2023-09-30T22:04:02.299 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-30T22:04:02.299 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_dparmar@teuthology --verbose --archive /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408039 --name dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi --description fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} 2-upgrade 3-workload/new_ops/{0-clients/kclient 1-client-sanity}}} -- /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408039/orig.config.yaml 2023-09-30T22:04:02.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T22:04:02.453 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408039 branch: fix-nfs-apply-err-reporting description: fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} 2-upgrade 3-workload/new_ops/{0-clients/kclient 1-client-sanity}}} email: null first_in_suite: false job_id: '7408039' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false machine_type: smithi name: dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 8.stream overrides: admin_socket: branch: fix-nfs-apply-err-reporting ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: bluestore warn on legacy statfs: false bluestore warn on no per pool omap: false mon pg warn min per osd: 0 ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on osd down out interval zero: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - scrub mismatch - ScrubResult - wrongly marked - \(POOL_APP_NOT_ENABLED\) - \(SLOW_OPS\) - overall HEALTH_ - \(MON_MSGR2_NOT_ENABLED\) - slow request sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-62953 sha1: 6973b24e3d99fd494b753449d2ea12077599cbd6 owner: scheduled_dparmar@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mgr.x - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - - client.0 seed: 2683 sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 sleep_before_teardown: 0 suite: fs:upgrade suite_branch: wip-62953 suite_path: /home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa suite_relpath: qa suite_repo: https://github.com/dparmar18/ceph suite_sha1: 6973b24e3d99fd494b753449d2ea12077599cbd6 targets: smithi040.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFqbonTGVhhSgPKdc3WgRKBJoXF6R9MoCundAIPrMI7XrrWDWgs5ddn0zAdLfSW36DtX6AUqZS0/w0Us6Btu74E= smithi158.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLxpTz0DsyBfPSCTqvRHySCxYwvLwOg+AjBFPHdLqxnAj6QEHJ13IdTerhOmu22y+fNeVavBgZTsLqlvCCQOpEY= tasks: - install: branch: pacific exclude_packages: - cephadm - ceph-mgr-cephadm - ceph-immutable-object-cache - python3-rados - python3-rgw - python3-rbd - python3-cephfs - ceph-volume extra_packages: - python-rados - python-rgw - python-rbd - python-cephfs extra_system_packages: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - print: '**** done installing pacific' - ceph: conf: global: mon warn on pool no app: false ms bind msgr2: false log-ignorelist: - overall HEALTH_ - \(FS_ - \(MDS_ - \(OSD_ - \(MON_DOWN\) - \(CACHE_POOL_ - \(POOL_ - \(MGR_DOWN\) - \(PG_ - \(SMALLER_PGP_NUM\) - Monitor daemon marked osd - Behind on trimming - Manager daemon - exec: osd.0: - ceph osd set-require-min-compat-client pacific - print: '**** done ceph' - kclient: null - mds_pre_upgrade: null - print: '**** done mds pre-upgrade sequence' - install.upgrade: mon.a: branch: reef - print: '**** done install.upgrade the host' - ceph.restart: daemons: - mon.* - mgr.* mon-health-to-clog: false wait-for-healthy: false - ceph.healthy: null - ceph.restart: daemons: - osd.* wait-for-healthy: false wait-for-osds-up: true - ceph.stop: - mds.* - ceph.restart: daemons: - mds.* wait-for-healthy: false wait-for-osds-up: true - exec: mon.a: - ceph osd dump -f json-pretty - ceph versions - for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done - ceph osd require-osd-release reef - ceph.healthy: null - print: '**** done ceph.restart' - cephfs_test_runner: modules: - tasks.cephfs.test_newops teuthology: branch: pacific fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end - if not is_kupstream() or syntax_version() == 'v2' then reject() end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-09-30_21:53:45 tube: smithi user: dparmar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-09-30T22:04:02.454 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa; will attempt to use it 2023-09-30T22:04:02.455 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks 2023-09-30T22:04:02.455 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-09-30T22:04:02.458 INFO:teuthology.task.internal:Checking packages... 2023-09-30T22:04:02.484 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3d6eb91756d99e822eeed7c6b783104a6ad86054' 2023-09-30T22:04:02.484 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-30T22:04:02.484 INFO:teuthology.packaging:ref: None 2023-09-30T22:04:02.484 INFO:teuthology.packaging:tag: None 2023-09-30T22:04:02.484 INFO:teuthology.packaging:branch: fix-nfs-apply-err-reporting 2023-09-30T22:04:02.484 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-09-30T22:04:02.485 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=fix-nfs-apply-err-reporting 2023-09-30T22:04:02.701 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5795.g3d6eb917 2023-09-30T22:04:02.701 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-09-30T22:04:02.711 INFO:teuthology.task.internal:no buildpackages task found 2023-09-30T22:04:02.712 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-09-30T22:04:02.758 INFO:teuthology.task.internal:Saving configuration 2023-09-30T22:04:02.777 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-09-30T22:04:02.786 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-30T22:04:02.815 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408039', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 21:58:22.084654', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFqbonTGVhhSgPKdc3WgRKBJoXF6R9MoCundAIPrMI7XrrWDWgs5ddn0zAdLfSW36DtX6AUqZS0/w0Us6Btu74E='} 2023-09-30T22:04:02.840 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi158.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408039', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 21:58:22.083050', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLxpTz0DsyBfPSCTqvRHySCxYwvLwOg+AjBFPHdLqxnAj6QEHJ13IdTerhOmu22y+fNeVavBgZTsLqlvCCQOpEY='} 2023-09-30T22:04:02.840 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-09-30T22:04:02.848 INFO:teuthology.task.internal:roles: ubuntu@smithi040.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2023-09-30T22:04:02.849 INFO:teuthology.task.internal:roles: ubuntu@smithi158.front.sepia.ceph.com - ['client.0'] 2023-09-30T22:04:02.849 INFO:teuthology.run_tasks:Running task console_log... 2023-09-30T22:04:02.943 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f491767af70>, signals=[15]) 2023-09-30T22:04:02.944 INFO:teuthology.run_tasks:Running task internal.connect... 2023-09-30T22:04:02.953 INFO:teuthology.task.internal:Opening connections... 2023-09-30T22:04:02.953 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi040.front.sepia.ceph.com 2023-09-30T22:04:02.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:04:03.024 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi158.front.sepia.ceph.com 2023-09-30T22:04:03.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:04:03.091 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-09-30T22:04:03.097 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2023-09-30T22:04:03.121 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2023-09-30T22:04:03.121 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2023-09-30T22:04:03.183 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2023-09-30T22:04:03.183 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="8" 2023-09-30T22:04:03.183 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2023-09-30T22:04:03.183 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2023-09-30T22:04:03.183 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="8" 2023-09-30T22:04:03.184 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el8" 2023-09-30T22:04:03.184 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-30T22:04:03.184 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2023-09-30T22:04:03.184 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-30T22:04:03.184 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2023-09-30T22:04:03.184 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-30T22:04:03.184 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-30T22:04:03.184 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-30T22:04:03.185 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2023-09-30T22:04:03.210 DEBUG:teuthology.orchestra.run.smithi158:> uname -m 2023-09-30T22:04:03.232 INFO:teuthology.orchestra.run.smithi158.stdout:x86_64 2023-09-30T22:04:03.233 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2023-09-30T22:04:03.293 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="CentOS Stream" 2023-09-30T22:04:03.293 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="8" 2023-09-30T22:04:03.293 INFO:teuthology.orchestra.run.smithi158.stdout:ID="centos" 2023-09-30T22:04:03.293 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="rhel fedora" 2023-09-30T22:04:03.293 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="8" 2023-09-30T22:04:03.293 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el8" 2023-09-30T22:04:03.294 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-30T22:04:03.294 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31" 2023-09-30T22:04:03.294 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-30T22:04:03.294 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://centos.org/" 2023-09-30T22:04:03.294 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-30T22:04:03.295 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-30T22:04:03.295 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-30T22:04:03.295 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2023-09-30T22:04:03.318 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-09-30T22:04:03.329 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-09-30T22:04:03.422 INFO:teuthology.task.internal:Checking for old test directory... 2023-09-30T22:04:03.422 DEBUG:teuthology.orchestra.run.smithi040:> test '!' -e /home/ubuntu/cephtest 2023-09-30T22:04:03.427 DEBUG:teuthology.orchestra.run.smithi158:> test '!' -e /home/ubuntu/cephtest 2023-09-30T22:04:03.450 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-09-30T22:04:03.460 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-09-30T22:04:03.461 DEBUG:teuthology.orchestra.run.smithi040:> test -z $(ls -A /var/lib/ceph) 2023-09-30T22:04:03.489 DEBUG:teuthology.orchestra.run.smithi158:> test -z $(ls -A /var/lib/ceph) 2023-09-30T22:04:03.522 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-09-30T22:04:03.588 INFO:teuthology.run_tasks:Running task kernel... 2023-09-30T22:04:03.611 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-09-30T22:04:03.612 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2023-09-30T22:04:03.612 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2023-09-30T22:04:03.612 DEBUG:teuthology.orchestra.run.smithi158:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-30T22:04:03.633 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:04:03.634 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-09-30T22:04:03.792 DEBUG:teuthology.task.kernel:sha1 for client.0 is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-30T22:04:03.792 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-09-30T22:04:03.792 DEBUG:teuthology.orchestra.run.smithi158:> uname -r 2023-09-30T22:04:03.814 INFO:teuthology.orchestra.run.smithi158.stdout:4.18.0-489.el8.x86_64 2023-09-30T22:04:03.814 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-30T22:04:03.814 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-09-30T22:04:03.815 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum upgrade -y linux-firmware 2023-09-30T22:04:08.278 INFO:teuthology.orchestra.run.smithi158.stdout:CentOS Stream 8 - AppStream 19 MB/s | 33 MB 00:01 2023-09-30T22:04:15.967 INFO:teuthology.orchestra.run.smithi158.stdout:CentOS Stream 8 - BaseOS 30 MB/s | 48 MB 00:01 2023-09-30T22:04:23.250 INFO:teuthology.orchestra.run.smithi158.stdout:CentOS Stream 8 - Extras 52 kB/s | 18 kB 00:00 2023-09-30T22:04:23.995 INFO:teuthology.orchestra.run.smithi158.stdout:CentOS Stream 8 - Extras common packages 12 kB/s | 6.9 kB 00:00 2023-09-30T22:04:24.281 INFO:teuthology.orchestra.run.smithi158.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-09-30T22:04:25.564 INFO:teuthology.orchestra.run.smithi158.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2023-09-30T22:04:29.422 INFO:teuthology.orchestra.run.smithi158.stdout:lab-extras 485 kB/s | 24 kB 00:00 2023-09-30T22:04:33.322 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-09-30T22:04:33.322 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-09-30T22:04:33.323 INFO:teuthology.orchestra.run.smithi158.stdout: Package Arch Version Repo Size 2023-09-30T22:04:33.323 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-09-30T22:04:33.323 INFO:teuthology.orchestra.run.smithi158.stdout:Upgrading: 2023-09-30T22:04:33.323 INFO:teuthology.orchestra.run.smithi158.stdout: linux-firmware noarch 20230824-118.git0e048b06.el8 baseos 286 M 2023-09-30T22:04:33.323 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:04:33.323 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2023-09-30T22:04:33.323 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-09-30T22:04:33.323 INFO:teuthology.orchestra.run.smithi158.stdout:Upgrade 1 Package 2023-09-30T22:04:33.323 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:04:33.324 INFO:teuthology.orchestra.run.smithi158.stdout:Total download size: 286 M 2023-09-30T22:04:33.324 INFO:teuthology.orchestra.run.smithi158.stdout:Downloading Packages: 2023-09-30T22:04:48.014 INFO:teuthology.orchestra.run.smithi158.stdout:linux-firmware-20230824-118.git0e048b06.el8.noa 20 MB/s | 286 MB 00:14 2023-09-30T22:04:48.014 INFO:teuthology.orchestra.run.smithi158.stdout:-------------------------------------------------------------------------------- 2023-09-30T22:04:48.014 INFO:teuthology.orchestra.run.smithi158.stdout:Total 19 MB/s | 286 MB 00:14 2023-09-30T22:04:49.713 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction check 2023-09-30T22:04:49.785 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction check succeeded. 2023-09-30T22:04:49.786 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction test 2023-09-30T22:04:51.555 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction test succeeded. 2023-09-30T22:04:51.589 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction 2023-09-30T22:05:10.733 INFO:teuthology.orchestra.run.smithi158.stdout: Preparing : 1/1 2023-09-30T22:05:11.148 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-09-30T22:05:11.399 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-09-30T22:05:11.623 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-09-30T22:05:11.623 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-09-30T22:05:12.359 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-09-30T22:05:12.359 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:05:12.359 INFO:teuthology.orchestra.run.smithi158.stdout:Upgraded: 2023-09-30T22:05:12.359 INFO:teuthology.orchestra.run.smithi158.stdout: linux-firmware-20230824-118.git0e048b06.el8.noarch 2023-09-30T22:05:12.360 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:05:12.360 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-09-30T22:05:12.564 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.0... 2023-09-30T22:05:12.564 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-30T22:05:12.939 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-09-30T22:05:12.940 DEBUG:teuthology.orchestra.run.smithi158:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-09-30T22:05:12.942 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi158.front.sepia.ceph.com to complete... 2023-09-30T22:05:25.798 INFO:teuthology.orchestra.run.smithi158.stderr:2023-09-30 22:05:25 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-09-30T22:05:25.798 INFO:teuthology.orchestra.run.smithi158.stderr:FINISHED --2023-09-30 22:05:25-- 2023-09-30T22:05:25.798 INFO:teuthology.orchestra.run.smithi158.stderr:Total wall clock time: 13s 2023-09-30T22:05:25.799 INFO:teuthology.orchestra.run.smithi158.stderr:Downloaded: 1 files, 363M in 13s (28.9 MB/s) 2023-09-30T22:05:25.800 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.0... 2023-09-30T22:05:25.800 DEBUG:teuthology.orchestra.run.smithi158:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-09-30T22:05:27.461 INFO:teuthology.orchestra.run.smithi158.stdout:Verifying... ######################################## 2023-09-30T22:05:27.506 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing... ######################################## 2023-09-30T22:05:27.616 INFO:teuthology.orchestra.run.smithi158.stdout:Updating / installing... 2023-09-30T22:06:05.703 INFO:teuthology.orchestra.run.smithi158.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-09-30T22:06:30.957 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi158.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-09-30T22:06:30.957 DEBUG:teuthology.orchestra.run.smithi158:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-09-30T22:06:31.014 INFO:teuthology.orchestra.run.smithi158.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-09-30T22:06:31.015 INFO:teuthology.orchestra.run.smithi158.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-09-30T22:06:31.015 INFO:teuthology.orchestra.run.smithi158.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-09-30T22:06:31.015 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-09-30T22:06:31.015 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-09-30T22:06:31.015 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-09-30T22:06:31.015 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-09-30T22:06:31.015 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-09-30T22:06:31.015 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-09-30T22:06:31.015 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-09-30T22:06:31.015 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-09-30T22:06:31.015 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-09-30T22:06:31.016 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-09-30T22:06:31.016 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-09-30T22:06:31.016 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-09-30T22:06:31.016 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-09-30T22:06:31.016 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-09-30T22:06:31.016 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-09-30T22:06:31.016 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-09-30T22:06:31.016 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-09-30T22:06:31.016 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-09-30T22:06:31.016 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-09-30T22:06:31.016 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-09-30T22:06:31.017 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-09-30T22:06:31.017 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-09-30T22:06:31.017 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-09-30T22:06:31.017 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-09-30T22:06:31.017 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-09-30T22:06:31.017 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-09-30T22:06:31.017 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-09-30T22:06:31.017 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-09-30T22:06:31.017 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-09-30T22:06:31.017 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-09-30T22:06:31.018 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-09-30T22:06:31.018 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-09-30T22:06:31.018 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-09-30T22:06:31.018 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-09-30T22:06:31.018 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-09-30T22:06:31.018 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-09-30T22:06:31.018 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-09-30T22:06:31.018 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-09-30T22:06:31.018 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-09-30T22:06:31.018 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-09-30T22:06:31.018 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-09-30T22:06:31.019 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-09-30T22:06:31.019 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-09-30T22:06:31.019 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-09-30T22:06:31.019 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-09-30T22:06:31.019 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-09-30T22:06:31.019 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-09-30T22:06:31.019 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-09-30T22:06:31.019 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-09-30T22:06:31.019 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-09-30T22:06:31.019 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-09-30T22:06:31.019 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-09-30T22:06:31.019 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-09-30T22:06:31.019 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-09-30T22:06:31.020 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-09-30T22:06:31.020 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-09-30T22:06:31.020 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-09-30T22:06:31.020 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-09-30T22:06:31.020 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-09-30T22:06:31.020 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-09-30T22:06:31.020 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-09-30T22:06:31.020 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-09-30T22:06:31.020 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-09-30T22:06:31.020 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-09-30T22:06:31.020 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-09-30T22:06:31.020 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-09-30T22:06:31.021 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-09-30T22:06:31.021 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-09-30T22:06:31.021 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-09-30T22:06:31.021 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-09-30T22:06:31.021 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-09-30T22:06:31.021 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-09-30T22:06:31.021 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-09-30T22:06:31.021 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-09-30T22:06:31.021 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-09-30T22:06:31.021 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-09-30T22:06:31.021 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-09-30T22:06:31.022 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-09-30T22:06:31.022 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-09-30T22:06:31.022 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-09-30T22:06:31.022 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-09-30T22:06:31.022 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-09-30T22:06:31.022 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-09-30T22:06:31.022 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-09-30T22:06:31.022 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-09-30T22:06:31.022 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-09-30T22:06:31.022 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-09-30T22:06:31.022 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-09-30T22:06:31.023 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-09-30T22:06:31.023 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-09-30T22:06:31.023 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-09-30T22:06:31.023 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-09-30T22:06:31.023 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-09-30T22:06:31.023 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-09-30T22:06:31.023 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-09-30T22:06:31.023 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-09-30T22:06:31.023 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-09-30T22:06:31.023 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-09-30T22:06:31.023 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-09-30T22:06:31.023 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-09-30T22:06:31.024 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-09-30T22:06:31.024 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-09-30T22:06:31.024 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-09-30T22:06:31.024 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-09-30T22:06:31.024 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-09-30T22:06:31.024 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-09-30T22:06:31.024 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-09-30T22:06:31.024 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-09-30T22:06:31.024 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-09-30T22:06:31.024 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-09-30T22:06:31.024 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-09-30T22:06:31.024 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-09-30T22:06:31.025 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-09-30T22:06:31.025 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-09-30T22:06:31.025 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-09-30T22:06:31.025 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-09-30T22:06:31.025 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-09-30T22:06:31.025 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-09-30T22:06:31.025 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-09-30T22:06:31.025 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-09-30T22:06:31.025 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-09-30T22:06:31.025 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-09-30T22:06:31.025 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-09-30T22:06:31.026 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-09-30T22:06:31.026 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-09-30T22:06:31.027 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-09-30T22:06:31.027 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-09-30T22:06:31.027 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-09-30T22:06:31.027 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-09-30T22:06:31.027 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-09-30T22:06:31.027 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-09-30T22:06:31.028 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-09-30T22:06:31.028 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-09-30T22:06:31.028 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-09-30T22:06:31.028 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-09-30T22:06:31.028 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-09-30T22:06:31.028 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-09-30T22:06:31.028 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-09-30T22:06:31.029 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-09-30T22:06:31.029 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-09-30T22:06:31.029 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-09-30T22:06:31.029 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-09-30T22:06:31.029 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-09-30T22:06:31.029 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-09-30T22:06:31.030 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-09-30T22:06:31.030 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-09-30T22:06:31.030 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-09-30T22:06:31.030 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-09-30T22:06:31.030 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-09-30T22:06:31.030 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-09-30T22:06:31.030 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-09-30T22:06:31.031 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-09-30T22:06:31.031 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-09-30T22:06:31.031 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-09-30T22:06:31.031 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-09-30T22:06:31.031 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-09-30T22:06:31.031 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-09-30T22:06:31.032 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-09-30T22:06:31.032 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-09-30T22:06:31.032 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-09-30T22:06:31.032 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-09-30T22:06:31.032 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-09-30T22:06:31.032 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-09-30T22:06:31.032 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-09-30T22:06:31.032 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-09-30T22:06:31.032 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-09-30T22:06:31.033 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-09-30T22:06:31.033 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-09-30T22:06:31.033 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-09-30T22:06:31.033 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-09-30T22:06:31.033 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-09-30T22:06:31.033 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-09-30T22:06:31.033 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-09-30T22:06:31.034 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-09-30T22:06:31.034 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-09-30T22:06:31.034 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-09-30T22:06:31.034 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-09-30T22:06:31.034 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-09-30T22:06:31.034 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-09-30T22:06:31.035 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-09-30T22:06:31.035 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-09-30T22:06:31.035 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-09-30T22:06:31.035 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-09-30T22:06:31.035 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-09-30T22:06:31.035 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-09-30T22:06:31.035 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-09-30T22:06:31.036 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-09-30T22:06:31.036 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-09-30T22:06:31.036 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-09-30T22:06:31.036 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-09-30T22:06:31.036 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-09-30T22:06:31.036 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-09-30T22:06:31.037 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-09-30T22:06:31.037 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-09-30T22:06:31.037 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-09-30T22:06:31.037 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-09-30T22:06:31.037 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-09-30T22:06:31.037 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-09-30T22:06:31.037 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-09-30T22:06:31.038 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-09-30T22:06:31.038 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-09-30T22:06:31.038 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-09-30T22:06:31.038 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-09-30T22:06:31.038 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-09-30T22:06:31.038 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-09-30T22:06:31.038 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-09-30T22:06:31.039 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-09-30T22:06:31.039 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-09-30T22:06:31.039 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-09-30T22:06:31.039 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-09-30T22:06:31.039 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-09-30T22:06:31.040 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-09-30T22:06:31.040 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-09-30T22:06:31.040 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-09-30T22:06:31.040 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-09-30T22:06:31.040 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-09-30T22:06:31.041 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-09-30T22:06:31.041 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-09-30T22:06:31.041 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-09-30T22:06:31.041 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-09-30T22:06:31.041 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-09-30T22:06:31.041 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-09-30T22:06:31.041 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-09-30T22:06:31.042 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-09-30T22:06:31.042 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-09-30T22:06:31.042 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-09-30T22:06:31.042 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-09-30T22:06:31.042 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-09-30T22:06:31.042 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-09-30T22:06:31.042 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-09-30T22:06:31.043 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-09-30T22:06:31.043 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-09-30T22:06:31.043 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-09-30T22:06:31.043 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-09-30T22:06:31.043 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-09-30T22:06:31.043 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-09-30T22:06:31.044 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-09-30T22:06:31.044 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-09-30T22:06:31.044 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-09-30T22:06:31.044 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-09-30T22:06:31.044 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-09-30T22:06:31.044 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-09-30T22:06:31.045 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-09-30T22:06:31.045 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-09-30T22:06:31.045 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-09-30T22:06:31.045 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-09-30T22:06:31.045 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-09-30T22:06:31.046 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-09-30T22:06:31.046 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-09-30T22:06:31.046 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-09-30T22:06:31.046 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-09-30T22:06:31.046 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-09-30T22:06:31.046 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-09-30T22:06:31.046 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-09-30T22:06:31.046 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-09-30T22:06:31.046 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-09-30T22:06:31.047 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-09-30T22:06:31.047 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-09-30T22:06:31.047 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-09-30T22:06:31.047 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-09-30T22:06:31.047 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-09-30T22:06:31.047 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-09-30T22:06:31.047 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-09-30T22:06:31.047 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-09-30T22:06:31.047 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-09-30T22:06:31.047 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-09-30T22:06:31.048 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-09-30T22:06:31.048 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-09-30T22:06:31.048 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-09-30T22:06:31.048 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-09-30T22:06:31.048 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-09-30T22:06:31.048 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-09-30T22:06:31.048 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-09-30T22:06:31.048 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-09-30T22:06:31.048 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-09-30T22:06:31.049 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-09-30T22:06:31.049 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-09-30T22:06:31.049 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-09-30T22:06:31.049 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-09-30T22:06:31.049 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-09-30T22:06:31.049 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-09-30T22:06:31.049 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-09-30T22:06:31.049 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-09-30T22:06:31.049 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-09-30T22:06:31.049 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-09-30T22:06:31.049 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-09-30T22:06:31.049 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-09-30T22:06:31.050 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-09-30T22:06:31.050 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-09-30T22:06:31.050 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-09-30T22:06:31.050 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-09-30T22:06:31.050 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-09-30T22:06:31.050 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-09-30T22:06:31.050 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-09-30T22:06:31.051 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-09-30T22:06:31.051 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-09-30T22:06:31.051 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-09-30T22:06:31.051 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-09-30T22:06:31.051 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-09-30T22:06:31.051 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-09-30T22:06:31.051 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-09-30T22:06:31.051 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-09-30T22:06:31.051 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-09-30T22:06:31.051 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-09-30T22:06:31.051 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-09-30T22:06:31.052 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-09-30T22:06:31.052 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-09-30T22:06:31.052 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-09-30T22:06:31.052 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-09-30T22:06:31.052 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-09-30T22:06:31.052 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-09-30T22:06:31.052 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-09-30T22:06:31.052 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-09-30T22:06:31.053 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-09-30T22:06:31.053 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-09-30T22:06:31.053 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-09-30T22:06:31.053 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-09-30T22:06:31.053 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-09-30T22:06:31.053 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-09-30T22:06:31.053 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-09-30T22:06:31.054 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-09-30T22:06:31.054 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-09-30T22:06:31.054 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-09-30T22:06:31.054 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-09-30T22:06:31.054 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-09-30T22:06:31.054 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-09-30T22:06:31.055 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-09-30T22:06:31.055 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-09-30T22:06:31.055 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-09-30T22:06:31.055 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-09-30T22:06:31.055 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-09-30T22:06:31.055 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-09-30T22:06:31.055 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-09-30T22:06:31.056 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-09-30T22:06:31.056 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-09-30T22:06:31.056 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-09-30T22:06:31.056 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-09-30T22:06:31.056 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-09-30T22:06:31.056 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-09-30T22:06:31.056 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-09-30T22:06:31.057 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-09-30T22:06:31.057 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-09-30T22:06:31.057 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-09-30T22:06:31.057 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-09-30T22:06:31.057 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-09-30T22:06:31.057 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-09-30T22:06:31.058 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-09-30T22:06:31.058 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-09-30T22:06:31.058 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-09-30T22:06:31.058 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-09-30T22:06:31.058 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-09-30T22:06:31.058 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-09-30T22:06:31.058 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-09-30T22:06:31.059 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-09-30T22:06:31.059 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-09-30T22:06:31.059 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-09-30T22:06:31.059 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-09-30T22:06:31.059 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-09-30T22:06:31.059 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-09-30T22:06:31.060 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-09-30T22:06:31.060 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-09-30T22:06:31.060 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-09-30T22:06:31.060 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-09-30T22:06:31.060 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-09-30T22:06:31.060 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-09-30T22:06:31.060 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-09-30T22:06:31.061 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-09-30T22:06:31.061 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-09-30T22:06:31.061 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-09-30T22:06:31.061 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-09-30T22:06:31.061 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-09-30T22:06:31.061 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-09-30T22:06:31.062 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-09-30T22:06:31.062 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-09-30T22:06:31.062 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-09-30T22:06:31.062 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-09-30T22:06:31.062 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-09-30T22:06:31.062 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-09-30T22:06:31.063 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-09-30T22:06:31.063 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-09-30T22:06:31.063 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-09-30T22:06:31.063 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-09-30T22:06:31.063 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-09-30T22:06:31.063 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-09-30T22:06:31.064 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-09-30T22:06:31.064 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-09-30T22:06:31.064 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-09-30T22:06:31.064 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-09-30T22:06:31.064 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-09-30T22:06:31.064 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-09-30T22:06:31.064 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-09-30T22:06:31.065 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-09-30T22:06:31.065 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-09-30T22:06:31.065 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-09-30T22:06:31.065 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-09-30T22:06:31.065 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-09-30T22:06:31.065 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-09-30T22:06:31.065 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-09-30T22:06:31.065 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-09-30T22:06:31.065 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-09-30T22:06:31.065 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-09-30T22:06:31.065 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-09-30T22:06:31.066 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-09-30T22:06:31.066 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-09-30T22:06:31.066 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-09-30T22:06:31.066 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-09-30T22:06:31.066 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-09-30T22:06:31.066 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-09-30T22:06:31.066 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-09-30T22:06:31.066 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-09-30T22:06:31.067 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-09-30T22:06:31.067 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-09-30T22:06:31.067 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-09-30T22:06:31.067 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-09-30T22:06:31.067 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-09-30T22:06:31.067 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-09-30T22:06:31.067 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-09-30T22:06:31.068 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-09-30T22:06:31.068 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-09-30T22:06:31.068 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-09-30T22:06:31.068 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-09-30T22:06:31.068 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-09-30T22:06:31.068 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-09-30T22:06:31.068 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-09-30T22:06:31.069 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-09-30T22:06:31.069 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-09-30T22:06:31.069 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-09-30T22:06:31.069 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-09-30T22:06:31.069 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-09-30T22:06:31.069 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-09-30T22:06:31.070 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-09-30T22:06:31.070 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-09-30T22:06:31.070 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-09-30T22:06:31.070 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-09-30T22:06:31.070 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-09-30T22:06:31.073 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-09-30T22:06:31.073 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-09-30T22:06:31.073 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-09-30T22:06:31.073 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-09-30T22:06:31.074 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-09-30T22:06:31.074 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-09-30T22:06:31.074 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-09-30T22:06:31.074 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-09-30T22:06:31.074 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-09-30T22:06:31.074 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-09-30T22:06:31.075 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-09-30T22:06:31.075 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-09-30T22:06:31.075 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-09-30T22:06:31.075 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-09-30T22:06:31.075 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-09-30T22:06:31.075 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-09-30T22:06:31.075 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-09-30T22:06:31.076 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-09-30T22:06:31.076 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-09-30T22:06:31.076 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-09-30T22:06:31.076 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-09-30T22:06:31.076 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-09-30T22:06:31.076 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-09-30T22:06:31.077 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-09-30T22:06:31.077 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-09-30T22:06:31.077 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-09-30T22:06:31.077 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-09-30T22:06:31.077 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-09-30T22:06:31.077 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-09-30T22:06:31.077 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-09-30T22:06:31.078 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-09-30T22:06:31.078 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-09-30T22:06:31.078 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-09-30T22:06:31.078 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-09-30T22:06:31.078 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-09-30T22:06:31.078 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-09-30T22:06:31.079 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-09-30T22:06:31.079 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-09-30T22:06:31.079 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-09-30T22:06:31.079 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-09-30T22:06:31.079 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-09-30T22:06:31.079 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-09-30T22:06:31.079 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-09-30T22:06:31.080 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-09-30T22:06:31.080 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-09-30T22:06:31.080 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-09-30T22:06:31.080 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-09-30T22:06:31.080 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-09-30T22:06:31.080 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-09-30T22:06:31.080 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-09-30T22:06:31.081 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-09-30T22:06:31.081 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-09-30T22:06:31.081 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-09-30T22:06:31.081 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-09-30T22:06:31.081 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-09-30T22:06:31.081 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-09-30T22:06:31.082 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-09-30T22:06:31.082 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-09-30T22:06:31.082 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-09-30T22:06:31.082 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-09-30T22:06:31.082 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-09-30T22:06:31.082 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-09-30T22:06:31.082 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-09-30T22:06:31.083 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-09-30T22:06:31.083 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-09-30T22:06:31.083 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-09-30T22:06:31.083 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-09-30T22:06:31.083 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-09-30T22:06:31.083 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-09-30T22:06:31.083 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-09-30T22:06:31.083 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-09-30T22:06:31.083 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-09-30T22:06:31.083 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-09-30T22:06:31.083 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-09-30T22:06:31.083 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-09-30T22:06:31.084 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-09-30T22:06:31.084 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-09-30T22:06:31.084 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-09-30T22:06:31.084 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-09-30T22:06:31.084 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-09-30T22:06:31.084 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-09-30T22:06:31.084 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-09-30T22:06:31.084 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-09-30T22:06:31.084 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-09-30T22:06:31.084 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-09-30T22:06:31.084 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-09-30T22:06:31.084 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-09-30T22:06:31.084 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-09-30T22:06:31.085 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-09-30T22:06:31.085 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-09-30T22:06:31.085 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-09-30T22:06:31.085 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-09-30T22:06:31.085 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-09-30T22:06:31.085 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-09-30T22:06:31.085 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-09-30T22:06:31.085 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-09-30T22:06:31.085 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-09-30T22:06:31.085 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-09-30T22:06:31.085 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-09-30T22:06:31.085 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-09-30T22:06:31.086 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-09-30T22:06:31.086 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-09-30T22:06:31.086 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-09-30T22:06:31.086 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-09-30T22:06:31.086 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-09-30T22:06:31.086 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-09-30T22:06:31.086 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-09-30T22:06:31.086 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-09-30T22:06:31.086 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-09-30T22:06:31.086 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-09-30T22:06:31.086 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-09-30T22:06:31.086 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-09-30T22:06:31.087 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-09-30T22:06:31.087 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-09-30T22:06:31.087 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-09-30T22:06:31.087 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-09-30T22:06:31.087 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-09-30T22:06:31.087 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-09-30T22:06:31.087 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-09-30T22:06:31.087 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-09-30T22:06:31.087 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-09-30T22:06:31.087 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-09-30T22:06:31.087 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-09-30T22:06:31.087 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-09-30T22:06:31.087 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-09-30T22:06:31.088 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-09-30T22:06:31.088 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-09-30T22:06:31.088 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-09-30T22:06:31.088 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-09-30T22:06:31.088 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-09-30T22:06:31.088 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-09-30T22:06:31.088 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-09-30T22:06:31.088 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-09-30T22:06:31.088 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-09-30T22:06:31.089 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-09-30T22:06:31.089 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-09-30T22:06:31.089 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-09-30T22:06:31.089 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-09-30T22:06:31.089 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-09-30T22:06:31.089 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-09-30T22:06:31.089 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-09-30T22:06:31.089 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-09-30T22:06:31.089 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-09-30T22:06:31.089 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-09-30T22:06:31.089 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-09-30T22:06:31.089 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-09-30T22:06:31.090 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-09-30T22:06:31.090 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-09-30T22:06:31.090 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-09-30T22:06:31.090 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-09-30T22:06:31.090 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-09-30T22:06:31.090 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-09-30T22:06:31.090 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-09-30T22:06:31.090 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-09-30T22:06:31.090 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-09-30T22:06:31.090 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-09-30T22:06:31.091 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-09-30T22:06:31.091 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-09-30T22:06:31.091 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-09-30T22:06:31.091 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-09-30T22:06:31.091 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-09-30T22:06:31.091 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-09-30T22:06:31.091 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-09-30T22:06:31.091 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-09-30T22:06:31.091 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-09-30T22:06:31.091 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-09-30T22:06:31.091 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-09-30T22:06:31.091 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-09-30T22:06:31.092 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-09-30T22:06:31.092 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-09-30T22:06:31.092 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-09-30T22:06:31.092 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-09-30T22:06:31.092 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-09-30T22:06:31.092 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-09-30T22:06:31.092 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-09-30T22:06:31.092 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-09-30T22:06:31.092 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-09-30T22:06:31.092 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-09-30T22:06:31.093 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-09-30T22:06:31.093 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-09-30T22:06:31.093 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-09-30T22:06:31.093 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-09-30T22:06:31.093 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-09-30T22:06:31.093 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-09-30T22:06:31.093 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-09-30T22:06:31.093 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-09-30T22:06:31.093 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-09-30T22:06:31.094 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-09-30T22:06:31.094 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-09-30T22:06:31.094 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-09-30T22:06:31.094 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-09-30T22:06:31.094 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-09-30T22:06:31.094 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-09-30T22:06:31.094 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-09-30T22:06:31.094 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-09-30T22:06:31.094 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-09-30T22:06:31.094 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-09-30T22:06:31.094 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-09-30T22:06:31.095 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-09-30T22:06:31.095 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-09-30T22:06:31.095 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-09-30T22:06:31.095 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-09-30T22:06:31.095 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-09-30T22:06:31.095 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-09-30T22:06:31.095 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-09-30T22:06:31.095 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-09-30T22:06:31.095 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-09-30T22:06:31.095 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-09-30T22:06:31.095 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-09-30T22:06:31.095 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-09-30T22:06:31.095 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-09-30T22:06:31.096 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-09-30T22:06:31.096 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-09-30T22:06:31.096 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-09-30T22:06:31.096 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-09-30T22:06:31.096 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-09-30T22:06:31.096 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-09-30T22:06:31.096 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-09-30T22:06:31.096 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-09-30T22:06:31.096 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-09-30T22:06:31.096 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-09-30T22:06:31.096 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-09-30T22:06:31.096 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-09-30T22:06:31.097 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-09-30T22:06:31.097 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-09-30T22:06:31.097 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-09-30T22:06:31.097 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-09-30T22:06:31.097 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-09-30T22:06:31.097 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-09-30T22:06:31.097 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-09-30T22:06:31.097 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-09-30T22:06:31.097 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-09-30T22:06:31.097 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-09-30T22:06:31.097 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-09-30T22:06:31.097 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-09-30T22:06:31.098 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-09-30T22:06:31.098 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-09-30T22:06:31.098 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-09-30T22:06:31.098 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-09-30T22:06:31.098 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-09-30T22:06:31.098 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-09-30T22:06:31.098 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-09-30T22:06:31.098 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-09-30T22:06:31.098 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-09-30T22:06:31.098 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-09-30T22:06:31.098 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-09-30T22:06:31.099 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-09-30T22:06:31.099 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-09-30T22:06:31.099 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-09-30T22:06:31.099 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-09-30T22:06:31.099 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-09-30T22:06:31.099 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-09-30T22:06:31.100 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-09-30T22:06:31.100 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-09-30T22:06:31.100 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-09-30T22:06:31.100 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-09-30T22:06:31.100 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-09-30T22:06:31.101 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-09-30T22:06:31.101 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-09-30T22:06:31.101 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-09-30T22:06:31.101 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-09-30T22:06:31.101 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-09-30T22:06:31.101 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-09-30T22:06:31.102 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-09-30T22:06:31.102 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-09-30T22:06:31.102 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-09-30T22:06:31.102 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-09-30T22:06:31.102 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-09-30T22:06:31.102 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-09-30T22:06:31.103 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-09-30T22:06:31.103 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-09-30T22:06:31.103 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-09-30T22:06:31.103 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-09-30T22:06:31.103 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-09-30T22:06:31.103 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-09-30T22:06:31.103 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-09-30T22:06:31.103 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-09-30T22:06:31.103 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-09-30T22:06:31.103 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-09-30T22:06:31.103 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-09-30T22:06:31.104 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-09-30T22:06:31.104 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-09-30T22:06:31.104 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-09-30T22:06:31.104 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-09-30T22:06:31.104 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-09-30T22:06:31.104 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-09-30T22:06:31.104 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-09-30T22:06:31.104 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-09-30T22:06:31.104 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-09-30T22:06:31.104 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-09-30T22:06:31.104 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-09-30T22:06:31.104 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-09-30T22:06:31.105 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-09-30T22:06:31.105 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-09-30T22:06:31.105 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-09-30T22:06:31.105 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-09-30T22:06:31.105 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-09-30T22:06:31.105 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-09-30T22:06:31.105 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-09-30T22:06:31.105 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-09-30T22:06:31.105 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-09-30T22:06:31.105 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-09-30T22:06:31.105 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-09-30T22:06:31.105 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-09-30T22:06:31.106 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-09-30T22:06:31.106 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-09-30T22:06:31.106 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-09-30T22:06:31.106 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-09-30T22:06:31.106 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-09-30T22:06:31.106 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-09-30T22:06:31.106 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-09-30T22:06:31.106 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-09-30T22:06:31.106 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-09-30T22:06:31.106 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-09-30T22:06:31.106 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-09-30T22:06:31.106 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-09-30T22:06:31.107 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-09-30T22:06:31.107 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-09-30T22:06:31.107 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-09-30T22:06:31.107 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-09-30T22:06:31.107 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-09-30T22:06:31.107 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-09-30T22:06:31.107 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-09-30T22:06:31.107 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-09-30T22:06:31.107 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-09-30T22:06:31.107 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-09-30T22:06:31.107 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-09-30T22:06:31.108 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-09-30T22:06:31.108 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-09-30T22:06:31.108 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-09-30T22:06:31.108 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-09-30T22:06:31.108 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-09-30T22:06:31.108 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-09-30T22:06:31.108 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-09-30T22:06:31.108 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-09-30T22:06:31.108 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-09-30T22:06:31.108 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-09-30T22:06:31.108 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-09-30T22:06:31.108 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-09-30T22:06:31.109 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-09-30T22:06:31.109 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-09-30T22:06:31.109 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-09-30T22:06:31.109 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-09-30T22:06:31.109 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-09-30T22:06:31.109 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-09-30T22:06:31.109 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-09-30T22:06:31.109 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-09-30T22:06:31.109 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-09-30T22:06:31.109 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-09-30T22:06:31.109 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-09-30T22:06:31.109 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-09-30T22:06:31.110 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-09-30T22:06:31.110 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-09-30T22:06:31.110 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-09-30T22:06:31.110 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-09-30T22:06:31.110 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-09-30T22:06:31.110 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-09-30T22:06:31.110 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-09-30T22:06:31.110 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-09-30T22:06:31.110 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-09-30T22:06:31.110 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-09-30T22:06:31.110 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-09-30T22:06:31.110 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-09-30T22:06:31.111 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-09-30T22:06:31.111 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-09-30T22:06:31.111 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-09-30T22:06:31.111 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-09-30T22:06:31.111 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-09-30T22:06:31.111 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-09-30T22:06:31.111 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-09-30T22:06:31.111 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-09-30T22:06:31.111 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-09-30T22:06:31.111 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-09-30T22:06:31.111 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-09-30T22:06:31.111 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-09-30T22:06:31.112 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-09-30T22:06:31.112 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-09-30T22:06:31.112 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-09-30T22:06:31.112 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-09-30T22:06:31.112 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-09-30T22:06:31.112 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-09-30T22:06:31.112 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-09-30T22:06:31.112 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-09-30T22:06:31.112 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-09-30T22:06:31.112 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-09-30T22:06:31.112 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-09-30T22:06:31.112 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-09-30T22:06:31.113 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-09-30T22:06:31.113 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-09-30T22:06:31.113 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-09-30T22:06:31.113 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-09-30T22:06:31.113 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-09-30T22:06:31.113 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-09-30T22:06:31.113 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-09-30T22:06:31.113 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-09-30T22:06:31.113 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-09-30T22:06:31.113 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-09-30T22:06:31.113 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-09-30T22:06:31.113 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-09-30T22:06:31.113 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-09-30T22:06:31.114 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-09-30T22:06:31.114 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-09-30T22:06:31.114 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-09-30T22:06:31.114 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-09-30T22:06:31.114 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-09-30T22:06:31.114 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-09-30T22:06:31.114 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-09-30T22:06:31.114 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-09-30T22:06:31.114 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-09-30T22:06:31.114 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-09-30T22:06:31.114 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-09-30T22:06:31.114 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-09-30T22:06:31.115 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-09-30T22:06:31.115 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-09-30T22:06:31.115 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-09-30T22:06:31.115 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-09-30T22:06:31.115 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-09-30T22:06:31.115 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-09-30T22:06:31.115 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-09-30T22:06:31.115 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-09-30T22:06:31.115 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-09-30T22:06:31.115 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-09-30T22:06:31.115 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-09-30T22:06:31.115 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-09-30T22:06:31.116 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-09-30T22:06:31.116 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-09-30T22:06:31.116 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-09-30T22:06:31.116 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-09-30T22:06:31.116 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-09-30T22:06:31.116 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-09-30T22:06:31.116 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-09-30T22:06:31.116 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-09-30T22:06:31.116 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-09-30T22:06:31.116 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-09-30T22:06:31.116 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-09-30T22:06:31.116 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-09-30T22:06:31.117 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-09-30T22:06:31.117 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-09-30T22:06:31.117 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-09-30T22:06:31.117 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-09-30T22:06:31.117 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-09-30T22:06:31.117 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-09-30T22:06:31.117 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-09-30T22:06:31.117 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-09-30T22:06:31.117 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-09-30T22:06:31.117 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-09-30T22:06:31.117 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-09-30T22:06:31.117 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-09-30T22:06:31.117 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-09-30T22:06:31.118 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-09-30T22:06:31.118 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-09-30T22:06:31.118 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-09-30T22:06:31.118 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-09-30T22:06:31.118 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-09-30T22:06:31.118 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-09-30T22:06:31.118 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-09-30T22:06:31.118 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-09-30T22:06:31.118 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-09-30T22:06:31.118 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-09-30T22:06:31.118 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-09-30T22:06:31.118 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-09-30T22:06:31.119 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-09-30T22:06:31.119 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-09-30T22:06:31.119 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-09-30T22:06:31.119 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-09-30T22:06:31.119 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-09-30T22:06:31.119 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-09-30T22:06:31.119 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-09-30T22:06:31.119 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-09-30T22:06:31.119 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-09-30T22:06:31.119 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-09-30T22:06:31.119 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-09-30T22:06:31.120 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-09-30T22:06:31.120 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-09-30T22:06:31.120 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-09-30T22:06:31.120 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-09-30T22:06:31.120 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-09-30T22:06:31.120 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-09-30T22:06:31.120 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-09-30T22:06:31.120 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-09-30T22:06:31.120 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-09-30T22:06:31.120 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-09-30T22:06:31.120 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-09-30T22:06:31.120 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-09-30T22:06:31.121 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-09-30T22:06:31.121 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-09-30T22:06:31.121 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-09-30T22:06:31.121 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-09-30T22:06:31.121 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-09-30T22:06:31.121 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-09-30T22:06:31.121 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-09-30T22:06:31.121 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-09-30T22:06:31.121 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-09-30T22:06:31.121 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-09-30T22:06:31.121 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-09-30T22:06:31.121 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-09-30T22:06:31.122 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-09-30T22:06:31.122 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-09-30T22:06:31.122 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-09-30T22:06:31.122 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-09-30T22:06:31.122 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-09-30T22:06:31.122 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-09-30T22:06:31.122 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-09-30T22:06:31.122 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-09-30T22:06:31.122 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-09-30T22:06:31.122 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-09-30T22:06:31.122 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-09-30T22:06:31.122 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-09-30T22:06:31.123 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-09-30T22:06:31.123 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-09-30T22:06:31.123 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-09-30T22:06:31.123 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-09-30T22:06:31.123 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-09-30T22:06:31.123 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-09-30T22:06:31.123 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-09-30T22:06:31.123 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-09-30T22:06:31.123 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-09-30T22:06:31.123 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-09-30T22:06:31.123 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-09-30T22:06:31.123 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-09-30T22:06:31.123 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-09-30T22:06:31.124 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-09-30T22:06:31.124 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-09-30T22:06:31.124 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-09-30T22:06:31.124 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-09-30T22:06:31.124 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-09-30T22:06:31.124 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-09-30T22:06:31.124 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-09-30T22:06:31.124 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-09-30T22:06:31.124 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-09-30T22:06:31.124 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-09-30T22:06:31.124 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-09-30T22:06:31.124 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-09-30T22:06:31.125 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-09-30T22:06:31.125 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-09-30T22:06:31.125 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-09-30T22:06:31.125 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-09-30T22:06:31.125 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-09-30T22:06:31.125 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-09-30T22:06:31.125 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-09-30T22:06:31.125 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-09-30T22:06:31.125 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-09-30T22:06:31.125 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-09-30T22:06:31.125 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-09-30T22:06:31.125 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-09-30T22:06:31.125 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-09-30T22:06:31.126 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-09-30T22:06:31.126 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-09-30T22:06:31.126 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-09-30T22:06:31.126 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-09-30T22:06:31.126 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-09-30T22:06:31.126 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-09-30T22:06:31.126 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-09-30T22:06:31.126 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-09-30T22:06:31.126 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-09-30T22:06:31.126 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-09-30T22:06:31.126 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-09-30T22:06:31.126 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-09-30T22:06:31.126 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-09-30T22:06:31.127 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-09-30T22:06:31.127 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-09-30T22:06:31.127 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-09-30T22:06:31.127 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-09-30T22:06:31.127 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-09-30T22:06:31.127 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-09-30T22:06:31.127 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-09-30T22:06:31.127 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-09-30T22:06:31.127 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-09-30T22:06:31.127 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-09-30T22:06:31.127 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-09-30T22:06:31.127 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-09-30T22:06:31.128 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-09-30T22:06:31.128 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-09-30T22:06:31.128 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-09-30T22:06:31.128 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-09-30T22:06:31.128 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-09-30T22:06:31.128 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-09-30T22:06:31.128 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-09-30T22:06:31.128 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-09-30T22:06:31.128 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-09-30T22:06:31.128 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-09-30T22:06:31.128 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-09-30T22:06:31.128 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-09-30T22:06:31.128 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-09-30T22:06:31.129 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-09-30T22:06:31.129 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-09-30T22:06:31.129 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-09-30T22:06:31.129 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-09-30T22:06:31.129 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-09-30T22:06:31.129 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-09-30T22:06:31.129 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-09-30T22:06:31.129 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-09-30T22:06:31.129 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-09-30T22:06:31.129 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-09-30T22:06:31.129 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-09-30T22:06:31.129 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-09-30T22:06:31.130 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-09-30T22:06:31.130 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-09-30T22:06:31.130 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-09-30T22:06:31.130 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-09-30T22:06:31.130 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-09-30T22:06:31.130 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-09-30T22:06:31.130 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-09-30T22:06:31.130 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-09-30T22:06:31.130 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-09-30T22:06:31.130 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-09-30T22:06:31.130 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-09-30T22:06:31.130 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-09-30T22:06:31.131 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-09-30T22:06:31.131 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-09-30T22:06:31.131 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-09-30T22:06:31.131 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-09-30T22:06:31.131 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-09-30T22:06:31.131 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-09-30T22:06:31.131 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-09-30T22:06:31.131 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-09-30T22:06:31.131 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-09-30T22:06:31.131 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-09-30T22:06:31.131 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-09-30T22:06:31.131 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-09-30T22:06:31.131 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-09-30T22:06:31.132 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-09-30T22:06:31.132 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-09-30T22:06:31.132 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-09-30T22:06:31.132 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-09-30T22:06:31.132 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-09-30T22:06:31.132 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-09-30T22:06:31.132 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-09-30T22:06:31.132 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-09-30T22:06:31.132 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-09-30T22:06:31.132 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-09-30T22:06:31.132 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-09-30T22:06:31.132 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-09-30T22:06:31.132 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-09-30T22:06:31.133 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-09-30T22:06:31.133 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-09-30T22:06:31.133 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-09-30T22:06:31.133 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-09-30T22:06:31.133 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-09-30T22:06:31.133 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-09-30T22:06:31.133 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-09-30T22:06:31.133 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-09-30T22:06:31.133 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-09-30T22:06:31.133 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-09-30T22:06:31.133 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-09-30T22:06:31.133 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-09-30T22:06:31.133 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-09-30T22:06:31.134 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-09-30T22:06:31.134 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-09-30T22:06:31.134 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-09-30T22:06:31.134 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-09-30T22:06:31.134 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-09-30T22:06:31.134 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-09-30T22:06:31.134 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-09-30T22:06:31.134 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-09-30T22:06:31.134 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-09-30T22:06:31.134 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-09-30T22:06:31.134 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-09-30T22:06:31.134 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-09-30T22:06:31.134 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-09-30T22:06:31.135 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-09-30T22:06:31.135 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-09-30T22:06:31.135 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-09-30T22:06:31.135 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-09-30T22:06:31.135 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-09-30T22:06:31.135 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-09-30T22:06:31.135 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-09-30T22:06:31.135 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-09-30T22:06:31.135 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-09-30T22:06:31.135 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-09-30T22:06:31.135 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-09-30T22:06:31.135 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-09-30T22:06:31.135 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-09-30T22:06:31.136 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-09-30T22:06:31.136 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-09-30T22:06:31.136 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-09-30T22:06:31.136 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-09-30T22:06:31.136 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-09-30T22:06:31.136 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-09-30T22:06:31.136 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-09-30T22:06:31.136 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-09-30T22:06:31.136 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-09-30T22:06:31.136 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-09-30T22:06:31.136 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-09-30T22:06:31.136 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-09-30T22:06:31.137 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-09-30T22:06:31.137 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-09-30T22:06:31.137 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-09-30T22:06:31.137 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-09-30T22:06:31.137 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-09-30T22:06:31.137 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-09-30T22:06:31.137 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-09-30T22:06:31.137 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-09-30T22:06:31.137 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-09-30T22:06:31.137 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-09-30T22:06:31.137 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-09-30T22:06:31.137 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-09-30T22:06:31.137 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-09-30T22:06:31.138 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-09-30T22:06:31.138 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-09-30T22:06:31.138 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-09-30T22:06:31.138 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-09-30T22:06:31.138 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-09-30T22:06:31.138 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-09-30T22:06:31.138 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-09-30T22:06:31.138 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-09-30T22:06:31.138 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-09-30T22:06:31.138 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-09-30T22:06:31.138 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-09-30T22:06:31.139 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-09-30T22:06:31.139 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-09-30T22:06:31.139 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-09-30T22:06:31.139 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-09-30T22:06:31.139 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-09-30T22:06:31.139 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-09-30T22:06:31.139 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-09-30T22:06:31.139 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-09-30T22:06:31.139 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-09-30T22:06:31.139 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-09-30T22:06:31.139 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-09-30T22:06:31.139 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-09-30T22:06:31.139 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-09-30T22:06:31.140 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-09-30T22:06:31.140 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-09-30T22:06:31.140 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-09-30T22:06:31.140 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-09-30T22:06:31.140 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-09-30T22:06:31.140 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-09-30T22:06:31.140 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-09-30T22:06:31.140 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-09-30T22:06:31.140 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-09-30T22:06:31.140 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-09-30T22:06:31.140 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-09-30T22:06:31.140 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-09-30T22:06:31.141 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-09-30T22:06:31.141 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-09-30T22:06:31.141 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-09-30T22:06:31.141 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-09-30T22:06:31.141 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-09-30T22:06:31.141 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-09-30T22:06:31.141 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-09-30T22:06:31.141 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-09-30T22:06:31.141 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-09-30T22:06:31.141 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-09-30T22:06:31.141 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-09-30T22:06:31.141 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-09-30T22:06:31.141 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-09-30T22:06:31.142 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-09-30T22:06:31.142 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-09-30T22:06:31.142 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-09-30T22:06:31.142 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-09-30T22:06:31.142 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-09-30T22:06:31.142 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-09-30T22:06:31.142 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-09-30T22:06:31.142 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-09-30T22:06:31.142 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-09-30T22:06:31.142 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-09-30T22:06:31.142 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-09-30T22:06:31.142 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-09-30T22:06:31.142 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-09-30T22:06:31.143 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-09-30T22:06:31.143 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-09-30T22:06:31.143 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-09-30T22:06:31.143 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-09-30T22:06:31.143 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-09-30T22:06:31.143 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-09-30T22:06:31.143 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-09-30T22:06:31.143 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-09-30T22:06:31.143 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-09-30T22:06:31.143 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-09-30T22:06:31.143 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-09-30T22:06:31.143 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-09-30T22:06:31.143 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-09-30T22:06:31.144 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-09-30T22:06:31.144 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-09-30T22:06:31.144 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-09-30T22:06:31.144 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-09-30T22:06:31.144 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-09-30T22:06:31.144 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-09-30T22:06:31.144 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-09-30T22:06:31.144 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-09-30T22:06:31.144 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-09-30T22:06:31.144 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-09-30T22:06:31.144 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-09-30T22:06:31.144 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-09-30T22:06:31.145 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-09-30T22:06:31.145 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-09-30T22:06:31.145 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-09-30T22:06:31.145 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-09-30T22:06:31.145 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-09-30T22:06:31.145 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-09-30T22:06:31.145 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-09-30T22:06:31.145 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-09-30T22:06:31.145 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-09-30T22:06:31.145 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-09-30T22:06:31.145 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-09-30T22:06:31.145 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-09-30T22:06:31.145 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-09-30T22:06:31.146 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-09-30T22:06:31.146 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-09-30T22:06:31.146 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-09-30T22:06:31.146 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-09-30T22:06:31.146 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-09-30T22:06:31.146 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-09-30T22:06:31.146 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-09-30T22:06:31.146 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-09-30T22:06:31.146 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-09-30T22:06:31.146 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-09-30T22:06:31.146 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-09-30T22:06:31.146 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-09-30T22:06:31.147 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-09-30T22:06:31.147 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-09-30T22:06:31.147 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-09-30T22:06:31.147 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-09-30T22:06:31.147 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-09-30T22:06:31.147 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-09-30T22:06:31.147 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-09-30T22:06:31.147 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-09-30T22:06:31.147 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-09-30T22:06:31.147 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-09-30T22:06:31.147 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-09-30T22:06:31.147 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-09-30T22:06:31.147 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-09-30T22:06:31.148 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-09-30T22:06:31.148 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-09-30T22:06:31.148 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-09-30T22:06:31.148 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-09-30T22:06:31.148 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-09-30T22:06:31.148 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-09-30T22:06:31.148 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-09-30T22:06:31.148 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-09-30T22:06:31.148 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-09-30T22:06:31.148 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-09-30T22:06:31.148 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-09-30T22:06:31.148 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-09-30T22:06:31.149 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-09-30T22:06:31.149 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-09-30T22:06:31.149 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-09-30T22:06:31.149 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-09-30T22:06:31.149 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-09-30T22:06:31.149 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-09-30T22:06:31.149 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-09-30T22:06:31.149 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-09-30T22:06:31.149 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-09-30T22:06:31.149 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-09-30T22:06:31.149 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-09-30T22:06:31.149 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-09-30T22:06:31.149 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-09-30T22:06:31.150 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-09-30T22:06:31.150 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-09-30T22:06:31.150 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-09-30T22:06:31.150 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-09-30T22:06:31.150 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-09-30T22:06:31.150 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-09-30T22:06:31.150 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-09-30T22:06:31.150 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-09-30T22:06:31.150 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-09-30T22:06:31.150 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-09-30T22:06:31.150 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-09-30T22:06:31.150 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-09-30T22:06:31.151 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-09-30T22:06:31.151 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-09-30T22:06:31.151 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-09-30T22:06:31.151 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-09-30T22:06:31.151 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-09-30T22:06:31.151 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-09-30T22:06:31.151 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-09-30T22:06:31.151 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-09-30T22:06:31.151 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-09-30T22:06:31.151 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-09-30T22:06:31.151 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-09-30T22:06:31.151 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-09-30T22:06:31.151 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-09-30T22:06:31.152 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-09-30T22:06:31.152 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-09-30T22:06:31.152 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-09-30T22:06:31.152 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-09-30T22:06:31.152 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-09-30T22:06:31.152 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-09-30T22:06:31.152 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-09-30T22:06:31.152 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-09-30T22:06:31.152 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-09-30T22:06:31.152 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-09-30T22:06:31.152 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-09-30T22:06:31.152 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-09-30T22:06:31.153 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-09-30T22:06:31.153 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-09-30T22:06:31.153 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-09-30T22:06:31.153 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-09-30T22:06:31.153 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-09-30T22:06:31.153 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-09-30T22:06:31.153 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-09-30T22:06:31.153 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-09-30T22:06:31.153 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-09-30T22:06:31.153 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-09-30T22:06:31.153 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-09-30T22:06:31.153 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-09-30T22:06:31.153 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-09-30T22:06:31.154 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-09-30T22:06:31.154 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-09-30T22:06:31.154 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-09-30T22:06:31.154 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-09-30T22:06:31.154 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-09-30T22:06:31.154 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-09-30T22:06:31.154 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-09-30T22:06:31.154 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-09-30T22:06:31.154 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-09-30T22:06:31.154 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-09-30T22:06:31.154 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-09-30T22:06:31.154 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-09-30T22:06:31.154 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-09-30T22:06:31.155 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-09-30T22:06:31.155 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-09-30T22:06:31.155 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-09-30T22:06:31.155 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-09-30T22:06:31.155 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-09-30T22:06:31.155 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-09-30T22:06:31.155 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-09-30T22:06:31.155 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-09-30T22:06:31.155 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-09-30T22:06:31.155 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-09-30T22:06:31.155 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-09-30T22:06:31.155 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-09-30T22:06:31.155 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-09-30T22:06:31.156 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-09-30T22:06:31.156 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-09-30T22:06:31.156 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-09-30T22:06:31.156 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-09-30T22:06:31.156 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-09-30T22:06:31.156 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-09-30T22:06:31.156 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-09-30T22:06:31.156 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-09-30T22:06:31.156 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-09-30T22:06:31.156 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-09-30T22:06:31.156 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-09-30T22:06:31.156 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-09-30T22:06:31.157 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-09-30T22:06:31.157 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-09-30T22:06:31.157 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-09-30T22:06:31.157 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-09-30T22:06:31.157 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-09-30T22:06:31.157 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-09-30T22:06:31.157 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-09-30T22:06:31.157 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-09-30T22:06:31.157 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-09-30T22:06:31.157 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-09-30T22:06:31.157 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-09-30T22:06:31.157 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-09-30T22:06:31.157 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-09-30T22:06:31.158 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-09-30T22:06:31.158 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-09-30T22:06:31.158 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-09-30T22:06:31.158 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-09-30T22:06:31.158 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-09-30T22:06:31.158 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-09-30T22:06:31.158 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-09-30T22:06:31.158 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-09-30T22:06:31.158 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-09-30T22:06:31.158 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-09-30T22:06:31.158 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-09-30T22:06:31.159 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-09-30T22:06:31.159 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-09-30T22:06:31.159 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-09-30T22:06:31.159 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-09-30T22:06:31.159 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-09-30T22:06:31.159 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-09-30T22:06:31.159 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-09-30T22:06:31.159 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-09-30T22:06:31.159 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-09-30T22:06:31.159 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-09-30T22:06:31.159 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-09-30T22:06:31.159 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-09-30T22:06:31.160 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-09-30T22:06:31.160 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-09-30T22:06:31.160 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-09-30T22:06:31.160 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-09-30T22:06:31.160 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-09-30T22:06:31.160 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-09-30T22:06:31.160 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-09-30T22:06:31.160 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-09-30T22:06:31.160 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-09-30T22:06:31.160 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-09-30T22:06:31.160 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-09-30T22:06:31.160 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-09-30T22:06:31.160 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-09-30T22:06:31.161 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-09-30T22:06:31.161 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-09-30T22:06:31.161 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-09-30T22:06:31.161 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-09-30T22:06:31.161 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-09-30T22:06:31.161 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-09-30T22:06:31.161 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-09-30T22:06:31.161 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-09-30T22:06:31.161 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-09-30T22:06:31.161 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-09-30T22:06:31.161 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-09-30T22:06:31.161 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-09-30T22:06:31.161 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-09-30T22:06:31.162 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-09-30T22:06:31.162 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-09-30T22:06:31.162 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-09-30T22:06:31.162 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-09-30T22:06:31.162 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-09-30T22:06:31.162 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-09-30T22:06:31.162 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-09-30T22:06:31.162 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-09-30T22:06:31.162 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-09-30T22:06:31.162 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-09-30T22:06:31.162 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-09-30T22:06:31.162 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-09-30T22:06:31.162 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-09-30T22:06:31.163 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-09-30T22:06:31.163 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-09-30T22:06:31.163 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-09-30T22:06:31.163 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-09-30T22:06:31.163 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-09-30T22:06:31.163 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-09-30T22:06:31.163 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-09-30T22:06:31.163 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-09-30T22:06:31.163 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-09-30T22:06:31.163 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-09-30T22:06:31.163 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-09-30T22:06:31.163 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-09-30T22:06:31.164 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-09-30T22:06:31.164 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-09-30T22:06:31.164 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-09-30T22:06:31.164 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-09-30T22:06:31.164 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-09-30T22:06:31.164 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-09-30T22:06:31.164 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-09-30T22:06:31.164 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-09-30T22:06:31.164 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-09-30T22:06:31.164 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-09-30T22:06:31.164 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-09-30T22:06:31.164 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-09-30T22:06:31.164 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-09-30T22:06:31.165 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-09-30T22:06:31.165 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-09-30T22:06:31.165 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-09-30T22:06:31.165 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-09-30T22:06:31.165 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-09-30T22:06:31.165 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-09-30T22:06:31.165 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-09-30T22:06:31.165 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-09-30T22:06:31.165 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-09-30T22:06:31.165 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-09-30T22:06:31.165 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-09-30T22:06:31.165 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-09-30T22:06:31.165 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-09-30T22:06:31.166 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-09-30T22:06:31.166 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-09-30T22:06:31.166 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-09-30T22:06:31.166 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-09-30T22:06:31.166 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-09-30T22:06:31.166 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-09-30T22:06:31.166 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-09-30T22:06:31.166 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-09-30T22:06:31.166 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-09-30T22:06:31.166 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-09-30T22:06:31.166 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-09-30T22:06:31.166 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-09-30T22:06:31.166 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-09-30T22:06:31.167 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-09-30T22:06:31.167 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-09-30T22:06:31.167 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-09-30T22:06:31.167 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-09-30T22:06:31.167 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-09-30T22:06:31.167 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-09-30T22:06:31.167 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-09-30T22:06:31.167 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-09-30T22:06:31.167 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-09-30T22:06:31.167 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-09-30T22:06:31.167 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-09-30T22:06:31.167 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-09-30T22:06:31.168 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-09-30T22:06:31.168 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-09-30T22:06:31.168 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-09-30T22:06:31.168 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-09-30T22:06:31.168 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-09-30T22:06:31.168 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-09-30T22:06:31.168 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-09-30T22:06:31.168 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-09-30T22:06:31.168 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-09-30T22:06:31.168 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-09-30T22:06:31.168 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-09-30T22:06:31.168 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-09-30T22:06:31.168 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-09-30T22:06:31.168 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-09-30T22:06:31.169 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-09-30T22:06:31.169 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-09-30T22:06:31.169 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-09-30T22:06:31.169 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-09-30T22:06:31.169 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-09-30T22:06:31.169 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-09-30T22:06:31.169 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-09-30T22:06:31.169 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-09-30T22:06:31.169 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-09-30T22:06:31.169 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-09-30T22:06:31.169 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-09-30T22:06:31.169 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-09-30T22:06:31.169 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-09-30T22:06:31.170 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-09-30T22:06:31.170 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-09-30T22:06:31.170 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-09-30T22:06:31.170 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-09-30T22:06:31.170 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-09-30T22:06:31.170 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-09-30T22:06:31.170 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-09-30T22:06:31.170 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-09-30T22:06:31.170 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-09-30T22:06:31.170 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-09-30T22:06:31.170 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-09-30T22:06:31.170 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-09-30T22:06:31.171 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-09-30T22:06:31.171 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-09-30T22:06:31.171 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-09-30T22:06:31.171 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-09-30T22:06:31.171 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-09-30T22:06:31.171 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-09-30T22:06:31.171 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-09-30T22:06:31.171 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-09-30T22:06:31.171 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-09-30T22:06:31.171 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-09-30T22:06:31.171 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-09-30T22:06:31.171 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-09-30T22:06:31.171 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-09-30T22:06:31.172 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-09-30T22:06:31.172 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-09-30T22:06:31.172 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-09-30T22:06:31.172 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-09-30T22:06:31.172 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-09-30T22:06:31.172 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-09-30T22:06:31.172 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-09-30T22:06:31.172 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-09-30T22:06:31.172 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-09-30T22:06:31.172 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-09-30T22:06:31.172 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-09-30T22:06:31.172 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-09-30T22:06:31.172 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-09-30T22:06:31.173 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-09-30T22:06:31.173 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-09-30T22:06:31.173 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-09-30T22:06:31.173 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-09-30T22:06:31.173 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-09-30T22:06:31.173 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-09-30T22:06:31.173 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-09-30T22:06:31.173 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-09-30T22:06:31.173 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-09-30T22:06:31.173 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-09-30T22:06:31.173 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-09-30T22:06:31.173 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-09-30T22:06:31.174 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-09-30T22:06:31.174 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-09-30T22:06:31.174 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-09-30T22:06:31.174 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-09-30T22:06:31.174 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-09-30T22:06:31.174 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-09-30T22:06:31.174 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-09-30T22:06:31.174 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-09-30T22:06:31.174 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-09-30T22:06:31.174 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-09-30T22:06:31.174 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-09-30T22:06:31.174 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-09-30T22:06:31.174 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-09-30T22:06:31.175 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-09-30T22:06:31.175 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-09-30T22:06:31.175 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-09-30T22:06:31.175 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-09-30T22:06:31.175 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-09-30T22:06:31.175 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-09-30T22:06:31.175 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-09-30T22:06:31.175 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-09-30T22:06:31.175 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-09-30T22:06:31.175 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-09-30T22:06:31.175 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-09-30T22:06:31.175 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-09-30T22:06:31.175 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-09-30T22:06:31.176 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-09-30T22:06:31.176 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-09-30T22:06:31.176 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-09-30T22:06:31.176 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-09-30T22:06:31.176 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-09-30T22:06:31.176 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-09-30T22:06:31.176 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-09-30T22:06:31.176 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-09-30T22:06:31.176 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-09-30T22:06:31.176 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-09-30T22:06:31.176 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-09-30T22:06:31.176 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-09-30T22:06:31.176 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-09-30T22:06:31.177 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-09-30T22:06:31.177 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-09-30T22:06:31.177 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-09-30T22:06:31.177 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-09-30T22:06:31.177 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-09-30T22:06:31.177 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-09-30T22:06:31.177 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-09-30T22:06:31.177 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-09-30T22:06:31.177 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-09-30T22:06:31.177 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-09-30T22:06:31.177 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-09-30T22:06:31.177 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-09-30T22:06:31.177 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-09-30T22:06:31.178 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-09-30T22:06:31.178 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-09-30T22:06:31.178 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-09-30T22:06:31.178 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-09-30T22:06:31.178 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-09-30T22:06:31.178 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-09-30T22:06:31.178 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-09-30T22:06:31.178 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-09-30T22:06:31.178 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-09-30T22:06:31.178 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-09-30T22:06:31.178 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-09-30T22:06:31.178 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-09-30T22:06:31.178 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-09-30T22:06:31.179 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-09-30T22:06:31.179 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-09-30T22:06:31.179 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-09-30T22:06:31.179 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-09-30T22:06:31.179 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-09-30T22:06:31.179 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-09-30T22:06:31.179 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-09-30T22:06:31.179 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-09-30T22:06:31.179 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-09-30T22:06:31.179 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-09-30T22:06:31.179 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-09-30T22:06:31.179 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-09-30T22:06:31.179 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-09-30T22:06:31.180 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-09-30T22:06:31.180 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-09-30T22:06:31.180 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-09-30T22:06:31.180 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-09-30T22:06:31.180 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-09-30T22:06:31.180 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-09-30T22:06:31.180 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-09-30T22:06:31.180 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-09-30T22:06:31.180 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-09-30T22:06:31.180 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-09-30T22:06:31.180 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-09-30T22:06:31.180 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-09-30T22:06:31.180 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-09-30T22:06:31.181 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-09-30T22:06:31.181 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-09-30T22:06:31.181 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-09-30T22:06:31.181 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-09-30T22:06:31.181 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-09-30T22:06:31.181 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-09-30T22:06:31.181 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-09-30T22:06:31.181 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-09-30T22:06:31.181 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-09-30T22:06:31.181 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-09-30T22:06:31.181 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-09-30T22:06:31.181 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-09-30T22:06:31.181 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-09-30T22:06:31.182 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-09-30T22:06:31.182 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-09-30T22:06:31.182 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-09-30T22:06:31.182 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-09-30T22:06:31.182 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-09-30T22:06:31.182 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-09-30T22:06:31.182 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-09-30T22:06:31.182 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-09-30T22:06:31.182 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-09-30T22:06:31.182 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-09-30T22:06:31.182 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-09-30T22:06:31.182 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-09-30T22:06:31.182 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-09-30T22:06:31.183 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-09-30T22:06:31.183 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-09-30T22:06:31.183 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-09-30T22:06:31.183 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-09-30T22:06:31.183 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-09-30T22:06:31.183 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-09-30T22:06:31.183 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-09-30T22:06:31.183 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-09-30T22:06:31.183 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-09-30T22:06:31.183 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-09-30T22:06:31.183 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-09-30T22:06:31.183 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-09-30T22:06:31.183 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-09-30T22:06:31.184 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-09-30T22:06:31.184 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-09-30T22:06:31.184 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-09-30T22:06:31.184 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-09-30T22:06:31.184 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-09-30T22:06:31.184 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-09-30T22:06:31.184 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-09-30T22:06:31.184 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-09-30T22:06:31.184 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-09-30T22:06:31.184 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-09-30T22:06:31.184 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-09-30T22:06:31.184 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-09-30T22:06:31.185 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-09-30T22:06:31.185 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-09-30T22:06:31.185 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-09-30T22:06:31.185 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-09-30T22:06:31.185 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-09-30T22:06:31.185 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-09-30T22:06:31.185 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-09-30T22:06:31.185 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-09-30T22:06:31.185 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-09-30T22:06:31.185 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-09-30T22:06:31.185 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-09-30T22:06:31.185 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-09-30T22:06:31.185 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-09-30T22:06:31.186 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-09-30T22:06:31.186 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-09-30T22:06:31.186 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-09-30T22:06:31.186 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-09-30T22:06:31.186 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-09-30T22:06:31.186 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-09-30T22:06:31.186 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-09-30T22:06:31.186 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-09-30T22:06:31.186 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-09-30T22:06:31.186 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-09-30T22:06:31.186 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-09-30T22:06:31.186 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-09-30T22:06:31.186 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-09-30T22:06:31.187 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-09-30T22:06:31.187 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-09-30T22:06:31.187 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-09-30T22:06:31.187 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-09-30T22:06:31.187 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-09-30T22:06:31.187 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-09-30T22:06:31.187 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-09-30T22:06:31.187 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-09-30T22:06:31.187 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-09-30T22:06:31.187 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-09-30T22:06:31.187 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-09-30T22:06:31.187 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-09-30T22:06:31.188 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-09-30T22:06:31.188 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-09-30T22:06:31.188 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-09-30T22:06:31.188 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-09-30T22:06:31.188 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-09-30T22:06:31.188 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-09-30T22:06:31.188 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-09-30T22:06:31.188 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-09-30T22:06:31.188 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-09-30T22:06:31.188 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-09-30T22:06:31.188 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-09-30T22:06:31.188 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-09-30T22:06:31.189 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-09-30T22:06:31.189 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-09-30T22:06:31.189 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-09-30T22:06:31.189 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-09-30T22:06:31.189 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-09-30T22:06:31.189 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-09-30T22:06:31.189 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-09-30T22:06:31.189 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-09-30T22:06:31.189 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-09-30T22:06:31.189 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-09-30T22:06:31.189 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-09-30T22:06:31.189 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-09-30T22:06:31.189 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-09-30T22:06:31.190 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-09-30T22:06:31.190 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-09-30T22:06:31.190 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-09-30T22:06:31.190 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-09-30T22:06:31.190 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-09-30T22:06:31.190 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-09-30T22:06:31.190 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-09-30T22:06:31.190 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-09-30T22:06:31.190 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-09-30T22:06:31.190 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-09-30T22:06:31.190 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-09-30T22:06:31.190 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-09-30T22:06:31.191 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-09-30T22:06:31.191 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-09-30T22:06:31.191 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-09-30T22:06:31.191 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-09-30T22:06:31.191 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-09-30T22:06:31.191 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-09-30T22:06:31.191 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-09-30T22:06:31.191 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-09-30T22:06:31.191 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-09-30T22:06:31.191 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-09-30T22:06:31.191 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-09-30T22:06:31.191 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-09-30T22:06:31.191 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-09-30T22:06:31.192 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-09-30T22:06:31.192 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-09-30T22:06:31.192 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-09-30T22:06:31.192 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-09-30T22:06:31.192 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-09-30T22:06:31.192 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-09-30T22:06:31.192 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-09-30T22:06:31.192 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-09-30T22:06:31.192 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-09-30T22:06:31.192 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-09-30T22:06:31.192 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-09-30T22:06:31.192 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-09-30T22:06:31.192 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-09-30T22:06:31.193 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-09-30T22:06:31.193 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-09-30T22:06:31.193 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-09-30T22:06:31.193 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-09-30T22:06:31.193 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-09-30T22:06:31.193 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-09-30T22:06:31.193 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-09-30T22:06:31.193 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-09-30T22:06:31.193 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-09-30T22:06:31.193 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-09-30T22:06:31.193 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-09-30T22:06:31.193 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-09-30T22:06:31.194 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-09-30T22:06:31.194 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-09-30T22:06:31.194 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-09-30T22:06:31.194 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-09-30T22:06:31.194 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-09-30T22:06:31.194 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-09-30T22:06:31.194 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-09-30T22:06:31.194 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-09-30T22:06:31.194 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-09-30T22:06:31.194 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-09-30T22:06:31.194 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-09-30T22:06:31.194 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-09-30T22:06:31.195 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-09-30T22:06:31.195 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-09-30T22:06:31.195 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-09-30T22:06:31.195 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-09-30T22:06:31.195 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-09-30T22:06:31.195 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-09-30T22:06:31.195 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-09-30T22:06:31.195 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-09-30T22:06:31.195 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-09-30T22:06:31.195 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-09-30T22:06:31.195 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-09-30T22:06:31.195 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-09-30T22:06:31.195 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-09-30T22:06:31.196 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-09-30T22:06:31.196 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-09-30T22:06:31.196 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-09-30T22:06:31.196 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-09-30T22:06:31.196 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-09-30T22:06:31.196 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-09-30T22:06:31.196 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-09-30T22:06:31.196 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-09-30T22:06:31.196 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-09-30T22:06:31.196 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-09-30T22:06:31.196 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-09-30T22:06:31.196 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-09-30T22:06:31.197 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-09-30T22:06:31.197 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-09-30T22:06:31.197 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-09-30T22:06:31.197 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-09-30T22:06:31.197 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-09-30T22:06:31.197 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-09-30T22:06:31.197 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-09-30T22:06:31.197 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-09-30T22:06:31.197 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-09-30T22:06:31.197 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-09-30T22:06:31.197 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-09-30T22:06:31.197 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-09-30T22:06:31.197 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-09-30T22:06:31.198 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-09-30T22:06:31.198 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-09-30T22:06:31.198 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-09-30T22:06:31.198 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-09-30T22:06:31.198 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-09-30T22:06:31.198 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-09-30T22:06:31.198 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-09-30T22:06:31.198 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-09-30T22:06:31.198 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-09-30T22:06:31.198 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-09-30T22:06:31.198 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-09-30T22:06:31.198 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-09-30T22:06:31.198 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-09-30T22:06:31.199 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-09-30T22:06:31.199 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-09-30T22:06:31.199 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-09-30T22:06:31.199 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-09-30T22:06:31.199 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-09-30T22:06:31.199 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-09-30T22:06:31.199 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-09-30T22:06:31.199 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-09-30T22:06:31.199 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-09-30T22:06:31.199 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-09-30T22:06:31.199 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-09-30T22:06:31.199 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-09-30T22:06:31.200 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-09-30T22:06:31.200 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-09-30T22:06:31.200 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-09-30T22:06:31.200 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-09-30T22:06:31.200 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-09-30T22:06:31.200 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-09-30T22:06:31.200 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-09-30T22:06:31.200 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-09-30T22:06:31.200 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-09-30T22:06:31.200 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-09-30T22:06:31.200 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-09-30T22:06:31.200 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-09-30T22:06:31.201 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-09-30T22:06:31.201 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-09-30T22:06:31.201 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-09-30T22:06:31.201 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-09-30T22:06:31.201 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-09-30T22:06:31.201 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-09-30T22:06:31.201 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-09-30T22:06:31.201 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-09-30T22:06:31.201 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-09-30T22:06:31.201 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-09-30T22:06:31.201 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-09-30T22:06:31.201 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-09-30T22:06:31.202 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-09-30T22:06:31.202 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-09-30T22:06:31.202 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-09-30T22:06:31.202 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-09-30T22:06:31.202 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-09-30T22:06:31.202 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-09-30T22:06:31.202 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-09-30T22:06:31.202 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-09-30T22:06:31.202 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-09-30T22:06:31.203 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-09-30T22:06:31.203 DEBUG:teuthology.orchestra.run.smithi158:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-09-30T22:06:31.231 INFO:teuthology.orchestra.run.smithi158.stdout:postinstall scriptlet (using /bin/sh): 2023-09-30T22:06:31.232 INFO:teuthology.orchestra.run.smithi158.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-09-30T22:06:31.232 INFO:teuthology.orchestra.run.smithi158.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-30T22:06:31.232 INFO:teuthology.orchestra.run.smithi158.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-30T22:06:31.232 INFO:teuthology.orchestra.run.smithi158.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-09-30T22:06:31.232 INFO:teuthology.orchestra.run.smithi158.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-30T22:06:31.232 INFO:teuthology.orchestra.run.smithi158.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-30T22:06:31.232 INFO:teuthology.orchestra.run.smithi158.stdout:fi 2023-09-30T22:06:31.232 INFO:teuthology.orchestra.run.smithi158.stdout:preuninstall scriptlet (using /bin/sh): 2023-09-30T22:06:31.232 INFO:teuthology.orchestra.run.smithi158.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-09-30T22:06:31.232 INFO:teuthology.orchestra.run.smithi158.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-09-30T22:06:31.233 INFO:teuthology.orchestra.run.smithi158.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-09-30T22:06:31.233 INFO:teuthology.orchestra.run.smithi158.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-09-30T22:06:31.233 INFO:teuthology.orchestra.run.smithi158.stdout:fi 2023-09-30T22:06:31.233 INFO:teuthology.orchestra.run.smithi158.stdout:postuninstall scriptlet (using /bin/sh): 2023-09-30T22:06:31.233 INFO:teuthology.orchestra.run.smithi158.stdout:if [ -x /sbin/update-bootloader ]; then 2023-09-30T22:06:31.233 INFO:teuthology.orchestra.run.smithi158.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-09-30T22:06:31.233 INFO:teuthology.orchestra.run.smithi158.stdout:fi 2023-09-30T22:06:31.234 DEBUG:teuthology.orchestra.run.smithi158:> sudo rpm -qi grub2-tools 2023-09-30T22:06:31.313 INFO:teuthology.orchestra.run.smithi158.stdout:Name : grub2-tools 2023-09-30T22:06:31.313 INFO:teuthology.orchestra.run.smithi158.stdout:Epoch : 1 2023-09-30T22:06:31.313 INFO:teuthology.orchestra.run.smithi158.stdout:Version : 2.02 2023-09-30T22:06:31.313 INFO:teuthology.orchestra.run.smithi158.stdout:Release : 129.el8 2023-09-30T22:06:31.313 INFO:teuthology.orchestra.run.smithi158.stdout:Architecture: x86_64 2023-09-30T22:06:31.314 INFO:teuthology.orchestra.run.smithi158.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-09-30T22:06:31.314 INFO:teuthology.orchestra.run.smithi158.stdout:Group : System Environment/Base 2023-09-30T22:06:31.314 INFO:teuthology.orchestra.run.smithi158.stdout:Size : 9265586 2023-09-30T22:06:31.314 INFO:teuthology.orchestra.run.smithi158.stdout:License : GPLv3+ 2023-09-30T22:06:31.314 INFO:teuthology.orchestra.run.smithi158.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-09-30T22:06:31.314 INFO:teuthology.orchestra.run.smithi158.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-09-30T22:06:31.314 INFO:teuthology.orchestra.run.smithi158.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-09-30T22:06:31.315 INFO:teuthology.orchestra.run.smithi158.stdout:Build Host : kbuilder.bsys.centos.org 2023-09-30T22:06:31.315 INFO:teuthology.orchestra.run.smithi158.stdout:Relocations : (not relocatable) 2023-09-30T22:06:31.315 INFO:teuthology.orchestra.run.smithi158.stdout:Packager : CentOS BuildSystem 2023-09-30T22:06:31.315 INFO:teuthology.orchestra.run.smithi158.stdout:Vendor : CentOS 2023-09-30T22:06:31.315 INFO:teuthology.orchestra.run.smithi158.stdout:URL : http://www.gnu.org/software/grub/ 2023-09-30T22:06:31.315 INFO:teuthology.orchestra.run.smithi158.stdout:Summary : Support tools for GRUB. 2023-09-30T22:06:31.316 INFO:teuthology.orchestra.run.smithi158.stdout:Description : 2023-09-30T22:06:31.316 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:06:31.316 INFO:teuthology.orchestra.run.smithi158.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-09-30T22:06:31.316 INFO:teuthology.orchestra.run.smithi158.stdout:customizable bootloader with modular architecture. It supports a rich 2023-09-30T22:06:31.316 INFO:teuthology.orchestra.run.smithi158.stdout:variety of kernel formats, file systems, computer architectures and 2023-09-30T22:06:31.317 INFO:teuthology.orchestra.run.smithi158.stdout:hardware devices. 2023-09-30T22:06:31.317 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:06:31.317 INFO:teuthology.orchestra.run.smithi158.stdout:This subpackage provides tools for support of all platforms. 2023-09-30T22:06:31.318 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-09-30T22:06:31.319 INFO:teuthology.task.kernel:Updating grub on smithi158 to boot 6.5.0-rc7-gfef64f93da2b 2023-09-30T22:06:31.319 DEBUG:teuthology.orchestra.run.smithi158:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-09-30T22:06:35.033 INFO:teuthology.orchestra.run.smithi158.stderr:Generating grub configuration file ... 2023-09-30T22:06:37.239 INFO:teuthology.orchestra.run.smithi158.stderr:done 2023-09-30T22:06:37.241 DEBUG:teuthology.orchestra.run.smithi158:> mktemp 2023-09-30T22:06:37.264 INFO:teuthology.orchestra.run.smithi158.stdout:/tmp/tmp.zAR7GH8daS 2023-09-30T22:06:37.265 DEBUG:teuthology.orchestra.run.smithi158:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.zAR7GH8daS 2023-09-30T22:06:37.339 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 0666 /tmp/tmp.zAR7GH8daS 2023-09-30T22:06:37.498 DEBUG:teuthology.orchestra.remote:smithi158:/tmp/tmp.zAR7GH8daS is 6KB 2023-09-30T22:06:37.545 DEBUG:teuthology.orchestra.run.smithi158:> rm -fr /tmp/tmp.zAR7GH8daS 2023-09-30T22:06:37.563 DEBUG:teuthology.orchestra.run.smithi158:> sudo /bin/ls /boot/loader/entries || true 2023-09-30T22:06:37.640 INFO:teuthology.orchestra.run.smithi158.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-09-30T22:06:37.640 INFO:teuthology.orchestra.run.smithi158.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-09-30T22:06:37.640 INFO:teuthology.orchestra.run.smithi158.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-09-30T22:06:37.640 INFO:teuthology.orchestra.run.smithi158.stdout:a1b29d6c289747bdb22930598d39874a-6.5.0-rc7-gfef64f93da2b.conf 2023-09-30T22:06:37.641 DEBUG:teuthology.orchestra.run.smithi158:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.5.0-rc7-gfef64f93da2b 2023-09-30T22:06:37.812 DEBUG:teuthology.orchestra.run.smithi158:> sudo shutdown -r now 2023-09-30T22:07:07.815 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-09-30T22:07:07.816 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-09-30T22:07:07.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:07:26.334 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-09-30T22:07:35.335 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-09-30T22:07:35.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:07:38.394 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-09-30T22:07:50.395 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-09-30T22:07:50.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:07:53.470 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-09-30T22:08:08.472 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-09-30T22:08:08.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:08:27.006 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-09-30T22:08:45.008 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-09-30T22:08:45.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:08:45.543 DEBUG:teuthology.orchestra.run.smithi158:> true 2023-09-30T22:08:45.961 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-09-30T22:08:45.961 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.5.0-rc7-gfef64f93da2b"... 2023-09-30T22:08:45.961 DEBUG:teuthology.orchestra.run.smithi158:> uname -r 2023-09-30T22:08:46.008 INFO:teuthology.orchestra.run.smithi158.stdout:6.5.0-rc7-gfef64f93da2b 2023-09-30T22:08:46.008 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-09-30T22:08:46.008 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-09-30T22:08:46.008 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-09-30T22:08:47.010 DEBUG:teuthology.parallel:result is None 2023-09-30T22:08:47.010 INFO:teuthology.run_tasks:Running task internal.base... 2023-09-30T22:08:47.019 INFO:teuthology.task.internal:Creating test directory... 2023-09-30T22:08:47.019 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-30T22:08:47.022 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-30T22:08:47.072 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-09-30T22:08:47.084 INFO:teuthology.run_tasks:Running task internal.archive... 2023-09-30T22:08:47.122 INFO:teuthology.task.internal:Creating archive directory... 2023-09-30T22:08:47.122 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-30T22:08:47.125 DEBUG:teuthology.orchestra.run.smithi158:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-30T22:08:47.186 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-09-30T22:08:47.197 INFO:teuthology.task.internal:Enabling coredump saving... 2023-09-30T22:08:47.197 DEBUG:teuthology.orchestra.run.smithi040:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-30T22:08:47.218 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:08:47.219 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-30T22:08:47.262 DEBUG:teuthology.orchestra.run.smithi158:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-30T22:08:47.345 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T22:08:47.360 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T22:08:47.388 INFO:teuthology.orchestra.run.smithi158.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T22:08:47.440 INFO:teuthology.orchestra.run.smithi158.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T22:08:47.443 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-09-30T22:08:47.451 INFO:teuthology.task.internal:Configuring sudo... 2023-09-30T22:08:47.451 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-30T22:08:47.454 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-30T22:08:47.524 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-09-30T22:08:47.536 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-09-30T22:08:47.537 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-30T22:08:47.539 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-30T22:08:47.585 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-30T22:08:47.645 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-30T22:08:47.719 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-30T22:08:47.768 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-30T22:08:47.814 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-09-30T22:08:47.814 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-30T22:08:47.885 DEBUG:teuthology.orchestra.run.smithi158:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-30T22:08:47.958 DEBUG:teuthology.orchestra.run.smithi158:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-30T22:08:48.028 DEBUG:teuthology.orchestra.run.smithi158:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-30T22:08:48.101 DEBUG:teuthology.orchestra.run.smithi158:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-30T22:08:48.171 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-09-30T22:08:48.171 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-30T22:08:48.241 DEBUG:teuthology.orchestra.run.smithi040:> sudo service rsyslog restart 2023-09-30T22:08:48.243 DEBUG:teuthology.orchestra.run.smithi158:> sudo service rsyslog restart 2023-09-30T22:08:48.302 INFO:teuthology.orchestra.run.smithi040.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-30T22:08:48.407 INFO:teuthology.orchestra.run.smithi158.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-30T22:08:48.684 INFO:teuthology.run_tasks:Running task internal.timer... 2023-09-30T22:08:48.695 INFO:teuthology.task.internal:Starting timer... 2023-09-30T22:08:48.695 INFO:teuthology.run_tasks:Running task pcp... 2023-09-30T22:08:48.766 INFO:teuthology.run_tasks:Running task selinux... 2023-09-30T22:08:48.812 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-09-30T22:08:48.812 DEBUG:teuthology.orchestra.run.smithi040:> sudo service auditd rotate 2023-09-30T22:08:48.891 INFO:teuthology.orchestra.run.smithi040.stdout:Rotating logs: 2023-09-30T22:08:48.893 DEBUG:teuthology.orchestra.run.smithi158:> sudo service auditd rotate 2023-09-30T22:08:49.026 INFO:teuthology.orchestra.run.smithi158.stdout:Rotating logs: 2023-09-30T22:08:49.029 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-09-30T22:08:49.029 DEBUG:teuthology.orchestra.run.smithi040:> /usr/sbin/getenforce 2023-09-30T22:08:49.059 INFO:teuthology.orchestra.run.smithi040.stdout:Permissive 2023-09-30T22:08:49.060 DEBUG:teuthology.orchestra.run.smithi158:> /usr/sbin/getenforce 2023-09-30T22:08:49.114 INFO:teuthology.orchestra.run.smithi158.stdout:Permissive 2023-09-30T22:08:49.115 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi040.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi158.front.sepia.ceph.com': 'permissive'} 2023-09-30T22:08:49.115 DEBUG:teuthology.orchestra.run.smithi040:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-30T22:08:49.146 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:08:49.147 DEBUG:teuthology.orchestra.run.smithi158:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-30T22:08:49.217 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:08:49.217 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-09-30T22:08:49.217 DEBUG:teuthology.orchestra.run.smithi040:> sudo /usr/sbin/setenforce permissive 2023-09-30T22:08:49.249 DEBUG:teuthology.orchestra.run.smithi158:> sudo /usr/sbin/setenforce permissive 2023-09-30T22:08:49.317 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-09-30T22:08:49.327 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-09-30T22:08:49.333 INFO:teuthology.repo_utils:Fetching main from origin 2023-09-30T22:08:49.452 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-09-30T22:08:49.468 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-09-30T22:08:49.470 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi040.front.sepia.ceph.com,smithi158.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-09-30T22:19:05.113 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi040.front.sepia.ceph.com'), Remote(name='ubuntu@smithi158.front.sepia.ceph.com')] 2023-09-30T22:19:05.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-09-30T22:19:05.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:19:05.184 DEBUG:teuthology.orchestra.run.smithi040:> true 2023-09-30T22:19:05.256 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-09-30T22:19:05.257 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-09-30T22:19:05.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:19:05.342 DEBUG:teuthology.orchestra.run.smithi158:> true 2023-09-30T22:19:05.411 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-09-30T22:19:05.411 INFO:teuthology.run_tasks:Running task clock... 2023-09-30T22:19:05.422 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-09-30T22:19:05.423 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-30T22:19:05.423 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T22:19:05.426 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-30T22:19:05.426 DEBUG:teuthology.orchestra.run.smithi158:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T22:19:05.464 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-30T22:19:05.480 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-30T22:19:05.526 INFO:teuthology.orchestra.run.smithi158.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-30T22:19:05.559 INFO:teuthology.orchestra.run.smithi158.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-30T22:19:05.564 INFO:teuthology.orchestra.run.smithi040.stderr:sudo: ntpd: command not found 2023-09-30T22:19:05.578 INFO:teuthology.orchestra.run.smithi040.stdout:506 Cannot talk to daemon 2023-09-30T22:19:05.593 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-30T22:19:05.607 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-30T22:19:05.646 INFO:teuthology.orchestra.run.smithi158.stderr:sudo: ntpd: command not found 2023-09-30T22:19:05.674 INFO:teuthology.orchestra.run.smithi158.stdout:506 Cannot talk to daemon 2023-09-30T22:19:05.680 INFO:teuthology.orchestra.run.smithi040.stderr:bash: ntpq: command not found 2023-09-30T22:19:05.683 INFO:teuthology.orchestra.run.smithi040.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-30T22:19:05.683 INFO:teuthology.orchestra.run.smithi040.stdout:=============================================================================== 2023-09-30T22:19:05.683 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:19:05.684 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:19:05.684 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:19:05.684 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:19:05.708 INFO:teuthology.orchestra.run.smithi158.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-30T22:19:05.740 INFO:teuthology.orchestra.run.smithi158.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-30T22:19:05.828 INFO:teuthology.orchestra.run.smithi158.stderr:bash: ntpq: command not found 2023-09-30T22:19:05.835 INFO:teuthology.orchestra.run.smithi158.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-30T22:19:05.835 INFO:teuthology.orchestra.run.smithi158.stdout:=============================================================================== 2023-09-30T22:19:05.835 INFO:teuthology.orchestra.run.smithi158.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:19:05.835 INFO:teuthology.orchestra.run.smithi158.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:19:05.835 INFO:teuthology.orchestra.run.smithi158.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:19:05.835 INFO:teuthology.orchestra.run.smithi158.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:19:05.837 INFO:teuthology.run_tasks:Running task install... 2023-09-30T22:19:05.845 DEBUG:teuthology.task.install:project ceph 2023-09-30T22:19:05.845 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}} 2023-09-30T22:19:05.845 DEBUG:teuthology.task.install:config {'branch': 'pacific', 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'} 2023-09-30T22:19:05.845 INFO:teuthology.task.install:Using flavor: default 2023-09-30T22:19:05.851 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-09-30T22:19:05.852 INFO:teuthology.task.install:extra packages: ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'] 2023-09-30T22:19:05.852 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'pacific', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'tag': None, 'wait_for_package': False} 2023-09-30T22:19:05.852 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-30T22:19:05.852 INFO:teuthology.packaging:ref: None 2023-09-30T22:19:05.853 INFO:teuthology.packaging:tag: None 2023-09-30T22:19:05.853 INFO:teuthology.packaging:branch: pacific 2023-09-30T22:19:05.853 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-09-30T22:19:05.853 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-09-30T22:19:05.855 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'pacific', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'tag': None, 'wait_for_package': False} 2023-09-30T22:19:05.855 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-30T22:19:05.855 INFO:teuthology.packaging:ref: None 2023-09-30T22:19:05.855 INFO:teuthology.packaging:tag: None 2023-09-30T22:19:05.855 INFO:teuthology.packaging:branch: pacific 2023-09-30T22:19:05.855 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-09-30T22:19:05.855 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-09-30T22:19:06.154 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/ 2023-09-30T22:19:06.154 INFO:teuthology.task.install.rpm:Package version is 16.2.14-44.geeb13ac9 2023-09-30T22:19:06.165 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/ 2023-09-30T22:19:06.166 INFO:teuthology.task.install.rpm:Package version is 16.2.14-44.geeb13ac9 2023-09-30T22:19:06.265 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-30T22:19:06.265 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-09-30T22:19:06.265 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-30T22:19:06.273 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-30T22:19:06.274 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-09-30T22:19:06.274 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-30T22:19:06.309 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, python-rados, python-rgw, python-rbd, python-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux on remote rpm x86_64 2023-09-30T22:19:06.309 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-30T22:19:06.309 INFO:teuthology.packaging:ref: None 2023-09-30T22:19:06.309 INFO:teuthology.packaging:tag: None 2023-09-30T22:19:06.309 INFO:teuthology.packaging:branch: pacific 2023-09-30T22:19:06.309 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-09-30T22:19:06.309 DEBUG:teuthology.orchestra.run.smithi040:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/pacific/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-30T22:19:06.338 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, python-rados, python-rgw, python-rbd, python-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux on remote rpm x86_64 2023-09-30T22:19:06.338 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-30T22:19:06.338 INFO:teuthology.packaging:ref: None 2023-09-30T22:19:06.338 INFO:teuthology.packaging:tag: None 2023-09-30T22:19:06.338 INFO:teuthology.packaging:branch: pacific 2023-09-30T22:19:06.338 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-09-30T22:19:06.338 DEBUG:teuthology.orchestra.run.smithi158:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/pacific/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-30T22:19:06.383 DEBUG:teuthology.orchestra.run.smithi040:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-30T22:19:06.450 DEBUG:teuthology.orchestra.run.smithi158:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-30T22:19:06.467 DEBUG:teuthology.orchestra.run.smithi040:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-30T22:19:06.538 INFO:teuthology.orchestra.run.smithi040.stdout:check_obsoletes = 1 2023-09-30T22:19:06.539 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum clean all 2023-09-30T22:19:06.545 DEBUG:teuthology.orchestra.run.smithi158:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-30T22:19:06.614 INFO:teuthology.orchestra.run.smithi158.stdout:check_obsoletes = 1 2023-09-30T22:19:06.617 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum clean all 2023-09-30T22:19:06.828 INFO:teuthology.orchestra.run.smithi040.stdout:76 files removed 2023-09-30T22:19:06.857 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 rbd-fuse rbd-mirror rbd-nbd python-rados python-rgw python-rbd python-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux 2023-09-30T22:19:06.966 INFO:teuthology.orchestra.run.smithi158.stdout:76 files removed 2023-09-30T22:19:07.002 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 rbd-fuse rbd-mirror rbd-nbd python-rados python-rgw python-rbd python-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux 2023-09-30T22:19:07.583 INFO:teuthology.orchestra.run.smithi040.stdout:ceph packages for x86_64 232 kB/s | 76 kB 00:00 2023-09-30T22:19:07.894 INFO:teuthology.orchestra.run.smithi158.stdout:ceph packages for x86_64 223 kB/s | 76 kB 00:00 2023-09-30T22:19:07.917 INFO:teuthology.orchestra.run.smithi040.stdout:ceph noarch packages 52 kB/s | 15 kB 00:00 2023-09-30T22:19:08.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph source packages 6.2 kB/s | 1.4 kB 00:00 2023-09-30T22:19:08.203 INFO:teuthology.orchestra.run.smithi158.stdout:ceph noarch packages 56 kB/s | 15 kB 00:00 2023-09-30T22:19:08.445 INFO:teuthology.orchestra.run.smithi158.stdout:ceph source packages 6.7 kB/s | 1.4 kB 00:00 2023-09-30T22:19:10.409 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - AppStream 15 MB/s | 33 MB 00:02 2023-09-30T22:19:11.962 INFO:teuthology.orchestra.run.smithi158.stdout:CentOS Stream 8 - AppStream 9.5 MB/s | 33 MB 00:03 2023-09-30T22:19:19.377 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - BaseOS 19 MB/s | 48 MB 00:02 2023-09-30T22:19:21.704 INFO:teuthology.orchestra.run.smithi158.stdout:CentOS Stream 8 - BaseOS 15 MB/s | 48 MB 00:03 2023-09-30T22:19:27.019 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - Extras 49 kB/s | 18 kB 00:00 2023-09-30T22:19:27.753 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - Extras common packages 13 kB/s | 6.9 kB 00:00 2023-09-30T22:19:28.520 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - PowerTools 11 MB/s | 6.5 MB 00:00 2023-09-30T22:19:29.154 INFO:teuthology.orchestra.run.smithi158.stdout:CentOS Stream 8 - Extras 102 kB/s | 18 kB 00:00 2023-09-30T22:19:29.729 INFO:teuthology.orchestra.run.smithi158.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 6.9 kB 00:00 2023-09-30T22:19:30.030 INFO:teuthology.orchestra.run.smithi040.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2023-09-30T22:19:30.349 INFO:teuthology.orchestra.run.smithi158.stdout:CentOS Stream 8 - PowerTools 14 MB/s | 6.5 MB 00:00 2023-09-30T22:19:32.041 INFO:teuthology.orchestra.run.smithi158.stdout:Copr repo for python3-asyncssh owned by ceph 11 kB/s | 3.5 kB 00:00 2023-09-30T22:19:34.367 INFO:teuthology.orchestra.run.smithi040.stdout:Extra Packages for Enterprise Linux 3.8 MB/s | 16 MB 00:04 2023-09-30T22:19:34.502 INFO:teuthology.orchestra.run.smithi158.stdout:Extra Packages for Enterprise Linux 6.9 MB/s | 16 MB 00:02 2023-09-30T22:19:38.539 INFO:teuthology.orchestra.run.smithi040.stdout:lab-extras 525 kB/s | 24 kB 00:00 2023-09-30T22:19:38.966 INFO:teuthology.orchestra.run.smithi158.stdout:lab-extras 419 kB/s | 24 kB 00:00 2023-09-30T22:19:43.122 INFO:teuthology.orchestra.run.smithi040.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-30T22:19:43.123 INFO:teuthology.orchestra.run.smithi040.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-30T22:19:43.150 INFO:teuthology.orchestra.run.smithi040.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-09-30T22:19:43.150 INFO:teuthology.orchestra.run.smithi040.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-09-30T22:19:43.151 INFO:teuthology.orchestra.run.smithi040.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-09-30T22:19:43.152 INFO:teuthology.orchestra.run.smithi040.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-09-30T22:19:43.358 INFO:teuthology.orchestra.run.smithi158.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-30T22:19:43.358 INFO:teuthology.orchestra.run.smithi158.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-30T22:19:43.373 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2023-09-30T22:19:43.381 INFO:teuthology.orchestra.run.smithi158.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-09-30T22:19:43.381 INFO:teuthology.orchestra.run.smithi158.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-09-30T22:19:43.382 INFO:teuthology.orchestra.run.smithi158.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-09-30T22:19:43.383 INFO:teuthology.orchestra.run.smithi158.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-09-30T22:19:43.385 INFO:teuthology.orchestra.run.smithi040.stdout:==================================================================================================== 2023-09-30T22:19:43.385 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repository Size 2023-09-30T22:19:43.386 INFO:teuthology.orchestra.run.smithi040.stdout:==================================================================================================== 2023-09-30T22:19:43.386 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2023-09-30T22:19:43.386 INFO:teuthology.orchestra.run.smithi040.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-09-30T22:19:43.386 INFO:teuthology.orchestra.run.smithi040.stdout: ceph x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.4 k 2023-09-30T22:19:43.386 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.1 M 2023-09-30T22:19:43.387 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 910 k 2023-09-30T22:19:43.387 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 1.6 M 2023-09-30T22:19:43.387 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 3.1 M 2023-09-30T22:19:43.387 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 8.6 M 2023-09-30T22:19:43.387 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-rook noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 27 k 2023-09-30T22:19:43.388 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-radosgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 12 M 2023-09-30T22:19:43.388 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-test x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 52 M 2023-09-30T22:19:43.388 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 baseos 62 k 2023-09-30T22:19:43.388 INFO:teuthology.orchestra.run.smithi040.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-09-30T22:19:43.388 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 25 k 2023-09-30T22:19:43.389 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 824 k 2023-09-30T22:19:43.389 INFO:teuthology.orchestra.run.smithi040.stdout: librados-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 131 k 2023-09-30T22:19:43.389 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-09-30T22:19:43.389 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cephfs x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 215 k 2023-09-30T22:19:43.389 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 390 k 2023-09-30T22:19:43.389 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 369 k 2023-09-30T22:19:43.389 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 114 k 2023-09-30T22:19:43.389 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 88 k 2023-09-30T22:19:43.389 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-mirror x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-09-30T22:19:43.390 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-nbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 173 k 2023-09-30T22:19:43.390 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrading: 2023-09-30T22:19:43.390 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 baseos 143 k 2023-09-30T22:19:43.390 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-debuginfod-client x86_64 0.189-3.el8 baseos 76 k 2023-09-30T22:19:43.390 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf x86_64 0.189-3.el8 baseos 232 k 2023-09-30T22:19:43.390 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libs x86_64 0.189-3.el8 baseos 303 k 2023-09-30T22:19:43.390 INFO:teuthology.orchestra.run.smithi040.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-09-30T22:19:43.390 INFO:teuthology.orchestra.run.smithi040.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2023-09-30T22:19:43.390 INFO:teuthology.orchestra.run.smithi040.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2023-09-30T22:19:43.390 INFO:teuthology.orchestra.run.smithi040.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2023-09-30T22:19:43.390 INFO:teuthology.orchestra.run.smithi040.stdout: librados2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-09-30T22:19:43.391 INFO:teuthology.orchestra.run.smithi040.stdout: librbd1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 4.2 M 2023-09-30T22:19:43.391 INFO:teuthology.orchestra.run.smithi040.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2023-09-30T22:19:43.391 INFO:teuthology.orchestra.run.smithi040.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2023-09-30T22:19:43.391 INFO:teuthology.orchestra.run.smithi040.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2023-09-30T22:19:43.391 INFO:teuthology.orchestra.run.smithi040.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2023-09-30T22:19:43.391 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2023-09-30T22:19:43.391 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 24 M 2023-09-30T22:19:43.391 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-grafana-dashboards noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 24 k 2023-09-30T22:19:43.391 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mds x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 2.4 M 2023-09-30T22:19:43.391 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 244 k 2023-09-30T22:19:43.391 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mon x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 5.0 M 2023-09-30T22:19:43.391 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-osd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 18 M 2023-09-30T22:19:43.392 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-prometheus-alerts noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 15 k 2023-09-30T22:19:43.392 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-selinux x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 26 k 2023-09-30T22:19:43.392 INFO:teuthology.orchestra.run.smithi040.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-09-30T22:19:43.392 INFO:teuthology.orchestra.run.smithi040.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-30T22:19:43.392 INFO:teuthology.orchestra.run.smithi040.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-09-30T22:19:43.392 INFO:teuthology.orchestra.run.smithi040.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-09-30T22:19:43.392 INFO:teuthology.orchestra.run.smithi040.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-09-30T22:19:43.392 INFO:teuthology.orchestra.run.smithi040.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-09-30T22:19:43.392 INFO:teuthology.orchestra.run.smithi040.stdout: libcephsqlite x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 174 k 2023-09-30T22:19:43.392 INFO:teuthology.orchestra.run.smithi040.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-09-30T22:19:43.392 INFO:teuthology.orchestra.run.smithi040.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-09-30T22:19:43.392 INFO:teuthology.orchestra.run.smithi040.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-30T22:19:43.393 INFO:teuthology.orchestra.run.smithi040.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-09-30T22:19:43.393 INFO:teuthology.orchestra.run.smithi040.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-09-30T22:19:43.393 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 493 k 2023-09-30T22:19:43.393 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-09-30T22:19:43.393 INFO:teuthology.orchestra.run.smithi040.stdout: librgw2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.8 M 2023-09-30T22:19:43.393 INFO:teuthology.orchestra.run.smithi040.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-09-30T22:19:43.393 INFO:teuthology.orchestra.run.smithi040.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-09-30T22:19:43.393 INFO:teuthology.orchestra.run.smithi040.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-30T22:19:43.393 INFO:teuthology.orchestra.run.smithi040.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-09-30T22:19:43.393 INFO:teuthology.orchestra.run.smithi040.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-09-30T22:19:43.393 INFO:teuthology.orchestra.run.smithi040.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-09-30T22:19:43.393 INFO:teuthology.orchestra.run.smithi040.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-09-30T22:19:43.394 INFO:teuthology.orchestra.run.smithi040.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-09-30T22:19:43.394 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-09-30T22:19:43.394 INFO:teuthology.orchestra.run.smithi040.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-09-30T22:19:43.394 INFO:teuthology.orchestra.run.smithi040.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-09-30T22:19:43.394 INFO:teuthology.orchestra.run.smithi040.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-09-30T22:19:43.394 INFO:teuthology.orchestra.run.smithi040.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-30T22:19:43.394 INFO:teuthology.orchestra.run.smithi040.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-30T22:19:43.394 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-30T22:19:43.394 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 45 k 2023-09-30T22:19:43.394 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 99 k 2023-09-30T22:19:43.394 INFO:teuthology.orchestra.run.smithi040.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-30T22:19:43.395 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-09-30T22:19:43.395 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-30T22:19:43.395 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-30T22:19:43.395 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-09-30T22:19:43.395 INFO:teuthology.orchestra.run.smithi040.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-30T22:19:43.395 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-30T22:19:43.395 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-30T22:19:43.395 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-09-30T22:19:43.395 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-09-30T22:19:43.395 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-09-30T22:19:43.395 INFO:teuthology.orchestra.run.smithi040.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-30T22:19:43.396 INFO:teuthology.orchestra.run.smithi040.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-30T22:19:43.396 INFO:teuthology.orchestra.run.smithi040.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-09-30T22:19:43.396 INFO:teuthology.orchestra.run.smithi040.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-09-30T22:19:43.396 INFO:teuthology.orchestra.run.smithi040.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-30T22:19:43.396 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-09-30T22:19:43.396 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-09-30T22:19:43.396 INFO:teuthology.orchestra.run.smithi040.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-09-30T22:19:43.396 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-30T22:19:43.396 INFO:teuthology.orchestra.run.smithi040.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-30T22:19:43.396 INFO:teuthology.orchestra.run.smithi040.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-09-30T22:19:43.396 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-09-30T22:19:43.396 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-09-30T22:19:43.397 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-09-30T22:19:43.397 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-09-30T22:19:43.397 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-09-30T22:19:43.397 INFO:teuthology.orchestra.run.smithi040.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-30T22:19:43.397 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-09-30T22:19:43.397 INFO:teuthology.orchestra.run.smithi040.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-30T22:19:43.397 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-30T22:19:43.397 INFO:teuthology.orchestra.run.smithi040.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-09-30T22:19:43.397 INFO:teuthology.orchestra.run.smithi040.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-30T22:19:43.397 INFO:teuthology.orchestra.run.smithi040.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-30T22:19:43.397 INFO:teuthology.orchestra.run.smithi040.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-30T22:19:43.398 INFO:teuthology.orchestra.run.smithi040.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-30T22:19:43.398 INFO:teuthology.orchestra.run.smithi040.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-30T22:19:43.398 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-30T22:19:43.398 INFO:teuthology.orchestra.run.smithi040.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-30T22:19:43.398 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-30T22:19:43.398 INFO:teuthology.orchestra.run.smithi040.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-09-30T22:19:43.398 INFO:teuthology.orchestra.run.smithi040.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-30T22:19:43.398 INFO:teuthology.orchestra.run.smithi040.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-09-30T22:19:43.398 INFO:teuthology.orchestra.run.smithi040.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-09-30T22:19:43.398 INFO:teuthology.orchestra.run.smithi040.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-09-30T22:19:43.398 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:19:43.398 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2023-09-30T22:19:43.399 INFO:teuthology.orchestra.run.smithi040.stdout:==================================================================================================== 2023-09-30T22:19:43.399 INFO:teuthology.orchestra.run.smithi040.stdout:Install 108 Packages 2023-09-30T22:19:43.399 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrade 14 Packages 2023-09-30T22:19:43.399 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:19:43.399 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 200 M 2023-09-30T22:19:43.399 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2023-09-30T22:19:43.600 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-09-30T22:19:43.612 INFO:teuthology.orchestra.run.smithi158.stdout:==================================================================================================== 2023-09-30T22:19:43.612 INFO:teuthology.orchestra.run.smithi158.stdout: Package Arch Version Repository Size 2023-09-30T22:19:43.612 INFO:teuthology.orchestra.run.smithi158.stdout:==================================================================================================== 2023-09-30T22:19:43.612 INFO:teuthology.orchestra.run.smithi158.stdout:Installing: 2023-09-30T22:19:43.612 INFO:teuthology.orchestra.run.smithi158.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-09-30T22:19:43.612 INFO:teuthology.orchestra.run.smithi158.stdout: ceph x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.4 k 2023-09-30T22:19:43.613 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-base x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.1 M 2023-09-30T22:19:43.613 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 910 k 2023-09-30T22:19:43.613 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 1.6 M 2023-09-30T22:19:43.613 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-dashboard noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 3.1 M 2023-09-30T22:19:43.613 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 8.6 M 2023-09-30T22:19:43.613 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-rook noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 27 k 2023-09-30T22:19:43.613 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-radosgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 12 M 2023-09-30T22:19:43.613 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-test x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 52 M 2023-09-30T22:19:43.613 INFO:teuthology.orchestra.run.smithi158.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 baseos 62 k 2023-09-30T22:19:43.613 INFO:teuthology.orchestra.run.smithi158.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-09-30T22:19:43.613 INFO:teuthology.orchestra.run.smithi158.stdout: libcephfs-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 25 k 2023-09-30T22:19:43.614 INFO:teuthology.orchestra.run.smithi158.stdout: libcephfs2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 824 k 2023-09-30T22:19:43.614 INFO:teuthology.orchestra.run.smithi158.stdout: librados-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 131 k 2023-09-30T22:19:43.614 INFO:teuthology.orchestra.run.smithi158.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-09-30T22:19:43.614 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cephfs x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 215 k 2023-09-30T22:19:43.614 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rados x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 390 k 2023-09-30T22:19:43.614 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 369 k 2023-09-30T22:19:43.614 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 114 k 2023-09-30T22:19:43.614 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 88 k 2023-09-30T22:19:43.614 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-mirror x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-09-30T22:19:43.614 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-nbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 173 k 2023-09-30T22:19:43.614 INFO:teuthology.orchestra.run.smithi158.stdout:Upgrading: 2023-09-30T22:19:43.614 INFO:teuthology.orchestra.run.smithi158.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 baseos 143 k 2023-09-30T22:19:43.615 INFO:teuthology.orchestra.run.smithi158.stdout: elfutils-debuginfod-client x86_64 0.189-3.el8 baseos 76 k 2023-09-30T22:19:43.615 INFO:teuthology.orchestra.run.smithi158.stdout: elfutils-libelf x86_64 0.189-3.el8 baseos 232 k 2023-09-30T22:19:43.615 INFO:teuthology.orchestra.run.smithi158.stdout: elfutils-libs x86_64 0.189-3.el8 baseos 303 k 2023-09-30T22:19:43.615 INFO:teuthology.orchestra.run.smithi158.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-09-30T22:19:43.615 INFO:teuthology.orchestra.run.smithi158.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2023-09-30T22:19:43.615 INFO:teuthology.orchestra.run.smithi158.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2023-09-30T22:19:43.615 INFO:teuthology.orchestra.run.smithi158.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2023-09-30T22:19:43.615 INFO:teuthology.orchestra.run.smithi158.stdout: librados2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-09-30T22:19:43.615 INFO:teuthology.orchestra.run.smithi158.stdout: librbd1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 4.2 M 2023-09-30T22:19:43.615 INFO:teuthology.orchestra.run.smithi158.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2023-09-30T22:19:43.615 INFO:teuthology.orchestra.run.smithi158.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2023-09-30T22:19:43.615 INFO:teuthology.orchestra.run.smithi158.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2023-09-30T22:19:43.616 INFO:teuthology.orchestra.run.smithi158.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2023-09-30T22:19:43.616 INFO:teuthology.orchestra.run.smithi158.stdout:Installing dependencies: 2023-09-30T22:19:43.616 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 24 M 2023-09-30T22:19:43.616 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-grafana-dashboards noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 24 k 2023-09-30T22:19:43.616 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mds x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 2.4 M 2023-09-30T22:19:43.616 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-modules-core noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 244 k 2023-09-30T22:19:43.616 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mon x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 5.0 M 2023-09-30T22:19:43.616 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-osd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 18 M 2023-09-30T22:19:43.616 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-prometheus-alerts noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 15 k 2023-09-30T22:19:43.616 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-selinux x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 26 k 2023-09-30T22:19:43.616 INFO:teuthology.orchestra.run.smithi158.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-09-30T22:19:43.616 INFO:teuthology.orchestra.run.smithi158.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-30T22:19:43.617 INFO:teuthology.orchestra.run.smithi158.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-09-30T22:19:43.617 INFO:teuthology.orchestra.run.smithi158.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-09-30T22:19:43.617 INFO:teuthology.orchestra.run.smithi158.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-09-30T22:19:43.617 INFO:teuthology.orchestra.run.smithi158.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-09-30T22:19:43.617 INFO:teuthology.orchestra.run.smithi158.stdout: libcephsqlite x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 174 k 2023-09-30T22:19:43.617 INFO:teuthology.orchestra.run.smithi158.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-09-30T22:19:43.617 INFO:teuthology.orchestra.run.smithi158.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-09-30T22:19:43.617 INFO:teuthology.orchestra.run.smithi158.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-30T22:19:43.617 INFO:teuthology.orchestra.run.smithi158.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-09-30T22:19:43.617 INFO:teuthology.orchestra.run.smithi158.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-09-30T22:19:43.617 INFO:teuthology.orchestra.run.smithi158.stdout: libradosstriper1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 493 k 2023-09-30T22:19:43.617 INFO:teuthology.orchestra.run.smithi158.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-09-30T22:19:43.618 INFO:teuthology.orchestra.run.smithi158.stdout: librgw2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.8 M 2023-09-30T22:19:43.618 INFO:teuthology.orchestra.run.smithi158.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-09-30T22:19:43.618 INFO:teuthology.orchestra.run.smithi158.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-09-30T22:19:43.618 INFO:teuthology.orchestra.run.smithi158.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-30T22:19:43.618 INFO:teuthology.orchestra.run.smithi158.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-09-30T22:19:43.618 INFO:teuthology.orchestra.run.smithi158.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-09-30T22:19:43.618 INFO:teuthology.orchestra.run.smithi158.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-09-30T22:19:43.618 INFO:teuthology.orchestra.run.smithi158.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-09-30T22:19:43.618 INFO:teuthology.orchestra.run.smithi158.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-09-30T22:19:43.618 INFO:teuthology.orchestra.run.smithi158.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-09-30T22:19:43.618 INFO:teuthology.orchestra.run.smithi158.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-09-30T22:19:43.619 INFO:teuthology.orchestra.run.smithi158.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-09-30T22:19:43.619 INFO:teuthology.orchestra.run.smithi158.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-09-30T22:19:43.619 INFO:teuthology.orchestra.run.smithi158.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-30T22:19:43.619 INFO:teuthology.orchestra.run.smithi158.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-30T22:19:43.619 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-30T22:19:43.619 INFO:teuthology.orchestra.run.smithi158.stdout: python3-ceph-argparse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 45 k 2023-09-30T22:19:43.619 INFO:teuthology.orchestra.run.smithi158.stdout: python3-ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 99 k 2023-09-30T22:19:43.619 INFO:teuthology.orchestra.run.smithi158.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-30T22:19:43.619 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-09-30T22:19:43.619 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-30T22:19:43.620 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-30T22:19:43.620 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-09-30T22:19:43.620 INFO:teuthology.orchestra.run.smithi158.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-30T22:19:43.620 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-30T22:19:43.620 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-30T22:19:43.620 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-09-30T22:19:43.620 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-09-30T22:19:43.620 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-09-30T22:19:43.620 INFO:teuthology.orchestra.run.smithi158.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-30T22:19:43.620 INFO:teuthology.orchestra.run.smithi158.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-30T22:19:43.621 INFO:teuthology.orchestra.run.smithi158.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-09-30T22:19:43.621 INFO:teuthology.orchestra.run.smithi158.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-09-30T22:19:43.621 INFO:teuthology.orchestra.run.smithi158.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-30T22:19:43.621 INFO:teuthology.orchestra.run.smithi158.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-09-30T22:19:43.621 INFO:teuthology.orchestra.run.smithi158.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-09-30T22:19:43.621 INFO:teuthology.orchestra.run.smithi158.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-09-30T22:19:43.621 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-30T22:19:43.621 INFO:teuthology.orchestra.run.smithi158.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-30T22:19:43.622 INFO:teuthology.orchestra.run.smithi158.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-09-30T22:19:43.622 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-09-30T22:19:43.622 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-09-30T22:19:43.622 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-09-30T22:19:43.622 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-09-30T22:19:43.622 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-09-30T22:19:43.622 INFO:teuthology.orchestra.run.smithi158.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-30T22:19:43.622 INFO:teuthology.orchestra.run.smithi158.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-09-30T22:19:43.622 INFO:teuthology.orchestra.run.smithi158.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-30T22:19:43.622 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-30T22:19:43.622 INFO:teuthology.orchestra.run.smithi158.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-09-30T22:19:43.623 INFO:teuthology.orchestra.run.smithi158.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-30T22:19:43.623 INFO:teuthology.orchestra.run.smithi158.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-30T22:19:43.623 INFO:teuthology.orchestra.run.smithi158.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-30T22:19:43.623 INFO:teuthology.orchestra.run.smithi158.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-30T22:19:43.623 INFO:teuthology.orchestra.run.smithi158.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-30T22:19:43.623 INFO:teuthology.orchestra.run.smithi158.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-30T22:19:43.623 INFO:teuthology.orchestra.run.smithi158.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-30T22:19:43.623 INFO:teuthology.orchestra.run.smithi158.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-30T22:19:43.623 INFO:teuthology.orchestra.run.smithi158.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-09-30T22:19:43.623 INFO:teuthology.orchestra.run.smithi158.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-30T22:19:43.623 INFO:teuthology.orchestra.run.smithi158.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-09-30T22:19:43.623 INFO:teuthology.orchestra.run.smithi158.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-09-30T22:19:43.624 INFO:teuthology.orchestra.run.smithi158.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-09-30T22:19:43.624 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:19:43.624 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2023-09-30T22:19:43.624 INFO:teuthology.orchestra.run.smithi158.stdout:==================================================================================================== 2023-09-30T22:19:43.624 INFO:teuthology.orchestra.run.smithi158.stdout:Install 108 Packages 2023-09-30T22:19:43.624 INFO:teuthology.orchestra.run.smithi158.stdout:Upgrade 14 Packages 2023-09-30T22:19:43.624 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:19:43.625 INFO:teuthology.orchestra.run.smithi158.stdout:Total download size: 200 M 2023-09-30T22:19:43.625 INFO:teuthology.orchestra.run.smithi158.stdout:Downloading Packages: 2023-09-30T22:19:43.674 INFO:teuthology.orchestra.run.smithi040.stdout:(1/122): ceph-16.2.14-44.geeb13ac9.el8.x86_64.r 47 kB/s | 6.4 kB 00:00 2023-09-30T22:19:44.066 INFO:teuthology.orchestra.run.smithi040.stdout:(2/122): ceph-fuse-16.2.14-44.geeb13ac9.el8.x86 2.3 MB/s | 910 kB 00:00 2023-09-30T22:19:44.443 INFO:teuthology.orchestra.run.smithi158.stdout:(1/122): ceph-16.2.14-44.geeb13ac9.el8.x86_64.r 17 kB/s | 6.4 kB 00:00 2023-09-30T22:19:44.917 INFO:teuthology.orchestra.run.smithi158.stdout:(2/122): ceph-fuse-16.2.14-44.geeb13ac9.el8.x86 1.9 MB/s | 910 kB 00:00 2023-09-30T22:19:45.009 INFO:teuthology.orchestra.run.smithi040.stdout:(3/122): ceph-common-16.2.14-44.geeb13ac9.el8.x 16 MB/s | 24 MB 00:01 2023-09-30T22:19:45.066 INFO:teuthology.orchestra.run.smithi040.stdout:(4/122): ceph-mds-16.2.14-44.geeb13ac9.el8.x86_ 2.4 MB/s | 2.4 MB 00:00 2023-09-30T22:19:45.334 INFO:teuthology.orchestra.run.smithi040.stdout:(5/122): ceph-mgr-16.2.14-44.geeb13ac9.el8.x86_ 5.0 MB/s | 1.6 MB 00:00 2023-09-30T22:19:45.402 INFO:teuthology.orchestra.run.smithi158.stdout:(3/122): ceph-mds-16.2.14-44.geeb13ac9.el8.x86_ 5.1 MB/s | 2.4 MB 00:00 2023-09-30T22:19:45.695 INFO:teuthology.orchestra.run.smithi158.stdout:(4/122): ceph-mgr-16.2.14-44.geeb13ac9.el8.x86_ 5.5 MB/s | 1.6 MB 00:00 2023-09-30T22:19:46.360 INFO:teuthology.orchestra.run.smithi158.stdout:(5/122): ceph-mon-16.2.14-44.geeb13ac9.el8.x86_ 7.5 MB/s | 5.0 MB 00:00 2023-09-30T22:19:47.069 INFO:teuthology.orchestra.run.smithi158.stdout:(6/122): ceph-common-16.2.14-44.geeb13ac9.el8.x 8.1 MB/s | 24 MB 00:03 2023-09-30T22:19:47.417 INFO:teuthology.orchestra.run.smithi040.stdout:(6/122): ceph-base-16.2.14-44.geeb13ac9.el8.x86 1.6 MB/s | 6.1 MB 00:03 2023-09-30T22:19:47.642 INFO:teuthology.orchestra.run.smithi040.stdout:(7/122): ceph-osd-16.2.14-44.geeb13ac9.el8.x86_ 7.9 MB/s | 18 MB 00:02 2023-09-30T22:19:47.732 INFO:teuthology.orchestra.run.smithi040.stdout:(8/122): ceph-selinux-16.2.14-44.geeb13ac9.el8. 286 kB/s | 26 kB 00:00 2023-09-30T22:19:47.936 INFO:teuthology.orchestra.run.smithi158.stdout:(7/122): ceph-osd-16.2.14-44.geeb13ac9.el8.x86_ 12 MB/s | 18 MB 00:01 2023-09-30T22:19:48.003 INFO:teuthology.orchestra.run.smithi158.stdout:(8/122): ceph-selinux-16.2.14-44.geeb13ac9.el8. 385 kB/s | 26 kB 00:00 2023-09-30T22:19:48.711 INFO:teuthology.orchestra.run.smithi158.stdout:(9/122): ceph-radosgw-16.2.14-44.geeb13ac9.el8. 7.0 MB/s | 12 MB 00:01 2023-09-30T22:19:48.803 INFO:teuthology.orchestra.run.smithi158.stdout:(10/122): libcephfs-devel-16.2.14-44.geeb13ac9. 279 kB/s | 25 kB 00:00 2023-09-30T22:19:48.995 INFO:teuthology.orchestra.run.smithi158.stdout:(11/122): libcephfs2-16.2.14-44.geeb13ac9.el8.x 4.2 MB/s | 824 kB 00:00 2023-09-30T22:19:49.095 INFO:teuthology.orchestra.run.smithi158.stdout:(12/122): libcephsqlite-16.2.14-44.geeb13ac9.el 1.7 MB/s | 174 kB 00:00 2023-09-30T22:19:49.195 INFO:teuthology.orchestra.run.smithi158.stdout:(13/122): librados-devel-16.2.14-44.geeb13ac9.e 1.3 MB/s | 131 kB 00:00 2023-09-30T22:19:49.304 INFO:teuthology.orchestra.run.smithi158.stdout:(14/122): libradosstriper1-16.2.14-44.geeb13ac9 4.4 MB/s | 493 kB 00:00 2023-09-30T22:19:49.542 INFO:teuthology.orchestra.run.smithi040.stdout:(9/122): ceph-mon-16.2.14-44.geeb13ac9.el8.x86_ 1.1 MB/s | 5.0 MB 00:04 2023-09-30T22:19:49.618 INFO:teuthology.orchestra.run.smithi040.stdout:(10/122): libcephfs-devel-16.2.14-44.geeb13ac9. 341 kB/s | 25 kB 00:00 2023-09-30T22:19:49.879 INFO:teuthology.orchestra.run.smithi158.stdout:(15/122): librgw2-16.2.14-44.geeb13ac9.el8.x86_ 6.6 MB/s | 3.8 MB 00:00 2023-09-30T22:19:49.972 INFO:teuthology.orchestra.run.smithi158.stdout:(16/122): python3-ceph-argparse-16.2.14-44.geeb 490 kB/s | 45 kB 00:00 2023-09-30T22:19:50.047 INFO:teuthology.orchestra.run.smithi158.stdout:(17/122): python3-ceph-common-16.2.14-44.geeb13 1.3 MB/s | 99 kB 00:00 2023-09-30T22:19:50.059 INFO:teuthology.orchestra.run.smithi040.stdout:(11/122): libcephfs2-16.2.14-44.geeb13ac9.el8.x 1.8 MB/s | 824 kB 00:00 2023-09-30T22:19:50.122 INFO:teuthology.orchestra.run.smithi158.stdout:(18/122): python3-cephfs-16.2.14-44.geeb13ac9.e 2.8 MB/s | 215 kB 00:00 2023-09-30T22:19:50.168 INFO:teuthology.orchestra.run.smithi040.stdout:(12/122): libcephsqlite-16.2.14-44.geeb13ac9.el 1.6 MB/s | 174 kB 00:00 2023-09-30T22:19:50.214 INFO:teuthology.orchestra.run.smithi158.stdout:(19/122): python3-rados-16.2.14-44.geeb13ac9.el 4.2 MB/s | 390 kB 00:00 2023-09-30T22:19:50.285 INFO:teuthology.orchestra.run.smithi040.stdout:(13/122): librados-devel-16.2.14-44.geeb13ac9.e 1.1 MB/s | 131 kB 00:00 2023-09-30T22:19:50.306 INFO:teuthology.orchestra.run.smithi158.stdout:(20/122): python3-rbd-16.2.14-44.geeb13ac9.el8. 3.9 MB/s | 369 kB 00:00 2023-09-30T22:19:50.390 INFO:teuthology.orchestra.run.smithi158.stdout:(21/122): python3-rgw-16.2.14-44.geeb13ac9.el8. 1.3 MB/s | 114 kB 00:00 2023-09-30T22:19:50.473 INFO:teuthology.orchestra.run.smithi158.stdout:(22/122): rbd-fuse-16.2.14-44.geeb13ac9.el8.x86 1.0 MB/s | 88 kB 00:00 2023-09-30T22:19:50.535 INFO:teuthology.orchestra.run.smithi040.stdout:(14/122): libradosstriper1-16.2.14-44.geeb13ac9 1.9 MB/s | 493 kB 00:00 2023-09-30T22:19:50.782 INFO:teuthology.orchestra.run.smithi158.stdout:(23/122): ceph-base-16.2.14-44.geeb13ac9.el8.x8 926 kB/s | 6.1 MB 00:06 2023-09-30T22:19:50.999 INFO:teuthology.orchestra.run.smithi158.stdout:(24/122): rbd-mirror-16.2.14-44.geeb13ac9.el8.x 7.0 MB/s | 3.7 MB 00:00 2023-09-30T22:19:51.024 INFO:teuthology.orchestra.run.smithi158.stdout:(25/122): rbd-nbd-16.2.14-44.geeb13ac9.el8.x86_ 717 kB/s | 173 kB 00:00 2023-09-30T22:19:51.083 INFO:teuthology.orchestra.run.smithi158.stdout:(26/122): ceph-grafana-dashboards-16.2.14-44.ge 292 kB/s | 24 kB 00:00 2023-09-30T22:19:52.219 INFO:teuthology.orchestra.run.smithi040.stdout:(15/122): librgw2-16.2.14-44.geeb13ac9.el8.x86_ 2.2 MB/s | 3.8 MB 00:01 2023-09-30T22:19:52.269 INFO:teuthology.orchestra.run.smithi040.stdout:(16/122): python3-ceph-argparse-16.2.14-44.geeb 904 kB/s | 45 kB 00:00 2023-09-30T22:19:52.311 INFO:teuthology.orchestra.run.smithi040.stdout:(17/122): python3-ceph-common-16.2.14-44.geeb13 2.3 MB/s | 99 kB 00:00 2023-09-30T22:19:52.420 INFO:teuthology.orchestra.run.smithi040.stdout:(18/122): python3-cephfs-16.2.14-44.geeb13ac9.e 1.9 MB/s | 215 kB 00:00 2023-09-30T22:19:52.595 INFO:teuthology.orchestra.run.smithi040.stdout:(19/122): ceph-radosgw-16.2.14-44.geeb13ac9.el8 2.2 MB/s | 12 MB 00:05 2023-09-30T22:19:52.620 INFO:teuthology.orchestra.run.smithi040.stdout:(20/122): python3-rados-16.2.14-44.geeb13ac9.el 1.9 MB/s | 390 kB 00:00 2023-09-30T22:19:52.658 INFO:teuthology.orchestra.run.smithi158.stdout:(27/122): ceph-test-16.2.14-44.geeb13ac9.el8.x8 11 MB/s | 52 MB 00:04 2023-09-30T22:19:52.695 INFO:teuthology.orchestra.run.smithi040.stdout:(21/122): python3-rgw-16.2.14-44.geeb13ac9.el8. 1.5 MB/s | 114 kB 00:00 2023-09-30T22:19:52.729 INFO:teuthology.orchestra.run.smithi040.stdout:(22/122): python3-rbd-16.2.14-44.geeb13ac9.el8. 2.7 MB/s | 369 kB 00:00 2023-09-30T22:19:52.754 INFO:teuthology.orchestra.run.smithi040.stdout:(23/122): rbd-fuse-16.2.14-44.geeb13ac9.el8.x86 1.5 MB/s | 88 kB 00:00 2023-09-30T22:19:52.792 INFO:teuthology.orchestra.run.smithi158.stdout:(28/122): ceph-mgr-diskprediction-local-16.2.14 5.0 MB/s | 8.6 MB 00:01 2023-09-30T22:19:52.817 INFO:teuthology.orchestra.run.smithi158.stdout:(29/122): ceph-mgr-modules-core-16.2.14-44.geeb 1.5 MB/s | 244 kB 00:00 2023-09-30T22:19:52.821 INFO:teuthology.orchestra.run.smithi040.stdout:(24/122): rbd-nbd-16.2.14-44.geeb13ac9.el8.x86_ 2.5 MB/s | 173 kB 00:00 2023-09-30T22:19:52.851 INFO:teuthology.orchestra.run.smithi158.stdout:(30/122): ceph-mgr-rook-16.2.14-44.geeb13ac9.el 472 kB/s | 27 kB 00:00 2023-09-30T22:19:52.863 INFO:teuthology.orchestra.run.smithi040.stdout:(25/122): ceph-grafana-dashboards-16.2.14-44.ge 587 kB/s | 24 kB 00:00 2023-09-30T22:19:52.876 INFO:teuthology.orchestra.run.smithi158.stdout:(31/122): ceph-prometheus-alerts-16.2.14-44.gee 253 kB/s | 15 kB 00:00 2023-09-30T22:19:53.110 INFO:teuthology.orchestra.run.smithi158.stdout:(32/122): ceph-mgr-dashboard-16.2.14-44.geeb13a 1.5 MB/s | 3.1 MB 00:02 2023-09-30T22:19:53.418 INFO:teuthology.orchestra.run.smithi158.stdout:(33/122): flex-2.6.1-9.el8.x86_64.rpm 590 kB/s | 320 kB 00:00 2023-09-30T22:19:53.430 INFO:teuthology.orchestra.run.smithi040.stdout:(26/122): ceph-mgr-dashboard-16.2.14-44.geeb13a 5.5 MB/s | 3.1 MB 00:00 2023-09-30T22:19:53.477 INFO:teuthology.orchestra.run.smithi158.stdout:(34/122): bison-3.0.4-10.el8.x86_64.rpm 1.1 MB/s | 688 kB 00:00 2023-09-30T22:19:53.602 INFO:teuthology.orchestra.run.smithi158.stdout:(35/122): librdkafka-0.11.4-3.el8.x86_64.rpm 1.9 MB/s | 354 kB 00:00 2023-09-30T22:19:53.614 INFO:teuthology.orchestra.run.smithi040.stdout:(27/122): rbd-mirror-16.2.14-44.geeb13ac9.el8.x 4.2 MB/s | 3.7 MB 00:00 2023-09-30T22:19:53.628 INFO:teuthology.orchestra.run.smithi158.stdout:(36/122): jq-1.6-7.el8.x86_64.rpm 391 kB/s | 202 kB 00:00 2023-09-30T22:19:53.644 INFO:teuthology.orchestra.run.smithi158.stdout:(37/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.5 MB/s | 259 kB 00:00 2023-09-30T22:19:53.720 INFO:teuthology.orchestra.run.smithi158.stdout:(38/122): oniguruma-6.8.2-2.el8.x86_64.rpm 1.6 MB/s | 187 kB 00:00 2023-09-30T22:19:53.722 INFO:teuthology.orchestra.run.smithi040.stdout:(28/122): ceph-mgr-modules-core-16.2.14-44.geeb 2.2 MB/s | 244 kB 00:00 2023-09-30T22:19:53.789 INFO:teuthology.orchestra.run.smithi040.stdout:(29/122): ceph-mgr-rook-16.2.14-44.geeb13ac9.el 411 kB/s | 27 kB 00:00 2023-09-30T22:19:53.820 INFO:teuthology.orchestra.run.smithi158.stdout:(39/122): python3-jsonpatch-1.21-2.el8.noarch.r 266 kB/s | 27 kB 00:00 2023-09-30T22:19:53.857 INFO:teuthology.orchestra.run.smithi040.stdout:(30/122): ceph-prometheus-alerts-16.2.14-44.gee 222 kB/s | 15 kB 00:00 2023-09-30T22:19:53.920 INFO:teuthology.orchestra.run.smithi158.stdout:(40/122): python3-jsonpointer-1.10-11.el8.noarc 200 kB/s | 20 kB 00:00 2023-09-30T22:19:54.037 INFO:teuthology.orchestra.run.smithi158.stdout:(41/122): openblas-0.3.15-4.el8.x86_64.rpm 12 MB/s | 4.7 MB 00:00 2023-09-30T22:19:54.054 INFO:teuthology.orchestra.run.smithi158.stdout:(42/122): python3-mako-1.0.6-14.el8.noarch.rpm 1.1 MB/s | 157 kB 00:00 2023-09-30T22:19:54.130 INFO:teuthology.orchestra.run.smithi158.stdout:(43/122): python3-markupsafe-0.23-19.el8.x86_64 421 kB/s | 39 kB 00:00 2023-09-30T22:19:54.213 INFO:teuthology.orchestra.run.smithi158.stdout:(44/122): openblas-threads-0.3.15-4.el8.x86_64. 8.5 MB/s | 4.9 MB 00:00 2023-09-30T22:19:54.238 INFO:teuthology.orchestra.run.smithi158.stdout:(45/122): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.0 MB/s | 225 kB 00:00 2023-09-30T22:19:54.314 INFO:teuthology.orchestra.run.smithi158.stdout:(46/122): python3-prettytable-0.7.2-14.el8.noar 440 kB/s | 44 kB 00:00 2023-09-30T22:19:54.339 INFO:teuthology.orchestra.run.smithi158.stdout:(47/122): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.0 MB/s | 103 kB 00:00 2023-09-30T22:19:54.406 INFO:teuthology.orchestra.run.smithi158.stdout:(48/122): python3-numpy-1.14.3-10.el8.x86_64.rp 11 MB/s | 3.7 MB 00:00 2023-09-30T22:19:54.423 INFO:teuthology.orchestra.run.smithi158.stdout:(49/122): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.1 MB/s | 126 kB 00:00 2023-09-30T22:19:54.448 INFO:teuthology.orchestra.run.smithi158.stdout:(50/122): python3-pyasn1-modules-0.3.7-6.el8.no 1.0 MB/s | 110 kB 00:00 2023-09-30T22:19:54.507 INFO:teuthology.orchestra.run.smithi158.stdout:(51/122): python3-pytz-2017.2-11.el8.noarch.rpm 568 kB/s | 57 kB 00:00 2023-09-30T22:19:54.540 INFO:teuthology.orchestra.run.smithi040.stdout:(31/122): ceph-test-16.2.14-44.geeb13ac9.el8.x8 7.6 MB/s | 52 MB 00:06 2023-09-30T22:19:54.566 INFO:teuthology.orchestra.run.smithi158.stdout:(52/122): python3-werkzeug-0.12.2-4.el8.noarch. 3.8 MB/s | 457 kB 00:00 2023-09-30T22:19:54.616 INFO:teuthology.orchestra.run.smithi158.stdout:(53/122): socat-1.7.4.1-1.el8.x86_64.rpm 2.9 MB/s | 323 kB 00:00 2023-09-30T22:19:54.666 INFO:teuthology.orchestra.run.smithi158.stdout:(54/122): xmlstarlet-1.6.1-20.el8.x86_64.rpm 705 kB/s | 71 kB 00:00 2023-09-30T22:19:54.783 INFO:teuthology.orchestra.run.smithi158.stdout:(55/122): elfutils-libelf-devel-0.189-3.el8.x86 369 kB/s | 62 kB 00:00 2023-09-30T22:19:54.825 INFO:teuthology.orchestra.run.smithi158.stdout:(56/122): fuse-2.9.7-17.el8.x86_64.rpm 524 kB/s | 83 kB 00:00 2023-09-30T22:19:54.849 INFO:teuthology.orchestra.run.smithi040.stdout:(32/122): bison-3.0.4-10.el8.x86_64.rpm 694 kB/s | 688 kB 00:00 2023-09-30T22:19:54.858 INFO:teuthology.orchestra.run.smithi158.stdout:(57/122): keyutils-libs-devel-1.5.10-9.el8.x86_ 640 kB/s | 48 kB 00:00 2023-09-30T22:19:54.934 INFO:teuthology.orchestra.run.smithi158.stdout:(58/122): libcom_err-devel-1.45.6-5.el8.x86_64. 516 kB/s | 39 kB 00:00 2023-09-30T22:19:54.982 INFO:teuthology.orchestra.run.smithi040.stdout:(33/122): jq-1.6-7.el8.x86_64.rpm 1.5 MB/s | 202 kB 00:00 2023-09-30T22:19:55.099 INFO:teuthology.orchestra.run.smithi040.stdout:(34/122): ceph-mgr-diskprediction-local-16.2.14 5.1 MB/s | 8.6 MB 00:01 2023-09-30T22:19:55.109 INFO:teuthology.orchestra.run.smithi158.stdout:(59/122): python3-scipy-1.0.0-21.module_el8.5.0 20 MB/s | 14 MB 00:00 2023-09-30T22:19:55.125 INFO:teuthology.orchestra.run.smithi040.stdout:(35/122): flex-2.6.1-9.el8.x86_64.rpm 547 kB/s | 320 kB 00:00 2023-09-30T22:19:55.143 INFO:teuthology.orchestra.run.smithi158.stdout:(60/122): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.7 MB/s | 561 kB 00:00 2023-09-30T22:19:55.150 INFO:teuthology.orchestra.run.smithi040.stdout:(36/122): librdkafka-0.11.4-3.el8.x86_64.rpm 2.1 MB/s | 354 kB 00:00 2023-09-30T22:19:55.193 INFO:teuthology.orchestra.run.smithi158.stdout:(61/122): librabbitmq-0.9.0-4.el8.x86_64.rpm 941 kB/s | 47 kB 00:00 2023-09-30T22:19:55.252 INFO:teuthology.orchestra.run.smithi158.stdout:(62/122): libselinux-devel-2.9-8.el8.x86_64.rpm 3.4 MB/s | 200 kB 00:00 2023-09-30T22:19:55.277 INFO:teuthology.orchestra.run.smithi158.stdout:(63/122): libquadmath-8.5.0-20.el8.x86_64.rpm 1.0 MB/s | 172 kB 00:00 2023-09-30T22:19:55.302 INFO:teuthology.orchestra.run.smithi040.stdout:(37/122): oniguruma-6.8.2-2.el8.x86_64.rpm 1.0 MB/s | 187 kB 00:00 2023-09-30T22:19:55.311 INFO:teuthology.orchestra.run.smithi158.stdout:(64/122): libsepol-devel-2.9-3.el8.x86_64.rpm 1.5 MB/s | 87 kB 00:00 2023-09-30T22:19:55.336 INFO:teuthology.orchestra.run.smithi158.stdout:(65/122): libverto-devel-0.3.2-2.el8.x86_64.rpm 308 kB/s | 18 kB 00:00 2023-09-30T22:19:55.361 INFO:teuthology.orchestra.run.smithi158.stdout:(66/122): libgfortran-8.5.0-20.el8.x86_64.rpm 1.5 MB/s | 645 kB 00:00 2023-09-30T22:19:55.386 INFO:teuthology.orchestra.run.smithi158.stdout:(67/122): libzstd-devel-1.4.4-1.el8.x86_64.rpm 581 kB/s | 44 kB 00:00 2023-09-30T22:19:55.470 INFO:teuthology.orchestra.run.smithi158.stdout:(68/122): pcre2-utf16-10.32-3.el8.x86_64.rpm 2.7 MB/s | 229 kB 00:00 2023-09-30T22:19:55.554 INFO:teuthology.orchestra.run.smithi158.stdout:(69/122): pcre2-utf32-10.32-3.el8.x86_64.rpm 2.6 MB/s | 220 kB 00:00 2023-09-30T22:19:55.609 INFO:teuthology.orchestra.run.smithi040.stdout:(38/122): openblas-0.3.15-4.el8.x86_64.rpm 10 MB/s | 4.7 MB 00:00 2023-09-30T22:19:55.635 INFO:teuthology.orchestra.run.smithi040.stdout:(39/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 486 kB/s | 259 kB 00:00 2023-09-30T22:19:55.638 INFO:teuthology.orchestra.run.smithi158.stdout:(70/122): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.9 MB/s | 249 kB 00:00 2023-09-30T22:19:55.705 INFO:teuthology.orchestra.run.smithi158.stdout:(71/122): pcre2-devel-10.32-3.el8.x86_64.rpm 1.7 MB/s | 605 kB 00:00 2023-09-30T22:19:55.710 INFO:teuthology.orchestra.run.smithi040.stdout:(40/122): python3-jsonpatch-1.21-2.el8.noarch.r 265 kB/s | 27 kB 00:00 2023-09-30T22:19:55.735 INFO:teuthology.orchestra.run.smithi040.stdout:(41/122): python3-jsonpointer-1.10-11.el8.noarc 199 kB/s | 20 kB 00:00 2023-09-30T22:19:55.763 INFO:teuthology.orchestra.run.smithi158.stdout:(72/122): python3-jwt-1.6.1-2.el8.noarch.rpm 732 kB/s | 43 kB 00:00 2023-09-30T22:19:55.789 INFO:teuthology.orchestra.run.smithi158.stdout:(73/122): python3-cryptography-3.2.1-6.el8.x86_ 4.2 MB/s | 641 kB 00:00 2023-09-30T22:19:55.818 INFO:teuthology.orchestra.run.smithi040.stdout:(42/122): openblas-threads-0.3.15-4.el8.x86_64. 9.4 MB/s | 4.9 MB 00:00 2023-09-30T22:19:55.848 INFO:teuthology.orchestra.run.smithi158.stdout:(74/122): python3-pycparser-2.14-14.el8.noarch. 1.8 MB/s | 109 kB 00:00 2023-09-30T22:19:55.878 INFO:teuthology.orchestra.run.smithi040.stdout:(43/122): python3-markupsafe-0.23-19.el8.x86_64 271 kB/s | 39 kB 00:00 2023-09-30T22:19:55.897 INFO:teuthology.orchestra.run.smithi158.stdout:(75/122): python3-oauthlib-2.1.0-1.el8.noarch.r 1.1 MB/s | 155 kB 00:00 2023-09-30T22:19:55.910 INFO:teuthology.orchestra.run.smithi040.stdout:(44/122): python3-mako-1.0.6-14.el8.noarch.rpm 782 kB/s | 157 kB 00:00 2023-09-30T22:19:55.956 INFO:teuthology.orchestra.run.smithi158.stdout:(76/122): openssl-devel-1.1.1k-9.el8.x86_64.rpm 5.1 MB/s | 3.2 MB 00:00 2023-09-30T22:19:55.981 INFO:teuthology.orchestra.run.smithi158.stdout:(77/122): python3-requests-oauthlib-1.0.0-1.el8 318 kB/s | 43 kB 00:00 2023-09-30T22:19:56.007 INFO:teuthology.orchestra.run.smithi158.stdout:(78/122): zlib-devel-1.2.11-21.el8.x86_64.rpm 533 kB/s | 58 kB 00:00 2023-09-30T22:19:56.010 INFO:teuthology.orchestra.run.smithi040.stdout:(45/122): python3-prettytable-0.7.2-14.el8.noar 440 kB/s | 44 kB 00:00 2023-09-30T22:19:56.036 INFO:teuthology.orchestra.run.smithi040.stdout:(46/122): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.4 MB/s | 225 kB 00:00 2023-09-30T22:19:56.157 INFO:teuthology.orchestra.run.smithi158.stdout:(79/122): leveldb-1.22-1.el8.x86_64.rpm 1.0 MB/s | 181 kB 00:00 2023-09-30T22:19:56.178 INFO:teuthology.orchestra.run.smithi040.stdout:(47/122): python3-numpy-1.14.3-10.el8.x86_64.rp 10 MB/s | 3.7 MB 00:00 2023-09-30T22:19:56.182 INFO:teuthology.orchestra.run.smithi158.stdout:(80/122): liboath-2.6.2-3.el8.x86_64.rpm 354 kB/s | 59 kB 00:00 2023-09-30T22:19:56.203 INFO:teuthology.orchestra.run.smithi040.stdout:(48/122): python3-pyOpenSSL-19.0.0-1.el8.noarch 538 kB/s | 103 kB 00:00 2023-09-30T22:19:56.207 INFO:teuthology.orchestra.run.smithi158.stdout:(81/122): libunwind-1.3.1-3.el8.x86_64.rpm 1.5 MB/s | 75 kB 00:00 2023-09-30T22:19:56.228 INFO:teuthology.orchestra.run.smithi040.stdout:(49/122): python3-pyasn1-0.3.7-6.el8.noarch.rpm 657 kB/s | 126 kB 00:00 2023-09-30T22:19:56.232 INFO:teuthology.orchestra.run.smithi158.stdout:(82/122): gperftools-libs-2.7-9.el8.x86_64.rpm 1.1 MB/s | 306 kB 00:00 2023-09-30T22:19:56.250 INFO:teuthology.orchestra.run.smithi158.stdout:(83/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 652 kB/s | 44 kB 00:00 2023-09-30T22:19:56.279 INFO:teuthology.orchestra.run.smithi040.stdout:(50/122): python3-pyasn1-modules-0.3.7-6.el8.no 1.1 MB/s | 110 kB 00:00 2023-09-30T22:19:56.296 INFO:teuthology.orchestra.run.smithi158.stdout:(84/122): python3-beautifulsoup4-4.6.3-2.el8.1. 2.1 MB/s | 185 kB 00:00 2023-09-30T22:19:56.304 INFO:teuthology.orchestra.run.smithi040.stdout:(51/122): python3-pytz-2017.2-11.el8.noarch.rpm 566 kB/s | 57 kB 00:00 2023-09-30T22:19:56.325 INFO:teuthology.orchestra.run.smithi158.stdout:(85/122): python3-certifi-2018.10.15-7.el8.noar 216 kB/s | 16 kB 00:00 2023-09-30T22:19:56.351 INFO:teuthology.orchestra.run.smithi158.stdout:(86/122): python3-cachetools-3.1.1-4.el8.noarch 280 kB/s | 33 kB 00:00 2023-09-30T22:19:56.376 INFO:teuthology.orchestra.run.smithi158.stdout:(87/122): python3-cheroot-8.5.2-1.el8.noarch.rp 2.1 MB/s | 173 kB 00:00 2023-09-30T22:19:56.401 INFO:teuthology.orchestra.run.smithi158.stdout:(88/122): python3-google-auth-1.1.1-10.el8.noar 1.6 MB/s | 81 kB 00:00 2023-09-30T22:19:56.412 INFO:teuthology.orchestra.run.smithi040.stdout:(52/122): python3-werkzeug-0.12.2-4.el8.noarch. 3.4 MB/s | 457 kB 00:00 2023-09-30T22:19:56.426 INFO:teuthology.orchestra.run.smithi158.stdout:(89/122): python3-jaraco-6.2-6.el8.noarch.rpm 220 kB/s | 11 kB 00:00 2023-09-30T22:19:56.455 INFO:teuthology.orchestra.run.smithi040.stdout:(53/122): socat-1.7.4.1-1.el8.x86_64.rpm 2.1 MB/s | 323 kB 00:00 2023-09-30T22:19:56.460 INFO:teuthology.orchestra.run.smithi158.stdout:(90/122): python3-jaraco-functools-2.0-4.el8.no 300 kB/s | 18 kB 00:00 2023-09-30T22:19:56.494 INFO:teuthology.orchestra.run.smithi158.stdout:(91/122): python3-cherrypy-18.4.0-1.el8.noarch. 2.2 MB/s | 384 kB 00:00 2023-09-30T22:19:56.513 INFO:teuthology.orchestra.run.smithi040.stdout:(54/122): xmlstarlet-1.6.1-20.el8.x86_64.rpm 703 kB/s | 71 kB 00:00 2023-09-30T22:19:56.519 INFO:teuthology.orchestra.run.smithi158.stdout:(92/122): python3-logutils-0.3.5-11.el8.noarch. 833 kB/s | 49 kB 00:00 2023-09-30T22:19:56.544 INFO:teuthology.orchestra.run.smithi158.stdout:(93/122): python3-more-itertools-7.2.0-3.el8.no 1.2 MB/s | 59 kB 00:00 2023-09-30T22:19:56.578 INFO:teuthology.orchestra.run.smithi158.stdout:(94/122): python3-pecan-1.3.2-9.el8.noarch.rpm 4.7 MB/s | 283 kB 00:00 2023-09-30T22:19:56.597 INFO:teuthology.orchestra.run.smithi040.stdout:(55/122): elfutils-libelf-devel-0.189-3.el8.x86 435 kB/s | 62 kB 00:00 2023-09-30T22:19:56.603 INFO:teuthology.orchestra.run.smithi158.stdout:(95/122): python3-portend-2.6-1.el8.noarch.rpm 265 kB/s | 16 kB 00:00 2023-09-30T22:19:56.628 INFO:teuthology.orchestra.run.smithi158.stdout:(96/122): python3-repoze-lru-0.7-6.el8.noarch.r 668 kB/s | 34 kB 00:00 2023-09-30T22:19:56.645 INFO:teuthology.orchestra.run.smithi158.stdout:(97/122): python3-routes-2.4.1-12.el8.noarch.rp 4.6 MB/s | 196 kB 00:00 2023-09-30T22:19:56.647 INFO:teuthology.orchestra.run.smithi040.stdout:(56/122): fuse-2.9.7-17.el8.x86_64.rpm 622 kB/s | 83 kB 00:00 2023-09-30T22:19:56.679 INFO:teuthology.orchestra.run.smithi158.stdout:(98/122): python3-kubernetes-11.0.0-6.el8.noarc 4.6 MB/s | 1.2 MB 00:00 2023-09-30T22:19:56.700 INFO:teuthology.orchestra.run.smithi040.stdout:(57/122): keyutils-libs-devel-1.5.10-9.el8.x86_ 467 kB/s | 48 kB 00:00 2023-09-30T22:19:56.706 INFO:teuthology.orchestra.run.smithi158.stdout:(99/122): python3-simplegeneric-0.8.1-17.el8.no 308 kB/s | 19 kB 00:00 2023-09-30T22:19:56.732 INFO:teuthology.orchestra.run.smithi158.stdout:(100/122): python3-singledispatch-3.4.0.3-18.el 457 kB/s | 24 kB 00:00 2023-09-30T22:19:56.757 INFO:teuthology.orchestra.run.smithi158.stdout:(101/122): python3-rsa-4.9-2.el8.noarch.rpm 501 kB/s | 64 kB 00:00 2023-09-30T22:19:56.764 INFO:teuthology.orchestra.run.smithi040.stdout:(58/122): libcom_err-devel-1.45.6-5.el8.x86_64. 606 kB/s | 39 kB 00:00 2023-09-30T22:19:56.782 INFO:teuthology.orchestra.run.smithi158.stdout:(102/122): python3-tempora-1.14.1-5.el8.noarch. 388 kB/s | 29 kB 00:00 2023-09-30T22:19:56.807 INFO:teuthology.orchestra.run.smithi158.stdout:(103/122): python3-trustme-0.6.0-4.el8.noarch.r 366 kB/s | 27 kB 00:00 2023-09-30T22:19:56.831 INFO:teuthology.orchestra.run.smithi040.stdout:(59/122): krb5-devel-1.18.2-22.el8.x86_64.rpm 3.0 MB/s | 561 kB 00:00 2023-09-30T22:19:56.833 INFO:teuthology.orchestra.run.smithi158.stdout:(104/122): python3-waitress-1.4.3-1.el8.noarch. 3.3 MB/s | 255 kB 00:00 2023-09-30T22:19:56.858 INFO:teuthology.orchestra.run.smithi158.stdout:(105/122): python3-websocket-client-0.56.0-5.el 1.2 MB/s | 61 kB 00:00 2023-09-30T22:19:56.883 INFO:teuthology.orchestra.run.smithi158.stdout:(106/122): python3-webtest-2.0.33-1.el8.noarch. 1.7 MB/s | 85 kB 00:00 2023-09-30T22:19:56.898 INFO:teuthology.orchestra.run.smithi040.stdout:(60/122): libquadmath-8.5.0-20.el8.x86_64.rpm 2.5 MB/s | 172 kB 00:00 2023-09-30T22:19:56.908 INFO:teuthology.orchestra.run.smithi158.stdout:(107/122): python3-zc-lockfile-2.0-2.el8.noarch 459 kB/s | 23 kB 00:00 2023-09-30T22:19:56.934 INFO:teuthology.orchestra.run.smithi158.stdout:(108/122): python3-webob-1.8.5-1.el8.1.noarch.r 1.6 MB/s | 251 kB 00:00 2023-09-30T22:19:56.940 INFO:teuthology.orchestra.run.smithi040.stdout:(61/122): libgfortran-8.5.0-20.el8.x86_64.rpm 3.6 MB/s | 645 kB 00:00 2023-09-30T22:19:56.991 INFO:teuthology.orchestra.run.smithi040.stdout:(62/122): librabbitmq-0.9.0-4.el8.x86_64.rpm 510 kB/s | 47 kB 00:00 2023-09-30T22:19:57.016 INFO:teuthology.orchestra.run.smithi040.stdout:(63/122): libselinux-devel-2.9-8.el8.x86_64.rpm 2.6 MB/s | 200 kB 00:00 2023-09-30T22:19:57.049 INFO:teuthology.orchestra.run.smithi040.stdout:(64/122): libsepol-devel-2.9-3.el8.x86_64.rpm 1.4 MB/s | 87 kB 00:00 2023-09-30T22:19:57.066 INFO:teuthology.orchestra.run.smithi040.stdout:(65/122): libverto-devel-0.3.2-2.el8.x86_64.rpm 359 kB/s | 18 kB 00:00 2023-09-30T22:19:57.076 INFO:teuthology.orchestra.run.smithi158.stdout:(109/122): NetworkManager-initscripts-updown-1. 1.0 MB/s | 143 kB 00:00 2023-09-30T22:19:57.176 INFO:teuthology.orchestra.run.smithi158.stdout:(110/122): elfutils-debuginfod-client-0.189-3.e 761 kB/s | 76 kB 00:00 2023-09-30T22:19:57.208 INFO:teuthology.orchestra.run.smithi040.stdout:(66/122): python3-scipy-1.0.0-21.module_el8.5.0 14 MB/s | 14 MB 00:00 2023-09-30T22:19:57.251 INFO:teuthology.orchestra.run.smithi040.stdout:(67/122): libzstd-devel-1.4.4-1.el8.x86_64.rpm 218 kB/s | 44 kB 00:00 2023-09-30T22:19:57.342 INFO:teuthology.orchestra.run.smithi040.stdout:(68/122): pcre2-utf16-10.32-3.el8.x86_64.rpm 2.5 MB/s | 229 kB 00:00 2023-09-30T22:19:57.351 INFO:teuthology.orchestra.run.smithi158.stdout:(111/122): librados2-16.2.14-44.geeb13ac9.el8.x 8.0 MB/s | 3.7 MB 00:00 2023-09-30T22:19:57.426 INFO:teuthology.orchestra.run.smithi040.stdout:(69/122): pcre2-utf32-10.32-3.el8.x86_64.rpm 2.6 MB/s | 220 kB 00:00 2023-09-30T22:19:57.427 INFO:teuthology.orchestra.run.smithi158.stdout:(112/122): elfutils-libelf-0.189-3.el8.x86_64.r 928 kB/s | 232 kB 00:00 2023-09-30T22:19:57.476 INFO:teuthology.orchestra.run.smithi040.stdout:(70/122): pcre2-devel-10.32-3.el8.x86_64.rpm 2.2 MB/s | 605 kB 00:00 2023-09-30T22:19:57.543 INFO:teuthology.orchestra.run.smithi040.stdout:(71/122): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.1 MB/s | 249 kB 00:00 2023-09-30T22:19:57.593 INFO:teuthology.orchestra.run.smithi040.stdout:(72/122): python3-jwt-1.6.1-2.el8.noarch.rpm 853 kB/s | 43 kB 00:00 2023-09-30T22:19:57.594 INFO:teuthology.orchestra.run.smithi158.stdout:(113/122): elfutils-libs-0.189-3.el8.x86_64.rpm 1.2 MB/s | 303 kB 00:00 2023-09-30T22:19:57.627 INFO:teuthology.orchestra.run.smithi040.stdout:(73/122): python3-cryptography-3.2.1-6.el8.x86_ 4.2 MB/s | 641 kB 00:00 2023-09-30T22:19:57.661 INFO:teuthology.orchestra.run.smithi040.stdout:(74/122): python3-oauthlib-2.1.0-1.el8.noarch.r 2.3 MB/s | 155 kB 00:00 2023-09-30T22:19:57.677 INFO:teuthology.orchestra.run.smithi158.stdout:(114/122): libblkid-2.32.1-43.el8.x86_64.rpm 2.6 MB/s | 220 kB 00:00 2023-09-30T22:19:57.694 INFO:teuthology.orchestra.run.smithi040.stdout:(75/122): python3-pycparser-2.14-14.el8.noarch. 1.6 MB/s | 109 kB 00:00 2023-09-30T22:19:57.711 INFO:teuthology.orchestra.run.smithi040.stdout:(76/122): python3-requests-oauthlib-1.0.0-1.el8 848 kB/s | 43 kB 00:00 2023-09-30T22:19:57.745 INFO:teuthology.orchestra.run.smithi040.stdout:(77/122): zlib-devel-1.2.11-21.el8.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-09-30T22:19:57.769 INFO:teuthology.orchestra.run.smithi158.stdout:(115/122): libfdisk-2.32.1-43.el8.x86_64.rpm 2.7 MB/s | 254 kB 00:00 2023-09-30T22:19:57.853 INFO:teuthology.orchestra.run.smithi158.stdout:(116/122): libmount-2.32.1-43.el8.x86_64.rpm 2.8 MB/s | 236 kB 00:00 2023-09-30T22:19:57.853 INFO:teuthology.orchestra.run.smithi040.stdout:(78/122): openssl-devel-1.1.1k-9.el8.x86_64.rpm 4.0 MB/s | 3.2 MB 00:00 2023-09-30T22:19:57.895 INFO:teuthology.orchestra.run.smithi040.stdout:(79/122): gperftools-libs-2.7-9.el8.x86_64.rpm 1.6 MB/s | 306 kB 00:00 2023-09-30T22:19:57.920 INFO:teuthology.orchestra.run.smithi158.stdout:(117/122): libsmartcols-2.32.1-43.el8.x86_64.rp 2.6 MB/s | 179 kB 00:00 2023-09-30T22:19:57.929 INFO:teuthology.orchestra.run.smithi040.stdout:(80/122): leveldb-1.22-1.el8.x86_64.rpm 988 kB/s | 181 kB 00:00 2023-09-30T22:19:57.954 INFO:teuthology.orchestra.run.smithi040.stdout:(81/122): libunwind-1.3.1-3.el8.x86_64.rpm 1.4 MB/s | 75 kB 00:00 2023-09-30T22:19:57.962 INFO:teuthology.orchestra.run.smithi158.stdout:(118/122): iproute-6.2.0-2.el8.x86_64.rpm 1.6 MB/s | 880 kB 00:00 2023-09-30T22:19:57.979 INFO:teuthology.orchestra.run.smithi158.stdout:(119/122): libuuid-2.32.1-43.el8.x86_64.rpm 1.7 MB/s | 99 kB 00:00 2023-09-30T22:19:57.980 INFO:teuthology.orchestra.run.smithi040.stdout:(82/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 882 kB/s | 44 kB 00:00 2023-09-30T22:19:58.005 INFO:teuthology.orchestra.run.smithi040.stdout:(83/122): liboath-2.6.2-3.el8.x86_64.rpm 392 kB/s | 59 kB 00:00 2023-09-30T22:19:58.030 INFO:teuthology.orchestra.run.smithi040.stdout:(84/122): python3-cachetools-3.1.1-4.el8.noarch 659 kB/s | 33 kB 00:00 2023-09-30T22:19:58.037 INFO:teuthology.orchestra.run.smithi158.stdout:(120/122): util-linux-user-2.32.1-43.el8.x86_64 1.7 MB/s | 103 kB 00:00 2023-09-30T22:19:58.082 INFO:teuthology.orchestra.run.smithi040.stdout:(85/122): python3-certifi-2018.10.15-7.el8.noar 213 kB/s | 16 kB 00:00 2023-09-30T22:19:58.114 INFO:teuthology.orchestra.run.smithi040.stdout:(86/122): python3-beautifulsoup4-4.6.3-2.el8.1. 1.1 MB/s | 185 kB 00:00 2023-09-30T22:19:58.140 INFO:teuthology.orchestra.run.smithi040.stdout:(87/122): python3-cheroot-8.5.2-1.el8.noarch.rp 1.5 MB/s | 173 kB 00:00 2023-09-30T22:19:58.165 INFO:teuthology.orchestra.run.smithi040.stdout:(88/122): python3-google-auth-1.1.1-10.el8.noar 1.6 MB/s | 81 kB 00:00 2023-09-30T22:19:58.190 INFO:teuthology.orchestra.run.smithi040.stdout:(89/122): python3-jaraco-6.2-6.el8.noarch.rpm 221 kB/s | 11 kB 00:00 2023-09-30T22:19:58.216 INFO:teuthology.orchestra.run.smithi040.stdout:(90/122): python3-jaraco-functools-2.0-4.el8.no 350 kB/s | 18 kB 00:00 2023-09-30T22:19:58.241 INFO:teuthology.orchestra.run.smithi040.stdout:(91/122): python3-cherrypy-18.4.0-1.el8.noarch. 2.4 MB/s | 384 kB 00:00 2023-09-30T22:19:58.341 INFO:teuthology.orchestra.run.smithi040.stdout:(92/122): python3-logutils-0.3.5-11.el8.noarch. 390 kB/s | 49 kB 00:00 2023-09-30T22:19:58.483 INFO:teuthology.orchestra.run.smithi040.stdout:(93/122): python3-more-itertools-7.2.0-3.el8.no 242 kB/s | 59 kB 00:00 2023-09-30T22:19:58.504 INFO:teuthology.orchestra.run.smithi158.stdout:(121/122): librbd1-16.2.14-44.geeb13ac9.el8.x86 2.6 MB/s | 4.2 MB 00:01 2023-09-30T22:19:58.508 INFO:teuthology.orchestra.run.smithi040.stdout:(94/122): python3-pecan-1.3.2-9.el8.noarch.rpm 1.7 MB/s | 283 kB 00:00 2023-09-30T22:19:58.534 INFO:teuthology.orchestra.run.smithi040.stdout:(95/122): python3-portend-2.6-1.el8.noarch.rpm 310 kB/s | 16 kB 00:00 2023-09-30T22:19:58.559 INFO:teuthology.orchestra.run.smithi040.stdout:(96/122): python3-repoze-lru-0.7-6.el8.noarch.r 669 kB/s | 34 kB 00:00 2023-09-30T22:19:58.584 INFO:teuthology.orchestra.run.smithi040.stdout:(97/122): python3-routes-2.4.1-12.el8.noarch.rp 3.8 MB/s | 196 kB 00:00 2023-09-30T22:19:58.610 INFO:teuthology.orchestra.run.smithi040.stdout:(98/122): python3-rsa-4.9-2.el8.noarch.rpm 1.3 MB/s | 64 kB 00:00 2023-09-30T22:19:58.676 INFO:teuthology.orchestra.run.smithi040.stdout:(99/122): python3-simplegeneric-0.8.1-17.el8.no 204 kB/s | 19 kB 00:00 2023-09-30T22:19:58.693 INFO:teuthology.orchestra.run.smithi040.stdout:(100/122): python3-singledispatch-3.4.0.3-18.el 287 kB/s | 24 kB 00:00 2023-09-30T22:19:58.710 INFO:teuthology.orchestra.run.smithi040.stdout:(101/122): python3-tempora-1.14.1-5.el8.noarch. 876 kB/s | 29 kB 00:00 2023-09-30T22:19:58.727 INFO:teuthology.orchestra.run.smithi040.stdout:(102/122): python3-trustme-0.6.0-4.el8.noarch.r 817 kB/s | 27 kB 00:00 2023-09-30T22:19:58.761 INFO:teuthology.orchestra.run.smithi040.stdout:(103/122): python3-kubernetes-11.0.0-6.el8.noar 2.0 MB/s | 1.2 MB 00:00 2023-09-30T22:19:58.786 INFO:teuthology.orchestra.run.smithi040.stdout:(104/122): python3-waitress-1.4.3-1.el8.noarch. 3.3 MB/s | 255 kB 00:00 2023-09-30T22:19:58.803 INFO:teuthology.orchestra.run.smithi040.stdout:(105/122): python3-websocket-client-0.56.0-5.el 1.4 MB/s | 61 kB 00:00 2023-09-30T22:19:58.828 INFO:teuthology.orchestra.run.smithi040.stdout:(106/122): python3-webob-1.8.5-1.el8.1.noarch.r 2.4 MB/s | 251 kB 00:00 2023-09-30T22:19:58.854 INFO:teuthology.orchestra.run.smithi040.stdout:(107/122): python3-webtest-2.0.33-1.el8.noarch. 1.2 MB/s | 85 kB 00:00 2023-09-30T22:19:58.871 INFO:teuthology.orchestra.run.smithi040.stdout:(108/122): python3-zc-lockfile-2.0-2.el8.noarch 341 kB/s | 23 kB 00:00 2023-09-30T22:19:58.929 INFO:teuthology.orchestra.run.smithi158.stdout:(122/122): util-linux-2.32.1-43.el8.x86_64.rpm 2.6 MB/s | 2.5 MB 00:00 2023-09-30T22:19:58.935 INFO:teuthology.orchestra.run.smithi158.stdout:-------------------------------------------------------------------------------- 2023-09-30T22:19:58.936 INFO:teuthology.orchestra.run.smithi158.stdout:Total 13 MB/s | 200 MB 00:15 2023-09-30T22:19:59.071 INFO:teuthology.orchestra.run.smithi040.stdout:(109/122): NetworkManager-initscripts-updown-1. 717 kB/s | 143 kB 00:00 2023-09-30T22:19:59.129 INFO:teuthology.orchestra.run.smithi040.stdout:(110/122): elfutils-debuginfod-client-0.189-3.e 1.3 MB/s | 76 kB 00:00 2023-09-30T22:19:59.305 INFO:teuthology.orchestra.run.smithi040.stdout:(111/122): elfutils-libelf-0.189-3.el8.x86_64.r 1.3 MB/s | 232 kB 00:00 2023-09-30T22:19:59.430 INFO:teuthology.orchestra.run.smithi040.stdout:(112/122): librados2-16.2.14-44.geeb13ac9.el8.x 6.2 MB/s | 3.7 MB 00:00 2023-09-30T22:19:59.530 INFO:teuthology.orchestra.run.smithi040.stdout:(113/122): elfutils-libs-0.189-3.el8.x86_64.rpm 1.3 MB/s | 303 kB 00:00 2023-09-30T22:19:59.656 INFO:teuthology.orchestra.run.smithi040.stdout:(114/122): libblkid-2.32.1-43.el8.x86_64.rpm 1.7 MB/s | 220 kB 00:00 2023-09-30T22:19:59.806 INFO:teuthology.orchestra.run.smithi040.stdout:(115/122): iproute-6.2.0-2.el8.x86_64.rpm 2.3 MB/s | 880 kB 00:00 2023-09-30T22:19:59.840 INFO:teuthology.orchestra.run.smithi040.stdout:(116/122): libfdisk-2.32.1-43.el8.x86_64.rpm 1.3 MB/s | 254 kB 00:00 2023-09-30T22:19:59.907 INFO:teuthology.orchestra.run.smithi040.stdout:(117/122): libsmartcols-2.32.1-43.el8.x86_64.rp 2.6 MB/s | 179 kB 00:00 2023-09-30T22:19:59.932 INFO:teuthology.orchestra.run.smithi040.stdout:(118/122): libmount-2.32.1-43.el8.x86_64.rpm 1.8 MB/s | 236 kB 00:00 2023-09-30T22:19:59.966 INFO:teuthology.orchestra.run.smithi040.stdout:(119/122): libuuid-2.32.1-43.el8.x86_64.rpm 1.7 MB/s | 99 kB 00:00 2023-09-30T22:20:00.016 INFO:teuthology.orchestra.run.smithi040.stdout:(120/122): util-linux-user-2.32.1-43.el8.x86_64 2.0 MB/s | 103 kB 00:00 2023-09-30T22:20:00.191 INFO:teuthology.orchestra.run.smithi040.stdout:(121/122): librbd1-16.2.14-44.geeb13ac9.el8.x86 3.1 MB/s | 4.2 MB 00:01 2023-09-30T22:20:00.397 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction check 2023-09-30T22:20:00.633 INFO:teuthology.orchestra.run.smithi040.stdout:(122/122): util-linux-2.32.1-43.el8.x86_64.rpm 3.5 MB/s | 2.5 MB 00:00 2023-09-30T22:20:00.638 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2023-09-30T22:20:00.639 INFO:teuthology.orchestra.run.smithi040.stdout:Total 12 MB/s | 200 MB 00:17 2023-09-30T22:20:00.660 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction check succeeded. 2023-09-30T22:20:00.660 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction test 2023-09-30T22:20:01.370 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2023-09-30T22:20:01.610 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2023-09-30T22:20:01.610 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2023-09-30T22:20:02.028 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction test succeeded. 2023-09-30T22:20:02.031 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction 2023-09-30T22:20:02.753 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2023-09-30T22:20:02.756 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2023-09-30T22:20:06.905 INFO:teuthology.orchestra.run.smithi158.stdout: Preparing : 1/1 2023-09-30T22:20:06.958 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: liboath-2.6.2-3.el8.x86_64 1/1 2023-09-30T22:20:07.150 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/136 2023-09-30T22:20:07.414 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/136 2023-09-30T22:20:07.663 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/136 2023-09-30T22:20:07.768 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/136 2023-09-30T22:20:07.913 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2023-09-30T22:20:08.619 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/136 2023-09-30T22:20:08.619 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/136 2023-09-30T22:20:08.619 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 5/136 2023-09-30T22:20:08.620 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/136 2023-09-30T22:20:08.620 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: liboath-2.6.2-3.el8.x86_64 1/1 2023-09-30T22:20:08.620 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/136 2023-09-30T22:20:08.620 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/136 2023-09-30T22:20:08.620 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/136 2023-09-30T22:20:08.647 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-09-30T22:20:08.945 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/136 2023-09-30T22:20:09.072 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-09-30T22:20:09.111 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/136 2023-09-30T22:20:09.200 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/136 2023-09-30T22:20:09.271 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-09-30T22:20:09.409 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 5/136 2023-09-30T22:20:09.646 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/136 2023-09-30T22:20:09.729 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-09-30T22:20:09.869 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-09-30T22:20:09.921 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-09-30T22:20:10.071 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-09-30T22:20:10.255 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-09-30T22:20:10.260 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-09-30T22:20:10.381 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-09-30T22:20:10.511 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-09-30T22:20:10.614 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-09-30T22:20:10.780 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/136 2023-09-30T22:20:10.978 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-09-30T22:20:11.200 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/136 2023-09-30T22:20:11.219 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-09-30T22:20:11.332 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-09-30T22:20:11.363 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-09-30T22:20:11.436 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-09-30T22:20:11.561 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-09-30T22:20:11.661 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-09-30T22:20:11.662 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/136 2023-09-30T22:20:11.871 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/136 2023-09-30T22:20:11.937 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-09-30T22:20:12.012 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-09-30T22:20:12.161 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/136 2023-09-30T22:20:12.175 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-09-30T22:20:12.321 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-09-30T22:20:12.468 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-09-30T22:20:12.547 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/136 2023-09-30T22:20:12.687 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 18/136 2023-09-30T22:20:12.711 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-09-30T22:20:12.816 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-09-30T22:20:12.927 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 19/136 2023-09-30T22:20:13.036 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/136 2023-09-30T22:20:13.046 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 20/136 2023-09-30T22:20:13.212 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 20/136 2023-09-30T22:20:13.268 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/136 2023-09-30T22:20:13.396 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 21/136 2023-09-30T22:20:13.444 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-09-30T22:20:13.555 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-09-30T22:20:13.719 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-09-30T22:20:13.851 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-09-30T22:20:14.068 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 18/136 2023-09-30T22:20:14.069 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 21/136 2023-09-30T22:20:14.254 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : openblas-0.3.15-4.el8.x86_64 22/136 2023-09-30T22:20:14.267 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 19/136 2023-09-30T22:20:14.394 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 20/136 2023-09-30T22:20:14.578 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 20/136 2023-09-30T22:20:14.793 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 21/136 2023-09-30T22:20:14.947 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 22/136 2023-09-30T22:20:15.112 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-09-30T22:20:15.434 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 21/136 2023-09-30T22:20:15.668 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openblas-0.3.15-4.el8.x86_64 22/136 2023-09-30T22:20:15.935 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-09-30T22:20:16.320 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 24/136 2023-09-30T22:20:16.326 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 22/136 2023-09-30T22:20:16.518 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-09-30T22:20:16.556 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 25/136 2023-09-30T22:20:16.793 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 26/136 2023-09-30T22:20:16.945 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 27/136 2023-09-30T22:20:17.222 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 28/136 2023-09-30T22:20:17.346 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-09-30T22:20:17.420 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-09-30T22:20:17.763 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 24/136 2023-09-30T22:20:18.048 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 25/136 2023-09-30T22:20:18.292 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 26/136 2023-09-30T22:20:18.477 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 27/136 2023-09-30T22:20:18.792 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 28/136 2023-09-30T22:20:19.026 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-09-30T22:20:19.474 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-09-30T22:20:19.831 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 30/136 2023-09-30T22:20:20.010 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 31/136 2023-09-30T22:20:20.224 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/136 2023-09-30T22:20:20.493 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 33/136 2023-09-30T22:20:20.701 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 34/136 2023-09-30T22:20:20.921 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 35/136 2023-09-30T22:20:21.051 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-09-30T22:20:21.104 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 36/136 2023-09-30T22:20:21.291 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el8.x86_64 37/136 2023-09-30T22:20:21.364 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 30/136 2023-09-30T22:20:21.546 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 38/136 2023-09-30T22:20:21.618 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 31/136 2023-09-30T22:20:21.644 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 38/136 2023-09-30T22:20:21.836 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 39/136 2023-09-30T22:20:21.872 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/136 2023-09-30T22:20:21.931 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 39/136 2023-09-30T22:20:22.111 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-09-30T22:20:22.139 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 33/136 2023-09-30T22:20:22.381 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 34/136 2023-09-30T22:20:22.618 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 35/136 2023-09-30T22:20:22.686 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-09-30T22:20:22.821 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 36/136 2023-09-30T22:20:23.019 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el8.x86_64 37/136 2023-09-30T22:20:23.242 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 38/136 2023-09-30T22:20:23.283 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 41/136 2023-09-30T22:20:23.312 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 41/136 2023-09-30T22:20:23.325 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 38/136 2023-09-30T22:20:23.551 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 39/136 2023-09-30T22:20:23.553 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 42/136 2023-09-30T22:20:23.613 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 39/136 2023-09-30T22:20:23.817 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-09-30T22:20:23.829 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 43/136 2023-09-30T22:20:24.060 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 44/136 2023-09-30T22:20:24.233 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 45/136 2023-09-30T22:20:24.300 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-09-30T22:20:24.391 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 46/136 2023-09-30T22:20:24.601 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 41/136 2023-09-30T22:20:24.611 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 47/136 2023-09-30T22:20:24.618 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 41/136 2023-09-30T22:20:24.834 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 42/136 2023-09-30T22:20:24.835 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 48/136 2023-09-30T22:20:25.040 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 49/136 2023-09-30T22:20:25.077 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 43/136 2023-09-30T22:20:25.185 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 50/136 2023-09-30T22:20:25.350 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 44/136 2023-09-30T22:20:25.371 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 51/136 2023-09-30T22:20:25.506 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 45/136 2023-09-30T22:20:25.565 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 52/136 2023-09-30T22:20:25.693 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 46/136 2023-09-30T22:20:25.839 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 53/136 2023-09-30T22:20:25.885 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 47/136 2023-09-30T22:20:26.085 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 48/136 2023-09-30T22:20:26.091 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 54/136 2023-09-30T22:20:26.288 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 49/136 2023-09-30T22:20:26.317 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 55/136 2023-09-30T22:20:26.466 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 50/136 2023-09-30T22:20:26.496 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 56/136 2023-09-30T22:20:26.636 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 51/136 2023-09-30T22:20:26.707 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 57/136 2023-09-30T22:20:26.871 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 52/136 2023-09-30T22:20:26.914 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 58/136 2023-09-30T22:20:27.119 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 53/136 2023-09-30T22:20:27.155 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 59/136 2023-09-30T22:20:27.374 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 54/136 2023-09-30T22:20:27.541 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 60/136 2023-09-30T22:20:27.618 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 55/136 2023-09-30T22:20:27.800 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 61/136 2023-09-30T22:20:27.861 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 56/136 2023-09-30T22:20:28.000 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/136 2023-09-30T22:20:28.046 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 57/136 2023-09-30T22:20:28.279 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 63/136 2023-09-30T22:20:28.324 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 58/136 2023-09-30T22:20:28.494 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 64/136 2023-09-30T22:20:28.582 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 59/136 2023-09-30T22:20:29.017 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 60/136 2023-09-30T22:20:29.329 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 61/136 2023-09-30T22:20:29.549 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/136 2023-09-30T22:20:29.770 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 65/136 2023-09-30T22:20:29.856 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 63/136 2023-09-30T22:20:29.995 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 66/136 2023-09-30T22:20:30.127 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 64/136 2023-09-30T22:20:30.220 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 67/136 2023-09-30T22:20:30.404 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 68/136 2023-09-30T22:20:30.648 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 69/136 2023-09-30T22:20:30.832 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 70/136 2023-09-30T22:20:31.150 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 71/136 2023-09-30T22:20:31.340 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 72/136 2023-09-30T22:20:31.425 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 65/136 2023-09-30T22:20:31.508 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 73/136 2023-09-30T22:20:31.669 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 74/136 2023-09-30T22:20:31.702 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 66/136 2023-09-30T22:20:31.904 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 67/136 2023-09-30T22:20:31.990 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 75/136 2023-09-30T22:20:32.162 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 68/136 2023-09-30T22:20:32.215 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 76/136 2023-09-30T22:20:32.368 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 77/136 2023-09-30T22:20:32.429 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 69/136 2023-09-30T22:20:32.582 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 78/136 2023-09-30T22:20:32.647 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 70/136 2023-09-30T22:20:32.779 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 79/136 2023-09-30T22:20:32.988 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : fuse-2.9.7-17.el8.x86_64 80/136 2023-09-30T22:20:33.005 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 71/136 2023-09-30T22:20:33.222 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 72/136 2023-09-30T22:20:33.271 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 81/136 2023-09-30T22:20:33.394 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 73/136 2023-09-30T22:20:33.435 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 82/136 2023-09-30T22:20:33.597 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 83/136 2023-09-30T22:20:33.620 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 74/136 2023-09-30T22:20:33.815 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 84/136 2023-09-30T22:20:33.927 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 75/136 2023-09-30T22:20:34.103 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-portend-2.6-1.el8.noarch 85/136 2023-09-30T22:20:34.179 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 76/136 2023-09-30T22:20:34.298 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 77/136 2023-09-30T22:20:34.360 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 86/136 2023-09-30T22:20:34.526 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 87/136 2023-09-30T22:20:34.533 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 78/136 2023-09-30T22:20:34.836 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 79/136 2023-09-30T22:20:35.095 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fuse-2.9.7-17.el8.x86_64 80/136 2023-09-30T22:20:35.369 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 81/136 2023-09-30T22:20:35.543 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 82/136 2023-09-30T22:20:35.715 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 83/136 2023-09-30T22:20:35.940 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 84/136 2023-09-30T22:20:36.214 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-portend-2.6-1.el8.noarch 85/136 2023-09-30T22:20:36.510 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 86/136 2023-09-30T22:20:36.649 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 87/136 2023-09-30T22:20:37.259 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-09-30T22:20:37.459 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-09-30T22:20:38.252 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-09-30T22:20:38.593 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-09-30T22:20:38.786 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-09-30T22:20:39.050 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-09-30T22:20:39.301 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-09-30T22:20:39.574 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-09-30T22:20:40.330 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-09-30T22:20:40.720 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-09-30T22:20:40.831 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-09-30T22:20:40.981 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-09-30T22:20:58.857 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-09-30T22:20:58.857 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /sys 2023-09-30T22:20:58.858 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /proc 2023-09-30T22:20:58.858 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /dev 2023-09-30T22:20:58.858 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /run 2023-09-30T22:20:58.858 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /mnt 2023-09-30T22:20:58.858 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /var/tmp 2023-09-30T22:20:58.858 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /home 2023-09-30T22:20:58.858 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /tmp 2023-09-30T22:20:58.858 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /dev 2023-09-30T22:20:58.858 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:20:59.308 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-09-30T22:20:59.791 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-09-30T22:20:59.966 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-09-30T22:21:00.029 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-09-30T22:21:00.030 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /sys 2023-09-30T22:21:00.030 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /proc 2023-09-30T22:21:00.030 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /dev 2023-09-30T22:21:00.030 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /run 2023-09-30T22:21:00.030 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /mnt 2023-09-30T22:21:00.030 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /var/tmp 2023-09-30T22:21:00.030 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /home 2023-09-30T22:21:00.030 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /tmp 2023-09-30T22:21:00.030 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /dev 2023-09-30T22:21:00.031 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:21:00.490 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-09-30T22:21:00.940 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-09-30T22:21:01.121 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-09-30T22:21:01.578 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-09-30T22:21:01.796 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-09-30T22:21:01.865 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-09-30T22:21:02.085 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 94/136 2023-09-30T22:21:02.449 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 95/136 2023-09-30T22:21:02.697 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-09-30T22:21:02.779 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 96/136 2023-09-30T22:21:02.946 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-09-30T22:21:02.984 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-09-30T22:21:03.029 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 97/136 2023-09-30T22:21:03.227 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 94/136 2023-09-30T22:21:03.242 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 98/136 2023-09-30T22:21:03.379 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 99/136 2023-09-30T22:21:03.474 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 99/136 2023-09-30T22:21:03.606 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 95/136 2023-09-30T22:21:03.666 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : jq-1.6-7.el8.x86_64 100/136 2023-09-30T22:21:03.821 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 101/136 2023-09-30T22:21:03.878 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 96/136 2023-09-30T22:21:04.113 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 97/136 2023-09-30T22:21:04.351 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 98/136 2023-09-30T22:21:04.537 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 99/136 2023-09-30T22:21:04.605 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 99/136 2023-09-30T22:21:04.832 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : jq-1.6-7.el8.x86_64 100/136 2023-09-30T22:21:04.962 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 101/136 2023-09-30T22:21:05.035 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 102/136 2023-09-30T22:21:05.313 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-09-30T22:21:06.230 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 102/136 2023-09-30T22:21:06.491 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-09-30T22:21:06.516 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-09-30T22:21:06.662 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-09-30T22:21:06.786 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-09-30T22:21:07.165 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 105/136 2023-09-30T22:21:07.394 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-09-30T22:21:07.447 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-09-30T22:21:07.603 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-09-30T22:21:07.627 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-09-30T22:21:07.630 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-09-30T22:21:07.861 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-09-30T22:21:07.972 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-09-30T22:21:08.391 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 105/136 2023-09-30T22:21:08.641 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-09-30T22:21:08.669 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-09-30T22:21:08.890 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-09-30T22:21:08.901 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-09-30T22:21:12.626 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 108/136 2023-09-30T22:21:13.814 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 108/136 2023-09-30T22:21:13.896 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-09-30T22:21:14.139 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-09-30T22:21:14.580 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-09-30T22:21:14.786 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-09-30T22:21:14.912 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-09-30T22:21:15.144 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-09-30T22:21:15.440 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-09-30T22:21:15.906 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-09-30T22:21:16.102 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 112/136 2023-09-30T22:21:16.135 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-09-30T22:21:16.234 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-09-30T22:21:16.374 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 113/136 2023-09-30T22:21:16.557 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 114/136 2023-09-30T22:21:16.748 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 115/136 2023-09-30T22:21:16.894 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 116/136 2023-09-30T22:21:17.077 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 117/136 2023-09-30T22:21:17.327 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 112/136 2023-09-30T22:21:17.426 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 118/136 2023-09-30T22:21:17.633 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 113/136 2023-09-30T22:21:17.662 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 119/136 2023-09-30T22:21:17.810 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-09-30T22:21:17.825 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 114/136 2023-09-30T22:21:17.894 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-09-30T22:21:18.022 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 115/136 2023-09-30T22:21:18.093 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : flex-2.6.1-9.el8.x86_64 121/136 2023-09-30T22:21:18.202 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 116/136 2023-09-30T22:21:18.210 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 121/136 2023-09-30T22:21:18.435 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 117/136 2023-09-30T22:21:18.452 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : bison-3.0.4-10.el8.x86_64 122/136 2023-09-30T22:21:18.478 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 122/136 2023-09-30T22:21:18.661 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 123/136 2023-09-30T22:21:18.785 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 118/136 2023-09-30T22:21:18.822 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 124/136 2023-09-30T22:21:18.822 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-09-30T22:21:19.037 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-09-30T22:21:19.053 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-09-30T22:21:19.079 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 119/136 2023-09-30T22:21:19.174 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-09-30T22:21:19.174 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 127/136 2023-09-30T22:21:19.252 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-09-30T22:21:19.310 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-09-30T22:21:19.418 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 127/136 2023-09-30T22:21:19.526 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flex-2.6.1-9.el8.x86_64 121/136 2023-09-30T22:21:19.617 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 121/136 2023-09-30T22:21:19.621 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 128/136 2023-09-30T22:21:19.765 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 129/136 2023-09-30T22:21:19.843 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : bison-3.0.4-10.el8.x86_64 122/136 2023-09-30T22:21:19.857 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 122/136 2023-09-30T22:21:20.003 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 130/136 2023-09-30T22:21:20.003 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 131/136 2023-09-30T22:21:20.078 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 123/136 2023-09-30T22:21:20.213 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 131/136 2023-09-30T22:21:20.213 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 132/136 2023-09-30T22:21:20.271 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 124/136 2023-09-30T22:21:20.271 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-09-30T22:21:20.430 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 132/136 2023-09-30T22:21:20.430 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 133/136 2023-09-30T22:21:20.505 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-09-30T22:21:20.509 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-09-30T22:21:20.654 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 133/136 2023-09-30T22:21:20.655 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 134/136 2023-09-30T22:21:20.663 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-09-30T22:21:20.663 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 127/136 2023-09-30T22:21:20.904 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 134/136 2023-09-30T22:21:20.904 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-09-30T22:21:20.941 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 127/136 2023-09-30T22:21:21.105 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-09-30T22:21:21.161 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 128/136 2023-09-30T22:21:21.277 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-09-30T22:21:21.325 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 129/136 2023-09-30T22:21:21.481 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-09-30T22:21:21.482 INFO:teuthology.orchestra.run.smithi158.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-09-30T22:21:21.482 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:21:21.578 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 130/136 2023-09-30T22:21:21.578 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 131/136 2023-09-30T22:21:21.821 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 131/136 2023-09-30T22:21:21.821 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 132/136 2023-09-30T22:21:22.054 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 132/136 2023-09-30T22:21:22.054 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 133/136 2023-09-30T22:21:22.220 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 1/136 2023-09-30T22:21:22.221 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2/136 2023-09-30T22:21:22.221 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 3/136 2023-09-30T22:21:22.221 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 4/136 2023-09-30T22:21:22.221 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 5/136 2023-09-30T22:21:22.221 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 6/136 2023-09-30T22:21:22.222 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 7/136 2023-09-30T22:21:22.222 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-09-30T22:21:22.222 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-09-30T22:21:22.222 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-09-30T22:21:22.222 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-09-30T22:21:22.222 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 12/136 2023-09-30T22:21:22.222 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-09-30T22:21:22.222 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 14/136 2023-09-30T22:21:22.222 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 15/136 2023-09-30T22:21:22.223 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 16/136 2023-09-30T22:21:22.223 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 17/136 2023-09-30T22:21:22.223 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 18/136 2023-09-30T22:21:22.223 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 19/136 2023-09-30T22:21:22.223 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 20/136 2023-09-30T22:21:22.223 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 21/136 2023-09-30T22:21:22.223 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 22/136 2023-09-30T22:21:22.223 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 23/136 2023-09-30T22:21:22.223 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 24/136 2023-09-30T22:21:22.224 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 25/136 2023-09-30T22:21:22.224 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 26/136 2023-09-30T22:21:22.224 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 27/136 2023-09-30T22:21:22.224 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 28/136 2023-09-30T22:21:22.224 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 29/136 2023-09-30T22:21:22.224 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 30/136 2023-09-30T22:21:22.224 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 31/136 2023-09-30T22:21:22.225 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 32/136 2023-09-30T22:21:22.225 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : bison-3.0.4-10.el8.x86_64 33/136 2023-09-30T22:21:22.225 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : flex-2.6.1-9.el8.x86_64 34/136 2023-09-30T22:21:22.225 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : jq-1.6-7.el8.x86_64 35/136 2023-09-30T22:21:22.225 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 36/136 2023-09-30T22:21:22.225 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 37/136 2023-09-30T22:21:22.225 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 38/136 2023-09-30T22:21:22.225 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 39/136 2023-09-30T22:21:22.226 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 40/136 2023-09-30T22:21:22.226 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 41/136 2023-09-30T22:21:22.226 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 42/136 2023-09-30T22:21:22.226 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 43/136 2023-09-30T22:21:22.226 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 44/136 2023-09-30T22:21:22.226 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 45/136 2023-09-30T22:21:22.226 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 46/136 2023-09-30T22:21:22.226 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 47/136 2023-09-30T22:21:22.226 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 48/136 2023-09-30T22:21:22.226 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 49/136 2023-09-30T22:21:22.227 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 50/136 2023-09-30T22:21:22.227 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 51/136 2023-09-30T22:21:22.227 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 52/136 2023-09-30T22:21:22.227 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 53/136 2023-09-30T22:21:22.227 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 54/136 2023-09-30T22:21:22.227 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 55/136 2023-09-30T22:21:22.227 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 56/136 2023-09-30T22:21:22.227 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 57/136 2023-09-30T22:21:22.227 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 58/136 2023-09-30T22:21:22.227 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 59/136 2023-09-30T22:21:22.227 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 60/136 2023-09-30T22:21:22.227 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 61/136 2023-09-30T22:21:22.228 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 62/136 2023-09-30T22:21:22.228 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 63/136 2023-09-30T22:21:22.228 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 64/136 2023-09-30T22:21:22.228 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 65/136 2023-09-30T22:21:22.228 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 66/136 2023-09-30T22:21:22.228 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 67/136 2023-09-30T22:21:22.228 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 68/136 2023-09-30T22:21:22.228 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 69/136 2023-09-30T22:21:22.228 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 70/136 2023-09-30T22:21:22.228 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 71/136 2023-09-30T22:21:22.228 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 72/136 2023-09-30T22:21:22.229 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 73/136 2023-09-30T22:21:22.229 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/136 2023-09-30T22:21:22.229 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/136 2023-09-30T22:21:22.229 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/136 2023-09-30T22:21:22.229 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/136 2023-09-30T22:21:22.229 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 78/136 2023-09-30T22:21:22.229 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 79/136 2023-09-30T22:21:22.229 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : leveldb-1.22-1.el8.x86_64 80/136 2023-09-30T22:21:22.229 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 81/136 2023-09-30T22:21:22.229 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 82/136 2023-09-30T22:21:22.229 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/136 2023-09-30T22:21:22.229 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/136 2023-09-30T22:21:22.230 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 85/136 2023-09-30T22:21:22.230 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 86/136 2023-09-30T22:21:22.230 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 87/136 2023-09-30T22:21:22.230 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 88/136 2023-09-30T22:21:22.230 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 89/136 2023-09-30T22:21:22.230 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 90/136 2023-09-30T22:21:22.230 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 91/136 2023-09-30T22:21:22.230 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 92/136 2023-09-30T22:21:22.230 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 93/136 2023-09-30T22:21:22.230 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 94/136 2023-09-30T22:21:22.230 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 95/136 2023-09-30T22:21:22.231 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-portend-2.6-1.el8.noarch 96/136 2023-09-30T22:21:22.231 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 97/136 2023-09-30T22:21:22.231 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 98/136 2023-09-30T22:21:22.231 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 99/136 2023-09-30T22:21:22.231 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 100/136 2023-09-30T22:21:22.231 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 101/136 2023-09-30T22:21:22.231 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 102/136 2023-09-30T22:21:22.231 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 103/136 2023-09-30T22:21:22.231 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 104/136 2023-09-30T22:21:22.232 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 105/136 2023-09-30T22:21:22.232 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 106/136 2023-09-30T22:21:22.232 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 107/136 2023-09-30T22:21:22.232 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 108/136 2023-09-30T22:21:22.232 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-09-30T22:21:22.232 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 110/136 2023-09-30T22:21:22.232 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-09-30T22:21:22.232 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 112/136 2023-09-30T22:21:22.232 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 113/136 2023-09-30T22:21:22.232 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 114/136 2023-09-30T22:21:22.232 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el8.x86_64 115/136 2023-09-30T22:21:22.233 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 116/136 2023-09-30T22:21:22.233 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 117/136 2023-09-30T22:21:22.233 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 118/136 2023-09-30T22:21:22.233 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 119/136 2023-09-30T22:21:22.233 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 120/136 2023-09-30T22:21:22.233 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 121/136 2023-09-30T22:21:22.233 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 122/136 2023-09-30T22:21:22.233 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 123/136 2023-09-30T22:21:22.233 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 124/136 2023-09-30T22:21:22.233 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 125/136 2023-09-30T22:21:22.233 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 126/136 2023-09-30T22:21:22.233 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 127/136 2023-09-30T22:21:22.234 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 128/136 2023-09-30T22:21:22.234 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 129/136 2023-09-30T22:21:22.234 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 130/136 2023-09-30T22:21:22.234 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 131/136 2023-09-30T22:21:22.234 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 132/136 2023-09-30T22:21:22.234 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 133/136 2023-09-30T22:21:22.234 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 134/136 2023-09-30T22:21:22.234 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 135/136 2023-09-30T22:21:22.262 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 133/136 2023-09-30T22:21:22.262 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 134/136 2023-09-30T22:21:22.487 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 134/136 2023-09-30T22:21:22.487 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-09-30T22:21:22.662 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-09-30T22:21:22.885 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-09-30T22:21:23.438 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-09-30T22:21:23.439 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 1/136 2023-09-30T22:21:23.439 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2/136 2023-09-30T22:21:23.439 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 3/136 2023-09-30T22:21:23.439 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 4/136 2023-09-30T22:21:23.439 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 5/136 2023-09-30T22:21:23.439 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 6/136 2023-09-30T22:21:23.439 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 7/136 2023-09-30T22:21:23.439 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-09-30T22:21:23.439 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-09-30T22:21:23.439 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-09-30T22:21:23.440 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-09-30T22:21:23.440 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 12/136 2023-09-30T22:21:23.440 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-09-30T22:21:23.440 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 14/136 2023-09-30T22:21:23.440 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 15/136 2023-09-30T22:21:23.440 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 16/136 2023-09-30T22:21:23.440 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 17/136 2023-09-30T22:21:23.440 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 18/136 2023-09-30T22:21:23.440 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 19/136 2023-09-30T22:21:23.440 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 20/136 2023-09-30T22:21:23.440 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 21/136 2023-09-30T22:21:23.441 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 22/136 2023-09-30T22:21:23.441 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 23/136 2023-09-30T22:21:23.441 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 24/136 2023-09-30T22:21:23.441 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 25/136 2023-09-30T22:21:23.441 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 26/136 2023-09-30T22:21:23.441 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 27/136 2023-09-30T22:21:23.449 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 28/136 2023-09-30T22:21:23.449 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 29/136 2023-09-30T22:21:23.450 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 30/136 2023-09-30T22:21:23.450 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 31/136 2023-09-30T22:21:23.450 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 32/136 2023-09-30T22:21:23.450 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : bison-3.0.4-10.el8.x86_64 33/136 2023-09-30T22:21:23.450 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flex-2.6.1-9.el8.x86_64 34/136 2023-09-30T22:21:23.450 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : jq-1.6-7.el8.x86_64 35/136 2023-09-30T22:21:23.450 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 36/136 2023-09-30T22:21:23.450 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 37/136 2023-09-30T22:21:23.450 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 38/136 2023-09-30T22:21:23.450 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 39/136 2023-09-30T22:21:23.450 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 40/136 2023-09-30T22:21:23.451 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 41/136 2023-09-30T22:21:23.451 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 42/136 2023-09-30T22:21:23.451 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 43/136 2023-09-30T22:21:23.451 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 44/136 2023-09-30T22:21:23.451 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 45/136 2023-09-30T22:21:23.451 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 46/136 2023-09-30T22:21:23.451 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 47/136 2023-09-30T22:21:23.451 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 48/136 2023-09-30T22:21:23.451 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 49/136 2023-09-30T22:21:23.451 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 50/136 2023-09-30T22:21:23.451 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 51/136 2023-09-30T22:21:23.451 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 52/136 2023-09-30T22:21:23.452 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 53/136 2023-09-30T22:21:23.452 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 54/136 2023-09-30T22:21:23.452 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 55/136 2023-09-30T22:21:23.452 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 56/136 2023-09-30T22:21:23.452 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 57/136 2023-09-30T22:21:23.452 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 58/136 2023-09-30T22:21:23.452 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 59/136 2023-09-30T22:21:23.452 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 60/136 2023-09-30T22:21:23.452 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 61/136 2023-09-30T22:21:23.452 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 62/136 2023-09-30T22:21:23.452 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 63/136 2023-09-30T22:21:23.452 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 64/136 2023-09-30T22:21:23.453 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 65/136 2023-09-30T22:21:23.453 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 66/136 2023-09-30T22:21:23.453 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 67/136 2023-09-30T22:21:23.453 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 68/136 2023-09-30T22:21:23.453 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 69/136 2023-09-30T22:21:23.453 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 70/136 2023-09-30T22:21:23.453 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 71/136 2023-09-30T22:21:23.453 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 72/136 2023-09-30T22:21:23.453 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 73/136 2023-09-30T22:21:23.453 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/136 2023-09-30T22:21:23.453 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/136 2023-09-30T22:21:23.453 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/136 2023-09-30T22:21:23.454 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/136 2023-09-30T22:21:23.454 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 78/136 2023-09-30T22:21:23.454 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 79/136 2023-09-30T22:21:23.454 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : leveldb-1.22-1.el8.x86_64 80/136 2023-09-30T22:21:23.454 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 81/136 2023-09-30T22:21:23.454 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 82/136 2023-09-30T22:21:23.454 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/136 2023-09-30T22:21:23.454 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/136 2023-09-30T22:21:23.454 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 85/136 2023-09-30T22:21:23.454 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 86/136 2023-09-30T22:21:23.454 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 87/136 2023-09-30T22:21:23.455 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 88/136 2023-09-30T22:21:23.455 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 89/136 2023-09-30T22:21:23.455 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 90/136 2023-09-30T22:21:23.455 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 91/136 2023-09-30T22:21:23.455 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 92/136 2023-09-30T22:21:23.455 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 93/136 2023-09-30T22:21:23.455 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 94/136 2023-09-30T22:21:23.455 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 95/136 2023-09-30T22:21:23.455 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-portend-2.6-1.el8.noarch 96/136 2023-09-30T22:21:23.455 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 97/136 2023-09-30T22:21:23.455 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 98/136 2023-09-30T22:21:23.455 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 99/136 2023-09-30T22:21:23.455 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 100/136 2023-09-30T22:21:23.456 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 101/136 2023-09-30T22:21:23.456 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 102/136 2023-09-30T22:21:23.456 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 103/136 2023-09-30T22:21:23.456 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 104/136 2023-09-30T22:21:23.456 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 105/136 2023-09-30T22:21:23.456 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 106/136 2023-09-30T22:21:23.456 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 107/136 2023-09-30T22:21:23.456 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 108/136 2023-09-30T22:21:23.456 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-09-30T22:21:23.456 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 110/136 2023-09-30T22:21:23.456 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-09-30T22:21:23.457 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 112/136 2023-09-30T22:21:23.457 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 113/136 2023-09-30T22:21:23.457 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 114/136 2023-09-30T22:21:23.457 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el8.x86_64 115/136 2023-09-30T22:21:23.457 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 116/136 2023-09-30T22:21:23.457 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 117/136 2023-09-30T22:21:23.457 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 118/136 2023-09-30T22:21:23.457 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 119/136 2023-09-30T22:21:23.457 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 120/136 2023-09-30T22:21:23.458 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 121/136 2023-09-30T22:21:23.458 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 122/136 2023-09-30T22:21:23.458 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 123/136 2023-09-30T22:21:23.458 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 124/136 2023-09-30T22:21:23.458 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 125/136 2023-09-30T22:21:23.458 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 126/136 2023-09-30T22:21:23.458 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 127/136 2023-09-30T22:21:23.458 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 128/136 2023-09-30T22:21:23.458 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 129/136 2023-09-30T22:21:23.458 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 130/136 2023-09-30T22:21:23.458 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 131/136 2023-09-30T22:21:23.459 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 132/136 2023-09-30T22:21:23.459 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 133/136 2023-09-30T22:21:23.459 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 134/136 2023-09-30T22:21:23.459 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 135/136 2023-09-30T22:21:24.161 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 136/136 2023-09-30T22:21:24.161 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:21:24.161 INFO:teuthology.orchestra.run.smithi158.stdout:Upgraded: 2023-09-30T22:21:24.161 INFO:teuthology.orchestra.run.smithi158.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-09-30T22:21:24.161 INFO:teuthology.orchestra.run.smithi158.stdout: elfutils-debuginfod-client-0.189-3.el8.x86_64 2023-09-30T22:21:24.161 INFO:teuthology.orchestra.run.smithi158.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-09-30T22:21:24.161 INFO:teuthology.orchestra.run.smithi158.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-09-30T22:21:24.161 INFO:teuthology.orchestra.run.smithi158.stdout: iproute-6.2.0-2.el8.x86_64 2023-09-30T22:21:24.162 INFO:teuthology.orchestra.run.smithi158.stdout: libblkid-2.32.1-43.el8.x86_64 2023-09-30T22:21:24.162 INFO:teuthology.orchestra.run.smithi158.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-09-30T22:21:24.162 INFO:teuthology.orchestra.run.smithi158.stdout: libmount-2.32.1-43.el8.x86_64 2023-09-30T22:21:24.162 INFO:teuthology.orchestra.run.smithi158.stdout: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:24.162 INFO:teuthology.orchestra.run.smithi158.stdout: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:24.162 INFO:teuthology.orchestra.run.smithi158.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-09-30T22:21:24.162 INFO:teuthology.orchestra.run.smithi158.stdout: libuuid-2.32.1-43.el8.x86_64 2023-09-30T22:21:24.162 INFO:teuthology.orchestra.run.smithi158.stdout: util-linux-2.32.1-43.el8.x86_64 2023-09-30T22:21:24.162 INFO:teuthology.orchestra.run.smithi158.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-09-30T22:21:24.162 INFO:teuthology.orchestra.run.smithi158.stdout:Installed: 2023-09-30T22:21:24.163 INFO:teuthology.orchestra.run.smithi158.stdout: bison-3.0.4-10.el8.x86_64 2023-09-30T22:21:24.163 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:24.163 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:24.163 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:24.163 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:24.163 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:21:24.163 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:24.163 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:24.163 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:21:24.163 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:21:24.163 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:21:24.163 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:21:24.163 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:24.164 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:24.164 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:21:24.164 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:24.164 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:24.164 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:24.164 INFO:teuthology.orchestra.run.smithi158.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-09-30T22:21:24.164 INFO:teuthology.orchestra.run.smithi158.stdout: flex-2.6.1-9.el8.x86_64 2023-09-30T22:21:24.164 INFO:teuthology.orchestra.run.smithi158.stdout: fuse-2.9.7-17.el8.x86_64 2023-09-30T22:21:24.164 INFO:teuthology.orchestra.run.smithi158.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-30T22:21:24.164 INFO:teuthology.orchestra.run.smithi158.stdout: jq-1.6-7.el8.x86_64 2023-09-30T22:21:24.164 INFO:teuthology.orchestra.run.smithi158.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-09-30T22:21:24.165 INFO:teuthology.orchestra.run.smithi158.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-09-30T22:21:24.165 INFO:teuthology.orchestra.run.smithi158.stdout: leveldb-1.22-1.el8.x86_64 2023-09-30T22:21:24.165 INFO:teuthology.orchestra.run.smithi158.stdout: libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:24.165 INFO:teuthology.orchestra.run.smithi158.stdout: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:24.165 INFO:teuthology.orchestra.run.smithi158.stdout: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:24.165 INFO:teuthology.orchestra.run.smithi158.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-09-30T22:21:24.165 INFO:teuthology.orchestra.run.smithi158.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-09-30T22:21:24.165 INFO:teuthology.orchestra.run.smithi158.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-30T22:21:24.165 INFO:teuthology.orchestra.run.smithi158.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-09-30T22:21:24.165 INFO:teuthology.orchestra.run.smithi158.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-09-30T22:21:24.165 INFO:teuthology.orchestra.run.smithi158.stdout: librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:24.165 INFO:teuthology.orchestra.run.smithi158.stdout: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:24.165 INFO:teuthology.orchestra.run.smithi158.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-09-30T22:21:24.166 INFO:teuthology.orchestra.run.smithi158.stdout: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:24.166 INFO:teuthology.orchestra.run.smithi158.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-09-30T22:21:24.166 INFO:teuthology.orchestra.run.smithi158.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-09-30T22:21:24.166 INFO:teuthology.orchestra.run.smithi158.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-30T22:21:24.166 INFO:teuthology.orchestra.run.smithi158.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-09-30T22:21:24.166 INFO:teuthology.orchestra.run.smithi158.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-09-30T22:21:24.166 INFO:teuthology.orchestra.run.smithi158.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-30T22:21:24.166 INFO:teuthology.orchestra.run.smithi158.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-30T22:21:24.166 INFO:teuthology.orchestra.run.smithi158.stdout: openblas-0.3.15-4.el8.x86_64 2023-09-30T22:21:24.167 INFO:teuthology.orchestra.run.smithi158.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-09-30T22:21:24.167 INFO:teuthology.orchestra.run.smithi158.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-09-30T22:21:24.167 INFO:teuthology.orchestra.run.smithi158.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-09-30T22:21:24.167 INFO:teuthology.orchestra.run.smithi158.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-09-30T22:21:24.167 INFO:teuthology.orchestra.run.smithi158.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-09-30T22:21:24.167 INFO:teuthology.orchestra.run.smithi158.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-30T22:21:24.167 INFO:teuthology.orchestra.run.smithi158.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-30T22:21:24.167 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-30T22:21:24.167 INFO:teuthology.orchestra.run.smithi158.stdout: python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:24.167 INFO:teuthology.orchestra.run.smithi158.stdout: python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:24.167 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:24.167 INFO:teuthology.orchestra.run.smithi158.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-30T22:21:24.168 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-09-30T22:21:24.168 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-30T22:21:24.168 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-30T22:21:24.168 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-09-30T22:21:24.168 INFO:teuthology.orchestra.run.smithi158.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-30T22:21:24.168 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-30T22:21:24.168 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-30T22:21:24.168 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-30T22:21:24.168 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-30T22:21:24.168 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-30T22:21:24.168 INFO:teuthology.orchestra.run.smithi158.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-30T22:21:24.168 INFO:teuthology.orchestra.run.smithi158.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-30T22:21:24.169 INFO:teuthology.orchestra.run.smithi158.stdout: python3-mako-1.0.6-14.el8.noarch 2023-09-30T22:21:24.169 INFO:teuthology.orchestra.run.smithi158.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-30T22:21:24.169 INFO:teuthology.orchestra.run.smithi158.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-30T22:21:24.169 INFO:teuthology.orchestra.run.smithi158.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-09-30T22:21:24.169 INFO:teuthology.orchestra.run.smithi158.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-09-30T22:21:24.169 INFO:teuthology.orchestra.run.smithi158.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-30T22:21:24.169 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-30T22:21:24.169 INFO:teuthology.orchestra.run.smithi158.stdout: python3-portend-2.6-1.el8.noarch 2023-09-30T22:21:24.169 INFO:teuthology.orchestra.run.smithi158.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-30T22:21:24.169 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-09-30T22:21:24.169 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-30T22:21:24.169 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-30T22:21:24.170 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pycparser-2.14-14.el8.noarch 2023-09-30T22:21:24.170 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pytz-2017.2-11.el8.noarch 2023-09-30T22:21:24.170 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:24.170 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:24.170 INFO:teuthology.orchestra.run.smithi158.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-30T22:21:24.170 INFO:teuthology.orchestra.run.smithi158.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-30T22:21:24.170 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:24.170 INFO:teuthology.orchestra.run.smithi158.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-30T22:21:24.170 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-30T22:21:24.170 INFO:teuthology.orchestra.run.smithi158.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-09-30T22:21:24.170 INFO:teuthology.orchestra.run.smithi158.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-30T22:21:24.170 INFO:teuthology.orchestra.run.smithi158.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-30T22:21:24.171 INFO:teuthology.orchestra.run.smithi158.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-30T22:21:24.171 INFO:teuthology.orchestra.run.smithi158.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-30T22:21:24.171 INFO:teuthology.orchestra.run.smithi158.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-30T22:21:24.171 INFO:teuthology.orchestra.run.smithi158.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-30T22:21:24.171 INFO:teuthology.orchestra.run.smithi158.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-30T22:21:24.171 INFO:teuthology.orchestra.run.smithi158.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-30T22:21:24.171 INFO:teuthology.orchestra.run.smithi158.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-30T22:21:24.171 INFO:teuthology.orchestra.run.smithi158.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-30T22:21:24.171 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:24.171 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:24.171 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:24.171 INFO:teuthology.orchestra.run.smithi158.stdout: socat-1.7.4.1-1.el8.x86_64 2023-09-30T22:21:24.172 INFO:teuthology.orchestra.run.smithi158.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-30T22:21:24.172 INFO:teuthology.orchestra.run.smithi158.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-09-30T22:21:24.172 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:21:24.172 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-09-30T22:21:24.439 DEBUG:teuthology.parallel:result is None 2023-09-30T22:21:25.495 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 136/136 2023-09-30T22:21:25.495 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:21:25.495 INFO:teuthology.orchestra.run.smithi040.stdout:Upgraded: 2023-09-30T22:21:25.496 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-09-30T22:21:25.496 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-debuginfod-client-0.189-3.el8.x86_64 2023-09-30T22:21:25.496 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-09-30T22:21:25.496 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-09-30T22:21:25.496 INFO:teuthology.orchestra.run.smithi040.stdout: iproute-6.2.0-2.el8.x86_64 2023-09-30T22:21:25.496 INFO:teuthology.orchestra.run.smithi040.stdout: libblkid-2.32.1-43.el8.x86_64 2023-09-30T22:21:25.496 INFO:teuthology.orchestra.run.smithi040.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-09-30T22:21:25.496 INFO:teuthology.orchestra.run.smithi040.stdout: libmount-2.32.1-43.el8.x86_64 2023-09-30T22:21:25.496 INFO:teuthology.orchestra.run.smithi040.stdout: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:25.496 INFO:teuthology.orchestra.run.smithi040.stdout: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:25.496 INFO:teuthology.orchestra.run.smithi040.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-09-30T22:21:25.497 INFO:teuthology.orchestra.run.smithi040.stdout: libuuid-2.32.1-43.el8.x86_64 2023-09-30T22:21:25.497 INFO:teuthology.orchestra.run.smithi040.stdout: util-linux-2.32.1-43.el8.x86_64 2023-09-30T22:21:25.497 INFO:teuthology.orchestra.run.smithi040.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-09-30T22:21:25.497 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2023-09-30T22:21:25.497 INFO:teuthology.orchestra.run.smithi040.stdout: bison-3.0.4-10.el8.x86_64 2023-09-30T22:21:25.497 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:25.497 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:25.497 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:25.497 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:25.497 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:21:25.497 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:25.497 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:25.498 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:21:25.498 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:21:25.498 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:21:25.498 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:21:25.498 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:25.498 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:25.498 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:21:25.498 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:25.498 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:25.499 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:25.499 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-09-30T22:21:25.499 INFO:teuthology.orchestra.run.smithi040.stdout: flex-2.6.1-9.el8.x86_64 2023-09-30T22:21:25.499 INFO:teuthology.orchestra.run.smithi040.stdout: fuse-2.9.7-17.el8.x86_64 2023-09-30T22:21:25.499 INFO:teuthology.orchestra.run.smithi040.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-30T22:21:25.499 INFO:teuthology.orchestra.run.smithi040.stdout: jq-1.6-7.el8.x86_64 2023-09-30T22:21:25.499 INFO:teuthology.orchestra.run.smithi040.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-09-30T22:21:25.499 INFO:teuthology.orchestra.run.smithi040.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-09-30T22:21:25.499 INFO:teuthology.orchestra.run.smithi040.stdout: leveldb-1.22-1.el8.x86_64 2023-09-30T22:21:25.499 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:25.499 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:25.499 INFO:teuthology.orchestra.run.smithi040.stdout: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:25.500 INFO:teuthology.orchestra.run.smithi040.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-09-30T22:21:25.500 INFO:teuthology.orchestra.run.smithi040.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-09-30T22:21:25.500 INFO:teuthology.orchestra.run.smithi040.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-30T22:21:25.500 INFO:teuthology.orchestra.run.smithi040.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-09-30T22:21:25.500 INFO:teuthology.orchestra.run.smithi040.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-09-30T22:21:25.500 INFO:teuthology.orchestra.run.smithi040.stdout: librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:25.500 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:25.500 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-09-30T22:21:25.500 INFO:teuthology.orchestra.run.smithi040.stdout: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:25.501 INFO:teuthology.orchestra.run.smithi040.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-09-30T22:21:25.501 INFO:teuthology.orchestra.run.smithi040.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-09-30T22:21:25.501 INFO:teuthology.orchestra.run.smithi040.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-30T22:21:25.501 INFO:teuthology.orchestra.run.smithi040.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-09-30T22:21:25.501 INFO:teuthology.orchestra.run.smithi040.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-09-30T22:21:25.501 INFO:teuthology.orchestra.run.smithi040.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-30T22:21:25.501 INFO:teuthology.orchestra.run.smithi040.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-30T22:21:25.501 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-0.3.15-4.el8.x86_64 2023-09-30T22:21:25.501 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-09-30T22:21:25.501 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-09-30T22:21:25.501 INFO:teuthology.orchestra.run.smithi040.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-09-30T22:21:25.502 INFO:teuthology.orchestra.run.smithi040.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-09-30T22:21:25.502 INFO:teuthology.orchestra.run.smithi040.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-09-30T22:21:25.502 INFO:teuthology.orchestra.run.smithi040.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-30T22:21:25.502 INFO:teuthology.orchestra.run.smithi040.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-30T22:21:25.502 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-30T22:21:25.502 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:25.502 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:25.502 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:25.502 INFO:teuthology.orchestra.run.smithi040.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-30T22:21:25.502 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-09-30T22:21:25.503 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-30T22:21:25.503 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-30T22:21:25.503 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-09-30T22:21:25.503 INFO:teuthology.orchestra.run.smithi040.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-30T22:21:25.503 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-30T22:21:25.503 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-30T22:21:25.503 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-30T22:21:25.503 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-30T22:21:25.503 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-30T22:21:25.503 INFO:teuthology.orchestra.run.smithi040.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-30T22:21:25.503 INFO:teuthology.orchestra.run.smithi040.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-30T22:21:25.504 INFO:teuthology.orchestra.run.smithi040.stdout: python3-mako-1.0.6-14.el8.noarch 2023-09-30T22:21:25.504 INFO:teuthology.orchestra.run.smithi040.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-30T22:21:25.504 INFO:teuthology.orchestra.run.smithi040.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-30T22:21:25.504 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-09-30T22:21:25.504 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-09-30T22:21:25.504 INFO:teuthology.orchestra.run.smithi040.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-30T22:21:25.504 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-30T22:21:25.504 INFO:teuthology.orchestra.run.smithi040.stdout: python3-portend-2.6-1.el8.noarch 2023-09-30T22:21:25.504 INFO:teuthology.orchestra.run.smithi040.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-30T22:21:25.504 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-09-30T22:21:25.505 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-30T22:21:25.505 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-30T22:21:25.505 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pycparser-2.14-14.el8.noarch 2023-09-30T22:21:25.505 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pytz-2017.2-11.el8.noarch 2023-09-30T22:21:25.505 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:25.505 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:25.505 INFO:teuthology.orchestra.run.smithi040.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-30T22:21:25.505 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-30T22:21:25.505 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:25.505 INFO:teuthology.orchestra.run.smithi040.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-30T22:21:25.505 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-30T22:21:25.506 INFO:teuthology.orchestra.run.smithi040.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-09-30T22:21:25.506 INFO:teuthology.orchestra.run.smithi040.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-30T22:21:25.506 INFO:teuthology.orchestra.run.smithi040.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-30T22:21:25.506 INFO:teuthology.orchestra.run.smithi040.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-30T22:21:25.506 INFO:teuthology.orchestra.run.smithi040.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-30T22:21:25.506 INFO:teuthology.orchestra.run.smithi040.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-30T22:21:25.506 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-30T22:21:25.506 INFO:teuthology.orchestra.run.smithi040.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-30T22:21:25.506 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-30T22:21:25.506 INFO:teuthology.orchestra.run.smithi040.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-30T22:21:25.507 INFO:teuthology.orchestra.run.smithi040.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-30T22:21:25.507 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:25.507 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:25.507 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:21:25.507 INFO:teuthology.orchestra.run.smithi040.stdout: socat-1.7.4.1-1.el8.x86_64 2023-09-30T22:21:25.507 INFO:teuthology.orchestra.run.smithi040.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-30T22:21:25.508 INFO:teuthology.orchestra.run.smithi040.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-09-30T22:21:25.508 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:21:25.508 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2023-09-30T22:21:25.695 DEBUG:teuthology.parallel:result is None 2023-09-30T22:21:25.695 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-30T22:21:25.695 INFO:teuthology.packaging:ref: None 2023-09-30T22:21:25.695 INFO:teuthology.packaging:tag: None 2023-09-30T22:21:25.695 INFO:teuthology.packaging:branch: pacific 2023-09-30T22:21:25.695 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-09-30T22:21:25.696 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-09-30T22:21:25.926 DEBUG:teuthology.orchestra.run.smithi040:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-30T22:21:25.951 INFO:teuthology.orchestra.run.smithi040.stdout:16.2.14-44.geeb13ac9.el8 2023-09-30T22:21:25.952 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-44.geeb13ac9.el8 2023-09-30T22:21:25.952 INFO:teuthology.task.install:The correct ceph version 16.2.14-44.geeb13ac9 is installed. 2023-09-30T22:21:25.952 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-30T22:21:25.953 INFO:teuthology.packaging:ref: None 2023-09-30T22:21:25.953 INFO:teuthology.packaging:tag: None 2023-09-30T22:21:25.953 INFO:teuthology.packaging:branch: pacific 2023-09-30T22:21:25.953 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-09-30T22:21:25.953 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-09-30T22:21:26.263 DEBUG:teuthology.orchestra.run.smithi158:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-30T22:21:26.318 INFO:teuthology.orchestra.run.smithi158.stdout:16.2.14-44.geeb13ac9.el8 2023-09-30T22:21:26.318 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-44.geeb13ac9.el8 2023-09-30T22:21:26.319 INFO:teuthology.task.install:The correct ceph version 16.2.14-44.geeb13ac9 is installed. 2023-09-30T22:21:26.319 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-09-30T22:21:26.319 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-09-30T22:21:26.319 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-30T22:21:26.351 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-09-30T22:21:26.351 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-30T22:21:26.430 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-09-30T22:21:26.430 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-09-30T22:21:26.430 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/daemon-helper 2023-09-30T22:21:26.458 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-30T22:21:26.528 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-09-30T22:21:26.528 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/usr/bin/daemon-helper 2023-09-30T22:21:26.599 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-30T22:21:26.714 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-09-30T22:21:26.714 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-09-30T22:21:26.714 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-30T22:21:26.743 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-30T22:21:26.811 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-09-30T22:21:26.811 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-30T22:21:26.884 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-30T22:21:26.996 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-09-30T22:21:26.996 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-09-30T22:21:26.996 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/stdin-killer 2023-09-30T22:21:27.024 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-30T22:21:27.093 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-09-30T22:21:27.093 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/usr/bin/stdin-killer 2023-09-30T22:21:27.163 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-30T22:21:27.273 INFO:teuthology.run_tasks:Running task print... 2023-09-30T22:21:27.283 INFO:teuthology.task.print:**** done installing pacific 2023-09-30T22:21:27.283 INFO:teuthology.run_tasks:Running task ceph... 2023-09-30T22:21:27.404 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-09-30T22:21:27.405 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 777 /var/log/ceph 2023-09-30T22:21:27.407 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 777 /var/log/ceph 2023-09-30T22:21:27.480 INFO:tasks.ceph:Disabling ceph logrotate... 2023-09-30T22:21:27.480 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-30T22:21:27.482 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-30T22:21:27.553 INFO:tasks.ceph:Creating extra log directories... 2023-09-30T22:21:27.554 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-30T22:21:27.556 DEBUG:teuthology.orchestra.run.smithi158:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-30T22:21:27.636 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-09-30T22:21:27.636 INFO:tasks.ceph:config {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-09-30T22:21:27.636 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408039', 'branch': 'fix-nfs-apply-err-reporting', 'description': 'fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} 2-upgrade 3-workload/new_ops/{0-clients/kclient 1-client-sanity}}}', 'email': None, 'first_in_suite': False, 'job_id': '7408039', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'fix-nfs-apply-err-reporting'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-62953', 'sha1': '6973b24e3d99fd494b753449d2ea12077599cbd6'}}, 'owner': 'scheduled_dparmar@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['client.0']], 'seed': 2683, 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'sleep_before_teardown': 0, 'suite': 'fs:upgrade', 'suite_branch': 'wip-62953', 'suite_path': '/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/dparmar18/ceph', 'suite_sha1': '6973b24e3d99fd494b753449d2ea12077599cbd6', 'targets': {'smithi040.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFqbonTGVhhSgPKdc3WgRKBJoXF6R9MoCundAIPrMI7XrrWDWgs5ddn0zAdLfSW36DtX6AUqZS0/w0Us6Btu74E=', 'smithi158.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLxpTz0DsyBfPSCTqvRHySCxYwvLwOg+AjBFPHdLqxnAj6QEHJ13IdTerhOmu22y+fNeVavBgZTsLqlvCCQOpEY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'branch': 'pacific', 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}}, {'print': '**** done installing pacific'}, {'ceph': {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'log-ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'flavor': 'default', 'fs': 'xfs', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'cluster': 'ceph'}}, {'exec': {'osd.0': ['ceph osd set-require-min-compat-client pacific']}}, {'print': '**** done ceph'}, {'kclient': None}, {'mds_pre_upgrade': None}, {'print': '**** done mds pre-upgrade sequence'}, {'install.upgrade': {'mon.a': {'branch': 'reef'}}}, {'print': '**** done install.upgrade the host'}, {'ceph.restart': {'daemons': ['mon.*', 'mgr.*'], 'mon-health-to-clog': False, 'wait-for-healthy': False}}, {'ceph.healthy': None}, {'ceph.restart': {'daemons': ['osd.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'ceph.stop': ['mds.*']}, {'ceph.restart': {'daemons': ['mds.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'exec': {'mon.a': ['ceph osd dump -f json-pretty', 'ceph versions', 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done', 'ceph osd require-osd-release reef']}}, {'ceph.healthy': None}, {'print': '**** done ceph.restart'}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_newops']}}], 'teuthology': {'branch': 'pacific', 'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end', "if not is_kupstream() or syntax_version() == 'v2' then reject() end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-09-30_21:53:45', 'tube': 'smithi', 'user': 'dparmar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-09-30T22:21:27.637 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-30T22:21:27.639 DEBUG:teuthology.orchestra.run.smithi158:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-30T22:21:27.686 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m0777 -- /var/run/ceph 2023-09-30T22:21:27.699 DEBUG:teuthology.orchestra.run.smithi158:> sudo install -d -m0777 -- /var/run/ceph 2023-09-30T22:21:27.798 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-09-30T22:21:27.798 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/scratch_devs of=/dev/stdout 2023-09-30T22:21:27.817 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-30T22:21:27.818 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_1 2023-09-30T22:21:27.878 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-30T22:21:27.878 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T22:21:27.878 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 6h/6d Inode: 397505 Links: 1 2023-09-30T22:21:27.879 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T22:21:27.879 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T22:21:27.879 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-09-30 22:21:23.104601539 +0000 2023-09-30T22:21:27.879 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-09-30 22:16:22.128596906 +0000 2023-09-30T22:21:27.879 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-09-30 22:16:22.128596906 +0000 2023-09-30T22:21:27.879 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2023-09-30T22:21:27.879 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-30T22:21:27.946 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-09-30T22:21:27.946 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-09-30T22:21:27.946 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000248499 s, 2.1 MB/s 2023-09-30T22:21:27.947 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-30T22:21:28.009 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_2 2023-09-30T22:21:28.069 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-30T22:21:28.069 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T22:21:28.069 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 6h/6d Inode: 392835 Links: 1 2023-09-30T22:21:28.069 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T22:21:28.069 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T22:21:28.069 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-09-30 22:21:23.105601527 +0000 2023-09-30T22:21:28.069 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-09-30 22:16:22.663590487 +0000 2023-09-30T22:21:28.069 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-09-30 22:16:22.663590487 +0000 2023-09-30T22:21:28.069 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2023-09-30T22:21:28.070 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-30T22:21:28.137 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-09-30T22:21:28.137 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-09-30T22:21:28.137 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000216905 s, 2.4 MB/s 2023-09-30T22:21:28.138 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-30T22:21:28.198 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_3 2023-09-30T22:21:28.259 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-30T22:21:28.259 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T22:21:28.259 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 6h/6d Inode: 394220 Links: 1 2023-09-30T22:21:28.259 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T22:21:28.259 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T22:21:28.259 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-09-30 22:21:23.105601527 +0000 2023-09-30T22:21:28.259 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-09-30 22:16:23.198584068 +0000 2023-09-30T22:21:28.259 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-09-30 22:16:23.198584068 +0000 2023-09-30T22:21:28.259 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2023-09-30T22:21:28.260 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-30T22:21:28.327 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-09-30T22:21:28.327 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-09-30T22:21:28.327 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000217945 s, 2.3 MB/s 2023-09-30T22:21:28.328 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-30T22:21:28.389 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_4 2023-09-30T22:21:28.448 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-30T22:21:28.448 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T22:21:28.449 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 6h/6d Inode: 401436 Links: 1 2023-09-30T22:21:28.449 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T22:21:28.449 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T22:21:28.449 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-09-30 22:21:23.105601527 +0000 2023-09-30T22:21:28.449 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-09-30 22:16:23.756577373 +0000 2023-09-30T22:21:28.449 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-09-30 22:16:23.756577373 +0000 2023-09-30T22:21:28.449 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2023-09-30T22:21:28.449 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-30T22:21:28.515 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-09-30T22:21:28.516 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-09-30T22:21:28.516 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000228876 s, 2.2 MB/s 2023-09-30T22:21:28.517 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-30T22:21:28.576 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-30T22:21:28.576 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi040.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2023-09-30T22:21:28.576 INFO:tasks.ceph:Generating config... 2023-09-30T22:21:28.578 INFO:tasks.ceph:[global] mon warn on pool no app = False 2023-09-30T22:21:28.578 INFO:tasks.ceph:[global] ms bind msgr2 = False 2023-09-30T22:21:28.578 INFO:tasks.ceph:[global] bluestore warn on legacy statfs = False 2023-09-30T22:21:28.578 INFO:tasks.ceph:[global] bluestore warn on no per pool omap = False 2023-09-30T22:21:28.578 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2023-09-30T22:21:28.578 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-09-30T22:21:28.578 INFO:tasks.ceph:[client] client mount timeout = 600 2023-09-30T22:21:28.578 INFO:tasks.ceph:[client] debug client = 20 2023-09-30T22:21:28.578 INFO:tasks.ceph:[client] debug ms = 1 2023-09-30T22:21:28.578 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-09-30T22:21:28.578 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-09-30T22:21:28.579 INFO:tasks.ceph:[mds] debug mds = 20 2023-09-30T22:21:28.579 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-09-30T22:21:28.579 INFO:tasks.ceph:[mds] debug ms = 1 2023-09-30T22:21:28.579 INFO:tasks.ceph:[mds] mds debug frag = True 2023-09-30T22:21:28.579 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-09-30T22:21:28.579 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-09-30T22:21:28.579 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-09-30T22:21:28.579 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-09-30T22:21:28.579 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-09-30T22:21:28.579 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-09-30T22:21:28.579 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-09-30T22:21:28.579 INFO:tasks.ceph:[mgr] debug ms = 1 2023-09-30T22:21:28.579 INFO:tasks.ceph:[mon] debug mon = 20 2023-09-30T22:21:28.580 INFO:tasks.ceph:[mon] debug ms = 1 2023-09-30T22:21:28.580 INFO:tasks.ceph:[mon] debug paxos = 20 2023-09-30T22:21:28.580 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-09-30T22:21:28.580 INFO:tasks.ceph:[mon] mon warn on osd down out interval zero = False 2023-09-30T22:21:28.580 INFO:tasks.ceph:[osd] bdev async discard = True 2023-09-30T22:21:28.580 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-09-30T22:21:28.580 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-09-30T22:21:28.580 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-09-30T22:21:28.580 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-09-30T22:21:28.580 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-09-30T22:21:28.580 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-09-30T22:21:28.580 INFO:tasks.ceph:[osd] debug ms = 1 2023-09-30T22:21:28.580 INFO:tasks.ceph:[osd] debug osd = 20 2023-09-30T22:21:28.581 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-09-30T22:21:28.581 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-09-30T22:21:28.581 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-09-30T22:21:28.581 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-09-30T22:21:28.581 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-09-30T22:21:28.581 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-09-30T22:21:28.581 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-09-30T22:21:28.581 INFO:tasks.ceph:Setting up mon.a... 2023-09-30T22:21:28.581 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-09-30T22:21:28.680 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.keyring 2023-09-30T22:21:28.683 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-09-30T22:21:28.726 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-30T22:21:28.794 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.40'), ('mon.b', '[v2:172.21.15.40:3301,v1:172.21.15.40:6790]'), ('mon.c', '[v2:172.21.15.40:3302,v1:172.21.15.40:6791]')] 2023-09-30T22:21:28.794 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.40,[v2:172.21.15.40:3301,v1:172.21.15.40:6790],[v2:172.21.15.40:3302,v1:172.21.15.40:6791]', 'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-09-30T22:21:28.795 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-09-30T22:21:28.796 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-09-30T22:21:28.852 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.40 --addv b '[v2:172.21.15.40:3301,v1:172.21.15.40:6790]' --addv c '[v2:172.21.15.40:3302,v1:172.21.15.40:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:21:28.938 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:21:28.938 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: generated fsid 79dd4d8e-f295-4d9c-bd93-9850863800e3 2023-09-30T22:21:28.938 INFO:teuthology.orchestra.run.smithi040.stdout:epoch 0 2023-09-30T22:21:28.938 INFO:teuthology.orchestra.run.smithi040.stdout:fsid 79dd4d8e-f295-4d9c-bd93-9850863800e3 2023-09-30T22:21:28.938 INFO:teuthology.orchestra.run.smithi040.stdout:last_changed 2023-09-30T22:21:28.938669+0000 2023-09-30T22:21:28.938 INFO:teuthology.orchestra.run.smithi040.stdout:created 2023-09-30T22:21:28.938669+0000 2023-09-30T22:21:28.938 INFO:teuthology.orchestra.run.smithi040.stdout:min_mon_release 0 (unknown) 2023-09-30T22:21:28.938 INFO:teuthology.orchestra.run.smithi040.stdout:election_strategy: 1 2023-09-30T22:21:28.939 INFO:teuthology.orchestra.run.smithi040.stdout:0: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.a 2023-09-30T22:21:28.939 INFO:teuthology.orchestra.run.smithi040.stdout:1: [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] mon.b 2023-09-30T22:21:28.939 INFO:teuthology.orchestra.run.smithi040.stdout:2: [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] mon.c 2023-09-30T22:21:28.939 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-09-30T22:21:28.940 DEBUG:teuthology.orchestra.run.smithi040:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-09-30T22:21:28.958 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 79dd4d8e-f295-4d9c-bd93-9850863800e3... 2023-09-30T22:21:28.959 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-30T22:21:29.000 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-30T22:21:29.045 INFO:teuthology.orchestra.run.smithi040.stdout:[global] 2023-09-30T22:21:29.045 INFO:teuthology.orchestra.run.smithi040.stdout: chdir = "" 2023-09-30T22:21:29.045 INFO:teuthology.orchestra.run.smithi040.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-30T22:21:29.045 INFO:teuthology.orchestra.run.smithi040.stdout: auth supported = cephx 2023-09-30T22:21:29.045 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:21:29.045 INFO:teuthology.orchestra.run.smithi040.stdout: filestore xattr use omap = true 2023-09-30T22:21:29.045 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:21:29.045 INFO:teuthology.orchestra.run.smithi040.stdout: mon clock drift allowed = 1.000 2023-09-30T22:21:29.045 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:21:29.046 INFO:teuthology.orchestra.run.smithi040.stdout: osd crush chooseleaf type = 0 2023-09-30T22:21:29.046 INFO:teuthology.orchestra.run.smithi040.stdout: auth debug = true 2023-09-30T22:21:29.046 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:21:29.046 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on old message = true 2023-09-30T22:21:29.046 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on bug = true 2023-09-30T22:21:29.046 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:21:29.046 INFO:teuthology.orchestra.run.smithi040.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-30T22:21:29.046 INFO:teuthology.orchestra.run.smithi040.stdout: mon pg warn max object skew = 0 2023-09-30T22:21:29.046 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:21:29.046 INFO:teuthology.orchestra.run.smithi040.stdout: # disable pg_autoscaler by default for new pools 2023-09-30T22:21:29.046 INFO:teuthology.orchestra.run.smithi040.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-30T22:21:29.046 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:21:29.047 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default size = 2 2023-09-30T22:21:29.047 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:21:29.047 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow primary affinity = true 2023-09-30T22:21:29.047 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow pg remap = true 2023-09-30T22:21:29.047 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on legacy crush tunables = false 2023-09-30T22:21:29.047 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on crush straw calc version zero = false 2023-09-30T22:21:29.047 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on no sortbitwise = false 2023-09-30T22:21:29.047 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on osd down out interval zero = false 2023-09-30T22:21:29.047 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on too few osds = false 2023-09-30T22:21:29.047 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-30T22:21:29.047 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-30T22:21:29.047 INFO:teuthology.orchestra.run.smithi040.stdout: mon_allow_pool_size_one = true 2023-09-30T22:21:29.048 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:21:29.048 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-30T22:21:29.048 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:21:29.048 INFO:teuthology.orchestra.run.smithi040.stdout: osd default data pool replay window = 5 2023-09-30T22:21:29.048 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:21:29.048 INFO:teuthology.orchestra.run.smithi040.stdout: mon allow pool delete = true 2023-09-30T22:21:29.048 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:21:29.048 INFO:teuthology.orchestra.run.smithi040.stdout: mon cluster log file level = debug 2023-09-30T22:21:29.048 INFO:teuthology.orchestra.run.smithi040.stdout: debug asserts on shutdown = true 2023-09-30T22:21:29.048 INFO:teuthology.orchestra.run.smithi040.stdout: mon health detail to clog = false 2023-09-30T22:21:29.048 INFO:teuthology.orchestra.run.smithi040.stdout: mon host = "172.21.15.40,[v2:172.21.15.40:3301,v1:172.21.15.40:6790],[v2:172.21.15.40:3302,v1:172.21.15.40:6791]" 2023-09-30T22:21:29.048 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on pool no app = False 2023-09-30T22:21:29.049 INFO:teuthology.orchestra.run.smithi040.stdout: ms bind msgr2 = False 2023-09-30T22:21:29.049 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore warn on legacy statfs = False 2023-09-30T22:21:29.049 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore warn on no per pool omap = False 2023-09-30T22:21:29.049 INFO:teuthology.orchestra.run.smithi040.stdout: mon pg warn min per osd = 0 2023-09-30T22:21:29.049 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on skipped message = False 2023-09-30T22:21:29.049 INFO:teuthology.orchestra.run.smithi040.stdout: fsid = 79dd4d8e-f295-4d9c-bd93-9850863800e3 2023-09-30T22:21:29.049 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:21:29.049 INFO:teuthology.orchestra.run.smithi040.stdout:[osd] 2023-09-30T22:21:29.049 INFO:teuthology.orchestra.run.smithi040.stdout: osd journal size = 100 2023-09-30T22:21:29.049 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:21:29.049 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub load threshold = 5.0 2023-09-30T22:21:29.049 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub max interval = 600 2023-09-30T22:21:29.050 INFO:teuthology.orchestra.run.smithi040.stdout: osd mclock profile = high_recovery_ops 2023-09-30T22:21:29.050 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:21:29.050 INFO:teuthology.orchestra.run.smithi040.stdout: osd recover clone overlap = true 2023-09-30T22:21:29.050 INFO:teuthology.orchestra.run.smithi040.stdout: osd recovery max chunk = 1048576 2023-09-30T22:21:29.050 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:21:29.050 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug shutdown = true 2023-09-30T22:21:29.050 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug op order = true 2023-09-30T22:21:29.050 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug verify stray on activate = true 2023-09-30T22:21:29.050 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:21:29.050 INFO:teuthology.orchestra.run.smithi040.stdout: osd open classes on start = true 2023-09-30T22:21:29.050 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug pg log writeout = true 2023-09-30T22:21:29.050 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:21:29.051 INFO:teuthology.orchestra.run.smithi040.stdout: osd deep scrub update digest min age = 30 2023-09-30T22:21:29.051 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:21:29.051 INFO:teuthology.orchestra.run.smithi040.stdout: osd map max advance = 10 2023-09-30T22:21:29.051 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:21:29.051 INFO:teuthology.orchestra.run.smithi040.stdout: journal zero on create = true 2023-09-30T22:21:29.051 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:21:29.051 INFO:teuthology.orchestra.run.smithi040.stdout: filestore ondisk finisher threads = 3 2023-09-30T22:21:29.051 INFO:teuthology.orchestra.run.smithi040.stdout: filestore apply finisher threads = 3 2023-09-30T22:21:29.051 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:21:29.051 INFO:teuthology.orchestra.run.smithi040.stdout: bdev debug aio = true 2023-09-30T22:21:29.051 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug misdirected ops = true 2023-09-30T22:21:29.051 INFO:teuthology.orchestra.run.smithi040.stdout: bdev async discard = True 2023-09-30T22:21:29.052 INFO:teuthology.orchestra.run.smithi040.stdout: bdev enable discard = True 2023-09-30T22:21:29.052 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore allocator = bitmap 2023-09-30T22:21:29.052 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore block size = 96636764160 2023-09-30T22:21:29.052 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore fsck on mount = True 2023-09-30T22:21:29.052 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluefs = 1/20 2023-09-30T22:21:29.052 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluestore = 1/20 2023-09-30T22:21:29.052 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-09-30T22:21:29.052 INFO:teuthology.orchestra.run.smithi040.stdout: debug osd = 20 2023-09-30T22:21:29.052 INFO:teuthology.orchestra.run.smithi040.stdout: debug rocksdb = 4/10 2023-09-30T22:21:29.052 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd backfillfull_ratio = 0.85 2023-09-30T22:21:29.052 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd full ratio = 0.9 2023-09-30T22:21:29.052 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd nearfull ratio = 0.8 2023-09-30T22:21:29.053 INFO:teuthology.orchestra.run.smithi040.stdout: osd failsafe full ratio = 0.95 2023-09-30T22:21:29.053 INFO:teuthology.orchestra.run.smithi040.stdout: osd objectstore = bluestore 2023-09-30T22:21:29.053 INFO:teuthology.orchestra.run.smithi040.stdout: osd op complaint time = 180 2023-09-30T22:21:29.053 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:21:29.053 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr] 2023-09-30T22:21:29.053 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-09-30T22:21:29.053 INFO:teuthology.orchestra.run.smithi040.stdout: debug mgr = 20 2023-09-30T22:21:29.053 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2023-09-30T22:21:29.053 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2023-09-30T22:21:29.053 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2023-09-30T22:21:29.053 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2023-09-30T22:21:29.053 INFO:teuthology.orchestra.run.smithi040.stdout: mgr/telemetry/nag = false 2023-09-30T22:21:29.054 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:21:29.054 INFO:teuthology.orchestra.run.smithi040.stdout:[mon] 2023-09-30T22:21:29.054 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-09-30T22:21:29.054 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2023-09-30T22:21:29.054 INFO:teuthology.orchestra.run.smithi040.stdout: debug paxos = 20 2023-09-30T22:21:29.054 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2023-09-30T22:21:29.054 INFO:teuthology.orchestra.run.smithi040.stdout: mon data avail warn = 5 2023-09-30T22:21:29.054 INFO:teuthology.orchestra.run.smithi040.stdout: mon mgr mkfs grace = 240 2023-09-30T22:21:29.054 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2023-09-30T22:21:29.054 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd reporter subtree level = osd 2023-09-30T22:21:29.054 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd prime pg temp = true 2023-09-30T22:21:29.054 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2023-09-30T22:21:29.054 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:21:29.055 INFO:teuthology.orchestra.run.smithi040.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-30T22:21:29.055 INFO:teuthology.orchestra.run.smithi040.stdout: auth mon ticket ttl = 660 # 11m 2023-09-30T22:21:29.055 INFO:teuthology.orchestra.run.smithi040.stdout: auth service ticket ttl = 240 # 4m 2023-09-30T22:21:29.055 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:21:29.055 INFO:teuthology.orchestra.run.smithi040.stdout: # don't complain about insecure global_id in the test suite 2023-09-30T22:21:29.055 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-30T22:21:29.055 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-30T22:21:29.055 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:21:29.055 INFO:teuthology.orchestra.run.smithi040.stdout: # 1m isn't quite enough 2023-09-30T22:21:29.055 INFO:teuthology.orchestra.run.smithi040.stdout: mon_down_mkfs_grace = 2m 2023-09-30T22:21:29.055 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:21:29.055 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_filestore_osds = false 2023-09-30T22:21:29.056 INFO:teuthology.orchestra.run.smithi040.stdout: mon op complaint time = 120 2023-09-30T22:21:29.056 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on osd down out interval zero = False 2023-09-30T22:21:29.056 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:21:29.056 INFO:teuthology.orchestra.run.smithi040.stdout:[client] 2023-09-30T22:21:29.056 INFO:teuthology.orchestra.run.smithi040.stdout: rgw cache enabled = true 2023-09-30T22:21:29.056 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable ops log = true 2023-09-30T22:21:29.056 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable usage log = true 2023-09-30T22:21:29.056 INFO:teuthology.orchestra.run.smithi040.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-30T22:21:29.056 INFO:teuthology.orchestra.run.smithi040.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-30T22:21:29.056 INFO:teuthology.orchestra.run.smithi040.stdout: client mount timeout = 600 2023-09-30T22:21:29.056 INFO:teuthology.orchestra.run.smithi040.stdout: debug client = 20 2023-09-30T22:21:29.057 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-09-30T22:21:29.057 INFO:teuthology.orchestra.run.smithi040.stdout: rados mon op timeout = 900 2023-09-30T22:21:29.057 INFO:teuthology.orchestra.run.smithi040.stdout: rados osd op timeout = 900 2023-09-30T22:21:29.057 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.a] 2023-09-30T22:21:29.057 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.b] 2023-09-30T22:21:29.057 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.c] 2023-09-30T22:21:29.057 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.a] 2023-09-30T22:21:29.057 INFO:teuthology.orchestra.run.smithi040.stdout:[mds] 2023-09-30T22:21:29.057 INFO:teuthology.orchestra.run.smithi040.stdout: debug mds = 20 2023-09-30T22:21:29.057 INFO:teuthology.orchestra.run.smithi040.stdout: debug mds balancer = 20 2023-09-30T22:21:29.057 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-09-30T22:21:29.057 INFO:teuthology.orchestra.run.smithi040.stdout: mds debug frag = True 2023-09-30T22:21:29.058 INFO:teuthology.orchestra.run.smithi040.stdout: mds debug scatterstat = True 2023-09-30T22:21:29.058 INFO:teuthology.orchestra.run.smithi040.stdout: mds op complaint time = 180 2023-09-30T22:21:29.058 INFO:teuthology.orchestra.run.smithi040.stdout: mds verify scatter = True 2023-09-30T22:21:29.058 INFO:teuthology.orchestra.run.smithi040.stdout: osd op complaint time = 180 2023-09-30T22:21:29.058 INFO:teuthology.orchestra.run.smithi040.stdout: rados mon op timeout = 900 2023-09-30T22:21:29.058 INFO:teuthology.orchestra.run.smithi040.stdout: rados osd op timeout = 900 2023-09-30T22:21:29.123 INFO:teuthology.orchestra.run.smithi158.stdout:[global] 2023-09-30T22:21:29.123 INFO:teuthology.orchestra.run.smithi158.stdout: chdir = "" 2023-09-30T22:21:29.124 INFO:teuthology.orchestra.run.smithi158.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-30T22:21:29.124 INFO:teuthology.orchestra.run.smithi158.stdout: auth supported = cephx 2023-09-30T22:21:29.124 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:21:29.124 INFO:teuthology.orchestra.run.smithi158.stdout: filestore xattr use omap = true 2023-09-30T22:21:29.124 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:21:29.124 INFO:teuthology.orchestra.run.smithi158.stdout: mon clock drift allowed = 1.000 2023-09-30T22:21:29.124 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:21:29.124 INFO:teuthology.orchestra.run.smithi158.stdout: osd crush chooseleaf type = 0 2023-09-30T22:21:29.124 INFO:teuthology.orchestra.run.smithi158.stdout: auth debug = true 2023-09-30T22:21:29.124 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:21:29.124 INFO:teuthology.orchestra.run.smithi158.stdout: ms die on old message = true 2023-09-30T22:21:29.124 INFO:teuthology.orchestra.run.smithi158.stdout: ms die on bug = true 2023-09-30T22:21:29.125 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:21:29.125 INFO:teuthology.orchestra.run.smithi158.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-30T22:21:29.125 INFO:teuthology.orchestra.run.smithi158.stdout: mon pg warn max object skew = 0 2023-09-30T22:21:29.125 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:21:29.125 INFO:teuthology.orchestra.run.smithi158.stdout: # disable pg_autoscaler by default for new pools 2023-09-30T22:21:29.125 INFO:teuthology.orchestra.run.smithi158.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-30T22:21:29.125 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:21:29.125 INFO:teuthology.orchestra.run.smithi158.stdout: osd pool default size = 2 2023-09-30T22:21:29.125 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:21:29.125 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd allow primary affinity = true 2023-09-30T22:21:29.125 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd allow pg remap = true 2023-09-30T22:21:29.125 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on legacy crush tunables = false 2023-09-30T22:21:29.126 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on crush straw calc version zero = false 2023-09-30T22:21:29.126 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on no sortbitwise = false 2023-09-30T22:21:29.126 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on osd down out interval zero = false 2023-09-30T22:21:29.126 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on too few osds = false 2023-09-30T22:21:29.126 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-30T22:21:29.126 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-30T22:21:29.126 INFO:teuthology.orchestra.run.smithi158.stdout: mon_allow_pool_size_one = true 2023-09-30T22:21:29.126 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:21:29.126 INFO:teuthology.orchestra.run.smithi158.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-30T22:21:29.126 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:21:29.126 INFO:teuthology.orchestra.run.smithi158.stdout: osd default data pool replay window = 5 2023-09-30T22:21:29.127 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:21:29.127 INFO:teuthology.orchestra.run.smithi158.stdout: mon allow pool delete = true 2023-09-30T22:21:29.127 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:21:29.127 INFO:teuthology.orchestra.run.smithi158.stdout: mon cluster log file level = debug 2023-09-30T22:21:29.127 INFO:teuthology.orchestra.run.smithi158.stdout: debug asserts on shutdown = true 2023-09-30T22:21:29.127 INFO:teuthology.orchestra.run.smithi158.stdout: mon health detail to clog = false 2023-09-30T22:21:29.127 INFO:teuthology.orchestra.run.smithi158.stdout: mon host = "172.21.15.40,[v2:172.21.15.40:3301,v1:172.21.15.40:6790],[v2:172.21.15.40:3302,v1:172.21.15.40:6791]" 2023-09-30T22:21:29.127 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on pool no app = False 2023-09-30T22:21:29.127 INFO:teuthology.orchestra.run.smithi158.stdout: ms bind msgr2 = False 2023-09-30T22:21:29.127 INFO:teuthology.orchestra.run.smithi158.stdout: bluestore warn on legacy statfs = False 2023-09-30T22:21:29.127 INFO:teuthology.orchestra.run.smithi158.stdout: bluestore warn on no per pool omap = False 2023-09-30T22:21:29.127 INFO:teuthology.orchestra.run.smithi158.stdout: mon pg warn min per osd = 0 2023-09-30T22:21:29.127 INFO:teuthology.orchestra.run.smithi158.stdout: ms die on skipped message = False 2023-09-30T22:21:29.128 INFO:teuthology.orchestra.run.smithi158.stdout: fsid = 79dd4d8e-f295-4d9c-bd93-9850863800e3 2023-09-30T22:21:29.128 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:21:29.128 INFO:teuthology.orchestra.run.smithi158.stdout:[osd] 2023-09-30T22:21:29.128 INFO:teuthology.orchestra.run.smithi158.stdout: osd journal size = 100 2023-09-30T22:21:29.128 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:21:29.128 INFO:teuthology.orchestra.run.smithi158.stdout: osd scrub load threshold = 5.0 2023-09-30T22:21:29.128 INFO:teuthology.orchestra.run.smithi158.stdout: osd scrub max interval = 600 2023-09-30T22:21:29.128 INFO:teuthology.orchestra.run.smithi158.stdout: osd mclock profile = high_recovery_ops 2023-09-30T22:21:29.128 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:21:29.128 INFO:teuthology.orchestra.run.smithi158.stdout: osd recover clone overlap = true 2023-09-30T22:21:29.128 INFO:teuthology.orchestra.run.smithi158.stdout: osd recovery max chunk = 1048576 2023-09-30T22:21:29.128 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:21:29.129 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug shutdown = true 2023-09-30T22:21:29.129 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug op order = true 2023-09-30T22:21:29.129 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug verify stray on activate = true 2023-09-30T22:21:29.129 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:21:29.129 INFO:teuthology.orchestra.run.smithi158.stdout: osd open classes on start = true 2023-09-30T22:21:29.129 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug pg log writeout = true 2023-09-30T22:21:29.129 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:21:29.129 INFO:teuthology.orchestra.run.smithi158.stdout: osd deep scrub update digest min age = 30 2023-09-30T22:21:29.129 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:21:29.129 INFO:teuthology.orchestra.run.smithi158.stdout: osd map max advance = 10 2023-09-30T22:21:29.129 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:21:29.129 INFO:teuthology.orchestra.run.smithi158.stdout: journal zero on create = true 2023-09-30T22:21:29.130 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:21:29.130 INFO:teuthology.orchestra.run.smithi158.stdout: filestore ondisk finisher threads = 3 2023-09-30T22:21:29.130 INFO:teuthology.orchestra.run.smithi158.stdout: filestore apply finisher threads = 3 2023-09-30T22:21:29.130 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:21:29.130 INFO:teuthology.orchestra.run.smithi158.stdout: bdev debug aio = true 2023-09-30T22:21:29.130 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug misdirected ops = true 2023-09-30T22:21:29.130 INFO:teuthology.orchestra.run.smithi158.stdout: bdev async discard = True 2023-09-30T22:21:29.130 INFO:teuthology.orchestra.run.smithi158.stdout: bdev enable discard = True 2023-09-30T22:21:29.130 INFO:teuthology.orchestra.run.smithi158.stdout: bluestore allocator = bitmap 2023-09-30T22:21:29.130 INFO:teuthology.orchestra.run.smithi158.stdout: bluestore block size = 96636764160 2023-09-30T22:21:29.130 INFO:teuthology.orchestra.run.smithi158.stdout: bluestore fsck on mount = True 2023-09-30T22:21:29.130 INFO:teuthology.orchestra.run.smithi158.stdout: debug bluefs = 1/20 2023-09-30T22:21:29.131 INFO:teuthology.orchestra.run.smithi158.stdout: debug bluestore = 1/20 2023-09-30T22:21:29.131 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2023-09-30T22:21:29.131 INFO:teuthology.orchestra.run.smithi158.stdout: debug osd = 20 2023-09-30T22:21:29.131 INFO:teuthology.orchestra.run.smithi158.stdout: debug rocksdb = 4/10 2023-09-30T22:21:29.131 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd backfillfull_ratio = 0.85 2023-09-30T22:21:29.131 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd full ratio = 0.9 2023-09-30T22:21:29.131 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd nearfull ratio = 0.8 2023-09-30T22:21:29.131 INFO:teuthology.orchestra.run.smithi158.stdout: osd failsafe full ratio = 0.95 2023-09-30T22:21:29.131 INFO:teuthology.orchestra.run.smithi158.stdout: osd objectstore = bluestore 2023-09-30T22:21:29.131 INFO:teuthology.orchestra.run.smithi158.stdout: osd op complaint time = 180 2023-09-30T22:21:29.131 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:21:29.131 INFO:teuthology.orchestra.run.smithi158.stdout:[mgr] 2023-09-30T22:21:29.132 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2023-09-30T22:21:29.132 INFO:teuthology.orchestra.run.smithi158.stdout: debug mgr = 20 2023-09-30T22:21:29.132 INFO:teuthology.orchestra.run.smithi158.stdout: debug mon = 20 2023-09-30T22:21:29.132 INFO:teuthology.orchestra.run.smithi158.stdout: debug auth = 20 2023-09-30T22:21:29.132 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min pgs per osd = 4 2023-09-30T22:21:29.132 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min bytes per osd = 10 2023-09-30T22:21:29.132 INFO:teuthology.orchestra.run.smithi158.stdout: mgr/telemetry/nag = false 2023-09-30T22:21:29.132 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:21:29.132 INFO:teuthology.orchestra.run.smithi158.stdout:[mon] 2023-09-30T22:21:29.132 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2023-09-30T22:21:29.132 INFO:teuthology.orchestra.run.smithi158.stdout: debug mon = 20 2023-09-30T22:21:29.132 INFO:teuthology.orchestra.run.smithi158.stdout: debug paxos = 20 2023-09-30T22:21:29.133 INFO:teuthology.orchestra.run.smithi158.stdout: debug auth = 20 2023-09-30T22:21:29.133 INFO:teuthology.orchestra.run.smithi158.stdout: mon data avail warn = 5 2023-09-30T22:21:29.133 INFO:teuthology.orchestra.run.smithi158.stdout: mon mgr mkfs grace = 240 2023-09-30T22:21:29.133 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min pgs per osd = 4 2023-09-30T22:21:29.133 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd reporter subtree level = osd 2023-09-30T22:21:29.133 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd prime pg temp = true 2023-09-30T22:21:29.133 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min bytes per osd = 10 2023-09-30T22:21:29.133 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:21:29.133 INFO:teuthology.orchestra.run.smithi158.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-30T22:21:29.133 INFO:teuthology.orchestra.run.smithi158.stdout: auth mon ticket ttl = 660 # 11m 2023-09-30T22:21:29.133 INFO:teuthology.orchestra.run.smithi158.stdout: auth service ticket ttl = 240 # 4m 2023-09-30T22:21:29.133 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:21:29.133 INFO:teuthology.orchestra.run.smithi158.stdout: # don't complain about insecure global_id in the test suite 2023-09-30T22:21:29.134 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-30T22:21:29.134 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-30T22:21:29.134 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:21:29.134 INFO:teuthology.orchestra.run.smithi158.stdout: # 1m isn't quite enough 2023-09-30T22:21:29.134 INFO:teuthology.orchestra.run.smithi158.stdout: mon_down_mkfs_grace = 2m 2023-09-30T22:21:29.134 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:21:29.134 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_filestore_osds = false 2023-09-30T22:21:29.134 INFO:teuthology.orchestra.run.smithi158.stdout: mon op complaint time = 120 2023-09-30T22:21:29.134 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on osd down out interval zero = False 2023-09-30T22:21:29.134 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-30T22:21:29.134 INFO:teuthology.orchestra.run.smithi158.stdout:[client] 2023-09-30T22:21:29.134 INFO:teuthology.orchestra.run.smithi158.stdout: rgw cache enabled = true 2023-09-30T22:21:29.135 INFO:teuthology.orchestra.run.smithi158.stdout: rgw enable ops log = true 2023-09-30T22:21:29.135 INFO:teuthology.orchestra.run.smithi158.stdout: rgw enable usage log = true 2023-09-30T22:21:29.135 INFO:teuthology.orchestra.run.smithi158.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-30T22:21:29.135 INFO:teuthology.orchestra.run.smithi158.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-30T22:21:29.135 INFO:teuthology.orchestra.run.smithi158.stdout: client mount timeout = 600 2023-09-30T22:21:29.135 INFO:teuthology.orchestra.run.smithi158.stdout: debug client = 20 2023-09-30T22:21:29.135 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2023-09-30T22:21:29.135 INFO:teuthology.orchestra.run.smithi158.stdout: rados mon op timeout = 900 2023-09-30T22:21:29.135 INFO:teuthology.orchestra.run.smithi158.stdout: rados osd op timeout = 900 2023-09-30T22:21:29.135 INFO:teuthology.orchestra.run.smithi158.stdout:[mon.a] 2023-09-30T22:21:29.135 INFO:teuthology.orchestra.run.smithi158.stdout:[mon.b] 2023-09-30T22:21:29.135 INFO:teuthology.orchestra.run.smithi158.stdout:[mon.c] 2023-09-30T22:21:29.135 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.a] 2023-09-30T22:21:29.136 INFO:teuthology.orchestra.run.smithi158.stdout:[mds] 2023-09-30T22:21:29.136 INFO:teuthology.orchestra.run.smithi158.stdout: debug mds = 20 2023-09-30T22:21:29.136 INFO:teuthology.orchestra.run.smithi158.stdout: debug mds balancer = 20 2023-09-30T22:21:29.136 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2023-09-30T22:21:29.136 INFO:teuthology.orchestra.run.smithi158.stdout: mds debug frag = True 2023-09-30T22:21:29.136 INFO:teuthology.orchestra.run.smithi158.stdout: mds debug scatterstat = True 2023-09-30T22:21:29.136 INFO:teuthology.orchestra.run.smithi158.stdout: mds op complaint time = 180 2023-09-30T22:21:29.136 INFO:teuthology.orchestra.run.smithi158.stdout: mds verify scatter = True 2023-09-30T22:21:29.136 INFO:teuthology.orchestra.run.smithi158.stdout: osd op complaint time = 180 2023-09-30T22:21:29.136 INFO:teuthology.orchestra.run.smithi158.stdout: rados mon op timeout = 900 2023-09-30T22:21:29.136 INFO:teuthology.orchestra.run.smithi158.stdout: rados osd op timeout = 900 2023-09-30T22:21:29.153 INFO:tasks.ceph:Creating admin key on mon.a... 2023-09-30T22:21:29.153 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-09-30T22:21:29.207 INFO:tasks.ceph:Copying monmap to all nodes... 2023-09-30T22:21:29.207 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-09-30T22:21:29.208 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-09-30T22:21:29.226 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-09-30T22:21:29.226 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-09-30T22:21:29.284 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi040.front.sepia.ceph.com 2023-09-30T22:21:29.284 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-09-30T22:21:29.285 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-30T22:21:29.285 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-30T22:21:29.361 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-09-30T22:21:29.361 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:21:29.419 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi158.front.sepia.ceph.com 2023-09-30T22:21:29.419 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-09-30T22:21:29.420 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-30T22:21:29.420 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-30T22:21:29.518 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-09-30T22:21:29.518 DEBUG:teuthology.orchestra.run.smithi158:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:21:29.607 INFO:tasks.ceph:Setting up mon nodes... 2023-09-30T22:21:29.689 INFO:tasks.ceph:Setting up mgr nodes... 2023-09-30T22:21:29.690 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-09-30T22:21:29.750 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-09-30T22:21:29.752 INFO:tasks.ceph:Setting up mds nodes... 2023-09-30T22:21:29.752 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-09-30T22:21:29.804 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-09-30T22:21:29.806 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-09-30T22:21:29.840 INFO:tasks.ceph_client:Setting up client nodes... 2023-09-30T22:21:29.840 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-09-30T22:21:30.108 INFO:teuthology.orchestra.run.smithi158.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-09-30T22:21:30.138 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-09-30T22:21:30.138 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi040.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2023-09-30T22:21:30.138 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-09-30T22:21:30.168 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-30T22:21:30.168 INFO:tasks.ceph:role: osd.0 2023-09-30T22:21:30.168 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi040.front.sepia.ceph.com 2023-09-30T22:21:30.168 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-30T22:21:30.244 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T22:21:30.245 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T22:21:30.245 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T22:21:30.245 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-30T22:21:30.245 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T22:21:30.245 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-09-30T22:21:30.245 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T22:21:30.245 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T22:21:30.245 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T22:21:30.245 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T22:21:30.663 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2023-09-30T22:21:30.665 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-09-30T22:21:30.665 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-09-30T22:21:30.852 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-09-30T22:21:30.897 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-09-30T22:21:30.929 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-30T22:21:30.930 INFO:tasks.ceph:role: osd.1 2023-09-30T22:21:30.930 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi040.front.sepia.ceph.com 2023-09-30T22:21:30.930 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-09-30T22:21:31.008 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T22:21:31.009 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T22:21:31.009 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T22:21:31.009 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-30T22:21:31.009 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T22:21:31.009 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-09-30T22:21:31.009 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T22:21:31.009 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T22:21:31.009 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T22:21:31.009 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T22:21:31.434 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2023-09-30T22:21:31.436 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-09-30T22:21:31.436 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-09-30T22:21:31.546 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-09-30T22:21:31.582 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-09-30T22:21:31.653 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-30T22:21:31.653 INFO:tasks.ceph:role: osd.2 2023-09-30T22:21:31.653 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi040.front.sepia.ceph.com 2023-09-30T22:21:31.653 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-09-30T22:21:31.731 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T22:21:31.731 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T22:21:31.731 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T22:21:31.732 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-30T22:21:31.732 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T22:21:31.732 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-09-30T22:21:31.732 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T22:21:31.732 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T22:21:31.732 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T22:21:31.732 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T22:21:32.180 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2023-09-30T22:21:32.182 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-09-30T22:21:32.182 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-09-30T22:21:32.360 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-09-30T22:21:32.399 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-09-30T22:21:32.471 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-30T22:21:32.471 INFO:tasks.ceph:role: osd.3 2023-09-30T22:21:32.471 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi040.front.sepia.ceph.com 2023-09-30T22:21:32.471 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-09-30T22:21:32.551 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T22:21:32.551 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T22:21:32.551 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T22:21:32.551 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-30T22:21:32.551 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T22:21:32.551 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-09-30T22:21:32.551 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T22:21:32.551 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T22:21:32.551 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T22:21:32.551 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T22:21:32.973 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2023-09-30T22:21:32.975 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-09-30T22:21:32.976 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-09-30T22:21:33.138 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-09-30T22:21:33.177 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:21:33.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:33.266+0000 7f13960bd200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-09-30T22:21:33.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:33.266+0000 7f13960bd200 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-09-30T22:21:33.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:33.266+0000 7f13960bd200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-30T22:21:33.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:33.266+0000 7f13960bd200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-30T22:21:33.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:33.266+0000 7f13960bd200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-30T22:21:33.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:33.266+0000 7f13960bd200 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-09-30T22:21:36.124 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-09-30T22:21:36.158 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:21:36.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:36.248+0000 7f1c583f1200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-09-30T22:21:36.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:36.249+0000 7f1c583f1200 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-09-30T22:21:36.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:36.249+0000 7f1c583f1200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-30T22:21:36.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:36.249+0000 7f1c583f1200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-30T22:21:36.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:36.249+0000 7f1c583f1200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-30T22:21:36.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:36.249+0000 7f1c583f1200 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-09-30T22:21:39.101 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-09-30T22:21:39.135 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:21:39.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:39.225+0000 7f00188b7200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-09-30T22:21:39.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:39.225+0000 7f00188b7200 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-09-30T22:21:39.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:39.225+0000 7f00188b7200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-30T22:21:39.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:39.226+0000 7f00188b7200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-30T22:21:39.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:39.226+0000 7f00188b7200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-30T22:21:39.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:39.226+0000 7f00188b7200 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-09-30T22:21:42.083 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-09-30T22:21:42.117 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:21:42.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:42.206+0000 7f533e7d3200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-09-30T22:21:42.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:42.206+0000 7f533e7d3200 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-09-30T22:21:42.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:42.207+0000 7f533e7d3200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-30T22:21:42.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:42.207+0000 7f533e7d3200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-30T22:21:42.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:42.207+0000 7f533e7d3200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-30T22:21:42.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:42.207+0000 7f533e7d3200 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-09-30T22:21:45.048 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-09-30T22:21:45.080 INFO:tasks.ceph:Reading keys from all nodes... 2023-09-30T22:21:45.081 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-09-30T22:21:45.081 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-09-30T22:21:45.151 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-09-30T22:21:45.152 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-09-30T22:21:45.222 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-09-30T22:21:45.223 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-09-30T22:21:45.301 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-09-30T22:21:45.301 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-09-30T22:21:45.377 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-09-30T22:21:45.377 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-09-30T22:21:45.449 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-09-30T22:21:45.449 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-09-30T22:21:45.520 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-09-30T22:21:45.521 DEBUG:teuthology.orchestra.run.smithi158:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-09-30T22:21:45.573 INFO:tasks.ceph:Adding keys to all mons... 2023-09-30T22:21:45.573 DEBUG:teuthology.orchestra.run.smithi040:> sudo tee -a /etc/ceph/ceph.keyring 2023-09-30T22:21:45.603 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr.x] 2023-09-30T22:21:45.603 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBpnxhlWl7FLBAAlh6Nj7buFOvU1bhnFwwGMg== 2023-09-30T22:21:45.603 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.a] 2023-09-30T22:21:45.603 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBpnxhlfc/+LxAAOuuxAhCASl5mSnWq2whrFA== 2023-09-30T22:21:45.603 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.0] 2023-09-30T22:21:45.603 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBtnxhlrEDsDxAAeyEm8yU0qIidYwaXxZXrbQ== 2023-09-30T22:21:45.603 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.1] 2023-09-30T22:21:45.604 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBwnxhlE1TlDhAAs7F+OkWqWi4C25SGjg8f6A== 2023-09-30T22:21:45.604 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.2] 2023-09-30T22:21:45.604 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBznxhltCuFDRAANEXYQKkMUX8aS6WY3ygujQ== 2023-09-30T22:21:45.604 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.3] 2023-09-30T22:21:45.604 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQB2nxhlK/diDBAAEqxO3KciNcrIuWgOejPSQQ== 2023-09-30T22:21:45.604 INFO:teuthology.orchestra.run.smithi040.stdout:[client.0] 2023-09-30T22:21:45.604 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBqnxhlu+6ABhAAxuZp9ppsasWkHk1wFRl/uQ== 2023-09-30T22:21:45.606 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-30T22:21:45.699 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-30T22:21:45.753 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T22:21:45.804 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T22:21:45.855 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T22:21:45.905 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T22:21:45.956 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-30T22:21:46.010 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-09-30T22:21:46.010 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-09-30T22:21:46.038 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-30T22:21:46.133 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-09-30T22:21:46.160 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-09-30T22:21:46.228 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-30T22:21:46.323 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-09-30T22:21:46.351 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-09-30T22:21:46.420 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-30T22:21:46.517 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-09-30T22:21:46.545 DEBUG:teuthology.orchestra.run.smithi040:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:21:46.604 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-09-30T22:21:46.604 INFO:tasks.ceph.mon.a:Restarting daemon 2023-09-30T22:21:46.604 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-09-30T22:21:46.646 INFO:tasks.ceph.mon.a:Started 2023-09-30T22:21:46.647 INFO:tasks.ceph.mon.b:Restarting daemon 2023-09-30T22:21:46.647 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-09-30T22:21:46.649 INFO:tasks.ceph.mon.b:Started 2023-09-30T22:21:46.649 INFO:tasks.ceph.mon.c:Restarting daemon 2023-09-30T22:21:46.649 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-09-30T22:21:46.651 INFO:tasks.ceph.mon.c:Started 2023-09-30T22:21:46.651 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-09-30T22:21:46.651 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-09-30T22:21:46.652 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-09-30T22:21:46.654 INFO:tasks.ceph.mgr.x:Started 2023-09-30T22:21:46.654 INFO:tasks.ceph:Setting crush tunables to default 2023-09-30T22:21:46.654 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd crush tunables default 2023-09-30T22:21:46.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:46.798+0000 7f81948dc700 1 Processor -- start 2023-09-30T22:21:46.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:46.798+0000 7f81948dc700 1 -- start start 2023-09-30T22:21:46.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:46.799+0000 7f81948dc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8190065140 0x7f8190096640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:46.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:46.799+0000 7f81948dc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8190096b30 0x7f8190096f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:46.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:46.799+0000 7f81948dc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f819012f8d0 0x7f8190131cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:46.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:46.799+0000 7f81948dc700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8190064940 con 0x7f8190096b30 2023-09-30T22:21:46.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:46.799+0000 7f81948dc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8190092ed0 con 0x7f819012f8d0 2023-09-30T22:21:46.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:46.799+0000 7f81948dc700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8190092c90 con 0x7f8190065140 2023-09-30T22:21:46.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:46.799+0000 7f818dd9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8190096b30 0x7f8190096f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:46.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:46.799+0000 7f818e59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8190065140 0x7f8190096640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:46.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:46.799+0000 7f818dd9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8190096b30 0x7f8190096f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56062/0 (socket says 172.21.15.40:56062) 2023-09-30T22:21:46.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:46.799+0000 7f818e59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8190065140 0x7f8190096640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52202/0 (socket says 172.21.15.40:52202) 2023-09-30T22:21:46.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:46.799+0000 7f818dd9b700 1 -- 172.21.15.40:0/1774319515 learned_addr learned my addr 172.21.15.40:0/1774319515 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:21:46.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:46.799+0000 7f818ed9d700 1 --2- 172.21.15.40:0/1774319515 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f819012f8d0 0x7f8190131cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:46.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:46.799+0000 7f818dd9b700 1 -- 172.21.15.40:0/1774319515 >> v2:172.21.15.40:3300/0 conn(0x7f8190096b30 msgr2=0x7f8190096f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-30T22:21:46.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:46.799+0000 7f818e59c700 1 -- 172.21.15.40:0/1774319515 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8190065140 msgr2=0x7f8190096640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-30T22:21:46.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:46.799+0000 7f818dd9b700 1 -- 172.21.15.40:0/1774319515 >> v2:172.21.15.40:3300/0 conn(0x7f8190096b30 msgr2=0x7f8190096f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:21:46.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:46.799+0000 7f818e59c700 1 -- 172.21.15.40:0/1774319515 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8190065140 msgr2=0x7f8190096640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:21:46.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:46.799+0000 7f818e59c700 1 --2- 172.21.15.40:0/1774319515 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8190065140 0x7f8190096640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:21:46.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:46.799+0000 7f818dd9b700 1 --2- 172.21.15.40:0/1774319515 >> v2:172.21.15.40:3300/0 conn(0x7f8190096b30 0x7f8190096f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:21:46.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:46.799+0000 7f818e59c700 1 --2- 172.21.15.40:0/1774319515 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8190065140 0x7f8190096640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-09-30T22:21:46.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:46.799+0000 7f818dd9b700 1 --2- 172.21.15.40:0/1774319515 >> v2:172.21.15.40:3300/0 conn(0x7f8190096b30 0x7f8190096f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-09-30T22:21:46.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:46.799+0000 7f818ed9d700 1 -- 172.21.15.40:0/1774319515 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f819012f8d0 msgr2=0x7f8190131cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-09-30T22:21:46.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:46.799+0000 7f818ed9d700 1 -- 172.21.15.40:0/1774319515 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f819012f8d0 msgr2=0x7f8190131cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:21:46.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:46.799+0000 7f818ed9d700 1 --2- 172.21.15.40:0/1774319515 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f819012f8d0 0x7f8190131cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:21:46.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:46.799+0000 7f818ed9d700 1 --2- 172.21.15.40:0/1774319515 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f819012f8d0 0x7f8190131cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-09-30T22:21:47.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.000+0000 7f818e59c700 1 --2- 172.21.15.40:0/1774319515 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8190065140 0x7f8190096640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:47.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.000+0000 7f818dd9b700 1 --2- 172.21.15.40:0/1774319515 >> v2:172.21.15.40:3300/0 conn(0x7f8190096b30 0x7f8190096f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:47.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.000+0000 7f818ed9d700 1 --2- 172.21.15.40:0/1774319515 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f819012f8d0 0x7f8190131cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:47.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.000+0000 7f818dd9b700 1 -- 172.21.15.40:0/1774319515 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8190065140 msgr2=0x7f8190096640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:47.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.000+0000 7f818dd9b700 1 --2- 172.21.15.40:0/1774319515 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8190065140 0x7f8190096640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.000+0000 7f818dd9b700 1 -- 172.21.15.40:0/1774319515 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f819012f8d0 msgr2=0x7f8190131cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:47.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.000+0000 7f818dd9b700 1 --2- 172.21.15.40:0/1774319515 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f819012f8d0 0x7f8190131cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.000+0000 7f818dd9b700 1 -- 172.21.15.40:0/1774319515 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8190098490 con 0x7f8190096b30 2023-09-30T22:21:47.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.000+0000 7f818dd9b700 1 --2- 172.21.15.40:0/1774319515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8190096b30 0x7f8190096f50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f8190092a70 tx=0x7f8184008040).ready entity=mon.0 client_cookie=d03775db915aca04 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:47.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.000+0000 7f818d59a700 1 -- 172.21.15.40:0/1774319515 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81840104f0 con 0x7f8190096b30 2023-09-30T22:21:47.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.000+0000 7f818d59a700 1 -- 172.21.15.40:0/1774319515 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8184010650 con 0x7f8190096b30 2023-09-30T22:21:47.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.000+0000 7f818d59a700 1 -- 172.21.15.40:0/1774319515 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81840109d0 con 0x7f8190096b30 2023-09-30T22:21:47.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.001+0000 7f81948dc700 1 -- 172.21.15.40:0/1774319515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8190096b30 msgr2=0x7f8190096f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.001+0000 7f81948dc700 1 --2- 172.21.15.40:0/1774319515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8190096b30 0x7f8190096f50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f8190092a70 tx=0x7f8184008040).stop 2023-09-30T22:21:47.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.001+0000 7f81948dc700 1 -- 172.21.15.40:0/1774319515 shutdown_connections 2023-09-30T22:21:47.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.001+0000 7f81948dc700 1 --2- 172.21.15.40:0/1774319515 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8190065140 0x7f8190096640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.001+0000 7f81948dc700 1 --2- 172.21.15.40:0/1774319515 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f819012f8d0 0x7f8190131cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.001+0000 7f81948dc700 1 --2- 172.21.15.40:0/1774319515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8190096b30 0x7f8190096f50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.001+0000 7f81948dc700 1 -- 172.21.15.40:0/1774319515 >> 172.21.15.40:0/1774319515 conn(0x7f819009bcf0 msgr2=0x7f819009c100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:47.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.001+0000 7f81948dc700 1 -- 172.21.15.40:0/1774319515 shutdown_connections 2023-09-30T22:21:47.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.001+0000 7f81948dc700 1 -- 172.21.15.40:0/1774319515 wait complete. 2023-09-30T22:21:47.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.003+0000 7f81948dc700 1 Processor -- start 2023-09-30T22:21:47.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.003+0000 7f81948dc700 1 -- start start 2023-09-30T22:21:47.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.003+0000 7f81948dc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8190065140 0x7f819011d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:47.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.003+0000 7f81948dc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8190096b30 0x7f819011a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:47.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.004+0000 7f81948dc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f819012f8d0 0x7f819011aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:47.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.004+0000 7f81948dc700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819011d990 con 0x7f8190096b30 2023-09-30T22:21:47.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.004+0000 7f81948dc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8190097cc0 con 0x7f8190065140 2023-09-30T22:21:47.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.004+0000 7f81948dc700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f819011e3c0 con 0x7f819012f8d0 2023-09-30T22:21:47.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.004+0000 7f818dd9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8190096b30 0x7f819011a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:47.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.004+0000 7f818ed9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f819012f8d0 0x7f819011aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:47.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.004+0000 7f818dd9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8190096b30 0x7f819011a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56100/0 (socket says 172.21.15.40:56100) 2023-09-30T22:21:47.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.004+0000 7f818dd9b700 1 -- 172.21.15.40:0/1018831236 learned_addr learned my addr 172.21.15.40:0/1018831236 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:21:47.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.004+0000 7f818e59c700 1 --2- 172.21.15.40:0/1018831236 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8190065140 0x7f819011d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:47.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.004+0000 7f818dd9b700 1 -- 172.21.15.40:0/1018831236 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f819012f8d0 msgr2=0x7f819011aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.004+0000 7f818dd9b700 1 --2- 172.21.15.40:0/1018831236 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f819012f8d0 0x7f819011aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.004+0000 7f818dd9b700 1 -- 172.21.15.40:0/1018831236 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8190065140 msgr2=0x7f819011d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.004+0000 7f818dd9b700 1 --2- 172.21.15.40:0/1018831236 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8190065140 0x7f819011d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.004+0000 7f818dd9b700 1 -- 172.21.15.40:0/1018831236 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818400e040 con 0x7f8190096b30 2023-09-30T22:21:47.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.004+0000 7f818dd9b700 1 --2- 172.21.15.40:0/1018831236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8190096b30 0x7f819011a560 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f8184006e70 tx=0x7f8190065040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:47.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.004+0000 7f817e7fc700 1 -- 172.21.15.40:0/1018831236 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8184010e00 con 0x7f8190096b30 2023-09-30T22:21:47.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.004+0000 7f817e7fc700 1 -- 172.21.15.40:0/1018831236 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8184013b40 con 0x7f8190096b30 2023-09-30T22:21:47.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.004+0000 7f81948dc700 1 -- 172.21.15.40:0/1018831236 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f819011c7a0 con 0x7f8190096b30 2023-09-30T22:21:47.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.004+0000 7f817e7fc700 1 -- 172.21.15.40:0/1018831236 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818401e420 con 0x7f8190096b30 2023-09-30T22:21:47.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.004+0000 7f81948dc700 1 -- 172.21.15.40:0/1018831236 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f819011c100 con 0x7f8190096b30 2023-09-30T22:21:47.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.005+0000 7f817e7fc700 1 -- 172.21.15.40:0/1018831236 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f818401ea70 con 0x7f8190096b30 2023-09-30T22:21:47.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.005+0000 7f817e7fc700 1 -- 172.21.15.40:0/1018831236 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f81840287b0 con 0x7f8190096b30 2023-09-30T22:21:47.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.005+0000 7f81948dc700 1 -- 172.21.15.40:0/1018831236 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f819005a260 con 0x7f8190096b30 2023-09-30T22:21:47.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.008+0000 7f817e7fc700 1 -- 172.21.15.40:0/1018831236 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f8184018070 con 0x7f8190096b30 2023-09-30T22:21:47.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.080+0000 7f81948dc700 1 -- 172.21.15.40:0/1018831236 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f819011b360 con 0x7f8190096b30 2023-09-30T22:21:47.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.090+0000 7f817e7fc700 1 -- 172.21.15.40:0/1018831236 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f8184028b30 con 0x7f8190096b30 2023-09-30T22:21:47.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.091+0000 7f81948dc700 1 -- 172.21.15.40:0/1018831236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8190096b30 msgr2=0x7f819011a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.091+0000 7f81948dc700 1 --2- 172.21.15.40:0/1018831236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8190096b30 0x7f819011a560 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f8184006e70 tx=0x7f8190065040).stop 2023-09-30T22:21:47.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.091+0000 7f81948dc700 1 -- 172.21.15.40:0/1018831236 shutdown_connections 2023-09-30T22:21:47.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.091+0000 7f81948dc700 1 --2- 172.21.15.40:0/1018831236 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f819012f8d0 0x7f819011aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.091+0000 7f81948dc700 1 --2- 172.21.15.40:0/1018831236 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8190065140 0x7f819011d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.091+0000 7f81948dc700 1 --2- 172.21.15.40:0/1018831236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8190096b30 0x7f819011a560 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.091+0000 7f81948dc700 1 -- 172.21.15.40:0/1018831236 >> 172.21.15.40:0/1018831236 conn(0x7f819009bcf0 msgr2=0x7f8190069880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:47.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.091+0000 7f81948dc700 1 -- 172.21.15.40:0/1018831236 shutdown_connections 2023-09-30T22:21:47.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.091+0000 7f81948dc700 1 -- 172.21.15.40:0/1018831236 wait complete. 2023-09-30T22:21:47.093 INFO:teuthology.orchestra.run.smithi040.stderr:adjusted tunables profile to default 2023-09-30T22:21:47.103 INFO:tasks.ceph:check_enable_crimson: False 2023-09-30T22:21:47.104 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-09-30T22:21:47.104 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-09-30T22:21:47.104 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-09-30T22:21:47.131 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-09-30T22:21:47.132 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-09-30T22:21:47.142 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:21:47.142+0000 7f623e81a680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-30T22:21:47.169 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-09-30T22:21:47.170 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-09-30T22:21:47.217 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:21:47.216+0000 7f623e81a680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-30T22:21:47.236 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-09-30T22:21:47.237 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-09-30T22:21:47.305 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new 771f785c-f464-4b17-936c-cbf31b1153e0 0 2023-09-30T22:21:47.306 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:21:47.306+0000 7f623e81a680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-30T22:21:47.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.426+0000 7ff8ab60e700 1 Processor -- start 2023-09-30T22:21:47.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.426+0000 7ff8ab60e700 1 -- start start 2023-09-30T22:21:47.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.427+0000 7ff8ab60e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff8a412aff0 0x7ff8a412b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:47.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.427+0000 7ff8ab60e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff8a412b8c0 0x7ff8a4095e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:47.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.427+0000 7ff8ab60e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8a4096300 0x7ff8a4096780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:47.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.427+0000 7ff8ab60e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8a4066ea0 con 0x7ff8a412aff0 2023-09-30T22:21:47.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.427+0000 7ff8ab60e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a4096c70 con 0x7ff8a4096300 2023-09-30T22:21:47.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.427+0000 7ff8ab60e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a40685b0 con 0x7ff8a412b8c0 2023-09-30T22:21:47.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.427+0000 7ff8a8ba9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff8a412b8c0 0x7ff8a4095e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:47.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.427+0000 7ff8a9bab700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8a4096300 0x7ff8a4096780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:47.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.427+0000 7ff8a8ba9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff8a412b8c0 0x7ff8a4095e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52242/0 (socket says 172.21.15.40:52242) 2023-09-30T22:21:47.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.427+0000 7ff8a9bab700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8a4096300 0x7ff8a4096780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60862/0 (socket says 172.21.15.40:60862) 2023-09-30T22:21:47.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.427+0000 7ff8a8ba9700 1 -- 172.21.15.40:0/3444473523 learned_addr learned my addr 172.21.15.40:0/3444473523 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:21:47.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.427+0000 7ff8a93aa700 1 --2- 172.21.15.40:0/3444473523 >> v2:172.21.15.40:3300/0 conn(0x7ff8a412aff0 0x7ff8a412b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:47.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.427+0000 7ff8a9bab700 1 -- 172.21.15.40:0/3444473523 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff8a412b8c0 msgr2=0x7ff8a4095e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:47.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.427+0000 7ff8a9bab700 1 --2- 172.21.15.40:0/3444473523 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff8a412b8c0 0x7ff8a4095e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.427+0000 7ff8a9bab700 1 -- 172.21.15.40:0/3444473523 >> v2:172.21.15.40:3300/0 conn(0x7ff8a412aff0 msgr2=0x7ff8a412b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:47.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.427+0000 7ff8a9bab700 1 --2- 172.21.15.40:0/3444473523 >> v2:172.21.15.40:3300/0 conn(0x7ff8a412aff0 0x7ff8a412b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.427+0000 7ff8a9bab700 1 -- 172.21.15.40:0/3444473523 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a4067700 con 0x7ff8a4096300 2023-09-30T22:21:47.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.427+0000 7ff8a93aa700 1 --2- 172.21.15.40:0/3444473523 >> v2:172.21.15.40:3300/0 conn(0x7ff8a412aff0 0x7ff8a412b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:47.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.427+0000 7ff8a8ba9700 1 --2- 172.21.15.40:0/3444473523 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff8a412b8c0 0x7ff8a4095e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:47.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.428+0000 7ff8a9bab700 1 --2- 172.21.15.40:0/3444473523 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8a4096300 0x7ff8a4096780 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7ff89c009e90 tx=0x7ff89c009780).ready entity=mon.1 client_cookie=50a92746e00008dc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:47.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.428+0000 7ff89bfff700 1 -- 172.21.15.40:0/3444473523 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c00e070 con 0x7ff8a4096300 2023-09-30T22:21:47.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.428+0000 7ff89bfff700 1 -- 172.21.15.40:0/3444473523 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89c00ba70 con 0x7ff8a4096300 2023-09-30T22:21:47.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.428+0000 7ff89bfff700 1 -- 172.21.15.40:0/3444473523 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c00bdf0 con 0x7ff8a4096300 2023-09-30T22:21:47.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.428+0000 7ff8ab60e700 1 -- 172.21.15.40:0/3444473523 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8a4096300 msgr2=0x7ff8a4096780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.428+0000 7ff8ab60e700 1 --2- 172.21.15.40:0/3444473523 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8a4096300 0x7ff8a4096780 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7ff89c009e90 tx=0x7ff89c009780).stop 2023-09-30T22:21:47.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.428+0000 7ff8ab60e700 1 -- 172.21.15.40:0/3444473523 shutdown_connections 2023-09-30T22:21:47.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.428+0000 7ff8ab60e700 1 --2- 172.21.15.40:0/3444473523 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8a4096300 0x7ff8a4096780 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.428+0000 7ff8ab60e700 1 --2- 172.21.15.40:0/3444473523 >> v2:172.21.15.40:3300/0 conn(0x7ff8a412aff0 0x7ff8a412b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.428+0000 7ff8ab60e700 1 --2- 172.21.15.40:0/3444473523 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff8a412b8c0 0x7ff8a4095e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.428+0000 7ff8ab60e700 1 -- 172.21.15.40:0/3444473523 >> 172.21.15.40:0/3444473523 conn(0x7ff8a405eb30 msgr2=0x7ff8a409a380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:47.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.428+0000 7ff8ab60e700 1 -- 172.21.15.40:0/3444473523 shutdown_connections 2023-09-30T22:21:47.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.428+0000 7ff8ab60e700 1 -- 172.21.15.40:0/3444473523 wait complete. 2023-09-30T22:21:47.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.429+0000 7ff8ab60e700 1 Processor -- start 2023-09-30T22:21:47.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.429+0000 7ff8ab60e700 1 -- start start 2023-09-30T22:21:47.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.430+0000 7ff8ab60e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8a4096300 0x7ff8a413a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:47.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.430+0000 7ff8ab60e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8a412aff0 0x7ff8a413ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:47.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.430+0000 7ff8ab60e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff8a412b8c0 0x7ff8a4115c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:47.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.430+0000 7ff8ab60e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a40670b0 con 0x7ff8a412aff0 2023-09-30T22:21:47.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.430+0000 7ff8ab60e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a41193d0 con 0x7ff8a4096300 2023-09-30T22:21:47.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.430+0000 7ff8ab60e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a412f530 con 0x7ff8a412b8c0 2023-09-30T22:21:47.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.430+0000 7ff8a8ba9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8a412aff0 0x7ff8a413ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:47.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.430+0000 7ff8a8ba9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8a412aff0 0x7ff8a413ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56116/0 (socket says 172.21.15.40:56116) 2023-09-30T22:21:47.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.430+0000 7ff8a8ba9700 1 -- 172.21.15.40:0/4019789234 learned_addr learned my addr 172.21.15.40:0/4019789234 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:21:47.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.430+0000 7ff8a93aa700 1 --2- 172.21.15.40:0/4019789234 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8a4096300 0x7ff8a413a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:47.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.430+0000 7ff8a9bab700 1 --2- 172.21.15.40:0/4019789234 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff8a412b8c0 0x7ff8a4115c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:47.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.430+0000 7ff8a8ba9700 1 -- 172.21.15.40:0/4019789234 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff8a412b8c0 msgr2=0x7ff8a4115c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.430+0000 7ff8a8ba9700 1 --2- 172.21.15.40:0/4019789234 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff8a412b8c0 0x7ff8a4115c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.430+0000 7ff8a8ba9700 1 -- 172.21.15.40:0/4019789234 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8a4096300 msgr2=0x7ff8a413a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.430+0000 7ff8a8ba9700 1 --2- 172.21.15.40:0/4019789234 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8a4096300 0x7ff8a413a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.430+0000 7ff8a8ba9700 1 -- 172.21.15.40:0/4019789234 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a00092a0 con 0x7ff8a412aff0 2023-09-30T22:21:47.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.430+0000 7ff8a8ba9700 1 --2- 172.21.15.40:0/4019789234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8a412aff0 0x7ff8a413ac80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7ff89400ea20 tx=0x7ff8940090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:47.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.431+0000 7ff8997fa700 1 -- 172.21.15.40:0/4019789234 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89400ee60 con 0x7ff8a412aff0 2023-09-30T22:21:47.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.431+0000 7ff8997fa700 1 -- 172.21.15.40:0/4019789234 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89400c7f0 con 0x7ff8a412aff0 2023-09-30T22:21:47.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.431+0000 7ff8ab60e700 1 -- 172.21.15.40:0/4019789234 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff894009370 con 0x7ff8a412aff0 2023-09-30T22:21:47.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.431+0000 7ff8997fa700 1 -- 172.21.15.40:0/4019789234 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89400cb70 con 0x7ff8a412aff0 2023-09-30T22:21:47.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.431+0000 7ff8ab60e700 1 -- 172.21.15.40:0/4019789234 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff89c009a20 con 0x7ff8a412aff0 2023-09-30T22:21:47.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.431+0000 7ff8997fa700 1 -- 172.21.15.40:0/4019789234 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7ff89401b660 con 0x7ff8a412aff0 2023-09-30T22:21:47.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.431+0000 7ff8997fa700 1 -- 172.21.15.40:0/4019789234 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7ff894012740 con 0x7ff8a412aff0 2023-09-30T22:21:47.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.432+0000 7ff8ab60e700 1 -- 172.21.15.40:0/4019789234 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8a4096a70 con 0x7ff8a412aff0 2023-09-30T22:21:47.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.434+0000 7ff8997fa700 1 -- 172.21.15.40:0/4019789234 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7ff89403ae50 con 0x7ff8a412aff0 2023-09-30T22:21:47.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.514+0000 7ff8ab60e700 1 -- 172.21.15.40:0/4019789234 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd new", "uuid": "771f785c-f464-4b17-936c-cbf31b1153e0", "id": 0} v 0) v1 -- 0x7ff8a405a260 con 0x7ff8a412aff0 2023-09-30T22:21:47.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.524+0000 7ff8997fa700 1 -- 172.21.15.40:0/4019789234 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "771f785c-f464-4b17-936c-cbf31b1153e0", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff894029030 con 0x7ff8a412aff0 2023-09-30T22:21:47.524 INFO:teuthology.orchestra.run.smithi040.stdout:0 2023-09-30T22:21:47.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.524+0000 7ff8ab60e700 1 -- 172.21.15.40:0/4019789234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8a412aff0 msgr2=0x7ff8a413ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.524+0000 7ff8ab60e700 1 --2- 172.21.15.40:0/4019789234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8a412aff0 0x7ff8a413ac80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7ff89400ea20 tx=0x7ff8940090f0).stop 2023-09-30T22:21:47.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.525+0000 7ff8ab60e700 1 -- 172.21.15.40:0/4019789234 shutdown_connections 2023-09-30T22:21:47.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.525+0000 7ff8ab60e700 1 --2- 172.21.15.40:0/4019789234 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff8a412b8c0 0x7ff8a4115c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.525+0000 7ff8ab60e700 1 --2- 172.21.15.40:0/4019789234 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8a4096300 0x7ff8a413a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.525+0000 7ff8ab60e700 1 --2- 172.21.15.40:0/4019789234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8a412aff0 0x7ff8a413ac80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.525+0000 7ff8ab60e700 1 -- 172.21.15.40:0/4019789234 >> 172.21.15.40:0/4019789234 conn(0x7ff8a405eb30 msgr2=0x7ff8a412e270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:47.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.525+0000 7ff8ab60e700 1 -- 172.21.15.40:0/4019789234 shutdown_connections 2023-09-30T22:21:47.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.525+0000 7ff8ab60e700 1 -- 172.21.15.40:0/4019789234 wait complete. 2023-09-30T22:21:47.536 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new 45f1e2e8-5310-4219-ab54-424e7440fcea 1 2023-09-30T22:21:47.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.656+0000 7f69ef12c700 1 Processor -- start 2023-09-30T22:21:47.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.656+0000 7f69ef12c700 1 -- start start 2023-09-30T22:21:47.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.657+0000 7f69ef12c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f69e80657e0 0x7f69e8096620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:47.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.657+0000 7f69ef12c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f69e8097ec0 0x7f69e8096b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:47.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.657+0000 7f69ef12c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69e8097000 0x7f69e8131650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:47.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.657+0000 7f69ef12c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e8098350 con 0x7f69e80657e0 2023-09-30T22:21:47.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.657+0000 7f69ef12c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e80662b0 con 0x7f69e8097000 2023-09-30T22:21:47.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.657+0000 7f69ef12c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69e8065bc0 con 0x7f69e8097ec0 2023-09-30T22:21:47.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.657+0000 7f69ed6c9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69e8097000 0x7f69e8131650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:47.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.657+0000 7f69e7fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f69e8097ec0 0x7f69e8096b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:47.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.657+0000 7f69ecec8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f69e80657e0 0x7f69e8096620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:47.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.657+0000 7f69ed6c9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69e8097000 0x7f69e8131650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60876/0 (socket says 172.21.15.40:60876) 2023-09-30T22:21:47.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.657+0000 7f69ed6c9700 1 -- 172.21.15.40:0/524484646 learned_addr learned my addr 172.21.15.40:0/524484646 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:21:47.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.657+0000 7f69e7fff700 1 -- 172.21.15.40:0/524484646 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69e8097000 msgr2=0x7f69e8131650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:47.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.657+0000 7f69e7fff700 1 --2- 172.21.15.40:0/524484646 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69e8097000 0x7f69e8131650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.657+0000 7f69e7fff700 1 -- 172.21.15.40:0/524484646 >> v2:172.21.15.40:3300/0 conn(0x7f69e80657e0 msgr2=0x7f69e8096620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:47.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.657+0000 7f69e7fff700 1 --2- 172.21.15.40:0/524484646 >> v2:172.21.15.40:3300/0 conn(0x7f69e80657e0 0x7f69e8096620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.657+0000 7f69e7fff700 1 -- 172.21.15.40:0/524484646 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e8096350 con 0x7f69e8097ec0 2023-09-30T22:21:47.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.657+0000 7f69ecec8700 1 --2- 172.21.15.40:0/524484646 >> v2:172.21.15.40:3300/0 conn(0x7f69e80657e0 0x7f69e8096620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:47.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.657+0000 7f69ed6c9700 1 --2- 172.21.15.40:0/524484646 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69e8097000 0x7f69e8131650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:47.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.657+0000 7f69e7fff700 1 --2- 172.21.15.40:0/524484646 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f69e8097ec0 0x7f69e8096b10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f69d4009760 tx=0x7f69d4009060).ready entity=mon.2 client_cookie=e2c6655413370108 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:47.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.657+0000 7f69e77fe700 1 -- 172.21.15.40:0/524484646 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d40090d0 con 0x7f69e8097ec0 2023-09-30T22:21:47.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.657+0000 7f69e77fe700 1 -- 172.21.15.40:0/524484646 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d400d4a0 con 0x7f69e8097ec0 2023-09-30T22:21:47.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.657+0000 7f69e77fe700 1 -- 172.21.15.40:0/524484646 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d400d820 con 0x7f69e8097ec0 2023-09-30T22:21:47.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.658+0000 7f69ef12c700 1 -- 172.21.15.40:0/524484646 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f69e8097ec0 msgr2=0x7f69e8096b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.658+0000 7f69ef12c700 1 --2- 172.21.15.40:0/524484646 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f69e8097ec0 0x7f69e8096b10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f69d4009760 tx=0x7f69d4009060).stop 2023-09-30T22:21:47.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.658+0000 7f69ef12c700 1 -- 172.21.15.40:0/524484646 shutdown_connections 2023-09-30T22:21:47.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.658+0000 7f69ef12c700 1 --2- 172.21.15.40:0/524484646 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69e8097000 0x7f69e8131650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.658+0000 7f69ef12c700 1 --2- 172.21.15.40:0/524484646 >> v2:172.21.15.40:3300/0 conn(0x7f69e80657e0 0x7f69e8096620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.658+0000 7f69ef12c700 1 --2- 172.21.15.40:0/524484646 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f69e8097ec0 0x7f69e8096b10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.658+0000 7f69ef12c700 1 -- 172.21.15.40:0/524484646 >> 172.21.15.40:0/524484646 conn(0x7f69e809de50 msgr2=0x7f69e809e260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:47.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.658+0000 7f69ef12c700 1 -- 172.21.15.40:0/524484646 shutdown_connections 2023-09-30T22:21:47.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.658+0000 7f69ef12c700 1 -- 172.21.15.40:0/524484646 wait complete. 2023-09-30T22:21:47.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.659+0000 7f69ef12c700 1 Processor -- start 2023-09-30T22:21:47.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.659+0000 7f69ef12c700 1 -- start start 2023-09-30T22:21:47.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.660+0000 7f69ef12c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69e80657e0 0x7f69e813a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:47.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.660+0000 7f69ef12c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69e8097000 0x7f69e813a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:47.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.660+0000 7f69ef12c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f69e813ad70 0x7f69e811ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:47.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.660+0000 7f69ef12c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e8099d70 con 0x7f69e8097000 2023-09-30T22:21:47.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.660+0000 7f69ef12c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e809cd30 con 0x7f69e80657e0 2023-09-30T22:21:47.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.660+0000 7f69ef12c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69e813b190 con 0x7f69e813ad70 2023-09-30T22:21:47.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.660+0000 7f69ecec8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69e80657e0 0x7f69e813a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:47.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.660+0000 7f69ed6c9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f69e813ad70 0x7f69e811ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:47.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.660+0000 7f69ecec8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69e80657e0 0x7f69e813a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60880/0 (socket says 172.21.15.40:60880) 2023-09-30T22:21:47.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.660+0000 7f69ecec8700 1 -- 172.21.15.40:0/2944467924 learned_addr learned my addr 172.21.15.40:0/2944467924 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:21:47.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.660+0000 7f69ed6c9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f69e813ad70 0x7f69e811ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52262/0 (socket says 172.21.15.40:52262) 2023-09-30T22:21:47.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.660+0000 7f69e7fff700 1 --2- 172.21.15.40:0/2944467924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69e8097000 0x7f69e813a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:47.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.660+0000 7f69ecec8700 1 -- 172.21.15.40:0/2944467924 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f69e813ad70 msgr2=0x7f69e811ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.660+0000 7f69ecec8700 1 --2- 172.21.15.40:0/2944467924 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f69e813ad70 0x7f69e811ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.660+0000 7f69ecec8700 1 -- 172.21.15.40:0/2944467924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69e8097000 msgr2=0x7f69e813a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.660+0000 7f69ecec8700 1 --2- 172.21.15.40:0/2944467924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69e8097000 0x7f69e813a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.660+0000 7f69ecec8700 1 -- 172.21.15.40:0/2944467924 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69dc0092a0 con 0x7f69e80657e0 2023-09-30T22:21:47.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.660+0000 7f69ed6c9700 1 --2- 172.21.15.40:0/2944467924 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f69e813ad70 0x7f69e811ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:47.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.661+0000 7f69ecec8700 1 --2- 172.21.15.40:0/2944467924 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69e80657e0 0x7f69e813a390 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f69dc00ea50 tx=0x7f69dc009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:47.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.661+0000 7f69e4ff9700 1 -- 172.21.15.40:0/2944467924 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc00ee90 con 0x7f69e80657e0 2023-09-30T22:21:47.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.661+0000 7f69e4ff9700 1 -- 172.21.15.40:0/2944467924 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69dc00c850 con 0x7f69e80657e0 2023-09-30T22:21:47.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.661+0000 7f69ef12c700 1 -- 172.21.15.40:0/2944467924 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e0009ae0 con 0x7f69e80657e0 2023-09-30T22:21:47.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.661+0000 7f69e4ff9700 1 -- 172.21.15.40:0/2944467924 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc00cbd0 con 0x7f69e80657e0 2023-09-30T22:21:47.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.661+0000 7f69ef12c700 1 -- 172.21.15.40:0/2944467924 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d40092a0 con 0x7f69e80657e0 2023-09-30T22:21:47.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.662+0000 7f69e4ff9700 1 -- 172.21.15.40:0/2944467924 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f69dc01b660 con 0x7f69e80657e0 2023-09-30T22:21:47.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.662+0000 7f69e4ff9700 1 -- 172.21.15.40:0/2944467924 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f69dc0127b0 con 0x7f69e80657e0 2023-09-30T22:21:47.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.662+0000 7f69ef12c700 1 -- 172.21.15.40:0/2944467924 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e805a260 con 0x7f69e80657e0 2023-09-30T22:21:47.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.664+0000 7f69e4ff9700 1 -- 172.21.15.40:0/2944467924 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f69dc03ae50 con 0x7f69e80657e0 2023-09-30T22:21:47.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.747+0000 7f69ef12c700 1 -- 172.21.15.40:0/2944467924 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd new", "uuid": "45f1e2e8-5310-4219-ab54-424e7440fcea", "id": 1} v 0) v1 -- 0x7f69e8099a50 con 0x7f69e80657e0 2023-09-30T22:21:47.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.753+0000 7f69e4ff9700 1 -- 172.21.15.40:0/2944467924 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "45f1e2e8-5310-4219-ab54-424e7440fcea", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f69dc029030 con 0x7f69e80657e0 2023-09-30T22:21:47.753 INFO:teuthology.orchestra.run.smithi040.stdout:1 2023-09-30T22:21:47.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.754+0000 7f69ef12c700 1 -- 172.21.15.40:0/2944467924 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69e80657e0 msgr2=0x7f69e813a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.754+0000 7f69ef12c700 1 --2- 172.21.15.40:0/2944467924 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69e80657e0 0x7f69e813a390 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f69dc00ea50 tx=0x7f69dc009060).stop 2023-09-30T22:21:47.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.754+0000 7f69ef12c700 1 -- 172.21.15.40:0/2944467924 shutdown_connections 2023-09-30T22:21:47.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.754+0000 7f69ef12c700 1 --2- 172.21.15.40:0/2944467924 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f69e813ad70 0x7f69e811ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.754+0000 7f69ef12c700 1 --2- 172.21.15.40:0/2944467924 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69e80657e0 0x7f69e813a390 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.754+0000 7f69ef12c700 1 --2- 172.21.15.40:0/2944467924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69e8097000 0x7f69e813a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.754+0000 7f69ef12c700 1 -- 172.21.15.40:0/2944467924 >> 172.21.15.40:0/2944467924 conn(0x7f69e809de50 msgr2=0x7f69e809bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:47.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.754+0000 7f69ef12c700 1 -- 172.21.15.40:0/2944467924 shutdown_connections 2023-09-30T22:21:47.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.754+0000 7f69ef12c700 1 -- 172.21.15.40:0/2944467924 wait complete. 2023-09-30T22:21:47.766 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new 7ba62ae5-d21e-4d56-b46c-ba7b718ede25 2 2023-09-30T22:21:47.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.887+0000 7fb36553e700 1 Processor -- start 2023-09-30T22:21:47.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.887+0000 7fb36553e700 1 -- start start 2023-09-30T22:21:47.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.887+0000 7fb36553e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb36012e050 0x7fb360130440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:47.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.887+0000 7fb36553e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb360130930 0x7fb360132d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:47.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.887+0000 7fb36553e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3600685b0 con 0x7fb36012aff0 2023-09-30T22:21:47.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.887+0000 7fb36553e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb360067700 con 0x7fb36012e050 2023-09-30T22:21:47.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.887+0000 7fb36553e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb36012add0 con 0x7fb360130930 2023-09-30T22:21:47.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.887+0000 7fb35effd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb36012aff0 0x7fb36012b3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47206/0 (socket says 172.21.15.40:47206) 2023-09-30T22:21:47.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.888+0000 7fb35effd700 1 -- 172.21.15.40:0/1373933870 learned_addr learned my addr 172.21.15.40:0/1373933870 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:21:47.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.888+0000 7fb35f7fe700 1 --2- 172.21.15.40:0/1373933870 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb360130930 0x7fb360132d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:47.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.888+0000 7fb35e7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb36012e050 0x7fb360130440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:47.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.888+0000 7fb35dffb700 1 -- 172.21.15.40:0/1373933870 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 268774600 0 0) 0x7fb3600685b0 con 0x7fb36012aff0 2023-09-30T22:21:47.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.888+0000 7fb35dffb700 1 -- 172.21.15.40:0/1373933870 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3480033f0 con 0x7fb36012aff0 2023-09-30T22:21:47.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.888+0000 7fb35e7fc700 1 -- 172.21.15.40:0/1373933870 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb360130930 msgr2=0x7fb360132d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:47.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.888+0000 7fb35e7fc700 1 --2- 172.21.15.40:0/1373933870 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb360130930 0x7fb360132d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.888+0000 7fb35e7fc700 1 -- 172.21.15.40:0/1373933870 >> v1:172.21.15.40:6789/0 conn(0x7fb36012aff0 legacy=0x7fb36012b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.888+0000 7fb35e7fc700 1 -- 172.21.15.40:0/1373933870 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3600673b0 con 0x7fb36012e050 2023-09-30T22:21:47.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.888+0000 7fb35e7fc700 1 --2- 172.21.15.40:0/1373933870 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb36012e050 0x7fb360130440 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fb354009790 tx=0x7fb354009060).ready entity=mon.1 client_cookie=782976ccf3c901c2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:47.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.888+0000 7fb35dffb700 1 -- 172.21.15.40:0/1373933870 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35400f510 con 0x7fb36012e050 2023-09-30T22:21:47.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.888+0000 7fb35dffb700 1 -- 172.21.15.40:0/1373933870 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb35400f670 con 0x7fb36012e050 2023-09-30T22:21:47.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.888+0000 7fb35dffb700 1 -- 172.21.15.40:0/1373933870 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35400f9f0 con 0x7fb36012e050 2023-09-30T22:21:47.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.889+0000 7fb36553e700 1 -- 172.21.15.40:0/1373933870 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb36012e050 msgr2=0x7fb360130440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.889+0000 7fb36553e700 1 --2- 172.21.15.40:0/1373933870 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb36012e050 0x7fb360130440 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fb354009790 tx=0x7fb354009060).stop 2023-09-30T22:21:47.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.889+0000 7fb36553e700 1 -- 172.21.15.40:0/1373933870 shutdown_connections 2023-09-30T22:21:47.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.889+0000 7fb36553e700 1 --2- 172.21.15.40:0/1373933870 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb360130930 0x7fb360132d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.889+0000 7fb36553e700 1 --2- 172.21.15.40:0/1373933870 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb36012e050 0x7fb360130440 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.889+0000 7fb36553e700 1 -- 172.21.15.40:0/1373933870 >> 172.21.15.40:0/1373933870 conn(0x7fb36005eb30 msgr2=0x7fb36009a380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:47.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.889+0000 7fb36553e700 1 -- 172.21.15.40:0/1373933870 shutdown_connections 2023-09-30T22:21:47.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.889+0000 7fb36553e700 1 -- 172.21.15.40:0/1373933870 wait complete. 2023-09-30T22:21:47.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.890+0000 7fb36553e700 1 Processor -- start 2023-09-30T22:21:47.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.890+0000 7fb36553e700 1 -- start start 2023-09-30T22:21:47.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.890+0000 7fb36553e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb36012aff0 0x7fb3601177f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:47.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.890+0000 7fb36553e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb36012e050 0x7fb360114890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:47.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.890+0000 7fb36553e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb360130930 0x7fb360114d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:47.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.890+0000 7fb36553e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb360115d30 con 0x7fb360130930 2023-09-30T22:21:47.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.890+0000 7fb36553e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3600670b0 con 0x7fb36012aff0 2023-09-30T22:21:47.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.890+0000 7fb36553e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb360118870 con 0x7fb36012e050 2023-09-30T22:21:47.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.890+0000 7fb35effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb36012aff0 0x7fb3601177f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:47.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.890+0000 7fb35f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb360130930 0x7fb360114d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:47.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.891+0000 7fb35effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb36012aff0 0x7fb3601177f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60898/0 (socket says 172.21.15.40:60898) 2023-09-30T22:21:47.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.891+0000 7fb35effd700 1 -- 172.21.15.40:0/236882520 learned_addr learned my addr 172.21.15.40:0/236882520 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:21:47.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.891+0000 7fb35e7fc700 1 --2- 172.21.15.40:0/236882520 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb36012e050 0x7fb360114890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:47.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.891+0000 7fb35effd700 1 -- 172.21.15.40:0/236882520 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb36012e050 msgr2=0x7fb360114890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.891+0000 7fb35effd700 1 --2- 172.21.15.40:0/236882520 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb36012e050 0x7fb360114890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.891+0000 7fb35effd700 1 -- 172.21.15.40:0/236882520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb360130930 msgr2=0x7fb360114d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.891+0000 7fb35effd700 1 --2- 172.21.15.40:0/236882520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb360130930 0x7fb360114d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.891+0000 7fb35effd700 1 -- 172.21.15.40:0/236882520 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3540092a0 con 0x7fb36012aff0 2023-09-30T22:21:47.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.891+0000 7fb35f7fe700 1 --2- 172.21.15.40:0/236882520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb360130930 0x7fb360114d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:47.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.891+0000 7fb35effd700 1 --2- 172.21.15.40:0/236882520 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb36012aff0 0x7fb3601177f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fb35000c450 tx=0x7fb350007c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:47.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.891+0000 7fb346ffd700 1 -- 172.21.15.40:0/236882520 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3500070d0 con 0x7fb36012aff0 2023-09-30T22:21:47.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.891+0000 7fb346ffd700 1 -- 172.21.15.40:0/236882520 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb350007230 con 0x7fb36012aff0 2023-09-30T22:21:47.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.891+0000 7fb346ffd700 1 -- 172.21.15.40:0/236882520 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3500075d0 con 0x7fb36012aff0 2023-09-30T22:21:47.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.891+0000 7fb36553e700 1 -- 172.21.15.40:0/236882520 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb360117dd0 con 0x7fb36012aff0 2023-09-30T22:21:47.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.891+0000 7fb36553e700 1 -- 172.21.15.40:0/236882520 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb360116460 con 0x7fb36012aff0 2023-09-30T22:21:47.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.892+0000 7fb346ffd700 1 -- 172.21.15.40:0/236882520 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fb350005c10 con 0x7fb36012aff0 2023-09-30T22:21:47.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.892+0000 7fb346ffd700 1 -- 172.21.15.40:0/236882520 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7fb350013c40 con 0x7fb36012aff0 2023-09-30T22:21:47.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.892+0000 7fb36553e700 1 -- 172.21.15.40:0/236882520 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb36005a260 con 0x7fb36012aff0 2023-09-30T22:21:47.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.895+0000 7fb346ffd700 1 -- 172.21.15.40:0/236882520 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fb350013810 con 0x7fb36012aff0 2023-09-30T22:21:47.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.976+0000 7fb36553e700 1 -- 172.21.15.40:0/236882520 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7ba62ae5-d21e-4d56-b46c-ba7b718ede25", "id": 2} v 0) v1 -- 0x7fb360115690 con 0x7fb36012aff0 2023-09-30T22:21:47.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.979+0000 7fb346ffd700 1 -- 172.21.15.40:0/236882520 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7ba62ae5-d21e-4d56-b46c-ba7b718ede25", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb350013a30 con 0x7fb36012aff0 2023-09-30T22:21:47.979 INFO:teuthology.orchestra.run.smithi040.stdout:2 2023-09-30T22:21:47.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.980+0000 7fb36553e700 1 -- 172.21.15.40:0/236882520 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb36012aff0 msgr2=0x7fb3601177f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.980+0000 7fb36553e700 1 --2- 172.21.15.40:0/236882520 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb36012aff0 0x7fb3601177f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fb35000c450 tx=0x7fb350007c80).stop 2023-09-30T22:21:47.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.980+0000 7fb36553e700 1 -- 172.21.15.40:0/236882520 shutdown_connections 2023-09-30T22:21:47.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.980+0000 7fb36553e700 1 --2- 172.21.15.40:0/236882520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb360130930 0x7fb360114d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.980+0000 7fb36553e700 1 --2- 172.21.15.40:0/236882520 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb36012aff0 0x7fb3601177f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.980+0000 7fb36553e700 1 --2- 172.21.15.40:0/236882520 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb36012e050 0x7fb360114890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:47.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.980+0000 7fb36553e700 1 -- 172.21.15.40:0/236882520 >> 172.21.15.40:0/236882520 conn(0x7fb36005eb30 msgr2=0x7fb360095e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:47.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.980+0000 7fb36553e700 1 -- 172.21.15.40:0/236882520 shutdown_connections 2023-09-30T22:21:47.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:47.980+0000 7fb36553e700 1 -- 172.21.15.40:0/236882520 wait complete. 2023-09-30T22:21:47.993 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new c9c55985-8a90-4927-a8fa-6a1fcec1cd3d 3 2023-09-30T22:21:48.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.112+0000 7f8c2f3f0700 1 Processor -- start 2023-09-30T22:21:48.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.112+0000 7f8c2f3f0700 1 -- start start 2023-09-30T22:21:48.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.112+0000 7f8c2f3f0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c2805e090 0x7f8c28127ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:48.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.112+0000 7f8c2f3f0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c281275e0 0x7f8c28127fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:48.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.113+0000 7f8c2f3f0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c281284c0 con 0x7f8c28095560 2023-09-30T22:21:48.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.113+0000 7f8c2f3f0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2805e470 con 0x7f8c281275e0 2023-09-30T22:21:48.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.113+0000 7f8c2f3f0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c28096cd0 con 0x7f8c2805e090 2023-09-30T22:21:48.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.113+0000 7f8c2d18c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c2805e090 0x7f8c28127ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:48.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.113+0000 7f8c2d98d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8c28095560 0x7f8c28095a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47210/0 (socket says 172.21.15.40:47210) 2023-09-30T22:21:48.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.113+0000 7f8c2d98d700 1 -- 172.21.15.40:0/4262374637 learned_addr learned my addr 172.21.15.40:0/4262374637 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:21:48.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.113+0000 7f8c2c98b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c281275e0 0x7f8c28127fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:48.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.113+0000 7f8c2d18c700 1 -- 172.21.15.40:0/4262374637 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c281275e0 msgr2=0x7f8c28127fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:48.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.113+0000 7f8c2d18c700 1 --2- 172.21.15.40:0/4262374637 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c281275e0 0x7f8c28127fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:48.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.113+0000 7f8c1ffff700 1 -- 172.21.15.40:0/4262374637 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913421000 0 0) 0x7f8c281284c0 con 0x7f8c28095560 2023-09-30T22:21:48.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.113+0000 7f8c2d18c700 1 -- 172.21.15.40:0/4262374637 >> v1:172.21.15.40:6789/0 conn(0x7f8c28095560 legacy=0x7f8c28095a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:48.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.113+0000 7f8c2d18c700 1 -- 172.21.15.40:0/4262374637 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c28092ba0 con 0x7f8c2805e090 2023-09-30T22:21:48.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.113+0000 7f8c2c98b700 1 --2- 172.21.15.40:0/4262374637 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c281275e0 0x7f8c28127fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:48.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.113+0000 7f8c2d18c700 1 --2- 172.21.15.40:0/4262374637 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c2805e090 0x7f8c28127ae0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f8c240097c0 tx=0x7f8c24009060).ready entity=mon.2 client_cookie=d3b90d02652973e3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:48.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.113+0000 7f8c1ffff700 1 -- 172.21.15.40:0/4262374637 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2400f510 con 0x7f8c2805e090 2023-09-30T22:21:48.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.113+0000 7f8c1ffff700 1 -- 172.21.15.40:0/4262374637 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2400f670 con 0x7f8c2805e090 2023-09-30T22:21:48.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.113+0000 7f8c1ffff700 1 -- 172.21.15.40:0/4262374637 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2400f9f0 con 0x7f8c2805e090 2023-09-30T22:21:48.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.114+0000 7f8c2f3f0700 1 -- 172.21.15.40:0/4262374637 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c2805e090 msgr2=0x7f8c28127ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:48.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.114+0000 7f8c2f3f0700 1 --2- 172.21.15.40:0/4262374637 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c2805e090 0x7f8c28127ae0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f8c240097c0 tx=0x7f8c24009060).stop 2023-09-30T22:21:48.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.114+0000 7f8c2f3f0700 1 -- 172.21.15.40:0/4262374637 shutdown_connections 2023-09-30T22:21:48.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.114+0000 7f8c2f3f0700 1 --2- 172.21.15.40:0/4262374637 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c2805e090 0x7f8c28127ae0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:48.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.114+0000 7f8c2f3f0700 1 --2- 172.21.15.40:0/4262374637 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c281275e0 0x7f8c28127fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:48.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.114+0000 7f8c2f3f0700 1 -- 172.21.15.40:0/4262374637 >> 172.21.15.40:0/4262374637 conn(0x7f8c2809ab40 msgr2=0x7f8c2809af50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:48.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.114+0000 7f8c2f3f0700 1 -- 172.21.15.40:0/4262374637 shutdown_connections 2023-09-30T22:21:48.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.114+0000 7f8c2f3f0700 1 -- 172.21.15.40:0/4262374637 wait complete. 2023-09-30T22:21:48.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.115+0000 7f8c2f3f0700 1 Processor -- start 2023-09-30T22:21:48.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.115+0000 7f8c2f3f0700 1 -- start start 2023-09-30T22:21:48.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.116+0000 7f8c2f3f0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c2805e090 0x7f8c28117af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:48.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.116+0000 7f8c2f3f0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c28095560 0x7f8c28113b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:48.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.116+0000 7f8c2f3f0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c281275e0 0x7f8c28114000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:48.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.116+0000 7f8c2f3f0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c28124c20 con 0x7f8c28095560 2023-09-30T22:21:48.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.116+0000 7f8c2f3f0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c28126ee0 con 0x7f8c281275e0 2023-09-30T22:21:48.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.116+0000 7f8c2f3f0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c28096e50 con 0x7f8c2805e090 2023-09-30T22:21:48.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.116+0000 7f8c2d98d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c281275e0 0x7f8c28114000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:48.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.116+0000 7f8c2d18c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c2805e090 0x7f8c28117af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:48.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.116+0000 7f8c2d18c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c2805e090 0x7f8c28117af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52292/0 (socket says 172.21.15.40:52292) 2023-09-30T22:21:48.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.116+0000 7f8c2d98d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c281275e0 0x7f8c28114000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60930/0 (socket says 172.21.15.40:60930) 2023-09-30T22:21:48.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.116+0000 7f8c2d18c700 1 -- 172.21.15.40:0/4045647681 learned_addr learned my addr 172.21.15.40:0/4045647681 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:21:48.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.116+0000 7f8c2c98b700 1 --2- 172.21.15.40:0/4045647681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c28095560 0x7f8c28113b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:48.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.117+0000 7f8c2d98d700 1 -- 172.21.15.40:0/4045647681 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c2805e090 msgr2=0x7f8c28117af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:48.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.117+0000 7f8c2d98d700 1 --2- 172.21.15.40:0/4045647681 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c2805e090 0x7f8c28117af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:48.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.117+0000 7f8c2d98d700 1 -- 172.21.15.40:0/4045647681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c28095560 msgr2=0x7f8c28113b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:48.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.117+0000 7f8c2d98d700 1 --2- 172.21.15.40:0/4045647681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c28095560 0x7f8c28113b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:48.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.117+0000 7f8c2d98d700 1 -- 172.21.15.40:0/4045647681 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c180092a0 con 0x7f8c281275e0 2023-09-30T22:21:48.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.117+0000 7f8c2d18c700 1 --2- 172.21.15.40:0/4045647681 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c2805e090 0x7f8c28117af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:48.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.117+0000 7f8c2c98b700 1 --2- 172.21.15.40:0/4045647681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c28095560 0x7f8c28113b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:48.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.117+0000 7f8c2d98d700 1 --2- 172.21.15.40:0/4045647681 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c281275e0 0x7f8c28114000 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f8c20002230 tx=0x7f8c20007eb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:48.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.117+0000 7f8c1d7fa700 1 -- 172.21.15.40:0/4045647681 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c20005d30 con 0x7f8c281275e0 2023-09-30T22:21:48.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.117+0000 7f8c1d7fa700 1 -- 172.21.15.40:0/4045647681 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c20005e90 con 0x7f8c281275e0 2023-09-30T22:21:48.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.117+0000 7f8c1d7fa700 1 -- 172.21.15.40:0/4045647681 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c20007360 con 0x7f8c281275e0 2023-09-30T22:21:48.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.117+0000 7f8c2f3f0700 1 -- 172.21.15.40:0/4045647681 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c240092a0 con 0x7f8c281275e0 2023-09-30T22:21:48.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.117+0000 7f8c2f3f0700 1 -- 172.21.15.40:0/4045647681 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c28114f10 con 0x7f8c281275e0 2023-09-30T22:21:48.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.117+0000 7f8c1d7fa700 1 -- 172.21.15.40:0/4045647681 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f8c2001d440 con 0x7f8c281275e0 2023-09-30T22:21:48.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.117+0000 7f8c1d7fa700 1 -- 172.21.15.40:0/4045647681 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f8c20013410 con 0x7f8c281275e0 2023-09-30T22:21:48.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.118+0000 7f8c2f3f0700 1 -- 172.21.15.40:0/4045647681 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c2805a260 con 0x7f8c281275e0 2023-09-30T22:21:48.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.120+0000 7f8c1d7fa700 1 -- 172.21.15.40:0/4045647681 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f8c2001d6f0 con 0x7f8c281275e0 2023-09-30T22:21:48.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.203+0000 7f8c2f3f0700 1 -- 172.21.15.40:0/4045647681 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c9c55985-8a90-4927-a8fa-6a1fcec1cd3d", "id": 3} v 0) v1 -- 0x7f8c28114910 con 0x7f8c281275e0 2023-09-30T22:21:48.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.207+0000 7f8c1d7fa700 1 -- 172.21.15.40:0/4045647681 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c9c55985-8a90-4927-a8fa-6a1fcec1cd3d", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8c2001d970 con 0x7f8c281275e0 2023-09-30T22:21:48.207 INFO:teuthology.orchestra.run.smithi040.stdout:3 2023-09-30T22:21:48.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.208+0000 7f8c2f3f0700 1 -- 172.21.15.40:0/4045647681 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c281275e0 msgr2=0x7f8c28114000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:48.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.208+0000 7f8c2f3f0700 1 --2- 172.21.15.40:0/4045647681 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c281275e0 0x7f8c28114000 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f8c20002230 tx=0x7f8c20007eb0).stop 2023-09-30T22:21:48.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.208+0000 7f8c2f3f0700 1 -- 172.21.15.40:0/4045647681 shutdown_connections 2023-09-30T22:21:48.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.208+0000 7f8c2f3f0700 1 --2- 172.21.15.40:0/4045647681 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c2805e090 0x7f8c28117af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:48.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.208+0000 7f8c2f3f0700 1 --2- 172.21.15.40:0/4045647681 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c281275e0 0x7f8c28114000 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:48.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.208+0000 7f8c2f3f0700 1 --2- 172.21.15.40:0/4045647681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c28095560 0x7f8c28113b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:48.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.208+0000 7f8c2f3f0700 1 -- 172.21.15.40:0/4045647681 >> 172.21.15.40:0/4045647681 conn(0x7f8c2809ab40 msgr2=0x7f8c28094350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:48.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.208+0000 7f8c2f3f0700 1 -- 172.21.15.40:0/4045647681 shutdown_connections 2023-09-30T22:21:48.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.208+0000 7f8c2f3f0700 1 -- 172.21.15.40:0/4045647681 wait complete. 2023-09-30T22:21:48.219 INFO:tasks.ceph.osd.0:Restarting daemon 2023-09-30T22:21:48.220 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-09-30T22:21:48.221 INFO:tasks.ceph.osd.0:Started 2023-09-30T22:21:48.222 INFO:tasks.ceph.osd.1:Restarting daemon 2023-09-30T22:21:48.222 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-09-30T22:21:48.223 INFO:tasks.ceph.osd.1:Started 2023-09-30T22:21:48.224 INFO:tasks.ceph.osd.2:Restarting daemon 2023-09-30T22:21:48.224 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-09-30T22:21:48.226 INFO:tasks.ceph.osd.2:Started 2023-09-30T22:21:48.226 INFO:tasks.ceph.osd.3:Restarting daemon 2023-09-30T22:21:48.226 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-09-30T22:21:48.228 INFO:tasks.ceph.osd.3:Started 2023-09-30T22:21:48.229 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:21:48.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.401+0000 7fd982b66700 1 Processor -- start 2023-09-30T22:21:48.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.401+0000 7fd982b66700 1 -- start start 2023-09-30T22:21:48.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.402+0000 7fd982b66700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd97c096450 0x7fd97c098c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:48.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.402+0000 7fd982b66700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd97c0958b0 0x7fd97c0990f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:48.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.402+0000 7fd982b66700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd97c09a640 con 0x7fd97c0995e0 2023-09-30T22:21:48.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.402+0000 7fd982b66700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd97c099a70 con 0x7fd97c0958b0 2023-09-30T22:21:48.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.402+0000 7fd982b66700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd97c096cf0 con 0x7fd97c096450 2023-09-30T22:21:48.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.402+0000 7fd980902700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd97c096450 0x7fd97c098c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:48.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.402+0000 7fd97bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd97c0958b0 0x7fd97c0990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:48.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.402+0000 7fd980902700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd97c096450 0x7fd97c098c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60976/0 (socket says 172.21.15.40:60976) 2023-09-30T22:21:48.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.402+0000 7fd980902700 1 -- 172.21.15.40:0/1562397511 learned_addr learned my addr 172.21.15.40:0/1562397511 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:21:48.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.403+0000 7fd980902700 1 -- 172.21.15.40:0/1562397511 >> v2:172.21.15.40:3300/0 conn(0x7fd97c0958b0 msgr2=0x7fd97c0990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:48.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.403+0000 7fd980902700 1 --2- 172.21.15.40:0/1562397511 >> v2:172.21.15.40:3300/0 conn(0x7fd97c0958b0 0x7fd97c0990f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:48.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.403+0000 7fd980902700 1 -- 172.21.15.40:0/1562397511 >> v1:172.21.15.40:6789/0 conn(0x7fd97c0995e0 legacy=0x7fd97c135e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:48.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.403+0000 7fd980902700 1 -- 172.21.15.40:0/1562397511 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd97c095fb0 con 0x7fd97c096450 2023-09-30T22:21:48.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.403+0000 7fd97bfff700 1 --2- 172.21.15.40:0/1562397511 >> v2:172.21.15.40:3300/0 conn(0x7fd97c0958b0 0x7fd97c0990f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:21:48.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.403+0000 7fd980902700 1 --2- 172.21.15.40:0/1562397511 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd97c096450 0x7fd97c098c00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fd970006fd0 tx=0x7fd9700090f0).ready entity=mon.1 client_cookie=b3d7bf00e31d7ef4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:48.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.404+0000 7fd97b7fe700 1 -- 172.21.15.40:0/1562397511 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97000b600 con 0x7fd97c096450 2023-09-30T22:21:48.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.404+0000 7fd97b7fe700 1 -- 172.21.15.40:0/1562397511 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97000b760 con 0x7fd97c096450 2023-09-30T22:21:48.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.404+0000 7fd97b7fe700 1 -- 172.21.15.40:0/1562397511 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97000bae0 con 0x7fd97c096450 2023-09-30T22:21:48.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.405+0000 7fd982b66700 1 -- 172.21.15.40:0/1562397511 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd97c096450 msgr2=0x7fd97c098c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:48.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.405+0000 7fd982b66700 1 --2- 172.21.15.40:0/1562397511 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd97c096450 0x7fd97c098c00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fd970006fd0 tx=0x7fd9700090f0).stop 2023-09-30T22:21:48.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.405+0000 7fd982b66700 1 -- 172.21.15.40:0/1562397511 shutdown_connections 2023-09-30T22:21:48.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.405+0000 7fd982b66700 1 --2- 172.21.15.40:0/1562397511 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd97c096450 0x7fd97c098c00 secure :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0x7fd970006fd0 tx=0x7fd9700090f0).stop 2023-09-30T22:21:48.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.405+0000 7fd982b66700 1 --2- 172.21.15.40:0/1562397511 >> v2:172.21.15.40:3300/0 conn(0x7fd97c0958b0 0x7fd97c0990f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:48.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.405+0000 7fd982b66700 1 -- 172.21.15.40:0/1562397511 >> 172.21.15.40:0/1562397511 conn(0x7fd97c09a970 msgr2=0x7fd97c09ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:48.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.406+0000 7fd982b66700 1 -- 172.21.15.40:0/1562397511 shutdown_connections 2023-09-30T22:21:48.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.406+0000 7fd982b66700 1 -- 172.21.15.40:0/1562397511 wait complete. 2023-09-30T22:21:48.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.407+0000 7fd982b66700 1 Processor -- start 2023-09-30T22:21:48.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.408+0000 7fd982b66700 1 -- start start 2023-09-30T22:21:48.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.408+0000 7fd982b66700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd97c0958b0 0x7fd97c0a66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:48.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.408+0000 7fd982b66700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd97c0995e0 0x7fd97c0a6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:48.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.408+0000 7fd982b66700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd97c0a5130 0x7fd97c0a55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:48.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.408+0000 7fd982b66700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97c1381c0 con 0x7fd97c0958b0 2023-09-30T22:21:48.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.408+0000 7fd982b66700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd97c0a3fb0 con 0x7fd97c0995e0 2023-09-30T22:21:48.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.408+0000 7fd982b66700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd97c0a4270 con 0x7fd97c0a5130 2023-09-30T22:21:48.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.409+0000 7fd97bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd97c0995e0 0x7fd97c0a6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:48.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.409+0000 7fd97bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd97c0995e0 0x7fd97c0a6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60982/0 (socket says 172.21.15.40:60982) 2023-09-30T22:21:48.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.409+0000 7fd97bfff700 1 -- 172.21.15.40:0/3068876562 learned_addr learned my addr 172.21.15.40:0/3068876562 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:21:48.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.409+0000 7fd97bfff700 1 -- 172.21.15.40:0/3068876562 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd97c0a5130 msgr2=0x7fd97c0a55b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:21:48.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.409+0000 7fd97bfff700 1 --2- 172.21.15.40:0/3068876562 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd97c0a5130 0x7fd97c0a55b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:21:48.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.409+0000 7fd97bfff700 1 -- 172.21.15.40:0/3068876562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd97c0958b0 msgr2=0x7fd97c0a66d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:21:48.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.409+0000 7fd97bfff700 1 --2- 172.21.15.40:0/3068876562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd97c0958b0 0x7fd97c0a66d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:21:48.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.409+0000 7fd97bfff700 1 -- 172.21.15.40:0/3068876562 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd970009370 con 0x7fd97c0995e0 2023-09-30T22:21:48.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.410+0000 7fd97bfff700 1 --2- 172.21.15.40:0/3068876562 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd97c0995e0 0x7fd97c0a6bc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fd96800c9d0 tx=0x7fd968008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:48.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.410+0000 7fd978ff9700 1 -- 172.21.15.40:0/3068876562 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd968007570 con 0x7fd97c0995e0 2023-09-30T22:21:48.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.410+0000 7fd978ff9700 1 -- 172.21.15.40:0/3068876562 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9680076d0 con 0x7fd97c0995e0 2023-09-30T22:21:48.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.410+0000 7fd978ff9700 1 -- 172.21.15.40:0/3068876562 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd968007a50 con 0x7fd97c0995e0 2023-09-30T22:21:48.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.410+0000 7fd982b66700 1 -- 172.21.15.40:0/3068876562 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd97c0a2dc0 con 0x7fd97c0995e0 2023-09-30T22:21:48.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.410+0000 7fd982b66700 1 -- 172.21.15.40:0/3068876562 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd97c0a4c30 con 0x7fd97c0995e0 2023-09-30T22:21:48.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.411+0000 7fd978ff9700 1 -- 172.21.15.40:0/3068876562 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fd96801b460 con 0x7fd97c0995e0 2023-09-30T22:21:48.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.411+0000 7fd978ff9700 1 -- 172.21.15.40:0/3068876562 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fd968011920 con 0x7fd97c0995e0 2023-09-30T22:21:48.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.412+0000 7fd982b66700 1 -- 172.21.15.40:0/3068876562 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd95c005120 con 0x7fd97c0995e0 2023-09-30T22:21:48.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.417+0000 7fd978ff9700 1 -- 172.21.15.40:0/3068876562 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fd96801b8f0 con 0x7fd97c0995e0 2023-09-30T22:21:48.472 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:21:48.472+0000 7f623e81a680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-30T22:21:48.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.507+0000 7fd982b66700 1 -- 172.21.15.40:0/3068876562 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd95c005ac0 con 0x7fd97c0995e0 2023-09-30T22:21:48.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.508+0000 7fd978ff9700 1 -- 172.21.15.40:0/3068876562 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4109 (secure 0 0 0) 0x7fd96801ba90 con 0x7fd97c0995e0 2023-09-30T22:21:48.508 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:21:48.508 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":6,"fsid":"79dd4d8e-f295-4d9c-bd93-9850863800e3","created":"2023-09-30T22:21:46.980357+0000","modified":"2023-09-30T22:21:48.205613+0000","last_up_change":"0.000000","last_in_change":"2023-09-30T22:21:48.205613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"771f785c-f464-4b17-936c-cbf31b1153e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"45f1e2e8-5310-4219-ab54-424e7440fcea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7ba62ae5-d21e-4d56-b46c-ba7b718ede25","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c9c55985-8a90-4927-a8fa-6a1fcec1cd3d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:21:48.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.509+0000 7fd982b66700 1 -- 172.21.15.40:0/3068876562 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd97c0995e0 msgr2=0x7fd97c0a6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:48.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.509+0000 7fd982b66700 1 --2- 172.21.15.40:0/3068876562 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd97c0995e0 0x7fd97c0a6bc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fd96800c9d0 tx=0x7fd968008040).stop 2023-09-30T22:21:48.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.509+0000 7fd982b66700 1 -- 172.21.15.40:0/3068876562 shutdown_connections 2023-09-30T22:21:48.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.509+0000 7fd982b66700 1 --2- 172.21.15.40:0/3068876562 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd97c0a5130 0x7fd97c0a55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:21:48.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.509+0000 7fd982b66700 1 --2- 172.21.15.40:0/3068876562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd97c0958b0 0x7fd97c0a66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:21:48.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.509+0000 7fd982b66700 1 --2- 172.21.15.40:0/3068876562 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd97c0995e0 0x7fd97c0a6bc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:48.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.509+0000 7fd982b66700 1 -- 172.21.15.40:0/3068876562 >> 172.21.15.40:0/3068876562 conn(0x7fd97c09a970 msgr2=0x7fd97c09c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:48.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.509+0000 7fd982b66700 1 -- 172.21.15.40:0/3068876562 shutdown_connections 2023-09-30T22:21:48.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:48.509+0000 7fd982b66700 1 -- 172.21.15.40:0/3068876562 wait complete. 2023-09-30T22:21:48.522 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-09-30T22:21:48.522 INFO:tasks.ceph:Waiting for OSDs to come up 2023-09-30T22:21:48.585 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:21:48.585+0000 7f623e81a680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-30T22:21:48.725 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:21:48.725+0000 7f623e81a680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-30T22:21:48.833 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-09-30T22:21:48.832+0000 7f605b711200 -1 Falling back to public interface 2023-09-30T22:21:48.834 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-09-30T22:21:48.834+0000 7ff327adb200 -1 Falling back to public interface 2023-09-30T22:21:48.850 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-09-30T22:21:48.850+0000 7f80f2c10200 -1 Falling back to public interface 2023-09-30T22:21:48.861 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-09-30T22:21:48.860+0000 7f3fe1425200 -1 Falling back to public interface 2023-09-30T22:21:48.925 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-30T22:21:49.044 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.037+0000 7f1c832ec700 1 Processor -- start 2023-09-30T22:21:49.044 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.037+0000 7f1c832ec700 1 -- start start 2023-09-30T22:21:49.045 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.038+0000 7f1c832ec700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c7c068960 0x7f1c7c068d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:49.045 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.038+0000 7f1c832ec700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1c7c069230 0x7f1c7c091a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:49.045 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.038+0000 7f1c832ec700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c7c091ef0 0x7f1c7c092370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:49.045 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.038+0000 7f1c832ec700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c7c0681e0 con 0x7f1c7c069230 2023-09-30T22:21:49.045 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.038+0000 7f1c832ec700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c092860 con 0x7f1c7c068960 2023-09-30T22:21:49.045 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.038+0000 7f1c832ec700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c068530 con 0x7f1c7c091ef0 2023-09-30T22:21:49.046 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.038+0000 7f1c81088700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c7c068960 0x7f1c7c068d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:49.046 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.038+0000 7f1c81889700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c7c091ef0 0x7f1c7c092370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:49.046 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.038+0000 7f1c80887700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1c7c069230 0x7f1c7c091a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:49.046 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.038+0000 7f1c81088700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c7c068960 0x7f1c7c068d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60996/0 (socket says 172.21.15.40:60996) 2023-09-30T22:21:49.047 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.038+0000 7f1c81889700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c7c091ef0 0x7f1c7c092370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52334/0 (socket says 172.21.15.40:52334) 2023-09-30T22:21:49.047 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.038+0000 7f1c81088700 1 -- 172.21.15.40:0/3129650490 learned_addr learned my addr 172.21.15.40:0/3129650490 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:21:49.047 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.038+0000 7f1c81088700 1 -- 172.21.15.40:0/3129650490 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c7c091ef0 msgr2=0x7f1c7c092370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:49.047 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.038+0000 7f1c81088700 1 --2- 172.21.15.40:0/3129650490 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c7c091ef0 0x7f1c7c092370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:49.047 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.038+0000 7f1c81088700 1 -- 172.21.15.40:0/3129650490 >> v2:172.21.15.40:3300/0 conn(0x7f1c7c069230 msgr2=0x7f1c7c091a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:49.048 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.038+0000 7f1c81088700 1 --2- 172.21.15.40:0/3129650490 >> v2:172.21.15.40:3300/0 conn(0x7f1c7c069230 0x7f1c7c091a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:49.048 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.038+0000 7f1c81088700 1 -- 172.21.15.40:0/3129650490 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c7c092be0 con 0x7f1c7c068960 2023-09-30T22:21:49.048 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.038+0000 7f1c80887700 1 --2- 172.21.15.40:0/3129650490 >> v2:172.21.15.40:3300/0 conn(0x7f1c7c069230 0x7f1c7c091a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:49.048 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.038+0000 7f1c81889700 1 --2- 172.21.15.40:0/3129650490 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c7c091ef0 0x7f1c7c092370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:49.049 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.038+0000 7f1c81088700 1 --2- 172.21.15.40:0/3129650490 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c7c068960 0x7f1c7c068d40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f1c78006fd0 tx=0x7f1c780090f0).ready entity=mon.1 client_cookie=8975d8fa8a1b4074 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:49.049 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.039+0000 7f1c73fff700 1 -- 172.21.15.40:0/3129650490 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7800f510 con 0x7f1c7c068960 2023-09-30T22:21:49.049 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.039+0000 7f1c73fff700 1 -- 172.21.15.40:0/3129650490 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7800f670 con 0x7f1c7c068960 2023-09-30T22:21:49.049 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.039+0000 7f1c73fff700 1 -- 172.21.15.40:0/3129650490 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7800fa10 con 0x7f1c7c068960 2023-09-30T22:21:49.049 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.039+0000 7f1c832ec700 1 -- 172.21.15.40:0/3129650490 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c7c068960 msgr2=0x7f1c7c068d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.050 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.039+0000 7f1c832ec700 1 --2- 172.21.15.40:0/3129650490 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c7c068960 0x7f1c7c068d40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f1c78006fd0 tx=0x7f1c780090f0).stop 2023-09-30T22:21:49.050 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.039+0000 7f1c832ec700 1 -- 172.21.15.40:0/3129650490 shutdown_connections 2023-09-30T22:21:49.050 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.039+0000 7f1c832ec700 1 --2- 172.21.15.40:0/3129650490 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c7c091ef0 0x7f1c7c092370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:49.050 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.039+0000 7f1c832ec700 1 --2- 172.21.15.40:0/3129650490 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c7c068960 0x7f1c7c068d40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:49.050 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.039+0000 7f1c832ec700 1 --2- 172.21.15.40:0/3129650490 >> v2:172.21.15.40:3300/0 conn(0x7f1c7c069230 0x7f1c7c091a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:49.051 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.039+0000 7f1c832ec700 1 -- 172.21.15.40:0/3129650490 >> 172.21.15.40:0/3129650490 conn(0x7f1c7c09ac60 msgr2=0x7f1c7c062c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:49.051 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.039+0000 7f1c832ec700 1 -- 172.21.15.40:0/3129650490 shutdown_connections 2023-09-30T22:21:49.051 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.039+0000 7f1c832ec700 1 -- 172.21.15.40:0/3129650490 wait complete. 2023-09-30T22:21:49.051 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.040+0000 7f1c832ec700 1 Processor -- start 2023-09-30T22:21:49.051 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.040+0000 7f1c832ec700 1 -- start start 2023-09-30T22:21:49.051 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.041+0000 7f1c832ec700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c7c068960 0x7f1c7c13a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:49.052 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.041+0000 7f1c832ec700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c7c069230 0x7f1c7c13a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:49.052 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.041+0000 7f1c832ec700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c7c091ef0 0x7f1c7c115ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:49.052 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.041+0000 7f1c832ec700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c12a470 con 0x7f1c7c091ef0 2023-09-30T22:21:49.052 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.041+0000 7f1c832ec700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c119690 con 0x7f1c7c069230 2023-09-30T22:21:49.052 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.041+0000 7f1c832ec700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c12f220 con 0x7f1c7c068960 2023-09-30T22:21:49.052 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.041+0000 7f1c81088700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c7c068960 0x7f1c7c13a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:49.053 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.041+0000 7f1c81889700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c7c091ef0 0x7f1c7c115ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:49.053 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.041+0000 7f1c80887700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c7c069230 0x7f1c7c13a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:49.053 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.041+0000 7f1c81889700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c7c091ef0 0x7f1c7c115ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56206/0 (socket says 172.21.15.40:56206) 2023-09-30T22:21:49.053 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.041+0000 7f1c80887700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c7c069230 0x7f1c7c13a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60998/0 (socket says 172.21.15.40:60998) 2023-09-30T22:21:49.053 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.041+0000 7f1c81088700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c7c068960 0x7f1c7c13a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52340/0 (socket says 172.21.15.40:52340) 2023-09-30T22:21:49.053 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.041+0000 7f1c81889700 1 -- 172.21.15.40:0/1165299943 learned_addr learned my addr 172.21.15.40:0/1165299943 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:21:49.054 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.041+0000 7f1c80887700 1 -- 172.21.15.40:0/1165299943 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c7c068960 msgr2=0x7f1c7c13a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.054 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.041+0000 7f1c80887700 1 --2- 172.21.15.40:0/1165299943 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c7c068960 0x7f1c7c13a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:49.054 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.041+0000 7f1c80887700 1 -- 172.21.15.40:0/1165299943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c7c091ef0 msgr2=0x7f1c7c115ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.054 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.041+0000 7f1c80887700 1 --2- 172.21.15.40:0/1165299943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c7c091ef0 0x7f1c7c115ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:49.054 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.041+0000 7f1c80887700 1 -- 172.21.15.40:0/1165299943 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6c0092a0 con 0x7f1c7c069230 2023-09-30T22:21:49.054 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.041+0000 7f1c81889700 1 --2- 172.21.15.40:0/1165299943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c7c091ef0 0x7f1c7c115ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:49.054 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.041+0000 7f1c81088700 1 --2- 172.21.15.40:0/1165299943 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c7c068960 0x7f1c7c13a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:49.055 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.042+0000 7f1c80887700 1 --2- 172.21.15.40:0/1165299943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c7c069230 0x7f1c7c13a950 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f1c6c00e950 tx=0x7f1c6c009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:49.055 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.042+0000 7f1c717fa700 1 -- 172.21.15.40:0/1165299943 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6c009580 con 0x7f1c7c069230 2023-09-30T22:21:49.055 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.042+0000 7f1c717fa700 1 -- 172.21.15.40:0/1165299943 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6c012600 con 0x7f1c7c069230 2023-09-30T22:21:49.055 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.042+0000 7f1c832ec700 1 -- 172.21.15.40:0/1165299943 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c74009a20 con 0x7f1c7c069230 2023-09-30T22:21:49.055 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.042+0000 7f1c717fa700 1 -- 172.21.15.40:0/1165299943 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6c0129a0 con 0x7f1c7c069230 2023-09-30T22:21:49.055 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.042+0000 7f1c832ec700 1 -- 172.21.15.40:0/1165299943 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c78009370 con 0x7f1c7c069230 2023-09-30T22:21:49.055 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.043+0000 7f1c717fa700 1 -- 172.21.15.40:0/1165299943 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f1c6c01b400 con 0x7f1c7c069230 2023-09-30T22:21:49.055 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.043+0000 7f1c717fa700 1 -- 172.21.15.40:0/1165299943 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f1c6c01a3b0 con 0x7f1c7c069230 2023-09-30T22:21:49.056 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.043+0000 7f1c832ec700 1 -- 172.21.15.40:0/1165299943 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c7c05a260 con 0x7f1c7c069230 2023-09-30T22:21:49.056 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.045+0000 7f1c717fa700 1 -- 172.21.15.40:0/1165299943 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f1c6c03ae50 con 0x7f1c7c069230 2023-09-30T22:21:49.114 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.113+0000 7f1c832ec700 1 -- 172.21.15.40:0/1165299943 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c7c046c20 con 0x7f1c7c069230 2023-09-30T22:21:49.114 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.114+0000 7f1c717fa700 1 -- 172.21.15.40:0/1165299943 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4109 (secure 0 0 0) 0x7f1c6c029030 con 0x7f1c7c069230 2023-09-30T22:21:49.115 INFO:teuthology.misc.health.smithi040.stdout: 2023-09-30T22:21:49.115 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":6,"fsid":"79dd4d8e-f295-4d9c-bd93-9850863800e3","created":"2023-09-30T22:21:46.980357+0000","modified":"2023-09-30T22:21:48.205613+0000","last_up_change":"0.000000","last_in_change":"2023-09-30T22:21:48.205613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"771f785c-f464-4b17-936c-cbf31b1153e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"45f1e2e8-5310-4219-ab54-424e7440fcea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7ba62ae5-d21e-4d56-b46c-ba7b718ede25","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c9c55985-8a90-4927-a8fa-6a1fcec1cd3d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:21:49.116 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.115+0000 7f1c832ec700 1 -- 172.21.15.40:0/1165299943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c7c069230 msgr2=0x7f1c7c13a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.116 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.115+0000 7f1c832ec700 1 --2- 172.21.15.40:0/1165299943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c7c069230 0x7f1c7c13a950 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f1c6c00e950 tx=0x7f1c6c009060).stop 2023-09-30T22:21:49.116 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.115+0000 7f1c832ec700 1 -- 172.21.15.40:0/1165299943 shutdown_connections 2023-09-30T22:21:49.116 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.115+0000 7f1c832ec700 1 --2- 172.21.15.40:0/1165299943 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c7c068960 0x7f1c7c13a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:49.116 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.115+0000 7f1c832ec700 1 --2- 172.21.15.40:0/1165299943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c7c091ef0 0x7f1c7c115ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:49.116 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.115+0000 7f1c832ec700 1 --2- 172.21.15.40:0/1165299943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c7c069230 0x7f1c7c13a950 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:49.116 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.115+0000 7f1c832ec700 1 -- 172.21.15.40:0/1165299943 >> 172.21.15.40:0/1165299943 conn(0x7f1c7c09ac60 msgr2=0x7f1c7c0983a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:49.116 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.115+0000 7f1c832ec700 1 -- 172.21.15.40:0/1165299943 shutdown_connections 2023-09-30T22:21:49.116 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:49.115+0000 7f1c832ec700 1 -- 172.21.15.40:0/1165299943 wait complete. 2023-09-30T22:21:49.126 DEBUG:teuthology.misc:0 of 4 OSDs are up 2023-09-30T22:21:49.182 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:21:49.182+0000 7f623e81a680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-30T22:21:49.362 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:21:49.362+0000 7f623e81a680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-30T22:21:49.430 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:21:49.430+0000 7f623e81a680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-30T22:21:49.510 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:21:49.510+0000 7f623e81a680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-30T22:21:49.583 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:21:49.583+0000 7f623e81a680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-30T22:21:49.946 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:21:49.946+0000 7f623e81a680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-30T22:21:50.036 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:21:50.035+0000 7f623e81a680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-30T22:21:50.712 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:21:50.712+0000 7f623e81a680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-30T22:21:50.785 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:21:50.784+0000 7f623e81a680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-30T22:21:50.866 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:21:50.866+0000 7f623e81a680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-30T22:21:51.167 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:21:51.166+0000 7f623e81a680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-30T22:21:51.241 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:21:51.240+0000 7f623e81a680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-30T22:21:51.367 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:21:51.367+0000 7f623e81a680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-30T22:21:51.480 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:21:51.480+0000 7f623e81a680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-30T22:21:51.667 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:21:51.666+0000 7f623e81a680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-30T22:21:51.755 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:21:51.755+0000 7f623e81a680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-30T22:21:52.305 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-09-30T22:21:52.304+0000 7ff327adb200 -1 osd.3 0 log_to_monitors {default=true} 2023-09-30T22:21:52.350 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-09-30T22:21:52.350+0000 7f3fe1425200 -1 osd.0 0 log_to_monitors {default=true} 2023-09-30T22:21:52.590 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-09-30T22:21:52.589+0000 7f605b711200 -1 osd.2 0 log_to_monitors {default=true} 2023-09-30T22:21:52.595 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-09-30T22:21:52.595+0000 7f80f2c10200 -1 osd.1 0 log_to_monitors {default=true} 2023-09-30T22:21:52.777 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:21:52.776+0000 7f61f5257700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-09-30T22:21:52.777 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:21:52.777+0000 7f61f5257700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-09-30T22:21:53.827 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-09-30T22:21:53.826+0000 7ff31e47c700 -1 osd.3 0 waiting for initial osdmap 2023-09-30T22:21:53.827 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-09-30T22:21:53.827+0000 7f3fd7dc6700 -1 osd.0 0 waiting for initial osdmap 2023-09-30T22:21:53.828 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-09-30T22:21:53.827+0000 7f60520b2700 -1 osd.2 0 waiting for initial osdmap 2023-09-30T22:21:53.828 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-09-30T22:21:53.827+0000 7f80e95b1700 -1 osd.1 0 waiting for initial osdmap 2023-09-30T22:21:53.832 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-09-30T22:21:53.832+0000 7f3fd4542700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:21:53.833 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-09-30T22:21:53.832+0000 7ff31abf8700 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:21:53.833 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-09-30T22:21:53.832+0000 7f80e5d2d700 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:21:53.833 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-09-30T22:21:53.832+0000 7f604e82e700 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:21:55.529 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-30T22:21:55.655 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.654+0000 7f7818e6a700 1 Processor -- start 2023-09-30T22:21:55.655 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.654+0000 7f7818e6a700 1 -- start start 2023-09-30T22:21:55.658 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.655+0000 7f7818e6a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7814068960 0x7f7814068d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:55.658 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.655+0000 7f7818e6a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7814069230 0x7f7814091a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:55.658 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.655+0000 7f7818e6a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7814091ef0 0x7f7814092370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:55.658 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.655+0000 7f7818e6a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78140681e0 con 0x7f7814069230 2023-09-30T22:21:55.658 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.655+0000 7f7818e6a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7814092860 con 0x7f7814091ef0 2023-09-30T22:21:55.658 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.655+0000 7f7818e6a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7814068530 con 0x7f7814068960 2023-09-30T22:21:55.658 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.655+0000 7f781259c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7814068960 0x7f7814068d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:55.658 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.655+0000 7f7812d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7814091ef0 0x7f7814092370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:55.659 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.655+0000 7f781259c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7814068960 0x7f7814068d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58604/0 (socket says 172.21.15.40:58604) 2023-09-30T22:21:55.659 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.655+0000 7f7812d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7814091ef0 0x7f7814092370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48652/0 (socket says 172.21.15.40:48652) 2023-09-30T22:21:55.659 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.655+0000 7f781259c700 1 -- 172.21.15.40:0/2854416514 learned_addr learned my addr 172.21.15.40:0/2854416514 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:21:55.659 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.655+0000 7f7811d9b700 1 --2- 172.21.15.40:0/2854416514 >> v2:172.21.15.40:3300/0 conn(0x7f7814069230 0x7f7814091a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:55.659 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.656+0000 7f7811d9b700 1 -- 172.21.15.40:0/2854416514 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7814068960 msgr2=0x7f7814068d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:55.659 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.656+0000 7f7811d9b700 1 --2- 172.21.15.40:0/2854416514 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7814068960 0x7f7814068d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:55.659 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.656+0000 7f7811d9b700 1 -- 172.21.15.40:0/2854416514 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7814091ef0 msgr2=0x7f7814092370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:55.659 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.656+0000 7f7811d9b700 1 --2- 172.21.15.40:0/2854416514 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7814091ef0 0x7f7814092370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:55.659 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.656+0000 7f7811d9b700 1 -- 172.21.15.40:0/2854416514 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7814092be0 con 0x7f7814069230 2023-09-30T22:21:55.659 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.656+0000 7f781259c700 1 --2- 172.21.15.40:0/2854416514 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7814068960 0x7f7814068d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:55.660 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.656+0000 7f7812d9d700 1 --2- 172.21.15.40:0/2854416514 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7814091ef0 0x7f7814092370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:55.660 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.656+0000 7f7811d9b700 1 --2- 172.21.15.40:0/2854416514 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7814069230 0x7f7814091a00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f7808009760 tx=0x7f7808009060).ready entity=mon.0 client_cookie=a1683e70801850c6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:55.660 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.656+0000 7f781159a700 1 -- 172.21.15.40:0/2854416514 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78080090d0 con 0x7f7814069230 2023-09-30T22:21:55.660 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.656+0000 7f781159a700 1 -- 172.21.15.40:0/2854416514 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780800d4a0 con 0x7f7814069230 2023-09-30T22:21:55.660 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.656+0000 7f781159a700 1 -- 172.21.15.40:0/2854416514 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780800d820 con 0x7f7814069230 2023-09-30T22:21:55.660 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.657+0000 7f7818e6a700 1 -- 172.21.15.40:0/2854416514 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7814069230 msgr2=0x7f7814091a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:55.660 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.657+0000 7f7818e6a700 1 --2- 172.21.15.40:0/2854416514 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7814069230 0x7f7814091a00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f7808009760 tx=0x7f7808009060).stop 2023-09-30T22:21:55.660 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.657+0000 7f7818e6a700 1 -- 172.21.15.40:0/2854416514 shutdown_connections 2023-09-30T22:21:55.660 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.657+0000 7f7818e6a700 1 --2- 172.21.15.40:0/2854416514 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7814068960 0x7f7814068d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:55.661 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.657+0000 7f7818e6a700 1 --2- 172.21.15.40:0/2854416514 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7814091ef0 0x7f7814092370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:55.661 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.657+0000 7f7818e6a700 1 --2- 172.21.15.40:0/2854416514 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7814069230 0x7f7814091a00 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:55.661 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.657+0000 7f7818e6a700 1 -- 172.21.15.40:0/2854416514 >> 172.21.15.40:0/2854416514 conn(0x7f781409ac60 msgr2=0x7f7814062c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:55.661 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.657+0000 7f7818e6a700 1 -- 172.21.15.40:0/2854416514 shutdown_connections 2023-09-30T22:21:55.661 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.657+0000 7f7818e6a700 1 -- 172.21.15.40:0/2854416514 wait complete. 2023-09-30T22:21:55.661 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.658+0000 7f7818e6a700 1 Processor -- start 2023-09-30T22:21:55.661 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.658+0000 7f7818e6a700 1 -- start start 2023-09-30T22:21:55.664 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.658+0000 7f7818e6a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7814068960 0x7f781411c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:55.664 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.658+0000 7f7818e6a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7814069230 0x7f7814118830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:55.664 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.658+0000 7f7818e6a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7814091ef0 0x7f7814118d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:55.664 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.658+0000 7f7818e6a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781411acd0 con 0x7f7814091ef0 2023-09-30T22:21:55.664 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.658+0000 7f7818e6a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7814129940 con 0x7f7814068960 2023-09-30T22:21:55.664 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.658+0000 7f7818e6a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7814093550 con 0x7f7814069230 2023-09-30T22:21:55.664 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.658+0000 7f7811d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7814069230 0x7f7814118830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:55.664 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.658+0000 7f7812d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7814091ef0 0x7f7814118d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:55.664 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.658+0000 7f7811d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7814069230 0x7f7814118830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58610/0 (socket says 172.21.15.40:58610) 2023-09-30T22:21:55.664 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.658+0000 7f7811d9b700 1 -- 172.21.15.40:0/3543580849 learned_addr learned my addr 172.21.15.40:0/3543580849 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:21:55.665 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.658+0000 7f7812d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7814091ef0 0x7f7814118d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44058/0 (socket says 172.21.15.40:44058) 2023-09-30T22:21:55.665 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.658+0000 7f781259c700 1 --2- 172.21.15.40:0/3543580849 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7814068960 0x7f781411c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:55.665 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.658+0000 7f7812d9d700 1 -- 172.21.15.40:0/3543580849 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7814069230 msgr2=0x7f7814118830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:55.665 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.659+0000 7f7812d9d700 1 --2- 172.21.15.40:0/3543580849 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7814069230 0x7f7814118830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:55.665 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.659+0000 7f7812d9d700 1 -- 172.21.15.40:0/3543580849 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7814068960 msgr2=0x7f781411c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:55.665 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.659+0000 7f7812d9d700 1 --2- 172.21.15.40:0/3543580849 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7814068960 0x7f781411c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:55.665 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.659+0000 7f7812d9d700 1 -- 172.21.15.40:0/3543580849 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780c009370 con 0x7f7814091ef0 2023-09-30T22:21:55.665 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.659+0000 7f7811d9b700 1 --2- 172.21.15.40:0/3543580849 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7814069230 0x7f7814118830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:55.665 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.659+0000 7f7812d9d700 1 --2- 172.21.15.40:0/3543580849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7814091ef0 0x7f7814118d20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f7804009f10 tx=0x7f780400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:55.665 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.659+0000 7f78027fc700 1 -- 172.21.15.40:0/3543580849 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780400cb70 con 0x7f7814091ef0 2023-09-30T22:21:55.666 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.659+0000 7f78027fc700 1 -- 172.21.15.40:0/3543580849 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780400f040 con 0x7f7814091ef0 2023-09-30T22:21:55.666 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.659+0000 7f7818e6a700 1 -- 172.21.15.40:0/3543580849 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7804009a20 con 0x7f7814091ef0 2023-09-30T22:21:55.666 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.659+0000 7f78027fc700 1 -- 172.21.15.40:0/3543580849 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7804013400 con 0x7f7814091ef0 2023-09-30T22:21:55.666 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.659+0000 7f7818e6a700 1 -- 172.21.15.40:0/3543580849 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78080092a0 con 0x7f7814091ef0 2023-09-30T22:21:55.666 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.660+0000 7f78027fc700 1 -- 172.21.15.40:0/3543580849 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f78040137b0 con 0x7f7814091ef0 2023-09-30T22:21:55.666 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.660+0000 7f78027fc700 1 -- 172.21.15.40:0/3543580849 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 2069+0+0 (secure 0 0 0) 0x7f780403b210 con 0x7f7814091ef0 2023-09-30T22:21:55.666 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.660+0000 7f7818e6a700 1 -- 172.21.15.40:0/3543580849 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7814092570 con 0x7f7814091ef0 2023-09-30T22:21:55.667 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.665+0000 7f78027fc700 1 -- 172.21.15.40:0/3543580849 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f780401ab50 con 0x7f7814091ef0 2023-09-30T22:21:55.837 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.836+0000 7f7818e6a700 1 -- 172.21.15.40:0/3543580849 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7814092370 con 0x7f7814091ef0 2023-09-30T22:21:55.837 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.837+0000 7f78027fc700 1 -- 172.21.15.40:0/3543580849 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+6597 (secure 0 0 0) 0x7f780402b090 con 0x7f7814091ef0 2023-09-30T22:21:55.837 INFO:teuthology.misc.health.smithi040.stdout: 2023-09-30T22:21:55.838 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":10,"fsid":"79dd4d8e-f295-4d9c-bd93-9850863800e3","created":"2023-09-30T22:21:46.980357+0000","modified":"2023-09-30T22:21:55.823939+0000","last_up_change":"2023-09-30T22:21:54.822866+0000","last_in_change":"2023-09-30T22:21:48.205613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:21:54.875024+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"771f785c-f464-4b17-936c-cbf31b1153e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6812","nonce":119451}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6813","nonce":119451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6815","nonce":119451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6814","nonce":119451}]},"public_addr":"172.21.15.40:6812/119451","cluster_addr":"172.21.15.40:6813/119451","heartbeat_back_addr":"172.21.15.40:6815/119451","heartbeat_front_addr":"172.21.15.40:6814/119451","state":["exists","up"]},{"osd":1,"uuid":"45f1e2e8-5310-4219-ab54-424e7440fcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6808","nonce":119436}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6809","nonce":119436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6811","nonce":119436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6810","nonce":119436}]},"public_addr":"172.21.15.40:6808/119436","cluster_addr":"172.21.15.40:6809/119436","heartbeat_back_addr":"172.21.15.40:6811/119436","heartbeat_front_addr":"172.21.15.40:6810/119436","state":["exists","up"]},{"osd":2,"uuid":"7ba62ae5-d21e-4d56-b46c-ba7b718ede25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6800","nonce":119433}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6801","nonce":119433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6803","nonce":119433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6802","nonce":119433}]},"public_addr":"172.21.15.40:6800/119433","cluster_addr":"172.21.15.40:6801/119433","heartbeat_back_addr":"172.21.15.40:6803/119433","heartbeat_front_addr":"172.21.15.40:6802/119433","state":["exists","up"]},{"osd":3,"uuid":"c9c55985-8a90-4927-a8fa-6a1fcec1cd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6804","nonce":119432}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6805","nonce":119432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6807","nonce":119432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6806","nonce":119432}]},"public_addr":"172.21.15.40:6804/119432","cluster_addr":"172.21.15.40:6805/119432","heartbeat_back_addr":"172.21.15.40:6807/119432","heartbeat_front_addr":"172.21.15.40:6806/119432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.339829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.554690+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.641664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.320635+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:21:55.840 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.839+0000 7f7818e6a700 1 -- 172.21.15.40:0/3543580849 >> v1:172.21.15.40:6816/118905 conn(0x7f77f402bb60 legacy=0x7f77f402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:55.840 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.839+0000 7f7818e6a700 1 -- 172.21.15.40:0/3543580849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7814091ef0 msgr2=0x7f7814118d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:55.840 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.839+0000 7f7818e6a700 1 --2- 172.21.15.40:0/3543580849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7814091ef0 0x7f7814118d20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f7804009f10 tx=0x7f780400b040).stop 2023-09-30T22:21:55.840 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.839+0000 7f7818e6a700 1 -- 172.21.15.40:0/3543580849 shutdown_connections 2023-09-30T22:21:55.840 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.839+0000 7f7818e6a700 1 --2- 172.21.15.40:0/3543580849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7814091ef0 0x7f7814118d20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:55.840 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.839+0000 7f7818e6a700 1 --2- 172.21.15.40:0/3543580849 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7814068960 0x7f781411c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:55.840 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.839+0000 7f7818e6a700 1 --2- 172.21.15.40:0/3543580849 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7814069230 0x7f7814118830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:55.841 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.839+0000 7f7818e6a700 1 -- 172.21.15.40:0/3543580849 >> 172.21.15.40:0/3543580849 conn(0x7f781409ac60 msgr2=0x7f781412a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:55.841 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.839+0000 7f7818e6a700 1 -- 172.21.15.40:0/3543580849 shutdown_connections 2023-09-30T22:21:55.841 INFO:teuthology.misc.health.smithi040.stderr:2023-09-30T22:21:55.839+0000 7f7818e6a700 1 -- 172.21.15.40:0/3543580849 wait complete. 2023-09-30T22:21:55.851 DEBUG:teuthology.misc:4 of 4 OSDs are up 2023-09-30T22:21:55.851 INFO:tasks.ceph:Creating RBD pool 2023-09-30T22:21:55.851 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd pool create rbd 8 2023-09-30T22:21:55.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.974+0000 7f90ea849700 1 Processor -- start 2023-09-30T22:21:55.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.974+0000 7f90ea849700 1 -- start start 2023-09-30T22:21:55.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.975+0000 7f90ea849700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90e40657e0 0x7f90e4096620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:55.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.975+0000 7f90ea849700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f90e4097ec0 0x7f90e4096b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:55.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.975+0000 7f90ea849700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90e4098350 con 0x7f90e4097000 2023-09-30T22:21:55.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.975+0000 7f90ea849700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e4065bc0 con 0x7f90e40657e0 2023-09-30T22:21:55.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.975+0000 7f90ea849700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90e4096350 con 0x7f90e4097ec0 2023-09-30T22:21:55.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.975+0000 7f90e3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90e40657e0 0x7f90e4096620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:55.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.975+0000 7f90e37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f90e4097ec0 0x7f90e4096b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:55.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.975+0000 7f90e8de6700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f90e4097000 0x7f90e4131650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55812/0 (socket says 172.21.15.40:55812) 2023-09-30T22:21:55.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.975+0000 7f90e8de6700 1 -- 172.21.15.40:0/543706475 learned_addr learned my addr 172.21.15.40:0/543706475 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:21:55.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.975+0000 7f90e2ffd700 1 -- 172.21.15.40:0/543706475 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3532603804 0 0) 0x7f90e4098350 con 0x7f90e4097000 2023-09-30T22:21:55.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.975+0000 7f90e37fe700 1 -- 172.21.15.40:0/543706475 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90e40657e0 msgr2=0x7f90e4096620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:55.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.975+0000 7f90e37fe700 1 --2- 172.21.15.40:0/543706475 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90e40657e0 0x7f90e4096620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:55.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.975+0000 7f90e37fe700 1 -- 172.21.15.40:0/543706475 >> v1:172.21.15.40:6789/0 conn(0x7f90e4097000 legacy=0x7f90e4131650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:55.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.975+0000 7f90e37fe700 1 -- 172.21.15.40:0/543706475 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e40662b0 con 0x7f90e4097ec0 2023-09-30T22:21:55.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.975+0000 7f90e3fff700 1 --2- 172.21.15.40:0/543706475 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90e40657e0 0x7f90e4096620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:55.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.975+0000 7f90e37fe700 1 --2- 172.21.15.40:0/543706475 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f90e4097ec0 0x7f90e4096b10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f90d8009790 tx=0x7f90d8009060).ready entity=mon.2 client_cookie=65ac37ec04679ec1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:55.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.976+0000 7f90e2ffd700 1 -- 172.21.15.40:0/543706475 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d80090d0 con 0x7f90e4097ec0 2023-09-30T22:21:55.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.976+0000 7f90e2ffd700 1 -- 172.21.15.40:0/543706475 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d800f510 con 0x7f90e4097ec0 2023-09-30T22:21:55.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.976+0000 7f90e2ffd700 1 -- 172.21.15.40:0/543706475 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d800f890 con 0x7f90e4097ec0 2023-09-30T22:21:55.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.976+0000 7f90ea849700 1 -- 172.21.15.40:0/543706475 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f90e4097ec0 msgr2=0x7f90e4096b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:55.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.976+0000 7f90ea849700 1 --2- 172.21.15.40:0/543706475 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f90e4097ec0 0x7f90e4096b10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f90d8009790 tx=0x7f90d8009060).stop 2023-09-30T22:21:55.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.976+0000 7f90ea849700 1 -- 172.21.15.40:0/543706475 shutdown_connections 2023-09-30T22:21:55.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.976+0000 7f90ea849700 1 --2- 172.21.15.40:0/543706475 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90e40657e0 0x7f90e4096620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:55.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.976+0000 7f90ea849700 1 --2- 172.21.15.40:0/543706475 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f90e4097ec0 0x7f90e4096b10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:55.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.976+0000 7f90ea849700 1 -- 172.21.15.40:0/543706475 >> 172.21.15.40:0/543706475 conn(0x7f90e409de50 msgr2=0x7f90e409e260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:55.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.976+0000 7f90ea849700 1 -- 172.21.15.40:0/543706475 shutdown_connections 2023-09-30T22:21:55.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.976+0000 7f90ea849700 1 -- 172.21.15.40:0/543706475 wait complete. 2023-09-30T22:21:55.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.977+0000 7f90ea849700 1 Processor -- start 2023-09-30T22:21:55.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.977+0000 7f90ea849700 1 -- start start 2023-09-30T22:21:55.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.978+0000 7f90ea849700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90e40657e0 0x7f90e413a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:55.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.978+0000 7f90ea849700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90e4097000 0x7f90e413aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:55.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.978+0000 7f90ea849700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f90e413af40 0x7f90e411ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:55.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.978+0000 7f90ea849700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e411e2d0 con 0x7f90e40657e0 2023-09-30T22:21:55.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.978+0000 7f90ea849700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e4099d70 con 0x7f90e4097000 2023-09-30T22:21:55.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.978+0000 7f90ea849700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90e4094840 con 0x7f90e413af40 2023-09-30T22:21:55.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.978+0000 7f90e3fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90e40657e0 0x7f90e413a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:55.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.978+0000 7f90e3fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90e40657e0 0x7f90e413a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44066/0 (socket says 172.21.15.40:44066) 2023-09-30T22:21:55.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.978+0000 7f90e3fff700 1 -- 172.21.15.40:0/1691023449 learned_addr learned my addr 172.21.15.40:0/1691023449 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:21:55.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.978+0000 7f90e37fe700 1 --2- 172.21.15.40:0/1691023449 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90e4097000 0x7f90e413aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:55.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.978+0000 7f90e8de6700 1 --2- 172.21.15.40:0/1691023449 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f90e413af40 0x7f90e411ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:55.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.978+0000 7f90e37fe700 1 -- 172.21.15.40:0/1691023449 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f90e413af40 msgr2=0x7f90e411ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:55.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.978+0000 7f90e37fe700 1 --2- 172.21.15.40:0/1691023449 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f90e413af40 0x7f90e411ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:55.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.978+0000 7f90e37fe700 1 -- 172.21.15.40:0/1691023449 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90e40657e0 msgr2=0x7f90e413a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:55.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.978+0000 7f90e37fe700 1 --2- 172.21.15.40:0/1691023449 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90e40657e0 0x7f90e413a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:55.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.978+0000 7f90e37fe700 1 -- 172.21.15.40:0/1691023449 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d40092a0 con 0x7f90e4097000 2023-09-30T22:21:55.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.978+0000 7f90e3fff700 1 --2- 172.21.15.40:0/1691023449 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90e40657e0 0x7f90e413a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:55.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.978+0000 7f90e37fe700 1 --2- 172.21.15.40:0/1691023449 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90e4097000 0x7f90e413aa50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f90e4064d80 tx=0x7f90d8017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:55.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.978+0000 7f90cbfff700 1 -- 172.21.15.40:0/1691023449 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d800f890 con 0x7f90e4097000 2023-09-30T22:21:55.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.978+0000 7f90cbfff700 1 -- 172.21.15.40:0/1691023449 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d8000d10 con 0x7f90e4097000 2023-09-30T22:21:55.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.978+0000 7f90ea849700 1 -- 172.21.15.40:0/1691023449 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d80092a0 con 0x7f90e4097000 2023-09-30T22:21:55.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.978+0000 7f90cbfff700 1 -- 172.21.15.40:0/1691023449 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d800fe80 con 0x7f90e4097000 2023-09-30T22:21:55.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.978+0000 7f90ea849700 1 -- 172.21.15.40:0/1691023449 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90e411e920 con 0x7f90e4097000 2023-09-30T22:21:55.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.979+0000 7f90cbfff700 1 -- 172.21.15.40:0/1691023449 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f90d801c630 con 0x7f90e4097000 2023-09-30T22:21:55.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.979+0000 7f90cbfff700 1 -- 172.21.15.40:0/1691023449 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 2461+0+0 (secure 0 0 0) 0x7f90d803c4b0 con 0x7f90e4097000 2023-09-30T22:21:55.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.980+0000 7f90ea849700 1 -- 172.21.15.40:0/1691023449 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90e4099500 con 0x7f90e4097000 2023-09-30T22:21:55.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:55.984+0000 7f90cbfff700 1 -- 172.21.15.40:0/1691023449 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f90d802a080 con 0x7f90e4097000 2023-09-30T22:21:56.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.151+0000 7f90ea849700 1 -- 172.21.15.40:0/1691023449 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f90e413b320 con 0x7f90e4097000 2023-09-30T22:21:56.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.829+0000 7f90cbfff700 1 -- 172.21.15.40:0/1691023449 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v11) v1 ==== 109+0+0 (secure 0 0 0) 0x7f90d8020020 con 0x7f90e4097000 2023-09-30T22:21:56.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.834+0000 7f90ea849700 1 -- 172.21.15.40:0/1691023449 >> v1:172.21.15.40:6816/118905 conn(0x7f90d002bb90 legacy=0x7f90d002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.834+0000 7f90ea849700 1 -- 172.21.15.40:0/1691023449 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90e4097000 msgr2=0x7f90e413aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.834+0000 7f90ea849700 1 --2- 172.21.15.40:0/1691023449 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90e4097000 0x7f90e413aa50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f90e4064d80 tx=0x7f90d8017000).stop 2023-09-30T22:21:56.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.834+0000 7f90ea849700 1 -- 172.21.15.40:0/1691023449 shutdown_connections 2023-09-30T22:21:56.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.834+0000 7f90ea849700 1 --2- 172.21.15.40:0/1691023449 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f90e413af40 0x7f90e411ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:56.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.834+0000 7f90ea849700 1 --2- 172.21.15.40:0/1691023449 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90e40657e0 0x7f90e413a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:56.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.834+0000 7f90ea849700 1 --2- 172.21.15.40:0/1691023449 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90e4097000 0x7f90e413aa50 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:56.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.834+0000 7f90ea849700 1 -- 172.21.15.40:0/1691023449 >> 172.21.15.40:0/1691023449 conn(0x7f90e409de50 msgr2=0x7f90e409bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:56.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.834+0000 7f90ea849700 1 -- 172.21.15.40:0/1691023449 shutdown_connections 2023-09-30T22:21:56.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.834+0000 7f90ea849700 1 -- 172.21.15.40:0/1691023449 wait complete. 2023-09-30T22:21:56.835 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'rbd' created 2023-09-30T22:21:56.850 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-09-30T22:21:56.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.981+0000 7faeb3994700 1 Processor -- start 2023-09-30T22:21:56.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.981+0000 7faeb3994700 1 -- start start 2023-09-30T22:21:56.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.982+0000 7faeb3994700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faeac067f70 0x7faeac068350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:56.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.982+0000 7faeb3994700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faeac068840 0x7faeac127c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:56.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.982+0000 7faeb3994700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeac069190 con 0x7faeac128180 2023-09-30T22:21:56.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.982+0000 7faeb3994700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeac091d10 con 0x7faeac067f70 2023-09-30T22:21:56.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.982+0000 7faeb3994700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeac0932d0 con 0x7faeac068840 2023-09-30T22:21:56.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.982+0000 7faeb0f2f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faeac068840 0x7faeac127c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:56.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.982+0000 7faeb1730700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faeac067f70 0x7faeac068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:56.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.982+0000 7faeb0f2f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faeac068840 0x7faeac127c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48706/0 (socket says 172.21.15.40:48706) 2023-09-30T22:21:56.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.982+0000 7faeb1730700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faeac067f70 0x7faeac068350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44068/0 (socket says 172.21.15.40:44068) 2023-09-30T22:21:56.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.982+0000 7faeb0f2f700 1 -- 172.21.15.40:0/2374069229 learned_addr learned my addr 172.21.15.40:0/2374069229 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:21:56.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.982+0000 7faeb1f31700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7faeac128180 0x7faeac12f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55818/0 (socket says 172.21.15.40:55818) 2023-09-30T22:21:56.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.982+0000 7faeb1730700 1 -- 172.21.15.40:0/2374069229 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faeac068840 msgr2=0x7faeac127c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:56.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.982+0000 7faeb1730700 1 --2- 172.21.15.40:0/2374069229 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faeac068840 0x7faeac127c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:56.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.982+0000 7faeb1730700 1 -- 172.21.15.40:0/2374069229 >> v1:172.21.15.40:6789/0 conn(0x7faeac128180 legacy=0x7faeac12f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.982+0000 7faeb1730700 1 -- 172.21.15.40:0/2374069229 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeac092170 con 0x7faeac067f70 2023-09-30T22:21:56.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.982+0000 7faea3fff700 1 -- 172.21.15.40:0/2374069229 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1846564008 0 0) 0x7faeac069190 con 0x7faeac128180 2023-09-30T22:21:56.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.982+0000 7faeb0f2f700 1 --2- 172.21.15.40:0/2374069229 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faeac068840 0x7faeac127c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:56.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.982+0000 7faeb1730700 1 --2- 172.21.15.40:0/2374069229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faeac067f70 0x7faeac068350 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7faea8009760 tx=0x7faea8009060).ready entity=mon.0 client_cookie=7a998db203e6d174 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:56.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.982+0000 7faea3fff700 1 -- 172.21.15.40:0/2374069229 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea800f510 con 0x7faeac067f70 2023-09-30T22:21:56.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.982+0000 7faea3fff700 1 -- 172.21.15.40:0/2374069229 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea800f670 con 0x7faeac067f70 2023-09-30T22:21:56.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.982+0000 7faea3fff700 1 -- 172.21.15.40:0/2374069229 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea800f9f0 con 0x7faeac067f70 2023-09-30T22:21:56.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.983+0000 7faeb3994700 1 -- 172.21.15.40:0/2374069229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faeac067f70 msgr2=0x7faeac068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.983+0000 7faeb3994700 1 --2- 172.21.15.40:0/2374069229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faeac067f70 0x7faeac068350 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7faea8009760 tx=0x7faea8009060).stop 2023-09-30T22:21:56.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.983+0000 7faeb3994700 1 -- 172.21.15.40:0/2374069229 shutdown_connections 2023-09-30T22:21:56.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.983+0000 7faeb3994700 1 --2- 172.21.15.40:0/2374069229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faeac067f70 0x7faeac068350 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:56.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.983+0000 7faeb3994700 1 --2- 172.21.15.40:0/2374069229 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faeac068840 0x7faeac127c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:56.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.983+0000 7faeb3994700 1 -- 172.21.15.40:0/2374069229 >> 172.21.15.40:0/2374069229 conn(0x7faeac09a4c0 msgr2=0x7faeac09a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:56.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.983+0000 7faeb3994700 1 -- 172.21.15.40:0/2374069229 shutdown_connections 2023-09-30T22:21:56.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.983+0000 7faeb3994700 1 -- 172.21.15.40:0/2374069229 wait complete. 2023-09-30T22:21:56.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.984+0000 7faeb3994700 1 Processor -- start 2023-09-30T22:21:56.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.984+0000 7faeb3994700 1 -- start start 2023-09-30T22:21:56.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.985+0000 7faeb3994700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faeac067f70 0x7faeac127440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:56.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.985+0000 7faeb3994700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faeac068840 0x7faeac115400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:56.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.985+0000 7faeb3994700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faeac128180 0x7faeac1158f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:56.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.985+0000 7faeb3994700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac1179d0 con 0x7faeac068840 2023-09-30T22:21:56.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.985+0000 7faeb3994700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeac067a40 con 0x7faeac128180 2023-09-30T22:21:56.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.985+0000 7faeb3994700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faeac0974f0 con 0x7faeac067f70 2023-09-30T22:21:56.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.985+0000 7faeb1730700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faeac067f70 0x7faeac127440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:56.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.985+0000 7faeb1730700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faeac067f70 0x7faeac127440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58638/0 (socket says 172.21.15.40:58638) 2023-09-30T22:21:56.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.985+0000 7faeb1730700 1 -- 172.21.15.40:0/2915808828 learned_addr learned my addr 172.21.15.40:0/2915808828 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:21:56.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.985+0000 7faeb0f2f700 1 --2- 172.21.15.40:0/2915808828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faeac068840 0x7faeac115400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:56.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.985+0000 7faeb1f31700 1 --2- 172.21.15.40:0/2915808828 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faeac128180 0x7faeac1158f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:56.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.985+0000 7faeb1730700 1 -- 172.21.15.40:0/2915808828 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faeac128180 msgr2=0x7faeac1158f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.985+0000 7faeb1730700 1 --2- 172.21.15.40:0/2915808828 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faeac128180 0x7faeac1158f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:56.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.985+0000 7faeb1730700 1 -- 172.21.15.40:0/2915808828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faeac068840 msgr2=0x7faeac115400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.985+0000 7faeb1730700 1 --2- 172.21.15.40:0/2915808828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faeac068840 0x7faeac115400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:56.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.985+0000 7faeb1730700 1 -- 172.21.15.40:0/2915808828 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae9c00b610 con 0x7faeac067f70 2023-09-30T22:21:56.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.985+0000 7faeb0f2f700 1 --2- 172.21.15.40:0/2915808828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faeac068840 0x7faeac115400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:56.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.985+0000 7faeb1730700 1 --2- 172.21.15.40:0/2915808828 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faeac067f70 0x7faeac127440 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7faea8009e00 tx=0x7faea8017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:56.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.985+0000 7faea17fa700 1 -- 172.21.15.40:0/2915808828 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea800f7e0 con 0x7faeac067f70 2023-09-30T22:21:56.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.985+0000 7faea17fa700 1 -- 172.21.15.40:0/2915808828 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea800f940 con 0x7faeac067f70 2023-09-30T22:21:56.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.985+0000 7faeb3994700 1 -- 172.21.15.40:0/2915808828 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faea80092a0 con 0x7faeac067f70 2023-09-30T22:21:56.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.985+0000 7faea17fa700 1 -- 172.21.15.40:0/2915808828 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea801b660 con 0x7faeac067f70 2023-09-30T22:21:56.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.985+0000 7faeb3994700 1 -- 172.21.15.40:0/2915808828 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeac118b20 con 0x7faeac067f70 2023-09-30T22:21:56.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.986+0000 7faea17fa700 1 -- 172.21.15.40:0/2915808828 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7faea801ba50 con 0x7faeac067f70 2023-09-30T22:21:56.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.986+0000 7faea17fa700 1 -- 172.21.15.40:0/2915808828 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2827+0+0 (secure 0 0 0) 0x7faea803c4e0 con 0x7faeac067f70 2023-09-30T22:21:56.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.986+0000 7faeb3994700 1 -- 172.21.15.40:0/2915808828 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeac05a260 con 0x7faeac067f70 2023-09-30T22:21:56.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:56.991+0000 7faea17fa700 1 -- 172.21.15.40:0/2915808828 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7faea8029080 con 0x7faeac067f70 2023-09-30T22:21:57.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.159+0000 7faeb3994700 1 -- 172.21.15.40:0/2915808828 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7faeac116200 con 0x7faeac067f70 2023-09-30T22:21:57.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.832+0000 7faea17fa700 1 -- 172.21.15.40:0/2915808828 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v12) v1 ==== 173+0+0 (secure 0 0 0) 0x7faea801f020 con 0x7faeac067f70 2023-09-30T22:21:57.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.835+0000 7faeb3994700 1 -- 172.21.15.40:0/2915808828 >> v1:172.21.15.40:6816/118905 conn(0x7fae9002bb90 legacy=0x7fae9002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.835+0000 7faeb3994700 1 -- 172.21.15.40:0/2915808828 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faeac067f70 msgr2=0x7faeac127440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.835+0000 7faeb3994700 1 --2- 172.21.15.40:0/2915808828 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faeac067f70 0x7faeac127440 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7faea8009e00 tx=0x7faea8017000).stop 2023-09-30T22:21:57.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.836+0000 7faeb3994700 1 -- 172.21.15.40:0/2915808828 shutdown_connections 2023-09-30T22:21:57.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.836+0000 7faeb3994700 1 --2- 172.21.15.40:0/2915808828 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faeac067f70 0x7faeac127440 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:57.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.836+0000 7faeb3994700 1 --2- 172.21.15.40:0/2915808828 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faeac128180 0x7faeac1158f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:57.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.836+0000 7faeb3994700 1 --2- 172.21.15.40:0/2915808828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faeac068840 0x7faeac115400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:57.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.836+0000 7faeb3994700 1 -- 172.21.15.40:0/2915808828 >> 172.21.15.40:0/2915808828 conn(0x7faeac09a4c0 msgr2=0x7faeac0954e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:57.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.836+0000 7faeb3994700 1 -- 172.21.15.40:0/2915808828 shutdown_connections 2023-09-30T22:21:57.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.836+0000 7faeb3994700 1 -- 172.21.15.40:0/2915808828 wait complete. 2023-09-30T22:21:57.837 INFO:teuthology.orchestra.run.smithi040.stderr:enabled application 'rbd' on pool 'rbd' 2023-09-30T22:21:57.852 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-09-30T22:21:57.852 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-30T22:21:57.852 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-30T22:21:57.854 INFO:tasks.ceph.mds.a:Started 2023-09-30T22:21:57.855 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-09-30T22:21:57.855 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:21:57.939 INFO:tasks.ceph.mds.a.smithi040.stdout:starting mds.a at 2023-09-30T22:21:57.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.985+0000 7fd623951700 1 Processor -- start 2023-09-30T22:21:57.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.985+0000 7fd623951700 1 -- start start 2023-09-30T22:21:57.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.985+0000 7fd623951700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd61c068240 0x7fd61c068620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:57.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.986+0000 7fd623951700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd61c068b10 0x7fd61c127c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:57.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.986+0000 7fd623951700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd61c128110 0x7fd61c1285c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:57.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.986+0000 7fd623951700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd61c128ab0 con 0x7fd61c068b10 2023-09-30T22:21:57.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.986+0000 7fd623951700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c069ed0 con 0x7fd61c068240 2023-09-30T22:21:57.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.986+0000 7fd623951700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c069460 con 0x7fd61c128110 2023-09-30T22:21:57.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.986+0000 7fd6216ed700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd61c068240 0x7fd61c068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:57.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.986+0000 7fd620eec700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd61c068b10 0x7fd61c127c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:57.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.986+0000 7fd621eee700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd61c128110 0x7fd61c1285c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:57.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.986+0000 7fd6216ed700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd61c068240 0x7fd61c068620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48728/0 (socket says 172.21.15.40:48728) 2023-09-30T22:21:57.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.986+0000 7fd620eec700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd61c068b10 0x7fd61c127c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44088/0 (socket says 172.21.15.40:44088) 2023-09-30T22:21:57.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.986+0000 7fd6216ed700 1 -- 172.21.15.40:0/3152887165 learned_addr learned my addr 172.21.15.40:0/3152887165 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:21:57.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.986+0000 7fd621eee700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd61c128110 0x7fd61c1285c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58650/0 (socket says 172.21.15.40:58650) 2023-09-30T22:21:57.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.986+0000 7fd6216ed700 1 -- 172.21.15.40:0/3152887165 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd61c128110 msgr2=0x7fd61c1285c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:57.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.986+0000 7fd6216ed700 1 --2- 172.21.15.40:0/3152887165 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd61c128110 0x7fd61c1285c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:57.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.986+0000 7fd6216ed700 1 -- 172.21.15.40:0/3152887165 >> v2:172.21.15.40:3300/0 conn(0x7fd61c068b10 msgr2=0x7fd61c127c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:57.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.986+0000 7fd6216ed700 1 --2- 172.21.15.40:0/3152887165 >> v2:172.21.15.40:3300/0 conn(0x7fd61c068b10 0x7fd61c127c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:57.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.986+0000 7fd6216ed700 1 -- 172.21.15.40:0/3152887165 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd61c069810 con 0x7fd61c068240 2023-09-30T22:21:57.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.986+0000 7fd620eec700 1 --2- 172.21.15.40:0/3152887165 >> v2:172.21.15.40:3300/0 conn(0x7fd61c068b10 0x7fd61c127c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:57.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.986+0000 7fd621eee700 1 --2- 172.21.15.40:0/3152887165 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd61c128110 0x7fd61c1285c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:57.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.986+0000 7fd6216ed700 1 --2- 172.21.15.40:0/3152887165 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd61c068240 0x7fd61c068620 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fd60c009830 tx=0x7fd60c0090f0).ready entity=mon.1 client_cookie=c9175a7f14128478 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:57.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.986+0000 7fd613fff700 1 -- 172.21.15.40:0/3152887165 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c00f510 con 0x7fd61c068240 2023-09-30T22:21:57.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.986+0000 7fd613fff700 1 -- 172.21.15.40:0/3152887165 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60c00f670 con 0x7fd61c068240 2023-09-30T22:21:57.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.986+0000 7fd613fff700 1 -- 172.21.15.40:0/3152887165 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c00fa10 con 0x7fd61c068240 2023-09-30T22:21:57.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.987+0000 7fd623951700 1 -- 172.21.15.40:0/3152887165 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd61c068240 msgr2=0x7fd61c068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.987+0000 7fd623951700 1 --2- 172.21.15.40:0/3152887165 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd61c068240 0x7fd61c068620 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fd60c009830 tx=0x7fd60c0090f0).stop 2023-09-30T22:21:57.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.987+0000 7fd623951700 1 -- 172.21.15.40:0/3152887165 shutdown_connections 2023-09-30T22:21:57.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.987+0000 7fd623951700 1 --2- 172.21.15.40:0/3152887165 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd61c128110 0x7fd61c1285c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:57.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.987+0000 7fd623951700 1 --2- 172.21.15.40:0/3152887165 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd61c068240 0x7fd61c068620 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:57.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.987+0000 7fd623951700 1 --2- 172.21.15.40:0/3152887165 >> v2:172.21.15.40:3300/0 conn(0x7fd61c068b10 0x7fd61c127c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:57.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.987+0000 7fd623951700 1 -- 172.21.15.40:0/3152887165 >> 172.21.15.40:0/3152887165 conn(0x7fd61c09a450 msgr2=0x7fd61c09a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:57.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.987+0000 7fd623951700 1 -- 172.21.15.40:0/3152887165 shutdown_connections 2023-09-30T22:21:57.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.987+0000 7fd623951700 1 -- 172.21.15.40:0/3152887165 wait complete. 2023-09-30T22:21:57.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.988+0000 7fd623951700 1 Processor -- start 2023-09-30T22:21:57.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.988+0000 7fd623951700 1 -- start start 2023-09-30T22:21:57.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.988+0000 7fd623951700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd61c068240 0x7fd61c1183d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:57.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.988+0000 7fd623951700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd61c068b10 0x7fd61c1188c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:57.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.988+0000 7fd623951700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd61c128110 0x7fd61c118db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:57.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.988+0000 7fd623951700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c127cc0 con 0x7fd61c128110 2023-09-30T22:21:57.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.988+0000 7fd623951700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c0974e0 con 0x7fd61c068b10 2023-09-30T22:21:57.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.988+0000 7fd623951700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c119760 con 0x7fd61c068240 2023-09-30T22:21:57.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.989+0000 7fd6216ed700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd61c068240 0x7fd61c1183d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:57.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.989+0000 7fd620eec700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd61c068b10 0x7fd61c1188c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:57.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.989+0000 7fd6216ed700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd61c068240 0x7fd61c1183d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58654/0 (socket says 172.21.15.40:58654) 2023-09-30T22:21:57.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.989+0000 7fd621eee700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd61c128110 0x7fd61c118db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:57.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.989+0000 7fd6216ed700 1 -- 172.21.15.40:0/3432444820 learned_addr learned my addr 172.21.15.40:0/3432444820 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:21:57.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.989+0000 7fd620eec700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd61c068b10 0x7fd61c1188c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48744/0 (socket says 172.21.15.40:48744) 2023-09-30T22:21:57.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.989+0000 7fd6216ed700 1 -- 172.21.15.40:0/3432444820 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd61c068b10 msgr2=0x7fd61c1188c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.989+0000 7fd6216ed700 1 --2- 172.21.15.40:0/3432444820 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd61c068b10 0x7fd61c1188c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:57.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.989+0000 7fd6216ed700 1 -- 172.21.15.40:0/3432444820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd61c128110 msgr2=0x7fd61c118db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.989+0000 7fd6216ed700 1 --2- 172.21.15.40:0/3432444820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd61c128110 0x7fd61c118db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:57.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.989+0000 7fd6216ed700 1 -- 172.21.15.40:0/3432444820 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6180092a0 con 0x7fd61c068240 2023-09-30T22:21:57.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.989+0000 7fd620eec700 1 --2- 172.21.15.40:0/3432444820 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd61c068b10 0x7fd61c1188c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:57.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.989+0000 7fd621eee700 1 --2- 172.21.15.40:0/3432444820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd61c128110 0x7fd61c118db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:57.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.989+0000 7fd6216ed700 1 --2- 172.21.15.40:0/3432444820 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd61c068240 0x7fd61c1183d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fd60c008000 tx=0x7fd60c015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:57.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.989+0000 7fd6117fa700 1 -- 172.21.15.40:0/3432444820 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c00fe50 con 0x7fd61c068240 2023-09-30T22:21:57.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.989+0000 7fd6117fa700 1 -- 172.21.15.40:0/3432444820 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60c00f7e0 con 0x7fd61c068240 2023-09-30T22:21:57.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.989+0000 7fd623951700 1 -- 172.21.15.40:0/3432444820 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd614009a20 con 0x7fd61c068240 2023-09-30T22:21:57.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.989+0000 7fd6117fa700 1 -- 172.21.15.40:0/3432444820 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c023420 con 0x7fd61c068240 2023-09-30T22:21:57.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.989+0000 7fd623951700 1 -- 172.21.15.40:0/3432444820 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd60c009370 con 0x7fd61c068240 2023-09-30T22:21:57.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.990+0000 7fd6117fa700 1 -- 172.21.15.40:0/3432444820 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fd60c021070 con 0x7fd61c068240 2023-09-30T22:21:57.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.990+0000 7fd6117fa700 1 -- 172.21.15.40:0/3432444820 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fd60c03c3c0 con 0x7fd61c068240 2023-09-30T22:21:57.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.990+0000 7fd623951700 1 -- 172.21.15.40:0/3432444820 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd61c05a260 con 0x7fd61c068240 2023-09-30T22:21:57.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:57.995+0000 7fd6117fa700 1 -- 172.21.15.40:0/3432444820 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fd60c028030 con 0x7fd61c068240 2023-09-30T22:21:58.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.163+0000 7fd623951700 1 -- 172.21.15.40:0/3432444820 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd61c046c20 con 0x7fd61c068240 2023-09-30T22:21:58.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.164+0000 7fd6117fa700 1 -- 172.21.15.40:0/3432444820 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+8137 (secure 0 0 0) 0x7fd60c010580 con 0x7fd61c068240 2023-09-30T22:21:58.164 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:21:58.165 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":12,"fsid":"79dd4d8e-f295-4d9c-bd93-9850863800e3","created":"2023-09-30T22:21:46.980357+0000","modified":"2023-09-30T22:21:57.826685+0000","last_up_change":"2023-09-30T22:21:54.822866+0000","last_in_change":"2023-09-30T22:21:48.205613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:21:54.875024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:21:56.197012+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"771f785c-f464-4b17-936c-cbf31b1153e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6812","nonce":119451}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6813","nonce":119451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6815","nonce":119451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6814","nonce":119451}]},"public_addr":"172.21.15.40:6812/119451","cluster_addr":"172.21.15.40:6813/119451","heartbeat_back_addr":"172.21.15.40:6815/119451","heartbeat_front_addr":"172.21.15.40:6814/119451","state":["exists","up"]},{"osd":1,"uuid":"45f1e2e8-5310-4219-ab54-424e7440fcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6808","nonce":119436}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6809","nonce":119436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6811","nonce":119436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6810","nonce":119436}]},"public_addr":"172.21.15.40:6808/119436","cluster_addr":"172.21.15.40:6809/119436","heartbeat_back_addr":"172.21.15.40:6811/119436","heartbeat_front_addr":"172.21.15.40:6810/119436","state":["exists","up"]},{"osd":2,"uuid":"7ba62ae5-d21e-4d56-b46c-ba7b718ede25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6800","nonce":119433}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6801","nonce":119433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6803","nonce":119433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6802","nonce":119433}]},"public_addr":"172.21.15.40:6800/119433","cluster_addr":"172.21.15.40:6801/119433","heartbeat_back_addr":"172.21.15.40:6803/119433","heartbeat_front_addr":"172.21.15.40:6802/119433","state":["exists","up"]},{"osd":3,"uuid":"c9c55985-8a90-4927-a8fa-6a1fcec1cd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6804","nonce":119432}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6805","nonce":119432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6807","nonce":119432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6806","nonce":119432}]},"public_addr":"172.21.15.40:6804/119432","cluster_addr":"172.21.15.40:6805/119432","heartbeat_back_addr":"172.21.15.40:6807/119432","heartbeat_front_addr":"172.21.15.40:6806/119432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.339829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.554690+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.641664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.320635+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:21:58.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.166+0000 7fd623951700 1 -- 172.21.15.40:0/3432444820 >> v1:172.21.15.40:6816/118905 conn(0x7fd60002bb60 legacy=0x7fd60002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.166+0000 7fd623951700 1 -- 172.21.15.40:0/3432444820 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd61c068240 msgr2=0x7fd61c1183d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.166+0000 7fd623951700 1 --2- 172.21.15.40:0/3432444820 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd61c068240 0x7fd61c1183d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fd60c008000 tx=0x7fd60c015000).stop 2023-09-30T22:21:58.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.166+0000 7fd623951700 1 -- 172.21.15.40:0/3432444820 shutdown_connections 2023-09-30T22:21:58.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.166+0000 7fd623951700 1 --2- 172.21.15.40:0/3432444820 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd61c068240 0x7fd61c1183d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:58.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.166+0000 7fd623951700 1 --2- 172.21.15.40:0/3432444820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd61c128110 0x7fd61c118db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:58.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.166+0000 7fd623951700 1 --2- 172.21.15.40:0/3432444820 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd61c068b10 0x7fd61c1188c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:58.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.166+0000 7fd623951700 1 -- 172.21.15.40:0/3432444820 >> 172.21.15.40:0/3432444820 conn(0x7fd61c09a450 msgr2=0x7fd61c0965f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:58.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.166+0000 7fd623951700 1 -- 172.21.15.40:0/3432444820 shutdown_connections 2023-09-30T22:21:58.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.166+0000 7fd623951700 1 -- 172.21.15.40:0/3432444820 wait complete. 2023-09-30T22:21:58.178 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-09-30T22:21:54.875024+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:21:56.197012+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-09-30T22:21:58.179 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-09-30T22:21:58.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.301+0000 7efd6ecc3700 1 Processor -- start 2023-09-30T22:21:58.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.301+0000 7efd6ecc3700 1 -- start start 2023-09-30T22:21:58.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.302+0000 7efd6ecc3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd6805e090 0x7efd68095780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:58.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.302+0000 7efd6ecc3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd68095c70 0x7efd68096050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:58.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.302+0000 7efd6ecc3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efd6812f2c0 0x7efd681316b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:58.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.302+0000 7efd6ecc3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd6805e470 con 0x7efd6812f2c0 2023-09-30T22:21:58.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.302+0000 7efd6ecc3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd680924b0 con 0x7efd6805e090 2023-09-30T22:21:58.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.302+0000 7efd6ecc3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd6805eb80 con 0x7efd68095c70 2023-09-30T22:21:58.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.302+0000 7efd6d260700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efd6812f2c0 0x7efd681316b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:58.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.302+0000 7efd6ca5f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd6805e090 0x7efd68095780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:58.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.302+0000 7efd67fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd68095c70 0x7efd68096050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:58.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.302+0000 7efd6d260700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efd6812f2c0 0x7efd681316b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44118/0 (socket says 172.21.15.40:44118) 2023-09-30T22:21:58.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.302+0000 7efd6d260700 1 -- 172.21.15.40:0/3809237341 learned_addr learned my addr 172.21.15.40:0/3809237341 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:21:58.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.302+0000 7efd67fff700 1 --2- 172.21.15.40:0/3809237341 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd68095c70 0x7efd68096050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58670/0 (socket says 172.21.15.40:58670) 2023-09-30T22:21:58.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.302+0000 7efd6ca5f700 1 -- 172.21.15.40:0/3809237341 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd68095c70 msgr2=0x7efd68096050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:58.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.302+0000 7efd6ca5f700 1 --2- 172.21.15.40:0/3809237341 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd68095c70 0x7efd68096050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:58.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.302+0000 7efd6ca5f700 1 -- 172.21.15.40:0/3809237341 >> v2:172.21.15.40:3300/0 conn(0x7efd6812f2c0 msgr2=0x7efd681316b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:58.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.302+0000 7efd6ca5f700 1 --2- 172.21.15.40:0/3809237341 >> v2:172.21.15.40:3300/0 conn(0x7efd6812f2c0 0x7efd681316b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:58.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.302+0000 7efd6ca5f700 1 -- 172.21.15.40:0/3809237341 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd68091a00 con 0x7efd6805e090 2023-09-30T22:21:58.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.302+0000 7efd6d260700 1 --2- 172.21.15.40:0/3809237341 >> v2:172.21.15.40:3300/0 conn(0x7efd6812f2c0 0x7efd681316b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:58.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.302+0000 7efd67fff700 1 --2- 172.21.15.40:0/3809237341 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd68095c70 0x7efd68096050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:58.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.302+0000 7efd6ca5f700 1 --2- 172.21.15.40:0/3809237341 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd6805e090 0x7efd68095780 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7efd5c009760 tx=0x7efd5c009060).ready entity=mon.1 client_cookie=d5d27d798510dd70 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:58.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.302+0000 7efd677fe700 1 -- 172.21.15.40:0/3809237341 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c00d4a0 con 0x7efd6805e090 2023-09-30T22:21:58.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.302+0000 7efd677fe700 1 -- 172.21.15.40:0/3809237341 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5c00d600 con 0x7efd6805e090 2023-09-30T22:21:58.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.302+0000 7efd677fe700 1 -- 172.21.15.40:0/3809237341 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c00d980 con 0x7efd6805e090 2023-09-30T22:21:58.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.303+0000 7efd6ecc3700 1 -- 172.21.15.40:0/3809237341 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd6805e090 msgr2=0x7efd68095780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.303+0000 7efd6ecc3700 1 --2- 172.21.15.40:0/3809237341 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd6805e090 0x7efd68095780 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7efd5c009760 tx=0x7efd5c009060).stop 2023-09-30T22:21:58.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.303+0000 7efd6ecc3700 1 -- 172.21.15.40:0/3809237341 shutdown_connections 2023-09-30T22:21:58.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.303+0000 7efd6ecc3700 1 --2- 172.21.15.40:0/3809237341 >> v2:172.21.15.40:3300/0 conn(0x7efd6812f2c0 0x7efd681316b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:58.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.303+0000 7efd6ecc3700 1 --2- 172.21.15.40:0/3809237341 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd6805e090 0x7efd68095780 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:58.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.303+0000 7efd6ecc3700 1 --2- 172.21.15.40:0/3809237341 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd68095c70 0x7efd68096050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:58.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.303+0000 7efd6ecc3700 1 -- 172.21.15.40:0/3809237341 >> 172.21.15.40:0/3809237341 conn(0x7efd6809aa60 msgr2=0x7efd6809ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:58.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.303+0000 7efd6ecc3700 1 -- 172.21.15.40:0/3809237341 shutdown_connections 2023-09-30T22:21:58.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.303+0000 7efd6ecc3700 1 -- 172.21.15.40:0/3809237341 wait complete. 2023-09-30T22:21:58.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.304+0000 7efd6ecc3700 1 Processor -- start 2023-09-30T22:21:58.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.304+0000 7efd6ecc3700 1 -- start start 2023-09-30T22:21:58.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.304+0000 7efd6ecc3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd6805e090 0x7efd68118aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:58.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.304+0000 7efd6ecc3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd68095c70 0x7efd68118f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:58.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.305+0000 7efd6ecc3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd6812f2c0 0x7efd68119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:58.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.305+0000 7efd6ecc3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd68119970 con 0x7efd6812f2c0 2023-09-30T22:21:58.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.305+0000 7efd6ecc3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd68099c70 con 0x7efd6805e090 2023-09-30T22:21:58.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.305+0000 7efd6ecc3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd6811d100 con 0x7efd68095c70 2023-09-30T22:21:58.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.305+0000 7efd6ca5f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd6805e090 0x7efd68118aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:58.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.305+0000 7efd6ca5f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd6805e090 0x7efd68118aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48764/0 (socket says 172.21.15.40:48764) 2023-09-30T22:21:58.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.305+0000 7efd6ca5f700 1 -- 172.21.15.40:0/2355447445 learned_addr learned my addr 172.21.15.40:0/2355447445 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:21:58.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.305+0000 7efd6d260700 1 --2- 172.21.15.40:0/2355447445 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd6812f2c0 0x7efd68119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:58.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.305+0000 7efd67fff700 1 --2- 172.21.15.40:0/2355447445 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd68095c70 0x7efd68118f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:58.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.305+0000 7efd6ca5f700 1 -- 172.21.15.40:0/2355447445 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd68095c70 msgr2=0x7efd68118f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.305+0000 7efd6ca5f700 1 --2- 172.21.15.40:0/2355447445 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd68095c70 0x7efd68118f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:58.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.305+0000 7efd6ca5f700 1 -- 172.21.15.40:0/2355447445 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd6812f2c0 msgr2=0x7efd68119480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.305+0000 7efd6ca5f700 1 --2- 172.21.15.40:0/2355447445 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd6812f2c0 0x7efd68119480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:58.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.305+0000 7efd6ca5f700 1 -- 172.21.15.40:0/2355447445 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd540092a0 con 0x7efd6805e090 2023-09-30T22:21:58.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.305+0000 7efd6d260700 1 --2- 172.21.15.40:0/2355447445 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd6812f2c0 0x7efd68119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:58.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.305+0000 7efd6ca5f700 1 --2- 172.21.15.40:0/2355447445 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd6805e090 0x7efd68118aa0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7efd5c011fb0 tx=0x7efd5c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:58.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.305+0000 7efd64ff9700 1 -- 172.21.15.40:0/2355447445 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c00dd30 con 0x7efd6805e090 2023-09-30T22:21:58.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.305+0000 7efd64ff9700 1 -- 172.21.15.40:0/2355447445 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5c00de90 con 0x7efd6805e090 2023-09-30T22:21:58.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.305+0000 7efd6ecc3700 1 -- 172.21.15.40:0/2355447445 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd60009ae0 con 0x7efd6805e090 2023-09-30T22:21:58.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.305+0000 7efd64ff9700 1 -- 172.21.15.40:0/2355447445 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c00d980 con 0x7efd6805e090 2023-09-30T22:21:58.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.305+0000 7efd6ecc3700 1 -- 172.21.15.40:0/2355447445 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd5c0092a0 con 0x7efd6805e090 2023-09-30T22:21:58.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.306+0000 7efd64ff9700 1 -- 172.21.15.40:0/2355447445 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7efd5c01d640 con 0x7efd6805e090 2023-09-30T22:21:58.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.306+0000 7efd64ff9700 1 -- 172.21.15.40:0/2355447445 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7efd5c03c270 con 0x7efd6805e090 2023-09-30T22:21:58.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.307+0000 7efd6ecc3700 1 -- 172.21.15.40:0/2355447445 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd6805a260 con 0x7efd6805e090 2023-09-30T22:21:58.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.311+0000 7efd64ff9700 1 -- 172.21.15.40:0/2355447445 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7efd5c01d8f0 con 0x7efd6805e090 2023-09-30T22:21:58.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.477+0000 7efd6ecc3700 1 -- 172.21.15.40:0/2355447445 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7efd680967d0 con 0x7efd6805e090 2023-09-30T22:21:58.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.478+0000 7efd64ff9700 1 -- 172.21.15.40:0/2355447445 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v12) v1 ==== 110+0+10 (secure 0 0 0) 0x7efd5c010360 con 0x7efd6805e090 2023-09-30T22:21:58.478 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-09-30T22:21:58.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.480+0000 7efd6ecc3700 1 -- 172.21.15.40:0/2355447445 >> v1:172.21.15.40:6816/118905 conn(0x7efd4c02bb60 legacy=0x7efd4c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.480+0000 7efd6ecc3700 1 -- 172.21.15.40:0/2355447445 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd6805e090 msgr2=0x7efd68118aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.480+0000 7efd6ecc3700 1 --2- 172.21.15.40:0/2355447445 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd6805e090 0x7efd68118aa0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7efd5c011fb0 tx=0x7efd5c016000).stop 2023-09-30T22:21:58.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.480+0000 7efd6ecc3700 1 -- 172.21.15.40:0/2355447445 shutdown_connections 2023-09-30T22:21:58.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.480+0000 7efd6ecc3700 1 --2- 172.21.15.40:0/2355447445 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd6812f2c0 0x7efd68119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:58.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.480+0000 7efd6ecc3700 1 --2- 172.21.15.40:0/2355447445 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd6805e090 0x7efd68118aa0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:58.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.480+0000 7efd6ecc3700 1 --2- 172.21.15.40:0/2355447445 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd68095c70 0x7efd68118f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:58.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.480+0000 7efd6ecc3700 1 -- 172.21.15.40:0/2355447445 >> 172.21.15.40:0/2355447445 conn(0x7efd6809aa60 msgr2=0x7efd6812df20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:58.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.480+0000 7efd6ecc3700 1 -- 172.21.15.40:0/2355447445 shutdown_connections 2023-09-30T22:21:58.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.480+0000 7efd6ecc3700 1 -- 172.21.15.40:0/2355447445 wait complete. 2023-09-30T22:21:58.492 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:21:58.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.614+0000 7fd039162700 1 Processor -- start 2023-09-30T22:21:58.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.614+0000 7fd039162700 1 -- start start 2023-09-30T22:21:58.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.615+0000 7fd039162700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd0340657e0 0x7fd034096620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:58.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.615+0000 7fd039162700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd034097ec0 0x7fd034096b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:58.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.615+0000 7fd039162700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd034098350 con 0x7fd034097000 2023-09-30T22:21:58.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.615+0000 7fd039162700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd034065bc0 con 0x7fd034097ec0 2023-09-30T22:21:58.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.615+0000 7fd039162700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd034096350 con 0x7fd0340657e0 2023-09-30T22:21:58.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.615+0000 7fd032d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd0340657e0 0x7fd034096620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:58.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.615+0000 7fd032d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd0340657e0 0x7fd034096620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58678/0 (socket says 172.21.15.40:58678) 2023-09-30T22:21:58.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.615+0000 7fd032d9d700 1 -- 172.21.15.40:0/71910413 learned_addr learned my addr 172.21.15.40:0/71910413 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:21:58.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.615+0000 7fd03259c700 1 --2- 172.21.15.40:0/71910413 >> v2:172.21.15.40:3300/0 conn(0x7fd034097ec0 0x7fd034096b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:58.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.615+0000 7fd03259c700 1 -- 172.21.15.40:0/71910413 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd0340657e0 msgr2=0x7fd034096620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:58.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.615+0000 7fd03259c700 1 --2- 172.21.15.40:0/71910413 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd0340657e0 0x7fd034096620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:58.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.615+0000 7fd03259c700 1 -- 172.21.15.40:0/71910413 >> v1:172.21.15.40:6789/0 conn(0x7fd034097000 legacy=0x7fd034131650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.615+0000 7fd031d9b700 1 -- 172.21.15.40:0/71910413 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 733334725 0 0) 0x7fd034098350 con 0x7fd034097000 2023-09-30T22:21:58.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.615+0000 7fd03259c700 1 -- 172.21.15.40:0/71910413 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0340662b0 con 0x7fd034097ec0 2023-09-30T22:21:58.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.615+0000 7fd032d9d700 1 --2- 172.21.15.40:0/71910413 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd0340657e0 0x7fd034096620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:58.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.615+0000 7fd03259c700 1 --2- 172.21.15.40:0/71910413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd034097ec0 0x7fd034096b10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fd024009760 tx=0x7fd024009060).ready entity=mon.0 client_cookie=e801a28066a47ac3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:58.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.615+0000 7fd031d9b700 1 -- 172.21.15.40:0/71910413 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0240090d0 con 0x7fd034097ec0 2023-09-30T22:21:58.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.616+0000 7fd031d9b700 1 -- 172.21.15.40:0/71910413 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd02400f510 con 0x7fd034097ec0 2023-09-30T22:21:58.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.616+0000 7fd031d9b700 1 -- 172.21.15.40:0/71910413 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02400f890 con 0x7fd034097ec0 2023-09-30T22:21:58.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.616+0000 7fd039162700 1 -- 172.21.15.40:0/71910413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd034097ec0 msgr2=0x7fd034096b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.616+0000 7fd039162700 1 --2- 172.21.15.40:0/71910413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd034097ec0 0x7fd034096b10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fd024009760 tx=0x7fd024009060).stop 2023-09-30T22:21:58.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.616+0000 7fd039162700 1 -- 172.21.15.40:0/71910413 shutdown_connections 2023-09-30T22:21:58.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.616+0000 7fd039162700 1 --2- 172.21.15.40:0/71910413 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd0340657e0 0x7fd034096620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:58.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.616+0000 7fd039162700 1 --2- 172.21.15.40:0/71910413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd034097ec0 0x7fd034096b10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:58.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.616+0000 7fd039162700 1 -- 172.21.15.40:0/71910413 >> 172.21.15.40:0/71910413 conn(0x7fd03409de50 msgr2=0x7fd03409e260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:58.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.616+0000 7fd039162700 1 -- 172.21.15.40:0/71910413 shutdown_connections 2023-09-30T22:21:58.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.616+0000 7fd039162700 1 -- 172.21.15.40:0/71910413 wait complete. 2023-09-30T22:21:58.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.617+0000 7fd039162700 1 Processor -- start 2023-09-30T22:21:58.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.617+0000 7fd039162700 1 -- start start 2023-09-30T22:21:58.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.617+0000 7fd039162700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0340657e0 0x7fd03411b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:58.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.617+0000 7fd039162700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd034097000 0x7fd034117310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:58.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.617+0000 7fd039162700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd034117800 0x7fd034117c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:58.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.617+0000 7fd039162700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd034118170 con 0x7fd0340657e0 2023-09-30T22:21:58.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.617+0000 7fd039162700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd03411a770 con 0x7fd034097000 2023-09-30T22:21:58.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.617+0000 7fd039162700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd03411a330 con 0x7fd034117800 2023-09-30T22:21:58.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.618+0000 7fd03259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd034097000 0x7fd034117310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:58.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.618+0000 7fd03359e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd034117800 0x7fd034117c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:58.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.618+0000 7fd03259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd034097000 0x7fd034117310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48770/0 (socket says 172.21.15.40:48770) 2023-09-30T22:21:58.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.618+0000 7fd03259c700 1 -- 172.21.15.40:0/441454780 learned_addr learned my addr 172.21.15.40:0/441454780 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:21:58.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.618+0000 7fd03359e700 1 --2- 172.21.15.40:0/441454780 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd034117800 0x7fd034117c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58690/0 (socket says 172.21.15.40:58690) 2023-09-30T22:21:58.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.618+0000 7fd032d9d700 1 --2- 172.21.15.40:0/441454780 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0340657e0 0x7fd03411b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:58.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.618+0000 7fd03359e700 1 -- 172.21.15.40:0/441454780 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd034097000 msgr2=0x7fd034117310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.618+0000 7fd03359e700 1 --2- 172.21.15.40:0/441454780 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd034097000 0x7fd034117310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:58.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.618+0000 7fd03359e700 1 -- 172.21.15.40:0/441454780 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0340657e0 msgr2=0x7fd03411b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.618+0000 7fd03359e700 1 --2- 172.21.15.40:0/441454780 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0340657e0 0x7fd03411b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:58.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.618+0000 7fd03359e700 1 -- 172.21.15.40:0/441454780 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd028009370 con 0x7fd034117800 2023-09-30T22:21:58.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.618+0000 7fd03259c700 1 --2- 172.21.15.40:0/441454780 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd034097000 0x7fd034117310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:58.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.618+0000 7fd032d9d700 1 --2- 172.21.15.40:0/441454780 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0340657e0 0x7fd03411b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:58.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.618+0000 7fd03359e700 1 --2- 172.21.15.40:0/441454780 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd034117800 0x7fd034117c80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fd02c0012e0 tx=0x7fd02c007ee0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:58.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.618+0000 7fd01affd700 1 -- 172.21.15.40:0/441454780 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02c00e4a0 con 0x7fd034117800 2023-09-30T22:21:58.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.618+0000 7fd01affd700 1 -- 172.21.15.40:0/441454780 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd02c00e600 con 0x7fd034117800 2023-09-30T22:21:58.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.618+0000 7fd039162700 1 -- 172.21.15.40:0/441454780 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0240092a0 con 0x7fd034117800 2023-09-30T22:21:58.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.618+0000 7fd01affd700 1 -- 172.21.15.40:0/441454780 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02c00e9a0 con 0x7fd034117800 2023-09-30T22:21:58.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.618+0000 7fd039162700 1 -- 172.21.15.40:0/441454780 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd034099d70 con 0x7fd034117800 2023-09-30T22:21:58.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.619+0000 7fd01affd700 1 -- 172.21.15.40:0/441454780 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fd02c012400 con 0x7fd034117800 2023-09-30T22:21:58.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.619+0000 7fd01affd700 1 -- 172.21.15.40:0/441454780 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fd02c03a430 con 0x7fd034117800 2023-09-30T22:21:58.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.619+0000 7fd039162700 1 -- 172.21.15.40:0/441454780 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd03409e950 con 0x7fd034117800 2023-09-30T22:21:58.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.624+0000 7fd01affd700 1 -- 172.21.15.40:0/441454780 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fd02c0126b0 con 0x7fd034117800 2023-09-30T22:21:58.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.788+0000 7fd039162700 1 -- 172.21.15.40:0/441454780 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd0340994c0 con 0x7fd034117800 2023-09-30T22:21:58.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.788+0000 7fd01affd700 1 -- 172.21.15.40:0/441454780 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v12) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd02c010af0 con 0x7fd034117800 2023-09-30T22:21:58.789 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-09-30T22:21:58.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.790+0000 7fd039162700 1 -- 172.21.15.40:0/441454780 >> v1:172.21.15.40:6816/118905 conn(0x7fd02002bb60 legacy=0x7fd02002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.790+0000 7fd039162700 1 -- 172.21.15.40:0/441454780 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd034117800 msgr2=0x7fd034117c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.790+0000 7fd039162700 1 --2- 172.21.15.40:0/441454780 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd034117800 0x7fd034117c80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fd02c0012e0 tx=0x7fd02c007ee0).stop 2023-09-30T22:21:58.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.790+0000 7fd039162700 1 -- 172.21.15.40:0/441454780 shutdown_connections 2023-09-30T22:21:58.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.790+0000 7fd039162700 1 --2- 172.21.15.40:0/441454780 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd034117800 0x7fd034117c80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:58.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.790+0000 7fd039162700 1 --2- 172.21.15.40:0/441454780 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0340657e0 0x7fd03411b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:58.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.790+0000 7fd039162700 1 --2- 172.21.15.40:0/441454780 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd034097000 0x7fd034117310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:58.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.790+0000 7fd039162700 1 -- 172.21.15.40:0/441454780 >> 172.21.15.40:0/441454780 conn(0x7fd03409de50 msgr2=0x7fd03409bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:58.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.790+0000 7fd039162700 1 -- 172.21.15.40:0/441454780 shutdown_connections 2023-09-30T22:21:58.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.790+0000 7fd039162700 1 -- 172.21.15.40:0/441454780 wait complete. 2023-09-30T22:21:58.803 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:21:58.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.923+0000 7f38693e5700 1 Processor -- start 2023-09-30T22:21:58.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.923+0000 7f38693e5700 1 -- start start 2023-09-30T22:21:58.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.924+0000 7f38693e5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3864064f10 0x7f3864065f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:58.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.924+0000 7f38693e5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3864066460 0x7f386412b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:58.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.924+0000 7f38693e5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38640975c0 con 0x7f3864065ae0 2023-09-30T22:21:58.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.924+0000 7f38693e5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38640652f0 con 0x7f3864066460 2023-09-30T22:21:58.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.924+0000 7f38693e5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3864097870 con 0x7f3864064f10 2023-09-30T22:21:58.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.924+0000 7f3862ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3864064f10 0x7f3864065f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:58.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.924+0000 7f38637fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3864066460 0x7f386412b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:58.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.924+0000 7f38627fc700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3864065ae0 0x7f386412ab90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55866/0 (socket says 172.21.15.40:55866) 2023-09-30T22:21:58.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.924+0000 7f3862ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3864064f10 0x7f3864065f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58706/0 (socket says 172.21.15.40:58706) 2023-09-30T22:21:58.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.924+0000 7f38627fc700 1 -- 172.21.15.40:0/2072365358 learned_addr learned my addr 172.21.15.40:0/2072365358 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:21:58.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.924+0000 7f3862ffd700 1 -- 172.21.15.40:0/2072365358 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3864066460 msgr2=0x7f386412b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:58.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.924+0000 7f3862ffd700 1 --2- 172.21.15.40:0/2072365358 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3864066460 0x7f386412b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:58.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.924+0000 7f3861ffb700 1 -- 172.21.15.40:0/2072365358 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 128529989 0 0) 0x7f38640975c0 con 0x7f3864065ae0 2023-09-30T22:21:58.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.924+0000 7f3862ffd700 1 -- 172.21.15.40:0/2072365358 >> v1:172.21.15.40:6789/0 conn(0x7f3864065ae0 legacy=0x7f386412ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.924+0000 7f3862ffd700 1 -- 172.21.15.40:0/2072365358 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3864098490 con 0x7f3864064f10 2023-09-30T22:21:58.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.924+0000 7f38637fe700 1 --2- 172.21.15.40:0/2072365358 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3864066460 0x7f386412b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:58.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.924+0000 7f3862ffd700 1 --2- 172.21.15.40:0/2072365358 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3864064f10 0x7f3864065f70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f3854009790 tx=0x7f3854009060).ready entity=mon.2 client_cookie=2b1162d6589b04fb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:58.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.925+0000 7f3861ffb700 1 -- 172.21.15.40:0/2072365358 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385400f510 con 0x7f3864064f10 2023-09-30T22:21:58.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.925+0000 7f3861ffb700 1 -- 172.21.15.40:0/2072365358 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385400f670 con 0x7f3864064f10 2023-09-30T22:21:58.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.925+0000 7f3861ffb700 1 -- 172.21.15.40:0/2072365358 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385400fa40 con 0x7f3864064f10 2023-09-30T22:21:58.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.925+0000 7f38693e5700 1 -- 172.21.15.40:0/2072365358 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3864064f10 msgr2=0x7f3864065f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.925+0000 7f38693e5700 1 --2- 172.21.15.40:0/2072365358 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3864064f10 0x7f3864065f70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f3854009790 tx=0x7f3854009060).stop 2023-09-30T22:21:58.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.925+0000 7f38693e5700 1 -- 172.21.15.40:0/2072365358 shutdown_connections 2023-09-30T22:21:58.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.925+0000 7f38693e5700 1 --2- 172.21.15.40:0/2072365358 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3864066460 0x7f386412b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:58.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.925+0000 7f38693e5700 1 --2- 172.21.15.40:0/2072365358 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3864064f10 0x7f3864065f70 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:58.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.925+0000 7f38693e5700 1 -- 172.21.15.40:0/2072365358 >> 172.21.15.40:0/2072365358 conn(0x7f386405ec10 msgr2=0x7f386409bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:58.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.925+0000 7f38693e5700 1 -- 172.21.15.40:0/2072365358 shutdown_connections 2023-09-30T22:21:58.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.925+0000 7f38693e5700 1 -- 172.21.15.40:0/2072365358 wait complete. 2023-09-30T22:21:58.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.926+0000 7f38693e5700 1 Processor -- start 2023-09-30T22:21:58.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.926+0000 7f38693e5700 1 -- start start 2023-09-30T22:21:58.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.927+0000 7f38693e5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3864064f10 0x7f3864117480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:58.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.927+0000 7f38693e5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3864066460 0x7f3864117970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:58.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.927+0000 7f38693e5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3864117e60 0x7f3864140dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:58.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.927+0000 7f38693e5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38640658d0 con 0x7f3864064f10 2023-09-30T22:21:58.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.927+0000 7f38693e5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f386411acd0 con 0x7f3864117e60 2023-09-30T22:21:58.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.927+0000 7f38693e5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38641188d0 con 0x7f3864066460 2023-09-30T22:21:58.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.927+0000 7f38627fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3864066460 0x7f3864117970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:58.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.927+0000 7f3862ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3864064f10 0x7f3864117480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:58.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.927+0000 7f38637fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3864117e60 0x7f3864140dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:58.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.927+0000 7f3862ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3864064f10 0x7f3864117480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44166/0 (socket says 172.21.15.40:44166) 2023-09-30T22:21:58.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.927+0000 7f38627fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3864066460 0x7f3864117970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58716/0 (socket says 172.21.15.40:58716) 2023-09-30T22:21:58.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.927+0000 7f3862ffd700 1 -- 172.21.15.40:0/985568021 learned_addr learned my addr 172.21.15.40:0/985568021 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:21:58.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.927+0000 7f38637fe700 1 -- 172.21.15.40:0/985568021 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3864066460 msgr2=0x7f3864117970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.927+0000 7f38637fe700 1 --2- 172.21.15.40:0/985568021 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3864066460 0x7f3864117970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:58.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.927+0000 7f38637fe700 1 -- 172.21.15.40:0/985568021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3864064f10 msgr2=0x7f3864117480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.927+0000 7f38637fe700 1 --2- 172.21.15.40:0/985568021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3864064f10 0x7f3864117480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:58.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.927+0000 7f38637fe700 1 -- 172.21.15.40:0/985568021 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f385c009a20 con 0x7f3864117e60 2023-09-30T22:21:58.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.927+0000 7f3862ffd700 1 --2- 172.21.15.40:0/985568021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3864064f10 0x7f3864117480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:58.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.927+0000 7f38637fe700 1 --2- 172.21.15.40:0/985568021 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3864117e60 0x7f3864140dd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f385c009f10 tx=0x7f385c00b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:58.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.927+0000 7f385affd700 1 -- 172.21.15.40:0/985568021 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c00cb70 con 0x7f3864117e60 2023-09-30T22:21:58.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.928+0000 7f385affd700 1 -- 172.21.15.40:0/985568021 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385c00f040 con 0x7f3864117e60 2023-09-30T22:21:58.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.928+0000 7f38693e5700 1 -- 172.21.15.40:0/985568021 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38540092a0 con 0x7f3864117e60 2023-09-30T22:21:58.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.928+0000 7f385affd700 1 -- 172.21.15.40:0/985568021 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c00cee0 con 0x7f3864117e60 2023-09-30T22:21:58.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.928+0000 7f38693e5700 1 -- 172.21.15.40:0/985568021 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f386411aa10 con 0x7f3864117e60 2023-09-30T22:21:58.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.928+0000 7f385affd700 1 -- 172.21.15.40:0/985568021 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f385c013610 con 0x7f3864117e60 2023-09-30T22:21:58.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.928+0000 7f385affd700 1 -- 172.21.15.40:0/985568021 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f385c03b650 con 0x7f3864117e60 2023-09-30T22:21:58.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.929+0000 7f38693e5700 1 -- 172.21.15.40:0/985568021 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f386405a260 con 0x7f3864117e60 2023-09-30T22:21:58.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:58.933+0000 7f385affd700 1 -- 172.21.15.40:0/985568021 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f385c01d460 con 0x7f3864117e60 2023-09-30T22:21:59.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.142+0000 7f38693e5700 1 -- 172.21.15.40:0/985568021 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f386411aef0 con 0x7f3864117e60 2023-09-30T22:21:59.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.142+0000 7f385affd700 1 -- 172.21.15.40:0/985568021 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1196 (secure 0 0 0) 0x7f385c02c090 con 0x7f3864117e60 2023-09-30T22:21:59.143 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:21:59.143 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4194,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6817/2392027806","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6817","nonce":2392027806}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-09-30T22:21:59.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.144+0000 7f38693e5700 1 -- 172.21.15.40:0/985568021 >> v1:172.21.15.40:6816/118905 conn(0x7f384402bb90 legacy=0x7f384402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.144+0000 7f38693e5700 1 -- 172.21.15.40:0/985568021 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3864117e60 msgr2=0x7f3864140dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.144+0000 7f38693e5700 1 --2- 172.21.15.40:0/985568021 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3864117e60 0x7f3864140dd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f385c009f10 tx=0x7f385c00b040).stop 2023-09-30T22:21:59.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.144+0000 7f38693e5700 1 -- 172.21.15.40:0/985568021 shutdown_connections 2023-09-30T22:21:59.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.144+0000 7f38693e5700 1 --2- 172.21.15.40:0/985568021 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3864117e60 0x7f3864140dd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:59.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.144+0000 7f38693e5700 1 --2- 172.21.15.40:0/985568021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3864064f10 0x7f3864117480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:59.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.144+0000 7f38693e5700 1 --2- 172.21.15.40:0/985568021 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3864066460 0x7f3864117970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:59.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.144+0000 7f38693e5700 1 -- 172.21.15.40:0/985568021 >> 172.21.15.40:0/985568021 conn(0x7f386405ec10 msgr2=0x7f38640952b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:59.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.144+0000 7f38693e5700 1 -- 172.21.15.40:0/985568021 shutdown_connections 2023-09-30T22:21:59.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.144+0000 7f38693e5700 1 -- 172.21.15.40:0/985568021 wait complete. 2023-09-30T22:21:59.146 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 2 2023-09-30T22:21:59.157 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:21:59.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.276+0000 7f29e6795700 1 Processor -- start 2023-09-30T22:21:59.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.276+0000 7f29e6795700 1 -- start start 2023-09-30T22:21:59.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.277+0000 7f29e6795700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f29e0093b40 0x7f29e0094200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:59.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.277+0000 7f29e6795700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f29e0097310 0x7f29e00946f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:59.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.277+0000 7f29e6795700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29e0093340 con 0x7f29e0094be0 2023-09-30T22:21:59.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.277+0000 7f29e6795700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e0093f20 con 0x7f29e0093b40 2023-09-30T22:21:59.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.277+0000 7f29e6795700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29e0095060 con 0x7f29e0097310 2023-09-30T22:21:59.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.277+0000 7f29df7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f29e0097310 0x7f29e00946f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:59.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.277+0000 7f29dffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f29e0093b40 0x7f29e0094200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:59.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.277+0000 7f29e4d32700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f29e0094be0 0x7f29e012f4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55868/0 (socket says 172.21.15.40:55868) 2023-09-30T22:21:59.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.277+0000 7f29e4d32700 1 -- 172.21.15.40:0/3909915463 learned_addr learned my addr 172.21.15.40:0/3909915463 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:21:59.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.277+0000 7f29dffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f29e0093b40 0x7f29e0094200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44172/0 (socket says 172.21.15.40:44172) 2023-09-30T22:21:59.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.277+0000 7f29df7fe700 1 --2- 172.21.15.40:0/3909915463 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f29e0097310 0x7f29e00946f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58722/0 (socket says 172.21.15.40:58722) 2023-09-30T22:21:59.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.277+0000 7f29df7fe700 1 -- 172.21.15.40:0/3909915463 >> v2:172.21.15.40:3300/0 conn(0x7f29e0093b40 msgr2=0x7f29e0094200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:59.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.277+0000 7f29df7fe700 1 --2- 172.21.15.40:0/3909915463 >> v2:172.21.15.40:3300/0 conn(0x7f29e0093b40 0x7f29e0094200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:59.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.277+0000 7f29df7fe700 1 -- 172.21.15.40:0/3909915463 >> v1:172.21.15.40:6789/0 conn(0x7f29e0094be0 legacy=0x7f29e012f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.277+0000 7f29df7fe700 1 -- 172.21.15.40:0/3909915463 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e00961c0 con 0x7f29e0097310 2023-09-30T22:21:59.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.277+0000 7f29deffd700 1 -- 172.21.15.40:0/3909915463 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 232603326 0 0) 0x7f29e0093340 con 0x7f29e0094be0 2023-09-30T22:21:59.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.277+0000 7f29dffff700 1 --2- 172.21.15.40:0/3909915463 >> v2:172.21.15.40:3300/0 conn(0x7f29e0093b40 0x7f29e0094200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:59.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.278+0000 7f29df7fe700 1 --2- 172.21.15.40:0/3909915463 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f29e0097310 0x7f29e00946f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f29d4009760 tx=0x7f29d4009060).ready entity=mon.2 client_cookie=b14f7926ebfd4de server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:59.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.278+0000 7f29deffd700 1 -- 172.21.15.40:0/3909915463 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d400f510 con 0x7f29e0097310 2023-09-30T22:21:59.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.278+0000 7f29deffd700 1 -- 172.21.15.40:0/3909915463 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d400f670 con 0x7f29e0097310 2023-09-30T22:21:59.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.278+0000 7f29deffd700 1 -- 172.21.15.40:0/3909915463 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d400f9f0 con 0x7f29e0097310 2023-09-30T22:21:59.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.278+0000 7f29e6795700 1 -- 172.21.15.40:0/3909915463 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f29e0097310 msgr2=0x7f29e00946f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.278+0000 7f29e6795700 1 --2- 172.21.15.40:0/3909915463 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f29e0097310 0x7f29e00946f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f29d4009760 tx=0x7f29d4009060).stop 2023-09-30T22:21:59.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.278+0000 7f29e6795700 1 -- 172.21.15.40:0/3909915463 shutdown_connections 2023-09-30T22:21:59.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.278+0000 7f29e6795700 1 --2- 172.21.15.40:0/3909915463 >> v2:172.21.15.40:3300/0 conn(0x7f29e0093b40 0x7f29e0094200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:59.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.278+0000 7f29e6795700 1 --2- 172.21.15.40:0/3909915463 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f29e0097310 0x7f29e00946f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:59.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.278+0000 7f29e6795700 1 -- 172.21.15.40:0/3909915463 >> 172.21.15.40:0/3909915463 conn(0x7f29e005ec10 msgr2=0x7f29e009bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:59.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.278+0000 7f29e6795700 1 -- 172.21.15.40:0/3909915463 shutdown_connections 2023-09-30T22:21:59.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.278+0000 7f29e6795700 1 -- 172.21.15.40:0/3909915463 wait complete. 2023-09-30T22:21:59.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.279+0000 7f29e6795700 1 Processor -- start 2023-09-30T22:21:59.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.279+0000 7f29e6795700 1 -- start start 2023-09-30T22:21:59.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.280+0000 7f29e6795700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f29e0093b40 0x7f29e0118e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:59.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.280+0000 7f29e6795700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29e0094be0 0x7f29e0119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:59.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.280+0000 7f29e6795700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29e0097310 0x7f29e0119820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:59.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.280+0000 7f29e6795700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e0118c50 con 0x7f29e0097310 2023-09-30T22:21:59.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.280+0000 7f29e6795700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e009a740 con 0x7f29e0094be0 2023-09-30T22:21:59.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.280+0000 7f29e6795700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29e006a8a0 con 0x7f29e0093b40 2023-09-30T22:21:59.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.280+0000 7f29e4d32700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29e0097310 0x7f29e0119820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:59.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.280+0000 7f29df7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29e0094be0 0x7f29e0119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:59.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.280+0000 7f29dffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f29e0093b40 0x7f29e0118e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:59.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.280+0000 7f29e4d32700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29e0097310 0x7f29e0119820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44178/0 (socket says 172.21.15.40:44178) 2023-09-30T22:21:59.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.280+0000 7f29df7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29e0094be0 0x7f29e0119330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48800/0 (socket says 172.21.15.40:48800) 2023-09-30T22:21:59.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.280+0000 7f29e4d32700 1 -- 172.21.15.40:0/2476126459 learned_addr learned my addr 172.21.15.40:0/2476126459 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:21:59.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.280+0000 7f29e4d32700 1 -- 172.21.15.40:0/2476126459 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f29e0093b40 msgr2=0x7f29e0118e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.280+0000 7f29e4d32700 1 --2- 172.21.15.40:0/2476126459 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f29e0093b40 0x7f29e0118e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:59.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.280+0000 7f29e4d32700 1 -- 172.21.15.40:0/2476126459 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29e0094be0 msgr2=0x7f29e0119330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.280+0000 7f29e4d32700 1 --2- 172.21.15.40:0/2476126459 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29e0094be0 0x7f29e0119330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:59.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.280+0000 7f29e4d32700 1 -- 172.21.15.40:0/2476126459 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d00092a0 con 0x7f29e0097310 2023-09-30T22:21:59.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.280+0000 7f29dffff700 1 --2- 172.21.15.40:0/2476126459 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f29e0093b40 0x7f29e0118e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:59.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.280+0000 7f29df7fe700 1 --2- 172.21.15.40:0/2476126459 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29e0094be0 0x7f29e0119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:59.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.280+0000 7f29e4d32700 1 --2- 172.21.15.40:0/2476126459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29e0097310 0x7f29e0119820 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f29d800c7e0 tx=0x7f29d8007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:59.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.280+0000 7f29c7fff700 1 -- 172.21.15.40:0/2476126459 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d8005d30 con 0x7f29e0097310 2023-09-30T22:21:59.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.280+0000 7f29c7fff700 1 -- 172.21.15.40:0/2476126459 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d8005e90 con 0x7f29e0097310 2023-09-30T22:21:59.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.280+0000 7f29c7fff700 1 -- 172.21.15.40:0/2476126459 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d8007320 con 0x7f29e0097310 2023-09-30T22:21:59.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.280+0000 7f29e6795700 1 -- 172.21.15.40:0/2476126459 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d40092a0 con 0x7f29e0097310 2023-09-30T22:21:59.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.281+0000 7f29e6795700 1 -- 172.21.15.40:0/2476126459 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e011c8f0 con 0x7f29e0097310 2023-09-30T22:21:59.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.281+0000 7f29c7fff700 1 -- 172.21.15.40:0/2476126459 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f29d8007710 con 0x7f29e0097310 2023-09-30T22:21:59.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.281+0000 7f29c7fff700 1 -- 172.21.15.40:0/2476126459 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f29d803abe0 con 0x7f29e0097310 2023-09-30T22:21:59.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.282+0000 7f29e6795700 1 -- 172.21.15.40:0/2476126459 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29e011c190 con 0x7f29e0097310 2023-09-30T22:21:59.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.286+0000 7f29c7fff700 1 -- 172.21.15.40:0/2476126459 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f29e011c190 con 0x7f29e0097310 2023-09-30T22:21:59.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.456+0000 7f29e6795700 1 -- 172.21.15.40:0/2476126459 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29e011c190 con 0x7f29e0097310 2023-09-30T22:21:59.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.457+0000 7f29c7fff700 1 -- 172.21.15.40:0/2476126459 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+8124 (secure 0 0 0) 0x7f29e011c190 con 0x7f29e0097310 2023-09-30T22:21:59.458 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:21:59.458 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":13,"fsid":"79dd4d8e-f295-4d9c-bd93-9850863800e3","created":"2023-09-30T22:21:46.980357+0000","modified":"2023-09-30T22:21:58.827992+0000","last_up_change":"2023-09-30T22:21:54.822866+0000","last_in_change":"2023-09-30T22:21:48.205613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:21:54.875024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:21:56.197012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"771f785c-f464-4b17-936c-cbf31b1153e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6812","nonce":119451}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6813","nonce":119451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6815","nonce":119451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6814","nonce":119451}]},"public_addr":"172.21.15.40:6812/119451","cluster_addr":"172.21.15.40:6813/119451","heartbeat_back_addr":"172.21.15.40:6815/119451","heartbeat_front_addr":"172.21.15.40:6814/119451","state":["exists","up"]},{"osd":1,"uuid":"45f1e2e8-5310-4219-ab54-424e7440fcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6808","nonce":119436}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6809","nonce":119436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6811","nonce":119436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6810","nonce":119436}]},"public_addr":"172.21.15.40:6808/119436","cluster_addr":"172.21.15.40:6809/119436","heartbeat_back_addr":"172.21.15.40:6811/119436","heartbeat_front_addr":"172.21.15.40:6810/119436","state":["exists","up"]},{"osd":2,"uuid":"7ba62ae5-d21e-4d56-b46c-ba7b718ede25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6800","nonce":119433}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6801","nonce":119433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6803","nonce":119433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6802","nonce":119433}]},"public_addr":"172.21.15.40:6800/119433","cluster_addr":"172.21.15.40:6801/119433","heartbeat_back_addr":"172.21.15.40:6803/119433","heartbeat_front_addr":"172.21.15.40:6802/119433","state":["exists","up"]},{"osd":3,"uuid":"c9c55985-8a90-4927-a8fa-6a1fcec1cd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6804","nonce":119432}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6805","nonce":119432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6807","nonce":119432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6806","nonce":119432}]},"public_addr":"172.21.15.40:6804/119432","cluster_addr":"172.21.15.40:6805/119432","heartbeat_back_addr":"172.21.15.40:6807/119432","heartbeat_front_addr":"172.21.15.40:6806/119432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.339829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.554690+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.641664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.320635+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:21:59.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.459+0000 7f29e6795700 1 -- 172.21.15.40:0/2476126459 >> v1:172.21.15.40:6816/118905 conn(0x7f29cc02bb30 legacy=0x7f29cc02dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.459+0000 7f29e6795700 1 -- 172.21.15.40:0/2476126459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29e0097310 msgr2=0x7f29e0119820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.459+0000 7f29e6795700 1 --2- 172.21.15.40:0/2476126459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29e0097310 0x7f29e0119820 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f29d800c7e0 tx=0x7f29d8007f90).stop 2023-09-30T22:21:59.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.459+0000 7f29e6795700 1 -- 172.21.15.40:0/2476126459 shutdown_connections 2023-09-30T22:21:59.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.459+0000 7f29e6795700 1 --2- 172.21.15.40:0/2476126459 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f29e0093b40 0x7f29e0118e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:59.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.459+0000 7f29e6795700 1 --2- 172.21.15.40:0/2476126459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29e0097310 0x7f29e0119820 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:59.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.459+0000 7f29e6795700 1 --2- 172.21.15.40:0/2476126459 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29e0094be0 0x7f29e0119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:59.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.459+0000 7f29e6795700 1 -- 172.21.15.40:0/2476126459 >> 172.21.15.40:0/2476126459 conn(0x7f29e005ec10 msgr2=0x7f29e0098720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:59.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.459+0000 7f29e6795700 1 -- 172.21.15.40:0/2476126459 shutdown_connections 2023-09-30T22:21:59.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.459+0000 7f29e6795700 1 -- 172.21.15.40:0/2476126459 wait complete. 2023-09-30T22:21:59.471 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-09-30T22:21:54.875024+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:21:56.197012+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-09-30T22:21:59.472 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-09-30T22:21:59.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.594+0000 7f30634d3700 1 Processor -- start 2023-09-30T22:21:59.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.595+0000 7f30634d3700 1 -- start start 2023-09-30T22:21:59.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.595+0000 7f30634d3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f305c095e80 0x7f305c096640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:59.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.595+0000 7f30634d3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f305c093d00 0x7f305c096b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:59.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.595+0000 7f30634d3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f305c097020 0x7f305c12f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:59.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.595+0000 7f30634d3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f305c096260 con 0x7f305c095e80 2023-09-30T22:21:59.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.595+0000 7f30634d3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305c097ad0 con 0x7f305c093d00 2023-09-30T22:21:59.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.595+0000 7f30634d3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f305c0941b0 con 0x7f305c097020 2023-09-30T22:21:59.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.595+0000 7f306126f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f305c095e80 0x7f305c096640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:59.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.595+0000 7f3060a6e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f305c093d00 0x7f305c096b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:59.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.595+0000 7f3061a70700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f305c097020 0x7f305c12f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:59.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.595+0000 7f306126f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f305c095e80 0x7f305c096640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44190/0 (socket says 172.21.15.40:44190) 2023-09-30T22:21:59.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.595+0000 7f3060a6e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f305c093d00 0x7f305c096b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48806/0 (socket says 172.21.15.40:48806) 2023-09-30T22:21:59.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.595+0000 7f3061a70700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f305c097020 0x7f305c12f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58730/0 (socket says 172.21.15.40:58730) 2023-09-30T22:21:59.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.595+0000 7f306126f700 1 -- 172.21.15.40:0/1483190522 learned_addr learned my addr 172.21.15.40:0/1483190522 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:21:59.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.596+0000 7f3061a70700 1 -- 172.21.15.40:0/1483190522 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f305c093d00 msgr2=0x7f305c096b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:59.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.596+0000 7f3061a70700 1 --2- 172.21.15.40:0/1483190522 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f305c093d00 0x7f305c096b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:59.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.596+0000 7f3061a70700 1 -- 172.21.15.40:0/1483190522 >> v2:172.21.15.40:3300/0 conn(0x7f305c095e80 msgr2=0x7f305c096640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:59.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.596+0000 7f3061a70700 1 --2- 172.21.15.40:0/1483190522 >> v2:172.21.15.40:3300/0 conn(0x7f305c095e80 0x7f305c096640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:59.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.596+0000 7f3061a70700 1 -- 172.21.15.40:0/1483190522 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305c0974b0 con 0x7f305c097020 2023-09-30T22:21:59.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.596+0000 7f306126f700 1 --2- 172.21.15.40:0/1483190522 >> v2:172.21.15.40:3300/0 conn(0x7f305c095e80 0x7f305c096640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:59.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.596+0000 7f3060a6e700 1 --2- 172.21.15.40:0/1483190522 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f305c093d00 0x7f305c096b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:59.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.596+0000 7f3061a70700 1 --2- 172.21.15.40:0/1483190522 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f305c097020 0x7f305c12f4f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f3054009e90 tx=0x7f3054009780).ready entity=mon.2 client_cookie=487e4f3f9711b7d0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:59.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.596+0000 7f3053fff700 1 -- 172.21.15.40:0/1483190522 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305400e070 con 0x7f305c097020 2023-09-30T22:21:59.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.596+0000 7f3053fff700 1 -- 172.21.15.40:0/1483190522 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305400ba70 con 0x7f305c097020 2023-09-30T22:21:59.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.596+0000 7f3053fff700 1 -- 172.21.15.40:0/1483190522 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305400bdf0 con 0x7f305c097020 2023-09-30T22:21:59.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.596+0000 7f30634d3700 1 -- 172.21.15.40:0/1483190522 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f305c097020 msgr2=0x7f305c12f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.596+0000 7f30634d3700 1 --2- 172.21.15.40:0/1483190522 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f305c097020 0x7f305c12f4f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f3054009e90 tx=0x7f3054009780).stop 2023-09-30T22:21:59.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.596+0000 7f30634d3700 1 -- 172.21.15.40:0/1483190522 shutdown_connections 2023-09-30T22:21:59.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.596+0000 7f30634d3700 1 --2- 172.21.15.40:0/1483190522 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f305c097020 0x7f305c12f4f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:59.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.596+0000 7f30634d3700 1 --2- 172.21.15.40:0/1483190522 >> v2:172.21.15.40:3300/0 conn(0x7f305c095e80 0x7f305c096640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:59.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.597+0000 7f30634d3700 1 --2- 172.21.15.40:0/1483190522 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f305c093d00 0x7f305c096b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:59.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.597+0000 7f30634d3700 1 -- 172.21.15.40:0/1483190522 >> 172.21.15.40:0/1483190522 conn(0x7f305c09bcf0 msgr2=0x7f305c09c100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:59.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.597+0000 7f30634d3700 1 -- 172.21.15.40:0/1483190522 shutdown_connections 2023-09-30T22:21:59.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.597+0000 7f30634d3700 1 -- 172.21.15.40:0/1483190522 wait complete. 2023-09-30T22:21:59.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.597+0000 7f30634d3700 1 Processor -- start 2023-09-30T22:21:59.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.598+0000 7f30634d3700 1 -- start start 2023-09-30T22:21:59.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.598+0000 7f30634d3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f305c093d00 0x7f305c064dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.598+0000 7f30634d3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f305c095e80 0x7f305c0652c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.598+0000 7f30634d3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f305c097020 0x7f305c0657b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.598+0000 7f30634d3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305c09ada0 con 0x7f305c097020 2023-09-30T22:21:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.598+0000 7f30634d3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305c097c70 con 0x7f305c095e80 2023-09-30T22:21:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.598+0000 7f30634d3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f305c064b40 con 0x7f305c093d00 2023-09-30T22:21:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.598+0000 7f306126f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f305c093d00 0x7f305c064dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.598+0000 7f306126f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f305c093d00 0x7f305c064dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58744/0 (socket says 172.21.15.40:58744) 2023-09-30T22:21:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.598+0000 7f3061a70700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f305c097020 0x7f305c0657b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.598+0000 7f306126f700 1 -- 172.21.15.40:0/3509376605 learned_addr learned my addr 172.21.15.40:0/3509376605 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:21:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.598+0000 7f3060a6e700 1 --2- 172.21.15.40:0/3509376605 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f305c095e80 0x7f305c0652c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.599+0000 7f306126f700 1 -- 172.21.15.40:0/3509376605 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f305c095e80 msgr2=0x7f305c0652c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.599+0000 7f306126f700 1 --2- 172.21.15.40:0/3509376605 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f305c095e80 0x7f305c0652c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.599+0000 7f306126f700 1 -- 172.21.15.40:0/3509376605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f305c097020 msgr2=0x7f305c0657b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.599+0000 7f306126f700 1 --2- 172.21.15.40:0/3509376605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f305c097020 0x7f305c0657b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.599+0000 7f306126f700 1 -- 172.21.15.40:0/3509376605 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30580092a0 con 0x7f305c093d00 2023-09-30T22:21:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.599+0000 7f3061a70700 1 --2- 172.21.15.40:0/3509376605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f305c097020 0x7f305c0657b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.599+0000 7f306126f700 1 --2- 172.21.15.40:0/3509376605 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f305c093d00 0x7f305c064dd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f304c00ea20 tx=0x7f304c0090f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.599+0000 7f30517fa700 1 -- 172.21.15.40:0/3509376605 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c00ee60 con 0x7f305c093d00 2023-09-30T22:21:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.599+0000 7f30517fa700 1 -- 172.21.15.40:0/3509376605 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304c00c850 con 0x7f305c093d00 2023-09-30T22:21:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.599+0000 7f30634d3700 1 -- 172.21.15.40:0/3509376605 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f304c009370 con 0x7f305c093d00 2023-09-30T22:21:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.599+0000 7f30517fa700 1 -- 172.21.15.40:0/3509376605 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c00cbd0 con 0x7f305c093d00 2023-09-30T22:21:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.599+0000 7f30634d3700 1 -- 172.21.15.40:0/3509376605 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3054009a20 con 0x7f305c093d00 2023-09-30T22:21:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.600+0000 7f30517fa700 1 -- 172.21.15.40:0/3509376605 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f304c01b400 con 0x7f305c093d00 2023-09-30T22:21:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.600+0000 7f30517fa700 1 -- 172.21.15.40:0/3509376605 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f304c03b230 con 0x7f305c093d00 2023-09-30T22:21:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.600+0000 7f30634d3700 1 -- 172.21.15.40:0/3509376605 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f305c05a260 con 0x7f305c093d00 2023-09-30T22:21:59.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.604+0000 7f30517fa700 1 -- 172.21.15.40:0/3509376605 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f304c016030 con 0x7f305c093d00 2023-09-30T22:21:59.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.771+0000 7f30634d3700 1 -- 172.21.15.40:0/3509376605 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f305c046c20 con 0x7f305c093d00 2023-09-30T22:21:59.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.771+0000 7f30517fa700 1 -- 172.21.15.40:0/3509376605 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v13) v1 ==== 110+0+10 (secure 0 0 0) 0x7f304c02a0b0 con 0x7f305c093d00 2023-09-30T22:21:59.772 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-09-30T22:21:59.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.773+0000 7f30634d3700 1 -- 172.21.15.40:0/3509376605 >> v1:172.21.15.40:6816/118905 conn(0x7f304002bb60 legacy=0x7f304002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.773+0000 7f30634d3700 1 -- 172.21.15.40:0/3509376605 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f305c093d00 msgr2=0x7f305c064dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.773+0000 7f30634d3700 1 --2- 172.21.15.40:0/3509376605 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f305c093d00 0x7f305c064dd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f304c00ea20 tx=0x7f304c0090f0).stop 2023-09-30T22:21:59.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.773+0000 7f30634d3700 1 -- 172.21.15.40:0/3509376605 shutdown_connections 2023-09-30T22:21:59.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.773+0000 7f30634d3700 1 --2- 172.21.15.40:0/3509376605 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f305c093d00 0x7f305c064dd0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:59.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.773+0000 7f30634d3700 1 --2- 172.21.15.40:0/3509376605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f305c097020 0x7f305c0657b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:59.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.773+0000 7f30634d3700 1 --2- 172.21.15.40:0/3509376605 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f305c095e80 0x7f305c0652c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:59.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.773+0000 7f30634d3700 1 -- 172.21.15.40:0/3509376605 >> 172.21.15.40:0/3509376605 conn(0x7f305c09bcf0 msgr2=0x7f305c112350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:59.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.773+0000 7f30634d3700 1 -- 172.21.15.40:0/3509376605 shutdown_connections 2023-09-30T22:21:59.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.773+0000 7f30634d3700 1 -- 172.21.15.40:0/3509376605 wait complete. 2023-09-30T22:21:59.785 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:21:59.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.909+0000 7fafca2a5700 1 Processor -- start 2023-09-30T22:21:59.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.909+0000 7fafca2a5700 1 -- start start 2023-09-30T22:21:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.910+0000 7fafca2a5700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fafc4097ec0 0x7fafc4096d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.910+0000 7fafca2a5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafc4097220 0x7fafc4132660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.910+0000 7fafca2a5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc4098350 con 0x7fafc40657e0 2023-09-30T22:21:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.910+0000 7fafca2a5700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafc4065bc0 con 0x7fafc4097ec0 2023-09-30T22:21:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.910+0000 7fafca2a5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc4096350 con 0x7fafc4097220 2023-09-30T22:21:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.910+0000 7fafc37fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fafc4097ec0 0x7fafc4096d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.910+0000 7fafc3fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fafc40657e0 0x7fafc4096620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55870/0 (socket says 172.21.15.40:55870) 2023-09-30T22:21:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.910+0000 7fafc3fff700 1 -- 172.21.15.40:0/402603665 learned_addr learned my addr 172.21.15.40:0/402603665 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:21:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.910+0000 7fafc8842700 1 --2- 172.21.15.40:0/402603665 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafc4097220 0x7fafc4132660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:59.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.910+0000 7fafc37fe700 1 -- 172.21.15.40:0/402603665 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafc4097220 msgr2=0x7fafc4132660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:59.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.910+0000 7fafc37fe700 1 --2- 172.21.15.40:0/402603665 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafc4097220 0x7fafc4132660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:59.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.910+0000 7fafc37fe700 1 -- 172.21.15.40:0/402603665 >> v1:172.21.15.40:6789/0 conn(0x7fafc40657e0 legacy=0x7fafc4096620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.910+0000 7fafc37fe700 1 -- 172.21.15.40:0/402603665 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc40662b0 con 0x7fafc4097ec0 2023-09-30T22:21:59.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.910+0000 7fafc2ffd700 1 -- 172.21.15.40:0/402603665 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2773701340 0 0) 0x7fafc4098350 con 0x7fafc40657e0 2023-09-30T22:21:59.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.910+0000 7fafc37fe700 1 --2- 172.21.15.40:0/402603665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafc4097ec0 0x7fafc4096d30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fafb8009760 tx=0x7fafb8009060).ready entity=mon.0 client_cookie=dcdbf719e70b2e8d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:59.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.910+0000 7fafc2ffd700 1 -- 172.21.15.40:0/402603665 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb80090d0 con 0x7fafc4097ec0 2023-09-30T22:21:59.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.910+0000 7fafc2ffd700 1 -- 172.21.15.40:0/402603665 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb800f510 con 0x7fafc4097ec0 2023-09-30T22:21:59.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.910+0000 7fafc2ffd700 1 -- 172.21.15.40:0/402603665 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb800f890 con 0x7fafc4097ec0 2023-09-30T22:21:59.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.911+0000 7fafca2a5700 1 -- 172.21.15.40:0/402603665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafc4097ec0 msgr2=0x7fafc4096d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.911+0000 7fafca2a5700 1 --2- 172.21.15.40:0/402603665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafc4097ec0 0x7fafc4096d30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fafb8009760 tx=0x7fafb8009060).stop 2023-09-30T22:21:59.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.911+0000 7fafca2a5700 1 -- 172.21.15.40:0/402603665 shutdown_connections 2023-09-30T22:21:59.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.911+0000 7fafca2a5700 1 --2- 172.21.15.40:0/402603665 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafc4097220 0x7fafc4132660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:59.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.911+0000 7fafca2a5700 1 --2- 172.21.15.40:0/402603665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafc4097ec0 0x7fafc4096d30 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:59.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.911+0000 7fafca2a5700 1 -- 172.21.15.40:0/402603665 >> 172.21.15.40:0/402603665 conn(0x7fafc409de50 msgr2=0x7fafc409e260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:59.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.911+0000 7fafca2a5700 1 -- 172.21.15.40:0/402603665 shutdown_connections 2023-09-30T22:21:59.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.911+0000 7fafca2a5700 1 -- 172.21.15.40:0/402603665 wait complete. 2023-09-30T22:21:59.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.912+0000 7fafca2a5700 1 Processor -- start 2023-09-30T22:21:59.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.912+0000 7fafca2a5700 1 -- start start 2023-09-30T22:21:59.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.913+0000 7fafca2a5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafc40657e0 0x7fafc4132630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:59.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.913+0000 7fafca2a5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafc4097220 0x7fafc411a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:59.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.913+0000 7fafca2a5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafc411ab20 0x7fafc411af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:21:59.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.913+0000 7fafca2a5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc411e0a0 con 0x7fafc40657e0 2023-09-30T22:21:59.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.913+0000 7fafca2a5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc40946a0 con 0x7fafc411ab20 2023-09-30T22:21:59.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.913+0000 7fafca2a5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fafc4099d70 con 0x7fafc4097220 2023-09-30T22:21:59.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.913+0000 7fafc8842700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafc411ab20 0x7fafc411af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:59.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.913+0000 7fafc8842700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafc411ab20 0x7fafc411af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48834/0 (socket says 172.21.15.40:48834) 2023-09-30T22:21:59.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.913+0000 7fafc8842700 1 -- 172.21.15.40:0/496497395 learned_addr learned my addr 172.21.15.40:0/496497395 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:21:59.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.913+0000 7fafc3fff700 1 --2- 172.21.15.40:0/496497395 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafc40657e0 0x7fafc4132630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:59.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.913+0000 7fafc37fe700 1 --2- 172.21.15.40:0/496497395 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafc4097220 0x7fafc411a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:21:59.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.914+0000 7fafc8842700 1 -- 172.21.15.40:0/496497395 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafc4097220 msgr2=0x7fafc411a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.914+0000 7fafc8842700 1 --2- 172.21.15.40:0/496497395 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafc4097220 0x7fafc411a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:59.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.914+0000 7fafc8842700 1 -- 172.21.15.40:0/496497395 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafc40657e0 msgr2=0x7fafc4132630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.914+0000 7fafc8842700 1 --2- 172.21.15.40:0/496497395 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafc40657e0 0x7fafc4132630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:21:59.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.914+0000 7fafc8842700 1 -- 172.21.15.40:0/496497395 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb80092a0 con 0x7fafc411ab20 2023-09-30T22:21:59.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.914+0000 7fafc3fff700 1 --2- 172.21.15.40:0/496497395 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafc40657e0 0x7fafc4132630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:59.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.914+0000 7fafc8842700 1 --2- 172.21.15.40:0/496497395 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafc411ab20 0x7fafc411af80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fafbc009ec0 tx=0x7fafbc00b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:59.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.914+0000 7fafabfff700 1 -- 172.21.15.40:0/496497395 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc00cb70 con 0x7fafc411ab20 2023-09-30T22:21:59.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.914+0000 7fafabfff700 1 -- 172.21.15.40:0/496497395 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafbc00f040 con 0x7fafc411ab20 2023-09-30T22:21:59.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.914+0000 7fafca2a5700 1 -- 172.21.15.40:0/496497395 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc411da90 con 0x7fafc411ab20 2023-09-30T22:21:59.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.914+0000 7fafabfff700 1 -- 172.21.15.40:0/496497395 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc00cee0 con 0x7fafc411ab20 2023-09-30T22:21:59.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.914+0000 7fafca2a5700 1 -- 172.21.15.40:0/496497395 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc411e5f0 con 0x7fafc411ab20 2023-09-30T22:21:59.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.914+0000 7fafabfff700 1 -- 172.21.15.40:0/496497395 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fafbc013610 con 0x7fafc411ab20 2023-09-30T22:21:59.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.915+0000 7fafabfff700 1 -- 172.21.15.40:0/496497395 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fafbc03b420 con 0x7fafc411ab20 2023-09-30T22:21:59.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.915+0000 7fafca2a5700 1 -- 172.21.15.40:0/496497395 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc40994b0 con 0x7fafc411ab20 2023-09-30T22:21:59.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:21:59.920+0000 7fafabfff700 1 -- 172.21.15.40:0/496497395 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fafbc01d460 con 0x7fafc411ab20 2023-09-30T22:22:00.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.086+0000 7fafca2a5700 1 -- 172.21.15.40:0/496497395 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fafc405a260 con 0x7fafc411ab20 2023-09-30T22:22:00.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.086+0000 7fafabfff700 1 -- 172.21.15.40:0/496497395 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v13) v1 ==== 92+0+10 (secure 0 0 0) 0x7fafbc02c0a0 con 0x7fafc411ab20 2023-09-30T22:22:00.087 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-09-30T22:22:00.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.088+0000 7fafca2a5700 1 -- 172.21.15.40:0/496497395 >> v1:172.21.15.40:6816/118905 conn(0x7fafb002bb90 legacy=0x7fafb002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.088+0000 7fafca2a5700 1 -- 172.21.15.40:0/496497395 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafc411ab20 msgr2=0x7fafc411af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.088+0000 7fafca2a5700 1 --2- 172.21.15.40:0/496497395 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafc411ab20 0x7fafc411af80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fafbc009ec0 tx=0x7fafbc00b040).stop 2023-09-30T22:22:00.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.088+0000 7fafca2a5700 1 -- 172.21.15.40:0/496497395 shutdown_connections 2023-09-30T22:22:00.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.088+0000 7fafca2a5700 1 --2- 172.21.15.40:0/496497395 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafc411ab20 0x7fafc411af80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:00.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.088+0000 7fafca2a5700 1 --2- 172.21.15.40:0/496497395 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafc40657e0 0x7fafc4132630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:00.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.088+0000 7fafca2a5700 1 --2- 172.21.15.40:0/496497395 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafc4097220 0x7fafc411a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:00.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.088+0000 7fafca2a5700 1 -- 172.21.15.40:0/496497395 >> 172.21.15.40:0/496497395 conn(0x7fafc409de50 msgr2=0x7fafc409bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:00.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.088+0000 7fafca2a5700 1 -- 172.21.15.40:0/496497395 shutdown_connections 2023-09-30T22:22:00.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.088+0000 7fafca2a5700 1 -- 172.21.15.40:0/496497395 wait complete. 2023-09-30T22:22:00.101 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-30T22:22:00.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.221+0000 7fa881732700 1 Processor -- start 2023-09-30T22:22:00.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.221+0000 7fa881732700 1 -- start start 2023-09-30T22:22:00.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.222+0000 7fa881732700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa87c093250 0x7fa87c12b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:00.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.222+0000 7fa881732700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa87c130060 0x7fa87c132450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:00.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.222+0000 7fa881732700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa87c0685f0 con 0x7fa87c062e60 2023-09-30T22:22:00.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.222+0000 7fa881732700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa87c0671d0 con 0x7fa87c093250 2023-09-30T22:22:00.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.222+0000 7fa881732700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c12ad30 con 0x7fa87c130060 2023-09-30T22:22:00.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.222+0000 7fa87b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa87c130060 0x7fa87c132450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:00.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.222+0000 7fa87affd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa87c062e60 0x7fa87c12af20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55874/0 (socket says 172.21.15.40:55874) 2023-09-30T22:22:00.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.222+0000 7fa87affd700 1 -- 172.21.15.40:0/3967925893 learned_addr learned my addr 172.21.15.40:0/3967925893 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:22:00.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.222+0000 7fa8727fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa87c093250 0x7fa87c12b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:00.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.222+0000 7fa8727fc700 1 -- 172.21.15.40:0/3967925893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa87c130060 msgr2=0x7fa87c132450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:00.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.222+0000 7fa8727fc700 1 --2- 172.21.15.40:0/3967925893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa87c130060 0x7fa87c132450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:00.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.222+0000 7fa8727fc700 1 -- 172.21.15.40:0/3967925893 >> v1:172.21.15.40:6789/0 conn(0x7fa87c062e60 legacy=0x7fa87c12af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.222+0000 7fa87a7fc700 1 -- 172.21.15.40:0/3967925893 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1594934361 0 0) 0x7fa87c0685f0 con 0x7fa87c062e60 2023-09-30T22:22:00.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.222+0000 7fa8727fc700 1 -- 172.21.15.40:0/3967925893 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87c0676e0 con 0x7fa87c093250 2023-09-30T22:22:00.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.222+0000 7fa87b7fe700 1 --2- 172.21.15.40:0/3967925893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa87c130060 0x7fa87c132450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:00.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.222+0000 7fa8727fc700 1 --2- 172.21.15.40:0/3967925893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa87c093250 0x7fa87c12b630 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fa864009760 tx=0x7fa864009060).ready entity=mon.0 client_cookie=58108c5cec9d8ad0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:00.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.222+0000 7fa87a7fc700 1 -- 172.21.15.40:0/3967925893 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86400f510 con 0x7fa87c093250 2023-09-30T22:22:00.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.223+0000 7fa87a7fc700 1 -- 172.21.15.40:0/3967925893 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86400f670 con 0x7fa87c093250 2023-09-30T22:22:00.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.223+0000 7fa87a7fc700 1 -- 172.21.15.40:0/3967925893 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86400f9f0 con 0x7fa87c093250 2023-09-30T22:22:00.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.223+0000 7fa881732700 1 -- 172.21.15.40:0/3967925893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa87c093250 msgr2=0x7fa87c12b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.223+0000 7fa881732700 1 --2- 172.21.15.40:0/3967925893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa87c093250 0x7fa87c12b630 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fa864009760 tx=0x7fa864009060).stop 2023-09-30T22:22:00.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.223+0000 7fa881732700 1 -- 172.21.15.40:0/3967925893 shutdown_connections 2023-09-30T22:22:00.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.223+0000 7fa881732700 1 --2- 172.21.15.40:0/3967925893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa87c130060 0x7fa87c132450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:00.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.223+0000 7fa881732700 1 --2- 172.21.15.40:0/3967925893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa87c093250 0x7fa87c12b630 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:00.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.223+0000 7fa881732700 1 -- 172.21.15.40:0/3967925893 >> 172.21.15.40:0/3967925893 conn(0x7fa87c09a450 msgr2=0x7fa87c09a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:00.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.223+0000 7fa881732700 1 -- 172.21.15.40:0/3967925893 shutdown_connections 2023-09-30T22:22:00.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.223+0000 7fa881732700 1 -- 172.21.15.40:0/3967925893 wait complete. 2023-09-30T22:22:00.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.224+0000 7fa881732700 1 Processor -- start 2023-09-30T22:22:00.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.224+0000 7fa881732700 1 -- start start 2023-09-30T22:22:00.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.224+0000 7fa881732700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa87c062e60 0x7fa87c116730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:00.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.224+0000 7fa881732700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa87c093250 0x7fa87c112800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:00.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.224+0000 7fa881732700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa87c130060 0x7fa87c112cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:00.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.224+0000 7fa881732700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c115f50 con 0x7fa87c093250 2023-09-30T22:22:00.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.224+0000 7fa881732700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c12a830 con 0x7fa87c130060 2023-09-30T22:22:00.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.224+0000 7fa881732700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c113c00 con 0x7fa87c062e60 2023-09-30T22:22:00.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.225+0000 7fa8727fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa87c093250 0x7fa87c112800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:00.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.225+0000 7fa87affd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa87c062e60 0x7fa87c116730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:00.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.225+0000 7fa87b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa87c130060 0x7fa87c112cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:00.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.225+0000 7fa8727fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa87c093250 0x7fa87c112800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44244/0 (socket says 172.21.15.40:44244) 2023-09-30T22:22:00.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.225+0000 7fa8727fc700 1 -- 172.21.15.40:0/1056991680 learned_addr learned my addr 172.21.15.40:0/1056991680 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:00.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.225+0000 7fa87b7fe700 1 -- 172.21.15.40:0/1056991680 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa87c062e60 msgr2=0x7fa87c116730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.225+0000 7fa87b7fe700 1 --2- 172.21.15.40:0/1056991680 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa87c062e60 0x7fa87c116730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:00.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.225+0000 7fa87b7fe700 1 -- 172.21.15.40:0/1056991680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa87c093250 msgr2=0x7fa87c112800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.225+0000 7fa87b7fe700 1 --2- 172.21.15.40:0/1056991680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa87c093250 0x7fa87c112800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:00.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.225+0000 7fa87b7fe700 1 -- 172.21.15.40:0/1056991680 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa874009a20 con 0x7fa87c130060 2023-09-30T22:22:00.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.225+0000 7fa87b7fe700 1 --2- 172.21.15.40:0/1056991680 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa87c130060 0x7fa87c112cf0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fa874009f40 tx=0x7fa87400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:00.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.225+0000 7fa8737fe700 1 -- 172.21.15.40:0/1056991680 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa874009c70 con 0x7fa87c130060 2023-09-30T22:22:00.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.225+0000 7fa8737fe700 1 -- 172.21.15.40:0/1056991680 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87400f040 con 0x7fa87c130060 2023-09-30T22:22:00.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.225+0000 7fa881732700 1 -- 172.21.15.40:0/1056991680 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8640092a0 con 0x7fa87c130060 2023-09-30T22:22:00.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.225+0000 7fa8737fe700 1 -- 172.21.15.40:0/1056991680 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87400cd20 con 0x7fa87c130060 2023-09-30T22:22:00.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.225+0000 7fa881732700 1 -- 172.21.15.40:0/1056991680 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa87c114aa0 con 0x7fa87c130060 2023-09-30T22:22:00.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.226+0000 7fa8737fe700 1 -- 172.21.15.40:0/1056991680 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fa874013610 con 0x7fa87c130060 2023-09-30T22:22:00.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.226+0000 7fa8737fe700 1 -- 172.21.15.40:0/1056991680 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fa87403b4b0 con 0x7fa87c130060 2023-09-30T22:22:00.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.226+0000 7fa881732700 1 -- 172.21.15.40:0/1056991680 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa87c114370 con 0x7fa87c130060 2023-09-30T22:22:00.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.231+0000 7fa8737fe700 1 -- 172.21.15.40:0/1056991680 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fa874007930 con 0x7fa87c130060 2023-09-30T22:22:00.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.398+0000 7fa881732700 1 -- 172.21.15.40:0/1056991680 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa87c05a260 con 0x7fa87c130060 2023-09-30T22:22:00.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.399+0000 7fa8737fe700 1 -- 172.21.15.40:0/1056991680 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v13) v1 ==== 84+0+143 (secure 0 0 0) 0x7fa874007340 con 0x7fa87c130060 2023-09-30T22:22:00.400 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:22:00.400 INFO:teuthology.orchestra.run.smithi040.stdout:[ 2023-09-30T22:22:00.400 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:22:00.400 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 1, 2023-09-30T22:22:00.400 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": "device_health_metrics" 2023-09-30T22:22:00.400 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:22:00.400 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:22:00.400 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 2, 2023-09-30T22:22:00.400 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": "rbd" 2023-09-30T22:22:00.401 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:22:00.401 INFO:teuthology.orchestra.run.smithi040.stdout:] 2023-09-30T22:22:00.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.401+0000 7fa881732700 1 -- 172.21.15.40:0/1056991680 >> v1:172.21.15.40:6816/118905 conn(0x7fa85c02bb60 legacy=0x7fa85c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.401+0000 7fa881732700 1 -- 172.21.15.40:0/1056991680 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa87c130060 msgr2=0x7fa87c112cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.401+0000 7fa881732700 1 --2- 172.21.15.40:0/1056991680 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa87c130060 0x7fa87c112cf0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fa874009f40 tx=0x7fa87400b040).stop 2023-09-30T22:22:00.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.401+0000 7fa881732700 1 -- 172.21.15.40:0/1056991680 shutdown_connections 2023-09-30T22:22:00.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.401+0000 7fa881732700 1 --2- 172.21.15.40:0/1056991680 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa87c062e60 0x7fa87c116730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:00.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.401+0000 7fa881732700 1 --2- 172.21.15.40:0/1056991680 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa87c130060 0x7fa87c112cf0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:00.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.401+0000 7fa881732700 1 --2- 172.21.15.40:0/1056991680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa87c093250 0x7fa87c112800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:00.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.401+0000 7fa881732700 1 -- 172.21.15.40:0/1056991680 >> 172.21.15.40:0/1056991680 conn(0x7fa87c09a450 msgr2=0x7fa87c131cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:00.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.401+0000 7fa881732700 1 -- 172.21.15.40:0/1056991680 shutdown_connections 2023-09-30T22:22:00.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.401+0000 7fa881732700 1 -- 172.21.15.40:0/1056991680 wait complete. 2023-09-30T22:22:00.413 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-30T22:22:00.413 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-30T22:22:00.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.537+0000 7fcb1a90e700 1 Processor -- start 2023-09-30T22:22:00.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.537+0000 7fcb1a90e700 1 -- start start 2023-09-30T22:22:00.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.537+0000 7fcb1a90e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb1405e090 0x7fcb1412af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:00.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.537+0000 7fcb1a90e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcb1412b460 0x7fcb14127620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:00.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.537+0000 7fcb1a90e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb14096bf0 con 0x7fcb14127b10 2023-09-30T22:22:00.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.537+0000 7fcb1a90e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb1405e470 con 0x7fcb1412b460 2023-09-30T22:22:00.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.537+0000 7fcb1a90e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb14091fb0 con 0x7fcb1405e090 2023-09-30T22:22:00.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.537+0000 7fcb13fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb1405e090 0x7fcb1412af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:00.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.537+0000 7fcb137fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcb1412b460 0x7fcb14127620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:00.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.537+0000 7fcb18eab700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fcb14127b10 0x7fcb14127f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55882/0 (socket says 172.21.15.40:55882) 2023-09-30T22:22:00.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.537+0000 7fcb18eab700 1 -- 172.21.15.40:0/3577971096 learned_addr learned my addr 172.21.15.40:0/3577971096 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:22:00.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.538+0000 7fcb13fff700 1 -- 172.21.15.40:0/3577971096 >> v2:172.21.15.40:3300/0 conn(0x7fcb1412b460 msgr2=0x7fcb14127620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:00.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.538+0000 7fcb12ffd700 1 -- 172.21.15.40:0/3577971096 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491330650 0 0) 0x7fcb14096bf0 con 0x7fcb14127b10 2023-09-30T22:22:00.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.538+0000 7fcb13fff700 1 --2- 172.21.15.40:0/3577971096 >> v2:172.21.15.40:3300/0 conn(0x7fcb1412b460 0x7fcb14127620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:00.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.538+0000 7fcb13fff700 1 -- 172.21.15.40:0/3577971096 >> v1:172.21.15.40:6789/0 conn(0x7fcb14127b10 legacy=0x7fcb14127f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.538+0000 7fcb13fff700 1 -- 172.21.15.40:0/3577971096 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb14092ba0 con 0x7fcb1405e090 2023-09-30T22:22:00.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.538+0000 7fcb13fff700 1 --2- 172.21.15.40:0/3577971096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb1405e090 0x7fcb1412af70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fcb04009760 tx=0x7fcb04009060).ready entity=mon.1 client_cookie=9b36c063e24933a9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:00.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.538+0000 7fcb12ffd700 1 -- 172.21.15.40:0/3577971096 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0400f510 con 0x7fcb1405e090 2023-09-30T22:22:00.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.538+0000 7fcb12ffd700 1 -- 172.21.15.40:0/3577971096 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb0400f670 con 0x7fcb1405e090 2023-09-30T22:22:00.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.538+0000 7fcb12ffd700 1 -- 172.21.15.40:0/3577971096 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0400f9f0 con 0x7fcb1405e090 2023-09-30T22:22:00.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.538+0000 7fcb1a90e700 1 -- 172.21.15.40:0/3577971096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb1405e090 msgr2=0x7fcb1412af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.538+0000 7fcb1a90e700 1 --2- 172.21.15.40:0/3577971096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb1405e090 0x7fcb1412af70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fcb04009760 tx=0x7fcb04009060).stop 2023-09-30T22:22:00.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.538+0000 7fcb1a90e700 1 -- 172.21.15.40:0/3577971096 shutdown_connections 2023-09-30T22:22:00.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.538+0000 7fcb1a90e700 1 --2- 172.21.15.40:0/3577971096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb1405e090 0x7fcb1412af70 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:00.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.538+0000 7fcb1a90e700 1 --2- 172.21.15.40:0/3577971096 >> v2:172.21.15.40:3300/0 conn(0x7fcb1412b460 0x7fcb14127620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:00.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.538+0000 7fcb1a90e700 1 -- 172.21.15.40:0/3577971096 >> 172.21.15.40:0/3577971096 conn(0x7fcb140975f0 msgr2=0x7fcb14097a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:00.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.539+0000 7fcb1a90e700 1 -- 172.21.15.40:0/3577971096 shutdown_connections 2023-09-30T22:22:00.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.539+0000 7fcb1a90e700 1 -- 172.21.15.40:0/3577971096 wait complete. 2023-09-30T22:22:00.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.539+0000 7fcb1a90e700 1 Processor -- start 2023-09-30T22:22:00.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.540+0000 7fcb1a90e700 1 -- start start 2023-09-30T22:22:00.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.540+0000 7fcb1a90e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb1405e090 0x7fcb14117bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:00.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.540+0000 7fcb1a90e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb14127b10 0x7fcb14113c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:00.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.540+0000 7fcb1a90e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb1412b460 0x7fcb14114120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:00.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.540+0000 7fcb1a90e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb14124d00 con 0x7fcb1405e090 2023-09-30T22:22:00.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.540+0000 7fcb1a90e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb14096e00 con 0x7fcb14127b10 2023-09-30T22:22:00.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.540+0000 7fcb1a90e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb14117130 con 0x7fcb1412b460 2023-09-30T22:22:00.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.540+0000 7fcb13fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb1405e090 0x7fcb14117bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:00.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.540+0000 7fcb13fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb1405e090 0x7fcb14117bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44262/0 (socket says 172.21.15.40:44262) 2023-09-30T22:22:00.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.540+0000 7fcb18eab700 1 --2- 172.21.15.40:0/995393750 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb1412b460 0x7fcb14114120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:00.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.540+0000 7fcb13fff700 1 -- 172.21.15.40:0/995393750 learned_addr learned my addr 172.21.15.40:0/995393750 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:00.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.540+0000 7fcb137fe700 1 --2- 172.21.15.40:0/995393750 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb14127b10 0x7fcb14113c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:00.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.540+0000 7fcb13fff700 1 -- 172.21.15.40:0/995393750 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb1412b460 msgr2=0x7fcb14114120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.540+0000 7fcb13fff700 1 --2- 172.21.15.40:0/995393750 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb1412b460 0x7fcb14114120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:00.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.540+0000 7fcb13fff700 1 -- 172.21.15.40:0/995393750 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb14127b10 msgr2=0x7fcb14113c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.540+0000 7fcb13fff700 1 --2- 172.21.15.40:0/995393750 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb14127b10 0x7fcb14113c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:00.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.540+0000 7fcb13fff700 1 -- 172.21.15.40:0/995393750 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb040092a0 con 0x7fcb1405e090 2023-09-30T22:22:00.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.540+0000 7fcb137fe700 1 --2- 172.21.15.40:0/995393750 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb14127b10 0x7fcb14113c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:00.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.541+0000 7fcb13fff700 1 --2- 172.21.15.40:0/995393750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb1405e090 0x7fcb14117bd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fcb04009e00 tx=0x7fcb04017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:00.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.541+0000 7fcafbfff700 1 -- 172.21.15.40:0/995393750 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0400f7e0 con 0x7fcb1405e090 2023-09-30T22:22:00.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.541+0000 7fcafbfff700 1 -- 172.21.15.40:0/995393750 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb0400f940 con 0x7fcb1405e090 2023-09-30T22:22:00.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.541+0000 7fcb1a90e700 1 -- 172.21.15.40:0/995393750 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb141176d0 con 0x7fcb1405e090 2023-09-30T22:22:00.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.541+0000 7fcafbfff700 1 -- 172.21.15.40:0/995393750 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0401b660 con 0x7fcb1405e090 2023-09-30T22:22:00.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.541+0000 7fcb1a90e700 1 -- 172.21.15.40:0/995393750 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb14116020 con 0x7fcb1405e090 2023-09-30T22:22:00.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.541+0000 7fcafbfff700 1 -- 172.21.15.40:0/995393750 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fcb0401ba50 con 0x7fcb1405e090 2023-09-30T22:22:00.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.542+0000 7fcafbfff700 1 -- 172.21.15.40:0/995393750 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fcb0403c5c0 con 0x7fcb1405e090 2023-09-30T22:22:00.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.542+0000 7fcb1a90e700 1 -- 172.21.15.40:0/995393750 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb140989d0 con 0x7fcb1405e090 2023-09-30T22:22:00.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.546+0000 7fcafbfff700 1 -- 172.21.15.40:0/995393750 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fcb0401f020 con 0x7fcb1405e090 2023-09-30T22:22:00.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.713+0000 7fcb1a90e700 1 -- 172.21.15.40:0/995393750 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fcb1405a260 con 0x7fcb1405e090 2023-09-30T22:22:00.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.960+0000 7fcafbfff700 1 -- 172.21.15.40:0/995393750 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v14) v1 ==== 138+0+0 (secure 0 0 0) 0x7fcb040193c0 con 0x7fcb1405e090 2023-09-30T22:22:00.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.963+0000 7fcb1a90e700 1 -- 172.21.15.40:0/995393750 >> v1:172.21.15.40:6816/118905 conn(0x7fcb0002bb60 legacy=0x7fcb0002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.963+0000 7fcb1a90e700 1 -- 172.21.15.40:0/995393750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb1405e090 msgr2=0x7fcb14117bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.963+0000 7fcb1a90e700 1 --2- 172.21.15.40:0/995393750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb1405e090 0x7fcb14117bd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fcb04009e00 tx=0x7fcb04017000).stop 2023-09-30T22:22:00.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.963+0000 7fcb1a90e700 1 -- 172.21.15.40:0/995393750 shutdown_connections 2023-09-30T22:22:00.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.963+0000 7fcb1a90e700 1 --2- 172.21.15.40:0/995393750 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb1412b460 0x7fcb14114120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:00.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.963+0000 7fcb1a90e700 1 --2- 172.21.15.40:0/995393750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb1405e090 0x7fcb14117bd0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:00.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.963+0000 7fcb1a90e700 1 --2- 172.21.15.40:0/995393750 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb14127b10 0x7fcb14113c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:00.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.963+0000 7fcb1a90e700 1 -- 172.21.15.40:0/995393750 >> 172.21.15.40:0/995393750 conn(0x7fcb140975f0 msgr2=0x7fcb14099730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:00.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.963+0000 7fcb1a90e700 1 -- 172.21.15.40:0/995393750 shutdown_connections 2023-09-30T22:22:00.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:00.964+0000 7fcb1a90e700 1 -- 172.21.15.40:0/995393750 wait complete. 2023-09-30T22:22:00.965 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' created 2023-09-30T22:22:00.980 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-30T22:22:01.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.106+0000 7fae0f089700 1 Processor -- start 2023-09-30T22:22:01.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.106+0000 7fae0f089700 1 -- start start 2023-09-30T22:22:01.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.106+0000 7fae0f089700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae080657e0 0x7fae08096620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:01.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.106+0000 7fae0f089700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae08097ec0 0x7fae08096b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:01.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.106+0000 7fae0f089700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fae08097000 0x7fae08131650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:01.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.106+0000 7fae0f089700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae08098350 con 0x7fae08097000 2023-09-30T22:22:01.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.106+0000 7fae0f089700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae080662b0 con 0x7fae08097ec0 2023-09-30T22:22:01.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.106+0000 7fae0f089700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae08065bc0 con 0x7fae080657e0 2023-09-30T22:22:01.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.107+0000 7fae0d626700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fae08097000 0x7fae08131650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:01.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.107+0000 7fae0ce25700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae080657e0 0x7fae08096620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:01.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.107+0000 7fae07fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae08097ec0 0x7fae08096b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:01.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.107+0000 7fae07fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae08097ec0 0x7fae08096b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48886/0 (socket says 172.21.15.40:48886) 2023-09-30T22:22:01.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.107+0000 7fae0d626700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fae08097000 0x7fae08131650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44276/0 (socket says 172.21.15.40:44276) 2023-09-30T22:22:01.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.107+0000 7fae0ce25700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae080657e0 0x7fae08096620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58776/0 (socket says 172.21.15.40:58776) 2023-09-30T22:22:01.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.107+0000 7fae07fff700 1 -- 172.21.15.40:0/1203404175 learned_addr learned my addr 172.21.15.40:0/1203404175 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:01.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.107+0000 7fae07fff700 1 -- 172.21.15.40:0/1203404175 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae080657e0 msgr2=0x7fae08096620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:01.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.107+0000 7fae07fff700 1 --2- 172.21.15.40:0/1203404175 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae080657e0 0x7fae08096620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:01.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.107+0000 7fae07fff700 1 -- 172.21.15.40:0/1203404175 >> v2:172.21.15.40:3300/0 conn(0x7fae08097000 msgr2=0x7fae08131650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:01.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.107+0000 7fae07fff700 1 --2- 172.21.15.40:0/1203404175 >> v2:172.21.15.40:3300/0 conn(0x7fae08097000 0x7fae08131650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:01.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.107+0000 7fae07fff700 1 -- 172.21.15.40:0/1203404175 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae08096350 con 0x7fae08097ec0 2023-09-30T22:22:01.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.107+0000 7fae07fff700 1 --2- 172.21.15.40:0/1203404175 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae08097ec0 0x7fae08096b10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fadf4009830 tx=0x7fadf40090f0).ready entity=mon.1 client_cookie=107b2c8bcb66d707 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:01.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.107+0000 7fae077fe700 1 -- 172.21.15.40:0/1203404175 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf400f510 con 0x7fae08097ec0 2023-09-30T22:22:01.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.107+0000 7fae077fe700 1 -- 172.21.15.40:0/1203404175 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf400f670 con 0x7fae08097ec0 2023-09-30T22:22:01.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.107+0000 7fae077fe700 1 -- 172.21.15.40:0/1203404175 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf400fa10 con 0x7fae08097ec0 2023-09-30T22:22:01.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.108+0000 7fae0f089700 1 -- 172.21.15.40:0/1203404175 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae08097ec0 msgr2=0x7fae08096b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.108+0000 7fae0f089700 1 --2- 172.21.15.40:0/1203404175 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae08097ec0 0x7fae08096b10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fadf4009830 tx=0x7fadf40090f0).stop 2023-09-30T22:22:01.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.108+0000 7fae0f089700 1 -- 172.21.15.40:0/1203404175 shutdown_connections 2023-09-30T22:22:01.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.108+0000 7fae0f089700 1 --2- 172.21.15.40:0/1203404175 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae080657e0 0x7fae08096620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:01.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.108+0000 7fae0f089700 1 --2- 172.21.15.40:0/1203404175 >> v2:172.21.15.40:3300/0 conn(0x7fae08097000 0x7fae08131650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:01.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.108+0000 7fae0f089700 1 --2- 172.21.15.40:0/1203404175 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae08097ec0 0x7fae08096b10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:01.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.108+0000 7fae0f089700 1 -- 172.21.15.40:0/1203404175 >> 172.21.15.40:0/1203404175 conn(0x7fae0809de50 msgr2=0x7fae0809e260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:01.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.108+0000 7fae0f089700 1 -- 172.21.15.40:0/1203404175 shutdown_connections 2023-09-30T22:22:01.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.108+0000 7fae0f089700 1 -- 172.21.15.40:0/1203404175 wait complete. 2023-09-30T22:22:01.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.109+0000 7fae0f089700 1 Processor -- start 2023-09-30T22:22:01.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.109+0000 7fae0f089700 1 -- start start 2023-09-30T22:22:01.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.109+0000 7fae0f089700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae080657e0 0x7fae0813a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:01.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.109+0000 7fae0f089700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae08097000 0x7fae0813a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:01.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.109+0000 7fae0f089700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae0813adc0 0x7fae0811ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:01.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.109+0000 7fae0f089700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae08099d70 con 0x7fae080657e0 2023-09-30T22:22:01.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.109+0000 7fae0f089700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae0809cd30 con 0x7fae08097000 2023-09-30T22:22:01.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.109+0000 7fae0f089700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae0813b1e0 con 0x7fae0813adc0 2023-09-30T22:22:01.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.109+0000 7fae0ce25700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae080657e0 0x7fae0813a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:01.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.109+0000 7fae07fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae08097000 0x7fae0813a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:01.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.109+0000 7fae0ce25700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae080657e0 0x7fae0813a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44278/0 (socket says 172.21.15.40:44278) 2023-09-30T22:22:01.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.109+0000 7fae0ce25700 1 -- 172.21.15.40:0/1773112682 learned_addr learned my addr 172.21.15.40:0/1773112682 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:01.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.109+0000 7fae0d626700 1 --2- 172.21.15.40:0/1773112682 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae0813adc0 0x7fae0811ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:01.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.110+0000 7fae0ce25700 1 -- 172.21.15.40:0/1773112682 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae0813adc0 msgr2=0x7fae0811ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.110+0000 7fae0ce25700 1 --2- 172.21.15.40:0/1773112682 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae0813adc0 0x7fae0811ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:01.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.110+0000 7fae0ce25700 1 -- 172.21.15.40:0/1773112682 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae08097000 msgr2=0x7fae0813a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.110+0000 7fae0ce25700 1 --2- 172.21.15.40:0/1773112682 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae08097000 0x7fae0813a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:01.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.110+0000 7fae0ce25700 1 -- 172.21.15.40:0/1773112682 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf4009370 con 0x7fae080657e0 2023-09-30T22:22:01.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.110+0000 7fae07fff700 1 --2- 172.21.15.40:0/1773112682 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae08097000 0x7fae0813a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:01.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.110+0000 7fae0ce25700 1 --2- 172.21.15.40:0/1773112682 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae080657e0 0x7fae0813a3e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fadfc00e930 tx=0x7fadfc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:01.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.110+0000 7fae04ff9700 1 -- 172.21.15.40:0/1773112682 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc012600 con 0x7fae080657e0 2023-09-30T22:22:01.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.110+0000 7fae04ff9700 1 -- 172.21.15.40:0/1773112682 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadfc012760 con 0x7fae080657e0 2023-09-30T22:22:01.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.110+0000 7fae0f089700 1 -- 172.21.15.40:0/1773112682 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae0811cbe0 con 0x7fae080657e0 2023-09-30T22:22:01.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.110+0000 7fae04ff9700 1 -- 172.21.15.40:0/1773112682 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc012ae0 con 0x7fae080657e0 2023-09-30T22:22:01.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.110+0000 7fae0f089700 1 -- 172.21.15.40:0/1773112682 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae0811c1f0 con 0x7fae080657e0 2023-09-30T22:22:01.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.111+0000 7fae04ff9700 1 -- 172.21.15.40:0/1773112682 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fadfc01b400 con 0x7fae080657e0 2023-09-30T22:22:01.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.111+0000 7fae04ff9700 1 -- 172.21.15.40:0/1773112682 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3208+0+0 (secure 0 0 0) 0x7fadfc03b220 con 0x7fae080657e0 2023-09-30T22:22:01.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.111+0000 7fae0f089700 1 -- 172.21.15.40:0/1773112682 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae0805a260 con 0x7fae080657e0 2023-09-30T22:22:01.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.116+0000 7fae04ff9700 1 -- 172.21.15.40:0/1773112682 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fadfc019900 con 0x7fae080657e0 2023-09-30T22:22:01.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.281+0000 7fae0f089700 1 -- 172.21.15.40:0/1773112682 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fae08099a50 con 0x7fae080657e0 2023-09-30T22:22:01.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.960+0000 7fae04ff9700 1 -- 172.21.15.40:0/1773112682 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v15) v1 ==== 170+0+0 (secure 0 0 0) 0x7fadfc023350 con 0x7fae080657e0 2023-09-30T22:22:01.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.967+0000 7fae0f089700 1 -- 172.21.15.40:0/1773112682 >> v1:172.21.15.40:6816/118905 conn(0x7fadec02bb60 legacy=0x7fadec02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.967+0000 7fae0f089700 1 -- 172.21.15.40:0/1773112682 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae080657e0 msgr2=0x7fae0813a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.967+0000 7fae0f089700 1 --2- 172.21.15.40:0/1773112682 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae080657e0 0x7fae0813a3e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fadfc00e930 tx=0x7fadfc009060).stop 2023-09-30T22:22:01.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.967+0000 7fae0f089700 1 -- 172.21.15.40:0/1773112682 shutdown_connections 2023-09-30T22:22:01.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.967+0000 7fae0f089700 1 --2- 172.21.15.40:0/1773112682 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae0813adc0 0x7fae0811ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:01.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.967+0000 7fae0f089700 1 --2- 172.21.15.40:0/1773112682 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae080657e0 0x7fae0813a3e0 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0x7fadfc00e930 tx=0x7fadfc009060).stop 2023-09-30T22:22:01.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.967+0000 7fae0f089700 1 --2- 172.21.15.40:0/1773112682 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae08097000 0x7fae0813a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:01.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.967+0000 7fae0f089700 1 -- 172.21.15.40:0/1773112682 >> 172.21.15.40:0/1773112682 conn(0x7fae0809de50 msgr2=0x7fae0809bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:01.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.968+0000 7fae0f089700 1 -- 172.21.15.40:0/1773112682 shutdown_connections 2023-09-30T22:22:01.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:01.971+0000 7fae0f089700 1 -- 172.21.15.40:0/1773112682 wait complete. 2023-09-30T22:22:01.979 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' created 2023-09-30T22:22:01.998 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-30T22:22:02.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.126+0000 7f6260890700 1 Processor -- start 2023-09-30T22:22:02.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.126+0000 7f6260890700 1 -- start start 2023-09-30T22:22:02.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.127+0000 7f6260890700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f625c067fb0 0x7f625c068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:02.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.127+0000 7f6260890700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f625c128260 0x7f625c12ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:02.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.127+0000 7f6260890700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f625c0933e0 con 0x7f625c068880 2023-09-30T22:22:02.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.127+0000 7f6260890700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f625c091f10 con 0x7f625c067fb0 2023-09-30T22:22:02.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.127+0000 7f6260890700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f625c069240 con 0x7f625c128260 2023-09-30T22:22:02.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.127+0000 7f625ad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f625c128260 0x7f625c12ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:02.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.127+0000 7f625ad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f625c128260 0x7f625c12ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58794/0 (socket says 172.21.15.40:58794) 2023-09-30T22:22:02.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.127+0000 7f625a59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f625c067fb0 0x7f625c068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:02.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.127+0000 7f625ad9d700 1 -- 172.21.15.40:0/4192248484 learned_addr learned my addr 172.21.15.40:0/4192248484 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:02.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.127+0000 7f625ad9d700 1 -- 172.21.15.40:0/4192248484 >> v2:172.21.15.40:3300/0 conn(0x7f625c067fb0 msgr2=0x7f625c068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:02.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.127+0000 7f625ad9d700 1 --2- 172.21.15.40:0/4192248484 >> v2:172.21.15.40:3300/0 conn(0x7f625c067fb0 0x7f625c068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:02.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.127+0000 7f625ad9d700 1 -- 172.21.15.40:0/4192248484 >> v1:172.21.15.40:6789/0 conn(0x7f625c068880 legacy=0x7f625c127b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:02.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.127+0000 7f625ad9d700 1 -- 172.21.15.40:0/4192248484 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625c093110 con 0x7f625c128260 2023-09-30T22:22:02.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.127+0000 7f625a59c700 1 --2- 172.21.15.40:0/4192248484 >> v2:172.21.15.40:3300/0 conn(0x7f625c067fb0 0x7f625c068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:02.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.128+0000 7f625ad9d700 1 --2- 172.21.15.40:0/4192248484 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f625c128260 0x7f625c12ffc0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f6254009f20 tx=0x7f6254009840).ready entity=mon.2 client_cookie=85b541dd671b7593 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:02.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.128+0000 7f625959a700 1 -- 172.21.15.40:0/4192248484 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625400e070 con 0x7f625c128260 2023-09-30T22:22:02.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.128+0000 7f625959a700 1 -- 172.21.15.40:0/4192248484 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625400b9d0 con 0x7f625c128260 2023-09-30T22:22:02.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.128+0000 7f625959a700 1 -- 172.21.15.40:0/4192248484 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625400bd50 con 0x7f625c128260 2023-09-30T22:22:02.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.128+0000 7f6260890700 1 -- 172.21.15.40:0/4192248484 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f625c128260 msgr2=0x7f625c12ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:02.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.128+0000 7f6260890700 1 --2- 172.21.15.40:0/4192248484 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f625c128260 0x7f625c12ffc0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f6254009f20 tx=0x7f6254009840).stop 2023-09-30T22:22:02.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.128+0000 7f6260890700 1 -- 172.21.15.40:0/4192248484 shutdown_connections 2023-09-30T22:22:02.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.128+0000 7f6260890700 1 --2- 172.21.15.40:0/4192248484 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f625c128260 0x7f625c12ffc0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:02.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.128+0000 7f6260890700 1 --2- 172.21.15.40:0/4192248484 >> v2:172.21.15.40:3300/0 conn(0x7f625c067fb0 0x7f625c068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:02.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.128+0000 7f6260890700 1 -- 172.21.15.40:0/4192248484 >> 172.21.15.40:0/4192248484 conn(0x7f625c05eb30 msgr2=0x7f625c09a380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:02.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.128+0000 7f6260890700 1 -- 172.21.15.40:0/4192248484 shutdown_connections 2023-09-30T22:22:02.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.128+0000 7f6260890700 1 -- 172.21.15.40:0/4192248484 wait complete. 2023-09-30T22:22:02.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.129+0000 7f6260890700 1 Processor -- start 2023-09-30T22:22:02.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.129+0000 7f6260890700 1 -- start start 2023-09-30T22:22:02.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.130+0000 7f6260890700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f625c067fb0 0x7f625c066ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:02.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.130+0000 7f6260890700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f625c068880 0x7f625c113100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:02.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.130+0000 7f6260890700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f625c128260 0x7f625c1135f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:02.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.130+0000 7f6260890700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625c09a590 con 0x7f625c068880 2023-09-30T22:22:02.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.130+0000 7f6260890700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f625c119a80 con 0x7f625c067fb0 2023-09-30T22:22:02.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.130+0000 7f6260890700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f625c067aa0 con 0x7f625c128260 2023-09-30T22:22:02.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.130+0000 7f625ad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f625c128260 0x7f625c1135f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:02.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.130+0000 7f625a59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f625c067fb0 0x7f625c066ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:02.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.130+0000 7f625ad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f625c128260 0x7f625c1135f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58800/0 (socket says 172.21.15.40:58800) 2023-09-30T22:22:02.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.130+0000 7f625ad9d700 1 -- 172.21.15.40:0/2497096265 learned_addr learned my addr 172.21.15.40:0/2497096265 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:02.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.130+0000 7f6259d9b700 1 --2- 172.21.15.40:0/2497096265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f625c068880 0x7f625c113100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:02.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.130+0000 7f625ad9d700 1 -- 172.21.15.40:0/2497096265 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f625c067fb0 msgr2=0x7f625c066ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:02.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.130+0000 7f625ad9d700 1 --2- 172.21.15.40:0/2497096265 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f625c067fb0 0x7f625c066ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:02.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.130+0000 7f625ad9d700 1 -- 172.21.15.40:0/2497096265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f625c068880 msgr2=0x7f625c113100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:02.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.130+0000 7f625ad9d700 1 --2- 172.21.15.40:0/2497096265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f625c068880 0x7f625c113100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:02.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.130+0000 7f625ad9d700 1 -- 172.21.15.40:0/2497096265 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624c0092a0 con 0x7f625c128260 2023-09-30T22:22:02.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.130+0000 7f625a59c700 1 --2- 172.21.15.40:0/2497096265 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f625c067fb0 0x7f625c066ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:02.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.130+0000 7f625ad9d700 1 --2- 172.21.15.40:0/2497096265 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f625c128260 0x7f625c1135f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f6254003370 tx=0x7f625c069540).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:02.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.130+0000 7f624a7fc700 1 -- 172.21.15.40:0/2497096265 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6254007080 con 0x7f625c128260 2023-09-30T22:22:02.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.130+0000 7f624a7fc700 1 -- 172.21.15.40:0/2497096265 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62540092e0 con 0x7f625c128260 2023-09-30T22:22:02.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.130+0000 7f6260890700 1 -- 172.21.15.40:0/2497096265 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6254009ae0 con 0x7f625c128260 2023-09-30T22:22:02.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.130+0000 7f624a7fc700 1 -- 172.21.15.40:0/2497096265 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6254007840 con 0x7f625c128260 2023-09-30T22:22:02.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.130+0000 7f6260890700 1 -- 172.21.15.40:0/2497096265 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f625c112ce0 con 0x7f625c128260 2023-09-30T22:22:02.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.131+0000 7f624a7fc700 1 -- 172.21.15.40:0/2497096265 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f6254003040 con 0x7f625c128260 2023-09-30T22:22:02.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.131+0000 7f624a7fc700 1 -- 172.21.15.40:0/2497096265 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3590+0+0 (secure 0 0 0) 0x7f625403cb30 con 0x7f625c128260 2023-09-30T22:22:02.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.131+0000 7f6260890700 1 -- 172.21.15.40:0/2497096265 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f625c127890 con 0x7f625c128260 2023-09-30T22:22:02.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.136+0000 7f624a7fc700 1 -- 172.21.15.40:0/2497096265 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f62540123c0 con 0x7f625c128260 2023-09-30T22:22:02.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.345+0000 7f6260890700 1 -- 172.21.15.40:0/2497096265 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f625c05a260 con 0x7f625c128260 2023-09-30T22:22:02.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.360+0000 7f624a7fc700 1 -- 172.21.15.40:0/2497096265 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v3) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6254027b50 con 0x7f625c128260 2023-09-30T22:22:02.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.382+0000 7f6260890700 1 -- 172.21.15.40:0/2497096265 >> v1:172.21.15.40:6816/118905 conn(0x7f623c02bb60 legacy=0x7f623c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:02.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.382+0000 7f6260890700 1 -- 172.21.15.40:0/2497096265 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f625c128260 msgr2=0x7f625c1135f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:02.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.382+0000 7f6260890700 1 --2- 172.21.15.40:0/2497096265 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f625c128260 0x7f625c1135f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f6254003370 tx=0x7f625c069540).stop 2023-09-30T22:22:02.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.383+0000 7f6260890700 1 -- 172.21.15.40:0/2497096265 shutdown_connections 2023-09-30T22:22:02.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.383+0000 7f6260890700 1 --2- 172.21.15.40:0/2497096265 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f625c128260 0x7f625c1135f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:02.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.383+0000 7f6260890700 1 --2- 172.21.15.40:0/2497096265 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f625c067fb0 0x7f625c066ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:02.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.383+0000 7f6260890700 1 --2- 172.21.15.40:0/2497096265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f625c068880 0x7f625c113100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:02.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.383+0000 7f6260890700 1 -- 172.21.15.40:0/2497096265 >> 172.21.15.40:0/2497096265 conn(0x7f625c05eb30 msgr2=0x7f625c0967c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:02.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.383+0000 7f6260890700 1 -- 172.21.15.40:0/2497096265 shutdown_connections 2023-09-30T22:22:02.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.383+0000 7f6260890700 1 -- 172.21.15.40:0/2497096265 wait complete. 2023-09-30T22:22:02.392 INFO:teuthology.orchestra.run.smithi040.stderr:new fs with metadata pool 3 and data pool 4 2023-09-30T22:22:02.405 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:22:02.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.525+0000 7f67391a1700 1 Processor -- start 2023-09-30T22:22:02.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.525+0000 7f67391a1700 1 -- start start 2023-09-30T22:22:02.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.525+0000 7f67391a1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f673405e090 0x7f67341258a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:02.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.525+0000 7f67391a1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6734126190 0x7f6734094320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:02.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.525+0000 7f67391a1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6734096950 con 0x7f6734125d90 2023-09-30T22:22:02.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.525+0000 7f67391a1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f673405e470 con 0x7f673405e090 2023-09-30T22:22:02.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.525+0000 7f67391a1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6734096770 con 0x7f6734126190 2023-09-30T22:22:02.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.525+0000 7f6732d9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f673405e090 0x7f67341258a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:02.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.525+0000 7f673359e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6734126190 0x7f6734094320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:02.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.526+0000 7f673259c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6734125d90 0x7f6734093c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55902/0 (socket says 172.21.15.40:55902) 2023-09-30T22:22:02.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.526+0000 7f673259c700 1 -- 172.21.15.40:0/1984446154 learned_addr learned my addr 172.21.15.40:0/1984446154 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:22:02.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.526+0000 7f6732d9d700 1 -- 172.21.15.40:0/1984446154 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6734126190 msgr2=0x7f6734094320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:02.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.526+0000 7f6732d9d700 1 --2- 172.21.15.40:0/1984446154 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6734126190 0x7f6734094320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:02.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.526+0000 7f6732d9d700 1 -- 172.21.15.40:0/1984446154 >> v1:172.21.15.40:6789/0 conn(0x7f6734125d90 legacy=0x7f6734093c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:02.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.526+0000 7f6731d9b700 1 -- 172.21.15.40:0/1984446154 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 701540196 0 0) 0x7f6734096950 con 0x7f6734125d90 2023-09-30T22:22:02.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.526+0000 7f6732d9d700 1 -- 172.21.15.40:0/1984446154 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67340963b0 con 0x7f673405e090 2023-09-30T22:22:02.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.526+0000 7f673359e700 1 --2- 172.21.15.40:0/1984446154 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6734126190 0x7f6734094320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:02.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.526+0000 7f6732d9d700 1 --2- 172.21.15.40:0/1984446154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f673405e090 0x7f67341258a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f6724009760 tx=0x7f6724009060).ready entity=mon.0 client_cookie=7aa4832122a9d23b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:02.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.526+0000 7f6731d9b700 1 -- 172.21.15.40:0/1984446154 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672400f510 con 0x7f673405e090 2023-09-30T22:22:02.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.526+0000 7f6731d9b700 1 -- 172.21.15.40:0/1984446154 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672400f670 con 0x7f673405e090 2023-09-30T22:22:02.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.526+0000 7f6731d9b700 1 -- 172.21.15.40:0/1984446154 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672400f9f0 con 0x7f673405e090 2023-09-30T22:22:02.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.527+0000 7f67391a1700 1 -- 172.21.15.40:0/1984446154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f673405e090 msgr2=0x7f67341258a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:02.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.527+0000 7f67391a1700 1 --2- 172.21.15.40:0/1984446154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f673405e090 0x7f67341258a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f6724009760 tx=0x7f6724009060).stop 2023-09-30T22:22:02.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.527+0000 7f67391a1700 1 -- 172.21.15.40:0/1984446154 shutdown_connections 2023-09-30T22:22:02.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.527+0000 7f67391a1700 1 --2- 172.21.15.40:0/1984446154 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6734126190 0x7f6734094320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:02.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.527+0000 7f67391a1700 1 --2- 172.21.15.40:0/1984446154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f673405e090 0x7f67341258a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:02.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.527+0000 7f67391a1700 1 -- 172.21.15.40:0/1984446154 >> 172.21.15.40:0/1984446154 conn(0x7f6734097580 msgr2=0x7f6734097990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:02.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.527+0000 7f67391a1700 1 -- 172.21.15.40:0/1984446154 shutdown_connections 2023-09-30T22:22:02.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.527+0000 7f67391a1700 1 -- 172.21.15.40:0/1984446154 wait complete. 2023-09-30T22:22:02.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.528+0000 7f67391a1700 1 Processor -- start 2023-09-30T22:22:02.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.528+0000 7f67391a1700 1 -- start start 2023-09-30T22:22:02.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.529+0000 7f67391a1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f673405e090 0x7f6734138340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:02.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.529+0000 7f67391a1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6734125d90 0x7f6734138830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:02.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.529+0000 7f67391a1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6734126190 0x7f6734067a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:02.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.529+0000 7f67391a1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67341117d0 con 0x7f6734125d90 2023-09-30T22:22:02.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.529+0000 7f67391a1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6734068ef0 con 0x7f6734126190 2023-09-30T22:22:02.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.529+0000 7f67391a1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6734127330 con 0x7f673405e090 2023-09-30T22:22:02.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.529+0000 7f6732d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f673405e090 0x7f6734138340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:02.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.529+0000 7f6732d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f673405e090 0x7f6734138340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58822/0 (socket says 172.21.15.40:58822) 2023-09-30T22:22:02.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.529+0000 7f6732d9d700 1 -- 172.21.15.40:0/33954521 learned_addr learned my addr 172.21.15.40:0/33954521 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:02.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.529+0000 7f673259c700 1 --2- 172.21.15.40:0/33954521 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6734125d90 0x7f6734138830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:02.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.529+0000 7f673359e700 1 --2- 172.21.15.40:0/33954521 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6734126190 0x7f6734067a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:02.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.529+0000 7f6732d9d700 1 -- 172.21.15.40:0/33954521 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6734126190 msgr2=0x7f6734067a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:02.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.529+0000 7f6732d9d700 1 --2- 172.21.15.40:0/33954521 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6734126190 0x7f6734067a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:02.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.529+0000 7f6732d9d700 1 -- 172.21.15.40:0/33954521 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6734125d90 msgr2=0x7f6734138830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:02.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.529+0000 7f6732d9d700 1 --2- 172.21.15.40:0/33954521 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6734125d90 0x7f6734138830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:02.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.529+0000 7f6732d9d700 1 -- 172.21.15.40:0/33954521 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672c009a20 con 0x7f673405e090 2023-09-30T22:22:02.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.529+0000 7f673259c700 1 --2- 172.21.15.40:0/33954521 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6734125d90 0x7f6734138830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:02.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.529+0000 7f6732d9d700 1 --2- 172.21.15.40:0/33954521 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f673405e090 0x7f6734138340 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f6724009f90 tx=0x7f6724017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:02.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.529+0000 7f671affd700 1 -- 172.21.15.40:0/33954521 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672400f7e0 con 0x7f673405e090 2023-09-30T22:22:02.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.529+0000 7f671affd700 1 -- 172.21.15.40:0/33954521 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672400f940 con 0x7f673405e090 2023-09-30T22:22:02.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.529+0000 7f671affd700 1 -- 172.21.15.40:0/33954521 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672401b660 con 0x7f673405e090 2023-09-30T22:22:02.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.530+0000 7f67391a1700 1 -- 172.21.15.40:0/33954521 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67240092a0 con 0x7f673405e090 2023-09-30T22:22:02.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.530+0000 7f67391a1700 1 -- 172.21.15.40:0/33954521 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6734111c80 con 0x7f673405e090 2023-09-30T22:22:02.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.530+0000 7f671affd700 1 -- 172.21.15.40:0/33954521 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f672401b9d0 con 0x7f673405e090 2023-09-30T22:22:02.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.530+0000 7f671affd700 1 -- 172.21.15.40:0/33954521 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f672403ca00 con 0x7f673405e090 2023-09-30T22:22:02.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.530+0000 7f67391a1700 1 -- 172.21.15.40:0/33954521 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f673405a260 con 0x7f673405e090 2023-09-30T22:22:02.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.535+0000 7f671affd700 1 -- 172.21.15.40:0/33954521 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f6724029080 con 0x7f673405e090 2023-09-30T22:22:02.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.701+0000 7f67391a1700 1 -- 172.21.15.40:0/33954521 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6734125520 con 0x7f673405e090 2023-09-30T22:22:02.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.702+0000 7f671affd700 1 -- 172.21.15.40:0/33954521 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11354 (secure 0 0 0) 0x7f672401f020 con 0x7f673405e090 2023-09-30T22:22:02.703 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:22:02.703 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":16,"fsid":"79dd4d8e-f295-4d9c-bd93-9850863800e3","created":"2023-09-30T22:21:46.980357+0000","modified":"2023-09-30T22:22:02.347266+0000","last_up_change":"2023-09-30T22:21:54.822866+0000","last_in_change":"2023-09-30T22:21:48.205613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:21:54.875024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:21:56.197012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:22:00.759069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:22:01.327265+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"771f785c-f464-4b17-936c-cbf31b1153e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6812","nonce":119451}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6813","nonce":119451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6815","nonce":119451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6814","nonce":119451}]},"public_addr":"172.21.15.40:6812/119451","cluster_addr":"172.21.15.40:6813/119451","heartbeat_back_addr":"172.21.15.40:6815/119451","heartbeat_front_addr":"172.21.15.40:6814/119451","state":["exists","up"]},{"osd":1,"uuid":"45f1e2e8-5310-4219-ab54-424e7440fcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6808","nonce":119436}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6809","nonce":119436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6811","nonce":119436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6810","nonce":119436}]},"public_addr":"172.21.15.40:6808/119436","cluster_addr":"172.21.15.40:6809/119436","heartbeat_back_addr":"172.21.15.40:6811/119436","heartbeat_front_addr":"172.21.15.40:6810/119436","state":["exists","up"]},{"osd":2,"uuid":"7ba62ae5-d21e-4d56-b46c-ba7b718ede25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6800","nonce":119433}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6801","nonce":119433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6803","nonce":119433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6802","nonce":119433}]},"public_addr":"172.21.15.40:6800/119433","cluster_addr":"172.21.15.40:6801/119433","heartbeat_back_addr":"172.21.15.40:6803/119433","heartbeat_front_addr":"172.21.15.40:6802/119433","state":["exists","up"]},{"osd":3,"uuid":"c9c55985-8a90-4927-a8fa-6a1fcec1cd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6804","nonce":119432}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6805","nonce":119432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6807","nonce":119432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6806","nonce":119432}]},"public_addr":"172.21.15.40:6804/119432","cluster_addr":"172.21.15.40:6805/119432","heartbeat_back_addr":"172.21.15.40:6807/119432","heartbeat_front_addr":"172.21.15.40:6806/119432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.339829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.554690+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.641664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.320635+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:22:02.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.704+0000 7f67391a1700 1 -- 172.21.15.40:0/33954521 >> v1:172.21.15.40:6816/118905 conn(0x7f672002bb60 legacy=0x7f672002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:02.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.704+0000 7f67391a1700 1 -- 172.21.15.40:0/33954521 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f673405e090 msgr2=0x7f6734138340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:02.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.704+0000 7f67391a1700 1 --2- 172.21.15.40:0/33954521 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f673405e090 0x7f6734138340 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f6724009f90 tx=0x7f6724017000).stop 2023-09-30T22:22:02.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.704+0000 7f67391a1700 1 -- 172.21.15.40:0/33954521 shutdown_connections 2023-09-30T22:22:02.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.704+0000 7f67391a1700 1 --2- 172.21.15.40:0/33954521 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f673405e090 0x7f6734138340 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:02.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.704+0000 7f67391a1700 1 --2- 172.21.15.40:0/33954521 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6734126190 0x7f6734067a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:02.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.704+0000 7f67391a1700 1 --2- 172.21.15.40:0/33954521 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6734125d90 0x7f6734138830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:02.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.704+0000 7f67391a1700 1 -- 172.21.15.40:0/33954521 >> 172.21.15.40:0/33954521 conn(0x7f6734097580 msgr2=0x7f6734124320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:02.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.704+0000 7f67391a1700 1 -- 172.21.15.40:0/33954521 shutdown_connections 2023-09-30T22:22:02.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.704+0000 7f67391a1700 1 -- 172.21.15.40:0/33954521 wait complete. 2023-09-30T22:22:02.717 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:22:02.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.837+0000 7f7894971700 1 Processor -- start 2023-09-30T22:22:02.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.837+0000 7f7894971700 1 -- start start 2023-09-30T22:22:02.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.838+0000 7f7894971700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7890098b10 0x7f7890096160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:02.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.838+0000 7f7894971700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7890130650 0x7f7890132a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:02.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.838+0000 7f7894971700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7890098910 con 0x7f7890098ef0 2023-09-30T22:22:02.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.838+0000 7f7894971700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7890065e40 con 0x7f7890130650 2023-09-30T22:22:02.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.838+0000 7f7894971700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78900955c0 con 0x7f7890098b10 2023-09-30T22:22:02.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.838+0000 7f788e59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7890098b10 0x7f7890096160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:02.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.838+0000 7f788ed9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7890130650 0x7f7890132a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:02.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.838+0000 7f788ed9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7890130650 0x7f7890132a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44324/0 (socket says 172.21.15.40:44324) 2023-09-30T22:22:02.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.838+0000 7f788e59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7890098b10 0x7f7890096160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58824/0 (socket says 172.21.15.40:58824) 2023-09-30T22:22:02.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.838+0000 7f788ed9d700 1 -- 172.21.15.40:0/4151426847 learned_addr learned my addr 172.21.15.40:0/4151426847 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:02.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.838+0000 7f788dd9b700 1 --1- 172.21.15.40:0/4151426847 >> v1:172.21.15.40:6789/0 conn(0x7f7890098ef0 0x7f78900992f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55910/0 (socket says 172.21.15.40:55910) 2023-09-30T22:22:02.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.838+0000 7f788e59c700 1 -- 172.21.15.40:0/4151426847 >> v2:172.21.15.40:3300/0 conn(0x7f7890130650 msgr2=0x7f7890132a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:02.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.838+0000 7f788e59c700 1 --2- 172.21.15.40:0/4151426847 >> v2:172.21.15.40:3300/0 conn(0x7f7890130650 0x7f7890132a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:02.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.838+0000 7f788e59c700 1 -- 172.21.15.40:0/4151426847 >> v1:172.21.15.40:6789/0 conn(0x7f7890098ef0 legacy=0x7f78900992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:02.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.838+0000 7f788d59a700 1 -- 172.21.15.40:0/4151426847 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3718346489 0 0) 0x7f7890098910 con 0x7f7890098ef0 2023-09-30T22:22:02.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.838+0000 7f788e59c700 1 -- 172.21.15.40:0/4151426847 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7890097750 con 0x7f7890098b10 2023-09-30T22:22:02.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.838+0000 7f788ed9d700 1 --2- 172.21.15.40:0/4151426847 >> v2:172.21.15.40:3300/0 conn(0x7f7890130650 0x7f7890132a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:02.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.838+0000 7f788e59c700 1 --2- 172.21.15.40:0/4151426847 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7890098b10 0x7f7890096160 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f7884009760 tx=0x7f7884009060).ready entity=mon.2 client_cookie=701a424a57850445 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:02.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.838+0000 7f788d59a700 1 -- 172.21.15.40:0/4151426847 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78840090d0 con 0x7f7890098b10 2023-09-30T22:22:02.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.838+0000 7f788d59a700 1 -- 172.21.15.40:0/4151426847 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788400f510 con 0x7f7890098b10 2023-09-30T22:22:02.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.838+0000 7f788d59a700 1 -- 172.21.15.40:0/4151426847 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788400f890 con 0x7f7890098b10 2023-09-30T22:22:02.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.839+0000 7f7894971700 1 -- 172.21.15.40:0/4151426847 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7890098b10 msgr2=0x7f7890096160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:02.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.839+0000 7f7894971700 1 --2- 172.21.15.40:0/4151426847 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7890098b10 0x7f7890096160 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f7884009760 tx=0x7f7884009060).stop 2023-09-30T22:22:02.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.839+0000 7f7894971700 1 -- 172.21.15.40:0/4151426847 shutdown_connections 2023-09-30T22:22:02.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.839+0000 7f7894971700 1 --2- 172.21.15.40:0/4151426847 >> v2:172.21.15.40:3300/0 conn(0x7f7890130650 0x7f7890132a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:02.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.839+0000 7f7894971700 1 --2- 172.21.15.40:0/4151426847 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7890098b10 0x7f7890096160 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:02.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.839+0000 7f7894971700 1 -- 172.21.15.40:0/4151426847 >> 172.21.15.40:0/4151426847 conn(0x7f789009ab30 msgr2=0x7f789009af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:02.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.839+0000 7f7894971700 1 -- 172.21.15.40:0/4151426847 shutdown_connections 2023-09-30T22:22:02.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.839+0000 7f7894971700 1 -- 172.21.15.40:0/4151426847 wait complete. 2023-09-30T22:22:02.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.840+0000 7f7894971700 1 Processor -- start 2023-09-30T22:22:02.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.840+0000 7f7894971700 1 -- start start 2023-09-30T22:22:02.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.840+0000 7f7894971700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7890098b10 0x7f789011a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:02.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.840+0000 7f7894971700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7890098ef0 0x7f789011a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:02.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.840+0000 7f7894971700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7890130650 0x7f789011ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:02.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.840+0000 7f7894971700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789011b290 con 0x7f7890098ef0 2023-09-30T22:22:02.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.840+0000 7f7894971700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f789011db40 con 0x7f7890098b10 2023-09-30T22:22:02.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.840+0000 7f7894971700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f789011b830 con 0x7f7890130650 2023-09-30T22:22:02.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.840+0000 7f788dd9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7890098ef0 0x7f789011a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:02.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.840+0000 7f788e59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7890098b10 0x7f789011a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:02.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.840+0000 7f788ed9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7890130650 0x7f789011ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:02.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.840+0000 7f788dd9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7890098ef0 0x7f789011a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44326/0 (socket says 172.21.15.40:44326) 2023-09-30T22:22:02.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.841+0000 7f788dd9b700 1 -- 172.21.15.40:0/63844567 learned_addr learned my addr 172.21.15.40:0/63844567 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:02.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.841+0000 7f788e59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7890098b10 0x7f789011a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48926/0 (socket says 172.21.15.40:48926) 2023-09-30T22:22:02.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.841+0000 7f788dd9b700 1 -- 172.21.15.40:0/63844567 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7890130650 msgr2=0x7f789011ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:02.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.841+0000 7f788dd9b700 1 --2- 172.21.15.40:0/63844567 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7890130650 0x7f789011ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:02.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.841+0000 7f788dd9b700 1 -- 172.21.15.40:0/63844567 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7890098b10 msgr2=0x7f789011a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:02.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.841+0000 7f788dd9b700 1 --2- 172.21.15.40:0/63844567 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7890098b10 0x7f789011a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:02.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.841+0000 7f788dd9b700 1 -- 172.21.15.40:0/63844567 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7888009ae0 con 0x7f7890098ef0 2023-09-30T22:22:02.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.841+0000 7f788e59c700 1 --2- 172.21.15.40:0/63844567 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7890098b10 0x7f789011a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:02.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.841+0000 7f788ed9d700 1 --2- 172.21.15.40:0/63844567 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7890130650 0x7f789011ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:02.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.841+0000 7f788dd9b700 1 --2- 172.21.15.40:0/63844567 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7890098ef0 0x7f789011a8b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f788000c4c0 tx=0x7f7880007be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:02.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.841+0000 7f787e7fc700 1 -- 172.21.15.40:0/63844567 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78800070d0 con 0x7f7890098ef0 2023-09-30T22:22:02.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.841+0000 7f787e7fc700 1 -- 172.21.15.40:0/63844567 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7880007230 con 0x7f7890098ef0 2023-09-30T22:22:02.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.841+0000 7f7894971700 1 -- 172.21.15.40:0/63844567 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78840092a0 con 0x7f7890098ef0 2023-09-30T22:22:02.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.841+0000 7f787e7fc700 1 -- 172.21.15.40:0/63844567 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78800056e0 con 0x7f7890098ef0 2023-09-30T22:22:02.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.841+0000 7f7894971700 1 -- 172.21.15.40:0/63844567 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7890099de0 con 0x7f7890098ef0 2023-09-30T22:22:02.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.842+0000 7f787e7fc700 1 -- 172.21.15.40:0/63844567 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f7880005a50 con 0x7f7890098ef0 2023-09-30T22:22:02.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.842+0000 7f787e7fc700 1 -- 172.21.15.40:0/63844567 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f788003a520 con 0x7f7890098ef0 2023-09-30T22:22:02.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.842+0000 7f7894971700 1 -- 172.21.15.40:0/63844567 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f789005a260 con 0x7f7890098ef0 2023-09-30T22:22:02.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:02.847+0000 7f787e7fc700 1 -- 172.21.15.40:0/63844567 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f788001b350 con 0x7f7890098ef0 2023-09-30T22:22:03.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.015+0000 7f7894971700 1 -- 172.21.15.40:0/63844567 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7890099a40 con 0x7f7890098ef0 2023-09-30T22:22:03.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.016+0000 7f787e7fc700 1 -- 172.21.15.40:0/63844567 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11354 (secure 0 0 0) 0x7f7880007d20 con 0x7f7890098ef0 2023-09-30T22:22:03.016 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:22:03.016 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":16,"fsid":"79dd4d8e-f295-4d9c-bd93-9850863800e3","created":"2023-09-30T22:21:46.980357+0000","modified":"2023-09-30T22:22:02.347266+0000","last_up_change":"2023-09-30T22:21:54.822866+0000","last_in_change":"2023-09-30T22:21:48.205613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:21:54.875024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:21:56.197012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:22:00.759069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:22:01.327265+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"771f785c-f464-4b17-936c-cbf31b1153e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6812","nonce":119451}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6813","nonce":119451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6815","nonce":119451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6814","nonce":119451}]},"public_addr":"172.21.15.40:6812/119451","cluster_addr":"172.21.15.40:6813/119451","heartbeat_back_addr":"172.21.15.40:6815/119451","heartbeat_front_addr":"172.21.15.40:6814/119451","state":["exists","up"]},{"osd":1,"uuid":"45f1e2e8-5310-4219-ab54-424e7440fcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6808","nonce":119436}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6809","nonce":119436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6811","nonce":119436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6810","nonce":119436}]},"public_addr":"172.21.15.40:6808/119436","cluster_addr":"172.21.15.40:6809/119436","heartbeat_back_addr":"172.21.15.40:6811/119436","heartbeat_front_addr":"172.21.15.40:6810/119436","state":["exists","up"]},{"osd":2,"uuid":"7ba62ae5-d21e-4d56-b46c-ba7b718ede25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6800","nonce":119433}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6801","nonce":119433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6803","nonce":119433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6802","nonce":119433}]},"public_addr":"172.21.15.40:6800/119433","cluster_addr":"172.21.15.40:6801/119433","heartbeat_back_addr":"172.21.15.40:6803/119433","heartbeat_front_addr":"172.21.15.40:6802/119433","state":["exists","up"]},{"osd":3,"uuid":"c9c55985-8a90-4927-a8fa-6a1fcec1cd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6804","nonce":119432}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6805","nonce":119432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6807","nonce":119432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6806","nonce":119432}]},"public_addr":"172.21.15.40:6804/119432","cluster_addr":"172.21.15.40:6805/119432","heartbeat_back_addr":"172.21.15.40:6807/119432","heartbeat_front_addr":"172.21.15.40:6806/119432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.339829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.554690+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.641664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.320635+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:22:03.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.017+0000 7f7894971700 1 -- 172.21.15.40:0/63844567 >> v1:172.21.15.40:6816/118905 conn(0x7f787002bb60 legacy=0x7f787002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:03.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.017+0000 7f7894971700 1 -- 172.21.15.40:0/63844567 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7890098ef0 msgr2=0x7f789011a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:03.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.017+0000 7f7894971700 1 --2- 172.21.15.40:0/63844567 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7890098ef0 0x7f789011a8b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f788000c4c0 tx=0x7f7880007be0).stop 2023-09-30T22:22:03.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.017+0000 7f7894971700 1 -- 172.21.15.40:0/63844567 shutdown_connections 2023-09-30T22:22:03.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.017+0000 7f7894971700 1 --2- 172.21.15.40:0/63844567 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7890130650 0x7f789011ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:03.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.017+0000 7f7894971700 1 --2- 172.21.15.40:0/63844567 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7890098b10 0x7f789011a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:03.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.017+0000 7f7894971700 1 --2- 172.21.15.40:0/63844567 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7890098ef0 0x7f789011a8b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:03.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.017+0000 7f7894971700 1 -- 172.21.15.40:0/63844567 >> 172.21.15.40:0/63844567 conn(0x7f789009ab30 msgr2=0x7f789009bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:03.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.017+0000 7f7894971700 1 -- 172.21.15.40:0/63844567 shutdown_connections 2023-09-30T22:22:03.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.018+0000 7f7894971700 1 -- 172.21.15.40:0/63844567 wait complete. 2023-09-30T22:22:03.030 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-30T22:22:03.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.152+0000 7f949a239700 1 Processor -- start 2023-09-30T22:22:03.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.152+0000 7f949a239700 1 -- start start 2023-09-30T22:22:03.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.152+0000 7f949a239700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94940657e0 0x7f9494096620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:03.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.152+0000 7f949a239700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9494097220 0x7f9494132660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:03.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.152+0000 7f949a239700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9494098350 con 0x7f9494097ec0 2023-09-30T22:22:03.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.152+0000 7f949a239700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9494065bc0 con 0x7f94940657e0 2023-09-30T22:22:03.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.152+0000 7f949a239700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9494096350 con 0x7f9494097220 2023-09-30T22:22:03.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.152+0000 7f94937fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94940657e0 0x7f9494096620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:03.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.152+0000 7f9492ffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9494097ec0 0x7f9494096b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55916/0 (socket says 172.21.15.40:55916) 2023-09-30T22:22:03.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.152+0000 7f9493fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9494097220 0x7f9494132660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:03.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.153+0000 7f9492ffd700 1 -- 172.21.15.40:0/2112651030 learned_addr learned my addr 172.21.15.40:0/2112651030 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:22:03.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.153+0000 7f94927fc700 1 -- 172.21.15.40:0/2112651030 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 634213428 0 0) 0x7f9494098350 con 0x7f9494097ec0 2023-09-30T22:22:03.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.153+0000 7f9493fff700 1 -- 172.21.15.40:0/2112651030 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94940657e0 msgr2=0x7f9494096620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:03.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.153+0000 7f9493fff700 1 --2- 172.21.15.40:0/2112651030 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94940657e0 0x7f9494096620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:03.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.153+0000 7f9493fff700 1 -- 172.21.15.40:0/2112651030 >> v1:172.21.15.40:6789/0 conn(0x7f9494097ec0 legacy=0x7f9494096b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:03.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.153+0000 7f9493fff700 1 -- 172.21.15.40:0/2112651030 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94940662b0 con 0x7f9494097220 2023-09-30T22:22:03.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.153+0000 7f94937fe700 1 --2- 172.21.15.40:0/2112651030 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94940657e0 0x7f9494096620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:03.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.153+0000 7f9493fff700 1 --2- 172.21.15.40:0/2112651030 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9494097220 0x7f9494132660 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f948c009e90 tx=0x7f948c009780).ready entity=mon.2 client_cookie=4e36fc2e3ef1c61f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:03.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.153+0000 7f94927fc700 1 -- 172.21.15.40:0/2112651030 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c00e070 con 0x7f9494097220 2023-09-30T22:22:03.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.153+0000 7f94927fc700 1 -- 172.21.15.40:0/2112651030 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948c00bb60 con 0x7f9494097220 2023-09-30T22:22:03.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.153+0000 7f94927fc700 1 -- 172.21.15.40:0/2112651030 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c012410 con 0x7f9494097220 2023-09-30T22:22:03.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.154+0000 7f949a239700 1 -- 172.21.15.40:0/2112651030 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9494097220 msgr2=0x7f9494132660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:03.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.154+0000 7f949a239700 1 --2- 172.21.15.40:0/2112651030 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9494097220 0x7f9494132660 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f948c009e90 tx=0x7f948c009780).stop 2023-09-30T22:22:03.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.154+0000 7f949a239700 1 -- 172.21.15.40:0/2112651030 shutdown_connections 2023-09-30T22:22:03.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.154+0000 7f949a239700 1 --2- 172.21.15.40:0/2112651030 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9494097220 0x7f9494132660 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:03.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.154+0000 7f949a239700 1 --2- 172.21.15.40:0/2112651030 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94940657e0 0x7f9494096620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:03.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.154+0000 7f949a239700 1 -- 172.21.15.40:0/2112651030 >> 172.21.15.40:0/2112651030 conn(0x7f949409de50 msgr2=0x7f949409e260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:03.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.154+0000 7f949a239700 1 -- 172.21.15.40:0/2112651030 shutdown_connections 2023-09-30T22:22:03.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.154+0000 7f949a239700 1 -- 172.21.15.40:0/2112651030 wait complete. 2023-09-30T22:22:03.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.155+0000 7f949a239700 1 Processor -- start 2023-09-30T22:22:03.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.155+0000 7f949a239700 1 -- start start 2023-09-30T22:22:03.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.155+0000 7f949a239700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f94940657e0 0x7f94941323b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:03.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.155+0000 7f949a239700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9494097220 0x7f949411a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:03.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.155+0000 7f949a239700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f949411a760 0x7f949411abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:03.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.155+0000 7f949a239700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949411c8d0 con 0x7f9494097220 2023-09-30T22:22:03.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.155+0000 7f949a239700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9494099da0 con 0x7f949411a760 2023-09-30T22:22:03.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.155+0000 7f949a239700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f949411dd10 con 0x7f94940657e0 2023-09-30T22:22:03.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.155+0000 7f94937fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f94940657e0 0x7f94941323b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:03.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.155+0000 7f9492ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9494097220 0x7f949411a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:03.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.155+0000 7f94937fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f94940657e0 0x7f94941323b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58856/0 (socket says 172.21.15.40:58856) 2023-09-30T22:22:03.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.155+0000 7f94937fe700 1 -- 172.21.15.40:0/4074120646 learned_addr learned my addr 172.21.15.40:0/4074120646 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:03.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.155+0000 7f9493fff700 1 --2- 172.21.15.40:0/4074120646 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f949411a760 0x7f949411abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:03.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.156+0000 7f94937fe700 1 -- 172.21.15.40:0/4074120646 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f949411a760 msgr2=0x7f949411abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:03.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.156+0000 7f94937fe700 1 --2- 172.21.15.40:0/4074120646 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f949411a760 0x7f949411abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:03.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.156+0000 7f94937fe700 1 -- 172.21.15.40:0/4074120646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9494097220 msgr2=0x7f949411a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:03.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.156+0000 7f94937fe700 1 --2- 172.21.15.40:0/4074120646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9494097220 0x7f949411a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:03.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.156+0000 7f94937fe700 1 -- 172.21.15.40:0/4074120646 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947c0092a0 con 0x7f94940657e0 2023-09-30T22:22:03.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.156+0000 7f9492ffd700 1 --2- 172.21.15.40:0/4074120646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9494097220 0x7f949411a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:03.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.156+0000 7f94937fe700 1 --2- 172.21.15.40:0/4074120646 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f94940657e0 0x7f94941323b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f947c00ea20 tx=0x7f947c009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:03.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.156+0000 7f948b7fe700 1 -- 172.21.15.40:0/4074120646 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c00ee60 con 0x7f94940657e0 2023-09-30T22:22:03.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.156+0000 7f948b7fe700 1 -- 172.21.15.40:0/4074120646 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947c00c850 con 0x7f94940657e0 2023-09-30T22:22:03.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.156+0000 7f948b7fe700 1 -- 172.21.15.40:0/4074120646 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c00cbd0 con 0x7f94940657e0 2023-09-30T22:22:03.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.156+0000 7f949a239700 1 -- 172.21.15.40:0/4074120646 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f948c009a20 con 0x7f94940657e0 2023-09-30T22:22:03.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.156+0000 7f949a239700 1 -- 172.21.15.40:0/4074120646 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f949411b0b0 con 0x7f94940657e0 2023-09-30T22:22:03.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.156+0000 7f948b7fe700 1 -- 172.21.15.40:0/4074120646 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f947c01b400 con 0x7f94940657e0 2023-09-30T22:22:03.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.157+0000 7f948b7fe700 1 -- 172.21.15.40:0/4074120646 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f947c03b4c0 con 0x7f94940657e0 2023-09-30T22:22:03.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.157+0000 7f949a239700 1 -- 172.21.15.40:0/4074120646 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f949405a260 con 0x7f94940657e0 2023-09-30T22:22:03.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.161+0000 7f948b7fe700 1 -- 172.21.15.40:0/4074120646 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f947c019900 con 0x7f94940657e0 2023-09-30T22:22:03.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:03.374+0000 7f949a239700 1 -- 172.21.15.40:0/4074120646 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9494099a50 con 0x7f94940657e0 2023-09-30T22:22:04.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.357+0000 7f948b7fe700 1 -- 172.21.15.40:0/4074120646 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f947c019310 con 0x7f94940657e0 2023-09-30T22:22:04.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.359+0000 7f949a239700 1 -- 172.21.15.40:0/4074120646 >> v1:172.21.15.40:6816/118905 conn(0x7f947402bb60 legacy=0x7f947402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:04.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.359+0000 7f949a239700 1 -- 172.21.15.40:0/4074120646 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f94940657e0 msgr2=0x7f94941323b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:04.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.359+0000 7f949a239700 1 --2- 172.21.15.40:0/4074120646 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f94940657e0 0x7f94941323b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f947c00ea20 tx=0x7f947c009060).stop 2023-09-30T22:22:04.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.359+0000 7f949a239700 1 -- 172.21.15.40:0/4074120646 shutdown_connections 2023-09-30T22:22:04.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.359+0000 7f949a239700 1 --2- 172.21.15.40:0/4074120646 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f94940657e0 0x7f94941323b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:04.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.359+0000 7f949a239700 1 --2- 172.21.15.40:0/4074120646 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f949411a760 0x7f949411abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:04.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.359+0000 7f949a239700 1 --2- 172.21.15.40:0/4074120646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9494097220 0x7f949411a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:04.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.359+0000 7f949a239700 1 -- 172.21.15.40:0/4074120646 >> 172.21.15.40:0/4074120646 conn(0x7f949409de50 msgr2=0x7f9494098810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:04.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.360+0000 7f949a239700 1 -- 172.21.15.40:0/4074120646 shutdown_connections 2023-09-30T22:22:04.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.360+0000 7f949a239700 1 -- 172.21.15.40:0/4074120646 wait complete. 2023-09-30T22:22:04.375 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-09-30T22:22:04.375 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-30T22:22:04.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.504+0000 7fa20a14d700 1 Processor -- start 2023-09-30T22:22:04.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.504+0000 7fa20a14d700 1 -- start start 2023-09-30T22:22:04.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.504+0000 7fa20a14d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa2040967b0 0x7fa204128110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:04.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.504+0000 7fa20a14d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa20412fee0 0x7fa2041322d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:04.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.504+0000 7fa20a14d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa204091a00 con 0x7fa20405e090 2023-09-30T22:22:04.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.504+0000 7fa20a14d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa20405e470 con 0x7fa20412fee0 2023-09-30T22:22:04.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.504+0000 7fa20a14d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa204092c30 con 0x7fa2040967b0 2023-09-30T22:22:04.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.504+0000 7fa202ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa2040967b0 0x7fa204128110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:04.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.504+0000 7fa203fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa20412fee0 0x7fa2041322d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:04.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.504+0000 7fa203fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa20412fee0 0x7fa2041322d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46402/0 (socket says 172.21.15.40:46402) 2023-09-30T22:22:04.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.504+0000 7fa202ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa2040967b0 0x7fa204128110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:46580/0 (socket says 172.21.15.40:46580) 2023-09-30T22:22:04.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.504+0000 7fa2037fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa20405e090 0x7fa204127a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49374/0 (socket says 172.21.15.40:49374) 2023-09-30T22:22:04.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.504+0000 7fa203fff700 1 -- 172.21.15.40:0/3753006428 learned_addr learned my addr 172.21.15.40:0/3753006428 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:04.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.504+0000 7fa203fff700 1 -- 172.21.15.40:0/3753006428 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa2040967b0 msgr2=0x7fa204128110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:04.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.504+0000 7fa203fff700 1 --2- 172.21.15.40:0/3753006428 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa2040967b0 0x7fa204128110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:04.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.504+0000 7fa203fff700 1 -- 172.21.15.40:0/3753006428 >> v1:172.21.15.40:6789/0 conn(0x7fa20405e090 legacy=0x7fa204127a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:04.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.504+0000 7fa203fff700 1 -- 172.21.15.40:0/3753006428 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa204096bd0 con 0x7fa20412fee0 2023-09-30T22:22:04.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.504+0000 7fa202ffd700 1 --2- 172.21.15.40:0/3753006428 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa2040967b0 0x7fa204128110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:04.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.504+0000 7fa2027fc700 1 -- 172.21.15.40:0/3753006428 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4193872848 0 0) 0x7fa204091a00 con 0x7fa20405e090 2023-09-30T22:22:04.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.504+0000 7fa203fff700 1 --2- 172.21.15.40:0/3753006428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa20412fee0 0x7fa2041322d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fa1fc009f20 tx=0x7fa1fc009840).ready entity=mon.0 client_cookie=b2b8f1b0cd2634ae server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:04.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.504+0000 7fa2027fc700 1 -- 172.21.15.40:0/3753006428 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc00e070 con 0x7fa20412fee0 2023-09-30T22:22:04.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.504+0000 7fa2027fc700 1 -- 172.21.15.40:0/3753006428 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1fc00b9d0 con 0x7fa20412fee0 2023-09-30T22:22:04.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.504+0000 7fa2027fc700 1 -- 172.21.15.40:0/3753006428 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc00bd50 con 0x7fa20412fee0 2023-09-30T22:22:04.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.505+0000 7fa20a14d700 1 -- 172.21.15.40:0/3753006428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa20412fee0 msgr2=0x7fa2041322d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:04.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.505+0000 7fa20a14d700 1 --2- 172.21.15.40:0/3753006428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa20412fee0 0x7fa2041322d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fa1fc009f20 tx=0x7fa1fc009840).stop 2023-09-30T22:22:04.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.505+0000 7fa20a14d700 1 -- 172.21.15.40:0/3753006428 shutdown_connections 2023-09-30T22:22:04.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.505+0000 7fa20a14d700 1 --2- 172.21.15.40:0/3753006428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa20412fee0 0x7fa2041322d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:04.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.505+0000 7fa20a14d700 1 --2- 172.21.15.40:0/3753006428 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa2040967b0 0x7fa204128110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:04.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.505+0000 7fa20a14d700 1 -- 172.21.15.40:0/3753006428 >> 172.21.15.40:0/3753006428 conn(0x7fa20409ab40 msgr2=0x7fa20409af50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:04.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.505+0000 7fa20a14d700 1 -- 172.21.15.40:0/3753006428 shutdown_connections 2023-09-30T22:22:04.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.505+0000 7fa20a14d700 1 -- 172.21.15.40:0/3753006428 wait complete. 2023-09-30T22:22:04.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.506+0000 7fa20a14d700 1 Processor -- start 2023-09-30T22:22:04.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.506+0000 7fa20a14d700 1 -- start start 2023-09-30T22:22:04.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.506+0000 7fa20a14d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa20405e090 0x7fa20412bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:04.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.506+0000 7fa20a14d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa2040967b0 0x7fa20412c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:04.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.506+0000 7fa20a14d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa20412fee0 0x7fa20412c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:04.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.506+0000 7fa20a14d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20412f600 con 0x7fa20405e090 2023-09-30T22:22:04.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.506+0000 7fa20a14d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2041322e0 con 0x7fa20412fee0 2023-09-30T22:22:04.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.506+0000 7fa20a14d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa204096e50 con 0x7fa2040967b0 2023-09-30T22:22:04.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.506+0000 7fa202ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa2040967b0 0x7fa20412c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:04.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.506+0000 7fa2037fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa20405e090 0x7fa20412bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:04.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.506+0000 7fa203fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa20412fee0 0x7fa20412c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:04.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.506+0000 7fa202ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa2040967b0 0x7fa20412c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:59918/0 (socket says 172.21.15.40:59918) 2023-09-30T22:22:04.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.506+0000 7fa202ffd700 1 -- 172.21.15.40:0/395412295 learned_addr learned my addr 172.21.15.40:0/395412295 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:04.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.507+0000 7fa203fff700 1 -- 172.21.15.40:0/395412295 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa2040967b0 msgr2=0x7fa20412c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:04.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.507+0000 7fa203fff700 1 --2- 172.21.15.40:0/395412295 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa2040967b0 0x7fa20412c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:04.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.507+0000 7fa203fff700 1 -- 172.21.15.40:0/395412295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa20405e090 msgr2=0x7fa20412bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:04.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.507+0000 7fa203fff700 1 --2- 172.21.15.40:0/395412295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa20405e090 0x7fa20412bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:04.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.507+0000 7fa203fff700 1 -- 172.21.15.40:0/395412295 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f80092a0 con 0x7fa20412fee0 2023-09-30T22:22:04.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.507+0000 7fa2037fe700 1 --2- 172.21.15.40:0/395412295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa20405e090 0x7fa20412bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:04.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.507+0000 7fa203fff700 1 --2- 172.21.15.40:0/395412295 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa20412fee0 0x7fa20412c690 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fa1fc009f20 tx=0x7fa1fc009840).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:04.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.507+0000 7fa1eb7fe700 1 -- 172.21.15.40:0/395412295 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc013ea0 con 0x7fa20412fee0 2023-09-30T22:22:04.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.507+0000 7fa1eb7fe700 1 -- 172.21.15.40:0/395412295 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1fc0092e0 con 0x7fa20412fee0 2023-09-30T22:22:04.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.507+0000 7fa1eb7fe700 1 -- 172.21.15.40:0/395412295 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc01f6d0 con 0x7fa20412fee0 2023-09-30T22:22:04.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.507+0000 7fa20a14d700 1 -- 172.21.15.40:0/395412295 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1fc009ae0 con 0x7fa20412fee0 2023-09-30T22:22:04.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.507+0000 7fa20a14d700 1 -- 172.21.15.40:0/395412295 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2041111a0 con 0x7fa20412fee0 2023-09-30T22:22:04.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.508+0000 7fa1eb7fe700 1 -- 172.21.15.40:0/395412295 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fa1fc003040 con 0x7fa20412fee0 2023-09-30T22:22:04.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.508+0000 7fa1eb7fe700 1 -- 172.21.15.40:0/395412295 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fa1fc03c740 con 0x7fa20412fee0 2023-09-30T22:22:04.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.508+0000 7fa20a14d700 1 -- 172.21.15.40:0/395412295 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa20405a260 con 0x7fa20412fee0 2023-09-30T22:22:04.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.513+0000 7fa1eb7fe700 1 -- 172.21.15.40:0/395412295 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fa1fc024020 con 0x7fa20412fee0 2023-09-30T22:22:04.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:04.720+0000 7fa20a14d700 1 -- 172.21.15.40:0/395412295 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa2041275e0 con 0x7fa20412fee0 2023-09-30T22:22:05.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.359+0000 7fa1eb7fe700 1 -- 172.21.15.40:0/395412295 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa1fc011960 con 0x7fa20412fee0 2023-09-30T22:22:05.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.362+0000 7fa20a14d700 1 -- 172.21.15.40:0/395412295 >> v1:172.21.15.40:6816/118905 conn(0x7fa1f002bb60 legacy=0x7fa1f002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:05.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.362+0000 7fa20a14d700 1 -- 172.21.15.40:0/395412295 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa20412fee0 msgr2=0x7fa20412c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:05.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.362+0000 7fa20a14d700 1 --2- 172.21.15.40:0/395412295 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa20412fee0 0x7fa20412c690 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fa1fc009f20 tx=0x7fa1fc009840).stop 2023-09-30T22:22:05.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.362+0000 7fa20a14d700 1 -- 172.21.15.40:0/395412295 shutdown_connections 2023-09-30T22:22:05.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.362+0000 7fa20a14d700 1 --2- 172.21.15.40:0/395412295 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa20412fee0 0x7fa20412c690 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:05.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.362+0000 7fa20a14d700 1 --2- 172.21.15.40:0/395412295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa20405e090 0x7fa20412bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:05.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.362+0000 7fa20a14d700 1 --2- 172.21.15.40:0/395412295 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa2040967b0 0x7fa20412c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:05.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.362+0000 7fa20a14d700 1 -- 172.21.15.40:0/395412295 >> 172.21.15.40:0/395412295 conn(0x7fa20409ab40 msgr2=0x7fa204095490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:05.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.362+0000 7fa20a14d700 1 -- 172.21.15.40:0/395412295 shutdown_connections 2023-09-30T22:22:05.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.362+0000 7fa20a14d700 1 -- 172.21.15.40:0/395412295 wait complete. 2023-09-30T22:22:05.376 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-09-30T22:22:05.376 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:22:05.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.504+0000 7f48b3421700 1 Processor -- start 2023-09-30T22:22:05.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.504+0000 7f48b3421700 1 -- start start 2023-09-30T22:22:05.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.505+0000 7f48b3421700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48ac05e090 0x7f48ac1258f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:05.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.505+0000 7f48b3421700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f48ac1253f0 0x7f48ac125de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:05.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.505+0000 7f48b3421700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f48ac093c10 0x7f48ac094090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:05.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.505+0000 7f48b3421700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48ac05e470 con 0x7f48ac1253f0 2023-09-30T22:22:05.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.505+0000 7f48b3421700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac05e870 con 0x7f48ac05e090 2023-09-30T22:22:05.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.505+0000 7f48b3421700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac096380 con 0x7f48ac093c10 2023-09-30T22:22:05.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.505+0000 7f48b09bc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f48ac1253f0 0x7f48ac125de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:05.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.505+0000 7f48b11bd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48ac05e090 0x7f48ac1258f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:05.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.505+0000 7f48b19be700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f48ac093c10 0x7f48ac094090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:05.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.505+0000 7f48b09bc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f48ac1253f0 0x7f48ac125de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46420/0 (socket says 172.21.15.40:46420) 2023-09-30T22:22:05.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.505+0000 7f48b09bc700 1 -- 172.21.15.40:0/498974570 learned_addr learned my addr 172.21.15.40:0/498974570 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:05.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.505+0000 7f48b19be700 1 -- 172.21.15.40:0/498974570 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48ac05e090 msgr2=0x7f48ac1258f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:05.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.505+0000 7f48b19be700 1 --2- 172.21.15.40:0/498974570 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48ac05e090 0x7f48ac1258f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:05.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.505+0000 7f48b19be700 1 -- 172.21.15.40:0/498974570 >> v2:172.21.15.40:3300/0 conn(0x7f48ac1253f0 msgr2=0x7f48ac125de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:05.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.505+0000 7f48b19be700 1 --2- 172.21.15.40:0/498974570 >> v2:172.21.15.40:3300/0 conn(0x7f48ac1253f0 0x7f48ac125de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:05.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.505+0000 7f48b19be700 1 -- 172.21.15.40:0/498974570 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ac1262d0 con 0x7f48ac093c10 2023-09-30T22:22:05.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.506+0000 7f48b09bc700 1 --2- 172.21.15.40:0/498974570 >> v2:172.21.15.40:3300/0 conn(0x7f48ac1253f0 0x7f48ac125de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:05.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.506+0000 7f48b11bd700 1 --2- 172.21.15.40:0/498974570 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48ac05e090 0x7f48ac1258f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:05.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.506+0000 7f48b19be700 1 --2- 172.21.15.40:0/498974570 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f48ac093c10 0x7f48ac094090 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f48a4009e60 tx=0x7f48a4009780).ready entity=mon.2 client_cookie=a404ba4154afcf38 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:05.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.506+0000 7f48a3fff700 1 -- 172.21.15.40:0/498974570 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a400e070 con 0x7f48ac093c10 2023-09-30T22:22:05.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.506+0000 7f48a3fff700 1 -- 172.21.15.40:0/498974570 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a400bab0 con 0x7f48ac093c10 2023-09-30T22:22:05.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.506+0000 7f48a3fff700 1 -- 172.21.15.40:0/498974570 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a400be30 con 0x7f48ac093c10 2023-09-30T22:22:05.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.506+0000 7f48b3421700 1 -- 172.21.15.40:0/498974570 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f48ac093c10 msgr2=0x7f48ac094090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:05.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.506+0000 7f48b3421700 1 --2- 172.21.15.40:0/498974570 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f48ac093c10 0x7f48ac094090 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f48a4009e60 tx=0x7f48a4009780).stop 2023-09-30T22:22:05.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.506+0000 7f48b3421700 1 -- 172.21.15.40:0/498974570 shutdown_connections 2023-09-30T22:22:05.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.506+0000 7f48b3421700 1 --2- 172.21.15.40:0/498974570 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f48ac093c10 0x7f48ac094090 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:05.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.506+0000 7f48b3421700 1 --2- 172.21.15.40:0/498974570 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48ac05e090 0x7f48ac1258f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:05.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.506+0000 7f48b3421700 1 --2- 172.21.15.40:0/498974570 >> v2:172.21.15.40:3300/0 conn(0x7f48ac1253f0 0x7f48ac125de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:05.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.506+0000 7f48b3421700 1 -- 172.21.15.40:0/498974570 >> 172.21.15.40:0/498974570 conn(0x7f48ac0975f0 msgr2=0x7f48ac097a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:05.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.506+0000 7f48b3421700 1 -- 172.21.15.40:0/498974570 shutdown_connections 2023-09-30T22:22:05.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.506+0000 7f48b3421700 1 -- 172.21.15.40:0/498974570 wait complete. 2023-09-30T22:22:05.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.508+0000 7f48b3421700 1 Processor -- start 2023-09-30T22:22:05.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.508+0000 7f48b3421700 1 -- start start 2023-09-30T22:22:05.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.508+0000 7f48b3421700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48ac05e090 0x7f48ac1380a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:05.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.508+0000 7f48b3421700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f48ac093c10 0x7f48ac138590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:05.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.508+0000 7f48b3421700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48ac1253f0 0x7f48ac138a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:05.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.509+0000 7f48b3421700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac069480 con 0x7f48ac1253f0 2023-09-30T22:22:05.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.509+0000 7f48b3421700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac127f30 con 0x7f48ac05e090 2023-09-30T22:22:05.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.509+0000 7f48b3421700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac095ac0 con 0x7f48ac093c10 2023-09-30T22:22:05.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.509+0000 7f48b09bc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f48ac093c10 0x7f48ac138590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:05.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.509+0000 7f48b11bd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48ac05e090 0x7f48ac1380a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:05.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.509+0000 7f48b19be700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48ac1253f0 0x7f48ac138a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:05.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.509+0000 7f48b09bc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f48ac093c10 0x7f48ac138590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:59944/0 (socket says 172.21.15.40:59944) 2023-09-30T22:22:05.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.509+0000 7f48b19be700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48ac1253f0 0x7f48ac138a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46432/0 (socket says 172.21.15.40:46432) 2023-09-30T22:22:05.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.509+0000 7f48b11bd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48ac05e090 0x7f48ac1380a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:46608/0 (socket says 172.21.15.40:46608) 2023-09-30T22:22:05.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.509+0000 7f48b09bc700 1 -- 172.21.15.40:0/4147929665 learned_addr learned my addr 172.21.15.40:0/4147929665 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:05.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.509+0000 7f48b09bc700 1 -- 172.21.15.40:0/4147929665 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48ac05e090 msgr2=0x7f48ac1380a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:05.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.509+0000 7f48b09bc700 1 --2- 172.21.15.40:0/4147929665 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48ac05e090 0x7f48ac1380a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:05.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.509+0000 7f48b09bc700 1 -- 172.21.15.40:0/4147929665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48ac1253f0 msgr2=0x7f48ac138a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:05.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.509+0000 7f48b09bc700 1 --2- 172.21.15.40:0/4147929665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48ac1253f0 0x7f48ac138a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:05.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.509+0000 7f48b09bc700 1 -- 172.21.15.40:0/4147929665 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a80092a0 con 0x7f48ac093c10 2023-09-30T22:22:05.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.509+0000 7f48b19be700 1 --2- 172.21.15.40:0/4147929665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48ac1253f0 0x7f48ac138a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:05.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.509+0000 7f48b09bc700 1 --2- 172.21.15.40:0/4147929665 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f48ac093c10 0x7f48ac138590 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f489c00ea20 tx=0x7f489c0090f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:05.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.509+0000 7f48a17fa700 1 -- 172.21.15.40:0/4147929665 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c009650 con 0x7f48ac093c10 2023-09-30T22:22:05.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.509+0000 7f48a17fa700 1 -- 172.21.15.40:0/4147929665 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489c00c850 con 0x7f48ac093c10 2023-09-30T22:22:05.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.509+0000 7f48b3421700 1 -- 172.21.15.40:0/4147929665 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f489c009370 con 0x7f48ac093c10 2023-09-30T22:22:05.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.509+0000 7f48a17fa700 1 -- 172.21.15.40:0/4147929665 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c00cbd0 con 0x7f48ac093c10 2023-09-30T22:22:05.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.509+0000 7f48b3421700 1 -- 172.21.15.40:0/4147929665 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a4009a20 con 0x7f48ac093c10 2023-09-30T22:22:05.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.510+0000 7f48a17fa700 1 -- 172.21.15.40:0/4147929665 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f489c01b400 con 0x7f48ac093c10 2023-09-30T22:22:05.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.510+0000 7f48a17fa700 1 -- 172.21.15.40:0/4147929665 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f489c03b520 con 0x7f48ac093c10 2023-09-30T22:22:05.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.510+0000 7f48b3421700 1 -- 172.21.15.40:0/4147929665 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48ac05a260 con 0x7f48ac093c10 2023-09-30T22:22:05.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.515+0000 7f48a17fa700 1 -- 172.21.15.40:0/4147929665 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f489c016070 con 0x7f48ac093c10 2023-09-30T22:22:05.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.723+0000 7f48b3421700 1 -- 172.21.15.40:0/4147929665 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48ac046c20 con 0x7f48ac093c10 2023-09-30T22:22:05.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.723+0000 7f48a17fa700 1 -- 172.21.15.40:0/4147929665 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2156 (secure 0 0 0) 0x7f489c016020 con 0x7f48ac093c10 2023-09-30T22:22:05.723 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:22:05.723 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:22:02.347538+0000","modified":"2023-09-30T22:22:05.356644+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4194},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4194":{"gid":4194,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6817/2392027806","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6817","nonce":2392027806}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-30T22:22:05.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.725+0000 7f48b3421700 1 -- 172.21.15.40:0/4147929665 >> v1:172.21.15.40:6816/118905 conn(0x7f489002bb60 legacy=0x7f489002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:05.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.725+0000 7f48b3421700 1 -- 172.21.15.40:0/4147929665 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f48ac093c10 msgr2=0x7f48ac138590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:05.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.725+0000 7f48b3421700 1 --2- 172.21.15.40:0/4147929665 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f48ac093c10 0x7f48ac138590 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f489c00ea20 tx=0x7f489c0090f0).stop 2023-09-30T22:22:05.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.725+0000 7f48b3421700 1 -- 172.21.15.40:0/4147929665 shutdown_connections 2023-09-30T22:22:05.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.725+0000 7f48b3421700 1 --2- 172.21.15.40:0/4147929665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48ac1253f0 0x7f48ac138a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:05.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.725+0000 7f48b3421700 1 --2- 172.21.15.40:0/4147929665 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48ac05e090 0x7f48ac1380a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:05.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.725+0000 7f48b3421700 1 --2- 172.21.15.40:0/4147929665 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f48ac093c10 0x7f48ac138590 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:05.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.725+0000 7f48b3421700 1 -- 172.21.15.40:0/4147929665 >> 172.21.15.40:0/4147929665 conn(0x7f48ac0975f0 msgr2=0x7f48ac126790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:05.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.725+0000 7f48b3421700 1 -- 172.21.15.40:0/4147929665 shutdown_connections 2023-09-30T22:22:05.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.725+0000 7f48b3421700 1 -- 172.21.15.40:0/4147929665 wait complete. 2023-09-30T22:22:05.726 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 6 2023-09-30T22:22:05.736 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:22:05.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.858+0000 7f0579f64700 1 Processor -- start 2023-09-30T22:22:05.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.858+0000 7f0579f64700 1 -- start start 2023-09-30T22:22:05.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.859+0000 7f0579f64700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0574096160 0x7f0574099600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:05.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.859+0000 7f0579f64700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0574130650 0x7f0574132a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:05.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.859+0000 7f0579f64700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0574098910 con 0x7f0574098b10 2023-09-30T22:22:05.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.859+0000 7f0579f64700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0574096560 con 0x7f0574130650 2023-09-30T22:22:05.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.859+0000 7f0579f64700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0574065e40 con 0x7f0574096160 2023-09-30T22:22:05.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.859+0000 7f05737fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f0574098b10 0x7f0574098ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49380/0 (socket says 172.21.15.40:49380) 2023-09-30T22:22:05.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.859+0000 7f05737fe700 1 -- 172.21.15.40:0/2478969778 learned_addr learned my addr 172.21.15.40:0/2478969778 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:22:05.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.859+0000 7f0572ffd700 1 --2- 172.21.15.40:0/2478969778 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0574096160 0x7f0574099600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:05.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.859+0000 7f0573fff700 1 --2- 172.21.15.40:0/2478969778 >> v2:172.21.15.40:3300/0 conn(0x7f0574130650 0x7f0574132a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:05.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.859+0000 7f05727fc700 1 -- 172.21.15.40:0/2478969778 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4151837013 0 0) 0x7f0574098910 con 0x7f0574098b10 2023-09-30T22:22:05.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.859+0000 7f05727fc700 1 -- 172.21.15.40:0/2478969778 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05600033f0 con 0x7f0574098b10 2023-09-30T22:22:05.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.859+0000 7f0572ffd700 1 -- 172.21.15.40:0/2478969778 >> v2:172.21.15.40:3300/0 conn(0x7f0574130650 msgr2=0x7f0574132a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:05.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.859+0000 7f0572ffd700 1 --2- 172.21.15.40:0/2478969778 >> v2:172.21.15.40:3300/0 conn(0x7f0574130650 0x7f0574132a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:05.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.859+0000 7f0572ffd700 1 -- 172.21.15.40:0/2478969778 >> v1:172.21.15.40:6789/0 conn(0x7f0574098b10 legacy=0x7f0574098ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:05.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.859+0000 7f0572ffd700 1 -- 172.21.15.40:0/2478969778 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05740955c0 con 0x7f0574096160 2023-09-30T22:22:05.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.859+0000 7f0573fff700 1 --2- 172.21.15.40:0/2478969778 >> v2:172.21.15.40:3300/0 conn(0x7f0574130650 0x7f0574132a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:05.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.859+0000 7f0572ffd700 1 --2- 172.21.15.40:0/2478969778 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0574096160 0x7f0574099600 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f055c009760 tx=0x7f055c009060).ready entity=mon.2 client_cookie=9403d168bd45a6b9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:05.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.860+0000 7f05727fc700 1 -- 172.21.15.40:0/2478969778 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c0090d0 con 0x7f0574096160 2023-09-30T22:22:05.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.860+0000 7f05727fc700 1 -- 172.21.15.40:0/2478969778 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055c00d4a0 con 0x7f0574096160 2023-09-30T22:22:05.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.860+0000 7f05727fc700 1 -- 172.21.15.40:0/2478969778 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c00d820 con 0x7f0574096160 2023-09-30T22:22:05.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.860+0000 7f0579f64700 1 -- 172.21.15.40:0/2478969778 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0574096160 msgr2=0x7f0574099600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:05.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.860+0000 7f0579f64700 1 --2- 172.21.15.40:0/2478969778 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0574096160 0x7f0574099600 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f055c009760 tx=0x7f055c009060).stop 2023-09-30T22:22:05.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.860+0000 7f0579f64700 1 -- 172.21.15.40:0/2478969778 shutdown_connections 2023-09-30T22:22:05.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.860+0000 7f0579f64700 1 --2- 172.21.15.40:0/2478969778 >> v2:172.21.15.40:3300/0 conn(0x7f0574130650 0x7f0574132a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:05.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.860+0000 7f0579f64700 1 --2- 172.21.15.40:0/2478969778 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0574096160 0x7f0574099600 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:05.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.860+0000 7f0579f64700 1 -- 172.21.15.40:0/2478969778 >> 172.21.15.40:0/2478969778 conn(0x7f057409ab30 msgr2=0x7f057409af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:05.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.860+0000 7f0579f64700 1 -- 172.21.15.40:0/2478969778 shutdown_connections 2023-09-30T22:22:05.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.860+0000 7f0579f64700 1 -- 172.21.15.40:0/2478969778 wait complete. 2023-09-30T22:22:05.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.861+0000 7f0579f64700 1 Processor -- start 2023-09-30T22:22:05.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.861+0000 7f0579f64700 1 -- start start 2023-09-30T22:22:05.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.862+0000 7f0579f64700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0574096160 0x7f057411a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:05.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.862+0000 7f0579f64700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0574098b10 0x7f057411a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:05.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.862+0000 7f0579f64700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0574130650 0x7f057411aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:05.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.862+0000 7f0579f64700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057411b190 con 0x7f0574130650 2023-09-30T22:22:05.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.862+0000 7f0579f64700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057411c060 con 0x7f0574098b10 2023-09-30T22:22:05.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.862+0000 7f0579f64700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f057411d850 con 0x7f0574096160 2023-09-30T22:22:05.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.862+0000 7f0573fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0574130650 0x7f057411aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:05.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.862+0000 7f0573fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0574130650 0x7f057411aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46448/0 (socket says 172.21.15.40:46448) 2023-09-30T22:22:05.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.862+0000 7f0572ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0574098b10 0x7f057411a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:05.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.862+0000 7f0573fff700 1 -- 172.21.15.40:0/2756956823 learned_addr learned my addr 172.21.15.40:0/2756956823 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:05.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.862+0000 7f05737fe700 1 --2- 172.21.15.40:0/2756956823 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0574096160 0x7f057411a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:05.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.862+0000 7f0573fff700 1 -- 172.21.15.40:0/2756956823 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0574096160 msgr2=0x7f057411a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:05.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.862+0000 7f0573fff700 1 --2- 172.21.15.40:0/2756956823 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0574096160 0x7f057411a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:05.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.862+0000 7f0573fff700 1 -- 172.21.15.40:0/2756956823 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0574098b10 msgr2=0x7f057411a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:05.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.862+0000 7f0573fff700 1 --2- 172.21.15.40:0/2756956823 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0574098b10 0x7f057411a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:05.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.862+0000 7f0573fff700 1 -- 172.21.15.40:0/2756956823 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056c009a20 con 0x7f0574130650 2023-09-30T22:22:05.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.862+0000 7f0573fff700 1 --2- 172.21.15.40:0/2756956823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0574130650 0x7f057411aca0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f056c009f60 tx=0x7f056c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:05.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.862+0000 7f056b7fe700 1 -- 172.21.15.40:0/2756956823 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c00cb70 con 0x7f0574130650 2023-09-30T22:22:05.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.862+0000 7f056b7fe700 1 -- 172.21.15.40:0/2756956823 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056c00f040 con 0x7f0574130650 2023-09-30T22:22:05.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.862+0000 7f0579f64700 1 -- 172.21.15.40:0/2756956823 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055c0092a0 con 0x7f0574130650 2023-09-30T22:22:05.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.862+0000 7f056b7fe700 1 -- 172.21.15.40:0/2756956823 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c013400 con 0x7f0574130650 2023-09-30T22:22:05.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.862+0000 7f0579f64700 1 -- 172.21.15.40:0/2756956823 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0574099de0 con 0x7f0574130650 2023-09-30T22:22:05.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.863+0000 7f056b7fe700 1 -- 172.21.15.40:0/2756956823 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f056c0137b0 con 0x7f0574130650 2023-09-30T22:22:05.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.863+0000 7f056b7fe700 1 -- 172.21.15.40:0/2756956823 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f056c03b850 con 0x7f0574130650 2023-09-30T22:22:05.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.863+0000 7f0579f64700 1 -- 172.21.15.40:0/2756956823 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f057405a260 con 0x7f0574130650 2023-09-30T22:22:05.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:05.868+0000 7f056b7fe700 1 -- 172.21.15.40:0/2756956823 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f056c013a60 con 0x7f0574130650 2023-09-30T22:22:06.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.039+0000 7f0579f64700 1 -- 172.21.15.40:0/2756956823 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0574099af0 con 0x7f0574130650 2023-09-30T22:22:06.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.040+0000 7f056b7fe700 1 -- 172.21.15.40:0/2756956823 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11341 (secure 0 0 0) 0x7f056c012e40 con 0x7f0574130650 2023-09-30T22:22:06.039 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:22:06.040 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":17,"fsid":"79dd4d8e-f295-4d9c-bd93-9850863800e3","created":"2023-09-30T22:21:46.980357+0000","modified":"2023-09-30T22:22:03.348895+0000","last_up_change":"2023-09-30T22:21:54.822866+0000","last_in_change":"2023-09-30T22:21:48.205613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:21:54.875024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:21:56.197012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:22:00.759069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:22:01.327265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"771f785c-f464-4b17-936c-cbf31b1153e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6812","nonce":119451}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6813","nonce":119451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6815","nonce":119451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6814","nonce":119451}]},"public_addr":"172.21.15.40:6812/119451","cluster_addr":"172.21.15.40:6813/119451","heartbeat_back_addr":"172.21.15.40:6815/119451","heartbeat_front_addr":"172.21.15.40:6814/119451","state":["exists","up"]},{"osd":1,"uuid":"45f1e2e8-5310-4219-ab54-424e7440fcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6808","nonce":119436}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6809","nonce":119436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6811","nonce":119436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6810","nonce":119436}]},"public_addr":"172.21.15.40:6808/119436","cluster_addr":"172.21.15.40:6809/119436","heartbeat_back_addr":"172.21.15.40:6811/119436","heartbeat_front_addr":"172.21.15.40:6810/119436","state":["exists","up"]},{"osd":2,"uuid":"7ba62ae5-d21e-4d56-b46c-ba7b718ede25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6800","nonce":119433}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6801","nonce":119433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6803","nonce":119433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6802","nonce":119433}]},"public_addr":"172.21.15.40:6800/119433","cluster_addr":"172.21.15.40:6801/119433","heartbeat_back_addr":"172.21.15.40:6803/119433","heartbeat_front_addr":"172.21.15.40:6802/119433","state":["exists","up"]},{"osd":3,"uuid":"c9c55985-8a90-4927-a8fa-6a1fcec1cd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6804","nonce":119432}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6805","nonce":119432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6807","nonce":119432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6806","nonce":119432}]},"public_addr":"172.21.15.40:6804/119432","cluster_addr":"172.21.15.40:6805/119432","heartbeat_back_addr":"172.21.15.40:6807/119432","heartbeat_front_addr":"172.21.15.40:6806/119432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.339829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.554690+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.641664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.320635+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:22:06.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.042+0000 7f0579f64700 1 -- 172.21.15.40:0/2756956823 >> v1:172.21.15.40:6816/118905 conn(0x7f055402bb60 legacy=0x7f055402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:06.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.042+0000 7f0579f64700 1 -- 172.21.15.40:0/2756956823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0574130650 msgr2=0x7f057411aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:06.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.042+0000 7f0579f64700 1 --2- 172.21.15.40:0/2756956823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0574130650 0x7f057411aca0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f056c009f60 tx=0x7f056c00b040).stop 2023-09-30T22:22:06.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.042+0000 7f0579f64700 1 -- 172.21.15.40:0/2756956823 shutdown_connections 2023-09-30T22:22:06.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.042+0000 7f0579f64700 1 --2- 172.21.15.40:0/2756956823 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0574096160 0x7f057411a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:06.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.042+0000 7f0579f64700 1 --2- 172.21.15.40:0/2756956823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0574130650 0x7f057411aca0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:06.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.042+0000 7f0579f64700 1 --2- 172.21.15.40:0/2756956823 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0574098b10 0x7f057411a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:06.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.042+0000 7f0579f64700 1 -- 172.21.15.40:0/2756956823 >> 172.21.15.40:0/2756956823 conn(0x7f057409ab30 msgr2=0x7f057409bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:06.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.042+0000 7f0579f64700 1 -- 172.21.15.40:0/2756956823 shutdown_connections 2023-09-30T22:22:06.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.042+0000 7f0579f64700 1 -- 172.21.15.40:0/2756956823 wait complete. 2023-09-30T22:22:06.053 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-30T22:22:06.053 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:22:06.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.174+0000 7fe15c266700 1 Processor -- start 2023-09-30T22:22:06.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.175+0000 7fe15c266700 1 -- start start 2023-09-30T22:22:06.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.175+0000 7fe15c266700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe154098b10 0x7fe154096160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:06.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.175+0000 7fe15c266700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe154130650 0x7fe154132a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:06.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.175+0000 7fe15c266700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe154098910 con 0x7fe154098ef0 2023-09-30T22:22:06.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.175+0000 7fe15c266700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe154065e40 con 0x7fe154098b10 2023-09-30T22:22:06.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.175+0000 7fe15c266700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1540955c0 con 0x7fe154130650 2023-09-30T22:22:06.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.175+0000 7fe15a002700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe154098b10 0x7fe154096160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:06.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.175+0000 7fe15a002700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe154098b10 0x7fe154096160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46458/0 (socket says 172.21.15.40:46458) 2023-09-30T22:22:06.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.175+0000 7fe15a002700 1 -- 172.21.15.40:0/671463522 learned_addr learned my addr 172.21.15.40:0/671463522 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:06.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.176+0000 7fe15a803700 1 --2- 172.21.15.40:0/671463522 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe154130650 0x7fe154132a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:06.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.176+0000 7fe15a002700 1 -- 172.21.15.40:0/671463522 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe154130650 msgr2=0x7fe154132a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:06.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.176+0000 7fe15a002700 1 --2- 172.21.15.40:0/671463522 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe154130650 0x7fe154132a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:06.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.176+0000 7fe15a002700 1 -- 172.21.15.40:0/671463522 >> v1:172.21.15.40:6789/0 conn(0x7fe154098ef0 legacy=0x7fe1540992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:06.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.176+0000 7fe159000700 1 -- 172.21.15.40:0/671463522 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2752621368 0 0) 0x7fe154098910 con 0x7fe154098ef0 2023-09-30T22:22:06.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.176+0000 7fe15a002700 1 -- 172.21.15.40:0/671463522 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe154097750 con 0x7fe154098b10 2023-09-30T22:22:06.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.176+0000 7fe15a002700 1 --2- 172.21.15.40:0/671463522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe154098b10 0x7fe154096160 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fe144006fd0 tx=0x7fe1440090f0).ready entity=mon.0 client_cookie=3513d97880064013 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:06.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.176+0000 7fe159000700 1 -- 172.21.15.40:0/671463522 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14400b580 con 0x7fe154098b10 2023-09-30T22:22:06.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.176+0000 7fe159000700 1 -- 172.21.15.40:0/671463522 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14400b6e0 con 0x7fe154098b10 2023-09-30T22:22:06.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.176+0000 7fe159000700 1 -- 172.21.15.40:0/671463522 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14400ba80 con 0x7fe154098b10 2023-09-30T22:22:06.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.177+0000 7fe15c266700 1 -- 172.21.15.40:0/671463522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe154098b10 msgr2=0x7fe154096160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:06.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.177+0000 7fe15c266700 1 --2- 172.21.15.40:0/671463522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe154098b10 0x7fe154096160 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fe144006fd0 tx=0x7fe1440090f0).stop 2023-09-30T22:22:06.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.177+0000 7fe15c266700 1 -- 172.21.15.40:0/671463522 shutdown_connections 2023-09-30T22:22:06.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.177+0000 7fe15c266700 1 --2- 172.21.15.40:0/671463522 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe154130650 0x7fe154132a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:06.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.177+0000 7fe15c266700 1 --2- 172.21.15.40:0/671463522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe154098b10 0x7fe154096160 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:06.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.177+0000 7fe15c266700 1 -- 172.21.15.40:0/671463522 >> 172.21.15.40:0/671463522 conn(0x7fe15409ab30 msgr2=0x7fe15409af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:06.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.177+0000 7fe15c266700 1 -- 172.21.15.40:0/671463522 shutdown_connections 2023-09-30T22:22:06.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.177+0000 7fe15c266700 1 -- 172.21.15.40:0/671463522 wait complete. 2023-09-30T22:22:06.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.178+0000 7fe15c266700 1 Processor -- start 2023-09-30T22:22:06.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.178+0000 7fe15c266700 1 -- start start 2023-09-30T22:22:06.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.178+0000 7fe15c266700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe154098b10 0x7fe15411a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:06.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.178+0000 7fe15c266700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe154098ef0 0x7fe15411a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:06.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.178+0000 7fe15c266700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe154130650 0x7fe15411ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:06.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.178+0000 7fe15c266700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15411b280 con 0x7fe154130650 2023-09-30T22:22:06.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.178+0000 7fe15c266700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe15411bfc0 con 0x7fe154098b10 2023-09-30T22:22:06.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.178+0000 7fe15c266700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe154099de0 con 0x7fe154098ef0 2023-09-30T22:22:06.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.178+0000 7fe15a002700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe154098b10 0x7fe15411a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:06.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.178+0000 7fe15a002700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe154098b10 0x7fe15411a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:46644/0 (socket says 172.21.15.40:46644) 2023-09-30T22:22:06.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.178+0000 7fe15a002700 1 -- 172.21.15.40:0/2801493945 learned_addr learned my addr 172.21.15.40:0/2801493945 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:06.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.178+0000 7fe15a803700 1 --2- 172.21.15.40:0/2801493945 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe154130650 0x7fe15411ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:06.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.178+0000 7fe159801700 1 --2- 172.21.15.40:0/2801493945 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe154098ef0 0x7fe15411a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:06.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.179+0000 7fe15a002700 1 -- 172.21.15.40:0/2801493945 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe154098ef0 msgr2=0x7fe15411a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:06.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.179+0000 7fe15a002700 1 --2- 172.21.15.40:0/2801493945 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe154098ef0 0x7fe15411a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:06.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.179+0000 7fe15a002700 1 -- 172.21.15.40:0/2801493945 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe154130650 msgr2=0x7fe15411ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:06.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.179+0000 7fe15a002700 1 --2- 172.21.15.40:0/2801493945 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe154130650 0x7fe15411ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:06.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.179+0000 7fe15a002700 1 -- 172.21.15.40:0/2801493945 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe144009370 con 0x7fe154098b10 2023-09-30T22:22:06.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.179+0000 7fe15a002700 1 --2- 172.21.15.40:0/2801493945 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe154098b10 0x7fe15411a3b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fe15409bcf0 tx=0x7fe144017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:06.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.179+0000 7fe151ffb700 1 -- 172.21.15.40:0/2801493945 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14400b580 con 0x7fe154098b10 2023-09-30T22:22:06.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.179+0000 7fe151ffb700 1 -- 172.21.15.40:0/2801493945 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe144006950 con 0x7fe154098b10 2023-09-30T22:22:06.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.179+0000 7fe15c266700 1 -- 172.21.15.40:0/2801493945 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe15411de00 con 0x7fe154098b10 2023-09-30T22:22:06.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.179+0000 7fe151ffb700 1 -- 172.21.15.40:0/2801493945 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14400be40 con 0x7fe154098b10 2023-09-30T22:22:06.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.179+0000 7fe15c266700 1 -- 172.21.15.40:0/2801493945 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe15411e4e0 con 0x7fe154098b10 2023-09-30T22:22:06.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.180+0000 7fe151ffb700 1 -- 172.21.15.40:0/2801493945 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fe14401c630 con 0x7fe154098b10 2023-09-30T22:22:06.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.180+0000 7fe151ffb700 1 -- 172.21.15.40:0/2801493945 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fe14403cb60 con 0x7fe154098b10 2023-09-30T22:22:06.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.180+0000 7fe15c266700 1 -- 172.21.15.40:0/2801493945 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe15411dc20 con 0x7fe154098b10 2023-09-30T22:22:06.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.185+0000 7fe151ffb700 1 -- 172.21.15.40:0/2801493945 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fe14402a020 con 0x7fe154098b10 2023-09-30T22:22:06.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.346+0000 7fe15c266700 1 -- 172.21.15.40:0/2801493945 --> v1:172.21.15.40:6816/118905 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe15411da80 con 0x7fe14002bb90 2023-09-30T22:22:06.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.354+0000 7fe151ffb700 1 -- 172.21.15.40:0/2801493945 <== mgr.4101 v1:172.21.15.40:6816/118905 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246257 (unknown 2965378022 0 717089435) 0x7fe14800d150 con 0x7fe14002bb90 2023-09-30T22:22:06.356 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:22:06.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.356+0000 7fe15c266700 1 -- 172.21.15.40:0/2801493945 >> v1:172.21.15.40:6816/118905 conn(0x7fe14002bb90 legacy=0x7fe14002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:06.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.356+0000 7fe15c266700 1 -- 172.21.15.40:0/2801493945 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe154098b10 msgr2=0x7fe15411a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:06.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.356+0000 7fe15c266700 1 --2- 172.21.15.40:0/2801493945 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe154098b10 0x7fe15411a3b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fe15409bcf0 tx=0x7fe144017000).stop 2023-09-30T22:22:06.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.356+0000 7fe15c266700 1 -- 172.21.15.40:0/2801493945 shutdown_connections 2023-09-30T22:22:06.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.356+0000 7fe15c266700 1 --2- 172.21.15.40:0/2801493945 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe154130650 0x7fe15411ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:06.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.356+0000 7fe15c266700 1 --2- 172.21.15.40:0/2801493945 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe154098b10 0x7fe15411a3b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:06.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.356+0000 7fe15c266700 1 --2- 172.21.15.40:0/2801493945 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe154098ef0 0x7fe15411a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:06.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.356+0000 7fe15c266700 1 -- 172.21.15.40:0/2801493945 >> 172.21.15.40:0/2801493945 conn(0x7fe15409ab30 msgr2=0x7fe15409bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:06.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.357+0000 7fe15c266700 1 -- 172.21.15.40:0/2801493945 shutdown_connections 2023-09-30T22:22:06.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.357+0000 7fe15c266700 1 -- 172.21.15.40:0/2801493945 wait complete. 2023-09-30T22:22:06.358 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-09-30T22:22:06.370 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-09-30T22:22:05.775335+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":666,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":114,"acting":114,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188920,"kb_used_data":536,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298440,"statfs":{"total":386547056640,"available":385329602560,"internally_reserved":0,"allocated":548864,"data_stored":155183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385151+0000","last_change":"2023-09-30T22:22:02.379022+0000","last_active":"2023-09-30T22:22:02.385151+0000","last_peered":"2023-09-30T22:22:02.385151+0000","last_clean":"2023-09-30T22:22:02.385151+0000","last_became_active":"2023-09-30T22:22:02.378723+0000","last_became_peered":"2023-09-30T22:22:02.378723+0000","last_unstale":"2023-09-30T22:22:02.385151+0000","last_undegraded":"2023-09-30T22:22:02.385151+0000","last_fullsized":"2023-09-30T22:22:02.385151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385016+0000","last_change":"2023-09-30T22:22:02.378089+0000","last_active":"2023-09-30T22:22:02.385016+0000","last_peered":"2023-09-30T22:22:02.385016+0000","last_clean":"2023-09-30T22:22:02.385016+0000","last_became_active":"2023-09-30T22:22:02.375446+0000","last_became_peered":"2023-09-30T22:22:02.375446+0000","last_unstale":"2023-09-30T22:22:02.385016+0000","last_undegraded":"2023-09-30T22:22:02.385016+0000","last_fullsized":"2023-09-30T22:22:02.385016+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.402864+0000","last_change":"2023-09-30T22:22:02.398073+0000","last_active":"2023-09-30T22:22:02.402864+0000","last_peered":"2023-09-30T22:22:02.402864+0000","last_clean":"2023-09-30T22:22:02.402864+0000","last_became_active":"2023-09-30T22:22:02.397855+0000","last_became_peered":"2023-09-30T22:22:02.397855+0000","last_unstale":"2023-09-30T22:22:02.402864+0000","last_undegraded":"2023-09-30T22:22:02.402864+0000","last_fullsized":"2023-09-30T22:22:02.402864+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393512+0000","last_change":"2023-09-30T22:22:02.382627+0000","last_active":"2023-09-30T22:22:02.393512+0000","last_peered":"2023-09-30T22:22:02.393512+0000","last_clean":"2023-09-30T22:22:02.393512+0000","last_became_active":"2023-09-30T22:22:02.382360+0000","last_became_peered":"2023-09-30T22:22:02.382360+0000","last_unstale":"2023-09-30T22:22:02.393512+0000","last_undegraded":"2023-09-30T22:22:02.393512+0000","last_fullsized":"2023-09-30T22:22:02.393512+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394788+0000","last_change":"2023-09-30T22:22:02.388864+0000","last_active":"2023-09-30T22:22:02.394788+0000","last_peered":"2023-09-30T22:22:02.394788+0000","last_clean":"2023-09-30T22:22:02.394788+0000","last_became_active":"2023-09-30T22:22:02.388267+0000","last_became_peered":"2023-09-30T22:22:02.388267+0000","last_unstale":"2023-09-30T22:22:02.394788+0000","last_undegraded":"2023-09-30T22:22:02.394788+0000","last_fullsized":"2023-09-30T22:22:02.394788+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380523+0000","last_change":"2023-09-30T22:22:02.379619+0000","last_active":"2023-09-30T22:22:02.380523+0000","last_peered":"2023-09-30T22:22:02.380523+0000","last_clean":"2023-09-30T22:22:02.380523+0000","last_became_active":"2023-09-30T22:22:02.379412+0000","last_became_peered":"2023-09-30T22:22:02.379412+0000","last_unstale":"2023-09-30T22:22:02.380523+0000","last_undegraded":"2023-09-30T22:22:02.380523+0000","last_fullsized":"2023-09-30T22:22:02.380523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.377473+0000","last_change":"2023-09-30T22:22:02.372757+0000","last_active":"2023-09-30T22:22:02.377473+0000","last_peered":"2023-09-30T22:22:02.377473+0000","last_clean":"2023-09-30T22:22:02.377473+0000","last_became_active":"2023-09-30T22:22:02.372495+0000","last_became_peered":"2023-09-30T22:22:02.372495+0000","last_unstale":"2023-09-30T22:22:02.377473+0000","last_undegraded":"2023-09-30T22:22:02.377473+0000","last_fullsized":"2023-09-30T22:22:02.377473+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380478+0000","last_change":"2023-09-30T22:22:02.374488+0000","last_active":"2023-09-30T22:22:02.380478+0000","last_peered":"2023-09-30T22:22:02.380478+0000","last_clean":"2023-09-30T22:22:02.380478+0000","last_became_active":"2023-09-30T22:22:02.374287+0000","last_became_peered":"2023-09-30T22:22:02.374287+0000","last_unstale":"2023-09-30T22:22:02.380478+0000","last_undegraded":"2023-09-30T22:22:02.380478+0000","last_fullsized":"2023-09-30T22:22:02.380478+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.384882+0000","last_change":"2023-09-30T22:22:02.375916+0000","last_active":"2023-09-30T22:22:02.384882+0000","last_peered":"2023-09-30T22:22:02.384882+0000","last_clean":"2023-09-30T22:22:02.384882+0000","last_became_active":"2023-09-30T22:22:02.374277+0000","last_became_peered":"2023-09-30T22:22:02.374277+0000","last_unstale":"2023-09-30T22:22:02.384882+0000","last_undegraded":"2023-09-30T22:22:02.384882+0000","last_fullsized":"2023-09-30T22:22:02.384882+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.395070+0000","last_change":"2023-09-30T22:22:02.391303+0000","last_active":"2023-09-30T22:22:02.395070+0000","last_peered":"2023-09-30T22:22:02.395070+0000","last_clean":"2023-09-30T22:22:02.395070+0000","last_became_active":"2023-09-30T22:22:02.388602+0000","last_became_peered":"2023-09-30T22:22:02.388602+0000","last_unstale":"2023-09-30T22:22:02.395070+0000","last_undegraded":"2023-09-30T22:22:02.395070+0000","last_fullsized":"2023-09-30T22:22:02.395070+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385063+0000","last_change":"2023-09-30T22:22:02.376471+0000","last_active":"2023-09-30T22:22:02.385063+0000","last_peered":"2023-09-30T22:22:02.385063+0000","last_clean":"2023-09-30T22:22:02.385063+0000","last_became_active":"2023-09-30T22:22:02.374833+0000","last_became_peered":"2023-09-30T22:22:02.374833+0000","last_unstale":"2023-09-30T22:22:02.385063+0000","last_undegraded":"2023-09-30T22:22:02.385063+0000","last_fullsized":"2023-09-30T22:22:02.385063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394501+0000","last_change":"2023-09-30T22:22:02.388315+0000","last_active":"2023-09-30T22:22:02.394501+0000","last_peered":"2023-09-30T22:22:02.394501+0000","last_clean":"2023-09-30T22:22:02.394501+0000","last_became_active":"2023-09-30T22:22:02.388046+0000","last_became_peered":"2023-09-30T22:22:02.388046+0000","last_unstale":"2023-09-30T22:22:02.394501+0000","last_undegraded":"2023-09-30T22:22:02.394501+0000","last_fullsized":"2023-09-30T22:22:02.394501+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.395152+0000","last_change":"2023-09-30T22:22:02.391309+0000","last_active":"2023-09-30T22:22:02.395152+0000","last_peered":"2023-09-30T22:22:02.395152+0000","last_clean":"2023-09-30T22:22:02.395152+0000","last_became_active":"2023-09-30T22:22:02.391040+0000","last_became_peered":"2023-09-30T22:22:02.391040+0000","last_unstale":"2023-09-30T22:22:02.395152+0000","last_undegraded":"2023-09-30T22:22:02.395152+0000","last_fullsized":"2023-09-30T22:22:02.395152+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.384855+0000","last_change":"2023-09-30T22:22:02.375857+0000","last_active":"2023-09-30T22:22:02.384855+0000","last_peered":"2023-09-30T22:22:02.384855+0000","last_clean":"2023-09-30T22:22:02.384855+0000","last_became_active":"2023-09-30T22:22:02.373866+0000","last_became_peered":"2023-09-30T22:22:02.373866+0000","last_unstale":"2023-09-30T22:22:02.384855+0000","last_undegraded":"2023-09-30T22:22:02.384855+0000","last_fullsized":"2023-09-30T22:22:02.384855+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394655+0000","last_change":"2023-09-30T22:22:02.389818+0000","last_active":"2023-09-30T22:22:02.394655+0000","last_peered":"2023-09-30T22:22:02.394655+0000","last_clean":"2023-09-30T22:22:02.394655+0000","last_became_active":"2023-09-30T22:22:02.389526+0000","last_became_peered":"2023-09-30T22:22:02.389526+0000","last_unstale":"2023-09-30T22:22:02.394655+0000","last_undegraded":"2023-09-30T22:22:02.394655+0000","last_fullsized":"2023-09-30T22:22:02.394655+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394419+0000","last_change":"2023-09-30T22:22:02.386166+0000","last_active":"2023-09-30T22:22:02.394419+0000","last_peered":"2023-09-30T22:22:02.394419+0000","last_clean":"2023-09-30T22:22:02.394419+0000","last_became_active":"2023-09-30T22:22:02.385731+0000","last_became_peered":"2023-09-30T22:22:02.385731+0000","last_unstale":"2023-09-30T22:22:02.394419+0000","last_undegraded":"2023-09-30T22:22:02.394419+0000","last_fullsized":"2023-09-30T22:22:02.394419+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380502+0000","last_change":"2023-09-30T22:22:02.374713+0000","last_active":"2023-09-30T22:22:02.380502+0000","last_peered":"2023-09-30T22:22:02.380502+0000","last_clean":"2023-09-30T22:22:02.380502+0000","last_became_active":"2023-09-30T22:22:02.374467+0000","last_became_peered":"2023-09-30T22:22:02.374467+0000","last_unstale":"2023-09-30T22:22:02.380502+0000","last_undegraded":"2023-09-30T22:22:02.380502+0000","last_fullsized":"2023-09-30T22:22:02.380502+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.374558+0000","last_change":"2023-09-30T22:22:01.986896+0000","last_active":"2023-09-30T22:22:02.374558+0000","last_peered":"2023-09-30T22:22:02.374558+0000","last_clean":"2023-09-30T22:22:02.374558+0000","last_became_active":"2023-09-30T22:22:01.986600+0000","last_became_peered":"2023-09-30T22:22:01.986600+0000","last_unstale":"2023-09-30T22:22:02.374558+0000","last_undegraded":"2023-09-30T22:22:02.374558+0000","last_fullsized":"2023-09-30T22:22:02.374558+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.361691+0000","last_change":"2023-09-30T22:22:01.992230+0000","last_active":"2023-09-30T22:22:02.361691+0000","last_peered":"2023-09-30T22:22:02.361691+0000","last_clean":"2023-09-30T22:22:02.361691+0000","last_became_active":"2023-09-30T22:22:01.991929+0000","last_became_peered":"2023-09-30T22:22:01.991929+0000","last_unstale":"2023-09-30T22:22:02.361691+0000","last_undegraded":"2023-09-30T22:22:02.361691+0000","last_fullsized":"2023-09-30T22:22:02.361691+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385127+0000","last_change":"2023-09-30T22:22:02.380249+0000","last_active":"2023-09-30T22:22:02.385127+0000","last_peered":"2023-09-30T22:22:02.385127+0000","last_clean":"2023-09-30T22:22:02.385127+0000","last_became_active":"2023-09-30T22:22:02.379830+0000","last_became_peered":"2023-09-30T22:22:02.379830+0000","last_unstale":"2023-09-30T22:22:02.385127+0000","last_undegraded":"2023-09-30T22:22:02.385127+0000","last_fullsized":"2023-09-30T22:22:02.385127+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.364409+0000","last_change":"2023-09-30T22:22:01.997405+0000","last_active":"2023-09-30T22:22:02.364409+0000","last_peered":"2023-09-30T22:22:02.364409+0000","last_clean":"2023-09-30T22:22:02.364409+0000","last_became_active":"2023-09-30T22:22:01.997079+0000","last_became_peered":"2023-09-30T22:22:01.997079+0000","last_unstale":"2023-09-30T22:22:02.364409+0000","last_undegraded":"2023-09-30T22:22:02.364409+0000","last_fullsized":"2023-09-30T22:22:02.364409+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.398556+0000","last_change":"2023-09-30T22:22:01.998235+0000","last_active":"2023-09-30T22:22:02.398556+0000","last_peered":"2023-09-30T22:22:02.398556+0000","last_clean":"2023-09-30T22:22:02.398556+0000","last_became_active":"2023-09-30T22:22:01.997649+0000","last_became_peered":"2023-09-30T22:22:01.997649+0000","last_unstale":"2023-09-30T22:22:02.398556+0000","last_undegraded":"2023-09-30T22:22:02.398556+0000","last_fullsized":"2023-09-30T22:22:02.398556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394877+0000","last_change":"2023-09-30T22:22:02.390318+0000","last_active":"2023-09-30T22:22:02.394877+0000","last_peered":"2023-09-30T22:22:02.394877+0000","last_clean":"2023-09-30T22:22:02.394877+0000","last_became_active":"2023-09-30T22:22:02.390020+0000","last_became_peered":"2023-09-30T22:22:02.390020+0000","last_unstale":"2023-09-30T22:22:02.394877+0000","last_undegraded":"2023-09-30T22:22:02.394877+0000","last_fullsized":"2023-09-30T22:22:02.394877+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.360247+0000","last_change":"2023-09-30T22:22:01.997424+0000","last_active":"2023-09-30T22:22:02.360247+0000","last_peered":"2023-09-30T22:22:02.360247+0000","last_clean":"2023-09-30T22:22:02.360247+0000","last_became_active":"2023-09-30T22:22:01.997098+0000","last_became_peered":"2023-09-30T22:22:01.997098+0000","last_unstale":"2023-09-30T22:22:02.360247+0000","last_undegraded":"2023-09-30T22:22:02.360247+0000","last_fullsized":"2023-09-30T22:22:02.360247+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.395039+0000","last_change":"2023-09-30T22:22:02.391210+0000","last_active":"2023-09-30T22:22:02.395039+0000","last_peered":"2023-09-30T22:22:02.395039+0000","last_clean":"2023-09-30T22:22:02.395039+0000","last_became_active":"2023-09-30T22:22:02.390937+0000","last_became_peered":"2023-09-30T22:22:02.390937+0000","last_unstale":"2023-09-30T22:22:02.395039+0000","last_undegraded":"2023-09-30T22:22:02.395039+0000","last_fullsized":"2023-09-30T22:22:02.395039+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.389161+0000","last_change":"2023-09-30T22:22:01.974848+0000","last_active":"2023-09-30T22:22:02.389161+0000","last_peered":"2023-09-30T22:22:02.389161+0000","last_clean":"2023-09-30T22:22:02.389161+0000","last_became_active":"2023-09-30T22:22:01.974025+0000","last_became_peered":"2023-09-30T22:22:01.974025+0000","last_unstale":"2023-09-30T22:22:02.389161+0000","last_undegraded":"2023-09-30T22:22:02.389161+0000","last_fullsized":"2023-09-30T22:22:02.389161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393941+0000","last_change":"2023-09-30T22:22:01.979910+0000","last_active":"2023-09-30T22:22:02.393941+0000","last_peered":"2023-09-30T22:22:02.393941+0000","last_clean":"2023-09-30T22:22:02.393941+0000","last_became_active":"2023-09-30T22:22:01.979649+0000","last_became_peered":"2023-09-30T22:22:01.979649+0000","last_unstale":"2023-09-30T22:22:02.393941+0000","last_undegraded":"2023-09-30T22:22:02.393941+0000","last_fullsized":"2023-09-30T22:22:02.393941+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394816+0000","last_change":"2023-09-30T22:22:02.390201+0000","last_active":"2023-09-30T22:22:02.394816+0000","last_peered":"2023-09-30T22:22:02.394816+0000","last_clean":"2023-09-30T22:22:02.394816+0000","last_became_active":"2023-09-30T22:22:02.389897+0000","last_became_peered":"2023-09-30T22:22:02.389897+0000","last_unstale":"2023-09-30T22:22:02.394816+0000","last_undegraded":"2023-09-30T22:22:02.394816+0000","last_fullsized":"2023-09-30T22:22:02.394816+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.361009+0000","last_change":"2023-09-30T22:22:01.998688+0000","last_active":"2023-09-30T22:22:02.361009+0000","last_peered":"2023-09-30T22:22:02.361009+0000","last_clean":"2023-09-30T22:22:02.361009+0000","last_became_active":"2023-09-30T22:22:01.998390+0000","last_became_peered":"2023-09-30T22:22:01.998390+0000","last_unstale":"2023-09-30T22:22:02.361009+0000","last_undegraded":"2023-09-30T22:22:02.361009+0000","last_fullsized":"2023-09-30T22:22:02.361009+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385081+0000","last_change":"2023-09-30T22:22:02.376261+0000","last_active":"2023-09-30T22:22:02.385081+0000","last_peered":"2023-09-30T22:22:02.385081+0000","last_clean":"2023-09-30T22:22:02.385081+0000","last_became_active":"2023-09-30T22:22:02.375940+0000","last_became_peered":"2023-09-30T22:22:02.375940+0000","last_unstale":"2023-09-30T22:22:02.385081+0000","last_undegraded":"2023-09-30T22:22:02.385081+0000","last_fullsized":"2023-09-30T22:22:02.385081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394834+0000","last_change":"2023-09-30T22:22:02.390443+0000","last_active":"2023-09-30T22:22:02.394834+0000","last_peered":"2023-09-30T22:22:02.394834+0000","last_clean":"2023-09-30T22:22:02.394834+0000","last_became_active":"2023-09-30T22:22:02.390261+0000","last_became_peered":"2023-09-30T22:22:02.390261+0000","last_unstale":"2023-09-30T22:22:02.394834+0000","last_undegraded":"2023-09-30T22:22:02.394834+0000","last_fullsized":"2023-09-30T22:22:02.394834+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394399+0000","last_change":"2023-09-30T22:22:02.385985+0000","last_active":"2023-09-30T22:22:02.394399+0000","last_peered":"2023-09-30T22:22:02.394399+0000","last_clean":"2023-09-30T22:22:02.394399+0000","last_became_active":"2023-09-30T22:22:02.385413+0000","last_became_peered":"2023-09-30T22:22:02.385413+0000","last_unstale":"2023-09-30T22:22:02.394399+0000","last_undegraded":"2023-09-30T22:22:02.394399+0000","last_fullsized":"2023-09-30T22:22:02.394399+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.359640+0000","last_change":"2023-09-30T22:21:58.403636+0000","last_active":"2023-09-30T22:22:02.359640+0000","last_peered":"2023-09-30T22:22:02.359640+0000","last_clean":"2023-09-30T22:22:02.359640+0000","last_became_active":"2023-09-30T22:21:58.403342+0000","last_became_peered":"2023-09-30T22:21:58.403342+0000","last_unstale":"2023-09-30T22:22:02.359640+0000","last_undegraded":"2023-09-30T22:22:02.359640+0000","last_fullsized":"2023-09-30T22:22:02.359640+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394856+0000","last_change":"2023-09-30T22:22:02.389982+0000","last_active":"2023-09-30T22:22:02.394856+0000","last_peered":"2023-09-30T22:22:02.394856+0000","last_clean":"2023-09-30T22:22:02.394856+0000","last_became_active":"2023-09-30T22:22:02.389680+0000","last_became_peered":"2023-09-30T22:22:02.389680+0000","last_unstale":"2023-09-30T22:22:02.394856+0000","last_undegraded":"2023-09-30T22:22:02.394856+0000","last_fullsized":"2023-09-30T22:22:02.394856+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:21:57.843502+0000","last_change":"2023-09-30T22:21:57.839392+0000","last_active":"2023-09-30T22:21:57.843502+0000","last_peered":"2023-09-30T22:21:57.843502+0000","last_clean":"2023-09-30T22:21:57.843502+0000","last_became_active":"2023-09-30T22:21:57.838993+0000","last_became_peered":"2023-09-30T22:21:57.838993+0000","last_unstale":"2023-09-30T22:21:57.843502+0000","last_undegraded":"2023-09-30T22:21:57.843502+0000","last_fullsized":"2023-09-30T22:21:57.843502+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.363117+0000","last_change":"2023-09-30T22:22:01.990265+0000","last_active":"2023-09-30T22:22:02.363117+0000","last_peered":"2023-09-30T22:22:02.363117+0000","last_clean":"2023-09-30T22:22:02.363117+0000","last_became_active":"2023-09-30T22:22:01.990011+0000","last_became_peered":"2023-09-30T22:22:01.990011+0000","last_unstale":"2023-09-30T22:22:02.363117+0000","last_undegraded":"2023-09-30T22:22:02.363117+0000","last_fullsized":"2023-09-30T22:22:02.363117+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.383793+0000","last_change":"2023-09-30T22:22:02.374205+0000","last_active":"2023-09-30T22:22:02.383793+0000","last_peered":"2023-09-30T22:22:02.383793+0000","last_clean":"2023-09-30T22:22:02.383793+0000","last_became_active":"2023-09-30T22:22:02.373928+0000","last_became_peered":"2023-09-30T22:22:02.373928+0000","last_unstale":"2023-09-30T22:22:02.383793+0000","last_undegraded":"2023-09-30T22:22:02.383793+0000","last_fullsized":"2023-09-30T22:22:02.383793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:21:57.838143+0000","last_change":"2023-09-30T22:21:57.836160+0000","last_active":"2023-09-30T22:21:57.838143+0000","last_peered":"2023-09-30T22:21:57.838143+0000","last_clean":"2023-09-30T22:21:57.838143+0000","last_became_active":"2023-09-30T22:21:57.835792+0000","last_became_peered":"2023-09-30T22:21:57.835792+0000","last_unstale":"2023-09-30T22:21:57.838143+0000","last_undegraded":"2023-09-30T22:21:57.838143+0000","last_fullsized":"2023-09-30T22:21:57.838143+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.359810+0000","last_change":"2023-09-30T22:22:01.987700+0000","last_active":"2023-09-30T22:22:02.359810+0000","last_peered":"2023-09-30T22:22:02.359810+0000","last_clean":"2023-09-30T22:22:02.359810+0000","last_became_active":"2023-09-30T22:22:01.987358+0000","last_became_peered":"2023-09-30T22:22:01.987358+0000","last_unstale":"2023-09-30T22:22:02.359810+0000","last_undegraded":"2023-09-30T22:22:02.359810+0000","last_fullsized":"2023-09-30T22:22:02.359810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.382010+0000","last_change":"2023-09-30T22:22:02.379845+0000","last_active":"2023-09-30T22:22:02.382010+0000","last_peered":"2023-09-30T22:22:02.382010+0000","last_clean":"2023-09-30T22:22:02.382010+0000","last_became_active":"2023-09-30T22:22:02.379594+0000","last_became_peered":"2023-09-30T22:22:02.379594+0000","last_unstale":"2023-09-30T22:22:02.382010+0000","last_undegraded":"2023-09-30T22:22:02.382010+0000","last_fullsized":"2023-09-30T22:22:02.382010+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:21:57.843463+0000","last_change":"2023-09-30T22:21:57.838957+0000","last_active":"2023-09-30T22:21:57.843463+0000","last_peered":"2023-09-30T22:21:57.843463+0000","last_clean":"2023-09-30T22:21:57.843463+0000","last_became_active":"2023-09-30T22:21:57.838667+0000","last_became_peered":"2023-09-30T22:21:57.838667+0000","last_unstale":"2023-09-30T22:21:57.843463+0000","last_undegraded":"2023-09-30T22:21:57.843463+0000","last_fullsized":"2023-09-30T22:21:57.843463+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.359529+0000","last_change":"2023-09-30T22:21:56.838072+0000","last_active":"2023-09-30T22:22:02.359529+0000","last_peered":"2023-09-30T22:22:02.359529+0000","last_clean":"2023-09-30T22:22:02.359529+0000","last_became_active":"2023-09-30T22:21:56.837717+0000","last_became_peered":"2023-09-30T22:21:56.837717+0000","last_unstale":"2023-09-30T22:22:02.359529+0000","last_undegraded":"2023-09-30T22:22:02.359529+0000","last_fullsized":"2023-09-30T22:22:02.359529+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:55.823939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:55.823939+0000","last_clean_scrub_stamp":"2023-09-30T22:21:55.823939+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:21:57.840884+0000","last_change":"2023-09-30T22:21:57.837598+0000","last_active":"2023-09-30T22:21:57.840884+0000","last_peered":"2023-09-30T22:21:57.840884+0000","last_clean":"2023-09-30T22:21:57.840884+0000","last_became_active":"2023-09-30T22:21:57.837284+0000","last_became_peered":"2023-09-30T22:21:57.837284+0000","last_unstale":"2023-09-30T22:21:57.840884+0000","last_undegraded":"2023-09-30T22:21:57.840884+0000","last_fullsized":"2023-09-30T22:21:57.840884+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.364183+0000","last_change":"2023-09-30T22:22:01.983059+0000","last_active":"2023-09-30T22:22:02.364183+0000","last_peered":"2023-09-30T22:22:02.364183+0000","last_clean":"2023-09-30T22:22:02.364183+0000","last_became_active":"2023-09-30T22:22:01.982739+0000","last_became_peered":"2023-09-30T22:22:01.982739+0000","last_unstale":"2023-09-30T22:22:02.364183+0000","last_undegraded":"2023-09-30T22:22:02.364183+0000","last_fullsized":"2023-09-30T22:22:02.364183+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385106+0000","last_change":"2023-09-30T22:22:02.380074+0000","last_active":"2023-09-30T22:22:02.385106+0000","last_peered":"2023-09-30T22:22:02.385106+0000","last_clean":"2023-09-30T22:22:02.385106+0000","last_became_active":"2023-09-30T22:22:02.379501+0000","last_became_peered":"2023-09-30T22:22:02.379501+0000","last_unstale":"2023-09-30T22:22:02.385106+0000","last_undegraded":"2023-09-30T22:22:02.385106+0000","last_fullsized":"2023-09-30T22:22:02.385106+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:21:58.404324+0000","last_change":"2023-09-30T22:21:58.403508+0000","last_active":"2023-09-30T22:21:58.404324+0000","last_peered":"2023-09-30T22:21:58.404324+0000","last_clean":"2023-09-30T22:21:58.404324+0000","last_became_active":"2023-09-30T22:21:58.403267+0000","last_became_peered":"2023-09-30T22:21:58.403267+0000","last_unstale":"2023-09-30T22:21:58.404324+0000","last_undegraded":"2023-09-30T22:21:58.404324+0000","last_fullsized":"2023-09-30T22:21:58.404324+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.359534+0000","last_change":"2023-09-30T22:22:01.987265+0000","last_active":"2023-09-30T22:22:02.359534+0000","last_peered":"2023-09-30T22:22:02.359534+0000","last_clean":"2023-09-30T22:22:02.359534+0000","last_became_active":"2023-09-30T22:22:01.986968+0000","last_became_peered":"2023-09-30T22:22:01.986968+0000","last_unstale":"2023-09-30T22:22:02.359534+0000","last_undegraded":"2023-09-30T22:22:02.359534+0000","last_fullsized":"2023-09-30T22:22:02.359534+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385062+0000","last_change":"2023-09-30T22:22:02.376013+0000","last_active":"2023-09-30T22:22:02.385062+0000","last_peered":"2023-09-30T22:22:02.385062+0000","last_clean":"2023-09-30T22:22:02.385062+0000","last_became_active":"2023-09-30T22:22:02.374252+0000","last_became_peered":"2023-09-30T22:22:02.374252+0000","last_unstale":"2023-09-30T22:22:02.385062+0000","last_undegraded":"2023-09-30T22:22:02.385062+0000","last_fullsized":"2023-09-30T22:22:02.385062+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.360873+0000","last_change":"2023-09-30T22:21:58.403570+0000","last_active":"2023-09-30T22:22:02.360873+0000","last_peered":"2023-09-30T22:22:02.360873+0000","last_clean":"2023-09-30T22:22:02.360873+0000","last_became_active":"2023-09-30T22:21:58.403321+0000","last_became_peered":"2023-09-30T22:21:58.403321+0000","last_unstale":"2023-09-30T22:22:02.360873+0000","last_undegraded":"2023-09-30T22:22:02.360873+0000","last_fullsized":"2023-09-30T22:22:02.360873+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:21:58.409868+0000","last_change":"2023-09-30T22:21:58.404380+0000","last_active":"2023-09-30T22:21:58.409868+0000","last_peered":"2023-09-30T22:21:58.409868+0000","last_clean":"2023-09-30T22:21:58.409868+0000","last_became_active":"2023-09-30T22:21:58.404098+0000","last_became_peered":"2023-09-30T22:21:58.404098+0000","last_unstale":"2023-09-30T22:21:58.409868+0000","last_undegraded":"2023-09-30T22:21:58.409868+0000","last_fullsized":"2023-09-30T22:21:58.409868+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.366010+0000","last_change":"2023-09-30T22:22:01.977163+0000","last_active":"2023-09-30T22:22:02.366010+0000","last_peered":"2023-09-30T22:22:02.366010+0000","last_clean":"2023-09-30T22:22:02.366010+0000","last_became_active":"2023-09-30T22:22:01.976494+0000","last_became_peered":"2023-09-30T22:22:01.976494+0000","last_unstale":"2023-09-30T22:22:02.366010+0000","last_undegraded":"2023-09-30T22:22:02.366010+0000","last_fullsized":"2023-09-30T22:22:02.366010+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.398231+0000","last_change":"2023-09-30T22:22:01.997989+0000","last_active":"2023-09-30T22:22:02.398231+0000","last_peered":"2023-09-30T22:22:02.398231+0000","last_clean":"2023-09-30T22:22:02.398231+0000","last_became_active":"2023-09-30T22:22:01.997419+0000","last_became_peered":"2023-09-30T22:22:01.997419+0000","last_unstale":"2023-09-30T22:22:02.398231+0000","last_undegraded":"2023-09-30T22:22:02.398231+0000","last_fullsized":"2023-09-30T22:22:02.398231+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380701+0000","last_change":"2023-09-30T22:22:01.977515+0000","last_active":"2023-09-30T22:22:02.380701+0000","last_peered":"2023-09-30T22:22:02.380701+0000","last_clean":"2023-09-30T22:22:02.380701+0000","last_became_active":"2023-09-30T22:22:01.976843+0000","last_became_peered":"2023-09-30T22:22:01.976843+0000","last_unstale":"2023-09-30T22:22:02.380701+0000","last_undegraded":"2023-09-30T22:22:02.380701+0000","last_fullsized":"2023-09-30T22:22:02.380701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.386441+0000","last_change":"2023-09-30T22:22:01.980853+0000","last_active":"2023-09-30T22:22:02.386441+0000","last_peered":"2023-09-30T22:22:02.386441+0000","last_clean":"2023-09-30T22:22:02.386441+0000","last_became_active":"2023-09-30T22:22:01.979795+0000","last_became_peered":"2023-09-30T22:22:01.979795+0000","last_unstale":"2023-09-30T22:22:02.386441+0000","last_undegraded":"2023-09-30T22:22:02.386441+0000","last_fullsized":"2023-09-30T22:22:02.386441+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380254+0000","last_change":"2023-09-30T22:22:02.373820+0000","last_active":"2023-09-30T22:22:02.380254+0000","last_peered":"2023-09-30T22:22:02.380254+0000","last_clean":"2023-09-30T22:22:02.380254+0000","last_became_active":"2023-09-30T22:22:02.373530+0000","last_became_peered":"2023-09-30T22:22:02.373530+0000","last_unstale":"2023-09-30T22:22:02.380254+0000","last_undegraded":"2023-09-30T22:22:02.380254+0000","last_fullsized":"2023-09-30T22:22:02.380254+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394694+0000","last_change":"2023-09-30T22:22:02.387890+0000","last_active":"2023-09-30T22:22:02.394694+0000","last_peered":"2023-09-30T22:22:02.394694+0000","last_clean":"2023-09-30T22:22:02.394694+0000","last_became_active":"2023-09-30T22:22:02.387599+0000","last_became_peered":"2023-09-30T22:22:02.387599+0000","last_unstale":"2023-09-30T22:22:02.394694+0000","last_undegraded":"2023-09-30T22:22:02.394694+0000","last_fullsized":"2023-09-30T22:22:02.394694+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.383770+0000","last_change":"2023-09-30T22:22:02.374216+0000","last_active":"2023-09-30T22:22:02.383770+0000","last_peered":"2023-09-30T22:22:02.383770+0000","last_clean":"2023-09-30T22:22:02.383770+0000","last_became_active":"2023-09-30T22:22:02.373952+0000","last_became_peered":"2023-09-30T22:22:02.373952+0000","last_unstale":"2023-09-30T22:22:02.383770+0000","last_undegraded":"2023-09-30T22:22:02.383770+0000","last_fullsized":"2023-09-30T22:22:02.383770+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":2},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":666,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":32,"acting":32,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":30204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705666,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":30204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":46930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":47845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T22:22:06.377 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:22:06.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.531+0000 7ff8e7510700 1 Processor -- start 2023-09-30T22:22:06.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.531+0000 7ff8e7510700 1 -- start start 2023-09-30T22:22:06.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.532+0000 7ff8e7510700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff8e0062e60 0x7ff8e0067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:06.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.532+0000 7ff8e7510700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8e00684e0 0x7ff8e00688e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:06.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.532+0000 7ff8e7510700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff8e0127c20 0x7ff8e01280d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:06.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.532+0000 7ff8e7510700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e0063240 con 0x7ff8e0062e60 2023-09-30T22:22:06.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.532+0000 7ff8e7510700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e0091ae0 con 0x7ff8e00684e0 2023-09-30T22:22:06.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.532+0000 7ff8e7510700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e0069210 con 0x7ff8e0127c20 2023-09-30T22:22:06.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.532+0000 7ff8e52ac700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff8e0062e60 0x7ff8e0067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:06.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.532+0000 7ff8e4aab700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8e00684e0 0x7ff8e00688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:06.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.532+0000 7ff8e5aad700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff8e0127c20 0x7ff8e01280d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:06.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.532+0000 7ff8e52ac700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff8e0062e60 0x7ff8e0067ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46466/0 (socket says 172.21.15.40:46466) 2023-09-30T22:22:06.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.532+0000 7ff8e4aab700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8e00684e0 0x7ff8e00688e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:46646/0 (socket says 172.21.15.40:46646) 2023-09-30T22:22:06.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.532+0000 7ff8e52ac700 1 -- 172.21.15.40:0/1793608050 learned_addr learned my addr 172.21.15.40:0/1793608050 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:06.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.532+0000 7ff8e4aab700 1 -- 172.21.15.40:0/1793608050 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff8e0127c20 msgr2=0x7ff8e01280d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:06.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.532+0000 7ff8e4aab700 1 --2- 172.21.15.40:0/1793608050 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff8e0127c20 0x7ff8e01280d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:06.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.532+0000 7ff8e4aab700 1 -- 172.21.15.40:0/1793608050 >> v2:172.21.15.40:3300/0 conn(0x7ff8e0062e60 msgr2=0x7ff8e0067ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:06.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.532+0000 7ff8e4aab700 1 --2- 172.21.15.40:0/1793608050 >> v2:172.21.15.40:3300/0 conn(0x7ff8e0062e60 0x7ff8e0067ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:06.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.532+0000 7ff8e4aab700 1 -- 172.21.15.40:0/1793608050 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e0092020 con 0x7ff8e00684e0 2023-09-30T22:22:06.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.532+0000 7ff8e52ac700 1 --2- 172.21.15.40:0/1793608050 >> v2:172.21.15.40:3300/0 conn(0x7ff8e0062e60 0x7ff8e0067ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:06.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.533+0000 7ff8e4aab700 1 --2- 172.21.15.40:0/1793608050 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8e00684e0 0x7ff8e00688e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7ff8d0009760 tx=0x7ff8d0009060).ready entity=mon.1 client_cookie=2dff4d0470364348 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:06.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.533+0000 7ff8d7fff700 1 -- 172.21.15.40:0/1793608050 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d00090d0 con 0x7ff8e00684e0 2023-09-30T22:22:06.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.533+0000 7ff8d7fff700 1 -- 172.21.15.40:0/1793608050 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d000d4a0 con 0x7ff8e00684e0 2023-09-30T22:22:06.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.533+0000 7ff8d7fff700 1 -- 172.21.15.40:0/1793608050 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d000d820 con 0x7ff8e00684e0 2023-09-30T22:22:06.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.533+0000 7ff8e7510700 1 -- 172.21.15.40:0/1793608050 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8e00684e0 msgr2=0x7ff8e00688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:06.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.533+0000 7ff8e7510700 1 --2- 172.21.15.40:0/1793608050 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8e00684e0 0x7ff8e00688e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7ff8d0009760 tx=0x7ff8d0009060).stop 2023-09-30T22:22:06.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.533+0000 7ff8e7510700 1 -- 172.21.15.40:0/1793608050 shutdown_connections 2023-09-30T22:22:06.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.533+0000 7ff8e7510700 1 --2- 172.21.15.40:0/1793608050 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff8e0127c20 0x7ff8e01280d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:06.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.533+0000 7ff8e7510700 1 --2- 172.21.15.40:0/1793608050 >> v2:172.21.15.40:3300/0 conn(0x7ff8e0062e60 0x7ff8e0067ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:06.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.533+0000 7ff8e7510700 1 --2- 172.21.15.40:0/1793608050 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8e00684e0 0x7ff8e00688e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:06.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.533+0000 7ff8e7510700 1 -- 172.21.15.40:0/1793608050 >> 172.21.15.40:0/1793608050 conn(0x7ff8e005eb30 msgr2=0x7ff8e009a450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:06.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.533+0000 7ff8e7510700 1 -- 172.21.15.40:0/1793608050 shutdown_connections 2023-09-30T22:22:06.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.533+0000 7ff8e7510700 1 -- 172.21.15.40:0/1793608050 wait complete. 2023-09-30T22:22:06.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.534+0000 7ff8e7510700 1 Processor -- start 2023-09-30T22:22:06.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.535+0000 7ff8e7510700 1 -- start start 2023-09-30T22:22:06.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.535+0000 7ff8e7510700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e0062e60 0x7ff8e0116690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:06.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.535+0000 7ff8e7510700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff8e00684e0 0x7ff8e0116b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:06.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.535+0000 7ff8e7510700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8e0127c20 0x7ff8e0117070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:06.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.535+0000 7ff8e7510700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e0099df0 con 0x7ff8e0062e60 2023-09-30T22:22:06.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.535+0000 7ff8e7510700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e0069f20 con 0x7ff8e0127c20 2023-09-30T22:22:06.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.535+0000 7ff8e7510700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e01197b0 con 0x7ff8e00684e0 2023-09-30T22:22:06.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.535+0000 7ff8e52ac700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e0062e60 0x7ff8e0116690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:06.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.535+0000 7ff8e52ac700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e0062e60 0x7ff8e0116690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46474/0 (socket says 172.21.15.40:46474) 2023-09-30T22:22:06.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.535+0000 7ff8e52ac700 1 -- 172.21.15.40:0/2577402844 learned_addr learned my addr 172.21.15.40:0/2577402844 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:06.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.536+0000 7ff8e5aad700 1 --2- 172.21.15.40:0/2577402844 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8e0127c20 0x7ff8e0117070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:06.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.536+0000 7ff8e4aab700 1 --2- 172.21.15.40:0/2577402844 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff8e00684e0 0x7ff8e0116b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:06.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.536+0000 7ff8e5aad700 1 -- 172.21.15.40:0/2577402844 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff8e00684e0 msgr2=0x7ff8e0116b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:06.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.536+0000 7ff8e5aad700 1 --2- 172.21.15.40:0/2577402844 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff8e00684e0 0x7ff8e0116b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:06.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.536+0000 7ff8e5aad700 1 -- 172.21.15.40:0/2577402844 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e0062e60 msgr2=0x7ff8e0116690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:06.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.536+0000 7ff8e5aad700 1 --2- 172.21.15.40:0/2577402844 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e0062e60 0x7ff8e0116690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:06.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.536+0000 7ff8e5aad700 1 -- 172.21.15.40:0/2577402844 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8dc009370 con 0x7ff8e0127c20 2023-09-30T22:22:06.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.536+0000 7ff8e52ac700 1 --2- 172.21.15.40:0/2577402844 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e0062e60 0x7ff8e0116690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:06.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.536+0000 7ff8e5aad700 1 --2- 172.21.15.40:0/2577402844 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8e0127c20 0x7ff8e0117070 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7ff8d8010fd0 tx=0x7ff8d800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:06.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.536+0000 7ff8d57fa700 1 -- 172.21.15.40:0/2577402844 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d800ee60 con 0x7ff8e0127c20 2023-09-30T22:22:06.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.536+0000 7ff8d57fa700 1 -- 172.21.15.40:0/2577402844 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d8012430 con 0x7ff8e0127c20 2023-09-30T22:22:06.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.536+0000 7ff8e7510700 1 -- 172.21.15.40:0/2577402844 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d00092a0 con 0x7ff8e0127c20 2023-09-30T22:22:06.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.536+0000 7ff8d57fa700 1 -- 172.21.15.40:0/2577402844 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d80127b0 con 0x7ff8e0127c20 2023-09-30T22:22:06.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.536+0000 7ff8e7510700 1 -- 172.21.15.40:0/2577402844 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e011a330 con 0x7ff8e0127c20 2023-09-30T22:22:06.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.537+0000 7ff8d57fa700 1 -- 172.21.15.40:0/2577402844 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7ff8d8012b20 con 0x7ff8e0127c20 2023-09-30T22:22:06.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.537+0000 7ff8d57fa700 1 -- 172.21.15.40:0/2577402844 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7ff8d803d6b0 con 0x7ff8e0127c20 2023-09-30T22:22:06.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.537+0000 7ff8e7510700 1 -- 172.21.15.40:0/2577402844 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e011a330 con 0x7ff8e0127c20 2023-09-30T22:22:06.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.542+0000 7ff8d57fa700 1 -- 172.21.15.40:0/2577402844 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7ff8e011a330 con 0x7ff8e0127c20 2023-09-30T22:22:06.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.704+0000 7ff8e7510700 1 -- 172.21.15.40:0/2577402844 --> v1:172.21.15.40:6816/118905 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff8e011a330 con 0x7ff8c402bb90 2023-09-30T22:22:06.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.710+0000 7ff8d57fa700 1 -- 172.21.15.40:0/2577402844 <== mgr.4101 v1:172.21.15.40:6816/118905 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246257 (unknown 2965378022 0 717089435) 0x7ff8e011a330 con 0x7ff8c402bb90 2023-09-30T22:22:06.712 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:22:06.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.713+0000 7ff8e7510700 1 -- 172.21.15.40:0/2577402844 >> v1:172.21.15.40:6816/118905 conn(0x7ff8c402bb90 legacy=0x7ff8c402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:06.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.713+0000 7ff8e7510700 1 -- 172.21.15.40:0/2577402844 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8e0127c20 msgr2=0x7ff8e0117070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:06.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.713+0000 7ff8e7510700 1 --2- 172.21.15.40:0/2577402844 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8e0127c20 0x7ff8e0117070 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7ff8d8010fd0 tx=0x7ff8d800b040).stop 2023-09-30T22:22:06.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.713+0000 7ff8e7510700 1 -- 172.21.15.40:0/2577402844 shutdown_connections 2023-09-30T22:22:06.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.713+0000 7ff8e7510700 1 --2- 172.21.15.40:0/2577402844 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff8e0127c20 0x7ff8e0117070 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:06.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.713+0000 7ff8e7510700 1 --2- 172.21.15.40:0/2577402844 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e0062e60 0x7ff8e0116690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:06.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.713+0000 7ff8e7510700 1 --2- 172.21.15.40:0/2577402844 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff8e00684e0 0x7ff8e0116b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:06.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.713+0000 7ff8e7510700 1 -- 172.21.15.40:0/2577402844 >> 172.21.15.40:0/2577402844 conn(0x7ff8e005eb30 msgr2=0x7ff8e00982f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:06.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.713+0000 7ff8e7510700 1 -- 172.21.15.40:0/2577402844 shutdown_connections 2023-09-30T22:22:06.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.713+0000 7ff8e7510700 1 -- 172.21.15.40:0/2577402844 wait complete. 2023-09-30T22:22:06.715 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-09-30T22:22:06.724 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-09-30T22:22:05.775335+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":666,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":114,"acting":114,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188920,"kb_used_data":536,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298440,"statfs":{"total":386547056640,"available":385329602560,"internally_reserved":0,"allocated":548864,"data_stored":155183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385151+0000","last_change":"2023-09-30T22:22:02.379022+0000","last_active":"2023-09-30T22:22:02.385151+0000","last_peered":"2023-09-30T22:22:02.385151+0000","last_clean":"2023-09-30T22:22:02.385151+0000","last_became_active":"2023-09-30T22:22:02.378723+0000","last_became_peered":"2023-09-30T22:22:02.378723+0000","last_unstale":"2023-09-30T22:22:02.385151+0000","last_undegraded":"2023-09-30T22:22:02.385151+0000","last_fullsized":"2023-09-30T22:22:02.385151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385016+0000","last_change":"2023-09-30T22:22:02.378089+0000","last_active":"2023-09-30T22:22:02.385016+0000","last_peered":"2023-09-30T22:22:02.385016+0000","last_clean":"2023-09-30T22:22:02.385016+0000","last_became_active":"2023-09-30T22:22:02.375446+0000","last_became_peered":"2023-09-30T22:22:02.375446+0000","last_unstale":"2023-09-30T22:22:02.385016+0000","last_undegraded":"2023-09-30T22:22:02.385016+0000","last_fullsized":"2023-09-30T22:22:02.385016+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.402864+0000","last_change":"2023-09-30T22:22:02.398073+0000","last_active":"2023-09-30T22:22:02.402864+0000","last_peered":"2023-09-30T22:22:02.402864+0000","last_clean":"2023-09-30T22:22:02.402864+0000","last_became_active":"2023-09-30T22:22:02.397855+0000","last_became_peered":"2023-09-30T22:22:02.397855+0000","last_unstale":"2023-09-30T22:22:02.402864+0000","last_undegraded":"2023-09-30T22:22:02.402864+0000","last_fullsized":"2023-09-30T22:22:02.402864+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393512+0000","last_change":"2023-09-30T22:22:02.382627+0000","last_active":"2023-09-30T22:22:02.393512+0000","last_peered":"2023-09-30T22:22:02.393512+0000","last_clean":"2023-09-30T22:22:02.393512+0000","last_became_active":"2023-09-30T22:22:02.382360+0000","last_became_peered":"2023-09-30T22:22:02.382360+0000","last_unstale":"2023-09-30T22:22:02.393512+0000","last_undegraded":"2023-09-30T22:22:02.393512+0000","last_fullsized":"2023-09-30T22:22:02.393512+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394788+0000","last_change":"2023-09-30T22:22:02.388864+0000","last_active":"2023-09-30T22:22:02.394788+0000","last_peered":"2023-09-30T22:22:02.394788+0000","last_clean":"2023-09-30T22:22:02.394788+0000","last_became_active":"2023-09-30T22:22:02.388267+0000","last_became_peered":"2023-09-30T22:22:02.388267+0000","last_unstale":"2023-09-30T22:22:02.394788+0000","last_undegraded":"2023-09-30T22:22:02.394788+0000","last_fullsized":"2023-09-30T22:22:02.394788+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380523+0000","last_change":"2023-09-30T22:22:02.379619+0000","last_active":"2023-09-30T22:22:02.380523+0000","last_peered":"2023-09-30T22:22:02.380523+0000","last_clean":"2023-09-30T22:22:02.380523+0000","last_became_active":"2023-09-30T22:22:02.379412+0000","last_became_peered":"2023-09-30T22:22:02.379412+0000","last_unstale":"2023-09-30T22:22:02.380523+0000","last_undegraded":"2023-09-30T22:22:02.380523+0000","last_fullsized":"2023-09-30T22:22:02.380523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.377473+0000","last_change":"2023-09-30T22:22:02.372757+0000","last_active":"2023-09-30T22:22:02.377473+0000","last_peered":"2023-09-30T22:22:02.377473+0000","last_clean":"2023-09-30T22:22:02.377473+0000","last_became_active":"2023-09-30T22:22:02.372495+0000","last_became_peered":"2023-09-30T22:22:02.372495+0000","last_unstale":"2023-09-30T22:22:02.377473+0000","last_undegraded":"2023-09-30T22:22:02.377473+0000","last_fullsized":"2023-09-30T22:22:02.377473+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380478+0000","last_change":"2023-09-30T22:22:02.374488+0000","last_active":"2023-09-30T22:22:02.380478+0000","last_peered":"2023-09-30T22:22:02.380478+0000","last_clean":"2023-09-30T22:22:02.380478+0000","last_became_active":"2023-09-30T22:22:02.374287+0000","last_became_peered":"2023-09-30T22:22:02.374287+0000","last_unstale":"2023-09-30T22:22:02.380478+0000","last_undegraded":"2023-09-30T22:22:02.380478+0000","last_fullsized":"2023-09-30T22:22:02.380478+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.384882+0000","last_change":"2023-09-30T22:22:02.375916+0000","last_active":"2023-09-30T22:22:02.384882+0000","last_peered":"2023-09-30T22:22:02.384882+0000","last_clean":"2023-09-30T22:22:02.384882+0000","last_became_active":"2023-09-30T22:22:02.374277+0000","last_became_peered":"2023-09-30T22:22:02.374277+0000","last_unstale":"2023-09-30T22:22:02.384882+0000","last_undegraded":"2023-09-30T22:22:02.384882+0000","last_fullsized":"2023-09-30T22:22:02.384882+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.395070+0000","last_change":"2023-09-30T22:22:02.391303+0000","last_active":"2023-09-30T22:22:02.395070+0000","last_peered":"2023-09-30T22:22:02.395070+0000","last_clean":"2023-09-30T22:22:02.395070+0000","last_became_active":"2023-09-30T22:22:02.388602+0000","last_became_peered":"2023-09-30T22:22:02.388602+0000","last_unstale":"2023-09-30T22:22:02.395070+0000","last_undegraded":"2023-09-30T22:22:02.395070+0000","last_fullsized":"2023-09-30T22:22:02.395070+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385063+0000","last_change":"2023-09-30T22:22:02.376471+0000","last_active":"2023-09-30T22:22:02.385063+0000","last_peered":"2023-09-30T22:22:02.385063+0000","last_clean":"2023-09-30T22:22:02.385063+0000","last_became_active":"2023-09-30T22:22:02.374833+0000","last_became_peered":"2023-09-30T22:22:02.374833+0000","last_unstale":"2023-09-30T22:22:02.385063+0000","last_undegraded":"2023-09-30T22:22:02.385063+0000","last_fullsized":"2023-09-30T22:22:02.385063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394501+0000","last_change":"2023-09-30T22:22:02.388315+0000","last_active":"2023-09-30T22:22:02.394501+0000","last_peered":"2023-09-30T22:22:02.394501+0000","last_clean":"2023-09-30T22:22:02.394501+0000","last_became_active":"2023-09-30T22:22:02.388046+0000","last_became_peered":"2023-09-30T22:22:02.388046+0000","last_unstale":"2023-09-30T22:22:02.394501+0000","last_undegraded":"2023-09-30T22:22:02.394501+0000","last_fullsized":"2023-09-30T22:22:02.394501+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.395152+0000","last_change":"2023-09-30T22:22:02.391309+0000","last_active":"2023-09-30T22:22:02.395152+0000","last_peered":"2023-09-30T22:22:02.395152+0000","last_clean":"2023-09-30T22:22:02.395152+0000","last_became_active":"2023-09-30T22:22:02.391040+0000","last_became_peered":"2023-09-30T22:22:02.391040+0000","last_unstale":"2023-09-30T22:22:02.395152+0000","last_undegraded":"2023-09-30T22:22:02.395152+0000","last_fullsized":"2023-09-30T22:22:02.395152+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.384855+0000","last_change":"2023-09-30T22:22:02.375857+0000","last_active":"2023-09-30T22:22:02.384855+0000","last_peered":"2023-09-30T22:22:02.384855+0000","last_clean":"2023-09-30T22:22:02.384855+0000","last_became_active":"2023-09-30T22:22:02.373866+0000","last_became_peered":"2023-09-30T22:22:02.373866+0000","last_unstale":"2023-09-30T22:22:02.384855+0000","last_undegraded":"2023-09-30T22:22:02.384855+0000","last_fullsized":"2023-09-30T22:22:02.384855+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394655+0000","last_change":"2023-09-30T22:22:02.389818+0000","last_active":"2023-09-30T22:22:02.394655+0000","last_peered":"2023-09-30T22:22:02.394655+0000","last_clean":"2023-09-30T22:22:02.394655+0000","last_became_active":"2023-09-30T22:22:02.389526+0000","last_became_peered":"2023-09-30T22:22:02.389526+0000","last_unstale":"2023-09-30T22:22:02.394655+0000","last_undegraded":"2023-09-30T22:22:02.394655+0000","last_fullsized":"2023-09-30T22:22:02.394655+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394419+0000","last_change":"2023-09-30T22:22:02.386166+0000","last_active":"2023-09-30T22:22:02.394419+0000","last_peered":"2023-09-30T22:22:02.394419+0000","last_clean":"2023-09-30T22:22:02.394419+0000","last_became_active":"2023-09-30T22:22:02.385731+0000","last_became_peered":"2023-09-30T22:22:02.385731+0000","last_unstale":"2023-09-30T22:22:02.394419+0000","last_undegraded":"2023-09-30T22:22:02.394419+0000","last_fullsized":"2023-09-30T22:22:02.394419+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380502+0000","last_change":"2023-09-30T22:22:02.374713+0000","last_active":"2023-09-30T22:22:02.380502+0000","last_peered":"2023-09-30T22:22:02.380502+0000","last_clean":"2023-09-30T22:22:02.380502+0000","last_became_active":"2023-09-30T22:22:02.374467+0000","last_became_peered":"2023-09-30T22:22:02.374467+0000","last_unstale":"2023-09-30T22:22:02.380502+0000","last_undegraded":"2023-09-30T22:22:02.380502+0000","last_fullsized":"2023-09-30T22:22:02.380502+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.374558+0000","last_change":"2023-09-30T22:22:01.986896+0000","last_active":"2023-09-30T22:22:02.374558+0000","last_peered":"2023-09-30T22:22:02.374558+0000","last_clean":"2023-09-30T22:22:02.374558+0000","last_became_active":"2023-09-30T22:22:01.986600+0000","last_became_peered":"2023-09-30T22:22:01.986600+0000","last_unstale":"2023-09-30T22:22:02.374558+0000","last_undegraded":"2023-09-30T22:22:02.374558+0000","last_fullsized":"2023-09-30T22:22:02.374558+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.361691+0000","last_change":"2023-09-30T22:22:01.992230+0000","last_active":"2023-09-30T22:22:02.361691+0000","last_peered":"2023-09-30T22:22:02.361691+0000","last_clean":"2023-09-30T22:22:02.361691+0000","last_became_active":"2023-09-30T22:22:01.991929+0000","last_became_peered":"2023-09-30T22:22:01.991929+0000","last_unstale":"2023-09-30T22:22:02.361691+0000","last_undegraded":"2023-09-30T22:22:02.361691+0000","last_fullsized":"2023-09-30T22:22:02.361691+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385127+0000","last_change":"2023-09-30T22:22:02.380249+0000","last_active":"2023-09-30T22:22:02.385127+0000","last_peered":"2023-09-30T22:22:02.385127+0000","last_clean":"2023-09-30T22:22:02.385127+0000","last_became_active":"2023-09-30T22:22:02.379830+0000","last_became_peered":"2023-09-30T22:22:02.379830+0000","last_unstale":"2023-09-30T22:22:02.385127+0000","last_undegraded":"2023-09-30T22:22:02.385127+0000","last_fullsized":"2023-09-30T22:22:02.385127+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.364409+0000","last_change":"2023-09-30T22:22:01.997405+0000","last_active":"2023-09-30T22:22:02.364409+0000","last_peered":"2023-09-30T22:22:02.364409+0000","last_clean":"2023-09-30T22:22:02.364409+0000","last_became_active":"2023-09-30T22:22:01.997079+0000","last_became_peered":"2023-09-30T22:22:01.997079+0000","last_unstale":"2023-09-30T22:22:02.364409+0000","last_undegraded":"2023-09-30T22:22:02.364409+0000","last_fullsized":"2023-09-30T22:22:02.364409+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.398556+0000","last_change":"2023-09-30T22:22:01.998235+0000","last_active":"2023-09-30T22:22:02.398556+0000","last_peered":"2023-09-30T22:22:02.398556+0000","last_clean":"2023-09-30T22:22:02.398556+0000","last_became_active":"2023-09-30T22:22:01.997649+0000","last_became_peered":"2023-09-30T22:22:01.997649+0000","last_unstale":"2023-09-30T22:22:02.398556+0000","last_undegraded":"2023-09-30T22:22:02.398556+0000","last_fullsized":"2023-09-30T22:22:02.398556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394877+0000","last_change":"2023-09-30T22:22:02.390318+0000","last_active":"2023-09-30T22:22:02.394877+0000","last_peered":"2023-09-30T22:22:02.394877+0000","last_clean":"2023-09-30T22:22:02.394877+0000","last_became_active":"2023-09-30T22:22:02.390020+0000","last_became_peered":"2023-09-30T22:22:02.390020+0000","last_unstale":"2023-09-30T22:22:02.394877+0000","last_undegraded":"2023-09-30T22:22:02.394877+0000","last_fullsized":"2023-09-30T22:22:02.394877+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.360247+0000","last_change":"2023-09-30T22:22:01.997424+0000","last_active":"2023-09-30T22:22:02.360247+0000","last_peered":"2023-09-30T22:22:02.360247+0000","last_clean":"2023-09-30T22:22:02.360247+0000","last_became_active":"2023-09-30T22:22:01.997098+0000","last_became_peered":"2023-09-30T22:22:01.997098+0000","last_unstale":"2023-09-30T22:22:02.360247+0000","last_undegraded":"2023-09-30T22:22:02.360247+0000","last_fullsized":"2023-09-30T22:22:02.360247+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.395039+0000","last_change":"2023-09-30T22:22:02.391210+0000","last_active":"2023-09-30T22:22:02.395039+0000","last_peered":"2023-09-30T22:22:02.395039+0000","last_clean":"2023-09-30T22:22:02.395039+0000","last_became_active":"2023-09-30T22:22:02.390937+0000","last_became_peered":"2023-09-30T22:22:02.390937+0000","last_unstale":"2023-09-30T22:22:02.395039+0000","last_undegraded":"2023-09-30T22:22:02.395039+0000","last_fullsized":"2023-09-30T22:22:02.395039+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.389161+0000","last_change":"2023-09-30T22:22:01.974848+0000","last_active":"2023-09-30T22:22:02.389161+0000","last_peered":"2023-09-30T22:22:02.389161+0000","last_clean":"2023-09-30T22:22:02.389161+0000","last_became_active":"2023-09-30T22:22:01.974025+0000","last_became_peered":"2023-09-30T22:22:01.974025+0000","last_unstale":"2023-09-30T22:22:02.389161+0000","last_undegraded":"2023-09-30T22:22:02.389161+0000","last_fullsized":"2023-09-30T22:22:02.389161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393941+0000","last_change":"2023-09-30T22:22:01.979910+0000","last_active":"2023-09-30T22:22:02.393941+0000","last_peered":"2023-09-30T22:22:02.393941+0000","last_clean":"2023-09-30T22:22:02.393941+0000","last_became_active":"2023-09-30T22:22:01.979649+0000","last_became_peered":"2023-09-30T22:22:01.979649+0000","last_unstale":"2023-09-30T22:22:02.393941+0000","last_undegraded":"2023-09-30T22:22:02.393941+0000","last_fullsized":"2023-09-30T22:22:02.393941+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394816+0000","last_change":"2023-09-30T22:22:02.390201+0000","last_active":"2023-09-30T22:22:02.394816+0000","last_peered":"2023-09-30T22:22:02.394816+0000","last_clean":"2023-09-30T22:22:02.394816+0000","last_became_active":"2023-09-30T22:22:02.389897+0000","last_became_peered":"2023-09-30T22:22:02.389897+0000","last_unstale":"2023-09-30T22:22:02.394816+0000","last_undegraded":"2023-09-30T22:22:02.394816+0000","last_fullsized":"2023-09-30T22:22:02.394816+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.361009+0000","last_change":"2023-09-30T22:22:01.998688+0000","last_active":"2023-09-30T22:22:02.361009+0000","last_peered":"2023-09-30T22:22:02.361009+0000","last_clean":"2023-09-30T22:22:02.361009+0000","last_became_active":"2023-09-30T22:22:01.998390+0000","last_became_peered":"2023-09-30T22:22:01.998390+0000","last_unstale":"2023-09-30T22:22:02.361009+0000","last_undegraded":"2023-09-30T22:22:02.361009+0000","last_fullsized":"2023-09-30T22:22:02.361009+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385081+0000","last_change":"2023-09-30T22:22:02.376261+0000","last_active":"2023-09-30T22:22:02.385081+0000","last_peered":"2023-09-30T22:22:02.385081+0000","last_clean":"2023-09-30T22:22:02.385081+0000","last_became_active":"2023-09-30T22:22:02.375940+0000","last_became_peered":"2023-09-30T22:22:02.375940+0000","last_unstale":"2023-09-30T22:22:02.385081+0000","last_undegraded":"2023-09-30T22:22:02.385081+0000","last_fullsized":"2023-09-30T22:22:02.385081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394834+0000","last_change":"2023-09-30T22:22:02.390443+0000","last_active":"2023-09-30T22:22:02.394834+0000","last_peered":"2023-09-30T22:22:02.394834+0000","last_clean":"2023-09-30T22:22:02.394834+0000","last_became_active":"2023-09-30T22:22:02.390261+0000","last_became_peered":"2023-09-30T22:22:02.390261+0000","last_unstale":"2023-09-30T22:22:02.394834+0000","last_undegraded":"2023-09-30T22:22:02.394834+0000","last_fullsized":"2023-09-30T22:22:02.394834+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394399+0000","last_change":"2023-09-30T22:22:02.385985+0000","last_active":"2023-09-30T22:22:02.394399+0000","last_peered":"2023-09-30T22:22:02.394399+0000","last_clean":"2023-09-30T22:22:02.394399+0000","last_became_active":"2023-09-30T22:22:02.385413+0000","last_became_peered":"2023-09-30T22:22:02.385413+0000","last_unstale":"2023-09-30T22:22:02.394399+0000","last_undegraded":"2023-09-30T22:22:02.394399+0000","last_fullsized":"2023-09-30T22:22:02.394399+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.359640+0000","last_change":"2023-09-30T22:21:58.403636+0000","last_active":"2023-09-30T22:22:02.359640+0000","last_peered":"2023-09-30T22:22:02.359640+0000","last_clean":"2023-09-30T22:22:02.359640+0000","last_became_active":"2023-09-30T22:21:58.403342+0000","last_became_peered":"2023-09-30T22:21:58.403342+0000","last_unstale":"2023-09-30T22:22:02.359640+0000","last_undegraded":"2023-09-30T22:22:02.359640+0000","last_fullsized":"2023-09-30T22:22:02.359640+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394856+0000","last_change":"2023-09-30T22:22:02.389982+0000","last_active":"2023-09-30T22:22:02.394856+0000","last_peered":"2023-09-30T22:22:02.394856+0000","last_clean":"2023-09-30T22:22:02.394856+0000","last_became_active":"2023-09-30T22:22:02.389680+0000","last_became_peered":"2023-09-30T22:22:02.389680+0000","last_unstale":"2023-09-30T22:22:02.394856+0000","last_undegraded":"2023-09-30T22:22:02.394856+0000","last_fullsized":"2023-09-30T22:22:02.394856+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:21:57.843502+0000","last_change":"2023-09-30T22:21:57.839392+0000","last_active":"2023-09-30T22:21:57.843502+0000","last_peered":"2023-09-30T22:21:57.843502+0000","last_clean":"2023-09-30T22:21:57.843502+0000","last_became_active":"2023-09-30T22:21:57.838993+0000","last_became_peered":"2023-09-30T22:21:57.838993+0000","last_unstale":"2023-09-30T22:21:57.843502+0000","last_undegraded":"2023-09-30T22:21:57.843502+0000","last_fullsized":"2023-09-30T22:21:57.843502+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.363117+0000","last_change":"2023-09-30T22:22:01.990265+0000","last_active":"2023-09-30T22:22:02.363117+0000","last_peered":"2023-09-30T22:22:02.363117+0000","last_clean":"2023-09-30T22:22:02.363117+0000","last_became_active":"2023-09-30T22:22:01.990011+0000","last_became_peered":"2023-09-30T22:22:01.990011+0000","last_unstale":"2023-09-30T22:22:02.363117+0000","last_undegraded":"2023-09-30T22:22:02.363117+0000","last_fullsized":"2023-09-30T22:22:02.363117+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.383793+0000","last_change":"2023-09-30T22:22:02.374205+0000","last_active":"2023-09-30T22:22:02.383793+0000","last_peered":"2023-09-30T22:22:02.383793+0000","last_clean":"2023-09-30T22:22:02.383793+0000","last_became_active":"2023-09-30T22:22:02.373928+0000","last_became_peered":"2023-09-30T22:22:02.373928+0000","last_unstale":"2023-09-30T22:22:02.383793+0000","last_undegraded":"2023-09-30T22:22:02.383793+0000","last_fullsized":"2023-09-30T22:22:02.383793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:21:57.838143+0000","last_change":"2023-09-30T22:21:57.836160+0000","last_active":"2023-09-30T22:21:57.838143+0000","last_peered":"2023-09-30T22:21:57.838143+0000","last_clean":"2023-09-30T22:21:57.838143+0000","last_became_active":"2023-09-30T22:21:57.835792+0000","last_became_peered":"2023-09-30T22:21:57.835792+0000","last_unstale":"2023-09-30T22:21:57.838143+0000","last_undegraded":"2023-09-30T22:21:57.838143+0000","last_fullsized":"2023-09-30T22:21:57.838143+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.359810+0000","last_change":"2023-09-30T22:22:01.987700+0000","last_active":"2023-09-30T22:22:02.359810+0000","last_peered":"2023-09-30T22:22:02.359810+0000","last_clean":"2023-09-30T22:22:02.359810+0000","last_became_active":"2023-09-30T22:22:01.987358+0000","last_became_peered":"2023-09-30T22:22:01.987358+0000","last_unstale":"2023-09-30T22:22:02.359810+0000","last_undegraded":"2023-09-30T22:22:02.359810+0000","last_fullsized":"2023-09-30T22:22:02.359810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.382010+0000","last_change":"2023-09-30T22:22:02.379845+0000","last_active":"2023-09-30T22:22:02.382010+0000","last_peered":"2023-09-30T22:22:02.382010+0000","last_clean":"2023-09-30T22:22:02.382010+0000","last_became_active":"2023-09-30T22:22:02.379594+0000","last_became_peered":"2023-09-30T22:22:02.379594+0000","last_unstale":"2023-09-30T22:22:02.382010+0000","last_undegraded":"2023-09-30T22:22:02.382010+0000","last_fullsized":"2023-09-30T22:22:02.382010+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:21:57.843463+0000","last_change":"2023-09-30T22:21:57.838957+0000","last_active":"2023-09-30T22:21:57.843463+0000","last_peered":"2023-09-30T22:21:57.843463+0000","last_clean":"2023-09-30T22:21:57.843463+0000","last_became_active":"2023-09-30T22:21:57.838667+0000","last_became_peered":"2023-09-30T22:21:57.838667+0000","last_unstale":"2023-09-30T22:21:57.843463+0000","last_undegraded":"2023-09-30T22:21:57.843463+0000","last_fullsized":"2023-09-30T22:21:57.843463+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.359529+0000","last_change":"2023-09-30T22:21:56.838072+0000","last_active":"2023-09-30T22:22:02.359529+0000","last_peered":"2023-09-30T22:22:02.359529+0000","last_clean":"2023-09-30T22:22:02.359529+0000","last_became_active":"2023-09-30T22:21:56.837717+0000","last_became_peered":"2023-09-30T22:21:56.837717+0000","last_unstale":"2023-09-30T22:22:02.359529+0000","last_undegraded":"2023-09-30T22:22:02.359529+0000","last_fullsized":"2023-09-30T22:22:02.359529+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:55.823939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:55.823939+0000","last_clean_scrub_stamp":"2023-09-30T22:21:55.823939+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:21:57.840884+0000","last_change":"2023-09-30T22:21:57.837598+0000","last_active":"2023-09-30T22:21:57.840884+0000","last_peered":"2023-09-30T22:21:57.840884+0000","last_clean":"2023-09-30T22:21:57.840884+0000","last_became_active":"2023-09-30T22:21:57.837284+0000","last_became_peered":"2023-09-30T22:21:57.837284+0000","last_unstale":"2023-09-30T22:21:57.840884+0000","last_undegraded":"2023-09-30T22:21:57.840884+0000","last_fullsized":"2023-09-30T22:21:57.840884+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.364183+0000","last_change":"2023-09-30T22:22:01.983059+0000","last_active":"2023-09-30T22:22:02.364183+0000","last_peered":"2023-09-30T22:22:02.364183+0000","last_clean":"2023-09-30T22:22:02.364183+0000","last_became_active":"2023-09-30T22:22:01.982739+0000","last_became_peered":"2023-09-30T22:22:01.982739+0000","last_unstale":"2023-09-30T22:22:02.364183+0000","last_undegraded":"2023-09-30T22:22:02.364183+0000","last_fullsized":"2023-09-30T22:22:02.364183+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385106+0000","last_change":"2023-09-30T22:22:02.380074+0000","last_active":"2023-09-30T22:22:02.385106+0000","last_peered":"2023-09-30T22:22:02.385106+0000","last_clean":"2023-09-30T22:22:02.385106+0000","last_became_active":"2023-09-30T22:22:02.379501+0000","last_became_peered":"2023-09-30T22:22:02.379501+0000","last_unstale":"2023-09-30T22:22:02.385106+0000","last_undegraded":"2023-09-30T22:22:02.385106+0000","last_fullsized":"2023-09-30T22:22:02.385106+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:21:58.404324+0000","last_change":"2023-09-30T22:21:58.403508+0000","last_active":"2023-09-30T22:21:58.404324+0000","last_peered":"2023-09-30T22:21:58.404324+0000","last_clean":"2023-09-30T22:21:58.404324+0000","last_became_active":"2023-09-30T22:21:58.403267+0000","last_became_peered":"2023-09-30T22:21:58.403267+0000","last_unstale":"2023-09-30T22:21:58.404324+0000","last_undegraded":"2023-09-30T22:21:58.404324+0000","last_fullsized":"2023-09-30T22:21:58.404324+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.359534+0000","last_change":"2023-09-30T22:22:01.987265+0000","last_active":"2023-09-30T22:22:02.359534+0000","last_peered":"2023-09-30T22:22:02.359534+0000","last_clean":"2023-09-30T22:22:02.359534+0000","last_became_active":"2023-09-30T22:22:01.986968+0000","last_became_peered":"2023-09-30T22:22:01.986968+0000","last_unstale":"2023-09-30T22:22:02.359534+0000","last_undegraded":"2023-09-30T22:22:02.359534+0000","last_fullsized":"2023-09-30T22:22:02.359534+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385062+0000","last_change":"2023-09-30T22:22:02.376013+0000","last_active":"2023-09-30T22:22:02.385062+0000","last_peered":"2023-09-30T22:22:02.385062+0000","last_clean":"2023-09-30T22:22:02.385062+0000","last_became_active":"2023-09-30T22:22:02.374252+0000","last_became_peered":"2023-09-30T22:22:02.374252+0000","last_unstale":"2023-09-30T22:22:02.385062+0000","last_undegraded":"2023-09-30T22:22:02.385062+0000","last_fullsized":"2023-09-30T22:22:02.385062+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.360873+0000","last_change":"2023-09-30T22:21:58.403570+0000","last_active":"2023-09-30T22:22:02.360873+0000","last_peered":"2023-09-30T22:22:02.360873+0000","last_clean":"2023-09-30T22:22:02.360873+0000","last_became_active":"2023-09-30T22:21:58.403321+0000","last_became_peered":"2023-09-30T22:21:58.403321+0000","last_unstale":"2023-09-30T22:22:02.360873+0000","last_undegraded":"2023-09-30T22:22:02.360873+0000","last_fullsized":"2023-09-30T22:22:02.360873+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:21:58.409868+0000","last_change":"2023-09-30T22:21:58.404380+0000","last_active":"2023-09-30T22:21:58.409868+0000","last_peered":"2023-09-30T22:21:58.409868+0000","last_clean":"2023-09-30T22:21:58.409868+0000","last_became_active":"2023-09-30T22:21:58.404098+0000","last_became_peered":"2023-09-30T22:21:58.404098+0000","last_unstale":"2023-09-30T22:21:58.409868+0000","last_undegraded":"2023-09-30T22:21:58.409868+0000","last_fullsized":"2023-09-30T22:21:58.409868+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.366010+0000","last_change":"2023-09-30T22:22:01.977163+0000","last_active":"2023-09-30T22:22:02.366010+0000","last_peered":"2023-09-30T22:22:02.366010+0000","last_clean":"2023-09-30T22:22:02.366010+0000","last_became_active":"2023-09-30T22:22:01.976494+0000","last_became_peered":"2023-09-30T22:22:01.976494+0000","last_unstale":"2023-09-30T22:22:02.366010+0000","last_undegraded":"2023-09-30T22:22:02.366010+0000","last_fullsized":"2023-09-30T22:22:02.366010+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.398231+0000","last_change":"2023-09-30T22:22:01.997989+0000","last_active":"2023-09-30T22:22:02.398231+0000","last_peered":"2023-09-30T22:22:02.398231+0000","last_clean":"2023-09-30T22:22:02.398231+0000","last_became_active":"2023-09-30T22:22:01.997419+0000","last_became_peered":"2023-09-30T22:22:01.997419+0000","last_unstale":"2023-09-30T22:22:02.398231+0000","last_undegraded":"2023-09-30T22:22:02.398231+0000","last_fullsized":"2023-09-30T22:22:02.398231+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380701+0000","last_change":"2023-09-30T22:22:01.977515+0000","last_active":"2023-09-30T22:22:02.380701+0000","last_peered":"2023-09-30T22:22:02.380701+0000","last_clean":"2023-09-30T22:22:02.380701+0000","last_became_active":"2023-09-30T22:22:01.976843+0000","last_became_peered":"2023-09-30T22:22:01.976843+0000","last_unstale":"2023-09-30T22:22:02.380701+0000","last_undegraded":"2023-09-30T22:22:02.380701+0000","last_fullsized":"2023-09-30T22:22:02.380701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.386441+0000","last_change":"2023-09-30T22:22:01.980853+0000","last_active":"2023-09-30T22:22:02.386441+0000","last_peered":"2023-09-30T22:22:02.386441+0000","last_clean":"2023-09-30T22:22:02.386441+0000","last_became_active":"2023-09-30T22:22:01.979795+0000","last_became_peered":"2023-09-30T22:22:01.979795+0000","last_unstale":"2023-09-30T22:22:02.386441+0000","last_undegraded":"2023-09-30T22:22:02.386441+0000","last_fullsized":"2023-09-30T22:22:02.386441+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380254+0000","last_change":"2023-09-30T22:22:02.373820+0000","last_active":"2023-09-30T22:22:02.380254+0000","last_peered":"2023-09-30T22:22:02.380254+0000","last_clean":"2023-09-30T22:22:02.380254+0000","last_became_active":"2023-09-30T22:22:02.373530+0000","last_became_peered":"2023-09-30T22:22:02.373530+0000","last_unstale":"2023-09-30T22:22:02.380254+0000","last_undegraded":"2023-09-30T22:22:02.380254+0000","last_fullsized":"2023-09-30T22:22:02.380254+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394694+0000","last_change":"2023-09-30T22:22:02.387890+0000","last_active":"2023-09-30T22:22:02.394694+0000","last_peered":"2023-09-30T22:22:02.394694+0000","last_clean":"2023-09-30T22:22:02.394694+0000","last_became_active":"2023-09-30T22:22:02.387599+0000","last_became_peered":"2023-09-30T22:22:02.387599+0000","last_unstale":"2023-09-30T22:22:02.394694+0000","last_undegraded":"2023-09-30T22:22:02.394694+0000","last_fullsized":"2023-09-30T22:22:02.394694+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.383770+0000","last_change":"2023-09-30T22:22:02.374216+0000","last_active":"2023-09-30T22:22:02.383770+0000","last_peered":"2023-09-30T22:22:02.383770+0000","last_clean":"2023-09-30T22:22:02.383770+0000","last_became_active":"2023-09-30T22:22:02.373952+0000","last_became_peered":"2023-09-30T22:22:02.373952+0000","last_unstale":"2023-09-30T22:22:02.383770+0000","last_undegraded":"2023-09-30T22:22:02.383770+0000","last_fullsized":"2023-09-30T22:22:02.383770+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":2},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":666,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":32,"acting":32,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":30204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705666,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":30204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":46930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":47845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T22:22:06.730 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:22:06.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.886+0000 7f1484868700 1 Processor -- start 2023-09-30T22:22:06.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.886+0000 7f1484868700 1 -- start start 2023-09-30T22:22:06.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.887+0000 7f1484868700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1480093930 0x7f14800957b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:06.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.887+0000 7f1484868700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1480095ca0 0x7f14800960a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:06.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.887+0000 7f1484868700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14800940d0 con 0x7f148012c2f0 2023-09-30T22:22:06.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.887+0000 7f1484868700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1480093d10 con 0x7f1480095ca0 2023-09-30T22:22:06.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.887+0000 7f1484868700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1480094b30 con 0x7f1480093930 2023-09-30T22:22:06.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.887+0000 7f147e59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1480093930 0x7f14800957b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:06.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.887+0000 7f147ed9d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f148012c2f0 0x7f148012e6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49392/0 (socket says 172.21.15.40:49392) 2023-09-30T22:22:06.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.887+0000 7f147ed9d700 1 -- 172.21.15.40:0/2010765419 learned_addr learned my addr 172.21.15.40:0/2010765419 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:22:06.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.887+0000 7f147dd9b700 1 --2- 172.21.15.40:0/2010765419 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1480095ca0 0x7f14800960a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:06.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.888+0000 7f147d59a700 1 -- 172.21.15.40:0/2010765419 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3644947672 0 0) 0x7f14800940d0 con 0x7f148012c2f0 2023-09-30T22:22:06.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.888+0000 7f147d59a700 1 -- 172.21.15.40:0/2010765419 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14680033f0 con 0x7f148012c2f0 2023-09-30T22:22:06.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.888+0000 7f147e59c700 1 -- 172.21.15.40:0/2010765419 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1480095ca0 msgr2=0x7f14800960a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:06.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.888+0000 7f147e59c700 1 --2- 172.21.15.40:0/2010765419 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1480095ca0 0x7f14800960a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:06.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.888+0000 7f147e59c700 1 -- 172.21.15.40:0/2010765419 >> v1:172.21.15.40:6789/0 conn(0x7f148012c2f0 legacy=0x7f148012e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:06.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.888+0000 7f147e59c700 1 -- 172.21.15.40:0/2010765419 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1480091a40 con 0x7f1480093930 2023-09-30T22:22:06.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.888+0000 7f147dd9b700 1 --2- 172.21.15.40:0/2010765419 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1480095ca0 0x7f14800960a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:06.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.888+0000 7f147e59c700 1 --2- 172.21.15.40:0/2010765419 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1480093930 0x7f14800957b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f1474009790 tx=0x7f1474009060).ready entity=mon.2 client_cookie=6923abe125458621 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:06.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.888+0000 7f147d59a700 1 -- 172.21.15.40:0/2010765419 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14740090d0 con 0x7f1480093930 2023-09-30T22:22:06.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.888+0000 7f147d59a700 1 -- 172.21.15.40:0/2010765419 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147400f510 con 0x7f1480093930 2023-09-30T22:22:06.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.888+0000 7f147d59a700 1 -- 172.21.15.40:0/2010765419 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147400f890 con 0x7f1480093930 2023-09-30T22:22:06.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.889+0000 7f1484868700 1 -- 172.21.15.40:0/2010765419 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1480093930 msgr2=0x7f14800957b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:06.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.889+0000 7f1484868700 1 --2- 172.21.15.40:0/2010765419 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1480093930 0x7f14800957b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f1474009790 tx=0x7f1474009060).stop 2023-09-30T22:22:06.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.889+0000 7f1484868700 1 -- 172.21.15.40:0/2010765419 shutdown_connections 2023-09-30T22:22:06.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.889+0000 7f1484868700 1 --2- 172.21.15.40:0/2010765419 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1480093930 0x7f14800957b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:06.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.889+0000 7f1484868700 1 --2- 172.21.15.40:0/2010765419 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1480095ca0 0x7f14800960a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:06.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.889+0000 7f1484868700 1 -- 172.21.15.40:0/2010765419 >> 172.21.15.40:0/2010765419 conn(0x7f1480097580 msgr2=0x7f1480097990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:06.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.889+0000 7f1484868700 1 -- 172.21.15.40:0/2010765419 shutdown_connections 2023-09-30T22:22:06.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.889+0000 7f1484868700 1 -- 172.21.15.40:0/2010765419 wait complete. 2023-09-30T22:22:06.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.890+0000 7f1484868700 1 Processor -- start 2023-09-30T22:22:06.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.890+0000 7f1484868700 1 -- start start 2023-09-30T22:22:06.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.890+0000 7f1484868700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1480093930 0x7f148012bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:06.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.890+0000 7f1484868700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1480095ca0 0x7f1480111c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:06.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.890+0000 7f1484868700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f148012c2f0 0x7f1480112170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:06.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.890+0000 7f1484868700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1480116100 con 0x7f148012c2f0 2023-09-30T22:22:06.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.890+0000 7f1484868700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1480115ce0 con 0x7f1480095ca0 2023-09-30T22:22:06.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.890+0000 7f1484868700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f148006a6b0 con 0x7f1480093930 2023-09-30T22:22:06.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.890+0000 7f147dd9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1480095ca0 0x7f1480111c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:06.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.890+0000 7f147e59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1480093930 0x7f148012bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:06.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.890+0000 7f147dd9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1480095ca0 0x7f1480111c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:46672/0 (socket says 172.21.15.40:46672) 2023-09-30T22:22:06.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.890+0000 7f147dd9b700 1 -- 172.21.15.40:0/2069678657 learned_addr learned my addr 172.21.15.40:0/2069678657 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:06.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.890+0000 7f147ed9d700 1 --2- 172.21.15.40:0/2069678657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f148012c2f0 0x7f1480112170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:06.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.890+0000 7f147dd9b700 1 -- 172.21.15.40:0/2069678657 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1480093930 msgr2=0x7f148012bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:06.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.890+0000 7f147dd9b700 1 --2- 172.21.15.40:0/2069678657 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1480093930 0x7f148012bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:06.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.890+0000 7f147dd9b700 1 -- 172.21.15.40:0/2069678657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f148012c2f0 msgr2=0x7f1480112170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:06.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.890+0000 7f147dd9b700 1 --2- 172.21.15.40:0/2069678657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f148012c2f0 0x7f1480112170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:06.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.890+0000 7f147dd9b700 1 -- 172.21.15.40:0/2069678657 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14700092a0 con 0x7f1480095ca0 2023-09-30T22:22:06.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.890+0000 7f147e59c700 1 --2- 172.21.15.40:0/2069678657 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1480093930 0x7f148012bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:06.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.890+0000 7f147ed9d700 1 --2- 172.21.15.40:0/2069678657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f148012c2f0 0x7f1480112170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:22:06.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.891+0000 7f147dd9b700 1 --2- 172.21.15.40:0/2069678657 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1480095ca0 0x7f1480111c80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f147000e9d0 tx=0x7f1470009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:06.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.891+0000 7f146e7fc700 1 -- 172.21.15.40:0/2069678657 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147000eec0 con 0x7f1480095ca0 2023-09-30T22:22:06.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.891+0000 7f146e7fc700 1 -- 172.21.15.40:0/2069678657 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1470009600 con 0x7f1480095ca0 2023-09-30T22:22:06.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.891+0000 7f1484868700 1 -- 172.21.15.40:0/2069678657 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14740092a0 con 0x7f1480095ca0 2023-09-30T22:22:06.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.891+0000 7f146e7fc700 1 -- 172.21.15.40:0/2069678657 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147000ca60 con 0x7f1480095ca0 2023-09-30T22:22:06.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.891+0000 7f1484868700 1 -- 172.21.15.40:0/2069678657 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1480115180 con 0x7f1480095ca0 2023-09-30T22:22:06.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.891+0000 7f146e7fc700 1 -- 172.21.15.40:0/2069678657 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f147001b400 con 0x7f1480095ca0 2023-09-30T22:22:06.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.892+0000 7f146e7fc700 1 -- 172.21.15.40:0/2069678657 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f147003b500 con 0x7f1480095ca0 2023-09-30T22:22:06.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.892+0000 7f1484868700 1 -- 172.21.15.40:0/2069678657 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1480097cf0 con 0x7f1480095ca0 2023-09-30T22:22:06.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:06.896+0000 7f146e7fc700 1 -- 172.21.15.40:0/2069678657 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f1470016070 con 0x7f1480095ca0 2023-09-30T22:22:07.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.059+0000 7f1484868700 1 -- 172.21.15.40:0/2069678657 --> v1:172.21.15.40:6816/118905 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f14801153a0 con 0x7f146002bb60 2023-09-30T22:22:07.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.065+0000 7f146e7fc700 1 -- 172.21.15.40:0/2069678657 <== mgr.4101 v1:172.21.15.40:6816/118905 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246257 (unknown 2965378022 0 717089435) 0x7f1474000bc0 con 0x7f146002bb60 2023-09-30T22:22:07.067 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:22:07.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.068+0000 7f1484868700 1 -- 172.21.15.40:0/2069678657 >> v1:172.21.15.40:6816/118905 conn(0x7f146002bb60 legacy=0x7f146002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:07.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.068+0000 7f1484868700 1 -- 172.21.15.40:0/2069678657 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1480095ca0 msgr2=0x7f1480111c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:07.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.068+0000 7f1484868700 1 --2- 172.21.15.40:0/2069678657 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1480095ca0 0x7f1480111c80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f147000e9d0 tx=0x7f1470009060).stop 2023-09-30T22:22:07.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.068+0000 7f1484868700 1 -- 172.21.15.40:0/2069678657 shutdown_connections 2023-09-30T22:22:07.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.068+0000 7f1484868700 1 --2- 172.21.15.40:0/2069678657 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1480093930 0x7f148012bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:07.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.068+0000 7f1484868700 1 --2- 172.21.15.40:0/2069678657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f148012c2f0 0x7f1480112170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:07.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.068+0000 7f1484868700 1 --2- 172.21.15.40:0/2069678657 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1480095ca0 0x7f1480111c80 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:07.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.068+0000 7f1484868700 1 -- 172.21.15.40:0/2069678657 >> 172.21.15.40:0/2069678657 conn(0x7f1480097580 msgr2=0x7f1480068bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:07.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.068+0000 7f1484868700 1 -- 172.21.15.40:0/2069678657 shutdown_connections 2023-09-30T22:22:07.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.068+0000 7f1484868700 1 -- 172.21.15.40:0/2069678657 wait complete. 2023-09-30T22:22:07.070 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-09-30T22:22:07.079 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-09-30T22:22:05.775335+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":666,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":114,"acting":114,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188920,"kb_used_data":536,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298440,"statfs":{"total":386547056640,"available":385329602560,"internally_reserved":0,"allocated":548864,"data_stored":155183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385151+0000","last_change":"2023-09-30T22:22:02.379022+0000","last_active":"2023-09-30T22:22:02.385151+0000","last_peered":"2023-09-30T22:22:02.385151+0000","last_clean":"2023-09-30T22:22:02.385151+0000","last_became_active":"2023-09-30T22:22:02.378723+0000","last_became_peered":"2023-09-30T22:22:02.378723+0000","last_unstale":"2023-09-30T22:22:02.385151+0000","last_undegraded":"2023-09-30T22:22:02.385151+0000","last_fullsized":"2023-09-30T22:22:02.385151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385016+0000","last_change":"2023-09-30T22:22:02.378089+0000","last_active":"2023-09-30T22:22:02.385016+0000","last_peered":"2023-09-30T22:22:02.385016+0000","last_clean":"2023-09-30T22:22:02.385016+0000","last_became_active":"2023-09-30T22:22:02.375446+0000","last_became_peered":"2023-09-30T22:22:02.375446+0000","last_unstale":"2023-09-30T22:22:02.385016+0000","last_undegraded":"2023-09-30T22:22:02.385016+0000","last_fullsized":"2023-09-30T22:22:02.385016+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.402864+0000","last_change":"2023-09-30T22:22:02.398073+0000","last_active":"2023-09-30T22:22:02.402864+0000","last_peered":"2023-09-30T22:22:02.402864+0000","last_clean":"2023-09-30T22:22:02.402864+0000","last_became_active":"2023-09-30T22:22:02.397855+0000","last_became_peered":"2023-09-30T22:22:02.397855+0000","last_unstale":"2023-09-30T22:22:02.402864+0000","last_undegraded":"2023-09-30T22:22:02.402864+0000","last_fullsized":"2023-09-30T22:22:02.402864+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393512+0000","last_change":"2023-09-30T22:22:02.382627+0000","last_active":"2023-09-30T22:22:02.393512+0000","last_peered":"2023-09-30T22:22:02.393512+0000","last_clean":"2023-09-30T22:22:02.393512+0000","last_became_active":"2023-09-30T22:22:02.382360+0000","last_became_peered":"2023-09-30T22:22:02.382360+0000","last_unstale":"2023-09-30T22:22:02.393512+0000","last_undegraded":"2023-09-30T22:22:02.393512+0000","last_fullsized":"2023-09-30T22:22:02.393512+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394788+0000","last_change":"2023-09-30T22:22:02.388864+0000","last_active":"2023-09-30T22:22:02.394788+0000","last_peered":"2023-09-30T22:22:02.394788+0000","last_clean":"2023-09-30T22:22:02.394788+0000","last_became_active":"2023-09-30T22:22:02.388267+0000","last_became_peered":"2023-09-30T22:22:02.388267+0000","last_unstale":"2023-09-30T22:22:02.394788+0000","last_undegraded":"2023-09-30T22:22:02.394788+0000","last_fullsized":"2023-09-30T22:22:02.394788+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380523+0000","last_change":"2023-09-30T22:22:02.379619+0000","last_active":"2023-09-30T22:22:02.380523+0000","last_peered":"2023-09-30T22:22:02.380523+0000","last_clean":"2023-09-30T22:22:02.380523+0000","last_became_active":"2023-09-30T22:22:02.379412+0000","last_became_peered":"2023-09-30T22:22:02.379412+0000","last_unstale":"2023-09-30T22:22:02.380523+0000","last_undegraded":"2023-09-30T22:22:02.380523+0000","last_fullsized":"2023-09-30T22:22:02.380523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.377473+0000","last_change":"2023-09-30T22:22:02.372757+0000","last_active":"2023-09-30T22:22:02.377473+0000","last_peered":"2023-09-30T22:22:02.377473+0000","last_clean":"2023-09-30T22:22:02.377473+0000","last_became_active":"2023-09-30T22:22:02.372495+0000","last_became_peered":"2023-09-30T22:22:02.372495+0000","last_unstale":"2023-09-30T22:22:02.377473+0000","last_undegraded":"2023-09-30T22:22:02.377473+0000","last_fullsized":"2023-09-30T22:22:02.377473+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380478+0000","last_change":"2023-09-30T22:22:02.374488+0000","last_active":"2023-09-30T22:22:02.380478+0000","last_peered":"2023-09-30T22:22:02.380478+0000","last_clean":"2023-09-30T22:22:02.380478+0000","last_became_active":"2023-09-30T22:22:02.374287+0000","last_became_peered":"2023-09-30T22:22:02.374287+0000","last_unstale":"2023-09-30T22:22:02.380478+0000","last_undegraded":"2023-09-30T22:22:02.380478+0000","last_fullsized":"2023-09-30T22:22:02.380478+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.384882+0000","last_change":"2023-09-30T22:22:02.375916+0000","last_active":"2023-09-30T22:22:02.384882+0000","last_peered":"2023-09-30T22:22:02.384882+0000","last_clean":"2023-09-30T22:22:02.384882+0000","last_became_active":"2023-09-30T22:22:02.374277+0000","last_became_peered":"2023-09-30T22:22:02.374277+0000","last_unstale":"2023-09-30T22:22:02.384882+0000","last_undegraded":"2023-09-30T22:22:02.384882+0000","last_fullsized":"2023-09-30T22:22:02.384882+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.395070+0000","last_change":"2023-09-30T22:22:02.391303+0000","last_active":"2023-09-30T22:22:02.395070+0000","last_peered":"2023-09-30T22:22:02.395070+0000","last_clean":"2023-09-30T22:22:02.395070+0000","last_became_active":"2023-09-30T22:22:02.388602+0000","last_became_peered":"2023-09-30T22:22:02.388602+0000","last_unstale":"2023-09-30T22:22:02.395070+0000","last_undegraded":"2023-09-30T22:22:02.395070+0000","last_fullsized":"2023-09-30T22:22:02.395070+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385063+0000","last_change":"2023-09-30T22:22:02.376471+0000","last_active":"2023-09-30T22:22:02.385063+0000","last_peered":"2023-09-30T22:22:02.385063+0000","last_clean":"2023-09-30T22:22:02.385063+0000","last_became_active":"2023-09-30T22:22:02.374833+0000","last_became_peered":"2023-09-30T22:22:02.374833+0000","last_unstale":"2023-09-30T22:22:02.385063+0000","last_undegraded":"2023-09-30T22:22:02.385063+0000","last_fullsized":"2023-09-30T22:22:02.385063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394501+0000","last_change":"2023-09-30T22:22:02.388315+0000","last_active":"2023-09-30T22:22:02.394501+0000","last_peered":"2023-09-30T22:22:02.394501+0000","last_clean":"2023-09-30T22:22:02.394501+0000","last_became_active":"2023-09-30T22:22:02.388046+0000","last_became_peered":"2023-09-30T22:22:02.388046+0000","last_unstale":"2023-09-30T22:22:02.394501+0000","last_undegraded":"2023-09-30T22:22:02.394501+0000","last_fullsized":"2023-09-30T22:22:02.394501+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.395152+0000","last_change":"2023-09-30T22:22:02.391309+0000","last_active":"2023-09-30T22:22:02.395152+0000","last_peered":"2023-09-30T22:22:02.395152+0000","last_clean":"2023-09-30T22:22:02.395152+0000","last_became_active":"2023-09-30T22:22:02.391040+0000","last_became_peered":"2023-09-30T22:22:02.391040+0000","last_unstale":"2023-09-30T22:22:02.395152+0000","last_undegraded":"2023-09-30T22:22:02.395152+0000","last_fullsized":"2023-09-30T22:22:02.395152+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.384855+0000","last_change":"2023-09-30T22:22:02.375857+0000","last_active":"2023-09-30T22:22:02.384855+0000","last_peered":"2023-09-30T22:22:02.384855+0000","last_clean":"2023-09-30T22:22:02.384855+0000","last_became_active":"2023-09-30T22:22:02.373866+0000","last_became_peered":"2023-09-30T22:22:02.373866+0000","last_unstale":"2023-09-30T22:22:02.384855+0000","last_undegraded":"2023-09-30T22:22:02.384855+0000","last_fullsized":"2023-09-30T22:22:02.384855+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394655+0000","last_change":"2023-09-30T22:22:02.389818+0000","last_active":"2023-09-30T22:22:02.394655+0000","last_peered":"2023-09-30T22:22:02.394655+0000","last_clean":"2023-09-30T22:22:02.394655+0000","last_became_active":"2023-09-30T22:22:02.389526+0000","last_became_peered":"2023-09-30T22:22:02.389526+0000","last_unstale":"2023-09-30T22:22:02.394655+0000","last_undegraded":"2023-09-30T22:22:02.394655+0000","last_fullsized":"2023-09-30T22:22:02.394655+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394419+0000","last_change":"2023-09-30T22:22:02.386166+0000","last_active":"2023-09-30T22:22:02.394419+0000","last_peered":"2023-09-30T22:22:02.394419+0000","last_clean":"2023-09-30T22:22:02.394419+0000","last_became_active":"2023-09-30T22:22:02.385731+0000","last_became_peered":"2023-09-30T22:22:02.385731+0000","last_unstale":"2023-09-30T22:22:02.394419+0000","last_undegraded":"2023-09-30T22:22:02.394419+0000","last_fullsized":"2023-09-30T22:22:02.394419+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380502+0000","last_change":"2023-09-30T22:22:02.374713+0000","last_active":"2023-09-30T22:22:02.380502+0000","last_peered":"2023-09-30T22:22:02.380502+0000","last_clean":"2023-09-30T22:22:02.380502+0000","last_became_active":"2023-09-30T22:22:02.374467+0000","last_became_peered":"2023-09-30T22:22:02.374467+0000","last_unstale":"2023-09-30T22:22:02.380502+0000","last_undegraded":"2023-09-30T22:22:02.380502+0000","last_fullsized":"2023-09-30T22:22:02.380502+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.374558+0000","last_change":"2023-09-30T22:22:01.986896+0000","last_active":"2023-09-30T22:22:02.374558+0000","last_peered":"2023-09-30T22:22:02.374558+0000","last_clean":"2023-09-30T22:22:02.374558+0000","last_became_active":"2023-09-30T22:22:01.986600+0000","last_became_peered":"2023-09-30T22:22:01.986600+0000","last_unstale":"2023-09-30T22:22:02.374558+0000","last_undegraded":"2023-09-30T22:22:02.374558+0000","last_fullsized":"2023-09-30T22:22:02.374558+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.361691+0000","last_change":"2023-09-30T22:22:01.992230+0000","last_active":"2023-09-30T22:22:02.361691+0000","last_peered":"2023-09-30T22:22:02.361691+0000","last_clean":"2023-09-30T22:22:02.361691+0000","last_became_active":"2023-09-30T22:22:01.991929+0000","last_became_peered":"2023-09-30T22:22:01.991929+0000","last_unstale":"2023-09-30T22:22:02.361691+0000","last_undegraded":"2023-09-30T22:22:02.361691+0000","last_fullsized":"2023-09-30T22:22:02.361691+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385127+0000","last_change":"2023-09-30T22:22:02.380249+0000","last_active":"2023-09-30T22:22:02.385127+0000","last_peered":"2023-09-30T22:22:02.385127+0000","last_clean":"2023-09-30T22:22:02.385127+0000","last_became_active":"2023-09-30T22:22:02.379830+0000","last_became_peered":"2023-09-30T22:22:02.379830+0000","last_unstale":"2023-09-30T22:22:02.385127+0000","last_undegraded":"2023-09-30T22:22:02.385127+0000","last_fullsized":"2023-09-30T22:22:02.385127+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.364409+0000","last_change":"2023-09-30T22:22:01.997405+0000","last_active":"2023-09-30T22:22:02.364409+0000","last_peered":"2023-09-30T22:22:02.364409+0000","last_clean":"2023-09-30T22:22:02.364409+0000","last_became_active":"2023-09-30T22:22:01.997079+0000","last_became_peered":"2023-09-30T22:22:01.997079+0000","last_unstale":"2023-09-30T22:22:02.364409+0000","last_undegraded":"2023-09-30T22:22:02.364409+0000","last_fullsized":"2023-09-30T22:22:02.364409+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.398556+0000","last_change":"2023-09-30T22:22:01.998235+0000","last_active":"2023-09-30T22:22:02.398556+0000","last_peered":"2023-09-30T22:22:02.398556+0000","last_clean":"2023-09-30T22:22:02.398556+0000","last_became_active":"2023-09-30T22:22:01.997649+0000","last_became_peered":"2023-09-30T22:22:01.997649+0000","last_unstale":"2023-09-30T22:22:02.398556+0000","last_undegraded":"2023-09-30T22:22:02.398556+0000","last_fullsized":"2023-09-30T22:22:02.398556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394877+0000","last_change":"2023-09-30T22:22:02.390318+0000","last_active":"2023-09-30T22:22:02.394877+0000","last_peered":"2023-09-30T22:22:02.394877+0000","last_clean":"2023-09-30T22:22:02.394877+0000","last_became_active":"2023-09-30T22:22:02.390020+0000","last_became_peered":"2023-09-30T22:22:02.390020+0000","last_unstale":"2023-09-30T22:22:02.394877+0000","last_undegraded":"2023-09-30T22:22:02.394877+0000","last_fullsized":"2023-09-30T22:22:02.394877+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.360247+0000","last_change":"2023-09-30T22:22:01.997424+0000","last_active":"2023-09-30T22:22:02.360247+0000","last_peered":"2023-09-30T22:22:02.360247+0000","last_clean":"2023-09-30T22:22:02.360247+0000","last_became_active":"2023-09-30T22:22:01.997098+0000","last_became_peered":"2023-09-30T22:22:01.997098+0000","last_unstale":"2023-09-30T22:22:02.360247+0000","last_undegraded":"2023-09-30T22:22:02.360247+0000","last_fullsized":"2023-09-30T22:22:02.360247+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.395039+0000","last_change":"2023-09-30T22:22:02.391210+0000","last_active":"2023-09-30T22:22:02.395039+0000","last_peered":"2023-09-30T22:22:02.395039+0000","last_clean":"2023-09-30T22:22:02.395039+0000","last_became_active":"2023-09-30T22:22:02.390937+0000","last_became_peered":"2023-09-30T22:22:02.390937+0000","last_unstale":"2023-09-30T22:22:02.395039+0000","last_undegraded":"2023-09-30T22:22:02.395039+0000","last_fullsized":"2023-09-30T22:22:02.395039+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.389161+0000","last_change":"2023-09-30T22:22:01.974848+0000","last_active":"2023-09-30T22:22:02.389161+0000","last_peered":"2023-09-30T22:22:02.389161+0000","last_clean":"2023-09-30T22:22:02.389161+0000","last_became_active":"2023-09-30T22:22:01.974025+0000","last_became_peered":"2023-09-30T22:22:01.974025+0000","last_unstale":"2023-09-30T22:22:02.389161+0000","last_undegraded":"2023-09-30T22:22:02.389161+0000","last_fullsized":"2023-09-30T22:22:02.389161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393941+0000","last_change":"2023-09-30T22:22:01.979910+0000","last_active":"2023-09-30T22:22:02.393941+0000","last_peered":"2023-09-30T22:22:02.393941+0000","last_clean":"2023-09-30T22:22:02.393941+0000","last_became_active":"2023-09-30T22:22:01.979649+0000","last_became_peered":"2023-09-30T22:22:01.979649+0000","last_unstale":"2023-09-30T22:22:02.393941+0000","last_undegraded":"2023-09-30T22:22:02.393941+0000","last_fullsized":"2023-09-30T22:22:02.393941+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394816+0000","last_change":"2023-09-30T22:22:02.390201+0000","last_active":"2023-09-30T22:22:02.394816+0000","last_peered":"2023-09-30T22:22:02.394816+0000","last_clean":"2023-09-30T22:22:02.394816+0000","last_became_active":"2023-09-30T22:22:02.389897+0000","last_became_peered":"2023-09-30T22:22:02.389897+0000","last_unstale":"2023-09-30T22:22:02.394816+0000","last_undegraded":"2023-09-30T22:22:02.394816+0000","last_fullsized":"2023-09-30T22:22:02.394816+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.361009+0000","last_change":"2023-09-30T22:22:01.998688+0000","last_active":"2023-09-30T22:22:02.361009+0000","last_peered":"2023-09-30T22:22:02.361009+0000","last_clean":"2023-09-30T22:22:02.361009+0000","last_became_active":"2023-09-30T22:22:01.998390+0000","last_became_peered":"2023-09-30T22:22:01.998390+0000","last_unstale":"2023-09-30T22:22:02.361009+0000","last_undegraded":"2023-09-30T22:22:02.361009+0000","last_fullsized":"2023-09-30T22:22:02.361009+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385081+0000","last_change":"2023-09-30T22:22:02.376261+0000","last_active":"2023-09-30T22:22:02.385081+0000","last_peered":"2023-09-30T22:22:02.385081+0000","last_clean":"2023-09-30T22:22:02.385081+0000","last_became_active":"2023-09-30T22:22:02.375940+0000","last_became_peered":"2023-09-30T22:22:02.375940+0000","last_unstale":"2023-09-30T22:22:02.385081+0000","last_undegraded":"2023-09-30T22:22:02.385081+0000","last_fullsized":"2023-09-30T22:22:02.385081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394834+0000","last_change":"2023-09-30T22:22:02.390443+0000","last_active":"2023-09-30T22:22:02.394834+0000","last_peered":"2023-09-30T22:22:02.394834+0000","last_clean":"2023-09-30T22:22:02.394834+0000","last_became_active":"2023-09-30T22:22:02.390261+0000","last_became_peered":"2023-09-30T22:22:02.390261+0000","last_unstale":"2023-09-30T22:22:02.394834+0000","last_undegraded":"2023-09-30T22:22:02.394834+0000","last_fullsized":"2023-09-30T22:22:02.394834+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394399+0000","last_change":"2023-09-30T22:22:02.385985+0000","last_active":"2023-09-30T22:22:02.394399+0000","last_peered":"2023-09-30T22:22:02.394399+0000","last_clean":"2023-09-30T22:22:02.394399+0000","last_became_active":"2023-09-30T22:22:02.385413+0000","last_became_peered":"2023-09-30T22:22:02.385413+0000","last_unstale":"2023-09-30T22:22:02.394399+0000","last_undegraded":"2023-09-30T22:22:02.394399+0000","last_fullsized":"2023-09-30T22:22:02.394399+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.359640+0000","last_change":"2023-09-30T22:21:58.403636+0000","last_active":"2023-09-30T22:22:02.359640+0000","last_peered":"2023-09-30T22:22:02.359640+0000","last_clean":"2023-09-30T22:22:02.359640+0000","last_became_active":"2023-09-30T22:21:58.403342+0000","last_became_peered":"2023-09-30T22:21:58.403342+0000","last_unstale":"2023-09-30T22:22:02.359640+0000","last_undegraded":"2023-09-30T22:22:02.359640+0000","last_fullsized":"2023-09-30T22:22:02.359640+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394856+0000","last_change":"2023-09-30T22:22:02.389982+0000","last_active":"2023-09-30T22:22:02.394856+0000","last_peered":"2023-09-30T22:22:02.394856+0000","last_clean":"2023-09-30T22:22:02.394856+0000","last_became_active":"2023-09-30T22:22:02.389680+0000","last_became_peered":"2023-09-30T22:22:02.389680+0000","last_unstale":"2023-09-30T22:22:02.394856+0000","last_undegraded":"2023-09-30T22:22:02.394856+0000","last_fullsized":"2023-09-30T22:22:02.394856+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:21:57.843502+0000","last_change":"2023-09-30T22:21:57.839392+0000","last_active":"2023-09-30T22:21:57.843502+0000","last_peered":"2023-09-30T22:21:57.843502+0000","last_clean":"2023-09-30T22:21:57.843502+0000","last_became_active":"2023-09-30T22:21:57.838993+0000","last_became_peered":"2023-09-30T22:21:57.838993+0000","last_unstale":"2023-09-30T22:21:57.843502+0000","last_undegraded":"2023-09-30T22:21:57.843502+0000","last_fullsized":"2023-09-30T22:21:57.843502+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.363117+0000","last_change":"2023-09-30T22:22:01.990265+0000","last_active":"2023-09-30T22:22:02.363117+0000","last_peered":"2023-09-30T22:22:02.363117+0000","last_clean":"2023-09-30T22:22:02.363117+0000","last_became_active":"2023-09-30T22:22:01.990011+0000","last_became_peered":"2023-09-30T22:22:01.990011+0000","last_unstale":"2023-09-30T22:22:02.363117+0000","last_undegraded":"2023-09-30T22:22:02.363117+0000","last_fullsized":"2023-09-30T22:22:02.363117+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.383793+0000","last_change":"2023-09-30T22:22:02.374205+0000","last_active":"2023-09-30T22:22:02.383793+0000","last_peered":"2023-09-30T22:22:02.383793+0000","last_clean":"2023-09-30T22:22:02.383793+0000","last_became_active":"2023-09-30T22:22:02.373928+0000","last_became_peered":"2023-09-30T22:22:02.373928+0000","last_unstale":"2023-09-30T22:22:02.383793+0000","last_undegraded":"2023-09-30T22:22:02.383793+0000","last_fullsized":"2023-09-30T22:22:02.383793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:21:57.838143+0000","last_change":"2023-09-30T22:21:57.836160+0000","last_active":"2023-09-30T22:21:57.838143+0000","last_peered":"2023-09-30T22:21:57.838143+0000","last_clean":"2023-09-30T22:21:57.838143+0000","last_became_active":"2023-09-30T22:21:57.835792+0000","last_became_peered":"2023-09-30T22:21:57.835792+0000","last_unstale":"2023-09-30T22:21:57.838143+0000","last_undegraded":"2023-09-30T22:21:57.838143+0000","last_fullsized":"2023-09-30T22:21:57.838143+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.359810+0000","last_change":"2023-09-30T22:22:01.987700+0000","last_active":"2023-09-30T22:22:02.359810+0000","last_peered":"2023-09-30T22:22:02.359810+0000","last_clean":"2023-09-30T22:22:02.359810+0000","last_became_active":"2023-09-30T22:22:01.987358+0000","last_became_peered":"2023-09-30T22:22:01.987358+0000","last_unstale":"2023-09-30T22:22:02.359810+0000","last_undegraded":"2023-09-30T22:22:02.359810+0000","last_fullsized":"2023-09-30T22:22:02.359810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.382010+0000","last_change":"2023-09-30T22:22:02.379845+0000","last_active":"2023-09-30T22:22:02.382010+0000","last_peered":"2023-09-30T22:22:02.382010+0000","last_clean":"2023-09-30T22:22:02.382010+0000","last_became_active":"2023-09-30T22:22:02.379594+0000","last_became_peered":"2023-09-30T22:22:02.379594+0000","last_unstale":"2023-09-30T22:22:02.382010+0000","last_undegraded":"2023-09-30T22:22:02.382010+0000","last_fullsized":"2023-09-30T22:22:02.382010+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:21:57.843463+0000","last_change":"2023-09-30T22:21:57.838957+0000","last_active":"2023-09-30T22:21:57.843463+0000","last_peered":"2023-09-30T22:21:57.843463+0000","last_clean":"2023-09-30T22:21:57.843463+0000","last_became_active":"2023-09-30T22:21:57.838667+0000","last_became_peered":"2023-09-30T22:21:57.838667+0000","last_unstale":"2023-09-30T22:21:57.843463+0000","last_undegraded":"2023-09-30T22:21:57.843463+0000","last_fullsized":"2023-09-30T22:21:57.843463+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.359529+0000","last_change":"2023-09-30T22:21:56.838072+0000","last_active":"2023-09-30T22:22:02.359529+0000","last_peered":"2023-09-30T22:22:02.359529+0000","last_clean":"2023-09-30T22:22:02.359529+0000","last_became_active":"2023-09-30T22:21:56.837717+0000","last_became_peered":"2023-09-30T22:21:56.837717+0000","last_unstale":"2023-09-30T22:22:02.359529+0000","last_undegraded":"2023-09-30T22:22:02.359529+0000","last_fullsized":"2023-09-30T22:22:02.359529+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:55.823939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:55.823939+0000","last_clean_scrub_stamp":"2023-09-30T22:21:55.823939+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:21:57.840884+0000","last_change":"2023-09-30T22:21:57.837598+0000","last_active":"2023-09-30T22:21:57.840884+0000","last_peered":"2023-09-30T22:21:57.840884+0000","last_clean":"2023-09-30T22:21:57.840884+0000","last_became_active":"2023-09-30T22:21:57.837284+0000","last_became_peered":"2023-09-30T22:21:57.837284+0000","last_unstale":"2023-09-30T22:21:57.840884+0000","last_undegraded":"2023-09-30T22:21:57.840884+0000","last_fullsized":"2023-09-30T22:21:57.840884+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.364183+0000","last_change":"2023-09-30T22:22:01.983059+0000","last_active":"2023-09-30T22:22:02.364183+0000","last_peered":"2023-09-30T22:22:02.364183+0000","last_clean":"2023-09-30T22:22:02.364183+0000","last_became_active":"2023-09-30T22:22:01.982739+0000","last_became_peered":"2023-09-30T22:22:01.982739+0000","last_unstale":"2023-09-30T22:22:02.364183+0000","last_undegraded":"2023-09-30T22:22:02.364183+0000","last_fullsized":"2023-09-30T22:22:02.364183+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385106+0000","last_change":"2023-09-30T22:22:02.380074+0000","last_active":"2023-09-30T22:22:02.385106+0000","last_peered":"2023-09-30T22:22:02.385106+0000","last_clean":"2023-09-30T22:22:02.385106+0000","last_became_active":"2023-09-30T22:22:02.379501+0000","last_became_peered":"2023-09-30T22:22:02.379501+0000","last_unstale":"2023-09-30T22:22:02.385106+0000","last_undegraded":"2023-09-30T22:22:02.385106+0000","last_fullsized":"2023-09-30T22:22:02.385106+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:21:58.404324+0000","last_change":"2023-09-30T22:21:58.403508+0000","last_active":"2023-09-30T22:21:58.404324+0000","last_peered":"2023-09-30T22:21:58.404324+0000","last_clean":"2023-09-30T22:21:58.404324+0000","last_became_active":"2023-09-30T22:21:58.403267+0000","last_became_peered":"2023-09-30T22:21:58.403267+0000","last_unstale":"2023-09-30T22:21:58.404324+0000","last_undegraded":"2023-09-30T22:21:58.404324+0000","last_fullsized":"2023-09-30T22:21:58.404324+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.359534+0000","last_change":"2023-09-30T22:22:01.987265+0000","last_active":"2023-09-30T22:22:02.359534+0000","last_peered":"2023-09-30T22:22:02.359534+0000","last_clean":"2023-09-30T22:22:02.359534+0000","last_became_active":"2023-09-30T22:22:01.986968+0000","last_became_peered":"2023-09-30T22:22:01.986968+0000","last_unstale":"2023-09-30T22:22:02.359534+0000","last_undegraded":"2023-09-30T22:22:02.359534+0000","last_fullsized":"2023-09-30T22:22:02.359534+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385062+0000","last_change":"2023-09-30T22:22:02.376013+0000","last_active":"2023-09-30T22:22:02.385062+0000","last_peered":"2023-09-30T22:22:02.385062+0000","last_clean":"2023-09-30T22:22:02.385062+0000","last_became_active":"2023-09-30T22:22:02.374252+0000","last_became_peered":"2023-09-30T22:22:02.374252+0000","last_unstale":"2023-09-30T22:22:02.385062+0000","last_undegraded":"2023-09-30T22:22:02.385062+0000","last_fullsized":"2023-09-30T22:22:02.385062+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.360873+0000","last_change":"2023-09-30T22:21:58.403570+0000","last_active":"2023-09-30T22:22:02.360873+0000","last_peered":"2023-09-30T22:22:02.360873+0000","last_clean":"2023-09-30T22:22:02.360873+0000","last_became_active":"2023-09-30T22:21:58.403321+0000","last_became_peered":"2023-09-30T22:21:58.403321+0000","last_unstale":"2023-09-30T22:22:02.360873+0000","last_undegraded":"2023-09-30T22:22:02.360873+0000","last_fullsized":"2023-09-30T22:22:02.360873+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:21:58.409868+0000","last_change":"2023-09-30T22:21:58.404380+0000","last_active":"2023-09-30T22:21:58.409868+0000","last_peered":"2023-09-30T22:21:58.409868+0000","last_clean":"2023-09-30T22:21:58.409868+0000","last_became_active":"2023-09-30T22:21:58.404098+0000","last_became_peered":"2023-09-30T22:21:58.404098+0000","last_unstale":"2023-09-30T22:21:58.409868+0000","last_undegraded":"2023-09-30T22:21:58.409868+0000","last_fullsized":"2023-09-30T22:21:58.409868+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.366010+0000","last_change":"2023-09-30T22:22:01.977163+0000","last_active":"2023-09-30T22:22:02.366010+0000","last_peered":"2023-09-30T22:22:02.366010+0000","last_clean":"2023-09-30T22:22:02.366010+0000","last_became_active":"2023-09-30T22:22:01.976494+0000","last_became_peered":"2023-09-30T22:22:01.976494+0000","last_unstale":"2023-09-30T22:22:02.366010+0000","last_undegraded":"2023-09-30T22:22:02.366010+0000","last_fullsized":"2023-09-30T22:22:02.366010+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.398231+0000","last_change":"2023-09-30T22:22:01.997989+0000","last_active":"2023-09-30T22:22:02.398231+0000","last_peered":"2023-09-30T22:22:02.398231+0000","last_clean":"2023-09-30T22:22:02.398231+0000","last_became_active":"2023-09-30T22:22:01.997419+0000","last_became_peered":"2023-09-30T22:22:01.997419+0000","last_unstale":"2023-09-30T22:22:02.398231+0000","last_undegraded":"2023-09-30T22:22:02.398231+0000","last_fullsized":"2023-09-30T22:22:02.398231+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380701+0000","last_change":"2023-09-30T22:22:01.977515+0000","last_active":"2023-09-30T22:22:02.380701+0000","last_peered":"2023-09-30T22:22:02.380701+0000","last_clean":"2023-09-30T22:22:02.380701+0000","last_became_active":"2023-09-30T22:22:01.976843+0000","last_became_peered":"2023-09-30T22:22:01.976843+0000","last_unstale":"2023-09-30T22:22:02.380701+0000","last_undegraded":"2023-09-30T22:22:02.380701+0000","last_fullsized":"2023-09-30T22:22:02.380701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:00.955035+0000","last_change":"2023-09-30T22:22:00.955035+0000","last_active":"2023-09-30T22:22:00.955035+0000","last_peered":"2023-09-30T22:22:00.955035+0000","last_clean":"2023-09-30T22:22:00.955035+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:00.955035+0000","last_undegraded":"2023-09-30T22:22:00.955035+0000","last_fullsized":"2023-09-30T22:22:00.955035+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.386441+0000","last_change":"2023-09-30T22:22:01.980853+0000","last_active":"2023-09-30T22:22:02.386441+0000","last_peered":"2023-09-30T22:22:02.386441+0000","last_clean":"2023-09-30T22:22:02.386441+0000","last_became_active":"2023-09-30T22:22:01.979795+0000","last_became_peered":"2023-09-30T22:22:01.979795+0000","last_unstale":"2023-09-30T22:22:02.386441+0000","last_undegraded":"2023-09-30T22:22:02.386441+0000","last_fullsized":"2023-09-30T22:22:02.386441+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380254+0000","last_change":"2023-09-30T22:22:02.373820+0000","last_active":"2023-09-30T22:22:02.380254+0000","last_peered":"2023-09-30T22:22:02.380254+0000","last_clean":"2023-09-30T22:22:02.380254+0000","last_became_active":"2023-09-30T22:22:02.373530+0000","last_became_peered":"2023-09-30T22:22:02.373530+0000","last_unstale":"2023-09-30T22:22:02.380254+0000","last_undegraded":"2023-09-30T22:22:02.380254+0000","last_fullsized":"2023-09-30T22:22:02.380254+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394694+0000","last_change":"2023-09-30T22:22:02.387890+0000","last_active":"2023-09-30T22:22:02.394694+0000","last_peered":"2023-09-30T22:22:02.394694+0000","last_clean":"2023-09-30T22:22:02.394694+0000","last_became_active":"2023-09-30T22:22:02.387599+0000","last_became_peered":"2023-09-30T22:22:02.387599+0000","last_unstale":"2023-09-30T22:22:02.394694+0000","last_undegraded":"2023-09-30T22:22:02.394694+0000","last_fullsized":"2023-09-30T22:22:02.394694+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:22:01.956301+0000","last_change":"2023-09-30T22:22:01.956301+0000","last_active":"2023-09-30T22:22:01.956301+0000","last_peered":"2023-09-30T22:22:01.956301+0000","last_clean":"2023-09-30T22:22:01.956301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:22:01.956301+0000","last_undegraded":"2023-09-30T22:22:01.956301+0000","last_fullsized":"2023-09-30T22:22:01.956301+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.383770+0000","last_change":"2023-09-30T22:22:02.374216+0000","last_active":"2023-09-30T22:22:02.383770+0000","last_peered":"2023-09-30T22:22:02.383770+0000","last_clean":"2023-09-30T22:22:02.383770+0000","last_became_active":"2023-09-30T22:22:02.373952+0000","last_became_peered":"2023-09-30T22:22:02.373952+0000","last_unstale":"2023-09-30T22:22:02.383770+0000","last_undegraded":"2023-09-30T22:22:02.383770+0000","last_fullsized":"2023-09-30T22:22:02.383770+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":2},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":666,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":32,"acting":32,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":30204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705666,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":30204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":46930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":47845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T22:22:07.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2023-09-30T22:22:07.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:01.956301+0000', 'last_change': '2023-09-30T22:22:01.956301+0000', 'last_active': '2023-09-30T22:22:01.956301+0000', 'last_peered': '2023-09-30T22:22:01.956301+0000', 'last_clean': '2023-09-30T22:22:01.956301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:01.956301+0000', 'last_undegraded': '2023-09-30T22:22:01.956301+0000', 'last_fullsized': '2023-09-30T22:22:01.956301+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2023-09-30T22:22:07.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:01.956301+0000', 'last_change': '2023-09-30T22:22:01.956301+0000', 'last_active': '2023-09-30T22:22:01.956301+0000', 'last_peered': '2023-09-30T22:22:01.956301+0000', 'last_clean': '2023-09-30T22:22:01.956301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:01.956301+0000', 'last_undegraded': '2023-09-30T22:22:01.956301+0000', 'last_fullsized': '2023-09-30T22:22:01.956301+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2023-09-30T22:22:07.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:01.956301+0000', 'last_change': '2023-09-30T22:22:01.956301+0000', 'last_active': '2023-09-30T22:22:01.956301+0000', 'last_peered': '2023-09-30T22:22:01.956301+0000', 'last_clean': '2023-09-30T22:22:01.956301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:01.956301+0000', 'last_undegraded': '2023-09-30T22:22:01.956301+0000', 'last_fullsized': '2023-09-30T22:22:01.956301+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2023-09-30T22:22:07.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:01.956301+0000', 'last_change': '2023-09-30T22:22:01.956301+0000', 'last_active': '2023-09-30T22:22:01.956301+0000', 'last_peered': '2023-09-30T22:22:01.956301+0000', 'last_clean': '2023-09-30T22:22:01.956301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:01.956301+0000', 'last_undegraded': '2023-09-30T22:22:01.956301+0000', 'last_fullsized': '2023-09-30T22:22:01.956301+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2023-09-30T22:22:07.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:01.956301+0000', 'last_change': '2023-09-30T22:22:01.956301+0000', 'last_active': '2023-09-30T22:22:01.956301+0000', 'last_peered': '2023-09-30T22:22:01.956301+0000', 'last_clean': '2023-09-30T22:22:01.956301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:01.956301+0000', 'last_undegraded': '2023-09-30T22:22:01.956301+0000', 'last_fullsized': '2023-09-30T22:22:01.956301+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.33 is not active+clean 2023-09-30T22:22:07.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:01.956301+0000', 'last_change': '2023-09-30T22:22:01.956301+0000', 'last_active': '2023-09-30T22:22:01.956301+0000', 'last_peered': '2023-09-30T22:22:01.956301+0000', 'last_clean': '2023-09-30T22:22:01.956301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:01.956301+0000', 'last_undegraded': '2023-09-30T22:22:01.956301+0000', 'last_fullsized': '2023-09-30T22:22:01.956301+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2023-09-30T22:22:07.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:01.956301+0000', 'last_change': '2023-09-30T22:22:01.956301+0000', 'last_active': '2023-09-30T22:22:01.956301+0000', 'last_peered': '2023-09-30T22:22:01.956301+0000', 'last_clean': '2023-09-30T22:22:01.956301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:01.956301+0000', 'last_undegraded': '2023-09-30T22:22:01.956301+0000', 'last_fullsized': '2023-09-30T22:22:01.956301+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2023-09-30T22:22:07.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:01.956301+0000', 'last_change': '2023-09-30T22:22:01.956301+0000', 'last_active': '2023-09-30T22:22:01.956301+0000', 'last_peered': '2023-09-30T22:22:01.956301+0000', 'last_clean': '2023-09-30T22:22:01.956301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:01.956301+0000', 'last_undegraded': '2023-09-30T22:22:01.956301+0000', 'last_fullsized': '2023-09-30T22:22:01.956301+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2023-09-30T22:22:07.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:01.956301+0000', 'last_change': '2023-09-30T22:22:01.956301+0000', 'last_active': '2023-09-30T22:22:01.956301+0000', 'last_peered': '2023-09-30T22:22:01.956301+0000', 'last_clean': '2023-09-30T22:22:01.956301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:01.956301+0000', 'last_undegraded': '2023-09-30T22:22:01.956301+0000', 'last_fullsized': '2023-09-30T22:22:01.956301+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2023-09-30T22:22:07.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:01.956301+0000', 'last_change': '2023-09-30T22:22:01.956301+0000', 'last_active': '2023-09-30T22:22:01.956301+0000', 'last_peered': '2023-09-30T22:22:01.956301+0000', 'last_clean': '2023-09-30T22:22:01.956301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:01.956301+0000', 'last_undegraded': '2023-09-30T22:22:01.956301+0000', 'last_fullsized': '2023-09-30T22:22:01.956301+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2023-09-30T22:22:07.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:01.956301+0000', 'last_change': '2023-09-30T22:22:01.956301+0000', 'last_active': '2023-09-30T22:22:01.956301+0000', 'last_peered': '2023-09-30T22:22:01.956301+0000', 'last_clean': '2023-09-30T22:22:01.956301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:01.956301+0000', 'last_undegraded': '2023-09-30T22:22:01.956301+0000', 'last_fullsized': '2023-09-30T22:22:01.956301+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2023-09-30T22:22:07.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:00.955035+0000', 'last_change': '2023-09-30T22:22:00.955035+0000', 'last_active': '2023-09-30T22:22:00.955035+0000', 'last_peered': '2023-09-30T22:22:00.955035+0000', 'last_clean': '2023-09-30T22:22:00.955035+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:00.955035+0000', 'last_undegraded': '2023-09-30T22:22:00.955035+0000', 'last_fullsized': '2023-09-30T22:22:00.955035+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2023-09-30T22:22:07.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:01.956301+0000', 'last_change': '2023-09-30T22:22:01.956301+0000', 'last_active': '2023-09-30T22:22:01.956301+0000', 'last_peered': '2023-09-30T22:22:01.956301+0000', 'last_clean': '2023-09-30T22:22:01.956301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:01.956301+0000', 'last_undegraded': '2023-09-30T22:22:01.956301+0000', 'last_fullsized': '2023-09-30T22:22:01.956301+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2023-09-30T22:22:07.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:01.956301+0000', 'last_change': '2023-09-30T22:22:01.956301+0000', 'last_active': '2023-09-30T22:22:01.956301+0000', 'last_peered': '2023-09-30T22:22:01.956301+0000', 'last_clean': '2023-09-30T22:22:01.956301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:01.956301+0000', 'last_undegraded': '2023-09-30T22:22:01.956301+0000', 'last_fullsized': '2023-09-30T22:22:01.956301+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2023-09-30T22:22:07.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:00.955035+0000', 'last_change': '2023-09-30T22:22:00.955035+0000', 'last_active': '2023-09-30T22:22:00.955035+0000', 'last_peered': '2023-09-30T22:22:00.955035+0000', 'last_clean': '2023-09-30T22:22:00.955035+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:00.955035+0000', 'last_undegraded': '2023-09-30T22:22:00.955035+0000', 'last_fullsized': '2023-09-30T22:22:00.955035+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2023-09-30T22:22:07.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:01.956301+0000', 'last_change': '2023-09-30T22:22:01.956301+0000', 'last_active': '2023-09-30T22:22:01.956301+0000', 'last_peered': '2023-09-30T22:22:01.956301+0000', 'last_clean': '2023-09-30T22:22:01.956301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:01.956301+0000', 'last_undegraded': '2023-09-30T22:22:01.956301+0000', 'last_fullsized': '2023-09-30T22:22:01.956301+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2023-09-30T22:22:07.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:00.955035+0000', 'last_change': '2023-09-30T22:22:00.955035+0000', 'last_active': '2023-09-30T22:22:00.955035+0000', 'last_peered': '2023-09-30T22:22:00.955035+0000', 'last_clean': '2023-09-30T22:22:00.955035+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:00.955035+0000', 'last_undegraded': '2023-09-30T22:22:00.955035+0000', 'last_fullsized': '2023-09-30T22:22:00.955035+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2023-09-30T22:22:07.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:01.956301+0000', 'last_change': '2023-09-30T22:22:01.956301+0000', 'last_active': '2023-09-30T22:22:01.956301+0000', 'last_peered': '2023-09-30T22:22:01.956301+0000', 'last_clean': '2023-09-30T22:22:01.956301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:01.956301+0000', 'last_undegraded': '2023-09-30T22:22:01.956301+0000', 'last_fullsized': '2023-09-30T22:22:01.956301+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2023-09-30T22:22:07.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:00.955035+0000', 'last_change': '2023-09-30T22:22:00.955035+0000', 'last_active': '2023-09-30T22:22:00.955035+0000', 'last_peered': '2023-09-30T22:22:00.955035+0000', 'last_clean': '2023-09-30T22:22:00.955035+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:00.955035+0000', 'last_undegraded': '2023-09-30T22:22:00.955035+0000', 'last_fullsized': '2023-09-30T22:22:00.955035+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2023-09-30T22:22:07.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:01.956301+0000', 'last_change': '2023-09-30T22:22:01.956301+0000', 'last_active': '2023-09-30T22:22:01.956301+0000', 'last_peered': '2023-09-30T22:22:01.956301+0000', 'last_clean': '2023-09-30T22:22:01.956301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:01.956301+0000', 'last_undegraded': '2023-09-30T22:22:01.956301+0000', 'last_fullsized': '2023-09-30T22:22:01.956301+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2023-09-30T22:22:07.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:01.956301+0000', 'last_change': '2023-09-30T22:22:01.956301+0000', 'last_active': '2023-09-30T22:22:01.956301+0000', 'last_peered': '2023-09-30T22:22:01.956301+0000', 'last_clean': '2023-09-30T22:22:01.956301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:01.956301+0000', 'last_undegraded': '2023-09-30T22:22:01.956301+0000', 'last_fullsized': '2023-09-30T22:22:01.956301+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2023-09-30T22:22:07.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:00.955035+0000', 'last_change': '2023-09-30T22:22:00.955035+0000', 'last_active': '2023-09-30T22:22:00.955035+0000', 'last_peered': '2023-09-30T22:22:00.955035+0000', 'last_clean': '2023-09-30T22:22:00.955035+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:00.955035+0000', 'last_undegraded': '2023-09-30T22:22:00.955035+0000', 'last_fullsized': '2023-09-30T22:22:00.955035+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2023-09-30T22:22:07.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:01.956301+0000', 'last_change': '2023-09-30T22:22:01.956301+0000', 'last_active': '2023-09-30T22:22:01.956301+0000', 'last_peered': '2023-09-30T22:22:01.956301+0000', 'last_clean': '2023-09-30T22:22:01.956301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:01.956301+0000', 'last_undegraded': '2023-09-30T22:22:01.956301+0000', 'last_fullsized': '2023-09-30T22:22:01.956301+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2023-09-30T22:22:07.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:01.956301+0000', 'last_change': '2023-09-30T22:22:01.956301+0000', 'last_active': '2023-09-30T22:22:01.956301+0000', 'last_peered': '2023-09-30T22:22:01.956301+0000', 'last_clean': '2023-09-30T22:22:01.956301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:01.956301+0000', 'last_undegraded': '2023-09-30T22:22:01.956301+0000', 'last_fullsized': '2023-09-30T22:22:01.956301+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2023-09-30T22:22:07.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:00.955035+0000', 'last_change': '2023-09-30T22:22:00.955035+0000', 'last_active': '2023-09-30T22:22:00.955035+0000', 'last_peered': '2023-09-30T22:22:00.955035+0000', 'last_clean': '2023-09-30T22:22:00.955035+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:00.955035+0000', 'last_undegraded': '2023-09-30T22:22:00.955035+0000', 'last_fullsized': '2023-09-30T22:22:00.955035+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2023-09-30T22:22:07.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:00.955035+0000', 'last_change': '2023-09-30T22:22:00.955035+0000', 'last_active': '2023-09-30T22:22:00.955035+0000', 'last_peered': '2023-09-30T22:22:00.955035+0000', 'last_clean': '2023-09-30T22:22:00.955035+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:00.955035+0000', 'last_undegraded': '2023-09-30T22:22:00.955035+0000', 'last_fullsized': '2023-09-30T22:22:00.955035+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2023-09-30T22:22:07.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:01.956301+0000', 'last_change': '2023-09-30T22:22:01.956301+0000', 'last_active': '2023-09-30T22:22:01.956301+0000', 'last_peered': '2023-09-30T22:22:01.956301+0000', 'last_clean': '2023-09-30T22:22:01.956301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:01.956301+0000', 'last_undegraded': '2023-09-30T22:22:01.956301+0000', 'last_fullsized': '2023-09-30T22:22:01.956301+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2023-09-30T22:22:07.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:00.955035+0000', 'last_change': '2023-09-30T22:22:00.955035+0000', 'last_active': '2023-09-30T22:22:00.955035+0000', 'last_peered': '2023-09-30T22:22:00.955035+0000', 'last_clean': '2023-09-30T22:22:00.955035+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:00.955035+0000', 'last_undegraded': '2023-09-30T22:22:00.955035+0000', 'last_fullsized': '2023-09-30T22:22:00.955035+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2023-09-30T22:22:07.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:00.955035+0000', 'last_change': '2023-09-30T22:22:00.955035+0000', 'last_active': '2023-09-30T22:22:00.955035+0000', 'last_peered': '2023-09-30T22:22:00.955035+0000', 'last_clean': '2023-09-30T22:22:00.955035+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:00.955035+0000', 'last_undegraded': '2023-09-30T22:22:00.955035+0000', 'last_fullsized': '2023-09-30T22:22:00.955035+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2023-09-30T22:22:07.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:01.956301+0000', 'last_change': '2023-09-30T22:22:01.956301+0000', 'last_active': '2023-09-30T22:22:01.956301+0000', 'last_peered': '2023-09-30T22:22:01.956301+0000', 'last_clean': '2023-09-30T22:22:01.956301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:01.956301+0000', 'last_undegraded': '2023-09-30T22:22:01.956301+0000', 'last_fullsized': '2023-09-30T22:22:01.956301+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2023-09-30T22:22:07.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:00.955035+0000', 'last_change': '2023-09-30T22:22:00.955035+0000', 'last_active': '2023-09-30T22:22:00.955035+0000', 'last_peered': '2023-09-30T22:22:00.955035+0000', 'last_clean': '2023-09-30T22:22:00.955035+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:00.955035+0000', 'last_undegraded': '2023-09-30T22:22:00.955035+0000', 'last_fullsized': '2023-09-30T22:22:00.955035+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2023-09-30T22:22:07.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:01.956301+0000', 'last_change': '2023-09-30T22:22:01.956301+0000', 'last_active': '2023-09-30T22:22:01.956301+0000', 'last_peered': '2023-09-30T22:22:01.956301+0000', 'last_clean': '2023-09-30T22:22:01.956301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:01.956301+0000', 'last_undegraded': '2023-09-30T22:22:01.956301+0000', 'last_fullsized': '2023-09-30T22:22:01.956301+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2023-09-30T22:22:07.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:00.955035+0000', 'last_change': '2023-09-30T22:22:00.955035+0000', 'last_active': '2023-09-30T22:22:00.955035+0000', 'last_peered': '2023-09-30T22:22:00.955035+0000', 'last_clean': '2023-09-30T22:22:00.955035+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:00.955035+0000', 'last_undegraded': '2023-09-30T22:22:00.955035+0000', 'last_fullsized': '2023-09-30T22:22:00.955035+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2023-09-30T22:22:07.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:00.955035+0000', 'last_change': '2023-09-30T22:22:00.955035+0000', 'last_active': '2023-09-30T22:22:00.955035+0000', 'last_peered': '2023-09-30T22:22:00.955035+0000', 'last_clean': '2023-09-30T22:22:00.955035+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:00.955035+0000', 'last_undegraded': '2023-09-30T22:22:00.955035+0000', 'last_fullsized': '2023-09-30T22:22:00.955035+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2023-09-30T22:22:07.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:00.955035+0000', 'last_change': '2023-09-30T22:22:00.955035+0000', 'last_active': '2023-09-30T22:22:00.955035+0000', 'last_peered': '2023-09-30T22:22:00.955035+0000', 'last_clean': '2023-09-30T22:22:00.955035+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:00.955035+0000', 'last_undegraded': '2023-09-30T22:22:00.955035+0000', 'last_fullsized': '2023-09-30T22:22:00.955035+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2023-09-30T22:22:07.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:01.956301+0000', 'last_change': '2023-09-30T22:22:01.956301+0000', 'last_active': '2023-09-30T22:22:01.956301+0000', 'last_peered': '2023-09-30T22:22:01.956301+0000', 'last_clean': '2023-09-30T22:22:01.956301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:01.956301+0000', 'last_undegraded': '2023-09-30T22:22:01.956301+0000', 'last_fullsized': '2023-09-30T22:22:01.956301+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2023-09-30T22:22:07.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:00.955035+0000', 'last_change': '2023-09-30T22:22:00.955035+0000', 'last_active': '2023-09-30T22:22:00.955035+0000', 'last_peered': '2023-09-30T22:22:00.955035+0000', 'last_clean': '2023-09-30T22:22:00.955035+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:00.955035+0000', 'last_undegraded': '2023-09-30T22:22:00.955035+0000', 'last_fullsized': '2023-09-30T22:22:00.955035+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2023-09-30T22:22:07.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:01.956301+0000', 'last_change': '2023-09-30T22:22:01.956301+0000', 'last_active': '2023-09-30T22:22:01.956301+0000', 'last_peered': '2023-09-30T22:22:01.956301+0000', 'last_clean': '2023-09-30T22:22:01.956301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:01.956301+0000', 'last_undegraded': '2023-09-30T22:22:01.956301+0000', 'last_fullsized': '2023-09-30T22:22:01.956301+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2023-09-30T22:22:07.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:01.956301+0000', 'last_change': '2023-09-30T22:22:01.956301+0000', 'last_active': '2023-09-30T22:22:01.956301+0000', 'last_peered': '2023-09-30T22:22:01.956301+0000', 'last_clean': '2023-09-30T22:22:01.956301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:01.956301+0000', 'last_undegraded': '2023-09-30T22:22:01.956301+0000', 'last_fullsized': '2023-09-30T22:22:01.956301+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2023-09-30T22:22:07.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:01.956301+0000', 'last_change': '2023-09-30T22:22:01.956301+0000', 'last_active': '2023-09-30T22:22:01.956301+0000', 'last_peered': '2023-09-30T22:22:01.956301+0000', 'last_clean': '2023-09-30T22:22:01.956301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:01.956301+0000', 'last_undegraded': '2023-09-30T22:22:01.956301+0000', 'last_fullsized': '2023-09-30T22:22:01.956301+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2023-09-30T22:22:07.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:01.956301+0000', 'last_change': '2023-09-30T22:22:01.956301+0000', 'last_active': '2023-09-30T22:22:01.956301+0000', 'last_peered': '2023-09-30T22:22:01.956301+0000', 'last_clean': '2023-09-30T22:22:01.956301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:01.956301+0000', 'last_undegraded': '2023-09-30T22:22:01.956301+0000', 'last_fullsized': '2023-09-30T22:22:01.956301+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2023-09-30T22:22:07.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:00.955035+0000', 'last_change': '2023-09-30T22:22:00.955035+0000', 'last_active': '2023-09-30T22:22:00.955035+0000', 'last_peered': '2023-09-30T22:22:00.955035+0000', 'last_clean': '2023-09-30T22:22:00.955035+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:00.955035+0000', 'last_undegraded': '2023-09-30T22:22:00.955035+0000', 'last_fullsized': '2023-09-30T22:22:00.955035+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2023-09-30T22:22:07.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:01.956301+0000', 'last_change': '2023-09-30T22:22:01.956301+0000', 'last_active': '2023-09-30T22:22:01.956301+0000', 'last_peered': '2023-09-30T22:22:01.956301+0000', 'last_clean': '2023-09-30T22:22:01.956301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:01.956301+0000', 'last_undegraded': '2023-09-30T22:22:01.956301+0000', 'last_fullsized': '2023-09-30T22:22:01.956301+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2023-09-30T22:22:07.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:00.955035+0000', 'last_change': '2023-09-30T22:22:00.955035+0000', 'last_active': '2023-09-30T22:22:00.955035+0000', 'last_peered': '2023-09-30T22:22:00.955035+0000', 'last_clean': '2023-09-30T22:22:00.955035+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:00.955035+0000', 'last_undegraded': '2023-09-30T22:22:00.955035+0000', 'last_fullsized': '2023-09-30T22:22:00.955035+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:00.955035+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2023-09-30T22:22:07.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:01.956301+0000', 'last_change': '2023-09-30T22:22:01.956301+0000', 'last_active': '2023-09-30T22:22:01.956301+0000', 'last_peered': '2023-09-30T22:22:01.956301+0000', 'last_clean': '2023-09-30T22:22:01.956301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:01.956301+0000', 'last_undegraded': '2023-09-30T22:22:01.956301+0000', 'last_fullsized': '2023-09-30T22:22:01.956301+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2023-09-30T22:22:07.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:01.956301+0000', 'last_change': '2023-09-30T22:22:01.956301+0000', 'last_active': '2023-09-30T22:22:01.956301+0000', 'last_peered': '2023-09-30T22:22:01.956301+0000', 'last_clean': '2023-09-30T22:22:01.956301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:01.956301+0000', 'last_undegraded': '2023-09-30T22:22:01.956301+0000', 'last_fullsized': '2023-09-30T22:22:01.956301+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2023-09-30T22:22:07.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:01.956301+0000', 'last_change': '2023-09-30T22:22:01.956301+0000', 'last_active': '2023-09-30T22:22:01.956301+0000', 'last_peered': '2023-09-30T22:22:01.956301+0000', 'last_clean': '2023-09-30T22:22:01.956301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:01.956301+0000', 'last_undegraded': '2023-09-30T22:22:01.956301+0000', 'last_fullsized': '2023-09-30T22:22:01.956301+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2023-09-30T22:22:07.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:22:01.956301+0000', 'last_change': '2023-09-30T22:22:01.956301+0000', 'last_active': '2023-09-30T22:22:01.956301+0000', 'last_peered': '2023-09-30T22:22:01.956301+0000', 'last_clean': '2023-09-30T22:22:01.956301+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:22:01.956301+0000', 'last_undegraded': '2023-09-30T22:22:01.956301+0000', 'last_fullsized': '2023-09-30T22:22:01.956301+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'last_clean_scrub_stamp': '2023-09-30T22:22:01.956301+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:22:07.095 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-09-30T22:22:07.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.240+0000 7f58a66ae700 1 Processor -- start 2023-09-30T22:22:07.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.240+0000 7f58a66ae700 1 -- start start 2023-09-30T22:22:07.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.240+0000 7f58a66ae700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58a012ab40 0x7f58a012b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:07.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.240+0000 7f58a66ae700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f58a012fed0 0x7f58a01322c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:07.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.240+0000 7f58a66ae700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a0096c10 con 0x7f58a005e090 2023-09-30T22:22:07.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.240+0000 7f58a66ae700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a0091fb0 con 0x7f58a012ab40 2023-09-30T22:22:07.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.240+0000 7f58a66ae700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58a0091a00 con 0x7f58a012fed0 2023-09-30T22:22:07.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.240+0000 7f58a4c4b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f58a012fed0 0x7f58a01322c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:07.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.240+0000 7f589f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58a012ab40 0x7f58a012b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:07.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.240+0000 7f589ffff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f58a005e090 0x7f58a012afd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49408/0 (socket says 172.21.15.40:49408) 2023-09-30T22:22:07.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.240+0000 7f589f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58a012ab40 0x7f58a012b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:46674/0 (socket says 172.21.15.40:46674) 2023-09-30T22:22:07.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.240+0000 7f589f7fe700 1 -- 172.21.15.40:0/1640819575 learned_addr learned my addr 172.21.15.40:0/1640819575 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:07.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.240+0000 7f58a4c4b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f58a012fed0 0x7f58a01322c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60028/0 (socket says 172.21.15.40:60028) 2023-09-30T22:22:07.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.241+0000 7f589effd700 1 -- 172.21.15.40:0/1640819575 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2450554309 0 0) 0x7f58a0096c10 con 0x7f58a005e090 2023-09-30T22:22:07.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.241+0000 7f589f7fe700 1 -- 172.21.15.40:0/1640819575 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f58a012fed0 msgr2=0x7f58a01322c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:07.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.241+0000 7f589f7fe700 1 --2- 172.21.15.40:0/1640819575 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f58a012fed0 0x7f58a01322c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:07.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.241+0000 7f589f7fe700 1 -- 172.21.15.40:0/1640819575 >> v1:172.21.15.40:6789/0 conn(0x7f58a005e090 legacy=0x7f58a012afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:07.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.241+0000 7f589f7fe700 1 -- 172.21.15.40:0/1640819575 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a0096700 con 0x7f58a012ab40 2023-09-30T22:22:07.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.241+0000 7f58a4c4b700 1 --2- 172.21.15.40:0/1640819575 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f58a012fed0 0x7f58a01322c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:07.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.241+0000 7f589f7fe700 1 --2- 172.21.15.40:0/1640819575 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58a012ab40 0x7f58a012b6e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f5894009830 tx=0x7f58940090f0).ready entity=mon.1 client_cookie=33112aa18bc7aedd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:07.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.241+0000 7f589effd700 1 -- 172.21.15.40:0/1640819575 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589400b580 con 0x7f58a012ab40 2023-09-30T22:22:07.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.241+0000 7f589effd700 1 -- 172.21.15.40:0/1640819575 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589400b6e0 con 0x7f58a012ab40 2023-09-30T22:22:07.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.241+0000 7f589effd700 1 -- 172.21.15.40:0/1640819575 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589400ba60 con 0x7f58a012ab40 2023-09-30T22:22:07.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.241+0000 7f58a66ae700 1 -- 172.21.15.40:0/1640819575 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58a012ab40 msgr2=0x7f58a012b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:07.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.241+0000 7f58a66ae700 1 --2- 172.21.15.40:0/1640819575 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58a012ab40 0x7f58a012b6e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f5894009830 tx=0x7f58940090f0).stop 2023-09-30T22:22:07.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.242+0000 7f58a66ae700 1 -- 172.21.15.40:0/1640819575 shutdown_connections 2023-09-30T22:22:07.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.242+0000 7f58a66ae700 1 --2- 172.21.15.40:0/1640819575 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f58a012fed0 0x7f58a01322c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:07.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.242+0000 7f58a66ae700 1 --2- 172.21.15.40:0/1640819575 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58a012ab40 0x7f58a012b6e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:07.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.242+0000 7f58a66ae700 1 -- 172.21.15.40:0/1640819575 >> 172.21.15.40:0/1640819575 conn(0x7f58a00975f0 msgr2=0x7f58a0097a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:07.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.242+0000 7f58a66ae700 1 -- 172.21.15.40:0/1640819575 shutdown_connections 2023-09-30T22:22:07.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.242+0000 7f58a66ae700 1 -- 172.21.15.40:0/1640819575 wait complete. 2023-09-30T22:22:07.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.242+0000 7f58a66ae700 1 Processor -- start 2023-09-30T22:22:07.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.243+0000 7f58a66ae700 1 -- start start 2023-09-30T22:22:07.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.243+0000 7f58a66ae700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58a005e090 0x7f58a0124fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:07.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.243+0000 7f58a66ae700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58a012fed0 0x7f58a012bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:07.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.243+0000 7f58a66ae700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f58a012c190 0x7f58a012c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:07.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.243+0000 7f58a66ae700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a0111360 con 0x7f58a012fed0 2023-09-30T22:22:07.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.243+0000 7f58a66ae700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a0111170 con 0x7f58a005e090 2023-09-30T22:22:07.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.243+0000 7f58a66ae700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58a012f430 con 0x7f58a012c190 2023-09-30T22:22:07.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.243+0000 7f589ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58a005e090 0x7f58a0124fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:07.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.243+0000 7f589f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58a012fed0 0x7f58a012bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:07.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.243+0000 7f589ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58a005e090 0x7f58a0124fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:46688/0 (socket says 172.21.15.40:46688) 2023-09-30T22:22:07.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.243+0000 7f589ffff700 1 -- 172.21.15.40:0/3932782564 learned_addr learned my addr 172.21.15.40:0/3932782564 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:07.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.243+0000 7f58a4c4b700 1 --2- 172.21.15.40:0/3932782564 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f58a012c190 0x7f58a012c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:07.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.244+0000 7f589ffff700 1 -- 172.21.15.40:0/3932782564 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f58a012c190 msgr2=0x7f58a012c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:07.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.244+0000 7f589ffff700 1 --2- 172.21.15.40:0/3932782564 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f58a012c190 0x7f58a012c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:07.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.244+0000 7f589ffff700 1 -- 172.21.15.40:0/3932782564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58a012fed0 msgr2=0x7f58a012bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:07.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.244+0000 7f589ffff700 1 --2- 172.21.15.40:0/3932782564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58a012fed0 0x7f58a012bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:07.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.244+0000 7f589ffff700 1 -- 172.21.15.40:0/3932782564 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5898009a20 con 0x7f58a005e090 2023-09-30T22:22:07.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.244+0000 7f58a4c4b700 1 --2- 172.21.15.40:0/3932782564 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f58a012c190 0x7f58a012c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:07.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.244+0000 7f589f7fe700 1 --2- 172.21.15.40:0/3932782564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58a012fed0 0x7f58a012bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:07.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.244+0000 7f589ffff700 1 --2- 172.21.15.40:0/3932782564 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58a005e090 0x7f58a0124fb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f589000c4c0 tx=0x7f5890007c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:07.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.244+0000 7f5887fff700 1 -- 172.21.15.40:0/3932782564 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58900072e0 con 0x7f58a005e090 2023-09-30T22:22:07.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.244+0000 7f5887fff700 1 -- 172.21.15.40:0/3932782564 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5890007460 con 0x7f58a005e090 2023-09-30T22:22:07.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.244+0000 7f58a66ae700 1 -- 172.21.15.40:0/3932782564 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5894009370 con 0x7f58a005e090 2023-09-30T22:22:07.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.244+0000 7f5887fff700 1 -- 172.21.15.40:0/3932782564 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5890005930 con 0x7f58a005e090 2023-09-30T22:22:07.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.244+0000 7f58a66ae700 1 -- 172.21.15.40:0/3932782564 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a012d0a0 con 0x7f58a005e090 2023-09-30T22:22:07.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.245+0000 7f5887fff700 1 -- 172.21.15.40:0/3932782564 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f5890005ce0 con 0x7f58a005e090 2023-09-30T22:22:07.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.245+0000 7f5887fff700 1 -- 172.21.15.40:0/3932782564 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f589003a670 con 0x7f58a005e090 2023-09-30T22:22:07.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.245+0000 7f58a66ae700 1 -- 172.21.15.40:0/3932782564 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a012cac0 con 0x7f58a005e090 2023-09-30T22:22:07.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.249+0000 7f5887fff700 1 -- 172.21.15.40:0/3932782564 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f589001d3f0 con 0x7f58a005e090 2023-09-30T22:22:07.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.481+0000 7f58a66ae700 1 -- 172.21.15.40:0/3932782564 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f58a0096e00 con 0x7f58a005e090 2023-09-30T22:22:07.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.482+0000 7f5887fff700 1 -- 172.21.15.40:0/3932782564 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1024 (secure 0 0 0) 0x7f589001c350 con 0x7f58a005e090 2023-09-30T22:22:07.481 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:22:07.481 INFO:teuthology.orchestra.run.smithi040.stdout:{"fsid":"79dd4d8e-f295-4d9c-bd93-9850863800e3","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":20,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":17,"num_osds":4,"num_up_osds":4,"osd_up_since":1696112514,"num_in_osds":4,"osd_in_since":1696112508,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":57},{"state_name":"unknown","count":48}],"num_pgs":105,"num_pools":4,"num_objects":10,"data_bytes":666,"bytes_used":1217454080,"bytes_avail":385329602560,"bytes_total":386547056640,"unknown_pgs_ratio":0.45714285969734192},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4194}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-09-30T22:21:46.981190+0000","services":{}},"progress_events":{}} 2023-09-30T22:22:07.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.484+0000 7f58a66ae700 1 -- 172.21.15.40:0/3932782564 >> v1:172.21.15.40:6816/118905 conn(0x7f588c02bb60 legacy=0x7f588c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:07.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.484+0000 7f58a66ae700 1 -- 172.21.15.40:0/3932782564 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58a005e090 msgr2=0x7f58a0124fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:07.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.484+0000 7f58a66ae700 1 --2- 172.21.15.40:0/3932782564 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58a005e090 0x7f58a0124fb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f589000c4c0 tx=0x7f5890007c10).stop 2023-09-30T22:22:07.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.484+0000 7f58a66ae700 1 -- 172.21.15.40:0/3932782564 shutdown_connections 2023-09-30T22:22:07.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.484+0000 7f58a66ae700 1 --2- 172.21.15.40:0/3932782564 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f58a012c190 0x7f58a012c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:07.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.484+0000 7f58a66ae700 1 --2- 172.21.15.40:0/3932782564 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58a005e090 0x7f58a0124fb0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:07.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.484+0000 7f58a66ae700 1 --2- 172.21.15.40:0/3932782564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58a012fed0 0x7f58a012bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:07.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.484+0000 7f58a66ae700 1 -- 172.21.15.40:0/3932782564 >> 172.21.15.40:0/3932782564 conn(0x7f58a00975f0 msgr2=0x7f58a0098900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:07.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.484+0000 7f58a66ae700 1 -- 172.21.15.40:0/3932782564 shutdown_connections 2023-09-30T22:22:07.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.484+0000 7f58a66ae700 1 -- 172.21.15.40:0/3932782564 wait complete. 2023-09-30T22:22:07.495 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-09-30T22:22:07.495 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:22:07.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.615+0000 7f75ace21700 1 Processor -- start 2023-09-30T22:22:07.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.615+0000 7f75ace21700 1 -- start start 2023-09-30T22:22:07.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.615+0000 7f75ace21700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f75a8093930 0x7f75a80957b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:07.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.615+0000 7f75ace21700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75a8095ca0 0x7f75a80960a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:07.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.615+0000 7f75ace21700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75a812c2f0 0x7f75a812e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:07.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.616+0000 7f75ace21700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a8093d10 con 0x7f75a8093930 2023-09-30T22:22:07.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.616+0000 7f75ace21700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a80940d0 con 0x7f75a8095ca0 2023-09-30T22:22:07.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.616+0000 7f75ace21700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75a8094b30 con 0x7f75a812c2f0 2023-09-30T22:22:07.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.616+0000 7f75a659c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f75a8093930 0x7f75a80957b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:07.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.616+0000 7f759ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75a8095ca0 0x7f75a80960a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:07.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.616+0000 7f75a6d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75a812c2f0 0x7f75a812e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:07.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.616+0000 7f75a659c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f75a8093930 0x7f75a80957b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46492/0 (socket says 172.21.15.40:46492) 2023-09-30T22:22:07.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.616+0000 7f759ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75a8095ca0 0x7f75a80960a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:46702/0 (socket says 172.21.15.40:46702) 2023-09-30T22:22:07.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.616+0000 7f75a6d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75a812c2f0 0x7f75a812e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60044/0 (socket says 172.21.15.40:60044) 2023-09-30T22:22:07.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.616+0000 7f75a659c700 1 -- 172.21.15.40:0/1549272680 learned_addr learned my addr 172.21.15.40:0/1549272680 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:07.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.616+0000 7f75a659c700 1 -- 172.21.15.40:0/1549272680 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75a812c2f0 msgr2=0x7f75a812e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:07.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.616+0000 7f75a659c700 1 --2- 172.21.15.40:0/1549272680 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75a812c2f0 0x7f75a812e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:07.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.616+0000 7f75a659c700 1 -- 172.21.15.40:0/1549272680 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75a8095ca0 msgr2=0x7f75a80960a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:07.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.616+0000 7f75a659c700 1 --2- 172.21.15.40:0/1549272680 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75a8095ca0 0x7f75a80960a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:07.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.616+0000 7f75a659c700 1 -- 172.21.15.40:0/1549272680 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a8091a40 con 0x7f75a8093930 2023-09-30T22:22:07.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.616+0000 7f75a6d9d700 1 --2- 172.21.15.40:0/1549272680 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75a812c2f0 0x7f75a812e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:07.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.616+0000 7f759ffff700 1 --2- 172.21.15.40:0/1549272680 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75a8095ca0 0x7f75a80960a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:07.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.616+0000 7f75a659c700 1 --2- 172.21.15.40:0/1549272680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75a8093930 0x7f75a80957b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f7598006fd0 tx=0x7f75980090f0).ready entity=mon.0 client_cookie=3eea638ba0b22e4e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:07.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.616+0000 7f75a5d9b700 1 -- 172.21.15.40:0/1549272680 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759800f510 con 0x7f75a8093930 2023-09-30T22:22:07.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.616+0000 7f75a5d9b700 1 -- 172.21.15.40:0/1549272680 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759800f670 con 0x7f75a8093930 2023-09-30T22:22:07.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.616+0000 7f75a5d9b700 1 -- 172.21.15.40:0/1549272680 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759800fa10 con 0x7f75a8093930 2023-09-30T22:22:07.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.617+0000 7f75ace21700 1 -- 172.21.15.40:0/1549272680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75a8093930 msgr2=0x7f75a80957b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:07.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.617+0000 7f75ace21700 1 --2- 172.21.15.40:0/1549272680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75a8093930 0x7f75a80957b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f7598006fd0 tx=0x7f75980090f0).stop 2023-09-30T22:22:07.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.617+0000 7f75ace21700 1 -- 172.21.15.40:0/1549272680 shutdown_connections 2023-09-30T22:22:07.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.617+0000 7f75ace21700 1 --2- 172.21.15.40:0/1549272680 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75a812c2f0 0x7f75a812e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:07.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.617+0000 7f75ace21700 1 --2- 172.21.15.40:0/1549272680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75a8093930 0x7f75a80957b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:07.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.617+0000 7f75ace21700 1 --2- 172.21.15.40:0/1549272680 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75a8095ca0 0x7f75a80960a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:07.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.617+0000 7f75ace21700 1 -- 172.21.15.40:0/1549272680 >> 172.21.15.40:0/1549272680 conn(0x7f75a8097580 msgr2=0x7f75a8097990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:07.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.617+0000 7f75ace21700 1 -- 172.21.15.40:0/1549272680 shutdown_connections 2023-09-30T22:22:07.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.617+0000 7f75ace21700 1 -- 172.21.15.40:0/1549272680 wait complete. 2023-09-30T22:22:07.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.618+0000 7f75ace21700 1 Processor -- start 2023-09-30T22:22:07.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.618+0000 7f75ace21700 1 -- start start 2023-09-30T22:22:07.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.618+0000 7f75ace21700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75a8093930 0x7f75a8118160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:07.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.618+0000 7f75ace21700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75a8095ca0 0x7f75a8118650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:07.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.618+0000 7f75ace21700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75a812c2f0 0x7f75a8118b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:07.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.618+0000 7f75ace21700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a8119030 con 0x7f75a8095ca0 2023-09-30T22:22:07.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.618+0000 7f75ace21700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a8119ce0 con 0x7f75a8093930 2023-09-30T22:22:07.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.618+0000 7f75ace21700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75a8119ed0 con 0x7f75a812c2f0 2023-09-30T22:22:07.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.618+0000 7f75a659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75a8093930 0x7f75a8118160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:07.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.618+0000 7f75a659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75a8093930 0x7f75a8118160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:46712/0 (socket says 172.21.15.40:46712) 2023-09-30T22:22:07.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.618+0000 7f75a6d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75a812c2f0 0x7f75a8118b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:07.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.618+0000 7f75a659c700 1 -- 172.21.15.40:0/2684623759 learned_addr learned my addr 172.21.15.40:0/2684623759 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:07.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.618+0000 7f759ffff700 1 --2- 172.21.15.40:0/2684623759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75a8095ca0 0x7f75a8118650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:07.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.619+0000 7f75a659c700 1 -- 172.21.15.40:0/2684623759 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75a812c2f0 msgr2=0x7f75a8118b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:07.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.619+0000 7f75a659c700 1 --2- 172.21.15.40:0/2684623759 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75a812c2f0 0x7f75a8118b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:07.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.619+0000 7f75a659c700 1 -- 172.21.15.40:0/2684623759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75a8095ca0 msgr2=0x7f75a8118650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:07.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.619+0000 7f75a659c700 1 --2- 172.21.15.40:0/2684623759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75a8095ca0 0x7f75a8118650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:07.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.619+0000 7f75a659c700 1 -- 172.21.15.40:0/2684623759 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75900092a0 con 0x7f75a8093930 2023-09-30T22:22:07.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.619+0000 7f75a6d9d700 1 --2- 172.21.15.40:0/2684623759 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75a812c2f0 0x7f75a8118b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:07.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.619+0000 7f75a659c700 1 --2- 172.21.15.40:0/2684623759 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75a8093930 0x7f75a8118160 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f7598009df0 tx=0x7f7598017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:07.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.619+0000 7f759e7fc700 1 -- 172.21.15.40:0/2684623759 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7598000bc0 con 0x7f75a8093930 2023-09-30T22:22:07.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.619+0000 7f759e7fc700 1 -- 172.21.15.40:0/2684623759 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759800f7e0 con 0x7f75a8093930 2023-09-30T22:22:07.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.619+0000 7f75ace21700 1 -- 172.21.15.40:0/2684623759 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a0009a20 con 0x7f75a8093930 2023-09-30T22:22:07.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.619+0000 7f759e7fc700 1 -- 172.21.15.40:0/2684623759 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7598000d20 con 0x7f75a8093930 2023-09-30T22:22:07.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.619+0000 7f75ace21700 1 -- 172.21.15.40:0/2684623759 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7598009370 con 0x7f75a8093930 2023-09-30T22:22:07.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.620+0000 7f759e7fc700 1 -- 172.21.15.40:0/2684623759 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f7598021070 con 0x7f75a8093930 2023-09-30T22:22:07.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.620+0000 7f759e7fc700 1 -- 172.21.15.40:0/2684623759 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f759803c8a0 con 0x7f75a8093930 2023-09-30T22:22:07.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.620+0000 7f75ace21700 1 -- 172.21.15.40:0/2684623759 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a811bb00 con 0x7f75a8093930 2023-09-30T22:22:07.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.624+0000 7f759e7fc700 1 -- 172.21.15.40:0/2684623759 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f759802d3f0 con 0x7f75a8093930 2023-09-30T22:22:07.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.790+0000 7f75ace21700 1 -- 172.21.15.40:0/2684623759 --> v1:172.21.15.40:6816/118905 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f75a806a6b0 con 0x7f758802bb60 2023-09-30T22:22:07.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.797+0000 7f759e7fc700 1 -- 172.21.15.40:0/2684623759 <== mgr.4101 v1:172.21.15.40:6816/118905 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+250003 (unknown 2965378022 0 4131087079) 0x7f75a806a6b0 con 0x7f758802bb60 2023-09-30T22:22:07.799 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:22:07.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.799+0000 7f75ace21700 1 -- 172.21.15.40:0/2684623759 >> v1:172.21.15.40:6816/118905 conn(0x7f758802bb60 legacy=0x7f758802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:07.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.799+0000 7f75ace21700 1 -- 172.21.15.40:0/2684623759 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75a8093930 msgr2=0x7f75a8118160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:07.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.799+0000 7f75ace21700 1 --2- 172.21.15.40:0/2684623759 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75a8093930 0x7f75a8118160 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f7598009df0 tx=0x7f7598017000).stop 2023-09-30T22:22:07.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.799+0000 7f75ace21700 1 -- 172.21.15.40:0/2684623759 shutdown_connections 2023-09-30T22:22:07.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.799+0000 7f75ace21700 1 --2- 172.21.15.40:0/2684623759 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75a812c2f0 0x7f75a8118b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:07.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.799+0000 7f75ace21700 1 --2- 172.21.15.40:0/2684623759 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75a8093930 0x7f75a8118160 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:07.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.799+0000 7f75ace21700 1 --2- 172.21.15.40:0/2684623759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75a8095ca0 0x7f75a8118650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:07.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.799+0000 7f75ace21700 1 -- 172.21.15.40:0/2684623759 >> 172.21.15.40:0/2684623759 conn(0x7f75a8097580 msgr2=0x7f75a805e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:07.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.800+0000 7f75ace21700 1 -- 172.21.15.40:0/2684623759 shutdown_connections 2023-09-30T22:22:07.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:07.800+0000 7f75ace21700 1 -- 172.21.15.40:0/2684623759 wait complete. 2023-09-30T22:22:07.801 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-09-30T22:22:07.811 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-09-30T22:22:07.775801+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189020,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298340,"statfs":{"total":386547056640,"available":385329500160,"internally_reserved":0,"allocated":651264,"data_stored":192439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1640,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000465"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385416+0000","last_change":"2023-09-30T22:22:02.384090+0000","last_active":"2023-09-30T22:22:02.385416+0000","last_peered":"2023-09-30T22:22:02.385416+0000","last_clean":"2023-09-30T22:22:02.385416+0000","last_became_active":"2023-09-30T22:22:02.383805+0000","last_became_peered":"2023-09-30T22:22:02.383805+0000","last_unstale":"2023-09-30T22:22:02.385416+0000","last_undegraded":"2023-09-30T22:22:02.385416+0000","last_fullsized":"2023-09-30T22:22:02.385416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380743+0000","last_change":"2023-09-30T22:22:02.377806+0000","last_active":"2023-09-30T22:22:02.380743+0000","last_peered":"2023-09-30T22:22:02.380743+0000","last_clean":"2023-09-30T22:22:02.380743+0000","last_became_active":"2023-09-30T22:22:02.377531+0000","last_became_peered":"2023-09-30T22:22:02.377531+0000","last_unstale":"2023-09-30T22:22:02.380743+0000","last_undegraded":"2023-09-30T22:22:02.380743+0000","last_fullsized":"2023-09-30T22:22:02.380743+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385151+0000","last_change":"2023-09-30T22:22:02.379022+0000","last_active":"2023-09-30T22:22:02.385151+0000","last_peered":"2023-09-30T22:22:02.385151+0000","last_clean":"2023-09-30T22:22:02.385151+0000","last_became_active":"2023-09-30T22:22:02.378723+0000","last_became_peered":"2023-09-30T22:22:02.378723+0000","last_unstale":"2023-09-30T22:22:02.385151+0000","last_undegraded":"2023-09-30T22:22:02.385151+0000","last_fullsized":"2023-09-30T22:22:02.385151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385016+0000","last_change":"2023-09-30T22:22:02.378089+0000","last_active":"2023-09-30T22:22:02.385016+0000","last_peered":"2023-09-30T22:22:02.385016+0000","last_clean":"2023-09-30T22:22:02.385016+0000","last_became_active":"2023-09-30T22:22:02.375446+0000","last_became_peered":"2023-09-30T22:22:02.375446+0000","last_unstale":"2023-09-30T22:22:02.385016+0000","last_undegraded":"2023-09-30T22:22:02.385016+0000","last_fullsized":"2023-09-30T22:22:02.385016+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.402864+0000","last_change":"2023-09-30T22:22:02.398073+0000","last_active":"2023-09-30T22:22:02.402864+0000","last_peered":"2023-09-30T22:22:02.402864+0000","last_clean":"2023-09-30T22:22:02.402864+0000","last_became_active":"2023-09-30T22:22:02.397855+0000","last_became_peered":"2023-09-30T22:22:02.397855+0000","last_unstale":"2023-09-30T22:22:02.402864+0000","last_undegraded":"2023-09-30T22:22:02.402864+0000","last_fullsized":"2023-09-30T22:22:02.402864+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385189+0000","last_change":"2023-09-30T22:22:02.382862+0000","last_active":"2023-09-30T22:22:02.385189+0000","last_peered":"2023-09-30T22:22:02.385189+0000","last_clean":"2023-09-30T22:22:02.385189+0000","last_became_active":"2023-09-30T22:22:02.382464+0000","last_became_peered":"2023-09-30T22:22:02.382464+0000","last_unstale":"2023-09-30T22:22:02.385189+0000","last_undegraded":"2023-09-30T22:22:02.385189+0000","last_fullsized":"2023-09-30T22:22:02.385189+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.399117+0000","last_change":"2023-09-30T22:22:02.395909+0000","last_active":"2023-09-30T22:22:02.399117+0000","last_peered":"2023-09-30T22:22:02.399117+0000","last_clean":"2023-09-30T22:22:02.399117+0000","last_became_active":"2023-09-30T22:22:02.395379+0000","last_became_peered":"2023-09-30T22:22:02.395379+0000","last_unstale":"2023-09-30T22:22:02.399117+0000","last_undegraded":"2023-09-30T22:22:02.399117+0000","last_fullsized":"2023-09-30T22:22:02.399117+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393512+0000","last_change":"2023-09-30T22:22:02.382627+0000","last_active":"2023-09-30T22:22:02.393512+0000","last_peered":"2023-09-30T22:22:02.393512+0000","last_clean":"2023-09-30T22:22:02.393512+0000","last_became_active":"2023-09-30T22:22:02.382360+0000","last_became_peered":"2023-09-30T22:22:02.382360+0000","last_unstale":"2023-09-30T22:22:02.393512+0000","last_undegraded":"2023-09-30T22:22:02.393512+0000","last_fullsized":"2023-09-30T22:22:02.393512+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394788+0000","last_change":"2023-09-30T22:22:02.388864+0000","last_active":"2023-09-30T22:22:02.394788+0000","last_peered":"2023-09-30T22:22:02.394788+0000","last_clean":"2023-09-30T22:22:02.394788+0000","last_became_active":"2023-09-30T22:22:02.388267+0000","last_became_peered":"2023-09-30T22:22:02.388267+0000","last_unstale":"2023-09-30T22:22:02.394788+0000","last_undegraded":"2023-09-30T22:22:02.394788+0000","last_fullsized":"2023-09-30T22:22:02.394788+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380523+0000","last_change":"2023-09-30T22:22:02.379619+0000","last_active":"2023-09-30T22:22:02.380523+0000","last_peered":"2023-09-30T22:22:02.380523+0000","last_clean":"2023-09-30T22:22:02.380523+0000","last_became_active":"2023-09-30T22:22:02.379412+0000","last_became_peered":"2023-09-30T22:22:02.379412+0000","last_unstale":"2023-09-30T22:22:02.380523+0000","last_undegraded":"2023-09-30T22:22:02.380523+0000","last_fullsized":"2023-09-30T22:22:02.380523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.377473+0000","last_change":"2023-09-30T22:22:02.372757+0000","last_active":"2023-09-30T22:22:02.377473+0000","last_peered":"2023-09-30T22:22:02.377473+0000","last_clean":"2023-09-30T22:22:02.377473+0000","last_became_active":"2023-09-30T22:22:02.372495+0000","last_became_peered":"2023-09-30T22:22:02.372495+0000","last_unstale":"2023-09-30T22:22:02.377473+0000","last_undegraded":"2023-09-30T22:22:02.377473+0000","last_fullsized":"2023-09-30T22:22:02.377473+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380876+0000","last_change":"2023-09-30T22:22:02.379525+0000","last_active":"2023-09-30T22:22:02.380876+0000","last_peered":"2023-09-30T22:22:02.380876+0000","last_clean":"2023-09-30T22:22:02.380876+0000","last_became_active":"2023-09-30T22:22:02.379330+0000","last_became_peered":"2023-09-30T22:22:02.379330+0000","last_unstale":"2023-09-30T22:22:02.380876+0000","last_undegraded":"2023-09-30T22:22:02.380876+0000","last_fullsized":"2023-09-30T22:22:02.380876+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393834+0000","last_change":"2023-09-30T22:22:02.387803+0000","last_active":"2023-09-30T22:22:02.393834+0000","last_peered":"2023-09-30T22:22:02.393834+0000","last_clean":"2023-09-30T22:22:02.393834+0000","last_became_active":"2023-09-30T22:22:02.387560+0000","last_became_peered":"2023-09-30T22:22:02.387560+0000","last_unstale":"2023-09-30T22:22:02.393834+0000","last_undegraded":"2023-09-30T22:22:02.393834+0000","last_fullsized":"2023-09-30T22:22:02.393834+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380478+0000","last_change":"2023-09-30T22:22:02.374488+0000","last_active":"2023-09-30T22:22:02.380478+0000","last_peered":"2023-09-30T22:22:02.380478+0000","last_clean":"2023-09-30T22:22:02.380478+0000","last_became_active":"2023-09-30T22:22:02.374287+0000","last_became_peered":"2023-09-30T22:22:02.374287+0000","last_unstale":"2023-09-30T22:22:02.380478+0000","last_undegraded":"2023-09-30T22:22:02.380478+0000","last_fullsized":"2023-09-30T22:22:02.380478+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.384882+0000","last_change":"2023-09-30T22:22:02.375916+0000","last_active":"2023-09-30T22:22:02.384882+0000","last_peered":"2023-09-30T22:22:02.384882+0000","last_clean":"2023-09-30T22:22:02.384882+0000","last_became_active":"2023-09-30T22:22:02.374277+0000","last_became_peered":"2023-09-30T22:22:02.374277+0000","last_unstale":"2023-09-30T22:22:02.384882+0000","last_undegraded":"2023-09-30T22:22:02.384882+0000","last_fullsized":"2023-09-30T22:22:02.384882+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.399057+0000","last_change":"2023-09-30T22:22:02.395769+0000","last_active":"2023-09-30T22:22:02.399057+0000","last_peered":"2023-09-30T22:22:02.399057+0000","last_clean":"2023-09-30T22:22:02.399057+0000","last_became_active":"2023-09-30T22:22:02.395459+0000","last_became_peered":"2023-09-30T22:22:02.395459+0000","last_unstale":"2023-09-30T22:22:02.399057+0000","last_undegraded":"2023-09-30T22:22:02.399057+0000","last_fullsized":"2023-09-30T22:22:02.399057+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.395070+0000","last_change":"2023-09-30T22:22:02.391303+0000","last_active":"2023-09-30T22:22:02.395070+0000","last_peered":"2023-09-30T22:22:02.395070+0000","last_clean":"2023-09-30T22:22:02.395070+0000","last_became_active":"2023-09-30T22:22:02.388602+0000","last_became_peered":"2023-09-30T22:22:02.388602+0000","last_unstale":"2023-09-30T22:22:02.395070+0000","last_undegraded":"2023-09-30T22:22:02.395070+0000","last_fullsized":"2023-09-30T22:22:02.395070+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385063+0000","last_change":"2023-09-30T22:22:02.376471+0000","last_active":"2023-09-30T22:22:02.385063+0000","last_peered":"2023-09-30T22:22:02.385063+0000","last_clean":"2023-09-30T22:22:02.385063+0000","last_became_active":"2023-09-30T22:22:02.374833+0000","last_became_peered":"2023-09-30T22:22:02.374833+0000","last_unstale":"2023-09-30T22:22:02.385063+0000","last_undegraded":"2023-09-30T22:22:02.385063+0000","last_fullsized":"2023-09-30T22:22:02.385063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385397+0000","last_change":"2023-09-30T22:22:02.383103+0000","last_active":"2023-09-30T22:22:02.385397+0000","last_peered":"2023-09-30T22:22:02.385397+0000","last_clean":"2023-09-30T22:22:02.385397+0000","last_became_active":"2023-09-30T22:22:02.382818+0000","last_became_peered":"2023-09-30T22:22:02.382818+0000","last_unstale":"2023-09-30T22:22:02.385397+0000","last_undegraded":"2023-09-30T22:22:02.385397+0000","last_fullsized":"2023-09-30T22:22:02.385397+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394501+0000","last_change":"2023-09-30T22:22:02.388315+0000","last_active":"2023-09-30T22:22:02.394501+0000","last_peered":"2023-09-30T22:22:02.394501+0000","last_clean":"2023-09-30T22:22:02.394501+0000","last_became_active":"2023-09-30T22:22:02.388046+0000","last_became_peered":"2023-09-30T22:22:02.388046+0000","last_unstale":"2023-09-30T22:22:02.394501+0000","last_undegraded":"2023-09-30T22:22:02.394501+0000","last_fullsized":"2023-09-30T22:22:02.394501+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.395152+0000","last_change":"2023-09-30T22:22:02.391309+0000","last_active":"2023-09-30T22:22:02.395152+0000","last_peered":"2023-09-30T22:22:02.395152+0000","last_clean":"2023-09-30T22:22:02.395152+0000","last_became_active":"2023-09-30T22:22:02.391040+0000","last_became_peered":"2023-09-30T22:22:02.391040+0000","last_unstale":"2023-09-30T22:22:02.395152+0000","last_undegraded":"2023-09-30T22:22:02.395152+0000","last_fullsized":"2023-09-30T22:22:02.395152+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.384855+0000","last_change":"2023-09-30T22:22:02.375857+0000","last_active":"2023-09-30T22:22:02.384855+0000","last_peered":"2023-09-30T22:22:02.384855+0000","last_clean":"2023-09-30T22:22:02.384855+0000","last_became_active":"2023-09-30T22:22:02.373866+0000","last_became_peered":"2023-09-30T22:22:02.373866+0000","last_unstale":"2023-09-30T22:22:02.384855+0000","last_undegraded":"2023-09-30T22:22:02.384855+0000","last_fullsized":"2023-09-30T22:22:02.384855+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.399093+0000","last_change":"2023-09-30T22:22:02.395696+0000","last_active":"2023-09-30T22:22:02.399093+0000","last_peered":"2023-09-30T22:22:02.399093+0000","last_clean":"2023-09-30T22:22:02.399093+0000","last_became_active":"2023-09-30T22:22:02.395318+0000","last_became_peered":"2023-09-30T22:22:02.395318+0000","last_unstale":"2023-09-30T22:22:02.399093+0000","last_undegraded":"2023-09-30T22:22:02.399093+0000","last_fullsized":"2023-09-30T22:22:02.399093+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394655+0000","last_change":"2023-09-30T22:22:02.389818+0000","last_active":"2023-09-30T22:22:02.394655+0000","last_peered":"2023-09-30T22:22:02.394655+0000","last_clean":"2023-09-30T22:22:02.394655+0000","last_became_active":"2023-09-30T22:22:02.389526+0000","last_became_peered":"2023-09-30T22:22:02.389526+0000","last_unstale":"2023-09-30T22:22:02.394655+0000","last_undegraded":"2023-09-30T22:22:02.394655+0000","last_fullsized":"2023-09-30T22:22:02.394655+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394419+0000","last_change":"2023-09-30T22:22:02.386166+0000","last_active":"2023-09-30T22:22:02.394419+0000","last_peered":"2023-09-30T22:22:02.394419+0000","last_clean":"2023-09-30T22:22:02.394419+0000","last_became_active":"2023-09-30T22:22:02.385731+0000","last_became_peered":"2023-09-30T22:22:02.385731+0000","last_unstale":"2023-09-30T22:22:02.394419+0000","last_undegraded":"2023-09-30T22:22:02.394419+0000","last_fullsized":"2023-09-30T22:22:02.394419+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380502+0000","last_change":"2023-09-30T22:22:02.374713+0000","last_active":"2023-09-30T22:22:02.380502+0000","last_peered":"2023-09-30T22:22:02.380502+0000","last_clean":"2023-09-30T22:22:02.380502+0000","last_became_active":"2023-09-30T22:22:02.374467+0000","last_became_peered":"2023-09-30T22:22:02.374467+0000","last_unstale":"2023-09-30T22:22:02.380502+0000","last_undegraded":"2023-09-30T22:22:02.380502+0000","last_fullsized":"2023-09-30T22:22:02.380502+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.399018+0000","last_change":"2023-09-30T22:22:02.395766+0000","last_active":"2023-09-30T22:22:02.399018+0000","last_peered":"2023-09-30T22:22:02.399018+0000","last_clean":"2023-09-30T22:22:02.399018+0000","last_became_active":"2023-09-30T22:22:02.395487+0000","last_became_peered":"2023-09-30T22:22:02.395487+0000","last_unstale":"2023-09-30T22:22:02.399018+0000","last_undegraded":"2023-09-30T22:22:02.399018+0000","last_fullsized":"2023-09-30T22:22:02.399018+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.374558+0000","last_change":"2023-09-30T22:22:01.986896+0000","last_active":"2023-09-30T22:22:02.374558+0000","last_peered":"2023-09-30T22:22:02.374558+0000","last_clean":"2023-09-30T22:22:02.374558+0000","last_became_active":"2023-09-30T22:22:01.986600+0000","last_became_peered":"2023-09-30T22:22:01.986600+0000","last_unstale":"2023-09-30T22:22:02.374558+0000","last_undegraded":"2023-09-30T22:22:02.374558+0000","last_fullsized":"2023-09-30T22:22:02.374558+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.388602+0000","last_change":"2023-09-30T22:22:02.380769+0000","last_active":"2023-09-30T22:22:02.388602+0000","last_peered":"2023-09-30T22:22:02.388602+0000","last_clean":"2023-09-30T22:22:02.388602+0000","last_became_active":"2023-09-30T22:22:02.380403+0000","last_became_peered":"2023-09-30T22:22:02.380403+0000","last_unstale":"2023-09-30T22:22:02.388602+0000","last_undegraded":"2023-09-30T22:22:02.388602+0000","last_fullsized":"2023-09-30T22:22:02.388602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.361691+0000","last_change":"2023-09-30T22:22:01.992230+0000","last_active":"2023-09-30T22:22:02.361691+0000","last_peered":"2023-09-30T22:22:02.361691+0000","last_clean":"2023-09-30T22:22:02.361691+0000","last_became_active":"2023-09-30T22:22:01.991929+0000","last_became_peered":"2023-09-30T22:22:01.991929+0000","last_unstale":"2023-09-30T22:22:02.361691+0000","last_undegraded":"2023-09-30T22:22:02.361691+0000","last_fullsized":"2023-09-30T22:22:02.361691+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385127+0000","last_change":"2023-09-30T22:22:02.380249+0000","last_active":"2023-09-30T22:22:02.385127+0000","last_peered":"2023-09-30T22:22:02.385127+0000","last_clean":"2023-09-30T22:22:02.385127+0000","last_became_active":"2023-09-30T22:22:02.379830+0000","last_became_peered":"2023-09-30T22:22:02.379830+0000","last_unstale":"2023-09-30T22:22:02.385127+0000","last_undegraded":"2023-09-30T22:22:02.385127+0000","last_fullsized":"2023-09-30T22:22:02.385127+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.358776+0000","last_change":"2023-09-30T22:22:01.995093+0000","last_active":"2023-09-30T22:22:02.358776+0000","last_peered":"2023-09-30T22:22:02.358776+0000","last_clean":"2023-09-30T22:22:02.358776+0000","last_became_active":"2023-09-30T22:22:01.994797+0000","last_became_peered":"2023-09-30T22:22:01.994797+0000","last_unstale":"2023-09-30T22:22:02.358776+0000","last_undegraded":"2023-09-30T22:22:02.358776+0000","last_fullsized":"2023-09-30T22:22:02.358776+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394410+0000","last_change":"2023-09-30T22:22:02.383534+0000","last_active":"2023-09-30T22:22:02.394410+0000","last_peered":"2023-09-30T22:22:02.394410+0000","last_clean":"2023-09-30T22:22:02.394410+0000","last_became_active":"2023-09-30T22:22:02.383271+0000","last_became_peered":"2023-09-30T22:22:02.383271+0000","last_unstale":"2023-09-30T22:22:02.394410+0000","last_undegraded":"2023-09-30T22:22:02.394410+0000","last_fullsized":"2023-09-30T22:22:02.394410+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.364409+0000","last_change":"2023-09-30T22:22:01.997405+0000","last_active":"2023-09-30T22:22:02.364409+0000","last_peered":"2023-09-30T22:22:02.364409+0000","last_clean":"2023-09-30T22:22:02.364409+0000","last_became_active":"2023-09-30T22:22:01.997079+0000","last_became_peered":"2023-09-30T22:22:01.997079+0000","last_unstale":"2023-09-30T22:22:02.364409+0000","last_undegraded":"2023-09-30T22:22:02.364409+0000","last_fullsized":"2023-09-30T22:22:02.364409+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.384947+0000","last_change":"2023-09-30T22:22:02.381424+0000","last_active":"2023-09-30T22:22:02.384947+0000","last_peered":"2023-09-30T22:22:02.384947+0000","last_clean":"2023-09-30T22:22:02.384947+0000","last_became_active":"2023-09-30T22:22:02.380981+0000","last_became_peered":"2023-09-30T22:22:02.380981+0000","last_unstale":"2023-09-30T22:22:02.384947+0000","last_undegraded":"2023-09-30T22:22:02.384947+0000","last_fullsized":"2023-09-30T22:22:02.384947+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.368614+0000","last_change":"2023-09-30T22:22:01.995183+0000","last_active":"2023-09-30T22:22:02.368614+0000","last_peered":"2023-09-30T22:22:02.368614+0000","last_clean":"2023-09-30T22:22:02.368614+0000","last_became_active":"2023-09-30T22:22:01.994920+0000","last_became_peered":"2023-09-30T22:22:01.994920+0000","last_unstale":"2023-09-30T22:22:02.368614+0000","last_undegraded":"2023-09-30T22:22:02.368614+0000","last_fullsized":"2023-09-30T22:22:02.368614+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.399138+0000","last_change":"2023-09-30T22:22:02.395975+0000","last_active":"2023-09-30T22:22:02.399138+0000","last_peered":"2023-09-30T22:22:02.399138+0000","last_clean":"2023-09-30T22:22:02.399138+0000","last_became_active":"2023-09-30T22:22:02.395719+0000","last_became_peered":"2023-09-30T22:22:02.395719+0000","last_unstale":"2023-09-30T22:22:02.399138+0000","last_undegraded":"2023-09-30T22:22:02.399138+0000","last_fullsized":"2023-09-30T22:22:02.399138+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.398556+0000","last_change":"2023-09-30T22:22:01.998235+0000","last_active":"2023-09-30T22:22:02.398556+0000","last_peered":"2023-09-30T22:22:02.398556+0000","last_clean":"2023-09-30T22:22:02.398556+0000","last_became_active":"2023-09-30T22:22:01.997649+0000","last_became_peered":"2023-09-30T22:22:01.997649+0000","last_unstale":"2023-09-30T22:22:02.398556+0000","last_undegraded":"2023-09-30T22:22:02.398556+0000","last_fullsized":"2023-09-30T22:22:02.398556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394877+0000","last_change":"2023-09-30T22:22:02.390318+0000","last_active":"2023-09-30T22:22:02.394877+0000","last_peered":"2023-09-30T22:22:02.394877+0000","last_clean":"2023-09-30T22:22:02.394877+0000","last_became_active":"2023-09-30T22:22:02.390020+0000","last_became_peered":"2023-09-30T22:22:02.390020+0000","last_unstale":"2023-09-30T22:22:02.394877+0000","last_undegraded":"2023-09-30T22:22:02.394877+0000","last_fullsized":"2023-09-30T22:22:02.394877+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"16'6","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.404225+0000","last_change":"2023-09-30T22:22:01.993933+0000","last_active":"2023-09-30T22:22:02.404225+0000","last_peered":"2023-09-30T22:22:02.404225+0000","last_clean":"2023-09-30T22:22:02.404225+0000","last_became_active":"2023-09-30T22:22:01.993574+0000","last_became_peered":"2023-09-30T22:22:01.993574+0000","last_unstale":"2023-09-30T22:22:02.404225+0000","last_undegraded":"2023-09-30T22:22:02.404225+0000","last_fullsized":"2023-09-30T22:22:02.404225+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393799+0000","last_change":"2023-09-30T22:22:02.387576+0000","last_active":"2023-09-30T22:22:02.393799+0000","last_peered":"2023-09-30T22:22:02.393799+0000","last_clean":"2023-09-30T22:22:02.393799+0000","last_became_active":"2023-09-30T22:22:02.387235+0000","last_became_peered":"2023-09-30T22:22:02.387235+0000","last_unstale":"2023-09-30T22:22:02.393799+0000","last_undegraded":"2023-09-30T22:22:02.393799+0000","last_fullsized":"2023-09-30T22:22:02.393799+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.397834+0000","last_change":"2023-09-30T22:22:01.995522+0000","last_active":"2023-09-30T22:22:02.397834+0000","last_peered":"2023-09-30T22:22:02.397834+0000","last_clean":"2023-09-30T22:22:02.397834+0000","last_became_active":"2023-09-30T22:22:01.994928+0000","last_became_peered":"2023-09-30T22:22:01.994928+0000","last_unstale":"2023-09-30T22:22:02.397834+0000","last_undegraded":"2023-09-30T22:22:02.397834+0000","last_fullsized":"2023-09-30T22:22:02.397834+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394448+0000","last_change":"2023-09-30T22:22:02.383942+0000","last_active":"2023-09-30T22:22:02.394448+0000","last_peered":"2023-09-30T22:22:02.394448+0000","last_clean":"2023-09-30T22:22:02.394448+0000","last_became_active":"2023-09-30T22:22:02.383663+0000","last_became_peered":"2023-09-30T22:22:02.383663+0000","last_unstale":"2023-09-30T22:22:02.394448+0000","last_undegraded":"2023-09-30T22:22:02.394448+0000","last_fullsized":"2023-09-30T22:22:02.394448+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.360247+0000","last_change":"2023-09-30T22:22:01.997424+0000","last_active":"2023-09-30T22:22:02.360247+0000","last_peered":"2023-09-30T22:22:02.360247+0000","last_clean":"2023-09-30T22:22:02.360247+0000","last_became_active":"2023-09-30T22:22:01.997098+0000","last_became_peered":"2023-09-30T22:22:01.997098+0000","last_unstale":"2023-09-30T22:22:02.360247+0000","last_undegraded":"2023-09-30T22:22:02.360247+0000","last_fullsized":"2023-09-30T22:22:02.360247+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.399142+0000","last_change":"2023-09-30T22:22:02.396425+0000","last_active":"2023-09-30T22:22:02.399142+0000","last_peered":"2023-09-30T22:22:02.399142+0000","last_clean":"2023-09-30T22:22:02.399142+0000","last_became_active":"2023-09-30T22:22:02.396152+0000","last_became_peered":"2023-09-30T22:22:02.396152+0000","last_unstale":"2023-09-30T22:22:02.399142+0000","last_undegraded":"2023-09-30T22:22:02.399142+0000","last_fullsized":"2023-09-30T22:22:02.399142+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.363664+0000","last_change":"2023-09-30T22:22:01.994313+0000","last_active":"2023-09-30T22:22:02.363664+0000","last_peered":"2023-09-30T22:22:02.363664+0000","last_clean":"2023-09-30T22:22:02.363664+0000","last_became_active":"2023-09-30T22:22:01.993994+0000","last_became_peered":"2023-09-30T22:22:01.993994+0000","last_unstale":"2023-09-30T22:22:02.363664+0000","last_undegraded":"2023-09-30T22:22:02.363664+0000","last_fullsized":"2023-09-30T22:22:02.363664+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.395039+0000","last_change":"2023-09-30T22:22:02.391210+0000","last_active":"2023-09-30T22:22:02.395039+0000","last_peered":"2023-09-30T22:22:02.395039+0000","last_clean":"2023-09-30T22:22:02.395039+0000","last_became_active":"2023-09-30T22:22:02.390937+0000","last_became_peered":"2023-09-30T22:22:02.390937+0000","last_unstale":"2023-09-30T22:22:02.395039+0000","last_undegraded":"2023-09-30T22:22:02.395039+0000","last_fullsized":"2023-09-30T22:22:02.395039+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.389161+0000","last_change":"2023-09-30T22:22:01.974848+0000","last_active":"2023-09-30T22:22:02.389161+0000","last_peered":"2023-09-30T22:22:02.389161+0000","last_clean":"2023-09-30T22:22:02.389161+0000","last_became_active":"2023-09-30T22:22:01.974025+0000","last_became_peered":"2023-09-30T22:22:01.974025+0000","last_unstale":"2023-09-30T22:22:02.389161+0000","last_undegraded":"2023-09-30T22:22:02.389161+0000","last_fullsized":"2023-09-30T22:22:02.389161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394389+0000","last_change":"2023-09-30T22:22:02.383497+0000","last_active":"2023-09-30T22:22:02.394389+0000","last_peered":"2023-09-30T22:22:02.394389+0000","last_clean":"2023-09-30T22:22:02.394389+0000","last_became_active":"2023-09-30T22:22:02.383215+0000","last_became_peered":"2023-09-30T22:22:02.383215+0000","last_unstale":"2023-09-30T22:22:02.394389+0000","last_undegraded":"2023-09-30T22:22:02.394389+0000","last_fullsized":"2023-09-30T22:22:02.394389+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393941+0000","last_change":"2023-09-30T22:22:01.979910+0000","last_active":"2023-09-30T22:22:02.393941+0000","last_peered":"2023-09-30T22:22:02.393941+0000","last_clean":"2023-09-30T22:22:02.393941+0000","last_became_active":"2023-09-30T22:22:01.979649+0000","last_became_peered":"2023-09-30T22:22:01.979649+0000","last_unstale":"2023-09-30T22:22:02.393941+0000","last_undegraded":"2023-09-30T22:22:02.393941+0000","last_fullsized":"2023-09-30T22:22:02.393941+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.384926+0000","last_change":"2023-09-30T22:22:02.381246+0000","last_active":"2023-09-30T22:22:02.384926+0000","last_peered":"2023-09-30T22:22:02.384926+0000","last_clean":"2023-09-30T22:22:02.384926+0000","last_became_active":"2023-09-30T22:22:02.380654+0000","last_became_peered":"2023-09-30T22:22:02.380654+0000","last_unstale":"2023-09-30T22:22:02.384926+0000","last_undegraded":"2023-09-30T22:22:02.384926+0000","last_fullsized":"2023-09-30T22:22:02.384926+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.386375+0000","last_change":"2023-09-30T22:22:01.990442+0000","last_active":"2023-09-30T22:22:02.386375+0000","last_peered":"2023-09-30T22:22:02.386375+0000","last_clean":"2023-09-30T22:22:02.386375+0000","last_became_active":"2023-09-30T22:22:01.990217+0000","last_became_peered":"2023-09-30T22:22:01.990217+0000","last_unstale":"2023-09-30T22:22:02.386375+0000","last_undegraded":"2023-09-30T22:22:02.386375+0000","last_fullsized":"2023-09-30T22:22:02.386375+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394816+0000","last_change":"2023-09-30T22:22:02.390201+0000","last_active":"2023-09-30T22:22:02.394816+0000","last_peered":"2023-09-30T22:22:02.394816+0000","last_clean":"2023-09-30T22:22:02.394816+0000","last_became_active":"2023-09-30T22:22:02.389897+0000","last_became_peered":"2023-09-30T22:22:02.389897+0000","last_unstale":"2023-09-30T22:22:02.394816+0000","last_undegraded":"2023-09-30T22:22:02.394816+0000","last_fullsized":"2023-09-30T22:22:02.394816+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.395355+0000","last_change":"2023-09-30T22:22:01.996439+0000","last_active":"2023-09-30T22:22:02.395355+0000","last_peered":"2023-09-30T22:22:02.395355+0000","last_clean":"2023-09-30T22:22:02.395355+0000","last_became_active":"2023-09-30T22:22:01.996114+0000","last_became_peered":"2023-09-30T22:22:01.996114+0000","last_unstale":"2023-09-30T22:22:02.395355+0000","last_undegraded":"2023-09-30T22:22:02.395355+0000","last_fullsized":"2023-09-30T22:22:02.395355+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393352+0000","last_change":"2023-09-30T22:22:02.384428+0000","last_active":"2023-09-30T22:22:02.393352+0000","last_peered":"2023-09-30T22:22:02.393352+0000","last_clean":"2023-09-30T22:22:02.393352+0000","last_became_active":"2023-09-30T22:22:02.383704+0000","last_became_peered":"2023-09-30T22:22:02.383704+0000","last_unstale":"2023-09-30T22:22:02.393352+0000","last_undegraded":"2023-09-30T22:22:02.393352+0000","last_fullsized":"2023-09-30T22:22:02.393352+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.361009+0000","last_change":"2023-09-30T22:22:01.998688+0000","last_active":"2023-09-30T22:22:02.361009+0000","last_peered":"2023-09-30T22:22:02.361009+0000","last_clean":"2023-09-30T22:22:02.361009+0000","last_became_active":"2023-09-30T22:22:01.998390+0000","last_became_peered":"2023-09-30T22:22:01.998390+0000","last_unstale":"2023-09-30T22:22:02.361009+0000","last_undegraded":"2023-09-30T22:22:02.361009+0000","last_fullsized":"2023-09-30T22:22:02.361009+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385081+0000","last_change":"2023-09-30T22:22:02.376261+0000","last_active":"2023-09-30T22:22:02.385081+0000","last_peered":"2023-09-30T22:22:02.385081+0000","last_clean":"2023-09-30T22:22:02.385081+0000","last_became_active":"2023-09-30T22:22:02.375940+0000","last_became_peered":"2023-09-30T22:22:02.375940+0000","last_unstale":"2023-09-30T22:22:02.385081+0000","last_undegraded":"2023-09-30T22:22:02.385081+0000","last_fullsized":"2023-09-30T22:22:02.385081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.397715+0000","last_change":"2023-09-30T22:22:01.995642+0000","last_active":"2023-09-30T22:22:02.397715+0000","last_peered":"2023-09-30T22:22:02.397715+0000","last_clean":"2023-09-30T22:22:02.397715+0000","last_became_active":"2023-09-30T22:22:01.995224+0000","last_became_peered":"2023-09-30T22:22:01.995224+0000","last_unstale":"2023-09-30T22:22:02.397715+0000","last_undegraded":"2023-09-30T22:22:02.397715+0000","last_fullsized":"2023-09-30T22:22:02.397715+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394834+0000","last_change":"2023-09-30T22:22:02.390443+0000","last_active":"2023-09-30T22:22:02.394834+0000","last_peered":"2023-09-30T22:22:02.394834+0000","last_clean":"2023-09-30T22:22:02.394834+0000","last_became_active":"2023-09-30T22:22:02.390261+0000","last_became_peered":"2023-09-30T22:22:02.390261+0000","last_unstale":"2023-09-30T22:22:02.394834+0000","last_undegraded":"2023-09-30T22:22:02.394834+0000","last_fullsized":"2023-09-30T22:22:02.394834+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.363042+0000","last_change":"2023-09-30T22:22:01.995738+0000","last_active":"2023-09-30T22:22:02.363042+0000","last_peered":"2023-09-30T22:22:02.363042+0000","last_clean":"2023-09-30T22:22:02.363042+0000","last_became_active":"2023-09-30T22:22:01.994552+0000","last_became_peered":"2023-09-30T22:22:01.994552+0000","last_unstale":"2023-09-30T22:22:02.363042+0000","last_undegraded":"2023-09-30T22:22:02.363042+0000","last_fullsized":"2023-09-30T22:22:02.363042+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.388642+0000","last_change":"2023-09-30T22:22:02.382026+0000","last_active":"2023-09-30T22:22:02.388642+0000","last_peered":"2023-09-30T22:22:02.388642+0000","last_clean":"2023-09-30T22:22:02.388642+0000","last_became_active":"2023-09-30T22:22:02.378486+0000","last_became_peered":"2023-09-30T22:22:02.378486+0000","last_unstale":"2023-09-30T22:22:02.388642+0000","last_undegraded":"2023-09-30T22:22:02.388642+0000","last_fullsized":"2023-09-30T22:22:02.388642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.359669+0000","last_change":"2023-09-30T22:22:01.994235+0000","last_active":"2023-09-30T22:22:02.359669+0000","last_peered":"2023-09-30T22:22:02.359669+0000","last_clean":"2023-09-30T22:22:02.359669+0000","last_became_active":"2023-09-30T22:22:01.993882+0000","last_became_peered":"2023-09-30T22:22:01.993882+0000","last_unstale":"2023-09-30T22:22:02.359669+0000","last_undegraded":"2023-09-30T22:22:02.359669+0000","last_fullsized":"2023-09-30T22:22:02.359669+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393722+0000","last_change":"2023-09-30T22:22:02.386102+0000","last_active":"2023-09-30T22:22:02.393722+0000","last_peered":"2023-09-30T22:22:02.393722+0000","last_clean":"2023-09-30T22:22:02.393722+0000","last_became_active":"2023-09-30T22:22:02.384968+0000","last_became_peered":"2023-09-30T22:22:02.384968+0000","last_unstale":"2023-09-30T22:22:02.393722+0000","last_undegraded":"2023-09-30T22:22:02.393722+0000","last_fullsized":"2023-09-30T22:22:02.393722+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.358511+0000","last_change":"2023-09-30T22:22:01.995015+0000","last_active":"2023-09-30T22:22:02.358511+0000","last_peered":"2023-09-30T22:22:02.358511+0000","last_clean":"2023-09-30T22:22:02.358511+0000","last_became_active":"2023-09-30T22:22:01.994743+0000","last_became_peered":"2023-09-30T22:22:01.994743+0000","last_unstale":"2023-09-30T22:22:02.358511+0000","last_undegraded":"2023-09-30T22:22:02.358511+0000","last_fullsized":"2023-09-30T22:22:02.358511+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394399+0000","last_change":"2023-09-30T22:22:02.385985+0000","last_active":"2023-09-30T22:22:02.394399+0000","last_peered":"2023-09-30T22:22:02.394399+0000","last_clean":"2023-09-30T22:22:02.394399+0000","last_became_active":"2023-09-30T22:22:02.385413+0000","last_became_peered":"2023-09-30T22:22:02.385413+0000","last_unstale":"2023-09-30T22:22:02.394399+0000","last_undegraded":"2023-09-30T22:22:02.394399+0000","last_fullsized":"2023-09-30T22:22:02.394399+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.359640+0000","last_change":"2023-09-30T22:21:58.403636+0000","last_active":"2023-09-30T22:22:02.359640+0000","last_peered":"2023-09-30T22:22:02.359640+0000","last_clean":"2023-09-30T22:22:02.359640+0000","last_became_active":"2023-09-30T22:21:58.403342+0000","last_became_peered":"2023-09-30T22:21:58.403342+0000","last_unstale":"2023-09-30T22:22:02.359640+0000","last_undegraded":"2023-09-30T22:22:02.359640+0000","last_fullsized":"2023-09-30T22:22:02.359640+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.364135+0000","last_change":"2023-09-30T22:22:01.997724+0000","last_active":"2023-09-30T22:22:02.364135+0000","last_peered":"2023-09-30T22:22:02.364135+0000","last_clean":"2023-09-30T22:22:02.364135+0000","last_became_active":"2023-09-30T22:22:01.997451+0000","last_became_peered":"2023-09-30T22:22:01.997451+0000","last_unstale":"2023-09-30T22:22:02.364135+0000","last_undegraded":"2023-09-30T22:22:02.364135+0000","last_fullsized":"2023-09-30T22:22:02.364135+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394856+0000","last_change":"2023-09-30T22:22:02.389982+0000","last_active":"2023-09-30T22:22:02.394856+0000","last_peered":"2023-09-30T22:22:02.394856+0000","last_clean":"2023-09-30T22:22:02.394856+0000","last_became_active":"2023-09-30T22:22:02.389680+0000","last_became_peered":"2023-09-30T22:22:02.389680+0000","last_unstale":"2023-09-30T22:22:02.394856+0000","last_undegraded":"2023-09-30T22:22:02.394856+0000","last_fullsized":"2023-09-30T22:22:02.394856+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.363445+0000","last_change":"2023-09-30T22:21:57.839392+0000","last_active":"2023-09-30T22:22:02.363445+0000","last_peered":"2023-09-30T22:22:02.363445+0000","last_clean":"2023-09-30T22:22:02.363445+0000","last_became_active":"2023-09-30T22:21:57.838993+0000","last_became_peered":"2023-09-30T22:21:57.838993+0000","last_unstale":"2023-09-30T22:22:02.363445+0000","last_undegraded":"2023-09-30T22:22:02.363445+0000","last_fullsized":"2023-09-30T22:22:02.363445+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.363117+0000","last_change":"2023-09-30T22:22:01.990265+0000","last_active":"2023-09-30T22:22:02.363117+0000","last_peered":"2023-09-30T22:22:02.363117+0000","last_clean":"2023-09-30T22:22:02.363117+0000","last_became_active":"2023-09-30T22:22:01.990011+0000","last_became_peered":"2023-09-30T22:22:01.990011+0000","last_unstale":"2023-09-30T22:22:02.363117+0000","last_undegraded":"2023-09-30T22:22:02.363117+0000","last_fullsized":"2023-09-30T22:22:02.363117+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.383793+0000","last_change":"2023-09-30T22:22:02.374205+0000","last_active":"2023-09-30T22:22:02.383793+0000","last_peered":"2023-09-30T22:22:02.383793+0000","last_clean":"2023-09-30T22:22:02.383793+0000","last_became_active":"2023-09-30T22:22:02.373928+0000","last_became_peered":"2023-09-30T22:22:02.373928+0000","last_unstale":"2023-09-30T22:22:02.383793+0000","last_undegraded":"2023-09-30T22:22:02.383793+0000","last_fullsized":"2023-09-30T22:22:02.383793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.363749+0000","last_change":"2023-09-30T22:21:57.836160+0000","last_active":"2023-09-30T22:22:02.363749+0000","last_peered":"2023-09-30T22:22:02.363749+0000","last_clean":"2023-09-30T22:22:02.363749+0000","last_became_active":"2023-09-30T22:21:57.835792+0000","last_became_peered":"2023-09-30T22:21:57.835792+0000","last_unstale":"2023-09-30T22:22:02.363749+0000","last_undegraded":"2023-09-30T22:22:02.363749+0000","last_fullsized":"2023-09-30T22:22:02.363749+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.359810+0000","last_change":"2023-09-30T22:22:01.987700+0000","last_active":"2023-09-30T22:22:02.359810+0000","last_peered":"2023-09-30T22:22:02.359810+0000","last_clean":"2023-09-30T22:22:02.359810+0000","last_became_active":"2023-09-30T22:22:01.987358+0000","last_became_peered":"2023-09-30T22:22:01.987358+0000","last_unstale":"2023-09-30T22:22:02.359810+0000","last_undegraded":"2023-09-30T22:22:02.359810+0000","last_fullsized":"2023-09-30T22:22:02.359810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.382010+0000","last_change":"2023-09-30T22:22:02.379845+0000","last_active":"2023-09-30T22:22:02.382010+0000","last_peered":"2023-09-30T22:22:02.382010+0000","last_clean":"2023-09-30T22:22:02.382010+0000","last_became_active":"2023-09-30T22:22:02.379594+0000","last_became_peered":"2023-09-30T22:22:02.379594+0000","last_unstale":"2023-09-30T22:22:02.382010+0000","last_undegraded":"2023-09-30T22:22:02.382010+0000","last_fullsized":"2023-09-30T22:22:02.382010+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.359678+0000","last_change":"2023-09-30T22:21:57.838957+0000","last_active":"2023-09-30T22:22:02.359678+0000","last_peered":"2023-09-30T22:22:02.359678+0000","last_clean":"2023-09-30T22:22:02.359678+0000","last_became_active":"2023-09-30T22:21:57.838667+0000","last_became_peered":"2023-09-30T22:21:57.838667+0000","last_unstale":"2023-09-30T22:22:02.359678+0000","last_undegraded":"2023-09-30T22:22:02.359678+0000","last_fullsized":"2023-09-30T22:22:02.359678+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.359529+0000","last_change":"2023-09-30T22:21:56.838072+0000","last_active":"2023-09-30T22:22:02.359529+0000","last_peered":"2023-09-30T22:22:02.359529+0000","last_clean":"2023-09-30T22:22:02.359529+0000","last_became_active":"2023-09-30T22:21:56.837717+0000","last_became_peered":"2023-09-30T22:21:56.837717+0000","last_unstale":"2023-09-30T22:22:02.359529+0000","last_undegraded":"2023-09-30T22:22:02.359529+0000","last_fullsized":"2023-09-30T22:22:02.359529+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:55.823939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:55.823939+0000","last_clean_scrub_stamp":"2023-09-30T22:21:55.823939+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.362949+0000","last_change":"2023-09-30T22:22:01.994653+0000","last_active":"2023-09-30T22:22:02.362949+0000","last_peered":"2023-09-30T22:22:02.362949+0000","last_clean":"2023-09-30T22:22:02.362949+0000","last_became_active":"2023-09-30T22:22:01.994362+0000","last_became_peered":"2023-09-30T22:22:01.994362+0000","last_unstale":"2023-09-30T22:22:02.362949+0000","last_undegraded":"2023-09-30T22:22:02.362949+0000","last_fullsized":"2023-09-30T22:22:02.362949+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.388623+0000","last_change":"2023-09-30T22:22:02.381190+0000","last_active":"2023-09-30T22:22:02.388623+0000","last_peered":"2023-09-30T22:22:02.388623+0000","last_clean":"2023-09-30T22:22:02.388623+0000","last_became_active":"2023-09-30T22:22:02.380952+0000","last_became_peered":"2023-09-30T22:22:02.380952+0000","last_unstale":"2023-09-30T22:22:02.388623+0000","last_undegraded":"2023-09-30T22:22:02.388623+0000","last_fullsized":"2023-09-30T22:22:02.388623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.358689+0000","last_change":"2023-09-30T22:21:57.837598+0000","last_active":"2023-09-30T22:22:02.358689+0000","last_peered":"2023-09-30T22:22:02.358689+0000","last_clean":"2023-09-30T22:22:02.358689+0000","last_became_active":"2023-09-30T22:21:57.837284+0000","last_became_peered":"2023-09-30T22:21:57.837284+0000","last_unstale":"2023-09-30T22:22:02.358689+0000","last_undegraded":"2023-09-30T22:22:02.358689+0000","last_fullsized":"2023-09-30T22:22:02.358689+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.364183+0000","last_change":"2023-09-30T22:22:01.983059+0000","last_active":"2023-09-30T22:22:02.364183+0000","last_peered":"2023-09-30T22:22:02.364183+0000","last_clean":"2023-09-30T22:22:02.364183+0000","last_became_active":"2023-09-30T22:22:01.982739+0000","last_became_peered":"2023-09-30T22:22:01.982739+0000","last_unstale":"2023-09-30T22:22:02.364183+0000","last_undegraded":"2023-09-30T22:22:02.364183+0000","last_fullsized":"2023-09-30T22:22:02.364183+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385106+0000","last_change":"2023-09-30T22:22:02.380074+0000","last_active":"2023-09-30T22:22:02.385106+0000","last_peered":"2023-09-30T22:22:02.385106+0000","last_clean":"2023-09-30T22:22:02.385106+0000","last_became_active":"2023-09-30T22:22:02.379501+0000","last_became_peered":"2023-09-30T22:22:02.379501+0000","last_unstale":"2023-09-30T22:22:02.385106+0000","last_undegraded":"2023-09-30T22:22:02.385106+0000","last_fullsized":"2023-09-30T22:22:02.385106+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.364495+0000","last_change":"2023-09-30T22:21:58.403508+0000","last_active":"2023-09-30T22:22:02.364495+0000","last_peered":"2023-09-30T22:22:02.364495+0000","last_clean":"2023-09-30T22:22:02.364495+0000","last_became_active":"2023-09-30T22:21:58.403267+0000","last_became_peered":"2023-09-30T22:21:58.403267+0000","last_unstale":"2023-09-30T22:22:02.364495+0000","last_undegraded":"2023-09-30T22:22:02.364495+0000","last_fullsized":"2023-09-30T22:22:02.364495+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.359534+0000","last_change":"2023-09-30T22:22:01.987265+0000","last_active":"2023-09-30T22:22:02.359534+0000","last_peered":"2023-09-30T22:22:02.359534+0000","last_clean":"2023-09-30T22:22:02.359534+0000","last_became_active":"2023-09-30T22:22:01.986968+0000","last_became_peered":"2023-09-30T22:22:01.986968+0000","last_unstale":"2023-09-30T22:22:02.359534+0000","last_undegraded":"2023-09-30T22:22:02.359534+0000","last_fullsized":"2023-09-30T22:22:02.359534+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385062+0000","last_change":"2023-09-30T22:22:02.376013+0000","last_active":"2023-09-30T22:22:02.385062+0000","last_peered":"2023-09-30T22:22:02.385062+0000","last_clean":"2023-09-30T22:22:02.385062+0000","last_became_active":"2023-09-30T22:22:02.374252+0000","last_became_peered":"2023-09-30T22:22:02.374252+0000","last_unstale":"2023-09-30T22:22:02.385062+0000","last_undegraded":"2023-09-30T22:22:02.385062+0000","last_fullsized":"2023-09-30T22:22:02.385062+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.395176+0000","last_change":"2023-09-30T22:22:01.994188+0000","last_active":"2023-09-30T22:22:02.395176+0000","last_peered":"2023-09-30T22:22:02.395176+0000","last_clean":"2023-09-30T22:22:02.395176+0000","last_became_active":"2023-09-30T22:22:01.993644+0000","last_became_peered":"2023-09-30T22:22:01.993644+0000","last_unstale":"2023-09-30T22:22:02.395176+0000","last_undegraded":"2023-09-30T22:22:02.395176+0000","last_fullsized":"2023-09-30T22:22:02.395176+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.360873+0000","last_change":"2023-09-30T22:21:58.403570+0000","last_active":"2023-09-30T22:22:02.360873+0000","last_peered":"2023-09-30T22:22:02.360873+0000","last_clean":"2023-09-30T22:22:02.360873+0000","last_became_active":"2023-09-30T22:21:58.403321+0000","last_became_peered":"2023-09-30T22:21:58.403321+0000","last_unstale":"2023-09-30T22:22:02.360873+0000","last_undegraded":"2023-09-30T22:22:02.360873+0000","last_fullsized":"2023-09-30T22:22:02.360873+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.381516+0000","last_change":"2023-09-30T22:22:02.372818+0000","last_active":"2023-09-30T22:22:02.381516+0000","last_peered":"2023-09-30T22:22:02.381516+0000","last_clean":"2023-09-30T22:22:02.381516+0000","last_became_active":"2023-09-30T22:22:02.372623+0000","last_became_peered":"2023-09-30T22:22:02.372623+0000","last_unstale":"2023-09-30T22:22:02.381516+0000","last_undegraded":"2023-09-30T22:22:02.381516+0000","last_fullsized":"2023-09-30T22:22:02.381516+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.369758+0000","last_change":"2023-09-30T22:21:58.404380+0000","last_active":"2023-09-30T22:22:02.369758+0000","last_peered":"2023-09-30T22:22:02.369758+0000","last_clean":"2023-09-30T22:22:02.369758+0000","last_became_active":"2023-09-30T22:21:58.404098+0000","last_became_peered":"2023-09-30T22:21:58.404098+0000","last_unstale":"2023-09-30T22:22:02.369758+0000","last_undegraded":"2023-09-30T22:22:02.369758+0000","last_fullsized":"2023-09-30T22:22:02.369758+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.366010+0000","last_change":"2023-09-30T22:22:01.977163+0000","last_active":"2023-09-30T22:22:02.366010+0000","last_peered":"2023-09-30T22:22:02.366010+0000","last_clean":"2023-09-30T22:22:02.366010+0000","last_became_active":"2023-09-30T22:22:01.976494+0000","last_became_peered":"2023-09-30T22:22:01.976494+0000","last_unstale":"2023-09-30T22:22:02.366010+0000","last_undegraded":"2023-09-30T22:22:02.366010+0000","last_fullsized":"2023-09-30T22:22:02.366010+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393757+0000","last_change":"2023-09-30T22:22:02.386251+0000","last_active":"2023-09-30T22:22:02.393757+0000","last_peered":"2023-09-30T22:22:02.393757+0000","last_clean":"2023-09-30T22:22:02.393757+0000","last_became_active":"2023-09-30T22:22:02.385701+0000","last_became_peered":"2023-09-30T22:22:02.385701+0000","last_unstale":"2023-09-30T22:22:02.393757+0000","last_undegraded":"2023-09-30T22:22:02.393757+0000","last_fullsized":"2023-09-30T22:22:02.393757+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.398231+0000","last_change":"2023-09-30T22:22:01.997989+0000","last_active":"2023-09-30T22:22:02.398231+0000","last_peered":"2023-09-30T22:22:02.398231+0000","last_clean":"2023-09-30T22:22:02.398231+0000","last_became_active":"2023-09-30T22:22:01.997419+0000","last_became_peered":"2023-09-30T22:22:01.997419+0000","last_unstale":"2023-09-30T22:22:02.398231+0000","last_undegraded":"2023-09-30T22:22:02.398231+0000","last_fullsized":"2023-09-30T22:22:02.398231+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380856+0000","last_change":"2023-09-30T22:22:02.379106+0000","last_active":"2023-09-30T22:22:02.380856+0000","last_peered":"2023-09-30T22:22:02.380856+0000","last_clean":"2023-09-30T22:22:02.380856+0000","last_became_active":"2023-09-30T22:22:02.378452+0000","last_became_peered":"2023-09-30T22:22:02.378452+0000","last_unstale":"2023-09-30T22:22:02.380856+0000","last_undegraded":"2023-09-30T22:22:02.380856+0000","last_fullsized":"2023-09-30T22:22:02.380856+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380701+0000","last_change":"2023-09-30T22:22:01.977515+0000","last_active":"2023-09-30T22:22:02.380701+0000","last_peered":"2023-09-30T22:22:02.380701+0000","last_clean":"2023-09-30T22:22:02.380701+0000","last_became_active":"2023-09-30T22:22:01.976843+0000","last_became_peered":"2023-09-30T22:22:01.976843+0000","last_unstale":"2023-09-30T22:22:02.380701+0000","last_undegraded":"2023-09-30T22:22:02.380701+0000","last_fullsized":"2023-09-30T22:22:02.380701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393819+0000","last_change":"2023-09-30T22:22:02.387751+0000","last_active":"2023-09-30T22:22:02.393819+0000","last_peered":"2023-09-30T22:22:02.393819+0000","last_clean":"2023-09-30T22:22:02.393819+0000","last_became_active":"2023-09-30T22:22:02.387326+0000","last_became_peered":"2023-09-30T22:22:02.387326+0000","last_unstale":"2023-09-30T22:22:02.393819+0000","last_undegraded":"2023-09-30T22:22:02.393819+0000","last_fullsized":"2023-09-30T22:22:02.393819+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.395931+0000","last_change":"2023-09-30T22:22:01.996439+0000","last_active":"2023-09-30T22:22:02.395931+0000","last_peered":"2023-09-30T22:22:02.395931+0000","last_clean":"2023-09-30T22:22:02.395931+0000","last_became_active":"2023-09-30T22:22:01.996179+0000","last_became_peered":"2023-09-30T22:22:01.996179+0000","last_unstale":"2023-09-30T22:22:02.395931+0000","last_undegraded":"2023-09-30T22:22:02.395931+0000","last_fullsized":"2023-09-30T22:22:02.395931+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393375+0000","last_change":"2023-09-30T22:22:02.384588+0000","last_active":"2023-09-30T22:22:02.393375+0000","last_peered":"2023-09-30T22:22:02.393375+0000","last_clean":"2023-09-30T22:22:02.393375+0000","last_became_active":"2023-09-30T22:22:02.384072+0000","last_became_peered":"2023-09-30T22:22:02.384072+0000","last_unstale":"2023-09-30T22:22:02.393375+0000","last_undegraded":"2023-09-30T22:22:02.393375+0000","last_fullsized":"2023-09-30T22:22:02.393375+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393972+0000","last_change":"2023-09-30T22:22:01.993986+0000","last_active":"2023-09-30T22:22:02.393972+0000","last_peered":"2023-09-30T22:22:02.393972+0000","last_clean":"2023-09-30T22:22:02.393972+0000","last_became_active":"2023-09-30T22:22:01.993575+0000","last_became_peered":"2023-09-30T22:22:01.993575+0000","last_unstale":"2023-09-30T22:22:02.393972+0000","last_undegraded":"2023-09-30T22:22:02.393972+0000","last_fullsized":"2023-09-30T22:22:02.393972+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.383708+0000","last_change":"2023-09-30T22:22:02.378109+0000","last_active":"2023-09-30T22:22:02.383708+0000","last_peered":"2023-09-30T22:22:02.383708+0000","last_clean":"2023-09-30T22:22:02.383708+0000","last_became_active":"2023-09-30T22:22:02.377671+0000","last_became_peered":"2023-09-30T22:22:02.377671+0000","last_unstale":"2023-09-30T22:22:02.383708+0000","last_undegraded":"2023-09-30T22:22:02.383708+0000","last_fullsized":"2023-09-30T22:22:02.383708+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.386441+0000","last_change":"2023-09-30T22:22:01.980853+0000","last_active":"2023-09-30T22:22:02.386441+0000","last_peered":"2023-09-30T22:22:02.386441+0000","last_clean":"2023-09-30T22:22:02.386441+0000","last_became_active":"2023-09-30T22:22:01.979795+0000","last_became_peered":"2023-09-30T22:22:01.979795+0000","last_unstale":"2023-09-30T22:22:02.386441+0000","last_undegraded":"2023-09-30T22:22:02.386441+0000","last_fullsized":"2023-09-30T22:22:02.386441+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380713+0000","last_change":"2023-09-30T22:22:02.377790+0000","last_active":"2023-09-30T22:22:02.380713+0000","last_peered":"2023-09-30T22:22:02.380713+0000","last_clean":"2023-09-30T22:22:02.380713+0000","last_became_active":"2023-09-30T22:22:02.377478+0000","last_became_peered":"2023-09-30T22:22:02.377478+0000","last_unstale":"2023-09-30T22:22:02.380713+0000","last_undegraded":"2023-09-30T22:22:02.380713+0000","last_fullsized":"2023-09-30T22:22:02.380713+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380254+0000","last_change":"2023-09-30T22:22:02.373820+0000","last_active":"2023-09-30T22:22:02.380254+0000","last_peered":"2023-09-30T22:22:02.380254+0000","last_clean":"2023-09-30T22:22:02.380254+0000","last_became_active":"2023-09-30T22:22:02.373530+0000","last_became_peered":"2023-09-30T22:22:02.373530+0000","last_unstale":"2023-09-30T22:22:02.380254+0000","last_undegraded":"2023-09-30T22:22:02.380254+0000","last_fullsized":"2023-09-30T22:22:02.380254+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.383688+0000","last_change":"2023-09-30T22:22:02.377945+0000","last_active":"2023-09-30T22:22:02.383688+0000","last_peered":"2023-09-30T22:22:02.383688+0000","last_clean":"2023-09-30T22:22:02.383688+0000","last_became_active":"2023-09-30T22:22:02.377355+0000","last_became_peered":"2023-09-30T22:22:02.377355+0000","last_unstale":"2023-09-30T22:22:02.383688+0000","last_undegraded":"2023-09-30T22:22:02.383688+0000","last_fullsized":"2023-09-30T22:22:02.383688+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394694+0000","last_change":"2023-09-30T22:22:02.387890+0000","last_active":"2023-09-30T22:22:02.394694+0000","last_peered":"2023-09-30T22:22:02.394694+0000","last_clean":"2023-09-30T22:22:02.394694+0000","last_became_active":"2023-09-30T22:22:02.387599+0000","last_became_peered":"2023-09-30T22:22:02.387599+0000","last_unstale":"2023-09-30T22:22:02.394694+0000","last_undegraded":"2023-09-30T22:22:02.394694+0000","last_fullsized":"2023-09-30T22:22:02.394694+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.397499+0000","last_change":"2023-09-30T22:22:02.385159+0000","last_active":"2023-09-30T22:22:02.397499+0000","last_peered":"2023-09-30T22:22:02.397499+0000","last_clean":"2023-09-30T22:22:02.397499+0000","last_became_active":"2023-09-30T22:22:02.376532+0000","last_became_peered":"2023-09-30T22:22:02.376532+0000","last_unstale":"2023-09-30T22:22:02.397499+0000","last_undegraded":"2023-09-30T22:22:02.397499+0000","last_fullsized":"2023-09-30T22:22:02.397499+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.383770+0000","last_change":"2023-09-30T22:22:02.374216+0000","last_active":"2023-09-30T22:22:02.383770+0000","last_peered":"2023-09-30T22:22:02.383770+0000","last_clean":"2023-09-30T22:22:02.383770+0000","last_became_active":"2023-09-30T22:22:02.373952+0000","last_became_peered":"2023-09-30T22:22:02.373952+0000","last_unstale":"2023-09-30T22:22:02.383770+0000","last_undegraded":"2023-09-30T22:22:02.383770+0000","last_fullsized":"2023-09-30T22:22:02.383770+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297264,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074576,"statfs":{"total":96636764160,"available":96332365824,"internally_reserved":0,"allocated":172032,"data_stored":48929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":48735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":46930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":47845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T22:22:07.950 INFO:tasks.ceph.mds.a.smithi040.stderr:2023-09-30T22:22:07.950+0000 7f01945a4700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-30T22:22:10.817 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:22:10.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.952+0000 7f67d233a700 1 Processor -- start 2023-09-30T22:22:10.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.952+0000 7f67d233a700 1 -- start start 2023-09-30T22:22:10.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.953+0000 7f67d233a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f67cc096740 0x7f67cc096b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:10.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.953+0000 7f67d233a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67cc0675f0 0x7f67cc130c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:10.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.953+0000 7f67d233a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67cc094330 con 0x7f67cc097010 2023-09-30T22:22:10.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.953+0000 7f67d233a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67cc091fc0 con 0x7f67cc0675f0 2023-09-30T22:22:10.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.953+0000 7f67d233a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67cc0932f0 con 0x7f67cc096740 2023-09-30T22:22:10.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.953+0000 7f67d08d7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67cc0675f0 0x7f67cc130c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:10.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.953+0000 7f67cbfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f67cc096740 0x7f67cc096b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:10.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.953+0000 7f67d08d7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67cc0675f0 0x7f67cc130c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:46726/0 (socket says 172.21.15.40:46726) 2023-09-30T22:22:10.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.953+0000 7f67cbfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f67cc096740 0x7f67cc096b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60064/0 (socket says 172.21.15.40:60064) 2023-09-30T22:22:10.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.953+0000 7f67d08d7700 1 -- 172.21.15.40:0/3576445594 learned_addr learned my addr 172.21.15.40:0/3576445594 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:10.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.954+0000 7f67d08d7700 1 -- 172.21.15.40:0/3576445594 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f67cc096740 msgr2=0x7f67cc096b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:10.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.954+0000 7f67d08d7700 1 --2- 172.21.15.40:0/3576445594 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f67cc096740 0x7f67cc096b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:10.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.954+0000 7f67d08d7700 1 -- 172.21.15.40:0/3576445594 >> v1:172.21.15.40:6789/0 conn(0x7f67cc097010 legacy=0x7f67cc066ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:10.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.954+0000 7f67caffd700 1 -- 172.21.15.40:0/3576445594 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1620765905 0 0) 0x7f67cc094330 con 0x7f67cc097010 2023-09-30T22:22:10.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.954+0000 7f67d08d7700 1 -- 172.21.15.40:0/3576445594 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67cc0926f0 con 0x7f67cc0675f0 2023-09-30T22:22:10.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.954+0000 7f67cbfff700 1 --2- 172.21.15.40:0/3576445594 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f67cc096740 0x7f67cc096b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:10.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.954+0000 7f67d08d7700 1 --2- 172.21.15.40:0/3576445594 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67cc0675f0 0x7f67cc130c80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f67c4009f50 tx=0x7f67c4009840).ready entity=mon.1 client_cookie=5e27a1baff38d83b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:10.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.954+0000 7f67caffd700 1 -- 172.21.15.40:0/3576445594 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c400e070 con 0x7f67cc0675f0 2023-09-30T22:22:10.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.954+0000 7f67caffd700 1 -- 172.21.15.40:0/3576445594 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c400ba00 con 0x7f67cc0675f0 2023-09-30T22:22:10.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.954+0000 7f67caffd700 1 -- 172.21.15.40:0/3576445594 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c400bd80 con 0x7f67cc0675f0 2023-09-30T22:22:10.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.955+0000 7f67d233a700 1 -- 172.21.15.40:0/3576445594 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67cc0675f0 msgr2=0x7f67cc130c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:10.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.955+0000 7f67d233a700 1 --2- 172.21.15.40:0/3576445594 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67cc0675f0 0x7f67cc130c80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f67c4009f50 tx=0x7f67c4009840).stop 2023-09-30T22:22:10.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.955+0000 7f67d233a700 1 -- 172.21.15.40:0/3576445594 shutdown_connections 2023-09-30T22:22:10.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.955+0000 7f67d233a700 1 --2- 172.21.15.40:0/3576445594 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67cc0675f0 0x7f67cc130c80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:10.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.955+0000 7f67d233a700 1 --2- 172.21.15.40:0/3576445594 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f67cc096740 0x7f67cc096b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:10.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.955+0000 7f67d233a700 1 -- 172.21.15.40:0/3576445594 >> 172.21.15.40:0/3576445594 conn(0x7f67cc05eb30 msgr2=0x7f67cc09a450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:10.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.955+0000 7f67d233a700 1 -- 172.21.15.40:0/3576445594 shutdown_connections 2023-09-30T22:22:10.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.955+0000 7f67d233a700 1 -- 172.21.15.40:0/3576445594 wait complete. 2023-09-30T22:22:10.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.956+0000 7f67d233a700 1 Processor -- start 2023-09-30T22:22:10.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.956+0000 7f67d233a700 1 -- start start 2023-09-30T22:22:10.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.956+0000 7f67d233a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67cc0675f0 0x7f67cc11dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:10.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.956+0000 7f67d233a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f67cc096740 0x7f67cc12aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:10.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.956+0000 7f67d233a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67cc097010 0x7f67cc12afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:10.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.956+0000 7f67d233a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67cc11e640 con 0x7f67cc0675f0 2023-09-30T22:22:10.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.956+0000 7f67d233a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67cc095bc0 con 0x7f67cc097010 2023-09-30T22:22:10.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.956+0000 7f67d233a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67cc11d6e0 con 0x7f67cc096740 2023-09-30T22:22:10.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.956+0000 7f67cbfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67cc0675f0 0x7f67cc11dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:10.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.956+0000 7f67cb7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f67cc096740 0x7f67cc12aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:10.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.956+0000 7f67d08d7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67cc097010 0x7f67cc12afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:10.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.956+0000 7f67cbfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67cc0675f0 0x7f67cc11dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46508/0 (socket says 172.21.15.40:46508) 2023-09-30T22:22:10.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.956+0000 7f67cbfff700 1 -- 172.21.15.40:0/2218988759 learned_addr learned my addr 172.21.15.40:0/2218988759 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:10.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.956+0000 7f67cb7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f67cc096740 0x7f67cc12aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60066/0 (socket says 172.21.15.40:60066) 2023-09-30T22:22:10.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.957+0000 7f67cb7fe700 1 -- 172.21.15.40:0/2218988759 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67cc097010 msgr2=0x7f67cc12afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:10.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.957+0000 7f67cb7fe700 1 --2- 172.21.15.40:0/2218988759 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67cc097010 0x7f67cc12afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:10.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.957+0000 7f67cb7fe700 1 -- 172.21.15.40:0/2218988759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67cc0675f0 msgr2=0x7f67cc11dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:10.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.957+0000 7f67cb7fe700 1 --2- 172.21.15.40:0/2218988759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67cc0675f0 0x7f67cc11dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:10.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.957+0000 7f67cb7fe700 1 -- 172.21.15.40:0/2218988759 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67bc0092a0 con 0x7f67cc096740 2023-09-30T22:22:10.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.957+0000 7f67cb7fe700 1 --2- 172.21.15.40:0/2218988759 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f67cc096740 0x7f67cc12aaf0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f67cc092190 tx=0x7f67c0007b60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:10.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.957+0000 7f67b3fff700 1 -- 172.21.15.40:0/2218988759 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c0012400 con 0x7f67cc096740 2023-09-30T22:22:10.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.957+0000 7f67b3fff700 1 -- 172.21.15.40:0/2218988759 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c0012580 con 0x7f67cc096740 2023-09-30T22:22:10.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.957+0000 7f67d233a700 1 -- 172.21.15.40:0/2218988759 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67c4009ae0 con 0x7f67cc096740 2023-09-30T22:22:10.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.957+0000 7f67b3fff700 1 -- 172.21.15.40:0/2218988759 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c0012940 con 0x7f67cc096740 2023-09-30T22:22:10.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.957+0000 7f67d233a700 1 -- 172.21.15.40:0/2218988759 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67cc11c550 con 0x7f67cc096740 2023-09-30T22:22:10.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.958+0000 7f67b3fff700 1 -- 172.21.15.40:0/2218988759 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f67c0012cf0 con 0x7f67cc096740 2023-09-30T22:22:10.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.958+0000 7f67b3fff700 1 -- 172.21.15.40:0/2218988759 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f67c003a420 con 0x7f67cc096740 2023-09-30T22:22:10.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.958+0000 7f67d233a700 1 -- 172.21.15.40:0/2218988759 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67cc05a260 con 0x7f67cc096740 2023-09-30T22:22:10.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:10.963+0000 7f67b3fff700 1 -- 172.21.15.40:0/2218988759 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f67c0017030 con 0x7f67cc096740 2023-09-30T22:22:11.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.125+0000 7f67d233a700 1 -- 172.21.15.40:0/2218988759 --> v1:172.21.15.40:6816/118905 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f67cc11d850 con 0x7f67b802bb60 2023-09-30T22:22:11.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.131+0000 7f67b3fff700 1 -- 172.21.15.40:0/2218988759 <== mgr.4101 v1:172.21.15.40:6816/118905 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+250003 (unknown 2965378022 0 1105181993) 0x7f67cc11d850 con 0x7f67b802bb60 2023-09-30T22:22:11.133 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:22:11.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.134+0000 7f67d233a700 1 -- 172.21.15.40:0/2218988759 >> v1:172.21.15.40:6816/118905 conn(0x7f67b802bb60 legacy=0x7f67b802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.134+0000 7f67d233a700 1 -- 172.21.15.40:0/2218988759 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f67cc096740 msgr2=0x7f67cc12aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.134+0000 7f67d233a700 1 --2- 172.21.15.40:0/2218988759 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f67cc096740 0x7f67cc12aaf0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f67cc092190 tx=0x7f67c0007b60).stop 2023-09-30T22:22:11.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.134+0000 7f67d233a700 1 -- 172.21.15.40:0/2218988759 shutdown_connections 2023-09-30T22:22:11.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.134+0000 7f67d233a700 1 --2- 172.21.15.40:0/2218988759 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67cc097010 0x7f67cc12afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:11.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.134+0000 7f67d233a700 1 --2- 172.21.15.40:0/2218988759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67cc0675f0 0x7f67cc11dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:11.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.134+0000 7f67d233a700 1 --2- 172.21.15.40:0/2218988759 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f67cc096740 0x7f67cc12aaf0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:11.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.134+0000 7f67d233a700 1 -- 172.21.15.40:0/2218988759 >> 172.21.15.40:0/2218988759 conn(0x7f67cc05eb30 msgr2=0x7f67cc0996f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:11.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.134+0000 7f67d233a700 1 -- 172.21.15.40:0/2218988759 shutdown_connections 2023-09-30T22:22:11.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.134+0000 7f67d233a700 1 -- 172.21.15.40:0/2218988759 wait complete. 2023-09-30T22:22:11.137 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-09-30T22:22:11.145 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-09-30T22:22:09.776253+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189020,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298340,"statfs":{"total":386547056640,"available":385329500160,"internally_reserved":0,"allocated":651264,"data_stored":192439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1640,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000918"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385416+0000","last_change":"2023-09-30T22:22:02.384090+0000","last_active":"2023-09-30T22:22:02.385416+0000","last_peered":"2023-09-30T22:22:02.385416+0000","last_clean":"2023-09-30T22:22:02.385416+0000","last_became_active":"2023-09-30T22:22:02.383805+0000","last_became_peered":"2023-09-30T22:22:02.383805+0000","last_unstale":"2023-09-30T22:22:02.385416+0000","last_undegraded":"2023-09-30T22:22:02.385416+0000","last_fullsized":"2023-09-30T22:22:02.385416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380743+0000","last_change":"2023-09-30T22:22:02.377806+0000","last_active":"2023-09-30T22:22:02.380743+0000","last_peered":"2023-09-30T22:22:02.380743+0000","last_clean":"2023-09-30T22:22:02.380743+0000","last_became_active":"2023-09-30T22:22:02.377531+0000","last_became_peered":"2023-09-30T22:22:02.377531+0000","last_unstale":"2023-09-30T22:22:02.380743+0000","last_undegraded":"2023-09-30T22:22:02.380743+0000","last_fullsized":"2023-09-30T22:22:02.380743+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385151+0000","last_change":"2023-09-30T22:22:02.379022+0000","last_active":"2023-09-30T22:22:02.385151+0000","last_peered":"2023-09-30T22:22:02.385151+0000","last_clean":"2023-09-30T22:22:02.385151+0000","last_became_active":"2023-09-30T22:22:02.378723+0000","last_became_peered":"2023-09-30T22:22:02.378723+0000","last_unstale":"2023-09-30T22:22:02.385151+0000","last_undegraded":"2023-09-30T22:22:02.385151+0000","last_fullsized":"2023-09-30T22:22:02.385151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385016+0000","last_change":"2023-09-30T22:22:02.378089+0000","last_active":"2023-09-30T22:22:02.385016+0000","last_peered":"2023-09-30T22:22:02.385016+0000","last_clean":"2023-09-30T22:22:02.385016+0000","last_became_active":"2023-09-30T22:22:02.375446+0000","last_became_peered":"2023-09-30T22:22:02.375446+0000","last_unstale":"2023-09-30T22:22:02.385016+0000","last_undegraded":"2023-09-30T22:22:02.385016+0000","last_fullsized":"2023-09-30T22:22:02.385016+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.402864+0000","last_change":"2023-09-30T22:22:02.398073+0000","last_active":"2023-09-30T22:22:02.402864+0000","last_peered":"2023-09-30T22:22:02.402864+0000","last_clean":"2023-09-30T22:22:02.402864+0000","last_became_active":"2023-09-30T22:22:02.397855+0000","last_became_peered":"2023-09-30T22:22:02.397855+0000","last_unstale":"2023-09-30T22:22:02.402864+0000","last_undegraded":"2023-09-30T22:22:02.402864+0000","last_fullsized":"2023-09-30T22:22:02.402864+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385189+0000","last_change":"2023-09-30T22:22:02.382862+0000","last_active":"2023-09-30T22:22:02.385189+0000","last_peered":"2023-09-30T22:22:02.385189+0000","last_clean":"2023-09-30T22:22:02.385189+0000","last_became_active":"2023-09-30T22:22:02.382464+0000","last_became_peered":"2023-09-30T22:22:02.382464+0000","last_unstale":"2023-09-30T22:22:02.385189+0000","last_undegraded":"2023-09-30T22:22:02.385189+0000","last_fullsized":"2023-09-30T22:22:02.385189+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.399117+0000","last_change":"2023-09-30T22:22:02.395909+0000","last_active":"2023-09-30T22:22:02.399117+0000","last_peered":"2023-09-30T22:22:02.399117+0000","last_clean":"2023-09-30T22:22:02.399117+0000","last_became_active":"2023-09-30T22:22:02.395379+0000","last_became_peered":"2023-09-30T22:22:02.395379+0000","last_unstale":"2023-09-30T22:22:02.399117+0000","last_undegraded":"2023-09-30T22:22:02.399117+0000","last_fullsized":"2023-09-30T22:22:02.399117+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393512+0000","last_change":"2023-09-30T22:22:02.382627+0000","last_active":"2023-09-30T22:22:02.393512+0000","last_peered":"2023-09-30T22:22:02.393512+0000","last_clean":"2023-09-30T22:22:02.393512+0000","last_became_active":"2023-09-30T22:22:02.382360+0000","last_became_peered":"2023-09-30T22:22:02.382360+0000","last_unstale":"2023-09-30T22:22:02.393512+0000","last_undegraded":"2023-09-30T22:22:02.393512+0000","last_fullsized":"2023-09-30T22:22:02.393512+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394788+0000","last_change":"2023-09-30T22:22:02.388864+0000","last_active":"2023-09-30T22:22:02.394788+0000","last_peered":"2023-09-30T22:22:02.394788+0000","last_clean":"2023-09-30T22:22:02.394788+0000","last_became_active":"2023-09-30T22:22:02.388267+0000","last_became_peered":"2023-09-30T22:22:02.388267+0000","last_unstale":"2023-09-30T22:22:02.394788+0000","last_undegraded":"2023-09-30T22:22:02.394788+0000","last_fullsized":"2023-09-30T22:22:02.394788+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380523+0000","last_change":"2023-09-30T22:22:02.379619+0000","last_active":"2023-09-30T22:22:02.380523+0000","last_peered":"2023-09-30T22:22:02.380523+0000","last_clean":"2023-09-30T22:22:02.380523+0000","last_became_active":"2023-09-30T22:22:02.379412+0000","last_became_peered":"2023-09-30T22:22:02.379412+0000","last_unstale":"2023-09-30T22:22:02.380523+0000","last_undegraded":"2023-09-30T22:22:02.380523+0000","last_fullsized":"2023-09-30T22:22:02.380523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.377473+0000","last_change":"2023-09-30T22:22:02.372757+0000","last_active":"2023-09-30T22:22:02.377473+0000","last_peered":"2023-09-30T22:22:02.377473+0000","last_clean":"2023-09-30T22:22:02.377473+0000","last_became_active":"2023-09-30T22:22:02.372495+0000","last_became_peered":"2023-09-30T22:22:02.372495+0000","last_unstale":"2023-09-30T22:22:02.377473+0000","last_undegraded":"2023-09-30T22:22:02.377473+0000","last_fullsized":"2023-09-30T22:22:02.377473+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380876+0000","last_change":"2023-09-30T22:22:02.379525+0000","last_active":"2023-09-30T22:22:02.380876+0000","last_peered":"2023-09-30T22:22:02.380876+0000","last_clean":"2023-09-30T22:22:02.380876+0000","last_became_active":"2023-09-30T22:22:02.379330+0000","last_became_peered":"2023-09-30T22:22:02.379330+0000","last_unstale":"2023-09-30T22:22:02.380876+0000","last_undegraded":"2023-09-30T22:22:02.380876+0000","last_fullsized":"2023-09-30T22:22:02.380876+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393834+0000","last_change":"2023-09-30T22:22:02.387803+0000","last_active":"2023-09-30T22:22:02.393834+0000","last_peered":"2023-09-30T22:22:02.393834+0000","last_clean":"2023-09-30T22:22:02.393834+0000","last_became_active":"2023-09-30T22:22:02.387560+0000","last_became_peered":"2023-09-30T22:22:02.387560+0000","last_unstale":"2023-09-30T22:22:02.393834+0000","last_undegraded":"2023-09-30T22:22:02.393834+0000","last_fullsized":"2023-09-30T22:22:02.393834+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380478+0000","last_change":"2023-09-30T22:22:02.374488+0000","last_active":"2023-09-30T22:22:02.380478+0000","last_peered":"2023-09-30T22:22:02.380478+0000","last_clean":"2023-09-30T22:22:02.380478+0000","last_became_active":"2023-09-30T22:22:02.374287+0000","last_became_peered":"2023-09-30T22:22:02.374287+0000","last_unstale":"2023-09-30T22:22:02.380478+0000","last_undegraded":"2023-09-30T22:22:02.380478+0000","last_fullsized":"2023-09-30T22:22:02.380478+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.384882+0000","last_change":"2023-09-30T22:22:02.375916+0000","last_active":"2023-09-30T22:22:02.384882+0000","last_peered":"2023-09-30T22:22:02.384882+0000","last_clean":"2023-09-30T22:22:02.384882+0000","last_became_active":"2023-09-30T22:22:02.374277+0000","last_became_peered":"2023-09-30T22:22:02.374277+0000","last_unstale":"2023-09-30T22:22:02.384882+0000","last_undegraded":"2023-09-30T22:22:02.384882+0000","last_fullsized":"2023-09-30T22:22:02.384882+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.399057+0000","last_change":"2023-09-30T22:22:02.395769+0000","last_active":"2023-09-30T22:22:02.399057+0000","last_peered":"2023-09-30T22:22:02.399057+0000","last_clean":"2023-09-30T22:22:02.399057+0000","last_became_active":"2023-09-30T22:22:02.395459+0000","last_became_peered":"2023-09-30T22:22:02.395459+0000","last_unstale":"2023-09-30T22:22:02.399057+0000","last_undegraded":"2023-09-30T22:22:02.399057+0000","last_fullsized":"2023-09-30T22:22:02.399057+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.395070+0000","last_change":"2023-09-30T22:22:02.391303+0000","last_active":"2023-09-30T22:22:02.395070+0000","last_peered":"2023-09-30T22:22:02.395070+0000","last_clean":"2023-09-30T22:22:02.395070+0000","last_became_active":"2023-09-30T22:22:02.388602+0000","last_became_peered":"2023-09-30T22:22:02.388602+0000","last_unstale":"2023-09-30T22:22:02.395070+0000","last_undegraded":"2023-09-30T22:22:02.395070+0000","last_fullsized":"2023-09-30T22:22:02.395070+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385063+0000","last_change":"2023-09-30T22:22:02.376471+0000","last_active":"2023-09-30T22:22:02.385063+0000","last_peered":"2023-09-30T22:22:02.385063+0000","last_clean":"2023-09-30T22:22:02.385063+0000","last_became_active":"2023-09-30T22:22:02.374833+0000","last_became_peered":"2023-09-30T22:22:02.374833+0000","last_unstale":"2023-09-30T22:22:02.385063+0000","last_undegraded":"2023-09-30T22:22:02.385063+0000","last_fullsized":"2023-09-30T22:22:02.385063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385397+0000","last_change":"2023-09-30T22:22:02.383103+0000","last_active":"2023-09-30T22:22:02.385397+0000","last_peered":"2023-09-30T22:22:02.385397+0000","last_clean":"2023-09-30T22:22:02.385397+0000","last_became_active":"2023-09-30T22:22:02.382818+0000","last_became_peered":"2023-09-30T22:22:02.382818+0000","last_unstale":"2023-09-30T22:22:02.385397+0000","last_undegraded":"2023-09-30T22:22:02.385397+0000","last_fullsized":"2023-09-30T22:22:02.385397+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394501+0000","last_change":"2023-09-30T22:22:02.388315+0000","last_active":"2023-09-30T22:22:02.394501+0000","last_peered":"2023-09-30T22:22:02.394501+0000","last_clean":"2023-09-30T22:22:02.394501+0000","last_became_active":"2023-09-30T22:22:02.388046+0000","last_became_peered":"2023-09-30T22:22:02.388046+0000","last_unstale":"2023-09-30T22:22:02.394501+0000","last_undegraded":"2023-09-30T22:22:02.394501+0000","last_fullsized":"2023-09-30T22:22:02.394501+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.395152+0000","last_change":"2023-09-30T22:22:02.391309+0000","last_active":"2023-09-30T22:22:02.395152+0000","last_peered":"2023-09-30T22:22:02.395152+0000","last_clean":"2023-09-30T22:22:02.395152+0000","last_became_active":"2023-09-30T22:22:02.391040+0000","last_became_peered":"2023-09-30T22:22:02.391040+0000","last_unstale":"2023-09-30T22:22:02.395152+0000","last_undegraded":"2023-09-30T22:22:02.395152+0000","last_fullsized":"2023-09-30T22:22:02.395152+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.384855+0000","last_change":"2023-09-30T22:22:02.375857+0000","last_active":"2023-09-30T22:22:02.384855+0000","last_peered":"2023-09-30T22:22:02.384855+0000","last_clean":"2023-09-30T22:22:02.384855+0000","last_became_active":"2023-09-30T22:22:02.373866+0000","last_became_peered":"2023-09-30T22:22:02.373866+0000","last_unstale":"2023-09-30T22:22:02.384855+0000","last_undegraded":"2023-09-30T22:22:02.384855+0000","last_fullsized":"2023-09-30T22:22:02.384855+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.399093+0000","last_change":"2023-09-30T22:22:02.395696+0000","last_active":"2023-09-30T22:22:02.399093+0000","last_peered":"2023-09-30T22:22:02.399093+0000","last_clean":"2023-09-30T22:22:02.399093+0000","last_became_active":"2023-09-30T22:22:02.395318+0000","last_became_peered":"2023-09-30T22:22:02.395318+0000","last_unstale":"2023-09-30T22:22:02.399093+0000","last_undegraded":"2023-09-30T22:22:02.399093+0000","last_fullsized":"2023-09-30T22:22:02.399093+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394655+0000","last_change":"2023-09-30T22:22:02.389818+0000","last_active":"2023-09-30T22:22:02.394655+0000","last_peered":"2023-09-30T22:22:02.394655+0000","last_clean":"2023-09-30T22:22:02.394655+0000","last_became_active":"2023-09-30T22:22:02.389526+0000","last_became_peered":"2023-09-30T22:22:02.389526+0000","last_unstale":"2023-09-30T22:22:02.394655+0000","last_undegraded":"2023-09-30T22:22:02.394655+0000","last_fullsized":"2023-09-30T22:22:02.394655+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394419+0000","last_change":"2023-09-30T22:22:02.386166+0000","last_active":"2023-09-30T22:22:02.394419+0000","last_peered":"2023-09-30T22:22:02.394419+0000","last_clean":"2023-09-30T22:22:02.394419+0000","last_became_active":"2023-09-30T22:22:02.385731+0000","last_became_peered":"2023-09-30T22:22:02.385731+0000","last_unstale":"2023-09-30T22:22:02.394419+0000","last_undegraded":"2023-09-30T22:22:02.394419+0000","last_fullsized":"2023-09-30T22:22:02.394419+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380502+0000","last_change":"2023-09-30T22:22:02.374713+0000","last_active":"2023-09-30T22:22:02.380502+0000","last_peered":"2023-09-30T22:22:02.380502+0000","last_clean":"2023-09-30T22:22:02.380502+0000","last_became_active":"2023-09-30T22:22:02.374467+0000","last_became_peered":"2023-09-30T22:22:02.374467+0000","last_unstale":"2023-09-30T22:22:02.380502+0000","last_undegraded":"2023-09-30T22:22:02.380502+0000","last_fullsized":"2023-09-30T22:22:02.380502+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.399018+0000","last_change":"2023-09-30T22:22:02.395766+0000","last_active":"2023-09-30T22:22:02.399018+0000","last_peered":"2023-09-30T22:22:02.399018+0000","last_clean":"2023-09-30T22:22:02.399018+0000","last_became_active":"2023-09-30T22:22:02.395487+0000","last_became_peered":"2023-09-30T22:22:02.395487+0000","last_unstale":"2023-09-30T22:22:02.399018+0000","last_undegraded":"2023-09-30T22:22:02.399018+0000","last_fullsized":"2023-09-30T22:22:02.399018+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.374558+0000","last_change":"2023-09-30T22:22:01.986896+0000","last_active":"2023-09-30T22:22:02.374558+0000","last_peered":"2023-09-30T22:22:02.374558+0000","last_clean":"2023-09-30T22:22:02.374558+0000","last_became_active":"2023-09-30T22:22:01.986600+0000","last_became_peered":"2023-09-30T22:22:01.986600+0000","last_unstale":"2023-09-30T22:22:02.374558+0000","last_undegraded":"2023-09-30T22:22:02.374558+0000","last_fullsized":"2023-09-30T22:22:02.374558+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.388602+0000","last_change":"2023-09-30T22:22:02.380769+0000","last_active":"2023-09-30T22:22:02.388602+0000","last_peered":"2023-09-30T22:22:02.388602+0000","last_clean":"2023-09-30T22:22:02.388602+0000","last_became_active":"2023-09-30T22:22:02.380403+0000","last_became_peered":"2023-09-30T22:22:02.380403+0000","last_unstale":"2023-09-30T22:22:02.388602+0000","last_undegraded":"2023-09-30T22:22:02.388602+0000","last_fullsized":"2023-09-30T22:22:02.388602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.361691+0000","last_change":"2023-09-30T22:22:01.992230+0000","last_active":"2023-09-30T22:22:02.361691+0000","last_peered":"2023-09-30T22:22:02.361691+0000","last_clean":"2023-09-30T22:22:02.361691+0000","last_became_active":"2023-09-30T22:22:01.991929+0000","last_became_peered":"2023-09-30T22:22:01.991929+0000","last_unstale":"2023-09-30T22:22:02.361691+0000","last_undegraded":"2023-09-30T22:22:02.361691+0000","last_fullsized":"2023-09-30T22:22:02.361691+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385127+0000","last_change":"2023-09-30T22:22:02.380249+0000","last_active":"2023-09-30T22:22:02.385127+0000","last_peered":"2023-09-30T22:22:02.385127+0000","last_clean":"2023-09-30T22:22:02.385127+0000","last_became_active":"2023-09-30T22:22:02.379830+0000","last_became_peered":"2023-09-30T22:22:02.379830+0000","last_unstale":"2023-09-30T22:22:02.385127+0000","last_undegraded":"2023-09-30T22:22:02.385127+0000","last_fullsized":"2023-09-30T22:22:02.385127+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.358776+0000","last_change":"2023-09-30T22:22:01.995093+0000","last_active":"2023-09-30T22:22:02.358776+0000","last_peered":"2023-09-30T22:22:02.358776+0000","last_clean":"2023-09-30T22:22:02.358776+0000","last_became_active":"2023-09-30T22:22:01.994797+0000","last_became_peered":"2023-09-30T22:22:01.994797+0000","last_unstale":"2023-09-30T22:22:02.358776+0000","last_undegraded":"2023-09-30T22:22:02.358776+0000","last_fullsized":"2023-09-30T22:22:02.358776+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394410+0000","last_change":"2023-09-30T22:22:02.383534+0000","last_active":"2023-09-30T22:22:02.394410+0000","last_peered":"2023-09-30T22:22:02.394410+0000","last_clean":"2023-09-30T22:22:02.394410+0000","last_became_active":"2023-09-30T22:22:02.383271+0000","last_became_peered":"2023-09-30T22:22:02.383271+0000","last_unstale":"2023-09-30T22:22:02.394410+0000","last_undegraded":"2023-09-30T22:22:02.394410+0000","last_fullsized":"2023-09-30T22:22:02.394410+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.364409+0000","last_change":"2023-09-30T22:22:01.997405+0000","last_active":"2023-09-30T22:22:02.364409+0000","last_peered":"2023-09-30T22:22:02.364409+0000","last_clean":"2023-09-30T22:22:02.364409+0000","last_became_active":"2023-09-30T22:22:01.997079+0000","last_became_peered":"2023-09-30T22:22:01.997079+0000","last_unstale":"2023-09-30T22:22:02.364409+0000","last_undegraded":"2023-09-30T22:22:02.364409+0000","last_fullsized":"2023-09-30T22:22:02.364409+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.384947+0000","last_change":"2023-09-30T22:22:02.381424+0000","last_active":"2023-09-30T22:22:02.384947+0000","last_peered":"2023-09-30T22:22:02.384947+0000","last_clean":"2023-09-30T22:22:02.384947+0000","last_became_active":"2023-09-30T22:22:02.380981+0000","last_became_peered":"2023-09-30T22:22:02.380981+0000","last_unstale":"2023-09-30T22:22:02.384947+0000","last_undegraded":"2023-09-30T22:22:02.384947+0000","last_fullsized":"2023-09-30T22:22:02.384947+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.368614+0000","last_change":"2023-09-30T22:22:01.995183+0000","last_active":"2023-09-30T22:22:02.368614+0000","last_peered":"2023-09-30T22:22:02.368614+0000","last_clean":"2023-09-30T22:22:02.368614+0000","last_became_active":"2023-09-30T22:22:01.994920+0000","last_became_peered":"2023-09-30T22:22:01.994920+0000","last_unstale":"2023-09-30T22:22:02.368614+0000","last_undegraded":"2023-09-30T22:22:02.368614+0000","last_fullsized":"2023-09-30T22:22:02.368614+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.399138+0000","last_change":"2023-09-30T22:22:02.395975+0000","last_active":"2023-09-30T22:22:02.399138+0000","last_peered":"2023-09-30T22:22:02.399138+0000","last_clean":"2023-09-30T22:22:02.399138+0000","last_became_active":"2023-09-30T22:22:02.395719+0000","last_became_peered":"2023-09-30T22:22:02.395719+0000","last_unstale":"2023-09-30T22:22:02.399138+0000","last_undegraded":"2023-09-30T22:22:02.399138+0000","last_fullsized":"2023-09-30T22:22:02.399138+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.398556+0000","last_change":"2023-09-30T22:22:01.998235+0000","last_active":"2023-09-30T22:22:02.398556+0000","last_peered":"2023-09-30T22:22:02.398556+0000","last_clean":"2023-09-30T22:22:02.398556+0000","last_became_active":"2023-09-30T22:22:01.997649+0000","last_became_peered":"2023-09-30T22:22:01.997649+0000","last_unstale":"2023-09-30T22:22:02.398556+0000","last_undegraded":"2023-09-30T22:22:02.398556+0000","last_fullsized":"2023-09-30T22:22:02.398556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394877+0000","last_change":"2023-09-30T22:22:02.390318+0000","last_active":"2023-09-30T22:22:02.394877+0000","last_peered":"2023-09-30T22:22:02.394877+0000","last_clean":"2023-09-30T22:22:02.394877+0000","last_became_active":"2023-09-30T22:22:02.390020+0000","last_became_peered":"2023-09-30T22:22:02.390020+0000","last_unstale":"2023-09-30T22:22:02.394877+0000","last_undegraded":"2023-09-30T22:22:02.394877+0000","last_fullsized":"2023-09-30T22:22:02.394877+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"16'6","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.404225+0000","last_change":"2023-09-30T22:22:01.993933+0000","last_active":"2023-09-30T22:22:02.404225+0000","last_peered":"2023-09-30T22:22:02.404225+0000","last_clean":"2023-09-30T22:22:02.404225+0000","last_became_active":"2023-09-30T22:22:01.993574+0000","last_became_peered":"2023-09-30T22:22:01.993574+0000","last_unstale":"2023-09-30T22:22:02.404225+0000","last_undegraded":"2023-09-30T22:22:02.404225+0000","last_fullsized":"2023-09-30T22:22:02.404225+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393799+0000","last_change":"2023-09-30T22:22:02.387576+0000","last_active":"2023-09-30T22:22:02.393799+0000","last_peered":"2023-09-30T22:22:02.393799+0000","last_clean":"2023-09-30T22:22:02.393799+0000","last_became_active":"2023-09-30T22:22:02.387235+0000","last_became_peered":"2023-09-30T22:22:02.387235+0000","last_unstale":"2023-09-30T22:22:02.393799+0000","last_undegraded":"2023-09-30T22:22:02.393799+0000","last_fullsized":"2023-09-30T22:22:02.393799+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.397834+0000","last_change":"2023-09-30T22:22:01.995522+0000","last_active":"2023-09-30T22:22:02.397834+0000","last_peered":"2023-09-30T22:22:02.397834+0000","last_clean":"2023-09-30T22:22:02.397834+0000","last_became_active":"2023-09-30T22:22:01.994928+0000","last_became_peered":"2023-09-30T22:22:01.994928+0000","last_unstale":"2023-09-30T22:22:02.397834+0000","last_undegraded":"2023-09-30T22:22:02.397834+0000","last_fullsized":"2023-09-30T22:22:02.397834+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394448+0000","last_change":"2023-09-30T22:22:02.383942+0000","last_active":"2023-09-30T22:22:02.394448+0000","last_peered":"2023-09-30T22:22:02.394448+0000","last_clean":"2023-09-30T22:22:02.394448+0000","last_became_active":"2023-09-30T22:22:02.383663+0000","last_became_peered":"2023-09-30T22:22:02.383663+0000","last_unstale":"2023-09-30T22:22:02.394448+0000","last_undegraded":"2023-09-30T22:22:02.394448+0000","last_fullsized":"2023-09-30T22:22:02.394448+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.360247+0000","last_change":"2023-09-30T22:22:01.997424+0000","last_active":"2023-09-30T22:22:02.360247+0000","last_peered":"2023-09-30T22:22:02.360247+0000","last_clean":"2023-09-30T22:22:02.360247+0000","last_became_active":"2023-09-30T22:22:01.997098+0000","last_became_peered":"2023-09-30T22:22:01.997098+0000","last_unstale":"2023-09-30T22:22:02.360247+0000","last_undegraded":"2023-09-30T22:22:02.360247+0000","last_fullsized":"2023-09-30T22:22:02.360247+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.399142+0000","last_change":"2023-09-30T22:22:02.396425+0000","last_active":"2023-09-30T22:22:02.399142+0000","last_peered":"2023-09-30T22:22:02.399142+0000","last_clean":"2023-09-30T22:22:02.399142+0000","last_became_active":"2023-09-30T22:22:02.396152+0000","last_became_peered":"2023-09-30T22:22:02.396152+0000","last_unstale":"2023-09-30T22:22:02.399142+0000","last_undegraded":"2023-09-30T22:22:02.399142+0000","last_fullsized":"2023-09-30T22:22:02.399142+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.363664+0000","last_change":"2023-09-30T22:22:01.994313+0000","last_active":"2023-09-30T22:22:02.363664+0000","last_peered":"2023-09-30T22:22:02.363664+0000","last_clean":"2023-09-30T22:22:02.363664+0000","last_became_active":"2023-09-30T22:22:01.993994+0000","last_became_peered":"2023-09-30T22:22:01.993994+0000","last_unstale":"2023-09-30T22:22:02.363664+0000","last_undegraded":"2023-09-30T22:22:02.363664+0000","last_fullsized":"2023-09-30T22:22:02.363664+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.395039+0000","last_change":"2023-09-30T22:22:02.391210+0000","last_active":"2023-09-30T22:22:02.395039+0000","last_peered":"2023-09-30T22:22:02.395039+0000","last_clean":"2023-09-30T22:22:02.395039+0000","last_became_active":"2023-09-30T22:22:02.390937+0000","last_became_peered":"2023-09-30T22:22:02.390937+0000","last_unstale":"2023-09-30T22:22:02.395039+0000","last_undegraded":"2023-09-30T22:22:02.395039+0000","last_fullsized":"2023-09-30T22:22:02.395039+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.389161+0000","last_change":"2023-09-30T22:22:01.974848+0000","last_active":"2023-09-30T22:22:02.389161+0000","last_peered":"2023-09-30T22:22:02.389161+0000","last_clean":"2023-09-30T22:22:02.389161+0000","last_became_active":"2023-09-30T22:22:01.974025+0000","last_became_peered":"2023-09-30T22:22:01.974025+0000","last_unstale":"2023-09-30T22:22:02.389161+0000","last_undegraded":"2023-09-30T22:22:02.389161+0000","last_fullsized":"2023-09-30T22:22:02.389161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394389+0000","last_change":"2023-09-30T22:22:02.383497+0000","last_active":"2023-09-30T22:22:02.394389+0000","last_peered":"2023-09-30T22:22:02.394389+0000","last_clean":"2023-09-30T22:22:02.394389+0000","last_became_active":"2023-09-30T22:22:02.383215+0000","last_became_peered":"2023-09-30T22:22:02.383215+0000","last_unstale":"2023-09-30T22:22:02.394389+0000","last_undegraded":"2023-09-30T22:22:02.394389+0000","last_fullsized":"2023-09-30T22:22:02.394389+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393941+0000","last_change":"2023-09-30T22:22:01.979910+0000","last_active":"2023-09-30T22:22:02.393941+0000","last_peered":"2023-09-30T22:22:02.393941+0000","last_clean":"2023-09-30T22:22:02.393941+0000","last_became_active":"2023-09-30T22:22:01.979649+0000","last_became_peered":"2023-09-30T22:22:01.979649+0000","last_unstale":"2023-09-30T22:22:02.393941+0000","last_undegraded":"2023-09-30T22:22:02.393941+0000","last_fullsized":"2023-09-30T22:22:02.393941+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.384926+0000","last_change":"2023-09-30T22:22:02.381246+0000","last_active":"2023-09-30T22:22:02.384926+0000","last_peered":"2023-09-30T22:22:02.384926+0000","last_clean":"2023-09-30T22:22:02.384926+0000","last_became_active":"2023-09-30T22:22:02.380654+0000","last_became_peered":"2023-09-30T22:22:02.380654+0000","last_unstale":"2023-09-30T22:22:02.384926+0000","last_undegraded":"2023-09-30T22:22:02.384926+0000","last_fullsized":"2023-09-30T22:22:02.384926+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.386375+0000","last_change":"2023-09-30T22:22:01.990442+0000","last_active":"2023-09-30T22:22:02.386375+0000","last_peered":"2023-09-30T22:22:02.386375+0000","last_clean":"2023-09-30T22:22:02.386375+0000","last_became_active":"2023-09-30T22:22:01.990217+0000","last_became_peered":"2023-09-30T22:22:01.990217+0000","last_unstale":"2023-09-30T22:22:02.386375+0000","last_undegraded":"2023-09-30T22:22:02.386375+0000","last_fullsized":"2023-09-30T22:22:02.386375+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394816+0000","last_change":"2023-09-30T22:22:02.390201+0000","last_active":"2023-09-30T22:22:02.394816+0000","last_peered":"2023-09-30T22:22:02.394816+0000","last_clean":"2023-09-30T22:22:02.394816+0000","last_became_active":"2023-09-30T22:22:02.389897+0000","last_became_peered":"2023-09-30T22:22:02.389897+0000","last_unstale":"2023-09-30T22:22:02.394816+0000","last_undegraded":"2023-09-30T22:22:02.394816+0000","last_fullsized":"2023-09-30T22:22:02.394816+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.395355+0000","last_change":"2023-09-30T22:22:01.996439+0000","last_active":"2023-09-30T22:22:02.395355+0000","last_peered":"2023-09-30T22:22:02.395355+0000","last_clean":"2023-09-30T22:22:02.395355+0000","last_became_active":"2023-09-30T22:22:01.996114+0000","last_became_peered":"2023-09-30T22:22:01.996114+0000","last_unstale":"2023-09-30T22:22:02.395355+0000","last_undegraded":"2023-09-30T22:22:02.395355+0000","last_fullsized":"2023-09-30T22:22:02.395355+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393352+0000","last_change":"2023-09-30T22:22:02.384428+0000","last_active":"2023-09-30T22:22:02.393352+0000","last_peered":"2023-09-30T22:22:02.393352+0000","last_clean":"2023-09-30T22:22:02.393352+0000","last_became_active":"2023-09-30T22:22:02.383704+0000","last_became_peered":"2023-09-30T22:22:02.383704+0000","last_unstale":"2023-09-30T22:22:02.393352+0000","last_undegraded":"2023-09-30T22:22:02.393352+0000","last_fullsized":"2023-09-30T22:22:02.393352+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.361009+0000","last_change":"2023-09-30T22:22:01.998688+0000","last_active":"2023-09-30T22:22:02.361009+0000","last_peered":"2023-09-30T22:22:02.361009+0000","last_clean":"2023-09-30T22:22:02.361009+0000","last_became_active":"2023-09-30T22:22:01.998390+0000","last_became_peered":"2023-09-30T22:22:01.998390+0000","last_unstale":"2023-09-30T22:22:02.361009+0000","last_undegraded":"2023-09-30T22:22:02.361009+0000","last_fullsized":"2023-09-30T22:22:02.361009+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385081+0000","last_change":"2023-09-30T22:22:02.376261+0000","last_active":"2023-09-30T22:22:02.385081+0000","last_peered":"2023-09-30T22:22:02.385081+0000","last_clean":"2023-09-30T22:22:02.385081+0000","last_became_active":"2023-09-30T22:22:02.375940+0000","last_became_peered":"2023-09-30T22:22:02.375940+0000","last_unstale":"2023-09-30T22:22:02.385081+0000","last_undegraded":"2023-09-30T22:22:02.385081+0000","last_fullsized":"2023-09-30T22:22:02.385081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.397715+0000","last_change":"2023-09-30T22:22:01.995642+0000","last_active":"2023-09-30T22:22:02.397715+0000","last_peered":"2023-09-30T22:22:02.397715+0000","last_clean":"2023-09-30T22:22:02.397715+0000","last_became_active":"2023-09-30T22:22:01.995224+0000","last_became_peered":"2023-09-30T22:22:01.995224+0000","last_unstale":"2023-09-30T22:22:02.397715+0000","last_undegraded":"2023-09-30T22:22:02.397715+0000","last_fullsized":"2023-09-30T22:22:02.397715+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394834+0000","last_change":"2023-09-30T22:22:02.390443+0000","last_active":"2023-09-30T22:22:02.394834+0000","last_peered":"2023-09-30T22:22:02.394834+0000","last_clean":"2023-09-30T22:22:02.394834+0000","last_became_active":"2023-09-30T22:22:02.390261+0000","last_became_peered":"2023-09-30T22:22:02.390261+0000","last_unstale":"2023-09-30T22:22:02.394834+0000","last_undegraded":"2023-09-30T22:22:02.394834+0000","last_fullsized":"2023-09-30T22:22:02.394834+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.363042+0000","last_change":"2023-09-30T22:22:01.995738+0000","last_active":"2023-09-30T22:22:02.363042+0000","last_peered":"2023-09-30T22:22:02.363042+0000","last_clean":"2023-09-30T22:22:02.363042+0000","last_became_active":"2023-09-30T22:22:01.994552+0000","last_became_peered":"2023-09-30T22:22:01.994552+0000","last_unstale":"2023-09-30T22:22:02.363042+0000","last_undegraded":"2023-09-30T22:22:02.363042+0000","last_fullsized":"2023-09-30T22:22:02.363042+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.388642+0000","last_change":"2023-09-30T22:22:02.382026+0000","last_active":"2023-09-30T22:22:02.388642+0000","last_peered":"2023-09-30T22:22:02.388642+0000","last_clean":"2023-09-30T22:22:02.388642+0000","last_became_active":"2023-09-30T22:22:02.378486+0000","last_became_peered":"2023-09-30T22:22:02.378486+0000","last_unstale":"2023-09-30T22:22:02.388642+0000","last_undegraded":"2023-09-30T22:22:02.388642+0000","last_fullsized":"2023-09-30T22:22:02.388642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.359669+0000","last_change":"2023-09-30T22:22:01.994235+0000","last_active":"2023-09-30T22:22:02.359669+0000","last_peered":"2023-09-30T22:22:02.359669+0000","last_clean":"2023-09-30T22:22:02.359669+0000","last_became_active":"2023-09-30T22:22:01.993882+0000","last_became_peered":"2023-09-30T22:22:01.993882+0000","last_unstale":"2023-09-30T22:22:02.359669+0000","last_undegraded":"2023-09-30T22:22:02.359669+0000","last_fullsized":"2023-09-30T22:22:02.359669+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393722+0000","last_change":"2023-09-30T22:22:02.386102+0000","last_active":"2023-09-30T22:22:02.393722+0000","last_peered":"2023-09-30T22:22:02.393722+0000","last_clean":"2023-09-30T22:22:02.393722+0000","last_became_active":"2023-09-30T22:22:02.384968+0000","last_became_peered":"2023-09-30T22:22:02.384968+0000","last_unstale":"2023-09-30T22:22:02.393722+0000","last_undegraded":"2023-09-30T22:22:02.393722+0000","last_fullsized":"2023-09-30T22:22:02.393722+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.358511+0000","last_change":"2023-09-30T22:22:01.995015+0000","last_active":"2023-09-30T22:22:02.358511+0000","last_peered":"2023-09-30T22:22:02.358511+0000","last_clean":"2023-09-30T22:22:02.358511+0000","last_became_active":"2023-09-30T22:22:01.994743+0000","last_became_peered":"2023-09-30T22:22:01.994743+0000","last_unstale":"2023-09-30T22:22:02.358511+0000","last_undegraded":"2023-09-30T22:22:02.358511+0000","last_fullsized":"2023-09-30T22:22:02.358511+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394399+0000","last_change":"2023-09-30T22:22:02.385985+0000","last_active":"2023-09-30T22:22:02.394399+0000","last_peered":"2023-09-30T22:22:02.394399+0000","last_clean":"2023-09-30T22:22:02.394399+0000","last_became_active":"2023-09-30T22:22:02.385413+0000","last_became_peered":"2023-09-30T22:22:02.385413+0000","last_unstale":"2023-09-30T22:22:02.394399+0000","last_undegraded":"2023-09-30T22:22:02.394399+0000","last_fullsized":"2023-09-30T22:22:02.394399+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.359640+0000","last_change":"2023-09-30T22:21:58.403636+0000","last_active":"2023-09-30T22:22:02.359640+0000","last_peered":"2023-09-30T22:22:02.359640+0000","last_clean":"2023-09-30T22:22:02.359640+0000","last_became_active":"2023-09-30T22:21:58.403342+0000","last_became_peered":"2023-09-30T22:21:58.403342+0000","last_unstale":"2023-09-30T22:22:02.359640+0000","last_undegraded":"2023-09-30T22:22:02.359640+0000","last_fullsized":"2023-09-30T22:22:02.359640+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.364135+0000","last_change":"2023-09-30T22:22:01.997724+0000","last_active":"2023-09-30T22:22:02.364135+0000","last_peered":"2023-09-30T22:22:02.364135+0000","last_clean":"2023-09-30T22:22:02.364135+0000","last_became_active":"2023-09-30T22:22:01.997451+0000","last_became_peered":"2023-09-30T22:22:01.997451+0000","last_unstale":"2023-09-30T22:22:02.364135+0000","last_undegraded":"2023-09-30T22:22:02.364135+0000","last_fullsized":"2023-09-30T22:22:02.364135+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394856+0000","last_change":"2023-09-30T22:22:02.389982+0000","last_active":"2023-09-30T22:22:02.394856+0000","last_peered":"2023-09-30T22:22:02.394856+0000","last_clean":"2023-09-30T22:22:02.394856+0000","last_became_active":"2023-09-30T22:22:02.389680+0000","last_became_peered":"2023-09-30T22:22:02.389680+0000","last_unstale":"2023-09-30T22:22:02.394856+0000","last_undegraded":"2023-09-30T22:22:02.394856+0000","last_fullsized":"2023-09-30T22:22:02.394856+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.363445+0000","last_change":"2023-09-30T22:21:57.839392+0000","last_active":"2023-09-30T22:22:02.363445+0000","last_peered":"2023-09-30T22:22:02.363445+0000","last_clean":"2023-09-30T22:22:02.363445+0000","last_became_active":"2023-09-30T22:21:57.838993+0000","last_became_peered":"2023-09-30T22:21:57.838993+0000","last_unstale":"2023-09-30T22:22:02.363445+0000","last_undegraded":"2023-09-30T22:22:02.363445+0000","last_fullsized":"2023-09-30T22:22:02.363445+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.363117+0000","last_change":"2023-09-30T22:22:01.990265+0000","last_active":"2023-09-30T22:22:02.363117+0000","last_peered":"2023-09-30T22:22:02.363117+0000","last_clean":"2023-09-30T22:22:02.363117+0000","last_became_active":"2023-09-30T22:22:01.990011+0000","last_became_peered":"2023-09-30T22:22:01.990011+0000","last_unstale":"2023-09-30T22:22:02.363117+0000","last_undegraded":"2023-09-30T22:22:02.363117+0000","last_fullsized":"2023-09-30T22:22:02.363117+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.383793+0000","last_change":"2023-09-30T22:22:02.374205+0000","last_active":"2023-09-30T22:22:02.383793+0000","last_peered":"2023-09-30T22:22:02.383793+0000","last_clean":"2023-09-30T22:22:02.383793+0000","last_became_active":"2023-09-30T22:22:02.373928+0000","last_became_peered":"2023-09-30T22:22:02.373928+0000","last_unstale":"2023-09-30T22:22:02.383793+0000","last_undegraded":"2023-09-30T22:22:02.383793+0000","last_fullsized":"2023-09-30T22:22:02.383793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.363749+0000","last_change":"2023-09-30T22:21:57.836160+0000","last_active":"2023-09-30T22:22:02.363749+0000","last_peered":"2023-09-30T22:22:02.363749+0000","last_clean":"2023-09-30T22:22:02.363749+0000","last_became_active":"2023-09-30T22:21:57.835792+0000","last_became_peered":"2023-09-30T22:21:57.835792+0000","last_unstale":"2023-09-30T22:22:02.363749+0000","last_undegraded":"2023-09-30T22:22:02.363749+0000","last_fullsized":"2023-09-30T22:22:02.363749+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.359810+0000","last_change":"2023-09-30T22:22:01.987700+0000","last_active":"2023-09-30T22:22:02.359810+0000","last_peered":"2023-09-30T22:22:02.359810+0000","last_clean":"2023-09-30T22:22:02.359810+0000","last_became_active":"2023-09-30T22:22:01.987358+0000","last_became_peered":"2023-09-30T22:22:01.987358+0000","last_unstale":"2023-09-30T22:22:02.359810+0000","last_undegraded":"2023-09-30T22:22:02.359810+0000","last_fullsized":"2023-09-30T22:22:02.359810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.382010+0000","last_change":"2023-09-30T22:22:02.379845+0000","last_active":"2023-09-30T22:22:02.382010+0000","last_peered":"2023-09-30T22:22:02.382010+0000","last_clean":"2023-09-30T22:22:02.382010+0000","last_became_active":"2023-09-30T22:22:02.379594+0000","last_became_peered":"2023-09-30T22:22:02.379594+0000","last_unstale":"2023-09-30T22:22:02.382010+0000","last_undegraded":"2023-09-30T22:22:02.382010+0000","last_fullsized":"2023-09-30T22:22:02.382010+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.359678+0000","last_change":"2023-09-30T22:21:57.838957+0000","last_active":"2023-09-30T22:22:02.359678+0000","last_peered":"2023-09-30T22:22:02.359678+0000","last_clean":"2023-09-30T22:22:02.359678+0000","last_became_active":"2023-09-30T22:21:57.838667+0000","last_became_peered":"2023-09-30T22:21:57.838667+0000","last_unstale":"2023-09-30T22:22:02.359678+0000","last_undegraded":"2023-09-30T22:22:02.359678+0000","last_fullsized":"2023-09-30T22:22:02.359678+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.359529+0000","last_change":"2023-09-30T22:21:56.838072+0000","last_active":"2023-09-30T22:22:02.359529+0000","last_peered":"2023-09-30T22:22:02.359529+0000","last_clean":"2023-09-30T22:22:02.359529+0000","last_became_active":"2023-09-30T22:21:56.837717+0000","last_became_peered":"2023-09-30T22:21:56.837717+0000","last_unstale":"2023-09-30T22:22:02.359529+0000","last_undegraded":"2023-09-30T22:22:02.359529+0000","last_fullsized":"2023-09-30T22:22:02.359529+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:55.823939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:55.823939+0000","last_clean_scrub_stamp":"2023-09-30T22:21:55.823939+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.362949+0000","last_change":"2023-09-30T22:22:01.994653+0000","last_active":"2023-09-30T22:22:02.362949+0000","last_peered":"2023-09-30T22:22:02.362949+0000","last_clean":"2023-09-30T22:22:02.362949+0000","last_became_active":"2023-09-30T22:22:01.994362+0000","last_became_peered":"2023-09-30T22:22:01.994362+0000","last_unstale":"2023-09-30T22:22:02.362949+0000","last_undegraded":"2023-09-30T22:22:02.362949+0000","last_fullsized":"2023-09-30T22:22:02.362949+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.388623+0000","last_change":"2023-09-30T22:22:02.381190+0000","last_active":"2023-09-30T22:22:02.388623+0000","last_peered":"2023-09-30T22:22:02.388623+0000","last_clean":"2023-09-30T22:22:02.388623+0000","last_became_active":"2023-09-30T22:22:02.380952+0000","last_became_peered":"2023-09-30T22:22:02.380952+0000","last_unstale":"2023-09-30T22:22:02.388623+0000","last_undegraded":"2023-09-30T22:22:02.388623+0000","last_fullsized":"2023-09-30T22:22:02.388623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.358689+0000","last_change":"2023-09-30T22:21:57.837598+0000","last_active":"2023-09-30T22:22:02.358689+0000","last_peered":"2023-09-30T22:22:02.358689+0000","last_clean":"2023-09-30T22:22:02.358689+0000","last_became_active":"2023-09-30T22:21:57.837284+0000","last_became_peered":"2023-09-30T22:21:57.837284+0000","last_unstale":"2023-09-30T22:22:02.358689+0000","last_undegraded":"2023-09-30T22:22:02.358689+0000","last_fullsized":"2023-09-30T22:22:02.358689+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.364183+0000","last_change":"2023-09-30T22:22:01.983059+0000","last_active":"2023-09-30T22:22:02.364183+0000","last_peered":"2023-09-30T22:22:02.364183+0000","last_clean":"2023-09-30T22:22:02.364183+0000","last_became_active":"2023-09-30T22:22:01.982739+0000","last_became_peered":"2023-09-30T22:22:01.982739+0000","last_unstale":"2023-09-30T22:22:02.364183+0000","last_undegraded":"2023-09-30T22:22:02.364183+0000","last_fullsized":"2023-09-30T22:22:02.364183+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385106+0000","last_change":"2023-09-30T22:22:02.380074+0000","last_active":"2023-09-30T22:22:02.385106+0000","last_peered":"2023-09-30T22:22:02.385106+0000","last_clean":"2023-09-30T22:22:02.385106+0000","last_became_active":"2023-09-30T22:22:02.379501+0000","last_became_peered":"2023-09-30T22:22:02.379501+0000","last_unstale":"2023-09-30T22:22:02.385106+0000","last_undegraded":"2023-09-30T22:22:02.385106+0000","last_fullsized":"2023-09-30T22:22:02.385106+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.364495+0000","last_change":"2023-09-30T22:21:58.403508+0000","last_active":"2023-09-30T22:22:02.364495+0000","last_peered":"2023-09-30T22:22:02.364495+0000","last_clean":"2023-09-30T22:22:02.364495+0000","last_became_active":"2023-09-30T22:21:58.403267+0000","last_became_peered":"2023-09-30T22:21:58.403267+0000","last_unstale":"2023-09-30T22:22:02.364495+0000","last_undegraded":"2023-09-30T22:22:02.364495+0000","last_fullsized":"2023-09-30T22:22:02.364495+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.359534+0000","last_change":"2023-09-30T22:22:01.987265+0000","last_active":"2023-09-30T22:22:02.359534+0000","last_peered":"2023-09-30T22:22:02.359534+0000","last_clean":"2023-09-30T22:22:02.359534+0000","last_became_active":"2023-09-30T22:22:01.986968+0000","last_became_peered":"2023-09-30T22:22:01.986968+0000","last_unstale":"2023-09-30T22:22:02.359534+0000","last_undegraded":"2023-09-30T22:22:02.359534+0000","last_fullsized":"2023-09-30T22:22:02.359534+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385062+0000","last_change":"2023-09-30T22:22:02.376013+0000","last_active":"2023-09-30T22:22:02.385062+0000","last_peered":"2023-09-30T22:22:02.385062+0000","last_clean":"2023-09-30T22:22:02.385062+0000","last_became_active":"2023-09-30T22:22:02.374252+0000","last_became_peered":"2023-09-30T22:22:02.374252+0000","last_unstale":"2023-09-30T22:22:02.385062+0000","last_undegraded":"2023-09-30T22:22:02.385062+0000","last_fullsized":"2023-09-30T22:22:02.385062+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.395176+0000","last_change":"2023-09-30T22:22:01.994188+0000","last_active":"2023-09-30T22:22:02.395176+0000","last_peered":"2023-09-30T22:22:02.395176+0000","last_clean":"2023-09-30T22:22:02.395176+0000","last_became_active":"2023-09-30T22:22:01.993644+0000","last_became_peered":"2023-09-30T22:22:01.993644+0000","last_unstale":"2023-09-30T22:22:02.395176+0000","last_undegraded":"2023-09-30T22:22:02.395176+0000","last_fullsized":"2023-09-30T22:22:02.395176+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.360873+0000","last_change":"2023-09-30T22:21:58.403570+0000","last_active":"2023-09-30T22:22:02.360873+0000","last_peered":"2023-09-30T22:22:02.360873+0000","last_clean":"2023-09-30T22:22:02.360873+0000","last_became_active":"2023-09-30T22:21:58.403321+0000","last_became_peered":"2023-09-30T22:21:58.403321+0000","last_unstale":"2023-09-30T22:22:02.360873+0000","last_undegraded":"2023-09-30T22:22:02.360873+0000","last_fullsized":"2023-09-30T22:22:02.360873+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.381516+0000","last_change":"2023-09-30T22:22:02.372818+0000","last_active":"2023-09-30T22:22:02.381516+0000","last_peered":"2023-09-30T22:22:02.381516+0000","last_clean":"2023-09-30T22:22:02.381516+0000","last_became_active":"2023-09-30T22:22:02.372623+0000","last_became_peered":"2023-09-30T22:22:02.372623+0000","last_unstale":"2023-09-30T22:22:02.381516+0000","last_undegraded":"2023-09-30T22:22:02.381516+0000","last_fullsized":"2023-09-30T22:22:02.381516+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.369758+0000","last_change":"2023-09-30T22:21:58.404380+0000","last_active":"2023-09-30T22:22:02.369758+0000","last_peered":"2023-09-30T22:22:02.369758+0000","last_clean":"2023-09-30T22:22:02.369758+0000","last_became_active":"2023-09-30T22:21:58.404098+0000","last_became_peered":"2023-09-30T22:21:58.404098+0000","last_unstale":"2023-09-30T22:22:02.369758+0000","last_undegraded":"2023-09-30T22:22:02.369758+0000","last_fullsized":"2023-09-30T22:22:02.369758+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.366010+0000","last_change":"2023-09-30T22:22:01.977163+0000","last_active":"2023-09-30T22:22:02.366010+0000","last_peered":"2023-09-30T22:22:02.366010+0000","last_clean":"2023-09-30T22:22:02.366010+0000","last_became_active":"2023-09-30T22:22:01.976494+0000","last_became_peered":"2023-09-30T22:22:01.976494+0000","last_unstale":"2023-09-30T22:22:02.366010+0000","last_undegraded":"2023-09-30T22:22:02.366010+0000","last_fullsized":"2023-09-30T22:22:02.366010+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393757+0000","last_change":"2023-09-30T22:22:02.386251+0000","last_active":"2023-09-30T22:22:02.393757+0000","last_peered":"2023-09-30T22:22:02.393757+0000","last_clean":"2023-09-30T22:22:02.393757+0000","last_became_active":"2023-09-30T22:22:02.385701+0000","last_became_peered":"2023-09-30T22:22:02.385701+0000","last_unstale":"2023-09-30T22:22:02.393757+0000","last_undegraded":"2023-09-30T22:22:02.393757+0000","last_fullsized":"2023-09-30T22:22:02.393757+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.398231+0000","last_change":"2023-09-30T22:22:01.997989+0000","last_active":"2023-09-30T22:22:02.398231+0000","last_peered":"2023-09-30T22:22:02.398231+0000","last_clean":"2023-09-30T22:22:02.398231+0000","last_became_active":"2023-09-30T22:22:01.997419+0000","last_became_peered":"2023-09-30T22:22:01.997419+0000","last_unstale":"2023-09-30T22:22:02.398231+0000","last_undegraded":"2023-09-30T22:22:02.398231+0000","last_fullsized":"2023-09-30T22:22:02.398231+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380856+0000","last_change":"2023-09-30T22:22:02.379106+0000","last_active":"2023-09-30T22:22:02.380856+0000","last_peered":"2023-09-30T22:22:02.380856+0000","last_clean":"2023-09-30T22:22:02.380856+0000","last_became_active":"2023-09-30T22:22:02.378452+0000","last_became_peered":"2023-09-30T22:22:02.378452+0000","last_unstale":"2023-09-30T22:22:02.380856+0000","last_undegraded":"2023-09-30T22:22:02.380856+0000","last_fullsized":"2023-09-30T22:22:02.380856+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380701+0000","last_change":"2023-09-30T22:22:01.977515+0000","last_active":"2023-09-30T22:22:02.380701+0000","last_peered":"2023-09-30T22:22:02.380701+0000","last_clean":"2023-09-30T22:22:02.380701+0000","last_became_active":"2023-09-30T22:22:01.976843+0000","last_became_peered":"2023-09-30T22:22:01.976843+0000","last_unstale":"2023-09-30T22:22:02.380701+0000","last_undegraded":"2023-09-30T22:22:02.380701+0000","last_fullsized":"2023-09-30T22:22:02.380701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393819+0000","last_change":"2023-09-30T22:22:02.387751+0000","last_active":"2023-09-30T22:22:02.393819+0000","last_peered":"2023-09-30T22:22:02.393819+0000","last_clean":"2023-09-30T22:22:02.393819+0000","last_became_active":"2023-09-30T22:22:02.387326+0000","last_became_peered":"2023-09-30T22:22:02.387326+0000","last_unstale":"2023-09-30T22:22:02.393819+0000","last_undegraded":"2023-09-30T22:22:02.393819+0000","last_fullsized":"2023-09-30T22:22:02.393819+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.395931+0000","last_change":"2023-09-30T22:22:01.996439+0000","last_active":"2023-09-30T22:22:02.395931+0000","last_peered":"2023-09-30T22:22:02.395931+0000","last_clean":"2023-09-30T22:22:02.395931+0000","last_became_active":"2023-09-30T22:22:01.996179+0000","last_became_peered":"2023-09-30T22:22:01.996179+0000","last_unstale":"2023-09-30T22:22:02.395931+0000","last_undegraded":"2023-09-30T22:22:02.395931+0000","last_fullsized":"2023-09-30T22:22:02.395931+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393375+0000","last_change":"2023-09-30T22:22:02.384588+0000","last_active":"2023-09-30T22:22:02.393375+0000","last_peered":"2023-09-30T22:22:02.393375+0000","last_clean":"2023-09-30T22:22:02.393375+0000","last_became_active":"2023-09-30T22:22:02.384072+0000","last_became_peered":"2023-09-30T22:22:02.384072+0000","last_unstale":"2023-09-30T22:22:02.393375+0000","last_undegraded":"2023-09-30T22:22:02.393375+0000","last_fullsized":"2023-09-30T22:22:02.393375+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393972+0000","last_change":"2023-09-30T22:22:01.993986+0000","last_active":"2023-09-30T22:22:02.393972+0000","last_peered":"2023-09-30T22:22:02.393972+0000","last_clean":"2023-09-30T22:22:02.393972+0000","last_became_active":"2023-09-30T22:22:01.993575+0000","last_became_peered":"2023-09-30T22:22:01.993575+0000","last_unstale":"2023-09-30T22:22:02.393972+0000","last_undegraded":"2023-09-30T22:22:02.393972+0000","last_fullsized":"2023-09-30T22:22:02.393972+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.383708+0000","last_change":"2023-09-30T22:22:02.378109+0000","last_active":"2023-09-30T22:22:02.383708+0000","last_peered":"2023-09-30T22:22:02.383708+0000","last_clean":"2023-09-30T22:22:02.383708+0000","last_became_active":"2023-09-30T22:22:02.377671+0000","last_became_peered":"2023-09-30T22:22:02.377671+0000","last_unstale":"2023-09-30T22:22:02.383708+0000","last_undegraded":"2023-09-30T22:22:02.383708+0000","last_fullsized":"2023-09-30T22:22:02.383708+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.386441+0000","last_change":"2023-09-30T22:22:01.980853+0000","last_active":"2023-09-30T22:22:02.386441+0000","last_peered":"2023-09-30T22:22:02.386441+0000","last_clean":"2023-09-30T22:22:02.386441+0000","last_became_active":"2023-09-30T22:22:01.979795+0000","last_became_peered":"2023-09-30T22:22:01.979795+0000","last_unstale":"2023-09-30T22:22:02.386441+0000","last_undegraded":"2023-09-30T22:22:02.386441+0000","last_fullsized":"2023-09-30T22:22:02.386441+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380713+0000","last_change":"2023-09-30T22:22:02.377790+0000","last_active":"2023-09-30T22:22:02.380713+0000","last_peered":"2023-09-30T22:22:02.380713+0000","last_clean":"2023-09-30T22:22:02.380713+0000","last_became_active":"2023-09-30T22:22:02.377478+0000","last_became_peered":"2023-09-30T22:22:02.377478+0000","last_unstale":"2023-09-30T22:22:02.380713+0000","last_undegraded":"2023-09-30T22:22:02.380713+0000","last_fullsized":"2023-09-30T22:22:02.380713+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380254+0000","last_change":"2023-09-30T22:22:02.373820+0000","last_active":"2023-09-30T22:22:02.380254+0000","last_peered":"2023-09-30T22:22:02.380254+0000","last_clean":"2023-09-30T22:22:02.380254+0000","last_became_active":"2023-09-30T22:22:02.373530+0000","last_became_peered":"2023-09-30T22:22:02.373530+0000","last_unstale":"2023-09-30T22:22:02.380254+0000","last_undegraded":"2023-09-30T22:22:02.380254+0000","last_fullsized":"2023-09-30T22:22:02.380254+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.383688+0000","last_change":"2023-09-30T22:22:02.377945+0000","last_active":"2023-09-30T22:22:02.383688+0000","last_peered":"2023-09-30T22:22:02.383688+0000","last_clean":"2023-09-30T22:22:02.383688+0000","last_became_active":"2023-09-30T22:22:02.377355+0000","last_became_peered":"2023-09-30T22:22:02.377355+0000","last_unstale":"2023-09-30T22:22:02.383688+0000","last_undegraded":"2023-09-30T22:22:02.383688+0000","last_fullsized":"2023-09-30T22:22:02.383688+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394694+0000","last_change":"2023-09-30T22:22:02.387890+0000","last_active":"2023-09-30T22:22:02.394694+0000","last_peered":"2023-09-30T22:22:02.394694+0000","last_clean":"2023-09-30T22:22:02.394694+0000","last_became_active":"2023-09-30T22:22:02.387599+0000","last_became_peered":"2023-09-30T22:22:02.387599+0000","last_unstale":"2023-09-30T22:22:02.394694+0000","last_undegraded":"2023-09-30T22:22:02.394694+0000","last_fullsized":"2023-09-30T22:22:02.394694+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.397499+0000","last_change":"2023-09-30T22:22:02.385159+0000","last_active":"2023-09-30T22:22:02.397499+0000","last_peered":"2023-09-30T22:22:02.397499+0000","last_clean":"2023-09-30T22:22:02.397499+0000","last_became_active":"2023-09-30T22:22:02.376532+0000","last_became_peered":"2023-09-30T22:22:02.376532+0000","last_unstale":"2023-09-30T22:22:02.397499+0000","last_undegraded":"2023-09-30T22:22:02.397499+0000","last_fullsized":"2023-09-30T22:22:02.397499+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.383770+0000","last_change":"2023-09-30T22:22:02.374216+0000","last_active":"2023-09-30T22:22:02.383770+0000","last_peered":"2023-09-30T22:22:02.383770+0000","last_clean":"2023-09-30T22:22:02.383770+0000","last_became_active":"2023-09-30T22:22:02.373952+0000","last_became_peered":"2023-09-30T22:22:02.373952+0000","last_unstale":"2023-09-30T22:22:02.383770+0000","last_undegraded":"2023-09-30T22:22:02.383770+0000","last_fullsized":"2023-09-30T22:22:02.383770+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297264,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074576,"statfs":{"total":96636764160,"available":96332365824,"internally_reserved":0,"allocated":172032,"data_stored":48929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":48735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":46930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":47845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T22:22:11.152 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-30T22:22:11.152 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-09-30T22:22:11.152 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-09-30T22:22:11.152 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-09-30T22:22:11.152 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-09-30T22:22:11.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.306+0000 7fa2e156d700 1 Processor -- start 2023-09-30T22:22:11.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.306+0000 7fa2e156d700 1 -- start start 2023-09-30T22:22:11.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.307+0000 7fa2e156d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa2dc093250 0x7fa2dc12b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:11.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.307+0000 7fa2e156d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa2dc130060 0x7fa2dc132450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:11.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.307+0000 7fa2e156d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2dc0685f0 con 0x7fa2dc062e60 2023-09-30T22:22:11.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.307+0000 7fa2e156d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc0671d0 con 0x7fa2dc093250 2023-09-30T22:22:11.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.307+0000 7fa2e156d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc12ad30 con 0x7fa2dc130060 2023-09-30T22:22:11.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.307+0000 7fa2daffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa2dc062e60 0x7fa2dc12af20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49422/0 (socket says 172.21.15.40:49422) 2023-09-30T22:22:11.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.307+0000 7fa2daffd700 1 -- 172.21.15.40:0/448273702 learned_addr learned my addr 172.21.15.40:0/448273702 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:22:11.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.307+0000 7fa2d27fc700 1 --2- 172.21.15.40:0/448273702 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa2dc093250 0x7fa2dc12b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:11.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.307+0000 7fa2db7fe700 1 --2- 172.21.15.40:0/448273702 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa2dc130060 0x7fa2dc132450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:11.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.307+0000 7fa2da7fc700 1 -- 172.21.15.40:0/448273702 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 978578088 0 0) 0x7fa2dc0685f0 con 0x7fa2dc062e60 2023-09-30T22:22:11.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.308+0000 7fa2db7fe700 1 -- 172.21.15.40:0/448273702 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa2dc093250 msgr2=0x7fa2dc12b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:11.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.308+0000 7fa2db7fe700 1 --2- 172.21.15.40:0/448273702 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa2dc093250 0x7fa2dc12b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:11.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.308+0000 7fa2db7fe700 1 -- 172.21.15.40:0/448273702 >> v1:172.21.15.40:6789/0 conn(0x7fa2dc062e60 legacy=0x7fa2dc12af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.308+0000 7fa2db7fe700 1 -- 172.21.15.40:0/448273702 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2dc0676e0 con 0x7fa2dc130060 2023-09-30T22:22:11.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.308+0000 7fa2d27fc700 1 --2- 172.21.15.40:0/448273702 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa2dc093250 0x7fa2dc12b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:11.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.308+0000 7fa2db7fe700 1 --2- 172.21.15.40:0/448273702 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa2dc130060 0x7fa2dc132450 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fa2d4009e90 tx=0x7fa2d4009780).ready entity=mon.2 client_cookie=19ec7db902b25eb8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:11.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.308+0000 7fa2da7fc700 1 -- 172.21.15.40:0/448273702 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d400e070 con 0x7fa2dc130060 2023-09-30T22:22:11.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.308+0000 7fa2da7fc700 1 -- 172.21.15.40:0/448273702 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d400bb60 con 0x7fa2dc130060 2023-09-30T22:22:11.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.308+0000 7fa2da7fc700 1 -- 172.21.15.40:0/448273702 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d4012410 con 0x7fa2dc130060 2023-09-30T22:22:11.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.308+0000 7fa2e156d700 1 -- 172.21.15.40:0/448273702 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa2dc130060 msgr2=0x7fa2dc132450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.308+0000 7fa2e156d700 1 --2- 172.21.15.40:0/448273702 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa2dc130060 0x7fa2dc132450 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fa2d4009e90 tx=0x7fa2d4009780).stop 2023-09-30T22:22:11.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.308+0000 7fa2e156d700 1 -- 172.21.15.40:0/448273702 shutdown_connections 2023-09-30T22:22:11.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.308+0000 7fa2e156d700 1 --2- 172.21.15.40:0/448273702 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa2dc130060 0x7fa2dc132450 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:11.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.308+0000 7fa2e156d700 1 --2- 172.21.15.40:0/448273702 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa2dc093250 0x7fa2dc12b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:11.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.308+0000 7fa2e156d700 1 -- 172.21.15.40:0/448273702 >> 172.21.15.40:0/448273702 conn(0x7fa2dc09a450 msgr2=0x7fa2dc09a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:11.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.308+0000 7fa2e156d700 1 -- 172.21.15.40:0/448273702 shutdown_connections 2023-09-30T22:22:11.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.308+0000 7fa2e156d700 1 -- 172.21.15.40:0/448273702 wait complete. 2023-09-30T22:22:11.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.310+0000 7fa2e156d700 1 Processor -- start 2023-09-30T22:22:11.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.310+0000 7fa2e156d700 1 -- start start 2023-09-30T22:22:11.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.310+0000 7fa2e156d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2dc062e60 0x7fa2dc12a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:11.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.310+0000 7fa2e156d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa2dc093250 0x7fa2dc1122e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:11.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.310+0000 7fa2e156d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa2dc130060 0x7fa2dc1127d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:11.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.310+0000 7fa2e156d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc1137a0 con 0x7fa2dc062e60 2023-09-30T22:22:11.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.310+0000 7fa2e156d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc1149a0 con 0x7fa2dc093250 2023-09-30T22:22:11.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.311+0000 7fa2e156d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc067370 con 0x7fa2dc130060 2023-09-30T22:22:11.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.311+0000 7fa2daffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2dc062e60 0x7fa2dc12a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:11.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.311+0000 7fa2db7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa2dc130060 0x7fa2dc1127d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:11.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.311+0000 7fa2daffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2dc062e60 0x7fa2dc12a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46524/0 (socket says 172.21.15.40:46524) 2023-09-30T22:22:11.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.311+0000 7fa2daffd700 1 -- 172.21.15.40:0/2643171007 learned_addr learned my addr 172.21.15.40:0/2643171007 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:11.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.311+0000 7fa2d27fc700 1 --2- 172.21.15.40:0/2643171007 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa2dc093250 0x7fa2dc1122e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:11.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.311+0000 7fa2daffd700 1 -- 172.21.15.40:0/2643171007 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa2dc130060 msgr2=0x7fa2dc1127d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.311+0000 7fa2daffd700 1 --2- 172.21.15.40:0/2643171007 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa2dc130060 0x7fa2dc1127d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:11.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.311+0000 7fa2daffd700 1 -- 172.21.15.40:0/2643171007 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa2dc093250 msgr2=0x7fa2dc1122e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.311+0000 7fa2daffd700 1 --2- 172.21.15.40:0/2643171007 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa2dc093250 0x7fa2dc1122e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:11.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.311+0000 7fa2daffd700 1 -- 172.21.15.40:0/2643171007 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c40092a0 con 0x7fa2dc062e60 2023-09-30T22:22:11.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.311+0000 7fa2daffd700 1 --2- 172.21.15.40:0/2643171007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2dc062e60 0x7fa2dc12a4b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fa2cc00c4c0 tx=0x7fa2cc007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:11.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.311+0000 7fa2d37fe700 1 -- 172.21.15.40:0/2643171007 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc00ce30 con 0x7fa2dc062e60 2023-09-30T22:22:11.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.311+0000 7fa2d37fe700 1 -- 172.21.15.40:0/2643171007 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2cc0072e0 con 0x7fa2dc062e60 2023-09-30T22:22:11.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.311+0000 7fa2e156d700 1 -- 172.21.15.40:0/2643171007 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d4009a20 con 0x7fa2dc062e60 2023-09-30T22:22:11.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.311+0000 7fa2d37fe700 1 -- 172.21.15.40:0/2643171007 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc0057a0 con 0x7fa2dc062e60 2023-09-30T22:22:11.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.311+0000 7fa2e156d700 1 -- 172.21.15.40:0/2643171007 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2dc1164f0 con 0x7fa2dc062e60 2023-09-30T22:22:11.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.312+0000 7fa2d37fe700 1 -- 172.21.15.40:0/2643171007 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fa2cc005bd0 con 0x7fa2dc062e60 2023-09-30T22:22:11.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.312+0000 7fa2d37fe700 1 -- 172.21.15.40:0/2643171007 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fa2cc03a650 con 0x7fa2dc062e60 2023-09-30T22:22:11.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.312+0000 7fa2e156d700 1 -- 172.21.15.40:0/2643171007 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2dc05a260 con 0x7fa2dc062e60 2023-09-30T22:22:11.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.317+0000 7fa2d37fe700 1 -- 172.21.15.40:0/2643171007 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fa2cc01d3f0 con 0x7fa2dc062e60 2023-09-30T22:22:11.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.525+0000 7fa2e156d700 1 -- 172.21.15.40:0/2643171007 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fa2dc0936d0 con 0x7fa2dc062e60 2023-09-30T22:22:11.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.526+0000 7fa2d37fe700 1 -- 172.21.15.40:0/2643171007 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+64130 (secure 0 0 0) 0x7fa2cc01c350 con 0x7fa2dc062e60 2023-09-30T22:22:11.527 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:22:11.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.528+0000 7fa2e156d700 1 -- 172.21.15.40:0/2643171007 >> v1:172.21.15.40:6816/118905 conn(0x7fa2bc02bb60 legacy=0x7fa2bc02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.528+0000 7fa2e156d700 1 -- 172.21.15.40:0/2643171007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2dc062e60 msgr2=0x7fa2dc12a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.528+0000 7fa2e156d700 1 --2- 172.21.15.40:0/2643171007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2dc062e60 0x7fa2dc12a4b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fa2cc00c4c0 tx=0x7fa2cc007c10).stop 2023-09-30T22:22:11.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.528+0000 7fa2e156d700 1 -- 172.21.15.40:0/2643171007 shutdown_connections 2023-09-30T22:22:11.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.528+0000 7fa2e156d700 1 --2- 172.21.15.40:0/2643171007 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa2dc130060 0x7fa2dc1127d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:11.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.528+0000 7fa2e156d700 1 --2- 172.21.15.40:0/2643171007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2dc062e60 0x7fa2dc12a4b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:11.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.528+0000 7fa2e156d700 1 --2- 172.21.15.40:0/2643171007 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa2dc093250 0x7fa2dc1122e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:11.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.528+0000 7fa2e156d700 1 -- 172.21.15.40:0/2643171007 >> 172.21.15.40:0/2643171007 conn(0x7fa2dc09a450 msgr2=0x7fa2dc12f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:11.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.528+0000 7fa2e156d700 1 -- 172.21.15.40:0/2643171007 shutdown_connections 2023-09-30T22:22:11.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.528+0000 7fa2e156d700 1 -- 172.21.15.40:0/2643171007 wait complete. 2023-09-30T22:22:11.539 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":4,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6816","nonce":118905}]},"active_addr":"172.21.15.40:6816/118905","active_change":"2023-09-30T22:21:51.768844+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":1890660785}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":1764460125}]}]} 2023-09-30T22:22:11.541 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-09-30T22:22:11.541 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-30T22:22:11.541 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:22:11.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.661+0000 7f2f2415e700 1 Processor -- start 2023-09-30T22:22:11.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.662+0000 7f2f2415e700 1 -- start start 2023-09-30T22:22:11.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.662+0000 7f2f2415e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2f1c098b10 0x7f2f1c096160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:11.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.662+0000 7f2f2415e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2f1c098ef0 0x7f2f1c0992f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:11.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.662+0000 7f2f2415e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f1c098910 con 0x7f2f1c0997e0 2023-09-30T22:22:11.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.662+0000 7f2f2415e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f1c065e40 con 0x7f2f1c098ef0 2023-09-30T22:22:11.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.662+0000 7f2f2415e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c0955c0 con 0x7f2f1c098b10 2023-09-30T22:22:11.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.662+0000 7f2f21efa700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2f1c098b10 0x7f2f1c096160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:11.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.662+0000 7f2f216f9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2f1c098ef0 0x7f2f1c0992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:11.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.662+0000 7f2f226fb700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2f1c0997e0 0x7f2f1c096740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49428/0 (socket says 172.21.15.40:49428) 2023-09-30T22:22:11.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.662+0000 7f2f216f9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2f1c098ef0 0x7f2f1c0992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46530/0 (socket says 172.21.15.40:46530) 2023-09-30T22:22:11.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.662+0000 7f2f226fb700 1 -- 172.21.15.40:0/114567035 learned_addr learned my addr 172.21.15.40:0/114567035 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:22:11.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.662+0000 7f2f21efa700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2f1c098b10 0x7f2f1c096160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60102/0 (socket says 172.21.15.40:60102) 2023-09-30T22:22:11.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.663+0000 7f2f21efa700 1 -- 172.21.15.40:0/114567035 >> v2:172.21.15.40:3300/0 conn(0x7f2f1c098ef0 msgr2=0x7f2f1c0992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:11.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.663+0000 7f2f21efa700 1 --2- 172.21.15.40:0/114567035 >> v2:172.21.15.40:3300/0 conn(0x7f2f1c098ef0 0x7f2f1c0992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:11.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.663+0000 7f2f21efa700 1 -- 172.21.15.40:0/114567035 >> v1:172.21.15.40:6789/0 conn(0x7f2f1c0997e0 legacy=0x7f2f1c096740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.663+0000 7f2f21efa700 1 -- 172.21.15.40:0/114567035 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1c098110 con 0x7f2f1c098b10 2023-09-30T22:22:11.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.663+0000 7f2f20ef8700 1 -- 172.21.15.40:0/114567035 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1531204761 0 0) 0x7f2f1c098910 con 0x7f2f1c0997e0 2023-09-30T22:22:11.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.663+0000 7f2f216f9700 1 --2- 172.21.15.40:0/114567035 >> v2:172.21.15.40:3300/0 conn(0x7f2f1c098ef0 0x7f2f1c0992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:11.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.663+0000 7f2f21efa700 1 --2- 172.21.15.40:0/114567035 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2f1c098b10 0x7f2f1c096160 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f2f18009760 tx=0x7f2f18009060).ready entity=mon.2 client_cookie=b63373c2ff1f0773 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:11.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.663+0000 7f2f20ef8700 1 -- 172.21.15.40:0/114567035 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1800f510 con 0x7f2f1c098b10 2023-09-30T22:22:11.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.663+0000 7f2f20ef8700 1 -- 172.21.15.40:0/114567035 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1800f670 con 0x7f2f1c098b10 2023-09-30T22:22:11.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.663+0000 7f2f20ef8700 1 -- 172.21.15.40:0/114567035 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1800f9f0 con 0x7f2f1c098b10 2023-09-30T22:22:11.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.663+0000 7f2f2415e700 1 -- 172.21.15.40:0/114567035 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2f1c098b10 msgr2=0x7f2f1c096160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.663+0000 7f2f2415e700 1 --2- 172.21.15.40:0/114567035 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2f1c098b10 0x7f2f1c096160 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f2f18009760 tx=0x7f2f18009060).stop 2023-09-30T22:22:11.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.663+0000 7f2f2415e700 1 -- 172.21.15.40:0/114567035 shutdown_connections 2023-09-30T22:22:11.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.663+0000 7f2f2415e700 1 --2- 172.21.15.40:0/114567035 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2f1c098b10 0x7f2f1c096160 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:11.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.663+0000 7f2f2415e700 1 --2- 172.21.15.40:0/114567035 >> v2:172.21.15.40:3300/0 conn(0x7f2f1c098ef0 0x7f2f1c0992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:11.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.663+0000 7f2f2415e700 1 -- 172.21.15.40:0/114567035 >> 172.21.15.40:0/114567035 conn(0x7f2f1c09ab30 msgr2=0x7f2f1c09af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:11.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.664+0000 7f2f2415e700 1 -- 172.21.15.40:0/114567035 shutdown_connections 2023-09-30T22:22:11.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.664+0000 7f2f2415e700 1 -- 172.21.15.40:0/114567035 wait complete. 2023-09-30T22:22:11.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.664+0000 7f2f2415e700 1 Processor -- start 2023-09-30T22:22:11.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.664+0000 7f2f2415e700 1 -- start start 2023-09-30T22:22:11.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.665+0000 7f2f2415e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2f1c098b10 0x7f2f1c13a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:11.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.665+0000 7f2f2415e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f1c098ef0 0x7f2f1c13a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:11.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.665+0000 7f2f2415e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2f1c0997e0 0x7f2f1c13ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:11.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.665+0000 7f2f2415e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c11dec0 con 0x7f2f1c098ef0 2023-09-30T22:22:11.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.665+0000 7f2f2415e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c099de0 con 0x7f2f1c0997e0 2023-09-30T22:22:11.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.665+0000 7f2f2415e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c09d110 con 0x7f2f1c098b10 2023-09-30T22:22:11.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.665+0000 7f2f216f9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f1c098ef0 0x7f2f1c13a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:11.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.665+0000 7f2f216f9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f1c098ef0 0x7f2f1c13a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46538/0 (socket says 172.21.15.40:46538) 2023-09-30T22:22:11.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.665+0000 7f2f216f9700 1 -- 172.21.15.40:0/153796590 learned_addr learned my addr 172.21.15.40:0/153796590 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:11.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.665+0000 7f2f226fb700 1 --2- 172.21.15.40:0/153796590 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2f1c0997e0 0x7f2f1c13ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:11.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.665+0000 7f2f21efa700 1 --2- 172.21.15.40:0/153796590 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2f1c098b10 0x7f2f1c13a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:11.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.665+0000 7f2f216f9700 1 -- 172.21.15.40:0/153796590 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2f1c098b10 msgr2=0x7f2f1c13a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.665+0000 7f2f216f9700 1 --2- 172.21.15.40:0/153796590 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2f1c098b10 0x7f2f1c13a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:11.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.665+0000 7f2f216f9700 1 -- 172.21.15.40:0/153796590 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2f1c0997e0 msgr2=0x7f2f1c13ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.665+0000 7f2f216f9700 1 --2- 172.21.15.40:0/153796590 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2f1c0997e0 0x7f2f1c13ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:11.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.665+0000 7f2f216f9700 1 -- 172.21.15.40:0/153796590 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c0092a0 con 0x7f2f1c098ef0 2023-09-30T22:22:11.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.665+0000 7f2f21efa700 1 --2- 172.21.15.40:0/153796590 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2f1c098b10 0x7f2f1c13a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:11.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.665+0000 7f2f226fb700 1 --2- 172.21.15.40:0/153796590 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2f1c0997e0 0x7f2f1c13ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:11.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.666+0000 7f2f216f9700 1 --2- 172.21.15.40:0/153796590 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f1c098ef0 0x7f2f1c13a990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f2f0c00e9d0 tx=0x7f2f0c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:11.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.666+0000 7f2f11ffb700 1 -- 172.21.15.40:0/153796590 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c00c6a0 con 0x7f2f1c098ef0 2023-09-30T22:22:11.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.666+0000 7f2f11ffb700 1 -- 172.21.15.40:0/153796590 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0c00c800 con 0x7f2f1c098ef0 2023-09-30T22:22:11.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.666+0000 7f2f2415e700 1 -- 172.21.15.40:0/153796590 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f180092a0 con 0x7f2f1c098ef0 2023-09-30T22:22:11.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.666+0000 7f2f11ffb700 1 -- 172.21.15.40:0/153796590 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c00cb80 con 0x7f2f1c098ef0 2023-09-30T22:22:11.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.666+0000 7f2f2415e700 1 -- 172.21.15.40:0/153796590 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f1c11ea20 con 0x7f2f1c098ef0 2023-09-30T22:22:11.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.667+0000 7f2f11ffb700 1 -- 172.21.15.40:0/153796590 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f2f0c01b400 con 0x7f2f1c098ef0 2023-09-30T22:22:11.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.667+0000 7f2f11ffb700 1 -- 172.21.15.40:0/153796590 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f2f0c03b2f0 con 0x7f2f1c098ef0 2023-09-30T22:22:11.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.667+0000 7f2f2415e700 1 -- 172.21.15.40:0/153796590 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f1c11ea20 con 0x7f2f1c098ef0 2023-09-30T22:22:11.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.671+0000 7f2f11ffb700 1 -- 172.21.15.40:0/153796590 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f2f1c11ea20 con 0x7f2f1c098ef0 2023-09-30T22:22:11.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.843+0000 7f2f2415e700 1 -- 172.21.15.40:0/153796590 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f1c11ea20 con 0x7f2f1c098ef0 2023-09-30T22:22:11.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.844+0000 7f2f11ffb700 1 -- 172.21.15.40:0/153796590 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11341 (secure 0 0 0) 0x7f2f1c11ea20 con 0x7f2f1c098ef0 2023-09-30T22:22:11.845 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:22:11.845 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":17,"fsid":"79dd4d8e-f295-4d9c-bd93-9850863800e3","created":"2023-09-30T22:21:46.980357+0000","modified":"2023-09-30T22:22:03.348895+0000","last_up_change":"2023-09-30T22:21:54.822866+0000","last_in_change":"2023-09-30T22:21:48.205613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:21:54.875024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:21:56.197012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:22:00.759069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:22:01.327265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"771f785c-f464-4b17-936c-cbf31b1153e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6812","nonce":119451}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6813","nonce":119451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6815","nonce":119451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6814","nonce":119451}]},"public_addr":"172.21.15.40:6812/119451","cluster_addr":"172.21.15.40:6813/119451","heartbeat_back_addr":"172.21.15.40:6815/119451","heartbeat_front_addr":"172.21.15.40:6814/119451","state":["exists","up"]},{"osd":1,"uuid":"45f1e2e8-5310-4219-ab54-424e7440fcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6808","nonce":119436}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6809","nonce":119436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6811","nonce":119436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6810","nonce":119436}]},"public_addr":"172.21.15.40:6808/119436","cluster_addr":"172.21.15.40:6809/119436","heartbeat_back_addr":"172.21.15.40:6811/119436","heartbeat_front_addr":"172.21.15.40:6810/119436","state":["exists","up"]},{"osd":2,"uuid":"7ba62ae5-d21e-4d56-b46c-ba7b718ede25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6800","nonce":119433}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6801","nonce":119433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6803","nonce":119433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6802","nonce":119433}]},"public_addr":"172.21.15.40:6800/119433","cluster_addr":"172.21.15.40:6801/119433","heartbeat_back_addr":"172.21.15.40:6803/119433","heartbeat_front_addr":"172.21.15.40:6802/119433","state":["exists","up"]},{"osd":3,"uuid":"c9c55985-8a90-4927-a8fa-6a1fcec1cd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6804","nonce":119432}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6805","nonce":119432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6807","nonce":119432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6806","nonce":119432}]},"public_addr":"172.21.15.40:6804/119432","cluster_addr":"172.21.15.40:6805/119432","heartbeat_back_addr":"172.21.15.40:6807/119432","heartbeat_front_addr":"172.21.15.40:6806/119432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.339829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.554690+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.641664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.320635+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:22:11.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.846+0000 7f2f2415e700 1 -- 172.21.15.40:0/153796590 >> v1:172.21.15.40:6816/118905 conn(0x7f2f0002bb60 legacy=0x7f2f0002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.846+0000 7f2f2415e700 1 -- 172.21.15.40:0/153796590 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f1c098ef0 msgr2=0x7f2f1c13a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.846+0000 7f2f2415e700 1 --2- 172.21.15.40:0/153796590 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f1c098ef0 0x7f2f1c13a990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f2f0c00e9d0 tx=0x7f2f0c009060).stop 2023-09-30T22:22:11.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.846+0000 7f2f2415e700 1 -- 172.21.15.40:0/153796590 shutdown_connections 2023-09-30T22:22:11.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.846+0000 7f2f2415e700 1 --2- 172.21.15.40:0/153796590 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2f1c098b10 0x7f2f1c13a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:11.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.846+0000 7f2f2415e700 1 --2- 172.21.15.40:0/153796590 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2f1c0997e0 0x7f2f1c13ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:11.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.846+0000 7f2f2415e700 1 --2- 172.21.15.40:0/153796590 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f1c098ef0 0x7f2f1c13a990 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:11.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.846+0000 7f2f2415e700 1 -- 172.21.15.40:0/153796590 >> 172.21.15.40:0/153796590 conn(0x7f2f1c09ab30 msgr2=0x7f2f1c1144b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:11.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.846+0000 7f2f2415e700 1 -- 172.21.15.40:0/153796590 shutdown_connections 2023-09-30T22:22:11.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.846+0000 7f2f2415e700 1 -- 172.21.15.40:0/153796590 wait complete. 2023-09-30T22:22:11.858 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-30T22:22:11.859 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:22:11.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.978+0000 7f8fdaf6a700 1 Processor -- start 2023-09-30T22:22:11.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.978+0000 7f8fdaf6a700 1 -- start start 2023-09-30T22:22:11.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.978+0000 7f8fdaf6a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8fd405e090 0x7f8fd4127a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:11.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.978+0000 7f8fdaf6a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fd4127550 0x7f8fd4127f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:11.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.979+0000 7f8fdaf6a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8fd412aa80 0x7f8fd412af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:11.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.979+0000 7f8fdaf6a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd405e470 con 0x7f8fd405e090 2023-09-30T22:22:11.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.979+0000 7f8fdaf6a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd4096f10 con 0x7f8fd4127550 2023-09-30T22:22:11.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.979+0000 7f8fdaf6a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd4096b60 con 0x7f8fd412aa80 2023-09-30T22:22:11.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.979+0000 7f8fd8d06700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8fd405e090 0x7f8fd4127a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:11.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.979+0000 7f8fd3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fd4127550 0x7f8fd4127f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:11.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.979+0000 7f8fd9507700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8fd412aa80 0x7f8fd412af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:11.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.979+0000 7f8fd8d06700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8fd405e090 0x7f8fd4127a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46552/0 (socket says 172.21.15.40:46552) 2023-09-30T22:22:11.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.979+0000 7f8fd8d06700 1 -- 172.21.15.40:0/1542001618 learned_addr learned my addr 172.21.15.40:0/1542001618 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:11.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.979+0000 7f8fd9507700 1 -- 172.21.15.40:0/1542001618 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fd4127550 msgr2=0x7f8fd4127f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:11.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.979+0000 7f8fd9507700 1 --2- 172.21.15.40:0/1542001618 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fd4127550 0x7f8fd4127f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:11.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.979+0000 7f8fd9507700 1 -- 172.21.15.40:0/1542001618 >> v2:172.21.15.40:3300/0 conn(0x7f8fd405e090 msgr2=0x7f8fd4127a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:11.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.979+0000 7f8fd9507700 1 --2- 172.21.15.40:0/1542001618 >> v2:172.21.15.40:3300/0 conn(0x7f8fd405e090 0x7f8fd4127a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:11.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.979+0000 7f8fd9507700 1 -- 172.21.15.40:0/1542001618 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd4092ae0 con 0x7f8fd412aa80 2023-09-30T22:22:11.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.979+0000 7f8fd3fff700 1 --2- 172.21.15.40:0/1542001618 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fd4127550 0x7f8fd4127f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:11.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.979+0000 7f8fd9507700 1 --2- 172.21.15.40:0/1542001618 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8fd412aa80 0x7f8fd412af30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f8fcc009e60 tx=0x7f8fcc009780).ready entity=mon.2 client_cookie=af7a6aabddfb9ae8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:11.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.979+0000 7f8fd37fe700 1 -- 172.21.15.40:0/1542001618 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc00e070 con 0x7f8fd412aa80 2023-09-30T22:22:11.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.979+0000 7f8fd37fe700 1 -- 172.21.15.40:0/1542001618 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fcc00ba50 con 0x7f8fd412aa80 2023-09-30T22:22:11.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.979+0000 7f8fd37fe700 1 -- 172.21.15.40:0/1542001618 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc00bdd0 con 0x7f8fd412aa80 2023-09-30T22:22:11.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.980+0000 7f8fdaf6a700 1 -- 172.21.15.40:0/1542001618 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8fd412aa80 msgr2=0x7f8fd412af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.980+0000 7f8fdaf6a700 1 --2- 172.21.15.40:0/1542001618 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8fd412aa80 0x7f8fd412af30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f8fcc009e60 tx=0x7f8fcc009780).stop 2023-09-30T22:22:11.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.980+0000 7f8fdaf6a700 1 -- 172.21.15.40:0/1542001618 shutdown_connections 2023-09-30T22:22:11.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.980+0000 7f8fdaf6a700 1 --2- 172.21.15.40:0/1542001618 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8fd412aa80 0x7f8fd412af30 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:11.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.980+0000 7f8fdaf6a700 1 --2- 172.21.15.40:0/1542001618 >> v2:172.21.15.40:3300/0 conn(0x7f8fd405e090 0x7f8fd4127a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:11.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.980+0000 7f8fdaf6a700 1 --2- 172.21.15.40:0/1542001618 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fd4127550 0x7f8fd4127f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:11.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.980+0000 7f8fdaf6a700 1 -- 172.21.15.40:0/1542001618 >> 172.21.15.40:0/1542001618 conn(0x7f8fd40975f0 msgr2=0x7f8fd4097a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:11.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.980+0000 7f8fdaf6a700 1 -- 172.21.15.40:0/1542001618 shutdown_connections 2023-09-30T22:22:11.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.980+0000 7f8fdaf6a700 1 -- 172.21.15.40:0/1542001618 wait complete. 2023-09-30T22:22:11.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.981+0000 7f8fdaf6a700 1 Processor -- start 2023-09-30T22:22:11.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.981+0000 7f8fdaf6a700 1 -- start start 2023-09-30T22:22:11.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.981+0000 7f8fdaf6a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fd405e090 0x7f8fd4113ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:11.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.981+0000 7f8fdaf6a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8fd4127550 0x7f8fd4113fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:11.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.981+0000 7f8fdaf6a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fd412aa80 0x7f8fd41144a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:11.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.981+0000 7f8fdaf6a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd4097140 con 0x7f8fd405e090 2023-09-30T22:22:11.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.981+0000 7f8fdaf6a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd4117050 con 0x7f8fd412aa80 2023-09-30T22:22:11.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.981+0000 7f8fdaf6a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd41175f0 con 0x7f8fd4127550 2023-09-30T22:22:11.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.981+0000 7f8fd8d06700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fd405e090 0x7f8fd4113ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:11.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.981+0000 7f8fd3fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8fd4127550 0x7f8fd4113fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:11.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.981+0000 7f8fd8d06700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fd405e090 0x7f8fd4113ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46556/0 (socket says 172.21.15.40:46556) 2023-09-30T22:22:11.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.981+0000 7f8fd8d06700 1 -- 172.21.15.40:0/225303881 learned_addr learned my addr 172.21.15.40:0/225303881 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:11.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.982+0000 7f8fd9507700 1 --2- 172.21.15.40:0/225303881 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fd412aa80 0x7f8fd41144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:11.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.982+0000 7f8fd8d06700 1 -- 172.21.15.40:0/225303881 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8fd4127550 msgr2=0x7f8fd4113fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.982+0000 7f8fd8d06700 1 --2- 172.21.15.40:0/225303881 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8fd4127550 0x7f8fd4113fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:11.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.982+0000 7f8fd8d06700 1 -- 172.21.15.40:0/225303881 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fd412aa80 msgr2=0x7f8fd41144a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.982+0000 7f8fd8d06700 1 --2- 172.21.15.40:0/225303881 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fd412aa80 0x7f8fd41144a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:11.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.982+0000 7f8fd8d06700 1 -- 172.21.15.40:0/225303881 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc00092a0 con 0x7f8fd405e090 2023-09-30T22:22:11.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.982+0000 7f8fd8d06700 1 --2- 172.21.15.40:0/225303881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fd405e090 0x7f8fd4113ac0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f8fc800e930 tx=0x7f8fc80090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:11.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.982+0000 7f8fd0ff9700 1 -- 172.21.15.40:0/225303881 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc8012600 con 0x7f8fd405e090 2023-09-30T22:22:11.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.982+0000 7f8fd0ff9700 1 -- 172.21.15.40:0/225303881 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc8012760 con 0x7f8fd405e090 2023-09-30T22:22:11.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.982+0000 7f8fdaf6a700 1 -- 172.21.15.40:0/225303881 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fcc009a20 con 0x7f8fd405e090 2023-09-30T22:22:11.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.982+0000 7f8fd0ff9700 1 -- 172.21.15.40:0/225303881 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc8012ae0 con 0x7f8fd405e090 2023-09-30T22:22:11.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.982+0000 7f8fdaf6a700 1 -- 172.21.15.40:0/225303881 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd4117cd0 con 0x7f8fd405e090 2023-09-30T22:22:11.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.983+0000 7f8fd0ff9700 1 -- 172.21.15.40:0/225303881 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f8fc801b400 con 0x7f8fd405e090 2023-09-30T22:22:11.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.983+0000 7f8fd0ff9700 1 -- 172.21.15.40:0/225303881 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f8fc803b330 con 0x7f8fd405e090 2023-09-30T22:22:11.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.983+0000 7f8fdaf6a700 1 -- 172.21.15.40:0/225303881 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd412b860 con 0x7f8fd405e090 2023-09-30T22:22:11.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:11.988+0000 7f8fd0ff9700 1 -- 172.21.15.40:0/225303881 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f8fc8011d20 con 0x7f8fd405e090 2023-09-30T22:22:12.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.156+0000 7f8fdaf6a700 1 -- 172.21.15.40:0/225303881 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8fd4117190 con 0x7f8fd405e090 2023-09-30T22:22:12.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.157+0000 7f8fd0ff9700 1 -- 172.21.15.40:0/225303881 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11341 (secure 0 0 0) 0x7f8fc8029030 con 0x7f8fd405e090 2023-09-30T22:22:12.157 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:22:12.158 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":17,"fsid":"79dd4d8e-f295-4d9c-bd93-9850863800e3","created":"2023-09-30T22:21:46.980357+0000","modified":"2023-09-30T22:22:03.348895+0000","last_up_change":"2023-09-30T22:21:54.822866+0000","last_in_change":"2023-09-30T22:21:48.205613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:21:54.875024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:21:56.197012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:22:00.759069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:22:01.327265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"771f785c-f464-4b17-936c-cbf31b1153e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6812","nonce":119451}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6813","nonce":119451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6815","nonce":119451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6814","nonce":119451}]},"public_addr":"172.21.15.40:6812/119451","cluster_addr":"172.21.15.40:6813/119451","heartbeat_back_addr":"172.21.15.40:6815/119451","heartbeat_front_addr":"172.21.15.40:6814/119451","state":["exists","up"]},{"osd":1,"uuid":"45f1e2e8-5310-4219-ab54-424e7440fcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6808","nonce":119436}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6809","nonce":119436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6811","nonce":119436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6810","nonce":119436}]},"public_addr":"172.21.15.40:6808/119436","cluster_addr":"172.21.15.40:6809/119436","heartbeat_back_addr":"172.21.15.40:6811/119436","heartbeat_front_addr":"172.21.15.40:6810/119436","state":["exists","up"]},{"osd":2,"uuid":"7ba62ae5-d21e-4d56-b46c-ba7b718ede25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6800","nonce":119433}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6801","nonce":119433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6803","nonce":119433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6802","nonce":119433}]},"public_addr":"172.21.15.40:6800/119433","cluster_addr":"172.21.15.40:6801/119433","heartbeat_back_addr":"172.21.15.40:6803/119433","heartbeat_front_addr":"172.21.15.40:6802/119433","state":["exists","up"]},{"osd":3,"uuid":"c9c55985-8a90-4927-a8fa-6a1fcec1cd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6804","nonce":119432}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6805","nonce":119432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6807","nonce":119432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6806","nonce":119432}]},"public_addr":"172.21.15.40:6804/119432","cluster_addr":"172.21.15.40:6805/119432","heartbeat_back_addr":"172.21.15.40:6807/119432","heartbeat_front_addr":"172.21.15.40:6806/119432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.339829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.554690+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.641664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.320635+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:22:12.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.159+0000 7f8fdaf6a700 1 -- 172.21.15.40:0/225303881 >> v1:172.21.15.40:6816/118905 conn(0x7f8fb802bb60 legacy=0x7f8fb802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.159+0000 7f8fdaf6a700 1 -- 172.21.15.40:0/225303881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fd405e090 msgr2=0x7f8fd4113ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.159+0000 7f8fdaf6a700 1 --2- 172.21.15.40:0/225303881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fd405e090 0x7f8fd4113ac0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f8fc800e930 tx=0x7f8fc80090f0).stop 2023-09-30T22:22:12.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.159+0000 7f8fdaf6a700 1 -- 172.21.15.40:0/225303881 shutdown_connections 2023-09-30T22:22:12.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.159+0000 7f8fdaf6a700 1 --2- 172.21.15.40:0/225303881 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fd412aa80 0x7f8fd41144a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.159+0000 7f8fdaf6a700 1 --2- 172.21.15.40:0/225303881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fd405e090 0x7f8fd4113ac0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.159+0000 7f8fdaf6a700 1 --2- 172.21.15.40:0/225303881 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8fd4127550 0x7f8fd4113fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.159+0000 7f8fdaf6a700 1 -- 172.21.15.40:0/225303881 >> 172.21.15.40:0/225303881 conn(0x7f8fd40975f0 msgr2=0x7f8fd41288b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:12.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.159+0000 7f8fdaf6a700 1 -- 172.21.15.40:0/225303881 shutdown_connections 2023-09-30T22:22:12.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.159+0000 7f8fdaf6a700 1 -- 172.21.15.40:0/225303881 wait complete. 2023-09-30T22:22:12.172 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-09-30T22:22:12.173 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-09-30T22:22:12.173 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-09-30T22:22:12.174 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-09-30T22:22:12.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.309+0000 7f31a3289700 1 Processor -- start 2023-09-30T22:22:12.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.310+0000 7f31a3289700 1 -- start start 2023-09-30T22:22:12.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.310+0000 7fb4badcb700 1 Processor -- start 2023-09-30T22:22:12.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.310+0000 7f31a3289700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f319c0967b0 0x7f319c096b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.310+0000 7f31a3289700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319c067ca0 0x7f319c137470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.310+0000 7f31a3289700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f319c069980 con 0x7f319c067190 2023-09-30T22:22:12.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.310+0000 7f31a3289700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319c092150 con 0x7f319c067ca0 2023-09-30T22:22:12.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.310+0000 7f31a3289700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f319c092340 con 0x7f319c0967b0 2023-09-30T22:22:12.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.310+0000 7fb4badcb700 1 -- start start 2023-09-30T22:22:12.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.311+0000 7f31a1826700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319c067ca0 0x7f319c137470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:12.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.311+0000 7f31a1826700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319c067ca0 0x7f319c137470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:46790/0 (socket says 172.21.15.40:46790) 2023-09-30T22:22:12.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.311+0000 7f31a1826700 1 -- 172.21.15.40:0/269291795 learned_addr learned my addr 172.21.15.40:0/269291795 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:12.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.311+0000 7fb4badcb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb4b4067650 0x7fb4b4092320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.311+0000 7fb4badcb700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4b40632b0 0x7fb4b4068310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.311+0000 7fb4badcb700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4b4068ca0 con 0x7fb4b4062e60 2023-09-30T22:22:12.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.311+0000 7fb4badcb700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4b4069810 con 0x7fb4b4067650 2023-09-30T22:22:12.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.311+0000 7fb4badcb700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b4097d20 con 0x7fb4b40632b0 2023-09-30T22:22:12.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.311+0000 7f31a1025700 1 --2- 172.21.15.40:0/269291795 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f319c0967b0 0x7f319c096b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:12.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.311+0000 7f31a1826700 1 -- 172.21.15.40:0/269291795 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f319c0967b0 msgr2=0x7f319c096b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:12.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.311+0000 7f31a1826700 1 --2- 172.21.15.40:0/269291795 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f319c0967b0 0x7f319c096b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.311+0000 7f31a1826700 1 -- 172.21.15.40:0/269291795 >> v1:172.21.15.40:6789/0 conn(0x7f319c067190 legacy=0x7f319c067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.311+0000 7f31a1826700 1 -- 172.21.15.40:0/269291795 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319c068770 con 0x7f319c067ca0 2023-09-30T22:22:12.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.311+0000 7fb4b3fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb4b4062e60 0x7fb4b4067c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49442/0 (socket says 172.21.15.40:49442) 2023-09-30T22:22:12.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.311+0000 7fb4b3fff700 1 -- 172.21.15.40:0/1203302289 learned_addr learned my addr 172.21.15.40:0/1203302289 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:22:12.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.311+0000 7fb4b8b67700 1 --2- 172.21.15.40:0/1203302289 >> v2:172.21.15.40:3300/0 conn(0x7fb4b4067650 0x7fb4b4092320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:12.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.311+0000 7fb4b9368700 1 --2- 172.21.15.40:0/1203302289 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4b40632b0 0x7fb4b4068310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:12.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.311+0000 7f31a1826700 1 --2- 172.21.15.40:0/269291795 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319c067ca0 0x7f319c137470 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f3194009f50 tx=0x7f3194009840).ready entity=mon.1 client_cookie=cbe6d26a8e68b3ed server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:12.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.311+0000 7fb4b37fe700 1 -- 172.21.15.40:0/1203302289 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 634739627 0 0) 0x7fb4b4068ca0 con 0x7fb4b4062e60 2023-09-30T22:22:12.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.311+0000 7fb4b37fe700 1 -- 172.21.15.40:0/1203302289 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4a40033f0 con 0x7fb4b4062e60 2023-09-30T22:22:12.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.311+0000 7fb4b8b67700 1 -- 172.21.15.40:0/1203302289 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4b40632b0 msgr2=0x7fb4b4068310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:12.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.311+0000 7fb4b8b67700 1 --2- 172.21.15.40:0/1203302289 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4b40632b0 0x7fb4b4068310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.312+0000 7fb4b8b67700 1 -- 172.21.15.40:0/1203302289 >> v1:172.21.15.40:6789/0 conn(0x7fb4b4062e60 legacy=0x7fb4b4067c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.312+0000 7fb4b8b67700 1 -- 172.21.15.40:0/1203302289 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b4091b80 con 0x7fb4b4067650 2023-09-30T22:22:12.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.312+0000 7f3193fff700 1 -- 172.21.15.40:0/269291795 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319400e070 con 0x7f319c067ca0 2023-09-30T22:22:12.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.312+0000 7f3193fff700 1 -- 172.21.15.40:0/269291795 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319400bab0 con 0x7f319c067ca0 2023-09-30T22:22:12.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.312+0000 7f3193fff700 1 -- 172.21.15.40:0/269291795 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319400be30 con 0x7f319c067ca0 2023-09-30T22:22:12.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.312+0000 7fb4b8b67700 1 --2- 172.21.15.40:0/1203302289 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4b4067650 0x7fb4b4092320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fb4a8009790 tx=0x7fb4a8009060).ready entity=mon.0 client_cookie=1a5fa96413557f9c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:12.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.312+0000 7f2ff976e700 1 Processor -- start 2023-09-30T22:22:12.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.312+0000 7f843671f700 1 Processor -- start 2023-09-30T22:22:12.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.312+0000 7f2ff976e700 1 -- start start 2023-09-30T22:22:12.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.312+0000 7f843671f700 1 -- start start 2023-09-30T22:22:12.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.312+0000 7f843671f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8430096450 0x7f8430098c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.312+0000 7f843671f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f84300958b0 0x7f84300990f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.312+0000 7f843671f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f84300995e0 0x7f8430135e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.312+0000 7f843671f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8430096830 con 0x7f84300958b0 2023-09-30T22:22:12.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.312+0000 7f843671f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843009a640 con 0x7f8430096450 2023-09-30T22:22:12.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.312+0000 7f843671f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8430099a70 con 0x7f84300995e0 2023-09-30T22:22:12.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.312+0000 7f842f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f84300958b0 0x7f84300990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:12.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.312+0000 7f842ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8430096450 0x7f8430098c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:12.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.312+0000 7f2ff976e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2ff4093ac0 0x7f2ff4095770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.312+0000 7f2ff976e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2ff4091e10 0x7f2ff4095c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.313+0000 7f2ff976e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ff4094180 con 0x7f2ff4096150 2023-09-30T22:22:12.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.313+0000 7f2ff976e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ff4093ea0 con 0x7f2ff4091e10 2023-09-30T22:22:12.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.313+0000 7f2ff976e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff4097300 con 0x7f2ff4093ac0 2023-09-30T22:22:12.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.312+0000 7f842f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f84300958b0 0x7f84300990f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46576/0 (socket says 172.21.15.40:46576) 2023-09-30T22:22:12.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.312+0000 7f842ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8430096450 0x7f8430098c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:46792/0 (socket says 172.21.15.40:46792) 2023-09-30T22:22:12.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.313+0000 7f842f7fe700 1 -- 172.21.15.40:0/2675699248 learned_addr learned my addr 172.21.15.40:0/2675699248 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:12.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.313+0000 7fb4b37fe700 1 -- 172.21.15.40:0/1203302289 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a80090d0 con 0x7fb4b4067650 2023-09-30T22:22:12.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.313+0000 7fb4b37fe700 1 -- 172.21.15.40:0/1203302289 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a800d4a0 con 0x7fb4b4067650 2023-09-30T22:22:12.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.313+0000 7f31a3289700 1 -- 172.21.15.40:0/269291795 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319c067ca0 msgr2=0x7f319c137470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.313+0000 7f31a3289700 1 --2- 172.21.15.40:0/269291795 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319c067ca0 0x7f319c137470 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f3194009f50 tx=0x7f3194009840).stop 2023-09-30T22:22:12.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.313+0000 7f2ff2ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2ff4093ac0 0x7f2ff4095770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:12.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.313+0000 7f2ff2ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2ff4093ac0 0x7f2ff4095770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60158/0 (socket says 172.21.15.40:60158) 2023-09-30T22:22:12.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.313+0000 7f2ff2ffd700 1 -- 172.21.15.40:0/3335186407 learned_addr learned my addr 172.21.15.40:0/3335186407 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:12.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.313+0000 7fb4b37fe700 1 -- 172.21.15.40:0/1203302289 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a800d820 con 0x7fb4b4067650 2023-09-30T22:22:12.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.313+0000 7f2ff27fc700 1 --2- 172.21.15.40:0/3335186407 >> v2:172.21.15.40:3300/0 conn(0x7f2ff4091e10 0x7f2ff4095c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:12.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.313+0000 7f842ffff700 1 -- 172.21.15.40:0/2675699248 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f84300995e0 msgr2=0x7f8430135e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:12.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.313+0000 7f842ffff700 1 --2- 172.21.15.40:0/2675699248 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f84300995e0 0x7f8430135e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-09-30T22:22:12.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.313+0000 7f842ffff700 1 -- 172.21.15.40:0/2675699248 >> v2:172.21.15.40:3300/0 conn(0x7f84300958b0 msgr2=0x7f84300990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:12.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.313+0000 7f842ffff700 1 --2- 172.21.15.40:0/2675699248 >> v2:172.21.15.40:3300/0 conn(0x7f84300958b0 0x7f84300990f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.313+0000 7f842ffff700 1 -- 172.21.15.40:0/2675699248 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8430096cf0 con 0x7f8430096450 2023-09-30T22:22:12.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.313+0000 7f842f7fe700 1 --2- 172.21.15.40:0/2675699248 >> v2:172.21.15.40:3300/0 conn(0x7f84300958b0 0x7f84300990f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:22:12.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.313+0000 7f2ff27fc700 1 -- 172.21.15.40:0/3335186407 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2ff4093ac0 msgr2=0x7f2ff4095770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:12.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.313+0000 7f2ff27fc700 1 --2- 172.21.15.40:0/3335186407 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2ff4093ac0 0x7f2ff4095770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.313+0000 7f2ff27fc700 1 -- 172.21.15.40:0/3335186407 >> v1:172.21.15.40:6789/0 conn(0x7f2ff4096150 legacy=0x7f2ff412e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.313+0000 7f2ff27fc700 1 -- 172.21.15.40:0/3335186407 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff4092290 con 0x7f2ff4091e10 2023-09-30T22:22:12.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.313+0000 7f2ff27fc700 1 --2- 172.21.15.40:0/3335186407 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ff4091e10 0x7f2ff4095c60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f2fec009e60 tx=0x7f2fec009780).ready entity=mon.0 client_cookie=dcb70eb179734bb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:12.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.313+0000 7f842ffff700 1 --2- 172.21.15.40:0/2675699248 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8430096450 0x7f8430098c00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f8428009e60 tx=0x7f8428009780).ready entity=mon.1 client_cookie=a5e79c2f79e22b99 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:12.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.313+0000 7f842effd700 1 -- 172.21.15.40:0/2675699248 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842800e070 con 0x7f8430096450 2023-09-30T22:22:12.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.313+0000 7f842effd700 1 -- 172.21.15.40:0/2675699248 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842800bbd0 con 0x7f8430096450 2023-09-30T22:22:12.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.313+0000 7f842effd700 1 -- 172.21.15.40:0/2675699248 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8428012410 con 0x7f8430096450 2023-09-30T22:22:12.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.314+0000 7fb4badcb700 1 -- 172.21.15.40:0/1203302289 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4b4067650 msgr2=0x7fb4b4092320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.314+0000 7fb4badcb700 1 --2- 172.21.15.40:0/1203302289 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4b4067650 0x7fb4b4092320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fb4a8009790 tx=0x7fb4a8009060).stop 2023-09-30T22:22:12.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.314+0000 7f2ff1ffb700 1 -- 172.21.15.40:0/3335186407 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fec00e070 con 0x7f2ff4091e10 2023-09-30T22:22:12.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.314+0000 7f2ff1ffb700 1 -- 172.21.15.40:0/3335186407 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fec00bb60 con 0x7f2ff4091e10 2023-09-30T22:22:12.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.314+0000 7f2ff1ffb700 1 -- 172.21.15.40:0/3335186407 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fec012410 con 0x7f2ff4091e10 2023-09-30T22:22:12.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.314+0000 7f31a3289700 1 -- 172.21.15.40:0/269291795 shutdown_connections 2023-09-30T22:22:12.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.314+0000 7f31a3289700 1 --2- 172.21.15.40:0/269291795 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319c067ca0 0x7f319c137470 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.314+0000 7f31a3289700 1 --2- 172.21.15.40:0/269291795 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f319c0967b0 0x7f319c096b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.314+0000 7f31a3289700 1 -- 172.21.15.40:0/269291795 >> 172.21.15.40:0/269291795 conn(0x7f319c09a450 msgr2=0x7f319c09a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:12.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.314+0000 7f31a3289700 1 -- 172.21.15.40:0/269291795 shutdown_connections 2023-09-30T22:22:12.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.314+0000 7f31a3289700 1 -- 172.21.15.40:0/269291795 wait complete. 2023-09-30T22:22:12.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.314+0000 7f843671f700 1 -- 172.21.15.40:0/2675699248 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8430096450 msgr2=0x7f8430098c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.314+0000 7f843671f700 1 --2- 172.21.15.40:0/2675699248 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8430096450 0x7f8430098c00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f8428009e60 tx=0x7f8428009780).stop 2023-09-30T22:22:12.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.314+0000 7f843671f700 1 -- 172.21.15.40:0/2675699248 shutdown_connections 2023-09-30T22:22:12.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.314+0000 7f843671f700 1 --2- 172.21.15.40:0/2675699248 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f84300995e0 0x7f8430135e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-09-30T22:22:12.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.314+0000 7f843671f700 1 --2- 172.21.15.40:0/2675699248 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8430096450 0x7f8430098c00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.314+0000 7f843671f700 1 --2- 172.21.15.40:0/2675699248 >> v2:172.21.15.40:3300/0 conn(0x7f84300958b0 0x7f84300990f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.314+0000 7f843671f700 1 -- 172.21.15.40:0/2675699248 >> 172.21.15.40:0/2675699248 conn(0x7f843009a970 msgr2=0x7f843009ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:12.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.314+0000 7f843671f700 1 -- 172.21.15.40:0/2675699248 shutdown_connections 2023-09-30T22:22:12.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.314+0000 7f843671f700 1 -- 172.21.15.40:0/2675699248 wait complete. 2023-09-30T22:22:12.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.315+0000 7f2ff976e700 1 -- 172.21.15.40:0/3335186407 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ff4091e10 msgr2=0x7f2ff4095c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.315+0000 7f2ff976e700 1 --2- 172.21.15.40:0/3335186407 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ff4091e10 0x7f2ff4095c60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f2fec009e60 tx=0x7f2fec009780).stop 2023-09-30T22:22:12.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.314+0000 7fb4badcb700 1 -- 172.21.15.40:0/1203302289 shutdown_connections 2023-09-30T22:22:12.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.314+0000 7fb4badcb700 1 --2- 172.21.15.40:0/1203302289 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4b40632b0 0x7fb4b4068310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.314+0000 7fb4badcb700 1 --2- 172.21.15.40:0/1203302289 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4b4067650 0x7fb4b4092320 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.314+0000 7fb4badcb700 1 -- 172.21.15.40:0/1203302289 >> 172.21.15.40:0/1203302289 conn(0x7fb4b409a450 msgr2=0x7fb4b409a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:12.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.314+0000 7fb4badcb700 1 -- 172.21.15.40:0/1203302289 shutdown_connections 2023-09-30T22:22:12.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.314+0000 7fb4badcb700 1 -- 172.21.15.40:0/1203302289 wait complete. 2023-09-30T22:22:12.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.315+0000 7f2ff976e700 1 -- 172.21.15.40:0/3335186407 shutdown_connections 2023-09-30T22:22:12.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.315+0000 7f2ff976e700 1 --2- 172.21.15.40:0/3335186407 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2ff4093ac0 0x7f2ff4095770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.315+0000 7f2ff976e700 1 --2- 172.21.15.40:0/3335186407 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ff4091e10 0x7f2ff4095c60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.315+0000 7f2ff976e700 1 -- 172.21.15.40:0/3335186407 >> 172.21.15.40:0/3335186407 conn(0x7f2ff4097580 msgr2=0x7f2ff4097990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:12.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.315+0000 7fb4badcb700 1 Processor -- start 2023-09-30T22:22:12.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.315+0000 7f2ff976e700 1 -- 172.21.15.40:0/3335186407 shutdown_connections 2023-09-30T22:22:12.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.315+0000 7f31a3289700 1 Processor -- start 2023-09-30T22:22:12.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.315+0000 7f31a3289700 1 -- start start 2023-09-30T22:22:12.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.315+0000 7fb4badcb700 1 -- start start 2023-09-30T22:22:12.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.315+0000 7f843671f700 1 Processor -- start 2023-09-30T22:22:12.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.316+0000 7f2ff976e700 1 -- 172.21.15.40:0/3335186407 wait complete. 2023-09-30T22:22:12.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.316+0000 7f843671f700 1 -- start start 2023-09-30T22:22:12.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.316+0000 7fb4badcb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4b4062e60 0x7fb4b4128b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.316+0000 7fb4badcb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4b40632b0 0x7fb4b4129010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.316+0000 7fb4badcb700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4b4067650 0x7fb4b4129500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.316+0000 7fb4badcb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b4099e60 con 0x7fb4b4062e60 2023-09-30T22:22:12.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.316+0000 7fb4badcb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b4069990 con 0x7fb4b40632b0 2023-09-30T22:22:12.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.316+0000 7fb4badcb700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b4128880 con 0x7fb4b4067650 2023-09-30T22:22:12.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.316+0000 7fb4b8b67700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4b4062e60 0x7fb4b4128b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:12.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.316+0000 7fb4b8b67700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4b4062e60 0x7fb4b4128b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46584/0 (socket says 172.21.15.40:46584) 2023-09-30T22:22:12.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.316+0000 7fb4b8b67700 1 -- 172.21.15.40:0/3196805861 learned_addr learned my addr 172.21.15.40:0/3196805861 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:12.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.316+0000 7fb4b9368700 1 --2- 172.21.15.40:0/3196805861 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4b4067650 0x7fb4b4129500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:12.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.316+0000 7f843671f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f84300958b0 0x7f843011f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.316+0000 7f843671f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8430096450 0x7f843011f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.316+0000 7fb4b3fff700 1 --2- 172.21.15.40:0/3196805861 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4b40632b0 0x7fb4b4129010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:12.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.316+0000 7fb4b8b67700 1 -- 172.21.15.40:0/3196805861 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4b4067650 msgr2=0x7fb4b4129500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.316+0000 7fb4b8b67700 1 --2- 172.21.15.40:0/3196805861 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4b4067650 0x7fb4b4129500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.316+0000 7fb4b8b67700 1 -- 172.21.15.40:0/3196805861 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4b40632b0 msgr2=0x7fb4b4129010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.316+0000 7fb4b8b67700 1 --2- 172.21.15.40:0/3196805861 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4b40632b0 0x7fb4b4129010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.316+0000 7fb4b8b67700 1 -- 172.21.15.40:0/3196805861 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a80092a0 con 0x7fb4b4062e60 2023-09-30T22:22:12.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.316+0000 7fb4b3fff700 1 --2- 172.21.15.40:0/3196805861 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4b40632b0 0x7fb4b4129010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:22:12.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.316+0000 7f843671f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f84300995e0 0x7f843011fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.316+0000 7f843671f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843011f2d0 con 0x7f8430096450 2023-09-30T22:22:12.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.316+0000 7f843671f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8430097dd0 con 0x7f84300958b0 2023-09-30T22:22:12.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.316+0000 7f843671f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8430094640 con 0x7f84300995e0 2023-09-30T22:22:12.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.317+0000 7f842ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f84300958b0 0x7f843011f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:12.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.317+0000 7f842ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f84300958b0 0x7f843011f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:46824/0 (socket says 172.21.15.40:46824) 2023-09-30T22:22:12.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.316+0000 7f31a3289700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f319c067190 0x7f319c13ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.316+0000 7f31a3289700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319c067ca0 0x7f319c13eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.317+0000 7f842ffff700 1 -- 172.21.15.40:0/1773810529 learned_addr learned my addr 172.21.15.40:0/1773810529 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:12.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.316+0000 7f31a3289700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f319c0967b0 0x7f319c13f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.316+0000 7f31a3289700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319c13f8d0 con 0x7f319c067190 2023-09-30T22:22:12.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.316+0000 7f31a3289700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319c122770 con 0x7f319c067ca0 2023-09-30T22:22:12.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.316+0000 7f31a3289700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f319c069560 con 0x7f319c0967b0 2023-09-30T22:22:12.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.317+0000 7f2ff976e700 1 Processor -- start 2023-09-30T22:22:12.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.317+0000 7f2ff976e700 1 -- start start 2023-09-30T22:22:12.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.317+0000 7f842ffff700 1 -- 172.21.15.40:0/1773810529 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f84300995e0 msgr2=0x7f843011fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.317+0000 7f842ffff700 1 --2- 172.21.15.40:0/1773810529 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f84300995e0 0x7f843011fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:22:12.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.317+0000 7f842ffff700 1 -- 172.21.15.40:0/1773810529 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8430096450 msgr2=0x7f843011f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.317+0000 7f842ffff700 1 --2- 172.21.15.40:0/1773810529 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8430096450 0x7f843011f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:22:12.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.317+0000 7f842ffff700 1 -- 172.21.15.40:0/1773810529 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8428009a20 con 0x7f84300958b0 2023-09-30T22:22:12.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.317+0000 7f842ffff700 1 --2- 172.21.15.40:0/1773810529 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f84300958b0 0x7f843011f500 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f842800b990 tx=0x7f8428009780).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:12.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.317+0000 7f8417fff700 1 -- 172.21.15.40:0/1773810529 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842801d420 con 0x7f84300958b0 2023-09-30T22:22:12.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.317+0000 7f8417fff700 1 -- 172.21.15.40:0/1773810529 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842801d580 con 0x7f84300958b0 2023-09-30T22:22:12.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.317+0000 7f843671f700 1 -- 172.21.15.40:0/1773810529 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84301213f0 con 0x7f84300958b0 2023-09-30T22:22:12.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.317+0000 7f8417fff700 1 -- 172.21.15.40:0/1773810529 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842801d900 con 0x7f84300958b0 2023-09-30T22:22:12.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.317+0000 7f843671f700 1 -- 172.21.15.40:0/1773810529 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8430123170 con 0x7f84300958b0 2023-09-30T22:22:12.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.317+0000 7fb4b8b67700 1 --2- 172.21.15.40:0/3196805861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4b4062e60 0x7fb4b4128b20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fb4a8010000 tx=0x7fb4a8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:12.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.317+0000 7f31a1826700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f319c0967b0 0x7f319c13f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:12.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.317+0000 7f31a1826700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f319c0967b0 0x7f319c13f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60188/0 (socket says 172.21.15.40:60188) 2023-09-30T22:22:12.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.317+0000 7f31a1826700 1 -- 172.21.15.40:0/1556938402 learned_addr learned my addr 172.21.15.40:0/1556938402 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:12.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.317+0000 7f31a0824700 1 --2- 172.21.15.40:0/1556938402 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319c067ca0 0x7f319c13eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:12.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.317+0000 7f31a1025700 1 --2- 172.21.15.40:0/1556938402 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f319c067190 0x7f319c13ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:12.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.318+0000 7f31a0824700 1 -- 172.21.15.40:0/1556938402 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f319c0967b0 msgr2=0x7f319c13f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.318+0000 7f31a0824700 1 --2- 172.21.15.40:0/1556938402 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f319c0967b0 0x7f319c13f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.318+0000 7f31a0824700 1 -- 172.21.15.40:0/1556938402 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f319c067190 msgr2=0x7f319c13ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.318+0000 7f31a0824700 1 --2- 172.21.15.40:0/1556938402 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f319c067190 0x7f319c13ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.318+0000 7f31a0824700 1 -- 172.21.15.40:0/1556938402 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3194009ae0 con 0x7f319c067ca0 2023-09-30T22:22:12.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.318+0000 7f2ff976e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2ff4091e10 0x7f2ff41163d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.318+0000 7f2ff976e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ff4093ac0 0x7f2ff41168c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.318+0000 7f2ff976e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ff4096150 0x7f2ff4116db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.318+0000 7f2ff976e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff4131540 con 0x7f2ff4096150 2023-09-30T22:22:12.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.318+0000 7f2ff976e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff4118a00 con 0x7f2ff4093ac0 2023-09-30T22:22:12.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.318+0000 7f2ff976e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff406a690 con 0x7f2ff4091e10 2023-09-30T22:22:12.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.318+0000 7f2ff27fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ff4093ac0 0x7f2ff41168c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:12.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.318+0000 7f2ff27fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ff4093ac0 0x7f2ff41168c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:46838/0 (socket says 172.21.15.40:46838) 2023-09-30T22:22:12.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.318+0000 7f2ff27fc700 1 -- 172.21.15.40:0/660674191 learned_addr learned my addr 172.21.15.40:0/660674191 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:12.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.318+0000 7f2ff2ffd700 1 --2- 172.21.15.40:0/660674191 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2ff4091e10 0x7f2ff41163d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:12.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.318+0000 7f2ff27fc700 1 -- 172.21.15.40:0/660674191 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2ff4091e10 msgr2=0x7f2ff41163d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.318+0000 7f2ff27fc700 1 --2- 172.21.15.40:0/660674191 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2ff4091e10 0x7f2ff41163d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.318+0000 7f2ff27fc700 1 -- 172.21.15.40:0/660674191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ff4096150 msgr2=0x7f2ff4116db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.318+0000 7f2ff27fc700 1 --2- 172.21.15.40:0/660674191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ff4096150 0x7f2ff4116db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:22:12.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.318+0000 7f2ff27fc700 1 -- 172.21.15.40:0/660674191 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fec009a20 con 0x7f2ff4093ac0 2023-09-30T22:22:12.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.318+0000 7f31a0824700 1 --2- 172.21.15.40:0/1556938402 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319c067ca0 0x7f319c13eef0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f318c00c440 tx=0x7f318c007d40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:12.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.318+0000 7f2ff27fc700 1 --2- 172.21.15.40:0/660674191 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ff4093ac0 0x7f2ff41168c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f2fec00b6c0 tx=0x7f2fec009780).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:12.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.318+0000 7f843671f700 1 -- 172.21.15.40:0/1773810529 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8410000fc0 con 0x7f84300958b0 2023-09-30T22:22:12.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.319+0000 7f8417fff700 1 -- 172.21.15.40:0/1773810529 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f8428003040 con 0x7f84300958b0 2023-09-30T22:22:12.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.319+0000 7f8417fff700 1 -- 172.21.15.40:0/1773810529 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f842803cb90 con 0x7f84300958b0 2023-09-30T22:22:12.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.319+0000 7f8417fff700 1 -- 172.21.15.40:0/1773810529 --> v1:172.21.15.40:6808/119436 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f841c038430 con 0x7f841c034740 2023-09-30T22:22:12.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.318+0000 7f31917fa700 1 -- 172.21.15.40:0/1556938402 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318c007020 con 0x7f319c067ca0 2023-09-30T22:22:12.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.318+0000 7f31917fa700 1 -- 172.21.15.40:0/1556938402 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318c007180 con 0x7f319c067ca0 2023-09-30T22:22:12.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.318+0000 7f31917fa700 1 -- 172.21.15.40:0/1556938402 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318c007540 con 0x7f319c067ca0 2023-09-30T22:22:12.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.319+0000 7f2fdaffd700 1 -- 172.21.15.40:0/660674191 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fec025070 con 0x7f2ff4093ac0 2023-09-30T22:22:12.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.320+0000 7f2ff976e700 1 -- 172.21.15.40:0/660674191 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ff41198d0 con 0x7f2ff4093ac0 2023-09-30T22:22:12.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.320+0000 7f8417fff700 1 -- 172.21.15.40:0/1773810529 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8428027460 con 0x7f84300958b0 2023-09-30T22:22:12.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.320+0000 7fb4b0ff9700 1 -- 172.21.15.40:0/3196805861 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a8012920 con 0x7fb4b4062e60 2023-09-30T22:22:12.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.320+0000 7f31a3289700 1 -- 172.21.15.40:0/1556938402 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f319c121200 con 0x7f319c067ca0 2023-09-30T22:22:12.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.320+0000 7f31a3289700 1 -- 172.21.15.40:0/1556938402 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f319c122f80 con 0x7f319c067ca0 2023-09-30T22:22:12.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.320+0000 7f2ff976e700 1 -- 172.21.15.40:0/660674191 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ff411a550 con 0x7f2ff4093ac0 2023-09-30T22:22:12.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.320+0000 7f2fdaffd700 1 -- 172.21.15.40:0/660674191 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fec013d00 con 0x7f2ff4093ac0 2023-09-30T22:22:12.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.320+0000 7f2fdaffd700 1 -- 172.21.15.40:0/660674191 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fec013e70 con 0x7f2ff4093ac0 2023-09-30T22:22:12.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.321+0000 7f2ff976e700 1 -- 172.21.15.40:0/660674191 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2fd4000fc0 con 0x7f2ff4093ac0 2023-09-30T22:22:12.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.321+0000 7f8417fff700 1 -- 172.21.15.40:0/1773810529 <== osd.1 v1:172.21.15.40:6808/119436 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f841c038430 con 0x7f841c034740 2023-09-30T22:22:12.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.321+0000 7fb4badcb700 1 -- 172.21.15.40:0/3196805861 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4b4096700 con 0x7fb4b4062e60 2023-09-30T22:22:12.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.321+0000 7fb4badcb700 1 -- 172.21.15.40:0/3196805861 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4b4097310 con 0x7fb4b4062e60 2023-09-30T22:22:12.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.320+0000 7fb4b0ff9700 1 -- 172.21.15.40:0/3196805861 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a8012a80 con 0x7fb4b4062e60 2023-09-30T22:22:12.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.321+0000 7fb4b0ff9700 1 -- 172.21.15.40:0/3196805861 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a8012e40 con 0x7fb4b4062e60 2023-09-30T22:22:12.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.321+0000 7f2fdaffd700 1 -- 172.21.15.40:0/660674191 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f2fec003040 con 0x7f2ff4093ac0 2023-09-30T22:22:12.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.322+0000 7fb49e7fc700 1 -- 172.21.15.40:0/3196805861 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb4b412aa20 con 0x7fb4b4062e60 2023-09-30T22:22:12.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.321+0000 7f31a3289700 1 -- 172.21.15.40:0/1556938402 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f319c09ac00 con 0x7f319c067ca0 2023-09-30T22:22:12.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.321+0000 7f31917fa700 1 -- 172.21.15.40:0/1556938402 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f318c0068b0 con 0x7f319c067ca0 2023-09-30T22:22:12.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.322+0000 7f31917fa700 1 -- 172.21.15.40:0/1556938402 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f318c03a740 con 0x7f319c067ca0 2023-09-30T22:22:12.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.322+0000 7f2fdaffd700 1 -- 172.21.15.40:0/660674191 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f2fec044670 con 0x7f2ff4093ac0 2023-09-30T22:22:12.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.322+0000 7f31917fa700 1 -- 172.21.15.40:0/1556938402 --> v1:172.21.15.40:6804/119432 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f31800385e0 con 0x7f31800348f0 2023-09-30T22:22:12.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.322+0000 7f2fdaffd700 1 -- 172.21.15.40:0/660674191 --> v1:172.21.15.40:6812/119451 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2fe0038460 con 0x7f2fe0034770 2023-09-30T22:22:12.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.323+0000 7fb4b0ff9700 1 -- 172.21.15.40:0/3196805861 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb4a801c630 con 0x7fb4b4062e60 2023-09-30T22:22:12.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.323+0000 7f2fdaffd700 1 -- 172.21.15.40:0/660674191 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2fec033440 con 0x7f2ff4093ac0 2023-09-30T22:22:12.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.323+0000 7fb4b0ff9700 1 -- 172.21.15.40:0/3196805861 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fb4a803d0e0 con 0x7fb4b4062e60 2023-09-30T22:22:12.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.323+0000 7fb4b0ff9700 1 -- 172.21.15.40:0/3196805861 --> v1:172.21.15.40:6800/119433 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb498038630 con 0x7fb498034940 2023-09-30T22:22:12.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.323+0000 7fb4b0ff9700 1 -- 172.21.15.40:0/3196805861 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4a803d410 con 0x7fb4b4062e60 2023-09-30T22:22:12.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.323+0000 7f2fdaffd700 1 -- 172.21.15.40:0/660674191 <== osd.0 v1:172.21.15.40:6812/119451 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f2fe0038460 con 0x7f2fe0034770 2023-09-30T22:22:12.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.323+0000 7f31917fa700 1 -- 172.21.15.40:0/1556938402 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f318c007db0 con 0x7f319c067ca0 2023-09-30T22:22:12.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.324+0000 7f31917fa700 1 -- 172.21.15.40:0/1556938402 <== osd.3 v1:172.21.15.40:6804/119432 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f31800385e0 con 0x7f31800348f0 2023-09-30T22:22:12.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.324+0000 7fb4b0ff9700 1 -- 172.21.15.40:0/3196805861 <== osd.2 v1:172.21.15.40:6800/119433 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7fb498038630 con 0x7fb498034940 2023-09-30T22:22:12.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.336+0000 7f843671f700 1 -- 172.21.15.40:0/1773810529 --> v1:172.21.15.40:6808/119436 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8410002b10 con 0x7f841c034740 2023-09-30T22:22:12.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.336+0000 7f8417fff700 1 -- 172.21.15.40:0/1773810529 <== osd.1 v1:172.21.15.40:6808/119436 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7f8410002b10 con 0x7f841c034740 2023-09-30T22:22:12.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.337+0000 7f843671f700 1 -- 172.21.15.40:0/1773810529 >> v1:172.21.15.40:6808/119436 conn(0x7f841c034740 legacy=0x7f841c036bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.337+0000 7f843671f700 1 -- 172.21.15.40:0/1773810529 >> v1:172.21.15.40:6816/118905 conn(0x7f841c02bb30 legacy=0x7f841c02dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.337+0000 7f843671f700 1 -- 172.21.15.40:0/1773810529 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f84300958b0 msgr2=0x7f843011f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.337+0000 7f843671f700 1 --2- 172.21.15.40:0/1773810529 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f84300958b0 0x7f843011f500 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f842800b990 tx=0x7f8428009780).stop 2023-09-30T22:22:12.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.337+0000 7f8434cbc700 1 -- 172.21.15.40:0/1773810529 reap_dead start 2023-09-30T22:22:12.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.337+0000 7f843671f700 1 -- 172.21.15.40:0/1773810529 shutdown_connections 2023-09-30T22:22:12.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.337+0000 7f843671f700 1 -- 172.21.15.40:0/1773810529 >> 172.21.15.40:0/1773810529 conn(0x7f843009a970 msgr2=0x7f843009bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:12.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.337+0000 7f843671f700 1 -- 172.21.15.40:0/1773810529 shutdown_connections 2023-09-30T22:22:12.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.337+0000 7f843671f700 1 -- 172.21.15.40:0/1773810529 wait complete. 2023-09-30T22:22:12.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.341+0000 7f2ff976e700 1 -- 172.21.15.40:0/660674191 --> v1:172.21.15.40:6812/119451 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2fd4002b10 con 0x7f2fe0034770 2023-09-30T22:22:12.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.342+0000 7f2fdaffd700 1 -- 172.21.15.40:0/660674191 <== osd.0 v1:172.21.15.40:6812/119451 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7f2fd4002b10 con 0x7f2fe0034770 2023-09-30T22:22:12.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.342+0000 7f2ff976e700 1 -- 172.21.15.40:0/660674191 >> v1:172.21.15.40:6812/119451 conn(0x7f2fe0034770 legacy=0x7f2fe0036bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.342+0000 7f2ff976e700 1 -- 172.21.15.40:0/660674191 >> v1:172.21.15.40:6816/118905 conn(0x7f2fe002bb60 legacy=0x7f2fe002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.342+0000 7f2ff976e700 1 -- 172.21.15.40:0/660674191 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ff4093ac0 msgr2=0x7f2ff41168c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.342+0000 7f2ff976e700 1 --2- 172.21.15.40:0/660674191 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ff4093ac0 0x7f2ff41168c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f2fec00b6c0 tx=0x7f2fec009780).stop 2023-09-30T22:22:12.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.342+0000 7f2ff37fe700 1 -- 172.21.15.40:0/660674191 reap_dead start 2023-09-30T22:22:12.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.343+0000 7f2ff976e700 1 -- 172.21.15.40:0/660674191 shutdown_connections 2023-09-30T22:22:12.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.343+0000 7f2ff976e700 1 -- 172.21.15.40:0/660674191 >> 172.21.15.40:0/660674191 conn(0x7f2ff4097580 msgr2=0x7f2ff4069100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:12.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.343+0000 7f2ff976e700 1 -- 172.21.15.40:0/660674191 shutdown_connections 2023-09-30T22:22:12.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.343+0000 7f2ff976e700 1 -- 172.21.15.40:0/660674191 wait complete. 2023-09-30T22:22:12.355 INFO:teuthology.orchestra.run.smithi040.stdout:38654705669 2023-09-30T22:22:12.356 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:12.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.353+0000 7f31a3289700 1 -- 172.21.15.40:0/1556938402 --> v1:172.21.15.40:6804/119432 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f319c062790 con 0x7f31800348f0 2023-09-30T22:22:12.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.354+0000 7fb49e7fc700 1 -- 172.21.15.40:0/3196805861 --> v1:172.21.15.40:6800/119433 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb4b41472e0 con 0x7fb498034940 2023-09-30T22:22:12.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.354+0000 7f31917fa700 1 -- 172.21.15.40:0/1556938402 <== osd.3 v1:172.21.15.40:6804/119432 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7f319c062790 con 0x7f31800348f0 2023-09-30T22:22:12.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.354+0000 7fb4b0ff9700 1 -- 172.21.15.40:0/3196805861 <== osd.2 v1:172.21.15.40:6800/119433 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7fb4b41472e0 con 0x7fb498034940 2023-09-30T22:22:12.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.354+0000 7f31a3289700 1 -- 172.21.15.40:0/1556938402 >> v1:172.21.15.40:6804/119432 conn(0x7f31800348f0 legacy=0x7f3180036d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.355+0000 7f31a3289700 1 -- 172.21.15.40:0/1556938402 >> v1:172.21.15.40:6816/118905 conn(0x7f318002bbe0 legacy=0x7f318002e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.355+0000 7f31a3289700 1 -- 172.21.15.40:0/1556938402 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319c067ca0 msgr2=0x7f319c13eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.355+0000 7f31a3289700 1 --2- 172.21.15.40:0/1556938402 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319c067ca0 0x7f319c13eef0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f318c00c440 tx=0x7f318c007d40).stop 2023-09-30T22:22:12.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.355+0000 7f31a1826700 1 -- 172.21.15.40:0/1556938402 reap_dead start 2023-09-30T22:22:12.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.355+0000 7fb49e7fc700 1 -- 172.21.15.40:0/3196805861 >> v1:172.21.15.40:6800/119433 conn(0x7fb498034940 legacy=0x7fb498036dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.355+0000 7f31a3289700 1 -- 172.21.15.40:0/1556938402 shutdown_connections 2023-09-30T22:22:12.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.355+0000 7f31a3289700 1 -- 172.21.15.40:0/1556938402 >> 172.21.15.40:0/1556938402 conn(0x7f319c09a450 msgr2=0x7f319c094bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:12.360 INFO:teuthology.orchestra.run.smithi040.stdout:38654705669 2023-09-30T22:22:12.360 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:12.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.355+0000 7fb49e7fc700 1 -- 172.21.15.40:0/3196805861 >> v1:172.21.15.40:6816/118905 conn(0x7fb49802bbb0 legacy=0x7fb49802e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.355+0000 7fb49e7fc700 1 -- 172.21.15.40:0/3196805861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4b4062e60 msgr2=0x7fb4b4128b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.355+0000 7fb49e7fc700 1 --2- 172.21.15.40:0/3196805861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4b4062e60 0x7fb4b4128b20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fb4a8010000 tx=0x7fb4a8016000).stop 2023-09-30T22:22:12.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.355+0000 7fb4b9368700 1 -- 172.21.15.40:0/3196805861 reap_dead start 2023-09-30T22:22:12.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.355+0000 7f31a3289700 1 -- 172.21.15.40:0/1556938402 shutdown_connections 2023-09-30T22:22:12.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.355+0000 7fb49e7fc700 1 -- 172.21.15.40:0/3196805861 shutdown_connections 2023-09-30T22:22:12.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.355+0000 7fb49e7fc700 1 -- 172.21.15.40:0/3196805861 >> 172.21.15.40:0/3196805861 conn(0x7fb4b409a450 msgr2=0x7fb4b4127a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:12.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.355+0000 7f31a3289700 1 -- 172.21.15.40:0/1556938402 wait complete. 2023-09-30T22:22:12.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.355+0000 7fb49e7fc700 1 -- 172.21.15.40:0/3196805861 shutdown_connections 2023-09-30T22:22:12.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.355+0000 7fb49e7fc700 1 -- 172.21.15.40:0/3196805861 wait complete. 2023-09-30T22:22:12.368 INFO:teuthology.orchestra.run.smithi040.stdout:38654705669 2023-09-30T22:22:12.369 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:12.369 INFO:teuthology.orchestra.run.smithi040.stdout:38654705669 2023-09-30T22:22:12.370 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:12.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.502+0000 7f8f560a0700 1 Processor -- start 2023-09-30T22:22:12.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.502+0000 7f8f560a0700 1 -- start start 2023-09-30T22:22:12.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.503+0000 7f8f560a0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f5005e090 0x7f8f5012afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.503+0000 7f8f560a0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f5012ab40 0x7f8f5012b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.503+0000 7f8f560a0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8f501275b0 0x7f8f50127a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.503+0000 7f8f560a0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f50091fb0 con 0x7f8f501275b0 2023-09-30T22:22:12.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.503+0000 7f8f560a0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f50096c10 con 0x7f8f5012ab40 2023-09-30T22:22:12.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.503+0000 7f8f560a0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f50091a00 con 0x7f8f5005e090 2023-09-30T22:22:12.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.503+0000 7f8f4effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f5012ab40 0x7f8f5012b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:12.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.503+0000 7f8f4f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f5005e090 0x7f8f5012afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:12.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.503+0000 7f8f4ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8f501275b0 0x7f8f50127a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:12.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.503+0000 7f8f4effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f5012ab40 0x7f8f5012b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:46844/0 (socket says 172.21.15.40:46844) 2023-09-30T22:22:12.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.503+0000 7f8f4effd700 1 -- 172.21.15.40:0/1599612377 learned_addr learned my addr 172.21.15.40:0/1599612377 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:12.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.504+0000 7f8f4ffff700 1 -- 172.21.15.40:0/1599612377 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f5005e090 msgr2=0x7f8f5012afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:12.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.504+0000 7f8f4ffff700 1 --2- 172.21.15.40:0/1599612377 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f5005e090 0x7f8f5012afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.504+0000 7f8f4ffff700 1 -- 172.21.15.40:0/1599612377 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f5012ab40 msgr2=0x7f8f5012b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:12.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.504+0000 7f8f4ffff700 1 --2- 172.21.15.40:0/1599612377 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f5012ab40 0x7f8f5012b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.504+0000 7f8f4ffff700 1 -- 172.21.15.40:0/1599612377 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f50096700 con 0x7f8f501275b0 2023-09-30T22:22:12.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.504+0000 7f8f4ffff700 1 --2- 172.21.15.40:0/1599612377 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f501275b0 0x7f8f50127a10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f8f48009e60 tx=0x7f8f48009780).ready entity=mon.0 client_cookie=fa6eeeefa859b465 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:12.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.504+0000 7f8f4e7fc700 1 -- 172.21.15.40:0/1599612377 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4800e070 con 0x7f8f501275b0 2023-09-30T22:22:12.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.504+0000 7f8f4e7fc700 1 -- 172.21.15.40:0/1599612377 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f4800bab0 con 0x7f8f501275b0 2023-09-30T22:22:12.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.504+0000 7f8f4e7fc700 1 -- 172.21.15.40:0/1599612377 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4800be30 con 0x7f8f501275b0 2023-09-30T22:22:12.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.505+0000 7f8f560a0700 1 -- 172.21.15.40:0/1599612377 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f501275b0 msgr2=0x7f8f50127a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.505+0000 7f8f560a0700 1 --2- 172.21.15.40:0/1599612377 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f501275b0 0x7f8f50127a10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f8f48009e60 tx=0x7f8f48009780).stop 2023-09-30T22:22:12.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.505+0000 7f8f560a0700 1 -- 172.21.15.40:0/1599612377 shutdown_connections 2023-09-30T22:22:12.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.505+0000 7f8f560a0700 1 --2- 172.21.15.40:0/1599612377 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f5005e090 0x7f8f5012afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.505+0000 7f8f560a0700 1 --2- 172.21.15.40:0/1599612377 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f501275b0 0x7f8f50127a10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.505+0000 7f8f560a0700 1 --2- 172.21.15.40:0/1599612377 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f5012ab40 0x7f8f5012b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.505+0000 7f8f560a0700 1 -- 172.21.15.40:0/1599612377 >> 172.21.15.40:0/1599612377 conn(0x7f8f500975f0 msgr2=0x7f8f50097a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:12.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.505+0000 7f8f560a0700 1 -- 172.21.15.40:0/1599612377 shutdown_connections 2023-09-30T22:22:12.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.505+0000 7f8f560a0700 1 -- 172.21.15.40:0/1599612377 wait complete. 2023-09-30T22:22:12.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.506+0000 7f8f560a0700 1 Processor -- start 2023-09-30T22:22:12.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.506+0000 7f8f560a0700 1 -- start start 2023-09-30T22:22:12.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.506+0000 7f8f560a0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f5005e090 0x7f8f50113cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.506+0000 7f8f560a0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f501275b0 0x7f8f501141a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.506+0000 7f8f560a0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f50114690 0x7f8f50139e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.506+0000 7f8f560a0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f50114af0 con 0x7f8f501275b0 2023-09-30T22:22:12.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.506+0000 7f8f560a0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f50116bb0 con 0x7f8f50114690 2023-09-30T22:22:12.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.506+0000 7f8f560a0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f50125bc0 con 0x7f8f5005e090 2023-09-30T22:22:12.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.507+0000 7f8f4ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f50114690 0x7f8f50139e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:12.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.507+0000 7f8f4ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f50114690 0x7f8f50139e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:46850/0 (socket says 172.21.15.40:46850) 2023-09-30T22:22:12.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.507+0000 7f8f4ffff700 1 -- 172.21.15.40:0/4244750598 learned_addr learned my addr 172.21.15.40:0/4244750598 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:12.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.507+0000 7f8f4effd700 1 --2- 172.21.15.40:0/4244750598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f501275b0 0x7f8f501141a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:12.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.507+0000 7f8f4f7fe700 1 --2- 172.21.15.40:0/4244750598 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f5005e090 0x7f8f50113cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:12.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.507+0000 7f8f4ffff700 1 -- 172.21.15.40:0/4244750598 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f5005e090 msgr2=0x7f8f50113cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.507+0000 7f8f4ffff700 1 --2- 172.21.15.40:0/4244750598 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f5005e090 0x7f8f50113cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.507+0000 7f8f4ffff700 1 -- 172.21.15.40:0/4244750598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f501275b0 msgr2=0x7f8f501141a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.507+0000 7f8f4ffff700 1 --2- 172.21.15.40:0/4244750598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f501275b0 0x7f8f501141a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.507+0000 7f8f4ffff700 1 -- 172.21.15.40:0/4244750598 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f48009a20 con 0x7f8f50114690 2023-09-30T22:22:12.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.507+0000 7f8f4f7fe700 1 --2- 172.21.15.40:0/4244750598 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f5005e090 0x7f8f50113cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:22:12.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.507+0000 7f8f4ffff700 1 --2- 172.21.15.40:0/4244750598 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f50114690 0x7f8f50139e60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f8f48013cc0 tx=0x7f8f48009780).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:12.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.507+0000 7f8f377fe700 1 -- 172.21.15.40:0/4244750598 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4801d630 con 0x7f8f50114690 2023-09-30T22:22:12.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.507+0000 7f8f377fe700 1 -- 172.21.15.40:0/4244750598 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f4801d790 con 0x7f8f50114690 2023-09-30T22:22:12.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.507+0000 7f8f377fe700 1 -- 172.21.15.40:0/4244750598 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4801db30 con 0x7f8f50114690 2023-09-30T22:22:12.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.508+0000 7f8f560a0700 1 -- 172.21.15.40:0/4244750598 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f50096e00 con 0x7f8f50114690 2023-09-30T22:22:12.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.508+0000 7f8f560a0700 1 -- 172.21.15.40:0/4244750598 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f50117830 con 0x7f8f50114690 2023-09-30T22:22:12.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.509+0000 7f8f377fe700 1 -- 172.21.15.40:0/4244750598 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f8f48003040 con 0x7f8f50114690 2023-09-30T22:22:12.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.509+0000 7f8f560a0700 1 -- 172.21.15.40:0/4244750598 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f5005a260 con 0x7f8f50114690 2023-09-30T22:22:12.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.509+0000 7f8f377fe700 1 -- 172.21.15.40:0/4244750598 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f8f4803ccd0 con 0x7f8f50114690 2023-09-30T22:22:12.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.514+0000 7f8f377fe700 1 -- 172.21.15.40:0/4244750598 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f8f48024310 con 0x7f8f50114690 2023-09-30T22:22:12.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.538+0000 7fc8d84b8700 1 Processor -- start 2023-09-30T22:22:12.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.538+0000 7fc8d84b8700 1 -- start start 2023-09-30T22:22:12.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.538+0000 7f3f96f66700 1 Processor -- start 2023-09-30T22:22:12.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.538+0000 7f3f96f66700 1 -- start start 2023-09-30T22:22:12.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.538+0000 7f3f96f66700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f90093930 0x7f3f900957b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.539+0000 7fc8d84b8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc8d0096160 0x7fc8d0099600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.539+0000 7fc8d84b8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc8d0130650 0x7fc8d0132a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.539+0000 7f3f96f66700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3f9012d300 0x7f3f9012f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.539+0000 7f3f96f66700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f900940d0 con 0x7f3f90095ca0 2023-09-30T22:22:12.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.539+0000 7f3f96f66700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f90093d10 con 0x7f3f90093930 2023-09-30T22:22:12.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.539+0000 7f3f96f66700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f90094b30 con 0x7f3f9012d300 2023-09-30T22:22:12.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.539+0000 7fc8d84b8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d0098910 con 0x7fc8d0098b10 2023-09-30T22:22:12.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.539+0000 7fc8d84b8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d0096560 con 0x7fc8d0130650 2023-09-30T22:22:12.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.539+0000 7fc8d84b8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d0065e40 con 0x7fc8d0096160 2023-09-30T22:22:12.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.540+0000 7f3f8ffff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3f90095ca0 0x7f3f900960a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49468/0 (socket says 172.21.15.40:49468) 2023-09-30T22:22:12.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.540+0000 7f3f8ffff700 1 -- 172.21.15.40:0/2392977911 learned_addr learned my addr 172.21.15.40:0/2392977911 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:22:12.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.540+0000 7f3f94d02700 1 --2- 172.21.15.40:0/2392977911 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f90093930 0x7f3f900957b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:12.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.540+0000 7fc8d6254700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc8d0098b10 0x7fc8d0098ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49482/0 (socket says 172.21.15.40:49482) 2023-09-30T22:22:12.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.540+0000 7fc8d6a55700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc8d0130650 0x7fc8d0132a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:12.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.540+0000 7fc8d6254700 1 -- 172.21.15.40:0/795557549 learned_addr learned my addr 172.21.15.40:0/795557549 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:22:12.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.540+0000 7f3f95503700 1 --2- 172.21.15.40:0/2392977911 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3f9012d300 0x7f3f9012f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:12.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.540+0000 7fc8d5a53700 1 --2- 172.21.15.40:0/795557549 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc8d0096160 0x7fc8d0099600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:12.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.540+0000 7f3f94d02700 1 -- 172.21.15.40:0/2392977911 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3f9012d300 msgr2=0x7f3f9012f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:12.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.540+0000 7f3f94d02700 1 --2- 172.21.15.40:0/2392977911 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3f9012d300 0x7f3f9012f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.540+0000 7f3f94d02700 1 -- 172.21.15.40:0/2392977911 >> v1:172.21.15.40:6789/0 conn(0x7f3f90095ca0 legacy=0x7f3f900960a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.540+0000 7f3f94d02700 1 -- 172.21.15.40:0/2392977911 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f90091a40 con 0x7f3f90093930 2023-09-30T22:22:12.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.540+0000 7fc8d5252700 1 -- 172.21.15.40:0/795557549 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2972216814 0 0) 0x7fc8d0098910 con 0x7fc8d0098b10 2023-09-30T22:22:12.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.540+0000 7fc8d5252700 1 -- 172.21.15.40:0/795557549 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8bc0033f0 con 0x7fc8d0098b10 2023-09-30T22:22:12.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.540+0000 7f3f94d02700 1 --2- 172.21.15.40:0/2392977911 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f90093930 0x7f3f900957b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f3f84009790 tx=0x7f3f84009060).ready entity=mon.1 client_cookie=26aa61485d08a1c5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:12.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.540+0000 7fc8d5a53700 1 -- 172.21.15.40:0/795557549 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc8d0130650 msgr2=0x7fc8d0132a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:12.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.540+0000 7fc8d5a53700 1 --2- 172.21.15.40:0/795557549 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc8d0130650 0x7fc8d0132a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.540+0000 7fc8d5a53700 1 -- 172.21.15.40:0/795557549 >> v1:172.21.15.40:6789/0 conn(0x7fc8d0098b10 legacy=0x7fc8d0098ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.540+0000 7fc8d5a53700 1 -- 172.21.15.40:0/795557549 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d00955c0 con 0x7fc8d0096160 2023-09-30T22:22:12.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.541+0000 7fc8d5a53700 1 --2- 172.21.15.40:0/795557549 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc8d0096160 0x7fc8d0099600 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fc8c0009790 tx=0x7fc8c0009060).ready entity=mon.2 client_cookie=4264b0a1b77efde2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:12.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.541+0000 7fc8d5252700 1 -- 172.21.15.40:0/795557549 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c00090d0 con 0x7fc8d0096160 2023-09-30T22:22:12.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.541+0000 7fc8d5252700 1 -- 172.21.15.40:0/795557549 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c000f510 con 0x7fc8d0096160 2023-09-30T22:22:12.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.541+0000 7fc8d5252700 1 -- 172.21.15.40:0/795557549 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c000f890 con 0x7fc8d0096160 2023-09-30T22:22:12.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.541+0000 7fc8d84b8700 1 -- 172.21.15.40:0/795557549 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc8d0096160 msgr2=0x7fc8d0099600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.541+0000 7fc8d84b8700 1 --2- 172.21.15.40:0/795557549 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc8d0096160 0x7fc8d0099600 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fc8c0009790 tx=0x7fc8c0009060).stop 2023-09-30T22:22:12.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.542+0000 7fc8d84b8700 1 -- 172.21.15.40:0/795557549 shutdown_connections 2023-09-30T22:22:12.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.542+0000 7fc8d84b8700 1 --2- 172.21.15.40:0/795557549 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc8d0130650 0x7fc8d0132a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.542+0000 7fc8d84b8700 1 --2- 172.21.15.40:0/795557549 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc8d0096160 0x7fc8d0099600 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.542+0000 7fc8d84b8700 1 -- 172.21.15.40:0/795557549 >> 172.21.15.40:0/795557549 conn(0x7fc8d009ab30 msgr2=0x7fc8d009af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:12.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.542+0000 7fc8d84b8700 1 -- 172.21.15.40:0/795557549 shutdown_connections 2023-09-30T22:22:12.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.542+0000 7fc8d84b8700 1 -- 172.21.15.40:0/795557549 wait complete. 2023-09-30T22:22:12.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.543+0000 7fc8d84b8700 1 Processor -- start 2023-09-30T22:22:12.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.543+0000 7fc8d84b8700 1 -- start start 2023-09-30T22:22:12.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.543+0000 7fc8d84b8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8d0096160 0x7fc8d012fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.543+0000 7fc8d84b8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc8d0098b10 0x7fc8d01144b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.543+0000 7fc8d84b8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc8d0130650 0x7fc8d01149a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.543+0000 7fc8d84b8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d0117710 con 0x7fc8d0096160 2023-09-30T22:22:12.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.543+0000 7fc8d84b8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d0094bf0 con 0x7fc8d0130650 2023-09-30T22:22:12.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.543+0000 7fc8d84b8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d0099de0 con 0x7fc8d0098b10 2023-09-30T22:22:12.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.543+0000 7fc8d6254700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8d0096160 0x7fc8d012fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:12.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.543+0000 7fc8d6254700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8d0096160 0x7fc8d012fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46624/0 (socket says 172.21.15.40:46624) 2023-09-30T22:22:12.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.543+0000 7fc8d6254700 1 -- 172.21.15.40:0/1247221386 learned_addr learned my addr 172.21.15.40:0/1247221386 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:12.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.543+0000 7fc8d5a53700 1 --2- 172.21.15.40:0/1247221386 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc8d0098b10 0x7fc8d01144b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:12.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.544+0000 7fc8d5a53700 1 -- 172.21.15.40:0/1247221386 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc8d0130650 msgr2=0x7fc8d01149a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.544+0000 7fc8d5a53700 1 --2- 172.21.15.40:0/1247221386 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc8d0130650 0x7fc8d01149a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:22:12.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.544+0000 7fc8d5a53700 1 -- 172.21.15.40:0/1247221386 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8d0096160 msgr2=0x7fc8d012fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.544+0000 7fc8d5a53700 1 --2- 172.21.15.40:0/1247221386 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8d0096160 0x7fc8d012fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.544+0000 7fc8d5a53700 1 -- 172.21.15.40:0/1247221386 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c00092a0 con 0x7fc8d0098b10 2023-09-30T22:22:12.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.544+0000 7fc8d5a53700 1 --2- 172.21.15.40:0/1247221386 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc8d0098b10 0x7fc8d01144b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fc8c0014000 tx=0x7fc8c0017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:12.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.544+0000 7fc8c67fc700 1 -- 172.21.15.40:0/1247221386 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c000fea0 con 0x7fc8d0098b10 2023-09-30T22:22:12.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.544+0000 7fc8c67fc700 1 -- 172.21.15.40:0/1247221386 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c0006910 con 0x7fc8d0098b10 2023-09-30T22:22:12.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.544+0000 7fc8d84b8700 1 -- 172.21.15.40:0/1247221386 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8d0118000 con 0x7fc8d0098b10 2023-09-30T22:22:12.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.544+0000 7fc8c67fc700 1 -- 172.21.15.40:0/1247221386 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c000f8b0 con 0x7fc8d0098b10 2023-09-30T22:22:12.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.544+0000 7fc8d84b8700 1 -- 172.21.15.40:0/1247221386 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8d006a4e0 con 0x7fc8d0098b10 2023-09-30T22:22:12.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.541+0000 7fcd0bca2700 1 Processor -- start 2023-09-30T22:22:12.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.541+0000 7fcd0bca2700 1 -- start start 2023-09-30T22:22:12.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.541+0000 7fcd0bca2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd04094b90 0x7fcd04094f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.541+0000 7fcd0bca2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcd04095460 0x7fcd04095840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.541+0000 7fcd0bca2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd040926a0 con 0x7fcd0412b2b0 2023-09-30T22:22:12.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.541+0000 7fcd0bca2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0406a9e0 con 0x7fcd04094b90 2023-09-30T22:22:12.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.541+0000 7fcd0bca2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd04095d30 con 0x7fcd04095460 2023-09-30T22:22:12.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.542+0000 7fcd0923d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcd04095460 0x7fcd04095840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:12.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.542+0000 7fcd0923d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcd04095460 0x7fcd04095840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60244/0 (socket says 172.21.15.40:60244) 2023-09-30T22:22:12.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.542+0000 7fcd0923d700 1 -- 172.21.15.40:0/631904384 learned_addr learned my addr 172.21.15.40:0/631904384 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:12.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.542+0000 7fcd0923d700 1 -- 172.21.15.40:0/631904384 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd04094b90 msgr2=0x7fcd04094f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:12.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.542+0000 7fcd0923d700 1 --2- 172.21.15.40:0/631904384 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd04094b90 0x7fcd04094f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-09-30T22:22:12.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.542+0000 7fcd0923d700 1 -- 172.21.15.40:0/631904384 >> v1:172.21.15.40:6789/0 conn(0x7fcd0412b2b0 legacy=0x7fcd0412d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.542+0000 7fcd0923d700 1 -- 172.21.15.40:0/631904384 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd04092b50 con 0x7fcd04095460 2023-09-30T22:22:12.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.542+0000 7fcd0923d700 1 --2- 172.21.15.40:0/631904384 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcd04095460 0x7fcd04095840 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fccf4009830 tx=0x7fccf40090f0).ready entity=mon.2 client_cookie=52d1205a74030535 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:12.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.542+0000 7fcd08a3c700 1 -- 172.21.15.40:0/631904384 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf400b640 con 0x7fcd04095460 2023-09-30T22:22:12.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.542+0000 7fcd08a3c700 1 -- 172.21.15.40:0/631904384 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf400b7a0 con 0x7fcd04095460 2023-09-30T22:22:12.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.542+0000 7fcd08a3c700 1 -- 172.21.15.40:0/631904384 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf400bb20 con 0x7fcd04095460 2023-09-30T22:22:12.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.543+0000 7fcd0bca2700 1 -- 172.21.15.40:0/631904384 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcd04095460 msgr2=0x7fcd04095840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.543+0000 7fcd0bca2700 1 --2- 172.21.15.40:0/631904384 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcd04095460 0x7fcd04095840 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fccf4009830 tx=0x7fccf40090f0).stop 2023-09-30T22:22:12.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.543+0000 7fcd0bca2700 1 -- 172.21.15.40:0/631904384 shutdown_connections 2023-09-30T22:22:12.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.543+0000 7fcd0bca2700 1 --2- 172.21.15.40:0/631904384 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd04094b90 0x7fcd04094f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-09-30T22:22:12.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.543+0000 7fcd0bca2700 1 --2- 172.21.15.40:0/631904384 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcd04095460 0x7fcd04095840 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.543+0000 7fcd0bca2700 1 -- 172.21.15.40:0/631904384 >> 172.21.15.40:0/631904384 conn(0x7fcd04099c80 msgr2=0x7fcd0409a090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:12.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.543+0000 7fcd0bca2700 1 -- 172.21.15.40:0/631904384 shutdown_connections 2023-09-30T22:22:12.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.543+0000 7fcd0bca2700 1 -- 172.21.15.40:0/631904384 wait complete. 2023-09-30T22:22:12.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.544+0000 7fcd0bca2700 1 Processor -- start 2023-09-30T22:22:12.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.544+0000 7fcd0bca2700 1 -- start start 2023-09-30T22:22:12.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.545+0000 7fcd0bca2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd04094b90 0x7fcd04077390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.545+0000 7fcd0bca2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcd04095460 0x7fcd04077880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.545+0000 7fcd0bca2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd0412b2b0 0x7fcd04077d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.545+0000 7fc8c67fc700 1 -- 172.21.15.40:0/1247221386 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fc8c001b620 con 0x7fc8d0098b10 2023-09-30T22:22:12.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.545+0000 7fcd0bca2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd04078260 con 0x7fcd04094b90 2023-09-30T22:22:12.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.545+0000 7fcd0bca2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0407ae50 con 0x7fcd0412b2b0 2023-09-30T22:22:12.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.545+0000 7fcd0bca2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd04065b20 con 0x7fcd04095460 2023-09-30T22:22:12.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.545+0000 7fcd0923d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcd04095460 0x7fcd04077880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:12.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.545+0000 7fcd09a3e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd04094b90 0x7fcd04077390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:12.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.545+0000 7fcd0923d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcd04095460 0x7fcd04077880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60260/0 (socket says 172.21.15.40:60260) 2023-09-30T22:22:12.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.545+0000 7fcd0923d700 1 -- 172.21.15.40:0/4060349103 learned_addr learned my addr 172.21.15.40:0/4060349103 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:12.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.545+0000 7fc8c67fc700 1 -- 172.21.15.40:0/1247221386 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fc8c003c690 con 0x7fc8d0098b10 2023-09-30T22:22:12.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.545+0000 7fc8d84b8700 1 -- 172.21.15.40:0/1247221386 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8d006a4e0 con 0x7fc8d0098b10 2023-09-30T22:22:12.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.545+0000 7fcd0923d700 1 -- 172.21.15.40:0/4060349103 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd0412b2b0 msgr2=0x7fcd04077d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.545+0000 7fcd0923d700 1 --2- 172.21.15.40:0/4060349103 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd0412b2b0 0x7fcd04077d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:22:12.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.545+0000 7fcd0923d700 1 -- 172.21.15.40:0/4060349103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd04094b90 msgr2=0x7fcd04077390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.545+0000 7fcd0923d700 1 --2- 172.21.15.40:0/4060349103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd04094b90 0x7fcd04077390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.545+0000 7fcd0923d700 1 -- 172.21.15.40:0/4060349103 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf4009370 con 0x7fcd04095460 2023-09-30T22:22:12.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.545+0000 7fcd0923d700 1 --2- 172.21.15.40:0/4060349103 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcd04095460 0x7fcd04077880 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fccf4006db0 tx=0x7fccf4017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:12.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.546+0000 7fccf9ffb700 1 -- 172.21.15.40:0/4060349103 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf400be90 con 0x7fcd04095460 2023-09-30T22:22:12.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.546+0000 7fccf9ffb700 1 -- 172.21.15.40:0/4060349103 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf400b910 con 0x7fcd04095460 2023-09-30T22:22:12.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.546+0000 7fcd0bca2700 1 -- 172.21.15.40:0/4060349103 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd04092e10 con 0x7fcd04095460 2023-09-30T22:22:12.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.546+0000 7f3f8f7fe700 1 -- 172.21.15.40:0/2392977911 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f840090d0 con 0x7f3f90093930 2023-09-30T22:22:12.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.546+0000 7f3f8f7fe700 1 -- 172.21.15.40:0/2392977911 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8400b5a0 con 0x7f3f90093930 2023-09-30T22:22:12.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.546+0000 7f3f8f7fe700 1 -- 172.21.15.40:0/2392977911 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8400b920 con 0x7f3f90093930 2023-09-30T22:22:12.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.547+0000 7f3f96f66700 1 -- 172.21.15.40:0/2392977911 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f90093930 msgr2=0x7f3f900957b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.547+0000 7f3f96f66700 1 --2- 172.21.15.40:0/2392977911 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f90093930 0x7f3f900957b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f3f84009790 tx=0x7f3f84009060).stop 2023-09-30T22:22:12.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.547+0000 7f3f96f66700 1 -- 172.21.15.40:0/2392977911 shutdown_connections 2023-09-30T22:22:12.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.547+0000 7f3f96f66700 1 --2- 172.21.15.40:0/2392977911 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3f9012d300 0x7f3f9012f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.547+0000 7f3f96f66700 1 --2- 172.21.15.40:0/2392977911 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f90093930 0x7f3f900957b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.547+0000 7f3f96f66700 1 -- 172.21.15.40:0/2392977911 >> 172.21.15.40:0/2392977911 conn(0x7f3f90097580 msgr2=0x7f3f90097990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:12.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.548+0000 7f3f96f66700 1 -- 172.21.15.40:0/2392977911 shutdown_connections 2023-09-30T22:22:12.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.548+0000 7f3f96f66700 1 -- 172.21.15.40:0/2392977911 wait complete. 2023-09-30T22:22:12.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.546+0000 7fccf9ffb700 1 -- 172.21.15.40:0/4060349103 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf400ba80 con 0x7fcd04095460 2023-09-30T22:22:12.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.546+0000 7fcd0bca2700 1 -- 172.21.15.40:0/4060349103 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd0407b4c0 con 0x7fcd04095460 2023-09-30T22:22:12.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.548+0000 7fcd0bca2700 1 -- 172.21.15.40:0/4060349103 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd0405a260 con 0x7fcd04095460 2023-09-30T22:22:12.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.548+0000 7f3f96f66700 1 Processor -- start 2023-09-30T22:22:12.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.549+0000 7f3f96f66700 1 -- start start 2023-09-30T22:22:12.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.549+0000 7f3f96f66700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3f90093930 0x7f3f9012f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.549+0000 7f3f96f66700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f90095ca0 0x7f3f9012fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.549+0000 7f3f96f66700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f9012d300 0x7f3f9012fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:12.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.549+0000 7f3f96f66700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f901304e0 con 0x7f3f9012d300 2023-09-30T22:22:12.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.549+0000 7f3f96f66700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9011a020 con 0x7f3f90095ca0 2023-09-30T22:22:12.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.549+0000 7f3f96f66700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f901312b0 con 0x7f3f90093930 2023-09-30T22:22:12.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.549+0000 7f3f94d02700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3f90093930 0x7f3f9012f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:12.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.549+0000 7f3f94d02700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3f90093930 0x7f3f9012f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60262/0 (socket says 172.21.15.40:60262) 2023-09-30T22:22:12.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.549+0000 7f3f94d02700 1 -- 172.21.15.40:0/1804541649 learned_addr learned my addr 172.21.15.40:0/1804541649 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:12.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.549+0000 7f3f95503700 1 --2- 172.21.15.40:0/1804541649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f9012d300 0x7f3f9012fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:12.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.550+0000 7f3f94d02700 1 -- 172.21.15.40:0/1804541649 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f90095ca0 msgr2=0x7f3f9012fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.550+0000 7f3f94d02700 1 --2- 172.21.15.40:0/1804541649 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f90095ca0 0x7f3f9012fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:22:12.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.550+0000 7f3f94d02700 1 -- 172.21.15.40:0/1804541649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f9012d300 msgr2=0x7f3f9012fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.550+0000 7f3f94d02700 1 --2- 172.21.15.40:0/1804541649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f9012d300 0x7f3f9012fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.550+0000 7f3f94d02700 1 -- 172.21.15.40:0/1804541649 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f840092a0 con 0x7f3f90093930 2023-09-30T22:22:12.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.550+0000 7f3f94d02700 1 --2- 172.21.15.40:0/1804541649 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3f90093930 0x7f3f9012f610 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f3f900973b0 tx=0x7f3f84015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:12.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.552+0000 7fccf9ffb700 1 -- 172.21.15.40:0/4060349103 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fccf4021020 con 0x7fcd04095460 2023-09-30T22:22:12.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.552+0000 7fccf9ffb700 1 -- 172.21.15.40:0/4060349103 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fccf403ccd0 con 0x7fcd04095460 2023-09-30T22:22:12.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.553+0000 7fc8c67fc700 1 -- 172.21.15.40:0/1247221386 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fc8d006a4e0 con 0x7fc8d0098b10 2023-09-30T22:22:12.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.553+0000 7f3f8cff9700 1 -- 172.21.15.40:0/1804541649 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8400b920 con 0x7f3f90093930 2023-09-30T22:22:12.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.553+0000 7f3f8cff9700 1 -- 172.21.15.40:0/1804541649 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8400bc90 con 0x7f3f90093930 2023-09-30T22:22:12.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.553+0000 7f3f8cff9700 1 -- 172.21.15.40:0/1804541649 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8401b410 con 0x7f3f90093930 2023-09-30T22:22:12.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.553+0000 7f3f96f66700 1 -- 172.21.15.40:0/1804541649 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f90132600 con 0x7f3f90093930 2023-09-30T22:22:12.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.553+0000 7f3f96f66700 1 -- 172.21.15.40:0/1804541649 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f9011aa60 con 0x7f3f90093930 2023-09-30T22:22:12.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.554+0000 7f3f96f66700 1 -- 172.21.15.40:0/1804541649 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f9005a260 con 0x7f3f90093930 2023-09-30T22:22:12.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.556+0000 7fccf9ffb700 1 -- 172.21.15.40:0/4060349103 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fccf402c350 con 0x7fcd04095460 2023-09-30T22:22:12.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.556+0000 7f3f8cff9700 1 -- 172.21.15.40:0/1804541649 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f3f8401b7c0 con 0x7f3f90093930 2023-09-30T22:22:12.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.557+0000 7f3f8cff9700 1 -- 172.21.15.40:0/1804541649 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f3f8403d280 con 0x7f3f90093930 2023-09-30T22:22:12.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.564+0000 7f3f8cff9700 1 -- 172.21.15.40:0/1804541649 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f3f8401ba70 con 0x7f3f90093930 2023-09-30T22:22:12.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.692+0000 7f8f560a0700 1 -- 172.21.15.40:0/4244750598 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8f50046c20 con 0x7f8f50114690 2023-09-30T22:22:12.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.692+0000 7f8f377fe700 1 -- 172.21.15.40:0/4244750598 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8f4801bb00 con 0x7f8f50114690 2023-09-30T22:22:12.693 INFO:teuthology.orchestra.run.smithi040.stdout:38654705667 2023-09-30T22:22:12.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.694+0000 7f8f560a0700 1 -- 172.21.15.40:0/4244750598 >> v1:172.21.15.40:6816/118905 conn(0x7f8f3c02bb60 legacy=0x7f8f3c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.694+0000 7f8f560a0700 1 -- 172.21.15.40:0/4244750598 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f50114690 msgr2=0x7f8f50139e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.694+0000 7f8f560a0700 1 --2- 172.21.15.40:0/4244750598 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f50114690 0x7f8f50139e60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f8f48013cc0 tx=0x7f8f48009780).stop 2023-09-30T22:22:12.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.694+0000 7f8f560a0700 1 -- 172.21.15.40:0/4244750598 shutdown_connections 2023-09-30T22:22:12.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.694+0000 7f8f560a0700 1 --2- 172.21.15.40:0/4244750598 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f5005e090 0x7f8f50113cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.694+0000 7f8f560a0700 1 --2- 172.21.15.40:0/4244750598 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f50114690 0x7f8f50139e60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.694+0000 7f8f560a0700 1 --2- 172.21.15.40:0/4244750598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f501275b0 0x7f8f501141a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.694+0000 7f8f560a0700 1 -- 172.21.15.40:0/4244750598 >> 172.21.15.40:0/4244750598 conn(0x7f8f500975f0 msgr2=0x7f8f50095420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:12.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.694+0000 7f8f560a0700 1 -- 172.21.15.40:0/4244750598 shutdown_connections 2023-09-30T22:22:12.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.694+0000 7f8f560a0700 1 -- 172.21.15.40:0/4244750598 wait complete. 2023-09-30T22:22:12.707 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.1 2023-09-30T22:22:12.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.724+0000 7fc8d84b8700 1 -- 172.21.15.40:0/1247221386 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc8d006a4e0 con 0x7fc8d0098b10 2023-09-30T22:22:12.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.724+0000 7fc8c67fc700 1 -- 172.21.15.40:0/1247221386 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc8d006a4e0 con 0x7fc8d0098b10 2023-09-30T22:22:12.725 INFO:teuthology.orchestra.run.smithi040.stdout:38654705667 2023-09-30T22:22:12.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.726+0000 7fc8d84b8700 1 -- 172.21.15.40:0/1247221386 >> v1:172.21.15.40:6816/118905 conn(0x7fc8b402bb90 legacy=0x7fc8b402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.726+0000 7fc8d84b8700 1 -- 172.21.15.40:0/1247221386 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc8d0098b10 msgr2=0x7fc8d01144b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.726+0000 7fc8d84b8700 1 --2- 172.21.15.40:0/1247221386 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc8d0098b10 0x7fc8d01144b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fc8c0014000 tx=0x7fc8c0017000).stop 2023-09-30T22:22:12.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.726+0000 7fc8d84b8700 1 -- 172.21.15.40:0/1247221386 shutdown_connections 2023-09-30T22:22:12.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.726+0000 7fc8d84b8700 1 --2- 172.21.15.40:0/1247221386 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc8d0130650 0x7fc8d01149a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:22:12.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.726+0000 7fc8d84b8700 1 --2- 172.21.15.40:0/1247221386 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8d0096160 0x7fc8d012fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.726+0000 7fc8d84b8700 1 --2- 172.21.15.40:0/1247221386 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc8d0098b10 0x7fc8d01144b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.726+0000 7fc8d84b8700 1 -- 172.21.15.40:0/1247221386 >> 172.21.15.40:0/1247221386 conn(0x7fc8d009ab30 msgr2=0x7fc8d009d090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:12.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.726+0000 7fc8d84b8700 1 -- 172.21.15.40:0/1247221386 shutdown_connections 2023-09-30T22:22:12.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.726+0000 7fc8d84b8700 1 -- 172.21.15.40:0/1247221386 wait complete. 2023-09-30T22:22:12.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.730+0000 7fcd0bca2700 1 -- 172.21.15.40:0/4060349103 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcd04046c20 con 0x7fcd04095460 2023-09-30T22:22:12.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.731+0000 7fccf9ffb700 1 -- 172.21.15.40:0/4060349103 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fccf402d3a0 con 0x7fcd04095460 2023-09-30T22:22:12.731 INFO:teuthology.orchestra.run.smithi040.stdout:38654705667 2023-09-30T22:22:12.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.733+0000 7fcd0bca2700 1 -- 172.21.15.40:0/4060349103 >> v1:172.21.15.40:6816/118905 conn(0x7fcce802bb60 legacy=0x7fcce802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.733+0000 7fcd0bca2700 1 -- 172.21.15.40:0/4060349103 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcd04095460 msgr2=0x7fcd04077880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.733+0000 7fcd0bca2700 1 --2- 172.21.15.40:0/4060349103 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcd04095460 0x7fcd04077880 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fccf4006db0 tx=0x7fccf4017000).stop 2023-09-30T22:22:12.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.733+0000 7fcd0bca2700 1 -- 172.21.15.40:0/4060349103 shutdown_connections 2023-09-30T22:22:12.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.733+0000 7fcd0bca2700 1 --2- 172.21.15.40:0/4060349103 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd0412b2b0 0x7fcd04077d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:22:12.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.733+0000 7fcd0bca2700 1 --2- 172.21.15.40:0/4060349103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd04094b90 0x7fcd04077390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.733+0000 7fcd0bca2700 1 --2- 172.21.15.40:0/4060349103 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcd04095460 0x7fcd04077880 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.733+0000 7fcd0bca2700 1 -- 172.21.15.40:0/4060349103 >> 172.21.15.40:0/4060349103 conn(0x7fcd04099c80 msgr2=0x7fcd04082290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:12.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.733+0000 7fcd0bca2700 1 -- 172.21.15.40:0/4060349103 shutdown_connections 2023-09-30T22:22:12.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.733+0000 7fcd0bca2700 1 -- 172.21.15.40:0/4060349103 wait complete. 2023-09-30T22:22:12.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.737+0000 7f3f96f66700 1 -- 172.21.15.40:0/1804541649 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3f90091c80 con 0x7f3f90093930 2023-09-30T22:22:12.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.737+0000 7f3f8cff9700 1 -- 172.21.15.40:0/1804541649 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3f84019380 con 0x7f3f90093930 2023-09-30T22:22:12.738 INFO:teuthology.orchestra.run.smithi040.stdout:38654705667 2023-09-30T22:22:12.741 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.3 2023-09-30T22:22:12.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.740+0000 7f3f96f66700 1 -- 172.21.15.40:0/1804541649 >> v1:172.21.15.40:6816/118905 conn(0x7f3f7402bbe0 legacy=0x7f3f7402e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.740+0000 7f3f96f66700 1 -- 172.21.15.40:0/1804541649 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3f90093930 msgr2=0x7f3f9012f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.740+0000 7f3f96f66700 1 --2- 172.21.15.40:0/1804541649 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3f90093930 0x7f3f9012f610 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f3f900973b0 tx=0x7f3f84015000).stop 2023-09-30T22:22:12.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.740+0000 7f3f96f66700 1 -- 172.21.15.40:0/1804541649 shutdown_connections 2023-09-30T22:22:12.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.740+0000 7f3f96f66700 1 --2- 172.21.15.40:0/1804541649 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3f90093930 0x7f3f9012f610 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.740+0000 7f3f96f66700 1 --2- 172.21.15.40:0/1804541649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f9012d300 0x7f3f9012fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:12.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.740+0000 7f3f96f66700 1 --2- 172.21.15.40:0/1804541649 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f90095ca0 0x7f3f9012fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:22:12.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.740+0000 7f3f96f66700 1 -- 172.21.15.40:0/1804541649 >> 172.21.15.40:0/1804541649 conn(0x7f3f90097580 msgr2=0x7f3f900992e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:12.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.740+0000 7f3f96f66700 1 -- 172.21.15.40:0/1804541649 shutdown_connections 2023-09-30T22:22:12.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:12.740+0000 7f3f96f66700 1 -- 172.21.15.40:0/1804541649 wait complete. 2023-09-30T22:22:12.747 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.2 2023-09-30T22:22:12.754 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.0 2023-09-30T22:22:13.708 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:13.741 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:13.748 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:13.754 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:13.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.856+0000 7f29ebfc1700 1 Processor -- start 2023-09-30T22:22:13.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.857+0000 7f29ebfc1700 1 -- start start 2023-09-30T22:22:13.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.857+0000 7f29ebfc1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29e405e090 0x7f29e4128e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:13.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.857+0000 7f29ebfc1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f29e41289b0 0x7f29e4129330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:13.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.857+0000 7f29ebfc1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29e405ec20 con 0x7f29e4093c10 2023-09-30T22:22:13.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.857+0000 7f29ebfc1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e405e470 con 0x7f29e405e090 2023-09-30T22:22:13.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.857+0000 7f29ebfc1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29e4095830 con 0x7f29e41289b0 2023-09-30T22:22:13.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.857+0000 7f29e9d5d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29e405e090 0x7f29e4128e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:13.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.858+0000 7f29e9d5d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29e405e090 0x7f29e4128e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:55108/0 (socket says 172.21.15.40:55108) 2023-09-30T22:22:13.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.858+0000 7f29e9d5d700 1 -- 172.21.15.40:0/2441927943 learned_addr learned my addr 172.21.15.40:0/2441927943 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:13.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.858+0000 7f29e955c700 1 --2- 172.21.15.40:0/2441927943 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f29e41289b0 0x7f29e4129330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:13.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.858+0000 7f29e9d5d700 1 -- 172.21.15.40:0/2441927943 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f29e41289b0 msgr2=0x7f29e4129330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:13.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.858+0000 7f29e9d5d700 1 --2- 172.21.15.40:0/2441927943 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f29e41289b0 0x7f29e4129330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:13.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.858+0000 7f29e9d5d700 1 -- 172.21.15.40:0/2441927943 >> v1:172.21.15.40:6789/0 conn(0x7f29e4093c10 legacy=0x7f29e40940c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:13.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.858+0000 7f29e9d5d700 1 -- 172.21.15.40:0/2441927943 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e40966a0 con 0x7f29e405e090 2023-09-30T22:22:13.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.858+0000 7f29e9d5d700 1 --2- 172.21.15.40:0/2441927943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29e405e090 0x7f29e4128e40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f29e000df50 tx=0x7f29e000d840).ready entity=mon.1 client_cookie=382ed23eb31fc024 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:13.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.858+0000 7f29e8d5b700 1 -- 172.21.15.40:0/2441927943 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e0012070 con 0x7f29e405e090 2023-09-30T22:22:13.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.858+0000 7f29e8d5b700 1 -- 172.21.15.40:0/2441927943 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e000f720 con 0x7f29e405e090 2023-09-30T22:22:13.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.858+0000 7f29e8d5b700 1 -- 172.21.15.40:0/2441927943 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e000faf0 con 0x7f29e405e090 2023-09-30T22:22:13.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.859+0000 7f29ebfc1700 1 -- 172.21.15.40:0/2441927943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29e405e090 msgr2=0x7f29e4128e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:13.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.859+0000 7f29ebfc1700 1 --2- 172.21.15.40:0/2441927943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29e405e090 0x7f29e4128e40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f29e000df50 tx=0x7f29e000d840).stop 2023-09-30T22:22:13.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.859+0000 7f29ebfc1700 1 -- 172.21.15.40:0/2441927943 shutdown_connections 2023-09-30T22:22:13.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.859+0000 7f29ebfc1700 1 --2- 172.21.15.40:0/2441927943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29e405e090 0x7f29e4128e40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:13.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.859+0000 7f29ebfc1700 1 --2- 172.21.15.40:0/2441927943 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f29e41289b0 0x7f29e4129330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:13.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.859+0000 7f29ebfc1700 1 -- 172.21.15.40:0/2441927943 >> 172.21.15.40:0/2441927943 conn(0x7f29e4097580 msgr2=0x7f29e4097990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:13.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.860+0000 7f29ebfc1700 1 -- 172.21.15.40:0/2441927943 shutdown_connections 2023-09-30T22:22:13.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.860+0000 7f29ebfc1700 1 -- 172.21.15.40:0/2441927943 wait complete. 2023-09-30T22:22:13.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.861+0000 7f29ebfc1700 1 Processor -- start 2023-09-30T22:22:13.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.861+0000 7f29ebfc1700 1 -- start start 2023-09-30T22:22:13.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.862+0000 7f29ebfc1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29e405e090 0x7f29e4136290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:13.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.862+0000 7f29ebfc1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f29e4093c10 0x7f29e4136780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:13.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.862+0000 7f29ebfc1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29e4067b20 0x7f29e4067f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:13.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.862+0000 7f29ebfc1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e4111f40 con 0x7f29e405e090 2023-09-30T22:22:13.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.862+0000 7f29ebfc1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e41268b0 con 0x7f29e4067b20 2023-09-30T22:22:13.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.862+0000 7f29ebfc1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29e4095dc0 con 0x7f29e4093c10 2023-09-30T22:22:13.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.862+0000 7f29ea55e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29e4067b20 0x7f29e4067f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:13.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.862+0000 7f29e955c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f29e4093c10 0x7f29e4136780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:13.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.862+0000 7f29e9d5d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29e405e090 0x7f29e4136290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:13.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.862+0000 7f29e955c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f29e4093c10 0x7f29e4136780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33412/0 (socket says 172.21.15.40:33412) 2023-09-30T22:22:13.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.862+0000 7f29e9d5d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29e405e090 0x7f29e4136290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47938/0 (socket says 172.21.15.40:47938) 2023-09-30T22:22:13.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.862+0000 7f29e955c700 1 -- 172.21.15.40:0/1270272037 learned_addr learned my addr 172.21.15.40:0/1270272037 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:13.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.862+0000 7f29ea55e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29e4067b20 0x7f29e4067f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:55122/0 (socket says 172.21.15.40:55122) 2023-09-30T22:22:13.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.862+0000 7f29ea55e700 1 -- 172.21.15.40:0/1270272037 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f29e4093c10 msgr2=0x7f29e4136780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:13.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.862+0000 7f29ea55e700 1 --2- 172.21.15.40:0/1270272037 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f29e4093c10 0x7f29e4136780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:13.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.862+0000 7f29ea55e700 1 -- 172.21.15.40:0/1270272037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29e405e090 msgr2=0x7f29e4136290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:13.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.862+0000 7f29ea55e700 1 --2- 172.21.15.40:0/1270272037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29e405e090 0x7f29e4136290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:13.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.862+0000 7f29ea55e700 1 -- 172.21.15.40:0/1270272037 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e000dae0 con 0x7f29e4067b20 2023-09-30T22:22:13.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.862+0000 7f29e9d5d700 1 --2- 172.21.15.40:0/1270272037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29e405e090 0x7f29e4136290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:13.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.862+0000 7f29e955c700 1 --2- 172.21.15.40:0/1270272037 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f29e4093c10 0x7f29e4136780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:13.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.863+0000 7f29ea55e700 1 --2- 172.21.15.40:0/1270272037 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29e4067b20 0x7f29e4067f60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f29dc0013d0 tx=0x7f29dc001530).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:13.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.863+0000 7f29d9ffb700 1 -- 172.21.15.40:0/1270272037 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29dc00e4a0 con 0x7f29e4067b20 2023-09-30T22:22:13.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.863+0000 7f29d9ffb700 1 -- 172.21.15.40:0/1270272037 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29dc00e600 con 0x7f29e4067b20 2023-09-30T22:22:13.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.863+0000 7f29ebfc1700 1 -- 172.21.15.40:0/1270272037 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29e412afe0 con 0x7f29e4067b20 2023-09-30T22:22:13.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.863+0000 7f29d9ffb700 1 -- 172.21.15.40:0/1270272037 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29dc00e980 con 0x7f29e4067b20 2023-09-30T22:22:13.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.863+0000 7f29ebfc1700 1 -- 172.21.15.40:0/1270272037 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e4112770 con 0x7f29e4067b20 2023-09-30T22:22:13.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.864+0000 7f29d9ffb700 1 -- 172.21.15.40:0/1270272037 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f29dc0123f0 con 0x7f29e4067b20 2023-09-30T22:22:13.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.864+0000 7f29d9ffb700 1 -- 172.21.15.40:0/1270272037 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f29dc03a7b0 con 0x7f29e4067b20 2023-09-30T22:22:13.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.864+0000 7f29ebfc1700 1 -- 172.21.15.40:0/1270272037 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29e4112770 con 0x7f29e4067b20 2023-09-30T22:22:13.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.869+0000 7f29d9ffb700 1 -- 172.21.15.40:0/1270272037 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f29e4112770 con 0x7f29e4067b20 2023-09-30T22:22:13.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.890+0000 7fb8a9bba700 1 Processor -- start 2023-09-30T22:22:13.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.890+0000 7fb8a9bba700 1 -- start start 2023-09-30T22:22:13.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.891+0000 7fb8a9bba700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb8a40938f0 0x7fb8a40954f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:13.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.891+0000 7fb8a9bba700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8a412d310 0x7fb8a412f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:13.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.891+0000 7fb8a9bba700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8a4093fb0 con 0x7fb8a40959e0 2023-09-30T22:22:13.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.891+0000 7fb8a9bba700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a4093cd0 con 0x7fb8a412d310 2023-09-30T22:22:13.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.891+0000 7fb8a9bba700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a40968f0 con 0x7fb8a40938f0 2023-09-30T22:22:13.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.891+0000 7fb8a3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8a412d310 0x7fb8a412f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:13.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.891+0000 7fb8a3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8a412d310 0x7fb8a412f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:55128/0 (socket says 172.21.15.40:55128) 2023-09-30T22:22:13.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.891+0000 7fb8a3fff700 1 -- 172.21.15.40:0/3695852913 learned_addr learned my addr 172.21.15.40:0/3695852913 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:13.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.891+0000 7fb8a37fe700 1 --2- 172.21.15.40:0/3695852913 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb8a40938f0 0x7fb8a40954f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:13.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.891+0000 7fb8a3fff700 1 -- 172.21.15.40:0/3695852913 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb8a40938f0 msgr2=0x7fb8a40954f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:13.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.891+0000 7fb8a3fff700 1 --2- 172.21.15.40:0/3695852913 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb8a40938f0 0x7fb8a40954f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:13.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.891+0000 7fb8a3fff700 1 -- 172.21.15.40:0/3695852913 >> v1:172.21.15.40:6789/0 conn(0x7fb8a40959e0 legacy=0x7fb8a4095dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:13.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.891+0000 7fb8a3fff700 1 -- 172.21.15.40:0/3695852913 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a4091a00 con 0x7fb8a412d310 2023-09-30T22:22:13.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.891+0000 7fb8a37fe700 1 --2- 172.21.15.40:0/3695852913 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb8a40938f0 0x7fb8a40954f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:13.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.892+0000 7fb8a3fff700 1 --2- 172.21.15.40:0/3695852913 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8a412d310 0x7fb8a412f700 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fb89c009f50 tx=0x7fb89c009840).ready entity=mon.1 client_cookie=fe27cae3d45728be server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:13.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.892+0000 7fb8a27fc700 1 -- 172.21.15.40:0/3695852913 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c00e070 con 0x7fb8a412d310 2023-09-30T22:22:13.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.892+0000 7fb8a27fc700 1 -- 172.21.15.40:0/3695852913 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89c00b900 con 0x7fb8a412d310 2023-09-30T22:22:13.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.892+0000 7fb8a27fc700 1 -- 172.21.15.40:0/3695852913 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c00bc80 con 0x7fb8a412d310 2023-09-30T22:22:13.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.893+0000 7fb8a9bba700 1 -- 172.21.15.40:0/3695852913 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8a412d310 msgr2=0x7fb8a412f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:13.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.893+0000 7fb8a9bba700 1 --2- 172.21.15.40:0/3695852913 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8a412d310 0x7fb8a412f700 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fb89c009f50 tx=0x7fb89c009840).stop 2023-09-30T22:22:13.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.893+0000 7fb8a9bba700 1 -- 172.21.15.40:0/3695852913 shutdown_connections 2023-09-30T22:22:13.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.893+0000 7fb8a9bba700 1 --2- 172.21.15.40:0/3695852913 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8a412d310 0x7fb8a412f700 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:13.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.893+0000 7fb8a9bba700 1 --2- 172.21.15.40:0/3695852913 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb8a40938f0 0x7fb8a40954f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:13.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.893+0000 7fb8a9bba700 1 -- 172.21.15.40:0/3695852913 >> 172.21.15.40:0/3695852913 conn(0x7fb8a40975f0 msgr2=0x7fb8a4097a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:13.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.893+0000 7fb8a9bba700 1 -- 172.21.15.40:0/3695852913 shutdown_connections 2023-09-30T22:22:13.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.893+0000 7fb8a9bba700 1 -- 172.21.15.40:0/3695852913 wait complete. 2023-09-30T22:22:13.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.894+0000 7fb8a9bba700 1 Processor -- start 2023-09-30T22:22:13.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.894+0000 7fb8a9bba700 1 -- start start 2023-09-30T22:22:13.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.895+0000 7fb8a9bba700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8a40938f0 0x7fb8a4116fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:13.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.895+0000 7fb8a9bba700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb8a40959e0 0x7fb8a41174a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:13.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.895+0000 7fb8a37fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8a40938f0 0x7fb8a4116fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:13.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.895+0000 7fb8a9bba700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8a412d310 0x7fb8a4117990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:13.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.895+0000 7fb8a37fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8a40938f0 0x7fb8a4116fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47944/0 (socket says 172.21.15.40:47944) 2023-09-30T22:22:13.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.895+0000 7fb8a37fe700 1 -- 172.21.15.40:0/2597723464 learned_addr learned my addr 172.21.15.40:0/2597723464 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:13.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.895+0000 7fb8a9bba700 1 -- 172.21.15.40:0/2597723464 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a4117e80 con 0x7fb8a40938f0 2023-09-30T22:22:13.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.895+0000 7fb8a9bba700 1 -- 172.21.15.40:0/2597723464 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a406a670 con 0x7fb8a412d310 2023-09-30T22:22:13.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.895+0000 7fb8a9bba700 1 -- 172.21.15.40:0/2597723464 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a411a800 con 0x7fb8a40959e0 2023-09-30T22:22:13.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.895+0000 7fb8a2ffd700 1 --2- 172.21.15.40:0/2597723464 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb8a40959e0 0x7fb8a41174a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:13.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.896+0000 7fb8a3fff700 1 --2- 172.21.15.40:0/2597723464 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8a412d310 0x7fb8a4117990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:13.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.896+0000 7fb8a2ffd700 1 -- 172.21.15.40:0/2597723464 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8a412d310 msgr2=0x7fb8a4117990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:13.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.896+0000 7fb8a2ffd700 1 --2- 172.21.15.40:0/2597723464 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8a412d310 0x7fb8a4117990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:13.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.896+0000 7fb8a2ffd700 1 -- 172.21.15.40:0/2597723464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8a40938f0 msgr2=0x7fb8a4116fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:13.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.896+0000 7fb8a2ffd700 1 --2- 172.21.15.40:0/2597723464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8a40938f0 0x7fb8a4116fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:13.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.896+0000 7fb8a2ffd700 1 -- 172.21.15.40:0/2597723464 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8940092a0 con 0x7fb8a40959e0 2023-09-30T22:22:13.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.896+0000 7fb8a3fff700 1 --2- 172.21.15.40:0/2597723464 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8a412d310 0x7fb8a4117990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:13.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.896+0000 7fb8a2ffd700 1 --2- 172.21.15.40:0/2597723464 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb8a40959e0 0x7fb8a41174a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fb89800c5b0 tx=0x7fb898007d20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:13.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.896+0000 7fb8a37fe700 1 --2- 172.21.15.40:0/2597723464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8a40938f0 0x7fb8a4116fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:22:13.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.896+0000 7fb88b7fe700 1 -- 172.21.15.40:0/2597723464 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89800f470 con 0x7fb8a40959e0 2023-09-30T22:22:13.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.896+0000 7fb88b7fe700 1 -- 172.21.15.40:0/2597723464 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89800f5d0 con 0x7fb8a40959e0 2023-09-30T22:22:13.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.896+0000 7fb88b7fe700 1 -- 172.21.15.40:0/2597723464 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89800f950 con 0x7fb8a40959e0 2023-09-30T22:22:13.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.897+0000 7fb8a9bba700 1 -- 172.21.15.40:0/2597723464 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb89c009ae0 con 0x7fb8a40959e0 2023-09-30T22:22:13.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.897+0000 7fb8a9bba700 1 -- 172.21.15.40:0/2597723464 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a4118d50 con 0x7fb8a40959e0 2023-09-30T22:22:13.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.898+0000 7fb88b7fe700 1 -- 172.21.15.40:0/2597723464 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb89800fd00 con 0x7fb8a40959e0 2023-09-30T22:22:13.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.898+0000 7fb88b7fe700 1 -- 172.21.15.40:0/2597723464 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fb898011360 con 0x7fb8a40959e0 2023-09-30T22:22:13.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.898+0000 7fb8a9bba700 1 -- 172.21.15.40:0/2597723464 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a405a260 con 0x7fb8a40959e0 2023-09-30T22:22:13.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.899+0000 7f82e6068700 1 Processor -- start 2023-09-30T22:22:13.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.899+0000 7f82e6068700 1 -- start start 2023-09-30T22:22:13.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.900+0000 7f82e6068700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f82e0065990 0x7f82e0095fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:13.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.900+0000 7f82e6068700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f82e0099380 0x7f82e0136e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:13.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.900+0000 7f82e6068700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e0099b50 con 0x7f82e0098870 2023-09-30T22:22:13.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.900+0000 7f82e6068700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82e0065d70 con 0x7f82e0065990 2023-09-30T22:22:13.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.900+0000 7f82e6068700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82e00964a0 con 0x7f82e0099380 2023-09-30T22:22:13.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.904+0000 7f82df7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f82e0065990 0x7f82e0095fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:13.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.904+0000 7f82dffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f82e0099380 0x7f82e0136e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:13.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.904+0000 7f82df7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f82e0065990 0x7f82e0095fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47954/0 (socket says 172.21.15.40:47954) 2023-09-30T22:22:13.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.904+0000 7f82df7fe700 1 -- 172.21.15.40:0/696092037 learned_addr learned my addr 172.21.15.40:0/696092037 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:13.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.904+0000 7f82deffd700 1 --1- 172.21.15.40:0/696092037 >> v1:172.21.15.40:6789/0 conn(0x7f82e0098870 0x7f82e0098c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53232/0 (socket says 172.21.15.40:53232) 2023-09-30T22:22:13.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.904+0000 7f82df7fe700 1 -- 172.21.15.40:0/696092037 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f82e0099380 msgr2=0x7f82e0136e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:13.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.904+0000 7f82df7fe700 1 --2- 172.21.15.40:0/696092037 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f82e0099380 0x7f82e0136e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:13.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.904+0000 7f82df7fe700 1 -- 172.21.15.40:0/696092037 >> v1:172.21.15.40:6789/0 conn(0x7f82e0098870 legacy=0x7f82e0098c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:13.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.904+0000 7f82df7fe700 1 -- 172.21.15.40:0/696092037 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e00957d0 con 0x7f82e0065990 2023-09-30T22:22:13.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.904+0000 7f82de7fc700 1 -- 172.21.15.40:0/696092037 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 713758657 0 0) 0x7f82e0099b50 con 0x7f82e0098870 2023-09-30T22:22:13.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.904+0000 7f82dffff700 1 --2- 172.21.15.40:0/696092037 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f82e0099380 0x7f82e0136e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:13.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.905+0000 7f82df7fe700 1 --2- 172.21.15.40:0/696092037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82e0065990 0x7f82e0095fb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f82d0006fd0 tx=0x7f82d00090f0).ready entity=mon.0 client_cookie=29db036b2c0f6c29 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:13.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.905+0000 7f82de7fc700 1 -- 172.21.15.40:0/696092037 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d000b580 con 0x7f82e0065990 2023-09-30T22:22:13.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.905+0000 7f82de7fc700 1 -- 172.21.15.40:0/696092037 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d000b6e0 con 0x7f82e0065990 2023-09-30T22:22:13.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.905+0000 7f82de7fc700 1 -- 172.21.15.40:0/696092037 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d000ba60 con 0x7f82e0065990 2023-09-30T22:22:13.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.906+0000 7f82e6068700 1 -- 172.21.15.40:0/696092037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82e0065990 msgr2=0x7f82e0095fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:13.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.906+0000 7f82e6068700 1 --2- 172.21.15.40:0/696092037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82e0065990 0x7f82e0095fb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f82d0006fd0 tx=0x7f82d00090f0).stop 2023-09-30T22:22:13.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.906+0000 7f82e6068700 1 -- 172.21.15.40:0/696092037 shutdown_connections 2023-09-30T22:22:13.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.906+0000 7f82e6068700 1 --2- 172.21.15.40:0/696092037 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f82e0099380 0x7f82e0136e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:13.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.906+0000 7f82e6068700 1 --2- 172.21.15.40:0/696092037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82e0065990 0x7f82e0095fb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:13.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.906+0000 7f82e6068700 1 -- 172.21.15.40:0/696092037 >> 172.21.15.40:0/696092037 conn(0x7f82e009ab30 msgr2=0x7f82e009af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:13.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.906+0000 7f82e6068700 1 -- 172.21.15.40:0/696092037 shutdown_connections 2023-09-30T22:22:13.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.906+0000 7f82e6068700 1 -- 172.21.15.40:0/696092037 wait complete. 2023-09-30T22:22:13.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.907+0000 7f82e6068700 1 Processor -- start 2023-09-30T22:22:13.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.906+0000 7fb88b7fe700 1 -- 172.21.15.40:0/2597723464 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fb898017020 con 0x7fb8a40959e0 2023-09-30T22:22:13.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.907+0000 7f82e6068700 1 -- start start 2023-09-30T22:22:13.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.907+0000 7f82e6068700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82e0065990 0x7f82e013e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:13.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.907+0000 7f82e6068700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f82e0098870 0x7f82e013ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:13.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.907+0000 7f82e6068700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82e0099380 0x7f82e013f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:13.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.907+0000 7f82e6068700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e0122510 con 0x7f82e0099380 2023-09-30T22:22:13.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.907+0000 7f82e6068700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e0094e70 con 0x7f82e0065990 2023-09-30T22:22:13.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.907+0000 7f82e6068700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82e0094580 con 0x7f82e0098870 2023-09-30T22:22:13.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.907+0000 7f82deffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f82e0098870 0x7f82e013ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:13.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.907+0000 7f82deffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f82e0098870 0x7f82e013ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33450/0 (socket says 172.21.15.40:33450) 2023-09-30T22:22:13.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.908+0000 7f82deffd700 1 -- 172.21.15.40:0/679265149 learned_addr learned my addr 172.21.15.40:0/679265149 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:13.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.908+0000 7f82dffff700 1 --2- 172.21.15.40:0/679265149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82e0099380 0x7f82e013f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:13.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.908+0000 7f82df7fe700 1 --2- 172.21.15.40:0/679265149 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82e0065990 0x7f82e013e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:13.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.908+0000 7f82deffd700 1 -- 172.21.15.40:0/679265149 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82e0065990 msgr2=0x7f82e013e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:13.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.908+0000 7f82deffd700 1 --2- 172.21.15.40:0/679265149 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82e0065990 0x7f82e013e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:13.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.908+0000 7f82deffd700 1 -- 172.21.15.40:0/679265149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82e0099380 msgr2=0x7f82e013f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:13.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.908+0000 7f82deffd700 1 --2- 172.21.15.40:0/679265149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82e0099380 0x7f82e013f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:13.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.908+0000 7f82deffd700 1 -- 172.21.15.40:0/679265149 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d8009a20 con 0x7f82e0098870 2023-09-30T22:22:13.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.908+0000 7f82deffd700 1 --2- 172.21.15.40:0/679265149 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f82e0098870 0x7f82e013ec90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f82d400c5c0 tx=0x7f82d4007c90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:13.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.908+0000 7f82c77fe700 1 -- 172.21.15.40:0/679265149 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d40072e0 con 0x7f82e0098870 2023-09-30T22:22:13.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.908+0000 7f82c77fe700 1 -- 172.21.15.40:0/679265149 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d4007440 con 0x7f82e0098870 2023-09-30T22:22:13.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.908+0000 7f82c77fe700 1 -- 172.21.15.40:0/679265149 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d40058f0 con 0x7f82e0098870 2023-09-30T22:22:13.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.909+0000 7f82e6068700 1 -- 172.21.15.40:0/679265149 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d0009370 con 0x7f82e0098870 2023-09-30T22:22:13.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.909+0000 7f82e6068700 1 -- 172.21.15.40:0/679265149 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e0122d20 con 0x7f82e0098870 2023-09-30T22:22:13.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.910+0000 7f82e6068700 1 -- 172.21.15.40:0/679265149 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e005ec10 con 0x7f82e0098870 2023-09-30T22:22:13.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.910+0000 7f82c77fe700 1 -- 172.21.15.40:0/679265149 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f82d4005ce0 con 0x7f82e0098870 2023-09-30T22:22:13.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.911+0000 7f82c77fe700 1 -- 172.21.15.40:0/679265149 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f82d403ad70 con 0x7f82e0098870 2023-09-30T22:22:13.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.918+0000 7f82c77fe700 1 -- 172.21.15.40:0/679265149 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f82d401c760 con 0x7f82e0098870 2023-09-30T22:22:13.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.938+0000 7f3e2ac2c700 1 Processor -- start 2023-09-30T22:22:13.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.938+0000 7f3e2ac2c700 1 -- start start 2023-09-30T22:22:13.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.939+0000 7f3e2ac2c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e240967b0 0x7f3e24096b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:13.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.939+0000 7f3e2ac2c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3e24067190 0x7f3e24067590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:13.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.939+0000 7f3e2ac2c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e24069980 con 0x7f3e24067a80 2023-09-30T22:22:13.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.939+0000 7f3e2ac2c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e24092150 con 0x7f3e24067190 2023-09-30T22:22:13.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.939+0000 7f3e2ac2c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e24092340 con 0x7f3e240967b0 2023-09-30T22:22:13.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.939+0000 7f3e289c8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e240967b0 0x7f3e24096b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:13.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.939+0000 7f3e23fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3e24067190 0x7f3e24067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:13.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.939+0000 7f3e289c8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e240967b0 0x7f3e24096b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33456/0 (socket says 172.21.15.40:33456) 2023-09-30T22:22:13.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.939+0000 7f3e289c8700 1 -- 172.21.15.40:0/2863588190 learned_addr learned my addr 172.21.15.40:0/2863588190 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:13.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.939+0000 7f3e289c8700 1 -- 172.21.15.40:0/2863588190 >> v2:172.21.15.40:3300/0 conn(0x7f3e24067190 msgr2=0x7f3e24067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:13.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.939+0000 7f3e289c8700 1 --2- 172.21.15.40:0/2863588190 >> v2:172.21.15.40:3300/0 conn(0x7f3e24067190 0x7f3e24067590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:13.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.939+0000 7f3e289c8700 1 -- 172.21.15.40:0/2863588190 >> v1:172.21.15.40:6789/0 conn(0x7f3e24067a80 legacy=0x7f3e24136460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:13.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.939+0000 7f3e289c8700 1 -- 172.21.15.40:0/2863588190 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e24068770 con 0x7f3e240967b0 2023-09-30T22:22:13.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.940+0000 7f3e289c8700 1 --2- 172.21.15.40:0/2863588190 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e240967b0 0x7f3e24096b90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f3e18006fd0 tx=0x7f3e180090f0).ready entity=mon.2 client_cookie=2e3b8f7557a14b30 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:13.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.940+0000 7f3e237fe700 1 -- 172.21.15.40:0/2863588190 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1800b580 con 0x7f3e240967b0 2023-09-30T22:22:13.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.940+0000 7f3e237fe700 1 -- 172.21.15.40:0/2863588190 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1800b6e0 con 0x7f3e240967b0 2023-09-30T22:22:13.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.940+0000 7f3e237fe700 1 -- 172.21.15.40:0/2863588190 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1800ba60 con 0x7f3e240967b0 2023-09-30T22:22:13.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.941+0000 7f3e2ac2c700 1 -- 172.21.15.40:0/2863588190 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e240967b0 msgr2=0x7f3e24096b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:13.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.941+0000 7f3e2ac2c700 1 --2- 172.21.15.40:0/2863588190 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e240967b0 0x7f3e24096b90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f3e18006fd0 tx=0x7f3e180090f0).stop 2023-09-30T22:22:13.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.941+0000 7f3e2ac2c700 1 -- 172.21.15.40:0/2863588190 shutdown_connections 2023-09-30T22:22:13.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.941+0000 7f3e2ac2c700 1 --2- 172.21.15.40:0/2863588190 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e240967b0 0x7f3e24096b90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:13.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.941+0000 7f3e2ac2c700 1 --2- 172.21.15.40:0/2863588190 >> v2:172.21.15.40:3300/0 conn(0x7f3e24067190 0x7f3e24067590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:13.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.941+0000 7f3e2ac2c700 1 -- 172.21.15.40:0/2863588190 >> 172.21.15.40:0/2863588190 conn(0x7f3e2409a450 msgr2=0x7f3e2409a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:13.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.941+0000 7f3e2ac2c700 1 -- 172.21.15.40:0/2863588190 shutdown_connections 2023-09-30T22:22:13.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.941+0000 7f3e2ac2c700 1 -- 172.21.15.40:0/2863588190 wait complete. 2023-09-30T22:22:13.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.942+0000 7f3e2ac2c700 1 Processor -- start 2023-09-30T22:22:13.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.942+0000 7f3e2ac2c700 1 -- start start 2023-09-30T22:22:13.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.942+0000 7f3e2ac2c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e24067190 0x7f3e2411bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:13.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.942+0000 7f3e2ac2c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e24067a80 0x7f3e2411c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:13.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.942+0000 7f3e2ac2c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e240967b0 0x7f3e2411c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:13.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.942+0000 7f3e2ac2c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e24099d60 con 0x7f3e240967b0 2023-09-30T22:22:13.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.942+0000 7f3e2ac2c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e24069560 con 0x7f3e24067190 2023-09-30T22:22:13.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.942+0000 7f3e2ac2c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2411efd0 con 0x7f3e24067a80 2023-09-30T22:22:13.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.943+0000 7f3e291c9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e240967b0 0x7f3e2411c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:13.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.943+0000 7f3e291c9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e240967b0 0x7f3e2411c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47974/0 (socket says 172.21.15.40:47974) 2023-09-30T22:22:13.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.943+0000 7f3e291c9700 1 -- 172.21.15.40:0/773883360 learned_addr learned my addr 172.21.15.40:0/773883360 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:13.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.943+0000 7f3e23fff700 1 --2- 172.21.15.40:0/773883360 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e24067a80 0x7f3e2411c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:13.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.943+0000 7f3e289c8700 1 --2- 172.21.15.40:0/773883360 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e24067190 0x7f3e2411bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:13.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.943+0000 7f3e23fff700 1 -- 172.21.15.40:0/773883360 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e24067190 msgr2=0x7f3e2411bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:13.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.943+0000 7f3e23fff700 1 --2- 172.21.15.40:0/773883360 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e24067190 0x7f3e2411bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:13.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.943+0000 7f3e23fff700 1 -- 172.21.15.40:0/773883360 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e240967b0 msgr2=0x7f3e2411c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:13.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.943+0000 7f3e23fff700 1 --2- 172.21.15.40:0/773883360 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e240967b0 0x7f3e2411c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:13.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.943+0000 7f3e23fff700 1 -- 172.21.15.40:0/773883360 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e18009370 con 0x7f3e24067a80 2023-09-30T22:22:13.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.943+0000 7f3e23fff700 1 --2- 172.21.15.40:0/773883360 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e24067a80 0x7f3e2411c440 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f3e1000e900 tx=0x7f3e10009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:13.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.943+0000 7f3e20ff9700 1 -- 172.21.15.40:0/773883360 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e10009470 con 0x7f3e24067a80 2023-09-30T22:22:13.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.943+0000 7f3e20ff9700 1 -- 172.21.15.40:0/773883360 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e10012600 con 0x7f3e24067a80 2023-09-30T22:22:13.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.943+0000 7f3e20ff9700 1 -- 172.21.15.40:0/773883360 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e10012980 con 0x7f3e24067a80 2023-09-30T22:22:13.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.944+0000 7f3e2ac2c700 1 -- 172.21.15.40:0/773883360 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e2411bba0 con 0x7f3e24067a80 2023-09-30T22:22:13.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.944+0000 7f3e2ac2c700 1 -- 172.21.15.40:0/773883360 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e2411fb30 con 0x7f3e24067a80 2023-09-30T22:22:13.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.945+0000 7f3e2ac2c700 1 -- 172.21.15.40:0/773883360 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e2405a260 con 0x7f3e24067a80 2023-09-30T22:22:13.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.946+0000 7f3e20ff9700 1 -- 172.21.15.40:0/773883360 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f3e1001b400 con 0x7f3e24067a80 2023-09-30T22:22:13.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.946+0000 7f3e20ff9700 1 -- 172.21.15.40:0/773883360 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f3e1003b750 con 0x7f3e24067a80 2023-09-30T22:22:13.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:13.950+0000 7f3e20ff9700 1 -- 172.21.15.40:0/773883360 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f3e10011350 con 0x7f3e24067a80 2023-09-30T22:22:14.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.070+0000 7f29ebfc1700 1 -- 172.21.15.40:0/1270272037 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f29e4112770 con 0x7f29e4067b20 2023-09-30T22:22:14.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.071+0000 7f29d9ffb700 1 -- 172.21.15.40:0/1270272037 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f29e4112770 con 0x7f29e4067b20 2023-09-30T22:22:14.071 INFO:teuthology.orchestra.run.smithi040.stdout:38654705669 2023-09-30T22:22:14.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.073+0000 7f29ebfc1700 1 -- 172.21.15.40:0/1270272037 >> v1:172.21.15.40:6816/118905 conn(0x7f29c802bb90 legacy=0x7f29c802e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:14.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.073+0000 7f29ebfc1700 1 -- 172.21.15.40:0/1270272037 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29e4067b20 msgr2=0x7f29e4067f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:14.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.073+0000 7f29ebfc1700 1 --2- 172.21.15.40:0/1270272037 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29e4067b20 0x7f29e4067f60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f29dc0013d0 tx=0x7f29dc001530).stop 2023-09-30T22:22:14.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.073+0000 7f29ebfc1700 1 -- 172.21.15.40:0/1270272037 shutdown_connections 2023-09-30T22:22:14.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.073+0000 7f29ebfc1700 1 --2- 172.21.15.40:0/1270272037 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29e4067b20 0x7f29e4067f60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:14.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.073+0000 7f29ebfc1700 1 --2- 172.21.15.40:0/1270272037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29e405e090 0x7f29e4136290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:14.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.073+0000 7f29ebfc1700 1 --2- 172.21.15.40:0/1270272037 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f29e4093c10 0x7f29e4136780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:14.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.073+0000 7f29ebfc1700 1 -- 172.21.15.40:0/1270272037 >> 172.21.15.40:0/1270272037 conn(0x7f29e4097580 msgr2=0x7f29e4123350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:14.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.073+0000 7f29ebfc1700 1 -- 172.21.15.40:0/1270272037 shutdown_connections 2023-09-30T22:22:14.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.073+0000 7f29ebfc1700 1 -- 172.21.15.40:0/1270272037 wait complete. 2023-09-30T22:22:14.086 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.1 2023-09-30T22:22:14.086 DEBUG:teuthology.parallel:result is None 2023-09-30T22:22:14.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.089+0000 7f82e6068700 1 -- 172.21.15.40:0/679265149 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f82e0122d20 con 0x7f82e0098870 2023-09-30T22:22:14.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.090+0000 7f82c77fe700 1 -- 172.21.15.40:0/679265149 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f82e0122d20 con 0x7f82e0098870 2023-09-30T22:22:14.090 INFO:teuthology.orchestra.run.smithi040.stdout:38654705669 2023-09-30T22:22:14.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.091+0000 7f82e6068700 1 -- 172.21.15.40:0/679265149 >> v1:172.21.15.40:6816/118905 conn(0x7f82cc02bb60 legacy=0x7f82cc02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:14.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.092+0000 7f82e6068700 1 -- 172.21.15.40:0/679265149 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f82e0098870 msgr2=0x7f82e013ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:14.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.092+0000 7f82e6068700 1 --2- 172.21.15.40:0/679265149 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f82e0098870 0x7f82e013ec90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f82d400c5c0 tx=0x7f82d4007c90).stop 2023-09-30T22:22:14.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.092+0000 7f82e6068700 1 -- 172.21.15.40:0/679265149 shutdown_connections 2023-09-30T22:22:14.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.092+0000 7f82e6068700 1 --2- 172.21.15.40:0/679265149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82e0099380 0x7f82e013f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:14.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.092+0000 7f82e6068700 1 --2- 172.21.15.40:0/679265149 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82e0065990 0x7f82e013e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:14.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.092+0000 7f82e6068700 1 --2- 172.21.15.40:0/679265149 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f82e0098870 0x7f82e013ec90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:14.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.092+0000 7f82e6068700 1 -- 172.21.15.40:0/679265149 >> 172.21.15.40:0/679265149 conn(0x7f82e009ab30 msgr2=0x7f82e009bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:14.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.092+0000 7f82e6068700 1 -- 172.21.15.40:0/679265149 shutdown_connections 2023-09-30T22:22:14.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.092+0000 7f82e6068700 1 -- 172.21.15.40:0/679265149 wait complete. 2023-09-30T22:22:14.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.098+0000 7fb8a9bba700 1 -- 172.21.15.40:0/2597723464 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb8a4069b30 con 0x7fb8a40959e0 2023-09-30T22:22:14.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.098+0000 7fb88b7fe700 1 -- 172.21.15.40:0/2597723464 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb898017070 con 0x7fb8a40959e0 2023-09-30T22:22:14.098 INFO:teuthology.orchestra.run.smithi040.stdout:38654705669 2023-09-30T22:22:14.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.100+0000 7fb8a9bba700 1 -- 172.21.15.40:0/2597723464 >> v1:172.21.15.40:6816/118905 conn(0x7fb89002bb60 legacy=0x7fb89002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:14.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.100+0000 7fb8a9bba700 1 -- 172.21.15.40:0/2597723464 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb8a40959e0 msgr2=0x7fb8a41174a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:14.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.100+0000 7fb8a9bba700 1 --2- 172.21.15.40:0/2597723464 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb8a40959e0 0x7fb8a41174a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fb89800c5b0 tx=0x7fb898007d20).stop 2023-09-30T22:22:14.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.100+0000 7fb8a9bba700 1 -- 172.21.15.40:0/2597723464 shutdown_connections 2023-09-30T22:22:14.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.100+0000 7fb8a9bba700 1 --2- 172.21.15.40:0/2597723464 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8a412d310 0x7fb8a4117990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:14.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.100+0000 7fb8a9bba700 1 --2- 172.21.15.40:0/2597723464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8a40938f0 0x7fb8a4116fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:14.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.100+0000 7fb8a9bba700 1 --2- 172.21.15.40:0/2597723464 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb8a40959e0 0x7fb8a41174a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:14.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.100+0000 7fb8a9bba700 1 -- 172.21.15.40:0/2597723464 >> 172.21.15.40:0/2597723464 conn(0x7fb8a40975f0 msgr2=0x7fb8a4111170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:14.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.100+0000 7fb8a9bba700 1 -- 172.21.15.40:0/2597723464 shutdown_connections 2023-09-30T22:22:14.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.100+0000 7fb8a9bba700 1 -- 172.21.15.40:0/2597723464 wait complete. 2023-09-30T22:22:14.105 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.3 2023-09-30T22:22:14.105 DEBUG:teuthology.parallel:result is None 2023-09-30T22:22:14.112 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.2 2023-09-30T22:22:14.113 DEBUG:teuthology.parallel:result is None 2023-09-30T22:22:14.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.122+0000 7f3e2ac2c700 1 -- 172.21.15.40:0/773883360 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3e2411fb30 con 0x7f3e24067a80 2023-09-30T22:22:14.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.122+0000 7f3e20ff9700 1 -- 172.21.15.40:0/773883360 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3e2411fb30 con 0x7f3e24067a80 2023-09-30T22:22:14.122 INFO:teuthology.orchestra.run.smithi040.stdout:38654705669 2023-09-30T22:22:14.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.124+0000 7f3e2ac2c700 1 -- 172.21.15.40:0/773883360 >> v1:172.21.15.40:6816/118905 conn(0x7f3e0802bb60 legacy=0x7f3e0802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:14.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.124+0000 7f3e2ac2c700 1 -- 172.21.15.40:0/773883360 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e24067a80 msgr2=0x7f3e2411c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:14.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.124+0000 7f3e2ac2c700 1 --2- 172.21.15.40:0/773883360 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e24067a80 0x7f3e2411c440 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f3e1000e900 tx=0x7f3e10009060).stop 2023-09-30T22:22:14.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.124+0000 7f3e2ac2c700 1 -- 172.21.15.40:0/773883360 shutdown_connections 2023-09-30T22:22:14.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.124+0000 7f3e2ac2c700 1 --2- 172.21.15.40:0/773883360 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e240967b0 0x7f3e2411c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:14.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.124+0000 7f3e2ac2c700 1 --2- 172.21.15.40:0/773883360 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e24067190 0x7f3e2411bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:14.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.124+0000 7f3e2ac2c700 1 --2- 172.21.15.40:0/773883360 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e24067a80 0x7f3e2411c440 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:14.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.124+0000 7f3e2ac2c700 1 -- 172.21.15.40:0/773883360 >> 172.21.15.40:0/773883360 conn(0x7f3e2409a450 msgr2=0x7f3e24132600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:14.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.124+0000 7f3e2ac2c700 1 -- 172.21.15.40:0/773883360 shutdown_connections 2023-09-30T22:22:14.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.124+0000 7f3e2ac2c700 1 -- 172.21.15.40:0/773883360 wait complete. 2023-09-30T22:22:14.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.0 2023-09-30T22:22:14.136 DEBUG:teuthology.parallel:result is None 2023-09-30T22:22:14.136 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-30T22:22:14.137 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:22:14.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.296+0000 7fb7482c5700 1 Processor -- start 2023-09-30T22:22:14.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.296+0000 7fb7482c5700 1 -- start start 2023-09-30T22:22:14.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.297+0000 7fb7482c5700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb740062e60 0x7fb74012af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:14.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.297+0000 7fb7482c5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb740093250 0x7fb74012b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:14.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.297+0000 7fb7482c5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7400685f0 con 0x7fb74012b900 2023-09-30T22:22:14.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.297+0000 7fb7482c5700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7400671d0 con 0x7fb740062e60 2023-09-30T22:22:14.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.297+0000 7fb7482c5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb74012ad30 con 0x7fb740093250 2023-09-30T22:22:14.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.297+0000 7fb745860700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb740093250 0x7fb74012b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:14.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.297+0000 7fb746061700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb740062e60 0x7fb74012af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:14.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.297+0000 7fb745860700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb740093250 0x7fb74012b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:55170/0 (socket says 172.21.15.40:55170) 2023-09-30T22:22:14.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.297+0000 7fb746862700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb74012b900 0x7fb740091a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53254/0 (socket says 172.21.15.40:53254) 2023-09-30T22:22:14.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.297+0000 7fb745860700 1 -- 172.21.15.40:0/2477020862 learned_addr learned my addr 172.21.15.40:0/2477020862 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:14.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.297+0000 7fb746061700 1 -- 172.21.15.40:0/2477020862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb740093250 msgr2=0x7fb74012b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:14.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.297+0000 7fb746061700 1 --2- 172.21.15.40:0/2477020862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb740093250 0x7fb74012b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:14.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.297+0000 7fb746061700 1 -- 172.21.15.40:0/2477020862 >> v1:172.21.15.40:6789/0 conn(0x7fb74012b900 legacy=0x7fb740091a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:14.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.297+0000 7fb746061700 1 -- 172.21.15.40:0/2477020862 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7400676e0 con 0x7fb740062e60 2023-09-30T22:22:14.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.297+0000 7fb745860700 1 --2- 172.21.15.40:0/2477020862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb740093250 0x7fb74012b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:14.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.297+0000 7fb74505f700 1 -- 172.21.15.40:0/2477020862 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4105570983 0 0) 0x7fb7400685f0 con 0x7fb74012b900 2023-09-30T22:22:14.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.298+0000 7fb746061700 1 --2- 172.21.15.40:0/2477020862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb740062e60 0x7fb74012af20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fb73c009760 tx=0x7fb73c009060).ready entity=mon.0 client_cookie=27cbf0afdd1e0d59 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:14.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.298+0000 7fb74505f700 1 -- 172.21.15.40:0/2477020862 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c00f510 con 0x7fb740062e60 2023-09-30T22:22:14.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.298+0000 7fb74505f700 1 -- 172.21.15.40:0/2477020862 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73c00f670 con 0x7fb740062e60 2023-09-30T22:22:14.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.298+0000 7fb74505f700 1 -- 172.21.15.40:0/2477020862 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c00f9f0 con 0x7fb740062e60 2023-09-30T22:22:14.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.298+0000 7fb7482c5700 1 -- 172.21.15.40:0/2477020862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb740062e60 msgr2=0x7fb74012af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:14.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.298+0000 7fb7482c5700 1 --2- 172.21.15.40:0/2477020862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb740062e60 0x7fb74012af20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fb73c009760 tx=0x7fb73c009060).stop 2023-09-30T22:22:14.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.298+0000 7fb7482c5700 1 -- 172.21.15.40:0/2477020862 shutdown_connections 2023-09-30T22:22:14.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.298+0000 7fb7482c5700 1 --2- 172.21.15.40:0/2477020862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb740062e60 0x7fb74012af20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:14.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.298+0000 7fb7482c5700 1 --2- 172.21.15.40:0/2477020862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb740093250 0x7fb74012b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:14.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.298+0000 7fb7482c5700 1 -- 172.21.15.40:0/2477020862 >> 172.21.15.40:0/2477020862 conn(0x7fb74009a450 msgr2=0x7fb74009a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:14.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.298+0000 7fb7482c5700 1 -- 172.21.15.40:0/2477020862 shutdown_connections 2023-09-30T22:22:14.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.298+0000 7fb7482c5700 1 -- 172.21.15.40:0/2477020862 wait complete. 2023-09-30T22:22:14.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.300+0000 7fb7482c5700 1 Processor -- start 2023-09-30T22:22:14.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.300+0000 7fb7482c5700 1 -- start start 2023-09-30T22:22:14.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.300+0000 7fb7482c5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb740062e60 0x7fb74013a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:14.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.300+0000 7fb7482c5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb740093250 0x7fb74013aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:14.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.300+0000 7fb7482c5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb74012b900 0x7fb740116e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:14.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.300+0000 7fb7482c5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74012e310 con 0x7fb740093250 2023-09-30T22:22:14.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.300+0000 7fb7482c5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb740098960 con 0x7fb740062e60 2023-09-30T22:22:14.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.300+0000 7fb7482c5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb740067340 con 0x7fb74012b900 2023-09-30T22:22:14.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.300+0000 7fb746061700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb740062e60 0x7fb74013a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:14.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.300+0000 7fb746061700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb740062e60 0x7fb74013a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:55172/0 (socket says 172.21.15.40:55172) 2023-09-30T22:22:14.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.300+0000 7fb746061700 1 -- 172.21.15.40:0/2536713141 learned_addr learned my addr 172.21.15.40:0/2536713141 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:14.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.300+0000 7fb745860700 1 --2- 172.21.15.40:0/2536713141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb740093250 0x7fb74013aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:14.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.300+0000 7fb746862700 1 --2- 172.21.15.40:0/2536713141 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb74012b900 0x7fb740116e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:14.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.301+0000 7fb746061700 1 -- 172.21.15.40:0/2536713141 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb74012b900 msgr2=0x7fb740116e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:14.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.301+0000 7fb746061700 1 --2- 172.21.15.40:0/2536713141 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb74012b900 0x7fb740116e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:14.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.301+0000 7fb746061700 1 -- 172.21.15.40:0/2536713141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb740093250 msgr2=0x7fb74013aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:14.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.301+0000 7fb746061700 1 --2- 172.21.15.40:0/2536713141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb740093250 0x7fb74013aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:14.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.301+0000 7fb746061700 1 -- 172.21.15.40:0/2536713141 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb730009370 con 0x7fb740062e60 2023-09-30T22:22:14.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.301+0000 7fb745860700 1 --2- 172.21.15.40:0/2536713141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb740093250 0x7fb74013aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:14.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.301+0000 7fb746061700 1 --2- 172.21.15.40:0/2536713141 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb740062e60 0x7fb74013a560 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fb73c009e00 tx=0x7fb73c017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:14.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.301+0000 7fb7367fc700 1 -- 172.21.15.40:0/2536713141 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c00f7e0 con 0x7fb740062e60 2023-09-30T22:22:14.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.301+0000 7fb7367fc700 1 -- 172.21.15.40:0/2536713141 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73c00f940 con 0x7fb740062e60 2023-09-30T22:22:14.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.301+0000 7fb7482c5700 1 -- 172.21.15.40:0/2536713141 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb73c0092a0 con 0x7fb740062e60 2023-09-30T22:22:14.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.301+0000 7fb7367fc700 1 -- 172.21.15.40:0/2536713141 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c01b660 con 0x7fb740062e60 2023-09-30T22:22:14.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.301+0000 7fb7482c5700 1 -- 172.21.15.40:0/2536713141 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb74011afa0 con 0x7fb740062e60 2023-09-30T22:22:14.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.302+0000 7fb7367fc700 1 -- 172.21.15.40:0/2536713141 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb73c01ba50 con 0x7fb740062e60 2023-09-30T22:22:14.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.302+0000 7fb7367fc700 1 -- 172.21.15.40:0/2536713141 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fb73c03c8c0 con 0x7fb740062e60 2023-09-30T22:22:14.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.302+0000 7fb7482c5700 1 -- 172.21.15.40:0/2536713141 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb74005a260 con 0x7fb740062e60 2023-09-30T22:22:14.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.306+0000 7fb7367fc700 1 -- 172.21.15.40:0/2536713141 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fb73c028070 con 0x7fb740062e60 2023-09-30T22:22:14.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.474+0000 7fb7482c5700 1 -- 172.21.15.40:0/2536713141 --> v1:172.21.15.40:6816/118905 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb74011a540 con 0x7fb72402bb90 2023-09-30T22:22:14.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.480+0000 7fb7367fc700 1 -- 172.21.15.40:0/2536713141 <== mgr.4101 v1:172.21.15.40:6816/118905 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249955 (unknown 2965378022 0 1401954706) 0x7fb730009ce0 con 0x7fb72402bb90 2023-09-30T22:22:14.486 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:22:14.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.483+0000 7fb7482c5700 1 -- 172.21.15.40:0/2536713141 >> v1:172.21.15.40:6816/118905 conn(0x7fb72402bb90 legacy=0x7fb72402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:14.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.483+0000 7fb7482c5700 1 -- 172.21.15.40:0/2536713141 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb740062e60 msgr2=0x7fb74013a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:14.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.483+0000 7fb7482c5700 1 --2- 172.21.15.40:0/2536713141 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb740062e60 0x7fb74013a560 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fb73c009e00 tx=0x7fb73c017000).stop 2023-09-30T22:22:14.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.483+0000 7fb7482c5700 1 -- 172.21.15.40:0/2536713141 shutdown_connections 2023-09-30T22:22:14.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.483+0000 7fb7482c5700 1 --2- 172.21.15.40:0/2536713141 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb74012b900 0x7fb740116e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:14.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.483+0000 7fb7482c5700 1 --2- 172.21.15.40:0/2536713141 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb740062e60 0x7fb74013a560 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:14.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.483+0000 7fb7482c5700 1 --2- 172.21.15.40:0/2536713141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb740093250 0x7fb74013aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:14.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.483+0000 7fb7482c5700 1 -- 172.21.15.40:0/2536713141 >> 172.21.15.40:0/2536713141 conn(0x7fb74009a450 msgr2=0x7fb740068820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:14.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.483+0000 7fb7482c5700 1 -- 172.21.15.40:0/2536713141 shutdown_connections 2023-09-30T22:22:14.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.483+0000 7fb7482c5700 1 -- 172.21.15.40:0/2536713141 wait complete. 2023-09-30T22:22:14.491 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-09-30T22:22:14.496 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-09-30T22:22:13.777155+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189020,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298340,"statfs":{"total":386547056640,"available":385329500160,"internally_reserved":0,"allocated":651264,"data_stored":192439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1640,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001820"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385416+0000","last_change":"2023-09-30T22:22:02.384090+0000","last_active":"2023-09-30T22:22:02.385416+0000","last_peered":"2023-09-30T22:22:02.385416+0000","last_clean":"2023-09-30T22:22:02.385416+0000","last_became_active":"2023-09-30T22:22:02.383805+0000","last_became_peered":"2023-09-30T22:22:02.383805+0000","last_unstale":"2023-09-30T22:22:02.385416+0000","last_undegraded":"2023-09-30T22:22:02.385416+0000","last_fullsized":"2023-09-30T22:22:02.385416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380743+0000","last_change":"2023-09-30T22:22:02.377806+0000","last_active":"2023-09-30T22:22:02.380743+0000","last_peered":"2023-09-30T22:22:02.380743+0000","last_clean":"2023-09-30T22:22:02.380743+0000","last_became_active":"2023-09-30T22:22:02.377531+0000","last_became_peered":"2023-09-30T22:22:02.377531+0000","last_unstale":"2023-09-30T22:22:02.380743+0000","last_undegraded":"2023-09-30T22:22:02.380743+0000","last_fullsized":"2023-09-30T22:22:02.380743+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385151+0000","last_change":"2023-09-30T22:22:02.379022+0000","last_active":"2023-09-30T22:22:02.385151+0000","last_peered":"2023-09-30T22:22:02.385151+0000","last_clean":"2023-09-30T22:22:02.385151+0000","last_became_active":"2023-09-30T22:22:02.378723+0000","last_became_peered":"2023-09-30T22:22:02.378723+0000","last_unstale":"2023-09-30T22:22:02.385151+0000","last_undegraded":"2023-09-30T22:22:02.385151+0000","last_fullsized":"2023-09-30T22:22:02.385151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385016+0000","last_change":"2023-09-30T22:22:02.378089+0000","last_active":"2023-09-30T22:22:02.385016+0000","last_peered":"2023-09-30T22:22:02.385016+0000","last_clean":"2023-09-30T22:22:02.385016+0000","last_became_active":"2023-09-30T22:22:02.375446+0000","last_became_peered":"2023-09-30T22:22:02.375446+0000","last_unstale":"2023-09-30T22:22:02.385016+0000","last_undegraded":"2023-09-30T22:22:02.385016+0000","last_fullsized":"2023-09-30T22:22:02.385016+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.402864+0000","last_change":"2023-09-30T22:22:02.398073+0000","last_active":"2023-09-30T22:22:02.402864+0000","last_peered":"2023-09-30T22:22:02.402864+0000","last_clean":"2023-09-30T22:22:02.402864+0000","last_became_active":"2023-09-30T22:22:02.397855+0000","last_became_peered":"2023-09-30T22:22:02.397855+0000","last_unstale":"2023-09-30T22:22:02.402864+0000","last_undegraded":"2023-09-30T22:22:02.402864+0000","last_fullsized":"2023-09-30T22:22:02.402864+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385189+0000","last_change":"2023-09-30T22:22:02.382862+0000","last_active":"2023-09-30T22:22:02.385189+0000","last_peered":"2023-09-30T22:22:02.385189+0000","last_clean":"2023-09-30T22:22:02.385189+0000","last_became_active":"2023-09-30T22:22:02.382464+0000","last_became_peered":"2023-09-30T22:22:02.382464+0000","last_unstale":"2023-09-30T22:22:02.385189+0000","last_undegraded":"2023-09-30T22:22:02.385189+0000","last_fullsized":"2023-09-30T22:22:02.385189+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.399117+0000","last_change":"2023-09-30T22:22:02.395909+0000","last_active":"2023-09-30T22:22:02.399117+0000","last_peered":"2023-09-30T22:22:02.399117+0000","last_clean":"2023-09-30T22:22:02.399117+0000","last_became_active":"2023-09-30T22:22:02.395379+0000","last_became_peered":"2023-09-30T22:22:02.395379+0000","last_unstale":"2023-09-30T22:22:02.399117+0000","last_undegraded":"2023-09-30T22:22:02.399117+0000","last_fullsized":"2023-09-30T22:22:02.399117+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393512+0000","last_change":"2023-09-30T22:22:02.382627+0000","last_active":"2023-09-30T22:22:02.393512+0000","last_peered":"2023-09-30T22:22:02.393512+0000","last_clean":"2023-09-30T22:22:02.393512+0000","last_became_active":"2023-09-30T22:22:02.382360+0000","last_became_peered":"2023-09-30T22:22:02.382360+0000","last_unstale":"2023-09-30T22:22:02.393512+0000","last_undegraded":"2023-09-30T22:22:02.393512+0000","last_fullsized":"2023-09-30T22:22:02.393512+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394788+0000","last_change":"2023-09-30T22:22:02.388864+0000","last_active":"2023-09-30T22:22:02.394788+0000","last_peered":"2023-09-30T22:22:02.394788+0000","last_clean":"2023-09-30T22:22:02.394788+0000","last_became_active":"2023-09-30T22:22:02.388267+0000","last_became_peered":"2023-09-30T22:22:02.388267+0000","last_unstale":"2023-09-30T22:22:02.394788+0000","last_undegraded":"2023-09-30T22:22:02.394788+0000","last_fullsized":"2023-09-30T22:22:02.394788+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380523+0000","last_change":"2023-09-30T22:22:02.379619+0000","last_active":"2023-09-30T22:22:02.380523+0000","last_peered":"2023-09-30T22:22:02.380523+0000","last_clean":"2023-09-30T22:22:02.380523+0000","last_became_active":"2023-09-30T22:22:02.379412+0000","last_became_peered":"2023-09-30T22:22:02.379412+0000","last_unstale":"2023-09-30T22:22:02.380523+0000","last_undegraded":"2023-09-30T22:22:02.380523+0000","last_fullsized":"2023-09-30T22:22:02.380523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.377473+0000","last_change":"2023-09-30T22:22:02.372757+0000","last_active":"2023-09-30T22:22:02.377473+0000","last_peered":"2023-09-30T22:22:02.377473+0000","last_clean":"2023-09-30T22:22:02.377473+0000","last_became_active":"2023-09-30T22:22:02.372495+0000","last_became_peered":"2023-09-30T22:22:02.372495+0000","last_unstale":"2023-09-30T22:22:02.377473+0000","last_undegraded":"2023-09-30T22:22:02.377473+0000","last_fullsized":"2023-09-30T22:22:02.377473+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380876+0000","last_change":"2023-09-30T22:22:02.379525+0000","last_active":"2023-09-30T22:22:02.380876+0000","last_peered":"2023-09-30T22:22:02.380876+0000","last_clean":"2023-09-30T22:22:02.380876+0000","last_became_active":"2023-09-30T22:22:02.379330+0000","last_became_peered":"2023-09-30T22:22:02.379330+0000","last_unstale":"2023-09-30T22:22:02.380876+0000","last_undegraded":"2023-09-30T22:22:02.380876+0000","last_fullsized":"2023-09-30T22:22:02.380876+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393834+0000","last_change":"2023-09-30T22:22:02.387803+0000","last_active":"2023-09-30T22:22:02.393834+0000","last_peered":"2023-09-30T22:22:02.393834+0000","last_clean":"2023-09-30T22:22:02.393834+0000","last_became_active":"2023-09-30T22:22:02.387560+0000","last_became_peered":"2023-09-30T22:22:02.387560+0000","last_unstale":"2023-09-30T22:22:02.393834+0000","last_undegraded":"2023-09-30T22:22:02.393834+0000","last_fullsized":"2023-09-30T22:22:02.393834+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380478+0000","last_change":"2023-09-30T22:22:02.374488+0000","last_active":"2023-09-30T22:22:02.380478+0000","last_peered":"2023-09-30T22:22:02.380478+0000","last_clean":"2023-09-30T22:22:02.380478+0000","last_became_active":"2023-09-30T22:22:02.374287+0000","last_became_peered":"2023-09-30T22:22:02.374287+0000","last_unstale":"2023-09-30T22:22:02.380478+0000","last_undegraded":"2023-09-30T22:22:02.380478+0000","last_fullsized":"2023-09-30T22:22:02.380478+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.384882+0000","last_change":"2023-09-30T22:22:02.375916+0000","last_active":"2023-09-30T22:22:02.384882+0000","last_peered":"2023-09-30T22:22:02.384882+0000","last_clean":"2023-09-30T22:22:02.384882+0000","last_became_active":"2023-09-30T22:22:02.374277+0000","last_became_peered":"2023-09-30T22:22:02.374277+0000","last_unstale":"2023-09-30T22:22:02.384882+0000","last_undegraded":"2023-09-30T22:22:02.384882+0000","last_fullsized":"2023-09-30T22:22:02.384882+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.399057+0000","last_change":"2023-09-30T22:22:02.395769+0000","last_active":"2023-09-30T22:22:02.399057+0000","last_peered":"2023-09-30T22:22:02.399057+0000","last_clean":"2023-09-30T22:22:02.399057+0000","last_became_active":"2023-09-30T22:22:02.395459+0000","last_became_peered":"2023-09-30T22:22:02.395459+0000","last_unstale":"2023-09-30T22:22:02.399057+0000","last_undegraded":"2023-09-30T22:22:02.399057+0000","last_fullsized":"2023-09-30T22:22:02.399057+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.395070+0000","last_change":"2023-09-30T22:22:02.391303+0000","last_active":"2023-09-30T22:22:02.395070+0000","last_peered":"2023-09-30T22:22:02.395070+0000","last_clean":"2023-09-30T22:22:02.395070+0000","last_became_active":"2023-09-30T22:22:02.388602+0000","last_became_peered":"2023-09-30T22:22:02.388602+0000","last_unstale":"2023-09-30T22:22:02.395070+0000","last_undegraded":"2023-09-30T22:22:02.395070+0000","last_fullsized":"2023-09-30T22:22:02.395070+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385063+0000","last_change":"2023-09-30T22:22:02.376471+0000","last_active":"2023-09-30T22:22:02.385063+0000","last_peered":"2023-09-30T22:22:02.385063+0000","last_clean":"2023-09-30T22:22:02.385063+0000","last_became_active":"2023-09-30T22:22:02.374833+0000","last_became_peered":"2023-09-30T22:22:02.374833+0000","last_unstale":"2023-09-30T22:22:02.385063+0000","last_undegraded":"2023-09-30T22:22:02.385063+0000","last_fullsized":"2023-09-30T22:22:02.385063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385397+0000","last_change":"2023-09-30T22:22:02.383103+0000","last_active":"2023-09-30T22:22:02.385397+0000","last_peered":"2023-09-30T22:22:02.385397+0000","last_clean":"2023-09-30T22:22:02.385397+0000","last_became_active":"2023-09-30T22:22:02.382818+0000","last_became_peered":"2023-09-30T22:22:02.382818+0000","last_unstale":"2023-09-30T22:22:02.385397+0000","last_undegraded":"2023-09-30T22:22:02.385397+0000","last_fullsized":"2023-09-30T22:22:02.385397+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394501+0000","last_change":"2023-09-30T22:22:02.388315+0000","last_active":"2023-09-30T22:22:02.394501+0000","last_peered":"2023-09-30T22:22:02.394501+0000","last_clean":"2023-09-30T22:22:02.394501+0000","last_became_active":"2023-09-30T22:22:02.388046+0000","last_became_peered":"2023-09-30T22:22:02.388046+0000","last_unstale":"2023-09-30T22:22:02.394501+0000","last_undegraded":"2023-09-30T22:22:02.394501+0000","last_fullsized":"2023-09-30T22:22:02.394501+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.395152+0000","last_change":"2023-09-30T22:22:02.391309+0000","last_active":"2023-09-30T22:22:02.395152+0000","last_peered":"2023-09-30T22:22:02.395152+0000","last_clean":"2023-09-30T22:22:02.395152+0000","last_became_active":"2023-09-30T22:22:02.391040+0000","last_became_peered":"2023-09-30T22:22:02.391040+0000","last_unstale":"2023-09-30T22:22:02.395152+0000","last_undegraded":"2023-09-30T22:22:02.395152+0000","last_fullsized":"2023-09-30T22:22:02.395152+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.384855+0000","last_change":"2023-09-30T22:22:02.375857+0000","last_active":"2023-09-30T22:22:02.384855+0000","last_peered":"2023-09-30T22:22:02.384855+0000","last_clean":"2023-09-30T22:22:02.384855+0000","last_became_active":"2023-09-30T22:22:02.373866+0000","last_became_peered":"2023-09-30T22:22:02.373866+0000","last_unstale":"2023-09-30T22:22:02.384855+0000","last_undegraded":"2023-09-30T22:22:02.384855+0000","last_fullsized":"2023-09-30T22:22:02.384855+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.399093+0000","last_change":"2023-09-30T22:22:02.395696+0000","last_active":"2023-09-30T22:22:02.399093+0000","last_peered":"2023-09-30T22:22:02.399093+0000","last_clean":"2023-09-30T22:22:02.399093+0000","last_became_active":"2023-09-30T22:22:02.395318+0000","last_became_peered":"2023-09-30T22:22:02.395318+0000","last_unstale":"2023-09-30T22:22:02.399093+0000","last_undegraded":"2023-09-30T22:22:02.399093+0000","last_fullsized":"2023-09-30T22:22:02.399093+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394655+0000","last_change":"2023-09-30T22:22:02.389818+0000","last_active":"2023-09-30T22:22:02.394655+0000","last_peered":"2023-09-30T22:22:02.394655+0000","last_clean":"2023-09-30T22:22:02.394655+0000","last_became_active":"2023-09-30T22:22:02.389526+0000","last_became_peered":"2023-09-30T22:22:02.389526+0000","last_unstale":"2023-09-30T22:22:02.394655+0000","last_undegraded":"2023-09-30T22:22:02.394655+0000","last_fullsized":"2023-09-30T22:22:02.394655+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394419+0000","last_change":"2023-09-30T22:22:02.386166+0000","last_active":"2023-09-30T22:22:02.394419+0000","last_peered":"2023-09-30T22:22:02.394419+0000","last_clean":"2023-09-30T22:22:02.394419+0000","last_became_active":"2023-09-30T22:22:02.385731+0000","last_became_peered":"2023-09-30T22:22:02.385731+0000","last_unstale":"2023-09-30T22:22:02.394419+0000","last_undegraded":"2023-09-30T22:22:02.394419+0000","last_fullsized":"2023-09-30T22:22:02.394419+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380502+0000","last_change":"2023-09-30T22:22:02.374713+0000","last_active":"2023-09-30T22:22:02.380502+0000","last_peered":"2023-09-30T22:22:02.380502+0000","last_clean":"2023-09-30T22:22:02.380502+0000","last_became_active":"2023-09-30T22:22:02.374467+0000","last_became_peered":"2023-09-30T22:22:02.374467+0000","last_unstale":"2023-09-30T22:22:02.380502+0000","last_undegraded":"2023-09-30T22:22:02.380502+0000","last_fullsized":"2023-09-30T22:22:02.380502+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.399018+0000","last_change":"2023-09-30T22:22:02.395766+0000","last_active":"2023-09-30T22:22:02.399018+0000","last_peered":"2023-09-30T22:22:02.399018+0000","last_clean":"2023-09-30T22:22:02.399018+0000","last_became_active":"2023-09-30T22:22:02.395487+0000","last_became_peered":"2023-09-30T22:22:02.395487+0000","last_unstale":"2023-09-30T22:22:02.399018+0000","last_undegraded":"2023-09-30T22:22:02.399018+0000","last_fullsized":"2023-09-30T22:22:02.399018+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.374558+0000","last_change":"2023-09-30T22:22:01.986896+0000","last_active":"2023-09-30T22:22:02.374558+0000","last_peered":"2023-09-30T22:22:02.374558+0000","last_clean":"2023-09-30T22:22:02.374558+0000","last_became_active":"2023-09-30T22:22:01.986600+0000","last_became_peered":"2023-09-30T22:22:01.986600+0000","last_unstale":"2023-09-30T22:22:02.374558+0000","last_undegraded":"2023-09-30T22:22:02.374558+0000","last_fullsized":"2023-09-30T22:22:02.374558+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.388602+0000","last_change":"2023-09-30T22:22:02.380769+0000","last_active":"2023-09-30T22:22:02.388602+0000","last_peered":"2023-09-30T22:22:02.388602+0000","last_clean":"2023-09-30T22:22:02.388602+0000","last_became_active":"2023-09-30T22:22:02.380403+0000","last_became_peered":"2023-09-30T22:22:02.380403+0000","last_unstale":"2023-09-30T22:22:02.388602+0000","last_undegraded":"2023-09-30T22:22:02.388602+0000","last_fullsized":"2023-09-30T22:22:02.388602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.361691+0000","last_change":"2023-09-30T22:22:01.992230+0000","last_active":"2023-09-30T22:22:02.361691+0000","last_peered":"2023-09-30T22:22:02.361691+0000","last_clean":"2023-09-30T22:22:02.361691+0000","last_became_active":"2023-09-30T22:22:01.991929+0000","last_became_peered":"2023-09-30T22:22:01.991929+0000","last_unstale":"2023-09-30T22:22:02.361691+0000","last_undegraded":"2023-09-30T22:22:02.361691+0000","last_fullsized":"2023-09-30T22:22:02.361691+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385127+0000","last_change":"2023-09-30T22:22:02.380249+0000","last_active":"2023-09-30T22:22:02.385127+0000","last_peered":"2023-09-30T22:22:02.385127+0000","last_clean":"2023-09-30T22:22:02.385127+0000","last_became_active":"2023-09-30T22:22:02.379830+0000","last_became_peered":"2023-09-30T22:22:02.379830+0000","last_unstale":"2023-09-30T22:22:02.385127+0000","last_undegraded":"2023-09-30T22:22:02.385127+0000","last_fullsized":"2023-09-30T22:22:02.385127+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.358776+0000","last_change":"2023-09-30T22:22:01.995093+0000","last_active":"2023-09-30T22:22:02.358776+0000","last_peered":"2023-09-30T22:22:02.358776+0000","last_clean":"2023-09-30T22:22:02.358776+0000","last_became_active":"2023-09-30T22:22:01.994797+0000","last_became_peered":"2023-09-30T22:22:01.994797+0000","last_unstale":"2023-09-30T22:22:02.358776+0000","last_undegraded":"2023-09-30T22:22:02.358776+0000","last_fullsized":"2023-09-30T22:22:02.358776+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394410+0000","last_change":"2023-09-30T22:22:02.383534+0000","last_active":"2023-09-30T22:22:02.394410+0000","last_peered":"2023-09-30T22:22:02.394410+0000","last_clean":"2023-09-30T22:22:02.394410+0000","last_became_active":"2023-09-30T22:22:02.383271+0000","last_became_peered":"2023-09-30T22:22:02.383271+0000","last_unstale":"2023-09-30T22:22:02.394410+0000","last_undegraded":"2023-09-30T22:22:02.394410+0000","last_fullsized":"2023-09-30T22:22:02.394410+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.364409+0000","last_change":"2023-09-30T22:22:01.997405+0000","last_active":"2023-09-30T22:22:02.364409+0000","last_peered":"2023-09-30T22:22:02.364409+0000","last_clean":"2023-09-30T22:22:02.364409+0000","last_became_active":"2023-09-30T22:22:01.997079+0000","last_became_peered":"2023-09-30T22:22:01.997079+0000","last_unstale":"2023-09-30T22:22:02.364409+0000","last_undegraded":"2023-09-30T22:22:02.364409+0000","last_fullsized":"2023-09-30T22:22:02.364409+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.384947+0000","last_change":"2023-09-30T22:22:02.381424+0000","last_active":"2023-09-30T22:22:02.384947+0000","last_peered":"2023-09-30T22:22:02.384947+0000","last_clean":"2023-09-30T22:22:02.384947+0000","last_became_active":"2023-09-30T22:22:02.380981+0000","last_became_peered":"2023-09-30T22:22:02.380981+0000","last_unstale":"2023-09-30T22:22:02.384947+0000","last_undegraded":"2023-09-30T22:22:02.384947+0000","last_fullsized":"2023-09-30T22:22:02.384947+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.368614+0000","last_change":"2023-09-30T22:22:01.995183+0000","last_active":"2023-09-30T22:22:02.368614+0000","last_peered":"2023-09-30T22:22:02.368614+0000","last_clean":"2023-09-30T22:22:02.368614+0000","last_became_active":"2023-09-30T22:22:01.994920+0000","last_became_peered":"2023-09-30T22:22:01.994920+0000","last_unstale":"2023-09-30T22:22:02.368614+0000","last_undegraded":"2023-09-30T22:22:02.368614+0000","last_fullsized":"2023-09-30T22:22:02.368614+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.399138+0000","last_change":"2023-09-30T22:22:02.395975+0000","last_active":"2023-09-30T22:22:02.399138+0000","last_peered":"2023-09-30T22:22:02.399138+0000","last_clean":"2023-09-30T22:22:02.399138+0000","last_became_active":"2023-09-30T22:22:02.395719+0000","last_became_peered":"2023-09-30T22:22:02.395719+0000","last_unstale":"2023-09-30T22:22:02.399138+0000","last_undegraded":"2023-09-30T22:22:02.399138+0000","last_fullsized":"2023-09-30T22:22:02.399138+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.398556+0000","last_change":"2023-09-30T22:22:01.998235+0000","last_active":"2023-09-30T22:22:02.398556+0000","last_peered":"2023-09-30T22:22:02.398556+0000","last_clean":"2023-09-30T22:22:02.398556+0000","last_became_active":"2023-09-30T22:22:01.997649+0000","last_became_peered":"2023-09-30T22:22:01.997649+0000","last_unstale":"2023-09-30T22:22:02.398556+0000","last_undegraded":"2023-09-30T22:22:02.398556+0000","last_fullsized":"2023-09-30T22:22:02.398556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394877+0000","last_change":"2023-09-30T22:22:02.390318+0000","last_active":"2023-09-30T22:22:02.394877+0000","last_peered":"2023-09-30T22:22:02.394877+0000","last_clean":"2023-09-30T22:22:02.394877+0000","last_became_active":"2023-09-30T22:22:02.390020+0000","last_became_peered":"2023-09-30T22:22:02.390020+0000","last_unstale":"2023-09-30T22:22:02.394877+0000","last_undegraded":"2023-09-30T22:22:02.394877+0000","last_fullsized":"2023-09-30T22:22:02.394877+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"16'6","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.404225+0000","last_change":"2023-09-30T22:22:01.993933+0000","last_active":"2023-09-30T22:22:02.404225+0000","last_peered":"2023-09-30T22:22:02.404225+0000","last_clean":"2023-09-30T22:22:02.404225+0000","last_became_active":"2023-09-30T22:22:01.993574+0000","last_became_peered":"2023-09-30T22:22:01.993574+0000","last_unstale":"2023-09-30T22:22:02.404225+0000","last_undegraded":"2023-09-30T22:22:02.404225+0000","last_fullsized":"2023-09-30T22:22:02.404225+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393799+0000","last_change":"2023-09-30T22:22:02.387576+0000","last_active":"2023-09-30T22:22:02.393799+0000","last_peered":"2023-09-30T22:22:02.393799+0000","last_clean":"2023-09-30T22:22:02.393799+0000","last_became_active":"2023-09-30T22:22:02.387235+0000","last_became_peered":"2023-09-30T22:22:02.387235+0000","last_unstale":"2023-09-30T22:22:02.393799+0000","last_undegraded":"2023-09-30T22:22:02.393799+0000","last_fullsized":"2023-09-30T22:22:02.393799+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.397834+0000","last_change":"2023-09-30T22:22:01.995522+0000","last_active":"2023-09-30T22:22:02.397834+0000","last_peered":"2023-09-30T22:22:02.397834+0000","last_clean":"2023-09-30T22:22:02.397834+0000","last_became_active":"2023-09-30T22:22:01.994928+0000","last_became_peered":"2023-09-30T22:22:01.994928+0000","last_unstale":"2023-09-30T22:22:02.397834+0000","last_undegraded":"2023-09-30T22:22:02.397834+0000","last_fullsized":"2023-09-30T22:22:02.397834+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394448+0000","last_change":"2023-09-30T22:22:02.383942+0000","last_active":"2023-09-30T22:22:02.394448+0000","last_peered":"2023-09-30T22:22:02.394448+0000","last_clean":"2023-09-30T22:22:02.394448+0000","last_became_active":"2023-09-30T22:22:02.383663+0000","last_became_peered":"2023-09-30T22:22:02.383663+0000","last_unstale":"2023-09-30T22:22:02.394448+0000","last_undegraded":"2023-09-30T22:22:02.394448+0000","last_fullsized":"2023-09-30T22:22:02.394448+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.360247+0000","last_change":"2023-09-30T22:22:01.997424+0000","last_active":"2023-09-30T22:22:02.360247+0000","last_peered":"2023-09-30T22:22:02.360247+0000","last_clean":"2023-09-30T22:22:02.360247+0000","last_became_active":"2023-09-30T22:22:01.997098+0000","last_became_peered":"2023-09-30T22:22:01.997098+0000","last_unstale":"2023-09-30T22:22:02.360247+0000","last_undegraded":"2023-09-30T22:22:02.360247+0000","last_fullsized":"2023-09-30T22:22:02.360247+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.399142+0000","last_change":"2023-09-30T22:22:02.396425+0000","last_active":"2023-09-30T22:22:02.399142+0000","last_peered":"2023-09-30T22:22:02.399142+0000","last_clean":"2023-09-30T22:22:02.399142+0000","last_became_active":"2023-09-30T22:22:02.396152+0000","last_became_peered":"2023-09-30T22:22:02.396152+0000","last_unstale":"2023-09-30T22:22:02.399142+0000","last_undegraded":"2023-09-30T22:22:02.399142+0000","last_fullsized":"2023-09-30T22:22:02.399142+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.363664+0000","last_change":"2023-09-30T22:22:01.994313+0000","last_active":"2023-09-30T22:22:02.363664+0000","last_peered":"2023-09-30T22:22:02.363664+0000","last_clean":"2023-09-30T22:22:02.363664+0000","last_became_active":"2023-09-30T22:22:01.993994+0000","last_became_peered":"2023-09-30T22:22:01.993994+0000","last_unstale":"2023-09-30T22:22:02.363664+0000","last_undegraded":"2023-09-30T22:22:02.363664+0000","last_fullsized":"2023-09-30T22:22:02.363664+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.395039+0000","last_change":"2023-09-30T22:22:02.391210+0000","last_active":"2023-09-30T22:22:02.395039+0000","last_peered":"2023-09-30T22:22:02.395039+0000","last_clean":"2023-09-30T22:22:02.395039+0000","last_became_active":"2023-09-30T22:22:02.390937+0000","last_became_peered":"2023-09-30T22:22:02.390937+0000","last_unstale":"2023-09-30T22:22:02.395039+0000","last_undegraded":"2023-09-30T22:22:02.395039+0000","last_fullsized":"2023-09-30T22:22:02.395039+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.389161+0000","last_change":"2023-09-30T22:22:01.974848+0000","last_active":"2023-09-30T22:22:02.389161+0000","last_peered":"2023-09-30T22:22:02.389161+0000","last_clean":"2023-09-30T22:22:02.389161+0000","last_became_active":"2023-09-30T22:22:01.974025+0000","last_became_peered":"2023-09-30T22:22:01.974025+0000","last_unstale":"2023-09-30T22:22:02.389161+0000","last_undegraded":"2023-09-30T22:22:02.389161+0000","last_fullsized":"2023-09-30T22:22:02.389161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394389+0000","last_change":"2023-09-30T22:22:02.383497+0000","last_active":"2023-09-30T22:22:02.394389+0000","last_peered":"2023-09-30T22:22:02.394389+0000","last_clean":"2023-09-30T22:22:02.394389+0000","last_became_active":"2023-09-30T22:22:02.383215+0000","last_became_peered":"2023-09-30T22:22:02.383215+0000","last_unstale":"2023-09-30T22:22:02.394389+0000","last_undegraded":"2023-09-30T22:22:02.394389+0000","last_fullsized":"2023-09-30T22:22:02.394389+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393941+0000","last_change":"2023-09-30T22:22:01.979910+0000","last_active":"2023-09-30T22:22:02.393941+0000","last_peered":"2023-09-30T22:22:02.393941+0000","last_clean":"2023-09-30T22:22:02.393941+0000","last_became_active":"2023-09-30T22:22:01.979649+0000","last_became_peered":"2023-09-30T22:22:01.979649+0000","last_unstale":"2023-09-30T22:22:02.393941+0000","last_undegraded":"2023-09-30T22:22:02.393941+0000","last_fullsized":"2023-09-30T22:22:02.393941+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.384926+0000","last_change":"2023-09-30T22:22:02.381246+0000","last_active":"2023-09-30T22:22:02.384926+0000","last_peered":"2023-09-30T22:22:02.384926+0000","last_clean":"2023-09-30T22:22:02.384926+0000","last_became_active":"2023-09-30T22:22:02.380654+0000","last_became_peered":"2023-09-30T22:22:02.380654+0000","last_unstale":"2023-09-30T22:22:02.384926+0000","last_undegraded":"2023-09-30T22:22:02.384926+0000","last_fullsized":"2023-09-30T22:22:02.384926+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.386375+0000","last_change":"2023-09-30T22:22:01.990442+0000","last_active":"2023-09-30T22:22:02.386375+0000","last_peered":"2023-09-30T22:22:02.386375+0000","last_clean":"2023-09-30T22:22:02.386375+0000","last_became_active":"2023-09-30T22:22:01.990217+0000","last_became_peered":"2023-09-30T22:22:01.990217+0000","last_unstale":"2023-09-30T22:22:02.386375+0000","last_undegraded":"2023-09-30T22:22:02.386375+0000","last_fullsized":"2023-09-30T22:22:02.386375+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394816+0000","last_change":"2023-09-30T22:22:02.390201+0000","last_active":"2023-09-30T22:22:02.394816+0000","last_peered":"2023-09-30T22:22:02.394816+0000","last_clean":"2023-09-30T22:22:02.394816+0000","last_became_active":"2023-09-30T22:22:02.389897+0000","last_became_peered":"2023-09-30T22:22:02.389897+0000","last_unstale":"2023-09-30T22:22:02.394816+0000","last_undegraded":"2023-09-30T22:22:02.394816+0000","last_fullsized":"2023-09-30T22:22:02.394816+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.395355+0000","last_change":"2023-09-30T22:22:01.996439+0000","last_active":"2023-09-30T22:22:02.395355+0000","last_peered":"2023-09-30T22:22:02.395355+0000","last_clean":"2023-09-30T22:22:02.395355+0000","last_became_active":"2023-09-30T22:22:01.996114+0000","last_became_peered":"2023-09-30T22:22:01.996114+0000","last_unstale":"2023-09-30T22:22:02.395355+0000","last_undegraded":"2023-09-30T22:22:02.395355+0000","last_fullsized":"2023-09-30T22:22:02.395355+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393352+0000","last_change":"2023-09-30T22:22:02.384428+0000","last_active":"2023-09-30T22:22:02.393352+0000","last_peered":"2023-09-30T22:22:02.393352+0000","last_clean":"2023-09-30T22:22:02.393352+0000","last_became_active":"2023-09-30T22:22:02.383704+0000","last_became_peered":"2023-09-30T22:22:02.383704+0000","last_unstale":"2023-09-30T22:22:02.393352+0000","last_undegraded":"2023-09-30T22:22:02.393352+0000","last_fullsized":"2023-09-30T22:22:02.393352+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.361009+0000","last_change":"2023-09-30T22:22:01.998688+0000","last_active":"2023-09-30T22:22:02.361009+0000","last_peered":"2023-09-30T22:22:02.361009+0000","last_clean":"2023-09-30T22:22:02.361009+0000","last_became_active":"2023-09-30T22:22:01.998390+0000","last_became_peered":"2023-09-30T22:22:01.998390+0000","last_unstale":"2023-09-30T22:22:02.361009+0000","last_undegraded":"2023-09-30T22:22:02.361009+0000","last_fullsized":"2023-09-30T22:22:02.361009+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385081+0000","last_change":"2023-09-30T22:22:02.376261+0000","last_active":"2023-09-30T22:22:02.385081+0000","last_peered":"2023-09-30T22:22:02.385081+0000","last_clean":"2023-09-30T22:22:02.385081+0000","last_became_active":"2023-09-30T22:22:02.375940+0000","last_became_peered":"2023-09-30T22:22:02.375940+0000","last_unstale":"2023-09-30T22:22:02.385081+0000","last_undegraded":"2023-09-30T22:22:02.385081+0000","last_fullsized":"2023-09-30T22:22:02.385081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.397715+0000","last_change":"2023-09-30T22:22:01.995642+0000","last_active":"2023-09-30T22:22:02.397715+0000","last_peered":"2023-09-30T22:22:02.397715+0000","last_clean":"2023-09-30T22:22:02.397715+0000","last_became_active":"2023-09-30T22:22:01.995224+0000","last_became_peered":"2023-09-30T22:22:01.995224+0000","last_unstale":"2023-09-30T22:22:02.397715+0000","last_undegraded":"2023-09-30T22:22:02.397715+0000","last_fullsized":"2023-09-30T22:22:02.397715+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394834+0000","last_change":"2023-09-30T22:22:02.390443+0000","last_active":"2023-09-30T22:22:02.394834+0000","last_peered":"2023-09-30T22:22:02.394834+0000","last_clean":"2023-09-30T22:22:02.394834+0000","last_became_active":"2023-09-30T22:22:02.390261+0000","last_became_peered":"2023-09-30T22:22:02.390261+0000","last_unstale":"2023-09-30T22:22:02.394834+0000","last_undegraded":"2023-09-30T22:22:02.394834+0000","last_fullsized":"2023-09-30T22:22:02.394834+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.363042+0000","last_change":"2023-09-30T22:22:01.995738+0000","last_active":"2023-09-30T22:22:02.363042+0000","last_peered":"2023-09-30T22:22:02.363042+0000","last_clean":"2023-09-30T22:22:02.363042+0000","last_became_active":"2023-09-30T22:22:01.994552+0000","last_became_peered":"2023-09-30T22:22:01.994552+0000","last_unstale":"2023-09-30T22:22:02.363042+0000","last_undegraded":"2023-09-30T22:22:02.363042+0000","last_fullsized":"2023-09-30T22:22:02.363042+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.388642+0000","last_change":"2023-09-30T22:22:02.382026+0000","last_active":"2023-09-30T22:22:02.388642+0000","last_peered":"2023-09-30T22:22:02.388642+0000","last_clean":"2023-09-30T22:22:02.388642+0000","last_became_active":"2023-09-30T22:22:02.378486+0000","last_became_peered":"2023-09-30T22:22:02.378486+0000","last_unstale":"2023-09-30T22:22:02.388642+0000","last_undegraded":"2023-09-30T22:22:02.388642+0000","last_fullsized":"2023-09-30T22:22:02.388642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.359669+0000","last_change":"2023-09-30T22:22:01.994235+0000","last_active":"2023-09-30T22:22:02.359669+0000","last_peered":"2023-09-30T22:22:02.359669+0000","last_clean":"2023-09-30T22:22:02.359669+0000","last_became_active":"2023-09-30T22:22:01.993882+0000","last_became_peered":"2023-09-30T22:22:01.993882+0000","last_unstale":"2023-09-30T22:22:02.359669+0000","last_undegraded":"2023-09-30T22:22:02.359669+0000","last_fullsized":"2023-09-30T22:22:02.359669+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393722+0000","last_change":"2023-09-30T22:22:02.386102+0000","last_active":"2023-09-30T22:22:02.393722+0000","last_peered":"2023-09-30T22:22:02.393722+0000","last_clean":"2023-09-30T22:22:02.393722+0000","last_became_active":"2023-09-30T22:22:02.384968+0000","last_became_peered":"2023-09-30T22:22:02.384968+0000","last_unstale":"2023-09-30T22:22:02.393722+0000","last_undegraded":"2023-09-30T22:22:02.393722+0000","last_fullsized":"2023-09-30T22:22:02.393722+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.358511+0000","last_change":"2023-09-30T22:22:01.995015+0000","last_active":"2023-09-30T22:22:02.358511+0000","last_peered":"2023-09-30T22:22:02.358511+0000","last_clean":"2023-09-30T22:22:02.358511+0000","last_became_active":"2023-09-30T22:22:01.994743+0000","last_became_peered":"2023-09-30T22:22:01.994743+0000","last_unstale":"2023-09-30T22:22:02.358511+0000","last_undegraded":"2023-09-30T22:22:02.358511+0000","last_fullsized":"2023-09-30T22:22:02.358511+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394399+0000","last_change":"2023-09-30T22:22:02.385985+0000","last_active":"2023-09-30T22:22:02.394399+0000","last_peered":"2023-09-30T22:22:02.394399+0000","last_clean":"2023-09-30T22:22:02.394399+0000","last_became_active":"2023-09-30T22:22:02.385413+0000","last_became_peered":"2023-09-30T22:22:02.385413+0000","last_unstale":"2023-09-30T22:22:02.394399+0000","last_undegraded":"2023-09-30T22:22:02.394399+0000","last_fullsized":"2023-09-30T22:22:02.394399+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.359640+0000","last_change":"2023-09-30T22:21:58.403636+0000","last_active":"2023-09-30T22:22:02.359640+0000","last_peered":"2023-09-30T22:22:02.359640+0000","last_clean":"2023-09-30T22:22:02.359640+0000","last_became_active":"2023-09-30T22:21:58.403342+0000","last_became_peered":"2023-09-30T22:21:58.403342+0000","last_unstale":"2023-09-30T22:22:02.359640+0000","last_undegraded":"2023-09-30T22:22:02.359640+0000","last_fullsized":"2023-09-30T22:22:02.359640+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.364135+0000","last_change":"2023-09-30T22:22:01.997724+0000","last_active":"2023-09-30T22:22:02.364135+0000","last_peered":"2023-09-30T22:22:02.364135+0000","last_clean":"2023-09-30T22:22:02.364135+0000","last_became_active":"2023-09-30T22:22:01.997451+0000","last_became_peered":"2023-09-30T22:22:01.997451+0000","last_unstale":"2023-09-30T22:22:02.364135+0000","last_undegraded":"2023-09-30T22:22:02.364135+0000","last_fullsized":"2023-09-30T22:22:02.364135+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394856+0000","last_change":"2023-09-30T22:22:02.389982+0000","last_active":"2023-09-30T22:22:02.394856+0000","last_peered":"2023-09-30T22:22:02.394856+0000","last_clean":"2023-09-30T22:22:02.394856+0000","last_became_active":"2023-09-30T22:22:02.389680+0000","last_became_peered":"2023-09-30T22:22:02.389680+0000","last_unstale":"2023-09-30T22:22:02.394856+0000","last_undegraded":"2023-09-30T22:22:02.394856+0000","last_fullsized":"2023-09-30T22:22:02.394856+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.363445+0000","last_change":"2023-09-30T22:21:57.839392+0000","last_active":"2023-09-30T22:22:02.363445+0000","last_peered":"2023-09-30T22:22:02.363445+0000","last_clean":"2023-09-30T22:22:02.363445+0000","last_became_active":"2023-09-30T22:21:57.838993+0000","last_became_peered":"2023-09-30T22:21:57.838993+0000","last_unstale":"2023-09-30T22:22:02.363445+0000","last_undegraded":"2023-09-30T22:22:02.363445+0000","last_fullsized":"2023-09-30T22:22:02.363445+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.363117+0000","last_change":"2023-09-30T22:22:01.990265+0000","last_active":"2023-09-30T22:22:02.363117+0000","last_peered":"2023-09-30T22:22:02.363117+0000","last_clean":"2023-09-30T22:22:02.363117+0000","last_became_active":"2023-09-30T22:22:01.990011+0000","last_became_peered":"2023-09-30T22:22:01.990011+0000","last_unstale":"2023-09-30T22:22:02.363117+0000","last_undegraded":"2023-09-30T22:22:02.363117+0000","last_fullsized":"2023-09-30T22:22:02.363117+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.383793+0000","last_change":"2023-09-30T22:22:02.374205+0000","last_active":"2023-09-30T22:22:02.383793+0000","last_peered":"2023-09-30T22:22:02.383793+0000","last_clean":"2023-09-30T22:22:02.383793+0000","last_became_active":"2023-09-30T22:22:02.373928+0000","last_became_peered":"2023-09-30T22:22:02.373928+0000","last_unstale":"2023-09-30T22:22:02.383793+0000","last_undegraded":"2023-09-30T22:22:02.383793+0000","last_fullsized":"2023-09-30T22:22:02.383793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.363749+0000","last_change":"2023-09-30T22:21:57.836160+0000","last_active":"2023-09-30T22:22:02.363749+0000","last_peered":"2023-09-30T22:22:02.363749+0000","last_clean":"2023-09-30T22:22:02.363749+0000","last_became_active":"2023-09-30T22:21:57.835792+0000","last_became_peered":"2023-09-30T22:21:57.835792+0000","last_unstale":"2023-09-30T22:22:02.363749+0000","last_undegraded":"2023-09-30T22:22:02.363749+0000","last_fullsized":"2023-09-30T22:22:02.363749+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.359810+0000","last_change":"2023-09-30T22:22:01.987700+0000","last_active":"2023-09-30T22:22:02.359810+0000","last_peered":"2023-09-30T22:22:02.359810+0000","last_clean":"2023-09-30T22:22:02.359810+0000","last_became_active":"2023-09-30T22:22:01.987358+0000","last_became_peered":"2023-09-30T22:22:01.987358+0000","last_unstale":"2023-09-30T22:22:02.359810+0000","last_undegraded":"2023-09-30T22:22:02.359810+0000","last_fullsized":"2023-09-30T22:22:02.359810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.382010+0000","last_change":"2023-09-30T22:22:02.379845+0000","last_active":"2023-09-30T22:22:02.382010+0000","last_peered":"2023-09-30T22:22:02.382010+0000","last_clean":"2023-09-30T22:22:02.382010+0000","last_became_active":"2023-09-30T22:22:02.379594+0000","last_became_peered":"2023-09-30T22:22:02.379594+0000","last_unstale":"2023-09-30T22:22:02.382010+0000","last_undegraded":"2023-09-30T22:22:02.382010+0000","last_fullsized":"2023-09-30T22:22:02.382010+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.359678+0000","last_change":"2023-09-30T22:21:57.838957+0000","last_active":"2023-09-30T22:22:02.359678+0000","last_peered":"2023-09-30T22:22:02.359678+0000","last_clean":"2023-09-30T22:22:02.359678+0000","last_became_active":"2023-09-30T22:21:57.838667+0000","last_became_peered":"2023-09-30T22:21:57.838667+0000","last_unstale":"2023-09-30T22:22:02.359678+0000","last_undegraded":"2023-09-30T22:22:02.359678+0000","last_fullsized":"2023-09-30T22:22:02.359678+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.359529+0000","last_change":"2023-09-30T22:21:56.838072+0000","last_active":"2023-09-30T22:22:02.359529+0000","last_peered":"2023-09-30T22:22:02.359529+0000","last_clean":"2023-09-30T22:22:02.359529+0000","last_became_active":"2023-09-30T22:21:56.837717+0000","last_became_peered":"2023-09-30T22:21:56.837717+0000","last_unstale":"2023-09-30T22:22:02.359529+0000","last_undegraded":"2023-09-30T22:22:02.359529+0000","last_fullsized":"2023-09-30T22:22:02.359529+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:55.823939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:55.823939+0000","last_clean_scrub_stamp":"2023-09-30T22:21:55.823939+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.362949+0000","last_change":"2023-09-30T22:22:01.994653+0000","last_active":"2023-09-30T22:22:02.362949+0000","last_peered":"2023-09-30T22:22:02.362949+0000","last_clean":"2023-09-30T22:22:02.362949+0000","last_became_active":"2023-09-30T22:22:01.994362+0000","last_became_peered":"2023-09-30T22:22:01.994362+0000","last_unstale":"2023-09-30T22:22:02.362949+0000","last_undegraded":"2023-09-30T22:22:02.362949+0000","last_fullsized":"2023-09-30T22:22:02.362949+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.388623+0000","last_change":"2023-09-30T22:22:02.381190+0000","last_active":"2023-09-30T22:22:02.388623+0000","last_peered":"2023-09-30T22:22:02.388623+0000","last_clean":"2023-09-30T22:22:02.388623+0000","last_became_active":"2023-09-30T22:22:02.380952+0000","last_became_peered":"2023-09-30T22:22:02.380952+0000","last_unstale":"2023-09-30T22:22:02.388623+0000","last_undegraded":"2023-09-30T22:22:02.388623+0000","last_fullsized":"2023-09-30T22:22:02.388623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.358689+0000","last_change":"2023-09-30T22:21:57.837598+0000","last_active":"2023-09-30T22:22:02.358689+0000","last_peered":"2023-09-30T22:22:02.358689+0000","last_clean":"2023-09-30T22:22:02.358689+0000","last_became_active":"2023-09-30T22:21:57.837284+0000","last_became_peered":"2023-09-30T22:21:57.837284+0000","last_unstale":"2023-09-30T22:22:02.358689+0000","last_undegraded":"2023-09-30T22:22:02.358689+0000","last_fullsized":"2023-09-30T22:22:02.358689+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.364183+0000","last_change":"2023-09-30T22:22:01.983059+0000","last_active":"2023-09-30T22:22:02.364183+0000","last_peered":"2023-09-30T22:22:02.364183+0000","last_clean":"2023-09-30T22:22:02.364183+0000","last_became_active":"2023-09-30T22:22:01.982739+0000","last_became_peered":"2023-09-30T22:22:01.982739+0000","last_unstale":"2023-09-30T22:22:02.364183+0000","last_undegraded":"2023-09-30T22:22:02.364183+0000","last_fullsized":"2023-09-30T22:22:02.364183+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385106+0000","last_change":"2023-09-30T22:22:02.380074+0000","last_active":"2023-09-30T22:22:02.385106+0000","last_peered":"2023-09-30T22:22:02.385106+0000","last_clean":"2023-09-30T22:22:02.385106+0000","last_became_active":"2023-09-30T22:22:02.379501+0000","last_became_peered":"2023-09-30T22:22:02.379501+0000","last_unstale":"2023-09-30T22:22:02.385106+0000","last_undegraded":"2023-09-30T22:22:02.385106+0000","last_fullsized":"2023-09-30T22:22:02.385106+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.364495+0000","last_change":"2023-09-30T22:21:58.403508+0000","last_active":"2023-09-30T22:22:02.364495+0000","last_peered":"2023-09-30T22:22:02.364495+0000","last_clean":"2023-09-30T22:22:02.364495+0000","last_became_active":"2023-09-30T22:21:58.403267+0000","last_became_peered":"2023-09-30T22:21:58.403267+0000","last_unstale":"2023-09-30T22:22:02.364495+0000","last_undegraded":"2023-09-30T22:22:02.364495+0000","last_fullsized":"2023-09-30T22:22:02.364495+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.359534+0000","last_change":"2023-09-30T22:22:01.987265+0000","last_active":"2023-09-30T22:22:02.359534+0000","last_peered":"2023-09-30T22:22:02.359534+0000","last_clean":"2023-09-30T22:22:02.359534+0000","last_became_active":"2023-09-30T22:22:01.986968+0000","last_became_peered":"2023-09-30T22:22:01.986968+0000","last_unstale":"2023-09-30T22:22:02.359534+0000","last_undegraded":"2023-09-30T22:22:02.359534+0000","last_fullsized":"2023-09-30T22:22:02.359534+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385062+0000","last_change":"2023-09-30T22:22:02.376013+0000","last_active":"2023-09-30T22:22:02.385062+0000","last_peered":"2023-09-30T22:22:02.385062+0000","last_clean":"2023-09-30T22:22:02.385062+0000","last_became_active":"2023-09-30T22:22:02.374252+0000","last_became_peered":"2023-09-30T22:22:02.374252+0000","last_unstale":"2023-09-30T22:22:02.385062+0000","last_undegraded":"2023-09-30T22:22:02.385062+0000","last_fullsized":"2023-09-30T22:22:02.385062+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.395176+0000","last_change":"2023-09-30T22:22:01.994188+0000","last_active":"2023-09-30T22:22:02.395176+0000","last_peered":"2023-09-30T22:22:02.395176+0000","last_clean":"2023-09-30T22:22:02.395176+0000","last_became_active":"2023-09-30T22:22:01.993644+0000","last_became_peered":"2023-09-30T22:22:01.993644+0000","last_unstale":"2023-09-30T22:22:02.395176+0000","last_undegraded":"2023-09-30T22:22:02.395176+0000","last_fullsized":"2023-09-30T22:22:02.395176+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.360873+0000","last_change":"2023-09-30T22:21:58.403570+0000","last_active":"2023-09-30T22:22:02.360873+0000","last_peered":"2023-09-30T22:22:02.360873+0000","last_clean":"2023-09-30T22:22:02.360873+0000","last_became_active":"2023-09-30T22:21:58.403321+0000","last_became_peered":"2023-09-30T22:21:58.403321+0000","last_unstale":"2023-09-30T22:22:02.360873+0000","last_undegraded":"2023-09-30T22:22:02.360873+0000","last_fullsized":"2023-09-30T22:22:02.360873+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.381516+0000","last_change":"2023-09-30T22:22:02.372818+0000","last_active":"2023-09-30T22:22:02.381516+0000","last_peered":"2023-09-30T22:22:02.381516+0000","last_clean":"2023-09-30T22:22:02.381516+0000","last_became_active":"2023-09-30T22:22:02.372623+0000","last_became_peered":"2023-09-30T22:22:02.372623+0000","last_unstale":"2023-09-30T22:22:02.381516+0000","last_undegraded":"2023-09-30T22:22:02.381516+0000","last_fullsized":"2023-09-30T22:22:02.381516+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.369758+0000","last_change":"2023-09-30T22:21:58.404380+0000","last_active":"2023-09-30T22:22:02.369758+0000","last_peered":"2023-09-30T22:22:02.369758+0000","last_clean":"2023-09-30T22:22:02.369758+0000","last_became_active":"2023-09-30T22:21:58.404098+0000","last_became_peered":"2023-09-30T22:21:58.404098+0000","last_unstale":"2023-09-30T22:22:02.369758+0000","last_undegraded":"2023-09-30T22:22:02.369758+0000","last_fullsized":"2023-09-30T22:22:02.369758+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:22:03.703353+0000","last_change":"2023-09-30T22:22:01.977163+0000","last_active":"2023-09-30T22:22:03.703353+0000","last_peered":"2023-09-30T22:22:03.703353+0000","last_clean":"2023-09-30T22:22:03.703353+0000","last_became_active":"2023-09-30T22:22:01.976494+0000","last_became_peered":"2023-09-30T22:22:01.976494+0000","last_unstale":"2023-09-30T22:22:03.703353+0000","last_undegraded":"2023-09-30T22:22:03.703353+0000","last_fullsized":"2023-09-30T22:22:03.703353+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393757+0000","last_change":"2023-09-30T22:22:02.386251+0000","last_active":"2023-09-30T22:22:02.393757+0000","last_peered":"2023-09-30T22:22:02.393757+0000","last_clean":"2023-09-30T22:22:02.393757+0000","last_became_active":"2023-09-30T22:22:02.385701+0000","last_became_peered":"2023-09-30T22:22:02.385701+0000","last_unstale":"2023-09-30T22:22:02.393757+0000","last_undegraded":"2023-09-30T22:22:02.393757+0000","last_fullsized":"2023-09-30T22:22:02.393757+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.398231+0000","last_change":"2023-09-30T22:22:01.997989+0000","last_active":"2023-09-30T22:22:02.398231+0000","last_peered":"2023-09-30T22:22:02.398231+0000","last_clean":"2023-09-30T22:22:02.398231+0000","last_became_active":"2023-09-30T22:22:01.997419+0000","last_became_peered":"2023-09-30T22:22:01.997419+0000","last_unstale":"2023-09-30T22:22:02.398231+0000","last_undegraded":"2023-09-30T22:22:02.398231+0000","last_fullsized":"2023-09-30T22:22:02.398231+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380856+0000","last_change":"2023-09-30T22:22:02.379106+0000","last_active":"2023-09-30T22:22:02.380856+0000","last_peered":"2023-09-30T22:22:02.380856+0000","last_clean":"2023-09-30T22:22:02.380856+0000","last_became_active":"2023-09-30T22:22:02.378452+0000","last_became_peered":"2023-09-30T22:22:02.378452+0000","last_unstale":"2023-09-30T22:22:02.380856+0000","last_undegraded":"2023-09-30T22:22:02.380856+0000","last_fullsized":"2023-09-30T22:22:02.380856+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380701+0000","last_change":"2023-09-30T22:22:01.977515+0000","last_active":"2023-09-30T22:22:02.380701+0000","last_peered":"2023-09-30T22:22:02.380701+0000","last_clean":"2023-09-30T22:22:02.380701+0000","last_became_active":"2023-09-30T22:22:01.976843+0000","last_became_peered":"2023-09-30T22:22:01.976843+0000","last_unstale":"2023-09-30T22:22:02.380701+0000","last_undegraded":"2023-09-30T22:22:02.380701+0000","last_fullsized":"2023-09-30T22:22:02.380701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393819+0000","last_change":"2023-09-30T22:22:02.387751+0000","last_active":"2023-09-30T22:22:02.393819+0000","last_peered":"2023-09-30T22:22:02.393819+0000","last_clean":"2023-09-30T22:22:02.393819+0000","last_became_active":"2023-09-30T22:22:02.387326+0000","last_became_peered":"2023-09-30T22:22:02.387326+0000","last_unstale":"2023-09-30T22:22:02.393819+0000","last_undegraded":"2023-09-30T22:22:02.393819+0000","last_fullsized":"2023-09-30T22:22:02.393819+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.395931+0000","last_change":"2023-09-30T22:22:01.996439+0000","last_active":"2023-09-30T22:22:02.395931+0000","last_peered":"2023-09-30T22:22:02.395931+0000","last_clean":"2023-09-30T22:22:02.395931+0000","last_became_active":"2023-09-30T22:22:01.996179+0000","last_became_peered":"2023-09-30T22:22:01.996179+0000","last_unstale":"2023-09-30T22:22:02.395931+0000","last_undegraded":"2023-09-30T22:22:02.395931+0000","last_fullsized":"2023-09-30T22:22:02.395931+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393375+0000","last_change":"2023-09-30T22:22:02.384588+0000","last_active":"2023-09-30T22:22:02.393375+0000","last_peered":"2023-09-30T22:22:02.393375+0000","last_clean":"2023-09-30T22:22:02.393375+0000","last_became_active":"2023-09-30T22:22:02.384072+0000","last_became_peered":"2023-09-30T22:22:02.384072+0000","last_unstale":"2023-09-30T22:22:02.393375+0000","last_undegraded":"2023-09-30T22:22:02.393375+0000","last_fullsized":"2023-09-30T22:22:02.393375+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393972+0000","last_change":"2023-09-30T22:22:01.993986+0000","last_active":"2023-09-30T22:22:02.393972+0000","last_peered":"2023-09-30T22:22:02.393972+0000","last_clean":"2023-09-30T22:22:02.393972+0000","last_became_active":"2023-09-30T22:22:01.993575+0000","last_became_peered":"2023-09-30T22:22:01.993575+0000","last_unstale":"2023-09-30T22:22:02.393972+0000","last_undegraded":"2023-09-30T22:22:02.393972+0000","last_fullsized":"2023-09-30T22:22:02.393972+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.383708+0000","last_change":"2023-09-30T22:22:02.378109+0000","last_active":"2023-09-30T22:22:02.383708+0000","last_peered":"2023-09-30T22:22:02.383708+0000","last_clean":"2023-09-30T22:22:02.383708+0000","last_became_active":"2023-09-30T22:22:02.377671+0000","last_became_peered":"2023-09-30T22:22:02.377671+0000","last_unstale":"2023-09-30T22:22:02.383708+0000","last_undegraded":"2023-09-30T22:22:02.383708+0000","last_fullsized":"2023-09-30T22:22:02.383708+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.386441+0000","last_change":"2023-09-30T22:22:01.980853+0000","last_active":"2023-09-30T22:22:02.386441+0000","last_peered":"2023-09-30T22:22:02.386441+0000","last_clean":"2023-09-30T22:22:02.386441+0000","last_became_active":"2023-09-30T22:22:01.979795+0000","last_became_peered":"2023-09-30T22:22:01.979795+0000","last_unstale":"2023-09-30T22:22:02.386441+0000","last_undegraded":"2023-09-30T22:22:02.386441+0000","last_fullsized":"2023-09-30T22:22:02.386441+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380713+0000","last_change":"2023-09-30T22:22:02.377790+0000","last_active":"2023-09-30T22:22:02.380713+0000","last_peered":"2023-09-30T22:22:02.380713+0000","last_clean":"2023-09-30T22:22:02.380713+0000","last_became_active":"2023-09-30T22:22:02.377478+0000","last_became_peered":"2023-09-30T22:22:02.377478+0000","last_unstale":"2023-09-30T22:22:02.380713+0000","last_undegraded":"2023-09-30T22:22:02.380713+0000","last_fullsized":"2023-09-30T22:22:02.380713+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380254+0000","last_change":"2023-09-30T22:22:02.373820+0000","last_active":"2023-09-30T22:22:02.380254+0000","last_peered":"2023-09-30T22:22:02.380254+0000","last_clean":"2023-09-30T22:22:02.380254+0000","last_became_active":"2023-09-30T22:22:02.373530+0000","last_became_peered":"2023-09-30T22:22:02.373530+0000","last_unstale":"2023-09-30T22:22:02.380254+0000","last_undegraded":"2023-09-30T22:22:02.380254+0000","last_fullsized":"2023-09-30T22:22:02.380254+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.383688+0000","last_change":"2023-09-30T22:22:02.377945+0000","last_active":"2023-09-30T22:22:02.383688+0000","last_peered":"2023-09-30T22:22:02.383688+0000","last_clean":"2023-09-30T22:22:02.383688+0000","last_became_active":"2023-09-30T22:22:02.377355+0000","last_became_peered":"2023-09-30T22:22:02.377355+0000","last_unstale":"2023-09-30T22:22:02.383688+0000","last_undegraded":"2023-09-30T22:22:02.383688+0000","last_fullsized":"2023-09-30T22:22:02.383688+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394694+0000","last_change":"2023-09-30T22:22:02.387890+0000","last_active":"2023-09-30T22:22:02.394694+0000","last_peered":"2023-09-30T22:22:02.394694+0000","last_clean":"2023-09-30T22:22:02.394694+0000","last_became_active":"2023-09-30T22:22:02.387599+0000","last_became_peered":"2023-09-30T22:22:02.387599+0000","last_unstale":"2023-09-30T22:22:02.394694+0000","last_undegraded":"2023-09-30T22:22:02.394694+0000","last_fullsized":"2023-09-30T22:22:02.394694+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.397499+0000","last_change":"2023-09-30T22:22:02.385159+0000","last_active":"2023-09-30T22:22:02.397499+0000","last_peered":"2023-09-30T22:22:02.397499+0000","last_clean":"2023-09-30T22:22:02.397499+0000","last_became_active":"2023-09-30T22:22:02.376532+0000","last_became_peered":"2023-09-30T22:22:02.376532+0000","last_unstale":"2023-09-30T22:22:02.397499+0000","last_undegraded":"2023-09-30T22:22:02.397499+0000","last_fullsized":"2023-09-30T22:22:02.397499+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.383770+0000","last_change":"2023-09-30T22:22:02.374216+0000","last_active":"2023-09-30T22:22:02.383770+0000","last_peered":"2023-09-30T22:22:02.383770+0000","last_clean":"2023-09-30T22:22:02.383770+0000","last_became_active":"2023-09-30T22:22:02.373952+0000","last_became_peered":"2023-09-30T22:22:02.373952+0000","last_unstale":"2023-09-30T22:22:02.383770+0000","last_undegraded":"2023-09-30T22:22:02.383770+0000","last_fullsized":"2023-09-30T22:22:02.383770+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297264,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074576,"statfs":{"total":96636764160,"available":96332365824,"internally_reserved":0,"allocated":172032,"data_stored":48929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26700000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":48735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":46930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":47845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T22:22:14.506 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:22:14.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.656+0000 7f56a862b700 1 Processor -- start 2023-09-30T22:22:14.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.656+0000 7f56a862b700 1 -- start start 2023-09-30T22:22:14.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.657+0000 7f56a862b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f56a0068890 0x7f56a012e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:14.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.657+0000 7f56a862b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56a012e6d0 0x7f56a0130ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:14.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.657+0000 7f56a862b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56a005e440 con 0x7f56a0067da0 2023-09-30T22:22:14.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.657+0000 7f56a862b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a0069ef0 con 0x7f56a0068890 2023-09-30T22:22:14.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.657+0000 7f56a862b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a00964c0 con 0x7f56a012e6d0 2023-09-30T22:22:14.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.657+0000 7f56a5bc6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f56a0068890 0x7f56a012e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:14.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.657+0000 7f56a63c7700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f56a0067da0 0x7f56a0068180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53264/0 (socket says 172.21.15.40:53264) 2023-09-30T22:22:14.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.657+0000 7f56a63c7700 1 -- 172.21.15.40:0/1384395943 learned_addr learned my addr 172.21.15.40:0/1384395943 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:22:14.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.657+0000 7f56a6bc8700 1 --2- 172.21.15.40:0/1384395943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56a012e6d0 0x7f56a0130ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:14.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.657+0000 7f56a5bc6700 1 -- 172.21.15.40:0/1384395943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56a012e6d0 msgr2=0x7f56a0130ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:14.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.657+0000 7f56a5bc6700 1 --2- 172.21.15.40:0/1384395943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56a012e6d0 0x7f56a0130ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:14.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.657+0000 7f56a5bc6700 1 -- 172.21.15.40:0/1384395943 >> v1:172.21.15.40:6789/0 conn(0x7f56a0067da0 legacy=0x7f56a0068180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:14.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.657+0000 7f56a53c5700 1 -- 172.21.15.40:0/1384395943 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1596451153 0 0) 0x7f56a005e440 con 0x7f56a0067da0 2023-09-30T22:22:14.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.657+0000 7f56a5bc6700 1 -- 172.21.15.40:0/1384395943 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a0096780 con 0x7f56a0068890 2023-09-30T22:22:14.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.657+0000 7f56a6bc8700 1 --2- 172.21.15.40:0/1384395943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56a012e6d0 0x7f56a0130ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:14.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.657+0000 7f56a5bc6700 1 --2- 172.21.15.40:0/1384395943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56a0068890 0x7f56a012e1e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f5690009760 tx=0x7f5690009060).ready entity=mon.0 client_cookie=c56f8498a319b897 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:14.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.658+0000 7f56a53c5700 1 -- 172.21.15.40:0/1384395943 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56900090d0 con 0x7f56a0068890 2023-09-30T22:22:14.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.658+0000 7f56a53c5700 1 -- 172.21.15.40:0/1384395943 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569000f510 con 0x7f56a0068890 2023-09-30T22:22:14.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.658+0000 7f56a53c5700 1 -- 172.21.15.40:0/1384395943 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569000f890 con 0x7f56a0068890 2023-09-30T22:22:14.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.658+0000 7f56a862b700 1 -- 172.21.15.40:0/1384395943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56a0068890 msgr2=0x7f56a012e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:14.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.658+0000 7f56a862b700 1 --2- 172.21.15.40:0/1384395943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56a0068890 0x7f56a012e1e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f5690009760 tx=0x7f5690009060).stop 2023-09-30T22:22:14.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.658+0000 7f56a862b700 1 -- 172.21.15.40:0/1384395943 shutdown_connections 2023-09-30T22:22:14.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.658+0000 7f56a862b700 1 --2- 172.21.15.40:0/1384395943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56a012e6d0 0x7f56a0130ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:14.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.658+0000 7f56a862b700 1 --2- 172.21.15.40:0/1384395943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56a0068890 0x7f56a012e1e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:14.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.658+0000 7f56a862b700 1 -- 172.21.15.40:0/1384395943 >> 172.21.15.40:0/1384395943 conn(0x7f56a009aa70 msgr2=0x7f56a0096930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:14.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.658+0000 7f56a862b700 1 -- 172.21.15.40:0/1384395943 shutdown_connections 2023-09-30T22:22:14.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.658+0000 7f56a862b700 1 -- 172.21.15.40:0/1384395943 wait complete. 2023-09-30T22:22:14.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.659+0000 7f56a862b700 1 Processor -- start 2023-09-30T22:22:14.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.659+0000 7f56a862b700 1 -- start start 2023-09-30T22:22:14.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.660+0000 7f56a862b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56a0067da0 0x7f56a008ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:14.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.660+0000 7f56a862b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56a0068890 0x7f56a0065bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:14.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.660+0000 7f56a862b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56a012e6d0 0x7f56a00660b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:14.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.660+0000 7f56a862b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a0066fc0 con 0x7f56a0067da0 2023-09-30T22:22:14.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.660+0000 7f56a862b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a00900a0 con 0x7f56a0068890 2023-09-30T22:22:14.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.660+0000 7f56a862b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56a008e2e0 con 0x7f56a012e6d0 2023-09-30T22:22:14.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.660+0000 7f56a63c7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56a0067da0 0x7f56a008ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:14.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.660+0000 7f56a5bc6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56a0068890 0x7f56a0065bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:14.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.660+0000 7f56a63c7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56a0067da0 0x7f56a008ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48010/0 (socket says 172.21.15.40:48010) 2023-09-30T22:22:14.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.660+0000 7f56a63c7700 1 -- 172.21.15.40:0/2147394813 learned_addr learned my addr 172.21.15.40:0/2147394813 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:14.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.660+0000 7f56a6bc8700 1 --2- 172.21.15.40:0/2147394813 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56a012e6d0 0x7f56a00660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:14.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.660+0000 7f56a63c7700 1 -- 172.21.15.40:0/2147394813 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56a012e6d0 msgr2=0x7f56a00660b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:14.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.660+0000 7f56a63c7700 1 --2- 172.21.15.40:0/2147394813 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56a012e6d0 0x7f56a00660b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:14.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.660+0000 7f56a63c7700 1 -- 172.21.15.40:0/2147394813 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56a0068890 msgr2=0x7f56a0065bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:14.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.661+0000 7f56a63c7700 1 --2- 172.21.15.40:0/2147394813 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56a0068890 0x7f56a0065bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:14.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.661+0000 7f56a63c7700 1 -- 172.21.15.40:0/2147394813 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5698009a20 con 0x7f56a0067da0 2023-09-30T22:22:14.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.661+0000 7f56a5bc6700 1 --2- 172.21.15.40:0/2147394813 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56a0068890 0x7f56a0065bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:14.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.661+0000 7f56a63c7700 1 --2- 172.21.15.40:0/2147394813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56a0067da0 0x7f56a008ee90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f569c00c4e0 tx=0x7f569c007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:14.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.661+0000 7f56967fc700 1 -- 172.21.15.40:0/2147394813 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c00ce30 con 0x7f56a0067da0 2023-09-30T22:22:14.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.661+0000 7f56967fc700 1 -- 172.21.15.40:0/2147394813 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569c0072e0 con 0x7f56a0067da0 2023-09-30T22:22:14.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.661+0000 7f56a862b700 1 -- 172.21.15.40:0/2147394813 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56900092a0 con 0x7f56a0067da0 2023-09-30T22:22:14.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.661+0000 7f56967fc700 1 -- 172.21.15.40:0/2147394813 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c005670 con 0x7f56a0067da0 2023-09-30T22:22:14.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.661+0000 7f56a862b700 1 -- 172.21.15.40:0/2147394813 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a0090850 con 0x7f56a0067da0 2023-09-30T22:22:14.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.662+0000 7f56967fc700 1 -- 172.21.15.40:0/2147394813 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f569c005a20 con 0x7f56a0067da0 2023-09-30T22:22:14.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.662+0000 7f56967fc700 1 -- 172.21.15.40:0/2147394813 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f569c03a550 con 0x7f56a0067da0 2023-09-30T22:22:14.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.662+0000 7f56a862b700 1 -- 172.21.15.40:0/2147394813 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56a005a260 con 0x7f56a0067da0 2023-09-30T22:22:14.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.666+0000 7f56967fc700 1 -- 172.21.15.40:0/2147394813 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f569c0137d0 con 0x7f56a0067da0 2023-09-30T22:22:14.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.829+0000 7f56a862b700 1 -- 172.21.15.40:0/2147394813 --> v1:172.21.15.40:6816/118905 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f56a0046c20 con 0x7f568402bb60 2023-09-30T22:22:14.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.836+0000 7f56967fc700 1 -- 172.21.15.40:0/2147394813 <== mgr.4101 v1:172.21.15.40:6816/118905 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249955 (unknown 2965378022 0 1401954706) 0x7f56a0046c20 con 0x7f568402bb60 2023-09-30T22:22:14.842 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:22:14.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.838+0000 7f56a862b700 1 -- 172.21.15.40:0/2147394813 >> v1:172.21.15.40:6816/118905 conn(0x7f568402bb60 legacy=0x7f568402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:14.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.838+0000 7f56a862b700 1 -- 172.21.15.40:0/2147394813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56a0067da0 msgr2=0x7f56a008ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:14.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.838+0000 7f56a862b700 1 --2- 172.21.15.40:0/2147394813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56a0067da0 0x7f56a008ee90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f569c00c4e0 tx=0x7f569c007a80).stop 2023-09-30T22:22:14.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.838+0000 7f56a862b700 1 -- 172.21.15.40:0/2147394813 shutdown_connections 2023-09-30T22:22:14.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.838+0000 7f56a862b700 1 --2- 172.21.15.40:0/2147394813 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56a012e6d0 0x7f56a00660b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:14.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.838+0000 7f56a862b700 1 --2- 172.21.15.40:0/2147394813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56a0067da0 0x7f56a008ee90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:14.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.838+0000 7f56a862b700 1 --2- 172.21.15.40:0/2147394813 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56a0068890 0x7f56a0065bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:14.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.838+0000 7f56a862b700 1 -- 172.21.15.40:0/2147394813 >> 172.21.15.40:0/2147394813 conn(0x7f56a009aa70 msgr2=0x7f56a0093b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:14.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.839+0000 7f56a862b700 1 -- 172.21.15.40:0/2147394813 shutdown_connections 2023-09-30T22:22:14.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:14.839+0000 7f56a862b700 1 -- 172.21.15.40:0/2147394813 wait complete. 2023-09-30T22:22:14.846 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-09-30T22:22:14.851 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-09-30T22:22:13.777155+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189020,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298340,"statfs":{"total":386547056640,"available":385329500160,"internally_reserved":0,"allocated":651264,"data_stored":192439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1640,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001820"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385416+0000","last_change":"2023-09-30T22:22:02.384090+0000","last_active":"2023-09-30T22:22:02.385416+0000","last_peered":"2023-09-30T22:22:02.385416+0000","last_clean":"2023-09-30T22:22:02.385416+0000","last_became_active":"2023-09-30T22:22:02.383805+0000","last_became_peered":"2023-09-30T22:22:02.383805+0000","last_unstale":"2023-09-30T22:22:02.385416+0000","last_undegraded":"2023-09-30T22:22:02.385416+0000","last_fullsized":"2023-09-30T22:22:02.385416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380743+0000","last_change":"2023-09-30T22:22:02.377806+0000","last_active":"2023-09-30T22:22:02.380743+0000","last_peered":"2023-09-30T22:22:02.380743+0000","last_clean":"2023-09-30T22:22:02.380743+0000","last_became_active":"2023-09-30T22:22:02.377531+0000","last_became_peered":"2023-09-30T22:22:02.377531+0000","last_unstale":"2023-09-30T22:22:02.380743+0000","last_undegraded":"2023-09-30T22:22:02.380743+0000","last_fullsized":"2023-09-30T22:22:02.380743+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385151+0000","last_change":"2023-09-30T22:22:02.379022+0000","last_active":"2023-09-30T22:22:02.385151+0000","last_peered":"2023-09-30T22:22:02.385151+0000","last_clean":"2023-09-30T22:22:02.385151+0000","last_became_active":"2023-09-30T22:22:02.378723+0000","last_became_peered":"2023-09-30T22:22:02.378723+0000","last_unstale":"2023-09-30T22:22:02.385151+0000","last_undegraded":"2023-09-30T22:22:02.385151+0000","last_fullsized":"2023-09-30T22:22:02.385151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385016+0000","last_change":"2023-09-30T22:22:02.378089+0000","last_active":"2023-09-30T22:22:02.385016+0000","last_peered":"2023-09-30T22:22:02.385016+0000","last_clean":"2023-09-30T22:22:02.385016+0000","last_became_active":"2023-09-30T22:22:02.375446+0000","last_became_peered":"2023-09-30T22:22:02.375446+0000","last_unstale":"2023-09-30T22:22:02.385016+0000","last_undegraded":"2023-09-30T22:22:02.385016+0000","last_fullsized":"2023-09-30T22:22:02.385016+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.402864+0000","last_change":"2023-09-30T22:22:02.398073+0000","last_active":"2023-09-30T22:22:02.402864+0000","last_peered":"2023-09-30T22:22:02.402864+0000","last_clean":"2023-09-30T22:22:02.402864+0000","last_became_active":"2023-09-30T22:22:02.397855+0000","last_became_peered":"2023-09-30T22:22:02.397855+0000","last_unstale":"2023-09-30T22:22:02.402864+0000","last_undegraded":"2023-09-30T22:22:02.402864+0000","last_fullsized":"2023-09-30T22:22:02.402864+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385189+0000","last_change":"2023-09-30T22:22:02.382862+0000","last_active":"2023-09-30T22:22:02.385189+0000","last_peered":"2023-09-30T22:22:02.385189+0000","last_clean":"2023-09-30T22:22:02.385189+0000","last_became_active":"2023-09-30T22:22:02.382464+0000","last_became_peered":"2023-09-30T22:22:02.382464+0000","last_unstale":"2023-09-30T22:22:02.385189+0000","last_undegraded":"2023-09-30T22:22:02.385189+0000","last_fullsized":"2023-09-30T22:22:02.385189+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.399117+0000","last_change":"2023-09-30T22:22:02.395909+0000","last_active":"2023-09-30T22:22:02.399117+0000","last_peered":"2023-09-30T22:22:02.399117+0000","last_clean":"2023-09-30T22:22:02.399117+0000","last_became_active":"2023-09-30T22:22:02.395379+0000","last_became_peered":"2023-09-30T22:22:02.395379+0000","last_unstale":"2023-09-30T22:22:02.399117+0000","last_undegraded":"2023-09-30T22:22:02.399117+0000","last_fullsized":"2023-09-30T22:22:02.399117+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393512+0000","last_change":"2023-09-30T22:22:02.382627+0000","last_active":"2023-09-30T22:22:02.393512+0000","last_peered":"2023-09-30T22:22:02.393512+0000","last_clean":"2023-09-30T22:22:02.393512+0000","last_became_active":"2023-09-30T22:22:02.382360+0000","last_became_peered":"2023-09-30T22:22:02.382360+0000","last_unstale":"2023-09-30T22:22:02.393512+0000","last_undegraded":"2023-09-30T22:22:02.393512+0000","last_fullsized":"2023-09-30T22:22:02.393512+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394788+0000","last_change":"2023-09-30T22:22:02.388864+0000","last_active":"2023-09-30T22:22:02.394788+0000","last_peered":"2023-09-30T22:22:02.394788+0000","last_clean":"2023-09-30T22:22:02.394788+0000","last_became_active":"2023-09-30T22:22:02.388267+0000","last_became_peered":"2023-09-30T22:22:02.388267+0000","last_unstale":"2023-09-30T22:22:02.394788+0000","last_undegraded":"2023-09-30T22:22:02.394788+0000","last_fullsized":"2023-09-30T22:22:02.394788+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380523+0000","last_change":"2023-09-30T22:22:02.379619+0000","last_active":"2023-09-30T22:22:02.380523+0000","last_peered":"2023-09-30T22:22:02.380523+0000","last_clean":"2023-09-30T22:22:02.380523+0000","last_became_active":"2023-09-30T22:22:02.379412+0000","last_became_peered":"2023-09-30T22:22:02.379412+0000","last_unstale":"2023-09-30T22:22:02.380523+0000","last_undegraded":"2023-09-30T22:22:02.380523+0000","last_fullsized":"2023-09-30T22:22:02.380523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.377473+0000","last_change":"2023-09-30T22:22:02.372757+0000","last_active":"2023-09-30T22:22:02.377473+0000","last_peered":"2023-09-30T22:22:02.377473+0000","last_clean":"2023-09-30T22:22:02.377473+0000","last_became_active":"2023-09-30T22:22:02.372495+0000","last_became_peered":"2023-09-30T22:22:02.372495+0000","last_unstale":"2023-09-30T22:22:02.377473+0000","last_undegraded":"2023-09-30T22:22:02.377473+0000","last_fullsized":"2023-09-30T22:22:02.377473+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380876+0000","last_change":"2023-09-30T22:22:02.379525+0000","last_active":"2023-09-30T22:22:02.380876+0000","last_peered":"2023-09-30T22:22:02.380876+0000","last_clean":"2023-09-30T22:22:02.380876+0000","last_became_active":"2023-09-30T22:22:02.379330+0000","last_became_peered":"2023-09-30T22:22:02.379330+0000","last_unstale":"2023-09-30T22:22:02.380876+0000","last_undegraded":"2023-09-30T22:22:02.380876+0000","last_fullsized":"2023-09-30T22:22:02.380876+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393834+0000","last_change":"2023-09-30T22:22:02.387803+0000","last_active":"2023-09-30T22:22:02.393834+0000","last_peered":"2023-09-30T22:22:02.393834+0000","last_clean":"2023-09-30T22:22:02.393834+0000","last_became_active":"2023-09-30T22:22:02.387560+0000","last_became_peered":"2023-09-30T22:22:02.387560+0000","last_unstale":"2023-09-30T22:22:02.393834+0000","last_undegraded":"2023-09-30T22:22:02.393834+0000","last_fullsized":"2023-09-30T22:22:02.393834+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380478+0000","last_change":"2023-09-30T22:22:02.374488+0000","last_active":"2023-09-30T22:22:02.380478+0000","last_peered":"2023-09-30T22:22:02.380478+0000","last_clean":"2023-09-30T22:22:02.380478+0000","last_became_active":"2023-09-30T22:22:02.374287+0000","last_became_peered":"2023-09-30T22:22:02.374287+0000","last_unstale":"2023-09-30T22:22:02.380478+0000","last_undegraded":"2023-09-30T22:22:02.380478+0000","last_fullsized":"2023-09-30T22:22:02.380478+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.384882+0000","last_change":"2023-09-30T22:22:02.375916+0000","last_active":"2023-09-30T22:22:02.384882+0000","last_peered":"2023-09-30T22:22:02.384882+0000","last_clean":"2023-09-30T22:22:02.384882+0000","last_became_active":"2023-09-30T22:22:02.374277+0000","last_became_peered":"2023-09-30T22:22:02.374277+0000","last_unstale":"2023-09-30T22:22:02.384882+0000","last_undegraded":"2023-09-30T22:22:02.384882+0000","last_fullsized":"2023-09-30T22:22:02.384882+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.399057+0000","last_change":"2023-09-30T22:22:02.395769+0000","last_active":"2023-09-30T22:22:02.399057+0000","last_peered":"2023-09-30T22:22:02.399057+0000","last_clean":"2023-09-30T22:22:02.399057+0000","last_became_active":"2023-09-30T22:22:02.395459+0000","last_became_peered":"2023-09-30T22:22:02.395459+0000","last_unstale":"2023-09-30T22:22:02.399057+0000","last_undegraded":"2023-09-30T22:22:02.399057+0000","last_fullsized":"2023-09-30T22:22:02.399057+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.395070+0000","last_change":"2023-09-30T22:22:02.391303+0000","last_active":"2023-09-30T22:22:02.395070+0000","last_peered":"2023-09-30T22:22:02.395070+0000","last_clean":"2023-09-30T22:22:02.395070+0000","last_became_active":"2023-09-30T22:22:02.388602+0000","last_became_peered":"2023-09-30T22:22:02.388602+0000","last_unstale":"2023-09-30T22:22:02.395070+0000","last_undegraded":"2023-09-30T22:22:02.395070+0000","last_fullsized":"2023-09-30T22:22:02.395070+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385063+0000","last_change":"2023-09-30T22:22:02.376471+0000","last_active":"2023-09-30T22:22:02.385063+0000","last_peered":"2023-09-30T22:22:02.385063+0000","last_clean":"2023-09-30T22:22:02.385063+0000","last_became_active":"2023-09-30T22:22:02.374833+0000","last_became_peered":"2023-09-30T22:22:02.374833+0000","last_unstale":"2023-09-30T22:22:02.385063+0000","last_undegraded":"2023-09-30T22:22:02.385063+0000","last_fullsized":"2023-09-30T22:22:02.385063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385397+0000","last_change":"2023-09-30T22:22:02.383103+0000","last_active":"2023-09-30T22:22:02.385397+0000","last_peered":"2023-09-30T22:22:02.385397+0000","last_clean":"2023-09-30T22:22:02.385397+0000","last_became_active":"2023-09-30T22:22:02.382818+0000","last_became_peered":"2023-09-30T22:22:02.382818+0000","last_unstale":"2023-09-30T22:22:02.385397+0000","last_undegraded":"2023-09-30T22:22:02.385397+0000","last_fullsized":"2023-09-30T22:22:02.385397+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394501+0000","last_change":"2023-09-30T22:22:02.388315+0000","last_active":"2023-09-30T22:22:02.394501+0000","last_peered":"2023-09-30T22:22:02.394501+0000","last_clean":"2023-09-30T22:22:02.394501+0000","last_became_active":"2023-09-30T22:22:02.388046+0000","last_became_peered":"2023-09-30T22:22:02.388046+0000","last_unstale":"2023-09-30T22:22:02.394501+0000","last_undegraded":"2023-09-30T22:22:02.394501+0000","last_fullsized":"2023-09-30T22:22:02.394501+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.395152+0000","last_change":"2023-09-30T22:22:02.391309+0000","last_active":"2023-09-30T22:22:02.395152+0000","last_peered":"2023-09-30T22:22:02.395152+0000","last_clean":"2023-09-30T22:22:02.395152+0000","last_became_active":"2023-09-30T22:22:02.391040+0000","last_became_peered":"2023-09-30T22:22:02.391040+0000","last_unstale":"2023-09-30T22:22:02.395152+0000","last_undegraded":"2023-09-30T22:22:02.395152+0000","last_fullsized":"2023-09-30T22:22:02.395152+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.384855+0000","last_change":"2023-09-30T22:22:02.375857+0000","last_active":"2023-09-30T22:22:02.384855+0000","last_peered":"2023-09-30T22:22:02.384855+0000","last_clean":"2023-09-30T22:22:02.384855+0000","last_became_active":"2023-09-30T22:22:02.373866+0000","last_became_peered":"2023-09-30T22:22:02.373866+0000","last_unstale":"2023-09-30T22:22:02.384855+0000","last_undegraded":"2023-09-30T22:22:02.384855+0000","last_fullsized":"2023-09-30T22:22:02.384855+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.399093+0000","last_change":"2023-09-30T22:22:02.395696+0000","last_active":"2023-09-30T22:22:02.399093+0000","last_peered":"2023-09-30T22:22:02.399093+0000","last_clean":"2023-09-30T22:22:02.399093+0000","last_became_active":"2023-09-30T22:22:02.395318+0000","last_became_peered":"2023-09-30T22:22:02.395318+0000","last_unstale":"2023-09-30T22:22:02.399093+0000","last_undegraded":"2023-09-30T22:22:02.399093+0000","last_fullsized":"2023-09-30T22:22:02.399093+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394655+0000","last_change":"2023-09-30T22:22:02.389818+0000","last_active":"2023-09-30T22:22:02.394655+0000","last_peered":"2023-09-30T22:22:02.394655+0000","last_clean":"2023-09-30T22:22:02.394655+0000","last_became_active":"2023-09-30T22:22:02.389526+0000","last_became_peered":"2023-09-30T22:22:02.389526+0000","last_unstale":"2023-09-30T22:22:02.394655+0000","last_undegraded":"2023-09-30T22:22:02.394655+0000","last_fullsized":"2023-09-30T22:22:02.394655+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394419+0000","last_change":"2023-09-30T22:22:02.386166+0000","last_active":"2023-09-30T22:22:02.394419+0000","last_peered":"2023-09-30T22:22:02.394419+0000","last_clean":"2023-09-30T22:22:02.394419+0000","last_became_active":"2023-09-30T22:22:02.385731+0000","last_became_peered":"2023-09-30T22:22:02.385731+0000","last_unstale":"2023-09-30T22:22:02.394419+0000","last_undegraded":"2023-09-30T22:22:02.394419+0000","last_fullsized":"2023-09-30T22:22:02.394419+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380502+0000","last_change":"2023-09-30T22:22:02.374713+0000","last_active":"2023-09-30T22:22:02.380502+0000","last_peered":"2023-09-30T22:22:02.380502+0000","last_clean":"2023-09-30T22:22:02.380502+0000","last_became_active":"2023-09-30T22:22:02.374467+0000","last_became_peered":"2023-09-30T22:22:02.374467+0000","last_unstale":"2023-09-30T22:22:02.380502+0000","last_undegraded":"2023-09-30T22:22:02.380502+0000","last_fullsized":"2023-09-30T22:22:02.380502+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.399018+0000","last_change":"2023-09-30T22:22:02.395766+0000","last_active":"2023-09-30T22:22:02.399018+0000","last_peered":"2023-09-30T22:22:02.399018+0000","last_clean":"2023-09-30T22:22:02.399018+0000","last_became_active":"2023-09-30T22:22:02.395487+0000","last_became_peered":"2023-09-30T22:22:02.395487+0000","last_unstale":"2023-09-30T22:22:02.399018+0000","last_undegraded":"2023-09-30T22:22:02.399018+0000","last_fullsized":"2023-09-30T22:22:02.399018+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.374558+0000","last_change":"2023-09-30T22:22:01.986896+0000","last_active":"2023-09-30T22:22:02.374558+0000","last_peered":"2023-09-30T22:22:02.374558+0000","last_clean":"2023-09-30T22:22:02.374558+0000","last_became_active":"2023-09-30T22:22:01.986600+0000","last_became_peered":"2023-09-30T22:22:01.986600+0000","last_unstale":"2023-09-30T22:22:02.374558+0000","last_undegraded":"2023-09-30T22:22:02.374558+0000","last_fullsized":"2023-09-30T22:22:02.374558+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.388602+0000","last_change":"2023-09-30T22:22:02.380769+0000","last_active":"2023-09-30T22:22:02.388602+0000","last_peered":"2023-09-30T22:22:02.388602+0000","last_clean":"2023-09-30T22:22:02.388602+0000","last_became_active":"2023-09-30T22:22:02.380403+0000","last_became_peered":"2023-09-30T22:22:02.380403+0000","last_unstale":"2023-09-30T22:22:02.388602+0000","last_undegraded":"2023-09-30T22:22:02.388602+0000","last_fullsized":"2023-09-30T22:22:02.388602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.361691+0000","last_change":"2023-09-30T22:22:01.992230+0000","last_active":"2023-09-30T22:22:02.361691+0000","last_peered":"2023-09-30T22:22:02.361691+0000","last_clean":"2023-09-30T22:22:02.361691+0000","last_became_active":"2023-09-30T22:22:01.991929+0000","last_became_peered":"2023-09-30T22:22:01.991929+0000","last_unstale":"2023-09-30T22:22:02.361691+0000","last_undegraded":"2023-09-30T22:22:02.361691+0000","last_fullsized":"2023-09-30T22:22:02.361691+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385127+0000","last_change":"2023-09-30T22:22:02.380249+0000","last_active":"2023-09-30T22:22:02.385127+0000","last_peered":"2023-09-30T22:22:02.385127+0000","last_clean":"2023-09-30T22:22:02.385127+0000","last_became_active":"2023-09-30T22:22:02.379830+0000","last_became_peered":"2023-09-30T22:22:02.379830+0000","last_unstale":"2023-09-30T22:22:02.385127+0000","last_undegraded":"2023-09-30T22:22:02.385127+0000","last_fullsized":"2023-09-30T22:22:02.385127+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.358776+0000","last_change":"2023-09-30T22:22:01.995093+0000","last_active":"2023-09-30T22:22:02.358776+0000","last_peered":"2023-09-30T22:22:02.358776+0000","last_clean":"2023-09-30T22:22:02.358776+0000","last_became_active":"2023-09-30T22:22:01.994797+0000","last_became_peered":"2023-09-30T22:22:01.994797+0000","last_unstale":"2023-09-30T22:22:02.358776+0000","last_undegraded":"2023-09-30T22:22:02.358776+0000","last_fullsized":"2023-09-30T22:22:02.358776+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394410+0000","last_change":"2023-09-30T22:22:02.383534+0000","last_active":"2023-09-30T22:22:02.394410+0000","last_peered":"2023-09-30T22:22:02.394410+0000","last_clean":"2023-09-30T22:22:02.394410+0000","last_became_active":"2023-09-30T22:22:02.383271+0000","last_became_peered":"2023-09-30T22:22:02.383271+0000","last_unstale":"2023-09-30T22:22:02.394410+0000","last_undegraded":"2023-09-30T22:22:02.394410+0000","last_fullsized":"2023-09-30T22:22:02.394410+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.364409+0000","last_change":"2023-09-30T22:22:01.997405+0000","last_active":"2023-09-30T22:22:02.364409+0000","last_peered":"2023-09-30T22:22:02.364409+0000","last_clean":"2023-09-30T22:22:02.364409+0000","last_became_active":"2023-09-30T22:22:01.997079+0000","last_became_peered":"2023-09-30T22:22:01.997079+0000","last_unstale":"2023-09-30T22:22:02.364409+0000","last_undegraded":"2023-09-30T22:22:02.364409+0000","last_fullsized":"2023-09-30T22:22:02.364409+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.384947+0000","last_change":"2023-09-30T22:22:02.381424+0000","last_active":"2023-09-30T22:22:02.384947+0000","last_peered":"2023-09-30T22:22:02.384947+0000","last_clean":"2023-09-30T22:22:02.384947+0000","last_became_active":"2023-09-30T22:22:02.380981+0000","last_became_peered":"2023-09-30T22:22:02.380981+0000","last_unstale":"2023-09-30T22:22:02.384947+0000","last_undegraded":"2023-09-30T22:22:02.384947+0000","last_fullsized":"2023-09-30T22:22:02.384947+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.368614+0000","last_change":"2023-09-30T22:22:01.995183+0000","last_active":"2023-09-30T22:22:02.368614+0000","last_peered":"2023-09-30T22:22:02.368614+0000","last_clean":"2023-09-30T22:22:02.368614+0000","last_became_active":"2023-09-30T22:22:01.994920+0000","last_became_peered":"2023-09-30T22:22:01.994920+0000","last_unstale":"2023-09-30T22:22:02.368614+0000","last_undegraded":"2023-09-30T22:22:02.368614+0000","last_fullsized":"2023-09-30T22:22:02.368614+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.399138+0000","last_change":"2023-09-30T22:22:02.395975+0000","last_active":"2023-09-30T22:22:02.399138+0000","last_peered":"2023-09-30T22:22:02.399138+0000","last_clean":"2023-09-30T22:22:02.399138+0000","last_became_active":"2023-09-30T22:22:02.395719+0000","last_became_peered":"2023-09-30T22:22:02.395719+0000","last_unstale":"2023-09-30T22:22:02.399138+0000","last_undegraded":"2023-09-30T22:22:02.399138+0000","last_fullsized":"2023-09-30T22:22:02.399138+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.398556+0000","last_change":"2023-09-30T22:22:01.998235+0000","last_active":"2023-09-30T22:22:02.398556+0000","last_peered":"2023-09-30T22:22:02.398556+0000","last_clean":"2023-09-30T22:22:02.398556+0000","last_became_active":"2023-09-30T22:22:01.997649+0000","last_became_peered":"2023-09-30T22:22:01.997649+0000","last_unstale":"2023-09-30T22:22:02.398556+0000","last_undegraded":"2023-09-30T22:22:02.398556+0000","last_fullsized":"2023-09-30T22:22:02.398556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394877+0000","last_change":"2023-09-30T22:22:02.390318+0000","last_active":"2023-09-30T22:22:02.394877+0000","last_peered":"2023-09-30T22:22:02.394877+0000","last_clean":"2023-09-30T22:22:02.394877+0000","last_became_active":"2023-09-30T22:22:02.390020+0000","last_became_peered":"2023-09-30T22:22:02.390020+0000","last_unstale":"2023-09-30T22:22:02.394877+0000","last_undegraded":"2023-09-30T22:22:02.394877+0000","last_fullsized":"2023-09-30T22:22:02.394877+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"16'6","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.404225+0000","last_change":"2023-09-30T22:22:01.993933+0000","last_active":"2023-09-30T22:22:02.404225+0000","last_peered":"2023-09-30T22:22:02.404225+0000","last_clean":"2023-09-30T22:22:02.404225+0000","last_became_active":"2023-09-30T22:22:01.993574+0000","last_became_peered":"2023-09-30T22:22:01.993574+0000","last_unstale":"2023-09-30T22:22:02.404225+0000","last_undegraded":"2023-09-30T22:22:02.404225+0000","last_fullsized":"2023-09-30T22:22:02.404225+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393799+0000","last_change":"2023-09-30T22:22:02.387576+0000","last_active":"2023-09-30T22:22:02.393799+0000","last_peered":"2023-09-30T22:22:02.393799+0000","last_clean":"2023-09-30T22:22:02.393799+0000","last_became_active":"2023-09-30T22:22:02.387235+0000","last_became_peered":"2023-09-30T22:22:02.387235+0000","last_unstale":"2023-09-30T22:22:02.393799+0000","last_undegraded":"2023-09-30T22:22:02.393799+0000","last_fullsized":"2023-09-30T22:22:02.393799+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.397834+0000","last_change":"2023-09-30T22:22:01.995522+0000","last_active":"2023-09-30T22:22:02.397834+0000","last_peered":"2023-09-30T22:22:02.397834+0000","last_clean":"2023-09-30T22:22:02.397834+0000","last_became_active":"2023-09-30T22:22:01.994928+0000","last_became_peered":"2023-09-30T22:22:01.994928+0000","last_unstale":"2023-09-30T22:22:02.397834+0000","last_undegraded":"2023-09-30T22:22:02.397834+0000","last_fullsized":"2023-09-30T22:22:02.397834+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394448+0000","last_change":"2023-09-30T22:22:02.383942+0000","last_active":"2023-09-30T22:22:02.394448+0000","last_peered":"2023-09-30T22:22:02.394448+0000","last_clean":"2023-09-30T22:22:02.394448+0000","last_became_active":"2023-09-30T22:22:02.383663+0000","last_became_peered":"2023-09-30T22:22:02.383663+0000","last_unstale":"2023-09-30T22:22:02.394448+0000","last_undegraded":"2023-09-30T22:22:02.394448+0000","last_fullsized":"2023-09-30T22:22:02.394448+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.360247+0000","last_change":"2023-09-30T22:22:01.997424+0000","last_active":"2023-09-30T22:22:02.360247+0000","last_peered":"2023-09-30T22:22:02.360247+0000","last_clean":"2023-09-30T22:22:02.360247+0000","last_became_active":"2023-09-30T22:22:01.997098+0000","last_became_peered":"2023-09-30T22:22:01.997098+0000","last_unstale":"2023-09-30T22:22:02.360247+0000","last_undegraded":"2023-09-30T22:22:02.360247+0000","last_fullsized":"2023-09-30T22:22:02.360247+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.399142+0000","last_change":"2023-09-30T22:22:02.396425+0000","last_active":"2023-09-30T22:22:02.399142+0000","last_peered":"2023-09-30T22:22:02.399142+0000","last_clean":"2023-09-30T22:22:02.399142+0000","last_became_active":"2023-09-30T22:22:02.396152+0000","last_became_peered":"2023-09-30T22:22:02.396152+0000","last_unstale":"2023-09-30T22:22:02.399142+0000","last_undegraded":"2023-09-30T22:22:02.399142+0000","last_fullsized":"2023-09-30T22:22:02.399142+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.363664+0000","last_change":"2023-09-30T22:22:01.994313+0000","last_active":"2023-09-30T22:22:02.363664+0000","last_peered":"2023-09-30T22:22:02.363664+0000","last_clean":"2023-09-30T22:22:02.363664+0000","last_became_active":"2023-09-30T22:22:01.993994+0000","last_became_peered":"2023-09-30T22:22:01.993994+0000","last_unstale":"2023-09-30T22:22:02.363664+0000","last_undegraded":"2023-09-30T22:22:02.363664+0000","last_fullsized":"2023-09-30T22:22:02.363664+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.395039+0000","last_change":"2023-09-30T22:22:02.391210+0000","last_active":"2023-09-30T22:22:02.395039+0000","last_peered":"2023-09-30T22:22:02.395039+0000","last_clean":"2023-09-30T22:22:02.395039+0000","last_became_active":"2023-09-30T22:22:02.390937+0000","last_became_peered":"2023-09-30T22:22:02.390937+0000","last_unstale":"2023-09-30T22:22:02.395039+0000","last_undegraded":"2023-09-30T22:22:02.395039+0000","last_fullsized":"2023-09-30T22:22:02.395039+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.389161+0000","last_change":"2023-09-30T22:22:01.974848+0000","last_active":"2023-09-30T22:22:02.389161+0000","last_peered":"2023-09-30T22:22:02.389161+0000","last_clean":"2023-09-30T22:22:02.389161+0000","last_became_active":"2023-09-30T22:22:01.974025+0000","last_became_peered":"2023-09-30T22:22:01.974025+0000","last_unstale":"2023-09-30T22:22:02.389161+0000","last_undegraded":"2023-09-30T22:22:02.389161+0000","last_fullsized":"2023-09-30T22:22:02.389161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394389+0000","last_change":"2023-09-30T22:22:02.383497+0000","last_active":"2023-09-30T22:22:02.394389+0000","last_peered":"2023-09-30T22:22:02.394389+0000","last_clean":"2023-09-30T22:22:02.394389+0000","last_became_active":"2023-09-30T22:22:02.383215+0000","last_became_peered":"2023-09-30T22:22:02.383215+0000","last_unstale":"2023-09-30T22:22:02.394389+0000","last_undegraded":"2023-09-30T22:22:02.394389+0000","last_fullsized":"2023-09-30T22:22:02.394389+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393941+0000","last_change":"2023-09-30T22:22:01.979910+0000","last_active":"2023-09-30T22:22:02.393941+0000","last_peered":"2023-09-30T22:22:02.393941+0000","last_clean":"2023-09-30T22:22:02.393941+0000","last_became_active":"2023-09-30T22:22:01.979649+0000","last_became_peered":"2023-09-30T22:22:01.979649+0000","last_unstale":"2023-09-30T22:22:02.393941+0000","last_undegraded":"2023-09-30T22:22:02.393941+0000","last_fullsized":"2023-09-30T22:22:02.393941+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.384926+0000","last_change":"2023-09-30T22:22:02.381246+0000","last_active":"2023-09-30T22:22:02.384926+0000","last_peered":"2023-09-30T22:22:02.384926+0000","last_clean":"2023-09-30T22:22:02.384926+0000","last_became_active":"2023-09-30T22:22:02.380654+0000","last_became_peered":"2023-09-30T22:22:02.380654+0000","last_unstale":"2023-09-30T22:22:02.384926+0000","last_undegraded":"2023-09-30T22:22:02.384926+0000","last_fullsized":"2023-09-30T22:22:02.384926+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.386375+0000","last_change":"2023-09-30T22:22:01.990442+0000","last_active":"2023-09-30T22:22:02.386375+0000","last_peered":"2023-09-30T22:22:02.386375+0000","last_clean":"2023-09-30T22:22:02.386375+0000","last_became_active":"2023-09-30T22:22:01.990217+0000","last_became_peered":"2023-09-30T22:22:01.990217+0000","last_unstale":"2023-09-30T22:22:02.386375+0000","last_undegraded":"2023-09-30T22:22:02.386375+0000","last_fullsized":"2023-09-30T22:22:02.386375+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394816+0000","last_change":"2023-09-30T22:22:02.390201+0000","last_active":"2023-09-30T22:22:02.394816+0000","last_peered":"2023-09-30T22:22:02.394816+0000","last_clean":"2023-09-30T22:22:02.394816+0000","last_became_active":"2023-09-30T22:22:02.389897+0000","last_became_peered":"2023-09-30T22:22:02.389897+0000","last_unstale":"2023-09-30T22:22:02.394816+0000","last_undegraded":"2023-09-30T22:22:02.394816+0000","last_fullsized":"2023-09-30T22:22:02.394816+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.395355+0000","last_change":"2023-09-30T22:22:01.996439+0000","last_active":"2023-09-30T22:22:02.395355+0000","last_peered":"2023-09-30T22:22:02.395355+0000","last_clean":"2023-09-30T22:22:02.395355+0000","last_became_active":"2023-09-30T22:22:01.996114+0000","last_became_peered":"2023-09-30T22:22:01.996114+0000","last_unstale":"2023-09-30T22:22:02.395355+0000","last_undegraded":"2023-09-30T22:22:02.395355+0000","last_fullsized":"2023-09-30T22:22:02.395355+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393352+0000","last_change":"2023-09-30T22:22:02.384428+0000","last_active":"2023-09-30T22:22:02.393352+0000","last_peered":"2023-09-30T22:22:02.393352+0000","last_clean":"2023-09-30T22:22:02.393352+0000","last_became_active":"2023-09-30T22:22:02.383704+0000","last_became_peered":"2023-09-30T22:22:02.383704+0000","last_unstale":"2023-09-30T22:22:02.393352+0000","last_undegraded":"2023-09-30T22:22:02.393352+0000","last_fullsized":"2023-09-30T22:22:02.393352+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.361009+0000","last_change":"2023-09-30T22:22:01.998688+0000","last_active":"2023-09-30T22:22:02.361009+0000","last_peered":"2023-09-30T22:22:02.361009+0000","last_clean":"2023-09-30T22:22:02.361009+0000","last_became_active":"2023-09-30T22:22:01.998390+0000","last_became_peered":"2023-09-30T22:22:01.998390+0000","last_unstale":"2023-09-30T22:22:02.361009+0000","last_undegraded":"2023-09-30T22:22:02.361009+0000","last_fullsized":"2023-09-30T22:22:02.361009+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385081+0000","last_change":"2023-09-30T22:22:02.376261+0000","last_active":"2023-09-30T22:22:02.385081+0000","last_peered":"2023-09-30T22:22:02.385081+0000","last_clean":"2023-09-30T22:22:02.385081+0000","last_became_active":"2023-09-30T22:22:02.375940+0000","last_became_peered":"2023-09-30T22:22:02.375940+0000","last_unstale":"2023-09-30T22:22:02.385081+0000","last_undegraded":"2023-09-30T22:22:02.385081+0000","last_fullsized":"2023-09-30T22:22:02.385081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.397715+0000","last_change":"2023-09-30T22:22:01.995642+0000","last_active":"2023-09-30T22:22:02.397715+0000","last_peered":"2023-09-30T22:22:02.397715+0000","last_clean":"2023-09-30T22:22:02.397715+0000","last_became_active":"2023-09-30T22:22:01.995224+0000","last_became_peered":"2023-09-30T22:22:01.995224+0000","last_unstale":"2023-09-30T22:22:02.397715+0000","last_undegraded":"2023-09-30T22:22:02.397715+0000","last_fullsized":"2023-09-30T22:22:02.397715+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394834+0000","last_change":"2023-09-30T22:22:02.390443+0000","last_active":"2023-09-30T22:22:02.394834+0000","last_peered":"2023-09-30T22:22:02.394834+0000","last_clean":"2023-09-30T22:22:02.394834+0000","last_became_active":"2023-09-30T22:22:02.390261+0000","last_became_peered":"2023-09-30T22:22:02.390261+0000","last_unstale":"2023-09-30T22:22:02.394834+0000","last_undegraded":"2023-09-30T22:22:02.394834+0000","last_fullsized":"2023-09-30T22:22:02.394834+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.363042+0000","last_change":"2023-09-30T22:22:01.995738+0000","last_active":"2023-09-30T22:22:02.363042+0000","last_peered":"2023-09-30T22:22:02.363042+0000","last_clean":"2023-09-30T22:22:02.363042+0000","last_became_active":"2023-09-30T22:22:01.994552+0000","last_became_peered":"2023-09-30T22:22:01.994552+0000","last_unstale":"2023-09-30T22:22:02.363042+0000","last_undegraded":"2023-09-30T22:22:02.363042+0000","last_fullsized":"2023-09-30T22:22:02.363042+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.388642+0000","last_change":"2023-09-30T22:22:02.382026+0000","last_active":"2023-09-30T22:22:02.388642+0000","last_peered":"2023-09-30T22:22:02.388642+0000","last_clean":"2023-09-30T22:22:02.388642+0000","last_became_active":"2023-09-30T22:22:02.378486+0000","last_became_peered":"2023-09-30T22:22:02.378486+0000","last_unstale":"2023-09-30T22:22:02.388642+0000","last_undegraded":"2023-09-30T22:22:02.388642+0000","last_fullsized":"2023-09-30T22:22:02.388642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.359669+0000","last_change":"2023-09-30T22:22:01.994235+0000","last_active":"2023-09-30T22:22:02.359669+0000","last_peered":"2023-09-30T22:22:02.359669+0000","last_clean":"2023-09-30T22:22:02.359669+0000","last_became_active":"2023-09-30T22:22:01.993882+0000","last_became_peered":"2023-09-30T22:22:01.993882+0000","last_unstale":"2023-09-30T22:22:02.359669+0000","last_undegraded":"2023-09-30T22:22:02.359669+0000","last_fullsized":"2023-09-30T22:22:02.359669+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393722+0000","last_change":"2023-09-30T22:22:02.386102+0000","last_active":"2023-09-30T22:22:02.393722+0000","last_peered":"2023-09-30T22:22:02.393722+0000","last_clean":"2023-09-30T22:22:02.393722+0000","last_became_active":"2023-09-30T22:22:02.384968+0000","last_became_peered":"2023-09-30T22:22:02.384968+0000","last_unstale":"2023-09-30T22:22:02.393722+0000","last_undegraded":"2023-09-30T22:22:02.393722+0000","last_fullsized":"2023-09-30T22:22:02.393722+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.358511+0000","last_change":"2023-09-30T22:22:01.995015+0000","last_active":"2023-09-30T22:22:02.358511+0000","last_peered":"2023-09-30T22:22:02.358511+0000","last_clean":"2023-09-30T22:22:02.358511+0000","last_became_active":"2023-09-30T22:22:01.994743+0000","last_became_peered":"2023-09-30T22:22:01.994743+0000","last_unstale":"2023-09-30T22:22:02.358511+0000","last_undegraded":"2023-09-30T22:22:02.358511+0000","last_fullsized":"2023-09-30T22:22:02.358511+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394399+0000","last_change":"2023-09-30T22:22:02.385985+0000","last_active":"2023-09-30T22:22:02.394399+0000","last_peered":"2023-09-30T22:22:02.394399+0000","last_clean":"2023-09-30T22:22:02.394399+0000","last_became_active":"2023-09-30T22:22:02.385413+0000","last_became_peered":"2023-09-30T22:22:02.385413+0000","last_unstale":"2023-09-30T22:22:02.394399+0000","last_undegraded":"2023-09-30T22:22:02.394399+0000","last_fullsized":"2023-09-30T22:22:02.394399+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.359640+0000","last_change":"2023-09-30T22:21:58.403636+0000","last_active":"2023-09-30T22:22:02.359640+0000","last_peered":"2023-09-30T22:22:02.359640+0000","last_clean":"2023-09-30T22:22:02.359640+0000","last_became_active":"2023-09-30T22:21:58.403342+0000","last_became_peered":"2023-09-30T22:21:58.403342+0000","last_unstale":"2023-09-30T22:22:02.359640+0000","last_undegraded":"2023-09-30T22:22:02.359640+0000","last_fullsized":"2023-09-30T22:22:02.359640+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.364135+0000","last_change":"2023-09-30T22:22:01.997724+0000","last_active":"2023-09-30T22:22:02.364135+0000","last_peered":"2023-09-30T22:22:02.364135+0000","last_clean":"2023-09-30T22:22:02.364135+0000","last_became_active":"2023-09-30T22:22:01.997451+0000","last_became_peered":"2023-09-30T22:22:01.997451+0000","last_unstale":"2023-09-30T22:22:02.364135+0000","last_undegraded":"2023-09-30T22:22:02.364135+0000","last_fullsized":"2023-09-30T22:22:02.364135+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394856+0000","last_change":"2023-09-30T22:22:02.389982+0000","last_active":"2023-09-30T22:22:02.394856+0000","last_peered":"2023-09-30T22:22:02.394856+0000","last_clean":"2023-09-30T22:22:02.394856+0000","last_became_active":"2023-09-30T22:22:02.389680+0000","last_became_peered":"2023-09-30T22:22:02.389680+0000","last_unstale":"2023-09-30T22:22:02.394856+0000","last_undegraded":"2023-09-30T22:22:02.394856+0000","last_fullsized":"2023-09-30T22:22:02.394856+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.363445+0000","last_change":"2023-09-30T22:21:57.839392+0000","last_active":"2023-09-30T22:22:02.363445+0000","last_peered":"2023-09-30T22:22:02.363445+0000","last_clean":"2023-09-30T22:22:02.363445+0000","last_became_active":"2023-09-30T22:21:57.838993+0000","last_became_peered":"2023-09-30T22:21:57.838993+0000","last_unstale":"2023-09-30T22:22:02.363445+0000","last_undegraded":"2023-09-30T22:22:02.363445+0000","last_fullsized":"2023-09-30T22:22:02.363445+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.363117+0000","last_change":"2023-09-30T22:22:01.990265+0000","last_active":"2023-09-30T22:22:02.363117+0000","last_peered":"2023-09-30T22:22:02.363117+0000","last_clean":"2023-09-30T22:22:02.363117+0000","last_became_active":"2023-09-30T22:22:01.990011+0000","last_became_peered":"2023-09-30T22:22:01.990011+0000","last_unstale":"2023-09-30T22:22:02.363117+0000","last_undegraded":"2023-09-30T22:22:02.363117+0000","last_fullsized":"2023-09-30T22:22:02.363117+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.383793+0000","last_change":"2023-09-30T22:22:02.374205+0000","last_active":"2023-09-30T22:22:02.383793+0000","last_peered":"2023-09-30T22:22:02.383793+0000","last_clean":"2023-09-30T22:22:02.383793+0000","last_became_active":"2023-09-30T22:22:02.373928+0000","last_became_peered":"2023-09-30T22:22:02.373928+0000","last_unstale":"2023-09-30T22:22:02.383793+0000","last_undegraded":"2023-09-30T22:22:02.383793+0000","last_fullsized":"2023-09-30T22:22:02.383793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.363749+0000","last_change":"2023-09-30T22:21:57.836160+0000","last_active":"2023-09-30T22:22:02.363749+0000","last_peered":"2023-09-30T22:22:02.363749+0000","last_clean":"2023-09-30T22:22:02.363749+0000","last_became_active":"2023-09-30T22:21:57.835792+0000","last_became_peered":"2023-09-30T22:21:57.835792+0000","last_unstale":"2023-09-30T22:22:02.363749+0000","last_undegraded":"2023-09-30T22:22:02.363749+0000","last_fullsized":"2023-09-30T22:22:02.363749+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.359810+0000","last_change":"2023-09-30T22:22:01.987700+0000","last_active":"2023-09-30T22:22:02.359810+0000","last_peered":"2023-09-30T22:22:02.359810+0000","last_clean":"2023-09-30T22:22:02.359810+0000","last_became_active":"2023-09-30T22:22:01.987358+0000","last_became_peered":"2023-09-30T22:22:01.987358+0000","last_unstale":"2023-09-30T22:22:02.359810+0000","last_undegraded":"2023-09-30T22:22:02.359810+0000","last_fullsized":"2023-09-30T22:22:02.359810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.382010+0000","last_change":"2023-09-30T22:22:02.379845+0000","last_active":"2023-09-30T22:22:02.382010+0000","last_peered":"2023-09-30T22:22:02.382010+0000","last_clean":"2023-09-30T22:22:02.382010+0000","last_became_active":"2023-09-30T22:22:02.379594+0000","last_became_peered":"2023-09-30T22:22:02.379594+0000","last_unstale":"2023-09-30T22:22:02.382010+0000","last_undegraded":"2023-09-30T22:22:02.382010+0000","last_fullsized":"2023-09-30T22:22:02.382010+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.359678+0000","last_change":"2023-09-30T22:21:57.838957+0000","last_active":"2023-09-30T22:22:02.359678+0000","last_peered":"2023-09-30T22:22:02.359678+0000","last_clean":"2023-09-30T22:22:02.359678+0000","last_became_active":"2023-09-30T22:21:57.838667+0000","last_became_peered":"2023-09-30T22:21:57.838667+0000","last_unstale":"2023-09-30T22:22:02.359678+0000","last_undegraded":"2023-09-30T22:22:02.359678+0000","last_fullsized":"2023-09-30T22:22:02.359678+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.359529+0000","last_change":"2023-09-30T22:21:56.838072+0000","last_active":"2023-09-30T22:22:02.359529+0000","last_peered":"2023-09-30T22:22:02.359529+0000","last_clean":"2023-09-30T22:22:02.359529+0000","last_became_active":"2023-09-30T22:21:56.837717+0000","last_became_peered":"2023-09-30T22:21:56.837717+0000","last_unstale":"2023-09-30T22:22:02.359529+0000","last_undegraded":"2023-09-30T22:22:02.359529+0000","last_fullsized":"2023-09-30T22:22:02.359529+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:55.823939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:55.823939+0000","last_clean_scrub_stamp":"2023-09-30T22:21:55.823939+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.362949+0000","last_change":"2023-09-30T22:22:01.994653+0000","last_active":"2023-09-30T22:22:02.362949+0000","last_peered":"2023-09-30T22:22:02.362949+0000","last_clean":"2023-09-30T22:22:02.362949+0000","last_became_active":"2023-09-30T22:22:01.994362+0000","last_became_peered":"2023-09-30T22:22:01.994362+0000","last_unstale":"2023-09-30T22:22:02.362949+0000","last_undegraded":"2023-09-30T22:22:02.362949+0000","last_fullsized":"2023-09-30T22:22:02.362949+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.388623+0000","last_change":"2023-09-30T22:22:02.381190+0000","last_active":"2023-09-30T22:22:02.388623+0000","last_peered":"2023-09-30T22:22:02.388623+0000","last_clean":"2023-09-30T22:22:02.388623+0000","last_became_active":"2023-09-30T22:22:02.380952+0000","last_became_peered":"2023-09-30T22:22:02.380952+0000","last_unstale":"2023-09-30T22:22:02.388623+0000","last_undegraded":"2023-09-30T22:22:02.388623+0000","last_fullsized":"2023-09-30T22:22:02.388623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.358689+0000","last_change":"2023-09-30T22:21:57.837598+0000","last_active":"2023-09-30T22:22:02.358689+0000","last_peered":"2023-09-30T22:22:02.358689+0000","last_clean":"2023-09-30T22:22:02.358689+0000","last_became_active":"2023-09-30T22:21:57.837284+0000","last_became_peered":"2023-09-30T22:21:57.837284+0000","last_unstale":"2023-09-30T22:22:02.358689+0000","last_undegraded":"2023-09-30T22:22:02.358689+0000","last_fullsized":"2023-09-30T22:22:02.358689+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.364183+0000","last_change":"2023-09-30T22:22:01.983059+0000","last_active":"2023-09-30T22:22:02.364183+0000","last_peered":"2023-09-30T22:22:02.364183+0000","last_clean":"2023-09-30T22:22:02.364183+0000","last_became_active":"2023-09-30T22:22:01.982739+0000","last_became_peered":"2023-09-30T22:22:01.982739+0000","last_unstale":"2023-09-30T22:22:02.364183+0000","last_undegraded":"2023-09-30T22:22:02.364183+0000","last_fullsized":"2023-09-30T22:22:02.364183+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385106+0000","last_change":"2023-09-30T22:22:02.380074+0000","last_active":"2023-09-30T22:22:02.385106+0000","last_peered":"2023-09-30T22:22:02.385106+0000","last_clean":"2023-09-30T22:22:02.385106+0000","last_became_active":"2023-09-30T22:22:02.379501+0000","last_became_peered":"2023-09-30T22:22:02.379501+0000","last_unstale":"2023-09-30T22:22:02.385106+0000","last_undegraded":"2023-09-30T22:22:02.385106+0000","last_fullsized":"2023-09-30T22:22:02.385106+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.364495+0000","last_change":"2023-09-30T22:21:58.403508+0000","last_active":"2023-09-30T22:22:02.364495+0000","last_peered":"2023-09-30T22:22:02.364495+0000","last_clean":"2023-09-30T22:22:02.364495+0000","last_became_active":"2023-09-30T22:21:58.403267+0000","last_became_peered":"2023-09-30T22:21:58.403267+0000","last_unstale":"2023-09-30T22:22:02.364495+0000","last_undegraded":"2023-09-30T22:22:02.364495+0000","last_fullsized":"2023-09-30T22:22:02.364495+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.359534+0000","last_change":"2023-09-30T22:22:01.987265+0000","last_active":"2023-09-30T22:22:02.359534+0000","last_peered":"2023-09-30T22:22:02.359534+0000","last_clean":"2023-09-30T22:22:02.359534+0000","last_became_active":"2023-09-30T22:22:01.986968+0000","last_became_peered":"2023-09-30T22:22:01.986968+0000","last_unstale":"2023-09-30T22:22:02.359534+0000","last_undegraded":"2023-09-30T22:22:02.359534+0000","last_fullsized":"2023-09-30T22:22:02.359534+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.385062+0000","last_change":"2023-09-30T22:22:02.376013+0000","last_active":"2023-09-30T22:22:02.385062+0000","last_peered":"2023-09-30T22:22:02.385062+0000","last_clean":"2023-09-30T22:22:02.385062+0000","last_became_active":"2023-09-30T22:22:02.374252+0000","last_became_peered":"2023-09-30T22:22:02.374252+0000","last_unstale":"2023-09-30T22:22:02.385062+0000","last_undegraded":"2023-09-30T22:22:02.385062+0000","last_fullsized":"2023-09-30T22:22:02.385062+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.395176+0000","last_change":"2023-09-30T22:22:01.994188+0000","last_active":"2023-09-30T22:22:02.395176+0000","last_peered":"2023-09-30T22:22:02.395176+0000","last_clean":"2023-09-30T22:22:02.395176+0000","last_became_active":"2023-09-30T22:22:01.993644+0000","last_became_peered":"2023-09-30T22:22:01.993644+0000","last_unstale":"2023-09-30T22:22:02.395176+0000","last_undegraded":"2023-09-30T22:22:02.395176+0000","last_fullsized":"2023-09-30T22:22:02.395176+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.360873+0000","last_change":"2023-09-30T22:21:58.403570+0000","last_active":"2023-09-30T22:22:02.360873+0000","last_peered":"2023-09-30T22:22:02.360873+0000","last_clean":"2023-09-30T22:22:02.360873+0000","last_became_active":"2023-09-30T22:21:58.403321+0000","last_became_peered":"2023-09-30T22:21:58.403321+0000","last_unstale":"2023-09-30T22:22:02.360873+0000","last_undegraded":"2023-09-30T22:22:02.360873+0000","last_fullsized":"2023-09-30T22:22:02.360873+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.381516+0000","last_change":"2023-09-30T22:22:02.372818+0000","last_active":"2023-09-30T22:22:02.381516+0000","last_peered":"2023-09-30T22:22:02.381516+0000","last_clean":"2023-09-30T22:22:02.381516+0000","last_became_active":"2023-09-30T22:22:02.372623+0000","last_became_peered":"2023-09-30T22:22:02.372623+0000","last_unstale":"2023-09-30T22:22:02.381516+0000","last_undegraded":"2023-09-30T22:22:02.381516+0000","last_fullsized":"2023-09-30T22:22:02.381516+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.369758+0000","last_change":"2023-09-30T22:21:58.404380+0000","last_active":"2023-09-30T22:22:02.369758+0000","last_peered":"2023-09-30T22:22:02.369758+0000","last_clean":"2023-09-30T22:22:02.369758+0000","last_became_active":"2023-09-30T22:21:58.404098+0000","last_became_peered":"2023-09-30T22:21:58.404098+0000","last_unstale":"2023-09-30T22:22:02.369758+0000","last_undegraded":"2023-09-30T22:22:02.369758+0000","last_fullsized":"2023-09-30T22:22:02.369758+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T22:22:03.703353+0000","last_change":"2023-09-30T22:22:01.977163+0000","last_active":"2023-09-30T22:22:03.703353+0000","last_peered":"2023-09-30T22:22:03.703353+0000","last_clean":"2023-09-30T22:22:03.703353+0000","last_became_active":"2023-09-30T22:22:01.976494+0000","last_became_peered":"2023-09-30T22:22:01.976494+0000","last_unstale":"2023-09-30T22:22:03.703353+0000","last_undegraded":"2023-09-30T22:22:03.703353+0000","last_fullsized":"2023-09-30T22:22:03.703353+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393757+0000","last_change":"2023-09-30T22:22:02.386251+0000","last_active":"2023-09-30T22:22:02.393757+0000","last_peered":"2023-09-30T22:22:02.393757+0000","last_clean":"2023-09-30T22:22:02.393757+0000","last_became_active":"2023-09-30T22:22:02.385701+0000","last_became_peered":"2023-09-30T22:22:02.385701+0000","last_unstale":"2023-09-30T22:22:02.393757+0000","last_undegraded":"2023-09-30T22:22:02.393757+0000","last_fullsized":"2023-09-30T22:22:02.393757+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.398231+0000","last_change":"2023-09-30T22:22:01.997989+0000","last_active":"2023-09-30T22:22:02.398231+0000","last_peered":"2023-09-30T22:22:02.398231+0000","last_clean":"2023-09-30T22:22:02.398231+0000","last_became_active":"2023-09-30T22:22:01.997419+0000","last_became_peered":"2023-09-30T22:22:01.997419+0000","last_unstale":"2023-09-30T22:22:02.398231+0000","last_undegraded":"2023-09-30T22:22:02.398231+0000","last_fullsized":"2023-09-30T22:22:02.398231+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380856+0000","last_change":"2023-09-30T22:22:02.379106+0000","last_active":"2023-09-30T22:22:02.380856+0000","last_peered":"2023-09-30T22:22:02.380856+0000","last_clean":"2023-09-30T22:22:02.380856+0000","last_became_active":"2023-09-30T22:22:02.378452+0000","last_became_peered":"2023-09-30T22:22:02.378452+0000","last_unstale":"2023-09-30T22:22:02.380856+0000","last_undegraded":"2023-09-30T22:22:02.380856+0000","last_fullsized":"2023-09-30T22:22:02.380856+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380701+0000","last_change":"2023-09-30T22:22:01.977515+0000","last_active":"2023-09-30T22:22:02.380701+0000","last_peered":"2023-09-30T22:22:02.380701+0000","last_clean":"2023-09-30T22:22:02.380701+0000","last_became_active":"2023-09-30T22:22:01.976843+0000","last_became_peered":"2023-09-30T22:22:01.976843+0000","last_unstale":"2023-09-30T22:22:02.380701+0000","last_undegraded":"2023-09-30T22:22:02.380701+0000","last_fullsized":"2023-09-30T22:22:02.380701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393819+0000","last_change":"2023-09-30T22:22:02.387751+0000","last_active":"2023-09-30T22:22:02.393819+0000","last_peered":"2023-09-30T22:22:02.393819+0000","last_clean":"2023-09-30T22:22:02.393819+0000","last_became_active":"2023-09-30T22:22:02.387326+0000","last_became_peered":"2023-09-30T22:22:02.387326+0000","last_unstale":"2023-09-30T22:22:02.393819+0000","last_undegraded":"2023-09-30T22:22:02.393819+0000","last_fullsized":"2023-09-30T22:22:02.393819+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.395931+0000","last_change":"2023-09-30T22:22:01.996439+0000","last_active":"2023-09-30T22:22:02.395931+0000","last_peered":"2023-09-30T22:22:02.395931+0000","last_clean":"2023-09-30T22:22:02.395931+0000","last_became_active":"2023-09-30T22:22:01.996179+0000","last_became_peered":"2023-09-30T22:22:01.996179+0000","last_unstale":"2023-09-30T22:22:02.395931+0000","last_undegraded":"2023-09-30T22:22:02.395931+0000","last_fullsized":"2023-09-30T22:22:02.395931+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393375+0000","last_change":"2023-09-30T22:22:02.384588+0000","last_active":"2023-09-30T22:22:02.393375+0000","last_peered":"2023-09-30T22:22:02.393375+0000","last_clean":"2023-09-30T22:22:02.393375+0000","last_became_active":"2023-09-30T22:22:02.384072+0000","last_became_peered":"2023-09-30T22:22:02.384072+0000","last_unstale":"2023-09-30T22:22:02.393375+0000","last_undegraded":"2023-09-30T22:22:02.393375+0000","last_fullsized":"2023-09-30T22:22:02.393375+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.393972+0000","last_change":"2023-09-30T22:22:01.993986+0000","last_active":"2023-09-30T22:22:02.393972+0000","last_peered":"2023-09-30T22:22:02.393972+0000","last_clean":"2023-09-30T22:22:02.393972+0000","last_became_active":"2023-09-30T22:22:01.993575+0000","last_became_peered":"2023-09-30T22:22:01.993575+0000","last_unstale":"2023-09-30T22:22:02.393972+0000","last_undegraded":"2023-09-30T22:22:02.393972+0000","last_fullsized":"2023-09-30T22:22:02.393972+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.383708+0000","last_change":"2023-09-30T22:22:02.378109+0000","last_active":"2023-09-30T22:22:02.383708+0000","last_peered":"2023-09-30T22:22:02.383708+0000","last_clean":"2023-09-30T22:22:02.383708+0000","last_became_active":"2023-09-30T22:22:02.377671+0000","last_became_peered":"2023-09-30T22:22:02.377671+0000","last_unstale":"2023-09-30T22:22:02.383708+0000","last_undegraded":"2023-09-30T22:22:02.383708+0000","last_fullsized":"2023-09-30T22:22:02.383708+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.386441+0000","last_change":"2023-09-30T22:22:01.980853+0000","last_active":"2023-09-30T22:22:02.386441+0000","last_peered":"2023-09-30T22:22:02.386441+0000","last_clean":"2023-09-30T22:22:02.386441+0000","last_became_active":"2023-09-30T22:22:01.979795+0000","last_became_peered":"2023-09-30T22:22:01.979795+0000","last_unstale":"2023-09-30T22:22:02.386441+0000","last_undegraded":"2023-09-30T22:22:02.386441+0000","last_fullsized":"2023-09-30T22:22:02.386441+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380713+0000","last_change":"2023-09-30T22:22:02.377790+0000","last_active":"2023-09-30T22:22:02.380713+0000","last_peered":"2023-09-30T22:22:02.380713+0000","last_clean":"2023-09-30T22:22:02.380713+0000","last_became_active":"2023-09-30T22:22:02.377478+0000","last_became_peered":"2023-09-30T22:22:02.377478+0000","last_unstale":"2023-09-30T22:22:02.380713+0000","last_undegraded":"2023-09-30T22:22:02.380713+0000","last_fullsized":"2023-09-30T22:22:02.380713+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.380254+0000","last_change":"2023-09-30T22:22:02.373820+0000","last_active":"2023-09-30T22:22:02.380254+0000","last_peered":"2023-09-30T22:22:02.380254+0000","last_clean":"2023-09-30T22:22:02.380254+0000","last_became_active":"2023-09-30T22:22:02.373530+0000","last_became_peered":"2023-09-30T22:22:02.373530+0000","last_unstale":"2023-09-30T22:22:02.380254+0000","last_undegraded":"2023-09-30T22:22:02.380254+0000","last_fullsized":"2023-09-30T22:22:02.380254+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.383688+0000","last_change":"2023-09-30T22:22:02.377945+0000","last_active":"2023-09-30T22:22:02.383688+0000","last_peered":"2023-09-30T22:22:02.383688+0000","last_clean":"2023-09-30T22:22:02.383688+0000","last_became_active":"2023-09-30T22:22:02.377355+0000","last_became_peered":"2023-09-30T22:22:02.377355+0000","last_unstale":"2023-09-30T22:22:02.383688+0000","last_undegraded":"2023-09-30T22:22:02.383688+0000","last_fullsized":"2023-09-30T22:22:02.383688+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.394694+0000","last_change":"2023-09-30T22:22:02.387890+0000","last_active":"2023-09-30T22:22:02.394694+0000","last_peered":"2023-09-30T22:22:02.394694+0000","last_clean":"2023-09-30T22:22:02.394694+0000","last_became_active":"2023-09-30T22:22:02.387599+0000","last_became_peered":"2023-09-30T22:22:02.387599+0000","last_unstale":"2023-09-30T22:22:02.394694+0000","last_undegraded":"2023-09-30T22:22:02.394694+0000","last_fullsized":"2023-09-30T22:22:02.394694+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.397499+0000","last_change":"2023-09-30T22:22:02.385159+0000","last_active":"2023-09-30T22:22:02.397499+0000","last_peered":"2023-09-30T22:22:02.397499+0000","last_clean":"2023-09-30T22:22:02.397499+0000","last_became_active":"2023-09-30T22:22:02.376532+0000","last_became_peered":"2023-09-30T22:22:02.376532+0000","last_unstale":"2023-09-30T22:22:02.397499+0000","last_undegraded":"2023-09-30T22:22:02.397499+0000","last_fullsized":"2023-09-30T22:22:02.397499+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:22:02.383770+0000","last_change":"2023-09-30T22:22:02.374216+0000","last_active":"2023-09-30T22:22:02.383770+0000","last_peered":"2023-09-30T22:22:02.383770+0000","last_clean":"2023-09-30T22:22:02.383770+0000","last_became_active":"2023-09-30T22:22:02.373952+0000","last_became_peered":"2023-09-30T22:22:02.373952+0000","last_unstale":"2023-09-30T22:22:02.383770+0000","last_undegraded":"2023-09-30T22:22:02.383770+0000","last_fullsized":"2023-09-30T22:22:02.383770+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297264,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074576,"statfs":{"total":96636764160,"available":96332365824,"internally_reserved":0,"allocated":172032,"data_stored":48929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26700000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":48735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":46930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":47845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T22:22:14.858 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-30T22:22:14.858 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-09-30T22:22:14.858 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-09-30T22:22:14.859 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T22:22:15.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.010+0000 7f2af8161700 1 Processor -- start 2023-09-30T22:22:15.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.010+0000 7f2af8161700 1 -- start start 2023-09-30T22:22:15.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.011+0000 7f2af8161700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2af0062e60 0x7f2af012af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:15.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.011+0000 7f2af8161700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2af0130060 0x7f2af0132450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:15.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.011+0000 7f2af8161700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2af00685f0 con 0x7f2af0093250 2023-09-30T22:22:15.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.011+0000 7f2af8161700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2af00671d0 con 0x7f2af0130060 2023-09-30T22:22:15.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.011+0000 7f2af8161700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af012ad30 con 0x7f2af0062e60 2023-09-30T22:22:15.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.011+0000 7f2af56fc700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2af0093250 0x7f2af012b410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53274/0 (socket says 172.21.15.40:53274) 2023-09-30T22:22:15.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.011+0000 7f2af5efd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2af0062e60 0x7f2af012af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:15.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.011+0000 7f2af56fc700 1 -- 172.21.15.40:0/2179386246 learned_addr learned my addr 172.21.15.40:0/2179386246 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:22:15.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.011+0000 7f2af66fe700 1 --2- 172.21.15.40:0/2179386246 >> v2:172.21.15.40:3300/0 conn(0x7f2af0130060 0x7f2af0132450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:15.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.011+0000 7f2af4efb700 1 -- 172.21.15.40:0/2179386246 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3978988338 0 0) 0x7f2af00685f0 con 0x7f2af0093250 2023-09-30T22:22:15.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.011+0000 7f2af4efb700 1 -- 172.21.15.40:0/2179386246 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2adc0033f0 con 0x7f2af0093250 2023-09-30T22:22:15.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.011+0000 7f2af5efd700 1 -- 172.21.15.40:0/2179386246 >> v2:172.21.15.40:3300/0 conn(0x7f2af0130060 msgr2=0x7f2af0132450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:15.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.011+0000 7f2af5efd700 1 --2- 172.21.15.40:0/2179386246 >> v2:172.21.15.40:3300/0 conn(0x7f2af0130060 0x7f2af0132450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:15.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.011+0000 7f2af5efd700 1 -- 172.21.15.40:0/2179386246 >> v1:172.21.15.40:6789/0 conn(0x7f2af0093250 legacy=0x7f2af012b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.011+0000 7f2af5efd700 1 -- 172.21.15.40:0/2179386246 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af00676e0 con 0x7f2af0062e60 2023-09-30T22:22:15.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.011+0000 7f2af66fe700 1 --2- 172.21.15.40:0/2179386246 >> v2:172.21.15.40:3300/0 conn(0x7f2af0130060 0x7f2af0132450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:15.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.012+0000 7f2af5efd700 1 --2- 172.21.15.40:0/2179386246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2af0062e60 0x7f2af012af20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f2aec009760 tx=0x7f2aec009060).ready entity=mon.1 client_cookie=321813ba4d0eda18 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:15.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.012+0000 7f2af4efb700 1 -- 172.21.15.40:0/2179386246 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec00d4a0 con 0x7f2af0062e60 2023-09-30T22:22:15.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.012+0000 7f2af4efb700 1 -- 172.21.15.40:0/2179386246 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aec00d600 con 0x7f2af0062e60 2023-09-30T22:22:15.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.012+0000 7f2af4efb700 1 -- 172.21.15.40:0/2179386246 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec00d980 con 0x7f2af0062e60 2023-09-30T22:22:15.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.012+0000 7f2af8161700 1 -- 172.21.15.40:0/2179386246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2af0062e60 msgr2=0x7f2af012af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.012+0000 7f2af8161700 1 --2- 172.21.15.40:0/2179386246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2af0062e60 0x7f2af012af20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f2aec009760 tx=0x7f2aec009060).stop 2023-09-30T22:22:15.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.012+0000 7f2af8161700 1 -- 172.21.15.40:0/2179386246 shutdown_connections 2023-09-30T22:22:15.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.012+0000 7f2af8161700 1 --2- 172.21.15.40:0/2179386246 >> v2:172.21.15.40:3300/0 conn(0x7f2af0130060 0x7f2af0132450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:15.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.012+0000 7f2af8161700 1 --2- 172.21.15.40:0/2179386246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2af0062e60 0x7f2af012af20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:15.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.012+0000 7f2af8161700 1 -- 172.21.15.40:0/2179386246 >> 172.21.15.40:0/2179386246 conn(0x7f2af009a450 msgr2=0x7f2af009a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:15.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.012+0000 7f2af8161700 1 -- 172.21.15.40:0/2179386246 shutdown_connections 2023-09-30T22:22:15.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.012+0000 7f2af8161700 1 -- 172.21.15.40:0/2179386246 wait complete. 2023-09-30T22:22:15.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.013+0000 7f2af8161700 1 Processor -- start 2023-09-30T22:22:15.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.013+0000 7f2af8161700 1 -- start start 2023-09-30T22:22:15.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.014+0000 7f2af8161700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2af0062e60 0x7f2af0116570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:15.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.014+0000 7f2af8161700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2af0093250 0x7f2af01125d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:15.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.014+0000 7f2af8161700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2af0130060 0x7f2af0112ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:15.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.014+0000 7f2af8161700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af012a710 con 0x7f2af0093250 2023-09-30T22:22:15.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.014+0000 7f2af8161700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af0116070 con 0x7f2af0130060 2023-09-30T22:22:15.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.014+0000 7f2af8161700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2af0132670 con 0x7f2af0062e60 2023-09-30T22:22:15.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.014+0000 7f2af5efd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2af0062e60 0x7f2af0116570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:15.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.014+0000 7f2af56fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2af0093250 0x7f2af01125d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:15.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.014+0000 7f2af66fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2af0130060 0x7f2af0112ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:15.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.014+0000 7f2af5efd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2af0062e60 0x7f2af0116570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33486/0 (socket says 172.21.15.40:33486) 2023-09-30T22:22:15.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.014+0000 7f2af5efd700 1 -- 172.21.15.40:0/182629103 learned_addr learned my addr 172.21.15.40:0/182629103 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:15.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.014+0000 7f2af66fe700 1 -- 172.21.15.40:0/182629103 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2af0062e60 msgr2=0x7f2af0116570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.014+0000 7f2af66fe700 1 --2- 172.21.15.40:0/182629103 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2af0062e60 0x7f2af0116570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:15.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.014+0000 7f2af66fe700 1 -- 172.21.15.40:0/182629103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2af0093250 msgr2=0x7f2af01125d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.014+0000 7f2af66fe700 1 --2- 172.21.15.40:0/182629103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2af0093250 0x7f2af01125d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:15.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.014+0000 7f2af66fe700 1 -- 172.21.15.40:0/182629103 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae8009a20 con 0x7f2af0130060 2023-09-30T22:22:15.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.014+0000 7f2af5efd700 1 --2- 172.21.15.40:0/182629103 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2af0062e60 0x7f2af0116570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:15.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.014+0000 7f2af56fc700 1 --2- 172.21.15.40:0/182629103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2af0093250 0x7f2af01125d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:15.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.014+0000 7f2af66fe700 1 --2- 172.21.15.40:0/182629103 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2af0130060 0x7f2af0112ac0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f2ae8009ee0 tx=0x7f2ae800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:15.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.014+0000 7f2ae5ffb700 1 -- 172.21.15.40:0/182629103 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae800cb70 con 0x7f2af0130060 2023-09-30T22:22:15.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.014+0000 7f2ae5ffb700 1 -- 172.21.15.40:0/182629103 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae800f040 con 0x7f2af0130060 2023-09-30T22:22:15.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.015+0000 7f2ae5ffb700 1 -- 172.21.15.40:0/182629103 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8013400 con 0x7f2af0130060 2023-09-30T22:22:15.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.015+0000 7f2af8161700 1 -- 172.21.15.40:0/182629103 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aec0092a0 con 0x7f2af0130060 2023-09-30T22:22:15.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.015+0000 7f2af8161700 1 -- 172.21.15.40:0/182629103 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af01139d0 con 0x7f2af0130060 2023-09-30T22:22:15.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.015+0000 7f2ae5ffb700 1 -- 172.21.15.40:0/182629103 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f2ae80137f0 con 0x7f2af0130060 2023-09-30T22:22:15.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.015+0000 7f2ae5ffb700 1 -- 172.21.15.40:0/182629103 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f2ae803b7f0 con 0x7f2af0130060 2023-09-30T22:22:15.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.016+0000 7f2af8161700 1 -- 172.21.15.40:0/182629103 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2af0115c90 con 0x7f2af0130060 2023-09-30T22:22:15.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.020+0000 7f2ae5ffb700 1 -- 172.21.15.40:0/182629103 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f2ae801ab70 con 0x7f2af0130060 2023-09-30T22:22:15.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.221+0000 7f2af8161700 1 -- 172.21.15.40:0/182629103 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2af005a260 con 0x7f2af0130060 2023-09-30T22:22:15.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.221+0000 7f2ae5ffb700 1 -- 172.21.15.40:0/182629103 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f2ae801a780 con 0x7f2af0130060 2023-09-30T22:22:15.222 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:22:15.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.222+0000 7f2af8161700 1 -- 172.21.15.40:0/182629103 >> v1:172.21.15.40:6816/118905 conn(0x7f2ad402bb60 legacy=0x7f2ad402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.222+0000 7f2af8161700 1 -- 172.21.15.40:0/182629103 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2af0130060 msgr2=0x7f2af0112ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.222+0000 7f2af8161700 1 --2- 172.21.15.40:0/182629103 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2af0130060 0x7f2af0112ac0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f2ae8009ee0 tx=0x7f2ae800b040).stop 2023-09-30T22:22:15.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.223+0000 7f2af8161700 1 -- 172.21.15.40:0/182629103 shutdown_connections 2023-09-30T22:22:15.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.223+0000 7f2af8161700 1 --2- 172.21.15.40:0/182629103 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2af0062e60 0x7f2af0116570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:15.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.223+0000 7f2af8161700 1 --2- 172.21.15.40:0/182629103 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2af0130060 0x7f2af0112ac0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:15.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.223+0000 7f2af8161700 1 --2- 172.21.15.40:0/182629103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2af0093250 0x7f2af01125d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:15.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.223+0000 7f2af8161700 1 -- 172.21.15.40:0/182629103 >> 172.21.15.40:0/182629103 conn(0x7f2af009a450 msgr2=0x7f2af0068820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:15.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.223+0000 7f2af8161700 1 -- 172.21.15.40:0/182629103 shutdown_connections 2023-09-30T22:22:15.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.223+0000 7f2af8161700 1 -- 172.21.15.40:0/182629103 wait complete. 2023-09-30T22:22:15.235 INFO:teuthology.orchestra.run.smithi040.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-09-30T22:22:15.235 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-09-30T22:22:15.235 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:22:15.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.355+0000 7f4d77727700 1 Processor -- start 2023-09-30T22:22:15.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.356+0000 7f4d77727700 1 -- start start 2023-09-30T22:22:15.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.356+0000 7f4d77727700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4d70095ec0 0x7f4d700962c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:15.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.356+0000 7f4d77727700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d7012d300 0x7f4d7012f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:15.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.356+0000 7f4d77727700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d700940d0 con 0x7f4d70093930 2023-09-30T22:22:15.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.356+0000 7f4d77727700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d70093d10 con 0x7f4d7012d300 2023-09-30T22:22:15.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.356+0000 7f4d77727700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d70094b30 con 0x7f4d70095ec0 2023-09-30T22:22:15.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.356+0000 7f4d74cc2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4d70095ec0 0x7f4d700962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:15.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.356+0000 7f4d75cc4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d7012d300 0x7f4d7012f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:15.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.356+0000 7f4d754c3700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f4d70093930 0x7f4d700957b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53286/0 (socket says 172.21.15.40:53286) 2023-09-30T22:22:15.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.356+0000 7f4d754c3700 1 -- 172.21.15.40:0/2994996419 learned_addr learned my addr 172.21.15.40:0/2994996419 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:22:15.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.357+0000 7f4d63fff700 1 -- 172.21.15.40:0/2994996419 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1341536961 0 0) 0x7f4d700940d0 con 0x7f4d70093930 2023-09-30T22:22:15.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.357+0000 7f4d63fff700 1 -- 172.21.15.40:0/2994996419 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d5c0033f0 con 0x7f4d70093930 2023-09-30T22:22:15.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.357+0000 7f4d74cc2700 1 -- 172.21.15.40:0/2994996419 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d7012d300 msgr2=0x7f4d7012f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:15.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.357+0000 7f4d74cc2700 1 --2- 172.21.15.40:0/2994996419 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d7012d300 0x7f4d7012f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:15.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.357+0000 7f4d74cc2700 1 -- 172.21.15.40:0/2994996419 >> v1:172.21.15.40:6789/0 conn(0x7f4d70093930 legacy=0x7f4d700957b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.357+0000 7f4d74cc2700 1 -- 172.21.15.40:0/2994996419 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d70091a40 con 0x7f4d70095ec0 2023-09-30T22:22:15.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.357+0000 7f4d75cc4700 1 --2- 172.21.15.40:0/2994996419 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d7012d300 0x7f4d7012f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:15.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.357+0000 7f4d74cc2700 1 --2- 172.21.15.40:0/2994996419 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4d70095ec0 0x7f4d700962c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f4d6c009790 tx=0x7f4d6c009060).ready entity=mon.2 client_cookie=dc15cb67456634a9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:15.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.357+0000 7f4d63fff700 1 -- 172.21.15.40:0/2994996419 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c0090d0 con 0x7f4d70095ec0 2023-09-30T22:22:15.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.357+0000 7f4d63fff700 1 -- 172.21.15.40:0/2994996419 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6c00f510 con 0x7f4d70095ec0 2023-09-30T22:22:15.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.357+0000 7f4d63fff700 1 -- 172.21.15.40:0/2994996419 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c00f890 con 0x7f4d70095ec0 2023-09-30T22:22:15.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.357+0000 7f4d77727700 1 -- 172.21.15.40:0/2994996419 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4d70095ec0 msgr2=0x7f4d700962c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.357+0000 7f4d77727700 1 --2- 172.21.15.40:0/2994996419 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4d70095ec0 0x7f4d700962c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f4d6c009790 tx=0x7f4d6c009060).stop 2023-09-30T22:22:15.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.357+0000 7f4d77727700 1 -- 172.21.15.40:0/2994996419 shutdown_connections 2023-09-30T22:22:15.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.357+0000 7f4d77727700 1 --2- 172.21.15.40:0/2994996419 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d7012d300 0x7f4d7012f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:15.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.357+0000 7f4d77727700 1 --2- 172.21.15.40:0/2994996419 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4d70095ec0 0x7f4d700962c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:15.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.357+0000 7f4d77727700 1 -- 172.21.15.40:0/2994996419 >> 172.21.15.40:0/2994996419 conn(0x7f4d70097580 msgr2=0x7f4d70097990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:15.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.358+0000 7f4d77727700 1 -- 172.21.15.40:0/2994996419 shutdown_connections 2023-09-30T22:22:15.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.358+0000 7f4d77727700 1 -- 172.21.15.40:0/2994996419 wait complete. 2023-09-30T22:22:15.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.358+0000 7f4d77727700 1 Processor -- start 2023-09-30T22:22:15.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.358+0000 7f4d77727700 1 -- start start 2023-09-30T22:22:15.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.359+0000 7f4d77727700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4d70093930 0x7f4d7013a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:15.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.359+0000 7f4d77727700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d70095ec0 0x7f4d7013aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:15.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.359+0000 7f4d77727700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d7012d300 0x7f4d7011a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:15.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.359+0000 7f4d77727700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7012cc00 con 0x7f4d70095ec0 2023-09-30T22:22:15.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.359+0000 7f4d77727700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7012d780 con 0x7f4d7012d300 2023-09-30T22:22:15.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.359+0000 7f4d77727700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7006a6b0 con 0x7f4d70093930 2023-09-30T22:22:15.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.359+0000 7f4d754c3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4d70093930 0x7f4d7013a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:15.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.359+0000 7f4d75cc4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d7012d300 0x7f4d7011a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:15.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.359+0000 7f4d754c3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4d70093930 0x7f4d7013a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33502/0 (socket says 172.21.15.40:33502) 2023-09-30T22:22:15.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.359+0000 7f4d74cc2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d70095ec0 0x7f4d7013aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:15.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.359+0000 7f4d754c3700 1 -- 172.21.15.40:0/180822142 learned_addr learned my addr 172.21.15.40:0/180822142 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:15.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.359+0000 7f4d754c3700 1 -- 172.21.15.40:0/180822142 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d7012d300 msgr2=0x7f4d7011a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.359+0000 7f4d754c3700 1 --2- 172.21.15.40:0/180822142 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d7012d300 0x7f4d7011a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:15.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.359+0000 7f4d754c3700 1 -- 172.21.15.40:0/180822142 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d70095ec0 msgr2=0x7f4d7013aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.359+0000 7f4d754c3700 1 --2- 172.21.15.40:0/180822142 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d70095ec0 0x7f4d7013aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:15.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.359+0000 7f4d754c3700 1 -- 172.21.15.40:0/180822142 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d68009a20 con 0x7f4d70093930 2023-09-30T22:22:15.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.360+0000 7f4d754c3700 1 --2- 172.21.15.40:0/180822142 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4d70093930 0x7f4d7013a9e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f4d6400c590 tx=0x7f4d64007c80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:15.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.360+0000 7f4d617fa700 1 -- 172.21.15.40:0/180822142 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d640072e0 con 0x7f4d70093930 2023-09-30T22:22:15.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.360+0000 7f4d617fa700 1 -- 172.21.15.40:0/180822142 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d64007440 con 0x7f4d70093930 2023-09-30T22:22:15.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.360+0000 7f4d77727700 1 -- 172.21.15.40:0/180822142 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d6c0092a0 con 0x7f4d70093930 2023-09-30T22:22:15.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.360+0000 7f4d617fa700 1 -- 172.21.15.40:0/180822142 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d640057a0 con 0x7f4d70093930 2023-09-30T22:22:15.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.360+0000 7f4d77727700 1 -- 172.21.15.40:0/180822142 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d7011db40 con 0x7f4d70093930 2023-09-30T22:22:15.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.361+0000 7f4d617fa700 1 -- 172.21.15.40:0/180822142 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f4d64005bd0 con 0x7f4d70093930 2023-09-30T22:22:15.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.361+0000 7f4d617fa700 1 -- 172.21.15.40:0/180822142 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f4d6403a7b0 con 0x7f4d70093930 2023-09-30T22:22:15.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.361+0000 7f4d77727700 1 -- 172.21.15.40:0/180822142 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d7009b230 con 0x7f4d70093930 2023-09-30T22:22:15.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.365+0000 7f4d617fa700 1 -- 172.21.15.40:0/180822142 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f4d640123b0 con 0x7f4d70093930 2023-09-30T22:22:15.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.536+0000 7f4d77727700 1 -- 172.21.15.40:0/180822142 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d7005a260 con 0x7f4d70093930 2023-09-30T22:22:15.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.537+0000 7f4d617fa700 1 -- 172.21.15.40:0/180822142 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11341 (secure 0 0 0) 0x7f4d64010300 con 0x7f4d70093930 2023-09-30T22:22:15.537 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:22:15.538 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":17,"fsid":"79dd4d8e-f295-4d9c-bd93-9850863800e3","created":"2023-09-30T22:21:46.980357+0000","modified":"2023-09-30T22:22:03.348895+0000","last_up_change":"2023-09-30T22:21:54.822866+0000","last_in_change":"2023-09-30T22:21:48.205613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:21:54.875024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:21:56.197012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:22:00.759069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:22:01.327265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"771f785c-f464-4b17-936c-cbf31b1153e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6812","nonce":119451}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6813","nonce":119451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6815","nonce":119451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6814","nonce":119451}]},"public_addr":"172.21.15.40:6812/119451","cluster_addr":"172.21.15.40:6813/119451","heartbeat_back_addr":"172.21.15.40:6815/119451","heartbeat_front_addr":"172.21.15.40:6814/119451","state":["exists","up"]},{"osd":1,"uuid":"45f1e2e8-5310-4219-ab54-424e7440fcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6808","nonce":119436}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6809","nonce":119436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6811","nonce":119436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6810","nonce":119436}]},"public_addr":"172.21.15.40:6808/119436","cluster_addr":"172.21.15.40:6809/119436","heartbeat_back_addr":"172.21.15.40:6811/119436","heartbeat_front_addr":"172.21.15.40:6810/119436","state":["exists","up"]},{"osd":2,"uuid":"7ba62ae5-d21e-4d56-b46c-ba7b718ede25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6800","nonce":119433}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6801","nonce":119433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6803","nonce":119433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6802","nonce":119433}]},"public_addr":"172.21.15.40:6800/119433","cluster_addr":"172.21.15.40:6801/119433","heartbeat_back_addr":"172.21.15.40:6803/119433","heartbeat_front_addr":"172.21.15.40:6802/119433","state":["exists","up"]},{"osd":3,"uuid":"c9c55985-8a90-4927-a8fa-6a1fcec1cd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6804","nonce":119432}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6805","nonce":119432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6807","nonce":119432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6806","nonce":119432}]},"public_addr":"172.21.15.40:6804/119432","cluster_addr":"172.21.15.40:6805/119432","heartbeat_back_addr":"172.21.15.40:6807/119432","heartbeat_front_addr":"172.21.15.40:6806/119432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.339829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.554690+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.641664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.320635+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:22:15.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.539+0000 7f4d77727700 1 -- 172.21.15.40:0/180822142 >> v1:172.21.15.40:6816/118905 conn(0x7f4d5402bb60 legacy=0x7f4d5402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.539+0000 7f4d77727700 1 -- 172.21.15.40:0/180822142 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4d70093930 msgr2=0x7f4d7013a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.539+0000 7f4d77727700 1 --2- 172.21.15.40:0/180822142 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4d70093930 0x7f4d7013a9e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f4d6400c590 tx=0x7f4d64007c80).stop 2023-09-30T22:22:15.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.539+0000 7f4d77727700 1 -- 172.21.15.40:0/180822142 shutdown_connections 2023-09-30T22:22:15.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.539+0000 7f4d77727700 1 --2- 172.21.15.40:0/180822142 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4d70093930 0x7f4d7013a9e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:15.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.539+0000 7f4d77727700 1 --2- 172.21.15.40:0/180822142 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d7012d300 0x7f4d7011a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:15.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.539+0000 7f4d77727700 1 --2- 172.21.15.40:0/180822142 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d70095ec0 0x7f4d7013aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:15.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.539+0000 7f4d77727700 1 -- 172.21.15.40:0/180822142 >> 172.21.15.40:0/180822142 conn(0x7f4d70097580 msgr2=0x7f4d70068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:15.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.539+0000 7f4d77727700 1 -- 172.21.15.40:0/180822142 shutdown_connections 2023-09-30T22:22:15.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.539+0000 7f4d77727700 1 -- 172.21.15.40:0/180822142 wait complete. 2023-09-30T22:22:15.551 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-09-30T22:21:54.875024+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:21:56.197012+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:22:00.759069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:22:01.327265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T22:22:15.552 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-09-30T22:22:15.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.674+0000 7efd92a52700 1 Processor -- start 2023-09-30T22:22:15.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.675+0000 7efd92a52700 1 -- start start 2023-09-30T22:22:15.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.675+0000 7efd92a52700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd8c097ec0 0x7efd8c096d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:15.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.675+0000 7efd92a52700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efd8c097220 0x7efd8c132660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:15.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.675+0000 7efd92a52700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd8c098350 con 0x7efd8c0657e0 2023-09-30T22:22:15.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.675+0000 7efd92a52700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd8c065bc0 con 0x7efd8c097220 2023-09-30T22:22:15.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.675+0000 7efd92a52700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c096350 con 0x7efd8c097ec0 2023-09-30T22:22:15.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.675+0000 7efd90fef700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efd8c097220 0x7efd8c132660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:15.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.675+0000 7efd8bfff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7efd8c0657e0 0x7efd8c096620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53288/0 (socket says 172.21.15.40:53288) 2023-09-30T22:22:15.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.675+0000 7efd8bfff700 1 -- 172.21.15.40:0/4113554759 learned_addr learned my addr 172.21.15.40:0/4113554759 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:22:15.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.675+0000 7efd8b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd8c097ec0 0x7efd8c096d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:15.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.676+0000 7efd90fef700 1 -- 172.21.15.40:0/4113554759 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd8c097ec0 msgr2=0x7efd8c096d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:15.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.676+0000 7efd90fef700 1 --2- 172.21.15.40:0/4113554759 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd8c097ec0 0x7efd8c096d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:15.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.676+0000 7efd90fef700 1 -- 172.21.15.40:0/4113554759 >> v1:172.21.15.40:6789/0 conn(0x7efd8c0657e0 legacy=0x7efd8c096620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.676+0000 7efd90fef700 1 -- 172.21.15.40:0/4113554759 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd8c0662b0 con 0x7efd8c097220 2023-09-30T22:22:15.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.676+0000 7efd8affd700 1 -- 172.21.15.40:0/4113554759 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2772027911 0 0) 0x7efd8c098350 con 0x7efd8c0657e0 2023-09-30T22:22:15.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.676+0000 7efd8b7fe700 1 --2- 172.21.15.40:0/4113554759 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd8c097ec0 0x7efd8c096d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:15.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.676+0000 7efd90fef700 1 --2- 172.21.15.40:0/4113554759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd8c097220 0x7efd8c132660 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7efd84009e60 tx=0x7efd84009780).ready entity=mon.0 client_cookie=3a335e011bf4afef server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:15.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.676+0000 7efd8affd700 1 -- 172.21.15.40:0/4113554759 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8400e070 con 0x7efd8c097220 2023-09-30T22:22:15.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.676+0000 7efd8affd700 1 -- 172.21.15.40:0/4113554759 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd8400bb60 con 0x7efd8c097220 2023-09-30T22:22:15.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.676+0000 7efd8affd700 1 -- 172.21.15.40:0/4113554759 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd84012410 con 0x7efd8c097220 2023-09-30T22:22:15.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.676+0000 7efd92a52700 1 -- 172.21.15.40:0/4113554759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd8c097220 msgr2=0x7efd8c132660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.676+0000 7efd92a52700 1 --2- 172.21.15.40:0/4113554759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd8c097220 0x7efd8c132660 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7efd84009e60 tx=0x7efd84009780).stop 2023-09-30T22:22:15.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.676+0000 7efd92a52700 1 -- 172.21.15.40:0/4113554759 shutdown_connections 2023-09-30T22:22:15.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.676+0000 7efd92a52700 1 --2- 172.21.15.40:0/4113554759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd8c097220 0x7efd8c132660 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:15.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.676+0000 7efd92a52700 1 --2- 172.21.15.40:0/4113554759 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd8c097ec0 0x7efd8c096d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:15.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.676+0000 7efd92a52700 1 -- 172.21.15.40:0/4113554759 >> 172.21.15.40:0/4113554759 conn(0x7efd8c09de50 msgr2=0x7efd8c09e260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:15.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.677+0000 7efd92a52700 1 -- 172.21.15.40:0/4113554759 shutdown_connections 2023-09-30T22:22:15.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.677+0000 7efd92a52700 1 -- 172.21.15.40:0/4113554759 wait complete. 2023-09-30T22:22:15.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.677+0000 7efd92a52700 1 Processor -- start 2023-09-30T22:22:15.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.678+0000 7efd92a52700 1 -- start start 2023-09-30T22:22:15.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.678+0000 7efd92a52700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd8c0657e0 0x7efd8c11e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:15.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.678+0000 7efd92a52700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd8c097220 0x7efd8c11a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:15.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.678+0000 7efd92a52700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd8c11a930 0x7efd8c11adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:15.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.678+0000 7efd92a52700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c1329d0 con 0x7efd8c11a930 2023-09-30T22:22:15.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.678+0000 7efd92a52700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c1325c0 con 0x7efd8c0657e0 2023-09-30T22:22:15.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.678+0000 7efd92a52700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c11cab0 con 0x7efd8c097220 2023-09-30T22:22:15.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.678+0000 7efd8bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd8c0657e0 0x7efd8c11e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:15.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.678+0000 7efd90fef700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd8c11a930 0x7efd8c11adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:15.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.678+0000 7efd8bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd8c0657e0 0x7efd8c11e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:55238/0 (socket says 172.21.15.40:55238) 2023-09-30T22:22:15.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.678+0000 7efd8bfff700 1 -- 172.21.15.40:0/2187611474 learned_addr learned my addr 172.21.15.40:0/2187611474 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:15.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.678+0000 7efd8b7fe700 1 --2- 172.21.15.40:0/2187611474 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd8c097220 0x7efd8c11a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:15.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.678+0000 7efd90fef700 1 -- 172.21.15.40:0/2187611474 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd8c097220 msgr2=0x7efd8c11a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.678+0000 7efd90fef700 1 --2- 172.21.15.40:0/2187611474 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd8c097220 0x7efd8c11a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:15.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.678+0000 7efd90fef700 1 -- 172.21.15.40:0/2187611474 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd8c0657e0 msgr2=0x7efd8c11e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.678+0000 7efd90fef700 1 --2- 172.21.15.40:0/2187611474 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd8c0657e0 0x7efd8c11e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:15.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.678+0000 7efd90fef700 1 -- 172.21.15.40:0/2187611474 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd740092a0 con 0x7efd8c11a930 2023-09-30T22:22:15.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.678+0000 7efd8bfff700 1 --2- 172.21.15.40:0/2187611474 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd8c0657e0 0x7efd8c11e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:15.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.679+0000 7efd90fef700 1 --2- 172.21.15.40:0/2187611474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd8c11a930 0x7efd8c11adb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7efd84014000 tx=0x7efd8c0664f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:15.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.679+0000 7efd83fff700 1 -- 172.21.15.40:0/2187611474 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd84012410 con 0x7efd8c11a930 2023-09-30T22:22:15.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.679+0000 7efd83fff700 1 -- 172.21.15.40:0/2187611474 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd8401d630 con 0x7efd8c11a930 2023-09-30T22:22:15.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.679+0000 7efd92a52700 1 -- 172.21.15.40:0/2187611474 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd84009a20 con 0x7efd8c11a930 2023-09-30T22:22:15.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.679+0000 7efd83fff700 1 -- 172.21.15.40:0/2187611474 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd840070e0 con 0x7efd8c11a930 2023-09-30T22:22:15.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.679+0000 7efd92a52700 1 -- 172.21.15.40:0/2187611474 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd8c11b2a0 con 0x7efd8c11a930 2023-09-30T22:22:15.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.679+0000 7efd83fff700 1 -- 172.21.15.40:0/2187611474 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7efd84003040 con 0x7efd8c11a930 2023-09-30T22:22:15.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.680+0000 7efd83fff700 1 -- 172.21.15.40:0/2187611474 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7efd8403cbb0 con 0x7efd8c11a930 2023-09-30T22:22:15.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.680+0000 7efd92a52700 1 -- 172.21.15.40:0/2187611474 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd8c0947b0 con 0x7efd8c11a930 2023-09-30T22:22:15.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.684+0000 7efd83fff700 1 -- 172.21.15.40:0/2187611474 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7efd84025be0 con 0x7efd8c11a930 2023-09-30T22:22:15.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.852+0000 7efd92a52700 1 -- 172.21.15.40:0/2187611474 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7efd8c09c030 con 0x7efd8c11a930 2023-09-30T22:22:15.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.852+0000 7efd83fff700 1 -- 172.21.15.40:0/2187611474 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7efd84011e60 con 0x7efd8c11a930 2023-09-30T22:22:15.852 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-09-30T22:22:15.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.854+0000 7efd92a52700 1 -- 172.21.15.40:0/2187611474 >> v1:172.21.15.40:6816/118905 conn(0x7efd6c02bb90 legacy=0x7efd6c02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.854+0000 7efd92a52700 1 -- 172.21.15.40:0/2187611474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd8c11a930 msgr2=0x7efd8c11adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.854+0000 7efd92a52700 1 --2- 172.21.15.40:0/2187611474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd8c11a930 0x7efd8c11adb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7efd84014000 tx=0x7efd8c0664f0).stop 2023-09-30T22:22:15.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.854+0000 7efd92a52700 1 -- 172.21.15.40:0/2187611474 shutdown_connections 2023-09-30T22:22:15.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.854+0000 7efd92a52700 1 --2- 172.21.15.40:0/2187611474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd8c11a930 0x7efd8c11adb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:15.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.854+0000 7efd92a52700 1 --2- 172.21.15.40:0/2187611474 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd8c0657e0 0x7efd8c11e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:15.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.854+0000 7efd92a52700 1 --2- 172.21.15.40:0/2187611474 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd8c097220 0x7efd8c11a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:15.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.854+0000 7efd92a52700 1 -- 172.21.15.40:0/2187611474 >> 172.21.15.40:0/2187611474 conn(0x7efd8c09de50 msgr2=0x7efd8c0987a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:15.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.854+0000 7efd92a52700 1 -- 172.21.15.40:0/2187611474 shutdown_connections 2023-09-30T22:22:15.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.854+0000 7efd92a52700 1 -- 172.21.15.40:0/2187611474 wait complete. 2023-09-30T22:22:15.866 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:22:15.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.988+0000 7f4c95b69700 1 Processor -- start 2023-09-30T22:22:15.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.989+0000 7f4c95b69700 1 -- start start 2023-09-30T22:22:15.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.989+0000 7f4c95b69700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c900657e0 0x7f4c90096620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:15.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.989+0000 7f4c95b69700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4c90097ec0 0x7f4c90096b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:15.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.989+0000 7f4c95b69700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c90097000 0x7f4c90131650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:15.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.989+0000 7f4c95b69700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c90098350 con 0x7f4c90097ec0 2023-09-30T22:22:15.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.989+0000 7f4c95b69700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c900662b0 con 0x7f4c900657e0 2023-09-30T22:22:15.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.989+0000 7f4c95b69700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c90065bc0 con 0x7f4c90097000 2023-09-30T22:22:15.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.989+0000 7f4c8effd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4c90097ec0 0x7f4c90096b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:15.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.989+0000 7f4c8f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c900657e0 0x7f4c90096620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:15.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.989+0000 7f4c8ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c90097000 0x7f4c90131650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:15.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.989+0000 7f4c8effd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4c90097ec0 0x7f4c90096b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48068/0 (socket says 172.21.15.40:48068) 2023-09-30T22:22:15.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.989+0000 7f4c8f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c900657e0 0x7f4c90096620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:55248/0 (socket says 172.21.15.40:55248) 2023-09-30T22:22:15.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.989+0000 7f4c8effd700 1 -- 172.21.15.40:0/2634301644 learned_addr learned my addr 172.21.15.40:0/2634301644 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:15.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.989+0000 7f4c8ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c90097000 0x7f4c90131650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33528/0 (socket says 172.21.15.40:33528) 2023-09-30T22:22:15.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.990+0000 7f4c8effd700 1 -- 172.21.15.40:0/2634301644 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c90097000 msgr2=0x7f4c90131650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:15.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.990+0000 7f4c8effd700 1 --2- 172.21.15.40:0/2634301644 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c90097000 0x7f4c90131650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:15.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.990+0000 7f4c8effd700 1 -- 172.21.15.40:0/2634301644 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c900657e0 msgr2=0x7f4c90096620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:15.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.990+0000 7f4c8effd700 1 --2- 172.21.15.40:0/2634301644 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c900657e0 0x7f4c90096620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:15.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.990+0000 7f4c8effd700 1 -- 172.21.15.40:0/2634301644 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c90096350 con 0x7f4c90097ec0 2023-09-30T22:22:15.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.990+0000 7f4c8ffff700 1 --2- 172.21.15.40:0/2634301644 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c90097000 0x7f4c90131650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:15.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.990+0000 7f4c8f7fe700 1 --2- 172.21.15.40:0/2634301644 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c900657e0 0x7f4c90096620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:15.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.990+0000 7f4c8effd700 1 --2- 172.21.15.40:0/2634301644 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c90097ec0 0x7f4c90096b10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f4c80009830 tx=0x7f4c800090f0).ready entity=mon.0 client_cookie=e9a91b0093b6d175 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:15.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.990+0000 7f4c8e7fc700 1 -- 172.21.15.40:0/2634301644 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8000f510 con 0x7f4c90097ec0 2023-09-30T22:22:15.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.990+0000 7f4c8e7fc700 1 -- 172.21.15.40:0/2634301644 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8000f670 con 0x7f4c90097ec0 2023-09-30T22:22:15.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.990+0000 7f4c8e7fc700 1 -- 172.21.15.40:0/2634301644 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8000fa10 con 0x7f4c90097ec0 2023-09-30T22:22:15.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.990+0000 7f4c95b69700 1 -- 172.21.15.40:0/2634301644 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c90097ec0 msgr2=0x7f4c90096b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.990+0000 7f4c95b69700 1 --2- 172.21.15.40:0/2634301644 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c90097ec0 0x7f4c90096b10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f4c80009830 tx=0x7f4c800090f0).stop 2023-09-30T22:22:15.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.990+0000 7f4c95b69700 1 -- 172.21.15.40:0/2634301644 shutdown_connections 2023-09-30T22:22:15.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.990+0000 7f4c95b69700 1 --2- 172.21.15.40:0/2634301644 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c90097000 0x7f4c90131650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:15.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.990+0000 7f4c95b69700 1 --2- 172.21.15.40:0/2634301644 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c900657e0 0x7f4c90096620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:15.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.990+0000 7f4c95b69700 1 --2- 172.21.15.40:0/2634301644 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c90097ec0 0x7f4c90096b10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:15.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.990+0000 7f4c95b69700 1 -- 172.21.15.40:0/2634301644 >> 172.21.15.40:0/2634301644 conn(0x7f4c9009de50 msgr2=0x7f4c9009e260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:15.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.990+0000 7f4c95b69700 1 -- 172.21.15.40:0/2634301644 shutdown_connections 2023-09-30T22:22:15.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.990+0000 7f4c95b69700 1 -- 172.21.15.40:0/2634301644 wait complete. 2023-09-30T22:22:15.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.991+0000 7f4c95b69700 1 Processor -- start 2023-09-30T22:22:15.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.992+0000 7f4c95b69700 1 -- start start 2023-09-30T22:22:15.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.992+0000 7f4c95b69700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c900657e0 0x7f4c9013a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:15.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.992+0000 7f4c95b69700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c90097000 0x7f4c9013a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:15.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.992+0000 7f4c95b69700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c9013ae40 0x7f4c9011ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:15.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.992+0000 7f4c95b69700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c90099d70 con 0x7f4c900657e0 2023-09-30T22:22:15.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.992+0000 7f4c95b69700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9009cd30 con 0x7f4c90097000 2023-09-30T22:22:15.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.992+0000 7f4c95b69700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9013b260 con 0x7f4c9013ae40 2023-09-30T22:22:15.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.992+0000 7f4c8f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c900657e0 0x7f4c9013a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:15.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.992+0000 7f4c8effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c90097000 0x7f4c9013a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:15.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.992+0000 7f4c8f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c900657e0 0x7f4c9013a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48080/0 (socket says 172.21.15.40:48080) 2023-09-30T22:22:16.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.992+0000 7f4c8f7fe700 1 -- 172.21.15.40:0/2990815772 learned_addr learned my addr 172.21.15.40:0/2990815772 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:16.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.992+0000 7f4c8ffff700 1 --2- 172.21.15.40:0/2990815772 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c9013ae40 0x7f4c9011ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:16.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.992+0000 7f4c8f7fe700 1 -- 172.21.15.40:0/2990815772 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c9013ae40 msgr2=0x7f4c9011ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.992+0000 7f4c8f7fe700 1 --2- 172.21.15.40:0/2990815772 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c9013ae40 0x7f4c9011ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:16.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.992+0000 7f4c8f7fe700 1 -- 172.21.15.40:0/2990815772 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c90097000 msgr2=0x7f4c9013a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.992+0000 7f4c8f7fe700 1 --2- 172.21.15.40:0/2990815772 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c90097000 0x7f4c9013a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:16.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.992+0000 7f4c8f7fe700 1 -- 172.21.15.40:0/2990815772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c780092a0 con 0x7f4c900657e0 2023-09-30T22:22:16.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.992+0000 7f4c8effd700 1 --2- 172.21.15.40:0/2990815772 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c90097000 0x7f4c9013a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:16.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.992+0000 7f4c8ffff700 1 --2- 172.21.15.40:0/2990815772 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c9013ae40 0x7f4c9011ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:16.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.993+0000 7f4c8f7fe700 1 --2- 172.21.15.40:0/2990815772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c900657e0 0x7f4c9013a460 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f4c7800ea20 tx=0x7f4c78009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:16.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.993+0000 7f4c877fe700 1 -- 172.21.15.40:0/2990815772 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7800ee60 con 0x7f4c900657e0 2023-09-30T22:22:16.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.993+0000 7f4c877fe700 1 -- 172.21.15.40:0/2990815772 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c7800c850 con 0x7f4c900657e0 2023-09-30T22:22:16.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.993+0000 7f4c877fe700 1 -- 172.21.15.40:0/2990815772 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7800cbd0 con 0x7f4c900657e0 2023-09-30T22:22:16.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.993+0000 7f4c95b69700 1 -- 172.21.15.40:0/2990815772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c88009a20 con 0x7f4c900657e0 2023-09-30T22:22:16.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.993+0000 7f4c95b69700 1 -- 172.21.15.40:0/2990815772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c80009370 con 0x7f4c900657e0 2023-09-30T22:22:16.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.993+0000 7f4c877fe700 1 -- 172.21.15.40:0/2990815772 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f4c7801b400 con 0x7f4c900657e0 2023-09-30T22:22:16.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.994+0000 7f4c877fe700 1 -- 172.21.15.40:0/2990815772 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f4c7803b4f0 con 0x7f4c900657e0 2023-09-30T22:22:16.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.994+0000 7f4c95b69700 1 -- 172.21.15.40:0/2990815772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c9005a260 con 0x7f4c900657e0 2023-09-30T22:22:16.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:15.998+0000 7f4c877fe700 1 -- 172.21.15.40:0/2990815772 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f4c78019900 con 0x7f4c900657e0 2023-09-30T22:22:16.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.166+0000 7f4c95b69700 1 -- 172.21.15.40:0/2990815772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4c90099a50 con 0x7f4c900657e0 2023-09-30T22:22:16.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.166+0000 7f4c877fe700 1 -- 172.21.15.40:0/2990815772 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4c78019310 con 0x7f4c900657e0 2023-09-30T22:22:16.167 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-09-30T22:22:16.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.168+0000 7f4c95b69700 1 -- 172.21.15.40:0/2990815772 >> v1:172.21.15.40:6816/118905 conn(0x7f4c7002bb60 legacy=0x7f4c7002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.168+0000 7f4c95b69700 1 -- 172.21.15.40:0/2990815772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c900657e0 msgr2=0x7f4c9013a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.168+0000 7f4c95b69700 1 --2- 172.21.15.40:0/2990815772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c900657e0 0x7f4c9013a460 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f4c7800ea20 tx=0x7f4c78009060).stop 2023-09-30T22:22:16.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.168+0000 7f4c95b69700 1 -- 172.21.15.40:0/2990815772 shutdown_connections 2023-09-30T22:22:16.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.168+0000 7f4c95b69700 1 --2- 172.21.15.40:0/2990815772 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c9013ae40 0x7f4c9011ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:16.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.168+0000 7f4c95b69700 1 --2- 172.21.15.40:0/2990815772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c900657e0 0x7f4c9013a460 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:16.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.168+0000 7f4c95b69700 1 --2- 172.21.15.40:0/2990815772 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c90097000 0x7f4c9013a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:16.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.168+0000 7f4c95b69700 1 -- 172.21.15.40:0/2990815772 >> 172.21.15.40:0/2990815772 conn(0x7f4c9009de50 msgr2=0x7f4c9009bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:16.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.168+0000 7f4c95b69700 1 -- 172.21.15.40:0/2990815772 shutdown_connections 2023-09-30T22:22:16.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.168+0000 7f4c95b69700 1 -- 172.21.15.40:0/2990815772 wait complete. 2023-09-30T22:22:16.180 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:22:16.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.303+0000 7f2a986f7700 1 Processor -- start 2023-09-30T22:22:16.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.303+0000 7f2a986f7700 1 -- start start 2023-09-30T22:22:16.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.304+0000 7f2a986f7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2a90062e60 0x7f2a90067fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:16.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.304+0000 7f2a986f7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2a9012d090 0x7f2a9012f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:16.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.304+0000 7f2a986f7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a90092590 con 0x7f2a900684a0 2023-09-30T22:22:16.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.304+0000 7f2a986f7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a90063240 con 0x7f2a9012d090 2023-09-30T22:22:16.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.304+0000 7f2a986f7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a90069d90 con 0x7f2a90062e60 2023-09-30T22:22:16.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.304+0000 7f2a96493700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2a90062e60 0x7f2a90067fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:16.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.304+0000 7f2a96c94700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2a9012d090 0x7f2a9012f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:16.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.304+0000 7f2a96493700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2a90062e60 0x7f2a90067fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33538/0 (socket says 172.21.15.40:33538) 2023-09-30T22:22:16.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.304+0000 7f2a96493700 1 -- 172.21.15.40:0/1969523714 learned_addr learned my addr 172.21.15.40:0/1969523714 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:16.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.304+0000 7f2a95c92700 1 --1- 172.21.15.40:0/1969523714 >> v1:172.21.15.40:6789/0 conn(0x7f2a900684a0 0x7f2a900688a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53292/0 (socket says 172.21.15.40:53292) 2023-09-30T22:22:16.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.304+0000 7f2a96493700 1 -- 172.21.15.40:0/1969523714 >> v2:172.21.15.40:3300/0 conn(0x7f2a9012d090 msgr2=0x7f2a9012f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:16.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.304+0000 7f2a96493700 1 --2- 172.21.15.40:0/1969523714 >> v2:172.21.15.40:3300/0 conn(0x7f2a9012d090 0x7f2a9012f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:16.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.304+0000 7f2a96493700 1 -- 172.21.15.40:0/1969523714 >> v1:172.21.15.40:6789/0 conn(0x7f2a900684a0 legacy=0x7f2a900688a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.304+0000 7f2a95491700 1 -- 172.21.15.40:0/1969523714 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 172072102 0 0) 0x7f2a90092590 con 0x7f2a900684a0 2023-09-30T22:22:16.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.304+0000 7f2a96493700 1 -- 172.21.15.40:0/1969523714 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a900922d0 con 0x7f2a90062e60 2023-09-30T22:22:16.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.304+0000 7f2a96c94700 1 --2- 172.21.15.40:0/1969523714 >> v2:172.21.15.40:3300/0 conn(0x7f2a9012d090 0x7f2a9012f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:16.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.305+0000 7f2a96493700 1 --2- 172.21.15.40:0/1969523714 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2a90062e60 0x7f2a90067fb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f2a8c00d1d0 tx=0x7f2a8c00ba50).ready entity=mon.2 client_cookie=fe47f3efd2a42a57 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:16.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.305+0000 7f2a95491700 1 -- 172.21.15.40:0/1969523714 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c010070 con 0x7f2a90062e60 2023-09-30T22:22:16.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.305+0000 7f2a95491700 1 -- 172.21.15.40:0/1969523714 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8c00de00 con 0x7f2a90062e60 2023-09-30T22:22:16.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.305+0000 7f2a95491700 1 -- 172.21.15.40:0/1969523714 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c00b2e0 con 0x7f2a90062e60 2023-09-30T22:22:16.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.305+0000 7f2a986f7700 1 -- 172.21.15.40:0/1969523714 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2a90062e60 msgr2=0x7f2a90067fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.305+0000 7f2a986f7700 1 --2- 172.21.15.40:0/1969523714 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2a90062e60 0x7f2a90067fb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f2a8c00d1d0 tx=0x7f2a8c00ba50).stop 2023-09-30T22:22:16.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.305+0000 7f2a986f7700 1 -- 172.21.15.40:0/1969523714 shutdown_connections 2023-09-30T22:22:16.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.305+0000 7f2a986f7700 1 --2- 172.21.15.40:0/1969523714 >> v2:172.21.15.40:3300/0 conn(0x7f2a9012d090 0x7f2a9012f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:16.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.305+0000 7f2a986f7700 1 --2- 172.21.15.40:0/1969523714 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2a90062e60 0x7f2a90067fb0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:16.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.305+0000 7f2a986f7700 1 -- 172.21.15.40:0/1969523714 >> 172.21.15.40:0/1969523714 conn(0x7f2a9005eb30 msgr2=0x7f2a9009a380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:16.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.305+0000 7f2a986f7700 1 -- 172.21.15.40:0/1969523714 shutdown_connections 2023-09-30T22:22:16.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.305+0000 7f2a986f7700 1 -- 172.21.15.40:0/1969523714 wait complete. 2023-09-30T22:22:16.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.306+0000 7f2a986f7700 1 Processor -- start 2023-09-30T22:22:16.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.306+0000 7f2a986f7700 1 -- start start 2023-09-30T22:22:16.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.307+0000 7f2a986f7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a90062e60 0x7f2a90119cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:16.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.307+0000 7f2a986f7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2a900684a0 0x7f2a9013a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:16.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.307+0000 7f2a986f7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a9012d090 0x7f2a9013ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:16.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.307+0000 7f2a986f7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a90091ca0 con 0x7f2a9012d090 2023-09-30T22:22:16.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.307+0000 7f2a986f7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9012d510 con 0x7f2a90062e60 2023-09-30T22:22:16.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.307+0000 7f2a986f7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9012cdf0 con 0x7f2a900684a0 2023-09-30T22:22:16.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.307+0000 7f2a95c92700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2a900684a0 0x7f2a9013a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:16.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.307+0000 7f2a96493700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a90062e60 0x7f2a90119cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:16.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.307+0000 7f2a95c92700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2a900684a0 0x7f2a9013a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33548/0 (socket says 172.21.15.40:33548) 2023-09-30T22:22:16.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.307+0000 7f2a95c92700 1 -- 172.21.15.40:0/4100091667 learned_addr learned my addr 172.21.15.40:0/4100091667 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:16.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.307+0000 7f2a96c94700 1 --2- 172.21.15.40:0/4100091667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a9012d090 0x7f2a9013ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:16.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.307+0000 7f2a96493700 1 -- 172.21.15.40:0/4100091667 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2a900684a0 msgr2=0x7f2a9013a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.307+0000 7f2a96493700 1 --2- 172.21.15.40:0/4100091667 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2a900684a0 0x7f2a9013a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:16.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.307+0000 7f2a96493700 1 -- 172.21.15.40:0/4100091667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a9012d090 msgr2=0x7f2a9013ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.307+0000 7f2a96493700 1 --2- 172.21.15.40:0/4100091667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a9012d090 0x7f2a9013ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:16.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.307+0000 7f2a96493700 1 -- 172.21.15.40:0/4100091667 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a880092a0 con 0x7f2a90062e60 2023-09-30T22:22:16.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.307+0000 7f2a95c92700 1 --2- 172.21.15.40:0/4100091667 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2a900684a0 0x7f2a9013a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:16.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.307+0000 7f2a96c94700 1 --2- 172.21.15.40:0/4100091667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a9012d090 0x7f2a9013ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:16.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.307+0000 7f2a96493700 1 --2- 172.21.15.40:0/4100091667 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a90062e60 0x7f2a90119cf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f2a9005efa0 tx=0x7f2a90069540).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:16.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.307+0000 7f2a867fc700 1 -- 172.21.15.40:0/4100091667 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c001010 con 0x7f2a90062e60 2023-09-30T22:22:16.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.307+0000 7f2a867fc700 1 -- 172.21.15.40:0/4100091667 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8c00b0d0 con 0x7f2a90062e60 2023-09-30T22:22:16.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.307+0000 7f2a986f7700 1 -- 172.21.15.40:0/4100091667 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a8c00bcf0 con 0x7f2a90062e60 2023-09-30T22:22:16.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.307+0000 7f2a867fc700 1 -- 172.21.15.40:0/4100091667 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c015670 con 0x7f2a90062e60 2023-09-30T22:22:16.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.307+0000 7f2a986f7700 1 -- 172.21.15.40:0/4100091667 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a90118370 con 0x7f2a90062e60 2023-09-30T22:22:16.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.308+0000 7f2a867fc700 1 -- 172.21.15.40:0/4100091667 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f2a8c003040 con 0x7f2a90062e60 2023-09-30T22:22:16.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.308+0000 7f2a867fc700 1 -- 172.21.15.40:0/4100091667 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f2a8c03bdb0 con 0x7f2a90062e60 2023-09-30T22:22:16.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.308+0000 7f2a986f7700 1 -- 172.21.15.40:0/4100091667 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a90118370 con 0x7f2a90062e60 2023-09-30T22:22:16.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.313+0000 7f2a867fc700 1 -- 172.21.15.40:0/4100091667 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f2a90118370 con 0x7f2a90062e60 2023-09-30T22:22:16.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.480+0000 7f2a986f7700 1 -- 172.21.15.40:0/4100091667 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2a90118370 con 0x7f2a90062e60 2023-09-30T22:22:16.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.480+0000 7f2a867fc700 1 -- 172.21.15.40:0/4100091667 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2a90118370 con 0x7f2a90062e60 2023-09-30T22:22:16.481 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-09-30T22:22:16.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.482+0000 7f2a986f7700 1 -- 172.21.15.40:0/4100091667 >> v1:172.21.15.40:6816/118905 conn(0x7f2a7402bb60 legacy=0x7f2a7402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.482+0000 7f2a986f7700 1 -- 172.21.15.40:0/4100091667 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a90062e60 msgr2=0x7f2a90119cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.482+0000 7f2a986f7700 1 --2- 172.21.15.40:0/4100091667 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a90062e60 0x7f2a90119cf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f2a9005efa0 tx=0x7f2a90069540).stop 2023-09-30T22:22:16.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.482+0000 7f2a986f7700 1 -- 172.21.15.40:0/4100091667 shutdown_connections 2023-09-30T22:22:16.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.482+0000 7f2a986f7700 1 --2- 172.21.15.40:0/4100091667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a9012d090 0x7f2a9013ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:16.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.482+0000 7f2a986f7700 1 --2- 172.21.15.40:0/4100091667 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a90062e60 0x7f2a90119cf0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:16.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.482+0000 7f2a986f7700 1 --2- 172.21.15.40:0/4100091667 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2a900684a0 0x7f2a9013a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:16.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.482+0000 7f2a986f7700 1 -- 172.21.15.40:0/4100091667 >> 172.21.15.40:0/4100091667 conn(0x7f2a9005eb30 msgr2=0x7f2a90128c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:16.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.482+0000 7f2a986f7700 1 -- 172.21.15.40:0/4100091667 shutdown_connections 2023-09-30T22:22:16.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.482+0000 7f2a986f7700 1 -- 172.21.15.40:0/4100091667 wait complete. 2023-09-30T22:22:16.494 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:22:16.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.617+0000 7f9ee138f700 1 Processor -- start 2023-09-30T22:22:16.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.617+0000 7f9ee138f700 1 -- start start 2023-09-30T22:22:16.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.618+0000 7f9ee138f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9edc12b690 0x7f9edc12fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:16.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.618+0000 7f9ee138f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9edc1303e0 0x7f9edc1327d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:16.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.618+0000 7f9ee138f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9edc096a00 con 0x7f9edc05e090 2023-09-30T22:22:16.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.618+0000 7f9ee138f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9edc05e470 con 0x7f9edc12b690 2023-09-30T22:22:16.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.618+0000 7f9ee138f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc12bae0 con 0x7f9edc1303e0 2023-09-30T22:22:16.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.618+0000 7f9edb7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9edc1303e0 0x7f9edc1327d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:16.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.618+0000 7f9edaffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9edc05e090 0x7f9edc12af80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53302/0 (socket says 172.21.15.40:53302) 2023-09-30T22:22:16.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.618+0000 7f9edaffd700 1 -- 172.21.15.40:0/1508097322 learned_addr learned my addr 172.21.15.40:0/1508097322 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:22:16.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.618+0000 7f9eda7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9edc12b690 0x7f9edc12fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:16.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.618+0000 7f9eda7fc700 1 -- 172.21.15.40:0/1508097322 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9edc1303e0 msgr2=0x7f9edc1327d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:16.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.618+0000 7f9eda7fc700 1 --2- 172.21.15.40:0/1508097322 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9edc1303e0 0x7f9edc1327d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:16.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.618+0000 7f9eda7fc700 1 -- 172.21.15.40:0/1508097322 >> v1:172.21.15.40:6789/0 conn(0x7f9edc05e090 legacy=0x7f9edc12af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.618+0000 7f9eda7fc700 1 -- 172.21.15.40:0/1508097322 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9edc0970d0 con 0x7f9edc12b690 2023-09-30T22:22:16.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.618+0000 7f9ed9ffb700 1 -- 172.21.15.40:0/1508097322 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1106550992 0 0) 0x7f9edc096a00 con 0x7f9edc05e090 2023-09-30T22:22:16.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.618+0000 7f9edb7fe700 1 --2- 172.21.15.40:0/1508097322 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9edc1303e0 0x7f9edc1327d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:16.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.618+0000 7f9eda7fc700 1 --2- 172.21.15.40:0/1508097322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9edc12b690 0x7f9edc12fef0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f9ecc009790 tx=0x7f9ecc009060).ready entity=mon.0 client_cookie=8cd7080d3f4956c4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:16.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.619+0000 7f9ed9ffb700 1 -- 172.21.15.40:0/1508097322 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc0090d0 con 0x7f9edc12b690 2023-09-30T22:22:16.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.619+0000 7f9ed9ffb700 1 -- 172.21.15.40:0/1508097322 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ecc00f510 con 0x7f9edc12b690 2023-09-30T22:22:16.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.619+0000 7f9ed9ffb700 1 -- 172.21.15.40:0/1508097322 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc00f890 con 0x7f9edc12b690 2023-09-30T22:22:16.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.619+0000 7f9ee138f700 1 -- 172.21.15.40:0/1508097322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9edc12b690 msgr2=0x7f9edc12fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.619+0000 7f9ee138f700 1 --2- 172.21.15.40:0/1508097322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9edc12b690 0x7f9edc12fef0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f9ecc009790 tx=0x7f9ecc009060).stop 2023-09-30T22:22:16.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.619+0000 7f9ee138f700 1 -- 172.21.15.40:0/1508097322 shutdown_connections 2023-09-30T22:22:16.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.619+0000 7f9ee138f700 1 --2- 172.21.15.40:0/1508097322 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9edc1303e0 0x7f9edc1327d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:16.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.619+0000 7f9ee138f700 1 --2- 172.21.15.40:0/1508097322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9edc12b690 0x7f9edc12fef0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:16.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.619+0000 7f9ee138f700 1 -- 172.21.15.40:0/1508097322 >> 172.21.15.40:0/1508097322 conn(0x7f9edc09ab40 msgr2=0x7f9edc09af50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:16.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.619+0000 7f9ee138f700 1 -- 172.21.15.40:0/1508097322 shutdown_connections 2023-09-30T22:22:16.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.619+0000 7f9ee138f700 1 -- 172.21.15.40:0/1508097322 wait complete. 2023-09-30T22:22:16.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.620+0000 7f9ee138f700 1 Processor -- start 2023-09-30T22:22:16.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.620+0000 7f9ee138f700 1 -- start start 2023-09-30T22:22:16.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.621+0000 7f9ee138f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9edc05e090 0x7f9edc12e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:16.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.621+0000 7f9ee138f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9edc12b690 0x7f9edc12e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:16.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.621+0000 7f9ee138f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9edc1303e0 0x7f9edc12e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:16.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.621+0000 7f9ee138f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc12eee0 con 0x7f9edc05e090 2023-09-30T22:22:16.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.621+0000 7f9ee138f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc12fb60 con 0x7f9edc1303e0 2023-09-30T22:22:16.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.621+0000 7f9ee138f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc1301a0 con 0x7f9edc12b690 2023-09-30T22:22:16.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.621+0000 7f9edaffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9edc05e090 0x7f9edc12e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:16.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.621+0000 7f9edaffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9edc05e090 0x7f9edc12e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48120/0 (socket says 172.21.15.40:48120) 2023-09-30T22:22:16.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.621+0000 7f9edaffd700 1 -- 172.21.15.40:0/1196571315 learned_addr learned my addr 172.21.15.40:0/1196571315 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:16.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.621+0000 7f9edb7fe700 1 --2- 172.21.15.40:0/1196571315 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9edc1303e0 0x7f9edc12e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:16.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.621+0000 7f9eda7fc700 1 --2- 172.21.15.40:0/1196571315 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9edc12b690 0x7f9edc12e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:16.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.621+0000 7f9edb7fe700 1 -- 172.21.15.40:0/1196571315 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9edc12b690 msgr2=0x7f9edc12e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.621+0000 7f9edb7fe700 1 --2- 172.21.15.40:0/1196571315 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9edc12b690 0x7f9edc12e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:16.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.621+0000 7f9edb7fe700 1 -- 172.21.15.40:0/1196571315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9edc05e090 msgr2=0x7f9edc12e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.621+0000 7f9edb7fe700 1 --2- 172.21.15.40:0/1196571315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9edc05e090 0x7f9edc12e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:16.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.621+0000 7f9edb7fe700 1 -- 172.21.15.40:0/1196571315 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed4009a20 con 0x7f9edc1303e0 2023-09-30T22:22:16.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.621+0000 7f9edaffd700 1 --2- 172.21.15.40:0/1196571315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9edc05e090 0x7f9edc12e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:22:16.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.621+0000 7f9edb7fe700 1 --2- 172.21.15.40:0/1196571315 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9edc1303e0 0x7f9edc12e9f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f9ed4009f10 tx=0x7f9ed400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:16.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.621+0000 7f9ec2ffd700 1 -- 172.21.15.40:0/1196571315 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed400cc20 con 0x7f9edc1303e0 2023-09-30T22:22:16.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.621+0000 7f9ec2ffd700 1 -- 172.21.15.40:0/1196571315 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed400f040 con 0x7f9edc1303e0 2023-09-30T22:22:16.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.621+0000 7f9ee138f700 1 -- 172.21.15.40:0/1196571315 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ecc0092a0 con 0x7f9edc1303e0 2023-09-30T22:22:16.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.621+0000 7f9ec2ffd700 1 -- 172.21.15.40:0/1196571315 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4013400 con 0x7f9edc1303e0 2023-09-30T22:22:16.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.622+0000 7f9ee138f700 1 -- 172.21.15.40:0/1196571315 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9edc111610 con 0x7f9edc1303e0 2023-09-30T22:22:16.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.622+0000 7f9ec2ffd700 1 -- 172.21.15.40:0/1196571315 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f9ed40137f0 con 0x7f9edc1303e0 2023-09-30T22:22:16.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.622+0000 7f9ec2ffd700 1 -- 172.21.15.40:0/1196571315 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f9ed403b9b0 con 0x7f9edc1303e0 2023-09-30T22:22:16.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.623+0000 7f9ee138f700 1 -- 172.21.15.40:0/1196571315 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9edc098320 con 0x7f9edc1303e0 2023-09-30T22:22:16.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.627+0000 7f9ec2ffd700 1 -- 172.21.15.40:0/1196571315 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f9ed401bbd0 con 0x7f9edc1303e0 2023-09-30T22:22:16.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.795+0000 7f9ee138f700 1 -- 172.21.15.40:0/1196571315 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9edc05a260 con 0x7f9edc1303e0 2023-09-30T22:22:16.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.795+0000 7f9ec2ffd700 1 -- 172.21.15.40:0/1196571315 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9ed401b7e0 con 0x7f9edc1303e0 2023-09-30T22:22:16.796 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-09-30T22:22:16.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.797+0000 7f9ee138f700 1 -- 172.21.15.40:0/1196571315 >> v1:172.21.15.40:6816/118905 conn(0x7f9ec802bb90 legacy=0x7f9ec802e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.797+0000 7f9ee138f700 1 -- 172.21.15.40:0/1196571315 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9edc1303e0 msgr2=0x7f9edc12e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.797+0000 7f9ee138f700 1 --2- 172.21.15.40:0/1196571315 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9edc1303e0 0x7f9edc12e9f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f9ed4009f10 tx=0x7f9ed400b040).stop 2023-09-30T22:22:16.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.797+0000 7f9ee138f700 1 -- 172.21.15.40:0/1196571315 shutdown_connections 2023-09-30T22:22:16.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.797+0000 7f9ee138f700 1 --2- 172.21.15.40:0/1196571315 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9edc1303e0 0x7f9edc12e9f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:16.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.797+0000 7f9ee138f700 1 --2- 172.21.15.40:0/1196571315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9edc05e090 0x7f9edc12e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:16.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.797+0000 7f9ee138f700 1 --2- 172.21.15.40:0/1196571315 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9edc12b690 0x7f9edc12e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:16.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.797+0000 7f9ee138f700 1 -- 172.21.15.40:0/1196571315 >> 172.21.15.40:0/1196571315 conn(0x7f9edc09ab40 msgr2=0x7f9edc092e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:16.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.797+0000 7f9ee138f700 1 -- 172.21.15.40:0/1196571315 shutdown_connections 2023-09-30T22:22:16.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.797+0000 7f9ee138f700 1 -- 172.21.15.40:0/1196571315 wait complete. 2023-09-30T22:22:16.809 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:22:16.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.929+0000 7fb9666e4700 1 Processor -- start 2023-09-30T22:22:16.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.929+0000 7fb9666e4700 1 -- start start 2023-09-30T22:22:16.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.930+0000 7fb9666e4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb960096160 0x7fb960099600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:16.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.930+0000 7fb9666e4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb960130650 0x7fb960132a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:16.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.930+0000 7fb9666e4700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb960098910 con 0x7fb960098b10 2023-09-30T22:22:16.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.930+0000 7fb9666e4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb960096560 con 0x7fb960130650 2023-09-30T22:22:16.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.930+0000 7fb9666e4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb960065e40 con 0x7fb960096160 2023-09-30T22:22:16.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.930+0000 7fb957fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb960096160 0x7fb960099600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:16.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.930+0000 7fb964c81700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb960130650 0x7fb960132a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:16.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.930+0000 7fb95ffff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb960098b10 0x7fb960098ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53306/0 (socket says 172.21.15.40:53306) 2023-09-30T22:22:16.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.930+0000 7fb95ffff700 1 -- 172.21.15.40:0/13287645 learned_addr learned my addr 172.21.15.40:0/13287645 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:22:16.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.930+0000 7fb964c81700 1 -- 172.21.15.40:0/13287645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb960096160 msgr2=0x7fb960099600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:16.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.930+0000 7fb964c81700 1 --2- 172.21.15.40:0/13287645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb960096160 0x7fb960099600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:16.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.930+0000 7fb964c81700 1 -- 172.21.15.40:0/13287645 >> v1:172.21.15.40:6789/0 conn(0x7fb960098b10 legacy=0x7fb960098ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.930+0000 7fb95f7fe700 1 -- 172.21.15.40:0/13287645 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1631502880 0 0) 0x7fb960098910 con 0x7fb960098b10 2023-09-30T22:22:16.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.930+0000 7fb964c81700 1 -- 172.21.15.40:0/13287645 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9600955c0 con 0x7fb960130650 2023-09-30T22:22:16.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.930+0000 7fb957fff700 1 --2- 172.21.15.40:0/13287645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb960096160 0x7fb960099600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:16.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.930+0000 7fb964c81700 1 --2- 172.21.15.40:0/13287645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb960130650 0x7fb960132a40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fb958009e60 tx=0x7fb958009780).ready entity=mon.0 client_cookie=17e9a95f7b372e49 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:16.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.930+0000 7fb95f7fe700 1 -- 172.21.15.40:0/13287645 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95800e070 con 0x7fb960130650 2023-09-30T22:22:16.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.930+0000 7fb95f7fe700 1 -- 172.21.15.40:0/13287645 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95800bb60 con 0x7fb960130650 2023-09-30T22:22:16.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.930+0000 7fb95f7fe700 1 -- 172.21.15.40:0/13287645 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb958012410 con 0x7fb960130650 2023-09-30T22:22:16.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.931+0000 7fb9666e4700 1 -- 172.21.15.40:0/13287645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb960130650 msgr2=0x7fb960132a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.931+0000 7fb9666e4700 1 --2- 172.21.15.40:0/13287645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb960130650 0x7fb960132a40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fb958009e60 tx=0x7fb958009780).stop 2023-09-30T22:22:16.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.931+0000 7fb9666e4700 1 -- 172.21.15.40:0/13287645 shutdown_connections 2023-09-30T22:22:16.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.931+0000 7fb9666e4700 1 --2- 172.21.15.40:0/13287645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb960130650 0x7fb960132a40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:16.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.931+0000 7fb9666e4700 1 --2- 172.21.15.40:0/13287645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb960096160 0x7fb960099600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:16.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.931+0000 7fb9666e4700 1 -- 172.21.15.40:0/13287645 >> 172.21.15.40:0/13287645 conn(0x7fb96009ab30 msgr2=0x7fb96009af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:16.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.931+0000 7fb9666e4700 1 -- 172.21.15.40:0/13287645 shutdown_connections 2023-09-30T22:22:16.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.931+0000 7fb9666e4700 1 -- 172.21.15.40:0/13287645 wait complete. 2023-09-30T22:22:16.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.932+0000 7fb9666e4700 1 Processor -- start 2023-09-30T22:22:16.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.932+0000 7fb9666e4700 1 -- start start 2023-09-30T22:22:16.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.932+0000 7fb9666e4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb960096160 0x7fb96011a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:16.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.932+0000 7fb9666e4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb960098b10 0x7fb96011a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:16.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.932+0000 7fb9666e4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb960130650 0x7fb96011ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:16.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.932+0000 7fb9666e4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96011b130 con 0x7fb960098b10 2023-09-30T22:22:16.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.932+0000 7fb9666e4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb96011d340 con 0x7fb960096160 2023-09-30T22:22:16.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.932+0000 7fb9666e4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb960099de0 con 0x7fb960130650 2023-09-30T22:22:16.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.932+0000 7fb957fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb960098b10 0x7fb96011a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:16.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.932+0000 7fb957fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb960098b10 0x7fb96011a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48136/0 (socket says 172.21.15.40:48136) 2023-09-30T22:22:16.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.932+0000 7fb957fff700 1 -- 172.21.15.40:0/3657086733 learned_addr learned my addr 172.21.15.40:0/3657086733 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:16.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.932+0000 7fb964c81700 1 --2- 172.21.15.40:0/3657086733 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb960130650 0x7fb96011ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:16.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.933+0000 7fb95ffff700 1 --2- 172.21.15.40:0/3657086733 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb960096160 0x7fb96011a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:16.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.933+0000 7fb957fff700 1 -- 172.21.15.40:0/3657086733 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb960130650 msgr2=0x7fb96011ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.933+0000 7fb957fff700 1 --2- 172.21.15.40:0/3657086733 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb960130650 0x7fb96011ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:16.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.933+0000 7fb957fff700 1 -- 172.21.15.40:0/3657086733 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb960096160 msgr2=0x7fb96011a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.933+0000 7fb957fff700 1 --2- 172.21.15.40:0/3657086733 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb960096160 0x7fb96011a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:16.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.933+0000 7fb957fff700 1 -- 172.21.15.40:0/3657086733 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9480092a0 con 0x7fb960098b10 2023-09-30T22:22:16.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.933+0000 7fb957fff700 1 --2- 172.21.15.40:0/3657086733 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb960098b10 0x7fb96011a750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fb94800e9d0 tx=0x7fb948009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:16.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.933+0000 7fb95cff9700 1 -- 172.21.15.40:0/3657086733 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94800c6a0 con 0x7fb960098b10 2023-09-30T22:22:16.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.933+0000 7fb95cff9700 1 -- 172.21.15.40:0/3657086733 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94800c800 con 0x7fb960098b10 2023-09-30T22:22:16.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.933+0000 7fb9666e4700 1 -- 172.21.15.40:0/3657086733 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb958009a20 con 0x7fb960098b10 2023-09-30T22:22:16.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.933+0000 7fb95cff9700 1 -- 172.21.15.40:0/3657086733 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94800cb80 con 0x7fb960098b10 2023-09-30T22:22:16.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.933+0000 7fb9666e4700 1 -- 172.21.15.40:0/3657086733 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb96011d570 con 0x7fb960098b10 2023-09-30T22:22:16.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.934+0000 7fb95cff9700 1 -- 172.21.15.40:0/3657086733 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb94801b400 con 0x7fb960098b10 2023-09-30T22:22:16.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.934+0000 7fb95cff9700 1 -- 172.21.15.40:0/3657086733 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fb94803b4d0 con 0x7fb960098b10 2023-09-30T22:22:16.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.934+0000 7fb9666e4700 1 -- 172.21.15.40:0/3657086733 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb96005a260 con 0x7fb960098b10 2023-09-30T22:22:16.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:16.939+0000 7fb95cff9700 1 -- 172.21.15.40:0/3657086733 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fb948016070 con 0x7fb960098b10 2023-09-30T22:22:17.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.148+0000 7fb9666e4700 1 -- 172.21.15.40:0/3657086733 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb960091e40 con 0x7fb960098b10 2023-09-30T22:22:17.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.148+0000 7fb95cff9700 1 -- 172.21.15.40:0/3657086733 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2156 (secure 0 0 0) 0x7fb948016020 con 0x7fb960098b10 2023-09-30T22:22:17.149 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:22:17.149 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:22:02.347538+0000","modified":"2023-09-30T22:22:05.356644+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4194},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4194":{"gid":4194,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6817/2392027806","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6817","nonce":2392027806}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-30T22:22:17.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.150+0000 7fb9666e4700 1 -- 172.21.15.40:0/3657086733 >> v1:172.21.15.40:6816/118905 conn(0x7fb94002bb60 legacy=0x7fb94002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:17.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.150+0000 7fb9666e4700 1 -- 172.21.15.40:0/3657086733 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb960098b10 msgr2=0x7fb96011a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:17.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.150+0000 7fb9666e4700 1 --2- 172.21.15.40:0/3657086733 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb960098b10 0x7fb96011a750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fb94800e9d0 tx=0x7fb948009060).stop 2023-09-30T22:22:17.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.150+0000 7fb9666e4700 1 -- 172.21.15.40:0/3657086733 shutdown_connections 2023-09-30T22:22:17.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.150+0000 7fb9666e4700 1 --2- 172.21.15.40:0/3657086733 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb960130650 0x7fb96011ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:17.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.150+0000 7fb9666e4700 1 --2- 172.21.15.40:0/3657086733 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb960096160 0x7fb96011a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:17.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.150+0000 7fb9666e4700 1 --2- 172.21.15.40:0/3657086733 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb960098b10 0x7fb96011a750 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:17.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.150+0000 7fb9666e4700 1 -- 172.21.15.40:0/3657086733 >> 172.21.15.40:0/3657086733 conn(0x7fb96009ab30 msgr2=0x7fb960093c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:17.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.150+0000 7fb9666e4700 1 -- 172.21.15.40:0/3657086733 shutdown_connections 2023-09-30T22:22:17.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.150+0000 7fb9666e4700 1 -- 172.21.15.40:0/3657086733 wait complete. 2023-09-30T22:22:17.152 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 6 2023-09-30T22:22:17.163 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:22:17.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.282+0000 7f71a5218700 1 Processor -- start 2023-09-30T22:22:17.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.282+0000 7f71a5218700 1 -- start start 2023-09-30T22:22:17.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.282+0000 7f71a5218700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f71a0098b10 0x7f71a0096160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:17.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.282+0000 7f71a5218700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71a0130650 0x7f71a0132a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:17.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.282+0000 7f71a5218700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71a0098910 con 0x7f71a0098ef0 2023-09-30T22:22:17.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.282+0000 7f71a5218700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71a0065e40 con 0x7f71a0098b10 2023-09-30T22:22:17.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.282+0000 7f71a5218700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71a00955c0 con 0x7f71a0130650 2023-09-30T22:22:17.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.283+0000 7f719f59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71a0130650 0x7f71a0132a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:17.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.283+0000 7f719ed9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f71a0098b10 0x7f71a0096160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:17.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.283+0000 7f719e59c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f71a0098ef0 0x7f71a00992f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53320/0 (socket says 172.21.15.40:53320) 2023-09-30T22:22:17.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.283+0000 7f719e59c700 1 -- 172.21.15.40:0/4004971025 learned_addr learned my addr 172.21.15.40:0/4004971025 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:22:17.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.283+0000 7f719ed9d700 1 -- 172.21.15.40:0/4004971025 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71a0130650 msgr2=0x7f71a0132a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:17.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.283+0000 7f719ed9d700 1 --2- 172.21.15.40:0/4004971025 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71a0130650 0x7f71a0132a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:17.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.283+0000 7f719ed9d700 1 -- 172.21.15.40:0/4004971025 >> v1:172.21.15.40:6789/0 conn(0x7f71a0098ef0 legacy=0x7f71a00992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:17.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.283+0000 7f719ed9d700 1 -- 172.21.15.40:0/4004971025 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a0097750 con 0x7f71a0098b10 2023-09-30T22:22:17.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.283+0000 7f719f59e700 1 --2- 172.21.15.40:0/4004971025 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71a0130650 0x7f71a0132a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:17.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.283+0000 7f719ed9d700 1 --2- 172.21.15.40:0/4004971025 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71a0098b10 0x7f71a0096160 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f7194009760 tx=0x7f7194009060).ready entity=mon.0 client_cookie=6ee0ecc1a62d2e69 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:17.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.283+0000 7f719dd9b700 1 -- 172.21.15.40:0/4004971025 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71940090d0 con 0x7f71a0098b10 2023-09-30T22:22:17.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.283+0000 7f719dd9b700 1 -- 172.21.15.40:0/4004971025 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719400f510 con 0x7f71a0098b10 2023-09-30T22:22:17.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.283+0000 7f719dd9b700 1 -- 172.21.15.40:0/4004971025 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719400f890 con 0x7f71a0098b10 2023-09-30T22:22:17.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.284+0000 7f71a5218700 1 -- 172.21.15.40:0/4004971025 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71a0098b10 msgr2=0x7f71a0096160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:17.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.284+0000 7f71a5218700 1 --2- 172.21.15.40:0/4004971025 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71a0098b10 0x7f71a0096160 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f7194009760 tx=0x7f7194009060).stop 2023-09-30T22:22:17.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.284+0000 7f71a5218700 1 -- 172.21.15.40:0/4004971025 shutdown_connections 2023-09-30T22:22:17.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.284+0000 7f71a5218700 1 --2- 172.21.15.40:0/4004971025 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71a0130650 0x7f71a0132a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:17.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.284+0000 7f71a5218700 1 --2- 172.21.15.40:0/4004971025 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71a0098b10 0x7f71a0096160 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:17.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.284+0000 7f71a5218700 1 -- 172.21.15.40:0/4004971025 >> 172.21.15.40:0/4004971025 conn(0x7f71a009ab30 msgr2=0x7f71a009af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:17.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.284+0000 7f71a5218700 1 -- 172.21.15.40:0/4004971025 shutdown_connections 2023-09-30T22:22:17.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.284+0000 7f71a5218700 1 -- 172.21.15.40:0/4004971025 wait complete. 2023-09-30T22:22:17.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.285+0000 7f71a5218700 1 Processor -- start 2023-09-30T22:22:17.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.285+0000 7f71a5218700 1 -- start start 2023-09-30T22:22:17.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.285+0000 7f71a5218700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71a0098b10 0x7f71a013ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:17.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.285+0000 7f71a5218700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f71a0098ef0 0x7f71a013b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:17.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.285+0000 7f71a5218700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71a0130650 0x7f71a011a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:17.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.285+0000 7f71a5218700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a011e1b0 con 0x7f71a0130650 2023-09-30T22:22:17.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.285+0000 7f71a5218700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71a0130a30 con 0x7f71a0098b10 2023-09-30T22:22:17.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.285+0000 7f71a5218700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71a009ce80 con 0x7f71a0098ef0 2023-09-30T22:22:17.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.285+0000 7f719ed9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71a0098b10 0x7f71a013ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:17.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.285+0000 7f719e59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f71a0098ef0 0x7f71a013b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:17.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.285+0000 7f719f59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71a0130650 0x7f71a011a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:17.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.285+0000 7f719ed9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71a0098b10 0x7f71a013ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:55316/0 (socket says 172.21.15.40:55316) 2023-09-30T22:22:17.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.285+0000 7f719ed9d700 1 -- 172.21.15.40:0/939868176 learned_addr learned my addr 172.21.15.40:0/939868176 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:17.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.285+0000 7f719f59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71a0130650 0x7f71a011a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48162/0 (socket says 172.21.15.40:48162) 2023-09-30T22:22:17.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.286+0000 7f719f59e700 1 -- 172.21.15.40:0/939868176 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f71a0098ef0 msgr2=0x7f71a013b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:17.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.286+0000 7f719f59e700 1 --2- 172.21.15.40:0/939868176 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f71a0098ef0 0x7f71a013b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:17.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.286+0000 7f719f59e700 1 -- 172.21.15.40:0/939868176 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71a0098b10 msgr2=0x7f71a013ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:17.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.286+0000 7f719f59e700 1 --2- 172.21.15.40:0/939868176 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71a0098b10 0x7f71a013ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:17.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.286+0000 7f719f59e700 1 -- 172.21.15.40:0/939868176 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7198009a20 con 0x7f71a0130650 2023-09-30T22:22:17.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.286+0000 7f719ed9d700 1 --2- 172.21.15.40:0/939868176 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71a0098b10 0x7f71a013ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:17.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.286+0000 7f719f59e700 1 --2- 172.21.15.40:0/939868176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71a0130650 0x7f71a011a760 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f71a009de20 tx=0x7f719800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:17.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.286+0000 7f7186ffd700 1 -- 172.21.15.40:0/939868176 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719800caa0 con 0x7f71a0130650 2023-09-30T22:22:17.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.286+0000 7f7186ffd700 1 -- 172.21.15.40:0/939868176 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719800f040 con 0x7f71a0130650 2023-09-30T22:22:17.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.286+0000 7f71a5218700 1 -- 172.21.15.40:0/939868176 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71940092a0 con 0x7f71a0130650 2023-09-30T22:22:17.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.286+0000 7f7186ffd700 1 -- 172.21.15.40:0/939868176 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719800ce30 con 0x7f71a0130650 2023-09-30T22:22:17.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.286+0000 7f71a5218700 1 -- 172.21.15.40:0/939868176 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71a011c320 con 0x7f71a0130650 2023-09-30T22:22:17.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.287+0000 7f7186ffd700 1 -- 172.21.15.40:0/939868176 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f7198013610 con 0x7f71a0130650 2023-09-30T22:22:17.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.287+0000 7f7186ffd700 1 -- 172.21.15.40:0/939868176 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f719803b800 con 0x7f71a0130650 2023-09-30T22:22:17.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.287+0000 7f71a5218700 1 -- 172.21.15.40:0/939868176 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71a00971e0 con 0x7f71a0130650 2023-09-30T22:22:17.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.291+0000 7f7186ffd700 1 -- 172.21.15.40:0/939868176 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f719801c410 con 0x7f71a0130650 2023-09-30T22:22:17.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.458+0000 7f71a5218700 1 -- 172.21.15.40:0/939868176 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71a011ccc0 con 0x7f71a0130650 2023-09-30T22:22:17.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.459+0000 7f7186ffd700 1 -- 172.21.15.40:0/939868176 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11341 (secure 0 0 0) 0x7f719801a310 con 0x7f71a0130650 2023-09-30T22:22:17.459 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:22:17.460 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":17,"fsid":"79dd4d8e-f295-4d9c-bd93-9850863800e3","created":"2023-09-30T22:21:46.980357+0000","modified":"2023-09-30T22:22:03.348895+0000","last_up_change":"2023-09-30T22:21:54.822866+0000","last_in_change":"2023-09-30T22:21:48.205613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:21:54.875024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:21:56.197012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:22:00.759069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:22:01.327265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"771f785c-f464-4b17-936c-cbf31b1153e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6812","nonce":119451}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6813","nonce":119451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6815","nonce":119451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6814","nonce":119451}]},"public_addr":"172.21.15.40:6812/119451","cluster_addr":"172.21.15.40:6813/119451","heartbeat_back_addr":"172.21.15.40:6815/119451","heartbeat_front_addr":"172.21.15.40:6814/119451","state":["exists","up"]},{"osd":1,"uuid":"45f1e2e8-5310-4219-ab54-424e7440fcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6808","nonce":119436}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6809","nonce":119436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6811","nonce":119436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6810","nonce":119436}]},"public_addr":"172.21.15.40:6808/119436","cluster_addr":"172.21.15.40:6809/119436","heartbeat_back_addr":"172.21.15.40:6811/119436","heartbeat_front_addr":"172.21.15.40:6810/119436","state":["exists","up"]},{"osd":2,"uuid":"7ba62ae5-d21e-4d56-b46c-ba7b718ede25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6800","nonce":119433}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6801","nonce":119433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6803","nonce":119433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6802","nonce":119433}]},"public_addr":"172.21.15.40:6800/119433","cluster_addr":"172.21.15.40:6801/119433","heartbeat_back_addr":"172.21.15.40:6803/119433","heartbeat_front_addr":"172.21.15.40:6802/119433","state":["exists","up"]},{"osd":3,"uuid":"c9c55985-8a90-4927-a8fa-6a1fcec1cd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6804","nonce":119432}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6805","nonce":119432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6807","nonce":119432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6806","nonce":119432}]},"public_addr":"172.21.15.40:6804/119432","cluster_addr":"172.21.15.40:6805/119432","heartbeat_back_addr":"172.21.15.40:6807/119432","heartbeat_front_addr":"172.21.15.40:6806/119432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.339829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.554690+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.641664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.320635+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:22:17.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.461+0000 7f71a5218700 1 -- 172.21.15.40:0/939868176 >> v1:172.21.15.40:6816/118905 conn(0x7f718c02bb60 legacy=0x7f718c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:17.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.461+0000 7f71a5218700 1 -- 172.21.15.40:0/939868176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71a0130650 msgr2=0x7f71a011a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:17.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.461+0000 7f71a5218700 1 --2- 172.21.15.40:0/939868176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71a0130650 0x7f71a011a760 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f71a009de20 tx=0x7f719800b040).stop 2023-09-30T22:22:17.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.461+0000 7f71a5218700 1 -- 172.21.15.40:0/939868176 shutdown_connections 2023-09-30T22:22:17.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.461+0000 7f71a5218700 1 --2- 172.21.15.40:0/939868176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71a0130650 0x7f71a011a760 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:17.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.461+0000 7f71a5218700 1 --2- 172.21.15.40:0/939868176 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71a0098b10 0x7f71a013ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:17.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.461+0000 7f71a5218700 1 --2- 172.21.15.40:0/939868176 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f71a0098ef0 0x7f71a013b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:17.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.461+0000 7f71a5218700 1 -- 172.21.15.40:0/939868176 >> 172.21.15.40:0/939868176 conn(0x7f71a009ab30 msgr2=0x7f71a01144b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:17.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.461+0000 7f71a5218700 1 -- 172.21.15.40:0/939868176 shutdown_connections 2023-09-30T22:22:17.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.461+0000 7f71a5218700 1 -- 172.21.15.40:0/939868176 wait complete. 2023-09-30T22:22:17.473 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-09-30T22:21:54.875024+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:21:56.197012+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:22:00.759069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:22:01.327265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T22:22:17.474 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-09-30T22:22:17.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.596+0000 7ffb52a08700 1 Processor -- start 2023-09-30T22:22:17.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.596+0000 7ffb52a08700 1 -- start start 2023-09-30T22:22:17.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.597+0000 7ffb52a08700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffb4c0657e0 0x7ffb4c096620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:17.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.597+0000 7ffb52a08700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb4c097ec0 0x7ffb4c096b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:17.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.597+0000 7ffb52a08700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb4c097000 0x7ffb4c131650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:17.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.597+0000 7ffb52a08700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb4c098350 con 0x7ffb4c0657e0 2023-09-30T22:22:17.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.597+0000 7ffb52a08700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c0662b0 con 0x7ffb4c097000 2023-09-30T22:22:17.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.597+0000 7ffb52a08700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c065bc0 con 0x7ffb4c097ec0 2023-09-30T22:22:17.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.597+0000 7ffb4bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffb4c0657e0 0x7ffb4c096620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:17.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.597+0000 7ffb4b7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb4c097ec0 0x7ffb4c096b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:17.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.597+0000 7ffb50fa5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb4c097000 0x7ffb4c131650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:17.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.597+0000 7ffb4bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffb4c0657e0 0x7ffb4c096620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48178/0 (socket says 172.21.15.40:48178) 2023-09-30T22:22:17.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.597+0000 7ffb50fa5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb4c097000 0x7ffb4c131650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:55324/0 (socket says 172.21.15.40:55324) 2023-09-30T22:22:17.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.597+0000 7ffb4b7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb4c097ec0 0x7ffb4c096b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33596/0 (socket says 172.21.15.40:33596) 2023-09-30T22:22:17.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.597+0000 7ffb4bfff700 1 -- 172.21.15.40:0/2462050907 learned_addr learned my addr 172.21.15.40:0/2462050907 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:17.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.597+0000 7ffb4b7fe700 1 -- 172.21.15.40:0/2462050907 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb4c097000 msgr2=0x7ffb4c131650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:17.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.597+0000 7ffb4b7fe700 1 --2- 172.21.15.40:0/2462050907 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb4c097000 0x7ffb4c131650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:17.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.597+0000 7ffb4b7fe700 1 -- 172.21.15.40:0/2462050907 >> v2:172.21.15.40:3300/0 conn(0x7ffb4c0657e0 msgr2=0x7ffb4c096620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:17.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.597+0000 7ffb4b7fe700 1 --2- 172.21.15.40:0/2462050907 >> v2:172.21.15.40:3300/0 conn(0x7ffb4c0657e0 0x7ffb4c096620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:17.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.597+0000 7ffb4b7fe700 1 -- 172.21.15.40:0/2462050907 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb4c096350 con 0x7ffb4c097ec0 2023-09-30T22:22:17.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.597+0000 7ffb4bfff700 1 --2- 172.21.15.40:0/2462050907 >> v2:172.21.15.40:3300/0 conn(0x7ffb4c0657e0 0x7ffb4c096620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:17.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.597+0000 7ffb4b7fe700 1 --2- 172.21.15.40:0/2462050907 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb4c097ec0 0x7ffb4c096b10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7ffb34009760 tx=0x7ffb34009060).ready entity=mon.2 client_cookie=50d4af26b31cae23 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:17.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.598+0000 7ffb4affd700 1 -- 172.21.15.40:0/2462050907 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb340090d0 con 0x7ffb4c097ec0 2023-09-30T22:22:17.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.598+0000 7ffb4affd700 1 -- 172.21.15.40:0/2462050907 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3400d4a0 con 0x7ffb4c097ec0 2023-09-30T22:22:17.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.598+0000 7ffb4affd700 1 -- 172.21.15.40:0/2462050907 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3400d820 con 0x7ffb4c097ec0 2023-09-30T22:22:17.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.598+0000 7ffb52a08700 1 -- 172.21.15.40:0/2462050907 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb4c097ec0 msgr2=0x7ffb4c096b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:17.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.598+0000 7ffb52a08700 1 --2- 172.21.15.40:0/2462050907 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb4c097ec0 0x7ffb4c096b10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7ffb34009760 tx=0x7ffb34009060).stop 2023-09-30T22:22:17.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.598+0000 7ffb52a08700 1 -- 172.21.15.40:0/2462050907 shutdown_connections 2023-09-30T22:22:17.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.598+0000 7ffb52a08700 1 --2- 172.21.15.40:0/2462050907 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb4c097000 0x7ffb4c131650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:17.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.598+0000 7ffb52a08700 1 --2- 172.21.15.40:0/2462050907 >> v2:172.21.15.40:3300/0 conn(0x7ffb4c0657e0 0x7ffb4c096620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:17.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.598+0000 7ffb52a08700 1 --2- 172.21.15.40:0/2462050907 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb4c097ec0 0x7ffb4c096b10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:17.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.598+0000 7ffb52a08700 1 -- 172.21.15.40:0/2462050907 >> 172.21.15.40:0/2462050907 conn(0x7ffb4c09de50 msgr2=0x7ffb4c09e260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:17.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.598+0000 7ffb52a08700 1 -- 172.21.15.40:0/2462050907 shutdown_connections 2023-09-30T22:22:17.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.598+0000 7ffb52a08700 1 -- 172.21.15.40:0/2462050907 wait complete. 2023-09-30T22:22:17.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.599+0000 7ffb52a08700 1 Processor -- start 2023-09-30T22:22:17.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.599+0000 7ffb52a08700 1 -- start start 2023-09-30T22:22:17.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.600+0000 7ffb52a08700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb4c0657e0 0x7ffb4c13abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:17.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.600+0000 7ffb52a08700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb4c097000 0x7ffb4c13b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:17.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.600+0000 7ffb52a08700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb4c11a750 0x7ffb4c11ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:17.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.600+0000 7ffb52a08700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c11e2f0 con 0x7ffb4c0657e0 2023-09-30T22:22:17.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.600+0000 7ffb52a08700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c09cc90 con 0x7ffb4c097000 2023-09-30T22:22:17.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.600+0000 7ffb52a08700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c099d70 con 0x7ffb4c11a750 2023-09-30T22:22:17.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.600+0000 7ffb4bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb4c0657e0 0x7ffb4c13abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:17.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.600+0000 7ffb4bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb4c0657e0 0x7ffb4c13abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48180/0 (socket says 172.21.15.40:48180) 2023-09-30T22:22:17.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.600+0000 7ffb4bfff700 1 -- 172.21.15.40:0/1143857702 learned_addr learned my addr 172.21.15.40:0/1143857702 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:17.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.600+0000 7ffb50fa5700 1 --2- 172.21.15.40:0/1143857702 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb4c11a750 0x7ffb4c11ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:17.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.600+0000 7ffb4b7fe700 1 --2- 172.21.15.40:0/1143857702 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb4c097000 0x7ffb4c13b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:17.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.600+0000 7ffb4bfff700 1 -- 172.21.15.40:0/1143857702 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb4c11a750 msgr2=0x7ffb4c11ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:17.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.600+0000 7ffb4bfff700 1 --2- 172.21.15.40:0/1143857702 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb4c11a750 0x7ffb4c11ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:17.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.600+0000 7ffb4bfff700 1 -- 172.21.15.40:0/1143857702 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb4c097000 msgr2=0x7ffb4c13b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:17.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.600+0000 7ffb4bfff700 1 --2- 172.21.15.40:0/1143857702 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb4c097000 0x7ffb4c13b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:17.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.600+0000 7ffb4bfff700 1 -- 172.21.15.40:0/1143857702 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb3c009370 con 0x7ffb4c0657e0 2023-09-30T22:22:17.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.600+0000 7ffb4b7fe700 1 --2- 172.21.15.40:0/1143857702 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb4c097000 0x7ffb4c13b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:17.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.600+0000 7ffb4bfff700 1 --2- 172.21.15.40:0/1143857702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb4c0657e0 0x7ffb4c13abc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7ffb3c00ea20 tx=0x7ffb3c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:17.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.600+0000 7ffb43fff700 1 -- 172.21.15.40:0/1143857702 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c00ee60 con 0x7ffb4c0657e0 2023-09-30T22:22:17.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.600+0000 7ffb43fff700 1 -- 172.21.15.40:0/1143857702 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3c00c850 con 0x7ffb4c0657e0 2023-09-30T22:22:17.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.600+0000 7ffb52a08700 1 -- 172.21.15.40:0/1143857702 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb340092a0 con 0x7ffb4c0657e0 2023-09-30T22:22:17.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.600+0000 7ffb43fff700 1 -- 172.21.15.40:0/1143857702 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c00cbd0 con 0x7ffb4c0657e0 2023-09-30T22:22:17.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.601+0000 7ffb52a08700 1 -- 172.21.15.40:0/1143857702 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb4c11e960 con 0x7ffb4c0657e0 2023-09-30T22:22:17.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.601+0000 7ffb43fff700 1 -- 172.21.15.40:0/1143857702 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7ffb3c01b400 con 0x7ffb4c0657e0 2023-09-30T22:22:17.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.601+0000 7ffb43fff700 1 -- 172.21.15.40:0/1143857702 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7ffb3c03b4c0 con 0x7ffb4c0657e0 2023-09-30T22:22:17.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.602+0000 7ffb52a08700 1 -- 172.21.15.40:0/1143857702 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb4c099270 con 0x7ffb4c0657e0 2023-09-30T22:22:17.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.606+0000 7ffb43fff700 1 -- 172.21.15.40:0/1143857702 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7ffb3c016070 con 0x7ffb4c0657e0 2023-09-30T22:22:17.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.771+0000 7ffb52a08700 1 -- 172.21.15.40:0/1143857702 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ffb4c099470 con 0x7ffb4c0657e0 2023-09-30T22:22:17.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.772+0000 7ffb43fff700 1 -- 172.21.15.40:0/1143857702 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7ffb3c0290b0 con 0x7ffb4c0657e0 2023-09-30T22:22:17.772 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-09-30T22:22:17.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.773+0000 7ffb52a08700 1 -- 172.21.15.40:0/1143857702 >> v1:172.21.15.40:6816/118905 conn(0x7ffb2c02bb90 legacy=0x7ffb2c02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:17.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.773+0000 7ffb52a08700 1 -- 172.21.15.40:0/1143857702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb4c0657e0 msgr2=0x7ffb4c13abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:17.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.773+0000 7ffb52a08700 1 --2- 172.21.15.40:0/1143857702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb4c0657e0 0x7ffb4c13abc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7ffb3c00ea20 tx=0x7ffb3c0090f0).stop 2023-09-30T22:22:17.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.773+0000 7ffb52a08700 1 -- 172.21.15.40:0/1143857702 shutdown_connections 2023-09-30T22:22:17.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.773+0000 7ffb52a08700 1 --2- 172.21.15.40:0/1143857702 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb4c11a750 0x7ffb4c11ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:17.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.773+0000 7ffb52a08700 1 --2- 172.21.15.40:0/1143857702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb4c0657e0 0x7ffb4c13abc0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:17.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.773+0000 7ffb52a08700 1 --2- 172.21.15.40:0/1143857702 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb4c097000 0x7ffb4c13b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:17.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.773+0000 7ffb52a08700 1 -- 172.21.15.40:0/1143857702 >> 172.21.15.40:0/1143857702 conn(0x7ffb4c09de50 msgr2=0x7ffb4c09bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:17.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.774+0000 7ffb52a08700 1 -- 172.21.15.40:0/1143857702 shutdown_connections 2023-09-30T22:22:17.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.774+0000 7ffb52a08700 1 -- 172.21.15.40:0/1143857702 wait complete. 2023-09-30T22:22:17.786 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:22:17.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.911+0000 7f302ce67700 1 Processor -- start 2023-09-30T22:22:17.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.911+0000 7f302ce67700 1 -- start start 2023-09-30T22:22:17.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.911+0000 7f302ce67700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3028097ec0 0x7f3028096d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:17.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.911+0000 7f302ce67700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3028097220 0x7f3028132660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:17.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.911+0000 7f302ce67700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3028098350 con 0x7f30280657e0 2023-09-30T22:22:17.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.911+0000 7f302ce67700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3028065bc0 con 0x7f3028097220 2023-09-30T22:22:17.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.911+0000 7f302ce67700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3028096350 con 0x7f3028097ec0 2023-09-30T22:22:17.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.912+0000 7f3025d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3028097ec0 0x7f3028096d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:17.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.912+0000 7f3025d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3028097ec0 0x7f3028096d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33616/0 (socket says 172.21.15.40:33616) 2023-09-30T22:22:17.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.912+0000 7f3026d9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3028097220 0x7f3028132660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:17.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.912+0000 7f3025d9b700 1 -- 172.21.15.40:0/3416875267 learned_addr learned my addr 172.21.15.40:0/3416875267 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:17.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.912+0000 7f302659c700 1 --1- 172.21.15.40:0/3416875267 >> v1:172.21.15.40:6789/0 conn(0x7f30280657e0 0x7f3028096620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53328/0 (socket says 172.21.15.40:53328) 2023-09-30T22:22:17.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.912+0000 7f3026d9d700 1 -- 172.21.15.40:0/3416875267 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3028097ec0 msgr2=0x7f3028096d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:17.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.912+0000 7f3026d9d700 1 --2- 172.21.15.40:0/3416875267 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3028097ec0 0x7f3028096d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:17.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.912+0000 7f3026d9d700 1 -- 172.21.15.40:0/3416875267 >> v1:172.21.15.40:6789/0 conn(0x7f30280657e0 legacy=0x7f3028096620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:17.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.912+0000 7f302559a700 1 -- 172.21.15.40:0/3416875267 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445696243 0 0) 0x7f3028098350 con 0x7f30280657e0 2023-09-30T22:22:17.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.912+0000 7f3026d9d700 1 -- 172.21.15.40:0/3416875267 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30280662b0 con 0x7f3028097220 2023-09-30T22:22:17.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.912+0000 7f3025d9b700 1 --2- 172.21.15.40:0/3416875267 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3028097ec0 0x7f3028096d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:17.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.912+0000 7f3026d9d700 1 --2- 172.21.15.40:0/3416875267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3028097220 0x7f3028132660 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f3020009e60 tx=0x7f3020009780).ready entity=mon.0 client_cookie=6738f7e6fd548fe6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:17.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.912+0000 7f302559a700 1 -- 172.21.15.40:0/3416875267 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302000e070 con 0x7f3028097220 2023-09-30T22:22:17.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.912+0000 7f302559a700 1 -- 172.21.15.40:0/3416875267 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302000bb60 con 0x7f3028097220 2023-09-30T22:22:17.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.912+0000 7f302559a700 1 -- 172.21.15.40:0/3416875267 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3020012410 con 0x7f3028097220 2023-09-30T22:22:17.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.913+0000 7f302ce67700 1 -- 172.21.15.40:0/3416875267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3028097220 msgr2=0x7f3028132660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:17.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.913+0000 7f302ce67700 1 --2- 172.21.15.40:0/3416875267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3028097220 0x7f3028132660 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f3020009e60 tx=0x7f3020009780).stop 2023-09-30T22:22:17.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.913+0000 7f302ce67700 1 -- 172.21.15.40:0/3416875267 shutdown_connections 2023-09-30T22:22:17.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.913+0000 7f302ce67700 1 --2- 172.21.15.40:0/3416875267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3028097220 0x7f3028132660 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:17.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.913+0000 7f302ce67700 1 --2- 172.21.15.40:0/3416875267 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3028097ec0 0x7f3028096d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:17.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.913+0000 7f302ce67700 1 -- 172.21.15.40:0/3416875267 >> 172.21.15.40:0/3416875267 conn(0x7f302809de50 msgr2=0x7f302809e260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:17.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.913+0000 7f302ce67700 1 -- 172.21.15.40:0/3416875267 shutdown_connections 2023-09-30T22:22:17.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.913+0000 7f302ce67700 1 -- 172.21.15.40:0/3416875267 wait complete. 2023-09-30T22:22:17.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.914+0000 7f302ce67700 1 Processor -- start 2023-09-30T22:22:17.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.914+0000 7f302ce67700 1 -- start start 2023-09-30T22:22:17.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.914+0000 7f302ce67700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f30280657e0 0x7f302811e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:17.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.914+0000 7f302ce67700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3028097220 0x7f302811a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:17.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.914+0000 7f302ce67700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f302811a930 0x7f302811adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:17.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.914+0000 7f302ce67700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30281329d0 con 0x7f30280657e0 2023-09-30T22:22:17.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.914+0000 7f302ce67700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30281325c0 con 0x7f3028097220 2023-09-30T22:22:17.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.914+0000 7f302ce67700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f302811cab0 con 0x7f302811a930 2023-09-30T22:22:17.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.914+0000 7f302659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f30280657e0 0x7f302811e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:17.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.914+0000 7f3026d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f302811a930 0x7f302811adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:17.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.914+0000 7f302659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f30280657e0 0x7f302811e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48198/0 (socket says 172.21.15.40:48198) 2023-09-30T22:22:17.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.914+0000 7f302659c700 1 -- 172.21.15.40:0/685949648 learned_addr learned my addr 172.21.15.40:0/685949648 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:17.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.914+0000 7f3025d9b700 1 --2- 172.21.15.40:0/685949648 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3028097220 0x7f302811a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:17.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.914+0000 7f302659c700 1 -- 172.21.15.40:0/685949648 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f302811a930 msgr2=0x7f302811adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:17.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.914+0000 7f302659c700 1 --2- 172.21.15.40:0/685949648 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f302811a930 0x7f302811adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:17.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.914+0000 7f302659c700 1 -- 172.21.15.40:0/685949648 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3028097220 msgr2=0x7f302811a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:17.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.914+0000 7f302659c700 1 --2- 172.21.15.40:0/685949648 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3028097220 0x7f302811a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:17.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.914+0000 7f302659c700 1 -- 172.21.15.40:0/685949648 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f301c009370 con 0x7f30280657e0 2023-09-30T22:22:17.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.914+0000 7f3026d9d700 1 --2- 172.21.15.40:0/685949648 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f302811a930 0x7f302811adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:17.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.915+0000 7f302659c700 1 --2- 172.21.15.40:0/685949648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f30280657e0 0x7f302811e420 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f301800c4c0 tx=0x7f3018007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:17.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.915+0000 7f30167fc700 1 -- 172.21.15.40:0/685949648 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301800ce30 con 0x7f30280657e0 2023-09-30T22:22:17.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.915+0000 7f30167fc700 1 -- 172.21.15.40:0/685949648 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30180072e0 con 0x7f30280657e0 2023-09-30T22:22:17.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.915+0000 7f302ce67700 1 -- 172.21.15.40:0/685949648 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3020009a20 con 0x7f30280657e0 2023-09-30T22:22:17.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.915+0000 7f30167fc700 1 -- 172.21.15.40:0/685949648 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30180056e0 con 0x7f30280657e0 2023-09-30T22:22:17.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.915+0000 7f302ce67700 1 -- 172.21.15.40:0/685949648 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f302811b2a0 con 0x7f30280657e0 2023-09-30T22:22:17.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.916+0000 7f302ce67700 1 -- 172.21.15.40:0/685949648 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30280947b0 con 0x7f30280657e0 2023-09-30T22:22:17.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.916+0000 7f30167fc700 1 -- 172.21.15.40:0/685949648 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f3018005a50 con 0x7f30280657e0 2023-09-30T22:22:17.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.916+0000 7f30167fc700 1 -- 172.21.15.40:0/685949648 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f301803a5e0 con 0x7f30280657e0 2023-09-30T22:22:17.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:17.920+0000 7f30167fc700 1 -- 172.21.15.40:0/685949648 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f301801c350 con 0x7f30280657e0 2023-09-30T22:22:18.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.088+0000 7f302ce67700 1 -- 172.21.15.40:0/685949648 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f302809c030 con 0x7f30280657e0 2023-09-30T22:22:18.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.089+0000 7f30167fc700 1 -- 172.21.15.40:0/685949648 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3018010ab0 con 0x7f30280657e0 2023-09-30T22:22:18.089 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-09-30T22:22:18.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.090+0000 7f302ce67700 1 -- 172.21.15.40:0/685949648 >> v1:172.21.15.40:6816/118905 conn(0x7f300802bb90 legacy=0x7f300802e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:18.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.090+0000 7f302ce67700 1 -- 172.21.15.40:0/685949648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f30280657e0 msgr2=0x7f302811e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:18.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.090+0000 7f302ce67700 1 --2- 172.21.15.40:0/685949648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f30280657e0 0x7f302811e420 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f301800c4c0 tx=0x7f3018007c10).stop 2023-09-30T22:22:18.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.091+0000 7f302ce67700 1 -- 172.21.15.40:0/685949648 shutdown_connections 2023-09-30T22:22:18.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.091+0000 7f302ce67700 1 --2- 172.21.15.40:0/685949648 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f302811a930 0x7f302811adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:18.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.091+0000 7f302ce67700 1 --2- 172.21.15.40:0/685949648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f30280657e0 0x7f302811e420 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:18.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.091+0000 7f302ce67700 1 --2- 172.21.15.40:0/685949648 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3028097220 0x7f302811a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:18.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.091+0000 7f302ce67700 1 -- 172.21.15.40:0/685949648 >> 172.21.15.40:0/685949648 conn(0x7f302809de50 msgr2=0x7f30280987a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:18.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.091+0000 7f302ce67700 1 -- 172.21.15.40:0/685949648 shutdown_connections 2023-09-30T22:22:18.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.091+0000 7f302ce67700 1 -- 172.21.15.40:0/685949648 wait complete. 2023-09-30T22:22:18.103 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:22:18.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.225+0000 7f7030989700 1 Processor -- start 2023-09-30T22:22:18.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.225+0000 7f7030989700 1 -- start start 2023-09-30T22:22:18.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.226+0000 7f7030989700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f702c095e80 0x7f702c096640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:18.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.226+0000 7f7030989700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f702c093d00 0x7f702c096b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:18.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.226+0000 7f7030989700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f702c0941b0 con 0x7f702c097020 2023-09-30T22:22:18.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.226+0000 7f7030989700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f702c096260 con 0x7f702c093d00 2023-09-30T22:22:18.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.226+0000 7f7030989700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f702c097ad0 con 0x7f702c095e80 2023-09-30T22:22:18.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.226+0000 7f702a59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f702c095e80 0x7f702c096640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:18.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.226+0000 7f7029d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f702c093d00 0x7f702c096b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:18.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.226+0000 7f702ad9d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f702c097020 0x7f702c12f4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53338/0 (socket says 172.21.15.40:53338) 2023-09-30T22:22:18.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.226+0000 7f702ad9d700 1 -- 172.21.15.40:0/3125520816 learned_addr learned my addr 172.21.15.40:0/3125520816 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:22:18.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.226+0000 7f702a59c700 1 -- 172.21.15.40:0/3125520816 >> v2:172.21.15.40:3300/0 conn(0x7f702c093d00 msgr2=0x7f702c096b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:18.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.226+0000 7f702a59c700 1 --2- 172.21.15.40:0/3125520816 >> v2:172.21.15.40:3300/0 conn(0x7f702c093d00 0x7f702c096b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:18.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.226+0000 7f702a59c700 1 -- 172.21.15.40:0/3125520816 >> v1:172.21.15.40:6789/0 conn(0x7f702c097020 legacy=0x7f702c12f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:18.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.226+0000 7f702a59c700 1 -- 172.21.15.40:0/3125520816 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702c097490 con 0x7f702c095e80 2023-09-30T22:22:18.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.226+0000 7f702959a700 1 -- 172.21.15.40:0/3125520816 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1634209652 0 0) 0x7f702c0941b0 con 0x7f702c097020 2023-09-30T22:22:18.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.226+0000 7f7029d9b700 1 --2- 172.21.15.40:0/3125520816 >> v2:172.21.15.40:3300/0 conn(0x7f702c093d00 0x7f702c096b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:18.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.226+0000 7f702a59c700 1 --2- 172.21.15.40:0/3125520816 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f702c095e80 0x7f702c096640 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f7020009790 tx=0x7f7020009060).ready entity=mon.1 client_cookie=8ae47bb6915c8044 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:18.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.227+0000 7f702959a700 1 -- 172.21.15.40:0/3125520816 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702000f510 con 0x7f702c095e80 2023-09-30T22:22:18.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.227+0000 7f702959a700 1 -- 172.21.15.40:0/3125520816 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702000f670 con 0x7f702c095e80 2023-09-30T22:22:18.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.227+0000 7f702959a700 1 -- 172.21.15.40:0/3125520816 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702000f9f0 con 0x7f702c095e80 2023-09-30T22:22:18.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.227+0000 7f7030989700 1 -- 172.21.15.40:0/3125520816 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f702c095e80 msgr2=0x7f702c096640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:18.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.227+0000 7f7030989700 1 --2- 172.21.15.40:0/3125520816 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f702c095e80 0x7f702c096640 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f7020009790 tx=0x7f7020009060).stop 2023-09-30T22:22:18.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.227+0000 7f7030989700 1 -- 172.21.15.40:0/3125520816 shutdown_connections 2023-09-30T22:22:18.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.227+0000 7f7030989700 1 --2- 172.21.15.40:0/3125520816 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f702c095e80 0x7f702c096640 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:18.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.227+0000 7f7030989700 1 --2- 172.21.15.40:0/3125520816 >> v2:172.21.15.40:3300/0 conn(0x7f702c093d00 0x7f702c096b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:18.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.227+0000 7f7030989700 1 -- 172.21.15.40:0/3125520816 >> 172.21.15.40:0/3125520816 conn(0x7f702c09bcf0 msgr2=0x7f702c09c100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:18.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.227+0000 7f7030989700 1 -- 172.21.15.40:0/3125520816 shutdown_connections 2023-09-30T22:22:18.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.227+0000 7f7030989700 1 -- 172.21.15.40:0/3125520816 wait complete. 2023-09-30T22:22:18.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.228+0000 7f7030989700 1 Processor -- start 2023-09-30T22:22:18.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.228+0000 7f7030989700 1 -- start start 2023-09-30T22:22:18.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.228+0000 7f7030989700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f702c093d00 0x7f702c064d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:18.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.228+0000 7f7030989700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f702c095e80 0x7f702c065250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:18.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.228+0000 7f7030989700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f702c097020 0x7f702c065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:18.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.228+0000 7f7030989700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702c11db00 con 0x7f702c093d00 2023-09-30T22:22:18.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.228+0000 7f7030989700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f702c09ac90 con 0x7f702c095e80 2023-09-30T22:22:18.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.228+0000 7f7030989700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f702c097c70 con 0x7f702c097020 2023-09-30T22:22:18.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.229+0000 7f702a59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f702c093d00 0x7f702c064d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:18.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.229+0000 7f702a59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f702c093d00 0x7f702c064d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48216/0 (socket says 172.21.15.40:48216) 2023-09-30T22:22:18.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.229+0000 7f702a59c700 1 -- 172.21.15.40:0/1900905738 learned_addr learned my addr 172.21.15.40:0/1900905738 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:18.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.229+0000 7f702ad9d700 1 --2- 172.21.15.40:0/1900905738 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f702c097020 0x7f702c065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:18.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.229+0000 7f7029d9b700 1 --2- 172.21.15.40:0/1900905738 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f702c095e80 0x7f702c065250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:18.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.229+0000 7f702a59c700 1 -- 172.21.15.40:0/1900905738 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f702c097020 msgr2=0x7f702c065740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:18.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.229+0000 7f702a59c700 1 --2- 172.21.15.40:0/1900905738 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f702c097020 0x7f702c065740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:18.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.229+0000 7f702a59c700 1 -- 172.21.15.40:0/1900905738 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f702c095e80 msgr2=0x7f702c065250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:18.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.229+0000 7f702a59c700 1 --2- 172.21.15.40:0/1900905738 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f702c095e80 0x7f702c065250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:18.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.229+0000 7f702a59c700 1 -- 172.21.15.40:0/1900905738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f701c0092a0 con 0x7f702c093d00 2023-09-30T22:22:18.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.229+0000 7f7029d9b700 1 --2- 172.21.15.40:0/1900905738 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f702c095e80 0x7f702c065250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:18.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.229+0000 7f702a59c700 1 --2- 172.21.15.40:0/1900905738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f702c093d00 0x7f702c064d60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f7020009e30 tx=0x7f7020017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:18.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.229+0000 7f701a7fc700 1 -- 172.21.15.40:0/1900905738 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702000f7e0 con 0x7f702c093d00 2023-09-30T22:22:18.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.229+0000 7f701a7fc700 1 -- 172.21.15.40:0/1900905738 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702000f940 con 0x7f702c093d00 2023-09-30T22:22:18.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.229+0000 7f701a7fc700 1 -- 172.21.15.40:0/1900905738 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702001b660 con 0x7f702c093d00 2023-09-30T22:22:18.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.230+0000 7f7030989700 1 -- 172.21.15.40:0/1900905738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70200092a0 con 0x7f702c093d00 2023-09-30T22:22:18.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.230+0000 7f7030989700 1 -- 172.21.15.40:0/1900905738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f702c11e900 con 0x7f702c093d00 2023-09-30T22:22:18.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.230+0000 7f701a7fc700 1 -- 172.21.15.40:0/1900905738 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f702001ba90 con 0x7f702c093d00 2023-09-30T22:22:18.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.230+0000 7f701a7fc700 1 -- 172.21.15.40:0/1900905738 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f702003c7c0 con 0x7f702c093d00 2023-09-30T22:22:18.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.231+0000 7f7030989700 1 -- 172.21.15.40:0/1900905738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f702c065c30 con 0x7f702c093d00 2023-09-30T22:22:18.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.235+0000 7f701a7fc700 1 -- 172.21.15.40:0/1900905738 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f702001f080 con 0x7f702c093d00 2023-09-30T22:22:18.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.403+0000 7f7030989700 1 -- 172.21.15.40:0/1900905738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f702c11e900 con 0x7f702c093d00 2023-09-30T22:22:18.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.403+0000 7f701a7fc700 1 -- 172.21.15.40:0/1900905738 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) v1 ==== 104+0+11 (secure 0 0 0) 0x7f702c11e900 con 0x7f702c093d00 2023-09-30T22:22:18.404 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-09-30T22:22:18.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.405+0000 7f7030989700 1 -- 172.21.15.40:0/1900905738 >> v1:172.21.15.40:6816/118905 conn(0x7f700c02bb60 legacy=0x7f700c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:18.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.405+0000 7f7030989700 1 -- 172.21.15.40:0/1900905738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f702c093d00 msgr2=0x7f702c064d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:18.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.405+0000 7f7030989700 1 --2- 172.21.15.40:0/1900905738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f702c093d00 0x7f702c064d60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f7020009e30 tx=0x7f7020017000).stop 2023-09-30T22:22:18.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.405+0000 7f7030989700 1 -- 172.21.15.40:0/1900905738 shutdown_connections 2023-09-30T22:22:18.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.405+0000 7f7030989700 1 --2- 172.21.15.40:0/1900905738 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f702c097020 0x7f702c065740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:18.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.405+0000 7f7030989700 1 --2- 172.21.15.40:0/1900905738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f702c093d00 0x7f702c064d60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:18.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.405+0000 7f7030989700 1 --2- 172.21.15.40:0/1900905738 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f702c095e80 0x7f702c065250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:18.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.405+0000 7f7030989700 1 -- 172.21.15.40:0/1900905738 >> 172.21.15.40:0/1900905738 conn(0x7f702c09bcf0 msgr2=0x7f702c099b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:18.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.405+0000 7f7030989700 1 -- 172.21.15.40:0/1900905738 shutdown_connections 2023-09-30T22:22:18.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.405+0000 7f7030989700 1 -- 172.21.15.40:0/1900905738 wait complete. 2023-09-30T22:22:18.417 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:22:18.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.540+0000 7fc769af3700 1 Processor -- start 2023-09-30T22:22:18.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.540+0000 7fc769af3700 1 -- start start 2023-09-30T22:22:18.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.541+0000 7fc769af3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc764062e60 0x7fc76412b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:18.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.541+0000 7fc769af3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc76412ad50 0x7fc76412b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:18.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.541+0000 7fc769af3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc764097240 con 0x7fc764095e10 2023-09-30T22:22:18.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.541+0000 7fc769af3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc764063240 con 0x7fc76412ad50 2023-09-30T22:22:18.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.541+0000 7fc769af3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7640671c0 con 0x7fc764062e60 2023-09-30T22:22:18.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.541+0000 7fc7637fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc764062e60 0x7fc76412b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:18.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.541+0000 7fc75bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc76412ad50 0x7fc76412b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:18.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.541+0000 7fc763fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc764095e10 0x7fc764096290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53340/0 (socket says 172.21.15.40:53340) 2023-09-30T22:22:18.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.541+0000 7fc763fff700 1 -- 172.21.15.40:0/3548552191 learned_addr learned my addr 172.21.15.40:0/3548552191 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:22:18.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.541+0000 7fc762ffd700 1 -- 172.21.15.40:0/3548552191 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2711267571 0 0) 0x7fc764097240 con 0x7fc764095e10 2023-09-30T22:22:18.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.541+0000 7fc75bfff700 1 -- 172.21.15.40:0/3548552191 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc764062e60 msgr2=0x7fc76412b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:18.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.541+0000 7fc75bfff700 1 --2- 172.21.15.40:0/3548552191 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc764062e60 0x7fc76412b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:18.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.541+0000 7fc75bfff700 1 -- 172.21.15.40:0/3548552191 >> v1:172.21.15.40:6789/0 conn(0x7fc764095e10 legacy=0x7fc764096290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:18.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.541+0000 7fc75bfff700 1 -- 172.21.15.40:0/3548552191 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7640676c0 con 0x7fc76412ad50 2023-09-30T22:22:18.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.542+0000 7fc7637fe700 1 --2- 172.21.15.40:0/3548552191 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc764062e60 0x7fc76412b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:18.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.542+0000 7fc75bfff700 1 --2- 172.21.15.40:0/3548552191 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc76412ad50 0x7fc76412b6d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fc74c009790 tx=0x7fc74c009060).ready entity=mon.1 client_cookie=268d366067a5c43d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:18.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.542+0000 7fc762ffd700 1 -- 172.21.15.40:0/3548552191 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c00f510 con 0x7fc76412ad50 2023-09-30T22:22:18.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.542+0000 7fc762ffd700 1 -- 172.21.15.40:0/3548552191 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74c00f670 con 0x7fc76412ad50 2023-09-30T22:22:18.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.542+0000 7fc762ffd700 1 -- 172.21.15.40:0/3548552191 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c00f9f0 con 0x7fc76412ad50 2023-09-30T22:22:18.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.542+0000 7fc769af3700 1 -- 172.21.15.40:0/3548552191 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc76412ad50 msgr2=0x7fc76412b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:18.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.542+0000 7fc769af3700 1 --2- 172.21.15.40:0/3548552191 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc76412ad50 0x7fc76412b6d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fc74c009790 tx=0x7fc74c009060).stop 2023-09-30T22:22:18.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.542+0000 7fc769af3700 1 -- 172.21.15.40:0/3548552191 shutdown_connections 2023-09-30T22:22:18.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.542+0000 7fc769af3700 1 --2- 172.21.15.40:0/3548552191 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc764062e60 0x7fc76412b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:18.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.542+0000 7fc769af3700 1 --2- 172.21.15.40:0/3548552191 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc76412ad50 0x7fc76412b6d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:18.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.542+0000 7fc769af3700 1 -- 172.21.15.40:0/3548552191 >> 172.21.15.40:0/3548552191 conn(0x7fc76409a380 msgr2=0x7fc76409a790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:18.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.542+0000 7fc769af3700 1 -- 172.21.15.40:0/3548552191 shutdown_connections 2023-09-30T22:22:18.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.542+0000 7fc769af3700 1 -- 172.21.15.40:0/3548552191 wait complete. 2023-09-30T22:22:18.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.543+0000 7fc769af3700 1 Processor -- start 2023-09-30T22:22:18.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.543+0000 7fc769af3700 1 -- start start 2023-09-30T22:22:18.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.544+0000 7fc769af3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc764062e60 0x7fc764128600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:18.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.544+0000 7fc769af3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc764095e10 0x7fc7641175d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:18.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.544+0000 7fc769af3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc764117ac0 0x7fc764117f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:18.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.544+0000 7fc769af3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76411b630 con 0x7fc764095e10 2023-09-30T22:22:18.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.544+0000 7fc769af3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc764098f20 con 0x7fc764117ac0 2023-09-30T22:22:18.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.544+0000 7fc769af3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc764097d80 con 0x7fc764062e60 2023-09-30T22:22:18.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.544+0000 7fc75bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc764095e10 0x7fc7641175d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:18.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.544+0000 7fc763fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc764117ac0 0x7fc764117f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:18.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.544+0000 7fc75bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc764095e10 0x7fc7641175d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48228/0 (socket says 172.21.15.40:48228) 2023-09-30T22:22:18.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.544+0000 7fc75bfff700 1 -- 172.21.15.40:0/3180211349 learned_addr learned my addr 172.21.15.40:0/3180211349 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:18.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.544+0000 7fc7637fe700 1 --2- 172.21.15.40:0/3180211349 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc764062e60 0x7fc764128600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:18.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.544+0000 7fc7637fe700 1 -- 172.21.15.40:0/3180211349 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc764117ac0 msgr2=0x7fc764117f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:18.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.544+0000 7fc7637fe700 1 --2- 172.21.15.40:0/3180211349 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc764117ac0 0x7fc764117f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:18.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.544+0000 7fc7637fe700 1 -- 172.21.15.40:0/3180211349 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc764095e10 msgr2=0x7fc7641175d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:18.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.544+0000 7fc7637fe700 1 --2- 172.21.15.40:0/3180211349 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc764095e10 0x7fc7641175d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:18.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.544+0000 7fc7637fe700 1 -- 172.21.15.40:0/3180211349 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7540092a0 con 0x7fc764062e60 2023-09-30T22:22:18.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.544+0000 7fc75bfff700 1 --2- 172.21.15.40:0/3180211349 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc764095e10 0x7fc7641175d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:18.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.544+0000 7fc763fff700 1 --2- 172.21.15.40:0/3180211349 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc764117ac0 0x7fc764117f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:18.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.544+0000 7fc7637fe700 1 --2- 172.21.15.40:0/3180211349 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc764062e60 0x7fc764128600 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fc75400e9e0 tx=0x7fc754009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:18.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.544+0000 7fc75b7fe700 1 -- 172.21.15.40:0/3180211349 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc754009580 con 0x7fc764062e60 2023-09-30T22:22:18.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.545+0000 7fc75b7fe700 1 -- 172.21.15.40:0/3180211349 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc754012600 con 0x7fc764062e60 2023-09-30T22:22:18.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.545+0000 7fc75b7fe700 1 -- 172.21.15.40:0/3180211349 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc754012980 con 0x7fc764062e60 2023-09-30T22:22:18.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.545+0000 7fc769af3700 1 -- 172.21.15.40:0/3180211349 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc74c0092a0 con 0x7fc764062e60 2023-09-30T22:22:18.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.545+0000 7fc769af3700 1 -- 172.21.15.40:0/3180211349 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7641189d0 con 0x7fc764062e60 2023-09-30T22:22:18.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.545+0000 7fc75b7fe700 1 -- 172.21.15.40:0/3180211349 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fc754012d30 con 0x7fc764062e60 2023-09-30T22:22:18.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.545+0000 7fc75b7fe700 1 -- 172.21.15.40:0/3180211349 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fc75403b320 con 0x7fc764062e60 2023-09-30T22:22:18.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.546+0000 7fc769af3700 1 -- 172.21.15.40:0/3180211349 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc76405a260 con 0x7fc764062e60 2023-09-30T22:22:18.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.550+0000 7fc75b7fe700 1 -- 172.21.15.40:0/3180211349 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fc754016020 con 0x7fc764062e60 2023-09-30T22:22:18.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.715+0000 7fc769af3700 1 -- 172.21.15.40:0/3180211349 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc764069850 con 0x7fc764062e60 2023-09-30T22:22:18.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.716+0000 7fc75b7fe700 1 -- 172.21.15.40:0/3180211349 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc75402a0a0 con 0x7fc764062e60 2023-09-30T22:22:18.716 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-09-30T22:22:18.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.717+0000 7fc769af3700 1 -- 172.21.15.40:0/3180211349 >> v1:172.21.15.40:6816/118905 conn(0x7fc74402bb60 legacy=0x7fc74402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:18.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.717+0000 7fc769af3700 1 -- 172.21.15.40:0/3180211349 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc764062e60 msgr2=0x7fc764128600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:18.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.717+0000 7fc769af3700 1 --2- 172.21.15.40:0/3180211349 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc764062e60 0x7fc764128600 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fc75400e9e0 tx=0x7fc754009060).stop 2023-09-30T22:22:18.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.717+0000 7fc769af3700 1 -- 172.21.15.40:0/3180211349 shutdown_connections 2023-09-30T22:22:18.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.717+0000 7fc769af3700 1 --2- 172.21.15.40:0/3180211349 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc764062e60 0x7fc764128600 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:18.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.717+0000 7fc769af3700 1 --2- 172.21.15.40:0/3180211349 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc764117ac0 0x7fc764117f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:18.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.717+0000 7fc769af3700 1 --2- 172.21.15.40:0/3180211349 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc764095e10 0x7fc7641175d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:18.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.717+0000 7fc769af3700 1 -- 172.21.15.40:0/3180211349 >> 172.21.15.40:0/3180211349 conn(0x7fc76409a380 msgr2=0x7fc7641297a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:18.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.718+0000 7fc769af3700 1 -- 172.21.15.40:0/3180211349 shutdown_connections 2023-09-30T22:22:18.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.718+0000 7fc769af3700 1 -- 172.21.15.40:0/3180211349 wait complete. 2023-09-30T22:22:18.730 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:22:18.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.850+0000 7fc33047c700 1 Processor -- start 2023-09-30T22:22:18.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.850+0000 7fc33047c700 1 -- start start 2023-09-30T22:22:18.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.850+0000 7fc33047c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc328092f70 0x7fc328093350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:18.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.850+0000 7fc33047c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc328093840 0x7fc328093c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:18.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.850+0000 7fc33047c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc328094e10 con 0x7fc32812f320 2023-09-30T22:22:18.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.850+0000 7fc33047c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc32805eee0 con 0x7fc328093840 2023-09-30T22:22:18.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.850+0000 7fc33047c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc328092d50 con 0x7fc328092f70 2023-09-30T22:22:18.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.850+0000 7fc32e218700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc328092f70 0x7fc328093350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:18.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.851+0000 7fc32da17700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc328093840 0x7fc328093c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:18.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.851+0000 7fc32ea19700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc32812f320 0x7fc328131710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53354/0 (socket says 172.21.15.40:53354) 2023-09-30T22:22:18.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.851+0000 7fc32e218700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc328092f70 0x7fc328093350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33646/0 (socket says 172.21.15.40:33646) 2023-09-30T22:22:18.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.851+0000 7fc32ea19700 1 -- 172.21.15.40:0/1377572395 learned_addr learned my addr 172.21.15.40:0/1377572395 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:22:18.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.851+0000 7fc32da17700 1 -- 172.21.15.40:0/1377572395 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc328092f70 msgr2=0x7fc328093350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:18.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.851+0000 7fc32da17700 1 --2- 172.21.15.40:0/1377572395 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc328092f70 0x7fc328093350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:18.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.851+0000 7fc32da17700 1 -- 172.21.15.40:0/1377572395 >> v1:172.21.15.40:6789/0 conn(0x7fc32812f320 legacy=0x7fc328131710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:18.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.851+0000 7fc32da17700 1 -- 172.21.15.40:0/1377572395 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc328091a00 con 0x7fc328093840 2023-09-30T22:22:18.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.851+0000 7fc32d216700 1 -- 172.21.15.40:0/1377572395 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 345220409 0 0) 0x7fc328094e10 con 0x7fc32812f320 2023-09-30T22:22:18.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.851+0000 7fc32e218700 1 --2- 172.21.15.40:0/1377572395 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc328092f70 0x7fc328093350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:18.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.851+0000 7fc32da17700 1 --2- 172.21.15.40:0/1377572395 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc328093840 0x7fc328093c20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fc3180097c0 tx=0x7fc318009060).ready entity=mon.0 client_cookie=6ab3347b8baa13e4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:18.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.851+0000 7fc32d216700 1 -- 172.21.15.40:0/1377572395 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31800f510 con 0x7fc328093840 2023-09-30T22:22:18.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.851+0000 7fc32d216700 1 -- 172.21.15.40:0/1377572395 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31800f670 con 0x7fc328093840 2023-09-30T22:22:18.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.851+0000 7fc32d216700 1 -- 172.21.15.40:0/1377572395 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31800f9f0 con 0x7fc328093840 2023-09-30T22:22:18.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.852+0000 7fc33047c700 1 -- 172.21.15.40:0/1377572395 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc328093840 msgr2=0x7fc328093c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:18.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.852+0000 7fc33047c700 1 --2- 172.21.15.40:0/1377572395 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc328093840 0x7fc328093c20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fc3180097c0 tx=0x7fc318009060).stop 2023-09-30T22:22:18.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.852+0000 7fc33047c700 1 -- 172.21.15.40:0/1377572395 shutdown_connections 2023-09-30T22:22:18.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.852+0000 7fc33047c700 1 --2- 172.21.15.40:0/1377572395 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc328092f70 0x7fc328093350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:18.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.852+0000 7fc33047c700 1 --2- 172.21.15.40:0/1377572395 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc328093840 0x7fc328093c20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:18.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.852+0000 7fc33047c700 1 -- 172.21.15.40:0/1377572395 >> 172.21.15.40:0/1377572395 conn(0x7fc328097580 msgr2=0x7fc328097990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:18.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.852+0000 7fc33047c700 1 -- 172.21.15.40:0/1377572395 shutdown_connections 2023-09-30T22:22:18.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.852+0000 7fc33047c700 1 -- 172.21.15.40:0/1377572395 wait complete. 2023-09-30T22:22:18.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.853+0000 7fc33047c700 1 Processor -- start 2023-09-30T22:22:18.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.853+0000 7fc33047c700 1 -- start start 2023-09-30T22:22:18.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.853+0000 7fc33047c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc328092f70 0x7fc32813a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:18.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.853+0000 7fc33047c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc328093840 0x7fc32813ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:18.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.853+0000 7fc33047c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc32812f320 0x7fc32813b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:18.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.853+0000 7fc33047c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32811a790 con 0x7fc328092f70 2023-09-30T22:22:18.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.853+0000 7fc33047c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc328099ba0 con 0x7fc328093840 2023-09-30T22:22:18.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.853+0000 7fc33047c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc328096db0 con 0x7fc32812f320 2023-09-30T22:22:18.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.853+0000 7fc32e218700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc328092f70 0x7fc32813a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:18.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.853+0000 7fc32ea19700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc32812f320 0x7fc32813b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:18.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.853+0000 7fc32e218700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc328092f70 0x7fc32813a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48250/0 (socket says 172.21.15.40:48250) 2023-09-30T22:22:18.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.853+0000 7fc32e218700 1 -- 172.21.15.40:0/1846294643 learned_addr learned my addr 172.21.15.40:0/1846294643 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:18.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.853+0000 7fc32da17700 1 --2- 172.21.15.40:0/1846294643 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc328093840 0x7fc32813ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:18.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.853+0000 7fc32ea19700 1 -- 172.21.15.40:0/1846294643 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc328093840 msgr2=0x7fc32813ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:18.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.853+0000 7fc32ea19700 1 --2- 172.21.15.40:0/1846294643 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc328093840 0x7fc32813ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:18.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.853+0000 7fc32ea19700 1 -- 172.21.15.40:0/1846294643 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc328092f70 msgr2=0x7fc32813a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:18.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.853+0000 7fc32ea19700 1 --2- 172.21.15.40:0/1846294643 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc328092f70 0x7fc32813a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:18.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.853+0000 7fc32ea19700 1 -- 172.21.15.40:0/1846294643 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3240092a0 con 0x7fc32812f320 2023-09-30T22:22:18.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.853+0000 7fc32e218700 1 --2- 172.21.15.40:0/1846294643 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc328092f70 0x7fc32813a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:18.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.854+0000 7fc32ea19700 1 --2- 172.21.15.40:0/1846294643 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc32812f320 0x7fc32813b270 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fc328063e20 tx=0x7fc320007eb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:18.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.854+0000 7fc31e7fc700 1 -- 172.21.15.40:0/1846294643 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc320005d30 con 0x7fc32812f320 2023-09-30T22:22:18.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.854+0000 7fc31e7fc700 1 -- 172.21.15.40:0/1846294643 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3200070d0 con 0x7fc32812f320 2023-09-30T22:22:18.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.854+0000 7fc33047c700 1 -- 172.21.15.40:0/1846294643 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3180092a0 con 0x7fc32812f320 2023-09-30T22:22:18.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.854+0000 7fc31e7fc700 1 -- 172.21.15.40:0/1846294643 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc320007490 con 0x7fc32812f320 2023-09-30T22:22:18.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.854+0000 7fc33047c700 1 -- 172.21.15.40:0/1846294643 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc32811c6a0 con 0x7fc32812f320 2023-09-30T22:22:18.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.855+0000 7fc31e7fc700 1 -- 172.21.15.40:0/1846294643 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fc320007880 con 0x7fc32812f320 2023-09-30T22:22:18.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.855+0000 7fc33047c700 1 -- 172.21.15.40:0/1846294643 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc32809b2a0 con 0x7fc32812f320 2023-09-30T22:22:18.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.855+0000 7fc31e7fc700 1 -- 172.21.15.40:0/1846294643 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fc32003a960 con 0x7fc32812f320 2023-09-30T22:22:18.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:18.859+0000 7fc31e7fc700 1 -- 172.21.15.40:0/1846294643 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fc320018030 con 0x7fc32812f320 2023-09-30T22:22:19.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.070+0000 7fc33047c700 1 -- 172.21.15.40:0/1846294643 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc32805a260 con 0x7fc32812f320 2023-09-30T22:22:19.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.070+0000 7fc31e7fc700 1 -- 172.21.15.40:0/1846294643 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2156 (secure 0 0 0) 0x7fc320022880 con 0x7fc32812f320 2023-09-30T22:22:19.071 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:22:19.071 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:22:02.347538+0000","modified":"2023-09-30T22:22:05.356644+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4194},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4194":{"gid":4194,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6817/2392027806","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6817","nonce":2392027806}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-30T22:22:19.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.072+0000 7fc33047c700 1 -- 172.21.15.40:0/1846294643 >> v1:172.21.15.40:6816/118905 conn(0x7fc30c02bb60 legacy=0x7fc30c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.072+0000 7fc33047c700 1 -- 172.21.15.40:0/1846294643 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc32812f320 msgr2=0x7fc32813b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.072+0000 7fc33047c700 1 --2- 172.21.15.40:0/1846294643 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc32812f320 0x7fc32813b270 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fc328063e20 tx=0x7fc320007eb0).stop 2023-09-30T22:22:19.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.072+0000 7fc33047c700 1 -- 172.21.15.40:0/1846294643 shutdown_connections 2023-09-30T22:22:19.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.072+0000 7fc33047c700 1 --2- 172.21.15.40:0/1846294643 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc32812f320 0x7fc32813b270 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:19.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.072+0000 7fc33047c700 1 --2- 172.21.15.40:0/1846294643 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc328092f70 0x7fc32813a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:19.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.072+0000 7fc33047c700 1 --2- 172.21.15.40:0/1846294643 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc328093840 0x7fc32813ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:19.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.072+0000 7fc33047c700 1 -- 172.21.15.40:0/1846294643 >> 172.21.15.40:0/1846294643 conn(0x7fc328097580 msgr2=0x7fc32812df10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:19.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.072+0000 7fc33047c700 1 -- 172.21.15.40:0/1846294643 shutdown_connections 2023-09-30T22:22:19.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.072+0000 7fc33047c700 1 -- 172.21.15.40:0/1846294643 wait complete. 2023-09-30T22:22:19.073 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 6 2023-09-30T22:22:19.084 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:22:19.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.203+0000 7f4fcb635700 1 Processor -- start 2023-09-30T22:22:19.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.203+0000 7f4fcb635700 1 -- start start 2023-09-30T22:22:19.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.204+0000 7f4fcb635700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fc4092a10 0x7f4fc4065ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:19.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.204+0000 7f4fcb635700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc40660f0 0x7f4fc412aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:19.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.204+0000 7f4fcb635700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc40974b0 con 0x7f4fc4066510 2023-09-30T22:22:19.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.204+0000 7f4fcb635700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc4092df0 con 0x7f4fc40660f0 2023-09-30T22:22:19.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.204+0000 7f4fcb635700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc4098380 con 0x7f4fc4092a10 2023-09-30T22:22:19.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.204+0000 7f4fc8bd0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc40660f0 0x7f4fc412aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:19.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.204+0000 7f4fc93d1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fc4092a10 0x7f4fc4065ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:19.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.204+0000 7f4fc9bd2700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f4fc4066510 0x7f4fc412af40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53370/0 (socket says 172.21.15.40:53370) 2023-09-30T22:22:19.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.204+0000 7f4fc9bd2700 1 -- 172.21.15.40:0/1018667150 learned_addr learned my addr 172.21.15.40:0/1018667150 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:22:19.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.204+0000 7f4fc93d1700 1 -- 172.21.15.40:0/1018667150 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc40660f0 msgr2=0x7f4fc412aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:19.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.204+0000 7f4fc93d1700 1 --2- 172.21.15.40:0/1018667150 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc40660f0 0x7f4fc412aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:19.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.204+0000 7f4fc93d1700 1 -- 172.21.15.40:0/1018667150 >> v1:172.21.15.40:6789/0 conn(0x7f4fc4066510 legacy=0x7f4fc412af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.204+0000 7f4fbbfff700 1 -- 172.21.15.40:0/1018667150 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3419860535 0 0) 0x7f4fc40974b0 con 0x7f4fc4066510 2023-09-30T22:22:19.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.204+0000 7f4fc93d1700 1 -- 172.21.15.40:0/1018667150 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc4064890 con 0x7f4fc4092a10 2023-09-30T22:22:19.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.204+0000 7f4fc8bd0700 1 --2- 172.21.15.40:0/1018667150 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc40660f0 0x7f4fc412aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:19.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.205+0000 7f4fc93d1700 1 --2- 172.21.15.40:0/1018667150 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fc4092a10 0x7f4fc4065ad0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f4fb40097c0 tx=0x7f4fb4009060).ready entity=mon.2 client_cookie=c818cdf708944c23 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:19.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.205+0000 7f4fbbfff700 1 -- 172.21.15.40:0/1018667150 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb40090d0 con 0x7f4fc4092a10 2023-09-30T22:22:19.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.205+0000 7f4fbbfff700 1 -- 172.21.15.40:0/1018667150 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb400f510 con 0x7f4fc4092a10 2023-09-30T22:22:19.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.205+0000 7f4fbbfff700 1 -- 172.21.15.40:0/1018667150 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb400f890 con 0x7f4fc4092a10 2023-09-30T22:22:19.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.205+0000 7f4fcb635700 1 -- 172.21.15.40:0/1018667150 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fc4092a10 msgr2=0x7f4fc4065ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.205+0000 7f4fcb635700 1 --2- 172.21.15.40:0/1018667150 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fc4092a10 0x7f4fc4065ad0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f4fb40097c0 tx=0x7f4fb4009060).stop 2023-09-30T22:22:19.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.205+0000 7f4fcb635700 1 -- 172.21.15.40:0/1018667150 shutdown_connections 2023-09-30T22:22:19.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.205+0000 7f4fcb635700 1 --2- 172.21.15.40:0/1018667150 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fc4092a10 0x7f4fc4065ad0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:19.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.205+0000 7f4fcb635700 1 --2- 172.21.15.40:0/1018667150 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc40660f0 0x7f4fc412aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:19.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.205+0000 7f4fcb635700 1 -- 172.21.15.40:0/1018667150 >> 172.21.15.40:0/1018667150 conn(0x7f4fc405eb80 msgr2=0x7f4fc409bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:19.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.205+0000 7f4fcb635700 1 -- 172.21.15.40:0/1018667150 shutdown_connections 2023-09-30T22:22:19.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.205+0000 7f4fcb635700 1 -- 172.21.15.40:0/1018667150 wait complete. 2023-09-30T22:22:19.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.206+0000 7f4fcb635700 1 Processor -- start 2023-09-30T22:22:19.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.206+0000 7f4fcb635700 1 -- start start 2023-09-30T22:22:19.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.207+0000 7f4fcb635700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fc40660f0 0x7f4fc4128350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:19.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.207+0000 7f4fcb635700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc4066510 0x7f4fc4117320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:19.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.207+0000 7f4fcb635700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fc4092a10 0x7f4fc4117810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:19.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.207+0000 7f4fcb635700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc411ae30 con 0x7f4fc40660f0 2023-09-30T22:22:19.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.207+0000 7f4fcb635700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc409b2e0 con 0x7f4fc4066510 2023-09-30T22:22:19.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.207+0000 7f4fcb635700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc40976f0 con 0x7f4fc4092a10 2023-09-30T22:22:19.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.207+0000 7f4fc8bd0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc4066510 0x7f4fc4117320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:19.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.207+0000 7f4fc9bd2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fc4092a10 0x7f4fc4117810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:19.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.207+0000 7f4fc8bd0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc4066510 0x7f4fc4117320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:55404/0 (socket says 172.21.15.40:55404) 2023-09-30T22:22:19.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.207+0000 7f4fc8bd0700 1 -- 172.21.15.40:0/1136433371 learned_addr learned my addr 172.21.15.40:0/1136433371 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:19.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.207+0000 7f4fc93d1700 1 --2- 172.21.15.40:0/1136433371 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fc40660f0 0x7f4fc4128350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:19.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.207+0000 7f4fc8bd0700 1 -- 172.21.15.40:0/1136433371 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fc4092a10 msgr2=0x7f4fc4117810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.207+0000 7f4fc8bd0700 1 --2- 172.21.15.40:0/1136433371 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fc4092a10 0x7f4fc4117810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:19.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.207+0000 7f4fc8bd0700 1 -- 172.21.15.40:0/1136433371 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fc40660f0 msgr2=0x7f4fc4128350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.207+0000 7f4fc8bd0700 1 --2- 172.21.15.40:0/1136433371 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fc40660f0 0x7f4fc4128350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:19.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.207+0000 7f4fc8bd0700 1 -- 172.21.15.40:0/1136433371 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc00092a0 con 0x7f4fc4066510 2023-09-30T22:22:19.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.207+0000 7f4fc93d1700 1 --2- 172.21.15.40:0/1136433371 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fc40660f0 0x7f4fc4128350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:19.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.207+0000 7f4fc8bd0700 1 --2- 172.21.15.40:0/1136433371 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc4066510 0x7f4fc4117320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f4fc000e9d0 tx=0x7f4fc0009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:19.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.208+0000 7f4fb97fa700 1 -- 172.21.15.40:0/1136433371 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc000c6a0 con 0x7f4fc4066510 2023-09-30T22:22:19.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.208+0000 7f4fb97fa700 1 -- 172.21.15.40:0/1136433371 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc000c800 con 0x7f4fc4066510 2023-09-30T22:22:19.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.208+0000 7f4fb97fa700 1 -- 172.21.15.40:0/1136433371 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc000cb80 con 0x7f4fc4066510 2023-09-30T22:22:19.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.208+0000 7f4fcb635700 1 -- 172.21.15.40:0/1136433371 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb40092a0 con 0x7f4fc4066510 2023-09-30T22:22:19.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.208+0000 7f4fcb635700 1 -- 172.21.15.40:0/1136433371 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc4118eb0 con 0x7f4fc4066510 2023-09-30T22:22:19.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.208+0000 7f4fb97fa700 1 -- 172.21.15.40:0/1136433371 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f4fc001b400 con 0x7f4fc4066510 2023-09-30T22:22:19.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.209+0000 7f4fb97fa700 1 -- 172.21.15.40:0/1136433371 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f4fc003b4d0 con 0x7f4fc4066510 2023-09-30T22:22:19.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.209+0000 7f4fcb635700 1 -- 172.21.15.40:0/1136433371 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc4092740 con 0x7f4fc4066510 2023-09-30T22:22:19.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.213+0000 7f4fb97fa700 1 -- 172.21.15.40:0/1136433371 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f4fc0016070 con 0x7f4fc4066510 2023-09-30T22:22:19.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.382+0000 7f4fcb635700 1 -- 172.21.15.40:0/1136433371 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4fc411a780 con 0x7f4fc4066510 2023-09-30T22:22:19.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.383+0000 7f4fb97fa700 1 -- 172.21.15.40:0/1136433371 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11341 (secure 0 0 0) 0x7f4fc0016020 con 0x7f4fc4066510 2023-09-30T22:22:19.383 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:22:19.383 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":17,"fsid":"79dd4d8e-f295-4d9c-bd93-9850863800e3","created":"2023-09-30T22:21:46.980357+0000","modified":"2023-09-30T22:22:03.348895+0000","last_up_change":"2023-09-30T22:21:54.822866+0000","last_in_change":"2023-09-30T22:21:48.205613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:21:54.875024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:21:56.197012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:22:00.759069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:22:01.327265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"771f785c-f464-4b17-936c-cbf31b1153e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6812","nonce":119451}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6813","nonce":119451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6815","nonce":119451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6814","nonce":119451}]},"public_addr":"172.21.15.40:6812/119451","cluster_addr":"172.21.15.40:6813/119451","heartbeat_back_addr":"172.21.15.40:6815/119451","heartbeat_front_addr":"172.21.15.40:6814/119451","state":["exists","up"]},{"osd":1,"uuid":"45f1e2e8-5310-4219-ab54-424e7440fcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6808","nonce":119436}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6809","nonce":119436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6811","nonce":119436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6810","nonce":119436}]},"public_addr":"172.21.15.40:6808/119436","cluster_addr":"172.21.15.40:6809/119436","heartbeat_back_addr":"172.21.15.40:6811/119436","heartbeat_front_addr":"172.21.15.40:6810/119436","state":["exists","up"]},{"osd":2,"uuid":"7ba62ae5-d21e-4d56-b46c-ba7b718ede25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6800","nonce":119433}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6801","nonce":119433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6803","nonce":119433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6802","nonce":119433}]},"public_addr":"172.21.15.40:6800/119433","cluster_addr":"172.21.15.40:6801/119433","heartbeat_back_addr":"172.21.15.40:6803/119433","heartbeat_front_addr":"172.21.15.40:6802/119433","state":["exists","up"]},{"osd":3,"uuid":"c9c55985-8a90-4927-a8fa-6a1fcec1cd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6804","nonce":119432}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6805","nonce":119432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6807","nonce":119432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6806","nonce":119432}]},"public_addr":"172.21.15.40:6804/119432","cluster_addr":"172.21.15.40:6805/119432","heartbeat_back_addr":"172.21.15.40:6807/119432","heartbeat_front_addr":"172.21.15.40:6806/119432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.339829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.554690+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.641664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.320635+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:22:19.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.384+0000 7f4fcb635700 1 -- 172.21.15.40:0/1136433371 >> v1:172.21.15.40:6816/118905 conn(0x7f4fa802bb90 legacy=0x7f4fa802e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.384+0000 7f4fcb635700 1 -- 172.21.15.40:0/1136433371 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc4066510 msgr2=0x7f4fc4117320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.384+0000 7f4fcb635700 1 --2- 172.21.15.40:0/1136433371 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc4066510 0x7f4fc4117320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f4fc000e9d0 tx=0x7f4fc0009060).stop 2023-09-30T22:22:19.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.384+0000 7f4fcb635700 1 -- 172.21.15.40:0/1136433371 shutdown_connections 2023-09-30T22:22:19.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.384+0000 7f4fcb635700 1 --2- 172.21.15.40:0/1136433371 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fc4092a10 0x7f4fc4117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:19.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.384+0000 7f4fcb635700 1 --2- 172.21.15.40:0/1136433371 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fc40660f0 0x7f4fc4128350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:19.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.384+0000 7f4fcb635700 1 --2- 172.21.15.40:0/1136433371 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc4066510 0x7f4fc4117320 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:19.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.384+0000 7f4fcb635700 1 -- 172.21.15.40:0/1136433371 >> 172.21.15.40:0/1136433371 conn(0x7f4fc405eb80 msgr2=0x7f4fc412ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:19.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.385+0000 7f4fcb635700 1 -- 172.21.15.40:0/1136433371 shutdown_connections 2023-09-30T22:22:19.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.385+0000 7f4fcb635700 1 -- 172.21.15.40:0/1136433371 wait complete. 2023-09-30T22:22:19.397 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:22:19.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.516+0000 7fd4019b4700 1 Processor -- start 2023-09-30T22:22:19.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.516+0000 7fd4019b4700 1 -- start start 2023-09-30T22:22:19.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.516+0000 7fd4019b4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3fc096160 0x7fd3fc099600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:19.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.516+0000 7fd4019b4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd3fc130650 0x7fd3fc132a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:19.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.516+0000 7fd4019b4700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3fc098910 con 0x7fd3fc098b10 2023-09-30T22:22:19.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.516+0000 7fd4019b4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc096560 con 0x7fd3fc096160 2023-09-30T22:22:19.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.516+0000 7fd4019b4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc065e40 con 0x7fd3fc130650 2023-09-30T22:22:19.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.517+0000 7fd3fb7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd3fc130650 0x7fd3fc132a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:19.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.517+0000 7fd3faffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd3fc098b10 0x7fd3fc098ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53382/0 (socket says 172.21.15.40:53382) 2023-09-30T22:22:19.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.517+0000 7fd3fa7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3fc096160 0x7fd3fc099600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:19.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.517+0000 7fd3faffd700 1 -- 172.21.15.40:0/219061117 learned_addr learned my addr 172.21.15.40:0/219061117 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:22:19.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.517+0000 7fd3f9ffb700 1 -- 172.21.15.40:0/219061117 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 744637304 0 0) 0x7fd3fc098910 con 0x7fd3fc098b10 2023-09-30T22:22:19.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.517+0000 7fd3fb7fe700 1 -- 172.21.15.40:0/219061117 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3fc096160 msgr2=0x7fd3fc099600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:19.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.517+0000 7fd3fb7fe700 1 --2- 172.21.15.40:0/219061117 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3fc096160 0x7fd3fc099600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:19.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.517+0000 7fd3fb7fe700 1 -- 172.21.15.40:0/219061117 >> v1:172.21.15.40:6789/0 conn(0x7fd3fc098b10 legacy=0x7fd3fc098ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.517+0000 7fd3fb7fe700 1 -- 172.21.15.40:0/219061117 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3fc0955c0 con 0x7fd3fc130650 2023-09-30T22:22:19.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.517+0000 7fd3fa7fc700 1 --2- 172.21.15.40:0/219061117 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3fc096160 0x7fd3fc099600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:19.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.517+0000 7fd3fb7fe700 1 --2- 172.21.15.40:0/219061117 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd3fc130650 0x7fd3fc132a40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fd3f4009e90 tx=0x7fd3f4009780).ready entity=mon.2 client_cookie=bd4d4352c1cbbe5c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:19.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.517+0000 7fd3f9ffb700 1 -- 172.21.15.40:0/219061117 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f400e070 con 0x7fd3fc130650 2023-09-30T22:22:19.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.517+0000 7fd3f9ffb700 1 -- 172.21.15.40:0/219061117 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f400bb00 con 0x7fd3fc130650 2023-09-30T22:22:19.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.517+0000 7fd3f9ffb700 1 -- 172.21.15.40:0/219061117 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f400be80 con 0x7fd3fc130650 2023-09-30T22:22:19.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.518+0000 7fd4019b4700 1 -- 172.21.15.40:0/219061117 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd3fc130650 msgr2=0x7fd3fc132a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.518+0000 7fd4019b4700 1 --2- 172.21.15.40:0/219061117 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd3fc130650 0x7fd3fc132a40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fd3f4009e90 tx=0x7fd3f4009780).stop 2023-09-30T22:22:19.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.518+0000 7fd4019b4700 1 -- 172.21.15.40:0/219061117 shutdown_connections 2023-09-30T22:22:19.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.518+0000 7fd4019b4700 1 --2- 172.21.15.40:0/219061117 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd3fc130650 0x7fd3fc132a40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:19.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.518+0000 7fd4019b4700 1 --2- 172.21.15.40:0/219061117 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3fc096160 0x7fd3fc099600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:19.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.518+0000 7fd4019b4700 1 -- 172.21.15.40:0/219061117 >> 172.21.15.40:0/219061117 conn(0x7fd3fc09ab30 msgr2=0x7fd3fc09af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:19.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.518+0000 7fd4019b4700 1 -- 172.21.15.40:0/219061117 shutdown_connections 2023-09-30T22:22:19.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.518+0000 7fd4019b4700 1 -- 172.21.15.40:0/219061117 wait complete. 2023-09-30T22:22:19.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.519+0000 7fd4019b4700 1 Processor -- start 2023-09-30T22:22:19.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.519+0000 7fd4019b4700 1 -- start start 2023-09-30T22:22:19.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.519+0000 7fd4019b4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3fc096160 0x7fd3fc11e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:19.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.519+0000 7fd4019b4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3fc098b10 0x7fd3fc11a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:19.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.519+0000 7fd4019b4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd3fc130650 0x7fd3fc11a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:19.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.519+0000 7fd4019b4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc11de50 con 0x7fd3fc096160 2023-09-30T22:22:19.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.519+0000 7fd4019b4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc094970 con 0x7fd3fc098b10 2023-09-30T22:22:19.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.519+0000 7fd4019b4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc099de0 con 0x7fd3fc130650 2023-09-30T22:22:19.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.519+0000 7fd3faffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3fc096160 0x7fd3fc11e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:19.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.519+0000 7fd3fa7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3fc098b10 0x7fd3fc11a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:19.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.519+0000 7fd3faffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3fc096160 0x7fd3fc11e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48272/0 (socket says 172.21.15.40:48272) 2023-09-30T22:22:19.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.519+0000 7fd3faffd700 1 -- 172.21.15.40:0/2342348401 learned_addr learned my addr 172.21.15.40:0/2342348401 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:19.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.520+0000 7fd3fb7fe700 1 --2- 172.21.15.40:0/2342348401 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd3fc130650 0x7fd3fc11a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:19.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.520+0000 7fd3fa7fc700 1 -- 172.21.15.40:0/2342348401 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd3fc130650 msgr2=0x7fd3fc11a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.520+0000 7fd3fa7fc700 1 --2- 172.21.15.40:0/2342348401 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd3fc130650 0x7fd3fc11a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:19.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.520+0000 7fd3fa7fc700 1 -- 172.21.15.40:0/2342348401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3fc096160 msgr2=0x7fd3fc11e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.520+0000 7fd3fa7fc700 1 --2- 172.21.15.40:0/2342348401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3fc096160 0x7fd3fc11e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:19.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.520+0000 7fd3fa7fc700 1 -- 172.21.15.40:0/2342348401 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e40092a0 con 0x7fd3fc098b10 2023-09-30T22:22:19.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.520+0000 7fd3faffd700 1 --2- 172.21.15.40:0/2342348401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3fc096160 0x7fd3fc11e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:19.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.520+0000 7fd3fa7fc700 1 --2- 172.21.15.40:0/2342348401 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3fc098b10 0x7fd3fc11a300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fd3e400e980 tx=0x7fd3e4009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:19.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.520+0000 7fd3f2ffd700 1 -- 172.21.15.40:0/2342348401 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4012600 con 0x7fd3fc098b10 2023-09-30T22:22:19.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.520+0000 7fd3f2ffd700 1 -- 172.21.15.40:0/2342348401 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e4012760 con 0x7fd3fc098b10 2023-09-30T22:22:19.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.520+0000 7fd4019b4700 1 -- 172.21.15.40:0/2342348401 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f4009a20 con 0x7fd3fc098b10 2023-09-30T22:22:19.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.520+0000 7fd3f2ffd700 1 -- 172.21.15.40:0/2342348401 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4012b00 con 0x7fd3fc098b10 2023-09-30T22:22:19.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.520+0000 7fd4019b4700 1 -- 172.21.15.40:0/2342348401 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3fc11c090 con 0x7fd3fc098b10 2023-09-30T22:22:19.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.521+0000 7fd3f2ffd700 1 -- 172.21.15.40:0/2342348401 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fd3e401b400 con 0x7fd3fc098b10 2023-09-30T22:22:19.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.521+0000 7fd3f2ffd700 1 -- 172.21.15.40:0/2342348401 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fd3e403b500 con 0x7fd3fc098b10 2023-09-30T22:22:19.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.521+0000 7fd4019b4700 1 -- 172.21.15.40:0/2342348401 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3fc09c650 con 0x7fd3fc098b10 2023-09-30T22:22:19.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.526+0000 7fd3f2ffd700 1 -- 172.21.15.40:0/2342348401 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fd3e4019900 con 0x7fd3fc098b10 2023-09-30T22:22:19.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.735+0000 7fd4019b4700 1 -- 172.21.15.40:0/2342348401 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3fc11dc90 con 0x7fd3fc098b10 2023-09-30T22:22:19.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.735+0000 7fd3f2ffd700 1 -- 172.21.15.40:0/2342348401 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2156 (secure 0 0 0) 0x7fd3e402a090 con 0x7fd3fc098b10 2023-09-30T22:22:19.736 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:22:19.736 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:22:02.347538+0000","modified":"2023-09-30T22:22:05.356644+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4194},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4194":{"gid":4194,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6817/2392027806","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6817","nonce":2392027806}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-30T22:22:19.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.737+0000 7fd4019b4700 1 -- 172.21.15.40:0/2342348401 >> v1:172.21.15.40:6816/118905 conn(0x7fd3dc02bb60 legacy=0x7fd3dc02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.737+0000 7fd4019b4700 1 -- 172.21.15.40:0/2342348401 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3fc098b10 msgr2=0x7fd3fc11a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.737+0000 7fd4019b4700 1 --2- 172.21.15.40:0/2342348401 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3fc098b10 0x7fd3fc11a300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fd3e400e980 tx=0x7fd3e4009060).stop 2023-09-30T22:22:19.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.737+0000 7fd4019b4700 1 -- 172.21.15.40:0/2342348401 shutdown_connections 2023-09-30T22:22:19.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.737+0000 7fd4019b4700 1 --2- 172.21.15.40:0/2342348401 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd3fc130650 0x7fd3fc11a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:19.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.737+0000 7fd4019b4700 1 --2- 172.21.15.40:0/2342348401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3fc096160 0x7fd3fc11e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:19.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.737+0000 7fd4019b4700 1 --2- 172.21.15.40:0/2342348401 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3fc098b10 0x7fd3fc11a300 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:19.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.737+0000 7fd4019b4700 1 -- 172.21.15.40:0/2342348401 >> 172.21.15.40:0/2342348401 conn(0x7fd3fc09ab30 msgr2=0x7fd3fc09b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:19.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.737+0000 7fd4019b4700 1 -- 172.21.15.40:0/2342348401 shutdown_connections 2023-09-30T22:22:19.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.737+0000 7fd4019b4700 1 -- 172.21.15.40:0/2342348401 wait complete. 2023-09-30T22:22:19.738 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 6 2023-09-30T22:22:19.850 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-30T22:22:02.347538+0000', 'modified': '2023-09-30T22:22:05.356644+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4194}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4194': {'gid': 4194, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.40:6817/2392027806', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.40:6817', 'nonce': 2392027806}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-09-30T22:22:19.850 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-30T22:22:19.850 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-09-30T22:22:19.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.971+0000 7f12484d9700 1 Processor -- start 2023-09-30T22:22:19.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.971+0000 7f12484d9700 1 -- start start 2023-09-30T22:22:19.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.971+0000 7f12484d9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1240096160 0x7f1240099600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:19.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.971+0000 7f12484d9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1240130650 0x7f1240132a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:19.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.971+0000 7f12484d9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1240098910 con 0x7f1240098b10 2023-09-30T22:22:19.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.971+0000 7f12484d9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1240096560 con 0x7f1240096160 2023-09-30T22:22:19.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.971+0000 7f12484d9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1240065e40 con 0x7f1240130650 2023-09-30T22:22:19.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.972+0000 7f1246a76700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1240130650 0x7f1240132a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:19.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.972+0000 7f1245a74700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1240096160 0x7f1240099600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:19.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.972+0000 7f1246a76700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1240130650 0x7f1240132a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:55434/0 (socket says 172.21.15.40:55434) 2023-09-30T22:22:19.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.972+0000 7f1245a74700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1240096160 0x7f1240099600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48284/0 (socket says 172.21.15.40:48284) 2023-09-30T22:22:19.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.972+0000 7f1246275700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1240098b10 0x7f1240098ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53396/0 (socket says 172.21.15.40:53396) 2023-09-30T22:22:19.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.972+0000 7f1246a76700 1 -- 172.21.15.40:0/1775673850 learned_addr learned my addr 172.21.15.40:0/1775673850 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:19.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.972+0000 7f1246a76700 1 -- 172.21.15.40:0/1775673850 >> v2:172.21.15.40:3300/0 conn(0x7f1240096160 msgr2=0x7f1240099600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:19.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.972+0000 7f1246a76700 1 --2- 172.21.15.40:0/1775673850 >> v2:172.21.15.40:3300/0 conn(0x7f1240096160 0x7f1240099600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:19.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.972+0000 7f1246a76700 1 -- 172.21.15.40:0/1775673850 >> v1:172.21.15.40:6789/0 conn(0x7f1240098b10 legacy=0x7f1240098ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.972+0000 7f1246a76700 1 -- 172.21.15.40:0/1775673850 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12400955c0 con 0x7f1240130650 2023-09-30T22:22:19.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.972+0000 7f1245a74700 1 --2- 172.21.15.40:0/1775673850 >> v2:172.21.15.40:3300/0 conn(0x7f1240096160 0x7f1240099600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:19.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.972+0000 7f1246a76700 1 --2- 172.21.15.40:0/1775673850 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1240130650 0x7f1240132a40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f1238009f20 tx=0x7f1238009840).ready entity=mon.1 client_cookie=ac3ac9bbde3c424 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:19.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.972+0000 7f1245273700 1 -- 172.21.15.40:0/1775673850 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123800e070 con 0x7f1240130650 2023-09-30T22:22:19.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.972+0000 7f1245273700 1 -- 172.21.15.40:0/1775673850 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123800b9d0 con 0x7f1240130650 2023-09-30T22:22:19.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.972+0000 7f1245273700 1 -- 172.21.15.40:0/1775673850 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123800bd50 con 0x7f1240130650 2023-09-30T22:22:19.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.973+0000 7f12484d9700 1 -- 172.21.15.40:0/1775673850 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1240130650 msgr2=0x7f1240132a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.973+0000 7f12484d9700 1 --2- 172.21.15.40:0/1775673850 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1240130650 0x7f1240132a40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f1238009f20 tx=0x7f1238009840).stop 2023-09-30T22:22:19.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.973+0000 7f12484d9700 1 -- 172.21.15.40:0/1775673850 shutdown_connections 2023-09-30T22:22:19.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.973+0000 7f12484d9700 1 --2- 172.21.15.40:0/1775673850 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1240130650 0x7f1240132a40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:19.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.973+0000 7f12484d9700 1 --2- 172.21.15.40:0/1775673850 >> v2:172.21.15.40:3300/0 conn(0x7f1240096160 0x7f1240099600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:19.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.973+0000 7f12484d9700 1 -- 172.21.15.40:0/1775673850 >> 172.21.15.40:0/1775673850 conn(0x7f124009ab30 msgr2=0x7f124009af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:19.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.973+0000 7f12484d9700 1 -- 172.21.15.40:0/1775673850 shutdown_connections 2023-09-30T22:22:19.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.973+0000 7f12484d9700 1 -- 172.21.15.40:0/1775673850 wait complete. 2023-09-30T22:22:19.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.974+0000 7f12484d9700 1 Processor -- start 2023-09-30T22:22:19.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.974+0000 7f12484d9700 1 -- start start 2023-09-30T22:22:19.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.974+0000 7f12484d9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1240096160 0x7f124011e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:19.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.974+0000 7f12484d9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1240098b10 0x7f124011a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:19.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.974+0000 7f12484d9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1240130650 0x7f124011a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:19.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.974+0000 7f12484d9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124011d7f0 con 0x7f1240098b10 2023-09-30T22:22:19.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.974+0000 7f12484d9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f124011d450 con 0x7f1240130650 2023-09-30T22:22:19.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.974+0000 7f12484d9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1240094a90 con 0x7f1240096160 2023-09-30T22:22:19.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.974+0000 7f1245a74700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1240098b10 0x7f124011a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:19.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.974+0000 7f1246275700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1240096160 0x7f124011e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:19.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.974+0000 7f1245a74700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1240098b10 0x7f124011a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48298/0 (socket says 172.21.15.40:48298) 2023-09-30T22:22:19.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.974+0000 7f1245a74700 1 -- 172.21.15.40:0/67290236 learned_addr learned my addr 172.21.15.40:0/67290236 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:19.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.974+0000 7f1246a76700 1 --2- 172.21.15.40:0/67290236 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1240130650 0x7f124011a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:19.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.975+0000 7f1246275700 1 -- 172.21.15.40:0/67290236 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1240130650 msgr2=0x7f124011a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.975+0000 7f1246275700 1 --2- 172.21.15.40:0/67290236 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1240130650 0x7f124011a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:19.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.975+0000 7f1246275700 1 -- 172.21.15.40:0/67290236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1240098b10 msgr2=0x7f124011a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.975+0000 7f1246275700 1 --2- 172.21.15.40:0/67290236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1240098b10 0x7f124011a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:19.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.975+0000 7f1246275700 1 -- 172.21.15.40:0/67290236 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12300092a0 con 0x7f1240096160 2023-09-30T22:22:19.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.975+0000 7f1245a74700 1 --2- 172.21.15.40:0/67290236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1240098b10 0x7f124011a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:19.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.975+0000 7f1246275700 1 --2- 172.21.15.40:0/67290236 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1240096160 0x7f124011e290 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f123c00c410 tx=0x7f123c007d30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:19.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.975+0000 7f12367fc700 1 -- 172.21.15.40:0/67290236 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c0070d0 con 0x7f1240096160 2023-09-30T22:22:19.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.975+0000 7f12367fc700 1 -- 172.21.15.40:0/67290236 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123c007230 con 0x7f1240096160 2023-09-30T22:22:19.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.975+0000 7f12367fc700 1 -- 172.21.15.40:0/67290236 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c0075b0 con 0x7f1240096160 2023-09-30T22:22:19.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.975+0000 7f12484d9700 1 -- 172.21.15.40:0/67290236 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1238009ae0 con 0x7f1240096160 2023-09-30T22:22:19.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.975+0000 7f12484d9700 1 -- 172.21.15.40:0/67290236 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f124011be80 con 0x7f1240096160 2023-09-30T22:22:19.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.976+0000 7f12367fc700 1 -- 172.21.15.40:0/67290236 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f123c0058f0 con 0x7f1240096160 2023-09-30T22:22:19.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.976+0000 7f12367fc700 1 -- 172.21.15.40:0/67290236 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f123c03a570 con 0x7f1240096160 2023-09-30T22:22:19.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.979+0000 7f1259e8cb80 1 Processor -- start 2023-09-30T22:22:19.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.979+0000 7f1259e8cb80 1 -- start start 2023-09-30T22:22:19.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.979+0000 7f1259e8cb80 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x55bc54116170 0x55bc54116550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:19.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.979+0000 7f1259e8cb80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc54116a40 0x55bc541400c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:19.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.979+0000 7f1259e8cb80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55bc541405b0 0x55bc541429a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:19.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.979+0000 7f1259e8cb80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc540e0610 con 0x55bc54116a40 2023-09-30T22:22:19.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.979+0000 7f1259e8cb80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bc54056db0 con 0x55bc541405b0 2023-09-30T22:22:19.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.979+0000 7f1259e8cb80 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x55bc5406c030 con 0x55bc54116170 2023-09-30T22:22:19.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.979+0000 7f1245a74700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc54116a40 0x55bc541400c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:19.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.979+0000 7f1246275700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x55bc54116170 0x55bc54116550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:19.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.979+0000 7f1246a76700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55bc541405b0 0x55bc541429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:19.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.979+0000 7f1246275700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x55bc54116170 0x55bc54116550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33700/0 (socket says 172.21.15.40:33700) 2023-09-30T22:22:19.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.979+0000 7f1246a76700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55bc541405b0 0x55bc541429a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:55460/0 (socket says 172.21.15.40:55460) 2023-09-30T22:22:19.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.979+0000 7f1246275700 1 -- 172.21.15.40:0/979274444 learned_addr learned my addr 172.21.15.40:0/979274444 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:19.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.979+0000 7f1246a76700 1 -- 172.21.15.40:0/979274444 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x55bc54116170 msgr2=0x55bc54116550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:19.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.979+0000 7f1246a76700 1 --2- 172.21.15.40:0/979274444 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x55bc54116170 0x55bc54116550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:19.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.979+0000 7f1246a76700 1 -- 172.21.15.40:0/979274444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc54116a40 msgr2=0x55bc541400c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:19.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.979+0000 7f1246a76700 1 --2- 172.21.15.40:0/979274444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc54116a40 0x55bc541400c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:19.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.979+0000 7f1246a76700 1 -- 172.21.15.40:0/979274444 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc53f07710 con 0x55bc541405b0 2023-09-30T22:22:19.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.979+0000 7f1246275700 1 --2- 172.21.15.40:0/979274444 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x55bc54116170 0x55bc54116550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:19.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.979+0000 7f1245a74700 1 --2- 172.21.15.40:0/979274444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc54116a40 0x55bc541400c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:19.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.980+0000 7f1246a76700 1 --2- 172.21.15.40:0/979274444 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55bc541405b0 0x55bc541429a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f1238013000 tx=0x7f1238009840).ready entity=mon.1 client_cookie=854abc3bc5ef2ff7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:19.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.980+0000 7f12237fe700 1 -- 172.21.15.40:0/979274444 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1238024070 con 0x55bc541405b0 2023-09-30T22:22:19.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.980+0000 7f12237fe700 1 -- 172.21.15.40:0/979274444 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123800bb40 con 0x55bc541405b0 2023-09-30T22:22:19.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.980+0000 7f12237fe700 1 -- 172.21.15.40:0/979274444 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1238013630 con 0x55bc541405b0 2023-09-30T22:22:19.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.980+0000 7f1259e8cb80 1 -- 172.21.15.40:0/979274444 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55bc541405b0 msgr2=0x55bc541429a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.980+0000 7f1259e8cb80 1 --2- 172.21.15.40:0/979274444 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55bc541405b0 0x55bc541429a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f1238013000 tx=0x7f1238009840).stop 2023-09-30T22:22:19.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.980+0000 7f1259e8cb80 1 -- 172.21.15.40:0/979274444 shutdown_connections 2023-09-30T22:22:19.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.980+0000 7f1259e8cb80 1 --2- 172.21.15.40:0/979274444 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x55bc54116170 0x55bc54116550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:19.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.980+0000 7f1259e8cb80 1 --2- 172.21.15.40:0/979274444 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55bc541405b0 0x55bc541429a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:19.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.980+0000 7f1259e8cb80 1 --2- 172.21.15.40:0/979274444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc54116a40 0x55bc541400c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:19.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.980+0000 7f1259e8cb80 1 -- 172.21.15.40:0/979274444 >> 172.21.15.40:0/979274444 conn(0x55bc53f84940 msgr2=0x55bc54136cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:19.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.980+0000 7f1259e8cb80 1 -- 172.21.15.40:0/979274444 shutdown_connections 2023-09-30T22:22:19.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.980+0000 7f1259e8cb80 1 -- 172.21.15.40:0/979274444 wait complete. 2023-09-30T22:22:19.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.981+0000 7f1259e8cb80 1 -- start start 2023-09-30T22:22:19.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.981+0000 7f1259e8cb80 1 Processor -- start 2023-09-30T22:22:19.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.982+0000 7f1259e8cb80 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x55bc54116170 0x55bc5413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:19.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.982+0000 7f1259e8cb80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc54116a40 0x55bc5413be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:19.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.982+0000 7f1259e8cb80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55bc541405b0 0x55bc5413c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:19.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.982+0000 7f1259e8cb80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc5406c170 con 0x55bc54116a40 2023-09-30T22:22:19.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.982+0000 7f1259e8cb80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bc5406c3f0 con 0x55bc541405b0 2023-09-30T22:22:19.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.982+0000 7f1259e8cb80 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x55bc54037920 con 0x55bc54116170 2023-09-30T22:22:19.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.982+0000 7f1259e8cb80 10 client.0 ll_register_callbacks cb 0x55bc5400cce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:22:19.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.982+0000 7f1246275700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x55bc54116170 0x55bc5413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:19.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.982+0000 7f1245a74700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc54116a40 0x55bc5413be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:19.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.982+0000 7f1246275700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x55bc54116170 0x55bc5413b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33708/0 (socket says 172.21.15.40:33708) 2023-09-30T22:22:19.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.982+0000 7f1246275700 1 -- 172.21.15.40:0/3144610737 learned_addr learned my addr 172.21.15.40:0/3144610737 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:19.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.982+0000 7f1246a76700 1 --2- 172.21.15.40:0/3144610737 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55bc541405b0 0x55bc5413c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:19.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.982+0000 7f1246275700 1 -- 172.21.15.40:0/3144610737 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55bc541405b0 msgr2=0x55bc5413c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:19.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.982+0000 7f1246275700 1 --2- 172.21.15.40:0/3144610737 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55bc541405b0 0x55bc5413c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:19.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.982+0000 7f1246275700 1 -- 172.21.15.40:0/3144610737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc54116a40 msgr2=0x55bc5413be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:19.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.982+0000 7f1246275700 1 --2- 172.21.15.40:0/3144610737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc54116a40 0x55bc5413be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:19.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.982+0000 7f1246275700 1 -- 172.21.15.40:0/3144610737 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12400955c0 con 0x55bc54116170 2023-09-30T22:22:19.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.982+0000 7f1246275700 1 --2- 172.21.15.40:0/3144610737 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x55bc54116170 0x55bc5413b990 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f123c000fd0 tx=0x7f123c015000).ready entity=mon.2 client_cookie=8b72d54f925bb210 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:19.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.982+0000 7f1220ff9700 10 client.0 ms_handle_connect on v2:172.21.15.40:3302/0 2023-09-30T22:22:19.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.982+0000 7f1220ff9700 1 -- 172.21.15.40:0/3144610737 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c030070 con 0x55bc54116170 2023-09-30T22:22:19.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.982+0000 7f1220ff9700 1 -- 172.21.15.40:0/3144610737 <== mon.2 v2:172.21.15.40:3302/0 2 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f123c005d80 con 0x55bc54116170 2023-09-30T22:22:19.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.982+0000 7f1259e8cb80 1 -- 172.21.15.40:0/3144610737 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bc5410ef20 con 0x55bc54116170 2023-09-30T22:22:19.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.982+0000 7f1220ff9700 1 -- 172.21.15.40:0/3144610737 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f123c01cb80 con 0x55bc54116170 2023-09-30T22:22:19.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.982+0000 7f1259e8cb80 10 client.4478 fetch_fsmap learned FSMap version 6 2023-09-30T22:22:19.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.982+0000 7f1259e8cb80 1 -- 172.21.15.40:0/3144610737 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55bc5403eb00 con 0x55bc54116170 2023-09-30T22:22:19.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.983+0000 7f1220ff9700 1 -- 172.21.15.40:0/3144610737 <== mon.2 v2:172.21.15.40:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bc5410ef20 con 0x55bc54116170 2023-09-30T22:22:19.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.983+0000 7f1220ff9700 1 -- 172.21.15.40:0/3144610737 <== mon.2 v2:172.21.15.40:3302/0 5 ==== fsmap(e 6) v1 ==== 1430+0+0 (secure 0 0 0) 0x7f123c033350 con 0x55bc54116170 2023-09-30T22:22:19.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.983+0000 7f1259e8cb80 10 client.4478 fetch_fsmap finished waiting for FSMap version 6 2023-09-30T22:22:19.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.983+0000 7f1259e8cb80 10 client.4478 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-30T22:22:19.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.983+0000 7f1259e8cb80 20 client.4478 populate_metadata read hostname 'smithi040' 2023-09-30T22:22:19.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.983+0000 7f1259e8cb80 4 client.4478 mds_command: new command op to 4194 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-30T22:22:19.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.983+0000 7f1259e8cb80 1 -- 172.21.15.40:0/3144610737 --> v1:172.21.15.40:6817/2392027806 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bc540e4250 con 0x55bc54130ad0 2023-09-30T22:22:19.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.983+0000 7f1220ff9700 10 client.4478 ms_handle_connect on v1:172.21.15.40:6817/2392027806 2023-09-30T22:22:19.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.984+0000 7f1220ff9700 1 -- 172.21.15.40:0/3144610737 <== mds.0 v1:172.21.15.40:6817/2392027806 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (unknown 0 0 3608088055) 0x55bc540e4250 con 0x55bc54130ad0 2023-09-30T22:22:19.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.984+0000 7f1220ff9700 10 client.4478 handle_command_reply: tid=0 2023-09-30T22:22:19.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.984+0000 7f1259e8cb80 1 client.4478 shutdown 2023-09-30T22:22:19.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.984+0000 7f1259e8cb80 1 -- 172.21.15.40:0/3144610737 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x55bc54116170 msgr2=0x55bc5413b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.984+0000 7f1259e8cb80 1 --2- 172.21.15.40:0/3144610737 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x55bc54116170 0x55bc5413b990 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f123c000fd0 tx=0x7f123c015000).stop 2023-09-30T22:22:19.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.984+0000 7f1259e8cb80 1 -- 172.21.15.40:0/3144610737 shutdown_connections 2023-09-30T22:22:19.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.984+0000 7f1259e8cb80 1 --2- 172.21.15.40:0/3144610737 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x55bc54116170 0x55bc5413b990 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:19.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.984+0000 7f1259e8cb80 1 --2- 172.21.15.40:0/3144610737 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55bc541405b0 0x55bc5413c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:19.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.984+0000 7f1220ff9700 0 client.4478 ms_handle_reset on v1:172.21.15.40:6817/2392027806 2023-09-30T22:22:19.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.984+0000 7f1259e8cb80 1 --2- 172.21.15.40:0/3144610737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc54116a40 0x55bc5413be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:19.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.984+0000 7f1259e8cb80 1 -- 172.21.15.40:0/3144610737 >> 172.21.15.40:0/3144610737 conn(0x55bc53f84940 msgr2=0x55bc54136c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:19.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.984+0000 7f1259e8cb80 1 -- 172.21.15.40:0/3144610737 shutdown_connections 2023-09-30T22:22:19.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.984+0000 7f1259e8cb80 1 -- 172.21.15.40:0/3144610737 wait complete. 2023-09-30T22:22:19.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:19.984+0000 7f1259e8cb80 20 client.4478 trim_cache size 0 max 16384 2023-09-30T22:22:20.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.001+0000 7f1259e8cb80 1 Processor -- start 2023-09-30T22:22:20.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.001+0000 7f1259e8cb80 1 -- start start 2023-09-30T22:22:20.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.001+0000 7f1259e8cb80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55bc54116170 0x55bc54112610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:20.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.001+0000 7f1259e8cb80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc54116a40 0x55bc5413f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:20.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.001+0000 7f1259e8cb80 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x55bc541405b0 0x55bc541312d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:20.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.001+0000 7f1259e8cb80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc5411a050 con 0x55bc54116a40 2023-09-30T22:22:20.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.001+0000 7f1259e8cb80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bc540db4c0 con 0x55bc54116170 2023-09-30T22:22:20.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.001+0000 7f1259e8cb80 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x55bc5413cb80 con 0x55bc541405b0 2023-09-30T22:22:20.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.001+0000 7f1246275700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55bc54116170 0x55bc54112610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:20.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.001+0000 7f1245a74700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc54116a40 0x55bc5413f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:20.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.001+0000 7f1246275700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55bc54116170 0x55bc54112610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:55484/0 (socket says 172.21.15.40:55484) 2023-09-30T22:22:20.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.001+0000 7f1246a76700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x55bc541405b0 0x55bc541312d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:20.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.001+0000 7f1246275700 1 -- 172.21.15.40:0/2236780387 learned_addr learned my addr 172.21.15.40:0/2236780387 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:20.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.001+0000 7f1245a74700 1 --2- 172.21.15.40:0/2236780387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc54116a40 0x55bc5413f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48326/0 (socket says 172.21.15.40:48326) 2023-09-30T22:22:20.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.002+0000 7f1246275700 1 -- 172.21.15.40:0/2236780387 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x55bc541405b0 msgr2=0x55bc541312d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:20.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.002+0000 7f1246275700 1 --2- 172.21.15.40:0/2236780387 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x55bc541405b0 0x55bc541312d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:20.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.002+0000 7f1246275700 1 -- 172.21.15.40:0/2236780387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc54116a40 msgr2=0x55bc5413f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:20.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.002+0000 7f1246275700 1 --2- 172.21.15.40:0/2236780387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc54116a40 0x55bc5413f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:20.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.002+0000 7f1246275700 1 -- 172.21.15.40:0/2236780387 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc54064f70 con 0x55bc54116170 2023-09-30T22:22:20.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.002+0000 7f1245a74700 1 --2- 172.21.15.40:0/2236780387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc54116a40 0x55bc5413f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:20.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.002+0000 7f1246275700 1 --2- 172.21.15.40:0/2236780387 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55bc54116170 0x55bc54112610 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f123c01cd40 tx=0x7f123c030000).ready entity=mon.1 client_cookie=6dd9ed3ac5653b55 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:20.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.002+0000 7f1223fff700 1 -- 172.21.15.40:0/2236780387 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c02bdd0 con 0x55bc54116170 2023-09-30T22:22:20.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.002+0000 7f1223fff700 1 -- 172.21.15.40:0/2236780387 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123c01c9a0 con 0x55bc54116170 2023-09-30T22:22:20.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.002+0000 7f1223fff700 1 -- 172.21.15.40:0/2236780387 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c01c350 con 0x55bc54116170 2023-09-30T22:22:20.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.002+0000 7f1259e8cb80 1 -- 172.21.15.40:0/2236780387 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55bc54116170 msgr2=0x55bc54112610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:20.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.002+0000 7f1259e8cb80 1 --2- 172.21.15.40:0/2236780387 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55bc54116170 0x55bc54112610 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f123c01cd40 tx=0x7f123c030000).stop 2023-09-30T22:22:20.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.003+0000 7f1259e8cb80 1 -- 172.21.15.40:0/2236780387 shutdown_connections 2023-09-30T22:22:20.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.003+0000 7f1259e8cb80 1 --2- 172.21.15.40:0/2236780387 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x55bc541405b0 0x55bc541312d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:20.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.003+0000 7f1259e8cb80 1 --2- 172.21.15.40:0/2236780387 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55bc54116170 0x55bc54112610 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:20.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.003+0000 7f1259e8cb80 1 --2- 172.21.15.40:0/2236780387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc54116a40 0x55bc5413f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:20.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.003+0000 7f1259e8cb80 1 -- 172.21.15.40:0/2236780387 >> 172.21.15.40:0/2236780387 conn(0x55bc53f84940 msgr2=0x55bc54119340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:20.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.003+0000 7f1259e8cb80 1 -- 172.21.15.40:0/2236780387 shutdown_connections 2023-09-30T22:22:20.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.003+0000 7f1259e8cb80 1 -- 172.21.15.40:0/2236780387 wait complete. 2023-09-30T22:22:20.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.003+0000 7f1259e8cb80 1 -- start start 2023-09-30T22:22:20.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.003+0000 7f1259e8cb80 1 Processor -- start 2023-09-30T22:22:20.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.004+0000 7f1259e8cb80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55bc54116170 0x55bc5414c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:20.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.004+0000 7f1259e8cb80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc54116a40 0x55bc54146c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:20.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.004+0000 7f1259e8cb80 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x55bc541405b0 0x55bc541470f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:20.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.004+0000 7f1259e8cb80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc5412fbd0 con 0x55bc54116a40 2023-09-30T22:22:20.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.004+0000 7f1259e8cb80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bc54117310 con 0x55bc54116170 2023-09-30T22:22:20.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.004+0000 7f1259e8cb80 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x55bc5413ea00 con 0x55bc541405b0 2023-09-30T22:22:20.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.004+0000 7f1259e8cb80 10 client.0 ll_register_callbacks cb 0x55bc5400cce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:22:20.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.004+0000 7f1245a74700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc54116a40 0x55bc54146c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:20.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.004+0000 7f1245a74700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc54116a40 0x55bc54146c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48334/0 (socket says 172.21.15.40:48334) 2023-09-30T22:22:20.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.004+0000 7f1245a74700 1 -- 172.21.15.40:0/3574671826 learned_addr learned my addr 172.21.15.40:0/3574671826 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:20.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.004+0000 7f1246a76700 1 --2- 172.21.15.40:0/3574671826 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x55bc541405b0 0x55bc541470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:20.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.004+0000 7f1246275700 1 --2- 172.21.15.40:0/3574671826 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55bc54116170 0x55bc5414c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:20.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.005+0000 7f1245a74700 1 -- 172.21.15.40:0/3574671826 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x55bc541405b0 msgr2=0x55bc541470f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:20.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.005+0000 7f1245a74700 1 --2- 172.21.15.40:0/3574671826 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x55bc541405b0 0x55bc541470f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:20.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.005+0000 7f1245a74700 1 -- 172.21.15.40:0/3574671826 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55bc54116170 msgr2=0x55bc5414c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:20.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.005+0000 7f1245a74700 1 --2- 172.21.15.40:0/3574671826 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55bc54116170 0x55bc5414c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:20.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.005+0000 7f1245a74700 1 -- 172.21.15.40:0/3574671826 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1230011800 con 0x55bc54116a40 2023-09-30T22:22:20.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.005+0000 7f1245a74700 1 --2- 172.21.15.40:0/3574671826 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc54116a40 0x55bc54146c00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x55bc54133350 tx=0x7f1230019040).ready entity=mon.0 client_cookie=6d8d34ca6cd69aa7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:20.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.005+0000 7f1220ff9700 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-09-30T22:22:20.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.005+0000 7f1220ff9700 1 -- 172.21.15.40:0/3574671826 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123001c070 con 0x55bc54116a40 2023-09-30T22:22:20.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.005+0000 7f1220ff9700 1 -- 172.21.15.40:0/3574671826 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f12300170d0 con 0x55bc54116a40 2023-09-30T22:22:20.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.005+0000 7f1259e8cb80 1 -- 172.21.15.40:0/3574671826 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f123800bb40 con 0x55bc54116a40 2023-09-30T22:22:20.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.005+0000 7f1220ff9700 1 -- 172.21.15.40:0/3574671826 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1230017290 con 0x55bc54116a40 2023-09-30T22:22:20.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.005+0000 7f1259e8cb80 10 client.4617 fetch_fsmap learned FSMap version 6 2023-09-30T22:22:20.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.005+0000 7f1259e8cb80 1 -- 172.21.15.40:0/3574671826 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55bc5403eb00 con 0x55bc54116a40 2023-09-30T22:22:20.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.005+0000 7f1220ff9700 1 -- 172.21.15.40:0/3574671826 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123800bb40 con 0x55bc54116a40 2023-09-30T22:22:20.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.005+0000 7f1220ff9700 1 -- 172.21.15.40:0/3574671826 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 6) v1 ==== 1430+0+0 (secure 0 0 0) 0x7f1230015c40 con 0x55bc54116a40 2023-09-30T22:22:20.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.005+0000 7f1259e8cb80 10 client.4617 fetch_fsmap finished waiting for FSMap version 6 2023-09-30T22:22:20.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.005+0000 7f1259e8cb80 10 client.4617 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-30T22:22:20.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.005+0000 7f1259e8cb80 20 client.4617 populate_metadata read hostname 'smithi040' 2023-09-30T22:22:20.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.005+0000 7f1259e8cb80 4 client.4617 mds_command: new command op to 4194 tid=0[{"prefix": "status"}] 2023-09-30T22:22:20.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.005+0000 7f1259e8cb80 1 -- 172.21.15.40:0/3574671826 --> v1:172.21.15.40:6817/2392027806 -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bc53ed4ef0 con 0x55bc541a11c0 2023-09-30T22:22:20.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.006+0000 7f1220ff9700 10 client.4617 ms_handle_connect on v1:172.21.15.40:6817/2392027806 2023-09-30T22:22:20.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.006+0000 7f1220ff9700 1 -- 172.21.15.40:0/3574671826 <== mds.0 v1:172.21.15.40:6817/2392027806 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+322 (unknown 0 0 3334941487) 0x55bc53ed4ef0 con 0x55bc541a11c0 2023-09-30T22:22:20.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.006+0000 7f1220ff9700 10 client.4617 handle_command_reply: tid=0 2023-09-30T22:22:20.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.006+0000 7f1259e8cb80 1 client.4617 shutdown 2023-09-30T22:22:20.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.006+0000 7f1259e8cb80 1 -- 172.21.15.40:0/3574671826 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc54116a40 msgr2=0x55bc54146c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:20.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.006+0000 7f1259e8cb80 1 --2- 172.21.15.40:0/3574671826 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc54116a40 0x55bc54146c00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x55bc54133350 tx=0x7f1230019040).stop 2023-09-30T22:22:20.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.006+0000 7f1259e8cb80 1 -- 172.21.15.40:0/3574671826 shutdown_connections 2023-09-30T22:22:20.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.006+0000 7f1259e8cb80 1 --2- 172.21.15.40:0/3574671826 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x55bc541405b0 0x55bc541470f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:20.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.006+0000 7f1259e8cb80 1 --2- 172.21.15.40:0/3574671826 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55bc54116170 0x55bc5414c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:20.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.006+0000 7f1259e8cb80 1 --2- 172.21.15.40:0/3574671826 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55bc54116a40 0x55bc54146c00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:20.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.006+0000 7f1220ff9700 0 client.4617 ms_handle_reset on v1:172.21.15.40:6817/2392027806 2023-09-30T22:22:20.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.006+0000 7f1259e8cb80 1 -- 172.21.15.40:0/3574671826 >> 172.21.15.40:0/3574671826 conn(0x55bc53f84940 msgr2=0x55bc5413f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:20.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.006+0000 7f1259e8cb80 1 -- 172.21.15.40:0/3574671826 shutdown_connections 2023-09-30T22:22:20.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.006+0000 7f1259e8cb80 1 -- 172.21.15.40:0/3574671826 wait complete. 2023-09-30T22:22:20.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.006+0000 7f1259e8cb80 20 client.4617 trim_cache size 0 max 16384 2023-09-30T22:22:20.013 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-09-30T22:22:20.013 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "79dd4d8e-f295-4d9c-bd93-9850863800e3", 2023-09-30T22:22:20.013 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2023-09-30T22:22:20.013 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4194, 2023-09-30T22:22:20.013 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2023-09-30T22:22:20.014 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2023-09-30T22:22:20.014 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2023-09-30T22:22:20.014 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 17.658541977999999, 2023-09-30T22:22:20.014 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 6, 2023-09-30T22:22:20.014 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 17, 2023-09-30T22:22:20.014 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 17, 2023-09-30T22:22:20.014 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 22.0660025 2023-09-30T22:22:20.014 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-09-30T22:22:20.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.007+0000 7f12484d9700 1 -- 172.21.15.40:0/67290236 >> v1:172.21.15.40:6816/118905 conn(0x7f122402bb30 legacy=0x7f122402dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:20.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.007+0000 7f12484d9700 1 -- 172.21.15.40:0/67290236 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1240096160 msgr2=0x7f124011e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:20.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.007+0000 7f12484d9700 1 --2- 172.21.15.40:0/67290236 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1240096160 0x7f124011e290 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f123c00c410 tx=0x7f123c007d30).stop 2023-09-30T22:22:20.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.007+0000 7f12484d9700 1 -- 172.21.15.40:0/67290236 shutdown_connections 2023-09-30T22:22:20.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.007+0000 7f12484d9700 1 --2- 172.21.15.40:0/67290236 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1240096160 0x7f124011e290 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:20.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.007+0000 7f12484d9700 1 --2- 172.21.15.40:0/67290236 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1240130650 0x7f124011a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:20.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.007+0000 7f12484d9700 1 --2- 172.21.15.40:0/67290236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1240098b10 0x7f124011a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:20.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.007+0000 7f12484d9700 1 -- 172.21.15.40:0/67290236 >> 172.21.15.40:0/67290236 conn(0x7f124009ab30 msgr2=0x7f124005e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:20.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.007+0000 7f12484d9700 1 -- 172.21.15.40:0/67290236 shutdown_connections 2023-09-30T22:22:20.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.007+0000 7f12484d9700 1 -- 172.21.15.40:0/67290236 wait complete. 2023-09-30T22:22:20.019 INFO:teuthology.run_tasks:Running task exec... 2023-09-30T22:22:20.029 INFO:teuthology.task.exec:Executing custom commands... 2023-09-30T22:22:20.029 INFO:teuthology.task.exec:Running commands on role osd.0 host ubuntu@smithi040.front.sepia.ceph.com 2023-09-30T22:22:20.029 DEBUG:teuthology.orchestra.run.smithi040:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd set-require-min-compat-client pacific' 2023-09-30T22:22:20.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.147+0000 7fa77062a700 1 Processor -- start 2023-09-30T22:22:20.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.148+0000 7fa77062a700 1 -- start start 2023-09-30T22:22:20.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.148+0000 7fa77062a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa768066ee0 0x7fa7680957e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:20.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.148+0000 7fa77062a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa768128cf0 0x7fa768129240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:20.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.148+0000 7fa77062a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa768125400 0x7fa768125890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:20.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.148+0000 7fa77062a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7680672c0 con 0x7fa768066ee0 2023-09-30T22:22:20.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.148+0000 7fa77062a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa768065790 con 0x7fa768125400 2023-09-30T22:22:20.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.148+0000 7fa77062a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa768066420 con 0x7fa768128cf0 2023-09-30T22:22:20.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.148+0000 7fa76e3c6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa768066ee0 0x7fa7680957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:20.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.148+0000 7fa76ebc7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa768125400 0x7fa768125890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:20.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.148+0000 7fa76dbc5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa768128cf0 0x7fa768129240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:20.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.148+0000 7fa76e3c6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa768066ee0 0x7fa7680957e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48350/0 (socket says 172.21.15.40:48350) 2023-09-30T22:22:20.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.148+0000 7fa76ebc7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa768125400 0x7fa768125890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:55498/0 (socket says 172.21.15.40:55498) 2023-09-30T22:22:20.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.148+0000 7fa76e3c6700 1 -- 172.21.15.40:0/1323997782 learned_addr learned my addr 172.21.15.40:0/1323997782 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:20.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.149+0000 7fa76ebc7700 1 -- 172.21.15.40:0/1323997782 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa768128cf0 msgr2=0x7fa768129240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:20.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.149+0000 7fa76ebc7700 1 --2- 172.21.15.40:0/1323997782 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa768128cf0 0x7fa768129240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:20.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.149+0000 7fa76ebc7700 1 -- 172.21.15.40:0/1323997782 >> v2:172.21.15.40:3300/0 conn(0x7fa768066ee0 msgr2=0x7fa7680957e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:20.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.149+0000 7fa76ebc7700 1 --2- 172.21.15.40:0/1323997782 >> v2:172.21.15.40:3300/0 conn(0x7fa768066ee0 0x7fa7680957e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:20.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.149+0000 7fa76ebc7700 1 -- 172.21.15.40:0/1323997782 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa768065b60 con 0x7fa768125400 2023-09-30T22:22:20.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.149+0000 7fa76e3c6700 1 --2- 172.21.15.40:0/1323997782 >> v2:172.21.15.40:3300/0 conn(0x7fa768066ee0 0x7fa7680957e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:20.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.149+0000 7fa76ebc7700 1 --2- 172.21.15.40:0/1323997782 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa768125400 0x7fa768125890 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fa760009e60 tx=0x7fa760009780).ready entity=mon.1 client_cookie=f5950fbc4427d008 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:20.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.149+0000 7fa76d3c4700 1 -- 172.21.15.40:0/1323997782 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76000e070 con 0x7fa768125400 2023-09-30T22:22:20.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.149+0000 7fa76d3c4700 1 -- 172.21.15.40:0/1323997782 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76000bab0 con 0x7fa768125400 2023-09-30T22:22:20.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.149+0000 7fa76d3c4700 1 -- 172.21.15.40:0/1323997782 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76000be30 con 0x7fa768125400 2023-09-30T22:22:20.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.149+0000 7fa77062a700 1 -- 172.21.15.40:0/1323997782 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa768125400 msgr2=0x7fa768125890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:20.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.149+0000 7fa77062a700 1 --2- 172.21.15.40:0/1323997782 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa768125400 0x7fa768125890 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fa760009e60 tx=0x7fa760009780).stop 2023-09-30T22:22:20.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.150+0000 7fa77062a700 1 -- 172.21.15.40:0/1323997782 shutdown_connections 2023-09-30T22:22:20.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.150+0000 7fa77062a700 1 --2- 172.21.15.40:0/1323997782 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa768125400 0x7fa768125890 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:20.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.150+0000 7fa77062a700 1 --2- 172.21.15.40:0/1323997782 >> v2:172.21.15.40:3300/0 conn(0x7fa768066ee0 0x7fa7680957e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:20.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.150+0000 7fa77062a700 1 --2- 172.21.15.40:0/1323997782 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa768128cf0 0x7fa768129240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:20.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.150+0000 7fa77062a700 1 -- 172.21.15.40:0/1323997782 >> 172.21.15.40:0/1323997782 conn(0x7fa768099b90 msgr2=0x7fa768099fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:20.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.150+0000 7fa77062a700 1 -- 172.21.15.40:0/1323997782 shutdown_connections 2023-09-30T22:22:20.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.150+0000 7fa77062a700 1 -- 172.21.15.40:0/1323997782 wait complete. 2023-09-30T22:22:20.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.150+0000 7fa77062a700 1 Processor -- start 2023-09-30T22:22:20.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.150+0000 7fa77062a700 1 -- start start 2023-09-30T22:22:20.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.151+0000 7fa77062a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa768066ee0 0x7fa768119c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:20.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.151+0000 7fa77062a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa768125400 0x7fa768091a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:20.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.151+0000 7fa77062a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa768128cf0 0x7fa768091f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:20.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.151+0000 7fa77062a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7681197a0 con 0x7fa768128cf0 2023-09-30T22:22:20.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.151+0000 7fa77062a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa768092e70 con 0x7fa768066ee0 2023-09-30T22:22:20.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.151+0000 7fa77062a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa768098090 con 0x7fa768125400 2023-09-30T22:22:20.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.151+0000 7fa76e3c6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa768066ee0 0x7fa768119c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:20.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.151+0000 7fa76e3c6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa768066ee0 0x7fa768119c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:55506/0 (socket says 172.21.15.40:55506) 2023-09-30T22:22:20.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.151+0000 7fa76e3c6700 1 -- 172.21.15.40:0/2833689576 learned_addr learned my addr 172.21.15.40:0/2833689576 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:20.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.151+0000 7fa76ebc7700 1 --2- 172.21.15.40:0/2833689576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa768128cf0 0x7fa768091f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:20.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.151+0000 7fa76dbc5700 1 --2- 172.21.15.40:0/2833689576 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa768125400 0x7fa768091a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:20.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.151+0000 7fa76e3c6700 1 -- 172.21.15.40:0/2833689576 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa768125400 msgr2=0x7fa768091a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:20.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.151+0000 7fa76e3c6700 1 --2- 172.21.15.40:0/2833689576 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa768125400 0x7fa768091a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:20.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.151+0000 7fa76e3c6700 1 -- 172.21.15.40:0/2833689576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa768128cf0 msgr2=0x7fa768091f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:20.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.151+0000 7fa76e3c6700 1 --2- 172.21.15.40:0/2833689576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa768128cf0 0x7fa768091f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:20.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.151+0000 7fa76e3c6700 1 -- 172.21.15.40:0/2833689576 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa764009370 con 0x7fa768066ee0 2023-09-30T22:22:20.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.152+0000 7fa76e3c6700 1 --2- 172.21.15.40:0/2833689576 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa768066ee0 0x7fa768119c30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fa76400ea20 tx=0x7fa7640090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:20.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.152+0000 7fa75a7fc700 1 -- 172.21.15.40:0/2833689576 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76400ee60 con 0x7fa768066ee0 2023-09-30T22:22:20.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.152+0000 7fa75a7fc700 1 -- 172.21.15.40:0/2833689576 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76400c850 con 0x7fa768066ee0 2023-09-30T22:22:20.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.152+0000 7fa75a7fc700 1 -- 172.21.15.40:0/2833689576 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76400cbd0 con 0x7fa768066ee0 2023-09-30T22:22:20.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.152+0000 7fa77062a700 1 -- 172.21.15.40:0/2833689576 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa760009a20 con 0x7fa768066ee0 2023-09-30T22:22:20.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.152+0000 7fa77062a700 1 -- 172.21.15.40:0/2833689576 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa768119450 con 0x7fa768066ee0 2023-09-30T22:22:20.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.152+0000 7fa75a7fc700 1 -- 172.21.15.40:0/2833689576 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fa76401b400 con 0x7fa768066ee0 2023-09-30T22:22:20.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.153+0000 7fa75a7fc700 1 -- 172.21.15.40:0/2833689576 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fa76403b600 con 0x7fa768066ee0 2023-09-30T22:22:20.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.153+0000 7fa77062a700 1 -- 172.21.15.40:0/2833689576 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa76805a260 con 0x7fa768066ee0 2023-09-30T22:22:20.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.157+0000 7fa75a7fc700 1 -- 172.21.15.40:0/2833689576 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fa764016030 con 0x7fa768066ee0 2023-09-30T22:22:20.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.335+0000 7fa77062a700 1 -- 172.21.15.40:0/2833689576 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd set-require-min-compat-client", "version": "pacific"} v 0) v1 -- 0x7fa768092870 con 0x7fa768066ee0 2023-09-30T22:22:20.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.862+0000 7fa75a7fc700 1 -- 172.21.15.40:0/2833689576 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd set-require-min-compat-client", "version": "pacific"}]=0 set require_min_compat_client to pacific v18) v1 ==== 143+0+0 (secure 0 0 0) 0x7fa764016020 con 0x7fa768066ee0 2023-09-30T22:22:20.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.866+0000 7fa77062a700 1 -- 172.21.15.40:0/2833689576 >> v1:172.21.15.40:6816/118905 conn(0x7fa74c02bb60 legacy=0x7fa74c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:20.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.866+0000 7fa77062a700 1 -- 172.21.15.40:0/2833689576 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa768066ee0 msgr2=0x7fa768119c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:20.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.866+0000 7fa77062a700 1 --2- 172.21.15.40:0/2833689576 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa768066ee0 0x7fa768119c30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fa76400ea20 tx=0x7fa7640090f0).stop 2023-09-30T22:22:20.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.866+0000 7fa77062a700 1 -- 172.21.15.40:0/2833689576 shutdown_connections 2023-09-30T22:22:20.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.866+0000 7fa77062a700 1 --2- 172.21.15.40:0/2833689576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa768128cf0 0x7fa768091f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:20.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.866+0000 7fa77062a700 1 --2- 172.21.15.40:0/2833689576 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa768066ee0 0x7fa768119c30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:20.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.866+0000 7fa77062a700 1 --2- 172.21.15.40:0/2833689576 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa768125400 0x7fa768091a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:20.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.866+0000 7fa77062a700 1 -- 172.21.15.40:0/2833689576 >> 172.21.15.40:0/2833689576 conn(0x7fa768099b90 msgr2=0x7fa768126920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:20.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.866+0000 7fa77062a700 1 -- 172.21.15.40:0/2833689576 shutdown_connections 2023-09-30T22:22:20.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:20.866+0000 7fa77062a700 1 -- 172.21.15.40:0/2833689576 wait complete. 2023-09-30T22:22:20.870 INFO:teuthology.orchestra.run.smithi040.stderr:set require_min_compat_client to pacific 2023-09-30T22:22:20.881 INFO:teuthology.run_tasks:Running task print... 2023-09-30T22:22:20.891 INFO:teuthology.task.print:**** done ceph 2023-09-30T22:22:20.891 INFO:teuthology.run_tasks:Running task kclient... 2023-09-30T22:22:20.950 INFO:tasks.kclient:Mounting kernel clients... 2023-09-30T22:22:20.951 INFO:tasks.kclient:config is {'client.0': {}} 2023-09-30T22:22:20.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:22:20.951 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list 2023-09-30T22:22:21.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:22:21.003 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link delete ceph-brx 2023-09-30T22:22:21.080 INFO:teuthology.orchestra.run.smithi158.stderr:Cannot find device "ceph-brx" 2023-09-30T22:22:21.083 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:22:21.083 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-09-30T22:22:21.083 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-30T22:22:21.084 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-30T22:22:21.084 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T22:22:21.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.217+0000 7f1b3373f700 1 Processor -- start 2023-09-30T22:22:21.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.218+0000 7f1b3373f700 1 -- start start 2023-09-30T22:22:21.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.218+0000 7f1b3373f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b2c098b10 0x7f1b2c096160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:21.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.218+0000 7f1b3373f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1b2c098ef0 0x7f1b2c0992f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:21.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.218+0000 7f1b3373f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b2c098910 con 0x7f1b2c0997e0 2023-09-30T22:22:21.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.218+0000 7f1b3373f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c065e40 con 0x7f1b2c098b10 2023-09-30T22:22:21.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.218+0000 7f1b3373f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c0955c0 con 0x7f1b2c098ef0 2023-09-30T22:22:21.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.218+0000 7f1b30cda700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1b2c098ef0 0x7f1b2c0992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:21.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.218+0000 7f1b31cdc700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1b2c0997e0 0x7f1b2c096740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53402/0 (socket says 172.21.15.40:53402) 2023-09-30T22:22:21.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.218+0000 7f1b31cdc700 1 -- 172.21.15.40:0/3919952453 learned_addr learned my addr 172.21.15.40:0/3919952453 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:22:21.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.218+0000 7f1b314db700 1 --2- 172.21.15.40:0/3919952453 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b2c098b10 0x7f1b2c096160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:21.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.219+0000 7f1b1ffff700 1 -- 172.21.15.40:0/3919952453 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4208057683 0 0) 0x7f1b2c098910 con 0x7f1b2c0997e0 2023-09-30T22:22:21.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.219+0000 7f1b1ffff700 1 -- 172.21.15.40:0/3919952453 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b180033f0 con 0x7f1b2c0997e0 2023-09-30T22:22:21.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.219+0000 7f1b30cda700 1 -- 172.21.15.40:0/3919952453 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b2c098b10 msgr2=0x7f1b2c096160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:21.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.219+0000 7f1b30cda700 1 --2- 172.21.15.40:0/3919952453 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b2c098b10 0x7f1b2c096160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:21.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.219+0000 7f1b30cda700 1 -- 172.21.15.40:0/3919952453 >> v1:172.21.15.40:6789/0 conn(0x7f1b2c0997e0 legacy=0x7f1b2c096740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:21.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.219+0000 7f1b30cda700 1 -- 172.21.15.40:0/3919952453 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2c098110 con 0x7f1b2c098ef0 2023-09-30T22:22:21.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.219+0000 7f1b314db700 1 --2- 172.21.15.40:0/3919952453 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b2c098b10 0x7f1b2c096160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:21.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.219+0000 7f1b30cda700 1 --2- 172.21.15.40:0/3919952453 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1b2c098ef0 0x7f1b2c0992f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f1b20009790 tx=0x7f1b20009060).ready entity=mon.2 client_cookie=c40e91c820d2d568 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:21.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.219+0000 7f1b1ffff700 1 -- 172.21.15.40:0/3919952453 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b200090d0 con 0x7f1b2c098ef0 2023-09-30T22:22:21.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.219+0000 7f1b1ffff700 1 -- 172.21.15.40:0/3919952453 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2000f510 con 0x7f1b2c098ef0 2023-09-30T22:22:21.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.219+0000 7f1b1ffff700 1 -- 172.21.15.40:0/3919952453 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2000f890 con 0x7f1b2c098ef0 2023-09-30T22:22:21.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.220+0000 7f1b3373f700 1 -- 172.21.15.40:0/3919952453 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1b2c098ef0 msgr2=0x7f1b2c0992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:21.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.220+0000 7f1b3373f700 1 --2- 172.21.15.40:0/3919952453 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1b2c098ef0 0x7f1b2c0992f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f1b20009790 tx=0x7f1b20009060).stop 2023-09-30T22:22:21.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.220+0000 7f1b3373f700 1 -- 172.21.15.40:0/3919952453 shutdown_connections 2023-09-30T22:22:21.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.220+0000 7f1b3373f700 1 --2- 172.21.15.40:0/3919952453 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b2c098b10 0x7f1b2c096160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:21.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.220+0000 7f1b3373f700 1 --2- 172.21.15.40:0/3919952453 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1b2c098ef0 0x7f1b2c0992f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:21.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.220+0000 7f1b3373f700 1 -- 172.21.15.40:0/3919952453 >> 172.21.15.40:0/3919952453 conn(0x7f1b2c09ab30 msgr2=0x7f1b2c09af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:21.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.220+0000 7f1b3373f700 1 -- 172.21.15.40:0/3919952453 shutdown_connections 2023-09-30T22:22:21.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.220+0000 7f1b3373f700 1 -- 172.21.15.40:0/3919952453 wait complete. 2023-09-30T22:22:21.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.221+0000 7f1b3373f700 1 Processor -- start 2023-09-30T22:22:21.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.221+0000 7f1b3373f700 1 -- start start 2023-09-30T22:22:21.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.221+0000 7f1b3373f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b2c098b10 0x7f1b2c13a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:21.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.221+0000 7f1b3373f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1b2c098ef0 0x7f1b2c13ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:21.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.221+0000 7f1b3373f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b2c0997e0 0x7f1b2c13b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:21.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.221+0000 7f1b3373f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c13b5f0 con 0x7f1b2c0997e0 2023-09-30T22:22:21.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.221+0000 7f1b3373f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c11e490 con 0x7f1b2c098b10 2023-09-30T22:22:21.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.221+0000 7f1b3373f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c099e10 con 0x7f1b2c098ef0 2023-09-30T22:22:21.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.221+0000 7f1b30cda700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1b2c098ef0 0x7f1b2c13ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:21.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.221+0000 7f1b31cdc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b2c0997e0 0x7f1b2c13b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:21.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.221+0000 7f1b30cda700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1b2c098ef0 0x7f1b2c13ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33770/0 (socket says 172.21.15.40:33770) 2023-09-30T22:22:21.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.221+0000 7f1b30cda700 1 -- 172.21.15.40:0/2086194213 learned_addr learned my addr 172.21.15.40:0/2086194213 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:21.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.221+0000 7f1b314db700 1 --2- 172.21.15.40:0/2086194213 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b2c098b10 0x7f1b2c13a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:21.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.222+0000 7f1b30cda700 1 -- 172.21.15.40:0/2086194213 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b2c098b10 msgr2=0x7f1b2c13a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:21.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.222+0000 7f1b30cda700 1 --2- 172.21.15.40:0/2086194213 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b2c098b10 0x7f1b2c13a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:21.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.222+0000 7f1b30cda700 1 -- 172.21.15.40:0/2086194213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b2c0997e0 msgr2=0x7f1b2c13b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:21.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.222+0000 7f1b30cda700 1 --2- 172.21.15.40:0/2086194213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b2c0997e0 0x7f1b2c13b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:21.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.222+0000 7f1b30cda700 1 -- 172.21.15.40:0/2086194213 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b280092a0 con 0x7f1b2c098ef0 2023-09-30T22:22:21.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.222+0000 7f1b314db700 1 --2- 172.21.15.40:0/2086194213 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b2c098b10 0x7f1b2c13a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:22:21.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.222+0000 7f1b31cdc700 1 --2- 172.21.15.40:0/2086194213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b2c0997e0 0x7f1b2c13b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:21.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.222+0000 7f1b30cda700 1 --2- 172.21.15.40:0/2086194213 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1b2c098ef0 0x7f1b2c13ac10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f1b20009d80 tx=0x7f1b20017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:21.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.222+0000 7f1b1d7fa700 1 -- 172.21.15.40:0/2086194213 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b20006930 con 0x7f1b2c098ef0 2023-09-30T22:22:21.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.222+0000 7f1b1d7fa700 1 -- 172.21.15.40:0/2086194213 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b20011a10 con 0x7f1b2c098ef0 2023-09-30T22:22:21.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.222+0000 7f1b3373f700 1 -- 172.21.15.40:0/2086194213 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b200092a0 con 0x7f1b2c098ef0 2023-09-30T22:22:21.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.222+0000 7f1b1d7fa700 1 -- 172.21.15.40:0/2086194213 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b20011db0 con 0x7f1b2c098ef0 2023-09-30T22:22:21.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.222+0000 7f1b3373f700 1 -- 172.21.15.40:0/2086194213 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b2c11eae0 con 0x7f1b2c098ef0 2023-09-30T22:22:21.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.223+0000 7f1b1d7fa700 1 -- 172.21.15.40:0/2086194213 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f1b2001b620 con 0x7f1b2c098ef0 2023-09-30T22:22:21.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.223+0000 7f1b1d7fa700 1 -- 172.21.15.40:0/2086194213 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f1b2003c870 con 0x7f1b2c098ef0 2023-09-30T22:22:21.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.223+0000 7f1b3373f700 1 -- 172.21.15.40:0/2086194213 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b2c05a260 con 0x7f1b2c098ef0 2023-09-30T22:22:21.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.227+0000 7f1b1d7fa700 1 -- 172.21.15.40:0/2086194213 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f1b20029080 con 0x7f1b2c098ef0 2023-09-30T22:22:21.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.438+0000 7f1b3373f700 1 -- 172.21.15.40:0/2086194213 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1b2c096e50 con 0x7f1b2c098ef0 2023-09-30T22:22:21.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.438+0000 7f1b1d7fa700 1 -- 172.21.15.40:0/2086194213 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1b2001f020 con 0x7f1b2c098ef0 2023-09-30T22:22:21.439 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T22:22:21.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.440+0000 7f1b3373f700 1 -- 172.21.15.40:0/2086194213 >> v1:172.21.15.40:6816/118905 conn(0x7f1b1002bb90 legacy=0x7f1b1002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:21.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.440+0000 7f1b3373f700 1 -- 172.21.15.40:0/2086194213 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1b2c098ef0 msgr2=0x7f1b2c13ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:21.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.440+0000 7f1b3373f700 1 --2- 172.21.15.40:0/2086194213 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1b2c098ef0 0x7f1b2c13ac10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f1b20009d80 tx=0x7f1b20017000).stop 2023-09-30T22:22:21.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.440+0000 7f1b3373f700 1 -- 172.21.15.40:0/2086194213 shutdown_connections 2023-09-30T22:22:21.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.441+0000 7f1b3373f700 1 --2- 172.21.15.40:0/2086194213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b2c0997e0 0x7f1b2c13b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:21.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.441+0000 7f1b3373f700 1 --2- 172.21.15.40:0/2086194213 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b2c098b10 0x7f1b2c13a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:21.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.441+0000 7f1b3373f700 1 --2- 172.21.15.40:0/2086194213 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1b2c098ef0 0x7f1b2c13ac10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:21.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.441+0000 7f1b3373f700 1 -- 172.21.15.40:0/2086194213 >> 172.21.15.40:0/2086194213 conn(0x7f1b2c09ab30 msgr2=0x7f1b2c1144b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:21.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.441+0000 7f1b3373f700 1 -- 172.21.15.40:0/2086194213 shutdown_connections 2023-09-30T22:22:21.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:21.441+0000 7f1b3373f700 1 -- 172.21.15.40:0/2086194213 wait complete. 2023-09-30T22:22:21.452 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-30T22:22:21.453 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T22:22:21.453 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi158.front.sepia.ceph.com 2023-09-30T22:22:21.453 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-30T22:22:21.453 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-30T22:22:21.453 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-30T22:22:21.453 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-30T22:22:21.453 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T22:22:21.453 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-30T22:22:21.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:22:21.453 DEBUG:teuthology.orchestra.run.smithi158:> ip addr 2023-09-30T22:22:21.503 INFO:teuthology.orchestra.run.smithi158.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T22:22:21.503 INFO:teuthology.orchestra.run.smithi158.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T22:22:21.503 INFO:teuthology.orchestra.run.smithi158.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T22:22:21.503 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:22:21.503 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 ::1/128 scope host 2023-09-30T22:22:21.504 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:22:21.504 INFO:teuthology.orchestra.run.smithi158.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:22:21.504 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d4 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:22:21.504 INFO:teuthology.orchestra.run.smithi158.stdout: altname enp7s0f0 2023-09-30T22:22:21.504 INFO:teuthology.orchestra.run.smithi158.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:22:21.504 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d5 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:22:21.505 INFO:teuthology.orchestra.run.smithi158.stdout: altname enp7s0f1 2023-09-30T22:22:21.505 INFO:teuthology.orchestra.run.smithi158.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:22:21.505 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6e brd ff:ff:ff:ff:ff:ff 2023-09-30T22:22:21.505 INFO:teuthology.orchestra.run.smithi158.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T22:22:21.505 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6f brd ff:ff:ff:ff:ff:ff 2023-09-30T22:22:21.506 INFO:teuthology.orchestra.run.smithi158.stdout: inet 172.21.15.158/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T22:22:21.506 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft 42374sec preferred_lft 42374sec 2023-09-30T22:22:21.506 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::ec4:7aff:fe88:726f/64 scope link 2023-09-30T22:22:21.506 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:22:21.507 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-09-30T22:22:21.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:22:21.507 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-09-30T22:22:21.507 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-09-30T22:22:21.508 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link add name ceph-brx type bridge 2023-09-30T22:22:21.508 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip addr flush dev ceph-brx 2023-09-30T22:22:21.508 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link set ceph-brx up 2023-09-30T22:22:21.508 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-09-30T22:22:21.508 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-09-30T22:22:21.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:22:21.939 DEBUG:teuthology.orchestra.run.smithi158:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T22:22:22.042 INFO:teuthology.orchestra.run.smithi158.stdout:1 2023-09-30T22:22:22.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:22:22.045 DEBUG:teuthology.orchestra.run.smithi158:> route 2023-09-30T22:22:22.114 INFO:teuthology.orchestra.run.smithi158.stdout:Kernel IP routing table 2023-09-30T22:22:22.115 INFO:teuthology.orchestra.run.smithi158.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T22:22:22.115 INFO:teuthology.orchestra.run.smithi158.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T22:22:22.115 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T22:22:22.115 INFO:teuthology.orchestra.run.smithi158.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T22:22:22.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:22:22.116 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-09-30T22:22:22.116 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-09-30T22:22:22.116 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T22:22:22.116 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T22:22:22.116 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T22:22:22.117 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-09-30T22:22:22.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:22:22.819 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list 2023-09-30T22:22:22.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:22:22.866 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list-id 2023-09-30T22:22:22.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:22:22.913 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-09-30T22:22:22.913 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-09-30T22:22:22.913 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T22:22:22.913 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-09-30T22:22:22.913 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-09-30T22:22:23.055 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-09-30T22:22:23.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:22:23.056 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-09-30T22:22:23.056 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-09-30T22:22:23.056 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-09-30T22:22:23.056 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-09-30T22:22:23.056 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-09-30T22:22:23.056 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-09-30T22:22:23.056 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-09-30T22:22:23.056 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-09-30T22:22:23.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:22:23.322 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-09-30T22:22:23.322 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-09-30T22:22:23.322 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link set brx.0 up 2023-09-30T22:22:23.322 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link set dev brx.0 master ceph-brx 2023-09-30T22:22:23.322 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-09-30T22:22:23.494 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:22:23.494 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-30T22:22:23.540 INFO:teuthology.orchestra.run.smithi158.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-30T22:22:23.540 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:22:23.540 DEBUG:teuthology.orchestra.run.smithi158:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-30T22:22:23.624 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-30T22:22:23.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:22:23.624 DEBUG:teuthology.orchestra.run.smithi158:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T22:22:23.763 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T22:22:23.763 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs" will pass to kernel. 2023-09-30T22:22:24.233 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-30T22:22:24.233 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs" will pass to kernel. 2023-09-30T22:22:24.239 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-30T22:22:24.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:22:24.239 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-30T22:22:24.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:22:24.310 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-30T22:22:24.430 INFO:teuthology.orchestra.run.smithi158.stdout:client4504 2023-09-30T22:22:24.430 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-09-30T22:22:24.430 DEBUG:teuthology.orchestra.run.smithi158:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T22:22:24.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:22:24.476 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-30T22:22:24.624 INFO:teuthology.orchestra.run.smithi158.stdout:client4504 2023-09-30T22:22:24.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:22:24.625 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-30T22:22:24.736 INFO:teuthology.orchestra.run.smithi158.stdout:client4504 2023-09-30T22:22:24.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:22:24.736 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/79dd4d8e-f295-4d9c-bd93-9850863800e3.client4504/status') 2023-09-30T22:22:24.865 INFO:teuthology.orchestra.run.smithi158.stdout:instance: client.4504 (3)172.21.15.158:0/663800187 2023-09-30T22:22:24.865 INFO:teuthology.orchestra.run.smithi158.stdout:blocklisted: false 2023-09-30T22:22:24.865 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records in 2023-09-30T22:22:24.865 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records out 2023-09-30T22:22:24.865 INFO:teuthology.orchestra.run.smithi158.stderr:70 bytes copied, 5.1202e-05 s, 1.4 MB/s 2023-09-30T22:22:24.868 INFO:teuthology.run_tasks:Running task mds_pre_upgrade... 2023-09-30T22:22:24.879 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:22:25.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.012+0000 7f2d03e1b700 1 Processor -- start 2023-09-30T22:22:25.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.013+0000 7f2d03e1b700 1 -- start start 2023-09-30T22:22:25.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.013+0000 7f2d03e1b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cfc098b10 0x7f2cfc096160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:25.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.013+0000 7f2d03e1b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2cfc130650 0x7f2cfc132a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:25.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.013+0000 7f2d03e1b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cfc098910 con 0x7f2cfc098ef0 2023-09-30T22:22:25.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.013+0000 7f2d03e1b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cfc065e40 con 0x7f2cfc130650 2023-09-30T22:22:25.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.013+0000 7f2d03e1b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc0955c0 con 0x7f2cfc098b10 2023-09-30T22:22:25.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.013+0000 7f2d023b8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2cfc130650 0x7f2cfc132a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:25.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.013+0000 7f2d01bb7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cfc098b10 0x7f2cfc096160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:25.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.013+0000 7f2d013b6700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2cfc098ef0 0x7f2cfc0992f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53516/0 (socket says 172.21.15.40:53516) 2023-09-30T22:22:25.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.013+0000 7f2d013b6700 1 -- 172.21.15.40:0/325027643 learned_addr learned my addr 172.21.15.40:0/325027643 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:22:25.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.014+0000 7f2d01bb7700 1 -- 172.21.15.40:0/325027643 >> v2:172.21.15.40:3300/0 conn(0x7f2cfc130650 msgr2=0x7f2cfc132a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:25.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.014+0000 7f2d01bb7700 1 --2- 172.21.15.40:0/325027643 >> v2:172.21.15.40:3300/0 conn(0x7f2cfc130650 0x7f2cfc132a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:25.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.014+0000 7f2d01bb7700 1 -- 172.21.15.40:0/325027643 >> v1:172.21.15.40:6789/0 conn(0x7f2cfc098ef0 legacy=0x7f2cfc0992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.014+0000 7f2d01bb7700 1 -- 172.21.15.40:0/325027643 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cfc097750 con 0x7f2cfc098b10 2023-09-30T22:22:25.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.014+0000 7f2d023b8700 1 --2- 172.21.15.40:0/325027643 >> v2:172.21.15.40:3300/0 conn(0x7f2cfc130650 0x7f2cfc132a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:25.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.014+0000 7f2d01bb7700 1 --2- 172.21.15.40:0/325027643 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cfc098b10 0x7f2cfc096160 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f2cf8009760 tx=0x7f2cf8009060).ready entity=mon.1 client_cookie=dc1d25d58acca27c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:25.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.014+0000 7f2d00bb5700 1 -- 172.21.15.40:0/325027643 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf80090d0 con 0x7f2cfc098b10 2023-09-30T22:22:25.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.014+0000 7f2d00bb5700 1 -- 172.21.15.40:0/325027643 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf800f510 con 0x7f2cfc098b10 2023-09-30T22:22:25.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.014+0000 7f2d00bb5700 1 -- 172.21.15.40:0/325027643 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf800f890 con 0x7f2cfc098b10 2023-09-30T22:22:25.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.014+0000 7f2d03e1b700 1 -- 172.21.15.40:0/325027643 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cfc098b10 msgr2=0x7f2cfc096160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.014+0000 7f2d03e1b700 1 --2- 172.21.15.40:0/325027643 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cfc098b10 0x7f2cfc096160 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f2cf8009760 tx=0x7f2cf8009060).stop 2023-09-30T22:22:25.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.015+0000 7f2d03e1b700 1 -- 172.21.15.40:0/325027643 shutdown_connections 2023-09-30T22:22:25.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.015+0000 7f2d03e1b700 1 --2- 172.21.15.40:0/325027643 >> v2:172.21.15.40:3300/0 conn(0x7f2cfc130650 0x7f2cfc132a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:25.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.015+0000 7f2d03e1b700 1 --2- 172.21.15.40:0/325027643 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cfc098b10 0x7f2cfc096160 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:25.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.015+0000 7f2d03e1b700 1 -- 172.21.15.40:0/325027643 >> 172.21.15.40:0/325027643 conn(0x7f2cfc09ab30 msgr2=0x7f2cfc09af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:25.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.015+0000 7f2d03e1b700 1 -- 172.21.15.40:0/325027643 shutdown_connections 2023-09-30T22:22:25.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.015+0000 7f2d03e1b700 1 -- 172.21.15.40:0/325027643 wait complete. 2023-09-30T22:22:25.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.015+0000 7f2d03e1b700 1 Processor -- start 2023-09-30T22:22:25.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.015+0000 7f2d03e1b700 1 -- start start 2023-09-30T22:22:25.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.016+0000 7f2d03e1b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2cfc098b10 0x7f2cfc13ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:25.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.016+0000 7f2d03e1b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cfc098ef0 0x7f2cfc13b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:25.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.016+0000 7f2d03e1b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cfc130650 0x7f2cfc11a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:25.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.016+0000 7f2d03e1b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc11e1d0 con 0x7f2cfc098ef0 2023-09-30T22:22:25.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.016+0000 7f2d03e1b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc130a30 con 0x7f2cfc130650 2023-09-30T22:22:25.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.016+0000 7f2d03e1b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc09ce80 con 0x7f2cfc098b10 2023-09-30T22:22:25.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.016+0000 7f2d01bb7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2cfc098b10 0x7f2cfc13ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:25.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.016+0000 7f2d013b6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cfc098ef0 0x7f2cfc13b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:25.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.016+0000 7f2d023b8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cfc130650 0x7f2cfc11a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:25.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.016+0000 7f2d01bb7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2cfc098b10 0x7f2cfc13ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:50452/0 (socket says 172.21.15.40:50452) 2023-09-30T22:22:25.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.016+0000 7f2d013b6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cfc098ef0 0x7f2cfc13b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52008/0 (socket says 172.21.15.40:52008) 2023-09-30T22:22:25.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.016+0000 7f2d01bb7700 1 -- 172.21.15.40:0/3387070072 learned_addr learned my addr 172.21.15.40:0/3387070072 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:25.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.016+0000 7f2d023b8700 1 -- 172.21.15.40:0/3387070072 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2cfc098b10 msgr2=0x7f2cfc13ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.016+0000 7f2d023b8700 1 --2- 172.21.15.40:0/3387070072 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2cfc098b10 0x7f2cfc13ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:25.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.016+0000 7f2d023b8700 1 -- 172.21.15.40:0/3387070072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cfc098ef0 msgr2=0x7f2cfc13b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.016+0000 7f2d023b8700 1 --2- 172.21.15.40:0/3387070072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cfc098ef0 0x7f2cfc13b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:25.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.016+0000 7f2d023b8700 1 -- 172.21.15.40:0/3387070072 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf4009a20 con 0x7f2cfc130650 2023-09-30T22:22:25.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.016+0000 7f2d01bb7700 1 --2- 172.21.15.40:0/3387070072 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2cfc098b10 0x7f2cfc13ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:25.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.016+0000 7f2d013b6700 1 --2- 172.21.15.40:0/3387070072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cfc098ef0 0x7f2cfc13b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:25.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.017+0000 7f2d023b8700 1 --2- 172.21.15.40:0/3387070072 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cfc130650 0x7f2cfc11a730 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f2cfc0668c0 tx=0x7f2cf400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:25.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.017+0000 7f2cedffb700 1 -- 172.21.15.40:0/3387070072 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf400ca70 con 0x7f2cfc130650 2023-09-30T22:22:25.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.017+0000 7f2cedffb700 1 -- 172.21.15.40:0/3387070072 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf400f040 con 0x7f2cfc130650 2023-09-30T22:22:25.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.017+0000 7f2d03e1b700 1 -- 172.21.15.40:0/3387070072 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf80092a0 con 0x7f2cfc130650 2023-09-30T22:22:25.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.017+0000 7f2cedffb700 1 -- 172.21.15.40:0/3387070072 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf400ce00 con 0x7f2cfc130650 2023-09-30T22:22:25.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.017+0000 7f2d03e1b700 1 -- 172.21.15.40:0/3387070072 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cfc11c2c0 con 0x7f2cfc130650 2023-09-30T22:22:25.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.018+0000 7f2cedffb700 1 -- 172.21.15.40:0/3387070072 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f2cf4013610 con 0x7f2cfc130650 2023-09-30T22:22:25.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.018+0000 7f2cedffb700 1 -- 172.21.15.40:0/3387070072 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f2cf403b7b0 con 0x7f2cfc130650 2023-09-30T22:22:25.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.018+0000 7f2d03e1b700 1 -- 172.21.15.40:0/3387070072 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cfc091a00 con 0x7f2cfc130650 2023-09-30T22:22:25.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.023+0000 7f2cedffb700 1 -- 172.21.15.40:0/3387070072 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f2cf401c410 con 0x7f2cfc130650 2023-09-30T22:22:25.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.190+0000 7f2d03e1b700 1 -- 172.21.15.40:0/3387070072 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2cfc05a260 con 0x7f2cfc130650 2023-09-30T22:22:25.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.190+0000 7f2cedffb700 1 -- 172.21.15.40:0/3387070072 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+11340 (secure 0 0 0) 0x7f2cf402b090 con 0x7f2cfc130650 2023-09-30T22:22:25.191 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:22:25.191 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":18,"fsid":"79dd4d8e-f295-4d9c-bd93-9850863800e3","created":"2023-09-30T22:21:46.980357+0000","modified":"2023-09-30T22:22:20.853681+0000","last_up_change":"2023-09-30T22:21:54.822866+0000","last_in_change":"2023-09-30T22:21:48.205613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:21:54.875024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:21:56.197012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:22:00.759069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:22:01.327265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"771f785c-f464-4b17-936c-cbf31b1153e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6812","nonce":119451}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6813","nonce":119451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6815","nonce":119451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6814","nonce":119451}]},"public_addr":"172.21.15.40:6812/119451","cluster_addr":"172.21.15.40:6813/119451","heartbeat_back_addr":"172.21.15.40:6815/119451","heartbeat_front_addr":"172.21.15.40:6814/119451","state":["exists","up"]},{"osd":1,"uuid":"45f1e2e8-5310-4219-ab54-424e7440fcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6808","nonce":119436}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6809","nonce":119436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6811","nonce":119436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6810","nonce":119436}]},"public_addr":"172.21.15.40:6808/119436","cluster_addr":"172.21.15.40:6809/119436","heartbeat_back_addr":"172.21.15.40:6811/119436","heartbeat_front_addr":"172.21.15.40:6810/119436","state":["exists","up"]},{"osd":2,"uuid":"7ba62ae5-d21e-4d56-b46c-ba7b718ede25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6800","nonce":119433}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6801","nonce":119433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6803","nonce":119433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6802","nonce":119433}]},"public_addr":"172.21.15.40:6800/119433","cluster_addr":"172.21.15.40:6801/119433","heartbeat_back_addr":"172.21.15.40:6803/119433","heartbeat_front_addr":"172.21.15.40:6802/119433","state":["exists","up"]},{"osd":3,"uuid":"c9c55985-8a90-4927-a8fa-6a1fcec1cd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6804","nonce":119432}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6805","nonce":119432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6807","nonce":119432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6806","nonce":119432}]},"public_addr":"172.21.15.40:6804/119432","cluster_addr":"172.21.15.40:6805/119432","heartbeat_back_addr":"172.21.15.40:6807/119432","heartbeat_front_addr":"172.21.15.40:6806/119432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.339829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.554690+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.641664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.320635+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:22:25.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.192+0000 7f2d03e1b700 1 -- 172.21.15.40:0/3387070072 >> v1:172.21.15.40:6816/118905 conn(0x7f2ce002bb60 legacy=0x7f2ce002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.192+0000 7f2d03e1b700 1 -- 172.21.15.40:0/3387070072 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cfc130650 msgr2=0x7f2cfc11a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.192+0000 7f2d03e1b700 1 --2- 172.21.15.40:0/3387070072 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cfc130650 0x7f2cfc11a730 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f2cfc0668c0 tx=0x7f2cf400b040).stop 2023-09-30T22:22:25.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.192+0000 7f2d03e1b700 1 -- 172.21.15.40:0/3387070072 shutdown_connections 2023-09-30T22:22:25.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.192+0000 7f2d03e1b700 1 --2- 172.21.15.40:0/3387070072 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2cfc098b10 0x7f2cfc13ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:25.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.192+0000 7f2d03e1b700 1 --2- 172.21.15.40:0/3387070072 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cfc130650 0x7f2cfc11a730 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:25.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.192+0000 7f2d03e1b700 1 --2- 172.21.15.40:0/3387070072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cfc098ef0 0x7f2cfc13b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:25.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.192+0000 7f2d03e1b700 1 -- 172.21.15.40:0/3387070072 >> 172.21.15.40:0/3387070072 conn(0x7f2cfc09ab30 msgr2=0x7f2cfc1144b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:25.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.192+0000 7f2d03e1b700 1 -- 172.21.15.40:0/3387070072 shutdown_connections 2023-09-30T22:22:25.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.192+0000 7f2d03e1b700 1 -- 172.21.15.40:0/3387070072 wait complete. 2023-09-30T22:22:25.205 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-09-30T22:21:54.875024+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:21:56.197012+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:22:00.759069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:22:01.327265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T22:22:25.205 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-09-30T22:22:25.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.327+0000 7f9744d43700 1 Processor -- start 2023-09-30T22:22:25.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.327+0000 7f9744d43700 1 -- start start 2023-09-30T22:22:25.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.328+0000 7f9744d43700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9740092430 0x7f9740067eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:25.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.328+0000 7f9744d43700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9740127590 0x7f9740097b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:25.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.328+0000 7f9744d43700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9740092810 con 0x7f9740123be0 2023-09-30T22:22:25.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.328+0000 7f9744d43700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9740068920 con 0x7f9740092430 2023-09-30T22:22:25.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.328+0000 7f9744d43700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9740069f80 con 0x7f9740127590 2023-09-30T22:22:25.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.328+0000 7f973ed9d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9740123be0 0x7f9740124090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53522/0 (socket says 172.21.15.40:53522) 2023-09-30T22:22:25.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.328+0000 7f973ed9d700 1 -- 172.21.15.40:0/1239677037 learned_addr learned my addr 172.21.15.40:0/1239677037 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:22:25.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.328+0000 7f973dd9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9740127590 0x7f9740097b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:25.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.328+0000 7f973e59c700 1 --2- 172.21.15.40:0/1239677037 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9740092430 0x7f9740067eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:25.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.329+0000 7f973e59c700 1 -- 172.21.15.40:0/1239677037 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9740127590 msgr2=0x7f9740097b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:25.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.329+0000 7f973e59c700 1 --2- 172.21.15.40:0/1239677037 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9740127590 0x7f9740097b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:25.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.329+0000 7f973e59c700 1 -- 172.21.15.40:0/1239677037 >> v1:172.21.15.40:6789/0 conn(0x7f9740123be0 legacy=0x7f9740124090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.329+0000 7f973d59a700 1 -- 172.21.15.40:0/1239677037 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 262654775 0 0) 0x7f9740092810 con 0x7f9740123be0 2023-09-30T22:22:25.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.329+0000 7f973e59c700 1 -- 172.21.15.40:0/1239677037 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9740127ad0 con 0x7f9740092430 2023-09-30T22:22:25.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.329+0000 7f973dd9b700 1 --2- 172.21.15.40:0/1239677037 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9740127590 0x7f9740097b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:25.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.329+0000 7f973e59c700 1 --2- 172.21.15.40:0/1239677037 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9740092430 0x7f9740067eb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f973000ba30 tx=0x7f973000b300).ready entity=mon.1 client_cookie=24d810bdb706785e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:25.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.329+0000 7f973d59a700 1 -- 172.21.15.40:0/1239677037 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973000da70 con 0x7f9740092430 2023-09-30T22:22:25.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.329+0000 7f973d59a700 1 -- 172.21.15.40:0/1239677037 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973000dbd0 con 0x7f9740092430 2023-09-30T22:22:25.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.329+0000 7f973d59a700 1 -- 172.21.15.40:0/1239677037 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9730010470 con 0x7f9740092430 2023-09-30T22:22:25.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.329+0000 7f9744d43700 1 -- 172.21.15.40:0/1239677037 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9740092430 msgr2=0x7f9740067eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.329+0000 7f9744d43700 1 --2- 172.21.15.40:0/1239677037 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9740092430 0x7f9740067eb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f973000ba30 tx=0x7f973000b300).stop 2023-09-30T22:22:25.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.329+0000 7f9744d43700 1 -- 172.21.15.40:0/1239677037 shutdown_connections 2023-09-30T22:22:25.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.329+0000 7f9744d43700 1 --2- 172.21.15.40:0/1239677037 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9740092430 0x7f9740067eb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:25.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.329+0000 7f9744d43700 1 --2- 172.21.15.40:0/1239677037 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9740127590 0x7f9740097b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:25.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.329+0000 7f9744d43700 1 -- 172.21.15.40:0/1239677037 >> 172.21.15.40:0/1239677037 conn(0x7f974005eb30 msgr2=0x7f974009a380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:25.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.330+0000 7f9744d43700 1 -- 172.21.15.40:0/1239677037 shutdown_connections 2023-09-30T22:22:25.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.330+0000 7f9744d43700 1 -- 172.21.15.40:0/1239677037 wait complete. 2023-09-30T22:22:25.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.330+0000 7f9744d43700 1 Processor -- start 2023-09-30T22:22:25.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.330+0000 7f9744d43700 1 -- start start 2023-09-30T22:22:25.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.331+0000 7f9744d43700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9740092430 0x7f97401109e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:25.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.331+0000 7f9744d43700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9740123be0 0x7f9740110ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:25.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.331+0000 7f9744d43700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9740127590 0x7f97401113c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:25.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.331+0000 7f9744d43700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97401118b0 con 0x7f9740092430 2023-09-30T22:22:25.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.331+0000 7f9744d43700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97400699b0 con 0x7f9740127590 2023-09-30T22:22:25.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.331+0000 7f9744d43700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9740113160 con 0x7f9740123be0 2023-09-30T22:22:25.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.331+0000 7f973e59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9740092430 0x7f97401109e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:25.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.331+0000 7f973e59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9740092430 0x7f97401109e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52012/0 (socket says 172.21.15.40:52012) 2023-09-30T22:22:25.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.331+0000 7f973e59c700 1 -- 172.21.15.40:0/1392665878 learned_addr learned my addr 172.21.15.40:0/1392665878 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:25.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.331+0000 7f973ed9d700 1 --2- 172.21.15.40:0/1392665878 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9740127590 0x7f97401113c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:25.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.331+0000 7f973dd9b700 1 --2- 172.21.15.40:0/1392665878 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9740123be0 0x7f9740110ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:25.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.331+0000 7f973e59c700 1 -- 172.21.15.40:0/1392665878 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9740123be0 msgr2=0x7f9740110ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.331+0000 7f973e59c700 1 --2- 172.21.15.40:0/1392665878 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9740123be0 0x7f9740110ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:25.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.331+0000 7f973e59c700 1 -- 172.21.15.40:0/1392665878 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9740127590 msgr2=0x7f97401113c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.331+0000 7f973e59c700 1 --2- 172.21.15.40:0/1392665878 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9740127590 0x7f97401113c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:25.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.331+0000 7f973e59c700 1 -- 172.21.15.40:0/1392665878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97340092a0 con 0x7f9740092430 2023-09-30T22:22:25.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.331+0000 7f973dd9b700 1 --2- 172.21.15.40:0/1392665878 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9740123be0 0x7f9740110ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:25.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.331+0000 7f973e59c700 1 --2- 172.21.15.40:0/1392665878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9740092430 0x7f97401109e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f9740068a60 tx=0x7f9740092330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:25.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.331+0000 7f972e7fc700 1 -- 172.21.15.40:0/1392665878 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9730006cf0 con 0x7f9740092430 2023-09-30T22:22:25.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.331+0000 7f972e7fc700 1 -- 172.21.15.40:0/1392665878 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9730019450 con 0x7f9740092430 2023-09-30T22:22:25.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.332+0000 7f9744d43700 1 -- 172.21.15.40:0/1392665878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f973000b540 con 0x7f9740092430 2023-09-30T22:22:25.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.332+0000 7f972e7fc700 1 -- 172.21.15.40:0/1392665878 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9730019810 con 0x7f9740092430 2023-09-30T22:22:25.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.332+0000 7f9744d43700 1 -- 172.21.15.40:0/1392665878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97401142b0 con 0x7f9740092430 2023-09-30T22:22:25.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.332+0000 7f972e7fc700 1 -- 172.21.15.40:0/1392665878 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f9730019c00 con 0x7f9740092430 2023-09-30T22:22:25.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.332+0000 7f972e7fc700 1 -- 172.21.15.40:0/1392665878 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f973003c660 con 0x7f9740092430 2023-09-30T22:22:25.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.333+0000 7f9744d43700 1 -- 172.21.15.40:0/1392665878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97401252a0 con 0x7f9740092430 2023-09-30T22:22:25.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.337+0000 7f972e7fc700 1 -- 172.21.15.40:0/1392665878 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f9730029080 con 0x7f9740092430 2023-09-30T22:22:25.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.502+0000 7f9744d43700 1 -- 172.21.15.40:0/1392665878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f97401132a0 con 0x7f9740092430 2023-09-30T22:22:25.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.502+0000 7f972e7fc700 1 -- 172.21.15.40:0/1392665878 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v18) v1 ==== 110+0+10 (secure 0 0 0) 0x7f973000f3d0 con 0x7f9740092430 2023-09-30T22:22:25.504 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-09-30T22:22:25.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.504+0000 7f9744d43700 1 -- 172.21.15.40:0/1392665878 >> v1:172.21.15.40:6816/118905 conn(0x7f972002bb60 legacy=0x7f972002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.504+0000 7f9744d43700 1 -- 172.21.15.40:0/1392665878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9740092430 msgr2=0x7f97401109e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.504+0000 7f9744d43700 1 --2- 172.21.15.40:0/1392665878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9740092430 0x7f97401109e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f9740068a60 tx=0x7f9740092330).stop 2023-09-30T22:22:25.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.504+0000 7f9744d43700 1 -- 172.21.15.40:0/1392665878 shutdown_connections 2023-09-30T22:22:25.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.504+0000 7f9744d43700 1 --2- 172.21.15.40:0/1392665878 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9740127590 0x7f97401113c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:25.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.504+0000 7f9744d43700 1 --2- 172.21.15.40:0/1392665878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9740092430 0x7f97401109e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:25.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.504+0000 7f9744d43700 1 --2- 172.21.15.40:0/1392665878 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9740123be0 0x7f9740110ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:25.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.504+0000 7f9744d43700 1 -- 172.21.15.40:0/1392665878 >> 172.21.15.40:0/1392665878 conn(0x7f974005eb30 msgr2=0x7f9740125b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:25.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.504+0000 7f9744d43700 1 -- 172.21.15.40:0/1392665878 shutdown_connections 2023-09-30T22:22:25.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.504+0000 7f9744d43700 1 -- 172.21.15.40:0/1392665878 wait complete. 2023-09-30T22:22:25.517 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:22:25.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.639+0000 7f307678d700 1 Processor -- start 2023-09-30T22:22:25.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.639+0000 7f307678d700 1 -- start start 2023-09-30T22:22:25.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.640+0000 7f307678d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30700657e0 0x7f3070096620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:25.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.640+0000 7f307678d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3070097220 0x7f3070132660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:25.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.640+0000 7f307678d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3070098350 con 0x7f3070097ec0 2023-09-30T22:22:25.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.640+0000 7f307678d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3070065bc0 con 0x7f3070097220 2023-09-30T22:22:25.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.640+0000 7f307678d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3070096350 con 0x7f30700657e0 2023-09-30T22:22:25.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.640+0000 7f306ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30700657e0 0x7f3070096620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:25.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.640+0000 7f306f7fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3070097ec0 0x7f3070096b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53536/0 (socket says 172.21.15.40:53536) 2023-09-30T22:22:25.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.640+0000 7f306f7fe700 1 -- 172.21.15.40:0/565815523 learned_addr learned my addr 172.21.15.40:0/565815523 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:22:25.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.640+0000 7f3074d2a700 1 --2- 172.21.15.40:0/565815523 >> v2:172.21.15.40:3300/0 conn(0x7f3070097220 0x7f3070132660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:25.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.640+0000 7f306ffff700 1 -- 172.21.15.40:0/565815523 >> v2:172.21.15.40:3300/0 conn(0x7f3070097220 msgr2=0x7f3070132660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:25.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.640+0000 7f306ffff700 1 --2- 172.21.15.40:0/565815523 >> v2:172.21.15.40:3300/0 conn(0x7f3070097220 0x7f3070132660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:25.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.640+0000 7f306effd700 1 -- 172.21.15.40:0/565815523 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3153526882 0 0) 0x7f3070098350 con 0x7f3070097ec0 2023-09-30T22:22:25.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.640+0000 7f306ffff700 1 -- 172.21.15.40:0/565815523 >> v1:172.21.15.40:6789/0 conn(0x7f3070097ec0 legacy=0x7f3070096b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.640+0000 7f306ffff700 1 -- 172.21.15.40:0/565815523 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30700662b0 con 0x7f30700657e0 2023-09-30T22:22:25.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.640+0000 7f306ffff700 1 --2- 172.21.15.40:0/565815523 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30700657e0 0x7f3070096620 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f3058009760 tx=0x7f3058009060).ready entity=mon.1 client_cookie=fc63d08d8896866d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:25.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.640+0000 7f306effd700 1 -- 172.21.15.40:0/565815523 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30580090d0 con 0x7f30700657e0 2023-09-30T22:22:25.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.641+0000 7f306effd700 1 -- 172.21.15.40:0/565815523 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305800f510 con 0x7f30700657e0 2023-09-30T22:22:25.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.641+0000 7f306effd700 1 -- 172.21.15.40:0/565815523 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305800f890 con 0x7f30700657e0 2023-09-30T22:22:25.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.641+0000 7f307678d700 1 -- 172.21.15.40:0/565815523 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30700657e0 msgr2=0x7f3070096620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.641+0000 7f307678d700 1 --2- 172.21.15.40:0/565815523 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30700657e0 0x7f3070096620 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f3058009760 tx=0x7f3058009060).stop 2023-09-30T22:22:25.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.641+0000 7f307678d700 1 -- 172.21.15.40:0/565815523 shutdown_connections 2023-09-30T22:22:25.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.641+0000 7f307678d700 1 --2- 172.21.15.40:0/565815523 >> v2:172.21.15.40:3300/0 conn(0x7f3070097220 0x7f3070132660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:25.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.641+0000 7f307678d700 1 --2- 172.21.15.40:0/565815523 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30700657e0 0x7f3070096620 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:25.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.641+0000 7f307678d700 1 -- 172.21.15.40:0/565815523 >> 172.21.15.40:0/565815523 conn(0x7f307009de50 msgr2=0x7f307009e260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:25.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.641+0000 7f307678d700 1 -- 172.21.15.40:0/565815523 shutdown_connections 2023-09-30T22:22:25.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.641+0000 7f307678d700 1 -- 172.21.15.40:0/565815523 wait complete. 2023-09-30T22:22:25.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.642+0000 7f307678d700 1 Processor -- start 2023-09-30T22:22:25.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.642+0000 7f307678d700 1 -- start start 2023-09-30T22:22:25.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.643+0000 7f307678d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f30700657e0 0x7f307011a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:25.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.643+0000 7f307678d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3070097220 0x7f307011a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:25.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.643+0000 7f307678d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f307011ad20 0x7f307011b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:25.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.643+0000 7f307678d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3070132510 con 0x7f307011ad20 2023-09-30T22:22:25.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.643+0000 7f307678d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f307011ca00 con 0x7f3070097220 2023-09-30T22:22:25.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.643+0000 7f307678d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3070099d70 con 0x7f30700657e0 2023-09-30T22:22:25.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.643+0000 7f3074d2a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f307011ad20 0x7f307011b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:25.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.643+0000 7f306f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3070097220 0x7f307011a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:25.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.643+0000 7f3074d2a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f307011ad20 0x7f307011b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52038/0 (socket says 172.21.15.40:52038) 2023-09-30T22:22:25.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.643+0000 7f306ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f30700657e0 0x7f307011a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:25.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.643+0000 7f3074d2a700 1 -- 172.21.15.40:0/2631282523 learned_addr learned my addr 172.21.15.40:0/2631282523 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:25.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.643+0000 7f3074d2a700 1 -- 172.21.15.40:0/2631282523 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f30700657e0 msgr2=0x7f307011a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.643+0000 7f3074d2a700 1 --2- 172.21.15.40:0/2631282523 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f30700657e0 0x7f307011a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:25.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.643+0000 7f3074d2a700 1 -- 172.21.15.40:0/2631282523 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3070097220 msgr2=0x7f307011a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.643+0000 7f3074d2a700 1 --2- 172.21.15.40:0/2631282523 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3070097220 0x7f307011a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:25.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.643+0000 7f3074d2a700 1 -- 172.21.15.40:0/2631282523 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30580092a0 con 0x7f307011ad20 2023-09-30T22:22:25.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.643+0000 7f306f7fe700 1 --2- 172.21.15.40:0/2631282523 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3070097220 0x7f307011a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:25.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.643+0000 7f3074d2a700 1 --2- 172.21.15.40:0/2631282523 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f307011ad20 0x7f307011b160 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f3068009e90 tx=0x7f306800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:25.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.643+0000 7f3067fff700 1 -- 172.21.15.40:0/2631282523 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306800caa0 con 0x7f307011ad20 2023-09-30T22:22:25.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.643+0000 7f3067fff700 1 -- 172.21.15.40:0/2631282523 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306800f040 con 0x7f307011ad20 2023-09-30T22:22:25.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.643+0000 7f307678d700 1 -- 172.21.15.40:0/2631282523 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f307011de70 con 0x7f307011ad20 2023-09-30T22:22:25.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.643+0000 7f3067fff700 1 -- 172.21.15.40:0/2631282523 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306800ce10 con 0x7f307011ad20 2023-09-30T22:22:25.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.643+0000 7f307678d700 1 -- 172.21.15.40:0/2631282523 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f307011e550 con 0x7f307011ad20 2023-09-30T22:22:25.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.644+0000 7f3067fff700 1 -- 172.21.15.40:0/2631282523 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f3068013610 con 0x7f307011ad20 2023-09-30T22:22:25.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.644+0000 7f3067fff700 1 -- 172.21.15.40:0/2631282523 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f306803b7c0 con 0x7f307011ad20 2023-09-30T22:22:25.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.644+0000 7f307678d700 1 -- 172.21.15.40:0/2631282523 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f307011b810 con 0x7f307011ad20 2023-09-30T22:22:25.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.649+0000 7f3067fff700 1 -- 172.21.15.40:0/2631282523 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f306801d460 con 0x7f307011ad20 2023-09-30T22:22:25.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.813+0000 7f307678d700 1 -- 172.21.15.40:0/2631282523 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f307005a260 con 0x7f307011ad20 2023-09-30T22:22:25.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.813+0000 7f3067fff700 1 -- 172.21.15.40:0/2631282523 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7f306802b0a0 con 0x7f307011ad20 2023-09-30T22:22:25.814 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-09-30T22:22:25.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.815+0000 7f307678d700 1 -- 172.21.15.40:0/2631282523 >> v1:172.21.15.40:6816/118905 conn(0x7f305002bb60 legacy=0x7f305002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.815+0000 7f307678d700 1 -- 172.21.15.40:0/2631282523 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f307011ad20 msgr2=0x7f307011b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.815+0000 7f307678d700 1 --2- 172.21.15.40:0/2631282523 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f307011ad20 0x7f307011b160 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f3068009e90 tx=0x7f306800b040).stop 2023-09-30T22:22:25.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.815+0000 7f307678d700 1 -- 172.21.15.40:0/2631282523 shutdown_connections 2023-09-30T22:22:25.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.815+0000 7f307678d700 1 --2- 172.21.15.40:0/2631282523 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f30700657e0 0x7f307011a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:25.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.815+0000 7f307678d700 1 --2- 172.21.15.40:0/2631282523 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f307011ad20 0x7f307011b160 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:25.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.815+0000 7f307678d700 1 --2- 172.21.15.40:0/2631282523 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3070097220 0x7f307011a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:25.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.815+0000 7f307678d700 1 -- 172.21.15.40:0/2631282523 >> 172.21.15.40:0/2631282523 conn(0x7f307009de50 msgr2=0x7f307009bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:25.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.815+0000 7f307678d700 1 -- 172.21.15.40:0/2631282523 shutdown_connections 2023-09-30T22:22:25.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.815+0000 7f307678d700 1 -- 172.21.15.40:0/2631282523 wait complete. 2023-09-30T22:22:25.828 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:22:25.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.950+0000 7f2c7d07e700 1 Processor -- start 2023-09-30T22:22:25.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.950+0000 7f2c7d07e700 1 -- start start 2023-09-30T22:22:25.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.951+0000 7f2c7d07e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c78065140 0x7f2c78096640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:25.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.951+0000 7f2c7d07e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c78096f50 0x7f2c78133000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:25.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.951+0000 7f2c7d07e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c78064940 con 0x7f2c78096b30 2023-09-30T22:22:25.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.951+0000 7f2c7d07e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c78092c90 con 0x7f2c78065140 2023-09-30T22:22:25.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.951+0000 7f2c7d07e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c78098490 con 0x7f2c78096f50 2023-09-30T22:22:25.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.951+0000 7f2c7759e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c78096f50 0x7f2c78133000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:25.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.951+0000 7f2c7659c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2c78096b30 0x7f2c7812f8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53546/0 (socket says 172.21.15.40:53546) 2023-09-30T22:22:25.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.951+0000 7f2c7659c700 1 -- 172.21.15.40:0/4276957017 learned_addr learned my addr 172.21.15.40:0/4276957017 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:22:25.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.951+0000 7f2c76d9d700 1 --2- 172.21.15.40:0/4276957017 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c78065140 0x7f2c78096640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:25.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.951+0000 7f2c75d9b700 1 -- 172.21.15.40:0/4276957017 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 929604933 0 0) 0x7f2c78064940 con 0x7f2c78096b30 2023-09-30T22:22:25.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.951+0000 7f2c76d9d700 1 -- 172.21.15.40:0/4276957017 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c78096f50 msgr2=0x7f2c78133000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:25.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.951+0000 7f2c76d9d700 1 --2- 172.21.15.40:0/4276957017 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c78096f50 0x7f2c78133000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:25.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.951+0000 7f2c76d9d700 1 -- 172.21.15.40:0/4276957017 >> v1:172.21.15.40:6789/0 conn(0x7f2c78096b30 legacy=0x7f2c7812f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.951+0000 7f2c76d9d700 1 -- 172.21.15.40:0/4276957017 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c78092ed0 con 0x7f2c78065140 2023-09-30T22:22:25.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.952+0000 7f2c7759e700 1 --2- 172.21.15.40:0/4276957017 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c78096f50 0x7f2c78133000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:25.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.952+0000 7f2c76d9d700 1 --2- 172.21.15.40:0/4276957017 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c78065140 0x7f2c78096640 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f2c6c009790 tx=0x7f2c6c009060).ready entity=mon.1 client_cookie=85b9d8fac1c33c9f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:25.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.952+0000 7f2c75d9b700 1 -- 172.21.15.40:0/4276957017 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c00f510 con 0x7f2c78065140 2023-09-30T22:22:25.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.952+0000 7f2c75d9b700 1 -- 172.21.15.40:0/4276957017 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6c00f670 con 0x7f2c78065140 2023-09-30T22:22:25.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.952+0000 7f2c75d9b700 1 -- 172.21.15.40:0/4276957017 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c00f9f0 con 0x7f2c78065140 2023-09-30T22:22:25.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.952+0000 7f2c7d07e700 1 -- 172.21.15.40:0/4276957017 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c78065140 msgr2=0x7f2c78096640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.952+0000 7f2c7d07e700 1 --2- 172.21.15.40:0/4276957017 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c78065140 0x7f2c78096640 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f2c6c009790 tx=0x7f2c6c009060).stop 2023-09-30T22:22:25.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.952+0000 7f2c7d07e700 1 -- 172.21.15.40:0/4276957017 shutdown_connections 2023-09-30T22:22:25.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.952+0000 7f2c7d07e700 1 --2- 172.21.15.40:0/4276957017 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c78096f50 0x7f2c78133000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:25.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.952+0000 7f2c7d07e700 1 --2- 172.21.15.40:0/4276957017 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c78065140 0x7f2c78096640 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:25.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.952+0000 7f2c7d07e700 1 -- 172.21.15.40:0/4276957017 >> 172.21.15.40:0/4276957017 conn(0x7f2c7809bcf0 msgr2=0x7f2c7809c100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:25.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.952+0000 7f2c7d07e700 1 -- 172.21.15.40:0/4276957017 shutdown_connections 2023-09-30T22:22:25.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.952+0000 7f2c7d07e700 1 -- 172.21.15.40:0/4276957017 wait complete. 2023-09-30T22:22:25.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.954+0000 7f2c7d07e700 1 Processor -- start 2023-09-30T22:22:25.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.954+0000 7f2c7d07e700 1 -- start start 2023-09-30T22:22:25.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.954+0000 7f2c7d07e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c78065140 0x7f2c7813a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:25.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.954+0000 7f2c7d07e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c78096b30 0x7f2c7813aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:25.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.954+0000 7f2c7d07e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c78096f50 0x7f2c7813afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:25.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.954+0000 7f2c7d07e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7811e370 con 0x7f2c78096b30 2023-09-30T22:22:25.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.954+0000 7f2c7d07e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c78097c90 con 0x7f2c78096f50 2023-09-30T22:22:25.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.954+0000 7f2c7d07e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c78093310 con 0x7f2c78065140 2023-09-30T22:22:25.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.954+0000 7f2c76d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c78065140 0x7f2c7813a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:25.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.954+0000 7f2c7659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c78096b30 0x7f2c7813aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:25.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.955+0000 7f2c76d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c78065140 0x7f2c7813a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:50484/0 (socket says 172.21.15.40:50484) 2023-09-30T22:22:25.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.955+0000 7f2c76d9d700 1 -- 172.21.15.40:0/3340101471 learned_addr learned my addr 172.21.15.40:0/3340101471 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:25.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.955+0000 7f2c7759e700 1 --2- 172.21.15.40:0/3340101471 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c78096f50 0x7f2c7813afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:25.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.955+0000 7f2c76d9d700 1 -- 172.21.15.40:0/3340101471 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c78096f50 msgr2=0x7f2c7813afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.955+0000 7f2c76d9d700 1 --2- 172.21.15.40:0/3340101471 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c78096f50 0x7f2c7813afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:25.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.955+0000 7f2c76d9d700 1 -- 172.21.15.40:0/3340101471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c78096b30 msgr2=0x7f2c7813aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.955+0000 7f2c76d9d700 1 --2- 172.21.15.40:0/3340101471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c78096b30 0x7f2c7813aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:25.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.955+0000 7f2c76d9d700 1 -- 172.21.15.40:0/3340101471 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c70009a20 con 0x7f2c78065140 2023-09-30T22:22:25.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.955+0000 7f2c7659c700 1 --2- 172.21.15.40:0/3340101471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c78096b30 0x7f2c7813aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:25.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.955+0000 7f2c76d9d700 1 --2- 172.21.15.40:0/3340101471 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c78065140 0x7f2c7813a600 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f2c6c00f610 tx=0x7f2c6c017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:25.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.955+0000 7f2c5effd700 1 -- 172.21.15.40:0/3340101471 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c00f7e0 con 0x7f2c78065140 2023-09-30T22:22:25.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.955+0000 7f2c5effd700 1 -- 172.21.15.40:0/3340101471 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6c00f940 con 0x7f2c78065140 2023-09-30T22:22:25.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.955+0000 7f2c7d07e700 1 -- 172.21.15.40:0/3340101471 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c6c0092a0 con 0x7f2c78065140 2023-09-30T22:22:25.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.955+0000 7f2c5effd700 1 -- 172.21.15.40:0/3340101471 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c01b660 con 0x7f2c78065140 2023-09-30T22:22:25.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.955+0000 7f2c7d07e700 1 -- 172.21.15.40:0/3340101471 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c7811eb80 con 0x7f2c78065140 2023-09-30T22:22:25.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.956+0000 7f2c5effd700 1 -- 172.21.15.40:0/3340101471 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f2c6c01ba10 con 0x7f2c78065140 2023-09-30T22:22:25.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.956+0000 7f2c5effd700 1 -- 172.21.15.40:0/3340101471 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f2c6c03c820 con 0x7f2c78065140 2023-09-30T22:22:25.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.956+0000 7f2c7d07e700 1 -- 172.21.15.40:0/3340101471 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c7811eb80 con 0x7f2c78065140 2023-09-30T22:22:25.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:25.961+0000 7f2c5effd700 1 -- 172.21.15.40:0/3340101471 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f2c7811eb80 con 0x7f2c78065140 2023-09-30T22:22:26.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.128+0000 7f2c7d07e700 1 -- 172.21.15.40:0/3340101471 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2c7811eb80 con 0x7f2c78065140 2023-09-30T22:22:26.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.128+0000 7f2c5effd700 1 -- 172.21.15.40:0/3340101471 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v18) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2c7811eb80 con 0x7f2c78065140 2023-09-30T22:22:26.129 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-09-30T22:22:26.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.130+0000 7f2c7d07e700 1 -- 172.21.15.40:0/3340101471 >> v1:172.21.15.40:6816/118905 conn(0x7f2c6402bb60 legacy=0x7f2c6402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.130+0000 7f2c7d07e700 1 -- 172.21.15.40:0/3340101471 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c78065140 msgr2=0x7f2c7813a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.130+0000 7f2c7d07e700 1 --2- 172.21.15.40:0/3340101471 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c78065140 0x7f2c7813a600 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f2c6c00f610 tx=0x7f2c6c017000).stop 2023-09-30T22:22:26.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.130+0000 7f2c7d07e700 1 -- 172.21.15.40:0/3340101471 shutdown_connections 2023-09-30T22:22:26.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.130+0000 7f2c7d07e700 1 --2- 172.21.15.40:0/3340101471 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c78065140 0x7f2c7813a600 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:26.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.130+0000 7f2c7d07e700 1 --2- 172.21.15.40:0/3340101471 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c78096f50 0x7f2c7813afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:26.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.130+0000 7f2c7d07e700 1 --2- 172.21.15.40:0/3340101471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c78096b30 0x7f2c7813aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:26.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.130+0000 7f2c7d07e700 1 -- 172.21.15.40:0/3340101471 >> 172.21.15.40:0/3340101471 conn(0x7f2c7809bcf0 msgr2=0x7f2c7809a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:26.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.130+0000 7f2c7d07e700 1 -- 172.21.15.40:0/3340101471 shutdown_connections 2023-09-30T22:22:26.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.130+0000 7f2c7d07e700 1 -- 172.21.15.40:0/3340101471 wait complete. 2023-09-30T22:22:26.142 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:22:26.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.265+0000 7f9b9086e700 1 Processor -- start 2023-09-30T22:22:26.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.265+0000 7f9b9086e700 1 -- start start 2023-09-30T22:22:26.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.266+0000 7f9b9086e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9b8c092430 0x7f9b8c067eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:26.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.266+0000 7f9b9086e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b8c127590 0x7f9b8c097b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:26.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.266+0000 7f9b9086e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b8c092810 con 0x7f9b8c123be0 2023-09-30T22:22:26.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.266+0000 7f9b9086e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b8c068920 con 0x7f9b8c092430 2023-09-30T22:22:26.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.266+0000 7f9b9086e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8c069f80 con 0x7f9b8c127590 2023-09-30T22:22:26.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.266+0000 7f9b8a59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9b8c092430 0x7f9b8c067eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:26.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.266+0000 7f9b81d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b8c127590 0x7f9b8c097b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:26.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.266+0000 7f9b8ad9d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9b8c123be0 0x7f9b8c124050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53554/0 (socket says 172.21.15.40:53554) 2023-09-30T22:22:26.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.266+0000 7f9b8ad9d700 1 -- 172.21.15.40:0/252899346 learned_addr learned my addr 172.21.15.40:0/252899346 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:22:26.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.266+0000 7f9b8a59c700 1 -- 172.21.15.40:0/252899346 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b8c127590 msgr2=0x7f9b8c097b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:26.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.266+0000 7f9b8a59c700 1 --2- 172.21.15.40:0/252899346 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b8c127590 0x7f9b8c097b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:26.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.266+0000 7f9b8a59c700 1 -- 172.21.15.40:0/252899346 >> v1:172.21.15.40:6789/0 conn(0x7f9b8c123be0 legacy=0x7f9b8c124050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.267+0000 7f9b8a59c700 1 -- 172.21.15.40:0/252899346 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8c127ad0 con 0x7f9b8c092430 2023-09-30T22:22:26.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.267+0000 7f9b89d9b700 1 -- 172.21.15.40:0/252899346 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4240855035 0 0) 0x7f9b8c092810 con 0x7f9b8c123be0 2023-09-30T22:22:26.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.267+0000 7f9b81d9b700 1 --2- 172.21.15.40:0/252899346 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b8c127590 0x7f9b8c097b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:26.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.267+0000 7f9b8a59c700 1 --2- 172.21.15.40:0/252899346 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b8c092430 0x7f9b8c067eb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f9b7c009760 tx=0x7f9b7c009060).ready entity=mon.0 client_cookie=5a573da741c5ec2f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:26.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.267+0000 7f9b89d9b700 1 -- 172.21.15.40:0/252899346 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c00f510 con 0x7f9b8c092430 2023-09-30T22:22:26.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.267+0000 7f9b89d9b700 1 -- 172.21.15.40:0/252899346 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7c00f670 con 0x7f9b8c092430 2023-09-30T22:22:26.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.267+0000 7f9b89d9b700 1 -- 172.21.15.40:0/252899346 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c00f9f0 con 0x7f9b8c092430 2023-09-30T22:22:26.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.267+0000 7f9b9086e700 1 -- 172.21.15.40:0/252899346 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b8c092430 msgr2=0x7f9b8c067eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.267+0000 7f9b9086e700 1 --2- 172.21.15.40:0/252899346 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b8c092430 0x7f9b8c067eb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f9b7c009760 tx=0x7f9b7c009060).stop 2023-09-30T22:22:26.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.267+0000 7f9b9086e700 1 -- 172.21.15.40:0/252899346 shutdown_connections 2023-09-30T22:22:26.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.267+0000 7f9b9086e700 1 --2- 172.21.15.40:0/252899346 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b8c092430 0x7f9b8c067eb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:26.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.267+0000 7f9b9086e700 1 --2- 172.21.15.40:0/252899346 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b8c127590 0x7f9b8c097b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:26.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.267+0000 7f9b9086e700 1 -- 172.21.15.40:0/252899346 >> 172.21.15.40:0/252899346 conn(0x7f9b8c05eb30 msgr2=0x7f9b8c09a380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:26.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.267+0000 7f9b9086e700 1 -- 172.21.15.40:0/252899346 shutdown_connections 2023-09-30T22:22:26.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.267+0000 7f9b9086e700 1 -- 172.21.15.40:0/252899346 wait complete. 2023-09-30T22:22:26.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.268+0000 7f9b9086e700 1 Processor -- start 2023-09-30T22:22:26.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.268+0000 7f9b9086e700 1 -- start start 2023-09-30T22:22:26.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.269+0000 7f9b9086e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b8c092430 0x7f9b8c110a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:26.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.269+0000 7f9b9086e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b8c123be0 0x7f9b8c110f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:26.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.269+0000 7f9b9086e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b8c127590 0x7f9b8c111450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:26.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.269+0000 7f9b9086e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8c112ed0 con 0x7f9b8c127590 2023-09-30T22:22:26.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.269+0000 7f9b9086e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8c1150f0 con 0x7f9b8c092430 2023-09-30T22:22:26.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.269+0000 7f9b9086e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8c0699b0 con 0x7f9b8c123be0 2023-09-30T22:22:26.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.269+0000 7f9b8a59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b8c092430 0x7f9b8c110a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:26.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.269+0000 7f9b8ad9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b8c127590 0x7f9b8c111450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:26.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.269+0000 7f9b8a59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b8c092430 0x7f9b8c110a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:55152/0 (socket says 172.21.15.40:55152) 2023-09-30T22:22:26.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.269+0000 7f9b8a59c700 1 -- 172.21.15.40:0/2708384843 learned_addr learned my addr 172.21.15.40:0/2708384843 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:26.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.269+0000 7f9b81d9b700 1 --2- 172.21.15.40:0/2708384843 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b8c123be0 0x7f9b8c110f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:26.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.269+0000 7f9b8a59c700 1 -- 172.21.15.40:0/2708384843 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b8c123be0 msgr2=0x7f9b8c110f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.269+0000 7f9b8a59c700 1 --2- 172.21.15.40:0/2708384843 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b8c123be0 0x7f9b8c110f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:26.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.269+0000 7f9b8a59c700 1 -- 172.21.15.40:0/2708384843 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b8c127590 msgr2=0x7f9b8c111450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.269+0000 7f9b8a59c700 1 --2- 172.21.15.40:0/2708384843 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b8c127590 0x7f9b8c111450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:26.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.269+0000 7f9b8a59c700 1 -- 172.21.15.40:0/2708384843 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b740092a0 con 0x7f9b8c092430 2023-09-30T22:22:26.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.269+0000 7f9b8ad9d700 1 --2- 172.21.15.40:0/2708384843 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b8c127590 0x7f9b8c111450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:26.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.269+0000 7f9b8a59c700 1 --2- 172.21.15.40:0/2708384843 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b8c092430 0x7f9b8c110a70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f9b7c009e00 tx=0x7f9b7c017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:26.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.270+0000 7f9b82ffd700 1 -- 172.21.15.40:0/2708384843 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c00f7e0 con 0x7f9b8c092430 2023-09-30T22:22:26.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.270+0000 7f9b82ffd700 1 -- 172.21.15.40:0/2708384843 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7c00f940 con 0x7f9b8c092430 2023-09-30T22:22:26.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.270+0000 7f9b9086e700 1 -- 172.21.15.40:0/2708384843 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b7c0092a0 con 0x7f9b8c092430 2023-09-30T22:22:26.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.270+0000 7f9b82ffd700 1 -- 172.21.15.40:0/2708384843 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c01b660 con 0x7f9b8c092430 2023-09-30T22:22:26.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.270+0000 7f9b9086e700 1 -- 172.21.15.40:0/2708384843 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b8c114230 con 0x7f9b8c092430 2023-09-30T22:22:26.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.270+0000 7f9b82ffd700 1 -- 172.21.15.40:0/2708384843 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f9b7c01ba50 con 0x7f9b8c092430 2023-09-30T22:22:26.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.270+0000 7f9b82ffd700 1 -- 172.21.15.40:0/2708384843 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f9b7c03c870 con 0x7f9b8c092430 2023-09-30T22:22:26.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.271+0000 7f9b9086e700 1 -- 172.21.15.40:0/2708384843 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b8c112660 con 0x7f9b8c092430 2023-09-30T22:22:26.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.275+0000 7f9b82ffd700 1 -- 172.21.15.40:0/2708384843 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f9b7c029080 con 0x7f9b8c092430 2023-09-30T22:22:26.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.446+0000 7f9b9086e700 1 -- 172.21.15.40:0/2708384843 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9b8c05a260 con 0x7f9b8c092430 2023-09-30T22:22:26.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.446+0000 7f9b82ffd700 1 -- 172.21.15.40:0/2708384843 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v18) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9b7c01f020 con 0x7f9b8c092430 2023-09-30T22:22:26.447 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-09-30T22:22:26.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.448+0000 7f9b9086e700 1 -- 172.21.15.40:0/2708384843 >> v1:172.21.15.40:6816/118905 conn(0x7f9b6c02bb60 legacy=0x7f9b6c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.448+0000 7f9b9086e700 1 -- 172.21.15.40:0/2708384843 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b8c092430 msgr2=0x7f9b8c110a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.448+0000 7f9b9086e700 1 --2- 172.21.15.40:0/2708384843 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b8c092430 0x7f9b8c110a70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f9b7c009e00 tx=0x7f9b7c017000).stop 2023-09-30T22:22:26.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.448+0000 7f9b9086e700 1 -- 172.21.15.40:0/2708384843 shutdown_connections 2023-09-30T22:22:26.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.448+0000 7f9b9086e700 1 --2- 172.21.15.40:0/2708384843 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b8c127590 0x7f9b8c111450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:26.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.448+0000 7f9b9086e700 1 --2- 172.21.15.40:0/2708384843 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b8c092430 0x7f9b8c110a70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:26.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.448+0000 7f9b9086e700 1 --2- 172.21.15.40:0/2708384843 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b8c123be0 0x7f9b8c110f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:26.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.448+0000 7f9b9086e700 1 -- 172.21.15.40:0/2708384843 >> 172.21.15.40:0/2708384843 conn(0x7f9b8c05eb30 msgr2=0x7f9b8c065e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:26.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.448+0000 7f9b9086e700 1 -- 172.21.15.40:0/2708384843 shutdown_connections 2023-09-30T22:22:26.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.448+0000 7f9b9086e700 1 -- 172.21.15.40:0/2708384843 wait complete. 2023-09-30T22:22:26.460 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:22:26.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.580+0000 7f2394be6700 1 Processor -- start 2023-09-30T22:22:26.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.580+0000 7f2394be6700 1 -- start start 2023-09-30T22:22:26.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.580+0000 7f2394be6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2390096160 0x7f2390099600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:26.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.580+0000 7f2394be6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2390130650 0x7f2390132a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:26.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.580+0000 7f2394be6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2390098910 con 0x7f2390098b10 2023-09-30T22:22:26.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.580+0000 7f2394be6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2390096560 con 0x7f2390096160 2023-09-30T22:22:26.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.580+0000 7f2394be6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2390065e40 con 0x7f2390130650 2023-09-30T22:22:26.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.580+0000 7f238ed9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2390130650 0x7f2390132a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:26.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.580+0000 7f238dd9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2390096160 0x7f2390099600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:26.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.580+0000 7f238ed9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2390130650 0x7f2390132a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:55162/0 (socket says 172.21.15.40:55162) 2023-09-30T22:22:26.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.580+0000 7f238dd9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2390096160 0x7f2390099600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52068/0 (socket says 172.21.15.40:52068) 2023-09-30T22:22:26.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.580+0000 7f238ed9d700 1 -- 172.21.15.40:0/4203933744 learned_addr learned my addr 172.21.15.40:0/4203933744 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:26.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.580+0000 7f238e59c700 1 --1- 172.21.15.40:0/4203933744 >> v1:172.21.15.40:6789/0 conn(0x7f2390098b10 0x7f2390098ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53568/0 (socket says 172.21.15.40:53568) 2023-09-30T22:22:26.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.581+0000 7f238ed9d700 1 -- 172.21.15.40:0/4203933744 >> v2:172.21.15.40:3300/0 conn(0x7f2390096160 msgr2=0x7f2390099600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:26.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.581+0000 7f238ed9d700 1 --2- 172.21.15.40:0/4203933744 >> v2:172.21.15.40:3300/0 conn(0x7f2390096160 0x7f2390099600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:26.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.581+0000 7f238ed9d700 1 -- 172.21.15.40:0/4203933744 >> v1:172.21.15.40:6789/0 conn(0x7f2390098b10 legacy=0x7f2390098ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.581+0000 7f238ed9d700 1 -- 172.21.15.40:0/4203933744 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23900955c0 con 0x7f2390130650 2023-09-30T22:22:26.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.581+0000 7f238dd9b700 1 --2- 172.21.15.40:0/4203933744 >> v2:172.21.15.40:3300/0 conn(0x7f2390096160 0x7f2390099600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:26.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.581+0000 7f238ed9d700 1 --2- 172.21.15.40:0/4203933744 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2390130650 0x7f2390132a40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f2388009f20 tx=0x7f2388009840).ready entity=mon.1 client_cookie=e827a3c3e44662ed server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:26.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.581+0000 7f238d59a700 1 -- 172.21.15.40:0/4203933744 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238800e070 con 0x7f2390130650 2023-09-30T22:22:26.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.581+0000 7f238d59a700 1 -- 172.21.15.40:0/4203933744 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238800b9d0 con 0x7f2390130650 2023-09-30T22:22:26.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.581+0000 7f238d59a700 1 -- 172.21.15.40:0/4203933744 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238800bd50 con 0x7f2390130650 2023-09-30T22:22:26.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.581+0000 7f2394be6700 1 -- 172.21.15.40:0/4203933744 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2390130650 msgr2=0x7f2390132a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.581+0000 7f2394be6700 1 --2- 172.21.15.40:0/4203933744 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2390130650 0x7f2390132a40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f2388009f20 tx=0x7f2388009840).stop 2023-09-30T22:22:26.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.582+0000 7f2394be6700 1 -- 172.21.15.40:0/4203933744 shutdown_connections 2023-09-30T22:22:26.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.582+0000 7f2394be6700 1 --2- 172.21.15.40:0/4203933744 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2390130650 0x7f2390132a40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:26.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.582+0000 7f2394be6700 1 --2- 172.21.15.40:0/4203933744 >> v2:172.21.15.40:3300/0 conn(0x7f2390096160 0x7f2390099600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:26.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.582+0000 7f2394be6700 1 -- 172.21.15.40:0/4203933744 >> 172.21.15.40:0/4203933744 conn(0x7f239009ab30 msgr2=0x7f239009af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:26.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.582+0000 7f2394be6700 1 -- 172.21.15.40:0/4203933744 shutdown_connections 2023-09-30T22:22:26.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.582+0000 7f2394be6700 1 -- 172.21.15.40:0/4203933744 wait complete. 2023-09-30T22:22:26.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.582+0000 7f2394be6700 1 Processor -- start 2023-09-30T22:22:26.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.582+0000 7f2394be6700 1 -- start start 2023-09-30T22:22:26.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.583+0000 7f2394be6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2390096160 0x7f239011e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:26.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.583+0000 7f2394be6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2390098b10 0x7f239011a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:26.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.583+0000 7f2394be6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2390130650 0x7f239011a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:26.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.583+0000 7f2394be6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2390099de0 con 0x7f2390098b10 2023-09-30T22:22:26.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.583+0000 7f2394be6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f239011bfb0 con 0x7f2390096160 2023-09-30T22:22:26.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.583+0000 7f2394be6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2390094bd0 con 0x7f2390130650 2023-09-30T22:22:26.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.583+0000 7f238e59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2390096160 0x7f239011e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:26.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.583+0000 7f238e59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2390096160 0x7f239011e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:55176/0 (socket says 172.21.15.40:55176) 2023-09-30T22:22:26.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.583+0000 7f238e59c700 1 -- 172.21.15.40:0/68734904 learned_addr learned my addr 172.21.15.40:0/68734904 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:26.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.583+0000 7f238dd9b700 1 --2- 172.21.15.40:0/68734904 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2390098b10 0x7f239011a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:26.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.583+0000 7f238ed9d700 1 --2- 172.21.15.40:0/68734904 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2390130650 0x7f239011a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:26.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.583+0000 7f238dd9b700 1 -- 172.21.15.40:0/68734904 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2390130650 msgr2=0x7f239011a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.583+0000 7f238dd9b700 1 --2- 172.21.15.40:0/68734904 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2390130650 0x7f239011a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:26.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.583+0000 7f238dd9b700 1 -- 172.21.15.40:0/68734904 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2390096160 msgr2=0x7f239011e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.583+0000 7f238dd9b700 1 --2- 172.21.15.40:0/68734904 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2390096160 0x7f239011e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:26.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.583+0000 7f238dd9b700 1 -- 172.21.15.40:0/68734904 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23800092a0 con 0x7f2390098b10 2023-09-30T22:22:26.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.583+0000 7f238dd9b700 1 --2- 172.21.15.40:0/68734904 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2390098b10 0x7f239011a400 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f238000e980 tx=0x7f2380009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:26.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.584+0000 7f237e7fc700 1 -- 172.21.15.40:0/68734904 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2380012600 con 0x7f2390098b10 2023-09-30T22:22:26.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.584+0000 7f237e7fc700 1 -- 172.21.15.40:0/68734904 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2380012760 con 0x7f2390098b10 2023-09-30T22:22:26.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.584+0000 7f2394be6700 1 -- 172.21.15.40:0/68734904 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2388009ae0 con 0x7f2390098b10 2023-09-30T22:22:26.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.584+0000 7f237e7fc700 1 -- 172.21.15.40:0/68734904 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2380012ae0 con 0x7f2390098b10 2023-09-30T22:22:26.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.584+0000 7f2394be6700 1 -- 172.21.15.40:0/68734904 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f239011d460 con 0x7f2390098b10 2023-09-30T22:22:26.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.584+0000 7f237e7fc700 1 -- 172.21.15.40:0/68734904 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f238001b400 con 0x7f2390098b10 2023-09-30T22:22:26.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.585+0000 7f237e7fc700 1 -- 172.21.15.40:0/68734904 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f238003b400 con 0x7f2390098b10 2023-09-30T22:22:26.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.585+0000 7f2394be6700 1 -- 172.21.15.40:0/68734904 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f239011d8f0 con 0x7f2390098b10 2023-09-30T22:22:26.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.589+0000 7f237e7fc700 1 -- 172.21.15.40:0/68734904 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f2380016070 con 0x7f2390098b10 2023-09-30T22:22:26.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.795+0000 7f2394be6700 1 -- 172.21.15.40:0/68734904 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f239011d6b0 con 0x7f2390098b10 2023-09-30T22:22:26.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.796+0000 7f237e7fc700 1 -- 172.21.15.40:0/68734904 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2156 (secure 0 0 0) 0x7f2380016020 con 0x7f2390098b10 2023-09-30T22:22:26.796 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:22:26.797 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:22:02.347538+0000","modified":"2023-09-30T22:22:05.356644+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4194},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4194":{"gid":4194,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6817/2392027806","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6817","nonce":2392027806}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-30T22:22:26.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.798+0000 7f2394be6700 1 -- 172.21.15.40:0/68734904 >> v1:172.21.15.40:6816/118905 conn(0x7f237002bb60 legacy=0x7f237002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.798+0000 7f2394be6700 1 -- 172.21.15.40:0/68734904 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2390098b10 msgr2=0x7f239011a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.798+0000 7f2394be6700 1 --2- 172.21.15.40:0/68734904 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2390098b10 0x7f239011a400 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f238000e980 tx=0x7f2380009060).stop 2023-09-30T22:22:26.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.798+0000 7f2394be6700 1 -- 172.21.15.40:0/68734904 shutdown_connections 2023-09-30T22:22:26.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.798+0000 7f2394be6700 1 --2- 172.21.15.40:0/68734904 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2390130650 0x7f239011a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:26.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.798+0000 7f2394be6700 1 --2- 172.21.15.40:0/68734904 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2390096160 0x7f239011e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:26.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.798+0000 7f2394be6700 1 --2- 172.21.15.40:0/68734904 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2390098b10 0x7f239011a400 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:26.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.798+0000 7f2394be6700 1 -- 172.21.15.40:0/68734904 >> 172.21.15.40:0/68734904 conn(0x7f239009ab30 msgr2=0x7f239005e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:26.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.798+0000 7f2394be6700 1 -- 172.21.15.40:0/68734904 shutdown_connections 2023-09-30T22:22:26.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.798+0000 7f2394be6700 1 -- 172.21.15.40:0/68734904 wait complete. 2023-09-30T22:22:26.800 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 6 2023-09-30T22:22:26.810 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:22:26.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.931+0000 7fba25df9700 1 Processor -- start 2023-09-30T22:22:26.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.931+0000 7fba25df9700 1 -- start start 2023-09-30T22:22:26.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.931+0000 7fba25df9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fba20093860 0x7fba20096500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:26.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.931+0000 7fba25df9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba20127f00 0x7fba2012fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:26.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.931+0000 7fba25df9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba20092da0 con 0x7fba20124bd0 2023-09-30T22:22:26.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.931+0000 7fba25df9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba20093c40 con 0x7fba20127f00 2023-09-30T22:22:26.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.931+0000 7fba25df9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba20092ad0 con 0x7fba20093860 2023-09-30T22:22:26.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.931+0000 7fba1f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fba20093860 0x7fba20096500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:26.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.931+0000 7fba1ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba20127f00 0x7fba2012fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:26.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.931+0000 7fba1f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fba20093860 0x7fba20096500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:50522/0 (socket says 172.21.15.40:50522) 2023-09-30T22:22:26.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.931+0000 7fba1f7fe700 1 -- 172.21.15.40:0/75218607 learned_addr learned my addr 172.21.15.40:0/75218607 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:26.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.932+0000 7fba1f7fe700 1 -- 172.21.15.40:0/75218607 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba20127f00 msgr2=0x7fba2012fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:26.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.932+0000 7fba1f7fe700 1 --2- 172.21.15.40:0/75218607 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba20127f00 0x7fba2012fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:26.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.932+0000 7fba1e7fc700 1 -- 172.21.15.40:0/75218607 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3466167263 0 0) 0x7fba20092da0 con 0x7fba20124bd0 2023-09-30T22:22:26.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.932+0000 7fba1f7fe700 1 -- 172.21.15.40:0/75218607 >> v1:172.21.15.40:6789/0 conn(0x7fba20124bd0 legacy=0x7fba201277f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.932+0000 7fba1f7fe700 1 -- 172.21.15.40:0/75218607 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba200920a0 con 0x7fba20093860 2023-09-30T22:22:26.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.932+0000 7fba1ffff700 1 --2- 172.21.15.40:0/75218607 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba20127f00 0x7fba2012fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:26.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.932+0000 7fba1f7fe700 1 --2- 172.21.15.40:0/75218607 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fba20093860 0x7fba20096500 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fba1000bb00 tx=0x7fba1000b3b0).ready entity=mon.2 client_cookie=dbb2aae3ef1b83c0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:26.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.932+0000 7fba1e7fc700 1 -- 172.21.15.40:0/75218607 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1000db00 con 0x7fba20093860 2023-09-30T22:22:26.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.932+0000 7fba1e7fc700 1 -- 172.21.15.40:0/75218607 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1000dc60 con 0x7fba20093860 2023-09-30T22:22:26.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.932+0000 7fba1e7fc700 1 -- 172.21.15.40:0/75218607 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba10010470 con 0x7fba20093860 2023-09-30T22:22:26.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.932+0000 7fba25df9700 1 -- 172.21.15.40:0/75218607 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fba20093860 msgr2=0x7fba20096500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.932+0000 7fba25df9700 1 --2- 172.21.15.40:0/75218607 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fba20093860 0x7fba20096500 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fba1000bb00 tx=0x7fba1000b3b0).stop 2023-09-30T22:22:26.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.932+0000 7fba25df9700 1 -- 172.21.15.40:0/75218607 shutdown_connections 2023-09-30T22:22:26.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.932+0000 7fba25df9700 1 --2- 172.21.15.40:0/75218607 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba20127f00 0x7fba2012fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:26.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.932+0000 7fba25df9700 1 --2- 172.21.15.40:0/75218607 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fba20093860 0x7fba20096500 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:26.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.932+0000 7fba25df9700 1 -- 172.21.15.40:0/75218607 >> 172.21.15.40:0/75218607 conn(0x7fba200975f0 msgr2=0x7fba20097a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:26.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.932+0000 7fba25df9700 1 -- 172.21.15.40:0/75218607 shutdown_connections 2023-09-30T22:22:26.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.932+0000 7fba25df9700 1 -- 172.21.15.40:0/75218607 wait complete. 2023-09-30T22:22:26.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.934+0000 7fba25df9700 1 Processor -- start 2023-09-30T22:22:26.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.934+0000 7fba25df9700 1 -- start start 2023-09-30T22:22:26.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.934+0000 7fba25df9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba20093860 0x7fba20116d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:26.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.934+0000 7fba25df9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fba20124bd0 0x7fba20117280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:26.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.935+0000 7fba25df9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba20127f00 0x7fba20117770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:26.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.935+0000 7fba25df9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba20116b40 con 0x7fba20127f00 2023-09-30T22:22:26.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.935+0000 7fba25df9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba20119b90 con 0x7fba20093860 2023-09-30T22:22:26.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.935+0000 7fba25df9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba20095570 con 0x7fba20124bd0 2023-09-30T22:22:26.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.935+0000 7fba1effd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fba20124bd0 0x7fba20117280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:26.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.935+0000 7fba1ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba20127f00 0x7fba20117770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:26.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.935+0000 7fba1f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba20093860 0x7fba20116d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:26.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.935+0000 7fba1effd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fba20124bd0 0x7fba20117280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:50530/0 (socket says 172.21.15.40:50530) 2023-09-30T22:22:26.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.935+0000 7fba1effd700 1 -- 172.21.15.40:0/2622600154 learned_addr learned my addr 172.21.15.40:0/2622600154 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:26.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.935+0000 7fba1ffff700 1 -- 172.21.15.40:0/2622600154 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fba20124bd0 msgr2=0x7fba20117280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.935+0000 7fba1ffff700 1 --2- 172.21.15.40:0/2622600154 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fba20124bd0 0x7fba20117280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:26.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.935+0000 7fba1ffff700 1 -- 172.21.15.40:0/2622600154 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba20093860 msgr2=0x7fba20116d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.935+0000 7fba1ffff700 1 --2- 172.21.15.40:0/2622600154 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba20093860 0x7fba20116d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:26.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.935+0000 7fba1ffff700 1 -- 172.21.15.40:0/2622600154 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba18009a20 con 0x7fba20127f00 2023-09-30T22:22:26.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.935+0000 7fba1effd700 1 --2- 172.21.15.40:0/2622600154 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fba20124bd0 0x7fba20117280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:26.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.935+0000 7fba1ffff700 1 --2- 172.21.15.40:0/2622600154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba20127f00 0x7fba20117770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fba18009f10 tx=0x7fba1800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:26.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.935+0000 7fba077fe700 1 -- 172.21.15.40:0/2622600154 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1800cb70 con 0x7fba20127f00 2023-09-30T22:22:26.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.935+0000 7fba077fe700 1 -- 172.21.15.40:0/2622600154 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1800f040 con 0x7fba20127f00 2023-09-30T22:22:26.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.935+0000 7fba25df9700 1 -- 172.21.15.40:0/2622600154 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba1000b610 con 0x7fba20127f00 2023-09-30T22:22:26.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.935+0000 7fba077fe700 1 -- 172.21.15.40:0/2622600154 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba18013400 con 0x7fba20127f00 2023-09-30T22:22:26.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.935+0000 7fba25df9700 1 -- 172.21.15.40:0/2622600154 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba2011a870 con 0x7fba20127f00 2023-09-30T22:22:26.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.936+0000 7fba077fe700 1 -- 172.21.15.40:0/2622600154 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fba180137f0 con 0x7fba20127f00 2023-09-30T22:22:26.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.936+0000 7fba077fe700 1 -- 172.21.15.40:0/2622600154 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fba1803b860 con 0x7fba20127f00 2023-09-30T22:22:26.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.936+0000 7fba25df9700 1 -- 172.21.15.40:0/2622600154 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba2009b7a0 con 0x7fba20127f00 2023-09-30T22:22:26.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:26.941+0000 7fba077fe700 1 -- 172.21.15.40:0/2622600154 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fba18013aa0 con 0x7fba20127f00 2023-09-30T22:22:27.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.110+0000 7fba25df9700 1 -- 172.21.15.40:0/2622600154 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba2005a260 con 0x7fba20127f00 2023-09-30T22:22:27.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.111+0000 7fba077fe700 1 -- 172.21.15.40:0/2622600154 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+11340 (secure 0 0 0) 0x7fba1801b7e0 con 0x7fba20127f00 2023-09-30T22:22:27.111 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:22:27.111 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":18,"fsid":"79dd4d8e-f295-4d9c-bd93-9850863800e3","created":"2023-09-30T22:21:46.980357+0000","modified":"2023-09-30T22:22:20.853681+0000","last_up_change":"2023-09-30T22:21:54.822866+0000","last_in_change":"2023-09-30T22:21:48.205613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:21:54.875024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:21:56.197012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:22:00.759069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:22:01.327265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"771f785c-f464-4b17-936c-cbf31b1153e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6812","nonce":119451}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6813","nonce":119451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6815","nonce":119451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6814","nonce":119451}]},"public_addr":"172.21.15.40:6812/119451","cluster_addr":"172.21.15.40:6813/119451","heartbeat_back_addr":"172.21.15.40:6815/119451","heartbeat_front_addr":"172.21.15.40:6814/119451","state":["exists","up"]},{"osd":1,"uuid":"45f1e2e8-5310-4219-ab54-424e7440fcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6808","nonce":119436}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6809","nonce":119436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6811","nonce":119436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6810","nonce":119436}]},"public_addr":"172.21.15.40:6808/119436","cluster_addr":"172.21.15.40:6809/119436","heartbeat_back_addr":"172.21.15.40:6811/119436","heartbeat_front_addr":"172.21.15.40:6810/119436","state":["exists","up"]},{"osd":2,"uuid":"7ba62ae5-d21e-4d56-b46c-ba7b718ede25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6800","nonce":119433}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6801","nonce":119433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6803","nonce":119433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6802","nonce":119433}]},"public_addr":"172.21.15.40:6800/119433","cluster_addr":"172.21.15.40:6801/119433","heartbeat_back_addr":"172.21.15.40:6803/119433","heartbeat_front_addr":"172.21.15.40:6802/119433","state":["exists","up"]},{"osd":3,"uuid":"c9c55985-8a90-4927-a8fa-6a1fcec1cd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6804","nonce":119432}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6805","nonce":119432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6807","nonce":119432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6806","nonce":119432}]},"public_addr":"172.21.15.40:6804/119432","cluster_addr":"172.21.15.40:6805/119432","heartbeat_back_addr":"172.21.15.40:6807/119432","heartbeat_front_addr":"172.21.15.40:6806/119432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.339829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.554690+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.641664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.320635+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:22:27.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.113+0000 7fba25df9700 1 -- 172.21.15.40:0/2622600154 >> v1:172.21.15.40:6816/118905 conn(0x7fba0c02bb60 legacy=0x7fba0c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.113+0000 7fba25df9700 1 -- 172.21.15.40:0/2622600154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba20127f00 msgr2=0x7fba20117770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.113+0000 7fba25df9700 1 --2- 172.21.15.40:0/2622600154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba20127f00 0x7fba20117770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fba18009f10 tx=0x7fba1800b040).stop 2023-09-30T22:22:27.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.113+0000 7fba25df9700 1 -- 172.21.15.40:0/2622600154 shutdown_connections 2023-09-30T22:22:27.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.113+0000 7fba25df9700 1 --2- 172.21.15.40:0/2622600154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba20127f00 0x7fba20117770 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:27.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.113+0000 7fba25df9700 1 --2- 172.21.15.40:0/2622600154 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba20093860 0x7fba20116d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:27.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.113+0000 7fba25df9700 1 --2- 172.21.15.40:0/2622600154 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fba20124bd0 0x7fba20117280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:27.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.113+0000 7fba25df9700 1 -- 172.21.15.40:0/2622600154 >> 172.21.15.40:0/2622600154 conn(0x7fba200975f0 msgr2=0x7fba20093f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:27.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.113+0000 7fba25df9700 1 -- 172.21.15.40:0/2622600154 shutdown_connections 2023-09-30T22:22:27.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.113+0000 7fba25df9700 1 -- 172.21.15.40:0/2622600154 wait complete. 2023-09-30T22:22:27.125 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-30T22:22:27.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.247+0000 7f457c1a1700 1 Processor -- start 2023-09-30T22:22:27.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.248+0000 7f457c1a1700 1 -- start start 2023-09-30T22:22:27.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.248+0000 7f457c1a1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45740939a0 0x7f4574095560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:27.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.248+0000 7f457c1a1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4574095a50 0x7f4574095e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:27.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.248+0000 7f457c1a1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f457412c330 0x7f457412e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:27.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.248+0000 7f457c1a1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4574093d80 con 0x7f457412c330 2023-09-30T22:22:27.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.248+0000 7f457c1a1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4574096960 con 0x7f45740939a0 2023-09-30T22:22:27.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.248+0000 7f457c1a1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4574094140 con 0x7f4574095a50 2023-09-30T22:22:27.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.248+0000 7f457a73e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f457412c330 0x7f457412e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:27.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.248+0000 7f4579f3d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45740939a0 0x7f4574095560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:27.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.248+0000 7f457a73e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f457412c330 0x7f457412e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52100/0 (socket says 172.21.15.40:52100) 2023-09-30T22:22:27.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.248+0000 7f4579f3d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45740939a0 0x7f4574095560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:55202/0 (socket says 172.21.15.40:55202) 2023-09-30T22:22:27.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.248+0000 7f457a73e700 1 -- 172.21.15.40:0/3128770219 learned_addr learned my addr 172.21.15.40:0/3128770219 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:27.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.248+0000 7f457973c700 1 --2- 172.21.15.40:0/3128770219 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4574095a50 0x7f4574095e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:27.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.249+0000 7f457973c700 1 -- 172.21.15.40:0/3128770219 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45740939a0 msgr2=0x7f4574095560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:27.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.249+0000 7f457973c700 1 --2- 172.21.15.40:0/3128770219 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45740939a0 0x7f4574095560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:27.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.249+0000 7f457973c700 1 -- 172.21.15.40:0/3128770219 >> v2:172.21.15.40:3300/0 conn(0x7f457412c330 msgr2=0x7f457412e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:27.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.249+0000 7f457973c700 1 --2- 172.21.15.40:0/3128770219 >> v2:172.21.15.40:3300/0 conn(0x7f457412c330 0x7f457412e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:27.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.249+0000 7f457973c700 1 -- 172.21.15.40:0/3128770219 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4574092ee0 con 0x7f4574095a50 2023-09-30T22:22:27.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.249+0000 7f4579f3d700 1 --2- 172.21.15.40:0/3128770219 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45740939a0 0x7f4574095560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:27.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.249+0000 7f457a73e700 1 --2- 172.21.15.40:0/3128770219 >> v2:172.21.15.40:3300/0 conn(0x7f457412c330 0x7f457412e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:27.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.249+0000 7f457973c700 1 --2- 172.21.15.40:0/3128770219 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4574095a50 0x7f4574095e50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f4570009790 tx=0x7f4570009060).ready entity=mon.2 client_cookie=1c19ba4949c3d439 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:27.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.249+0000 7f4578f3b700 1 -- 172.21.15.40:0/3128770219 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45700090d0 con 0x7f4574095a50 2023-09-30T22:22:27.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.249+0000 7f4578f3b700 1 -- 172.21.15.40:0/3128770219 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457000d4a0 con 0x7f4574095a50 2023-09-30T22:22:27.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.249+0000 7f4578f3b700 1 -- 172.21.15.40:0/3128770219 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457000d820 con 0x7f4574095a50 2023-09-30T22:22:27.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.249+0000 7f457c1a1700 1 -- 172.21.15.40:0/3128770219 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4574095a50 msgr2=0x7f4574095e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.249+0000 7f457c1a1700 1 --2- 172.21.15.40:0/3128770219 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4574095a50 0x7f4574095e50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f4570009790 tx=0x7f4570009060).stop 2023-09-30T22:22:27.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.250+0000 7f457c1a1700 1 -- 172.21.15.40:0/3128770219 shutdown_connections 2023-09-30T22:22:27.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.250+0000 7f457c1a1700 1 --2- 172.21.15.40:0/3128770219 >> v2:172.21.15.40:3300/0 conn(0x7f457412c330 0x7f457412e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:27.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.250+0000 7f457c1a1700 1 --2- 172.21.15.40:0/3128770219 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45740939a0 0x7f4574095560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:27.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.250+0000 7f457c1a1700 1 --2- 172.21.15.40:0/3128770219 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4574095a50 0x7f4574095e50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:27.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.250+0000 7f457c1a1700 1 -- 172.21.15.40:0/3128770219 >> 172.21.15.40:0/3128770219 conn(0x7f457409ab40 msgr2=0x7f457409af50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:27.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.250+0000 7f457c1a1700 1 -- 172.21.15.40:0/3128770219 shutdown_connections 2023-09-30T22:22:27.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.250+0000 7f457c1a1700 1 -- 172.21.15.40:0/3128770219 wait complete. 2023-09-30T22:22:27.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.250+0000 7f457c1a1700 1 Processor -- start 2023-09-30T22:22:27.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.250+0000 7f457c1a1700 1 -- start start 2023-09-30T22:22:27.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.251+0000 7f457c1a1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45740939a0 0x7f45741181c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:27.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.251+0000 7f457c1a1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4574095a50 0x7f45741186b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:27.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.251+0000 7f457c1a1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f457412c330 0x7f4574118ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:27.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.251+0000 7f457c1a1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4574119090 con 0x7f45740939a0 2023-09-30T22:22:27.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.251+0000 7f457c1a1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f457411b440 con 0x7f4574095a50 2023-09-30T22:22:27.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.251+0000 7f457c1a1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4574119d90 con 0x7f457412c330 2023-09-30T22:22:27.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.251+0000 7f4579f3d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45740939a0 0x7f45741181c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:27.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.251+0000 7f457973c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4574095a50 0x7f45741186b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:27.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.251+0000 7f4579f3d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45740939a0 0x7f45741181c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52106/0 (socket says 172.21.15.40:52106) 2023-09-30T22:22:27.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.251+0000 7f457a73e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f457412c330 0x7f4574118ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:27.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.251+0000 7f4579f3d700 1 -- 172.21.15.40:0/289703512 learned_addr learned my addr 172.21.15.40:0/289703512 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:27.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.251+0000 7f457973c700 1 -- 172.21.15.40:0/289703512 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f457412c330 msgr2=0x7f4574118ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.251+0000 7f457973c700 1 --2- 172.21.15.40:0/289703512 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f457412c330 0x7f4574118ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:27.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.251+0000 7f457973c700 1 -- 172.21.15.40:0/289703512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45740939a0 msgr2=0x7f45741181c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.251+0000 7f457973c700 1 --2- 172.21.15.40:0/289703512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45740939a0 0x7f45741181c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:27.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.251+0000 7f457973c700 1 -- 172.21.15.40:0/289703512 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45640092a0 con 0x7f4574095a50 2023-09-30T22:22:27.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.251+0000 7f4579f3d700 1 --2- 172.21.15.40:0/289703512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45740939a0 0x7f45741181c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:27.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.251+0000 7f457a73e700 1 --2- 172.21.15.40:0/289703512 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f457412c330 0x7f4574118ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:27.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.251+0000 7f457973c700 1 --2- 172.21.15.40:0/289703512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4574095a50 0x7f45741186b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f4570013000 tx=0x7f4570016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:27.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.252+0000 7f4569ffb700 1 -- 172.21.15.40:0/289703512 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4570020070 con 0x7f4574095a50 2023-09-30T22:22:27.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.252+0000 7f4569ffb700 1 -- 172.21.15.40:0/289703512 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45700127f0 con 0x7f4574095a50 2023-09-30T22:22:27.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.252+0000 7f457c1a1700 1 -- 172.21.15.40:0/289703512 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f456c009ae0 con 0x7f4574095a50 2023-09-30T22:22:27.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.252+0000 7f4569ffb700 1 -- 172.21.15.40:0/289703512 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4570012b90 con 0x7f4574095a50 2023-09-30T22:22:27.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.252+0000 7f457c1a1700 1 -- 172.21.15.40:0/289703512 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45700092a0 con 0x7f4574095a50 2023-09-30T22:22:27.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.252+0000 7f4569ffb700 1 -- 172.21.15.40:0/289703512 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f4570025410 con 0x7f4574095a50 2023-09-30T22:22:27.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.253+0000 7f4569ffb700 1 -- 172.21.15.40:0/289703512 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f457003b890 con 0x7f4574095a50 2023-09-30T22:22:27.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.253+0000 7f457c1a1700 1 -- 172.21.15.40:0/289703512 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4574097d40 con 0x7f4574095a50 2023-09-30T22:22:27.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.257+0000 7f4569ffb700 1 -- 172.21.15.40:0/289703512 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f457000f710 con 0x7f4574095a50 2023-09-30T22:22:27.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.464+0000 7f457c1a1700 1 -- 172.21.15.40:0/289703512 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f457405a260 con 0x7f4574095a50 2023-09-30T22:22:27.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.880+0000 7f4569ffb700 1 -- 172.21.15.40:0/289703512 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4570010360 con 0x7f4574095a50 2023-09-30T22:22:27.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.882+0000 7f457c1a1700 1 -- 172.21.15.40:0/289703512 >> v1:172.21.15.40:6816/118905 conn(0x7f455802bb60 legacy=0x7f455802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.882+0000 7f457c1a1700 1 -- 172.21.15.40:0/289703512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4574095a50 msgr2=0x7f45741186b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.882+0000 7f457c1a1700 1 --2- 172.21.15.40:0/289703512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4574095a50 0x7f45741186b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f4570013000 tx=0x7f4570016000).stop 2023-09-30T22:22:27.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.882+0000 7f457c1a1700 1 -- 172.21.15.40:0/289703512 shutdown_connections 2023-09-30T22:22:27.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.882+0000 7f457c1a1700 1 --2- 172.21.15.40:0/289703512 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f457412c330 0x7f4574118ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:27.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.882+0000 7f457c1a1700 1 --2- 172.21.15.40:0/289703512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45740939a0 0x7f45741181c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:27.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.882+0000 7f457c1a1700 1 --2- 172.21.15.40:0/289703512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4574095a50 0x7f45741186b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:27.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.882+0000 7f457c1a1700 1 -- 172.21.15.40:0/289703512 >> 172.21.15.40:0/289703512 conn(0x7f457409ab40 msgr2=0x7f457405e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:27.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.882+0000 7f457c1a1700 1 -- 172.21.15.40:0/289703512 shutdown_connections 2023-09-30T22:22:27.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:27.882+0000 7f457c1a1700 1 -- 172.21.15.40:0/289703512 wait complete. 2023-09-30T22:22:27.896 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2023-09-30T22:22:28.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.023+0000 7f03e8c9c700 1 Processor -- start 2023-09-30T22:22:28.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.023+0000 7f03e8c9c700 1 -- start start 2023-09-30T22:22:28.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.024+0000 7f03e8c9c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03e40657e0 0x7f03e4096620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:28.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.024+0000 7f03e8c9c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f03e4097ec0 0x7f03e4096b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:28.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.024+0000 7f03e8c9c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f03e4097000 0x7f03e4131650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:28.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.024+0000 7f03e8c9c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03e4098350 con 0x7f03e4097ec0 2023-09-30T22:22:28.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.024+0000 7f03e8c9c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e40662b0 con 0x7f03e40657e0 2023-09-30T22:22:28.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.024+0000 7f03e8c9c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03e4065bc0 con 0x7f03e4097000 2023-09-30T22:22:28.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.024+0000 7f03e1d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f03e4097ec0 0x7f03e4096b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:28.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.024+0000 7f03e259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03e40657e0 0x7f03e4096620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:28.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.024+0000 7f03e2d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f03e4097000 0x7f03e4131650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:28.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.024+0000 7f03e1d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f03e4097ec0 0x7f03e4096b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52112/0 (socket says 172.21.15.40:52112) 2023-09-30T22:22:28.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.024+0000 7f03e259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03e40657e0 0x7f03e4096620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:55226/0 (socket says 172.21.15.40:55226) 2023-09-30T22:22:28.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.024+0000 7f03e1d9b700 1 -- 172.21.15.40:0/260675865 learned_addr learned my addr 172.21.15.40:0/260675865 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:28.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.024+0000 7f03e2d9d700 1 -- 172.21.15.40:0/260675865 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03e40657e0 msgr2=0x7f03e4096620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:28.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.024+0000 7f03e2d9d700 1 --2- 172.21.15.40:0/260675865 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03e40657e0 0x7f03e4096620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:28.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.024+0000 7f03e2d9d700 1 -- 172.21.15.40:0/260675865 >> v2:172.21.15.40:3300/0 conn(0x7f03e4097ec0 msgr2=0x7f03e4096b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:28.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.024+0000 7f03e2d9d700 1 --2- 172.21.15.40:0/260675865 >> v2:172.21.15.40:3300/0 conn(0x7f03e4097ec0 0x7f03e4096b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:28.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.024+0000 7f03e2d9d700 1 -- 172.21.15.40:0/260675865 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e4096350 con 0x7f03e4097000 2023-09-30T22:22:28.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.025+0000 7f03e1d9b700 1 --2- 172.21.15.40:0/260675865 >> v2:172.21.15.40:3300/0 conn(0x7f03e4097ec0 0x7f03e4096b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:28.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.025+0000 7f03e259c700 1 --2- 172.21.15.40:0/260675865 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03e40657e0 0x7f03e4096620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:28.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.025+0000 7f03e2d9d700 1 --2- 172.21.15.40:0/260675865 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f03e4097000 0x7f03e4131650 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f03dc009e60 tx=0x7f03dc009780).ready entity=mon.2 client_cookie=2b5411150b0b5ed0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:28.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.025+0000 7f03e159a700 1 -- 172.21.15.40:0/260675865 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc00e070 con 0x7f03e4097000 2023-09-30T22:22:28.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.025+0000 7f03e159a700 1 -- 172.21.15.40:0/260675865 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03dc00bab0 con 0x7f03e4097000 2023-09-30T22:22:28.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.025+0000 7f03e159a700 1 -- 172.21.15.40:0/260675865 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc00be30 con 0x7f03e4097000 2023-09-30T22:22:28.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.025+0000 7f03e8c9c700 1 -- 172.21.15.40:0/260675865 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f03e4097000 msgr2=0x7f03e4131650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:28.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.025+0000 7f03e8c9c700 1 --2- 172.21.15.40:0/260675865 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f03e4097000 0x7f03e4131650 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f03dc009e60 tx=0x7f03dc009780).stop 2023-09-30T22:22:28.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.025+0000 7f03e8c9c700 1 -- 172.21.15.40:0/260675865 shutdown_connections 2023-09-30T22:22:28.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.025+0000 7f03e8c9c700 1 --2- 172.21.15.40:0/260675865 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f03e4097000 0x7f03e4131650 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:28.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.025+0000 7f03e8c9c700 1 --2- 172.21.15.40:0/260675865 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03e40657e0 0x7f03e4096620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:28.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.025+0000 7f03e8c9c700 1 --2- 172.21.15.40:0/260675865 >> v2:172.21.15.40:3300/0 conn(0x7f03e4097ec0 0x7f03e4096b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:28.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.025+0000 7f03e8c9c700 1 -- 172.21.15.40:0/260675865 >> 172.21.15.40:0/260675865 conn(0x7f03e409de50 msgr2=0x7f03e409e260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:28.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.025+0000 7f03e8c9c700 1 -- 172.21.15.40:0/260675865 shutdown_connections 2023-09-30T22:22:28.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.025+0000 7f03e8c9c700 1 -- 172.21.15.40:0/260675865 wait complete. 2023-09-30T22:22:28.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.026+0000 7f03e8c9c700 1 Processor -- start 2023-09-30T22:22:28.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.026+0000 7f03e8c9c700 1 -- start start 2023-09-30T22:22:28.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.027+0000 7f03e8c9c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03e40657e0 0x7f03e413a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:28.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.027+0000 7f03e8c9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03e4097000 0x7f03e413a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:28.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.027+0000 7f03e8c9c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f03e413ad50 0x7f03e411ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:28.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.027+0000 7f03e8c9c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e4099d70 con 0x7f03e4097000 2023-09-30T22:22:28.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.027+0000 7f03e8c9c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e4094740 con 0x7f03e40657e0 2023-09-30T22:22:28.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.027+0000 7f03e8c9c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03e413b170 con 0x7f03e413ad50 2023-09-30T22:22:28.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.027+0000 7f03e2d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f03e413ad50 0x7f03e411ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:28.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.027+0000 7f03e1d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03e4097000 0x7f03e413a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:28.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.027+0000 7f03e2d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f03e413ad50 0x7f03e411ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:50574/0 (socket says 172.21.15.40:50574) 2023-09-30T22:22:28.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.027+0000 7f03e1d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03e4097000 0x7f03e413a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52118/0 (socket says 172.21.15.40:52118) 2023-09-30T22:22:28.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.027+0000 7f03e2d9d700 1 -- 172.21.15.40:0/1492453932 learned_addr learned my addr 172.21.15.40:0/1492453932 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:28.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.027+0000 7f03e259c700 1 --2- 172.21.15.40:0/1492453932 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03e40657e0 0x7f03e413a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:28.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.027+0000 7f03e2d9d700 1 -- 172.21.15.40:0/1492453932 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03e40657e0 msgr2=0x7f03e413a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:28.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.027+0000 7f03e2d9d700 1 --2- 172.21.15.40:0/1492453932 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03e40657e0 0x7f03e413a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:28.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.027+0000 7f03e2d9d700 1 -- 172.21.15.40:0/1492453932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03e4097000 msgr2=0x7f03e413a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:28.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.027+0000 7f03e2d9d700 1 --2- 172.21.15.40:0/1492453932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03e4097000 0x7f03e413a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:28.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.027+0000 7f03e2d9d700 1 -- 172.21.15.40:0/1492453932 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d40092a0 con 0x7f03e413ad50 2023-09-30T22:22:28.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.027+0000 7f03e1d9b700 1 --2- 172.21.15.40:0/1492453932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03e4097000 0x7f03e413a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:28.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.027+0000 7f03e2d9d700 1 --2- 172.21.15.40:0/1492453932 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f03e413ad50 0x7f03e411ab10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f03dc013cc0 tx=0x7f03e40987a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:28.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.027+0000 7f03da7fc700 1 -- 172.21.15.40:0/1492453932 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc013ea0 con 0x7f03e413ad50 2023-09-30T22:22:28.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.028+0000 7f03da7fc700 1 -- 172.21.15.40:0/1492453932 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03dc01d630 con 0x7f03e413ad50 2023-09-30T22:22:28.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.028+0000 7f03e8c9c700 1 -- 172.21.15.40:0/1492453932 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03cc009370 con 0x7f03e413ad50 2023-09-30T22:22:28.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.028+0000 7f03da7fc700 1 -- 172.21.15.40:0/1492453932 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc0070e0 con 0x7f03e413ad50 2023-09-30T22:22:28.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.028+0000 7f03e8c9c700 1 -- 172.21.15.40:0/1492453932 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03dc009a20 con 0x7f03e413ad50 2023-09-30T22:22:28.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.028+0000 7f03da7fc700 1 -- 172.21.15.40:0/1492453932 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f03dc003040 con 0x7f03e413ad50 2023-09-30T22:22:28.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.028+0000 7f03da7fc700 1 -- 172.21.15.40:0/1492453932 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f03dc03cb80 con 0x7f03e413ad50 2023-09-30T22:22:28.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.029+0000 7f03e8c9c700 1 -- 172.21.15.40:0/1492453932 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03e40994d0 con 0x7f03e413ad50 2023-09-30T22:22:28.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.033+0000 7f03da7fc700 1 -- 172.21.15.40:0/1492453932 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f03dc01b310 con 0x7f03e413ad50 2023-09-30T22:22:28.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.242+0000 7f03e8c9c700 1 -- 172.21.15.40:0/1492453932 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f03e405a260 con 0x7f03e413ad50 2023-09-30T22:22:28.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.883+0000 7f03da7fc700 1 -- 172.21.15.40:0/1492453932 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v8) v1 ==== 105+0+0 (secure 0 0 0) 0x7f03dc0360b0 con 0x7f03e413ad50 2023-09-30T22:22:28.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.886+0000 7f03e8c9c700 1 -- 172.21.15.40:0/1492453932 >> v1:172.21.15.40:6816/118905 conn(0x7f03c402bb60 legacy=0x7f03c402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:28.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.886+0000 7f03e8c9c700 1 -- 172.21.15.40:0/1492453932 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f03e413ad50 msgr2=0x7f03e411ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:28.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.886+0000 7f03e8c9c700 1 --2- 172.21.15.40:0/1492453932 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f03e413ad50 0x7f03e411ab10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f03dc013cc0 tx=0x7f03e40987a0).stop 2023-09-30T22:22:28.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.886+0000 7f03e8c9c700 1 -- 172.21.15.40:0/1492453932 shutdown_connections 2023-09-30T22:22:28.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.886+0000 7f03e8c9c700 1 --2- 172.21.15.40:0/1492453932 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f03e413ad50 0x7f03e411ab10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:28.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.886+0000 7f03e8c9c700 1 --2- 172.21.15.40:0/1492453932 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03e40657e0 0x7f03e413a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:28.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.886+0000 7f03e8c9c700 1 --2- 172.21.15.40:0/1492453932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03e4097000 0x7f03e413a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:28.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.886+0000 7f03e8c9c700 1 -- 172.21.15.40:0/1492453932 >> 172.21.15.40:0/1492453932 conn(0x7f03e409de50 msgr2=0x7f03e409bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:28.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.886+0000 7f03e8c9c700 1 -- 172.21.15.40:0/1492453932 shutdown_connections 2023-09-30T22:22:28.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:28.886+0000 7f03e8c9c700 1 -- 172.21.15.40:0/1492453932 wait complete. 2023-09-30T22:22:28.901 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:22:29.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.028+0000 7f52a1b0a700 1 Processor -- start 2023-09-30T22:22:29.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.028+0000 7f52a1b0a700 1 -- start start 2023-09-30T22:22:29.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.029+0000 7f52a1b0a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f529c093a60 0x7f529c130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:29.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.029+0000 7f52a1b0a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f529c130820 0x7f529c132c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:29.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.029+0000 7f52a1b0a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f529c094e10 con 0x7f529c092f70 2023-09-30T22:22:29.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.029+0000 7f52a1b0a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f529c05eee0 con 0x7f529c093a60 2023-09-30T22:22:29.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.029+0000 7f52a1b0a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f529c092d50 con 0x7f529c130820 2023-09-30T22:22:29.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.029+0000 7f5292ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f529c093a60 0x7f529c130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:29.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.029+0000 7f529bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f529c130820 0x7f529c132c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:29.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.029+0000 7f529b7fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f529c092f70 0x7f529c093350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53598/0 (socket says 172.21.15.40:53598) 2023-09-30T22:22:29.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.029+0000 7f529b7fe700 1 -- 172.21.15.40:0/4073154338 learned_addr learned my addr 172.21.15.40:0/4073154338 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:22:29.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.029+0000 7f5292ffd700 1 -- 172.21.15.40:0/4073154338 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f529c130820 msgr2=0x7f529c132c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:29.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.029+0000 7f5292ffd700 1 --2- 172.21.15.40:0/4073154338 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f529c130820 0x7f529c132c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:29.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.029+0000 7f5292ffd700 1 -- 172.21.15.40:0/4073154338 >> v1:172.21.15.40:6789/0 conn(0x7f529c092f70 legacy=0x7f529c093350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.029+0000 7f5292ffd700 1 -- 172.21.15.40:0/4073154338 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f529c091a00 con 0x7f529c093a60 2023-09-30T22:22:29.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.029+0000 7f529bfff700 1 --2- 172.21.15.40:0/4073154338 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f529c130820 0x7f529c132c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:29.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.029+0000 7f5292ffd700 1 --2- 172.21.15.40:0/4073154338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f529c093a60 0x7f529c130330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f5284009790 tx=0x7f5284009060).ready entity=mon.0 client_cookie=c1071ce0efd890e1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:29.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.030+0000 7f529affd700 1 -- 172.21.15.40:0/4073154338 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528400f510 con 0x7f529c093a60 2023-09-30T22:22:29.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.030+0000 7f529affd700 1 -- 172.21.15.40:0/4073154338 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f528400f670 con 0x7f529c093a60 2023-09-30T22:22:29.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.030+0000 7f529affd700 1 -- 172.21.15.40:0/4073154338 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528400f9f0 con 0x7f529c093a60 2023-09-30T22:22:29.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.030+0000 7f52a1b0a700 1 -- 172.21.15.40:0/4073154338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f529c093a60 msgr2=0x7f529c130330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.030+0000 7f52a1b0a700 1 --2- 172.21.15.40:0/4073154338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f529c093a60 0x7f529c130330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f5284009790 tx=0x7f5284009060).stop 2023-09-30T22:22:29.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.030+0000 7f52a1b0a700 1 -- 172.21.15.40:0/4073154338 shutdown_connections 2023-09-30T22:22:29.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.030+0000 7f52a1b0a700 1 --2- 172.21.15.40:0/4073154338 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f529c130820 0x7f529c132c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:29.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.030+0000 7f52a1b0a700 1 --2- 172.21.15.40:0/4073154338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f529c093a60 0x7f529c130330 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:29.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.030+0000 7f52a1b0a700 1 -- 172.21.15.40:0/4073154338 >> 172.21.15.40:0/4073154338 conn(0x7f529c097580 msgr2=0x7f529c097990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:29.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.030+0000 7f52a1b0a700 1 -- 172.21.15.40:0/4073154338 shutdown_connections 2023-09-30T22:22:29.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.030+0000 7f52a1b0a700 1 -- 172.21.15.40:0/4073154338 wait complete. 2023-09-30T22:22:29.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.031+0000 7f52a1b0a700 1 Processor -- start 2023-09-30T22:22:29.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.031+0000 7f52a1b0a700 1 -- start start 2023-09-30T22:22:29.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.032+0000 7f52a1b0a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f529c092f70 0x7f529c12d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:29.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.032+0000 7f52a1b0a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f529c093a60 0x7f529c1176c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:29.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.032+0000 7f52a1b0a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f529c130820 0x7f529c117bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:29.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.032+0000 7f52a1b0a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529c096db0 con 0x7f529c092f70 2023-09-30T22:22:29.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.032+0000 7f52a1b0a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f529c11bb90 con 0x7f529c130820 2023-09-30T22:22:29.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.032+0000 7f52a1b0a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f529c11b7b0 con 0x7f529c093a60 2023-09-30T22:22:29.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.032+0000 7f529b7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f529c092f70 0x7f529c12d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:29.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.032+0000 7f529bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f529c130820 0x7f529c117bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:29.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.032+0000 7f529b7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f529c092f70 0x7f529c12d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52136/0 (socket says 172.21.15.40:52136) 2023-09-30T22:22:29.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.032+0000 7f529b7fe700 1 -- 172.21.15.40:0/4063395520 learned_addr learned my addr 172.21.15.40:0/4063395520 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:29.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.032+0000 7f5292ffd700 1 --2- 172.21.15.40:0/4063395520 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f529c093a60 0x7f529c1176c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:29.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.032+0000 7f5292ffd700 1 -- 172.21.15.40:0/4063395520 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f529c130820 msgr2=0x7f529c117bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.032+0000 7f5292ffd700 1 --2- 172.21.15.40:0/4063395520 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f529c130820 0x7f529c117bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:29.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.032+0000 7f5292ffd700 1 -- 172.21.15.40:0/4063395520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f529c092f70 msgr2=0x7f529c12d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.032+0000 7f5292ffd700 1 --2- 172.21.15.40:0/4063395520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f529c092f70 0x7f529c12d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:29.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.032+0000 7f5292ffd700 1 -- 172.21.15.40:0/4063395520 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5294009a20 con 0x7f529c093a60 2023-09-30T22:22:29.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.032+0000 7f529b7fe700 1 --2- 172.21.15.40:0/4063395520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f529c092f70 0x7f529c12d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:29.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.032+0000 7f529bfff700 1 --2- 172.21.15.40:0/4063395520 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f529c130820 0x7f529c117bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:29.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.032+0000 7f5292ffd700 1 --2- 172.21.15.40:0/4063395520 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f529c093a60 0x7f529c1176c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f5284009790 tx=0x7f5284017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:29.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.032+0000 7f5293fff700 1 -- 172.21.15.40:0/4063395520 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528400f7e0 con 0x7f529c093a60 2023-09-30T22:22:29.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.032+0000 7f5293fff700 1 -- 172.21.15.40:0/4063395520 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f528400f960 con 0x7f529c093a60 2023-09-30T22:22:29.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.032+0000 7f5293fff700 1 -- 172.21.15.40:0/4063395520 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528401b660 con 0x7f529c093a60 2023-09-30T22:22:29.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.033+0000 7f52a1b0a700 1 -- 172.21.15.40:0/4063395520 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52840092a0 con 0x7f529c093a60 2023-09-30T22:22:29.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.033+0000 7f52a1b0a700 1 -- 172.21.15.40:0/4063395520 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f529c11ac50 con 0x7f529c093a60 2023-09-30T22:22:29.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.033+0000 7f5293fff700 1 -- 172.21.15.40:0/4063395520 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f528401ba50 con 0x7f529c093a60 2023-09-30T22:22:29.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.034+0000 7f5293fff700 1 -- 172.21.15.40:0/4063395520 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f528403c980 con 0x7f529c093a60 2023-09-30T22:22:29.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.034+0000 7f52a1b0a700 1 -- 172.21.15.40:0/4063395520 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f529c11b030 con 0x7f529c093a60 2023-09-30T22:22:29.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.038+0000 7f5293fff700 1 -- 172.21.15.40:0/4063395520 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f5284029080 con 0x7f529c093a60 2023-09-30T22:22:29.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.247+0000 7f52a1b0a700 1 -- 172.21.15.40:0/4063395520 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f529c05a260 con 0x7f529c093a60 2023-09-30T22:22:29.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.247+0000 7f5293fff700 1 -- 172.21.15.40:0/4063395520 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2156 (secure 0 0 0) 0x7f528401f020 con 0x7f529c093a60 2023-09-30T22:22:29.248 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:22:29.248 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:22:02.347538+0000","modified":"2023-09-30T22:22:28.878876+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4194},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4194":{"gid":4194,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6817/2392027806","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6817","nonce":2392027806}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-30T22:22:29.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.249+0000 7f52a1b0a700 1 -- 172.21.15.40:0/4063395520 >> v1:172.21.15.40:6816/118905 conn(0x7f527c02bb60 legacy=0x7f527c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.249+0000 7f52a1b0a700 1 -- 172.21.15.40:0/4063395520 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f529c093a60 msgr2=0x7f529c1176c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.249+0000 7f52a1b0a700 1 --2- 172.21.15.40:0/4063395520 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f529c093a60 0x7f529c1176c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f5284009790 tx=0x7f5284017000).stop 2023-09-30T22:22:29.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.249+0000 7f52a1b0a700 1 -- 172.21.15.40:0/4063395520 shutdown_connections 2023-09-30T22:22:29.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.249+0000 7f52a1b0a700 1 --2- 172.21.15.40:0/4063395520 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f529c130820 0x7f529c117bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:29.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.249+0000 7f52a1b0a700 1 --2- 172.21.15.40:0/4063395520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f529c092f70 0x7f529c12d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:29.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.249+0000 7f52a1b0a700 1 --2- 172.21.15.40:0/4063395520 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f529c093a60 0x7f529c1176c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:29.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.249+0000 7f52a1b0a700 1 -- 172.21.15.40:0/4063395520 >> 172.21.15.40:0/4063395520 conn(0x7f529c097580 msgr2=0x7f529c1119d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:29.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.249+0000 7f52a1b0a700 1 -- 172.21.15.40:0/4063395520 shutdown_connections 2023-09-30T22:22:29.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.250+0000 7f52a1b0a700 1 -- 172.21.15.40:0/4063395520 wait complete. 2023-09-30T22:22:29.252 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2023-09-30T22:22:29.362 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-30T22:22:02.347538+0000', 'modified': '2023-09-30T22:22:28.878876+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4194}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4194': {'gid': 4194, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.40:6817/2392027806', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.40:6817', 'nonce': 2392027806}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-09-30T22:22:29.363 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-30T22:22:29.363 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-09-30T22:22:29.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.483+0000 7fade09d7700 1 Processor -- start 2023-09-30T22:22:29.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.483+0000 7fade09d7700 1 -- start start 2023-09-30T22:22:29.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.484+0000 7fade09d7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faddc125fb0 0x7faddc12dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:29.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.484+0000 7fade09d7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faddc12e250 0x7faddc130640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:29.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.484+0000 7fade09d7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faddc096950 con 0x7faddc05e090 2023-09-30T22:22:29.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.484+0000 7fade09d7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faddc05e470 con 0x7faddc12e250 2023-09-30T22:22:29.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.484+0000 7fade09d7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faddc096770 con 0x7faddc125fb0 2023-09-30T22:22:29.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.484+0000 7fadda59c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7faddc05e090 0x7faddc1258a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53612/0 (socket says 172.21.15.40:53612) 2023-09-30T22:22:29.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.484+0000 7fadda59c700 1 -- 172.21.15.40:0/1783152576 learned_addr learned my addr 172.21.15.40:0/1783152576 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:22:29.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.484+0000 7fadd9d9b700 1 --2- 172.21.15.40:0/1783152576 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faddc125fb0 0x7faddc12dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:29.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.484+0000 7faddad9d700 1 --2- 172.21.15.40:0/1783152576 >> v2:172.21.15.40:3300/0 conn(0x7faddc12e250 0x7faddc130640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:29.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.484+0000 7fadd959a700 1 -- 172.21.15.40:0/1783152576 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3663537825 0 0) 0x7faddc096950 con 0x7faddc05e090 2023-09-30T22:22:29.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.484+0000 7fadd959a700 1 -- 172.21.15.40:0/1783152576 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadc40033f0 con 0x7faddc05e090 2023-09-30T22:22:29.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.484+0000 7fadd9d9b700 1 -- 172.21.15.40:0/1783152576 >> v2:172.21.15.40:3300/0 conn(0x7faddc12e250 msgr2=0x7faddc130640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:29.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.484+0000 7fadd9d9b700 1 --2- 172.21.15.40:0/1783152576 >> v2:172.21.15.40:3300/0 conn(0x7faddc12e250 0x7faddc130640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:29.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.484+0000 7fadd9d9b700 1 -- 172.21.15.40:0/1783152576 >> v1:172.21.15.40:6789/0 conn(0x7faddc05e090 legacy=0x7faddc1258a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.484+0000 7fadd9d9b700 1 -- 172.21.15.40:0/1783152576 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faddc0963b0 con 0x7faddc125fb0 2023-09-30T22:22:29.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.484+0000 7faddad9d700 1 --2- 172.21.15.40:0/1783152576 >> v2:172.21.15.40:3300/0 conn(0x7faddc12e250 0x7faddc130640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:29.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.485+0000 7fadd9d9b700 1 --2- 172.21.15.40:0/1783152576 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faddc125fb0 0x7faddc12dd60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fadd0009760 tx=0x7fadd0009060).ready entity=mon.2 client_cookie=e6857e69724a4597 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:29.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.485+0000 7fadd959a700 1 -- 172.21.15.40:0/1783152576 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd000d4a0 con 0x7faddc125fb0 2023-09-30T22:22:29.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.485+0000 7fadd959a700 1 -- 172.21.15.40:0/1783152576 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd000d600 con 0x7faddc125fb0 2023-09-30T22:22:29.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.485+0000 7fadd959a700 1 -- 172.21.15.40:0/1783152576 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd000d980 con 0x7faddc125fb0 2023-09-30T22:22:29.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.485+0000 7fade09d7700 1 -- 172.21.15.40:0/1783152576 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faddc125fb0 msgr2=0x7faddc12dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.485+0000 7fade09d7700 1 --2- 172.21.15.40:0/1783152576 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faddc125fb0 0x7faddc12dd60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fadd0009760 tx=0x7fadd0009060).stop 2023-09-30T22:22:29.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.485+0000 7fade09d7700 1 -- 172.21.15.40:0/1783152576 shutdown_connections 2023-09-30T22:22:29.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.485+0000 7fade09d7700 1 --2- 172.21.15.40:0/1783152576 >> v2:172.21.15.40:3300/0 conn(0x7faddc12e250 0x7faddc130640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:29.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.485+0000 7fade09d7700 1 --2- 172.21.15.40:0/1783152576 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faddc125fb0 0x7faddc12dd60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:29.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.485+0000 7fade09d7700 1 -- 172.21.15.40:0/1783152576 >> 172.21.15.40:0/1783152576 conn(0x7faddc097580 msgr2=0x7faddc097990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:29.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.485+0000 7fade09d7700 1 -- 172.21.15.40:0/1783152576 shutdown_connections 2023-09-30T22:22:29.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.485+0000 7fade09d7700 1 -- 172.21.15.40:0/1783152576 wait complete. 2023-09-30T22:22:29.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.486+0000 7fade09d7700 1 Processor -- start 2023-09-30T22:22:29.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.487+0000 7fade09d7700 1 -- start start 2023-09-30T22:22:29.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.487+0000 7fade09d7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faddc05e090 0x7faddc129fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:29.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.487+0000 7fade09d7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faddc125fb0 0x7faddc12a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:29.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.487+0000 7fade09d7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faddc12e250 0x7faddc12a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:29.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.487+0000 7fade09d7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faddc12dfb0 con 0x7faddc125fb0 2023-09-30T22:22:29.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.487+0000 7fade09d7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faddc12b800 con 0x7faddc05e090 2023-09-30T22:22:29.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.487+0000 7fade09d7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faddc12cdf0 con 0x7faddc12e250 2023-09-30T22:22:29.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.487+0000 7fadda59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faddc05e090 0x7faddc129fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:29.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.487+0000 7fadd9d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faddc125fb0 0x7faddc12a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:29.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.487+0000 7fadd9d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faddc125fb0 0x7faddc12a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52142/0 (socket says 172.21.15.40:52142) 2023-09-30T22:22:29.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.487+0000 7fadd9d9b700 1 -- 172.21.15.40:0/906552113 learned_addr learned my addr 172.21.15.40:0/906552113 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:29.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.487+0000 7fadda59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faddc05e090 0x7faddc129fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:55254/0 (socket says 172.21.15.40:55254) 2023-09-30T22:22:29.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.487+0000 7faddad9d700 1 --2- 172.21.15.40:0/906552113 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faddc12e250 0x7faddc12a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:29.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.488+0000 7fadd9d9b700 1 -- 172.21.15.40:0/906552113 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faddc12e250 msgr2=0x7faddc12a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.488+0000 7fadd9d9b700 1 --2- 172.21.15.40:0/906552113 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faddc12e250 0x7faddc12a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:29.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.488+0000 7fadd9d9b700 1 -- 172.21.15.40:0/906552113 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faddc05e090 msgr2=0x7faddc129fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.488+0000 7fadd9d9b700 1 --2- 172.21.15.40:0/906552113 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faddc05e090 0x7faddc129fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:29.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.488+0000 7fadd9d9b700 1 -- 172.21.15.40:0/906552113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd4009a20 con 0x7faddc125fb0 2023-09-30T22:22:29.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.488+0000 7fadd9d9b700 1 --2- 172.21.15.40:0/906552113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faddc125fb0 0x7faddc12a4a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7faddc095730 tx=0x7fadd0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:29.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.488+0000 7fadca7fc700 1 -- 172.21.15.40:0/906552113 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd000dd30 con 0x7faddc125fb0 2023-09-30T22:22:29.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.488+0000 7fadca7fc700 1 -- 172.21.15.40:0/906552113 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd000de90 con 0x7faddc125fb0 2023-09-30T22:22:29.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.488+0000 7fade09d7700 1 -- 172.21.15.40:0/906552113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd00092a0 con 0x7faddc125fb0 2023-09-30T22:22:29.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.488+0000 7fadca7fc700 1 -- 172.21.15.40:0/906552113 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd000d980 con 0x7faddc125fb0 2023-09-30T22:22:29.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.488+0000 7fade09d7700 1 -- 172.21.15.40:0/906552113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faddc12c060 con 0x7faddc125fb0 2023-09-30T22:22:29.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.489+0000 7fadca7fc700 1 -- 172.21.15.40:0/906552113 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fadd001d640 con 0x7faddc125fb0 2023-09-30T22:22:29.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.489+0000 7fadca7fc700 1 -- 172.21.15.40:0/906552113 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fadd003c710 con 0x7faddc125fb0 2023-09-30T22:22:29.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.491+0000 7fadf238ab80 1 Processor -- start 2023-09-30T22:22:29.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.491+0000 7fadf238ab80 1 -- start start 2023-09-30T22:22:29.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.492+0000 7fadf238ab80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5604aeef9170 0x5604aeef9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:29.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.492+0000 7fadf238ab80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5604aeef9a40 0x5604aef230c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:29.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.492+0000 7fadf238ab80 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x5604aef235b0 0x5604aef259a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:29.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.492+0000 7fadf238ab80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604aeec3610 con 0x5604aeef9a40 2023-09-30T22:22:29.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.492+0000 7fadf238ab80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604aee39db0 con 0x5604aeef9170 2023-09-30T22:22:29.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.492+0000 7fadf238ab80 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x5604aee4f030 con 0x5604aef235b0 2023-09-30T22:22:29.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.492+0000 7fadd9d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5604aeef9a40 0x5604aef230c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:29.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.492+0000 7faddad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x5604aef235b0 0x5604aef259a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:29.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.492+0000 7fadda59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5604aeef9170 0x5604aeef9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:29.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.492+0000 7fadd9d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5604aeef9a40 0x5604aef230c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52158/0 (socket says 172.21.15.40:52158) 2023-09-30T22:22:29.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.492+0000 7faddad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x5604aef235b0 0x5604aef259a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:50624/0 (socket says 172.21.15.40:50624) 2023-09-30T22:22:29.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.492+0000 7fadd9d9b700 1 -- 172.21.15.40:0/1842282889 learned_addr learned my addr 172.21.15.40:0/1842282889 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:29.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.492+0000 7fadda59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5604aeef9170 0x5604aeef9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:55260/0 (socket says 172.21.15.40:55260) 2023-09-30T22:22:29.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.492+0000 7fadd9d9b700 1 -- 172.21.15.40:0/1842282889 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x5604aef235b0 msgr2=0x5604aef259a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:29.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.492+0000 7fadd9d9b700 1 --2- 172.21.15.40:0/1842282889 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x5604aef235b0 0x5604aef259a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:29.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.492+0000 7fadd9d9b700 1 -- 172.21.15.40:0/1842282889 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5604aeef9170 msgr2=0x5604aeef9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:29.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.492+0000 7fadd9d9b700 1 --2- 172.21.15.40:0/1842282889 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5604aeef9170 0x5604aeef9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:29.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.492+0000 7fadd9d9b700 1 -- 172.21.15.40:0/1842282889 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604aecea710 con 0x5604aeef9a40 2023-09-30T22:22:29.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.492+0000 7faddad9d700 1 --2- 172.21.15.40:0/1842282889 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x5604aef235b0 0x5604aef259a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:29.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.492+0000 7fadda59c700 1 --2- 172.21.15.40:0/1842282889 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5604aeef9170 0x5604aeef9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:29.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.492+0000 7fadd9d9b700 1 --2- 172.21.15.40:0/1842282889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5604aeef9a40 0x5604aef230c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fadd0026880 tx=0x7fadd001d000).ready entity=mon.0 client_cookie=c11b1f8632fc054d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:29.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.493+0000 7fadbb7fe700 1 -- 172.21.15.40:0/1842282889 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd0014e60 con 0x5604aeef9a40 2023-09-30T22:22:29.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.493+0000 7fadbb7fe700 1 -- 172.21.15.40:0/1842282889 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd001db80 con 0x5604aeef9a40 2023-09-30T22:22:29.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.493+0000 7fadbb7fe700 1 -- 172.21.15.40:0/1842282889 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd001dcf0 con 0x5604aeef9a40 2023-09-30T22:22:29.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.493+0000 7fadf238ab80 1 -- 172.21.15.40:0/1842282889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5604aeef9a40 msgr2=0x5604aef230c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.493+0000 7fadf238ab80 1 --2- 172.21.15.40:0/1842282889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5604aeef9a40 0x5604aef230c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fadd0026880 tx=0x7fadd001d000).stop 2023-09-30T22:22:29.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.493+0000 7fadf238ab80 1 -- 172.21.15.40:0/1842282889 shutdown_connections 2023-09-30T22:22:29.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.493+0000 7fadf238ab80 1 --2- 172.21.15.40:0/1842282889 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x5604aef235b0 0x5604aef259a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:29.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.493+0000 7fadf238ab80 1 --2- 172.21.15.40:0/1842282889 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5604aeef9170 0x5604aeef9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:29.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.493+0000 7fadf238ab80 1 --2- 172.21.15.40:0/1842282889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5604aeef9a40 0x5604aef230c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:29.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.493+0000 7fadf238ab80 1 -- 172.21.15.40:0/1842282889 >> 172.21.15.40:0/1842282889 conn(0x5604aed67940 msgr2=0x5604aef19cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:29.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.493+0000 7fadf238ab80 1 -- 172.21.15.40:0/1842282889 shutdown_connections 2023-09-30T22:22:29.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.493+0000 7fadf238ab80 1 -- 172.21.15.40:0/1842282889 wait complete. 2023-09-30T22:22:29.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.494+0000 7fadf238ab80 1 -- start start 2023-09-30T22:22:29.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.494+0000 7fadf238ab80 1 Processor -- start 2023-09-30T22:22:29.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.494+0000 7fadf238ab80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5604aeef9170 0x5604aef13350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:29.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.495+0000 7fadf238ab80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5604aeef9a40 0x5604aef13840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:29.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.495+0000 7fadf238ab80 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x5604aef235b0 0x5604aef1ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:29.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.495+0000 7fadf238ab80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604aee4f170 con 0x5604aeef9170 2023-09-30T22:22:29.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.495+0000 7fadf238ab80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604aee4f3f0 con 0x5604aeef9a40 2023-09-30T22:22:29.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.495+0000 7fadf238ab80 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x5604aee1a920 con 0x5604aef235b0 2023-09-30T22:22:29.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.495+0000 7fadf238ab80 10 client.0 ll_register_callbacks cb 0x5604aedefce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:22:29.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.495+0000 7fadda59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5604aeef9170 0x5604aef13350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:29.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.495+0000 7faddad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x5604aef235b0 0x5604aef1ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:29.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.495+0000 7fadda59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5604aeef9170 0x5604aef13350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52166/0 (socket says 172.21.15.40:52166) 2023-09-30T22:22:29.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.495+0000 7fadda59c700 1 -- 172.21.15.40:0/2874980510 learned_addr learned my addr 172.21.15.40:0/2874980510 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:29.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.495+0000 7fadd9d9b700 1 --2- 172.21.15.40:0/2874980510 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5604aeef9a40 0x5604aef13840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:29.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.495+0000 7fadda59c700 1 -- 172.21.15.40:0/2874980510 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x5604aef235b0 msgr2=0x5604aef1ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:29.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.495+0000 7fadda59c700 1 --2- 172.21.15.40:0/2874980510 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x5604aef235b0 0x5604aef1ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:29.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.495+0000 7fadda59c700 1 -- 172.21.15.40:0/2874980510 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5604aeef9a40 msgr2=0x5604aef13840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:29.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.495+0000 7fadda59c700 1 --2- 172.21.15.40:0/2874980510 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5604aeef9a40 0x5604aef13840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:29.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.495+0000 7fadda59c700 1 -- 172.21.15.40:0/2874980510 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faddc12c060 con 0x5604aeef9170 2023-09-30T22:22:29.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.495+0000 7fadd9d9b700 1 --2- 172.21.15.40:0/2874980510 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5604aeef9a40 0x5604aef13840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:29.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.495+0000 7faddad9d700 1 --2- 172.21.15.40:0/2874980510 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x5604aef235b0 0x5604aef1ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:29.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.495+0000 7fadda59c700 1 --2- 172.21.15.40:0/2874980510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5604aeef9170 0x5604aef13350 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fadcc001ba0 tx=0x7fadcc017040).ready entity=mon.0 client_cookie=fa5fc22ae00df463 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:29.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.495+0000 7fadb8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-09-30T22:22:29.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.495+0000 7fadb8ff9700 1 -- 172.21.15.40:0/2874980510 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc01a040 con 0x5604aeef9170 2023-09-30T22:22:29.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.495+0000 7fadb8ff9700 1 -- 172.21.15.40:0/2874980510 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fadcc00daa0 con 0x5604aeef9170 2023-09-30T22:22:29.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.495+0000 7fadf238ab80 1 -- 172.21.15.40:0/2874980510 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5604aeef1f20 con 0x5604aeef9170 2023-09-30T22:22:29.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.495+0000 7fadb8ff9700 1 -- 172.21.15.40:0/2874980510 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fadcc015b40 con 0x5604aeef9170 2023-09-30T22:22:29.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.495+0000 7fadf238ab80 10 client.4719 fetch_fsmap learned FSMap version 8 2023-09-30T22:22:29.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.495+0000 7fadf238ab80 1 -- 172.21.15.40:0/2874980510 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5604aee21b00 con 0x5604aeef9170 2023-09-30T22:22:29.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.496+0000 7fadb8ff9700 1 -- 172.21.15.40:0/2874980510 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5604aeef1f20 con 0x5604aeef9170 2023-09-30T22:22:29.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.496+0000 7fadb8ff9700 1 -- 172.21.15.40:0/2874980510 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 8) v1 ==== 1430+0+0 (secure 0 0 0) 0x7fadcc015ca0 con 0x5604aeef9170 2023-09-30T22:22:29.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.496+0000 7fadf238ab80 10 client.4719 fetch_fsmap finished waiting for FSMap version 8 2023-09-30T22:22:29.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.496+0000 7fadf238ab80 10 client.4719 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-30T22:22:29.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.496+0000 7fadf238ab80 20 client.4719 populate_metadata read hostname 'smithi040' 2023-09-30T22:22:29.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.496+0000 7fadf238ab80 4 client.4719 mds_command: new command op to 4194 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-30T22:22:29.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.496+0000 7fadf238ab80 1 -- 172.21.15.40:0/2874980510 --> v1:172.21.15.40:6817/2392027806 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5604aeec7250 con 0x5604aef1f720 2023-09-30T22:22:29.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.496+0000 7fadb8ff9700 10 client.4719 ms_handle_connect on v1:172.21.15.40:6817/2392027806 2023-09-30T22:22:29.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.497+0000 7fadb8ff9700 1 -- 172.21.15.40:0/2874980510 <== mds.0 v1:172.21.15.40:6817/2392027806 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (unknown 0 0 3608088055) 0x5604aeec7250 con 0x5604aef1f720 2023-09-30T22:22:29.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.497+0000 7fadb8ff9700 10 client.4719 handle_command_reply: tid=0 2023-09-30T22:22:29.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.497+0000 7fadf238ab80 1 client.4719 shutdown 2023-09-30T22:22:29.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.497+0000 7fadf238ab80 1 -- 172.21.15.40:0/2874980510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5604aeef9170 msgr2=0x5604aef13350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.497+0000 7fadf238ab80 1 --2- 172.21.15.40:0/2874980510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5604aeef9170 0x5604aef13350 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fadcc001ba0 tx=0x7fadcc017040).stop 2023-09-30T22:22:29.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.497+0000 7fadf238ab80 1 -- 172.21.15.40:0/2874980510 shutdown_connections 2023-09-30T22:22:29.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.497+0000 7fadf238ab80 1 --2- 172.21.15.40:0/2874980510 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x5604aef235b0 0x5604aef1ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:29.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.497+0000 7fadf238ab80 1 --2- 172.21.15.40:0/2874980510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5604aeef9170 0x5604aef13350 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:29.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.497+0000 7fadb8ff9700 0 client.4719 ms_handle_reset on v1:172.21.15.40:6817/2392027806 2023-09-30T22:22:29.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.497+0000 7fadf238ab80 1 --2- 172.21.15.40:0/2874980510 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5604aeef9a40 0x5604aef13840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:29.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.497+0000 7fadf238ab80 1 -- 172.21.15.40:0/2874980510 >> 172.21.15.40:0/2874980510 conn(0x5604aed67940 msgr2=0x5604aef19c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:29.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.497+0000 7fadf238ab80 1 -- 172.21.15.40:0/2874980510 shutdown_connections 2023-09-30T22:22:29.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.497+0000 7fadf238ab80 1 -- 172.21.15.40:0/2874980510 wait complete. 2023-09-30T22:22:29.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.497+0000 7fadf238ab80 20 client.4719 trim_cache size 0 max 16384 2023-09-30T22:22:29.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.514+0000 7fadf238ab80 1 Processor -- start 2023-09-30T22:22:29.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.514+0000 7fadf238ab80 1 -- start start 2023-09-30T22:22:29.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.514+0000 7fadf238ab80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5604aeef9170 0x5604aeefc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:29.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.514+0000 7fadf238ab80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5604aeef9a40 0x5604aef34d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:29.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.514+0000 7fadf238ab80 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x5604aef235b0 0x5604aef19b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:29.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.514+0000 7fadf238ab80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604aef22c20 con 0x5604aeef9a40 2023-09-30T22:22:29.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.514+0000 7fadf238ab80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604aeefaaf0 con 0x5604aeef9170 2023-09-30T22:22:29.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.514+0000 7fadf238ab80 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x5604aeec7250 con 0x5604aef235b0 2023-09-30T22:22:29.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.514+0000 7fadda59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5604aeef9170 0x5604aeefc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:29.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.514+0000 7fadd9d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5604aeef9a40 0x5604aef34d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:29.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.514+0000 7fadda59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5604aeef9170 0x5604aeefc700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:55280/0 (socket says 172.21.15.40:55280) 2023-09-30T22:22:29.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.514+0000 7fadda59c700 1 -- 172.21.15.40:0/2783514576 learned_addr learned my addr 172.21.15.40:0/2783514576 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:29.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.514+0000 7faddad9d700 1 --2- 172.21.15.40:0/2783514576 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x5604aef235b0 0x5604aef19b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:29.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.514+0000 7fadda59c700 1 -- 172.21.15.40:0/2783514576 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x5604aef235b0 msgr2=0x5604aef19b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:29.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.514+0000 7fadda59c700 1 --2- 172.21.15.40:0/2783514576 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x5604aef235b0 0x5604aef19b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:29.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.514+0000 7fadda59c700 1 -- 172.21.15.40:0/2783514576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5604aeef9a40 msgr2=0x5604aef34d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:29.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.514+0000 7fadda59c700 1 --2- 172.21.15.40:0/2783514576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5604aeef9a40 0x5604aef34d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:29.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.514+0000 7fadda59c700 1 -- 172.21.15.40:0/2783514576 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604aeefd880 con 0x5604aeef9170 2023-09-30T22:22:29.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.514+0000 7fadd9d9b700 1 --2- 172.21.15.40:0/2783514576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5604aeef9a40 0x5604aef34d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:29.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.514+0000 7faddad9d700 1 --2- 172.21.15.40:0/2783514576 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x5604aef235b0 0x5604aef19b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:22:29.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.515+0000 7fadda59c700 1 --2- 172.21.15.40:0/2783514576 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5604aeef9170 0x5604aeefc700 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fadcc001ed0 tx=0x7fadcc01c000).ready entity=mon.1 client_cookie=f8225dc6cfefc12f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:29.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.515+0000 7fadbbfff700 1 -- 172.21.15.40:0/2783514576 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc01a040 con 0x5604aeef9170 2023-09-30T22:22:29.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.515+0000 7fadbbfff700 1 -- 172.21.15.40:0/2783514576 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadcc00daa0 con 0x5604aeef9170 2023-09-30T22:22:29.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.515+0000 7fadbbfff700 1 -- 172.21.15.40:0/2783514576 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc001820 con 0x5604aeef9170 2023-09-30T22:22:29.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.515+0000 7fadf238ab80 1 -- 172.21.15.40:0/2783514576 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5604aeef9170 msgr2=0x5604aeefc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.515+0000 7fadf238ab80 1 --2- 172.21.15.40:0/2783514576 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5604aeef9170 0x5604aeefc700 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fadcc001ed0 tx=0x7fadcc01c000).stop 2023-09-30T22:22:29.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.515+0000 7fadf238ab80 1 -- 172.21.15.40:0/2783514576 shutdown_connections 2023-09-30T22:22:29.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.515+0000 7fadf238ab80 1 --2- 172.21.15.40:0/2783514576 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x5604aef235b0 0x5604aef19b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:29.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.515+0000 7fadf238ab80 1 --2- 172.21.15.40:0/2783514576 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5604aeef9170 0x5604aeefc700 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:29.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.515+0000 7fadf238ab80 1 --2- 172.21.15.40:0/2783514576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5604aeef9a40 0x5604aef34d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:29.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.515+0000 7fadf238ab80 1 -- 172.21.15.40:0/2783514576 >> 172.21.15.40:0/2783514576 conn(0x5604aed67940 msgr2=0x5604aeef7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:29.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.515+0000 7fadf238ab80 1 -- 172.21.15.40:0/2783514576 shutdown_connections 2023-09-30T22:22:29.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.515+0000 7fadf238ab80 1 -- 172.21.15.40:0/2783514576 wait complete. 2023-09-30T22:22:29.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.516+0000 7fadf238ab80 1 -- start start 2023-09-30T22:22:29.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.516+0000 7fadf238ab80 1 Processor -- start 2023-09-30T22:22:29.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.516+0000 7fadf238ab80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5604aeef9170 0x5604aef1d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:29.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.516+0000 7fadf238ab80 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x5604aeef9a40 0x5604aef1d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:29.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.516+0000 7fadf238ab80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5604aef235b0 0x5604aef7d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:22:29.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.517+0000 7fadf238ab80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604aef61e80 con 0x5604aef235b0 2023-09-30T22:22:29.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.517+0000 7fadf238ab80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604aef21c50 con 0x5604aeef9170 2023-09-30T22:22:29.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.517+0000 7fadf238ab80 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x5604aef14280 con 0x5604aeef9a40 2023-09-30T22:22:29.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.517+0000 7fadf238ab80 10 client.0 ll_register_callbacks cb 0x5604aedefce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:22:29.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.517+0000 7faddad9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5604aef235b0 0x5604aef7d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:29.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.517+0000 7faddad9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5604aef235b0 0x5604aef7d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52176/0 (socket says 172.21.15.40:52176) 2023-09-30T22:22:29.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.517+0000 7faddad9d700 1 -- 172.21.15.40:0/1120644282 learned_addr learned my addr 172.21.15.40:0/1120644282 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:22:29.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.517+0000 7fadda59c700 1 --2- 172.21.15.40:0/1120644282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5604aeef9170 0x5604aef1d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:29.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.517+0000 7fadd9d9b700 1 --2- 172.21.15.40:0/1120644282 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x5604aeef9a40 0x5604aef1d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:22:29.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.517+0000 7faddad9d700 1 -- 172.21.15.40:0/1120644282 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x5604aeef9a40 msgr2=0x5604aef1d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:29.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.517+0000 7faddad9d700 1 --2- 172.21.15.40:0/1120644282 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x5604aeef9a40 0x5604aef1d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:29.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.517+0000 7faddad9d700 1 -- 172.21.15.40:0/1120644282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5604aeef9170 msgr2=0x5604aef1d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:29.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.517+0000 7faddad9d700 1 --2- 172.21.15.40:0/1120644282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5604aeef9170 0x5604aef1d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:29.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.517+0000 7faddad9d700 1 -- 172.21.15.40:0/1120644282 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd0035040 con 0x5604aef235b0 2023-09-30T22:22:29.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.517+0000 7fadda59c700 1 --2- 172.21.15.40:0/1120644282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5604aeef9170 0x5604aef1d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:29.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.517+0000 7faddad9d700 1 --2- 172.21.15.40:0/1120644282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5604aef235b0 0x5604aef7d690 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7faddc096db0 tx=0x7fadd400b040).ready entity=mon.0 client_cookie=3ee3ee58d0de486 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:29.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.517+0000 7fadb8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-09-30T22:22:29.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.517+0000 7fadb8ff9700 1 -- 172.21.15.40:0/1120644282 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd401d070 con 0x5604aef235b0 2023-09-30T22:22:29.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.517+0000 7fadb8ff9700 1 -- 172.21.15.40:0/1120644282 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fadd4011950 con 0x5604aef235b0 2023-09-30T22:22:29.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.517+0000 7fadf238ab80 1 -- 172.21.15.40:0/1120644282 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fadd001db80 con 0x5604aef235b0 2023-09-30T22:22:29.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.517+0000 7fadb8ff9700 1 -- 172.21.15.40:0/1120644282 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fadd400e040 con 0x5604aef235b0 2023-09-30T22:22:29.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.517+0000 7fadf238ab80 10 client.4725 fetch_fsmap learned FSMap version 8 2023-09-30T22:22:29.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.517+0000 7fadf238ab80 1 -- 172.21.15.40:0/1120644282 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5604aee21b00 con 0x5604aef235b0 2023-09-30T22:22:29.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.518+0000 7fadb8ff9700 1 -- 172.21.15.40:0/1120644282 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd001db80 con 0x5604aef235b0 2023-09-30T22:22:29.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.518+0000 7fadb8ff9700 1 -- 172.21.15.40:0/1120644282 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 8) v1 ==== 1430+0+0 (secure 0 0 0) 0x7fadd4016400 con 0x5604aef235b0 2023-09-30T22:22:29.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.518+0000 7fadf238ab80 10 client.4725 fetch_fsmap finished waiting for FSMap version 8 2023-09-30T22:22:29.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.518+0000 7fadf238ab80 10 client.4725 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-30T22:22:29.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.518+0000 7fadf238ab80 20 client.4725 populate_metadata read hostname 'smithi040' 2023-09-30T22:22:29.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.518+0000 7fadf238ab80 4 client.4725 mds_command: new command op to 4194 tid=0[{"prefix": "status"}] 2023-09-30T22:22:29.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.518+0000 7fadf238ab80 1 -- 172.21.15.40:0/1120644282 --> v1:172.21.15.40:6817/2392027806 -- command(tid 0: {"prefix": "status"}) v1 -- 0x5604aecb7ef0 con 0x5604aef7e1e0 2023-09-30T22:22:29.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.518+0000 7fadb8ff9700 10 client.4725 ms_handle_connect on v1:172.21.15.40:6817/2392027806 2023-09-30T22:22:29.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.518+0000 7fadb8ff9700 1 -- 172.21.15.40:0/1120644282 <== mds.0 v1:172.21.15.40:6817/2392027806 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (unknown 0 0 3287681283) 0x5604aecb7ef0 con 0x5604aef7e1e0 2023-09-30T22:22:29.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.518+0000 7fadb8ff9700 10 client.4725 handle_command_reply: tid=0 2023-09-30T22:22:29.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.518+0000 7fadf238ab80 1 client.4725 shutdown 2023-09-30T22:22:29.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.518+0000 7fadf238ab80 1 -- 172.21.15.40:0/1120644282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5604aef235b0 msgr2=0x5604aef7d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.518+0000 7fadf238ab80 1 --2- 172.21.15.40:0/1120644282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5604aef235b0 0x5604aef7d690 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7faddc096db0 tx=0x7fadd400b040).stop 2023-09-30T22:22:29.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.518+0000 7fadf238ab80 1 -- 172.21.15.40:0/1120644282 shutdown_connections 2023-09-30T22:22:29.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.518+0000 7fadf238ab80 1 --2- 172.21.15.40:0/1120644282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5604aef235b0 0x5604aef7d690 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:29.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.518+0000 7fadf238ab80 1 --2- 172.21.15.40:0/1120644282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x5604aeef9170 0x5604aef1d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:29.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.518+0000 7fadb8ff9700 0 client.4725 ms_handle_reset on v1:172.21.15.40:6817/2392027806 2023-09-30T22:22:29.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.518+0000 7fadf238ab80 1 --2- 172.21.15.40:0/1120644282 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x5604aeef9a40 0x5604aef1d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:29.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.518+0000 7fadf238ab80 1 -- 172.21.15.40:0/1120644282 >> 172.21.15.40:0/1120644282 conn(0x5604aed67940 msgr2=0x5604aef158e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:29.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.519+0000 7fadf238ab80 1 -- 172.21.15.40:0/1120644282 shutdown_connections 2023-09-30T22:22:29.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.519+0000 7fadf238ab80 1 -- 172.21.15.40:0/1120644282 wait complete. 2023-09-30T22:22:29.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.519+0000 7fadf238ab80 20 client.4725 trim_cache size 0 max 16384 2023-09-30T22:22:29.528 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-09-30T22:22:29.528 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "79dd4d8e-f295-4d9c-bd93-9850863800e3", 2023-09-30T22:22:29.528 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2023-09-30T22:22:29.528 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4194, 2023-09-30T22:22:29.528 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2023-09-30T22:22:29.528 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2023-09-30T22:22:29.528 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2023-09-30T22:22:29.529 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 27.170976439, 2023-09-30T22:22:29.529 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 8, 2023-09-30T22:22:29.529 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 18, 2023-09-30T22:22:29.529 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 18, 2023-09-30T22:22:29.529 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 31.578436356000001 2023-09-30T22:22:29.529 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-09-30T22:22:29.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.519+0000 7fade09d7700 1 -- 172.21.15.40:0/906552113 >> v1:172.21.15.40:6816/118905 conn(0x7fadbc02bb60 legacy=0x7fadbc02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.519+0000 7fade09d7700 1 -- 172.21.15.40:0/906552113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faddc125fb0 msgr2=0x7faddc12a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.519+0000 7fade09d7700 1 --2- 172.21.15.40:0/906552113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faddc125fb0 0x7faddc12a4a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7faddc095730 tx=0x7fadd0016000).stop 2023-09-30T22:22:29.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.519+0000 7fade09d7700 1 -- 172.21.15.40:0/906552113 shutdown_connections 2023-09-30T22:22:29.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.519+0000 7fade09d7700 1 --2- 172.21.15.40:0/906552113 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faddc12e250 0x7faddc12a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:29.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.519+0000 7fade09d7700 1 --2- 172.21.15.40:0/906552113 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faddc05e090 0x7faddc129fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:29.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.519+0000 7fade09d7700 1 --2- 172.21.15.40:0/906552113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faddc125fb0 0x7faddc12a4a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:22:29.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.519+0000 7fade09d7700 1 -- 172.21.15.40:0/906552113 >> 172.21.15.40:0/906552113 conn(0x7faddc097580 msgr2=0x7faddc128830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:29.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.519+0000 7fade09d7700 1 -- 172.21.15.40:0/906552113 shutdown_connections 2023-09-30T22:22:29.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:22:29.519+0000 7fade09d7700 1 -- 172.21.15.40:0/906552113 wait complete. 2023-09-30T22:22:29.532 INFO:teuthology.run_tasks:Running task print... 2023-09-30T22:22:29.541 INFO:teuthology.task.print:**** done mds pre-upgrade sequence 2023-09-30T22:22:29.541 INFO:teuthology.run_tasks:Running task install.upgrade... 2023-09-30T22:22:29.576 INFO:teuthology.task.install:project ceph config {'mon.a': {'branch': 'reef'}} overrides {'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'} 2023-09-30T22:22:29.577 INFO:teuthology.task.install:config contains sha1|tag|branch, removing those keys from override 2023-09-30T22:22:29.577 INFO:teuthology.task.install:remote ubuntu@smithi040.front.sepia.ceph.com config {'branch': 'reef', 'flavor': 'default'} 2023-09-30T22:22:29.577 INFO:teuthology.task.install:extra packages: [] 2023-09-30T22:22:29.582 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-09-30T22:22:29.582 INFO:teuthology.task.install:Upgrading ceph rpm packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd 2023-09-30T22:22:29.583 DEBUG:teuthology.orchestra.run.smithi040:> rpm -q ceph-common --qf '%{VERSION}-%{RELEASE}' 2023-09-30T22:22:29.606 INFO:teuthology.orchestra.run.smithi040.stdout:16.2.14-44.geeb13ac9.el8 2023-09-30T22:22:29.607 INFO:teuthology.packaging:The installed version of ceph-common is 16.2.14-44.geeb13ac9.el8 2023-09-30T22:22:29.607 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2023-09-30T22:22:29.918 INFO:teuthology.task.install:Ceph rpm upgrade from 16.2.14-44.geeb13ac9.el8 to 18.2.0-501.gfc1e90a3 2023-09-30T22:22:29.918 INFO:teuthology.task.install.rpm:Host smithi040 is: centos 8 x86_64 2023-09-30T22:22:29.919 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2023-09-30T22:22:30.239 INFO:teuthology.task.install.rpm:Repo base URL: https://3.chacra.ceph.com/r/ceph/reef/fc1e90a395a6a5631142eb70fd9bf3d22740a9da/centos/8/flavors/default/ 2023-09-30T22:22:30.241 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f /etc/yum.repos.d/ceph.repo 2023-09-30T22:22:30.525 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/fc1e90a395a6a5631142eb70fd9bf3d22740a9da/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/fc1e90a395a6a5631142eb70fd9bf3d22740a9da/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/fc1e90a395a6a5631142eb70fd9bf3d22740a9da/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-30T22:22:30.526 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-09-30T22:22:30.526 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-30T22:22:30.562 DEBUG:teuthology.orchestra.run.smithi040:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-30T22:22:30.636 DEBUG:teuthology.orchestra.run.smithi040:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-30T22:22:30.708 DEBUG:teuthology.orchestra.run.smithi040:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-30T22:22:30.768 INFO:teuthology.orchestra.run.smithi040.stdout:check_obsoletes = 1 2023-09-30T22:22:30.781 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum clean all 2023-09-30T22:22:31.067 INFO:teuthology.orchestra.run.smithi040.stdout:71 files removed 2023-09-30T22:22:31.097 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y upgrade ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd 2023-09-30T22:22:31.876 INFO:teuthology.orchestra.run.smithi040.stdout:ceph packages for x86_64 216 kB/s | 80 kB 00:00 2023-09-30T22:22:32.176 INFO:teuthology.orchestra.run.smithi040.stdout:ceph noarch packages 36 kB/s | 9.4 kB 00:00 2023-09-30T22:22:32.535 INFO:teuthology.orchestra.run.smithi040.stdout:ceph source packages 4.5 kB/s | 1.5 kB 00:00 2023-09-30T22:22:34.760 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - AppStream 15 MB/s | 33 MB 00:02 2023-09-30T22:22:48.552 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - BaseOS 6.5 MB/s | 48 MB 00:07 2023-09-30T22:22:56.335 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - Extras 54 kB/s | 18 kB 00:00 2023-09-30T22:22:56.936 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 6.9 kB 00:00 2023-09-30T22:22:57.488 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - PowerTools 17 MB/s | 6.5 MB 00:00 2023-09-30T22:22:59.003 INFO:teuthology.orchestra.run.smithi040.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2023-09-30T22:23:02.868 INFO:teuthology.orchestra.run.smithi040.stdout:Extra Packages for Enterprise Linux 4.3 MB/s | 16 MB 00:03 2023-09-30T22:23:06.957 INFO:teuthology.orchestra.run.smithi040.stdout:lab-extras 567 kB/s | 24 kB 00:00 2023-09-30T22:23:11.534 INFO:teuthology.orchestra.run.smithi040.stderr:Package cephadm available, but not installed. 2023-09-30T22:23:11.535 INFO:teuthology.orchestra.run.smithi040.stdout:No match for argument: cephadm 2023-09-30T22:23:11.535 INFO:teuthology.orchestra.run.smithi040.stderr:Package ceph-immutable-object-cache available, but not installed. 2023-09-30T22:23:11.535 INFO:teuthology.orchestra.run.smithi040.stdout:No match for argument: ceph-immutable-object-cache 2023-09-30T22:23:11.549 INFO:teuthology.orchestra.run.smithi040.stderr:Package ceph-mgr-cephadm available, but not installed. 2023-09-30T22:23:11.549 INFO:teuthology.orchestra.run.smithi040.stdout:No match for argument: ceph-mgr-cephadm 2023-09-30T22:23:11.552 INFO:teuthology.orchestra.run.smithi040.stderr:Package ceph-volume available, but not installed. 2023-09-30T22:23:11.553 INFO:teuthology.orchestra.run.smithi040.stdout:No match for argument: ceph-volume 2023-09-30T22:23:11.852 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2023-09-30T22:23:11.857 INFO:teuthology.orchestra.run.smithi040.stdout:====================================================================================== 2023-09-30T22:23:11.857 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repository Size 2023-09-30T22:23:11.857 INFO:teuthology.orchestra.run.smithi040.stdout:====================================================================================== 2023-09-30T22:23:11.858 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrading: 2023-09-30T22:23:11.858 INFO:teuthology.orchestra.run.smithi040.stdout: ceph x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 6.4 k 2023-09-30T22:23:11.858 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 5.4 M 2023-09-30T22:23:11.858 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-common x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 22 M 2023-09-30T22:23:11.858 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-fuse x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 847 k 2023-09-30T22:23:11.858 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-grafana-dashboards noarch 2:18.2.0-501.gfc1e90a3.el8 ceph-noarch 23 k 2023-09-30T22:23:11.858 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mds x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 2.3 M 2023-09-30T22:23:11.858 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 1.5 M 2023-09-30T22:23:11.858 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard noarch 2:18.2.0-501.gfc1e90a3.el8 ceph-noarch 1.7 M 2023-09-30T22:23:11.858 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-501.gfc1e90a3.el8 ceph-noarch 7.4 M 2023-09-30T22:23:11.858 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core noarch 2:18.2.0-501.gfc1e90a3.el8 ceph-noarch 241 k 2023-09-30T22:23:11.859 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-rook noarch 2:18.2.0-501.gfc1e90a3.el8 ceph-noarch 47 k 2023-09-30T22:23:11.859 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mon x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 4.6 M 2023-09-30T22:23:11.859 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-osd x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 18 M 2023-09-30T22:23:11.859 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-prometheus-alerts noarch 2:18.2.0-501.gfc1e90a3.el8 ceph-noarch 15 k 2023-09-30T22:23:11.859 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-radosgw x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 13 M 2023-09-30T22:23:11.859 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-selinux x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 24 k 2023-09-30T22:23:11.859 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-test x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 47 M 2023-09-30T22:23:11.859 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs-devel x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 30 k 2023-09-30T22:23:11.859 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2 x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 769 k 2023-09-30T22:23:11.859 INFO:teuthology.orchestra.run.smithi040.stdout: libcephsqlite x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 137 k 2023-09-30T22:23:11.859 INFO:teuthology.orchestra.run.smithi040.stdout: librados-devel x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 139 k 2023-09-30T22:23:11.860 INFO:teuthology.orchestra.run.smithi040.stdout: librados2 x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 3.7 M 2023-09-30T22:23:11.860 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1 x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 474 k 2023-09-30T22:23:11.860 INFO:teuthology.orchestra.run.smithi040.stdout: librbd1 x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 3.6 M 2023-09-30T22:23:11.860 INFO:teuthology.orchestra.run.smithi040.stdout: librgw2 x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 6.5 M 2023-09-30T22:23:11.860 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 45 k 2023-09-30T22:23:11.860 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 123 k 2023-09-30T22:23:11.860 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cephfs x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 190 k 2023-09-30T22:23:11.860 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 371 k 2023-09-30T22:23:11.860 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rbd x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 364 k 2023-09-30T22:23:11.860 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rgw x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 107 k 2023-09-30T22:23:11.860 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-fuse x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 94 k 2023-09-30T22:23:11.861 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-mirror x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 3.4 M 2023-09-30T22:23:11.861 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-nbd x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 179 k 2023-09-30T22:23:11.861 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2023-09-30T22:23:11.861 INFO:teuthology.orchestra.run.smithi040.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-09-30T22:23:11.861 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:23:11.861 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2023-09-30T22:23:11.861 INFO:teuthology.orchestra.run.smithi040.stdout:====================================================================================== 2023-09-30T22:23:11.861 INFO:teuthology.orchestra.run.smithi040.stdout:Install 1 Package 2023-09-30T22:23:11.861 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrade 34 Packages 2023-09-30T22:23:11.861 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:23:11.862 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 145 M 2023-09-30T22:23:11.862 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2023-09-30T22:23:12.350 INFO:teuthology.orchestra.run.smithi040.stdout:(1/35): ceph-18.2.0-501.gfc1e90a3.el8.x86_64.rp 46 kB/s | 6.4 kB 00:00 2023-09-30T22:23:12.701 INFO:teuthology.orchestra.run.smithi040.stdout:(2/35): ceph-base-18.2.0-501.gfc1e90a3.el8.x86_ 11 MB/s | 5.4 MB 00:00 2023-09-30T22:23:12.784 INFO:teuthology.orchestra.run.smithi040.stdout:(3/35): ceph-fuse-18.2.0-501.gfc1e90a3.el8.x86_ 10 MB/s | 847 kB 00:00 2023-09-30T22:23:12.826 INFO:teuthology.orchestra.run.smithi040.stdout:(4/35): thrift-0.13.0-2.el8.x86_64.rpm 2.8 MB/s | 1.7 MB 00:00 2023-09-30T22:23:12.926 INFO:teuthology.orchestra.run.smithi040.stdout:(5/35): ceph-mds-18.2.0-501.gfc1e90a3.el8.x86_6 16 MB/s | 2.3 MB 00:00 2023-09-30T22:23:13.202 INFO:teuthology.orchestra.run.smithi040.stdout:(6/35): ceph-mon-18.2.0-501.gfc1e90a3.el8.x86_6 17 MB/s | 4.6 MB 00:00 2023-09-30T22:23:13.752 INFO:teuthology.orchestra.run.smithi040.stdout:(7/35): ceph-mgr-18.2.0-501.gfc1e90a3.el8.x86_6 1.7 MB/s | 1.5 MB 00:00 2023-09-30T22:23:14.235 INFO:teuthology.orchestra.run.smithi040.stdout:(8/35): ceph-osd-18.2.0-501.gfc1e90a3.el8.x86_6 17 MB/s | 18 MB 00:01 2023-09-30T22:23:14.286 INFO:teuthology.orchestra.run.smithi040.stdout:(9/35): ceph-selinux-18.2.0-501.gfc1e90a3.el8.x 487 kB/s | 24 kB 00:00 2023-09-30T22:23:16.761 INFO:teuthology.orchestra.run.smithi040.stdout:(10/35): ceph-common-18.2.0-501.gfc1e90a3.el8.x 4.9 MB/s | 22 MB 00:04 2023-09-30T22:23:17.244 INFO:teuthology.orchestra.run.smithi040.stdout:(11/35): ceph-test-18.2.0-501.gfc1e90a3.el8.x86 16 MB/s | 47 MB 00:02 2023-09-30T22:23:17.269 INFO:teuthology.orchestra.run.smithi040.stdout:(12/35): libcephfs-devel-18.2.0-501.gfc1e90a3.e 60 kB/s | 30 kB 00:00 2023-09-30T22:23:17.320 INFO:teuthology.orchestra.run.smithi040.stdout:(13/35): libcephfs2-18.2.0-501.gfc1e90a3.el8.x8 10 MB/s | 769 kB 00:00 2023-09-30T22:23:17.345 INFO:teuthology.orchestra.run.smithi040.stdout:(14/35): libcephsqlite-18.2.0-501.gfc1e90a3.el8 1.8 MB/s | 137 kB 00:00 2023-09-30T22:23:17.370 INFO:teuthology.orchestra.run.smithi040.stdout:(15/35): librados-devel-18.2.0-501.gfc1e90a3.el 2.7 MB/s | 139 kB 00:00 2023-09-30T22:23:17.513 INFO:teuthology.orchestra.run.smithi040.stdout:(16/35): ceph-radosgw-18.2.0-501.gfc1e90a3.el8. 3.5 MB/s | 13 MB 00:03 2023-09-30T22:23:17.546 INFO:teuthology.orchestra.run.smithi040.stdout:(17/35): libradosstriper1-18.2.0-501.gfc1e90a3. 2.6 MB/s | 474 kB 00:00 2023-09-30T22:23:18.013 INFO:teuthology.orchestra.run.smithi040.stdout:(18/35): librgw2-18.2.0-501.gfc1e90a3.el8.x86_6 14 MB/s | 6.5 MB 00:00 2023-09-30T22:23:18.072 INFO:teuthology.orchestra.run.smithi040.stdout:(19/35): librados2-18.2.0-501.gfc1e90a3.el8.x86 5.0 MB/s | 3.7 MB 00:00 2023-09-30T22:23:18.089 INFO:teuthology.orchestra.run.smithi040.stdout:(20/35): python3-ceph-argparse-18.2.0-501.gfc1e 593 kB/s | 45 kB 00:00 2023-09-30T22:23:18.114 INFO:teuthology.orchestra.run.smithi040.stdout:(21/35): python3-ceph-common-18.2.0-501.gfc1e90 2.9 MB/s | 123 kB 00:00 2023-09-30T22:23:18.139 INFO:teuthology.orchestra.run.smithi040.stdout:(22/35): python3-cephfs-18.2.0-501.gfc1e90a3.el 3.7 MB/s | 190 kB 00:00 2023-09-30T22:23:18.173 INFO:teuthology.orchestra.run.smithi040.stdout:(23/35): python3-rados-18.2.0-501.gfc1e90a3.el8 6.2 MB/s | 371 kB 00:00 2023-09-30T22:23:18.228 INFO:teuthology.orchestra.run.smithi040.stdout:(24/35): python3-rbd-18.2.0-501.gfc1e90a3.el8.x 4.0 MB/s | 364 kB 00:00 2023-09-30T22:23:18.265 INFO:teuthology.orchestra.run.smithi040.stdout:(25/35): python3-rgw-18.2.0-501.gfc1e90a3.el8.x 1.1 MB/s | 107 kB 00:00 2023-09-30T22:23:18.291 INFO:teuthology.orchestra.run.smithi040.stdout:(26/35): rbd-fuse-18.2.0-501.gfc1e90a3.el8.x86_ 1.5 MB/s | 94 kB 00:00 2023-09-30T22:23:18.357 INFO:teuthology.orchestra.run.smithi040.stdout:(27/35): librbd1-18.2.0-501.gfc1e90a3.el8.x86_6 4.2 MB/s | 3.6 MB 00:00 2023-09-30T22:23:18.383 INFO:teuthology.orchestra.run.smithi040.stdout:(28/35): rbd-nbd-18.2.0-501.gfc1e90a3.el8.x86_6 1.9 MB/s | 179 kB 00:00 2023-09-30T22:23:18.416 INFO:teuthology.orchestra.run.smithi040.stdout:(29/35): ceph-grafana-dashboards-18.2.0-501.gfc 394 kB/s | 23 kB 00:00 2023-09-30T22:23:18.525 INFO:teuthology.orchestra.run.smithi040.stdout:(30/35): ceph-mgr-dashboard-18.2.0-501.gfc1e90a 12 MB/s | 1.7 MB 00:00 2023-09-30T22:23:18.592 INFO:teuthology.orchestra.run.smithi040.stdout:(31/35): ceph-mgr-modules-core-18.2.0-501.gfc1e 3.5 MB/s | 241 kB 00:00 2023-09-30T22:23:18.642 INFO:teuthology.orchestra.run.smithi040.stdout:(32/35): ceph-mgr-rook-18.2.0-501.gfc1e90a3.el8 950 kB/s | 47 kB 00:00 2023-09-30T22:23:18.701 INFO:teuthology.orchestra.run.smithi040.stdout:(33/35): rbd-mirror-18.2.0-501.gfc1e90a3.el8.x8 7.9 MB/s | 3.4 MB 00:00 2023-09-30T22:23:18.718 INFO:teuthology.orchestra.run.smithi040.stdout:(34/35): ceph-prometheus-alerts-18.2.0-501.gfc1 193 kB/s | 15 kB 00:00 2023-09-30T22:23:19.535 INFO:teuthology.orchestra.run.smithi040.stdout:(35/35): ceph-mgr-diskprediction-local-18.2.0-5 6.6 MB/s | 7.4 MB 00:01 2023-09-30T22:23:19.538 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2023-09-30T22:23:19.538 INFO:teuthology.orchestra.run.smithi040.stdout:Total 19 MB/s | 145 MB 00:07 2023-09-30T22:23:19.539 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2023-09-30T22:23:19.616 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2023-09-30T22:23:19.616 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2023-09-30T22:23:20.306 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2023-09-30T22:23:20.309 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2023-09-30T22:23:22.895 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2023-09-30T22:23:23.077 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-09-30T22:23:23.640 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/69 2023-09-30T22:23:23.917 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librados2-2:18.2.0-501.gfc1e90a3.el8.x86_64 2/69 2023-09-30T22:23:24.337 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-2:18.2.0-501.gfc1e90a3.el8.x86_64 2/69 2023-09-30T22:23:24.509 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librbd1-2:18.2.0-501.gfc1e90a3.el8.x86_64 3/69 2023-09-30T22:23:24.649 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librbd1-2:18.2.0-501.gfc1e90a3.el8.x86_64 3/69 2023-09-30T22:23:24.875 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : libcephfs2-2:18.2.0-501.gfc1e90a3.el8.x86_64 4/69 2023-09-30T22:23:25.688 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephfs2-2:18.2.0-501.gfc1e90a3.el8.x86_64 4/69 2023-09-30T22:23:26.092 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librgw2-2:18.2.0-501.gfc1e90a3.el8.x86_64 5/69 2023-09-30T22:23:26.190 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librgw2-2:18.2.0-501.gfc1e90a3.el8.x86_64 5/69 2023-09-30T22:23:26.430 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : python3-rados-2:18.2.0-501.gfc1e90a3.el8.x86_64 6/69 2023-09-30T22:23:26.865 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : libcephsqlite-2:18.2.0-501.gfc1e90a3.el8.x86_64 7/69 2023-09-30T22:23:27.267 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephsqlite-2:18.2.0-501.gfc1e90a3.el8.x86_64 7/69 2023-09-30T22:23:27.485 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : libradosstriper1-2:18.2.0-501.gfc1e90a3.el8.x86_64 8/69 2023-09-30T22:23:27.546 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libradosstriper1-2:18.2.0-501.gfc1e90a3.el8.x86_64 8/69 2023-09-30T22:23:27.705 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : python3-ceph-argparse-2:18.2.0-501.gfc1e90a3.el8.x 9/69 2023-09-30T22:23:27.998 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : python3-cephfs-2:18.2.0-501.gfc1e90a3.el8.x86_64 10/69 2023-09-30T22:23:28.255 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : python3-rbd-2:18.2.0-501.gfc1e90a3.el8.x86_64 11/69 2023-09-30T22:23:28.525 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : python3-rgw-2:18.2.0-501.gfc1e90a3.el8.x86_64 12/69 2023-09-30T22:23:28.752 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librados-devel-2:18.2.0-501.gfc1e90a3.el8.x86_64 13/69 2023-09-30T22:23:28.922 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : ceph-prometheus-alerts-2:18.2.0-501.gfc1e90a3.el8. 14/69 2023-09-30T22:23:29.096 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : ceph-grafana-dashboards-2:18.2.0-501.gfc1e90a3.el8 15/69 2023-09-30T22:23:29.359 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : python3-ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86 16/69 2023-09-30T22:23:31.926 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86_64 17/69 2023-09-30T22:23:32.208 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86_64 17/69 2023-09-30T22:23:32.902 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86_64 17/69 2023-09-30T22:23:33.246 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : ceph-base-2:18.2.0-501.gfc1e90a3.el8.x86_64 18/69 2023-09-30T22:23:33.312 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-base-2:18.2.0-501.gfc1e90a3.el8.x86_64 18/69 2023-09-30T22:23:33.482 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : ceph-selinux-2:18.2.0-501.gfc1e90a3.el8.x86_64 19/69 2023-09-30T22:23:51.564 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-selinux-2:18.2.0-501.gfc1e90a3.el8.x86_64 19/69 2023-09-30T22:23:51.843 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : ceph-mgr-dashboard-2:18.2.0-501.gfc1e90a3.el8.noar 20/69 2023-09-30T22:23:53.090 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-501.gfc1e90a3.el8.noar 20/69 2023-09-30T22:23:53.305 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : ceph-mgr-diskprediction-local-2:18.2.0-501.gfc1e90 21/69 2023-09-30T22:23:53.409 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-501.gfc1e90 21/69 2023-09-30T22:23:53.864 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : ceph-mgr-modules-core-2:18.2.0-501.gfc1e90a3.el8.n 22/69 2023-09-30T22:23:54.118 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : ceph-mgr-2:18.2.0-501.gfc1e90a3.el8.x86_64 23/69 2023-09-30T22:23:54.143 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-2:18.2.0-501.gfc1e90a3.el8.x86_64 23/69 2023-09-30T22:23:54.380 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : ceph-mgr-rook-2:18.2.0-501.gfc1e90a3.el8.noarch 24/69 2023-09-30T22:23:54.599 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-501.gfc1e90a3.el8.noarch 24/69 2023-09-30T22:23:54.847 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : ceph-mds-2:18.2.0-501.gfc1e90a3.el8.x86_64 25/69 2023-09-30T22:23:55.389 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mds-2:18.2.0-501.gfc1e90a3.el8.x86_64 25/69 2023-09-30T22:23:55.672 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : ceph-mon-2:18.2.0-501.gfc1e90a3.el8.x86_64 26/69 2023-09-30T22:23:57.624 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mon-2:18.2.0-501.gfc1e90a3.el8.x86_64 26/69 2023-09-30T22:23:57.917 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : ceph-osd-2:18.2.0-501.gfc1e90a3.el8.x86_64 27/69 2023-09-30T22:23:57.929 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-osd-2:18.2.0-501.gfc1e90a3.el8.x86_64 27/69 2023-09-30T22:23:59.702 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : ceph-2:18.2.0-501.gfc1e90a3.el8.x86_64 28/69 2023-09-30T22:23:59.975 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : ceph-radosgw-2:18.2.0-501.gfc1e90a3.el8.x86_64 29/69 2023-09-30T22:24:00.403 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-501.gfc1e90a3.el8.x86_64 29/69 2023-09-30T22:24:00.688 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : rbd-mirror-2:18.2.0-501.gfc1e90a3.el8.x86_64 30/69 2023-09-30T22:24:05.908 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: rbd-mirror-2:18.2.0-501.gfc1e90a3.el8.x86_64 30/69 2023-09-30T22:24:06.317 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : ceph-test-2:18.2.0-501.gfc1e90a3.el8.x86_64 31/69 2023-09-30T22:24:06.463 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : libcephfs-devel-2:18.2.0-501.gfc1e90a3.el8.x86_64 32/69 2023-09-30T22:24:06.713 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : rbd-fuse-2:18.2.0-501.gfc1e90a3.el8.x86_64 33/69 2023-09-30T22:24:07.025 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : rbd-nbd-2:18.2.0-501.gfc1e90a3.el8.x86_64 34/69 2023-09-30T22:24:07.305 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : ceph-fuse-2:18.2.0-501.gfc1e90a3.el8.x86_64 35/69 2023-09-30T22:24:07.474 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 36/69 2023-09-30T22:24:07.871 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 37/69 2023-09-30T22:24:07.880 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 38/69 2023-09-30T22:24:07.881 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 38/69 2023-09-30T22:24:08.243 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 38/69 2023-09-30T22:24:08.371 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 39/69 2023-09-30T22:24:08.371 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 40/69 2023-09-30T22:24:08.605 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 40/69 2023-09-30T22:24:08.612 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 41/69 2023-09-30T22:24:08.613 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 41/69 2023-09-30T22:24:08.848 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 41/69 2023-09-30T22:24:09.067 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.n 42/69 2023-09-30T22:24:09.271 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 43/69 2023-09-30T22:24:09.277 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 44/69 2023-09-30T22:24:09.278 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 44/69 2023-09-30T22:24:09.546 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 44/69 2023-09-30T22:24:09.762 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 45/69 2023-09-30T22:24:09.762 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 46/69 2023-09-30T22:24:10.038 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 46/69 2023-09-30T22:24:10.238 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 47/69 2023-09-30T22:24:10.245 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 48/69 2023-09-30T22:24:10.246 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 48/69 2023-09-30T22:24:10.671 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 48/69 2023-09-30T22:24:10.671 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noar 49/69 2023-09-30T22:24:11.076 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noar 49/69 2023-09-30T22:24:11.082 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 50/69 2023-09-30T22:24:11.082 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 50/69 2023-09-30T22:24:11.288 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 50/69 2023-09-30T22:24:11.294 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-09-30T22:24:11.295 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-09-30T22:24:11.455 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-09-30T22:24:11.455 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 52/69 2023-09-30T22:24:11.622 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 52/69 2023-09-30T22:24:11.651 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-09-30T22:24:11.652 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-09-30T22:24:11.996 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-09-30T22:24:11.997 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 54/69 2023-09-30T22:24:12.246 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 54/69 2023-09-30T22:24:12.246 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 55/69 2023-09-30T22:24:12.505 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 55/69 2023-09-30T22:24:12.728 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 56/69 2023-09-30T22:24:12.913 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 57/69 2023-09-30T22:24:12.913 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 58/69 2023-09-30T22:24:13.213 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 58/69 2023-09-30T22:24:13.445 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 59/69 2023-09-30T22:24:13.446 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 60/69 2023-09-30T22:24:13.704 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 60/69 2023-09-30T22:24:13.929 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 61/69 2023-09-30T22:24:13.929 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 62/69 2023-09-30T22:24:14.205 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 62/69 2023-09-30T22:24:14.445 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 63/69 2023-09-30T22:24:14.563 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x 64/69 2023-09-30T22:24:14.795 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86 65/69 2023-09-30T22:24:15.003 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8 66/69 2023-09-30T22:24:15.105 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8. 67/69 2023-09-30T22:24:15.106 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13a 68/69 2023-09-30T22:24:15.321 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13a 68/69 2023-09-30T22:24:15.322 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 69/69 2023-09-30T22:24:16.107 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 69/69 2023-09-30T22:24:16.107 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 1/69 2023-09-30T22:24:16.107 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-2:18.2.0-501.gfc1e90a3.el8.x86_64 2/69 2023-09-30T22:24:16.107 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 3/69 2023-09-30T22:24:16.107 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-base-2:18.2.0-501.gfc1e90a3.el8.x86_64 4/69 2023-09-30T22:24:16.107 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 5/69 2023-09-30T22:24:16.107 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86_64 6/69 2023-09-30T22:24:16.107 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 7/69 2023-09-30T22:24:16.107 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-fuse-2:18.2.0-501.gfc1e90a3.el8.x86_64 8/69 2023-09-30T22:24:16.108 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 9/69 2023-09-30T22:24:16.108 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mds-2:18.2.0-501.gfc1e90a3.el8.x86_64 10/69 2023-09-30T22:24:16.108 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 11/69 2023-09-30T22:24:16.108 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-2:18.2.0-501.gfc1e90a3.el8.x86_64 12/69 2023-09-30T22:24:16.108 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 13/69 2023-09-30T22:24:16.108 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mon-2:18.2.0-501.gfc1e90a3.el8.x86_64 14/69 2023-09-30T22:24:16.108 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 15/69 2023-09-30T22:24:16.108 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-osd-2:18.2.0-501.gfc1e90a3.el8.x86_64 16/69 2023-09-30T22:24:16.108 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 17/69 2023-09-30T22:24:16.108 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-radosgw-2:18.2.0-501.gfc1e90a3.el8.x86_64 18/69 2023-09-30T22:24:16.108 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 19/69 2023-09-30T22:24:16.108 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-selinux-2:18.2.0-501.gfc1e90a3.el8.x86_64 20/69 2023-09-30T22:24:16.109 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 21/69 2023-09-30T22:24:16.109 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-test-2:18.2.0-501.gfc1e90a3.el8.x86_64 22/69 2023-09-30T22:24:16.109 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 23/69 2023-09-30T22:24:16.109 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs-devel-2:18.2.0-501.gfc1e90a3.el8.x86_64 24/69 2023-09-30T22:24:16.109 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 25/69 2023-09-30T22:24:16.109 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs2-2:18.2.0-501.gfc1e90a3.el8.x86_64 26/69 2023-09-30T22:24:16.109 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 27/69 2023-09-30T22:24:16.109 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephsqlite-2:18.2.0-501.gfc1e90a3.el8.x86_64 28/69 2023-09-30T22:24:16.109 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 29/69 2023-09-30T22:24:16.109 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados-devel-2:18.2.0-501.gfc1e90a3.el8.x86_64 30/69 2023-09-30T22:24:16.109 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 31/69 2023-09-30T22:24:16.109 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados2-2:18.2.0-501.gfc1e90a3.el8.x86_64 32/69 2023-09-30T22:24:16.109 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 33/69 2023-09-30T22:24:16.110 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libradosstriper1-2:18.2.0-501.gfc1e90a3.el8.x86_64 34/69 2023-09-30T22:24:16.110 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 35/69 2023-09-30T22:24:16.110 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librbd1-2:18.2.0-501.gfc1e90a3.el8.x86_64 36/69 2023-09-30T22:24:16.110 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 37/69 2023-09-30T22:24:16.110 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librgw2-2:18.2.0-501.gfc1e90a3.el8.x86_64 38/69 2023-09-30T22:24:16.110 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 39/69 2023-09-30T22:24:16.110 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-argparse-2:18.2.0-501.gfc1e90a3.el8.x 40/69 2023-09-30T22:24:16.110 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x 41/69 2023-09-30T22:24:16.110 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86 42/69 2023-09-30T22:24:16.110 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86 43/69 2023-09-30T22:24:16.110 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cephfs-2:18.2.0-501.gfc1e90a3.el8.x86_64 44/69 2023-09-30T22:24:16.110 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 45/69 2023-09-30T22:24:16.111 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rados-2:18.2.0-501.gfc1e90a3.el8.x86_64 46/69 2023-09-30T22:24:16.111 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 47/69 2023-09-30T22:24:16.111 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rbd-2:18.2.0-501.gfc1e90a3.el8.x86_64 48/69 2023-09-30T22:24:16.111 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 49/69 2023-09-30T22:24:16.111 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rgw-2:18.2.0-501.gfc1e90a3.el8.x86_64 50/69 2023-09-30T22:24:16.111 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-09-30T22:24:16.111 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-fuse-2:18.2.0-501.gfc1e90a3.el8.x86_64 52/69 2023-09-30T22:24:16.111 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-09-30T22:24:16.111 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-mirror-2:18.2.0-501.gfc1e90a3.el8.x86_64 54/69 2023-09-30T22:24:16.111 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 55/69 2023-09-30T22:24:16.111 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-nbd-2:18.2.0-501.gfc1e90a3.el8.x86_64 56/69 2023-09-30T22:24:16.111 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 57/69 2023-09-30T22:24:16.112 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-501.gfc1e90a3.el8 58/69 2023-09-30T22:24:16.112 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8 59/69 2023-09-30T22:24:16.112 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-501.gfc1e90a3.el8.noar 60/69 2023-09-30T22:24:16.112 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noar 61/69 2023-09-30T22:24:16.112 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-501.gfc1e90 62/69 2023-09-30T22:24:16.112 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13a 63/69 2023-09-30T22:24:16.112 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-501.gfc1e90a3.el8.n 64/69 2023-09-30T22:24:16.112 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.n 65/69 2023-09-30T22:24:16.112 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-rook-2:18.2.0-501.gfc1e90a3.el8.noarch 66/69 2023-09-30T22:24:16.112 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 67/69 2023-09-30T22:24:16.112 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-501.gfc1e90a3.el8. 68/69 2023-09-30T22:24:17.854 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8. 69/69 2023-09-30T22:24:17.854 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:24:17.854 INFO:teuthology.orchestra.run.smithi040.stdout:Upgraded: 2023-09-30T22:24:17.854 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:24:17.854 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:24:17.854 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:24:17.854 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-fuse-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:24:17.854 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-grafana-dashboards-2:18.2.0-501.gfc1e90a3.el8.noarch 2023-09-30T22:24:17.855 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mds-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:24:17.855 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:24:17.855 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard-2:18.2.0-501.gfc1e90a3.el8.noarch 2023-09-30T22:24:17.855 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-diskprediction-local-2:18.2.0-501.gfc1e90a3.el8.noarch 2023-09-30T22:24:17.855 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core-2:18.2.0-501.gfc1e90a3.el8.noarch 2023-09-30T22:24:17.855 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-rook-2:18.2.0-501.gfc1e90a3.el8.noarch 2023-09-30T22:24:17.855 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mon-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:24:17.855 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-osd-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:24:17.855 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-prometheus-alerts-2:18.2.0-501.gfc1e90a3.el8.noarch 2023-09-30T22:24:17.855 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-radosgw-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:24:17.855 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-selinux-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:24:17.855 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-test-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:24:17.855 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs-devel-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:24:17.856 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:24:17.856 INFO:teuthology.orchestra.run.smithi040.stdout: libcephsqlite-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:24:17.856 INFO:teuthology.orchestra.run.smithi040.stdout: librados-devel-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:24:17.856 INFO:teuthology.orchestra.run.smithi040.stdout: librados2-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:24:17.856 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:24:17.856 INFO:teuthology.orchestra.run.smithi040.stdout: librbd1-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:24:17.856 INFO:teuthology.orchestra.run.smithi040.stdout: librgw2-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:24:17.856 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:24:17.856 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:24:17.856 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cephfs-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:24:17.856 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:24:17.856 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rbd-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:24:17.857 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rgw-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:24:17.857 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-fuse-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:24:17.857 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-mirror-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:24:17.857 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-nbd-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:24:17.857 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2023-09-30T22:24:17.857 INFO:teuthology.orchestra.run.smithi040.stdout: thrift-0.13.0-2.el8.x86_64 2023-09-30T22:24:17.857 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:24:17.857 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2023-09-30T22:24:18.047 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2023-09-30T22:24:18.260 DEBUG:teuthology.orchestra.run.smithi040:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-30T22:24:18.285 INFO:teuthology.orchestra.run.smithi040.stdout:18.2.0-501.gfc1e90a3.el8 2023-09-30T22:24:18.285 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-501.gfc1e90a3.el8 2023-09-30T22:24:18.286 INFO:teuthology.task.install:The correct ceph version 18.2.0-501.gfc1e90a3 is installed. 2023-09-30T22:24:18.286 INFO:teuthology.run_tasks:Running task print... 2023-09-30T22:24:18.296 INFO:teuthology.task.print:**** done install.upgrade the host 2023-09-30T22:24:18.296 INFO:teuthology.run_tasks:Running task ceph.restart... 2023-09-30T22:24:18.338 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-09-30T22:24:18.338 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:24:18.349 INFO:tasks.ceph.mon.a:Stopped 2023-09-30T22:24:18.349 INFO:tasks.ceph.mon.a:Restarting daemon 2023-09-30T22:24:18.349 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-09-30T22:24:18.391 INFO:tasks.ceph.mon.a:Started 2023-09-30T22:24:18.391 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-09-30T22:24:18.392 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:24:18.404 INFO:tasks.ceph.mon.b:Stopped 2023-09-30T22:24:18.404 INFO:tasks.ceph.mon.b:Restarting daemon 2023-09-30T22:24:18.405 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-09-30T22:24:18.446 INFO:tasks.ceph.mon.b:Started 2023-09-30T22:24:18.447 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-09-30T22:24:18.447 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:24:18.460 INFO:tasks.ceph.mon.c:Stopped 2023-09-30T22:24:18.460 INFO:tasks.ceph.mon.c:Restarting daemon 2023-09-30T22:24:18.460 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-09-30T22:24:18.503 INFO:tasks.ceph.mon.c:Started 2023-09-30T22:24:18.504 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-09-30T22:24:18.504 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:24:18.531 INFO:tasks.ceph.mgr.x:Stopped 2023-09-30T22:24:18.531 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-09-30T22:24:18.531 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-09-30T22:24:18.573 INFO:tasks.ceph.mgr.x:Started 2023-09-30T22:24:18.574 INFO:teuthology.run_tasks:Running task ceph.healthy... 2023-09-30T22:24:18.583 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-09-30T22:24:18.583 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-09-30T22:24:18.583 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-09-30T22:24:18.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.714+0000 7f4ca8fd6700 1 Processor -- start 2023-09-30T22:24:18.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.714+0000 7f4ca8fd6700 1 -- start start 2023-09-30T22:24:18.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.715+0000 7f4ca8fd6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ca406f070 0x7f4ca406f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.715+0000 7f4ca8fd6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4ca406fdb0 0x7f4ca40977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.715+0000 7f4ca8fd6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ca4070830 con 0x7f4ca406f980 2023-09-30T22:24:18.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.715+0000 7f4ca8fd6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ca4071af0 con 0x7f4ca406fdb0 2023-09-30T22:24:18.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.715+0000 7f4ca8fd6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca4070ad0 con 0x7f4ca406f070 2023-09-30T22:24:18.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.715+0000 7f4ca259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ca406f070 0x7f4ca406f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.715+0000 7f4ca2d9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4ca406fdb0 0x7f4ca40977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.715+0000 7f4ca1d9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f4ca406f980 0x7f4ca4097090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50050/0 (socket says 172.21.15.40:50050) 2023-09-30T22:24:18.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.715+0000 7f4ca1d9b700 1 -- 172.21.15.40:0/3662362252 learned_addr learned my addr 172.21.15.40:0/3662362252 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:24:18.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.715+0000 7f4ca259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ca406f070 0x7f4ca406f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:56454/0 (socket says 172.21.15.40:56454) 2023-09-30T22:24:18.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.715+0000 7f4ca2d9d700 1 -- 172.21.15.40:0/3662362252 >> v2:172.21.15.40:3300/0 conn(0x7f4ca406fdb0 msgr2=0x7f4ca40977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-09-30T22:24:18.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.715+0000 7f4ca2d9d700 1 -- 172.21.15.40:0/3662362252 >> v2:172.21.15.40:3300/0 conn(0x7f4ca406fdb0 msgr2=0x7f4ca40977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:24:18.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.715+0000 7f4ca2d9d700 1 --2- 172.21.15.40:0/3662362252 >> v2:172.21.15.40:3300/0 conn(0x7f4ca406fdb0 0x7f4ca40977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-30T22:24:18.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.715+0000 7f4ca2d9d700 1 --2- 172.21.15.40:0/3662362252 >> v2:172.21.15.40:3300/0 conn(0x7f4ca406fdb0 0x7f4ca40977a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-30T22:24:18.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.715+0000 7f4ca259c700 1 -- 172.21.15.40:0/3662362252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ca406f070 msgr2=0x7f4ca406f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-30T22:24:18.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.715+0000 7f4ca259c700 1 -- 172.21.15.40:0/3662362252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ca406f070 msgr2=0x7f4ca406f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:24:18.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.715+0000 7f4ca259c700 1 --2- 172.21.15.40:0/3662362252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ca406f070 0x7f4ca406f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-30T22:24:18.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.715+0000 7f4ca259c700 1 --2- 172.21.15.40:0/3662362252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ca406f070 0x7f4ca406f440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-30T22:24:18.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.743+0000 7f4ca159a700 1 -- 172.21.15.40:0/3662362252 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2518723234 0 0) 0x7f4ca4070830 con 0x7f4ca406f980 2023-09-30T22:24:18.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.743+0000 7f4ca159a700 1 -- 172.21.15.40:0/3662362252 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c8c0035b0 con 0x7f4ca406f980 2023-09-30T22:24:18.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.743+0000 7f4ca159a700 1 -- 172.21.15.40:0/3662362252 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2271566568 0 0) 0x7f4c8c0035b0 con 0x7f4ca406f980 2023-09-30T22:24:18.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.743+0000 7f4ca159a700 1 -- 172.21.15.40:0/3662362252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ca406f070 msgr2=0x7f4ca406f440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:24:18.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.743+0000 7f4ca159a700 1 --2- 172.21.15.40:0/3662362252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ca406f070 0x7f4ca406f440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.743+0000 7f4ca159a700 1 -- 172.21.15.40:0/3662362252 >> v2:172.21.15.40:3300/0 conn(0x7f4ca406fdb0 msgr2=0x7f4ca40977a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:24:18.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.743+0000 7f4ca159a700 1 --2- 172.21.15.40:0/3662362252 >> v2:172.21.15.40:3300/0 conn(0x7f4ca406fdb0 0x7f4ca40977a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.743+0000 7f4ca159a700 1 -- 172.21.15.40:0/3662362252 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca4070de0 con 0x7f4ca406f980 2023-09-30T22:24:18.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.744+0000 7f4ca159a700 1 -- 172.21.15.40:0/3662362252 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4231795173 0 0) 0x7f4c98001670 con 0x7f4ca406f980 2023-09-30T22:24:18.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.744+0000 7f4ca159a700 1 -- 172.21.15.40:0/3662362252 >> v1:172.21.15.40:6789/0 conn(0x7f4ca406f980 legacy=0x7f4ca4097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:18.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.744+0000 7f4ca159a700 1 --2- 172.21.15.40:0/3662362252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c8c003a30 0x7f4c8c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.744+0000 7f4ca159a700 1 --2- 172.21.15.40:0/3662362252 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c8c004850 0x7f4c8c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.744+0000 7f4ca159a700 1 --2- 172.21.15.40:0/3662362252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ca406f070 0x7f4c8c0052b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.744+0000 7f4ca159a700 1 -- 172.21.15.40:0/3662362252 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca4070ad0 con 0x7f4c8c003a30 2023-09-30T22:24:18.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.744+0000 7f4ca159a700 1 -- 172.21.15.40:0/3662362252 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c00bba0 con 0x7f4ca406f070 2023-09-30T22:24:18.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.744+0000 7f4ca159a700 1 -- 172.21.15.40:0/3662362252 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c00bd60 con 0x7f4c8c004850 2023-09-30T22:24:18.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.744+0000 7f4ca1d9b700 1 --2- 172.21.15.40:0/3662362252 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c8c004850 0x7f4c8c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.744+0000 7f4ca259c700 1 --2- 172.21.15.40:0/3662362252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c8c003a30 0x7f4c8c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.744+0000 7f4ca2d9d700 1 --2- 172.21.15.40:0/3662362252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ca406f070 0x7f4c8c0052b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.744+0000 7f4ca2d9d700 1 -- 172.21.15.40:0/3662362252 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c8c004850 msgr2=0x7f4c8c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:18.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.744+0000 7f4ca2d9d700 1 --2- 172.21.15.40:0/3662362252 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c8c004850 0x7f4c8c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.744+0000 7f4ca2d9d700 1 -- 172.21.15.40:0/3662362252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c8c003a30 msgr2=0x7f4c8c003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:18.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.744+0000 7f4ca2d9d700 1 --2- 172.21.15.40:0/3662362252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c8c003a30 0x7f4c8c003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.744+0000 7f4ca2d9d700 1 -- 172.21.15.40:0/3662362252 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca4070de0 con 0x7f4ca406f070 2023-09-30T22:24:18.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.744+0000 7f4ca259c700 1 --2- 172.21.15.40:0/3662362252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c8c003a30 0x7f4c8c003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:18.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.744+0000 7f4ca2d9d700 1 --2- 172.21.15.40:0/3662362252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ca406f070 0x7f4c8c0052b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c009fc0 tx=0x7f4c8c005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=270681c69c4ac235 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:18.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.746+0000 7f4ca159a700 1 -- 172.21.15.40:0/3662362252 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c007e20 con 0x7f4ca406f070 2023-09-30T22:24:18.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.746+0000 7f4ca159a700 1 -- 172.21.15.40:0/3662362252 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9c013560 con 0x7f4ca406f070 2023-09-30T22:24:18.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.746+0000 7f4ca159a700 1 -- 172.21.15.40:0/3662362252 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c0138f0 con 0x7f4ca406f070 2023-09-30T22:24:18.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.747+0000 7f4ca8fd6700 1 -- 172.21.15.40:0/3662362252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ca406f070 msgr2=0x7f4c8c0052b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:18.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.747+0000 7f4ca8fd6700 1 --2- 172.21.15.40:0/3662362252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ca406f070 0x7f4c8c0052b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c009fc0 tx=0x7f4c8c005880 comp rx=0 tx=0).stop 2023-09-30T22:24:18.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.747+0000 7f4ca2d9d700 1 -- 172.21.15.40:0/3662362252 reap_dead start 2023-09-30T22:24:18.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.747+0000 7f4ca8fd6700 1 -- 172.21.15.40:0/3662362252 shutdown_connections 2023-09-30T22:24:18.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.747+0000 7f4ca8fd6700 1 -- 172.21.15.40:0/3662362252 >> 172.21.15.40:0/3662362252 conn(0x7f4ca40a41a0 msgr2=0x7f4ca40a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:18.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.747+0000 7f4ca8fd6700 1 -- 172.21.15.40:0/3662362252 shutdown_connections 2023-09-30T22:24:18.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.747+0000 7f4ca8fd6700 1 -- 172.21.15.40:0/3662362252 wait complete. 2023-09-30T22:24:18.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.749+0000 7f4ca8fd6700 1 Processor -- start 2023-09-30T22:24:18.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.749+0000 7f4ca8fd6700 1 -- start start 2023-09-30T22:24:18.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.749+0000 7f4ca8fd6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ca406f070 0x7f4ca409cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.749+0000 7f4ca8fd6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ca409d500 0x7f4ca409d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.749+0000 7f4ca8fd6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ca41cc910 0x7f4ca41ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.749+0000 7f4ca8fd6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca40956b0 con 0x7f4ca41cc910 2023-09-30T22:24:18.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.749+0000 7f4ca8fd6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca409de70 con 0x7f4ca406f070 2023-09-30T22:24:18.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.749+0000 7f4ca8fd6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca4095890 con 0x7f4ca409d500 2023-09-30T22:24:18.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.749+0000 7f4ca2d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ca41cc910 0x7f4ca41ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.749+0000 7f4ca2d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ca41cc910 0x7f4ca41ccd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60436/0 (socket says 172.21.15.40:60436) 2023-09-30T22:24:18.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.749+0000 7f4ca2d9d700 1 -- 172.21.15.40:0/703735375 learned_addr learned my addr 172.21.15.40:0/703735375 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:18.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.749+0000 7f4ca259c700 1 --2- 172.21.15.40:0/703735375 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ca406f070 0x7f4ca409cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.750+0000 7f4ca1d9b700 1 --2- 172.21.15.40:0/703735375 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ca409d500 0x7f4ca409d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.750+0000 7f4ca259c700 1 -- 172.21.15.40:0/703735375 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ca409d500 msgr2=0x7f4ca409d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:18.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.750+0000 7f4ca259c700 1 --2- 172.21.15.40:0/703735375 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ca409d500 0x7f4ca409d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.750+0000 7f4ca259c700 1 -- 172.21.15.40:0/703735375 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ca41cc910 msgr2=0x7f4ca41ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:18.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.750+0000 7f4ca259c700 1 --2- 172.21.15.40:0/703735375 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ca41cc910 0x7f4ca41ccd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.750+0000 7f4ca259c700 1 -- 172.21.15.40:0/703735375 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca406e7d0 con 0x7f4ca406f070 2023-09-30T22:24:18.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.750+0000 7f4ca259c700 1 --2- 172.21.15.40:0/703735375 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ca406f070 0x7f4ca409cfc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4c94010890 tx=0x7f4c94010ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:18.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.750+0000 7f4c92ffd700 1 -- 172.21.15.40:0/703735375 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c94006ea0 con 0x7f4ca406f070 2023-09-30T22:24:18.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.750+0000 7f4c92ffd700 1 -- 172.21.15.40:0/703735375 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c94004020 con 0x7f4ca406f070 2023-09-30T22:24:18.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.750+0000 7f4ca8fd6700 1 -- 172.21.15.40:0/703735375 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca4093930 con 0x7f4ca406f070 2023-09-30T22:24:18.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.750+0000 7f4c92ffd700 1 -- 172.21.15.40:0/703735375 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c940043d0 con 0x7f4ca406f070 2023-09-30T22:24:18.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.751+0000 7f4ca8fd6700 1 -- 172.21.15.40:0/703735375 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca4096470 con 0x7f4ca406f070 2023-09-30T22:24:18.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.752+0000 7f4ca8fd6700 1 -- 172.21.15.40:0/703735375 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ca40997b0 con 0x7f4ca406f070 2023-09-30T22:24:18.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.752+0000 7f4c92ffd700 1 -- 172.21.15.40:0/703735375 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f4c94015740 con 0x7f4ca406f070 2023-09-30T22:24:18.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.752+0000 7f4c92ffd700 1 -- 172.21.15.40:0/703735375 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3967+0+0 (secure 0 0 0) 0x7f4c9403c630 con 0x7f4ca406f070 2023-09-30T22:24:18.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.752+0000 7f4ca1d9b700 1 -- 172.21.15.40:0/703735375 >> v1:172.21.15.40:6816/118905 conn(0x7f4c8402c1e0 legacy=0x7f4c8402e690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/118905 2023-09-30T22:24:18.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.756+0000 7f4c92ffd700 1 -- 172.21.15.40:0/703735375 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f4c9401e3b0 con 0x7f4ca406f070 2023-09-30T22:24:18.872 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:18.872+0000 7ff0e5d3a240 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-30T22:24:18.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.954+0000 7f4ca1d9b700 1 -- 172.21.15.40:0/703735375 >> v1:172.21.15.40:6816/118905 conn(0x7f4c8402c1e0 legacy=0x7f4c8402e690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/118905 2023-09-30T22:24:18.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.985+0000 7f4ca8fd6700 1 -- 172.21.15.40:0/703735375 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f4ca40954d0 con 0x7f4ca406f070 2023-09-30T22:24:18.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.988+0000 7f4c92ffd700 1 -- 172.21.15.40:0/703735375 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+64282 (secure 0 0 0) 0x7f4c9402e090 con 0x7f4ca406f070 2023-09-30T22:24:18.993 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:24:18.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.992+0000 7f4ca8fd6700 1 -- 172.21.15.40:0/703735375 >> v1:172.21.15.40:6816/118905 conn(0x7f4c8402c1e0 legacy=0x7f4c8402e690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:18.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.992+0000 7f4ca8fd6700 1 -- 172.21.15.40:0/703735375 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ca406f070 msgr2=0x7f4ca409cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:18.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.992+0000 7f4ca8fd6700 1 --2- 172.21.15.40:0/703735375 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ca406f070 0x7f4ca409cfc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4c94010890 tx=0x7f4c94010ba0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.992+0000 7f4ca8fd6700 1 -- 172.21.15.40:0/703735375 shutdown_connections 2023-09-30T22:24:18.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.992+0000 7f4ca8fd6700 1 --2- 172.21.15.40:0/703735375 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ca41cc910 0x7f4ca41ccd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.992+0000 7f4ca8fd6700 1 --2- 172.21.15.40:0/703735375 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ca406f070 0x7f4ca409cfc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.992+0000 7f4ca8fd6700 1 --2- 172.21.15.40:0/703735375 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ca409d500 0x7f4ca409d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.992+0000 7f4ca8fd6700 1 -- 172.21.15.40:0/703735375 >> 172.21.15.40:0/703735375 conn(0x7f4ca40a41a0 msgr2=0x7f4ca40972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:18.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.992+0000 7f4ca8fd6700 1 -- 172.21.15.40:0/703735375 shutdown_connections 2023-09-30T22:24:18.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:18.992+0000 7f4ca8fd6700 1 -- 172.21.15.40:0/703735375 wait complete. 2023-09-30T22:24:19.015 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":5,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6816","nonce":118905}]},"active_addr":"172.21.15.40:6816/118905","active_change":"2023-09-30T22:21:51.768844+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":1890660785}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":1764460125}]}]} 2023-09-30T22:24:19.018 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-09-30T22:24:19.018 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-30T22:24:19.018 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:24:19.059 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:19.059+0000 7ff0e5d3a240 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-30T22:24:19.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.156+0000 7f48a9fd0700 1 Processor -- start 2023-09-30T22:24:19.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.156+0000 7f48a9fd0700 1 -- start start 2023-09-30T22:24:19.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.156+0000 7f48a9fd0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48a409fbb0 0x7f48a406c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.156+0000 7f48a9fd0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f48a4139380 0x7f48a413b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.156+0000 7f48a9fd0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a406e3f0 con 0x7f48a406ced0 2023-09-30T22:24:19.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.156+0000 7f48a9fd0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a409ff80 con 0x7f48a4139380 2023-09-30T22:24:19.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.156+0000 7f48a9fd0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a406ec40 con 0x7f48a409fbb0 2023-09-30T22:24:19.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.156+0000 7f48a3fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f48a4139380 0x7f48a413b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.156+0000 7f48a37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48a409fbb0 0x7f48a406c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.156+0000 7f48a3fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f48a4139380 0x7f48a413b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60444/0 (socket says 172.21.15.40:60444) 2023-09-30T22:24:19.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.156+0000 7f48a3fff700 1 -- 172.21.15.40:0/2890648692 learned_addr learned my addr 172.21.15.40:0/2890648692 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:19.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.156+0000 7f48a2ffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f48a406ced0 0x7f48a406d2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50062/0 (socket says 172.21.15.40:50062) 2023-09-30T22:24:19.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.157+0000 7f48a3fff700 1 -- 172.21.15.40:0/2890648692 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48a409fbb0 msgr2=0x7f48a406c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:19.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.157+0000 7f48a3fff700 1 --2- 172.21.15.40:0/2890648692 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48a409fbb0 0x7f48a406c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.157+0000 7f48a3fff700 1 -- 172.21.15.40:0/2890648692 >> v1:172.21.15.40:6789/0 conn(0x7f48a406ced0 legacy=0x7f48a406d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.157+0000 7f48a3fff700 1 -- 172.21.15.40:0/2890648692 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a406d9f0 con 0x7f48a4139380 2023-09-30T22:24:19.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.157+0000 7f48a27fc700 1 -- 172.21.15.40:0/2890648692 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2211110642 0 0) 0x7f48a406e3f0 con 0x7f48a406ced0 2023-09-30T22:24:19.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.157+0000 7f48a37fe700 1 --2- 172.21.15.40:0/2890648692 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48a409fbb0 0x7f48a406c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:19.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.157+0000 7f48a3fff700 1 --2- 172.21.15.40:0/2890648692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48a4139380 0x7f48a413b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f489c009e50 tx=0x7f489c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=885e4947aac31c97 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:19.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.157+0000 7f48a27fc700 1 -- 172.21.15.40:0/2890648692 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c00e070 con 0x7f48a4139380 2023-09-30T22:24:19.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.157+0000 7f48a27fc700 1 -- 172.21.15.40:0/2890648692 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489c00b910 con 0x7f48a4139380 2023-09-30T22:24:19.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.157+0000 7f48a27fc700 1 -- 172.21.15.40:0/2890648692 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c00bcc0 con 0x7f48a4139380 2023-09-30T22:24:19.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.157+0000 7f48a9fd0700 1 -- 172.21.15.40:0/2890648692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48a4139380 msgr2=0x7f48a413b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.157+0000 7f48a9fd0700 1 --2- 172.21.15.40:0/2890648692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48a4139380 0x7f48a413b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f489c009e50 tx=0x7f489c00b330 comp rx=0 tx=0).stop 2023-09-30T22:24:19.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.158+0000 7f48a9fd0700 1 -- 172.21.15.40:0/2890648692 shutdown_connections 2023-09-30T22:24:19.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.158+0000 7f48a9fd0700 1 --2- 172.21.15.40:0/2890648692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48a4139380 0x7f48a413b760 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.158+0000 7f48a9fd0700 1 --2- 172.21.15.40:0/2890648692 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48a409fbb0 0x7f48a406c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.158+0000 7f48a9fd0700 1 -- 172.21.15.40:0/2890648692 >> 172.21.15.40:0/2890648692 conn(0x7f48a40a41a0 msgr2=0x7f48a40a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:19.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.158+0000 7f48a9fd0700 1 -- 172.21.15.40:0/2890648692 shutdown_connections 2023-09-30T22:24:19.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.158+0000 7f48a9fd0700 1 -- 172.21.15.40:0/2890648692 wait complete. 2023-09-30T22:24:19.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.158+0000 7f48a9fd0700 1 Processor -- start 2023-09-30T22:24:19.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.159+0000 7f48a9fd0700 1 -- start start 2023-09-30T22:24:19.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.159+0000 7f48a9fd0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48a406ced0 0x7f48a4138390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.159+0000 7f48a9fd0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48a409fbb0 0x7f48a41388d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.159+0000 7f48a9fd0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f48a4139380 0x7f48a4138e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.159+0000 7f48a9fd0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a4091390 con 0x7f48a406ced0 2023-09-30T22:24:19.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.159+0000 7f48a9fd0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a40929d0 con 0x7f48a409fbb0 2023-09-30T22:24:19.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.159+0000 7f48a9fd0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48a4091da0 con 0x7f48a4139380 2023-09-30T22:24:19.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.159+0000 7f48a2ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48a409fbb0 0x7f48a41388d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.159+0000 7f48a37fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48a406ced0 0x7f48a4138390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.159+0000 7f48a2ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48a409fbb0 0x7f48a41388d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:56496/0 (socket says 172.21.15.40:56496) 2023-09-30T22:24:19.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.159+0000 7f48a2ffd700 1 -- 172.21.15.40:0/2936981772 learned_addr learned my addr 172.21.15.40:0/2936981772 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:19.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.159+0000 7f48a3fff700 1 --2- 172.21.15.40:0/2936981772 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f48a4139380 0x7f48a4138e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.160+0000 7f48a37fe700 1 -- 172.21.15.40:0/2936981772 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f48a4139380 msgr2=0x7f48a4138e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.160+0000 7f48a37fe700 1 --2- 172.21.15.40:0/2936981772 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f48a4139380 0x7f48a4138e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.160+0000 7f48a37fe700 1 -- 172.21.15.40:0/2936981772 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48a409fbb0 msgr2=0x7f48a41388d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.160+0000 7f48a37fe700 1 --2- 172.21.15.40:0/2936981772 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48a409fbb0 0x7f48a41388d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.160+0000 7f48a37fe700 1 -- 172.21.15.40:0/2936981772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48940094a0 con 0x7f48a406ced0 2023-09-30T22:24:19.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.160+0000 7f48a2ffd700 1 --2- 172.21.15.40:0/2936981772 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48a409fbb0 0x7f48a41388d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:19.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.160+0000 7f48a37fe700 1 --2- 172.21.15.40:0/2936981772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48a406ced0 0x7f48a4138390 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f489400e9e0 tx=0x7f489400ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:19.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.160+0000 7f488bfff700 1 -- 172.21.15.40:0/2936981772 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489400ee80 con 0x7f48a406ced0 2023-09-30T22:24:19.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.160+0000 7f488bfff700 1 -- 172.21.15.40:0/2936981772 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489400c850 con 0x7f48a406ced0 2023-09-30T22:24:19.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.160+0000 7f48a9fd0700 1 -- 172.21.15.40:0/2936981772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f489c009b30 con 0x7f48a406ced0 2023-09-30T22:24:19.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.160+0000 7f488bfff700 1 -- 172.21.15.40:0/2936981772 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489400cc00 con 0x7f48a406ced0 2023-09-30T22:24:19.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.160+0000 7f48a9fd0700 1 -- 172.21.15.40:0/2936981772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a4097f10 con 0x7f48a406ced0 2023-09-30T22:24:19.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.161+0000 7f488bfff700 1 -- 172.21.15.40:0/2936981772 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f489400cd60 con 0x7f48a406ced0 2023-09-30T22:24:19.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.161+0000 7f488bfff700 1 -- 172.21.15.40:0/2936981772 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3967+0+0 (secure 0 0 0) 0x7f489403b8e0 con 0x7f48a406ced0 2023-09-30T22:24:19.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.161+0000 7f48a2ffd700 1 -- 172.21.15.40:0/2936981772 >> v1:172.21.15.40:6816/118905 conn(0x7f489002c1b0 legacy=0x7f489002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/118905 2023-09-30T22:24:19.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.161+0000 7f48a9fd0700 1 -- 172.21.15.40:0/2936981772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48a4092570 con 0x7f48a406ced0 2023-09-30T22:24:19.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.165+0000 7f488bfff700 1 -- 172.21.15.40:0/2936981772 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f48a4092570 con 0x7f48a406ced0 2023-09-30T22:24:19.326 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:19.326+0000 7ff0e5d3a240 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-30T22:24:19.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.340+0000 7f48a9fd0700 1 -- 172.21.15.40:0/2936981772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48a4092570 con 0x7f48a406ced0 2023-09-30T22:24:19.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.341+0000 7f488bfff700 1 -- 172.21.15.40:0/2936981772 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+12817 (secure 0 0 0) 0x7f4894021030 con 0x7f48a406ced0 2023-09-30T22:24:19.342 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:24:19.342 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":22,"fsid":"79dd4d8e-f295-4d9c-bd93-9850863800e3","created":"2023-09-30T22:21:46.980357+0000","modified":"2023-09-30T22:23:54.775939+0000","last_up_change":"2023-09-30T22:21:54.822866+0000","last_in_change":"2023-09-30T22:21:48.205613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:21:54.875024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:21:56.197012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:22:00.759069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:22:01.327265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"771f785c-f464-4b17-936c-cbf31b1153e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6812","nonce":119451}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6813","nonce":119451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6815","nonce":119451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6814","nonce":119451}]},"public_addr":"172.21.15.40:6812/119451","cluster_addr":"172.21.15.40:6813/119451","heartbeat_back_addr":"172.21.15.40:6815/119451","heartbeat_front_addr":"172.21.15.40:6814/119451","state":["exists","up"]},{"osd":1,"uuid":"45f1e2e8-5310-4219-ab54-424e7440fcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6808","nonce":119436}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6809","nonce":119436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6811","nonce":119436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6810","nonce":119436}]},"public_addr":"172.21.15.40:6808/119436","cluster_addr":"172.21.15.40:6809/119436","heartbeat_back_addr":"172.21.15.40:6811/119436","heartbeat_front_addr":"172.21.15.40:6810/119436","state":["exists","up"]},{"osd":2,"uuid":"7ba62ae5-d21e-4d56-b46c-ba7b718ede25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6800","nonce":119433}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6801","nonce":119433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6803","nonce":119433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6802","nonce":119433}]},"public_addr":"172.21.15.40:6800/119433","cluster_addr":"172.21.15.40:6801/119433","heartbeat_back_addr":"172.21.15.40:6803/119433","heartbeat_front_addr":"172.21.15.40:6802/119433","state":["exists","up"]},{"osd":3,"uuid":"c9c55985-8a90-4927-a8fa-6a1fcec1cd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6804","nonce":119432}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6805","nonce":119432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6807","nonce":119432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6806","nonce":119432}]},"public_addr":"172.21.15.40:6804/119432","cluster_addr":"172.21.15.40:6805/119432","heartbeat_back_addr":"172.21.15.40:6807/119432","heartbeat_front_addr":"172.21.15.40:6806/119432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.339829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.554690+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.641664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.320635+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2},{"from":1,"to":0}]},{"pgid":"4.1","mappings":[{"from":3,"to":0}]},{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.12","mappings":[{"from":3,"to":0}]},{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":3,"to":2},{"from":1,"to":0}]},{"pgid":"4.2c","mappings":[{"from":1,"to":2}]},{"pgid":"4.3f","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:24:19.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.343+0000 7f48a9fd0700 1 -- 172.21.15.40:0/2936981772 >> v1:172.21.15.40:6816/118905 conn(0x7f489002c1b0 legacy=0x7f489002e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:19.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.343+0000 7f48a9fd0700 1 -- 172.21.15.40:0/2936981772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48a406ced0 msgr2=0x7f48a4138390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.343+0000 7f48a9fd0700 1 --2- 172.21.15.40:0/2936981772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48a406ced0 0x7f48a4138390 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f489400e9e0 tx=0x7f489400ecf0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.343+0000 7f48a9fd0700 1 -- 172.21.15.40:0/2936981772 shutdown_connections 2023-09-30T22:24:19.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.343+0000 7f48a9fd0700 1 --2- 172.21.15.40:0/2936981772 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f48a4139380 0x7f48a4138e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.343+0000 7f48a9fd0700 1 --2- 172.21.15.40:0/2936981772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48a406ced0 0x7f48a4138390 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.343+0000 7f48a9fd0700 1 --2- 172.21.15.40:0/2936981772 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48a409fbb0 0x7f48a41388d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.343+0000 7f48a9fd0700 1 -- 172.21.15.40:0/2936981772 >> 172.21.15.40:0/2936981772 conn(0x7f48a40a41a0 msgr2=0x7f48a413afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:19.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.343+0000 7f48a9fd0700 1 -- 172.21.15.40:0/2936981772 shutdown_connections 2023-09-30T22:24:19.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.343+0000 7f48a9fd0700 1 -- 172.21.15.40:0/2936981772 wait complete. 2023-09-30T22:24:19.357 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-30T22:24:19.357 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:24:19.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.524+0000 7fc22c3ba700 1 Processor -- start 2023-09-30T22:24:19.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.524+0000 7fc22c3ba700 1 -- start start 2023-09-30T22:24:19.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.525+0000 7fc22c3ba700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc22409d920 0x7fc22409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.525+0000 7fc22c3ba700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc22409f0f0 0x7fc22409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.525+0000 7fc22c3ba700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc224133ca0 0x7fc224134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.525+0000 7fc22c3ba700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc22406b4c0 con 0x7fc22409f0f0 2023-09-30T22:24:19.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.525+0000 7fc22c3ba700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc22409a8f0 con 0x7fc224133ca0 2023-09-30T22:24:19.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.525+0000 7fc22c3ba700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc22409f940 con 0x7fc22409d920 2023-09-30T22:24:19.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.526+0000 7fc229955700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc22409f0f0 0x7fc22409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.526+0000 7fc22a957700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc224133ca0 0x7fc224134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.526+0000 7fc22a957700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc224133ca0 0x7fc224134140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:56508/0 (socket says 172.21.15.40:56508) 2023-09-30T22:24:19.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.526+0000 7fc229955700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc22409f0f0 0x7fc22409e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60466/0 (socket says 172.21.15.40:60466) 2023-09-30T22:24:19.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.526+0000 7fc22a957700 1 -- 172.21.15.40:0/2479474894 learned_addr learned my addr 172.21.15.40:0/2479474894 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:19.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.526+0000 7fc22a156700 1 --2- 172.21.15.40:0/2479474894 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc22409d920 0x7fc22409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.526+0000 7fc229955700 1 -- 172.21.15.40:0/2479474894 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc22409d920 msgr2=0x7fc22409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:19.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.526+0000 7fc229955700 1 --2- 172.21.15.40:0/2479474894 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc22409d920 0x7fc22409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.526+0000 7fc229955700 1 -- 172.21.15.40:0/2479474894 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc224133ca0 msgr2=0x7fc224134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:19.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.526+0000 7fc229955700 1 --2- 172.21.15.40:0/2479474894 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc224133ca0 0x7fc224134140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.526+0000 7fc229955700 1 -- 172.21.15.40:0/2479474894 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc22409f6e0 con 0x7fc22409f0f0 2023-09-30T22:24:19.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.526+0000 7fc22a957700 1 --2- 172.21.15.40:0/2479474894 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc224133ca0 0x7fc224134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:19.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.526+0000 7fc229955700 1 --2- 172.21.15.40:0/2479474894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc22409f0f0 0x7fc22409e230 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc214009870 tx=0x7fc214009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=841754de1f31cab server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:19.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.526+0000 7fc229154700 1 -- 172.21.15.40:0/2479474894 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc214011830 con 0x7fc22409f0f0 2023-09-30T22:24:19.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.526+0000 7fc229154700 1 -- 172.21.15.40:0/2479474894 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc214011990 con 0x7fc22409f0f0 2023-09-30T22:24:19.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.526+0000 7fc229154700 1 -- 172.21.15.40:0/2479474894 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc214011d20 con 0x7fc22409f0f0 2023-09-30T22:24:19.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.527+0000 7fc22c3ba700 1 -- 172.21.15.40:0/2479474894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc22409f0f0 msgr2=0x7fc22409e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.527+0000 7fc22c3ba700 1 --2- 172.21.15.40:0/2479474894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc22409f0f0 0x7fc22409e230 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc214009870 tx=0x7fc214009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:19.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.527+0000 7fc22c3ba700 1 -- 172.21.15.40:0/2479474894 shutdown_connections 2023-09-30T22:24:19.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.527+0000 7fc22c3ba700 1 --2- 172.21.15.40:0/2479474894 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc22409d920 0x7fc22409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.527+0000 7fc22c3ba700 1 --2- 172.21.15.40:0/2479474894 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc224133ca0 0x7fc224134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.527+0000 7fc22c3ba700 1 --2- 172.21.15.40:0/2479474894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc22409f0f0 0x7fc22409e230 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.527+0000 7fc22c3ba700 1 -- 172.21.15.40:0/2479474894 >> 172.21.15.40:0/2479474894 conn(0x7fc22409fb20 msgr2=0x7fc22409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:19.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.527+0000 7fc22c3ba700 1 -- 172.21.15.40:0/2479474894 shutdown_connections 2023-09-30T22:24:19.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.527+0000 7fc22c3ba700 1 -- 172.21.15.40:0/2479474894 wait complete. 2023-09-30T22:24:19.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.528+0000 7fc22c3ba700 1 Processor -- start 2023-09-30T22:24:19.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.528+0000 7fc22c3ba700 1 -- start start 2023-09-30T22:24:19.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.528+0000 7fc22c3ba700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc22409d920 0x7fc2241228e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.528+0000 7fc22c3ba700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc224133ca0 0x7fc224122e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.528+0000 7fc22c3ba700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc224123360 0x7fc2241c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.528+0000 7fc22c3ba700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2241260e0 con 0x7fc22409d920 2023-09-30T22:24:19.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.528+0000 7fc22c3ba700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2241245c0 con 0x7fc224133ca0 2023-09-30T22:24:19.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.528+0000 7fc22c3ba700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc224124cd0 con 0x7fc224123360 2023-09-30T22:24:19.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.529+0000 7fc22a957700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc224123360 0x7fc2241c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.529+0000 7fc22a156700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc22409d920 0x7fc2241228e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.529+0000 7fc22a957700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc224123360 0x7fc2241c87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:50422/0 (socket says 172.21.15.40:50422) 2023-09-30T22:24:19.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.529+0000 7fc22a156700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc22409d920 0x7fc2241228e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60472/0 (socket says 172.21.15.40:60472) 2023-09-30T22:24:19.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.529+0000 7fc22a957700 1 -- 172.21.15.40:0/2384830596 learned_addr learned my addr 172.21.15.40:0/2384830596 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:19.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.529+0000 7fc229955700 1 --2- 172.21.15.40:0/2384830596 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc224133ca0 0x7fc224122e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.529+0000 7fc22a156700 1 -- 172.21.15.40:0/2384830596 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc224123360 msgr2=0x7fc2241c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.529+0000 7fc22a156700 1 --2- 172.21.15.40:0/2384830596 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc224123360 0x7fc2241c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.529+0000 7fc22a156700 1 -- 172.21.15.40:0/2384830596 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc224133ca0 msgr2=0x7fc224122e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.529+0000 7fc22a156700 1 --2- 172.21.15.40:0/2384830596 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc224133ca0 0x7fc224122e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.529+0000 7fc22a156700 1 -- 172.21.15.40:0/2384830596 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c009b30 con 0x7fc22409d920 2023-09-30T22:24:19.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.529+0000 7fc22a957700 1 --2- 172.21.15.40:0/2384830596 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc224123360 0x7fc2241c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:19.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.529+0000 7fc22a156700 1 --2- 172.21.15.40:0/2384830596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc22409d920 0x7fc2241228e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc22000e870 tx=0x7fc22000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:19.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.529+0000 7fc21affd700 1 -- 172.21.15.40:0/2384830596 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc220005a20 con 0x7fc22409d920 2023-09-30T22:24:19.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.529+0000 7fc21affd700 1 -- 172.21.15.40:0/2384830596 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc220005b80 con 0x7fc22409d920 2023-09-30T22:24:19.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.529+0000 7fc22c3ba700 1 -- 172.21.15.40:0/2384830596 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2140094a0 con 0x7fc22409d920 2023-09-30T22:24:19.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.529+0000 7fc21affd700 1 -- 172.21.15.40:0/2384830596 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc220013680 con 0x7fc22409d920 2023-09-30T22:24:19.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.529+0000 7fc22c3ba700 1 -- 172.21.15.40:0/2384830596 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2240a2b10 con 0x7fc22409d920 2023-09-30T22:24:19.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.530+0000 7fc21affd700 1 -- 172.21.15.40:0/2384830596 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fc2200137e0 con 0x7fc22409d920 2023-09-30T22:24:19.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.530+0000 7fc21affd700 1 -- 172.21.15.40:0/2384830596 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3967+0+0 (secure 0 0 0) 0x7fc22003b880 con 0x7fc22409d920 2023-09-30T22:24:19.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.530+0000 7fc229955700 1 -- 172.21.15.40:0/2384830596 >> v1:172.21.15.40:6816/118905 conn(0x7fc20802c1b0 legacy=0x7fc20802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/118905 2023-09-30T22:24:19.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.530+0000 7fc22c3ba700 1 -- 172.21.15.40:0/2384830596 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc224062380 con 0x7fc22409d920 2023-09-30T22:24:19.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.538+0000 7fc21affd700 1 -- 172.21.15.40:0/2384830596 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fc220006030 con 0x7fc22409d920 2023-09-30T22:24:19.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.713+0000 7fc22c3ba700 1 -- 172.21.15.40:0/2384830596 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc224074720 con 0x7fc22409d920 2023-09-30T22:24:19.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.714+0000 7fc21affd700 1 -- 172.21.15.40:0/2384830596 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+12817 (secure 0 0 0) 0x7fc220023e20 con 0x7fc22409d920 2023-09-30T22:24:19.715 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:24:19.715 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":22,"fsid":"79dd4d8e-f295-4d9c-bd93-9850863800e3","created":"2023-09-30T22:21:46.980357+0000","modified":"2023-09-30T22:23:54.775939+0000","last_up_change":"2023-09-30T22:21:54.822866+0000","last_in_change":"2023-09-30T22:21:48.205613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:21:54.875024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:21:56.197012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:22:00.759069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:22:01.327265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"771f785c-f464-4b17-936c-cbf31b1153e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6812","nonce":119451}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6813","nonce":119451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6815","nonce":119451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6814","nonce":119451}]},"public_addr":"172.21.15.40:6812/119451","cluster_addr":"172.21.15.40:6813/119451","heartbeat_back_addr":"172.21.15.40:6815/119451","heartbeat_front_addr":"172.21.15.40:6814/119451","state":["exists","up"]},{"osd":1,"uuid":"45f1e2e8-5310-4219-ab54-424e7440fcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6808","nonce":119436}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6809","nonce":119436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6811","nonce":119436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6810","nonce":119436}]},"public_addr":"172.21.15.40:6808/119436","cluster_addr":"172.21.15.40:6809/119436","heartbeat_back_addr":"172.21.15.40:6811/119436","heartbeat_front_addr":"172.21.15.40:6810/119436","state":["exists","up"]},{"osd":2,"uuid":"7ba62ae5-d21e-4d56-b46c-ba7b718ede25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6800","nonce":119433}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6801","nonce":119433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6803","nonce":119433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6802","nonce":119433}]},"public_addr":"172.21.15.40:6800/119433","cluster_addr":"172.21.15.40:6801/119433","heartbeat_back_addr":"172.21.15.40:6803/119433","heartbeat_front_addr":"172.21.15.40:6802/119433","state":["exists","up"]},{"osd":3,"uuid":"c9c55985-8a90-4927-a8fa-6a1fcec1cd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6804","nonce":119432}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6805","nonce":119432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6807","nonce":119432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6806","nonce":119432}]},"public_addr":"172.21.15.40:6804/119432","cluster_addr":"172.21.15.40:6805/119432","heartbeat_back_addr":"172.21.15.40:6807/119432","heartbeat_front_addr":"172.21.15.40:6806/119432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.339829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.554690+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.641664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.320635+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2},{"from":1,"to":0}]},{"pgid":"4.1","mappings":[{"from":3,"to":0}]},{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.12","mappings":[{"from":3,"to":0}]},{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":3,"to":2},{"from":1,"to":0}]},{"pgid":"4.2c","mappings":[{"from":1,"to":2}]},{"pgid":"4.3f","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:24:19.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.716+0000 7fc22c3ba700 1 -- 172.21.15.40:0/2384830596 >> v1:172.21.15.40:6816/118905 conn(0x7fc20802c1b0 legacy=0x7fc20802e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:19.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.716+0000 7fc22c3ba700 1 -- 172.21.15.40:0/2384830596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc22409d920 msgr2=0x7fc2241228e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.716+0000 7fc22c3ba700 1 --2- 172.21.15.40:0/2384830596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc22409d920 0x7fc2241228e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc22000e870 tx=0x7fc22000eb80 comp rx=0 tx=0).stop 2023-09-30T22:24:19.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.716+0000 7fc22c3ba700 1 -- 172.21.15.40:0/2384830596 shutdown_connections 2023-09-30T22:24:19.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.716+0000 7fc22c3ba700 1 --2- 172.21.15.40:0/2384830596 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc224123360 0x7fc2241c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.716+0000 7fc22c3ba700 1 --2- 172.21.15.40:0/2384830596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc22409d920 0x7fc2241228e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.716+0000 7fc22c3ba700 1 --2- 172.21.15.40:0/2384830596 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc224133ca0 0x7fc224122e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.716+0000 7fc22c3ba700 1 -- 172.21.15.40:0/2384830596 >> 172.21.15.40:0/2384830596 conn(0x7fc22409fb20 msgr2=0x7fc2240a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:19.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.716+0000 7fc22c3ba700 1 -- 172.21.15.40:0/2384830596 shutdown_connections 2023-09-30T22:24:19.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.716+0000 7fc22c3ba700 1 -- 172.21.15.40:0/2384830596 wait complete. 2023-09-30T22:24:19.730 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-09-30T22:24:19.730 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-09-30T22:24:19.731 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-09-30T22:24:19.731 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-09-30T22:24:19.872 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:19.871+0000 7ff0e5d3a240 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-30T22:24:19.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.880+0000 7f1902626700 1 Processor -- start 2023-09-30T22:24:19.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.880+0000 7f1902626700 1 -- start start 2023-09-30T22:24:19.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.880+0000 7f28339bb700 1 Processor -- start 2023-09-30T22:24:19.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.880+0000 7f28339bb700 1 -- start start 2023-09-30T22:24:19.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.881+0000 7f1902626700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18fc06f070 0x7f18fc06f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.881+0000 7f1902626700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18fc06fdb0 0x7f18fc0977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.881+0000 7f1902626700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18fc070830 con 0x7f18fc06f980 2023-09-30T22:24:19.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.881+0000 7f1902626700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc070ad0 con 0x7f18fc06fdb0 2023-09-30T22:24:19.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.881+0000 7f1902626700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc070de0 con 0x7f18fc06f070 2023-09-30T22:24:19.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.881+0000 7f18fbfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18fc06f070 0x7f18fc06f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.881+0000 7f18fbfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18fc06f070 0x7f18fc06f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:50428/0 (socket says 172.21.15.40:50428) 2023-09-30T22:24:19.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.881+0000 7f18fbfff700 1 -- 172.21.15.40:0/3915251741 learned_addr learned my addr 172.21.15.40:0/3915251741 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:19.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.881+0000 7f1900bc3700 1 --2- 172.21.15.40:0/3915251741 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18fc06fdb0 0x7f18fc0977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.881+0000 7f28339bb700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f282c067820 0x7f282c09d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.881+0000 7f28339bb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f282c067bf0 0x7f282c09d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.881+0000 7f28339bb700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f282c09e8b0 con 0x7f282c09ded0 2023-09-30T22:24:19.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.881+0000 7f28339bb700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f282c09e300 con 0x7f282c067bf0 2023-09-30T22:24:19.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.881+0000 7f28339bb700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f282c09c3b0 con 0x7f282c067820 2023-09-30T22:24:19.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.881+0000 7f2831757700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f282c067820 0x7f282c09d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.881+0000 7f18fbfff700 1 -- 172.21.15.40:0/3915251741 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18fc06fdb0 msgr2=0x7f18fc0977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:19.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.881+0000 7f18fbfff700 1 --2- 172.21.15.40:0/3915251741 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18fc06fdb0 0x7f18fc0977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.881+0000 7f18fbfff700 1 -- 172.21.15.40:0/3915251741 >> v1:172.21.15.40:6789/0 conn(0x7f18fc06f980 legacy=0x7f18fc097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:19.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.881+0000 7f18fbfff700 1 -- 172.21.15.40:0/3915251741 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18fc09fe20 con 0x7f18fc06f070 2023-09-30T22:24:19.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.881+0000 7f2831757700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f282c067820 0x7f282c09d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:50438/0 (socket says 172.21.15.40:50438) 2023-09-30T22:24:19.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.882+0000 7f2831757700 1 -- 172.21.15.40:0/3050836117 learned_addr learned my addr 172.21.15.40:0/3050836117 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:19.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.882+0000 7f1900bc3700 1 --2- 172.21.15.40:0/3915251741 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18fc06fdb0 0x7f18fc0977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:19.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.882+0000 7f18fbfff700 1 --2- 172.21.15.40:0/3915251741 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18fc06f070 0x7f18fc06f440 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f18ec009920 tx=0x7f18ec009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81aca18fd2957289 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:19.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.882+0000 7f2831757700 1 -- 172.21.15.40:0/3050836117 >> v2:172.21.15.40:3300/0 conn(0x7f282c067bf0 msgr2=0x7f282c09d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:19.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.882+0000 7f2831757700 1 --2- 172.21.15.40:0/3050836117 >> v2:172.21.15.40:3300/0 conn(0x7f282c067bf0 0x7f282c09d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.882+0000 7f2831757700 1 -- 172.21.15.40:0/3050836117 >> v1:172.21.15.40:6789/0 conn(0x7f282c09ded0 legacy=0x7f282c1301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:19.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.882+0000 7f2831757700 1 -- 172.21.15.40:0/3050836117 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282c09a6b0 con 0x7f282c067820 2023-09-30T22:24:19.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.882+0000 7f18faffd700 1 -- 172.21.15.40:0/3915251741 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec004230 con 0x7f18fc06f070 2023-09-30T22:24:19.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.882+0000 7f2831757700 1 --2- 172.21.15.40:0/3050836117 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f282c067820 0x7f282c09d450 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2828009920 tx=0x7f2828009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a942935cfea9eab1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:19.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.882+0000 7f18faffd700 1 -- 172.21.15.40:0/3915251741 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ec004390 con 0x7f18fc06f070 2023-09-30T22:24:19.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.882+0000 7f18faffd700 1 -- 172.21.15.40:0/3915251741 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec0036a0 con 0x7f18fc06f070 2023-09-30T22:24:19.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.882+0000 7f2823fff700 1 -- 172.21.15.40:0/3050836117 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2828004230 con 0x7f282c067820 2023-09-30T22:24:19.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.882+0000 7f2823fff700 1 -- 172.21.15.40:0/3050836117 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2828004390 con 0x7f282c067820 2023-09-30T22:24:19.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.882+0000 7f2823fff700 1 -- 172.21.15.40:0/3050836117 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2828009e70 con 0x7f282c067820 2023-09-30T22:24:19.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.883+0000 7f1902626700 1 -- 172.21.15.40:0/3915251741 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18fc06f070 msgr2=0x7f18fc06f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.883+0000 7f1902626700 1 --2- 172.21.15.40:0/3915251741 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18fc06f070 0x7f18fc06f440 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f18ec009920 tx=0x7f18ec009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:19.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.883+0000 7f1902626700 1 -- 172.21.15.40:0/3915251741 shutdown_connections 2023-09-30T22:24:19.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.883+0000 7f1902626700 1 --2- 172.21.15.40:0/3915251741 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18fc06fdb0 0x7f18fc0977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.883+0000 7f1902626700 1 --2- 172.21.15.40:0/3915251741 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18fc06f070 0x7f18fc06f440 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.883+0000 7f1902626700 1 -- 172.21.15.40:0/3915251741 >> 172.21.15.40:0/3915251741 conn(0x7f18fc0a41a0 msgr2=0x7f18fc0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:19.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.883+0000 7f28339bb700 1 -- 172.21.15.40:0/3050836117 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f282c067820 msgr2=0x7f282c09d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.883+0000 7f28339bb700 1 --2- 172.21.15.40:0/3050836117 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f282c067820 0x7f282c09d450 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2828009920 tx=0x7f2828009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:19.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.883+0000 7f28339bb700 1 -- 172.21.15.40:0/3050836117 shutdown_connections 2023-09-30T22:24:19.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.883+0000 7f28339bb700 1 --2- 172.21.15.40:0/3050836117 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f282c067820 0x7f282c09d450 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.883+0000 7f28339bb700 1 --2- 172.21.15.40:0/3050836117 >> v2:172.21.15.40:3300/0 conn(0x7f282c067bf0 0x7f282c09d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.883+0000 7f28339bb700 1 -- 172.21.15.40:0/3050836117 >> 172.21.15.40:0/3050836117 conn(0x7f282c0a2a00 msgr2=0x7f282c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:19.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.883+0000 7f1902626700 1 -- 172.21.15.40:0/3915251741 shutdown_connections 2023-09-30T22:24:19.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.883+0000 7f1902626700 1 -- 172.21.15.40:0/3915251741 wait complete. 2023-09-30T22:24:19.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.883+0000 7f28339bb700 1 -- 172.21.15.40:0/3050836117 shutdown_connections 2023-09-30T22:24:19.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.883+0000 7f28339bb700 1 -- 172.21.15.40:0/3050836117 wait complete. 2023-09-30T22:24:19.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.884+0000 7f28339bb700 1 Processor -- start 2023-09-30T22:24:19.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.884+0000 7f28339bb700 1 -- start start 2023-09-30T22:24:19.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.885+0000 7f1902626700 1 Processor -- start 2023-09-30T22:24:19.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.885+0000 7f28339bb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f282c067820 0x7f282c132830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.885+0000 7f28339bb700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f282c067bf0 0x7f282c132d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.885+0000 7f28339bb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f282c09ded0 0x7f282c1332b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.885+0000 7f28339bb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282c119360 con 0x7f282c067820 2023-09-30T22:24:19.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.885+0000 7f28339bb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f282c119540 con 0x7f282c09ded0 2023-09-30T22:24:19.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.885+0000 7f28339bb700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f282c134240 con 0x7f282c067bf0 2023-09-30T22:24:19.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.885+0000 7f2830f56700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f282c067bf0 0x7f282c132d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.885+0000 7f2830f56700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f282c067bf0 0x7f282c132d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:50448/0 (socket says 172.21.15.40:50448) 2023-09-30T22:24:19.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.885+0000 7f2830f56700 1 -- 172.21.15.40:0/129587618 learned_addr learned my addr 172.21.15.40:0/129587618 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:19.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.885+0000 7f2831f58700 1 --2- 172.21.15.40:0/129587618 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f282c09ded0 0x7f282c1332b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.885+0000 7f2831757700 1 --2- 172.21.15.40:0/129587618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f282c067820 0x7f282c132830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.886+0000 7f2830f56700 1 -- 172.21.15.40:0/129587618 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f282c09ded0 msgr2=0x7f282c1332b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.886+0000 7f2830f56700 1 --2- 172.21.15.40:0/129587618 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f282c09ded0 0x7f282c1332b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.886+0000 7f2830f56700 1 -- 172.21.15.40:0/129587618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f282c067820 msgr2=0x7f282c132830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.886+0000 7f2830f56700 1 --2- 172.21.15.40:0/129587618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f282c067820 0x7f282c132830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.886+0000 7f2830f56700 1 -- 172.21.15.40:0/129587618 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2828009550 con 0x7f282c067bf0 2023-09-30T22:24:19.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.885+0000 7f1902626700 1 -- start start 2023-09-30T22:24:19.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.886+0000 7f1902626700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18fc06f070 0x7f18fc095a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.886+0000 7f1902626700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18fc06f980 0x7f18fc096460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.886+0000 7f1902626700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18fc06fdb0 0x7f18fc1cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.886+0000 7f1902626700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc094de0 con 0x7f18fc06fdb0 2023-09-30T22:24:19.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.886+0000 7f1902626700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc0948d0 con 0x7f18fc06f980 2023-09-30T22:24:19.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.886+0000 7f1902626700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc095750 con 0x7f18fc06f070 2023-09-30T22:24:19.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.886+0000 7f2830f56700 1 --2- 172.21.15.40:0/129587618 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f282c067bf0 0x7f282c132d70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f281c00b530 tx=0x7f281c00b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:19.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.886+0000 7f18fb7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18fc06f980 0x7f18fc096460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.886+0000 7f18fb7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18fc06f980 0x7f18fc096460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:56554/0 (socket says 172.21.15.40:56554) 2023-09-30T22:24:19.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.886+0000 7f18fb7fe700 1 -- 172.21.15.40:0/2599633112 learned_addr learned my addr 172.21.15.40:0/2599633112 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:19.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.886+0000 7f1900bc3700 1 --2- 172.21.15.40:0/2599633112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18fc06fdb0 0x7f18fc1cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.886+0000 7f2821ffb700 1 -- 172.21.15.40:0/129587618 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c011830 con 0x7f282c067bf0 2023-09-30T22:24:19.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.886+0000 7f2821ffb700 1 -- 172.21.15.40:0/129587618 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281c0119b0 con 0x7f282c067bf0 2023-09-30T22:24:19.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.887+0000 7f2821ffb700 1 -- 172.21.15.40:0/129587618 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c011d60 con 0x7f282c067bf0 2023-09-30T22:24:19.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.887+0000 7f1900bc3700 1 -- 172.21.15.40:0/2599633112 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18fc06f070 msgr2=0x7f18fc095a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.887+0000 7f1900bc3700 1 --2- 172.21.15.40:0/2599633112 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18fc06f070 0x7f18fc095a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.887+0000 7f1900bc3700 1 -- 172.21.15.40:0/2599633112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18fc06f980 msgr2=0x7f18fc096460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.887+0000 7f1900bc3700 1 --2- 172.21.15.40:0/2599633112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18fc06f980 0x7f18fc096460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.887+0000 7f1900bc3700 1 -- 172.21.15.40:0/2599633112 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f4009a70 con 0x7f18fc06fdb0 2023-09-30T22:24:19.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.887+0000 7f18fb7fe700 1 --2- 172.21.15.40:0/2599633112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18fc06f980 0x7f18fc096460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:19.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.887+0000 7f28339bb700 1 -- 172.21.15.40:0/129587618 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f282c0a21b0 con 0x7f282c067bf0 2023-09-30T22:24:19.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.887+0000 7f28339bb700 1 -- 172.21.15.40:0/129587618 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f282c119fb0 con 0x7f282c067bf0 2023-09-30T22:24:19.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.887+0000 7f1900bc3700 1 --2- 172.21.15.40:0/2599633112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18fc06fdb0 0x7f18fc1cc910 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f18f4009e50 tx=0x7f18f400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:19.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.888+0000 7f2821ffb700 1 -- 172.21.15.40:0/129587618 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f281c01a400 con 0x7f282c067bf0 2023-09-30T22:24:19.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.888+0000 7f18f8ff9700 1 -- 172.21.15.40:0/2599633112 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f400cb40 con 0x7f18fc06fdb0 2023-09-30T22:24:19.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.888+0000 7f18f8ff9700 1 -- 172.21.15.40:0/2599633112 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f400f040 con 0x7f18fc06fdb0 2023-09-30T22:24:19.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.888+0000 7f1902626700 1 -- 172.21.15.40:0/2599633112 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18ec009550 con 0x7f18fc06fdb0 2023-09-30T22:24:19.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.888+0000 7f1902626700 1 -- 172.21.15.40:0/2599633112 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18fc094b00 con 0x7f18fc06fdb0 2023-09-30T22:24:19.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.888+0000 7f2821ffb700 1 -- 172.21.15.40:0/129587618 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3967+0+0 (secure 0 0 0) 0x7f281c03b730 con 0x7f282c067bf0 2023-09-30T22:24:19.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.888+0000 7f2831757700 1 -- 172.21.15.40:0/129587618 >> v1:172.21.15.40:6816/118905 conn(0x7f281002c1b0 legacy=0x7f281002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/118905 2023-09-30T22:24:19.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.889+0000 7f18f8ff9700 1 -- 172.21.15.40:0/2599633112 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f4003a20 con 0x7f18fc06fdb0 2023-09-30T22:24:19.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.889+0000 7f18f8ff9700 1 -- 172.21.15.40:0/2599633112 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f18f4014480 con 0x7f18fc06fdb0 2023-09-30T22:24:19.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.889+0000 7f1902626700 1 -- 172.21.15.40:0/2599633112 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f18e0000fb0 con 0x7f18fc06fdb0 2023-09-30T22:24:19.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.889+0000 7f18fbfff700 1 -- 172.21.15.40:0/2599633112 >> v1:172.21.15.40:6816/118905 conn(0x7f18dc02c230 legacy=0x7f18dc02e6e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/118905 2023-09-30T22:24:19.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.889+0000 7f18f8ff9700 1 -- 172.21.15.40:0/2599633112 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3967+0+0 (secure 0 0 0) 0x7f18f401c780 con 0x7f18fc06fdb0 2023-09-30T22:24:19.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.889+0000 7f18f8ff9700 1 -- 172.21.15.40:0/2599633112 --> v1:172.21.15.40:6800/119433 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f18dc038f90 con 0x7f18dc035290 2023-09-30T22:24:19.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.889+0000 7f18f8ff9700 1 -- 172.21.15.40:0/2599633112 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18f4012930 con 0x7f18fc06fdb0 2023-09-30T22:24:19.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.892+0000 7f18f8ff9700 1 -- 172.21.15.40:0/2599633112 <== osd.2 v1:172.21.15.40:6800/119433 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f18dc038f90 con 0x7f18dc035290 2023-09-30T22:24:19.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.896+0000 7f28339bb700 1 -- 172.21.15.40:0/129587618 --> v1:172.21.15.40:6812/119451 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f282c09af90 con 0x7f282c119680 2023-09-30T22:24:19.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.897+0000 7f2821ffb700 1 -- 172.21.15.40:0/129587618 <== osd.0 v1:172.21.15.40:6812/119451 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f2824001900 con 0x7f282c119680 2023-09-30T22:24:19.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.917+0000 7f7e45be6700 1 Processor -- start 2023-09-30T22:24:19.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.917+0000 7f7e45be6700 1 -- start start 2023-09-30T22:24:19.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.918+0000 7f7e45be6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7e4009d450 0x7f7e4009d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.918+0000 7f7e45be6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e401308d0 0x7f7e40138420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.918+0000 7f7e45be6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e4009e8b0 con 0x7f7e4009dd60 2023-09-30T22:24:19.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.918+0000 7f7e45be6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e4009c3b0 con 0x7f7e4009d450 2023-09-30T22:24:19.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.918+0000 7f7e45be6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4009a6b0 con 0x7f7e401308d0 2023-09-30T22:24:19.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.918+0000 7f7e3effd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7e4009dd60 0x7f7e401301c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50092/0 (socket says 172.21.15.40:50092) 2023-09-30T22:24:19.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.918+0000 7f7e3effd700 1 -- 172.21.15.40:0/1459665119 learned_addr learned my addr 172.21.15.40:0/1459665119 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:24:19.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.918+0000 7f7e3f7fe700 1 --2- 172.21.15.40:0/1459665119 >> v2:172.21.15.40:3300/0 conn(0x7f7e4009d450 0x7f7e4009d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.918+0000 7f7e3e7fc700 1 -- 172.21.15.40:0/1459665119 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3598555809 0 0) 0x7f7e4009e8b0 con 0x7f7e4009dd60 2023-09-30T22:24:19.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.918+0000 7f7e3e7fc700 1 -- 172.21.15.40:0/1459665119 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e280035b0 con 0x7f7e4009dd60 2023-09-30T22:24:19.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.918+0000 7f7e3f7fe700 1 -- 172.21.15.40:0/1459665119 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e401308d0 msgr2=0x7f7e40138420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:19.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.918+0000 7f7e3f7fe700 1 --2- 172.21.15.40:0/1459665119 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e401308d0 0x7f7e40138420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.918+0000 7f7e3f7fe700 1 -- 172.21.15.40:0/1459665119 >> v1:172.21.15.40:6789/0 conn(0x7f7e4009dd60 legacy=0x7f7e401301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.918+0000 7f7e3f7fe700 1 -- 172.21.15.40:0/1459665119 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e4009b4f0 con 0x7f7e4009d450 2023-09-30T22:24:19.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.919+0000 7f7e3f7fe700 1 --2- 172.21.15.40:0/1459665119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e4009d450 0x7f7e4009d820 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7e30009840 tx=0x7f7e30009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf799a0f3312116 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:19.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.919+0000 7f7e3e7fc700 1 -- 172.21.15.40:0/1459665119 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e30011830 con 0x7f7e4009d450 2023-09-30T22:24:19.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.919+0000 7f7e3e7fc700 1 -- 172.21.15.40:0/1459665119 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e30011990 con 0x7f7e4009d450 2023-09-30T22:24:19.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.919+0000 7f7e3e7fc700 1 -- 172.21.15.40:0/1459665119 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e30011d20 con 0x7f7e4009d450 2023-09-30T22:24:19.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.919+0000 7f7e45be6700 1 -- 172.21.15.40:0/1459665119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e4009d450 msgr2=0x7f7e4009d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.919+0000 7f7e45be6700 1 --2- 172.21.15.40:0/1459665119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e4009d450 0x7f7e4009d820 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7e30009840 tx=0x7f7e30009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:19.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.920+0000 7f7e45be6700 1 -- 172.21.15.40:0/1459665119 shutdown_connections 2023-09-30T22:24:19.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.920+0000 7f7e45be6700 1 --2- 172.21.15.40:0/1459665119 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e401308d0 0x7f7e40138420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.920+0000 7f7e45be6700 1 --2- 172.21.15.40:0/1459665119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e4009d450 0x7f7e4009d820 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.920+0000 7f7e45be6700 1 -- 172.21.15.40:0/1459665119 >> 172.21.15.40:0/1459665119 conn(0x7f7e400a2a00 msgr2=0x7f7e400a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:19.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.920+0000 7f7e45be6700 1 -- 172.21.15.40:0/1459665119 shutdown_connections 2023-09-30T22:24:19.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.922+0000 7f28339bb700 1 -- 172.21.15.40:0/129587618 --> v1:172.21.15.40:6812/119451 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f282c062060 con 0x7f282c119680 2023-09-30T22:24:19.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.922+0000 7f2821ffb700 1 -- 172.21.15.40:0/129587618 <== osd.0 v1:172.21.15.40:6812/119451 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2188548419) 0x7f282c062060 con 0x7f282c119680 2023-09-30T22:24:19.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.923+0000 7f28339bb700 1 -- 172.21.15.40:0/129587618 >> v1:172.21.15.40:6812/119451 conn(0x7f282c119680 legacy=0x7f282c0616a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.923+0000 7f28339bb700 1 -- 172.21.15.40:0/129587618 >> v1:172.21.15.40:6816/118905 conn(0x7f281002c1b0 legacy=0x7f281002e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:19.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.923+0000 7f28339bb700 1 -- 172.21.15.40:0/129587618 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f282c067bf0 msgr2=0x7f282c132d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.923+0000 7f28339bb700 1 --2- 172.21.15.40:0/129587618 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f282c067bf0 0x7f282c132d70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f281c00b530 tx=0x7f281c00b840 comp rx=0 tx=0).stop 2023-09-30T22:24:19.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.923+0000 7f2831f58700 1 -- 172.21.15.40:0/129587618 reap_dead start 2023-09-30T22:24:19.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.923+0000 7f28339bb700 1 -- 172.21.15.40:0/129587618 shutdown_connections 2023-09-30T22:24:19.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.923+0000 7f28339bb700 1 -- 172.21.15.40:0/129587618 >> 172.21.15.40:0/129587618 conn(0x7f282c0a2a00 msgr2=0x7f282c134490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:19.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.924+0000 7f28339bb700 1 -- 172.21.15.40:0/129587618 shutdown_connections 2023-09-30T22:24:19.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.924+0000 7f1902626700 1 -- 172.21.15.40:0/2599633112 --> v1:172.21.15.40:6800/119433 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f18e0002d00 con 0x7f18dc035290 2023-09-30T22:24:19.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.924+0000 7f28339bb700 1 -- 172.21.15.40:0/129587618 wait complete. 2023-09-30T22:24:19.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.924+0000 7f18f8ff9700 1 -- 172.21.15.40:0/2599633112 <== osd.2 v1:172.21.15.40:6800/119433 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2188548419) 0x7f18e0002d00 con 0x7f18dc035290 2023-09-30T22:24:19.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.925+0000 7f7e45be6700 1 -- 172.21.15.40:0/1459665119 wait complete. 2023-09-30T22:24:19.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.925+0000 7f1902626700 1 -- 172.21.15.40:0/2599633112 >> v1:172.21.15.40:6800/119433 conn(0x7f18dc035290 legacy=0x7f18dc037720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.926+0000 7f7e45be6700 1 Processor -- start 2023-09-30T22:24:19.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.926+0000 7f1902626700 1 -- 172.21.15.40:0/2599633112 >> v1:172.21.15.40:6816/118905 conn(0x7f18dc02c230 legacy=0x7f18dc02e6e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:19.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.926+0000 7f1902626700 1 -- 172.21.15.40:0/2599633112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18fc06fdb0 msgr2=0x7f18fc1cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.926+0000 7f1902626700 1 --2- 172.21.15.40:0/2599633112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18fc06fdb0 0x7f18fc1cc910 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f18f4009e50 tx=0x7f18f400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.926+0000 7f1900bc3700 1 -- 172.21.15.40:0/2599633112 reap_dead start 2023-09-30T22:24:19.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.926+0000 7f7e45be6700 1 -- start start 2023-09-30T22:24:19.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.927+0000 7f7e45be6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e4009d450 0x7f7e40135d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.927+0000 7f7e45be6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e4009dd60 0x7f7e40136290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.927+0000 7f7e45be6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e401308d0 0x7f7e401367d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.927+0000 7f7e45be6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e40119b60 con 0x7f7e401308d0 2023-09-30T22:24:19.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.927+0000 7f7e45be6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e40119600 con 0x7f7e4009d450 2023-09-30T22:24:19.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.927+0000 7f7e45be6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e40137a00 con 0x7f7e4009dd60 2023-09-30T22:24:19.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.927+0000 7f7e3effd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e4009dd60 0x7f7e40136290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.927+0000 7f7e3effd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e4009dd60 0x7f7e40136290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:50464/0 (socket says 172.21.15.40:50464) 2023-09-30T22:24:19.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.927+0000 7f7e3effd700 1 -- 172.21.15.40:0/10794707 learned_addr learned my addr 172.21.15.40:0/10794707 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:19.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.927+0000 7f7e3ffff700 1 --2- 172.21.15.40:0/10794707 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e401308d0 0x7f7e401367d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.927+0000 7f7e3f7fe700 1 --2- 172.21.15.40:0/10794707 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e4009d450 0x7f7e40135d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.927+0000 7f7e3effd700 1 -- 172.21.15.40:0/10794707 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e4009d450 msgr2=0x7f7e40135d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.927+0000 7f7e3effd700 1 --2- 172.21.15.40:0/10794707 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e4009d450 0x7f7e40135d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.927+0000 7f7e3effd700 1 -- 172.21.15.40:0/10794707 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e401308d0 msgr2=0x7f7e401367d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.927+0000 7f7e3effd700 1 --2- 172.21.15.40:0/10794707 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e401308d0 0x7f7e401367d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.927+0000 7f7e3effd700 1 -- 172.21.15.40:0/10794707 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e300094a0 con 0x7f7e4009dd60 2023-09-30T22:24:19.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.927+0000 7f7e3effd700 1 --2- 172.21.15.40:0/10794707 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e4009dd60 0x7f7e40136290 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7e3400c700 tx=0x7f7e3400ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:19.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.927+0000 7f1902626700 1 -- 172.21.15.40:0/2599633112 shutdown_connections 2023-09-30T22:24:19.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.927+0000 7f1902626700 1 -- 172.21.15.40:0/2599633112 >> 172.21.15.40:0/2599633112 conn(0x7f18fc0a41a0 msgr2=0x7f18fc0a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:19.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.928+0000 7f1902626700 1 -- 172.21.15.40:0/2599633112 shutdown_connections 2023-09-30T22:24:19.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.928+0000 7f1902626700 1 -- 172.21.15.40:0/2599633112 wait complete. 2023-09-30T22:24:19.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.928+0000 7f7e27fff700 1 -- 172.21.15.40:0/10794707 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e34005d70 con 0x7f7e4009dd60 2023-09-30T22:24:19.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.928+0000 7f7e27fff700 1 -- 172.21.15.40:0/10794707 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e340070d0 con 0x7f7e4009dd60 2023-09-30T22:24:19.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.928+0000 7f7e27fff700 1 -- 172.21.15.40:0/10794707 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e34007460 con 0x7f7e4009dd60 2023-09-30T22:24:19.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.929+0000 7f7e45be6700 1 -- 172.21.15.40:0/10794707 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e400a2100 con 0x7f7e4009dd60 2023-09-30T22:24:19.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.929+0000 7f7e45be6700 1 -- 172.21.15.40:0/10794707 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e40119170 con 0x7f7e4009dd60 2023-09-30T22:24:19.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.930+0000 7f7e45be6700 1 -- 172.21.15.40:0/10794707 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7e4009b7d0 con 0x7f7e4009dd60 2023-09-30T22:24:19.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.930+0000 7f7e27fff700 1 -- 172.21.15.40:0/10794707 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f7e340075c0 con 0x7f7e4009dd60 2023-09-30T22:24:19.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.930+0000 7f7e27fff700 1 -- 172.21.15.40:0/10794707 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3967+0+0 (secure 0 0 0) 0x7f7e3403b550 con 0x7f7e4009dd60 2023-09-30T22:24:19.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.930+0000 7f7e3f7fe700 1 -- 172.21.15.40:0/10794707 >> v1:172.21.15.40:6816/118905 conn(0x7f7e2c02c200 legacy=0x7f7e2c02e6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/118905 2023-09-30T22:24:19.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.931+0000 7f7e27fff700 1 -- 172.21.15.40:0/10794707 --> v1:172.21.15.40:6804/119432 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7e2c039050 con 0x7f7e2c035350 2023-09-30T22:24:19.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.931+0000 7f7e27fff700 1 -- 172.21.15.40:0/10794707 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e3403b880 con 0x7f7e4009dd60 2023-09-30T22:24:19.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.932+0000 7f7e27fff700 1 -- 172.21.15.40:0/10794707 <== osd.3 v1:172.21.15.40:6804/119432 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f7e2c039050 con 0x7f7e2c035350 2023-09-30T22:24:19.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.933+0000 7f823e0d8700 1 Processor -- start 2023-09-30T22:24:19.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.934+0000 7f823e0d8700 1 -- start start 2023-09-30T22:24:19.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.934+0000 7f823e0d8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f823813b130 0x7f823813d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.934+0000 7f823e0d8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f823813da50 0x7f823813fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.934+0000 7f823e0d8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8238137e20 con 0x7f8238138250 2023-09-30T22:24:19.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.934+0000 7f823e0d8700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8238138d30 con 0x7f823813da50 2023-09-30T22:24:19.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.934+0000 7f823e0d8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8238138050 con 0x7f823813b130 2023-09-30T22:24:19.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.934+0000 7f8236ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f823813b130 0x7f823813d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.934+0000 7f8236ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f823813b130 0x7f823813d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:56590/0 (socket says 172.21.15.40:56590) 2023-09-30T22:24:19.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.934+0000 7f8236ffd700 1 -- 172.21.15.40:0/3910870370 learned_addr learned my addr 172.21.15.40:0/3910870370 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:19.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.934+0000 7f8237fff700 1 --2- 172.21.15.40:0/3910870370 >> v2:172.21.15.40:3300/0 conn(0x7f823813da50 0x7f823813fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.935+0000 7f8236ffd700 1 -- 172.21.15.40:0/3910870370 >> v2:172.21.15.40:3300/0 conn(0x7f823813da50 msgr2=0x7f823813fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:19.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.935+0000 7f8236ffd700 1 --2- 172.21.15.40:0/3910870370 >> v2:172.21.15.40:3300/0 conn(0x7f823813da50 0x7f823813fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.935+0000 7f8236ffd700 1 -- 172.21.15.40:0/3910870370 >> v1:172.21.15.40:6789/0 conn(0x7f8238138250 legacy=0x7f8238138620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.935+0000 7f8236ffd700 1 -- 172.21.15.40:0/3910870370 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f823809b010 con 0x7f823813b130 2023-09-30T22:24:19.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.935+0000 7f8236ffd700 1 --2- 172.21.15.40:0/3910870370 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f823813b130 0x7f823813d510 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f822c009920 tx=0x7f822c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b91c28aceb01d95 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:19.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.935+0000 7f82367fc700 1 -- 172.21.15.40:0/3910870370 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822c011830 con 0x7f823813b130 2023-09-30T22:24:19.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.935+0000 7f82367fc700 1 -- 172.21.15.40:0/3910870370 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822c011990 con 0x7f823813b130 2023-09-30T22:24:19.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.935+0000 7f82367fc700 1 -- 172.21.15.40:0/3910870370 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822c011d00 con 0x7f823813b130 2023-09-30T22:24:19.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.936+0000 7f823e0d8700 1 -- 172.21.15.40:0/3910870370 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f823813b130 msgr2=0x7f823813d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.936+0000 7f823e0d8700 1 --2- 172.21.15.40:0/3910870370 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f823813b130 0x7f823813d510 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f822c009920 tx=0x7f822c009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:19.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.936+0000 7f823e0d8700 1 -- 172.21.15.40:0/3910870370 shutdown_connections 2023-09-30T22:24:19.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.936+0000 7f823e0d8700 1 --2- 172.21.15.40:0/3910870370 >> v2:172.21.15.40:3300/0 conn(0x7f823813da50 0x7f823813fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.936+0000 7f823e0d8700 1 --2- 172.21.15.40:0/3910870370 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f823813b130 0x7f823813d510 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.936+0000 7f823e0d8700 1 -- 172.21.15.40:0/3910870370 >> 172.21.15.40:0/3910870370 conn(0x7f82380a2a00 msgr2=0x7f82380a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:19.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.936+0000 7f823e0d8700 1 -- 172.21.15.40:0/3910870370 shutdown_connections 2023-09-30T22:24:19.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.936+0000 7f823e0d8700 1 -- 172.21.15.40:0/3910870370 wait complete. 2023-09-30T22:24:19.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.937+0000 7f823e0d8700 1 Processor -- start 2023-09-30T22:24:19.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.937+0000 7f823e0d8700 1 -- start start 2023-09-30T22:24:19.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.939+0000 7f823e0d8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8238138250 0x7f823813f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.939+0000 7f823e0d8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f823813b130 0x7f823813fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.939+0000 7f823e0d8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f823813da50 0x7f82381402e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.939+0000 7f823e0d8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823806fa40 con 0x7f823813b130 2023-09-30T22:24:19.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.939+0000 7f823e0d8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8238070620 con 0x7f8238138250 2023-09-30T22:24:19.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.939+0000 7f823e0d8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8238140f70 con 0x7f823813da50 2023-09-30T22:24:19.941 INFO:teuthology.orchestra.run.smithi040.stdout:38654705695 2023-09-30T22:24:19.941 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:19.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.939+0000 7f8236ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f823813b130 0x7f823813fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.939+0000 7f8236ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f823813b130 0x7f823813fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60526/0 (socket says 172.21.15.40:60526) 2023-09-30T22:24:19.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.939+0000 7f8236ffd700 1 -- 172.21.15.40:0/3333972886 learned_addr learned my addr 172.21.15.40:0/3333972886 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:19.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.939+0000 7f8236ffd700 1 -- 172.21.15.40:0/3333972886 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f823813da50 msgr2=0x7f82381402e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.939+0000 7f8236ffd700 1 --2- 172.21.15.40:0/3333972886 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f823813da50 0x7f82381402e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.939+0000 7f8236ffd700 1 -- 172.21.15.40:0/3333972886 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8238138250 msgr2=0x7f823813f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.939+0000 7f8236ffd700 1 --2- 172.21.15.40:0/3333972886 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8238138250 0x7f823813f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.939+0000 7f8236ffd700 1 -- 172.21.15.40:0/3333972886 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f822c009550 con 0x7f823813b130 2023-09-30T22:24:19.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.939+0000 7f8236ffd700 1 --2- 172.21.15.40:0/3333972886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f823813b130 0x7f823813fda0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f822c009130 tx=0x7f822c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:19.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.940+0000 7f821ffff700 1 -- 172.21.15.40:0/3333972886 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822c004300 con 0x7f823813b130 2023-09-30T22:24:19.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.940+0000 7f821ffff700 1 -- 172.21.15.40:0/3333972886 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822c01f070 con 0x7f823813b130 2023-09-30T22:24:19.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.940+0000 7f821ffff700 1 -- 172.21.15.40:0/3333972886 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822c0036a0 con 0x7f823813b130 2023-09-30T22:24:19.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.940+0000 7f823e0d8700 1 -- 172.21.15.40:0/3333972886 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f823806e390 con 0x7f823813b130 2023-09-30T22:24:19.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.940+0000 7f823e0d8700 1 -- 172.21.15.40:0/3333972886 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f823806f1d0 con 0x7f823813b130 2023-09-30T22:24:19.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.941+0000 7f823e0d8700 1 -- 172.21.15.40:0/3333972886 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f823809f270 con 0x7f823813b130 2023-09-30T22:24:19.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.941+0000 7f821ffff700 1 -- 172.21.15.40:0/3333972886 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f822c021030 con 0x7f823813b130 2023-09-30T22:24:19.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.941+0000 7f821ffff700 1 -- 172.21.15.40:0/3333972886 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3967+0+0 (secure 0 0 0) 0x7f822c03d000 con 0x7f823813b130 2023-09-30T22:24:19.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.942+0000 7f82377fe700 1 -- 172.21.15.40:0/3333972886 >> v1:172.21.15.40:6816/118905 conn(0x7f822402c1b0 legacy=0x7f822402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/118905 2023-09-30T22:24:19.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.942+0000 7f821ffff700 1 -- 172.21.15.40:0/3333972886 --> v1:172.21.15.40:6808/119436 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8224038f10 con 0x7f8224035210 2023-09-30T22:24:19.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.942+0000 7f821ffff700 1 -- 172.21.15.40:0/3333972886 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f822c03d310 con 0x7f823813b130 2023-09-30T22:24:19.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.943+0000 7f821ffff700 1 -- 172.21.15.40:0/3333972886 <== osd.1 v1:172.21.15.40:6808/119436 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f8224038f10 con 0x7f8224035210 2023-09-30T22:24:19.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.950+0000 7f7e45be6700 1 -- 172.21.15.40:0/10794707 --> v1:172.21.15.40:6804/119432 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7e4011a300 con 0x7f7e2c035350 2023-09-30T22:24:19.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.950+0000 7f7e27fff700 1 -- 172.21.15.40:0/10794707 <== osd.3 v1:172.21.15.40:6804/119432 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2188548419) 0x7f7e4011a300 con 0x7f7e2c035350 2023-09-30T22:24:19.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.950+0000 7f7e45be6700 1 -- 172.21.15.40:0/10794707 >> v1:172.21.15.40:6804/119432 conn(0x7f7e2c035350 legacy=0x7f7e2c0377e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.951+0000 7f7e45be6700 1 -- 172.21.15.40:0/10794707 >> v1:172.21.15.40:6816/118905 conn(0x7f7e2c02c200 legacy=0x7f7e2c02e6b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:19.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.951+0000 7f7e45be6700 1 -- 172.21.15.40:0/10794707 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e4009dd60 msgr2=0x7f7e40136290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.951+0000 7f7e45be6700 1 --2- 172.21.15.40:0/10794707 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e4009dd60 0x7f7e40136290 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7e3400c700 tx=0x7f7e3400ca10 comp rx=0 tx=0).stop 2023-09-30T22:24:19.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.951+0000 7f7e3ffff700 1 -- 172.21.15.40:0/10794707 reap_dead start 2023-09-30T22:24:19.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.951+0000 7f7e45be6700 1 -- 172.21.15.40:0/10794707 shutdown_connections 2023-09-30T22:24:19.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.951+0000 7f7e45be6700 1 -- 172.21.15.40:0/10794707 >> 172.21.15.40:0/10794707 conn(0x7f7e400a2a00 msgr2=0x7f7e40070300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:19.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.952+0000 7f7e45be6700 1 -- 172.21.15.40:0/10794707 shutdown_connections 2023-09-30T22:24:19.953 INFO:teuthology.orchestra.run.smithi040.stdout:38654705695 2023-09-30T22:24:19.953 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:19.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.952+0000 7f7e45be6700 1 -- 172.21.15.40:0/10794707 wait complete. 2023-09-30T22:24:19.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.961+0000 7f823e0d8700 1 -- 172.21.15.40:0/3333972886 --> v1:172.21.15.40:6808/119436 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f82380701b0 con 0x7f8224035210 2023-09-30T22:24:19.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.961+0000 7f821ffff700 1 -- 172.21.15.40:0/3333972886 <== osd.1 v1:172.21.15.40:6808/119436 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2188548419) 0x7f82380701b0 con 0x7f8224035210 2023-09-30T22:24:19.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.962+0000 7f823e0d8700 1 -- 172.21.15.40:0/3333972886 >> v1:172.21.15.40:6808/119436 conn(0x7f8224035210 legacy=0x7f82240376a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.962+0000 7f823e0d8700 1 -- 172.21.15.40:0/3333972886 >> v1:172.21.15.40:6816/118905 conn(0x7f822402c1b0 legacy=0x7f822402e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:19.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.962+0000 7f823e0d8700 1 -- 172.21.15.40:0/3333972886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f823813b130 msgr2=0x7f823813fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.962+0000 7f823e0d8700 1 --2- 172.21.15.40:0/3333972886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f823813b130 0x7f823813fda0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f822c009130 tx=0x7f822c004750 comp rx=0 tx=0).stop 2023-09-30T22:24:19.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.962+0000 7f8237fff700 1 -- 172.21.15.40:0/3333972886 reap_dead start 2023-09-30T22:24:19.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.962+0000 7f823e0d8700 1 -- 172.21.15.40:0/3333972886 shutdown_connections 2023-09-30T22:24:19.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.962+0000 7f823e0d8700 1 -- 172.21.15.40:0/3333972886 >> 172.21.15.40:0/3333972886 conn(0x7f82380a2a00 msgr2=0x7f823813cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:19.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.962+0000 7f823e0d8700 1 -- 172.21.15.40:0/3333972886 shutdown_connections 2023-09-30T22:24:19.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:19.962+0000 7f823e0d8700 1 -- 172.21.15.40:0/3333972886 wait complete. 2023-09-30T22:24:19.972 INFO:teuthology.orchestra.run.smithi040.stdout:38654705695 2023-09-30T22:24:19.972 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:19.979 INFO:teuthology.orchestra.run.smithi040.stdout:38654705695 2023-09-30T22:24:19.979 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:20.041 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:20.040+0000 7ff0e5d3a240 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-30T22:24:20.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.103+0000 7f0bfc920700 1 Processor -- start 2023-09-30T22:24:20.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.103+0000 7f0bfc920700 1 -- start start 2023-09-30T22:24:20.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.104+0000 7f0bfc920700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0bf813b130 0x7f0bf813d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.104+0000 7f0bfc920700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0bf813da50 0x7f0bf813fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.104+0000 7f0bfc920700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bf8137e20 con 0x7f0bf8138250 2023-09-30T22:24:20.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.104+0000 7f0bfc920700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf8138d30 con 0x7f0bf813da50 2023-09-30T22:24:20.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.104+0000 7f0bfc920700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf8138050 con 0x7f0bf813b130 2023-09-30T22:24:20.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.104+0000 7f0bf659c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f0bf8138250 0x7f0bf8138620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50114/0 (socket says 172.21.15.40:50114) 2023-09-30T22:24:20.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.104+0000 7f0bf659c700 1 -- 172.21.15.40:0/2931303679 learned_addr learned my addr 172.21.15.40:0/2931303679 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:24:20.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.104+0000 7f0bf5d9b700 1 --2- 172.21.15.40:0/2931303679 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0bf813b130 0x7f0bf813d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.105+0000 7f0bf6d9d700 1 --2- 172.21.15.40:0/2931303679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0bf813da50 0x7f0bf813fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.105+0000 7f0bf5d9b700 1 -- 172.21.15.40:0/2931303679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0bf813da50 msgr2=0x7f0bf813fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:20.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.105+0000 7f0bf5d9b700 1 --2- 172.21.15.40:0/2931303679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0bf813da50 0x7f0bf813fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.105+0000 7f0bf5d9b700 1 -- 172.21.15.40:0/2931303679 >> v1:172.21.15.40:6789/0 conn(0x7f0bf8138250 legacy=0x7f0bf8138620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.105+0000 7f0bf5d9b700 1 -- 172.21.15.40:0/2931303679 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf809b010 con 0x7f0bf813b130 2023-09-30T22:24:20.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.105+0000 7f0bf5d9b700 1 --2- 172.21.15.40:0/2931303679 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0bf813b130 0x7f0bf813d510 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0bec009870 tx=0x7f0bec009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a1ff8e6e99e9169 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:20.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.105+0000 7f0bf559a700 1 -- 172.21.15.40:0/2931303679 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bec011830 con 0x7f0bf813b130 2023-09-30T22:24:20.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.105+0000 7f0bf559a700 1 -- 172.21.15.40:0/2931303679 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bec011990 con 0x7f0bf813b130 2023-09-30T22:24:20.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.105+0000 7f0bf559a700 1 -- 172.21.15.40:0/2931303679 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bec011d20 con 0x7f0bf813b130 2023-09-30T22:24:20.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.106+0000 7f0bfc920700 1 -- 172.21.15.40:0/2931303679 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0bf813b130 msgr2=0x7f0bf813d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.106+0000 7f0bfc920700 1 --2- 172.21.15.40:0/2931303679 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0bf813b130 0x7f0bf813d510 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0bec009870 tx=0x7f0bec009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:20.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.106+0000 7f0bfc920700 1 -- 172.21.15.40:0/2931303679 shutdown_connections 2023-09-30T22:24:20.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.106+0000 7f0bfc920700 1 --2- 172.21.15.40:0/2931303679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0bf813da50 0x7f0bf813fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.106+0000 7f0bfc920700 1 --2- 172.21.15.40:0/2931303679 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0bf813b130 0x7f0bf813d510 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.106+0000 7f0bfc920700 1 -- 172.21.15.40:0/2931303679 >> 172.21.15.40:0/2931303679 conn(0x7f0bf80a2a00 msgr2=0x7f0bf80a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:20.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.106+0000 7f0bfc920700 1 -- 172.21.15.40:0/2931303679 shutdown_connections 2023-09-30T22:24:20.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.107+0000 7f0bfc920700 1 -- 172.21.15.40:0/2931303679 wait complete. 2023-09-30T22:24:20.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.108+0000 7f0bfc920700 1 Processor -- start 2023-09-30T22:24:20.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.108+0000 7f0bfc920700 1 -- start start 2023-09-30T22:24:20.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.108+0000 7f0bfc920700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0bf8138250 0x7f0bf8135440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.108+0000 7f0bfc920700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0bf813b130 0x7f0bf806d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.108+0000 7f0bfc920700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0bf813da50 0x7f0bf806db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.108+0000 7f0bfc920700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf8070050 con 0x7f0bf8138250 2023-09-30T22:24:20.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.108+0000 7f0bfc920700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf806f620 con 0x7f0bf813b130 2023-09-30T22:24:20.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.108+0000 7f0bfc920700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf806fc60 con 0x7f0bf813da50 2023-09-30T22:24:20.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.108+0000 7f0bf6d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0bf813da50 0x7f0bf806db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.108+0000 7f0bf659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0bf8138250 0x7f0bf8135440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.108+0000 7f0bf6d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0bf813da50 0x7f0bf806db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:50500/0 (socket says 172.21.15.40:50500) 2023-09-30T22:24:20.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.108+0000 7f0bf659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0bf8138250 0x7f0bf8135440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60540/0 (socket says 172.21.15.40:60540) 2023-09-30T22:24:20.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.108+0000 7f0bf6d9d700 1 -- 172.21.15.40:0/619869712 learned_addr learned my addr 172.21.15.40:0/619869712 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:20.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.109+0000 7f0bf5d9b700 1 --2- 172.21.15.40:0/619869712 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0bf813b130 0x7f0bf806d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.109+0000 7f0bf6d9d700 1 -- 172.21.15.40:0/619869712 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0bf813b130 msgr2=0x7f0bf806d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.109+0000 7f0bf6d9d700 1 --2- 172.21.15.40:0/619869712 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0bf813b130 0x7f0bf806d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.109+0000 7f0bf6d9d700 1 -- 172.21.15.40:0/619869712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0bf8138250 msgr2=0x7f0bf8135440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.109+0000 7f0bf6d9d700 1 --2- 172.21.15.40:0/619869712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0bf8138250 0x7f0bf8135440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.109+0000 7f0bf6d9d700 1 -- 172.21.15.40:0/619869712 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bec0094a0 con 0x7f0bf813da50 2023-09-30T22:24:20.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.109+0000 7f0bf5d9b700 1 --2- 172.21.15.40:0/619869712 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0bf813b130 0x7f0bf806d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:24:20.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.109+0000 7f0bf6d9d700 1 --2- 172.21.15.40:0/619869712 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0bf813da50 0x7f0bf806db50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000efc0 tx=0x7f0bf000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:20.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.109+0000 7f0be6ffd700 1 -- 172.21.15.40:0/619869712 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf000cd40 con 0x7f0bf813da50 2023-09-30T22:24:20.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.109+0000 7f0be6ffd700 1 -- 172.21.15.40:0/619869712 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf000f040 con 0x7f0bf813da50 2023-09-30T22:24:20.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.109+0000 7f0be6ffd700 1 -- 172.21.15.40:0/619869712 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf00146c0 con 0x7f0bf813da50 2023-09-30T22:24:20.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.110+0000 7f0bfc920700 1 -- 172.21.15.40:0/619869712 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf806f990 con 0x7f0bf813da50 2023-09-30T22:24:20.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.110+0000 7f0bfc920700 1 -- 172.21.15.40:0/619869712 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf8070ab0 con 0x7f0bf813da50 2023-09-30T22:24:20.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.111+0000 7f0be6ffd700 1 -- 172.21.15.40:0/619869712 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f0bf0014820 con 0x7f0bf813da50 2023-09-30T22:24:20.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.111+0000 7f0bfc920700 1 -- 172.21.15.40:0/619869712 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bf806f7e0 con 0x7f0bf813da50 2023-09-30T22:24:20.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.111+0000 7f0bf659c700 1 -- 172.21.15.40:0/619869712 >> v1:172.21.15.40:6816/118905 conn(0x7f0bd802c1b0 legacy=0x7f0bd802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/118905 2023-09-30T22:24:20.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.111+0000 7f0be6ffd700 1 -- 172.21.15.40:0/619869712 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3967+0+0 (secure 0 0 0) 0x7f0bf003c460 con 0x7f0bf813da50 2023-09-30T22:24:20.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.112+0000 7fcc79a19700 1 Processor -- start 2023-09-30T22:24:20.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.118+0000 7fcc79a19700 1 -- start start 2023-09-30T22:24:20.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.119+0000 7fcc79a19700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcc7412cac0 0x7fcc7412ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.120+0000 7f0be6ffd700 1 -- 172.21.15.40:0/619869712 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f0bf00076f0 con 0x7f0bf813da50 2023-09-30T22:24:20.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.119+0000 7fcc79a19700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc7412c3a0 0x7fcc74099510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.119+0000 7fcc79a19700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc7409aae0 con 0x7fcc74099a50 2023-09-30T22:24:20.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.119+0000 7fcc79a19700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc7409e7c0 con 0x7fcc7412cac0 2023-09-30T22:24:20.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.119+0000 7fcc79a19700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7409b4d0 con 0x7fcc7412c3a0 2023-09-30T22:24:20.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.119+0000 7fcc727fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc7412c3a0 0x7fcc74099510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.119+0000 7fcc727fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc7412c3a0 0x7fcc74099510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:56624/0 (socket says 172.21.15.40:56624) 2023-09-30T22:24:20.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.119+0000 7fcc727fc700 1 -- 172.21.15.40:0/3447643531 learned_addr learned my addr 172.21.15.40:0/3447643531 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:20.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.119+0000 7fcc72ffd700 1 --2- 172.21.15.40:0/3447643531 >> v2:172.21.15.40:3300/0 conn(0x7fcc7412cac0 0x7fcc7412ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.119+0000 7fcc72ffd700 1 -- 172.21.15.40:0/3447643531 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc7412c3a0 msgr2=0x7fcc74099510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:20.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.119+0000 7fcc72ffd700 1 --2- 172.21.15.40:0/3447643531 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc7412c3a0 0x7fcc74099510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.119+0000 7fcc72ffd700 1 -- 172.21.15.40:0/3447643531 >> v1:172.21.15.40:6789/0 conn(0x7fcc74099a50 legacy=0x7fcc74136ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.119+0000 7fcc72ffd700 1 -- 172.21.15.40:0/3447643531 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc7412c8a0 con 0x7fcc7412cac0 2023-09-30T22:24:20.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.120+0000 7fcc72ffd700 1 --2- 172.21.15.40:0/3447643531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc7412cac0 0x7fcc7412ce90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcc64009820 tx=0x7fcc64009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7dcda2aa97ddb38 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:20.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.120+0000 7fcc71ffb700 1 -- 172.21.15.40:0/3447643531 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc64005e30 con 0x7fcc7412cac0 2023-09-30T22:24:20.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.120+0000 7fcc71ffb700 1 -- 172.21.15.40:0/3447643531 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc64006030 con 0x7fcc7412cac0 2023-09-30T22:24:20.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.120+0000 7fcc71ffb700 1 -- 172.21.15.40:0/3447643531 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc640063c0 con 0x7fcc7412cac0 2023-09-30T22:24:20.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.121+0000 7fcc79a19700 1 -- 172.21.15.40:0/3447643531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc7412cac0 msgr2=0x7fcc7412ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.121+0000 7fcc79a19700 1 --2- 172.21.15.40:0/3447643531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc7412cac0 0x7fcc7412ce90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcc64009820 tx=0x7fcc64009b30 comp rx=0 tx=0).stop 2023-09-30T22:24:20.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.121+0000 7fcc79a19700 1 -- 172.21.15.40:0/3447643531 shutdown_connections 2023-09-30T22:24:20.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.121+0000 7fcc79a19700 1 --2- 172.21.15.40:0/3447643531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc7412cac0 0x7fcc7412ce90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.121+0000 7fcc79a19700 1 --2- 172.21.15.40:0/3447643531 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc7412c3a0 0x7fcc74099510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.121+0000 7fcc79a19700 1 -- 172.21.15.40:0/3447643531 >> 172.21.15.40:0/3447643531 conn(0x7fcc740a2c70 msgr2=0x7fcc7409eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:20.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.121+0000 7fcc79a19700 1 -- 172.21.15.40:0/3447643531 shutdown_connections 2023-09-30T22:24:20.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.121+0000 7fcc79a19700 1 -- 172.21.15.40:0/3447643531 wait complete. 2023-09-30T22:24:20.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.123+0000 7fcc79a19700 1 Processor -- start 2023-09-30T22:24:20.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.124+0000 7fcc79a19700 1 -- start start 2023-09-30T22:24:20.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.125+0000 7fcc79a19700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc74099a50 0x7fcc7412f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.125+0000 7fcc79a19700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc7412c3a0 0x7fcc7412f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.125+0000 7fcc79a19700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc7412cac0 0x7fcc7412fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.125+0000 7fcc79a19700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7406d390 con 0x7fcc74099a50 2023-09-30T22:24:20.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.125+0000 7fcc79a19700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7406cfd0 con 0x7fcc7412c3a0 2023-09-30T22:24:20.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.125+0000 7fcc79a19700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7412b540 con 0x7fcc7412cac0 2023-09-30T22:24:20.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.125+0000 7fcc737fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc7412cac0 0x7fcc7412fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.125+0000 7fcc737fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc7412cac0 0x7fcc7412fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:50504/0 (socket says 172.21.15.40:50504) 2023-09-30T22:24:20.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.125+0000 7fcc737fe700 1 -- 172.21.15.40:0/3218699624 learned_addr learned my addr 172.21.15.40:0/3218699624 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:20.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.125+0000 7fcc72ffd700 1 --2- 172.21.15.40:0/3218699624 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc74099a50 0x7fcc7412f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.126+0000 7fcc737fe700 1 -- 172.21.15.40:0/3218699624 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc7412c3a0 msgr2=0x7fcc7412f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.126+0000 7fcc737fe700 1 --2- 172.21.15.40:0/3218699624 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc7412c3a0 0x7fcc7412f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.126+0000 7fcc737fe700 1 -- 172.21.15.40:0/3218699624 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc74099a50 msgr2=0x7fcc7412f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.126+0000 7fcc737fe700 1 --2- 172.21.15.40:0/3218699624 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc74099a50 0x7fcc7412f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.126+0000 7fcc737fe700 1 -- 172.21.15.40:0/3218699624 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc64009430 con 0x7fcc7412cac0 2023-09-30T22:24:20.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.126+0000 7fcc737fe700 1 --2- 172.21.15.40:0/3218699624 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc7412cac0 0x7fcc7412fcb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c00cc50 tx=0x7fcc6c00cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:20.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.127+0000 7fcc5bfff700 1 -- 172.21.15.40:0/3218699624 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c003c00 con 0x7fcc7412cac0 2023-09-30T22:24:20.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.127+0000 7fcc5bfff700 1 -- 172.21.15.40:0/3218699624 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6c003d60 con 0x7fcc7412cac0 2023-09-30T22:24:20.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.127+0000 7fcc79a19700 1 -- 172.21.15.40:0/3218699624 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc7406db60 con 0x7fcc7412cac0 2023-09-30T22:24:20.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.127+0000 7fcc5bfff700 1 -- 172.21.15.40:0/3218699624 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c00ab60 con 0x7fcc7412cac0 2023-09-30T22:24:20.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.127+0000 7fcc79a19700 1 -- 172.21.15.40:0/3218699624 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc7406e890 con 0x7fcc7412cac0 2023-09-30T22:24:20.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.128+0000 7fcc5bfff700 1 -- 172.21.15.40:0/3218699624 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fcc6c00acc0 con 0x7fcc7412cac0 2023-09-30T22:24:20.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.128+0000 7fcc5bfff700 1 -- 172.21.15.40:0/3218699624 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3967+0+0 (secure 0 0 0) 0x7fcc6c03b830 con 0x7fcc7412cac0 2023-09-30T22:24:20.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.128+0000 7fcc72ffd700 1 -- 172.21.15.40:0/3218699624 >> v1:172.21.15.40:6816/118905 conn(0x7fcc6002c1b0 legacy=0x7fcc6002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/118905 2023-09-30T22:24:20.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.129+0000 7fcc79a19700 1 -- 172.21.15.40:0/3218699624 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc74072720 con 0x7fcc7412cac0 2023-09-30T22:24:20.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.134+0000 7fcc5bfff700 1 -- 172.21.15.40:0/3218699624 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fcc6c0198f0 con 0x7fcc7412cac0 2023-09-30T22:24:20.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.185+0000 7f6bddc52700 1 Processor -- start 2023-09-30T22:24:20.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.185+0000 7f6bddc52700 1 -- start start 2023-09-30T22:24:20.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.186+0000 7f6bddc52700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6bd809d920 0x7f6bd809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.186+0000 7f6bddc52700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6bd8130fb0 0x7f6bd8138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.186+0000 7f6bddc52700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd809adf0 con 0x7f6bd809e230 2023-09-30T22:24:20.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.186+0000 7f6bddc52700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd809edf0 con 0x7f6bd8130fb0 2023-09-30T22:24:20.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.186+0000 7f6bddc52700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd809b660 con 0x7f6bd809d920 2023-09-30T22:24:20.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.186+0000 7f6bd6ffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6bd809e230 0x7f6bd81308a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50126/0 (socket says 172.21.15.40:50126) 2023-09-30T22:24:20.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.186+0000 7f6bd6ffd700 1 -- 172.21.15.40:0/2531192680 learned_addr learned my addr 172.21.15.40:0/2531192680 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:24:20.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.186+0000 7f6bd7fff700 1 --2- 172.21.15.40:0/2531192680 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6bd8130fb0 0x7f6bd8138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.186+0000 7f6bd77fe700 1 --2- 172.21.15.40:0/2531192680 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6bd809d920 0x7f6bd809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.187+0000 7f6bd67fc700 1 -- 172.21.15.40:0/2531192680 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2788971359 0 0) 0x7f6bd809adf0 con 0x7f6bd809e230 2023-09-30T22:24:20.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.187+0000 7f6bd67fc700 1 -- 172.21.15.40:0/2531192680 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bc00035b0 con 0x7f6bd809e230 2023-09-30T22:24:20.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.187+0000 7f6bd7fff700 1 -- 172.21.15.40:0/2531192680 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6bd809d920 msgr2=0x7f6bd809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:20.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.187+0000 7f6bd7fff700 1 --2- 172.21.15.40:0/2531192680 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6bd809d920 0x7f6bd809dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.187+0000 7f6bd7fff700 1 -- 172.21.15.40:0/2531192680 >> v1:172.21.15.40:6789/0 conn(0x7f6bd809e230 legacy=0x7f6bd81308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.187+0000 7f6bd7fff700 1 -- 172.21.15.40:0/2531192680 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd809a6e0 con 0x7f6bd8130fb0 2023-09-30T22:24:20.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.187+0000 7f6bd7fff700 1 --2- 172.21.15.40:0/2531192680 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6bd8130fb0 0x7f6bd8138d10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0009e40 tx=0x7f6bd000d540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55debe844de23e7b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:20.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.187+0000 7f6bd67fc700 1 -- 172.21.15.40:0/2531192680 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd0011460 con 0x7f6bd8130fb0 2023-09-30T22:24:20.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.187+0000 7f6bd67fc700 1 -- 172.21.15.40:0/2531192680 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd00115c0 con 0x7f6bd8130fb0 2023-09-30T22:24:20.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.187+0000 7f6bd67fc700 1 -- 172.21.15.40:0/2531192680 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd0011970 con 0x7f6bd8130fb0 2023-09-30T22:24:20.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.188+0000 7f6bddc52700 1 -- 172.21.15.40:0/2531192680 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6bd8130fb0 msgr2=0x7f6bd8138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.188+0000 7f6bddc52700 1 --2- 172.21.15.40:0/2531192680 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6bd8130fb0 0x7f6bd8138d10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0009e40 tx=0x7f6bd000d540 comp rx=0 tx=0).stop 2023-09-30T22:24:20.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.188+0000 7f6bddc52700 1 -- 172.21.15.40:0/2531192680 shutdown_connections 2023-09-30T22:24:20.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.188+0000 7f6bddc52700 1 --2- 172.21.15.40:0/2531192680 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6bd8130fb0 0x7f6bd8138d10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.188+0000 7f6bddc52700 1 --2- 172.21.15.40:0/2531192680 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6bd809d920 0x7f6bd809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.188+0000 7f6bddc52700 1 -- 172.21.15.40:0/2531192680 >> 172.21.15.40:0/2531192680 conn(0x7f6bd809fb20 msgr2=0x7f6bd809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:20.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.188+0000 7f6bddc52700 1 -- 172.21.15.40:0/2531192680 shutdown_connections 2023-09-30T22:24:20.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.188+0000 7f6bddc52700 1 -- 172.21.15.40:0/2531192680 wait complete. 2023-09-30T22:24:20.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.190+0000 7f6bddc52700 1 Processor -- start 2023-09-30T22:24:20.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.190+0000 7f6bddc52700 1 -- start start 2023-09-30T22:24:20.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.190+0000 7fcb74f2e700 1 Processor -- start 2023-09-30T22:24:20.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.190+0000 7fcb74f2e700 1 -- start start 2023-09-30T22:24:20.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.191+0000 7f6bddc52700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bd809d920 0x7f6bd81c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.191+0000 7f6bddc52700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6bd809e230 0x7f6bd81c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.191+0000 7f6bddc52700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6bd8130fb0 0x7f6bd81c0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.191+0000 7f6bddc52700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd811dba0 con 0x7f6bd809d920 2023-09-30T22:24:20.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.191+0000 7f6bddc52700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd811e8f0 con 0x7f6bd8130fb0 2023-09-30T22:24:20.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.191+0000 7f6bddc52700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd81c4d20 con 0x7f6bd809e230 2023-09-30T22:24:20.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.191+0000 7f6bd7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6bd8130fb0 0x7f6bd81c0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.191+0000 7f6bd7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6bd8130fb0 0x7f6bd81c0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:56656/0 (socket says 172.21.15.40:56656) 2023-09-30T22:24:20.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.191+0000 7f6bd7fff700 1 -- 172.21.15.40:0/2094822420 learned_addr learned my addr 172.21.15.40:0/2094822420 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:20.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.191+0000 7fcb74f2e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcb7009df30 0x7fcb70135400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.191+0000 7fcb74f2e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb70135940 0x7fcb70137d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.191+0000 7fcb74f2e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb7009e8b0 con 0x7fcb7009d450 2023-09-30T22:24:20.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.191+0000 7fcb74f2e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb7009c3b0 con 0x7fcb7009df30 2023-09-30T22:24:20.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.191+0000 7fcb74f2e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7009a6b0 con 0x7fcb70135940 2023-09-30T22:24:20.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.191+0000 7f6bd7fff700 1 -- 172.21.15.40:0/2094822420 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6bd809e230 msgr2=0x7f6bd81c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.191+0000 7f6bd7fff700 1 --2- 172.21.15.40:0/2094822420 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6bd809e230 0x7f6bd81c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.191+0000 7f6bd7fff700 1 -- 172.21.15.40:0/2094822420 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bd809d920 msgr2=0x7f6bd81c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.191+0000 7f6bd7fff700 1 --2- 172.21.15.40:0/2094822420 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bd809d920 0x7f6bd81c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.191+0000 7f6bd7fff700 1 -- 172.21.15.40:0/2094822420 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd0009a70 con 0x7f6bd8130fb0 2023-09-30T22:24:20.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.191+0000 7fcb6dd9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcb7009df30 0x7fcb70135400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.191+0000 7fcb6dd9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcb7009df30 0x7fcb70135400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60566/0 (socket says 172.21.15.40:60566) 2023-09-30T22:24:20.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.191+0000 7fcb6dd9b700 1 -- 172.21.15.40:0/1491805655 learned_addr learned my addr 172.21.15.40:0/1491805655 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:20.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.192+0000 7fcb6ed9d700 1 --2- 172.21.15.40:0/1491805655 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb70135940 0x7fcb70137d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.192+0000 7f6bd7fff700 1 --2- 172.21.15.40:0/2094822420 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6bd8130fb0 0x7f6bd81c0870 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0009fd0 tx=0x7f6bd0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:20.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.192+0000 7f6bbffff700 1 -- 172.21.15.40:0/2094822420 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd0020070 con 0x7f6bd8130fb0 2023-09-30T22:24:20.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.192+0000 7f6bddc52700 1 -- 172.21.15.40:0/2094822420 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd809cb00 con 0x7f6bd8130fb0 2023-09-30T22:24:20.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.192+0000 7fcb6dd9b700 1 -- 172.21.15.40:0/1491805655 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb70135940 msgr2=0x7fcb70137d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:20.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.192+0000 7fcb6dd9b700 1 --2- 172.21.15.40:0/1491805655 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb70135940 0x7fcb70137d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.192+0000 7fcb6dd9b700 1 -- 172.21.15.40:0/1491805655 >> v1:172.21.15.40:6789/0 conn(0x7fcb7009d450 legacy=0x7fcb7009d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.192+0000 7fcb6dd9b700 1 -- 172.21.15.40:0/1491805655 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7009b4f0 con 0x7fcb7009df30 2023-09-30T22:24:20.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.192+0000 7f6bddc52700 1 -- 172.21.15.40:0/2094822420 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd811c9e0 con 0x7f6bd8130fb0 2023-09-30T22:24:20.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.192+0000 7f6bbffff700 1 -- 172.21.15.40:0/2094822420 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd0003e10 con 0x7f6bd8130fb0 2023-09-30T22:24:20.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.192+0000 7f6bbffff700 1 -- 172.21.15.40:0/2094822420 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd0011460 con 0x7f6bd8130fb0 2023-09-30T22:24:20.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.193+0000 7f6bbffff700 1 -- 172.21.15.40:0/2094822420 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f6bd0004040 con 0x7f6bd8130fb0 2023-09-30T22:24:20.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.193+0000 7f6bbffff700 1 -- 172.21.15.40:0/2094822420 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3967+0+0 (secure 0 0 0) 0x7f6bd003f470 con 0x7f6bd8130fb0 2023-09-30T22:24:20.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.193+0000 7f6bd77fe700 1 -- 172.21.15.40:0/2094822420 >> v1:172.21.15.40:6816/118905 conn(0x7f6bc402c1b0 legacy=0x7f6bc402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/118905 2023-09-30T22:24:20.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.193+0000 7f6bddc52700 1 -- 172.21.15.40:0/2094822420 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb80052e0 con 0x7f6bd8130fb0 2023-09-30T22:24:20.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.193+0000 7fcb6dd9b700 1 --2- 172.21.15.40:0/1491805655 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb7009df30 0x7fcb70135400 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcb6400bb90 tx=0x7fcb6400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bbdac0533daf89c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:20.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.194+0000 7fcb6d59a700 1 -- 172.21.15.40:0/1491805655 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6400dc20 con 0x7fcb7009df30 2023-09-30T22:24:20.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.194+0000 7fcb6d59a700 1 -- 172.21.15.40:0/1491805655 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb6400dd80 con 0x7fcb7009df30 2023-09-30T22:24:20.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.194+0000 7fcb6d59a700 1 -- 172.21.15.40:0/1491805655 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb64017630 con 0x7fcb7009df30 2023-09-30T22:24:20.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.197+0000 7fcb74f2e700 1 -- 172.21.15.40:0/1491805655 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb7009df30 msgr2=0x7fcb70135400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.197+0000 7fcb74f2e700 1 --2- 172.21.15.40:0/1491805655 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb7009df30 0x7fcb70135400 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcb6400bb90 tx=0x7fcb6400bea0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.198+0000 7fcb74f2e700 1 -- 172.21.15.40:0/1491805655 shutdown_connections 2023-09-30T22:24:20.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.198+0000 7fcb74f2e700 1 --2- 172.21.15.40:0/1491805655 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb70135940 0x7fcb70137d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.198+0000 7fcb74f2e700 1 --2- 172.21.15.40:0/1491805655 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb7009df30 0x7fcb70135400 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.198+0000 7fcb74f2e700 1 -- 172.21.15.40:0/1491805655 >> 172.21.15.40:0/1491805655 conn(0x7fcb700a2a00 msgr2=0x7fcb700a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:20.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.198+0000 7fcb74f2e700 1 -- 172.21.15.40:0/1491805655 shutdown_connections 2023-09-30T22:24:20.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.198+0000 7f6bbffff700 1 -- 172.21.15.40:0/2094822420 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f6bd0023730 con 0x7f6bd8130fb0 2023-09-30T22:24:20.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.198+0000 7fcb74f2e700 1 -- 172.21.15.40:0/1491805655 wait complete. 2023-09-30T22:24:20.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.199+0000 7fcb74f2e700 1 Processor -- start 2023-09-30T22:24:20.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.201+0000 7fcb74f2e700 1 -- start start 2023-09-30T22:24:20.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.201+0000 7fcb74f2e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb7009d450 0x7fcb7012a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.201+0000 7fcb74f2e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb7009df30 0x7fcb7012a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.201+0000 7fcb74f2e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb70135940 0x7fcb7012aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.201+0000 7fcb74f2e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7012d350 con 0x7fcb70135940 2023-09-30T22:24:20.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.201+0000 7fcb74f2e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7012ba70 con 0x7fcb7009df30 2023-09-30T22:24:20.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.201+0000 7fcb74f2e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7012d630 con 0x7fcb7009d450 2023-09-30T22:24:20.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.202+0000 7fcb6dd9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb7009df30 0x7fcb7012a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.202+0000 7fcb6dd9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb7009df30 0x7fcb7012a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:56682/0 (socket says 172.21.15.40:56682) 2023-09-30T22:24:20.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.202+0000 7fcb6dd9b700 1 -- 172.21.15.40:0/3957903120 learned_addr learned my addr 172.21.15.40:0/3957903120 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:20.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.202+0000 7fcb6dd9b700 1 -- 172.21.15.40:0/3957903120 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb7009d450 msgr2=0x7fcb7012a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.202+0000 7fcb6dd9b700 1 --2- 172.21.15.40:0/3957903120 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb7009d450 0x7fcb7012a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.202+0000 7fcb6dd9b700 1 -- 172.21.15.40:0/3957903120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb70135940 msgr2=0x7fcb7012aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.202+0000 7fcb6dd9b700 1 --2- 172.21.15.40:0/3957903120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb70135940 0x7fcb7012aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.202+0000 7fcb6dd9b700 1 -- 172.21.15.40:0/3957903120 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb6400b7f0 con 0x7fcb7009df30 2023-09-30T22:24:20.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.202+0000 7fcb6dd9b700 1 --2- 172.21.15.40:0/3957903120 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb7009df30 0x7fcb7012a5a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcb64019040 tx=0x7fcb64004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:20.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.202+0000 7fcb5effd700 1 -- 172.21.15.40:0/3957903120 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb64004050 con 0x7fcb7009df30 2023-09-30T22:24:20.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.202+0000 7fcb5effd700 1 -- 172.21.15.40:0/3957903120 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb640041f0 con 0x7fcb7009df30 2023-09-30T22:24:20.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.202+0000 7fcb74f2e700 1 -- 172.21.15.40:0/3957903120 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb700a24a0 con 0x7fcb7009df30 2023-09-30T22:24:20.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.202+0000 7fcb74f2e700 1 -- 172.21.15.40:0/3957903120 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb7012d090 con 0x7fcb7009df30 2023-09-30T22:24:20.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.203+0000 7fcb5effd700 1 -- 172.21.15.40:0/3957903120 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb640045a0 con 0x7fcb7009df30 2023-09-30T22:24:20.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.204+0000 7fcb74f2e700 1 -- 172.21.15.40:0/3957903120 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb70062380 con 0x7fcb7009df30 2023-09-30T22:24:20.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.204+0000 7fcb5effd700 1 -- 172.21.15.40:0/3957903120 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fcb64015070 con 0x7fcb7009df30 2023-09-30T22:24:20.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.204+0000 7fcb5effd700 1 -- 172.21.15.40:0/3957903120 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3967+0+0 (secure 0 0 0) 0x7fcb6403cd30 con 0x7fcb7009df30 2023-09-30T22:24:20.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.204+0000 7fcb6e59c700 1 -- 172.21.15.40:0/3957903120 >> v1:172.21.15.40:6816/118905 conn(0x7fcb5002c1b0 legacy=0x7fcb5002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/118905 2023-09-30T22:24:20.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.212+0000 7fcb5effd700 1 -- 172.21.15.40:0/3957903120 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fcb6401e720 con 0x7fcb7009df30 2023-09-30T22:24:20.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.312+0000 7f0bf659c700 1 -- 172.21.15.40:0/619869712 >> v1:172.21.15.40:6816/118905 conn(0x7f0bd802c1b0 legacy=0x7f0bd802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/118905 2023-09-30T22:24:20.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.329+0000 7fcc72ffd700 1 -- 172.21.15.40:0/3218699624 >> v1:172.21.15.40:6816/118905 conn(0x7fcc6002c1b0 legacy=0x7fcc6002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/118905 2023-09-30T22:24:20.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.365+0000 7fcc79a19700 1 -- 172.21.15.40:0/3218699624 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcc74099780 con 0x7fcc7412cac0 2023-09-30T22:24:20.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.366+0000 7fcc5bfff700 1 -- 172.21.15.40:0/3218699624 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcc6c019300 con 0x7fcc7412cac0 2023-09-30T22:24:20.367 INFO:teuthology.orchestra.run.smithi040.stdout:38654705694 2023-09-30T22:24:20.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.368+0000 7fcc79a19700 1 -- 172.21.15.40:0/3218699624 >> v1:172.21.15.40:6816/118905 conn(0x7fcc6002c1b0 legacy=0x7fcc6002e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:20.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.368+0000 7fcc79a19700 1 -- 172.21.15.40:0/3218699624 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc7412cac0 msgr2=0x7fcc7412fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.368+0000 7fcc79a19700 1 --2- 172.21.15.40:0/3218699624 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc7412cac0 0x7fcc7412fcb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c00cc50 tx=0x7fcc6c00cf60 comp rx=0 tx=0).stop 2023-09-30T22:24:20.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.368+0000 7fcc79a19700 1 -- 172.21.15.40:0/3218699624 shutdown_connections 2023-09-30T22:24:20.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.368+0000 7fcc79a19700 1 --2- 172.21.15.40:0/3218699624 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc7412cac0 0x7fcc7412fcb0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.368+0000 7fcc79a19700 1 --2- 172.21.15.40:0/3218699624 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc74099a50 0x7fcc7412f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.368+0000 7fcc79a19700 1 --2- 172.21.15.40:0/3218699624 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc7412c3a0 0x7fcc7412f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.368+0000 7fcc79a19700 1 -- 172.21.15.40:0/3218699624 >> 172.21.15.40:0/3218699624 conn(0x7fcc740a2c70 msgr2=0x7fcc7409ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:20.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.368+0000 7fcc79a19700 1 -- 172.21.15.40:0/3218699624 shutdown_connections 2023-09-30T22:24:20.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.368+0000 7fcc79a19700 1 -- 172.21.15.40:0/3218699624 wait complete. 2023-09-30T22:24:20.382 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705694 for osd.2 2023-09-30T22:24:20.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.381+0000 7f6bddc52700 1 -- 172.21.15.40:0/2094822420 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6bb8005590 con 0x7f6bd8130fb0 2023-09-30T22:24:20.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.381+0000 7f6bbffff700 1 -- 172.21.15.40:0/2094822420 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6bd00243c0 con 0x7f6bd8130fb0 2023-09-30T22:24:20.382 INFO:teuthology.orchestra.run.smithi040.stdout:38654705694 2023-09-30T22:24:20.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.383+0000 7f6bddc52700 1 -- 172.21.15.40:0/2094822420 >> v1:172.21.15.40:6816/118905 conn(0x7f6bc402c1b0 legacy=0x7f6bc402e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:20.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.383+0000 7f6bddc52700 1 -- 172.21.15.40:0/2094822420 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6bd8130fb0 msgr2=0x7f6bd81c0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.383+0000 7f6bddc52700 1 --2- 172.21.15.40:0/2094822420 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6bd8130fb0 0x7f6bd81c0870 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0009fd0 tx=0x7f6bd0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.383+0000 7f6bddc52700 1 -- 172.21.15.40:0/2094822420 shutdown_connections 2023-09-30T22:24:20.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.383+0000 7f6bddc52700 1 --2- 172.21.15.40:0/2094822420 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6bd8130fb0 0x7f6bd81c0870 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.383+0000 7f6bddc52700 1 --2- 172.21.15.40:0/2094822420 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bd809d920 0x7f6bd81c42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.383+0000 7f6bddc52700 1 --2- 172.21.15.40:0/2094822420 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6bd809e230 0x7f6bd81c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.383+0000 7f6bddc52700 1 -- 172.21.15.40:0/2094822420 >> 172.21.15.40:0/2094822420 conn(0x7f6bd809fb20 msgr2=0x7f6bd812dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:20.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.384+0000 7f6bddc52700 1 -- 172.21.15.40:0/2094822420 shutdown_connections 2023-09-30T22:24:20.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.384+0000 7f6bddc52700 1 -- 172.21.15.40:0/2094822420 wait complete. 2023-09-30T22:24:20.396 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705694 for osd.1 2023-09-30T22:24:20.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.405+0000 7fcb6e59c700 1 -- 172.21.15.40:0/3957903120 >> v1:172.21.15.40:6816/118905 conn(0x7fcb5002c1b0 legacy=0x7fcb5002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/118905 2023-09-30T22:24:20.447 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:20.446+0000 7ff0e5d3a240 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-30T22:24:20.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.454+0000 7f0bfc920700 1 -- 172.21.15.40:0/619869712 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0bf8062380 con 0x7f0bf813da50 2023-09-30T22:24:20.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.455+0000 7f0be6ffd700 1 -- 172.21.15.40:0/619869712 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0bf0018020 con 0x7f0bf813da50 2023-09-30T22:24:20.455 INFO:teuthology.orchestra.run.smithi040.stdout:38654705694 2023-09-30T22:24:20.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.457+0000 7f0bfc920700 1 -- 172.21.15.40:0/619869712 >> v1:172.21.15.40:6816/118905 conn(0x7f0bd802c1b0 legacy=0x7f0bd802e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:20.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.457+0000 7f0bfc920700 1 -- 172.21.15.40:0/619869712 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0bf813da50 msgr2=0x7f0bf806db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.457+0000 7f0bfc920700 1 --2- 172.21.15.40:0/619869712 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0bf813da50 0x7f0bf806db50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000efc0 tx=0x7f0bf000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.457+0000 7f0bfc920700 1 -- 172.21.15.40:0/619869712 shutdown_connections 2023-09-30T22:24:20.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.457+0000 7f0bfc920700 1 --2- 172.21.15.40:0/619869712 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0bf813da50 0x7f0bf806db50 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.457+0000 7f0bfc920700 1 --2- 172.21.15.40:0/619869712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0bf8138250 0x7f0bf8135440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.457+0000 7f0bfc920700 1 --2- 172.21.15.40:0/619869712 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0bf813b130 0x7f0bf806d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.457+0000 7f0bfc920700 1 -- 172.21.15.40:0/619869712 >> 172.21.15.40:0/619869712 conn(0x7f0bf80a2a00 msgr2=0x7f0bf813cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:20.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.457+0000 7f0bfc920700 1 -- 172.21.15.40:0/619869712 shutdown_connections 2023-09-30T22:24:20.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.457+0000 7f0bfc920700 1 -- 172.21.15.40:0/619869712 wait complete. 2023-09-30T22:24:20.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705694 for osd.0 2023-09-30T22:24:20.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.512+0000 7fcb74f2e700 1 -- 172.21.15.40:0/3957903120 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcb70062380 con 0x7fcb7009df30 2023-09-30T22:24:20.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.513+0000 7fcb5effd700 1 -- 172.21.15.40:0/3957903120 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcb6401e360 con 0x7fcb7009df30 2023-09-30T22:24:20.513 INFO:teuthology.orchestra.run.smithi040.stdout:38654705694 2023-09-30T22:24:20.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.515+0000 7fcb74f2e700 1 -- 172.21.15.40:0/3957903120 >> v1:172.21.15.40:6816/118905 conn(0x7fcb5002c1b0 legacy=0x7fcb5002e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:20.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.515+0000 7fcb74f2e700 1 -- 172.21.15.40:0/3957903120 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb7009df30 msgr2=0x7fcb7012a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.515+0000 7fcb74f2e700 1 --2- 172.21.15.40:0/3957903120 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb7009df30 0x7fcb7012a5a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcb64019040 tx=0x7fcb64004750 comp rx=0 tx=0).stop 2023-09-30T22:24:20.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.516+0000 7fcb74f2e700 1 -- 172.21.15.40:0/3957903120 shutdown_connections 2023-09-30T22:24:20.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.516+0000 7fcb74f2e700 1 --2- 172.21.15.40:0/3957903120 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb7009d450 0x7fcb7012a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.516+0000 7fcb74f2e700 1 --2- 172.21.15.40:0/3957903120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb70135940 0x7fcb7012aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.516+0000 7fcb74f2e700 1 --2- 172.21.15.40:0/3957903120 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb7009df30 0x7fcb7012a5a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.516+0000 7fcb74f2e700 1 -- 172.21.15.40:0/3957903120 >> 172.21.15.40:0/3957903120 conn(0x7fcb700a2a00 msgr2=0x7fcb70130940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:20.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.516+0000 7fcb74f2e700 1 -- 172.21.15.40:0/3957903120 shutdown_connections 2023-09-30T22:24:20.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:20.516+0000 7fcb74f2e700 1 -- 172.21.15.40:0/3957903120 wait complete. 2023-09-30T22:24:20.532 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705694 for osd.3 2023-09-30T22:24:20.601 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:20.601+0000 7ff0e5d3a240 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-30T22:24:20.678 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:20.677+0000 7ff0e5d3a240 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-30T22:24:20.822 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:20.821+0000 7ff0e5d3a240 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-30T22:24:20.895 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:20.894+0000 7ff0e5d3a240 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-30T22:24:21.060 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:21.060+0000 7ff0e5d3a240 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-30T22:24:21.143 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:21.142+0000 7ff0e5d3a240 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-30T22:24:21.224 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:21.224+0000 7ff0e5d3a240 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-30T22:24:21.321 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:21.320+0000 7ff0e5d3a240 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-30T22:24:21.382 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:21.397 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:21.471 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:21.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.518+0000 7f6c56305700 1 Processor -- start 2023-09-30T22:24:21.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.518+0000 7f6c56305700 1 -- start start 2023-09-30T22:24:21.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.518+0000 7f6c56305700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c5009e400 0x7f6c50135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.518+0000 7f6c56305700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c50136230 0x7f6c50138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.518+0000 7f6c56305700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c5009adf0 con 0x7f6c5009d920 2023-09-30T22:24:21.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.518+0000 7f6c56305700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5009e7f0 con 0x7f6c50136230 2023-09-30T22:24:21.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.518+0000 7f6c56305700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5009edf0 con 0x7f6c5009e400 2023-09-30T22:24:21.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.519+0000 7f6c4ffff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6c5009d920 0x7f6c5009dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50130/0 (socket says 172.21.15.40:50130) 2023-09-30T22:24:21.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.519+0000 7f6c4ffff700 1 -- 172.21.15.40:0/2166708206 learned_addr learned my addr 172.21.15.40:0/2166708206 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:24:21.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.519+0000 7f6c548a2700 1 --2- 172.21.15.40:0/2166708206 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c50136230 0x7f6c50138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.519+0000 7f6c4f7fe700 1 --2- 172.21.15.40:0/2166708206 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c5009e400 0x7f6c50135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.519+0000 7f6c548a2700 1 -- 172.21.15.40:0/2166708206 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c5009e400 msgr2=0x7f6c50135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:21.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.519+0000 7f6c548a2700 1 --2- 172.21.15.40:0/2166708206 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c5009e400 0x7f6c50135cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.519+0000 7f6c548a2700 1 -- 172.21.15.40:0/2166708206 >> v1:172.21.15.40:6789/0 conn(0x7f6c5009d920 legacy=0x7f6c5009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.519+0000 7f6c4effd700 1 -- 172.21.15.40:0/2166708206 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3208528645 0 0) 0x7f6c5009adf0 con 0x7f6c5009d920 2023-09-30T22:24:21.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.519+0000 7f6c548a2700 1 -- 172.21.15.40:0/2166708206 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c5009b660 con 0x7f6c50136230 2023-09-30T22:24:21.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.519+0000 7f6c548a2700 1 --2- 172.21.15.40:0/2166708206 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c50136230 0x7f6c50138610 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6c4800d050 tx=0x7f6c4800d360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bab56fe750b89c20 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:21.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.520+0000 7f6c4effd700 1 -- 172.21.15.40:0/2166708206 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4800d960 con 0x7f6c50136230 2023-09-30T22:24:21.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.520+0000 7f6c4effd700 1 -- 172.21.15.40:0/2166708206 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4800dac0 con 0x7f6c50136230 2023-09-30T22:24:21.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.520+0000 7f6c4effd700 1 -- 172.21.15.40:0/2166708206 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4800de70 con 0x7f6c50136230 2023-09-30T22:24:21.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.520+0000 7f6c56305700 1 -- 172.21.15.40:0/2166708206 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c50136230 msgr2=0x7f6c50138610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.520+0000 7f6c56305700 1 --2- 172.21.15.40:0/2166708206 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c50136230 0x7f6c50138610 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6c4800d050 tx=0x7f6c4800d360 comp rx=0 tx=0).stop 2023-09-30T22:24:21.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.520+0000 7f6c56305700 1 -- 172.21.15.40:0/2166708206 shutdown_connections 2023-09-30T22:24:21.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.520+0000 7f6c56305700 1 --2- 172.21.15.40:0/2166708206 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c50136230 0x7f6c50138610 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.520+0000 7f6c56305700 1 --2- 172.21.15.40:0/2166708206 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c5009e400 0x7f6c50135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.520+0000 7f6c56305700 1 -- 172.21.15.40:0/2166708206 >> 172.21.15.40:0/2166708206 conn(0x7f6c5009fb20 msgr2=0x7f6c5009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:21.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.520+0000 7f6c56305700 1 -- 172.21.15.40:0/2166708206 shutdown_connections 2023-09-30T22:24:21.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.520+0000 7f6c56305700 1 -- 172.21.15.40:0/2166708206 wait complete. 2023-09-30T22:24:21.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.522+0000 7f6c56305700 1 Processor -- start 2023-09-30T22:24:21.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.522+0000 7f6c56305700 1 -- start start 2023-09-30T22:24:21.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.522+0000 7f6c56305700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c5009d920 0x7f6c5011e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.522+0000 7f6c56305700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c5009e400 0x7f6c5011eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.523+0000 7f6c56305700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c50136230 0x7f6c5011f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.523+0000 7f6c56305700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5009cb70 con 0x7f6c50136230 2023-09-30T22:24:21.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.523+0000 7f6c56305700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c500a3c40 con 0x7f6c5009e400 2023-09-30T22:24:21.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.523+0000 7f6c56305700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c501206e0 con 0x7f6c5009d920 2023-09-30T22:24:21.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.523+0000 7f6c4ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c5009d920 0x7f6c5011e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.523+0000 7f6c4ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c5009d920 0x7f6c5011e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:50546/0 (socket says 172.21.15.40:50546) 2023-09-30T22:24:21.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.523+0000 7f6c4ffff700 1 -- 172.21.15.40:0/3772517730 learned_addr learned my addr 172.21.15.40:0/3772517730 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:21.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.523+0000 7f6c4f7fe700 1 --2- 172.21.15.40:0/3772517730 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c5009e400 0x7f6c5011eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.523+0000 7f6c548a2700 1 --2- 172.21.15.40:0/3772517730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c50136230 0x7f6c5011f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.523+0000 7f6c4ffff700 1 -- 172.21.15.40:0/3772517730 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c5009e400 msgr2=0x7f6c5011eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.523+0000 7f6c4ffff700 1 --2- 172.21.15.40:0/3772517730 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c5009e400 0x7f6c5011eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.523+0000 7f6c4ffff700 1 -- 172.21.15.40:0/3772517730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c50136230 msgr2=0x7f6c5011f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.523+0000 7f6c4ffff700 1 --2- 172.21.15.40:0/3772517730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c50136230 0x7f6c5011f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.523+0000 7f6c4ffff700 1 -- 172.21.15.40:0/3772517730 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4800bc80 con 0x7f6c5009d920 2023-09-30T22:24:21.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.523+0000 7f6c4ffff700 1 --2- 172.21.15.40:0/3772517730 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c5009d920 0x7f6c5011e580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6c4000c6d0 tx=0x7f6c4000c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:21.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.524+0000 7f6c4cff9700 1 -- 172.21.15.40:0/3772517730 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c400074e0 con 0x7f6c5009d920 2023-09-30T22:24:21.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.524+0000 7f6c4cff9700 1 -- 172.21.15.40:0/3772517730 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c40007640 con 0x7f6c5009d920 2023-09-30T22:24:21.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.524+0000 7f6c56305700 1 -- 172.21.15.40:0/3772517730 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c50121a70 con 0x7f6c5009d920 2023-09-30T22:24:21.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.524+0000 7f6c4cff9700 1 -- 172.21.15.40:0/3772517730 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c40005a70 con 0x7f6c5009d920 2023-09-30T22:24:21.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.524+0000 7f6c56305700 1 -- 172.21.15.40:0/3772517730 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c501208f0 con 0x7f6c5009d920 2023-09-30T22:24:21.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.525+0000 7f6c4cff9700 1 -- 172.21.15.40:0/3772517730 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f6c40005bd0 con 0x7f6c5009d920 2023-09-30T22:24:21.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.525+0000 7f6c56305700 1 -- 172.21.15.40:0/3772517730 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c5009a660 con 0x7f6c5009d920 2023-09-30T22:24:21.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.525+0000 7f6c4f7fe700 1 -- 172.21.15.40:0/3772517730 >> v1:172.21.15.40:6816/118905 conn(0x7f6c3c02c1b0 legacy=0x7f6c3c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/118905 2023-09-30T22:24:21.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.525+0000 7f6c4cff9700 1 -- 172.21.15.40:0/3772517730 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3967+0+0 (secure 0 0 0) 0x7f6c4003ada0 con 0x7f6c5009d920 2023-09-30T22:24:21.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.530+0000 7f6c4cff9700 1 -- 172.21.15.40:0/3772517730 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f6c40018260 con 0x7f6c5009d920 2023-09-30T22:24:21.533 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:21.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.573+0000 7f9ac5a13700 1 Processor -- start 2023-09-30T22:24:21.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.573+0000 7f9ac5a13700 1 -- start start 2023-09-30T22:24:21.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.574+0000 7f9ac5a13700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ac009d450 0x7f9ac009d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.574+0000 7f9ac5a13700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9ac01308d0 0x7f9ac0138420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.574+0000 7f9ac5a13700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac009e8b0 con 0x7f9ac009dd60 2023-09-30T22:24:21.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.574+0000 7f9ac5a13700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac009c3b0 con 0x7f9ac009d450 2023-09-30T22:24:21.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.574+0000 7f9ac5a13700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac009a6b0 con 0x7f9ac01308d0 2023-09-30T22:24:21.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.574+0000 7f9abeffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ac009d450 0x7f9ac009d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.574+0000 7f9abeffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ac009d450 0x7f9ac009d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:56702/0 (socket says 172.21.15.40:56702) 2023-09-30T22:24:21.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.574+0000 7f9abeffd700 1 -- 172.21.15.40:0/1964670977 learned_addr learned my addr 172.21.15.40:0/1964670977 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:21.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.574+0000 7f9abeffd700 1 -- 172.21.15.40:0/1964670977 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9ac01308d0 msgr2=0x7f9ac0138420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:21.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.574+0000 7f9abeffd700 1 --2- 172.21.15.40:0/1964670977 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9ac01308d0 0x7f9ac0138420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.574+0000 7f9abeffd700 1 -- 172.21.15.40:0/1964670977 >> v1:172.21.15.40:6789/0 conn(0x7f9ac009dd60 legacy=0x7f9ac01301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:21.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.574+0000 7f9abeffd700 1 -- 172.21.15.40:0/1964670977 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac009b4f0 con 0x7f9ac009d450 2023-09-30T22:24:21.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.575+0000 7f9abeffd700 1 --2- 172.21.15.40:0/1964670977 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ac009d450 0x7f9ac009d820 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0009920 tx=0x7f9ab0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e51db0a66c073c2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:21.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.575+0000 7f9abe7fc700 1 -- 172.21.15.40:0/1964670977 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0004230 con 0x7f9ac009d450 2023-09-30T22:24:21.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.575+0000 7f9abe7fc700 1 -- 172.21.15.40:0/1964670977 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab0004390 con 0x7f9ac009d450 2023-09-30T22:24:21.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.575+0000 7f9abe7fc700 1 -- 172.21.15.40:0/1964670977 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0009e70 con 0x7f9ac009d450 2023-09-30T22:24:21.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.576+0000 7f9ac5a13700 1 -- 172.21.15.40:0/1964670977 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ac009d450 msgr2=0x7f9ac009d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.576+0000 7f9ac5a13700 1 --2- 172.21.15.40:0/1964670977 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ac009d450 0x7f9ac009d820 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0009920 tx=0x7f9ab0009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:21.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.576+0000 7f9ac5a13700 1 -- 172.21.15.40:0/1964670977 shutdown_connections 2023-09-30T22:24:21.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.576+0000 7f9ac5a13700 1 --2- 172.21.15.40:0/1964670977 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9ac01308d0 0x7f9ac0138420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.576+0000 7f9ac5a13700 1 --2- 172.21.15.40:0/1964670977 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ac009d450 0x7f9ac009d820 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.576+0000 7f9ac5a13700 1 -- 172.21.15.40:0/1964670977 >> 172.21.15.40:0/1964670977 conn(0x7f9ac00a2a00 msgr2=0x7f9ac00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:21.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.576+0000 7f9ac5a13700 1 -- 172.21.15.40:0/1964670977 shutdown_connections 2023-09-30T22:24:21.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.576+0000 7f9ac5a13700 1 -- 172.21.15.40:0/1964670977 wait complete. 2023-09-30T22:24:21.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.577+0000 7f9ac5a13700 1 Processor -- start 2023-09-30T22:24:21.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.578+0000 7f9ac5a13700 1 -- start start 2023-09-30T22:24:21.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.578+0000 7f9ac5a13700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9ac009d450 0x7f9ac011bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.578+0000 7f9ac5a13700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ac009dd60 0x7f9ac011c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.578+0000 7f9ac5a13700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ac01308d0 0x7f9ac01c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.578+0000 7f9ac5a13700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac011d8d0 con 0x7f9ac01308d0 2023-09-30T22:24:21.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.578+0000 7f9ac5a13700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac011b9f0 con 0x7f9ac009dd60 2023-09-30T22:24:21.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.578+0000 7f9ac5a13700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac012fea0 con 0x7f9ac009d450 2023-09-30T22:24:21.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.578+0000 7f9ab7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ac009dd60 0x7f9ac011c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.578+0000 7f9ab7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ac009dd60 0x7f9ac011c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:56708/0 (socket says 172.21.15.40:56708) 2023-09-30T22:24:21.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.578+0000 7f9ab7fff700 1 -- 172.21.15.40:0/2254178760 learned_addr learned my addr 172.21.15.40:0/2254178760 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:21.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.579+0000 7f9abf7fe700 1 --2- 172.21.15.40:0/2254178760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ac01308d0 0x7f9ac01c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.579+0000 7f9ab7fff700 1 -- 172.21.15.40:0/2254178760 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9ac009d450 msgr2=0x7f9ac011bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.579+0000 7f9ab7fff700 1 --2- 172.21.15.40:0/2254178760 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9ac009d450 0x7f9ac011bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.579+0000 7f9ab7fff700 1 -- 172.21.15.40:0/2254178760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ac01308d0 msgr2=0x7f9ac01c43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.579+0000 7f9ab7fff700 1 --2- 172.21.15.40:0/2254178760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ac01308d0 0x7f9ac01c43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.579+0000 7f9ab7fff700 1 -- 172.21.15.40:0/2254178760 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab0009550 con 0x7f9ac009dd60 2023-09-30T22:24:21.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.579+0000 7f9ab7fff700 1 --2- 172.21.15.40:0/2254178760 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ac009dd60 0x7f9ac011c410 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9aa800c4a0 tx=0x7f9aa800c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:21.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.579+0000 7f9abcff9700 1 -- 172.21.15.40:0/2254178760 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa80054e0 con 0x7f9ac009dd60 2023-09-30T22:24:21.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.579+0000 7f9abcff9700 1 -- 172.21.15.40:0/2254178760 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa8003680 con 0x7f9ac009dd60 2023-09-30T22:24:21.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.579+0000 7f9abcff9700 1 -- 172.21.15.40:0/2254178760 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa8003a10 con 0x7f9ac009dd60 2023-09-30T22:24:21.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.580+0000 7f9ac5a13700 1 -- 172.21.15.40:0/2254178760 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac009c5d0 con 0x7f9ac009dd60 2023-09-30T22:24:21.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.580+0000 7f9ac5a13700 1 -- 172.21.15.40:0/2254178760 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac011ec30 con 0x7f9ac009dd60 2023-09-30T22:24:21.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.582+0000 7f9ac5a13700 1 -- 172.21.15.40:0/2254178760 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac0130150 con 0x7f9ac009dd60 2023-09-30T22:24:21.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.582+0000 7f9abcff9700 1 -- 172.21.15.40:0/2254178760 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f9aa8003b70 con 0x7f9ac009dd60 2023-09-30T22:24:21.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.582+0000 7f9abcff9700 1 -- 172.21.15.40:0/2254178760 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3967+0+0 (secure 0 0 0) 0x7f9aa803adb0 con 0x7f9ac009dd60 2023-09-30T22:24:21.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.582+0000 7f9abeffd700 1 -- 172.21.15.40:0/2254178760 >> v1:172.21.15.40:6816/118905 conn(0x7f9aa002c1b0 legacy=0x7f9aa002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/118905 2023-09-30T22:24:21.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.589+0000 7f9abcff9700 1 -- 172.21.15.40:0/2254178760 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f9aa8011be0 con 0x7f9ac009dd60 2023-09-30T22:24:21.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.622+0000 7f40e38a1700 1 Processor -- start 2023-09-30T22:24:21.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.622+0000 7f40e38a1700 1 -- start start 2023-09-30T22:24:21.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.623+0000 7f40e38a1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f40dc09d920 0x7f40dc09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.623+0000 7f40e38a1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40dc09f0f0 0x7f40dc09e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.623+0000 7f40e38a1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40dc09f940 con 0x7f40dc133ca0 2023-09-30T22:24:21.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.623+0000 7f40e38a1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40dc06b4c0 con 0x7f40dc09d920 2023-09-30T22:24:21.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.623+0000 7f40e38a1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc09a8f0 con 0x7f40dc09f0f0 2023-09-30T22:24:21.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.623+0000 7f40e163d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f40dc09d920 0x7f40dc09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.623+0000 7f40e1e3e700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f40dc133ca0 0x7f40dc134120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50150/0 (socket says 172.21.15.40:50150) 2023-09-30T22:24:21.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.623+0000 7f40e1e3e700 1 -- 172.21.15.40:0/4201829313 learned_addr learned my addr 172.21.15.40:0/4201829313 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:24:21.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.623+0000 7f40e0e3c700 1 --2- 172.21.15.40:0/4201829313 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40dc09f0f0 0x7f40dc09e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.624+0000 7f40e163d700 1 -- 172.21.15.40:0/4201829313 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40dc09f0f0 msgr2=0x7f40dc09e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:21.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.624+0000 7f40d3fff700 1 -- 172.21.15.40:0/4201829313 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1635050959 0 0) 0x7f40dc09f940 con 0x7f40dc133ca0 2023-09-30T22:24:21.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.624+0000 7f40e163d700 1 --2- 172.21.15.40:0/4201829313 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40dc09f0f0 0x7f40dc09e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.624+0000 7f40e163d700 1 -- 172.21.15.40:0/4201829313 >> v1:172.21.15.40:6789/0 conn(0x7f40dc133ca0 legacy=0x7f40dc134120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.624+0000 7f40e163d700 1 -- 172.21.15.40:0/4201829313 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40dc09f6e0 con 0x7f40dc09d920 2023-09-30T22:24:21.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.624+0000 7f40e0e3c700 1 --2- 172.21.15.40:0/4201829313 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40dc09f0f0 0x7f40dc09e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:21.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.624+0000 7f40e163d700 1 --2- 172.21.15.40:0/4201829313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40dc09d920 0x7f40dc09dcf0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f40d8009850 tx=0x7f40d8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b21ece4d407c0ecd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:21.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.624+0000 7f40d3fff700 1 -- 172.21.15.40:0/4201829313 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d8005e30 con 0x7f40dc09d920 2023-09-30T22:24:21.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.624+0000 7f40d3fff700 1 -- 172.21.15.40:0/4201829313 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d8006030 con 0x7f40dc09d920 2023-09-30T22:24:21.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.624+0000 7f40d3fff700 1 -- 172.21.15.40:0/4201829313 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d80063c0 con 0x7f40dc09d920 2023-09-30T22:24:21.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.625+0000 7f40e38a1700 1 -- 172.21.15.40:0/4201829313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40dc09d920 msgr2=0x7f40dc09dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.625+0000 7f40e38a1700 1 --2- 172.21.15.40:0/4201829313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40dc09d920 0x7f40dc09dcf0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f40d8009850 tx=0x7f40d8009b60 comp rx=0 tx=0).stop 2023-09-30T22:24:21.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.625+0000 7f40e38a1700 1 -- 172.21.15.40:0/4201829313 shutdown_connections 2023-09-30T22:24:21.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.625+0000 7f40e38a1700 1 --2- 172.21.15.40:0/4201829313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40dc09d920 0x7f40dc09dcf0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.625+0000 7f40e38a1700 1 --2- 172.21.15.40:0/4201829313 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40dc09f0f0 0x7f40dc09e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.625+0000 7f40e38a1700 1 -- 172.21.15.40:0/4201829313 >> 172.21.15.40:0/4201829313 conn(0x7f40dc09fb20 msgr2=0x7f40dc09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:21.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.625+0000 7f40e38a1700 1 -- 172.21.15.40:0/4201829313 shutdown_connections 2023-09-30T22:24:21.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.625+0000 7f40e38a1700 1 -- 172.21.15.40:0/4201829313 wait complete. 2023-09-30T22:24:21.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.626+0000 7f40e38a1700 1 Processor -- start 2023-09-30T22:24:21.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.627+0000 7f40e38a1700 1 -- start start 2023-09-30T22:24:21.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.627+0000 7f40e38a1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f40dc09d920 0x7f40dc1cce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.627+0000 7f40e38a1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40dc133ca0 0x7f40dc1cd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.627+0000 7f40e0e3c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40dc133ca0 0x7f40dc1cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.627+0000 7f40e0e3c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40dc133ca0 0x7f40dc1cd360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60616/0 (socket says 172.21.15.40:60616) 2023-09-30T22:24:21.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.627+0000 7f40e38a1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40dc119730 0x7f40dc119ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.628+0000 7f40e38a1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc09c9e0 con 0x7f40dc133ca0 2023-09-30T22:24:21.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.628+0000 7f40e38a1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc11b430 con 0x7f40dc119730 2023-09-30T22:24:21.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.628+0000 7f40e38a1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc0a2460 con 0x7f40dc09d920 2023-09-30T22:24:21.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.628+0000 7f40e0e3c700 1 -- 172.21.15.40:0/1124895500 learned_addr learned my addr 172.21.15.40:0/1124895500 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:21.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.628+0000 7f40e163d700 1 --2- 172.21.15.40:0/1124895500 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f40dc09d920 0x7f40dc1cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.628+0000 7f40e1e3e700 1 --2- 172.21.15.40:0/1124895500 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40dc119730 0x7f40dc119ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.628+0000 7f40e1e3e700 1 -- 172.21.15.40:0/1124895500 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f40dc09d920 msgr2=0x7f40dc1cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.628+0000 7f40e1e3e700 1 --2- 172.21.15.40:0/1124895500 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f40dc09d920 0x7f40dc1cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.628+0000 7f40e1e3e700 1 -- 172.21.15.40:0/1124895500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40dc133ca0 msgr2=0x7f40dc1cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.628+0000 7f40e1e3e700 1 --2- 172.21.15.40:0/1124895500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40dc133ca0 0x7f40dc1cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.628+0000 7f40e1e3e700 1 -- 172.21.15.40:0/1124895500 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40cc0094a0 con 0x7f40dc119730 2023-09-30T22:24:21.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.628+0000 7f40e0e3c700 1 --2- 172.21.15.40:0/1124895500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40dc133ca0 0x7f40dc1cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:21.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.628+0000 7f40e163d700 1 --2- 172.21.15.40:0/1124895500 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f40dc09d920 0x7f40dc1cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:21.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.628+0000 7f40e1e3e700 1 --2- 172.21.15.40:0/1124895500 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40dc119730 0x7f40dc119ba0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f40d400cbe0 tx=0x7f40d400cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:21.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.629+0000 7f40d1ffb700 1 -- 172.21.15.40:0/1124895500 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d400aaa0 con 0x7f40dc119730 2023-09-30T22:24:21.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.629+0000 7f40d1ffb700 1 -- 172.21.15.40:0/1124895500 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d400ac00 con 0x7f40dc119730 2023-09-30T22:24:21.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.629+0000 7f40d1ffb700 1 -- 172.21.15.40:0/1124895500 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d40070d0 con 0x7f40dc119730 2023-09-30T22:24:21.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.629+0000 7f40e38a1700 1 -- 172.21.15.40:0/1124895500 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d8009430 con 0x7f40dc119730 2023-09-30T22:24:21.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.630+0000 7f40e38a1700 1 -- 172.21.15.40:0/1124895500 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40dc11d230 con 0x7f40dc119730 2023-09-30T22:24:21.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.630+0000 7f40d1ffb700 1 -- 172.21.15.40:0/1124895500 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f40d4007230 con 0x7f40dc119730 2023-09-30T22:24:21.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.631+0000 7f40d1ffb700 1 -- 172.21.15.40:0/1124895500 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3967+0+0 (secure 0 0 0) 0x7f40d403b200 con 0x7f40dc119730 2023-09-30T22:24:21.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.631+0000 7f40e163d700 1 -- 172.21.15.40:0/1124895500 >> v1:172.21.15.40:6816/118905 conn(0x7f40c002c1b0 legacy=0x7f40c002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/118905 2023-09-30T22:24:21.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.631+0000 7f40e38a1700 1 -- 172.21.15.40:0/1124895500 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40dc0a3de0 con 0x7f40dc119730 2023-09-30T22:24:21.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.635+0000 7f40d1ffb700 1 -- 172.21.15.40:0/1124895500 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f40d4018080 con 0x7f40dc119730 2023-09-30T22:24:21.704 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:21.704+0000 7ff0e5d3a240 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-30T22:24:21.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.726+0000 7f6c4f7fe700 1 -- 172.21.15.40:0/3772517730 >> v1:172.21.15.40:6816/118905 conn(0x7f6c3c02c1b0 legacy=0x7f6c3c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/118905 2023-09-30T22:24:21.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.741+0000 7f2dbc230700 1 Processor -- start 2023-09-30T22:24:21.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.741+0000 7f2dbc230700 1 -- start start 2023-09-30T22:24:21.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.742+0000 7f2dbc230700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2db409f0f0 0x7f2db4138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.742+0000 7f2dbc230700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2db409e400 0x7f2db413b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.742+0000 7f2dbc230700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db409f940 con 0x7f2db409d920 2023-09-30T22:24:21.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.742+0000 7f2dbc230700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db406b4c0 con 0x7f2db409e400 2023-09-30T22:24:21.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.742+0000 7f2dbc230700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db409a8f0 con 0x7f2db409f0f0 2023-09-30T22:24:21.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.742+0000 7f2db97cb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2db409f0f0 0x7f2db4138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.742+0000 7f2db97cb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2db409f0f0 0x7f2db4138ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:56726/0 (socket says 172.21.15.40:56726) 2023-09-30T22:24:21.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.742+0000 7f2db97cb700 1 -- 172.21.15.40:0/569958084 learned_addr learned my addr 172.21.15.40:0/569958084 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:21.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.743+0000 7f2dba7cd700 1 --2- 172.21.15.40:0/569958084 >> v2:172.21.15.40:3300/0 conn(0x7f2db409e400 0x7f2db413b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.743+0000 7f2db97cb700 1 -- 172.21.15.40:0/569958084 >> v2:172.21.15.40:3300/0 conn(0x7f2db409e400 msgr2=0x7f2db413b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:21.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.743+0000 7f2db97cb700 1 --2- 172.21.15.40:0/569958084 >> v2:172.21.15.40:3300/0 conn(0x7f2db409e400 0x7f2db413b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.743+0000 7f2db97cb700 1 -- 172.21.15.40:0/569958084 >> v1:172.21.15.40:6789/0 conn(0x7f2db409d920 legacy=0x7f2db409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.743+0000 7f2db97cb700 1 -- 172.21.15.40:0/569958084 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db409f6e0 con 0x7f2db409f0f0 2023-09-30T22:24:21.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.743+0000 7f2dba7cd700 1 --2- 172.21.15.40:0/569958084 >> v2:172.21.15.40:3300/0 conn(0x7f2db409e400 0x7f2db413b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:21.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.743+0000 7f2db97cb700 1 --2- 172.21.15.40:0/569958084 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2db409f0f0 0x7f2db4138ee0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2da40098f0 tx=0x7f2da4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=993c03c6014d277 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:21.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.744+0000 7f2db8fca700 1 -- 172.21.15.40:0/569958084 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da4011830 con 0x7f2db409f0f0 2023-09-30T22:24:21.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.744+0000 7f2db8fca700 1 -- 172.21.15.40:0/569958084 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da4011990 con 0x7f2db409f0f0 2023-09-30T22:24:21.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.744+0000 7f2db8fca700 1 -- 172.21.15.40:0/569958084 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da4011d20 con 0x7f2db409f0f0 2023-09-30T22:24:21.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.745+0000 7f2dbc230700 1 -- 172.21.15.40:0/569958084 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2db409f0f0 msgr2=0x7f2db4138ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.745+0000 7f2dbc230700 1 --2- 172.21.15.40:0/569958084 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2db409f0f0 0x7f2db4138ee0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2da40098f0 tx=0x7f2da4009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:21.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.745+0000 7f2dbc230700 1 -- 172.21.15.40:0/569958084 shutdown_connections 2023-09-30T22:24:21.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.745+0000 7f2dbc230700 1 --2- 172.21.15.40:0/569958084 >> v2:172.21.15.40:3300/0 conn(0x7f2db409e400 0x7f2db413b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.745+0000 7f2dbc230700 1 --2- 172.21.15.40:0/569958084 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2db409f0f0 0x7f2db4138ee0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.745+0000 7f2dbc230700 1 -- 172.21.15.40:0/569958084 >> 172.21.15.40:0/569958084 conn(0x7f2db409fb20 msgr2=0x7f2db409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:21.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.745+0000 7f2dbc230700 1 -- 172.21.15.40:0/569958084 shutdown_connections 2023-09-30T22:24:21.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.745+0000 7f2dbc230700 1 -- 172.21.15.40:0/569958084 wait complete. 2023-09-30T22:24:21.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.746+0000 7f2dbc230700 1 Processor -- start 2023-09-30T22:24:21.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.746+0000 7f2dbc230700 1 -- start start 2023-09-30T22:24:21.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.747+0000 7f2dbc230700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2db409d920 0x7f2db411ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.747+0000 7f2dbc230700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2db409e400 0x7f2db411ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.747+0000 7f2dbc230700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2db411f4a0 0x7f2db41351b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:21.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.747+0000 7f2dbc230700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db40a32b0 con 0x7f2db409e400 2023-09-30T22:24:21.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.747+0000 7f2dbc230700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db409c9e0 con 0x7f2db411f4a0 2023-09-30T22:24:21.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.747+0000 7f2dbc230700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2db4121c40 con 0x7f2db409d920 2023-09-30T22:24:21.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.747+0000 7f2dba7cd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2db411f4a0 0x7f2db41351b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.747+0000 7f2dba7cd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2db411f4a0 0x7f2db41351b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:56742/0 (socket says 172.21.15.40:56742) 2023-09-30T22:24:21.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.747+0000 7f2dba7cd700 1 -- 172.21.15.40:0/402166076 learned_addr learned my addr 172.21.15.40:0/402166076 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:21.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.747+0000 7f2db9fcc700 1 --2- 172.21.15.40:0/402166076 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2db409d920 0x7f2db411ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.748+0000 7f2db97cb700 1 --2- 172.21.15.40:0/402166076 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2db409e400 0x7f2db411ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:21.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.748+0000 7f2db9fcc700 1 -- 172.21.15.40:0/402166076 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2db411f4a0 msgr2=0x7f2db41351b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.748+0000 7f2db9fcc700 1 --2- 172.21.15.40:0/402166076 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2db411f4a0 0x7f2db41351b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.748+0000 7f2db9fcc700 1 -- 172.21.15.40:0/402166076 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2db409e400 msgr2=0x7f2db411ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.748+0000 7f2db9fcc700 1 --2- 172.21.15.40:0/402166076 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2db409e400 0x7f2db411ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.748+0000 7f2db9fcc700 1 -- 172.21.15.40:0/402166076 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dac009a70 con 0x7f2db409d920 2023-09-30T22:24:21.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.748+0000 7f2db9fcc700 1 --2- 172.21.15.40:0/402166076 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2db409d920 0x7f2db411ea20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2db0000fd0 tx=0x7f2db000c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:21.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.749+0000 7f2daa7fc700 1 -- 172.21.15.40:0/402166076 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db00054e0 con 0x7f2db409d920 2023-09-30T22:24:21.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.749+0000 7f2daa7fc700 1 -- 172.21.15.40:0/402166076 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db000ce50 con 0x7f2db409d920 2023-09-30T22:24:21.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.749+0000 7f2daa7fc700 1 -- 172.21.15.40:0/402166076 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db0003880 con 0x7f2db409d920 2023-09-30T22:24:21.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.749+0000 7f2dbc230700 1 -- 172.21.15.40:0/402166076 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da4009550 con 0x7f2db409d920 2023-09-30T22:24:21.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.749+0000 7f2dbc230700 1 -- 172.21.15.40:0/402166076 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db4120d60 con 0x7f2db409d920 2023-09-30T22:24:21.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.750+0000 7f2dbc230700 1 -- 172.21.15.40:0/402166076 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db411f8a0 con 0x7f2db409d920 2023-09-30T22:24:21.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.751+0000 7f2daa7fc700 1 -- 172.21.15.40:0/402166076 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f2db00039e0 con 0x7f2db409d920 2023-09-30T22:24:21.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.751+0000 7f2daa7fc700 1 -- 172.21.15.40:0/402166076 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3967+0+0 (secure 0 0 0) 0x7f2db003b370 con 0x7f2db409d920 2023-09-30T22:24:21.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.751+0000 7f2db97cb700 1 -- 172.21.15.40:0/402166076 >> v1:172.21.15.40:6816/118905 conn(0x7f2d9802c200 legacy=0x7f2d9802e6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/118905 2023-09-30T22:24:21.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.759+0000 7f2daa7fc700 1 -- 172.21.15.40:0/402166076 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f2db00238e0 con 0x7f2db409d920 2023-09-30T22:24:21.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.783+0000 7f9abeffd700 1 -- 172.21.15.40:0/2254178760 >> v1:172.21.15.40:6816/118905 conn(0x7f9aa002c1b0 legacy=0x7f9aa002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/118905 2023-09-30T22:24:21.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.807+0000 7f6c56305700 1 -- 172.21.15.40:0/3772517730 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6c50062380 con 0x7f6c5009d920 2023-09-30T22:24:21.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.807+0000 7f6c4cff9700 1 -- 172.21.15.40:0/3772517730 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6c40010300 con 0x7f6c5009d920 2023-09-30T22:24:21.808 INFO:teuthology.orchestra.run.smithi040.stdout:38654705694 2023-09-30T22:24:21.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.809+0000 7f6c56305700 1 -- 172.21.15.40:0/3772517730 >> v1:172.21.15.40:6816/118905 conn(0x7f6c3c02c1b0 legacy=0x7f6c3c02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:21.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.809+0000 7f6c56305700 1 -- 172.21.15.40:0/3772517730 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c5009d920 msgr2=0x7f6c5011e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.809+0000 7f6c56305700 1 --2- 172.21.15.40:0/3772517730 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c5009d920 0x7f6c5011e580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6c4000c6d0 tx=0x7f6c4000c9e0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.809+0000 7f6c56305700 1 -- 172.21.15.40:0/3772517730 shutdown_connections 2023-09-30T22:24:21.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.809+0000 7f6c56305700 1 --2- 172.21.15.40:0/3772517730 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c5009d920 0x7f6c5011e580 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.809+0000 7f6c56305700 1 --2- 172.21.15.40:0/3772517730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c50136230 0x7f6c5011f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.809+0000 7f6c56305700 1 --2- 172.21.15.40:0/3772517730 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c5009e400 0x7f6c5011eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.809+0000 7f6c56305700 1 -- 172.21.15.40:0/3772517730 >> 172.21.15.40:0/3772517730 conn(0x7f6c5009fb20 msgr2=0x7f6c50070310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:21.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.809+0000 7f6c56305700 1 -- 172.21.15.40:0/3772517730 shutdown_connections 2023-09-30T22:24:21.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.809+0000 7f6c56305700 1 -- 172.21.15.40:0/3772517730 wait complete. 2023-09-30T22:24:21.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.810+0000 7f9ac5a13700 1 -- 172.21.15.40:0/2254178760 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9ac011f7c0 con 0x7f9ac009dd60 2023-09-30T22:24:21.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.811+0000 7f9abcff9700 1 -- 172.21.15.40:0/2254178760 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9aa8017030 con 0x7f9ac009dd60 2023-09-30T22:24:21.812 INFO:teuthology.orchestra.run.smithi040.stdout:38654705694 2023-09-30T22:24:21.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.813+0000 7f9ac5a13700 1 -- 172.21.15.40:0/2254178760 >> v1:172.21.15.40:6816/118905 conn(0x7f9aa002c1b0 legacy=0x7f9aa002e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:21.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.813+0000 7f9ac5a13700 1 -- 172.21.15.40:0/2254178760 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ac009dd60 msgr2=0x7f9ac011c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.813+0000 7f9ac5a13700 1 --2- 172.21.15.40:0/2254178760 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ac009dd60 0x7f9ac011c410 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9aa800c4a0 tx=0x7f9aa800c7b0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.817+0000 7f9ac5a13700 1 -- 172.21.15.40:0/2254178760 shutdown_connections 2023-09-30T22:24:21.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.817+0000 7f9ac5a13700 1 --2- 172.21.15.40:0/2254178760 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9ac009d450 0x7f9ac011bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.817+0000 7f9ac5a13700 1 --2- 172.21.15.40:0/2254178760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ac01308d0 0x7f9ac01c43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.817+0000 7f9ac5a13700 1 --2- 172.21.15.40:0/2254178760 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ac009dd60 0x7f9ac011c410 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.817+0000 7f9ac5a13700 1 -- 172.21.15.40:0/2254178760 >> 172.21.15.40:0/2254178760 conn(0x7f9ac00a2a00 msgr2=0x7f9ac01b7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:21.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.817+0000 7f9ac5a13700 1 -- 172.21.15.40:0/2254178760 shutdown_connections 2023-09-30T22:24:21.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.817+0000 7f9ac5a13700 1 -- 172.21.15.40:0/2254178760 wait complete. 2023-09-30T22:24:21.820 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:21.820+0000 7ff0e5d3a240 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-30T22:24:21.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705694 for osd.2 2023-09-30T22:24:21.830 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705694 for osd.1 2023-09-30T22:24:21.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.832+0000 7f40e163d700 1 -- 172.21.15.40:0/1124895500 >> v1:172.21.15.40:6816/118905 conn(0x7f40c002c1b0 legacy=0x7f40c002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/118905 2023-09-30T22:24:21.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.840+0000 7f40e38a1700 1 -- 172.21.15.40:0/1124895500 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f40dc062380 con 0x7f40dc119730 2023-09-30T22:24:21.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.840+0000 7f40d1ffb700 1 -- 172.21.15.40:0/1124895500 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f40d40074e0 con 0x7f40dc119730 2023-09-30T22:24:21.841 INFO:teuthology.orchestra.run.smithi040.stdout:38654705694 2023-09-30T22:24:21.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.842+0000 7f40e38a1700 1 -- 172.21.15.40:0/1124895500 >> v1:172.21.15.40:6816/118905 conn(0x7f40c002c1b0 legacy=0x7f40c002e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:21.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.842+0000 7f40e38a1700 1 -- 172.21.15.40:0/1124895500 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40dc119730 msgr2=0x7f40dc119ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.842+0000 7f40e38a1700 1 --2- 172.21.15.40:0/1124895500 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40dc119730 0x7f40dc119ba0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f40d400cbe0 tx=0x7f40d400cef0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.842+0000 7f40e38a1700 1 -- 172.21.15.40:0/1124895500 shutdown_connections 2023-09-30T22:24:21.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.842+0000 7f40e38a1700 1 --2- 172.21.15.40:0/1124895500 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f40dc09d920 0x7f40dc1cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.842+0000 7f40e38a1700 1 --2- 172.21.15.40:0/1124895500 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40dc119730 0x7f40dc119ba0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.842+0000 7f40e38a1700 1 --2- 172.21.15.40:0/1124895500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40dc133ca0 0x7f40dc1cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.842+0000 7f40e38a1700 1 -- 172.21.15.40:0/1124895500 >> 172.21.15.40:0/1124895500 conn(0x7f40dc09fb20 msgr2=0x7f40dc1bb150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:21.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.842+0000 7f40e38a1700 1 -- 172.21.15.40:0/1124895500 shutdown_connections 2023-09-30T22:24:21.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.842+0000 7f40e38a1700 1 -- 172.21.15.40:0/1124895500 wait complete. 2023-09-30T22:24:21.855 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705694 for osd.0 2023-09-30T22:24:21.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.952+0000 7f2db97cb700 1 -- 172.21.15.40:0/402166076 >> v1:172.21.15.40:6816/118905 conn(0x7f2d9802c200 legacy=0x7f2d9802e6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/118905 2023-09-30T22:24:21.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.981+0000 7f2dbc230700 1 -- 172.21.15.40:0/402166076 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2db41217f0 con 0x7f2db409d920 2023-09-30T22:24:21.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.981+0000 7f2daa7fc700 1 -- 172.21.15.40:0/402166076 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2db0017030 con 0x7f2db409d920 2023-09-30T22:24:21.982 INFO:teuthology.orchestra.run.smithi040.stdout:38654705694 2023-09-30T22:24:21.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.983+0000 7f2dbc230700 1 -- 172.21.15.40:0/402166076 >> v1:172.21.15.40:6816/118905 conn(0x7f2d9802c200 legacy=0x7f2d9802e6b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:21.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.983+0000 7f2dbc230700 1 -- 172.21.15.40:0/402166076 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2db409d920 msgr2=0x7f2db411ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.983+0000 7f2dbc230700 1 --2- 172.21.15.40:0/402166076 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2db409d920 0x7f2db411ea20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2db0000fd0 tx=0x7f2db000c7b0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.983+0000 7f2dbc230700 1 -- 172.21.15.40:0/402166076 shutdown_connections 2023-09-30T22:24:21.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.983+0000 7f2dbc230700 1 --2- 172.21.15.40:0/402166076 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2db409d920 0x7f2db411ea20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.983+0000 7f2dbc230700 1 --2- 172.21.15.40:0/402166076 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2db411f4a0 0x7f2db41351b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.983+0000 7f2dbc230700 1 --2- 172.21.15.40:0/402166076 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2db409e400 0x7f2db411ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.983+0000 7f2dbc230700 1 -- 172.21.15.40:0/402166076 >> 172.21.15.40:0/402166076 conn(0x7f2db409fb20 msgr2=0x7f2db4070860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:21.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.983+0000 7f2dbc230700 1 -- 172.21.15.40:0/402166076 shutdown_connections 2023-09-30T22:24:21.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:21.983+0000 7f2dbc230700 1 -- 172.21.15.40:0/402166076 wait complete. 2023-09-30T22:24:21.996 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705694 for osd.3 2023-09-30T22:24:22.001 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:22.001+0000 7ff0e5d3a240 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-30T22:24:22.076 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:22.076+0000 7ff0e5d3a240 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-30T22:24:22.750 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:22.750+0000 7ff0e5d3a240 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-30T22:24:22.825 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:22.832 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:22.855 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:22.886 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:22.885+0000 7ff0e5d3a240 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-30T22:24:22.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.961+0000 7fbd5ea7d700 1 Processor -- start 2023-09-30T22:24:22.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.961+0000 7fbd5ea7d700 1 -- start start 2023-09-30T22:24:22.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.962+0000 7fbd5ea7d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbd5809c890 0x7fbd5809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.962+0000 7fbd5ea7d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd5809d920 0x7fbd5809dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.962+0000 7fbd5ea7d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbd5809e2b0 0x7fbd5813ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.962+0000 7fbd5ea7d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd580a29d0 con 0x7fbd5809e2b0 2023-09-30T22:24:22.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.962+0000 7fbd5ea7d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5809fb40 con 0x7fbd5809d920 2023-09-30T22:24:22.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.962+0000 7fbd5ea7d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd580a2600 con 0x7fbd5809c890 2023-09-30T22:24:22.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.962+0000 7fbd5c819700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbd5809c890 0x7fbd5809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.962+0000 7fbd5c819700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbd5809c890 0x7fbd5809cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:50584/0 (socket says 172.21.15.40:50584) 2023-09-30T22:24:22.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.962+0000 7fbd5c819700 1 -- 172.21.15.40:0/3286082863 learned_addr learned my addr 172.21.15.40:0/3286082863 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:22.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.962+0000 7fbd5d01a700 1 --2- 172.21.15.40:0/3286082863 >> v2:172.21.15.40:3300/0 conn(0x7fbd5809e2b0 0x7fbd5813ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.962+0000 7fbd57fff700 1 --2- 172.21.15.40:0/3286082863 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd5809d920 0x7fbd5809dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.962+0000 7fbd5d01a700 1 -- 172.21.15.40:0/3286082863 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbd5809c890 msgr2=0x7fbd5809cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:22.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.963+0000 7fbd5d01a700 1 --2- 172.21.15.40:0/3286082863 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbd5809c890 0x7fbd5809cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.963+0000 7fbd5d01a700 1 -- 172.21.15.40:0/3286082863 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd5809d920 msgr2=0x7fbd5809dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:22.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.963+0000 7fbd5d01a700 1 --2- 172.21.15.40:0/3286082863 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd5809d920 0x7fbd5809dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.963+0000 7fbd5d01a700 1 -- 172.21.15.40:0/3286082863 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd5809e720 con 0x7fbd5809e2b0 2023-09-30T22:24:22.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.963+0000 7fbd5d01a700 1 --2- 172.21.15.40:0/3286082863 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd5809e2b0 0x7fbd5813ac10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbd50009dc0 tx=0x7fbd5000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e91770285fbe82 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:22.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.963+0000 7fbd577fe700 1 -- 172.21.15.40:0/3286082863 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5000e070 con 0x7fbd5809e2b0 2023-09-30T22:24:22.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.963+0000 7fbd577fe700 1 -- 172.21.15.40:0/3286082863 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5000bae0 con 0x7fbd5809e2b0 2023-09-30T22:24:22.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.963+0000 7fbd577fe700 1 -- 172.21.15.40:0/3286082863 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5000be90 con 0x7fbd5809e2b0 2023-09-30T22:24:22.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.964+0000 7fbd5ea7d700 1 -- 172.21.15.40:0/3286082863 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd5809e2b0 msgr2=0x7fbd5813ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:22.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.964+0000 7fbd5ea7d700 1 --2- 172.21.15.40:0/3286082863 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd5809e2b0 0x7fbd5813ac10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbd50009dc0 tx=0x7fbd5000b330 comp rx=0 tx=0).stop 2023-09-30T22:24:22.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.964+0000 7fbd5ea7d700 1 -- 172.21.15.40:0/3286082863 shutdown_connections 2023-09-30T22:24:22.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.964+0000 7fbd5ea7d700 1 --2- 172.21.15.40:0/3286082863 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbd5809c890 0x7fbd5809cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.964+0000 7fbd5ea7d700 1 --2- 172.21.15.40:0/3286082863 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd5809e2b0 0x7fbd5813ac10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.964+0000 7fbd5ea7d700 1 --2- 172.21.15.40:0/3286082863 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd5809d920 0x7fbd5809dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.964+0000 7fbd5ea7d700 1 -- 172.21.15.40:0/3286082863 >> 172.21.15.40:0/3286082863 conn(0x7fbd580a7080 msgr2=0x7fbd580a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:22.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.964+0000 7fbd5ea7d700 1 -- 172.21.15.40:0/3286082863 shutdown_connections 2023-09-30T22:24:22.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.964+0000 7fbd5ea7d700 1 -- 172.21.15.40:0/3286082863 wait complete. 2023-09-30T22:24:22.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.965+0000 7fbd5ea7d700 1 Processor -- start 2023-09-30T22:24:22.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.965+0000 7fbd5ea7d700 1 -- start start 2023-09-30T22:24:22.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.965+0000 7fbd5ea7d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd5809c890 0x7fbd5812b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.965+0000 7fbd5ea7d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbd5809d920 0x7fbd5812ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.965+0000 7fbd5ea7d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd5809e2b0 0x7fbd5812bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.965+0000 7fbd5ea7d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5812caf0 con 0x7fbd5809c890 2023-09-30T22:24:22.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.965+0000 7fbd5ea7d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5812d1e0 con 0x7fbd5809e2b0 2023-09-30T22:24:22.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.965+0000 7fbd5ea7d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5809ecf0 con 0x7fbd5809d920 2023-09-30T22:24:22.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.966+0000 7fbd57fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbd5809d920 0x7fbd5812ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.966+0000 7fbd5c819700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd5809c890 0x7fbd5812b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.966+0000 7fbd5d01a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd5809e2b0 0x7fbd5812bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.966+0000 7fbd57fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbd5809d920 0x7fbd5812ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:50590/0 (socket says 172.21.15.40:50590) 2023-09-30T22:24:22.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.966+0000 7fbd57fff700 1 -- 172.21.15.40:0/4177889909 learned_addr learned my addr 172.21.15.40:0/4177889909 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:22.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.966+0000 7fbd5c819700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd5809c890 0x7fbd5812b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60642/0 (socket says 172.21.15.40:60642) 2023-09-30T22:24:22.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.966+0000 7fbd5d01a700 1 -- 172.21.15.40:0/4177889909 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbd5809d920 msgr2=0x7fbd5812ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:22.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.966+0000 7fbd5d01a700 1 --2- 172.21.15.40:0/4177889909 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbd5809d920 0x7fbd5812ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.966+0000 7fbd5d01a700 1 -- 172.21.15.40:0/4177889909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd5809c890 msgr2=0x7fbd5812b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:22.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.966+0000 7fbd5d01a700 1 --2- 172.21.15.40:0/4177889909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd5809c890 0x7fbd5812b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.966+0000 7fbd5d01a700 1 -- 172.21.15.40:0/4177889909 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd50009a70 con 0x7fbd5809e2b0 2023-09-30T22:24:22.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.966+0000 7fbd5c819700 1 --2- 172.21.15.40:0/4177889909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd5809c890 0x7fbd5812b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:22.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.966+0000 7fbd5d01a700 1 --2- 172.21.15.40:0/4177889909 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd5809e2b0 0x7fbd5812bf60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbd50016000 tx=0x7fbd50004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:22.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.966+0000 7fbd557fa700 1 -- 172.21.15.40:0/4177889909 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd500045d0 con 0x7fbd5809e2b0 2023-09-30T22:24:22.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.966+0000 7fbd557fa700 1 -- 172.21.15.40:0/4177889909 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd50020070 con 0x7fbd5809e2b0 2023-09-30T22:24:22.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.966+0000 7fbd5ea7d700 1 -- 172.21.15.40:0/4177889909 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd5812d6c0 con 0x7fbd5809e2b0 2023-09-30T22:24:22.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.966+0000 7fbd557fa700 1 -- 172.21.15.40:0/4177889909 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd50009860 con 0x7fbd5809e2b0 2023-09-30T22:24:22.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.966+0000 7fbd5ea7d700 1 -- 172.21.15.40:0/4177889909 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd580a5b20 con 0x7fbd5809e2b0 2023-09-30T22:24:22.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.967+0000 7fbd557fa700 1 -- 172.21.15.40:0/4177889909 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fbd50027480 con 0x7fbd5809e2b0 2023-09-30T22:24:22.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.968+0000 7fbd5ea7d700 1 -- 172.21.15.40:0/4177889909 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd5806e600 con 0x7fbd5809e2b0 2023-09-30T22:24:22.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.968+0000 7fbd557fa700 1 -- 172.21.15.40:0/4177889909 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3967+0+0 (secure 0 0 0) 0x7fbd50022070 con 0x7fbd5809e2b0 2023-09-30T22:24:22.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.968+0000 7fbd5c819700 1 -- 172.21.15.40:0/4177889909 >> v1:172.21.15.40:6816/118905 conn(0x7fbd3c02c1b0 legacy=0x7fbd3c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/118905 2023-09-30T22:24:22.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:22.976+0000 7fbd557fa700 1 -- 172.21.15.40:0/4177889909 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fbd5002f980 con 0x7fbd5809e2b0 2023-09-30T22:24:22.996 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:23.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.005+0000 7fa82555b700 1 Processor -- start 2023-09-30T22:24:23.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.005+0000 7fa82555b700 1 -- start start 2023-09-30T22:24:23.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.006+0000 7fa82555b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa820138250 0x7fa820138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.006+0000 7fa82555b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa82009df20 0x7fa820140160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.006+0000 7fa82555b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa820137e20 con 0x7fa82009d400 2023-09-30T22:24:23.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.006+0000 7fa82555b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa820138050 con 0x7fa820138250 2023-09-30T22:24:23.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.006+0000 7fa82555b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa82009b010 con 0x7fa82009df20 2023-09-30T22:24:23.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.006+0000 7fa81effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa820138250 0x7fa820138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.006+0000 7fa81e7fc700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa82009d400 0x7fa82009d810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50174/0 (socket says 172.21.15.40:50174) 2023-09-30T22:24:23.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.006+0000 7fa81e7fc700 1 -- 172.21.15.40:0/2795971119 learned_addr learned my addr 172.21.15.40:0/2795971119 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:24:23.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.006+0000 7fa81effd700 1 --2- 172.21.15.40:0/2795971119 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa820138250 0x7fa820138620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:56776/0 (socket says 172.21.15.40:56776) 2023-09-30T22:24:23.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.006+0000 7fa81effd700 1 -- 172.21.15.40:0/2795971119 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa82009df20 msgr2=0x7fa820140160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:23.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.006+0000 7fa81effd700 1 --2- 172.21.15.40:0/2795971119 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa82009df20 0x7fa820140160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.006+0000 7fa81effd700 1 -- 172.21.15.40:0/2795971119 >> v1:172.21.15.40:6789/0 conn(0x7fa82009d400 legacy=0x7fa82009d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:23.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.006+0000 7fa81effd700 1 -- 172.21.15.40:0/2795971119 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa82009f1f0 con 0x7fa820138250 2023-09-30T22:24:23.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.007+0000 7fa81effd700 1 --2- 172.21.15.40:0/2795971119 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa820138250 0x7fa820138620 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa810009870 tx=0x7fa810009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9886021caa0afdd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:23.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.007+0000 7fa81dffb700 1 -- 172.21.15.40:0/2795971119 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa810004230 con 0x7fa820138250 2023-09-30T22:24:23.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.007+0000 7fa81dffb700 1 -- 172.21.15.40:0/2795971119 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa810004390 con 0x7fa820138250 2023-09-30T22:24:23.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.007+0000 7fa81dffb700 1 -- 172.21.15.40:0/2795971119 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8100036a0 con 0x7fa820138250 2023-09-30T22:24:23.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.008+0000 7fa82555b700 1 -- 172.21.15.40:0/2795971119 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa820138250 msgr2=0x7fa820138620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.008+0000 7fa82555b700 1 --2- 172.21.15.40:0/2795971119 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa820138250 0x7fa820138620 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa810009870 tx=0x7fa810009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:23.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.008+0000 7fa82555b700 1 -- 172.21.15.40:0/2795971119 shutdown_connections 2023-09-30T22:24:23.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.008+0000 7fa82555b700 1 --2- 172.21.15.40:0/2795971119 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa82009df20 0x7fa820140160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.008+0000 7fa82555b700 1 --2- 172.21.15.40:0/2795971119 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa820138250 0x7fa820138620 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.008+0000 7fa82555b700 1 -- 172.21.15.40:0/2795971119 >> 172.21.15.40:0/2795971119 conn(0x7fa8200a2a00 msgr2=0x7fa8200a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:23.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.008+0000 7fa82555b700 1 -- 172.21.15.40:0/2795971119 shutdown_connections 2023-09-30T22:24:23.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.008+0000 7fa82555b700 1 -- 172.21.15.40:0/2795971119 wait complete. 2023-09-30T22:24:23.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.009+0000 7fa82555b700 1 Processor -- start 2023-09-30T22:24:23.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.009+0000 7fa82555b700 1 -- start start 2023-09-30T22:24:23.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.010+0000 7fa82555b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa82009d400 0x7fa820140a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.010+0000 7fa82555b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa82009df20 0x7fa82013b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.010+0000 7fa82555b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa820138250 0x7fa82013bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.010+0000 7fa82555b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82013dc00 con 0x7fa820138250 2023-09-30T22:24:23.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.010+0000 7fa82555b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa82013fc00 con 0x7fa82009df20 2023-09-30T22:24:23.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.010+0000 7fa82555b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa82013f2c0 con 0x7fa82009d400 2023-09-30T22:24:23.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.010+0000 7fa81e7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa82009df20 0x7fa82013b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.010+0000 7fa81e7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa82009df20 0x7fa82013b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:56786/0 (socket says 172.21.15.40:56786) 2023-09-30T22:24:23.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.010+0000 7fa81e7fc700 1 -- 172.21.15.40:0/2046952685 learned_addr learned my addr 172.21.15.40:0/2046952685 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:23.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.010+0000 7fa81effd700 1 --2- 172.21.15.40:0/2046952685 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa82009d400 0x7fa820140a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.011+0000 7fa81e7fc700 1 -- 172.21.15.40:0/2046952685 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa82009d400 msgr2=0x7fa820140a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.011+0000 7fa81e7fc700 1 --2- 172.21.15.40:0/2046952685 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa82009d400 0x7fa820140a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.011+0000 7fa81e7fc700 1 -- 172.21.15.40:0/2046952685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa820138250 msgr2=0x7fa82013bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.011+0000 7fa81e7fc700 1 --2- 172.21.15.40:0/2046952685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa820138250 0x7fa82013bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.011+0000 7fa81e7fc700 1 -- 172.21.15.40:0/2046952685 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8100094a0 con 0x7fa82009df20 2023-09-30T22:24:23.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.011+0000 7fa81effd700 1 --2- 172.21.15.40:0/2046952685 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa82009d400 0x7fa820140a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:23.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.011+0000 7fa81e7fc700 1 --2- 172.21.15.40:0/2046952685 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa82009df20 0x7fa82013b7c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa81400c580 tx=0x7fa81400c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:23.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.012+0000 7fa8077fe700 1 -- 172.21.15.40:0/2046952685 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa814005d70 con 0x7fa82009df20 2023-09-30T22:24:23.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.012+0000 7fa8077fe700 1 -- 172.21.15.40:0/2046952685 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8140070d0 con 0x7fa82009df20 2023-09-30T22:24:23.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.012+0000 7fa8077fe700 1 -- 172.21.15.40:0/2046952685 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa814007480 con 0x7fa82009df20 2023-09-30T22:24:23.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.012+0000 7fa82555b700 1 -- 172.21.15.40:0/2046952685 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa82009a300 con 0x7fa82009df20 2023-09-30T22:24:23.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.012+0000 7fa82555b700 1 -- 172.21.15.40:0/2046952685 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa82013fe20 con 0x7fa82009df20 2023-09-30T22:24:23.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.013+0000 7fa82555b700 1 -- 172.21.15.40:0/2046952685 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa820136400 con 0x7fa82009df20 2023-09-30T22:24:23.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.018+0000 7fa8077fe700 1 -- 172.21.15.40:0/2046952685 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fa8140075e0 con 0x7fa82009df20 2023-09-30T22:24:23.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.018+0000 7fa8077fe700 1 -- 172.21.15.40:0/2046952685 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3967+0+0 (secure 0 0 0) 0x7fa81403b2a0 con 0x7fa82009df20 2023-09-30T22:24:23.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.018+0000 7fa8077fe700 1 -- 172.21.15.40:0/2046952685 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fa814011770 con 0x7fa82009df20 2023-09-30T22:24:23.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.018+0000 7fa81effd700 1 -- 172.21.15.40:0/2046952685 >> v1:172.21.15.40:6816/118905 conn(0x7fa80c02c200 legacy=0x7fa80c02e6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/118905 2023-09-30T22:24:23.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.033+0000 7fb0149ec700 1 Processor -- start 2023-09-30T22:24:23.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.033+0000 7fb0149ec700 1 -- start start 2023-09-30T22:24:23.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.034+0000 7fb0149ec700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb01006d470 0x7fb01013d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.034+0000 7fb0149ec700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb01013d900 0x7fb01013fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.034+0000 7fb0149ec700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb01006df30 con 0x7fb01006c990 2023-09-30T22:24:23.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.034+0000 7fb0149ec700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb01006ec40 con 0x7fb01006d470 2023-09-30T22:24:23.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.034+0000 7fb0149ec700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01006ea40 con 0x7fb01013d900 2023-09-30T22:24:23.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.034+0000 7fb00ed9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb01013d900 0x7fb01013fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.034+0000 7fb00ed9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb01013d900 0x7fb01013fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:56800/0 (socket says 172.21.15.40:56800) 2023-09-30T22:24:23.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.034+0000 7fb00ed9d700 1 -- 172.21.15.40:0/1553325900 learned_addr learned my addr 172.21.15.40:0/1553325900 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:23.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.034+0000 7fb00ed9d700 1 -- 172.21.15.40:0/1553325900 >> v2:172.21.15.40:3300/0 conn(0x7fb01006d470 msgr2=0x7fb01013d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:23.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.034+0000 7fb00ed9d700 1 --2- 172.21.15.40:0/1553325900 >> v2:172.21.15.40:3300/0 conn(0x7fb01006d470 0x7fb01013d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.034+0000 7fb00ed9d700 1 -- 172.21.15.40:0/1553325900 >> v1:172.21.15.40:6789/0 conn(0x7fb01006c990 legacy=0x7fb01006cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:23.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.034+0000 7fb00ed9d700 1 -- 172.21.15.40:0/1553325900 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb010072050 con 0x7fb01013d900 2023-09-30T22:24:23.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.035+0000 7fb00ed9d700 1 --2- 172.21.15.40:0/1553325900 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb01013d900 0x7fb01013fce0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb008009e50 tx=0x7fb00800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b728f072e4e9ce3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:23.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.035+0000 7fb00d59a700 1 -- 172.21.15.40:0/1553325900 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00800e070 con 0x7fb01013d900 2023-09-30T22:24:23.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.035+0000 7fb00d59a700 1 -- 172.21.15.40:0/1553325900 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb008003a20 con 0x7fb01013d900 2023-09-30T22:24:23.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.035+0000 7fb00d59a700 1 -- 172.21.15.40:0/1553325900 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb008003dd0 con 0x7fb01013d900 2023-09-30T22:24:23.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.036+0000 7fb0149ec700 1 -- 172.21.15.40:0/1553325900 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb01013d900 msgr2=0x7fb01013fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.036+0000 7fb0149ec700 1 --2- 172.21.15.40:0/1553325900 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb01013d900 0x7fb01013fce0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb008009e50 tx=0x7fb00800b330 comp rx=0 tx=0).stop 2023-09-30T22:24:23.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.036+0000 7fb0149ec700 1 -- 172.21.15.40:0/1553325900 shutdown_connections 2023-09-30T22:24:23.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.036+0000 7fb0149ec700 1 --2- 172.21.15.40:0/1553325900 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb01013d900 0x7fb01013fce0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.036+0000 7fb0149ec700 1 --2- 172.21.15.40:0/1553325900 >> v2:172.21.15.40:3300/0 conn(0x7fb01006d470 0x7fb01013d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.036+0000 7fb0149ec700 1 -- 172.21.15.40:0/1553325900 >> 172.21.15.40:0/1553325900 conn(0x7fb0100a41a0 msgr2=0x7fb0100a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:23.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.036+0000 7fb0149ec700 1 -- 172.21.15.40:0/1553325900 shutdown_connections 2023-09-30T22:24:23.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.036+0000 7fb0149ec700 1 -- 172.21.15.40:0/1553325900 wait complete. 2023-09-30T22:24:23.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.037+0000 7fb0149ec700 1 Processor -- start 2023-09-30T22:24:23.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.037+0000 7fb0149ec700 1 -- start start 2023-09-30T22:24:23.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.038+0000 7fb0149ec700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb01006c990 0x7fb01008de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.038+0000 7fb0149ec700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb01006d470 0x7fb01008e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.038+0000 7fb0149ec700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb01013d900 0x7fb0101ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.038+0000 7fb0149ec700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01009b180 con 0x7fb01006c990 2023-09-30T22:24:23.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.038+0000 7fb0149ec700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01009a9d0 con 0x7fb01006d470 2023-09-30T22:24:23.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.038+0000 7fb0149ec700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb01008b5e0 con 0x7fb01013d900 2023-09-30T22:24:23.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.038+0000 7fb00dd9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb01006d470 0x7fb01008e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.038+0000 7fb00dd9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb01006d470 0x7fb01008e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:56804/0 (socket says 172.21.15.40:56804) 2023-09-30T22:24:23.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.038+0000 7fb00dd9b700 1 -- 172.21.15.40:0/1213146703 learned_addr learned my addr 172.21.15.40:0/1213146703 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:23.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.039+0000 7fb00dd9b700 1 -- 172.21.15.40:0/1213146703 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb01013d900 msgr2=0x7fb0101ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.039+0000 7fb00dd9b700 1 --2- 172.21.15.40:0/1213146703 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb01013d900 0x7fb0101ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.039+0000 7fb00dd9b700 1 -- 172.21.15.40:0/1213146703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb01006c990 msgr2=0x7fb01008de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.039+0000 7fb00dd9b700 1 --2- 172.21.15.40:0/1213146703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb01006c990 0x7fb01008de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.039+0000 7fb00dd9b700 1 -- 172.21.15.40:0/1213146703 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb008009b30 con 0x7fb01006d470 2023-09-30T22:24:23.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.039+0000 7fb00dd9b700 1 --2- 172.21.15.40:0/1213146703 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb01006d470 0x7fb01008e3d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb00400b590 tx=0x7fb00400b950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:23.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.039+0000 7faffeffd700 1 -- 172.21.15.40:0/1213146703 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb004011830 con 0x7fb01006d470 2023-09-30T22:24:23.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.039+0000 7faffeffd700 1 -- 172.21.15.40:0/1213146703 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb004011990 con 0x7fb01006d470 2023-09-30T22:24:23.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.039+0000 7fb0149ec700 1 -- 172.21.15.40:0/1213146703 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb01008ca20 con 0x7fb01006d470 2023-09-30T22:24:23.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.039+0000 7faffeffd700 1 -- 172.21.15.40:0/1213146703 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb004011d40 con 0x7fb01006d470 2023-09-30T22:24:23.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.039+0000 7fb0149ec700 1 -- 172.21.15.40:0/1213146703 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb01008ec30 con 0x7fb01006d470 2023-09-30T22:24:23.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.040+0000 7fb0149ec700 1 -- 172.21.15.40:0/1213146703 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb010062380 con 0x7fb01006d470 2023-09-30T22:24:23.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.041+0000 7faffeffd700 1 -- 172.21.15.40:0/1213146703 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fb00401a400 con 0x7fb01006d470 2023-09-30T22:24:23.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.041+0000 7fb00e59c700 1 -- 172.21.15.40:0/1213146703 >> v1:172.21.15.40:6816/118905 conn(0x7faff002c1b0 legacy=0x7faff002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/118905 2023-09-30T22:24:23.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.045+0000 7faffeffd700 1 -- 172.21.15.40:0/1213146703 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3967+0+0 (secure 0 0 0) 0x7fb00400f4a0 con 0x7fb01006d470 2023-09-30T22:24:23.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.049+0000 7faffeffd700 1 -- 172.21.15.40:0/1213146703 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fb004018900 con 0x7fb01006d470 2023-09-30T22:24:23.052 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:23.051+0000 7ff0e5d3a240 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-30T22:24:23.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.169+0000 7fbd5c819700 1 -- 172.21.15.40:0/4177889909 >> v1:172.21.15.40:6816/118905 conn(0x7fbd3c02c1b0 legacy=0x7fbd3c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/118905 2023-09-30T22:24:23.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.194+0000 7fd49b5a1700 1 Processor -- start 2023-09-30T22:24:23.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.195+0000 7fd49b5a1700 1 -- start start 2023-09-30T22:24:23.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.195+0000 7fd49b5a1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd49409d450 0x7fd49409d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.195+0000 7fd49b5a1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd4941308d0 0x7fd494138420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.195+0000 7fd49b5a1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd49409c3b0 con 0x7fd49409dd60 2023-09-30T22:24:23.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.195+0000 7fd49b5a1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd49409a6b0 con 0x7fd4941308d0 2023-09-30T22:24:23.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.195+0000 7fd49b5a1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd49409b4f0 con 0x7fd49409d450 2023-09-30T22:24:23.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.196+0000 7fd49933d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd49409d450 0x7fd49409d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.196+0000 7fd499b3e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd4941308d0 0x7fd494138420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.196+0000 7fd49933d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd49409d450 0x7fd49409d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:32822/0 (socket says 172.21.15.40:32822) 2023-09-30T22:24:23.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.196+0000 7fd49933d700 1 -- 172.21.15.40:0/3298485734 learned_addr learned my addr 172.21.15.40:0/3298485734 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:23.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.196+0000 7fd499b3e700 1 -- 172.21.15.40:0/3298485734 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd49409d450 msgr2=0x7fd49409d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:23.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.196+0000 7fd499b3e700 1 --2- 172.21.15.40:0/3298485734 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd49409d450 0x7fd49409d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.196+0000 7fd499b3e700 1 -- 172.21.15.40:0/3298485734 >> v1:172.21.15.40:6789/0 conn(0x7fd49409dd60 legacy=0x7fd4941301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.196+0000 7fd499b3e700 1 -- 172.21.15.40:0/3298485734 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49409af90 con 0x7fd4941308d0 2023-09-30T22:24:23.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.196+0000 7fd499b3e700 1 --2- 172.21.15.40:0/3298485734 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4941308d0 0x7fd494138420 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd48c009d90 tx=0x7fd48c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b230e4ae87438d2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:23.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.197+0000 7fd48bfff700 1 -- 172.21.15.40:0/3298485734 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c00e070 con 0x7fd4941308d0 2023-09-30T22:24:23.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.197+0000 7fd48bfff700 1 -- 172.21.15.40:0/3298485734 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48c00bb20 con 0x7fd4941308d0 2023-09-30T22:24:23.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.197+0000 7fd48bfff700 1 -- 172.21.15.40:0/3298485734 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c012430 con 0x7fd4941308d0 2023-09-30T22:24:23.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.197+0000 7fd49b5a1700 1 -- 172.21.15.40:0/3298485734 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4941308d0 msgr2=0x7fd494138420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.197+0000 7fd49b5a1700 1 --2- 172.21.15.40:0/3298485734 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4941308d0 0x7fd494138420 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd48c009d90 tx=0x7fd48c00b330 comp rx=0 tx=0).stop 2023-09-30T22:24:23.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.198+0000 7fd49b5a1700 1 -- 172.21.15.40:0/3298485734 shutdown_connections 2023-09-30T22:24:23.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.198+0000 7fd49b5a1700 1 --2- 172.21.15.40:0/3298485734 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4941308d0 0x7fd494138420 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.198+0000 7fd49b5a1700 1 --2- 172.21.15.40:0/3298485734 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd49409d450 0x7fd49409d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.198+0000 7fd49b5a1700 1 -- 172.21.15.40:0/3298485734 >> 172.21.15.40:0/3298485734 conn(0x7fd4940a2a00 msgr2=0x7fd4940a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:23.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.198+0000 7fd49b5a1700 1 -- 172.21.15.40:0/3298485734 shutdown_connections 2023-09-30T22:24:23.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.198+0000 7fd49b5a1700 1 -- 172.21.15.40:0/3298485734 wait complete. 2023-09-30T22:24:23.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.199+0000 7fd49b5a1700 1 Processor -- start 2023-09-30T22:24:23.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.199+0000 7fd49b5a1700 1 -- start start 2023-09-30T22:24:23.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.200+0000 7fd49b5a1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd49409d450 0x7fd494136b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.200+0000 7fd49b5a1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd49409dd60 0x7fd49413a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.200+0000 7fd49b5a1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd4941308d0 0x7fd49413a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.200+0000 7fd49b5a1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd494139370 con 0x7fd49409dd60 2023-09-30T22:24:23.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.200+0000 7fd49b5a1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49413b350 con 0x7fd49409d450 2023-09-30T22:24:23.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.200+0000 7fd49b5a1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd494138dd0 con 0x7fd4941308d0 2023-09-30T22:24:23.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.200+0000 7fd499b3e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd4941308d0 0x7fd49413a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.200+0000 7fd499b3e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd4941308d0 0x7fd49413a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:32836/0 (socket says 172.21.15.40:32836) 2023-09-30T22:24:23.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.200+0000 7fd499b3e700 1 -- 172.21.15.40:0/3757984916 learned_addr learned my addr 172.21.15.40:0/3757984916 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:23.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.200+0000 7fd498b3c700 1 --2- 172.21.15.40:0/3757984916 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd49409dd60 0x7fd49413a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.201+0000 7fd499b3e700 1 -- 172.21.15.40:0/3757984916 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd49409d450 msgr2=0x7fd494136b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.201+0000 7fd499b3e700 1 --2- 172.21.15.40:0/3757984916 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd49409d450 0x7fd494136b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.201+0000 7fd499b3e700 1 -- 172.21.15.40:0/3757984916 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd49409dd60 msgr2=0x7fd49413a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.201+0000 7fd499b3e700 1 --2- 172.21.15.40:0/3757984916 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd49409dd60 0x7fd49413a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.201+0000 7fd499b3e700 1 -- 172.21.15.40:0/3757984916 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48c009a70 con 0x7fd4941308d0 2023-09-30T22:24:23.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.201+0000 7fd499b3e700 1 --2- 172.21.15.40:0/3757984916 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd4941308d0 0x7fd49413a770 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd48c014040 tx=0x7fd48c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:23.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.201+0000 7fd489ffb700 1 -- 172.21.15.40:0/3757984916 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c012430 con 0x7fd4941308d0 2023-09-30T22:24:23.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.201+0000 7fd489ffb700 1 -- 172.21.15.40:0/3757984916 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48c020070 con 0x7fd4941308d0 2023-09-30T22:24:23.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.201+0000 7fd489ffb700 1 -- 172.21.15.40:0/3757984916 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c003ea0 con 0x7fd4941308d0 2023-09-30T22:24:23.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.201+0000 7fd49b5a1700 1 -- 172.21.15.40:0/3757984916 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4940a24a0 con 0x7fd4941308d0 2023-09-30T22:24:23.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.202+0000 7fd49b5a1700 1 -- 172.21.15.40:0/3757984916 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd494139650 con 0x7fd4941308d0 2023-09-30T22:24:23.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.203+0000 7fd489ffb700 1 -- 172.21.15.40:0/3757984916 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fd48c004280 con 0x7fd4941308d0 2023-09-30T22:24:23.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.203+0000 7fd49b5a1700 1 -- 172.21.15.40:0/3757984916 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd494062380 con 0x7fd4941308d0 2023-09-30T22:24:23.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.203+0000 7fd489ffb700 1 -- 172.21.15.40:0/3757984916 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3967+0+0 (secure 0 0 0) 0x7fd48c022070 con 0x7fd4941308d0 2023-09-30T22:24:23.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.203+0000 7fd49933d700 1 -- 172.21.15.40:0/3757984916 >> v1:172.21.15.40:6816/118905 conn(0x7fd47802c1b0 legacy=0x7fd47802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/118905 2023-09-30T22:24:23.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.208+0000 7fa82555b700 1 -- 172.21.15.40:0/2046952685 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa820062380 con 0x7fa82009df20 2023-09-30T22:24:23.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.208+0000 7fa8077fe700 1 -- 172.21.15.40:0/2046952685 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa814011af0 con 0x7fa82009df20 2023-09-30T22:24:23.208 INFO:teuthology.orchestra.run.smithi040.stdout:38654705694 2023-09-30T22:24:23.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.211+0000 7fd489ffb700 1 -- 172.21.15.40:0/3757984916 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fd48c01c400 con 0x7fd4941308d0 2023-09-30T22:24:23.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.211+0000 7fa82555b700 1 -- 172.21.15.40:0/2046952685 >> v1:172.21.15.40:6816/118905 conn(0x7fa80c02c200 legacy=0x7fa80c02e6b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:23.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.211+0000 7fa82555b700 1 -- 172.21.15.40:0/2046952685 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa82009df20 msgr2=0x7fa82013b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.211+0000 7fa82555b700 1 --2- 172.21.15.40:0/2046952685 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa82009df20 0x7fa82013b7c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa81400c580 tx=0x7fa81400c940 comp rx=0 tx=0).stop 2023-09-30T22:24:23.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.211+0000 7fa82555b700 1 -- 172.21.15.40:0/2046952685 shutdown_connections 2023-09-30T22:24:23.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.211+0000 7fa82555b700 1 --2- 172.21.15.40:0/2046952685 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa82009d400 0x7fa820140a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.211+0000 7fa82555b700 1 --2- 172.21.15.40:0/2046952685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa820138250 0x7fa82013bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.211+0000 7fa82555b700 1 --2- 172.21.15.40:0/2046952685 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa82009df20 0x7fa82013b7c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.211+0000 7fa82555b700 1 -- 172.21.15.40:0/2046952685 >> 172.21.15.40:0/2046952685 conn(0x7fa8200a2a00 msgr2=0x7fa8200a1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:23.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.211+0000 7fa82555b700 1 -- 172.21.15.40:0/2046952685 shutdown_connections 2023-09-30T22:24:23.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.212+0000 7fa82555b700 1 -- 172.21.15.40:0/2046952685 wait complete. 2023-09-30T22:24:23.226 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705694 for osd.1 2023-09-30T22:24:23.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.242+0000 7fb00e59c700 1 -- 172.21.15.40:0/1213146703 >> v1:172.21.15.40:6816/118905 conn(0x7faff002c1b0 legacy=0x7faff002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/118905 2023-09-30T22:24:23.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.262+0000 7fbd5ea7d700 1 -- 172.21.15.40:0/4177889909 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbd58062380 con 0x7fbd5809e2b0 2023-09-30T22:24:23.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.262+0000 7fbd557fa700 1 -- 172.21.15.40:0/4177889909 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbd5002f390 con 0x7fbd5809e2b0 2023-09-30T22:24:23.263 INFO:teuthology.orchestra.run.smithi040.stdout:38654705694 2023-09-30T22:24:23.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.264+0000 7fbd5ea7d700 1 -- 172.21.15.40:0/4177889909 >> v1:172.21.15.40:6816/118905 conn(0x7fbd3c02c1b0 legacy=0x7fbd3c02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:23.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.264+0000 7fbd5ea7d700 1 -- 172.21.15.40:0/4177889909 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd5809e2b0 msgr2=0x7fbd5812bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.264+0000 7fbd5ea7d700 1 --2- 172.21.15.40:0/4177889909 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd5809e2b0 0x7fbd5812bf60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbd50016000 tx=0x7fbd50004ad0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.264+0000 7fbd5ea7d700 1 -- 172.21.15.40:0/4177889909 shutdown_connections 2023-09-30T22:24:23.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.264+0000 7fbd5ea7d700 1 --2- 172.21.15.40:0/4177889909 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd5809e2b0 0x7fbd5812bf60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.264+0000 7fbd5ea7d700 1 --2- 172.21.15.40:0/4177889909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd5809c890 0x7fbd5812b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.264+0000 7fbd5ea7d700 1 --2- 172.21.15.40:0/4177889909 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbd5809d920 0x7fbd5812ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.264+0000 7fbd5ea7d700 1 -- 172.21.15.40:0/4177889909 >> 172.21.15.40:0/4177889909 conn(0x7fbd580a7080 msgr2=0x7fbd581baff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:23.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.265+0000 7fbd5ea7d700 1 -- 172.21.15.40:0/4177889909 shutdown_connections 2023-09-30T22:24:23.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.265+0000 7fbd5ea7d700 1 -- 172.21.15.40:0/4177889909 wait complete. 2023-09-30T22:24:23.278 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705694 for osd.2 2023-09-30T22:24:23.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.291+0000 7fb0149ec700 1 -- 172.21.15.40:0/1213146703 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb0100713c0 con 0x7fb01006d470 2023-09-30T22:24:23.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.291+0000 7faffeffd700 1 -- 172.21.15.40:0/1213146703 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb004015020 con 0x7fb01006d470 2023-09-30T22:24:23.292 INFO:teuthology.orchestra.run.smithi040.stdout:38654705694 2023-09-30T22:24:23.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.293+0000 7fb0149ec700 1 -- 172.21.15.40:0/1213146703 >> v1:172.21.15.40:6816/118905 conn(0x7faff002c1b0 legacy=0x7faff002e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:23.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.293+0000 7fb0149ec700 1 -- 172.21.15.40:0/1213146703 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb01006d470 msgr2=0x7fb01008e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.293+0000 7fb0149ec700 1 --2- 172.21.15.40:0/1213146703 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb01006d470 0x7fb01008e3d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb00400b590 tx=0x7fb00400b950 comp rx=0 tx=0).stop 2023-09-30T22:24:23.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.293+0000 7fb0149ec700 1 -- 172.21.15.40:0/1213146703 shutdown_connections 2023-09-30T22:24:23.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.293+0000 7fb0149ec700 1 --2- 172.21.15.40:0/1213146703 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb01013d900 0x7fb0101ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.293+0000 7fb0149ec700 1 --2- 172.21.15.40:0/1213146703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb01006c990 0x7fb01008de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.293+0000 7fb0149ec700 1 --2- 172.21.15.40:0/1213146703 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb01006d470 0x7fb01008e3d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.293+0000 7fb0149ec700 1 -- 172.21.15.40:0/1213146703 >> 172.21.15.40:0/1213146703 conn(0x7fb0100a41a0 msgr2=0x7fb0100a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:23.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.293+0000 7fb0149ec700 1 -- 172.21.15.40:0/1213146703 shutdown_connections 2023-09-30T22:24:23.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.293+0000 7fb0149ec700 1 -- 172.21.15.40:0/1213146703 wait complete. 2023-09-30T22:24:23.306 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705694 for osd.0 2023-09-30T22:24:23.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.404+0000 7fd49933d700 1 -- 172.21.15.40:0/3757984916 >> v1:172.21.15.40:6816/118905 conn(0x7fd47802c1b0 legacy=0x7fd47802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/118905 2023-09-30T22:24:23.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.428+0000 7fd49b5a1700 1 -- 172.21.15.40:0/3757984916 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd4941394b0 con 0x7fd4941308d0 2023-09-30T22:24:23.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.428+0000 7fd489ffb700 1 -- 172.21.15.40:0/3757984916 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd4941394b0 con 0x7fd4941308d0 2023-09-30T22:24:23.429 INFO:teuthology.orchestra.run.smithi040.stdout:38654705694 2023-09-30T22:24:23.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.430+0000 7fd49b5a1700 1 -- 172.21.15.40:0/3757984916 >> v1:172.21.15.40:6816/118905 conn(0x7fd47802c1b0 legacy=0x7fd47802e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:23.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.430+0000 7fd49b5a1700 1 -- 172.21.15.40:0/3757984916 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd4941308d0 msgr2=0x7fd49413a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.430+0000 7fd49b5a1700 1 --2- 172.21.15.40:0/3757984916 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd4941308d0 0x7fd49413a770 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd48c014040 tx=0x7fd48c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.430+0000 7fd49b5a1700 1 -- 172.21.15.40:0/3757984916 shutdown_connections 2023-09-30T22:24:23.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.430+0000 7fd49b5a1700 1 --2- 172.21.15.40:0/3757984916 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd4941308d0 0x7fd49413a770 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.430+0000 7fd49b5a1700 1 --2- 172.21.15.40:0/3757984916 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd49409d450 0x7fd494136b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.430+0000 7fd49b5a1700 1 --2- 172.21.15.40:0/3757984916 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd49409dd60 0x7fd49413a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.430+0000 7fd49b5a1700 1 -- 172.21.15.40:0/3757984916 >> 172.21.15.40:0/3757984916 conn(0x7fd4940a2a00 msgr2=0x7fd4940a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:23.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.430+0000 7fd49b5a1700 1 -- 172.21.15.40:0/3757984916 shutdown_connections 2023-09-30T22:24:23.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:23.430+0000 7fd49b5a1700 1 -- 172.21.15.40:0/3757984916 wait complete. 2023-09-30T22:24:23.443 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705694 for osd.3 2023-09-30T22:24:23.717 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:23.716+0000 7ff0e5d3a240 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-30T22:24:23.843 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:23.842+0000 7ff0e5d3a240 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-30T22:24:24.005 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:24.005+0000 7ff0e5d3a240 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-30T22:24:24.113 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:24.113+0000 7ff0e5d3a240 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-30T22:24:24.197 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:24.196+0000 7ff0643d2700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:24:24.197 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:24.196+0000 7ff0643d2700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:24:24.198 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:24.196+0000 7ff0643d2700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:24:24.198 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:24.196+0000 7ff0643d2700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:24:24.198 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:24.196+0000 7ff0643d2700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:24:24.198 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:24.197+0000 7ff05fbc9700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:24:24.198 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:24.197+0000 7ff05fbc9700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:24:24.198 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:24.197+0000 7ff05fbc9700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:24:24.198 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:24.197+0000 7ff05fbc9700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:24:24.198 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:24.197+0000 7ff05fbc9700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:24:24.229 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:24.279 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:24.307 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:24.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.360+0000 7f718a55a700 1 Processor -- start 2023-09-30T22:24:24.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.360+0000 7f718a55a700 1 -- start start 2023-09-30T22:24:24.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.360+0000 7f718a55a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f718409e400 0x7f7184135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.360+0000 7f718a55a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7184136230 0x7f7184138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.360+0000 7f718a55a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f718409adf0 con 0x7f718409d920 2023-09-30T22:24:24.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.360+0000 7f718a55a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f718409e7f0 con 0x7f7184136230 2023-09-30T22:24:24.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.360+0000 7f718a55a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f718409edf0 con 0x7f718409e400 2023-09-30T22:24:24.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.360+0000 7f71837fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f718409e400 0x7f7184135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.360+0000 7f71837fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f718409e400 0x7f7184135cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:51846/0 (socket says 172.21.15.40:51846) 2023-09-30T22:24:24.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.360+0000 7f71837fe700 1 -- 172.21.15.40:0/138697671 learned_addr learned my addr 172.21.15.40:0/138697671 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:24.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.360+0000 7f7188af7700 1 --2- 172.21.15.40:0/138697671 >> v2:172.21.15.40:3300/0 conn(0x7f7184136230 0x7f7184138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.361+0000 7f7188af7700 1 -- 172.21.15.40:0/138697671 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f718409e400 msgr2=0x7f7184135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:24.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.361+0000 7f7188af7700 1 --2- 172.21.15.40:0/138697671 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f718409e400 0x7f7184135cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.361+0000 7f7188af7700 1 -- 172.21.15.40:0/138697671 >> v1:172.21.15.40:6789/0 conn(0x7f718409d920 legacy=0x7f718409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:24.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.361+0000 7f7188af7700 1 -- 172.21.15.40:0/138697671 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f718409b660 con 0x7f7184136230 2023-09-30T22:24:24.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.361+0000 7f71837fe700 1 --2- 172.21.15.40:0/138697671 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f718409e400 0x7f7184135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:24.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.361+0000 7f7188af7700 1 --2- 172.21.15.40:0/138697671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7184136230 0x7f7184138610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f717c009d90 tx=0x7f717c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=155171e4d6d372b7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:24.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.361+0000 7f7182ffd700 1 -- 172.21.15.40:0/138697671 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c00e070 con 0x7f7184136230 2023-09-30T22:24:24.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.361+0000 7f7182ffd700 1 -- 172.21.15.40:0/138697671 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717c00bae0 con 0x7f7184136230 2023-09-30T22:24:24.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.361+0000 7f7182ffd700 1 -- 172.21.15.40:0/138697671 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c00be90 con 0x7f7184136230 2023-09-30T22:24:24.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.362+0000 7f718a55a700 1 -- 172.21.15.40:0/138697671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7184136230 msgr2=0x7f7184138610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.362+0000 7f718a55a700 1 --2- 172.21.15.40:0/138697671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7184136230 0x7f7184138610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f717c009d90 tx=0x7f717c00b330 comp rx=0 tx=0).stop 2023-09-30T22:24:24.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.362+0000 7f718a55a700 1 -- 172.21.15.40:0/138697671 shutdown_connections 2023-09-30T22:24:24.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.362+0000 7f718a55a700 1 --2- 172.21.15.40:0/138697671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7184136230 0x7f7184138610 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.362+0000 7f718a55a700 1 --2- 172.21.15.40:0/138697671 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f718409e400 0x7f7184135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.362+0000 7f718a55a700 1 -- 172.21.15.40:0/138697671 >> 172.21.15.40:0/138697671 conn(0x7f718409fb20 msgr2=0x7f718409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:24.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.362+0000 7f718a55a700 1 -- 172.21.15.40:0/138697671 shutdown_connections 2023-09-30T22:24:24.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.362+0000 7f718a55a700 1 -- 172.21.15.40:0/138697671 wait complete. 2023-09-30T22:24:24.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.363+0000 7f718a55a700 1 Processor -- start 2023-09-30T22:24:24.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.363+0000 7f718a55a700 1 -- start start 2023-09-30T22:24:24.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.363+0000 7f718a55a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f718409d920 0x7f718411b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.363+0000 7f718a55a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f718409e400 0x7f718411b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.363+0000 7f718a55a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7184136230 0x7f718411be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.363+0000 7f718a55a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718411cf30 con 0x7f7184136230 2023-09-30T22:24:24.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.363+0000 7f718a55a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f718411ec00 con 0x7f718409d920 2023-09-30T22:24:24.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.363+0000 7f718a55a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f718411d7c0 con 0x7f718409e400 2023-09-30T22:24:24.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.364+0000 7f71837fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f718409e400 0x7f718411b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.364+0000 7f71837fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f718409e400 0x7f718411b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:32940/0 (socket says 172.21.15.40:32940) 2023-09-30T22:24:24.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.364+0000 7f71837fe700 1 -- 172.21.15.40:0/3972895837 learned_addr learned my addr 172.21.15.40:0/3972895837 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:24.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.364+0000 7f7188af7700 1 --2- 172.21.15.40:0/3972895837 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7184136230 0x7f718411be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.364+0000 7f7183fff700 1 --2- 172.21.15.40:0/3972895837 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f718409d920 0x7f718411b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.364+0000 7f7188af7700 1 -- 172.21.15.40:0/3972895837 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f718409e400 msgr2=0x7f718411b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.364+0000 7f7188af7700 1 --2- 172.21.15.40:0/3972895837 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f718409e400 0x7f718411b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.364+0000 7f7188af7700 1 -- 172.21.15.40:0/3972895837 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f718409d920 msgr2=0x7f718411b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.364+0000 7f7188af7700 1 --2- 172.21.15.40:0/3972895837 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f718409d920 0x7f718411b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.364+0000 7f7188af7700 1 -- 172.21.15.40:0/3972895837 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7178009550 con 0x7f7184136230 2023-09-30T22:24:24.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.364+0000 7f71837fe700 1 --2- 172.21.15.40:0/3972895837 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f718409e400 0x7f718411b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:24.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.364+0000 7f7188af7700 1 --2- 172.21.15.40:0/3972895837 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7184136230 0x7f718411be30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f717c015000 tx=0x7f717c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:24.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.364+0000 7f7180ff9700 1 -- 172.21.15.40:0/3972895837 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c004540 con 0x7f7184136230 2023-09-30T22:24:24.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.364+0000 7f7180ff9700 1 -- 172.21.15.40:0/3972895837 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717c0046a0 con 0x7f7184136230 2023-09-30T22:24:24.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.364+0000 7f7180ff9700 1 -- 172.21.15.40:0/3972895837 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c012430 con 0x7f7184136230 2023-09-30T22:24:24.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.365+0000 7f718a55a700 1 -- 172.21.15.40:0/3972895837 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f717c009a70 con 0x7f7184136230 2023-09-30T22:24:24.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.365+0000 7f718a55a700 1 -- 172.21.15.40:0/3972895837 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f718411e180 con 0x7f7184136230 2023-09-30T22:24:24.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.366+0000 7f7180ff9700 1 -- 172.21.15.40:0/3972895837 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f717c012590 con 0x7f7184136230 2023-09-30T22:24:24.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.366+0000 7f7180ff9700 1 -- 172.21.15.40:0/3972895837 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4100+0+0 (secure 0 0 0) 0x7f717c041290 con 0x7f7184136230 2023-09-30T22:24:24.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.366+0000 7f718a55a700 1 -- 172.21.15.40:0/3972895837 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7184070700 con 0x7f7184136230 2023-09-30T22:24:24.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.375+0000 7f7180ff9700 1 -- 172.21.15.40:0/3972895837 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f717c008980 con 0x7f7184136230 2023-09-30T22:24:24.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.409+0000 7f45a7e13700 1 Processor -- start 2023-09-30T22:24:24.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.409+0000 7f45a7e13700 1 -- start start 2023-09-30T22:24:24.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.409+0000 7f45a7e13700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45a009d920 0x7f45a009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.410+0000 7f45a7e13700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f45a009f0f0 0x7f45a009e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.410+0000 7f45a7e13700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f45a0133ca0 0x7f45a0134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.410+0000 7f45a7e13700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a006b4c0 con 0x7f45a009f0f0 2023-09-30T22:24:24.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.410+0000 7f45a7e13700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a009a8f0 con 0x7f45a009d920 2023-09-30T22:24:24.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.410+0000 7f45a7e13700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45a009f940 con 0x7f45a0133ca0 2023-09-30T22:24:24.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.410+0000 7f45a53ae700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f45a009f0f0 0x7f45a009e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.410+0000 7f45a5baf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45a009d920 0x7f45a009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.410+0000 7f45a63b0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f45a0133ca0 0x7f45a0134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.410+0000 7f45a53ae700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f45a009f0f0 0x7f45a009e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46258/0 (socket says 172.21.15.40:46258) 2023-09-30T22:24:24.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.410+0000 7f45a53ae700 1 -- 172.21.15.40:0/2435456807 learned_addr learned my addr 172.21.15.40:0/2435456807 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:24.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.410+0000 7f45a5baf700 1 -- 172.21.15.40:0/2435456807 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f45a0133ca0 msgr2=0x7f45a0134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:24.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.410+0000 7f45a5baf700 1 --2- 172.21.15.40:0/2435456807 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f45a0133ca0 0x7f45a0134140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.410+0000 7f45a5baf700 1 -- 172.21.15.40:0/2435456807 >> v2:172.21.15.40:3300/0 conn(0x7f45a009f0f0 msgr2=0x7f45a009e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:24.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.410+0000 7f45a5baf700 1 --2- 172.21.15.40:0/2435456807 >> v2:172.21.15.40:3300/0 conn(0x7f45a009f0f0 0x7f45a009e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.410+0000 7f45a5baf700 1 -- 172.21.15.40:0/2435456807 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a009f6e0 con 0x7f45a009d920 2023-09-30T22:24:24.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.410+0000 7f45a53ae700 1 --2- 172.21.15.40:0/2435456807 >> v2:172.21.15.40:3300/0 conn(0x7f45a009f0f0 0x7f45a009e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:24.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.410+0000 7f45a63b0700 1 --2- 172.21.15.40:0/2435456807 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f45a0133ca0 0x7f45a0134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:24.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.410+0000 7f45a5baf700 1 --2- 172.21.15.40:0/2435456807 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45a009d920 0x7f45a009dcf0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f459c009880 tx=0x7f459c009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b171c34881f5ee4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:24.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.410+0000 7f45a4bad700 1 -- 172.21.15.40:0/2435456807 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c005e30 con 0x7f45a009d920 2023-09-30T22:24:24.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.411+0000 7f45a4bad700 1 -- 172.21.15.40:0/2435456807 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459c006030 con 0x7f45a009d920 2023-09-30T22:24:24.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.411+0000 7f45a4bad700 1 -- 172.21.15.40:0/2435456807 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c0063c0 con 0x7f45a009d920 2023-09-30T22:24:24.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.411+0000 7f45a7e13700 1 -- 172.21.15.40:0/2435456807 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45a009d920 msgr2=0x7f45a009dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.411+0000 7f45a7e13700 1 --2- 172.21.15.40:0/2435456807 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45a009d920 0x7f45a009dcf0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f459c009880 tx=0x7f459c009b90 comp rx=0 tx=0).stop 2023-09-30T22:24:24.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.411+0000 7f45a7e13700 1 -- 172.21.15.40:0/2435456807 shutdown_connections 2023-09-30T22:24:24.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.411+0000 7f45a7e13700 1 --2- 172.21.15.40:0/2435456807 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f45a0133ca0 0x7f45a0134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.411+0000 7f45a7e13700 1 --2- 172.21.15.40:0/2435456807 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45a009d920 0x7f45a009dcf0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.411+0000 7f45a7e13700 1 --2- 172.21.15.40:0/2435456807 >> v2:172.21.15.40:3300/0 conn(0x7f45a009f0f0 0x7f45a009e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.411+0000 7f45a7e13700 1 -- 172.21.15.40:0/2435456807 >> 172.21.15.40:0/2435456807 conn(0x7f45a009fb20 msgr2=0x7f45a009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:24.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.411+0000 7f45a7e13700 1 -- 172.21.15.40:0/2435456807 shutdown_connections 2023-09-30T22:24:24.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.411+0000 7f45a7e13700 1 -- 172.21.15.40:0/2435456807 wait complete. 2023-09-30T22:24:24.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.412+0000 7f45a7e13700 1 Processor -- start 2023-09-30T22:24:24.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.412+0000 7f45a7e13700 1 -- start start 2023-09-30T22:24:24.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.413+0000 7f45a7e13700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f45a009d920 0x7f45a01218a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.413+0000 7f45a7e13700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45a0133ca0 0x7f45a0121de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.413+0000 7f45a7e13700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45a0122320 0x7f45a01c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.413+0000 7f45a7e13700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a01251c0 con 0x7f45a0133ca0 2023-09-30T22:24:24.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.413+0000 7f45a7e13700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a01253c0 con 0x7f45a0122320 2023-09-30T22:24:24.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.413+0000 7f45a7e13700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45a0132c40 con 0x7f45a009d920 2023-09-30T22:24:24.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.413+0000 7f45a53ae700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45a0133ca0 0x7f45a0121de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.413+0000 7f45a53ae700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45a0133ca0 0x7f45a0121de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46266/0 (socket says 172.21.15.40:46266) 2023-09-30T22:24:24.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.413+0000 7f45a53ae700 1 -- 172.21.15.40:0/2518315284 learned_addr learned my addr 172.21.15.40:0/2518315284 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:24.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.413+0000 7f45a63b0700 1 --2- 172.21.15.40:0/2518315284 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45a0122320 0x7f45a01c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.413+0000 7f45a5baf700 1 --2- 172.21.15.40:0/2518315284 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f45a009d920 0x7f45a01218a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.413+0000 7f45a53ae700 1 -- 172.21.15.40:0/2518315284 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f45a009d920 msgr2=0x7f45a01218a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.413+0000 7f45a53ae700 1 --2- 172.21.15.40:0/2518315284 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f45a009d920 0x7f45a01218a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.413+0000 7f45a53ae700 1 -- 172.21.15.40:0/2518315284 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45a0122320 msgr2=0x7f45a01c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.413+0000 7f45a53ae700 1 --2- 172.21.15.40:0/2518315284 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45a0122320 0x7f45a01c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.413+0000 7f45a53ae700 1 -- 172.21.15.40:0/2518315284 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4590009550 con 0x7f45a0133ca0 2023-09-30T22:24:24.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.413+0000 7f45a63b0700 1 --2- 172.21.15.40:0/2518315284 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45a0122320 0x7f45a01c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:24.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.413+0000 7f45a53ae700 1 --2- 172.21.15.40:0/2518315284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45a0133ca0 0x7f45a0121de0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4590006b20 tx=0x7f459000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:24.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.413+0000 7f45967fc700 1 -- 172.21.15.40:0/2518315284 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4590009e60 con 0x7f45a0133ca0 2023-09-30T22:24:24.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.414+0000 7f45967fc700 1 -- 172.21.15.40:0/2518315284 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4590004240 con 0x7f45a0133ca0 2023-09-30T22:24:24.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.414+0000 7f45a7e13700 1 -- 172.21.15.40:0/2518315284 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4598009a70 con 0x7f45a0133ca0 2023-09-30T22:24:24.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.414+0000 7f45967fc700 1 -- 172.21.15.40:0/2518315284 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45900036a0 con 0x7f45a0133ca0 2023-09-30T22:24:24.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.414+0000 7f45a7e13700 1 -- 172.21.15.40:0/2518315284 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f459c009430 con 0x7f45a0133ca0 2023-09-30T22:24:24.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.414+0000 7f45967fc700 1 -- 172.21.15.40:0/2518315284 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f4590003800 con 0x7f45a0133ca0 2023-09-30T22:24:24.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.415+0000 7f45967fc700 1 -- 172.21.15.40:0/2518315284 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4100+0+0 (secure 0 0 0) 0x7f459003f710 con 0x7f45a0133ca0 2023-09-30T22:24:24.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.415+0000 7f45a7e13700 1 -- 172.21.15.40:0/2518315284 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a009ca40 con 0x7f45a0133ca0 2023-09-30T22:24:24.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.419+0000 7f45967fc700 1 -- 172.21.15.40:0/2518315284 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f459000c640 con 0x7f45a0133ca0 2023-09-30T22:24:24.444 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:24.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.478+0000 7fec5b8d7700 1 Processor -- start 2023-09-30T22:24:24.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.478+0000 7fec5b8d7700 1 -- start start 2023-09-30T22:24:24.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.479+0000 7fec5b8d7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec5409d920 0x7fec5409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.479+0000 7fec5b8d7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fec5409f0f0 0x7fec5409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.479+0000 7fec5b8d7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fec54133ca0 0x7fec54134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.479+0000 7fec5b8d7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec5406b4c0 con 0x7fec5409f0f0 2023-09-30T22:24:24.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.479+0000 7fec5b8d7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5409a8f0 con 0x7fec5409d920 2023-09-30T22:24:24.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.479+0000 7fec5b8d7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec5409f940 con 0x7fec54133ca0 2023-09-30T22:24:24.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.479+0000 7fec58e72700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fec5409f0f0 0x7fec5409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.479+0000 7fec58e72700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fec5409f0f0 0x7fec5409e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46268/0 (socket says 172.21.15.40:46268) 2023-09-30T22:24:24.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.479+0000 7fec59e74700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fec54133ca0 0x7fec54134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.479+0000 7fec58e72700 1 -- 172.21.15.40:0/3575234236 learned_addr learned my addr 172.21.15.40:0/3575234236 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:24.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.479+0000 7fec59673700 1 --2- 172.21.15.40:0/3575234236 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec5409d920 0x7fec5409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.480+0000 7fec58e72700 1 -- 172.21.15.40:0/3575234236 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fec54133ca0 msgr2=0x7fec54134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:24.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.480+0000 7fec58e72700 1 --2- 172.21.15.40:0/3575234236 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fec54133ca0 0x7fec54134140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.480+0000 7fec58e72700 1 -- 172.21.15.40:0/3575234236 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec5409d920 msgr2=0x7fec5409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:24.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.480+0000 7fec58e72700 1 --2- 172.21.15.40:0/3575234236 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec5409d920 0x7fec5409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.480+0000 7fec58e72700 1 -- 172.21.15.40:0/3575234236 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5409f6e0 con 0x7fec5409f0f0 2023-09-30T22:24:24.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.480+0000 7fec58e72700 1 --2- 172.21.15.40:0/3575234236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec5409f0f0 0x7fec5409e230 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fec44009920 tx=0x7fec44009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5960fede7876ea18 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:24.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.480+0000 7fec4bfff700 1 -- 172.21.15.40:0/3575234236 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec44011830 con 0x7fec5409f0f0 2023-09-30T22:24:24.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.480+0000 7fec4bfff700 1 -- 172.21.15.40:0/3575234236 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec44011990 con 0x7fec5409f0f0 2023-09-30T22:24:24.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.480+0000 7fec4bfff700 1 -- 172.21.15.40:0/3575234236 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec44011d20 con 0x7fec5409f0f0 2023-09-30T22:24:24.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.481+0000 7fec5b8d7700 1 -- 172.21.15.40:0/3575234236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec5409f0f0 msgr2=0x7fec5409e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.481+0000 7fec5b8d7700 1 --2- 172.21.15.40:0/3575234236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec5409f0f0 0x7fec5409e230 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fec44009920 tx=0x7fec44009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:24.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.481+0000 7fec5b8d7700 1 -- 172.21.15.40:0/3575234236 shutdown_connections 2023-09-30T22:24:24.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.481+0000 7fec5b8d7700 1 --2- 172.21.15.40:0/3575234236 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fec54133ca0 0x7fec54134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.481+0000 7fec5b8d7700 1 --2- 172.21.15.40:0/3575234236 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec5409d920 0x7fec5409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.481+0000 7fec5b8d7700 1 --2- 172.21.15.40:0/3575234236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec5409f0f0 0x7fec5409e230 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.481+0000 7fec5b8d7700 1 -- 172.21.15.40:0/3575234236 >> 172.21.15.40:0/3575234236 conn(0x7fec5409fb20 msgr2=0x7fec5409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:24.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.481+0000 7fec5b8d7700 1 -- 172.21.15.40:0/3575234236 shutdown_connections 2023-09-30T22:24:24.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.481+0000 7fec5b8d7700 1 -- 172.21.15.40:0/3575234236 wait complete. 2023-09-30T22:24:24.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.482+0000 7fec5b8d7700 1 Processor -- start 2023-09-30T22:24:24.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.482+0000 7fec5b8d7700 1 -- start start 2023-09-30T22:24:24.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.483+0000 7fec5b8d7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec5409d920 0x7fec54122b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.483+0000 7fec5b8d7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fec54133ca0 0x7fec54123040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.483+0000 7fec5b8d7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec54123580 0x7fec541c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.483+0000 7fec5b8d7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec54126160 con 0x7fec54123580 2023-09-30T22:24:24.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.483+0000 7fec5b8d7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec541239c0 con 0x7fec5409d920 2023-09-30T22:24:24.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.483+0000 7fec5b8d7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec540a2c60 con 0x7fec54133ca0 2023-09-30T22:24:24.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.483+0000 7fec59673700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec5409d920 0x7fec54122b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.483+0000 7fec59673700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec5409d920 0x7fec54122b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:51904/0 (socket says 172.21.15.40:51904) 2023-09-30T22:24:24.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.483+0000 7fec59673700 1 -- 172.21.15.40:0/3706145125 learned_addr learned my addr 172.21.15.40:0/3706145125 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:24.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.483+0000 7fec58e72700 1 --2- 172.21.15.40:0/3706145125 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fec54133ca0 0x7fec54123040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.483+0000 7fec59e74700 1 --2- 172.21.15.40:0/3706145125 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec54123580 0x7fec541c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.484+0000 7fec58e72700 1 -- 172.21.15.40:0/3706145125 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec5409d920 msgr2=0x7fec54122b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.484+0000 7fec58e72700 1 --2- 172.21.15.40:0/3706145125 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec5409d920 0x7fec54122b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.484+0000 7fec58e72700 1 -- 172.21.15.40:0/3706145125 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec54123580 msgr2=0x7fec541c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.484+0000 7fec58e72700 1 --2- 172.21.15.40:0/3706145125 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec54123580 0x7fec541c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.484+0000 7fec58e72700 1 -- 172.21.15.40:0/3706145125 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec44009550 con 0x7fec54133ca0 2023-09-30T22:24:24.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.484+0000 7fec58e72700 1 --2- 172.21.15.40:0/3706145125 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fec54133ca0 0x7fec54123040 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fec44016000 tx=0x7fec44004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:24.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.484+0000 7fec49ffb700 1 -- 172.21.15.40:0/3706145125 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec44004240 con 0x7fec54133ca0 2023-09-30T22:24:24.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.484+0000 7fec49ffb700 1 -- 172.21.15.40:0/3706145125 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4401f070 con 0x7fec54133ca0 2023-09-30T22:24:24.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.484+0000 7fec5b8d7700 1 -- 172.21.15.40:0/3706145125 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec541247b0 con 0x7fec54133ca0 2023-09-30T22:24:24.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.484+0000 7fec49ffb700 1 -- 172.21.15.40:0/3706145125 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec440036a0 con 0x7fec54133ca0 2023-09-30T22:24:24.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.484+0000 7fec5b8d7700 1 -- 172.21.15.40:0/3706145125 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec54133a50 con 0x7fec54133ca0 2023-09-30T22:24:24.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.485+0000 7fec49ffb700 1 -- 172.21.15.40:0/3706145125 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7fec44021030 con 0x7fec54133ca0 2023-09-30T22:24:24.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.486+0000 7fec5b8d7700 1 -- 172.21.15.40:0/3706145125 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec54068040 con 0x7fec54133ca0 2023-09-30T22:24:24.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.486+0000 7fec49ffb700 1 -- 172.21.15.40:0/3706145125 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4100+0+0 (secure 0 0 0) 0x7fec44040520 con 0x7fec54133ca0 2023-09-30T22:24:24.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.494+0000 7fec49ffb700 1 -- 172.21.15.40:0/3706145125 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fec440199a0 con 0x7fec54133ca0 2023-09-30T22:24:24.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.578+0000 7f718a55a700 1 -- 172.21.15.40:0/3972895837 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f718409cb00 con 0x7f7184136230 2023-09-30T22:24:24.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.578+0000 7f430e0e3700 1 Processor -- start 2023-09-30T22:24:24.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.578+0000 7f430e0e3700 1 -- start start 2023-09-30T22:24:24.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.578+0000 7f7180ff9700 1 -- 172.21.15.40:0/3972895837 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f717c02a020 con 0x7f7184136230 2023-09-30T22:24:24.580 INFO:teuthology.orchestra.run.smithi040.stdout:38654705694 2023-09-30T22:24:24.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.579+0000 7f430e0e3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f430809d450 0x7f430809d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.579+0000 7f430e0e3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f43081308d0 0x7f4308138420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.579+0000 7f430e0e3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f430809c3b0 con 0x7f430809dd60 2023-09-30T22:24:24.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.579+0000 7f430e0e3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f430809a6b0 con 0x7f43081308d0 2023-09-30T22:24:24.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.579+0000 7f430e0e3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f430809b4f0 con 0x7f430809d450 2023-09-30T22:24:24.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.579+0000 7f4306ffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f430809dd60 0x7f43081301c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40146/0 (socket says 172.21.15.40:40146) 2023-09-30T22:24:24.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.579+0000 7f43077fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f430809d450 0x7f430809d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.579+0000 7f4306ffd700 1 -- 172.21.15.40:0/3227108426 learned_addr learned my addr 172.21.15.40:0/3227108426 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:24:24.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.579+0000 7f4307fff700 1 --2- 172.21.15.40:0/3227108426 >> v2:172.21.15.40:3300/0 conn(0x7f43081308d0 0x7f4308138420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.579+0000 7f4307fff700 1 -- 172.21.15.40:0/3227108426 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f430809d450 msgr2=0x7f430809d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:24.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.579+0000 7f4307fff700 1 --2- 172.21.15.40:0/3227108426 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f430809d450 0x7f430809d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.579+0000 7f4307fff700 1 -- 172.21.15.40:0/3227108426 >> v1:172.21.15.40:6789/0 conn(0x7f430809dd60 legacy=0x7f43081301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.579+0000 7f43067fc700 1 -- 172.21.15.40:0/3227108426 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3561499562 0 0) 0x7f430809c3b0 con 0x7f430809dd60 2023-09-30T22:24:24.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.579+0000 7f4307fff700 1 -- 172.21.15.40:0/3227108426 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f430809af90 con 0x7f43081308d0 2023-09-30T22:24:24.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.580+0000 7f4307fff700 1 --2- 172.21.15.40:0/3227108426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43081308d0 0x7f4308138420 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4300009d90 tx=0x7f430000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9306497ab7a5b9f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:24.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.580+0000 7f43067fc700 1 -- 172.21.15.40:0/3227108426 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430000e070 con 0x7f43081308d0 2023-09-30T22:24:24.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.580+0000 7f43067fc700 1 -- 172.21.15.40:0/3227108426 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f430000bb20 con 0x7f43081308d0 2023-09-30T22:24:24.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.580+0000 7f43067fc700 1 -- 172.21.15.40:0/3227108426 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4300012430 con 0x7f43081308d0 2023-09-30T22:24:24.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.580+0000 7f430e0e3700 1 -- 172.21.15.40:0/3227108426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43081308d0 msgr2=0x7f4308138420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.580+0000 7f430e0e3700 1 --2- 172.21.15.40:0/3227108426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43081308d0 0x7f4308138420 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4300009d90 tx=0x7f430000b330 comp rx=0 tx=0).stop 2023-09-30T22:24:24.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.581+0000 7f430e0e3700 1 -- 172.21.15.40:0/3227108426 shutdown_connections 2023-09-30T22:24:24.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.581+0000 7f430e0e3700 1 --2- 172.21.15.40:0/3227108426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43081308d0 0x7f4308138420 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.581+0000 7f430e0e3700 1 --2- 172.21.15.40:0/3227108426 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f430809d450 0x7f430809d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.581+0000 7f430e0e3700 1 -- 172.21.15.40:0/3227108426 >> 172.21.15.40:0/3227108426 conn(0x7f43080a2a00 msgr2=0x7f43080a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:24.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.581+0000 7f430e0e3700 1 -- 172.21.15.40:0/3227108426 shutdown_connections 2023-09-30T22:24:24.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.581+0000 7f430e0e3700 1 -- 172.21.15.40:0/3227108426 wait complete. 2023-09-30T22:24:24.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.581+0000 7f718a55a700 1 -- 172.21.15.40:0/3972895837 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7184136230 msgr2=0x7f718411be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.581+0000 7f718a55a700 1 --2- 172.21.15.40:0/3972895837 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7184136230 0x7f718411be30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f717c015000 tx=0x7f717c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.582+0000 7f718a55a700 1 -- 172.21.15.40:0/3972895837 shutdown_connections 2023-09-30T22:24:24.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.582+0000 7f718a55a700 1 --2- 172.21.15.40:0/3972895837 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7184136230 0x7f718411be30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.582+0000 7f718a55a700 1 --2- 172.21.15.40:0/3972895837 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f718409d920 0x7f718411b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.582+0000 7f718a55a700 1 --2- 172.21.15.40:0/3972895837 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f718409e400 0x7f718411b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.582+0000 7f718a55a700 1 -- 172.21.15.40:0/3972895837 >> 172.21.15.40:0/3972895837 conn(0x7f718409fb20 msgr2=0x7f71841393a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:24.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.582+0000 7f430e0e3700 1 Processor -- start 2023-09-30T22:24:24.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.582+0000 7f430e0e3700 1 -- start start 2023-09-30T22:24:24.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.583+0000 7f430e0e3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f430809d450 0x7f43081c8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.583+0000 7f430e0e3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f430809dd60 0x7f43081c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.583+0000 7f430e0e3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43081308d0 0x7f43081c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.583+0000 7f430e0e3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4308122ef0 con 0x7f430809d450 2023-09-30T22:24:24.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.583+0000 7f430e0e3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43081221f0 con 0x7f43081308d0 2023-09-30T22:24:24.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.583+0000 7f430e0e3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f430809c5d0 con 0x7f430809dd60 2023-09-30T22:24:24.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.583+0000 7f43077fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f430809d450 0x7f43081c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.583+0000 7f43077fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f430809d450 0x7f43081c8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46292/0 (socket says 172.21.15.40:46292) 2023-09-30T22:24:24.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.583+0000 7f43077fe700 1 -- 172.21.15.40:0/3167164501 learned_addr learned my addr 172.21.15.40:0/3167164501 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:24.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.583+0000 7f4307fff700 1 --2- 172.21.15.40:0/3167164501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43081308d0 0x7f43081c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.583+0000 7f4306ffd700 1 --2- 172.21.15.40:0/3167164501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f430809dd60 0x7f43081c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.583+0000 7f43077fe700 1 -- 172.21.15.40:0/3167164501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f430809dd60 msgr2=0x7f43081c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.583+0000 7f43077fe700 1 --2- 172.21.15.40:0/3167164501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f430809dd60 0x7f43081c8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.583+0000 7f43077fe700 1 -- 172.21.15.40:0/3167164501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43081308d0 msgr2=0x7f43081c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.583+0000 7f43077fe700 1 --2- 172.21.15.40:0/3167164501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43081308d0 0x7f43081c8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.583+0000 7f43077fe700 1 -- 172.21.15.40:0/3167164501 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4300009a70 con 0x7f430809d450 2023-09-30T22:24:24.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.583+0000 7f43077fe700 1 --2- 172.21.15.40:0/3167164501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f430809d450 0x7f43081c8320 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f42f800e940 tx=0x7f42f800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:24.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.583+0000 7f42effff700 1 -- 172.21.15.40:0/3167164501 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f800c900 con 0x7f430809d450 2023-09-30T22:24:24.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.583+0000 7f42effff700 1 -- 172.21.15.40:0/3167164501 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f800ca60 con 0x7f430809d450 2023-09-30T22:24:24.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.583+0000 7f430e0e3700 1 -- 172.21.15.40:0/3167164501 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43081211e0 con 0x7f430809d450 2023-09-30T22:24:24.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.584+0000 7f42effff700 1 -- 172.21.15.40:0/3167164501 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f800cdf0 con 0x7f430809d450 2023-09-30T22:24:24.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.584+0000 7f430e0e3700 1 -- 172.21.15.40:0/3167164501 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4308123880 con 0x7f430809d450 2023-09-30T22:24:24.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.584+0000 7f718a55a700 1 -- 172.21.15.40:0/3972895837 shutdown_connections 2023-09-30T22:24:24.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.584+0000 7f718a55a700 1 -- 172.21.15.40:0/3972895837 wait complete. 2023-09-30T22:24:24.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.585+0000 7f430e0e3700 1 -- 172.21.15.40:0/3167164501 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4308062380 con 0x7f430809d450 2023-09-30T22:24:24.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.585+0000 7f42effff700 1 -- 172.21.15.40:0/3167164501 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f42f80113f0 con 0x7f430809d450 2023-09-30T22:24:24.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.585+0000 7f42effff700 1 -- 172.21.15.40:0/3167164501 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4100+0+0 (secure 0 0 0) 0x7f42f803f6a0 con 0x7f430809d450 2023-09-30T22:24:24.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.589+0000 7f42effff700 1 -- 172.21.15.40:0/3167164501 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f42f80116a0 con 0x7f430809d450 2023-09-30T22:24:24.601 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705694 for osd.1 2023-09-30T22:24:24.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.608+0000 7f45a7e13700 1 -- 172.21.15.40:0/2518315284 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f45a0062380 con 0x7f45a0133ca0 2023-09-30T22:24:24.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.608+0000 7f45967fc700 1 -- 172.21.15.40:0/2518315284 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4590013e60 con 0x7f45a0133ca0 2023-09-30T22:24:24.609 INFO:teuthology.orchestra.run.smithi040.stdout:38654705694 2023-09-30T22:24:24.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.610+0000 7f45a7e13700 1 -- 172.21.15.40:0/2518315284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45a0133ca0 msgr2=0x7f45a0121de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.610+0000 7f45a7e13700 1 --2- 172.21.15.40:0/2518315284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45a0133ca0 0x7f45a0121de0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4590006b20 tx=0x7f459000ee90 comp rx=0 tx=0).stop 2023-09-30T22:24:24.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.610+0000 7f45a7e13700 1 -- 172.21.15.40:0/2518315284 shutdown_connections 2023-09-30T22:24:24.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.610+0000 7f45a7e13700 1 --2- 172.21.15.40:0/2518315284 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f45a009d920 0x7f45a01218a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.610+0000 7f45a7e13700 1 --2- 172.21.15.40:0/2518315284 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45a0122320 0x7f45a01c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.610+0000 7f45a7e13700 1 --2- 172.21.15.40:0/2518315284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45a0133ca0 0x7f45a0121de0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.610+0000 7f45a7e13700 1 -- 172.21.15.40:0/2518315284 >> 172.21.15.40:0/2518315284 conn(0x7f45a009fb20 msgr2=0x7f45a00a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:24.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.610+0000 7f45a7e13700 1 -- 172.21.15.40:0/2518315284 shutdown_connections 2023-09-30T22:24:24.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.610+0000 7f45a7e13700 1 -- 172.21.15.40:0/2518315284 wait complete. 2023-09-30T22:24:24.623 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705694 for osd.2 2023-09-30T22:24:24.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.680+0000 7fec5b8d7700 1 -- 172.21.15.40:0/3706145125 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fec54062380 con 0x7fec54133ca0 2023-09-30T22:24:24.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.680+0000 7fec49ffb700 1 -- 172.21.15.40:0/3706145125 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fec44015070 con 0x7fec54133ca0 2023-09-30T22:24:24.681 INFO:teuthology.orchestra.run.smithi040.stdout:38654705694 2023-09-30T22:24:24.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.682+0000 7fec5b8d7700 1 -- 172.21.15.40:0/3706145125 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fec54133ca0 msgr2=0x7fec54123040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.682+0000 7fec5b8d7700 1 --2- 172.21.15.40:0/3706145125 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fec54133ca0 0x7fec54123040 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fec44016000 tx=0x7fec44004750 comp rx=0 tx=0).stop 2023-09-30T22:24:24.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.682+0000 7fec5b8d7700 1 -- 172.21.15.40:0/3706145125 shutdown_connections 2023-09-30T22:24:24.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.682+0000 7fec5b8d7700 1 --2- 172.21.15.40:0/3706145125 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec54123580 0x7fec541c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.682+0000 7fec5b8d7700 1 --2- 172.21.15.40:0/3706145125 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec5409d920 0x7fec54122b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.682+0000 7fec5b8d7700 1 --2- 172.21.15.40:0/3706145125 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fec54133ca0 0x7fec54123040 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.682+0000 7fec5b8d7700 1 -- 172.21.15.40:0/3706145125 >> 172.21.15.40:0/3706145125 conn(0x7fec5409fb20 msgr2=0x7fec540a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:24.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.682+0000 7fec5b8d7700 1 -- 172.21.15.40:0/3706145125 shutdown_connections 2023-09-30T22:24:24.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.682+0000 7fec5b8d7700 1 -- 172.21.15.40:0/3706145125 wait complete. 2023-09-30T22:24:24.695 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705694 for osd.0 2023-09-30T22:24:24.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.764+0000 7f430e0e3700 1 -- 172.21.15.40:0/3167164501 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4308074330 con 0x7f430809d450 2023-09-30T22:24:24.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.764+0000 7f42effff700 1 -- 172.21.15.40:0/3167164501 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f42f801a3b0 con 0x7f430809d450 2023-09-30T22:24:24.765 INFO:teuthology.orchestra.run.smithi040.stdout:38654705694 2023-09-30T22:24:24.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.766+0000 7f430e0e3700 1 -- 172.21.15.40:0/3167164501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f430809d450 msgr2=0x7f43081c8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.766+0000 7f430e0e3700 1 --2- 172.21.15.40:0/3167164501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f430809d450 0x7f43081c8320 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f42f800e940 tx=0x7f42f800ec50 comp rx=0 tx=0).stop 2023-09-30T22:24:24.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.766+0000 7f430e0e3700 1 -- 172.21.15.40:0/3167164501 shutdown_connections 2023-09-30T22:24:24.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.766+0000 7f430e0e3700 1 --2- 172.21.15.40:0/3167164501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43081308d0 0x7f43081c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.766+0000 7f430e0e3700 1 --2- 172.21.15.40:0/3167164501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f430809d450 0x7f43081c8320 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.766+0000 7f430e0e3700 1 --2- 172.21.15.40:0/3167164501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f430809dd60 0x7f43081c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.766+0000 7f430e0e3700 1 -- 172.21.15.40:0/3167164501 >> 172.21.15.40:0/3167164501 conn(0x7f43080a2a00 msgr2=0x7f43081b7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:24.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.766+0000 7f430e0e3700 1 -- 172.21.15.40:0/3167164501 shutdown_connections 2023-09-30T22:24:24.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:24.766+0000 7f430e0e3700 1 -- 172.21.15.40:0/3167164501 wait complete. 2023-09-30T22:24:24.778 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705694 for osd.3 2023-09-30T22:24:25.140 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:25.139+0000 7ff0a7155700 -1 mgr.server handle_report got status from non-daemon mon.a 2023-09-30T22:24:25.141 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:25.141+0000 7ff0a7155700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-09-30T22:24:25.144 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:25.144+0000 7ff0a7155700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-09-30T22:24:25.602 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:25.623 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:25.696 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:25.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.749+0000 7f65b759e700 1 Processor -- start 2023-09-30T22:24:25.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.749+0000 7f65b759e700 1 -- start start 2023-09-30T22:24:25.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.750+0000 7f65b759e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65b809d8b0 0x7f65b809dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.750+0000 7f65b759e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f65b809e1c0 0x7f65b8130770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.750+0000 7f65b759e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f65b8130cb0 0x7f65b8131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.750+0000 7f65b759e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65b809f2f0 con 0x7f65b8130cb0 2023-09-30T22:24:25.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.750+0000 7f65b759e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b809b160 con 0x7f65b809d8b0 2023-09-30T22:24:25.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.750+0000 7f65b759e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65b809ab30 con 0x7f65b809e1c0 2023-09-30T22:24:25.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.750+0000 7f65b5d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f65b809e1c0 0x7f65b8130770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.750+0000 7f65b659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65b809d8b0 0x7f65b809dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.750+0000 7f65b6d9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f65b8130cb0 0x7f65b8131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.750+0000 7f65b5d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f65b809e1c0 0x7f65b8130770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:32998/0 (socket says 172.21.15.40:32998) 2023-09-30T22:24:25.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.750+0000 7f65b5d9b700 1 -- 172.21.15.40:0/484998109 learned_addr learned my addr 172.21.15.40:0/484998109 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:25.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.750+0000 7f65b5d9b700 1 -- 172.21.15.40:0/484998109 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65b809d8b0 msgr2=0x7f65b809dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:25.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.750+0000 7f65b5d9b700 1 --2- 172.21.15.40:0/484998109 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65b809d8b0 0x7f65b809dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.750+0000 7f65b5d9b700 1 -- 172.21.15.40:0/484998109 >> v2:172.21.15.40:3300/0 conn(0x7f65b8130cb0 msgr2=0x7f65b8131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:25.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.750+0000 7f65b5d9b700 1 --2- 172.21.15.40:0/484998109 >> v2:172.21.15.40:3300/0 conn(0x7f65b8130cb0 0x7f65b8131130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.750+0000 7f65b5d9b700 1 -- 172.21.15.40:0/484998109 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b809c700 con 0x7f65b809e1c0 2023-09-30T22:24:25.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.750+0000 7f65b659c700 1 --2- 172.21.15.40:0/484998109 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65b809d8b0 0x7f65b809dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:25.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.750+0000 7f65b6d9d700 1 --2- 172.21.15.40:0/484998109 >> v2:172.21.15.40:3300/0 conn(0x7f65b8130cb0 0x7f65b8131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:25.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.751+0000 7f65b5d9b700 1 --2- 172.21.15.40:0/484998109 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f65b809e1c0 0x7f65b8130770 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f65ac00bb90 tx=0x7f65ac00bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12ce340e743ecca2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:25.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.751+0000 7f65b559a700 1 -- 172.21.15.40:0/484998109 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac00dd30 con 0x7f65b809e1c0 2023-09-30T22:24:25.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.751+0000 7f65b559a700 1 -- 172.21.15.40:0/484998109 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ac00de90 con 0x7f65b809e1c0 2023-09-30T22:24:25.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.751+0000 7f65b559a700 1 -- 172.21.15.40:0/484998109 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac010690 con 0x7f65b809e1c0 2023-09-30T22:24:25.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.752+0000 7f65b759e700 1 -- 172.21.15.40:0/484998109 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f65b809e1c0 msgr2=0x7f65b8130770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.752+0000 7f65b759e700 1 --2- 172.21.15.40:0/484998109 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f65b809e1c0 0x7f65b8130770 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f65ac00bb90 tx=0x7f65ac00bea0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.752+0000 7f65b759e700 1 -- 172.21.15.40:0/484998109 shutdown_connections 2023-09-30T22:24:25.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.752+0000 7f65b759e700 1 --2- 172.21.15.40:0/484998109 >> v2:172.21.15.40:3300/0 conn(0x7f65b8130cb0 0x7f65b8131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.752+0000 7f65b759e700 1 --2- 172.21.15.40:0/484998109 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65b809d8b0 0x7f65b809dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.752+0000 7f65b759e700 1 --2- 172.21.15.40:0/484998109 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f65b809e1c0 0x7f65b8130770 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.752+0000 7f65b759e700 1 -- 172.21.15.40:0/484998109 >> 172.21.15.40:0/484998109 conn(0x7f65b80a2fb0 msgr2=0x7f65b80a33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:25.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.752+0000 7f65b759e700 1 -- 172.21.15.40:0/484998109 shutdown_connections 2023-09-30T22:24:25.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.752+0000 7f65b759e700 1 -- 172.21.15.40:0/484998109 wait complete. 2023-09-30T22:24:25.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.753+0000 7f65b759e700 1 Processor -- start 2023-09-30T22:24:25.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.753+0000 7f65b759e700 1 -- start start 2023-09-30T22:24:25.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.753+0000 7f65b759e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f65b809d8b0 0x7f65b811bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.753+0000 7f65b759e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b809e1c0 0x7f65b811c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.753+0000 7f65b759e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65b8130cb0 0x7f65b811c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.753+0000 7f65b759e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b811db00 con 0x7f65b809e1c0 2023-09-30T22:24:25.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.753+0000 7f65b759e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b811ed50 con 0x7f65b8130cb0 2023-09-30T22:24:25.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.753+0000 7f65b759e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65b811e0f0 con 0x7f65b809d8b0 2023-09-30T22:24:25.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.753+0000 7f65b5d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b809e1c0 0x7f65b811c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.753+0000 7f65b659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f65b809d8b0 0x7f65b811bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.754+0000 7f65b5d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b809e1c0 0x7f65b811c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46310/0 (socket says 172.21.15.40:46310) 2023-09-30T22:24:25.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.754+0000 7f65b659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f65b809d8b0 0x7f65b811bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33014/0 (socket says 172.21.15.40:33014) 2023-09-30T22:24:25.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.754+0000 7f65b5d9b700 1 -- 172.21.15.40:0/3418917795 learned_addr learned my addr 172.21.15.40:0/3418917795 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:25.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.754+0000 7f65b659c700 1 -- 172.21.15.40:0/3418917795 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65b8130cb0 msgr2=0x7f65b811c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.754+0000 7f65b659c700 1 --2- 172.21.15.40:0/3418917795 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65b8130cb0 0x7f65b811c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.754+0000 7f65b659c700 1 -- 172.21.15.40:0/3418917795 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b809e1c0 msgr2=0x7f65b811c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.754+0000 7f65b659c700 1 --2- 172.21.15.40:0/3418917795 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b809e1c0 0x7f65b811c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.754+0000 7f65b659c700 1 -- 172.21.15.40:0/3418917795 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a80094a0 con 0x7f65b809d8b0 2023-09-30T22:24:25.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.754+0000 7f65b5d9b700 1 --2- 172.21.15.40:0/3418917795 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b809e1c0 0x7f65b811c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:25.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.754+0000 7f65b659c700 1 --2- 172.21.15.40:0/3418917795 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f65b809d8b0 0x7f65b811bef0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f65a8010cf0 tx=0x7f65a800b140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:25.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.754+0000 7f65a6ffd700 1 -- 172.21.15.40:0/3418917795 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a8015070 con 0x7f65b809d8b0 2023-09-30T22:24:25.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.754+0000 7f65a6ffd700 1 -- 172.21.15.40:0/3418917795 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a800ba00 con 0x7f65b809d8b0 2023-09-30T22:24:25.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.754+0000 7f65a6ffd700 1 -- 172.21.15.40:0/3418917795 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a800bd90 con 0x7f65b809d8b0 2023-09-30T22:24:25.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.754+0000 7f65b759e700 1 -- 172.21.15.40:0/3418917795 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b0009a70 con 0x7f65b809d8b0 2023-09-30T22:24:25.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.754+0000 7f65b759e700 1 -- 172.21.15.40:0/3418917795 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65ac00b7f0 con 0x7f65b809d8b0 2023-09-30T22:24:25.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.755+0000 7f65a6ffd700 1 -- 172.21.15.40:0/3418917795 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f65a8019410 con 0x7f65b809d8b0 2023-09-30T22:24:25.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.755+0000 7f65b759e700 1 -- 172.21.15.40:0/3418917795 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65b809c920 con 0x7f65b809d8b0 2023-09-30T22:24:25.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.756+0000 7f65a6ffd700 1 -- 172.21.15.40:0/3418917795 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4083+0+0 (secure 0 0 0) 0x7f65a80430f0 con 0x7f65b809d8b0 2023-09-30T22:24:25.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.765+0000 7f65a6ffd700 1 -- 172.21.15.40:0/3418917795 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f65a8074750 con 0x7f65b809d8b0 2023-09-30T22:24:25.779 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:25.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.789+0000 7f2dd2c88700 1 Processor -- start 2023-09-30T22:24:25.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.790+0000 7f2dd2c88700 1 -- start start 2023-09-30T22:24:25.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.790+0000 7f2dd2c88700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2dcc09c890 0x7f2dcc09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.790+0000 7f2dd2c88700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2dcc09d920 0x7f2dcc09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.790+0000 7f2dd2c88700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2dcc09e2b0 0x7f2dcc13ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.790+0000 7f2dd2c88700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dcc0a29d0 con 0x7f2dcc09c890 2023-09-30T22:24:25.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.790+0000 7f2dd2c88700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc09fb40 con 0x7f2dcc09d920 2023-09-30T22:24:25.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.790+0000 7f2dd2c88700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc0a2600 con 0x7f2dcc09e2b0 2023-09-30T22:24:25.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.790+0000 7f2dcbfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2dcc09d920 0x7f2dcc09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.790+0000 7f2dcbfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2dcc09d920 0x7f2dcc09dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:51938/0 (socket says 172.21.15.40:51938) 2023-09-30T22:24:25.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.790+0000 7f2dcbfff700 1 -- 172.21.15.40:0/1671075260 learned_addr learned my addr 172.21.15.40:0/1671075260 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:25.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.790+0000 7f2dd0a24700 1 --2- 172.21.15.40:0/1671075260 >> v2:172.21.15.40:3300/0 conn(0x7f2dcc09c890 0x7f2dcc09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.791+0000 7f2dd1225700 1 --2- 172.21.15.40:0/1671075260 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2dcc09e2b0 0x7f2dcc13ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.791+0000 7f2dcbfff700 1 -- 172.21.15.40:0/1671075260 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2dcc09e2b0 msgr2=0x7f2dcc13ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:25.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.791+0000 7f2dcbfff700 1 --2- 172.21.15.40:0/1671075260 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2dcc09e2b0 0x7f2dcc13ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.791+0000 7f2dcbfff700 1 -- 172.21.15.40:0/1671075260 >> v2:172.21.15.40:3300/0 conn(0x7f2dcc09c890 msgr2=0x7f2dcc09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:25.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.791+0000 7f2dcbfff700 1 --2- 172.21.15.40:0/1671075260 >> v2:172.21.15.40:3300/0 conn(0x7f2dcc09c890 0x7f2dcc09cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.791+0000 7f2dcbfff700 1 -- 172.21.15.40:0/1671075260 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dcc09fed0 con 0x7f2dcc09d920 2023-09-30T22:24:25.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.791+0000 7f2dd1225700 1 --2- 172.21.15.40:0/1671075260 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2dcc09e2b0 0x7f2dcc13ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:24:25.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.791+0000 7f2dcbfff700 1 --2- 172.21.15.40:0/1671075260 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2dcc09d920 0x7f2dcc09dd70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2db80098f0 tx=0x7f2db8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d52db3878217a6d3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:25.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.791+0000 7f2dcb7fe700 1 -- 172.21.15.40:0/1671075260 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db8011830 con 0x7f2dcc09d920 2023-09-30T22:24:25.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.791+0000 7f2dcb7fe700 1 -- 172.21.15.40:0/1671075260 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db8011990 con 0x7f2dcc09d920 2023-09-30T22:24:25.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.791+0000 7f2dcb7fe700 1 -- 172.21.15.40:0/1671075260 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db8011d20 con 0x7f2dcc09d920 2023-09-30T22:24:25.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.792+0000 7f2dd2c88700 1 -- 172.21.15.40:0/1671075260 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2dcc09d920 msgr2=0x7f2dcc09dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.792+0000 7f2dd2c88700 1 --2- 172.21.15.40:0/1671075260 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2dcc09d920 0x7f2dcc09dd70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2db80098f0 tx=0x7f2db8009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:25.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.792+0000 7f2dd2c88700 1 -- 172.21.15.40:0/1671075260 shutdown_connections 2023-09-30T22:24:25.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.792+0000 7f2dd2c88700 1 --2- 172.21.15.40:0/1671075260 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2dcc09e2b0 0x7f2dcc13ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.792+0000 7f2dd2c88700 1 --2- 172.21.15.40:0/1671075260 >> v2:172.21.15.40:3300/0 conn(0x7f2dcc09c890 0x7f2dcc09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.792+0000 7f2dd2c88700 1 --2- 172.21.15.40:0/1671075260 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2dcc09d920 0x7f2dcc09dd70 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.792+0000 7f2dd2c88700 1 -- 172.21.15.40:0/1671075260 >> 172.21.15.40:0/1671075260 conn(0x7f2dcc0a7080 msgr2=0x7f2dcc0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:25.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.792+0000 7f2dd2c88700 1 -- 172.21.15.40:0/1671075260 shutdown_connections 2023-09-30T22:24:25.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.792+0000 7f2dd2c88700 1 -- 172.21.15.40:0/1671075260 wait complete. 2023-09-30T22:24:25.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.793+0000 7f2dd2c88700 1 Processor -- start 2023-09-30T22:24:25.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.793+0000 7f2dd2c88700 1 -- start start 2023-09-30T22:24:25.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.794+0000 7f2dd2c88700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2dcc09c890 0x7f2dcc09a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.794+0000 7f2dd2c88700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dcc09d920 0x7f2dcc09abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.794+0000 7f2dd2c88700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2dcc09e2b0 0x7f2dcc1ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.794+0000 7f2dd2c88700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc06ec20 con 0x7f2dcc09d920 2023-09-30T22:24:25.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.794+0000 7f2dd2c88700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc09ba20 con 0x7f2dcc09e2b0 2023-09-30T22:24:25.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.794+0000 7f2dd2c88700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc0a5c90 con 0x7f2dcc09c890 2023-09-30T22:24:25.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.794+0000 7f2dd0a24700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2dcc09c890 0x7f2dcc09a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.794+0000 7f2dd1225700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2dcc09e2b0 0x7f2dcc1ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.794+0000 7f2dd0a24700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2dcc09c890 0x7f2dcc09a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33036/0 (socket says 172.21.15.40:33036) 2023-09-30T22:24:25.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.794+0000 7f2dd0a24700 1 -- 172.21.15.40:0/3768257946 learned_addr learned my addr 172.21.15.40:0/3768257946 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:25.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.794+0000 7f2dcbfff700 1 --2- 172.21.15.40:0/3768257946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dcc09d920 0x7f2dcc09abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.794+0000 7f2dd0a24700 1 -- 172.21.15.40:0/3768257946 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2dcc09e2b0 msgr2=0x7f2dcc1ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.794+0000 7f2dd0a24700 1 --2- 172.21.15.40:0/3768257946 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2dcc09e2b0 0x7f2dcc1ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.794+0000 7f2dd0a24700 1 -- 172.21.15.40:0/3768257946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dcc09d920 msgr2=0x7f2dcc09abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.794+0000 7f2dd0a24700 1 --2- 172.21.15.40:0/3768257946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dcc09d920 0x7f2dcc09abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.794+0000 7f2dd0a24700 1 -- 172.21.15.40:0/3768257946 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db8009550 con 0x7f2dcc09c890 2023-09-30T22:24:25.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.794+0000 7f2dcbfff700 1 --2- 172.21.15.40:0/3768257946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dcc09d920 0x7f2dcc09abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:25.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.795+0000 7f2dd0a24700 1 --2- 172.21.15.40:0/3768257946 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2dcc09c890 0x7f2dcc09a6a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2dc000e870 tx=0x7f2dc000eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:25.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.795+0000 7f2dc97fa700 1 -- 172.21.15.40:0/3768257946 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc0005a20 con 0x7f2dcc09c890 2023-09-30T22:24:25.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.795+0000 7f2dc97fa700 1 -- 172.21.15.40:0/3768257946 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc0005b80 con 0x7f2dcc09c890 2023-09-30T22:24:25.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.795+0000 7f2dc97fa700 1 -- 172.21.15.40:0/3768257946 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc0013680 con 0x7f2dcc09c890 2023-09-30T22:24:25.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.795+0000 7f2dd2c88700 1 -- 172.21.15.40:0/3768257946 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dcc09ecf0 con 0x7f2dcc09c890 2023-09-30T22:24:25.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.795+0000 7f2dd2c88700 1 -- 172.21.15.40:0/3768257946 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dcc06e9f0 con 0x7f2dcc09c890 2023-09-30T22:24:25.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.796+0000 7f2dd2c88700 1 -- 172.21.15.40:0/3768257946 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dcc0a5530 con 0x7f2dcc09c890 2023-09-30T22:24:25.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.797+0000 7f2dc97fa700 1 -- 172.21.15.40:0/3768257946 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f2dc00137e0 con 0x7f2dcc09c890 2023-09-30T22:24:25.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.797+0000 7f2dc97fa700 1 -- 172.21.15.40:0/3768257946 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4083+0+0 (secure 0 0 0) 0x7f2dc003fd60 con 0x7f2dcc09c890 2023-09-30T22:24:25.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.802+0000 7f2dc97fa700 1 -- 172.21.15.40:0/3768257946 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2dc0013a90 con 0x7f2dcc09c890 2023-09-30T22:24:25.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.839+0000 7fd7a2032700 1 Processor -- start 2023-09-30T22:24:25.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.839+0000 7fd7a2032700 1 -- start start 2023-09-30T22:24:25.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.840+0000 7fd7a2032700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd79c09e400 0x7fd79c135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.840+0000 7fd7a2032700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd79c136230 0x7fd79c138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.840+0000 7fd7a2032700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd79c09adf0 con 0x7fd79c09d920 2023-09-30T22:24:25.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.840+0000 7fd7a2032700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd79c09edf0 con 0x7fd79c09e400 2023-09-30T22:24:25.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.840+0000 7fd7a2032700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c09b660 con 0x7fd79c136230 2023-09-30T22:24:25.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.840+0000 7fd79bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd79c136230 0x7fd79c138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.840+0000 7fd79bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd79c136230 0x7fd79c138610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:51950/0 (socket says 172.21.15.40:51950) 2023-09-30T22:24:25.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.840+0000 7fd79b7fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd79c09d920 0x7fd79c09dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40158/0 (socket says 172.21.15.40:40158) 2023-09-30T22:24:25.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.840+0000 7fd79bfff700 1 -- 172.21.15.40:0/4180175538 learned_addr learned my addr 172.21.15.40:0/4180175538 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:25.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.840+0000 7fd79affd700 1 --2- 172.21.15.40:0/4180175538 >> v2:172.21.15.40:3300/0 conn(0x7fd79c09e400 0x7fd79c135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.841+0000 7fd79affd700 1 -- 172.21.15.40:0/4180175538 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd79c136230 msgr2=0x7fd79c138610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:25.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.841+0000 7fd79affd700 1 --2- 172.21.15.40:0/4180175538 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd79c136230 0x7fd79c138610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.841+0000 7fd79affd700 1 -- 172.21.15.40:0/4180175538 >> v1:172.21.15.40:6789/0 conn(0x7fd79c09d920 legacy=0x7fd79c09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.841+0000 7fd79affd700 1 -- 172.21.15.40:0/4180175538 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd79c09a6e0 con 0x7fd79c09e400 2023-09-30T22:24:25.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.841+0000 7fd79affd700 1 --2- 172.21.15.40:0/4180175538 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd79c09e400 0x7fd79c135cf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd790009840 tx=0x7fd790009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a514480618ba9a41 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:25.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.841+0000 7fd79a7fc700 1 -- 172.21.15.40:0/4180175538 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd790011830 con 0x7fd79c09e400 2023-09-30T22:24:25.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.841+0000 7fd79a7fc700 1 -- 172.21.15.40:0/4180175538 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd790011990 con 0x7fd79c09e400 2023-09-30T22:24:25.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.841+0000 7fd79a7fc700 1 -- 172.21.15.40:0/4180175538 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd790011d20 con 0x7fd79c09e400 2023-09-30T22:24:25.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.842+0000 7fd7a2032700 1 -- 172.21.15.40:0/4180175538 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd79c09e400 msgr2=0x7fd79c135cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.842+0000 7fd7a2032700 1 --2- 172.21.15.40:0/4180175538 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd79c09e400 0x7fd79c135cf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd790009840 tx=0x7fd790009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:25.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.842+0000 7fd7a2032700 1 -- 172.21.15.40:0/4180175538 shutdown_connections 2023-09-30T22:24:25.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.842+0000 7fd7a2032700 1 --2- 172.21.15.40:0/4180175538 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd79c136230 0x7fd79c138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.842+0000 7fd7a2032700 1 --2- 172.21.15.40:0/4180175538 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd79c09e400 0x7fd79c135cf0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.842+0000 7fd7a2032700 1 -- 172.21.15.40:0/4180175538 >> 172.21.15.40:0/4180175538 conn(0x7fd79c09fb20 msgr2=0x7fd79c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:25.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.842+0000 7fd7a2032700 1 -- 172.21.15.40:0/4180175538 shutdown_connections 2023-09-30T22:24:25.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.842+0000 7fd7a2032700 1 -- 172.21.15.40:0/4180175538 wait complete. 2023-09-30T22:24:25.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.843+0000 7fd7a2032700 1 Processor -- start 2023-09-30T22:24:25.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.843+0000 7fd7a2032700 1 -- start start 2023-09-30T22:24:25.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.843+0000 7fd7a2032700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd79c09d920 0x7fd79c11c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.843+0000 7fd7a2032700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd79c09e400 0x7fd79c11ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.843+0000 7fd7a2032700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd79c136230 0x7fd79c11cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.843+0000 7fd7a2032700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c132d80 con 0x7fd79c136230 2023-09-30T22:24:25.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.843+0000 7fd7a2032700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c09cb00 con 0x7fd79c09d920 2023-09-30T22:24:25.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.843+0000 7fd7a2032700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c11fff0 con 0x7fd79c09e400 2023-09-30T22:24:25.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.844+0000 7fd79affd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd79c09e400 0x7fd79c11ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.844+0000 7fd79affd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd79c09e400 0x7fd79c11ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33040/0 (socket says 172.21.15.40:33040) 2023-09-30T22:24:25.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.844+0000 7fd79affd700 1 -- 172.21.15.40:0/3044591915 learned_addr learned my addr 172.21.15.40:0/3044591915 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:25.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.844+0000 7fd79bfff700 1 --2- 172.21.15.40:0/3044591915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd79c136230 0x7fd79c11cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.844+0000 7fd79b7fe700 1 --2- 172.21.15.40:0/3044591915 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd79c09d920 0x7fd79c11c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.844+0000 7fd79affd700 1 -- 172.21.15.40:0/3044591915 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd79c09d920 msgr2=0x7fd79c11c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.844+0000 7fd79affd700 1 --2- 172.21.15.40:0/3044591915 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd79c09d920 0x7fd79c11c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.844+0000 7fd79affd700 1 -- 172.21.15.40:0/3044591915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd79c136230 msgr2=0x7fd79c11cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.844+0000 7fd79affd700 1 --2- 172.21.15.40:0/3044591915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd79c136230 0x7fd79c11cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.844+0000 7fd79affd700 1 -- 172.21.15.40:0/3044591915 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7900094a0 con 0x7fd79c09e400 2023-09-30T22:24:25.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.844+0000 7fd79affd700 1 --2- 172.21.15.40:0/3044591915 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd79c09e400 0x7fd79c11ca10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd790009fd0 tx=0x7fd790004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:25.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.845+0000 7fd783fff700 1 -- 172.21.15.40:0/3044591915 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7900036a0 con 0x7fd79c09e400 2023-09-30T22:24:25.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.845+0000 7fd783fff700 1 -- 172.21.15.40:0/3044591915 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd79001f070 con 0x7fd79c09e400 2023-09-30T22:24:25.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.845+0000 7fd7a2032700 1 -- 172.21.15.40:0/3044591915 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd79c0a2e20 con 0x7fd79c09e400 2023-09-30T22:24:25.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.845+0000 7fd7a2032700 1 -- 172.21.15.40:0/3044591915 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd79c11e8d0 con 0x7fd79c09e400 2023-09-30T22:24:25.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.845+0000 7fd783fff700 1 -- 172.21.15.40:0/3044591915 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd790003a60 con 0x7fd79c09e400 2023-09-30T22:24:25.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.846+0000 7fd7a2032700 1 -- 172.21.15.40:0/3044591915 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd77c0052e0 con 0x7fd79c09e400 2023-09-30T22:24:25.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.846+0000 7fd783fff700 1 -- 172.21.15.40:0/3044591915 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7fd790003bc0 con 0x7fd79c09e400 2023-09-30T22:24:25.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.846+0000 7fd783fff700 1 -- 172.21.15.40:0/3044591915 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4083+0+0 (secure 0 0 0) 0x7fd790021070 con 0x7fd79c09e400 2023-09-30T22:24:25.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.856+0000 7fd783fff700 1 -- 172.21.15.40:0/3044591915 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd790010790 con 0x7fd79c09e400 2023-09-30T22:24:25.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.923+0000 7f3c360dc700 1 Processor -- start 2023-09-30T22:24:25.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.923+0000 7f3c360dc700 1 -- start start 2023-09-30T22:24:25.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.924+0000 7f3c360dc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c3009d450 0x7f3c3009d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.924+0000 7f3c360dc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c3009dd60 0x7f3c301301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.924+0000 7f3c360dc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3c30067820 0x7f3c30130700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.924+0000 7f3c360dc700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c3009e8b0 con 0x7f3c30067820 2023-09-30T22:24:25.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.924+0000 7f3c360dc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3009c3b0 con 0x7f3c3009dd60 2023-09-30T22:24:25.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.924+0000 7f3c360dc700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3009a6b0 con 0x7f3c3009d450 2023-09-30T22:24:25.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.924+0000 7f3c2effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c3009dd60 0x7f3c301301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.924+0000 7f3c2ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3c30067820 0x7f3c30130700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.924+0000 7f3c2ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3c30067820 0x7f3c30130700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46348/0 (socket says 172.21.15.40:46348) 2023-09-30T22:24:25.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.924+0000 7f3c2effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c3009dd60 0x7f3c301301c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:51972/0 (socket says 172.21.15.40:51972) 2023-09-30T22:24:25.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.924+0000 7f3c2ffff700 1 -- 172.21.15.40:0/940398316 learned_addr learned my addr 172.21.15.40:0/940398316 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:25.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.924+0000 7f3c2f7fe700 1 --2- 172.21.15.40:0/940398316 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c3009d450 0x7f3c3009d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.924+0000 7f3c2ffff700 1 -- 172.21.15.40:0/940398316 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c3009d450 msgr2=0x7f3c3009d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:25.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.924+0000 7f3c2ffff700 1 --2- 172.21.15.40:0/940398316 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c3009d450 0x7f3c3009d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.924+0000 7f3c2ffff700 1 -- 172.21.15.40:0/940398316 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c3009dd60 msgr2=0x7f3c301301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:25.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.924+0000 7f3c2ffff700 1 --2- 172.21.15.40:0/940398316 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c3009dd60 0x7f3c301301c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.924+0000 7f3c2ffff700 1 -- 172.21.15.40:0/940398316 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3009b4f0 con 0x7f3c30067820 2023-09-30T22:24:25.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.924+0000 7f3c2effd700 1 --2- 172.21.15.40:0/940398316 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c3009dd60 0x7f3c301301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:25.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.925+0000 7f3c2ffff700 1 --2- 172.21.15.40:0/940398316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c30067820 0x7f3c30130700 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3c28009e50 tx=0x7f3c2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de552fa4dc04a93e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:25.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.925+0000 7f3c2e7fc700 1 -- 172.21.15.40:0/940398316 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2800e070 con 0x7f3c30067820 2023-09-30T22:24:25.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.925+0000 7f3c2e7fc700 1 -- 172.21.15.40:0/940398316 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2800b910 con 0x7f3c30067820 2023-09-30T22:24:25.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.925+0000 7f3c2e7fc700 1 -- 172.21.15.40:0/940398316 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2800bcc0 con 0x7f3c30067820 2023-09-30T22:24:25.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.926+0000 7f3c360dc700 1 -- 172.21.15.40:0/940398316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c30067820 msgr2=0x7f3c30130700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.926+0000 7f3c360dc700 1 --2- 172.21.15.40:0/940398316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c30067820 0x7f3c30130700 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3c28009e50 tx=0x7f3c2800b330 comp rx=0 tx=0).stop 2023-09-30T22:24:25.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.926+0000 7f3c360dc700 1 -- 172.21.15.40:0/940398316 shutdown_connections 2023-09-30T22:24:25.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.926+0000 7f3c360dc700 1 --2- 172.21.15.40:0/940398316 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c3009d450 0x7f3c3009d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.926+0000 7f3c360dc700 1 --2- 172.21.15.40:0/940398316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c30067820 0x7f3c30130700 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.926+0000 7f3c360dc700 1 --2- 172.21.15.40:0/940398316 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c3009dd60 0x7f3c301301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.926+0000 7f3c360dc700 1 -- 172.21.15.40:0/940398316 >> 172.21.15.40:0/940398316 conn(0x7f3c300a2a00 msgr2=0x7f3c300a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:25.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.926+0000 7f3c360dc700 1 -- 172.21.15.40:0/940398316 shutdown_connections 2023-09-30T22:24:25.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.926+0000 7f3c360dc700 1 -- 172.21.15.40:0/940398316 wait complete. 2023-09-30T22:24:25.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.927+0000 7f3c360dc700 1 Processor -- start 2023-09-30T22:24:25.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.928+0000 7f3c360dc700 1 -- start start 2023-09-30T22:24:25.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.928+0000 7f3c360dc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c30067820 0x7f3c301c4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.928+0000 7f3c360dc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c3009d450 0x7f3c301c4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.928+0000 7f3c360dc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c3009dd60 0x7f3c301c0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.928+0000 7f3c360dc700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c301a6840 con 0x7f3c3009d450 2023-09-30T22:24:25.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.928+0000 7f3c360dc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c300a0290 con 0x7f3c3009dd60 2023-09-30T22:24:25.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.928+0000 7f3c360dc700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3009c5d0 con 0x7f3c30067820 2023-09-30T22:24:25.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.928+0000 7f3c2f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c30067820 0x7f3c301c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.928+0000 7f3c2effd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c3009d450 0x7f3c301c4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.928+0000 7f3c2f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c30067820 0x7f3c301c4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33050/0 (socket says 172.21.15.40:33050) 2023-09-30T22:24:25.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.928+0000 7f3c2f7fe700 1 -- 172.21.15.40:0/750779400 learned_addr learned my addr 172.21.15.40:0/750779400 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:25.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.928+0000 7f3c2effd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c3009d450 0x7f3c301c4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46350/0 (socket says 172.21.15.40:46350) 2023-09-30T22:24:25.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.928+0000 7f3c2ffff700 1 --2- 172.21.15.40:0/750779400 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c3009dd60 0x7f3c301c0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.929+0000 7f3c2effd700 1 -- 172.21.15.40:0/750779400 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c30067820 msgr2=0x7f3c301c4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.929+0000 7f3c2effd700 1 --2- 172.21.15.40:0/750779400 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c30067820 0x7f3c301c4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.929+0000 7f3c2effd700 1 -- 172.21.15.40:0/750779400 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c3009dd60 msgr2=0x7f3c301c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.929+0000 7f3c2effd700 1 --2- 172.21.15.40:0/750779400 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c3009dd60 0x7f3c301c0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.929+0000 7f3c2effd700 1 -- 172.21.15.40:0/750779400 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c2400d940 con 0x7f3c3009d450 2023-09-30T22:24:25.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.929+0000 7f3c2effd700 1 --2- 172.21.15.40:0/750779400 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c3009d450 0x7f3c301c4a80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3c24012f90 tx=0x7f3c240100c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:25.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.929+0000 7f3c17fff700 1 -- 172.21.15.40:0/750779400 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c24010940 con 0x7f3c3009d450 2023-09-30T22:24:25.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.929+0000 7f3c17fff700 1 -- 172.21.15.40:0/750779400 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c24013040 con 0x7f3c3009d450 2023-09-30T22:24:25.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.929+0000 7f3c360dc700 1 -- 172.21.15.40:0/750779400 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c28009b30 con 0x7f3c3009d450 2023-09-30T22:24:25.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.929+0000 7f3c17fff700 1 -- 172.21.15.40:0/750779400 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c24010ca0 con 0x7f3c3009d450 2023-09-30T22:24:25.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.929+0000 7f3c360dc700 1 -- 172.21.15.40:0/750779400 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c301a5c00 con 0x7f3c3009d450 2023-09-30T22:24:25.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.930+0000 7f3c17fff700 1 -- 172.21.15.40:0/750779400 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f3c24018480 con 0x7f3c3009d450 2023-09-30T22:24:25.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.930+0000 7f3c17fff700 1 -- 172.21.15.40:0/750779400 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4083+0+0 (secure 0 0 0) 0x7f3c24043350 con 0x7f3c3009d450 2023-09-30T22:24:25.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.930+0000 7f3c360dc700 1 -- 172.21.15.40:0/750779400 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c301a5c00 con 0x7f3c3009d450 2023-09-30T22:24:25.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.936+0000 7f3c17fff700 1 -- 172.21.15.40:0/750779400 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3c301a5c00 con 0x7f3c3009d450 2023-09-30T22:24:25.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.974+0000 7f65b759e700 1 -- 172.21.15.40:0/3418917795 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f65b8062380 con 0x7f65b809d8b0 2023-09-30T22:24:25.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.974+0000 7f65a6ffd700 1 -- 172.21.15.40:0/3418917795 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f65a801e030 con 0x7f65b809d8b0 2023-09-30T22:24:25.975 INFO:teuthology.orchestra.run.smithi040.stdout:38654705694 2023-09-30T22:24:25.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.977+0000 7f65b759e700 1 -- 172.21.15.40:0/3418917795 >> v1:172.21.15.40:6816/127432 conn(0x7f659802f240 legacy=0x7f65980316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.977+0000 7f65b759e700 1 -- 172.21.15.40:0/3418917795 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f65b809d8b0 msgr2=0x7f65b811bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.977+0000 7f65b759e700 1 --2- 172.21.15.40:0/3418917795 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f65b809d8b0 0x7f65b811bef0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f65a8010cf0 tx=0x7f65a800b140 comp rx=0 tx=0).stop 2023-09-30T22:24:25.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.977+0000 7f65b759e700 1 -- 172.21.15.40:0/3418917795 shutdown_connections 2023-09-30T22:24:25.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.977+0000 7f65b759e700 1 --2- 172.21.15.40:0/3418917795 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f65b809d8b0 0x7f65b811bef0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.977+0000 7f65b759e700 1 --2- 172.21.15.40:0/3418917795 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65b8130cb0 0x7f65b811c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.977+0000 7f65b759e700 1 --2- 172.21.15.40:0/3418917795 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b809e1c0 0x7f65b811c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.977+0000 7f65b759e700 1 -- 172.21.15.40:0/3418917795 >> 172.21.15.40:0/3418917795 conn(0x7f65b80a2fb0 msgr2=0x7f65b8130050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:25.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.977+0000 7f65b759e700 1 -- 172.21.15.40:0/3418917795 shutdown_connections 2023-09-30T22:24:25.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:25.977+0000 7f65b759e700 1 -- 172.21.15.40:0/3418917795 wait complete. 2023-09-30T22:24:25.991 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705694 for osd.1 2023-09-30T22:24:26.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:26.033+0000 7f2dd2c88700 1 -- 172.21.15.40:0/3768257946 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2dcc0a5750 con 0x7f2dcc09c890 2023-09-30T22:24:26.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:26.033+0000 7f2dc97fa700 1 -- 172.21.15.40:0/3768257946 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2dc002a090 con 0x7f2dcc09c890 2023-09-30T22:24:26.034 INFO:teuthology.orchestra.run.smithi040.stdout:38654705694 2023-09-30T22:24:26.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:26.035+0000 7f2dd2c88700 1 -- 172.21.15.40:0/3768257946 >> v1:172.21.15.40:6816/127432 conn(0x7f2db002f240 legacy=0x7f2db00316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:26.035+0000 7f2dd2c88700 1 -- 172.21.15.40:0/3768257946 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2dcc09c890 msgr2=0x7f2dcc09a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:26.035+0000 7f2dd2c88700 1 --2- 172.21.15.40:0/3768257946 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2dcc09c890 0x7f2dcc09a6a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2dc000e870 tx=0x7f2dc000eb80 comp rx=0 tx=0).stop 2023-09-30T22:24:26.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:26.035+0000 7f2dd2c88700 1 -- 172.21.15.40:0/3768257946 shutdown_connections 2023-09-30T22:24:26.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:26.035+0000 7f2dd2c88700 1 --2- 172.21.15.40:0/3768257946 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2dcc09c890 0x7f2dcc09a6a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:26.035+0000 7f2dd2c88700 1 --2- 172.21.15.40:0/3768257946 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2dcc09e2b0 0x7f2dcc1ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:26.035+0000 7f2dd2c88700 1 --2- 172.21.15.40:0/3768257946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dcc09d920 0x7f2dcc09abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:26.035+0000 7f2dd2c88700 1 -- 172.21.15.40:0/3768257946 >> 172.21.15.40:0/3768257946 conn(0x7f2dcc0a7080 msgr2=0x7f2dcc132ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:26.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:26.035+0000 7f2dd2c88700 1 -- 172.21.15.40:0/3768257946 shutdown_connections 2023-09-30T22:24:26.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:26.035+0000 7f2dd2c88700 1 -- 172.21.15.40:0/3768257946 wait complete. 2023-09-30T22:24:26.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705694 for osd.2 2023-09-30T22:24:26.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:26.073+0000 7fd7a2032700 1 -- 172.21.15.40:0/3044591915 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd77c005590 con 0x7fd79c09e400 2023-09-30T22:24:26.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:26.074+0000 7fd783fff700 1 -- 172.21.15.40:0/3044591915 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd790015070 con 0x7fd79c09e400 2023-09-30T22:24:26.075 INFO:teuthology.orchestra.run.smithi040.stdout:38654705694 2023-09-30T22:24:26.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:26.076+0000 7fd7a2032700 1 -- 172.21.15.40:0/3044591915 >> v1:172.21.15.40:6816/127432 conn(0x7fd78802f290 legacy=0x7fd788031740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:26.076+0000 7fd7a2032700 1 -- 172.21.15.40:0/3044591915 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd79c09e400 msgr2=0x7fd79c11ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:26.076+0000 7fd7a2032700 1 --2- 172.21.15.40:0/3044591915 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd79c09e400 0x7fd79c11ca10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd790009fd0 tx=0x7fd790004750 comp rx=0 tx=0).stop 2023-09-30T22:24:26.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:26.076+0000 7fd7a2032700 1 -- 172.21.15.40:0/3044591915 shutdown_connections 2023-09-30T22:24:26.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:26.076+0000 7fd7a2032700 1 --2- 172.21.15.40:0/3044591915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd79c136230 0x7fd79c11cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:26.076+0000 7fd7a2032700 1 --2- 172.21.15.40:0/3044591915 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd79c09d920 0x7fd79c11c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:26.076+0000 7fd7a2032700 1 --2- 172.21.15.40:0/3044591915 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd79c09e400 0x7fd79c11ca10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:26.076+0000 7fd7a2032700 1 -- 172.21.15.40:0/3044591915 >> 172.21.15.40:0/3044591915 conn(0x7fd79c09fb20 msgr2=0x7fd79c06e610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:26.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:26.076+0000 7fd7a2032700 1 -- 172.21.15.40:0/3044591915 shutdown_connections 2023-09-30T22:24:26.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:26.076+0000 7fd7a2032700 1 -- 172.21.15.40:0/3044591915 wait complete. 2023-09-30T22:24:26.089 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705694 for osd.0 2023-09-30T22:24:26.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:26.165+0000 7f3c360dc700 1 -- 172.21.15.40:0/750779400 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3c301a5c00 con 0x7f3c3009d450 2023-09-30T22:24:26.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:26.165+0000 7f3c17fff700 1 -- 172.21.15.40:0/750779400 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3c301a5c00 con 0x7f3c3009d450 2023-09-30T22:24:26.166 INFO:teuthology.orchestra.run.smithi040.stdout:38654705696 2023-09-30T22:24:26.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:26.167+0000 7f3c360dc700 1 -- 172.21.15.40:0/750779400 >> v1:172.21.15.40:6816/127432 conn(0x7f3c1c02f270 legacy=0x7f3c1c031720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:26.167+0000 7f3c360dc700 1 -- 172.21.15.40:0/750779400 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c3009d450 msgr2=0x7f3c301c4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:26.167+0000 7f3c360dc700 1 --2- 172.21.15.40:0/750779400 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c3009d450 0x7f3c301c4a80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3c24012f90 tx=0x7f3c240100c0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:26.167+0000 7f3c360dc700 1 -- 172.21.15.40:0/750779400 shutdown_connections 2023-09-30T22:24:26.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:26.167+0000 7f3c360dc700 1 --2- 172.21.15.40:0/750779400 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c30067820 0x7f3c301c4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:26.167+0000 7f3c360dc700 1 --2- 172.21.15.40:0/750779400 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c3009dd60 0x7f3c301c0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:26.167+0000 7f3c360dc700 1 --2- 172.21.15.40:0/750779400 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c3009d450 0x7f3c301c4a80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:26.167+0000 7f3c360dc700 1 -- 172.21.15.40:0/750779400 >> 172.21.15.40:0/750779400 conn(0x7f3c300a2a00 msgr2=0x7f3c300a1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:26.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:26.168+0000 7f3c360dc700 1 -- 172.21.15.40:0/750779400 shutdown_connections 2023-09-30T22:24:26.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:26.168+0000 7f3c360dc700 1 -- 172.21.15.40:0/750779400 wait complete. 2023-09-30T22:24:26.183 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705696 for osd.3 2023-09-30T22:24:26.183 DEBUG:teuthology.parallel:result is None 2023-09-30T22:24:26.992 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:27.048 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:27.090 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:27.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.122+0000 7f1f0a2ac700 1 Processor -- start 2023-09-30T22:24:27.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.122+0000 7f1f0a2ac700 1 -- start start 2023-09-30T22:24:27.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.123+0000 7f1f0a2ac700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f0409d920 0x7f1f0409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.123+0000 7f1f0a2ac700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f0409e230 0x7f1f041343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.123+0000 7f1f0a2ac700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f0409f940 con 0x7f1f0409f0f0 2023-09-30T22:24:27.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.123+0000 7f1f0a2ac700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0406b4c0 con 0x7f1f0409e230 2023-09-30T22:24:27.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.123+0000 7f1f0a2ac700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0409a8f0 con 0x7f1f0409d920 2023-09-30T22:24:27.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.123+0000 7f1f037fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1f0409f0f0 0x7f1f04133ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40170/0 (socket says 172.21.15.40:40170) 2023-09-30T22:24:27.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.123+0000 7f1f037fe700 1 -- 172.21.15.40:0/85139033 learned_addr learned my addr 172.21.15.40:0/85139033 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:24:27.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.123+0000 7f1f08849700 1 --2- 172.21.15.40:0/85139033 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f0409e230 0x7f1f041343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.123+0000 7f1f03fff700 1 --2- 172.21.15.40:0/85139033 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f0409d920 0x7f1f0409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.123+0000 7f1f02ffd700 1 -- 172.21.15.40:0/85139033 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1587470559 0 0) 0x7f1f0409f940 con 0x7f1f0409f0f0 2023-09-30T22:24:27.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.123+0000 7f1f02ffd700 1 -- 172.21.15.40:0/85139033 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1eec0035b0 con 0x7f1f0409f0f0 2023-09-30T22:24:27.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.124+0000 7f1f08849700 1 -- 172.21.15.40:0/85139033 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f0409d920 msgr2=0x7f1f0409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:27.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.124+0000 7f1f08849700 1 --2- 172.21.15.40:0/85139033 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f0409d920 0x7f1f0409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.124+0000 7f1f08849700 1 -- 172.21.15.40:0/85139033 >> v1:172.21.15.40:6789/0 conn(0x7f1f0409f0f0 legacy=0x7f1f04133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.124+0000 7f1f08849700 1 -- 172.21.15.40:0/85139033 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f0409f6e0 con 0x7f1f0409e230 2023-09-30T22:24:27.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.124+0000 7f1f08849700 1 --2- 172.21.15.40:0/85139033 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f0409e230 0x7f1f041343b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1efc009dc0 tx=0x7f1efc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66946a2f193e700d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:27.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.124+0000 7f1f02ffd700 1 -- 172.21.15.40:0/85139033 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc00e070 con 0x7f1f0409e230 2023-09-30T22:24:27.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.124+0000 7f1f02ffd700 1 -- 172.21.15.40:0/85139033 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1efc00bae0 con 0x7f1f0409e230 2023-09-30T22:24:27.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.124+0000 7f1f02ffd700 1 -- 172.21.15.40:0/85139033 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc00be90 con 0x7f1f0409e230 2023-09-30T22:24:27.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.125+0000 7f1f0a2ac700 1 -- 172.21.15.40:0/85139033 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f0409e230 msgr2=0x7f1f041343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.125+0000 7f1f0a2ac700 1 --2- 172.21.15.40:0/85139033 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f0409e230 0x7f1f041343b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1efc009dc0 tx=0x7f1efc00b330 comp rx=0 tx=0).stop 2023-09-30T22:24:27.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.125+0000 7f1f0a2ac700 1 -- 172.21.15.40:0/85139033 shutdown_connections 2023-09-30T22:24:27.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.125+0000 7f1f0a2ac700 1 --2- 172.21.15.40:0/85139033 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f0409e230 0x7f1f041343b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.125+0000 7f1f0a2ac700 1 --2- 172.21.15.40:0/85139033 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f0409d920 0x7f1f0409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.125+0000 7f1f0a2ac700 1 -- 172.21.15.40:0/85139033 >> 172.21.15.40:0/85139033 conn(0x7f1f0409fb20 msgr2=0x7f1f0409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:27.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.125+0000 7f1f0a2ac700 1 -- 172.21.15.40:0/85139033 shutdown_connections 2023-09-30T22:24:27.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.125+0000 7f1f0a2ac700 1 -- 172.21.15.40:0/85139033 wait complete. 2023-09-30T22:24:27.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.126+0000 7f1f0a2ac700 1 Processor -- start 2023-09-30T22:24:27.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.126+0000 7f1f0a2ac700 1 -- start start 2023-09-30T22:24:27.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.126+0000 7f1f0a2ac700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f0409d920 0x7f1f04122920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.126+0000 7f1f0a2ac700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f0409e230 0x7f1f04122e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.126+0000 7f1f0a2ac700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f041233a0 0x7f1f041c8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.126+0000 7f1f0a2ac700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f04124490 con 0x7f1f0409e230 2023-09-30T22:24:27.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.126+0000 7f1f0a2ac700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0409ca50 con 0x7f1f0409d920 2023-09-30T22:24:27.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.126+0000 7f1f0a2ac700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f04123d60 con 0x7f1f041233a0 2023-09-30T22:24:27.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.127+0000 7f1f037fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f0409e230 0x7f1f04122e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.127+0000 7f1f037fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f0409e230 0x7f1f04122e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46384/0 (socket says 172.21.15.40:46384) 2023-09-30T22:24:27.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.127+0000 7f1f037fe700 1 -- 172.21.15.40:0/3669954902 learned_addr learned my addr 172.21.15.40:0/3669954902 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:27.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.127+0000 7f1f08849700 1 --2- 172.21.15.40:0/3669954902 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f041233a0 0x7f1f041c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.127+0000 7f1f03fff700 1 --2- 172.21.15.40:0/3669954902 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f0409d920 0x7f1f04122920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.127+0000 7f1f037fe700 1 -- 172.21.15.40:0/3669954902 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f041233a0 msgr2=0x7f1f041c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.127+0000 7f1f037fe700 1 --2- 172.21.15.40:0/3669954902 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f041233a0 0x7f1f041c8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.127+0000 7f1f037fe700 1 -- 172.21.15.40:0/3669954902 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f0409d920 msgr2=0x7f1f04122920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.127+0000 7f1f037fe700 1 --2- 172.21.15.40:0/3669954902 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f0409d920 0x7f1f04122920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.127+0000 7f1f037fe700 1 -- 172.21.15.40:0/3669954902 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1efc009a70 con 0x7f1f0409e230 2023-09-30T22:24:27.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.127+0000 7f1f03fff700 1 --2- 172.21.15.40:0/3669954902 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f0409d920 0x7f1f04122920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:27.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.127+0000 7f1f037fe700 1 --2- 172.21.15.40:0/3669954902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f0409e230 0x7f1f04122e60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1ef800c550 tx=0x7f1ef800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:27.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.127+0000 7f1f00ff9700 1 -- 172.21.15.40:0/3669954902 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef8004c80 con 0x7f1f0409e230 2023-09-30T22:24:27.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.127+0000 7f1f00ff9700 1 -- 172.21.15.40:0/3669954902 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef8004e00 con 0x7f1f0409e230 2023-09-30T22:24:27.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.127+0000 7f1f0a2ac700 1 -- 172.21.15.40:0/3669954902 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f041260c0 con 0x7f1f0409e230 2023-09-30T22:24:27.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.127+0000 7f1f00ff9700 1 -- 172.21.15.40:0/3669954902 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef8007310 con 0x7f1f0409e230 2023-09-30T22:24:27.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.127+0000 7f1f0a2ac700 1 -- 172.21.15.40:0/3669954902 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f04124d00 con 0x7f1f0409e230 2023-09-30T22:24:27.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.128+0000 7f1f00ff9700 1 -- 172.21.15.40:0/3669954902 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f1ef8007470 con 0x7f1f0409e230 2023-09-30T22:24:27.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.129+0000 7f1f00ff9700 1 -- 172.21.15.40:0/3669954902 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4094+0+0 (secure 0 0 0) 0x7f1ef803f390 con 0x7f1f0409e230 2023-09-30T22:24:27.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.130+0000 7f1f0a2ac700 1 -- 172.21.15.40:0/3669954902 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f041237a0 con 0x7f1f0409e230 2023-09-30T22:24:27.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.139+0000 7f1f00ff9700 1 -- 172.21.15.40:0/3669954902 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1ef80123b0 con 0x7f1f0409e230 2023-09-30T22:24:27.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.148+0000 7f1f00ff9700 1 -- 172.21.15.40:0/3669954902 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f1ef80138e0 con 0x7f1f0409e230 2023-09-30T22:24:27.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.200+0000 7f5c7b382700 1 Processor -- start 2023-09-30T22:24:27.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.200+0000 7f5c7b382700 1 -- start start 2023-09-30T22:24:27.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.201+0000 7f5c7b382700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5c7412f070 0x7f5c74135c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.201+0000 7f5c7b382700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c74136170 0x7f5c74138550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.201+0000 7f5c7b382700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c7409ab70 con 0x7f5c7412e590 2023-09-30T22:24:27.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.201+0000 7f5c7b382700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c7412f470 con 0x7f5c7412f070 2023-09-30T22:24:27.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.201+0000 7f5c7b382700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7409b270 con 0x7f5c74136170 2023-09-30T22:24:27.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.201+0000 7f5c7891d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5c7412f070 0x7f5c74135c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.201+0000 7f5c7891d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5c7412f070 0x7f5c74135c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46394/0 (socket says 172.21.15.40:46394) 2023-09-30T22:24:27.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.201+0000 7f5c7891d700 1 -- 172.21.15.40:0/1951406686 learned_addr learned my addr 172.21.15.40:0/1951406686 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:27.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.201+0000 7f5c7991f700 1 --2- 172.21.15.40:0/1951406686 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c74136170 0x7f5c74138550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.202+0000 7f5c7891d700 1 -- 172.21.15.40:0/1951406686 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c74136170 msgr2=0x7f5c74138550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:27.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.202+0000 7f5c7891d700 1 --2- 172.21.15.40:0/1951406686 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c74136170 0x7f5c74138550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.202+0000 7f5c7891d700 1 -- 172.21.15.40:0/1951406686 >> v1:172.21.15.40:6789/0 conn(0x7f5c7412e590 legacy=0x7f5c7412e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.202+0000 7f5c6bfff700 1 -- 172.21.15.40:0/1951406686 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2469016206 0 0) 0x7f5c7409ab70 con 0x7f5c7412e590 2023-09-30T22:24:27.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.202+0000 7f5c7891d700 1 -- 172.21.15.40:0/1951406686 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c7409bd70 con 0x7f5c7412f070 2023-09-30T22:24:27.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.202+0000 7f5c7891d700 1 --2- 172.21.15.40:0/1951406686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c7412f070 0x7f5c74135c30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5c640098f0 tx=0x7f5c64009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d7d98220b296a71 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:27.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.202+0000 7f5c6bfff700 1 -- 172.21.15.40:0/1951406686 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c64011830 con 0x7f5c7412f070 2023-09-30T22:24:27.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.202+0000 7f5c6bfff700 1 -- 172.21.15.40:0/1951406686 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c64011990 con 0x7f5c7412f070 2023-09-30T22:24:27.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.202+0000 7f5c6bfff700 1 -- 172.21.15.40:0/1951406686 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c64011d20 con 0x7f5c7412f070 2023-09-30T22:24:27.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.203+0000 7f5c7b382700 1 -- 172.21.15.40:0/1951406686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c7412f070 msgr2=0x7f5c74135c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.203+0000 7f5c7b382700 1 --2- 172.21.15.40:0/1951406686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c7412f070 0x7f5c74135c30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5c640098f0 tx=0x7f5c64009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:27.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.203+0000 7f5c7b382700 1 -- 172.21.15.40:0/1951406686 shutdown_connections 2023-09-30T22:24:27.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.203+0000 7f5c7b382700 1 --2- 172.21.15.40:0/1951406686 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c74136170 0x7f5c74138550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.203+0000 7f5c7b382700 1 --2- 172.21.15.40:0/1951406686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c7412f070 0x7f5c74135c30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.203+0000 7f5c7b382700 1 -- 172.21.15.40:0/1951406686 >> 172.21.15.40:0/1951406686 conn(0x7f5c740a2a00 msgr2=0x7f5c740a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:27.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.203+0000 7f5c7b382700 1 -- 172.21.15.40:0/1951406686 shutdown_connections 2023-09-30T22:24:27.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.203+0000 7f5c7b382700 1 -- 172.21.15.40:0/1951406686 wait complete. 2023-09-30T22:24:27.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.204+0000 7f5c7b382700 1 Processor -- start 2023-09-30T22:24:27.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.204+0000 7f5c7b382700 1 -- start start 2023-09-30T22:24:27.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.205+0000 7f5c7b382700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c7412e590 0x7f5c741317f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.205+0000 7f5c7b382700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c7412f070 0x7f5c74131d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.205+0000 7f5c7b382700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c74136170 0x7f5c74132270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.205+0000 7f5c7b382700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7409b4b0 con 0x7f5c7412e590 2023-09-30T22:24:27.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.205+0000 7f5c7b382700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c74134090 con 0x7f5c74136170 2023-09-30T22:24:27.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.205+0000 7f5c7b382700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c740a0200 con 0x7f5c7412f070 2023-09-30T22:24:27.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.205+0000 7f5c7911e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c7412e590 0x7f5c741317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.205+0000 7f5c7991f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c74136170 0x7f5c74132270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.205+0000 7f5c7911e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c7412e590 0x7f5c741317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46402/0 (socket says 172.21.15.40:46402) 2023-09-30T22:24:27.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.205+0000 7f5c7991f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c74136170 0x7f5c74132270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52024/0 (socket says 172.21.15.40:52024) 2023-09-30T22:24:27.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.205+0000 7f5c7911e700 1 -- 172.21.15.40:0/3047998233 learned_addr learned my addr 172.21.15.40:0/3047998233 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:27.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.205+0000 7f5c7891d700 1 --2- 172.21.15.40:0/3047998233 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c7412f070 0x7f5c74131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.206+0000 7f5c7991f700 1 -- 172.21.15.40:0/3047998233 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c7412f070 msgr2=0x7f5c74131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.206+0000 7f5c7991f700 1 --2- 172.21.15.40:0/3047998233 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c7412f070 0x7f5c74131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.206+0000 7f5c7991f700 1 -- 172.21.15.40:0/3047998233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c7412e590 msgr2=0x7f5c741317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.206+0000 7f5c7991f700 1 --2- 172.21.15.40:0/3047998233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c7412e590 0x7f5c741317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.206+0000 7f5c7991f700 1 -- 172.21.15.40:0/3047998233 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c64009550 con 0x7f5c74136170 2023-09-30T22:24:27.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.206+0000 7f5c7911e700 1 --2- 172.21.15.40:0/3047998233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c7412e590 0x7f5c741317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:27.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.206+0000 7f5c7991f700 1 --2- 172.21.15.40:0/3047998233 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c74136170 0x7f5c74132270 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c00b360 tx=0x7f5c6c00b670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:27.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.206+0000 7f5c69ffb700 1 -- 172.21.15.40:0/3047998233 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c015070 con 0x7f5c74136170 2023-09-30T22:24:27.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.206+0000 7f5c69ffb700 1 -- 172.21.15.40:0/3047998233 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c6c00bce0 con 0x7f5c74136170 2023-09-30T22:24:27.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.206+0000 7f5c7b382700 1 -- 172.21.15.40:0/3047998233 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c74133dc0 con 0x7f5c74136170 2023-09-30T22:24:27.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.206+0000 7f5c69ffb700 1 -- 172.21.15.40:0/3047998233 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c019650 con 0x7f5c74136170 2023-09-30T22:24:27.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.206+0000 7f5c7b382700 1 -- 172.21.15.40:0/3047998233 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c74070980 con 0x7f5c74136170 2023-09-30T22:24:27.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.207+0000 7f5c69ffb700 1 -- 172.21.15.40:0/3047998233 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f5c6c0223b0 con 0x7f5c74136170 2023-09-30T22:24:27.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.207+0000 7f5c69ffb700 1 -- 172.21.15.40:0/3047998233 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4094+0+0 (secure 0 0 0) 0x7f5c6c043be0 con 0x7f5c74136170 2023-09-30T22:24:27.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.207+0000 7f5c7b382700 1 -- 172.21.15.40:0/3047998233 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c7409ea00 con 0x7f5c74136170 2023-09-30T22:24:27.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.212+0000 7f5c69ffb700 1 -- 172.21.15.40:0/3047998233 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5c6c0202c0 con 0x7f5c74136170 2023-09-30T22:24:27.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.234+0000 7f2b4bbc9700 1 Processor -- start 2023-09-30T22:24:27.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.234+0000 7f2b4bbc9700 1 -- start start 2023-09-30T22:24:27.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.235+0000 7f2b4bbc9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2b4406fb50 0x7f2b44136c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.235+0000 7f2b4bbc9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b441371b0 0x7f2b44139590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.235+0000 7f2b4bbc9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b44070830 con 0x7f2b4406f070 2023-09-30T22:24:27.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.235+0000 7f2b4bbc9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b44070ad0 con 0x7f2b4406fb50 2023-09-30T22:24:27.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.235+0000 7f2b4bbc9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b44070de0 con 0x7f2b441371b0 2023-09-30T22:24:27.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.235+0000 7f2b49164700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2b4406fb50 0x7f2b44136c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.235+0000 7f2b49965700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2b4406f070 0x7f2b4406f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40200/0 (socket says 172.21.15.40:40200) 2023-09-30T22:24:27.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.235+0000 7f2b49164700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2b4406fb50 0x7f2b44136c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46406/0 (socket says 172.21.15.40:46406) 2023-09-30T22:24:27.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.235+0000 7f2b49965700 1 -- 172.21.15.40:0/2836219513 learned_addr learned my addr 172.21.15.40:0/2836219513 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:24:27.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.235+0000 7f2b4a166700 1 --2- 172.21.15.40:0/2836219513 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b441371b0 0x7f2b44139590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.235+0000 7f2b49164700 1 -- 172.21.15.40:0/2836219513 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b441371b0 msgr2=0x7f2b44139590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:27.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.235+0000 7f2b49164700 1 --2- 172.21.15.40:0/2836219513 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b441371b0 0x7f2b44139590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.235+0000 7f2b49164700 1 -- 172.21.15.40:0/2836219513 >> v1:172.21.15.40:6789/0 conn(0x7f2b4406f070 legacy=0x7f2b4406f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.235+0000 7f2b49164700 1 -- 172.21.15.40:0/2836219513 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4409fe20 con 0x7f2b4406fb50 2023-09-30T22:24:27.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.235+0000 7f2b49164700 1 --2- 172.21.15.40:0/2836219513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b4406fb50 0x7f2b44136c70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2b34009840 tx=0x7f2b34009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c617523c31d5d506 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:27.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.236+0000 7f2b48963700 1 -- 172.21.15.40:0/2836219513 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b34011830 con 0x7f2b4406fb50 2023-09-30T22:24:27.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.236+0000 7f2b48963700 1 -- 172.21.15.40:0/2836219513 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b34011990 con 0x7f2b4406fb50 2023-09-30T22:24:27.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.236+0000 7f2b48963700 1 -- 172.21.15.40:0/2836219513 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b34011d20 con 0x7f2b4406fb50 2023-09-30T22:24:27.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.236+0000 7f2b4bbc9700 1 -- 172.21.15.40:0/2836219513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b4406fb50 msgr2=0x7f2b44136c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.236+0000 7f2b4bbc9700 1 --2- 172.21.15.40:0/2836219513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b4406fb50 0x7f2b44136c70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2b34009840 tx=0x7f2b34009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:27.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.236+0000 7f2b4bbc9700 1 -- 172.21.15.40:0/2836219513 shutdown_connections 2023-09-30T22:24:27.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.236+0000 7f2b4bbc9700 1 --2- 172.21.15.40:0/2836219513 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b441371b0 0x7f2b44139590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.236+0000 7f2b4bbc9700 1 --2- 172.21.15.40:0/2836219513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b4406fb50 0x7f2b44136c70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.236+0000 7f2b4bbc9700 1 -- 172.21.15.40:0/2836219513 >> 172.21.15.40:0/2836219513 conn(0x7f2b440a41a0 msgr2=0x7f2b440a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:27.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.236+0000 7f2b4bbc9700 1 -- 172.21.15.40:0/2836219513 shutdown_connections 2023-09-30T22:24:27.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.236+0000 7f2b4bbc9700 1 -- 172.21.15.40:0/2836219513 wait complete. 2023-09-30T22:24:27.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.237+0000 7f2b4bbc9700 1 Processor -- start 2023-09-30T22:24:27.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.237+0000 7f2b4bbc9700 1 -- start start 2023-09-30T22:24:27.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.238+0000 7f2b4bbc9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2b4406f070 0x7f2b44134640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.238+0000 7f2b4bbc9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b4406fb50 0x7f2b44134b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.238+0000 7f2b4bbc9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b441371b0 0x7f2b441350c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.238+0000 7f2b4bbc9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4412d560 con 0x7f2b441371b0 2023-09-30T22:24:27.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.238+0000 7f2b4bbc9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4412da40 con 0x7f2b4406fb50 2023-09-30T22:24:27.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.238+0000 7f2b4bbc9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4412d250 con 0x7f2b4406f070 2023-09-30T22:24:27.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.238+0000 7f2b49164700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b4406fb50 0x7f2b44134b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.238+0000 7f2b49164700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b4406fb50 0x7f2b44134b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52040/0 (socket says 172.21.15.40:52040) 2023-09-30T22:24:27.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.238+0000 7f2b49164700 1 -- 172.21.15.40:0/3584986152 learned_addr learned my addr 172.21.15.40:0/3584986152 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:27.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.238+0000 7f2b49965700 1 --2- 172.21.15.40:0/3584986152 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2b4406f070 0x7f2b44134640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.238+0000 7f2b4a166700 1 --2- 172.21.15.40:0/3584986152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b441371b0 0x7f2b441350c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.238+0000 7f2b49164700 1 -- 172.21.15.40:0/3584986152 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2b4406f070 msgr2=0x7f2b44134640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.238+0000 7f2b49164700 1 --2- 172.21.15.40:0/3584986152 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2b4406f070 0x7f2b44134640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.238+0000 7f2b49164700 1 -- 172.21.15.40:0/3584986152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b441371b0 msgr2=0x7f2b441350c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.238+0000 7f2b49164700 1 --2- 172.21.15.40:0/3584986152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b441371b0 0x7f2b441350c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.238+0000 7f2b49164700 1 -- 172.21.15.40:0/3584986152 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b340094a0 con 0x7f2b4406fb50 2023-09-30T22:24:27.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.238+0000 7f2b49164700 1 --2- 172.21.15.40:0/3584986152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b4406fb50 0x7f2b44134b80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2b44070c10 tx=0x7f2b34004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:27.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.239+0000 7f2b3a7fc700 1 -- 172.21.15.40:0/3584986152 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b34004400 con 0x7f2b4406fb50 2023-09-30T22:24:27.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.239+0000 7f2b3a7fc700 1 -- 172.21.15.40:0/3584986152 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b3401f070 con 0x7f2b4406fb50 2023-09-30T22:24:27.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.239+0000 7f2b4bbc9700 1 -- 172.21.15.40:0/3584986152 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b4412e4b0 con 0x7f2b4406fb50 2023-09-30T22:24:27.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.239+0000 7f2b3a7fc700 1 -- 172.21.15.40:0/3584986152 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b340038e0 con 0x7f2b4406fb50 2023-09-30T22:24:27.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.239+0000 7f2b4bbc9700 1 -- 172.21.15.40:0/3584986152 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b44136270 con 0x7f2b4406fb50 2023-09-30T22:24:27.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.240+0000 7f2b3a7fc700 1 -- 172.21.15.40:0/3584986152 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f2b34021030 con 0x7f2b4406fb50 2023-09-30T22:24:27.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.240+0000 7f2b3a7fc700 1 -- 172.21.15.40:0/3584986152 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4094+0+0 (secure 0 0 0) 0x7f2b34040c50 con 0x7f2b4406fb50 2023-09-30T22:24:27.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.240+0000 7f2b4bbc9700 1 -- 172.21.15.40:0/3584986152 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b4412d8a0 con 0x7f2b4406fb50 2023-09-30T22:24:27.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.245+0000 7f2b3a7fc700 1 -- 172.21.15.40:0/3584986152 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2b4412d8a0 con 0x7f2b4406fb50 2023-09-30T22:24:27.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.385+0000 7f1f0a2ac700 1 -- 172.21.15.40:0/3669954902 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1f0406ac40 con 0x7f1f0409e230 2023-09-30T22:24:27.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.385+0000 7f1f00ff9700 1 -- 172.21.15.40:0/3669954902 <== mon.0 v2:172.21.15.40:3300/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1ef801b500 con 0x7f1f0409e230 2023-09-30T22:24:27.386 INFO:teuthology.orchestra.run.smithi040.stdout:38654705696 2023-09-30T22:24:27.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.387+0000 7f1f0a2ac700 1 -- 172.21.15.40:0/3669954902 >> v1:172.21.15.40:6816/127432 conn(0x7f1ef002f240 legacy=0x7f1ef00316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.387+0000 7f1f0a2ac700 1 -- 172.21.15.40:0/3669954902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f0409e230 msgr2=0x7f1f04122e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.387+0000 7f1f0a2ac700 1 --2- 172.21.15.40:0/3669954902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f0409e230 0x7f1f04122e60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1ef800c550 tx=0x7f1ef800c860 comp rx=0 tx=0).stop 2023-09-30T22:24:27.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.387+0000 7f1f0a2ac700 1 -- 172.21.15.40:0/3669954902 shutdown_connections 2023-09-30T22:24:27.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.387+0000 7f1f0a2ac700 1 --2- 172.21.15.40:0/3669954902 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f041233a0 0x7f1f041c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.387+0000 7f1f0a2ac700 1 --2- 172.21.15.40:0/3669954902 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f0409d920 0x7f1f04122920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.387+0000 7f1f0a2ac700 1 --2- 172.21.15.40:0/3669954902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f0409e230 0x7f1f04122e60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.387+0000 7f1f0a2ac700 1 -- 172.21.15.40:0/3669954902 >> 172.21.15.40:0/3669954902 conn(0x7f1f0409fb20 msgr2=0x7f1f0406e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:27.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.387+0000 7f1f0a2ac700 1 -- 172.21.15.40:0/3669954902 shutdown_connections 2023-09-30T22:24:27.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.387+0000 7f1f0a2ac700 1 -- 172.21.15.40:0/3669954902 wait complete. 2023-09-30T22:24:27.400 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705696 for osd.1 2023-09-30T22:24:27.400 DEBUG:teuthology.parallel:result is None 2023-09-30T22:24:27.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.432+0000 7f5c7b382700 1 -- 172.21.15.40:0/3047998233 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5c74062380 con 0x7f5c74136170 2023-09-30T22:24:27.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.432+0000 7f5c69ffb700 1 -- 172.21.15.40:0/3047998233 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5c6c01e030 con 0x7f5c74136170 2023-09-30T22:24:27.433 INFO:teuthology.orchestra.run.smithi040.stdout:38654705696 2023-09-30T22:24:27.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.434+0000 7f5c7b382700 1 -- 172.21.15.40:0/3047998233 >> v1:172.21.15.40:6816/127432 conn(0x7f5c5802f480 legacy=0x7f5c58031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.434+0000 7f5c7b382700 1 -- 172.21.15.40:0/3047998233 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c74136170 msgr2=0x7f5c74132270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.434+0000 7f5c7b382700 1 --2- 172.21.15.40:0/3047998233 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c74136170 0x7f5c74132270 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c00b360 tx=0x7f5c6c00b670 comp rx=0 tx=0).stop 2023-09-30T22:24:27.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.434+0000 7f5c7b382700 1 -- 172.21.15.40:0/3047998233 shutdown_connections 2023-09-30T22:24:27.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.434+0000 7f5c7b382700 1 --2- 172.21.15.40:0/3047998233 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c74136170 0x7f5c74132270 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.434+0000 7f5c7b382700 1 --2- 172.21.15.40:0/3047998233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c7412e590 0x7f5c741317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.434+0000 7f5c7b382700 1 --2- 172.21.15.40:0/3047998233 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c7412f070 0x7f5c74131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.434+0000 7f5c7b382700 1 -- 172.21.15.40:0/3047998233 >> 172.21.15.40:0/3047998233 conn(0x7f5c740a2a00 msgr2=0x7f5c74099a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:27.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.434+0000 7f5c7b382700 1 -- 172.21.15.40:0/3047998233 shutdown_connections 2023-09-30T22:24:27.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.434+0000 7f5c7b382700 1 -- 172.21.15.40:0/3047998233 wait complete. 2023-09-30T22:24:27.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.441+0000 7f2b4bbc9700 1 -- 172.21.15.40:0/3584986152 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2b4412d8a0 con 0x7f2b4406fb50 2023-09-30T22:24:27.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.442+0000 7f2b3a7fc700 1 -- 172.21.15.40:0/3584986152 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2b4412d8a0 con 0x7f2b4406fb50 2023-09-30T22:24:27.442 INFO:teuthology.orchestra.run.smithi040.stdout:38654705696 2023-09-30T22:24:27.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.444+0000 7f2b4bbc9700 1 -- 172.21.15.40:0/3584986152 >> v1:172.21.15.40:6816/127432 conn(0x7f2b2802f480 legacy=0x7f2b28031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.444+0000 7f2b4bbc9700 1 -- 172.21.15.40:0/3584986152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b4406fb50 msgr2=0x7f2b44134b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.444+0000 7f2b4bbc9700 1 --2- 172.21.15.40:0/3584986152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b4406fb50 0x7f2b44134b80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2b44070c10 tx=0x7f2b34004750 comp rx=0 tx=0).stop 2023-09-30T22:24:27.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.444+0000 7f2b4bbc9700 1 -- 172.21.15.40:0/3584986152 shutdown_connections 2023-09-30T22:24:27.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.444+0000 7f2b4bbc9700 1 --2- 172.21.15.40:0/3584986152 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2b4406f070 0x7f2b44134640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.444+0000 7f2b4bbc9700 1 --2- 172.21.15.40:0/3584986152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b441371b0 0x7f2b441350c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.444+0000 7f2b4bbc9700 1 --2- 172.21.15.40:0/3584986152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b4406fb50 0x7f2b44134b80 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.444+0000 7f2b4bbc9700 1 -- 172.21.15.40:0/3584986152 >> 172.21.15.40:0/3584986152 conn(0x7f2b440a41a0 msgr2=0x7f2b44137580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:27.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.444+0000 7f2b4bbc9700 1 -- 172.21.15.40:0/3584986152 shutdown_connections 2023-09-30T22:24:27.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.444+0000 7f2b4bbc9700 1 -- 172.21.15.40:0/3584986152 wait complete. 2023-09-30T22:24:27.447 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705696 for osd.2 2023-09-30T22:24:27.447 DEBUG:teuthology.parallel:result is None 2023-09-30T22:24:27.456 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705696 for osd.0 2023-09-30T22:24:27.456 DEBUG:teuthology.parallel:result is None 2023-09-30T22:24:27.457 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-30T22:24:27.457 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:24:27.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.621+0000 7fbc6ba08700 1 Processor -- start 2023-09-30T22:24:27.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.621+0000 7fbc6ba08700 1 -- start start 2023-09-30T22:24:27.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.621+0000 7fbc6ba08700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc6409c890 0x7fbc6409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.621+0000 7fbc6ba08700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc6409d920 0x7fbc6409dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.621+0000 7fbc6ba08700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc640a2600 con 0x7fbc6409e2b0 2023-09-30T22:24:27.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.621+0000 7fbc6ba08700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc640a29d0 con 0x7fbc6409d920 2023-09-30T22:24:27.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.621+0000 7fbc6ba08700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6409fb40 con 0x7fbc6409c890 2023-09-30T22:24:27.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.621+0000 7fbc68fa3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc6409d920 0x7fbc6409dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.621+0000 7fbc697a4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc6409c890 0x7fbc6409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.621+0000 7fbc697a4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc6409c890 0x7fbc6409cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33138/0 (socket says 172.21.15.40:33138) 2023-09-30T22:24:27.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.621+0000 7fbc68fa3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc6409d920 0x7fbc6409dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52054/0 (socket says 172.21.15.40:52054) 2023-09-30T22:24:27.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.621+0000 7fbc697a4700 1 -- 172.21.15.40:0/2589308320 learned_addr learned my addr 172.21.15.40:0/2589308320 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:27.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.621+0000 7fbc69fa5700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbc6409e2b0 0x7fbc6413ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40212/0 (socket says 172.21.15.40:40212) 2023-09-30T22:24:27.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.622+0000 7fbc68fa3700 1 -- 172.21.15.40:0/2589308320 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc6409c890 msgr2=0x7fbc6409cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:27.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.622+0000 7fbc5bfff700 1 -- 172.21.15.40:0/2589308320 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1491625639 0 0) 0x7fbc640a2600 con 0x7fbc6409e2b0 2023-09-30T22:24:27.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.622+0000 7fbc68fa3700 1 --2- 172.21.15.40:0/2589308320 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc6409c890 0x7fbc6409cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.622+0000 7fbc68fa3700 1 -- 172.21.15.40:0/2589308320 >> v1:172.21.15.40:6789/0 conn(0x7fbc6409e2b0 legacy=0x7fbc6413ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.622+0000 7fbc68fa3700 1 -- 172.21.15.40:0/2589308320 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6409e720 con 0x7fbc6409d920 2023-09-30T22:24:27.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.622+0000 7fbc697a4700 1 --2- 172.21.15.40:0/2589308320 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc6409c890 0x7fbc6409cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:27.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.622+0000 7fbc68fa3700 1 --2- 172.21.15.40:0/2589308320 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc6409d920 0x7fbc6409dd70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbc54009870 tx=0x7fbc54009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4dc04a47df9cbb0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:27.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.622+0000 7fbc5bfff700 1 -- 172.21.15.40:0/2589308320 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc54011830 con 0x7fbc6409d920 2023-09-30T22:24:27.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.622+0000 7fbc5bfff700 1 -- 172.21.15.40:0/2589308320 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc54011990 con 0x7fbc6409d920 2023-09-30T22:24:27.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.622+0000 7fbc5bfff700 1 -- 172.21.15.40:0/2589308320 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc54011d20 con 0x7fbc6409d920 2023-09-30T22:24:27.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.622+0000 7fbc6ba08700 1 -- 172.21.15.40:0/2589308320 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc6409d920 msgr2=0x7fbc6409dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.622+0000 7fbc6ba08700 1 --2- 172.21.15.40:0/2589308320 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc6409d920 0x7fbc6409dd70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbc54009870 tx=0x7fbc54009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:27.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.622+0000 7fbc6ba08700 1 -- 172.21.15.40:0/2589308320 shutdown_connections 2023-09-30T22:24:27.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.622+0000 7fbc6ba08700 1 --2- 172.21.15.40:0/2589308320 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc6409c890 0x7fbc6409cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.622+0000 7fbc6ba08700 1 --2- 172.21.15.40:0/2589308320 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc6409d920 0x7fbc6409dd70 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.623+0000 7fbc6ba08700 1 -- 172.21.15.40:0/2589308320 >> 172.21.15.40:0/2589308320 conn(0x7fbc640a7080 msgr2=0x7fbc640a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:27.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.623+0000 7fbc6ba08700 1 -- 172.21.15.40:0/2589308320 shutdown_connections 2023-09-30T22:24:27.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.623+0000 7fbc6ba08700 1 -- 172.21.15.40:0/2589308320 wait complete. 2023-09-30T22:24:27.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.623+0000 7fbc6ba08700 1 Processor -- start 2023-09-30T22:24:27.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.623+0000 7fbc6ba08700 1 -- start start 2023-09-30T22:24:27.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.624+0000 7fbc6ba08700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc6409c890 0x7fbc6412b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.624+0000 7fbc6ba08700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc6409d920 0x7fbc6412ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.624+0000 7fbc6ba08700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc6409e2b0 0x7fbc6412bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.624+0000 7fbc6ba08700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6412e5d0 con 0x7fbc6409e2b0 2023-09-30T22:24:27.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.624+0000 7fbc6ba08700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc640a59b0 con 0x7fbc6409c890 2023-09-30T22:24:27.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.624+0000 7fbc6ba08700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6409ecf0 con 0x7fbc6409d920 2023-09-30T22:24:27.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.624+0000 7fbc697a4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc6409c890 0x7fbc6412b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.624+0000 7fbc69fa5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc6409e2b0 0x7fbc6412bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.624+0000 7fbc68fa3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc6409d920 0x7fbc6412ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.624+0000 7fbc697a4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc6409c890 0x7fbc6412b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52062/0 (socket says 172.21.15.40:52062) 2023-09-30T22:24:27.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.624+0000 7fbc697a4700 1 -- 172.21.15.40:0/1557729608 learned_addr learned my addr 172.21.15.40:0/1557729608 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:27.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.624+0000 7fbc68fa3700 1 -- 172.21.15.40:0/1557729608 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc6409c890 msgr2=0x7fbc6412b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.624+0000 7fbc68fa3700 1 --2- 172.21.15.40:0/1557729608 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc6409c890 0x7fbc6412b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.624+0000 7fbc68fa3700 1 -- 172.21.15.40:0/1557729608 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc6409e2b0 msgr2=0x7fbc6412bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.624+0000 7fbc68fa3700 1 --2- 172.21.15.40:0/1557729608 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc6409e2b0 0x7fbc6412bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.624+0000 7fbc68fa3700 1 -- 172.21.15.40:0/1557729608 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc60009500 con 0x7fbc6409d920 2023-09-30T22:24:27.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.624+0000 7fbc69fa5700 1 --2- 172.21.15.40:0/1557729608 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc6409e2b0 0x7fbc6412bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:27.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.624+0000 7fbc68fa3700 1 --2- 172.21.15.40:0/1557729608 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc6409d920 0x7fbc6412ba20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbc54016000 tx=0x7fbc54004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:27.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.625+0000 7fbc59ffb700 1 -- 172.21.15.40:0/1557729608 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc54004300 con 0x7fbc6409d920 2023-09-30T22:24:27.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.625+0000 7fbc59ffb700 1 -- 172.21.15.40:0/1557729608 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5401f070 con 0x7fbc6409d920 2023-09-30T22:24:27.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.625+0000 7fbc6ba08700 1 -- 172.21.15.40:0/1557729608 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc540094a0 con 0x7fbc6409d920 2023-09-30T22:24:27.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.625+0000 7fbc59ffb700 1 -- 172.21.15.40:0/1557729608 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc540036a0 con 0x7fbc6409d920 2023-09-30T22:24:27.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.625+0000 7fbc6ba08700 1 -- 172.21.15.40:0/1557729608 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc6412ef90 con 0x7fbc6409d920 2023-09-30T22:24:27.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.626+0000 7fbc59ffb700 1 -- 172.21.15.40:0/1557729608 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7fbc54021030 con 0x7fbc6409d920 2023-09-30T22:24:27.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.626+0000 7fbc59ffb700 1 -- 172.21.15.40:0/1557729608 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4094+0+0 (secure 0 0 0) 0x7fbc54040a40 con 0x7fbc6409d920 2023-09-30T22:24:27.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.626+0000 7fbc6ba08700 1 -- 172.21.15.40:0/1557729608 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc6406e600 con 0x7fbc6409d920 2023-09-30T22:24:27.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.631+0000 7fbc59ffb700 1 -- 172.21.15.40:0/1557729608 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbc54015020 con 0x7fbc6409d920 2023-09-30T22:24:27.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.821+0000 7fbc6ba08700 1 -- 172.21.15.40:0/1557729608 --> v1:172.21.15.40:6816/127432 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbc640a2c10 con 0x7fbc4802f480 2023-09-30T22:24:27.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.829+0000 7fbc59ffb700 1 -- 172.21.15.40:0/1557729608 <== mgr.14099 v1:172.21.15.40:6816/127432 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+270371 (unknown 2965378022 0 1289589766) 0x7fbc60009930 con 0x7fbc4802f480 2023-09-30T22:24:27.832 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:24:27.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.832+0000 7fbc6ba08700 1 -- 172.21.15.40:0/1557729608 >> v1:172.21.15.40:6816/127432 conn(0x7fbc4802f480 legacy=0x7fbc48031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.832+0000 7fbc6ba08700 1 -- 172.21.15.40:0/1557729608 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc6409d920 msgr2=0x7fbc6412ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.832+0000 7fbc6ba08700 1 --2- 172.21.15.40:0/1557729608 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc6409d920 0x7fbc6412ba20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbc54016000 tx=0x7fbc54004750 comp rx=0 tx=0).stop 2023-09-30T22:24:27.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.832+0000 7fbc6ba08700 1 -- 172.21.15.40:0/1557729608 shutdown_connections 2023-09-30T22:24:27.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.832+0000 7fbc6ba08700 1 --2- 172.21.15.40:0/1557729608 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc6409e2b0 0x7fbc6412bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.832+0000 7fbc6ba08700 1 --2- 172.21.15.40:0/1557729608 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc6409c890 0x7fbc6412b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.832+0000 7fbc6ba08700 1 --2- 172.21.15.40:0/1557729608 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc6409d920 0x7fbc6412ba20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.832+0000 7fbc6ba08700 1 -- 172.21.15.40:0/1557729608 >> 172.21.15.40:0/1557729608 conn(0x7fbc640a7080 msgr2=0x7fbc641baee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:27.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.832+0000 7fbc6ba08700 1 -- 172.21.15.40:0/1557729608 shutdown_connections 2023-09-30T22:24:27.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:27.832+0000 7fbc6ba08700 1 -- 172.21.15.40:0/1557729608 wait complete. 2023-09-30T22:24:27.835 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-09-30T22:24:27.844 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2023-09-30T22:24:26.140846+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4317,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189192,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298168,"statfs":{"total":386547056640,"available":385329324032,"internally_reserved":0,"allocated":827392,"data_stored":291705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.996192"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.785153+0000","last_change":"2023-09-30T22:22:53.776858+0000","last_active":"2023-09-30T22:23:54.785153+0000","last_peered":"2023-09-30T22:23:54.785153+0000","last_clean":"2023-09-30T22:23:54.785153+0000","last_became_active":"2023-09-30T22:22:53.776533+0000","last_became_peered":"2023-09-30T22:22:53.776533+0000","last_unstale":"2023-09-30T22:23:54.785153+0000","last_undegraded":"2023-09-30T22:23:54.785153+0000","last_fullsized":"2023-09-30T22:23:54.785153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.785599+0000","last_change":"2023-09-30T22:22:02.377806+0000","last_active":"2023-09-30T22:23:54.785599+0000","last_peered":"2023-09-30T22:23:54.785599+0000","last_clean":"2023-09-30T22:23:54.785599+0000","last_became_active":"2023-09-30T22:22:02.377531+0000","last_became_peered":"2023-09-30T22:22:02.377531+0000","last_unstale":"2023-09-30T22:23:54.785599+0000","last_undegraded":"2023-09-30T22:23:54.785599+0000","last_fullsized":"2023-09-30T22:23:54.785599+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906353+0000","last_change":"2023-09-30T22:22:02.379022+0000","last_active":"2023-09-30T22:23:54.906353+0000","last_peered":"2023-09-30T22:23:54.906353+0000","last_clean":"2023-09-30T22:23:54.906353+0000","last_became_active":"2023-09-30T22:22:02.378723+0000","last_became_peered":"2023-09-30T22:22:02.378723+0000","last_unstale":"2023-09-30T22:23:54.906353+0000","last_undegraded":"2023-09-30T22:23:54.906353+0000","last_fullsized":"2023-09-30T22:23:54.906353+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906102+0000","last_change":"2023-09-30T22:22:02.378089+0000","last_active":"2023-09-30T22:23:54.906102+0000","last_peered":"2023-09-30T22:23:54.906102+0000","last_clean":"2023-09-30T22:23:54.906102+0000","last_became_active":"2023-09-30T22:22:02.375446+0000","last_became_peered":"2023-09-30T22:22:02.375446+0000","last_unstale":"2023-09-30T22:23:54.906102+0000","last_undegraded":"2023-09-30T22:23:54.906102+0000","last_fullsized":"2023-09-30T22:23:54.906102+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906289+0000","last_change":"2023-09-30T22:22:02.398073+0000","last_active":"2023-09-30T22:23:54.906289+0000","last_peered":"2023-09-30T22:23:54.906289+0000","last_clean":"2023-09-30T22:23:54.906289+0000","last_became_active":"2023-09-30T22:22:02.397855+0000","last_became_peered":"2023-09-30T22:22:02.397855+0000","last_unstale":"2023-09-30T22:23:54.906289+0000","last_undegraded":"2023-09-30T22:23:54.906289+0000","last_fullsized":"2023-09-30T22:23:54.906289+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136504+0000","last_change":"2023-09-30T22:22:02.382862+0000","last_active":"2023-09-30T22:24:24.136504+0000","last_peered":"2023-09-30T22:24:24.136504+0000","last_clean":"2023-09-30T22:24:24.136504+0000","last_became_active":"2023-09-30T22:22:02.382464+0000","last_became_peered":"2023-09-30T22:22:02.382464+0000","last_unstale":"2023-09-30T22:24:24.136504+0000","last_undegraded":"2023-09-30T22:24:24.136504+0000","last_fullsized":"2023-09-30T22:24:24.136504+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136848+0000","last_change":"2023-09-30T22:22:02.395909+0000","last_active":"2023-09-30T22:24:24.136848+0000","last_peered":"2023-09-30T22:24:24.136848+0000","last_clean":"2023-09-30T22:24:24.136848+0000","last_became_active":"2023-09-30T22:22:02.395379+0000","last_became_peered":"2023-09-30T22:22:02.395379+0000","last_unstale":"2023-09-30T22:24:24.136848+0000","last_undegraded":"2023-09-30T22:24:24.136848+0000","last_fullsized":"2023-09-30T22:24:24.136848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.135781+0000","last_change":"2023-09-30T22:22:02.382627+0000","last_active":"2023-09-30T22:24:24.135781+0000","last_peered":"2023-09-30T22:24:24.135781+0000","last_clean":"2023-09-30T22:24:24.135781+0000","last_became_active":"2023-09-30T22:22:02.382360+0000","last_became_peered":"2023-09-30T22:22:02.382360+0000","last_unstale":"2023-09-30T22:24:24.135781+0000","last_undegraded":"2023-09-30T22:24:24.135781+0000","last_fullsized":"2023-09-30T22:24:24.135781+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906766+0000","last_change":"2023-09-30T22:22:02.388864+0000","last_active":"2023-09-30T22:23:54.906766+0000","last_peered":"2023-09-30T22:23:54.906766+0000","last_clean":"2023-09-30T22:23:54.906766+0000","last_became_active":"2023-09-30T22:22:02.388267+0000","last_became_peered":"2023-09-30T22:22:02.388267+0000","last_unstale":"2023-09-30T22:23:54.906766+0000","last_undegraded":"2023-09-30T22:23:54.906766+0000","last_fullsized":"2023-09-30T22:23:54.906766+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137037+0000","last_change":"2023-09-30T22:22:02.379619+0000","last_active":"2023-09-30T22:24:24.137037+0000","last_peered":"2023-09-30T22:24:24.137037+0000","last_clean":"2023-09-30T22:24:24.137037+0000","last_became_active":"2023-09-30T22:22:02.379412+0000","last_became_peered":"2023-09-30T22:22:02.379412+0000","last_unstale":"2023-09-30T22:24:24.137037+0000","last_undegraded":"2023-09-30T22:24:24.137037+0000","last_fullsized":"2023-09-30T22:24:24.137037+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136809+0000","last_change":"2023-09-30T22:22:02.372757+0000","last_active":"2023-09-30T22:24:24.136809+0000","last_peered":"2023-09-30T22:24:24.136809+0000","last_clean":"2023-09-30T22:24:24.136809+0000","last_became_active":"2023-09-30T22:22:02.372495+0000","last_became_peered":"2023-09-30T22:22:02.372495+0000","last_unstale":"2023-09-30T22:24:24.136809+0000","last_undegraded":"2023-09-30T22:24:24.136809+0000","last_fullsized":"2023-09-30T22:24:24.136809+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.784512+0000","last_change":"2023-09-30T22:22:02.379525+0000","last_active":"2023-09-30T22:23:54.784512+0000","last_peered":"2023-09-30T22:23:54.784512+0000","last_clean":"2023-09-30T22:23:54.784512+0000","last_became_active":"2023-09-30T22:22:02.379330+0000","last_became_peered":"2023-09-30T22:22:02.379330+0000","last_unstale":"2023-09-30T22:23:54.784512+0000","last_undegraded":"2023-09-30T22:23:54.784512+0000","last_fullsized":"2023-09-30T22:23:54.784512+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.784799+0000","last_change":"2023-09-30T22:22:02.387803+0000","last_active":"2023-09-30T22:23:54.784799+0000","last_peered":"2023-09-30T22:23:54.784799+0000","last_clean":"2023-09-30T22:23:54.784799+0000","last_became_active":"2023-09-30T22:22:02.387560+0000","last_became_peered":"2023-09-30T22:22:02.387560+0000","last_unstale":"2023-09-30T22:23:54.784799+0000","last_undegraded":"2023-09-30T22:23:54.784799+0000","last_fullsized":"2023-09-30T22:23:54.784799+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136515+0000","last_change":"2023-09-30T22:22:02.374488+0000","last_active":"2023-09-30T22:24:24.136515+0000","last_peered":"2023-09-30T22:24:24.136515+0000","last_clean":"2023-09-30T22:24:24.136515+0000","last_became_active":"2023-09-30T22:22:02.374287+0000","last_became_peered":"2023-09-30T22:22:02.374287+0000","last_unstale":"2023-09-30T22:24:24.136515+0000","last_undegraded":"2023-09-30T22:24:24.136515+0000","last_fullsized":"2023-09-30T22:24:24.136515+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.905859+0000","last_change":"2023-09-30T22:22:02.375916+0000","last_active":"2023-09-30T22:23:54.905859+0000","last_peered":"2023-09-30T22:23:54.905859+0000","last_clean":"2023-09-30T22:23:54.905859+0000","last_became_active":"2023-09-30T22:22:02.374277+0000","last_became_peered":"2023-09-30T22:22:02.374277+0000","last_unstale":"2023-09-30T22:23:54.905859+0000","last_undegraded":"2023-09-30T22:23:54.905859+0000","last_fullsized":"2023-09-30T22:23:54.905859+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136250+0000","last_change":"2023-09-30T22:22:02.395769+0000","last_active":"2023-09-30T22:24:24.136250+0000","last_peered":"2023-09-30T22:24:24.136250+0000","last_clean":"2023-09-30T22:24:24.136250+0000","last_became_active":"2023-09-30T22:22:02.395459+0000","last_became_peered":"2023-09-30T22:22:02.395459+0000","last_unstale":"2023-09-30T22:24:24.136250+0000","last_undegraded":"2023-09-30T22:24:24.136250+0000","last_fullsized":"2023-09-30T22:24:24.136250+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906728+0000","last_change":"2023-09-30T22:22:02.391303+0000","last_active":"2023-09-30T22:23:54.906728+0000","last_peered":"2023-09-30T22:23:54.906728+0000","last_clean":"2023-09-30T22:23:54.906728+0000","last_became_active":"2023-09-30T22:22:02.388602+0000","last_became_peered":"2023-09-30T22:22:02.388602+0000","last_unstale":"2023-09-30T22:23:54.906728+0000","last_undegraded":"2023-09-30T22:23:54.906728+0000","last_fullsized":"2023-09-30T22:23:54.906728+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906324+0000","last_change":"2023-09-30T22:22:02.376471+0000","last_active":"2023-09-30T22:23:54.906324+0000","last_peered":"2023-09-30T22:23:54.906324+0000","last_clean":"2023-09-30T22:23:54.906324+0000","last_became_active":"2023-09-30T22:22:02.374833+0000","last_became_peered":"2023-09-30T22:22:02.374833+0000","last_unstale":"2023-09-30T22:23:54.906324+0000","last_undegraded":"2023-09-30T22:23:54.906324+0000","last_fullsized":"2023-09-30T22:23:54.906324+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.784989+0000","last_change":"2023-09-30T22:22:02.383103+0000","last_active":"2023-09-30T22:23:54.784989+0000","last_peered":"2023-09-30T22:23:54.784989+0000","last_clean":"2023-09-30T22:23:54.784989+0000","last_became_active":"2023-09-30T22:22:02.382818+0000","last_became_peered":"2023-09-30T22:22:02.382818+0000","last_unstale":"2023-09-30T22:23:54.784989+0000","last_undegraded":"2023-09-30T22:23:54.784989+0000","last_fullsized":"2023-09-30T22:23:54.784989+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.784596+0000","last_change":"2023-09-30T22:22:53.778065+0000","last_active":"2023-09-30T22:23:54.784596+0000","last_peered":"2023-09-30T22:23:54.784596+0000","last_clean":"2023-09-30T22:23:54.784596+0000","last_became_active":"2023-09-30T22:22:53.777585+0000","last_became_peered":"2023-09-30T22:22:53.777585+0000","last_unstale":"2023-09-30T22:23:54.784596+0000","last_undegraded":"2023-09-30T22:23:54.784596+0000","last_fullsized":"2023-09-30T22:23:54.784596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.135996+0000","last_change":"2023-09-30T22:22:02.391309+0000","last_active":"2023-09-30T22:24:24.135996+0000","last_peered":"2023-09-30T22:24:24.135996+0000","last_clean":"2023-09-30T22:24:24.135996+0000","last_became_active":"2023-09-30T22:22:02.391040+0000","last_became_peered":"2023-09-30T22:22:02.391040+0000","last_unstale":"2023-09-30T22:24:24.135996+0000","last_undegraded":"2023-09-30T22:24:24.135996+0000","last_fullsized":"2023-09-30T22:24:24.135996+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.905981+0000","last_change":"2023-09-30T22:22:02.375857+0000","last_active":"2023-09-30T22:23:54.905981+0000","last_peered":"2023-09-30T22:23:54.905981+0000","last_clean":"2023-09-30T22:23:54.905981+0000","last_became_active":"2023-09-30T22:22:02.373866+0000","last_became_peered":"2023-09-30T22:22:02.373866+0000","last_unstale":"2023-09-30T22:23:54.905981+0000","last_undegraded":"2023-09-30T22:23:54.905981+0000","last_fullsized":"2023-09-30T22:23:54.905981+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136774+0000","last_change":"2023-09-30T22:22:02.395696+0000","last_active":"2023-09-30T22:24:24.136774+0000","last_peered":"2023-09-30T22:24:24.136774+0000","last_clean":"2023-09-30T22:24:24.136774+0000","last_became_active":"2023-09-30T22:22:02.395318+0000","last_became_peered":"2023-09-30T22:22:02.395318+0000","last_unstale":"2023-09-30T22:24:24.136774+0000","last_undegraded":"2023-09-30T22:24:24.136774+0000","last_fullsized":"2023-09-30T22:24:24.136774+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.135842+0000","last_change":"2023-09-30T22:22:02.389818+0000","last_active":"2023-09-30T22:24:24.135842+0000","last_peered":"2023-09-30T22:24:24.135842+0000","last_clean":"2023-09-30T22:24:24.135842+0000","last_became_active":"2023-09-30T22:22:02.389526+0000","last_became_peered":"2023-09-30T22:22:02.389526+0000","last_unstale":"2023-09-30T22:24:24.135842+0000","last_undegraded":"2023-09-30T22:24:24.135842+0000","last_fullsized":"2023-09-30T22:24:24.135842+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137347+0000","last_change":"2023-09-30T22:22:02.386166+0000","last_active":"2023-09-30T22:24:24.137347+0000","last_peered":"2023-09-30T22:24:24.137347+0000","last_clean":"2023-09-30T22:24:24.137347+0000","last_became_active":"2023-09-30T22:22:02.385731+0000","last_became_peered":"2023-09-30T22:22:02.385731+0000","last_unstale":"2023-09-30T22:24:24.137347+0000","last_undegraded":"2023-09-30T22:24:24.137347+0000","last_fullsized":"2023-09-30T22:24:24.137347+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136962+0000","last_change":"2023-09-30T22:22:02.374713+0000","last_active":"2023-09-30T22:24:24.136962+0000","last_peered":"2023-09-30T22:24:24.136962+0000","last_clean":"2023-09-30T22:24:24.136962+0000","last_became_active":"2023-09-30T22:22:02.374467+0000","last_became_peered":"2023-09-30T22:22:02.374467+0000","last_unstale":"2023-09-30T22:24:24.136962+0000","last_undegraded":"2023-09-30T22:24:24.136962+0000","last_fullsized":"2023-09-30T22:24:24.136962+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136917+0000","last_change":"2023-09-30T22:22:02.395766+0000","last_active":"2023-09-30T22:24:24.136917+0000","last_peered":"2023-09-30T22:24:24.136917+0000","last_clean":"2023-09-30T22:24:24.136917+0000","last_became_active":"2023-09-30T22:22:02.395487+0000","last_became_peered":"2023-09-30T22:22:02.395487+0000","last_unstale":"2023-09-30T22:24:24.136917+0000","last_undegraded":"2023-09-30T22:24:24.136917+0000","last_fullsized":"2023-09-30T22:24:24.136917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136222+0000","last_change":"2023-09-30T22:22:01.986896+0000","last_active":"2023-09-30T22:24:24.136222+0000","last_peered":"2023-09-30T22:24:24.136222+0000","last_clean":"2023-09-30T22:24:24.136222+0000","last_became_active":"2023-09-30T22:22:01.986600+0000","last_became_peered":"2023-09-30T22:22:01.986600+0000","last_unstale":"2023-09-30T22:24:24.136222+0000","last_undegraded":"2023-09-30T22:24:24.136222+0000","last_fullsized":"2023-09-30T22:24:24.136222+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.787587+0000","last_change":"2023-09-30T22:23:54.786953+0000","last_active":"2023-09-30T22:23:54.787587+0000","last_peered":"2023-09-30T22:23:54.787587+0000","last_clean":"2023-09-30T22:23:54.787587+0000","last_became_active":"2023-09-30T22:23:54.786631+0000","last_became_peered":"2023-09-30T22:23:54.786631+0000","last_unstale":"2023-09-30T22:23:54.787587+0000","last_undegraded":"2023-09-30T22:23:54.787587+0000","last_fullsized":"2023-09-30T22:23:54.787587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136044+0000","last_change":"2023-09-30T22:22:01.992230+0000","last_active":"2023-09-30T22:24:24.136044+0000","last_peered":"2023-09-30T22:24:24.136044+0000","last_clean":"2023-09-30T22:24:24.136044+0000","last_became_active":"2023-09-30T22:22:01.991929+0000","last_became_peered":"2023-09-30T22:22:01.991929+0000","last_unstale":"2023-09-30T22:24:24.136044+0000","last_undegraded":"2023-09-30T22:24:24.136044+0000","last_fullsized":"2023-09-30T22:24:24.136044+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906431+0000","last_change":"2023-09-30T22:22:02.380249+0000","last_active":"2023-09-30T22:23:54.906431+0000","last_peered":"2023-09-30T22:23:54.906431+0000","last_clean":"2023-09-30T22:23:54.906431+0000","last_became_active":"2023-09-30T22:22:02.379830+0000","last_became_peered":"2023-09-30T22:22:02.379830+0000","last_unstale":"2023-09-30T22:23:54.906431+0000","last_undegraded":"2023-09-30T22:23:54.906431+0000","last_fullsized":"2023-09-30T22:23:54.906431+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136547+0000","last_change":"2023-09-30T22:22:01.995093+0000","last_active":"2023-09-30T22:24:24.136547+0000","last_peered":"2023-09-30T22:24:24.136547+0000","last_clean":"2023-09-30T22:24:24.136547+0000","last_became_active":"2023-09-30T22:22:01.994797+0000","last_became_peered":"2023-09-30T22:22:01.994797+0000","last_unstale":"2023-09-30T22:24:24.136547+0000","last_undegraded":"2023-09-30T22:24:24.136547+0000","last_fullsized":"2023-09-30T22:24:24.136547+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.138721+0000","last_change":"2023-09-30T22:22:02.383534+0000","last_active":"2023-09-30T22:24:24.138721+0000","last_peered":"2023-09-30T22:24:24.138721+0000","last_clean":"2023-09-30T22:24:24.138721+0000","last_became_active":"2023-09-30T22:22:02.383271+0000","last_became_peered":"2023-09-30T22:22:02.383271+0000","last_unstale":"2023-09-30T22:24:24.138721+0000","last_undegraded":"2023-09-30T22:24:24.138721+0000","last_fullsized":"2023-09-30T22:24:24.138721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906644+0000","last_change":"2023-09-30T22:22:01.997405+0000","last_active":"2023-09-30T22:23:54.906644+0000","last_peered":"2023-09-30T22:23:54.906644+0000","last_clean":"2023-09-30T22:23:54.906644+0000","last_became_active":"2023-09-30T22:22:01.997079+0000","last_became_peered":"2023-09-30T22:22:01.997079+0000","last_unstale":"2023-09-30T22:23:54.906644+0000","last_undegraded":"2023-09-30T22:23:54.906644+0000","last_fullsized":"2023-09-30T22:23:54.906644+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136622+0000","last_change":"2023-09-30T22:22:02.381424+0000","last_active":"2023-09-30T22:24:24.136622+0000","last_peered":"2023-09-30T22:24:24.136622+0000","last_clean":"2023-09-30T22:24:24.136622+0000","last_became_active":"2023-09-30T22:22:02.380981+0000","last_became_peered":"2023-09-30T22:22:02.380981+0000","last_unstale":"2023-09-30T22:24:24.136622+0000","last_undegraded":"2023-09-30T22:24:24.136622+0000","last_fullsized":"2023-09-30T22:24:24.136622+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.785293+0000","last_change":"2023-09-30T22:22:01.995183+0000","last_active":"2023-09-30T22:23:54.785293+0000","last_peered":"2023-09-30T22:23:54.785293+0000","last_clean":"2023-09-30T22:23:54.785293+0000","last_became_active":"2023-09-30T22:22:01.994920+0000","last_became_peered":"2023-09-30T22:22:01.994920+0000","last_unstale":"2023-09-30T22:23:54.785293+0000","last_undegraded":"2023-09-30T22:23:54.785293+0000","last_fullsized":"2023-09-30T22:23:54.785293+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137220+0000","last_change":"2023-09-30T22:22:02.395975+0000","last_active":"2023-09-30T22:24:24.137220+0000","last_peered":"2023-09-30T22:24:24.137220+0000","last_clean":"2023-09-30T22:24:24.137220+0000","last_became_active":"2023-09-30T22:22:02.395719+0000","last_became_peered":"2023-09-30T22:22:02.395719+0000","last_unstale":"2023-09-30T22:24:24.137220+0000","last_undegraded":"2023-09-30T22:24:24.137220+0000","last_fullsized":"2023-09-30T22:24:24.137220+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906299+0000","last_change":"2023-09-30T22:22:01.998235+0000","last_active":"2023-09-30T22:23:54.906299+0000","last_peered":"2023-09-30T22:23:54.906299+0000","last_clean":"2023-09-30T22:23:54.906299+0000","last_became_active":"2023-09-30T22:22:01.997649+0000","last_became_peered":"2023-09-30T22:22:01.997649+0000","last_unstale":"2023-09-30T22:23:54.906299+0000","last_undegraded":"2023-09-30T22:23:54.906299+0000","last_fullsized":"2023-09-30T22:23:54.906299+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136441+0000","last_change":"2023-09-30T22:22:53.774304+0000","last_active":"2023-09-30T22:24:24.136441+0000","last_peered":"2023-09-30T22:24:24.136441+0000","last_clean":"2023-09-30T22:24:24.136441+0000","last_became_active":"2023-09-30T22:22:53.773998+0000","last_became_peered":"2023-09-30T22:22:53.773998+0000","last_unstale":"2023-09-30T22:24:24.136441+0000","last_undegraded":"2023-09-30T22:24:24.136441+0000","last_fullsized":"2023-09-30T22:24:24.136441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'12","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.203393+0000","last_change":"2023-09-30T22:22:01.993933+0000","last_active":"2023-09-30T22:24:24.203393+0000","last_peered":"2023-09-30T22:24:24.203393+0000","last_clean":"2023-09-30T22:24:24.203393+0000","last_became_active":"2023-09-30T22:22:01.993574+0000","last_became_peered":"2023-09-30T22:22:01.993574+0000","last_unstale":"2023-09-30T22:24:24.203393+0000","last_undegraded":"2023-09-30T22:24:24.203393+0000","last_fullsized":"2023-09-30T22:24:24.203393+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3547,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.784634+0000","last_change":"2023-09-30T22:22:02.387576+0000","last_active":"2023-09-30T22:23:54.784634+0000","last_peered":"2023-09-30T22:23:54.784634+0000","last_clean":"2023-09-30T22:23:54.784634+0000","last_became_active":"2023-09-30T22:22:02.387235+0000","last_became_peered":"2023-09-30T22:22:02.387235+0000","last_unstale":"2023-09-30T22:23:54.784634+0000","last_undegraded":"2023-09-30T22:23:54.784634+0000","last_fullsized":"2023-09-30T22:23:54.784634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137239+0000","last_change":"2023-09-30T22:22:01.995522+0000","last_active":"2023-09-30T22:24:24.137239+0000","last_peered":"2023-09-30T22:24:24.137239+0000","last_clean":"2023-09-30T22:24:24.137239+0000","last_became_active":"2023-09-30T22:22:01.994928+0000","last_became_peered":"2023-09-30T22:22:01.994928+0000","last_unstale":"2023-09-30T22:24:24.137239+0000","last_undegraded":"2023-09-30T22:24:24.137239+0000","last_fullsized":"2023-09-30T22:24:24.137239+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137832+0000","last_change":"2023-09-30T22:22:02.383942+0000","last_active":"2023-09-30T22:24:24.137832+0000","last_peered":"2023-09-30T22:24:24.137832+0000","last_clean":"2023-09-30T22:24:24.137832+0000","last_became_active":"2023-09-30T22:22:02.383663+0000","last_became_peered":"2023-09-30T22:22:02.383663+0000","last_unstale":"2023-09-30T22:24:24.137832+0000","last_undegraded":"2023-09-30T22:24:24.137832+0000","last_fullsized":"2023-09-30T22:24:24.137832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906001+0000","last_change":"2023-09-30T22:22:01.997424+0000","last_active":"2023-09-30T22:23:54.906001+0000","last_peered":"2023-09-30T22:23:54.906001+0000","last_clean":"2023-09-30T22:23:54.906001+0000","last_became_active":"2023-09-30T22:22:01.997098+0000","last_became_peered":"2023-09-30T22:22:01.997098+0000","last_unstale":"2023-09-30T22:23:54.906001+0000","last_undegraded":"2023-09-30T22:23:54.906001+0000","last_fullsized":"2023-09-30T22:23:54.906001+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136997+0000","last_change":"2023-09-30T22:22:02.396425+0000","last_active":"2023-09-30T22:24:24.136997+0000","last_peered":"2023-09-30T22:24:24.136997+0000","last_clean":"2023-09-30T22:24:24.136997+0000","last_became_active":"2023-09-30T22:22:02.396152+0000","last_became_peered":"2023-09-30T22:22:02.396152+0000","last_unstale":"2023-09-30T22:24:24.136997+0000","last_undegraded":"2023-09-30T22:24:24.136997+0000","last_fullsized":"2023-09-30T22:24:24.136997+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137138+0000","last_change":"2023-09-30T22:22:01.994313+0000","last_active":"2023-09-30T22:24:24.137138+0000","last_peered":"2023-09-30T22:24:24.137138+0000","last_clean":"2023-09-30T22:24:24.137138+0000","last_became_active":"2023-09-30T22:22:01.993994+0000","last_became_peered":"2023-09-30T22:22:01.993994+0000","last_unstale":"2023-09-30T22:24:24.137138+0000","last_undegraded":"2023-09-30T22:24:24.137138+0000","last_fullsized":"2023-09-30T22:24:24.137138+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906530+0000","last_change":"2023-09-30T22:22:02.391210+0000","last_active":"2023-09-30T22:23:54.906530+0000","last_peered":"2023-09-30T22:23:54.906530+0000","last_clean":"2023-09-30T22:23:54.906530+0000","last_became_active":"2023-09-30T22:22:02.390937+0000","last_became_peered":"2023-09-30T22:22:02.390937+0000","last_unstale":"2023-09-30T22:23:54.906530+0000","last_undegraded":"2023-09-30T22:23:54.906530+0000","last_fullsized":"2023-09-30T22:23:54.906530+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137402+0000","last_change":"2023-09-30T22:22:01.974848+0000","last_active":"2023-09-30T22:24:24.137402+0000","last_peered":"2023-09-30T22:24:24.137402+0000","last_clean":"2023-09-30T22:24:24.137402+0000","last_became_active":"2023-09-30T22:22:01.974025+0000","last_became_peered":"2023-09-30T22:22:01.974025+0000","last_unstale":"2023-09-30T22:24:24.137402+0000","last_undegraded":"2023-09-30T22:24:24.137402+0000","last_fullsized":"2023-09-30T22:24:24.137402+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.138646+0000","last_change":"2023-09-30T22:22:02.383497+0000","last_active":"2023-09-30T22:24:24.138646+0000","last_peered":"2023-09-30T22:24:24.138646+0000","last_clean":"2023-09-30T22:24:24.138646+0000","last_became_active":"2023-09-30T22:22:02.383215+0000","last_became_peered":"2023-09-30T22:22:02.383215+0000","last_unstale":"2023-09-30T22:24:24.138646+0000","last_undegraded":"2023-09-30T22:24:24.138646+0000","last_fullsized":"2023-09-30T22:24:24.138646+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906532+0000","last_change":"2023-09-30T22:22:01.979910+0000","last_active":"2023-09-30T22:23:54.906532+0000","last_peered":"2023-09-30T22:23:54.906532+0000","last_clean":"2023-09-30T22:23:54.906532+0000","last_became_active":"2023-09-30T22:22:01.979649+0000","last_became_peered":"2023-09-30T22:22:01.979649+0000","last_unstale":"2023-09-30T22:23:54.906532+0000","last_undegraded":"2023-09-30T22:23:54.906532+0000","last_fullsized":"2023-09-30T22:23:54.906532+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137441+0000","last_change":"2023-09-30T22:22:02.381246+0000","last_active":"2023-09-30T22:24:24.137441+0000","last_peered":"2023-09-30T22:24:24.137441+0000","last_clean":"2023-09-30T22:24:24.137441+0000","last_became_active":"2023-09-30T22:22:02.380654+0000","last_became_peered":"2023-09-30T22:22:02.380654+0000","last_unstale":"2023-09-30T22:24:24.137441+0000","last_undegraded":"2023-09-30T22:24:24.137441+0000","last_fullsized":"2023-09-30T22:24:24.137441+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.785376+0000","last_change":"2023-09-30T22:22:01.990442+0000","last_active":"2023-09-30T22:23:54.785376+0000","last_peered":"2023-09-30T22:23:54.785376+0000","last_clean":"2023-09-30T22:23:54.785376+0000","last_became_active":"2023-09-30T22:22:01.990217+0000","last_became_peered":"2023-09-30T22:22:01.990217+0000","last_unstale":"2023-09-30T22:23:54.785376+0000","last_undegraded":"2023-09-30T22:23:54.785376+0000","last_fullsized":"2023-09-30T22:23:54.785376+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.135952+0000","last_change":"2023-09-30T22:22:53.777865+0000","last_active":"2023-09-30T22:24:24.135952+0000","last_peered":"2023-09-30T22:24:24.135952+0000","last_clean":"2023-09-30T22:24:24.135952+0000","last_became_active":"2023-09-30T22:22:53.777521+0000","last_became_peered":"2023-09-30T22:22:53.777521+0000","last_unstale":"2023-09-30T22:24:24.135952+0000","last_undegraded":"2023-09-30T22:24:24.135952+0000","last_fullsized":"2023-09-30T22:24:24.135952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137166+0000","last_change":"2023-09-30T22:22:01.996439+0000","last_active":"2023-09-30T22:24:24.137166+0000","last_peered":"2023-09-30T22:24:24.137166+0000","last_clean":"2023-09-30T22:24:24.137166+0000","last_became_active":"2023-09-30T22:22:01.996114+0000","last_became_peered":"2023-09-30T22:22:01.996114+0000","last_unstale":"2023-09-30T22:24:24.137166+0000","last_undegraded":"2023-09-30T22:24:24.137166+0000","last_fullsized":"2023-09-30T22:24:24.137166+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.785072+0000","last_change":"2023-09-30T22:22:02.384428+0000","last_active":"2023-09-30T22:23:54.785072+0000","last_peered":"2023-09-30T22:23:54.785072+0000","last_clean":"2023-09-30T22:23:54.785072+0000","last_became_active":"2023-09-30T22:22:02.383704+0000","last_became_peered":"2023-09-30T22:22:02.383704+0000","last_unstale":"2023-09-30T22:23:54.785072+0000","last_undegraded":"2023-09-30T22:23:54.785072+0000","last_fullsized":"2023-09-30T22:23:54.785072+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906172+0000","last_change":"2023-09-30T22:22:01.998688+0000","last_active":"2023-09-30T22:23:54.906172+0000","last_peered":"2023-09-30T22:23:54.906172+0000","last_clean":"2023-09-30T22:23:54.906172+0000","last_became_active":"2023-09-30T22:22:01.998390+0000","last_became_peered":"2023-09-30T22:22:01.998390+0000","last_unstale":"2023-09-30T22:23:54.906172+0000","last_undegraded":"2023-09-30T22:23:54.906172+0000","last_fullsized":"2023-09-30T22:23:54.906172+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906467+0000","last_change":"2023-09-30T22:22:02.376261+0000","last_active":"2023-09-30T22:23:54.906467+0000","last_peered":"2023-09-30T22:23:54.906467+0000","last_clean":"2023-09-30T22:23:54.906467+0000","last_became_active":"2023-09-30T22:22:02.375940+0000","last_became_peered":"2023-09-30T22:22:02.375940+0000","last_unstale":"2023-09-30T22:23:54.906467+0000","last_undegraded":"2023-09-30T22:23:54.906467+0000","last_fullsized":"2023-09-30T22:23:54.906467+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137070+0000","last_change":"2023-09-30T22:22:01.995642+0000","last_active":"2023-09-30T22:24:24.137070+0000","last_peered":"2023-09-30T22:24:24.137070+0000","last_clean":"2023-09-30T22:24:24.137070+0000","last_became_active":"2023-09-30T22:22:01.995224+0000","last_became_peered":"2023-09-30T22:22:01.995224+0000","last_unstale":"2023-09-30T22:24:24.137070+0000","last_undegraded":"2023-09-30T22:24:24.137070+0000","last_fullsized":"2023-09-30T22:24:24.137070+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906179+0000","last_change":"2023-09-30T22:22:53.776711+0000","last_active":"2023-09-30T22:23:54.906179+0000","last_peered":"2023-09-30T22:23:54.906179+0000","last_clean":"2023-09-30T22:23:54.906179+0000","last_became_active":"2023-09-30T22:22:53.776416+0000","last_became_peered":"2023-09-30T22:22:53.776416+0000","last_unstale":"2023-09-30T22:23:54.906179+0000","last_undegraded":"2023-09-30T22:23:54.906179+0000","last_fullsized":"2023-09-30T22:23:54.906179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136426+0000","last_change":"2023-09-30T22:22:01.995738+0000","last_active":"2023-09-30T22:24:24.136426+0000","last_peered":"2023-09-30T22:24:24.136426+0000","last_clean":"2023-09-30T22:24:24.136426+0000","last_became_active":"2023-09-30T22:22:01.994552+0000","last_became_peered":"2023-09-30T22:22:01.994552+0000","last_unstale":"2023-09-30T22:24:24.136426+0000","last_undegraded":"2023-09-30T22:24:24.136426+0000","last_fullsized":"2023-09-30T22:24:24.136426+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137073+0000","last_change":"2023-09-30T22:22:02.382026+0000","last_active":"2023-09-30T22:24:24.137073+0000","last_peered":"2023-09-30T22:24:24.137073+0000","last_clean":"2023-09-30T22:24:24.137073+0000","last_became_active":"2023-09-30T22:22:02.378486+0000","last_became_peered":"2023-09-30T22:22:02.378486+0000","last_unstale":"2023-09-30T22:24:24.137073+0000","last_undegraded":"2023-09-30T22:24:24.137073+0000","last_fullsized":"2023-09-30T22:24:24.137073+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136926+0000","last_change":"2023-09-30T22:22:01.994235+0000","last_active":"2023-09-30T22:24:24.136926+0000","last_peered":"2023-09-30T22:24:24.136926+0000","last_clean":"2023-09-30T22:24:24.136926+0000","last_became_active":"2023-09-30T22:22:01.993882+0000","last_became_peered":"2023-09-30T22:22:01.993882+0000","last_unstale":"2023-09-30T22:24:24.136926+0000","last_undegraded":"2023-09-30T22:24:24.136926+0000","last_fullsized":"2023-09-30T22:24:24.136926+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.785514+0000","last_change":"2023-09-30T22:22:02.386102+0000","last_active":"2023-09-30T22:23:54.785514+0000","last_peered":"2023-09-30T22:23:54.785514+0000","last_clean":"2023-09-30T22:23:54.785514+0000","last_became_active":"2023-09-30T22:22:02.384968+0000","last_became_peered":"2023-09-30T22:22:02.384968+0000","last_unstale":"2023-09-30T22:23:54.785514+0000","last_undegraded":"2023-09-30T22:23:54.785514+0000","last_fullsized":"2023-09-30T22:23:54.785514+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136334+0000","last_change":"2023-09-30T22:22:01.995015+0000","last_active":"2023-09-30T22:24:24.136334+0000","last_peered":"2023-09-30T22:24:24.136334+0000","last_clean":"2023-09-30T22:24:24.136334+0000","last_became_active":"2023-09-30T22:22:01.994743+0000","last_became_peered":"2023-09-30T22:22:01.994743+0000","last_unstale":"2023-09-30T22:24:24.136334+0000","last_undegraded":"2023-09-30T22:24:24.136334+0000","last_fullsized":"2023-09-30T22:24:24.136334+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137555+0000","last_change":"2023-09-30T22:22:02.385985+0000","last_active":"2023-09-30T22:24:24.137555+0000","last_peered":"2023-09-30T22:24:24.137555+0000","last_clean":"2023-09-30T22:24:24.137555+0000","last_became_active":"2023-09-30T22:22:02.385413+0000","last_became_peered":"2023-09-30T22:22:02.385413+0000","last_unstale":"2023-09-30T22:24:24.137555+0000","last_undegraded":"2023-09-30T22:24:24.137555+0000","last_fullsized":"2023-09-30T22:24:24.137555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136505+0000","last_change":"2023-09-30T22:21:58.403636+0000","last_active":"2023-09-30T22:24:24.136505+0000","last_peered":"2023-09-30T22:24:24.136505+0000","last_clean":"2023-09-30T22:24:24.136505+0000","last_became_active":"2023-09-30T22:21:58.403342+0000","last_became_peered":"2023-09-30T22:21:58.403342+0000","last_unstale":"2023-09-30T22:24:24.136505+0000","last_undegraded":"2023-09-30T22:24:24.136505+0000","last_fullsized":"2023-09-30T22:24:24.136505+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.784908+0000","last_change":"2023-09-30T22:22:01.997724+0000","last_active":"2023-09-30T22:23:54.784908+0000","last_peered":"2023-09-30T22:23:54.784908+0000","last_clean":"2023-09-30T22:23:54.784908+0000","last_became_active":"2023-09-30T22:22:01.997451+0000","last_became_peered":"2023-09-30T22:22:01.997451+0000","last_unstale":"2023-09-30T22:23:54.784908+0000","last_undegraded":"2023-09-30T22:23:54.784908+0000","last_fullsized":"2023-09-30T22:23:54.784908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136357+0000","last_change":"2023-09-30T22:22:02.389982+0000","last_active":"2023-09-30T22:24:24.136357+0000","last_peered":"2023-09-30T22:24:24.136357+0000","last_clean":"2023-09-30T22:24:24.136357+0000","last_became_active":"2023-09-30T22:22:02.389680+0000","last_became_peered":"2023-09-30T22:22:02.389680+0000","last_unstale":"2023-09-30T22:24:24.136357+0000","last_undegraded":"2023-09-30T22:24:24.136357+0000","last_fullsized":"2023-09-30T22:24:24.136357+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136635+0000","last_change":"2023-09-30T22:21:57.839392+0000","last_active":"2023-09-30T22:24:24.136635+0000","last_peered":"2023-09-30T22:24:24.136635+0000","last_clean":"2023-09-30T22:24:24.136635+0000","last_became_active":"2023-09-30T22:21:57.838993+0000","last_became_peered":"2023-09-30T22:21:57.838993+0000","last_unstale":"2023-09-30T22:24:24.136635+0000","last_undegraded":"2023-09-30T22:24:24.136635+0000","last_fullsized":"2023-09-30T22:24:24.136635+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906289+0000","last_change":"2023-09-30T22:22:01.990265+0000","last_active":"2023-09-30T22:23:54.906289+0000","last_peered":"2023-09-30T22:23:54.906289+0000","last_clean":"2023-09-30T22:23:54.906289+0000","last_became_active":"2023-09-30T22:22:01.990011+0000","last_became_peered":"2023-09-30T22:22:01.990011+0000","last_unstale":"2023-09-30T22:23:54.906289+0000","last_undegraded":"2023-09-30T22:23:54.906289+0000","last_fullsized":"2023-09-30T22:23:54.906289+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136433+0000","last_change":"2023-09-30T22:22:02.374205+0000","last_active":"2023-09-30T22:24:24.136433+0000","last_peered":"2023-09-30T22:24:24.136433+0000","last_clean":"2023-09-30T22:24:24.136433+0000","last_became_active":"2023-09-30T22:22:02.373928+0000","last_became_peered":"2023-09-30T22:22:02.373928+0000","last_unstale":"2023-09-30T22:24:24.136433+0000","last_undegraded":"2023-09-30T22:24:24.136433+0000","last_fullsized":"2023-09-30T22:24:24.136433+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.784255+0000","last_change":"2023-09-30T22:21:57.836160+0000","last_active":"2023-09-30T22:23:54.784255+0000","last_peered":"2023-09-30T22:23:54.784255+0000","last_clean":"2023-09-30T22:23:54.784255+0000","last_became_active":"2023-09-30T22:21:57.835792+0000","last_became_peered":"2023-09-30T22:21:57.835792+0000","last_unstale":"2023-09-30T22:23:54.784255+0000","last_undegraded":"2023-09-30T22:23:54.784255+0000","last_fullsized":"2023-09-30T22:23:54.784255+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136190+0000","last_change":"2023-09-30T22:22:01.987700+0000","last_active":"2023-09-30T22:24:24.136190+0000","last_peered":"2023-09-30T22:24:24.136190+0000","last_clean":"2023-09-30T22:24:24.136190+0000","last_became_active":"2023-09-30T22:22:01.987358+0000","last_became_peered":"2023-09-30T22:22:01.987358+0000","last_unstale":"2023-09-30T22:24:24.136190+0000","last_undegraded":"2023-09-30T22:24:24.136190+0000","last_fullsized":"2023-09-30T22:24:24.136190+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137424+0000","last_change":"2023-09-30T22:22:02.379845+0000","last_active":"2023-09-30T22:24:24.137424+0000","last_peered":"2023-09-30T22:24:24.137424+0000","last_clean":"2023-09-30T22:24:24.137424+0000","last_became_active":"2023-09-30T22:22:02.379594+0000","last_became_peered":"2023-09-30T22:22:02.379594+0000","last_unstale":"2023-09-30T22:24:24.137424+0000","last_undegraded":"2023-09-30T22:24:24.137424+0000","last_fullsized":"2023-09-30T22:24:24.137424+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137155+0000","last_change":"2023-09-30T22:21:57.838957+0000","last_active":"2023-09-30T22:24:24.137155+0000","last_peered":"2023-09-30T22:24:24.137155+0000","last_clean":"2023-09-30T22:24:24.137155+0000","last_became_active":"2023-09-30T22:21:57.838667+0000","last_became_peered":"2023-09-30T22:21:57.838667+0000","last_unstale":"2023-09-30T22:24:24.137155+0000","last_undegraded":"2023-09-30T22:24:24.137155+0000","last_fullsized":"2023-09-30T22:24:24.137155+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.135950+0000","last_change":"2023-09-30T22:21:56.838072+0000","last_active":"2023-09-30T22:24:24.135950+0000","last_peered":"2023-09-30T22:24:24.135950+0000","last_clean":"2023-09-30T22:24:24.135950+0000","last_became_active":"2023-09-30T22:21:56.837717+0000","last_became_peered":"2023-09-30T22:21:56.837717+0000","last_unstale":"2023-09-30T22:24:24.135950+0000","last_undegraded":"2023-09-30T22:24:24.135950+0000","last_fullsized":"2023-09-30T22:24:24.135950+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:55.823939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:55.823939+0000","last_clean_scrub_stamp":"2023-09-30T22:21:55.823939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136347+0000","last_change":"2023-09-30T22:22:01.994653+0000","last_active":"2023-09-30T22:24:24.136347+0000","last_peered":"2023-09-30T22:24:24.136347+0000","last_clean":"2023-09-30T22:24:24.136347+0000","last_became_active":"2023-09-30T22:22:01.994362+0000","last_became_peered":"2023-09-30T22:22:01.994362+0000","last_unstale":"2023-09-30T22:24:24.136347+0000","last_undegraded":"2023-09-30T22:24:24.136347+0000","last_fullsized":"2023-09-30T22:24:24.136347+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137397+0000","last_change":"2023-09-30T22:22:02.381190+0000","last_active":"2023-09-30T22:24:24.137397+0000","last_peered":"2023-09-30T22:24:24.137397+0000","last_clean":"2023-09-30T22:24:24.137397+0000","last_became_active":"2023-09-30T22:22:02.380952+0000","last_became_peered":"2023-09-30T22:22:02.380952+0000","last_unstale":"2023-09-30T22:24:24.137397+0000","last_undegraded":"2023-09-30T22:24:24.137397+0000","last_fullsized":"2023-09-30T22:24:24.137397+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136410+0000","last_change":"2023-09-30T22:21:57.837598+0000","last_active":"2023-09-30T22:24:24.136410+0000","last_peered":"2023-09-30T22:24:24.136410+0000","last_clean":"2023-09-30T22:24:24.136410+0000","last_became_active":"2023-09-30T22:21:57.837284+0000","last_became_peered":"2023-09-30T22:21:57.837284+0000","last_unstale":"2023-09-30T22:24:24.136410+0000","last_undegraded":"2023-09-30T22:24:24.136410+0000","last_fullsized":"2023-09-30T22:24:24.136410+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.905905+0000","last_change":"2023-09-30T22:22:01.983059+0000","last_active":"2023-09-30T22:23:54.905905+0000","last_peered":"2023-09-30T22:23:54.905905+0000","last_clean":"2023-09-30T22:23:54.905905+0000","last_became_active":"2023-09-30T22:22:01.982739+0000","last_became_peered":"2023-09-30T22:22:01.982739+0000","last_unstale":"2023-09-30T22:23:54.905905+0000","last_undegraded":"2023-09-30T22:23:54.905905+0000","last_fullsized":"2023-09-30T22:23:54.905905+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906540+0000","last_change":"2023-09-30T22:22:02.380074+0000","last_active":"2023-09-30T22:23:54.906540+0000","last_peered":"2023-09-30T22:23:54.906540+0000","last_clean":"2023-09-30T22:23:54.906540+0000","last_became_active":"2023-09-30T22:22:02.379501+0000","last_became_peered":"2023-09-30T22:22:02.379501+0000","last_unstale":"2023-09-30T22:23:54.906540+0000","last_undegraded":"2023-09-30T22:23:54.906540+0000","last_fullsized":"2023-09-30T22:23:54.906540+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137298+0000","last_change":"2023-09-30T22:21:58.403508+0000","last_active":"2023-09-30T22:24:24.137298+0000","last_peered":"2023-09-30T22:24:24.137298+0000","last_clean":"2023-09-30T22:24:24.137298+0000","last_became_active":"2023-09-30T22:21:58.403267+0000","last_became_peered":"2023-09-30T22:21:58.403267+0000","last_unstale":"2023-09-30T22:24:24.137298+0000","last_undegraded":"2023-09-30T22:24:24.137298+0000","last_fullsized":"2023-09-30T22:24:24.137298+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136353+0000","last_change":"2023-09-30T22:22:01.987265+0000","last_active":"2023-09-30T22:24:24.136353+0000","last_peered":"2023-09-30T22:24:24.136353+0000","last_clean":"2023-09-30T22:24:24.136353+0000","last_became_active":"2023-09-30T22:22:01.986968+0000","last_became_peered":"2023-09-30T22:22:01.986968+0000","last_unstale":"2023-09-30T22:24:24.136353+0000","last_undegraded":"2023-09-30T22:24:24.136353+0000","last_fullsized":"2023-09-30T22:24:24.136353+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906389+0000","last_change":"2023-09-30T22:22:02.376013+0000","last_active":"2023-09-30T22:23:54.906389+0000","last_peered":"2023-09-30T22:23:54.906389+0000","last_clean":"2023-09-30T22:23:54.906389+0000","last_became_active":"2023-09-30T22:22:02.374252+0000","last_became_peered":"2023-09-30T22:22:02.374252+0000","last_unstale":"2023-09-30T22:23:54.906389+0000","last_undegraded":"2023-09-30T22:23:54.906389+0000","last_fullsized":"2023-09-30T22:23:54.906389+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.138485+0000","last_change":"2023-09-30T22:22:01.994188+0000","last_active":"2023-09-30T22:24:24.138485+0000","last_peered":"2023-09-30T22:24:24.138485+0000","last_clean":"2023-09-30T22:24:24.138485+0000","last_became_active":"2023-09-30T22:22:01.993644+0000","last_became_peered":"2023-09-30T22:22:01.993644+0000","last_unstale":"2023-09-30T22:24:24.138485+0000","last_undegraded":"2023-09-30T22:24:24.138485+0000","last_fullsized":"2023-09-30T22:24:24.138485+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136825+0000","last_change":"2023-09-30T22:21:58.403570+0000","last_active":"2023-09-30T22:24:24.136825+0000","last_peered":"2023-09-30T22:24:24.136825+0000","last_clean":"2023-09-30T22:24:24.136825+0000","last_became_active":"2023-09-30T22:21:58.403321+0000","last_became_peered":"2023-09-30T22:21:58.403321+0000","last_unstale":"2023-09-30T22:24:24.136825+0000","last_undegraded":"2023-09-30T22:24:24.136825+0000","last_fullsized":"2023-09-30T22:24:24.136825+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.784002+0000","last_change":"2023-09-30T22:22:53.773733+0000","last_active":"2023-09-30T22:23:54.784002+0000","last_peered":"2023-09-30T22:23:54.784002+0000","last_clean":"2023-09-30T22:23:54.784002+0000","last_became_active":"2023-09-30T22:22:53.773355+0000","last_became_peered":"2023-09-30T22:22:53.773355+0000","last_unstale":"2023-09-30T22:23:54.784002+0000","last_undegraded":"2023-09-30T22:23:54.784002+0000","last_fullsized":"2023-09-30T22:23:54.784002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.138566+0000","last_change":"2023-09-30T22:21:58.404380+0000","last_active":"2023-09-30T22:24:24.138566+0000","last_peered":"2023-09-30T22:24:24.138566+0000","last_clean":"2023-09-30T22:24:24.138566+0000","last_became_active":"2023-09-30T22:21:58.404098+0000","last_became_peered":"2023-09-30T22:21:58.404098+0000","last_unstale":"2023-09-30T22:24:24.138566+0000","last_undegraded":"2023-09-30T22:24:24.138566+0000","last_fullsized":"2023-09-30T22:24:24.138566+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"17'1","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906428+0000","last_change":"2023-09-30T22:22:01.977163+0000","last_active":"2023-09-30T22:23:54.906428+0000","last_peered":"2023-09-30T22:23:54.906428+0000","last_clean":"2023-09-30T22:23:54.906428+0000","last_became_active":"2023-09-30T22:22:01.976494+0000","last_became_peered":"2023-09-30T22:22:01.976494+0000","last_unstale":"2023-09-30T22:23:54.906428+0000","last_undegraded":"2023-09-30T22:23:54.906428+0000","last_fullsized":"2023-09-30T22:23:54.906428+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.784171+0000","last_change":"2023-09-30T22:22:53.778172+0000","last_active":"2023-09-30T22:23:54.784171+0000","last_peered":"2023-09-30T22:23:54.784171+0000","last_clean":"2023-09-30T22:23:54.784171+0000","last_became_active":"2023-09-30T22:22:53.777822+0000","last_became_peered":"2023-09-30T22:22:53.777822+0000","last_unstale":"2023-09-30T22:23:54.784171+0000","last_undegraded":"2023-09-30T22:23:54.784171+0000","last_fullsized":"2023-09-30T22:23:54.784171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906397+0000","last_change":"2023-09-30T22:22:01.997989+0000","last_active":"2023-09-30T22:23:54.906397+0000","last_peered":"2023-09-30T22:23:54.906397+0000","last_clean":"2023-09-30T22:23:54.906397+0000","last_became_active":"2023-09-30T22:22:01.997419+0000","last_became_peered":"2023-09-30T22:22:01.997419+0000","last_unstale":"2023-09-30T22:23:54.906397+0000","last_undegraded":"2023-09-30T22:23:54.906397+0000","last_fullsized":"2023-09-30T22:23:54.906397+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.784492+0000","last_change":"2023-09-30T22:22:02.379106+0000","last_active":"2023-09-30T22:23:54.784492+0000","last_peered":"2023-09-30T22:23:54.784492+0000","last_clean":"2023-09-30T22:23:54.784492+0000","last_became_active":"2023-09-30T22:22:02.378452+0000","last_became_peered":"2023-09-30T22:22:02.378452+0000","last_unstale":"2023-09-30T22:23:54.784492+0000","last_undegraded":"2023-09-30T22:23:54.784492+0000","last_fullsized":"2023-09-30T22:23:54.784492+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136591+0000","last_change":"2023-09-30T22:22:01.977515+0000","last_active":"2023-09-30T22:24:24.136591+0000","last_peered":"2023-09-30T22:24:24.136591+0000","last_clean":"2023-09-30T22:24:24.136591+0000","last_became_active":"2023-09-30T22:22:01.976843+0000","last_became_peered":"2023-09-30T22:22:01.976843+0000","last_unstale":"2023-09-30T22:24:24.136591+0000","last_undegraded":"2023-09-30T22:24:24.136591+0000","last_fullsized":"2023-09-30T22:24:24.136591+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.784718+0000","last_change":"2023-09-30T22:22:02.387751+0000","last_active":"2023-09-30T22:23:54.784718+0000","last_peered":"2023-09-30T22:23:54.784718+0000","last_clean":"2023-09-30T22:23:54.784718+0000","last_became_active":"2023-09-30T22:22:02.387326+0000","last_became_peered":"2023-09-30T22:22:02.387326+0000","last_unstale":"2023-09-30T22:23:54.784718+0000","last_undegraded":"2023-09-30T22:23:54.784718+0000","last_fullsized":"2023-09-30T22:23:54.784718+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137406+0000","last_change":"2023-09-30T22:22:01.996439+0000","last_active":"2023-09-30T22:24:24.137406+0000","last_peered":"2023-09-30T22:24:24.137406+0000","last_clean":"2023-09-30T22:24:24.137406+0000","last_became_active":"2023-09-30T22:22:01.996179+0000","last_became_peered":"2023-09-30T22:22:01.996179+0000","last_unstale":"2023-09-30T22:24:24.137406+0000","last_undegraded":"2023-09-30T22:24:24.137406+0000","last_fullsized":"2023-09-30T22:24:24.137406+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.784994+0000","last_change":"2023-09-30T22:22:02.384588+0000","last_active":"2023-09-30T22:23:54.784994+0000","last_peered":"2023-09-30T22:23:54.784994+0000","last_clean":"2023-09-30T22:23:54.784994+0000","last_became_active":"2023-09-30T22:22:02.384072+0000","last_became_peered":"2023-09-30T22:22:02.384072+0000","last_unstale":"2023-09-30T22:23:54.784994+0000","last_undegraded":"2023-09-30T22:23:54.784994+0000","last_fullsized":"2023-09-30T22:23:54.784994+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.138259+0000","last_change":"2023-09-30T22:22:01.993986+0000","last_active":"2023-09-30T22:24:24.138259+0000","last_peered":"2023-09-30T22:24:24.138259+0000","last_clean":"2023-09-30T22:24:24.138259+0000","last_became_active":"2023-09-30T22:22:01.993575+0000","last_became_peered":"2023-09-30T22:22:01.993575+0000","last_unstale":"2023-09-30T22:24:24.138259+0000","last_undegraded":"2023-09-30T22:24:24.138259+0000","last_fullsized":"2023-09-30T22:24:24.138259+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137313+0000","last_change":"2023-09-30T22:22:02.378109+0000","last_active":"2023-09-30T22:24:24.137313+0000","last_peered":"2023-09-30T22:24:24.137313+0000","last_clean":"2023-09-30T22:24:24.137313+0000","last_became_active":"2023-09-30T22:22:02.377671+0000","last_became_peered":"2023-09-30T22:22:02.377671+0000","last_unstale":"2023-09-30T22:24:24.137313+0000","last_undegraded":"2023-09-30T22:24:24.137313+0000","last_fullsized":"2023-09-30T22:24:24.137313+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906686+0000","last_change":"2023-09-30T22:22:01.980853+0000","last_active":"2023-09-30T22:23:54.906686+0000","last_peered":"2023-09-30T22:23:54.906686+0000","last_clean":"2023-09-30T22:23:54.906686+0000","last_became_active":"2023-09-30T22:22:01.979795+0000","last_became_peered":"2023-09-30T22:22:01.979795+0000","last_unstale":"2023-09-30T22:23:54.906686+0000","last_undegraded":"2023-09-30T22:23:54.906686+0000","last_fullsized":"2023-09-30T22:23:54.906686+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.784090+0000","last_change":"2023-09-30T22:22:02.377790+0000","last_active":"2023-09-30T22:23:54.784090+0000","last_peered":"2023-09-30T22:23:54.784090+0000","last_clean":"2023-09-30T22:23:54.784090+0000","last_became_active":"2023-09-30T22:22:02.377478+0000","last_became_peered":"2023-09-30T22:22:02.377478+0000","last_unstale":"2023-09-30T22:23:54.784090+0000","last_undegraded":"2023-09-30T22:23:54.784090+0000","last_fullsized":"2023-09-30T22:23:54.784090+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136045+0000","last_change":"2023-09-30T22:22:02.373820+0000","last_active":"2023-09-30T22:24:24.136045+0000","last_peered":"2023-09-30T22:24:24.136045+0000","last_clean":"2023-09-30T22:24:24.136045+0000","last_became_active":"2023-09-30T22:22:02.373530+0000","last_became_peered":"2023-09-30T22:22:02.373530+0000","last_unstale":"2023-09-30T22:24:24.136045+0000","last_undegraded":"2023-09-30T22:24:24.136045+0000","last_fullsized":"2023-09-30T22:24:24.136045+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137000+0000","last_change":"2023-09-30T22:22:02.377945+0000","last_active":"2023-09-30T22:24:24.137000+0000","last_peered":"2023-09-30T22:24:24.137000+0000","last_clean":"2023-09-30T22:24:24.137000+0000","last_became_active":"2023-09-30T22:22:02.377355+0000","last_became_peered":"2023-09-30T22:22:02.377355+0000","last_unstale":"2023-09-30T22:24:24.137000+0000","last_undegraded":"2023-09-30T22:24:24.137000+0000","last_fullsized":"2023-09-30T22:24:24.137000+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906082+0000","last_change":"2023-09-30T22:22:02.387890+0000","last_active":"2023-09-30T22:23:54.906082+0000","last_peered":"2023-09-30T22:23:54.906082+0000","last_clean":"2023-09-30T22:23:54.906082+0000","last_became_active":"2023-09-30T22:22:02.387599+0000","last_became_peered":"2023-09-30T22:22:02.387599+0000","last_unstale":"2023-09-30T22:23:54.906082+0000","last_undegraded":"2023-09-30T22:23:54.906082+0000","last_fullsized":"2023-09-30T22:23:54.906082+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.784382+0000","last_change":"2023-09-30T22:22:53.776901+0000","last_active":"2023-09-30T22:23:54.784382+0000","last_peered":"2023-09-30T22:23:54.784382+0000","last_clean":"2023-09-30T22:23:54.784382+0000","last_became_active":"2023-09-30T22:22:53.776569+0000","last_became_peered":"2023-09-30T22:22:53.776569+0000","last_unstale":"2023-09-30T22:23:54.784382+0000","last_undegraded":"2023-09-30T22:23:54.784382+0000","last_fullsized":"2023-09-30T22:23:54.784382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136219+0000","last_change":"2023-09-30T22:22:02.374216+0000","last_active":"2023-09-30T22:24:24.136219+0000","last_peered":"2023-09-30T22:24:24.136219+0000","last_clean":"2023-09-30T22:24:24.136219+0000","last_became_active":"2023-09-30T22:22:02.373952+0000","last_became_peered":"2023-09-30T22:22:02.373952+0000","last_unstale":"2023-09-30T22:24:24.136219+0000","last_undegraded":"2023-09-30T22:24:24.136219+0000","last_fullsized":"2023-09-30T22:24:24.136219+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4317,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705696,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297308,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074532,"statfs":{"total":96636764160,"available":96332320768,"internally_reserved":0,"allocated":217088,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"min":{"1min":0.20499999999999999,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.42099999999999999,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.23400000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.246}]},{"osd":1,"last update":"Sat Sep 30 22:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.26600000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.46200000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.317,"5min":0.33100000000000002,"15min":0.33300000000000002},"min":{"1min":0.249,"5min":0.223,"15min":0.223},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.28699999999999998}]},{"osd":2,"last update":"Sat Sep 30 22:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.35099999999999998,"15min":0.35299999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.497,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.34599999999999997,"15min":0.34799999999999998},"min":{"1min":0.26900000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.47799999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.34499999999999997}]}]},{"osd":2,"up_from":9,"seq":38654705696,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297296,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074544,"statfs":{"total":96636764160,"available":96332333056,"internally_reserved":0,"allocated":204800,"data_stored":75571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.30499999999999999,"15min":0.307},"min":{"1min":0.16,"5min":0.159,"15min":0.159},"max":{"1min":0.432,"5min":0.55700000000000005,"15min":0.55700000000000005},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.311,"5min":0.309,"15min":0.309},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.495,"5min":0.501,"15min":0.501},"last":0.28199999999999997}]},{"osd":1,"last update":"Sat Sep 30 22:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.307,"15min":0.309},"min":{"1min":0.223,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.42099999999999999,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.314,"5min":0.33800000000000002,"15min":0.34200000000000003},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.46000000000000002,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.29399999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.33700000000000002,"15min":0.34100000000000003},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.442,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.35199999999999998,"15min":0.35499999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.47999999999999998,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.30299999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705696,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297292,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074548,"statfs":{"total":96636764160,"available":96332337152,"internally_reserved":0,"allocated":200704,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 22:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.30099999999999999,"15min":0.29899999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.432,"5min":0.432,"15min":0.432},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.33900000000000002,"15min":0.33700000000000002},"min":{"1min":0.27900000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.47999999999999998}]},{"osd":2,"last update":"Sat Sep 30 22:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.308,"15min":0.307},"min":{"1min":0.254,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.30199999999999999,"5min":0.32000000000000001,"15min":0.32300000000000001},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.44}]},{"osd":3,"last update":"Sat Sep 30 22:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.34000000000000002,"15min":0.34200000000000003},"min":{"1min":0.26700000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.313,"5min":0.32200000000000001,"15min":0.32400000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"last":0.61899999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705696,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297296,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074544,"statfs":{"total":96636764160,"available":96332333056,"internally_reserved":0,"allocated":204800,"data_stored":72670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.307,"15min":0.30499999999999999},"min":{"1min":0.16900000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.32700000000000001,"15min":0.32500000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.73799999999999999}]},{"osd":2,"last update":"Sat Sep 30 22:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.23499999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.35599999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.34899999999999998,"15min":0.34699999999999998},"min":{"1min":0.252,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.38200000000000001,"15min":0.38300000000000001},"min":{"1min":0.28399999999999997,"5min":0.246,"15min":0.246},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.67500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T22:24:27.850 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:24:28.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.009+0000 7f33e2145700 1 Processor -- start 2023-09-30T22:24:28.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.009+0000 7f33e2145700 1 -- start start 2023-09-30T22:24:28.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.010+0000 7f33e2145700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33dc09c890 0x7f33dc09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:28.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.010+0000 7f33e2145700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f33dc09d920 0x7f33dc09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:28.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.010+0000 7f33e2145700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33dc0a2600 con 0x7f33dc09e2b0 2023-09-30T22:24:28.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.010+0000 7f33e2145700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc0a29d0 con 0x7f33dc09c890 2023-09-30T22:24:28.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.010+0000 7f33e2145700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc09fb40 con 0x7f33dc09d920 2023-09-30T22:24:28.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.010+0000 7f33dbfff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f33dc09e2b0 0x7f33dc13ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40218/0 (socket says 172.21.15.40:40218) 2023-09-30T22:24:28.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.010+0000 7f33dbfff700 1 -- 172.21.15.40:0/304794989 learned_addr learned my addr 172.21.15.40:0/304794989 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:24:28.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.010+0000 7f33db7fe700 1 --2- 172.21.15.40:0/304794989 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33dc09c890 0x7f33dc09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:28.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.010+0000 7f33daffd700 1 --2- 172.21.15.40:0/304794989 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f33dc09d920 0x7f33dc09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:28.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.010+0000 7f33da7fc700 1 -- 172.21.15.40:0/304794989 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 67880549 0 0) 0x7f33dc0a2600 con 0x7f33dc09e2b0 2023-09-30T22:24:28.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.010+0000 7f33da7fc700 1 -- 172.21.15.40:0/304794989 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33c40035b0 con 0x7f33dc09e2b0 2023-09-30T22:24:28.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.010+0000 7f33db7fe700 1 -- 172.21.15.40:0/304794989 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f33dc09d920 msgr2=0x7f33dc09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:28.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.010+0000 7f33db7fe700 1 --2- 172.21.15.40:0/304794989 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f33dc09d920 0x7f33dc09dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.010+0000 7f33db7fe700 1 -- 172.21.15.40:0/304794989 >> v1:172.21.15.40:6789/0 conn(0x7f33dc09e2b0 legacy=0x7f33dc13ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.010+0000 7f33db7fe700 1 -- 172.21.15.40:0/304794989 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33dc09e720 con 0x7f33dc09c890 2023-09-30T22:24:28.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.010+0000 7f33daffd700 1 --2- 172.21.15.40:0/304794989 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f33dc09d920 0x7f33dc09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:28.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.011+0000 7f33db7fe700 1 --2- 172.21.15.40:0/304794989 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33dc09c890 0x7f33dc09cc60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f33cc009850 tx=0x7f33cc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd8b86903034ad7b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:28.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.011+0000 7f33da7fc700 1 -- 172.21.15.40:0/304794989 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33cc005e30 con 0x7f33dc09c890 2023-09-30T22:24:28.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.011+0000 7f33da7fc700 1 -- 172.21.15.40:0/304794989 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33cc006030 con 0x7f33dc09c890 2023-09-30T22:24:28.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.011+0000 7f33da7fc700 1 -- 172.21.15.40:0/304794989 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33cc0063e0 con 0x7f33dc09c890 2023-09-30T22:24:28.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.011+0000 7f33e2145700 1 -- 172.21.15.40:0/304794989 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33dc09c890 msgr2=0x7f33dc09cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.011+0000 7f33e2145700 1 --2- 172.21.15.40:0/304794989 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33dc09c890 0x7f33dc09cc60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f33cc009850 tx=0x7f33cc009b60 comp rx=0 tx=0).stop 2023-09-30T22:24:28.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.011+0000 7f33e2145700 1 -- 172.21.15.40:0/304794989 shutdown_connections 2023-09-30T22:24:28.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.011+0000 7f33e2145700 1 --2- 172.21.15.40:0/304794989 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33dc09c890 0x7f33dc09cc60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.011+0000 7f33e2145700 1 --2- 172.21.15.40:0/304794989 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f33dc09d920 0x7f33dc09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.011+0000 7f33e2145700 1 -- 172.21.15.40:0/304794989 >> 172.21.15.40:0/304794989 conn(0x7f33dc0a7080 msgr2=0x7f33dc0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:28.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.011+0000 7f33e2145700 1 -- 172.21.15.40:0/304794989 shutdown_connections 2023-09-30T22:24:28.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.011+0000 7f33e2145700 1 -- 172.21.15.40:0/304794989 wait complete. 2023-09-30T22:24:28.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.012+0000 7f33e2145700 1 Processor -- start 2023-09-30T22:24:28.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.012+0000 7f33e2145700 1 -- start start 2023-09-30T22:24:28.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.013+0000 7f33e2145700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33dc09c890 0x7f33dc1c4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:28.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.013+0000 7f33e2145700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33dc09d920 0x7f33dc1c5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:28.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.013+0000 7f33e2145700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f33dc09e2b0 0x7f33dc12b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:28.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.013+0000 7f33e2145700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc12e580 con 0x7f33dc09d920 2023-09-30T22:24:28.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.013+0000 7f33e2145700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc09ecf0 con 0x7f33dc09c890 2023-09-30T22:24:28.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.013+0000 7f33e2145700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc12e780 con 0x7f33dc09e2b0 2023-09-30T22:24:28.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.013+0000 7f33db7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33dc09c890 0x7f33dc1c4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:28.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.013+0000 7f33daffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33dc09d920 0x7f33dc1c5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:28.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.013+0000 7f33dbfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f33dc09e2b0 0x7f33dc12b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:28.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.013+0000 7f33db7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33dc09c890 0x7f33dc1c4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52078/0 (socket says 172.21.15.40:52078) 2023-09-30T22:24:28.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.013+0000 7f33db7fe700 1 -- 172.21.15.40:0/3723382902 learned_addr learned my addr 172.21.15.40:0/3723382902 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:28.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.013+0000 7f33daffd700 1 -- 172.21.15.40:0/3723382902 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f33dc09e2b0 msgr2=0x7f33dc12b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.013+0000 7f33daffd700 1 --2- 172.21.15.40:0/3723382902 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f33dc09e2b0 0x7f33dc12b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.013+0000 7f33daffd700 1 -- 172.21.15.40:0/3723382902 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33dc09c890 msgr2=0x7f33dc1c4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.013+0000 7f33daffd700 1 --2- 172.21.15.40:0/3723382902 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33dc09c890 0x7f33dc1c4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.013+0000 7f33daffd700 1 -- 172.21.15.40:0/3723382902 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d00094a0 con 0x7f33dc09d920 2023-09-30T22:24:28.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.013+0000 7f33dbfff700 1 --2- 172.21.15.40:0/3723382902 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f33dc09e2b0 0x7f33dc12b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:28.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.013+0000 7f33daffd700 1 --2- 172.21.15.40:0/3723382902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33dc09d920 0x7f33dc1c5520 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f33d000e980 tx=0x7f33d000ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:28.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.014+0000 7f33c3fff700 1 -- 172.21.15.40:0/3723382902 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d000c690 con 0x7f33dc09d920 2023-09-30T22:24:28.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.014+0000 7f33c3fff700 1 -- 172.21.15.40:0/3723382902 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d000c7f0 con 0x7f33dc09d920 2023-09-30T22:24:28.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.014+0000 7f33c3fff700 1 -- 172.21.15.40:0/3723382902 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d000cb80 con 0x7f33dc09d920 2023-09-30T22:24:28.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.014+0000 7f33e2145700 1 -- 172.21.15.40:0/3723382902 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33cc009430 con 0x7f33dc09d920 2023-09-30T22:24:28.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.014+0000 7f33e2145700 1 -- 172.21.15.40:0/3723382902 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33dc12c880 con 0x7f33dc09d920 2023-09-30T22:24:28.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.015+0000 7f33c3fff700 1 -- 172.21.15.40:0/3723382902 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f33d000cce0 con 0x7f33dc09d920 2023-09-30T22:24:28.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.015+0000 7f33c3fff700 1 -- 172.21.15.40:0/3723382902 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4094+0+0 (secure 0 0 0) 0x7f33d003f950 con 0x7f33dc09d920 2023-09-30T22:24:28.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.015+0000 7f33e2145700 1 -- 172.21.15.40:0/3723382902 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33dc12c820 con 0x7f33dc09d920 2023-09-30T22:24:28.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.020+0000 7f33c3fff700 1 -- 172.21.15.40:0/3723382902 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f33d0021080 con 0x7f33dc09d920 2023-09-30T22:24:28.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.216+0000 7f33e2145700 1 -- 172.21.15.40:0/3723382902 --> v1:172.21.15.40:6816/127432 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f33dc0a2c10 con 0x7f33c802f480 2023-09-30T22:24:28.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.223+0000 7f33c3fff700 1 -- 172.21.15.40:0/3723382902 <== mgr.14099 v1:172.21.15.40:6816/127432 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+270371 (unknown 2965378022 0 118636338) 0x7f33cc0061a0 con 0x7f33c802f480 2023-09-30T22:24:28.227 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:24:28.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.226+0000 7f33e2145700 1 -- 172.21.15.40:0/3723382902 >> v1:172.21.15.40:6816/127432 conn(0x7f33c802f480 legacy=0x7f33c8031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.226+0000 7f33e2145700 1 -- 172.21.15.40:0/3723382902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33dc09d920 msgr2=0x7f33dc1c5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.226+0000 7f33e2145700 1 --2- 172.21.15.40:0/3723382902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33dc09d920 0x7f33dc1c5520 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f33d000e980 tx=0x7f33d000ec90 comp rx=0 tx=0).stop 2023-09-30T22:24:28.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.226+0000 7f33e2145700 1 -- 172.21.15.40:0/3723382902 shutdown_connections 2023-09-30T22:24:28.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.226+0000 7f33e2145700 1 --2- 172.21.15.40:0/3723382902 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f33dc09e2b0 0x7f33dc12b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.226+0000 7f33e2145700 1 --2- 172.21.15.40:0/3723382902 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33dc09c890 0x7f33dc1c4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.226+0000 7f33e2145700 1 --2- 172.21.15.40:0/3723382902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33dc09d920 0x7f33dc1c5520 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.226+0000 7f33e2145700 1 -- 172.21.15.40:0/3723382902 >> 172.21.15.40:0/3723382902 conn(0x7f33dc0a7080 msgr2=0x7f33dc1bafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:28.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.227+0000 7f33e2145700 1 -- 172.21.15.40:0/3723382902 shutdown_connections 2023-09-30T22:24:28.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.227+0000 7f33e2145700 1 -- 172.21.15.40:0/3723382902 wait complete. 2023-09-30T22:24:28.230 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-09-30T22:24:28.239 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":7,"stamp":"2023-09-30T22:24:28.141145+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4317,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189192,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298168,"statfs":{"total":386547056640,"available":385329324032,"internally_reserved":0,"allocated":827392,"data_stored":291705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.996492"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.785153+0000","last_change":"2023-09-30T22:22:53.776858+0000","last_active":"2023-09-30T22:23:54.785153+0000","last_peered":"2023-09-30T22:23:54.785153+0000","last_clean":"2023-09-30T22:23:54.785153+0000","last_became_active":"2023-09-30T22:22:53.776533+0000","last_became_peered":"2023-09-30T22:22:53.776533+0000","last_unstale":"2023-09-30T22:23:54.785153+0000","last_undegraded":"2023-09-30T22:23:54.785153+0000","last_fullsized":"2023-09-30T22:23:54.785153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.785599+0000","last_change":"2023-09-30T22:22:02.377806+0000","last_active":"2023-09-30T22:23:54.785599+0000","last_peered":"2023-09-30T22:23:54.785599+0000","last_clean":"2023-09-30T22:23:54.785599+0000","last_became_active":"2023-09-30T22:22:02.377531+0000","last_became_peered":"2023-09-30T22:22:02.377531+0000","last_unstale":"2023-09-30T22:23:54.785599+0000","last_undegraded":"2023-09-30T22:23:54.785599+0000","last_fullsized":"2023-09-30T22:23:54.785599+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906353+0000","last_change":"2023-09-30T22:22:02.379022+0000","last_active":"2023-09-30T22:23:54.906353+0000","last_peered":"2023-09-30T22:23:54.906353+0000","last_clean":"2023-09-30T22:23:54.906353+0000","last_became_active":"2023-09-30T22:22:02.378723+0000","last_became_peered":"2023-09-30T22:22:02.378723+0000","last_unstale":"2023-09-30T22:23:54.906353+0000","last_undegraded":"2023-09-30T22:23:54.906353+0000","last_fullsized":"2023-09-30T22:23:54.906353+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906102+0000","last_change":"2023-09-30T22:22:02.378089+0000","last_active":"2023-09-30T22:23:54.906102+0000","last_peered":"2023-09-30T22:23:54.906102+0000","last_clean":"2023-09-30T22:23:54.906102+0000","last_became_active":"2023-09-30T22:22:02.375446+0000","last_became_peered":"2023-09-30T22:22:02.375446+0000","last_unstale":"2023-09-30T22:23:54.906102+0000","last_undegraded":"2023-09-30T22:23:54.906102+0000","last_fullsized":"2023-09-30T22:23:54.906102+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906289+0000","last_change":"2023-09-30T22:22:02.398073+0000","last_active":"2023-09-30T22:23:54.906289+0000","last_peered":"2023-09-30T22:23:54.906289+0000","last_clean":"2023-09-30T22:23:54.906289+0000","last_became_active":"2023-09-30T22:22:02.397855+0000","last_became_peered":"2023-09-30T22:22:02.397855+0000","last_unstale":"2023-09-30T22:23:54.906289+0000","last_undegraded":"2023-09-30T22:23:54.906289+0000","last_fullsized":"2023-09-30T22:23:54.906289+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136504+0000","last_change":"2023-09-30T22:22:02.382862+0000","last_active":"2023-09-30T22:24:24.136504+0000","last_peered":"2023-09-30T22:24:24.136504+0000","last_clean":"2023-09-30T22:24:24.136504+0000","last_became_active":"2023-09-30T22:22:02.382464+0000","last_became_peered":"2023-09-30T22:22:02.382464+0000","last_unstale":"2023-09-30T22:24:24.136504+0000","last_undegraded":"2023-09-30T22:24:24.136504+0000","last_fullsized":"2023-09-30T22:24:24.136504+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136848+0000","last_change":"2023-09-30T22:22:02.395909+0000","last_active":"2023-09-30T22:24:24.136848+0000","last_peered":"2023-09-30T22:24:24.136848+0000","last_clean":"2023-09-30T22:24:24.136848+0000","last_became_active":"2023-09-30T22:22:02.395379+0000","last_became_peered":"2023-09-30T22:22:02.395379+0000","last_unstale":"2023-09-30T22:24:24.136848+0000","last_undegraded":"2023-09-30T22:24:24.136848+0000","last_fullsized":"2023-09-30T22:24:24.136848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.135781+0000","last_change":"2023-09-30T22:22:02.382627+0000","last_active":"2023-09-30T22:24:24.135781+0000","last_peered":"2023-09-30T22:24:24.135781+0000","last_clean":"2023-09-30T22:24:24.135781+0000","last_became_active":"2023-09-30T22:22:02.382360+0000","last_became_peered":"2023-09-30T22:22:02.382360+0000","last_unstale":"2023-09-30T22:24:24.135781+0000","last_undegraded":"2023-09-30T22:24:24.135781+0000","last_fullsized":"2023-09-30T22:24:24.135781+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906766+0000","last_change":"2023-09-30T22:22:02.388864+0000","last_active":"2023-09-30T22:23:54.906766+0000","last_peered":"2023-09-30T22:23:54.906766+0000","last_clean":"2023-09-30T22:23:54.906766+0000","last_became_active":"2023-09-30T22:22:02.388267+0000","last_became_peered":"2023-09-30T22:22:02.388267+0000","last_unstale":"2023-09-30T22:23:54.906766+0000","last_undegraded":"2023-09-30T22:23:54.906766+0000","last_fullsized":"2023-09-30T22:23:54.906766+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137037+0000","last_change":"2023-09-30T22:22:02.379619+0000","last_active":"2023-09-30T22:24:24.137037+0000","last_peered":"2023-09-30T22:24:24.137037+0000","last_clean":"2023-09-30T22:24:24.137037+0000","last_became_active":"2023-09-30T22:22:02.379412+0000","last_became_peered":"2023-09-30T22:22:02.379412+0000","last_unstale":"2023-09-30T22:24:24.137037+0000","last_undegraded":"2023-09-30T22:24:24.137037+0000","last_fullsized":"2023-09-30T22:24:24.137037+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136809+0000","last_change":"2023-09-30T22:22:02.372757+0000","last_active":"2023-09-30T22:24:24.136809+0000","last_peered":"2023-09-30T22:24:24.136809+0000","last_clean":"2023-09-30T22:24:24.136809+0000","last_became_active":"2023-09-30T22:22:02.372495+0000","last_became_peered":"2023-09-30T22:22:02.372495+0000","last_unstale":"2023-09-30T22:24:24.136809+0000","last_undegraded":"2023-09-30T22:24:24.136809+0000","last_fullsized":"2023-09-30T22:24:24.136809+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.784512+0000","last_change":"2023-09-30T22:22:02.379525+0000","last_active":"2023-09-30T22:23:54.784512+0000","last_peered":"2023-09-30T22:23:54.784512+0000","last_clean":"2023-09-30T22:23:54.784512+0000","last_became_active":"2023-09-30T22:22:02.379330+0000","last_became_peered":"2023-09-30T22:22:02.379330+0000","last_unstale":"2023-09-30T22:23:54.784512+0000","last_undegraded":"2023-09-30T22:23:54.784512+0000","last_fullsized":"2023-09-30T22:23:54.784512+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.784799+0000","last_change":"2023-09-30T22:22:02.387803+0000","last_active":"2023-09-30T22:23:54.784799+0000","last_peered":"2023-09-30T22:23:54.784799+0000","last_clean":"2023-09-30T22:23:54.784799+0000","last_became_active":"2023-09-30T22:22:02.387560+0000","last_became_peered":"2023-09-30T22:22:02.387560+0000","last_unstale":"2023-09-30T22:23:54.784799+0000","last_undegraded":"2023-09-30T22:23:54.784799+0000","last_fullsized":"2023-09-30T22:23:54.784799+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136515+0000","last_change":"2023-09-30T22:22:02.374488+0000","last_active":"2023-09-30T22:24:24.136515+0000","last_peered":"2023-09-30T22:24:24.136515+0000","last_clean":"2023-09-30T22:24:24.136515+0000","last_became_active":"2023-09-30T22:22:02.374287+0000","last_became_peered":"2023-09-30T22:22:02.374287+0000","last_unstale":"2023-09-30T22:24:24.136515+0000","last_undegraded":"2023-09-30T22:24:24.136515+0000","last_fullsized":"2023-09-30T22:24:24.136515+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.905859+0000","last_change":"2023-09-30T22:22:02.375916+0000","last_active":"2023-09-30T22:23:54.905859+0000","last_peered":"2023-09-30T22:23:54.905859+0000","last_clean":"2023-09-30T22:23:54.905859+0000","last_became_active":"2023-09-30T22:22:02.374277+0000","last_became_peered":"2023-09-30T22:22:02.374277+0000","last_unstale":"2023-09-30T22:23:54.905859+0000","last_undegraded":"2023-09-30T22:23:54.905859+0000","last_fullsized":"2023-09-30T22:23:54.905859+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136250+0000","last_change":"2023-09-30T22:22:02.395769+0000","last_active":"2023-09-30T22:24:24.136250+0000","last_peered":"2023-09-30T22:24:24.136250+0000","last_clean":"2023-09-30T22:24:24.136250+0000","last_became_active":"2023-09-30T22:22:02.395459+0000","last_became_peered":"2023-09-30T22:22:02.395459+0000","last_unstale":"2023-09-30T22:24:24.136250+0000","last_undegraded":"2023-09-30T22:24:24.136250+0000","last_fullsized":"2023-09-30T22:24:24.136250+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906728+0000","last_change":"2023-09-30T22:22:02.391303+0000","last_active":"2023-09-30T22:23:54.906728+0000","last_peered":"2023-09-30T22:23:54.906728+0000","last_clean":"2023-09-30T22:23:54.906728+0000","last_became_active":"2023-09-30T22:22:02.388602+0000","last_became_peered":"2023-09-30T22:22:02.388602+0000","last_unstale":"2023-09-30T22:23:54.906728+0000","last_undegraded":"2023-09-30T22:23:54.906728+0000","last_fullsized":"2023-09-30T22:23:54.906728+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906324+0000","last_change":"2023-09-30T22:22:02.376471+0000","last_active":"2023-09-30T22:23:54.906324+0000","last_peered":"2023-09-30T22:23:54.906324+0000","last_clean":"2023-09-30T22:23:54.906324+0000","last_became_active":"2023-09-30T22:22:02.374833+0000","last_became_peered":"2023-09-30T22:22:02.374833+0000","last_unstale":"2023-09-30T22:23:54.906324+0000","last_undegraded":"2023-09-30T22:23:54.906324+0000","last_fullsized":"2023-09-30T22:23:54.906324+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.784989+0000","last_change":"2023-09-30T22:22:02.383103+0000","last_active":"2023-09-30T22:23:54.784989+0000","last_peered":"2023-09-30T22:23:54.784989+0000","last_clean":"2023-09-30T22:23:54.784989+0000","last_became_active":"2023-09-30T22:22:02.382818+0000","last_became_peered":"2023-09-30T22:22:02.382818+0000","last_unstale":"2023-09-30T22:23:54.784989+0000","last_undegraded":"2023-09-30T22:23:54.784989+0000","last_fullsized":"2023-09-30T22:23:54.784989+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.784596+0000","last_change":"2023-09-30T22:22:53.778065+0000","last_active":"2023-09-30T22:23:54.784596+0000","last_peered":"2023-09-30T22:23:54.784596+0000","last_clean":"2023-09-30T22:23:54.784596+0000","last_became_active":"2023-09-30T22:22:53.777585+0000","last_became_peered":"2023-09-30T22:22:53.777585+0000","last_unstale":"2023-09-30T22:23:54.784596+0000","last_undegraded":"2023-09-30T22:23:54.784596+0000","last_fullsized":"2023-09-30T22:23:54.784596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.135996+0000","last_change":"2023-09-30T22:22:02.391309+0000","last_active":"2023-09-30T22:24:24.135996+0000","last_peered":"2023-09-30T22:24:24.135996+0000","last_clean":"2023-09-30T22:24:24.135996+0000","last_became_active":"2023-09-30T22:22:02.391040+0000","last_became_peered":"2023-09-30T22:22:02.391040+0000","last_unstale":"2023-09-30T22:24:24.135996+0000","last_undegraded":"2023-09-30T22:24:24.135996+0000","last_fullsized":"2023-09-30T22:24:24.135996+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.905981+0000","last_change":"2023-09-30T22:22:02.375857+0000","last_active":"2023-09-30T22:23:54.905981+0000","last_peered":"2023-09-30T22:23:54.905981+0000","last_clean":"2023-09-30T22:23:54.905981+0000","last_became_active":"2023-09-30T22:22:02.373866+0000","last_became_peered":"2023-09-30T22:22:02.373866+0000","last_unstale":"2023-09-30T22:23:54.905981+0000","last_undegraded":"2023-09-30T22:23:54.905981+0000","last_fullsized":"2023-09-30T22:23:54.905981+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136774+0000","last_change":"2023-09-30T22:22:02.395696+0000","last_active":"2023-09-30T22:24:24.136774+0000","last_peered":"2023-09-30T22:24:24.136774+0000","last_clean":"2023-09-30T22:24:24.136774+0000","last_became_active":"2023-09-30T22:22:02.395318+0000","last_became_peered":"2023-09-30T22:22:02.395318+0000","last_unstale":"2023-09-30T22:24:24.136774+0000","last_undegraded":"2023-09-30T22:24:24.136774+0000","last_fullsized":"2023-09-30T22:24:24.136774+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.135842+0000","last_change":"2023-09-30T22:22:02.389818+0000","last_active":"2023-09-30T22:24:24.135842+0000","last_peered":"2023-09-30T22:24:24.135842+0000","last_clean":"2023-09-30T22:24:24.135842+0000","last_became_active":"2023-09-30T22:22:02.389526+0000","last_became_peered":"2023-09-30T22:22:02.389526+0000","last_unstale":"2023-09-30T22:24:24.135842+0000","last_undegraded":"2023-09-30T22:24:24.135842+0000","last_fullsized":"2023-09-30T22:24:24.135842+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137347+0000","last_change":"2023-09-30T22:22:02.386166+0000","last_active":"2023-09-30T22:24:24.137347+0000","last_peered":"2023-09-30T22:24:24.137347+0000","last_clean":"2023-09-30T22:24:24.137347+0000","last_became_active":"2023-09-30T22:22:02.385731+0000","last_became_peered":"2023-09-30T22:22:02.385731+0000","last_unstale":"2023-09-30T22:24:24.137347+0000","last_undegraded":"2023-09-30T22:24:24.137347+0000","last_fullsized":"2023-09-30T22:24:24.137347+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136962+0000","last_change":"2023-09-30T22:22:02.374713+0000","last_active":"2023-09-30T22:24:24.136962+0000","last_peered":"2023-09-30T22:24:24.136962+0000","last_clean":"2023-09-30T22:24:24.136962+0000","last_became_active":"2023-09-30T22:22:02.374467+0000","last_became_peered":"2023-09-30T22:22:02.374467+0000","last_unstale":"2023-09-30T22:24:24.136962+0000","last_undegraded":"2023-09-30T22:24:24.136962+0000","last_fullsized":"2023-09-30T22:24:24.136962+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136917+0000","last_change":"2023-09-30T22:22:02.395766+0000","last_active":"2023-09-30T22:24:24.136917+0000","last_peered":"2023-09-30T22:24:24.136917+0000","last_clean":"2023-09-30T22:24:24.136917+0000","last_became_active":"2023-09-30T22:22:02.395487+0000","last_became_peered":"2023-09-30T22:22:02.395487+0000","last_unstale":"2023-09-30T22:24:24.136917+0000","last_undegraded":"2023-09-30T22:24:24.136917+0000","last_fullsized":"2023-09-30T22:24:24.136917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136222+0000","last_change":"2023-09-30T22:22:01.986896+0000","last_active":"2023-09-30T22:24:24.136222+0000","last_peered":"2023-09-30T22:24:24.136222+0000","last_clean":"2023-09-30T22:24:24.136222+0000","last_became_active":"2023-09-30T22:22:01.986600+0000","last_became_peered":"2023-09-30T22:22:01.986600+0000","last_unstale":"2023-09-30T22:24:24.136222+0000","last_undegraded":"2023-09-30T22:24:24.136222+0000","last_fullsized":"2023-09-30T22:24:24.136222+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.787587+0000","last_change":"2023-09-30T22:23:54.786953+0000","last_active":"2023-09-30T22:23:54.787587+0000","last_peered":"2023-09-30T22:23:54.787587+0000","last_clean":"2023-09-30T22:23:54.787587+0000","last_became_active":"2023-09-30T22:23:54.786631+0000","last_became_peered":"2023-09-30T22:23:54.786631+0000","last_unstale":"2023-09-30T22:23:54.787587+0000","last_undegraded":"2023-09-30T22:23:54.787587+0000","last_fullsized":"2023-09-30T22:23:54.787587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136044+0000","last_change":"2023-09-30T22:22:01.992230+0000","last_active":"2023-09-30T22:24:24.136044+0000","last_peered":"2023-09-30T22:24:24.136044+0000","last_clean":"2023-09-30T22:24:24.136044+0000","last_became_active":"2023-09-30T22:22:01.991929+0000","last_became_peered":"2023-09-30T22:22:01.991929+0000","last_unstale":"2023-09-30T22:24:24.136044+0000","last_undegraded":"2023-09-30T22:24:24.136044+0000","last_fullsized":"2023-09-30T22:24:24.136044+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906431+0000","last_change":"2023-09-30T22:22:02.380249+0000","last_active":"2023-09-30T22:23:54.906431+0000","last_peered":"2023-09-30T22:23:54.906431+0000","last_clean":"2023-09-30T22:23:54.906431+0000","last_became_active":"2023-09-30T22:22:02.379830+0000","last_became_peered":"2023-09-30T22:22:02.379830+0000","last_unstale":"2023-09-30T22:23:54.906431+0000","last_undegraded":"2023-09-30T22:23:54.906431+0000","last_fullsized":"2023-09-30T22:23:54.906431+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136547+0000","last_change":"2023-09-30T22:22:01.995093+0000","last_active":"2023-09-30T22:24:24.136547+0000","last_peered":"2023-09-30T22:24:24.136547+0000","last_clean":"2023-09-30T22:24:24.136547+0000","last_became_active":"2023-09-30T22:22:01.994797+0000","last_became_peered":"2023-09-30T22:22:01.994797+0000","last_unstale":"2023-09-30T22:24:24.136547+0000","last_undegraded":"2023-09-30T22:24:24.136547+0000","last_fullsized":"2023-09-30T22:24:24.136547+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.138721+0000","last_change":"2023-09-30T22:22:02.383534+0000","last_active":"2023-09-30T22:24:24.138721+0000","last_peered":"2023-09-30T22:24:24.138721+0000","last_clean":"2023-09-30T22:24:24.138721+0000","last_became_active":"2023-09-30T22:22:02.383271+0000","last_became_peered":"2023-09-30T22:22:02.383271+0000","last_unstale":"2023-09-30T22:24:24.138721+0000","last_undegraded":"2023-09-30T22:24:24.138721+0000","last_fullsized":"2023-09-30T22:24:24.138721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906644+0000","last_change":"2023-09-30T22:22:01.997405+0000","last_active":"2023-09-30T22:23:54.906644+0000","last_peered":"2023-09-30T22:23:54.906644+0000","last_clean":"2023-09-30T22:23:54.906644+0000","last_became_active":"2023-09-30T22:22:01.997079+0000","last_became_peered":"2023-09-30T22:22:01.997079+0000","last_unstale":"2023-09-30T22:23:54.906644+0000","last_undegraded":"2023-09-30T22:23:54.906644+0000","last_fullsized":"2023-09-30T22:23:54.906644+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136622+0000","last_change":"2023-09-30T22:22:02.381424+0000","last_active":"2023-09-30T22:24:24.136622+0000","last_peered":"2023-09-30T22:24:24.136622+0000","last_clean":"2023-09-30T22:24:24.136622+0000","last_became_active":"2023-09-30T22:22:02.380981+0000","last_became_peered":"2023-09-30T22:22:02.380981+0000","last_unstale":"2023-09-30T22:24:24.136622+0000","last_undegraded":"2023-09-30T22:24:24.136622+0000","last_fullsized":"2023-09-30T22:24:24.136622+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.785293+0000","last_change":"2023-09-30T22:22:01.995183+0000","last_active":"2023-09-30T22:23:54.785293+0000","last_peered":"2023-09-30T22:23:54.785293+0000","last_clean":"2023-09-30T22:23:54.785293+0000","last_became_active":"2023-09-30T22:22:01.994920+0000","last_became_peered":"2023-09-30T22:22:01.994920+0000","last_unstale":"2023-09-30T22:23:54.785293+0000","last_undegraded":"2023-09-30T22:23:54.785293+0000","last_fullsized":"2023-09-30T22:23:54.785293+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137220+0000","last_change":"2023-09-30T22:22:02.395975+0000","last_active":"2023-09-30T22:24:24.137220+0000","last_peered":"2023-09-30T22:24:24.137220+0000","last_clean":"2023-09-30T22:24:24.137220+0000","last_became_active":"2023-09-30T22:22:02.395719+0000","last_became_peered":"2023-09-30T22:22:02.395719+0000","last_unstale":"2023-09-30T22:24:24.137220+0000","last_undegraded":"2023-09-30T22:24:24.137220+0000","last_fullsized":"2023-09-30T22:24:24.137220+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906299+0000","last_change":"2023-09-30T22:22:01.998235+0000","last_active":"2023-09-30T22:23:54.906299+0000","last_peered":"2023-09-30T22:23:54.906299+0000","last_clean":"2023-09-30T22:23:54.906299+0000","last_became_active":"2023-09-30T22:22:01.997649+0000","last_became_peered":"2023-09-30T22:22:01.997649+0000","last_unstale":"2023-09-30T22:23:54.906299+0000","last_undegraded":"2023-09-30T22:23:54.906299+0000","last_fullsized":"2023-09-30T22:23:54.906299+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136441+0000","last_change":"2023-09-30T22:22:53.774304+0000","last_active":"2023-09-30T22:24:24.136441+0000","last_peered":"2023-09-30T22:24:24.136441+0000","last_clean":"2023-09-30T22:24:24.136441+0000","last_became_active":"2023-09-30T22:22:53.773998+0000","last_became_peered":"2023-09-30T22:22:53.773998+0000","last_unstale":"2023-09-30T22:24:24.136441+0000","last_undegraded":"2023-09-30T22:24:24.136441+0000","last_fullsized":"2023-09-30T22:24:24.136441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'12","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.203393+0000","last_change":"2023-09-30T22:22:01.993933+0000","last_active":"2023-09-30T22:24:24.203393+0000","last_peered":"2023-09-30T22:24:24.203393+0000","last_clean":"2023-09-30T22:24:24.203393+0000","last_became_active":"2023-09-30T22:22:01.993574+0000","last_became_peered":"2023-09-30T22:22:01.993574+0000","last_unstale":"2023-09-30T22:24:24.203393+0000","last_undegraded":"2023-09-30T22:24:24.203393+0000","last_fullsized":"2023-09-30T22:24:24.203393+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3547,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.784634+0000","last_change":"2023-09-30T22:22:02.387576+0000","last_active":"2023-09-30T22:23:54.784634+0000","last_peered":"2023-09-30T22:23:54.784634+0000","last_clean":"2023-09-30T22:23:54.784634+0000","last_became_active":"2023-09-30T22:22:02.387235+0000","last_became_peered":"2023-09-30T22:22:02.387235+0000","last_unstale":"2023-09-30T22:23:54.784634+0000","last_undegraded":"2023-09-30T22:23:54.784634+0000","last_fullsized":"2023-09-30T22:23:54.784634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137239+0000","last_change":"2023-09-30T22:22:01.995522+0000","last_active":"2023-09-30T22:24:24.137239+0000","last_peered":"2023-09-30T22:24:24.137239+0000","last_clean":"2023-09-30T22:24:24.137239+0000","last_became_active":"2023-09-30T22:22:01.994928+0000","last_became_peered":"2023-09-30T22:22:01.994928+0000","last_unstale":"2023-09-30T22:24:24.137239+0000","last_undegraded":"2023-09-30T22:24:24.137239+0000","last_fullsized":"2023-09-30T22:24:24.137239+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137832+0000","last_change":"2023-09-30T22:22:02.383942+0000","last_active":"2023-09-30T22:24:24.137832+0000","last_peered":"2023-09-30T22:24:24.137832+0000","last_clean":"2023-09-30T22:24:24.137832+0000","last_became_active":"2023-09-30T22:22:02.383663+0000","last_became_peered":"2023-09-30T22:22:02.383663+0000","last_unstale":"2023-09-30T22:24:24.137832+0000","last_undegraded":"2023-09-30T22:24:24.137832+0000","last_fullsized":"2023-09-30T22:24:24.137832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906001+0000","last_change":"2023-09-30T22:22:01.997424+0000","last_active":"2023-09-30T22:23:54.906001+0000","last_peered":"2023-09-30T22:23:54.906001+0000","last_clean":"2023-09-30T22:23:54.906001+0000","last_became_active":"2023-09-30T22:22:01.997098+0000","last_became_peered":"2023-09-30T22:22:01.997098+0000","last_unstale":"2023-09-30T22:23:54.906001+0000","last_undegraded":"2023-09-30T22:23:54.906001+0000","last_fullsized":"2023-09-30T22:23:54.906001+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136997+0000","last_change":"2023-09-30T22:22:02.396425+0000","last_active":"2023-09-30T22:24:24.136997+0000","last_peered":"2023-09-30T22:24:24.136997+0000","last_clean":"2023-09-30T22:24:24.136997+0000","last_became_active":"2023-09-30T22:22:02.396152+0000","last_became_peered":"2023-09-30T22:22:02.396152+0000","last_unstale":"2023-09-30T22:24:24.136997+0000","last_undegraded":"2023-09-30T22:24:24.136997+0000","last_fullsized":"2023-09-30T22:24:24.136997+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137138+0000","last_change":"2023-09-30T22:22:01.994313+0000","last_active":"2023-09-30T22:24:24.137138+0000","last_peered":"2023-09-30T22:24:24.137138+0000","last_clean":"2023-09-30T22:24:24.137138+0000","last_became_active":"2023-09-30T22:22:01.993994+0000","last_became_peered":"2023-09-30T22:22:01.993994+0000","last_unstale":"2023-09-30T22:24:24.137138+0000","last_undegraded":"2023-09-30T22:24:24.137138+0000","last_fullsized":"2023-09-30T22:24:24.137138+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906530+0000","last_change":"2023-09-30T22:22:02.391210+0000","last_active":"2023-09-30T22:23:54.906530+0000","last_peered":"2023-09-30T22:23:54.906530+0000","last_clean":"2023-09-30T22:23:54.906530+0000","last_became_active":"2023-09-30T22:22:02.390937+0000","last_became_peered":"2023-09-30T22:22:02.390937+0000","last_unstale":"2023-09-30T22:23:54.906530+0000","last_undegraded":"2023-09-30T22:23:54.906530+0000","last_fullsized":"2023-09-30T22:23:54.906530+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137402+0000","last_change":"2023-09-30T22:22:01.974848+0000","last_active":"2023-09-30T22:24:24.137402+0000","last_peered":"2023-09-30T22:24:24.137402+0000","last_clean":"2023-09-30T22:24:24.137402+0000","last_became_active":"2023-09-30T22:22:01.974025+0000","last_became_peered":"2023-09-30T22:22:01.974025+0000","last_unstale":"2023-09-30T22:24:24.137402+0000","last_undegraded":"2023-09-30T22:24:24.137402+0000","last_fullsized":"2023-09-30T22:24:24.137402+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.138646+0000","last_change":"2023-09-30T22:22:02.383497+0000","last_active":"2023-09-30T22:24:24.138646+0000","last_peered":"2023-09-30T22:24:24.138646+0000","last_clean":"2023-09-30T22:24:24.138646+0000","last_became_active":"2023-09-30T22:22:02.383215+0000","last_became_peered":"2023-09-30T22:22:02.383215+0000","last_unstale":"2023-09-30T22:24:24.138646+0000","last_undegraded":"2023-09-30T22:24:24.138646+0000","last_fullsized":"2023-09-30T22:24:24.138646+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906532+0000","last_change":"2023-09-30T22:22:01.979910+0000","last_active":"2023-09-30T22:23:54.906532+0000","last_peered":"2023-09-30T22:23:54.906532+0000","last_clean":"2023-09-30T22:23:54.906532+0000","last_became_active":"2023-09-30T22:22:01.979649+0000","last_became_peered":"2023-09-30T22:22:01.979649+0000","last_unstale":"2023-09-30T22:23:54.906532+0000","last_undegraded":"2023-09-30T22:23:54.906532+0000","last_fullsized":"2023-09-30T22:23:54.906532+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137441+0000","last_change":"2023-09-30T22:22:02.381246+0000","last_active":"2023-09-30T22:24:24.137441+0000","last_peered":"2023-09-30T22:24:24.137441+0000","last_clean":"2023-09-30T22:24:24.137441+0000","last_became_active":"2023-09-30T22:22:02.380654+0000","last_became_peered":"2023-09-30T22:22:02.380654+0000","last_unstale":"2023-09-30T22:24:24.137441+0000","last_undegraded":"2023-09-30T22:24:24.137441+0000","last_fullsized":"2023-09-30T22:24:24.137441+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.785376+0000","last_change":"2023-09-30T22:22:01.990442+0000","last_active":"2023-09-30T22:23:54.785376+0000","last_peered":"2023-09-30T22:23:54.785376+0000","last_clean":"2023-09-30T22:23:54.785376+0000","last_became_active":"2023-09-30T22:22:01.990217+0000","last_became_peered":"2023-09-30T22:22:01.990217+0000","last_unstale":"2023-09-30T22:23:54.785376+0000","last_undegraded":"2023-09-30T22:23:54.785376+0000","last_fullsized":"2023-09-30T22:23:54.785376+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.135952+0000","last_change":"2023-09-30T22:22:53.777865+0000","last_active":"2023-09-30T22:24:24.135952+0000","last_peered":"2023-09-30T22:24:24.135952+0000","last_clean":"2023-09-30T22:24:24.135952+0000","last_became_active":"2023-09-30T22:22:53.777521+0000","last_became_peered":"2023-09-30T22:22:53.777521+0000","last_unstale":"2023-09-30T22:24:24.135952+0000","last_undegraded":"2023-09-30T22:24:24.135952+0000","last_fullsized":"2023-09-30T22:24:24.135952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137166+0000","last_change":"2023-09-30T22:22:01.996439+0000","last_active":"2023-09-30T22:24:24.137166+0000","last_peered":"2023-09-30T22:24:24.137166+0000","last_clean":"2023-09-30T22:24:24.137166+0000","last_became_active":"2023-09-30T22:22:01.996114+0000","last_became_peered":"2023-09-30T22:22:01.996114+0000","last_unstale":"2023-09-30T22:24:24.137166+0000","last_undegraded":"2023-09-30T22:24:24.137166+0000","last_fullsized":"2023-09-30T22:24:24.137166+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.785072+0000","last_change":"2023-09-30T22:22:02.384428+0000","last_active":"2023-09-30T22:23:54.785072+0000","last_peered":"2023-09-30T22:23:54.785072+0000","last_clean":"2023-09-30T22:23:54.785072+0000","last_became_active":"2023-09-30T22:22:02.383704+0000","last_became_peered":"2023-09-30T22:22:02.383704+0000","last_unstale":"2023-09-30T22:23:54.785072+0000","last_undegraded":"2023-09-30T22:23:54.785072+0000","last_fullsized":"2023-09-30T22:23:54.785072+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906172+0000","last_change":"2023-09-30T22:22:01.998688+0000","last_active":"2023-09-30T22:23:54.906172+0000","last_peered":"2023-09-30T22:23:54.906172+0000","last_clean":"2023-09-30T22:23:54.906172+0000","last_became_active":"2023-09-30T22:22:01.998390+0000","last_became_peered":"2023-09-30T22:22:01.998390+0000","last_unstale":"2023-09-30T22:23:54.906172+0000","last_undegraded":"2023-09-30T22:23:54.906172+0000","last_fullsized":"2023-09-30T22:23:54.906172+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906467+0000","last_change":"2023-09-30T22:22:02.376261+0000","last_active":"2023-09-30T22:23:54.906467+0000","last_peered":"2023-09-30T22:23:54.906467+0000","last_clean":"2023-09-30T22:23:54.906467+0000","last_became_active":"2023-09-30T22:22:02.375940+0000","last_became_peered":"2023-09-30T22:22:02.375940+0000","last_unstale":"2023-09-30T22:23:54.906467+0000","last_undegraded":"2023-09-30T22:23:54.906467+0000","last_fullsized":"2023-09-30T22:23:54.906467+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137070+0000","last_change":"2023-09-30T22:22:01.995642+0000","last_active":"2023-09-30T22:24:24.137070+0000","last_peered":"2023-09-30T22:24:24.137070+0000","last_clean":"2023-09-30T22:24:24.137070+0000","last_became_active":"2023-09-30T22:22:01.995224+0000","last_became_peered":"2023-09-30T22:22:01.995224+0000","last_unstale":"2023-09-30T22:24:24.137070+0000","last_undegraded":"2023-09-30T22:24:24.137070+0000","last_fullsized":"2023-09-30T22:24:24.137070+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906179+0000","last_change":"2023-09-30T22:22:53.776711+0000","last_active":"2023-09-30T22:23:54.906179+0000","last_peered":"2023-09-30T22:23:54.906179+0000","last_clean":"2023-09-30T22:23:54.906179+0000","last_became_active":"2023-09-30T22:22:53.776416+0000","last_became_peered":"2023-09-30T22:22:53.776416+0000","last_unstale":"2023-09-30T22:23:54.906179+0000","last_undegraded":"2023-09-30T22:23:54.906179+0000","last_fullsized":"2023-09-30T22:23:54.906179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136426+0000","last_change":"2023-09-30T22:22:01.995738+0000","last_active":"2023-09-30T22:24:24.136426+0000","last_peered":"2023-09-30T22:24:24.136426+0000","last_clean":"2023-09-30T22:24:24.136426+0000","last_became_active":"2023-09-30T22:22:01.994552+0000","last_became_peered":"2023-09-30T22:22:01.994552+0000","last_unstale":"2023-09-30T22:24:24.136426+0000","last_undegraded":"2023-09-30T22:24:24.136426+0000","last_fullsized":"2023-09-30T22:24:24.136426+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137073+0000","last_change":"2023-09-30T22:22:02.382026+0000","last_active":"2023-09-30T22:24:24.137073+0000","last_peered":"2023-09-30T22:24:24.137073+0000","last_clean":"2023-09-30T22:24:24.137073+0000","last_became_active":"2023-09-30T22:22:02.378486+0000","last_became_peered":"2023-09-30T22:22:02.378486+0000","last_unstale":"2023-09-30T22:24:24.137073+0000","last_undegraded":"2023-09-30T22:24:24.137073+0000","last_fullsized":"2023-09-30T22:24:24.137073+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136926+0000","last_change":"2023-09-30T22:22:01.994235+0000","last_active":"2023-09-30T22:24:24.136926+0000","last_peered":"2023-09-30T22:24:24.136926+0000","last_clean":"2023-09-30T22:24:24.136926+0000","last_became_active":"2023-09-30T22:22:01.993882+0000","last_became_peered":"2023-09-30T22:22:01.993882+0000","last_unstale":"2023-09-30T22:24:24.136926+0000","last_undegraded":"2023-09-30T22:24:24.136926+0000","last_fullsized":"2023-09-30T22:24:24.136926+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.785514+0000","last_change":"2023-09-30T22:22:02.386102+0000","last_active":"2023-09-30T22:23:54.785514+0000","last_peered":"2023-09-30T22:23:54.785514+0000","last_clean":"2023-09-30T22:23:54.785514+0000","last_became_active":"2023-09-30T22:22:02.384968+0000","last_became_peered":"2023-09-30T22:22:02.384968+0000","last_unstale":"2023-09-30T22:23:54.785514+0000","last_undegraded":"2023-09-30T22:23:54.785514+0000","last_fullsized":"2023-09-30T22:23:54.785514+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136334+0000","last_change":"2023-09-30T22:22:01.995015+0000","last_active":"2023-09-30T22:24:24.136334+0000","last_peered":"2023-09-30T22:24:24.136334+0000","last_clean":"2023-09-30T22:24:24.136334+0000","last_became_active":"2023-09-30T22:22:01.994743+0000","last_became_peered":"2023-09-30T22:22:01.994743+0000","last_unstale":"2023-09-30T22:24:24.136334+0000","last_undegraded":"2023-09-30T22:24:24.136334+0000","last_fullsized":"2023-09-30T22:24:24.136334+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137555+0000","last_change":"2023-09-30T22:22:02.385985+0000","last_active":"2023-09-30T22:24:24.137555+0000","last_peered":"2023-09-30T22:24:24.137555+0000","last_clean":"2023-09-30T22:24:24.137555+0000","last_became_active":"2023-09-30T22:22:02.385413+0000","last_became_peered":"2023-09-30T22:22:02.385413+0000","last_unstale":"2023-09-30T22:24:24.137555+0000","last_undegraded":"2023-09-30T22:24:24.137555+0000","last_fullsized":"2023-09-30T22:24:24.137555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136505+0000","last_change":"2023-09-30T22:21:58.403636+0000","last_active":"2023-09-30T22:24:24.136505+0000","last_peered":"2023-09-30T22:24:24.136505+0000","last_clean":"2023-09-30T22:24:24.136505+0000","last_became_active":"2023-09-30T22:21:58.403342+0000","last_became_peered":"2023-09-30T22:21:58.403342+0000","last_unstale":"2023-09-30T22:24:24.136505+0000","last_undegraded":"2023-09-30T22:24:24.136505+0000","last_fullsized":"2023-09-30T22:24:24.136505+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.784908+0000","last_change":"2023-09-30T22:22:01.997724+0000","last_active":"2023-09-30T22:23:54.784908+0000","last_peered":"2023-09-30T22:23:54.784908+0000","last_clean":"2023-09-30T22:23:54.784908+0000","last_became_active":"2023-09-30T22:22:01.997451+0000","last_became_peered":"2023-09-30T22:22:01.997451+0000","last_unstale":"2023-09-30T22:23:54.784908+0000","last_undegraded":"2023-09-30T22:23:54.784908+0000","last_fullsized":"2023-09-30T22:23:54.784908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136357+0000","last_change":"2023-09-30T22:22:02.389982+0000","last_active":"2023-09-30T22:24:24.136357+0000","last_peered":"2023-09-30T22:24:24.136357+0000","last_clean":"2023-09-30T22:24:24.136357+0000","last_became_active":"2023-09-30T22:22:02.389680+0000","last_became_peered":"2023-09-30T22:22:02.389680+0000","last_unstale":"2023-09-30T22:24:24.136357+0000","last_undegraded":"2023-09-30T22:24:24.136357+0000","last_fullsized":"2023-09-30T22:24:24.136357+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136635+0000","last_change":"2023-09-30T22:21:57.839392+0000","last_active":"2023-09-30T22:24:24.136635+0000","last_peered":"2023-09-30T22:24:24.136635+0000","last_clean":"2023-09-30T22:24:24.136635+0000","last_became_active":"2023-09-30T22:21:57.838993+0000","last_became_peered":"2023-09-30T22:21:57.838993+0000","last_unstale":"2023-09-30T22:24:24.136635+0000","last_undegraded":"2023-09-30T22:24:24.136635+0000","last_fullsized":"2023-09-30T22:24:24.136635+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906289+0000","last_change":"2023-09-30T22:22:01.990265+0000","last_active":"2023-09-30T22:23:54.906289+0000","last_peered":"2023-09-30T22:23:54.906289+0000","last_clean":"2023-09-30T22:23:54.906289+0000","last_became_active":"2023-09-30T22:22:01.990011+0000","last_became_peered":"2023-09-30T22:22:01.990011+0000","last_unstale":"2023-09-30T22:23:54.906289+0000","last_undegraded":"2023-09-30T22:23:54.906289+0000","last_fullsized":"2023-09-30T22:23:54.906289+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136433+0000","last_change":"2023-09-30T22:22:02.374205+0000","last_active":"2023-09-30T22:24:24.136433+0000","last_peered":"2023-09-30T22:24:24.136433+0000","last_clean":"2023-09-30T22:24:24.136433+0000","last_became_active":"2023-09-30T22:22:02.373928+0000","last_became_peered":"2023-09-30T22:22:02.373928+0000","last_unstale":"2023-09-30T22:24:24.136433+0000","last_undegraded":"2023-09-30T22:24:24.136433+0000","last_fullsized":"2023-09-30T22:24:24.136433+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.784255+0000","last_change":"2023-09-30T22:21:57.836160+0000","last_active":"2023-09-30T22:23:54.784255+0000","last_peered":"2023-09-30T22:23:54.784255+0000","last_clean":"2023-09-30T22:23:54.784255+0000","last_became_active":"2023-09-30T22:21:57.835792+0000","last_became_peered":"2023-09-30T22:21:57.835792+0000","last_unstale":"2023-09-30T22:23:54.784255+0000","last_undegraded":"2023-09-30T22:23:54.784255+0000","last_fullsized":"2023-09-30T22:23:54.784255+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136190+0000","last_change":"2023-09-30T22:22:01.987700+0000","last_active":"2023-09-30T22:24:24.136190+0000","last_peered":"2023-09-30T22:24:24.136190+0000","last_clean":"2023-09-30T22:24:24.136190+0000","last_became_active":"2023-09-30T22:22:01.987358+0000","last_became_peered":"2023-09-30T22:22:01.987358+0000","last_unstale":"2023-09-30T22:24:24.136190+0000","last_undegraded":"2023-09-30T22:24:24.136190+0000","last_fullsized":"2023-09-30T22:24:24.136190+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137424+0000","last_change":"2023-09-30T22:22:02.379845+0000","last_active":"2023-09-30T22:24:24.137424+0000","last_peered":"2023-09-30T22:24:24.137424+0000","last_clean":"2023-09-30T22:24:24.137424+0000","last_became_active":"2023-09-30T22:22:02.379594+0000","last_became_peered":"2023-09-30T22:22:02.379594+0000","last_unstale":"2023-09-30T22:24:24.137424+0000","last_undegraded":"2023-09-30T22:24:24.137424+0000","last_fullsized":"2023-09-30T22:24:24.137424+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137155+0000","last_change":"2023-09-30T22:21:57.838957+0000","last_active":"2023-09-30T22:24:24.137155+0000","last_peered":"2023-09-30T22:24:24.137155+0000","last_clean":"2023-09-30T22:24:24.137155+0000","last_became_active":"2023-09-30T22:21:57.838667+0000","last_became_peered":"2023-09-30T22:21:57.838667+0000","last_unstale":"2023-09-30T22:24:24.137155+0000","last_undegraded":"2023-09-30T22:24:24.137155+0000","last_fullsized":"2023-09-30T22:24:24.137155+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.135950+0000","last_change":"2023-09-30T22:21:56.838072+0000","last_active":"2023-09-30T22:24:24.135950+0000","last_peered":"2023-09-30T22:24:24.135950+0000","last_clean":"2023-09-30T22:24:24.135950+0000","last_became_active":"2023-09-30T22:21:56.837717+0000","last_became_peered":"2023-09-30T22:21:56.837717+0000","last_unstale":"2023-09-30T22:24:24.135950+0000","last_undegraded":"2023-09-30T22:24:24.135950+0000","last_fullsized":"2023-09-30T22:24:24.135950+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:55.823939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:55.823939+0000","last_clean_scrub_stamp":"2023-09-30T22:21:55.823939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136347+0000","last_change":"2023-09-30T22:22:01.994653+0000","last_active":"2023-09-30T22:24:24.136347+0000","last_peered":"2023-09-30T22:24:24.136347+0000","last_clean":"2023-09-30T22:24:24.136347+0000","last_became_active":"2023-09-30T22:22:01.994362+0000","last_became_peered":"2023-09-30T22:22:01.994362+0000","last_unstale":"2023-09-30T22:24:24.136347+0000","last_undegraded":"2023-09-30T22:24:24.136347+0000","last_fullsized":"2023-09-30T22:24:24.136347+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137397+0000","last_change":"2023-09-30T22:22:02.381190+0000","last_active":"2023-09-30T22:24:24.137397+0000","last_peered":"2023-09-30T22:24:24.137397+0000","last_clean":"2023-09-30T22:24:24.137397+0000","last_became_active":"2023-09-30T22:22:02.380952+0000","last_became_peered":"2023-09-30T22:22:02.380952+0000","last_unstale":"2023-09-30T22:24:24.137397+0000","last_undegraded":"2023-09-30T22:24:24.137397+0000","last_fullsized":"2023-09-30T22:24:24.137397+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136410+0000","last_change":"2023-09-30T22:21:57.837598+0000","last_active":"2023-09-30T22:24:24.136410+0000","last_peered":"2023-09-30T22:24:24.136410+0000","last_clean":"2023-09-30T22:24:24.136410+0000","last_became_active":"2023-09-30T22:21:57.837284+0000","last_became_peered":"2023-09-30T22:21:57.837284+0000","last_unstale":"2023-09-30T22:24:24.136410+0000","last_undegraded":"2023-09-30T22:24:24.136410+0000","last_fullsized":"2023-09-30T22:24:24.136410+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.905905+0000","last_change":"2023-09-30T22:22:01.983059+0000","last_active":"2023-09-30T22:23:54.905905+0000","last_peered":"2023-09-30T22:23:54.905905+0000","last_clean":"2023-09-30T22:23:54.905905+0000","last_became_active":"2023-09-30T22:22:01.982739+0000","last_became_peered":"2023-09-30T22:22:01.982739+0000","last_unstale":"2023-09-30T22:23:54.905905+0000","last_undegraded":"2023-09-30T22:23:54.905905+0000","last_fullsized":"2023-09-30T22:23:54.905905+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906540+0000","last_change":"2023-09-30T22:22:02.380074+0000","last_active":"2023-09-30T22:23:54.906540+0000","last_peered":"2023-09-30T22:23:54.906540+0000","last_clean":"2023-09-30T22:23:54.906540+0000","last_became_active":"2023-09-30T22:22:02.379501+0000","last_became_peered":"2023-09-30T22:22:02.379501+0000","last_unstale":"2023-09-30T22:23:54.906540+0000","last_undegraded":"2023-09-30T22:23:54.906540+0000","last_fullsized":"2023-09-30T22:23:54.906540+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137298+0000","last_change":"2023-09-30T22:21:58.403508+0000","last_active":"2023-09-30T22:24:24.137298+0000","last_peered":"2023-09-30T22:24:24.137298+0000","last_clean":"2023-09-30T22:24:24.137298+0000","last_became_active":"2023-09-30T22:21:58.403267+0000","last_became_peered":"2023-09-30T22:21:58.403267+0000","last_unstale":"2023-09-30T22:24:24.137298+0000","last_undegraded":"2023-09-30T22:24:24.137298+0000","last_fullsized":"2023-09-30T22:24:24.137298+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136353+0000","last_change":"2023-09-30T22:22:01.987265+0000","last_active":"2023-09-30T22:24:24.136353+0000","last_peered":"2023-09-30T22:24:24.136353+0000","last_clean":"2023-09-30T22:24:24.136353+0000","last_became_active":"2023-09-30T22:22:01.986968+0000","last_became_peered":"2023-09-30T22:22:01.986968+0000","last_unstale":"2023-09-30T22:24:24.136353+0000","last_undegraded":"2023-09-30T22:24:24.136353+0000","last_fullsized":"2023-09-30T22:24:24.136353+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906389+0000","last_change":"2023-09-30T22:22:02.376013+0000","last_active":"2023-09-30T22:23:54.906389+0000","last_peered":"2023-09-30T22:23:54.906389+0000","last_clean":"2023-09-30T22:23:54.906389+0000","last_became_active":"2023-09-30T22:22:02.374252+0000","last_became_peered":"2023-09-30T22:22:02.374252+0000","last_unstale":"2023-09-30T22:23:54.906389+0000","last_undegraded":"2023-09-30T22:23:54.906389+0000","last_fullsized":"2023-09-30T22:23:54.906389+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.138485+0000","last_change":"2023-09-30T22:22:01.994188+0000","last_active":"2023-09-30T22:24:24.138485+0000","last_peered":"2023-09-30T22:24:24.138485+0000","last_clean":"2023-09-30T22:24:24.138485+0000","last_became_active":"2023-09-30T22:22:01.993644+0000","last_became_peered":"2023-09-30T22:22:01.993644+0000","last_unstale":"2023-09-30T22:24:24.138485+0000","last_undegraded":"2023-09-30T22:24:24.138485+0000","last_fullsized":"2023-09-30T22:24:24.138485+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136825+0000","last_change":"2023-09-30T22:21:58.403570+0000","last_active":"2023-09-30T22:24:24.136825+0000","last_peered":"2023-09-30T22:24:24.136825+0000","last_clean":"2023-09-30T22:24:24.136825+0000","last_became_active":"2023-09-30T22:21:58.403321+0000","last_became_peered":"2023-09-30T22:21:58.403321+0000","last_unstale":"2023-09-30T22:24:24.136825+0000","last_undegraded":"2023-09-30T22:24:24.136825+0000","last_fullsized":"2023-09-30T22:24:24.136825+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.784002+0000","last_change":"2023-09-30T22:22:53.773733+0000","last_active":"2023-09-30T22:23:54.784002+0000","last_peered":"2023-09-30T22:23:54.784002+0000","last_clean":"2023-09-30T22:23:54.784002+0000","last_became_active":"2023-09-30T22:22:53.773355+0000","last_became_peered":"2023-09-30T22:22:53.773355+0000","last_unstale":"2023-09-30T22:23:54.784002+0000","last_undegraded":"2023-09-30T22:23:54.784002+0000","last_fullsized":"2023-09-30T22:23:54.784002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.138566+0000","last_change":"2023-09-30T22:21:58.404380+0000","last_active":"2023-09-30T22:24:24.138566+0000","last_peered":"2023-09-30T22:24:24.138566+0000","last_clean":"2023-09-30T22:24:24.138566+0000","last_became_active":"2023-09-30T22:21:58.404098+0000","last_became_peered":"2023-09-30T22:21:58.404098+0000","last_unstale":"2023-09-30T22:24:24.138566+0000","last_undegraded":"2023-09-30T22:24:24.138566+0000","last_fullsized":"2023-09-30T22:24:24.138566+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:21:56.824958+0000","last_clean_scrub_stamp":"2023-09-30T22:21:56.824958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"17'1","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906428+0000","last_change":"2023-09-30T22:22:01.977163+0000","last_active":"2023-09-30T22:23:54.906428+0000","last_peered":"2023-09-30T22:23:54.906428+0000","last_clean":"2023-09-30T22:23:54.906428+0000","last_became_active":"2023-09-30T22:22:01.976494+0000","last_became_peered":"2023-09-30T22:22:01.976494+0000","last_unstale":"2023-09-30T22:23:54.906428+0000","last_undegraded":"2023-09-30T22:23:54.906428+0000","last_fullsized":"2023-09-30T22:23:54.906428+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.784171+0000","last_change":"2023-09-30T22:22:53.778172+0000","last_active":"2023-09-30T22:23:54.784171+0000","last_peered":"2023-09-30T22:23:54.784171+0000","last_clean":"2023-09-30T22:23:54.784171+0000","last_became_active":"2023-09-30T22:22:53.777822+0000","last_became_peered":"2023-09-30T22:22:53.777822+0000","last_unstale":"2023-09-30T22:23:54.784171+0000","last_undegraded":"2023-09-30T22:23:54.784171+0000","last_fullsized":"2023-09-30T22:23:54.784171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906397+0000","last_change":"2023-09-30T22:22:01.997989+0000","last_active":"2023-09-30T22:23:54.906397+0000","last_peered":"2023-09-30T22:23:54.906397+0000","last_clean":"2023-09-30T22:23:54.906397+0000","last_became_active":"2023-09-30T22:22:01.997419+0000","last_became_peered":"2023-09-30T22:22:01.997419+0000","last_unstale":"2023-09-30T22:23:54.906397+0000","last_undegraded":"2023-09-30T22:23:54.906397+0000","last_fullsized":"2023-09-30T22:23:54.906397+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.784492+0000","last_change":"2023-09-30T22:22:02.379106+0000","last_active":"2023-09-30T22:23:54.784492+0000","last_peered":"2023-09-30T22:23:54.784492+0000","last_clean":"2023-09-30T22:23:54.784492+0000","last_became_active":"2023-09-30T22:22:02.378452+0000","last_became_peered":"2023-09-30T22:22:02.378452+0000","last_unstale":"2023-09-30T22:23:54.784492+0000","last_undegraded":"2023-09-30T22:23:54.784492+0000","last_fullsized":"2023-09-30T22:23:54.784492+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136591+0000","last_change":"2023-09-30T22:22:01.977515+0000","last_active":"2023-09-30T22:24:24.136591+0000","last_peered":"2023-09-30T22:24:24.136591+0000","last_clean":"2023-09-30T22:24:24.136591+0000","last_became_active":"2023-09-30T22:22:01.976843+0000","last_became_peered":"2023-09-30T22:22:01.976843+0000","last_unstale":"2023-09-30T22:24:24.136591+0000","last_undegraded":"2023-09-30T22:24:24.136591+0000","last_fullsized":"2023-09-30T22:24:24.136591+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.784718+0000","last_change":"2023-09-30T22:22:02.387751+0000","last_active":"2023-09-30T22:23:54.784718+0000","last_peered":"2023-09-30T22:23:54.784718+0000","last_clean":"2023-09-30T22:23:54.784718+0000","last_became_active":"2023-09-30T22:22:02.387326+0000","last_became_peered":"2023-09-30T22:22:02.387326+0000","last_unstale":"2023-09-30T22:23:54.784718+0000","last_undegraded":"2023-09-30T22:23:54.784718+0000","last_fullsized":"2023-09-30T22:23:54.784718+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137406+0000","last_change":"2023-09-30T22:22:01.996439+0000","last_active":"2023-09-30T22:24:24.137406+0000","last_peered":"2023-09-30T22:24:24.137406+0000","last_clean":"2023-09-30T22:24:24.137406+0000","last_became_active":"2023-09-30T22:22:01.996179+0000","last_became_peered":"2023-09-30T22:22:01.996179+0000","last_unstale":"2023-09-30T22:24:24.137406+0000","last_undegraded":"2023-09-30T22:24:24.137406+0000","last_fullsized":"2023-09-30T22:24:24.137406+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.784994+0000","last_change":"2023-09-30T22:22:02.384588+0000","last_active":"2023-09-30T22:23:54.784994+0000","last_peered":"2023-09-30T22:23:54.784994+0000","last_clean":"2023-09-30T22:23:54.784994+0000","last_became_active":"2023-09-30T22:22:02.384072+0000","last_became_peered":"2023-09-30T22:22:02.384072+0000","last_unstale":"2023-09-30T22:23:54.784994+0000","last_undegraded":"2023-09-30T22:23:54.784994+0000","last_fullsized":"2023-09-30T22:23:54.784994+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.138259+0000","last_change":"2023-09-30T22:22:01.993986+0000","last_active":"2023-09-30T22:24:24.138259+0000","last_peered":"2023-09-30T22:24:24.138259+0000","last_clean":"2023-09-30T22:24:24.138259+0000","last_became_active":"2023-09-30T22:22:01.993575+0000","last_became_peered":"2023-09-30T22:22:01.993575+0000","last_unstale":"2023-09-30T22:24:24.138259+0000","last_undegraded":"2023-09-30T22:24:24.138259+0000","last_fullsized":"2023-09-30T22:24:24.138259+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137313+0000","last_change":"2023-09-30T22:22:02.378109+0000","last_active":"2023-09-30T22:24:24.137313+0000","last_peered":"2023-09-30T22:24:24.137313+0000","last_clean":"2023-09-30T22:24:24.137313+0000","last_became_active":"2023-09-30T22:22:02.377671+0000","last_became_peered":"2023-09-30T22:22:02.377671+0000","last_unstale":"2023-09-30T22:24:24.137313+0000","last_undegraded":"2023-09-30T22:24:24.137313+0000","last_fullsized":"2023-09-30T22:24:24.137313+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906686+0000","last_change":"2023-09-30T22:22:01.980853+0000","last_active":"2023-09-30T22:23:54.906686+0000","last_peered":"2023-09-30T22:23:54.906686+0000","last_clean":"2023-09-30T22:23:54.906686+0000","last_became_active":"2023-09-30T22:22:01.979795+0000","last_became_peered":"2023-09-30T22:22:01.979795+0000","last_unstale":"2023-09-30T22:23:54.906686+0000","last_undegraded":"2023-09-30T22:23:54.906686+0000","last_fullsized":"2023-09-30T22:23:54.906686+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:00.955035+0000","last_clean_scrub_stamp":"2023-09-30T22:22:00.955035+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.784090+0000","last_change":"2023-09-30T22:22:02.377790+0000","last_active":"2023-09-30T22:23:54.784090+0000","last_peered":"2023-09-30T22:23:54.784090+0000","last_clean":"2023-09-30T22:23:54.784090+0000","last_became_active":"2023-09-30T22:22:02.377478+0000","last_became_peered":"2023-09-30T22:22:02.377478+0000","last_unstale":"2023-09-30T22:23:54.784090+0000","last_undegraded":"2023-09-30T22:23:54.784090+0000","last_fullsized":"2023-09-30T22:23:54.784090+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136045+0000","last_change":"2023-09-30T22:22:02.373820+0000","last_active":"2023-09-30T22:24:24.136045+0000","last_peered":"2023-09-30T22:24:24.136045+0000","last_clean":"2023-09-30T22:24:24.136045+0000","last_became_active":"2023-09-30T22:22:02.373530+0000","last_became_peered":"2023-09-30T22:22:02.373530+0000","last_unstale":"2023-09-30T22:24:24.136045+0000","last_undegraded":"2023-09-30T22:24:24.136045+0000","last_fullsized":"2023-09-30T22:24:24.136045+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.137000+0000","last_change":"2023-09-30T22:22:02.377945+0000","last_active":"2023-09-30T22:24:24.137000+0000","last_peered":"2023-09-30T22:24:24.137000+0000","last_clean":"2023-09-30T22:24:24.137000+0000","last_became_active":"2023-09-30T22:22:02.377355+0000","last_became_peered":"2023-09-30T22:22:02.377355+0000","last_unstale":"2023-09-30T22:24:24.137000+0000","last_undegraded":"2023-09-30T22:24:24.137000+0000","last_fullsized":"2023-09-30T22:24:24.137000+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.906082+0000","last_change":"2023-09-30T22:22:02.387890+0000","last_active":"2023-09-30T22:23:54.906082+0000","last_peered":"2023-09-30T22:23:54.906082+0000","last_clean":"2023-09-30T22:23:54.906082+0000","last_became_active":"2023-09-30T22:22:02.387599+0000","last_became_peered":"2023-09-30T22:22:02.387599+0000","last_unstale":"2023-09-30T22:23:54.906082+0000","last_undegraded":"2023-09-30T22:23:54.906082+0000","last_fullsized":"2023-09-30T22:23:54.906082+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-30T22:23:54.784382+0000","last_change":"2023-09-30T22:22:53.776901+0000","last_active":"2023-09-30T22:23:54.784382+0000","last_peered":"2023-09-30T22:23:54.784382+0000","last_clean":"2023-09-30T22:23:54.784382+0000","last_became_active":"2023-09-30T22:22:53.776569+0000","last_became_peered":"2023-09-30T22:22:53.776569+0000","last_unstale":"2023-09-30T22:23:54.784382+0000","last_undegraded":"2023-09-30T22:23:54.784382+0000","last_fullsized":"2023-09-30T22:23:54.784382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-30T22:24:24.136219+0000","last_change":"2023-09-30T22:22:02.374216+0000","last_active":"2023-09-30T22:24:24.136219+0000","last_peered":"2023-09-30T22:24:24.136219+0000","last_clean":"2023-09-30T22:24:24.136219+0000","last_became_active":"2023-09-30T22:22:02.373952+0000","last_became_peered":"2023-09-30T22:22:02.373952+0000","last_unstale":"2023-09-30T22:24:24.136219+0000","last_undegraded":"2023-09-30T22:24:24.136219+0000","last_fullsized":"2023-09-30T22:24:24.136219+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:22:01.956301+0000","last_clean_scrub_stamp":"2023-09-30T22:22:01.956301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4317,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705696,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297308,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074532,"statfs":{"total":96636764160,"available":96332320768,"internally_reserved":0,"allocated":217088,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"min":{"1min":0.20499999999999999,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.42099999999999999,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.23400000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.246}]},{"osd":1,"last update":"Sat Sep 30 22:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.26600000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.46200000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.317,"5min":0.33100000000000002,"15min":0.33300000000000002},"min":{"1min":0.249,"5min":0.223,"15min":0.223},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.28699999999999998}]},{"osd":2,"last update":"Sat Sep 30 22:23:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.35099999999999998,"15min":0.35299999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.497,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.34599999999999997,"15min":0.34799999999999998},"min":{"1min":0.26900000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.47799999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.34499999999999997}]}]},{"osd":2,"up_from":9,"seq":38654705696,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297296,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074544,"statfs":{"total":96636764160,"available":96332333056,"internally_reserved":0,"allocated":204800,"data_stored":75571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.30499999999999999,"15min":0.307},"min":{"1min":0.16,"5min":0.159,"15min":0.159},"max":{"1min":0.432,"5min":0.55700000000000005,"15min":0.55700000000000005},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.311,"5min":0.309,"15min":0.309},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.495,"5min":0.501,"15min":0.501},"last":0.28199999999999997}]},{"osd":1,"last update":"Sat Sep 30 22:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.307,"15min":0.309},"min":{"1min":0.223,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.42099999999999999,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.314,"5min":0.33800000000000002,"15min":0.34200000000000003},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.46000000000000002,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.29399999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:23:59 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.33700000000000002,"15min":0.34100000000000003},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.442,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.35199999999999998,"15min":0.35499999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.47999999999999998,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.30299999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705696,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297292,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074548,"statfs":{"total":96636764160,"available":96332337152,"internally_reserved":0,"allocated":200704,"data_stored":67699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 22:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.30099999999999999,"15min":0.29899999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.432,"5min":0.432,"15min":0.432},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.33900000000000002,"15min":0.33700000000000002},"min":{"1min":0.27900000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.47999999999999998}]},{"osd":2,"last update":"Sat Sep 30 22:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.308,"15min":0.307},"min":{"1min":0.254,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.30199999999999999,"5min":0.32000000000000001,"15min":0.32300000000000001},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.44}]},{"osd":3,"last update":"Sat Sep 30 22:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.34000000000000002,"15min":0.34200000000000003},"min":{"1min":0.26700000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.313,"5min":0.32200000000000001,"15min":0.32400000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"last":0.61899999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705696,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297296,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074544,"statfs":{"total":96636764160,"available":96332333056,"internally_reserved":0,"allocated":204800,"data_stored":72670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.307,"15min":0.30499999999999999},"min":{"1min":0.16900000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.32700000000000001,"15min":0.32500000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.73799999999999999}]},{"osd":2,"last update":"Sat Sep 30 22:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.23499999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.35599999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:23:58 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.34899999999999998,"15min":0.34699999999999998},"min":{"1min":0.252,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.38200000000000001,"15min":0.38300000000000001},"min":{"1min":0.28399999999999997,"5min":0.246,"15min":0.246},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.67500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T22:24:28.245 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-30T22:24:28.245 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-09-30T22:24:28.245 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-09-30T22:24:28.245 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T22:24:28.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.403+0000 7f7a9b15c700 1 Processor -- start 2023-09-30T22:24:28.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.403+0000 7f7a9b15c700 1 -- start start 2023-09-30T22:24:28.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.403+0000 7f7a9b15c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a94136bf0 0x7f7a94138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:28.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.403+0000 7f7a9b15c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7a94139510 0x7f7a9413b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:28.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.403+0000 7f7a9b15c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a940a2600 con 0x7f7a9409c890 2023-09-30T22:24:28.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.403+0000 7f7a9b15c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a940a29d0 con 0x7f7a94139510 2023-09-30T22:24:28.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.403+0000 7f7a9b15c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9409fb40 con 0x7f7a94136bf0 2023-09-30T22:24:28.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.403+0000 7f7a93fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a94136bf0 0x7f7a94138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:28.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.403+0000 7f7a996f9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7a94139510 0x7f7a9413b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:28.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.403+0000 7f7a93fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a94136bf0 0x7f7a94138fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33176/0 (socket says 172.21.15.40:33176) 2023-09-30T22:24:28.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.403+0000 7f7a93fff700 1 -- 172.21.15.40:0/1419265203 learned_addr learned my addr 172.21.15.40:0/1419265203 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:28.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.404+0000 7f7a93fff700 1 -- 172.21.15.40:0/1419265203 >> v2:172.21.15.40:3300/0 conn(0x7f7a94139510 msgr2=0x7f7a9413b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:28.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.404+0000 7f7a93fff700 1 --2- 172.21.15.40:0/1419265203 >> v2:172.21.15.40:3300/0 conn(0x7f7a94139510 0x7f7a9413b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.404+0000 7f7a93fff700 1 -- 172.21.15.40:0/1419265203 >> v1:172.21.15.40:6789/0 conn(0x7f7a9409c890 legacy=0x7f7a9409cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.404+0000 7f7a93fff700 1 -- 172.21.15.40:0/1419265203 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a9409d370 con 0x7f7a94136bf0 2023-09-30T22:24:28.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.404+0000 7f7a937fe700 1 -- 172.21.15.40:0/1419265203 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3735993438 0 0) 0x7f7a940a2600 con 0x7f7a9409c890 2023-09-30T22:24:28.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.404+0000 7f7a996f9700 1 --2- 172.21.15.40:0/1419265203 >> v2:172.21.15.40:3300/0 conn(0x7f7a94139510 0x7f7a9413b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:28.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.404+0000 7f7a93fff700 1 --2- 172.21.15.40:0/1419265203 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a94136bf0 0x7f7a94138fd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7a800098f0 tx=0x7f7a80009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fce1e8beb3843cf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:28.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.404+0000 7f7a937fe700 1 -- 172.21.15.40:0/1419265203 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a80011830 con 0x7f7a94136bf0 2023-09-30T22:24:28.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.404+0000 7f7a937fe700 1 -- 172.21.15.40:0/1419265203 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a80011990 con 0x7f7a94136bf0 2023-09-30T22:24:28.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.404+0000 7f7a937fe700 1 -- 172.21.15.40:0/1419265203 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a80011d20 con 0x7f7a94136bf0 2023-09-30T22:24:28.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.404+0000 7f7a9b15c700 1 -- 172.21.15.40:0/1419265203 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a94136bf0 msgr2=0x7f7a94138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.404+0000 7f7a9b15c700 1 --2- 172.21.15.40:0/1419265203 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a94136bf0 0x7f7a94138fd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7a800098f0 tx=0x7f7a80009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:28.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.405+0000 7f7a9b15c700 1 -- 172.21.15.40:0/1419265203 shutdown_connections 2023-09-30T22:24:28.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.405+0000 7f7a9b15c700 1 --2- 172.21.15.40:0/1419265203 >> v2:172.21.15.40:3300/0 conn(0x7f7a94139510 0x7f7a9413b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.405+0000 7f7a9b15c700 1 --2- 172.21.15.40:0/1419265203 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a94136bf0 0x7f7a94138fd0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.405+0000 7f7a9b15c700 1 -- 172.21.15.40:0/1419265203 >> 172.21.15.40:0/1419265203 conn(0x7f7a940a7080 msgr2=0x7f7a940a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:28.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.405+0000 7f7a9b15c700 1 -- 172.21.15.40:0/1419265203 shutdown_connections 2023-09-30T22:24:28.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.405+0000 7f7a9b15c700 1 -- 172.21.15.40:0/1419265203 wait complete. 2023-09-30T22:24:28.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.406+0000 7f7a9b15c700 1 Processor -- start 2023-09-30T22:24:28.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.406+0000 7f7a9b15c700 1 -- start start 2023-09-30T22:24:28.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.407+0000 7f7a9b15c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a9409c890 0x7f7a941c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:28.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.407+0000 7f7a9b15c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a94136bf0 0x7f7a941c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:28.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.407+0000 7f7a9b15c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a94139510 0x7f7a9406efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:28.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.407+0000 7f7a9b15c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9412c550 con 0x7f7a94136bf0 2023-09-30T22:24:28.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.407+0000 7f7a9b15c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9412bcb0 con 0x7f7a94139510 2023-09-30T22:24:28.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.407+0000 7f7a9b15c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a94071760 con 0x7f7a9409c890 2023-09-30T22:24:28.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.407+0000 7f7a98ef8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a9409c890 0x7f7a941c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:28.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.407+0000 7f7a98ef8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a9409c890 0x7f7a941c8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33192/0 (socket says 172.21.15.40:33192) 2023-09-30T22:24:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.407+0000 7f7a98ef8700 1 -- 172.21.15.40:0/3133999638 learned_addr learned my addr 172.21.15.40:0/3133999638 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.407+0000 7f7a93fff700 1 --2- 172.21.15.40:0/3133999638 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a94136bf0 0x7f7a941c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.407+0000 7f7a996f9700 1 --2- 172.21.15.40:0/3133999638 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a94139510 0x7f7a9406efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.407+0000 7f7a98ef8700 1 -- 172.21.15.40:0/3133999638 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a94139510 msgr2=0x7f7a9406efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.407+0000 7f7a98ef8700 1 --2- 172.21.15.40:0/3133999638 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a94139510 0x7f7a9406efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.407+0000 7f7a98ef8700 1 -- 172.21.15.40:0/3133999638 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a94136bf0 msgr2=0x7f7a941c8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.407+0000 7f7a98ef8700 1 --2- 172.21.15.40:0/3133999638 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a94136bf0 0x7f7a941c8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.407+0000 7f7a98ef8700 1 -- 172.21.15.40:0/3133999638 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8c009a70 con 0x7f7a9409c890 2023-09-30T22:24:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.407+0000 7f7a93fff700 1 --2- 172.21.15.40:0/3133999638 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a94136bf0 0x7f7a941c8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.407+0000 7f7a98ef8700 1 --2- 172.21.15.40:0/3133999638 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a9409c890 0x7f7a941c8900 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7a8800c550 tx=0x7f7a8800c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.407+0000 7f7a917fa700 1 -- 172.21.15.40:0/3133999638 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a880054e0 con 0x7f7a9409c890 2023-09-30T22:24:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.407+0000 7f7a917fa700 1 -- 172.21.15.40:0/3133999638 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a88003680 con 0x7f7a9409c890 2023-09-30T22:24:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.407+0000 7f7a9b15c700 1 -- 172.21.15.40:0/3133999638 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a80009550 con 0x7f7a9409c890 2023-09-30T22:24:28.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.407+0000 7f7a917fa700 1 -- 172.21.15.40:0/3133999638 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a88003a30 con 0x7f7a9409c890 2023-09-30T22:24:28.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.408+0000 7f7a9b15c700 1 -- 172.21.15.40:0/3133999638 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a9412bf90 con 0x7f7a9409c890 2023-09-30T22:24:28.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.408+0000 7f7a917fa700 1 -- 172.21.15.40:0/3133999638 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f7a88003b90 con 0x7f7a9409c890 2023-09-30T22:24:28.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.408+0000 7f7a917fa700 1 -- 172.21.15.40:0/3133999638 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4094+0+0 (secure 0 0 0) 0x7f7a8803ef70 con 0x7f7a9409c890 2023-09-30T22:24:28.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.408+0000 7f7a9b15c700 1 -- 172.21.15.40:0/3133999638 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a94062380 con 0x7f7a9409c890 2023-09-30T22:24:28.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.413+0000 7f7a917fa700 1 -- 172.21.15.40:0/3133999638 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7a88017030 con 0x7f7a9409c890 2023-09-30T22:24:28.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.652+0000 7f7a9b15c700 1 -- 172.21.15.40:0/3133999638 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7a94074620 con 0x7f7a9409c890 2023-09-30T22:24:28.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.652+0000 7f7a917fa700 1 -- 172.21.15.40:0/3133999638 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f7a88017020 con 0x7f7a9409c890 2023-09-30T22:24:28.653 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:24:28.653 INFO:teuthology.orchestra.run.smithi040.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-09-30T22:24:28.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.655+0000 7f7a9b15c700 1 -- 172.21.15.40:0/3133999638 >> v1:172.21.15.40:6816/127432 conn(0x7f7a7802f480 legacy=0x7f7a78031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.655+0000 7f7a9b15c700 1 -- 172.21.15.40:0/3133999638 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a9409c890 msgr2=0x7f7a941c8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.655+0000 7f7a9b15c700 1 --2- 172.21.15.40:0/3133999638 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a9409c890 0x7f7a941c8900 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7a8800c550 tx=0x7f7a8800c860 comp rx=0 tx=0).stop 2023-09-30T22:24:28.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.655+0000 7f7a9b15c700 1 -- 172.21.15.40:0/3133999638 shutdown_connections 2023-09-30T22:24:28.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.655+0000 7f7a9b15c700 1 --2- 172.21.15.40:0/3133999638 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a9409c890 0x7f7a941c8900 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.655+0000 7f7a9b15c700 1 --2- 172.21.15.40:0/3133999638 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a94139510 0x7f7a9406efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.655+0000 7f7a9b15c700 1 --2- 172.21.15.40:0/3133999638 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a94136bf0 0x7f7a941c8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.655+0000 7f7a9b15c700 1 -- 172.21.15.40:0/3133999638 >> 172.21.15.40:0/3133999638 conn(0x7f7a940a7080 msgr2=0x7f7a941349d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:28.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.655+0000 7f7a9b15c700 1 -- 172.21.15.40:0/3133999638 shutdown_connections 2023-09-30T22:24:28.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.655+0000 7f7a9b15c700 1 -- 172.21.15.40:0/3133999638 wait complete. 2023-09-30T22:24:28.667 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-09-30T22:24:28.668 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:24:28.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.793+0000 7f53a17c4700 1 Processor -- start 2023-09-30T22:24:28.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.793+0000 7f53a17c4700 1 -- start start 2023-09-30T22:24:28.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.793+0000 7f53a17c4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f539c06a6d0 0x7f539c06aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:28.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.793+0000 7f53a17c4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f539c131fc0 0x7f539c139b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:28.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.794+0000 7f53a17c4700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f539c09eb60 con 0x7f539c06afe0 2023-09-30T22:24:28.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.794+0000 7f53a17c4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f539c09db70 con 0x7f539c06a6d0 2023-09-30T22:24:28.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.794+0000 7f53a17c4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f539c09ddf0 con 0x7f539c131fc0 2023-09-30T22:24:28.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.794+0000 7f539affd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f539c06a6d0 0x7f539c06aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:28.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.794+0000 7f539a7fc700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f539c06afe0 0x7f539c1318b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40234/0 (socket says 172.21.15.40:40234) 2023-09-30T22:24:28.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.794+0000 7f539b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f539c131fc0 0x7f539c139b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:28.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.794+0000 7f539a7fc700 1 -- 172.21.15.40:0/3924452000 learned_addr learned my addr 172.21.15.40:0/3924452000 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:24:28.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.794+0000 7f539affd700 1 -- 172.21.15.40:0/3924452000 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f539c131fc0 msgr2=0x7f539c139b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.794+0000 7f539affd700 1 --2- 172.21.15.40:0/3924452000 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f539c131fc0 0x7f539c139b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.794+0000 7f539affd700 1 -- 172.21.15.40:0/3924452000 >> v1:172.21.15.40:6789/0 conn(0x7f539c06afe0 legacy=0x7f539c1318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.794+0000 7f539affd700 1 -- 172.21.15.40:0/3924452000 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539c09c9a0 con 0x7f539c06a6d0 2023-09-30T22:24:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.794+0000 7f539b7fe700 1 --2- 172.21.15.40:0/3924452000 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f539c131fc0 0x7f539c139b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.794+0000 7f5399ffb700 1 -- 172.21.15.40:0/3924452000 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3023583059 0 0) 0x7f539c09eb60 con 0x7f539c06afe0 2023-09-30T22:24:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.794+0000 7f539affd700 1 --2- 172.21.15.40:0/3924452000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f539c06a6d0 0x7f539c06aaa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f538c009820 tx=0x7f538c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f7004c208eb823 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.794+0000 7f5399ffb700 1 -- 172.21.15.40:0/3924452000 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538c005e30 con 0x7f539c06a6d0 2023-09-30T22:24:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.794+0000 7f5399ffb700 1 -- 172.21.15.40:0/3924452000 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538c006030 con 0x7f539c06a6d0 2023-09-30T22:24:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.794+0000 7f5399ffb700 1 -- 172.21.15.40:0/3924452000 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538c0063c0 con 0x7f539c06a6d0 2023-09-30T22:24:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.795+0000 7f53a17c4700 1 -- 172.21.15.40:0/3924452000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f539c06a6d0 msgr2=0x7f539c06aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.795+0000 7f53a17c4700 1 --2- 172.21.15.40:0/3924452000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f539c06a6d0 0x7f539c06aaa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f538c009820 tx=0x7f538c009b30 comp rx=0 tx=0).stop 2023-09-30T22:24:28.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.795+0000 7f53a17c4700 1 -- 172.21.15.40:0/3924452000 shutdown_connections 2023-09-30T22:24:28.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.795+0000 7f53a17c4700 1 --2- 172.21.15.40:0/3924452000 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f539c131fc0 0x7f539c139b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.795+0000 7f53a17c4700 1 --2- 172.21.15.40:0/3924452000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f539c06a6d0 0x7f539c06aaa0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.795+0000 7f53a17c4700 1 -- 172.21.15.40:0/3924452000 >> 172.21.15.40:0/3924452000 conn(0x7f539c09fb20 msgr2=0x7f539c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:28.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.795+0000 7f53a17c4700 1 -- 172.21.15.40:0/3924452000 shutdown_connections 2023-09-30T22:24:28.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.795+0000 7f53a17c4700 1 -- 172.21.15.40:0/3924452000 wait complete. 2023-09-30T22:24:28.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.796+0000 7f53a17c4700 1 Processor -- start 2023-09-30T22:24:28.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.796+0000 7f53a17c4700 1 -- start start 2023-09-30T22:24:28.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.796+0000 7f53a17c4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f539c06a6d0 0x7f539c11e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:28.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.796+0000 7f53a17c4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f539c06afe0 0x7f539c11e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:28.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.796+0000 7f53a17c4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f539c131fc0 0x7f539c11ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:28.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.796+0000 7f53a17c4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539c121b00 con 0x7f539c06a6d0 2023-09-30T22:24:28.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.796+0000 7f53a17c4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f539c0715d0 con 0x7f539c06afe0 2023-09-30T22:24:28.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.796+0000 7f53a17c4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f539c120730 con 0x7f539c131fc0 2023-09-30T22:24:28.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.797+0000 7f539affd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f539c06a6d0 0x7f539c11e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:28.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.797+0000 7f539affd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f539c06a6d0 0x7f539c11e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46438/0 (socket says 172.21.15.40:46438) 2023-09-30T22:24:28.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.797+0000 7f539affd700 1 -- 172.21.15.40:0/1357481481 learned_addr learned my addr 172.21.15.40:0/1357481481 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:28.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.797+0000 7f539a7fc700 1 --2- 172.21.15.40:0/1357481481 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f539c06afe0 0x7f539c11e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:28.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.797+0000 7f539b7fe700 1 --2- 172.21.15.40:0/1357481481 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f539c131fc0 0x7f539c11ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:28.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.797+0000 7f539a7fc700 1 -- 172.21.15.40:0/1357481481 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f539c131fc0 msgr2=0x7f539c11ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.797+0000 7f539a7fc700 1 --2- 172.21.15.40:0/1357481481 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f539c131fc0 0x7f539c11ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.797+0000 7f539a7fc700 1 -- 172.21.15.40:0/1357481481 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f539c06a6d0 msgr2=0x7f539c11e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.797+0000 7f539a7fc700 1 --2- 172.21.15.40:0/1357481481 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f539c06a6d0 0x7f539c11e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.797+0000 7f539a7fc700 1 -- 172.21.15.40:0/1357481481 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539400f050 con 0x7f539c06afe0 2023-09-30T22:24:28.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.797+0000 7f539affd700 1 --2- 172.21.15.40:0/1357481481 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f539c06a6d0 0x7f539c11e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:28.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.797+0000 7f539a7fc700 1 --2- 172.21.15.40:0/1357481481 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f539c06afe0 0x7f539c11e850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f538400c4a0 tx=0x7f538400c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:28.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.797+0000 7f53937fe700 1 -- 172.21.15.40:0/1357481481 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5384004c80 con 0x7f539c06afe0 2023-09-30T22:24:28.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.797+0000 7f53937fe700 1 -- 172.21.15.40:0/1357481481 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5384004de0 con 0x7f539c06afe0 2023-09-30T22:24:28.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.797+0000 7f53a17c4700 1 -- 172.21.15.40:0/1357481481 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f538c009430 con 0x7f539c06afe0 2023-09-30T22:24:28.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.797+0000 7f53937fe700 1 -- 172.21.15.40:0/1357481481 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5384007310 con 0x7f539c06afe0 2023-09-30T22:24:28.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.797+0000 7f53a17c4700 1 -- 172.21.15.40:0/1357481481 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f539c09e420 con 0x7f539c06afe0 2023-09-30T22:24:28.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.798+0000 7f53937fe700 1 -- 172.21.15.40:0/1357481481 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f5384007470 con 0x7f539c06afe0 2023-09-30T22:24:28.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.798+0000 7f53a17c4700 1 -- 172.21.15.40:0/1357481481 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f539c062380 con 0x7f539c06afe0 2023-09-30T22:24:28.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.798+0000 7f53937fe700 1 -- 172.21.15.40:0/1357481481 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4094+0+0 (secure 0 0 0) 0x7f538403f600 con 0x7f539c06afe0 2023-09-30T22:24:28.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.803+0000 7f53937fe700 1 -- 172.21.15.40:0/1357481481 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5384007720 con 0x7f539c06afe0 2023-09-30T22:24:28.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.997+0000 7f53a17c4700 1 -- 172.21.15.40:0/1357481481 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f539c120450 con 0x7f539c06afe0 2023-09-30T22:24:28.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:28.998+0000 7f53937fe700 1 -- 172.21.15.40:0/1357481481 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+12993 (secure 0 0 0) 0x7f5384011360 con 0x7f539c06afe0 2023-09-30T22:24:28.999 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:24:28.999 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"fsid":"79dd4d8e-f295-4d9c-bd93-9850863800e3","created":"2023-09-30T22:21:46.980357+0000","modified":"2023-09-30T22:24:26.129783+0000","last_up_change":"2023-09-30T22:21:54.822866+0000","last_in_change":"2023-09-30T22:21:48.205613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:21:54.875024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:21:56.197012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:22:00.759069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:22:01.327265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"771f785c-f464-4b17-936c-cbf31b1153e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6812","nonce":119451}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6813","nonce":119451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6815","nonce":119451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6814","nonce":119451}]},"public_addr":"172.21.15.40:6812/119451","cluster_addr":"172.21.15.40:6813/119451","heartbeat_back_addr":"172.21.15.40:6815/119451","heartbeat_front_addr":"172.21.15.40:6814/119451","state":["exists","up"]},{"osd":1,"uuid":"45f1e2e8-5310-4219-ab54-424e7440fcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6808","nonce":119436}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6809","nonce":119436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6811","nonce":119436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6810","nonce":119436}]},"public_addr":"172.21.15.40:6808/119436","cluster_addr":"172.21.15.40:6809/119436","heartbeat_back_addr":"172.21.15.40:6811/119436","heartbeat_front_addr":"172.21.15.40:6810/119436","state":["exists","up"]},{"osd":2,"uuid":"7ba62ae5-d21e-4d56-b46c-ba7b718ede25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6800","nonce":119433}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6801","nonce":119433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6803","nonce":119433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6802","nonce":119433}]},"public_addr":"172.21.15.40:6800/119433","cluster_addr":"172.21.15.40:6801/119433","heartbeat_back_addr":"172.21.15.40:6803/119433","heartbeat_front_addr":"172.21.15.40:6802/119433","state":["exists","up"]},{"osd":3,"uuid":"c9c55985-8a90-4927-a8fa-6a1fcec1cd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6804","nonce":119432}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6805","nonce":119432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6807","nonce":119432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6806","nonce":119432}]},"public_addr":"172.21.15.40:6804/119432","cluster_addr":"172.21.15.40:6805/119432","heartbeat_back_addr":"172.21.15.40:6807/119432","heartbeat_front_addr":"172.21.15.40:6806/119432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.339829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.554690+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.641664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.320635+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2},{"from":1,"to":0}]},{"pgid":"4.1","mappings":[{"from":3,"to":0}]},{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.12","mappings":[{"from":3,"to":0}]},{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":3,"to":2},{"from":1,"to":0}]},{"pgid":"4.2c","mappings":[{"from":1,"to":2}]},{"pgid":"4.3f","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:0/1890660785":"2023-10-01T22:24:24.127340+0000","172.21.15.40:0/1764460125":"2023-10-01T22:24:24.127340+0000","172.21.15.40:6816/118905":"2023-10-01T22:24:24.127340+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:24:29.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.000+0000 7f53a17c4700 1 -- 172.21.15.40:0/1357481481 >> v1:172.21.15.40:6816/127432 conn(0x7f537c02f480 legacy=0x7f537c031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.000+0000 7f53a17c4700 1 -- 172.21.15.40:0/1357481481 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f539c06afe0 msgr2=0x7f539c11e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.000+0000 7f53a17c4700 1 --2- 172.21.15.40:0/1357481481 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f539c06afe0 0x7f539c11e850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f538400c4a0 tx=0x7f538400c7b0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.001+0000 7f53a17c4700 1 -- 172.21.15.40:0/1357481481 shutdown_connections 2023-09-30T22:24:29.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.001+0000 7f53a17c4700 1 --2- 172.21.15.40:0/1357481481 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f539c131fc0 0x7f539c11ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.001+0000 7f53a17c4700 1 --2- 172.21.15.40:0/1357481481 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f539c06a6d0 0x7f539c11e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.001+0000 7f53a17c4700 1 --2- 172.21.15.40:0/1357481481 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f539c06afe0 0x7f539c11e850 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.001+0000 7f53a17c4700 1 -- 172.21.15.40:0/1357481481 >> 172.21.15.40:0/1357481481 conn(0x7f539c09fb20 msgr2=0x7f539c06e180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:29.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.001+0000 7f53a17c4700 1 -- 172.21.15.40:0/1357481481 shutdown_connections 2023-09-30T22:24:29.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.001+0000 7f53a17c4700 1 -- 172.21.15.40:0/1357481481 wait complete. 2023-09-30T22:24:29.013 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:21:54.875024+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:21:56.197012+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:22:00.759069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:22:01.327265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.059999942779541, 'score_stable': 1.059999942779541, 'optimal_score': 1, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T22:24:29.014 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:24:29.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.141+0000 7f53c7726700 1 Processor -- start 2023-09-30T22:24:29.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.142+0000 7f53c7726700 1 -- start start 2023-09-30T22:24:29.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.142+0000 7f53c7726700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f53c009d920 0x7f53c009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.142+0000 7f53c7726700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f53c009e230 0x7f53c01308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.142+0000 7f53c7726700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53c009adf0 con 0x7f53c0130de0 2023-09-30T22:24:29.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.142+0000 7f53c7726700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c009edf0 con 0x7f53c009e230 2023-09-30T22:24:29.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.142+0000 7f53c7726700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c009b660 con 0x7f53c009d920 2023-09-30T22:24:29.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.142+0000 7f53c54c2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f53c009d920 0x7f53c009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.142+0000 7f53c4cc1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f53c009e230 0x7f53c01308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.142+0000 7f53c5cc3700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f53c0130de0 0x7f53c0137d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40240/0 (socket says 172.21.15.40:40240) 2023-09-30T22:24:29.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.142+0000 7f53c5cc3700 1 -- 172.21.15.40:0/498123513 learned_addr learned my addr 172.21.15.40:0/498123513 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:24:29.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.142+0000 7f53c54c2700 1 -- 172.21.15.40:0/498123513 >> v2:172.21.15.40:3300/0 conn(0x7f53c009e230 msgr2=0x7f53c01308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:29.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.142+0000 7f53c54c2700 1 --2- 172.21.15.40:0/498123513 >> v2:172.21.15.40:3300/0 conn(0x7f53c009e230 0x7f53c01308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.142+0000 7f53c54c2700 1 -- 172.21.15.40:0/498123513 >> v1:172.21.15.40:6789/0 conn(0x7f53c0130de0 legacy=0x7f53c0137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.142+0000 7f53c54c2700 1 -- 172.21.15.40:0/498123513 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c009a6e0 con 0x7f53c009d920 2023-09-30T22:24:29.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.142+0000 7f53c4cc1700 1 --2- 172.21.15.40:0/498123513 >> v2:172.21.15.40:3300/0 conn(0x7f53c009e230 0x7f53c01308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:29.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.142+0000 7f53b7fff700 1 -- 172.21.15.40:0/498123513 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144621152 0 0) 0x7f53c009adf0 con 0x7f53c0130de0 2023-09-30T22:24:29.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.143+0000 7f53c54c2700 1 --2- 172.21.15.40:0/498123513 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f53c009d920 0x7f53c009dcf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f53b0009820 tx=0x7f53b0009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bf5724e0e734fa7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:29.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.143+0000 7f53b7fff700 1 -- 172.21.15.40:0/498123513 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b0005e30 con 0x7f53c009d920 2023-09-30T22:24:29.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.143+0000 7f53b7fff700 1 -- 172.21.15.40:0/498123513 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b0006030 con 0x7f53c009d920 2023-09-30T22:24:29.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.143+0000 7f53b7fff700 1 -- 172.21.15.40:0/498123513 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b00063c0 con 0x7f53c009d920 2023-09-30T22:24:29.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.143+0000 7f53c7726700 1 -- 172.21.15.40:0/498123513 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f53c009d920 msgr2=0x7f53c009dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.143+0000 7f53c7726700 1 --2- 172.21.15.40:0/498123513 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f53c009d920 0x7f53c009dcf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f53b0009820 tx=0x7f53b0009b30 comp rx=0 tx=0).stop 2023-09-30T22:24:29.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.143+0000 7f53c7726700 1 -- 172.21.15.40:0/498123513 shutdown_connections 2023-09-30T22:24:29.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.143+0000 7f53c7726700 1 --2- 172.21.15.40:0/498123513 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f53c009d920 0x7f53c009dcf0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.143+0000 7f53c7726700 1 --2- 172.21.15.40:0/498123513 >> v2:172.21.15.40:3300/0 conn(0x7f53c009e230 0x7f53c01308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.143+0000 7f53c7726700 1 -- 172.21.15.40:0/498123513 >> 172.21.15.40:0/498123513 conn(0x7f53c009fb20 msgr2=0x7f53c009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:29.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.143+0000 7f53c7726700 1 -- 172.21.15.40:0/498123513 shutdown_connections 2023-09-30T22:24:29.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.143+0000 7f53c7726700 1 -- 172.21.15.40:0/498123513 wait complete. 2023-09-30T22:24:29.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.144+0000 7f53c7726700 1 Processor -- start 2023-09-30T22:24:29.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.144+0000 7f53c7726700 1 -- start start 2023-09-30T22:24:29.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.145+0000 7f53c7726700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53c009d920 0x7f53c011db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.145+0000 7f53c7726700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f53c009e230 0x7f53c011e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.145+0000 7f53c7726700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f53c0130de0 0x7f53c011e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.145+0000 7f53c7726700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c011ef30 con 0x7f53c009d920 2023-09-30T22:24:29.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.145+0000 7f53c7726700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c011f380 con 0x7f53c0130de0 2023-09-30T22:24:29.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.145+0000 7f53c7726700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53c0121400 con 0x7f53c009e230 2023-09-30T22:24:29.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.145+0000 7f53c54c2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53c009d920 0x7f53c011db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.145+0000 7f53c54c2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53c009d920 0x7f53c011db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46460/0 (socket says 172.21.15.40:46460) 2023-09-30T22:24:29.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.145+0000 7f53c5cc3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f53c0130de0 0x7f53c011e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.145+0000 7f53c54c2700 1 -- 172.21.15.40:0/2146742537 learned_addr learned my addr 172.21.15.40:0/2146742537 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:29.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.145+0000 7f53c4cc1700 1 --2- 172.21.15.40:0/2146742537 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f53c009e230 0x7f53c011e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.145+0000 7f53c5cc3700 1 -- 172.21.15.40:0/2146742537 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f53c009e230 msgr2=0x7f53c011e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.145+0000 7f53c5cc3700 1 --2- 172.21.15.40:0/2146742537 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f53c009e230 0x7f53c011e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.145+0000 7f53c5cc3700 1 -- 172.21.15.40:0/2146742537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53c009d920 msgr2=0x7f53c011db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.145+0000 7f53c5cc3700 1 --2- 172.21.15.40:0/2146742537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53c009d920 0x7f53c011db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.145+0000 7f53c5cc3700 1 -- 172.21.15.40:0/2146742537 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53bc0094a0 con 0x7f53c0130de0 2023-09-30T22:24:29.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.145+0000 7f53c54c2700 1 --2- 172.21.15.40:0/2146742537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53c009d920 0x7f53c011db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:29.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.145+0000 7f53c4cc1700 1 --2- 172.21.15.40:0/2146742537 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f53c009e230 0x7f53c011e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:29.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.145+0000 7f53c5cc3700 1 --2- 172.21.15.40:0/2146742537 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f53c0130de0 0x7f53c011e5c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f53b800cc10 tx=0x7f53b800cf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:29.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.146+0000 7f53b5ffb700 1 -- 172.21.15.40:0/2146742537 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b800aa00 con 0x7f53c0130de0 2023-09-30T22:24:29.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.146+0000 7f53b5ffb700 1 -- 172.21.15.40:0/2146742537 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b800ab80 con 0x7f53c0130de0 2023-09-30T22:24:29.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.146+0000 7f53c7726700 1 -- 172.21.15.40:0/2146742537 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53b0009430 con 0x7f53c0130de0 2023-09-30T22:24:29.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.146+0000 7f53b5ffb700 1 -- 172.21.15.40:0/2146742537 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b80070d0 con 0x7f53c0130de0 2023-09-30T22:24:29.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.146+0000 7f53c7726700 1 -- 172.21.15.40:0/2146742537 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c0120d60 con 0x7f53c0130de0 2023-09-30T22:24:29.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.146+0000 7f53b5ffb700 1 -- 172.21.15.40:0/2146742537 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f53b8007230 con 0x7f53c0130de0 2023-09-30T22:24:29.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.147+0000 7f53b5ffb700 1 -- 172.21.15.40:0/2146742537 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4094+0+0 (secure 0 0 0) 0x7f53b803f7d0 con 0x7f53c0130de0 2023-09-30T22:24:29.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.147+0000 7f53c7726700 1 -- 172.21.15.40:0/2146742537 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c00a02f0 con 0x7f53c0130de0 2023-09-30T22:24:29.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.152+0000 7f53b5ffb700 1 -- 172.21.15.40:0/2146742537 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f53b8018020 con 0x7f53c0130de0 2023-09-30T22:24:29.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.154+0000 7f53b5ffb700 1 -- 172.21.15.40:0/2146742537 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f53b801c3b0 con 0x7f53c0130de0 2023-09-30T22:24:29.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.345+0000 7f53c7726700 1 -- 172.21.15.40:0/2146742537 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f53c009fef0 con 0x7f53c0130de0 2023-09-30T22:24:29.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.346+0000 7f53b5ffb700 1 -- 172.21.15.40:0/2146742537 <== mon.1 v2:172.21.15.40:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f53b801a8b0 con 0x7f53c0130de0 2023-09-30T22:24:29.347 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-09-30T22:24:29.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.348+0000 7f53c7726700 1 -- 172.21.15.40:0/2146742537 >> v1:172.21.15.40:6816/127432 conn(0x7f53a402f480 legacy=0x7f53a4031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.348+0000 7f53c7726700 1 -- 172.21.15.40:0/2146742537 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f53c0130de0 msgr2=0x7f53c011e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.348+0000 7f53c7726700 1 --2- 172.21.15.40:0/2146742537 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f53c0130de0 0x7f53c011e5c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f53b800cc10 tx=0x7f53b800cf20 comp rx=0 tx=0).stop 2023-09-30T22:24:29.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.348+0000 7f53c7726700 1 -- 172.21.15.40:0/2146742537 shutdown_connections 2023-09-30T22:24:29.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.348+0000 7f53c7726700 1 --2- 172.21.15.40:0/2146742537 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f53c0130de0 0x7f53c011e5c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.348+0000 7f53c7726700 1 --2- 172.21.15.40:0/2146742537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53c009d920 0x7f53c011db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.348+0000 7f53c7726700 1 --2- 172.21.15.40:0/2146742537 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f53c009e230 0x7f53c011e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.348+0000 7f53c7726700 1 -- 172.21.15.40:0/2146742537 >> 172.21.15.40:0/2146742537 conn(0x7f53c009fb20 msgr2=0x7f53c006df50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:29.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.348+0000 7f53c7726700 1 -- 172.21.15.40:0/2146742537 shutdown_connections 2023-09-30T22:24:29.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.348+0000 7f53c7726700 1 -- 172.21.15.40:0/2146742537 wait complete. 2023-09-30T22:24:29.361 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:24:29.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.489+0000 7f8b16536700 1 Processor -- start 2023-09-30T22:24:29.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.489+0000 7f8b16536700 1 -- start start 2023-09-30T22:24:29.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.489+0000 7f8b16536700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8b1009c890 0x7f8b1009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.489+0000 7f8b16536700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b1009d920 0x7f8b1009dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.489+0000 7f8b16536700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8b1009e2b0 0x7f8b1013ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.489+0000 7f8b16536700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b100a29d0 con 0x7f8b1009e2b0 2023-09-30T22:24:29.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.489+0000 7f8b16536700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1009fb40 con 0x7f8b1009d920 2023-09-30T22:24:29.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.489+0000 7f8b16536700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b100a2600 con 0x7f8b1009c890 2023-09-30T22:24:29.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.490+0000 7f8b0f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b1009d920 0x7f8b1009dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.490+0000 7f8b14ad3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8b1009e2b0 0x7f8b1013ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.490+0000 7f8b0ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8b1009c890 0x7f8b1009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.490+0000 7f8b14ad3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8b1009e2b0 0x7f8b1013ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46462/0 (socket says 172.21.15.40:46462) 2023-09-30T22:24:29.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.490+0000 7f8b0f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b1009d920 0x7f8b1009dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52128/0 (socket says 172.21.15.40:52128) 2023-09-30T22:24:29.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.490+0000 7f8b14ad3700 1 -- 172.21.15.40:0/411732162 learned_addr learned my addr 172.21.15.40:0/411732162 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:29.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.490+0000 7f8b14ad3700 1 -- 172.21.15.40:0/411732162 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8b1009c890 msgr2=0x7f8b1009cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:29.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.490+0000 7f8b14ad3700 1 --2- 172.21.15.40:0/411732162 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8b1009c890 0x7f8b1009cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.490+0000 7f8b14ad3700 1 -- 172.21.15.40:0/411732162 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b1009d920 msgr2=0x7f8b1009dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:29.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.490+0000 7f8b14ad3700 1 --2- 172.21.15.40:0/411732162 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b1009d920 0x7f8b1009dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.490+0000 7f8b14ad3700 1 -- 172.21.15.40:0/411732162 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1009e720 con 0x7f8b1009e2b0 2023-09-30T22:24:29.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.490+0000 7f8b0ffff700 1 --2- 172.21.15.40:0/411732162 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8b1009c890 0x7f8b1009cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:29.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.490+0000 7f8b0f7fe700 1 --2- 172.21.15.40:0/411732162 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b1009d920 0x7f8b1009dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:29.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.490+0000 7f8b14ad3700 1 --2- 172.21.15.40:0/411732162 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b1009e2b0 0x7f8b1013ac10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8b08009e80 tx=0x7f8b0800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1282d7dd4e49132b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:29.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.490+0000 7f8b0effd700 1 -- 172.21.15.40:0/411732162 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0800e070 con 0x7f8b1009e2b0 2023-09-30T22:24:29.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.490+0000 7f8b0effd700 1 -- 172.21.15.40:0/411732162 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0800b8d0 con 0x7f8b1009e2b0 2023-09-30T22:24:29.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.490+0000 7f8b0effd700 1 -- 172.21.15.40:0/411732162 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0800bc80 con 0x7f8b1009e2b0 2023-09-30T22:24:29.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.491+0000 7f8b16536700 1 -- 172.21.15.40:0/411732162 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b1009e2b0 msgr2=0x7f8b1013ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.491+0000 7f8b16536700 1 --2- 172.21.15.40:0/411732162 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b1009e2b0 0x7f8b1013ac10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8b08009e80 tx=0x7f8b0800b330 comp rx=0 tx=0).stop 2023-09-30T22:24:29.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.491+0000 7f8b16536700 1 -- 172.21.15.40:0/411732162 shutdown_connections 2023-09-30T22:24:29.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.491+0000 7f8b16536700 1 --2- 172.21.15.40:0/411732162 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8b1009c890 0x7f8b1009cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.491+0000 7f8b16536700 1 --2- 172.21.15.40:0/411732162 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b1009e2b0 0x7f8b1013ac10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.491+0000 7f8b16536700 1 --2- 172.21.15.40:0/411732162 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b1009d920 0x7f8b1009dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.491+0000 7f8b16536700 1 -- 172.21.15.40:0/411732162 >> 172.21.15.40:0/411732162 conn(0x7f8b100a7080 msgr2=0x7f8b100a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:29.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.491+0000 7f8b16536700 1 -- 172.21.15.40:0/411732162 shutdown_connections 2023-09-30T22:24:29.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.491+0000 7f8b16536700 1 -- 172.21.15.40:0/411732162 wait complete. 2023-09-30T22:24:29.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.492+0000 7f8b16536700 1 Processor -- start 2023-09-30T22:24:29.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.492+0000 7f8b16536700 1 -- start start 2023-09-30T22:24:29.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.492+0000 7f8b16536700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b1009c890 0x7f8b1012d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.492+0000 7f8b16536700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8b1009d920 0x7f8b1012d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.492+0000 7f8b16536700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b1009e2b0 0x7f8b1012ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.492+0000 7f8b16536700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1012faf0 con 0x7f8b1009c890 2023-09-30T22:24:29.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.492+0000 7f8b16536700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1012edd0 con 0x7f8b1009e2b0 2023-09-30T22:24:29.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.492+0000 7f8b16536700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b100a5bf0 con 0x7f8b1009d920 2023-09-30T22:24:29.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.493+0000 7f8b0ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b1009c890 0x7f8b1012d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.493+0000 7f8b0f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8b1009d920 0x7f8b1012d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.493+0000 7f8b14ad3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b1009e2b0 0x7f8b1012ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.493+0000 7f8b0ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b1009c890 0x7f8b1012d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46470/0 (socket says 172.21.15.40:46470) 2023-09-30T22:24:29.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.493+0000 7f8b0ffff700 1 -- 172.21.15.40:0/2942083519 learned_addr learned my addr 172.21.15.40:0/2942083519 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:29.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.493+0000 7f8b14ad3700 1 -- 172.21.15.40:0/2942083519 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8b1009d920 msgr2=0x7f8b1012d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.493+0000 7f8b14ad3700 1 --2- 172.21.15.40:0/2942083519 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8b1009d920 0x7f8b1012d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.493+0000 7f8b14ad3700 1 -- 172.21.15.40:0/2942083519 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b1009c890 msgr2=0x7f8b1012d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.493+0000 7f8b14ad3700 1 --2- 172.21.15.40:0/2942083519 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b1009c890 0x7f8b1012d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.493+0000 7f8b14ad3700 1 -- 172.21.15.40:0/2942083519 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b00009430 con 0x7f8b1009e2b0 2023-09-30T22:24:29.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.493+0000 7f8b0f7fe700 1 --2- 172.21.15.40:0/2942083519 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8b1009d920 0x7f8b1012d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:29.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.493+0000 7f8b0ffff700 1 --2- 172.21.15.40:0/2942083519 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b1009c890 0x7f8b1012d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:29.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.493+0000 7f8b14ad3700 1 --2- 172.21.15.40:0/2942083519 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b1009e2b0 0x7f8b1012ddc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8b08015000 tx=0x7f8b08004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:29.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.493+0000 7f8b0cff9700 1 -- 172.21.15.40:0/2942083519 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b08004240 con 0x7f8b1009e2b0 2023-09-30T22:24:29.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.493+0000 7f8b0cff9700 1 -- 172.21.15.40:0/2942083519 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b080043e0 con 0x7f8b1009e2b0 2023-09-30T22:24:29.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.493+0000 7f8b16536700 1 -- 172.21.15.40:0/2942083519 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b040094a0 con 0x7f8b1009e2b0 2023-09-30T22:24:29.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.493+0000 7f8b0cff9700 1 -- 172.21.15.40:0/2942083519 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b08004790 con 0x7f8b1009e2b0 2023-09-30T22:24:29.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.493+0000 7f8b16536700 1 -- 172.21.15.40:0/2942083519 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b08009b30 con 0x7f8b1009e2b0 2023-09-30T22:24:29.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.494+0000 7f8b0cff9700 1 -- 172.21.15.40:0/2942083519 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8b0801c410 con 0x7f8b1009e2b0 2023-09-30T22:24:29.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.494+0000 7f8b0cff9700 1 -- 172.21.15.40:0/2942083519 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4094+0+0 (secure 0 0 0) 0x7f8b08041a60 con 0x7f8b1009e2b0 2023-09-30T22:24:29.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.494+0000 7f8af67fc700 1 -- 172.21.15.40:0/2942083519 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae80052e0 con 0x7f8b1009e2b0 2023-09-30T22:24:29.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.499+0000 7f8b0cff9700 1 -- 172.21.15.40:0/2942083519 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8b0801c6c0 con 0x7f8b1009e2b0 2023-09-30T22:24:29.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.695+0000 7f8af67fc700 1 -- 172.21.15.40:0/2942083519 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8ae8005b10 con 0x7f8b1009e2b0 2023-09-30T22:24:29.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.695+0000 7f8b0cff9700 1 -- 172.21.15.40:0/2942083519 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8b0800ee90 con 0x7f8b1009e2b0 2023-09-30T22:24:29.696 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-09-30T22:24:29.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.697+0000 7f8af67fc700 1 -- 172.21.15.40:0/2942083519 >> v1:172.21.15.40:6816/127432 conn(0x7f8afc02f510 legacy=0x7f8afc0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.697+0000 7f8af67fc700 1 -- 172.21.15.40:0/2942083519 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b1009e2b0 msgr2=0x7f8b1012ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.697+0000 7f8af67fc700 1 --2- 172.21.15.40:0/2942083519 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b1009e2b0 0x7f8b1012ddc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8b08015000 tx=0x7f8b08004ad0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.698+0000 7f8af67fc700 1 -- 172.21.15.40:0/2942083519 shutdown_connections 2023-09-30T22:24:29.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.698+0000 7f8af67fc700 1 --2- 172.21.15.40:0/2942083519 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b1009e2b0 0x7f8b1012ddc0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.698+0000 7f8af67fc700 1 --2- 172.21.15.40:0/2942083519 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b1009c890 0x7f8b1012d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.698+0000 7f8af67fc700 1 --2- 172.21.15.40:0/2942083519 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8b1009d920 0x7f8b1012d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.698+0000 7f8af67fc700 1 -- 172.21.15.40:0/2942083519 >> 172.21.15.40:0/2942083519 conn(0x7f8b100a7080 msgr2=0x7f8b10133230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:29.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.698+0000 7f8af67fc700 1 -- 172.21.15.40:0/2942083519 shutdown_connections 2023-09-30T22:24:29.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.698+0000 7f8af67fc700 1 -- 172.21.15.40:0/2942083519 wait complete. 2023-09-30T22:24:29.710 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:24:29.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.839+0000 7f466ecc7700 1 Processor -- start 2023-09-30T22:24:29.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.839+0000 7f466ecc7700 1 -- start start 2023-09-30T22:24:29.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.839+0000 7f466ecc7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4668136bf0 0x7f4668138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.839+0000 7f466ecc7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4668139510 0x7f466813b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.839+0000 7f466ecc7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46680a2600 con 0x7f466809c890 2023-09-30T22:24:29.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.839+0000 7f466ecc7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46680a29d0 con 0x7f4668139510 2023-09-30T22:24:29.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.839+0000 7f466ecc7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f466809fb40 con 0x7f4668136bf0 2023-09-30T22:24:29.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.839+0000 7f4667fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4668136bf0 0x7f4668138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.839+0000 7f466d264700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4668139510 0x7f466813b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.839+0000 7f466ca63700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f466809c890 0x7f466809cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40252/0 (socket says 172.21.15.40:40252) 2023-09-30T22:24:29.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.839+0000 7f466ca63700 1 -- 172.21.15.40:0/3611734731 learned_addr learned my addr 172.21.15.40:0/3611734731 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:24:29.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.840+0000 7f466d264700 1 -- 172.21.15.40:0/3611734731 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4668136bf0 msgr2=0x7f4668138fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:29.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.840+0000 7f466d264700 1 --2- 172.21.15.40:0/3611734731 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4668136bf0 0x7f4668138fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.840+0000 7f466d264700 1 -- 172.21.15.40:0/3611734731 >> v1:172.21.15.40:6789/0 conn(0x7f466809c890 legacy=0x7f466809cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.840+0000 7f466d264700 1 -- 172.21.15.40:0/3611734731 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466809d370 con 0x7f4668139510 2023-09-30T22:24:29.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.840+0000 7f46677fe700 1 -- 172.21.15.40:0/3611734731 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2485601217 0 0) 0x7f46680a2600 con 0x7f466809c890 2023-09-30T22:24:29.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.840+0000 7f466d264700 1 --2- 172.21.15.40:0/3611734731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4668139510 0x7f466813b8f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4660009d90 tx=0x7f466000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e544ae286e3cb3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:29.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.840+0000 7f46677fe700 1 -- 172.21.15.40:0/3611734731 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466000e070 con 0x7f4668139510 2023-09-30T22:24:29.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.840+0000 7f46677fe700 1 -- 172.21.15.40:0/3611734731 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466000bb20 con 0x7f4668139510 2023-09-30T22:24:29.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.840+0000 7f46677fe700 1 -- 172.21.15.40:0/3611734731 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4660012430 con 0x7f4668139510 2023-09-30T22:24:29.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.841+0000 7f466ecc7700 1 -- 172.21.15.40:0/3611734731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4668139510 msgr2=0x7f466813b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.841+0000 7f466ecc7700 1 --2- 172.21.15.40:0/3611734731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4668139510 0x7f466813b8f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4660009d90 tx=0x7f466000b330 comp rx=0 tx=0).stop 2023-09-30T22:24:29.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.841+0000 7f466ecc7700 1 -- 172.21.15.40:0/3611734731 shutdown_connections 2023-09-30T22:24:29.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.841+0000 7f466ecc7700 1 --2- 172.21.15.40:0/3611734731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4668139510 0x7f466813b8f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.841+0000 7f466ecc7700 1 --2- 172.21.15.40:0/3611734731 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4668136bf0 0x7f4668138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.841+0000 7f466ecc7700 1 -- 172.21.15.40:0/3611734731 >> 172.21.15.40:0/3611734731 conn(0x7f46680a7080 msgr2=0x7f46680a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:29.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.841+0000 7f466ecc7700 1 -- 172.21.15.40:0/3611734731 shutdown_connections 2023-09-30T22:24:29.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.841+0000 7f466ecc7700 1 -- 172.21.15.40:0/3611734731 wait complete. 2023-09-30T22:24:29.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.842+0000 7f466ecc7700 1 Processor -- start 2023-09-30T22:24:29.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.842+0000 7f466ecc7700 1 -- start start 2023-09-30T22:24:29.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.842+0000 7f466ecc7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f466809c890 0x7f466806ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.842+0000 7f466ecc7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4668136bf0 0x7f466806f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.842+0000 7f466ecc7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4668139510 0x7f466806f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.842+0000 7f466ecc7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466809ecf0 con 0x7f4668136bf0 2023-09-30T22:24:29.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.842+0000 7f466ecc7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f466812bc00 con 0x7f4668139510 2023-09-30T22:24:29.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.842+0000 7f466ecc7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4668071560 con 0x7f466809c890 2023-09-30T22:24:29.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.842+0000 7f466ca63700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f466809c890 0x7f466806ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.842+0000 7f466ca63700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f466809c890 0x7f466806ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33264/0 (socket says 172.21.15.40:33264) 2023-09-30T22:24:29.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.843+0000 7f466ca63700 1 -- 172.21.15.40:0/1655569255 learned_addr learned my addr 172.21.15.40:0/1655569255 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:29.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.843+0000 7f4667fff700 1 --2- 172.21.15.40:0/1655569255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4668136bf0 0x7f466806f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.843+0000 7f466d264700 1 --2- 172.21.15.40:0/1655569255 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4668139510 0x7f466806f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.843+0000 7f4667fff700 1 -- 172.21.15.40:0/1655569255 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f466809c890 msgr2=0x7f466806ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.843+0000 7f4667fff700 1 --2- 172.21.15.40:0/1655569255 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f466809c890 0x7f466806ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.843+0000 7f4667fff700 1 -- 172.21.15.40:0/1655569255 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4668139510 msgr2=0x7f466806f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.843+0000 7f4667fff700 1 --2- 172.21.15.40:0/1655569255 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4668139510 0x7f466806f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.843+0000 7f4667fff700 1 -- 172.21.15.40:0/1655569255 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4660009a70 con 0x7f4668136bf0 2023-09-30T22:24:29.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.843+0000 7f4667fff700 1 --2- 172.21.15.40:0/1655569255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4668136bf0 0x7f466806f2a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f465400e900 tx=0x7f465400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:29.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.843+0000 7f46657fa700 1 -- 172.21.15.40:0/1655569255 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4654013680 con 0x7f4668136bf0 2023-09-30T22:24:29.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.843+0000 7f46657fa700 1 -- 172.21.15.40:0/1655569255 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46540137e0 con 0x7f4668136bf0 2023-09-30T22:24:29.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.843+0000 7f466ecc7700 1 -- 172.21.15.40:0/1655569255 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4668070ea0 con 0x7f4668136bf0 2023-09-30T22:24:29.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.843+0000 7f46657fa700 1 -- 172.21.15.40:0/1655569255 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4654013b50 con 0x7f4668136bf0 2023-09-30T22:24:29.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.843+0000 7f466ecc7700 1 -- 172.21.15.40:0/1655569255 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f466812c5c0 con 0x7f4668136bf0 2023-09-30T22:24:29.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.844+0000 7f46657fa700 1 -- 172.21.15.40:0/1655569255 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4654013cb0 con 0x7f4668136bf0 2023-09-30T22:24:29.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.844+0000 7f466ecc7700 1 -- 172.21.15.40:0/1655569255 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f466812bd90 con 0x7f4668136bf0 2023-09-30T22:24:29.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.844+0000 7f46657fa700 1 -- 172.21.15.40:0/1655569255 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4094+0+0 (secure 0 0 0) 0x7f465403fe70 con 0x7f4668136bf0 2023-09-30T22:24:29.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:29.849+0000 7f46657fa700 1 -- 172.21.15.40:0/1655569255 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f465401c730 con 0x7f4668136bf0 2023-09-30T22:24:30.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.042+0000 7f466ecc7700 1 -- 172.21.15.40:0/1655569255 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4668062380 con 0x7f4668136bf0 2023-09-30T22:24:30.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.042+0000 7f46657fa700 1 -- 172.21.15.40:0/1655569255 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4654017020 con 0x7f4668136bf0 2023-09-30T22:24:30.043 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-09-30T22:24:30.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.044+0000 7f466ecc7700 1 -- 172.21.15.40:0/1655569255 >> v1:172.21.15.40:6816/127432 conn(0x7f464c02f510 legacy=0x7f464c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.044+0000 7f466ecc7700 1 -- 172.21.15.40:0/1655569255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4668136bf0 msgr2=0x7f466806f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.044+0000 7f466ecc7700 1 --2- 172.21.15.40:0/1655569255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4668136bf0 0x7f466806f2a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f465400e900 tx=0x7f465400ec10 comp rx=0 tx=0).stop 2023-09-30T22:24:30.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.044+0000 7f466ecc7700 1 -- 172.21.15.40:0/1655569255 shutdown_connections 2023-09-30T22:24:30.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.044+0000 7f466ecc7700 1 --2- 172.21.15.40:0/1655569255 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f466809c890 0x7f466806ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.044+0000 7f466ecc7700 1 --2- 172.21.15.40:0/1655569255 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4668139510 0x7f466806f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.044+0000 7f466ecc7700 1 --2- 172.21.15.40:0/1655569255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4668136bf0 0x7f466806f2a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.044+0000 7f466ecc7700 1 -- 172.21.15.40:0/1655569255 >> 172.21.15.40:0/1655569255 conn(0x7f46680a7080 msgr2=0x7f46681349d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:30.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.045+0000 7f466ecc7700 1 -- 172.21.15.40:0/1655569255 shutdown_connections 2023-09-30T22:24:30.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.045+0000 7f466ecc7700 1 -- 172.21.15.40:0/1655569255 wait complete. 2023-09-30T22:24:30.057 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:24:30.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.185+0000 7f27fa248700 1 Processor -- start 2023-09-30T22:24:30.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.185+0000 7f27fa248700 1 -- start start 2023-09-30T22:24:30.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.186+0000 7f27fa248700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f27f4130c00 0x7f27f4130fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.186+0000 7f27fa248700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f27f4130570 0x7f27f409a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.186+0000 7f27fa248700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f27f409ab60 0x7f27f409afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.186+0000 7f27fa248700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f409bfb0 con 0x7f27f4130c00 2023-09-30T22:24:30.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.186+0000 7f27fa248700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f409ba60 con 0x7f27f4130570 2023-09-30T22:24:30.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.186+0000 7f27fa248700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27f409df10 con 0x7f27f409ab60 2023-09-30T22:24:30.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.186+0000 7f27f3fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f27f409ab60 0x7f27f409afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.186+0000 7f27f37fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f27f4130c00 0x7f27f4130fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.186+0000 7f27f3fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f27f409ab60 0x7f27f409afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33270/0 (socket says 172.21.15.40:33270) 2023-09-30T22:24:30.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.186+0000 7f27f37fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f27f4130c00 0x7f27f4130fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46504/0 (socket says 172.21.15.40:46504) 2023-09-30T22:24:30.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.186+0000 7f27f3fff700 1 -- 172.21.15.40:0/392022734 learned_addr learned my addr 172.21.15.40:0/392022734 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:30.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.186+0000 7f27f2ffd700 1 --2- 172.21.15.40:0/392022734 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f27f4130570 0x7f27f409a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.186+0000 7f27f3fff700 1 -- 172.21.15.40:0/392022734 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f27f4130570 msgr2=0x7f27f409a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:30.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.186+0000 7f27f3fff700 1 --2- 172.21.15.40:0/392022734 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f27f4130570 0x7f27f409a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.186+0000 7f27f3fff700 1 -- 172.21.15.40:0/392022734 >> v2:172.21.15.40:3300/0 conn(0x7f27f4130c00 msgr2=0x7f27f4130fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:30.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.186+0000 7f27f3fff700 1 --2- 172.21.15.40:0/392022734 >> v2:172.21.15.40:3300/0 conn(0x7f27f4130c00 0x7f27f4130fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.186+0000 7f27f3fff700 1 -- 172.21.15.40:0/392022734 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f4131510 con 0x7f27f409ab60 2023-09-30T22:24:30.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.186+0000 7f27f37fe700 1 --2- 172.21.15.40:0/392022734 >> v2:172.21.15.40:3300/0 conn(0x7f27f4130c00 0x7f27f4130fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:30.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.186+0000 7f27f3fff700 1 --2- 172.21.15.40:0/392022734 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f27f409ab60 0x7f27f409afb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f27ec0098f0 tx=0x7f27ec009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=717e40c1e9a3babd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:30.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.187+0000 7f27f27fc700 1 -- 172.21.15.40:0/392022734 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec011830 con 0x7f27f409ab60 2023-09-30T22:24:30.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.187+0000 7f27f27fc700 1 -- 172.21.15.40:0/392022734 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ec011990 con 0x7f27f409ab60 2023-09-30T22:24:30.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.187+0000 7f27f27fc700 1 -- 172.21.15.40:0/392022734 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec011d20 con 0x7f27f409ab60 2023-09-30T22:24:30.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.187+0000 7f27fa248700 1 -- 172.21.15.40:0/392022734 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f27f409ab60 msgr2=0x7f27f409afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.187+0000 7f27fa248700 1 --2- 172.21.15.40:0/392022734 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f27f409ab60 0x7f27f409afb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f27ec0098f0 tx=0x7f27ec009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:30.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.187+0000 7f27fa248700 1 -- 172.21.15.40:0/392022734 shutdown_connections 2023-09-30T22:24:30.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.187+0000 7f27fa248700 1 --2- 172.21.15.40:0/392022734 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f27f409ab60 0x7f27f409afb0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.187+0000 7f27fa248700 1 --2- 172.21.15.40:0/392022734 >> v2:172.21.15.40:3300/0 conn(0x7f27f4130c00 0x7f27f4130fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.187+0000 7f27fa248700 1 --2- 172.21.15.40:0/392022734 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f27f4130570 0x7f27f409a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.187+0000 7f27fa248700 1 -- 172.21.15.40:0/392022734 >> 172.21.15.40:0/392022734 conn(0x7f27f409eb10 msgr2=0x7f27f409ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:30.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.187+0000 7f27fa248700 1 -- 172.21.15.40:0/392022734 shutdown_connections 2023-09-30T22:24:30.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.187+0000 7f27fa248700 1 -- 172.21.15.40:0/392022734 wait complete. 2023-09-30T22:24:30.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.188+0000 7f27fa248700 1 Processor -- start 2023-09-30T22:24:30.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.188+0000 7f27fa248700 1 -- start start 2023-09-30T22:24:30.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.189+0000 7f27fa248700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f27f409ab60 0x7f27f412cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.189+0000 7f27fa248700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f27f4130570 0x7f27f412d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.189+0000 7f27fa248700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27f4130c00 0x7f27f412d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.189+0000 7f27fa248700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f408d140 con 0x7f27f4130c00 2023-09-30T22:24:30.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.189+0000 7f27fa248700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f408c1a0 con 0x7f27f4130570 2023-09-30T22:24:30.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.189+0000 7f27fa248700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27f408c540 con 0x7f27f409ab60 2023-09-30T22:24:30.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.189+0000 7f27f2ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f27f4130570 0x7f27f412d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.189+0000 7f27f2ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f27f4130570 0x7f27f412d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52162/0 (socket says 172.21.15.40:52162) 2023-09-30T22:24:30.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.189+0000 7f27f2ffd700 1 -- 172.21.15.40:0/878274900 learned_addr learned my addr 172.21.15.40:0/878274900 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:30.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.189+0000 7f27f3fff700 1 --2- 172.21.15.40:0/878274900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27f4130c00 0x7f27f412d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.189+0000 7f27f37fe700 1 --2- 172.21.15.40:0/878274900 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f27f409ab60 0x7f27f412cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.189+0000 7f27f2ffd700 1 -- 172.21.15.40:0/878274900 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f27f409ab60 msgr2=0x7f27f412cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.189+0000 7f27f2ffd700 1 --2- 172.21.15.40:0/878274900 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f27f409ab60 0x7f27f412cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.189+0000 7f27f2ffd700 1 -- 172.21.15.40:0/878274900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27f4130c00 msgr2=0x7f27f412d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.189+0000 7f27f2ffd700 1 --2- 172.21.15.40:0/878274900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27f4130c00 0x7f27f412d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.189+0000 7f27f2ffd700 1 -- 172.21.15.40:0/878274900 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e4009a70 con 0x7f27f4130570 2023-09-30T22:24:30.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.189+0000 7f27f2ffd700 1 --2- 172.21.15.40:0/878274900 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f27f4130570 0x7f27f412d4a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f27e800e9b0 tx=0x7f27e800ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:30.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.189+0000 7f27dbfff700 1 -- 172.21.15.40:0/878274900 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e8009710 con 0x7f27f4130570 2023-09-30T22:24:30.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.190+0000 7f27dbfff700 1 -- 172.21.15.40:0/878274900 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e800c850 con 0x7f27f4130570 2023-09-30T22:24:30.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.190+0000 7f27dbfff700 1 -- 172.21.15.40:0/878274900 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e800cbc0 con 0x7f27f4130570 2023-09-30T22:24:30.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.190+0000 7f27fa248700 1 -- 172.21.15.40:0/878274900 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27ec009550 con 0x7f27f4130570 2023-09-30T22:24:30.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.190+0000 7f27fa248700 1 -- 172.21.15.40:0/878274900 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f409d610 con 0x7f27f4130570 2023-09-30T22:24:30.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.191+0000 7f27dbfff700 1 -- 172.21.15.40:0/878274900 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f27e800cd20 con 0x7f27f4130570 2023-09-30T22:24:30.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.191+0000 7f27dbfff700 1 -- 172.21.15.40:0/878274900 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4094+0+0 (secure 0 0 0) 0x7f27e803fc40 con 0x7f27f4130570 2023-09-30T22:24:30.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.191+0000 7f27fa248700 1 -- 172.21.15.40:0/878274900 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f4062380 con 0x7f27f4130570 2023-09-30T22:24:30.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.196+0000 7f27dbfff700 1 -- 172.21.15.40:0/878274900 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f27e8017080 con 0x7f27f4130570 2023-09-30T22:24:30.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.387+0000 7f27fa248700 1 -- 172.21.15.40:0/878274900 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f27f4072160 con 0x7f27f4130570 2023-09-30T22:24:30.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.387+0000 7f27dbfff700 1 -- 172.21.15.40:0/878274900 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f27f4072160 con 0x7f27f4130570 2023-09-30T22:24:30.388 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-09-30T22:24:30.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.390+0000 7f27fa248700 1 -- 172.21.15.40:0/878274900 >> v1:172.21.15.40:6816/127432 conn(0x7f27e002f510 legacy=0x7f27e00319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.390+0000 7f27fa248700 1 -- 172.21.15.40:0/878274900 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f27f4130570 msgr2=0x7f27f412d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.390+0000 7f27fa248700 1 --2- 172.21.15.40:0/878274900 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f27f4130570 0x7f27f412d4a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f27e800e9b0 tx=0x7f27e800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.390+0000 7f27fa248700 1 -- 172.21.15.40:0/878274900 shutdown_connections 2023-09-30T22:24:30.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.390+0000 7f27fa248700 1 --2- 172.21.15.40:0/878274900 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f27f409ab60 0x7f27f412cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.390+0000 7f27fa248700 1 --2- 172.21.15.40:0/878274900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27f4130c00 0x7f27f412d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.390+0000 7f27fa248700 1 --2- 172.21.15.40:0/878274900 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f27f4130570 0x7f27f412d4a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.390+0000 7f27fa248700 1 -- 172.21.15.40:0/878274900 >> 172.21.15.40:0/878274900 conn(0x7f27f409eb10 msgr2=0x7f27f412f300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:30.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.390+0000 7f27fa248700 1 -- 172.21.15.40:0/878274900 shutdown_connections 2023-09-30T22:24:30.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.390+0000 7f27fa248700 1 -- 172.21.15.40:0/878274900 wait complete. 2023-09-30T22:24:30.403 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:24:30.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.530+0000 7fef0f372700 1 Processor -- start 2023-09-30T22:24:30.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.530+0000 7fef0f372700 1 -- start start 2023-09-30T22:24:30.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.530+0000 7fef0f372700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef08136bf0 0x7fef08138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.530+0000 7fef0f372700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef08139510 0x7fef0813b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.530+0000 7fef0f372700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef080a2600 con 0x7fef0809c890 2023-09-30T22:24:30.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.530+0000 7fef0f372700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef080a29d0 con 0x7fef08136bf0 2023-09-30T22:24:30.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.530+0000 7fef0f372700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef0809fb40 con 0x7fef08139510 2023-09-30T22:24:30.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.530+0000 7fef0d90f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef08139510 0x7fef0813b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.530+0000 7fef0c90d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef08136bf0 0x7fef08138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.530+0000 7fef0d90f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef08139510 0x7fef0813b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33302/0 (socket says 172.21.15.40:33302) 2023-09-30T22:24:30.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.530+0000 7fef0d90f700 1 -- 172.21.15.40:0/390835470 learned_addr learned my addr 172.21.15.40:0/390835470 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:30.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.531+0000 7fef07fff700 1 -- 172.21.15.40:0/390835470 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3489369834 0 0) 0x7fef080a2600 con 0x7fef0809c890 2023-09-30T22:24:30.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.531+0000 7fef0d90f700 1 -- 172.21.15.40:0/390835470 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef08136bf0 msgr2=0x7fef08138fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:30.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.531+0000 7fef0d90f700 1 --2- 172.21.15.40:0/390835470 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef08136bf0 0x7fef08138fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.531+0000 7fef0d90f700 1 -- 172.21.15.40:0/390835470 >> v1:172.21.15.40:6789/0 conn(0x7fef0809c890 legacy=0x7fef0809cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.531+0000 7fef0d90f700 1 -- 172.21.15.40:0/390835470 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef0809d370 con 0x7fef08139510 2023-09-30T22:24:30.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.531+0000 7fef0c90d700 1 --2- 172.21.15.40:0/390835470 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef08136bf0 0x7fef08138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:30.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.531+0000 7fef0d90f700 1 --2- 172.21.15.40:0/390835470 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef08139510 0x7fef0813b8f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fef00009e80 tx=0x7fef0000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3b1abbb1c3fbeb0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:30.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.531+0000 7fef07fff700 1 -- 172.21.15.40:0/390835470 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0000e070 con 0x7fef08139510 2023-09-30T22:24:30.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.531+0000 7fef07fff700 1 -- 172.21.15.40:0/390835470 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef0000b8b0 con 0x7fef08139510 2023-09-30T22:24:30.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.531+0000 7fef07fff700 1 -- 172.21.15.40:0/390835470 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0000bc60 con 0x7fef08139510 2023-09-30T22:24:30.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.531+0000 7fef0f372700 1 -- 172.21.15.40:0/390835470 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef08139510 msgr2=0x7fef0813b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.531+0000 7fef0f372700 1 --2- 172.21.15.40:0/390835470 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef08139510 0x7fef0813b8f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fef00009e80 tx=0x7fef0000b330 comp rx=0 tx=0).stop 2023-09-30T22:24:30.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.532+0000 7fef0f372700 1 -- 172.21.15.40:0/390835470 shutdown_connections 2023-09-30T22:24:30.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.532+0000 7fef0f372700 1 --2- 172.21.15.40:0/390835470 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef08139510 0x7fef0813b8f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.532+0000 7fef0f372700 1 --2- 172.21.15.40:0/390835470 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef08136bf0 0x7fef08138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.532+0000 7fef0f372700 1 -- 172.21.15.40:0/390835470 >> 172.21.15.40:0/390835470 conn(0x7fef080a7080 msgr2=0x7fef080a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:30.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.532+0000 7fef0f372700 1 -- 172.21.15.40:0/390835470 shutdown_connections 2023-09-30T22:24:30.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.532+0000 7fef0f372700 1 -- 172.21.15.40:0/390835470 wait complete. 2023-09-30T22:24:30.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.532+0000 7fef0f372700 1 Processor -- start 2023-09-30T22:24:30.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.533+0000 7fef0f372700 1 -- start start 2023-09-30T22:24:30.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.533+0000 7fef0f372700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef0809c890 0x7fef0806ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.533+0000 7fef0f372700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef08136bf0 0x7fef0806f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.533+0000 7fef0f372700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef08139510 0x7fef0806f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.533+0000 7fef0f372700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0812be70 con 0x7fef0809c890 2023-09-30T22:24:30.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.533+0000 7fef0f372700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef08071b70 con 0x7fef08136bf0 2023-09-30T22:24:30.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.533+0000 7fef0f372700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef080708d0 con 0x7fef08139510 2023-09-30T22:24:30.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.533+0000 7fef0c90d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef08136bf0 0x7fef0806f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.533+0000 7fef0d90f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef08139510 0x7fef0806f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.533+0000 7fef0d10e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef0809c890 0x7fef0806ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.533+0000 7fef0c90d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef08136bf0 0x7fef0806f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52184/0 (socket says 172.21.15.40:52184) 2023-09-30T22:24:30.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.533+0000 7fef0c90d700 1 -- 172.21.15.40:0/3652795195 learned_addr learned my addr 172.21.15.40:0/3652795195 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:30.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.533+0000 7fef0d90f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef08139510 0x7fef0806f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33316/0 (socket says 172.21.15.40:33316) 2023-09-30T22:24:30.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.533+0000 7fef0c90d700 1 -- 172.21.15.40:0/3652795195 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef08139510 msgr2=0x7fef0806f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.533+0000 7fef0c90d700 1 --2- 172.21.15.40:0/3652795195 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef08139510 0x7fef0806f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.533+0000 7fef0c90d700 1 -- 172.21.15.40:0/3652795195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef0809c890 msgr2=0x7fef0806ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.533+0000 7fef0c90d700 1 --2- 172.21.15.40:0/3652795195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef0809c890 0x7fef0806ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.533+0000 7fef0c90d700 1 -- 172.21.15.40:0/3652795195 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feefc0094a0 con 0x7fef08136bf0 2023-09-30T22:24:30.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.533+0000 7fef0d90f700 1 --2- 172.21.15.40:0/3652795195 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef08139510 0x7fef0806f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:30.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.534+0000 7fef0c90d700 1 --2- 172.21.15.40:0/3652795195 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef08136bf0 0x7fef0806f490 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7feefc00ebe0 tx=0x7feefc00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:30.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.534+0000 7fef05ffb700 1 -- 172.21.15.40:0/3652795195 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc00c850 con 0x7fef08136bf0 2023-09-30T22:24:30.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.534+0000 7fef05ffb700 1 -- 172.21.15.40:0/3652795195 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feefc00c9b0 con 0x7fef08136bf0 2023-09-30T22:24:30.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.534+0000 7fef0f372700 1 -- 172.21.15.40:0/3652795195 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef00009b30 con 0x7fef08136bf0 2023-09-30T22:24:30.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.534+0000 7fef05ffb700 1 -- 172.21.15.40:0/3652795195 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc00cd40 con 0x7fef08136bf0 2023-09-30T22:24:30.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.534+0000 7fef0f372700 1 -- 172.21.15.40:0/3652795195 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef0812b4e0 con 0x7fef08136bf0 2023-09-30T22:24:30.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.535+0000 7fef05ffb700 1 -- 172.21.15.40:0/3652795195 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7feefc013470 con 0x7fef08136bf0 2023-09-30T22:24:30.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.535+0000 7fef05ffb700 1 -- 172.21.15.40:0/3652795195 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4094+0+0 (secure 0 0 0) 0x7feefc040040 con 0x7fef08136bf0 2023-09-30T22:24:30.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.535+0000 7fef0f372700 1 -- 172.21.15.40:0/3652795195 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef08062380 con 0x7fef08136bf0 2023-09-30T22:24:30.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.539+0000 7fef05ffb700 1 -- 172.21.15.40:0/3652795195 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feefc021080 con 0x7fef08136bf0 2023-09-30T22:24:30.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.772+0000 7fef0f372700 1 -- 172.21.15.40:0/3652795195 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef0809ecf0 con 0x7fef08136bf0 2023-09-30T22:24:30.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.772+0000 7fef05ffb700 1 -- 172.21.15.40:0/3652795195 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2315 (secure 0 0 0) 0x7feefc017020 con 0x7fef08136bf0 2023-09-30T22:24:30.773 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:24:30.773 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:22:02.347538+0000","modified":"2023-09-30T22:22:28.878876+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4194},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4194":{"gid":4194,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6817/2392027806","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6817","nonce":2392027806}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-30T22:24:30.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.774+0000 7fef0f372700 1 -- 172.21.15.40:0/3652795195 >> v1:172.21.15.40:6816/127432 conn(0x7feef402f510 legacy=0x7feef40319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.774+0000 7fef0f372700 1 -- 172.21.15.40:0/3652795195 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef08136bf0 msgr2=0x7fef0806f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.774+0000 7fef0f372700 1 --2- 172.21.15.40:0/3652795195 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef08136bf0 0x7fef0806f490 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7feefc00ebe0 tx=0x7feefc00eef0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.774+0000 7fef0f372700 1 -- 172.21.15.40:0/3652795195 shutdown_connections 2023-09-30T22:24:30.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.774+0000 7fef0f372700 1 --2- 172.21.15.40:0/3652795195 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef08139510 0x7fef0806f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.774+0000 7fef0f372700 1 --2- 172.21.15.40:0/3652795195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef0809c890 0x7fef0806ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.774+0000 7fef0f372700 1 --2- 172.21.15.40:0/3652795195 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef08136bf0 0x7fef0806f490 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.774+0000 7fef0f372700 1 -- 172.21.15.40:0/3652795195 >> 172.21.15.40:0/3652795195 conn(0x7fef080a7080 msgr2=0x7fef081349d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:30.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.774+0000 7fef0f372700 1 -- 172.21.15.40:0/3652795195 shutdown_connections 2023-09-30T22:24:30.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.774+0000 7fef0f372700 1 -- 172.21.15.40:0/3652795195 wait complete. 2023-09-30T22:24:30.778 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2023-09-30T22:24:30.787 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:24:30.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.912+0000 7f1d77f92700 1 Processor -- start 2023-09-30T22:24:30.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.912+0000 7f1d77f92700 1 -- start start 2023-09-30T22:24:30.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.913+0000 7f1d77f92700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d70136bf0 0x7f1d70138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.913+0000 7f1d77f92700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1d70139510 0x7f1d7013b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.913+0000 7f1d77f92700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d700a2600 con 0x7f1d7009c890 2023-09-30T22:24:30.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.913+0000 7f1d77f92700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d700a29d0 con 0x7f1d70139510 2023-09-30T22:24:30.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.913+0000 7f1d77f92700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7009fb40 con 0x7f1d70136bf0 2023-09-30T22:24:30.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.913+0000 7f1d7552d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d70136bf0 0x7f1d70138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.913+0000 7f1d7652f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1d70139510 0x7f1d7013b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.913+0000 7f1d75d2e700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1d7009c890 0x7f1d7009cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40270/0 (socket says 172.21.15.40:40270) 2023-09-30T22:24:30.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.913+0000 7f1d7652f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1d70139510 0x7f1d7013b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46516/0 (socket says 172.21.15.40:46516) 2023-09-30T22:24:30.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.913+0000 7f1d75d2e700 1 -- 172.21.15.40:0/1710967282 learned_addr learned my addr 172.21.15.40:0/1710967282 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:24:30.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.913+0000 7f1d7552d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d70136bf0 0x7f1d70138fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52188/0 (socket says 172.21.15.40:52188) 2023-09-30T22:24:30.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.913+0000 7f1d7552d700 1 -- 172.21.15.40:0/1710967282 >> v2:172.21.15.40:3300/0 conn(0x7f1d70139510 msgr2=0x7f1d7013b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:30.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.913+0000 7f1d7552d700 1 --2- 172.21.15.40:0/1710967282 >> v2:172.21.15.40:3300/0 conn(0x7f1d70139510 0x7f1d7013b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.913+0000 7f1d7552d700 1 -- 172.21.15.40:0/1710967282 >> v1:172.21.15.40:6789/0 conn(0x7f1d7009c890 legacy=0x7f1d7009cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.913+0000 7f1d74d2c700 1 -- 172.21.15.40:0/1710967282 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2471759826 0 0) 0x7f1d700a2600 con 0x7f1d7009c890 2023-09-30T22:24:30.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.913+0000 7f1d7552d700 1 -- 172.21.15.40:0/1710967282 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7009d370 con 0x7f1d70136bf0 2023-09-30T22:24:30.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.913+0000 7f1d7552d700 1 --2- 172.21.15.40:0/1710967282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d70136bf0 0x7f1d70138fd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c009840 tx=0x7f1d6c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f721c5d1380132b1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:30.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.913+0000 7f1d74d2c700 1 -- 172.21.15.40:0/1710967282 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c011830 con 0x7f1d70136bf0 2023-09-30T22:24:30.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.913+0000 7f1d74d2c700 1 -- 172.21.15.40:0/1710967282 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6c011990 con 0x7f1d70136bf0 2023-09-30T22:24:30.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.913+0000 7f1d74d2c700 1 -- 172.21.15.40:0/1710967282 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c011d20 con 0x7f1d70136bf0 2023-09-30T22:24:30.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.914+0000 7f1d77f92700 1 -- 172.21.15.40:0/1710967282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d70136bf0 msgr2=0x7f1d70138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.914+0000 7f1d77f92700 1 --2- 172.21.15.40:0/1710967282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d70136bf0 0x7f1d70138fd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c009840 tx=0x7f1d6c009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:30.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.914+0000 7f1d77f92700 1 -- 172.21.15.40:0/1710967282 shutdown_connections 2023-09-30T22:24:30.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.914+0000 7f1d77f92700 1 --2- 172.21.15.40:0/1710967282 >> v2:172.21.15.40:3300/0 conn(0x7f1d70139510 0x7f1d7013b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.914+0000 7f1d77f92700 1 --2- 172.21.15.40:0/1710967282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d70136bf0 0x7f1d70138fd0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.914+0000 7f1d77f92700 1 -- 172.21.15.40:0/1710967282 >> 172.21.15.40:0/1710967282 conn(0x7f1d700a7080 msgr2=0x7f1d700a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:30.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.914+0000 7f1d77f92700 1 -- 172.21.15.40:0/1710967282 shutdown_connections 2023-09-30T22:24:30.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.914+0000 7f1d77f92700 1 -- 172.21.15.40:0/1710967282 wait complete. 2023-09-30T22:24:30.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.915+0000 7f1d77f92700 1 Processor -- start 2023-09-30T22:24:30.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.915+0000 7f1d77f92700 1 -- start start 2023-09-30T22:24:30.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.915+0000 7f1d77f92700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d7009c890 0x7f1d7006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.915+0000 7f1d77f92700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d70136bf0 0x7f1d7006f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.915+0000 7f1d77f92700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d70139510 0x7f1d7006f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.915+0000 7f1d77f92700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7012beb0 con 0x7f1d7009c890 2023-09-30T22:24:30.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.915+0000 7f1d77f92700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d70070210 con 0x7f1d70139510 2023-09-30T22:24:30.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.916+0000 7f1d77f92700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d70070f20 con 0x7f1d70136bf0 2023-09-30T22:24:30.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.916+0000 7f1d75d2e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d7009c890 0x7f1d7006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.916+0000 7f1d7652f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d70139510 0x7f1d7006f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.916+0000 7f1d75d2e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d7009c890 0x7f1d7006edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46532/0 (socket says 172.21.15.40:46532) 2023-09-30T22:24:30.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.916+0000 7f1d75d2e700 1 -- 172.21.15.40:0/3345567116 learned_addr learned my addr 172.21.15.40:0/3345567116 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:30.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.916+0000 7f1d7552d700 1 --2- 172.21.15.40:0/3345567116 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d70136bf0 0x7f1d7006f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.916+0000 7f1d7652f700 1 -- 172.21.15.40:0/3345567116 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d70136bf0 msgr2=0x7f1d7006f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.916+0000 7f1d7652f700 1 --2- 172.21.15.40:0/3345567116 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d70136bf0 0x7f1d7006f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.916+0000 7f1d7652f700 1 -- 172.21.15.40:0/3345567116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d7009c890 msgr2=0x7f1d7006edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.916+0000 7f1d7652f700 1 --2- 172.21.15.40:0/3345567116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d7009c890 0x7f1d7006edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.916+0000 7f1d7652f700 1 -- 172.21.15.40:0/3345567116 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d6c0094a0 con 0x7f1d70139510 2023-09-30T22:24:30.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.916+0000 7f1d75d2e700 1 --2- 172.21.15.40:0/3345567116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d7009c890 0x7f1d7006edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:30.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.916+0000 7f1d7652f700 1 --2- 172.21.15.40:0/3345567116 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d70139510 0x7f1d7006f830 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1d700a0df0 tx=0x7f1d6800ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:30.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.916+0000 7f1d667fc700 1 -- 172.21.15.40:0/3345567116 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6800cc20 con 0x7f1d70139510 2023-09-30T22:24:30.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.916+0000 7f1d667fc700 1 -- 172.21.15.40:0/3345567116 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6800f040 con 0x7f1d70139510 2023-09-30T22:24:30.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.916+0000 7f1d77f92700 1 -- 172.21.15.40:0/3345567116 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d70139100 con 0x7f1d70139510 2023-09-30T22:24:30.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.916+0000 7f1d667fc700 1 -- 172.21.15.40:0/3345567116 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d68009e60 con 0x7f1d70139510 2023-09-30T22:24:30.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.916+0000 7f1d77f92700 1 -- 172.21.15.40:0/3345567116 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d700715e0 con 0x7f1d70139510 2023-09-30T22:24:30.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.917+0000 7f1d667fc700 1 -- 172.21.15.40:0/3345567116 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1d68014480 con 0x7f1d70139510 2023-09-30T22:24:30.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.917+0000 7f1d667fc700 1 -- 172.21.15.40:0/3345567116 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4094+0+0 (secure 0 0 0) 0x7f1d680407a0 con 0x7f1d70139510 2023-09-30T22:24:30.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.917+0000 7f1d77f92700 1 -- 172.21.15.40:0/3345567116 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d7012bd10 con 0x7f1d70139510 2023-09-30T22:24:30.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:30.922+0000 7f1d667fc700 1 -- 172.21.15.40:0/3345567116 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1d7012bd10 con 0x7f1d70139510 2023-09-30T22:24:31.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.118+0000 7f1d77f92700 1 -- 172.21.15.40:0/3345567116 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d7012bd10 con 0x7f1d70139510 2023-09-30T22:24:31.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.119+0000 7f1d667fc700 1 -- 172.21.15.40:0/3345567116 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+12993 (secure 0 0 0) 0x7f1d7012bd10 con 0x7f1d70139510 2023-09-30T22:24:31.120 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:24:31.120 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"fsid":"79dd4d8e-f295-4d9c-bd93-9850863800e3","created":"2023-09-30T22:21:46.980357+0000","modified":"2023-09-30T22:24:26.129783+0000","last_up_change":"2023-09-30T22:21:54.822866+0000","last_in_change":"2023-09-30T22:21:48.205613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:21:54.875024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:21:56.197012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:22:00.759069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:22:01.327265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"771f785c-f464-4b17-936c-cbf31b1153e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6812","nonce":119451}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6813","nonce":119451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6815","nonce":119451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6814","nonce":119451}]},"public_addr":"172.21.15.40:6812/119451","cluster_addr":"172.21.15.40:6813/119451","heartbeat_back_addr":"172.21.15.40:6815/119451","heartbeat_front_addr":"172.21.15.40:6814/119451","state":["exists","up"]},{"osd":1,"uuid":"45f1e2e8-5310-4219-ab54-424e7440fcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6808","nonce":119436}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6809","nonce":119436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6811","nonce":119436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6810","nonce":119436}]},"public_addr":"172.21.15.40:6808/119436","cluster_addr":"172.21.15.40:6809/119436","heartbeat_back_addr":"172.21.15.40:6811/119436","heartbeat_front_addr":"172.21.15.40:6810/119436","state":["exists","up"]},{"osd":2,"uuid":"7ba62ae5-d21e-4d56-b46c-ba7b718ede25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6800","nonce":119433}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6801","nonce":119433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6803","nonce":119433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6802","nonce":119433}]},"public_addr":"172.21.15.40:6800/119433","cluster_addr":"172.21.15.40:6801/119433","heartbeat_back_addr":"172.21.15.40:6803/119433","heartbeat_front_addr":"172.21.15.40:6802/119433","state":["exists","up"]},{"osd":3,"uuid":"c9c55985-8a90-4927-a8fa-6a1fcec1cd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6804","nonce":119432}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6805","nonce":119432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6807","nonce":119432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6806","nonce":119432}]},"public_addr":"172.21.15.40:6804/119432","cluster_addr":"172.21.15.40:6805/119432","heartbeat_back_addr":"172.21.15.40:6807/119432","heartbeat_front_addr":"172.21.15.40:6806/119432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.339829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.554690+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.641664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.320635+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2},{"from":1,"to":0}]},{"pgid":"4.1","mappings":[{"from":3,"to":0}]},{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.12","mappings":[{"from":3,"to":0}]},{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":3,"to":2},{"from":1,"to":0}]},{"pgid":"4.2c","mappings":[{"from":1,"to":2}]},{"pgid":"4.3f","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:0/1890660785":"2023-10-01T22:24:24.127340+0000","172.21.15.40:0/1764460125":"2023-10-01T22:24:24.127340+0000","172.21.15.40:6816/118905":"2023-10-01T22:24:24.127340+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:24:31.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.121+0000 7f1d77f92700 1 -- 172.21.15.40:0/3345567116 >> v1:172.21.15.40:6816/127432 conn(0x7f1d5402f510 legacy=0x7f1d540319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.121+0000 7f1d77f92700 1 -- 172.21.15.40:0/3345567116 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d70139510 msgr2=0x7f1d7006f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.121+0000 7f1d77f92700 1 --2- 172.21.15.40:0/3345567116 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d70139510 0x7f1d7006f830 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1d700a0df0 tx=0x7f1d6800ef90 comp rx=0 tx=0).stop 2023-09-30T22:24:31.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.121+0000 7f1d77f92700 1 -- 172.21.15.40:0/3345567116 shutdown_connections 2023-09-30T22:24:31.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.121+0000 7f1d77f92700 1 --2- 172.21.15.40:0/3345567116 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d70139510 0x7f1d7006f830 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.121+0000 7f1d77f92700 1 --2- 172.21.15.40:0/3345567116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d7009c890 0x7f1d7006edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.121+0000 7f1d77f92700 1 --2- 172.21.15.40:0/3345567116 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d70136bf0 0x7f1d7006f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.121+0000 7f1d77f92700 1 -- 172.21.15.40:0/3345567116 >> 172.21.15.40:0/3345567116 conn(0x7f1d700a7080 msgr2=0x7f1d701349d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:31.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.121+0000 7f1d77f92700 1 -- 172.21.15.40:0/3345567116 shutdown_connections 2023-09-30T22:24:31.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.121+0000 7f1d77f92700 1 -- 172.21.15.40:0/3345567116 wait complete. 2023-09-30T22:24:31.134 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:21:54.875024+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:21:56.197012+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:22:00.759069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:22:01.327265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.059999942779541, 'score_stable': 1.059999942779541, 'optimal_score': 1, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T22:24:31.134 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:24:31.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.262+0000 7f7a41d51700 1 Processor -- start 2023-09-30T22:24:31.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.262+0000 7f7a41d51700 1 -- start start 2023-09-30T22:24:31.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.263+0000 7f7a41d51700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a3c09c890 0x7f7a3c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.263+0000 7f7a41d51700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7a3c09d920 0x7f7a3c09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.263+0000 7f7a41d51700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a3c09e2b0 0x7f7a3c13ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.263+0000 7f7a41d51700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a3c0a29d0 con 0x7f7a3c09d920 2023-09-30T22:24:31.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.263+0000 7f7a41d51700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3c09fb40 con 0x7f7a3c09c890 2023-09-30T22:24:31.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.263+0000 7f7a41d51700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3c0a2600 con 0x7f7a3c09e2b0 2023-09-30T22:24:31.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.263+0000 7f7a3affd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7a3c09d920 0x7f7a3c09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.263+0000 7f7a3bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a3c09e2b0 0x7f7a3c13ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.263+0000 7f7a3b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a3c09c890 0x7f7a3c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.263+0000 7f7a3affd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7a3c09d920 0x7f7a3c09dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46542/0 (socket says 172.21.15.40:46542) 2023-09-30T22:24:31.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.263+0000 7f7a3bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a3c09e2b0 0x7f7a3c13ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33326/0 (socket says 172.21.15.40:33326) 2023-09-30T22:24:31.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.263+0000 7f7a3affd700 1 -- 172.21.15.40:0/1655027096 learned_addr learned my addr 172.21.15.40:0/1655027096 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:31.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.263+0000 7f7a3b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a3c09c890 0x7f7a3c09cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52204/0 (socket says 172.21.15.40:52204) 2023-09-30T22:24:31.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.263+0000 7f7a3b7fe700 1 -- 172.21.15.40:0/1655027096 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a3c09e2b0 msgr2=0x7f7a3c13ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:31.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.263+0000 7f7a3b7fe700 1 --2- 172.21.15.40:0/1655027096 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a3c09e2b0 0x7f7a3c13ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.263+0000 7f7a3b7fe700 1 -- 172.21.15.40:0/1655027096 >> v2:172.21.15.40:3300/0 conn(0x7f7a3c09d920 msgr2=0x7f7a3c09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:31.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.263+0000 7f7a3b7fe700 1 --2- 172.21.15.40:0/1655027096 >> v2:172.21.15.40:3300/0 conn(0x7f7a3c09d920 0x7f7a3c09dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.263+0000 7f7a3b7fe700 1 -- 172.21.15.40:0/1655027096 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a3c09e750 con 0x7f7a3c09c890 2023-09-30T22:24:31.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.263+0000 7f7a3affd700 1 --2- 172.21.15.40:0/1655027096 >> v2:172.21.15.40:3300/0 conn(0x7f7a3c09d920 0x7f7a3c09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:31.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.263+0000 7f7a3bfff700 1 --2- 172.21.15.40:0/1655027096 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a3c09e2b0 0x7f7a3c13ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:31.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.263+0000 7f7a3b7fe700 1 --2- 172.21.15.40:0/1655027096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a3c09c890 0x7f7a3c09cc60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7a24009820 tx=0x7f7a24009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e66f3ffa89e96c6a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:31.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.264+0000 7f7a3a7fc700 1 -- 172.21.15.40:0/1655027096 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24005e30 con 0x7f7a3c09c890 2023-09-30T22:24:31.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.264+0000 7f7a3a7fc700 1 -- 172.21.15.40:0/1655027096 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a24006030 con 0x7f7a3c09c890 2023-09-30T22:24:31.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.264+0000 7f7a3a7fc700 1 -- 172.21.15.40:0/1655027096 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a240063c0 con 0x7f7a3c09c890 2023-09-30T22:24:31.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.264+0000 7f7a41d51700 1 -- 172.21.15.40:0/1655027096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a3c09c890 msgr2=0x7f7a3c09cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.264+0000 7f7a41d51700 1 --2- 172.21.15.40:0/1655027096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a3c09c890 0x7f7a3c09cc60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7a24009820 tx=0x7f7a24009b30 comp rx=0 tx=0).stop 2023-09-30T22:24:31.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.264+0000 7f7a41d51700 1 -- 172.21.15.40:0/1655027096 shutdown_connections 2023-09-30T22:24:31.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.264+0000 7f7a41d51700 1 --2- 172.21.15.40:0/1655027096 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a3c09e2b0 0x7f7a3c13ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.264+0000 7f7a41d51700 1 --2- 172.21.15.40:0/1655027096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a3c09c890 0x7f7a3c09cc60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.264+0000 7f7a41d51700 1 --2- 172.21.15.40:0/1655027096 >> v2:172.21.15.40:3300/0 conn(0x7f7a3c09d920 0x7f7a3c09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.264+0000 7f7a41d51700 1 -- 172.21.15.40:0/1655027096 >> 172.21.15.40:0/1655027096 conn(0x7f7a3c0a7080 msgr2=0x7f7a3c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:31.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.264+0000 7f7a41d51700 1 -- 172.21.15.40:0/1655027096 shutdown_connections 2023-09-30T22:24:31.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.264+0000 7f7a41d51700 1 -- 172.21.15.40:0/1655027096 wait complete. 2023-09-30T22:24:31.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.265+0000 7f7a41d51700 1 Processor -- start 2023-09-30T22:24:31.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.265+0000 7f7a41d51700 1 -- start start 2023-09-30T22:24:31.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.266+0000 7f7a41d51700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a3c09c890 0x7f7a3c12e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.266+0000 7f7a41d51700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a3c09d920 0x7f7a3c12e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.266+0000 7f7a41d51700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a3c09e2b0 0x7f7a3c1c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.266+0000 7f7a41d51700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3c131090 con 0x7f7a3c09c890 2023-09-30T22:24:31.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.266+0000 7f7a41d51700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3c0a5d40 con 0x7f7a3c09e2b0 2023-09-30T22:24:31.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.266+0000 7f7a41d51700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3c12dc10 con 0x7f7a3c09d920 2023-09-30T22:24:31.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.266+0000 7f7a3b7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a3c09c890 0x7f7a3c12e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.266+0000 7f7a3affd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a3c09d920 0x7f7a3c12e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.266+0000 7f7a3bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a3c09e2b0 0x7f7a3c1c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.266+0000 7f7a3b7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a3c09c890 0x7f7a3c12e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46546/0 (socket says 172.21.15.40:46546) 2023-09-30T22:24:31.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.266+0000 7f7a3b7fe700 1 -- 172.21.15.40:0/2393088766 learned_addr learned my addr 172.21.15.40:0/2393088766 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:31.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.266+0000 7f7a3b7fe700 1 -- 172.21.15.40:0/2393088766 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a3c09d920 msgr2=0x7f7a3c12e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.266+0000 7f7a3b7fe700 1 --2- 172.21.15.40:0/2393088766 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a3c09d920 0x7f7a3c12e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.266+0000 7f7a3b7fe700 1 -- 172.21.15.40:0/2393088766 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a3c09e2b0 msgr2=0x7f7a3c1c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.266+0000 7f7a3b7fe700 1 --2- 172.21.15.40:0/2393088766 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a3c09e2b0 0x7f7a3c1c8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.266+0000 7f7a3b7fe700 1 -- 172.21.15.40:0/2393088766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a2c009550 con 0x7f7a3c09c890 2023-09-30T22:24:31.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.266+0000 7f7a3bfff700 1 --2- 172.21.15.40:0/2393088766 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a3c09e2b0 0x7f7a3c1c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:31.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.266+0000 7f7a3b7fe700 1 --2- 172.21.15.40:0/2393088766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a3c09c890 0x7f7a3c12e0b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7a24000c00 tx=0x7f7a24004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:31.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.266+0000 7f7a33fff700 1 -- 172.21.15.40:0/2393088766 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a240065b0 con 0x7f7a3c09c890 2023-09-30T22:24:31.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.267+0000 7f7a33fff700 1 -- 172.21.15.40:0/2393088766 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a24006710 con 0x7f7a3c09c890 2023-09-30T22:24:31.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.267+0000 7f7a33fff700 1 -- 172.21.15.40:0/2393088766 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24004560 con 0x7f7a3c09c890 2023-09-30T22:24:31.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.267+0000 7f7a41d51700 1 -- 172.21.15.40:0/2393088766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a34009a70 con 0x7f7a3c09c890 2023-09-30T22:24:31.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.267+0000 7f7a41d51700 1 -- 172.21.15.40:0/2393088766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a24009430 con 0x7f7a3c09c890 2023-09-30T22:24:31.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.267+0000 7f7a33fff700 1 -- 172.21.15.40:0/2393088766 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7a24022070 con 0x7f7a3c09c890 2023-09-30T22:24:31.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.268+0000 7f7a33fff700 1 -- 172.21.15.40:0/2393088766 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4094+0+0 (secure 0 0 0) 0x7f7a24041180 con 0x7f7a3c09c890 2023-09-30T22:24:31.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.268+0000 7f7a41d51700 1 -- 172.21.15.40:0/2393088766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a3c131850 con 0x7f7a3c09c890 2023-09-30T22:24:31.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.272+0000 7f7a33fff700 1 -- 172.21.15.40:0/2393088766 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7a2402a030 con 0x7f7a3c09c890 2023-09-30T22:24:31.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.468+0000 7f7a41d51700 1 -- 172.21.15.40:0/2393088766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7a3c09f090 con 0x7f7a3c09c890 2023-09-30T22:24:31.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.468+0000 7f7a33fff700 1 -- 172.21.15.40:0/2393088766 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7a2402a070 con 0x7f7a3c09c890 2023-09-30T22:24:31.469 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-09-30T22:24:31.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.470+0000 7f7a41d51700 1 -- 172.21.15.40:0/2393088766 >> v1:172.21.15.40:6816/127432 conn(0x7f7a1c02f510 legacy=0x7f7a1c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.470+0000 7f7a41d51700 1 -- 172.21.15.40:0/2393088766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a3c09c890 msgr2=0x7f7a3c12e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.470+0000 7f7a41d51700 1 --2- 172.21.15.40:0/2393088766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a3c09c890 0x7f7a3c12e0b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7a24000c00 tx=0x7f7a24004750 comp rx=0 tx=0).stop 2023-09-30T22:24:31.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.470+0000 7f7a41d51700 1 -- 172.21.15.40:0/2393088766 shutdown_connections 2023-09-30T22:24:31.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.470+0000 7f7a41d51700 1 --2- 172.21.15.40:0/2393088766 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a3c09e2b0 0x7f7a3c1c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.470+0000 7f7a41d51700 1 --2- 172.21.15.40:0/2393088766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a3c09c890 0x7f7a3c12e0b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.470+0000 7f7a41d51700 1 --2- 172.21.15.40:0/2393088766 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a3c09d920 0x7f7a3c12e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.470+0000 7f7a41d51700 1 -- 172.21.15.40:0/2393088766 >> 172.21.15.40:0/2393088766 conn(0x7f7a3c0a7080 msgr2=0x7f7a3c132890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:31.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.470+0000 7f7a41d51700 1 -- 172.21.15.40:0/2393088766 shutdown_connections 2023-09-30T22:24:31.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.470+0000 7f7a41d51700 1 -- 172.21.15.40:0/2393088766 wait complete. 2023-09-30T22:24:31.483 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:24:31.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.611+0000 7fda36a19700 1 Processor -- start 2023-09-30T22:24:31.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.611+0000 7fda36a19700 1 -- start start 2023-09-30T22:24:31.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.612+0000 7fda36a19700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda3009f0f0 0x7fda30138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.612+0000 7fda36a19700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda3009e400 0x7fda3013b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.612+0000 7fda36a19700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda3009f940 con 0x7fda3009d920 2023-09-30T22:24:31.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.612+0000 7fda36a19700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda3006b4c0 con 0x7fda3009e400 2023-09-30T22:24:31.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.612+0000 7fda36a19700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda3009a8f0 con 0x7fda3009f0f0 2023-09-30T22:24:31.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.612+0000 7fda2f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda3009f0f0 0x7fda30138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.612+0000 7fda2ffff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fda3009d920 0x7fda3009dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40274/0 (socket says 172.21.15.40:40274) 2023-09-30T22:24:31.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.612+0000 7fda34fb6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda3009e400 0x7fda3013b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.612+0000 7fda2ffff700 1 -- 172.21.15.40:0/1965254729 learned_addr learned my addr 172.21.15.40:0/1965254729 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:24:31.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.612+0000 7fda2effd700 1 -- 172.21.15.40:0/1965254729 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 118148716 0 0) 0x7fda3009f940 con 0x7fda3009d920 2023-09-30T22:24:31.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.612+0000 7fda2f7fe700 1 -- 172.21.15.40:0/1965254729 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda3009e400 msgr2=0x7fda3013b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:31.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.612+0000 7fda2f7fe700 1 --2- 172.21.15.40:0/1965254729 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda3009e400 0x7fda3013b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.612+0000 7fda2f7fe700 1 -- 172.21.15.40:0/1965254729 >> v1:172.21.15.40:6789/0 conn(0x7fda3009d920 legacy=0x7fda3009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.612+0000 7fda2f7fe700 1 -- 172.21.15.40:0/1965254729 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda3009f6e0 con 0x7fda3009f0f0 2023-09-30T22:24:31.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.612+0000 7fda34fb6700 1 --2- 172.21.15.40:0/1965254729 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda3009e400 0x7fda3013b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:31.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.612+0000 7fda2f7fe700 1 --2- 172.21.15.40:0/1965254729 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda3009f0f0 0x7fda30138ee0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fda180098a0 tx=0x7fda18009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53b81629668f00f8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:31.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.612+0000 7fda2effd700 1 -- 172.21.15.40:0/1965254729 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda18011830 con 0x7fda3009f0f0 2023-09-30T22:24:31.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.612+0000 7fda2effd700 1 -- 172.21.15.40:0/1965254729 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda18011990 con 0x7fda3009f0f0 2023-09-30T22:24:31.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.612+0000 7fda2effd700 1 -- 172.21.15.40:0/1965254729 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda18011d20 con 0x7fda3009f0f0 2023-09-30T22:24:31.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.613+0000 7fda36a19700 1 -- 172.21.15.40:0/1965254729 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda3009f0f0 msgr2=0x7fda30138ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.613+0000 7fda36a19700 1 --2- 172.21.15.40:0/1965254729 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda3009f0f0 0x7fda30138ee0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fda180098a0 tx=0x7fda18009bb0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.613+0000 7fda36a19700 1 -- 172.21.15.40:0/1965254729 shutdown_connections 2023-09-30T22:24:31.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.613+0000 7fda36a19700 1 --2- 172.21.15.40:0/1965254729 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda3009e400 0x7fda3013b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.613+0000 7fda36a19700 1 --2- 172.21.15.40:0/1965254729 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda3009f0f0 0x7fda30138ee0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.613+0000 7fda36a19700 1 -- 172.21.15.40:0/1965254729 >> 172.21.15.40:0/1965254729 conn(0x7fda3009fb20 msgr2=0x7fda3009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:31.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.613+0000 7fda36a19700 1 -- 172.21.15.40:0/1965254729 shutdown_connections 2023-09-30T22:24:31.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.613+0000 7fda36a19700 1 -- 172.21.15.40:0/1965254729 wait complete. 2023-09-30T22:24:31.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.614+0000 7fda36a19700 1 Processor -- start 2023-09-30T22:24:31.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.614+0000 7fda36a19700 1 -- start start 2023-09-30T22:24:31.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.614+0000 7fda36a19700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda3009d920 0x7fda3011e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.614+0000 7fda36a19700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda3009e400 0x7fda3011ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.614+0000 7fda36a19700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda3011f2c0 0x7fda301ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.614+0000 7fda36a19700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda300a3260 con 0x7fda3011f2c0 2023-09-30T22:24:31.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.614+0000 7fda36a19700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda3009c9e0 con 0x7fda3009d920 2023-09-30T22:24:31.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.614+0000 7fda36a19700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda30121a60 con 0x7fda3009e400 2023-09-30T22:24:31.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.615+0000 7fda2ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda3009d920 0x7fda3011e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.615+0000 7fda2f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda3009e400 0x7fda3011ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.615+0000 7fda2ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda3009d920 0x7fda3011e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52218/0 (socket says 172.21.15.40:52218) 2023-09-30T22:24:31.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.615+0000 7fda2ffff700 1 -- 172.21.15.40:0/360188365 learned_addr learned my addr 172.21.15.40:0/360188365 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:31.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.615+0000 7fda34fb6700 1 --2- 172.21.15.40:0/360188365 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda3011f2c0 0x7fda301ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.615+0000 7fda2f7fe700 1 -- 172.21.15.40:0/360188365 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda3009d920 msgr2=0x7fda3011e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.615+0000 7fda2f7fe700 1 --2- 172.21.15.40:0/360188365 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda3009d920 0x7fda3011e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.615+0000 7fda2f7fe700 1 -- 172.21.15.40:0/360188365 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda3011f2c0 msgr2=0x7fda301ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.615+0000 7fda2f7fe700 1 --2- 172.21.15.40:0/360188365 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda3011f2c0 0x7fda301ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.615+0000 7fda2f7fe700 1 -- 172.21.15.40:0/360188365 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda28009a70 con 0x7fda3009e400 2023-09-30T22:24:31.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.615+0000 7fda34fb6700 1 --2- 172.21.15.40:0/360188365 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda3011f2c0 0x7fda301ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:31.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.615+0000 7fda2ffff700 1 --2- 172.21.15.40:0/360188365 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda3009d920 0x7fda3011e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:31.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.615+0000 7fda2f7fe700 1 --2- 172.21.15.40:0/360188365 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda3009e400 0x7fda3011ed80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fda18016000 tx=0x7fda18004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:31.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.615+0000 7fda2cff9700 1 -- 172.21.15.40:0/360188365 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda18004550 con 0x7fda3009e400 2023-09-30T22:24:31.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.615+0000 7fda2cff9700 1 -- 172.21.15.40:0/360188365 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda180036a0 con 0x7fda3009e400 2023-09-30T22:24:31.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.615+0000 7fda36a19700 1 -- 172.21.15.40:0/360188365 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda180094a0 con 0x7fda3009e400 2023-09-30T22:24:31.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.615+0000 7fda2cff9700 1 -- 172.21.15.40:0/360188365 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda18003a50 con 0x7fda3009e400 2023-09-30T22:24:31.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.615+0000 7fda36a19700 1 -- 172.21.15.40:0/360188365 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda30120bb0 con 0x7fda3009e400 2023-09-30T22:24:31.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.616+0000 7fda2cff9700 1 -- 172.21.15.40:0/360188365 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fda18003bb0 con 0x7fda3009e400 2023-09-30T22:24:31.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.616+0000 7fda2cff9700 1 -- 172.21.15.40:0/360188365 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4094+0+0 (secure 0 0 0) 0x7fda18040de0 con 0x7fda3009e400 2023-09-30T22:24:31.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.616+0000 7fda36a19700 1 -- 172.21.15.40:0/360188365 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda30121c30 con 0x7fda3009e400 2023-09-30T22:24:31.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.621+0000 7fda2cff9700 1 -- 172.21.15.40:0/360188365 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fda18015020 con 0x7fda3009e400 2023-09-30T22:24:31.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.812+0000 7fda36a19700 1 -- 172.21.15.40:0/360188365 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fda30062380 con 0x7fda3009e400 2023-09-30T22:24:31.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.813+0000 7fda2cff9700 1 -- 172.21.15.40:0/360188365 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fda18003e60 con 0x7fda3009e400 2023-09-30T22:24:31.814 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-09-30T22:24:31.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.815+0000 7fda36a19700 1 -- 172.21.15.40:0/360188365 >> v1:172.21.15.40:6816/127432 conn(0x7fda1002f510 legacy=0x7fda100319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.815+0000 7fda36a19700 1 -- 172.21.15.40:0/360188365 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda3009e400 msgr2=0x7fda3011ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.815+0000 7fda36a19700 1 --2- 172.21.15.40:0/360188365 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda3009e400 0x7fda3011ed80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fda18016000 tx=0x7fda18004750 comp rx=0 tx=0).stop 2023-09-30T22:24:31.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.815+0000 7fda36a19700 1 -- 172.21.15.40:0/360188365 shutdown_connections 2023-09-30T22:24:31.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.815+0000 7fda36a19700 1 --2- 172.21.15.40:0/360188365 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda3011f2c0 0x7fda301ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.815+0000 7fda36a19700 1 --2- 172.21.15.40:0/360188365 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda3009d920 0x7fda3011e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.815+0000 7fda36a19700 1 --2- 172.21.15.40:0/360188365 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda3009e400 0x7fda3011ed80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.815+0000 7fda36a19700 1 -- 172.21.15.40:0/360188365 >> 172.21.15.40:0/360188365 conn(0x7fda3009fb20 msgr2=0x7fda300a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:31.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.815+0000 7fda36a19700 1 -- 172.21.15.40:0/360188365 shutdown_connections 2023-09-30T22:24:31.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.815+0000 7fda36a19700 1 -- 172.21.15.40:0/360188365 wait complete. 2023-09-30T22:24:31.827 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:24:31.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.955+0000 7fe3c3a8c700 1 Processor -- start 2023-09-30T22:24:31.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.956+0000 7fe3c3a8c700 1 -- start start 2023-09-30T22:24:31.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.956+0000 7fe3c3a8c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe3bc09e400 0x7fe3bc135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.956+0000 7fe3c3a8c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe3bc136230 0x7fe3bc138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.956+0000 7fe3c3a8c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3bc09adf0 con 0x7fe3bc09d920 2023-09-30T22:24:31.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.956+0000 7fe3c3a8c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3bc09e7f0 con 0x7fe3bc136230 2023-09-30T22:24:31.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.956+0000 7fe3c3a8c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3bc09edf0 con 0x7fe3bc09e400 2023-09-30T22:24:31.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.956+0000 7fe3c2029700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe3bc136230 0x7fe3bc138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.956+0000 7fe3c1828700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe3bc09d920 0x7fe3bc09dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40282/0 (socket says 172.21.15.40:40282) 2023-09-30T22:24:31.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.956+0000 7fe3c1828700 1 -- 172.21.15.40:0/42177826 learned_addr learned my addr 172.21.15.40:0/42177826 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:24:31.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.956+0000 7fe3c1027700 1 --2- 172.21.15.40:0/42177826 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe3bc09e400 0x7fe3bc135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.957+0000 7fe3c2029700 1 -- 172.21.15.40:0/42177826 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe3bc09e400 msgr2=0x7fe3bc135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:31.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.957+0000 7fe3c2029700 1 --2- 172.21.15.40:0/42177826 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe3bc09e400 0x7fe3bc135cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.957+0000 7fe3c2029700 1 -- 172.21.15.40:0/42177826 >> v1:172.21.15.40:6789/0 conn(0x7fe3bc09d920 legacy=0x7fe3bc09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.957+0000 7fe3c2029700 1 -- 172.21.15.40:0/42177826 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3bc09b660 con 0x7fe3bc136230 2023-09-30T22:24:31.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.957+0000 7fe3c0826700 1 -- 172.21.15.40:0/42177826 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3582607370 0 0) 0x7fe3bc09adf0 con 0x7fe3bc09d920 2023-09-30T22:24:31.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.957+0000 7fe3c1027700 1 --2- 172.21.15.40:0/42177826 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe3bc09e400 0x7fe3bc135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:31.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.957+0000 7fe3c2029700 1 --2- 172.21.15.40:0/42177826 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3bc136230 0x7fe3bc138610 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4009d90 tx=0x7fe3b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=620d8c2146a3604 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:31.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.957+0000 7fe3c0826700 1 -- 172.21.15.40:0/42177826 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b400e070 con 0x7fe3bc136230 2023-09-30T22:24:31.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.957+0000 7fe3c0826700 1 -- 172.21.15.40:0/42177826 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b400bb20 con 0x7fe3bc136230 2023-09-30T22:24:31.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.957+0000 7fe3c0826700 1 -- 172.21.15.40:0/42177826 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b4012430 con 0x7fe3bc136230 2023-09-30T22:24:31.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.957+0000 7fe3c3a8c700 1 -- 172.21.15.40:0/42177826 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3bc136230 msgr2=0x7fe3bc138610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.957+0000 7fe3c3a8c700 1 --2- 172.21.15.40:0/42177826 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3bc136230 0x7fe3bc138610 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4009d90 tx=0x7fe3b400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:31.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.957+0000 7fe3c3a8c700 1 -- 172.21.15.40:0/42177826 shutdown_connections 2023-09-30T22:24:31.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.957+0000 7fe3c3a8c700 1 --2- 172.21.15.40:0/42177826 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3bc136230 0x7fe3bc138610 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.957+0000 7fe3c3a8c700 1 --2- 172.21.15.40:0/42177826 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe3bc09e400 0x7fe3bc135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.957+0000 7fe3c3a8c700 1 -- 172.21.15.40:0/42177826 >> 172.21.15.40:0/42177826 conn(0x7fe3bc09fb20 msgr2=0x7fe3bc09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:31.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.957+0000 7fe3c3a8c700 1 -- 172.21.15.40:0/42177826 shutdown_connections 2023-09-30T22:24:31.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.958+0000 7fe3c3a8c700 1 -- 172.21.15.40:0/42177826 wait complete. 2023-09-30T22:24:31.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.958+0000 7fe3c3a8c700 1 Processor -- start 2023-09-30T22:24:31.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.958+0000 7fe3c3a8c700 1 -- start start 2023-09-30T22:24:31.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.959+0000 7fe3c3a8c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe3bc09d920 0x7fe3bc133b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.959+0000 7fe3c3a8c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3bc09e400 0x7fe3bc1340c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.959+0000 7fe3c3a8c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe3bc136230 0x7fe3bc134600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.959+0000 7fe3c3a8c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3bc1357a0 con 0x7fe3bc09e400 2023-09-30T22:24:31.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.959+0000 7fe3c3a8c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3bc132a00 con 0x7fe3bc136230 2023-09-30T22:24:31.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.959+0000 7fe3c3a8c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3bc0a3bb0 con 0x7fe3bc09d920 2023-09-30T22:24:31.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.959+0000 7fe3c1828700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe3bc09d920 0x7fe3bc133b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.959+0000 7fe3c1027700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3bc09e400 0x7fe3bc1340c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.959+0000 7fe3c2029700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe3bc136230 0x7fe3bc134600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.959+0000 7fe3c1027700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3bc09e400 0x7fe3bc1340c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46580/0 (socket says 172.21.15.40:46580) 2023-09-30T22:24:31.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.959+0000 7fe3c1828700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe3bc09d920 0x7fe3bc133b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33378/0 (socket says 172.21.15.40:33378) 2023-09-30T22:24:31.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.959+0000 7fe3c1027700 1 -- 172.21.15.40:0/629224322 learned_addr learned my addr 172.21.15.40:0/629224322 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:31.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.959+0000 7fe3c1027700 1 -- 172.21.15.40:0/629224322 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe3bc09d920 msgr2=0x7fe3bc133b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.959+0000 7fe3c1027700 1 --2- 172.21.15.40:0/629224322 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe3bc09d920 0x7fe3bc133b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.959+0000 7fe3c1027700 1 -- 172.21.15.40:0/629224322 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe3bc136230 msgr2=0x7fe3bc134600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.959+0000 7fe3c1027700 1 --2- 172.21.15.40:0/629224322 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe3bc136230 0x7fe3bc134600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.959+0000 7fe3c1027700 1 -- 172.21.15.40:0/629224322 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b80094a0 con 0x7fe3bc09e400 2023-09-30T22:24:31.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.959+0000 7fe3c1027700 1 --2- 172.21.15.40:0/629224322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3bc09e400 0x7fe3bc1340c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe3b800ec10 tx=0x7fe3b800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:31.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.960+0000 7fe3b27fc700 1 -- 172.21.15.40:0/629224322 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b800c7f0 con 0x7fe3bc09e400 2023-09-30T22:24:31.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.960+0000 7fe3b27fc700 1 -- 172.21.15.40:0/629224322 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b800c950 con 0x7fe3bc09e400 2023-09-30T22:24:31.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.960+0000 7fe3c3a8c700 1 -- 172.21.15.40:0/629224322 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3b4009a70 con 0x7fe3bc09e400 2023-09-30T22:24:31.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.960+0000 7fe3b27fc700 1 -- 172.21.15.40:0/629224322 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b800ccc0 con 0x7fe3bc09e400 2023-09-30T22:24:31.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.960+0000 7fe3c3a8c700 1 -- 172.21.15.40:0/629224322 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3bc09cb00 con 0x7fe3bc09e400 2023-09-30T22:24:31.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.960+0000 7fe3b27fc700 1 -- 172.21.15.40:0/629224322 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe3b8013470 con 0x7fe3bc09e400 2023-09-30T22:24:31.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.961+0000 7fe3b27fc700 1 -- 172.21.15.40:0/629224322 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4094+0+0 (secure 0 0 0) 0x7fe3b803fc90 con 0x7fe3bc09e400 2023-09-30T22:24:31.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.961+0000 7fe3c3a8c700 1 -- 172.21.15.40:0/629224322 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3bc062380 con 0x7fe3bc09e400 2023-09-30T22:24:31.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:31.965+0000 7fe3b27fc700 1 -- 172.21.15.40:0/629224322 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe3b8021020 con 0x7fe3bc09e400 2023-09-30T22:24:32.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.159+0000 7fe3c3a8c700 1 -- 172.21.15.40:0/629224322 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe3bc132790 con 0x7fe3bc09e400 2023-09-30T22:24:32.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.159+0000 7fe3b27fc700 1 -- 172.21.15.40:0/629224322 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe3b8013720 con 0x7fe3bc09e400 2023-09-30T22:24:32.160 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-09-30T22:24:32.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.161+0000 7fe3c3a8c700 1 -- 172.21.15.40:0/629224322 >> v1:172.21.15.40:6816/127432 conn(0x7fe3a002f510 legacy=0x7fe3a00319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.161+0000 7fe3c3a8c700 1 -- 172.21.15.40:0/629224322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3bc09e400 msgr2=0x7fe3bc1340c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.161+0000 7fe3c3a8c700 1 --2- 172.21.15.40:0/629224322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3bc09e400 0x7fe3bc1340c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe3b800ec10 tx=0x7fe3b800ef20 comp rx=0 tx=0).stop 2023-09-30T22:24:32.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.161+0000 7fe3c3a8c700 1 -- 172.21.15.40:0/629224322 shutdown_connections 2023-09-30T22:24:32.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.161+0000 7fe3c3a8c700 1 --2- 172.21.15.40:0/629224322 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe3bc09d920 0x7fe3bc133b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.161+0000 7fe3c3a8c700 1 --2- 172.21.15.40:0/629224322 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe3bc136230 0x7fe3bc134600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.161+0000 7fe3c3a8c700 1 --2- 172.21.15.40:0/629224322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3bc09e400 0x7fe3bc1340c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.161+0000 7fe3c3a8c700 1 -- 172.21.15.40:0/629224322 >> 172.21.15.40:0/629224322 conn(0x7fe3bc09fb20 msgr2=0x7fe3bc12fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:32.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.161+0000 7fe3c3a8c700 1 -- 172.21.15.40:0/629224322 shutdown_connections 2023-09-30T22:24:32.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.162+0000 7fe3c3a8c700 1 -- 172.21.15.40:0/629224322 wait complete. 2023-09-30T22:24:32.174 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:24:32.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.301+0000 7febf2b8b700 1 Processor -- start 2023-09-30T22:24:32.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.301+0000 7febf2b8b700 1 -- start start 2023-09-30T22:24:32.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.302+0000 7febf2b8b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7febec09e400 0x7febec135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:32.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.302+0000 7febf2b8b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febec136230 0x7febec138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:32.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.302+0000 7febf2b8b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febec09adf0 con 0x7febec09d920 2023-09-30T22:24:32.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.302+0000 7febf2b8b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febec09edf0 con 0x7febec09e400 2023-09-30T22:24:32.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.302+0000 7febf2b8b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febec09b660 con 0x7febec136230 2023-09-30T22:24:32.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.302+0000 7febebfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7febec09e400 0x7febec135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:32.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.302+0000 7febf1128700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febec136230 0x7febec138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:32.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.302+0000 7febf0927700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7febec09d920 0x7febec09dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40296/0 (socket says 172.21.15.40:40296) 2023-09-30T22:24:32.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.302+0000 7febf0927700 1 -- 172.21.15.40:0/488702493 learned_addr learned my addr 172.21.15.40:0/488702493 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:24:32.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.302+0000 7febf1128700 1 -- 172.21.15.40:0/488702493 >> v2:172.21.15.40:3300/0 conn(0x7febec09e400 msgr2=0x7febec135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:32.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.302+0000 7febf1128700 1 --2- 172.21.15.40:0/488702493 >> v2:172.21.15.40:3300/0 conn(0x7febec09e400 0x7febec135cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.302+0000 7febf1128700 1 -- 172.21.15.40:0/488702493 >> v1:172.21.15.40:6789/0 conn(0x7febec09d920 legacy=0x7febec09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.302+0000 7febf1128700 1 -- 172.21.15.40:0/488702493 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febec09a6e0 con 0x7febec136230 2023-09-30T22:24:32.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.302+0000 7febebfff700 1 --2- 172.21.15.40:0/488702493 >> v2:172.21.15.40:3300/0 conn(0x7febec09e400 0x7febec135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:32.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.302+0000 7febeb7fe700 1 -- 172.21.15.40:0/488702493 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1759949572 0 0) 0x7febec09adf0 con 0x7febec09d920 2023-09-30T22:24:32.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.303+0000 7febf1128700 1 --2- 172.21.15.40:0/488702493 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febec136230 0x7febec138610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7febe4009d90 tx=0x7febe400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ac0d71c09d2313f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:32.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.303+0000 7febeb7fe700 1 -- 172.21.15.40:0/488702493 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe400e070 con 0x7febec136230 2023-09-30T22:24:32.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.303+0000 7febeb7fe700 1 -- 172.21.15.40:0/488702493 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe400bb20 con 0x7febec136230 2023-09-30T22:24:32.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.303+0000 7febeb7fe700 1 -- 172.21.15.40:0/488702493 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe4012430 con 0x7febec136230 2023-09-30T22:24:32.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.303+0000 7febf2b8b700 1 -- 172.21.15.40:0/488702493 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febec136230 msgr2=0x7febec138610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.303+0000 7febf2b8b700 1 --2- 172.21.15.40:0/488702493 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febec136230 0x7febec138610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7febe4009d90 tx=0x7febe400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:32.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.303+0000 7febf2b8b700 1 -- 172.21.15.40:0/488702493 shutdown_connections 2023-09-30T22:24:32.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.303+0000 7febf2b8b700 1 --2- 172.21.15.40:0/488702493 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febec136230 0x7febec138610 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.303+0000 7febf2b8b700 1 --2- 172.21.15.40:0/488702493 >> v2:172.21.15.40:3300/0 conn(0x7febec09e400 0x7febec135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.303+0000 7febf2b8b700 1 -- 172.21.15.40:0/488702493 >> 172.21.15.40:0/488702493 conn(0x7febec09fb20 msgr2=0x7febec09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:32.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.303+0000 7febf2b8b700 1 -- 172.21.15.40:0/488702493 shutdown_connections 2023-09-30T22:24:32.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.303+0000 7febf2b8b700 1 -- 172.21.15.40:0/488702493 wait complete. 2023-09-30T22:24:32.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.304+0000 7febf2b8b700 1 Processor -- start 2023-09-30T22:24:32.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.304+0000 7febf2b8b700 1 -- start start 2023-09-30T22:24:32.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.305+0000 7febf2b8b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febec09d920 0x7febec11e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:32.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.305+0000 7febf2b8b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febec09e400 0x7febec11ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:32.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.305+0000 7febf2b8b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febec136230 0x7febec11f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:32.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.305+0000 7febf2b8b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec121ed0 con 0x7febec09d920 2023-09-30T22:24:32.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.305+0000 7febf2b8b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febec135970 con 0x7febec09e400 2023-09-30T22:24:32.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.305+0000 7febf2b8b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febec1220d0 con 0x7febec136230 2023-09-30T22:24:32.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.305+0000 7febf0927700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febec09d920 0x7febec11e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:32.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.305+0000 7febebfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febec09e400 0x7febec11ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:32.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.305+0000 7febf0927700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febec09d920 0x7febec11e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46600/0 (socket says 172.21.15.40:46600) 2023-09-30T22:24:32.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.305+0000 7febf0927700 1 -- 172.21.15.40:0/219701462 learned_addr learned my addr 172.21.15.40:0/219701462 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:32.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.305+0000 7febf1128700 1 --2- 172.21.15.40:0/219701462 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febec136230 0x7febec11f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:32.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.305+0000 7febf0927700 1 -- 172.21.15.40:0/219701462 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febec136230 msgr2=0x7febec11f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.305+0000 7febf0927700 1 --2- 172.21.15.40:0/219701462 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febec136230 0x7febec11f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.305+0000 7febf0927700 1 -- 172.21.15.40:0/219701462 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febec09e400 msgr2=0x7febec11ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.305+0000 7febf0927700 1 --2- 172.21.15.40:0/219701462 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febec09e400 0x7febec11ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.305+0000 7febf0927700 1 -- 172.21.15.40:0/219701462 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd800b740 con 0x7febec09d920 2023-09-30T22:24:32.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.305+0000 7febebfff700 1 --2- 172.21.15.40:0/219701462 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febec09e400 0x7febec11ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:32.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.306+0000 7febf0927700 1 --2- 172.21.15.40:0/219701462 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febec09d920 0x7febec11e770 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7febe000c470 tx=0x7febe000c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:32.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.306+0000 7febe97fa700 1 -- 172.21.15.40:0/219701462 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe00074e0 con 0x7febec09d920 2023-09-30T22:24:32.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.306+0000 7febe97fa700 1 -- 172.21.15.40:0/219701462 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe0007640 con 0x7febec09d920 2023-09-30T22:24:32.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.306+0000 7febf2b8b700 1 -- 172.21.15.40:0/219701462 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe4009a70 con 0x7febec09d920 2023-09-30T22:24:32.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.306+0000 7febe97fa700 1 -- 172.21.15.40:0/219701462 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe0005a70 con 0x7febec09d920 2023-09-30T22:24:32.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.306+0000 7febf2b8b700 1 -- 172.21.15.40:0/219701462 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febec1213a0 con 0x7febec09d920 2023-09-30T22:24:32.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.306+0000 7febe97fa700 1 -- 172.21.15.40:0/219701462 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7febe0005bd0 con 0x7febec09d920 2023-09-30T22:24:32.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.307+0000 7febe97fa700 1 -- 172.21.15.40:0/219701462 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4094+0+0 (secure 0 0 0) 0x7febe003ef40 con 0x7febec09d920 2023-09-30T22:24:32.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.307+0000 7febf2b8b700 1 -- 172.21.15.40:0/219701462 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febec062380 con 0x7febec09d920 2023-09-30T22:24:32.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.311+0000 7febe97fa700 1 -- 172.21.15.40:0/219701462 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7febe0017070 con 0x7febec09d920 2023-09-30T22:24:32.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.505+0000 7febf2b8b700 1 -- 172.21.15.40:0/219701462 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7febec120940 con 0x7febec09d920 2023-09-30T22:24:32.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.505+0000 7febe97fa700 1 -- 172.21.15.40:0/219701462 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7febe001bb10 con 0x7febec09d920 2023-09-30T22:24:32.506 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-09-30T22:24:32.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.507+0000 7febf2b8b700 1 -- 172.21.15.40:0/219701462 >> v1:172.21.15.40:6816/127432 conn(0x7febd002f510 legacy=0x7febd00319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.507+0000 7febf2b8b700 1 -- 172.21.15.40:0/219701462 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febec09d920 msgr2=0x7febec11e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.507+0000 7febf2b8b700 1 --2- 172.21.15.40:0/219701462 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febec09d920 0x7febec11e770 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7febe000c470 tx=0x7febe000c780 comp rx=0 tx=0).stop 2023-09-30T22:24:32.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.508+0000 7febf2b8b700 1 -- 172.21.15.40:0/219701462 shutdown_connections 2023-09-30T22:24:32.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.508+0000 7febf2b8b700 1 --2- 172.21.15.40:0/219701462 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febec136230 0x7febec11f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.508+0000 7febf2b8b700 1 --2- 172.21.15.40:0/219701462 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febec09d920 0x7febec11e770 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.508+0000 7febf2b8b700 1 --2- 172.21.15.40:0/219701462 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febec09e400 0x7febec11ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.508+0000 7febf2b8b700 1 -- 172.21.15.40:0/219701462 >> 172.21.15.40:0/219701462 conn(0x7febec09fb20 msgr2=0x7febec0703b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:32.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.508+0000 7febf2b8b700 1 -- 172.21.15.40:0/219701462 shutdown_connections 2023-09-30T22:24:32.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.508+0000 7febf2b8b700 1 -- 172.21.15.40:0/219701462 wait complete. 2023-09-30T22:24:32.520 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:24:32.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.645+0000 7f0f4291a700 1 Processor -- start 2023-09-30T22:24:32.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.645+0000 7f0f4291a700 1 -- start start 2023-09-30T22:24:32.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.646+0000 7f0f4291a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0f3c136bf0 0x7f0f3c138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:32.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.646+0000 7f0f4291a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0f3c139510 0x7f0f3c13b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:32.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.646+0000 7f0f4291a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f3c0a2600 con 0x7f0f3c09c890 2023-09-30T22:24:32.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.646+0000 7f0f4291a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f3c0a29d0 con 0x7f0f3c136bf0 2023-09-30T22:24:32.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.646+0000 7f0f4291a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c09fb40 con 0x7f0f3c139510 2023-09-30T22:24:32.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.646+0000 7f0f40eb7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0f3c139510 0x7f0f3c13b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:32.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.646+0000 7f0f3b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0f3c136bf0 0x7f0f3c138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:32.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.646+0000 7f0f3bfff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f0f3c09c890 0x7f0f3c09cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40312/0 (socket says 172.21.15.40:40312) 2023-09-30T22:24:32.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.646+0000 7f0f3bfff700 1 -- 172.21.15.40:0/2143464066 learned_addr learned my addr 172.21.15.40:0/2143464066 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:24:32.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.646+0000 7f0f3affd700 1 -- 172.21.15.40:0/2143464066 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1521418445 0 0) 0x7f0f3c0a2600 con 0x7f0f3c09c890 2023-09-30T22:24:32.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.646+0000 7f0f3affd700 1 -- 172.21.15.40:0/2143464066 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f240035b0 con 0x7f0f3c09c890 2023-09-30T22:24:32.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.646+0000 7f0f40eb7700 1 -- 172.21.15.40:0/2143464066 >> v2:172.21.15.40:3300/0 conn(0x7f0f3c136bf0 msgr2=0x7f0f3c138fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:32.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.646+0000 7f0f40eb7700 1 --2- 172.21.15.40:0/2143464066 >> v2:172.21.15.40:3300/0 conn(0x7f0f3c136bf0 0x7f0f3c138fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.646+0000 7f0f40eb7700 1 -- 172.21.15.40:0/2143464066 >> v1:172.21.15.40:6789/0 conn(0x7f0f3c09c890 legacy=0x7f0f3c09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.646+0000 7f0f40eb7700 1 -- 172.21.15.40:0/2143464066 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3c09d370 con 0x7f0f3c139510 2023-09-30T22:24:32.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.646+0000 7f0f3b7fe700 1 --2- 172.21.15.40:0/2143464066 >> v2:172.21.15.40:3300/0 conn(0x7f0f3c136bf0 0x7f0f3c138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:32.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.646+0000 7f0f40eb7700 1 --2- 172.21.15.40:0/2143464066 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0f3c139510 0x7f0f3c13b8f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0f34009d90 tx=0x7f0f3400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42c3c8937c3cc038 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:32.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.646+0000 7f0f3affd700 1 -- 172.21.15.40:0/2143464066 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3400e070 con 0x7f0f3c139510 2023-09-30T22:24:32.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.646+0000 7f0f3affd700 1 -- 172.21.15.40:0/2143464066 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f3400bb20 con 0x7f0f3c139510 2023-09-30T22:24:32.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.646+0000 7f0f3affd700 1 -- 172.21.15.40:0/2143464066 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f34012430 con 0x7f0f3c139510 2023-09-30T22:24:32.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.647+0000 7f0f4291a700 1 -- 172.21.15.40:0/2143464066 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0f3c139510 msgr2=0x7f0f3c13b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.647+0000 7f0f4291a700 1 --2- 172.21.15.40:0/2143464066 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0f3c139510 0x7f0f3c13b8f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0f34009d90 tx=0x7f0f3400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:32.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.647+0000 7f0f4291a700 1 -- 172.21.15.40:0/2143464066 shutdown_connections 2023-09-30T22:24:32.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.647+0000 7f0f4291a700 1 --2- 172.21.15.40:0/2143464066 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0f3c139510 0x7f0f3c13b8f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.647+0000 7f0f4291a700 1 --2- 172.21.15.40:0/2143464066 >> v2:172.21.15.40:3300/0 conn(0x7f0f3c136bf0 0x7f0f3c138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.647+0000 7f0f4291a700 1 -- 172.21.15.40:0/2143464066 >> 172.21.15.40:0/2143464066 conn(0x7f0f3c0a7080 msgr2=0x7f0f3c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:32.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.647+0000 7f0f4291a700 1 -- 172.21.15.40:0/2143464066 shutdown_connections 2023-09-30T22:24:32.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.647+0000 7f0f4291a700 1 -- 172.21.15.40:0/2143464066 wait complete. 2023-09-30T22:24:32.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.648+0000 7f0f4291a700 1 Processor -- start 2023-09-30T22:24:32.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.648+0000 7f0f4291a700 1 -- start start 2023-09-30T22:24:32.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.648+0000 7f0f4291a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0f3c09c890 0x7f0f3c09b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:32.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.648+0000 7f0f4291a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f3c136bf0 0x7f0f3c09bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:32.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.649+0000 7f0f4291a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0f3c139510 0x7f0f3c06f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:32.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.649+0000 7f0f4291a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c070600 con 0x7f0f3c136bf0 2023-09-30T22:24:32.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.649+0000 7f0f4291a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c12cd90 con 0x7f0f3c09c890 2023-09-30T22:24:32.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.649+0000 7f0f4291a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c12bb70 con 0x7f0f3c139510 2023-09-30T22:24:32.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.649+0000 7f0f3bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0f3c09c890 0x7f0f3c09b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:32.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.649+0000 7f0f40eb7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0f3c139510 0x7f0f3c06f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:32.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.649+0000 7f0f3b7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f3c136bf0 0x7f0f3c09bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:32.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.649+0000 7f0f40eb7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0f3c139510 0x7f0f3c06f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33414/0 (socket says 172.21.15.40:33414) 2023-09-30T22:24:32.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.649+0000 7f0f40eb7700 1 -- 172.21.15.40:0/1438328786 learned_addr learned my addr 172.21.15.40:0/1438328786 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:32.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.649+0000 7f0f3bfff700 1 --2- 172.21.15.40:0/1438328786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0f3c09c890 0x7f0f3c09b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52244/0 (socket says 172.21.15.40:52244) 2023-09-30T22:24:32.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.649+0000 7f0f3bfff700 1 -- 172.21.15.40:0/1438328786 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0f3c139510 msgr2=0x7f0f3c06f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.649+0000 7f0f3bfff700 1 --2- 172.21.15.40:0/1438328786 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0f3c139510 0x7f0f3c06f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.649+0000 7f0f3bfff700 1 -- 172.21.15.40:0/1438328786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f3c136bf0 msgr2=0x7f0f3c09bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.649+0000 7f0f3bfff700 1 --2- 172.21.15.40:0/1438328786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f3c136bf0 0x7f0f3c09bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.649+0000 7f0f3bfff700 1 -- 172.21.15.40:0/1438328786 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f300094a0 con 0x7f0f3c09c890 2023-09-30T22:24:32.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.649+0000 7f0f40eb7700 1 --2- 172.21.15.40:0/1438328786 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0f3c139510 0x7f0f3c06f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:32.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.649+0000 7f0f3b7fe700 1 --2- 172.21.15.40:0/1438328786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f3c136bf0 0x7f0f3c09bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:32.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.649+0000 7f0f3bfff700 1 --2- 172.21.15.40:0/1438328786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0f3c09c890 0x7f0f3c09b7f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c00c700 tx=0x7f0f2c00ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:32.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.649+0000 7f0f38ff9700 1 -- 172.21.15.40:0/1438328786 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c0074e0 con 0x7f0f3c09c890 2023-09-30T22:24:32.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.649+0000 7f0f38ff9700 1 -- 172.21.15.40:0/1438328786 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2c007640 con 0x7f0f3c09c890 2023-09-30T22:24:32.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.649+0000 7f0f4291a700 1 -- 172.21.15.40:0/1438328786 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f34009a70 con 0x7f0f3c09c890 2023-09-30T22:24:32.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.649+0000 7f0f38ff9700 1 -- 172.21.15.40:0/1438328786 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c005a50 con 0x7f0f3c09c890 2023-09-30T22:24:32.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.649+0000 7f0f4291a700 1 -- 172.21.15.40:0/1438328786 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f3c12b4e0 con 0x7f0f3c09c890 2023-09-30T22:24:32.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.650+0000 7f0f38ff9700 1 -- 172.21.15.40:0/1438328786 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0f2c005bb0 con 0x7f0f3c09c890 2023-09-30T22:24:32.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.650+0000 7f0f38ff9700 1 -- 172.21.15.40:0/1438328786 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4094+0+0 (secure 0 0 0) 0x7f0f2c03ef60 con 0x7f0f3c09c890 2023-09-30T22:24:32.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.650+0000 7f0f4291a700 1 -- 172.21.15.40:0/1438328786 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f3c062380 con 0x7f0f3c09c890 2023-09-30T22:24:32.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.655+0000 7f0f38ff9700 1 -- 172.21.15.40:0/1438328786 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f2c017070 con 0x7f0f3c09c890 2023-09-30T22:24:32.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.888+0000 7f0f4291a700 1 -- 172.21.15.40:0/1438328786 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f3c072430 con 0x7f0f3c09c890 2023-09-30T22:24:32.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.888+0000 7f0f38ff9700 1 -- 172.21.15.40:0/1438328786 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2315 (secure 0 0 0) 0x7f0f2c019b40 con 0x7f0f3c09c890 2023-09-30T22:24:32.889 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:24:32.889 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:22:02.347538+0000","modified":"2023-09-30T22:22:28.878876+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4194},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4194":{"gid":4194,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6817/2392027806","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6817","nonce":2392027806}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-30T22:24:32.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.890+0000 7f0f4291a700 1 -- 172.21.15.40:0/1438328786 >> v1:172.21.15.40:6816/127432 conn(0x7f0f2802f510 legacy=0x7f0f280319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.890+0000 7f0f4291a700 1 -- 172.21.15.40:0/1438328786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0f3c09c890 msgr2=0x7f0f3c09b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.890+0000 7f0f4291a700 1 --2- 172.21.15.40:0/1438328786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0f3c09c890 0x7f0f3c09b7f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c00c700 tx=0x7f0f2c00ca10 comp rx=0 tx=0).stop 2023-09-30T22:24:32.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.890+0000 7f0f4291a700 1 -- 172.21.15.40:0/1438328786 shutdown_connections 2023-09-30T22:24:32.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.890+0000 7f0f4291a700 1 --2- 172.21.15.40:0/1438328786 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0f3c139510 0x7f0f3c06f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.890+0000 7f0f4291a700 1 --2- 172.21.15.40:0/1438328786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0f3c09c890 0x7f0f3c09b7f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.890+0000 7f0f4291a700 1 --2- 172.21.15.40:0/1438328786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f3c136bf0 0x7f0f3c09bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.890+0000 7f0f4291a700 1 -- 172.21.15.40:0/1438328786 >> 172.21.15.40:0/1438328786 conn(0x7f0f3c0a7080 msgr2=0x7f0f3c1349d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:32.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.890+0000 7f0f4291a700 1 -- 172.21.15.40:0/1438328786 shutdown_connections 2023-09-30T22:24:32.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:32.890+0000 7f0f4291a700 1 -- 172.21.15.40:0/1438328786 wait complete. 2023-09-30T22:24:32.892 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2023-09-30T22:24:32.903 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:24:33.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.027+0000 7f5d52727700 1 Processor -- start 2023-09-30T22:24:33.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.027+0000 7f5d52727700 1 -- start start 2023-09-30T22:24:33.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.028+0000 7f5d52727700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5d4c09d920 0x7f5d4c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.028+0000 7f5d52727700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d4c09e230 0x7f5d4c1308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.028+0000 7f5d52727700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d4c130de0 0x7f5d4c131240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.028+0000 7f5d52727700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d4c09edf0 con 0x7f5d4c09d920 2023-09-30T22:24:33.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.028+0000 7f5d52727700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c09adf0 con 0x7f5d4c09e230 2023-09-30T22:24:33.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.028+0000 7f5d52727700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c09b660 con 0x7f5d4c130de0 2023-09-30T22:24:33.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.028+0000 7f5d4bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5d4c09d920 0x7f5d4c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.028+0000 7f5d4b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d4c09e230 0x7f5d4c1308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.028+0000 7f5d50cc4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d4c130de0 0x7f5d4c131240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.028+0000 7f5d4b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d4c09e230 0x7f5d4c1308a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52258/0 (socket says 172.21.15.40:52258) 2023-09-30T22:24:33.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.028+0000 7f5d4b7fe700 1 -- 172.21.15.40:0/219053501 learned_addr learned my addr 172.21.15.40:0/219053501 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:33.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.028+0000 7f5d4bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5d4c09d920 0x7f5d4c09dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46620/0 (socket says 172.21.15.40:46620) 2023-09-30T22:24:33.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.028+0000 7f5d50cc4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d4c130de0 0x7f5d4c131240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33418/0 (socket says 172.21.15.40:33418) 2023-09-30T22:24:33.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.028+0000 7f5d4b7fe700 1 -- 172.21.15.40:0/219053501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d4c130de0 msgr2=0x7f5d4c131240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:33.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.028+0000 7f5d4b7fe700 1 --2- 172.21.15.40:0/219053501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d4c130de0 0x7f5d4c131240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.028+0000 7f5d4b7fe700 1 -- 172.21.15.40:0/219053501 >> v2:172.21.15.40:3300/0 conn(0x7f5d4c09d920 msgr2=0x7f5d4c09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:33.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.028+0000 7f5d4b7fe700 1 --2- 172.21.15.40:0/219053501 >> v2:172.21.15.40:3300/0 conn(0x7f5d4c09d920 0x7f5d4c09dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.028+0000 7f5d4b7fe700 1 -- 172.21.15.40:0/219053501 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4c09a6e0 con 0x7f5d4c09e230 2023-09-30T22:24:33.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.028+0000 7f5d50cc4700 1 --2- 172.21.15.40:0/219053501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d4c130de0 0x7f5d4c131240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:33.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.028+0000 7f5d4bfff700 1 --2- 172.21.15.40:0/219053501 >> v2:172.21.15.40:3300/0 conn(0x7f5d4c09d920 0x7f5d4c09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:33.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.028+0000 7f5d4b7fe700 1 --2- 172.21.15.40:0/219053501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d4c09e230 0x7f5d4c1308a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5d340098f0 tx=0x7f5d34009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a5540f4fce3eb8c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:33.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.029+0000 7f5d4affd700 1 -- 172.21.15.40:0/219053501 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d34011830 con 0x7f5d4c09e230 2023-09-30T22:24:33.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.029+0000 7f5d4affd700 1 -- 172.21.15.40:0/219053501 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d34011990 con 0x7f5d4c09e230 2023-09-30T22:24:33.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.029+0000 7f5d4affd700 1 -- 172.21.15.40:0/219053501 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d34011d20 con 0x7f5d4c09e230 2023-09-30T22:24:33.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.029+0000 7f5d52727700 1 -- 172.21.15.40:0/219053501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d4c09e230 msgr2=0x7f5d4c1308a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.029+0000 7f5d52727700 1 --2- 172.21.15.40:0/219053501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d4c09e230 0x7f5d4c1308a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5d340098f0 tx=0x7f5d34009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:33.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.029+0000 7f5d52727700 1 -- 172.21.15.40:0/219053501 shutdown_connections 2023-09-30T22:24:33.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.029+0000 7f5d52727700 1 --2- 172.21.15.40:0/219053501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d4c130de0 0x7f5d4c131240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.029+0000 7f5d52727700 1 --2- 172.21.15.40:0/219053501 >> v2:172.21.15.40:3300/0 conn(0x7f5d4c09d920 0x7f5d4c09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.029+0000 7f5d52727700 1 --2- 172.21.15.40:0/219053501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d4c09e230 0x7f5d4c1308a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.029+0000 7f5d52727700 1 -- 172.21.15.40:0/219053501 >> 172.21.15.40:0/219053501 conn(0x7f5d4c09fb20 msgr2=0x7f5d4c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:33.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.029+0000 7f5d52727700 1 -- 172.21.15.40:0/219053501 shutdown_connections 2023-09-30T22:24:33.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.029+0000 7f5d52727700 1 -- 172.21.15.40:0/219053501 wait complete. 2023-09-30T22:24:33.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.030+0000 7f5d52727700 1 Processor -- start 2023-09-30T22:24:33.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.030+0000 7f5d52727700 1 -- start start 2023-09-30T22:24:33.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.031+0000 7f5d52727700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d4c09d920 0x7f5d4c06df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.031+0000 7f5d52727700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d4c09e230 0x7f5d4c06e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.031+0000 7f5d52727700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d4c130de0 0x7f5d4c06ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.031+0000 7f5d52727700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c124c00 con 0x7f5d4c09e230 2023-09-30T22:24:33.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.031+0000 7f5d52727700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c1238a0 con 0x7f5d4c130de0 2023-09-30T22:24:33.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.031+0000 7f5d52727700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c130920 con 0x7f5d4c09d920 2023-09-30T22:24:33.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.031+0000 7f5d4b7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d4c09e230 0x7f5d4c06e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.031+0000 7f5d4b7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d4c09e230 0x7f5d4c06e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46636/0 (socket says 172.21.15.40:46636) 2023-09-30T22:24:33.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.031+0000 7f5d4b7fe700 1 -- 172.21.15.40:0/1433280207 learned_addr learned my addr 172.21.15.40:0/1433280207 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:33.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.031+0000 7f5d50cc4700 1 --2- 172.21.15.40:0/1433280207 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d4c130de0 0x7f5d4c06ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.031+0000 7f5d4bfff700 1 --2- 172.21.15.40:0/1433280207 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d4c09d920 0x7f5d4c06df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.031+0000 7f5d4b7fe700 1 -- 172.21.15.40:0/1433280207 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d4c09d920 msgr2=0x7f5d4c06df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.031+0000 7f5d4b7fe700 1 --2- 172.21.15.40:0/1433280207 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d4c09d920 0x7f5d4c06df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.031+0000 7f5d4b7fe700 1 -- 172.21.15.40:0/1433280207 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d4c130de0 msgr2=0x7f5d4c06ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.031+0000 7f5d4b7fe700 1 --2- 172.21.15.40:0/1433280207 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d4c130de0 0x7f5d4c06ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.031+0000 7f5d4b7fe700 1 -- 172.21.15.40:0/1433280207 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d3c009430 con 0x7f5d4c09e230 2023-09-30T22:24:33.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.031+0000 7f5d4b7fe700 1 --2- 172.21.15.40:0/1433280207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d4c09e230 0x7f5d4c06e4c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5d34000c00 tx=0x7f5d34004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:33.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.032+0000 7f5d48ff9700 1 -- 172.21.15.40:0/1433280207 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d34004240 con 0x7f5d4c09e230 2023-09-30T22:24:33.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.032+0000 7f5d48ff9700 1 -- 172.21.15.40:0/1433280207 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3401f070 con 0x7f5d4c09e230 2023-09-30T22:24:33.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.032+0000 7f5d52727700 1 -- 172.21.15.40:0/1433280207 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d44009a70 con 0x7f5d4c09e230 2023-09-30T22:24:33.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.032+0000 7f5d48ff9700 1 -- 172.21.15.40:0/1433280207 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d340045c0 con 0x7f5d4c09e230 2023-09-30T22:24:33.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.032+0000 7f5d52727700 1 -- 172.21.15.40:0/1433280207 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d34009550 con 0x7f5d4c09e230 2023-09-30T22:24:33.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.032+0000 7f5d48ff9700 1 -- 172.21.15.40:0/1433280207 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5d34021030 con 0x7f5d4c09e230 2023-09-30T22:24:33.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.032+0000 7f5d48ff9700 1 -- 172.21.15.40:0/1433280207 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4094+0+0 (secure 0 0 0) 0x7f5d34040e10 con 0x7f5d4c09e230 2023-09-30T22:24:33.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.033+0000 7f5d52727700 1 -- 172.21.15.40:0/1433280207 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d4c062380 con 0x7f5d4c09e230 2023-09-30T22:24:33.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.037+0000 7f5d48ff9700 1 -- 172.21.15.40:0/1433280207 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5d3406c750 con 0x7f5d4c09e230 2023-09-30T22:24:33.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.234+0000 7f5d52727700 1 -- 172.21.15.40:0/1433280207 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d4c074720 con 0x7f5d4c09e230 2023-09-30T22:24:33.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.235+0000 7f5d48ff9700 1 -- 172.21.15.40:0/1433280207 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+12993 (secure 0 0 0) 0x7f5d34015020 con 0x7f5d4c09e230 2023-09-30T22:24:33.236 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:24:33.236 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"fsid":"79dd4d8e-f295-4d9c-bd93-9850863800e3","created":"2023-09-30T22:21:46.980357+0000","modified":"2023-09-30T22:24:26.129783+0000","last_up_change":"2023-09-30T22:21:54.822866+0000","last_in_change":"2023-09-30T22:21:48.205613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:21:54.875024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:21:56.197012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:22:00.759069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:22:01.327265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"771f785c-f464-4b17-936c-cbf31b1153e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6812","nonce":119451}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6813","nonce":119451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6815","nonce":119451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6814","nonce":119451}]},"public_addr":"172.21.15.40:6812/119451","cluster_addr":"172.21.15.40:6813/119451","heartbeat_back_addr":"172.21.15.40:6815/119451","heartbeat_front_addr":"172.21.15.40:6814/119451","state":["exists","up"]},{"osd":1,"uuid":"45f1e2e8-5310-4219-ab54-424e7440fcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6808","nonce":119436}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6809","nonce":119436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6811","nonce":119436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6810","nonce":119436}]},"public_addr":"172.21.15.40:6808/119436","cluster_addr":"172.21.15.40:6809/119436","heartbeat_back_addr":"172.21.15.40:6811/119436","heartbeat_front_addr":"172.21.15.40:6810/119436","state":["exists","up"]},{"osd":2,"uuid":"7ba62ae5-d21e-4d56-b46c-ba7b718ede25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6800","nonce":119433}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6801","nonce":119433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6803","nonce":119433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6802","nonce":119433}]},"public_addr":"172.21.15.40:6800/119433","cluster_addr":"172.21.15.40:6801/119433","heartbeat_back_addr":"172.21.15.40:6803/119433","heartbeat_front_addr":"172.21.15.40:6802/119433","state":["exists","up"]},{"osd":3,"uuid":"c9c55985-8a90-4927-a8fa-6a1fcec1cd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6804","nonce":119432}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6805","nonce":119432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6807","nonce":119432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6806","nonce":119432}]},"public_addr":"172.21.15.40:6804/119432","cluster_addr":"172.21.15.40:6805/119432","heartbeat_back_addr":"172.21.15.40:6807/119432","heartbeat_front_addr":"172.21.15.40:6806/119432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.339829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.554690+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.641664+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.320635+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2},{"from":1,"to":0}]},{"pgid":"4.1","mappings":[{"from":3,"to":0}]},{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.12","mappings":[{"from":3,"to":0}]},{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":3,"to":2},{"from":1,"to":0}]},{"pgid":"4.2c","mappings":[{"from":1,"to":2}]},{"pgid":"4.3f","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:0/1890660785":"2023-10-01T22:24:24.127340+0000","172.21.15.40:0/1764460125":"2023-10-01T22:24:24.127340+0000","172.21.15.40:6816/118905":"2023-10-01T22:24:24.127340+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:24:33.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.237+0000 7f5d52727700 1 -- 172.21.15.40:0/1433280207 >> v1:172.21.15.40:6816/127432 conn(0x7f5d2c02f510 legacy=0x7f5d2c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.237+0000 7f5d52727700 1 -- 172.21.15.40:0/1433280207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d4c09e230 msgr2=0x7f5d4c06e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.237+0000 7f5d52727700 1 --2- 172.21.15.40:0/1433280207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d4c09e230 0x7f5d4c06e4c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5d34000c00 tx=0x7f5d34004750 comp rx=0 tx=0).stop 2023-09-30T22:24:33.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.237+0000 7f5d52727700 1 -- 172.21.15.40:0/1433280207 shutdown_connections 2023-09-30T22:24:33.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.237+0000 7f5d52727700 1 --2- 172.21.15.40:0/1433280207 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d4c09d920 0x7f5d4c06df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.237+0000 7f5d52727700 1 --2- 172.21.15.40:0/1433280207 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d4c130de0 0x7f5d4c06ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.237+0000 7f5d52727700 1 --2- 172.21.15.40:0/1433280207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d4c09e230 0x7f5d4c06e4c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.237+0000 7f5d52727700 1 -- 172.21.15.40:0/1433280207 >> 172.21.15.40:0/1433280207 conn(0x7f5d4c09fb20 msgr2=0x7f5d4c06a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:33.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.237+0000 7f5d52727700 1 -- 172.21.15.40:0/1433280207 shutdown_connections 2023-09-30T22:24:33.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.237+0000 7f5d52727700 1 -- 172.21.15.40:0/1433280207 wait complete. 2023-09-30T22:24:33.250 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:24:33.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.374+0000 7f5573397700 1 Processor -- start 2023-09-30T22:24:33.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.375+0000 7f5573397700 1 -- start start 2023-09-30T22:24:33.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.375+0000 7f5573397700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f556c09d920 0x7f556c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.375+0000 7f5573397700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f556c130fb0 0x7f556c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.375+0000 7f5573397700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f556c09adf0 con 0x7f556c09e230 2023-09-30T22:24:33.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.375+0000 7f5573397700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556c09edf0 con 0x7f556c130fb0 2023-09-30T22:24:33.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.375+0000 7f5573397700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f556c09b660 con 0x7f556c09d920 2023-09-30T22:24:33.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.375+0000 7f5571133700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f556c09d920 0x7f556c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.375+0000 7f5570932700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f556c09e230 0x7f556c1308a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39054/0 (socket says 172.21.15.40:39054) 2023-09-30T22:24:33.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.375+0000 7f5571133700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f556c09d920 0x7f556c09dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48596/0 (socket says 172.21.15.40:48596) 2023-09-30T22:24:33.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.375+0000 7f5571934700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f556c130fb0 0x7f556c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.375+0000 7f5570932700 1 -- 172.21.15.40:0/101615895 learned_addr learned my addr 172.21.15.40:0/101615895 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:24:33.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.376+0000 7f5571934700 1 -- 172.21.15.40:0/101615895 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f556c09d920 msgr2=0x7f556c09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:33.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.376+0000 7f5563fff700 1 -- 172.21.15.40:0/101615895 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 759947613 0 0) 0x7f556c09adf0 con 0x7f556c09e230 2023-09-30T22:24:33.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.376+0000 7f5571934700 1 --2- 172.21.15.40:0/101615895 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f556c09d920 0x7f556c09dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.376+0000 7f5571934700 1 -- 172.21.15.40:0/101615895 >> v1:172.21.15.40:6789/0 conn(0x7f556c09e230 legacy=0x7f556c1308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.376+0000 7f5571934700 1 -- 172.21.15.40:0/101615895 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f556c09a6e0 con 0x7f556c130fb0 2023-09-30T22:24:33.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.376+0000 7f5571133700 1 --2- 172.21.15.40:0/101615895 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f556c09d920 0x7f556c09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:33.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.376+0000 7f5571934700 1 --2- 172.21.15.40:0/101615895 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f556c130fb0 0x7f556c138d10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5564009dc0 tx=0x7f556400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ffc45545666aa63 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:33.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.376+0000 7f5563fff700 1 -- 172.21.15.40:0/101615895 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556400bd20 con 0x7f556c130fb0 2023-09-30T22:24:33.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.376+0000 7f5563fff700 1 -- 172.21.15.40:0/101615895 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f556400be80 con 0x7f556c130fb0 2023-09-30T22:24:33.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.376+0000 7f5563fff700 1 -- 172.21.15.40:0/101615895 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55640116a0 con 0x7f556c130fb0 2023-09-30T22:24:33.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.377+0000 7f5573397700 1 -- 172.21.15.40:0/101615895 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f556c130fb0 msgr2=0x7f556c138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.377+0000 7f5573397700 1 --2- 172.21.15.40:0/101615895 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f556c130fb0 0x7f556c138d10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5564009dc0 tx=0x7f556400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:33.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.377+0000 7f5573397700 1 -- 172.21.15.40:0/101615895 shutdown_connections 2023-09-30T22:24:33.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.377+0000 7f5573397700 1 --2- 172.21.15.40:0/101615895 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f556c130fb0 0x7f556c138d10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.377+0000 7f5573397700 1 --2- 172.21.15.40:0/101615895 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f556c09d920 0x7f556c09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.377+0000 7f5573397700 1 -- 172.21.15.40:0/101615895 >> 172.21.15.40:0/101615895 conn(0x7f556c09fb20 msgr2=0x7f556c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:33.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.377+0000 7f5573397700 1 -- 172.21.15.40:0/101615895 shutdown_connections 2023-09-30T22:24:33.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.377+0000 7f5573397700 1 -- 172.21.15.40:0/101615895 wait complete. 2023-09-30T22:24:33.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.378+0000 7f5573397700 1 Processor -- start 2023-09-30T22:24:33.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.378+0000 7f5573397700 1 -- start start 2023-09-30T22:24:33.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.378+0000 7f5573397700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f556c09d920 0x7f556c121820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.378+0000 7f5573397700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f556c09e230 0x7f556c121d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.378+0000 7f5573397700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f556c130fb0 0x7f556c1222a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.378+0000 7f5573397700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556c1234d0 con 0x7f556c130fb0 2023-09-30T22:24:33.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.378+0000 7f5573397700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556c0711a0 con 0x7f556c09e230 2023-09-30T22:24:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.378+0000 7f5573397700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f556c09cb00 con 0x7f556c09d920 2023-09-30T22:24:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.378+0000 7f5571133700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f556c09d920 0x7f556c121820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.378+0000 7f5570932700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f556c09e230 0x7f556c121d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.378+0000 7f5571934700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f556c130fb0 0x7f556c1222a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.378+0000 7f5571133700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f556c09d920 0x7f556c121820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48602/0 (socket says 172.21.15.40:48602) 2023-09-30T22:24:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.378+0000 7f5571133700 1 -- 172.21.15.40:0/3227962463 learned_addr learned my addr 172.21.15.40:0/3227962463 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.378+0000 7f5570932700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f556c09e230 0x7f556c121d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60226/0 (socket says 172.21.15.40:60226) 2023-09-30T22:24:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.379+0000 7f5571133700 1 -- 172.21.15.40:0/3227962463 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f556c09e230 msgr2=0x7f556c121d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.379+0000 7f5571133700 1 --2- 172.21.15.40:0/3227962463 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f556c09e230 0x7f556c121d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.379+0000 7f5571133700 1 -- 172.21.15.40:0/3227962463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f556c130fb0 msgr2=0x7f556c1222a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.379+0000 7f5571133700 1 --2- 172.21.15.40:0/3227962463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f556c130fb0 0x7f556c1222a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.379+0000 7f5571133700 1 -- 172.21.15.40:0/3227962463 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f555c009430 con 0x7f556c09d920 2023-09-30T22:24:33.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.379+0000 7f5570932700 1 --2- 172.21.15.40:0/3227962463 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f556c09e230 0x7f556c121d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:33.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.379+0000 7f5571934700 1 --2- 172.21.15.40:0/3227962463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f556c130fb0 0x7f556c1222a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:33.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.379+0000 7f5571133700 1 --2- 172.21.15.40:0/3227962463 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f556c09d920 0x7f556c121820 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f555c00ebe0 tx=0x7f555c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:33.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.379+0000 7f5561ffb700 1 -- 172.21.15.40:0/3227962463 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c005a20 con 0x7f556c09d920 2023-09-30T22:24:33.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.379+0000 7f5561ffb700 1 -- 172.21.15.40:0/3227962463 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555c005b80 con 0x7f556c09d920 2023-09-30T22:24:33.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.379+0000 7f5573397700 1 -- 172.21.15.40:0/3227962463 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5564009a70 con 0x7f556c09d920 2023-09-30T22:24:33.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.379+0000 7f5561ffb700 1 -- 172.21.15.40:0/3227962463 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c00c850 con 0x7f556c09d920 2023-09-30T22:24:33.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.379+0000 7f5573397700 1 -- 172.21.15.40:0/3227962463 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f556c123bb0 con 0x7f556c09d920 2023-09-30T22:24:33.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.380+0000 7f5561ffb700 1 -- 172.21.15.40:0/3227962463 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f555c00c9b0 con 0x7f556c09d920 2023-09-30T22:24:33.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.380+0000 7f5561ffb700 1 -- 172.21.15.40:0/3227962463 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4094+0+0 (secure 0 0 0) 0x7f555c03fdf0 con 0x7f556c09d920 2023-09-30T22:24:33.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.380+0000 7f5573397700 1 -- 172.21.15.40:0/3227962463 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f556c062380 con 0x7f556c09d920 2023-09-30T22:24:33.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.385+0000 7f5561ffb700 1 -- 172.21.15.40:0/3227962463 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f555c020020 con 0x7f556c09d920 2023-09-30T22:24:33.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.619+0000 7f5573397700 1 -- 172.21.15.40:0/3227962463 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f556c070f80 con 0x7f556c09d920 2023-09-30T22:24:33.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.619+0000 7f5561ffb700 1 -- 172.21.15.40:0/3227962463 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2315 (secure 0 0 0) 0x7f555c022300 con 0x7f556c09d920 2023-09-30T22:24:33.620 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:24:33.620 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:22:02.347538+0000","modified":"2023-09-30T22:22:28.878876+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4194},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4194":{"gid":4194,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6817/2392027806","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6817","nonce":2392027806}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-30T22:24:33.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.622+0000 7f5573397700 1 -- 172.21.15.40:0/3227962463 >> v1:172.21.15.40:6816/127432 conn(0x7f555002f510 legacy=0x7f55500319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.622+0000 7f5573397700 1 -- 172.21.15.40:0/3227962463 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f556c09d920 msgr2=0x7f556c121820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.622+0000 7f5573397700 1 --2- 172.21.15.40:0/3227962463 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f556c09d920 0x7f556c121820 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f555c00ebe0 tx=0x7f555c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.622+0000 7f5573397700 1 -- 172.21.15.40:0/3227962463 shutdown_connections 2023-09-30T22:24:33.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.622+0000 7f5573397700 1 --2- 172.21.15.40:0/3227962463 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f556c09d920 0x7f556c121820 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.622+0000 7f5573397700 1 --2- 172.21.15.40:0/3227962463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f556c130fb0 0x7f556c1222a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.622+0000 7f5573397700 1 --2- 172.21.15.40:0/3227962463 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f556c09e230 0x7f556c121d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.622+0000 7f5573397700 1 -- 172.21.15.40:0/3227962463 >> 172.21.15.40:0/3227962463 conn(0x7f556c09fb20 msgr2=0x7f556c12fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:33.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.622+0000 7f5573397700 1 -- 172.21.15.40:0/3227962463 shutdown_connections 2023-09-30T22:24:33.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.622+0000 7f5573397700 1 -- 172.21.15.40:0/3227962463 wait complete. 2023-09-30T22:24:33.624 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2023-09-30T22:24:33.735 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-30T22:22:02.347538+0000', 'modified': '2023-09-30T22:22:28.878876+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4194}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4194': {'gid': 4194, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.40:6817/2392027806', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.40:6817', 'nonce': 2392027806}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-09-30T22:24:33.735 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-30T22:24:33.735 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-09-30T22:24:33.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.862+0000 7f4fe63e7700 1 Processor -- start 2023-09-30T22:24:33.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.862+0000 7f4fe63e7700 1 -- start start 2023-09-30T22:24:33.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.862+0000 7f4fe63e7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fe009d920 0x7f4fe009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.862+0000 7f4fe63e7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4fe009e230 0x7f4fe01308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.862+0000 7f4fe63e7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fe0130de0 0x7f4fe0131260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.862+0000 7f4fe63e7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fe009edf0 con 0x7f4fe009e230 2023-09-30T22:24:33.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.862+0000 7f4fe63e7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe009adf0 con 0x7f4fe009d920 2023-09-30T22:24:33.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.862+0000 7f4fe63e7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe009b660 con 0x7f4fe0130de0 2023-09-30T22:24:33.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.862+0000 7f4fdffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fe009d920 0x7f4fe009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.862+0000 7f4fdf7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4fe009e230 0x7f4fe01308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.862+0000 7f4fe4984700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fe0130de0 0x7f4fe0131260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.862+0000 7f4fe4984700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fe0130de0 0x7f4fe0131260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48604/0 (socket says 172.21.15.40:48604) 2023-09-30T22:24:33.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.862+0000 7f4fdf7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4fe009e230 0x7f4fe01308a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49918/0 (socket says 172.21.15.40:49918) 2023-09-30T22:24:33.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.862+0000 7f4fdffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fe009d920 0x7f4fe009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60236/0 (socket says 172.21.15.40:60236) 2023-09-30T22:24:33.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.862+0000 7f4fe4984700 1 -- 172.21.15.40:0/671722491 learned_addr learned my addr 172.21.15.40:0/671722491 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:33.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.863+0000 7f4fe4984700 1 -- 172.21.15.40:0/671722491 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fe009d920 msgr2=0x7f4fe009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:33.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.863+0000 7f4fe4984700 1 --2- 172.21.15.40:0/671722491 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fe009d920 0x7f4fe009dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.863+0000 7f4fe4984700 1 -- 172.21.15.40:0/671722491 >> v2:172.21.15.40:3300/0 conn(0x7f4fe009e230 msgr2=0x7f4fe01308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:33.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.863+0000 7f4fe4984700 1 --2- 172.21.15.40:0/671722491 >> v2:172.21.15.40:3300/0 conn(0x7f4fe009e230 0x7f4fe01308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.863+0000 7f4fe4984700 1 -- 172.21.15.40:0/671722491 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe009a6e0 con 0x7f4fe0130de0 2023-09-30T22:24:33.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.863+0000 7f4fdf7fe700 1 --2- 172.21.15.40:0/671722491 >> v2:172.21.15.40:3300/0 conn(0x7f4fe009e230 0x7f4fe01308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:33.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.863+0000 7f4fe4984700 1 --2- 172.21.15.40:0/671722491 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fe0130de0 0x7f4fe0131260 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8009e50 tx=0x7f4fd800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8023f0d3eea2269e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:33.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.863+0000 7f4fdeffd700 1 -- 172.21.15.40:0/671722491 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd800e070 con 0x7f4fe0130de0 2023-09-30T22:24:33.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.863+0000 7f4fdeffd700 1 -- 172.21.15.40:0/671722491 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd800b910 con 0x7f4fe0130de0 2023-09-30T22:24:33.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.863+0000 7f4fdeffd700 1 -- 172.21.15.40:0/671722491 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd800bcc0 con 0x7f4fe0130de0 2023-09-30T22:24:33.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.863+0000 7f4fe63e7700 1 -- 172.21.15.40:0/671722491 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fe0130de0 msgr2=0x7f4fe0131260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.863+0000 7f4fe63e7700 1 --2- 172.21.15.40:0/671722491 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fe0130de0 0x7f4fe0131260 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8009e50 tx=0x7f4fd800b330 comp rx=0 tx=0).stop 2023-09-30T22:24:33.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.864+0000 7f4fe63e7700 1 -- 172.21.15.40:0/671722491 shutdown_connections 2023-09-30T22:24:33.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.864+0000 7f4fe63e7700 1 --2- 172.21.15.40:0/671722491 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fe0130de0 0x7f4fe0131260 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.864+0000 7f4fe63e7700 1 --2- 172.21.15.40:0/671722491 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fe009d920 0x7f4fe009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.864+0000 7f4fe63e7700 1 --2- 172.21.15.40:0/671722491 >> v2:172.21.15.40:3300/0 conn(0x7f4fe009e230 0x7f4fe01308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.864+0000 7f4fe63e7700 1 -- 172.21.15.40:0/671722491 >> 172.21.15.40:0/671722491 conn(0x7f4fe009fb20 msgr2=0x7f4fe009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:33.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.864+0000 7f4fe63e7700 1 -- 172.21.15.40:0/671722491 shutdown_connections 2023-09-30T22:24:33.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.864+0000 7f4fe63e7700 1 -- 172.21.15.40:0/671722491 wait complete. 2023-09-30T22:24:33.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.864+0000 7f4fe63e7700 1 Processor -- start 2023-09-30T22:24:33.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.865+0000 7f4fe63e7700 1 -- start start 2023-09-30T22:24:33.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.865+0000 7f4fe63e7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fe009d920 0x7f4fe011eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.865+0000 7f4fe63e7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fe009e230 0x7f4fe011ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.865+0000 7f4fe63e7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fe0130de0 0x7f4fe011b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.865+0000 7f4fe63e7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe009cb00 con 0x7f4fe0130de0 2023-09-30T22:24:33.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.865+0000 7f4fe63e7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe011caa0 con 0x7f4fe009e230 2023-09-30T22:24:33.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.865+0000 7f4fe63e7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe006b4c0 con 0x7f4fe009d920 2023-09-30T22:24:33.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.865+0000 7f4fdffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fe009d920 0x7f4fe011eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.865+0000 7f4fdffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fe009d920 0x7f4fe011eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48616/0 (socket says 172.21.15.40:48616) 2023-09-30T22:24:33.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.865+0000 7f4fe4984700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fe0130de0 0x7f4fe011b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.865+0000 7f4fdffff700 1 -- 172.21.15.40:0/2961271245 learned_addr learned my addr 172.21.15.40:0/2961271245 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:33.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.865+0000 7f4fdf7fe700 1 --2- 172.21.15.40:0/2961271245 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fe009e230 0x7f4fe011ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.866+0000 7f4fdffff700 1 -- 172.21.15.40:0/2961271245 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fe009e230 msgr2=0x7f4fe011ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.866+0000 7f4fdffff700 1 --2- 172.21.15.40:0/2961271245 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fe009e230 0x7f4fe011ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.866+0000 7f4fdffff700 1 -- 172.21.15.40:0/2961271245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fe0130de0 msgr2=0x7f4fe011b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.866+0000 7f4fdffff700 1 --2- 172.21.15.40:0/2961271245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fe0130de0 0x7f4fe011b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.866+0000 7f4fdffff700 1 -- 172.21.15.40:0/2961271245 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd400b740 con 0x7f4fe009d920 2023-09-30T22:24:33.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.866+0000 7f4fe4984700 1 --2- 172.21.15.40:0/2961271245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fe0130de0 0x7f4fe011b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:33.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.866+0000 7f4fdffff700 1 --2- 172.21.15.40:0/2961271245 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fe009d920 0x7f4fe011eeb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4fd000e9e0 tx=0x7f4fd000ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:33.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.866+0000 7f4fdcff9700 1 -- 172.21.15.40:0/2961271245 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd0005a20 con 0x7f4fe009d920 2023-09-30T22:24:33.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.866+0000 7f4fdcff9700 1 -- 172.21.15.40:0/2961271245 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd0005b80 con 0x7f4fe009d920 2023-09-30T22:24:33.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.866+0000 7f4fe63e7700 1 -- 172.21.15.40:0/2961271245 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd8009b30 con 0x7f4fe009d920 2023-09-30T22:24:33.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.866+0000 7f4fdcff9700 1 -- 172.21.15.40:0/2961271245 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd000c640 con 0x7f4fe009d920 2023-09-30T22:24:33.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.866+0000 7f4fe63e7700 1 -- 172.21.15.40:0/2961271245 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fe011dcf0 con 0x7f4fe009d920 2023-09-30T22:24:33.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.867+0000 7f4fdcff9700 1 -- 172.21.15.40:0/2961271245 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4fd000c9b0 con 0x7f4fe009d920 2023-09-30T22:24:33.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.867+0000 7f4fdcff9700 1 -- 172.21.15.40:0/2961271245 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4094+0+0 (secure 0 0 0) 0x7f4fd003ff40 con 0x7f4fe009d920 2023-09-30T22:24:33.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.869+0000 7f4ff258ab80 1 Processor -- start 2023-09-30T22:24:33.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.869+0000 7f4ff258ab80 1 -- start start 2023-09-30T22:24:33.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.870+0000 7f4ff258ab80 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x558ff5b0cc50 0x558ff5b0d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.870+0000 7f4ff258ab80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ff5b29100 0x558ff5b0d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.870+0000 7f4ff258ab80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ff5b238f0 0x558ff5b23d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.870+0000 7f4ff258ab80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ff5a6fc60 con 0x558ff5b29100 2023-09-30T22:24:33.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.870+0000 7f4ff258ab80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ff5a6aa10 con 0x558ff5b238f0 2023-09-30T22:24:33.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.870+0000 7f4ff258ab80 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x558ff5a68210 con 0x558ff5b0cc50 2023-09-30T22:24:33.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.870+0000 7f4fdf7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ff5b29100 0x558ff5b0d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.870+0000 7f4fe4984700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ff5b238f0 0x558ff5b23d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.870+0000 7f4fdf7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ff5b29100 0x558ff5b0d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49944/0 (socket says 172.21.15.40:49944) 2023-09-30T22:24:33.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.870+0000 7f4fe4984700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ff5b238f0 0x558ff5b23d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60254/0 (socket says 172.21.15.40:60254) 2023-09-30T22:24:33.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.870+0000 7f4fdf7fe700 1 -- 172.21.15.40:0/3961925853 learned_addr learned my addr 172.21.15.40:0/3961925853 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:33.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.870+0000 7f4fdffff700 1 --2- 172.21.15.40:0/3961925853 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x558ff5b0cc50 0x558ff5b0d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.870+0000 7f4fdf7fe700 1 -- 172.21.15.40:0/3961925853 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x558ff5b0cc50 msgr2=0x558ff5b0d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:33.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.870+0000 7f4fdf7fe700 1 --2- 172.21.15.40:0/3961925853 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x558ff5b0cc50 0x558ff5b0d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.870+0000 7f4fdf7fe700 1 -- 172.21.15.40:0/3961925853 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ff5b238f0 msgr2=0x558ff5b23d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:33.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.870+0000 7f4fdf7fe700 1 --2- 172.21.15.40:0/3961925853 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ff5b238f0 0x558ff5b23d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.870+0000 7f4fdf7fe700 1 -- 172.21.15.40:0/3961925853 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ff5857790 con 0x558ff5b29100 2023-09-30T22:24:33.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.870+0000 7f4fe4984700 1 --2- 172.21.15.40:0/3961925853 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ff5b238f0 0x558ff5b23d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:33.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.870+0000 7f4fdf7fe700 1 --2- 172.21.15.40:0/3961925853 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ff5b29100 0x558ff5b0d560 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4011900 tx=0x7f4fd4011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=734a23514382a890 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:33.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.871+0000 7f4fc5ffb700 1 -- 172.21.15.40:0/3961925853 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd4010a90 con 0x558ff5b29100 2023-09-30T22:24:33.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.871+0000 7f4fc5ffb700 1 -- 172.21.15.40:0/3961925853 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd4017040 con 0x558ff5b29100 2023-09-30T22:24:33.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.871+0000 7f4fc5ffb700 1 -- 172.21.15.40:0/3961925853 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd4010df0 con 0x558ff5b29100 2023-09-30T22:24:33.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.871+0000 7f4ff258ab80 1 -- 172.21.15.40:0/3961925853 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ff5b29100 msgr2=0x558ff5b0d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.871+0000 7f4ff258ab80 1 --2- 172.21.15.40:0/3961925853 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ff5b29100 0x558ff5b0d560 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4011900 tx=0x7f4fd4011c10 comp rx=0 tx=0).stop 2023-09-30T22:24:33.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.871+0000 7f4ff258ab80 1 -- 172.21.15.40:0/3961925853 shutdown_connections 2023-09-30T22:24:33.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.871+0000 7f4ff258ab80 1 --2- 172.21.15.40:0/3961925853 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x558ff5b0cc50 0x558ff5b0d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.871+0000 7f4ff258ab80 1 --2- 172.21.15.40:0/3961925853 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ff5b238f0 0x558ff5b23d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.871+0000 7f4ff258ab80 1 --2- 172.21.15.40:0/3961925853 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ff5b29100 0x558ff5b0d560 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.871+0000 7f4ff258ab80 1 -- 172.21.15.40:0/3961925853 >> 172.21.15.40:0/3961925853 conn(0x558ff5b110f0 msgr2=0x558ff5b10690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:33.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.871+0000 7f4ff258ab80 1 -- 172.21.15.40:0/3961925853 shutdown_connections 2023-09-30T22:24:33.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.871+0000 7f4ff258ab80 1 -- 172.21.15.40:0/3961925853 wait complete. 2023-09-30T22:24:33.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.872+0000 7f4ff258ab80 1 -- start start 2023-09-30T22:24:33.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.872+0000 7f4ff258ab80 1 Processor -- start 2023-09-30T22:24:33.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.872+0000 7f4ff258ab80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ff5b0cc50 0x558ff5b32140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.872+0000 7f4ff258ab80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ff5b238f0 0x558ff5b32680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.872+0000 7f4ff258ab80 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x558ff5b29100 0x558ff5b32bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.872+0000 7f4ff258ab80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ff5a63b00 con 0x558ff5b0cc50 2023-09-30T22:24:33.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.872+0000 7f4ff258ab80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ff59ff770 con 0x558ff5b238f0 2023-09-30T22:24:33.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.872+0000 7f4ff258ab80 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x558ff5a226f0 con 0x558ff5b29100 2023-09-30T22:24:33.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.873+0000 7f4ff258ab80 10 client.0 _ll_register_callbacks cb 0x558ff586b5a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:24:33.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.873+0000 7f4fdffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ff5b0cc50 0x558ff5b32140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.873+0000 7f4fdffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ff5b0cc50 0x558ff5b32140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49948/0 (socket says 172.21.15.40:49948) 2023-09-30T22:24:33.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.873+0000 7f4fdffff700 1 -- 172.21.15.40:0/2914647081 learned_addr learned my addr 172.21.15.40:0/2914647081 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:33.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.873+0000 7f4fe4984700 1 --2- 172.21.15.40:0/2914647081 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x558ff5b29100 0x558ff5b32bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.873+0000 7f4fdf7fe700 1 --2- 172.21.15.40:0/2914647081 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ff5b238f0 0x558ff5b32680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.873+0000 7f4fdffff700 1 -- 172.21.15.40:0/2914647081 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x558ff5b29100 msgr2=0x558ff5b32bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:33.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.873+0000 7f4fdffff700 1 --2- 172.21.15.40:0/2914647081 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x558ff5b29100 0x558ff5b32bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.873+0000 7f4fdffff700 1 -- 172.21.15.40:0/2914647081 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ff5b238f0 msgr2=0x558ff5b32680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:33.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.873+0000 7f4fdffff700 1 --2- 172.21.15.40:0/2914647081 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ff5b238f0 0x558ff5b32680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.873+0000 7f4fdffff700 1 -- 172.21.15.40:0/2914647081 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fe009a6e0 con 0x558ff5b0cc50 2023-09-30T22:24:33.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.873+0000 7f4fdffff700 1 --2- 172.21.15.40:0/2914647081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ff5b0cc50 0x558ff5b32140 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4fd00228d0 tx=0x7f4fd0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd899e50f5ceaa25 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:33.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.873+0000 7f4fbeffd700 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-09-30T22:24:33.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.873+0000 7f4fbeffd700 1 -- 172.21.15.40:0/2914647081 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd003eb90 con 0x558ff5b0cc50 2023-09-30T22:24:33.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.873+0000 7f4fbeffd700 1 -- 172.21.15.40:0/2914647081 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 4094+0+0 (secure 0 0 0) 0x7f4fd003ecf0 con 0x558ff5b0cc50 2023-09-30T22:24:33.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.873+0000 7f4ff258ab80 1 -- 172.21.15.40:0/2914647081 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558ff5b052b0 con 0x558ff5b0cc50 2023-09-30T22:24:33.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.873+0000 7f4fbeffd700 1 -- 172.21.15.40:0/2914647081 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4fd0022940 con 0x558ff5b0cc50 2023-09-30T22:24:33.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.873+0000 7f4ff258ab80 10 client.14460 fetch_fsmap learned FSMap version 8 2023-09-30T22:24:33.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.873+0000 7f4ff258ab80 1 -- 172.21.15.40:0/2914647081 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=3+}) v3 -- 0x7f4fd40114d0 con 0x558ff5b0cc50 2023-09-30T22:24:33.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.873+0000 7f4fbeffd700 1 -- 172.21.15.40:0/2914647081 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558ff5b052b0 con 0x558ff5b0cc50 2023-09-30T22:24:33.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.873+0000 7f4fbeffd700 1 -- 172.21.15.40:0/2914647081 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 8) v1 ==== 1436+0+0 (secure 0 0 0) 0x7f4fd0022b20 con 0x558ff5b0cc50 2023-09-30T22:24:33.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.874+0000 7f4ff258ab80 10 client.14460 fetch_fsmap finished waiting for FSMap version 8 2023-09-30T22:24:33.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.874+0000 7f4ff258ab80 10 client.14460 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-30T22:24:33.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.874+0000 7f4ff258ab80 20 client.14460 populate_metadata read hostname 'smithi040' 2023-09-30T22:24:33.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.874+0000 7f4ff258ab80 4 client.14460 mds_command: new command op to 4194 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-30T22:24:33.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.874+0000 7f4ff258ab80 1 -- 172.21.15.40:0/2914647081 --> v1:172.21.15.40:6817/2392027806 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558ff5ae1f40 con 0x558ff5b23230 2023-09-30T22:24:33.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.874+0000 7f4fbeffd700 10 client.14460 ms_handle_connect on v1:172.21.15.40:6817/2392027806 2023-09-30T22:24:33.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.875+0000 7f4fbeffd700 1 -- 172.21.15.40:0/2914647081 <== mds.0 v1:172.21.15.40:6817/2392027806 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (unknown 0 0 3608088055) 0x558ff5ae1f40 con 0x558ff5b23230 2023-09-30T22:24:33.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.875+0000 7f4fbeffd700 10 client.14460 handle_command_reply: tid=0 2023-09-30T22:24:33.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.875+0000 7f4ff258ab80 1 client.14460 shutdown 2023-09-30T22:24:33.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.875+0000 7f4ff258ab80 1 -- 172.21.15.40:0/2914647081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ff5b0cc50 msgr2=0x558ff5b32140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.875+0000 7f4ff258ab80 1 --2- 172.21.15.40:0/2914647081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ff5b0cc50 0x558ff5b32140 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4fd00228d0 tx=0x7f4fd0004750 comp rx=0 tx=0).stop 2023-09-30T22:24:33.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.875+0000 7f4ff258ab80 1 -- 172.21.15.40:0/2914647081 shutdown_connections 2023-09-30T22:24:33.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.875+0000 7f4ff258ab80 1 --2- 172.21.15.40:0/2914647081 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x558ff5b29100 0x558ff5b32bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.875+0000 7f4ff258ab80 1 --2- 172.21.15.40:0/2914647081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ff5b0cc50 0x558ff5b32140 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.875+0000 7f4ff258ab80 1 --2- 172.21.15.40:0/2914647081 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ff5b238f0 0x558ff5b32680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.875+0000 7f4ff258ab80 1 -- 172.21.15.40:0/2914647081 >> 172.21.15.40:0/2914647081 conn(0x558ff5b110f0 msgr2=0x558ff5b0d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:33.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.875+0000 7f4fbeffd700 0 client.14460 ms_handle_reset on v1:172.21.15.40:6817/2392027806 2023-09-30T22:24:33.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.875+0000 7f4ff258ab80 1 -- 172.21.15.40:0/2914647081 shutdown_connections 2023-09-30T22:24:33.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.875+0000 7f4ff258ab80 1 -- 172.21.15.40:0/2914647081 wait complete. 2023-09-30T22:24:33.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.875+0000 7f4ff258ab80 20 client.14460 trim_cache size 0 max 16384 2023-09-30T22:24:33.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.892+0000 7f4ff258ab80 1 Processor -- start 2023-09-30T22:24:33.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.892+0000 7f4ff258ab80 1 -- start start 2023-09-30T22:24:33.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.892+0000 7f4ff258ab80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ff5b0cc50 0x558ff5b0f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.892+0000 7f4ff258ab80 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x558ff5b238f0 0x558ff5b0e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.892+0000 7f4ff258ab80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ff5b29100 0x558ff5b0e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.892+0000 7f4ff258ab80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ff5858390 con 0x558ff5b29100 2023-09-30T22:24:33.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.892+0000 7f4ff258ab80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ff5b294d0 con 0x558ff5b0cc50 2023-09-30T22:24:33.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.892+0000 7f4ff258ab80 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x558ff5b2de00 con 0x558ff5b238f0 2023-09-30T22:24:33.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.892+0000 7f4fdf7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x558ff5b238f0 0x558ff5b0e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.892+0000 7f4fdffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ff5b0cc50 0x558ff5b0f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.892+0000 7f4fe4984700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ff5b29100 0x558ff5b0e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.892+0000 7f4fdf7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x558ff5b238f0 0x558ff5b0e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48642/0 (socket says 172.21.15.40:48642) 2023-09-30T22:24:33.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.892+0000 7f4fdffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ff5b0cc50 0x558ff5b0f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60282/0 (socket says 172.21.15.40:60282) 2023-09-30T22:24:33.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.892+0000 7f4fdf7fe700 1 -- 172.21.15.40:0/3557423161 learned_addr learned my addr 172.21.15.40:0/3557423161 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:33.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.893+0000 7f4fdf7fe700 1 -- 172.21.15.40:0/3557423161 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ff5b0cc50 msgr2=0x558ff5b0f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:33.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.893+0000 7f4fdf7fe700 1 --2- 172.21.15.40:0/3557423161 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ff5b0cc50 0x558ff5b0f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.893+0000 7f4fdf7fe700 1 -- 172.21.15.40:0/3557423161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ff5b29100 msgr2=0x558ff5b0e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:33.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.893+0000 7f4fdf7fe700 1 --2- 172.21.15.40:0/3557423161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ff5b29100 0x558ff5b0e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.893+0000 7f4fdf7fe700 1 -- 172.21.15.40:0/3557423161 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ff59440a0 con 0x558ff5b238f0 2023-09-30T22:24:33.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.893+0000 7f4fdffff700 1 --2- 172.21.15.40:0/3557423161 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ff5b0cc50 0x558ff5b0f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:33.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.893+0000 7f4fdf7fe700 1 --2- 172.21.15.40:0/3557423161 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x558ff5b238f0 0x558ff5b0e000 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4fd400b2c0 tx=0x7f4fd4013070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97f08404ff171fd7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:33.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.893+0000 7f4fc67fc700 1 -- 172.21.15.40:0/3557423161 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd4010a90 con 0x558ff5b238f0 2023-09-30T22:24:33.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.893+0000 7f4fc67fc700 1 -- 172.21.15.40:0/3557423161 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd4010bf0 con 0x558ff5b238f0 2023-09-30T22:24:33.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.893+0000 7f4fc67fc700 1 -- 172.21.15.40:0/3557423161 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd40295c0 con 0x558ff5b238f0 2023-09-30T22:24:33.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.893+0000 7f4ff258ab80 1 -- 172.21.15.40:0/3557423161 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x558ff5b238f0 msgr2=0x558ff5b0e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.893+0000 7f4ff258ab80 1 --2- 172.21.15.40:0/3557423161 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x558ff5b238f0 0x558ff5b0e000 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4fd400b2c0 tx=0x7f4fd4013070 comp rx=0 tx=0).stop 2023-09-30T22:24:33.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.893+0000 7f4ff258ab80 1 -- 172.21.15.40:0/3557423161 shutdown_connections 2023-09-30T22:24:33.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.893+0000 7f4ff258ab80 1 --2- 172.21.15.40:0/3557423161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ff5b29100 0x558ff5b0e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.893+0000 7f4ff258ab80 1 --2- 172.21.15.40:0/3557423161 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ff5b0cc50 0x558ff5b0f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.893+0000 7f4ff258ab80 1 --2- 172.21.15.40:0/3557423161 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x558ff5b238f0 0x558ff5b0e000 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.893+0000 7f4ff258ab80 1 -- 172.21.15.40:0/3557423161 >> 172.21.15.40:0/3557423161 conn(0x558ff5b110f0 msgr2=0x558ff5b2c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:33.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.894+0000 7f4ff258ab80 1 -- 172.21.15.40:0/3557423161 shutdown_connections 2023-09-30T22:24:33.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.894+0000 7f4ff258ab80 1 -- 172.21.15.40:0/3557423161 wait complete. 2023-09-30T22:24:33.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.894+0000 7f4ff258ab80 1 -- start start 2023-09-30T22:24:33.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.894+0000 7f4ff258ab80 1 Processor -- start 2023-09-30T22:24:33.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.895+0000 7f4ff258ab80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ff5b0cc50 0x558ff5b4cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.895+0000 7f4ff258ab80 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x558ff5b238f0 0x558ff5b4d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.895+0000 7f4ff258ab80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ff5b29100 0x558ff5b4d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.895+0000 7f4ff258ab80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ff5b22510 con 0x558ff5b29100 2023-09-30T22:24:33.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.895+0000 7f4ff258ab80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ff5b324a0 con 0x558ff5b0cc50 2023-09-30T22:24:33.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.895+0000 7f4ff258ab80 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x558ff5b23540 con 0x558ff5b238f0 2023-09-30T22:24:33.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.895+0000 7f4ff258ab80 10 client.0 _ll_register_callbacks cb 0x7f4fd00227c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:24:33.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.895+0000 7f4fdffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ff5b0cc50 0x558ff5b4cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.895+0000 7f4fe4984700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ff5b29100 0x558ff5b4d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.895+0000 7f4fdffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ff5b0cc50 0x558ff5b4cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60296/0 (socket says 172.21.15.40:60296) 2023-09-30T22:24:33.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.895+0000 7f4fdffff700 1 -- 172.21.15.40:0/3568674175 learned_addr learned my addr 172.21.15.40:0/3568674175 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:33.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.895+0000 7f4fe4984700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ff5b29100 0x558ff5b4d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49966/0 (socket says 172.21.15.40:49966) 2023-09-30T22:24:33.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.895+0000 7f4fdf7fe700 1 --2- 172.21.15.40:0/3568674175 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x558ff5b238f0 0x558ff5b4d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.895+0000 7f4fdffff700 1 -- 172.21.15.40:0/3568674175 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x558ff5b238f0 msgr2=0x558ff5b4d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:33.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.895+0000 7f4fdffff700 1 --2- 172.21.15.40:0/3568674175 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x558ff5b238f0 0x558ff5b4d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.895+0000 7f4fdffff700 1 -- 172.21.15.40:0/3568674175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ff5b29100 msgr2=0x558ff5b4d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:33.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.895+0000 7f4fdffff700 1 --2- 172.21.15.40:0/3568674175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ff5b29100 0x558ff5b4d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.895+0000 7f4fdffff700 1 -- 172.21.15.40:0/3568674175 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd40114d0 con 0x558ff5b0cc50 2023-09-30T22:24:33.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.895+0000 7f4fdffff700 1 --2- 172.21.15.40:0/3568674175 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ff5b0cc50 0x558ff5b4cad0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4fd00223e0 tx=0x7f4fd000cf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2612dd6e28c3f626 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:33.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.895+0000 7f4fbeffd700 10 client.0 ms_handle_connect on v2:172.21.15.40:3301/0 2023-09-30T22:24:33.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.895+0000 7f4fbeffd700 1 -- 172.21.15.40:0/3568674175 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd0033040 con 0x558ff5b0cc50 2023-09-30T22:24:33.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.895+0000 7f4fbeffd700 1 -- 172.21.15.40:0/3568674175 <== mon.1 v2:172.21.15.40:3301/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 4094+0+0 (secure 0 0 0) 0x7f4fd0022940 con 0x558ff5b0cc50 2023-09-30T22:24:33.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.895+0000 7f4ff258ab80 1 -- 172.21.15.40:0/3568674175 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4fd4017040 con 0x558ff5b0cc50 2023-09-30T22:24:33.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.896+0000 7f4fbeffd700 1 -- 172.21.15.40:0/3568674175 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4fd0011ef0 con 0x558ff5b0cc50 2023-09-30T22:24:33.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.896+0000 7f4ff258ab80 10 client.14386 fetch_fsmap learned FSMap version 8 2023-09-30T22:24:33.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.896+0000 7f4ff258ab80 1 -- 172.21.15.40:0/3568674175 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,fsmap=8,monmap=3+}) v3 -- 0x558ff5857790 con 0x558ff5b0cc50 2023-09-30T22:24:33.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.896+0000 7f4fbeffd700 1 -- 172.21.15.40:0/3568674175 <== mon.1 v2:172.21.15.40:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd4017040 con 0x558ff5b0cc50 2023-09-30T22:24:33.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.896+0000 7f4fbeffd700 1 -- 172.21.15.40:0/3568674175 <== mon.1 v2:172.21.15.40:3301/0 5 ==== fsmap(e 8) v1 ==== 1436+0+0 (secure 0 0 0) 0x7f4fd004e030 con 0x558ff5b0cc50 2023-09-30T22:24:33.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.896+0000 7f4ff258ab80 10 client.14386 fetch_fsmap finished waiting for FSMap version 8 2023-09-30T22:24:33.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.896+0000 7f4ff258ab80 10 client.14386 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-30T22:24:33.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.896+0000 7f4ff258ab80 20 client.14386 populate_metadata read hostname 'smithi040' 2023-09-30T22:24:33.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.896+0000 7f4ff258ab80 4 client.14386 mds_command: new command op to 4194 tid=0[{"prefix": "status"}] 2023-09-30T22:24:33.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.896+0000 7f4ff258ab80 1 -- 172.21.15.40:0/3568674175 --> v1:172.21.15.40:6817/2392027806 -- command(tid 0: {"prefix": "status"}) v1 -- 0x558ff5a5cce0 con 0x558ff5b98cc0 2023-09-30T22:24:33.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.896+0000 7f4fbeffd700 10 client.14386 ms_handle_connect on v1:172.21.15.40:6817/2392027806 2023-09-30T22:24:33.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.896+0000 7f4fbeffd700 1 -- 172.21.15.40:0/3568674175 <== mds.0 v1:172.21.15.40:6817/2392027806 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (unknown 0 0 13454203) 0x558ff5a5cce0 con 0x558ff5b98cc0 2023-09-30T22:24:33.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.896+0000 7f4fbeffd700 10 client.14386 handle_command_reply: tid=0 2023-09-30T22:24:33.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.896+0000 7f4ff258ab80 1 client.14386 shutdown 2023-09-30T22:24:33.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.897+0000 7f4ff258ab80 1 -- 172.21.15.40:0/3568674175 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ff5b0cc50 msgr2=0x558ff5b4cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.897+0000 7f4ff258ab80 1 --2- 172.21.15.40:0/3568674175 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ff5b0cc50 0x558ff5b4cad0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4fd00223e0 tx=0x7f4fd000cf70 comp rx=0 tx=0).stop 2023-09-30T22:24:33.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.897+0000 7f4ff258ab80 1 -- 172.21.15.40:0/3568674175 shutdown_connections 2023-09-30T22:24:33.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.897+0000 7f4ff258ab80 1 --2- 172.21.15.40:0/3568674175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x558ff5b29100 0x558ff5b4d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.897+0000 7f4ff258ab80 1 --2- 172.21.15.40:0/3568674175 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x558ff5b0cc50 0x558ff5b4cad0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.897+0000 7f4fbeffd700 0 client.14386 ms_handle_reset on v1:172.21.15.40:6817/2392027806 2023-09-30T22:24:33.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.897+0000 7f4ff258ab80 1 --2- 172.21.15.40:0/3568674175 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x558ff5b238f0 0x558ff5b4d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.897+0000 7f4ff258ab80 1 -- 172.21.15.40:0/3568674175 >> 172.21.15.40:0/3568674175 conn(0x558ff5b110f0 msgr2=0x558ff5b0b920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:33.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.897+0000 7f4ff258ab80 1 -- 172.21.15.40:0/3568674175 shutdown_connections 2023-09-30T22:24:33.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.897+0000 7f4ff258ab80 1 -- 172.21.15.40:0/3568674175 wait complete. 2023-09-30T22:24:33.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.897+0000 7f4ff258ab80 20 client.14386 trim_cache size 0 max 16384 2023-09-30T22:24:33.904 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-09-30T22:24:33.904 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "79dd4d8e-f295-4d9c-bd93-9850863800e3", 2023-09-30T22:24:33.904 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2023-09-30T22:24:33.904 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4194, 2023-09-30T22:24:33.904 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2023-09-30T22:24:33.904 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2023-09-30T22:24:33.905 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2023-09-30T22:24:33.905 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 151.54909567199999, 2023-09-30T22:24:33.905 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 8, 2023-09-30T22:24:33.905 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 25, 2023-09-30T22:24:33.905 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 18, 2023-09-30T22:24:33.905 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 155.95655561800001 2023-09-30T22:24:33.905 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-09-30T22:24:33.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.897+0000 7f4fe63e7700 1 -- 172.21.15.40:0/2961271245 >> v1:172.21.15.40:6816/127432 conn(0x7f4fcc02f510 legacy=0x7f4fcc0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.897+0000 7f4fe63e7700 1 -- 172.21.15.40:0/2961271245 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fe009d920 msgr2=0x7f4fe011eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.897+0000 7f4fe63e7700 1 --2- 172.21.15.40:0/2961271245 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fe009d920 0x7f4fe011eeb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4fd000e9e0 tx=0x7f4fd000ecf0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.897+0000 7f4fe63e7700 1 -- 172.21.15.40:0/2961271245 shutdown_connections 2023-09-30T22:24:33.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.897+0000 7f4fe63e7700 1 --2- 172.21.15.40:0/2961271245 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fe009d920 0x7f4fe011eeb0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.897+0000 7f4fe63e7700 1 --2- 172.21.15.40:0/2961271245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fe0130de0 0x7f4fe011b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.897+0000 7f4fe63e7700 1 --2- 172.21.15.40:0/2961271245 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fe009e230 0x7f4fe011ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.897+0000 7f4fe63e7700 1 -- 172.21.15.40:0/2961271245 >> 172.21.15.40:0/2961271245 conn(0x7f4fe009fb20 msgr2=0x7f4fe012dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:33.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.897+0000 7f4fe63e7700 1 -- 172.21.15.40:0/2961271245 shutdown_connections 2023-09-30T22:24:33.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:33.897+0000 7f4fe63e7700 1 -- 172.21.15.40:0/2961271245 wait complete. 2023-09-30T22:24:33.910 INFO:teuthology.run_tasks:Running task ceph.restart... 2023-09-30T22:24:33.925 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-09-30T22:24:33.925 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:24:33.958 INFO:tasks.ceph.osd.0:Stopped 2023-09-30T22:24:33.958 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 0 2023-09-30T22:24:34.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.124+0000 7ffb60f6b700 1 Processor -- start 2023-09-30T22:24:34.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.124+0000 7ffb60f6b700 1 -- start start 2023-09-30T22:24:34.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.125+0000 7ffb60f6b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb5c09c890 0x7ffb5c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.125+0000 7ffb60f6b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb5c09e480 0x7ffb5c13bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.125+0000 7ffb60f6b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb5c0a2600 con 0x7ffb5c09d920 2023-09-30T22:24:34.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.125+0000 7ffb60f6b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c0a29d0 con 0x7ffb5c09c890 2023-09-30T22:24:34.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.125+0000 7ffb60f6b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c09fb40 con 0x7ffb5c09e480 2023-09-30T22:24:34.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.125+0000 7ffb5a59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb5c09c890 0x7ffb5c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.125+0000 7ffb59d9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ffb5c09d920 0x7ffb5c09dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39060/0 (socket says 172.21.15.40:39060) 2023-09-30T22:24:34.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.125+0000 7ffb59d9b700 1 -- 172.21.15.40:0/1483458588 learned_addr learned my addr 172.21.15.40:0/1483458588 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:24:34.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.125+0000 7ffb5ad9d700 1 --2- 172.21.15.40:0/1483458588 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb5c09e480 0x7ffb5c13bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.125+0000 7ffb5a59c700 1 -- 172.21.15.40:0/1483458588 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb5c09e480 msgr2=0x7ffb5c13bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:34.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.125+0000 7ffb5a59c700 1 --2- 172.21.15.40:0/1483458588 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb5c09e480 0x7ffb5c13bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.125+0000 7ffb5a59c700 1 -- 172.21.15.40:0/1483458588 >> v1:172.21.15.40:6789/0 conn(0x7ffb5c09d920 legacy=0x7ffb5c09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.125+0000 7ffb5959a700 1 -- 172.21.15.40:0/1483458588 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3871015029 0 0) 0x7ffb5c0a2600 con 0x7ffb5c09d920 2023-09-30T22:24:34.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.125+0000 7ffb5a59c700 1 -- 172.21.15.40:0/1483458588 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb5c09fed0 con 0x7ffb5c09c890 2023-09-30T22:24:34.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.125+0000 7ffb5ad9d700 1 --2- 172.21.15.40:0/1483458588 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb5c09e480 0x7ffb5c13bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:34.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.125+0000 7ffb5a59c700 1 --2- 172.21.15.40:0/1483458588 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb5c09c890 0x7ffb5c09cc60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ffb50009850 tx=0x7ffb50009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=950b6b6c6d47f74a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:34.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.126+0000 7ffb5959a700 1 -- 172.21.15.40:0/1483458588 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb50005e30 con 0x7ffb5c09c890 2023-09-30T22:24:34.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.126+0000 7ffb5959a700 1 -- 172.21.15.40:0/1483458588 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb50006030 con 0x7ffb5c09c890 2023-09-30T22:24:34.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.126+0000 7ffb5959a700 1 -- 172.21.15.40:0/1483458588 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb500063e0 con 0x7ffb5c09c890 2023-09-30T22:24:34.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.126+0000 7ffb60f6b700 1 -- 172.21.15.40:0/1483458588 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb5c09c890 msgr2=0x7ffb5c09cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.126+0000 7ffb60f6b700 1 --2- 172.21.15.40:0/1483458588 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb5c09c890 0x7ffb5c09cc60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ffb50009850 tx=0x7ffb50009b60 comp rx=0 tx=0).stop 2023-09-30T22:24:34.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.126+0000 7ffb60f6b700 1 -- 172.21.15.40:0/1483458588 shutdown_connections 2023-09-30T22:24:34.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.126+0000 7ffb60f6b700 1 --2- 172.21.15.40:0/1483458588 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb5c09e480 0x7ffb5c13bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.126+0000 7ffb60f6b700 1 --2- 172.21.15.40:0/1483458588 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb5c09c890 0x7ffb5c09cc60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.126+0000 7ffb60f6b700 1 -- 172.21.15.40:0/1483458588 >> 172.21.15.40:0/1483458588 conn(0x7ffb5c0a7080 msgr2=0x7ffb5c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:34.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.126+0000 7ffb60f6b700 1 -- 172.21.15.40:0/1483458588 shutdown_connections 2023-09-30T22:24:34.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.126+0000 7ffb60f6b700 1 -- 172.21.15.40:0/1483458588 wait complete. 2023-09-30T22:24:34.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.127+0000 7ffb60f6b700 1 Processor -- start 2023-09-30T22:24:34.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.127+0000 7ffb60f6b700 1 -- start start 2023-09-30T22:24:34.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.128+0000 7ffb60f6b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb5c09c890 0x7ffb5c12d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.128+0000 7ffb60f6b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb5c09d920 0x7ffb5c12d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.128+0000 7ffb60f6b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb5c09e480 0x7ffb5c12ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.128+0000 7ffb60f6b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c130560 con 0x7ffb5c09d920 2023-09-30T22:24:34.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.128+0000 7ffb60f6b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c12f1a0 con 0x7ffb5c09c890 2023-09-30T22:24:34.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.128+0000 7ffb60f6b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c0a5c60 con 0x7ffb5c09e480 2023-09-30T22:24:34.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.128+0000 7ffb5a59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb5c09c890 0x7ffb5c12d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.128+0000 7ffb59d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb5c09d920 0x7ffb5c12d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.128+0000 7ffb5a59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb5c09c890 0x7ffb5c12d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60320/0 (socket says 172.21.15.40:60320) 2023-09-30T22:24:34.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.128+0000 7ffb5ad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb5c09e480 0x7ffb5c12ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.128+0000 7ffb5a59c700 1 -- 172.21.15.40:0/2275241310 learned_addr learned my addr 172.21.15.40:0/2275241310 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:34.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.128+0000 7ffb5a59c700 1 -- 172.21.15.40:0/2275241310 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb5c09e480 msgr2=0x7ffb5c12ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.128+0000 7ffb5a59c700 1 --2- 172.21.15.40:0/2275241310 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb5c09e480 0x7ffb5c12ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.128+0000 7ffb5a59c700 1 -- 172.21.15.40:0/2275241310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb5c09d920 msgr2=0x7ffb5c12d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.128+0000 7ffb5a59c700 1 --2- 172.21.15.40:0/2275241310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb5c09d920 0x7ffb5c12d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.128+0000 7ffb5a59c700 1 -- 172.21.15.40:0/2275241310 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb54009a70 con 0x7ffb5c09c890 2023-09-30T22:24:34.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.128+0000 7ffb5ad9d700 1 --2- 172.21.15.40:0/2275241310 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb5c09e480 0x7ffb5c12ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:34.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.128+0000 7ffb59d9b700 1 --2- 172.21.15.40:0/2275241310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb5c09d920 0x7ffb5c12d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:34.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.128+0000 7ffb5a59c700 1 --2- 172.21.15.40:0/2275241310 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb5c09c890 0x7ffb5c12d340 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ffb50013040 tx=0x7ffb50004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:34.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.129+0000 7ffb4affd700 1 -- 172.21.15.40:0/2275241310 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb50025670 con 0x7ffb5c09c890 2023-09-30T22:24:34.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.129+0000 7ffb4affd700 1 -- 172.21.15.40:0/2275241310 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb500257d0 con 0x7ffb5c09c890 2023-09-30T22:24:34.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.129+0000 7ffb60f6b700 1 -- 172.21.15.40:0/2275241310 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb50009430 con 0x7ffb5c09c890 2023-09-30T22:24:34.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.129+0000 7ffb4affd700 1 -- 172.21.15.40:0/2275241310 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb50025b80 con 0x7ffb5c09c890 2023-09-30T22:24:34.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.129+0000 7ffb60f6b700 1 -- 172.21.15.40:0/2275241310 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb5c130820 con 0x7ffb5c09c890 2023-09-30T22:24:34.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.129+0000 7ffb4affd700 1 -- 172.21.15.40:0/2275241310 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ffb50022070 con 0x7ffb5c09c890 2023-09-30T22:24:34.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.130+0000 7ffb60f6b700 1 -- 172.21.15.40:0/2275241310 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb5c062380 con 0x7ffb5c09c890 2023-09-30T22:24:34.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.130+0000 7ffb4affd700 1 -- 172.21.15.40:0/2275241310 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4094+0+0 (secure 0 0 0) 0x7ffb50041150 con 0x7ffb5c09c890 2023-09-30T22:24:34.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.134+0000 7ffb4affd700 1 -- 172.21.15.40:0/2275241310 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb50006910 con 0x7ffb5c09c890 2023-09-30T22:24:34.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.343+0000 7ffb60f6b700 1 -- 172.21.15.40:0/2275241310 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd down", "ids": ["0"]} v 0) v1 -- 0x7ffb5c074620 con 0x7ffb5c09c890 2023-09-30T22:24:34.343 INFO:tasks.ceph.mon.a.smithi040.stderr:2023-09-30T22:24:34.343+0000 7f632bd71700 -1 mon.a@0(leader).osd e25 definitely_dead 0 2023-09-30T22:24:34.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.536+0000 7ffb4affd700 1 -- 172.21.15.40:0/2275241310 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["0"]}]=0 marked down osd.0. v26) v1 ==== 89+0+0 (secure 0 0 0) 0x7ffb5001ab80 con 0x7ffb5c09c890 2023-09-30T22:24:34.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.542+0000 7ffb60f6b700 1 -- 172.21.15.40:0/2275241310 >> v1:172.21.15.40:6816/127432 conn(0x7ffb3c02f510 legacy=0x7ffb3c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.542+0000 7ffb60f6b700 1 -- 172.21.15.40:0/2275241310 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb5c09c890 msgr2=0x7ffb5c12d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.542+0000 7ffb60f6b700 1 --2- 172.21.15.40:0/2275241310 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb5c09c890 0x7ffb5c12d340 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ffb50013040 tx=0x7ffb50004750 comp rx=0 tx=0).stop 2023-09-30T22:24:34.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.543+0000 7ffb60f6b700 1 -- 172.21.15.40:0/2275241310 shutdown_connections 2023-09-30T22:24:34.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.543+0000 7ffb60f6b700 1 --2- 172.21.15.40:0/2275241310 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb5c09e480 0x7ffb5c12ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.543+0000 7ffb60f6b700 1 --2- 172.21.15.40:0/2275241310 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb5c09c890 0x7ffb5c12d340 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.543+0000 7ffb60f6b700 1 --2- 172.21.15.40:0/2275241310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb5c09d920 0x7ffb5c12d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.543+0000 7ffb60f6b700 1 -- 172.21.15.40:0/2275241310 >> 172.21.15.40:0/2275241310 conn(0x7ffb5c0a7080 msgr2=0x7ffb5c0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:34.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.543+0000 7ffb60f6b700 1 -- 172.21.15.40:0/2275241310 shutdown_connections 2023-09-30T22:24:34.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.543+0000 7ffb60f6b700 1 -- 172.21.15.40:0/2275241310 wait complete. 2023-09-30T22:24:34.582 INFO:teuthology.orchestra.run.smithi040.stderr:marked down osd.0. 2023-09-30T22:24:34.582 INFO:tasks.ceph.osd.0:Restarting daemon 2023-09-30T22:24:34.583 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-09-30T22:24:34.585 INFO:tasks.ceph.osd.0:Started 2023-09-30T22:24:34.585 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-09-30T22:24:34.585 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:24:34.625 INFO:tasks.ceph.osd.1:Stopped 2023-09-30T22:24:34.625 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 1 2023-09-30T22:24:34.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.791+0000 7f8942f85700 1 Processor -- start 2023-09-30T22:24:34.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.791+0000 7f8942f85700 1 -- start start 2023-09-30T22:24:34.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.792+0000 7f8942f85700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f893c06a6d0 0x7f893c06aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.792+0000 7f8942f85700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f893c06afe0 0x7f893c1318b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.792+0000 7f8942f85700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f893c09eb50 con 0x7f893c131df0 2023-09-30T22:24:34.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.792+0000 7f8942f85700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f893c09dde0 con 0x7f893c06a6d0 2023-09-30T22:24:34.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.792+0000 7f8942f85700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f893c09d4a0 con 0x7f893c06afe0 2023-09-30T22:24:34.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.792+0000 7f8940d21700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f893c06a6d0 0x7f893c06aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.792+0000 7f8941522700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f893c131df0 0x7f893c138b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39082/0 (socket says 172.21.15.40:39082) 2023-09-30T22:24:34.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.792+0000 7f8941522700 1 -- 172.21.15.40:0/2830486628 learned_addr learned my addr 172.21.15.40:0/2830486628 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:24:34.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.792+0000 7f893bfff700 1 --2- 172.21.15.40:0/2830486628 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f893c06afe0 0x7f893c1318b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.792+0000 7f893b7fe700 1 -- 172.21.15.40:0/2830486628 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 957026406 0 0) 0x7f893c09eb50 con 0x7f893c131df0 2023-09-30T22:24:34.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.792+0000 7f8940d21700 1 -- 172.21.15.40:0/2830486628 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f893c06afe0 msgr2=0x7f893c1318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:34.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.792+0000 7f8940d21700 1 --2- 172.21.15.40:0/2830486628 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f893c06afe0 0x7f893c1318b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.792+0000 7f8940d21700 1 -- 172.21.15.40:0/2830486628 >> v1:172.21.15.40:6789/0 conn(0x7f893c131df0 legacy=0x7f893c138b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.792+0000 7f8940d21700 1 -- 172.21.15.40:0/2830486628 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893c09f5f0 con 0x7f893c06a6d0 2023-09-30T22:24:34.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.792+0000 7f893bfff700 1 --2- 172.21.15.40:0/2830486628 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f893c06afe0 0x7f893c1318b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:34.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.792+0000 7f8940d21700 1 --2- 172.21.15.40:0/2830486628 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f893c06a6d0 0x7f893c06aaa0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8930009850 tx=0x7f8930009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d55375595f3609a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:34.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.793+0000 7f893b7fe700 1 -- 172.21.15.40:0/2830486628 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8930005e30 con 0x7f893c06a6d0 2023-09-30T22:24:34.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.793+0000 7f893b7fe700 1 -- 172.21.15.40:0/2830486628 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8930006030 con 0x7f893c06a6d0 2023-09-30T22:24:34.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.793+0000 7f893b7fe700 1 -- 172.21.15.40:0/2830486628 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89300063e0 con 0x7f893c06a6d0 2023-09-30T22:24:34.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.793+0000 7f8942f85700 1 -- 172.21.15.40:0/2830486628 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f893c06a6d0 msgr2=0x7f893c06aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.793+0000 7f8942f85700 1 --2- 172.21.15.40:0/2830486628 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f893c06a6d0 0x7f893c06aaa0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8930009850 tx=0x7f8930009b60 comp rx=0 tx=0).stop 2023-09-30T22:24:34.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.793+0000 7f8942f85700 1 -- 172.21.15.40:0/2830486628 shutdown_connections 2023-09-30T22:24:34.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.793+0000 7f8942f85700 1 --2- 172.21.15.40:0/2830486628 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f893c06a6d0 0x7f893c06aaa0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.793+0000 7f8942f85700 1 --2- 172.21.15.40:0/2830486628 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f893c06afe0 0x7f893c1318b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.793+0000 7f8942f85700 1 -- 172.21.15.40:0/2830486628 >> 172.21.15.40:0/2830486628 conn(0x7f893c09fb20 msgr2=0x7f893c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:34.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.793+0000 7f8942f85700 1 -- 172.21.15.40:0/2830486628 shutdown_connections 2023-09-30T22:24:34.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.793+0000 7f8942f85700 1 -- 172.21.15.40:0/2830486628 wait complete. 2023-09-30T22:24:34.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.794+0000 7f8942f85700 1 Processor -- start 2023-09-30T22:24:34.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.795+0000 7f8942f85700 1 -- start start 2023-09-30T22:24:34.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.795+0000 7f8942f85700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f893c06a6d0 0x7f893c1211d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.795+0000 7f8942f85700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f893c06afe0 0x7f893c121710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.795+0000 7f8942f85700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f893c131df0 0x7f893c1c6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.795+0000 7f8942f85700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893c124280 con 0x7f893c131df0 2023-09-30T22:24:34.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.795+0000 7f8942f85700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f893c123ec0 con 0x7f893c06afe0 2023-09-30T22:24:34.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.795+0000 7f8942f85700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f893c120e00 con 0x7f893c06a6d0 2023-09-30T22:24:34.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.795+0000 7f8940d21700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f893c06a6d0 0x7f893c1211d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.795+0000 7f8940d21700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f893c06a6d0 0x7f893c1211d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48698/0 (socket says 172.21.15.40:48698) 2023-09-30T22:24:34.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.795+0000 7f8941522700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f893c131df0 0x7f893c1c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.795+0000 7f8940d21700 1 -- 172.21.15.40:0/492709850 learned_addr learned my addr 172.21.15.40:0/492709850 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:34.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.796+0000 7f893bfff700 1 --2- 172.21.15.40:0/492709850 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f893c06afe0 0x7f893c121710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.796+0000 7f8941522700 1 -- 172.21.15.40:0/492709850 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f893c06a6d0 msgr2=0x7f893c1211d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.796+0000 7f8941522700 1 --2- 172.21.15.40:0/492709850 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f893c06a6d0 0x7f893c1211d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.796+0000 7f8941522700 1 -- 172.21.15.40:0/492709850 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f893c06afe0 msgr2=0x7f893c121710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.796+0000 7f8941522700 1 --2- 172.21.15.40:0/492709850 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f893c06afe0 0x7f893c121710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.796+0000 7f8941522700 1 -- 172.21.15.40:0/492709850 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89280094a0 con 0x7f893c131df0 2023-09-30T22:24:34.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.796+0000 7f8940d21700 1 --2- 172.21.15.40:0/492709850 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f893c06a6d0 0x7f893c1211d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:34.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.796+0000 7f8941522700 1 --2- 172.21.15.40:0/492709850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f893c131df0 0x7f893c1c6170 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f893400cbe0 tx=0x7f893400cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:34.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.796+0000 7f89397fa700 1 -- 172.21.15.40:0/492709850 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893400aa40 con 0x7f893c131df0 2023-09-30T22:24:34.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.796+0000 7f8942f85700 1 -- 172.21.15.40:0/492709850 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8930009430 con 0x7f893c131df0 2023-09-30T22:24:34.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.796+0000 7f89397fa700 1 -- 172.21.15.40:0/492709850 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893400abc0 con 0x7f893c131df0 2023-09-30T22:24:34.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.796+0000 7f89397fa700 1 -- 172.21.15.40:0/492709850 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89340070d0 con 0x7f893c131df0 2023-09-30T22:24:34.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.796+0000 7f8942f85700 1 -- 172.21.15.40:0/492709850 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f893c122550 con 0x7f893c131df0 2023-09-30T22:24:34.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.797+0000 7f89397fa700 1 -- 172.21.15.40:0/492709850 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8934007230 con 0x7f893c131df0 2023-09-30T22:24:34.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.797+0000 7f89397fa700 1 -- 172.21.15.40:0/492709850 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4094+0+0 (secure 0 0 0) 0x7f893403f540 con 0x7f893c131df0 2023-09-30T22:24:34.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.797+0000 7f8942f85700 1 -- 172.21.15.40:0/492709850 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f893c124060 con 0x7f893c131df0 2023-09-30T22:24:34.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:34.802+0000 7f89397fa700 1 -- 172.21.15.40:0/492709850 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8934018030 con 0x7f893c131df0 2023-09-30T22:24:35.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.008+0000 7f8942f85700 1 -- 172.21.15.40:0/492709850 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd down", "ids": ["1"]} v 0) v1 -- 0x7f893c062380 con 0x7f893c131df0 2023-09-30T22:24:35.009 INFO:tasks.ceph.mon.a.smithi040.stderr:2023-09-30T22:24:35.008+0000 7f632bd71700 -1 mon.a@0(leader).osd e26 definitely_dead 0 2023-09-30T22:24:35.178 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-09-30T22:24:35.178+0000 7f532634a680 -1 Falling back to public interface 2023-09-30T22:24:35.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.542+0000 7f89397fa700 1 -- 172.21.15.40:0/492709850 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["1"]}]=0 marked down osd.1. v27) v1 ==== 89+0+0 (secure 0 0 0) 0x7f8934018030 con 0x7f893c131df0 2023-09-30T22:24:35.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.546+0000 7f8942f85700 1 -- 172.21.15.40:0/492709850 >> v1:172.21.15.40:6816/127432 conn(0x7f892002f510 legacy=0x7f89200319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:35.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.547+0000 7f8942f85700 1 -- 172.21.15.40:0/492709850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f893c131df0 msgr2=0x7f893c1c6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:35.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.547+0000 7f8942f85700 1 --2- 172.21.15.40:0/492709850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f893c131df0 0x7f893c1c6170 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f893400cbe0 tx=0x7f893400cef0 comp rx=0 tx=0).stop 2023-09-30T22:24:35.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.547+0000 7f8942f85700 1 -- 172.21.15.40:0/492709850 shutdown_connections 2023-09-30T22:24:35.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.547+0000 7f8942f85700 1 --2- 172.21.15.40:0/492709850 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f893c06a6d0 0x7f893c1211d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:35.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.547+0000 7f8942f85700 1 --2- 172.21.15.40:0/492709850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f893c131df0 0x7f893c1c6170 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:35.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.547+0000 7f8942f85700 1 --2- 172.21.15.40:0/492709850 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f893c06afe0 0x7f893c121710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:35.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.547+0000 7f8942f85700 1 -- 172.21.15.40:0/492709850 >> 172.21.15.40:0/492709850 conn(0x7f893c09fb20 msgr2=0x7f893c06f770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:35.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.548+0000 7f8942f85700 1 -- 172.21.15.40:0/492709850 shutdown_connections 2023-09-30T22:24:35.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.548+0000 7f8942f85700 1 -- 172.21.15.40:0/492709850 wait complete. 2023-09-30T22:24:35.551 INFO:teuthology.orchestra.run.smithi040.stderr:marked down osd.1. 2023-09-30T22:24:35.566 INFO:tasks.ceph.osd.1:Restarting daemon 2023-09-30T22:24:35.566 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-09-30T22:24:35.568 INFO:tasks.ceph.osd.1:Started 2023-09-30T22:24:35.569 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-09-30T22:24:35.569 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:24:35.599 INFO:tasks.ceph.osd.2:Stopped 2023-09-30T22:24:35.599 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 2 2023-09-30T22:24:35.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.766+0000 7f6e28e7d700 1 Processor -- start 2023-09-30T22:24:35.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.766+0000 7f6e28e7d700 1 -- start start 2023-09-30T22:24:35.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.766+0000 7f6e28e7d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6e2409c890 0x7f6e2409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:35.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.766+0000 7f6e28e7d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e2409e480 0x7f6e2413bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:35.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.766+0000 7f6e28e7d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e240a2600 con 0x7f6e2409d920 2023-09-30T22:24:35.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.766+0000 7f6e28e7d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e240a29d0 con 0x7f6e2409c890 2023-09-30T22:24:35.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.766+0000 7f6e28e7d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2409fb40 con 0x7f6e2409e480 2023-09-30T22:24:35.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.766+0000 7f6e2259c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6e2409c890 0x7f6e2409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:35.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.766+0000 7f6e22d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e2409e480 0x7f6e2413bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:35.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.766+0000 7f6e21d9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6e2409d920 0x7f6e2409dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39092/0 (socket says 172.21.15.40:39092) 2023-09-30T22:24:35.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.766+0000 7f6e21d9b700 1 -- 172.21.15.40:0/4004077892 learned_addr learned my addr 172.21.15.40:0/4004077892 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:24:35.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.767+0000 7f6e2259c700 1 -- 172.21.15.40:0/4004077892 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e2409e480 msgr2=0x7f6e2413bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:35.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.767+0000 7f6e2259c700 1 --2- 172.21.15.40:0/4004077892 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e2409e480 0x7f6e2413bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:35.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.767+0000 7f6e2259c700 1 -- 172.21.15.40:0/4004077892 >> v1:172.21.15.40:6789/0 conn(0x7f6e2409d920 legacy=0x7f6e2409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:35.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.767+0000 7f6e2159a700 1 -- 172.21.15.40:0/4004077892 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 500699864 0 0) 0x7f6e240a2600 con 0x7f6e2409d920 2023-09-30T22:24:35.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.767+0000 7f6e2259c700 1 -- 172.21.15.40:0/4004077892 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e2409fed0 con 0x7f6e2409c890 2023-09-30T22:24:35.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.767+0000 7f6e2259c700 1 --2- 172.21.15.40:0/4004077892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e2409c890 0x7f6e2409cc60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6e14009820 tx=0x7f6e14009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56dd8afa7a29bb9c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:35.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.767+0000 7f6e2159a700 1 -- 172.21.15.40:0/4004077892 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e14005e30 con 0x7f6e2409c890 2023-09-30T22:24:35.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.767+0000 7f6e2159a700 1 -- 172.21.15.40:0/4004077892 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e14006030 con 0x7f6e2409c890 2023-09-30T22:24:35.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.767+0000 7f6e2159a700 1 -- 172.21.15.40:0/4004077892 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e140063c0 con 0x7f6e2409c890 2023-09-30T22:24:35.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.768+0000 7f6e28e7d700 1 -- 172.21.15.40:0/4004077892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e2409c890 msgr2=0x7f6e2409cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:35.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.768+0000 7f6e28e7d700 1 --2- 172.21.15.40:0/4004077892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e2409c890 0x7f6e2409cc60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6e14009820 tx=0x7f6e14009b30 comp rx=0 tx=0).stop 2023-09-30T22:24:35.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.768+0000 7f6e28e7d700 1 -- 172.21.15.40:0/4004077892 shutdown_connections 2023-09-30T22:24:35.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.768+0000 7f6e28e7d700 1 --2- 172.21.15.40:0/4004077892 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e2409e480 0x7f6e2413bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:35.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.768+0000 7f6e28e7d700 1 --2- 172.21.15.40:0/4004077892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e2409c890 0x7f6e2409cc60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:35.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.768+0000 7f6e28e7d700 1 -- 172.21.15.40:0/4004077892 >> 172.21.15.40:0/4004077892 conn(0x7f6e240a7080 msgr2=0x7f6e240a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:35.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.768+0000 7f6e28e7d700 1 -- 172.21.15.40:0/4004077892 shutdown_connections 2023-09-30T22:24:35.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.768+0000 7f6e28e7d700 1 -- 172.21.15.40:0/4004077892 wait complete. 2023-09-30T22:24:35.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.769+0000 7f6e28e7d700 1 Processor -- start 2023-09-30T22:24:35.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.769+0000 7f6e28e7d700 1 -- start start 2023-09-30T22:24:35.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.769+0000 7f6e28e7d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e2409c890 0x7f6e2412d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:35.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.769+0000 7f6e28e7d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e2409d920 0x7f6e2412d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:35.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.769+0000 7f6e28e7d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6e2409e480 0x7f6e2412de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:35.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.769+0000 7f6e28e7d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e241308e0 con 0x7f6e2409c890 2023-09-30T22:24:35.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.769+0000 7f6e28e7d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e240a5c60 con 0x7f6e2409d920 2023-09-30T22:24:35.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.769+0000 7f6e28e7d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2409c280 con 0x7f6e2409e480 2023-09-30T22:24:35.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.769+0000 7f6e21d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e2409d920 0x7f6e2412d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:35.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.769+0000 7f6e2259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e2409c890 0x7f6e2412d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:35.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.769+0000 7f6e21d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e2409d920 0x7f6e2412d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60388/0 (socket says 172.21.15.40:60388) 2023-09-30T22:24:35.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.769+0000 7f6e2259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e2409c890 0x7f6e2412d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50022/0 (socket says 172.21.15.40:50022) 2023-09-30T22:24:35.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.769+0000 7f6e21d9b700 1 -- 172.21.15.40:0/1959521949 learned_addr learned my addr 172.21.15.40:0/1959521949 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:35.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.769+0000 7f6e22d9d700 1 --2- 172.21.15.40:0/1959521949 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6e2409e480 0x7f6e2412de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:35.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.770+0000 7f6e2259c700 1 -- 172.21.15.40:0/1959521949 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6e2409e480 msgr2=0x7f6e2412de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:35.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.770+0000 7f6e2259c700 1 --2- 172.21.15.40:0/1959521949 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6e2409e480 0x7f6e2412de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:35.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.770+0000 7f6e2259c700 1 -- 172.21.15.40:0/1959521949 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e2409d920 msgr2=0x7f6e2412d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:35.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.770+0000 7f6e2259c700 1 --2- 172.21.15.40:0/1959521949 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e2409d920 0x7f6e2412d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:35.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.770+0000 7f6e2259c700 1 -- 172.21.15.40:0/1959521949 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e14009430 con 0x7f6e2409c890 2023-09-30T22:24:35.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.770+0000 7f6e21d9b700 1 --2- 172.21.15.40:0/1959521949 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e2409d920 0x7f6e2412d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:35.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.770+0000 7f6e22d9d700 1 --2- 172.21.15.40:0/1959521949 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6e2409e480 0x7f6e2412de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:35.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.770+0000 7f6e2259c700 1 --2- 172.21.15.40:0/1959521949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e2409c890 0x7f6e2412d3d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6e14015000 tx=0x7f6e14004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:35.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.770+0000 7f6e12ffd700 1 -- 172.21.15.40:0/1959521949 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e140063a0 con 0x7f6e2409c890 2023-09-30T22:24:35.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.770+0000 7f6e12ffd700 1 -- 172.21.15.40:0/1959521949 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e14006500 con 0x7f6e2409c890 2023-09-30T22:24:35.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.770+0000 7f6e28e7d700 1 -- 172.21.15.40:0/1959521949 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e2412f100 con 0x7f6e2409c890 2023-09-30T22:24:35.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.770+0000 7f6e12ffd700 1 -- 172.21.15.40:0/1959521949 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e140068b0 con 0x7f6e2409c890 2023-09-30T22:24:35.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.770+0000 7f6e28e7d700 1 -- 172.21.15.40:0/1959521949 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e24130b30 con 0x7f6e2409c890 2023-09-30T22:24:35.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.771+0000 7f6e12ffd700 1 -- 172.21.15.40:0/1959521949 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f6e14022070 con 0x7f6e2409c890 2023-09-30T22:24:35.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.771+0000 7f6e28e7d700 1 -- 172.21.15.40:0/1959521949 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e24062380 con 0x7f6e2409c890 2023-09-30T22:24:35.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.771+0000 7f6e12ffd700 1 -- 172.21.15.40:0/1959521949 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4094+0+0 (secure 0 0 0) 0x7f6e14041190 con 0x7f6e2409c890 2023-09-30T22:24:35.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.776+0000 7f6e12ffd700 1 -- 172.21.15.40:0/1959521949 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6e1402e9a0 con 0x7f6e2409c890 2023-09-30T22:24:35.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:35.983+0000 7f6e28e7d700 1 -- 172.21.15.40:0/1959521949 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd down", "ids": ["2"]} v 0) v1 -- 0x7f6e24130690 con 0x7f6e2409c890 2023-09-30T22:24:35.984 INFO:tasks.ceph.mon.a.smithi040.stderr:2023-09-30T22:24:35.983+0000 7f632bd71700 -1 mon.a@0(leader).osd e27 definitely_dead 0 2023-09-30T22:24:36.164 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-09-30T22:24:36.164+0000 7f0bf7041680 -1 Falling back to public interface 2023-09-30T22:24:36.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.555+0000 7f6e12ffd700 1 -- 172.21.15.40:0/1959521949 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["2"]}]=0 marked down osd.2. v28) v1 ==== 89+0+0 (secure 0 0 0) 0x7f6e1402e770 con 0x7f6e2409c890 2023-09-30T22:24:36.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.559+0000 7f6e28e7d700 1 -- 172.21.15.40:0/1959521949 >> v1:172.21.15.40:6816/127432 conn(0x7f6e0402f510 legacy=0x7f6e040319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.559+0000 7f6e28e7d700 1 -- 172.21.15.40:0/1959521949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e2409c890 msgr2=0x7f6e2412d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.559+0000 7f6e28e7d700 1 --2- 172.21.15.40:0/1959521949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e2409c890 0x7f6e2412d3d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6e14015000 tx=0x7f6e14004750 comp rx=0 tx=0).stop 2023-09-30T22:24:36.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.559+0000 7f6e28e7d700 1 -- 172.21.15.40:0/1959521949 shutdown_connections 2023-09-30T22:24:36.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.559+0000 7f6e28e7d700 1 --2- 172.21.15.40:0/1959521949 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6e2409e480 0x7f6e2412de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.559+0000 7f6e28e7d700 1 --2- 172.21.15.40:0/1959521949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e2409c890 0x7f6e2412d3d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.559+0000 7f6e28e7d700 1 --2- 172.21.15.40:0/1959521949 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e2409d920 0x7f6e2412d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.559+0000 7f6e28e7d700 1 -- 172.21.15.40:0/1959521949 >> 172.21.15.40:0/1959521949 conn(0x7f6e240a7080 msgr2=0x7f6e240a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:36.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.560+0000 7f6e28e7d700 1 -- 172.21.15.40:0/1959521949 shutdown_connections 2023-09-30T22:24:36.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.560+0000 7f6e28e7d700 1 -- 172.21.15.40:0/1959521949 wait complete. 2023-09-30T22:24:36.562 INFO:teuthology.orchestra.run.smithi040.stderr:marked down osd.2. 2023-09-30T22:24:36.577 INFO:tasks.ceph.osd.2:Restarting daemon 2023-09-30T22:24:36.577 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-09-30T22:24:36.579 INFO:tasks.ceph.osd.2:Started 2023-09-30T22:24:36.580 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-09-30T22:24:36.580 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:24:36.623 INFO:tasks.ceph.osd.3:Stopped 2023-09-30T22:24:36.623 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 3 2023-09-30T22:24:36.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.753+0000 7f5534142700 1 Processor -- start 2023-09-30T22:24:36.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.753+0000 7f5534142700 1 -- start start 2023-09-30T22:24:36.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.754+0000 7f5534142700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f552c09d920 0x7f552c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.754+0000 7f5534142700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f552c09f0f0 0x7f552c09e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.754+0000 7f5534142700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f552c09f940 con 0x7f552c133ca0 2023-09-30T22:24:36.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.754+0000 7f5534142700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f552c06b4c0 con 0x7f552c09f0f0 2023-09-30T22:24:36.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.754+0000 7f5534142700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f552c09a8f0 con 0x7f552c09d920 2023-09-30T22:24:36.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.754+0000 7f5531ede700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f552c09d920 0x7f552c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.754+0000 7f55316dd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f552c09f0f0 0x7f552c09e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.754+0000 7f55326df700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f552c133ca0 0x7f552c134100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39096/0 (socket says 172.21.15.40:39096) 2023-09-30T22:24:36.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.754+0000 7f55326df700 1 -- 172.21.15.40:0/200027047 learned_addr learned my addr 172.21.15.40:0/200027047 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:24:36.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.754+0000 7f5531ede700 1 -- 172.21.15.40:0/200027047 >> v2:172.21.15.40:3300/0 conn(0x7f552c09f0f0 msgr2=0x7f552c09e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:36.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.754+0000 7f5531ede700 1 --2- 172.21.15.40:0/200027047 >> v2:172.21.15.40:3300/0 conn(0x7f552c09f0f0 0x7f552c09e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.754+0000 7f5531ede700 1 -- 172.21.15.40:0/200027047 >> v1:172.21.15.40:6789/0 conn(0x7f552c133ca0 legacy=0x7f552c134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.754+0000 7f5530edc700 1 -- 172.21.15.40:0/200027047 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2214907643 0 0) 0x7f552c09f940 con 0x7f552c133ca0 2023-09-30T22:24:36.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.754+0000 7f5531ede700 1 -- 172.21.15.40:0/200027047 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f552c09f6e0 con 0x7f552c09d920 2023-09-30T22:24:36.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.754+0000 7f55316dd700 1 --2- 172.21.15.40:0/200027047 >> v2:172.21.15.40:3300/0 conn(0x7f552c09f0f0 0x7f552c09e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:36.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.754+0000 7f5531ede700 1 --2- 172.21.15.40:0/200027047 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f552c09d920 0x7f552c09dcf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f551c009820 tx=0x7f551c009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c752b780f1d471e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:36.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.754+0000 7f5530edc700 1 -- 172.21.15.40:0/200027047 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c005e30 con 0x7f552c09d920 2023-09-30T22:24:36.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.755+0000 7f5530edc700 1 -- 172.21.15.40:0/200027047 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f551c006030 con 0x7f552c09d920 2023-09-30T22:24:36.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.755+0000 7f5530edc700 1 -- 172.21.15.40:0/200027047 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c0063c0 con 0x7f552c09d920 2023-09-30T22:24:36.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.755+0000 7f5534142700 1 -- 172.21.15.40:0/200027047 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f552c09d920 msgr2=0x7f552c09dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.755+0000 7f5534142700 1 --2- 172.21.15.40:0/200027047 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f552c09d920 0x7f552c09dcf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f551c009820 tx=0x7f551c009b30 comp rx=0 tx=0).stop 2023-09-30T22:24:36.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.755+0000 7f5534142700 1 -- 172.21.15.40:0/200027047 shutdown_connections 2023-09-30T22:24:36.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.755+0000 7f5534142700 1 --2- 172.21.15.40:0/200027047 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f552c09d920 0x7f552c09dcf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.755+0000 7f5534142700 1 --2- 172.21.15.40:0/200027047 >> v2:172.21.15.40:3300/0 conn(0x7f552c09f0f0 0x7f552c09e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.755+0000 7f5534142700 1 -- 172.21.15.40:0/200027047 >> 172.21.15.40:0/200027047 conn(0x7f552c09fb20 msgr2=0x7f552c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:36.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.755+0000 7f5534142700 1 -- 172.21.15.40:0/200027047 shutdown_connections 2023-09-30T22:24:36.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.755+0000 7f5534142700 1 -- 172.21.15.40:0/200027047 wait complete. 2023-09-30T22:24:36.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.756+0000 7f5534142700 1 Processor -- start 2023-09-30T22:24:36.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.756+0000 7f5534142700 1 -- start start 2023-09-30T22:24:36.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.757+0000 7f5534142700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f552c09d920 0x7f552c11e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.757+0000 7f5534142700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f552c133ca0 0x7f552c11ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.757+0000 7f5534142700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f552c131870 0x7f552c11ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.757+0000 7f5534142700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552c121810 con 0x7f552c131870 2023-09-30T22:24:36.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.757+0000 7f5534142700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552c120130 con 0x7f552c09d920 2023-09-30T22:24:36.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.757+0000 7f5534142700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f552c121cc0 con 0x7f552c133ca0 2023-09-30T22:24:36.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.757+0000 7f5531ede700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f552c09d920 0x7f552c11e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.757+0000 7f55316dd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f552c133ca0 0x7f552c11ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.757+0000 7f5531ede700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f552c09d920 0x7f552c11e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60406/0 (socket says 172.21.15.40:60406) 2023-09-30T22:24:36.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.757+0000 7f5531ede700 1 -- 172.21.15.40:0/4261675966 learned_addr learned my addr 172.21.15.40:0/4261675966 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:36.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.757+0000 7f55326df700 1 --2- 172.21.15.40:0/4261675966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f552c131870 0x7f552c11ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.757+0000 7f5531ede700 1 -- 172.21.15.40:0/4261675966 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f552c133ca0 msgr2=0x7f552c11ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.757+0000 7f5531ede700 1 --2- 172.21.15.40:0/4261675966 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f552c133ca0 0x7f552c11ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.757+0000 7f5531ede700 1 -- 172.21.15.40:0/4261675966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f552c131870 msgr2=0x7f552c11ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.757+0000 7f5531ede700 1 --2- 172.21.15.40:0/4261675966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f552c131870 0x7f552c11ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.757+0000 7f5531ede700 1 -- 172.21.15.40:0/4261675966 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55280094a0 con 0x7f552c09d920 2023-09-30T22:24:36.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.757+0000 7f55326df700 1 --2- 172.21.15.40:0/4261675966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f552c131870 0x7f552c11ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:36.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.757+0000 7f5531ede700 1 --2- 172.21.15.40:0/4261675966 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f552c09d920 0x7f552c11e510 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f551c009e80 tx=0x7f551c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:36.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.757+0000 7f55227fc700 1 -- 172.21.15.40:0/4261675966 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c0036a0 con 0x7f552c09d920 2023-09-30T22:24:36.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.757+0000 7f55227fc700 1 -- 172.21.15.40:0/4261675966 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f551c020070 con 0x7f552c09d920 2023-09-30T22:24:36.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.757+0000 7f5534142700 1 -- 172.21.15.40:0/4261675966 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f551c009430 con 0x7f552c09d920 2023-09-30T22:24:36.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.757+0000 7f55227fc700 1 -- 172.21.15.40:0/4261675966 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c003a40 con 0x7f552c09d920 2023-09-30T22:24:36.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.757+0000 7f5534142700 1 -- 172.21.15.40:0/4261675966 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f552c09c9e0 con 0x7f552c09d920 2023-09-30T22:24:36.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.758+0000 7f55227fc700 1 -- 172.21.15.40:0/4261675966 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f551c022030 con 0x7f552c09d920 2023-09-30T22:24:36.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.758+0000 7f55227fc700 1 -- 172.21.15.40:0/4261675966 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4094+0+0 (secure 0 0 0) 0x7f551c041080 con 0x7f552c09d920 2023-09-30T22:24:36.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.758+0000 7f5534142700 1 -- 172.21.15.40:0/4261675966 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f552c06f6f0 con 0x7f552c09d920 2023-09-30T22:24:36.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.763+0000 7f55227fc700 1 -- 172.21.15.40:0/4261675966 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f551c0193b0 con 0x7f552c09d920 2023-09-30T22:24:36.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:36.970+0000 7f5534142700 1 -- 172.21.15.40:0/4261675966 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd down", "ids": ["3"]} v 0) v1 -- 0x7f552c121340 con 0x7f552c09d920 2023-09-30T22:24:36.971 INFO:tasks.ceph.mon.a.smithi040.stderr:2023-09-30T22:24:36.971+0000 7f632bd71700 -1 mon.a@0(leader).osd e28 definitely_dead 0 2023-09-30T22:24:37.181 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-09-30T22:24:37.180+0000 7fb95b8cd680 -1 Falling back to public interface 2023-09-30T22:24:37.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.559+0000 7f55227fc700 1 -- 172.21.15.40:0/4261675966 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["3"]}]=0 marked down osd.3. v29) v1 ==== 89+0+0 (secure 0 0 0) 0x7f551c01cbc0 con 0x7f552c09d920 2023-09-30T22:24:37.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.562+0000 7f5534142700 1 -- 172.21.15.40:0/4261675966 >> v1:172.21.15.40:6816/127432 conn(0x7f551002f510 legacy=0x7f55100319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.562+0000 7f5534142700 1 -- 172.21.15.40:0/4261675966 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f552c09d920 msgr2=0x7f552c11e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.562+0000 7f5534142700 1 --2- 172.21.15.40:0/4261675966 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f552c09d920 0x7f552c11e510 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f551c009e80 tx=0x7f551c004750 comp rx=0 tx=0).stop 2023-09-30T22:24:37.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.562+0000 7f5534142700 1 -- 172.21.15.40:0/4261675966 shutdown_connections 2023-09-30T22:24:37.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.562+0000 7f5534142700 1 --2- 172.21.15.40:0/4261675966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f552c131870 0x7f552c11ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.562+0000 7f5534142700 1 --2- 172.21.15.40:0/4261675966 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f552c09d920 0x7f552c11e510 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.562+0000 7f5534142700 1 --2- 172.21.15.40:0/4261675966 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f552c133ca0 0x7f552c11ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.562+0000 7f5534142700 1 -- 172.21.15.40:0/4261675966 >> 172.21.15.40:0/4261675966 conn(0x7f552c09fb20 msgr2=0x7f552c1334d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:37.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.562+0000 7f5534142700 1 -- 172.21.15.40:0/4261675966 shutdown_connections 2023-09-30T22:24:37.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.562+0000 7f5534142700 1 -- 172.21.15.40:0/4261675966 wait complete. 2023-09-30T22:24:37.564 INFO:teuthology.orchestra.run.smithi040.stderr:marked down osd.3. 2023-09-30T22:24:37.578 INFO:tasks.ceph.osd.3:Restarting daemon 2023-09-30T22:24:37.579 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-09-30T22:24:37.581 INFO:tasks.ceph.osd.3:Started 2023-09-30T22:24:37.581 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-30T22:24:37.581 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:24:37.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.715+0000 7f4ea24af700 1 Processor -- start 2023-09-30T22:24:37.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.715+0000 7f4ea24af700 1 -- start start 2023-09-30T22:24:37.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.716+0000 7f4ea24af700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e9c136bf0 0x7f4e9c138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.716+0000 7f4ea24af700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e9c139510 0x7f4e9c13b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.716+0000 7f4ea24af700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e9c0a2600 con 0x7f4e9c09c890 2023-09-30T22:24:37.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.716+0000 7f4ea24af700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c0a29d0 con 0x7f4e9c136bf0 2023-09-30T22:24:37.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.716+0000 7f4ea24af700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c09fb40 con 0x7f4e9c139510 2023-09-30T22:24:37.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.716+0000 7f4ea0a4c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e9c139510 0x7f4e9c13b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.716+0000 7f4e9bfff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f4e9c09c890 0x7f4e9c09cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39112/0 (socket says 172.21.15.40:39112) 2023-09-30T22:24:37.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.716+0000 7f4e9bfff700 1 -- 172.21.15.40:0/3422474151 learned_addr learned my addr 172.21.15.40:0/3422474151 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:24:37.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.716+0000 7f4e9b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e9c136bf0 0x7f4e9c138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.716+0000 7f4e9affd700 1 -- 172.21.15.40:0/3422474151 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1443706664 0 0) 0x7f4e9c0a2600 con 0x7f4e9c09c890 2023-09-30T22:24:37.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.716+0000 7f4ea0a4c700 1 -- 172.21.15.40:0/3422474151 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e9c136bf0 msgr2=0x7f4e9c138fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:37.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.716+0000 7f4ea0a4c700 1 --2- 172.21.15.40:0/3422474151 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e9c136bf0 0x7f4e9c138fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.716+0000 7f4ea0a4c700 1 -- 172.21.15.40:0/3422474151 >> v1:172.21.15.40:6789/0 conn(0x7f4e9c09c890 legacy=0x7f4e9c09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.716+0000 7f4ea0a4c700 1 -- 172.21.15.40:0/3422474151 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9c09d370 con 0x7f4e9c139510 2023-09-30T22:24:37.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.716+0000 7f4e9b7fe700 1 --2- 172.21.15.40:0/3422474151 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e9c136bf0 0x7f4e9c138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:37.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.717+0000 7f4ea0a4c700 1 --2- 172.21.15.40:0/3422474151 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e9c139510 0x7f4e9c13b8f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4e94009dc0 tx=0x7f4e9400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5324296009a171a1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:37.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.717+0000 7f4e9affd700 1 -- 172.21.15.40:0/3422474151 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9400e070 con 0x7f4e9c139510 2023-09-30T22:24:37.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.717+0000 7f4e9affd700 1 -- 172.21.15.40:0/3422474151 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9400bac0 con 0x7f4e9c139510 2023-09-30T22:24:37.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.717+0000 7f4e9affd700 1 -- 172.21.15.40:0/3422474151 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9400be70 con 0x7f4e9c139510 2023-09-30T22:24:37.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.717+0000 7f4ea24af700 1 -- 172.21.15.40:0/3422474151 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e9c139510 msgr2=0x7f4e9c13b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.717+0000 7f4ea24af700 1 --2- 172.21.15.40:0/3422474151 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e9c139510 0x7f4e9c13b8f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4e94009dc0 tx=0x7f4e9400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:37.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.717+0000 7f4ea24af700 1 -- 172.21.15.40:0/3422474151 shutdown_connections 2023-09-30T22:24:37.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.717+0000 7f4ea24af700 1 --2- 172.21.15.40:0/3422474151 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e9c139510 0x7f4e9c13b8f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.717+0000 7f4ea24af700 1 --2- 172.21.15.40:0/3422474151 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e9c136bf0 0x7f4e9c138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.717+0000 7f4ea24af700 1 -- 172.21.15.40:0/3422474151 >> 172.21.15.40:0/3422474151 conn(0x7f4e9c0a7080 msgr2=0x7f4e9c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:37.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.717+0000 7f4ea24af700 1 -- 172.21.15.40:0/3422474151 shutdown_connections 2023-09-30T22:24:37.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.717+0000 7f4ea24af700 1 -- 172.21.15.40:0/3422474151 wait complete. 2023-09-30T22:24:37.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.718+0000 7f4ea24af700 1 Processor -- start 2023-09-30T22:24:37.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.718+0000 7f4ea24af700 1 -- start start 2023-09-30T22:24:37.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.719+0000 7f4ea24af700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e9c09c890 0x7f4e9c06ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.719+0000 7f4ea24af700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e9c136bf0 0x7f4e9c06f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.719+0000 7f4ea24af700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e9c139510 0x7f4e9c06f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.719+0000 7f4ea24af700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c12be70 con 0x7f4e9c139510 2023-09-30T22:24:37.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.719+0000 7f4ea24af700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c071b70 con 0x7f4e9c09c890 2023-09-30T22:24:37.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.719+0000 7f4ea24af700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c0708d0 con 0x7f4e9c136bf0 2023-09-30T22:24:37.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.719+0000 7f4ea0a4c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e9c139510 0x7f4e9c06f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.719+0000 7f4e9bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e9c09c890 0x7f4e9c06ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.719+0000 7f4e9b7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e9c136bf0 0x7f4e9c06f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.719+0000 7f4ea0a4c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e9c139510 0x7f4e9c06f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50058/0 (socket says 172.21.15.40:50058) 2023-09-30T22:24:37.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.719+0000 7f4e9bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e9c09c890 0x7f4e9c06ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60442/0 (socket says 172.21.15.40:60442) 2023-09-30T22:24:37.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.719+0000 7f4ea0a4c700 1 -- 172.21.15.40:0/3228234719 learned_addr learned my addr 172.21.15.40:0/3228234719 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:37.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.719+0000 7f4e9b7fe700 1 -- 172.21.15.40:0/3228234719 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e9c09c890 msgr2=0x7f4e9c06ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.719+0000 7f4e9b7fe700 1 --2- 172.21.15.40:0/3228234719 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e9c09c890 0x7f4e9c06ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.719+0000 7f4e9b7fe700 1 -- 172.21.15.40:0/3228234719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e9c139510 msgr2=0x7f4e9c06f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.719+0000 7f4e9b7fe700 1 --2- 172.21.15.40:0/3228234719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e9c139510 0x7f4e9c06f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.719+0000 7f4e9b7fe700 1 -- 172.21.15.40:0/3228234719 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e900094a0 con 0x7f4e9c136bf0 2023-09-30T22:24:37.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.719+0000 7f4e9b7fe700 1 --2- 172.21.15.40:0/3228234719 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e9c136bf0 0x7f4e9c06f490 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4e9000e9b0 tx=0x7f4e9000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:37.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.720+0000 7f4e98ff9700 1 -- 172.21.15.40:0/3228234719 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9000ee50 con 0x7f4e9c136bf0 2023-09-30T22:24:37.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.720+0000 7f4e98ff9700 1 -- 172.21.15.40:0/3228234719 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9000c850 con 0x7f4e9c136bf0 2023-09-30T22:24:37.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.720+0000 7f4ea24af700 1 -- 172.21.15.40:0/3228234719 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e94009a70 con 0x7f4e9c136bf0 2023-09-30T22:24:37.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.720+0000 7f4e98ff9700 1 -- 172.21.15.40:0/3228234719 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9000cc00 con 0x7f4e9c136bf0 2023-09-30T22:24:37.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.720+0000 7f4ea24af700 1 -- 172.21.15.40:0/3228234719 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e9c12b4e0 con 0x7f4e9c136bf0 2023-09-30T22:24:37.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.720+0000 7f4e98ff9700 1 -- 172.21.15.40:0/3228234719 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4e90013470 con 0x7f4e9c136bf0 2023-09-30T22:24:37.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.720+0000 7f4e98ff9700 1 -- 172.21.15.40:0/3228234719 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4094+0+0 (secure 0 0 0) 0x7f4e9003ffa0 con 0x7f4e9c136bf0 2023-09-30T22:24:37.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.721+0000 7f4ea24af700 1 -- 172.21.15.40:0/3228234719 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e9c062380 con 0x7f4e9c136bf0 2023-09-30T22:24:37.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.726+0000 7f4e98ff9700 1 -- 172.21.15.40:0/3228234719 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4e90017080 con 0x7f4e9c136bf0 2023-09-30T22:24:37.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.921+0000 7f4ea24af700 1 -- 172.21.15.40:0/3228234719 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e9c09ecf0 con 0x7f4e9c136bf0 2023-09-30T22:24:37.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.922+0000 7f4e98ff9700 1 -- 172.21.15.40:0/3228234719 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+12029 (secure 0 0 0) 0x7f4e90013720 con 0x7f4e9c136bf0 2023-09-30T22:24:37.923 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:24:37.923 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":29,"fsid":"79dd4d8e-f295-4d9c-bd93-9850863800e3","created":"2023-09-30T22:21:46.980357+0000","modified":"2023-09-30T22:24:37.547345+0000","last_up_change":"2023-09-30T22:24:37.547345+0000","last_in_change":"2023-09-30T22:21:48.205613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:21:54.875024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:21:56.197012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:22:00.759069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:22:01.327265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"771f785c-f464-4b17-936c-cbf31b1153e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6812","nonce":119451}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6813","nonce":119451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6815","nonce":119451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6814","nonce":119451}]},"public_addr":"172.21.15.40:6812/119451","cluster_addr":"172.21.15.40:6813/119451","heartbeat_back_addr":"172.21.15.40:6815/119451","heartbeat_front_addr":"172.21.15.40:6814/119451","state":["exists"]},{"osd":1,"uuid":"45f1e2e8-5310-4219-ab54-424e7440fcea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":26,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6808","nonce":119436}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6809","nonce":119436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6811","nonce":119436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6810","nonce":119436}]},"public_addr":"172.21.15.40:6808/119436","cluster_addr":"172.21.15.40:6809/119436","heartbeat_back_addr":"172.21.15.40:6811/119436","heartbeat_front_addr":"172.21.15.40:6810/119436","state":["exists"]},{"osd":2,"uuid":"7ba62ae5-d21e-4d56-b46c-ba7b718ede25","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":27,"down_at":28,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6800","nonce":119433}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6801","nonce":119433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6803","nonce":119433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6802","nonce":119433}]},"public_addr":"172.21.15.40:6800/119433","cluster_addr":"172.21.15.40:6801/119433","heartbeat_back_addr":"172.21.15.40:6803/119433","heartbeat_front_addr":"172.21.15.40:6802/119433","state":["exists"]},{"osd":3,"uuid":"c9c55985-8a90-4927-a8fa-6a1fcec1cd3d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":28,"down_at":29,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6804","nonce":119432}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6805","nonce":119432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6807","nonce":119432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6806","nonce":119432}]},"public_addr":"172.21.15.40:6804/119432","cluster_addr":"172.21.15.40:6805/119432","heartbeat_back_addr":"172.21.15.40:6807/119432","heartbeat_front_addr":"172.21.15.40:6806/119432","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.339829+0000","dead_epoch":26},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.554690+0000","dead_epoch":27},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.641664+0000","dead_epoch":28},{"osd":3,"down_stamp":"2023-09-30T22:24:37.547345+0000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.320635+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2},{"from":1,"to":0}]},{"pgid":"4.1","mappings":[{"from":3,"to":0}]},{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.12","mappings":[{"from":3,"to":0}]},{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":3,"to":2},{"from":1,"to":0}]},{"pgid":"4.2c","mappings":[{"from":1,"to":2}]},{"pgid":"4.3f","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:0/1890660785":"2023-10-01T22:24:24.127340+0000","172.21.15.40:0/1764460125":"2023-10-01T22:24:24.127340+0000","172.21.15.40:6816/118905":"2023-10-01T22:24:24.127340+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:24:37.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.924+0000 7f4ea24af700 1 -- 172.21.15.40:0/3228234719 >> v1:172.21.15.40:6816/127432 conn(0x7f4e8802f510 legacy=0x7f4e880319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.924+0000 7f4ea24af700 1 -- 172.21.15.40:0/3228234719 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e9c136bf0 msgr2=0x7f4e9c06f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.924+0000 7f4ea24af700 1 --2- 172.21.15.40:0/3228234719 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e9c136bf0 0x7f4e9c06f490 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4e9000e9b0 tx=0x7f4e9000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.924+0000 7f4ea24af700 1 -- 172.21.15.40:0/3228234719 shutdown_connections 2023-09-30T22:24:37.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.924+0000 7f4ea24af700 1 --2- 172.21.15.40:0/3228234719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e9c139510 0x7f4e9c06f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.924+0000 7f4ea24af700 1 --2- 172.21.15.40:0/3228234719 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e9c09c890 0x7f4e9c06ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.924+0000 7f4ea24af700 1 --2- 172.21.15.40:0/3228234719 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e9c136bf0 0x7f4e9c06f490 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.924+0000 7f4ea24af700 1 -- 172.21.15.40:0/3228234719 >> 172.21.15.40:0/3228234719 conn(0x7f4e9c0a7080 msgr2=0x7f4e9c1349d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:37.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.925+0000 7f4ea24af700 1 -- 172.21.15.40:0/3228234719 shutdown_connections 2023-09-30T22:24:37.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:37.925+0000 7f4ea24af700 1 -- 172.21.15.40:0/3228234719 wait complete. 2023-09-30T22:24:38.187 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-09-30T22:24:38.186+0000 7fd978538680 -1 Falling back to public interface 2023-09-30T22:24:38.943 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-09-30T22:24:38.943+0000 7f532634a680 -1 osd.0 25 log_to_monitors true 2023-09-30T22:24:40.032 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-09-30T22:24:40.032+0000 7f0bf7041680 -1 osd.1 26 log_to_monitors true 2023-09-30T22:24:40.939 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:24:41.005 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-09-30T22:24:41.005+0000 7fb95b8cd680 -1 osd.2 27 log_to_monitors true 2023-09-30T22:24:41.011 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-09-30T22:24:41.010+0000 7f53122c5700 -1 osd.0 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:24:41.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.109+0000 7f57bcf1a700 1 Processor -- start 2023-09-30T22:24:41.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.109+0000 7f57bcf1a700 1 -- start start 2023-09-30T22:24:41.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.110+0000 7f57bcf1a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f57b8138250 0x7f57b8138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.110+0000 7f57bcf1a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f57b809df20 0x7f57b8140160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.110+0000 7f57bcf1a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b8137e20 con 0x7f57b809d400 2023-09-30T22:24:41.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.110+0000 7f57bcf1a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b8138050 con 0x7f57b809df20 2023-09-30T22:24:41.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.110+0000 7f57bcf1a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f57b809b010 con 0x7f57b8138250 2023-09-30T22:24:41.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.110+0000 7f57b5d9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f57b809d400 0x7f57b809d810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39146/0 (socket says 172.21.15.40:39146) 2023-09-30T22:24:41.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.110+0000 7f57b5d9b700 1 -- 172.21.15.40:0/3035498536 learned_addr learned my addr 172.21.15.40:0/3035498536 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:24:41.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.110+0000 7f57b6d9d700 1 --2- 172.21.15.40:0/3035498536 >> v2:172.21.15.40:3300/0 conn(0x7f57b809df20 0x7f57b8140160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.110+0000 7f57b659c700 1 --2- 172.21.15.40:0/3035498536 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f57b8138250 0x7f57b8138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.110+0000 7f57b559a700 1 -- 172.21.15.40:0/3035498536 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1809149944 0 0) 0x7f57b8137e20 con 0x7f57b809d400 2023-09-30T22:24:41.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.110+0000 7f57b559a700 1 -- 172.21.15.40:0/3035498536 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57a00035b0 con 0x7f57b809d400 2023-09-30T22:24:41.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.110+0000 7f57b6d9d700 1 -- 172.21.15.40:0/3035498536 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f57b8138250 msgr2=0x7f57b8138620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:41.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.110+0000 7f57b6d9d700 1 --2- 172.21.15.40:0/3035498536 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f57b8138250 0x7f57b8138620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.110+0000 7f57b6d9d700 1 -- 172.21.15.40:0/3035498536 >> v1:172.21.15.40:6789/0 conn(0x7f57b809d400 legacy=0x7f57b809d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.110+0000 7f57b6d9d700 1 -- 172.21.15.40:0/3035498536 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b809f1f0 con 0x7f57b809df20 2023-09-30T22:24:41.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.111+0000 7f57b659c700 1 --2- 172.21.15.40:0/3035498536 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f57b8138250 0x7f57b8138620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:41.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.111+0000 7f57b6d9d700 1 --2- 172.21.15.40:0/3035498536 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57b809df20 0x7f57b8140160 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f57b0009d90 tx=0x7f57b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a1a75eb7600752 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:41.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.111+0000 7f57b559a700 1 -- 172.21.15.40:0/3035498536 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b000e070 con 0x7f57b809df20 2023-09-30T22:24:41.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.111+0000 7f57b559a700 1 -- 172.21.15.40:0/3035498536 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b000bae0 con 0x7f57b809df20 2023-09-30T22:24:41.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.111+0000 7f57b559a700 1 -- 172.21.15.40:0/3035498536 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b000be90 con 0x7f57b809df20 2023-09-30T22:24:41.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.112+0000 7f57bcf1a700 1 -- 172.21.15.40:0/3035498536 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57b809df20 msgr2=0x7f57b8140160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.112+0000 7f57bcf1a700 1 --2- 172.21.15.40:0/3035498536 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57b809df20 0x7f57b8140160 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f57b0009d90 tx=0x7f57b000b330 comp rx=0 tx=0).stop 2023-09-30T22:24:41.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.112+0000 7f57bcf1a700 1 -- 172.21.15.40:0/3035498536 shutdown_connections 2023-09-30T22:24:41.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.112+0000 7f57bcf1a700 1 --2- 172.21.15.40:0/3035498536 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57b809df20 0x7f57b8140160 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.112+0000 7f57bcf1a700 1 --2- 172.21.15.40:0/3035498536 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f57b8138250 0x7f57b8138620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.112+0000 7f57bcf1a700 1 -- 172.21.15.40:0/3035498536 >> 172.21.15.40:0/3035498536 conn(0x7f57b80a2a00 msgr2=0x7f57b80a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:41.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.112+0000 7f57bcf1a700 1 -- 172.21.15.40:0/3035498536 shutdown_connections 2023-09-30T22:24:41.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.112+0000 7f57bcf1a700 1 -- 172.21.15.40:0/3035498536 wait complete. 2023-09-30T22:24:41.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.114+0000 7f57bcf1a700 1 Processor -- start 2023-09-30T22:24:41.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.114+0000 7f57bcf1a700 1 -- start start 2023-09-30T22:24:41.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.114+0000 7f57bcf1a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57b809d400 0x7f57b8124420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.114+0000 7f57bcf1a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f57b809df20 0x7f57b8124960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.114+0000 7f57bcf1a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57b8138250 0x7f57b8124ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.114+0000 7f57bcf1a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b8126f00 con 0x7f57b8138250 2023-09-30T22:24:41.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.114+0000 7f57bcf1a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b8135880 con 0x7f57b809d400 2023-09-30T22:24:41.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.114+0000 7f57bcf1a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f57b8127f40 con 0x7f57b809df20 2023-09-30T22:24:41.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.115+0000 7f57b659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57b809d400 0x7f57b8124420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.115+0000 7f57b5d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f57b809df20 0x7f57b8124960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.115+0000 7f57b659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57b809d400 0x7f57b8124420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60448/0 (socket says 172.21.15.40:60448) 2023-09-30T22:24:41.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.115+0000 7f57b659c700 1 -- 172.21.15.40:0/2779725128 learned_addr learned my addr 172.21.15.40:0/2779725128 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:41.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.115+0000 7f57b6d9d700 1 --2- 172.21.15.40:0/2779725128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57b8138250 0x7f57b8124ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.115+0000 7f57b659c700 1 -- 172.21.15.40:0/2779725128 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f57b809df20 msgr2=0x7f57b8124960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.115+0000 7f57b659c700 1 --2- 172.21.15.40:0/2779725128 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f57b809df20 0x7f57b8124960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.115+0000 7f57b659c700 1 -- 172.21.15.40:0/2779725128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57b8138250 msgr2=0x7f57b8124ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.115+0000 7f57b659c700 1 --2- 172.21.15.40:0/2779725128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57b8138250 0x7f57b8124ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.115+0000 7f57b659c700 1 -- 172.21.15.40:0/2779725128 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a80094a0 con 0x7f57b809d400 2023-09-30T22:24:41.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.115+0000 7f57b659c700 1 --2- 172.21.15.40:0/2779725128 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57b809d400 0x7f57b8124420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f57a800ebe0 tx=0x7f57a800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:41.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.115+0000 7f57a6ffd700 1 -- 172.21.15.40:0/2779725128 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a800c850 con 0x7f57b809d400 2023-09-30T22:24:41.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.115+0000 7f57a6ffd700 1 -- 172.21.15.40:0/2779725128 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a800c9b0 con 0x7f57b809d400 2023-09-30T22:24:41.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.115+0000 7f57a6ffd700 1 -- 172.21.15.40:0/2779725128 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a800cd40 con 0x7f57b809d400 2023-09-30T22:24:41.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.116+0000 7f57bcf1a700 1 -- 172.21.15.40:0/2779725128 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b0009a70 con 0x7f57b809d400 2023-09-30T22:24:41.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.117+0000 7f57bcf1a700 1 -- 172.21.15.40:0/2779725128 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b8127280 con 0x7f57b809d400 2023-09-30T22:24:41.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.117+0000 7f57a6ffd700 1 -- 172.21.15.40:0/2779725128 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f57a8013470 con 0x7f57b809d400 2023-09-30T22:24:41.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.118+0000 7f57bcf1a700 1 -- 172.21.15.40:0/2779725128 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b8070dc0 con 0x7f57b809d400 2023-09-30T22:24:41.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.118+0000 7f57a6ffd700 1 -- 172.21.15.40:0/2779725128 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4094+0+0 (secure 0 0 0) 0x7f57a803fd10 con 0x7f57b809d400 2023-09-30T22:24:41.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.126+0000 7f57a6ffd700 1 -- 172.21.15.40:0/2779725128 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f57a8013720 con 0x7f57b809d400 2023-09-30T22:24:41.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.410+0000 7f57bcf1a700 1 -- 172.21.15.40:0/2779725128 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57b8062380 con 0x7f57b809d400 2023-09-30T22:24:41.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.411+0000 7f57a6ffd700 1 -- 172.21.15.40:0/2779725128 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+12029 (secure 0 0 0) 0x7f57a8017070 con 0x7f57b809d400 2023-09-30T22:24:41.412 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:24:41.412 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":31,"fsid":"79dd4d8e-f295-4d9c-bd93-9850863800e3","created":"2023-09-30T22:21:46.980357+0000","modified":"2023-09-30T22:24:40.564798+0000","last_up_change":"2023-09-30T22:24:37.547345+0000","last_in_change":"2023-09-30T22:21:48.205613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:21:54.875024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:21:56.197012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:22:00.759069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:22:01.327265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"771f785c-f464-4b17-936c-cbf31b1153e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6812","nonce":119451}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6813","nonce":119451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6815","nonce":119451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6814","nonce":119451}]},"public_addr":"172.21.15.40:6812/119451","cluster_addr":"172.21.15.40:6813/119451","heartbeat_back_addr":"172.21.15.40:6815/119451","heartbeat_front_addr":"172.21.15.40:6814/119451","state":["exists"]},{"osd":1,"uuid":"45f1e2e8-5310-4219-ab54-424e7440fcea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":26,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6808","nonce":119436}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6809","nonce":119436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6811","nonce":119436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6810","nonce":119436}]},"public_addr":"172.21.15.40:6808/119436","cluster_addr":"172.21.15.40:6809/119436","heartbeat_back_addr":"172.21.15.40:6811/119436","heartbeat_front_addr":"172.21.15.40:6810/119436","state":["exists"]},{"osd":2,"uuid":"7ba62ae5-d21e-4d56-b46c-ba7b718ede25","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":27,"down_at":28,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6800","nonce":119433}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6801","nonce":119433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6803","nonce":119433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6802","nonce":119433}]},"public_addr":"172.21.15.40:6800/119433","cluster_addr":"172.21.15.40:6801/119433","heartbeat_back_addr":"172.21.15.40:6803/119433","heartbeat_front_addr":"172.21.15.40:6802/119433","state":["exists"]},{"osd":3,"uuid":"c9c55985-8a90-4927-a8fa-6a1fcec1cd3d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":28,"down_at":29,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6804","nonce":119432}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6805","nonce":119432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6807","nonce":119432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6806","nonce":119432}]},"public_addr":"172.21.15.40:6804/119432","cluster_addr":"172.21.15.40:6805/119432","heartbeat_back_addr":"172.21.15.40:6807/119432","heartbeat_front_addr":"172.21.15.40:6806/119432","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.339829+0000","dead_epoch":26},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.554690+0000","dead_epoch":27},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.641664+0000","dead_epoch":28},{"osd":3,"down_stamp":"2023-09-30T22:24:37.547345+0000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.320635+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2},{"from":1,"to":0}]},{"pgid":"4.1","mappings":[{"from":3,"to":0}]},{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.12","mappings":[{"from":3,"to":0}]},{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":3,"to":2},{"from":1,"to":0}]},{"pgid":"4.2c","mappings":[{"from":1,"to":2}]},{"pgid":"4.3f","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:0/1890660785":"2023-10-01T22:24:24.127340+0000","172.21.15.40:0/1764460125":"2023-10-01T22:24:24.127340+0000","172.21.15.40:6816/118905":"2023-10-01T22:24:24.127340+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:24:41.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.414+0000 7f57bcf1a700 1 -- 172.21.15.40:0/2779725128 >> v1:172.21.15.40:6816/127432 conn(0x7f579802f510 legacy=0x7f57980319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.414+0000 7f57bcf1a700 1 -- 172.21.15.40:0/2779725128 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57b809d400 msgr2=0x7f57b8124420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.414+0000 7f57bcf1a700 1 --2- 172.21.15.40:0/2779725128 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57b809d400 0x7f57b8124420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f57a800ebe0 tx=0x7f57a800eef0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.414+0000 7f57bcf1a700 1 -- 172.21.15.40:0/2779725128 shutdown_connections 2023-09-30T22:24:41.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.414+0000 7f57bcf1a700 1 --2- 172.21.15.40:0/2779725128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57b8138250 0x7f57b8124ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.414+0000 7f57bcf1a700 1 --2- 172.21.15.40:0/2779725128 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57b809d400 0x7f57b8124420 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.414+0000 7f57bcf1a700 1 --2- 172.21.15.40:0/2779725128 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f57b809df20 0x7f57b8124960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.414+0000 7f57bcf1a700 1 -- 172.21.15.40:0/2779725128 >> 172.21.15.40:0/2779725128 conn(0x7f57b80a2a00 msgr2=0x7f57b81376a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:41.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.414+0000 7f57bcf1a700 1 -- 172.21.15.40:0/2779725128 shutdown_connections 2023-09-30T22:24:41.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:41.414+0000 7f57bcf1a700 1 -- 172.21.15.40:0/2779725128 wait complete. 2023-09-30T22:24:41.569 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-09-30T22:24:41.568+0000 7f0be2fbc700 -1 osd.1 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:24:42.117 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-09-30T22:24:42.115+0000 7fd978538680 -1 osd.3 28 log_to_monitors true 2023-09-30T22:24:42.553 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-09-30T22:24:42.553+0000 7fb947848700 -1 osd.2 27 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:24:43.503 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-09-30T22:24:43.502+0000 7fd9644b3700 -1 osd.3 28 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:24:44.431 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:24:44.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.570+0000 7fb57d691700 1 Processor -- start 2023-09-30T22:24:44.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.570+0000 7fb57d691700 1 -- start start 2023-09-30T22:24:44.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.570+0000 7fb57d691700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb57812ec40 0x7fb578136a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.570+0000 7fb57d691700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb578136f80 0x7fb578139360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.570+0000 7fb57d691700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb57809aad0 con 0x7fb57809da20 2023-09-30T22:24:44.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.570+0000 7fb57d691700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb57809b220 con 0x7fb57812ec40 2023-09-30T22:24:44.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.570+0000 7fb57d691700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb57812f0b0 con 0x7fb578136f80 2023-09-30T22:24:44.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.570+0000 7fb5767fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb57812ec40 0x7fb578136a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.570+0000 7fb5777fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb578136f80 0x7fb578139360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.570+0000 7fb576ffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb57809da20 0x7fb57812e530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38408/0 (socket says 172.21.15.40:38408) 2023-09-30T22:24:44.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.570+0000 7fb576ffd700 1 -- 172.21.15.40:0/3690060282 learned_addr learned my addr 172.21.15.40:0/3690060282 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:24:44.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.571+0000 7fb575ffb700 1 -- 172.21.15.40:0/3690060282 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4005931703 0 0) 0x7fb57809aad0 con 0x7fb57809da20 2023-09-30T22:24:44.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.571+0000 7fb575ffb700 1 -- 172.21.15.40:0/3690060282 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5600035b0 con 0x7fb57809da20 2023-09-30T22:24:44.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.571+0000 7fb5777fe700 1 -- 172.21.15.40:0/3690060282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb57812ec40 msgr2=0x7fb578136a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:44.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.571+0000 7fb5777fe700 1 --2- 172.21.15.40:0/3690060282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb57812ec40 0x7fb578136a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.571+0000 7fb5777fe700 1 -- 172.21.15.40:0/3690060282 >> v1:172.21.15.40:6789/0 conn(0x7fb57809da20 legacy=0x7fb57812e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.571+0000 7fb5777fe700 1 -- 172.21.15.40:0/3690060282 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57812e1b0 con 0x7fb578136f80 2023-09-30T22:24:44.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.571+0000 7fb5767fc700 1 --2- 172.21.15.40:0/3690060282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb57812ec40 0x7fb578136a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:44.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.571+0000 7fb5777fe700 1 --2- 172.21.15.40:0/3690060282 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb578136f80 0x7fb578139360 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb570009dc0 tx=0x7fb57000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15938a88bc8dd3e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:44.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.571+0000 7fb575ffb700 1 -- 172.21.15.40:0/3690060282 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57000e070 con 0x7fb578136f80 2023-09-30T22:24:44.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.571+0000 7fb575ffb700 1 -- 172.21.15.40:0/3690060282 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57000bb20 con 0x7fb578136f80 2023-09-30T22:24:44.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.571+0000 7fb575ffb700 1 -- 172.21.15.40:0/3690060282 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb570012430 con 0x7fb578136f80 2023-09-30T22:24:44.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.572+0000 7fb57d691700 1 -- 172.21.15.40:0/3690060282 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb578136f80 msgr2=0x7fb578139360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.572+0000 7fb57d691700 1 --2- 172.21.15.40:0/3690060282 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb578136f80 0x7fb578139360 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb570009dc0 tx=0x7fb57000b330 comp rx=0 tx=0).stop 2023-09-30T22:24:44.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.572+0000 7fb57d691700 1 -- 172.21.15.40:0/3690060282 shutdown_connections 2023-09-30T22:24:44.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.572+0000 7fb57d691700 1 --2- 172.21.15.40:0/3690060282 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb578136f80 0x7fb578139360 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.572+0000 7fb57d691700 1 --2- 172.21.15.40:0/3690060282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb57812ec40 0x7fb578136a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.572+0000 7fb57d691700 1 -- 172.21.15.40:0/3690060282 >> 172.21.15.40:0/3690060282 conn(0x7fb57809eb10 msgr2=0x7fb57809ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:44.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.572+0000 7fb57d691700 1 -- 172.21.15.40:0/3690060282 shutdown_connections 2023-09-30T22:24:44.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.572+0000 7fb57d691700 1 -- 172.21.15.40:0/3690060282 wait complete. 2023-09-30T22:24:44.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.573+0000 7fb57d691700 1 Processor -- start 2023-09-30T22:24:44.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.573+0000 7fb57d691700 1 -- start start 2023-09-30T22:24:44.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.573+0000 7fb57d691700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb57809da20 0x7fb578127330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.573+0000 7fb57d691700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb57812ec40 0x7fb578127870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.573+0000 7fb57d691700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb578136f80 0x7fb578127db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.573+0000 7fb57d691700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57812b880 con 0x7fb57812ec40 2023-09-30T22:24:44.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.573+0000 7fb57d691700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb57812aa50 con 0x7fb578136f80 2023-09-30T22:24:44.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.573+0000 7fb57d691700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5780a0fb0 con 0x7fb57809da20 2023-09-30T22:24:44.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.573+0000 7fb5767fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb57812ec40 0x7fb578127870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.573+0000 7fb576ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb57809da20 0x7fb578127330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.573+0000 7fb5777fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb578136f80 0x7fb578127db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.573+0000 7fb5767fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb57812ec40 0x7fb578127870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55630/0 (socket says 172.21.15.40:55630) 2023-09-30T22:24:44.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.573+0000 7fb5767fc700 1 -- 172.21.15.40:0/4149589658 learned_addr learned my addr 172.21.15.40:0/4149589658 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:44.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.573+0000 7fb5777fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb578136f80 0x7fb578127db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:36568/0 (socket says 172.21.15.40:36568) 2023-09-30T22:24:44.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.574+0000 7fb576ffd700 1 -- 172.21.15.40:0/4149589658 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb578136f80 msgr2=0x7fb578127db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.574+0000 7fb576ffd700 1 --2- 172.21.15.40:0/4149589658 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb578136f80 0x7fb578127db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.574+0000 7fb576ffd700 1 -- 172.21.15.40:0/4149589658 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb57812ec40 msgr2=0x7fb578127870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.574+0000 7fb576ffd700 1 --2- 172.21.15.40:0/4149589658 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb57812ec40 0x7fb578127870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.574+0000 7fb576ffd700 1 -- 172.21.15.40:0/4149589658 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb56c0094a0 con 0x7fb57809da20 2023-09-30T22:24:44.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.574+0000 7fb5767fc700 1 --2- 172.21.15.40:0/4149589658 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb57812ec40 0x7fb578127870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:44.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.574+0000 7fb576ffd700 1 --2- 172.21.15.40:0/4149589658 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb57809da20 0x7fb578127330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb568001360 tx=0x7fb56800c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:44.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.574+0000 7fb55f7fe700 1 -- 172.21.15.40:0/4149589658 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5680072d0 con 0x7fb57809da20 2023-09-30T22:24:44.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.574+0000 7fb55f7fe700 1 -- 172.21.15.40:0/4149589658 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb568007430 con 0x7fb57809da20 2023-09-30T22:24:44.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.574+0000 7fb55f7fe700 1 -- 172.21.15.40:0/4149589658 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb568005830 con 0x7fb57809da20 2023-09-30T22:24:44.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.574+0000 7fb57d691700 1 -- 172.21.15.40:0/4149589658 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb570009a70 con 0x7fb57809da20 2023-09-30T22:24:44.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.574+0000 7fb57d691700 1 -- 172.21.15.40:0/4149589658 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb57809c520 con 0x7fb57809da20 2023-09-30T22:24:44.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.575+0000 7fb55f7fe700 1 -- 172.21.15.40:0/4149589658 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb568005ba0 con 0x7fb57809da20 2023-09-30T22:24:44.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.575+0000 7fb55f7fe700 1 -- 172.21.15.40:0/4149589658 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4094+0+0 (secure 0 0 0) 0x7fb56803f1f0 con 0x7fb57809da20 2023-09-30T22:24:44.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.575+0000 7fb57d691700 1 -- 172.21.15.40:0/4149589658 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb578129360 con 0x7fb57809da20 2023-09-30T22:24:44.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.580+0000 7fb55f7fe700 1 -- 172.21.15.40:0/4149589658 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb568017030 con 0x7fb57809da20 2023-09-30T22:24:44.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.797+0000 7fb57d691700 1 -- 172.21.15.40:0/4149589658 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb578062380 con 0x7fb57809da20 2023-09-30T22:24:44.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.799+0000 7fb55f7fe700 1 -- 172.21.15.40:0/4149589658 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+13031 (secure 0 0 0) 0x7fb568017020 con 0x7fb57809da20 2023-09-30T22:24:44.799 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:24:44.799 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"fsid":"79dd4d8e-f295-4d9c-bd93-9850863800e3","created":"2023-09-30T22:21:46.980357+0000","modified":"2023-09-30T22:24:44.607582+0000","last_up_change":"2023-09-30T22:24:43.600612+0000","last_in_change":"2023-09-30T22:21:48.205613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:21:54.875024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:21:56.197012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:22:00.759069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:22:01.327265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"771f785c-f464-4b17-936c-cbf31b1153e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":32,"up_thru":34,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6808","nonce":130098}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6809","nonce":130098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6811","nonce":130098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6810","nonce":130098}]},"public_addr":"172.21.15.40:6808/130098","cluster_addr":"172.21.15.40:6809/130098","heartbeat_back_addr":"172.21.15.40:6811/130098","heartbeat_front_addr":"172.21.15.40:6810/130098","state":["exists","up"]},{"osd":1,"uuid":"45f1e2e8-5310-4219-ab54-424e7440fcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":33,"up_thru":34,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6800","nonce":130196}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6801","nonce":130196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6803","nonce":130196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6802","nonce":130196}]},"public_addr":"172.21.15.40:6800/130196","cluster_addr":"172.21.15.40:6801/130196","heartbeat_back_addr":"172.21.15.40:6803/130196","heartbeat_front_addr":"172.21.15.40:6802/130196","state":["exists","up"]},{"osd":2,"uuid":"7ba62ae5-d21e-4d56-b46c-ba7b718ede25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":27,"up_from":33,"up_thru":34,"down_at":28,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6804","nonce":130328}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6805","nonce":130328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6807","nonce":130328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6806","nonce":130328}]},"public_addr":"172.21.15.40:6804/130328","cluster_addr":"172.21.15.40:6805/130328","heartbeat_back_addr":"172.21.15.40:6807/130328","heartbeat_front_addr":"172.21.15.40:6806/130328","state":["exists","up"]},{"osd":3,"uuid":"c9c55985-8a90-4927-a8fa-6a1fcec1cd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":28,"up_from":34,"up_thru":34,"down_at":29,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6812","nonce":130646}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6813","nonce":130646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6815","nonce":130646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6814","nonce":130646}]},"public_addr":"172.21.15.40:6812/130646","cluster_addr":"172.21.15.40:6813/130646","heartbeat_back_addr":"172.21.15.40:6815/130646","heartbeat_front_addr":"172.21.15.40:6814/130646","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.339829+0000","dead_epoch":26},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.554690+0000","dead_epoch":27},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.641664+0000","dead_epoch":28},{"osd":3,"down_stamp":"2023-09-30T22:24:37.547345+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.320635+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2},{"from":1,"to":0}]},{"pgid":"4.1","mappings":[{"from":3,"to":0}]},{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.12","mappings":[{"from":3,"to":0}]},{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":3,"to":2},{"from":1,"to":0}]},{"pgid":"4.2c","mappings":[{"from":1,"to":2}]},{"pgid":"4.3f","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:0/1890660785":"2023-10-01T22:24:24.127340+0000","172.21.15.40:0/1764460125":"2023-10-01T22:24:24.127340+0000","172.21.15.40:6816/118905":"2023-10-01T22:24:24.127340+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:24:44.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.801+0000 7fb57d691700 1 -- 172.21.15.40:0/4149589658 >> v1:172.21.15.40:6816/127432 conn(0x7fb56402f510 legacy=0x7fb5640319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.801+0000 7fb57d691700 1 -- 172.21.15.40:0/4149589658 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb57809da20 msgr2=0x7fb578127330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.801+0000 7fb57d691700 1 --2- 172.21.15.40:0/4149589658 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb57809da20 0x7fb578127330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb568001360 tx=0x7fb56800c6e0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.801+0000 7fb57d691700 1 -- 172.21.15.40:0/4149589658 shutdown_connections 2023-09-30T22:24:44.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.801+0000 7fb57d691700 1 --2- 172.21.15.40:0/4149589658 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb57809da20 0x7fb578127330 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.801+0000 7fb57d691700 1 --2- 172.21.15.40:0/4149589658 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb578136f80 0x7fb578127db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.801+0000 7fb57d691700 1 --2- 172.21.15.40:0/4149589658 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb57812ec40 0x7fb578127870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.801+0000 7fb57d691700 1 -- 172.21.15.40:0/4149589658 >> 172.21.15.40:0/4149589658 conn(0x7fb57809eb10 msgr2=0x7fb57809ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:44.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.801+0000 7fb57d691700 1 -- 172.21.15.40:0/4149589658 shutdown_connections 2023-09-30T22:24:44.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:44.801+0000 7fb57d691700 1 -- 172.21.15.40:0/4149589658 wait complete. 2023-09-30T22:24:44.813 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-30T22:24:44.814 INFO:teuthology.run_tasks:Running task ceph.stop... 2023-09-30T22:24:44.824 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-30T22:24:44.824 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:24:44.835 INFO:tasks.ceph.mds.a:Stopped 2023-09-30T22:24:50.551 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog finished 2023-09-30T22:24:50.552 INFO:teuthology.run_tasks:Running task ceph.restart... 2023-09-30T22:24:50.564 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2023-09-30T22:24:50.564 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-30T22:24:50.565 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-30T22:24:50.568 INFO:tasks.ceph.mds.a:Started 2023-09-30T22:24:50.568 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-30T22:24:50.568 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:24:50.664 INFO:tasks.ceph.mds.a.smithi040.stdout:starting mds.a at 2023-09-30T22:24:50.682 INFO:tasks.ceph.mon.a.smithi040.stderr:2023-09-30T22:24:50.683+0000 7f632bd71700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-30T22:24:50.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.720+0000 7fdfb39d4700 1 Processor -- start 2023-09-30T22:24:50.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.721+0000 7fdfb39d4700 1 -- start start 2023-09-30T22:24:50.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.721+0000 7fdfb39d4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdfac09c890 0x7fdfac09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:50.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.721+0000 7fdfb39d4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdfac09e480 0x7fdfac13bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:50.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.721+0000 7fdfb39d4700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfac0a2600 con 0x7fdfac09d920 2023-09-30T22:24:50.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.721+0000 7fdfb39d4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfac0a29d0 con 0x7fdfac09c890 2023-09-30T22:24:50.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.721+0000 7fdfb39d4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac09fb40 con 0x7fdfac09e480 2023-09-30T22:24:50.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.721+0000 7fdfb1770700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdfac09c890 0x7fdfac09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:50.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.721+0000 7fdfb1f71700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdfac09e480 0x7fdfac13bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:50.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.721+0000 7fdfb0f6f700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fdfac09d920 0x7fdfac09dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38436/0 (socket says 172.21.15.40:38436) 2023-09-30T22:24:50.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.721+0000 7fdfb0f6f700 1 -- 172.21.15.40:0/3518164346 learned_addr learned my addr 172.21.15.40:0/3518164346 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:24:50.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.721+0000 7fdfb1770700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdfac09c890 0x7fdfac09cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55660/0 (socket says 172.21.15.40:55660) 2023-09-30T22:24:50.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.721+0000 7fdfb1f71700 1 -- 172.21.15.40:0/3518164346 >> v2:172.21.15.40:3300/0 conn(0x7fdfac09c890 msgr2=0x7fdfac09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:50.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.721+0000 7fdfb1f71700 1 --2- 172.21.15.40:0/3518164346 >> v2:172.21.15.40:3300/0 conn(0x7fdfac09c890 0x7fdfac09cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:50.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.721+0000 7fdfb1f71700 1 -- 172.21.15.40:0/3518164346 >> v1:172.21.15.40:6789/0 conn(0x7fdfac09d920 legacy=0x7fdfac09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:50.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.722+0000 7fdfb1f71700 1 -- 172.21.15.40:0/3518164346 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfac09fed0 con 0x7fdfac09e480 2023-09-30T22:24:50.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.721+0000 7fdfa3fff700 1 -- 172.21.15.40:0/3518164346 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1661286696 0 0) 0x7fdfac0a2600 con 0x7fdfac09d920 2023-09-30T22:24:50.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.722+0000 7fdfb1770700 1 --2- 172.21.15.40:0/3518164346 >> v2:172.21.15.40:3300/0 conn(0x7fdfac09c890 0x7fdfac09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:50.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.722+0000 7fdfb1f71700 1 --2- 172.21.15.40:0/3518164346 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdfac09e480 0x7fdfac13bc20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4009d90 tx=0x7fdfa400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76f18c61fcaa7c94 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:50.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.722+0000 7fdfa3fff700 1 -- 172.21.15.40:0/3518164346 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa400e070 con 0x7fdfac09e480 2023-09-30T22:24:50.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.722+0000 7fdfa3fff700 1 -- 172.21.15.40:0/3518164346 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa400bb20 con 0x7fdfac09e480 2023-09-30T22:24:50.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.722+0000 7fdfa3fff700 1 -- 172.21.15.40:0/3518164346 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4012430 con 0x7fdfac09e480 2023-09-30T22:24:50.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.722+0000 7fdfb39d4700 1 -- 172.21.15.40:0/3518164346 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdfac09e480 msgr2=0x7fdfac13bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:50.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.722+0000 7fdfb39d4700 1 --2- 172.21.15.40:0/3518164346 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdfac09e480 0x7fdfac13bc20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4009d90 tx=0x7fdfa400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:50.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.722+0000 7fdfb39d4700 1 -- 172.21.15.40:0/3518164346 shutdown_connections 2023-09-30T22:24:50.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.722+0000 7fdfb39d4700 1 --2- 172.21.15.40:0/3518164346 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdfac09e480 0x7fdfac13bc20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:50.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.722+0000 7fdfb39d4700 1 --2- 172.21.15.40:0/3518164346 >> v2:172.21.15.40:3300/0 conn(0x7fdfac09c890 0x7fdfac09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:50.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.722+0000 7fdfb39d4700 1 -- 172.21.15.40:0/3518164346 >> 172.21.15.40:0/3518164346 conn(0x7fdfac0a7080 msgr2=0x7fdfac0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:50.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.722+0000 7fdfb39d4700 1 -- 172.21.15.40:0/3518164346 shutdown_connections 2023-09-30T22:24:50.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.723+0000 7fdfb39d4700 1 -- 172.21.15.40:0/3518164346 wait complete. 2023-09-30T22:24:50.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.723+0000 7fdfb39d4700 1 Processor -- start 2023-09-30T22:24:50.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.723+0000 7fdfb39d4700 1 -- start start 2023-09-30T22:24:50.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.724+0000 7fdfb39d4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdfac09c890 0x7fdfac12f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:50.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.724+0000 7fdfb39d4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfac09d920 0x7fdfac12fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:50.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.724+0000 7fdfb39d4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdfac09e480 0x7fdfac12ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:50.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.724+0000 7fdfb39d4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac12e960 con 0x7fdfac09d920 2023-09-30T22:24:50.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.724+0000 7fdfb39d4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac12f320 con 0x7fdfac09c890 2023-09-30T22:24:50.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.724+0000 7fdfb39d4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac12dc80 con 0x7fdfac09e480 2023-09-30T22:24:50.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.724+0000 7fdfb1770700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdfac09c890 0x7fdfac12f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:50.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.724+0000 7fdfb1f71700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdfac09e480 0x7fdfac12ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:50.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.724+0000 7fdfb0f6f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfac09d920 0x7fdfac12fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:50.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.724+0000 7fdfb1770700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdfac09c890 0x7fdfac12f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:36572/0 (socket says 172.21.15.40:36572) 2023-09-30T22:24:50.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.724+0000 7fdfb1770700 1 -- 172.21.15.40:0/3470191519 learned_addr learned my addr 172.21.15.40:0/3470191519 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:50.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.724+0000 7fdfb1f71700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdfac09e480 0x7fdfac12ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:34632/0 (socket says 172.21.15.40:34632) 2023-09-30T22:24:50.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.724+0000 7fdfb0f6f700 1 --2- 172.21.15.40:0/3470191519 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfac09d920 0x7fdfac12fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55672/0 (socket says 172.21.15.40:55672) 2023-09-30T22:24:50.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.724+0000 7fdfb1770700 1 -- 172.21.15.40:0/3470191519 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdfac09e480 msgr2=0x7fdfac12ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:50.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.724+0000 7fdfb1770700 1 --2- 172.21.15.40:0/3470191519 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdfac09e480 0x7fdfac12ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:50.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.724+0000 7fdfb1770700 1 -- 172.21.15.40:0/3470191519 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfac09d920 msgr2=0x7fdfac12fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:50.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.724+0000 7fdfb1770700 1 --2- 172.21.15.40:0/3470191519 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfac09d920 0x7fdfac12fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:50.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.724+0000 7fdfb1770700 1 -- 172.21.15.40:0/3470191519 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa8009430 con 0x7fdfac09c890 2023-09-30T22:24:50.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.724+0000 7fdfb1770700 1 --2- 172.21.15.40:0/3470191519 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdfac09c890 0x7fdfac12f540 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdfa800ec10 tx=0x7fdfa800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:50.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.725+0000 7fdfa1ffb700 1 -- 172.21.15.40:0/3470191519 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8009740 con 0x7fdfac09c890 2023-09-30T22:24:50.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.725+0000 7fdfa1ffb700 1 -- 172.21.15.40:0/3470191519 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa8005a20 con 0x7fdfac09c890 2023-09-30T22:24:50.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.725+0000 7fdfa1ffb700 1 -- 172.21.15.40:0/3470191519 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8005d90 con 0x7fdfac09c890 2023-09-30T22:24:50.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.725+0000 7fdfb39d4700 1 -- 172.21.15.40:0/3470191519 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfa4009a70 con 0x7fdfac09c890 2023-09-30T22:24:50.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.725+0000 7fdfb39d4700 1 -- 172.21.15.40:0/3470191519 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfac09ecf0 con 0x7fdfac09c890 2023-09-30T22:24:50.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.725+0000 7fdfa1ffb700 1 -- 172.21.15.40:0/3470191519 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fdfa800c850 con 0x7fdfac09c890 2023-09-30T22:24:50.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.726+0000 7fdfa1ffb700 1 -- 172.21.15.40:0/3470191519 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4137+0+0 (secure 0 0 0) 0x7fdfa803fdd0 con 0x7fdfac09c890 2023-09-30T22:24:50.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.726+0000 7fdfb39d4700 1 -- 172.21.15.40:0/3470191519 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfac06e600 con 0x7fdfac09c890 2023-09-30T22:24:50.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.731+0000 7fdfa1ffb700 1 -- 172.21.15.40:0/3470191519 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdfa8020020 con 0x7fdfac09c890 2023-09-30T22:24:50.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.926+0000 7fdfb39d4700 1 -- 172.21.15.40:0/3470191519 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdfac062380 con 0x7fdfac09c890 2023-09-30T22:24:50.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.927+0000 7fdfa1ffb700 1 -- 172.21.15.40:0/3470191519 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+13096 (secure 0 0 0) 0x7fdfa8006030 con 0x7fdfac09c890 2023-09-30T22:24:50.926 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:24:50.927 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":36,"fsid":"79dd4d8e-f295-4d9c-bd93-9850863800e3","created":"2023-09-30T22:21:46.980357+0000","modified":"2023-09-30T22:24:50.682751+0000","last_up_change":"2023-09-30T22:24:43.600612+0000","last_in_change":"2023-09-30T22:21:48.205613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:21:54.875024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:21:56.197012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:22:00.759069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:22:01.327265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"771f785c-f464-4b17-936c-cbf31b1153e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":32,"up_thru":34,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6808","nonce":130098}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6809","nonce":130098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6811","nonce":130098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6810","nonce":130098}]},"public_addr":"172.21.15.40:6808/130098","cluster_addr":"172.21.15.40:6809/130098","heartbeat_back_addr":"172.21.15.40:6811/130098","heartbeat_front_addr":"172.21.15.40:6810/130098","state":["exists","up"]},{"osd":1,"uuid":"45f1e2e8-5310-4219-ab54-424e7440fcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":33,"up_thru":34,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6800","nonce":130196}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6801","nonce":130196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6803","nonce":130196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6802","nonce":130196}]},"public_addr":"172.21.15.40:6800/130196","cluster_addr":"172.21.15.40:6801/130196","heartbeat_back_addr":"172.21.15.40:6803/130196","heartbeat_front_addr":"172.21.15.40:6802/130196","state":["exists","up"]},{"osd":2,"uuid":"7ba62ae5-d21e-4d56-b46c-ba7b718ede25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":27,"up_from":33,"up_thru":34,"down_at":28,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6804","nonce":130328}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6805","nonce":130328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6807","nonce":130328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6806","nonce":130328}]},"public_addr":"172.21.15.40:6804/130328","cluster_addr":"172.21.15.40:6805/130328","heartbeat_back_addr":"172.21.15.40:6807/130328","heartbeat_front_addr":"172.21.15.40:6806/130328","state":["exists","up"]},{"osd":3,"uuid":"c9c55985-8a90-4927-a8fa-6a1fcec1cd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":28,"up_from":34,"up_thru":34,"down_at":29,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6812","nonce":130646}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6813","nonce":130646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6815","nonce":130646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6814","nonce":130646}]},"public_addr":"172.21.15.40:6812/130646","cluster_addr":"172.21.15.40:6813/130646","heartbeat_back_addr":"172.21.15.40:6815/130646","heartbeat_front_addr":"172.21.15.40:6814/130646","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.339829+0000","dead_epoch":26},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.554690+0000","dead_epoch":27},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.641664+0000","dead_epoch":28},{"osd":3,"down_stamp":"2023-09-30T22:24:37.547345+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.320635+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2},{"from":1,"to":0}]},{"pgid":"4.1","mappings":[{"from":3,"to":0}]},{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.12","mappings":[{"from":3,"to":0}]},{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":3,"to":2},{"from":1,"to":0}]},{"pgid":"4.2c","mappings":[{"from":1,"to":2}]},{"pgid":"4.3f","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:6817/2392027806":"2023-10-01T22:24:50.682728+0000","172.21.15.40:0/1890660785":"2023-10-01T22:24:24.127340+0000","172.21.15.40:0/1764460125":"2023-10-01T22:24:24.127340+0000","172.21.15.40:6816/118905":"2023-10-01T22:24:24.127340+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:24:50.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.929+0000 7fdfb39d4700 1 -- 172.21.15.40:0/3470191519 >> v1:172.21.15.40:6816/127432 conn(0x7fdf9002f510 legacy=0x7fdf900319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:50.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.929+0000 7fdfb39d4700 1 -- 172.21.15.40:0/3470191519 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdfac09c890 msgr2=0x7fdfac12f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:50.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.929+0000 7fdfb39d4700 1 --2- 172.21.15.40:0/3470191519 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdfac09c890 0x7fdfac12f540 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdfa800ec10 tx=0x7fdfa800ef20 comp rx=0 tx=0).stop 2023-09-30T22:24:50.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.929+0000 7fdfb39d4700 1 -- 172.21.15.40:0/3470191519 shutdown_connections 2023-09-30T22:24:50.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.929+0000 7fdfb39d4700 1 --2- 172.21.15.40:0/3470191519 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdfac09e480 0x7fdfac12ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:50.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.929+0000 7fdfb39d4700 1 --2- 172.21.15.40:0/3470191519 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdfac09c890 0x7fdfac12f540 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:50.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.929+0000 7fdfb39d4700 1 --2- 172.21.15.40:0/3470191519 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfac09d920 0x7fdfac12fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:50.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.929+0000 7fdfb39d4700 1 -- 172.21.15.40:0/3470191519 >> 172.21.15.40:0/3470191519 conn(0x7fdfac0a7080 msgr2=0x7fdfac1bb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:50.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.929+0000 7fdfb39d4700 1 -- 172.21.15.40:0/3470191519 shutdown_connections 2023-09-30T22:24:50.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:50.929+0000 7fdfb39d4700 1 -- 172.21.15.40:0/3470191519 wait complete. 2023-09-30T22:24:50.941 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-30T22:24:50.941 INFO:teuthology.run_tasks:Running task exec... 2023-09-30T22:24:50.952 INFO:teuthology.task.exec:Executing custom commands... 2023-09-30T22:24:50.952 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi040.front.sepia.ceph.com 2023-09-30T22:24:50.952 DEBUG:teuthology.orchestra.run.smithi040:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd dump -f json-pretty' 2023-09-30T22:24:51.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.075+0000 7f5c57022700 1 Processor -- start 2023-09-30T22:24:51.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.075+0000 7f5c57022700 1 -- start start 2023-09-30T22:24:51.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.076+0000 7f5c57022700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c50130a50 0x7f5c5009b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.076+0000 7f5c57022700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5c5009dc00 0x7f5c50130e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.076+0000 7f5c57022700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c5009a590 0x7f5c5009aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.076+0000 7f5c57022700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c50130500 con 0x7f5c5009dc00 2023-09-30T22:24:51.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.076+0000 7f5c57022700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5009bea0 con 0x7f5c5009a590 2023-09-30T22:24:51.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.076+0000 7f5c57022700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5009e5a0 con 0x7f5c50130a50 2023-09-30T22:24:51.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.076+0000 7f5c4ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5c5009dc00 0x7f5c50130e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.076+0000 7f5c555bf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c5009a590 0x7f5c5009aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.076+0000 7f5c4ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5c5009dc00 0x7f5c50130e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55678/0 (socket says 172.21.15.40:55678) 2023-09-30T22:24:51.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.076+0000 7f5c4ffff700 1 -- 172.21.15.40:0/2300613006 learned_addr learned my addr 172.21.15.40:0/2300613006 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:51.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.076+0000 7f5c54dbe700 1 --2- 172.21.15.40:0/2300613006 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c50130a50 0x7f5c5009b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.076+0000 7f5c555bf700 1 -- 172.21.15.40:0/2300613006 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c50130a50 msgr2=0x7f5c5009b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:51.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.076+0000 7f5c555bf700 1 --2- 172.21.15.40:0/2300613006 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c50130a50 0x7f5c5009b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.076+0000 7f5c555bf700 1 -- 172.21.15.40:0/2300613006 >> v2:172.21.15.40:3300/0 conn(0x7f5c5009dc00 msgr2=0x7f5c50130e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:51.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.076+0000 7f5c555bf700 1 --2- 172.21.15.40:0/2300613006 >> v2:172.21.15.40:3300/0 conn(0x7f5c5009dc00 0x7f5c50130e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.076+0000 7f5c555bf700 1 -- 172.21.15.40:0/2300613006 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c50131360 con 0x7f5c5009a590 2023-09-30T22:24:51.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.076+0000 7f5c54dbe700 1 --2- 172.21.15.40:0/2300613006 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c50130a50 0x7f5c5009b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:51.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.076+0000 7f5c4ffff700 1 --2- 172.21.15.40:0/2300613006 >> v2:172.21.15.40:3300/0 conn(0x7f5c5009dc00 0x7f5c50130e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:51.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.077+0000 7f5c555bf700 1 --2- 172.21.15.40:0/2300613006 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c5009a590 0x7f5c5009aa30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5c48009d90 tx=0x7f5c4800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a80864f4de292da server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:51.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.077+0000 7f5c4f7fe700 1 -- 172.21.15.40:0/2300613006 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4800e070 con 0x7f5c5009a590 2023-09-30T22:24:51.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.077+0000 7f5c4f7fe700 1 -- 172.21.15.40:0/2300613006 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4800bb20 con 0x7f5c5009a590 2023-09-30T22:24:51.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.077+0000 7f5c4f7fe700 1 -- 172.21.15.40:0/2300613006 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c48012430 con 0x7f5c5009a590 2023-09-30T22:24:51.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.077+0000 7f5c57022700 1 -- 172.21.15.40:0/2300613006 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c5009a590 msgr2=0x7f5c5009aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.077+0000 7f5c57022700 1 --2- 172.21.15.40:0/2300613006 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c5009a590 0x7f5c5009aa30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5c48009d90 tx=0x7f5c4800b330 comp rx=0 tx=0).stop 2023-09-30T22:24:51.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.077+0000 7f5c57022700 1 -- 172.21.15.40:0/2300613006 shutdown_connections 2023-09-30T22:24:51.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.077+0000 7f5c57022700 1 --2- 172.21.15.40:0/2300613006 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c50130a50 0x7f5c5009b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.077+0000 7f5c57022700 1 --2- 172.21.15.40:0/2300613006 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c5009a590 0x7f5c5009aa30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.077+0000 7f5c57022700 1 --2- 172.21.15.40:0/2300613006 >> v2:172.21.15.40:3300/0 conn(0x7f5c5009dc00 0x7f5c50130e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.077+0000 7f5c57022700 1 -- 172.21.15.40:0/2300613006 >> 172.21.15.40:0/2300613006 conn(0x7f5c5009ea80 msgr2=0x7f5c5009ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:51.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.077+0000 7f5c57022700 1 -- 172.21.15.40:0/2300613006 shutdown_connections 2023-09-30T22:24:51.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.077+0000 7f5c57022700 1 -- 172.21.15.40:0/2300613006 wait complete. 2023-09-30T22:24:51.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.078+0000 7f5c57022700 1 Processor -- start 2023-09-30T22:24:51.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.078+0000 7f5c57022700 1 -- start start 2023-09-30T22:24:51.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.079+0000 7f5c57022700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c5009a590 0x7f5c5012c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.079+0000 7f5c57022700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c5009dc00 0x7f5c5012c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.079+0000 7f5c57022700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c50130a50 0x7f5c5012cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.079+0000 7f5c57022700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5008d5c0 con 0x7f5c5009a590 2023-09-30T22:24:51.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.079+0000 7f5c57022700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5012de80 con 0x7f5c50130a50 2023-09-30T22:24:51.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.079+0000 7f5c57022700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c50098ee0 con 0x7f5c5009dc00 2023-09-30T22:24:51.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.079+0000 7f5c54dbe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c5009a590 0x7f5c5012c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.079+0000 7f5c54dbe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c5009a590 0x7f5c5012c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55690/0 (socket says 172.21.15.40:55690) 2023-09-30T22:24:51.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.079+0000 7f5c54dbe700 1 -- 172.21.15.40:0/763380307 learned_addr learned my addr 172.21.15.40:0/763380307 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:51.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.079+0000 7f5c4ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c5009dc00 0x7f5c5012c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.079+0000 7f5c555bf700 1 --2- 172.21.15.40:0/763380307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c50130a50 0x7f5c5012cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.079+0000 7f5c4ffff700 1 -- 172.21.15.40:0/763380307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c50130a50 msgr2=0x7f5c5012cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.079+0000 7f5c4ffff700 1 --2- 172.21.15.40:0/763380307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c50130a50 0x7f5c5012cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.079+0000 7f5c4ffff700 1 -- 172.21.15.40:0/763380307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c5009a590 msgr2=0x7f5c5012c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.079+0000 7f5c4ffff700 1 --2- 172.21.15.40:0/763380307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c5009a590 0x7f5c5012c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.079+0000 7f5c4ffff700 1 -- 172.21.15.40:0/763380307 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c3c00b7f0 con 0x7f5c5009dc00 2023-09-30T22:24:51.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.079+0000 7f5c54dbe700 1 --2- 172.21.15.40:0/763380307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c5009a590 0x7f5c5012c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:51.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.079+0000 7f5c4ffff700 1 --2- 172.21.15.40:0/763380307 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c5009dc00 0x7f5c5012c7e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00ed40 tx=0x7f5c3c00d630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:51.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.080+0000 7f5c4d7fa700 1 -- 172.21.15.40:0/763380307 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c00dd90 con 0x7f5c5009dc00 2023-09-30T22:24:51.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.080+0000 7f5c4d7fa700 1 -- 172.21.15.40:0/763380307 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3c004030 con 0x7f5c5009dc00 2023-09-30T22:24:51.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.080+0000 7f5c57022700 1 -- 172.21.15.40:0/763380307 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c44009430 con 0x7f5c5009dc00 2023-09-30T22:24:51.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.080+0000 7f5c4d7fa700 1 -- 172.21.15.40:0/763380307 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c0043a0 con 0x7f5c5009dc00 2023-09-30T22:24:51.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.080+0000 7f5c57022700 1 -- 172.21.15.40:0/763380307 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c48009a70 con 0x7f5c5009dc00 2023-09-30T22:24:51.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.080+0000 7f5c4d7fa700 1 -- 172.21.15.40:0/763380307 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5c3c0036a0 con 0x7f5c5009dc00 2023-09-30T22:24:51.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.081+0000 7f5c57022700 1 -- 172.21.15.40:0/763380307 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c50131030 con 0x7f5c5009dc00 2023-09-30T22:24:51.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.081+0000 7f5c4d7fa700 1 -- 172.21.15.40:0/763380307 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f5c3c040120 con 0x7f5c5009dc00 2023-09-30T22:24:51.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.086+0000 7f5c4d7fa700 1 -- 172.21.15.40:0/763380307 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5c3c003950 con 0x7f5c5009dc00 2023-09-30T22:24:51.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.283+0000 7f5c57022700 1 -- 172.21.15.40:0/763380307 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f5c5004f2a0 con 0x7f5c5009dc00 2023-09-30T22:24:51.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.284+0000 7f5c4d7fa700 1 -- 172.21.15.40:0/763380307 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v36) v1 ==== 81+0+24716 (secure 0 0 0) 0x7f5c3c014070 con 0x7f5c5009dc00 2023-09-30T22:24:51.284 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:24:51.284 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-09-30T22:24:51.284 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 36, 2023-09-30T22:24:51.285 INFO:teuthology.orchestra.run.smithi040.stdout: "fsid": "79dd4d8e-f295-4d9c-bd93-9850863800e3", 2023-09-30T22:24:51.285 INFO:teuthology.orchestra.run.smithi040.stdout: "created": "2023-09-30T22:21:46.980357+0000", 2023-09-30T22:24:51.285 INFO:teuthology.orchestra.run.smithi040.stdout: "modified": "2023-09-30T22:24:50.682751+0000", 2023-09-30T22:24:51.285 INFO:teuthology.orchestra.run.smithi040.stdout: "last_up_change": "2023-09-30T22:24:43.600612+0000", 2023-09-30T22:24:51.285 INFO:teuthology.orchestra.run.smithi040.stdout: "last_in_change": "2023-09-30T22:21:48.205613+0000", 2023-09-30T22:24:51.285 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-30T22:24:51.285 INFO:teuthology.orchestra.run.smithi040.stdout: "flags_num": 5799936, 2023-09-30T22:24:51.285 INFO:teuthology.orchestra.run.smithi040.stdout: "flags_set": [ 2023-09-30T22:24:51.285 INFO:teuthology.orchestra.run.smithi040.stdout: "pglog_hardlimit", 2023-09-30T22:24:51.285 INFO:teuthology.orchestra.run.smithi040.stdout: "purged_snapdirs", 2023-09-30T22:24:51.285 INFO:teuthology.orchestra.run.smithi040.stdout: "recovery_deletes", 2023-09-30T22:24:51.285 INFO:teuthology.orchestra.run.smithi040.stdout: "sortbitwise" 2023-09-30T22:24:51.286 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2023-09-30T22:24:51.286 INFO:teuthology.orchestra.run.smithi040.stdout: "crush_version": 8, 2023-09-30T22:24:51.286 INFO:teuthology.orchestra.run.smithi040.stdout: "full_ratio": 0.94999998807907104, 2023-09-30T22:24:51.286 INFO:teuthology.orchestra.run.smithi040.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-09-30T22:24:51.286 INFO:teuthology.orchestra.run.smithi040.stdout: "nearfull_ratio": 0.85000002384185791, 2023-09-30T22:24:51.286 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_snapshot": "", 2023-09-30T22:24:51.286 INFO:teuthology.orchestra.run.smithi040.stdout: "pool_max": 4, 2023-09-30T22:24:51.286 INFO:teuthology.orchestra.run.smithi040.stdout: "max_osd": 4, 2023-09-30T22:24:51.286 INFO:teuthology.orchestra.run.smithi040.stdout: "require_min_compat_client": "pacific", 2023-09-30T22:24:51.286 INFO:teuthology.orchestra.run.smithi040.stdout: "min_compat_client": "luminous", 2023-09-30T22:24:51.286 INFO:teuthology.orchestra.run.smithi040.stdout: "require_osd_release": "pacific", 2023-09-30T22:24:51.287 INFO:teuthology.orchestra.run.smithi040.stdout: "allow_crimson": false, 2023-09-30T22:24:51.287 INFO:teuthology.orchestra.run.smithi040.stdout: "pools": [ 2023-09-30T22:24:51.287 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.287 INFO:teuthology.orchestra.run.smithi040.stdout: "pool": 1, 2023-09-30T22:24:51.287 INFO:teuthology.orchestra.run.smithi040.stdout: "pool_name": ".mgr", 2023-09-30T22:24:51.287 INFO:teuthology.orchestra.run.smithi040.stdout: "create_time": "2023-09-30T22:21:54.875024+0000", 2023-09-30T22:24:51.287 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2023-09-30T22:24:51.287 INFO:teuthology.orchestra.run.smithi040.stdout: "flags_names": "hashpspool", 2023-09-30T22:24:51.287 INFO:teuthology.orchestra.run.smithi040.stdout: "type": 1, 2023-09-30T22:24:51.287 INFO:teuthology.orchestra.run.smithi040.stdout: "size": 2, 2023-09-30T22:24:51.287 INFO:teuthology.orchestra.run.smithi040.stdout: "min_size": 1, 2023-09-30T22:24:51.288 INFO:teuthology.orchestra.run.smithi040.stdout: "crush_rule": 0, 2023-09-30T22:24:51.288 INFO:teuthology.orchestra.run.smithi040.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:24:51.288 INFO:teuthology.orchestra.run.smithi040.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:24:51.288 INFO:teuthology.orchestra.run.smithi040.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:24:51.288 INFO:teuthology.orchestra.run.smithi040.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:24:51.288 INFO:teuthology.orchestra.run.smithi040.stdout: "object_hash": 2, 2023-09-30T22:24:51.288 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:24:51.288 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_num": 1, 2023-09-30T22:24:51.288 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_placement_num": 1, 2023-09-30T22:24:51.288 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_placement_num_target": 1, 2023-09-30T22:24:51.288 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_num_target": 1, 2023-09-30T22:24:51.288 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_num_pending": 1, 2023-09-30T22:24:51.289 INFO:teuthology.orchestra.run.smithi040.stdout: "last_pg_merge_meta": { 2023-09-30T22:24:51.289 INFO:teuthology.orchestra.run.smithi040.stdout: "source_pgid": "0.0", 2023-09-30T22:24:51.289 INFO:teuthology.orchestra.run.smithi040.stdout: "ready_epoch": 0, 2023-09-30T22:24:51.289 INFO:teuthology.orchestra.run.smithi040.stdout: "last_epoch_started": 0, 2023-09-30T22:24:51.289 INFO:teuthology.orchestra.run.smithi040.stdout: "last_epoch_clean": 0, 2023-09-30T22:24:51.289 INFO:teuthology.orchestra.run.smithi040.stdout: "source_version": "0'0", 2023-09-30T22:24:51.289 INFO:teuthology.orchestra.run.smithi040.stdout: "target_version": "0'0" 2023-09-30T22:24:51.289 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.289 INFO:teuthology.orchestra.run.smithi040.stdout: "last_change": "25", 2023-09-30T22:24:51.289 INFO:teuthology.orchestra.run.smithi040.stdout: "last_force_op_resend": "0", 2023-09-30T22:24:51.290 INFO:teuthology.orchestra.run.smithi040.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:24:51.290 INFO:teuthology.orchestra.run.smithi040.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:24:51.290 INFO:teuthology.orchestra.run.smithi040.stdout: "auid": 0, 2023-09-30T22:24:51.290 INFO:teuthology.orchestra.run.smithi040.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:24:51.290 INFO:teuthology.orchestra.run.smithi040.stdout: "snap_seq": 0, 2023-09-30T22:24:51.290 INFO:teuthology.orchestra.run.smithi040.stdout: "snap_epoch": 0, 2023-09-30T22:24:51.290 INFO:teuthology.orchestra.run.smithi040.stdout: "pool_snaps": [], 2023-09-30T22:24:51.290 INFO:teuthology.orchestra.run.smithi040.stdout: "removed_snaps": "[]", 2023-09-30T22:24:51.290 INFO:teuthology.orchestra.run.smithi040.stdout: "quota_max_bytes": 0, 2023-09-30T22:24:51.290 INFO:teuthology.orchestra.run.smithi040.stdout: "quota_max_objects": 0, 2023-09-30T22:24:51.291 INFO:teuthology.orchestra.run.smithi040.stdout: "tiers": [], 2023-09-30T22:24:51.291 INFO:teuthology.orchestra.run.smithi040.stdout: "tier_of": -1, 2023-09-30T22:24:51.291 INFO:teuthology.orchestra.run.smithi040.stdout: "read_tier": -1, 2023-09-30T22:24:51.291 INFO:teuthology.orchestra.run.smithi040.stdout: "write_tier": -1, 2023-09-30T22:24:51.291 INFO:teuthology.orchestra.run.smithi040.stdout: "cache_mode": "none", 2023-09-30T22:24:51.291 INFO:teuthology.orchestra.run.smithi040.stdout: "target_max_bytes": 0, 2023-09-30T22:24:51.291 INFO:teuthology.orchestra.run.smithi040.stdout: "target_max_objects": 0, 2023-09-30T22:24:51.291 INFO:teuthology.orchestra.run.smithi040.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:24:51.291 INFO:teuthology.orchestra.run.smithi040.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:24:51.291 INFO:teuthology.orchestra.run.smithi040.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:24:51.291 INFO:teuthology.orchestra.run.smithi040.stdout: "cache_min_flush_age": 0, 2023-09-30T22:24:51.291 INFO:teuthology.orchestra.run.smithi040.stdout: "cache_min_evict_age": 0, 2023-09-30T22:24:51.292 INFO:teuthology.orchestra.run.smithi040.stdout: "erasure_code_profile": "", 2023-09-30T22:24:51.292 INFO:teuthology.orchestra.run.smithi040.stdout: "hit_set_params": { 2023-09-30T22:24:51.292 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "none" 2023-09-30T22:24:51.292 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.292 INFO:teuthology.orchestra.run.smithi040.stdout: "hit_set_period": 0, 2023-09-30T22:24:51.292 INFO:teuthology.orchestra.run.smithi040.stdout: "hit_set_count": 0, 2023-09-30T22:24:51.292 INFO:teuthology.orchestra.run.smithi040.stdout: "use_gmt_hitset": true, 2023-09-30T22:24:51.292 INFO:teuthology.orchestra.run.smithi040.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:24:51.292 INFO:teuthology.orchestra.run.smithi040.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:24:51.292 INFO:teuthology.orchestra.run.smithi040.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:24:51.292 INFO:teuthology.orchestra.run.smithi040.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:24:51.292 INFO:teuthology.orchestra.run.smithi040.stdout: "grade_table": [], 2023-09-30T22:24:51.293 INFO:teuthology.orchestra.run.smithi040.stdout: "stripe_width": 0, 2023-09-30T22:24:51.293 INFO:teuthology.orchestra.run.smithi040.stdout: "expected_num_objects": 0, 2023-09-30T22:24:51.293 INFO:teuthology.orchestra.run.smithi040.stdout: "fast_read": false, 2023-09-30T22:24:51.293 INFO:teuthology.orchestra.run.smithi040.stdout: "options": { 2023-09-30T22:24:51.293 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_num_max": 32, 2023-09-30T22:24:51.293 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_num_min": 1 2023-09-30T22:24:51.293 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.293 INFO:teuthology.orchestra.run.smithi040.stdout: "application_metadata": { 2023-09-30T22:24:51.293 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": {}, 2023-09-30T22:24:51.293 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr_devicehealth": {} 2023-09-30T22:24:51.294 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.294 INFO:teuthology.orchestra.run.smithi040.stdout: "read_balance": { 2023-09-30T22:24:51.294 INFO:teuthology.orchestra.run.smithi040.stdout: "score_acting": 4, 2023-09-30T22:24:51.294 INFO:teuthology.orchestra.run.smithi040.stdout: "score_stable": 4, 2023-09-30T22:24:51.294 INFO:teuthology.orchestra.run.smithi040.stdout: "optimal_score": 0.5, 2023-09-30T22:24:51.294 INFO:teuthology.orchestra.run.smithi040.stdout: "raw_score_acting": 2, 2023-09-30T22:24:51.295 INFO:teuthology.orchestra.run.smithi040.stdout: "raw_score_stable": 2, 2023-09-30T22:24:51.295 INFO:teuthology.orchestra.run.smithi040.stdout: "primary_affinity_weighted": 1, 2023-09-30T22:24:51.295 INFO:teuthology.orchestra.run.smithi040.stdout: "average_primary_affinity": 1, 2023-09-30T22:24:51.295 INFO:teuthology.orchestra.run.smithi040.stdout: "average_primary_affinity_weighted": 1 2023-09-30T22:24:51.295 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.295 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.295 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.295 INFO:teuthology.orchestra.run.smithi040.stdout: "pool": 2, 2023-09-30T22:24:51.295 INFO:teuthology.orchestra.run.smithi040.stdout: "pool_name": "rbd", 2023-09-30T22:24:51.295 INFO:teuthology.orchestra.run.smithi040.stdout: "create_time": "2023-09-30T22:21:56.197012+0000", 2023-09-30T22:24:51.295 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2023-09-30T22:24:51.295 INFO:teuthology.orchestra.run.smithi040.stdout: "flags_names": "hashpspool", 2023-09-30T22:24:51.296 INFO:teuthology.orchestra.run.smithi040.stdout: "type": 1, 2023-09-30T22:24:51.296 INFO:teuthology.orchestra.run.smithi040.stdout: "size": 2, 2023-09-30T22:24:51.296 INFO:teuthology.orchestra.run.smithi040.stdout: "min_size": 1, 2023-09-30T22:24:51.296 INFO:teuthology.orchestra.run.smithi040.stdout: "crush_rule": 0, 2023-09-30T22:24:51.296 INFO:teuthology.orchestra.run.smithi040.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:24:51.296 INFO:teuthology.orchestra.run.smithi040.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:24:51.296 INFO:teuthology.orchestra.run.smithi040.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:24:51.296 INFO:teuthology.orchestra.run.smithi040.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:24:51.296 INFO:teuthology.orchestra.run.smithi040.stdout: "object_hash": 2, 2023-09-30T22:24:51.297 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:24:51.297 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_num": 8, 2023-09-30T22:24:51.297 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_placement_num": 8, 2023-09-30T22:24:51.297 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_placement_num_target": 8, 2023-09-30T22:24:51.297 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_num_target": 8, 2023-09-30T22:24:51.297 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_num_pending": 8, 2023-09-30T22:24:51.297 INFO:teuthology.orchestra.run.smithi040.stdout: "last_pg_merge_meta": { 2023-09-30T22:24:51.297 INFO:teuthology.orchestra.run.smithi040.stdout: "source_pgid": "0.0", 2023-09-30T22:24:51.297 INFO:teuthology.orchestra.run.smithi040.stdout: "ready_epoch": 0, 2023-09-30T22:24:51.297 INFO:teuthology.orchestra.run.smithi040.stdout: "last_epoch_started": 0, 2023-09-30T22:24:51.297 INFO:teuthology.orchestra.run.smithi040.stdout: "last_epoch_clean": 0, 2023-09-30T22:24:51.297 INFO:teuthology.orchestra.run.smithi040.stdout: "source_version": "0'0", 2023-09-30T22:24:51.298 INFO:teuthology.orchestra.run.smithi040.stdout: "target_version": "0'0" 2023-09-30T22:24:51.298 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.298 INFO:teuthology.orchestra.run.smithi040.stdout: "last_change": "13", 2023-09-30T22:24:51.298 INFO:teuthology.orchestra.run.smithi040.stdout: "last_force_op_resend": "0", 2023-09-30T22:24:51.298 INFO:teuthology.orchestra.run.smithi040.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:24:51.298 INFO:teuthology.orchestra.run.smithi040.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:24:51.298 INFO:teuthology.orchestra.run.smithi040.stdout: "auid": 0, 2023-09-30T22:24:51.298 INFO:teuthology.orchestra.run.smithi040.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:24:51.298 INFO:teuthology.orchestra.run.smithi040.stdout: "snap_seq": 0, 2023-09-30T22:24:51.298 INFO:teuthology.orchestra.run.smithi040.stdout: "snap_epoch": 0, 2023-09-30T22:24:51.298 INFO:teuthology.orchestra.run.smithi040.stdout: "pool_snaps": [], 2023-09-30T22:24:51.298 INFO:teuthology.orchestra.run.smithi040.stdout: "removed_snaps": "[]", 2023-09-30T22:24:51.299 INFO:teuthology.orchestra.run.smithi040.stdout: "quota_max_bytes": 0, 2023-09-30T22:24:51.299 INFO:teuthology.orchestra.run.smithi040.stdout: "quota_max_objects": 0, 2023-09-30T22:24:51.299 INFO:teuthology.orchestra.run.smithi040.stdout: "tiers": [], 2023-09-30T22:24:51.299 INFO:teuthology.orchestra.run.smithi040.stdout: "tier_of": -1, 2023-09-30T22:24:51.299 INFO:teuthology.orchestra.run.smithi040.stdout: "read_tier": -1, 2023-09-30T22:24:51.299 INFO:teuthology.orchestra.run.smithi040.stdout: "write_tier": -1, 2023-09-30T22:24:51.299 INFO:teuthology.orchestra.run.smithi040.stdout: "cache_mode": "none", 2023-09-30T22:24:51.299 INFO:teuthology.orchestra.run.smithi040.stdout: "target_max_bytes": 0, 2023-09-30T22:24:51.299 INFO:teuthology.orchestra.run.smithi040.stdout: "target_max_objects": 0, 2023-09-30T22:24:51.299 INFO:teuthology.orchestra.run.smithi040.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:24:51.299 INFO:teuthology.orchestra.run.smithi040.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:24:51.300 INFO:teuthology.orchestra.run.smithi040.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:24:51.300 INFO:teuthology.orchestra.run.smithi040.stdout: "cache_min_flush_age": 0, 2023-09-30T22:24:51.300 INFO:teuthology.orchestra.run.smithi040.stdout: "cache_min_evict_age": 0, 2023-09-30T22:24:51.300 INFO:teuthology.orchestra.run.smithi040.stdout: "erasure_code_profile": "", 2023-09-30T22:24:51.300 INFO:teuthology.orchestra.run.smithi040.stdout: "hit_set_params": { 2023-09-30T22:24:51.300 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "none" 2023-09-30T22:24:51.300 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.300 INFO:teuthology.orchestra.run.smithi040.stdout: "hit_set_period": 0, 2023-09-30T22:24:51.300 INFO:teuthology.orchestra.run.smithi040.stdout: "hit_set_count": 0, 2023-09-30T22:24:51.300 INFO:teuthology.orchestra.run.smithi040.stdout: "use_gmt_hitset": true, 2023-09-30T22:24:51.300 INFO:teuthology.orchestra.run.smithi040.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:24:51.300 INFO:teuthology.orchestra.run.smithi040.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:24:51.300 INFO:teuthology.orchestra.run.smithi040.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:24:51.301 INFO:teuthology.orchestra.run.smithi040.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:24:51.301 INFO:teuthology.orchestra.run.smithi040.stdout: "grade_table": [], 2023-09-30T22:24:51.301 INFO:teuthology.orchestra.run.smithi040.stdout: "stripe_width": 0, 2023-09-30T22:24:51.301 INFO:teuthology.orchestra.run.smithi040.stdout: "expected_num_objects": 0, 2023-09-30T22:24:51.301 INFO:teuthology.orchestra.run.smithi040.stdout: "fast_read": false, 2023-09-30T22:24:51.301 INFO:teuthology.orchestra.run.smithi040.stdout: "options": {}, 2023-09-30T22:24:51.301 INFO:teuthology.orchestra.run.smithi040.stdout: "application_metadata": { 2023-09-30T22:24:51.301 INFO:teuthology.orchestra.run.smithi040.stdout: "rbd": {} 2023-09-30T22:24:51.301 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.301 INFO:teuthology.orchestra.run.smithi040.stdout: "read_balance": { 2023-09-30T22:24:51.301 INFO:teuthology.orchestra.run.smithi040.stdout: "score_acting": 2.5, 2023-09-30T22:24:51.301 INFO:teuthology.orchestra.run.smithi040.stdout: "score_stable": 2.5, 2023-09-30T22:24:51.302 INFO:teuthology.orchestra.run.smithi040.stdout: "optimal_score": 1, 2023-09-30T22:24:51.302 INFO:teuthology.orchestra.run.smithi040.stdout: "raw_score_acting": 2.5, 2023-09-30T22:24:51.302 INFO:teuthology.orchestra.run.smithi040.stdout: "raw_score_stable": 2.5, 2023-09-30T22:24:51.302 INFO:teuthology.orchestra.run.smithi040.stdout: "primary_affinity_weighted": 1, 2023-09-30T22:24:51.302 INFO:teuthology.orchestra.run.smithi040.stdout: "average_primary_affinity": 1, 2023-09-30T22:24:51.302 INFO:teuthology.orchestra.run.smithi040.stdout: "average_primary_affinity_weighted": 1 2023-09-30T22:24:51.302 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.302 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.302 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.302 INFO:teuthology.orchestra.run.smithi040.stdout: "pool": 3, 2023-09-30T22:24:51.302 INFO:teuthology.orchestra.run.smithi040.stdout: "pool_name": "cephfs_metadata", 2023-09-30T22:24:51.303 INFO:teuthology.orchestra.run.smithi040.stdout: "create_time": "2023-09-30T22:22:00.759069+0000", 2023-09-30T22:24:51.303 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2023-09-30T22:24:51.303 INFO:teuthology.orchestra.run.smithi040.stdout: "flags_names": "hashpspool", 2023-09-30T22:24:51.303 INFO:teuthology.orchestra.run.smithi040.stdout: "type": 1, 2023-09-30T22:24:51.303 INFO:teuthology.orchestra.run.smithi040.stdout: "size": 2, 2023-09-30T22:24:51.303 INFO:teuthology.orchestra.run.smithi040.stdout: "min_size": 1, 2023-09-30T22:24:51.303 INFO:teuthology.orchestra.run.smithi040.stdout: "crush_rule": 0, 2023-09-30T22:24:51.303 INFO:teuthology.orchestra.run.smithi040.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:24:51.303 INFO:teuthology.orchestra.run.smithi040.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:24:51.303 INFO:teuthology.orchestra.run.smithi040.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:24:51.303 INFO:teuthology.orchestra.run.smithi040.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:24:51.303 INFO:teuthology.orchestra.run.smithi040.stdout: "object_hash": 2, 2023-09-30T22:24:51.304 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:24:51.304 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_num": 32, 2023-09-30T22:24:51.304 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_placement_num": 32, 2023-09-30T22:24:51.304 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_placement_num_target": 32, 2023-09-30T22:24:51.304 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_num_target": 32, 2023-09-30T22:24:51.304 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_num_pending": 32, 2023-09-30T22:24:51.304 INFO:teuthology.orchestra.run.smithi040.stdout: "last_pg_merge_meta": { 2023-09-30T22:24:51.304 INFO:teuthology.orchestra.run.smithi040.stdout: "source_pgid": "0.0", 2023-09-30T22:24:51.304 INFO:teuthology.orchestra.run.smithi040.stdout: "ready_epoch": 0, 2023-09-30T22:24:51.304 INFO:teuthology.orchestra.run.smithi040.stdout: "last_epoch_started": 0, 2023-09-30T22:24:51.304 INFO:teuthology.orchestra.run.smithi040.stdout: "last_epoch_clean": 0, 2023-09-30T22:24:51.304 INFO:teuthology.orchestra.run.smithi040.stdout: "source_version": "0'0", 2023-09-30T22:24:51.304 INFO:teuthology.orchestra.run.smithi040.stdout: "target_version": "0'0" 2023-09-30T22:24:51.305 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.305 INFO:teuthology.orchestra.run.smithi040.stdout: "last_change": "16", 2023-09-30T22:24:51.305 INFO:teuthology.orchestra.run.smithi040.stdout: "last_force_op_resend": "0", 2023-09-30T22:24:51.305 INFO:teuthology.orchestra.run.smithi040.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:24:51.305 INFO:teuthology.orchestra.run.smithi040.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:24:51.305 INFO:teuthology.orchestra.run.smithi040.stdout: "auid": 0, 2023-09-30T22:24:51.305 INFO:teuthology.orchestra.run.smithi040.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:24:51.305 INFO:teuthology.orchestra.run.smithi040.stdout: "snap_seq": 0, 2023-09-30T22:24:51.305 INFO:teuthology.orchestra.run.smithi040.stdout: "snap_epoch": 0, 2023-09-30T22:24:51.305 INFO:teuthology.orchestra.run.smithi040.stdout: "pool_snaps": [], 2023-09-30T22:24:51.305 INFO:teuthology.orchestra.run.smithi040.stdout: "removed_snaps": "[]", 2023-09-30T22:24:51.305 INFO:teuthology.orchestra.run.smithi040.stdout: "quota_max_bytes": 0, 2023-09-30T22:24:51.305 INFO:teuthology.orchestra.run.smithi040.stdout: "quota_max_objects": 0, 2023-09-30T22:24:51.306 INFO:teuthology.orchestra.run.smithi040.stdout: "tiers": [], 2023-09-30T22:24:51.306 INFO:teuthology.orchestra.run.smithi040.stdout: "tier_of": -1, 2023-09-30T22:24:51.306 INFO:teuthology.orchestra.run.smithi040.stdout: "read_tier": -1, 2023-09-30T22:24:51.306 INFO:teuthology.orchestra.run.smithi040.stdout: "write_tier": -1, 2023-09-30T22:24:51.306 INFO:teuthology.orchestra.run.smithi040.stdout: "cache_mode": "none", 2023-09-30T22:24:51.306 INFO:teuthology.orchestra.run.smithi040.stdout: "target_max_bytes": 0, 2023-09-30T22:24:51.306 INFO:teuthology.orchestra.run.smithi040.stdout: "target_max_objects": 0, 2023-09-30T22:24:51.306 INFO:teuthology.orchestra.run.smithi040.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:24:51.306 INFO:teuthology.orchestra.run.smithi040.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:24:51.306 INFO:teuthology.orchestra.run.smithi040.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:24:51.306 INFO:teuthology.orchestra.run.smithi040.stdout: "cache_min_flush_age": 0, 2023-09-30T22:24:51.307 INFO:teuthology.orchestra.run.smithi040.stdout: "cache_min_evict_age": 0, 2023-09-30T22:24:51.307 INFO:teuthology.orchestra.run.smithi040.stdout: "erasure_code_profile": "", 2023-09-30T22:24:51.307 INFO:teuthology.orchestra.run.smithi040.stdout: "hit_set_params": { 2023-09-30T22:24:51.307 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "none" 2023-09-30T22:24:51.307 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.307 INFO:teuthology.orchestra.run.smithi040.stdout: "hit_set_period": 0, 2023-09-30T22:24:51.307 INFO:teuthology.orchestra.run.smithi040.stdout: "hit_set_count": 0, 2023-09-30T22:24:51.307 INFO:teuthology.orchestra.run.smithi040.stdout: "use_gmt_hitset": true, 2023-09-30T22:24:51.307 INFO:teuthology.orchestra.run.smithi040.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:24:51.307 INFO:teuthology.orchestra.run.smithi040.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:24:51.307 INFO:teuthology.orchestra.run.smithi040.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:24:51.307 INFO:teuthology.orchestra.run.smithi040.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:24:51.308 INFO:teuthology.orchestra.run.smithi040.stdout: "grade_table": [], 2023-09-30T22:24:51.308 INFO:teuthology.orchestra.run.smithi040.stdout: "stripe_width": 0, 2023-09-30T22:24:51.308 INFO:teuthology.orchestra.run.smithi040.stdout: "expected_num_objects": 0, 2023-09-30T22:24:51.308 INFO:teuthology.orchestra.run.smithi040.stdout: "fast_read": false, 2023-09-30T22:24:51.308 INFO:teuthology.orchestra.run.smithi040.stdout: "options": { 2023-09-30T22:24:51.308 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_autoscale_bias": 4, 2023-09-30T22:24:51.308 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_num_min": 16, 2023-09-30T22:24:51.308 INFO:teuthology.orchestra.run.smithi040.stdout: "recovery_priority": 5 2023-09-30T22:24:51.308 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.308 INFO:teuthology.orchestra.run.smithi040.stdout: "application_metadata": { 2023-09-30T22:24:51.308 INFO:teuthology.orchestra.run.smithi040.stdout: "cephfs": { 2023-09-30T22:24:51.308 INFO:teuthology.orchestra.run.smithi040.stdout: "metadata": "cephfs" 2023-09-30T22:24:51.308 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.309 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.309 INFO:teuthology.orchestra.run.smithi040.stdout: "read_balance": { 2023-09-30T22:24:51.309 INFO:teuthology.orchestra.run.smithi040.stdout: "score_acting": 1.6299999952316284, 2023-09-30T22:24:51.309 INFO:teuthology.orchestra.run.smithi040.stdout: "score_stable": 1.6299999952316284, 2023-09-30T22:24:51.309 INFO:teuthology.orchestra.run.smithi040.stdout: "optimal_score": 1, 2023-09-30T22:24:51.309 INFO:teuthology.orchestra.run.smithi040.stdout: "raw_score_acting": 1.6299999952316284, 2023-09-30T22:24:51.309 INFO:teuthology.orchestra.run.smithi040.stdout: "raw_score_stable": 1.6299999952316284, 2023-09-30T22:24:51.309 INFO:teuthology.orchestra.run.smithi040.stdout: "primary_affinity_weighted": 1, 2023-09-30T22:24:51.309 INFO:teuthology.orchestra.run.smithi040.stdout: "average_primary_affinity": 1, 2023-09-30T22:24:51.309 INFO:teuthology.orchestra.run.smithi040.stdout: "average_primary_affinity_weighted": 1 2023-09-30T22:24:51.309 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.309 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.309 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.310 INFO:teuthology.orchestra.run.smithi040.stdout: "pool": 4, 2023-09-30T22:24:51.310 INFO:teuthology.orchestra.run.smithi040.stdout: "pool_name": "cephfs_data", 2023-09-30T22:24:51.310 INFO:teuthology.orchestra.run.smithi040.stdout: "create_time": "2023-09-30T22:22:01.327265+0000", 2023-09-30T22:24:51.310 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2023-09-30T22:24:51.310 INFO:teuthology.orchestra.run.smithi040.stdout: "flags_names": "hashpspool", 2023-09-30T22:24:51.310 INFO:teuthology.orchestra.run.smithi040.stdout: "type": 1, 2023-09-30T22:24:51.310 INFO:teuthology.orchestra.run.smithi040.stdout: "size": 2, 2023-09-30T22:24:51.310 INFO:teuthology.orchestra.run.smithi040.stdout: "min_size": 1, 2023-09-30T22:24:51.310 INFO:teuthology.orchestra.run.smithi040.stdout: "crush_rule": 0, 2023-09-30T22:24:51.310 INFO:teuthology.orchestra.run.smithi040.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:24:51.310 INFO:teuthology.orchestra.run.smithi040.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:24:51.310 INFO:teuthology.orchestra.run.smithi040.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:24:51.311 INFO:teuthology.orchestra.run.smithi040.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:24:51.311 INFO:teuthology.orchestra.run.smithi040.stdout: "object_hash": 2, 2023-09-30T22:24:51.311 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:24:51.311 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_num": 64, 2023-09-30T22:24:51.311 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_placement_num": 64, 2023-09-30T22:24:51.311 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_placement_num_target": 64, 2023-09-30T22:24:51.311 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_num_target": 64, 2023-09-30T22:24:51.311 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_num_pending": 64, 2023-09-30T22:24:51.311 INFO:teuthology.orchestra.run.smithi040.stdout: "last_pg_merge_meta": { 2023-09-30T22:24:51.311 INFO:teuthology.orchestra.run.smithi040.stdout: "source_pgid": "0.0", 2023-09-30T22:24:51.311 INFO:teuthology.orchestra.run.smithi040.stdout: "ready_epoch": 0, 2023-09-30T22:24:51.311 INFO:teuthology.orchestra.run.smithi040.stdout: "last_epoch_started": 0, 2023-09-30T22:24:51.312 INFO:teuthology.orchestra.run.smithi040.stdout: "last_epoch_clean": 0, 2023-09-30T22:24:51.312 INFO:teuthology.orchestra.run.smithi040.stdout: "source_version": "0'0", 2023-09-30T22:24:51.312 INFO:teuthology.orchestra.run.smithi040.stdout: "target_version": "0'0" 2023-09-30T22:24:51.312 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.312 INFO:teuthology.orchestra.run.smithi040.stdout: "last_change": "17", 2023-09-30T22:24:51.312 INFO:teuthology.orchestra.run.smithi040.stdout: "last_force_op_resend": "0", 2023-09-30T22:24:51.312 INFO:teuthology.orchestra.run.smithi040.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:24:51.312 INFO:teuthology.orchestra.run.smithi040.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:24:51.312 INFO:teuthology.orchestra.run.smithi040.stdout: "auid": 0, 2023-09-30T22:24:51.312 INFO:teuthology.orchestra.run.smithi040.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:24:51.312 INFO:teuthology.orchestra.run.smithi040.stdout: "snap_seq": 0, 2023-09-30T22:24:51.312 INFO:teuthology.orchestra.run.smithi040.stdout: "snap_epoch": 0, 2023-09-30T22:24:51.313 INFO:teuthology.orchestra.run.smithi040.stdout: "pool_snaps": [], 2023-09-30T22:24:51.313 INFO:teuthology.orchestra.run.smithi040.stdout: "removed_snaps": "[]", 2023-09-30T22:24:51.313 INFO:teuthology.orchestra.run.smithi040.stdout: "quota_max_bytes": 0, 2023-09-30T22:24:51.313 INFO:teuthology.orchestra.run.smithi040.stdout: "quota_max_objects": 0, 2023-09-30T22:24:51.313 INFO:teuthology.orchestra.run.smithi040.stdout: "tiers": [], 2023-09-30T22:24:51.313 INFO:teuthology.orchestra.run.smithi040.stdout: "tier_of": -1, 2023-09-30T22:24:51.313 INFO:teuthology.orchestra.run.smithi040.stdout: "read_tier": -1, 2023-09-30T22:24:51.313 INFO:teuthology.orchestra.run.smithi040.stdout: "write_tier": -1, 2023-09-30T22:24:51.313 INFO:teuthology.orchestra.run.smithi040.stdout: "cache_mode": "none", 2023-09-30T22:24:51.313 INFO:teuthology.orchestra.run.smithi040.stdout: "target_max_bytes": 0, 2023-09-30T22:24:51.313 INFO:teuthology.orchestra.run.smithi040.stdout: "target_max_objects": 0, 2023-09-30T22:24:51.313 INFO:teuthology.orchestra.run.smithi040.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:24:51.313 INFO:teuthology.orchestra.run.smithi040.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:24:51.314 INFO:teuthology.orchestra.run.smithi040.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:24:51.314 INFO:teuthology.orchestra.run.smithi040.stdout: "cache_min_flush_age": 0, 2023-09-30T22:24:51.314 INFO:teuthology.orchestra.run.smithi040.stdout: "cache_min_evict_age": 0, 2023-09-30T22:24:51.314 INFO:teuthology.orchestra.run.smithi040.stdout: "erasure_code_profile": "", 2023-09-30T22:24:51.314 INFO:teuthology.orchestra.run.smithi040.stdout: "hit_set_params": { 2023-09-30T22:24:51.314 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "none" 2023-09-30T22:24:51.314 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.314 INFO:teuthology.orchestra.run.smithi040.stdout: "hit_set_period": 0, 2023-09-30T22:24:51.314 INFO:teuthology.orchestra.run.smithi040.stdout: "hit_set_count": 0, 2023-09-30T22:24:51.314 INFO:teuthology.orchestra.run.smithi040.stdout: "use_gmt_hitset": true, 2023-09-30T22:24:51.314 INFO:teuthology.orchestra.run.smithi040.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:24:51.315 INFO:teuthology.orchestra.run.smithi040.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:24:51.315 INFO:teuthology.orchestra.run.smithi040.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:24:51.315 INFO:teuthology.orchestra.run.smithi040.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:24:51.315 INFO:teuthology.orchestra.run.smithi040.stdout: "grade_table": [], 2023-09-30T22:24:51.315 INFO:teuthology.orchestra.run.smithi040.stdout: "stripe_width": 0, 2023-09-30T22:24:51.315 INFO:teuthology.orchestra.run.smithi040.stdout: "expected_num_objects": 0, 2023-09-30T22:24:51.315 INFO:teuthology.orchestra.run.smithi040.stdout: "fast_read": false, 2023-09-30T22:24:51.315 INFO:teuthology.orchestra.run.smithi040.stdout: "options": { 2023-09-30T22:24:51.315 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_num_min": 64, 2023-09-30T22:24:51.315 INFO:teuthology.orchestra.run.smithi040.stdout: "target_size_ratio": 0.89999997615814209 2023-09-30T22:24:51.315 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.315 INFO:teuthology.orchestra.run.smithi040.stdout: "application_metadata": { 2023-09-30T22:24:51.315 INFO:teuthology.orchestra.run.smithi040.stdout: "cephfs": { 2023-09-30T22:24:51.316 INFO:teuthology.orchestra.run.smithi040.stdout: "data": "cephfs" 2023-09-30T22:24:51.316 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.316 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.316 INFO:teuthology.orchestra.run.smithi040.stdout: "read_balance": { 2023-09-30T22:24:51.316 INFO:teuthology.orchestra.run.smithi040.stdout: "score_acting": 1.059999942779541, 2023-09-30T22:24:51.316 INFO:teuthology.orchestra.run.smithi040.stdout: "score_stable": 1.059999942779541, 2023-09-30T22:24:51.316 INFO:teuthology.orchestra.run.smithi040.stdout: "optimal_score": 1, 2023-09-30T22:24:51.316 INFO:teuthology.orchestra.run.smithi040.stdout: "raw_score_acting": 1.059999942779541, 2023-09-30T22:24:51.316 INFO:teuthology.orchestra.run.smithi040.stdout: "raw_score_stable": 1.059999942779541, 2023-09-30T22:24:51.316 INFO:teuthology.orchestra.run.smithi040.stdout: "primary_affinity_weighted": 1, 2023-09-30T22:24:51.316 INFO:teuthology.orchestra.run.smithi040.stdout: "average_primary_affinity": 1, 2023-09-30T22:24:51.316 INFO:teuthology.orchestra.run.smithi040.stdout: "average_primary_affinity_weighted": 1 2023-09-30T22:24:51.317 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.317 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.317 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2023-09-30T22:24:51.317 INFO:teuthology.orchestra.run.smithi040.stdout: "osds": [ 2023-09-30T22:24:51.317 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.317 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": 0, 2023-09-30T22:24:51.317 INFO:teuthology.orchestra.run.smithi040.stdout: "uuid": "771f785c-f464-4b17-936c-cbf31b1153e0", 2023-09-30T22:24:51.317 INFO:teuthology.orchestra.run.smithi040.stdout: "up": 1, 2023-09-30T22:24:51.317 INFO:teuthology.orchestra.run.smithi040.stdout: "in": 1, 2023-09-30T22:24:51.317 INFO:teuthology.orchestra.run.smithi040.stdout: "weight": 1, 2023-09-30T22:24:51.317 INFO:teuthology.orchestra.run.smithi040.stdout: "primary_affinity": 1, 2023-09-30T22:24:51.317 INFO:teuthology.orchestra.run.smithi040.stdout: "last_clean_begin": 9, 2023-09-30T22:24:51.317 INFO:teuthology.orchestra.run.smithi040.stdout: "last_clean_end": 25, 2023-09-30T22:24:51.318 INFO:teuthology.orchestra.run.smithi040.stdout: "up_from": 32, 2023-09-30T22:24:51.318 INFO:teuthology.orchestra.run.smithi040.stdout: "up_thru": 34, 2023-09-30T22:24:51.318 INFO:teuthology.orchestra.run.smithi040.stdout: "down_at": 26, 2023-09-30T22:24:51.318 INFO:teuthology.orchestra.run.smithi040.stdout: "lost_at": 0, 2023-09-30T22:24:51.318 INFO:teuthology.orchestra.run.smithi040.stdout: "public_addrs": { 2023-09-30T22:24:51.318 INFO:teuthology.orchestra.run.smithi040.stdout: "addrvec": [ 2023-09-30T22:24:51.318 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.318 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-09-30T22:24:51.318 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:6808", 2023-09-30T22:24:51.318 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 130098 2023-09-30T22:24:51.318 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.319 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-09-30T22:24:51.319 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.319 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_addrs": { 2023-09-30T22:24:51.319 INFO:teuthology.orchestra.run.smithi040.stdout: "addrvec": [ 2023-09-30T22:24:51.319 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.319 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-09-30T22:24:51.319 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:6809", 2023-09-30T22:24:51.319 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 130098 2023-09-30T22:24:51.319 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.319 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-09-30T22:24:51.319 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.319 INFO:teuthology.orchestra.run.smithi040.stdout: "heartbeat_back_addrs": { 2023-09-30T22:24:51.320 INFO:teuthology.orchestra.run.smithi040.stdout: "addrvec": [ 2023-09-30T22:24:51.320 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.320 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-09-30T22:24:51.320 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:6811", 2023-09-30T22:24:51.320 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 130098 2023-09-30T22:24:51.320 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.320 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-09-30T22:24:51.320 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.320 INFO:teuthology.orchestra.run.smithi040.stdout: "heartbeat_front_addrs": { 2023-09-30T22:24:51.320 INFO:teuthology.orchestra.run.smithi040.stdout: "addrvec": [ 2023-09-30T22:24:51.320 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.321 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-09-30T22:24:51.321 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:6810", 2023-09-30T22:24:51.321 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 130098 2023-09-30T22:24:51.321 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.321 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-09-30T22:24:51.321 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.321 INFO:teuthology.orchestra.run.smithi040.stdout: "public_addr": "172.21.15.40:6808/130098", 2023-09-30T22:24:51.321 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_addr": "172.21.15.40:6809/130098", 2023-09-30T22:24:51.321 INFO:teuthology.orchestra.run.smithi040.stdout: "heartbeat_back_addr": "172.21.15.40:6811/130098", 2023-09-30T22:24:51.321 INFO:teuthology.orchestra.run.smithi040.stdout: "heartbeat_front_addr": "172.21.15.40:6810/130098", 2023-09-30T22:24:51.321 INFO:teuthology.orchestra.run.smithi040.stdout: "state": [ 2023-09-30T22:24:51.321 INFO:teuthology.orchestra.run.smithi040.stdout: "exists", 2023-09-30T22:24:51.321 INFO:teuthology.orchestra.run.smithi040.stdout: "up" 2023-09-30T22:24:51.322 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-09-30T22:24:51.322 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.322 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.322 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": 1, 2023-09-30T22:24:51.322 INFO:teuthology.orchestra.run.smithi040.stdout: "uuid": "45f1e2e8-5310-4219-ab54-424e7440fcea", 2023-09-30T22:24:51.322 INFO:teuthology.orchestra.run.smithi040.stdout: "up": 1, 2023-09-30T22:24:51.322 INFO:teuthology.orchestra.run.smithi040.stdout: "in": 1, 2023-09-30T22:24:51.322 INFO:teuthology.orchestra.run.smithi040.stdout: "weight": 1, 2023-09-30T22:24:51.322 INFO:teuthology.orchestra.run.smithi040.stdout: "primary_affinity": 1, 2023-09-30T22:24:51.322 INFO:teuthology.orchestra.run.smithi040.stdout: "last_clean_begin": 9, 2023-09-30T22:24:51.322 INFO:teuthology.orchestra.run.smithi040.stdout: "last_clean_end": 26, 2023-09-30T22:24:51.322 INFO:teuthology.orchestra.run.smithi040.stdout: "up_from": 33, 2023-09-30T22:24:51.323 INFO:teuthology.orchestra.run.smithi040.stdout: "up_thru": 34, 2023-09-30T22:24:51.323 INFO:teuthology.orchestra.run.smithi040.stdout: "down_at": 27, 2023-09-30T22:24:51.323 INFO:teuthology.orchestra.run.smithi040.stdout: "lost_at": 0, 2023-09-30T22:24:51.323 INFO:teuthology.orchestra.run.smithi040.stdout: "public_addrs": { 2023-09-30T22:24:51.323 INFO:teuthology.orchestra.run.smithi040.stdout: "addrvec": [ 2023-09-30T22:24:51.323 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.323 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-09-30T22:24:51.323 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:6800", 2023-09-30T22:24:51.323 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 130196 2023-09-30T22:24:51.323 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.323 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-09-30T22:24:51.323 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.323 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_addrs": { 2023-09-30T22:24:51.324 INFO:teuthology.orchestra.run.smithi040.stdout: "addrvec": [ 2023-09-30T22:24:51.324 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.324 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-09-30T22:24:51.324 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:6801", 2023-09-30T22:24:51.324 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 130196 2023-09-30T22:24:51.324 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.324 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-09-30T22:24:51.324 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.324 INFO:teuthology.orchestra.run.smithi040.stdout: "heartbeat_back_addrs": { 2023-09-30T22:24:51.324 INFO:teuthology.orchestra.run.smithi040.stdout: "addrvec": [ 2023-09-30T22:24:51.324 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.324 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-09-30T22:24:51.324 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:6803", 2023-09-30T22:24:51.325 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 130196 2023-09-30T22:24:51.325 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.325 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-09-30T22:24:51.325 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.325 INFO:teuthology.orchestra.run.smithi040.stdout: "heartbeat_front_addrs": { 2023-09-30T22:24:51.325 INFO:teuthology.orchestra.run.smithi040.stdout: "addrvec": [ 2023-09-30T22:24:51.325 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.325 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-09-30T22:24:51.325 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:6802", 2023-09-30T22:24:51.325 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 130196 2023-09-30T22:24:51.325 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.325 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-09-30T22:24:51.326 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.326 INFO:teuthology.orchestra.run.smithi040.stdout: "public_addr": "172.21.15.40:6800/130196", 2023-09-30T22:24:51.326 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_addr": "172.21.15.40:6801/130196", 2023-09-30T22:24:51.326 INFO:teuthology.orchestra.run.smithi040.stdout: "heartbeat_back_addr": "172.21.15.40:6803/130196", 2023-09-30T22:24:51.326 INFO:teuthology.orchestra.run.smithi040.stdout: "heartbeat_front_addr": "172.21.15.40:6802/130196", 2023-09-30T22:24:51.326 INFO:teuthology.orchestra.run.smithi040.stdout: "state": [ 2023-09-30T22:24:51.326 INFO:teuthology.orchestra.run.smithi040.stdout: "exists", 2023-09-30T22:24:51.326 INFO:teuthology.orchestra.run.smithi040.stdout: "up" 2023-09-30T22:24:51.326 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-09-30T22:24:51.326 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.326 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.326 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": 2, 2023-09-30T22:24:51.327 INFO:teuthology.orchestra.run.smithi040.stdout: "uuid": "7ba62ae5-d21e-4d56-b46c-ba7b718ede25", 2023-09-30T22:24:51.327 INFO:teuthology.orchestra.run.smithi040.stdout: "up": 1, 2023-09-30T22:24:51.327 INFO:teuthology.orchestra.run.smithi040.stdout: "in": 1, 2023-09-30T22:24:51.327 INFO:teuthology.orchestra.run.smithi040.stdout: "weight": 1, 2023-09-30T22:24:51.327 INFO:teuthology.orchestra.run.smithi040.stdout: "primary_affinity": 1, 2023-09-30T22:24:51.327 INFO:teuthology.orchestra.run.smithi040.stdout: "last_clean_begin": 9, 2023-09-30T22:24:51.327 INFO:teuthology.orchestra.run.smithi040.stdout: "last_clean_end": 27, 2023-09-30T22:24:51.327 INFO:teuthology.orchestra.run.smithi040.stdout: "up_from": 33, 2023-09-30T22:24:51.327 INFO:teuthology.orchestra.run.smithi040.stdout: "up_thru": 34, 2023-09-30T22:24:51.327 INFO:teuthology.orchestra.run.smithi040.stdout: "down_at": 28, 2023-09-30T22:24:51.327 INFO:teuthology.orchestra.run.smithi040.stdout: "lost_at": 0, 2023-09-30T22:24:51.327 INFO:teuthology.orchestra.run.smithi040.stdout: "public_addrs": { 2023-09-30T22:24:51.328 INFO:teuthology.orchestra.run.smithi040.stdout: "addrvec": [ 2023-09-30T22:24:51.328 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.328 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-09-30T22:24:51.328 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:6804", 2023-09-30T22:24:51.328 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 130328 2023-09-30T22:24:51.328 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.328 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-09-30T22:24:51.328 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.328 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_addrs": { 2023-09-30T22:24:51.328 INFO:teuthology.orchestra.run.smithi040.stdout: "addrvec": [ 2023-09-30T22:24:51.328 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.328 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-09-30T22:24:51.329 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:6805", 2023-09-30T22:24:51.329 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 130328 2023-09-30T22:24:51.329 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.329 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-09-30T22:24:51.329 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.329 INFO:teuthology.orchestra.run.smithi040.stdout: "heartbeat_back_addrs": { 2023-09-30T22:24:51.329 INFO:teuthology.orchestra.run.smithi040.stdout: "addrvec": [ 2023-09-30T22:24:51.329 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.329 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-09-30T22:24:51.329 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:6807", 2023-09-30T22:24:51.329 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 130328 2023-09-30T22:24:51.329 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.329 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-09-30T22:24:51.330 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.330 INFO:teuthology.orchestra.run.smithi040.stdout: "heartbeat_front_addrs": { 2023-09-30T22:24:51.330 INFO:teuthology.orchestra.run.smithi040.stdout: "addrvec": [ 2023-09-30T22:24:51.330 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.330 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-09-30T22:24:51.330 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:6806", 2023-09-30T22:24:51.330 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 130328 2023-09-30T22:24:51.330 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.330 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-09-30T22:24:51.330 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.330 INFO:teuthology.orchestra.run.smithi040.stdout: "public_addr": "172.21.15.40:6804/130328", 2023-09-30T22:24:51.330 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_addr": "172.21.15.40:6805/130328", 2023-09-30T22:24:51.331 INFO:teuthology.orchestra.run.smithi040.stdout: "heartbeat_back_addr": "172.21.15.40:6807/130328", 2023-09-30T22:24:51.331 INFO:teuthology.orchestra.run.smithi040.stdout: "heartbeat_front_addr": "172.21.15.40:6806/130328", 2023-09-30T22:24:51.331 INFO:teuthology.orchestra.run.smithi040.stdout: "state": [ 2023-09-30T22:24:51.331 INFO:teuthology.orchestra.run.smithi040.stdout: "exists", 2023-09-30T22:24:51.331 INFO:teuthology.orchestra.run.smithi040.stdout: "up" 2023-09-30T22:24:51.331 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-09-30T22:24:51.331 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.331 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.331 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": 3, 2023-09-30T22:24:51.331 INFO:teuthology.orchestra.run.smithi040.stdout: "uuid": "c9c55985-8a90-4927-a8fa-6a1fcec1cd3d", 2023-09-30T22:24:51.331 INFO:teuthology.orchestra.run.smithi040.stdout: "up": 1, 2023-09-30T22:24:51.331 INFO:teuthology.orchestra.run.smithi040.stdout: "in": 1, 2023-09-30T22:24:51.332 INFO:teuthology.orchestra.run.smithi040.stdout: "weight": 1, 2023-09-30T22:24:51.332 INFO:teuthology.orchestra.run.smithi040.stdout: "primary_affinity": 1, 2023-09-30T22:24:51.332 INFO:teuthology.orchestra.run.smithi040.stdout: "last_clean_begin": 9, 2023-09-30T22:24:51.332 INFO:teuthology.orchestra.run.smithi040.stdout: "last_clean_end": 28, 2023-09-30T22:24:51.332 INFO:teuthology.orchestra.run.smithi040.stdout: "up_from": 34, 2023-09-30T22:24:51.332 INFO:teuthology.orchestra.run.smithi040.stdout: "up_thru": 34, 2023-09-30T22:24:51.332 INFO:teuthology.orchestra.run.smithi040.stdout: "down_at": 29, 2023-09-30T22:24:51.332 INFO:teuthology.orchestra.run.smithi040.stdout: "lost_at": 0, 2023-09-30T22:24:51.332 INFO:teuthology.orchestra.run.smithi040.stdout: "public_addrs": { 2023-09-30T22:24:51.332 INFO:teuthology.orchestra.run.smithi040.stdout: "addrvec": [ 2023-09-30T22:24:51.332 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.333 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-09-30T22:24:51.333 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:6812", 2023-09-30T22:24:51.333 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 130646 2023-09-30T22:24:51.333 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.333 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-09-30T22:24:51.333 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.333 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_addrs": { 2023-09-30T22:24:51.333 INFO:teuthology.orchestra.run.smithi040.stdout: "addrvec": [ 2023-09-30T22:24:51.333 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.333 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-09-30T22:24:51.334 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:6813", 2023-09-30T22:24:51.334 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 130646 2023-09-30T22:24:51.334 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.334 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-09-30T22:24:51.334 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.334 INFO:teuthology.orchestra.run.smithi040.stdout: "heartbeat_back_addrs": { 2023-09-30T22:24:51.334 INFO:teuthology.orchestra.run.smithi040.stdout: "addrvec": [ 2023-09-30T22:24:51.334 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.334 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-09-30T22:24:51.334 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:6815", 2023-09-30T22:24:51.334 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 130646 2023-09-30T22:24:51.335 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.335 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-09-30T22:24:51.335 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.335 INFO:teuthology.orchestra.run.smithi040.stdout: "heartbeat_front_addrs": { 2023-09-30T22:24:51.335 INFO:teuthology.orchestra.run.smithi040.stdout: "addrvec": [ 2023-09-30T22:24:51.335 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.335 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-09-30T22:24:51.335 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:6814", 2023-09-30T22:24:51.335 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 130646 2023-09-30T22:24:51.335 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.335 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-09-30T22:24:51.336 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.336 INFO:teuthology.orchestra.run.smithi040.stdout: "public_addr": "172.21.15.40:6812/130646", 2023-09-30T22:24:51.336 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_addr": "172.21.15.40:6813/130646", 2023-09-30T22:24:51.336 INFO:teuthology.orchestra.run.smithi040.stdout: "heartbeat_back_addr": "172.21.15.40:6815/130646", 2023-09-30T22:24:51.336 INFO:teuthology.orchestra.run.smithi040.stdout: "heartbeat_front_addr": "172.21.15.40:6814/130646", 2023-09-30T22:24:51.336 INFO:teuthology.orchestra.run.smithi040.stdout: "state": [ 2023-09-30T22:24:51.336 INFO:teuthology.orchestra.run.smithi040.stdout: "exists", 2023-09-30T22:24:51.336 INFO:teuthology.orchestra.run.smithi040.stdout: "up" 2023-09-30T22:24:51.336 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-09-30T22:24:51.336 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.336 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2023-09-30T22:24:51.336 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_xinfo": [ 2023-09-30T22:24:51.337 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.337 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": 0, 2023-09-30T22:24:51.337 INFO:teuthology.orchestra.run.smithi040.stdout: "down_stamp": "0.000000", 2023-09-30T22:24:51.337 INFO:teuthology.orchestra.run.smithi040.stdout: "laggy_probability": 0, 2023-09-30T22:24:51.337 INFO:teuthology.orchestra.run.smithi040.stdout: "laggy_interval": 0, 2023-09-30T22:24:51.337 INFO:teuthology.orchestra.run.smithi040.stdout: "features": 4540138322906710015, 2023-09-30T22:24:51.337 INFO:teuthology.orchestra.run.smithi040.stdout: "old_weight": 0, 2023-09-30T22:24:51.337 INFO:teuthology.orchestra.run.smithi040.stdout: "last_purged_snaps_scrub": "2023-09-30T22:21:53.339829+0000", 2023-09-30T22:24:51.337 INFO:teuthology.orchestra.run.smithi040.stdout: "dead_epoch": 26 2023-09-30T22:24:51.337 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.337 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.338 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": 1, 2023-09-30T22:24:51.338 INFO:teuthology.orchestra.run.smithi040.stdout: "down_stamp": "0.000000", 2023-09-30T22:24:51.338 INFO:teuthology.orchestra.run.smithi040.stdout: "laggy_probability": 0, 2023-09-30T22:24:51.338 INFO:teuthology.orchestra.run.smithi040.stdout: "laggy_interval": 0, 2023-09-30T22:24:51.338 INFO:teuthology.orchestra.run.smithi040.stdout: "features": 4540138322906710015, 2023-09-30T22:24:51.338 INFO:teuthology.orchestra.run.smithi040.stdout: "old_weight": 0, 2023-09-30T22:24:51.338 INFO:teuthology.orchestra.run.smithi040.stdout: "last_purged_snaps_scrub": "2023-09-30T22:21:53.554690+0000", 2023-09-30T22:24:51.338 INFO:teuthology.orchestra.run.smithi040.stdout: "dead_epoch": 27 2023-09-30T22:24:51.338 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.338 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.338 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": 2, 2023-09-30T22:24:51.338 INFO:teuthology.orchestra.run.smithi040.stdout: "down_stamp": "0.000000", 2023-09-30T22:24:51.339 INFO:teuthology.orchestra.run.smithi040.stdout: "laggy_probability": 0, 2023-09-30T22:24:51.339 INFO:teuthology.orchestra.run.smithi040.stdout: "laggy_interval": 0, 2023-09-30T22:24:51.339 INFO:teuthology.orchestra.run.smithi040.stdout: "features": 4540138322906710015, 2023-09-30T22:24:51.339 INFO:teuthology.orchestra.run.smithi040.stdout: "old_weight": 0, 2023-09-30T22:24:51.339 INFO:teuthology.orchestra.run.smithi040.stdout: "last_purged_snaps_scrub": "2023-09-30T22:21:53.641664+0000", 2023-09-30T22:24:51.339 INFO:teuthology.orchestra.run.smithi040.stdout: "dead_epoch": 28 2023-09-30T22:24:51.339 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.339 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.339 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": 3, 2023-09-30T22:24:51.339 INFO:teuthology.orchestra.run.smithi040.stdout: "down_stamp": "2023-09-30T22:24:37.547345+0000", 2023-09-30T22:24:51.339 INFO:teuthology.orchestra.run.smithi040.stdout: "laggy_probability": 0, 2023-09-30T22:24:51.339 INFO:teuthology.orchestra.run.smithi040.stdout: "laggy_interval": 0, 2023-09-30T22:24:51.340 INFO:teuthology.orchestra.run.smithi040.stdout: "features": 4540138322906710015, 2023-09-30T22:24:51.340 INFO:teuthology.orchestra.run.smithi040.stdout: "old_weight": 0, 2023-09-30T22:24:51.340 INFO:teuthology.orchestra.run.smithi040.stdout: "last_purged_snaps_scrub": "2023-09-30T22:21:53.320635+0000", 2023-09-30T22:24:51.340 INFO:teuthology.orchestra.run.smithi040.stdout: "dead_epoch": 0 2023-09-30T22:24:51.340 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.340 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2023-09-30T22:24:51.340 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_upmap": [], 2023-09-30T22:24:51.340 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_upmap_items": [ 2023-09-30T22:24:51.340 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.340 INFO:teuthology.orchestra.run.smithi040.stdout: "pgid": "4.0", 2023-09-30T22:24:51.340 INFO:teuthology.orchestra.run.smithi040.stdout: "mappings": [ 2023-09-30T22:24:51.340 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.341 INFO:teuthology.orchestra.run.smithi040.stdout: "from": 3, 2023-09-30T22:24:51.341 INFO:teuthology.orchestra.run.smithi040.stdout: "to": 2 2023-09-30T22:24:51.341 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.341 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.341 INFO:teuthology.orchestra.run.smithi040.stdout: "from": 1, 2023-09-30T22:24:51.341 INFO:teuthology.orchestra.run.smithi040.stdout: "to": 0 2023-09-30T22:24:51.341 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.341 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-09-30T22:24:51.341 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.341 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.341 INFO:teuthology.orchestra.run.smithi040.stdout: "pgid": "4.1", 2023-09-30T22:24:51.341 INFO:teuthology.orchestra.run.smithi040.stdout: "mappings": [ 2023-09-30T22:24:51.342 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.342 INFO:teuthology.orchestra.run.smithi040.stdout: "from": 3, 2023-09-30T22:24:51.342 INFO:teuthology.orchestra.run.smithi040.stdout: "to": 0 2023-09-30T22:24:51.342 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.342 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-09-30T22:24:51.342 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.342 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.342 INFO:teuthology.orchestra.run.smithi040.stdout: "pgid": "4.9", 2023-09-30T22:24:51.342 INFO:teuthology.orchestra.run.smithi040.stdout: "mappings": [ 2023-09-30T22:24:51.342 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.342 INFO:teuthology.orchestra.run.smithi040.stdout: "from": 3, 2023-09-30T22:24:51.343 INFO:teuthology.orchestra.run.smithi040.stdout: "to": 0 2023-09-30T22:24:51.343 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.343 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-09-30T22:24:51.343 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.343 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.343 INFO:teuthology.orchestra.run.smithi040.stdout: "pgid": "4.c", 2023-09-30T22:24:51.343 INFO:teuthology.orchestra.run.smithi040.stdout: "mappings": [ 2023-09-30T22:24:51.343 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.343 INFO:teuthology.orchestra.run.smithi040.stdout: "from": 3, 2023-09-30T22:24:51.343 INFO:teuthology.orchestra.run.smithi040.stdout: "to": 2 2023-09-30T22:24:51.343 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.343 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-09-30T22:24:51.344 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.344 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.344 INFO:teuthology.orchestra.run.smithi040.stdout: "pgid": "4.12", 2023-09-30T22:24:51.344 INFO:teuthology.orchestra.run.smithi040.stdout: "mappings": [ 2023-09-30T22:24:51.344 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.344 INFO:teuthology.orchestra.run.smithi040.stdout: "from": 3, 2023-09-30T22:24:51.344 INFO:teuthology.orchestra.run.smithi040.stdout: "to": 0 2023-09-30T22:24:51.344 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.344 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-09-30T22:24:51.344 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.344 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.344 INFO:teuthology.orchestra.run.smithi040.stdout: "pgid": "4.1d", 2023-09-30T22:24:51.345 INFO:teuthology.orchestra.run.smithi040.stdout: "mappings": [ 2023-09-30T22:24:51.345 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.345 INFO:teuthology.orchestra.run.smithi040.stdout: "from": 3, 2023-09-30T22:24:51.345 INFO:teuthology.orchestra.run.smithi040.stdout: "to": 2 2023-09-30T22:24:51.345 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.345 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-09-30T22:24:51.345 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.345 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.345 INFO:teuthology.orchestra.run.smithi040.stdout: "pgid": "4.23", 2023-09-30T22:24:51.345 INFO:teuthology.orchestra.run.smithi040.stdout: "mappings": [ 2023-09-30T22:24:51.345 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.345 INFO:teuthology.orchestra.run.smithi040.stdout: "from": 3, 2023-09-30T22:24:51.346 INFO:teuthology.orchestra.run.smithi040.stdout: "to": 2 2023-09-30T22:24:51.346 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.346 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.346 INFO:teuthology.orchestra.run.smithi040.stdout: "from": 1, 2023-09-30T22:24:51.346 INFO:teuthology.orchestra.run.smithi040.stdout: "to": 0 2023-09-30T22:24:51.346 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.346 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-09-30T22:24:51.346 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.346 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.346 INFO:teuthology.orchestra.run.smithi040.stdout: "pgid": "4.2c", 2023-09-30T22:24:51.346 INFO:teuthology.orchestra.run.smithi040.stdout: "mappings": [ 2023-09-30T22:24:51.346 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.347 INFO:teuthology.orchestra.run.smithi040.stdout: "from": 1, 2023-09-30T22:24:51.347 INFO:teuthology.orchestra.run.smithi040.stdout: "to": 2 2023-09-30T22:24:51.347 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.347 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-09-30T22:24:51.347 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.347 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.347 INFO:teuthology.orchestra.run.smithi040.stdout: "pgid": "4.3f", 2023-09-30T22:24:51.347 INFO:teuthology.orchestra.run.smithi040.stdout: "mappings": [ 2023-09-30T22:24:51.347 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-09-30T22:24:51.347 INFO:teuthology.orchestra.run.smithi040.stdout: "from": 3, 2023-09-30T22:24:51.347 INFO:teuthology.orchestra.run.smithi040.stdout: "to": 0 2023-09-30T22:24:51.348 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.348 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-09-30T22:24:51.348 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.348 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2023-09-30T22:24:51.348 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_upmap_primaries": [], 2023-09-30T22:24:51.348 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_temp": [], 2023-09-30T22:24:51.348 INFO:teuthology.orchestra.run.smithi040.stdout: "primary_temp": [], 2023-09-30T22:24:51.348 INFO:teuthology.orchestra.run.smithi040.stdout: "blocklist": { 2023-09-30T22:24:51.348 INFO:teuthology.orchestra.run.smithi040.stdout: "172.21.15.40:6817/2392027806": "2023-10-01T22:24:50.682728+0000", 2023-09-30T22:24:51.348 INFO:teuthology.orchestra.run.smithi040.stdout: "172.21.15.40:0/1890660785": "2023-10-01T22:24:24.127340+0000", 2023-09-30T22:24:51.349 INFO:teuthology.orchestra.run.smithi040.stdout: "172.21.15.40:0/1764460125": "2023-10-01T22:24:24.127340+0000", 2023-09-30T22:24:51.349 INFO:teuthology.orchestra.run.smithi040.stdout: "172.21.15.40:6816/118905": "2023-10-01T22:24:24.127340+0000" 2023-09-30T22:24:51.349 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.349 INFO:teuthology.orchestra.run.smithi040.stdout: "range_blocklist": {}, 2023-09-30T22:24:51.349 INFO:teuthology.orchestra.run.smithi040.stdout: "erasure_code_profiles": { 2023-09-30T22:24:51.349 INFO:teuthology.orchestra.run.smithi040.stdout: "default": { 2023-09-30T22:24:51.349 INFO:teuthology.orchestra.run.smithi040.stdout: "crush-failure-domain": "osd", 2023-09-30T22:24:51.349 INFO:teuthology.orchestra.run.smithi040.stdout: "k": "2", 2023-09-30T22:24:51.349 INFO:teuthology.orchestra.run.smithi040.stdout: "m": "1", 2023-09-30T22:24:51.349 INFO:teuthology.orchestra.run.smithi040.stdout: "plugin": "jerasure", 2023-09-30T22:24:51.350 INFO:teuthology.orchestra.run.smithi040.stdout: "technique": "reed_sol_van" 2023-09-30T22:24:51.350 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.350 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.350 INFO:teuthology.orchestra.run.smithi040.stdout: "removed_snaps_queue": [], 2023-09-30T22:24:51.350 INFO:teuthology.orchestra.run.smithi040.stdout: "new_removed_snaps": [], 2023-09-30T22:24:51.350 INFO:teuthology.orchestra.run.smithi040.stdout: "new_purged_snaps": [], 2023-09-30T22:24:51.350 INFO:teuthology.orchestra.run.smithi040.stdout: "crush_node_flags": {}, 2023-09-30T22:24:51.350 INFO:teuthology.orchestra.run.smithi040.stdout: "device_class_flags": {}, 2023-09-30T22:24:51.350 INFO:teuthology.orchestra.run.smithi040.stdout: "stretch_mode": { 2023-09-30T22:24:51.350 INFO:teuthology.orchestra.run.smithi040.stdout: "stretch_mode_enabled": false, 2023-09-30T22:24:51.350 INFO:teuthology.orchestra.run.smithi040.stdout: "stretch_bucket_count": 0, 2023-09-30T22:24:51.351 INFO:teuthology.orchestra.run.smithi040.stdout: "degraded_stretch_mode": 0, 2023-09-30T22:24:51.351 INFO:teuthology.orchestra.run.smithi040.stdout: "recovering_stretch_mode": 0, 2023-09-30T22:24:51.351 INFO:teuthology.orchestra.run.smithi040.stdout: "stretch_mode_bucket": 0 2023-09-30T22:24:51.351 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.351 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-09-30T22:24:51.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.286+0000 7f5c57022700 1 -- 172.21.15.40:0/763380307 >> v1:172.21.15.40:6816/127432 conn(0x7f5c3402f510 legacy=0x7f5c340319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.286+0000 7f5c57022700 1 -- 172.21.15.40:0/763380307 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c5009dc00 msgr2=0x7f5c5012c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.286+0000 7f5c57022700 1 --2- 172.21.15.40:0/763380307 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c5009dc00 0x7f5c5012c7e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00ed40 tx=0x7f5c3c00d630 comp rx=0 tx=0).stop 2023-09-30T22:24:51.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.287+0000 7f5c57022700 1 -- 172.21.15.40:0/763380307 shutdown_connections 2023-09-30T22:24:51.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.287+0000 7f5c57022700 1 --2- 172.21.15.40:0/763380307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c50130a50 0x7f5c5012cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.287+0000 7f5c57022700 1 --2- 172.21.15.40:0/763380307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c5009a590 0x7f5c5012c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.287+0000 7f5c57022700 1 --2- 172.21.15.40:0/763380307 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c5009dc00 0x7f5c5012c7e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.287+0000 7f5c57022700 1 -- 172.21.15.40:0/763380307 >> 172.21.15.40:0/763380307 conn(0x7f5c5009ea80 msgr2=0x7f5c5012fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:51.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.287+0000 7f5c57022700 1 -- 172.21.15.40:0/763380307 shutdown_connections 2023-09-30T22:24:51.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.287+0000 7f5c57022700 1 -- 172.21.15.40:0/763380307 wait complete. 2023-09-30T22:24:51.353 DEBUG:teuthology.orchestra.run.smithi040:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph versions' 2023-09-30T22:24:51.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.476+0000 7fbe410af700 1 Processor -- start 2023-09-30T22:24:51.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.476+0000 7fbe410af700 1 -- start start 2023-09-30T22:24:51.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.477+0000 7fbe410af700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbe3c09e5a0 0x7fbe3c130700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.477+0000 7fbe410af700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe3c09c980 0x7fbe3c130c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.477+0000 7fbe410af700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe3c09db00 con 0x7fbe3c133630 2023-09-30T22:24:51.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.477+0000 7fbe410af700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe3c09e970 con 0x7fbe3c09e5a0 2023-09-30T22:24:51.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.477+0000 7fbe410af700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3c09d200 con 0x7fbe3c09c980 2023-09-30T22:24:51.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.477+0000 7fbe3ad9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbe3c09e5a0 0x7fbe3c130700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.477+0000 7fbe3b59e700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbe3c133630 0x7fbe3c133a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38444/0 (socket says 172.21.15.40:38444) 2023-09-30T22:24:51.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.477+0000 7fbe3b59e700 1 -- 172.21.15.40:0/3610521127 learned_addr learned my addr 172.21.15.40:0/3610521127 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:24:51.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.477+0000 7fbe3a59c700 1 --2- 172.21.15.40:0/3610521127 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe3c09c980 0x7fbe3c130c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.477+0000 7fbe3ad9d700 1 -- 172.21.15.40:0/3610521127 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe3c09c980 msgr2=0x7fbe3c130c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:51.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.477+0000 7fbe3ad9d700 1 --2- 172.21.15.40:0/3610521127 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe3c09c980 0x7fbe3c130c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.477+0000 7fbe3ad9d700 1 -- 172.21.15.40:0/3610521127 >> v1:172.21.15.40:6789/0 conn(0x7fbe3c133630 legacy=0x7fbe3c133a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.477+0000 7fbe39d9b700 1 -- 172.21.15.40:0/3610521127 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2876631554 0 0) 0x7fbe3c09db00 con 0x7fbe3c133630 2023-09-30T22:24:51.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.477+0000 7fbe3ad9d700 1 -- 172.21.15.40:0/3610521127 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe3c130310 con 0x7fbe3c09e5a0 2023-09-30T22:24:51.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.477+0000 7fbe3ad9d700 1 --2- 172.21.15.40:0/3610521127 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe3c09e5a0 0x7fbe3c130700 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbe24009840 tx=0x7fbe24009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea0be7803eeb2d35 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:51.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.477+0000 7fbe39d9b700 1 -- 172.21.15.40:0/3610521127 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe24011830 con 0x7fbe3c09e5a0 2023-09-30T22:24:51.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.477+0000 7fbe39d9b700 1 -- 172.21.15.40:0/3610521127 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe24011990 con 0x7fbe3c09e5a0 2023-09-30T22:24:51.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.477+0000 7fbe39d9b700 1 -- 172.21.15.40:0/3610521127 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe24011d20 con 0x7fbe3c09e5a0 2023-09-30T22:24:51.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.478+0000 7fbe410af700 1 -- 172.21.15.40:0/3610521127 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe3c09e5a0 msgr2=0x7fbe3c130700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.478+0000 7fbe410af700 1 --2- 172.21.15.40:0/3610521127 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe3c09e5a0 0x7fbe3c130700 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbe24009840 tx=0x7fbe24009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:51.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.478+0000 7fbe410af700 1 -- 172.21.15.40:0/3610521127 shutdown_connections 2023-09-30T22:24:51.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.478+0000 7fbe410af700 1 --2- 172.21.15.40:0/3610521127 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe3c09e5a0 0x7fbe3c130700 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.478+0000 7fbe410af700 1 --2- 172.21.15.40:0/3610521127 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe3c09c980 0x7fbe3c130c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.478+0000 7fbe410af700 1 -- 172.21.15.40:0/3610521127 >> 172.21.15.40:0/3610521127 conn(0x7fbe3c0a6550 msgr2=0x7fbe3c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:51.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.478+0000 7fbe410af700 1 -- 172.21.15.40:0/3610521127 shutdown_connections 2023-09-30T22:24:51.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.478+0000 7fbe410af700 1 -- 172.21.15.40:0/3610521127 wait complete. 2023-09-30T22:24:51.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.479+0000 7fbe410af700 1 Processor -- start 2023-09-30T22:24:51.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.479+0000 7fbe410af700 1 -- start start 2023-09-30T22:24:51.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.480+0000 7fbe410af700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe3c09c980 0x7fbe3c1347b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.480+0000 7fbe410af700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe3c09e5a0 0x7fbe3c134cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.480+0000 7fbe410af700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe3c133630 0x7fbe3c135230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.480+0000 7fbe410af700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3c0a37b0 con 0x7fbe3c09e5a0 2023-09-30T22:24:51.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.480+0000 7fbe410af700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3c136d90 con 0x7fbe3c133630 2023-09-30T22:24:51.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.480+0000 7fbe410af700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3c135f80 con 0x7fbe3c09c980 2023-09-30T22:24:51.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.480+0000 7fbe3ad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe3c09c980 0x7fbe3c1347b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.480+0000 7fbe3ad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe3c09c980 0x7fbe3c1347b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:34666/0 (socket says 172.21.15.40:34666) 2023-09-30T22:24:51.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.480+0000 7fbe3ad9d700 1 -- 172.21.15.40:0/888987167 learned_addr learned my addr 172.21.15.40:0/888987167 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:51.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.480+0000 7fbe3b59e700 1 --2- 172.21.15.40:0/888987167 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe3c133630 0x7fbe3c135230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.480+0000 7fbe3a59c700 1 --2- 172.21.15.40:0/888987167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe3c09e5a0 0x7fbe3c134cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.480+0000 7fbe3ad9d700 1 -- 172.21.15.40:0/888987167 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe3c133630 msgr2=0x7fbe3c135230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.480+0000 7fbe3ad9d700 1 --2- 172.21.15.40:0/888987167 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe3c133630 0x7fbe3c135230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.480+0000 7fbe3ad9d700 1 -- 172.21.15.40:0/888987167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe3c09e5a0 msgr2=0x7fbe3c134cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.480+0000 7fbe3ad9d700 1 --2- 172.21.15.40:0/888987167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe3c09e5a0 0x7fbe3c134cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.480+0000 7fbe3ad9d700 1 -- 172.21.15.40:0/888987167 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe240094a0 con 0x7fbe3c09c980 2023-09-30T22:24:51.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.480+0000 7fbe3ad9d700 1 --2- 172.21.15.40:0/888987167 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe3c09c980 0x7fbe3c1347b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbe24009fd0 tx=0x7fbe24004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:51.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.480+0000 7fbe337fe700 1 -- 172.21.15.40:0/888987167 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe240036a0 con 0x7fbe3c09c980 2023-09-30T22:24:51.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.480+0000 7fbe337fe700 1 -- 172.21.15.40:0/888987167 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2401f070 con 0x7fbe3c09c980 2023-09-30T22:24:51.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.481+0000 7fbe410af700 1 -- 172.21.15.40:0/888987167 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe3c0a4b10 con 0x7fbe3c09c980 2023-09-30T22:24:51.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.481+0000 7fbe337fe700 1 -- 172.21.15.40:0/888987167 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe24003a60 con 0x7fbe3c09c980 2023-09-30T22:24:51.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.481+0000 7fbe410af700 1 -- 172.21.15.40:0/888987167 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe3c0a2d10 con 0x7fbe3c09c980 2023-09-30T22:24:51.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.481+0000 7fbe337fe700 1 -- 172.21.15.40:0/888987167 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fbe24003bc0 con 0x7fbe3c09c980 2023-09-30T22:24:51.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.481+0000 7fbe337fe700 1 -- 172.21.15.40:0/888987167 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4137+0+0 (secure 0 0 0) 0x7fbe24021070 con 0x7fbe3c09c980 2023-09-30T22:24:51.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.482+0000 7fbe410af700 1 -- 172.21.15.40:0/888987167 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe3c09c6a0 con 0x7fbe3c09c980 2023-09-30T22:24:51.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.487+0000 7fbe337fe700 1 -- 172.21.15.40:0/888987167 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe24015080 con 0x7fbe3c09c980 2023-09-30T22:24:51.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.764+0000 7fbe410af700 1 -- 172.21.15.40:0/888987167 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbe3c04f2a0 con 0x7fbe3c09c980 2023-09-30T22:24:51.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.765+0000 7fbe337fe700 1 -- 172.21.15.40:0/888987167 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+627 (secure 0 0 0) 0x7fbe240253e0 con 0x7fbe3c09c980 2023-09-30T22:24:51.764 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-09-30T22:24:51.764 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": { 2023-09-30T22:24:51.764 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 18.2.0-501-gfc1e90a3 (fc1e90a395a6a5631142eb70fd9bf3d22740a9da) reef (stable)": 3 2023-09-30T22:24:51.765 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.765 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": { 2023-09-30T22:24:51.765 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 18.2.0-501-gfc1e90a3 (fc1e90a395a6a5631142eb70fd9bf3d22740a9da) reef (stable)": 1 2023-09-30T22:24:51.765 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.765 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": { 2023-09-30T22:24:51.765 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 18.2.0-501-gfc1e90a3 (fc1e90a395a6a5631142eb70fd9bf3d22740a9da) reef (stable)": 4 2023-09-30T22:24:51.765 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.765 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": { 2023-09-30T22:24:51.765 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 18.2.0-501-gfc1e90a3 (fc1e90a395a6a5631142eb70fd9bf3d22740a9da) reef (stable)": 1 2023-09-30T22:24:51.765 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-09-30T22:24:51.765 INFO:teuthology.orchestra.run.smithi040.stdout: "overall": { 2023-09-30T22:24:51.766 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph version 18.2.0-501-gfc1e90a3 (fc1e90a395a6a5631142eb70fd9bf3d22740a9da) reef (stable)": 9 2023-09-30T22:24:51.766 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-09-30T22:24:51.766 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-09-30T22:24:51.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.767+0000 7fbe410af700 1 -- 172.21.15.40:0/888987167 >> v1:172.21.15.40:6816/127432 conn(0x7fbe1c02f510 legacy=0x7fbe1c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.767+0000 7fbe410af700 1 -- 172.21.15.40:0/888987167 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe3c09c980 msgr2=0x7fbe3c1347b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.767+0000 7fbe410af700 1 --2- 172.21.15.40:0/888987167 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe3c09c980 0x7fbe3c1347b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbe24009fd0 tx=0x7fbe24004750 comp rx=0 tx=0).stop 2023-09-30T22:24:51.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.767+0000 7fbe410af700 1 -- 172.21.15.40:0/888987167 shutdown_connections 2023-09-30T22:24:51.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.767+0000 7fbe410af700 1 --2- 172.21.15.40:0/888987167 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe3c09c980 0x7fbe3c1347b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.767+0000 7fbe410af700 1 --2- 172.21.15.40:0/888987167 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe3c133630 0x7fbe3c135230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.767+0000 7fbe410af700 1 --2- 172.21.15.40:0/888987167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe3c09e5a0 0x7fbe3c134cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.767+0000 7fbe410af700 1 -- 172.21.15.40:0/888987167 >> 172.21.15.40:0/888987167 conn(0x7fbe3c0a6550 msgr2=0x7fbe3c12e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:51.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.767+0000 7fbe410af700 1 -- 172.21.15.40:0/888987167 shutdown_connections 2023-09-30T22:24:51.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.767+0000 7fbe410af700 1 -- 172.21.15.40:0/888987167 wait complete. 2023-09-30T22:24:51.778 DEBUG:teuthology.orchestra.run.smithi040:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done' 2023-09-30T22:24:51.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.903+0000 7f91ee2d5700 1 Processor -- start 2023-09-30T22:24:51.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.903+0000 7f91ee2d5700 1 -- start start 2023-09-30T22:24:51.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.903+0000 7f91ee2d5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f91e80a0600 0x7f91e8133c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.903+0000 7f91ee2d5700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f91e81341c0 0x7f91e809e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.903+0000 7f91ee2d5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f91e8134590 0x7f91e809ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.903+0000 7f91ee2d5700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e80a09d0 con 0x7f91e81341c0 2023-09-30T22:24:51.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.903+0000 7f91ee2d5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e806b430 con 0x7f91e80a0600 2023-09-30T22:24:51.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.903+0000 7f91ee2d5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91e8072340 con 0x7f91e8134590 2023-09-30T22:24:51.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.903+0000 7f91e7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f91e80a0600 0x7f91e8133c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.903+0000 7f91ec872700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f91e8134590 0x7f91e809ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.903+0000 7f91e77fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f91e81341c0 0x7f91e809e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.903+0000 7f91e7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f91e80a0600 0x7f91e8133c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:36618/0 (socket says 172.21.15.40:36618) 2023-09-30T22:24:51.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.903+0000 7f91e77fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f91e81341c0 0x7f91e809e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55714/0 (socket says 172.21.15.40:55714) 2023-09-30T22:24:51.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.903+0000 7f91ec872700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f91e8134590 0x7f91e809ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:34676/0 (socket says 172.21.15.40:34676) 2023-09-30T22:24:51.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.903+0000 7f91e7fff700 1 -- 172.21.15.40:0/1623388313 learned_addr learned my addr 172.21.15.40:0/1623388313 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:51.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.904+0000 7f91ec872700 1 -- 172.21.15.40:0/1623388313 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f91e80a0600 msgr2=0x7f91e8133c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:51.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.904+0000 7f91ec872700 1 --2- 172.21.15.40:0/1623388313 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f91e80a0600 0x7f91e8133c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.904+0000 7f91ec872700 1 -- 172.21.15.40:0/1623388313 >> v2:172.21.15.40:3300/0 conn(0x7f91e81341c0 msgr2=0x7f91e809e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:51.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.904+0000 7f91ec872700 1 --2- 172.21.15.40:0/1623388313 >> v2:172.21.15.40:3300/0 conn(0x7f91e81341c0 0x7f91e809e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.904+0000 7f91ec872700 1 -- 172.21.15.40:0/1623388313 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e8072710 con 0x7f91e8134590 2023-09-30T22:24:51.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.904+0000 7f91e7fff700 1 --2- 172.21.15.40:0/1623388313 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f91e80a0600 0x7f91e8133c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:51.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.904+0000 7f91e77fe700 1 --2- 172.21.15.40:0/1623388313 >> v2:172.21.15.40:3300/0 conn(0x7f91e81341c0 0x7f91e809e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:51.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.904+0000 7f91ec872700 1 --2- 172.21.15.40:0/1623388313 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f91e8134590 0x7f91e809ef20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f91e0009dc0 tx=0x7f91e000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8a126aa5561375c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:51.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.904+0000 7f91e6ffd700 1 -- 172.21.15.40:0/1623388313 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e000e070 con 0x7f91e8134590 2023-09-30T22:24:51.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.904+0000 7f91e6ffd700 1 -- 172.21.15.40:0/1623388313 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e000bae0 con 0x7f91e8134590 2023-09-30T22:24:51.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.904+0000 7f91e6ffd700 1 -- 172.21.15.40:0/1623388313 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e000be90 con 0x7f91e8134590 2023-09-30T22:24:51.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.904+0000 7f91ee2d5700 1 -- 172.21.15.40:0/1623388313 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f91e8134590 msgr2=0x7f91e809ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.904+0000 7f91ee2d5700 1 --2- 172.21.15.40:0/1623388313 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f91e8134590 0x7f91e809ef20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f91e0009dc0 tx=0x7f91e000b330 comp rx=0 tx=0).stop 2023-09-30T22:24:51.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.904+0000 7f91ee2d5700 1 -- 172.21.15.40:0/1623388313 shutdown_connections 2023-09-30T22:24:51.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.904+0000 7f91ee2d5700 1 --2- 172.21.15.40:0/1623388313 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f91e8134590 0x7f91e809ef20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.904+0000 7f91ee2d5700 1 --2- 172.21.15.40:0/1623388313 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f91e80a0600 0x7f91e8133c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.904+0000 7f91ee2d5700 1 --2- 172.21.15.40:0/1623388313 >> v2:172.21.15.40:3300/0 conn(0x7f91e81341c0 0x7f91e809e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.904+0000 7f91ee2d5700 1 -- 172.21.15.40:0/1623388313 >> 172.21.15.40:0/1623388313 conn(0x7f91e80a3cb0 msgr2=0x7f91e809fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:51.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.905+0000 7f91ee2d5700 1 -- 172.21.15.40:0/1623388313 shutdown_connections 2023-09-30T22:24:51.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.905+0000 7f91ee2d5700 1 -- 172.21.15.40:0/1623388313 wait complete. 2023-09-30T22:24:51.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.905+0000 7f91ee2d5700 1 Processor -- start 2023-09-30T22:24:51.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.906+0000 7f91ee2d5700 1 -- start start 2023-09-30T22:24:51.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.906+0000 7f91ee2d5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f91e80a0600 0x7f91e8129af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.906+0000 7f91ee2d5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f91e81341c0 0x7f91e812a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.906+0000 7f91ee2d5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91e8134590 0x7f91e812a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.906+0000 7f91ee2d5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e812dec0 con 0x7f91e8134590 2023-09-30T22:24:51.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.906+0000 7f91ee2d5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e812cd00 con 0x7f91e81341c0 2023-09-30T22:24:51.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.906+0000 7f91ee2d5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91e809c630 con 0x7f91e80a0600 2023-09-30T22:24:51.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.906+0000 7f91e7fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f91e80a0600 0x7f91e8129af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.906+0000 7f91e77fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f91e81341c0 0x7f91e812a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.906+0000 7f91e7fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f91e80a0600 0x7f91e8129af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:34690/0 (socket says 172.21.15.40:34690) 2023-09-30T22:24:51.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.906+0000 7f91ec872700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91e8134590 0x7f91e812a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.906+0000 7f91e7fff700 1 -- 172.21.15.40:0/54117634 learned_addr learned my addr 172.21.15.40:0/54117634 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:51.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.906+0000 7f91e77fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f91e81341c0 0x7f91e812a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:36630/0 (socket says 172.21.15.40:36630) 2023-09-30T22:24:51.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.907+0000 7f91ec872700 1 -- 172.21.15.40:0/54117634 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f91e80a0600 msgr2=0x7f91e8129af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.907+0000 7f91ec872700 1 --2- 172.21.15.40:0/54117634 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f91e80a0600 0x7f91e8129af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.907+0000 7f91ec872700 1 -- 172.21.15.40:0/54117634 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f91e81341c0 msgr2=0x7f91e812a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.907+0000 7f91ec872700 1 --2- 172.21.15.40:0/54117634 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f91e81341c0 0x7f91e812a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.907+0000 7f91ec872700 1 -- 172.21.15.40:0/54117634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d8009500 con 0x7f91e8134590 2023-09-30T22:24:51.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.907+0000 7f91e7fff700 1 --2- 172.21.15.40:0/54117634 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f91e80a0600 0x7f91e8129af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:51.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.907+0000 7f91e77fe700 1 --2- 172.21.15.40:0/54117634 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f91e81341c0 0x7f91e812a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:51.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.907+0000 7f91ec872700 1 --2- 172.21.15.40:0/54117634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91e8134590 0x7f91e812a570 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f91e0016000 tx=0x7f91e0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:51.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.907+0000 7f91e4ff9700 1 -- 172.21.15.40:0/54117634 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e00044d0 con 0x7f91e8134590 2023-09-30T22:24:51.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.907+0000 7f91e4ff9700 1 -- 172.21.15.40:0/54117634 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e0020070 con 0x7f91e8134590 2023-09-30T22:24:51.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.907+0000 7f91ee2d5700 1 -- 172.21.15.40:0/54117634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91dc0094a0 con 0x7f91e8134590 2023-09-30T22:24:51.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.907+0000 7f91e4ff9700 1 -- 172.21.15.40:0/54117634 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e00048b0 con 0x7f91e8134590 2023-09-30T22:24:51.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.907+0000 7f91ee2d5700 1 -- 172.21.15.40:0/54117634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e0009a70 con 0x7f91e8134590 2023-09-30T22:24:51.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.908+0000 7f91e4ff9700 1 -- 172.21.15.40:0/54117634 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f91e0027480 con 0x7f91e8134590 2023-09-30T22:24:51.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.908+0000 7f91e4ff9700 1 -- 172.21.15.40:0/54117634 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f91e0022070 con 0x7f91e8134590 2023-09-30T22:24:51.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.908+0000 7f91ee2d5700 1 -- 172.21.15.40:0/54117634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e812c8a0 con 0x7f91e8134590 2023-09-30T22:24:51.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:51.913+0000 7f91e4ff9700 1 -- 172.21.15.40:0/54117634 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f91e002c020 con 0x7f91e8134590 2023-09-30T22:24:52.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.106+0000 7f91ee2d5700 1 -- 172.21.15.40:0/54117634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool ls"} v 0) v1 -- 0x7f91e804f2a0 con 0x7f91e8134590 2023-09-30T22:24:52.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.107+0000 7f91e4ff9700 1 -- 172.21.15.40:0/54117634 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v36) v1 ==== 59+0+37 (secure 0 0 0) 0x7f91e0011980 con 0x7f91e8134590 2023-09-30T22:24:52.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.109+0000 7f91ee2d5700 1 -- 172.21.15.40:0/54117634 >> v1:172.21.15.40:6816/127432 conn(0x7f91d402f510 legacy=0x7f91d40319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.109+0000 7f91ee2d5700 1 -- 172.21.15.40:0/54117634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91e8134590 msgr2=0x7f91e812a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.109+0000 7f91ee2d5700 1 --2- 172.21.15.40:0/54117634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91e8134590 0x7f91e812a570 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f91e0016000 tx=0x7f91e0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.109+0000 7f91ee2d5700 1 -- 172.21.15.40:0/54117634 shutdown_connections 2023-09-30T22:24:52.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.109+0000 7f91ee2d5700 1 --2- 172.21.15.40:0/54117634 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f91e80a0600 0x7f91e8129af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.109+0000 7f91ee2d5700 1 --2- 172.21.15.40:0/54117634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91e8134590 0x7f91e812a570 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.109+0000 7f91ee2d5700 1 --2- 172.21.15.40:0/54117634 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f91e81341c0 0x7f91e812a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.109+0000 7f91ee2d5700 1 -- 172.21.15.40:0/54117634 >> 172.21.15.40:0/54117634 conn(0x7f91e80a3cb0 msgr2=0x7f91e8099760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:52.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.109+0000 7f91ee2d5700 1 -- 172.21.15.40:0/54117634 shutdown_connections 2023-09-30T22:24:52.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.109+0000 7f91ee2d5700 1 -- 172.21.15.40:0/54117634 wait complete. 2023-09-30T22:24:52.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.220+0000 7fa938329700 1 Processor -- start 2023-09-30T22:24:52.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.220+0000 7fa938329700 1 -- start start 2023-09-30T22:24:52.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.221+0000 7fa938329700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa93009b8b0 0x7fa930134e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.221+0000 7fa938329700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa930135390 0x7fa930137770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.221+0000 7fa938329700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa93009cd40 con 0x7fa93012c880 2023-09-30T22:24:52.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.221+0000 7fa938329700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa93009b250 con 0x7fa930135390 2023-09-30T22:24:52.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.221+0000 7fa938329700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa93009c100 con 0x7fa93009b8b0 2023-09-30T22:24:52.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.221+0000 7fa9368c6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa930135390 0x7fa930137770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.221+0000 7fa9358c4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa93009b8b0 0x7fa930134e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.221+0000 7fa9368c6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa930135390 0x7fa930137770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55744/0 (socket says 172.21.15.40:55744) 2023-09-30T22:24:52.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.221+0000 7fa9368c6700 1 -- 172.21.15.40:0/1443314999 learned_addr learned my addr 172.21.15.40:0/1443314999 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:52.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.222+0000 7fa9358c4700 1 -- 172.21.15.40:0/1443314999 >> v2:172.21.15.40:3300/0 conn(0x7fa930135390 msgr2=0x7fa930137770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:52.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.222+0000 7fa9358c4700 1 --2- 172.21.15.40:0/1443314999 >> v2:172.21.15.40:3300/0 conn(0x7fa930135390 0x7fa930137770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.222+0000 7fa9358c4700 1 -- 172.21.15.40:0/1443314999 >> v1:172.21.15.40:6789/0 conn(0x7fa93012c880 legacy=0x7fa93012cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.222+0000 7fa9358c4700 1 -- 172.21.15.40:0/1443314999 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa93009c3c0 con 0x7fa93009b8b0 2023-09-30T22:24:52.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.222+0000 7fa9368c6700 1 --2- 172.21.15.40:0/1443314999 >> v2:172.21.15.40:3300/0 conn(0x7fa930135390 0x7fa930137770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:52.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.222+0000 7fa9358c4700 1 --2- 172.21.15.40:0/1443314999 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa93009b8b0 0x7fa930134e50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa920009840 tx=0x7fa920009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=198d02100ad1247c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:52.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.222+0000 7fa9350c3700 1 -- 172.21.15.40:0/1443314999 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa920011830 con 0x7fa93009b8b0 2023-09-30T22:24:52.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.222+0000 7fa9350c3700 1 -- 172.21.15.40:0/1443314999 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa920011990 con 0x7fa93009b8b0 2023-09-30T22:24:52.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.222+0000 7fa9350c3700 1 -- 172.21.15.40:0/1443314999 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa920011d20 con 0x7fa93009b8b0 2023-09-30T22:24:52.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.222+0000 7fa938329700 1 -- 172.21.15.40:0/1443314999 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa93009b8b0 msgr2=0x7fa930134e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.222+0000 7fa938329700 1 --2- 172.21.15.40:0/1443314999 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa93009b8b0 0x7fa930134e50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa920009840 tx=0x7fa920009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:52.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.222+0000 7fa938329700 1 -- 172.21.15.40:0/1443314999 shutdown_connections 2023-09-30T22:24:52.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.223+0000 7fa938329700 1 --2- 172.21.15.40:0/1443314999 >> v2:172.21.15.40:3300/0 conn(0x7fa930135390 0x7fa930137770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.223+0000 7fa938329700 1 --2- 172.21.15.40:0/1443314999 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa93009b8b0 0x7fa930134e50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.223+0000 7fa938329700 1 -- 172.21.15.40:0/1443314999 >> 172.21.15.40:0/1443314999 conn(0x7fa93009f5c0 msgr2=0x7fa93009f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:52.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.223+0000 7fa938329700 1 -- 172.21.15.40:0/1443314999 shutdown_connections 2023-09-30T22:24:52.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.223+0000 7fa938329700 1 -- 172.21.15.40:0/1443314999 wait complete. 2023-09-30T22:24:52.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.224+0000 7fa938329700 1 Processor -- start 2023-09-30T22:24:52.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.224+0000 7fa938329700 1 -- start start 2023-09-30T22:24:52.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.224+0000 7fa938329700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa93009b8b0 0x7fa930138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.224+0000 7fa938329700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa93012c880 0x7fa930139200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.225+0000 7fa938329700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa930135390 0x7fa930139740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.225+0000 7fa938329700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa930131570 con 0x7fa930135390 2023-09-30T22:24:52.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.225+0000 7fa938329700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa930132d80 con 0x7fa93012c880 2023-09-30T22:24:52.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.225+0000 7fa938329700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa930132fd0 con 0x7fa93009b8b0 2023-09-30T22:24:52.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.225+0000 7fa9368c6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa930135390 0x7fa930139740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.225+0000 7fa9358c4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa93012c880 0x7fa930139200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.225+0000 7fa9360c5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa93009b8b0 0x7fa930138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.225+0000 7fa9358c4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa93012c880 0x7fa930139200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:36634/0 (socket says 172.21.15.40:36634) 2023-09-30T22:24:52.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.225+0000 7fa9368c6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa930135390 0x7fa930139740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55760/0 (socket says 172.21.15.40:55760) 2023-09-30T22:24:52.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.225+0000 7fa9358c4700 1 -- 172.21.15.40:0/1248768386 learned_addr learned my addr 172.21.15.40:0/1248768386 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:52.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.225+0000 7fa9360c5700 1 -- 172.21.15.40:0/1248768386 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa93012c880 msgr2=0x7fa930139200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.225+0000 7fa9360c5700 1 --2- 172.21.15.40:0/1248768386 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa93012c880 0x7fa930139200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.225+0000 7fa9360c5700 1 -- 172.21.15.40:0/1248768386 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa930135390 msgr2=0x7fa930139740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.225+0000 7fa9360c5700 1 --2- 172.21.15.40:0/1248768386 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa930135390 0x7fa930139740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.225+0000 7fa9360c5700 1 -- 172.21.15.40:0/1248768386 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa928009b30 con 0x7fa93009b8b0 2023-09-30T22:24:52.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.225+0000 7fa9358c4700 1 --2- 172.21.15.40:0/1248768386 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa93012c880 0x7fa930139200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:52.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.225+0000 7fa9360c5700 1 --2- 172.21.15.40:0/1248768386 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa93009b8b0 0x7fa930138cc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa92c000f60 tx=0x7fa92c00c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:52.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.225+0000 7fa926ffd700 1 -- 172.21.15.40:0/1248768386 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92c0052d0 con 0x7fa93009b8b0 2023-09-30T22:24:52.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.225+0000 7fa926ffd700 1 -- 172.21.15.40:0/1248768386 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa92c005430 con 0x7fa93009b8b0 2023-09-30T22:24:52.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.225+0000 7fa926ffd700 1 -- 172.21.15.40:0/1248768386 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92c0038c0 con 0x7fa93009b8b0 2023-09-30T22:24:52.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.226+0000 7fa938329700 1 -- 172.21.15.40:0/1248768386 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9200094a0 con 0x7fa93009b8b0 2023-09-30T22:24:52.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.226+0000 7fa938329700 1 -- 172.21.15.40:0/1248768386 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa93012a200 con 0x7fa93009b8b0 2023-09-30T22:24:52.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.226+0000 7fa926ffd700 1 -- 172.21.15.40:0/1248768386 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa92c003a20 con 0x7fa93009b8b0 2023-09-30T22:24:52.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.226+0000 7fa926ffd700 1 -- 172.21.15.40:0/1248768386 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4137+0+0 (secure 0 0 0) 0x7fa92c03efe0 con 0x7fa93009b8b0 2023-09-30T22:24:52.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.227+0000 7fa938329700 1 -- 172.21.15.40:0/1248768386 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa93004f2a0 con 0x7fa93009b8b0 2023-09-30T22:24:52.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.231+0000 7fa926ffd700 1 -- 172.21.15.40:0/1248768386 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa92c011590 con 0x7fa93009b8b0 2023-09-30T22:24:52.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.423+0000 7fa938329700 1 -- 172.21.15.40:0/1248768386 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7fa930074b30 con 0x7fa93009b8b0 2023-09-30T22:24:52.715 INFO:tasks.ceph.mgr.x.smithi040.stderr:terminate called after throwing an instance of 'ceph::buffer::v15_2_0::end_of_buffer' 2023-09-30T22:24:52.715 INFO:tasks.ceph.mgr.x.smithi040.stderr: what(): End of buffer [buffer:2] 2023-09-30T22:24:52.715 INFO:tasks.ceph.mgr.x.smithi040.stderr:*** Caught signal (Aborted) ** 2023-09-30T22:24:52.715 INFO:tasks.ceph.mgr.x.smithi040.stderr: in thread 7ff0593bc700 thread_name:ms_dispatch 2023-09-30T22:24:52.721 INFO:tasks.ceph.mgr.x.smithi040.stderr: ceph version 18.2.0-501-gfc1e90a3 (fc1e90a395a6a5631142eb70fd9bf3d22740a9da) reef (stable) 2023-09-30T22:24:52.721 INFO:tasks.ceph.mgr.x.smithi040.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7ff0e3374cf0] 2023-09-30T22:24:52.722 INFO:tasks.ceph.mgr.x.smithi040.stderr: 2: gsignal() 2023-09-30T22:24:52.722 INFO:tasks.ceph.mgr.x.smithi040.stderr: 3: abort() 2023-09-30T22:24:52.722 INFO:tasks.ceph.mgr.x.smithi040.stderr: 4: /lib64/libstdc++.so.6(+0x9009b) [0x7ff0e222409b] 2023-09-30T22:24:52.722 INFO:tasks.ceph.mgr.x.smithi040.stderr: 5: /lib64/libstdc++.so.6(+0x9653c) [0x7ff0e222a53c] 2023-09-30T22:24:52.722 INFO:tasks.ceph.mgr.x.smithi040.stderr: 6: /lib64/libstdc++.so.6(+0x96597) [0x7ff0e222a597] 2023-09-30T22:24:52.722 INFO:tasks.ceph.mgr.x.smithi040.stderr: 7: /lib64/libstdc++.so.6(+0x967f8) [0x7ff0e222a7f8] 2023-09-30T22:24:52.722 INFO:tasks.ceph.mgr.x.smithi040.stderr: 8: (ceph::buffer::v15_2_0::list::iterator_impl::copy(unsigned int, char*)+0xa5) [0x7ff0e474cb05] 2023-09-30T22:24:52.722 INFO:tasks.ceph.mgr.x.smithi040.stderr: 9: (SnapRealmInfo::decode(ceph::buffer::v15_2_0::list::iterator_impl&)+0x40) [0x7ff0e453db60] 2023-09-30T22:24:52.722 INFO:tasks.ceph.mgr.x.smithi040.stderr: 10: /lib64/libcephfs.so.2(+0x62f7e) [0x7ff0cf34bf7e] 2023-09-30T22:24:52.722 INFO:tasks.ceph.mgr.x.smithi040.stderr: 11: /lib64/libcephfs.so.2(+0xbc051) [0x7ff0cf3a5051] 2023-09-30T22:24:52.723 INFO:tasks.ceph.mgr.x.smithi040.stderr: 12: /lib64/libcephfs.so.2(+0xbced8) [0x7ff0cf3a5ed8] 2023-09-30T22:24:52.723 INFO:tasks.ceph.mgr.x.smithi040.stderr: 13: /lib64/libcephfs.so.2(+0xe8af5) [0x7ff0cf3d1af5] 2023-09-30T22:24:52.723 INFO:tasks.ceph.mgr.x.smithi040.stderr: 14: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7ff0e4601208] 2023-09-30T22:24:52.723 INFO:tasks.ceph.mgr.x.smithi040.stderr: 15: (DispatchQueue::entry()+0x50f) [0x7ff0e45fe3af] 2023-09-30T22:24:52.723 INFO:tasks.ceph.mgr.x.smithi040.stderr: 16: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff0e46c48f1] 2023-09-30T22:24:52.723 INFO:tasks.ceph.mgr.x.smithi040.stderr: 17: /lib64/libpthread.so.0(+0x81ca) [0x7ff0e336a1ca] 2023-09-30T22:24:52.723 INFO:tasks.ceph.mgr.x.smithi040.stderr: 18: clone() 2023-09-30T22:24:52.723 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-09-30T22:24:52.716+0000 7ff0593bc700 -1 *** Caught signal (Aborted) ** 2023-09-30T22:24:52.723 INFO:tasks.ceph.mgr.x.smithi040.stderr: in thread 7ff0593bc700 thread_name:ms_dispatch 2023-09-30T22:24:52.723 INFO:tasks.ceph.mgr.x.smithi040.stderr: 2023-09-30T22:24:52.723 INFO:tasks.ceph.mgr.x.smithi040.stderr: ceph version 18.2.0-501-gfc1e90a3 (fc1e90a395a6a5631142eb70fd9bf3d22740a9da) reef (stable) 2023-09-30T22:24:52.723 INFO:tasks.ceph.mgr.x.smithi040.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7ff0e3374cf0] 2023-09-30T22:24:52.724 INFO:tasks.ceph.mgr.x.smithi040.stderr: 2: gsignal() 2023-09-30T22:24:52.724 INFO:tasks.ceph.mgr.x.smithi040.stderr: 3: abort() 2023-09-30T22:24:52.724 INFO:tasks.ceph.mgr.x.smithi040.stderr: 4: /lib64/libstdc++.so.6(+0x9009b) [0x7ff0e222409b] 2023-09-30T22:24:52.724 INFO:tasks.ceph.mgr.x.smithi040.stderr: 5: /lib64/libstdc++.so.6(+0x9653c) [0x7ff0e222a53c] 2023-09-30T22:24:52.724 INFO:tasks.ceph.mgr.x.smithi040.stderr: 6: /lib64/libstdc++.so.6(+0x96597) [0x7ff0e222a597] 2023-09-30T22:24:52.724 INFO:tasks.ceph.mgr.x.smithi040.stderr: 7: /lib64/libstdc++.so.6(+0x967f8) [0x7ff0e222a7f8] 2023-09-30T22:24:52.724 INFO:tasks.ceph.mgr.x.smithi040.stderr: 8: (ceph::buffer::v15_2_0::list::iterator_impl::copy(unsigned int, char*)+0xa5) [0x7ff0e474cb05] 2023-09-30T22:24:52.724 INFO:tasks.ceph.mgr.x.smithi040.stderr: 9: (SnapRealmInfo::decode(ceph::buffer::v15_2_0::list::iterator_impl&)+0x40) [0x7ff0e453db60] 2023-09-30T22:24:52.724 INFO:tasks.ceph.mgr.x.smithi040.stderr: 10: /lib64/libcephfs.so.2(+0x62f7e) [0x7ff0cf34bf7e] 2023-09-30T22:24:52.724 INFO:tasks.ceph.mgr.x.smithi040.stderr: 11: /lib64/libcephfs.so.2(+0xbc051) [0x7ff0cf3a5051] 2023-09-30T22:24:52.724 INFO:tasks.ceph.mgr.x.smithi040.stderr: 12: /lib64/libcephfs.so.2(+0xbced8) [0x7ff0cf3a5ed8] 2023-09-30T22:24:52.724 INFO:tasks.ceph.mgr.x.smithi040.stderr: 13: /lib64/libcephfs.so.2(+0xe8af5) [0x7ff0cf3d1af5] 2023-09-30T22:24:52.724 INFO:tasks.ceph.mgr.x.smithi040.stderr: 14: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x478) [0x7ff0e4601208] 2023-09-30T22:24:52.725 INFO:tasks.ceph.mgr.x.smithi040.stderr: 15: (DispatchQueue::entry()+0x50f) [0x7ff0e45fe3af] 2023-09-30T22:24:52.725 INFO:tasks.ceph.mgr.x.smithi040.stderr: 16: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff0e46c48f1] 2023-09-30T22:24:52.725 INFO:tasks.ceph.mgr.x.smithi040.stderr: 17: /lib64/libpthread.so.0(+0x81ca) [0x7ff0e336a1ca] 2023-09-30T22:24:52.725 INFO:tasks.ceph.mgr.x.smithi040.stderr: 18: clone() 2023-09-30T22:24:52.725 INFO:tasks.ceph.mgr.x.smithi040.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-09-30T22:24:52.725 INFO:tasks.ceph.mgr.x.smithi040.stderr: 2023-09-30T22:24:52.725 INFO:tasks.ceph.mgr.x.smithi040.stderr:terminate called recursively 2023-09-30T22:24:52.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.717+0000 7fa926ffd700 1 -- 172.21.15.40:0/1248768386 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 1 pg_autoscale_mode to off v37) v1 ==== 153+0+0 (secure 0 0 0) 0x7fa92c017030 con 0x7fa93009b8b0 2023-09-30T22:24:52.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.720+0000 7fa938329700 1 -- 172.21.15.40:0/1248768386 >> v1:172.21.15.40:6816/127432 conn(0x7fa91402f510 legacy=0x7fa9140319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.720+0000 7fa938329700 1 -- 172.21.15.40:0/1248768386 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa93009b8b0 msgr2=0x7fa930138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.720+0000 7fa938329700 1 --2- 172.21.15.40:0/1248768386 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa93009b8b0 0x7fa930138cc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa92c000f60 tx=0x7fa92c00c730 comp rx=0 tx=0).stop 2023-09-30T22:24:52.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.720+0000 7fa938329700 1 -- 172.21.15.40:0/1248768386 shutdown_connections 2023-09-30T22:24:52.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.720+0000 7fa938329700 1 --2- 172.21.15.40:0/1248768386 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa93009b8b0 0x7fa930138cc0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.720+0000 7fa938329700 1 --2- 172.21.15.40:0/1248768386 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa930135390 0x7fa930139740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.720+0000 7fa938329700 1 --2- 172.21.15.40:0/1248768386 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa93012c880 0x7fa930139200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.720+0000 7fa938329700 1 -- 172.21.15.40:0/1248768386 >> 172.21.15.40:0/1248768386 conn(0x7fa93009f5c0 msgr2=0x7fa93012be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:52.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.720+0000 7fa938329700 1 -- 172.21.15.40:0/1248768386 shutdown_connections 2023-09-30T22:24:52.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.720+0000 7fa938329700 1 -- 172.21.15.40:0/1248768386 wait complete. 2023-09-30T22:24:52.726 INFO:teuthology.orchestra.run.smithi040.stderr:set pool 1 pg_autoscale_mode to off 2023-09-30T22:24:52.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.840+0000 7fec5d0e8700 1 Processor -- start 2023-09-30T22:24:52.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.840+0000 7fec5d0e8700 1 -- start start 2023-09-30T22:24:52.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.841+0000 7fec5d0e8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fec58072290 0x7fec58135740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.841+0000 7fec5d0e8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec58135c80 0x7fec58138060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.841+0000 7fec5d0e8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec5809ead0 con 0x7fec5809adb0 2023-09-30T22:24:52.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.841+0000 7fec5d0e8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5809c720 con 0x7fec58135c80 2023-09-30T22:24:52.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.841+0000 7fec5d0e8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec5809abb0 con 0x7fec58072290 2023-09-30T22:24:52.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.841+0000 7fec5659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fec58072290 0x7fec58135740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.841+0000 7fec5659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fec58072290 0x7fec58135740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:34718/0 (socket says 172.21.15.40:34718) 2023-09-30T22:24:52.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.841+0000 7fec5659c700 1 -- 172.21.15.40:0/2873021059 learned_addr learned my addr 172.21.15.40:0/2873021059 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:52.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.841+0000 7fec5759e700 1 --2- 172.21.15.40:0/2873021059 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec58135c80 0x7fec58138060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.841+0000 7fec5659c700 1 -- 172.21.15.40:0/2873021059 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec58135c80 msgr2=0x7fec58138060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:52.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.841+0000 7fec5659c700 1 --2- 172.21.15.40:0/2873021059 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec58135c80 0x7fec58138060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.841+0000 7fec5659c700 1 -- 172.21.15.40:0/2873021059 >> v1:172.21.15.40:6789/0 conn(0x7fec5809adb0 legacy=0x7fec5809b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.841+0000 7fec55d9b700 1 -- 172.21.15.40:0/2873021059 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2063406995 0 0) 0x7fec5809ead0 con 0x7fec5809adb0 2023-09-30T22:24:52.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.842+0000 7fec5659c700 1 -- 172.21.15.40:0/2873021059 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5809c980 con 0x7fec58072290 2023-09-30T22:24:52.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.842+0000 7fec5659c700 1 --2- 172.21.15.40:0/2873021059 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fec58072290 0x7fec58135740 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fec4c009920 tx=0x7fec4c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2696f203e57a6a64 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:52.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.842+0000 7fec55d9b700 1 -- 172.21.15.40:0/2873021059 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c011830 con 0x7fec58072290 2023-09-30T22:24:52.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.842+0000 7fec55d9b700 1 -- 172.21.15.40:0/2873021059 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4c011990 con 0x7fec58072290 2023-09-30T22:24:52.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.842+0000 7fec55d9b700 1 -- 172.21.15.40:0/2873021059 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c011d20 con 0x7fec58072290 2023-09-30T22:24:52.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.843+0000 7fec5d0e8700 1 -- 172.21.15.40:0/2873021059 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fec58072290 msgr2=0x7fec58135740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.843+0000 7fec5d0e8700 1 --2- 172.21.15.40:0/2873021059 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fec58072290 0x7fec58135740 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fec4c009920 tx=0x7fec4c009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:52.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.843+0000 7fec5d0e8700 1 -- 172.21.15.40:0/2873021059 shutdown_connections 2023-09-30T22:24:52.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.843+0000 7fec5d0e8700 1 --2- 172.21.15.40:0/2873021059 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec58135c80 0x7fec58138060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.843+0000 7fec5d0e8700 1 --2- 172.21.15.40:0/2873021059 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fec58072290 0x7fec58135740 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.843+0000 7fec5d0e8700 1 -- 172.21.15.40:0/2873021059 >> 172.21.15.40:0/2873021059 conn(0x7fec5809f5c0 msgr2=0x7fec5809f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:52.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.843+0000 7fec5d0e8700 1 -- 172.21.15.40:0/2873021059 shutdown_connections 2023-09-30T22:24:52.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.843+0000 7fec5d0e8700 1 -- 172.21.15.40:0/2873021059 wait complete. 2023-09-30T22:24:52.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.844+0000 7fec5d0e8700 1 Processor -- start 2023-09-30T22:24:52.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.845+0000 7fec5d0e8700 1 -- start start 2023-09-30T22:24:52.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.845+0000 7fec5d0e8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec58072290 0x7fec58130390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.845+0000 7fec5d0e8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fec5809adb0 0x7fec581308d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.845+0000 7fec5d0e8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec58135c80 0x7fec58130e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.845+0000 7fec5d0e8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec58134a40 con 0x7fec58135c80 2023-09-30T22:24:52.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.845+0000 7fec5d0e8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec581317f0 con 0x7fec58072290 2023-09-30T22:24:52.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.845+0000 7fec5d0e8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec581358a0 con 0x7fec5809adb0 2023-09-30T22:24:52.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.845+0000 7fec5659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fec5809adb0 0x7fec581308d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.845+0000 7fec5759e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec58135c80 0x7fec58130e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.845+0000 7fec56d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec58072290 0x7fec58130390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.845+0000 7fec5759e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec58135c80 0x7fec58130e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55770/0 (socket says 172.21.15.40:55770) 2023-09-30T22:24:52.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.845+0000 7fec5659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fec5809adb0 0x7fec581308d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:34732/0 (socket says 172.21.15.40:34732) 2023-09-30T22:24:52.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.845+0000 7fec5759e700 1 -- 172.21.15.40:0/1389748389 learned_addr learned my addr 172.21.15.40:0/1389748389 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:52.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.845+0000 7fec56d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec58072290 0x7fec58130390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:36642/0 (socket says 172.21.15.40:36642) 2023-09-30T22:24:52.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.846+0000 7fec56d9d700 1 -- 172.21.15.40:0/1389748389 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fec5809adb0 msgr2=0x7fec581308d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.846+0000 7fec56d9d700 1 --2- 172.21.15.40:0/1389748389 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fec5809adb0 0x7fec581308d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.846+0000 7fec56d9d700 1 -- 172.21.15.40:0/1389748389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec58135c80 msgr2=0x7fec58130e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.846+0000 7fec56d9d700 1 --2- 172.21.15.40:0/1389748389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec58135c80 0x7fec58130e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.846+0000 7fec56d9d700 1 -- 172.21.15.40:0/1389748389 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4c009550 con 0x7fec58072290 2023-09-30T22:24:52.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.846+0000 7fec56d9d700 1 --2- 172.21.15.40:0/1389748389 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec58072290 0x7fec58130390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fec4800c430 tx=0x7fec4800c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:52.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.846+0000 7fec3f7fe700 1 -- 172.21.15.40:0/1389748389 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec480054e0 con 0x7fec58072290 2023-09-30T22:24:52.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.846+0000 7fec3f7fe700 1 -- 172.21.15.40:0/1389748389 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4800ce40 con 0x7fec58072290 2023-09-30T22:24:52.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.846+0000 7fec5d0e8700 1 -- 172.21.15.40:0/1389748389 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec58133ec0 con 0x7fec58072290 2023-09-30T22:24:52.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.846+0000 7fec3f7fe700 1 -- 172.21.15.40:0/1389748389 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec480038c0 con 0x7fec58072290 2023-09-30T22:24:52.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.846+0000 7fec5d0e8700 1 -- 172.21.15.40:0/1389748389 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec581345f0 con 0x7fec58072290 2023-09-30T22:24:52.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.847+0000 7fec3f7fe700 1 -- 172.21.15.40:0/1389748389 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fec48003a20 con 0x7fec58072290 2023-09-30T22:24:52.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.847+0000 7fec5d0e8700 1 -- 172.21.15.40:0/1389748389 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec58133820 con 0x7fec58072290 2023-09-30T22:24:52.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.847+0000 7fec3f7fe700 1 -- 172.21.15.40:0/1389748389 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4137+0+0 (secure 0 0 0) 0x7fec4803ef30 con 0x7fec58072290 2023-09-30T22:24:52.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.852+0000 7fec3f7fe700 1 -- 172.21.15.40:0/1389748389 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fec58133820 con 0x7fec58072290 2023-09-30T22:24:52.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.973+0000 7fec5659c700 1 -- 172.21.15.40:0/1389748389 >> v1:172.21.15.40:6816/127432 conn(0x7fec4402f510 legacy=0x7fec440319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk reading from fd=20 : -104 Unknown error -104 2023-09-30T22:24:52.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.973+0000 7fec5659c700 1 -- 172.21.15.40:0/1389748389 >> v1:172.21.15.40:6816/127432 conn(0x7fec4402f510 legacy=0x7fec440319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-09-30T22:24:52.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.973+0000 7fec5659c700 1 --1- 172.21.15.40:0/1389748389 >> v1:172.21.15.40:6816/127432 conn(0x7fec4402f510 0x7fec440319c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify read banner and identify addresses failed 2023-09-30T22:24:52.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.973+0000 7fec5659c700 1 --1- 172.21.15.40:0/1389748389 >> v1:172.21.15.40:6816/127432 conn(0x7fec4402f510 0x7fec440319c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).fault on lossy channel, failing 2023-09-30T22:24:52.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:52.974+0000 7fec3f7fe700 1 -- 172.21.15.40:0/1389748389 >> v1:172.21.15.40:6816/127432 conn(0x7fec4402f510 legacy=0x7fec440319c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-09-30T22:24:53.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.051+0000 7fec5d0e8700 1 -- 172.21.15.40:0/1389748389 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7fec300051e0 con 0x7fec58072290 2023-09-30T22:24:53.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.714+0000 7fec3f7fe700 1 -- 172.21.15.40:0/1389748389 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 2 pg_autoscale_mode to off v38) v1 ==== 152+0+0 (secure 0 0 0) 0x7fec48017030 con 0x7fec58072290 2023-09-30T22:24:53.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.718+0000 7fec5d0e8700 1 -- 172.21.15.40:0/1389748389 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec58072290 msgr2=0x7fec58130390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:53.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.718+0000 7fec5d0e8700 1 --2- 172.21.15.40:0/1389748389 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec58072290 0x7fec58130390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fec4800c430 tx=0x7fec4800c740 comp rx=0 tx=0).stop 2023-09-30T22:24:53.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.718+0000 7fec5d0e8700 1 -- 172.21.15.40:0/1389748389 shutdown_connections 2023-09-30T22:24:53.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.718+0000 7fec5d0e8700 1 --2- 172.21.15.40:0/1389748389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec58135c80 0x7fec58130e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.718+0000 7fec5d0e8700 1 --2- 172.21.15.40:0/1389748389 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fec58072290 0x7fec58130390 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.718+0000 7fec5d0e8700 1 --2- 172.21.15.40:0/1389748389 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fec5809adb0 0x7fec581308d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.718+0000 7fec5d0e8700 1 -- 172.21.15.40:0/1389748389 >> 172.21.15.40:0/1389748389 conn(0x7fec5809f5c0 msgr2=0x7fec5809db70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:53.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.719+0000 7fec5d0e8700 1 -- 172.21.15.40:0/1389748389 shutdown_connections 2023-09-30T22:24:53.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.719+0000 7fec5d0e8700 1 -- 172.21.15.40:0/1389748389 wait complete. 2023-09-30T22:24:53.720 INFO:teuthology.orchestra.run.smithi040.stderr:set pool 2 pg_autoscale_mode to off 2023-09-30T22:24:53.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.841+0000 7f5efa279700 1 Processor -- start 2023-09-30T22:24:53.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.841+0000 7f5efa279700 1 -- start start 2023-09-30T22:24:53.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.841+0000 7f5efa279700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ef41301f0 0x7f5ef41305c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:53.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.841+0000 7f5efa279700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ef409c1a0 0x7f5ef4099480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:53.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.841+0000 7f5efa279700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5ef40999c0 0x7f5ef4099e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:53.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.841+0000 7f5efa279700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef409a350 con 0x7f5ef40999c0 2023-09-30T22:24:53.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.841+0000 7f5efa279700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef409bba0 con 0x7f5ef41301f0 2023-09-30T22:24:53.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.841+0000 7f5efa279700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef409b930 con 0x7f5ef409c1a0 2023-09-30T22:24:53.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.842+0000 7f5ef37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ef409c1a0 0x7f5ef4099480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:53.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.842+0000 7f5ef3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ef41301f0 0x7f5ef41305c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:53.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.842+0000 7f5ef37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ef409c1a0 0x7f5ef4099480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51248/0 (socket says 172.21.15.40:51248) 2023-09-30T22:24:53.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.842+0000 7f5ef8816700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5ef40999c0 0x7f5ef4099e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:53.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.842+0000 7f5ef3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ef41301f0 0x7f5ef41305c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53716/0 (socket says 172.21.15.40:53716) 2023-09-30T22:24:53.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.842+0000 7f5ef37fe700 1 -- 172.21.15.40:0/554643668 learned_addr learned my addr 172.21.15.40:0/554643668 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:53.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.842+0000 7f5ef37fe700 1 -- 172.21.15.40:0/554643668 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ef41301f0 msgr2=0x7f5ef41305c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:53.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.842+0000 7f5ef37fe700 1 --2- 172.21.15.40:0/554643668 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ef41301f0 0x7f5ef41305c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.842+0000 7f5ef37fe700 1 -- 172.21.15.40:0/554643668 >> v2:172.21.15.40:3300/0 conn(0x7f5ef40999c0 msgr2=0x7f5ef4099e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:53.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.842+0000 7f5ef37fe700 1 --2- 172.21.15.40:0/554643668 >> v2:172.21.15.40:3300/0 conn(0x7f5ef40999c0 0x7f5ef4099e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.842+0000 7f5ef37fe700 1 -- 172.21.15.40:0/554643668 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef4130b00 con 0x7f5ef409c1a0 2023-09-30T22:24:53.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.842+0000 7f5ef3fff700 1 --2- 172.21.15.40:0/554643668 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ef41301f0 0x7f5ef41305c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:53.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.842+0000 7f5ef8816700 1 --2- 172.21.15.40:0/554643668 >> v2:172.21.15.40:3300/0 conn(0x7f5ef40999c0 0x7f5ef4099e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:53.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.842+0000 7f5ef37fe700 1 --2- 172.21.15.40:0/554643668 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ef409c1a0 0x7f5ef4099480 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5edc00bb90 tx=0x7f5edc00bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2d25d9c36b99de4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:53.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.842+0000 7f5ef2ffd700 1 -- 172.21.15.40:0/554643668 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc00dc20 con 0x7f5ef409c1a0 2023-09-30T22:24:53.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.842+0000 7f5ef2ffd700 1 -- 172.21.15.40:0/554643668 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5edc00dd80 con 0x7f5ef409c1a0 2023-09-30T22:24:53.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.842+0000 7f5ef2ffd700 1 -- 172.21.15.40:0/554643668 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc017630 con 0x7f5ef409c1a0 2023-09-30T22:24:53.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.843+0000 7f5efa279700 1 -- 172.21.15.40:0/554643668 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ef409c1a0 msgr2=0x7f5ef4099480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:53.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.843+0000 7f5efa279700 1 --2- 172.21.15.40:0/554643668 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ef409c1a0 0x7f5ef4099480 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5edc00bb90 tx=0x7f5edc00bea0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.843+0000 7f5efa279700 1 -- 172.21.15.40:0/554643668 shutdown_connections 2023-09-30T22:24:53.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.843+0000 7f5efa279700 1 --2- 172.21.15.40:0/554643668 >> v2:172.21.15.40:3300/0 conn(0x7f5ef40999c0 0x7f5ef4099e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.843+0000 7f5efa279700 1 --2- 172.21.15.40:0/554643668 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ef41301f0 0x7f5ef41305c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.843+0000 7f5efa279700 1 --2- 172.21.15.40:0/554643668 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ef409c1a0 0x7f5ef4099480 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.843+0000 7f5efa279700 1 -- 172.21.15.40:0/554643668 >> 172.21.15.40:0/554643668 conn(0x7f5ef409ea80 msgr2=0x7f5ef409ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:53.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.843+0000 7f5efa279700 1 -- 172.21.15.40:0/554643668 shutdown_connections 2023-09-30T22:24:53.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.843+0000 7f5efa279700 1 -- 172.21.15.40:0/554643668 wait complete. 2023-09-30T22:24:53.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.844+0000 7f5efa279700 1 Processor -- start 2023-09-30T22:24:53.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.844+0000 7f5efa279700 1 -- start start 2023-09-30T22:24:53.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.845+0000 7f5efa279700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ef40999c0 0x7f5ef4128740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:53.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.845+0000 7f5efa279700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ef409c1a0 0x7f5ef4128c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:53.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.845+0000 7f5efa279700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ef41301f0 0x7f5ef41291c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:53.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.845+0000 7f5efa279700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef406d580 con 0x7f5ef409c1a0 2023-09-30T22:24:53.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.845+0000 7f5efa279700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef406e2f0 con 0x7f5ef40999c0 2023-09-30T22:24:53.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.845+0000 7f5efa279700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef406ca60 con 0x7f5ef41301f0 2023-09-30T22:24:53.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.845+0000 7f5ef3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ef40999c0 0x7f5ef4128740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:53.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.845+0000 7f5ef8816700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ef41301f0 0x7f5ef41291c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:53.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.845+0000 7f5ef37fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ef409c1a0 0x7f5ef4128c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:53.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.845+0000 7f5ef3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ef40999c0 0x7f5ef4128740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53720/0 (socket says 172.21.15.40:53720) 2023-09-30T22:24:53.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.845+0000 7f5ef37fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ef409c1a0 0x7f5ef4128c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54324/0 (socket says 172.21.15.40:54324) 2023-09-30T22:24:53.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.845+0000 7f5ef3fff700 1 -- 172.21.15.40:0/2519723712 learned_addr learned my addr 172.21.15.40:0/2519723712 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:53.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.845+0000 7f5ef8816700 1 --2- 172.21.15.40:0/2519723712 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ef41301f0 0x7f5ef41291c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51256/0 (socket says 172.21.15.40:51256) 2023-09-30T22:24:53.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.845+0000 7f5ef3fff700 1 -- 172.21.15.40:0/2519723712 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ef41301f0 msgr2=0x7f5ef41291c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:53.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.846+0000 7f5ef3fff700 1 --2- 172.21.15.40:0/2519723712 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ef41301f0 0x7f5ef41291c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.846+0000 7f5ef3fff700 1 -- 172.21.15.40:0/2519723712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ef409c1a0 msgr2=0x7f5ef4128c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:53.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.846+0000 7f5ef3fff700 1 --2- 172.21.15.40:0/2519723712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ef409c1a0 0x7f5ef4128c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.846+0000 7f5ef3fff700 1 -- 172.21.15.40:0/2519723712 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eec009a70 con 0x7f5ef40999c0 2023-09-30T22:24:53.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.846+0000 7f5ef37fe700 1 --2- 172.21.15.40:0/2519723712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ef409c1a0 0x7f5ef4128c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:53.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.846+0000 7f5ef8816700 1 --2- 172.21.15.40:0/2519723712 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ef41301f0 0x7f5ef41291c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:53.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.846+0000 7f5ef3fff700 1 --2- 172.21.15.40:0/2519723712 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ef40999c0 0x7f5ef4128740 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5ee400ebe0 tx=0x7f5ee400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:53.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.846+0000 7f5ef0ff9700 1 -- 172.21.15.40:0/2519723712 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4009800 con 0x7f5ef40999c0 2023-09-30T22:24:53.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.846+0000 7f5ef0ff9700 1 -- 172.21.15.40:0/2519723712 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee400c850 con 0x7f5ef40999c0 2023-09-30T22:24:53.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.846+0000 7f5efa279700 1 -- 172.21.15.40:0/2519723712 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee40094a0 con 0x7f5ef40999c0 2023-09-30T22:24:53.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.846+0000 7f5ef0ff9700 1 -- 172.21.15.40:0/2519723712 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee400cbc0 con 0x7f5ef40999c0 2023-09-30T22:24:53.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.846+0000 7f5efa279700 1 -- 172.21.15.40:0/2519723712 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5edc00b7f0 con 0x7f5ef40999c0 2023-09-30T22:24:53.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.847+0000 7f5ef0ff9700 1 -- 172.21.15.40:0/2519723712 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5ee400cd20 con 0x7f5ef40999c0 2023-09-30T22:24:53.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.847+0000 7f5ef0ff9700 1 -- 172.21.15.40:0/2519723712 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f5ee403ffe0 con 0x7f5ef40999c0 2023-09-30T22:24:53.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.847+0000 7f5ef37fe700 1 -- 172.21.15.40:0/2519723712 >> v1:172.21.15.40:6816/127432 conn(0x7f5ed402f510 legacy=0x7f5ed40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:24:53.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.847+0000 7f5efa279700 1 -- 172.21.15.40:0/2519723712 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ef406e510 con 0x7f5ef40999c0 2023-09-30T22:24:53.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:53.852+0000 7f5ef0ff9700 1 -- 172.21.15.40:0/2519723712 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5ef406e510 con 0x7f5ef40999c0 2023-09-30T22:24:54.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.045+0000 7f5efa279700 1 -- 172.21.15.40:0/2519723712 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f5ef406e510 con 0x7f5ef40999c0 2023-09-30T22:24:54.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.048+0000 7f5ef37fe700 1 -- 172.21.15.40:0/2519723712 >> v1:172.21.15.40:6816/127432 conn(0x7f5ed402f510 legacy=0x7f5ed40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:24:54.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.449+0000 7f5ef37fe700 1 -- 172.21.15.40:0/2519723712 >> v1:172.21.15.40:6816/127432 conn(0x7f5ed402f510 legacy=0x7f5ed40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:24:54.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.730+0000 7f5ef0ff9700 1 -- 172.21.15.40:0/2519723712 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 3 pg_autoscale_mode to off v39) v1 ==== 164+0+0 (secure 0 0 0) 0x7f5ef406e510 con 0x7f5ef40999c0 2023-09-30T22:24:55.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.732+0000 7f5efa279700 1 -- 172.21.15.40:0/2519723712 >> v1:172.21.15.40:6816/127432 conn(0x7f5ed402f510 legacy=0x7f5ed40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:55.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.732+0000 7f5efa279700 1 -- 172.21.15.40:0/2519723712 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ef40999c0 msgr2=0x7f5ef4128740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.733+0000 7f5efa279700 1 --2- 172.21.15.40:0/2519723712 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ef40999c0 0x7f5ef4128740 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5ee400ebe0 tx=0x7f5ee400eef0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.733+0000 7f5efa279700 1 -- 172.21.15.40:0/2519723712 shutdown_connections 2023-09-30T22:24:55.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.733+0000 7f5efa279700 1 --2- 172.21.15.40:0/2519723712 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ef41301f0 0x7f5ef41291c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.733+0000 7f5efa279700 1 --2- 172.21.15.40:0/2519723712 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ef40999c0 0x7f5ef4128740 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.733+0000 7f5efa279700 1 --2- 172.21.15.40:0/2519723712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ef409c1a0 0x7f5ef4128c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.733+0000 7f5efa279700 1 -- 172.21.15.40:0/2519723712 >> 172.21.15.40:0/2519723712 conn(0x7f5ef409ea80 msgr2=0x7f5ef412e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:55.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.733+0000 7f5efa279700 1 -- 172.21.15.40:0/2519723712 shutdown_connections 2023-09-30T22:24:55.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.733+0000 7f5efa279700 1 -- 172.21.15.40:0/2519723712 wait complete. 2023-09-30T22:24:55.338 INFO:teuthology.orchestra.run.smithi040.stderr:set pool 3 pg_autoscale_mode to off 2023-09-30T22:24:55.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.853+0000 7f0832527700 1 Processor -- start 2023-09-30T22:24:55.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.853+0000 7f0832527700 1 -- start start 2023-09-30T22:24:55.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.853+0000 7f0832527700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f082c0a3cd0 0x7f082c1309c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.853+0000 7f0832527700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f082c133e20 0x7f082c13ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.853+0000 7f0832527700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f082c09db00 con 0x7f082c130f00 2023-09-30T22:24:55.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.853+0000 7f0832527700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f082c09d750 con 0x7f082c0a3cd0 2023-09-30T22:24:55.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.853+0000 7f0832527700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f082c0a40a0 con 0x7f082c133e20 2023-09-30T22:24:55.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.853+0000 7f0830ac4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f082c133e20 0x7f082c13ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.853+0000 7f082b7fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f082c130f00 0x7f082c133710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48278/0 (socket says 172.21.15.40:48278) 2023-09-30T22:24:55.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.853+0000 7f082bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f082c0a3cd0 0x7f082c1309c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.853+0000 7f082b7fe700 1 -- 172.21.15.40:0/3347083669 learned_addr learned my addr 172.21.15.40:0/3347083669 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:24:55.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.854+0000 7f082affd700 1 -- 172.21.15.40:0/3347083669 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2079030463 0 0) 0x7f082c09db00 con 0x7f082c130f00 2023-09-30T22:24:55.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.854+0000 7f082affd700 1 -- 172.21.15.40:0/3347083669 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08140035b0 con 0x7f082c130f00 2023-09-30T22:24:55.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.854+0000 7f082bfff700 1 -- 172.21.15.40:0/3347083669 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f082c133e20 msgr2=0x7f082c13ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:55.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.854+0000 7f082bfff700 1 --2- 172.21.15.40:0/3347083669 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f082c133e20 0x7f082c13ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.854+0000 7f082bfff700 1 -- 172.21.15.40:0/3347083669 >> v1:172.21.15.40:6789/0 conn(0x7f082c130f00 legacy=0x7f082c133710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.854+0000 7f082bfff700 1 -- 172.21.15.40:0/3347083669 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f082c09ddc0 con 0x7f082c0a3cd0 2023-09-30T22:24:55.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.854+0000 7f0830ac4700 1 --2- 172.21.15.40:0/3347083669 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f082c133e20 0x7f082c13ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:55.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.854+0000 7f082bfff700 1 --2- 172.21.15.40:0/3347083669 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f082c0a3cd0 0x7f082c1309c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f081c0098a0 tx=0x7f081c009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cc12337a4da3556 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:55.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.854+0000 7f082affd700 1 -- 172.21.15.40:0/3347083669 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081c011830 con 0x7f082c0a3cd0 2023-09-30T22:24:55.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.854+0000 7f082affd700 1 -- 172.21.15.40:0/3347083669 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081c011990 con 0x7f082c0a3cd0 2023-09-30T22:24:55.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.854+0000 7f082affd700 1 -- 172.21.15.40:0/3347083669 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081c011d00 con 0x7f082c0a3cd0 2023-09-30T22:24:55.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.855+0000 7f0832527700 1 -- 172.21.15.40:0/3347083669 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f082c0a3cd0 msgr2=0x7f082c1309c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.855+0000 7f0832527700 1 --2- 172.21.15.40:0/3347083669 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f082c0a3cd0 0x7f082c1309c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f081c0098a0 tx=0x7f081c009bb0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.855+0000 7f0832527700 1 -- 172.21.15.40:0/3347083669 shutdown_connections 2023-09-30T22:24:55.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.855+0000 7f0832527700 1 --2- 172.21.15.40:0/3347083669 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f082c133e20 0x7f082c13ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.855+0000 7f0832527700 1 --2- 172.21.15.40:0/3347083669 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f082c0a3cd0 0x7f082c1309c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.855+0000 7f0832527700 1 -- 172.21.15.40:0/3347083669 >> 172.21.15.40:0/3347083669 conn(0x7f082c0a6630 msgr2=0x7f082c0a6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:55.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.855+0000 7f0832527700 1 -- 172.21.15.40:0/3347083669 shutdown_connections 2023-09-30T22:24:55.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.855+0000 7f0832527700 1 -- 172.21.15.40:0/3347083669 wait complete. 2023-09-30T22:24:55.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.856+0000 7f0832527700 1 Processor -- start 2023-09-30T22:24:55.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.856+0000 7f0832527700 1 -- start start 2023-09-30T22:24:55.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.856+0000 7f0832527700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f082c0a3cd0 0x7f082c11cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.856+0000 7f0832527700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f082c130f00 0x7f082c11d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.856+0000 7f0832527700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f082c133e20 0x7f082c11d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.856+0000 7f0832527700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082c120030 con 0x7f082c130f00 2023-09-30T22:24:55.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.856+0000 7f0832527700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f082c120210 con 0x7f082c0a3cd0 2023-09-30T22:24:55.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.856+0000 7f0832527700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f082c11e050 con 0x7f082c133e20 2023-09-30T22:24:55.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.856+0000 7f082bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f082c0a3cd0 0x7f082c11cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.856+0000 7f082bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f082c0a3cd0 0x7f082c11cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53742/0 (socket says 172.21.15.40:53742) 2023-09-30T22:24:55.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.856+0000 7f082bfff700 1 -- 172.21.15.40:0/1850407163 learned_addr learned my addr 172.21.15.40:0/1850407163 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:55.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.856+0000 7f082b7fe700 1 --2- 172.21.15.40:0/1850407163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f082c130f00 0x7f082c11d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.856+0000 7f0830ac4700 1 --2- 172.21.15.40:0/1850407163 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f082c133e20 0x7f082c11d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.857+0000 7f082bfff700 1 -- 172.21.15.40:0/1850407163 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f082c133e20 msgr2=0x7f082c11d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.857+0000 7f082bfff700 1 --2- 172.21.15.40:0/1850407163 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f082c133e20 0x7f082c11d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.857+0000 7f082bfff700 1 -- 172.21.15.40:0/1850407163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f082c130f00 msgr2=0x7f082c11d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.857+0000 7f082bfff700 1 --2- 172.21.15.40:0/1850407163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f082c130f00 0x7f082c11d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.857+0000 7f082bfff700 1 -- 172.21.15.40:0/1850407163 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0824009a70 con 0x7f082c0a3cd0 2023-09-30T22:24:55.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.857+0000 7f0830ac4700 1 --2- 172.21.15.40:0/1850407163 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f082c133e20 0x7f082c11d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:55.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.857+0000 7f082bfff700 1 --2- 172.21.15.40:0/1850407163 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f082c0a3cd0 0x7f082c11cc80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f081c009870 tx=0x7f081c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:55.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.857+0000 7f0828ff9700 1 -- 172.21.15.40:0/1850407163 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081c01a9b0 con 0x7f082c0a3cd0 2023-09-30T22:24:55.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.857+0000 7f0828ff9700 1 -- 172.21.15.40:0/1850407163 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081c006b30 con 0x7f082c0a3cd0 2023-09-30T22:24:55.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.857+0000 7f0832527700 1 -- 172.21.15.40:0/1850407163 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f081c0094a0 con 0x7f082c0a3cd0 2023-09-30T22:24:55.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.857+0000 7f0828ff9700 1 -- 172.21.15.40:0/1850407163 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081c01ad30 con 0x7f082c0a3cd0 2023-09-30T22:24:55.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.857+0000 7f0832527700 1 -- 172.21.15.40:0/1850407163 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f082c11fc70 con 0x7f082c0a3cd0 2023-09-30T22:24:55.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.858+0000 7f0828ff9700 1 -- 172.21.15.40:0/1850407163 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f081c0243f0 con 0x7f082c0a3cd0 2023-09-30T22:24:55.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.858+0000 7f0828ff9700 1 -- 172.21.15.40:0/1850407163 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f081c041020 con 0x7f082c0a3cd0 2023-09-30T22:24:55.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.858+0000 7f082b7fe700 1 -- 172.21.15.40:0/1850407163 >> v1:172.21.15.40:6816/127432 conn(0x7f081802f540 legacy=0x7f08180319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:24:55.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.858+0000 7f0832527700 1 -- 172.21.15.40:0/1850407163 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f082c0a0420 con 0x7f082c0a3cd0 2023-09-30T22:24:55.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:54.863+0000 7f0828ff9700 1 -- 172.21.15.40:0/1850407163 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f081c015020 con 0x7f082c0a3cd0 2023-09-30T22:24:55.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.054+0000 7f0832527700 1 -- 172.21.15.40:0/1850407163 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f082c11f9a0 con 0x7f082c0a3cd0 2023-09-30T22:24:55.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.059+0000 7f082b7fe700 1 -- 172.21.15.40:0/1850407163 >> v1:172.21.15.40:6816/127432 conn(0x7f081802f540 legacy=0x7f08180319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:24:55.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.460+0000 7f082b7fe700 1 -- 172.21.15.40:0/1850407163 >> v1:172.21.15.40:6816/127432 conn(0x7f081802f540 legacy=0x7f08180319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:24:55.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.731+0000 7f0828ff9700 1 -- 172.21.15.40:0/1850407163 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 4 pg_autoscale_mode to off v40) v1 ==== 160+0+0 (secure 0 0 0) 0x7f081c00b360 con 0x7f082c0a3cd0 2023-09-30T22:24:55.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.734+0000 7f0832527700 1 -- 172.21.15.40:0/1850407163 >> v1:172.21.15.40:6816/127432 conn(0x7f081802f540 legacy=0x7f08180319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:55.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.734+0000 7f0832527700 1 -- 172.21.15.40:0/1850407163 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f082c0a3cd0 msgr2=0x7f082c11cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.734+0000 7f0832527700 1 --2- 172.21.15.40:0/1850407163 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f082c0a3cd0 0x7f082c11cc80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f081c009870 tx=0x7f081c004750 comp rx=0 tx=0).stop 2023-09-30T22:24:55.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.734+0000 7f0832527700 1 -- 172.21.15.40:0/1850407163 shutdown_connections 2023-09-30T22:24:55.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.734+0000 7f0832527700 1 --2- 172.21.15.40:0/1850407163 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f082c133e20 0x7f082c11d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.734+0000 7f0832527700 1 --2- 172.21.15.40:0/1850407163 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f082c0a3cd0 0x7f082c11cc80 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f081c009870 tx=0x7f081c004750 comp rx=0 tx=0).stop 2023-09-30T22:24:55.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.734+0000 7f0832527700 1 --2- 172.21.15.40:0/1850407163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f082c130f00 0x7f082c11d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.734+0000 7f0832527700 1 -- 172.21.15.40:0/1850407163 >> 172.21.15.40:0/1850407163 conn(0x7f082c0a6630 msgr2=0x7f082c12fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:55.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.734+0000 7f0832527700 1 -- 172.21.15.40:0/1850407163 shutdown_connections 2023-09-30T22:24:55.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.734+0000 7f0832527700 1 -- 172.21.15.40:0/1850407163 wait complete. 2023-09-30T22:24:55.736 INFO:teuthology.orchestra.run.smithi040.stderr:set pool 4 pg_autoscale_mode to off 2023-09-30T22:24:55.751 DEBUG:teuthology.orchestra.run.smithi040:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd require-osd-release reef' 2023-09-30T22:24:55.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.882+0000 7f05c316e700 1 Processor -- start 2023-09-30T22:24:55.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.882+0000 7f05c316e700 1 -- start start 2023-09-30T22:24:55.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.882+0000 7f05c316e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f05bc09e5a0 0x7f05bc130700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.883+0000 7f05c316e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05bc130c40 0x7f05bc133d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.883+0000 7f05c316e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05bc09db00 con 0x7f05bc09c980 2023-09-30T22:24:55.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.883+0000 7f05c316e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05bc09e970 con 0x7f05bc09e5a0 2023-09-30T22:24:55.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.883+0000 7f05c316e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc09d200 con 0x7f05bc130c40 2023-09-30T22:24:55.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.883+0000 7f05c170b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05bc130c40 0x7f05bc133d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.883+0000 7f05c0f0a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f05bc09e5a0 0x7f05bc130700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.883+0000 7f05c0f0a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f05bc09e5a0 0x7f05bc130700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54350/0 (socket says 172.21.15.40:54350) 2023-09-30T22:24:55.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.883+0000 7f05c170b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05bc130c40 0x7f05bc133d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53752/0 (socket says 172.21.15.40:53752) 2023-09-30T22:24:55.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.883+0000 7f05c0f0a700 1 -- 172.21.15.40:0/2444957139 learned_addr learned my addr 172.21.15.40:0/2444957139 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:55.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.883+0000 7f05c170b700 1 -- 172.21.15.40:0/2444957139 >> v2:172.21.15.40:3300/0 conn(0x7f05bc09e5a0 msgr2=0x7f05bc130700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:55.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.883+0000 7f05c170b700 1 --2- 172.21.15.40:0/2444957139 >> v2:172.21.15.40:3300/0 conn(0x7f05bc09e5a0 0x7f05bc130700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.883+0000 7f05c170b700 1 -- 172.21.15.40:0/2444957139 >> v1:172.21.15.40:6789/0 conn(0x7f05bc09c980 legacy=0x7f05bc133630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.883+0000 7f05c170b700 1 -- 172.21.15.40:0/2444957139 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05bc130310 con 0x7f05bc130c40 2023-09-30T22:24:55.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.883+0000 7f05bb7fe700 1 -- 172.21.15.40:0/2444957139 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 16152561 0 0) 0x7f05bc09db00 con 0x7f05bc09c980 2023-09-30T22:24:55.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.883+0000 7f05c0f0a700 1 --2- 172.21.15.40:0/2444957139 >> v2:172.21.15.40:3300/0 conn(0x7f05bc09e5a0 0x7f05bc130700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:55.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.883+0000 7f05c170b700 1 --2- 172.21.15.40:0/2444957139 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05bc130c40 0x7f05bc133d40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f05b4009d90 tx=0x7f05b400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbaf1ce6fc6bf131 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:55.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.883+0000 7f05bb7fe700 1 -- 172.21.15.40:0/2444957139 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b400e070 con 0x7f05bc130c40 2023-09-30T22:24:55.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.883+0000 7f05bb7fe700 1 -- 172.21.15.40:0/2444957139 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b400bb20 con 0x7f05bc130c40 2023-09-30T22:24:55.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.883+0000 7f05bb7fe700 1 -- 172.21.15.40:0/2444957139 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b4012430 con 0x7f05bc130c40 2023-09-30T22:24:55.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.884+0000 7f05c316e700 1 -- 172.21.15.40:0/2444957139 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05bc130c40 msgr2=0x7f05bc133d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.884+0000 7f05c316e700 1 --2- 172.21.15.40:0/2444957139 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05bc130c40 0x7f05bc133d40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f05b4009d90 tx=0x7f05b400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:55.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.884+0000 7f05c316e700 1 -- 172.21.15.40:0/2444957139 shutdown_connections 2023-09-30T22:24:55.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.884+0000 7f05c316e700 1 --2- 172.21.15.40:0/2444957139 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05bc130c40 0x7f05bc133d40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.884+0000 7f05c316e700 1 --2- 172.21.15.40:0/2444957139 >> v2:172.21.15.40:3300/0 conn(0x7f05bc09e5a0 0x7f05bc130700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.884+0000 7f05c316e700 1 -- 172.21.15.40:0/2444957139 >> 172.21.15.40:0/2444957139 conn(0x7f05bc0a6550 msgr2=0x7f05bc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:55.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.884+0000 7f05c316e700 1 -- 172.21.15.40:0/2444957139 shutdown_connections 2023-09-30T22:24:55.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.884+0000 7f05c316e700 1 -- 172.21.15.40:0/2444957139 wait complete. 2023-09-30T22:24:55.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.885+0000 7f05c316e700 1 Processor -- start 2023-09-30T22:24:55.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.885+0000 7f05c316e700 1 -- start start 2023-09-30T22:24:55.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.885+0000 7f05c316e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05bc09c980 0x7f05bc1347b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.885+0000 7f05c316e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05bc09e5a0 0x7f05bc134cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.885+0000 7f05c316e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05bc130c40 0x7f05bc135230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.885+0000 7f05c316e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc0a5460 con 0x7f05bc130c40 2023-09-30T22:24:55.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.885+0000 7f05c316e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc1366e0 con 0x7f05bc09c980 2023-09-30T22:24:55.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.885+0000 7f05c316e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc1377c0 con 0x7f05bc09e5a0 2023-09-30T22:24:55.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.886+0000 7f05c170b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05bc130c40 0x7f05bc135230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.886+0000 7f05bbfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05bc09e5a0 0x7f05bc134cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.886+0000 7f05c170b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05bc130c40 0x7f05bc135230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54362/0 (socket says 172.21.15.40:54362) 2023-09-30T22:24:55.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.886+0000 7f05c170b700 1 -- 172.21.15.40:0/453308934 learned_addr learned my addr 172.21.15.40:0/453308934 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:55.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.886+0000 7f05c0f0a700 1 --2- 172.21.15.40:0/453308934 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05bc09c980 0x7f05bc1347b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.886+0000 7f05bbfff700 1 -- 172.21.15.40:0/453308934 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05bc09c980 msgr2=0x7f05bc1347b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.886+0000 7f05bbfff700 1 --2- 172.21.15.40:0/453308934 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05bc09c980 0x7f05bc1347b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.886+0000 7f05bbfff700 1 -- 172.21.15.40:0/453308934 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05bc130c40 msgr2=0x7f05bc135230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.886+0000 7f05bbfff700 1 --2- 172.21.15.40:0/453308934 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05bc130c40 0x7f05bc135230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.886+0000 7f05bbfff700 1 -- 172.21.15.40:0/453308934 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b0009550 con 0x7f05bc09e5a0 2023-09-30T22:24:55.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.886+0000 7f05c170b700 1 --2- 172.21.15.40:0/453308934 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05bc130c40 0x7f05bc135230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:55.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.886+0000 7f05bbfff700 1 --2- 172.21.15.40:0/453308934 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05bc09e5a0 0x7f05bc134cf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f05a8000f60 tx=0x7f05a800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:55.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.886+0000 7f05b97fa700 1 -- 172.21.15.40:0/453308934 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a80052d0 con 0x7f05bc09e5a0 2023-09-30T22:24:55.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.886+0000 7f05b97fa700 1 -- 172.21.15.40:0/453308934 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a8005450 con 0x7f05bc09e5a0 2023-09-30T22:24:55.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.886+0000 7f05c316e700 1 -- 172.21.15.40:0/453308934 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b4009a70 con 0x7f05bc09e5a0 2023-09-30T22:24:55.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.886+0000 7f05b97fa700 1 -- 172.21.15.40:0/453308934 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a80038c0 con 0x7f05bc09e5a0 2023-09-30T22:24:55.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.886+0000 7f05c316e700 1 -- 172.21.15.40:0/453308934 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05bc136910 con 0x7f05bc09e5a0 2023-09-30T22:24:55.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.887+0000 7f05b97fa700 1 -- 172.21.15.40:0/453308934 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f05a8003a20 con 0x7f05bc09e5a0 2023-09-30T22:24:55.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.887+0000 7f05b97fa700 1 -- 172.21.15.40:0/453308934 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f05a803ee50 con 0x7f05bc09e5a0 2023-09-30T22:24:55.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.887+0000 7f05c0f0a700 1 -- 172.21.15.40:0/453308934 >> v1:172.21.15.40:6816/127432 conn(0x7f05a002f510 legacy=0x7f05a00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:24:55.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.887+0000 7f05c316e700 1 -- 172.21.15.40:0/453308934 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05bc09c6a0 con 0x7f05bc09e5a0 2023-09-30T22:24:55.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:55.892+0000 7f05b97fa700 1 -- 172.21.15.40:0/453308934 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f05a8017070 con 0x7f05bc09e5a0 2023-09-30T22:24:56.085 INFO:tasks.ceph.mgr.x.smithi040.stderr:daemon-helper: command crashed with signal 6 2023-09-30T22:24:56.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.088+0000 7f05c0f0a700 1 -- 172.21.15.40:0/453308934 >> v1:172.21.15.40:6816/127432 conn(0x7f05a002f510 legacy=0x7f05a00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:24:56.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.108+0000 7f05c316e700 1 -- 172.21.15.40:0/453308934 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd require-osd-release", "release": "reef"} v 0) v1 -- 0x7f05bc04f2a0 con 0x7f05bc09e5a0 2023-09-30T22:24:56.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.489+0000 7f05c0f0a700 1 -- 172.21.15.40:0/453308934 >> v1:172.21.15.40:6816/127432 conn(0x7f05a002f510 legacy=0x7f05a00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:24:56.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.739+0000 7f05b97fa700 1 -- 172.21.15.40:0/453308934 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd require-osd-release", "release": "reef"}]=0 v41) v1 ==== 90+0+0 (secure 0 0 0) 0x7f05a8019b40 con 0x7f05bc09e5a0 2023-09-30T22:24:56.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.743+0000 7f05c316e700 1 -- 172.21.15.40:0/453308934 >> v1:172.21.15.40:6816/127432 conn(0x7f05a002f510 legacy=0x7f05a00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:56.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.743+0000 7f05c316e700 1 -- 172.21.15.40:0/453308934 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05bc09e5a0 msgr2=0x7f05bc134cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:56.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.743+0000 7f05c316e700 1 --2- 172.21.15.40:0/453308934 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05bc09e5a0 0x7f05bc134cf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f05a8000f60 tx=0x7f05a800c6a0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.744+0000 7f05c316e700 1 -- 172.21.15.40:0/453308934 shutdown_connections 2023-09-30T22:24:56.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.744+0000 7f05c316e700 1 --2- 172.21.15.40:0/453308934 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05bc130c40 0x7f05bc135230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.744+0000 7f05c316e700 1 --2- 172.21.15.40:0/453308934 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05bc09c980 0x7f05bc1347b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.744+0000 7f05c316e700 1 --2- 172.21.15.40:0/453308934 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05bc09e5a0 0x7f05bc134cf0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.744+0000 7f05c316e700 1 -- 172.21.15.40:0/453308934 >> 172.21.15.40:0/453308934 conn(0x7f05bc0a6550 msgr2=0x7f05bc0a5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:56.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.744+0000 7f05c316e700 1 -- 172.21.15.40:0/453308934 shutdown_connections 2023-09-30T22:24:56.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.744+0000 7f05c316e700 1 -- 172.21.15.40:0/453308934 wait complete. 2023-09-30T22:24:56.760 INFO:teuthology.run_tasks:Running task ceph.healthy... 2023-09-30T22:24:56.772 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-09-30T22:24:56.772 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-09-30T22:24:56.773 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-09-30T22:24:56.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.933+0000 7f896d875700 1 Processor -- start 2023-09-30T22:24:56.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.933+0000 7f896d875700 1 -- start start 2023-09-30T22:24:56.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.934+0000 7f896d875700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f896809c890 0x7f896809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.934+0000 7f896d875700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f896809d920 0x7f896809dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.934+0000 7f896d875700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89680a2600 con 0x7f896809e2b0 2023-09-30T22:24:56.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.934+0000 7f896d875700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89680a29d0 con 0x7f896809c890 2023-09-30T22:24:56.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.934+0000 7f896d875700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f896809fb40 con 0x7f896809d920 2023-09-30T22:24:56.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.934+0000 7f89667fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f896809d920 0x7f896809dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:56.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.934+0000 7f8966ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f896809c890 0x7f896809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:56.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.934+0000 7f8966ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f896809c890 0x7f896809cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54364/0 (socket says 172.21.15.40:54364) 2023-09-30T22:24:56.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.934+0000 7f89667fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f896809d920 0x7f896809dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51282/0 (socket says 172.21.15.40:51282) 2023-09-30T22:24:56.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.934+0000 7f8966ffd700 1 -- 172.21.15.40:0/1536654024 learned_addr learned my addr 172.21.15.40:0/1536654024 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:56.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.934+0000 7f89667fc700 1 -- 172.21.15.40:0/1536654024 >> v2:172.21.15.40:3300/0 conn(0x7f896809c890 msgr2=0x7f896809cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:56.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.934+0000 7f89667fc700 1 --2- 172.21.15.40:0/1536654024 >> v2:172.21.15.40:3300/0 conn(0x7f896809c890 0x7f896809cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.934+0000 7f89667fc700 1 -- 172.21.15.40:0/1536654024 >> v1:172.21.15.40:6789/0 conn(0x7f896809e2b0 legacy=0x7f896813ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:56.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.934+0000 7f89667fc700 1 -- 172.21.15.40:0/1536654024 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896809e730 con 0x7f896809d920 2023-09-30T22:24:56.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.935+0000 7f89667fc700 1 --2- 172.21.15.40:0/1536654024 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f896809d920 0x7f896809dd70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8950009840 tx=0x7f8950009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c83133388b7215ab server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:56.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.935+0000 7f8965ffb700 1 -- 172.21.15.40:0/1536654024 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8950011830 con 0x7f896809d920 2023-09-30T22:24:56.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.935+0000 7f8965ffb700 1 -- 172.21.15.40:0/1536654024 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8950011990 con 0x7f896809d920 2023-09-30T22:24:56.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.935+0000 7f8965ffb700 1 -- 172.21.15.40:0/1536654024 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8950011d20 con 0x7f896809d920 2023-09-30T22:24:56.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.935+0000 7f896d875700 1 -- 172.21.15.40:0/1536654024 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f896809d920 msgr2=0x7f896809dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:56.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.935+0000 7f896d875700 1 --2- 172.21.15.40:0/1536654024 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f896809d920 0x7f896809dd70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8950009840 tx=0x7f8950009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:56.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.935+0000 7f896d875700 1 -- 172.21.15.40:0/1536654024 shutdown_connections 2023-09-30T22:24:56.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.935+0000 7f896d875700 1 --2- 172.21.15.40:0/1536654024 >> v2:172.21.15.40:3300/0 conn(0x7f896809c890 0x7f896809cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.935+0000 7f896d875700 1 --2- 172.21.15.40:0/1536654024 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f896809d920 0x7f896809dd70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.935+0000 7f896d875700 1 -- 172.21.15.40:0/1536654024 >> 172.21.15.40:0/1536654024 conn(0x7f89680a7080 msgr2=0x7f89680a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:56.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.935+0000 7f896d875700 1 -- 172.21.15.40:0/1536654024 shutdown_connections 2023-09-30T22:24:56.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.935+0000 7f896d875700 1 -- 172.21.15.40:0/1536654024 wait complete. 2023-09-30T22:24:56.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.936+0000 7f896d875700 1 Processor -- start 2023-09-30T22:24:56.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.936+0000 7f896d875700 1 -- start start 2023-09-30T22:24:56.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.937+0000 7f896d875700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f896809c890 0x7f896812d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.937+0000 7f896d875700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f896809d920 0x7f896812daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.937+0000 7f896d875700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f896809e2b0 0x7f896812e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.937+0000 7f896d875700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896809bbb0 con 0x7f896809e2b0 2023-09-30T22:24:56.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.937+0000 7f896d875700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896809ecf0 con 0x7f896809c890 2023-09-30T22:24:56.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.937+0000 7f896d875700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89681306b0 con 0x7f896809d920 2023-09-30T22:24:56.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.937+0000 7f89677fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f896809e2b0 0x7f896812e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:56.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.937+0000 7f8966ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f896809c890 0x7f896812d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:56.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.937+0000 7f89677fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f896809e2b0 0x7f896812e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54378/0 (socket says 172.21.15.40:54378) 2023-09-30T22:24:56.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.937+0000 7f89677fe700 1 -- 172.21.15.40:0/3377421606 learned_addr learned my addr 172.21.15.40:0/3377421606 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:56.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.937+0000 7f89667fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f896809d920 0x7f896812daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:56.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.937+0000 7f8966ffd700 1 -- 172.21.15.40:0/3377421606 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f896809d920 msgr2=0x7f896812daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:56.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.937+0000 7f8966ffd700 1 --2- 172.21.15.40:0/3377421606 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f896809d920 0x7f896812daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.937+0000 7f8966ffd700 1 -- 172.21.15.40:0/3377421606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f896809e2b0 msgr2=0x7f896812e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:56.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.937+0000 7f8966ffd700 1 --2- 172.21.15.40:0/3377421606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f896809e2b0 0x7f896812e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.937+0000 7f8966ffd700 1 -- 172.21.15.40:0/3377421606 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89500094a0 con 0x7f896809c890 2023-09-30T22:24:56.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.937+0000 7f89667fc700 1 --2- 172.21.15.40:0/3377421606 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f896809d920 0x7f896812daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:56.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.937+0000 7f8966ffd700 1 --2- 172.21.15.40:0/3377421606 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f896809c890 0x7f896812d5b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8958009d60 tx=0x7f895800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:56.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.938+0000 7f895ffff700 1 -- 172.21.15.40:0/3377421606 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895800cb00 con 0x7f896809c890 2023-09-30T22:24:56.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.938+0000 7f895ffff700 1 -- 172.21.15.40:0/3377421606 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895800f040 con 0x7f896809c890 2023-09-30T22:24:56.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.938+0000 7f895ffff700 1 -- 172.21.15.40:0/3377421606 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895800ce60 con 0x7f896809c890 2023-09-30T22:24:56.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.938+0000 7f896d875700 1 -- 172.21.15.40:0/3377421606 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8968130cc0 con 0x7f896809c890 2023-09-30T22:24:56.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.938+0000 7f896d875700 1 -- 172.21.15.40:0/3377421606 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f896812e570 con 0x7f896809c890 2023-09-30T22:24:56.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.939+0000 7f895ffff700 1 -- 172.21.15.40:0/3377421606 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8958014480 con 0x7f896809c890 2023-09-30T22:24:56.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.939+0000 7f896d875700 1 -- 172.21.15.40:0/3377421606 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8968130500 con 0x7f896809c890 2023-09-30T22:24:56.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.939+0000 7f89667fc700 1 -- 172.21.15.40:0/3377421606 >> v1:172.21.15.40:6816/127432 conn(0x7f894802f510 legacy=0x7f89480319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:24:56.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.939+0000 7f895ffff700 1 -- 172.21.15.40:0/3377421606 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f89580402b0 con 0x7f896809c890 2023-09-30T22:24:56.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:56.943+0000 7f895ffff700 1 -- 172.21.15.40:0/3377421606 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f895801c720 con 0x7f896809c890 2023-09-30T22:24:57.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.140+0000 7f89667fc700 1 -- 172.21.15.40:0/3377421606 >> v1:172.21.15.40:6816/127432 conn(0x7f894802f510 legacy=0x7f89480319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:24:57.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.192+0000 7f896d875700 1 -- 172.21.15.40:0/3377421606 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f8968062380 con 0x7f896809c890 2023-09-30T22:24:57.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.194+0000 7f895ffff700 1 -- 172.21.15.40:0/3377421606 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v9) v1 ==== 74+0+70481 (secure 0 0 0) 0x7f895801c360 con 0x7f896809c890 2023-09-30T22:24:57.195 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:24:57.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.196+0000 7f896d875700 1 -- 172.21.15.40:0/3377421606 >> v1:172.21.15.40:6816/127432 conn(0x7f894802f510 legacy=0x7f89480319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:57.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.196+0000 7f896d875700 1 -- 172.21.15.40:0/3377421606 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f896809c890 msgr2=0x7f896812d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:57.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.196+0000 7f896d875700 1 --2- 172.21.15.40:0/3377421606 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f896809c890 0x7f896812d5b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8958009d60 tx=0x7f895800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.196+0000 7f896d875700 1 -- 172.21.15.40:0/3377421606 shutdown_connections 2023-09-30T22:24:57.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.196+0000 7f896d875700 1 --2- 172.21.15.40:0/3377421606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f896809e2b0 0x7f896812e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.196+0000 7f896d875700 1 --2- 172.21.15.40:0/3377421606 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f896809c890 0x7f896812d5b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.196+0000 7f896d875700 1 --2- 172.21.15.40:0/3377421606 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f896809d920 0x7f896812daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.196+0000 7f896d875700 1 -- 172.21.15.40:0/3377421606 >> 172.21.15.40:0/3377421606 conn(0x7f89680a7080 msgr2=0x7f89680a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:57.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.196+0000 7f896d875700 1 -- 172.21.15.40:0/3377421606 shutdown_connections 2023-09-30T22:24:57.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.196+0000 7f896d875700 1 -- 172.21.15.40:0/3377421606 wait complete. 2023-09-30T22:24:57.209 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":9,"active_gid":14099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6816","nonce":127432}]},"active_addr":"172.21.15.40:6816/127432","active_change":"2023-09-30T22:24:24.127513+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":23,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":968436005}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":499521639}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":1146580499}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":4083948303}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":3091130082}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":778194028}]}]} 2023-09-30T22:24:57.212 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-09-30T22:24:57.212 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-30T22:24:57.212 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:24:57.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.337+0000 7f16b5972700 1 Processor -- start 2023-09-30T22:24:57.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.337+0000 7f16b5972700 1 -- start start 2023-09-30T22:24:57.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.337+0000 7f16b5972700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f16b0136bf0 0x7f16b0138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:57.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.337+0000 7f16b5972700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f16b0139510 0x7f16b013b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:57.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.337+0000 7f16b5972700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16b00a2600 con 0x7f16b009c890 2023-09-30T22:24:57.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.337+0000 7f16b5972700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16b00a29d0 con 0x7f16b0139510 2023-09-30T22:24:57.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.337+0000 7f16b5972700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16b009fb40 con 0x7f16b0136bf0 2023-09-30T22:24:57.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.338+0000 7f16ae7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f16b0136bf0 0x7f16b0138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:57.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.338+0000 7f16aeffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f16b009c890 0x7f16b009cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48310/0 (socket says 172.21.15.40:48310) 2023-09-30T22:24:57.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.338+0000 7f16ae7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f16b0136bf0 0x7f16b0138fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51298/0 (socket says 172.21.15.40:51298) 2023-09-30T22:24:57.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.338+0000 7f16aeffd700 1 -- 172.21.15.40:0/2841173082 learned_addr learned my addr 172.21.15.40:0/2841173082 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:24:57.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.338+0000 7f16af7fe700 1 --2- 172.21.15.40:0/2841173082 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f16b0139510 0x7f16b013b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:57.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.338+0000 7f16adffb700 1 -- 172.21.15.40:0/2841173082 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2642960949 0 0) 0x7f16b00a2600 con 0x7f16b009c890 2023-09-30T22:24:57.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.338+0000 7f16ae7fc700 1 -- 172.21.15.40:0/2841173082 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f16b0139510 msgr2=0x7f16b013b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:57.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.338+0000 7f16ae7fc700 1 --2- 172.21.15.40:0/2841173082 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f16b0139510 0x7f16b013b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.338+0000 7f16ae7fc700 1 -- 172.21.15.40:0/2841173082 >> v1:172.21.15.40:6789/0 conn(0x7f16b009c890 legacy=0x7f16b009cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:57.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.338+0000 7f16ae7fc700 1 -- 172.21.15.40:0/2841173082 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b009d370 con 0x7f16b0136bf0 2023-09-30T22:24:57.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.338+0000 7f16ae7fc700 1 --2- 172.21.15.40:0/2841173082 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f16b0136bf0 0x7f16b0138fd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f16a0009870 tx=0x7f16a0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8505b6f4606f4ec server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:57.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.338+0000 7f16adffb700 1 -- 172.21.15.40:0/2841173082 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a0011830 con 0x7f16b0136bf0 2023-09-30T22:24:57.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.338+0000 7f16adffb700 1 -- 172.21.15.40:0/2841173082 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a0011990 con 0x7f16b0136bf0 2023-09-30T22:24:57.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.338+0000 7f16adffb700 1 -- 172.21.15.40:0/2841173082 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a0011d20 con 0x7f16b0136bf0 2023-09-30T22:24:57.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.339+0000 7f16b5972700 1 -- 172.21.15.40:0/2841173082 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f16b0136bf0 msgr2=0x7f16b0138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:57.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.339+0000 7f16b5972700 1 --2- 172.21.15.40:0/2841173082 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f16b0136bf0 0x7f16b0138fd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f16a0009870 tx=0x7f16a0009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:57.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.339+0000 7f16b5972700 1 -- 172.21.15.40:0/2841173082 shutdown_connections 2023-09-30T22:24:57.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.339+0000 7f16b5972700 1 --2- 172.21.15.40:0/2841173082 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f16b0139510 0x7f16b013b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.339+0000 7f16b5972700 1 --2- 172.21.15.40:0/2841173082 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f16b0136bf0 0x7f16b0138fd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.339+0000 7f16b5972700 1 -- 172.21.15.40:0/2841173082 >> 172.21.15.40:0/2841173082 conn(0x7f16b00a7080 msgr2=0x7f16b00a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:57.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.339+0000 7f16b5972700 1 -- 172.21.15.40:0/2841173082 shutdown_connections 2023-09-30T22:24:57.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.339+0000 7f16b5972700 1 -- 172.21.15.40:0/2841173082 wait complete. 2023-09-30T22:24:57.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.340+0000 7f16b5972700 1 Processor -- start 2023-09-30T22:24:57.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.340+0000 7f16b5972700 1 -- start start 2023-09-30T22:24:57.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.340+0000 7f16b5972700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f16b009c890 0x7f16b006ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:57.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.340+0000 7f16b5972700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f16b0136bf0 0x7f16b006f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:57.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.340+0000 7f16b5972700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16b0139510 0x7f16b006f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:57.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.340+0000 7f16b5972700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b0071670 con 0x7f16b0139510 2023-09-30T22:24:57.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.340+0000 7f16b5972700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16b0070900 con 0x7f16b009c890 2023-09-30T22:24:57.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.340+0000 7f16b5972700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16b0139070 con 0x7f16b0136bf0 2023-09-30T22:24:57.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.341+0000 7f16af7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16b0139510 0x7f16b006f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:57.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.341+0000 7f16ae7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f16b0136bf0 0x7f16b006f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:57.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.341+0000 7f16aeffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f16b009c890 0x7f16b006ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:57.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.341+0000 7f16af7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16b0139510 0x7f16b006f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54384/0 (socket says 172.21.15.40:54384) 2023-09-30T22:24:57.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.341+0000 7f16ae7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f16b0136bf0 0x7f16b006f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51310/0 (socket says 172.21.15.40:51310) 2023-09-30T22:24:57.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.341+0000 7f16af7fe700 1 -- 172.21.15.40:0/1604660573 learned_addr learned my addr 172.21.15.40:0/1604660573 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:57.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.341+0000 7f16af7fe700 1 -- 172.21.15.40:0/1604660573 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f16b0136bf0 msgr2=0x7f16b006f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:57.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.341+0000 7f16af7fe700 1 --2- 172.21.15.40:0/1604660573 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f16b0136bf0 0x7f16b006f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.341+0000 7f16af7fe700 1 -- 172.21.15.40:0/1604660573 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f16b009c890 msgr2=0x7f16b006ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:57.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.341+0000 7f16af7fe700 1 --2- 172.21.15.40:0/1604660573 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f16b009c890 0x7f16b006ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.341+0000 7f16af7fe700 1 -- 172.21.15.40:0/1604660573 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a00094a0 con 0x7f16b0139510 2023-09-30T22:24:57.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.341+0000 7f16ae7fc700 1 --2- 172.21.15.40:0/1604660573 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f16b0136bf0 0x7f16b006f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:57.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.341+0000 7f16af7fe700 1 --2- 172.21.15.40:0/1604660573 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16b0139510 0x7f16b006f8e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f16a800efc0 tx=0x7f16a800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:57.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.341+0000 7f16a7fff700 1 -- 172.21.15.40:0/1604660573 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a8009ea0 con 0x7f16b0139510 2023-09-30T22:24:57.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.341+0000 7f16a7fff700 1 -- 172.21.15.40:0/1604660573 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a800f040 con 0x7f16b0139510 2023-09-30T22:24:57.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.341+0000 7f16b5972700 1 -- 172.21.15.40:0/1604660573 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16b009ecf0 con 0x7f16b0139510 2023-09-30T22:24:57.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.341+0000 7f16a7fff700 1 -- 172.21.15.40:0/1604660573 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a8014480 con 0x7f16b0139510 2023-09-30T22:24:57.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.341+0000 7f16b5972700 1 -- 172.21.15.40:0/1604660573 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16b012b4e0 con 0x7f16b0139510 2023-09-30T22:24:57.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.342+0000 7f16a7fff700 1 -- 172.21.15.40:0/1604660573 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f16a80145e0 con 0x7f16b0139510 2023-09-30T22:24:57.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.342+0000 7f16a7fff700 1 -- 172.21.15.40:0/1604660573 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f16a8040aa0 con 0x7f16b0139510 2023-09-30T22:24:57.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.342+0000 7f16aeffd700 1 -- 172.21.15.40:0/1604660573 >> v1:172.21.15.40:6816/127432 conn(0x7f169002f510 legacy=0x7f16900319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:24:57.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.342+0000 7f16b5972700 1 -- 172.21.15.40:0/1604660573 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16b0062380 con 0x7f16b0139510 2023-09-30T22:24:57.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.347+0000 7f16a7fff700 1 -- 172.21.15.40:0/1604660573 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f16a8018020 con 0x7f16b0139510 2023-09-30T22:24:57.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.542+0000 7f16b5972700 1 -- 172.21.15.40:0/1604660573 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16b0074620 con 0x7f16b0139510 2023-09-30T22:24:57.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.543+0000 7f16aeffd700 1 -- 172.21.15.40:0/1604660573 >> v1:172.21.15.40:6816/127432 conn(0x7f169002f510 legacy=0x7f16900319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:24:57.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.543+0000 7f16a7fff700 1 -- 172.21.15.40:0/1604660573 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+13093 (secure 0 0 0) 0x7f16a802c090 con 0x7f16b0139510 2023-09-30T22:24:57.544 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:24:57.544 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":41,"fsid":"79dd4d8e-f295-4d9c-bd93-9850863800e3","created":"2023-09-30T22:21:46.980357+0000","modified":"2023-09-30T22:24:56.733166+0000","last_up_change":"2023-09-30T22:24:43.600612+0000","last_in_change":"2023-09-30T22:21:48.205613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:21:54.875024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:21:56.197012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:22:00.759069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:22:01.327265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"771f785c-f464-4b17-936c-cbf31b1153e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":32,"up_thru":34,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6808","nonce":130098}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6809","nonce":130098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6811","nonce":130098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6810","nonce":130098}]},"public_addr":"172.21.15.40:6808/130098","cluster_addr":"172.21.15.40:6809/130098","heartbeat_back_addr":"172.21.15.40:6811/130098","heartbeat_front_addr":"172.21.15.40:6810/130098","state":["exists","up"]},{"osd":1,"uuid":"45f1e2e8-5310-4219-ab54-424e7440fcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":33,"up_thru":34,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6800","nonce":130196}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6801","nonce":130196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6803","nonce":130196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6802","nonce":130196}]},"public_addr":"172.21.15.40:6800/130196","cluster_addr":"172.21.15.40:6801/130196","heartbeat_back_addr":"172.21.15.40:6803/130196","heartbeat_front_addr":"172.21.15.40:6802/130196","state":["exists","up"]},{"osd":2,"uuid":"7ba62ae5-d21e-4d56-b46c-ba7b718ede25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":27,"up_from":33,"up_thru":34,"down_at":28,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6804","nonce":130328}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6805","nonce":130328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6807","nonce":130328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6806","nonce":130328}]},"public_addr":"172.21.15.40:6804/130328","cluster_addr":"172.21.15.40:6805/130328","heartbeat_back_addr":"172.21.15.40:6807/130328","heartbeat_front_addr":"172.21.15.40:6806/130328","state":["exists","up"]},{"osd":3,"uuid":"c9c55985-8a90-4927-a8fa-6a1fcec1cd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":28,"up_from":34,"up_thru":34,"down_at":29,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6812","nonce":130646}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6813","nonce":130646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6815","nonce":130646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6814","nonce":130646}]},"public_addr":"172.21.15.40:6812/130646","cluster_addr":"172.21.15.40:6813/130646","heartbeat_back_addr":"172.21.15.40:6815/130646","heartbeat_front_addr":"172.21.15.40:6814/130646","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.339829+0000","dead_epoch":26},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.554690+0000","dead_epoch":27},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.641664+0000","dead_epoch":28},{"osd":3,"down_stamp":"2023-09-30T22:24:37.547345+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.320635+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2},{"from":1,"to":0}]},{"pgid":"4.1","mappings":[{"from":3,"to":0}]},{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.12","mappings":[{"from":3,"to":0}]},{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":3,"to":2},{"from":1,"to":0}]},{"pgid":"4.2c","mappings":[{"from":1,"to":2}]},{"pgid":"4.3f","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:6817/2392027806":"2023-10-01T22:24:50.682728+0000","172.21.15.40:0/1890660785":"2023-10-01T22:24:24.127340+0000","172.21.15.40:0/1764460125":"2023-10-01T22:24:24.127340+0000","172.21.15.40:6816/118905":"2023-10-01T22:24:24.127340+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:24:57.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.545+0000 7f16b5972700 1 -- 172.21.15.40:0/1604660573 >> v1:172.21.15.40:6816/127432 conn(0x7f169002f510 legacy=0x7f16900319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:57.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.545+0000 7f16b5972700 1 -- 172.21.15.40:0/1604660573 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16b0139510 msgr2=0x7f16b006f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:57.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.545+0000 7f16b5972700 1 --2- 172.21.15.40:0/1604660573 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16b0139510 0x7f16b006f8e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f16a800efc0 tx=0x7f16a800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.545+0000 7f16b5972700 1 -- 172.21.15.40:0/1604660573 shutdown_connections 2023-09-30T22:24:57.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.545+0000 7f16b5972700 1 --2- 172.21.15.40:0/1604660573 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16b0139510 0x7f16b006f8e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.545+0000 7f16b5972700 1 --2- 172.21.15.40:0/1604660573 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f16b009c890 0x7f16b006ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.545+0000 7f16b5972700 1 --2- 172.21.15.40:0/1604660573 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f16b0136bf0 0x7f16b006f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.545+0000 7f16b5972700 1 -- 172.21.15.40:0/1604660573 >> 172.21.15.40:0/1604660573 conn(0x7f16b00a7080 msgr2=0x7f16b0136fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:57.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.545+0000 7f16b5972700 1 -- 172.21.15.40:0/1604660573 shutdown_connections 2023-09-30T22:24:57.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.545+0000 7f16b5972700 1 -- 172.21.15.40:0/1604660573 wait complete. 2023-09-30T22:24:57.558 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-30T22:24:57.559 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:24:57.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.684+0000 7f9ae964b700 1 Processor -- start 2023-09-30T22:24:57.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.684+0000 7f9ae964b700 1 -- start start 2023-09-30T22:24:57.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.685+0000 7f9ae964b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9ae409c890 0x7f9ae409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:57.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.685+0000 7f9ae964b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9ae409d920 0x7f9ae409dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:57.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.685+0000 7f9ae964b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ae409e2b0 0x7f9ae413ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:57.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.685+0000 7f9ae964b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ae40a29d0 con 0x7f9ae409c890 2023-09-30T22:24:57.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.685+0000 7f9ae964b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae409fb40 con 0x7f9ae409e2b0 2023-09-30T22:24:57.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.685+0000 7f9ae964b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae40a2600 con 0x7f9ae409d920 2023-09-30T22:24:57.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.685+0000 7f9ae27fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9ae409d920 0x7f9ae409dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:57.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.685+0000 7f9ae37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ae409e2b0 0x7f9ae413ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:57.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.685+0000 7f9ae2ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9ae409c890 0x7f9ae409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:57.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.685+0000 7f9ae2ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9ae409c890 0x7f9ae409cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54386/0 (socket says 172.21.15.40:54386) 2023-09-30T22:24:57.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.685+0000 7f9ae27fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9ae409d920 0x7f9ae409dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51312/0 (socket says 172.21.15.40:51312) 2023-09-30T22:24:57.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.685+0000 7f9ae37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ae409e2b0 0x7f9ae413ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53800/0 (socket says 172.21.15.40:53800) 2023-09-30T22:24:57.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.685+0000 7f9ae2ffd700 1 -- 172.21.15.40:0/622672372 learned_addr learned my addr 172.21.15.40:0/622672372 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:57.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.685+0000 7f9ae2ffd700 1 -- 172.21.15.40:0/622672372 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9ae409d920 msgr2=0x7f9ae409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:57.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.685+0000 7f9ae2ffd700 1 --2- 172.21.15.40:0/622672372 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9ae409d920 0x7f9ae409dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.685+0000 7f9ae2ffd700 1 -- 172.21.15.40:0/622672372 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ae409e2b0 msgr2=0x7f9ae413ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:57.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.685+0000 7f9ae2ffd700 1 --2- 172.21.15.40:0/622672372 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ae409e2b0 0x7f9ae413ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.685+0000 7f9ae2ffd700 1 -- 172.21.15.40:0/622672372 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae409fed0 con 0x7f9ae409c890 2023-09-30T22:24:57.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.685+0000 7f9ae37fe700 1 --2- 172.21.15.40:0/622672372 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ae409e2b0 0x7f9ae413ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:57.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.685+0000 7f9ae2ffd700 1 --2- 172.21.15.40:0/622672372 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ae409c890 0x7f9ae409cc60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8006fd0 tx=0x7f9ad8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=946aaffcfee7b9ea server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:57.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.685+0000 7f9ae1ffb700 1 -- 172.21.15.40:0/622672372 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad8005e30 con 0x7f9ae409c890 2023-09-30T22:24:57.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.685+0000 7f9ae1ffb700 1 -- 172.21.15.40:0/622672372 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad8004030 con 0x7f9ae409c890 2023-09-30T22:24:57.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.686+0000 7f9ae1ffb700 1 -- 172.21.15.40:0/622672372 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad80043e0 con 0x7f9ae409c890 2023-09-30T22:24:57.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.686+0000 7f9ae964b700 1 -- 172.21.15.40:0/622672372 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ae409c890 msgr2=0x7f9ae409cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:57.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.686+0000 7f9ae964b700 1 --2- 172.21.15.40:0/622672372 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ae409c890 0x7f9ae409cc60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8006fd0 tx=0x7f9ad8009bd0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.686+0000 7f9ae964b700 1 -- 172.21.15.40:0/622672372 shutdown_connections 2023-09-30T22:24:57.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.686+0000 7f9ae964b700 1 --2- 172.21.15.40:0/622672372 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ae409e2b0 0x7f9ae413ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.686+0000 7f9ae964b700 1 --2- 172.21.15.40:0/622672372 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ae409c890 0x7f9ae409cc60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.686+0000 7f9ae964b700 1 --2- 172.21.15.40:0/622672372 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9ae409d920 0x7f9ae409dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.686+0000 7f9ae964b700 1 -- 172.21.15.40:0/622672372 >> 172.21.15.40:0/622672372 conn(0x7f9ae40a7080 msgr2=0x7f9ae40a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:57.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.686+0000 7f9ae964b700 1 -- 172.21.15.40:0/622672372 shutdown_connections 2023-09-30T22:24:57.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.686+0000 7f9ae964b700 1 -- 172.21.15.40:0/622672372 wait complete. 2023-09-30T22:24:57.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.687+0000 7f9ae964b700 1 Processor -- start 2023-09-30T22:24:57.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.687+0000 7f9ae964b700 1 -- start start 2023-09-30T22:24:57.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.688+0000 7f9ae964b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ae409c890 0x7f9ae412d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:57.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.688+0000 7f9ae964b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9ae409d920 0x7f9ae412db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:57.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.688+0000 7f9ae964b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ae409e2b0 0x7f9ae412e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:57.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.688+0000 7f9ae964b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae4130ac0 con 0x7f9ae409e2b0 2023-09-30T22:24:57.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.688+0000 7f9ae964b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae409ecf0 con 0x7f9ae409c890 2023-09-30T22:24:57.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.688+0000 7f9ae964b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae40a5d40 con 0x7f9ae409d920 2023-09-30T22:24:57.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.688+0000 7f9ae27fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9ae409d920 0x7f9ae412db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:57.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.688+0000 7f9ae37fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ae409e2b0 0x7f9ae412e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:57.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.688+0000 7f9ae27fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9ae409d920 0x7f9ae412db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51326/0 (socket says 172.21.15.40:51326) 2023-09-30T22:24:57.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.688+0000 7f9ae27fc700 1 -- 172.21.15.40:0/3770540933 learned_addr learned my addr 172.21.15.40:0/3770540933 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:57.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.688+0000 7f9ae2ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ae409c890 0x7f9ae412d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:57.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.688+0000 7f9ae27fc700 1 -- 172.21.15.40:0/3770540933 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ae409c890 msgr2=0x7f9ae412d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:57.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.688+0000 7f9ae27fc700 1 --2- 172.21.15.40:0/3770540933 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ae409c890 0x7f9ae412d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.688+0000 7f9ae27fc700 1 -- 172.21.15.40:0/3770540933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ae409e2b0 msgr2=0x7f9ae412e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:57.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.688+0000 7f9ae27fc700 1 --2- 172.21.15.40:0/3770540933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ae409e2b0 0x7f9ae412e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.688+0000 7f9ae27fc700 1 -- 172.21.15.40:0/3770540933 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9adc009a70 con 0x7f9ae409d920 2023-09-30T22:24:57.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.688+0000 7f9ae2ffd700 1 --2- 172.21.15.40:0/3770540933 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ae409c890 0x7f9ae412d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:57.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.688+0000 7f9ae27fc700 1 --2- 172.21.15.40:0/3770540933 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9ae409d920 0x7f9ae412db40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9ad400e930 tx=0x7f9ad400ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:57.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.688+0000 7f9acb7fe700 1 -- 172.21.15.40:0/3770540933 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad400c640 con 0x7f9ae409d920 2023-09-30T22:24:57.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.688+0000 7f9acb7fe700 1 -- 172.21.15.40:0/3770540933 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad400c7a0 con 0x7f9ae409d920 2023-09-30T22:24:57.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.688+0000 7f9ae964b700 1 -- 172.21.15.40:0/3770540933 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad8009500 con 0x7f9ae409d920 2023-09-30T22:24:57.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.688+0000 7f9acb7fe700 1 -- 172.21.15.40:0/3770540933 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad400cb30 con 0x7f9ae409d920 2023-09-30T22:24:57.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.688+0000 7f9ae964b700 1 -- 172.21.15.40:0/3770540933 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ae4130da0 con 0x7f9ae409d920 2023-09-30T22:24:57.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.689+0000 7f9acb7fe700 1 -- 172.21.15.40:0/3770540933 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9ad400cc90 con 0x7f9ae409d920 2023-09-30T22:24:57.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.689+0000 7f9ae964b700 1 -- 172.21.15.40:0/3770540933 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ae4062380 con 0x7f9ae409d920 2023-09-30T22:24:57.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.689+0000 7f9ae2ffd700 1 -- 172.21.15.40:0/3770540933 >> v1:172.21.15.40:6816/127432 conn(0x7f9ad002f510 legacy=0x7f9ad00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:24:57.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.689+0000 7f9acb7fe700 1 -- 172.21.15.40:0/3770540933 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f9ad403ff30 con 0x7f9ae409d920 2023-09-30T22:24:57.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.694+0000 7f9acb7fe700 1 -- 172.21.15.40:0/3770540933 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9ad4017080 con 0x7f9ae409d920 2023-09-30T22:24:57.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.888+0000 7f9ae964b700 1 -- 172.21.15.40:0/3770540933 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ae4074620 con 0x7f9ae409d920 2023-09-30T22:24:57.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.889+0000 7f9acb7fe700 1 -- 172.21.15.40:0/3770540933 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+13093 (secure 0 0 0) 0x7f9ad4021070 con 0x7f9ae409d920 2023-09-30T22:24:57.890 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:24:57.890 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":41,"fsid":"79dd4d8e-f295-4d9c-bd93-9850863800e3","created":"2023-09-30T22:21:46.980357+0000","modified":"2023-09-30T22:24:56.733166+0000","last_up_change":"2023-09-30T22:24:43.600612+0000","last_in_change":"2023-09-30T22:21:48.205613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:21:54.875024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:21:56.197012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:22:00.759069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:22:01.327265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"771f785c-f464-4b17-936c-cbf31b1153e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":32,"up_thru":34,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6808","nonce":130098}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6809","nonce":130098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6811","nonce":130098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6810","nonce":130098}]},"public_addr":"172.21.15.40:6808/130098","cluster_addr":"172.21.15.40:6809/130098","heartbeat_back_addr":"172.21.15.40:6811/130098","heartbeat_front_addr":"172.21.15.40:6810/130098","state":["exists","up"]},{"osd":1,"uuid":"45f1e2e8-5310-4219-ab54-424e7440fcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":33,"up_thru":34,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6800","nonce":130196}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6801","nonce":130196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6803","nonce":130196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6802","nonce":130196}]},"public_addr":"172.21.15.40:6800/130196","cluster_addr":"172.21.15.40:6801/130196","heartbeat_back_addr":"172.21.15.40:6803/130196","heartbeat_front_addr":"172.21.15.40:6802/130196","state":["exists","up"]},{"osd":2,"uuid":"7ba62ae5-d21e-4d56-b46c-ba7b718ede25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":27,"up_from":33,"up_thru":34,"down_at":28,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6804","nonce":130328}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6805","nonce":130328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6807","nonce":130328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6806","nonce":130328}]},"public_addr":"172.21.15.40:6804/130328","cluster_addr":"172.21.15.40:6805/130328","heartbeat_back_addr":"172.21.15.40:6807/130328","heartbeat_front_addr":"172.21.15.40:6806/130328","state":["exists","up"]},{"osd":3,"uuid":"c9c55985-8a90-4927-a8fa-6a1fcec1cd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":28,"up_from":34,"up_thru":34,"down_at":29,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6812","nonce":130646}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6813","nonce":130646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6815","nonce":130646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6814","nonce":130646}]},"public_addr":"172.21.15.40:6812/130646","cluster_addr":"172.21.15.40:6813/130646","heartbeat_back_addr":"172.21.15.40:6815/130646","heartbeat_front_addr":"172.21.15.40:6814/130646","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.339829+0000","dead_epoch":26},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.554690+0000","dead_epoch":27},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.641664+0000","dead_epoch":28},{"osd":3,"down_stamp":"2023-09-30T22:24:37.547345+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.320635+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2},{"from":1,"to":0}]},{"pgid":"4.1","mappings":[{"from":3,"to":0}]},{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.12","mappings":[{"from":3,"to":0}]},{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":3,"to":2},{"from":1,"to":0}]},{"pgid":"4.2c","mappings":[{"from":1,"to":2}]},{"pgid":"4.3f","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:6817/2392027806":"2023-10-01T22:24:50.682728+0000","172.21.15.40:0/1890660785":"2023-10-01T22:24:24.127340+0000","172.21.15.40:0/1764460125":"2023-10-01T22:24:24.127340+0000","172.21.15.40:6816/118905":"2023-10-01T22:24:24.127340+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:24:57.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.890+0000 7f9ae2ffd700 1 -- 172.21.15.40:0/3770540933 >> v1:172.21.15.40:6816/127432 conn(0x7f9ad002f510 legacy=0x7f9ad00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:24:57.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.891+0000 7f9ae964b700 1 -- 172.21.15.40:0/3770540933 >> v1:172.21.15.40:6816/127432 conn(0x7f9ad002f510 legacy=0x7f9ad00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:57.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.891+0000 7f9ae964b700 1 -- 172.21.15.40:0/3770540933 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9ae409d920 msgr2=0x7f9ae412db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:57.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.891+0000 7f9ae964b700 1 --2- 172.21.15.40:0/3770540933 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9ae409d920 0x7f9ae412db40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9ad400e930 tx=0x7f9ad400ec40 comp rx=0 tx=0).stop 2023-09-30T22:24:57.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.891+0000 7f9ae964b700 1 -- 172.21.15.40:0/3770540933 shutdown_connections 2023-09-30T22:24:57.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.891+0000 7f9ae964b700 1 --2- 172.21.15.40:0/3770540933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ae409e2b0 0x7f9ae412e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.891+0000 7f9ae964b700 1 --2- 172.21.15.40:0/3770540933 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ae409c890 0x7f9ae412d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.891+0000 7f9ae964b700 1 --2- 172.21.15.40:0/3770540933 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9ae409d920 0x7f9ae412db40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.891+0000 7f9ae964b700 1 -- 172.21.15.40:0/3770540933 >> 172.21.15.40:0/3770540933 conn(0x7f9ae40a7080 msgr2=0x7f9ae4132890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:57.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.891+0000 7f9ae964b700 1 -- 172.21.15.40:0/3770540933 shutdown_connections 2023-09-30T22:24:57.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:57.891+0000 7f9ae964b700 1 -- 172.21.15.40:0/3770540933 wait complete. 2023-09-30T22:24:57.904 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-09-30T22:24:57.905 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-09-30T22:24:57.905 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-09-30T22:24:57.906 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-09-30T22:24:58.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.047+0000 7faa94011700 1 Processor -- start 2023-09-30T22:24:58.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.047+0000 7f87cd56b700 1 Processor -- start 2023-09-30T22:24:58.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.047+0000 7f87cd56b700 1 -- start start 2023-09-30T22:24:58.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.048+0000 7f87cd56b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87c8133e00 0x7f87c81341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.048+0000 7f87cd56b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f87c809d400 0x7f87c809d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.048+0000 7f87cd56b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87c809dd70 0x7f87c813ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.048+0000 7f87cd56b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c809ab20 con 0x7f87c809d400 2023-09-30T22:24:58.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.048+0000 7f87cd56b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c8133940 con 0x7f87c809dd70 2023-09-30T22:24:58.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.048+0000 7f87cd56b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87c809f0d0 con 0x7f87c8133e00 2023-09-30T22:24:58.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.048+0000 7f87c6ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87c8133e00 0x7f87c81341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.048+0000 7f87c6ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87c8133e00 0x7f87c81341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51342/0 (socket says 172.21.15.40:51342) 2023-09-30T22:24:58.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.048+0000 7f87c6ffd700 1 -- 172.21.15.40:0/1779229825 learned_addr learned my addr 172.21.15.40:0/1779229825 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:58.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.047+0000 7faa94011700 1 -- start start 2023-09-30T22:24:58.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.048+0000 7faa94011700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faa8c138250 0x7faa8c138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.048+0000 7faa94011700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa8c09df20 0x7faa8c140160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.048+0000 7faa94011700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa8c137e20 con 0x7faa8c09d400 2023-09-30T22:24:58.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.048+0000 7faa94011700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa8c138050 con 0x7faa8c09df20 2023-09-30T22:24:58.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.048+0000 7faa94011700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c09b010 con 0x7faa8c138250 2023-09-30T22:24:58.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.048+0000 7faa91dad700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faa8c138250 0x7faa8c138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.048+0000 7faa91dad700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faa8c138250 0x7faa8c138620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51348/0 (socket says 172.21.15.40:51348) 2023-09-30T22:24:58.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.048+0000 7faa91dad700 1 -- 172.21.15.40:0/3374149018 learned_addr learned my addr 172.21.15.40:0/3374149018 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:58.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.048+0000 7f87c67fc700 1 --2- 172.21.15.40:0/1779229825 >> v2:172.21.15.40:3300/0 conn(0x7f87c809d400 0x7f87c809d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.048+0000 7f87c6ffd700 1 -- 172.21.15.40:0/1779229825 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87c809dd70 msgr2=0x7f87c813ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:58.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.048+0000 7f87c6ffd700 1 --2- 172.21.15.40:0/1779229825 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87c809dd70 0x7f87c813ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.048+0000 7f87c6ffd700 1 -- 172.21.15.40:0/1779229825 >> v2:172.21.15.40:3300/0 conn(0x7f87c809d400 msgr2=0x7f87c809d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:58.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.048+0000 7f87c6ffd700 1 --2- 172.21.15.40:0/1779229825 >> v2:172.21.15.40:3300/0 conn(0x7f87c809d400 0x7f87c809d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.048+0000 7f87c6ffd700 1 -- 172.21.15.40:0/1779229825 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c809e210 con 0x7f87c8133e00 2023-09-30T22:24:58.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.048+0000 7faa925ae700 1 --2- 172.21.15.40:0/3374149018 >> v2:172.21.15.40:3300/0 conn(0x7faa8c09df20 0x7faa8c140160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.049+0000 7faa90dab700 1 -- 172.21.15.40:0/3374149018 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3433858697 0 0) 0x7faa8c137e20 con 0x7faa8c09d400 2023-09-30T22:24:58.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.049+0000 7faa90dab700 1 -- 172.21.15.40:0/3374149018 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa780035b0 con 0x7faa8c09d400 2023-09-30T22:24:58.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.049+0000 7faa91dad700 1 -- 172.21.15.40:0/3374149018 >> v2:172.21.15.40:3300/0 conn(0x7faa8c09df20 msgr2=0x7faa8c140160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:58.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.049+0000 7faa91dad700 1 --2- 172.21.15.40:0/3374149018 >> v2:172.21.15.40:3300/0 conn(0x7faa8c09df20 0x7faa8c140160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.049+0000 7faa91dad700 1 -- 172.21.15.40:0/3374149018 >> v1:172.21.15.40:6789/0 conn(0x7faa8c09d400 legacy=0x7faa8c09d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.049+0000 7faa91dad700 1 -- 172.21.15.40:0/3374149018 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa8c09f1f0 con 0x7faa8c138250 2023-09-30T22:24:58.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.049+0000 7f87c6ffd700 1 --2- 172.21.15.40:0/1779229825 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87c8133e00 0x7f87c81341d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f87b80098f0 tx=0x7f87b8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f462d6a538a057 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:58.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.049+0000 7faa91dad700 1 --2- 172.21.15.40:0/3374149018 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faa8c138250 0x7faa8c138620 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faa880098f0 tx=0x7faa88009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a5b2ba765b30a42 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:58.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.049+0000 7f87c5ffb700 1 -- 172.21.15.40:0/1779229825 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b800b8a0 con 0x7f87c8133e00 2023-09-30T22:24:58.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.049+0000 7f87c5ffb700 1 -- 172.21.15.40:0/1779229825 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b800ba00 con 0x7f87c8133e00 2023-09-30T22:24:58.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.049+0000 7f87c5ffb700 1 -- 172.21.15.40:0/1779229825 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b800bd90 con 0x7f87c8133e00 2023-09-30T22:24:58.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.049+0000 7faa90dab700 1 -- 172.21.15.40:0/3374149018 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa88004230 con 0x7faa8c138250 2023-09-30T22:24:58.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.049+0000 7faa90dab700 1 -- 172.21.15.40:0/3374149018 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa88004390 con 0x7faa8c138250 2023-09-30T22:24:58.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.049+0000 7faa90dab700 1 -- 172.21.15.40:0/3374149018 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa880036a0 con 0x7faa8c138250 2023-09-30T22:24:58.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.050+0000 7f87cd56b700 1 -- 172.21.15.40:0/1779229825 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87c8133e00 msgr2=0x7f87c81341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.050+0000 7f87cd56b700 1 --2- 172.21.15.40:0/1779229825 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87c8133e00 0x7f87c81341d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f87b80098f0 tx=0x7f87b8009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:58.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.050+0000 7faa94011700 1 -- 172.21.15.40:0/3374149018 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faa8c138250 msgr2=0x7faa8c138620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.050+0000 7faa94011700 1 --2- 172.21.15.40:0/3374149018 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faa8c138250 0x7faa8c138620 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faa880098f0 tx=0x7faa88009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:58.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.050+0000 7f87cd56b700 1 -- 172.21.15.40:0/1779229825 shutdown_connections 2023-09-30T22:24:58.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.050+0000 7f87cd56b700 1 --2- 172.21.15.40:0/1779229825 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87c8133e00 0x7f87c81341d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.050+0000 7f87cd56b700 1 --2- 172.21.15.40:0/1779229825 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87c809dd70 0x7f87c813ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.050+0000 7f87cd56b700 1 --2- 172.21.15.40:0/1779229825 >> v2:172.21.15.40:3300/0 conn(0x7f87c809d400 0x7f87c809d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.050+0000 7f87cd56b700 1 -- 172.21.15.40:0/1779229825 >> 172.21.15.40:0/1779229825 conn(0x7f87c80a2a00 msgr2=0x7f87c80a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:58.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.050+0000 7f87cd56b700 1 -- 172.21.15.40:0/1779229825 shutdown_connections 2023-09-30T22:24:58.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.050+0000 7f87cd56b700 1 -- 172.21.15.40:0/1779229825 wait complete. 2023-09-30T22:24:58.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.050+0000 7faa94011700 1 -- 172.21.15.40:0/3374149018 shutdown_connections 2023-09-30T22:24:58.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.050+0000 7faa94011700 1 --2- 172.21.15.40:0/3374149018 >> v2:172.21.15.40:3300/0 conn(0x7faa8c09df20 0x7faa8c140160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.050+0000 7faa94011700 1 --2- 172.21.15.40:0/3374149018 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faa8c138250 0x7faa8c138620 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.050+0000 7faa94011700 1 -- 172.21.15.40:0/3374149018 >> 172.21.15.40:0/3374149018 conn(0x7faa8c0a2a00 msgr2=0x7faa8c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:58.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.050+0000 7faa94011700 1 -- 172.21.15.40:0/3374149018 shutdown_connections 2023-09-30T22:24:58.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.050+0000 7faa94011700 1 -- 172.21.15.40:0/3374149018 wait complete. 2023-09-30T22:24:58.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.051+0000 7faa94011700 1 Processor -- start 2023-09-30T22:24:58.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.051+0000 7faa94011700 1 -- start start 2023-09-30T22:24:58.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.051+0000 7f87cd56b700 1 Processor -- start 2023-09-30T22:24:58.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.051+0000 7f87cd56b700 1 -- start start 2023-09-30T22:24:58.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.051+0000 7faa94011700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa8c09d400 0x7faa8c13c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.051+0000 7faa94011700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa8c09df20 0x7faa8c1265e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.052+0000 7faa94011700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faa8c138250 0x7faa8c126b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.052+0000 7faa94011700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c13dc00 con 0x7faa8c09d400 2023-09-30T22:24:58.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.052+0000 7faa94011700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c127060 con 0x7faa8c09df20 2023-09-30T22:24:58.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.052+0000 7faa94011700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c126330 con 0x7faa8c138250 2023-09-30T22:24:58.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.052+0000 7faa91dad700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa8c09d400 0x7faa8c13c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.052+0000 7faa91dad700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa8c09d400 0x7faa8c13c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54434/0 (socket says 172.21.15.40:54434) 2023-09-30T22:24:58.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.052+0000 7faa915ac700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa8c09df20 0x7faa8c1265e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.052+0000 7faa91dad700 1 -- 172.21.15.40:0/3844553683 learned_addr learned my addr 172.21.15.40:0/3844553683 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:58.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.052+0000 7faa925ae700 1 --2- 172.21.15.40:0/3844553683 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faa8c138250 0x7faa8c126b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.052+0000 7f87cd56b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87c809d400 0x7f87c811a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.052+0000 7f87cd56b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87c809dd70 0x7f87c811ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.052+0000 7f87cd56b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87c8133e00 0x7f87c811b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.052+0000 7f87cd56b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c811c690 con 0x7f87c809dd70 2023-09-30T22:24:58.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.052+0000 7f87cd56b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c811c4a0 con 0x7f87c809d400 2023-09-30T22:24:58.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.052+0000 7f87cd56b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87c811caf0 con 0x7f87c8133e00 2023-09-30T22:24:58.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.052+0000 7f87c77fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87c8133e00 0x7f87c811b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.052+0000 7f87c77fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87c8133e00 0x7f87c811b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51360/0 (socket says 172.21.15.40:51360) 2023-09-30T22:24:58.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.052+0000 7f87c77fe700 1 -- 172.21.15.40:0/1957048282 learned_addr learned my addr 172.21.15.40:0/1957048282 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:58.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.052+0000 7f87c67fc700 1 --2- 172.21.15.40:0/1957048282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87c809dd70 0x7f87c811ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.052+0000 7f87c6ffd700 1 --2- 172.21.15.40:0/1957048282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87c809d400 0x7f87c811a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.052+0000 7faa91dad700 1 -- 172.21.15.40:0/3844553683 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faa8c138250 msgr2=0x7faa8c126b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.052+0000 7faa91dad700 1 --2- 172.21.15.40:0/3844553683 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faa8c138250 0x7faa8c126b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.052+0000 7faa91dad700 1 -- 172.21.15.40:0/3844553683 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa8c09df20 msgr2=0x7faa8c1265e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.052+0000 7faa91dad700 1 --2- 172.21.15.40:0/3844553683 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa8c09df20 0x7faa8c1265e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.052+0000 7faa91dad700 1 -- 172.21.15.40:0/3844553683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa88009550 con 0x7faa8c09d400 2023-09-30T22:24:58.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.053+0000 7f87c6ffd700 1 -- 172.21.15.40:0/1957048282 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87c8133e00 msgr2=0x7f87c811b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.053+0000 7f87c6ffd700 1 --2- 172.21.15.40:0/1957048282 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87c8133e00 0x7f87c811b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.053+0000 7f87c6ffd700 1 -- 172.21.15.40:0/1957048282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87c809dd70 msgr2=0x7f87c811ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.053+0000 7f87c6ffd700 1 --2- 172.21.15.40:0/1957048282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87c809dd70 0x7f87c811ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.053+0000 7f87c6ffd700 1 -- 172.21.15.40:0/1957048282 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b8009550 con 0x7f87c809d400 2023-09-30T22:24:58.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.053+0000 7f87c77fe700 1 --2- 172.21.15.40:0/1957048282 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87c8133e00 0x7f87c811b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:58.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.053+0000 7f87c6ffd700 1 --2- 172.21.15.40:0/1957048282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87c809d400 0x7f87c811a8d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f87b8016000 tx=0x7f87b8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:58.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.053+0000 7faa91dad700 1 --2- 172.21.15.40:0/3844553683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa8c09d400 0x7faa8c13c250 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faa88009130 tx=0x7faa88004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:58.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.053+0000 7f87af7fe700 1 -- 172.21.15.40:0/1957048282 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b8004510 con 0x7f87c809d400 2023-09-30T22:24:58.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.053+0000 7f87af7fe700 1 -- 172.21.15.40:0/1957048282 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b80036a0 con 0x7f87c809d400 2023-09-30T22:24:58.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.053+0000 7f87af7fe700 1 -- 172.21.15.40:0/1957048282 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b8003a10 con 0x7f87c809d400 2023-09-30T22:24:58.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.053+0000 7f87cd56b700 1 -- 172.21.15.40:0/1957048282 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c811e3b0 con 0x7f87c809d400 2023-09-30T22:24:58.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.053+0000 7f87cd56b700 1 -- 172.21.15.40:0/1957048282 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c811de10 con 0x7f87c809d400 2023-09-30T22:24:58.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.053+0000 7faa827fc700 1 -- 172.21.15.40:0/3844553683 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa88003c70 con 0x7faa8c09d400 2023-09-30T22:24:58.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.053+0000 7faa827fc700 1 -- 172.21.15.40:0/3844553683 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa88003dd0 con 0x7faa8c09d400 2023-09-30T22:24:58.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.053+0000 7faa827fc700 1 -- 172.21.15.40:0/3844553683 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa88011870 con 0x7faa8c09d400 2023-09-30T22:24:58.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.054+0000 7faa94011700 1 -- 172.21.15.40:0/3844553683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa8c13e590 con 0x7faa8c09d400 2023-09-30T22:24:58.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.054+0000 7faa94011700 1 -- 172.21.15.40:0/3844553683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa8c13d4a0 con 0x7faa8c09d400 2023-09-30T22:24:58.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.054+0000 7f87cd56b700 1 -- 172.21.15.40:0/1957048282 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f87c809a860 con 0x7f87c809d400 2023-09-30T22:24:58.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.054+0000 7f87af7fe700 1 -- 172.21.15.40:0/1957048282 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f87b8003b70 con 0x7f87c809d400 2023-09-30T22:24:58.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.055+0000 7f87af7fe700 1 -- 172.21.15.40:0/1957048282 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f87b8040e20 con 0x7f87c809d400 2023-09-30T22:24:58.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.055+0000 7f87c67fc700 1 -- 172.21.15.40:0/1957048282 >> v1:172.21.15.40:6816/127432 conn(0x7f87b402f510 legacy=0x7f87b40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:24:58.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.055+0000 7f87af7fe700 1 -- 172.21.15.40:0/1957048282 --> v1:172.21.15.40:6808/130098 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f87b403c3e0 con 0x7f87b40386e0 2023-09-30T22:24:58.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.055+0000 7faa827fc700 1 -- 172.21.15.40:0/3844553683 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7faa880119d0 con 0x7faa8c09d400 2023-09-30T22:24:58.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.055+0000 7f87af7fe700 1 -- 172.21.15.40:0/1957048282 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87b8024440 con 0x7f87c809d400 2023-09-30T22:24:58.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.055+0000 7faa94011700 1 -- 172.21.15.40:0/3844553683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faa8c067ae0 con 0x7faa8c09d400 2023-09-30T22:24:58.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.055+0000 7faa827fc700 1 -- 172.21.15.40:0/3844553683 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7faa88041200 con 0x7faa8c09d400 2023-09-30T22:24:58.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.055+0000 7faa827fc700 1 -- 172.21.15.40:0/3844553683 --> v1:172.21.15.40:6800/130196 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faa7003c360 con 0x7faa70038660 2023-09-30T22:24:58.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.055+0000 7faa915ac700 1 -- 172.21.15.40:0/3844553683 >> v1:172.21.15.40:6816/127432 conn(0x7faa7002f510 legacy=0x7faa700319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:24:58.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.055+0000 7faa827fc700 1 -- 172.21.15.40:0/3844553683 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa8802c3a0 con 0x7faa8c09d400 2023-09-30T22:24:58.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.056+0000 7faa827fc700 1 -- 172.21.15.40:0/3844553683 <== osd.1 v1:172.21.15.40:6800/130196 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7faa7003c360 con 0x7faa70038660 2023-09-30T22:24:58.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.056+0000 7f87af7fe700 1 -- 172.21.15.40:0/1957048282 <== osd.0 v1:172.21.15.40:6808/130098 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7f87b403c3e0 con 0x7f87b40386e0 2023-09-30T22:24:58.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.072+0000 7f87cd56b700 1 -- 172.21.15.40:0/1957048282 --> v1:172.21.15.40:6808/130098 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f87c8133be0 con 0x7f87b40386e0 2023-09-30T22:24:58.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.072+0000 7faa94011700 1 -- 172.21.15.40:0/3844553683 --> v1:172.21.15.40:6800/130196 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faa8c09fd60 con 0x7faa70038660 2023-09-30T22:24:58.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.073+0000 7f87af7fe700 1 -- 172.21.15.40:0/1957048282 <== osd.0 v1:172.21.15.40:6808/130098 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 2909512871) 0x7f87c0005dd0 con 0x7f87b40386e0 2023-09-30T22:24:58.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.073+0000 7faa827fc700 1 -- 172.21.15.40:0/3844553683 <== osd.1 v1:172.21.15.40:6800/130196 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 4282407164) 0x7faa8c09fd60 con 0x7faa70038660 2023-09-30T22:24:58.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.073+0000 7f87cd56b700 1 -- 172.21.15.40:0/1957048282 >> v1:172.21.15.40:6808/130098 conn(0x7f87b40386e0 legacy=0x7f87b403ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.073+0000 7faa94011700 1 -- 172.21.15.40:0/3844553683 >> v1:172.21.15.40:6800/130196 conn(0x7faa70038660 legacy=0x7faa7003aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.073+0000 7f87cd56b700 1 -- 172.21.15.40:0/1957048282 >> v1:172.21.15.40:6816/127432 conn(0x7f87b402f510 legacy=0x7f87b40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:58.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.073+0000 7f87cd56b700 1 -- 172.21.15.40:0/1957048282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87c809d400 msgr2=0x7f87c811a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.073+0000 7f87cd56b700 1 --2- 172.21.15.40:0/1957048282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87c809d400 0x7f87c811a8d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f87b8016000 tx=0x7f87b8004750 comp rx=0 tx=0).stop 2023-09-30T22:24:58.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.073+0000 7faa94011700 1 -- 172.21.15.40:0/3844553683 >> v1:172.21.15.40:6816/127432 conn(0x7faa7002f510 legacy=0x7faa700319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:58.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.073+0000 7faa94011700 1 -- 172.21.15.40:0/3844553683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa8c09d400 msgr2=0x7faa8c13c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.073+0000 7faa94011700 1 --2- 172.21.15.40:0/3844553683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa8c09d400 0x7faa8c13c250 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faa88009130 tx=0x7faa88004750 comp rx=0 tx=0).stop 2023-09-30T22:24:58.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.073+0000 7f87c77fe700 1 -- 172.21.15.40:0/1957048282 reap_dead start 2023-09-30T22:24:58.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.073+0000 7f87cd56b700 1 -- 172.21.15.40:0/1957048282 shutdown_connections 2023-09-30T22:24:58.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.073+0000 7f87cd56b700 1 -- 172.21.15.40:0/1957048282 >> 172.21.15.40:0/1957048282 conn(0x7f87c80a2a00 msgr2=0x7f87c812f050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:58.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.073+0000 7faa925ae700 1 -- 172.21.15.40:0/3844553683 reap_dead start 2023-09-30T22:24:58.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.073+0000 7f87cd56b700 1 -- 172.21.15.40:0/1957048282 shutdown_connections 2023-09-30T22:24:58.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.073+0000 7f87cd56b700 1 -- 172.21.15.40:0/1957048282 wait complete. 2023-09-30T22:24:58.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.075+0000 7faa94011700 1 -- 172.21.15.40:0/3844553683 shutdown_connections 2023-09-30T22:24:58.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.075+0000 7faa94011700 1 -- 172.21.15.40:0/3844553683 >> 172.21.15.40:0/3844553683 conn(0x7faa8c0a2a00 msgr2=0x7faa8c09f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:58.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.075+0000 7faa94011700 1 -- 172.21.15.40:0/3844553683 shutdown_connections 2023-09-30T22:24:58.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.075+0000 7faa94011700 1 -- 172.21.15.40:0/3844553683 wait complete. 2023-09-30T22:24:58.088 INFO:teuthology.orchestra.run.smithi040.stdout:137438953476 2023-09-30T22:24:58.088 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:58.089 INFO:teuthology.orchestra.run.smithi040.stdout:141733920772 2023-09-30T22:24:58.090 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:58.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.094+0000 7f8a91884700 1 Processor -- start 2023-09-30T22:24:58.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.095+0000 7f8a91884700 1 -- start start 2023-09-30T22:24:58.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.095+0000 7f100daa6700 1 Processor -- start 2023-09-30T22:24:58.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.095+0000 7f100daa6700 1 -- start start 2023-09-30T22:24:58.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.095+0000 7f100daa6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f100809d920 0x7f100809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.095+0000 7f100daa6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f100809f0f0 0x7f100809e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.095+0000 7f100daa6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f100809f940 con 0x7f1008133ca0 2023-09-30T22:24:58.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.095+0000 7f100daa6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f100806b4c0 con 0x7f100809d920 2023-09-30T22:24:58.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.095+0000 7f100daa6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f100809a8f0 con 0x7f100809f0f0 2023-09-30T22:24:58.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.095+0000 7f1006ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f100809f0f0 0x7f100809e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.095+0000 7f1006ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f100809f0f0 0x7f100809e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53850/0 (socket says 172.21.15.40:53850) 2023-09-30T22:24:58.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.095+0000 7f1006ffd700 1 -- 172.21.15.40:0/604300410 learned_addr learned my addr 172.21.15.40:0/604300410 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:58.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.095+0000 7f8a91884700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8a8c09e400 0x7f8a8c135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.095+0000 7f8a91884700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a8c136230 0x7f8a8c138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.095+0000 7f8a91884700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a8c09adf0 con 0x7f8a8c09d920 2023-09-30T22:24:58.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.095+0000 7f8a91884700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a8c09edf0 con 0x7f8a8c09e400 2023-09-30T22:24:58.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.095+0000 7f8a91884700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c09b660 con 0x7f8a8c136230 2023-09-30T22:24:58.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.095+0000 7f8a8b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a8c136230 0x7f8a8c138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.096+0000 7f10077fe700 1 --2- 172.21.15.40:0/604300410 >> v2:172.21.15.40:3300/0 conn(0x7f100809d920 0x7f100809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.095+0000 7f8a8affd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8a8c09d920 0x7f8a8c09dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48338/0 (socket says 172.21.15.40:48338) 2023-09-30T22:24:58.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.095+0000 7f8a8b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a8c136230 0x7f8a8c138610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53834/0 (socket says 172.21.15.40:53834) 2023-09-30T22:24:58.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.095+0000 7f8a8a7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8a8c09e400 0x7f8a8c135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.095+0000 7f8a8affd700 1 -- 172.21.15.40:0/3011227471 learned_addr learned my addr 172.21.15.40:0/3011227471 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:24:58.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.096+0000 7f8a8b7fe700 1 -- 172.21.15.40:0/3011227471 >> v2:172.21.15.40:3300/0 conn(0x7f8a8c09e400 msgr2=0x7f8a8c135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:58.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.096+0000 7f8a8b7fe700 1 --2- 172.21.15.40:0/3011227471 >> v2:172.21.15.40:3300/0 conn(0x7f8a8c09e400 0x7f8a8c135cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.096+0000 7f8a8b7fe700 1 -- 172.21.15.40:0/3011227471 >> v1:172.21.15.40:6789/0 conn(0x7f8a8c09d920 legacy=0x7f8a8c09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.096+0000 7f8a8b7fe700 1 -- 172.21.15.40:0/3011227471 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a8c09a6e0 con 0x7f8a8c136230 2023-09-30T22:24:58.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.096+0000 7f1006ffd700 1 -- 172.21.15.40:0/604300410 >> v2:172.21.15.40:3300/0 conn(0x7f100809d920 msgr2=0x7f100809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:58.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.096+0000 7f1006ffd700 1 --2- 172.21.15.40:0/604300410 >> v2:172.21.15.40:3300/0 conn(0x7f100809d920 0x7f100809dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.096+0000 7f1006ffd700 1 -- 172.21.15.40:0/604300410 >> v1:172.21.15.40:6789/0 conn(0x7f1008133ca0 legacy=0x7f1008134120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:24:58.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.096+0000 7f1006ffd700 1 -- 172.21.15.40:0/604300410 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f100809f6e0 con 0x7f100809f0f0 2023-09-30T22:24:58.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.096+0000 7f8a8b7fe700 1 --2- 172.21.15.40:0/3011227471 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a8c136230 0x7f8a8c138610 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8a84009d90 tx=0x7f8a8400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78bcf49197c6eaa6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:58.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.096+0000 7f1006ffd700 1 --2- 172.21.15.40:0/604300410 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f100809f0f0 0x7f100809e230 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc0098f0 tx=0x7f0ffc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d082e1a93f525dde server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:58.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.096+0000 7f8a89ffb700 1 -- 172.21.15.40:0/3011227471 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8400e070 con 0x7f8a8c136230 2023-09-30T22:24:58.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.096+0000 7f8a89ffb700 1 -- 172.21.15.40:0/3011227471 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a8400bb20 con 0x7f8a8c136230 2023-09-30T22:24:58.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.096+0000 7f8a89ffb700 1 -- 172.21.15.40:0/3011227471 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a84012430 con 0x7f8a8c136230 2023-09-30T22:24:58.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.096+0000 7f10067fc700 1 -- 172.21.15.40:0/604300410 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc004230 con 0x7f100809f0f0 2023-09-30T22:24:58.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.097+0000 7f10067fc700 1 -- 172.21.15.40:0/604300410 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ffc004390 con 0x7f100809f0f0 2023-09-30T22:24:58.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.097+0000 7f10067fc700 1 -- 172.21.15.40:0/604300410 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc0036a0 con 0x7f100809f0f0 2023-09-30T22:24:58.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.097+0000 7f100daa6700 1 -- 172.21.15.40:0/604300410 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f100809f0f0 msgr2=0x7f100809e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.097+0000 7f100daa6700 1 --2- 172.21.15.40:0/604300410 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f100809f0f0 0x7f100809e230 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc0098f0 tx=0x7f0ffc009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:58.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.097+0000 7f100daa6700 1 -- 172.21.15.40:0/604300410 shutdown_connections 2023-09-30T22:24:58.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.097+0000 7f100daa6700 1 --2- 172.21.15.40:0/604300410 >> v2:172.21.15.40:3300/0 conn(0x7f100809d920 0x7f100809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.097+0000 7f100daa6700 1 --2- 172.21.15.40:0/604300410 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f100809f0f0 0x7f100809e230 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.097+0000 7f100daa6700 1 -- 172.21.15.40:0/604300410 >> 172.21.15.40:0/604300410 conn(0x7f100809fb20 msgr2=0x7f100809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:58.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.097+0000 7f8a91884700 1 -- 172.21.15.40:0/3011227471 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a8c136230 msgr2=0x7f8a8c138610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.097+0000 7f8a91884700 1 --2- 172.21.15.40:0/3011227471 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a8c136230 0x7f8a8c138610 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8a84009d90 tx=0x7f8a8400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:58.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.097+0000 7f100daa6700 1 -- 172.21.15.40:0/604300410 shutdown_connections 2023-09-30T22:24:58.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.097+0000 7f100daa6700 1 -- 172.21.15.40:0/604300410 wait complete. 2023-09-30T22:24:58.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.097+0000 7f8a91884700 1 -- 172.21.15.40:0/3011227471 shutdown_connections 2023-09-30T22:24:58.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.097+0000 7f8a91884700 1 --2- 172.21.15.40:0/3011227471 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a8c136230 0x7f8a8c138610 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.097+0000 7f8a91884700 1 --2- 172.21.15.40:0/3011227471 >> v2:172.21.15.40:3300/0 conn(0x7f8a8c09e400 0x7f8a8c135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.097+0000 7f8a91884700 1 -- 172.21.15.40:0/3011227471 >> 172.21.15.40:0/3011227471 conn(0x7f8a8c09fb20 msgr2=0x7f8a8c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:58.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.098+0000 7f8a91884700 1 -- 172.21.15.40:0/3011227471 shutdown_connections 2023-09-30T22:24:58.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.098+0000 7f100daa6700 1 Processor -- start 2023-09-30T22:24:58.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.098+0000 7f8a91884700 1 -- 172.21.15.40:0/3011227471 wait complete. 2023-09-30T22:24:58.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.099+0000 7f100daa6700 1 -- start start 2023-09-30T22:24:58.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.099+0000 7f100daa6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f100809d920 0x7f100811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.099+0000 7f100daa6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1008133ca0 0x7f100811ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.099+0000 7f100daa6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10081224e0 0x7f100811ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.099+0000 7f100daa6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100811f970 con 0x7f10081224e0 2023-09-30T22:24:58.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.099+0000 7f100daa6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10081200d0 con 0x7f100809d920 2023-09-30T22:24:58.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.099+0000 7f100daa6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10081206f0 con 0x7f1008133ca0 2023-09-30T22:24:58.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.099+0000 7f1006ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1008133ca0 0x7f100811ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.099+0000 7f1006ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1008133ca0 0x7f100811ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51376/0 (socket says 172.21.15.40:51376) 2023-09-30T22:24:58.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.099+0000 7f1006ffd700 1 -- 172.21.15.40:0/2529245030 learned_addr learned my addr 172.21.15.40:0/2529245030 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:58.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.099+0000 7f10077fe700 1 --2- 172.21.15.40:0/2529245030 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f100809d920 0x7f100811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.099+0000 7f1007fff700 1 --2- 172.21.15.40:0/2529245030 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10081224e0 0x7f100811ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.100+0000 7f1006ffd700 1 -- 172.21.15.40:0/2529245030 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f100809d920 msgr2=0x7f100811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.100+0000 7f1006ffd700 1 --2- 172.21.15.40:0/2529245030 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f100809d920 0x7f100811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.100+0000 7f1006ffd700 1 -- 172.21.15.40:0/2529245030 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10081224e0 msgr2=0x7f100811ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.100+0000 7f1006ffd700 1 --2- 172.21.15.40:0/2529245030 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10081224e0 0x7f100811ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.100+0000 7f1006ffd700 1 -- 172.21.15.40:0/2529245030 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ffc009550 con 0x7f1008133ca0 2023-09-30T22:24:58.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.100+0000 7f1006ffd700 1 --2- 172.21.15.40:0/2529245030 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1008133ca0 0x7f100811ea00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc009f50 tx=0x7f0ffc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:58.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.100+0000 7f8a91884700 1 Processor -- start 2023-09-30T22:24:58.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.100+0000 7f0feffff700 1 -- 172.21.15.40:0/2529245030 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc003c00 con 0x7f1008133ca0 2023-09-30T22:24:58.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.100+0000 7f0feffff700 1 -- 172.21.15.40:0/2529245030 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ffc01f070 con 0x7f1008133ca0 2023-09-30T22:24:58.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.100+0000 7f0feffff700 1 -- 172.21.15.40:0/2529245030 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc011630 con 0x7f1008133ca0 2023-09-30T22:24:58.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.101+0000 7f100daa6700 1 -- 172.21.15.40:0/2529245030 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1008121320 con 0x7f1008133ca0 2023-09-30T22:24:58.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.101+0000 7f100daa6700 1 -- 172.21.15.40:0/2529245030 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10080a2930 con 0x7f1008133ca0 2023-09-30T22:24:58.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.100+0000 7f8a91884700 1 -- start start 2023-09-30T22:24:58.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.101+0000 7f8a91884700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a8c09d920 0x7f8a8c11c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.101+0000 7f8a91884700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a8c09e400 0x7f8a8c11cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.101+0000 7f8a91884700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a8c136230 0x7f8a8c11d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.101+0000 7f8a91884700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c11e0b0 con 0x7f8a8c09e400 2023-09-30T22:24:58.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.101+0000 7f8a91884700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c11f300 con 0x7f8a8c136230 2023-09-30T22:24:58.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.101+0000 7f8a91884700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c11e910 con 0x7f8a8c09d920 2023-09-30T22:24:58.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.101+0000 7f8a8affd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a8c09d920 0x7f8a8c11c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.101+0000 7f8a8affd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a8c09d920 0x7f8a8c11c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51380/0 (socket says 172.21.15.40:51380) 2023-09-30T22:24:58.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.101+0000 7f8a8affd700 1 -- 172.21.15.40:0/821729254 learned_addr learned my addr 172.21.15.40:0/821729254 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:58.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.101+0000 7f8a8b7fe700 1 --2- 172.21.15.40:0/821729254 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a8c136230 0x7f8a8c11d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.102+0000 7f0feffff700 1 -- 172.21.15.40:0/2529245030 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0ffc021030 con 0x7f1008133ca0 2023-09-30T22:24:58.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.102+0000 7f10077fe700 1 -- 172.21.15.40:0/2529245030 >> v1:172.21.15.40:6816/127432 conn(0x7f0ff402f560 legacy=0x7f0ff4031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:24:58.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.102+0000 7f0feffff700 1 -- 172.21.15.40:0/2529245030 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f0ffc041160 con 0x7f1008133ca0 2023-09-30T22:24:58.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.101+0000 7f8a8a7fc700 1 --2- 172.21.15.40:0/821729254 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a8c09e400 0x7f8a8c11cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.102+0000 7f8a8b7fe700 1 -- 172.21.15.40:0/821729254 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a8c09d920 msgr2=0x7f8a8c11c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.102+0000 7f8a8b7fe700 1 --2- 172.21.15.40:0/821729254 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a8c09d920 0x7f8a8c11c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.102+0000 7f8a8b7fe700 1 -- 172.21.15.40:0/821729254 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a8c09e400 msgr2=0x7f8a8c11cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.102+0000 7f8a8b7fe700 1 --2- 172.21.15.40:0/821729254 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a8c09e400 0x7f8a8c11cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.102+0000 7f8a8b7fe700 1 -- 172.21.15.40:0/821729254 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a84009a70 con 0x7f8a8c136230 2023-09-30T22:24:58.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.102+0000 7f8a8a7fc700 1 --2- 172.21.15.40:0/821729254 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a8c09e400 0x7f8a8c11cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:58.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.102+0000 7f8a8affd700 1 --2- 172.21.15.40:0/821729254 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a8c09d920 0x7f8a8c11c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:58.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.102+0000 7f8a8b7fe700 1 --2- 172.21.15.40:0/821729254 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a8c136230 0x7f8a8c11d000 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c072b50 tx=0x7f8a84004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:58.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.102+0000 7f100daa6700 1 -- 172.21.15.40:0/2529245030 --> v1:172.21.15.40:6804/130328 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1008070f70 con 0x7f100809f0f0 2023-09-30T22:24:58.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.103+0000 7f8a73fff700 1 -- 172.21.15.40:0/821729254 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a84012430 con 0x7f8a8c136230 2023-09-30T22:24:58.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.103+0000 7f8a73fff700 1 -- 172.21.15.40:0/821729254 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a84024070 con 0x7f8a8c136230 2023-09-30T22:24:58.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.103+0000 7f8a73fff700 1 -- 172.21.15.40:0/821729254 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a84003fe0 con 0x7f8a8c136230 2023-09-30T22:24:58.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.103+0000 7f8a91884700 1 -- 172.21.15.40:0/821729254 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a8c11fce0 con 0x7f8a8c136230 2023-09-30T22:24:58.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.103+0000 7f8a91884700 1 -- 172.21.15.40:0/821729254 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a8c0a2eb0 con 0x7f8a8c136230 2023-09-30T22:24:58.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.104+0000 7f0feffff700 1 -- 172.21.15.40:0/2529245030 <== osd.2 v1:172.21.15.40:6804/130328 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7f1008070f70 con 0x7f100809f0f0 2023-09-30T22:24:58.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.104+0000 7f8a91884700 1 -- 172.21.15.40:0/821729254 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8a8c09c390 con 0x7f8a8c136230 2023-09-30T22:24:58.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.105+0000 7f8a73fff700 1 -- 172.21.15.40:0/821729254 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8a84004140 con 0x7f8a8c136230 2023-09-30T22:24:58.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.105+0000 7f8a73fff700 1 -- 172.21.15.40:0/821729254 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f8a84041a10 con 0x7f8a8c136230 2023-09-30T22:24:58.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.105+0000 7f8a8affd700 1 -- 172.21.15.40:0/821729254 >> v1:172.21.15.40:6816/127432 conn(0x7f8a7802f560 legacy=0x7f8a78031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:24:58.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.105+0000 7f8a73fff700 1 -- 172.21.15.40:0/821729254 --> v1:172.21.15.40:6812/130646 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8a7803c4b0 con 0x7f8a780387b0 2023-09-30T22:24:58.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.105+0000 7f8a73fff700 1 -- 172.21.15.40:0/821729254 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a84041db0 con 0x7f8a8c136230 2023-09-30T22:24:58.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.106+0000 7f8a73fff700 1 -- 172.21.15.40:0/821729254 <== osd.3 v1:172.21.15.40:6812/130646 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7f8a7803c4b0 con 0x7f8a780387b0 2023-09-30T22:24:58.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.122+0000 7f100daa6700 1 -- 172.21.15.40:0/2529245030 --> v1:172.21.15.40:6804/130328 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f100809e770 con 0x7f100809f0f0 2023-09-30T22:24:58.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.123+0000 7f0feffff700 1 -- 172.21.15.40:0/2529245030 <== osd.2 v1:172.21.15.40:6804/130328 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 4282407164) 0x7f1000009690 con 0x7f100809f0f0 2023-09-30T22:24:58.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.123+0000 7f100daa6700 1 -- 172.21.15.40:0/2529245030 >> v1:172.21.15.40:6804/130328 conn(0x7f100809f0f0 legacy=0x7f1008061190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.123+0000 7f100daa6700 1 -- 172.21.15.40:0/2529245030 >> v1:172.21.15.40:6816/127432 conn(0x7f0ff402f560 legacy=0x7f0ff4031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:58.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.123+0000 7f100daa6700 1 -- 172.21.15.40:0/2529245030 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1008133ca0 msgr2=0x7f100811ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.123+0000 7f100daa6700 1 --2- 172.21.15.40:0/2529245030 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1008133ca0 0x7f100811ea00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc009f50 tx=0x7f0ffc004750 comp rx=0 tx=0).stop 2023-09-30T22:24:58.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.123+0000 7f1007fff700 1 -- 172.21.15.40:0/2529245030 reap_dead start 2023-09-30T22:24:58.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.123+0000 7f100daa6700 1 -- 172.21.15.40:0/2529245030 shutdown_connections 2023-09-30T22:24:58.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.123+0000 7f100daa6700 1 -- 172.21.15.40:0/2529245030 >> 172.21.15.40:0/2529245030 conn(0x7f100809fb20 msgr2=0x7f1008133510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:58.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.124+0000 7f100daa6700 1 -- 172.21.15.40:0/2529245030 shutdown_connections 2023-09-30T22:24:58.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.124+0000 7f100daa6700 1 -- 172.21.15.40:0/2529245030 wait complete. 2023-09-30T22:24:58.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.126+0000 7f8a91884700 1 -- 172.21.15.40:0/821729254 --> v1:172.21.15.40:6812/130646 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8a8c09b360 con 0x7f8a780387b0 2023-09-30T22:24:58.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.127+0000 7f8a73fff700 1 -- 172.21.15.40:0/821729254 <== osd.3 v1:172.21.15.40:6812/130646 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 1557062723) 0x7f8a80009590 con 0x7f8a780387b0 2023-09-30T22:24:58.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.127+0000 7f8a91884700 1 -- 172.21.15.40:0/821729254 >> v1:172.21.15.40:6812/130646 conn(0x7f8a780387b0 legacy=0x7f8a7803ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.127+0000 7f8a91884700 1 -- 172.21.15.40:0/821729254 >> v1:172.21.15.40:6816/127432 conn(0x7f8a7802f560 legacy=0x7f8a78031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:58.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.127+0000 7f8a91884700 1 -- 172.21.15.40:0/821729254 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a8c136230 msgr2=0x7f8a8c11d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.127+0000 7f8a91884700 1 --2- 172.21.15.40:0/821729254 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a8c136230 0x7f8a8c11d000 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c072b50 tx=0x7f8a84004ad0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.127+0000 7f8a8b7fe700 1 -- 172.21.15.40:0/821729254 reap_dead start 2023-09-30T22:24:58.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.127+0000 7f8a91884700 1 -- 172.21.15.40:0/821729254 shutdown_connections 2023-09-30T22:24:58.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.127+0000 7f8a91884700 1 -- 172.21.15.40:0/821729254 >> 172.21.15.40:0/821729254 conn(0x7f8a8c09fb20 msgr2=0x7f8a8c06e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:58.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.127+0000 7f8a91884700 1 -- 172.21.15.40:0/821729254 shutdown_connections 2023-09-30T22:24:58.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.127+0000 7f8a91884700 1 -- 172.21.15.40:0/821729254 wait complete. 2023-09-30T22:24:58.138 INFO:teuthology.orchestra.run.smithi040.stdout:141733920772 2023-09-30T22:24:58.139 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:58.142 INFO:teuthology.orchestra.run.smithi040.stdout:146028888068 2023-09-30T22:24:58.142 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:58.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.231+0000 7fb0bec76700 1 Processor -- start 2023-09-30T22:24:58.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.232+0000 7fb0bec76700 1 -- start start 2023-09-30T22:24:58.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.232+0000 7fb0bec76700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb0b809d920 0x7fb0b809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.232+0000 7fb0bec76700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb0b809f0f0 0x7fb0b809e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.232+0000 7fb0bec76700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b809f940 con 0x7fb0b8133ca0 2023-09-30T22:24:58.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.232+0000 7fb0bec76700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b806b4c0 con 0x7fb0b809d920 2023-09-30T22:24:58.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.232+0000 7fb0bec76700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b809a8f0 con 0x7fb0b809f0f0 2023-09-30T22:24:58.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.232+0000 7fb0bd213700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb0b8133ca0 0x7fb0b8134120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48348/0 (socket says 172.21.15.40:48348) 2023-09-30T22:24:58.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.232+0000 7fb0b7fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb0b809f0f0 0x7fb0b809e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.232+0000 7fb0bd213700 1 -- 172.21.15.40:0/2679066027 learned_addr learned my addr 172.21.15.40:0/2679066027 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:24:58.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.232+0000 7fb0bca12700 1 --2- 172.21.15.40:0/2679066027 >> v2:172.21.15.40:3300/0 conn(0x7fb0b809d920 0x7fb0b809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.233+0000 7fb0b7fff700 1 -- 172.21.15.40:0/2679066027 >> v2:172.21.15.40:3300/0 conn(0x7fb0b809d920 msgr2=0x7fb0b809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:58.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.233+0000 7fb0b7fff700 1 --2- 172.21.15.40:0/2679066027 >> v2:172.21.15.40:3300/0 conn(0x7fb0b809d920 0x7fb0b809dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.233+0000 7fb0b7fff700 1 -- 172.21.15.40:0/2679066027 >> v1:172.21.15.40:6789/0 conn(0x7fb0b8133ca0 legacy=0x7fb0b8134120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.233+0000 7fb0b7fff700 1 -- 172.21.15.40:0/2679066027 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b809f6e0 con 0x7fb0b809f0f0 2023-09-30T22:24:58.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.233+0000 7fb0bca12700 1 --2- 172.21.15.40:0/2679066027 >> v2:172.21.15.40:3300/0 conn(0x7fb0b809d920 0x7fb0b809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:58.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.233+0000 7fb0b7fff700 1 --2- 172.21.15.40:0/2679066027 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb0b809f0f0 0x7fb0b809e230 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4009840 tx=0x7fb0a4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc7db71c110df666 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:58.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.233+0000 7fb0b77fe700 1 -- 172.21.15.40:0/2679066027 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4011830 con 0x7fb0b809f0f0 2023-09-30T22:24:58.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.233+0000 7fb0b77fe700 1 -- 172.21.15.40:0/2679066027 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a4011990 con 0x7fb0b809f0f0 2023-09-30T22:24:58.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.233+0000 7fb0b77fe700 1 -- 172.21.15.40:0/2679066027 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4011d20 con 0x7fb0b809f0f0 2023-09-30T22:24:58.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.234+0000 7fc1173f4700 1 Processor -- start 2023-09-30T22:24:58.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.234+0000 7fc1173f4700 1 -- start start 2023-09-30T22:24:58.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.234+0000 7fb0bec76700 1 -- 172.21.15.40:0/2679066027 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb0b809f0f0 msgr2=0x7fb0b809e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.234+0000 7fb0bec76700 1 --2- 172.21.15.40:0/2679066027 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb0b809f0f0 0x7fb0b809e230 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4009840 tx=0x7fb0a4009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:58.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.234+0000 7fb0bec76700 1 -- 172.21.15.40:0/2679066027 shutdown_connections 2023-09-30T22:24:58.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.234+0000 7fb0bec76700 1 --2- 172.21.15.40:0/2679066027 >> v2:172.21.15.40:3300/0 conn(0x7fb0b809d920 0x7fb0b809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.234+0000 7fb0bec76700 1 --2- 172.21.15.40:0/2679066027 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb0b809f0f0 0x7fb0b809e230 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.234+0000 7fb0bec76700 1 -- 172.21.15.40:0/2679066027 >> 172.21.15.40:0/2679066027 conn(0x7fb0b809fb20 msgr2=0x7fb0b809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:58.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.234+0000 7fc1173f4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc11009b050 0x7fc110134f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.234+0000 7fc1173f4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc110135460 0x7fc110137840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.234+0000 7fc1173f4700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc11009b8f0 con 0x7fc11012c660 2023-09-30T22:24:58.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.234+0000 7fc1173f4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc11006ce60 con 0x7fc110135460 2023-09-30T22:24:58.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.234+0000 7fc1173f4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc11009be20 con 0x7fc11009b050 2023-09-30T22:24:58.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.234+0000 7fb0bec76700 1 -- 172.21.15.40:0/2679066027 shutdown_connections 2023-09-30T22:24:58.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.234+0000 7fc11498f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc11009b050 0x7fc110134f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.235+0000 7fc11498f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc11009b050 0x7fc110134f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51390/0 (socket says 172.21.15.40:51390) 2023-09-30T22:24:58.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.235+0000 7fc11498f700 1 -- 172.21.15.40:0/2927361234 learned_addr learned my addr 172.21.15.40:0/2927361234 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:58.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.235+0000 7fb0bec76700 1 -- 172.21.15.40:0/2679066027 wait complete. 2023-09-30T22:24:58.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.236+0000 7fc11498f700 1 -- 172.21.15.40:0/2927361234 >> v2:172.21.15.40:3300/0 conn(0x7fc110135460 msgr2=0x7fc110137840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:58.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.236+0000 7fc11498f700 1 --2- 172.21.15.40:0/2927361234 >> v2:172.21.15.40:3300/0 conn(0x7fc110135460 0x7fc110137840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.236+0000 7fc11498f700 1 -- 172.21.15.40:0/2927361234 >> v1:172.21.15.40:6789/0 conn(0x7fc11012c660 legacy=0x7fc11009a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:58.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.236+0000 7fc11498f700 1 -- 172.21.15.40:0/2927361234 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11012d120 con 0x7fc11009b050 2023-09-30T22:24:58.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.236+0000 7fb0bec76700 1 Processor -- start 2023-09-30T22:24:58.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.236+0000 7fc11498f700 1 --2- 172.21.15.40:0/2927361234 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc11009b050 0x7fc110134f20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc10000bb90 tx=0x7fc10000bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e36b90cfc83e7df server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:58.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.236+0000 7fc107fff700 1 -- 172.21.15.40:0/2927361234 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10000dc00 con 0x7fc11009b050 2023-09-30T22:24:58.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.236+0000 7fc107fff700 1 -- 172.21.15.40:0/2927361234 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10000dd60 con 0x7fc11009b050 2023-09-30T22:24:58.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.236+0000 7fc107fff700 1 -- 172.21.15.40:0/2927361234 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc100004270 con 0x7fc11009b050 2023-09-30T22:24:58.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.236+0000 7fb0bec76700 1 -- start start 2023-09-30T22:24:58.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.237+0000 7fb0bec76700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb0b809d920 0x7fb0b81199d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.237+0000 7fb0bec76700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb0b8133ca0 0x7fb0b8119f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.237+0000 7fb0bec76700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0b811a450 0x7fb0b81d2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.237+0000 7fb0bec76700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b811cfa0 con 0x7fb0b811a450 2023-09-30T22:24:58.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.237+0000 7fb0bec76700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b811be10 con 0x7fb0b8133ca0 2023-09-30T22:24:58.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.237+0000 7fb0bec76700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b80a28c0 con 0x7fb0b809d920 2023-09-30T22:24:58.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.237+0000 7fc1173f4700 1 -- 172.21.15.40:0/2927361234 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc11009b050 msgr2=0x7fc110134f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.237+0000 7fc1173f4700 1 --2- 172.21.15.40:0/2927361234 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc11009b050 0x7fc110134f20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc10000bb90 tx=0x7fc10000bea0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.237+0000 7fb0b7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb0b8133ca0 0x7fb0b8119f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.237+0000 7fb0b7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb0b8133ca0 0x7fb0b8119f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53878/0 (socket says 172.21.15.40:53878) 2023-09-30T22:24:58.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.237+0000 7fb0b7fff700 1 -- 172.21.15.40:0/432597797 learned_addr learned my addr 172.21.15.40:0/432597797 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:58.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.237+0000 7fc1173f4700 1 -- 172.21.15.40:0/2927361234 shutdown_connections 2023-09-30T22:24:58.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.237+0000 7fc1173f4700 1 --2- 172.21.15.40:0/2927361234 >> v2:172.21.15.40:3300/0 conn(0x7fc110135460 0x7fc110137840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.237+0000 7fc1173f4700 1 --2- 172.21.15.40:0/2927361234 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc11009b050 0x7fc110134f20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.237+0000 7fc1173f4700 1 -- 172.21.15.40:0/2927361234 >> 172.21.15.40:0/2927361234 conn(0x7fc1100a2c70 msgr2=0x7fc11009eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:58.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.237+0000 7fb0bca12700 1 --2- 172.21.15.40:0/432597797 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb0b809d920 0x7fb0b81199d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.237+0000 7fc1173f4700 1 -- 172.21.15.40:0/2927361234 shutdown_connections 2023-09-30T22:24:58.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.237+0000 7fc1173f4700 1 -- 172.21.15.40:0/2927361234 wait complete. 2023-09-30T22:24:58.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.238+0000 7fb0b7fff700 1 -- 172.21.15.40:0/432597797 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb0b809d920 msgr2=0x7fb0b81199d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.238+0000 7fb0bd213700 1 --2- 172.21.15.40:0/432597797 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0b811a450 0x7fb0b81d2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.238+0000 7fb0b7fff700 1 --2- 172.21.15.40:0/432597797 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb0b809d920 0x7fb0b81199d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.238+0000 7fb0b7fff700 1 -- 172.21.15.40:0/432597797 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0b811a450 msgr2=0x7fb0b81d2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.238+0000 7fb0b7fff700 1 --2- 172.21.15.40:0/432597797 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0b811a450 0x7fb0b81d2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.238+0000 7fb0b7fff700 1 -- 172.21.15.40:0/432597797 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a40094a0 con 0x7fb0b8133ca0 2023-09-30T22:24:58.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.238+0000 7fb0bca12700 1 --2- 172.21.15.40:0/432597797 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb0b809d920 0x7fb0b81199d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:58.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.238+0000 7fb0bd213700 1 --2- 172.21.15.40:0/432597797 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0b811a450 0x7fb0b81d2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:24:58.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.238+0000 7fb0b7fff700 1 --2- 172.21.15.40:0/432597797 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb0b8133ca0 0x7fb0b8119f10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4009f50 tx=0x7fb0a4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:58.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.238+0000 7fc1173f4700 1 Processor -- start 2023-09-30T22:24:58.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.238+0000 7fc1173f4700 1 -- start start 2023-09-30T22:24:58.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.239+0000 7fc1173f4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc11009b050 0x7fc110131d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.239+0000 7fc1173f4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc11012c660 0x7fc110132280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.239+0000 7fc1173f4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc110135460 0x7fc1101327c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.239+0000 7fc1173f4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc110133d50 con 0x7fc11012c660 2023-09-30T22:24:58.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.239+0000 7fc1173f4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc110133830 con 0x7fc11009b050 2023-09-30T22:24:58.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.239+0000 7fc1173f4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc11012bd80 con 0x7fc110135460 2023-09-30T22:24:58.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.239+0000 7fc115991700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc110135460 0x7fc1101327c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.239+0000 7fc115991700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc110135460 0x7fc1101327c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51414/0 (socket says 172.21.15.40:51414) 2023-09-30T22:24:58.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.239+0000 7fc115991700 1 -- 172.21.15.40:0/3337511917 learned_addr learned my addr 172.21.15.40:0/3337511917 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:58.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.239+0000 7fc115991700 1 -- 172.21.15.40:0/3337511917 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc11009b050 msgr2=0x7fc110131d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.239+0000 7fc115991700 1 --2- 172.21.15.40:0/3337511917 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc11009b050 0x7fc110131d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.239+0000 7fc115991700 1 -- 172.21.15.40:0/3337511917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc11012c660 msgr2=0x7fc110132280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.239+0000 7fc115991700 1 --2- 172.21.15.40:0/3337511917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc11012c660 0x7fc110132280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.239+0000 7fc115991700 1 -- 172.21.15.40:0/3337511917 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10000b7f0 con 0x7fc110135460 2023-09-30T22:24:58.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.239+0000 7fc115991700 1 --2- 172.21.15.40:0/3337511917 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc110135460 0x7fc1101327c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc10800ba10 tx=0x7fc10800bdd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:58.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.240+0000 7fc105ffb700 1 -- 172.21.15.40:0/3337511917 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10800c9b0 con 0x7fc110135460 2023-09-30T22:24:58.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.240+0000 7fc105ffb700 1 -- 172.21.15.40:0/3337511917 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10800cb30 con 0x7fc110135460 2023-09-30T22:24:58.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.240+0000 7fc105ffb700 1 -- 172.21.15.40:0/3337511917 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc108014440 con 0x7fc110135460 2023-09-30T22:24:58.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.240+0000 7fc1173f4700 1 -- 172.21.15.40:0/3337511917 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc11012a250 con 0x7fc110135460 2023-09-30T22:24:58.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.240+0000 7fc1173f4700 1 -- 172.21.15.40:0/3337511917 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc11006e200 con 0x7fc110135460 2023-09-30T22:24:58.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.241+0000 7fc105ffb700 1 -- 172.21.15.40:0/3337511917 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc10801c360 con 0x7fc110135460 2023-09-30T22:24:58.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.241+0000 7fc105ffb700 1 -- 172.21.15.40:0/3337511917 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7fc108006e40 con 0x7fc110135460 2023-09-30T22:24:58.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.241+0000 7fc1173f4700 1 -- 172.21.15.40:0/3337511917 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc110062380 con 0x7fc110135460 2023-09-30T22:24:58.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.240+0000 7fb0b57fa700 1 -- 172.21.15.40:0/432597797 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a40036a0 con 0x7fb0b8133ca0 2023-09-30T22:24:58.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.240+0000 7fb0b57fa700 1 -- 172.21.15.40:0/432597797 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a401f070 con 0x7fb0b8133ca0 2023-09-30T22:24:58.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.240+0000 7fb0b57fa700 1 -- 172.21.15.40:0/432597797 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4003a20 con 0x7fb0b8133ca0 2023-09-30T22:24:58.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.241+0000 7fb0bec76700 1 -- 172.21.15.40:0/432597797 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b809c9e0 con 0x7fb0b8133ca0 2023-09-30T22:24:58.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.241+0000 7fb0bec76700 1 -- 172.21.15.40:0/432597797 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b811d280 con 0x7fb0b8133ca0 2023-09-30T22:24:58.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.241+0000 7fc115190700 1 -- 172.21.15.40:0/3337511917 >> v1:172.21.15.40:6816/127432 conn(0x7fc0f402f510 legacy=0x7fc0f40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:24:58.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.242+0000 7fb0bec76700 1 -- 172.21.15.40:0/432597797 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b8131a60 con 0x7fb0b8133ca0 2023-09-30T22:24:58.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.242+0000 7fb0b57fa700 1 -- 172.21.15.40:0/432597797 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb0a4003b80 con 0x7fb0b8133ca0 2023-09-30T22:24:58.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.243+0000 7fb0b57fa700 1 -- 172.21.15.40:0/432597797 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7fb0a4021070 con 0x7fb0b8133ca0 2023-09-30T22:24:58.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.247+0000 7fb0bca12700 1 -- 172.21.15.40:0/432597797 >> v1:172.21.15.40:6816/127432 conn(0x7fb09c02f560 legacy=0x7fb09c031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:24:58.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.250+0000 7fc105ffb700 1 -- 172.21.15.40:0/3337511917 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc10801d3b0 con 0x7fc110135460 2023-09-30T22:24:58.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.251+0000 7fb0b57fa700 1 -- 172.21.15.40:0/432597797 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb0a400b3e0 con 0x7fb0b8133ca0 2023-09-30T22:24:58.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.321+0000 7f2efba74700 1 Processor -- start 2023-09-30T22:24:58.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.322+0000 7f2efba74700 1 -- start start 2023-09-30T22:24:58.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.322+0000 7f2efba74700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2ef406f070 0x7f2ef406f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.322+0000 7f2efba74700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2ef406f980 0x7f2ef4097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.322+0000 7f2efba74700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef4070830 con 0x7f2ef406fdb0 2023-09-30T22:24:58.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.322+0000 7f2efba74700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef4071af0 con 0x7f2ef406f980 2023-09-30T22:24:58.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.322+0000 7f2efba74700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef4070ad0 con 0x7f2ef406f070 2023-09-30T22:24:58.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.322+0000 7f2ef9810700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2ef406f070 0x7f2ef406f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.322+0000 7f2ef9810700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2ef406f070 0x7f2ef406f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51418/0 (socket says 172.21.15.40:51418) 2023-09-30T22:24:58.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.322+0000 7f2ef9810700 1 -- 172.21.15.40:0/2494913600 learned_addr learned my addr 172.21.15.40:0/2494913600 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:58.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.322+0000 7f2ef900f700 1 --2- 172.21.15.40:0/2494913600 >> v2:172.21.15.40:3300/0 conn(0x7f2ef406f980 0x7f2ef4097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.323+0000 7f2ef9810700 1 -- 172.21.15.40:0/2494913600 >> v2:172.21.15.40:3300/0 conn(0x7f2ef406f980 msgr2=0x7f2ef4097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:58.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.323+0000 7f2ef9810700 1 --2- 172.21.15.40:0/2494913600 >> v2:172.21.15.40:3300/0 conn(0x7f2ef406f980 0x7f2ef4097090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.323+0000 7f2ef9810700 1 -- 172.21.15.40:0/2494913600 >> v1:172.21.15.40:6789/0 conn(0x7f2ef406fdb0 legacy=0x7f2ef40975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.323+0000 7f2ef9810700 1 -- 172.21.15.40:0/2494913600 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef4070de0 con 0x7f2ef406f070 2023-09-30T22:24:58.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.323+0000 7f2ef9810700 1 --2- 172.21.15.40:0/2494913600 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2ef406f070 0x7f2ef406f440 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0009950 tx=0x7f2ef0009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a6fa8c7a7a739b6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:58.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.323+0000 7f2ef880e700 1 -- 172.21.15.40:0/2494913600 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef0011830 con 0x7f2ef406f070 2023-09-30T22:24:58.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.323+0000 7f2ef880e700 1 -- 172.21.15.40:0/2494913600 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef0011990 con 0x7f2ef406f070 2023-09-30T22:24:58.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.323+0000 7f2ef880e700 1 -- 172.21.15.40:0/2494913600 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef0011d40 con 0x7f2ef406f070 2023-09-30T22:24:58.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.324+0000 7f2efba74700 1 -- 172.21.15.40:0/2494913600 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2ef406f070 msgr2=0x7f2ef406f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.324+0000 7f2efba74700 1 --2- 172.21.15.40:0/2494913600 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2ef406f070 0x7f2ef406f440 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0009950 tx=0x7f2ef0009c60 comp rx=0 tx=0).stop 2023-09-30T22:24:58.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.324+0000 7f2efba74700 1 -- 172.21.15.40:0/2494913600 shutdown_connections 2023-09-30T22:24:58.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.324+0000 7f2efba74700 1 --2- 172.21.15.40:0/2494913600 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2ef406f070 0x7f2ef406f440 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.324+0000 7f2efba74700 1 --2- 172.21.15.40:0/2494913600 >> v2:172.21.15.40:3300/0 conn(0x7f2ef406f980 0x7f2ef4097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.324+0000 7f2efba74700 1 -- 172.21.15.40:0/2494913600 >> 172.21.15.40:0/2494913600 conn(0x7f2ef40a41a0 msgr2=0x7f2ef40a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:58.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.324+0000 7f2efba74700 1 -- 172.21.15.40:0/2494913600 shutdown_connections 2023-09-30T22:24:58.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.324+0000 7f2efba74700 1 -- 172.21.15.40:0/2494913600 wait complete. 2023-09-30T22:24:58.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.325+0000 7f2efba74700 1 Processor -- start 2023-09-30T22:24:58.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.325+0000 7f2efba74700 1 -- start start 2023-09-30T22:24:58.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.325+0000 7f2efba74700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ef406f070 0x7f2ef412c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.325+0000 7f2efba74700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2ef406f980 0x7f2ef412c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.325+0000 7f2efba74700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ef406fdb0 0x7f2ef412cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.325+0000 7f2efba74700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef412e410 con 0x7f2ef406fdb0 2023-09-30T22:24:58.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.325+0000 7f2efba74700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef409e050 con 0x7f2ef406f070 2023-09-30T22:24:58.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.325+0000 7f2efba74700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef412eee0 con 0x7f2ef406f980 2023-09-30T22:24:58.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.326+0000 7f2ef900f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2ef406f980 0x7f2ef412c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.326+0000 7f2ef900f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2ef406f980 0x7f2ef412c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51430/0 (socket says 172.21.15.40:51430) 2023-09-30T22:24:58.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.326+0000 7f2ef900f700 1 -- 172.21.15.40:0/2764956067 learned_addr learned my addr 172.21.15.40:0/2764956067 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:58.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.326+0000 7f2ef9810700 1 --2- 172.21.15.40:0/2764956067 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ef406f070 0x7f2ef412c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.326+0000 7f2efa011700 1 --2- 172.21.15.40:0/2764956067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ef406fdb0 0x7f2ef412cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.326+0000 7f2ef900f700 1 -- 172.21.15.40:0/2764956067 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ef406f070 msgr2=0x7f2ef412c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.326+0000 7f2ef900f700 1 --2- 172.21.15.40:0/2764956067 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ef406f070 0x7f2ef412c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.326+0000 7f2ef900f700 1 -- 172.21.15.40:0/2764956067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ef406fdb0 msgr2=0x7f2ef412cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.326+0000 7f2ef900f700 1 --2- 172.21.15.40:0/2764956067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ef406fdb0 0x7f2ef412cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.326+0000 7f2ef900f700 1 -- 172.21.15.40:0/2764956067 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef0009550 con 0x7f2ef406f980 2023-09-30T22:24:58.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.326+0000 7f2ef9810700 1 --2- 172.21.15.40:0/2764956067 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ef406f070 0x7f2ef412c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:58.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.326+0000 7f2ef900f700 1 --2- 172.21.15.40:0/2764956067 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2ef406f980 0x7f2ef412c810 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2ee400e9b0 tx=0x7f2ee400ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:58.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.326+0000 7f2eea7fc700 1 -- 172.21.15.40:0/2764956067 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee4009710 con 0x7f2ef406f980 2023-09-30T22:24:58.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.326+0000 7f2eea7fc700 1 -- 172.21.15.40:0/2764956067 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee400c850 con 0x7f2ef406f980 2023-09-30T22:24:58.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.326+0000 7f2efba74700 1 -- 172.21.15.40:0/2764956067 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef412dae0 con 0x7f2ef406f980 2023-09-30T22:24:58.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.326+0000 7f2eea7fc700 1 -- 172.21.15.40:0/2764956067 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee400cbe0 con 0x7f2ef406f980 2023-09-30T22:24:58.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.326+0000 7f2efba74700 1 -- 172.21.15.40:0/2764956067 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef412e9c0 con 0x7f2ef406f980 2023-09-30T22:24:58.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.327+0000 7f2eea7fc700 1 -- 172.21.15.40:0/2764956067 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2ee400cd40 con 0x7f2ef406f980 2023-09-30T22:24:58.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.328+0000 7f2efba74700 1 -- 172.21.15.40:0/2764956067 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef4099840 con 0x7f2ef406f980 2023-09-30T22:24:58.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.328+0000 7f2eea7fc700 1 -- 172.21.15.40:0/2764956067 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f2ee4040230 con 0x7f2ef406f980 2023-09-30T22:24:58.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.328+0000 7f2ef9810700 1 -- 172.21.15.40:0/2764956067 >> v1:172.21.15.40:6816/127432 conn(0x7f2ed802f510 legacy=0x7f2ed80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:24:58.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.332+0000 7f7271646700 1 Processor -- start 2023-09-30T22:24:58.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.332+0000 7f7271646700 1 -- start start 2023-09-30T22:24:58.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.332+0000 7f7271646700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f726c09c890 0x7f726c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.332+0000 7f7271646700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f726c09e480 0x7f726c13bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.332+0000 7f7271646700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f726c0a2600 con 0x7f726c09d920 2023-09-30T22:24:58.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.332+0000 7f7271646700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726c0a29d0 con 0x7f726c09c890 2023-09-30T22:24:58.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.332+0000 7f7271646700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f726c09fb40 con 0x7f726c09e480 2023-09-30T22:24:58.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.332+0000 7f726affd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f726c09c890 0x7f726c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.332+0000 7f726affd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f726c09c890 0x7f726c09cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53920/0 (socket says 172.21.15.40:53920) 2023-09-30T22:24:58.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.332+0000 7f726affd700 1 -- 172.21.15.40:0/236666304 learned_addr learned my addr 172.21.15.40:0/236666304 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:58.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.332+0000 7f726b7fe700 1 --2- 172.21.15.40:0/236666304 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f726c09e480 0x7f726c13bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.333+0000 7f726affd700 1 -- 172.21.15.40:0/236666304 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f726c09e480 msgr2=0x7f726c13bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:58.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.333+0000 7f726affd700 1 --2- 172.21.15.40:0/236666304 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f726c09e480 0x7f726c13bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.333+0000 7f726affd700 1 -- 172.21.15.40:0/236666304 >> v1:172.21.15.40:6789/0 conn(0x7f726c09d920 legacy=0x7f726c09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.333+0000 7f726affd700 1 -- 172.21.15.40:0/236666304 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726c09fed0 con 0x7f726c09c890 2023-09-30T22:24:58.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.333+0000 7f726b7fe700 1 --2- 172.21.15.40:0/236666304 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f726c09e480 0x7f726c13bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:58.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.333+0000 7f726affd700 1 --2- 172.21.15.40:0/236666304 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f726c09c890 0x7f726c09cc60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f725c0098f0 tx=0x7f725c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc78656796b45694 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:58.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.333+0000 7f7269ffb700 1 -- 172.21.15.40:0/236666304 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c005e30 con 0x7f726c09c890 2023-09-30T22:24:58.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.333+0000 7f7269ffb700 1 -- 172.21.15.40:0/236666304 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725c004030 con 0x7f726c09c890 2023-09-30T22:24:58.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.333+0000 7f7269ffb700 1 -- 172.21.15.40:0/236666304 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c0043e0 con 0x7f726c09c890 2023-09-30T22:24:58.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.334+0000 7f7271646700 1 -- 172.21.15.40:0/236666304 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f726c09c890 msgr2=0x7f726c09cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.334+0000 7f7271646700 1 --2- 172.21.15.40:0/236666304 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f726c09c890 0x7f726c09cc60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f725c0098f0 tx=0x7f725c009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:58.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.334+0000 7f7271646700 1 -- 172.21.15.40:0/236666304 shutdown_connections 2023-09-30T22:24:58.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.334+0000 7f7271646700 1 --2- 172.21.15.40:0/236666304 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f726c09e480 0x7f726c13bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.334+0000 7f7271646700 1 --2- 172.21.15.40:0/236666304 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f726c09c890 0x7f726c09cc60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.334+0000 7f7271646700 1 -- 172.21.15.40:0/236666304 >> 172.21.15.40:0/236666304 conn(0x7f726c0a7080 msgr2=0x7f726c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:58.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.334+0000 7f7271646700 1 -- 172.21.15.40:0/236666304 shutdown_connections 2023-09-30T22:24:58.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.334+0000 7f7271646700 1 -- 172.21.15.40:0/236666304 wait complete. 2023-09-30T22:24:58.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.335+0000 7f7271646700 1 Processor -- start 2023-09-30T22:24:58.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.335+0000 7f7271646700 1 -- start start 2023-09-30T22:24:58.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.335+0000 7f7271646700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f726c09c890 0x7f726c1c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.335+0000 7f7271646700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f726c09d920 0x7f726c1c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.335+0000 7f7271646700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f726c09e480 0x7f726c12d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.335+0000 7f7271646700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726c12f580 con 0x7f726c09c890 2023-09-30T22:24:58.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.335+0000 7f7271646700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726c09bd90 con 0x7f726c09e480 2023-09-30T22:24:58.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.335+0000 7f7271646700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f726c1308e0 con 0x7f726c09d920 2023-09-30T22:24:58.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.336+0000 7f726a7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f726c09d920 0x7f726c1c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.336+0000 7f726affd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f726c09c890 0x7f726c1c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.336+0000 7f726a7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f726c09d920 0x7f726c1c9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51452/0 (socket says 172.21.15.40:51452) 2023-09-30T22:24:58.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.336+0000 7f726affd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f726c09c890 0x7f726c1c8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54556/0 (socket says 172.21.15.40:54556) 2023-09-30T22:24:58.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.336+0000 7f726a7fc700 1 -- 172.21.15.40:0/2905536246 learned_addr learned my addr 172.21.15.40:0/2905536246 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:58.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.336+0000 7f726b7fe700 1 --2- 172.21.15.40:0/2905536246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f726c09e480 0x7f726c12d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.336+0000 7f726a7fc700 1 -- 172.21.15.40:0/2905536246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f726c09e480 msgr2=0x7f726c12d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.336+0000 7f726a7fc700 1 --2- 172.21.15.40:0/2905536246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f726c09e480 0x7f726c12d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.336+0000 7f726a7fc700 1 -- 172.21.15.40:0/2905536246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f726c09c890 msgr2=0x7f726c1c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.336+0000 7f726a7fc700 1 --2- 172.21.15.40:0/2905536246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f726c09c890 0x7f726c1c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.336+0000 7f726a7fc700 1 -- 172.21.15.40:0/2905536246 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725c009500 con 0x7f726c09d920 2023-09-30T22:24:58.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.336+0000 7f726b7fe700 1 --2- 172.21.15.40:0/2905536246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f726c09e480 0x7f726c12d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:58.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.336+0000 7f726a7fc700 1 --2- 172.21.15.40:0/2905536246 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f726c09d920 0x7f726c1c9190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7260007fd0 tx=0x7f7260001e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:58.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.337+0000 7f72537fe700 1 -- 172.21.15.40:0/2905536246 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7260017070 con 0x7f726c09d920 2023-09-30T22:24:58.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.337+0000 7f72537fe700 1 -- 172.21.15.40:0/2905536246 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72600122e0 con 0x7f726c09d920 2023-09-30T22:24:58.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.337+0000 7f7271646700 1 -- 172.21.15.40:0/2905536246 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f726c0a5db0 con 0x7f726c09d920 2023-09-30T22:24:58.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.337+0000 7f72537fe700 1 -- 172.21.15.40:0/2905536246 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7260012690 con 0x7f726c09d920 2023-09-30T22:24:58.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.337+0000 7f2eea7fc700 1 -- 172.21.15.40:0/2764956067 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2ee401b3b0 con 0x7f2ef406f980 2023-09-30T22:24:58.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.337+0000 7f72537fe700 1 -- 172.21.15.40:0/2905536246 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f72600050d0 con 0x7f726c09d920 2023-09-30T22:24:58.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.337+0000 7f7271646700 1 -- 172.21.15.40:0/2905536246 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f726c130e80 con 0x7f726c09d920 2023-09-30T22:24:58.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.338+0000 7f726affd700 1 -- 172.21.15.40:0/2905536246 >> v1:172.21.15.40:6816/127432 conn(0x7f725802f510 legacy=0x7f72580319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:24:58.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.338+0000 7f72537fe700 1 -- 172.21.15.40:0/2905536246 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f726001ba30 con 0x7f726c09d920 2023-09-30T22:24:58.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.339+0000 7f7271646700 1 -- 172.21.15.40:0/2905536246 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f726c09c150 con 0x7f726c09d920 2023-09-30T22:24:58.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.348+0000 7f72537fe700 1 -- 172.21.15.40:0/2905536246 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f72600146b0 con 0x7f726c09d920 2023-09-30T22:24:58.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.442+0000 7fc115190700 1 -- 172.21.15.40:0/3337511917 >> v1:172.21.15.40:6816/127432 conn(0x7fc0f402f510 legacy=0x7fc0f40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:24:58.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.448+0000 7fb0bca12700 1 -- 172.21.15.40:0/432597797 >> v1:172.21.15.40:6816/127432 conn(0x7fb09c02f560 legacy=0x7fb09c031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:24:58.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.455+0000 7fb0bec76700 1 -- 172.21.15.40:0/432597797 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb0b811d0e0 con 0x7fb0b8133ca0 2023-09-30T22:24:58.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.456+0000 7fb0b57fa700 1 -- 172.21.15.40:0/432597797 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb0b811d0e0 con 0x7fb0b8133ca0 2023-09-30T22:24:58.456 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:24:58.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.459+0000 7fb0bec76700 1 -- 172.21.15.40:0/432597797 >> v1:172.21.15.40:6816/127432 conn(0x7fb09c02f560 legacy=0x7fb09c031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:58.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.459+0000 7fb0bec76700 1 -- 172.21.15.40:0/432597797 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb0b8133ca0 msgr2=0x7fb0b8119f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.459+0000 7fb0bec76700 1 --2- 172.21.15.40:0/432597797 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb0b8133ca0 0x7fb0b8119f10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4009f50 tx=0x7fb0a4004750 comp rx=0 tx=0).stop 2023-09-30T22:24:58.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.459+0000 7fb0bec76700 1 -- 172.21.15.40:0/432597797 shutdown_connections 2023-09-30T22:24:58.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.459+0000 7fb0bec76700 1 --2- 172.21.15.40:0/432597797 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb0b809d920 0x7fb0b81199d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.459+0000 7fb0bec76700 1 --2- 172.21.15.40:0/432597797 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0b811a450 0x7fb0b81d2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.459+0000 7fb0bec76700 1 --2- 172.21.15.40:0/432597797 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb0b8133ca0 0x7fb0b8119f10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.459+0000 7fb0bec76700 1 -- 172.21.15.40:0/432597797 >> 172.21.15.40:0/432597797 conn(0x7fb0b809fb20 msgr2=0x7fb0b81333d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:58.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.459+0000 7fb0bec76700 1 -- 172.21.15.40:0/432597797 shutdown_connections 2023-09-30T22:24:58.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.459+0000 7fb0bec76700 1 -- 172.21.15.40:0/432597797 wait complete. 2023-09-30T22:24:58.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.463+0000 7fc1173f4700 1 -- 172.21.15.40:0/3337511917 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc110074620 con 0x7fc110135460 2023-09-30T22:24:58.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.463+0000 7fc105ffb700 1 -- 172.21.15.40:0/3337511917 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc108019030 con 0x7fc110135460 2023-09-30T22:24:58.464 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:24:58.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.465+0000 7fc1173f4700 1 -- 172.21.15.40:0/3337511917 >> v1:172.21.15.40:6816/127432 conn(0x7fc0f402f510 legacy=0x7fc0f40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:58.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.465+0000 7fc1173f4700 1 -- 172.21.15.40:0/3337511917 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc110135460 msgr2=0x7fc1101327c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.465+0000 7fc1173f4700 1 --2- 172.21.15.40:0/3337511917 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc110135460 0x7fc1101327c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc10800ba10 tx=0x7fc10800bdd0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.466+0000 7fc1173f4700 1 -- 172.21.15.40:0/3337511917 shutdown_connections 2023-09-30T22:24:58.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.466+0000 7fc1173f4700 1 --2- 172.21.15.40:0/3337511917 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc110135460 0x7fc1101327c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.466+0000 7fc1173f4700 1 --2- 172.21.15.40:0/3337511917 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc11009b050 0x7fc110131d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.466+0000 7fc1173f4700 1 --2- 172.21.15.40:0/3337511917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc11012c660 0x7fc110132280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.466+0000 7fc1173f4700 1 -- 172.21.15.40:0/3337511917 >> 172.21.15.40:0/3337511917 conn(0x7fc1100a2c70 msgr2=0x7fc1100a0830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:58.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.466+0000 7fc1173f4700 1 -- 172.21.15.40:0/3337511917 shutdown_connections 2023-09-30T22:24:58.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.466+0000 7fc1173f4700 1 -- 172.21.15.40:0/3337511917 wait complete. 2023-09-30T22:24:58.478 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:24:58.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:24:58.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.529+0000 7f2ef9810700 1 -- 172.21.15.40:0/2764956067 >> v1:172.21.15.40:6816/127432 conn(0x7f2ed802f510 legacy=0x7f2ed80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:24:58.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.539+0000 7f726affd700 1 -- 172.21.15.40:0/2905536246 >> v1:172.21.15.40:6816/127432 conn(0x7f725802f510 legacy=0x7f72580319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:24:58.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.545+0000 7f2efba74700 1 -- 172.21.15.40:0/2764956067 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2ef4062380 con 0x7f2ef406f980 2023-09-30T22:24:58.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.545+0000 7f2eea7fc700 1 -- 172.21.15.40:0/2764956067 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2ee4017090 con 0x7f2ef406f980 2023-09-30T22:24:58.546 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:24:58.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.546+0000 7f7271646700 1 -- 172.21.15.40:0/2905536246 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f726c1346f0 con 0x7f726c09d920 2023-09-30T22:24:58.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.547+0000 7f72537fe700 1 -- 172.21.15.40:0/2905536246 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7260019ae0 con 0x7f726c09d920 2023-09-30T22:24:58.547 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:24:58.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.547+0000 7f2efba74700 1 -- 172.21.15.40:0/2764956067 >> v1:172.21.15.40:6816/127432 conn(0x7f2ed802f510 legacy=0x7f2ed80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:58.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.547+0000 7f2efba74700 1 -- 172.21.15.40:0/2764956067 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2ef406f980 msgr2=0x7f2ef412c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.547+0000 7f2efba74700 1 --2- 172.21.15.40:0/2764956067 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2ef406f980 0x7f2ef412c810 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2ee400e9b0 tx=0x7f2ee400ed70 comp rx=0 tx=0).stop 2023-09-30T22:24:58.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.547+0000 7f2efba74700 1 -- 172.21.15.40:0/2764956067 shutdown_connections 2023-09-30T22:24:58.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.547+0000 7f2efba74700 1 --2- 172.21.15.40:0/2764956067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ef406fdb0 0x7f2ef412cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.547+0000 7f2efba74700 1 --2- 172.21.15.40:0/2764956067 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ef406f070 0x7f2ef412c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.547+0000 7f2efba74700 1 --2- 172.21.15.40:0/2764956067 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2ef406f980 0x7f2ef412c810 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.547+0000 7f2efba74700 1 -- 172.21.15.40:0/2764956067 >> 172.21.15.40:0/2764956067 conn(0x7f2ef40a41a0 msgr2=0x7f2ef40973c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:58.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.547+0000 7f2efba74700 1 -- 172.21.15.40:0/2764956067 shutdown_connections 2023-09-30T22:24:58.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.548+0000 7f2efba74700 1 -- 172.21.15.40:0/2764956067 wait complete. 2023-09-30T22:24:58.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.549+0000 7f7271646700 1 -- 172.21.15.40:0/2905536246 >> v1:172.21.15.40:6816/127432 conn(0x7f725802f510 legacy=0x7f72580319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:58.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.549+0000 7f7271646700 1 -- 172.21.15.40:0/2905536246 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f726c09d920 msgr2=0x7f726c1c9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.549+0000 7f7271646700 1 --2- 172.21.15.40:0/2905536246 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f726c09d920 0x7f726c1c9190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7260007fd0 tx=0x7f7260001e40 comp rx=0 tx=0).stop 2023-09-30T22:24:58.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.549+0000 7f7271646700 1 -- 172.21.15.40:0/2905536246 shutdown_connections 2023-09-30T22:24:58.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.549+0000 7f7271646700 1 --2- 172.21.15.40:0/2905536246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f726c09e480 0x7f726c12d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.549+0000 7f7271646700 1 --2- 172.21.15.40:0/2905536246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f726c09c890 0x7f726c1c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.549+0000 7f7271646700 1 --2- 172.21.15.40:0/2905536246 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f726c09d920 0x7f726c1c9190 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.549+0000 7f7271646700 1 -- 172.21.15.40:0/2905536246 >> 172.21.15.40:0/2905536246 conn(0x7f726c0a7080 msgr2=0x7f726c132a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:58.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.549+0000 7f7271646700 1 -- 172.21.15.40:0/2905536246 shutdown_connections 2023-09-30T22:24:58.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:58.549+0000 7f7271646700 1 -- 172.21.15.40:0/2905536246 wait complete. 2023-09-30T22:24:58.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:24:58.563 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:24:59.479 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:59.480 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:59.562 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:59.563 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:59.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.629+0000 7f80a6a7a700 1 Processor -- start 2023-09-30T22:24:59.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.629+0000 7f80a6a7a700 1 -- start start 2023-09-30T22:24:59.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.630+0000 7f80a6a7a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f80a012e590 0x7f80a012e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.630+0000 7f80a6a7a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f80a012eea0 0x7f80a012d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.630+0000 7f80a6a7a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a009ab70 con 0x7f80a012d6d0 2023-09-30T22:24:59.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.630+0000 7f80a6a7a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80a009b270 con 0x7f80a012e590 2023-09-30T22:24:59.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.630+0000 7f80a6a7a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80a009bab0 con 0x7f80a012eea0 2023-09-30T22:24:59.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.630+0000 7f80a4816700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f80a012e590 0x7f80a012e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.630+0000 7f80a4816700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f80a012e590 0x7f80a012e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54566/0 (socket says 172.21.15.40:54566) 2023-09-30T22:24:59.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.630+0000 7f80a4816700 1 -- 172.21.15.40:0/2187923611 learned_addr learned my addr 172.21.15.40:0/2187923611 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:59.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.630+0000 7f80a4816700 1 -- 172.21.15.40:0/2187923611 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f80a012eea0 msgr2=0x7f80a012d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:59.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.630+0000 7f80a4816700 1 --2- 172.21.15.40:0/2187923611 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f80a012eea0 0x7f80a012d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.631+0000 7f80a4816700 1 -- 172.21.15.40:0/2187923611 >> v1:172.21.15.40:6789/0 conn(0x7f80a012d6d0 legacy=0x7f80a0137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.631+0000 7f80a4816700 1 -- 172.21.15.40:0/2187923611 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a009bd70 con 0x7f80a012e590 2023-09-30T22:24:59.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.631+0000 7f80a4816700 1 --2- 172.21.15.40:0/2187923611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80a012e590 0x7f80a012e960 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8094009920 tx=0x7f8094009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ce3d42def74a14 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:59.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.631+0000 7f809f7fe700 1 -- 172.21.15.40:0/2187923611 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809400ba20 con 0x7f80a012e590 2023-09-30T22:24:59.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.631+0000 7f809f7fe700 1 -- 172.21.15.40:0/2187923611 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809400bb80 con 0x7f80a012e590 2023-09-30T22:24:59.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.631+0000 7f809f7fe700 1 -- 172.21.15.40:0/2187923611 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8094009e70 con 0x7f80a012e590 2023-09-30T22:24:59.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.632+0000 7f80a6a7a700 1 -- 172.21.15.40:0/2187923611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80a012e590 msgr2=0x7f80a012e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.632+0000 7f80a6a7a700 1 --2- 172.21.15.40:0/2187923611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80a012e590 0x7f80a012e960 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8094009920 tx=0x7f8094009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:59.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.632+0000 7f80a6a7a700 1 -- 172.21.15.40:0/2187923611 shutdown_connections 2023-09-30T22:24:59.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.632+0000 7f80a6a7a700 1 --2- 172.21.15.40:0/2187923611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80a012e590 0x7f80a012e960 secure :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8094009920 tx=0x7f8094009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:59.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.632+0000 7f80a6a7a700 1 --2- 172.21.15.40:0/2187923611 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f80a012eea0 0x7f80a012d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.632+0000 7f80a6a7a700 1 -- 172.21.15.40:0/2187923611 >> 172.21.15.40:0/2187923611 conn(0x7f80a00a2a00 msgr2=0x7f80a00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:59.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.632+0000 7f80a6a7a700 1 -- 172.21.15.40:0/2187923611 shutdown_connections 2023-09-30T22:24:59.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.632+0000 7f80a6a7a700 1 -- 172.21.15.40:0/2187923611 wait complete. 2023-09-30T22:24:59.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.634+0000 7f80a6a7a700 1 Processor -- start 2023-09-30T22:24:59.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.634+0000 7f80a6a7a700 1 -- start start 2023-09-30T22:24:59.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.635+0000 7f80a6a7a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f80a012d6d0 0x7f80a013ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.635+0000 7f80a6a7a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80a012eea0 0x7f80a013b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.635+0000 7f80a6a7a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f80a013b5c0 0x7f80a01c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.635+0000 7f80a6a7a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a0138660 con 0x7f80a012eea0 2023-09-30T22:24:59.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.635+0000 7f80a6a7a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a009df70 con 0x7f80a012d6d0 2023-09-30T22:24:59.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.635+0000 7f80a6a7a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80a009b4b0 con 0x7f80a013b5c0 2023-09-30T22:24:59.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.635+0000 7f80a5017700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f80a013b5c0 0x7f80a01c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.635+0000 7f80a5017700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f80a013b5c0 0x7f80a01c8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51460/0 (socket says 172.21.15.40:51460) 2023-09-30T22:24:59.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.635+0000 7f80a5017700 1 -- 172.21.15.40:0/3685333205 learned_addr learned my addr 172.21.15.40:0/3685333205 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:59.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.635+0000 7f809ffff700 1 --2- 172.21.15.40:0/3685333205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80a012eea0 0x7f80a013b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.635+0000 7f80a5017700 1 -- 172.21.15.40:0/3685333205 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f80a012d6d0 msgr2=0x7f80a013ab40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:59.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.635+0000 7f80a5017700 1 --2- 172.21.15.40:0/3685333205 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f80a012d6d0 0x7f80a013ab40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.635+0000 7f80a5017700 1 -- 172.21.15.40:0/3685333205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80a012eea0 msgr2=0x7f80a013b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.635+0000 7f80a5017700 1 --2- 172.21.15.40:0/3685333205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80a012eea0 0x7f80a013b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.635+0000 7f80a5017700 1 -- 172.21.15.40:0/3685333205 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8094009550 con 0x7f80a013b5c0 2023-09-30T22:24:59.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.636+0000 7f80a5017700 1 --2- 172.21.15.40:0/3685333205 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f80a013b5c0 0x7f80a01c8680 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f809800cc50 tx=0x7f809800cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:59.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.636+0000 7f809d7fa700 1 -- 172.21.15.40:0/3685333205 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8098003c00 con 0x7f80a013b5c0 2023-09-30T22:24:59.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.636+0000 7f809d7fa700 1 -- 172.21.15.40:0/3685333205 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8098003d60 con 0x7f80a013b5c0 2023-09-30T22:24:59.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.636+0000 7f809d7fa700 1 -- 172.21.15.40:0/3685333205 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809800ab60 con 0x7f80a013b5c0 2023-09-30T22:24:59.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.636+0000 7f80a6a7a700 1 -- 172.21.15.40:0/3685333205 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a013bfc0 con 0x7f80a013b5c0 2023-09-30T22:24:59.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.636+0000 7f80a6a7a700 1 -- 172.21.15.40:0/3685333205 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a0138c00 con 0x7f80a013b5c0 2023-09-30T22:24:59.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.637+0000 7f809d7fa700 1 -- 172.21.15.40:0/3685333205 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f809800acc0 con 0x7f80a013b5c0 2023-09-30T22:24:59.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.637+0000 7f80a6a7a700 1 -- 172.21.15.40:0/3685333205 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a0062380 con 0x7f80a013b5c0 2023-09-30T22:24:59.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.638+0000 7f809d7fa700 1 -- 172.21.15.40:0/3685333205 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f809803fcc0 con 0x7f80a013b5c0 2023-09-30T22:24:59.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.638+0000 7f80a4816700 1 -- 172.21.15.40:0/3685333205 >> v1:172.21.15.40:6816/127432 conn(0x7f808402f540 legacy=0x7f80840319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:24:59.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.645+0000 7f6b8787a700 1 Processor -- start 2023-09-30T22:24:59.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.645+0000 7f6b8787a700 1 -- start start 2023-09-30T22:24:59.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.645+0000 7f809d7fa700 1 -- 172.21.15.40:0/3685333205 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f80980196c0 con 0x7f80a013b5c0 2023-09-30T22:24:59.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.646+0000 7f6b8787a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b8006f3a0 0x7f6b8006c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.646+0000 7f6b8787a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b8009fbb0 0x7f6b8006ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.646+0000 7f6b8787a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b800a0780 con 0x7f6b8006d410 2023-09-30T22:24:59.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.646+0000 7f6b8787a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8009ff80 con 0x7f6b8006f3a0 2023-09-30T22:24:59.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.646+0000 7f6b8787a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b800a0590 con 0x7f6b8009fbb0 2023-09-30T22:24:59.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.646+0000 7f6b85e17700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6b8006d410 0x7f6b8013a380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48386/0 (socket says 172.21.15.40:48386) 2023-09-30T22:24:59.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.646+0000 7f6b85e17700 1 -- 172.21.15.40:0/1964274919 learned_addr learned my addr 172.21.15.40:0/1964274919 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:24:59.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.646+0000 7f6b77fff700 1 -- 172.21.15.40:0/1964274919 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1708693172 0 0) 0x7f6b800a0780 con 0x7f6b8006d410 2023-09-30T22:24:59.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.646+0000 7f6b77fff700 1 -- 172.21.15.40:0/1964274919 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b6c0035b0 con 0x7f6b8006d410 2023-09-30T22:24:59.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.647+0000 7f6b77fff700 1 -- 172.21.15.40:0/1964274919 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1672812783 0 0) 0x7f6b6c0035b0 con 0x7f6b8006d410 2023-09-30T22:24:59.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.647+0000 7f6b77fff700 1 -- 172.21.15.40:0/1964274919 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b8009fbb0 msgr2=0x7f6b8006ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:59.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.647+0000 7f6b77fff700 1 --2- 172.21.15.40:0/1964274919 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b8009fbb0 0x7f6b8006ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.647+0000 7f6b77fff700 1 -- 172.21.15.40:0/1964274919 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b8006f3a0 msgr2=0x7f6b8006c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:59.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.647+0000 7f6b77fff700 1 --2- 172.21.15.40:0/1964274919 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b8006f3a0 0x7f6b8006c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.647+0000 7f6b77fff700 1 -- 172.21.15.40:0/1964274919 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b8006df90 con 0x7f6b8006d410 2023-09-30T22:24:59.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.647+0000 7f6b77fff700 1 -- 172.21.15.40:0/1964274919 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4231795173 0 0) 0x7f6b780019f0 con 0x7f6b8006d410 2023-09-30T22:24:59.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.647+0000 7f6b77fff700 1 -- 172.21.15.40:0/1964274919 >> v1:172.21.15.40:6789/0 conn(0x7f6b8006d410 legacy=0x7f6b8013a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.647+0000 7f6b77fff700 1 --2- 172.21.15.40:0/1964274919 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b8006f3a0 0x7f6b6c003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.647+0000 7f6b77fff700 1 --2- 172.21.15.40:0/1964274919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b6c004140 0x7f6b6c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.647+0000 7f6b77fff700 1 --2- 172.21.15.40:0/1964274919 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b6c004eb0 0x7f6b6c005320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.647+0000 7f6b77fff700 1 -- 172.21.15.40:0/1964274919 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8009ff80 con 0x7f6b6c004140 2023-09-30T22:24:59.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.647+0000 7f6b77fff700 1 -- 172.21.15.40:0/1964274919 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c00bcf0 con 0x7f6b8006f3a0 2023-09-30T22:24:59.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.647+0000 7f6b77fff700 1 -- 172.21.15.40:0/1964274919 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c00beb0 con 0x7f6b6c004eb0 2023-09-30T22:24:59.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.647+0000 7f6b84e15700 1 --2- 172.21.15.40:0/1964274919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b6c004140 0x7f6b6c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.647+0000 7f6b84e15700 1 -- 172.21.15.40:0/1964274919 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b6c004eb0 msgr2=0x7f6b6c005320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:59.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.647+0000 7f6b84e15700 1 --2- 172.21.15.40:0/1964274919 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b6c004eb0 0x7f6b6c005320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.647+0000 7f6b84e15700 1 -- 172.21.15.40:0/1964274919 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b8006f3a0 msgr2=0x7f6b6c003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:59.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.647+0000 7f6b84e15700 1 --2- 172.21.15.40:0/1964274919 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b8006f3a0 0x7f6b6c003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.647+0000 7f6b84e15700 1 -- 172.21.15.40:0/1964274919 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6c0035b0 con 0x7f6b6c004140 2023-09-30T22:24:59.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.648+0000 7f6b84e15700 1 --2- 172.21.15.40:0/1964274919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b6c004140 0x7f6b6c004850 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6b8006bd20 tx=0x7f6b6c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ddc5666c1e8c397 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:59.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.648+0000 7f6b77fff700 1 -- 172.21.15.40:0/1964274919 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c011620 con 0x7f6b6c004140 2023-09-30T22:24:59.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.648+0000 7f6b77fff700 1 -- 172.21.15.40:0/1964274919 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7c011780 con 0x7f6b6c004140 2023-09-30T22:24:59.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.648+0000 7f6b77fff700 1 -- 172.21.15.40:0/1964274919 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c011b30 con 0x7f6b6c004140 2023-09-30T22:24:59.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.648+0000 7f6b8787a700 1 -- 172.21.15.40:0/1964274919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b6c004140 msgr2=0x7f6b6c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.648+0000 7f6b8787a700 1 --2- 172.21.15.40:0/1964274919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b6c004140 0x7f6b6c004850 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6b8006bd20 tx=0x7f6b6c005880 comp rx=0 tx=0).stop 2023-09-30T22:24:59.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.652+0000 7f6b8787a700 1 -- 172.21.15.40:0/1964274919 shutdown_connections 2023-09-30T22:24:59.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.652+0000 7f6b8787a700 1 --2- 172.21.15.40:0/1964274919 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b6c004eb0 0x7f6b6c005320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.652+0000 7f6b8787a700 1 --2- 172.21.15.40:0/1964274919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b6c004140 0x7f6b6c004850 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.652+0000 7f6b8787a700 1 --2- 172.21.15.40:0/1964274919 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b8006f3a0 0x7f6b6c003a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.653+0000 7f6b8787a700 1 -- 172.21.15.40:0/1964274919 >> 172.21.15.40:0/1964274919 conn(0x7f6b800a41a0 msgr2=0x7f6b800a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:59.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.653+0000 7f6b8787a700 1 -- 172.21.15.40:0/1964274919 shutdown_connections 2023-09-30T22:24:59.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.653+0000 7f6b8787a700 1 -- 172.21.15.40:0/1964274919 wait complete. 2023-09-30T22:24:59.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.654+0000 7f6b8787a700 1 Processor -- start 2023-09-30T22:24:59.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.654+0000 7f6b8787a700 1 -- start start 2023-09-30T22:24:59.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.654+0000 7f6b8787a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b6c004140 0x7f6b801bc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.654+0000 7f6b8787a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b6c004eb0 0x7f6b801bc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.654+0000 7f6b8787a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b8006d410 0x7f6b801bcb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.654+0000 7f6b8787a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b80094f70 con 0x7f6b6c004140 2023-09-30T22:24:59.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.654+0000 7f6b8787a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b80093810 con 0x7f6b6c004eb0 2023-09-30T22:24:59.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.654+0000 7f6b8787a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b800a20a0 con 0x7f6b8006d410 2023-09-30T22:24:59.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.654+0000 7f6b85616700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b6c004140 0x7f6b801bc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.654+0000 7f6b85e17700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b8006d410 0x7f6b801bcb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.654+0000 7f6b85616700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b6c004140 0x7f6b801bc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54602/0 (socket says 172.21.15.40:54602) 2023-09-30T22:24:59.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.654+0000 7f6b85616700 1 -- 172.21.15.40:0/3830685267 learned_addr learned my addr 172.21.15.40:0/3830685267 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:59.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.654+0000 7f6b84e15700 1 --2- 172.21.15.40:0/3830685267 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b6c004eb0 0x7f6b801bc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.655+0000 7f6b85e17700 1 -- 172.21.15.40:0/3830685267 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b6c004eb0 msgr2=0x7f6b801bc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.655+0000 7f6b85e17700 1 --2- 172.21.15.40:0/3830685267 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b6c004eb0 0x7f6b801bc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.655+0000 7f6b85e17700 1 -- 172.21.15.40:0/3830685267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b6c004140 msgr2=0x7f6b801bc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.655+0000 7f6b85e17700 1 --2- 172.21.15.40:0/3830685267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b6c004140 0x7f6b801bc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.655+0000 7f6b85e17700 1 -- 172.21.15.40:0/3830685267 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b80071eb0 con 0x7f6b8006d410 2023-09-30T22:24:59.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.655+0000 7f6b85616700 1 --2- 172.21.15.40:0/3830685267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b6c004140 0x7f6b801bc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:59.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.655+0000 7f6b85e17700 1 --2- 172.21.15.40:0/3830685267 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b8006d410 0x7f6b801bcb10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6b7800cbb0 tx=0x7f6b7800cec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:59.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.655+0000 7f6b75ffb700 1 -- 172.21.15.40:0/3830685267 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7800aaa0 con 0x7f6b8006d410 2023-09-30T22:24:59.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.655+0000 7f6b75ffb700 1 -- 172.21.15.40:0/3830685267 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7800ac00 con 0x7f6b8006d410 2023-09-30T22:24:59.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.655+0000 7f6b8787a700 1 -- 172.21.15.40:0/3830685267 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b80094c90 con 0x7f6b8006d410 2023-09-30T22:24:59.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.655+0000 7f6b75ffb700 1 -- 172.21.15.40:0/3830685267 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b780070d0 con 0x7f6b8006d410 2023-09-30T22:24:59.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.656+0000 7f6b8787a700 1 -- 172.21.15.40:0/3830685267 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b80095b50 con 0x7f6b8006d410 2023-09-30T22:24:59.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.657+0000 7f6b8787a700 1 -- 172.21.15.40:0/3830685267 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b80062380 con 0x7f6b8006d410 2023-09-30T22:24:59.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.657+0000 7f6b75ffb700 1 -- 172.21.15.40:0/3830685267 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f6b78007230 con 0x7f6b8006d410 2023-09-30T22:24:59.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.657+0000 7f6b75ffb700 1 -- 172.21.15.40:0/3830685267 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f6b78041a80 con 0x7f6b8006d410 2023-09-30T22:24:59.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.657+0000 7f6b85616700 1 -- 172.21.15.40:0/3830685267 >> v1:172.21.15.40:6816/127432 conn(0x7f6b6402f4e0 legacy=0x7f6b64031990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:24:59.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.662+0000 7f6b75ffb700 1 -- 172.21.15.40:0/3830685267 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6b78045060 con 0x7f6b8006d410 2023-09-30T22:24:59.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.713+0000 7ff196b93700 1 Processor -- start 2023-09-30T22:24:59.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.713+0000 7ff196b93700 1 -- start start 2023-09-30T22:24:59.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.713+0000 7ff196b93700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff19006a6d0 0x7ff19009d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.713+0000 7ff196b93700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff19009de60 0x7ff19009e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.713+0000 7ff196b93700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff19013c490 0x7ff19013e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.713+0000 7ff196b93700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff19006aaa0 con 0x7ff19006a6d0 2023-09-30T22:24:59.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.713+0000 7ff196b93700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff19009e790 con 0x7ff19009de60 2023-09-30T22:24:59.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.713+0000 7ff196b93700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff19006b150 con 0x7ff19013c490 2023-09-30T22:24:59.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.713+0000 7ff18ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff19009de60 0x7ff19009e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.714+0000 7ff18ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff19009de60 0x7ff19009e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53974/0 (socket says 172.21.15.40:53974) 2023-09-30T22:24:59.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.714+0000 7ff18ffff700 1 -- 172.21.15.40:0/1288306749 learned_addr learned my addr 172.21.15.40:0/1288306749 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:59.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.714+0000 7ff195130700 1 --2- 172.21.15.40:0/1288306749 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff19013c490 0x7ff19013e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.714+0000 7ff19492f700 1 --2- 172.21.15.40:0/1288306749 >> v2:172.21.15.40:3300/0 conn(0x7ff19006a6d0 0x7ff19009d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.714+0000 7ff195130700 1 -- 172.21.15.40:0/1288306749 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff19009de60 msgr2=0x7ff19009e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:59.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.714+0000 7ff195130700 1 --2- 172.21.15.40:0/1288306749 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff19009de60 0x7ff19009e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.714+0000 7ff195130700 1 -- 172.21.15.40:0/1288306749 >> v2:172.21.15.40:3300/0 conn(0x7ff19006a6d0 msgr2=0x7ff19009d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:59.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.714+0000 7ff195130700 1 --2- 172.21.15.40:0/1288306749 >> v2:172.21.15.40:3300/0 conn(0x7ff19006a6d0 0x7ff19009d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.714+0000 7ff195130700 1 -- 172.21.15.40:0/1288306749 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff19009f300 con 0x7ff19013c490 2023-09-30T22:24:59.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.714+0000 7ff18ffff700 1 --2- 172.21.15.40:0/1288306749 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff19009de60 0x7ff19009e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:59.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.714+0000 7ff195130700 1 --2- 172.21.15.40:0/1288306749 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff19013c490 0x7ff19013e870 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff188009dc0 tx=0x7ff18800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65e0c9a8fa2d7699 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:59.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.714+0000 7ff18f7fe700 1 -- 172.21.15.40:0/1288306749 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18800e070 con 0x7ff19013c490 2023-09-30T22:24:59.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.714+0000 7ff18f7fe700 1 -- 172.21.15.40:0/1288306749 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff18800ba80 con 0x7ff19013c490 2023-09-30T22:24:59.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.714+0000 7ff18f7fe700 1 -- 172.21.15.40:0/1288306749 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18800be30 con 0x7ff19013c490 2023-09-30T22:24:59.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.715+0000 7ff196b93700 1 -- 172.21.15.40:0/1288306749 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff19013c490 msgr2=0x7ff19013e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.715+0000 7ff196b93700 1 --2- 172.21.15.40:0/1288306749 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff19013c490 0x7ff19013e870 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff188009dc0 tx=0x7ff18800b330 comp rx=0 tx=0).stop 2023-09-30T22:24:59.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.715+0000 7ff196b93700 1 -- 172.21.15.40:0/1288306749 shutdown_connections 2023-09-30T22:24:59.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.715+0000 7ff196b93700 1 --2- 172.21.15.40:0/1288306749 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff19013c490 0x7ff19013e870 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.715+0000 7ff196b93700 1 --2- 172.21.15.40:0/1288306749 >> v2:172.21.15.40:3300/0 conn(0x7ff19006a6d0 0x7ff19009d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.715+0000 7ff196b93700 1 --2- 172.21.15.40:0/1288306749 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff19009de60 0x7ff19009e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.715+0000 7ff196b93700 1 -- 172.21.15.40:0/1288306749 >> 172.21.15.40:0/1288306749 conn(0x7ff19009fb20 msgr2=0x7ff19009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:59.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.715+0000 7ff196b93700 1 -- 172.21.15.40:0/1288306749 shutdown_connections 2023-09-30T22:24:59.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.715+0000 7ff196b93700 1 -- 172.21.15.40:0/1288306749 wait complete. 2023-09-30T22:24:59.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.717+0000 7ff196b93700 1 Processor -- start 2023-09-30T22:24:59.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.717+0000 7ff196b93700 1 -- start start 2023-09-30T22:24:59.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.718+0000 7ff196b93700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff19006a6d0 0x7ff1901208d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.718+0000 7ff196b93700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff19009de60 0x7ff19013a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.718+0000 7ff196b93700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff19013c490 0x7ff19013ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.718+0000 7ff196b93700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1901201f0 con 0x7ff19006a6d0 2023-09-30T22:24:59.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.718+0000 7ff196b93700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1901203d0 con 0x7ff19009de60 2023-09-30T22:24:59.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.718+0000 7ff196b93700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff19013bd60 con 0x7ff19013c490 2023-09-30T22:24:59.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.718+0000 7ff19492f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff19006a6d0 0x7ff1901208d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.718+0000 7ff18ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff19009de60 0x7ff19013a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.718+0000 7ff19492f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff19006a6d0 0x7ff1901208d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54610/0 (socket says 172.21.15.40:54610) 2023-09-30T22:24:59.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.718+0000 7ff19492f700 1 -- 172.21.15.40:0/1156738695 learned_addr learned my addr 172.21.15.40:0/1156738695 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:59.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.718+0000 7ff195130700 1 --2- 172.21.15.40:0/1156738695 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff19013c490 0x7ff19013ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.718+0000 7ff18ffff700 1 -- 172.21.15.40:0/1156738695 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff19013c490 msgr2=0x7ff19013ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.718+0000 7ff18ffff700 1 --2- 172.21.15.40:0/1156738695 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff19013c490 0x7ff19013ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.718+0000 7ff18ffff700 1 -- 172.21.15.40:0/1156738695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff19006a6d0 msgr2=0x7ff1901208d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.718+0000 7ff18ffff700 1 --2- 172.21.15.40:0/1156738695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff19006a6d0 0x7ff1901208d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.718+0000 7ff18ffff700 1 -- 172.21.15.40:0/1156738695 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17c009550 con 0x7ff19009de60 2023-09-30T22:24:59.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.719+0000 7ff18ffff700 1 --2- 172.21.15.40:0/1156738695 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff19009de60 0x7ff19013a920 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff17c00e9d0 tx=0x7ff17c00ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:59.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.719+0000 7ff18d7fa700 1 -- 172.21.15.40:0/1156738695 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c00ee70 con 0x7ff19009de60 2023-09-30T22:24:59.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.719+0000 7ff18d7fa700 1 -- 172.21.15.40:0/1156738695 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17c004030 con 0x7ff19009de60 2023-09-30T22:24:59.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.719+0000 7ff196b93700 1 -- 172.21.15.40:0/1156738695 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff188009a70 con 0x7ff19009de60 2023-09-30T22:24:59.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.719+0000 7ff18d7fa700 1 -- 172.21.15.40:0/1156738695 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c0043c0 con 0x7ff19009de60 2023-09-30T22:24:59.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.719+0000 7ff196b93700 1 -- 172.21.15.40:0/1156738695 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff190071a10 con 0x7ff19009de60 2023-09-30T22:24:59.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.720+0000 7ff18d7fa700 1 -- 172.21.15.40:0/1156738695 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff17c00c850 con 0x7ff19009de60 2023-09-30T22:24:59.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.720+0000 7ff18d7fa700 1 -- 172.21.15.40:0/1156738695 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7ff17c03fa80 con 0x7ff19009de60 2023-09-30T22:24:59.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.720+0000 7ff19492f700 1 -- 172.21.15.40:0/1156738695 >> v1:172.21.15.40:6816/127432 conn(0x7ff17402f510 legacy=0x7ff1740319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:24:59.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.720+0000 7ff196b93700 1 -- 172.21.15.40:0/1156738695 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff190120010 con 0x7ff19009de60 2023-09-30T22:24:59.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.723+0000 7fbcc3a63700 1 Processor -- start 2023-09-30T22:24:59.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.724+0000 7fbcc3a63700 1 -- start start 2023-09-30T22:24:59.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.724+0000 7fbcc3a63700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbcbc09d920 0x7fbcbc09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.724+0000 7fbcc3a63700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcbc09e230 0x7fbcbc1308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.724+0000 7fbcc3a63700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbcbc130de0 0x7fbcbc131280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.724+0000 7fbcc3a63700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcbc09edf0 con 0x7fbcbc130de0 2023-09-30T22:24:59.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.724+0000 7fbcc3a63700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc09adf0 con 0x7fbcbc09e230 2023-09-30T22:24:59.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.724+0000 7fbcc3a63700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc09b660 con 0x7fbcbc09d920 2023-09-30T22:24:59.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.725+0000 7fbcc0ffe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcbc09e230 0x7fbcbc1308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.725+0000 7fbcc17ff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbcbc09d920 0x7fbcbc09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.725+0000 7fbcc17ff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbcbc09d920 0x7fbcbc09dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51512/0 (socket says 172.21.15.40:51512) 2023-09-30T22:24:59.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.725+0000 7fbcc0ffe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcbc09e230 0x7fbcbc1308a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54000/0 (socket says 172.21.15.40:54000) 2023-09-30T22:24:59.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.725+0000 7fbcc2000700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbcbc130de0 0x7fbcbc131280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.725+0000 7fbcc17ff700 1 -- 172.21.15.40:0/1327570492 learned_addr learned my addr 172.21.15.40:0/1327570492 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:59.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.725+0000 7fbcc0ffe700 1 -- 172.21.15.40:0/1327570492 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbcbc09d920 msgr2=0x7fbcbc09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:59.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.725+0000 7fbcc0ffe700 1 --2- 172.21.15.40:0/1327570492 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbcbc09d920 0x7fbcbc09dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.725+0000 7fbcc0ffe700 1 -- 172.21.15.40:0/1327570492 >> v2:172.21.15.40:3300/0 conn(0x7fbcbc130de0 msgr2=0x7fbcbc131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:59.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.725+0000 7fbcc0ffe700 1 --2- 172.21.15.40:0/1327570492 >> v2:172.21.15.40:3300/0 conn(0x7fbcbc130de0 0x7fbcbc131280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.725+0000 7fbcc0ffe700 1 -- 172.21.15.40:0/1327570492 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcbc09a6e0 con 0x7fbcbc09e230 2023-09-30T22:24:59.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.725+0000 7fbcc17ff700 1 --2- 172.21.15.40:0/1327570492 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbcbc09d920 0x7fbcbc09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:59.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.725+0000 7fbcc0ffe700 1 --2- 172.21.15.40:0/1327570492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcbc09e230 0x7fbcbc1308a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbcac009840 tx=0x7fbcac009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac534c1cf0099556 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:59.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.729+0000 7fbcb3fff700 1 -- 172.21.15.40:0/1327570492 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcac011830 con 0x7fbcbc09e230 2023-09-30T22:24:59.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.729+0000 7fbcb3fff700 1 -- 172.21.15.40:0/1327570492 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcac011990 con 0x7fbcbc09e230 2023-09-30T22:24:59.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.729+0000 7fbcb3fff700 1 -- 172.21.15.40:0/1327570492 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcac011d20 con 0x7fbcbc09e230 2023-09-30T22:24:59.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.729+0000 7ff18d7fa700 1 -- 172.21.15.40:0/1156738695 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff17c019d60 con 0x7ff19009de60 2023-09-30T22:24:59.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.730+0000 7fbcc3a63700 1 -- 172.21.15.40:0/1327570492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcbc09e230 msgr2=0x7fbcbc1308a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.730+0000 7fbcc3a63700 1 --2- 172.21.15.40:0/1327570492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcbc09e230 0x7fbcbc1308a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbcac009840 tx=0x7fbcac009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:59.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.730+0000 7fbcc3a63700 1 -- 172.21.15.40:0/1327570492 shutdown_connections 2023-09-30T22:24:59.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.730+0000 7fbcc3a63700 1 --2- 172.21.15.40:0/1327570492 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbcbc09d920 0x7fbcbc09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.730+0000 7fbcc3a63700 1 --2- 172.21.15.40:0/1327570492 >> v2:172.21.15.40:3300/0 conn(0x7fbcbc130de0 0x7fbcbc131280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.730+0000 7fbcc3a63700 1 --2- 172.21.15.40:0/1327570492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcbc09e230 0x7fbcbc1308a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.730+0000 7fbcc3a63700 1 -- 172.21.15.40:0/1327570492 >> 172.21.15.40:0/1327570492 conn(0x7fbcbc09fb20 msgr2=0x7fbcbc09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:59.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.731+0000 7fbcc3a63700 1 -- 172.21.15.40:0/1327570492 shutdown_connections 2023-09-30T22:24:59.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.731+0000 7fbcc3a63700 1 -- 172.21.15.40:0/1327570492 wait complete. 2023-09-30T22:24:59.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.732+0000 7fbcc3a63700 1 Processor -- start 2023-09-30T22:24:59.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.732+0000 7fbcc3a63700 1 -- start start 2023-09-30T22:24:59.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.733+0000 7fbcc3a63700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcbc09d920 0x7fbcbc11e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.733+0000 7fbcc3a63700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbcbc09e230 0x7fbcbc11e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.733+0000 7fbcc3a63700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcbc130de0 0x7fbcbc11ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.733+0000 7fbcc3a63700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc09a210 con 0x7fbcbc09d920 2023-09-30T22:24:59.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.733+0000 7fbcc3a63700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc12f470 con 0x7fbcbc130de0 2023-09-30T22:24:59.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.733+0000 7fbcc3a63700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc124d90 con 0x7fbcbc09e230 2023-09-30T22:24:59.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.733+0000 7fbcc17ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcbc09d920 0x7fbcbc11e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.733+0000 7fbcc17ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcbc09d920 0x7fbcbc11e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54622/0 (socket says 172.21.15.40:54622) 2023-09-30T22:24:59.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.733+0000 7fbcc17ff700 1 -- 172.21.15.40:0/118200779 learned_addr learned my addr 172.21.15.40:0/118200779 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:24:59.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.733+0000 7fbcc2000700 1 --2- 172.21.15.40:0/118200779 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcbc130de0 0x7fbcbc11ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.733+0000 7fbcc17ff700 1 -- 172.21.15.40:0/118200779 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbcbc09e230 msgr2=0x7fbcbc11e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.733+0000 7fbcc17ff700 1 --2- 172.21.15.40:0/118200779 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbcbc09e230 0x7fbcbc11e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.733+0000 7fbcc17ff700 1 -- 172.21.15.40:0/118200779 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcbc130de0 msgr2=0x7fbcbc11ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.733+0000 7fbcc17ff700 1 --2- 172.21.15.40:0/118200779 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcbc130de0 0x7fbcbc11ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.733+0000 7fbcc17ff700 1 -- 172.21.15.40:0/118200779 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb8009500 con 0x7fbcbc09d920 2023-09-30T22:24:59.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.733+0000 7fbcc17ff700 1 --2- 172.21.15.40:0/118200779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcbc09d920 0x7fbcbc11e2b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbcb800ebb0 tx=0x7fbcb800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:59.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.734+0000 7fbcb1ffb700 1 -- 172.21.15.40:0/118200779 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb8005a20 con 0x7fbcbc09d920 2023-09-30T22:24:59.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.734+0000 7fbcb1ffb700 1 -- 172.21.15.40:0/118200779 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb8005b80 con 0x7fbcbc09d920 2023-09-30T22:24:59.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.734+0000 7fbcb1ffb700 1 -- 172.21.15.40:0/118200779 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb800c910 con 0x7fbcbc09d920 2023-09-30T22:24:59.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.734+0000 7fbcc3a63700 1 -- 172.21.15.40:0/118200779 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcac0094a0 con 0x7fbcbc09d920 2023-09-30T22:24:59.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.734+0000 7fbcc3a63700 1 -- 172.21.15.40:0/118200779 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcbc11f540 con 0x7fbcbc09d920 2023-09-30T22:24:59.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.735+0000 7fbcc3a63700 1 -- 172.21.15.40:0/118200779 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcbc11f7f0 con 0x7fbcbc09d920 2023-09-30T22:24:59.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.736+0000 7fbcb1ffb700 1 -- 172.21.15.40:0/118200779 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fbcb800ca70 con 0x7fbcbc09d920 2023-09-30T22:24:59.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.736+0000 7fbcc0ffe700 1 -- 172.21.15.40:0/118200779 >> v1:172.21.15.40:6816/127432 conn(0x7fbca002f510 legacy=0x7fbca00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:24:59.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.741+0000 7fbcb1ffb700 1 -- 172.21.15.40:0/118200779 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7fbcb8023530 con 0x7fbcbc09d920 2023-09-30T22:24:59.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.745+0000 7fbcb1ffb700 1 -- 172.21.15.40:0/118200779 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbcb8023740 con 0x7fbcbc09d920 2023-09-30T22:24:59.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.839+0000 7f80a4816700 1 -- 172.21.15.40:0/3685333205 >> v1:172.21.15.40:6816/127432 conn(0x7f808402f540 legacy=0x7f80840319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:24:59.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.858+0000 7f6b85616700 1 -- 172.21.15.40:0/3830685267 >> v1:172.21.15.40:6816/127432 conn(0x7f6b6402f4e0 legacy=0x7f6b64031990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:24:59.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.866+0000 7f6b8787a700 1 -- 172.21.15.40:0/3830685267 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6b8006e3c0 con 0x7f6b8006d410 2023-09-30T22:24:59.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.866+0000 7f6b75ffb700 1 -- 172.21.15.40:0/3830685267 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6b78045020 con 0x7f6b8006d410 2023-09-30T22:24:59.867 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:24:59.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.869+0000 7f6b8787a700 1 -- 172.21.15.40:0/3830685267 >> v1:172.21.15.40:6816/127432 conn(0x7f6b6402f4e0 legacy=0x7f6b64031990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:59.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.869+0000 7f6b8787a700 1 -- 172.21.15.40:0/3830685267 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b8006d410 msgr2=0x7f6b801bcb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.869+0000 7f6b8787a700 1 --2- 172.21.15.40:0/3830685267 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b8006d410 0x7f6b801bcb10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6b7800cbb0 tx=0x7f6b7800cec0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.869+0000 7f6b8787a700 1 -- 172.21.15.40:0/3830685267 shutdown_connections 2023-09-30T22:24:59.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.869+0000 7f6b8787a700 1 --2- 172.21.15.40:0/3830685267 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b8006d410 0x7f6b801bcb10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.869+0000 7f6b8787a700 1 --2- 172.21.15.40:0/3830685267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b6c004140 0x7f6b801bc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.869+0000 7f6b8787a700 1 --2- 172.21.15.40:0/3830685267 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b6c004eb0 0x7f6b801bc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.869+0000 7f6b8787a700 1 -- 172.21.15.40:0/3830685267 >> 172.21.15.40:0/3830685267 conn(0x7f6b800a41a0 msgr2=0x7f6b8006f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:59.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.870+0000 7f6b8787a700 1 -- 172.21.15.40:0/3830685267 shutdown_connections 2023-09-30T22:24:59.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.870+0000 7f6b8787a700 1 -- 172.21.15.40:0/3830685267 wait complete. 2023-09-30T22:24:59.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.877+0000 7f80a6a7a700 1 -- 172.21.15.40:0/3685333205 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f80a0071980 con 0x7f80a013b5c0 2023-09-30T22:24:59.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.878+0000 7f809d7fa700 1 -- 172.21.15.40:0/3685333205 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8098019300 con 0x7f80a013b5c0 2023-09-30T22:24:59.878 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:24:59.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.880+0000 7f80a6a7a700 1 -- 172.21.15.40:0/3685333205 >> v1:172.21.15.40:6816/127432 conn(0x7f808402f540 legacy=0x7f80840319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:59.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.880+0000 7f80a6a7a700 1 -- 172.21.15.40:0/3685333205 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f80a013b5c0 msgr2=0x7f80a01c8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.880+0000 7f80a6a7a700 1 --2- 172.21.15.40:0/3685333205 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f80a013b5c0 0x7f80a01c8680 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f809800cc50 tx=0x7f809800cf60 comp rx=0 tx=0).stop 2023-09-30T22:24:59.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.880+0000 7f80a6a7a700 1 -- 172.21.15.40:0/3685333205 shutdown_connections 2023-09-30T22:24:59.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.880+0000 7f80a6a7a700 1 --2- 172.21.15.40:0/3685333205 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f80a013b5c0 0x7f80a01c8680 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.880+0000 7f80a6a7a700 1 --2- 172.21.15.40:0/3685333205 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f80a012d6d0 0x7f80a013ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.880+0000 7f80a6a7a700 1 --2- 172.21.15.40:0/3685333205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80a012eea0 0x7f80a013b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.880+0000 7f80a6a7a700 1 -- 172.21.15.40:0/3685333205 >> 172.21.15.40:0/3685333205 conn(0x7f80a00a2a00 msgr2=0x7f80a0130d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:59.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.880+0000 7f80a6a7a700 1 -- 172.21.15.40:0/3685333205 shutdown_connections 2023-09-30T22:24:59.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.880+0000 7f80a6a7a700 1 -- 172.21.15.40:0/3685333205 wait complete. 2023-09-30T22:24:59.888 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:24:59.893 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:24:59.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.921+0000 7ff19492f700 1 -- 172.21.15.40:0/1156738695 >> v1:172.21.15.40:6816/127432 conn(0x7ff17402f510 legacy=0x7ff1740319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:24:59.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.937+0000 7fbcc0ffe700 1 -- 172.21.15.40:0/118200779 >> v1:172.21.15.40:6816/127432 conn(0x7fbca002f510 legacy=0x7fbca00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:24:59.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.937+0000 7ff196b93700 1 -- 172.21.15.40:0/1156738695 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff190062380 con 0x7ff19009de60 2023-09-30T22:24:59.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.937+0000 7ff18d7fa700 1 -- 172.21.15.40:0/1156738695 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff17c019300 con 0x7ff19009de60 2023-09-30T22:24:59.938 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:24:59.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.939+0000 7ff196b93700 1 -- 172.21.15.40:0/1156738695 >> v1:172.21.15.40:6816/127432 conn(0x7ff17402f510 legacy=0x7ff1740319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:59.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.939+0000 7ff196b93700 1 -- 172.21.15.40:0/1156738695 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff19009de60 msgr2=0x7ff19013a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.939+0000 7ff196b93700 1 --2- 172.21.15.40:0/1156738695 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff19009de60 0x7ff19013a920 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff17c00e9d0 tx=0x7ff17c00ece0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.939+0000 7ff196b93700 1 -- 172.21.15.40:0/1156738695 shutdown_connections 2023-09-30T22:24:59.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.939+0000 7ff196b93700 1 --2- 172.21.15.40:0/1156738695 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff19013c490 0x7ff19013ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.939+0000 7ff196b93700 1 --2- 172.21.15.40:0/1156738695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff19006a6d0 0x7ff1901208d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.939+0000 7ff196b93700 1 --2- 172.21.15.40:0/1156738695 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff19009de60 0x7ff19013a920 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.939+0000 7ff196b93700 1 -- 172.21.15.40:0/1156738695 >> 172.21.15.40:0/1156738695 conn(0x7ff19009fb20 msgr2=0x7ff1900a2200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:59.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.939+0000 7ff196b93700 1 -- 172.21.15.40:0/1156738695 shutdown_connections 2023-09-30T22:24:59.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.939+0000 7ff196b93700 1 -- 172.21.15.40:0/1156738695 wait complete. 2023-09-30T22:24:59.952 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:24:59.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.954+0000 7fbcc3a63700 1 -- 172.21.15.40:0/118200779 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbcbc062380 con 0x7fbcbc09d920 2023-09-30T22:24:59.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.954+0000 7fbcb1ffb700 1 -- 172.21.15.40:0/118200779 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbcb8020020 con 0x7fbcbc09d920 2023-09-30T22:24:59.955 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:24:59.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.956+0000 7fbcc3a63700 1 -- 172.21.15.40:0/118200779 >> v1:172.21.15.40:6816/127432 conn(0x7fbca002f510 legacy=0x7fbca00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:59.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.956+0000 7fbcc3a63700 1 -- 172.21.15.40:0/118200779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcbc09d920 msgr2=0x7fbcbc11e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.956+0000 7fbcc3a63700 1 --2- 172.21.15.40:0/118200779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcbc09d920 0x7fbcbc11e2b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbcb800ebb0 tx=0x7fbcb800eec0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.956+0000 7fbcc3a63700 1 -- 172.21.15.40:0/118200779 shutdown_connections 2023-09-30T22:24:59.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.956+0000 7fbcc3a63700 1 --2- 172.21.15.40:0/118200779 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcbc130de0 0x7fbcbc11ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.956+0000 7fbcc3a63700 1 --2- 172.21.15.40:0/118200779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcbc09d920 0x7fbcbc11e2b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.956+0000 7fbcc3a63700 1 --2- 172.21.15.40:0/118200779 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbcbc09e230 0x7fbcbc11e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.956+0000 7fbcc3a63700 1 -- 172.21.15.40:0/118200779 >> 172.21.15.40:0/118200779 conn(0x7fbcbc09fb20 msgr2=0x7fbcbc06df50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:59.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.956+0000 7fbcc3a63700 1 -- 172.21.15.40:0/118200779 shutdown_connections 2023-09-30T22:24:59.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:24:59.956+0000 7fbcc3a63700 1 -- 172.21.15.40:0/118200779 wait complete. 2023-09-30T22:24:59.969 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:00.889 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:00.893 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:00.953 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:00.970 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:01.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.039+0000 7f9a1397e700 1 Processor -- start 2023-09-30T22:25:01.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.039+0000 7f9a1397e700 1 -- start start 2023-09-30T22:25:01.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.040+0000 7f9a1397e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a0c131d50 0x7f9a0c132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.040+0000 7f9a1397e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9a0c09bc50 0x7f9a0c09c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.040+0000 7f9a1397e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9a0c09c600 0x7f9a0c138ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.040+0000 7f9a1397e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a0c09cb00 con 0x7f9a0c09c600 2023-09-30T22:25:01.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.040+0000 7f9a1397e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c071920 con 0x7f9a0c131d50 2023-09-30T22:25:01.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.040+0000 7f9a1397e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c132660 con 0x7f9a0c09bc50 2023-09-30T22:25:01.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.040+0000 7f9a1171a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a0c131d50 0x7f9a0c132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.040+0000 7f9a1171a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a0c131d50 0x7f9a0c132120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54004/0 (socket says 172.21.15.40:54004) 2023-09-30T22:25:01.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.040+0000 7f9a1171a700 1 -- 172.21.15.40:0/3358999532 learned_addr learned my addr 172.21.15.40:0/3358999532 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:01.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.040+0000 7f9a10f19700 1 --2- 172.21.15.40:0/3358999532 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9a0c09bc50 0x7f9a0c09c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.040+0000 7f9a1171a700 1 -- 172.21.15.40:0/3358999532 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9a0c09bc50 msgr2=0x7f9a0c09c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:01.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.040+0000 7f9a1171a700 1 --2- 172.21.15.40:0/3358999532 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9a0c09bc50 0x7f9a0c09c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.040+0000 7f9a1171a700 1 -- 172.21.15.40:0/3358999532 >> v2:172.21.15.40:3300/0 conn(0x7f9a0c09c600 msgr2=0x7f9a0c138ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:01.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.040+0000 7f9a1171a700 1 --2- 172.21.15.40:0/3358999532 >> v2:172.21.15.40:3300/0 conn(0x7f9a0c09c600 0x7f9a0c138ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.040+0000 7f9a1171a700 1 -- 172.21.15.40:0/3358999532 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0c131900 con 0x7f9a0c131d50 2023-09-30T22:25:01.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.041+0000 7f9a1171a700 1 --2- 172.21.15.40:0/3358999532 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a0c131d50 0x7f9a0c132120 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9a080098f0 tx=0x7f9a08009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0d1cf3fb9b6cd8a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:01.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.041+0000 7f9a03fff700 1 -- 172.21.15.40:0/3358999532 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a08010a90 con 0x7f9a0c131d50 2023-09-30T22:25:01.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.041+0000 7f9a03fff700 1 -- 172.21.15.40:0/3358999532 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a08010bf0 con 0x7f9a0c131d50 2023-09-30T22:25:01.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.041+0000 7f9a03fff700 1 -- 172.21.15.40:0/3358999532 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a08018440 con 0x7f9a0c131d50 2023-09-30T22:25:01.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.042+0000 7f9a1397e700 1 -- 172.21.15.40:0/3358999532 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a0c131d50 msgr2=0x7f9a0c132120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.042+0000 7f9a1397e700 1 --2- 172.21.15.40:0/3358999532 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a0c131d50 0x7f9a0c132120 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9a080098f0 tx=0x7f9a08009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:01.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.042+0000 7f9a1397e700 1 -- 172.21.15.40:0/3358999532 shutdown_connections 2023-09-30T22:25:01.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.042+0000 7f9a1397e700 1 --2- 172.21.15.40:0/3358999532 >> v2:172.21.15.40:3300/0 conn(0x7f9a0c09c600 0x7f9a0c138ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.042+0000 7f9a1397e700 1 --2- 172.21.15.40:0/3358999532 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a0c131d50 0x7f9a0c132120 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.042+0000 7f9a1397e700 1 --2- 172.21.15.40:0/3358999532 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9a0c09bc50 0x7f9a0c09c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.042+0000 7f9a1397e700 1 -- 172.21.15.40:0/3358999532 >> 172.21.15.40:0/3358999532 conn(0x7f9a0c0a2a00 msgr2=0x7f9a0c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:01.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.042+0000 7f9a1397e700 1 -- 172.21.15.40:0/3358999532 shutdown_connections 2023-09-30T22:25:01.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.042+0000 7f9a1397e700 1 -- 172.21.15.40:0/3358999532 wait complete. 2023-09-30T22:25:01.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.043+0000 7f9a1397e700 1 Processor -- start 2023-09-30T22:25:01.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.043+0000 7f9a1397e700 1 -- start start 2023-09-30T22:25:01.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.043+0000 7f9a1397e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9a0c09bc50 0x7f9a0c1cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.043+0000 7f9a1397e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a0c09c600 0x7f9a0c1ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.044+0000 7f9a1397e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a0c131d50 0x7f9a0c1cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.044+0000 7f9a1397e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c09eaf0 con 0x7f9a0c131d50 2023-09-30T22:25:01.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.044+0000 7f9a1397e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c123630 con 0x7f9a0c09c600 2023-09-30T22:25:01.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.044+0000 7f9a1397e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c121c30 con 0x7f9a0c09bc50 2023-09-30T22:25:01.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.044+0000 7f9a10f19700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a0c09c600 0x7f9a0c1ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.044+0000 7f9a10f19700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a0c09c600 0x7f9a0c1ccf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54012/0 (socket says 172.21.15.40:54012) 2023-09-30T22:25:01.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.044+0000 7f9a10f19700 1 -- 172.21.15.40:0/1587425193 learned_addr learned my addr 172.21.15.40:0/1587425193 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:01.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.044+0000 7f9a11f1b700 1 --2- 172.21.15.40:0/1587425193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a0c131d50 0x7f9a0c1cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.044+0000 7f9a1171a700 1 --2- 172.21.15.40:0/1587425193 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9a0c09bc50 0x7f9a0c1cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.044+0000 7f9a10f19700 1 -- 172.21.15.40:0/1587425193 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9a0c09bc50 msgr2=0x7f9a0c1cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.044+0000 7f9a10f19700 1 --2- 172.21.15.40:0/1587425193 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9a0c09bc50 0x7f9a0c1cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.044+0000 7f9a10f19700 1 -- 172.21.15.40:0/1587425193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a0c131d50 msgr2=0x7f9a0c1cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.044+0000 7f9a10f19700 1 --2- 172.21.15.40:0/1587425193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a0c131d50 0x7f9a0c1cd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.044+0000 7f9a10f19700 1 -- 172.21.15.40:0/1587425193 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a08009550 con 0x7f9a0c09c600 2023-09-30T22:25:01.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.044+0000 7f9a1171a700 1 --2- 172.21.15.40:0/1587425193 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9a0c09bc50 0x7f9a0c1cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:01.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.044+0000 7f9a10f19700 1 --2- 172.21.15.40:0/1587425193 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a0c09c600 0x7f9a0c1ccf90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00e870 tx=0x7f99fc00eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:01.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.045+0000 7f9a01ffb700 1 -- 172.21.15.40:0/1587425193 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc009590 con 0x7f9a0c09c600 2023-09-30T22:25:01.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.045+0000 7f9a1397e700 1 -- 172.21.15.40:0/1587425193 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a0c122ff0 con 0x7f9a0c09c600 2023-09-30T22:25:01.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.045+0000 7f9a01ffb700 1 -- 172.21.15.40:0/1587425193 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99fc013680 con 0x7f9a0c09c600 2023-09-30T22:25:01.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.045+0000 7f9a01ffb700 1 -- 172.21.15.40:0/1587425193 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc013a10 con 0x7f9a0c09c600 2023-09-30T22:25:01.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.046+0000 7f9a1397e700 1 -- 172.21.15.40:0/1587425193 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a0c12a530 con 0x7f9a0c09c600 2023-09-30T22:25:01.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.046+0000 7f9a01ffb700 1 -- 172.21.15.40:0/1587425193 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f99fc013b70 con 0x7f9a0c09c600 2023-09-30T22:25:01.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.046+0000 7f9a01ffb700 1 -- 172.21.15.40:0/1587425193 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f99fc040540 con 0x7f9a0c09c600 2023-09-30T22:25:01.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.046+0000 7f9a1171a700 1 -- 172.21.15.40:0/1587425193 >> v1:172.21.15.40:6816/127432 conn(0x7f99f002f510 legacy=0x7f99f00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:01.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.047+0000 7f9a1397e700 1 -- 172.21.15.40:0/1587425193 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a0c1233c0 con 0x7f9a0c09c600 2023-09-30T22:25:01.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.052+0000 7f9a01ffb700 1 -- 172.21.15.40:0/1587425193 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f99fc01bbe0 con 0x7f9a0c09c600 2023-09-30T22:25:01.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.079+0000 7fb2f6e25700 1 Processor -- start 2023-09-30T22:25:01.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.079+0000 7fb2f6e25700 1 -- start start 2023-09-30T22:25:01.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.080+0000 7fb2f6e25700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2f0131d50 0x7fb2f0132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.080+0000 7fb2f6e25700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb2f009c7d0 0x7fb2f0139ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.080+0000 7fb2f6e25700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2f0132660 con 0x7fb2f009bc50 2023-09-30T22:25:01.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.080+0000 7fb2f6e25700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2f00719b0 con 0x7fb2f009c7d0 2023-09-30T22:25:01.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.080+0000 7fb2f6e25700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f0131900 con 0x7fb2f0131d50 2023-09-30T22:25:01.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.080+0000 7fb2f53c2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb2f009c7d0 0x7fb2f0139ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.080+0000 7fb2f53c2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb2f009c7d0 0x7fb2f0139ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54636/0 (socket says 172.21.15.40:54636) 2023-09-30T22:25:01.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.080+0000 7fb2f53c2700 1 -- 172.21.15.40:0/3816835512 learned_addr learned my addr 172.21.15.40:0/3816835512 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:01.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.080+0000 7fb2f4bc1700 1 --2- 172.21.15.40:0/3816835512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2f0131d50 0x7fb2f0132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.080+0000 7fb2f53c2700 1 -- 172.21.15.40:0/3816835512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2f0131d50 msgr2=0x7fb2f0132120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:01.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.080+0000 7fb2f53c2700 1 --2- 172.21.15.40:0/3816835512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2f0131d50 0x7fb2f0132120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.080+0000 7fb2ef7fe700 1 -- 172.21.15.40:0/3816835512 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2339515801 0 0) 0x7fb2f0132660 con 0x7fb2f009bc50 2023-09-30T22:25:01.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.080+0000 7fb2f53c2700 1 -- 172.21.15.40:0/3816835512 >> v1:172.21.15.40:6789/0 conn(0x7fb2f009bc50 legacy=0x7fb2f009c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.080+0000 7fb2f53c2700 1 -- 172.21.15.40:0/3816835512 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f009e820 con 0x7fb2f009c7d0 2023-09-30T22:25:01.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.081+0000 7fb2f53c2700 1 --2- 172.21.15.40:0/3816835512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2f009c7d0 0x7fb2f0139ac0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8009e50 tx=0x7fb2e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc9a4ddf7a77b659 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:01.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.081+0000 7fb2ef7fe700 1 -- 172.21.15.40:0/3816835512 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e800e070 con 0x7fb2f009c7d0 2023-09-30T22:25:01.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.081+0000 7fb2ef7fe700 1 -- 172.21.15.40:0/3816835512 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e800b910 con 0x7fb2f009c7d0 2023-09-30T22:25:01.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.081+0000 7fb2ef7fe700 1 -- 172.21.15.40:0/3816835512 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e800bcc0 con 0x7fb2f009c7d0 2023-09-30T22:25:01.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.082+0000 7fb2f6e25700 1 -- 172.21.15.40:0/3816835512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2f009c7d0 msgr2=0x7fb2f0139ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.082+0000 7fb2f6e25700 1 --2- 172.21.15.40:0/3816835512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2f009c7d0 0x7fb2f0139ac0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8009e50 tx=0x7fb2e800b330 comp rx=0 tx=0).stop 2023-09-30T22:25:01.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.082+0000 7fb2f6e25700 1 -- 172.21.15.40:0/3816835512 shutdown_connections 2023-09-30T22:25:01.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.082+0000 7fb2f6e25700 1 --2- 172.21.15.40:0/3816835512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2f009c7d0 0x7fb2f0139ac0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.082+0000 7fb2f6e25700 1 --2- 172.21.15.40:0/3816835512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2f0131d50 0x7fb2f0132120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.082+0000 7fb2f6e25700 1 -- 172.21.15.40:0/3816835512 >> 172.21.15.40:0/3816835512 conn(0x7fb2f00a2a00 msgr2=0x7fb2f00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:01.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.082+0000 7fb2f6e25700 1 -- 172.21.15.40:0/3816835512 shutdown_connections 2023-09-30T22:25:01.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.082+0000 7fb2f6e25700 1 -- 172.21.15.40:0/3816835512 wait complete. 2023-09-30T22:25:01.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.083+0000 7fb2f6e25700 1 Processor -- start 2023-09-30T22:25:01.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.083+0000 7fb2f6e25700 1 -- start start 2023-09-30T22:25:01.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.083+0000 7fb2f6e25700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2f009bc50 0x7fb2f01c3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.083+0000 7fb2f6e25700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2f009c7d0 0x7fb2f01c37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.083+0000 7fb2f6e25700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb2f0131d50 0x7fb2f0119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.083+0000 7fb2f6e25700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f012bfd0 con 0x7fb2f009c7d0 2023-09-30T22:25:01.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.083+0000 7fb2f6e25700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f01c2e40 con 0x7fb2f009bc50 2023-09-30T22:25:01.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.083+0000 7fb2f6e25700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f01c2ba0 con 0x7fb2f0131d50 2023-09-30T22:25:01.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.083+0000 7fb2effff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2f009c7d0 0x7fb2f01c37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.083+0000 7fb2f4bc1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2f009bc50 0x7fb2f01c3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.083+0000 7fb2effff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2f009c7d0 0x7fb2f01c37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54638/0 (socket says 172.21.15.40:54638) 2023-09-30T22:25:01.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.083+0000 7fb2effff700 1 -- 172.21.15.40:0/1022470182 learned_addr learned my addr 172.21.15.40:0/1022470182 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:01.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.084+0000 7fb2f53c2700 1 --2- 172.21.15.40:0/1022470182 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb2f0131d50 0x7fb2f0119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.084+0000 7fb2effff700 1 -- 172.21.15.40:0/1022470182 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb2f0131d50 msgr2=0x7fb2f0119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.084+0000 7fb2effff700 1 --2- 172.21.15.40:0/1022470182 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb2f0131d50 0x7fb2f0119050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.084+0000 7fb2effff700 1 -- 172.21.15.40:0/1022470182 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2f009bc50 msgr2=0x7fb2f01c3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.084+0000 7fb2effff700 1 --2- 172.21.15.40:0/1022470182 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2f009bc50 0x7fb2f01c3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.084+0000 7fb2effff700 1 -- 172.21.15.40:0/1022470182 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e8009b30 con 0x7fb2f009c7d0 2023-09-30T22:25:01.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.084+0000 7fb2effff700 1 --2- 172.21.15.40:0/1022470182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2f009c7d0 0x7fb2f01c37b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc00c450 tx=0x7fb2dc00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:01.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.084+0000 7fb2ed7fa700 1 -- 172.21.15.40:0/1022470182 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc0054e0 con 0x7fb2f009c7d0 2023-09-30T22:25:01.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.084+0000 7fb2ed7fa700 1 -- 172.21.15.40:0/1022470182 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2dc00ce60 con 0x7fb2f009c7d0 2023-09-30T22:25:01.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.084+0000 7fb2ed7fa700 1 -- 172.21.15.40:0/1022470182 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc0038a0 con 0x7fb2f009c7d0 2023-09-30T22:25:01.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.085+0000 7fb2f6e25700 1 -- 172.21.15.40:0/1022470182 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f011bd30 con 0x7fb2f009c7d0 2023-09-30T22:25:01.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.085+0000 7fb2f6e25700 1 -- 172.21.15.40:0/1022470182 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f011c270 con 0x7fb2f009c7d0 2023-09-30T22:25:01.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.086+0000 7fb2ed7fa700 1 -- 172.21.15.40:0/1022470182 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb2dc003a00 con 0x7fb2f009c7d0 2023-09-30T22:25:01.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.087+0000 7fb2ed7fa700 1 -- 172.21.15.40:0/1022470182 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7fb2dc03ef90 con 0x7fb2f009c7d0 2023-09-30T22:25:01.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.087+0000 7fb2f4bc1700 1 -- 172.21.15.40:0/1022470182 >> v1:172.21.15.40:6816/127432 conn(0x7fb2d402f510 legacy=0x7fb2d40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:01.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.086+0000 7fb2f6e25700 1 -- 172.21.15.40:0/1022470182 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f011b0d0 con 0x7fb2f009c7d0 2023-09-30T22:25:01.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.091+0000 7fb2ed7fa700 1 -- 172.21.15.40:0/1022470182 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb2dc017070 con 0x7fb2f009c7d0 2023-09-30T22:25:01.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.116+0000 7fe04b363700 1 Processor -- start 2023-09-30T22:25:01.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.117+0000 7fe04b363700 1 -- start start 2023-09-30T22:25:01.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.117+0000 7fe04b363700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe04409d920 0x7fe04409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.117+0000 7fe04b363700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe044130fb0 0x7fe044138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.117+0000 7fe04b363700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe04409adf0 con 0x7fe04409e230 2023-09-30T22:25:01.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.117+0000 7fe04b363700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe04409edf0 con 0x7fe04409d920 2023-09-30T22:25:01.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.117+0000 7fe04b363700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe04409b660 con 0x7fe044130fb0 2023-09-30T22:25:01.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.117+0000 7fe049900700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe044130fb0 0x7fe044138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.117+0000 7fe049900700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe044130fb0 0x7fe044138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51572/0 (socket says 172.21.15.40:51572) 2023-09-30T22:25:01.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.117+0000 7fe049900700 1 -- 172.21.15.40:0/2949453589 learned_addr learned my addr 172.21.15.40:0/2949453589 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:01.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.118+0000 7fe0490ff700 1 --2- 172.21.15.40:0/2949453589 >> v2:172.21.15.40:3300/0 conn(0x7fe04409d920 0x7fe04409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.118+0000 7fe049900700 1 -- 172.21.15.40:0/2949453589 >> v2:172.21.15.40:3300/0 conn(0x7fe04409d920 msgr2=0x7fe04409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:01.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.118+0000 7fe049900700 1 --2- 172.21.15.40:0/2949453589 >> v2:172.21.15.40:3300/0 conn(0x7fe04409d920 0x7fe04409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.118+0000 7fe049900700 1 -- 172.21.15.40:0/2949453589 >> v1:172.21.15.40:6789/0 conn(0x7fe04409e230 legacy=0x7fe0441308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.118+0000 7fe049900700 1 -- 172.21.15.40:0/2949453589 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04409a6e0 con 0x7fe044130fb0 2023-09-30T22:25:01.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.118+0000 7fe0490ff700 1 --2- 172.21.15.40:0/2949453589 >> v2:172.21.15.40:3300/0 conn(0x7fe04409d920 0x7fe04409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:01.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.118+0000 7fe049900700 1 --2- 172.21.15.40:0/2949453589 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe044130fb0 0x7fe044138d10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe03c00d150 tx=0x7fe03c00d460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c60b4f4b08e0c95 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:01.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.118+0000 7fe03bfff700 1 -- 172.21.15.40:0/2949453589 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c010070 con 0x7fe044130fb0 2023-09-30T22:25:01.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.118+0000 7fe03bfff700 1 -- 172.21.15.40:0/2949453589 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03c00ddc0 con 0x7fe044130fb0 2023-09-30T22:25:01.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.118+0000 7fe03bfff700 1 -- 172.21.15.40:0/2949453589 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c00b310 con 0x7fe044130fb0 2023-09-30T22:25:01.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.119+0000 7fe04b363700 1 -- 172.21.15.40:0/2949453589 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe044130fb0 msgr2=0x7fe044138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.119+0000 7fe04b363700 1 --2- 172.21.15.40:0/2949453589 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe044130fb0 0x7fe044138d10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe03c00d150 tx=0x7fe03c00d460 comp rx=0 tx=0).stop 2023-09-30T22:25:01.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.119+0000 7fe04b363700 1 -- 172.21.15.40:0/2949453589 shutdown_connections 2023-09-30T22:25:01.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.119+0000 7fe04b363700 1 --2- 172.21.15.40:0/2949453589 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe044130fb0 0x7fe044138d10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.119+0000 7fe04b363700 1 --2- 172.21.15.40:0/2949453589 >> v2:172.21.15.40:3300/0 conn(0x7fe04409d920 0x7fe04409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.119+0000 7fe04b363700 1 -- 172.21.15.40:0/2949453589 >> 172.21.15.40:0/2949453589 conn(0x7fe04409fb20 msgr2=0x7fe04409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:01.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.119+0000 7fe04b363700 1 -- 172.21.15.40:0/2949453589 shutdown_connections 2023-09-30T22:25:01.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.119+0000 7fe04b363700 1 -- 172.21.15.40:0/2949453589 wait complete. 2023-09-30T22:25:01.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.121+0000 7fe04b363700 1 Processor -- start 2023-09-30T22:25:01.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.121+0000 7fe04b363700 1 -- start start 2023-09-30T22:25:01.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.122+0000 7fe04b363700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe04409d920 0x7fe04411d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.122+0000 7fe04b363700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe04409e230 0x7fe04411d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.122+0000 7fe04b363700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe044130fb0 0x7fe04411db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.122+0000 7fe04b363700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04411ed00 con 0x7fe044130fb0 2023-09-30T22:25:01.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.122+0000 7fe04b363700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe04411ff50 con 0x7fe04409d920 2023-09-30T22:25:01.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.122+0000 7fe04b363700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe04411f2e0 con 0x7fe04409e230 2023-09-30T22:25:01.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.122+0000 7fe0488fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe04409e230 0x7fe04411d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.122+0000 7fe049900700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe044130fb0 0x7fe04411db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.122+0000 7fe0488fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe04409e230 0x7fe04411d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51576/0 (socket says 172.21.15.40:51576) 2023-09-30T22:25:01.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.122+0000 7fe0488fe700 1 -- 172.21.15.40:0/1345394157 learned_addr learned my addr 172.21.15.40:0/1345394157 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:01.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.122+0000 7fe0488fe700 1 -- 172.21.15.40:0/1345394157 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe04409d920 msgr2=0x7fe04411d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.122+0000 7fe0488fe700 1 --2- 172.21.15.40:0/1345394157 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe04409d920 0x7fe04411d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.122+0000 7fe0488fe700 1 -- 172.21.15.40:0/1345394157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe044130fb0 msgr2=0x7fe04411db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.122+0000 7fe0488fe700 1 --2- 172.21.15.40:0/1345394157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe044130fb0 0x7fe04411db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.122+0000 7fe0488fe700 1 -- 172.21.15.40:0/1345394157 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe03c00bd40 con 0x7fe04409e230 2023-09-30T22:25:01.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.122+0000 7fe049900700 1 --2- 172.21.15.40:0/1345394157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe044130fb0 0x7fe04411db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:01.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.122+0000 7fe0488fe700 1 --2- 172.21.15.40:0/1345394157 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe04409e230 0x7fe04411d630 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe03400c4e0 tx=0x7fe03400c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:01.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.123+0000 7fe039ffb700 1 -- 172.21.15.40:0/1345394157 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0340052d0 con 0x7fe04409e230 2023-09-30T22:25:01.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.123+0000 7fe039ffb700 1 -- 172.21.15.40:0/1345394157 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe034005430 con 0x7fe04409e230 2023-09-30T22:25:01.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.123+0000 7fe04b363700 1 -- 172.21.15.40:0/1345394157 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe044120930 con 0x7fe04409e230 2023-09-30T22:25:01.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.123+0000 7fe039ffb700 1 -- 172.21.15.40:0/1345394157 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0340038c0 con 0x7fe04409e230 2023-09-30T22:25:01.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.123+0000 7fe04b363700 1 -- 172.21.15.40:0/1345394157 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe04409cb00 con 0x7fe04409e230 2023-09-30T22:25:01.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.124+0000 7fe039ffb700 1 -- 172.21.15.40:0/1345394157 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe034003a20 con 0x7fe04409e230 2023-09-30T22:25:01.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.124+0000 7fe039ffb700 1 -- 172.21.15.40:0/1345394157 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7fe03403fe40 con 0x7fe04409e230 2023-09-30T22:25:01.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.124+0000 7fe0490ff700 1 -- 172.21.15.40:0/1345394157 >> v1:172.21.15.40:6816/127432 conn(0x7fe02802f540 legacy=0x7fe0280319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:01.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.128+0000 7fe04b363700 1 -- 172.21.15.40:0/1345394157 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe044062380 con 0x7fe04409e230 2023-09-30T22:25:01.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.128+0000 7f96e2b14700 1 Processor -- start 2023-09-30T22:25:01.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.128+0000 7f96e2b14700 1 -- start start 2023-09-30T22:25:01.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.129+0000 7f96e2b14700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f96dc09fbb0 0x7f96dc06c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.129+0000 7f96e2b14700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f96dc06ced0 0x7f96dc06d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.129+0000 7f96e2b14700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f96dc138370 0x7f96dc13a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.129+0000 7f96e2b14700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96dc09ff80 con 0x7f96dc06ced0 2023-09-30T22:25:01.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.129+0000 7f96e2b14700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96dc06ec40 con 0x7f96dc09fbb0 2023-09-30T22:25:01.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.129+0000 7f96e2b14700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96dc06f510 con 0x7f96dc138370 2023-09-30T22:25:01.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.129+0000 7f96e08b0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f96dc09fbb0 0x7f96dc06c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.129+0000 7f96e08b0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f96dc09fbb0 0x7f96dc06c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54048/0 (socket says 172.21.15.40:54048) 2023-09-30T22:25:01.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.129+0000 7f96e08b0700 1 -- 172.21.15.40:0/717347913 learned_addr learned my addr 172.21.15.40:0/717347913 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:01.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.129+0000 7f96e10b1700 1 --2- 172.21.15.40:0/717347913 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f96dc138370 0x7f96dc13a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.129+0000 7f96dbfff700 1 --2- 172.21.15.40:0/717347913 >> v2:172.21.15.40:3300/0 conn(0x7f96dc06ced0 0x7f96dc06d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.130+0000 7f96e08b0700 1 -- 172.21.15.40:0/717347913 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f96dc138370 msgr2=0x7f96dc13a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:01.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.130+0000 7f96e08b0700 1 --2- 172.21.15.40:0/717347913 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f96dc138370 0x7f96dc13a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.130+0000 7f96e08b0700 1 -- 172.21.15.40:0/717347913 >> v2:172.21.15.40:3300/0 conn(0x7f96dc06ced0 msgr2=0x7f96dc06d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:01.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.130+0000 7f96e08b0700 1 --2- 172.21.15.40:0/717347913 >> v2:172.21.15.40:3300/0 conn(0x7f96dc06ced0 0x7f96dc06d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.130+0000 7f96e08b0700 1 -- 172.21.15.40:0/717347913 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96dc06e3f0 con 0x7f96dc09fbb0 2023-09-30T22:25:01.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.130+0000 7f96e10b1700 1 --2- 172.21.15.40:0/717347913 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f96dc138370 0x7f96dc13a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:01.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.130+0000 7f96e08b0700 1 --2- 172.21.15.40:0/717347913 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f96dc09fbb0 0x7f96dc06c990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f96d0009920 tx=0x7f96d0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88c14706ef3974d8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:01.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.130+0000 7f96db7fe700 1 -- 172.21.15.40:0/717347913 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d0011830 con 0x7f96dc09fbb0 2023-09-30T22:25:01.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.130+0000 7f96db7fe700 1 -- 172.21.15.40:0/717347913 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d0011990 con 0x7f96dc09fbb0 2023-09-30T22:25:01.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.130+0000 7f96db7fe700 1 -- 172.21.15.40:0/717347913 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d0011d20 con 0x7f96dc09fbb0 2023-09-30T22:25:01.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.131+0000 7f96e2b14700 1 -- 172.21.15.40:0/717347913 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f96dc09fbb0 msgr2=0x7f96dc06c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.131+0000 7f96e2b14700 1 --2- 172.21.15.40:0/717347913 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f96dc09fbb0 0x7f96dc06c990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f96d0009920 tx=0x7f96d0009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:01.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.131+0000 7f96e2b14700 1 -- 172.21.15.40:0/717347913 shutdown_connections 2023-09-30T22:25:01.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.131+0000 7f96e2b14700 1 --2- 172.21.15.40:0/717347913 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f96dc138370 0x7f96dc13a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.131+0000 7f96e2b14700 1 --2- 172.21.15.40:0/717347913 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f96dc09fbb0 0x7f96dc06c990 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.131+0000 7f96e2b14700 1 --2- 172.21.15.40:0/717347913 >> v2:172.21.15.40:3300/0 conn(0x7f96dc06ced0 0x7f96dc06d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.131+0000 7f96e2b14700 1 -- 172.21.15.40:0/717347913 >> 172.21.15.40:0/717347913 conn(0x7f96dc0a41a0 msgr2=0x7f96dc0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:01.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.131+0000 7f96e2b14700 1 -- 172.21.15.40:0/717347913 shutdown_connections 2023-09-30T22:25:01.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.132+0000 7f96e2b14700 1 -- 172.21.15.40:0/717347913 wait complete. 2023-09-30T22:25:01.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.133+0000 7f96e2b14700 1 Processor -- start 2023-09-30T22:25:01.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.133+0000 7fe039ffb700 1 -- 172.21.15.40:0/1345394157 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe034017070 con 0x7fe04409e230 2023-09-30T22:25:01.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.133+0000 7f96e2b14700 1 -- start start 2023-09-30T22:25:01.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.134+0000 7f96e2b14700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f96dc06ced0 0x7f96dc08afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.134+0000 7f96e2b14700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f96dc09fbb0 0x7f96dc08b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.134+0000 7f96e2b14700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96dc138370 0x7f96dc08ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.134+0000 7f96e2b14700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96dc08d3d0 con 0x7f96dc138370 2023-09-30T22:25:01.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.134+0000 7f96e2b14700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96dc08cc80 con 0x7f96dc09fbb0 2023-09-30T22:25:01.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.134+0000 7f96e2b14700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96dc09f3f0 con 0x7f96dc06ced0 2023-09-30T22:25:01.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.134+0000 7f96e08b0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f96dc06ced0 0x7f96dc08afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.134+0000 7f96e08b0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f96dc06ced0 0x7f96dc08afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51598/0 (socket says 172.21.15.40:51598) 2023-09-30T22:25:01.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.134+0000 7f96e08b0700 1 -- 172.21.15.40:0/2995026161 learned_addr learned my addr 172.21.15.40:0/2995026161 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:01.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.134+0000 7f96e08b0700 1 -- 172.21.15.40:0/2995026161 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f96dc09fbb0 msgr2=0x7f96dc08b510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:01.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.134+0000 7f96e08b0700 1 --2- 172.21.15.40:0/2995026161 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f96dc09fbb0 0x7f96dc08b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.134+0000 7f96e08b0700 1 -- 172.21.15.40:0/2995026161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96dc138370 msgr2=0x7f96dc08ba50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:01.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.134+0000 7f96e08b0700 1 --2- 172.21.15.40:0/2995026161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96dc138370 0x7f96dc08ba50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.134+0000 7f96e08b0700 1 -- 172.21.15.40:0/2995026161 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d4009a70 con 0x7f96dc06ced0 2023-09-30T22:25:01.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.134+0000 7f96e08b0700 1 --2- 172.21.15.40:0/2995026161 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f96dc06ced0 0x7f96dc08afd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f96d0009c70 tx=0x7f96d0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:01.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.135+0000 7f96d97fa700 1 -- 172.21.15.40:0/2995026161 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d0004590 con 0x7f96dc06ced0 2023-09-30T22:25:01.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.135+0000 7f96d97fa700 1 -- 172.21.15.40:0/2995026161 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d00036a0 con 0x7f96dc06ced0 2023-09-30T22:25:01.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.135+0000 7f96d97fa700 1 -- 172.21.15.40:0/2995026161 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d0003a50 con 0x7f96dc06ced0 2023-09-30T22:25:01.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.135+0000 7f96e2b14700 1 -- 172.21.15.40:0/2995026161 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96d0009550 con 0x7f96dc06ced0 2023-09-30T22:25:01.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.135+0000 7f96e2b14700 1 -- 172.21.15.40:0/2995026161 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96dc08e470 con 0x7f96dc06ced0 2023-09-30T22:25:01.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.136+0000 7f96e2b14700 1 -- 172.21.15.40:0/2995026161 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96dc09b5a0 con 0x7f96dc06ced0 2023-09-30T22:25:01.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.137+0000 7f96d97fa700 1 -- 172.21.15.40:0/2995026161 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f96d0021070 con 0x7f96dc06ced0 2023-09-30T22:25:01.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.137+0000 7f96d97fa700 1 -- 172.21.15.40:0/2995026161 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f96d00413e0 con 0x7f96dc06ced0 2023-09-30T22:25:01.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.143+0000 7f96dbfff700 1 -- 172.21.15.40:0/2995026161 >> v1:172.21.15.40:6816/127432 conn(0x7f96c002f510 legacy=0x7f96c00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:01.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.146+0000 7f96d97fa700 1 -- 172.21.15.40:0/2995026161 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f96d00199a0 con 0x7f96dc06ced0 2023-09-30T22:25:01.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.247+0000 7f9a1171a700 1 -- 172.21.15.40:0/1587425193 >> v1:172.21.15.40:6816/127432 conn(0x7f99f002f510 legacy=0x7f99f00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:01.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.255+0000 7f9a1397e700 1 -- 172.21.15.40:0/1587425193 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9a0c062380 con 0x7f9a0c09c600 2023-09-30T22:25:01.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.256+0000 7f9a01ffb700 1 -- 172.21.15.40:0/1587425193 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f99fc017030 con 0x7f9a0c09c600 2023-09-30T22:25:01.256 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:01.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.259+0000 7f9a1397e700 1 -- 172.21.15.40:0/1587425193 >> v1:172.21.15.40:6816/127432 conn(0x7f99f002f510 legacy=0x7f99f00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:01.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.259+0000 7f9a1397e700 1 -- 172.21.15.40:0/1587425193 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a0c09c600 msgr2=0x7f9a0c1ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.259+0000 7f9a1397e700 1 --2- 172.21.15.40:0/1587425193 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a0c09c600 0x7f9a0c1ccf90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00e870 tx=0x7f99fc00eb80 comp rx=0 tx=0).stop 2023-09-30T22:25:01.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.259+0000 7f9a1397e700 1 -- 172.21.15.40:0/1587425193 shutdown_connections 2023-09-30T22:25:01.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.259+0000 7f9a1397e700 1 --2- 172.21.15.40:0/1587425193 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9a0c09bc50 0x7f9a0c1cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.259+0000 7f9a1397e700 1 --2- 172.21.15.40:0/1587425193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a0c131d50 0x7f9a0c1cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.259+0000 7f9a1397e700 1 --2- 172.21.15.40:0/1587425193 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a0c09c600 0x7f9a0c1ccf90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.259+0000 7f9a1397e700 1 -- 172.21.15.40:0/1587425193 >> 172.21.15.40:0/1587425193 conn(0x7f9a0c0a2a00 msgr2=0x7f9a0c0a0900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:01.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.259+0000 7f9a1397e700 1 -- 172.21.15.40:0/1587425193 shutdown_connections 2023-09-30T22:25:01.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.259+0000 7f9a1397e700 1 -- 172.21.15.40:0/1587425193 wait complete. 2023-09-30T22:25:01.277 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:01.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.288+0000 7fb2f4bc1700 1 -- 172.21.15.40:0/1022470182 >> v1:172.21.15.40:6816/127432 conn(0x7fb2d402f510 legacy=0x7fb2d40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:01.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.325+0000 7fe0490ff700 1 -- 172.21.15.40:0/1345394157 >> v1:172.21.15.40:6816/127432 conn(0x7fe02802f540 legacy=0x7fe0280319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:01.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.328+0000 7fb2f6e25700 1 -- 172.21.15.40:0/1022470182 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb2f0062380 con 0x7fb2f009c7d0 2023-09-30T22:25:01.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.328+0000 7fb2ed7fa700 1 -- 172.21.15.40:0/1022470182 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb2dc019b40 con 0x7fb2f009c7d0 2023-09-30T22:25:01.329 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:01.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.330+0000 7fb2f6e25700 1 -- 172.21.15.40:0/1022470182 >> v1:172.21.15.40:6816/127432 conn(0x7fb2d402f510 legacy=0x7fb2d40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:01.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.330+0000 7fb2f6e25700 1 -- 172.21.15.40:0/1022470182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2f009c7d0 msgr2=0x7fb2f01c37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.330+0000 7fb2f6e25700 1 --2- 172.21.15.40:0/1022470182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2f009c7d0 0x7fb2f01c37b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc00c450 tx=0x7fb2dc00c760 comp rx=0 tx=0).stop 2023-09-30T22:25:01.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.330+0000 7fb2f6e25700 1 -- 172.21.15.40:0/1022470182 shutdown_connections 2023-09-30T22:25:01.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.330+0000 7fb2f6e25700 1 --2- 172.21.15.40:0/1022470182 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb2f0131d50 0x7fb2f0119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.330+0000 7fb2f6e25700 1 --2- 172.21.15.40:0/1022470182 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2f009bc50 0x7fb2f01c3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.330+0000 7fb2f6e25700 1 --2- 172.21.15.40:0/1022470182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2f009c7d0 0x7fb2f01c37b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.330+0000 7fb2f6e25700 1 -- 172.21.15.40:0/1022470182 >> 172.21.15.40:0/1022470182 conn(0x7fb2f00a2a00 msgr2=0x7fb2f012d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:01.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.330+0000 7fb2f6e25700 1 -- 172.21.15.40:0/1022470182 shutdown_connections 2023-09-30T22:25:01.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.330+0000 7fb2f6e25700 1 -- 172.21.15.40:0/1022470182 wait complete. 2023-09-30T22:25:01.343 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:01.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.344+0000 7f96dbfff700 1 -- 172.21.15.40:0/2995026161 >> v1:172.21.15.40:6816/127432 conn(0x7f96c002f510 legacy=0x7f96c00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:01.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.346+0000 7fe04b363700 1 -- 172.21.15.40:0/1345394157 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe044071020 con 0x7fe04409e230 2023-09-30T22:25:01.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.346+0000 7fe039ffb700 1 -- 172.21.15.40:0/1345394157 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe034017030 con 0x7fe04409e230 2023-09-30T22:25:01.346 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:01.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.348+0000 7fe04b363700 1 -- 172.21.15.40:0/1345394157 >> v1:172.21.15.40:6816/127432 conn(0x7fe02802f540 legacy=0x7fe0280319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:01.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.348+0000 7fe04b363700 1 -- 172.21.15.40:0/1345394157 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe04409e230 msgr2=0x7fe04411d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.348+0000 7fe04b363700 1 --2- 172.21.15.40:0/1345394157 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe04409e230 0x7fe04411d630 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe03400c4e0 tx=0x7fe03400c7f0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.348+0000 7fe04b363700 1 -- 172.21.15.40:0/1345394157 shutdown_connections 2023-09-30T22:25:01.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.348+0000 7fe04b363700 1 --2- 172.21.15.40:0/1345394157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe044130fb0 0x7fe04411db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.348+0000 7fe04b363700 1 --2- 172.21.15.40:0/1345394157 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe04409d920 0x7fe04411d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.348+0000 7fe04b363700 1 --2- 172.21.15.40:0/1345394157 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe04409e230 0x7fe04411d630 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.348+0000 7fe04b363700 1 -- 172.21.15.40:0/1345394157 >> 172.21.15.40:0/1345394157 conn(0x7fe04409fb20 msgr2=0x7fe04412fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:01.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.348+0000 7fe04b363700 1 -- 172.21.15.40:0/1345394157 shutdown_connections 2023-09-30T22:25:01.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.348+0000 7fe04b363700 1 -- 172.21.15.40:0/1345394157 wait complete. 2023-09-30T22:25:01.360 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:01.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.363+0000 7f96e2b14700 1 -- 172.21.15.40:0/2995026161 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f96dc062380 con 0x7f96dc06ced0 2023-09-30T22:25:01.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.364+0000 7f96d97fa700 1 -- 172.21.15.40:0/2995026161 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f96d0029070 con 0x7f96dc06ced0 2023-09-30T22:25:01.364 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:01.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.366+0000 7f96e2b14700 1 -- 172.21.15.40:0/2995026161 >> v1:172.21.15.40:6816/127432 conn(0x7f96c002f510 legacy=0x7f96c00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:01.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.366+0000 7f96e2b14700 1 -- 172.21.15.40:0/2995026161 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f96dc06ced0 msgr2=0x7f96dc08afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.366+0000 7f96e2b14700 1 --2- 172.21.15.40:0/2995026161 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f96dc06ced0 0x7f96dc08afd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f96d0009c70 tx=0x7f96d0004750 comp rx=0 tx=0).stop 2023-09-30T22:25:01.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.366+0000 7f96e2b14700 1 -- 172.21.15.40:0/2995026161 shutdown_connections 2023-09-30T22:25:01.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.366+0000 7f96e2b14700 1 --2- 172.21.15.40:0/2995026161 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f96dc06ced0 0x7f96dc08afd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.366+0000 7f96e2b14700 1 --2- 172.21.15.40:0/2995026161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96dc138370 0x7f96dc08ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.366+0000 7f96e2b14700 1 --2- 172.21.15.40:0/2995026161 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f96dc09fbb0 0x7f96dc08b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.366+0000 7f96e2b14700 1 -- 172.21.15.40:0/2995026161 >> 172.21.15.40:0/2995026161 conn(0x7f96dc0a41a0 msgr2=0x7f96dc0a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:01.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.366+0000 7f96e2b14700 1 -- 172.21.15.40:0/2995026161 shutdown_connections 2023-09-30T22:25:01.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:01.366+0000 7f96e2b14700 1 -- 172.21.15.40:0/2995026161 wait complete. 2023-09-30T22:25:01.378 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:02.278 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:02.344 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:02.361 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:02.380 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:02.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.425+0000 7f75bde98700 1 Processor -- start 2023-09-30T22:25:02.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.425+0000 7f75bde98700 1 -- start start 2023-09-30T22:25:02.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.426+0000 7f75bde98700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75b809e400 0x7f75b8135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.426+0000 7f75bde98700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75b8136230 0x7f75b8138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.426+0000 7f75bde98700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75b809adf0 con 0x7f75b809d920 2023-09-30T22:25:02.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.426+0000 7f75bde98700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b809e7f0 con 0x7f75b809e400 2023-09-30T22:25:02.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.426+0000 7f75bde98700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75b809edf0 con 0x7f75b8136230 2023-09-30T22:25:02.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.426+0000 7f75b77fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f75b809d920 0x7f75b809dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48406/0 (socket says 172.21.15.40:48406) 2023-09-30T22:25:02.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.426+0000 7f75b77fe700 1 -- 172.21.15.40:0/1425669300 learned_addr learned my addr 172.21.15.40:0/1425669300 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:02.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.426+0000 7f75b7fff700 1 --2- 172.21.15.40:0/1425669300 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75b8136230 0x7f75b8138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.426+0000 7f75b67fc700 1 -- 172.21.15.40:0/1425669300 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1462336178 0 0) 0x7f75b809adf0 con 0x7f75b809d920 2023-09-30T22:25:02.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.427+0000 7f75b7fff700 1 -- 172.21.15.40:0/1425669300 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75b809e400 msgr2=0x7f75b8135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:02.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.427+0000 7f75b7fff700 1 --2- 172.21.15.40:0/1425669300 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75b809e400 0x7f75b8135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.427+0000 7f75b7fff700 1 -- 172.21.15.40:0/1425669300 >> v1:172.21.15.40:6789/0 conn(0x7f75b809d920 legacy=0x7f75b809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.427+0000 7f75b7fff700 1 -- 172.21.15.40:0/1425669300 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b809b660 con 0x7f75b8136230 2023-09-30T22:25:02.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.427+0000 7f75b7fff700 1 --2- 172.21.15.40:0/1425669300 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75b8136230 0x7f75b8138610 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f75b0009dc0 tx=0x7f75b000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1a381c7e4b053c0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:02.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.427+0000 7f75b67fc700 1 -- 172.21.15.40:0/1425669300 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b000e070 con 0x7f75b8136230 2023-09-30T22:25:02.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.427+0000 7f75b67fc700 1 -- 172.21.15.40:0/1425669300 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b000bb70 con 0x7f75b8136230 2023-09-30T22:25:02.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.427+0000 7f75b67fc700 1 -- 172.21.15.40:0/1425669300 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b0012430 con 0x7f75b8136230 2023-09-30T22:25:02.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.428+0000 7f75bde98700 1 -- 172.21.15.40:0/1425669300 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75b8136230 msgr2=0x7f75b8138610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.428+0000 7f75bde98700 1 --2- 172.21.15.40:0/1425669300 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75b8136230 0x7f75b8138610 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f75b0009dc0 tx=0x7f75b000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:02.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.428+0000 7f75bde98700 1 -- 172.21.15.40:0/1425669300 shutdown_connections 2023-09-30T22:25:02.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.428+0000 7f75bde98700 1 --2- 172.21.15.40:0/1425669300 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75b8136230 0x7f75b8138610 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.428+0000 7f75bde98700 1 --2- 172.21.15.40:0/1425669300 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75b809e400 0x7f75b8135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.428+0000 7f75bde98700 1 -- 172.21.15.40:0/1425669300 >> 172.21.15.40:0/1425669300 conn(0x7f75b809fb20 msgr2=0x7f75b809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:02.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.428+0000 7f75bde98700 1 -- 172.21.15.40:0/1425669300 shutdown_connections 2023-09-30T22:25:02.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.428+0000 7f75bde98700 1 -- 172.21.15.40:0/1425669300 wait complete. 2023-09-30T22:25:02.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.430+0000 7f75bde98700 1 Processor -- start 2023-09-30T22:25:02.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.430+0000 7f75bde98700 1 -- start start 2023-09-30T22:25:02.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.430+0000 7f75bde98700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75b809d920 0x7f75b81c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.430+0000 7f75bde98700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75b809e400 0x7f75b81c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.431+0000 7f75bde98700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75b8136230 0x7f75b8135030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.431+0000 7f75bde98700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b811d840 con 0x7f75b809d920 2023-09-30T22:25:02.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.431+0000 7f75bde98700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b81c9240 con 0x7f75b8136230 2023-09-30T22:25:02.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.431+0000 7f75bde98700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75b811c940 con 0x7f75b809e400 2023-09-30T22:25:02.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.431+0000 7f75b77fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75b809d920 0x7f75b81c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.431+0000 7f75b77fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75b809d920 0x7f75b81c87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54670/0 (socket says 172.21.15.40:54670) 2023-09-30T22:25:02.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.431+0000 7f75b77fe700 1 -- 172.21.15.40:0/1080724416 learned_addr learned my addr 172.21.15.40:0/1080724416 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:02.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.431+0000 7f75b7fff700 1 --2- 172.21.15.40:0/1080724416 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75b8136230 0x7f75b8135030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.431+0000 7f75b6ffd700 1 --2- 172.21.15.40:0/1080724416 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75b809e400 0x7f75b81c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.431+0000 7f75b77fe700 1 -- 172.21.15.40:0/1080724416 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75b809e400 msgr2=0x7f75b81c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.431+0000 7f75b77fe700 1 --2- 172.21.15.40:0/1080724416 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75b809e400 0x7f75b81c8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.431+0000 7f75b77fe700 1 -- 172.21.15.40:0/1080724416 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75b8136230 msgr2=0x7f75b8135030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.431+0000 7f75b77fe700 1 --2- 172.21.15.40:0/1080724416 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75b8136230 0x7f75b8135030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.431+0000 7f75b77fe700 1 -- 172.21.15.40:0/1080724416 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b0009a70 con 0x7f75b809d920 2023-09-30T22:25:02.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.431+0000 7f75b6ffd700 1 --2- 172.21.15.40:0/1080724416 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75b809e400 0x7f75b81c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:02.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.431+0000 7f75b77fe700 1 --2- 172.21.15.40:0/1080724416 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75b809d920 0x7f75b81c87c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f75a800c700 tx=0x7f75a800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:02.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.432+0000 7f759ffff700 1 -- 172.21.15.40:0/1080724416 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a80074e0 con 0x7f75b809d920 2023-09-30T22:25:02.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.432+0000 7f759ffff700 1 -- 172.21.15.40:0/1080724416 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a8007640 con 0x7f75b809d920 2023-09-30T22:25:02.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.432+0000 7f759ffff700 1 -- 172.21.15.40:0/1080724416 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a8005a70 con 0x7f75b809d920 2023-09-30T22:25:02.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.433+0000 7f75bde98700 1 -- 172.21.15.40:0/1080724416 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b811dcf0 con 0x7f75b809d920 2023-09-30T22:25:02.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.433+0000 7f75bde98700 1 -- 172.21.15.40:0/1080724416 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b809cb00 con 0x7f75b809d920 2023-09-30T22:25:02.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.433+0000 7f759ffff700 1 -- 172.21.15.40:0/1080724416 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f75a8005bd0 con 0x7f75b809d920 2023-09-30T22:25:02.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.434+0000 7f75b6ffd700 1 -- 172.21.15.40:0/1080724416 >> v1:172.21.15.40:6816/127432 conn(0x7f75a402f510 legacy=0x7f75a40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:02.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.434+0000 7f759ffff700 1 -- 172.21.15.40:0/1080724416 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f75a803f190 con 0x7f75b809d920 2023-09-30T22:25:02.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.434+0000 7f75bde98700 1 -- 172.21.15.40:0/1080724416 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b813a640 con 0x7f75b809d920 2023-09-30T22:25:02.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.443+0000 7f759ffff700 1 -- 172.21.15.40:0/1080724416 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f75a8017080 con 0x7f75b809d920 2023-09-30T22:25:02.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.488+0000 7f3d50f58700 1 Processor -- start 2023-09-30T22:25:02.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.488+0000 7f3d50f58700 1 -- start start 2023-09-30T22:25:02.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.489+0000 7f3d50f58700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d4c09f0f0 0x7f3d4c138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.489+0000 7f3d50f58700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d4c09e400 0x7f3d4c13b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.489+0000 7f3d50f58700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d4c09f940 con 0x7f3d4c09d920 2023-09-30T22:25:02.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.489+0000 7f3d50f58700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c06b4c0 con 0x7f3d4c09f0f0 2023-09-30T22:25:02.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.489+0000 7f3d50f58700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c09a8f0 con 0x7f3d4c09e400 2023-09-30T22:25:02.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.489+0000 7f3d4a59c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3d4c09d920 0x7f3d4c09dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48422/0 (socket says 172.21.15.40:48422) 2023-09-30T22:25:02.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.489+0000 7f3d4a59c700 1 -- 172.21.15.40:0/2268098285 learned_addr learned my addr 172.21.15.40:0/2268098285 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:02.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.489+0000 7f3d49d9b700 1 --2- 172.21.15.40:0/2268098285 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d4c09f0f0 0x7f3d4c138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.489+0000 7f3d4ad9d700 1 --2- 172.21.15.40:0/2268098285 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d4c09e400 0x7f3d4c13b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.489+0000 7f3d4959a700 1 -- 172.21.15.40:0/2268098285 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2589281846 0 0) 0x7f3d4c09f940 con 0x7f3d4c09d920 2023-09-30T22:25:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.489+0000 7f3d4959a700 1 -- 172.21.15.40:0/2268098285 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d340035b0 con 0x7f3d4c09d920 2023-09-30T22:25:02.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.489+0000 7f3d49d9b700 1 -- 172.21.15.40:0/2268098285 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d4c09e400 msgr2=0x7f3d4c13b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:02.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.489+0000 7f3d49d9b700 1 --2- 172.21.15.40:0/2268098285 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d4c09e400 0x7f3d4c13b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.489+0000 7f3d49d9b700 1 -- 172.21.15.40:0/2268098285 >> v1:172.21.15.40:6789/0 conn(0x7f3d4c09d920 legacy=0x7f3d4c09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.489+0000 7f3d49d9b700 1 -- 172.21.15.40:0/2268098285 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4c09f6e0 con 0x7f3d4c09f0f0 2023-09-30T22:25:02.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.490+0000 7f3d49d9b700 1 --2- 172.21.15.40:0/2268098285 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d4c09f0f0 0x7f3d4c138ee0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3d40009870 tx=0x7f3d40009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=560bd820ef366f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:02.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.490+0000 7f3d4959a700 1 -- 172.21.15.40:0/2268098285 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d40011830 con 0x7f3d4c09f0f0 2023-09-30T22:25:02.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.490+0000 7f3d4959a700 1 -- 172.21.15.40:0/2268098285 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d40011990 con 0x7f3d4c09f0f0 2023-09-30T22:25:02.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.490+0000 7f3d4959a700 1 -- 172.21.15.40:0/2268098285 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d40011d20 con 0x7f3d4c09f0f0 2023-09-30T22:25:02.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.491+0000 7f3d50f58700 1 -- 172.21.15.40:0/2268098285 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d4c09f0f0 msgr2=0x7f3d4c138ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.491+0000 7f3d50f58700 1 --2- 172.21.15.40:0/2268098285 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d4c09f0f0 0x7f3d4c138ee0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3d40009870 tx=0x7f3d40009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:02.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.491+0000 7f3d50f58700 1 -- 172.21.15.40:0/2268098285 shutdown_connections 2023-09-30T22:25:02.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.491+0000 7f3d50f58700 1 --2- 172.21.15.40:0/2268098285 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d4c09e400 0x7f3d4c13b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.491+0000 7f3d50f58700 1 --2- 172.21.15.40:0/2268098285 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d4c09f0f0 0x7f3d4c138ee0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.491+0000 7f3d50f58700 1 -- 172.21.15.40:0/2268098285 >> 172.21.15.40:0/2268098285 conn(0x7f3d4c09fb20 msgr2=0x7f3d4c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:02.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.491+0000 7f3d50f58700 1 -- 172.21.15.40:0/2268098285 shutdown_connections 2023-09-30T22:25:02.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.491+0000 7f3d50f58700 1 -- 172.21.15.40:0/2268098285 wait complete. 2023-09-30T22:25:02.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.492+0000 7f3d50f58700 1 Processor -- start 2023-09-30T22:25:02.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.493+0000 7f3d50f58700 1 -- start start 2023-09-30T22:25:02.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.493+0000 7f3d50f58700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d4c09d920 0x7f3d4c11db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.493+0000 7f3d50f58700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d4c09e400 0x7f3d4c11e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.493+0000 7f3d50f58700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d4c11e5c0 0x7f3d4c1ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.493+0000 7f3d50f58700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c11fdb0 con 0x7f3d4c09d920 2023-09-30T22:25:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.493+0000 7f3d50f58700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c0a2f20 con 0x7f3d4c11e5c0 2023-09-30T22:25:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.493+0000 7f3d50f58700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c09c9e0 con 0x7f3d4c09e400 2023-09-30T22:25:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.493+0000 7f3d4ad9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d4c11e5c0 0x7f3d4c1ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.493+0000 7f3d4a59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d4c09d920 0x7f3d4c11db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.493+0000 7f3d4ad9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d4c11e5c0 0x7f3d4c1ce8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54088/0 (socket says 172.21.15.40:54088) 2023-09-30T22:25:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.493+0000 7f3d4ad9d700 1 -- 172.21.15.40:0/3756718107 learned_addr learned my addr 172.21.15.40:0/3756718107 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.494+0000 7f3d49d9b700 1 --2- 172.21.15.40:0/3756718107 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d4c09e400 0x7f3d4c11e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.494+0000 7f3d4a59c700 1 -- 172.21.15.40:0/3756718107 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d4c09e400 msgr2=0x7f3d4c11e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.494+0000 7f3d4a59c700 1 --2- 172.21.15.40:0/3756718107 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d4c09e400 0x7f3d4c11e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.494+0000 7f3d4a59c700 1 -- 172.21.15.40:0/3756718107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d4c11e5c0 msgr2=0x7f3d4c1ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.494+0000 7f3d4a59c700 1 --2- 172.21.15.40:0/3756718107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d4c11e5c0 0x7f3d4c1ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.494+0000 7f3d4a59c700 1 -- 172.21.15.40:0/3756718107 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d400094a0 con 0x7f3d4c09d920 2023-09-30T22:25:02.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.494+0000 7f3d49d9b700 1 --2- 172.21.15.40:0/3756718107 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d4c09e400 0x7f3d4c11e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:02.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.494+0000 7f3d4a59c700 1 --2- 172.21.15.40:0/3756718107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d4c09d920 0x7f3d4c11db40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c00c700 tx=0x7f3d3c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:02.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.494+0000 7f3d3affd700 1 -- 172.21.15.40:0/3756718107 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c0074e0 con 0x7f3d4c09d920 2023-09-30T22:25:02.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.494+0000 7f3d3affd700 1 -- 172.21.15.40:0/3756718107 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3c007640 con 0x7f3d4c09d920 2023-09-30T22:25:02.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.494+0000 7f3d3affd700 1 -- 172.21.15.40:0/3756718107 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c005a50 con 0x7f3d4c09d920 2023-09-30T22:25:02.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.494+0000 7f3d50f58700 1 -- 172.21.15.40:0/3756718107 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d4c11fa00 con 0x7f3d4c09d920 2023-09-30T22:25:02.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.494+0000 7f3d50f58700 1 -- 172.21.15.40:0/3756718107 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d4c13a940 con 0x7f3d4c09d920 2023-09-30T22:25:02.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.495+0000 7f3d3affd700 1 -- 172.21.15.40:0/3756718107 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3d3c005bb0 con 0x7f3d4c09d920 2023-09-30T22:25:02.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.495+0000 7f3d50f58700 1 -- 172.21.15.40:0/3756718107 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d4c11fbf0 con 0x7f3d4c09d920 2023-09-30T22:25:02.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.496+0000 7f3d49d9b700 1 -- 172.21.15.40:0/3756718107 >> v1:172.21.15.40:6816/127432 conn(0x7f3d2c02f540 legacy=0x7f3d2c0319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:02.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.496+0000 7f3d3affd700 1 -- 172.21.15.40:0/3756718107 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f3d3c03f140 con 0x7f3d4c09d920 2023-09-30T22:25:02.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.500+0000 7f3d3affd700 1 -- 172.21.15.40:0/3756718107 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3d3c019b40 con 0x7f3d4c09d920 2023-09-30T22:25:02.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.527+0000 7f44c2a89700 1 Processor -- start 2023-09-30T22:25:02.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.528+0000 7f44c2a89700 1 -- start start 2023-09-30T22:25:02.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.528+0000 7f44c2a89700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f44bc09d450 0x7f44bc09d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.528+0000 7f44c2a89700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f44bc09dd60 0x7f44bc1301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.528+0000 7f44c2a89700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44bc09c3b0 con 0x7f44bc130700 2023-09-30T22:25:02.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.528+0000 7f44c2a89700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44bc09a6b0 con 0x7f44bc09dd60 2023-09-30T22:25:02.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.528+0000 7f44c2a89700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc09b4f0 con 0x7f44bc09d450 2023-09-30T22:25:02.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.528+0000 7f44c0825700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f44bc09d450 0x7f44bc09d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.529+0000 7f44c0825700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f44bc09d450 0x7f44bc09d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51658/0 (socket says 172.21.15.40:51658) 2023-09-30T22:25:02.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.529+0000 7f44c0825700 1 -- 172.21.15.40:0/1579684852 learned_addr learned my addr 172.21.15.40:0/1579684852 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:02.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.529+0000 7f44bbfff700 1 --2- 172.21.15.40:0/1579684852 >> v2:172.21.15.40:3300/0 conn(0x7f44bc09dd60 0x7f44bc1301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.529+0000 7f44bb7fe700 1 -- 172.21.15.40:0/1579684852 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 323819074 0 0) 0x7f44bc09c3b0 con 0x7f44bc130700 2023-09-30T22:25:02.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.529+0000 7f44bb7fe700 1 -- 172.21.15.40:0/1579684852 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44ac0035b0 con 0x7f44bc130700 2023-09-30T22:25:02.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.529+0000 7f44c0825700 1 -- 172.21.15.40:0/1579684852 >> v2:172.21.15.40:3300/0 conn(0x7f44bc09dd60 msgr2=0x7f44bc1301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:02.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.529+0000 7f44c0825700 1 --2- 172.21.15.40:0/1579684852 >> v2:172.21.15.40:3300/0 conn(0x7f44bc09dd60 0x7f44bc1301c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.529+0000 7f44c0825700 1 -- 172.21.15.40:0/1579684852 >> v1:172.21.15.40:6789/0 conn(0x7f44bc130700 legacy=0x7f44bc137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.529+0000 7f44c0825700 1 -- 172.21.15.40:0/1579684852 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44bc09af90 con 0x7f44bc09d450 2023-09-30T22:25:02.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.529+0000 7f44bbfff700 1 --2- 172.21.15.40:0/1579684852 >> v2:172.21.15.40:3300/0 conn(0x7f44bc09dd60 0x7f44bc1301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:02.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.529+0000 7f44c0825700 1 --2- 172.21.15.40:0/1579684852 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f44bc09d450 0x7f44bc09d820 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f44b000bb90 tx=0x7f44b000bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c25735cccde5b98 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:02.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.529+0000 7f44bb7fe700 1 -- 172.21.15.40:0/1579684852 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b000dc20 con 0x7f44bc09d450 2023-09-30T22:25:02.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.529+0000 7f44bb7fe700 1 -- 172.21.15.40:0/1579684852 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b000dd80 con 0x7f44bc09d450 2023-09-30T22:25:02.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.529+0000 7f44bb7fe700 1 -- 172.21.15.40:0/1579684852 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b0017630 con 0x7f44bc09d450 2023-09-30T22:25:02.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.530+0000 7f44c2a89700 1 -- 172.21.15.40:0/1579684852 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f44bc09d450 msgr2=0x7f44bc09d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.530+0000 7f44c2a89700 1 --2- 172.21.15.40:0/1579684852 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f44bc09d450 0x7f44bc09d820 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f44b000bb90 tx=0x7f44b000bea0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.530+0000 7f44c2a89700 1 -- 172.21.15.40:0/1579684852 shutdown_connections 2023-09-30T22:25:02.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.530+0000 7f44c2a89700 1 --2- 172.21.15.40:0/1579684852 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f44bc09d450 0x7f44bc09d820 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.530+0000 7f44c2a89700 1 --2- 172.21.15.40:0/1579684852 >> v2:172.21.15.40:3300/0 conn(0x7f44bc09dd60 0x7f44bc1301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.530+0000 7f44c2a89700 1 -- 172.21.15.40:0/1579684852 >> 172.21.15.40:0/1579684852 conn(0x7f44bc0a2a00 msgr2=0x7f44bc0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:02.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.530+0000 7f44c2a89700 1 -- 172.21.15.40:0/1579684852 shutdown_connections 2023-09-30T22:25:02.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.530+0000 7f44c2a89700 1 -- 172.21.15.40:0/1579684852 wait complete. 2023-09-30T22:25:02.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.531+0000 7f44c2a89700 1 Processor -- start 2023-09-30T22:25:02.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.531+0000 7f44c2a89700 1 -- start start 2023-09-30T22:25:02.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.532+0000 7f44c2a89700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f44bc09d450 0x7f44bc1c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.532+0000 7f44c2a89700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f44bc09dd60 0x7f44bc1c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.532+0000 7f44c2a89700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44bc130700 0x7f44bc1c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.532+0000 7f44c2a89700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc1211d0 con 0x7f44bc130700 2023-09-30T22:25:02.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.532+0000 7f44c2a89700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc122270 con 0x7f44bc09d450 2023-09-30T22:25:02.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.532+0000 7f44c2a89700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc11faa0 con 0x7f44bc09dd60 2023-09-30T22:25:02.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.532+0000 7f44c0825700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f44bc09d450 0x7f44bc1c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.532+0000 7f44c0825700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f44bc09d450 0x7f44bc1c82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54096/0 (socket says 172.21.15.40:54096) 2023-09-30T22:25:02.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.532+0000 7f44c0825700 1 -- 172.21.15.40:0/3256351700 learned_addr learned my addr 172.21.15.40:0/3256351700 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:02.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.532+0000 7f44bbfff700 1 --2- 172.21.15.40:0/3256351700 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f44bc09dd60 0x7f44bc1c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.532+0000 7f44c1026700 1 --2- 172.21.15.40:0/3256351700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44bc130700 0x7f44bc1c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.532+0000 7f44c0825700 1 -- 172.21.15.40:0/3256351700 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f44bc09dd60 msgr2=0x7f44bc1c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.532+0000 7f44c0825700 1 --2- 172.21.15.40:0/3256351700 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f44bc09dd60 0x7f44bc1c8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.532+0000 7f44c0825700 1 -- 172.21.15.40:0/3256351700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44bc130700 msgr2=0x7f44bc1c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.532+0000 7f44c0825700 1 --2- 172.21.15.40:0/3256351700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44bc130700 0x7f44bc1c8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.532+0000 7f44c0825700 1 -- 172.21.15.40:0/3256351700 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a80094a0 con 0x7f44bc09d450 2023-09-30T22:25:02.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.532+0000 7f44c0825700 1 --2- 172.21.15.40:0/3256351700 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f44bc09d450 0x7f44bc1c82c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f44b0019040 tx=0x7f44b0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:02.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.533+0000 7f44b97fa700 1 -- 172.21.15.40:0/3256351700 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b0017dd0 con 0x7f44bc09d450 2023-09-30T22:25:02.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.533+0000 7f44b97fa700 1 -- 172.21.15.40:0/3256351700 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b0021410 con 0x7f44bc09d450 2023-09-30T22:25:02.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.533+0000 7f44b97fa700 1 -- 172.21.15.40:0/3256351700 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b00217c0 con 0x7f44bc09d450 2023-09-30T22:25:02.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.533+0000 7f44c2a89700 1 -- 172.21.15.40:0/3256351700 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b000b7f0 con 0x7f44bc09d450 2023-09-30T22:25:02.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.533+0000 7f44c2a89700 1 -- 172.21.15.40:0/3256351700 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44bc122e00 con 0x7f44bc09d450 2023-09-30T22:25:02.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.534+0000 7f44b97fa700 1 -- 172.21.15.40:0/3256351700 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f44b0015070 con 0x7f44bc09d450 2023-09-30T22:25:02.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.534+0000 7f44b97fa700 1 -- 172.21.15.40:0/3256351700 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f44b0041420 con 0x7f44bc09d450 2023-09-30T22:25:02.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.534+0000 7f44bbfff700 1 -- 172.21.15.40:0/3256351700 >> v1:172.21.15.40:6816/127432 conn(0x7f44a002f510 legacy=0x7f44a00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:02.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.534+0000 7f44a6ffd700 1 -- 172.21.15.40:0/3256351700 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44bc062380 con 0x7f44bc09d450 2023-09-30T22:25:02.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.539+0000 7f44b97fa700 1 -- 172.21.15.40:0/3256351700 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f44b002a400 con 0x7f44bc09d450 2023-09-30T22:25:02.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.570+0000 7f3c7cb83700 1 Processor -- start 2023-09-30T22:25:02.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.570+0000 7f3c7cb83700 1 -- start start 2023-09-30T22:25:02.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.571+0000 7f3c7cb83700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c7809d920 0x7f3c7809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.571+0000 7f3c7cb83700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3c7809f0f0 0x7f3c7809e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.571+0000 7f3c7cb83700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c7809f940 con 0x7f3c78133ca0 2023-09-30T22:25:02.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.571+0000 7f3c7cb83700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c7806b4c0 con 0x7f3c7809f0f0 2023-09-30T22:25:02.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.571+0000 7f3c7cb83700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7809a8f0 con 0x7f3c7809d920 2023-09-30T22:25:02.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.571+0000 7f3c7659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c7809d920 0x7f3c7809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.571+0000 7f3c7659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c7809d920 0x7f3c7809dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51680/0 (socket says 172.21.15.40:51680) 2023-09-30T22:25:02.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.571+0000 7f3c7659c700 1 -- 172.21.15.40:0/3927839698 learned_addr learned my addr 172.21.15.40:0/3927839698 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:02.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.571+0000 7f3c75d9b700 1 --2- 172.21.15.40:0/3927839698 >> v2:172.21.15.40:3300/0 conn(0x7f3c7809f0f0 0x7f3c7809e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.572+0000 7f3c7659c700 1 -- 172.21.15.40:0/3927839698 >> v2:172.21.15.40:3300/0 conn(0x7f3c7809f0f0 msgr2=0x7f3c7809e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:02.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.572+0000 7f3c7659c700 1 --2- 172.21.15.40:0/3927839698 >> v2:172.21.15.40:3300/0 conn(0x7f3c7809f0f0 0x7f3c7809e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.572+0000 7f3c7659c700 1 -- 172.21.15.40:0/3927839698 >> v1:172.21.15.40:6789/0 conn(0x7f3c78133ca0 legacy=0x7f3c78134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.572+0000 7f3c7659c700 1 -- 172.21.15.40:0/3927839698 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c7809f6e0 con 0x7f3c7809d920 2023-09-30T22:25:02.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.572+0000 7f3c7659c700 1 --2- 172.21.15.40:0/3927839698 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c7809d920 0x7f3c7809dcf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3c68006fd0 tx=0x7f3c68009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c91f47bf24e8bfd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:02.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.572+0000 7f3c7559a700 1 -- 172.21.15.40:0/3927839698 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c68005e30 con 0x7f3c7809d920 2023-09-30T22:25:02.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.572+0000 7f3c7559a700 1 -- 172.21.15.40:0/3927839698 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c68004030 con 0x7f3c7809d920 2023-09-30T22:25:02.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.572+0000 7f3c7559a700 1 -- 172.21.15.40:0/3927839698 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c680043e0 con 0x7f3c7809d920 2023-09-30T22:25:02.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.573+0000 7f3c7cb83700 1 -- 172.21.15.40:0/3927839698 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c7809d920 msgr2=0x7f3c7809dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.573+0000 7f3c7cb83700 1 --2- 172.21.15.40:0/3927839698 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c7809d920 0x7f3c7809dcf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3c68006fd0 tx=0x7f3c68009bd0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.573+0000 7f3c7cb83700 1 -- 172.21.15.40:0/3927839698 shutdown_connections 2023-09-30T22:25:02.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.573+0000 7f3c7cb83700 1 --2- 172.21.15.40:0/3927839698 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c7809d920 0x7f3c7809dcf0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.573+0000 7f3c7cb83700 1 --2- 172.21.15.40:0/3927839698 >> v2:172.21.15.40:3300/0 conn(0x7f3c7809f0f0 0x7f3c7809e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.573+0000 7f3c7cb83700 1 -- 172.21.15.40:0/3927839698 >> 172.21.15.40:0/3927839698 conn(0x7f3c7809fb20 msgr2=0x7f3c7809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:02.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.573+0000 7f3c7cb83700 1 -- 172.21.15.40:0/3927839698 shutdown_connections 2023-09-30T22:25:02.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.573+0000 7f3c7cb83700 1 -- 172.21.15.40:0/3927839698 wait complete. 2023-09-30T22:25:02.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.574+0000 7f3c7cb83700 1 Processor -- start 2023-09-30T22:25:02.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.574+0000 7f3c7cb83700 1 -- start start 2023-09-30T22:25:02.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.575+0000 7f3c7cb83700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c7809d920 0x7f3c7811e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.575+0000 7f3c7cb83700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c78133ca0 0x7f3c7811e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.575+0000 7f3c7cb83700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c781223c0 0x7f3c7811ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.575+0000 7f3c7cb83700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7811f850 con 0x7f3c78133ca0 2023-09-30T22:25:02.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.575+0000 7f3c7cb83700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7811ffb0 con 0x7f3c781223c0 2023-09-30T22:25:02.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.575+0000 7f3c7cb83700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c781205d0 con 0x7f3c7809d920 2023-09-30T22:25:02.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.575+0000 7f3c76d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c781223c0 0x7f3c7811ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.575+0000 7f3c76d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c781223c0 0x7f3c7811ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54102/0 (socket says 172.21.15.40:54102) 2023-09-30T22:25:02.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.575+0000 7f3c76d9d700 1 -- 172.21.15.40:0/962173292 learned_addr learned my addr 172.21.15.40:0/962173292 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:02.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.575+0000 7f3c7659c700 1 --2- 172.21.15.40:0/962173292 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c7809d920 0x7f3c7811e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.575+0000 7f3c75d9b700 1 --2- 172.21.15.40:0/962173292 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c78133ca0 0x7f3c7811e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.576+0000 7f3c76d9d700 1 -- 172.21.15.40:0/962173292 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c7809d920 msgr2=0x7f3c7811e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.576+0000 7f3c76d9d700 1 --2- 172.21.15.40:0/962173292 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c7809d920 0x7f3c7811e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.576+0000 7f3c76d9d700 1 -- 172.21.15.40:0/962173292 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c78133ca0 msgr2=0x7f3c7811e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.576+0000 7f3c76d9d700 1 --2- 172.21.15.40:0/962173292 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c78133ca0 0x7f3c7811e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.576+0000 7f3c76d9d700 1 -- 172.21.15.40:0/962173292 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c68009500 con 0x7f3c781223c0 2023-09-30T22:25:02.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.576+0000 7f3c7659c700 1 --2- 172.21.15.40:0/962173292 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c7809d920 0x7f3c7811e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:02.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.576+0000 7f3c75d9b700 1 --2- 172.21.15.40:0/962173292 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c78133ca0 0x7f3c7811e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:02.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.576+0000 7f3c76d9d700 1 --2- 172.21.15.40:0/962173292 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c781223c0 0x7f3c7811ee20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3c7000ccb0 tx=0x7f3c7000a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:02.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.576+0000 7f3c66ffd700 1 -- 172.21.15.40:0/962173292 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c70003c00 con 0x7f3c781223c0 2023-09-30T22:25:02.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.576+0000 7f3c66ffd700 1 -- 172.21.15.40:0/962173292 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c70003d60 con 0x7f3c781223c0 2023-09-30T22:25:02.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.576+0000 7f3c7cb83700 1 -- 172.21.15.40:0/962173292 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c78121200 con 0x7f3c781223c0 2023-09-30T22:25:02.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.576+0000 7f3c66ffd700 1 -- 172.21.15.40:0/962173292 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7000aad0 con 0x7f3c781223c0 2023-09-30T22:25:02.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.576+0000 7f3c7cb83700 1 -- 172.21.15.40:0/962173292 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c780a2830 con 0x7f3c781223c0 2023-09-30T22:25:02.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.577+0000 7f3c7cb83700 1 -- 172.21.15.40:0/962173292 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c7809c9e0 con 0x7f3c781223c0 2023-09-30T22:25:02.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.578+0000 7f3c66ffd700 1 -- 172.21.15.40:0/962173292 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3c7000ac30 con 0x7f3c781223c0 2023-09-30T22:25:02.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.578+0000 7f3c66ffd700 1 -- 172.21.15.40:0/962173292 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f3c70040630 con 0x7f3c781223c0 2023-09-30T22:25:02.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.578+0000 7f3c7659c700 1 -- 172.21.15.40:0/962173292 >> v1:172.21.15.40:6816/127432 conn(0x7f3c5802f510 legacy=0x7f3c580319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:02.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.587+0000 7f3c66ffd700 1 -- 172.21.15.40:0/962173292 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3c70011740 con 0x7f3c781223c0 2023-09-30T22:25:02.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.635+0000 7f75b6ffd700 1 -- 172.21.15.40:0/1080724416 >> v1:172.21.15.40:6816/127432 conn(0x7f75a402f510 legacy=0x7f75a40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:02.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.697+0000 7f3d49d9b700 1 -- 172.21.15.40:0/3756718107 >> v1:172.21.15.40:6816/127432 conn(0x7f3d2c02f540 legacy=0x7f3d2c0319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:02.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.701+0000 7f3d50f58700 1 -- 172.21.15.40:0/3756718107 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3d4c062380 con 0x7f3d4c09d920 2023-09-30T22:25:02.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.702+0000 7f3d3affd700 1 -- 172.21.15.40:0/3756718107 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3d3c017070 con 0x7f3d4c09d920 2023-09-30T22:25:02.702 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:02.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.704+0000 7f75bde98700 1 -- 172.21.15.40:0/1080724416 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f75b8062380 con 0x7f75b809d920 2023-09-30T22:25:02.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.704+0000 7f759ffff700 1 -- 172.21.15.40:0/1080724416 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f75a801bb10 con 0x7f75b809d920 2023-09-30T22:25:02.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.704+0000 7f3d50f58700 1 -- 172.21.15.40:0/3756718107 >> v1:172.21.15.40:6816/127432 conn(0x7f3d2c02f540 legacy=0x7f3d2c0319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:02.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.704+0000 7f3d50f58700 1 -- 172.21.15.40:0/3756718107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d4c09d920 msgr2=0x7f3d4c11db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.704+0000 7f3d50f58700 1 --2- 172.21.15.40:0/3756718107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d4c09d920 0x7f3d4c11db40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c00c700 tx=0x7f3d3c00ca10 comp rx=0 tx=0).stop 2023-09-30T22:25:02.705 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:02.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.704+0000 7f3d50f58700 1 -- 172.21.15.40:0/3756718107 shutdown_connections 2023-09-30T22:25:02.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.704+0000 7f3d50f58700 1 --2- 172.21.15.40:0/3756718107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d4c11e5c0 0x7f3d4c1ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.704+0000 7f3d50f58700 1 --2- 172.21.15.40:0/3756718107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d4c09d920 0x7f3d4c11db40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.704+0000 7f3d50f58700 1 --2- 172.21.15.40:0/3756718107 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d4c09e400 0x7f3d4c11e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.704+0000 7f3d50f58700 1 -- 172.21.15.40:0/3756718107 >> 172.21.15.40:0/3756718107 conn(0x7f3d4c09fb20 msgr2=0x7f3d4c0a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:02.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.704+0000 7f3d50f58700 1 -- 172.21.15.40:0/3756718107 shutdown_connections 2023-09-30T22:25:02.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.704+0000 7f3d50f58700 1 -- 172.21.15.40:0/3756718107 wait complete. 2023-09-30T22:25:02.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.706+0000 7f75bde98700 1 -- 172.21.15.40:0/1080724416 >> v1:172.21.15.40:6816/127432 conn(0x7f75a402f510 legacy=0x7f75a40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:02.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.706+0000 7f75bde98700 1 -- 172.21.15.40:0/1080724416 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75b809d920 msgr2=0x7f75b81c87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.706+0000 7f75bde98700 1 --2- 172.21.15.40:0/1080724416 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75b809d920 0x7f75b81c87c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f75a800c700 tx=0x7f75a800ca10 comp rx=0 tx=0).stop 2023-09-30T22:25:02.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.706+0000 7f75bde98700 1 -- 172.21.15.40:0/1080724416 shutdown_connections 2023-09-30T22:25:02.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.706+0000 7f75bde98700 1 --2- 172.21.15.40:0/1080724416 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75b8136230 0x7f75b8135030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.706+0000 7f75bde98700 1 --2- 172.21.15.40:0/1080724416 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75b809d920 0x7f75b81c87c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.706+0000 7f75bde98700 1 --2- 172.21.15.40:0/1080724416 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75b809e400 0x7f75b81c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.706+0000 7f75bde98700 1 -- 172.21.15.40:0/1080724416 >> 172.21.15.40:0/1080724416 conn(0x7f75b809fb20 msgr2=0x7f75b8070310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:02.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.706+0000 7f75bde98700 1 -- 172.21.15.40:0/1080724416 shutdown_connections 2023-09-30T22:25:02.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.706+0000 7f75bde98700 1 -- 172.21.15.40:0/1080724416 wait complete. 2023-09-30T22:25:02.720 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:02.723 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:02.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.735+0000 7f44bbfff700 1 -- 172.21.15.40:0/3256351700 >> v1:172.21.15.40:6816/127432 conn(0x7f44a002f510 legacy=0x7f44a00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:02.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.746+0000 7f44a6ffd700 1 -- 172.21.15.40:0/3256351700 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f44bc0a2030 con 0x7f44bc09d450 2023-09-30T22:25:02.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.747+0000 7f44b97fa700 1 -- 172.21.15.40:0/3256351700 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f44b001eb50 con 0x7f44bc09d450 2023-09-30T22:25:02.747 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:02.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.749+0000 7f44a6ffd700 1 -- 172.21.15.40:0/3256351700 >> v1:172.21.15.40:6816/127432 conn(0x7f44a002f510 legacy=0x7f44a00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:02.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.749+0000 7f44a6ffd700 1 -- 172.21.15.40:0/3256351700 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f44bc09d450 msgr2=0x7f44bc1c82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.749+0000 7f44a6ffd700 1 --2- 172.21.15.40:0/3256351700 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f44bc09d450 0x7f44bc1c82c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f44b0019040 tx=0x7f44b0004750 comp rx=0 tx=0).stop 2023-09-30T22:25:02.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.749+0000 7f44a6ffd700 1 -- 172.21.15.40:0/3256351700 shutdown_connections 2023-09-30T22:25:02.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.749+0000 7f44a6ffd700 1 --2- 172.21.15.40:0/3256351700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44bc130700 0x7f44bc1c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.749+0000 7f44a6ffd700 1 --2- 172.21.15.40:0/3256351700 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f44bc09d450 0x7f44bc1c82c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.749+0000 7f44a6ffd700 1 --2- 172.21.15.40:0/3256351700 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f44bc09dd60 0x7f44bc1c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.749+0000 7f44a6ffd700 1 -- 172.21.15.40:0/3256351700 >> 172.21.15.40:0/3256351700 conn(0x7f44bc0a2a00 msgr2=0x7f44bc1b7ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:02.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.749+0000 7f44a6ffd700 1 -- 172.21.15.40:0/3256351700 shutdown_connections 2023-09-30T22:25:02.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.749+0000 7f44a6ffd700 1 -- 172.21.15.40:0/3256351700 wait complete. 2023-09-30T22:25:02.762 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:02.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.779+0000 7f3c7659c700 1 -- 172.21.15.40:0/962173292 >> v1:172.21.15.40:6816/127432 conn(0x7f3c5802f510 legacy=0x7f3c580319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:02.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.793+0000 7f3c7cb83700 1 -- 172.21.15.40:0/962173292 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3c78062380 con 0x7f3c781223c0 2023-09-30T22:25:02.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.794+0000 7f3c66ffd700 1 -- 172.21.15.40:0/962173292 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3c70029090 con 0x7f3c781223c0 2023-09-30T22:25:02.794 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:02.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.796+0000 7f3c7cb83700 1 -- 172.21.15.40:0/962173292 >> v1:172.21.15.40:6816/127432 conn(0x7f3c5802f510 legacy=0x7f3c580319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:02.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.796+0000 7f3c7cb83700 1 -- 172.21.15.40:0/962173292 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c781223c0 msgr2=0x7f3c7811ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.796+0000 7f3c7cb83700 1 --2- 172.21.15.40:0/962173292 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c781223c0 0x7f3c7811ee20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3c7000ccb0 tx=0x7f3c7000a060 comp rx=0 tx=0).stop 2023-09-30T22:25:02.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.796+0000 7f3c7cb83700 1 -- 172.21.15.40:0/962173292 shutdown_connections 2023-09-30T22:25:02.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.796+0000 7f3c7cb83700 1 --2- 172.21.15.40:0/962173292 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c7809d920 0x7f3c7811e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.796+0000 7f3c7cb83700 1 --2- 172.21.15.40:0/962173292 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c781223c0 0x7f3c7811ee20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.796+0000 7f3c7cb83700 1 --2- 172.21.15.40:0/962173292 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c78133ca0 0x7f3c7811e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.796+0000 7f3c7cb83700 1 -- 172.21.15.40:0/962173292 >> 172.21.15.40:0/962173292 conn(0x7f3c7809fb20 msgr2=0x7f3c78133360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:02.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.796+0000 7f3c7cb83700 1 -- 172.21.15.40:0/962173292 shutdown_connections 2023-09-30T22:25:02.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:02.796+0000 7f3c7cb83700 1 -- 172.21.15.40:0/962173292 wait complete. 2023-09-30T22:25:02.808 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:03.721 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:03.724 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:03.762 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:03.809 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:03.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.868+0000 7f3b7dc4b700 1 Processor -- start 2023-09-30T22:25:03.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.868+0000 7f3b7dc4b700 1 -- start start 2023-09-30T22:25:03.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.869+0000 7f3b7dc4b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3b7809d920 0x7f3b7809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.869+0000 7f3b7dc4b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b7809e230 0x7f3b781308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.869+0000 7f3b7dc4b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b78130de0 0x7f3b78131240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.869+0000 7f3b7dc4b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b7809edf0 con 0x7f3b7809d920 2023-09-30T22:25:03.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.869+0000 7f3b7dc4b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7809adf0 con 0x7f3b78130de0 2023-09-30T22:25:03.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.869+0000 7f3b7dc4b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7809b660 con 0x7f3b7809e230 2023-09-30T22:25:03.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.869+0000 7f3b76ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b7809e230 0x7f3b781308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.869+0000 7f3b76ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b7809e230 0x7f3b781308a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:42362/0 (socket says 172.21.15.40:42362) 2023-09-30T22:25:03.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.869+0000 7f3b76ffd700 1 -- 172.21.15.40:0/2477080328 learned_addr learned my addr 172.21.15.40:0/2477080328 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:03.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.869+0000 7f3b77fff700 1 --2- 172.21.15.40:0/2477080328 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b78130de0 0x7f3b78131240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.869+0000 7f3b777fe700 1 --2- 172.21.15.40:0/2477080328 >> v2:172.21.15.40:3300/0 conn(0x7f3b7809d920 0x7f3b7809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.870+0000 7f3b77fff700 1 -- 172.21.15.40:0/2477080328 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b7809e230 msgr2=0x7f3b781308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:03.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.870+0000 7f3b77fff700 1 --2- 172.21.15.40:0/2477080328 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b7809e230 0x7f3b781308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.870+0000 7f3b77fff700 1 -- 172.21.15.40:0/2477080328 >> v2:172.21.15.40:3300/0 conn(0x7f3b7809d920 msgr2=0x7f3b7809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:03.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.870+0000 7f3b77fff700 1 --2- 172.21.15.40:0/2477080328 >> v2:172.21.15.40:3300/0 conn(0x7f3b7809d920 0x7f3b7809dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.870+0000 7f3b77fff700 1 -- 172.21.15.40:0/2477080328 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7809a6e0 con 0x7f3b78130de0 2023-09-30T22:25:03.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.870+0000 7f3b76ffd700 1 --2- 172.21.15.40:0/2477080328 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b7809e230 0x7f3b781308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:03.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.870+0000 7f039a4ca700 1 Processor -- start 2023-09-30T22:25:03.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.870+0000 7f3b77fff700 1 --2- 172.21.15.40:0/2477080328 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b78130de0 0x7f3b78131240 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3b70009d90 tx=0x7f3b7000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3c7f87e4bf955ab server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:03.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.870+0000 7f3b767fc700 1 -- 172.21.15.40:0/2477080328 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7000e070 con 0x7f3b78130de0 2023-09-30T22:25:03.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.870+0000 7f3b767fc700 1 -- 172.21.15.40:0/2477080328 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7000bb20 con 0x7f3b78130de0 2023-09-30T22:25:03.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.870+0000 7f3b767fc700 1 -- 172.21.15.40:0/2477080328 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b70012430 con 0x7f3b78130de0 2023-09-30T22:25:03.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.870+0000 7f039a4ca700 1 -- start start 2023-09-30T22:25:03.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.871+0000 7f039a4ca700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f039409c890 0x7f039409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.871+0000 7f039a4ca700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f039409e480 0x7f039413bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.871+0000 7f039a4ca700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03940a2600 con 0x7f039409d920 2023-09-30T22:25:03.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.871+0000 7f039a4ca700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03940a29d0 con 0x7f039409e480 2023-09-30T22:25:03.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.871+0000 7f039a4ca700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f039409fb40 con 0x7f039409c890 2023-09-30T22:25:03.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.871+0000 7f03937fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f039409d920 0x7f039409dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:36726/0 (socket says 172.21.15.40:36726) 2023-09-30T22:25:03.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.871+0000 7f03937fe700 1 -- 172.21.15.40:0/3915813595 learned_addr learned my addr 172.21.15.40:0/3915813595 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:03.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.871+0000 7f0393fff700 1 --2- 172.21.15.40:0/3915813595 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f039409c890 0x7f039409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.871+0000 7f3b7dc4b700 1 -- 172.21.15.40:0/2477080328 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b78130de0 msgr2=0x7f3b78131240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.871+0000 7f3b7dc4b700 1 --2- 172.21.15.40:0/2477080328 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b78130de0 0x7f3b78131240 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3b70009d90 tx=0x7f3b7000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:03.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.871+0000 7f0393fff700 1 -- 172.21.15.40:0/3915813595 >> v2:172.21.15.40:3300/0 conn(0x7f039409e480 msgr2=0x7f039413bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:03.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.871+0000 7f0392ffd700 1 -- 172.21.15.40:0/3915813595 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4173084422 0 0) 0x7f03940a2600 con 0x7f039409d920 2023-09-30T22:25:03.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.871+0000 7f0393fff700 1 --2- 172.21.15.40:0/3915813595 >> v2:172.21.15.40:3300/0 conn(0x7f039409e480 0x7f039413bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.871+0000 7f0393fff700 1 -- 172.21.15.40:0/3915813595 >> v1:172.21.15.40:6789/0 conn(0x7f039409d920 legacy=0x7f039409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.871+0000 7f0393fff700 1 -- 172.21.15.40:0/3915813595 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f039409fed0 con 0x7f039409c890 2023-09-30T22:25:03.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.871+0000 7f3b7dc4b700 1 -- 172.21.15.40:0/2477080328 shutdown_connections 2023-09-30T22:25:03.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.871+0000 7f3b7dc4b700 1 --2- 172.21.15.40:0/2477080328 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b78130de0 0x7f3b78131240 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.871+0000 7f3b7dc4b700 1 --2- 172.21.15.40:0/2477080328 >> v2:172.21.15.40:3300/0 conn(0x7f3b7809d920 0x7f3b7809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.871+0000 7f3b7dc4b700 1 --2- 172.21.15.40:0/2477080328 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b7809e230 0x7f3b781308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.871+0000 7f3b7dc4b700 1 -- 172.21.15.40:0/2477080328 >> 172.21.15.40:0/2477080328 conn(0x7f3b7809fb20 msgr2=0x7f3b7809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:03.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.872+0000 7f3b7dc4b700 1 -- 172.21.15.40:0/2477080328 shutdown_connections 2023-09-30T22:25:03.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.872+0000 7f3b7dc4b700 1 -- 172.21.15.40:0/2477080328 wait complete. 2023-09-30T22:25:03.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.872+0000 7f0393fff700 1 --2- 172.21.15.40:0/3915813595 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f039409c890 0x7f039409cc60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0384009820 tx=0x7f0384009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc5fc88a7752ac8b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:03.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.872+0000 7f0392ffd700 1 -- 172.21.15.40:0/3915813595 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0384005e30 con 0x7f039409c890 2023-09-30T22:25:03.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.872+0000 7f0392ffd700 1 -- 172.21.15.40:0/3915813595 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0384006030 con 0x7f039409c890 2023-09-30T22:25:03.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.872+0000 7f0392ffd700 1 -- 172.21.15.40:0/3915813595 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03840063e0 con 0x7f039409c890 2023-09-30T22:25:03.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.873+0000 7f3b7dc4b700 1 Processor -- start 2023-09-30T22:25:03.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.873+0000 7f039a4ca700 1 -- 172.21.15.40:0/3915813595 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f039409c890 msgr2=0x7f039409cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.873+0000 7f039a4ca700 1 --2- 172.21.15.40:0/3915813595 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f039409c890 0x7f039409cc60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0384009820 tx=0x7f0384009b30 comp rx=0 tx=0).stop 2023-09-30T22:25:03.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.873+0000 7f039a4ca700 1 -- 172.21.15.40:0/3915813595 shutdown_connections 2023-09-30T22:25:03.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.873+0000 7f039a4ca700 1 --2- 172.21.15.40:0/3915813595 >> v2:172.21.15.40:3300/0 conn(0x7f039409e480 0x7f039413bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.873+0000 7f039a4ca700 1 --2- 172.21.15.40:0/3915813595 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f039409c890 0x7f039409cc60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.873+0000 7f039a4ca700 1 -- 172.21.15.40:0/3915813595 >> 172.21.15.40:0/3915813595 conn(0x7f03940a7080 msgr2=0x7f03940a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:03.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.873+0000 7f039a4ca700 1 -- 172.21.15.40:0/3915813595 shutdown_connections 2023-09-30T22:25:03.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.873+0000 7f039a4ca700 1 -- 172.21.15.40:0/3915813595 wait complete. 2023-09-30T22:25:03.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.873+0000 7f3b7dc4b700 1 -- start start 2023-09-30T22:25:03.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.873+0000 7f3b7dc4b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b7809d920 0x7f3b781201b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.873+0000 7f3b7dc4b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b7809e230 0x7f3b781206f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.873+0000 7f3b7dc4b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b78130de0 0x7f3b78120c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.873+0000 7f3b7dc4b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b78123ce0 con 0x7f3b7809e230 2023-09-30T22:25:03.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.873+0000 7f3b7dc4b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b78122f80 con 0x7f3b7809d920 2023-09-30T22:25:03.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.873+0000 7f3b7dc4b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b78121eb0 con 0x7f3b78130de0 2023-09-30T22:25:03.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.874+0000 7f3b777fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b7809d920 0x7f3b781201b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.874+0000 7f3b777fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b7809d920 0x7f3b781201b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:37992/0 (socket says 172.21.15.40:37992) 2023-09-30T22:25:03.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.874+0000 7f3b777fe700 1 -- 172.21.15.40:0/1638409929 learned_addr learned my addr 172.21.15.40:0/1638409929 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:03.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.874+0000 7f3b76ffd700 1 --2- 172.21.15.40:0/1638409929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b7809e230 0x7f3b781206f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.874+0000 7f3b77fff700 1 --2- 172.21.15.40:0/1638409929 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b78130de0 0x7f3b78120c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.874+0000 7f3b777fe700 1 -- 172.21.15.40:0/1638409929 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b78130de0 msgr2=0x7f3b78120c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.874+0000 7f3b777fe700 1 --2- 172.21.15.40:0/1638409929 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b78130de0 0x7f3b78120c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.874+0000 7f3b777fe700 1 -- 172.21.15.40:0/1638409929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b7809e230 msgr2=0x7f3b781206f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.874+0000 7f3b777fe700 1 --2- 172.21.15.40:0/1638409929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b7809e230 0x7f3b781206f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.874+0000 7f3b777fe700 1 -- 172.21.15.40:0/1638409929 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6c009550 con 0x7f3b7809d920 2023-09-30T22:25:03.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.874+0000 7f039a4ca700 1 Processor -- start 2023-09-30T22:25:03.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.875+0000 7f039a4ca700 1 -- start start 2023-09-30T22:25:03.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.875+0000 7f3b777fe700 1 --2- 172.21.15.40:0/1638409929 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b7809d920 0x7f3b781201b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3b6800e9b0 tx=0x7f3b6800ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:03.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.875+0000 7f3b5ffff700 1 -- 172.21.15.40:0/1638409929 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6800eea0 con 0x7f3b7809d920 2023-09-30T22:25:03.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.875+0000 7f3b5ffff700 1 -- 172.21.15.40:0/1638409929 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b68005a20 con 0x7f3b7809d920 2023-09-30T22:25:03.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.875+0000 7f3b5ffff700 1 -- 172.21.15.40:0/1638409929 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b68005db0 con 0x7f3b7809d920 2023-09-30T22:25:03.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.875+0000 7f3b7dc4b700 1 -- 172.21.15.40:0/1638409929 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b70009a70 con 0x7f3b7809d920 2023-09-30T22:25:03.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.875+0000 7f3b7dc4b700 1 -- 172.21.15.40:0/1638409929 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b78122590 con 0x7f3b7809d920 2023-09-30T22:25:03.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.875+0000 7f039a4ca700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f039409c890 0x7f03941ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.875+0000 7f039a4ca700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f039409d920 0x7f03941cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.875+0000 7f039a4ca700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f039409e480 0x7f039409abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.875+0000 7f039a4ca700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039406d570 con 0x7f039409d920 2023-09-30T22:25:03.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.875+0000 7f039a4ca700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f039406e6f0 con 0x7f039409c890 2023-09-30T22:25:03.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.875+0000 7f039a4ca700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f039406f880 con 0x7f039409e480 2023-09-30T22:25:03.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.876+0000 7f03937fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f039409d920 0x7f03941cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.876+0000 7f03937fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f039409d920 0x7f03941cd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56286/0 (socket says 172.21.15.40:56286) 2023-09-30T22:25:03.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.876+0000 7f03937fe700 1 -- 172.21.15.40:0/178767427 learned_addr learned my addr 172.21.15.40:0/178767427 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:03.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.876+0000 7f0398a67700 1 --2- 172.21.15.40:0/178767427 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f039409e480 0x7f039409abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.876+0000 7f03937fe700 1 -- 172.21.15.40:0/178767427 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f039409e480 msgr2=0x7f039409abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.876+0000 7f03937fe700 1 --2- 172.21.15.40:0/178767427 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f039409e480 0x7f039409abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.876+0000 7f03937fe700 1 -- 172.21.15.40:0/178767427 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f039409c890 msgr2=0x7f03941ccd70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:03.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.876+0000 7f03937fe700 1 --2- 172.21.15.40:0/178767427 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f039409c890 0x7f03941ccd70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.876+0000 7f03937fe700 1 -- 172.21.15.40:0/178767427 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0384009430 con 0x7f039409d920 2023-09-30T22:25:03.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.876+0000 7f03937fe700 1 --2- 172.21.15.40:0/178767427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f039409d920 0x7f03941cd2b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f038800c520 tx=0x7f038800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:03.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.876+0000 7f3b7dc4b700 1 -- 172.21.15.40:0/1638409929 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b7811cee0 con 0x7f3b7809d920 2023-09-30T22:25:03.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.876+0000 7f3b5ffff700 1 -- 172.21.15.40:0/1638409929 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3b6800c850 con 0x7f3b7809d920 2023-09-30T22:25:03.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.877+0000 7f3b5ffff700 1 -- 172.21.15.40:0/1638409929 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f3b6803ff70 con 0x7f3b7809d920 2023-09-30T22:25:03.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.877+0000 7f3b76ffd700 1 -- 172.21.15.40:0/1638409929 >> v1:172.21.15.40:6816/127432 conn(0x7f3b6402f510 legacy=0x7f3b640319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:03.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.877+0000 7f0390ff9700 1 -- 172.21.15.40:0/178767427 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0388004c80 con 0x7f039409d920 2023-09-30T22:25:03.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.877+0000 7f0390ff9700 1 -- 172.21.15.40:0/178767427 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0388004de0 con 0x7f039409d920 2023-09-30T22:25:03.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.877+0000 7f0390ff9700 1 -- 172.21.15.40:0/178767427 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03880072f0 con 0x7f039409d920 2023-09-30T22:25:03.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.877+0000 7f039a4ca700 1 -- 172.21.15.40:0/178767427 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f039409c540 con 0x7f039409d920 2023-09-30T22:25:03.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.877+0000 7f039a4ca700 1 -- 172.21.15.40:0/178767427 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03941cd7f0 con 0x7f039409d920 2023-09-30T22:25:03.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.878+0000 7f0390ff9700 1 -- 172.21.15.40:0/178767427 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0388007450 con 0x7f039409d920 2023-09-30T22:25:03.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.878+0000 7f039a4ca700 1 -- 172.21.15.40:0/178767427 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f039406d230 con 0x7f039409d920 2023-09-30T22:25:03.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.878+0000 7f0393fff700 1 -- 172.21.15.40:0/178767427 >> v1:172.21.15.40:6816/127432 conn(0x7f038002f510 legacy=0x7f03800319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:03.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.879+0000 7f0390ff9700 1 -- 172.21.15.40:0/178767427 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f0388011db0 con 0x7f039409d920 2023-09-30T22:25:03.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.882+0000 7f3b5ffff700 1 -- 172.21.15.40:0/1638409929 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3b68006030 con 0x7f3b7809d920 2023-09-30T22:25:03.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.883+0000 7f0390ff9700 1 -- 172.21.15.40:0/178767427 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0388007700 con 0x7f039409d920 2023-09-30T22:25:03.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.913+0000 7fa927503700 1 Processor -- start 2023-09-30T22:25:03.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.913+0000 7fa927503700 1 -- start start 2023-09-30T22:25:03.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.913+0000 7fa927503700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa92009d920 0x7fa92009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.913+0000 7fa927503700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa92009e230 0x7fa9201308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.913+0000 7fa927503700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa920130de0 0x7fa920131280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.913+0000 7fa927503700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa92009edf0 con 0x7fa920130de0 2023-09-30T22:25:03.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.913+0000 7fa927503700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa92009adf0 con 0x7fa92009e230 2023-09-30T22:25:03.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.913+0000 7fa927503700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa92009b660 con 0x7fa92009d920 2023-09-30T22:25:03.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.914+0000 7fa92529f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa92009d920 0x7fa92009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.914+0000 7fa924a9e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa92009e230 0x7fa9201308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.914+0000 7fa92529f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa92009d920 0x7fa92009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:42388/0 (socket says 172.21.15.40:42388) 2023-09-30T22:25:03.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.914+0000 7fa92529f700 1 -- 172.21.15.40:0/860602967 learned_addr learned my addr 172.21.15.40:0/860602967 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:03.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.914+0000 7fa925aa0700 1 --2- 172.21.15.40:0/860602967 >> v2:172.21.15.40:3300/0 conn(0x7fa920130de0 0x7fa920131280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.914+0000 7fa924a9e700 1 -- 172.21.15.40:0/860602967 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa92009d920 msgr2=0x7fa92009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:03.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.914+0000 7fa924a9e700 1 --2- 172.21.15.40:0/860602967 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa92009d920 0x7fa92009dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.914+0000 7fa924a9e700 1 -- 172.21.15.40:0/860602967 >> v2:172.21.15.40:3300/0 conn(0x7fa920130de0 msgr2=0x7fa920131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:03.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.914+0000 7fa924a9e700 1 --2- 172.21.15.40:0/860602967 >> v2:172.21.15.40:3300/0 conn(0x7fa920130de0 0x7fa920131280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.914+0000 7fa924a9e700 1 -- 172.21.15.40:0/860602967 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa92009a6e0 con 0x7fa92009e230 2023-09-30T22:25:03.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.914+0000 7fa924a9e700 1 --2- 172.21.15.40:0/860602967 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa92009e230 0x7fa9201308a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa910009840 tx=0x7fa910009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=730c7600a23e39 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:03.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.914+0000 7fa917fff700 1 -- 172.21.15.40:0/860602967 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa910011830 con 0x7fa92009e230 2023-09-30T22:25:03.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.915+0000 7fa917fff700 1 -- 172.21.15.40:0/860602967 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa910011990 con 0x7fa92009e230 2023-09-30T22:25:03.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.915+0000 7fa917fff700 1 -- 172.21.15.40:0/860602967 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa910011d20 con 0x7fa92009e230 2023-09-30T22:25:03.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.915+0000 7fa927503700 1 -- 172.21.15.40:0/860602967 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa92009e230 msgr2=0x7fa9201308a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.915+0000 7fa927503700 1 --2- 172.21.15.40:0/860602967 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa92009e230 0x7fa9201308a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa910009840 tx=0x7fa910009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:03.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.915+0000 7fa927503700 1 -- 172.21.15.40:0/860602967 shutdown_connections 2023-09-30T22:25:03.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.915+0000 7fa927503700 1 --2- 172.21.15.40:0/860602967 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa92009d920 0x7fa92009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.915+0000 7fa927503700 1 --2- 172.21.15.40:0/860602967 >> v2:172.21.15.40:3300/0 conn(0x7fa920130de0 0x7fa920131280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.915+0000 7fa927503700 1 --2- 172.21.15.40:0/860602967 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa92009e230 0x7fa9201308a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.915+0000 7fa927503700 1 -- 172.21.15.40:0/860602967 >> 172.21.15.40:0/860602967 conn(0x7fa92009fb20 msgr2=0x7fa92009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:03.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.915+0000 7fa927503700 1 -- 172.21.15.40:0/860602967 shutdown_connections 2023-09-30T22:25:03.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.915+0000 7fa927503700 1 -- 172.21.15.40:0/860602967 wait complete. 2023-09-30T22:25:03.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.917+0000 7fa927503700 1 Processor -- start 2023-09-30T22:25:03.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.917+0000 7fa927503700 1 -- start start 2023-09-30T22:25:03.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.918+0000 7fa927503700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa92009d920 0x7fa92011d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.918+0000 7fa927503700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa92009e230 0x7fa92011d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.918+0000 7fa927503700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa920130de0 0x7fa92011dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.918+0000 7fa927503700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa920121490 con 0x7fa92009e230 2023-09-30T22:25:03.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.918+0000 7fa927503700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa92009cb00 con 0x7fa92009d920 2023-09-30T22:25:03.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.918+0000 7fa927503700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa92011ec80 con 0x7fa920130de0 2023-09-30T22:25:03.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.918+0000 7fa924a9e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa92009e230 0x7fa92011d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.918+0000 7fa92529f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa92009d920 0x7fa92011d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.918+0000 7fa924a9e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa92009e230 0x7fa92011d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56296/0 (socket says 172.21.15.40:56296) 2023-09-30T22:25:03.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.918+0000 7fa92529f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa92009d920 0x7fa92011d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38020/0 (socket says 172.21.15.40:38020) 2023-09-30T22:25:03.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.918+0000 7fa924a9e700 1 -- 172.21.15.40:0/3660469631 learned_addr learned my addr 172.21.15.40:0/3660469631 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:03.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.918+0000 7fa925aa0700 1 --2- 172.21.15.40:0/3660469631 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa920130de0 0x7fa92011dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.918+0000 7fa924a9e700 1 -- 172.21.15.40:0/3660469631 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa920130de0 msgr2=0x7fa92011dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.918+0000 7fa924a9e700 1 --2- 172.21.15.40:0/3660469631 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa920130de0 0x7fa92011dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.918+0000 7fa924a9e700 1 -- 172.21.15.40:0/3660469631 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa92009d920 msgr2=0x7fa92011d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.918+0000 7fa924a9e700 1 --2- 172.21.15.40:0/3660469631 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa92009d920 0x7fa92011d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.918+0000 7fa924a9e700 1 -- 172.21.15.40:0/3660469631 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9100094a0 con 0x7fa92009e230 2023-09-30T22:25:03.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.918+0000 7fa924a9e700 1 --2- 172.21.15.40:0/3660469631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa92009e230 0x7fa92011d5a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa9100090b0 tx=0x7fa910004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:03.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.919+0000 7fa915ffb700 1 -- 172.21.15.40:0/3660469631 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa910004240 con 0x7fa92009e230 2023-09-30T22:25:03.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.919+0000 7fa915ffb700 1 -- 172.21.15.40:0/3660469631 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91001f070 con 0x7fa92009e230 2023-09-30T22:25:03.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.919+0000 7fa915ffb700 1 -- 172.21.15.40:0/3660469631 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9100036a0 con 0x7fa92009e230 2023-09-30T22:25:03.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.919+0000 7fa927503700 1 -- 172.21.15.40:0/3660469631 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa920120810 con 0x7fa92009e230 2023-09-30T22:25:03.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.919+0000 7fa927503700 1 -- 172.21.15.40:0/3660469631 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa92011fe30 con 0x7fa92009e230 2023-09-30T22:25:03.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.920+0000 7fa915ffb700 1 -- 172.21.15.40:0/3660469631 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa910021030 con 0x7fa92009e230 2023-09-30T22:25:03.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.920+0000 7fa927503700 1 -- 172.21.15.40:0/3660469631 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa920062380 con 0x7fa92009e230 2023-09-30T22:25:03.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.920+0000 7fa915ffb700 1 -- 172.21.15.40:0/3660469631 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7fa910040b00 con 0x7fa92009e230 2023-09-30T22:25:03.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.920+0000 7fa92529f700 1 -- 172.21.15.40:0/3660469631 >> v1:172.21.15.40:6816/127432 conn(0x7fa90402f510 legacy=0x7fa9040319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:03.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.929+0000 7fa915ffb700 1 -- 172.21.15.40:0/3660469631 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa9100239c0 con 0x7fa92009e230 2023-09-30T22:25:03.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.957+0000 7f2baecd4700 1 Processor -- start 2023-09-30T22:25:03.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.957+0000 7f2baecd4700 1 -- start start 2023-09-30T22:25:03.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.957+0000 7f2baecd4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2ba809c890 0x7f2ba809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.957+0000 7f2baecd4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ba809d920 0x7f2ba809dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.957+0000 7f2baecd4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2ba809e2b0 0x7f2ba813ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.957+0000 7f2baecd4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba80a29d0 con 0x7f2ba809e2b0 2023-09-30T22:25:03.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.957+0000 7f2baecd4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba809fb40 con 0x7f2ba809d920 2023-09-30T22:25:03.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.957+0000 7f2baecd4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba80a2600 con 0x7f2ba809c890 2023-09-30T22:25:03.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.958+0000 7f2bad271700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2ba809e2b0 0x7f2ba813ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.958+0000 7f2bad271700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2ba809e2b0 0x7f2ba813ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56302/0 (socket says 172.21.15.40:56302) 2023-09-30T22:25:03.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.958+0000 7f2bad271700 1 -- 172.21.15.40:0/1968919971 learned_addr learned my addr 172.21.15.40:0/1968919971 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:03.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.958+0000 7f2baca70700 1 --2- 172.21.15.40:0/1968919971 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2ba809c890 0x7f2ba809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.958+0000 7f2ba7fff700 1 --2- 172.21.15.40:0/1968919971 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ba809d920 0x7f2ba809dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.958+0000 7f2bad271700 1 -- 172.21.15.40:0/1968919971 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2ba809c890 msgr2=0x7f2ba809cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:03.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.958+0000 7f2bad271700 1 --2- 172.21.15.40:0/1968919971 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2ba809c890 0x7f2ba809cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.958+0000 7f2bad271700 1 -- 172.21.15.40:0/1968919971 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ba809d920 msgr2=0x7f2ba809dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:03.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.958+0000 7f2bad271700 1 --2- 172.21.15.40:0/1968919971 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ba809d920 0x7f2ba809dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.958+0000 7f2bad271700 1 -- 172.21.15.40:0/1968919971 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba809e720 con 0x7f2ba809e2b0 2023-09-30T22:25:03.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.958+0000 7f2bad271700 1 --2- 172.21.15.40:0/1968919971 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ba809e2b0 0x7f2ba813ac10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0009e80 tx=0x7f2ba000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be3b2bb144794621 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:03.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.958+0000 7f2ba77fe700 1 -- 172.21.15.40:0/1968919971 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba000e070 con 0x7f2ba809e2b0 2023-09-30T22:25:03.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.958+0000 7f2ba77fe700 1 -- 172.21.15.40:0/1968919971 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba000b8d0 con 0x7f2ba809e2b0 2023-09-30T22:25:03.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.958+0000 7f2ba77fe700 1 -- 172.21.15.40:0/1968919971 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba000bc80 con 0x7f2ba809e2b0 2023-09-30T22:25:03.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.959+0000 7f2baecd4700 1 -- 172.21.15.40:0/1968919971 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ba809e2b0 msgr2=0x7f2ba813ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.959+0000 7f2baecd4700 1 --2- 172.21.15.40:0/1968919971 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ba809e2b0 0x7f2ba813ac10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0009e80 tx=0x7f2ba000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:03.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.959+0000 7f2baecd4700 1 -- 172.21.15.40:0/1968919971 shutdown_connections 2023-09-30T22:25:03.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.959+0000 7f2baecd4700 1 --2- 172.21.15.40:0/1968919971 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2ba809c890 0x7f2ba809cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.959+0000 7f2baecd4700 1 --2- 172.21.15.40:0/1968919971 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ba809e2b0 0x7f2ba813ac10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.959+0000 7f2baecd4700 1 --2- 172.21.15.40:0/1968919971 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ba809d920 0x7f2ba809dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.959+0000 7f2baecd4700 1 -- 172.21.15.40:0/1968919971 >> 172.21.15.40:0/1968919971 conn(0x7f2ba80a7080 msgr2=0x7f2ba80a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:03.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.959+0000 7f2baecd4700 1 -- 172.21.15.40:0/1968919971 shutdown_connections 2023-09-30T22:25:03.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.959+0000 7f2baecd4700 1 -- 172.21.15.40:0/1968919971 wait complete. 2023-09-30T22:25:03.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.960+0000 7f2baecd4700 1 Processor -- start 2023-09-30T22:25:03.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.960+0000 7f2baecd4700 1 -- start start 2023-09-30T22:25:03.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.961+0000 7f2baecd4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ba809c890 0x7f2ba812f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.961+0000 7f2baecd4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ba809d920 0x7f2ba812fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.961+0000 7f2baecd4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2ba809e2b0 0x7f2ba81301a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.961+0000 7f2baecd4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba812e680 con 0x7f2ba809c890 2023-09-30T22:25:03.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.961+0000 7f2baecd4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba812e900 con 0x7f2ba809d920 2023-09-30T22:25:03.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.961+0000 7f2baecd4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba812d1e0 con 0x7f2ba809e2b0 2023-09-30T22:25:03.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.961+0000 7f2baca70700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ba809c890 0x7f2ba812f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.961+0000 7f2baca70700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ba809c890 0x7f2ba812f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56304/0 (socket says 172.21.15.40:56304) 2023-09-30T22:25:03.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.961+0000 7f2baca70700 1 -- 172.21.15.40:0/3714310591 learned_addr learned my addr 172.21.15.40:0/3714310591 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:03.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.961+0000 7f2ba7fff700 1 --2- 172.21.15.40:0/3714310591 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ba809d920 0x7f2ba812fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.961+0000 7f2bad271700 1 --2- 172.21.15.40:0/3714310591 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2ba809e2b0 0x7f2ba81301a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.961+0000 7f2baca70700 1 -- 172.21.15.40:0/3714310591 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2ba809e2b0 msgr2=0x7f2ba81301a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.961+0000 7f2baca70700 1 --2- 172.21.15.40:0/3714310591 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2ba809e2b0 0x7f2ba81301a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.961+0000 7f2baca70700 1 -- 172.21.15.40:0/3714310591 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ba809d920 msgr2=0x7f2ba812fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.961+0000 7f2baca70700 1 --2- 172.21.15.40:0/3714310591 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ba809d920 0x7f2ba812fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.961+0000 7f2baca70700 1 -- 172.21.15.40:0/3714310591 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba0009b30 con 0x7f2ba809c890 2023-09-30T22:25:03.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.961+0000 7f2bad271700 1 --2- 172.21.15.40:0/3714310591 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2ba809e2b0 0x7f2ba81301a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:03.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.962+0000 7f2baca70700 1 --2- 172.21.15.40:0/3714310591 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ba809c890 0x7f2ba812f720 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c00e9b0 tx=0x7f2b9c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:03.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.962+0000 7f2ba57fa700 1 -- 172.21.15.40:0/3714310591 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c00eea0 con 0x7f2ba809c890 2023-09-30T22:25:03.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.962+0000 7f2ba57fa700 1 -- 172.21.15.40:0/3714310591 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9c005a20 con 0x7f2ba809c890 2023-09-30T22:25:03.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.962+0000 7f2baecd4700 1 -- 172.21.15.40:0/3714310591 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba80a5b70 con 0x7f2ba809c890 2023-09-30T22:25:03.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.962+0000 7f2ba57fa700 1 -- 172.21.15.40:0/3714310591 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c005db0 con 0x7f2ba809c890 2023-09-30T22:25:03.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.962+0000 7f2baecd4700 1 -- 172.21.15.40:0/3714310591 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba81306e0 con 0x7f2ba809c890 2023-09-30T22:25:03.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.963+0000 7f2ba57fa700 1 -- 172.21.15.40:0/3714310591 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2b9c00c7f0 con 0x7f2ba809c890 2023-09-30T22:25:03.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.963+0000 7f2ba57fa700 1 -- 172.21.15.40:0/3714310591 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f2b9c03fd60 con 0x7f2ba809c890 2023-09-30T22:25:03.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.963+0000 7f2ba7fff700 1 -- 172.21.15.40:0/3714310591 >> v1:172.21.15.40:6816/127432 conn(0x7f2b8c02f540 legacy=0x7f2b8c0319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:03.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.963+0000 7f2baecd4700 1 -- 172.21.15.40:0/3714310591 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba806e600 con 0x7f2ba809c890 2023-09-30T22:25:03.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:03.968+0000 7f2ba57fa700 1 -- 172.21.15.40:0/3714310591 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2b9c020020 con 0x7f2ba809c890 2023-09-30T22:25:04.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.078+0000 7f3b76ffd700 1 -- 172.21.15.40:0/1638409929 >> v1:172.21.15.40:6816/127432 conn(0x7f3b6402f510 legacy=0x7f3b640319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:04.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.079+0000 7f0393fff700 1 -- 172.21.15.40:0/178767427 >> v1:172.21.15.40:6816/127432 conn(0x7f038002f510 legacy=0x7f03800319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:04.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.087+0000 7f039a4ca700 1 -- 172.21.15.40:0/178767427 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0394062380 con 0x7f039409d920 2023-09-30T22:25:04.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.088+0000 7f0390ff9700 1 -- 172.21.15.40:0/178767427 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0388031020 con 0x7f039409d920 2023-09-30T22:25:04.088 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:04.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.090+0000 7f039a4ca700 1 -- 172.21.15.40:0/178767427 >> v1:172.21.15.40:6816/127432 conn(0x7f038002f510 legacy=0x7f03800319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:04.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.090+0000 7f039a4ca700 1 -- 172.21.15.40:0/178767427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f039409d920 msgr2=0x7f03941cd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:04.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.090+0000 7f039a4ca700 1 --2- 172.21.15.40:0/178767427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f039409d920 0x7f03941cd2b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f038800c520 tx=0x7f038800c830 comp rx=0 tx=0).stop 2023-09-30T22:25:04.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.090+0000 7f039a4ca700 1 -- 172.21.15.40:0/178767427 shutdown_connections 2023-09-30T22:25:04.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.090+0000 7f039a4ca700 1 --2- 172.21.15.40:0/178767427 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f039409e480 0x7f039409abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.090+0000 7f039a4ca700 1 --2- 172.21.15.40:0/178767427 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f039409c890 0x7f03941ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.090+0000 7f039a4ca700 1 --2- 172.21.15.40:0/178767427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f039409d920 0x7f03941cd2b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.090+0000 7f039a4ca700 1 -- 172.21.15.40:0/178767427 >> 172.21.15.40:0/178767427 conn(0x7f03940a7080 msgr2=0x7f03940a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:04.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.090+0000 7f039a4ca700 1 -- 172.21.15.40:0/178767427 shutdown_connections 2023-09-30T22:25:04.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.090+0000 7f039a4ca700 1 -- 172.21.15.40:0/178767427 wait complete. 2023-09-30T22:25:04.107 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:04.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.121+0000 7fa92529f700 1 -- 172.21.15.40:0/3660469631 >> v1:172.21.15.40:6816/127432 conn(0x7fa90402f510 legacy=0x7fa9040319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:04.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.149+0000 7f3b7dc4b700 1 -- 172.21.15.40:0/1638409929 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3b78062380 con 0x7f3b7809d920 2023-09-30T22:25:04.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.149+0000 7f3b5ffff700 1 -- 172.21.15.40:0/1638409929 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3b68020070 con 0x7f3b7809d920 2023-09-30T22:25:04.150 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:04.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.151+0000 7f3b7dc4b700 1 -- 172.21.15.40:0/1638409929 >> v1:172.21.15.40:6816/127432 conn(0x7f3b6402f510 legacy=0x7f3b640319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:04.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.151+0000 7f3b7dc4b700 1 -- 172.21.15.40:0/1638409929 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b7809d920 msgr2=0x7f3b781201b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:04.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.151+0000 7f3b7dc4b700 1 --2- 172.21.15.40:0/1638409929 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b7809d920 0x7f3b781201b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3b6800e9b0 tx=0x7f3b6800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.151+0000 7f3b7dc4b700 1 -- 172.21.15.40:0/1638409929 shutdown_connections 2023-09-30T22:25:04.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.151+0000 7f3b7dc4b700 1 --2- 172.21.15.40:0/1638409929 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b78130de0 0x7f3b78120c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.151+0000 7f3b7dc4b700 1 --2- 172.21.15.40:0/1638409929 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b7809d920 0x7f3b781201b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.151+0000 7f3b7dc4b700 1 --2- 172.21.15.40:0/1638409929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b7809e230 0x7f3b781206f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.151+0000 7f3b7dc4b700 1 -- 172.21.15.40:0/1638409929 >> 172.21.15.40:0/1638409929 conn(0x7f3b7809fb20 msgr2=0x7f3b78070aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:04.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.151+0000 7f3b7dc4b700 1 -- 172.21.15.40:0/1638409929 shutdown_connections 2023-09-30T22:25:04.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.151+0000 7f3b7dc4b700 1 -- 172.21.15.40:0/1638409929 wait complete. 2023-09-30T22:25:04.164 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:04.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.163+0000 7f2baecd4700 1 -- 172.21.15.40:0/3714310591 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2ba8062380 con 0x7f2ba809c890 2023-09-30T22:25:04.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.164+0000 7f2ba7fff700 1 -- 172.21.15.40:0/3714310591 >> v1:172.21.15.40:6816/127432 conn(0x7f2b8c02f540 legacy=0x7f2b8c0319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:04.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.164+0000 7f2ba57fa700 1 -- 172.21.15.40:0/3714310591 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2b9c006030 con 0x7f2ba809c890 2023-09-30T22:25:04.165 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:04.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.166+0000 7f2baecd4700 1 -- 172.21.15.40:0/3714310591 >> v1:172.21.15.40:6816/127432 conn(0x7f2b8c02f540 legacy=0x7f2b8c0319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:04.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.166+0000 7f2baecd4700 1 -- 172.21.15.40:0/3714310591 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ba809c890 msgr2=0x7f2ba812f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:04.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.166+0000 7f2baecd4700 1 --2- 172.21.15.40:0/3714310591 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ba809c890 0x7f2ba812f720 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c00e9b0 tx=0x7f2b9c00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.166+0000 7f2baecd4700 1 -- 172.21.15.40:0/3714310591 shutdown_connections 2023-09-30T22:25:04.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.166+0000 7f2baecd4700 1 --2- 172.21.15.40:0/3714310591 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2ba809e2b0 0x7f2ba81301a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.166+0000 7f2baecd4700 1 --2- 172.21.15.40:0/3714310591 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ba809c890 0x7f2ba812f720 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.166+0000 7f2baecd4700 1 --2- 172.21.15.40:0/3714310591 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ba809d920 0x7f2ba812fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.166+0000 7f2baecd4700 1 -- 172.21.15.40:0/3714310591 >> 172.21.15.40:0/3714310591 conn(0x7f2ba80a7080 msgr2=0x7f2ba81bb110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:04.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.166+0000 7f2baecd4700 1 -- 172.21.15.40:0/3714310591 shutdown_connections 2023-09-30T22:25:04.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.166+0000 7f2baecd4700 1 -- 172.21.15.40:0/3714310591 wait complete. 2023-09-30T22:25:04.179 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:04.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.188+0000 7fa927503700 1 -- 172.21.15.40:0/3660469631 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa920120b50 con 0x7fa92009e230 2023-09-30T22:25:04.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.189+0000 7fa915ffb700 1 -- 172.21.15.40:0/3660469631 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa910015020 con 0x7fa92009e230 2023-09-30T22:25:04.189 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:04.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.191+0000 7fa927503700 1 -- 172.21.15.40:0/3660469631 >> v1:172.21.15.40:6816/127432 conn(0x7fa90402f510 legacy=0x7fa9040319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:04.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.191+0000 7fa927503700 1 -- 172.21.15.40:0/3660469631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa92009e230 msgr2=0x7fa92011d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:04.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.191+0000 7fa927503700 1 --2- 172.21.15.40:0/3660469631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa92009e230 0x7fa92011d5a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa9100090b0 tx=0x7fa910004750 comp rx=0 tx=0).stop 2023-09-30T22:25:04.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.191+0000 7fa927503700 1 -- 172.21.15.40:0/3660469631 shutdown_connections 2023-09-30T22:25:04.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.191+0000 7fa927503700 1 --2- 172.21.15.40:0/3660469631 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa920130de0 0x7fa92011dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.191+0000 7fa927503700 1 --2- 172.21.15.40:0/3660469631 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa92009d920 0x7fa92011d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.191+0000 7fa927503700 1 --2- 172.21.15.40:0/3660469631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa92009e230 0x7fa92011d5a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.191+0000 7fa927503700 1 -- 172.21.15.40:0/3660469631 >> 172.21.15.40:0/3660469631 conn(0x7fa92009fb20 msgr2=0x7fa920130080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:04.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.191+0000 7fa927503700 1 -- 172.21.15.40:0/3660469631 shutdown_connections 2023-09-30T22:25:04.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:04.191+0000 7fa927503700 1 -- 172.21.15.40:0/3660469631 wait complete. 2023-09-30T22:25:04.204 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:05.109 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:05.165 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:05.277 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:05.277 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:05.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.249+0000 7fdfb4dad700 1 Processor -- start 2023-09-30T22:25:05.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.249+0000 7fdfb4dad700 1 -- start start 2023-09-30T22:25:05.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.250+0000 7fdfb4dad700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdfb006f070 0x7fdfb006f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.250+0000 7fdfb4dad700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdfb006f980 0x7fdfb0097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.250+0000 7fdfb4dad700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb0070830 con 0x7fdfb006fdb0 2023-09-30T22:25:05.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.250+0000 7fdfb4dad700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb0071af0 con 0x7fdfb006f070 2023-09-30T22:25:05.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.250+0000 7fdfb4dad700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb0070ad0 con 0x7fdfb006f980 2023-09-30T22:25:05.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.250+0000 7fdfae59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdfb006f070 0x7fdfb006f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.250+0000 7fdfadd9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdfb006f980 0x7fdfb0097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.250+0000 7fdfadd9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdfb006f980 0x7fdfb0097090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:42426/0 (socket says 172.21.15.40:42426) 2023-09-30T22:25:05.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.250+0000 7fdfae59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdfb006f070 0x7fdfb006f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56312/0 (socket says 172.21.15.40:56312) 2023-09-30T22:25:05.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.250+0000 7fdfadd9b700 1 -- 172.21.15.40:0/4011713047 learned_addr learned my addr 172.21.15.40:0/4011713047 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:05.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.250+0000 7fdfadd9b700 1 -- 172.21.15.40:0/4011713047 >> v2:172.21.15.40:3300/0 conn(0x7fdfb006f070 msgr2=0x7fdfb006f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:05.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.250+0000 7fdfadd9b700 1 --2- 172.21.15.40:0/4011713047 >> v2:172.21.15.40:3300/0 conn(0x7fdfb006f070 0x7fdfb006f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.250+0000 7fdfadd9b700 1 -- 172.21.15.40:0/4011713047 >> v1:172.21.15.40:6789/0 conn(0x7fdfb006fdb0 legacy=0x7fdfb00975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.250+0000 7fdfadd9b700 1 -- 172.21.15.40:0/4011713047 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb0070de0 con 0x7fdfb006f980 2023-09-30T22:25:05.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.250+0000 7fdfae59c700 1 --2- 172.21.15.40:0/4011713047 >> v2:172.21.15.40:3300/0 conn(0x7fdfb006f070 0x7fdfb006f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:05.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.251+0000 7fdfadd9b700 1 --2- 172.21.15.40:0/4011713047 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdfb006f980 0x7fdfb0097090 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdf98009920 tx=0x7fdf98009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a4e45c5c855f0e0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:05.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.251+0000 7fdfad59a700 1 -- 172.21.15.40:0/4011713047 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf98011830 con 0x7fdfb006f980 2023-09-30T22:25:05.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.251+0000 7fdfad59a700 1 -- 172.21.15.40:0/4011713047 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf98011990 con 0x7fdfb006f980 2023-09-30T22:25:05.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.251+0000 7fdfad59a700 1 -- 172.21.15.40:0/4011713047 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf98011d20 con 0x7fdfb006f980 2023-09-30T22:25:05.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.251+0000 7fdfb4dad700 1 -- 172.21.15.40:0/4011713047 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdfb006f980 msgr2=0x7fdfb0097090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.251+0000 7fdfb4dad700 1 --2- 172.21.15.40:0/4011713047 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdfb006f980 0x7fdfb0097090 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdf98009920 tx=0x7fdf98009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:05.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.251+0000 7fdfb4dad700 1 -- 172.21.15.40:0/4011713047 shutdown_connections 2023-09-30T22:25:05.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.251+0000 7fdfb4dad700 1 --2- 172.21.15.40:0/4011713047 >> v2:172.21.15.40:3300/0 conn(0x7fdfb006f070 0x7fdfb006f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.251+0000 7fdfb4dad700 1 --2- 172.21.15.40:0/4011713047 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdfb006f980 0x7fdfb0097090 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.251+0000 7fdfb4dad700 1 -- 172.21.15.40:0/4011713047 >> 172.21.15.40:0/4011713047 conn(0x7fdfb00a41a0 msgr2=0x7fdfb00a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:05.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.252+0000 7fdfb4dad700 1 -- 172.21.15.40:0/4011713047 shutdown_connections 2023-09-30T22:25:05.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.252+0000 7fdfb4dad700 1 -- 172.21.15.40:0/4011713047 wait complete. 2023-09-30T22:25:05.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.253+0000 7fdfb4dad700 1 Processor -- start 2023-09-30T22:25:05.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.253+0000 7fdfb4dad700 1 -- start start 2023-09-30T22:25:05.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.253+0000 7fdfb4dad700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdfb006f070 0x7fdfb006c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.253+0000 7fdfb4dad700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdfb006f980 0x7fdfb006ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.253+0000 7fdfb4dad700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfb006fdb0 0x7fdfb006d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.253+0000 7fdfb4dad700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb0096e30 con 0x7fdfb006fdb0 2023-09-30T22:25:05.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.253+0000 7fdfb4dad700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb006dd90 con 0x7fdfb006f980 2023-09-30T22:25:05.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.253+0000 7fdfb4dad700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb0131fa0 con 0x7fdfb006f070 2023-09-30T22:25:05.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.253+0000 7fdfaed9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfb006fdb0 0x7fdfb006d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.253+0000 7fdfadd9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdfb006f980 0x7fdfb006ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.253+0000 7fdfae59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdfb006f070 0x7fdfb006c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.253+0000 7fdfadd9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdfb006f980 0x7fdfb006ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38054/0 (socket says 172.21.15.40:38054) 2023-09-30T22:25:05.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.253+0000 7fdfadd9b700 1 -- 172.21.15.40:0/880537431 learned_addr learned my addr 172.21.15.40:0/880537431 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:05.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.253+0000 7fdfae59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdfb006f070 0x7fdfb006c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:42428/0 (socket says 172.21.15.40:42428) 2023-09-30T22:25:05.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.253+0000 7fdfaed9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfb006fdb0 0x7fdfb006d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56326/0 (socket says 172.21.15.40:56326) 2023-09-30T22:25:05.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.254+0000 7fdfadd9b700 1 -- 172.21.15.40:0/880537431 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdfb006f070 msgr2=0x7fdfb006c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.254+0000 7fdfadd9b700 1 --2- 172.21.15.40:0/880537431 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdfb006f070 0x7fdfb006c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.254+0000 7fdfadd9b700 1 -- 172.21.15.40:0/880537431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfb006fdb0 msgr2=0x7fdfb006d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.254+0000 7fdfadd9b700 1 --2- 172.21.15.40:0/880537431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfb006fdb0 0x7fdfb006d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.254+0000 7fdfadd9b700 1 -- 172.21.15.40:0/880537431 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa00094a0 con 0x7fdfb006f980 2023-09-30T22:25:05.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.254+0000 7fdfaed9d700 1 --2- 172.21.15.40:0/880537431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfb006fdb0 0x7fdfb006d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:05.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.254+0000 7fdfae59c700 1 --2- 172.21.15.40:0/880537431 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdfb006f070 0x7fdfb006c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:05.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.254+0000 7fdfadd9b700 1 --2- 172.21.15.40:0/880537431 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdfb006f980 0x7fdfb006ced0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdf98009870 tx=0x7fdf98004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:05.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.254+0000 7fdfa6ffd700 1 -- 172.21.15.40:0/880537431 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf98004380 con 0x7fdfb006f980 2023-09-30T22:25:05.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.254+0000 7fdfa6ffd700 1 -- 172.21.15.40:0/880537431 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf9801f070 con 0x7fdfb006f980 2023-09-30T22:25:05.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.254+0000 7fdfb4dad700 1 -- 172.21.15.40:0/880537431 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf98009550 con 0x7fdfb006f980 2023-09-30T22:25:05.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.254+0000 7fdfa6ffd700 1 -- 172.21.15.40:0/880537431 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf980036a0 con 0x7fdfb006f980 2023-09-30T22:25:05.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.254+0000 7fdfb4dad700 1 -- 172.21.15.40:0/880537431 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb0131860 con 0x7fdfb006f980 2023-09-30T22:25:05.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.255+0000 7fdfa6ffd700 1 -- 172.21.15.40:0/880537431 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fdf98021030 con 0x7fdfb006f980 2023-09-30T22:25:05.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.255+0000 7fdfa6ffd700 1 -- 172.21.15.40:0/880537431 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7fdf98040de0 con 0x7fdfb006f980 2023-09-30T22:25:05.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.255+0000 7fdfae59c700 1 -- 172.21.15.40:0/880537431 >> v1:172.21.15.40:6816/127432 conn(0x7fdf9002f510 legacy=0x7fdf900319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:05.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.255+0000 7fdfb4dad700 1 -- 172.21.15.40:0/880537431 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb012c2d0 con 0x7fdfb006f980 2023-09-30T22:25:05.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.260+0000 7fdfa6ffd700 1 -- 172.21.15.40:0/880537431 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdf98015070 con 0x7fdfb006f980 2023-09-30T22:25:05.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.419+0000 7fb02c60b700 1 Processor -- start 2023-09-30T22:25:05.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.419+0000 7ffb89c15700 1 Processor -- start 2023-09-30T22:25:05.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.419+0000 7fc0e98a2700 1 Processor -- start 2023-09-30T22:25:05.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.419+0000 7fc0e98a2700 1 -- start start 2023-09-30T22:25:05.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.419+0000 7fc0e98a2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc0e412e590 0x7fc0e412e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.419+0000 7fb02c60b700 1 -- start start 2023-09-30T22:25:05.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.420+0000 7fb02c60b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb02409df30 0x7fb024135400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.420+0000 7fb02c60b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb024135940 0x7fb024137d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.420+0000 7fb02c60b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02409e8b0 con 0x7fb02409d450 2023-09-30T22:25:05.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.420+0000 7fb02c60b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02409c3b0 con 0x7fb024135940 2023-09-30T22:25:05.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.420+0000 7fc0e98a2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc0e412d8a0 0x7fc0e4138c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.420+0000 7fc0e98a2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0e409ab70 con 0x7fc0e412eea0 2023-09-30T22:25:05.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.420+0000 7fc0e98a2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0e409b270 con 0x7fc0e412e590 2023-09-30T22:25:05.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.420+0000 7fc0e98a2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e409bab0 con 0x7fc0e412d8a0 2023-09-30T22:25:05.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.420+0000 7fb02c60b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb02409a6b0 con 0x7fb02409df30 2023-09-30T22:25:05.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.420+0000 7fb029ba6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb02409df30 0x7fb024135400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.420+0000 7fb029ba6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb02409df30 0x7fb024135400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:42440/0 (socket says 172.21.15.40:42440) 2023-09-30T22:25:05.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.420+0000 7fb029ba6700 1 -- 172.21.15.40:0/705825064 learned_addr learned my addr 172.21.15.40:0/705825064 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:05.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.420+0000 7fc0e27fc700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc0e412eea0 0x7fc0e412d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:36734/0 (socket says 172.21.15.40:36734) 2023-09-30T22:25:05.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.420+0000 7fc0e27fc700 1 -- 172.21.15.40:0/2794638174 learned_addr learned my addr 172.21.15.40:0/2794638174 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:05.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.420+0000 7fc0e37fe700 1 --2- 172.21.15.40:0/2794638174 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc0e412d8a0 0x7fc0e4138c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.419+0000 7ffb89c15700 1 -- start start 2023-09-30T22:25:05.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.419+0000 7ffb89c15700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb84138250 0x7ffb84138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.420+0000 7ffb89c15700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffb8409d400 0x7ffb8409d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.420+0000 7ffb89c15700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb84137e20 con 0x7ffb8409dd50 2023-09-30T22:25:05.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.420+0000 7ffb89c15700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb84138050 con 0x7ffb8409d400 2023-09-30T22:25:05.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.420+0000 7ffb89c15700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8409b010 con 0x7ffb84138250 2023-09-30T22:25:05.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.420+0000 7ffb83fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ffb8409dd50 0x7ffb8413f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:36736/0 (socket says 172.21.15.40:36736) 2023-09-30T22:25:05.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.420+0000 7ffb83fff700 1 -- 172.21.15.40:0/1167511145 learned_addr learned my addr 172.21.15.40:0/1167511145 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:05.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.420+0000 7fc0e2ffd700 1 --2- 172.21.15.40:0/2794638174 >> v2:172.21.15.40:3300/0 conn(0x7fc0e412e590 0x7fc0e412e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.420+0000 7fb029ba6700 1 -- 172.21.15.40:0/705825064 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb024135940 msgr2=0x7fb024137d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:05.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.420+0000 7fb029ba6700 1 --2- 172.21.15.40:0/705825064 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb024135940 0x7fb024137d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.420+0000 7fb029ba6700 1 -- 172.21.15.40:0/705825064 >> v1:172.21.15.40:6789/0 conn(0x7fb02409d450 legacy=0x7fb02409d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.420+0000 7fb029ba6700 1 -- 172.21.15.40:0/705825064 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02409b4f0 con 0x7fb02409df30 2023-09-30T22:25:05.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.420+0000 7ffb82ffd700 1 --2- 172.21.15.40:0/1167511145 >> v2:172.21.15.40:3300/0 conn(0x7ffb8409d400 0x7ffb8409d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.420+0000 7ffb827fc700 1 -- 172.21.15.40:0/1167511145 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4098354639 0 0) 0x7ffb84137e20 con 0x7ffb8409dd50 2023-09-30T22:25:05.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.420+0000 7fc0e1ffb700 1 -- 172.21.15.40:0/2794638174 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3361628551 0 0) 0x7fc0e409ab70 con 0x7fc0e412eea0 2023-09-30T22:25:05.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.420+0000 7ffb827fc700 1 -- 172.21.15.40:0/1167511145 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb6c0035b0 con 0x7ffb8409dd50 2023-09-30T22:25:05.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.420+0000 7fc0e1ffb700 1 -- 172.21.15.40:0/2794638174 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0cc0035b0 con 0x7fc0e412eea0 2023-09-30T22:25:05.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.420+0000 7fc0e37fe700 1 -- 172.21.15.40:0/2794638174 >> v2:172.21.15.40:3300/0 conn(0x7fc0e412e590 msgr2=0x7fc0e412e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:05.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.420+0000 7fc0e37fe700 1 --2- 172.21.15.40:0/2794638174 >> v2:172.21.15.40:3300/0 conn(0x7fc0e412e590 0x7fc0e412e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.420+0000 7fc0e37fe700 1 -- 172.21.15.40:0/2794638174 >> v1:172.21.15.40:6789/0 conn(0x7fc0e412eea0 legacy=0x7fc0e412d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.421+0000 7fc0e37fe700 1 -- 172.21.15.40:0/2794638174 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e409bd70 con 0x7fc0e412d8a0 2023-09-30T22:25:05.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.421+0000 7ffb82ffd700 1 -- 172.21.15.40:0/1167511145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb84138250 msgr2=0x7ffb84138620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:05.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.421+0000 7ffb82ffd700 1 --2- 172.21.15.40:0/1167511145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb84138250 0x7ffb84138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.421+0000 7ffb82ffd700 1 -- 172.21.15.40:0/1167511145 >> v1:172.21.15.40:6789/0 conn(0x7ffb8409dd50 legacy=0x7ffb8413f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.421+0000 7ffb827fc700 1 -- 172.21.15.40:0/1167511145 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4115698569 0 0) 0x7ffb6c0035b0 con 0x7ffb8409dd50 2023-09-30T22:25:05.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.421+0000 7ffb82ffd700 1 -- 172.21.15.40:0/1167511145 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8409e1f0 con 0x7ffb8409d400 2023-09-30T22:25:05.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.421+0000 7fc0e37fe700 1 --2- 172.21.15.40:0/2794638174 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc0e412d8a0 0x7fc0e4138c50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc00bfa0 tx=0x7fc0dc00d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1be2b25d10cdc5c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:05.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.421+0000 7fb029ba6700 1 --2- 172.21.15.40:0/705825064 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb02409df30 0x7fb024135400 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb014010ce0 tx=0x7fb01400b4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5a86b52519d56f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:05.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.421+0000 7fc0e1ffb700 1 -- 172.21.15.40:0/2794638174 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc010070 con 0x7fc0e412d8a0 2023-09-30T22:25:05.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.421+0000 7fc0e1ffb700 1 -- 172.21.15.40:0/2794638174 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0dc00b2e0 con 0x7fc0e412d8a0 2023-09-30T22:25:05.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.421+0000 7fc0e1ffb700 1 -- 172.21.15.40:0/2794638174 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc00dc40 con 0x7fc0e412d8a0 2023-09-30T22:25:05.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.421+0000 7fb0293a5700 1 -- 172.21.15.40:0/705825064 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb014009030 con 0x7fb02409df30 2023-09-30T22:25:05.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.421+0000 7fb0293a5700 1 -- 172.21.15.40:0/705825064 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb014018410 con 0x7fb02409df30 2023-09-30T22:25:05.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.421+0000 7fb0293a5700 1 -- 172.21.15.40:0/705825064 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01400bea0 con 0x7fb02409df30 2023-09-30T22:25:05.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.421+0000 7ffb82ffd700 1 --2- 172.21.15.40:0/1167511145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb8409d400 0x7ffb8409d810 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffb78009840 tx=0x7ffb78009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58509aa3c6700098 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:05.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.421+0000 7ffb827fc700 1 -- 172.21.15.40:0/1167511145 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c0019f0 con 0x7ffb8409d400 2023-09-30T22:25:05.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.421+0000 7ffb827fc700 1 -- 172.21.15.40:0/1167511145 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb78004030 con 0x7ffb8409d400 2023-09-30T22:25:05.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.422+0000 7ffb827fc700 1 -- 172.21.15.40:0/1167511145 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb780043c0 con 0x7ffb8409d400 2023-09-30T22:25:05.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.422+0000 7fb02c60b700 1 -- 172.21.15.40:0/705825064 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb02409df30 msgr2=0x7fb024135400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.422+0000 7fb02c60b700 1 --2- 172.21.15.40:0/705825064 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb02409df30 0x7fb024135400 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb014010ce0 tx=0x7fb01400b4e0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.422+0000 7fc0e98a2700 1 -- 172.21.15.40:0/2794638174 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc0e412d8a0 msgr2=0x7fc0e4138c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.422+0000 7fc0e98a2700 1 --2- 172.21.15.40:0/2794638174 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc0e412d8a0 0x7fc0e4138c50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc00bfa0 tx=0x7fc0dc00d330 comp rx=0 tx=0).stop 2023-09-30T22:25:05.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.422+0000 7fb02c60b700 1 -- 172.21.15.40:0/705825064 shutdown_connections 2023-09-30T22:25:05.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.422+0000 7fb02c60b700 1 --2- 172.21.15.40:0/705825064 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb024135940 0x7fb024137d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.422+0000 7fb02c60b700 1 --2- 172.21.15.40:0/705825064 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb02409df30 0x7fb024135400 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.422+0000 7fb02c60b700 1 -- 172.21.15.40:0/705825064 >> 172.21.15.40:0/705825064 conn(0x7fb0240a2a00 msgr2=0x7fb0240a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:05.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.422+0000 7fc0e98a2700 1 -- 172.21.15.40:0/2794638174 shutdown_connections 2023-09-30T22:25:05.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.422+0000 7fc0e98a2700 1 --2- 172.21.15.40:0/2794638174 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc0e412d8a0 0x7fc0e4138c50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.422+0000 7fc0e98a2700 1 --2- 172.21.15.40:0/2794638174 >> v2:172.21.15.40:3300/0 conn(0x7fc0e412e590 0x7fc0e412e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.422+0000 7fc0e98a2700 1 -- 172.21.15.40:0/2794638174 >> 172.21.15.40:0/2794638174 conn(0x7fc0e40a2a00 msgr2=0x7fc0e40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:05.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.422+0000 7fb02c60b700 1 -- 172.21.15.40:0/705825064 shutdown_connections 2023-09-30T22:25:05.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.422+0000 7fb02c60b700 1 -- 172.21.15.40:0/705825064 wait complete. 2023-09-30T22:25:05.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.422+0000 7fc0e98a2700 1 -- 172.21.15.40:0/2794638174 shutdown_connections 2023-09-30T22:25:05.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.422+0000 7fc0e98a2700 1 -- 172.21.15.40:0/2794638174 wait complete. 2023-09-30T22:25:05.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.422+0000 7ffb89c15700 1 -- 172.21.15.40:0/1167511145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb8409d400 msgr2=0x7ffb8409d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.422+0000 7ffb89c15700 1 --2- 172.21.15.40:0/1167511145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb8409d400 0x7ffb8409d810 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffb78009840 tx=0x7ffb78009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:05.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.423+0000 7ffb89c15700 1 -- 172.21.15.40:0/1167511145 shutdown_connections 2023-09-30T22:25:05.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.423+0000 7ffb89c15700 1 --2- 172.21.15.40:0/1167511145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb84138250 0x7ffb84138620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.423+0000 7ffb89c15700 1 --2- 172.21.15.40:0/1167511145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb8409d400 0x7ffb8409d810 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.423+0000 7ffb89c15700 1 -- 172.21.15.40:0/1167511145 >> 172.21.15.40:0/1167511145 conn(0x7ffb840a2a00 msgr2=0x7ffb840a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:05.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.423+0000 7fb02c60b700 1 Processor -- start 2023-09-30T22:25:05.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.423+0000 7ffb89c15700 1 -- 172.21.15.40:0/1167511145 shutdown_connections 2023-09-30T22:25:05.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.423+0000 7fb02c60b700 1 -- start start 2023-09-30T22:25:05.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.423+0000 7fc0e98a2700 1 Processor -- start 2023-09-30T22:25:05.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.423+0000 7fc0e98a2700 1 -- start start 2023-09-30T22:25:05.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.424+0000 7fb02c60b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb02409d450 0x7fb02411f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.424+0000 7fb02c60b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb02409df30 0x7fb02411f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.424+0000 7fb02c60b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb024135940 0x7fb02411fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.424+0000 7fb02c60b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb024123490 con 0x7fb02409d450 2023-09-30T22:25:05.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.424+0000 7fb02c60b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02409c5d0 con 0x7fb024135940 2023-09-30T22:25:05.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.424+0000 7fb02c60b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb024121430 con 0x7fb02409df30 2023-09-30T22:25:05.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.424+0000 7fb02a3a7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb02409d450 0x7fb02411f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.424+0000 7fc0e98a2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0e412d8a0 0x7fc0e41197d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.424+0000 7ffb89c15700 1 -- 172.21.15.40:0/1167511145 wait complete. 2023-09-30T22:25:05.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.424+0000 7fc0e98a2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc0e412e590 0x7fc0e4119d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.424+0000 7fc0e98a2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc0e412eea0 0x7fc0e411a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.424+0000 7fb02a3a7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb02409d450 0x7fb02411f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56350/0 (socket says 172.21.15.40:56350) 2023-09-30T22:25:05.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.424+0000 7fb02a3a7700 1 -- 172.21.15.40:0/2831619204 learned_addr learned my addr 172.21.15.40:0/2831619204 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:05.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.424+0000 7fc0e98a2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e411dcb0 con 0x7fc0e412d8a0 2023-09-30T22:25:05.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.424+0000 7fc0e98a2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e411b3e0 con 0x7fc0e412eea0 2023-09-30T22:25:05.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.424+0000 7fc0e98a2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e411ba00 con 0x7fc0e412e590 2023-09-30T22:25:05.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.424+0000 7fc0e2ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0e412d8a0 0x7fc0e41197d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.424+0000 7fc0e2ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0e412d8a0 0x7fc0e41197d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56362/0 (socket says 172.21.15.40:56362) 2023-09-30T22:25:05.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.424+0000 7fc0e2ffd700 1 -- 172.21.15.40:0/3424317456 learned_addr learned my addr 172.21.15.40:0/3424317456 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:05.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.424+0000 7fb02a3a7700 1 -- 172.21.15.40:0/2831619204 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb02409df30 msgr2=0x7fb02411f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.424+0000 7fb02a3a7700 1 --2- 172.21.15.40:0/2831619204 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb02409df30 0x7fb02411f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.424+0000 7fb02a3a7700 1 -- 172.21.15.40:0/2831619204 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb024135940 msgr2=0x7fb02411fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.424+0000 7fb02a3a7700 1 --2- 172.21.15.40:0/2831619204 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb024135940 0x7fb02411fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.424+0000 7fb02a3a7700 1 -- 172.21.15.40:0/2831619204 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb014010910 con 0x7fb02409d450 2023-09-30T22:25:05.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.424+0000 7fc0e2ffd700 1 -- 172.21.15.40:0/3424317456 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc0e412e590 msgr2=0x7fc0e4119d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.424+0000 7fc0e2ffd700 1 --2- 172.21.15.40:0/3424317456 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc0e412e590 0x7fc0e4119d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.424+0000 7fc0e2ffd700 1 -- 172.21.15.40:0/3424317456 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc0e412eea0 msgr2=0x7fc0e411a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.424+0000 7fc0e2ffd700 1 --2- 172.21.15.40:0/3424317456 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc0e412eea0 0x7fc0e411a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.425+0000 7fc0e2ffd700 1 -- 172.21.15.40:0/3424317456 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0dc00bc80 con 0x7fc0e412d8a0 2023-09-30T22:25:05.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.425+0000 7fb02a3a7700 1 --2- 172.21.15.40:0/2831619204 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb02409d450 0x7fb02411f000 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb02000c4e0 tx=0x7fb02000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:05.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.425+0000 7fc0e2ffd700 1 --2- 172.21.15.40:0/3424317456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0e412d8a0 0x7fc0e41197d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc0d400e840 tx=0x7fc0d400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:05.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.425+0000 7fb01affd700 1 -- 172.21.15.40:0/2831619204 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0200052d0 con 0x7fb02409d450 2023-09-30T22:25:05.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.425+0000 7fb01affd700 1 -- 172.21.15.40:0/2831619204 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb020005430 con 0x7fb02409d450 2023-09-30T22:25:05.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.425+0000 7fb01affd700 1 -- 172.21.15.40:0/2831619204 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0200038c0 con 0x7fb02409d450 2023-09-30T22:25:05.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.425+0000 7fb02c60b700 1 -- 172.21.15.40:0/2831619204 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb024120c60 con 0x7fb02409d450 2023-09-30T22:25:05.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.425+0000 7fb02c60b700 1 -- 172.21.15.40:0/2831619204 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb024121e10 con 0x7fb02409d450 2023-09-30T22:25:05.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.425+0000 7fc0cbfff700 1 -- 172.21.15.40:0/3424317456 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d4013610 con 0x7fc0e412d8a0 2023-09-30T22:25:05.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.425+0000 7ffb89c15700 1 Processor -- start 2023-09-30T22:25:05.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.425+0000 7fc0cbfff700 1 -- 172.21.15.40:0/3424317456 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d4013770 con 0x7fc0e412d8a0 2023-09-30T22:25:05.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.425+0000 7fc0cbfff700 1 -- 172.21.15.40:0/3424317456 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d4013b20 con 0x7fc0e412d8a0 2023-09-30T22:25:05.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.425+0000 7fc0e98a2700 1 -- 172.21.15.40:0/3424317456 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0e411c630 con 0x7fc0e412d8a0 2023-09-30T22:25:05.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.425+0000 7fc0e98a2700 1 -- 172.21.15.40:0/3424317456 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0e411d070 con 0x7fc0e412d8a0 2023-09-30T22:25:05.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.426+0000 7fb02c60b700 1 -- 172.21.15.40:0/2831619204 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb024122750 con 0x7fb02409d450 2023-09-30T22:25:05.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.426+0000 7fc0e98a2700 1 -- 172.21.15.40:0/3424317456 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0e406edb0 con 0x7fc0e412d8a0 2023-09-30T22:25:05.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.426+0000 7ffb89c15700 1 -- start start 2023-09-30T22:25:05.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.426+0000 7ffb89c15700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb8409d400 0x7ffb84126350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.426+0000 7ffb89c15700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb8409dd50 0x7ffb84126890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.426+0000 7ffb89c15700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb84138250 0x7ffb8413a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.426+0000 7ffb89c15700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8409a300 con 0x7ffb8409d400 2023-09-30T22:25:05.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.426+0000 7ffb89c15700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8413b630 con 0x7ffb8409dd50 2023-09-30T22:25:05.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.426+0000 7ffb89c15700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb840a0e10 con 0x7ffb84138250 2023-09-30T22:25:05.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.426+0000 7ffb837fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb8409d400 0x7ffb84126350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.426+0000 7ffb837fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb8409d400 0x7ffb84126350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56376/0 (socket says 172.21.15.40:56376) 2023-09-30T22:25:05.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.426+0000 7ffb837fe700 1 -- 172.21.15.40:0/656147840 learned_addr learned my addr 172.21.15.40:0/656147840 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:05.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.427+0000 7ffb837fe700 1 -- 172.21.15.40:0/656147840 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb84138250 msgr2=0x7ffb8413a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.427+0000 7ffb83fff700 1 --2- 172.21.15.40:0/656147840 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb84138250 0x7ffb8413a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.427+0000 7ffb837fe700 1 --2- 172.21.15.40:0/656147840 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb84138250 0x7ffb8413a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.427+0000 7ffb837fe700 1 -- 172.21.15.40:0/656147840 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb8409dd50 msgr2=0x7ffb84126890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.427+0000 7ffb837fe700 1 --2- 172.21.15.40:0/656147840 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb8409dd50 0x7ffb84126890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.427+0000 7ffb837fe700 1 -- 172.21.15.40:0/656147840 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb780094a0 con 0x7ffb8409d400 2023-09-30T22:25:05.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.427+0000 7ffb83fff700 1 --2- 172.21.15.40:0/656147840 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb84138250 0x7ffb8413a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:05.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.427+0000 7ffb837fe700 1 --2- 172.21.15.40:0/656147840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb8409d400 0x7ffb84126350 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ffb7400b530 tx=0x7ffb7400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:05.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.428+0000 7fc0cbfff700 1 -- 172.21.15.40:0/3424317456 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc0d4013c80 con 0x7fc0e412d8a0 2023-09-30T22:25:05.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.428+0000 7fc0cbfff700 1 -- 172.21.15.40:0/3424317456 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7fc0d403fb60 con 0x7fc0e412d8a0 2023-09-30T22:25:05.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.428+0000 7fb01affd700 1 -- 172.21.15.40:0/2831619204 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb020003a20 con 0x7fb02409d450 2023-09-30T22:25:05.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.428+0000 7fb01affd700 1 -- 172.21.15.40:0/2831619204 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7fb02003f520 con 0x7fb02409d450 2023-09-30T22:25:05.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.428+0000 7fb029ba6700 1 -- 172.21.15.40:0/2831619204 >> v1:172.21.15.40:6816/127432 conn(0x7fb00802f510 legacy=0x7fb0080319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:05.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.431+0000 7fc0e27fc700 1 -- 172.21.15.40:0/3424317456 >> v1:172.21.15.40:6816/127432 conn(0x7fc0d002f560 legacy=0x7fc0d0031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:05.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.431+0000 7ffb6bfff700 1 -- 172.21.15.40:0/656147840 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb74011830 con 0x7ffb8409d400 2023-09-30T22:25:05.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.432+0000 7ffb89c15700 1 -- 172.21.15.40:0/656147840 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb8413c1c0 con 0x7ffb8409d400 2023-09-30T22:25:05.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.432+0000 7ffb89c15700 1 -- 172.21.15.40:0/656147840 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb8413e2b0 con 0x7ffb8409d400 2023-09-30T22:25:05.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.432+0000 7fb01affd700 1 -- 172.21.15.40:0/2831619204 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb020019d00 con 0x7fb02409d450 2023-09-30T22:25:05.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.433+0000 7ffb89c15700 1 -- 172.21.15.40:0/656147840 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb8413d4e0 con 0x7ffb8409d400 2023-09-30T22:25:05.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.436+0000 7ffb6bfff700 1 -- 172.21.15.40:0/656147840 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb74011990 con 0x7ffb8409d400 2023-09-30T22:25:05.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.436+0000 7ffb6bfff700 1 -- 172.21.15.40:0/656147840 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb74011d20 con 0x7ffb8409d400 2023-09-30T22:25:05.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.437+0000 7fc0cbfff700 1 -- 172.21.15.40:0/3424317456 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc0d4012370 con 0x7fc0e412d8a0 2023-09-30T22:25:05.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.437+0000 7ffb6bfff700 1 -- 172.21.15.40:0/656147840 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ffb7401a400 con 0x7ffb8409d400 2023-09-30T22:25:05.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.437+0000 7ffb6bfff700 1 -- 172.21.15.40:0/656147840 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7ffb740402e0 con 0x7ffb8409d400 2023-09-30T22:25:05.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.437+0000 7ffb82ffd700 1 -- 172.21.15.40:0/656147840 >> v1:172.21.15.40:6816/127432 conn(0x7ffb7002f540 legacy=0x7ffb700319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:05.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.441+0000 7ffb6bfff700 1 -- 172.21.15.40:0/656147840 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb740218f0 con 0x7ffb8409d400 2023-09-30T22:25:05.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.456+0000 7fdfae59c700 1 -- 172.21.15.40:0/880537431 >> v1:172.21.15.40:6816/127432 conn(0x7fdf9002f510 legacy=0x7fdf900319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:05.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.469+0000 7fdfb4dad700 1 -- 172.21.15.40:0/880537431 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdfb008b250 con 0x7fdfb006f980 2023-09-30T22:25:05.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.470+0000 7fdfa6ffd700 1 -- 172.21.15.40:0/880537431 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdf980239c0 con 0x7fdfb006f980 2023-09-30T22:25:05.470 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:05.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.472+0000 7fdfb4dad700 1 -- 172.21.15.40:0/880537431 >> v1:172.21.15.40:6816/127432 conn(0x7fdf9002f510 legacy=0x7fdf900319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:05.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.472+0000 7fdfb4dad700 1 -- 172.21.15.40:0/880537431 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdfb006f980 msgr2=0x7fdfb006ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.472+0000 7fdfb4dad700 1 --2- 172.21.15.40:0/880537431 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdfb006f980 0x7fdfb006ced0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdf98009870 tx=0x7fdf98004750 comp rx=0 tx=0).stop 2023-09-30T22:25:05.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.472+0000 7fdfb4dad700 1 -- 172.21.15.40:0/880537431 shutdown_connections 2023-09-30T22:25:05.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.472+0000 7fdfb4dad700 1 --2- 172.21.15.40:0/880537431 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdfb006f070 0x7fdfb006c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.472+0000 7fdfb4dad700 1 --2- 172.21.15.40:0/880537431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfb006fdb0 0x7fdfb006d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.472+0000 7fdfb4dad700 1 --2- 172.21.15.40:0/880537431 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdfb006f980 0x7fdfb006ced0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.472+0000 7fdfb4dad700 1 -- 172.21.15.40:0/880537431 >> 172.21.15.40:0/880537431 conn(0x7fdfb00a41a0 msgr2=0x7fdfb00a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:05.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.472+0000 7fdfb4dad700 1 -- 172.21.15.40:0/880537431 shutdown_connections 2023-09-30T22:25:05.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.472+0000 7fdfb4dad700 1 -- 172.21.15.40:0/880537431 wait complete. 2023-09-30T22:25:05.485 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:05.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.629+0000 7fb029ba6700 1 -- 172.21.15.40:0/2831619204 >> v1:172.21.15.40:6816/127432 conn(0x7fb00802f510 legacy=0x7fb0080319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:05.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.632+0000 7fc0e27fc700 1 -- 172.21.15.40:0/3424317456 >> v1:172.21.15.40:6816/127432 conn(0x7fc0d002f560 legacy=0x7fc0d0031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:05.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.634+0000 7fb02c60b700 1 -- 172.21.15.40:0/2831619204 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb024062380 con 0x7fb02409d450 2023-09-30T22:25:05.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.634+0000 7fb01affd700 1 -- 172.21.15.40:0/2831619204 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb020017030 con 0x7fb02409d450 2023-09-30T22:25:05.634 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:05.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.636+0000 7fb02c60b700 1 -- 172.21.15.40:0/2831619204 >> v1:172.21.15.40:6816/127432 conn(0x7fb00802f510 legacy=0x7fb0080319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:05.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.636+0000 7fb02c60b700 1 -- 172.21.15.40:0/2831619204 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb02409d450 msgr2=0x7fb02411f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.636+0000 7fb02c60b700 1 --2- 172.21.15.40:0/2831619204 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb02409d450 0x7fb02411f000 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb02000c4e0 tx=0x7fb02000c8a0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.636+0000 7fb02c60b700 1 -- 172.21.15.40:0/2831619204 shutdown_connections 2023-09-30T22:25:05.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.636+0000 7fb02c60b700 1 --2- 172.21.15.40:0/2831619204 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb024135940 0x7fb02411fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.636+0000 7fb02c60b700 1 --2- 172.21.15.40:0/2831619204 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb02409d450 0x7fb02411f000 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.636+0000 7fb02c60b700 1 --2- 172.21.15.40:0/2831619204 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb02409df30 0x7fb02411f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.636+0000 7fb02c60b700 1 -- 172.21.15.40:0/2831619204 >> 172.21.15.40:0/2831619204 conn(0x7fb0240a2a00 msgr2=0x7fb0240a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:05.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.636+0000 7fb02c60b700 1 -- 172.21.15.40:0/2831619204 shutdown_connections 2023-09-30T22:25:05.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.636+0000 7fb02c60b700 1 -- 172.21.15.40:0/2831619204 wait complete. 2023-09-30T22:25:05.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.639+0000 7ffb82ffd700 1 -- 172.21.15.40:0/656147840 >> v1:172.21.15.40:6816/127432 conn(0x7ffb7002f540 legacy=0x7ffb700319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:05.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.639+0000 7fc0e98a2700 1 -- 172.21.15.40:0/3424317456 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc0e4062380 con 0x7fc0e412d8a0 2023-09-30T22:25:05.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.639+0000 7fc0cbfff700 1 -- 172.21.15.40:0/3424317456 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc0d4021020 con 0x7fc0e412d8a0 2023-09-30T22:25:05.640 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:05.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.640+0000 7ffb89c15700 1 -- 172.21.15.40:0/656147840 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffb84062380 con 0x7ffb8409d400 2023-09-30T22:25:05.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.640+0000 7ffb6bfff700 1 -- 172.21.15.40:0/656147840 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffb74028090 con 0x7ffb8409d400 2023-09-30T22:25:05.640 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:05.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.641+0000 7fc0e98a2700 1 -- 172.21.15.40:0/3424317456 >> v1:172.21.15.40:6816/127432 conn(0x7fc0d002f560 legacy=0x7fc0d0031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:05.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.641+0000 7fc0e98a2700 1 -- 172.21.15.40:0/3424317456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0e412d8a0 msgr2=0x7fc0e41197d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.641+0000 7fc0e98a2700 1 --2- 172.21.15.40:0/3424317456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0e412d8a0 0x7fc0e41197d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc0d400e840 tx=0x7fc0d400ec00 comp rx=0 tx=0).stop 2023-09-30T22:25:05.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.641+0000 7fc0e98a2700 1 -- 172.21.15.40:0/3424317456 shutdown_connections 2023-09-30T22:25:05.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.641+0000 7fc0e98a2700 1 --2- 172.21.15.40:0/3424317456 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc0e412eea0 0x7fc0e411a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.641+0000 7fc0e98a2700 1 --2- 172.21.15.40:0/3424317456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0e412d8a0 0x7fc0e41197d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.641+0000 7fc0e98a2700 1 --2- 172.21.15.40:0/3424317456 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc0e412e590 0x7fc0e4119d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.641+0000 7fc0e98a2700 1 -- 172.21.15.40:0/3424317456 >> 172.21.15.40:0/3424317456 conn(0x7fc0e40a2a00 msgr2=0x7fc0e412c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:05.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.641+0000 7fc0e98a2700 1 -- 172.21.15.40:0/3424317456 shutdown_connections 2023-09-30T22:25:05.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.641+0000 7fc0e98a2700 1 -- 172.21.15.40:0/3424317456 wait complete. 2023-09-30T22:25:05.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.642+0000 7ffb89c15700 1 -- 172.21.15.40:0/656147840 >> v1:172.21.15.40:6816/127432 conn(0x7ffb7002f540 legacy=0x7ffb700319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:05.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.642+0000 7ffb89c15700 1 -- 172.21.15.40:0/656147840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb8409d400 msgr2=0x7ffb84126350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.642+0000 7ffb89c15700 1 --2- 172.21.15.40:0/656147840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb8409d400 0x7ffb84126350 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ffb7400b530 tx=0x7ffb7400b8f0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.642+0000 7ffb89c15700 1 -- 172.21.15.40:0/656147840 shutdown_connections 2023-09-30T22:25:05.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.642+0000 7ffb89c15700 1 --2- 172.21.15.40:0/656147840 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb84138250 0x7ffb8413a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.642+0000 7ffb89c15700 1 --2- 172.21.15.40:0/656147840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb8409d400 0x7ffb84126350 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.642+0000 7ffb89c15700 1 --2- 172.21.15.40:0/656147840 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb8409dd50 0x7ffb84126890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.642+0000 7ffb89c15700 1 -- 172.21.15.40:0/656147840 >> 172.21.15.40:0/656147840 conn(0x7ffb840a2a00 msgr2=0x7ffb8409f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:05.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.643+0000 7ffb89c15700 1 -- 172.21.15.40:0/656147840 shutdown_connections 2023-09-30T22:25:05.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:05.643+0000 7ffb89c15700 1 -- 172.21.15.40:0/656147840 wait complete. 2023-09-30T22:25:05.652 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:05.656 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:05.657 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:06.486 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:06.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.627+0000 7f585cba2700 1 Processor -- start 2023-09-30T22:25:06.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.627+0000 7f585cba2700 1 -- start start 2023-09-30T22:25:06.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.627+0000 7f585cba2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f585812e780 0x7f585812eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.627+0000 7f585cba2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5858132220 0x7f58581399f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.627+0000 7f585cba2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f585812f090 con 0x7f58581316b0 2023-09-30T22:25:06.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.628+0000 7f585cba2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f585812e560 con 0x7f585812e780 2023-09-30T22:25:06.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.628+0000 7f585cba2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585809b220 con 0x7f5858132220 2023-09-30T22:25:06.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.628+0000 7f5856d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5858132220 0x7f58581399f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.628+0000 7f585659c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f585812e780 0x7f585812eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.628+0000 7f5856d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5858132220 0x7f58581399f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38104/0 (socket says 172.21.15.40:38104) 2023-09-30T22:25:06.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.628+0000 7f585659c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f585812e780 0x7f585812eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56384/0 (socket says 172.21.15.40:56384) 2023-09-30T22:25:06.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.628+0000 7f5856d9d700 1 -- 172.21.15.40:0/1319188939 learned_addr learned my addr 172.21.15.40:0/1319188939 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:06.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.628+0000 7f585659c700 1 -- 172.21.15.40:0/1319188939 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5858132220 msgr2=0x7f58581399f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:06.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.628+0000 7f585659c700 1 --2- 172.21.15.40:0/1319188939 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5858132220 0x7f58581399f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.628+0000 7f585659c700 1 -- 172.21.15.40:0/1319188939 >> v1:172.21.15.40:6789/0 conn(0x7f58581316b0 legacy=0x7f5858131b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.628+0000 7f585659c700 1 -- 172.21.15.40:0/1319188939 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585809c4a0 con 0x7f585812e780 2023-09-30T22:25:06.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.628+0000 7f5856d9d700 1 --2- 172.21.15.40:0/1319188939 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5858132220 0x7f58581399f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:06.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.628+0000 7f585659c700 1 --2- 172.21.15.40:0/1319188939 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f585812e780 0x7f585812eb50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5848009820 tx=0x7f5848009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a43308729415be37 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:06.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.628+0000 7f585559a700 1 -- 172.21.15.40:0/1319188939 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5848005e30 con 0x7f585812e780 2023-09-30T22:25:06.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.628+0000 7f585559a700 1 -- 172.21.15.40:0/1319188939 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5848006030 con 0x7f585812e780 2023-09-30T22:25:06.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.628+0000 7f585559a700 1 -- 172.21.15.40:0/1319188939 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58480063c0 con 0x7f585812e780 2023-09-30T22:25:06.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.629+0000 7f585cba2700 1 -- 172.21.15.40:0/1319188939 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f585812e780 msgr2=0x7f585812eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.629+0000 7f585cba2700 1 --2- 172.21.15.40:0/1319188939 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f585812e780 0x7f585812eb50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5848009820 tx=0x7f5848009b30 comp rx=0 tx=0).stop 2023-09-30T22:25:06.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.629+0000 7f585cba2700 1 -- 172.21.15.40:0/1319188939 shutdown_connections 2023-09-30T22:25:06.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.629+0000 7f585cba2700 1 --2- 172.21.15.40:0/1319188939 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5858132220 0x7f58581399f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.629+0000 7f585cba2700 1 --2- 172.21.15.40:0/1319188939 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f585812e780 0x7f585812eb50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.629+0000 7f585cba2700 1 -- 172.21.15.40:0/1319188939 >> 172.21.15.40:0/1319188939 conn(0x7f585809eb10 msgr2=0x7f585809ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:06.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.629+0000 7f585cba2700 1 -- 172.21.15.40:0/1319188939 shutdown_connections 2023-09-30T22:25:06.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.629+0000 7f585cba2700 1 -- 172.21.15.40:0/1319188939 wait complete. 2023-09-30T22:25:06.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.630+0000 7f585cba2700 1 Processor -- start 2023-09-30T22:25:06.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.630+0000 7f585cba2700 1 -- start start 2023-09-30T22:25:06.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.630+0000 7f585cba2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f585812e780 0x7f5858098470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.631+0000 7f585cba2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f58581316b0 0x7f58580989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.631+0000 7f585cba2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5858132220 0x7f585806cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.631+0000 7f585cba2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585812c430 con 0x7f585812e780 2023-09-30T22:25:06.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.631+0000 7f585cba2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585812c710 con 0x7f5858132220 2023-09-30T22:25:06.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.631+0000 7f585cba2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f585809a0c0 con 0x7f58581316b0 2023-09-30T22:25:06.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.631+0000 7f585659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f585812e780 0x7f5858098470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.631+0000 7f5856d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5858132220 0x7f585806cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.631+0000 7f585659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f585812e780 0x7f5858098470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56388/0 (socket says 172.21.15.40:56388) 2023-09-30T22:25:06.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.631+0000 7f585659c700 1 -- 172.21.15.40:0/1483966011 learned_addr learned my addr 172.21.15.40:0/1483966011 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:06.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.631+0000 7f5856d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5858132220 0x7f585806cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38112/0 (socket says 172.21.15.40:38112) 2023-09-30T22:25:06.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.631+0000 7f5855d9b700 1 --2- 172.21.15.40:0/1483966011 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f58581316b0 0x7f58580989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.631+0000 7f585659c700 1 -- 172.21.15.40:0/1483966011 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f58581316b0 msgr2=0x7f58580989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.631+0000 7f585659c700 1 --2- 172.21.15.40:0/1483966011 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f58581316b0 0x7f58580989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.631+0000 7f585659c700 1 -- 172.21.15.40:0/1483966011 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5858132220 msgr2=0x7f585806cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.631+0000 7f585659c700 1 --2- 172.21.15.40:0/1483966011 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5858132220 0x7f585806cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.631+0000 7f585659c700 1 -- 172.21.15.40:0/1483966011 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5850009b30 con 0x7f585812e780 2023-09-30T22:25:06.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.631+0000 7f5856d9d700 1 --2- 172.21.15.40:0/1483966011 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5858132220 0x7f585806cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:06.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.631+0000 7f585659c700 1 --2- 172.21.15.40:0/1483966011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f585812e780 0x7f5858098470 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5848000c00 tx=0x7f5848004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:06.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.631+0000 7f5846ffd700 1 -- 172.21.15.40:0/1483966011 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58480061a0 con 0x7f585812e780 2023-09-30T22:25:06.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.631+0000 7f5846ffd700 1 -- 172.21.15.40:0/1483966011 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5848020070 con 0x7f585812e780 2023-09-30T22:25:06.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.631+0000 7f5846ffd700 1 -- 172.21.15.40:0/1483966011 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5848006540 con 0x7f585812e780 2023-09-30T22:25:06.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.631+0000 7f585cba2700 1 -- 172.21.15.40:0/1483966011 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5848009430 con 0x7f585812e780 2023-09-30T22:25:06.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.631+0000 7f585cba2700 1 -- 172.21.15.40:0/1483966011 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f585812c170 con 0x7f585812e780 2023-09-30T22:25:06.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.632+0000 7f5846ffd700 1 -- 172.21.15.40:0/1483966011 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5848022030 con 0x7f585812e780 2023-09-30T22:25:06.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.632+0000 7f5846ffd700 1 -- 172.21.15.40:0/1483966011 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f5848041110 con 0x7f585812e780 2023-09-30T22:25:06.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.632+0000 7f5855d9b700 1 -- 172.21.15.40:0/1483966011 >> v1:172.21.15.40:6816/127432 conn(0x7f583802f510 legacy=0x7f58380319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:06.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.632+0000 7f585cba2700 1 -- 172.21.15.40:0/1483966011 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5858062380 con 0x7f585812e780 2023-09-30T22:25:06.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.637+0000 7f5846ffd700 1 -- 172.21.15.40:0/1483966011 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f58480247e0 con 0x7f585812e780 2023-09-30T22:25:06.653 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:06.658 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:06.658 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:06.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.787+0000 7f32cc163700 1 Processor -- start 2023-09-30T22:25:06.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.787+0000 7f32cc163700 1 -- start start 2023-09-30T22:25:06.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.787+0000 7f32cc163700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32c409fbb0 0x7f32c406c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.787+0000 7f32cc163700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f32c406d2c0 0x7f32c413baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.787+0000 7f32cc163700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32c40a0590 con 0x7f32c406ced0 2023-09-30T22:25:06.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.787+0000 7f32cc163700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c409ff80 con 0x7f32c409fbb0 2023-09-30T22:25:06.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.787+0000 7f32cc163700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32c406da80 con 0x7f32c406d2c0 2023-09-30T22:25:06.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.788+0000 7f32c96fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f32c406ced0 0x7f32c4138370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:36758/0 (socket says 172.21.15.40:36758) 2023-09-30T22:25:06.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.788+0000 7f32c96fe700 1 -- 172.21.15.40:0/1231101021 learned_addr learned my addr 172.21.15.40:0/1231101021 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:06.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.788+0000 7f32ca700700 1 --2- 172.21.15.40:0/1231101021 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f32c406d2c0 0x7f32c413baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.788+0000 7f32c9eff700 1 --2- 172.21.15.40:0/1231101021 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32c409fbb0 0x7f32c406c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.788+0000 7f32c8efd700 1 -- 172.21.15.40:0/1231101021 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 38459787 0 0) 0x7f32c40a0590 con 0x7f32c406ced0 2023-09-30T22:25:06.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.788+0000 7f32c8efd700 1 -- 172.21.15.40:0/1231101021 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32b00035b0 con 0x7f32c406ced0 2023-09-30T22:25:06.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.788+0000 7f32c9eff700 1 -- 172.21.15.40:0/1231101021 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f32c406d2c0 msgr2=0x7f32c413baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:06.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.788+0000 7f32c9eff700 1 --2- 172.21.15.40:0/1231101021 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f32c406d2c0 0x7f32c413baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.788+0000 7f32c9eff700 1 -- 172.21.15.40:0/1231101021 >> v1:172.21.15.40:6789/0 conn(0x7f32c406ced0 legacy=0x7f32c4138370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.788+0000 7f32c9eff700 1 -- 172.21.15.40:0/1231101021 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c40a0780 con 0x7f32c409fbb0 2023-09-30T22:25:06.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.788+0000 7f32c9eff700 1 --2- 172.21.15.40:0/1231101021 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32c409fbb0 0x7f32c406c990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f32c0009870 tx=0x7f32c0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a49aa478b6e8e41 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:06.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.789+0000 7f32c8efd700 1 -- 172.21.15.40:0/1231101021 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c0011830 con 0x7f32c409fbb0 2023-09-30T22:25:06.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.789+0000 7f32c8efd700 1 -- 172.21.15.40:0/1231101021 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c0011990 con 0x7f32c409fbb0 2023-09-30T22:25:06.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.789+0000 7f32c8efd700 1 -- 172.21.15.40:0/1231101021 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c0011d20 con 0x7f32c409fbb0 2023-09-30T22:25:06.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.789+0000 7f32cc163700 1 -- 172.21.15.40:0/1231101021 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32c409fbb0 msgr2=0x7f32c406c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.789+0000 7f32cc163700 1 --2- 172.21.15.40:0/1231101021 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32c409fbb0 0x7f32c406c990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f32c0009870 tx=0x7f32c0009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:06.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.789+0000 7f32cc163700 1 -- 172.21.15.40:0/1231101021 shutdown_connections 2023-09-30T22:25:06.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.789+0000 7f32cc163700 1 --2- 172.21.15.40:0/1231101021 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f32c406d2c0 0x7f32c413baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.789+0000 7f32cc163700 1 --2- 172.21.15.40:0/1231101021 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32c409fbb0 0x7f32c406c990 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.789+0000 7f32cc163700 1 -- 172.21.15.40:0/1231101021 >> 172.21.15.40:0/1231101021 conn(0x7f32c40a41a0 msgr2=0x7f32c40a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:06.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.789+0000 7f32cc163700 1 -- 172.21.15.40:0/1231101021 shutdown_connections 2023-09-30T22:25:06.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.790+0000 7f32cc163700 1 -- 172.21.15.40:0/1231101021 wait complete. 2023-09-30T22:25:06.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.791+0000 7f32cc163700 1 Processor -- start 2023-09-30T22:25:06.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.791+0000 7f32cc163700 1 -- start start 2023-09-30T22:25:06.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.792+0000 7f32cc163700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f32c406ced0 0x7f32c408f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.792+0000 7f32cc163700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32c406d2c0 0x7f32c408f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.792+0000 7f32cc163700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32c409fbb0 0x7f32c408fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.792+0000 7f32cc163700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c40914c0 con 0x7f32c409fbb0 2023-09-30T22:25:06.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.792+0000 7f32cc163700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c4091de0 con 0x7f32c406d2c0 2023-09-30T22:25:06.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.792+0000 7f32cc163700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32c406f830 con 0x7f32c406ced0 2023-09-30T22:25:06.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.792+0000 7f32c9eff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f32c406ced0 0x7f32c408f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.792+0000 7f32c9eff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f32c406ced0 0x7f32c408f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:42486/0 (socket says 172.21.15.40:42486) 2023-09-30T22:25:06.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.792+0000 7f32c9eff700 1 -- 172.21.15.40:0/1872034620 learned_addr learned my addr 172.21.15.40:0/1872034620 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:06.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.792+0000 7f32c96fe700 1 --2- 172.21.15.40:0/1872034620 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32c406d2c0 0x7f32c408f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.792+0000 7f32ca700700 1 --2- 172.21.15.40:0/1872034620 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32c409fbb0 0x7f32c408fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.792+0000 7f32c9eff700 1 -- 172.21.15.40:0/1872034620 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32c406d2c0 msgr2=0x7f32c408f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.792+0000 7f32c9eff700 1 --2- 172.21.15.40:0/1872034620 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32c406d2c0 0x7f32c408f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.792+0000 7f32c9eff700 1 -- 172.21.15.40:0/1872034620 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32c409fbb0 msgr2=0x7f32c408fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.792+0000 7f32c9eff700 1 --2- 172.21.15.40:0/1872034620 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32c409fbb0 0x7f32c408fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.792+0000 7f32c9eff700 1 -- 172.21.15.40:0/1872034620 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c00094a0 con 0x7f32c406ced0 2023-09-30T22:25:06.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.793+0000 7f32c9eff700 1 --2- 172.21.15.40:0/1872034620 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f32c406ced0 0x7f32c408f3e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f32c0009bc0 tx=0x7f32c0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:06.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.793+0000 7f32ba7fc700 1 -- 172.21.15.40:0/1872034620 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c0004450 con 0x7f32c406ced0 2023-09-30T22:25:06.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.793+0000 7f32ba7fc700 1 -- 172.21.15.40:0/1872034620 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c00045b0 con 0x7f32c406ced0 2023-09-30T22:25:06.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.793+0000 7f32ba7fc700 1 -- 172.21.15.40:0/1872034620 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c00038e0 con 0x7f32c406ced0 2023-09-30T22:25:06.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.793+0000 7f32cc163700 1 -- 172.21.15.40:0/1872034620 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c406df90 con 0x7f32c406ced0 2023-09-30T22:25:06.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.793+0000 7f32cc163700 1 -- 172.21.15.40:0/1872034620 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c40926c0 con 0x7f32c406ced0 2023-09-30T22:25:06.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.794+0000 7f32ba7fc700 1 -- 172.21.15.40:0/1872034620 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f32c0003a40 con 0x7f32c406ced0 2023-09-30T22:25:06.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.794+0000 7f32cc163700 1 -- 172.21.15.40:0/1872034620 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c4062380 con 0x7f32c406ced0 2023-09-30T22:25:06.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.794+0000 7f32c96fe700 1 -- 172.21.15.40:0/1872034620 >> v1:172.21.15.40:6816/127432 conn(0x7f32a802f510 legacy=0x7f32a80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:06.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.794+0000 7f32ba7fc700 1 -- 172.21.15.40:0/1872034620 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f32c0040e70 con 0x7f32c406ced0 2023-09-30T22:25:06.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.803+0000 7f32ba7fc700 1 -- 172.21.15.40:0/1872034620 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f32c002d3b0 con 0x7f32c406ced0 2023-09-30T22:25:06.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.831+0000 7f07b5890700 1 Processor -- start 2023-09-30T22:25:06.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.831+0000 7f07b5890700 1 -- start start 2023-09-30T22:25:06.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.832+0000 7f07b5890700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f07b012e590 0x7f07b012e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.832+0000 7f07b5890700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07b012eea0 0x7f07b012d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.832+0000 7f07b5890700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07b012d6d0 0x7f07b012db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.832+0000 7f07b5890700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b009ca30 con 0x7f07b012e590 2023-09-30T22:25:06.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.832+0000 7f07b5890700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b009ab70 con 0x7f07b012d6d0 2023-09-30T22:25:06.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.832+0000 7f07b5890700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07b009bd70 con 0x7f07b012eea0 2023-09-30T22:25:06.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.832+0000 7f07ae7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07b012eea0 0x7f07b012d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.832+0000 7f07aeffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f07b012e590 0x7f07b012e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.832+0000 7f07ae7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07b012eea0 0x7f07b012d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:42492/0 (socket says 172.21.15.40:42492) 2023-09-30T22:25:06.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.832+0000 7f07aeffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f07b012e590 0x7f07b012e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56410/0 (socket says 172.21.15.40:56410) 2023-09-30T22:25:06.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.832+0000 7f07ae7fc700 1 -- 172.21.15.40:0/135255999 learned_addr learned my addr 172.21.15.40:0/135255999 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:06.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.832+0000 7f07af7fe700 1 --2- 172.21.15.40:0/135255999 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07b012d6d0 0x7f07b012db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.833+0000 7f07aeffd700 1 -- 172.21.15.40:0/135255999 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07b012eea0 msgr2=0x7f07b012d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:06.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.833+0000 7f07aeffd700 1 --2- 172.21.15.40:0/135255999 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07b012eea0 0x7f07b012d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.833+0000 7f07aeffd700 1 -- 172.21.15.40:0/135255999 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07b012d6d0 msgr2=0x7f07b012db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:06.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.833+0000 7f07aeffd700 1 --2- 172.21.15.40:0/135255999 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07b012d6d0 0x7f07b012db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.833+0000 7f07aeffd700 1 -- 172.21.15.40:0/135255999 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b009b270 con 0x7f07b012e590 2023-09-30T22:25:06.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.833+0000 7f07ae7fc700 1 --2- 172.21.15.40:0/135255999 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07b012eea0 0x7f07b012d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:06.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.833+0000 7f07af7fe700 1 --2- 172.21.15.40:0/135255999 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07b012d6d0 0x7f07b012db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:06.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.833+0000 7f07aeffd700 1 --2- 172.21.15.40:0/135255999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07b012e590 0x7f07b012e960 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f07a0009840 tx=0x7f07a0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dba8f888f6096468 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:06.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.833+0000 7f07adffb700 1 -- 172.21.15.40:0/135255999 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a0011830 con 0x7f07b012e590 2023-09-30T22:25:06.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.833+0000 7f07adffb700 1 -- 172.21.15.40:0/135255999 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a0011990 con 0x7f07b012e590 2023-09-30T22:25:06.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.833+0000 7f07adffb700 1 -- 172.21.15.40:0/135255999 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a0011d20 con 0x7f07b012e590 2023-09-30T22:25:06.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.834+0000 7f07b5890700 1 -- 172.21.15.40:0/135255999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07b012e590 msgr2=0x7f07b012e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.834+0000 7f07b5890700 1 --2- 172.21.15.40:0/135255999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07b012e590 0x7f07b012e960 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f07a0009840 tx=0x7f07a0009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:06.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.834+0000 7f07b5890700 1 -- 172.21.15.40:0/135255999 shutdown_connections 2023-09-30T22:25:06.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.834+0000 7f07b5890700 1 --2- 172.21.15.40:0/135255999 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07b012d6d0 0x7f07b012db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.834+0000 7f07b5890700 1 --2- 172.21.15.40:0/135255999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07b012e590 0x7f07b012e960 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.834+0000 7f07b5890700 1 --2- 172.21.15.40:0/135255999 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07b012eea0 0x7f07b012d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.834+0000 7f07b5890700 1 -- 172.21.15.40:0/135255999 >> 172.21.15.40:0/135255999 conn(0x7f07b00a2a00 msgr2=0x7f07b00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:06.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.834+0000 7f07b5890700 1 -- 172.21.15.40:0/135255999 shutdown_connections 2023-09-30T22:25:06.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.834+0000 7f07b5890700 1 -- 172.21.15.40:0/135255999 wait complete. 2023-09-30T22:25:06.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.833+0000 7f5855d9b700 1 -- 172.21.15.40:0/1483966011 >> v1:172.21.15.40:6816/127432 conn(0x7f583802f510 legacy=0x7f58380319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:06.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.835+0000 7f07b5890700 1 Processor -- start 2023-09-30T22:25:06.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.836+0000 7f07b5890700 1 -- start start 2023-09-30T22:25:06.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.836+0000 7f07b5890700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07b012d6d0 0x7f07b006e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.836+0000 7f07b5890700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07b012e590 0x7f07b006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.836+0000 7f07b5890700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07b012eea0 0x7f07b006f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.836+0000 7f07b5890700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b00708d0 con 0x7f07b012d6d0 2023-09-30T22:25:06.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.836+0000 7f07b5890700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b01269c0 con 0x7f07b012eea0 2023-09-30T22:25:06.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.836+0000 7f07b5890700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07b009a190 con 0x7f07b012e590 2023-09-30T22:25:06.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.837+0000 7f07ae7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07b012e590 0x7f07b006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.837+0000 7f07ae7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07b012e590 0x7f07b006ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:42508/0 (socket says 172.21.15.40:42508) 2023-09-30T22:25:06.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.837+0000 7f07aeffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07b012d6d0 0x7f07b006e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.837+0000 7f07ae7fc700 1 -- 172.21.15.40:0/2511641390 learned_addr learned my addr 172.21.15.40:0/2511641390 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:06.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.837+0000 7f07af7fe700 1 --2- 172.21.15.40:0/2511641390 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07b012eea0 0x7f07b006f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.837+0000 7f07ae7fc700 1 -- 172.21.15.40:0/2511641390 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07b012eea0 msgr2=0x7f07b006f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.837+0000 7f07ae7fc700 1 --2- 172.21.15.40:0/2511641390 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07b012eea0 0x7f07b006f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.837+0000 7f07ae7fc700 1 -- 172.21.15.40:0/2511641390 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07b012d6d0 msgr2=0x7f07b006e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.837+0000 7f07ae7fc700 1 --2- 172.21.15.40:0/2511641390 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07b012d6d0 0x7f07b006e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.837+0000 7f07ae7fc700 1 -- 172.21.15.40:0/2511641390 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a400b7f0 con 0x7f07b012e590 2023-09-30T22:25:06.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.837+0000 7f07aeffd700 1 --2- 172.21.15.40:0/2511641390 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07b012d6d0 0x7f07b006e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:06.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.837+0000 7f07af7fe700 1 --2- 172.21.15.40:0/2511641390 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07b012eea0 0x7f07b006f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:06.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.837+0000 7f07ae7fc700 1 --2- 172.21.15.40:0/2511641390 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07b012e590 0x7f07b006ee00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f07a400ed70 tx=0x7f07a400d630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:06.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.837+0000 7f0797fff700 1 -- 172.21.15.40:0/2511641390 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a400ee60 con 0x7f07b012e590 2023-09-30T22:25:06.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.838+0000 7f0797fff700 1 -- 172.21.15.40:0/2511641390 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a4010440 con 0x7f07b012e590 2023-09-30T22:25:06.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.838+0000 7f07b5890700 1 -- 172.21.15.40:0/2511641390 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07a00094a0 con 0x7f07b012e590 2023-09-30T22:25:06.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.838+0000 7f0797fff700 1 -- 172.21.15.40:0/2511641390 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a40107b0 con 0x7f07b012e590 2023-09-30T22:25:06.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.838+0000 7f07b5890700 1 -- 172.21.15.40:0/2511641390 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b01264e0 con 0x7f07b012e590 2023-09-30T22:25:06.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.839+0000 7f0797fff700 1 -- 172.21.15.40:0/2511641390 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f07a4010910 con 0x7f07b012e590 2023-09-30T22:25:06.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.839+0000 7f0797fff700 1 -- 172.21.15.40:0/2511641390 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f07a4041ce0 con 0x7f07b012e590 2023-09-30T22:25:06.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.839+0000 7f07aeffd700 1 -- 172.21.15.40:0/2511641390 >> v1:172.21.15.40:6816/127432 conn(0x7f079c02f510 legacy=0x7f079c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:06.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.839+0000 7f07b5890700 1 -- 172.21.15.40:0/2511641390 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07b0126180 con 0x7f07b012e590 2023-09-30T22:25:06.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.842+0000 7f9bca42e700 1 Processor -- start 2023-09-30T22:25:06.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.842+0000 7f9bca42e700 1 -- start start 2023-09-30T22:25:06.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.843+0000 7f9bca42e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9bc409d920 0x7f9bc409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.843+0000 7f9bca42e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bc409f0f0 0x7f9bc409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.843+0000 7f9bca42e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9bc4133ca0 0x7f9bc4134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.843+0000 7f9bca42e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bc406b4c0 con 0x7f9bc4133ca0 2023-09-30T22:25:06.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.843+0000 7f9bca42e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc409a8f0 con 0x7f9bc409f0f0 2023-09-30T22:25:06.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.843+0000 7f9bca42e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc409f940 con 0x7f9bc409d920 2023-09-30T22:25:06.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.843+0000 7f9bc89cb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9bc4133ca0 0x7f9bc4134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.843+0000 7f9bc37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bc409f0f0 0x7f9bc409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.843+0000 7f9bc89cb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9bc4133ca0 0x7f9bc4134140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56434/0 (socket says 172.21.15.40:56434) 2023-09-30T22:25:06.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.843+0000 7f9bc89cb700 1 -- 172.21.15.40:0/1396163777 learned_addr learned my addr 172.21.15.40:0/1396163777 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:06.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.843+0000 7f9bc37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bc409f0f0 0x7f9bc409e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38156/0 (socket says 172.21.15.40:38156) 2023-09-30T22:25:06.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.843+0000 7f9bc89cb700 1 -- 172.21.15.40:0/1396163777 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9bc409d920 msgr2=0x7f9bc409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:06.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.843+0000 7f9bc89cb700 1 --2- 172.21.15.40:0/1396163777 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9bc409d920 0x7f9bc409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.843+0000 7f9bc89cb700 1 -- 172.21.15.40:0/1396163777 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bc409f0f0 msgr2=0x7f9bc409e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:06.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.843+0000 7f9bc89cb700 1 --2- 172.21.15.40:0/1396163777 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bc409f0f0 0x7f9bc409e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.843+0000 7f9bc89cb700 1 -- 172.21.15.40:0/1396163777 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc409f6e0 con 0x7f9bc4133ca0 2023-09-30T22:25:06.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.843+0000 7f9bc37fe700 1 --2- 172.21.15.40:0/1396163777 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bc409f0f0 0x7f9bc409e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:06.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.844+0000 7f9bc89cb700 1 --2- 172.21.15.40:0/1396163777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bc4133ca0 0x7f9bc4134140 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc009e80 tx=0x7f9bbc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f019481c582730 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:06.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.844+0000 7f9bc2ffd700 1 -- 172.21.15.40:0/1396163777 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc00e070 con 0x7f9bc4133ca0 2023-09-30T22:25:06.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.844+0000 7f9bc2ffd700 1 -- 172.21.15.40:0/1396163777 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bbc00b8d0 con 0x7f9bc4133ca0 2023-09-30T22:25:06.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.844+0000 7f9bc2ffd700 1 -- 172.21.15.40:0/1396163777 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc00bc80 con 0x7f9bc4133ca0 2023-09-30T22:25:06.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.844+0000 7f9bca42e700 1 -- 172.21.15.40:0/1396163777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bc4133ca0 msgr2=0x7f9bc4134140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.844+0000 7f9bca42e700 1 --2- 172.21.15.40:0/1396163777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bc4133ca0 0x7f9bc4134140 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc009e80 tx=0x7f9bbc00b330 comp rx=0 tx=0).stop 2023-09-30T22:25:06.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.845+0000 7f9bca42e700 1 -- 172.21.15.40:0/1396163777 shutdown_connections 2023-09-30T22:25:06.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.845+0000 7f9bca42e700 1 --2- 172.21.15.40:0/1396163777 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9bc409d920 0x7f9bc409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.845+0000 7f9bca42e700 1 --2- 172.21.15.40:0/1396163777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bc4133ca0 0x7f9bc4134140 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.845+0000 7f9bca42e700 1 --2- 172.21.15.40:0/1396163777 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bc409f0f0 0x7f9bc409e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.845+0000 7f9bca42e700 1 -- 172.21.15.40:0/1396163777 >> 172.21.15.40:0/1396163777 conn(0x7f9bc409fb20 msgr2=0x7f9bc409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:06.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.845+0000 7f9bca42e700 1 -- 172.21.15.40:0/1396163777 shutdown_connections 2023-09-30T22:25:06.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.845+0000 7f9bca42e700 1 -- 172.21.15.40:0/1396163777 wait complete. 2023-09-30T22:25:06.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.845+0000 7f9bca42e700 1 Processor -- start 2023-09-30T22:25:06.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.846+0000 7f9bca42e700 1 -- start start 2023-09-30T22:25:06.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.846+0000 7f9bca42e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9bc409d920 0x7f9bc41218c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.846+0000 7f9bca42e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bc4133ca0 0x7f9bc4121e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.846+0000 7f9bca42e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bc4122340 0x7f9bc41c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.846+0000 7f9bca42e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc409c9e0 con 0x7f9bc4122340 2023-09-30T22:25:06.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.846+0000 7f9bca42e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc4125100 con 0x7f9bc4133ca0 2023-09-30T22:25:06.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.846+0000 7f9bca42e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc41235e0 con 0x7f9bc409d920 2023-09-30T22:25:06.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.846+0000 7f9bc37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bc4133ca0 0x7f9bc4121e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.846+0000 7f9bc37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bc4133ca0 0x7f9bc4121e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38172/0 (socket says 172.21.15.40:38172) 2023-09-30T22:25:06.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.846+0000 7f9bc37fe700 1 -- 172.21.15.40:0/2246072212 learned_addr learned my addr 172.21.15.40:0/2246072212 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:06.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.846+0000 7f9bc89cb700 1 --2- 172.21.15.40:0/2246072212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bc4122340 0x7f9bc41c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.846+0000 7f9bc3fff700 1 --2- 172.21.15.40:0/2246072212 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9bc409d920 0x7f9bc41218c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.847+0000 7f9bc37fe700 1 -- 172.21.15.40:0/2246072212 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9bc409d920 msgr2=0x7f9bc41218c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.847+0000 7f9bc37fe700 1 --2- 172.21.15.40:0/2246072212 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9bc409d920 0x7f9bc41218c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.847+0000 7f9bc37fe700 1 -- 172.21.15.40:0/2246072212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bc4122340 msgr2=0x7f9bc41c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.847+0000 7f9bc37fe700 1 --2- 172.21.15.40:0/2246072212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bc4122340 0x7f9bc41c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.847+0000 7f9bc37fe700 1 -- 172.21.15.40:0/2246072212 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb80094a0 con 0x7f9bc4133ca0 2023-09-30T22:25:06.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.847+0000 7f9bc37fe700 1 --2- 172.21.15.40:0/2246072212 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bc4133ca0 0x7f9bc4121e00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800ec10 tx=0x7f9bb800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:06.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.847+0000 7f9bc0ff9700 1 -- 172.21.15.40:0/2246072212 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb800c850 con 0x7f9bc4133ca0 2023-09-30T22:25:06.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.847+0000 7f9bc0ff9700 1 -- 172.21.15.40:0/2246072212 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb800c9b0 con 0x7f9bc4133ca0 2023-09-30T22:25:06.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.847+0000 7f9bca42e700 1 -- 172.21.15.40:0/2246072212 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bbc009b30 con 0x7f9bc4133ca0 2023-09-30T22:25:06.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.847+0000 7f9bc0ff9700 1 -- 172.21.15.40:0/2246072212 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb800cd20 con 0x7f9bc4133ca0 2023-09-30T22:25:06.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.847+0000 7f9bca42e700 1 -- 172.21.15.40:0/2246072212 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bc41323e0 con 0x7f9bc4133ca0 2023-09-30T22:25:06.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.848+0000 7f9bc0ff9700 1 -- 172.21.15.40:0/2246072212 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9bb8013470 con 0x7f9bc4133ca0 2023-09-30T22:25:06.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.848+0000 7f9bca42e700 1 -- 172.21.15.40:0/2246072212 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bc4062380 con 0x7f9bc4133ca0 2023-09-30T22:25:06.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.849+0000 7f9bc0ff9700 1 -- 172.21.15.40:0/2246072212 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f9bb80417f0 con 0x7f9bc4133ca0 2023-09-30T22:25:06.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.849+0000 7f9bc3fff700 1 -- 172.21.15.40:0/2246072212 >> v1:172.21.15.40:6816/127432 conn(0x7f9bb002f510 legacy=0x7f9bb00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:06.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.849+0000 7f0797fff700 1 -- 172.21.15.40:0/2511641390 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f07a4045060 con 0x7f07b012e590 2023-09-30T22:25:06.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.853+0000 7f9bc0ff9700 1 -- 172.21.15.40:0/2246072212 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9bb8045060 con 0x7f9bc4133ca0 2023-09-30T22:25:06.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.856+0000 7f585cba2700 1 -- 172.21.15.40:0/1483966011 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f585812c570 con 0x7f585812e780 2023-09-30T22:25:06.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.857+0000 7f5846ffd700 1 -- 172.21.15.40:0/1483966011 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f585812c570 con 0x7f585812e780 2023-09-30T22:25:06.857 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:06.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.859+0000 7f585cba2700 1 -- 172.21.15.40:0/1483966011 >> v1:172.21.15.40:6816/127432 conn(0x7f583802f510 legacy=0x7f58380319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:06.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.859+0000 7f585cba2700 1 -- 172.21.15.40:0/1483966011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f585812e780 msgr2=0x7f5858098470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.859+0000 7f585cba2700 1 --2- 172.21.15.40:0/1483966011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f585812e780 0x7f5858098470 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5848000c00 tx=0x7f5848004750 comp rx=0 tx=0).stop 2023-09-30T22:25:06.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.859+0000 7f585cba2700 1 -- 172.21.15.40:0/1483966011 shutdown_connections 2023-09-30T22:25:06.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.859+0000 7f585cba2700 1 --2- 172.21.15.40:0/1483966011 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5858132220 0x7f585806cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.859+0000 7f585cba2700 1 --2- 172.21.15.40:0/1483966011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f585812e780 0x7f5858098470 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.859+0000 7f585cba2700 1 --2- 172.21.15.40:0/1483966011 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f58581316b0 0x7f58580989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.859+0000 7f585cba2700 1 -- 172.21.15.40:0/1483966011 >> 172.21.15.40:0/1483966011 conn(0x7f585809eb10 msgr2=0x7f5858070f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:06.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.859+0000 7f585cba2700 1 -- 172.21.15.40:0/1483966011 shutdown_connections 2023-09-30T22:25:06.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.859+0000 7f585cba2700 1 -- 172.21.15.40:0/1483966011 wait complete. 2023-09-30T22:25:06.872 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:06.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:06.995+0000 7f32c96fe700 1 -- 172.21.15.40:0/1872034620 >> v1:172.21.15.40:6816/127432 conn(0x7f32a802f510 legacy=0x7f32a80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:07.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.014+0000 7f32cc163700 1 -- 172.21.15.40:0/1872034620 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f32c4074620 con 0x7f32c406ced0 2023-09-30T22:25:07.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.014+0000 7f32ba7fc700 1 -- 172.21.15.40:0/1872034620 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f32c0015070 con 0x7f32c406ced0 2023-09-30T22:25:07.015 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:07.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.017+0000 7f32cc163700 1 -- 172.21.15.40:0/1872034620 >> v1:172.21.15.40:6816/127432 conn(0x7f32a802f510 legacy=0x7f32a80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:07.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.017+0000 7f32cc163700 1 -- 172.21.15.40:0/1872034620 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f32c406ced0 msgr2=0x7f32c408f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:07.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.017+0000 7f32cc163700 1 --2- 172.21.15.40:0/1872034620 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f32c406ced0 0x7f32c408f3e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f32c0009bc0 tx=0x7f32c0004750 comp rx=0 tx=0).stop 2023-09-30T22:25:07.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.017+0000 7f32cc163700 1 -- 172.21.15.40:0/1872034620 shutdown_connections 2023-09-30T22:25:07.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.017+0000 7f32cc163700 1 --2- 172.21.15.40:0/1872034620 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f32c406ced0 0x7f32c408f3e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:07.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.017+0000 7f32cc163700 1 --2- 172.21.15.40:0/1872034620 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32c409fbb0 0x7f32c408fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:07.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.017+0000 7f32cc163700 1 --2- 172.21.15.40:0/1872034620 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32c406d2c0 0x7f32c408f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:07.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.017+0000 7f32cc163700 1 -- 172.21.15.40:0/1872034620 >> 172.21.15.40:0/1872034620 conn(0x7f32c40a41a0 msgr2=0x7f32c40a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:07.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.017+0000 7f32cc163700 1 -- 172.21.15.40:0/1872034620 shutdown_connections 2023-09-30T22:25:07.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.018+0000 7f32cc163700 1 -- 172.21.15.40:0/1872034620 wait complete. 2023-09-30T22:25:07.034 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:07.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.040+0000 7f07aeffd700 1 -- 172.21.15.40:0/2511641390 >> v1:172.21.15.40:6816/127432 conn(0x7f079c02f510 legacy=0x7f079c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:07.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.046+0000 7f07b5890700 1 -- 172.21.15.40:0/2511641390 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f07b0062380 con 0x7f07b012e590 2023-09-30T22:25:07.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.046+0000 7f0797fff700 1 -- 172.21.15.40:0/2511641390 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f07a4015b30 con 0x7f07b012e590 2023-09-30T22:25:07.047 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:07.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.048+0000 7f07b5890700 1 -- 172.21.15.40:0/2511641390 >> v1:172.21.15.40:6816/127432 conn(0x7f079c02f510 legacy=0x7f079c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:07.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.048+0000 7f07b5890700 1 -- 172.21.15.40:0/2511641390 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07b012e590 msgr2=0x7f07b006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:07.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.048+0000 7f07b5890700 1 --2- 172.21.15.40:0/2511641390 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07b012e590 0x7f07b006ee00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f07a400ed70 tx=0x7f07a400d630 comp rx=0 tx=0).stop 2023-09-30T22:25:07.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.048+0000 7f07b5890700 1 -- 172.21.15.40:0/2511641390 shutdown_connections 2023-09-30T22:25:07.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.048+0000 7f07b5890700 1 --2- 172.21.15.40:0/2511641390 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07b012eea0 0x7f07b006f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:07.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.048+0000 7f07b5890700 1 --2- 172.21.15.40:0/2511641390 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07b012d6d0 0x7f07b006e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:07.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.048+0000 7f07b5890700 1 --2- 172.21.15.40:0/2511641390 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07b012e590 0x7f07b006ee00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:07.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.048+0000 7f07b5890700 1 -- 172.21.15.40:0/2511641390 >> 172.21.15.40:0/2511641390 conn(0x7f07b00a2a00 msgr2=0x7f07b009d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:07.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.049+0000 7f07b5890700 1 -- 172.21.15.40:0/2511641390 shutdown_connections 2023-09-30T22:25:07.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.049+0000 7f07b5890700 1 -- 172.21.15.40:0/2511641390 wait complete. 2023-09-30T22:25:07.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.050+0000 7f9bc3fff700 1 -- 172.21.15.40:0/2246072212 >> v1:172.21.15.40:6816/127432 conn(0x7f9bb002f510 legacy=0x7f9bb00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:07.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.059+0000 7f9bca42e700 1 -- 172.21.15.40:0/2246072212 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9bc4074720 con 0x7f9bc4133ca0 2023-09-30T22:25:07.061 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:07.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.060+0000 7f9bc0ff9700 1 -- 172.21.15.40:0/2246072212 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9bb8017090 con 0x7f9bc4133ca0 2023-09-30T22:25:07.063 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:07.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.062+0000 7f9bca42e700 1 -- 172.21.15.40:0/2246072212 >> v1:172.21.15.40:6816/127432 conn(0x7f9bb002f510 legacy=0x7f9bb00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:07.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.062+0000 7f9bca42e700 1 -- 172.21.15.40:0/2246072212 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bc4133ca0 msgr2=0x7f9bc4121e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:07.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.062+0000 7f9bca42e700 1 --2- 172.21.15.40:0/2246072212 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bc4133ca0 0x7f9bc4121e00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800ec10 tx=0x7f9bb800ef20 comp rx=0 tx=0).stop 2023-09-30T22:25:07.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.062+0000 7f9bca42e700 1 -- 172.21.15.40:0/2246072212 shutdown_connections 2023-09-30T22:25:07.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.062+0000 7f9bca42e700 1 --2- 172.21.15.40:0/2246072212 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9bc409d920 0x7f9bc41218c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:07.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.062+0000 7f9bca42e700 1 --2- 172.21.15.40:0/2246072212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bc4122340 0x7f9bc41c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:07.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.062+0000 7f9bca42e700 1 --2- 172.21.15.40:0/2246072212 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bc4133ca0 0x7f9bc4121e00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:07.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.062+0000 7f9bca42e700 1 -- 172.21.15.40:0/2246072212 >> 172.21.15.40:0/2246072212 conn(0x7f9bc409fb20 msgr2=0x7f9bc4070310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:07.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.062+0000 7f9bca42e700 1 -- 172.21.15.40:0/2246072212 shutdown_connections 2023-09-30T22:25:07.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:07.062+0000 7f9bca42e700 1 -- 172.21.15.40:0/2246072212 wait complete. 2023-09-30T22:25:07.075 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:07.874 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:08.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.014+0000 7fbd766e5700 1 Processor -- start 2023-09-30T22:25:08.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.014+0000 7fbd766e5700 1 -- start start 2023-09-30T22:25:08.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.014+0000 7fbd766e5700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbd7009c890 0x7fbd7009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.014+0000 7fbd766e5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbd7009d920 0x7fbd7009dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.014+0000 7fbd766e5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd7009e2b0 0x7fbd7013ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.015+0000 7fbd766e5700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd700a29d0 con 0x7fbd7009c890 2023-09-30T22:25:08.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.015+0000 7fbd766e5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7009fb40 con 0x7fbd7009e2b0 2023-09-30T22:25:08.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.015+0000 7fbd766e5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd700a2600 con 0x7fbd7009d920 2023-09-30T22:25:08.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.015+0000 7fbd6ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbd7009c890 0x7fbd7009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.015+0000 7fbd74c82700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd7009e2b0 0x7fbd7013ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.015+0000 7fbd6f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbd7009d920 0x7fbd7009dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.015+0000 7fbd6ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbd7009c890 0x7fbd7009cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56454/0 (socket says 172.21.15.40:56454) 2023-09-30T22:25:08.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.015+0000 7fbd6ffff700 1 -- 172.21.15.40:0/2958556126 learned_addr learned my addr 172.21.15.40:0/2958556126 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:08.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.015+0000 7fbd74c82700 1 -- 172.21.15.40:0/2958556126 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbd7009d920 msgr2=0x7fbd7009dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:08.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.015+0000 7fbd74c82700 1 --2- 172.21.15.40:0/2958556126 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbd7009d920 0x7fbd7009dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.015+0000 7fbd74c82700 1 -- 172.21.15.40:0/2958556126 >> v2:172.21.15.40:3300/0 conn(0x7fbd7009c890 msgr2=0x7fbd7009cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:08.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.015+0000 7fbd74c82700 1 --2- 172.21.15.40:0/2958556126 >> v2:172.21.15.40:3300/0 conn(0x7fbd7009c890 0x7fbd7009cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.015+0000 7fbd74c82700 1 -- 172.21.15.40:0/2958556126 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd7009fed0 con 0x7fbd7009e2b0 2023-09-30T22:25:08.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.015+0000 7fbd6ffff700 1 --2- 172.21.15.40:0/2958556126 >> v2:172.21.15.40:3300/0 conn(0x7fbd7009c890 0x7fbd7009cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:08.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.015+0000 7fbd6f7fe700 1 --2- 172.21.15.40:0/2958556126 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbd7009d920 0x7fbd7009dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:08.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.015+0000 7fbd74c82700 1 --2- 172.21.15.40:0/2958556126 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd7009e2b0 0x7fbd7013ac10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbd68009d90 tx=0x7fbd6800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eecebf68d3b9d672 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:08.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.015+0000 7fbd6effd700 1 -- 172.21.15.40:0/2958556126 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6800e070 con 0x7fbd7009e2b0 2023-09-30T22:25:08.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.015+0000 7fbd6effd700 1 -- 172.21.15.40:0/2958556126 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6800bb20 con 0x7fbd7009e2b0 2023-09-30T22:25:08.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.015+0000 7fbd6effd700 1 -- 172.21.15.40:0/2958556126 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd68012430 con 0x7fbd7009e2b0 2023-09-30T22:25:08.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.016+0000 7fbd766e5700 1 -- 172.21.15.40:0/2958556126 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd7009e2b0 msgr2=0x7fbd7013ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.016+0000 7fbd766e5700 1 --2- 172.21.15.40:0/2958556126 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd7009e2b0 0x7fbd7013ac10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbd68009d90 tx=0x7fbd6800b330 comp rx=0 tx=0).stop 2023-09-30T22:25:08.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.016+0000 7fbd766e5700 1 -- 172.21.15.40:0/2958556126 shutdown_connections 2023-09-30T22:25:08.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.016+0000 7fbd766e5700 1 --2- 172.21.15.40:0/2958556126 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd7009e2b0 0x7fbd7013ac10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.016+0000 7fbd766e5700 1 --2- 172.21.15.40:0/2958556126 >> v2:172.21.15.40:3300/0 conn(0x7fbd7009c890 0x7fbd7009cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.016+0000 7fbd766e5700 1 --2- 172.21.15.40:0/2958556126 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbd7009d920 0x7fbd7009dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.016+0000 7fbd766e5700 1 -- 172.21.15.40:0/2958556126 >> 172.21.15.40:0/2958556126 conn(0x7fbd700a7080 msgr2=0x7fbd700a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:08.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.016+0000 7fbd766e5700 1 -- 172.21.15.40:0/2958556126 shutdown_connections 2023-09-30T22:25:08.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.016+0000 7fbd766e5700 1 -- 172.21.15.40:0/2958556126 wait complete. 2023-09-30T22:25:08.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.017+0000 7fbd766e5700 1 Processor -- start 2023-09-30T22:25:08.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.017+0000 7fbd766e5700 1 -- start start 2023-09-30T22:25:08.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.017+0000 7fbd766e5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd7009c890 0x7fbd7012d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.018+0000 7fbd766e5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd7009d920 0x7fbd7012d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.018+0000 7fbd766e5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbd7009e2b0 0x7fbd7012de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.018+0000 7fbd766e5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7012e780 con 0x7fbd7009c890 2023-09-30T22:25:08.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.018+0000 7fbd766e5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7009ecf0 con 0x7fbd7009d920 2023-09-30T22:25:08.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.018+0000 7fbd766e5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7012f020 con 0x7fbd7009e2b0 2023-09-30T22:25:08.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.018+0000 7fbd6ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd7009c890 0x7fbd7012d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.018+0000 7fbd74c82700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbd7009e2b0 0x7fbd7012de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.018+0000 7fbd6ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd7009c890 0x7fbd7012d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56460/0 (socket says 172.21.15.40:56460) 2023-09-30T22:25:08.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.018+0000 7fbd6ffff700 1 -- 172.21.15.40:0/2806994519 learned_addr learned my addr 172.21.15.40:0/2806994519 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:08.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.018+0000 7fbd6f7fe700 1 --2- 172.21.15.40:0/2806994519 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd7009d920 0x7fbd7012d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.018+0000 7fbd6ffff700 1 -- 172.21.15.40:0/2806994519 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbd7009e2b0 msgr2=0x7fbd7012de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.018+0000 7fbd6ffff700 1 --2- 172.21.15.40:0/2806994519 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbd7009e2b0 0x7fbd7012de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.018+0000 7fbd6ffff700 1 -- 172.21.15.40:0/2806994519 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd7009d920 msgr2=0x7fbd7012d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.018+0000 7fbd6ffff700 1 --2- 172.21.15.40:0/2806994519 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd7009d920 0x7fbd7012d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.018+0000 7fbd6ffff700 1 -- 172.21.15.40:0/2806994519 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd60009500 con 0x7fbd7009c890 2023-09-30T22:25:08.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.018+0000 7fbd6f7fe700 1 --2- 172.21.15.40:0/2806994519 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd7009d920 0x7fbd7012d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:08.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.018+0000 7fbd6ffff700 1 --2- 172.21.15.40:0/2806994519 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd7009c890 0x7fbd7012d3b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbd6000ebb0 tx=0x7fbd6000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:08.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.018+0000 7fbd6cff9700 1 -- 172.21.15.40:0/2806994519 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd60009790 con 0x7fbd7009c890 2023-09-30T22:25:08.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.018+0000 7fbd6cff9700 1 -- 172.21.15.40:0/2806994519 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd60005a20 con 0x7fbd7009c890 2023-09-30T22:25:08.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.018+0000 7fbd766e5700 1 -- 172.21.15.40:0/2806994519 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd640094a0 con 0x7fbd7009c890 2023-09-30T22:25:08.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.018+0000 7fbd6cff9700 1 -- 172.21.15.40:0/2806994519 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd60005db0 con 0x7fbd7009c890 2023-09-30T22:25:08.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.018+0000 7fbd766e5700 1 -- 172.21.15.40:0/2806994519 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd68009a70 con 0x7fbd7009c890 2023-09-30T22:25:08.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.019+0000 7fbd6cff9700 1 -- 172.21.15.40:0/2806994519 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fbd6000c850 con 0x7fbd7009c890 2023-09-30T22:25:08.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.019+0000 7fbd6cff9700 1 -- 172.21.15.40:0/2806994519 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7fbd6003fe70 con 0x7fbd7009c890 2023-09-30T22:25:08.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.019+0000 7fbd6f7fe700 1 -- 172.21.15.40:0/2806994519 >> v1:172.21.15.40:6816/127432 conn(0x7fbd5c02f510 legacy=0x7fbd5c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:08.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.020+0000 7fbd766e5700 1 -- 172.21.15.40:0/2806994519 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd70062380 con 0x7fbd7009c890 2023-09-30T22:25:08.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.024+0000 7fbd6cff9700 1 -- 172.21.15.40:0/2806994519 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbd60006030 con 0x7fbd7009c890 2023-09-30T22:25:08.035 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:08.063 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:08.075 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:08.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.177+0000 7f3c66464700 1 Processor -- start 2023-09-30T22:25:08.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.177+0000 7f3c66464700 1 -- start start 2023-09-30T22:25:08.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.178+0000 7f3c66464700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c6006a6d0 0x7f3c6009d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.178+0000 7f3c66464700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3c6009de60 0x7f3c6009e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.178+0000 7f3c66464700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c6013c490 0x7f3c6013e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.178+0000 7f3c66464700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c6006aaa0 con 0x7f3c6009de60 2023-09-30T22:25:08.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.178+0000 7f3c66464700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6009e790 con 0x7f3c6006a6d0 2023-09-30T22:25:08.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.178+0000 7f3c66464700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6006b150 con 0x7f3c6013c490 2023-09-30T22:25:08.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.178+0000 7f3c64a01700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c6013c490 0x7f3c6013e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.178+0000 7f3c5f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3c6009de60 0x7f3c6009e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.178+0000 7f3c64a01700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c6013c490 0x7f3c6013e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:42556/0 (socket says 172.21.15.40:42556) 2023-09-30T22:25:08.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.178+0000 7f3c64a01700 1 -- 172.21.15.40:0/1015069647 learned_addr learned my addr 172.21.15.40:0/1015069647 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:08.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.178+0000 7f3c5f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3c6009de60 0x7f3c6009e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56462/0 (socket says 172.21.15.40:56462) 2023-09-30T22:25:08.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.178+0000 7f3c5ffff700 1 --2- 172.21.15.40:0/1015069647 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c6006a6d0 0x7f3c6009d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.179+0000 7f3c64a01700 1 -- 172.21.15.40:0/1015069647 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c6006a6d0 msgr2=0x7f3c6009d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:08.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.179+0000 7f3c64a01700 1 --2- 172.21.15.40:0/1015069647 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c6006a6d0 0x7f3c6009d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.179+0000 7f3c64a01700 1 -- 172.21.15.40:0/1015069647 >> v2:172.21.15.40:3300/0 conn(0x7f3c6009de60 msgr2=0x7f3c6009e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:08.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.179+0000 7f3c64a01700 1 --2- 172.21.15.40:0/1015069647 >> v2:172.21.15.40:3300/0 conn(0x7f3c6009de60 0x7f3c6009e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.179+0000 7f3c64a01700 1 -- 172.21.15.40:0/1015069647 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6009f300 con 0x7f3c6013c490 2023-09-30T22:25:08.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.179+0000 7f3c5f7fe700 1 --2- 172.21.15.40:0/1015069647 >> v2:172.21.15.40:3300/0 conn(0x7f3c6009de60 0x7f3c6009e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:08.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.179+0000 7f3c64a01700 1 --2- 172.21.15.40:0/1015069647 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c6013c490 0x7f3c6013e870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3c58009e80 tx=0x7f3c5800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e2284f9c007735d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:08.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.179+0000 7f3c5effd700 1 -- 172.21.15.40:0/1015069647 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5800e070 con 0x7f3c6013c490 2023-09-30T22:25:08.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.179+0000 7f3c5effd700 1 -- 172.21.15.40:0/1015069647 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5800b870 con 0x7f3c6013c490 2023-09-30T22:25:08.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.179+0000 7f3c5effd700 1 -- 172.21.15.40:0/1015069647 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5800bc20 con 0x7f3c6013c490 2023-09-30T22:25:08.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.180+0000 7f3c66464700 1 -- 172.21.15.40:0/1015069647 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c6013c490 msgr2=0x7f3c6013e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.180+0000 7f3c66464700 1 --2- 172.21.15.40:0/1015069647 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c6013c490 0x7f3c6013e870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3c58009e80 tx=0x7f3c5800b330 comp rx=0 tx=0).stop 2023-09-30T22:25:08.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.180+0000 7f3c66464700 1 -- 172.21.15.40:0/1015069647 shutdown_connections 2023-09-30T22:25:08.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.180+0000 7f3c66464700 1 --2- 172.21.15.40:0/1015069647 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c6013c490 0x7f3c6013e870 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.180+0000 7f3c66464700 1 --2- 172.21.15.40:0/1015069647 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c6006a6d0 0x7f3c6009d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.180+0000 7f3c66464700 1 --2- 172.21.15.40:0/1015069647 >> v2:172.21.15.40:3300/0 conn(0x7f3c6009de60 0x7f3c6009e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.180+0000 7f3c66464700 1 -- 172.21.15.40:0/1015069647 >> 172.21.15.40:0/1015069647 conn(0x7f3c6009fb20 msgr2=0x7f3c6009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:08.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.180+0000 7f3c66464700 1 -- 172.21.15.40:0/1015069647 shutdown_connections 2023-09-30T22:25:08.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.180+0000 7f3c66464700 1 -- 172.21.15.40:0/1015069647 wait complete. 2023-09-30T22:25:08.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.181+0000 7f3c66464700 1 Processor -- start 2023-09-30T22:25:08.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.181+0000 7f3c66464700 1 -- start start 2023-09-30T22:25:08.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.182+0000 7f3c66464700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c6006a6d0 0x7f3c6013a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.182+0000 7f3c66464700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c6009de60 0x7f3c6013aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.182+0000 7f3c66464700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c6013c490 0x7f3c6013b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.182+0000 7f3c66464700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6009c660 con 0x7f3c6009de60 2023-09-30T22:25:08.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.182+0000 7f3c66464700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6009f540 con 0x7f3c6013c490 2023-09-30T22:25:08.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.182+0000 7f3c66464700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6011f790 con 0x7f3c6006a6d0 2023-09-30T22:25:08.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.182+0000 7f3c5ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c6006a6d0 0x7f3c6013a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.182+0000 7f3c5ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c6006a6d0 0x7f3c6013a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:42568/0 (socket says 172.21.15.40:42568) 2023-09-30T22:25:08.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.182+0000 7f3c5ffff700 1 -- 172.21.15.40:0/331559623 learned_addr learned my addr 172.21.15.40:0/331559623 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:08.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.182+0000 7f3c5f7fe700 1 --2- 172.21.15.40:0/331559623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c6009de60 0x7f3c6013aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.182+0000 7f3c64a01700 1 --2- 172.21.15.40:0/331559623 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c6013c490 0x7f3c6013b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.183+0000 7f3c5f7fe700 1 -- 172.21.15.40:0/331559623 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c6006a6d0 msgr2=0x7f3c6013a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.183+0000 7f3c5f7fe700 1 --2- 172.21.15.40:0/331559623 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c6006a6d0 0x7f3c6013a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.183+0000 7f3c5f7fe700 1 -- 172.21.15.40:0/331559623 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c6013c490 msgr2=0x7f3c6013b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.183+0000 7f3c5f7fe700 1 --2- 172.21.15.40:0/331559623 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c6013c490 0x7f3c6013b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.183+0000 7f3c5f7fe700 1 -- 172.21.15.40:0/331559623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c540094a0 con 0x7f3c6009de60 2023-09-30T22:25:08.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.183+0000 7f3c64a01700 1 --2- 172.21.15.40:0/331559623 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c6013c490 0x7f3c6013b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:08.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.183+0000 7f3c5f7fe700 1 --2- 172.21.15.40:0/331559623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c6009de60 0x7f3c6013aee0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3c5400e980 tx=0x7f3c5400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:08.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.183+0000 7f3c5cff9700 1 -- 172.21.15.40:0/331559623 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5400c690 con 0x7f3c6009de60 2023-09-30T22:25:08.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.183+0000 7f3c66464700 1 -- 172.21.15.40:0/331559623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c58009b30 con 0x7f3c6009de60 2023-09-30T22:25:08.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.183+0000 7f3c5cff9700 1 -- 172.21.15.40:0/331559623 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5400c7f0 con 0x7f3c6009de60 2023-09-30T22:25:08.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.183+0000 7f3c5cff9700 1 -- 172.21.15.40:0/331559623 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5400cb80 con 0x7f3c6009de60 2023-09-30T22:25:08.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.183+0000 7f3c66464700 1 -- 172.21.15.40:0/331559623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c6013c280 con 0x7f3c6009de60 2023-09-30T22:25:08.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.184+0000 7f3c5cff9700 1 -- 172.21.15.40:0/331559623 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3c5400cce0 con 0x7f3c6009de60 2023-09-30T22:25:08.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.184+0000 7f3c66464700 1 -- 172.21.15.40:0/331559623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c60062380 con 0x7f3c6009de60 2023-09-30T22:25:08.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.184+0000 7f3c5ffff700 1 -- 172.21.15.40:0/331559623 >> v1:172.21.15.40:6816/127432 conn(0x7f3c4c02f510 legacy=0x7f3c4c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:08.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.184+0000 7f3c5cff9700 1 -- 172.21.15.40:0/331559623 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f3c54013990 con 0x7f3c6009de60 2023-09-30T22:25:08.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.193+0000 7f3c5cff9700 1 -- 172.21.15.40:0/331559623 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3c54045060 con 0x7f3c6009de60 2023-09-30T22:25:08.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.217+0000 7f20c1c3b700 1 Processor -- start 2023-09-30T22:25:08.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.217+0000 7f20c1c3b700 1 -- start start 2023-09-30T22:25:08.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.217+0000 7f20c1c3b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20bc136c50 0x7f20bc139030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.217+0000 7f20c1c3b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20bc139570 0x7f20bc13b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.217+0000 7f20c1c3b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20bc133940 con 0x7f20bc133e00 2023-09-30T22:25:08.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.217+0000 7f20c1c3b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc09af70 con 0x7f20bc136c50 2023-09-30T22:25:08.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.217+0000 7f20c1c3b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc09ab20 con 0x7f20bc139570 2023-09-30T22:25:08.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.218+0000 7f20bb7fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f20bc133e00 0x7f20bc1341d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:36764/0 (socket says 172.21.15.40:36764) 2023-09-30T22:25:08.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.218+0000 7f20bb7fe700 1 -- 172.21.15.40:0/170891331 learned_addr learned my addr 172.21.15.40:0/170891331 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:08.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.218+0000 7f20baffd700 1 --2- 172.21.15.40:0/170891331 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20bc136c50 0x7f20bc139030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.218+0000 7f20bbfff700 1 --2- 172.21.15.40:0/170891331 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20bc139570 0x7f20bc13b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.218+0000 7f20baffd700 1 -- 172.21.15.40:0/170891331 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20bc139570 msgr2=0x7f20bc13b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:08.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.218+0000 7f20baffd700 1 --2- 172.21.15.40:0/170891331 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20bc139570 0x7f20bc13b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.218+0000 7f20baffd700 1 -- 172.21.15.40:0/170891331 >> v1:172.21.15.40:6789/0 conn(0x7f20bc133e00 legacy=0x7f20bc1341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.218+0000 7f20baffd700 1 -- 172.21.15.40:0/170891331 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20bc09f0d0 con 0x7f20bc136c50 2023-09-30T22:25:08.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.218+0000 7f20baffd700 1 --2- 172.21.15.40:0/170891331 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20bc136c50 0x7f20bc139030 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f20b0009870 tx=0x7f20b0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a728632bfc94db6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:08.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.218+0000 7f20ba7fc700 1 -- 172.21.15.40:0/170891331 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b0004230 con 0x7f20bc136c50 2023-09-30T22:25:08.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.218+0000 7f20ba7fc700 1 -- 172.21.15.40:0/170891331 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b0004390 con 0x7f20bc136c50 2023-09-30T22:25:08.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.218+0000 7f20ba7fc700 1 -- 172.21.15.40:0/170891331 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b00036a0 con 0x7f20bc136c50 2023-09-30T22:25:08.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.219+0000 7f20c1c3b700 1 -- 172.21.15.40:0/170891331 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20bc136c50 msgr2=0x7f20bc139030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.219+0000 7f20c1c3b700 1 --2- 172.21.15.40:0/170891331 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20bc136c50 0x7f20bc139030 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f20b0009870 tx=0x7f20b0009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:08.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.219+0000 7f20c1c3b700 1 -- 172.21.15.40:0/170891331 shutdown_connections 2023-09-30T22:25:08.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.219+0000 7f20c1c3b700 1 --2- 172.21.15.40:0/170891331 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20bc139570 0x7f20bc13b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.219+0000 7f20c1c3b700 1 --2- 172.21.15.40:0/170891331 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20bc136c50 0x7f20bc139030 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.219+0000 7f20c1c3b700 1 -- 172.21.15.40:0/170891331 >> 172.21.15.40:0/170891331 conn(0x7f20bc0a2a00 msgr2=0x7f20bc0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:08.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.220+0000 7fbd6f7fe700 1 -- 172.21.15.40:0/2806994519 >> v1:172.21.15.40:6816/127432 conn(0x7fbd5c02f510 legacy=0x7fbd5c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:08.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.221+0000 7f20c1c3b700 1 -- 172.21.15.40:0/170891331 shutdown_connections 2023-09-30T22:25:08.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.221+0000 7f20c1c3b700 1 -- 172.21.15.40:0/170891331 wait complete. 2023-09-30T22:25:08.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.222+0000 7f20c1c3b700 1 Processor -- start 2023-09-30T22:25:08.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.222+0000 7f20c1c3b700 1 -- start start 2023-09-30T22:25:08.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.223+0000 7f20c1c3b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20bc133e00 0x7f20bc119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.223+0000 7f20c1c3b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20bc136c50 0x7f20bc119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.223+0000 7f20c1c3b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20bc139570 0x7f20bc119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.223+0000 7f20c1c3b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc1335c0 con 0x7f20bc136c50 2023-09-30T22:25:08.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.223+0000 7f20c1c3b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc11b800 con 0x7f20bc133e00 2023-09-30T22:25:08.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.223+0000 7f20c1c3b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc12deb0 con 0x7f20bc139570 2023-09-30T22:25:08.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.223+0000 7f20bb7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20bc133e00 0x7f20bc119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.223+0000 7f20bb7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20bc133e00 0x7f20bc119050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38212/0 (socket says 172.21.15.40:38212) 2023-09-30T22:25:08.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.223+0000 7f20bb7fe700 1 -- 172.21.15.40:0/3574572119 learned_addr learned my addr 172.21.15.40:0/3574572119 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:08.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.223+0000 7f20baffd700 1 --2- 172.21.15.40:0/3574572119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20bc136c50 0x7f20bc119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.223+0000 7f20bbfff700 1 --2- 172.21.15.40:0/3574572119 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20bc139570 0x7f20bc119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.223+0000 7f20bb7fe700 1 -- 172.21.15.40:0/3574572119 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20bc139570 msgr2=0x7f20bc119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.223+0000 7f20bb7fe700 1 --2- 172.21.15.40:0/3574572119 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20bc139570 0x7f20bc119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.223+0000 7f20bb7fe700 1 -- 172.21.15.40:0/3574572119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20bc136c50 msgr2=0x7f20bc119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.223+0000 7f20bb7fe700 1 --2- 172.21.15.40:0/3574572119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20bc136c50 0x7f20bc119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.223+0000 7f20bb7fe700 1 -- 172.21.15.40:0/3574572119 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b00094a0 con 0x7f20bc133e00 2023-09-30T22:25:08.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.223+0000 7f20bbfff700 1 --2- 172.21.15.40:0/3574572119 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20bc139570 0x7f20bc119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:08.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.223+0000 7f20baffd700 1 --2- 172.21.15.40:0/3574572119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20bc136c50 0x7f20bc119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:08.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.224+0000 7f20bb7fe700 1 --2- 172.21.15.40:0/3574572119 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20bc133e00 0x7f20bc119050 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f20ac00c780 tx=0x7f20ac00cb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:08.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.224+0000 7f20a3fff700 1 -- 172.21.15.40:0/3574572119 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ac004c80 con 0x7f20bc133e00 2023-09-30T22:25:08.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.224+0000 7f20a3fff700 1 -- 172.21.15.40:0/3574572119 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20ac004de0 con 0x7f20bc133e00 2023-09-30T22:25:08.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.224+0000 7f20a3fff700 1 -- 172.21.15.40:0/3574572119 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ac007310 con 0x7f20bc133e00 2023-09-30T22:25:08.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.224+0000 7f20c1c3b700 1 -- 172.21.15.40:0/3574572119 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20bc11b540 con 0x7f20bc133e00 2023-09-30T22:25:08.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.224+0000 7f20c1c3b700 1 -- 172.21.15.40:0/3574572119 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20bc11bae0 con 0x7f20bc133e00 2023-09-30T22:25:08.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.225+0000 7f20a3fff700 1 -- 172.21.15.40:0/3574572119 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f20ac007470 con 0x7f20bc133e00 2023-09-30T22:25:08.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.225+0000 7f20baffd700 1 -- 172.21.15.40:0/3574572119 >> v1:172.21.15.40:6816/127432 conn(0x7f20a802f510 legacy=0x7f20a80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:08.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.225+0000 7f20a3fff700 1 -- 172.21.15.40:0/3574572119 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f20ac0421c0 con 0x7f20bc133e00 2023-09-30T22:25:08.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.226+0000 7f20c1c3b700 1 -- 172.21.15.40:0/3574572119 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20bc062380 con 0x7f20bc133e00 2023-09-30T22:25:08.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.227+0000 7fbd766e5700 1 -- 172.21.15.40:0/2806994519 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbd7012ed10 con 0x7fbd7009c890 2023-09-30T22:25:08.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.228+0000 7fbd6cff9700 1 -- 172.21.15.40:0/2806994519 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbd60011b40 con 0x7fbd7009c890 2023-09-30T22:25:08.228 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:08.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.230+0000 7f10b366d700 1 Processor -- start 2023-09-30T22:25:08.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.230+0000 7fbd766e5700 1 -- 172.21.15.40:0/2806994519 >> v1:172.21.15.40:6816/127432 conn(0x7fbd5c02f510 legacy=0x7fbd5c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:08.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.230+0000 7fbd766e5700 1 -- 172.21.15.40:0/2806994519 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd7009c890 msgr2=0x7fbd7012d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.230+0000 7fbd766e5700 1 --2- 172.21.15.40:0/2806994519 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd7009c890 0x7fbd7012d3b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbd6000ebb0 tx=0x7fbd6000eec0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.230+0000 7f10b366d700 1 -- start start 2023-09-30T22:25:08.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.230+0000 7fbd766e5700 1 -- 172.21.15.40:0/2806994519 shutdown_connections 2023-09-30T22:25:08.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.230+0000 7fbd766e5700 1 --2- 172.21.15.40:0/2806994519 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbd7009e2b0 0x7fbd7012de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.230+0000 7fbd766e5700 1 --2- 172.21.15.40:0/2806994519 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd7009c890 0x7fbd7012d3b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.230+0000 7fbd766e5700 1 --2- 172.21.15.40:0/2806994519 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd7009d920 0x7fbd7012d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.230+0000 7fbd766e5700 1 -- 172.21.15.40:0/2806994519 >> 172.21.15.40:0/2806994519 conn(0x7fbd700a7080 msgr2=0x7fbd700a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:08.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.231+0000 7fbd766e5700 1 -- 172.21.15.40:0/2806994519 shutdown_connections 2023-09-30T22:25:08.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.231+0000 7fbd766e5700 1 -- 172.21.15.40:0/2806994519 wait complete. 2023-09-30T22:25:08.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.231+0000 7f10b366d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ac09d450 0x7f10ac09d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.231+0000 7f10b366d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10ac1308d0 0x7f10ac138420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.231+0000 7f10b366d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10ac09e8b0 con 0x7f10ac09dd60 2023-09-30T22:25:08.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.231+0000 7f10b366d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10ac09c3b0 con 0x7f10ac09d450 2023-09-30T22:25:08.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.231+0000 7f10b366d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10ac09a6b0 con 0x7f10ac1308d0 2023-09-30T22:25:08.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.231+0000 7f10b0c08700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f10ac09dd60 0x7f10ac1301c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:36776/0 (socket says 172.21.15.40:36776) 2023-09-30T22:25:08.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.231+0000 7f10b0c08700 1 -- 172.21.15.40:0/1469321325 learned_addr learned my addr 172.21.15.40:0/1469321325 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:08.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.232+0000 7f10a3fff700 1 -- 172.21.15.40:0/1469321325 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3124198842 0 0) 0x7f10ac09e8b0 con 0x7f10ac09dd60 2023-09-30T22:25:08.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.232+0000 7f10a3fff700 1 -- 172.21.15.40:0/1469321325 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10980046c0 con 0x7f10ac09dd60 2023-09-30T22:25:08.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.232+0000 7f10a3fff700 1 -- 172.21.15.40:0/1469321325 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1521571704 0 0) 0x7f10980046c0 con 0x7f10ac09dd60 2023-09-30T22:25:08.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.232+0000 7f10a3fff700 1 -- 172.21.15.40:0/1469321325 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10ac1308d0 msgr2=0x7f10ac138420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:08.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.232+0000 7f10a3fff700 1 --2- 172.21.15.40:0/1469321325 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10ac1308d0 0x7f10ac138420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.232+0000 7f10a3fff700 1 -- 172.21.15.40:0/1469321325 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ac09d450 msgr2=0x7f10ac09d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:08.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.232+0000 7f10a3fff700 1 --2- 172.21.15.40:0/1469321325 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ac09d450 0x7f10ac09d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.232+0000 7f10a3fff700 1 -- 172.21.15.40:0/1469321325 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ac09b4f0 con 0x7f10ac09dd60 2023-09-30T22:25:08.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.232+0000 7f10a3fff700 1 -- 172.21.15.40:0/1469321325 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4231795173 0 0) 0x7f109c001670 con 0x7f10ac09dd60 2023-09-30T22:25:08.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.232+0000 7f10a3fff700 1 -- 172.21.15.40:0/1469321325 >> v1:172.21.15.40:6789/0 conn(0x7f10ac09dd60 legacy=0x7f10ac1301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.232+0000 7f10a3fff700 1 --2- 172.21.15.40:0/1469321325 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ac09d450 0x7f1098004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.232+0000 7f10a3fff700 1 --2- 172.21.15.40:0/1469321325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1098005220 0x7f1098005960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.232+0000 7f10a3fff700 1 --2- 172.21.15.40:0/1469321325 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10ac1308d0 0x7f1098005f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.232+0000 7f10a3fff700 1 -- 172.21.15.40:0/1469321325 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ac09c3b0 con 0x7f1098005220 2023-09-30T22:25:08.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.232+0000 7f10a3fff700 1 -- 172.21.15.40:0/1469321325 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10ac09a6b0 con 0x7f10ac09d450 2023-09-30T22:25:08.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.232+0000 7f10a3fff700 1 -- 172.21.15.40:0/1469321325 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1098006730 con 0x7f10ac1308d0 2023-09-30T22:25:08.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.232+0000 7f10b1409700 1 --2- 172.21.15.40:0/1469321325 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ac09d450 0x7f1098004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.232+0000 7f10b1c0a700 1 --2- 172.21.15.40:0/1469321325 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10ac1308d0 0x7f1098005f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.232+0000 7f10b0c08700 1 --2- 172.21.15.40:0/1469321325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1098005220 0x7f1098005960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.233+0000 7f20a3fff700 1 -- 172.21.15.40:0/3574572119 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f20ac018030 con 0x7f20bc133e00 2023-09-30T22:25:08.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.233+0000 7f10b0c08700 1 -- 172.21.15.40:0/1469321325 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10ac1308d0 msgr2=0x7f1098005f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:08.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.233+0000 7f10b0c08700 1 --2- 172.21.15.40:0/1469321325 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10ac1308d0 0x7f1098005f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.233+0000 7f10b0c08700 1 -- 172.21.15.40:0/1469321325 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ac09d450 msgr2=0x7f1098004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:08.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.233+0000 7f10b0c08700 1 --2- 172.21.15.40:0/1469321325 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ac09d450 0x7f1098004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.233+0000 7f10b0c08700 1 -- 172.21.15.40:0/1469321325 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10980046c0 con 0x7f1098005220 2023-09-30T22:25:08.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.233+0000 7f10b0c08700 1 --2- 172.21.15.40:0/1469321325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1098005220 0x7f1098005960 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f109c001050 tx=0x7f1098006990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8bbda0366e00d2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:08.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.233+0000 7f10a3fff700 1 -- 172.21.15.40:0/1469321325 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c007c40 con 0x7f1098005220 2023-09-30T22:25:08.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.233+0000 7f10a3fff700 1 -- 172.21.15.40:0/1469321325 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109c00cdd0 con 0x7f1098005220 2023-09-30T22:25:08.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.234+0000 7f10a3fff700 1 -- 172.21.15.40:0/1469321325 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c005ba0 con 0x7f1098005220 2023-09-30T22:25:08.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.234+0000 7f10b366d700 1 -- 172.21.15.40:0/1469321325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1098005220 msgr2=0x7f1098005960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.234+0000 7f10b366d700 1 --2- 172.21.15.40:0/1469321325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1098005220 0x7f1098005960 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f109c001050 tx=0x7f1098006990 comp rx=0 tx=0).stop 2023-09-30T22:25:08.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.236+0000 7f10b366d700 1 -- 172.21.15.40:0/1469321325 shutdown_connections 2023-09-30T22:25:08.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.236+0000 7f10b366d700 1 --2- 172.21.15.40:0/1469321325 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10ac1308d0 0x7f1098005f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.236+0000 7f10b366d700 1 --2- 172.21.15.40:0/1469321325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1098005220 0x7f1098005960 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.236+0000 7f10b366d700 1 --2- 172.21.15.40:0/1469321325 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ac09d450 0x7f1098004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.236+0000 7f10b366d700 1 -- 172.21.15.40:0/1469321325 >> 172.21.15.40:0/1469321325 conn(0x7f10ac0a2a00 msgr2=0x7f10ac0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:08.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.236+0000 7f10b366d700 1 -- 172.21.15.40:0/1469321325 shutdown_connections 2023-09-30T22:25:08.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.236+0000 7f10b366d700 1 -- 172.21.15.40:0/1469321325 wait complete. 2023-09-30T22:25:08.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.237+0000 7f10b366d700 1 Processor -- start 2023-09-30T22:25:08.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.237+0000 7f10b366d700 1 -- start start 2023-09-30T22:25:08.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.237+0000 7f10b366d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1098005220 0x7f10ac1c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.237+0000 7f10b366d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ac09d450 0x7f10ac1c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.237+0000 7f10b366d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10ac09dd60 0x7f10ac11b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.237+0000 7f10b366d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ac12f9b0 con 0x7f1098005220 2023-09-30T22:25:08.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.237+0000 7f10b366d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10ac11e580 con 0x7f10ac09d450 2023-09-30T22:25:08.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.237+0000 7f10b366d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10ac11cd90 con 0x7f10ac09dd60 2023-09-30T22:25:08.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.238+0000 7f10b1c0a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10ac09dd60 0x7f10ac11b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.238+0000 7f10b1c0a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10ac09dd60 0x7f10ac11b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:42614/0 (socket says 172.21.15.40:42614) 2023-09-30T22:25:08.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.238+0000 7f10b1c0a700 1 -- 172.21.15.40:0/3497402418 learned_addr learned my addr 172.21.15.40:0/3497402418 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:08.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.238+0000 7f10b1409700 1 --2- 172.21.15.40:0/3497402418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1098005220 0x7f10ac1c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.238+0000 7f10b0c08700 1 --2- 172.21.15.40:0/3497402418 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ac09d450 0x7f10ac1c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.238+0000 7f10b1c0a700 1 -- 172.21.15.40:0/3497402418 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ac09d450 msgr2=0x7f10ac1c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.238+0000 7f10b1c0a700 1 --2- 172.21.15.40:0/3497402418 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ac09d450 0x7f10ac1c4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.238+0000 7f10b1c0a700 1 -- 172.21.15.40:0/3497402418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1098005220 msgr2=0x7f10ac1c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.238+0000 7f10b1c0a700 1 --2- 172.21.15.40:0/3497402418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1098005220 0x7f10ac1c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.238+0000 7f10b1c0a700 1 -- 172.21.15.40:0/3497402418 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ac11eb20 con 0x7f10ac09dd60 2023-09-30T22:25:08.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.238+0000 7f10b1409700 1 --2- 172.21.15.40:0/3497402418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1098005220 0x7f10ac1c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:08.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.238+0000 7f10b0c08700 1 --2- 172.21.15.40:0/3497402418 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ac09d450 0x7f10ac1c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:08.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.238+0000 7f10b1c0a700 1 --2- 172.21.15.40:0/3497402418 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10ac09dd60 0x7f10ac11b090 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f10a4004bb0 tx=0x7f10a400ef50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:08.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.241+0000 7f10a1ffb700 1 -- 172.21.15.40:0/3497402418 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a400cc10 con 0x7f10ac09dd60 2023-09-30T22:25:08.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.241+0000 7f10a1ffb700 1 -- 172.21.15.40:0/3497402418 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a400cd70 con 0x7f10ac09dd60 2023-09-30T22:25:08.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.241+0000 7f10a1ffb700 1 -- 172.21.15.40:0/3497402418 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a4016450 con 0x7f10ac09dd60 2023-09-30T22:25:08.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.242+0000 7f10b366d700 1 -- 172.21.15.40:0/3497402418 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10ac0a1c70 con 0x7f10ac09dd60 2023-09-30T22:25:08.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.242+0000 7f10b366d700 1 -- 172.21.15.40:0/3497402418 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10ac11d410 con 0x7f10ac09dd60 2023-09-30T22:25:08.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.243+0000 7f10a1ffb700 1 -- 172.21.15.40:0/3497402418 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f10a401f3b0 con 0x7f10ac09dd60 2023-09-30T22:25:08.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.243+0000 7f10b366d700 1 -- 172.21.15.40:0/3497402418 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10ac062380 con 0x7f10ac09dd60 2023-09-30T22:25:08.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.243+0000 7f10a1ffb700 1 -- 172.21.15.40:0/3497402418 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f10a403fd70 con 0x7f10ac09dd60 2023-09-30T22:25:08.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.243+0000 7f10b1409700 1 -- 172.21.15.40:0/3497402418 >> v1:172.21.15.40:6816/127432 conn(0x7f109002f560 legacy=0x7f1090031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:08.247 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:08.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.252+0000 7f10a1ffb700 1 -- 172.21.15.40:0/3497402418 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f10a4014310 con 0x7f10ac09dd60 2023-09-30T22:25:08.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.385+0000 7f3c5ffff700 1 -- 172.21.15.40:0/331559623 >> v1:172.21.15.40:6816/127432 conn(0x7f3c4c02f510 legacy=0x7f3c4c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:08.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.401+0000 7f3c66464700 1 -- 172.21.15.40:0/331559623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3c6011d4d0 con 0x7f3c6009de60 2023-09-30T22:25:08.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.402+0000 7f3c5cff9700 1 -- 172.21.15.40:0/331559623 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3c54017020 con 0x7f3c6009de60 2023-09-30T22:25:08.402 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:08.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.403+0000 7f3c66464700 1 -- 172.21.15.40:0/331559623 >> v1:172.21.15.40:6816/127432 conn(0x7f3c4c02f510 legacy=0x7f3c4c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:08.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.404+0000 7f3c66464700 1 -- 172.21.15.40:0/331559623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c6009de60 msgr2=0x7f3c6013aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.404+0000 7f3c66464700 1 --2- 172.21.15.40:0/331559623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c6009de60 0x7f3c6013aee0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3c5400e980 tx=0x7f3c5400ec90 comp rx=0 tx=0).stop 2023-09-30T22:25:08.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.404+0000 7f3c66464700 1 -- 172.21.15.40:0/331559623 shutdown_connections 2023-09-30T22:25:08.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.404+0000 7f3c66464700 1 --2- 172.21.15.40:0/331559623 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c6006a6d0 0x7f3c6013a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.404+0000 7f3c66464700 1 --2- 172.21.15.40:0/331559623 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c6013c490 0x7f3c6013b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.404+0000 7f3c66464700 1 --2- 172.21.15.40:0/331559623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c6009de60 0x7f3c6013aee0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.404+0000 7f3c66464700 1 -- 172.21.15.40:0/331559623 >> 172.21.15.40:0/331559623 conn(0x7f3c6009fb20 msgr2=0x7f3c6013d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:08.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.404+0000 7f3c66464700 1 -- 172.21.15.40:0/331559623 shutdown_connections 2023-09-30T22:25:08.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.404+0000 7f3c66464700 1 -- 172.21.15.40:0/331559623 wait complete. 2023-09-30T22:25:08.417 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:08.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.426+0000 7f20baffd700 1 -- 172.21.15.40:0/3574572119 >> v1:172.21.15.40:6816/127432 conn(0x7f20a802f510 legacy=0x7f20a80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:08.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.438+0000 7f20c1c3b700 1 -- 172.21.15.40:0/3574572119 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f20bc074330 con 0x7f20bc133e00 2023-09-30T22:25:08.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.438+0000 7f20a3fff700 1 -- 172.21.15.40:0/3574572119 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f20ac018020 con 0x7f20bc133e00 2023-09-30T22:25:08.439 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:08.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.440+0000 7f20c1c3b700 1 -- 172.21.15.40:0/3574572119 >> v1:172.21.15.40:6816/127432 conn(0x7f20a802f510 legacy=0x7f20a80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:08.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.440+0000 7f20c1c3b700 1 -- 172.21.15.40:0/3574572119 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20bc133e00 msgr2=0x7f20bc119050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.440+0000 7f20c1c3b700 1 --2- 172.21.15.40:0/3574572119 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20bc133e00 0x7f20bc119050 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f20ac00c780 tx=0x7f20ac00cb40 comp rx=0 tx=0).stop 2023-09-30T22:25:08.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.440+0000 7f20c1c3b700 1 -- 172.21.15.40:0/3574572119 shutdown_connections 2023-09-30T22:25:08.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.440+0000 7f20c1c3b700 1 --2- 172.21.15.40:0/3574572119 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20bc139570 0x7f20bc119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.440+0000 7f20c1c3b700 1 --2- 172.21.15.40:0/3574572119 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20bc133e00 0x7f20bc119050 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.440+0000 7f20c1c3b700 1 --2- 172.21.15.40:0/3574572119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20bc136c50 0x7f20bc119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.440+0000 7f20c1c3b700 1 -- 172.21.15.40:0/3574572119 >> 172.21.15.40:0/3574572119 conn(0x7f20bc0a2a00 msgr2=0x7f20bc130420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:08.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.440+0000 7f20c1c3b700 1 -- 172.21.15.40:0/3574572119 shutdown_connections 2023-09-30T22:25:08.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.440+0000 7f20c1c3b700 1 -- 172.21.15.40:0/3574572119 wait complete. 2023-09-30T22:25:08.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.444+0000 7f10b1409700 1 -- 172.21.15.40:0/3497402418 >> v1:172.21.15.40:6816/127432 conn(0x7f109002f560 legacy=0x7f1090031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:08.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.448+0000 7f10b366d700 1 -- 172.21.15.40:0/3497402418 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f10ac074330 con 0x7f10ac09dd60 2023-09-30T22:25:08.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.449+0000 7f10a1ffb700 1 -- 172.21.15.40:0/3497402418 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f10a401b070 con 0x7f10ac09dd60 2023-09-30T22:25:08.449 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:08.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.451+0000 7f10b366d700 1 -- 172.21.15.40:0/3497402418 >> v1:172.21.15.40:6816/127432 conn(0x7f109002f560 legacy=0x7f1090031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:08.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.451+0000 7f10b366d700 1 -- 172.21.15.40:0/3497402418 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10ac09dd60 msgr2=0x7f10ac11b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.451+0000 7f10b366d700 1 --2- 172.21.15.40:0/3497402418 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10ac09dd60 0x7f10ac11b090 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f10a4004bb0 tx=0x7f10a400ef50 comp rx=0 tx=0).stop 2023-09-30T22:25:08.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.451+0000 7f10b366d700 1 -- 172.21.15.40:0/3497402418 shutdown_connections 2023-09-30T22:25:08.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.451+0000 7f10b366d700 1 --2- 172.21.15.40:0/3497402418 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10ac09dd60 0x7f10ac11b090 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.451+0000 7f10b366d700 1 --2- 172.21.15.40:0/3497402418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1098005220 0x7f10ac1c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.451+0000 7f10b366d700 1 --2- 172.21.15.40:0/3497402418 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ac09d450 0x7f10ac1c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.451+0000 7f10b366d700 1 -- 172.21.15.40:0/3497402418 >> 172.21.15.40:0/3497402418 conn(0x7f10ac0a2a00 msgr2=0x7f10ac1b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:08.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.451+0000 7f10b366d700 1 -- 172.21.15.40:0/3497402418 shutdown_connections 2023-09-30T22:25:08.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:08.451+0000 7f10b366d700 1 -- 172.21.15.40:0/3497402418 wait complete. 2023-09-30T22:25:08.453 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:08.464 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:09.248 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:09.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.388+0000 7f9bb106d700 1 Processor -- start 2023-09-30T22:25:09.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.388+0000 7f9bb106d700 1 -- start start 2023-09-30T22:25:09.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.389+0000 7f9bb106d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9bac09c890 0x7f9bac09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.389+0000 7f9bb106d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9bac09d920 0x7f9bac09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.389+0000 7f9bb106d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bac09e2b0 0x7f9bac13ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.389+0000 7f9bb106d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bac0a29d0 con 0x7f9bac09d920 2023-09-30T22:25:09.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.389+0000 7f9bb106d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac09fb40 con 0x7f9bac09e2b0 2023-09-30T22:25:09.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.389+0000 7f9bb106d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac0a2600 con 0x7f9bac09c890 2023-09-30T22:25:09.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.389+0000 7f9bab59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bac09e2b0 0x7f9bac13ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.389+0000 7f9baad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9bac09c890 0x7f9bac09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.389+0000 7f9bab59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bac09e2b0 0x7f9bac13ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38248/0 (socket says 172.21.15.40:38248) 2023-09-30T22:25:09.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.389+0000 7f9bab59e700 1 -- 172.21.15.40:0/366440814 learned_addr learned my addr 172.21.15.40:0/366440814 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:09.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.389+0000 7f9baad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9bac09c890 0x7f9bac09cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:42626/0 (socket says 172.21.15.40:42626) 2023-09-30T22:25:09.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.389+0000 7f9baa59c700 1 --2- 172.21.15.40:0/366440814 >> v2:172.21.15.40:3300/0 conn(0x7f9bac09d920 0x7f9bac09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.389+0000 7f9baa59c700 1 -- 172.21.15.40:0/366440814 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9bac09c890 msgr2=0x7f9bac09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:09.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.389+0000 7f9baa59c700 1 --2- 172.21.15.40:0/366440814 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9bac09c890 0x7f9bac09cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.389+0000 7f9baa59c700 1 -- 172.21.15.40:0/366440814 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bac09e2b0 msgr2=0x7f9bac13ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:09.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.389+0000 7f9baa59c700 1 --2- 172.21.15.40:0/366440814 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bac09e2b0 0x7f9bac13ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.389+0000 7f9baa59c700 1 -- 172.21.15.40:0/366440814 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bac09e750 con 0x7f9bac09d920 2023-09-30T22:25:09.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.389+0000 7f9bab59e700 1 --2- 172.21.15.40:0/366440814 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bac09e2b0 0x7f9bac13ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:09.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.389+0000 7f9baad9d700 1 --2- 172.21.15.40:0/366440814 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9bac09c890 0x7f9bac09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:09.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.389+0000 7f9baa59c700 1 --2- 172.21.15.40:0/366440814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bac09d920 0x7f9bac09dd70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c009840 tx=0x7f9b9c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa19f0e271e2bba server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:09.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.389+0000 7f9ba9d9b700 1 -- 172.21.15.40:0/366440814 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c011830 con 0x7f9bac09d920 2023-09-30T22:25:09.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.390+0000 7f9ba9d9b700 1 -- 172.21.15.40:0/366440814 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b9c011990 con 0x7f9bac09d920 2023-09-30T22:25:09.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.390+0000 7f9ba9d9b700 1 -- 172.21.15.40:0/366440814 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c011d20 con 0x7f9bac09d920 2023-09-30T22:25:09.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.390+0000 7f9bb106d700 1 -- 172.21.15.40:0/366440814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bac09d920 msgr2=0x7f9bac09dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.390+0000 7f9bb106d700 1 --2- 172.21.15.40:0/366440814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bac09d920 0x7f9bac09dd70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c009840 tx=0x7f9b9c009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:09.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.390+0000 7f9bb106d700 1 -- 172.21.15.40:0/366440814 shutdown_connections 2023-09-30T22:25:09.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.390+0000 7f9bb106d700 1 --2- 172.21.15.40:0/366440814 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9bac09c890 0x7f9bac09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.390+0000 7f9bb106d700 1 --2- 172.21.15.40:0/366440814 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bac09e2b0 0x7f9bac13ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.390+0000 7f9bb106d700 1 --2- 172.21.15.40:0/366440814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bac09d920 0x7f9bac09dd70 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.390+0000 7f9bb106d700 1 -- 172.21.15.40:0/366440814 >> 172.21.15.40:0/366440814 conn(0x7f9bac0a7080 msgr2=0x7f9bac0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:09.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.390+0000 7f9bb106d700 1 -- 172.21.15.40:0/366440814 shutdown_connections 2023-09-30T22:25:09.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.390+0000 7f9bb106d700 1 -- 172.21.15.40:0/366440814 wait complete. 2023-09-30T22:25:09.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.391+0000 7f9bb106d700 1 Processor -- start 2023-09-30T22:25:09.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.392+0000 7f9bb106d700 1 -- start start 2023-09-30T22:25:09.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.392+0000 7f9bb106d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9bac09c890 0x7f9bac1c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.392+0000 7f9bb106d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bac09d920 0x7f9bac1c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.392+0000 7f9bb106d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bac09e2b0 0x7f9bac12d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.392+0000 7f9bb106d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac130920 con 0x7f9bac09d920 2023-09-30T22:25:09.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.392+0000 7f9bb106d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac12f5c0 con 0x7f9bac09e2b0 2023-09-30T22:25:09.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.392+0000 7f9bb106d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac09ecf0 con 0x7f9bac09c890 2023-09-30T22:25:09.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.392+0000 7f9baa59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bac09d920 0x7f9bac1c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.392+0000 7f9bab59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bac09e2b0 0x7f9bac12d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.392+0000 7f9baad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9bac09c890 0x7f9bac1c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.392+0000 7f9baa59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bac09d920 0x7f9bac1c9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56506/0 (socket says 172.21.15.40:56506) 2023-09-30T22:25:09.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.392+0000 7f9baad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9bac09c890 0x7f9bac1c8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:42630/0 (socket says 172.21.15.40:42630) 2023-09-30T22:25:09.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.392+0000 7f9baa59c700 1 -- 172.21.15.40:0/3756820209 learned_addr learned my addr 172.21.15.40:0/3756820209 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:09.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.392+0000 7f9baa59c700 1 -- 172.21.15.40:0/3756820209 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9bac09c890 msgr2=0x7f9bac1c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.392+0000 7f9baa59c700 1 --2- 172.21.15.40:0/3756820209 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9bac09c890 0x7f9bac1c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.392+0000 7f9baa59c700 1 -- 172.21.15.40:0/3756820209 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bac09e2b0 msgr2=0x7f9bac12d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.392+0000 7f9baa59c700 1 --2- 172.21.15.40:0/3756820209 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bac09e2b0 0x7f9bac12d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.392+0000 7f9baa59c700 1 -- 172.21.15.40:0/3756820209 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba0009430 con 0x7f9bac09d920 2023-09-30T22:25:09.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.392+0000 7f9bab59e700 1 --2- 172.21.15.40:0/3756820209 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bac09e2b0 0x7f9bac12d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:09.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.392+0000 7f9baad9d700 1 --2- 172.21.15.40:0/3756820209 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9bac09c890 0x7f9bac1c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:09.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.393+0000 7f9baa59c700 1 --2- 172.21.15.40:0/3756820209 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bac09d920 0x7f9bac1c9190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c000c00 tx=0x7f9b9c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:09.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.393+0000 7f9b937fe700 1 -- 172.21.15.40:0/3756820209 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c004450 con 0x7f9bac09d920 2023-09-30T22:25:09.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.393+0000 7f9b937fe700 1 -- 172.21.15.40:0/3756820209 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b9c01f070 con 0x7f9bac09d920 2023-09-30T22:25:09.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.393+0000 7f9bb106d700 1 -- 172.21.15.40:0/3756820209 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ba4009b30 con 0x7f9bac09d920 2023-09-30T22:25:09.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.393+0000 7f9b937fe700 1 -- 172.21.15.40:0/3756820209 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c0038e0 con 0x7f9bac09d920 2023-09-30T22:25:09.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.393+0000 7f9bb106d700 1 -- 172.21.15.40:0/3756820209 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b9c0094a0 con 0x7f9bac09d920 2023-09-30T22:25:09.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.394+0000 7f9b937fe700 1 -- 172.21.15.40:0/3756820209 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9b9c003a40 con 0x7f9bac09d920 2023-09-30T22:25:09.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.394+0000 7f9b937fe700 1 -- 172.21.15.40:0/3756820209 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f9b9c021070 con 0x7f9bac09d920 2023-09-30T22:25:09.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.394+0000 7f9baad9d700 1 -- 172.21.15.40:0/3756820209 >> v1:172.21.15.40:6816/127432 conn(0x7f9b9802f510 legacy=0x7f9b980319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:09.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.394+0000 7f9bb106d700 1 -- 172.21.15.40:0/3756820209 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bac130c60 con 0x7f9bac09d920 2023-09-30T22:25:09.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.399+0000 7f9b937fe700 1 -- 172.21.15.40:0/3756820209 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9b9c015080 con 0x7f9bac09d920 2023-09-30T22:25:09.418 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:09.454 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:09.465 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:09.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.552+0000 7ffa31a50700 1 Processor -- start 2023-09-30T22:25:09.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.552+0000 7ffa31a50700 1 -- start start 2023-09-30T22:25:09.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.552+0000 7ffa31a50700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa2c138250 0x7ffa2c138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.552+0000 7ffa31a50700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffa2c09d400 0x7ffa2c09d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.552+0000 7ffa31a50700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa2c09dd50 0x7ffa2c13f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.552+0000 7ffa31a50700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa2c137e20 con 0x7ffa2c09d400 2023-09-30T22:25:09.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.552+0000 7ffa31a50700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c138050 con 0x7ffa2c09dd50 2023-09-30T22:25:09.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.552+0000 7ffa31a50700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c09b010 con 0x7ffa2c138250 2023-09-30T22:25:09.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.553+0000 7ffa2affd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa2c138250 0x7ffa2c138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.553+0000 7ffa2affd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa2c138250 0x7ffa2c138620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:42636/0 (socket says 172.21.15.40:42636) 2023-09-30T22:25:09.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.553+0000 7ffa2affd700 1 -- 172.21.15.40:0/4172608764 learned_addr learned my addr 172.21.15.40:0/4172608764 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:09.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.553+0000 7ffa2a7fc700 1 --2- 172.21.15.40:0/4172608764 >> v2:172.21.15.40:3300/0 conn(0x7ffa2c09d400 0x7ffa2c09d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.553+0000 7ffa2a7fc700 1 -- 172.21.15.40:0/4172608764 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa2c138250 msgr2=0x7ffa2c138620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:09.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.553+0000 7ffa2a7fc700 1 --2- 172.21.15.40:0/4172608764 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa2c138250 0x7ffa2c138620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.553+0000 7ffa2a7fc700 1 -- 172.21.15.40:0/4172608764 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa2c09dd50 msgr2=0x7ffa2c13f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:09.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.553+0000 7ffa2a7fc700 1 --2- 172.21.15.40:0/4172608764 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa2c09dd50 0x7ffa2c13f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.553+0000 7ffa2a7fc700 1 -- 172.21.15.40:0/4172608764 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa2c09e1f0 con 0x7ffa2c09d400 2023-09-30T22:25:09.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.553+0000 7ffa2a7fc700 1 --2- 172.21.15.40:0/4172608764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa2c09d400 0x7ffa2c09d810 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ffa20009840 tx=0x7ffa20009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd044675534e5422 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:09.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.553+0000 7ffa29ffb700 1 -- 172.21.15.40:0/4172608764 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa20011830 con 0x7ffa2c09d400 2023-09-30T22:25:09.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.553+0000 7ffa29ffb700 1 -- 172.21.15.40:0/4172608764 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa20011990 con 0x7ffa2c09d400 2023-09-30T22:25:09.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.554+0000 7ffa29ffb700 1 -- 172.21.15.40:0/4172608764 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa20011d20 con 0x7ffa2c09d400 2023-09-30T22:25:09.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.554+0000 7ffa31a50700 1 -- 172.21.15.40:0/4172608764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa2c09d400 msgr2=0x7ffa2c09d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.554+0000 7ffa31a50700 1 --2- 172.21.15.40:0/4172608764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa2c09d400 0x7ffa2c09d810 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ffa20009840 tx=0x7ffa20009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:09.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.555+0000 7ffa31a50700 1 -- 172.21.15.40:0/4172608764 shutdown_connections 2023-09-30T22:25:09.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.555+0000 7ffa31a50700 1 --2- 172.21.15.40:0/4172608764 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa2c138250 0x7ffa2c138620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.555+0000 7ffa31a50700 1 --2- 172.21.15.40:0/4172608764 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa2c09dd50 0x7ffa2c13f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.555+0000 7ffa31a50700 1 --2- 172.21.15.40:0/4172608764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa2c09d400 0x7ffa2c09d810 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.555+0000 7ffa31a50700 1 -- 172.21.15.40:0/4172608764 >> 172.21.15.40:0/4172608764 conn(0x7ffa2c0a2a00 msgr2=0x7ffa2c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:09.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.555+0000 7ffa31a50700 1 -- 172.21.15.40:0/4172608764 shutdown_connections 2023-09-30T22:25:09.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.555+0000 7ffa31a50700 1 -- 172.21.15.40:0/4172608764 wait complete. 2023-09-30T22:25:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.556+0000 7ffa31a50700 1 Processor -- start 2023-09-30T22:25:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.556+0000 7ffa31a50700 1 -- start start 2023-09-30T22:25:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.557+0000 7ffa31a50700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa2c09d400 0x7ffa2c1d53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.557+0000 7ffa31a50700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa2c09dd50 0x7ffa2c1d58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.557+0000 7ffa31a50700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa2c138250 0x7ffa2c1d5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.557+0000 7ffa31a50700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c12ff50 con 0x7ffa2c09d400 2023-09-30T22:25:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.557+0000 7ffa31a50700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c13d2f0 con 0x7ffa2c138250 2023-09-30T22:25:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.557+0000 7ffa31a50700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c09a300 con 0x7ffa2c09dd50 2023-09-30T22:25:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.557+0000 7ffa2affd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa2c09d400 0x7ffa2c1d53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.557+0000 7ffa2a7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa2c09dd50 0x7ffa2c1d58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.557+0000 7ffa2affd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa2c09d400 0x7ffa2c1d53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56522/0 (socket says 172.21.15.40:56522) 2023-09-30T22:25:09.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.557+0000 7ffa2affd700 1 -- 172.21.15.40:0/2538238769 learned_addr learned my addr 172.21.15.40:0/2538238769 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:09.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.557+0000 7ffa2b7fe700 1 --2- 172.21.15.40:0/2538238769 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa2c138250 0x7ffa2c1d5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.558+0000 7ffa2affd700 1 -- 172.21.15.40:0/2538238769 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa2c09dd50 msgr2=0x7ffa2c1d58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.558+0000 7ffa2affd700 1 --2- 172.21.15.40:0/2538238769 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa2c09dd50 0x7ffa2c1d58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.558+0000 7ffa2affd700 1 -- 172.21.15.40:0/2538238769 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa2c138250 msgr2=0x7ffa2c1d5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.558+0000 7ffa2affd700 1 --2- 172.21.15.40:0/2538238769 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa2c138250 0x7ffa2c1d5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.558+0000 7ffa2affd700 1 -- 172.21.15.40:0/2538238769 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa200094a0 con 0x7ffa2c09d400 2023-09-30T22:25:09.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.558+0000 7ffa2affd700 1 --2- 172.21.15.40:0/2538238769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa2c09d400 0x7ffa2c1d53b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c00e910 tx=0x7ffa1c00ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:09.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.558+0000 7ffa13fff700 1 -- 172.21.15.40:0/2538238769 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c0096a0 con 0x7ffa2c09d400 2023-09-30T22:25:09.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.558+0000 7ffa13fff700 1 -- 172.21.15.40:0/2538238769 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1c013680 con 0x7ffa2c09d400 2023-09-30T22:25:09.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.558+0000 7ffa31a50700 1 -- 172.21.15.40:0/2538238769 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa2c1361b0 con 0x7ffa2c09d400 2023-09-30T22:25:09.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.558+0000 7ffa13fff700 1 -- 172.21.15.40:0/2538238769 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c013a30 con 0x7ffa2c09d400 2023-09-30T22:25:09.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.558+0000 7ffa31a50700 1 -- 172.21.15.40:0/2538238769 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa2c13d9d0 con 0x7ffa2c09d400 2023-09-30T22:25:09.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.559+0000 7ffa31a50700 1 -- 172.21.15.40:0/2538238769 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa2c13ea60 con 0x7ffa2c09d400 2023-09-30T22:25:09.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.560+0000 7ffa13fff700 1 -- 172.21.15.40:0/2538238769 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ffa1c013b90 con 0x7ffa2c09d400 2023-09-30T22:25:09.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.560+0000 7ffa13fff700 1 -- 172.21.15.40:0/2538238769 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7ffa1c03ffd0 con 0x7ffa2c09d400 2023-09-30T22:25:09.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.560+0000 7ffa2a7fc700 1 -- 172.21.15.40:0/2538238769 >> v1:172.21.15.40:6816/127432 conn(0x7ffa1802f510 legacy=0x7ffa180319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:09.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.568+0000 7ffa13fff700 1 -- 172.21.15.40:0/2538238769 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa1c011d90 con 0x7ffa2c09d400 2023-09-30T22:25:09.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.595+0000 7f9baad9d700 1 -- 172.21.15.40:0/3756820209 >> v1:172.21.15.40:6816/127432 conn(0x7f9b9802f510 legacy=0x7f9b980319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:09.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.595+0000 7fbdd9dac700 1 Processor -- start 2023-09-30T22:25:09.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.595+0000 7fbdd9dac700 1 -- start start 2023-09-30T22:25:09.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.596+0000 7fbdd9dac700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbdd409e400 0x7fbdd4135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.596+0000 7fbdd9dac700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdd4136230 0x7fbdd4138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.596+0000 7fbdd9dac700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd409adf0 con 0x7fbdd409d920 2023-09-30T22:25:09.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.596+0000 7fbdd9dac700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd409e7f0 con 0x7fbdd4136230 2023-09-30T22:25:09.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.596+0000 7fbdd9dac700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd409edf0 con 0x7fbdd409e400 2023-09-30T22:25:09.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.596+0000 7fbdd3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdd4136230 0x7fbdd4138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.596+0000 7fbdd2ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbdd409e400 0x7fbdd4135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.596+0000 7fbdd3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdd4136230 0x7fbdd4138610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38292/0 (socket says 172.21.15.40:38292) 2023-09-30T22:25:09.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.596+0000 7fbdd2ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbdd409e400 0x7fbdd4135cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:42662/0 (socket says 172.21.15.40:42662) 2023-09-30T22:25:09.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.596+0000 7fbdd3fff700 1 -- 172.21.15.40:0/3490900877 learned_addr learned my addr 172.21.15.40:0/3490900877 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:09.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.596+0000 7fbdd2ffd700 1 -- 172.21.15.40:0/3490900877 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdd4136230 msgr2=0x7fbdd4138610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:09.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.596+0000 7fbdd2ffd700 1 --2- 172.21.15.40:0/3490900877 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdd4136230 0x7fbdd4138610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.596+0000 7fbdd2ffd700 1 -- 172.21.15.40:0/3490900877 >> v1:172.21.15.40:6789/0 conn(0x7fbdd409d920 legacy=0x7fbdd409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.596+0000 7fbdd2ffd700 1 -- 172.21.15.40:0/3490900877 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd409b660 con 0x7fbdd409e400 2023-09-30T22:25:09.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.596+0000 7fbdd27fc700 1 -- 172.21.15.40:0/3490900877 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009368890 0 0) 0x7fbdd409adf0 con 0x7fbdd409d920 2023-09-30T22:25:09.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.597+0000 7fbdd3fff700 1 --2- 172.21.15.40:0/3490900877 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdd4136230 0x7fbdd4138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:09.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.597+0000 7fbdd2ffd700 1 --2- 172.21.15.40:0/3490900877 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbdd409e400 0x7fbdd4135cf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8009870 tx=0x7fbdc8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ce51921f61805e5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:09.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.597+0000 7fbdd27fc700 1 -- 172.21.15.40:0/3490900877 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8011830 con 0x7fbdd409e400 2023-09-30T22:25:09.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.597+0000 7fbdd27fc700 1 -- 172.21.15.40:0/3490900877 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc8011990 con 0x7fbdd409e400 2023-09-30T22:25:09.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.597+0000 7fbdd27fc700 1 -- 172.21.15.40:0/3490900877 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8011d20 con 0x7fbdd409e400 2023-09-30T22:25:09.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.597+0000 7fbdd9dac700 1 -- 172.21.15.40:0/3490900877 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbdd409e400 msgr2=0x7fbdd4135cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.597+0000 7fbdd9dac700 1 --2- 172.21.15.40:0/3490900877 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbdd409e400 0x7fbdd4135cf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8009870 tx=0x7fbdc8009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:09.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.598+0000 7fbdd9dac700 1 -- 172.21.15.40:0/3490900877 shutdown_connections 2023-09-30T22:25:09.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.598+0000 7fbdd9dac700 1 --2- 172.21.15.40:0/3490900877 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdd4136230 0x7fbdd4138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.598+0000 7fbdd9dac700 1 --2- 172.21.15.40:0/3490900877 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbdd409e400 0x7fbdd4135cf0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.598+0000 7fbdd9dac700 1 -- 172.21.15.40:0/3490900877 >> 172.21.15.40:0/3490900877 conn(0x7fbdd409fb20 msgr2=0x7fbdd409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:09.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.598+0000 7fbdd9dac700 1 -- 172.21.15.40:0/3490900877 shutdown_connections 2023-09-30T22:25:09.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.598+0000 7fbdd9dac700 1 -- 172.21.15.40:0/3490900877 wait complete. 2023-09-30T22:25:09.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.599+0000 7fbdd9dac700 1 Processor -- start 2023-09-30T22:25:09.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.599+0000 7fbdd9dac700 1 -- start start 2023-09-30T22:25:09.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.599+0000 7fbdd9dac700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbdd409d920 0x7fbdd411e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.599+0000 7fbdd9dac700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdd409e400 0x7fbdd411ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.599+0000 7fbdd9dac700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdd4136230 0x7fbdd411f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.599+0000 7fbdd9dac700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd4122210 con 0x7fbdd409e400 2023-09-30T22:25:09.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.599+0000 7fbdd9dac700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd4120300 con 0x7fbdd4136230 2023-09-30T22:25:09.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.599+0000 7fbdd9dac700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd41208b0 con 0x7fbdd409d920 2023-09-30T22:25:09.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.599+0000 7fbdd3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdd4136230 0x7fbdd411f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.599+0000 7fbdd3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdd4136230 0x7fbdd411f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38294/0 (socket says 172.21.15.40:38294) 2023-09-30T22:25:09.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.599+0000 7fbdd3fff700 1 -- 172.21.15.40:0/1871889515 learned_addr learned my addr 172.21.15.40:0/1871889515 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:09.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.599+0000 7fbdd2ffd700 1 --2- 172.21.15.40:0/1871889515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdd409e400 0x7fbdd411ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.600+0000 7fbdd3fff700 1 -- 172.21.15.40:0/1871889515 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbdd409d920 msgr2=0x7fbdd411e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.600+0000 7fbdd3fff700 1 --2- 172.21.15.40:0/1871889515 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbdd409d920 0x7fbdd411e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.600+0000 7fbdd3fff700 1 -- 172.21.15.40:0/1871889515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdd409e400 msgr2=0x7fbdd411ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.600+0000 7fbdd3fff700 1 --2- 172.21.15.40:0/1871889515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdd409e400 0x7fbdd411ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.600+0000 7fbdd3fff700 1 -- 172.21.15.40:0/1871889515 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdcc009b30 con 0x7fbdd4136230 2023-09-30T22:25:09.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.600+0000 7fbdd3fff700 1 --2- 172.21.15.40:0/1871889515 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdd4136230 0x7fbdd411f170 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00ef90 tx=0x7fbdcc00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:09.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.600+0000 7fbdbbfff700 1 -- 172.21.15.40:0/1871889515 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc018070 con 0x7fbdd4136230 2023-09-30T22:25:09.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.600+0000 7fbdbbfff700 1 -- 172.21.15.40:0/1871889515 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdcc00f040 con 0x7fbdd4136230 2023-09-30T22:25:09.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.600+0000 7fbdbbfff700 1 -- 172.21.15.40:0/1871889515 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc003c20 con 0x7fbdd4136230 2023-09-30T22:25:09.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.600+0000 7fbdd9dac700 1 -- 172.21.15.40:0/1871889515 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdc80094a0 con 0x7fbdd4136230 2023-09-30T22:25:09.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.600+0000 7fbdd9dac700 1 -- 172.21.15.40:0/1871889515 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd409cb00 con 0x7fbdd4136230 2023-09-30T22:25:09.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.601+0000 7fbdbbfff700 1 -- 172.21.15.40:0/1871889515 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fbdcc00c930 con 0x7fbdd4136230 2023-09-30T22:25:09.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.602+0000 7fbdbbfff700 1 -- 172.21.15.40:0/1871889515 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7fbdcc03fda0 con 0x7fbdd4136230 2023-09-30T22:25:09.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.602+0000 7fbdd37fe700 1 -- 172.21.15.40:0/1871889515 >> v1:172.21.15.40:6816/127432 conn(0x7fbdc002f510 legacy=0x7fbdc00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:09.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.602+0000 7fbdd9dac700 1 -- 172.21.15.40:0/1871889515 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd409a660 con 0x7fbdd4136230 2023-09-30T22:25:09.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.604+0000 7f9bb106d700 1 -- 172.21.15.40:0/3756820209 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9bac062380 con 0x7f9bac09d920 2023-09-30T22:25:09.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.605+0000 7f9b937fe700 1 -- 172.21.15.40:0/3756820209 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9b9c010380 con 0x7f9bac09d920 2023-09-30T22:25:09.605 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:09.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.607+0000 7f9bb106d700 1 -- 172.21.15.40:0/3756820209 >> v1:172.21.15.40:6816/127432 conn(0x7f9b9802f510 legacy=0x7f9b980319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:09.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.607+0000 7f9bb106d700 1 -- 172.21.15.40:0/3756820209 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bac09d920 msgr2=0x7f9bac1c9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.607+0000 7f9bb106d700 1 --2- 172.21.15.40:0/3756820209 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bac09d920 0x7f9bac1c9190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c000c00 tx=0x7f9b9c004750 comp rx=0 tx=0).stop 2023-09-30T22:25:09.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.608+0000 7f9bb106d700 1 -- 172.21.15.40:0/3756820209 shutdown_connections 2023-09-30T22:25:09.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.608+0000 7f9bb106d700 1 --2- 172.21.15.40:0/3756820209 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9bac09c890 0x7f9bac1c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.608+0000 7f9bb106d700 1 --2- 172.21.15.40:0/3756820209 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bac09e2b0 0x7f9bac12d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.608+0000 7f9bb106d700 1 --2- 172.21.15.40:0/3756820209 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bac09d920 0x7f9bac1c9190 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.608+0000 7f9bb106d700 1 -- 172.21.15.40:0/3756820209 >> 172.21.15.40:0/3756820209 conn(0x7f9bac0a7080 msgr2=0x7f9bac0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:09.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.608+0000 7f9bb106d700 1 -- 172.21.15.40:0/3756820209 shutdown_connections 2023-09-30T22:25:09.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.608+0000 7f9bb106d700 1 -- 172.21.15.40:0/3756820209 wait complete. 2023-09-30T22:25:09.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.611+0000 7fbdbbfff700 1 -- 172.21.15.40:0/1871889515 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbdcc00cbe0 con 0x7fbdd4136230 2023-09-30T22:25:09.621 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:09.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.642+0000 7f2ff29d0700 1 Processor -- start 2023-09-30T22:25:09.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.642+0000 7f2ff29d0700 1 -- start start 2023-09-30T22:25:09.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.642+0000 7f2ff29d0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2fec06f070 0x7f2fec06f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.642+0000 7f2ff29d0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2fec06f980 0x7f2fec097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.642+0000 7f2ff29d0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2fec06fdb0 0x7f2fec0975d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.642+0000 7f2ff29d0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fec071af0 con 0x7f2fec06fdb0 2023-09-30T22:25:09.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.642+0000 7f2ff29d0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec070830 con 0x7f2fec06f980 2023-09-30T22:25:09.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.642+0000 7f2ff29d0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec070ad0 con 0x7f2fec06f070 2023-09-30T22:25:09.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.642+0000 7f2febfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2fec06f070 0x7f2fec06f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.642+0000 7f2febfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2fec06f070 0x7f2fec06f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:42682/0 (socket says 172.21.15.40:42682) 2023-09-30T22:25:09.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.642+0000 7f2febfff700 1 -- 172.21.15.40:0/547471618 learned_addr learned my addr 172.21.15.40:0/547471618 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:09.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.642+0000 7f2ff0f6d700 1 --2- 172.21.15.40:0/547471618 >> v2:172.21.15.40:3300/0 conn(0x7f2fec06fdb0 0x7f2fec0975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.643+0000 7f2feb7fe700 1 --2- 172.21.15.40:0/547471618 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2fec06f980 0x7f2fec097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.643+0000 7f2febfff700 1 -- 172.21.15.40:0/547471618 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2fec06f980 msgr2=0x7f2fec097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:09.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.643+0000 7f2febfff700 1 --2- 172.21.15.40:0/547471618 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2fec06f980 0x7f2fec097090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.643+0000 7f2febfff700 1 -- 172.21.15.40:0/547471618 >> v2:172.21.15.40:3300/0 conn(0x7f2fec06fdb0 msgr2=0x7f2fec0975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:09.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.643+0000 7f2febfff700 1 --2- 172.21.15.40:0/547471618 >> v2:172.21.15.40:3300/0 conn(0x7f2fec06fdb0 0x7f2fec0975d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.643+0000 7f2febfff700 1 -- 172.21.15.40:0/547471618 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fec070de0 con 0x7f2fec06f070 2023-09-30T22:25:09.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.643+0000 7f2ff0f6d700 1 --2- 172.21.15.40:0/547471618 >> v2:172.21.15.40:3300/0 conn(0x7f2fec06fdb0 0x7f2fec0975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:09.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.643+0000 7f2feb7fe700 1 --2- 172.21.15.40:0/547471618 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2fec06f980 0x7f2fec097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:09.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.643+0000 7f2febfff700 1 --2- 172.21.15.40:0/547471618 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2fec06f070 0x7f2fec06f440 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc009920 tx=0x7f2fdc009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76df0072f9b2bc6b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:09.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.643+0000 7f2feaffd700 1 -- 172.21.15.40:0/547471618 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc011830 con 0x7f2fec06f070 2023-09-30T22:25:09.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.643+0000 7f2feaffd700 1 -- 172.21.15.40:0/547471618 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fdc011990 con 0x7f2fec06f070 2023-09-30T22:25:09.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.643+0000 7f2feaffd700 1 -- 172.21.15.40:0/547471618 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc011d20 con 0x7f2fec06f070 2023-09-30T22:25:09.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.644+0000 7f2ff29d0700 1 -- 172.21.15.40:0/547471618 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2fec06f070 msgr2=0x7f2fec06f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.644+0000 7f2ff29d0700 1 --2- 172.21.15.40:0/547471618 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2fec06f070 0x7f2fec06f440 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc009920 tx=0x7f2fdc009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:09.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.644+0000 7f2ff29d0700 1 -- 172.21.15.40:0/547471618 shutdown_connections 2023-09-30T22:25:09.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.644+0000 7f2ff29d0700 1 --2- 172.21.15.40:0/547471618 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2fec06f070 0x7f2fec06f440 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.644+0000 7f2ff29d0700 1 --2- 172.21.15.40:0/547471618 >> v2:172.21.15.40:3300/0 conn(0x7f2fec06fdb0 0x7f2fec0975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.644+0000 7f2ff29d0700 1 --2- 172.21.15.40:0/547471618 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2fec06f980 0x7f2fec097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.644+0000 7f2ff29d0700 1 -- 172.21.15.40:0/547471618 >> 172.21.15.40:0/547471618 conn(0x7f2fec0a41a0 msgr2=0x7f2fec0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:09.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.644+0000 7f2ff29d0700 1 -- 172.21.15.40:0/547471618 shutdown_connections 2023-09-30T22:25:09.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.644+0000 7f2ff29d0700 1 -- 172.21.15.40:0/547471618 wait complete. 2023-09-30T22:25:09.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.645+0000 7f2ff29d0700 1 Processor -- start 2023-09-30T22:25:09.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.645+0000 7f2ff29d0700 1 -- start start 2023-09-30T22:25:09.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.645+0000 7f2ff29d0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fec06f070 0x7f2fec1c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.645+0000 7f2ff29d0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2fec06f980 0x7f2fec1c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.645+0000 7f2ff29d0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2fec06fdb0 0x7f2fec1c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.645+0000 7f2ff29d0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec08b6d0 con 0x7f2fec06f070 2023-09-30T22:25:09.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.645+0000 7f2ff29d0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec131f80 con 0x7f2fec06f980 2023-09-30T22:25:09.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.645+0000 7f2ff29d0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec12c2d0 con 0x7f2fec06fdb0 2023-09-30T22:25:09.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.645+0000 7f2febfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fec06f070 0x7f2fec1c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.645+0000 7f2ff0f6d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2fec06fdb0 0x7f2fec1c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.645+0000 7f2ff0f6d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2fec06fdb0 0x7f2fec1c92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:42692/0 (socket says 172.21.15.40:42692) 2023-09-30T22:25:09.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.645+0000 7f2febfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fec06f070 0x7f2fec1c8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56546/0 (socket says 172.21.15.40:56546) 2023-09-30T22:25:09.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.645+0000 7f2ff0f6d700 1 -- 172.21.15.40:0/3817998766 learned_addr learned my addr 172.21.15.40:0/3817998766 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:09.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.646+0000 7f2feb7fe700 1 --2- 172.21.15.40:0/3817998766 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2fec06f980 0x7f2fec1c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.646+0000 7f2ff0f6d700 1 -- 172.21.15.40:0/3817998766 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2fec06f980 msgr2=0x7f2fec1c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.646+0000 7f2ff0f6d700 1 --2- 172.21.15.40:0/3817998766 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2fec06f980 0x7f2fec1c8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.646+0000 7f2ff0f6d700 1 -- 172.21.15.40:0/3817998766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fec06f070 msgr2=0x7f2fec1c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.646+0000 7f2ff0f6d700 1 --2- 172.21.15.40:0/3817998766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fec06f070 0x7f2fec1c8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.646+0000 7f2ff0f6d700 1 -- 172.21.15.40:0/3817998766 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe4009a70 con 0x7f2fec06fdb0 2023-09-30T22:25:09.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.646+0000 7f2ff0f6d700 1 --2- 172.21.15.40:0/3817998766 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2fec06fdb0 0x7f2fec1c92e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2fe400ef90 tx=0x7f2fe400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:09.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.646+0000 7f2fe8ff9700 1 -- 172.21.15.40:0/3817998766 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe400cc90 con 0x7f2fec06fdb0 2023-09-30T22:25:09.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.646+0000 7f2fe8ff9700 1 -- 172.21.15.40:0/3817998766 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe400f040 con 0x7f2fec06fdb0 2023-09-30T22:25:09.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.646+0000 7f2ff29d0700 1 -- 172.21.15.40:0/3817998766 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fdc009550 con 0x7f2fec06fdb0 2023-09-30T22:25:09.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.646+0000 7f2fe8ff9700 1 -- 172.21.15.40:0/3817998766 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe40146c0 con 0x7f2fec06fdb0 2023-09-30T22:25:09.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.646+0000 7f2ff29d0700 1 -- 172.21.15.40:0/3817998766 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fec06df00 con 0x7f2fec06fdb0 2023-09-30T22:25:09.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.647+0000 7f2fe8ff9700 1 -- 172.21.15.40:0/3817998766 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2fe4014820 con 0x7f2fec06fdb0 2023-09-30T22:25:09.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.647+0000 7f2fe8ff9700 1 -- 172.21.15.40:0/3817998766 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f2fe4040b00 con 0x7f2fec06fdb0 2023-09-30T22:25:09.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.647+0000 7f2febfff700 1 -- 172.21.15.40:0/3817998766 >> v1:172.21.15.40:6816/127432 conn(0x7f2fd802f510 legacy=0x7f2fd80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:09.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.647+0000 7f2ff29d0700 1 -- 172.21.15.40:0/3817998766 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fec08b510 con 0x7f2fec06fdb0 2023-09-30T22:25:09.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.652+0000 7f2fe8ff9700 1 -- 172.21.15.40:0/3817998766 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2fec08b510 con 0x7f2fec06fdb0 2023-09-30T22:25:09.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.761+0000 7ffa2a7fc700 1 -- 172.21.15.40:0/2538238769 >> v1:172.21.15.40:6816/127432 conn(0x7ffa1802f510 legacy=0x7ffa180319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:09.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.782+0000 7ffa31a50700 1 -- 172.21.15.40:0/2538238769 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ffa2c1199d0 con 0x7ffa2c09d400 2023-09-30T22:25:09.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.782+0000 7ffa13fff700 1 -- 172.21.15.40:0/2538238769 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffa1c017070 con 0x7ffa2c09d400 2023-09-30T22:25:09.783 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:09.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.784+0000 7ffa31a50700 1 -- 172.21.15.40:0/2538238769 >> v1:172.21.15.40:6816/127432 conn(0x7ffa1802f510 legacy=0x7ffa180319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:09.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.784+0000 7ffa31a50700 1 -- 172.21.15.40:0/2538238769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa2c09d400 msgr2=0x7ffa2c1d53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.784+0000 7ffa31a50700 1 --2- 172.21.15.40:0/2538238769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa2c09d400 0x7ffa2c1d53b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c00e910 tx=0x7ffa1c00ec20 comp rx=0 tx=0).stop 2023-09-30T22:25:09.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.784+0000 7ffa31a50700 1 -- 172.21.15.40:0/2538238769 shutdown_connections 2023-09-30T22:25:09.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.784+0000 7ffa31a50700 1 --2- 172.21.15.40:0/2538238769 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa2c138250 0x7ffa2c1d5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.784+0000 7ffa31a50700 1 --2- 172.21.15.40:0/2538238769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa2c09d400 0x7ffa2c1d53b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.784+0000 7ffa31a50700 1 --2- 172.21.15.40:0/2538238769 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa2c09dd50 0x7ffa2c1d58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.784+0000 7ffa31a50700 1 -- 172.21.15.40:0/2538238769 >> 172.21.15.40:0/2538238769 conn(0x7ffa2c0a2a00 msgr2=0x7ffa2c0a1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:09.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.784+0000 7ffa31a50700 1 -- 172.21.15.40:0/2538238769 shutdown_connections 2023-09-30T22:25:09.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.784+0000 7ffa31a50700 1 -- 172.21.15.40:0/2538238769 wait complete. 2023-09-30T22:25:09.797 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:09.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.803+0000 7fbdd37fe700 1 -- 172.21.15.40:0/1871889515 >> v1:172.21.15.40:6816/127432 conn(0x7fbdc002f510 legacy=0x7fbdc00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:09.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.823+0000 7fbdd9dac700 1 -- 172.21.15.40:0/1871889515 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbdd4062380 con 0x7fbdd4136230 2023-09-30T22:25:09.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.823+0000 7fbdbbfff700 1 -- 172.21.15.40:0/1871889515 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbdcc01cb60 con 0x7fbdd4136230 2023-09-30T22:25:09.824 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:09.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.826+0000 7fbdd9dac700 1 -- 172.21.15.40:0/1871889515 >> v1:172.21.15.40:6816/127432 conn(0x7fbdc002f510 legacy=0x7fbdc00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:09.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.826+0000 7fbdd9dac700 1 -- 172.21.15.40:0/1871889515 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdd4136230 msgr2=0x7fbdd411f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.826+0000 7fbdd9dac700 1 --2- 172.21.15.40:0/1871889515 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdd4136230 0x7fbdd411f170 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00ef90 tx=0x7fbdcc00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.826+0000 7fbdd9dac700 1 -- 172.21.15.40:0/1871889515 shutdown_connections 2023-09-30T22:25:09.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.826+0000 7fbdd9dac700 1 --2- 172.21.15.40:0/1871889515 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbdd409d920 0x7fbdd411e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.826+0000 7fbdd9dac700 1 --2- 172.21.15.40:0/1871889515 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdd4136230 0x7fbdd411f170 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.826+0000 7fbdd9dac700 1 --2- 172.21.15.40:0/1871889515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdd409e400 0x7fbdd411ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.826+0000 7fbdd9dac700 1 -- 172.21.15.40:0/1871889515 >> 172.21.15.40:0/1871889515 conn(0x7fbdd409fb20 msgr2=0x7fbdd40a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:09.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.826+0000 7fbdd9dac700 1 -- 172.21.15.40:0/1871889515 shutdown_connections 2023-09-30T22:25:09.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.826+0000 7fbdd9dac700 1 -- 172.21.15.40:0/1871889515 wait complete. 2023-09-30T22:25:09.843 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:09.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.848+0000 7f2febfff700 1 -- 172.21.15.40:0/3817998766 >> v1:172.21.15.40:6816/127432 conn(0x7f2fd802f510 legacy=0x7f2fd80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:09.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.861+0000 7f2ff29d0700 1 -- 172.21.15.40:0/3817998766 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2fec08b510 con 0x7f2fec06fdb0 2023-09-30T22:25:09.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.861+0000 7f2fe8ff9700 1 -- 172.21.15.40:0/3817998766 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2fec08b510 con 0x7f2fec06fdb0 2023-09-30T22:25:09.861 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:09.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.863+0000 7f2ff29d0700 1 -- 172.21.15.40:0/3817998766 >> v1:172.21.15.40:6816/127432 conn(0x7f2fd802f510 legacy=0x7f2fd80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:09.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.863+0000 7f2ff29d0700 1 -- 172.21.15.40:0/3817998766 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2fec06fdb0 msgr2=0x7f2fec1c92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.863+0000 7f2ff29d0700 1 --2- 172.21.15.40:0/3817998766 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2fec06fdb0 0x7f2fec1c92e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2fe400ef90 tx=0x7f2fe400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.863+0000 7f2ff29d0700 1 -- 172.21.15.40:0/3817998766 shutdown_connections 2023-09-30T22:25:09.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.863+0000 7f2ff29d0700 1 --2- 172.21.15.40:0/3817998766 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2fec06fdb0 0x7f2fec1c92e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.863+0000 7f2ff29d0700 1 --2- 172.21.15.40:0/3817998766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fec06f070 0x7f2fec1c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.863+0000 7f2ff29d0700 1 --2- 172.21.15.40:0/3817998766 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2fec06f980 0x7f2fec1c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.863+0000 7f2ff29d0700 1 -- 172.21.15.40:0/3817998766 >> 172.21.15.40:0/3817998766 conn(0x7f2fec0a41a0 msgr2=0x7f2fec12b970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:09.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.863+0000 7f2ff29d0700 1 -- 172.21.15.40:0/3817998766 shutdown_connections 2023-09-30T22:25:09.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:09.863+0000 7f2ff29d0700 1 -- 172.21.15.40:0/3817998766 wait complete. 2023-09-30T22:25:09.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:10.622 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:10.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.764+0000 7fa97ed43700 1 Processor -- start 2023-09-30T22:25:10.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.764+0000 7fa97ed43700 1 -- start start 2023-09-30T22:25:10.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.764+0000 7fa97ed43700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa978130570 0x7fa978130fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.764+0000 7fa97ed43700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa97809ad30 0x7fa978138910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.764+0000 7fa97ed43700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa97809ba60 con 0x7fa978130c00 2023-09-30T22:25:10.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.764+0000 7fa97ed43700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa97809df10 con 0x7fa97809ad30 2023-09-30T22:25:10.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.764+0000 7fa97ed43700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa978131510 con 0x7fa978130570 2023-09-30T22:25:10.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.764+0000 7fa977fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa978130570 0x7fa978130fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.764+0000 7fa97cadf700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa978130c00 0x7fa97809a620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:36792/0 (socket says 172.21.15.40:36792) 2023-09-30T22:25:10.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.764+0000 7fa97cadf700 1 -- 172.21.15.40:0/4067256327 learned_addr learned my addr 172.21.15.40:0/4067256327 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:10.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.764+0000 7fa97d2e0700 1 --2- 172.21.15.40:0/4067256327 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa97809ad30 0x7fa978138910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.765+0000 7fa977fff700 1 -- 172.21.15.40:0/4067256327 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa97809ad30 msgr2=0x7fa978138910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:10.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.765+0000 7fa977fff700 1 --2- 172.21.15.40:0/4067256327 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa97809ad30 0x7fa978138910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.765+0000 7fa977fff700 1 -- 172.21.15.40:0/4067256327 >> v1:172.21.15.40:6789/0 conn(0x7fa978130c00 legacy=0x7fa97809a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.765+0000 7fa977fff700 1 -- 172.21.15.40:0/4067256327 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa978130a00 con 0x7fa978130570 2023-09-30T22:25:10.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.765+0000 7fa9777fe700 1 -- 172.21.15.40:0/4067256327 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4098042282 0 0) 0x7fa97809ba60 con 0x7fa978130c00 2023-09-30T22:25:10.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.765+0000 7fa977fff700 1 --2- 172.21.15.40:0/4067256327 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa978130570 0x7fa978130fd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa964009870 tx=0x7fa964009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f649a3ed602fb9eb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:10.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.765+0000 7fa9777fe700 1 -- 172.21.15.40:0/4067256327 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa964011830 con 0x7fa978130570 2023-09-30T22:25:10.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.765+0000 7fa9777fe700 1 -- 172.21.15.40:0/4067256327 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa964011990 con 0x7fa978130570 2023-09-30T22:25:10.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.765+0000 7fa9777fe700 1 -- 172.21.15.40:0/4067256327 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa964011d20 con 0x7fa978130570 2023-09-30T22:25:10.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.765+0000 7fa97ed43700 1 -- 172.21.15.40:0/4067256327 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa978130570 msgr2=0x7fa978130fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.765+0000 7fa97ed43700 1 --2- 172.21.15.40:0/4067256327 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa978130570 0x7fa978130fd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa964009870 tx=0x7fa964009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:10.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.766+0000 7fa97ed43700 1 -- 172.21.15.40:0/4067256327 shutdown_connections 2023-09-30T22:25:10.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.766+0000 7fa97ed43700 1 --2- 172.21.15.40:0/4067256327 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa97809ad30 0x7fa978138910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.766+0000 7fa97ed43700 1 --2- 172.21.15.40:0/4067256327 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa978130570 0x7fa978130fd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.766+0000 7fa97ed43700 1 -- 172.21.15.40:0/4067256327 >> 172.21.15.40:0/4067256327 conn(0x7fa97809eb10 msgr2=0x7fa97809ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:10.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.766+0000 7fa97ed43700 1 -- 172.21.15.40:0/4067256327 shutdown_connections 2023-09-30T22:25:10.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.766+0000 7fa97ed43700 1 -- 172.21.15.40:0/4067256327 wait complete. 2023-09-30T22:25:10.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.767+0000 7fa97ed43700 1 Processor -- start 2023-09-30T22:25:10.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.767+0000 7fa97ed43700 1 -- start start 2023-09-30T22:25:10.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.768+0000 7fa97ed43700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa97809ad30 0x7fa97812ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.768+0000 7fa97ed43700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa978130570 0x7fa97812b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.768+0000 7fa97ed43700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa978130c00 0x7fa97812b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.768+0000 7fa97ed43700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97812dec0 con 0x7fa978130c00 2023-09-30T22:25:10.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.768+0000 7fa97ed43700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa97808b100 con 0x7fa978130570 2023-09-30T22:25:10.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.768+0000 7fa97ed43700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa97809d610 con 0x7fa97809ad30 2023-09-30T22:25:10.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.768+0000 7fa97cadf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa97809ad30 0x7fa97812ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.768+0000 7fa97cadf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa97809ad30 0x7fa97812ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:42712/0 (socket says 172.21.15.40:42712) 2023-09-30T22:25:10.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.768+0000 7fa977fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa978130570 0x7fa97812b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.768+0000 7fa97cadf700 1 -- 172.21.15.40:0/2889135504 learned_addr learned my addr 172.21.15.40:0/2889135504 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:10.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.768+0000 7fa97d2e0700 1 --2- 172.21.15.40:0/2889135504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa978130c00 0x7fa97812b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.768+0000 7fa97cadf700 1 -- 172.21.15.40:0/2889135504 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa978130570 msgr2=0x7fa97812b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.768+0000 7fa97cadf700 1 --2- 172.21.15.40:0/2889135504 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa978130570 0x7fa97812b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.768+0000 7fa97cadf700 1 -- 172.21.15.40:0/2889135504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa978130c00 msgr2=0x7fa97812b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.768+0000 7fa97cadf700 1 --2- 172.21.15.40:0/2889135504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa978130c00 0x7fa97812b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.768+0000 7fa97cadf700 1 -- 172.21.15.40:0/2889135504 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9640094a0 con 0x7fa97809ad30 2023-09-30T22:25:10.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.768+0000 7fa977fff700 1 --2- 172.21.15.40:0/2889135504 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa978130570 0x7fa97812b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:10.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.768+0000 7fa97cadf700 1 --2- 172.21.15.40:0/2889135504 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa97809ad30 0x7fa97812ac60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa96c00c6d0 tx=0x7fa96c00c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:10.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.768+0000 7fa9757fa700 1 -- 172.21.15.40:0/2889135504 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c0074e0 con 0x7fa97809ad30 2023-09-30T22:25:10.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.769+0000 7fa9757fa700 1 -- 172.21.15.40:0/2889135504 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96c007640 con 0x7fa97809ad30 2023-09-30T22:25:10.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.769+0000 7fa97ed43700 1 -- 172.21.15.40:0/2889135504 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa97809bc10 con 0x7fa97809ad30 2023-09-30T22:25:10.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.769+0000 7fa9757fa700 1 -- 172.21.15.40:0/2889135504 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c005a70 con 0x7fa97809ad30 2023-09-30T22:25:10.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.769+0000 7fa97ed43700 1 -- 172.21.15.40:0/2889135504 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa97808bda0 con 0x7fa97809ad30 2023-09-30T22:25:10.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.769+0000 7fa9757fa700 1 -- 172.21.15.40:0/2889135504 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa96c005bd0 con 0x7fa97809ad30 2023-09-30T22:25:10.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.770+0000 7fa97ed43700 1 -- 172.21.15.40:0/2889135504 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa978062380 con 0x7fa97809ad30 2023-09-30T22:25:10.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.770+0000 7fa977fff700 1 -- 172.21.15.40:0/2889135504 >> v1:172.21.15.40:6816/127432 conn(0x7fa95c02f510 legacy=0x7fa95c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:10.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.770+0000 7fa9757fa700 1 -- 172.21.15.40:0/2889135504 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7fa96c03f140 con 0x7fa97809ad30 2023-09-30T22:25:10.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.774+0000 7fa9757fa700 1 -- 172.21.15.40:0/2889135504 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa96c017020 con 0x7fa97809ad30 2023-09-30T22:25:10.798 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:10.844 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:10.876 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:10.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.930+0000 7faa5c228700 1 Processor -- start 2023-09-30T22:25:10.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.930+0000 7faa5c228700 1 -- start start 2023-09-30T22:25:10.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.931+0000 7faa5c228700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa5409d450 0x7faa5409d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.931+0000 7faa5c228700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa5409dd60 0x7faa54067820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.931+0000 7faa5c228700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa5409e8b0 con 0x7faa541301c0 2023-09-30T22:25:10.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.931+0000 7faa5c228700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa5409c3b0 con 0x7faa5409dd60 2023-09-30T22:25:10.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.931+0000 7faa5c228700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5409a6b0 con 0x7faa5409d450 2023-09-30T22:25:10.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.931+0000 7faa597c3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa5409dd60 0x7faa54067820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.931+0000 7faa597c3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa5409dd60 0x7faa54067820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56574/0 (socket says 172.21.15.40:56574) 2023-09-30T22:25:10.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.931+0000 7faa59fc4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa5409d450 0x7faa5409d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.931+0000 7faa597c3700 1 -- 172.21.15.40:0/3619087916 learned_addr learned my addr 172.21.15.40:0/3619087916 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:10.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.932+0000 7faa59fc4700 1 -- 172.21.15.40:0/3619087916 >> v2:172.21.15.40:3300/0 conn(0x7faa5409dd60 msgr2=0x7faa54067820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:10.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.932+0000 7faa59fc4700 1 --2- 172.21.15.40:0/3619087916 >> v2:172.21.15.40:3300/0 conn(0x7faa5409dd60 0x7faa54067820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.932+0000 7faa59fc4700 1 -- 172.21.15.40:0/3619087916 >> v1:172.21.15.40:6789/0 conn(0x7faa541301c0 legacy=0x7faa54130610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.932+0000 7faa59fc4700 1 -- 172.21.15.40:0/3619087916 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa5409b4f0 con 0x7faa5409d450 2023-09-30T22:25:10.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.932+0000 7faa59fc4700 1 --2- 172.21.15.40:0/3619087916 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa5409d450 0x7faa5409d820 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faa50009840 tx=0x7faa50009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6f58f826b6f025 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:10.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.932+0000 7faa58fc2700 1 -- 172.21.15.40:0/3619087916 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa50011830 con 0x7faa5409d450 2023-09-30T22:25:10.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.932+0000 7faa58fc2700 1 -- 172.21.15.40:0/3619087916 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa50011990 con 0x7faa5409d450 2023-09-30T22:25:10.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.932+0000 7faa58fc2700 1 -- 172.21.15.40:0/3619087916 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa50011d20 con 0x7faa5409d450 2023-09-30T22:25:10.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.933+0000 7faa5c228700 1 -- 172.21.15.40:0/3619087916 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa5409d450 msgr2=0x7faa5409d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.933+0000 7faa5c228700 1 --2- 172.21.15.40:0/3619087916 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa5409d450 0x7faa5409d820 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faa50009840 tx=0x7faa50009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:10.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.933+0000 7faa5c228700 1 -- 172.21.15.40:0/3619087916 shutdown_connections 2023-09-30T22:25:10.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.933+0000 7faa5c228700 1 --2- 172.21.15.40:0/3619087916 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa5409d450 0x7faa5409d820 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.933+0000 7faa5c228700 1 --2- 172.21.15.40:0/3619087916 >> v2:172.21.15.40:3300/0 conn(0x7faa5409dd60 0x7faa54067820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.933+0000 7faa5c228700 1 -- 172.21.15.40:0/3619087916 >> 172.21.15.40:0/3619087916 conn(0x7faa540a2a00 msgr2=0x7faa540a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:10.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.933+0000 7faa5c228700 1 -- 172.21.15.40:0/3619087916 shutdown_connections 2023-09-30T22:25:10.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.933+0000 7faa5c228700 1 -- 172.21.15.40:0/3619087916 wait complete. 2023-09-30T22:25:10.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.934+0000 7faa5c228700 1 Processor -- start 2023-09-30T22:25:10.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.934+0000 7faa5c228700 1 -- start start 2023-09-30T22:25:10.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.935+0000 7faa5c228700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa5409d450 0x7faa541363b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.935+0000 7faa5c228700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa5409dd60 0x7faa541368f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.935+0000 7faa5c228700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faa541301c0 0x7faa54136e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.935+0000 7faa5c228700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa54139da0 con 0x7faa5409d450 2023-09-30T22:25:10.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.935+0000 7faa5c228700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5413acc0 con 0x7faa5409dd60 2023-09-30T22:25:10.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.935+0000 7faa5c228700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa5413aa20 con 0x7faa541301c0 2023-09-30T22:25:10.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.935+0000 7faa59fc4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa5409d450 0x7faa541363b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.935+0000 7faa59fc4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa5409d450 0x7faa541363b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56578/0 (socket says 172.21.15.40:56578) 2023-09-30T22:25:10.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.935+0000 7faa59fc4700 1 -- 172.21.15.40:0/1637416158 learned_addr learned my addr 172.21.15.40:0/1637416158 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:10.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.935+0000 7faa5a7c5700 1 --2- 172.21.15.40:0/1637416158 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faa541301c0 0x7faa54136e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.935+0000 7faa597c3700 1 --2- 172.21.15.40:0/1637416158 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa5409dd60 0x7faa541368f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.936+0000 7faa5a7c5700 1 -- 172.21.15.40:0/1637416158 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa5409dd60 msgr2=0x7faa541368f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.936+0000 7faa5a7c5700 1 --2- 172.21.15.40:0/1637416158 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa5409dd60 0x7faa541368f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.936+0000 7faa5a7c5700 1 -- 172.21.15.40:0/1637416158 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa5409d450 msgr2=0x7faa541363b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.936+0000 7faa5a7c5700 1 --2- 172.21.15.40:0/1637416158 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa5409d450 0x7faa541363b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.936+0000 7faa5a7c5700 1 -- 172.21.15.40:0/1637416158 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa500094a0 con 0x7faa541301c0 2023-09-30T22:25:10.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.936+0000 7faa5a7c5700 1 --2- 172.21.15.40:0/1637416158 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faa541301c0 0x7faa54136e30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faa4c00cb90 tx=0x7faa4c00cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:10.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.936+0000 7faa4a7fc700 1 -- 172.21.15.40:0/1637416158 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c003c00 con 0x7faa541301c0 2023-09-30T22:25:10.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.936+0000 7faa4a7fc700 1 -- 172.21.15.40:0/1637416158 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4c003d60 con 0x7faa541301c0 2023-09-30T22:25:10.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.936+0000 7faa5c228700 1 -- 172.21.15.40:0/1637416158 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa540a2060 con 0x7faa541301c0 2023-09-30T22:25:10.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.936+0000 7faa4a7fc700 1 -- 172.21.15.40:0/1637416158 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c00aa80 con 0x7faa541301c0 2023-09-30T22:25:10.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.936+0000 7faa5c228700 1 -- 172.21.15.40:0/1637416158 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa5413b180 con 0x7faa541301c0 2023-09-30T22:25:10.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.937+0000 7faa4a7fc700 1 -- 172.21.15.40:0/1637416158 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7faa4c00abe0 con 0x7faa541301c0 2023-09-30T22:25:10.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.937+0000 7faa5c228700 1 -- 172.21.15.40:0/1637416158 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa54062380 con 0x7faa541301c0 2023-09-30T22:25:10.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.937+0000 7faa4a7fc700 1 -- 172.21.15.40:0/1637416158 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7faa4c03fbc0 con 0x7faa541301c0 2023-09-30T22:25:10.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.937+0000 7faa59fc4700 1 -- 172.21.15.40:0/1637416158 >> v1:172.21.15.40:6816/127432 conn(0x7faa3802f510 legacy=0x7faa380319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:10.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.947+0000 7faa4a7fc700 1 -- 172.21.15.40:0/1637416158 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faa4c0196c0 con 0x7faa541301c0 2023-09-30T22:25:10.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.971+0000 7fa977fff700 1 -- 172.21.15.40:0/2889135504 >> v1:172.21.15.40:6816/127432 conn(0x7fa95c02f510 legacy=0x7fa95c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:10.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.979+0000 7f6121f05700 1 Processor -- start 2023-09-30T22:25:10.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.979+0000 7f6121f05700 1 -- start start 2023-09-30T22:25:10.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.979+0000 7f6121f05700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f611c09d920 0x7f611c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.979+0000 7f6121f05700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f611c130fb0 0x7f611c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.979+0000 7f6121f05700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f611c09adf0 con 0x7f611c09e230 2023-09-30T22:25:10.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.979+0000 7f6121f05700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f611c09edf0 con 0x7f611c130fb0 2023-09-30T22:25:10.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.979+0000 7f6121f05700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f611c09b660 con 0x7f611c09d920 2023-09-30T22:25:10.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.980+0000 7f611b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f611c09d920 0x7f611c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.980+0000 7f611b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f611c09d920 0x7f611c09dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38352/0 (socket says 172.21.15.40:38352) 2023-09-30T22:25:10.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.980+0000 7f611b7fe700 1 -- 172.21.15.40:0/2910855957 learned_addr learned my addr 172.21.15.40:0/2910855957 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:10.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.980+0000 7f611bfff700 1 --2- 172.21.15.40:0/2910855957 >> v2:172.21.15.40:3300/0 conn(0x7f611c130fb0 0x7f611c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.980+0000 7f611b7fe700 1 -- 172.21.15.40:0/2910855957 >> v2:172.21.15.40:3300/0 conn(0x7f611c130fb0 msgr2=0x7f611c138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:10.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.980+0000 7f611b7fe700 1 --2- 172.21.15.40:0/2910855957 >> v2:172.21.15.40:3300/0 conn(0x7f611c130fb0 0x7f611c138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.980+0000 7f611b7fe700 1 -- 172.21.15.40:0/2910855957 >> v1:172.21.15.40:6789/0 conn(0x7f611c09e230 legacy=0x7f611c1308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.980+0000 7f611b7fe700 1 -- 172.21.15.40:0/2910855957 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f611c09a6e0 con 0x7f611c09d920 2023-09-30T22:25:10.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.980+0000 7f611b7fe700 1 --2- 172.21.15.40:0/2910855957 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f611c09d920 0x7f611c09dcf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f610c006fd0 tx=0x7f610c00be70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2322091692b46a8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:10.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.980+0000 7f611a7fc700 1 -- 172.21.15.40:0/2910855957 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610c005e30 con 0x7f611c09d920 2023-09-30T22:25:10.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.981+0000 7f611a7fc700 1 -- 172.21.15.40:0/2910855957 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610c004030 con 0x7f611c09d920 2023-09-30T22:25:10.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.981+0000 7f611a7fc700 1 -- 172.21.15.40:0/2910855957 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610c0043e0 con 0x7f611c09d920 2023-09-30T22:25:10.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.981+0000 7f6121f05700 1 -- 172.21.15.40:0/2910855957 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f611c09d920 msgr2=0x7f611c09dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.981+0000 7f6121f05700 1 --2- 172.21.15.40:0/2910855957 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f611c09d920 0x7f611c09dcf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f610c006fd0 tx=0x7f610c00be70 comp rx=0 tx=0).stop 2023-09-30T22:25:10.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.981+0000 7f6121f05700 1 -- 172.21.15.40:0/2910855957 shutdown_connections 2023-09-30T22:25:10.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.981+0000 7f6121f05700 1 --2- 172.21.15.40:0/2910855957 >> v2:172.21.15.40:3300/0 conn(0x7f611c130fb0 0x7f611c138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.981+0000 7f6121f05700 1 --2- 172.21.15.40:0/2910855957 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f611c09d920 0x7f611c09dcf0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.981+0000 7f6121f05700 1 -- 172.21.15.40:0/2910855957 >> 172.21.15.40:0/2910855957 conn(0x7f611c09fb20 msgr2=0x7f611c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:10.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.981+0000 7f6121f05700 1 -- 172.21.15.40:0/2910855957 shutdown_connections 2023-09-30T22:25:10.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.981+0000 7f6121f05700 1 -- 172.21.15.40:0/2910855957 wait complete. 2023-09-30T22:25:10.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.982+0000 7f6121f05700 1 Processor -- start 2023-09-30T22:25:10.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.982+0000 7f6121f05700 1 -- start start 2023-09-30T22:25:10.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.983+0000 7f6121f05700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f611c09d920 0x7f611c11cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.983+0000 7f6121f05700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f611c09e230 0x7f611c11d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.983+0000 7f6121f05700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f611c130fb0 0x7f611c11da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.983+0000 7f6121f05700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611c121470 con 0x7f611c09e230 2023-09-30T22:25:10.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.983+0000 7f6121f05700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f611c11ec40 con 0x7f611c09d920 2023-09-30T22:25:10.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.983+0000 7f6121f05700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f611c1207d0 con 0x7f611c130fb0 2023-09-30T22:25:10.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.983+0000 7f611b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f611c09d920 0x7f611c11cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.983+0000 7f611affd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f611c09e230 0x7f611c11d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.983+0000 7f611b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f611c09d920 0x7f611c11cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38356/0 (socket says 172.21.15.40:38356) 2023-09-30T22:25:10.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.983+0000 7f611affd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f611c09e230 0x7f611c11d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56586/0 (socket says 172.21.15.40:56586) 2023-09-30T22:25:10.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.983+0000 7f611b7fe700 1 -- 172.21.15.40:0/50258459 learned_addr learned my addr 172.21.15.40:0/50258459 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:10.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.983+0000 7f611bfff700 1 --2- 172.21.15.40:0/50258459 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f611c130fb0 0x7f611c11da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.984+0000 7f611affd700 1 -- 172.21.15.40:0/50258459 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f611c130fb0 msgr2=0x7f611c11da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.984+0000 7f611affd700 1 --2- 172.21.15.40:0/50258459 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f611c130fb0 0x7f611c11da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.984+0000 7f611affd700 1 -- 172.21.15.40:0/50258459 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f611c09d920 msgr2=0x7f611c11cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.984+0000 7f611affd700 1 --2- 172.21.15.40:0/50258459 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f611c09d920 0x7f611c11cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.984+0000 7f611affd700 1 -- 172.21.15.40:0/50258459 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610c00b7a0 con 0x7f611c09e230 2023-09-30T22:25:10.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.984+0000 7f611affd700 1 --2- 172.21.15.40:0/50258459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f611c09e230 0x7f611c11d4d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6110000f60 tx=0x7f611000c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:10.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.984+0000 7f6103fff700 1 -- 172.21.15.40:0/50258459 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61100050d0 con 0x7f611c09e230 2023-09-30T22:25:10.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.984+0000 7f6103fff700 1 -- 172.21.15.40:0/50258459 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6110005230 con 0x7f611c09e230 2023-09-30T22:25:10.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.984+0000 7f6103fff700 1 -- 172.21.15.40:0/50258459 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6110003680 con 0x7f611c09e230 2023-09-30T22:25:10.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.985+0000 7f6121f05700 1 -- 172.21.15.40:0/50258459 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f611c071360 con 0x7f611c09e230 2023-09-30T22:25:10.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.985+0000 7f6121f05700 1 -- 172.21.15.40:0/50258459 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f611c11fdf0 con 0x7f611c09e230 2023-09-30T22:25:10.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.985+0000 7f6103fff700 1 -- 172.21.15.40:0/50258459 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f61100037e0 con 0x7f611c09e230 2023-09-30T22:25:10.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.986+0000 7f6121f05700 1 -- 172.21.15.40:0/50258459 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f611c120bd0 con 0x7f611c09e230 2023-09-30T22:25:10.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.986+0000 7f6103fff700 1 -- 172.21.15.40:0/50258459 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f611003ee90 con 0x7f611c09e230 2023-09-30T22:25:10.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.986+0000 7f611b7fe700 1 -- 172.21.15.40:0/50258459 >> v1:172.21.15.40:6816/127432 conn(0x7f610802f510 legacy=0x7f61080319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:10.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.989+0000 7fa97ed43700 1 -- 172.21.15.40:0/2889135504 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa978074620 con 0x7fa97809ad30 2023-09-30T22:25:10.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.990+0000 7fa9757fa700 1 -- 172.21.15.40:0/2889135504 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa96c01bb10 con 0x7fa97809ad30 2023-09-30T22:25:10.990 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:10.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.994+0000 7fa97ed43700 1 -- 172.21.15.40:0/2889135504 >> v1:172.21.15.40:6816/127432 conn(0x7fa95c02f510 legacy=0x7fa95c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:10.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.994+0000 7fa97ed43700 1 -- 172.21.15.40:0/2889135504 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa97809ad30 msgr2=0x7fa97812ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.994+0000 7fa97ed43700 1 --2- 172.21.15.40:0/2889135504 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa97809ad30 0x7fa97812ac60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa96c00c6d0 tx=0x7fa96c00c9e0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.994+0000 7fa97ed43700 1 -- 172.21.15.40:0/2889135504 shutdown_connections 2023-09-30T22:25:10.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.994+0000 7fa97ed43700 1 --2- 172.21.15.40:0/2889135504 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa97809ad30 0x7fa97812ac60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.994+0000 7fa97ed43700 1 --2- 172.21.15.40:0/2889135504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa978130c00 0x7fa97812b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.994+0000 7fa97ed43700 1 --2- 172.21.15.40:0/2889135504 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa978130570 0x7fa97812b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.994+0000 7fa97ed43700 1 -- 172.21.15.40:0/2889135504 >> 172.21.15.40:0/2889135504 conn(0x7fa97809eb10 msgr2=0x7fa97812f300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:10.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.994+0000 7fa97ed43700 1 -- 172.21.15.40:0/2889135504 shutdown_connections 2023-09-30T22:25:10.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.994+0000 7fa97ed43700 1 -- 172.21.15.40:0/2889135504 wait complete. 2023-09-30T22:25:10.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:10.995+0000 7f6103fff700 1 -- 172.21.15.40:0/50258459 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6110011590 con 0x7f611c09e230 2023-09-30T22:25:11.012 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:11.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.033+0000 7f31622a1700 1 Processor -- start 2023-09-30T22:25:11.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.033+0000 7f31622a1700 1 -- start start 2023-09-30T22:25:11.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.033+0000 7f31622a1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f315c09fbb0 0x7f315c06c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:11.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.033+0000 7f31622a1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f315c06d2c0 0x7f315c13baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:11.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.033+0000 7f31622a1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f315c0a0590 con 0x7f315c06ced0 2023-09-30T22:25:11.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.033+0000 7f31622a1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f315c09ff80 con 0x7f315c06d2c0 2023-09-30T22:25:11.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.033+0000 7f31622a1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f315c06da80 con 0x7f315c09fbb0 2023-09-30T22:25:11.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.034+0000 7f315bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f315c09fbb0 0x7f315c06c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:11.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.034+0000 7f315b7fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f315c06ced0 0x7f315c138370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:36832/0 (socket says 172.21.15.40:36832) 2023-09-30T22:25:11.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.034+0000 7f315bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f315c09fbb0 0x7f315c06c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:42740/0 (socket says 172.21.15.40:42740) 2023-09-30T22:25:11.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.034+0000 7f315b7fe700 1 -- 172.21.15.40:0/1406953561 learned_addr learned my addr 172.21.15.40:0/1406953561 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:11.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.034+0000 7f316083e700 1 --2- 172.21.15.40:0/1406953561 >> v2:172.21.15.40:3300/0 conn(0x7f315c06d2c0 0x7f315c13baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:11.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.034+0000 7f316083e700 1 -- 172.21.15.40:0/1406953561 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f315c09fbb0 msgr2=0x7f315c06c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:11.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.034+0000 7f316083e700 1 --2- 172.21.15.40:0/1406953561 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f315c09fbb0 0x7f315c06c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.034+0000 7f316083e700 1 -- 172.21.15.40:0/1406953561 >> v1:172.21.15.40:6789/0 conn(0x7f315c06ced0 legacy=0x7f315c138370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:11.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.034+0000 7f316083e700 1 -- 172.21.15.40:0/1406953561 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315c0a0780 con 0x7f315c06d2c0 2023-09-30T22:25:11.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.034+0000 7f315affd700 1 -- 172.21.15.40:0/1406953561 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1238748211 0 0) 0x7f315c0a0590 con 0x7f315c06ced0 2023-09-30T22:25:11.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.034+0000 7f316083e700 1 --2- 172.21.15.40:0/1406953561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f315c06d2c0 0x7f315c13baa0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3154009d90 tx=0x7f315400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff87a000c4189b89 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:11.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.034+0000 7f315affd700 1 -- 172.21.15.40:0/1406953561 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315400e070 con 0x7f315c06d2c0 2023-09-30T22:25:11.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.034+0000 7f315affd700 1 -- 172.21.15.40:0/1406953561 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315400bb20 con 0x7f315c06d2c0 2023-09-30T22:25:11.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.034+0000 7f315affd700 1 -- 172.21.15.40:0/1406953561 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3154012430 con 0x7f315c06d2c0 2023-09-30T22:25:11.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.035+0000 7f31622a1700 1 -- 172.21.15.40:0/1406953561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f315c06d2c0 msgr2=0x7f315c13baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:11.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.035+0000 7f31622a1700 1 --2- 172.21.15.40:0/1406953561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f315c06d2c0 0x7f315c13baa0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3154009d90 tx=0x7f315400b330 comp rx=0 tx=0).stop 2023-09-30T22:25:11.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.035+0000 7f31622a1700 1 -- 172.21.15.40:0/1406953561 shutdown_connections 2023-09-30T22:25:11.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.035+0000 7f31622a1700 1 --2- 172.21.15.40:0/1406953561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f315c06d2c0 0x7f315c13baa0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.035+0000 7f31622a1700 1 --2- 172.21.15.40:0/1406953561 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f315c09fbb0 0x7f315c06c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.035+0000 7f31622a1700 1 -- 172.21.15.40:0/1406953561 >> 172.21.15.40:0/1406953561 conn(0x7f315c0a41a0 msgr2=0x7f315c0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:11.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.035+0000 7f31622a1700 1 -- 172.21.15.40:0/1406953561 shutdown_connections 2023-09-30T22:25:11.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.035+0000 7f31622a1700 1 -- 172.21.15.40:0/1406953561 wait complete. 2023-09-30T22:25:11.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.036+0000 7f31622a1700 1 Processor -- start 2023-09-30T22:25:11.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.036+0000 7f31622a1700 1 -- start start 2023-09-30T22:25:11.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.037+0000 7f31622a1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f315c06ced0 0x7f315c1bc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:11.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.037+0000 7f31622a1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f315c06d2c0 0x7f315c1bc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:11.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.037+0000 7f31622a1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f315c09fbb0 0x7f315c1bcb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:11.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.037+0000 7f31622a1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315c092a70 con 0x7f315c06d2c0 2023-09-30T22:25:11.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.037+0000 7f31622a1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f315c094a80 con 0x7f315c06ced0 2023-09-30T22:25:11.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.037+0000 7f31622a1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f315c093630 con 0x7f315c09fbb0 2023-09-30T22:25:11.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.037+0000 7f315bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f315c06ced0 0x7f315c1bc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:11.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.037+0000 7f315b7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f315c06d2c0 0x7f315c1bc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:11.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.037+0000 7f315bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f315c06ced0 0x7f315c1bc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38368/0 (socket says 172.21.15.40:38368) 2023-09-30T22:25:11.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.037+0000 7f315bfff700 1 -- 172.21.15.40:0/283066808 learned_addr learned my addr 172.21.15.40:0/283066808 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:11.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.037+0000 7f316083e700 1 --2- 172.21.15.40:0/283066808 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f315c09fbb0 0x7f315c1bcb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:11.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.037+0000 7f315bfff700 1 -- 172.21.15.40:0/283066808 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f315c09fbb0 msgr2=0x7f315c1bcb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:11.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.037+0000 7f315bfff700 1 --2- 172.21.15.40:0/283066808 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f315c09fbb0 0x7f315c1bcb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.037+0000 7f315bfff700 1 -- 172.21.15.40:0/283066808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f315c06d2c0 msgr2=0x7f315c1bc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:11.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.037+0000 7f315bfff700 1 --2- 172.21.15.40:0/283066808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f315c06d2c0 0x7f315c1bc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.037+0000 7f315bfff700 1 -- 172.21.15.40:0/283066808 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3154009a70 con 0x7f315c06ced0 2023-09-30T22:25:11.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.037+0000 7f315b7fe700 1 --2- 172.21.15.40:0/283066808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f315c06d2c0 0x7f315c1bc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:11.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.037+0000 7f315bfff700 1 --2- 172.21.15.40:0/283066808 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f315c06ced0 0x7f315c1bc090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f314c00e9b0 tx=0x7f314c00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:11.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.038+0000 7f3158ff9700 1 -- 172.21.15.40:0/283066808 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314c009710 con 0x7f315c06ced0 2023-09-30T22:25:11.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.038+0000 7f3158ff9700 1 -- 172.21.15.40:0/283066808 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314c00ee50 con 0x7f315c06ced0 2023-09-30T22:25:11.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.038+0000 7f31622a1700 1 -- 172.21.15.40:0/283066808 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f315c071630 con 0x7f315c06ced0 2023-09-30T22:25:11.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.038+0000 7f3158ff9700 1 -- 172.21.15.40:0/283066808 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314c00ca50 con 0x7f315c06ced0 2023-09-30T22:25:11.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.038+0000 7f31622a1700 1 -- 172.21.15.40:0/283066808 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f315c095690 con 0x7f315c06ced0 2023-09-30T22:25:11.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.039+0000 7f3158ff9700 1 -- 172.21.15.40:0/283066808 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f314c00cbb0 con 0x7f315c06ced0 2023-09-30T22:25:11.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.039+0000 7f315b7fe700 1 -- 172.21.15.40:0/283066808 >> v1:172.21.15.40:6816/127432 conn(0x7f314802f510 legacy=0x7f31480319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:11.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.039+0000 7f3158ff9700 1 -- 172.21.15.40:0/283066808 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f314c040050 con 0x7f315c06ced0 2023-09-30T22:25:11.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.039+0000 7f31622a1700 1 -- 172.21.15.40:0/283066808 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f315c062380 con 0x7f315c06ced0 2023-09-30T22:25:11.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.044+0000 7f3158ff9700 1 -- 172.21.15.40:0/283066808 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f314c021020 con 0x7f315c06ced0 2023-09-30T22:25:11.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.139+0000 7faa59fc4700 1 -- 172.21.15.40:0/1637416158 >> v1:172.21.15.40:6816/127432 conn(0x7faa3802f510 legacy=0x7faa380319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:11.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.178+0000 7faa5c228700 1 -- 172.21.15.40:0/1637416158 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faa54074330 con 0x7faa541301c0 2023-09-30T22:25:11.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.179+0000 7faa4a7fc700 1 -- 172.21.15.40:0/1637416158 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faa4c019300 con 0x7faa541301c0 2023-09-30T22:25:11.179 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:11.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.181+0000 7faa5c228700 1 -- 172.21.15.40:0/1637416158 >> v1:172.21.15.40:6816/127432 conn(0x7faa3802f510 legacy=0x7faa380319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:11.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.181+0000 7faa5c228700 1 -- 172.21.15.40:0/1637416158 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faa541301c0 msgr2=0x7faa54136e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:11.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.181+0000 7faa5c228700 1 --2- 172.21.15.40:0/1637416158 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faa541301c0 0x7faa54136e30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faa4c00cb90 tx=0x7faa4c00cea0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.181+0000 7faa5c228700 1 -- 172.21.15.40:0/1637416158 shutdown_connections 2023-09-30T22:25:11.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.181+0000 7faa5c228700 1 --2- 172.21.15.40:0/1637416158 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faa541301c0 0x7faa54136e30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.181+0000 7faa5c228700 1 --2- 172.21.15.40:0/1637416158 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa5409d450 0x7faa541363b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.181+0000 7faa5c228700 1 --2- 172.21.15.40:0/1637416158 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa5409dd60 0x7faa541368f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.181+0000 7faa5c228700 1 -- 172.21.15.40:0/1637416158 >> 172.21.15.40:0/1637416158 conn(0x7faa540a2a00 msgr2=0x7faa540a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:11.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.181+0000 7faa5c228700 1 -- 172.21.15.40:0/1637416158 shutdown_connections 2023-09-30T22:25:11.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.181+0000 7faa5c228700 1 -- 172.21.15.40:0/1637416158 wait complete. 2023-09-30T22:25:11.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.187+0000 7f611b7fe700 1 -- 172.21.15.40:0/50258459 >> v1:172.21.15.40:6816/127432 conn(0x7f610802f510 legacy=0x7f61080319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:11.194 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:11.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.195+0000 7f6121f05700 1 -- 172.21.15.40:0/50258459 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f611c062380 con 0x7f611c09e230 2023-09-30T22:25:11.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.196+0000 7f6103fff700 1 -- 172.21.15.40:0/50258459 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6110017070 con 0x7f611c09e230 2023-09-30T22:25:11.196 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:11.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.197+0000 7f6121f05700 1 -- 172.21.15.40:0/50258459 >> v1:172.21.15.40:6816/127432 conn(0x7f610802f510 legacy=0x7f61080319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:11.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.197+0000 7f6121f05700 1 -- 172.21.15.40:0/50258459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f611c09e230 msgr2=0x7f611c11d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:11.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.197+0000 7f6121f05700 1 --2- 172.21.15.40:0/50258459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f611c09e230 0x7f611c11d4d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6110000f60 tx=0x7f611000c730 comp rx=0 tx=0).stop 2023-09-30T22:25:11.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.198+0000 7f6121f05700 1 -- 172.21.15.40:0/50258459 shutdown_connections 2023-09-30T22:25:11.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.198+0000 7f6121f05700 1 --2- 172.21.15.40:0/50258459 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f611c130fb0 0x7f611c11da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.198+0000 7f6121f05700 1 --2- 172.21.15.40:0/50258459 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f611c09d920 0x7f611c11cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.198+0000 7f6121f05700 1 --2- 172.21.15.40:0/50258459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f611c09e230 0x7f611c11d4d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.198+0000 7f6121f05700 1 -- 172.21.15.40:0/50258459 >> 172.21.15.40:0/50258459 conn(0x7f611c09fb20 msgr2=0x7f611c12ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:11.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.198+0000 7f6121f05700 1 -- 172.21.15.40:0/50258459 shutdown_connections 2023-09-30T22:25:11.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.198+0000 7f6121f05700 1 -- 172.21.15.40:0/50258459 wait complete. 2023-09-30T22:25:11.210 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:11.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.240+0000 7f315b7fe700 1 -- 172.21.15.40:0/283066808 >> v1:172.21.15.40:6816/127432 conn(0x7f314802f510 legacy=0x7f31480319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:11.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.261+0000 7f31622a1700 1 -- 172.21.15.40:0/283066808 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f315c071eb0 con 0x7f315c06ced0 2023-09-30T22:25:11.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.261+0000 7f3158ff9700 1 -- 172.21.15.40:0/283066808 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f314c017070 con 0x7f315c06ced0 2023-09-30T22:25:11.262 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:11.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.263+0000 7f31622a1700 1 -- 172.21.15.40:0/283066808 >> v1:172.21.15.40:6816/127432 conn(0x7f314802f510 legacy=0x7f31480319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:11.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.263+0000 7f31622a1700 1 -- 172.21.15.40:0/283066808 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f315c06ced0 msgr2=0x7f315c1bc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:11.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.263+0000 7f31622a1700 1 --2- 172.21.15.40:0/283066808 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f315c06ced0 0x7f315c1bc090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f314c00e9b0 tx=0x7f314c00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.263+0000 7f31622a1700 1 -- 172.21.15.40:0/283066808 shutdown_connections 2023-09-30T22:25:11.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.263+0000 7f31622a1700 1 --2- 172.21.15.40:0/283066808 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f315c09fbb0 0x7f315c1bcb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.263+0000 7f31622a1700 1 --2- 172.21.15.40:0/283066808 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f315c06ced0 0x7f315c1bc090 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.263+0000 7f31622a1700 1 --2- 172.21.15.40:0/283066808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f315c06d2c0 0x7f315c1bc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.263+0000 7f31622a1700 1 -- 172.21.15.40:0/283066808 >> 172.21.15.40:0/283066808 conn(0x7f315c0a41a0 msgr2=0x7f315c0a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:11.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.263+0000 7f31622a1700 1 -- 172.21.15.40:0/283066808 shutdown_connections 2023-09-30T22:25:11.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:11.263+0000 7f31622a1700 1 -- 172.21.15.40:0/283066808 wait complete. 2023-09-30T22:25:11.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:12.013 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:12.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.153+0000 7f5e5957d700 1 Processor -- start 2023-09-30T22:25:12.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.154+0000 7f5e5957d700 1 -- start start 2023-09-30T22:25:12.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.154+0000 7f5e5957d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e5409c890 0x7f5e5409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.154+0000 7f5e5957d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e5409d920 0x7f5e5409dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.154+0000 7f5e5957d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e540a2600 con 0x7f5e5409e2b0 2023-09-30T22:25:12.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.154+0000 7f5e5957d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e540a29d0 con 0x7f5e5409d920 2023-09-30T22:25:12.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.154+0000 7f5e5957d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5409fb40 con 0x7f5e5409c890 2023-09-30T22:25:12.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.154+0000 7f5e527fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e5409d920 0x7f5e5409dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.154+0000 7f5e52ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e5409c890 0x7f5e5409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.154+0000 7f5e527fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e5409d920 0x7f5e5409dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38384/0 (socket says 172.21.15.40:38384) 2023-09-30T22:25:12.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.154+0000 7f5e52ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e5409c890 0x7f5e5409cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:42754/0 (socket says 172.21.15.40:42754) 2023-09-30T22:25:12.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.154+0000 7f5e527fc700 1 -- 172.21.15.40:0/1785715643 learned_addr learned my addr 172.21.15.40:0/1785715643 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:12.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.154+0000 7f5e51ffb700 1 -- 172.21.15.40:0/1785715643 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2001937665 0 0) 0x7f5e540a2600 con 0x7f5e5409e2b0 2023-09-30T22:25:12.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.155+0000 7f5e51ffb700 1 -- 172.21.15.40:0/1785715643 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e400035b0 con 0x7f5e5409e2b0 2023-09-30T22:25:12.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.155+0000 7f5e527fc700 1 -- 172.21.15.40:0/1785715643 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e5409c890 msgr2=0x7f5e5409cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:12.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.155+0000 7f5e527fc700 1 --2- 172.21.15.40:0/1785715643 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e5409c890 0x7f5e5409cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.155+0000 7f5e527fc700 1 -- 172.21.15.40:0/1785715643 >> v1:172.21.15.40:6789/0 conn(0x7f5e5409e2b0 legacy=0x7f5e5413ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.155+0000 7f5e527fc700 1 -- 172.21.15.40:0/1785715643 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e5409e720 con 0x7f5e5409d920 2023-09-30T22:25:12.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.155+0000 7f5e52ffd700 1 --2- 172.21.15.40:0/1785715643 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e5409c890 0x7f5e5409cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:12.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.155+0000 7f5e527fc700 1 --2- 172.21.15.40:0/1785715643 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e5409d920 0x7f5e5409dd70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5e44009920 tx=0x7f5e44009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a904514810ed8eb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:12.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.155+0000 7f5e51ffb700 1 -- 172.21.15.40:0/1785715643 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e44011830 con 0x7f5e5409d920 2023-09-30T22:25:12.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.155+0000 7f5e51ffb700 1 -- 172.21.15.40:0/1785715643 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e44011990 con 0x7f5e5409d920 2023-09-30T22:25:12.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.155+0000 7f5e51ffb700 1 -- 172.21.15.40:0/1785715643 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e44011d20 con 0x7f5e5409d920 2023-09-30T22:25:12.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.155+0000 7f5e5957d700 1 -- 172.21.15.40:0/1785715643 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e5409d920 msgr2=0x7f5e5409dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.155+0000 7f5e5957d700 1 --2- 172.21.15.40:0/1785715643 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e5409d920 0x7f5e5409dd70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5e44009920 tx=0x7f5e44009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:12.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.156+0000 7f5e5957d700 1 -- 172.21.15.40:0/1785715643 shutdown_connections 2023-09-30T22:25:12.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.156+0000 7f5e5957d700 1 --2- 172.21.15.40:0/1785715643 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e5409c890 0x7f5e5409cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.156+0000 7f5e5957d700 1 --2- 172.21.15.40:0/1785715643 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e5409d920 0x7f5e5409dd70 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.156+0000 7f5e5957d700 1 -- 172.21.15.40:0/1785715643 >> 172.21.15.40:0/1785715643 conn(0x7f5e540a7080 msgr2=0x7f5e540a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:12.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.156+0000 7f5e5957d700 1 -- 172.21.15.40:0/1785715643 shutdown_connections 2023-09-30T22:25:12.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.156+0000 7f5e5957d700 1 -- 172.21.15.40:0/1785715643 wait complete. 2023-09-30T22:25:12.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.157+0000 7f5e5957d700 1 Processor -- start 2023-09-30T22:25:12.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.157+0000 7f5e5957d700 1 -- start start 2023-09-30T22:25:12.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.157+0000 7f5e5957d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e5409c890 0x7f5e541c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.157+0000 7f5e5957d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e5409d920 0x7f5e541c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.157+0000 7f5e5957d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e5409e2b0 0x7f5e5412d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.157+0000 7f5e5957d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e54130560 con 0x7f5e5409e2b0 2023-09-30T22:25:12.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.157+0000 7f5e5957d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5408f560 con 0x7f5e5409d920 2023-09-30T22:25:12.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.157+0000 7f5e5957d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5409ecf0 con 0x7f5e5409c890 2023-09-30T22:25:12.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.157+0000 7f5e52ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e5409c890 0x7f5e541c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.157+0000 7f5e52ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e5409c890 0x7f5e541c8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:42766/0 (socket says 172.21.15.40:42766) 2023-09-30T22:25:12.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.157+0000 7f5e537fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e5409e2b0 0x7f5e5412d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.157+0000 7f5e52ffd700 1 -- 172.21.15.40:0/2146837951 learned_addr learned my addr 172.21.15.40:0/2146837951 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:12.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.157+0000 7f5e527fc700 1 --2- 172.21.15.40:0/2146837951 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e5409d920 0x7f5e541c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.158+0000 7f5e52ffd700 1 -- 172.21.15.40:0/2146837951 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e5409d920 msgr2=0x7f5e541c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.158+0000 7f5e52ffd700 1 --2- 172.21.15.40:0/2146837951 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e5409d920 0x7f5e541c9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.158+0000 7f5e52ffd700 1 -- 172.21.15.40:0/2146837951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e5409e2b0 msgr2=0x7f5e5412d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.158+0000 7f5e52ffd700 1 --2- 172.21.15.40:0/2146837951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e5409e2b0 0x7f5e5412d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.158+0000 7f5e52ffd700 1 -- 172.21.15.40:0/2146837951 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3c009430 con 0x7f5e5409c890 2023-09-30T22:25:12.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.158+0000 7f5e537fe700 1 --2- 172.21.15.40:0/2146837951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e5409e2b0 0x7f5e5412d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:12.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.158+0000 7f5e52ffd700 1 --2- 172.21.15.40:0/2146837951 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e5409c890 0x7f5e541c8c50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c00ebe0 tx=0x7f5e3c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:12.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.158+0000 7f5e4b7fe700 1 -- 172.21.15.40:0/2146837951 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c009740 con 0x7f5e5409c890 2023-09-30T22:25:12.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.158+0000 7f5e4b7fe700 1 -- 172.21.15.40:0/2146837951 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3c005a20 con 0x7f5e5409c890 2023-09-30T22:25:12.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.158+0000 7f5e5957d700 1 -- 172.21.15.40:0/2146837951 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e44009550 con 0x7f5e5409c890 2023-09-30T22:25:12.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.158+0000 7f5e4b7fe700 1 -- 172.21.15.40:0/2146837951 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c005db0 con 0x7f5e5409c890 2023-09-30T22:25:12.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.158+0000 7f5e5957d700 1 -- 172.21.15.40:0/2146837951 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e54130aa0 con 0x7f5e5409c890 2023-09-30T22:25:12.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.159+0000 7f5e4b7fe700 1 -- 172.21.15.40:0/2146837951 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5e3c00c850 con 0x7f5e5409c890 2023-09-30T22:25:12.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.159+0000 7f5e4b7fe700 1 -- 172.21.15.40:0/2146837951 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f5e3c03fe00 con 0x7f5e5409c890 2023-09-30T22:25:12.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.159+0000 7f5e527fc700 1 -- 172.21.15.40:0/2146837951 >> v1:172.21.15.40:6816/127432 conn(0x7f5e3402f540 legacy=0x7f5e340319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:12.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.159+0000 7f5e5957d700 1 -- 172.21.15.40:0/2146837951 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e54130c90 con 0x7f5e5409c890 2023-09-30T22:25:12.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.164+0000 7f5e4b7fe700 1 -- 172.21.15.40:0/2146837951 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5e3c020020 con 0x7f5e5409c890 2023-09-30T22:25:12.194 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:12.211 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:12.277 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:12.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.331+0000 7fe50b10a700 1 Processor -- start 2023-09-30T22:25:12.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.331+0000 7fe50b10a700 1 -- start start 2023-09-30T22:25:12.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.331+0000 7fe50b10a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe50409d920 0x7fe50409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.331+0000 7fe50b10a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe50409f0f0 0x7fe50409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.331+0000 7fe50b10a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe504133ca0 0x7fe504134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.331+0000 7fe50b10a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe50406b4c0 con 0x7fe50409f0f0 2023-09-30T22:25:12.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.331+0000 7fe50b10a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe50409a8f0 con 0x7fe504133ca0 2023-09-30T22:25:12.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.331+0000 7fe50b10a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe50409f940 con 0x7fe50409d920 2023-09-30T22:25:12.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.332+0000 7fe503fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe50409f0f0 0x7fe50409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.332+0000 7fe508ea6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe50409d920 0x7fe50409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.332+0000 7fe5096a7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe504133ca0 0x7fe504134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.332+0000 7fe503fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe50409f0f0 0x7fe50409e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56606/0 (socket says 172.21.15.40:56606) 2023-09-30T22:25:12.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.332+0000 7fe503fff700 1 -- 172.21.15.40:0/1127322768 learned_addr learned my addr 172.21.15.40:0/1127322768 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:12.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.332+0000 7fe5096a7700 1 -- 172.21.15.40:0/1127322768 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe50409d920 msgr2=0x7fe50409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:12.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.332+0000 7fe5096a7700 1 --2- 172.21.15.40:0/1127322768 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe50409d920 0x7fe50409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.332+0000 7fe5096a7700 1 -- 172.21.15.40:0/1127322768 >> v2:172.21.15.40:3300/0 conn(0x7fe50409f0f0 msgr2=0x7fe50409e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:12.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.332+0000 7fe5096a7700 1 --2- 172.21.15.40:0/1127322768 >> v2:172.21.15.40:3300/0 conn(0x7fe50409f0f0 0x7fe50409e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.332+0000 7fe5096a7700 1 -- 172.21.15.40:0/1127322768 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe50409f6e0 con 0x7fe504133ca0 2023-09-30T22:25:12.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.332+0000 7fe5096a7700 1 --2- 172.21.15.40:0/1127322768 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe504133ca0 0x7fe504134140 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc0098a0 tx=0x7fe4fc009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=179afe7fa3096ade server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:12.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.332+0000 7fe5037fe700 1 -- 172.21.15.40:0/1127322768 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc011830 con 0x7fe504133ca0 2023-09-30T22:25:12.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.332+0000 7fe5037fe700 1 -- 172.21.15.40:0/1127322768 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4fc011990 con 0x7fe504133ca0 2023-09-30T22:25:12.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.332+0000 7fe5037fe700 1 -- 172.21.15.40:0/1127322768 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc011d20 con 0x7fe504133ca0 2023-09-30T22:25:12.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.333+0000 7fe50b10a700 1 -- 172.21.15.40:0/1127322768 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe504133ca0 msgr2=0x7fe504134140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.333+0000 7fe50b10a700 1 --2- 172.21.15.40:0/1127322768 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe504133ca0 0x7fe504134140 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc0098a0 tx=0x7fe4fc009bb0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.333+0000 7fe50b10a700 1 -- 172.21.15.40:0/1127322768 shutdown_connections 2023-09-30T22:25:12.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.333+0000 7fe50b10a700 1 --2- 172.21.15.40:0/1127322768 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe50409d920 0x7fe50409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.334+0000 7fe50b10a700 1 --2- 172.21.15.40:0/1127322768 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe504133ca0 0x7fe504134140 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.334+0000 7fe50b10a700 1 --2- 172.21.15.40:0/1127322768 >> v2:172.21.15.40:3300/0 conn(0x7fe50409f0f0 0x7fe50409e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.334+0000 7fe50b10a700 1 -- 172.21.15.40:0/1127322768 >> 172.21.15.40:0/1127322768 conn(0x7fe50409fb20 msgr2=0x7fe50409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:12.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.334+0000 7fe50b10a700 1 -- 172.21.15.40:0/1127322768 shutdown_connections 2023-09-30T22:25:12.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.334+0000 7fe50b10a700 1 -- 172.21.15.40:0/1127322768 wait complete. 2023-09-30T22:25:12.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.335+0000 7fe50b10a700 1 Processor -- start 2023-09-30T22:25:12.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.335+0000 7fe50b10a700 1 -- start start 2023-09-30T22:25:12.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.335+0000 7fe50b10a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe50409d920 0x7fe504121800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.335+0000 7fe50b10a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe504133ca0 0x7fe504121d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.335+0000 7fe50b10a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe504122280 0x7fe5041c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.335+0000 7fe50b10a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe504122cd0 con 0x7fe504133ca0 2023-09-30T22:25:12.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.335+0000 7fe50b10a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe504125320 con 0x7fe504122280 2023-09-30T22:25:12.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.335+0000 7fe50b10a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe50409c9e0 con 0x7fe50409d920 2023-09-30T22:25:12.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.335+0000 7fe508ea6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe50409d920 0x7fe504121800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.335+0000 7fe508ea6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe50409d920 0x7fe504121800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:42790/0 (socket says 172.21.15.40:42790) 2023-09-30T22:25:12.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.335+0000 7fe508ea6700 1 -- 172.21.15.40:0/92770101 learned_addr learned my addr 172.21.15.40:0/92770101 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:12.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.336+0000 7fe5096a7700 1 --2- 172.21.15.40:0/92770101 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe504122280 0x7fe5041c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.336+0000 7fe503fff700 1 --2- 172.21.15.40:0/92770101 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe504133ca0 0x7fe504121d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.336+0000 7fe508ea6700 1 -- 172.21.15.40:0/92770101 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe504122280 msgr2=0x7fe5041c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.336+0000 7fe508ea6700 1 --2- 172.21.15.40:0/92770101 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe504122280 0x7fe5041c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.336+0000 7fe508ea6700 1 -- 172.21.15.40:0/92770101 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe504133ca0 msgr2=0x7fe504121d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.336+0000 7fe508ea6700 1 --2- 172.21.15.40:0/92770101 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe504133ca0 0x7fe504121d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.336+0000 7fe508ea6700 1 -- 172.21.15.40:0/92770101 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4fc0094a0 con 0x7fe50409d920 2023-09-30T22:25:12.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.336+0000 7fe503fff700 1 --2- 172.21.15.40:0/92770101 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe504133ca0 0x7fe504121d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:12.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.336+0000 7fe508ea6700 1 --2- 172.21.15.40:0/92770101 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe50409d920 0x7fe504121800 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe4f400eed0 tx=0x7fe4f400b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:12.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.336+0000 7fe5017fa700 1 -- 172.21.15.40:0/92770101 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f4010040 con 0x7fe50409d920 2023-09-30T22:25:12.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.336+0000 7fe5017fa700 1 -- 172.21.15.40:0/92770101 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f400baf0 con 0x7fe50409d920 2023-09-30T22:25:12.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.336+0000 7fe5017fa700 1 -- 172.21.15.40:0/92770101 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f400be60 con 0x7fe50409d920 2023-09-30T22:25:12.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.336+0000 7fe50b10a700 1 -- 172.21.15.40:0/92770101 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe504123410 con 0x7fe50409d920 2023-09-30T22:25:12.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.336+0000 7fe50b10a700 1 -- 172.21.15.40:0/92770101 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe504123c90 con 0x7fe50409d920 2023-09-30T22:25:12.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.338+0000 7fe50b10a700 1 -- 172.21.15.40:0/92770101 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe504124ea0 con 0x7fe50409d920 2023-09-30T22:25:12.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.338+0000 7fe5017fa700 1 -- 172.21.15.40:0/92770101 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe4f401d400 con 0x7fe50409d920 2023-09-30T22:25:12.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.338+0000 7fe5017fa700 1 -- 172.21.15.40:0/92770101 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7fe4f40419d0 con 0x7fe50409d920 2023-09-30T22:25:12.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.338+0000 7fe503fff700 1 -- 172.21.15.40:0/92770101 >> v1:172.21.15.40:6816/127432 conn(0x7fe4f002f510 legacy=0x7fe4f00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:12.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.347+0000 7fe5017fa700 1 -- 172.21.15.40:0/92770101 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe504124ea0 con 0x7fe50409d920 2023-09-30T22:25:12.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.360+0000 7f5e527fc700 1 -- 172.21.15.40:0/2146837951 >> v1:172.21.15.40:6816/127432 conn(0x7f5e3402f540 legacy=0x7f5e340319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:12.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.369+0000 7f5e5957d700 1 -- 172.21.15.40:0/2146837951 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5e54062380 con 0x7f5e5409c890 2023-09-30T22:25:12.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.369+0000 7f5e4b7fe700 1 -- 172.21.15.40:0/2146837951 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5e3c006030 con 0x7f5e5409c890 2023-09-30T22:25:12.372 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:12.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.372+0000 7f5e5957d700 1 -- 172.21.15.40:0/2146837951 >> v1:172.21.15.40:6816/127432 conn(0x7f5e3402f540 legacy=0x7f5e340319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:12.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.372+0000 7f5e5957d700 1 -- 172.21.15.40:0/2146837951 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e5409c890 msgr2=0x7f5e541c8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.372+0000 7f5e5957d700 1 --2- 172.21.15.40:0/2146837951 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e5409c890 0x7f5e541c8c50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c00ebe0 tx=0x7f5e3c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.372+0000 7f5e5957d700 1 -- 172.21.15.40:0/2146837951 shutdown_connections 2023-09-30T22:25:12.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.372+0000 7f5e5957d700 1 --2- 172.21.15.40:0/2146837951 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e5409c890 0x7f5e541c8c50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.372+0000 7f5e5957d700 1 --2- 172.21.15.40:0/2146837951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e5409e2b0 0x7f5e5412d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.372+0000 7f5e5957d700 1 --2- 172.21.15.40:0/2146837951 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e5409d920 0x7f5e541c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.372+0000 7f5e5957d700 1 -- 172.21.15.40:0/2146837951 >> 172.21.15.40:0/2146837951 conn(0x7f5e540a7080 msgr2=0x7f5e540a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:12.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.372+0000 7f5e5957d700 1 -- 172.21.15.40:0/2146837951 shutdown_connections 2023-09-30T22:25:12.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.372+0000 7f5e5957d700 1 -- 172.21.15.40:0/2146837951 wait complete. 2023-09-30T22:25:12.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.375+0000 7f361a936700 1 Processor -- start 2023-09-30T22:25:12.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.375+0000 7f361a936700 1 -- start start 2023-09-30T22:25:12.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.375+0000 7f361a936700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f361406b1b0 0x7f3614136b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.375+0000 7f361a936700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36141370a0 0x7f3614139480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.375+0000 7f361a936700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f361409eb60 con 0x7f361406a6d0 2023-09-30T22:25:12.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.375+0000 7f361a936700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361409db70 con 0x7f361406b1b0 2023-09-30T22:25:12.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.375+0000 7f361a936700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f361409ddf0 con 0x7f36141370a0 2023-09-30T22:25:12.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.376+0000 7f3618ed3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36141370a0 0x7f3614139480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.376+0000 7f36137fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f361406b1b0 0x7f3614136b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.376+0000 7f3618ed3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36141370a0 0x7f3614139480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:42798/0 (socket says 172.21.15.40:42798) 2023-09-30T22:25:12.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.376+0000 7f3618ed3700 1 -- 172.21.15.40:0/2150553587 learned_addr learned my addr 172.21.15.40:0/2150553587 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:12.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.376+0000 7f3618ed3700 1 -- 172.21.15.40:0/2150553587 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f361406b1b0 msgr2=0x7f3614136b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:12.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.376+0000 7f3618ed3700 1 --2- 172.21.15.40:0/2150553587 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f361406b1b0 0x7f3614136b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.376+0000 7f3618ed3700 1 -- 172.21.15.40:0/2150553587 >> v1:172.21.15.40:6789/0 conn(0x7f361406a6d0 legacy=0x7f361406aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.376+0000 7f3618ed3700 1 -- 172.21.15.40:0/2150553587 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361409c9a0 con 0x7f36141370a0 2023-09-30T22:25:12.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.376+0000 7f36137fe700 1 --2- 172.21.15.40:0/2150553587 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f361406b1b0 0x7f3614136b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:12.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.376+0000 7f3618ed3700 1 --2- 172.21.15.40:0/2150553587 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36141370a0 0x7f3614139480 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f360c009e80 tx=0x7f360c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87fe1f58d981b01e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:12.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.376+0000 7f3612ffd700 1 -- 172.21.15.40:0/2150553587 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360c00e070 con 0x7f36141370a0 2023-09-30T22:25:12.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.376+0000 7f3612ffd700 1 -- 172.21.15.40:0/2150553587 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360c00b910 con 0x7f36141370a0 2023-09-30T22:25:12.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.376+0000 7f3612ffd700 1 -- 172.21.15.40:0/2150553587 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360c00bcc0 con 0x7f36141370a0 2023-09-30T22:25:12.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.377+0000 7f361a936700 1 -- 172.21.15.40:0/2150553587 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36141370a0 msgr2=0x7f3614139480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.377+0000 7f361a936700 1 --2- 172.21.15.40:0/2150553587 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36141370a0 0x7f3614139480 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f360c009e80 tx=0x7f360c00b330 comp rx=0 tx=0).stop 2023-09-30T22:25:12.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.377+0000 7f361a936700 1 -- 172.21.15.40:0/2150553587 shutdown_connections 2023-09-30T22:25:12.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.377+0000 7f361a936700 1 --2- 172.21.15.40:0/2150553587 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36141370a0 0x7f3614139480 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.377+0000 7f361a936700 1 --2- 172.21.15.40:0/2150553587 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f361406b1b0 0x7f3614136b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.377+0000 7f361a936700 1 -- 172.21.15.40:0/2150553587 >> 172.21.15.40:0/2150553587 conn(0x7f361409fb20 msgr2=0x7f361409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:12.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.377+0000 7f361a936700 1 -- 172.21.15.40:0/2150553587 shutdown_connections 2023-09-30T22:25:12.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.377+0000 7f361a936700 1 -- 172.21.15.40:0/2150553587 wait complete. 2023-09-30T22:25:12.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.378+0000 7f361a936700 1 Processor -- start 2023-09-30T22:25:12.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.379+0000 7f361a936700 1 -- start start 2023-09-30T22:25:12.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.379+0000 7f361a936700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f361406a6d0 0x7f36141c4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.379+0000 7f361a936700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f361406b1b0 0x7f36141c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.379+0000 7f361a936700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36141370a0 0x7f36141c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.379+0000 7f361a936700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361409a210 con 0x7f36141370a0 2023-09-30T22:25:12.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.379+0000 7f361a936700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3614122880 con 0x7f361406b1b0 2023-09-30T22:25:12.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.379+0000 7f361a936700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3614121210 con 0x7f361406a6d0 2023-09-30T22:25:12.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.379+0000 7f3613fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f361406a6d0 0x7f36141c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.379+0000 7f3613fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f361406a6d0 0x7f36141c4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:42812/0 (socket says 172.21.15.40:42812) 2023-09-30T22:25:12.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.379+0000 7f3613fff700 1 -- 172.21.15.40:0/1532406040 learned_addr learned my addr 172.21.15.40:0/1532406040 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:12.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.379+0000 7f36137fe700 1 --2- 172.21.15.40:0/1532406040 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f361406b1b0 0x7f36141c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.380+0000 7f3618ed3700 1 --2- 172.21.15.40:0/1532406040 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36141370a0 0x7f36141c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.380+0000 7f3613fff700 1 -- 172.21.15.40:0/1532406040 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f361406b1b0 msgr2=0x7f36141c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.380+0000 7f3613fff700 1 --2- 172.21.15.40:0/1532406040 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f361406b1b0 0x7f36141c47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.380+0000 7f3613fff700 1 -- 172.21.15.40:0/1532406040 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36141370a0 msgr2=0x7f36141c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.380+0000 7f3613fff700 1 --2- 172.21.15.40:0/1532406040 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36141370a0 0x7f36141c4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.380+0000 7f3613fff700 1 -- 172.21.15.40:0/1532406040 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36080094a0 con 0x7f361406a6d0 2023-09-30T22:25:12.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.380+0000 7f3618ed3700 1 --2- 172.21.15.40:0/1532406040 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36141370a0 0x7f36141c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:12.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.380+0000 7f3613fff700 1 --2- 172.21.15.40:0/1532406040 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f361406a6d0 0x7f36141c4270 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f360400c4d0 tx=0x7f360400c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:12.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.380+0000 7f3610ff9700 1 -- 172.21.15.40:0/1532406040 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36040054e0 con 0x7f361406a6d0 2023-09-30T22:25:12.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.380+0000 7f3610ff9700 1 -- 172.21.15.40:0/1532406040 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3604003680 con 0x7f361406a6d0 2023-09-30T22:25:12.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.380+0000 7f361a936700 1 -- 172.21.15.40:0/1532406040 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f360c009b30 con 0x7f361406a6d0 2023-09-30T22:25:12.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.380+0000 7f3610ff9700 1 -- 172.21.15.40:0/1532406040 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3604003a30 con 0x7f361406a6d0 2023-09-30T22:25:12.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.380+0000 7f361a936700 1 -- 172.21.15.40:0/1532406040 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f361409e420 con 0x7f361406a6d0 2023-09-30T22:25:12.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.381+0000 7f3610ff9700 1 -- 172.21.15.40:0/1532406040 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3604003b90 con 0x7f361406a6d0 2023-09-30T22:25:12.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.381+0000 7f3610ff9700 1 -- 172.21.15.40:0/1532406040 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f360403f060 con 0x7f361406a6d0 2023-09-30T22:25:12.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.381+0000 7f36137fe700 1 -- 172.21.15.40:0/1532406040 >> v1:172.21.15.40:6816/127432 conn(0x7f360002f510 legacy=0x7f36000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:12.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.382+0000 7f361a936700 1 -- 172.21.15.40:0/1532406040 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3614122680 con 0x7f361406a6d0 2023-09-30T22:25:12.388 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:12.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.387+0000 7f3610ff9700 1 -- 172.21.15.40:0/1532406040 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3604017070 con 0x7f361406a6d0 2023-09-30T22:25:12.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.442+0000 7f1e57fbb700 1 Processor -- start 2023-09-30T22:25:12.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.443+0000 7f1e57fbb700 1 -- start start 2023-09-30T22:25:12.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.443+0000 7f1e57fbb700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1e5006a6d0 0x7f1e5006aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.443+0000 7f1e57fbb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1e50131fc0 0x7f1e50139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.443+0000 7f1e57fbb700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e5009eb50 con 0x7f1e5006afe0 2023-09-30T22:25:12.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.443+0000 7f1e57fbb700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e5009dde0 con 0x7f1e50131fc0 2023-09-30T22:25:12.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.443+0000 7f1e57fbb700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5009d4a0 con 0x7f1e5006a6d0 2023-09-30T22:25:12.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.443+0000 7f1e56558700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1e50131fc0 0x7f1e50139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.443+0000 7f1e55d57700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1e5006a6d0 0x7f1e5006aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.443+0000 7f1e56558700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1e50131fc0 0x7f1e50139b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56640/0 (socket says 172.21.15.40:56640) 2023-09-30T22:25:12.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.443+0000 7f1e56558700 1 -- 172.21.15.40:0/1836875337 learned_addr learned my addr 172.21.15.40:0/1836875337 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:12.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.444+0000 7f1e56558700 1 -- 172.21.15.40:0/1836875337 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1e5006a6d0 msgr2=0x7f1e5006aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:12.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.444+0000 7f1e56558700 1 --2- 172.21.15.40:0/1836875337 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1e5006a6d0 0x7f1e5006aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.444+0000 7f1e56558700 1 -- 172.21.15.40:0/1836875337 >> v1:172.21.15.40:6789/0 conn(0x7f1e5006afe0 legacy=0x7f1e501318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.444+0000 7f1e56558700 1 -- 172.21.15.40:0/1836875337 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e5009f5f0 con 0x7f1e50131fc0 2023-09-30T22:25:12.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.444+0000 7f1e56558700 1 --2- 172.21.15.40:0/1836875337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e50131fc0 0x7f1e50139b10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1e48009e50 tx=0x7f1e4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a8db681517559c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:12.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.444+0000 7f1e54d55700 1 -- 172.21.15.40:0/1836875337 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4800e070 con 0x7f1e50131fc0 2023-09-30T22:25:12.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.444+0000 7f1e54d55700 1 -- 172.21.15.40:0/1836875337 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4800b910 con 0x7f1e50131fc0 2023-09-30T22:25:12.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.444+0000 7f1e54d55700 1 -- 172.21.15.40:0/1836875337 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4800bcc0 con 0x7f1e50131fc0 2023-09-30T22:25:12.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.445+0000 7f1e57fbb700 1 -- 172.21.15.40:0/1836875337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e50131fc0 msgr2=0x7f1e50139b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.445+0000 7f1e57fbb700 1 --2- 172.21.15.40:0/1836875337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e50131fc0 0x7f1e50139b10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1e48009e50 tx=0x7f1e4800b330 comp rx=0 tx=0).stop 2023-09-30T22:25:12.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.445+0000 7f1e57fbb700 1 -- 172.21.15.40:0/1836875337 shutdown_connections 2023-09-30T22:25:12.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.445+0000 7f1e57fbb700 1 --2- 172.21.15.40:0/1836875337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e50131fc0 0x7f1e50139b10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.445+0000 7f1e57fbb700 1 --2- 172.21.15.40:0/1836875337 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1e5006a6d0 0x7f1e5006aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.445+0000 7f1e57fbb700 1 -- 172.21.15.40:0/1836875337 >> 172.21.15.40:0/1836875337 conn(0x7f1e5009fb20 msgr2=0x7f1e5009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:12.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.445+0000 7f1e57fbb700 1 -- 172.21.15.40:0/1836875337 shutdown_connections 2023-09-30T22:25:12.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.445+0000 7f1e57fbb700 1 -- 172.21.15.40:0/1836875337 wait complete. 2023-09-30T22:25:12.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.446+0000 7f1e57fbb700 1 Processor -- start 2023-09-30T22:25:12.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.446+0000 7f1e57fbb700 1 -- start start 2023-09-30T22:25:12.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.446+0000 7f1e57fbb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e5006a6d0 0x7f1e50120630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.446+0000 7f1e57fbb700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1e5006afe0 0x7f1e50120b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.446+0000 7f1e57fbb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e50131fc0 0x7f1e501210b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.446+0000 7f1e57fbb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e50123f50 con 0x7f1e5006a6d0 2023-09-30T22:25:12.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.446+0000 7f1e57fbb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e50121a90 con 0x7f1e50131fc0 2023-09-30T22:25:12.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.446+0000 7f1e57fbb700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e50124150 con 0x7f1e5006afe0 2023-09-30T22:25:12.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.446+0000 7f1e55556700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1e5006afe0 0x7f1e50120b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.447+0000 7f1e55d57700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e5006a6d0 0x7f1e50120630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.447+0000 7f1e55d57700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e5006a6d0 0x7f1e50120630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56646/0 (socket says 172.21.15.40:56646) 2023-09-30T22:25:12.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.447+0000 7f1e55556700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1e5006afe0 0x7f1e50120b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:42828/0 (socket says 172.21.15.40:42828) 2023-09-30T22:25:12.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.447+0000 7f1e55d57700 1 -- 172.21.15.40:0/2721980051 learned_addr learned my addr 172.21.15.40:0/2721980051 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:12.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.447+0000 7f1e56558700 1 --2- 172.21.15.40:0/2721980051 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e50131fc0 0x7f1e501210b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.447+0000 7f1e55d57700 1 -- 172.21.15.40:0/2721980051 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1e5006afe0 msgr2=0x7f1e50120b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.447+0000 7f1e55d57700 1 --2- 172.21.15.40:0/2721980051 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1e5006afe0 0x7f1e50120b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.447+0000 7f1e55d57700 1 -- 172.21.15.40:0/2721980051 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e50131fc0 msgr2=0x7f1e501210b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.447+0000 7f1e55d57700 1 --2- 172.21.15.40:0/2721980051 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e50131fc0 0x7f1e501210b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.447+0000 7f1e55d57700 1 -- 172.21.15.40:0/2721980051 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e48009b30 con 0x7f1e5006a6d0 2023-09-30T22:25:12.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.447+0000 7f1e55556700 1 --2- 172.21.15.40:0/2721980051 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1e5006afe0 0x7f1e50120b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:12.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.447+0000 7f1e56558700 1 --2- 172.21.15.40:0/2721980051 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e50131fc0 0x7f1e501210b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:12.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.447+0000 7f1e55d57700 1 --2- 172.21.15.40:0/2721980051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e5006a6d0 0x7f1e50120630 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00e9c0 tx=0x7f1e4c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:12.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.447+0000 7f1e467fc700 1 -- 172.21.15.40:0/2721980051 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c0096f0 con 0x7f1e5006a6d0 2023-09-30T22:25:12.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.447+0000 7f1e467fc700 1 -- 172.21.15.40:0/2721980051 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4c00c850 con 0x7f1e5006a6d0 2023-09-30T22:25:12.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.447+0000 7f1e467fc700 1 -- 172.21.15.40:0/2721980051 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c00cbc0 con 0x7f1e5006a6d0 2023-09-30T22:25:12.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.447+0000 7f1e57fbb700 1 -- 172.21.15.40:0/2721980051 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e50131820 con 0x7f1e5006a6d0 2023-09-30T22:25:12.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.447+0000 7f1e57fbb700 1 -- 172.21.15.40:0/2721980051 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e50131150 con 0x7f1e5006a6d0 2023-09-30T22:25:12.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.448+0000 7f1e467fc700 1 -- 172.21.15.40:0/2721980051 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1e4c00cd20 con 0x7f1e5006a6d0 2023-09-30T22:25:12.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.448+0000 7f1e55556700 1 -- 172.21.15.40:0/2721980051 >> v1:172.21.15.40:6816/127432 conn(0x7f1e3402f510 legacy=0x7f1e340319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:12.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.448+0000 7f1e467fc700 1 -- 172.21.15.40:0/2721980051 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f1e4c03ff10 con 0x7f1e5006a6d0 2023-09-30T22:25:12.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.449+0000 7f1e57fbb700 1 -- 172.21.15.40:0/2721980051 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e501317c0 con 0x7f1e5006a6d0 2023-09-30T22:25:12.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.458+0000 7f1e467fc700 1 -- 172.21.15.40:0/2721980051 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e4c017020 con 0x7f1e5006a6d0 2023-09-30T22:25:12.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.539+0000 7fe503fff700 1 -- 172.21.15.40:0/92770101 >> v1:172.21.15.40:6816/127432 conn(0x7fe4f002f510 legacy=0x7fe4f00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:12.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.581+0000 7fe50b10a700 1 -- 172.21.15.40:0/92770101 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe504124ea0 con 0x7fe50409d920 2023-09-30T22:25:12.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.581+0000 7fe5017fa700 1 -- 172.21.15.40:0/92770101 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe504124ea0 con 0x7fe50409d920 2023-09-30T22:25:12.582 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:12.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.582+0000 7f36137fe700 1 -- 172.21.15.40:0/1532406040 >> v1:172.21.15.40:6816/127432 conn(0x7f360002f510 legacy=0x7f36000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:12.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.583+0000 7fe50b10a700 1 -- 172.21.15.40:0/92770101 >> v1:172.21.15.40:6816/127432 conn(0x7fe4f002f510 legacy=0x7fe4f00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:12.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.583+0000 7fe50b10a700 1 -- 172.21.15.40:0/92770101 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe50409d920 msgr2=0x7fe504121800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.583+0000 7fe50b10a700 1 --2- 172.21.15.40:0/92770101 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe50409d920 0x7fe504121800 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe4f400eed0 tx=0x7fe4f400b390 comp rx=0 tx=0).stop 2023-09-30T22:25:12.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.583+0000 7fe50b10a700 1 -- 172.21.15.40:0/92770101 shutdown_connections 2023-09-30T22:25:12.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.583+0000 7fe50b10a700 1 --2- 172.21.15.40:0/92770101 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe50409d920 0x7fe504121800 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.583+0000 7fe50b10a700 1 --2- 172.21.15.40:0/92770101 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe504122280 0x7fe5041c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.583+0000 7fe50b10a700 1 --2- 172.21.15.40:0/92770101 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe504133ca0 0x7fe504121d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.583+0000 7fe50b10a700 1 -- 172.21.15.40:0/92770101 >> 172.21.15.40:0/92770101 conn(0x7fe50409fb20 msgr2=0x7fe5040a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:12.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.583+0000 7fe50b10a700 1 -- 172.21.15.40:0/92770101 shutdown_connections 2023-09-30T22:25:12.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.583+0000 7fe50b10a700 1 -- 172.21.15.40:0/92770101 wait complete. 2023-09-30T22:25:12.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.587+0000 7f361a936700 1 -- 172.21.15.40:0/1532406040 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3614062380 con 0x7f361406a6d0 2023-09-30T22:25:12.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.588+0000 7f3610ff9700 1 -- 172.21.15.40:0/1532406040 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3604003e40 con 0x7f361406a6d0 2023-09-30T22:25:12.588 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:12.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.590+0000 7f361a936700 1 -- 172.21.15.40:0/1532406040 >> v1:172.21.15.40:6816/127432 conn(0x7f360002f510 legacy=0x7f36000319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:12.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.590+0000 7f361a936700 1 -- 172.21.15.40:0/1532406040 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f361406a6d0 msgr2=0x7f36141c4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.590+0000 7f361a936700 1 --2- 172.21.15.40:0/1532406040 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f361406a6d0 0x7f36141c4270 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f360400c4d0 tx=0x7f360400c7e0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.590+0000 7f361a936700 1 -- 172.21.15.40:0/1532406040 shutdown_connections 2023-09-30T22:25:12.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.590+0000 7f361a936700 1 --2- 172.21.15.40:0/1532406040 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f361406a6d0 0x7f36141c4270 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.590+0000 7f361a936700 1 --2- 172.21.15.40:0/1532406040 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36141370a0 0x7f36141c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.590+0000 7f361a936700 1 --2- 172.21.15.40:0/1532406040 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f361406b1b0 0x7f36141c47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.590+0000 7f361a936700 1 -- 172.21.15.40:0/1532406040 >> 172.21.15.40:0/1532406040 conn(0x7f361409fb20 msgr2=0x7f361406e180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:12.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.590+0000 7f361a936700 1 -- 172.21.15.40:0/1532406040 shutdown_connections 2023-09-30T22:25:12.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.590+0000 7f361a936700 1 -- 172.21.15.40:0/1532406040 wait complete. 2023-09-30T22:25:12.597 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:12.603 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:12.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.649+0000 7f1e55556700 1 -- 172.21.15.40:0/2721980051 >> v1:172.21.15.40:6816/127432 conn(0x7f1e3402f510 legacy=0x7f1e340319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:12.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.657+0000 7f1e57fbb700 1 -- 172.21.15.40:0/2721980051 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1e50062380 con 0x7f1e5006a6d0 2023-09-30T22:25:12.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.657+0000 7f1e467fc700 1 -- 172.21.15.40:0/2721980051 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e4c02b090 con 0x7f1e5006a6d0 2023-09-30T22:25:12.658 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:12.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.659+0000 7f1e57fbb700 1 -- 172.21.15.40:0/2721980051 >> v1:172.21.15.40:6816/127432 conn(0x7f1e3402f510 legacy=0x7f1e340319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:12.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.659+0000 7f1e57fbb700 1 -- 172.21.15.40:0/2721980051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e5006a6d0 msgr2=0x7f1e50120630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.659+0000 7f1e57fbb700 1 --2- 172.21.15.40:0/2721980051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e5006a6d0 0x7f1e50120630 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00e9c0 tx=0x7f1e4c00ecd0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.659+0000 7f1e57fbb700 1 -- 172.21.15.40:0/2721980051 shutdown_connections 2023-09-30T22:25:12.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.659+0000 7f1e57fbb700 1 --2- 172.21.15.40:0/2721980051 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e50131fc0 0x7f1e501210b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.659+0000 7f1e57fbb700 1 --2- 172.21.15.40:0/2721980051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e5006a6d0 0x7f1e50120630 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.659+0000 7f1e57fbb700 1 --2- 172.21.15.40:0/2721980051 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1e5006afe0 0x7f1e50120b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.659+0000 7f1e57fbb700 1 -- 172.21.15.40:0/2721980051 >> 172.21.15.40:0/2721980051 conn(0x7f1e5009fb20 msgr2=0x7f1e500a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:12.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.659+0000 7f1e57fbb700 1 -- 172.21.15.40:0/2721980051 shutdown_connections 2023-09-30T22:25:12.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:12.659+0000 7f1e57fbb700 1 -- 172.21.15.40:0/2721980051 wait complete. 2023-09-30T22:25:12.672 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:13.389 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:13.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.531+0000 7fd7ad9c5700 1 Processor -- start 2023-09-30T22:25:13.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.531+0000 7fd7ad9c5700 1 -- start start 2023-09-30T22:25:13.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.532+0000 7fd7ad9c5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7a809c890 0x7fd7a809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.532+0000 7fd7ad9c5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd7a809d920 0x7fd7a809dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.532+0000 7fd7ad9c5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7a80a2600 con 0x7fd7a809e2b0 2023-09-30T22:25:13.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.532+0000 7fd7ad9c5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a80a29d0 con 0x7fd7a809c890 2023-09-30T22:25:13.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.532+0000 7fd7ad9c5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a809fb40 con 0x7fd7a809d920 2023-09-30T22:25:13.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.532+0000 7fd79ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd7a809d920 0x7fd7a809dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.532+0000 7fd7a6ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7a809c890 0x7fd7a809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.532+0000 7fd7a77fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd7a809e2b0 0x7fd7a813ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:59740/0 (socket says 172.21.15.40:59740) 2023-09-30T22:25:13.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.532+0000 7fd7a77fe700 1 -- 172.21.15.40:0/3019447051 learned_addr learned my addr 172.21.15.40:0/3019447051 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:13.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.532+0000 7fd7a67fc700 1 -- 172.21.15.40:0/3019447051 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2645014168 0 0) 0x7fd7a80a2600 con 0x7fd7a809e2b0 2023-09-30T22:25:13.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.532+0000 7fd7a67fc700 1 -- 172.21.15.40:0/3019447051 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7940035b0 con 0x7fd7a809e2b0 2023-09-30T22:25:13.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.532+0000 7fd7a6ffd700 1 -- 172.21.15.40:0/3019447051 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd7a809d920 msgr2=0x7fd7a809dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:13.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.532+0000 7fd7a6ffd700 1 --2- 172.21.15.40:0/3019447051 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd7a809d920 0x7fd7a809dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.532+0000 7fd7a6ffd700 1 -- 172.21.15.40:0/3019447051 >> v1:172.21.15.40:6789/0 conn(0x7fd7a809e2b0 legacy=0x7fd7a813ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.532+0000 7fd7a6ffd700 1 -- 172.21.15.40:0/3019447051 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a809e720 con 0x7fd7a809c890 2023-09-30T22:25:13.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.532+0000 7fd79ffff700 1 --2- 172.21.15.40:0/3019447051 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd7a809d920 0x7fd7a809dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:13.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.532+0000 7fd7a6ffd700 1 --2- 172.21.15.40:0/3019447051 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7a809c890 0x7fd7a809cc60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd798009850 tx=0x7fd798009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9d62b1c6ffb6b43 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:13.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.532+0000 7fd7a67fc700 1 -- 172.21.15.40:0/3019447051 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd798005e30 con 0x7fd7a809c890 2023-09-30T22:25:13.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.533+0000 7fd7a67fc700 1 -- 172.21.15.40:0/3019447051 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd798006030 con 0x7fd7a809c890 2023-09-30T22:25:13.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.533+0000 7fd7a67fc700 1 -- 172.21.15.40:0/3019447051 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7980063e0 con 0x7fd7a809c890 2023-09-30T22:25:13.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.533+0000 7fd7ad9c5700 1 -- 172.21.15.40:0/3019447051 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7a809c890 msgr2=0x7fd7a809cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.533+0000 7fd7ad9c5700 1 --2- 172.21.15.40:0/3019447051 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7a809c890 0x7fd7a809cc60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd798009850 tx=0x7fd798009b60 comp rx=0 tx=0).stop 2023-09-30T22:25:13.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.533+0000 7fd7ad9c5700 1 -- 172.21.15.40:0/3019447051 shutdown_connections 2023-09-30T22:25:13.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.533+0000 7fd7ad9c5700 1 --2- 172.21.15.40:0/3019447051 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7a809c890 0x7fd7a809cc60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.533+0000 7fd7ad9c5700 1 --2- 172.21.15.40:0/3019447051 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd7a809d920 0x7fd7a809dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.533+0000 7fd7ad9c5700 1 -- 172.21.15.40:0/3019447051 >> 172.21.15.40:0/3019447051 conn(0x7fd7a80a7080 msgr2=0x7fd7a80a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:13.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.533+0000 7fd7ad9c5700 1 -- 172.21.15.40:0/3019447051 shutdown_connections 2023-09-30T22:25:13.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.533+0000 7fd7ad9c5700 1 -- 172.21.15.40:0/3019447051 wait complete. 2023-09-30T22:25:13.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.534+0000 7fd7ad9c5700 1 Processor -- start 2023-09-30T22:25:13.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.534+0000 7fd7ad9c5700 1 -- start start 2023-09-30T22:25:13.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.535+0000 7fd7ad9c5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd7a809c890 0x7fd7a81c4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.535+0000 7fd7ad9c5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7a809d920 0x7fd7a81c5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.535+0000 7fd7ad9c5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7a809e2b0 0x7fd7a812b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.535+0000 7fd7ad9c5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a812e580 con 0x7fd7a809e2b0 2023-09-30T22:25:13.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.535+0000 7fd7ad9c5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a809ecf0 con 0x7fd7a809d920 2023-09-30T22:25:13.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.535+0000 7fd7ad9c5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a812e780 con 0x7fd7a809c890 2023-09-30T22:25:13.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.535+0000 7fd79ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7a809d920 0x7fd7a81c5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.535+0000 7fd7a6ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd7a809c890 0x7fd7a81c4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.535+0000 7fd79ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7a809d920 0x7fd7a81c5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35088/0 (socket says 172.21.15.40:35088) 2023-09-30T22:25:13.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.535+0000 7fd79ffff700 1 -- 172.21.15.40:0/3194635529 learned_addr learned my addr 172.21.15.40:0/3194635529 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:13.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.535+0000 7fd7a77fe700 1 --2- 172.21.15.40:0/3194635529 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7a809e2b0 0x7fd7a812b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.535+0000 7fd79ffff700 1 -- 172.21.15.40:0/3194635529 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd7a809c890 msgr2=0x7fd7a81c4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.535+0000 7fd79ffff700 1 --2- 172.21.15.40:0/3194635529 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd7a809c890 0x7fd7a81c4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.535+0000 7fd79ffff700 1 -- 172.21.15.40:0/3194635529 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7a809e2b0 msgr2=0x7fd7a812b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.535+0000 7fd79ffff700 1 --2- 172.21.15.40:0/3194635529 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7a809e2b0 0x7fd7a812b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.535+0000 7fd79ffff700 1 -- 172.21.15.40:0/3194635529 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7900094a0 con 0x7fd7a809d920 2023-09-30T22:25:13.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.535+0000 7fd7a6ffd700 1 --2- 172.21.15.40:0/3194635529 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd7a809c890 0x7fd7a81c4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:13.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.535+0000 7fd79ffff700 1 --2- 172.21.15.40:0/3194635529 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7a809d920 0x7fd7a81c5520 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd79000ebb0 tx=0x7fd79000eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:13.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.535+0000 7fd7a4ff9700 1 -- 172.21.15.40:0/3194635529 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79000c850 con 0x7fd7a809d920 2023-09-30T22:25:13.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.535+0000 7fd7a4ff9700 1 -- 172.21.15.40:0/3194635529 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd79000c9b0 con 0x7fd7a809d920 2023-09-30T22:25:13.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.535+0000 7fd7ad9c5700 1 -- 172.21.15.40:0/3194635529 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd798009430 con 0x7fd7a809d920 2023-09-30T22:25:13.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.535+0000 7fd7a4ff9700 1 -- 172.21.15.40:0/3194635529 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79000cd40 con 0x7fd7a809d920 2023-09-30T22:25:13.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.535+0000 7fd7ad9c5700 1 -- 172.21.15.40:0/3194635529 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7a80a5af0 con 0x7fd7a809d920 2023-09-30T22:25:13.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.536+0000 7fd7a4ff9700 1 -- 172.21.15.40:0/3194635529 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd790013470 con 0x7fd7a809d920 2023-09-30T22:25:13.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.536+0000 7fd7a6ffd700 1 -- 172.21.15.40:0/3194635529 >> v1:172.21.15.40:6816/127432 conn(0x7fd78802f510 legacy=0x7fd7880319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:13.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.536+0000 7fd7a4ff9700 1 -- 172.21.15.40:0/3194635529 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7fd79003fd10 con 0x7fd7a809d920 2023-09-30T22:25:13.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.537+0000 7fd7ad9c5700 1 -- 172.21.15.40:0/3194635529 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7a8062380 con 0x7fd7a809d920 2023-09-30T22:25:13.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.541+0000 7fd7a4ff9700 1 -- 172.21.15.40:0/3194635529 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd790017080 con 0x7fd7a809d920 2023-09-30T22:25:13.598 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:13.604 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:13.673 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:13.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.735+0000 7f6308ba1700 1 Processor -- start 2023-09-30T22:25:13.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.735+0000 7f6308ba1700 1 -- start start 2023-09-30T22:25:13.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.735+0000 7f6308ba1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f630412d1d0 0x7f630412d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.736+0000 7f6308ba1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f630406ff20 0x7f63041386f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.736+0000 7f6308ba1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f630412cda0 con 0x7f630412dae0 2023-09-30T22:25:13.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.736+0000 7f6308ba1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f630409aa00 con 0x7f630412d1d0 2023-09-30T22:25:13.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.736+0000 7f6308ba1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f630409a740 con 0x7f630406ff20 2023-09-30T22:25:13.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.736+0000 7f6303fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f630406ff20 0x7f63041386f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.736+0000 7f63037fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f630412d1d0 0x7f630412d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.736+0000 7f6303fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f630406ff20 0x7f63041386f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:40976/0 (socket says 172.21.15.40:40976) 2023-09-30T22:25:13.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.736+0000 7f6303fff700 1 -- 172.21.15.40:0/3522464368 learned_addr learned my addr 172.21.15.40:0/3522464368 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:13.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.736+0000 7f6303fff700 1 -- 172.21.15.40:0/3522464368 >> v2:172.21.15.40:3300/0 conn(0x7f630412d1d0 msgr2=0x7f630412d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:13.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.736+0000 7f6303fff700 1 --2- 172.21.15.40:0/3522464368 >> v2:172.21.15.40:3300/0 conn(0x7f630412d1d0 0x7f630412d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.736+0000 7f6303fff700 1 -- 172.21.15.40:0/3522464368 >> v1:172.21.15.40:6789/0 conn(0x7f630412dae0 legacy=0x7f630406f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.736+0000 7f6303fff700 1 -- 172.21.15.40:0/3522464368 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6304071290 con 0x7f630406ff20 2023-09-30T22:25:13.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.736+0000 7f63037fe700 1 --2- 172.21.15.40:0/3522464368 >> v2:172.21.15.40:3300/0 conn(0x7f630412d1d0 0x7f630412d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:13.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.736+0000 7f6303fff700 1 --2- 172.21.15.40:0/3522464368 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f630406ff20 0x7f63041386f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f62fc009e50 tx=0x7f62fc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb2528203c495a1d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:13.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.737+0000 7f63027fc700 1 -- 172.21.15.40:0/3522464368 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc00e070 con 0x7f630406ff20 2023-09-30T22:25:13.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.737+0000 7fd7a6ffd700 1 -- 172.21.15.40:0/3194635529 >> v1:172.21.15.40:6816/127432 conn(0x7fd78802f510 legacy=0x7fd7880319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:13.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.737+0000 7f63027fc700 1 -- 172.21.15.40:0/3522464368 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62fc00b910 con 0x7f630406ff20 2023-09-30T22:25:13.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.737+0000 7f63027fc700 1 -- 172.21.15.40:0/3522464368 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc00bcc0 con 0x7f630406ff20 2023-09-30T22:25:13.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.737+0000 7f6308ba1700 1 -- 172.21.15.40:0/3522464368 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f630406ff20 msgr2=0x7f63041386f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.737+0000 7f6308ba1700 1 --2- 172.21.15.40:0/3522464368 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f630406ff20 0x7f63041386f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f62fc009e50 tx=0x7f62fc00b330 comp rx=0 tx=0).stop 2023-09-30T22:25:13.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.737+0000 7f6308ba1700 1 -- 172.21.15.40:0/3522464368 shutdown_connections 2023-09-30T22:25:13.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.737+0000 7f6308ba1700 1 --2- 172.21.15.40:0/3522464368 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f630406ff20 0x7f63041386f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.737+0000 7f6308ba1700 1 --2- 172.21.15.40:0/3522464368 >> v2:172.21.15.40:3300/0 conn(0x7f630412d1d0 0x7f630412d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.737+0000 7f6308ba1700 1 -- 172.21.15.40:0/3522464368 >> 172.21.15.40:0/3522464368 conn(0x7f63040a27f0 msgr2=0x7f63040a2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:13.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.737+0000 7f6308ba1700 1 -- 172.21.15.40:0/3522464368 shutdown_connections 2023-09-30T22:25:13.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.738+0000 7f6308ba1700 1 -- 172.21.15.40:0/3522464368 wait complete. 2023-09-30T22:25:13.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.738+0000 7f6308ba1700 1 Processor -- start 2023-09-30T22:25:13.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.739+0000 7f6308ba1700 1 -- start start 2023-09-30T22:25:13.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.739+0000 7f6308ba1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f630406ff20 0x7f630409e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.739+0000 7f6308ba1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f630412d1d0 0x7f630409eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.739+0000 7f6308ba1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f630412dae0 0x7f63041c6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.739+0000 7f6308ba1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6304128c10 con 0x7f630406ff20 2023-09-30T22:25:13.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.739+0000 7f6308ba1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f630409f030 con 0x7f630412d1d0 2023-09-30T22:25:13.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.739+0000 7f6308ba1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6304127590 con 0x7f630412dae0 2023-09-30T22:25:13.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.739+0000 7f63037fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f630406ff20 0x7f630409e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.739+0000 7f63037fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f630406ff20 0x7f630409e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60406/0 (socket says 172.21.15.40:60406) 2023-09-30T22:25:13.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.739+0000 7f63037fe700 1 -- 172.21.15.40:0/364067534 learned_addr learned my addr 172.21.15.40:0/364067534 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:13.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.739+0000 7f6303fff700 1 --2- 172.21.15.40:0/364067534 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f630412dae0 0x7f63041c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.739+0000 7f6302ffd700 1 --2- 172.21.15.40:0/364067534 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f630412d1d0 0x7f630409eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.740+0000 7f63037fe700 1 -- 172.21.15.40:0/364067534 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f630412dae0 msgr2=0x7f63041c6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.740+0000 7f63037fe700 1 --2- 172.21.15.40:0/364067534 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f630412dae0 0x7f63041c6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.740+0000 7f63037fe700 1 -- 172.21.15.40:0/364067534 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f630412d1d0 msgr2=0x7f630409eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.740+0000 7f63037fe700 1 --2- 172.21.15.40:0/364067534 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f630412d1d0 0x7f630409eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.740+0000 7f63037fe700 1 -- 172.21.15.40:0/364067534 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f40094a0 con 0x7f630406ff20 2023-09-30T22:25:13.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.740+0000 7f63037fe700 1 --2- 172.21.15.40:0/364067534 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f630406ff20 0x7f630409e5b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f62f400ebe0 tx=0x7f62f400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:13.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.740+0000 7f62ebfff700 1 -- 172.21.15.40:0/364067534 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f400c850 con 0x7f630406ff20 2023-09-30T22:25:13.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.740+0000 7f6308ba1700 1 -- 172.21.15.40:0/364067534 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62fc009b30 con 0x7f630406ff20 2023-09-30T22:25:13.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.740+0000 7f62ebfff700 1 -- 172.21.15.40:0/364067534 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f400c9b0 con 0x7f630406ff20 2023-09-30T22:25:13.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.740+0000 7f62ebfff700 1 -- 172.21.15.40:0/364067534 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f400cd40 con 0x7f630406ff20 2023-09-30T22:25:13.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.740+0000 7f6308ba1700 1 -- 172.21.15.40:0/364067534 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f630409e160 con 0x7f630406ff20 2023-09-30T22:25:13.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.741+0000 7f62ebfff700 1 -- 172.21.15.40:0/364067534 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f62f4013470 con 0x7f630406ff20 2023-09-30T22:25:13.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.741+0000 7f62ebfff700 1 -- 172.21.15.40:0/364067534 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f62f403fd50 con 0x7f630406ff20 2023-09-30T22:25:13.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.741+0000 7f6308ba1700 1 -- 172.21.15.40:0/364067534 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6304099b20 con 0x7f630406ff20 2023-09-30T22:25:13.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.742+0000 7f6302ffd700 1 -- 172.21.15.40:0/364067534 >> v1:172.21.15.40:6816/127432 conn(0x7f62f002f510 legacy=0x7f62f00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:13.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.746+0000 7f62ebfff700 1 -- 172.21.15.40:0/364067534 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6304099b20 con 0x7f630406ff20 2023-09-30T22:25:13.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.751+0000 7fd7ad9c5700 1 -- 172.21.15.40:0/3194635529 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd7a812d620 con 0x7fd7a809d920 2023-09-30T22:25:13.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.751+0000 7fd7a4ff9700 1 -- 172.21.15.40:0/3194635529 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd790021030 con 0x7fd7a809d920 2023-09-30T22:25:13.752 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:13.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.753+0000 7fd7ad9c5700 1 -- 172.21.15.40:0/3194635529 >> v1:172.21.15.40:6816/127432 conn(0x7fd78802f510 legacy=0x7fd7880319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:13.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.753+0000 7fd7ad9c5700 1 -- 172.21.15.40:0/3194635529 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7a809d920 msgr2=0x7fd7a81c5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.753+0000 7fd7ad9c5700 1 --2- 172.21.15.40:0/3194635529 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7a809d920 0x7fd7a81c5520 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd79000ebb0 tx=0x7fd79000eec0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.753+0000 7fd7ad9c5700 1 -- 172.21.15.40:0/3194635529 shutdown_connections 2023-09-30T22:25:13.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.753+0000 7fd7ad9c5700 1 --2- 172.21.15.40:0/3194635529 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd7a809c890 0x7fd7a81c4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.753+0000 7fd7ad9c5700 1 --2- 172.21.15.40:0/3194635529 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7a809e2b0 0x7fd7a812b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.753+0000 7fd7ad9c5700 1 --2- 172.21.15.40:0/3194635529 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7a809d920 0x7fd7a81c5520 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.753+0000 7fd7ad9c5700 1 -- 172.21.15.40:0/3194635529 >> 172.21.15.40:0/3194635529 conn(0x7fd7a80a7080 msgr2=0x7fd7a81bafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:13.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.753+0000 7fd7ad9c5700 1 -- 172.21.15.40:0/3194635529 shutdown_connections 2023-09-30T22:25:13.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.753+0000 7fd7ad9c5700 1 -- 172.21.15.40:0/3194635529 wait complete. 2023-09-30T22:25:13.768 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:13.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.795+0000 7f4e4ac92700 1 Processor -- start 2023-09-30T22:25:13.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.795+0000 7f4e4ac92700 1 -- start start 2023-09-30T22:25:13.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.795+0000 7f4e4ac92700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e4409e400 0x7f4e44135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.795+0000 7f4e4ac92700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4e44136230 0x7f4e44138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.795+0000 7f4e4ac92700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e4409adf0 con 0x7f4e4409d920 2023-09-30T22:25:13.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.795+0000 7f4e4ac92700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e4409e7f0 con 0x7f4e44136230 2023-09-30T22:25:13.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.795+0000 7f4e4ac92700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4409edf0 con 0x7f4e4409e400 2023-09-30T22:25:13.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.795+0000 7f4e43fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e4409e400 0x7f4e44135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.796+0000 7f4e43fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e4409e400 0x7f4e44135cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35108/0 (socket says 172.21.15.40:35108) 2023-09-30T22:25:13.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.796+0000 7f4e43fff700 1 -- 172.21.15.40:0/2072194020 learned_addr learned my addr 172.21.15.40:0/2072194020 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:13.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.796+0000 7f4e4922f700 1 --2- 172.21.15.40:0/2072194020 >> v2:172.21.15.40:3300/0 conn(0x7f4e44136230 0x7f4e44138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.796+0000 7f4e43fff700 1 -- 172.21.15.40:0/2072194020 >> v2:172.21.15.40:3300/0 conn(0x7f4e44136230 msgr2=0x7f4e44138610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:13.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.796+0000 7f4e43fff700 1 --2- 172.21.15.40:0/2072194020 >> v2:172.21.15.40:3300/0 conn(0x7f4e44136230 0x7f4e44138610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.796+0000 7f4e43fff700 1 -- 172.21.15.40:0/2072194020 >> v1:172.21.15.40:6789/0 conn(0x7f4e4409d920 legacy=0x7f4e4409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.796+0000 7f4e43fff700 1 -- 172.21.15.40:0/2072194020 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4409b660 con 0x7f4e4409e400 2023-09-30T22:25:13.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.796+0000 7f4e43fff700 1 --2- 172.21.15.40:0/2072194020 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e4409e400 0x7f4e44135cf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4e3000bb90 tx=0x7f4e3000bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f519064a27777cef server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:13.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.796+0000 7f4e437fe700 1 -- 172.21.15.40:0/2072194020 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3000dd30 con 0x7f4e4409e400 2023-09-30T22:25:13.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.796+0000 7f4e437fe700 1 -- 172.21.15.40:0/2072194020 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3000de90 con 0x7f4e4409e400 2023-09-30T22:25:13.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.796+0000 7f4e437fe700 1 -- 172.21.15.40:0/2072194020 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e30010690 con 0x7f4e4409e400 2023-09-30T22:25:13.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.797+0000 7f4e4ac92700 1 -- 172.21.15.40:0/2072194020 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e4409e400 msgr2=0x7f4e44135cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.797+0000 7f4e4ac92700 1 --2- 172.21.15.40:0/2072194020 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e4409e400 0x7f4e44135cf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4e3000bb90 tx=0x7f4e3000bea0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.797+0000 7f4e4ac92700 1 -- 172.21.15.40:0/2072194020 shutdown_connections 2023-09-30T22:25:13.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.797+0000 7f4e4ac92700 1 --2- 172.21.15.40:0/2072194020 >> v2:172.21.15.40:3300/0 conn(0x7f4e44136230 0x7f4e44138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.797+0000 7f4e4ac92700 1 --2- 172.21.15.40:0/2072194020 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e4409e400 0x7f4e44135cf0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.797+0000 7f4e4ac92700 1 -- 172.21.15.40:0/2072194020 >> 172.21.15.40:0/2072194020 conn(0x7f4e4409fb20 msgr2=0x7f4e4409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:13.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.797+0000 7f4e4ac92700 1 -- 172.21.15.40:0/2072194020 shutdown_connections 2023-09-30T22:25:13.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.797+0000 7f4e4ac92700 1 -- 172.21.15.40:0/2072194020 wait complete. 2023-09-30T22:25:13.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.798+0000 7f4e4ac92700 1 Processor -- start 2023-09-30T22:25:13.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.798+0000 7f4e4ac92700 1 -- start start 2023-09-30T22:25:13.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.799+0000 7f4e4ac92700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e4409d920 0x7f4e441234e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.799+0000 7f4e4ac92700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e4409e400 0x7f4e44123a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.799+0000 7f4e4ac92700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e44136230 0x7f4e441c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.799+0000 7f4e4ac92700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e44124f80 con 0x7f4e4409e400 2023-09-30T22:25:13.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.799+0000 7f4e4ac92700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e44123f60 con 0x7f4e44136230 2023-09-30T22:25:13.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.799+0000 7f4e4ac92700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e44124690 con 0x7f4e4409d920 2023-09-30T22:25:13.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.799+0000 7f4e4922f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e44136230 0x7f4e441c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.799+0000 7f4e48a2e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e4409d920 0x7f4e441234e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.799+0000 7f4e4922f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e44136230 0x7f4e441c8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35112/0 (socket says 172.21.15.40:35112) 2023-09-30T22:25:13.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.799+0000 7f4e4922f700 1 -- 172.21.15.40:0/1811367823 learned_addr learned my addr 172.21.15.40:0/1811367823 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:13.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.799+0000 7f4e43fff700 1 --2- 172.21.15.40:0/1811367823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e4409e400 0x7f4e44123a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.799+0000 7f4e48a2e700 1 -- 172.21.15.40:0/1811367823 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e44136230 msgr2=0x7f4e441c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.799+0000 7f4e48a2e700 1 --2- 172.21.15.40:0/1811367823 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e44136230 0x7f4e441c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.799+0000 7f4e48a2e700 1 -- 172.21.15.40:0/1811367823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e4409e400 msgr2=0x7f4e44123a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.799+0000 7f4e48a2e700 1 --2- 172.21.15.40:0/1811367823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e4409e400 0x7f4e44123a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.799+0000 7f4e48a2e700 1 -- 172.21.15.40:0/1811367823 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3000b7f0 con 0x7f4e4409d920 2023-09-30T22:25:13.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.799+0000 7f4e4922f700 1 --2- 172.21.15.40:0/1811367823 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e44136230 0x7f4e441c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:13.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.799+0000 7f4e43fff700 1 --2- 172.21.15.40:0/1811367823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e4409e400 0x7f4e44123a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:13.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.799+0000 7f4e48a2e700 1 --2- 172.21.15.40:0/1811367823 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e4409d920 0x7f4e441234e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4e3800c4d0 tx=0x7f4e3800c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:13.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.799+0000 7f4e417fa700 1 -- 172.21.15.40:0/1811367823 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e380054e0 con 0x7f4e4409d920 2023-09-30T22:25:13.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.800+0000 7f4e417fa700 1 -- 172.21.15.40:0/1811367823 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3800ce40 con 0x7f4e4409d920 2023-09-30T22:25:13.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.800+0000 7f4e417fa700 1 -- 172.21.15.40:0/1811367823 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e380038a0 con 0x7f4e4409d920 2023-09-30T22:25:13.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.800+0000 7f4e4ac92700 1 -- 172.21.15.40:0/1811367823 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e441353f0 con 0x7f4e4409d920 2023-09-30T22:25:13.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.800+0000 7f4e4ac92700 1 -- 172.21.15.40:0/1811367823 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e44126000 con 0x7f4e4409d920 2023-09-30T22:25:13.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.800+0000 7f4e417fa700 1 -- 172.21.15.40:0/1811367823 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4e38003a00 con 0x7f4e4409d920 2023-09-30T22:25:13.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.801+0000 7f4e43fff700 1 -- 172.21.15.40:0/1811367823 >> v1:172.21.15.40:6816/127432 conn(0x7f4e2802f510 legacy=0x7f4e280319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:13.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.801+0000 7f4e417fa700 1 -- 172.21.15.40:0/1811367823 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f4e3803efe0 con 0x7f4e4409d920 2023-09-30T22:25:13.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.801+0000 7f4e4ac92700 1 -- 172.21.15.40:0/1811367823 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e44062380 con 0x7f4e4409d920 2023-09-30T22:25:13.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.806+0000 7f4e417fa700 1 -- 172.21.15.40:0/1811367823 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4e38017070 con 0x7f4e4409d920 2023-09-30T22:25:13.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.848+0000 7f5bb7692700 1 Processor -- start 2023-09-30T22:25:13.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.849+0000 7f5bb7692700 1 -- start start 2023-09-30T22:25:13.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.849+0000 7f5bb7692700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5bb009c890 0x7f5bb009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.849+0000 7f5bb7692700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bb009e480 0x7f5bb013bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.849+0000 7f5bb7692700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb00a2600 con 0x7f5bb009d920 2023-09-30T22:25:13.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.849+0000 7f5bb7692700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bb00a29d0 con 0x7f5bb009c890 2023-09-30T22:25:13.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.849+0000 7f5bb7692700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb009fb40 con 0x7f5bb009e480 2023-09-30T22:25:13.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.849+0000 7f5bb542e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5bb009c890 0x7f5bb009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.849+0000 7f5bb5c2f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bb009e480 0x7f5bb013bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.849+0000 7f5bb5c2f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bb009e480 0x7f5bb013bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41012/0 (socket says 172.21.15.40:41012) 2023-09-30T22:25:13.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.849+0000 7f5bb542e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5bb009c890 0x7f5bb009cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60442/0 (socket says 172.21.15.40:60442) 2023-09-30T22:25:13.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.849+0000 7f5bb5c2f700 1 -- 172.21.15.40:0/935682944 learned_addr learned my addr 172.21.15.40:0/935682944 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:13.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.850+0000 7f5bb542e700 1 -- 172.21.15.40:0/935682944 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bb009e480 msgr2=0x7f5bb013bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:13.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.850+0000 7f5bb542e700 1 --2- 172.21.15.40:0/935682944 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bb009e480 0x7f5bb013bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.850+0000 7f5bb542e700 1 -- 172.21.15.40:0/935682944 >> v1:172.21.15.40:6789/0 conn(0x7f5bb009d920 legacy=0x7f5bb009dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.850+0000 7f5bb542e700 1 -- 172.21.15.40:0/935682944 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb009fed0 con 0x7f5bb009c890 2023-09-30T22:25:13.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.850+0000 7f5bb5c2f700 1 --2- 172.21.15.40:0/935682944 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bb009e480 0x7f5bb013bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:13.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.850+0000 7f5bb542e700 1 --2- 172.21.15.40:0/935682944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bb009c890 0x7f5bb009cc60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5bac009820 tx=0x7f5bac009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0e6e688caba87d8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:13.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.850+0000 7f5ba7fff700 1 -- 172.21.15.40:0/935682944 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac005e30 con 0x7f5bb009c890 2023-09-30T22:25:13.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.850+0000 7f5ba7fff700 1 -- 172.21.15.40:0/935682944 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bac004030 con 0x7f5bb009c890 2023-09-30T22:25:13.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.850+0000 7f5ba7fff700 1 -- 172.21.15.40:0/935682944 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac0043c0 con 0x7f5bb009c890 2023-09-30T22:25:13.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.851+0000 7f5bb7692700 1 -- 172.21.15.40:0/935682944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bb009c890 msgr2=0x7f5bb009cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.851+0000 7f5bb7692700 1 --2- 172.21.15.40:0/935682944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bb009c890 0x7f5bb009cc60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5bac009820 tx=0x7f5bac009b30 comp rx=0 tx=0).stop 2023-09-30T22:25:13.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.851+0000 7f5bb7692700 1 -- 172.21.15.40:0/935682944 shutdown_connections 2023-09-30T22:25:13.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.851+0000 7f5bb7692700 1 --2- 172.21.15.40:0/935682944 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bb009e480 0x7f5bb013bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.851+0000 7f5bb7692700 1 --2- 172.21.15.40:0/935682944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bb009c890 0x7f5bb009cc60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.851+0000 7f5bb7692700 1 -- 172.21.15.40:0/935682944 >> 172.21.15.40:0/935682944 conn(0x7f5bb00a7080 msgr2=0x7f5bb00a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:13.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.851+0000 7f5bb7692700 1 -- 172.21.15.40:0/935682944 shutdown_connections 2023-09-30T22:25:13.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.851+0000 7f5bb7692700 1 -- 172.21.15.40:0/935682944 wait complete. 2023-09-30T22:25:13.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.852+0000 7f5bb7692700 1 Processor -- start 2023-09-30T22:25:13.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.852+0000 7f5bb7692700 1 -- start start 2023-09-30T22:25:13.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.853+0000 7f5bb7692700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bb009c890 0x7f5bb012d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.853+0000 7f5bb7692700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bb009d920 0x7f5bb012dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.853+0000 7f5bb7692700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bb009e480 0x7f5bb012e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.853+0000 7f5bb7692700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb00a5cd0 con 0x7f5bb009e480 2023-09-30T22:25:13.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.853+0000 7f5bb7692700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb009ecf0 con 0x7f5bb009d920 2023-09-30T22:25:13.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.853+0000 7f5bb7692700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb012fa00 con 0x7f5bb009c890 2023-09-30T22:25:13.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.853+0000 7f5bb542e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bb009c890 0x7f5bb012d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.853+0000 7f5bb542e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bb009c890 0x7f5bb012d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41014/0 (socket says 172.21.15.40:41014) 2023-09-30T22:25:13.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.853+0000 7f5bb542e700 1 -- 172.21.15.40:0/2087272543 learned_addr learned my addr 172.21.15.40:0/2087272543 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:13.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.853+0000 7f5bb4c2d700 1 --2- 172.21.15.40:0/2087272543 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bb009d920 0x7f5bb012dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.853+0000 7f5bb5c2f700 1 --2- 172.21.15.40:0/2087272543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bb009e480 0x7f5bb012e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.854+0000 7f5bb542e700 1 -- 172.21.15.40:0/2087272543 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bb009d920 msgr2=0x7f5bb012dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.854+0000 7f5bb542e700 1 --2- 172.21.15.40:0/2087272543 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bb009d920 0x7f5bb012dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.854+0000 7f5bb542e700 1 -- 172.21.15.40:0/2087272543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bb009e480 msgr2=0x7f5bb012e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.854+0000 7f5bb542e700 1 --2- 172.21.15.40:0/2087272543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bb009e480 0x7f5bb012e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.854+0000 7f5bb542e700 1 -- 172.21.15.40:0/2087272543 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba8009b30 con 0x7f5bb009c890 2023-09-30T22:25:13.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.854+0000 7f5bb4c2d700 1 --2- 172.21.15.40:0/2087272543 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bb009d920 0x7f5bb012dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:13.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.854+0000 7f5bb5c2f700 1 --2- 172.21.15.40:0/2087272543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bb009e480 0x7f5bb012e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:13.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.854+0000 7f5bb542e700 1 --2- 172.21.15.40:0/2087272543 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bb009c890 0x7f5bb012d590 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5bac000c00 tx=0x7f5bac004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:13.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.854+0000 7f5ba5ffb700 1 -- 172.21.15.40:0/2087272543 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac003af0 con 0x7f5bb009c890 2023-09-30T22:25:13.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.854+0000 7f5ba5ffb700 1 -- 172.21.15.40:0/2087272543 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bac003c50 con 0x7f5bb009c890 2023-09-30T22:25:13.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.854+0000 7f5bb7692700 1 -- 172.21.15.40:0/2087272543 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bac009430 con 0x7f5bb009c890 2023-09-30T22:25:13.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.854+0000 7f5ba5ffb700 1 -- 172.21.15.40:0/2087272543 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac011420 con 0x7f5bb009c890 2023-09-30T22:25:13.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.854+0000 7f5bb7692700 1 -- 172.21.15.40:0/2087272543 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bb0130dd0 con 0x7f5bb009c890 2023-09-30T22:25:13.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.856+0000 7f5ba5ffb700 1 -- 172.21.15.40:0/2087272543 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5bac018070 con 0x7f5bb009c890 2023-09-30T22:25:13.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.856+0000 7f5bb4c2d700 1 -- 172.21.15.40:0/2087272543 >> v1:172.21.15.40:6816/127432 conn(0x7f5b9402f510 legacy=0x7f5b940319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:13.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.856+0000 7f5ba5ffb700 1 -- 172.21.15.40:0/2087272543 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f5bac040a90 con 0x7f5bb009c890 2023-09-30T22:25:13.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.856+0000 7f5bb7692700 1 -- 172.21.15.40:0/2087272543 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bb009dff0 con 0x7f5bb009c890 2023-09-30T22:25:13.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.861+0000 7f5ba5ffb700 1 -- 172.21.15.40:0/2087272543 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5bac021020 con 0x7f5bb009c890 2023-09-30T22:25:13.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.943+0000 7f6302ffd700 1 -- 172.21.15.40:0/364067534 >> v1:172.21.15.40:6816/127432 conn(0x7f62f002f510 legacy=0x7f62f00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:13.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.947+0000 7f6308ba1700 1 -- 172.21.15.40:0/364067534 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6304128d50 con 0x7f630406ff20 2023-09-30T22:25:13.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.948+0000 7f62ebfff700 1 -- 172.21.15.40:0/364067534 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6304128d50 con 0x7f630406ff20 2023-09-30T22:25:13.949 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:13.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.950+0000 7f6308ba1700 1 -- 172.21.15.40:0/364067534 >> v1:172.21.15.40:6816/127432 conn(0x7f62f002f510 legacy=0x7f62f00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:13.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.950+0000 7f6308ba1700 1 -- 172.21.15.40:0/364067534 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f630406ff20 msgr2=0x7f630409e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.950+0000 7f6308ba1700 1 --2- 172.21.15.40:0/364067534 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f630406ff20 0x7f630409e5b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f62f400ebe0 tx=0x7f62f400eef0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.950+0000 7f6308ba1700 1 -- 172.21.15.40:0/364067534 shutdown_connections 2023-09-30T22:25:13.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.950+0000 7f6308ba1700 1 --2- 172.21.15.40:0/364067534 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f630412dae0 0x7f63041c6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.950+0000 7f6308ba1700 1 --2- 172.21.15.40:0/364067534 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f630406ff20 0x7f630409e5b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.950+0000 7f6308ba1700 1 --2- 172.21.15.40:0/364067534 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f630412d1d0 0x7f630409eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.950+0000 7f6308ba1700 1 -- 172.21.15.40:0/364067534 >> 172.21.15.40:0/364067534 conn(0x7f63040a27f0 msgr2=0x7f6304125f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:13.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.950+0000 7f6308ba1700 1 -- 172.21.15.40:0/364067534 shutdown_connections 2023-09-30T22:25:13.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:13.950+0000 7f6308ba1700 1 -- 172.21.15.40:0/364067534 wait complete. 2023-09-30T22:25:13.963 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:14.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.002+0000 7f4e43fff700 1 -- 172.21.15.40:0/1811367823 >> v1:172.21.15.40:6816/127432 conn(0x7f4e2802f510 legacy=0x7f4e280319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:14.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.047+0000 7f4e4ac92700 1 -- 172.21.15.40:0/1811367823 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4e44126450 con 0x7f4e4409d920 2023-09-30T22:25:14.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.048+0000 7f4e417fa700 1 -- 172.21.15.40:0/1811367823 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4e38019b40 con 0x7f4e4409d920 2023-09-30T22:25:14.048 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:14.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.050+0000 7f4e4ac92700 1 -- 172.21.15.40:0/1811367823 >> v1:172.21.15.40:6816/127432 conn(0x7f4e2802f510 legacy=0x7f4e280319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:14.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.050+0000 7f4e4ac92700 1 -- 172.21.15.40:0/1811367823 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e4409d920 msgr2=0x7f4e441234e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:14.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.050+0000 7f4e4ac92700 1 --2- 172.21.15.40:0/1811367823 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e4409d920 0x7f4e441234e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4e3800c4d0 tx=0x7f4e3800c7e0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.050+0000 7f4e4ac92700 1 -- 172.21.15.40:0/1811367823 shutdown_connections 2023-09-30T22:25:14.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.050+0000 7f4e4ac92700 1 --2- 172.21.15.40:0/1811367823 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e4409d920 0x7f4e441234e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.050+0000 7f4e4ac92700 1 --2- 172.21.15.40:0/1811367823 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e44136230 0x7f4e441c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.050+0000 7f4e4ac92700 1 --2- 172.21.15.40:0/1811367823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e4409e400 0x7f4e44123a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.050+0000 7f4e4ac92700 1 -- 172.21.15.40:0/1811367823 >> 172.21.15.40:0/1811367823 conn(0x7f4e4409fb20 msgr2=0x7f4e440a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:14.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.050+0000 7f4e4ac92700 1 -- 172.21.15.40:0/1811367823 shutdown_connections 2023-09-30T22:25:14.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.050+0000 7f4e4ac92700 1 -- 172.21.15.40:0/1811367823 wait complete. 2023-09-30T22:25:14.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.057+0000 7f5bb4c2d700 1 -- 172.21.15.40:0/2087272543 >> v1:172.21.15.40:6816/127432 conn(0x7f5b9402f510 legacy=0x7f5b940319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:14.063 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:14.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.080+0000 7f5bb7692700 1 -- 172.21.15.40:0/2087272543 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5bb0062380 con 0x7f5bb009c890 2023-09-30T22:25:14.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.081+0000 7f5ba5ffb700 1 -- 172.21.15.40:0/2087272543 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5bac016070 con 0x7f5bb009c890 2023-09-30T22:25:14.081 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:14.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.083+0000 7f5bb7692700 1 -- 172.21.15.40:0/2087272543 >> v1:172.21.15.40:6816/127432 conn(0x7f5b9402f510 legacy=0x7f5b940319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:14.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.083+0000 7f5bb7692700 1 -- 172.21.15.40:0/2087272543 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bb009c890 msgr2=0x7f5bb012d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:14.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.083+0000 7f5bb7692700 1 --2- 172.21.15.40:0/2087272543 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bb009c890 0x7f5bb012d590 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5bac000c00 tx=0x7f5bac004750 comp rx=0 tx=0).stop 2023-09-30T22:25:14.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.083+0000 7f5bb7692700 1 -- 172.21.15.40:0/2087272543 shutdown_connections 2023-09-30T22:25:14.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.083+0000 7f5bb7692700 1 --2- 172.21.15.40:0/2087272543 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bb009c890 0x7f5bb012d590 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.083+0000 7f5bb7692700 1 --2- 172.21.15.40:0/2087272543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bb009e480 0x7f5bb012e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.083+0000 7f5bb7692700 1 --2- 172.21.15.40:0/2087272543 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bb009d920 0x7f5bb012dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.083+0000 7f5bb7692700 1 -- 172.21.15.40:0/2087272543 >> 172.21.15.40:0/2087272543 conn(0x7f5bb00a7080 msgr2=0x7f5bb00a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:14.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.083+0000 7f5bb7692700 1 -- 172.21.15.40:0/2087272543 shutdown_connections 2023-09-30T22:25:14.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.083+0000 7f5bb7692700 1 -- 172.21.15.40:0/2087272543 wait complete. 2023-09-30T22:25:14.095 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:14.769 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:14.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.910+0000 7f3feb003700 1 Processor -- start 2023-09-30T22:25:14.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.910+0000 7f3feb003700 1 -- start start 2023-09-30T22:25:14.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.910+0000 7f3feb003700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3fe409f0f0 0x7f3fe4138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:14.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.910+0000 7f3feb003700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3fe409e400 0x7f3fe413b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:14.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.910+0000 7f3feb003700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe409f940 con 0x7f3fe409d920 2023-09-30T22:25:14.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.910+0000 7f3feb003700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe406b4c0 con 0x7f3fe409e400 2023-09-30T22:25:14.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.910+0000 7f3feb003700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe409a8f0 con 0x7f3fe409f0f0 2023-09-30T22:25:14.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.910+0000 7f3fe95a0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3fe409e400 0x7f3fe413b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:14.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.910+0000 7f3fe3fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3fe409f0f0 0x7f3fe4138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:14.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.910+0000 7f3fe95a0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3fe409e400 0x7f3fe413b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60460/0 (socket says 172.21.15.40:60460) 2023-09-30T22:25:14.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.910+0000 7f3fe95a0700 1 -- 172.21.15.40:0/1962869283 learned_addr learned my addr 172.21.15.40:0/1962869283 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:14.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.910+0000 7f3fe8d9f700 1 --1- 172.21.15.40:0/1962869283 >> v1:172.21.15.40:6789/0 conn(0x7f3fe409d920 0x7f3fe409dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:59772/0 (socket says 172.21.15.40:59772) 2023-09-30T22:25:14.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.911+0000 7f3fe3fff700 1 -- 172.21.15.40:0/1962869283 >> v2:172.21.15.40:3300/0 conn(0x7f3fe409e400 msgr2=0x7f3fe413b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:14.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.911+0000 7f3fe3fff700 1 --2- 172.21.15.40:0/1962869283 >> v2:172.21.15.40:3300/0 conn(0x7f3fe409e400 0x7f3fe413b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.911+0000 7f3fe3fff700 1 -- 172.21.15.40:0/1962869283 >> v1:172.21.15.40:6789/0 conn(0x7f3fe409d920 legacy=0x7f3fe409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:14.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.911+0000 7f3fe3fff700 1 -- 172.21.15.40:0/1962869283 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe409f6e0 con 0x7f3fe409f0f0 2023-09-30T22:25:14.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.911+0000 7f3fe95a0700 1 --2- 172.21.15.40:0/1962869283 >> v2:172.21.15.40:3300/0 conn(0x7f3fe409e400 0x7f3fe413b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:14.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.911+0000 7f3fe3fff700 1 --2- 172.21.15.40:0/1962869283 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3fe409f0f0 0x7f3fe4138ee0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009840 tx=0x7f3fd0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e7f65ef01fd2505 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:14.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.911+0000 7f3fe37fe700 1 -- 172.21.15.40:0/1962869283 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0011830 con 0x7f3fe409f0f0 2023-09-30T22:25:14.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.911+0000 7f3fe37fe700 1 -- 172.21.15.40:0/1962869283 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd0011990 con 0x7f3fe409f0f0 2023-09-30T22:25:14.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.911+0000 7f3fe37fe700 1 -- 172.21.15.40:0/1962869283 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0011d20 con 0x7f3fe409f0f0 2023-09-30T22:25:14.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.911+0000 7f3feb003700 1 -- 172.21.15.40:0/1962869283 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3fe409f0f0 msgr2=0x7f3fe4138ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:14.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.911+0000 7f3feb003700 1 --2- 172.21.15.40:0/1962869283 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3fe409f0f0 0x7f3fe4138ee0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009840 tx=0x7f3fd0009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:14.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.912+0000 7f3feb003700 1 -- 172.21.15.40:0/1962869283 shutdown_connections 2023-09-30T22:25:14.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.912+0000 7f3feb003700 1 --2- 172.21.15.40:0/1962869283 >> v2:172.21.15.40:3300/0 conn(0x7f3fe409e400 0x7f3fe413b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.912+0000 7f3feb003700 1 --2- 172.21.15.40:0/1962869283 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3fe409f0f0 0x7f3fe4138ee0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.912+0000 7f3feb003700 1 -- 172.21.15.40:0/1962869283 >> 172.21.15.40:0/1962869283 conn(0x7f3fe409fb20 msgr2=0x7f3fe409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:14.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.912+0000 7f3feb003700 1 -- 172.21.15.40:0/1962869283 shutdown_connections 2023-09-30T22:25:14.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.912+0000 7f3feb003700 1 -- 172.21.15.40:0/1962869283 wait complete. 2023-09-30T22:25:14.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.912+0000 7f3feb003700 1 Processor -- start 2023-09-30T22:25:14.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.913+0000 7f3feb003700 1 -- start start 2023-09-30T22:25:14.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.913+0000 7f3feb003700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3fe409d920 0x7f3fe411e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:14.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.913+0000 7f3feb003700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fe409e400 0x7f3fe411ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:14.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.913+0000 7f3feb003700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3fe411f210 0x7f3fe41ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:14.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.913+0000 7f3feb003700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe411f660 con 0x7f3fe409e400 2023-09-30T22:25:14.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.913+0000 7f3feb003700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe40a32b0 con 0x7f3fe409d920 2023-09-30T22:25:14.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.913+0000 7f3feb003700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe409c9e0 con 0x7f3fe411f210 2023-09-30T22:25:14.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.913+0000 7f3fe8d9f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3fe409d920 0x7f3fe411e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:14.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.913+0000 7f3fe95a0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3fe411f210 0x7f3fe41ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:14.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.913+0000 7f3fe3fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fe409e400 0x7f3fe411ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:14.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.913+0000 7f3fe95a0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3fe411f210 0x7f3fe41ce8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41026/0 (socket says 172.21.15.40:41026) 2023-09-30T22:25:14.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.913+0000 7f3fe8d9f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3fe409d920 0x7f3fe411e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35140/0 (socket says 172.21.15.40:35140) 2023-09-30T22:25:14.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.913+0000 7f3fe95a0700 1 -- 172.21.15.40:0/842391941 learned_addr learned my addr 172.21.15.40:0/842391941 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:14.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.914+0000 7f3fe3fff700 1 -- 172.21.15.40:0/842391941 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3fe411f210 msgr2=0x7f3fe41ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:14.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.914+0000 7f3fe3fff700 1 --2- 172.21.15.40:0/842391941 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3fe411f210 0x7f3fe41ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.914+0000 7f3fe3fff700 1 -- 172.21.15.40:0/842391941 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3fe409d920 msgr2=0x7f3fe411e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:14.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.914+0000 7f3fe3fff700 1 --2- 172.21.15.40:0/842391941 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3fe409d920 0x7f3fe411e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.914+0000 7f3fe3fff700 1 -- 172.21.15.40:0/842391941 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fdc009b30 con 0x7f3fe409e400 2023-09-30T22:25:14.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.914+0000 7f3fe95a0700 1 --2- 172.21.15.40:0/842391941 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3fe411f210 0x7f3fe41ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:14.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.914+0000 7f3fe3fff700 1 --2- 172.21.15.40:0/842391941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fe409e400 0x7f3fe411ecd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009840 tx=0x7f3fd0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:14.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.914+0000 7f3fe17fa700 1 -- 172.21.15.40:0/842391941 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0004550 con 0x7f3fe409e400 2023-09-30T22:25:14.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.914+0000 7f3fe17fa700 1 -- 172.21.15.40:0/842391941 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd00036a0 con 0x7f3fe409e400 2023-09-30T22:25:14.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.914+0000 7f3feb003700 1 -- 172.21.15.40:0/842391941 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fd00094a0 con 0x7f3fe409e400 2023-09-30T22:25:14.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.914+0000 7f3fe17fa700 1 -- 172.21.15.40:0/842391941 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0003a30 con 0x7f3fe409e400 2023-09-30T22:25:14.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.914+0000 7f3feb003700 1 -- 172.21.15.40:0/842391941 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe4121fd0 con 0x7f3fe409e400 2023-09-30T22:25:14.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.915+0000 7f3fe17fa700 1 -- 172.21.15.40:0/842391941 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3fd0003b90 con 0x7f3fe409e400 2023-09-30T22:25:14.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.915+0000 7f3fe8d9f700 1 -- 172.21.15.40:0/842391941 >> v1:172.21.15.40:6816/127432 conn(0x7f3fc802f510 legacy=0x7f3fc80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:14.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.915+0000 7f3fe17fa700 1 -- 172.21.15.40:0/842391941 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f3fd0040e20 con 0x7f3fe409e400 2023-09-30T22:25:14.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.915+0000 7f3feb003700 1 -- 172.21.15.40:0/842391941 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe4121c20 con 0x7f3fe409e400 2023-09-30T22:25:14.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:14.920+0000 7f3fe17fa700 1 -- 172.21.15.40:0/842391941 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3fd0015020 con 0x7f3fe409e400 2023-09-30T22:25:14.964 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:15.064 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:15.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.093+0000 7fb0f89c7700 1 Processor -- start 2023-09-30T22:25:15.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.093+0000 7fb0f89c7700 1 -- start start 2023-09-30T22:25:15.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.094+0000 7fb0f89c7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb0f409d920 0x7fb0f409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.094+0000 7fb0f89c7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb0f409e230 0x7fb0f41343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.094+0000 7fb0f89c7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0f409f940 con 0x7fb0f409f0f0 2023-09-30T22:25:15.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.094+0000 7fb0f89c7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0f406b4c0 con 0x7fb0f409d920 2023-09-30T22:25:15.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.094+0000 7fb0f89c7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f409a8f0 con 0x7fb0f409e230 2023-09-30T22:25:15.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.094+0000 7fb0f2d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb0f409e230 0x7fb0f41343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:15.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.094+0000 7fb0f2d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb0f409e230 0x7fb0f41343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41030/0 (socket says 172.21.15.40:41030) 2023-09-30T22:25:15.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.094+0000 7fb0f2d9d700 1 -- 172.21.15.40:0/4138740238 learned_addr learned my addr 172.21.15.40:0/4138740238 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:15.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.094+0000 7fb0f259c700 1 --2- 172.21.15.40:0/4138740238 >> v2:172.21.15.40:3300/0 conn(0x7fb0f409d920 0x7fb0f409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:15.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.095+0000 7fb0f259c700 1 -- 172.21.15.40:0/4138740238 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb0f409e230 msgr2=0x7fb0f41343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:15.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.095+0000 7fb0f259c700 1 --2- 172.21.15.40:0/4138740238 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb0f409e230 0x7fb0f41343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.095+0000 7fb0f259c700 1 -- 172.21.15.40:0/4138740238 >> v1:172.21.15.40:6789/0 conn(0x7fb0f409f0f0 legacy=0x7fb0f4133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:15.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.095+0000 7fb0f259c700 1 -- 172.21.15.40:0/4138740238 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f409f6e0 con 0x7fb0f409d920 2023-09-30T22:25:15.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.095+0000 7fb0f2d9d700 1 --2- 172.21.15.40:0/4138740238 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb0f409e230 0x7fb0f41343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:15.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.095+0000 7fb0f259c700 1 --2- 172.21.15.40:0/4138740238 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0f409d920 0x7fb0f409dcf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4009820 tx=0x7fb0e4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf6cd29d853e8d38 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:15.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.095+0000 7fb0f159a700 1 -- 172.21.15.40:0/4138740238 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e4005e30 con 0x7fb0f409d920 2023-09-30T22:25:15.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.095+0000 7fb0f159a700 1 -- 172.21.15.40:0/4138740238 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e4006030 con 0x7fb0f409d920 2023-09-30T22:25:15.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.095+0000 7fb0f159a700 1 -- 172.21.15.40:0/4138740238 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e40063c0 con 0x7fb0f409d920 2023-09-30T22:25:15.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.096+0000 7fb0f89c7700 1 -- 172.21.15.40:0/4138740238 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0f409d920 msgr2=0x7fb0f409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:15.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.096+0000 7fb0f89c7700 1 --2- 172.21.15.40:0/4138740238 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0f409d920 0x7fb0f409dcf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4009820 tx=0x7fb0e4009b30 comp rx=0 tx=0).stop 2023-09-30T22:25:15.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.096+0000 7fb0f89c7700 1 -- 172.21.15.40:0/4138740238 shutdown_connections 2023-09-30T22:25:15.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.096+0000 7fb0f89c7700 1 --2- 172.21.15.40:0/4138740238 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb0f409e230 0x7fb0f41343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.096+0000 7fb0f89c7700 1 --2- 172.21.15.40:0/4138740238 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0f409d920 0x7fb0f409dcf0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.096+0000 7fb0f89c7700 1 -- 172.21.15.40:0/4138740238 >> 172.21.15.40:0/4138740238 conn(0x7fb0f409fb20 msgr2=0x7fb0f409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:15.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.096+0000 7fb0f89c7700 1 -- 172.21.15.40:0/4138740238 shutdown_connections 2023-09-30T22:25:15.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.096+0000 7fb0f89c7700 1 -- 172.21.15.40:0/4138740238 wait complete. 2023-09-30T22:25:15.099 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:15.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.097+0000 7fb0f89c7700 1 Processor -- start 2023-09-30T22:25:15.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.097+0000 7fb0f89c7700 1 -- start start 2023-09-30T22:25:15.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.097+0000 7fb0f89c7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb0f409d920 0x7fb0f41a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.097+0000 7fb0f89c7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb0f409e230 0x7fb0f41a66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.097+0000 7fb0f89c7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0f41b94b0 0x7fb0f41a6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.097+0000 7fb0f89c7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f41aa5a0 con 0x7fb0f41b94b0 2023-09-30T22:25:15.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.097+0000 7fb0f89c7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f41a9be0 con 0x7fb0f409d920 2023-09-30T22:25:15.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.097+0000 7fb0f89c7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f41a8f20 con 0x7fb0f409e230 2023-09-30T22:25:15.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.098+0000 7fb0f1d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb0f409e230 0x7fb0f41a66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:15.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.098+0000 7fb0f1d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb0f409e230 0x7fb0f41a66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41042/0 (socket says 172.21.15.40:41042) 2023-09-30T22:25:15.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.098+0000 7fb0f1d9b700 1 -- 172.21.15.40:0/4135738571 learned_addr learned my addr 172.21.15.40:0/4135738571 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:15.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.098+0000 7fb0f259c700 1 --2- 172.21.15.40:0/4135738571 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb0f409d920 0x7fb0f41a6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:15.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.098+0000 7fb0f2d9d700 1 --2- 172.21.15.40:0/4135738571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0f41b94b0 0x7fb0f41a6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:15.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.098+0000 7fb0f1d9b700 1 -- 172.21.15.40:0/4135738571 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb0f409d920 msgr2=0x7fb0f41a6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:15.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.098+0000 7fb0f1d9b700 1 --2- 172.21.15.40:0/4135738571 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb0f409d920 0x7fb0f41a6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.098+0000 7fb0f1d9b700 1 -- 172.21.15.40:0/4135738571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0f41b94b0 msgr2=0x7fb0f41a6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:15.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.098+0000 7fb0f1d9b700 1 --2- 172.21.15.40:0/4135738571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0f41b94b0 0x7fb0f41a6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.098+0000 7fb0f1d9b700 1 -- 172.21.15.40:0/4135738571 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ec009b30 con 0x7fb0f409e230 2023-09-30T22:25:15.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.098+0000 7fb0f2d9d700 1 --2- 172.21.15.40:0/4135738571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0f41b94b0 0x7fb0f41a6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:15.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.098+0000 7fb0f1d9b700 1 --2- 172.21.15.40:0/4135738571 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb0f409e230 0x7fb0f41a66a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb0e800c540 tx=0x7fb0e800c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:15.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.098+0000 7fb0e2ffd700 1 -- 172.21.15.40:0/4135738571 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e80052d0 con 0x7fb0f409e230 2023-09-30T22:25:15.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.098+0000 7fb0e2ffd700 1 -- 172.21.15.40:0/4135738571 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e8005430 con 0x7fb0f409e230 2023-09-30T22:25:15.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.098+0000 7fb0f89c7700 1 -- 172.21.15.40:0/4135738571 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0e4009430 con 0x7fb0f409e230 2023-09-30T22:25:15.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.099+0000 7fb0e2ffd700 1 -- 172.21.15.40:0/4135738571 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e80038c0 con 0x7fb0f409e230 2023-09-30T22:25:15.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.099+0000 7fb0f89c7700 1 -- 172.21.15.40:0/4135738571 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f409c9e0 con 0x7fb0f409e230 2023-09-30T22:25:15.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.100+0000 7fb0e2ffd700 1 -- 172.21.15.40:0/4135738571 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb0e8003a20 con 0x7fb0f409e230 2023-09-30T22:25:15.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.100+0000 7fb0f259c700 1 -- 172.21.15.40:0/4135738571 >> v1:172.21.15.40:6816/127432 conn(0x7fb0d402f510 legacy=0x7fb0d40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:15.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.100+0000 7fb0e2ffd700 1 -- 172.21.15.40:0/4135738571 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7fb0e803ef50 con 0x7fb0f409e230 2023-09-30T22:25:15.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.100+0000 7fb0f89c7700 1 -- 172.21.15.40:0/4135738571 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f41a7d30 con 0x7fb0f409e230 2023-09-30T22:25:15.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.105+0000 7fb0e2ffd700 1 -- 172.21.15.40:0/4135738571 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb0e8019d00 con 0x7fb0f409e230 2023-09-30T22:25:15.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.116+0000 7f3fe8d9f700 1 -- 172.21.15.40:0/842391941 >> v1:172.21.15.40:6816/127432 conn(0x7f3fc802f510 legacy=0x7f3fc80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:15.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.130+0000 7f3feb003700 1 -- 172.21.15.40:0/842391941 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3fe4062380 con 0x7f3fe409e400 2023-09-30T22:25:15.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.131+0000 7f3fe17fa700 1 -- 172.21.15.40:0/842391941 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3fd002e970 con 0x7f3fe409e400 2023-09-30T22:25:15.131 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:15.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.133+0000 7f3feb003700 1 -- 172.21.15.40:0/842391941 >> v1:172.21.15.40:6816/127432 conn(0x7f3fc802f510 legacy=0x7f3fc80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:15.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.133+0000 7f3feb003700 1 -- 172.21.15.40:0/842391941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fe409e400 msgr2=0x7f3fe411ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:15.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.133+0000 7f3feb003700 1 --2- 172.21.15.40:0/842391941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fe409e400 0x7f3fe411ecd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009840 tx=0x7f3fd0004750 comp rx=0 tx=0).stop 2023-09-30T22:25:15.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.133+0000 7f3feb003700 1 -- 172.21.15.40:0/842391941 shutdown_connections 2023-09-30T22:25:15.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.133+0000 7f3feb003700 1 --2- 172.21.15.40:0/842391941 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3fe411f210 0x7f3fe41ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.133+0000 7f3feb003700 1 --2- 172.21.15.40:0/842391941 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3fe409d920 0x7f3fe411e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.133+0000 7f3feb003700 1 --2- 172.21.15.40:0/842391941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fe409e400 0x7f3fe411ecd0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.133+0000 7f3feb003700 1 -- 172.21.15.40:0/842391941 >> 172.21.15.40:0/842391941 conn(0x7f3fe409fb20 msgr2=0x7f3fe40a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:15.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.133+0000 7f3feb003700 1 -- 172.21.15.40:0/842391941 shutdown_connections 2023-09-30T22:25:15.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.133+0000 7f3feb003700 1 -- 172.21.15.40:0/842391941 wait complete. 2023-09-30T22:25:15.146 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:15.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.200+0000 7fea68f2c700 1 Processor -- start 2023-09-30T22:25:15.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.200+0000 7fea68f2c700 1 -- start start 2023-09-30T22:25:15.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.201+0000 7fea68f2c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fea6409c890 0x7fea6409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.201+0000 7fea68f2c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea6409d920 0x7fea6409dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.201+0000 7fea68f2c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea640a2600 con 0x7fea6409e2b0 2023-09-30T22:25:15.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.201+0000 7fea68f2c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea640a29d0 con 0x7fea6409c890 2023-09-30T22:25:15.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.201+0000 7fea68f2c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea6409fb40 con 0x7fea6409d920 2023-09-30T22:25:15.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.201+0000 7fea61d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea6409d920 0x7fea6409dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:15.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.201+0000 7fea6259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fea6409c890 0x7fea6409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:15.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.201+0000 7fea61d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea6409d920 0x7fea6409dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41046/0 (socket says 172.21.15.40:41046) 2023-09-30T22:25:15.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.201+0000 7fea61d9b700 1 -- 172.21.15.40:0/2242253394 learned_addr learned my addr 172.21.15.40:0/2242253394 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:15.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.201+0000 7fea61d9b700 1 -- 172.21.15.40:0/2242253394 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fea6409c890 msgr2=0x7fea6409cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:15.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.201+0000 7fea61d9b700 1 --2- 172.21.15.40:0/2242253394 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fea6409c890 0x7fea6409cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.201+0000 7fea61d9b700 1 -- 172.21.15.40:0/2242253394 >> v1:172.21.15.40:6789/0 conn(0x7fea6409e2b0 legacy=0x7fea6413ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:15.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.201+0000 7fea61d9b700 1 -- 172.21.15.40:0/2242253394 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6409e720 con 0x7fea6409d920 2023-09-30T22:25:15.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.201+0000 7fea6159a700 1 -- 172.21.15.40:0/2242253394 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4245658893 0 0) 0x7fea640a2600 con 0x7fea6409e2b0 2023-09-30T22:25:15.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.201+0000 7fea6259c700 1 --2- 172.21.15.40:0/2242253394 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fea6409c890 0x7fea6409cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:15.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.201+0000 7fea61d9b700 1 --2- 172.21.15.40:0/2242253394 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea6409d920 0x7fea6409dd70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fea58009920 tx=0x7fea58009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed8bf23d476d026e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:15.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.202+0000 7fea6159a700 1 -- 172.21.15.40:0/2242253394 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea58011830 con 0x7fea6409d920 2023-09-30T22:25:15.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.202+0000 7fea6159a700 1 -- 172.21.15.40:0/2242253394 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea58011990 con 0x7fea6409d920 2023-09-30T22:25:15.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.202+0000 7fea6159a700 1 -- 172.21.15.40:0/2242253394 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea58011d20 con 0x7fea6409d920 2023-09-30T22:25:15.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.202+0000 7fea68f2c700 1 -- 172.21.15.40:0/2242253394 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea6409d920 msgr2=0x7fea6409dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:15.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.202+0000 7fea68f2c700 1 --2- 172.21.15.40:0/2242253394 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea6409d920 0x7fea6409dd70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fea58009920 tx=0x7fea58009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:15.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.202+0000 7fea68f2c700 1 -- 172.21.15.40:0/2242253394 shutdown_connections 2023-09-30T22:25:15.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.202+0000 7fea68f2c700 1 --2- 172.21.15.40:0/2242253394 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fea6409c890 0x7fea6409cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.202+0000 7fea68f2c700 1 --2- 172.21.15.40:0/2242253394 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea6409d920 0x7fea6409dd70 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.202+0000 7fea68f2c700 1 -- 172.21.15.40:0/2242253394 >> 172.21.15.40:0/2242253394 conn(0x7fea640a7080 msgr2=0x7fea640a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:15.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.202+0000 7fea68f2c700 1 -- 172.21.15.40:0/2242253394 shutdown_connections 2023-09-30T22:25:15.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.202+0000 7fea68f2c700 1 -- 172.21.15.40:0/2242253394 wait complete. 2023-09-30T22:25:15.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.203+0000 7fea68f2c700 1 Processor -- start 2023-09-30T22:25:15.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.203+0000 7fea68f2c700 1 -- start start 2023-09-30T22:25:15.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.204+0000 7fea68f2c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fea6409c890 0x7fea6412d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.204+0000 7fea68f2c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea6409d920 0x7fea6412d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.204+0000 7fea68f2c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea6409e2b0 0x7fea6412dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.204+0000 7fea68f2c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea64130b50 con 0x7fea6409d920 2023-09-30T22:25:15.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.204+0000 7fea68f2c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea64130350 con 0x7fea6409c890 2023-09-30T22:25:15.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.204+0000 7fea68f2c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea640a5b20 con 0x7fea6409e2b0 2023-09-30T22:25:15.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.204+0000 7fea61d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea6409d920 0x7fea6412d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:15.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.204+0000 7fea6259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fea6409c890 0x7fea6412d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:15.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.204+0000 7fea61d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea6409d920 0x7fea6412d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60500/0 (socket says 172.21.15.40:60500) 2023-09-30T22:25:15.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.204+0000 7fea61d9b700 1 -- 172.21.15.40:0/3517153606 learned_addr learned my addr 172.21.15.40:0/3517153606 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:15.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.204+0000 7fea6259c700 1 --2- 172.21.15.40:0/3517153606 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fea6409c890 0x7fea6412d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35174/0 (socket says 172.21.15.40:35174) 2023-09-30T22:25:15.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.204+0000 7fea62d9d700 1 --2- 172.21.15.40:0/3517153606 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea6409e2b0 0x7fea6412dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:15.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.204+0000 7fea6259c700 1 -- 172.21.15.40:0/3517153606 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea6409e2b0 msgr2=0x7fea6412dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:15.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.204+0000 7fea6259c700 1 --2- 172.21.15.40:0/3517153606 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea6409e2b0 0x7fea6412dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.204+0000 7fea6259c700 1 -- 172.21.15.40:0/3517153606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea6409d920 msgr2=0x7fea6412d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:15.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.204+0000 7fea6259c700 1 --2- 172.21.15.40:0/3517153606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea6409d920 0x7fea6412d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.204+0000 7fea6259c700 1 -- 172.21.15.40:0/3517153606 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea54009430 con 0x7fea6409c890 2023-09-30T22:25:15.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.204+0000 7fea62d9d700 1 --2- 172.21.15.40:0/3517153606 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea6409e2b0 0x7fea6412dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:15.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.205+0000 7fea6259c700 1 --2- 172.21.15.40:0/3517153606 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fea6409c890 0x7fea6412d160 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fea5400e980 tx=0x7fea5400ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:15.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.205+0000 7fea52ffd700 1 -- 172.21.15.40:0/3517153606 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea54005a20 con 0x7fea6409c890 2023-09-30T22:25:15.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.205+0000 7fea52ffd700 1 -- 172.21.15.40:0/3517153606 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea54005b80 con 0x7fea6409c890 2023-09-30T22:25:15.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.205+0000 7fea68f2c700 1 -- 172.21.15.40:0/3517153606 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea58009550 con 0x7fea6409c890 2023-09-30T22:25:15.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.205+0000 7fea52ffd700 1 -- 172.21.15.40:0/3517153606 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5400c690 con 0x7fea6409c890 2023-09-30T22:25:15.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.205+0000 7fea68f2c700 1 -- 172.21.15.40:0/3517153606 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea6409ecf0 con 0x7fea6409c890 2023-09-30T22:25:15.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.206+0000 7fea52ffd700 1 -- 172.21.15.40:0/3517153606 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fea5400c7f0 con 0x7fea6409c890 2023-09-30T22:25:15.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.206+0000 7fea52ffd700 1 -- 172.21.15.40:0/3517153606 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7fea5403fde0 con 0x7fea6409c890 2023-09-30T22:25:15.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.206+0000 7fea61d9b700 1 -- 172.21.15.40:0/3517153606 >> v1:172.21.15.40:6816/127432 conn(0x7fea4402f510 legacy=0x7fea440319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:15.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.206+0000 7fea68f2c700 1 -- 172.21.15.40:0/3517153606 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea641306d0 con 0x7fea6409c890 2023-09-30T22:25:15.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.211+0000 7fea52ffd700 1 -- 172.21.15.40:0/3517153606 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fea641306d0 con 0x7fea6409c890 2023-09-30T22:25:15.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.233+0000 7fafc21de700 1 Processor -- start 2023-09-30T22:25:15.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.233+0000 7fafc21de700 1 -- start start 2023-09-30T22:25:15.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.234+0000 7fafc21de700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fafbc06f070 0x7fafbc06f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.234+0000 7fafc21de700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafbc06f980 0x7fafbc097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.234+0000 7fafc21de700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafbc06fdb0 0x7fafbc0975d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.234+0000 7fafc21de700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafbc070830 con 0x7fafbc06f070 2023-09-30T22:25:15.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.234+0000 7fafc21de700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc070ad0 con 0x7fafbc06f980 2023-09-30T22:25:15.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.234+0000 7fafc21de700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc070de0 con 0x7fafbc06fdb0 2023-09-30T22:25:15.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.234+0000 7fafbbfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafbc06fdb0 0x7fafbc0975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:15.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.234+0000 7fafbbfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafbc06fdb0 0x7fafbc0975d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41060/0 (socket says 172.21.15.40:41060) 2023-09-30T22:25:15.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.234+0000 7fafbbfff700 1 -- 172.21.15.40:0/3046844141 learned_addr learned my addr 172.21.15.40:0/3046844141 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:15.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.234+0000 7fafbaffd700 1 --2- 172.21.15.40:0/3046844141 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafbc06f980 0x7fafbc097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:15.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.234+0000 7fafbb7fe700 1 --2- 172.21.15.40:0/3046844141 >> v2:172.21.15.40:3300/0 conn(0x7fafbc06f070 0x7fafbc06f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:15.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.234+0000 7fafbbfff700 1 -- 172.21.15.40:0/3046844141 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafbc06f980 msgr2=0x7fafbc097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:15.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.234+0000 7fafbbfff700 1 --2- 172.21.15.40:0/3046844141 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafbc06f980 0x7fafbc097090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.234+0000 7fafbbfff700 1 -- 172.21.15.40:0/3046844141 >> v2:172.21.15.40:3300/0 conn(0x7fafbc06f070 msgr2=0x7fafbc06f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:15.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.235+0000 7fafbbfff700 1 --2- 172.21.15.40:0/3046844141 >> v2:172.21.15.40:3300/0 conn(0x7fafbc06f070 0x7fafbc06f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.235+0000 7fafbbfff700 1 -- 172.21.15.40:0/3046844141 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafbc09fe20 con 0x7fafbc06fdb0 2023-09-30T22:25:15.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.235+0000 7fafbaffd700 1 --2- 172.21.15.40:0/3046844141 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafbc06f980 0x7fafbc097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:15.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.235+0000 7fafbbfff700 1 --2- 172.21.15.40:0/3046844141 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafbc06fdb0 0x7fafbc0975d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fafb40098f0 tx=0x7fafb4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=621c516d59dbfd63 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:15.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.235+0000 7fafba7fc700 1 -- 172.21.15.40:0/3046844141 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb4011830 con 0x7fafbc06fdb0 2023-09-30T22:25:15.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.235+0000 7fafba7fc700 1 -- 172.21.15.40:0/3046844141 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb4011990 con 0x7fafbc06fdb0 2023-09-30T22:25:15.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.235+0000 7fafba7fc700 1 -- 172.21.15.40:0/3046844141 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb4011d20 con 0x7fafbc06fdb0 2023-09-30T22:25:15.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.235+0000 7fafc21de700 1 -- 172.21.15.40:0/3046844141 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafbc06fdb0 msgr2=0x7fafbc0975d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:15.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.235+0000 7fafc21de700 1 --2- 172.21.15.40:0/3046844141 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafbc06fdb0 0x7fafbc0975d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fafb40098f0 tx=0x7fafb4009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:15.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.236+0000 7fafc21de700 1 -- 172.21.15.40:0/3046844141 shutdown_connections 2023-09-30T22:25:15.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.236+0000 7fafc21de700 1 --2- 172.21.15.40:0/3046844141 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafbc06fdb0 0x7fafbc0975d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.236+0000 7fafc21de700 1 --2- 172.21.15.40:0/3046844141 >> v2:172.21.15.40:3300/0 conn(0x7fafbc06f070 0x7fafbc06f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.236+0000 7fafc21de700 1 --2- 172.21.15.40:0/3046844141 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafbc06f980 0x7fafbc097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.236+0000 7fafc21de700 1 -- 172.21.15.40:0/3046844141 >> 172.21.15.40:0/3046844141 conn(0x7fafbc0a41a0 msgr2=0x7fafbc0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:15.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.236+0000 7fafc21de700 1 -- 172.21.15.40:0/3046844141 shutdown_connections 2023-09-30T22:25:15.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.236+0000 7fafc21de700 1 -- 172.21.15.40:0/3046844141 wait complete. 2023-09-30T22:25:15.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.237+0000 7fafc21de700 1 Processor -- start 2023-09-30T22:25:15.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.237+0000 7fafc21de700 1 -- start start 2023-09-30T22:25:15.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.237+0000 7fafc21de700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafbc06f070 0x7fafbc09b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.237+0000 7fafc21de700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafbc06f980 0x7fafbc09bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.237+0000 7fafc21de700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafbc06fdb0 0x7fafbc09c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:15.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.237+0000 7fafc21de700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc09e200 con 0x7fafbc06f980 2023-09-30T22:25:15.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.237+0000 7fafc21de700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc1308f0 con 0x7fafbc06fdb0 2023-09-30T22:25:15.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.237+0000 7fafc21de700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc09c970 con 0x7fafbc06f070 2023-09-30T22:25:15.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.237+0000 7fafbbfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafbc06fdb0 0x7fafbc09c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:15.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.237+0000 7fafbaffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafbc06f980 0x7fafbc09bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.237+0000 7fafbbfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafbc06fdb0 0x7fafbc09c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35204/0 (socket says 172.21.15.40:35204) 2023-09-30T22:25:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.237+0000 7fafbb7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafbc06f070 0x7fafbc09b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.237+0000 7fafbbfff700 1 -- 172.21.15.40:0/1227369113 learned_addr learned my addr 172.21.15.40:0/1227369113 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.238+0000 7fafbbfff700 1 -- 172.21.15.40:0/1227369113 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafbc06f070 msgr2=0x7fafbc09b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.238+0000 7fafbbfff700 1 --2- 172.21.15.40:0/1227369113 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafbc06f070 0x7fafbc09b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.238+0000 7fafbbfff700 1 -- 172.21.15.40:0/1227369113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafbc06f980 msgr2=0x7fafbc09bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.238+0000 7fafbbfff700 1 --2- 172.21.15.40:0/1227369113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafbc06f980 0x7fafbc09bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.238+0000 7fafbbfff700 1 -- 172.21.15.40:0/1227369113 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb00094a0 con 0x7fafbc06fdb0 2023-09-30T22:25:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.238+0000 7fafbaffd700 1 --2- 172.21.15.40:0/1227369113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafbc06f980 0x7fafbc09bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.238+0000 7fafbbfff700 1 --2- 172.21.15.40:0/1227369113 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafbc06fdb0 0x7fafbc09c020 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fafb4013000 tx=0x7fafb4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.238+0000 7fafa3fff700 1 -- 172.21.15.40:0/1227369113 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb4004450 con 0x7fafbc06fdb0 2023-09-30T22:25:15.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.238+0000 7fafa3fff700 1 -- 172.21.15.40:0/1227369113 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb40045b0 con 0x7fafbc06fdb0 2023-09-30T22:25:15.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.238+0000 7fafc21de700 1 -- 172.21.15.40:0/1227369113 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb4009550 con 0x7fafbc06fdb0 2023-09-30T22:25:15.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.238+0000 7fafa3fff700 1 -- 172.21.15.40:0/1227369113 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb40038e0 con 0x7fafbc06fdb0 2023-09-30T22:25:15.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.238+0000 7fafc21de700 1 -- 172.21.15.40:0/1227369113 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafbc12c2b0 con 0x7fafbc06fdb0 2023-09-30T22:25:15.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.239+0000 7fafa3fff700 1 -- 172.21.15.40:0/1227369113 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fafb4003a40 con 0x7fafbc06fdb0 2023-09-30T22:25:15.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.239+0000 7fafc21de700 1 -- 172.21.15.40:0/1227369113 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafbc0a3ae0 con 0x7fafbc06fdb0 2023-09-30T22:25:15.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.239+0000 7fafa3fff700 1 -- 172.21.15.40:0/1227369113 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7fafb4040b20 con 0x7fafbc06fdb0 2023-09-30T22:25:15.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.239+0000 7fafbb7fe700 1 -- 172.21.15.40:0/1227369113 >> v1:172.21.15.40:6816/127432 conn(0x7fafa802f510 legacy=0x7fafa80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:15.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.248+0000 7fafa3fff700 1 -- 172.21.15.40:0/1227369113 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fafb401a420 con 0x7fafbc06fdb0 2023-09-30T22:25:15.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.301+0000 7fb0f259c700 1 -- 172.21.15.40:0/4135738571 >> v1:172.21.15.40:6816/127432 conn(0x7fb0d402f510 legacy=0x7fb0d40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:15.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.315+0000 7fb0f89c7700 1 -- 172.21.15.40:0/4135738571 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb0f41a9780 con 0x7fb0f409e230 2023-09-30T22:25:15.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.315+0000 7fb0e2ffd700 1 -- 172.21.15.40:0/4135738571 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb0e8017030 con 0x7fb0f409e230 2023-09-30T22:25:15.316 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:15.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.318+0000 7fb0f89c7700 1 -- 172.21.15.40:0/4135738571 >> v1:172.21.15.40:6816/127432 conn(0x7fb0d402f510 legacy=0x7fb0d40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:15.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.318+0000 7fb0f89c7700 1 -- 172.21.15.40:0/4135738571 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb0f409e230 msgr2=0x7fb0f41a66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:15.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.318+0000 7fb0f89c7700 1 --2- 172.21.15.40:0/4135738571 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb0f409e230 0x7fb0f41a66a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb0e800c540 tx=0x7fb0e800c850 comp rx=0 tx=0).stop 2023-09-30T22:25:15.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.318+0000 7fb0f89c7700 1 -- 172.21.15.40:0/4135738571 shutdown_connections 2023-09-30T22:25:15.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.318+0000 7fb0f89c7700 1 --2- 172.21.15.40:0/4135738571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0f41b94b0 0x7fb0f41a6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.318+0000 7fb0f89c7700 1 --2- 172.21.15.40:0/4135738571 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb0f409d920 0x7fb0f41a6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.318+0000 7fb0f89c7700 1 --2- 172.21.15.40:0/4135738571 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb0f409e230 0x7fb0f41a66a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.318+0000 7fb0f89c7700 1 -- 172.21.15.40:0/4135738571 >> 172.21.15.40:0/4135738571 conn(0x7fb0f409fb20 msgr2=0x7fb0f41bb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:15.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.318+0000 7fb0f89c7700 1 -- 172.21.15.40:0/4135738571 shutdown_connections 2023-09-30T22:25:15.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.318+0000 7fb0f89c7700 1 -- 172.21.15.40:0/4135738571 wait complete. 2023-09-30T22:25:15.331 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:15.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.407+0000 7fea61d9b700 1 -- 172.21.15.40:0/3517153606 >> v1:172.21.15.40:6816/127432 conn(0x7fea4402f510 legacy=0x7fea440319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:15.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.409+0000 7fea68f2c700 1 -- 172.21.15.40:0/3517153606 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fea641306d0 con 0x7fea6409c890 2023-09-30T22:25:15.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.410+0000 7fea52ffd700 1 -- 172.21.15.40:0/3517153606 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fea641306d0 con 0x7fea6409c890 2023-09-30T22:25:15.411 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:15.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.412+0000 7fea68f2c700 1 -- 172.21.15.40:0/3517153606 >> v1:172.21.15.40:6816/127432 conn(0x7fea4402f510 legacy=0x7fea440319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:15.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.412+0000 7fea68f2c700 1 -- 172.21.15.40:0/3517153606 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fea6409c890 msgr2=0x7fea6412d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:15.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.412+0000 7fea68f2c700 1 --2- 172.21.15.40:0/3517153606 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fea6409c890 0x7fea6412d160 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fea5400e980 tx=0x7fea5400ec90 comp rx=0 tx=0).stop 2023-09-30T22:25:15.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.412+0000 7fea68f2c700 1 -- 172.21.15.40:0/3517153606 shutdown_connections 2023-09-30T22:25:15.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.412+0000 7fea68f2c700 1 --2- 172.21.15.40:0/3517153606 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea6409e2b0 0x7fea6412dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.412+0000 7fea68f2c700 1 --2- 172.21.15.40:0/3517153606 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fea6409c890 0x7fea6412d160 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.412+0000 7fea68f2c700 1 --2- 172.21.15.40:0/3517153606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea6409d920 0x7fea6412d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.412+0000 7fea68f2c700 1 -- 172.21.15.40:0/3517153606 >> 172.21.15.40:0/3517153606 conn(0x7fea640a7080 msgr2=0x7fea64133130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:15.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.412+0000 7fea68f2c700 1 -- 172.21.15.40:0/3517153606 shutdown_connections 2023-09-30T22:25:15.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.412+0000 7fea68f2c700 1 -- 172.21.15.40:0/3517153606 wait complete. 2023-09-30T22:25:15.425 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:15.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.440+0000 7fafbb7fe700 1 -- 172.21.15.40:0/1227369113 >> v1:172.21.15.40:6816/127432 conn(0x7fafa802f510 legacy=0x7fafa80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:15.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.444+0000 7fafc21de700 1 -- 172.21.15.40:0/1227369113 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fafbc062380 con 0x7fafbc06fdb0 2023-09-30T22:25:15.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.444+0000 7fafa3fff700 1 -- 172.21.15.40:0/1227369113 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fafb4028090 con 0x7fafbc06fdb0 2023-09-30T22:25:15.444 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:15.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.446+0000 7fafc21de700 1 -- 172.21.15.40:0/1227369113 >> v1:172.21.15.40:6816/127432 conn(0x7fafa802f510 legacy=0x7fafa80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:15.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.446+0000 7fafc21de700 1 -- 172.21.15.40:0/1227369113 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafbc06fdb0 msgr2=0x7fafbc09c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:15.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.446+0000 7fafc21de700 1 --2- 172.21.15.40:0/1227369113 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafbc06fdb0 0x7fafbc09c020 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fafb4013000 tx=0x7fafb4004750 comp rx=0 tx=0).stop 2023-09-30T22:25:15.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.446+0000 7fafc21de700 1 -- 172.21.15.40:0/1227369113 shutdown_connections 2023-09-30T22:25:15.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.446+0000 7fafc21de700 1 --2- 172.21.15.40:0/1227369113 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafbc06f070 0x7fafbc09b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.446+0000 7fafc21de700 1 --2- 172.21.15.40:0/1227369113 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafbc06fdb0 0x7fafbc09c020 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.446+0000 7fafc21de700 1 --2- 172.21.15.40:0/1227369113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafbc06f980 0x7fafbc09bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.446+0000 7fafc21de700 1 -- 172.21.15.40:0/1227369113 >> 172.21.15.40:0/1227369113 conn(0x7fafbc0a41a0 msgr2=0x7fafbc098080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:15.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.446+0000 7fafc21de700 1 -- 172.21.15.40:0/1227369113 shutdown_connections 2023-09-30T22:25:15.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:15.446+0000 7fafc21de700 1 -- 172.21.15.40:0/1227369113 wait complete. 2023-09-30T22:25:15.459 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:16.147 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:16.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.287+0000 7f9da31b6700 1 Processor -- start 2023-09-30T22:25:16.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.287+0000 7f9da31b6700 1 -- start start 2023-09-30T22:25:16.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.288+0000 7f9da31b6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d9c09c890 0x7f9d9c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.288+0000 7f9da31b6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9d9c09e480 0x7f9d9c13bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.288+0000 7f9da31b6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d9c0a2600 con 0x7f9d9c09d920 2023-09-30T22:25:16.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.288+0000 7f9da31b6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d9c0a29d0 con 0x7f9d9c09e480 2023-09-30T22:25:16.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.288+0000 7f9da31b6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9c09fb40 con 0x7f9d9c09c890 2023-09-30T22:25:16.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.288+0000 7f9da1753700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9d9c09e480 0x7f9d9c13bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.288+0000 7f9da0f52700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d9c09c890 0x7f9d9c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.288+0000 7f9da0f52700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d9c09c890 0x7f9d9c09cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41068/0 (socket says 172.21.15.40:41068) 2023-09-30T22:25:16.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.288+0000 7f9da1753700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9d9c09e480 0x7f9d9c13bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60536/0 (socket says 172.21.15.40:60536) 2023-09-30T22:25:16.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.288+0000 7f9da0f52700 1 -- 172.21.15.40:0/539914866 learned_addr learned my addr 172.21.15.40:0/539914866 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:16.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.288+0000 7f9da0f52700 1 -- 172.21.15.40:0/539914866 >> v2:172.21.15.40:3300/0 conn(0x7f9d9c09e480 msgr2=0x7f9d9c13bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:16.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.288+0000 7f9da0f52700 1 --2- 172.21.15.40:0/539914866 >> v2:172.21.15.40:3300/0 conn(0x7f9d9c09e480 0x7f9d9c13bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.288+0000 7f9da0f52700 1 -- 172.21.15.40:0/539914866 >> v1:172.21.15.40:6789/0 conn(0x7f9d9c09d920 legacy=0x7f9d9c09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.288+0000 7f9da0f52700 1 -- 172.21.15.40:0/539914866 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d9c09fed0 con 0x7f9d9c09c890 2023-09-30T22:25:16.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.288+0000 7f9da1753700 1 --2- 172.21.15.40:0/539914866 >> v2:172.21.15.40:3300/0 conn(0x7f9d9c09e480 0x7f9d9c13bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:16.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.289+0000 7f9da0f52700 1 --2- 172.21.15.40:0/539914866 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d9c09c890 0x7f9d9c09cc60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9d90006fd0 tx=0x7f9d90009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17f74dcb7a4bf98f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:16.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.289+0000 7f9d9b7fe700 1 -- 172.21.15.40:0/539914866 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d90005e30 con 0x7f9d9c09c890 2023-09-30T22:25:16.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.289+0000 7f9d9b7fe700 1 -- 172.21.15.40:0/539914866 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d90004030 con 0x7f9d9c09c890 2023-09-30T22:25:16.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.289+0000 7f9d9b7fe700 1 -- 172.21.15.40:0/539914866 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d900043e0 con 0x7f9d9c09c890 2023-09-30T22:25:16.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.289+0000 7f9da31b6700 1 -- 172.21.15.40:0/539914866 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d9c09c890 msgr2=0x7f9d9c09cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.289+0000 7f9da31b6700 1 --2- 172.21.15.40:0/539914866 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d9c09c890 0x7f9d9c09cc60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9d90006fd0 tx=0x7f9d90009bd0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.289+0000 7f9da31b6700 1 -- 172.21.15.40:0/539914866 shutdown_connections 2023-09-30T22:25:16.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.289+0000 7f9da31b6700 1 --2- 172.21.15.40:0/539914866 >> v2:172.21.15.40:3300/0 conn(0x7f9d9c09e480 0x7f9d9c13bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.289+0000 7f9da31b6700 1 --2- 172.21.15.40:0/539914866 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d9c09c890 0x7f9d9c09cc60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.289+0000 7f9da31b6700 1 -- 172.21.15.40:0/539914866 >> 172.21.15.40:0/539914866 conn(0x7f9d9c0a7080 msgr2=0x7f9d9c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:16.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.289+0000 7f9da31b6700 1 -- 172.21.15.40:0/539914866 shutdown_connections 2023-09-30T22:25:16.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.289+0000 7f9da31b6700 1 -- 172.21.15.40:0/539914866 wait complete. 2023-09-30T22:25:16.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.290+0000 7f9da31b6700 1 Processor -- start 2023-09-30T22:25:16.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.290+0000 7f9da31b6700 1 -- start start 2023-09-30T22:25:16.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.291+0000 7f9da31b6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d9c09c890 0x7f9d9c12d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.291+0000 7f9da31b6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d9c09d920 0x7f9d9c12da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.291+0000 7f9da31b6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d9c09e480 0x7f9d9c12dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.291+0000 7f9da31b6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9c08f4f0 con 0x7f9d9c09e480 2023-09-30T22:25:16.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.291+0000 7f9da31b6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9c130af0 con 0x7f9d9c09c890 2023-09-30T22:25:16.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.291+0000 7f9da31b6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9c0a5da0 con 0x7f9d9c09d920 2023-09-30T22:25:16.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.291+0000 7f9da0f52700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d9c09c890 0x7f9d9c12d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.291+0000 7f9da1753700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d9c09e480 0x7f9d9c12dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.291+0000 7f9d9bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d9c09d920 0x7f9d9c12da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.291+0000 7f9da0f52700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d9c09c890 0x7f9d9c12d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35212/0 (socket says 172.21.15.40:35212) 2023-09-30T22:25:16.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.291+0000 7f9da0f52700 1 -- 172.21.15.40:0/3869070599 learned_addr learned my addr 172.21.15.40:0/3869070599 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:16.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.291+0000 7f9da1753700 1 -- 172.21.15.40:0/3869070599 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d9c09d920 msgr2=0x7f9d9c12da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.291+0000 7f9da1753700 1 --2- 172.21.15.40:0/3869070599 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d9c09d920 0x7f9d9c12da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.291+0000 7f9da1753700 1 -- 172.21.15.40:0/3869070599 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d9c09c890 msgr2=0x7f9d9c12d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.291+0000 7f9da1753700 1 --2- 172.21.15.40:0/3869070599 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d9c09c890 0x7f9d9c12d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.291+0000 7f9da1753700 1 -- 172.21.15.40:0/3869070599 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d94009a70 con 0x7f9d9c09e480 2023-09-30T22:25:16.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.291+0000 7f9da0f52700 1 --2- 172.21.15.40:0/3869070599 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d9c09c890 0x7f9d9c12d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:16.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.291+0000 7f9d9bfff700 1 --2- 172.21.15.40:0/3869070599 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d9c09d920 0x7f9d9c12da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:16.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.292+0000 7f9da1753700 1 --2- 172.21.15.40:0/3869070599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d9c09e480 0x7f9d9c12dfa0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9d9400efc0 tx=0x7f9d9400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:16.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.292+0000 7f9d997fa700 1 -- 172.21.15.40:0/3869070599 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9400ca90 con 0x7f9d9c09e480 2023-09-30T22:25:16.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.292+0000 7f9d997fa700 1 -- 172.21.15.40:0/3869070599 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9400f040 con 0x7f9d9c09e480 2023-09-30T22:25:16.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.292+0000 7f9da31b6700 1 -- 172.21.15.40:0/3869070599 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d90009500 con 0x7f9d9c09e480 2023-09-30T22:25:16.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.292+0000 7f9d997fa700 1 -- 172.21.15.40:0/3869070599 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9400ce30 con 0x7f9d9c09e480 2023-09-30T22:25:16.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.292+0000 7f9da31b6700 1 -- 172.21.15.40:0/3869070599 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d9c130dd0 con 0x7f9d9c09e480 2023-09-30T22:25:16.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.293+0000 7f9d997fa700 1 -- 172.21.15.40:0/3869070599 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9d94014480 con 0x7f9d9c09e480 2023-09-30T22:25:16.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.293+0000 7f9da31b6700 1 -- 172.21.15.40:0/3869070599 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d9c130890 con 0x7f9d9c09e480 2023-09-30T22:25:16.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.293+0000 7f9d997fa700 1 -- 172.21.15.40:0/3869070599 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f9d940401f0 con 0x7f9d9c09e480 2023-09-30T22:25:16.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.293+0000 7f9da0f52700 1 -- 172.21.15.40:0/3869070599 >> v1:172.21.15.40:6816/127432 conn(0x7f9d8002f510 legacy=0x7f9d800319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:16.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.297+0000 7f9d997fa700 1 -- 172.21.15.40:0/3869070599 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d9c130890 con 0x7f9d9c09e480 2023-09-30T22:25:16.331 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:16.426 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:16.459 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:16.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.460+0000 7f8a4ee39700 1 Processor -- start 2023-09-30T22:25:16.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.460+0000 7f8a4ee39700 1 -- start start 2023-09-30T22:25:16.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.461+0000 7f8a4ee39700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a4809d920 0x7f8a4809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.461+0000 7f8a4ee39700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8a4809e230 0x7f8a481308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.461+0000 7f8a4ee39700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a4809adf0 con 0x7f8a48130de0 2023-09-30T22:25:16.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.461+0000 7f8a4ee39700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a4809edf0 con 0x7f8a4809e230 2023-09-30T22:25:16.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.461+0000 7f8a4ee39700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4809b660 con 0x7f8a4809d920 2023-09-30T22:25:16.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.461+0000 7f8a4cbd5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a4809d920 0x7f8a4809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.461+0000 7f8a4d3d6700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8a48130de0 0x7f8a48137d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:59808/0 (socket says 172.21.15.40:59808) 2023-09-30T22:25:16.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.461+0000 7f8a4d3d6700 1 -- 172.21.15.40:0/1219417491 learned_addr learned my addr 172.21.15.40:0/1219417491 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:16.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.461+0000 7f8a47fff700 1 --2- 172.21.15.40:0/1219417491 >> v2:172.21.15.40:3300/0 conn(0x7f8a4809e230 0x7f8a481308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.462+0000 7f8a4cbd5700 1 -- 172.21.15.40:0/1219417491 >> v2:172.21.15.40:3300/0 conn(0x7f8a4809e230 msgr2=0x7f8a481308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:16.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.462+0000 7f8a4cbd5700 1 --2- 172.21.15.40:0/1219417491 >> v2:172.21.15.40:3300/0 conn(0x7f8a4809e230 0x7f8a481308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.462+0000 7f8a4cbd5700 1 -- 172.21.15.40:0/1219417491 >> v1:172.21.15.40:6789/0 conn(0x7f8a48130de0 legacy=0x7f8a48137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.462+0000 7f8a477fe700 1 -- 172.21.15.40:0/1219417491 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 159674345 0 0) 0x7f8a4809adf0 con 0x7f8a48130de0 2023-09-30T22:25:16.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.462+0000 7f8a4cbd5700 1 -- 172.21.15.40:0/1219417491 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4809a6e0 con 0x7f8a4809d920 2023-09-30T22:25:16.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.462+0000 7f8a4cbd5700 1 --2- 172.21.15.40:0/1219417491 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a4809d920 0x7f8a4809dcf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c009820 tx=0x7f8a3c009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ab6521d64bb2edb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:16.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.462+0000 7f8a477fe700 1 -- 172.21.15.40:0/1219417491 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c005e30 con 0x7f8a4809d920 2023-09-30T22:25:16.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.462+0000 7f8a477fe700 1 -- 172.21.15.40:0/1219417491 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3c006030 con 0x7f8a4809d920 2023-09-30T22:25:16.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.462+0000 7f8a477fe700 1 -- 172.21.15.40:0/1219417491 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c0063c0 con 0x7f8a4809d920 2023-09-30T22:25:16.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.463+0000 7f8a4ee39700 1 -- 172.21.15.40:0/1219417491 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a4809d920 msgr2=0x7f8a4809dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.463+0000 7f8a4ee39700 1 --2- 172.21.15.40:0/1219417491 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a4809d920 0x7f8a4809dcf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c009820 tx=0x7f8a3c009b30 comp rx=0 tx=0).stop 2023-09-30T22:25:16.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.463+0000 7f8a4ee39700 1 -- 172.21.15.40:0/1219417491 shutdown_connections 2023-09-30T22:25:16.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.463+0000 7f8a4ee39700 1 --2- 172.21.15.40:0/1219417491 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a4809d920 0x7f8a4809dcf0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.463+0000 7f8a4ee39700 1 --2- 172.21.15.40:0/1219417491 >> v2:172.21.15.40:3300/0 conn(0x7f8a4809e230 0x7f8a481308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.463+0000 7f8a4ee39700 1 -- 172.21.15.40:0/1219417491 >> 172.21.15.40:0/1219417491 conn(0x7f8a4809fb20 msgr2=0x7f8a4809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:16.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.463+0000 7f8a4ee39700 1 -- 172.21.15.40:0/1219417491 shutdown_connections 2023-09-30T22:25:16.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.463+0000 7f8a4ee39700 1 -- 172.21.15.40:0/1219417491 wait complete. 2023-09-30T22:25:16.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.464+0000 7f8a4ee39700 1 Processor -- start 2023-09-30T22:25:16.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.464+0000 7f8a4ee39700 1 -- start start 2023-09-30T22:25:16.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.465+0000 7f8a4ee39700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a4809d920 0x7f8a4812ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.465+0000 7f8a4ee39700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a4809e230 0x7f8a4812f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.465+0000 7f8a4ee39700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a48130de0 0x7f8a4812f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.465+0000 7f8a4ee39700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a48131c40 con 0x7f8a4809e230 2023-09-30T22:25:16.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.465+0000 7f8a4ee39700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a48130110 con 0x7f8a48130de0 2023-09-30T22:25:16.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.465+0000 7f8a4ee39700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a48139fd0 con 0x7f8a4809d920 2023-09-30T22:25:16.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.465+0000 7f8a47fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a4809e230 0x7f8a4812f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.465+0000 7f8a47fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a4809e230 0x7f8a4812f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60570/0 (socket says 172.21.15.40:60570) 2023-09-30T22:25:16.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.465+0000 7f8a47fff700 1 -- 172.21.15.40:0/3004946862 learned_addr learned my addr 172.21.15.40:0/3004946862 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:16.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.465+0000 7f8a4d3d6700 1 --2- 172.21.15.40:0/3004946862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a48130de0 0x7f8a4812f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.465+0000 7f8a4cbd5700 1 --2- 172.21.15.40:0/3004946862 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a4809d920 0x7f8a4812ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.466+0000 7f8a47fff700 1 -- 172.21.15.40:0/3004946862 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a4809d920 msgr2=0x7f8a4812ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.466+0000 7f8a47fff700 1 --2- 172.21.15.40:0/3004946862 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a4809d920 0x7f8a4812ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.466+0000 7f8a47fff700 1 -- 172.21.15.40:0/3004946862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a48130de0 msgr2=0x7f8a4812f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.466+0000 7f8a47fff700 1 --2- 172.21.15.40:0/3004946862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a48130de0 0x7f8a4812f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.466+0000 7f8a47fff700 1 -- 172.21.15.40:0/3004946862 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3c009430 con 0x7f8a4809e230 2023-09-30T22:25:16.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.466+0000 7f8a4d3d6700 1 --2- 172.21.15.40:0/3004946862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a48130de0 0x7f8a4812f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:16.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.466+0000 7f8a47fff700 1 --2- 172.21.15.40:0/3004946862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a4809e230 0x7f8a4812f1d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8a3400e9b0 tx=0x7f8a3400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:16.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.466+0000 7f8a457fa700 1 -- 172.21.15.40:0/3004946862 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a34009710 con 0x7f8a4809e230 2023-09-30T22:25:16.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.466+0000 7f8a457fa700 1 -- 172.21.15.40:0/3004946862 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3400ee50 con 0x7f8a4809e230 2023-09-30T22:25:16.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.466+0000 7f8a457fa700 1 -- 172.21.15.40:0/3004946862 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3400ca70 con 0x7f8a4809e230 2023-09-30T22:25:16.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.466+0000 7f8a4ee39700 1 -- 172.21.15.40:0/3004946862 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a4809cb60 con 0x7f8a4809e230 2023-09-30T22:25:16.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.466+0000 7f8a4ee39700 1 -- 172.21.15.40:0/3004946862 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a48133a10 con 0x7f8a4809e230 2023-09-30T22:25:16.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.467+0000 7f8a457fa700 1 -- 172.21.15.40:0/3004946862 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8a3400cbd0 con 0x7f8a4809e230 2023-09-30T22:25:16.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.467+0000 7f8a4ee39700 1 -- 172.21.15.40:0/3004946862 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a48062380 con 0x7f8a4809e230 2023-09-30T22:25:16.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.468+0000 7f8a4cbd5700 1 -- 172.21.15.40:0/3004946862 >> v1:172.21.15.40:6816/127432 conn(0x7f8a2c02f560 legacy=0x7f8a2c031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:16.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.468+0000 7f8a457fa700 1 -- 172.21.15.40:0/3004946862 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f8a3403fb70 con 0x7f8a4809e230 2023-09-30T22:25:16.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.472+0000 7f8a457fa700 1 -- 172.21.15.40:0/3004946862 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8a340232f0 con 0x7f8a4809e230 2023-09-30T22:25:16.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.494+0000 7f9da0f52700 1 -- 172.21.15.40:0/3869070599 >> v1:172.21.15.40:6816/127432 conn(0x7f9d8002f510 legacy=0x7f9d800319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:16.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.502+0000 7f9da31b6700 1 -- 172.21.15.40:0/3869070599 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9d9c130c30 con 0x7f9d9c09e480 2023-09-30T22:25:16.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.502+0000 7f9d997fa700 1 -- 172.21.15.40:0/3869070599 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9d9c130c30 con 0x7f9d9c09e480 2023-09-30T22:25:16.503 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:16.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.504+0000 7f9da31b6700 1 -- 172.21.15.40:0/3869070599 >> v1:172.21.15.40:6816/127432 conn(0x7f9d8002f510 legacy=0x7f9d800319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:16.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.504+0000 7f9da31b6700 1 -- 172.21.15.40:0/3869070599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d9c09e480 msgr2=0x7f9d9c12dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.504+0000 7f9da31b6700 1 --2- 172.21.15.40:0/3869070599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d9c09e480 0x7f9d9c12dfa0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9d9400efc0 tx=0x7f9d9400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.505+0000 7f9da31b6700 1 -- 172.21.15.40:0/3869070599 shutdown_connections 2023-09-30T22:25:16.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.505+0000 7f9da31b6700 1 --2- 172.21.15.40:0/3869070599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d9c09e480 0x7f9d9c12dfa0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.505+0000 7f9da31b6700 1 --2- 172.21.15.40:0/3869070599 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d9c09c890 0x7f9d9c12d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.505+0000 7f9da31b6700 1 --2- 172.21.15.40:0/3869070599 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d9c09d920 0x7f9d9c12da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.505+0000 7f9da31b6700 1 -- 172.21.15.40:0/3869070599 >> 172.21.15.40:0/3869070599 conn(0x7f9d9c0a7080 msgr2=0x7f9d9c0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:16.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.505+0000 7f9da31b6700 1 -- 172.21.15.40:0/3869070599 shutdown_connections 2023-09-30T22:25:16.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.505+0000 7f9da31b6700 1 -- 172.21.15.40:0/3869070599 wait complete. 2023-09-30T22:25:16.518 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:16.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.562+0000 7fd9c544f700 1 Processor -- start 2023-09-30T22:25:16.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.562+0000 7fd9c544f700 1 -- start start 2023-09-30T22:25:16.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.563+0000 7fd9c544f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd9c006f3a0 0x7fd9c006c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.563+0000 7fd9c544f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd9c009fbb0 0x7fd9c006ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.563+0000 7fd9c544f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9c00a0780 con 0x7fd9c006d410 2023-09-30T22:25:16.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.563+0000 7fd9c544f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9c009ff80 con 0x7fd9c009fbb0 2023-09-30T22:25:16.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.563+0000 7fd9c544f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c00a0590 con 0x7fd9c006f3a0 2023-09-30T22:25:16.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.563+0000 7fd9be7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd9c009fbb0 0x7fd9c006ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.563+0000 7fd9bf7fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd9c006d410 0x7fd9c013a380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:59820/0 (socket says 172.21.15.40:59820) 2023-09-30T22:25:16.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.563+0000 7fd9bf7fe700 1 -- 172.21.15.40:0/2656648781 learned_addr learned my addr 172.21.15.40:0/2656648781 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:16.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.563+0000 7fd9beffd700 1 --2- 172.21.15.40:0/2656648781 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd9c006f3a0 0x7fd9c006c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.563+0000 7fd9be7fc700 1 -- 172.21.15.40:0/2656648781 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd9c006f3a0 msgr2=0x7fd9c006c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:16.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.563+0000 7fd9be7fc700 1 --2- 172.21.15.40:0/2656648781 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd9c006f3a0 0x7fd9c006c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.563+0000 7fd9be7fc700 1 -- 172.21.15.40:0/2656648781 >> v1:172.21.15.40:6789/0 conn(0x7fd9c006d410 legacy=0x7fd9c013a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.563+0000 7fd9be7fc700 1 -- 172.21.15.40:0/2656648781 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c006df90 con 0x7fd9c009fbb0 2023-09-30T22:25:16.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.563+0000 7fd9bdffb700 1 -- 172.21.15.40:0/2656648781 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3857328867 0 0) 0x7fd9c00a0780 con 0x7fd9c006d410 2023-09-30T22:25:16.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.564+0000 7fd9be7fc700 1 --2- 172.21.15.40:0/2656648781 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9c009fbb0 0x7fd9c006ced0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4009840 tx=0x7fd9b4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9aaaaa200aa0b0f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:16.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.564+0000 7fd9bdffb700 1 -- 172.21.15.40:0/2656648781 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b4011830 con 0x7fd9c009fbb0 2023-09-30T22:25:16.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.564+0000 7fd9bdffb700 1 -- 172.21.15.40:0/2656648781 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b4011990 con 0x7fd9c009fbb0 2023-09-30T22:25:16.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.564+0000 7fd9bdffb700 1 -- 172.21.15.40:0/2656648781 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b4011d20 con 0x7fd9c009fbb0 2023-09-30T22:25:16.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.565+0000 7fd9c544f700 1 -- 172.21.15.40:0/2656648781 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9c009fbb0 msgr2=0x7fd9c006ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.565+0000 7fd9c544f700 1 --2- 172.21.15.40:0/2656648781 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9c009fbb0 0x7fd9c006ced0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4009840 tx=0x7fd9b4009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:16.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.565+0000 7fd9c544f700 1 -- 172.21.15.40:0/2656648781 shutdown_connections 2023-09-30T22:25:16.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.565+0000 7fd9c544f700 1 --2- 172.21.15.40:0/2656648781 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd9c006f3a0 0x7fd9c006c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.565+0000 7fd9c544f700 1 --2- 172.21.15.40:0/2656648781 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9c009fbb0 0x7fd9c006ced0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.565+0000 7fd9c544f700 1 -- 172.21.15.40:0/2656648781 >> 172.21.15.40:0/2656648781 conn(0x7fd9c00a41a0 msgr2=0x7fd9c00a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:16.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.565+0000 7fd9c544f700 1 -- 172.21.15.40:0/2656648781 shutdown_connections 2023-09-30T22:25:16.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.565+0000 7fd9c544f700 1 -- 172.21.15.40:0/2656648781 wait complete. 2023-09-30T22:25:16.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.566+0000 7fd9c544f700 1 Processor -- start 2023-09-30T22:25:16.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.566+0000 7fd9c544f700 1 -- start start 2023-09-30T22:25:16.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.566+0000 7fd9c544f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9c006d410 0x7fd9c008f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.566+0000 7fd9c544f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9c006f3a0 0x7fd9c008f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.566+0000 7fd9c544f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd9c009fbb0 0x7fd9c008fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.566+0000 7fd9c544f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c0090610 con 0x7fd9c006d410 2023-09-30T22:25:16.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.566+0000 7fd9c544f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c0091a60 con 0x7fd9c006f3a0 2023-09-30T22:25:16.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.566+0000 7fd9c544f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c0071640 con 0x7fd9c009fbb0 2023-09-30T22:25:16.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.566+0000 7fd9bf7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd9c009fbb0 0x7fd9c008fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.566+0000 7fd9beffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9c006d410 0x7fd9c008f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.567+0000 7fd9beffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9c006d410 0x7fd9c008f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60592/0 (socket says 172.21.15.40:60592) 2023-09-30T22:25:16.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.567+0000 7fd9bf7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd9c009fbb0 0x7fd9c008fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41108/0 (socket says 172.21.15.40:41108) 2023-09-30T22:25:16.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.567+0000 7fd9beffd700 1 -- 172.21.15.40:0/3897443857 learned_addr learned my addr 172.21.15.40:0/3897443857 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:16.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.567+0000 7fd9be7fc700 1 --2- 172.21.15.40:0/3897443857 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9c006f3a0 0x7fd9c008f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.567+0000 7fd9bf7fe700 1 -- 172.21.15.40:0/3897443857 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9c006f3a0 msgr2=0x7fd9c008f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.567+0000 7fd9bf7fe700 1 --2- 172.21.15.40:0/3897443857 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9c006f3a0 0x7fd9c008f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.567+0000 7fd9bf7fe700 1 -- 172.21.15.40:0/3897443857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9c006d410 msgr2=0x7fd9c008f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.567+0000 7fd9bf7fe700 1 --2- 172.21.15.40:0/3897443857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9c006d410 0x7fd9c008f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.567+0000 7fd9bf7fe700 1 -- 172.21.15.40:0/3897443857 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b40094a0 con 0x7fd9c009fbb0 2023-09-30T22:25:16.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.567+0000 7fd9be7fc700 1 --2- 172.21.15.40:0/3897443857 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9c006f3a0 0x7fd9c008f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:16.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.567+0000 7fd9bf7fe700 1 --2- 172.21.15.40:0/3897443857 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd9c009fbb0 0x7fd9c008fe60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd9b800c410 tx=0x7fd9b800c720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:16.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.567+0000 7fd9a77fe700 1 -- 172.21.15.40:0/3897443857 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8004a70 con 0x7fd9c009fbb0 2023-09-30T22:25:16.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.567+0000 7fd9a77fe700 1 -- 172.21.15.40:0/3897443857 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b8004bf0 con 0x7fd9c009fbb0 2023-09-30T22:25:16.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.567+0000 7fd9c544f700 1 -- 172.21.15.40:0/3897443857 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c00911f0 con 0x7fd9c009fbb0 2023-09-30T22:25:16.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.567+0000 7fd9a77fe700 1 -- 172.21.15.40:0/3897443857 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b80070d0 con 0x7fd9c009fbb0 2023-09-30T22:25:16.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.567+0000 7fd9c544f700 1 -- 172.21.15.40:0/3897443857 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c0097290 con 0x7fd9c009fbb0 2023-09-30T22:25:16.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.568+0000 7fd9a77fe700 1 -- 172.21.15.40:0/3897443857 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd9b8007230 con 0x7fd9c009fbb0 2023-09-30T22:25:16.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.568+0000 7fd9c544f700 1 -- 172.21.15.40:0/3897443857 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9c0091600 con 0x7fd9c009fbb0 2023-09-30T22:25:16.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.568+0000 7fd9a77fe700 1 -- 172.21.15.40:0/3897443857 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7fd9b803f720 con 0x7fd9c009fbb0 2023-09-30T22:25:16.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.568+0000 7fd9beffd700 1 -- 172.21.15.40:0/3897443857 >> v1:172.21.15.40:6816/127432 conn(0x7fd9ac02f510 legacy=0x7fd9ac0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:16.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.577+0000 7fd9a77fe700 1 -- 172.21.15.40:0/3897443857 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd9b801b950 con 0x7fd9c009fbb0 2023-09-30T22:25:16.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.598+0000 7ff195e25700 1 Processor -- start 2023-09-30T22:25:16.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.598+0000 7ff195e25700 1 -- start start 2023-09-30T22:25:16.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.598+0000 7ff195e25700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff19009d920 0x7ff19009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.598+0000 7ff195e25700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff19009e230 0x7ff1901308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.598+0000 7ff195e25700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff190130de0 0x7ff190131240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.598+0000 7ff195e25700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff19009edf0 con 0x7ff19009d920 2023-09-30T22:25:16.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.599+0000 7ff195e25700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff19009adf0 con 0x7ff190130de0 2023-09-30T22:25:16.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.599+0000 7ff195e25700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff19009b660 con 0x7ff19009e230 2023-09-30T22:25:16.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.599+0000 7ff18f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff19009d920 0x7ff19009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.599+0000 7ff18ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff190130de0 0x7ff190131240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.599+0000 7ff18f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff19009d920 0x7ff19009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60602/0 (socket says 172.21.15.40:60602) 2023-09-30T22:25:16.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.599+0000 7ff18ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff190130de0 0x7ff190131240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35226/0 (socket says 172.21.15.40:35226) 2023-09-30T22:25:16.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.599+0000 7ff18f7fe700 1 -- 172.21.15.40:0/1519332474 learned_addr learned my addr 172.21.15.40:0/1519332474 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:16.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.599+0000 7ff18effd700 1 --2- 172.21.15.40:0/1519332474 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff19009e230 0x7ff1901308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.599+0000 7ff18f7fe700 1 -- 172.21.15.40:0/1519332474 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff19009e230 msgr2=0x7ff1901308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:16.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.599+0000 7ff18f7fe700 1 --2- 172.21.15.40:0/1519332474 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff19009e230 0x7ff1901308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.599+0000 7ff18f7fe700 1 -- 172.21.15.40:0/1519332474 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff190130de0 msgr2=0x7ff190131240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:16.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.599+0000 7ff18f7fe700 1 --2- 172.21.15.40:0/1519332474 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff190130de0 0x7ff190131240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.599+0000 7ff18f7fe700 1 -- 172.21.15.40:0/1519332474 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff19009a6e0 con 0x7ff19009d920 2023-09-30T22:25:16.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.599+0000 7ff18ffff700 1 --2- 172.21.15.40:0/1519332474 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff190130de0 0x7ff190131240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:16.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.599+0000 7ff18f7fe700 1 --2- 172.21.15.40:0/1519332474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff19009d920 0x7ff19009dcf0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff180006fd0 tx=0x7ff180009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c370cf4438af0e9e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:16.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.599+0000 7ff18e7fc700 1 -- 172.21.15.40:0/1519332474 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff180005e30 con 0x7ff19009d920 2023-09-30T22:25:16.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.600+0000 7ff18e7fc700 1 -- 172.21.15.40:0/1519332474 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff180004030 con 0x7ff19009d920 2023-09-30T22:25:16.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.600+0000 7ff18e7fc700 1 -- 172.21.15.40:0/1519332474 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1800043e0 con 0x7ff19009d920 2023-09-30T22:25:16.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.600+0000 7ff195e25700 1 -- 172.21.15.40:0/1519332474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff19009d920 msgr2=0x7ff19009dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.600+0000 7ff195e25700 1 --2- 172.21.15.40:0/1519332474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff19009d920 0x7ff19009dcf0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff180006fd0 tx=0x7ff180009bd0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.600+0000 7ff195e25700 1 -- 172.21.15.40:0/1519332474 shutdown_connections 2023-09-30T22:25:16.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.600+0000 7ff195e25700 1 --2- 172.21.15.40:0/1519332474 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff190130de0 0x7ff190131240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.600+0000 7ff195e25700 1 --2- 172.21.15.40:0/1519332474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff19009d920 0x7ff19009dcf0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.600+0000 7ff195e25700 1 --2- 172.21.15.40:0/1519332474 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff19009e230 0x7ff1901308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.600+0000 7ff195e25700 1 -- 172.21.15.40:0/1519332474 >> 172.21.15.40:0/1519332474 conn(0x7ff19009fb20 msgr2=0x7ff19009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:16.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.600+0000 7ff195e25700 1 -- 172.21.15.40:0/1519332474 shutdown_connections 2023-09-30T22:25:16.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.600+0000 7ff195e25700 1 -- 172.21.15.40:0/1519332474 wait complete. 2023-09-30T22:25:16.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.602+0000 7ff195e25700 1 Processor -- start 2023-09-30T22:25:16.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.602+0000 7ff195e25700 1 -- start start 2023-09-30T22:25:16.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.602+0000 7ff195e25700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff19009d920 0x7ff19011d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.603+0000 7ff195e25700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff19009e230 0x7ff19011d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.603+0000 7ff195e25700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff190130de0 0x7ff19011dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.603+0000 7ff195e25700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19011e700 con 0x7ff19009d920 2023-09-30T22:25:16.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.603+0000 7ff195e25700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff19012f5c0 con 0x7ff19009e230 2023-09-30T22:25:16.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.603+0000 7ff195e25700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff190120040 con 0x7ff190130de0 2023-09-30T22:25:16.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.603+0000 7ff18f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff19009d920 0x7ff19011d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.603+0000 7ff18f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff19009d920 0x7ff19011d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60606/0 (socket says 172.21.15.40:60606) 2023-09-30T22:25:16.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.603+0000 7ff18f7fe700 1 -- 172.21.15.40:0/438230785 learned_addr learned my addr 172.21.15.40:0/438230785 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:16.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.603+0000 7ff18effd700 1 --2- 172.21.15.40:0/438230785 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff19009e230 0x7ff19011d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.603+0000 7ff18ffff700 1 --2- 172.21.15.40:0/438230785 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff190130de0 0x7ff19011dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.603+0000 7ff18f7fe700 1 -- 172.21.15.40:0/438230785 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff190130de0 msgr2=0x7ff19011dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.603+0000 7ff18f7fe700 1 --2- 172.21.15.40:0/438230785 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff190130de0 0x7ff19011dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.603+0000 7ff18f7fe700 1 -- 172.21.15.40:0/438230785 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff19009e230 msgr2=0x7ff19011d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.603+0000 7ff18f7fe700 1 --2- 172.21.15.40:0/438230785 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff19009e230 0x7ff19011d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.603+0000 7ff18f7fe700 1 -- 172.21.15.40:0/438230785 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff188009a70 con 0x7ff19009d920 2023-09-30T22:25:16.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.603+0000 7ff18effd700 1 --2- 172.21.15.40:0/438230785 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff19009e230 0x7ff19011d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:16.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.603+0000 7ff18f7fe700 1 --2- 172.21.15.40:0/438230785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff19009d920 0x7ff19011d230 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff180009c10 tx=0x7ff180004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:16.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.603+0000 7ff177fff700 1 -- 172.21.15.40:0/438230785 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1800043f0 con 0x7ff19009d920 2023-09-30T22:25:16.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.603+0000 7ff177fff700 1 -- 172.21.15.40:0/438230785 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff18001c420 con 0x7ff19009d920 2023-09-30T22:25:16.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.603+0000 7ff177fff700 1 -- 172.21.15.40:0/438230785 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18001c7d0 con 0x7ff19009d920 2023-09-30T22:25:16.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.604+0000 7ff195e25700 1 -- 172.21.15.40:0/438230785 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff180009500 con 0x7ff19009d920 2023-09-30T22:25:16.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.604+0000 7ff195e25700 1 -- 172.21.15.40:0/438230785 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff190120490 con 0x7ff19009d920 2023-09-30T22:25:16.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.605+0000 7ff177fff700 1 -- 172.21.15.40:0/438230785 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff18001c930 con 0x7ff19009d920 2023-09-30T22:25:16.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.605+0000 7ff177fff700 1 -- 172.21.15.40:0/438230785 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7ff180040980 con 0x7ff19009d920 2023-09-30T22:25:16.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.605+0000 7ff18effd700 1 -- 172.21.15.40:0/438230785 >> v1:172.21.15.40:6816/127432 conn(0x7ff17c02f510 legacy=0x7ff17c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:16.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.606+0000 7ff175ffb700 1 -- 172.21.15.40:0/438230785 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1680052e0 con 0x7ff19009d920 2023-09-30T22:25:16.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.610+0000 7ff177fff700 1 -- 172.21.15.40:0/438230785 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff180020080 con 0x7ff19009d920 2023-09-30T22:25:16.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.669+0000 7f8a4cbd5700 1 -- 172.21.15.40:0/3004946862 >> v1:172.21.15.40:6816/127432 conn(0x7f8a2c02f560 legacy=0x7f8a2c031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:16.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.689+0000 7f8a4ee39700 1 -- 172.21.15.40:0/3004946862 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8a48074720 con 0x7f8a4809e230 2023-09-30T22:25:16.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.690+0000 7f8a457fa700 1 -- 172.21.15.40:0/3004946862 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8a34021070 con 0x7f8a4809e230 2023-09-30T22:25:16.691 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:16.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.693+0000 7f8a4ee39700 1 -- 172.21.15.40:0/3004946862 >> v1:172.21.15.40:6816/127432 conn(0x7f8a2c02f560 legacy=0x7f8a2c031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:16.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.693+0000 7f8a4ee39700 1 -- 172.21.15.40:0/3004946862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a4809e230 msgr2=0x7f8a4812f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.693+0000 7f8a4ee39700 1 --2- 172.21.15.40:0/3004946862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a4809e230 0x7f8a4812f1d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8a3400e9b0 tx=0x7f8a3400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.694+0000 7f8a4ee39700 1 -- 172.21.15.40:0/3004946862 shutdown_connections 2023-09-30T22:25:16.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.694+0000 7f8a4ee39700 1 --2- 172.21.15.40:0/3004946862 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a4809d920 0x7f8a4812ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.694+0000 7f8a4ee39700 1 --2- 172.21.15.40:0/3004946862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a48130de0 0x7f8a4812f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.694+0000 7f8a4ee39700 1 --2- 172.21.15.40:0/3004946862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a4809e230 0x7f8a4812f1d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.694+0000 7f8a4ee39700 1 -- 172.21.15.40:0/3004946862 >> 172.21.15.40:0/3004946862 conn(0x7f8a4809fb20 msgr2=0x7f8a4806ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:16.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.694+0000 7f8a4ee39700 1 -- 172.21.15.40:0/3004946862 shutdown_connections 2023-09-30T22:25:16.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.694+0000 7f8a4ee39700 1 -- 172.21.15.40:0/3004946862 wait complete. 2023-09-30T22:25:16.706 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:16.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.769+0000 7fd9beffd700 1 -- 172.21.15.40:0/3897443857 >> v1:172.21.15.40:6816/127432 conn(0x7fd9ac02f510 legacy=0x7fd9ac0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:16.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.780+0000 7fd9c544f700 1 -- 172.21.15.40:0/3897443857 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd9c0062380 con 0x7fd9c009fbb0 2023-09-30T22:25:16.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.780+0000 7fd9a77fe700 1 -- 172.21.15.40:0/3897443857 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd9b801b950 con 0x7fd9c009fbb0 2023-09-30T22:25:16.781 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:16.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.782+0000 7fd9c544f700 1 -- 172.21.15.40:0/3897443857 >> v1:172.21.15.40:6816/127432 conn(0x7fd9ac02f510 legacy=0x7fd9ac0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:16.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.782+0000 7fd9c544f700 1 -- 172.21.15.40:0/3897443857 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd9c009fbb0 msgr2=0x7fd9c008fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.782+0000 7fd9c544f700 1 --2- 172.21.15.40:0/3897443857 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd9c009fbb0 0x7fd9c008fe60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd9b800c410 tx=0x7fd9b800c720 comp rx=0 tx=0).stop 2023-09-30T22:25:16.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.782+0000 7fd9c544f700 1 -- 172.21.15.40:0/3897443857 shutdown_connections 2023-09-30T22:25:16.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.782+0000 7fd9c544f700 1 --2- 172.21.15.40:0/3897443857 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd9c009fbb0 0x7fd9c008fe60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.782+0000 7fd9c544f700 1 --2- 172.21.15.40:0/3897443857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9c006d410 0x7fd9c008f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.782+0000 7fd9c544f700 1 --2- 172.21.15.40:0/3897443857 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9c006f3a0 0x7fd9c008f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.782+0000 7fd9c544f700 1 -- 172.21.15.40:0/3897443857 >> 172.21.15.40:0/3897443857 conn(0x7fd9c00a41a0 msgr2=0x7fd9c006f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:16.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.782+0000 7fd9c544f700 1 -- 172.21.15.40:0/3897443857 shutdown_connections 2023-09-30T22:25:16.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.782+0000 7fd9c544f700 1 -- 172.21.15.40:0/3897443857 wait complete. 2023-09-30T22:25:16.796 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:16.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.806+0000 7ff18effd700 1 -- 172.21.15.40:0/438230785 >> v1:172.21.15.40:6816/127432 conn(0x7ff17c02f510 legacy=0x7ff17c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:16.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.814+0000 7ff175ffb700 1 -- 172.21.15.40:0/438230785 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff168005860 con 0x7ff19009d920 2023-09-30T22:25:16.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.815+0000 7ff177fff700 1 -- 172.21.15.40:0/438230785 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff180016020 con 0x7ff19009d920 2023-09-30T22:25:16.815 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:16.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.817+0000 7ff175ffb700 1 -- 172.21.15.40:0/438230785 >> v1:172.21.15.40:6816/127432 conn(0x7ff17c02f510 legacy=0x7ff17c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:16.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.817+0000 7ff175ffb700 1 -- 172.21.15.40:0/438230785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff19009d920 msgr2=0x7ff19011d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.817+0000 7ff175ffb700 1 --2- 172.21.15.40:0/438230785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff19009d920 0x7ff19011d230 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff180009c10 tx=0x7ff180004750 comp rx=0 tx=0).stop 2023-09-30T22:25:16.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.817+0000 7ff175ffb700 1 -- 172.21.15.40:0/438230785 shutdown_connections 2023-09-30T22:25:16.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.817+0000 7ff175ffb700 1 --2- 172.21.15.40:0/438230785 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff190130de0 0x7ff19011dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.817+0000 7ff175ffb700 1 --2- 172.21.15.40:0/438230785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff19009d920 0x7ff19011d230 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.817+0000 7ff175ffb700 1 --2- 172.21.15.40:0/438230785 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff19009e230 0x7ff19011d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.817+0000 7ff175ffb700 1 -- 172.21.15.40:0/438230785 >> 172.21.15.40:0/438230785 conn(0x7ff19009fb20 msgr2=0x7ff19012ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:16.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.817+0000 7ff175ffb700 1 -- 172.21.15.40:0/438230785 shutdown_connections 2023-09-30T22:25:16.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:16.817+0000 7ff175ffb700 1 -- 172.21.15.40:0/438230785 wait complete. 2023-09-30T22:25:16.829 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:17.519 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:17.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.659+0000 7fd45a1e2700 1 Processor -- start 2023-09-30T22:25:17.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.659+0000 7fd45a1e2700 1 -- start start 2023-09-30T22:25:17.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.659+0000 7fd45a1e2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd45406d0a0 0x7fd45406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.659+0000 7fd45a1e2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd454139380 0x7fd45413b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.659+0000 7fd45a1e2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd45406e3f0 con 0x7fd45409fbb0 2023-09-30T22:25:17.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.659+0000 7fd45a1e2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd45409ff80 con 0x7fd454139380 2023-09-30T22:25:17.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.659+0000 7fd45a1e2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd45406ec40 con 0x7fd45406d0a0 2023-09-30T22:25:17.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.659+0000 7fd453fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd454139380 0x7fd45413b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.659+0000 7fd452ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd45406d0a0 0x7fd45406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.659+0000 7fd4537fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd45409fbb0 0x7fd45406c990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:59822/0 (socket says 172.21.15.40:59822) 2023-09-30T22:25:17.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.659+0000 7fd4537fe700 1 -- 172.21.15.40:0/4189311275 learned_addr learned my addr 172.21.15.40:0/4189311275 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:17.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.660+0000 7fd4527fc700 1 -- 172.21.15.40:0/4189311275 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 426025664 0 0) 0x7fd45406e3f0 con 0x7fd45409fbb0 2023-09-30T22:25:17.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.660+0000 7fd4527fc700 1 -- 172.21.15.40:0/4189311275 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd43c0035b0 con 0x7fd45409fbb0 2023-09-30T22:25:17.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.660+0000 7fd453fff700 1 -- 172.21.15.40:0/4189311275 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd45406d0a0 msgr2=0x7fd45406d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:17.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.660+0000 7fd453fff700 1 --2- 172.21.15.40:0/4189311275 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd45406d0a0 0x7fd45406d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.660+0000 7fd453fff700 1 -- 172.21.15.40:0/4189311275 >> v1:172.21.15.40:6789/0 conn(0x7fd45409fbb0 legacy=0x7fd45406c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.660+0000 7fd453fff700 1 -- 172.21.15.40:0/4189311275 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45406d9f0 con 0x7fd454139380 2023-09-30T22:25:17.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.660+0000 7fd452ffd700 1 --2- 172.21.15.40:0/4189311275 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd45406d0a0 0x7fd45406d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:17.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.660+0000 7fd453fff700 1 --2- 172.21.15.40:0/4189311275 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd454139380 0x7fd45413b760 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd44c009870 tx=0x7fd44c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ecbee86420434cf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:17.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.660+0000 7fd4527fc700 1 -- 172.21.15.40:0/4189311275 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c011830 con 0x7fd454139380 2023-09-30T22:25:17.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.660+0000 7fd4527fc700 1 -- 172.21.15.40:0/4189311275 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44c011990 con 0x7fd454139380 2023-09-30T22:25:17.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.660+0000 7fd4527fc700 1 -- 172.21.15.40:0/4189311275 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c011d20 con 0x7fd454139380 2023-09-30T22:25:17.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.660+0000 7fd45a1e2700 1 -- 172.21.15.40:0/4189311275 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd454139380 msgr2=0x7fd45413b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.660+0000 7fd45a1e2700 1 --2- 172.21.15.40:0/4189311275 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd454139380 0x7fd45413b760 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd44c009870 tx=0x7fd44c009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:17.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.661+0000 7fd45a1e2700 1 -- 172.21.15.40:0/4189311275 shutdown_connections 2023-09-30T22:25:17.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.661+0000 7fd45a1e2700 1 --2- 172.21.15.40:0/4189311275 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd454139380 0x7fd45413b760 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.661+0000 7fd45a1e2700 1 --2- 172.21.15.40:0/4189311275 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd45406d0a0 0x7fd45406d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.661+0000 7fd45a1e2700 1 -- 172.21.15.40:0/4189311275 >> 172.21.15.40:0/4189311275 conn(0x7fd4540a41a0 msgr2=0x7fd4540a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:17.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.661+0000 7fd45a1e2700 1 -- 172.21.15.40:0/4189311275 shutdown_connections 2023-09-30T22:25:17.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.661+0000 7fd45a1e2700 1 -- 172.21.15.40:0/4189311275 wait complete. 2023-09-30T22:25:17.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.661+0000 7fd45a1e2700 1 Processor -- start 2023-09-30T22:25:17.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.662+0000 7fd45a1e2700 1 -- start start 2023-09-30T22:25:17.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.662+0000 7fd45a1e2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd45406d0a0 0x7fd454138390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.662+0000 7fd45a1e2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd45409fbb0 0x7fd4541388d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.662+0000 7fd45a1e2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd454139380 0x7fd454138e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.662+0000 7fd45a1e2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4540948b0 con 0x7fd454139380 2023-09-30T22:25:17.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.662+0000 7fd45a1e2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd454096a50 con 0x7fd45406d0a0 2023-09-30T22:25:17.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.662+0000 7fd45a1e2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd454094ae0 con 0x7fd45409fbb0 2023-09-30T22:25:17.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.662+0000 7fd4537fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd45406d0a0 0x7fd454138390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.662+0000 7fd453fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd454139380 0x7fd454138e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.662+0000 7fd4537fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd45406d0a0 0x7fd454138390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35250/0 (socket says 172.21.15.40:35250) 2023-09-30T22:25:17.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.662+0000 7fd4537fe700 1 -- 172.21.15.40:0/3649088312 learned_addr learned my addr 172.21.15.40:0/3649088312 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:17.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.662+0000 7fd452ffd700 1 --2- 172.21.15.40:0/3649088312 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd45409fbb0 0x7fd4541388d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.663+0000 7fd453fff700 1 -- 172.21.15.40:0/3649088312 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd45409fbb0 msgr2=0x7fd4541388d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.663+0000 7fd453fff700 1 --2- 172.21.15.40:0/3649088312 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd45409fbb0 0x7fd4541388d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.663+0000 7fd453fff700 1 -- 172.21.15.40:0/3649088312 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd45406d0a0 msgr2=0x7fd454138390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.663+0000 7fd453fff700 1 --2- 172.21.15.40:0/3649088312 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd45406d0a0 0x7fd454138390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.663+0000 7fd453fff700 1 -- 172.21.15.40:0/3649088312 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4480094a0 con 0x7fd454139380 2023-09-30T22:25:17.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.663+0000 7fd453fff700 1 --2- 172.21.15.40:0/3649088312 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd454139380 0x7fd454138e10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd44c016000 tx=0x7fd44c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:17.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.663+0000 7fd43bfff700 1 -- 172.21.15.40:0/3649088312 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c004450 con 0x7fd454139380 2023-09-30T22:25:17.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.663+0000 7fd43bfff700 1 -- 172.21.15.40:0/3649088312 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44c0045b0 con 0x7fd454139380 2023-09-30T22:25:17.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.663+0000 7fd45a1e2700 1 -- 172.21.15.40:0/3649088312 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd44c0094a0 con 0x7fd454139380 2023-09-30T22:25:17.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.663+0000 7fd43bfff700 1 -- 172.21.15.40:0/3649088312 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c0038e0 con 0x7fd454139380 2023-09-30T22:25:17.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.663+0000 7fd45a1e2700 1 -- 172.21.15.40:0/3649088312 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd454095550 con 0x7fd454139380 2023-09-30T22:25:17.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.664+0000 7fd43bfff700 1 -- 172.21.15.40:0/3649088312 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd44c003a40 con 0x7fd454139380 2023-09-30T22:25:17.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.664+0000 7fd43bfff700 1 -- 172.21.15.40:0/3649088312 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7fd44c040c90 con 0x7fd454139380 2023-09-30T22:25:17.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.664+0000 7fd4537fe700 1 -- 172.21.15.40:0/3649088312 >> v1:172.21.15.40:6816/127432 conn(0x7fd44002f510 legacy=0x7fd4400319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:17.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.664+0000 7fd45a1e2700 1 -- 172.21.15.40:0/3649088312 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd454062380 con 0x7fd454139380 2023-09-30T22:25:17.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.669+0000 7fd43bfff700 1 -- 172.21.15.40:0/3649088312 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd44c015020 con 0x7fd454139380 2023-09-30T22:25:17.708 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:17.797 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:17.830 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:17.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.835+0000 7fc3b9c1c700 1 Processor -- start 2023-09-30T22:25:17.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.836+0000 7fc3b9c1c700 1 -- start start 2023-09-30T22:25:17.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.836+0000 7fc3b9c1c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3b412e590 0x7fc3b412e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.836+0000 7fc3b9c1c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc3b412eea0 0x7fc3b412d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.836+0000 7fc3b9c1c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3b409ab70 con 0x7fc3b412d6d0 2023-09-30T22:25:17.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.836+0000 7fc3b9c1c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3b409b270 con 0x7fc3b412eea0 2023-09-30T22:25:17.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.836+0000 7fc3b9c1c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b409bab0 con 0x7fc3b412e590 2023-09-30T22:25:17.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.836+0000 7fc3b37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3b412e590 0x7fc3b412e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.836+0000 7fc3b37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3b412e590 0x7fc3b412e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41146/0 (socket says 172.21.15.40:41146) 2023-09-30T22:25:17.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.836+0000 7fc3b37fe700 1 -- 172.21.15.40:0/2119163530 learned_addr learned my addr 172.21.15.40:0/2119163530 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:17.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.836+0000 7fc3b2ffd700 1 --2- 172.21.15.40:0/2119163530 >> v2:172.21.15.40:3300/0 conn(0x7fc3b412eea0 0x7fc3b412d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.837+0000 7fc3b37fe700 1 -- 172.21.15.40:0/2119163530 >> v2:172.21.15.40:3300/0 conn(0x7fc3b412eea0 msgr2=0x7fc3b412d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:17.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.837+0000 7fc3b37fe700 1 --2- 172.21.15.40:0/2119163530 >> v2:172.21.15.40:3300/0 conn(0x7fc3b412eea0 0x7fc3b412d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.837+0000 7fc3b37fe700 1 -- 172.21.15.40:0/2119163530 >> v1:172.21.15.40:6789/0 conn(0x7fc3b412d6d0 legacy=0x7fc3b4137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.837+0000 7fc3b37fe700 1 -- 172.21.15.40:0/2119163530 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b409bd70 con 0x7fc3b412e590 2023-09-30T22:25:17.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.837+0000 7fc3b37fe700 1 --2- 172.21.15.40:0/2119163530 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3b412e590 0x7fc3b412e960 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4009920 tx=0x7fc3a4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=519da54d4329cb38 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:17.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.837+0000 7fc3b27fc700 1 -- 172.21.15.40:0/2119163530 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a400ba20 con 0x7fc3b412e590 2023-09-30T22:25:17.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.837+0000 7fc3b27fc700 1 -- 172.21.15.40:0/2119163530 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a400bb80 con 0x7fc3b412e590 2023-09-30T22:25:17.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.837+0000 7fc3b27fc700 1 -- 172.21.15.40:0/2119163530 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4009e70 con 0x7fc3b412e590 2023-09-30T22:25:17.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.838+0000 7fc3b9c1c700 1 -- 172.21.15.40:0/2119163530 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3b412e590 msgr2=0x7fc3b412e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.838+0000 7fc3b9c1c700 1 --2- 172.21.15.40:0/2119163530 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3b412e590 0x7fc3b412e960 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4009920 tx=0x7fc3a4009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:17.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.839+0000 7fc3b9c1c700 1 -- 172.21.15.40:0/2119163530 shutdown_connections 2023-09-30T22:25:17.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.839+0000 7fc3b9c1c700 1 --2- 172.21.15.40:0/2119163530 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3b412e590 0x7fc3b412e960 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.839+0000 7fc3b9c1c700 1 --2- 172.21.15.40:0/2119163530 >> v2:172.21.15.40:3300/0 conn(0x7fc3b412eea0 0x7fc3b412d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.839+0000 7fc3b9c1c700 1 -- 172.21.15.40:0/2119163530 >> 172.21.15.40:0/2119163530 conn(0x7fc3b40a2a00 msgr2=0x7fc3b40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:17.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.839+0000 7fc3b9c1c700 1 -- 172.21.15.40:0/2119163530 shutdown_connections 2023-09-30T22:25:17.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.839+0000 7fc3b9c1c700 1 -- 172.21.15.40:0/2119163530 wait complete. 2023-09-30T22:25:17.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.840+0000 7fc3b9c1c700 1 Processor -- start 2023-09-30T22:25:17.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.840+0000 7fc3b9c1c700 1 -- start start 2023-09-30T22:25:17.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.841+0000 7fc3b9c1c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3b412d6d0 0x7fc3b4137a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.841+0000 7fc3b9c1c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3b412e590 0x7fc3b4137fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.841+0000 7fc3b9c1c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3b412eea0 0x7fc3b41c6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.841+0000 7fc3b9c1c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b4135240 con 0x7fc3b412eea0 2023-09-30T22:25:17.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.841+0000 7fc3b9c1c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b409ded0 con 0x7fc3b412e590 2023-09-30T22:25:17.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.841+0000 7fc3b9c1c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b409b4b0 con 0x7fc3b412d6d0 2023-09-30T22:25:17.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.841+0000 7fc3b37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3b412d6d0 0x7fc3b4137a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.841+0000 7fc3b37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3b412d6d0 0x7fc3b4137a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41162/0 (socket says 172.21.15.40:41162) 2023-09-30T22:25:17.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.841+0000 7fc3b37fe700 1 -- 172.21.15.40:0/625217221 learned_addr learned my addr 172.21.15.40:0/625217221 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:17.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.841+0000 7fc3b3fff700 1 --2- 172.21.15.40:0/625217221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3b412eea0 0x7fc3b41c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.841+0000 7fc3b37fe700 1 -- 172.21.15.40:0/625217221 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3b412e590 msgr2=0x7fc3b4137fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.841+0000 7fc3b37fe700 1 --2- 172.21.15.40:0/625217221 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3b412e590 0x7fc3b4137fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.841+0000 7fc3b37fe700 1 -- 172.21.15.40:0/625217221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3b412eea0 msgr2=0x7fc3b41c6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.841+0000 7fc3b37fe700 1 --2- 172.21.15.40:0/625217221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3b412eea0 0x7fc3b41c6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.841+0000 7fc3b37fe700 1 -- 172.21.15.40:0/625217221 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a4009550 con 0x7fc3b412d6d0 2023-09-30T22:25:17.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.842+0000 7fc3b37fe700 1 --2- 172.21.15.40:0/625217221 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3b412d6d0 0x7fc3b4137a60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400c010 tx=0x7fc3a4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:17.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.842+0000 7fc39bfff700 1 -- 172.21.15.40:0/625217221 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4004510 con 0x7fc3b412d6d0 2023-09-30T22:25:17.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.842+0000 7fc39bfff700 1 -- 172.21.15.40:0/625217221 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a401f070 con 0x7fc3b412d6d0 2023-09-30T22:25:17.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.842+0000 7fc39bfff700 1 -- 172.21.15.40:0/625217221 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a40038e0 con 0x7fc3b412d6d0 2023-09-30T22:25:17.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.842+0000 7fc3b9c1c700 1 -- 172.21.15.40:0/625217221 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3b409cdb0 con 0x7fc3b412d6d0 2023-09-30T22:25:17.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.842+0000 7fc3b9c1c700 1 -- 172.21.15.40:0/625217221 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3b41384e0 con 0x7fc3b412d6d0 2023-09-30T22:25:17.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.843+0000 7fc3b9c1c700 1 -- 172.21.15.40:0/625217221 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3b4136480 con 0x7fc3b412d6d0 2023-09-30T22:25:17.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.843+0000 7fc39bfff700 1 -- 172.21.15.40:0/625217221 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc3a4003a40 con 0x7fc3b412d6d0 2023-09-30T22:25:17.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.843+0000 7fc39bfff700 1 -- 172.21.15.40:0/625217221 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7fc3a4021070 con 0x7fc3b412d6d0 2023-09-30T22:25:17.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.843+0000 7fc3b2ffd700 1 -- 172.21.15.40:0/625217221 >> v1:172.21.15.40:6816/127432 conn(0x7fc3a002f510 legacy=0x7fc3a00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:17.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.848+0000 7fc39bfff700 1 -- 172.21.15.40:0/625217221 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc3a402f3a0 con 0x7fc3b412d6d0 2023-09-30T22:25:17.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.865+0000 7fd4537fe700 1 -- 172.21.15.40:0/3649088312 >> v1:172.21.15.40:6816/127432 conn(0x7fd44002f510 legacy=0x7fd4400319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:17.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.873+0000 7fd45a1e2700 1 -- 172.21.15.40:0/3649088312 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd454074620 con 0x7fd454139380 2023-09-30T22:25:17.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.874+0000 7fd43bfff700 1 -- 172.21.15.40:0/3649088312 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd44c02e7d0 con 0x7fd454139380 2023-09-30T22:25:17.874 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:17.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.876+0000 7fd45a1e2700 1 -- 172.21.15.40:0/3649088312 >> v1:172.21.15.40:6816/127432 conn(0x7fd44002f510 legacy=0x7fd4400319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:17.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.876+0000 7fd45a1e2700 1 -- 172.21.15.40:0/3649088312 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd454139380 msgr2=0x7fd454138e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.876+0000 7fd45a1e2700 1 --2- 172.21.15.40:0/3649088312 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd454139380 0x7fd454138e10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd44c016000 tx=0x7fd44c004750 comp rx=0 tx=0).stop 2023-09-30T22:25:17.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.876+0000 7fd45a1e2700 1 -- 172.21.15.40:0/3649088312 shutdown_connections 2023-09-30T22:25:17.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.876+0000 7fd45a1e2700 1 --2- 172.21.15.40:0/3649088312 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd454139380 0x7fd454138e10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.876+0000 7fd45a1e2700 1 --2- 172.21.15.40:0/3649088312 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd45406d0a0 0x7fd454138390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.876+0000 7fd45a1e2700 1 --2- 172.21.15.40:0/3649088312 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd45409fbb0 0x7fd4541388d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.876+0000 7fd45a1e2700 1 -- 172.21.15.40:0/3649088312 >> 172.21.15.40:0/3649088312 conn(0x7fd4540a41a0 msgr2=0x7fd4540a20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:17.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.876+0000 7fd45a1e2700 1 -- 172.21.15.40:0/3649088312 shutdown_connections 2023-09-30T22:25:17.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.876+0000 7fd45a1e2700 1 -- 172.21.15.40:0/3649088312 wait complete. 2023-09-30T22:25:17.891 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:17.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.930+0000 7fcb81df9700 1 Processor -- start 2023-09-30T22:25:17.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.930+0000 7fcb81df9700 1 -- start start 2023-09-30T22:25:17.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.931+0000 7fcb81df9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcb7c09d920 0x7fcb7c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.931+0000 7fcb81df9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb7c09f0f0 0x7fcb7c09e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.931+0000 7fcb81df9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb7c133ca0 0x7fcb7c134110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.931+0000 7fcb81df9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb7c06b4c0 con 0x7fcb7c09d920 2023-09-30T22:25:17.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.931+0000 7fcb81df9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c09a8f0 con 0x7fcb7c09f0f0 2023-09-30T22:25:17.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.931+0000 7fcb81df9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c09f940 con 0x7fcb7c133ca0 2023-09-30T22:25:17.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.931+0000 7fcb7b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcb7c09d920 0x7fcb7c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.931+0000 7fcb7b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcb7c09d920 0x7fcb7c09dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60636/0 (socket says 172.21.15.40:60636) 2023-09-30T22:25:17.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.931+0000 7fcb7b7fe700 1 -- 172.21.15.40:0/1370271268 learned_addr learned my addr 172.21.15.40:0/1370271268 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:17.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.931+0000 7fcb7affd700 1 --2- 172.21.15.40:0/1370271268 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb7c09f0f0 0x7fcb7c09e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.931+0000 7fcb7bfff700 1 --2- 172.21.15.40:0/1370271268 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb7c133ca0 0x7fcb7c134110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.931+0000 7fcb7b7fe700 1 -- 172.21.15.40:0/1370271268 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb7c133ca0 msgr2=0x7fcb7c134110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:17.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.931+0000 7fcb7b7fe700 1 --2- 172.21.15.40:0/1370271268 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb7c133ca0 0x7fcb7c134110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.931+0000 7fcb7b7fe700 1 -- 172.21.15.40:0/1370271268 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb7c09f0f0 msgr2=0x7fcb7c09e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:17.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.931+0000 7fcb7b7fe700 1 --2- 172.21.15.40:0/1370271268 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb7c09f0f0 0x7fcb7c09e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.931+0000 7fcb7b7fe700 1 -- 172.21.15.40:0/1370271268 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7c09f6e0 con 0x7fcb7c09d920 2023-09-30T22:25:17.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.931+0000 7fcb7affd700 1 --2- 172.21.15.40:0/1370271268 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb7c09f0f0 0x7fcb7c09e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:17.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.931+0000 7fcb7b7fe700 1 --2- 172.21.15.40:0/1370271268 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb7c09d920 0x7fcb7c09dcf0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c0098f0 tx=0x7fcb6c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a524f8e8a811a34b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:17.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.932+0000 7fcb7a7fc700 1 -- 172.21.15.40:0/1370271268 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c005e30 con 0x7fcb7c09d920 2023-09-30T22:25:17.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.932+0000 7fcb7a7fc700 1 -- 172.21.15.40:0/1370271268 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb6c004030 con 0x7fcb7c09d920 2023-09-30T22:25:17.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.932+0000 7fcb7a7fc700 1 -- 172.21.15.40:0/1370271268 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c0043e0 con 0x7fcb7c09d920 2023-09-30T22:25:17.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.932+0000 7fcb81df9700 1 -- 172.21.15.40:0/1370271268 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb7c09d920 msgr2=0x7fcb7c09dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.932+0000 7fcb81df9700 1 --2- 172.21.15.40:0/1370271268 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb7c09d920 0x7fcb7c09dcf0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c0098f0 tx=0x7fcb6c009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:17.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.932+0000 7fcb81df9700 1 -- 172.21.15.40:0/1370271268 shutdown_connections 2023-09-30T22:25:17.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.932+0000 7fcb81df9700 1 --2- 172.21.15.40:0/1370271268 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb7c133ca0 0x7fcb7c134110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.932+0000 7fcb81df9700 1 --2- 172.21.15.40:0/1370271268 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb7c09d920 0x7fcb7c09dcf0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.932+0000 7fcb81df9700 1 --2- 172.21.15.40:0/1370271268 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb7c09f0f0 0x7fcb7c09e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.932+0000 7fcb81df9700 1 -- 172.21.15.40:0/1370271268 >> 172.21.15.40:0/1370271268 conn(0x7fcb7c09fb20 msgr2=0x7fcb7c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:17.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.932+0000 7fcb81df9700 1 -- 172.21.15.40:0/1370271268 shutdown_connections 2023-09-30T22:25:17.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.932+0000 7fcb81df9700 1 -- 172.21.15.40:0/1370271268 wait complete. 2023-09-30T22:25:17.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.934+0000 7fcb81df9700 1 Processor -- start 2023-09-30T22:25:17.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.934+0000 7fcb81df9700 1 -- start start 2023-09-30T22:25:17.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.934+0000 7fcb81df9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb7c09d920 0x7fcb7c121920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.934+0000 7fcb81df9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb7c133ca0 0x7fcb7c121e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.935+0000 7fcb81df9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb7c1223a0 0x7fcb7c1c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.935+0000 7fcb81df9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c123d40 con 0x7fcb7c133ca0 2023-09-30T22:25:17.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.935+0000 7fcb81df9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c1227e0 con 0x7fcb7c09d920 2023-09-30T22:25:17.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.935+0000 7fcb81df9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c122d80 con 0x7fcb7c1223a0 2023-09-30T22:25:17.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.935+0000 7fcb7b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb7c09d920 0x7fcb7c121920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.935+0000 7fcb7b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb7c09d920 0x7fcb7c121920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35272/0 (socket says 172.21.15.40:35272) 2023-09-30T22:25:17.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.935+0000 7fcb7b7fe700 1 -- 172.21.15.40:0/3501535584 learned_addr learned my addr 172.21.15.40:0/3501535584 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:17.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.935+0000 7fcb7bfff700 1 --2- 172.21.15.40:0/3501535584 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb7c1223a0 0x7fcb7c1c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.935+0000 7fcb7affd700 1 --2- 172.21.15.40:0/3501535584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb7c133ca0 0x7fcb7c121e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.935+0000 7fcb7b7fe700 1 -- 172.21.15.40:0/3501535584 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb7c1223a0 msgr2=0x7fcb7c1c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.935+0000 7fcb7b7fe700 1 --2- 172.21.15.40:0/3501535584 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb7c1223a0 0x7fcb7c1c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.935+0000 7fcb7b7fe700 1 -- 172.21.15.40:0/3501535584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb7c133ca0 msgr2=0x7fcb7c121e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.935+0000 7fcb7b7fe700 1 --2- 172.21.15.40:0/3501535584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb7c133ca0 0x7fcb7c121e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.935+0000 7fcb7b7fe700 1 -- 172.21.15.40:0/3501535584 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb700094a0 con 0x7fcb7c09d920 2023-09-30T22:25:17.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.935+0000 7fcb7b7fe700 1 --2- 172.21.15.40:0/3501535584 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb7c09d920 0x7fcb7c121920 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c009c40 tx=0x7fcb6c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:17.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.935+0000 7fcb63fff700 1 -- 172.21.15.40:0/3501535584 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c003ce0 con 0x7fcb7c09d920 2023-09-30T22:25:17.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.935+0000 7fcb63fff700 1 -- 172.21.15.40:0/3501535584 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb6c003e40 con 0x7fcb7c09d920 2023-09-30T22:25:17.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.935+0000 7fcb63fff700 1 -- 172.21.15.40:0/3501535584 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c01c660 con 0x7fcb7c09d920 2023-09-30T22:25:17.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.935+0000 7fcb81df9700 1 -- 172.21.15.40:0/3501535584 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb6c009500 con 0x7fcb7c09d920 2023-09-30T22:25:17.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.936+0000 7fcb81df9700 1 -- 172.21.15.40:0/3501535584 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb7c132360 con 0x7fcb7c09d920 2023-09-30T22:25:17.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.936+0000 7fcb63fff700 1 -- 172.21.15.40:0/3501535584 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fcb6c01c7c0 con 0x7fcb7c09d920 2023-09-30T22:25:17.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.937+0000 7fcb81df9700 1 -- 172.21.15.40:0/3501535584 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb7c062380 con 0x7fcb7c09d920 2023-09-30T22:25:17.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.937+0000 7fcb63fff700 1 -- 172.21.15.40:0/3501535584 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7fcb6c040ca0 con 0x7fcb7c09d920 2023-09-30T22:25:17.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.937+0000 7fcb7affd700 1 -- 172.21.15.40:0/3501535584 >> v1:172.21.15.40:6816/127432 conn(0x7fcb6802f510 legacy=0x7fcb680319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:17.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.941+0000 7fcb63fff700 1 -- 172.21.15.40:0/3501535584 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcb6c01b740 con 0x7fcb7c09d920 2023-09-30T22:25:17.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.971+0000 7fda303ab700 1 Processor -- start 2023-09-30T22:25:17.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.971+0000 7fda303ab700 1 -- start start 2023-09-30T22:25:17.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.972+0000 7fda303ab700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fda2806f070 0x7fda2806f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.972+0000 7fda303ab700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda2806fdb0 0x7fda280977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.972+0000 7fda303ab700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda28070830 con 0x7fda2806f980 2023-09-30T22:25:17.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.972+0000 7fda303ab700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda28070ad0 con 0x7fda2806f070 2023-09-30T22:25:17.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.972+0000 7fda303ab700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda28070de0 con 0x7fda2806fdb0 2023-09-30T22:25:17.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.972+0000 7fda2e948700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda2806fdb0 0x7fda280977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.972+0000 7fda2e147700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fda2806f070 0x7fda2806f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.972+0000 7fda2e948700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda2806fdb0 0x7fda280977a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35288/0 (socket says 172.21.15.40:35288) 2023-09-30T22:25:17.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.972+0000 7fda2e948700 1 -- 172.21.15.40:0/4035683359 learned_addr learned my addr 172.21.15.40:0/4035683359 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:17.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.972+0000 7fda2e948700 1 -- 172.21.15.40:0/4035683359 >> v2:172.21.15.40:3300/0 conn(0x7fda2806f070 msgr2=0x7fda2806f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:17.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.972+0000 7fda2e948700 1 --2- 172.21.15.40:0/4035683359 >> v2:172.21.15.40:3300/0 conn(0x7fda2806f070 0x7fda2806f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.972+0000 7fda2e948700 1 -- 172.21.15.40:0/4035683359 >> v1:172.21.15.40:6789/0 conn(0x7fda2806f980 legacy=0x7fda28097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.972+0000 7fda2e948700 1 -- 172.21.15.40:0/4035683359 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2809fe20 con 0x7fda2806fdb0 2023-09-30T22:25:17.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.972+0000 7fda2e948700 1 --2- 172.21.15.40:0/4035683359 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda2806fdb0 0x7fda280977a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fda20009e50 tx=0x7fda2000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c803526c8426b684 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:17.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.973+0000 7fda2d145700 1 -- 172.21.15.40:0/4035683359 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2000e070 con 0x7fda2806fdb0 2023-09-30T22:25:17.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.973+0000 7fda2d145700 1 -- 172.21.15.40:0/4035683359 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2000b910 con 0x7fda2806fdb0 2023-09-30T22:25:17.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.973+0000 7fda2d145700 1 -- 172.21.15.40:0/4035683359 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2000bcc0 con 0x7fda2806fdb0 2023-09-30T22:25:17.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.973+0000 7fda303ab700 1 -- 172.21.15.40:0/4035683359 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda2806fdb0 msgr2=0x7fda280977a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.973+0000 7fda303ab700 1 --2- 172.21.15.40:0/4035683359 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda2806fdb0 0x7fda280977a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fda20009e50 tx=0x7fda2000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:17.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.973+0000 7fda303ab700 1 -- 172.21.15.40:0/4035683359 shutdown_connections 2023-09-30T22:25:17.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.973+0000 7fda303ab700 1 --2- 172.21.15.40:0/4035683359 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda2806fdb0 0x7fda280977a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.973+0000 7fda303ab700 1 --2- 172.21.15.40:0/4035683359 >> v2:172.21.15.40:3300/0 conn(0x7fda2806f070 0x7fda2806f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.973+0000 7fda303ab700 1 -- 172.21.15.40:0/4035683359 >> 172.21.15.40:0/4035683359 conn(0x7fda280a41a0 msgr2=0x7fda280a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:17.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.973+0000 7fda303ab700 1 -- 172.21.15.40:0/4035683359 shutdown_connections 2023-09-30T22:25:17.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.973+0000 7fda303ab700 1 -- 172.21.15.40:0/4035683359 wait complete. 2023-09-30T22:25:17.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.975+0000 7fda303ab700 1 Processor -- start 2023-09-30T22:25:17.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.975+0000 7fda303ab700 1 -- start start 2023-09-30T22:25:17.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.975+0000 7fda303ab700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda2806f070 0x7fda2812d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.975+0000 7fda303ab700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda2806f980 0x7fda2812d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.975+0000 7fda303ab700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda2806fdb0 0x7fda2812dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.975+0000 7fda303ab700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda28130a10 con 0x7fda2806f980 2023-09-30T22:25:17.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.975+0000 7fda303ab700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2812fb60 con 0x7fda2806f070 2023-09-30T22:25:17.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.975+0000 7fda303ab700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda28129310 con 0x7fda2806fdb0 2023-09-30T22:25:17.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.975+0000 7fda2e147700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda2806f070 0x7fda2812d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.975+0000 7fda2e147700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda2806f070 0x7fda2812d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35302/0 (socket says 172.21.15.40:35302) 2023-09-30T22:25:17.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.975+0000 7fda2e147700 1 -- 172.21.15.40:0/1046926169 learned_addr learned my addr 172.21.15.40:0/1046926169 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:17.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.975+0000 7fda2d946700 1 --2- 172.21.15.40:0/1046926169 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda2806f980 0x7fda2812d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.975+0000 7fda2e948700 1 --2- 172.21.15.40:0/1046926169 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda2806fdb0 0x7fda2812dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.976+0000 7fda2e147700 1 -- 172.21.15.40:0/1046926169 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda2806fdb0 msgr2=0x7fda2812dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.976+0000 7fda2e147700 1 --2- 172.21.15.40:0/1046926169 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda2806fdb0 0x7fda2812dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.976+0000 7fda2e147700 1 -- 172.21.15.40:0/1046926169 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda2806f980 msgr2=0x7fda2812d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.976+0000 7fda2e147700 1 --2- 172.21.15.40:0/1046926169 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda2806f980 0x7fda2812d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.976+0000 7fda2e147700 1 -- 172.21.15.40:0/1046926169 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda20009b30 con 0x7fda2806f070 2023-09-30T22:25:17.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.976+0000 7fda2e948700 1 --2- 172.21.15.40:0/1046926169 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda2806fdb0 0x7fda2812dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:17.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.976+0000 7fda2d946700 1 --2- 172.21.15.40:0/1046926169 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda2806f980 0x7fda2812d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:17.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.976+0000 7fda2e147700 1 --2- 172.21.15.40:0/1046926169 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda2806f070 0x7fda2812d1d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fda2400e9b0 tx=0x7fda2400ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:17.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.976+0000 7fda1effd700 1 -- 172.21.15.40:0/1046926169 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda24009710 con 0x7fda2806f070 2023-09-30T22:25:17.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.976+0000 7fda1effd700 1 -- 172.21.15.40:0/1046926169 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2400ee50 con 0x7fda2806f070 2023-09-30T22:25:17.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.976+0000 7fda1effd700 1 -- 172.21.15.40:0/1046926169 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2400ca50 con 0x7fda2806f070 2023-09-30T22:25:17.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.976+0000 7fda303ab700 1 -- 172.21.15.40:0/1046926169 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda2812c2d0 con 0x7fda2806f070 2023-09-30T22:25:17.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.976+0000 7fda303ab700 1 -- 172.21.15.40:0/1046926169 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda28131480 con 0x7fda2806f070 2023-09-30T22:25:17.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.977+0000 7fda303ab700 1 -- 172.21.15.40:0/1046926169 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda28062380 con 0x7fda2806f070 2023-09-30T22:25:17.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.977+0000 7fda1effd700 1 -- 172.21.15.40:0/1046926169 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fda2400cbb0 con 0x7fda2806f070 2023-09-30T22:25:17.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.978+0000 7fda2d946700 1 -- 172.21.15.40:0/1046926169 >> v1:172.21.15.40:6816/127432 conn(0x7fda0c02f510 legacy=0x7fda0c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:17.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.978+0000 7fda1effd700 1 -- 172.21.15.40:0/1046926169 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7fda2403fc60 con 0x7fda2806f070 2023-09-30T22:25:17.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:17.982+0000 7fda1effd700 1 -- 172.21.15.40:0/1046926169 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fda2401be10 con 0x7fda2806f070 2023-09-30T22:25:18.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.044+0000 7fc3b2ffd700 1 -- 172.21.15.40:0/625217221 >> v1:172.21.15.40:6816/127432 conn(0x7fc3a002f510 legacy=0x7fc3a00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:18.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.051+0000 7fc3b9c1c700 1 -- 172.21.15.40:0/625217221 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc3b4062380 con 0x7fc3b412d6d0 2023-09-30T22:25:18.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.052+0000 7fc39bfff700 1 -- 172.21.15.40:0/625217221 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc3a4015090 con 0x7fc3b412d6d0 2023-09-30T22:25:18.052 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:18.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.054+0000 7fc3b9c1c700 1 -- 172.21.15.40:0/625217221 >> v1:172.21.15.40:6816/127432 conn(0x7fc3a002f510 legacy=0x7fc3a00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:18.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.054+0000 7fc3b9c1c700 1 -- 172.21.15.40:0/625217221 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3b412d6d0 msgr2=0x7fc3b4137a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:18.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.054+0000 7fc3b9c1c700 1 --2- 172.21.15.40:0/625217221 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3b412d6d0 0x7fc3b4137a60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400c010 tx=0x7fc3a4004750 comp rx=0 tx=0).stop 2023-09-30T22:25:18.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.054+0000 7fc3b9c1c700 1 -- 172.21.15.40:0/625217221 shutdown_connections 2023-09-30T22:25:18.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.054+0000 7fc3b9c1c700 1 --2- 172.21.15.40:0/625217221 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3b412d6d0 0x7fc3b4137a60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.054+0000 7fc3b9c1c700 1 --2- 172.21.15.40:0/625217221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3b412eea0 0x7fc3b41c6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.054+0000 7fc3b9c1c700 1 --2- 172.21.15.40:0/625217221 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3b412e590 0x7fc3b4137fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.054+0000 7fc3b9c1c700 1 -- 172.21.15.40:0/625217221 >> 172.21.15.40:0/625217221 conn(0x7fc3b40a2a00 msgr2=0x7fc3b4130b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:18.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.054+0000 7fc3b9c1c700 1 -- 172.21.15.40:0/625217221 shutdown_connections 2023-09-30T22:25:18.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.054+0000 7fc3b9c1c700 1 -- 172.21.15.40:0/625217221 wait complete. 2023-09-30T22:25:18.067 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:18.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.138+0000 7fcb7affd700 1 -- 172.21.15.40:0/3501535584 >> v1:172.21.15.40:6816/127432 conn(0x7fcb6802f510 legacy=0x7fcb680319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:18.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.141+0000 7fcb81df9700 1 -- 172.21.15.40:0/3501535584 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcb7c074720 con 0x7fcb7c09d920 2023-09-30T22:25:18.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.141+0000 7fcb63fff700 1 -- 172.21.15.40:0/3501535584 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcb6c020070 con 0x7fcb7c09d920 2023-09-30T22:25:18.142 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:18.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.144+0000 7fcb81df9700 1 -- 172.21.15.40:0/3501535584 >> v1:172.21.15.40:6816/127432 conn(0x7fcb6802f510 legacy=0x7fcb680319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:18.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.144+0000 7fcb81df9700 1 -- 172.21.15.40:0/3501535584 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb7c09d920 msgr2=0x7fcb7c121920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:18.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.144+0000 7fcb81df9700 1 --2- 172.21.15.40:0/3501535584 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb7c09d920 0x7fcb7c121920 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c009c40 tx=0x7fcb6c004750 comp rx=0 tx=0).stop 2023-09-30T22:25:18.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.144+0000 7fcb81df9700 1 -- 172.21.15.40:0/3501535584 shutdown_connections 2023-09-30T22:25:18.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.144+0000 7fcb81df9700 1 --2- 172.21.15.40:0/3501535584 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb7c1223a0 0x7fcb7c1c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.144+0000 7fcb81df9700 1 --2- 172.21.15.40:0/3501535584 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb7c09d920 0x7fcb7c121920 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.144+0000 7fcb81df9700 1 --2- 172.21.15.40:0/3501535584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb7c133ca0 0x7fcb7c121e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.144+0000 7fcb81df9700 1 -- 172.21.15.40:0/3501535584 >> 172.21.15.40:0/3501535584 conn(0x7fcb7c09fb20 msgr2=0x7fcb7c0a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:18.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.144+0000 7fcb81df9700 1 -- 172.21.15.40:0/3501535584 shutdown_connections 2023-09-30T22:25:18.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.144+0000 7fcb81df9700 1 -- 172.21.15.40:0/3501535584 wait complete. 2023-09-30T22:25:18.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:18.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.179+0000 7fda2d946700 1 -- 172.21.15.40:0/1046926169 >> v1:172.21.15.40:6816/127432 conn(0x7fda0c02f510 legacy=0x7fda0c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:18.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.180+0000 7fda303ab700 1 -- 172.21.15.40:0/1046926169 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fda28074620 con 0x7fda2806f070 2023-09-30T22:25:18.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.180+0000 7fda1effd700 1 -- 172.21.15.40:0/1046926169 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fda24021020 con 0x7fda2806f070 2023-09-30T22:25:18.181 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:18.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.182+0000 7fda303ab700 1 -- 172.21.15.40:0/1046926169 >> v1:172.21.15.40:6816/127432 conn(0x7fda0c02f510 legacy=0x7fda0c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:18.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.182+0000 7fda303ab700 1 -- 172.21.15.40:0/1046926169 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda2806f070 msgr2=0x7fda2812d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:18.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.182+0000 7fda303ab700 1 --2- 172.21.15.40:0/1046926169 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda2806f070 0x7fda2812d1d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fda2400e9b0 tx=0x7fda2400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.182+0000 7fda303ab700 1 -- 172.21.15.40:0/1046926169 shutdown_connections 2023-09-30T22:25:18.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.182+0000 7fda303ab700 1 --2- 172.21.15.40:0/1046926169 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda2806fdb0 0x7fda2812dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.182+0000 7fda303ab700 1 --2- 172.21.15.40:0/1046926169 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda2806f070 0x7fda2812d1d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.182+0000 7fda303ab700 1 --2- 172.21.15.40:0/1046926169 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda2806f980 0x7fda2812d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.182+0000 7fda303ab700 1 -- 172.21.15.40:0/1046926169 >> 172.21.15.40:0/1046926169 conn(0x7fda280a41a0 msgr2=0x7fda280974a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:18.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.182+0000 7fda303ab700 1 -- 172.21.15.40:0/1046926169 shutdown_connections 2023-09-30T22:25:18.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:18.182+0000 7fda303ab700 1 -- 172.21.15.40:0/1046926169 wait complete. 2023-09-30T22:25:18.195 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:18.892 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:19.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.032+0000 7fcfb91fd700 1 Processor -- start 2023-09-30T22:25:19.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.032+0000 7fcfb91fd700 1 -- start start 2023-09-30T22:25:19.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.033+0000 7fcfb91fd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfb4133e00 0x7fcfb41341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.033+0000 7fcfb91fd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcfb409d400 0x7fcfb409d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.033+0000 7fcfb91fd700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb4133940 con 0x7fcfb409dd70 2023-09-30T22:25:19.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.033+0000 7fcfb91fd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb409ab20 con 0x7fcfb4133e00 2023-09-30T22:25:19.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.033+0000 7fcfb91fd700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb409f0d0 con 0x7fcfb409d400 2023-09-30T22:25:19.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.033+0000 7fcfb2d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfb4133e00 0x7fcfb41341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.033+0000 7fcfabfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcfb409d400 0x7fcfb409d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.033+0000 7fcfb359e700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fcfb409dd70 0x7fcfb413ac70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:59848/0 (socket says 172.21.15.40:59848) 2023-09-30T22:25:19.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.033+0000 7fcfb2d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfb4133e00 0x7fcfb41341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35318/0 (socket says 172.21.15.40:35318) 2023-09-30T22:25:19.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.033+0000 7fcfb359e700 1 -- 172.21.15.40:0/1009293118 learned_addr learned my addr 172.21.15.40:0/1009293118 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:19.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.033+0000 7fcfabfff700 1 -- 172.21.15.40:0/1009293118 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfb4133e00 msgr2=0x7fcfb41341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:19.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.033+0000 7fcfb259c700 1 -- 172.21.15.40:0/1009293118 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 22531865 0 0) 0x7fcfb4133940 con 0x7fcfb409dd70 2023-09-30T22:25:19.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.033+0000 7fcfabfff700 1 --2- 172.21.15.40:0/1009293118 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfb4133e00 0x7fcfb41341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.033+0000 7fcfabfff700 1 -- 172.21.15.40:0/1009293118 >> v1:172.21.15.40:6789/0 conn(0x7fcfb409dd70 legacy=0x7fcfb413ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.033+0000 7fcfabfff700 1 -- 172.21.15.40:0/1009293118 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb409e210 con 0x7fcfb409d400 2023-09-30T22:25:19.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.033+0000 7fcfb2d9d700 1 --2- 172.21.15.40:0/1009293118 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfb4133e00 0x7fcfb41341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:19.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.033+0000 7fcfabfff700 1 --2- 172.21.15.40:0/1009293118 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcfb409d400 0x7fcfb409d830 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c009870 tx=0x7fcf9c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e05298c29c0f67f5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:19.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.033+0000 7fcfb259c700 1 -- 172.21.15.40:0/1009293118 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c011830 con 0x7fcfb409d400 2023-09-30T22:25:19.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.033+0000 7fcfb259c700 1 -- 172.21.15.40:0/1009293118 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9c011990 con 0x7fcfb409d400 2023-09-30T22:25:19.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.033+0000 7fcfb259c700 1 -- 172.21.15.40:0/1009293118 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c011d20 con 0x7fcfb409d400 2023-09-30T22:25:19.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.034+0000 7fcfb91fd700 1 -- 172.21.15.40:0/1009293118 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcfb409d400 msgr2=0x7fcfb409d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.034+0000 7fcfb91fd700 1 --2- 172.21.15.40:0/1009293118 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcfb409d400 0x7fcfb409d830 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c009870 tx=0x7fcf9c009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:19.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.034+0000 7fcfb91fd700 1 -- 172.21.15.40:0/1009293118 shutdown_connections 2023-09-30T22:25:19.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.034+0000 7fcfb91fd700 1 --2- 172.21.15.40:0/1009293118 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfb4133e00 0x7fcfb41341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.034+0000 7fcfb91fd700 1 --2- 172.21.15.40:0/1009293118 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcfb409d400 0x7fcfb409d830 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.034+0000 7fcfb91fd700 1 -- 172.21.15.40:0/1009293118 >> 172.21.15.40:0/1009293118 conn(0x7fcfb40a2a00 msgr2=0x7fcfb40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:19.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.034+0000 7fcfb91fd700 1 -- 172.21.15.40:0/1009293118 shutdown_connections 2023-09-30T22:25:19.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.034+0000 7fcfb91fd700 1 -- 172.21.15.40:0/1009293118 wait complete. 2023-09-30T22:25:19.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.035+0000 7fcfb91fd700 1 Processor -- start 2023-09-30T22:25:19.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.035+0000 7fcfb91fd700 1 -- start start 2023-09-30T22:25:19.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.036+0000 7fcfb91fd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfb409d400 0x7fcfb411a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.036+0000 7fcfb91fd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfb409dd70 0x7fcfb411adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.036+0000 7fcfb91fd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcfb4133e00 0x7fcfb411b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.036+0000 7fcfb91fd700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb411ddb0 con 0x7fcfb409dd70 2023-09-30T22:25:19.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.036+0000 7fcfb91fd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb411c5c0 con 0x7fcfb409d400 2023-09-30T22:25:19.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.036+0000 7fcfb91fd700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb40a10a0 con 0x7fcfb4133e00 2023-09-30T22:25:19.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.036+0000 7fcfb2d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfb409d400 0x7fcfb411a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.036+0000 7fcfb359e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcfb4133e00 0x7fcfb411b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.036+0000 7fcfb2d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfb409d400 0x7fcfb411a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35322/0 (socket says 172.21.15.40:35322) 2023-09-30T22:25:19.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.036+0000 7fcfb2d9d700 1 -- 172.21.15.40:0/224216724 learned_addr learned my addr 172.21.15.40:0/224216724 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:19.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.036+0000 7fcfabfff700 1 --2- 172.21.15.40:0/224216724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfb409dd70 0x7fcfb411adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.036+0000 7fcfb2d9d700 1 -- 172.21.15.40:0/224216724 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcfb4133e00 msgr2=0x7fcfb411b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.036+0000 7fcfb2d9d700 1 --2- 172.21.15.40:0/224216724 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcfb4133e00 0x7fcfb411b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.036+0000 7fcfb2d9d700 1 -- 172.21.15.40:0/224216724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfb409dd70 msgr2=0x7fcfb411adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.036+0000 7fcfb2d9d700 1 --2- 172.21.15.40:0/224216724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfb409dd70 0x7fcfb411adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.036+0000 7fcfb2d9d700 1 -- 172.21.15.40:0/224216724 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa40094a0 con 0x7fcfb409d400 2023-09-30T22:25:19.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.036+0000 7fcfb359e700 1 --2- 172.21.15.40:0/224216724 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcfb4133e00 0x7fcfb411b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:19.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.036+0000 7fcfabfff700 1 --2- 172.21.15.40:0/224216724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfb409dd70 0x7fcfb411adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:19.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.036+0000 7fcfb2d9d700 1 --2- 172.21.15.40:0/224216724 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfb409d400 0x7fcfb411a880 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcfa400ebe0 tx=0x7fcfa400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:19.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.037+0000 7fcfab7fe700 1 -- 172.21.15.40:0/224216724 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa400c850 con 0x7fcfb409d400 2023-09-30T22:25:19.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.037+0000 7fcfab7fe700 1 -- 172.21.15.40:0/224216724 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa400c9b0 con 0x7fcfb409d400 2023-09-30T22:25:19.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.037+0000 7fcfb91fd700 1 -- 172.21.15.40:0/224216724 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf9c0094a0 con 0x7fcfb409d400 2023-09-30T22:25:19.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.037+0000 7fcfab7fe700 1 -- 172.21.15.40:0/224216724 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa400cd40 con 0x7fcfb409d400 2023-09-30T22:25:19.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.037+0000 7fcfb91fd700 1 -- 172.21.15.40:0/224216724 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb411e3a0 con 0x7fcfb409d400 2023-09-30T22:25:19.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.037+0000 7fcfab7fe700 1 -- 172.21.15.40:0/224216724 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fcfa4013470 con 0x7fcfb409d400 2023-09-30T22:25:19.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.037+0000 7fcfab7fe700 1 -- 172.21.15.40:0/224216724 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7fcfa403ff10 con 0x7fcfb409d400 2023-09-30T22:25:19.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.037+0000 7fcfabfff700 1 -- 172.21.15.40:0/224216724 >> v1:172.21.15.40:6816/127432 conn(0x7fcf9402f510 legacy=0x7fcf940319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:19.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.038+0000 7fcfb91fd700 1 -- 172.21.15.40:0/224216724 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb411e3a0 con 0x7fcfb409d400 2023-09-30T22:25:19.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.042+0000 7fcfab7fe700 1 -- 172.21.15.40:0/224216724 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcfb411e3a0 con 0x7fcfb409d400 2023-09-30T22:25:19.067 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:19.157 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:19.196 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:19.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.196+0000 7ff5b0251700 1 Processor -- start 2023-09-30T22:25:19.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.196+0000 7ff5b0251700 1 -- start start 2023-09-30T22:25:19.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.197+0000 7ff5b0251700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff5a806f070 0x7ff5a806f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.197+0000 7ff5b0251700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5a806f980 0x7ff5a8097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.197+0000 7ff5b0251700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a8070830 con 0x7ff5a806fdb0 2023-09-30T22:25:19.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.197+0000 7ff5b0251700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a8071af0 con 0x7ff5a806f980 2023-09-30T22:25:19.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.197+0000 7ff5b0251700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a8070ad0 con 0x7ff5a806f070 2023-09-30T22:25:19.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.197+0000 7ff5adfed700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff5a806f070 0x7ff5a806f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.197+0000 7ff5adfed700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff5a806f070 0x7ff5a806f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41190/0 (socket says 172.21.15.40:41190) 2023-09-30T22:25:19.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.197+0000 7ff5adfed700 1 -- 172.21.15.40:0/179163188 learned_addr learned my addr 172.21.15.40:0/179163188 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:19.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.197+0000 7ff5ad7ec700 1 --2- 172.21.15.40:0/179163188 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5a806f980 0x7ff5a8097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.197+0000 7ff5adfed700 1 -- 172.21.15.40:0/179163188 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5a806f980 msgr2=0x7ff5a8097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:19.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.197+0000 7ff5adfed700 1 --2- 172.21.15.40:0/179163188 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5a806f980 0x7ff5a8097090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.197+0000 7ff5adfed700 1 -- 172.21.15.40:0/179163188 >> v1:172.21.15.40:6789/0 conn(0x7ff5a806fdb0 legacy=0x7ff5a80975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.197+0000 7ff5acfeb700 1 -- 172.21.15.40:0/179163188 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2337897437 0 0) 0x7ff5a8070830 con 0x7ff5a806fdb0 2023-09-30T22:25:19.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.197+0000 7ff5adfed700 1 -- 172.21.15.40:0/179163188 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a8070de0 con 0x7ff5a806f070 2023-09-30T22:25:19.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.197+0000 7ff5ad7ec700 1 --2- 172.21.15.40:0/179163188 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5a806f980 0x7ff5a8097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:19.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.198+0000 7ff5adfed700 1 --2- 172.21.15.40:0/179163188 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff5a806f070 0x7ff5a806f440 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4009950 tx=0x7ff5a4009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9797e2508ab903cf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:19.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.198+0000 7ff5acfeb700 1 -- 172.21.15.40:0/179163188 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4011830 con 0x7ff5a806f070 2023-09-30T22:25:19.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.198+0000 7ff5acfeb700 1 -- 172.21.15.40:0/179163188 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a4011990 con 0x7ff5a806f070 2023-09-30T22:25:19.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.198+0000 7ff5acfeb700 1 -- 172.21.15.40:0/179163188 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4011d40 con 0x7ff5a806f070 2023-09-30T22:25:19.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.198+0000 7ff5b0251700 1 -- 172.21.15.40:0/179163188 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff5a806f070 msgr2=0x7ff5a806f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.198+0000 7ff5b0251700 1 --2- 172.21.15.40:0/179163188 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff5a806f070 0x7ff5a806f440 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4009950 tx=0x7ff5a4009c60 comp rx=0 tx=0).stop 2023-09-30T22:25:19.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.199+0000 7ff5b0251700 1 -- 172.21.15.40:0/179163188 shutdown_connections 2023-09-30T22:25:19.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.199+0000 7ff5b0251700 1 --2- 172.21.15.40:0/179163188 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff5a806f070 0x7ff5a806f440 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.199+0000 7ff5b0251700 1 --2- 172.21.15.40:0/179163188 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5a806f980 0x7ff5a8097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.199+0000 7ff5b0251700 1 -- 172.21.15.40:0/179163188 >> 172.21.15.40:0/179163188 conn(0x7ff5a80a41a0 msgr2=0x7ff5a80a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:19.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.199+0000 7ff5b0251700 1 -- 172.21.15.40:0/179163188 shutdown_connections 2023-09-30T22:25:19.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.199+0000 7ff5b0251700 1 -- 172.21.15.40:0/179163188 wait complete. 2023-09-30T22:25:19.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.200+0000 7ff5b0251700 1 Processor -- start 2023-09-30T22:25:19.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.200+0000 7ff5b0251700 1 -- start start 2023-09-30T22:25:19.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.200+0000 7ff5b0251700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5a806f070 0x7ff5a806c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.200+0000 7ff5b0251700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a806f980 0x7ff5a806ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.200+0000 7ff5b0251700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff5a806fdb0 0x7ff5a806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.200+0000 7ff5b0251700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a808b610 con 0x7ff5a806f980 2023-09-30T22:25:19.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.200+0000 7ff5b0251700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a812c340 con 0x7ff5a806f070 2023-09-30T22:25:19.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.200+0000 7ff5b0251700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a806e160 con 0x7ff5a806fdb0 2023-09-30T22:25:19.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.201+0000 7ff5ad7ec700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a806f980 0x7ff5a806ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.201+0000 7ff5ad7ec700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a806f980 0x7ff5a806ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60700/0 (socket says 172.21.15.40:60700) 2023-09-30T22:25:19.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.201+0000 7ff5ad7ec700 1 -- 172.21.15.40:0/1275135884 learned_addr learned my addr 172.21.15.40:0/1275135884 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:19.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.201+0000 7ff5ae7ee700 1 --2- 172.21.15.40:0/1275135884 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff5a806fdb0 0x7ff5a806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.201+0000 7ff5ad7ec700 1 -- 172.21.15.40:0/1275135884 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff5a806fdb0 msgr2=0x7ff5a806d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.201+0000 7ff5ad7ec700 1 --2- 172.21.15.40:0/1275135884 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff5a806fdb0 0x7ff5a806d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.201+0000 7ff5ad7ec700 1 -- 172.21.15.40:0/1275135884 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5a806f070 msgr2=0x7ff5a806c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.201+0000 7ff5adfed700 1 --2- 172.21.15.40:0/1275135884 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5a806f070 0x7ff5a806c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.201+0000 7ff5ad7ec700 1 --2- 172.21.15.40:0/1275135884 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5a806f070 0x7ff5a806c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.201+0000 7ff5ad7ec700 1 -- 172.21.15.40:0/1275135884 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5980094a0 con 0x7ff5a806f980 2023-09-30T22:25:19.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.201+0000 7ff5adfed700 1 --2- 172.21.15.40:0/1275135884 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5a806f070 0x7ff5a806c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:19.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.201+0000 7ff5ad7ec700 1 --2- 172.21.15.40:0/1275135884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a806f980 0x7ff5a806ced0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff59800ebe0 tx=0x7ff59800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:19.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.201+0000 7ff59e7fc700 1 -- 172.21.15.40:0/1275135884 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59800c8b0 con 0x7ff5a806f980 2023-09-30T22:25:19.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.201+0000 7ff59e7fc700 1 -- 172.21.15.40:0/1275135884 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59800ca10 con 0x7ff5a806f980 2023-09-30T22:25:19.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.201+0000 7ff5b0251700 1 -- 172.21.15.40:0/1275135884 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a4009550 con 0x7ff5a806f980 2023-09-30T22:25:19.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.202+0000 7ff59e7fc700 1 -- 172.21.15.40:0/1275135884 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59800cda0 con 0x7ff5a806f980 2023-09-30T22:25:19.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.202+0000 7ff5b0251700 1 -- 172.21.15.40:0/1275135884 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a8132410 con 0x7ff5a806f980 2023-09-30T22:25:19.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.202+0000 7ff5b0251700 1 -- 172.21.15.40:0/1275135884 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a8062380 con 0x7ff5a806f980 2023-09-30T22:25:19.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.203+0000 7ff59e7fc700 1 -- 172.21.15.40:0/1275135884 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff598013470 con 0x7ff5a806f980 2023-09-30T22:25:19.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.203+0000 7ff59e7fc700 1 -- 172.21.15.40:0/1275135884 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7ff59803fbb0 con 0x7ff5a806f980 2023-09-30T22:25:19.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.203+0000 7ff5adfed700 1 -- 172.21.15.40:0/1275135884 >> v1:172.21.15.40:6816/127432 conn(0x7ff58c02f560 legacy=0x7ff58c031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:19.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.208+0000 7ff59e7fc700 1 -- 172.21.15.40:0/1275135884 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff598013720 con 0x7ff5a806f980 2023-09-30T22:25:19.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.238+0000 7fcfabfff700 1 -- 172.21.15.40:0/224216724 >> v1:172.21.15.40:6816/127432 conn(0x7fcf9402f510 legacy=0x7fcf940319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:19.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.252+0000 7fcfb91fd700 1 -- 172.21.15.40:0/224216724 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcfb411e3a0 con 0x7fcfb409d400 2023-09-30T22:25:19.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.253+0000 7fcfab7fe700 1 -- 172.21.15.40:0/224216724 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcfb411e3a0 con 0x7fcfb409d400 2023-09-30T22:25:19.253 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:19.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.256+0000 7fcfb91fd700 1 -- 172.21.15.40:0/224216724 >> v1:172.21.15.40:6816/127432 conn(0x7fcf9402f510 legacy=0x7fcf940319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:19.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.256+0000 7fcfb91fd700 1 -- 172.21.15.40:0/224216724 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfb409d400 msgr2=0x7fcfb411a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.256+0000 7fcfb91fd700 1 --2- 172.21.15.40:0/224216724 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfb409d400 0x7fcfb411a880 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcfa400ebe0 tx=0x7fcfa400eef0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.256+0000 7fcfb91fd700 1 -- 172.21.15.40:0/224216724 shutdown_connections 2023-09-30T22:25:19.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.256+0000 7fcfb91fd700 1 --2- 172.21.15.40:0/224216724 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcfb4133e00 0x7fcfb411b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.256+0000 7fcfb91fd700 1 --2- 172.21.15.40:0/224216724 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfb409d400 0x7fcfb411a880 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.256+0000 7fcfb91fd700 1 --2- 172.21.15.40:0/224216724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfb409dd70 0x7fcfb411adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.256+0000 7fcfb91fd700 1 -- 172.21.15.40:0/224216724 >> 172.21.15.40:0/224216724 conn(0x7fcfb40a2a00 msgr2=0x7fcfb41bb110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:19.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.256+0000 7fcfb91fd700 1 -- 172.21.15.40:0/224216724 shutdown_connections 2023-09-30T22:25:19.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.256+0000 7fcfb91fd700 1 -- 172.21.15.40:0/224216724 wait complete. 2023-09-30T22:25:19.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:19.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.300+0000 7fb759b6b700 1 Processor -- start 2023-09-30T22:25:19.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.300+0000 7fb759b6b700 1 -- start start 2023-09-30T22:25:19.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.301+0000 7fb759b6b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb75409c890 0x7fb75409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.301+0000 7fb759b6b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb75409d920 0x7fb75409dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.301+0000 7fb759b6b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb75409e2b0 0x7fb75413ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.301+0000 7fb759b6b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7540a29d0 con 0x7fb75409e2b0 2023-09-30T22:25:19.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.301+0000 7fb759b6b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb75409fb40 con 0x7fb75409c890 2023-09-30T22:25:19.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.301+0000 7fb759b6b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7540a2600 con 0x7fb75409d920 2023-09-30T22:25:19.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.301+0000 7fb74affd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb75409d920 0x7fb75409dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.301+0000 7fb74affd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb75409d920 0x7fb75409dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41216/0 (socket says 172.21.15.40:41216) 2023-09-30T22:25:19.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.301+0000 7fb74affd700 1 -- 172.21.15.40:0/3873830022 learned_addr learned my addr 172.21.15.40:0/3873830022 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:19.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.301+0000 7fb7537fe700 1 --2- 172.21.15.40:0/3873830022 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb75409c890 0x7fb75409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.301+0000 7fb753fff700 1 --2- 172.21.15.40:0/3873830022 >> v2:172.21.15.40:3300/0 conn(0x7fb75409e2b0 0x7fb75413ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.301+0000 7fb74affd700 1 -- 172.21.15.40:0/3873830022 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb75409c890 msgr2=0x7fb75409cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:19.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.301+0000 7fb74affd700 1 --2- 172.21.15.40:0/3873830022 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb75409c890 0x7fb75409cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.301+0000 7fb74affd700 1 -- 172.21.15.40:0/3873830022 >> v2:172.21.15.40:3300/0 conn(0x7fb75409e2b0 msgr2=0x7fb75413ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:19.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.301+0000 7fb74affd700 1 --2- 172.21.15.40:0/3873830022 >> v2:172.21.15.40:3300/0 conn(0x7fb75409e2b0 0x7fb75413ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.301+0000 7fb74affd700 1 -- 172.21.15.40:0/3873830022 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75409e720 con 0x7fb75409d920 2023-09-30T22:25:19.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.301+0000 7fb753fff700 1 --2- 172.21.15.40:0/3873830022 >> v2:172.21.15.40:3300/0 conn(0x7fb75409e2b0 0x7fb75413ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:19.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.301+0000 7fb74affd700 1 --2- 172.21.15.40:0/3873830022 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb75409d920 0x7fb75409dd70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb73c0098f0 tx=0x7fb73c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc3f562b736a8d12 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:19.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.302+0000 7fb752ffd700 1 -- 172.21.15.40:0/3873830022 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c011830 con 0x7fb75409d920 2023-09-30T22:25:19.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.302+0000 7fb752ffd700 1 -- 172.21.15.40:0/3873830022 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73c011990 con 0x7fb75409d920 2023-09-30T22:25:19.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.302+0000 7fb752ffd700 1 -- 172.21.15.40:0/3873830022 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c011d20 con 0x7fb75409d920 2023-09-30T22:25:19.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.302+0000 7fb759b6b700 1 -- 172.21.15.40:0/3873830022 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb75409d920 msgr2=0x7fb75409dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.302+0000 7fb759b6b700 1 --2- 172.21.15.40:0/3873830022 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb75409d920 0x7fb75409dd70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb73c0098f0 tx=0x7fb73c009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:19.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.302+0000 7fb759b6b700 1 -- 172.21.15.40:0/3873830022 shutdown_connections 2023-09-30T22:25:19.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.302+0000 7fb759b6b700 1 --2- 172.21.15.40:0/3873830022 >> v2:172.21.15.40:3300/0 conn(0x7fb75409e2b0 0x7fb75413ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.302+0000 7fb759b6b700 1 --2- 172.21.15.40:0/3873830022 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb75409c890 0x7fb75409cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.302+0000 7fb759b6b700 1 --2- 172.21.15.40:0/3873830022 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb75409d920 0x7fb75409dd70 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.302+0000 7fb759b6b700 1 -- 172.21.15.40:0/3873830022 >> 172.21.15.40:0/3873830022 conn(0x7fb7540a7080 msgr2=0x7fb7540a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:19.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.302+0000 7fb759b6b700 1 -- 172.21.15.40:0/3873830022 shutdown_connections 2023-09-30T22:25:19.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.302+0000 7fb759b6b700 1 -- 172.21.15.40:0/3873830022 wait complete. 2023-09-30T22:25:19.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.304+0000 7fb759b6b700 1 Processor -- start 2023-09-30T22:25:19.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.304+0000 7fb759b6b700 1 -- start start 2023-09-30T22:25:19.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.305+0000 7fb759b6b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb75409c890 0x7fb75412d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.305+0000 7fb759b6b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb75409d920 0x7fb75412d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.305+0000 7fb759b6b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb75409e2b0 0x7fb75412db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.305+0000 7fb759b6b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb754130870 con 0x7fb75409c890 2023-09-30T22:25:19.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.305+0000 7fb759b6b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7540a5bd0 con 0x7fb75409d920 2023-09-30T22:25:19.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.305+0000 7fb759b6b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb75409c340 con 0x7fb75409e2b0 2023-09-30T22:25:19.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.305+0000 7fb7537fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb75409c890 0x7fb75412d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.305+0000 7fb7537fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb75409c890 0x7fb75412d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60720/0 (socket says 172.21.15.40:60720) 2023-09-30T22:25:19.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.305+0000 7fb7537fe700 1 -- 172.21.15.40:0/3892136946 learned_addr learned my addr 172.21.15.40:0/3892136946 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:19.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.305+0000 7fb74affd700 1 --2- 172.21.15.40:0/3892136946 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb75409d920 0x7fb75412d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.305+0000 7fb753fff700 1 --2- 172.21.15.40:0/3892136946 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb75409e2b0 0x7fb75412db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.305+0000 7fb7537fe700 1 -- 172.21.15.40:0/3892136946 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb75409e2b0 msgr2=0x7fb75412db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.305+0000 7fb7537fe700 1 --2- 172.21.15.40:0/3892136946 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb75409e2b0 0x7fb75412db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.305+0000 7fb7537fe700 1 -- 172.21.15.40:0/3892136946 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb75409d920 msgr2=0x7fb75412d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.305+0000 7fb7537fe700 1 --2- 172.21.15.40:0/3892136946 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb75409d920 0x7fb75412d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.305+0000 7fb7537fe700 1 -- 172.21.15.40:0/3892136946 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb73c009550 con 0x7fb75409c890 2023-09-30T22:25:19.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.305+0000 7fb74affd700 1 --2- 172.21.15.40:0/3892136946 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb75409d920 0x7fb75412d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:19.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.305+0000 7fb7537fe700 1 --2- 172.21.15.40:0/3892136946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb75409c890 0x7fb75412d0c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb74400e9b0 tx=0x7fb74400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:19.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.306+0000 7fb750ff9700 1 -- 172.21.15.40:0/3892136946 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb744005a20 con 0x7fb75409c890 2023-09-30T22:25:19.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.306+0000 7fb759b6b700 1 -- 172.21.15.40:0/3892136946 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb75412e490 con 0x7fb75409c890 2023-09-30T22:25:19.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.306+0000 7fb759b6b700 1 -- 172.21.15.40:0/3892136946 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7541305b0 con 0x7fb75409c890 2023-09-30T22:25:19.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.306+0000 7fb750ff9700 1 -- 172.21.15.40:0/3892136946 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb744005b80 con 0x7fb75409c890 2023-09-30T22:25:19.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.306+0000 7fb750ff9700 1 -- 172.21.15.40:0/3892136946 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74400c640 con 0x7fb75409c890 2023-09-30T22:25:19.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.307+0000 7fb759b6b700 1 -- 172.21.15.40:0/3892136946 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7380052e0 con 0x7fb75409c890 2023-09-30T22:25:19.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.307+0000 7fb750ff9700 1 -- 172.21.15.40:0/3892136946 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb74400c7a0 con 0x7fb75409c890 2023-09-30T22:25:19.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.307+0000 7fb750ff9700 1 -- 172.21.15.40:0/3892136946 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7fb74403fc30 con 0x7fb75409c890 2023-09-30T22:25:19.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.307+0000 7fb74affd700 1 -- 172.21.15.40:0/3892136946 >> v1:172.21.15.40:6816/127432 conn(0x7fb73402f510 legacy=0x7fb7340319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:19.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.315+0000 7fb750ff9700 1 -- 172.21.15.40:0/3892136946 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb744011900 con 0x7fb75409c890 2023-09-30T22:25:19.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.335+0000 7fd3da82e700 1 Processor -- start 2023-09-30T22:25:19.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.335+0000 7fd3da82e700 1 -- start start 2023-09-30T22:25:19.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.335+0000 7fd3da82e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd3d409c890 0x7fd3d409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.335+0000 7fd3da82e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd3d409d920 0x7fd3d409dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.335+0000 7fd3da82e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3d40a2600 con 0x7fd3d409e2b0 2023-09-30T22:25:19.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.335+0000 7fd3da82e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3d40a29d0 con 0x7fd3d409c890 2023-09-30T22:25:19.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.335+0000 7fd3da82e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d409fb40 con 0x7fd3d409d920 2023-09-30T22:25:19.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.336+0000 7fd3d8dcb700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd3d409e2b0 0x7fd3d413ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:59870/0 (socket says 172.21.15.40:59870) 2023-09-30T22:25:19.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.336+0000 7fd3d3fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd3d409c890 0x7fd3d409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.336+0000 7fd3d8dcb700 1 -- 172.21.15.40:0/3274900685 learned_addr learned my addr 172.21.15.40:0/3274900685 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:19.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.336+0000 7fd3d37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd3d409d920 0x7fd3d409dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.336+0000 7fd3d3fff700 1 -- 172.21.15.40:0/3274900685 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd3d409d920 msgr2=0x7fd3d409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:19.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.336+0000 7fd3d3fff700 1 --2- 172.21.15.40:0/3274900685 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd3d409d920 0x7fd3d409dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.336+0000 7fd3d3fff700 1 -- 172.21.15.40:0/3274900685 >> v1:172.21.15.40:6789/0 conn(0x7fd3d409e2b0 legacy=0x7fd3d413ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.336+0000 7fd3d2ffd700 1 -- 172.21.15.40:0/3274900685 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 505008948 0 0) 0x7fd3d40a2600 con 0x7fd3d409e2b0 2023-09-30T22:25:19.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.336+0000 7fd3d3fff700 1 -- 172.21.15.40:0/3274900685 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d409e730 con 0x7fd3d409c890 2023-09-30T22:25:19.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.336+0000 7fd3d37fe700 1 --2- 172.21.15.40:0/3274900685 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd3d409d920 0x7fd3d409dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:19.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.336+0000 7fd3d3fff700 1 --2- 172.21.15.40:0/3274900685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3d409c890 0x7fd3d409cc60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4009820 tx=0x7fd3c4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e10276ea4d93d694 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:19.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.336+0000 7fd3d2ffd700 1 -- 172.21.15.40:0/3274900685 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c4005e30 con 0x7fd3d409c890 2023-09-30T22:25:19.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.336+0000 7fd3d2ffd700 1 -- 172.21.15.40:0/3274900685 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c4006030 con 0x7fd3d409c890 2023-09-30T22:25:19.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.336+0000 7fd3d2ffd700 1 -- 172.21.15.40:0/3274900685 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c40063c0 con 0x7fd3d409c890 2023-09-30T22:25:19.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.337+0000 7fd3da82e700 1 -- 172.21.15.40:0/3274900685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3d409c890 msgr2=0x7fd3d409cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.337+0000 7fd3da82e700 1 --2- 172.21.15.40:0/3274900685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3d409c890 0x7fd3d409cc60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4009820 tx=0x7fd3c4009b30 comp rx=0 tx=0).stop 2023-09-30T22:25:19.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.337+0000 7fd3da82e700 1 -- 172.21.15.40:0/3274900685 shutdown_connections 2023-09-30T22:25:19.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.337+0000 7fd3da82e700 1 --2- 172.21.15.40:0/3274900685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3d409c890 0x7fd3d409cc60 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.337+0000 7fd3da82e700 1 --2- 172.21.15.40:0/3274900685 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd3d409d920 0x7fd3d409dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.337+0000 7fd3da82e700 1 -- 172.21.15.40:0/3274900685 >> 172.21.15.40:0/3274900685 conn(0x7fd3d40a7080 msgr2=0x7fd3d40a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:19.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.337+0000 7fd3da82e700 1 -- 172.21.15.40:0/3274900685 shutdown_connections 2023-09-30T22:25:19.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.337+0000 7fd3da82e700 1 -- 172.21.15.40:0/3274900685 wait complete. 2023-09-30T22:25:19.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.338+0000 7fd3da82e700 1 Processor -- start 2023-09-30T22:25:19.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.338+0000 7fd3da82e700 1 -- start start 2023-09-30T22:25:19.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.339+0000 7fd3da82e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd3d409c890 0x7fd3d412d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.339+0000 7fd3da82e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3d409d920 0x7fd3d412d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.339+0000 7fd3da82e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3d409e2b0 0x7fd3d412dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.339+0000 7fd3da82e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d41305c0 con 0x7fd3d409e2b0 2023-09-30T22:25:19.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.339+0000 7fd3da82e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d412fae0 con 0x7fd3d409d920 2023-09-30T22:25:19.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.339+0000 7fd3da82e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d409ecf0 con 0x7fd3d409c890 2023-09-30T22:25:19.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.339+0000 7fd3d3fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd3d409c890 0x7fd3d412d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.339+0000 7fd3d8dcb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3d409e2b0 0x7fd3d412dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.339+0000 7fd3d37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3d409d920 0x7fd3d412d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.339+0000 7fd3d3fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd3d409c890 0x7fd3d412d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41238/0 (socket says 172.21.15.40:41238) 2023-09-30T22:25:19.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.339+0000 7fd3d3fff700 1 -- 172.21.15.40:0/3769181801 learned_addr learned my addr 172.21.15.40:0/3769181801 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:19.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.339+0000 7fd3d8dcb700 1 -- 172.21.15.40:0/3769181801 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd3d409c890 msgr2=0x7fd3d412d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.339+0000 7fd3d8dcb700 1 --2- 172.21.15.40:0/3769181801 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd3d409c890 0x7fd3d412d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.339+0000 7fd3d8dcb700 1 -- 172.21.15.40:0/3769181801 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3d409d920 msgr2=0x7fd3d412d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.339+0000 7fd3d8dcb700 1 --2- 172.21.15.40:0/3769181801 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3d409d920 0x7fd3d412d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.339+0000 7fd3d8dcb700 1 -- 172.21.15.40:0/3769181801 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c80094a0 con 0x7fd3d409e2b0 2023-09-30T22:25:19.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.339+0000 7fd3d8dcb700 1 --2- 172.21.15.40:0/3769181801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3d409e2b0 0x7fd3d412dbe0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc00cbe0 tx=0x7fd3cc00cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:19.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.339+0000 7fd3d0ff9700 1 -- 172.21.15.40:0/3769181801 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc00aa40 con 0x7fd3d409e2b0 2023-09-30T22:25:19.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.339+0000 7fd3d0ff9700 1 -- 172.21.15.40:0/3769181801 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3cc00abc0 con 0x7fd3d409e2b0 2023-09-30T22:25:19.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.339+0000 7fd3d0ff9700 1 -- 172.21.15.40:0/3769181801 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc0070d0 con 0x7fd3d409e2b0 2023-09-30T22:25:19.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.339+0000 7fd3da82e700 1 -- 172.21.15.40:0/3769181801 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c4009430 con 0x7fd3d409e2b0 2023-09-30T22:25:19.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.340+0000 7fd3da82e700 1 -- 172.21.15.40:0/3769181801 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d40a5bd0 con 0x7fd3d409e2b0 2023-09-30T22:25:19.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.340+0000 7fd3da82e700 1 -- 172.21.15.40:0/3769181801 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3d4130410 con 0x7fd3d409e2b0 2023-09-30T22:25:19.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.341+0000 7fd3d0ff9700 1 -- 172.21.15.40:0/3769181801 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd3cc007230 con 0x7fd3d409e2b0 2023-09-30T22:25:19.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.341+0000 7fd3d3fff700 1 -- 172.21.15.40:0/3769181801 >> v1:172.21.15.40:6816/127432 conn(0x7fd3c002f510 legacy=0x7fd3c00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:19.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.341+0000 7fd3d0ff9700 1 -- 172.21.15.40:0/3769181801 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7fd3cc03f580 con 0x7fd3d409e2b0 2023-09-30T22:25:19.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.345+0000 7fd3d0ff9700 1 -- 172.21.15.40:0/3769181801 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd3cc0074e0 con 0x7fd3d409e2b0 2023-09-30T22:25:19.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.404+0000 7ff5adfed700 1 -- 172.21.15.40:0/1275135884 >> v1:172.21.15.40:6816/127432 conn(0x7ff58c02f560 legacy=0x7ff58c031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:19.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.414+0000 7ff5b0251700 1 -- 172.21.15.40:0/1275135884 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff5a8132410 con 0x7ff5a806f980 2023-09-30T22:25:19.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.415+0000 7ff59e7fc700 1 -- 172.21.15.40:0/1275135884 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff5a8132410 con 0x7ff5a806f980 2023-09-30T22:25:19.415 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:19.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.417+0000 7ff5b0251700 1 -- 172.21.15.40:0/1275135884 >> v1:172.21.15.40:6816/127432 conn(0x7ff58c02f560 legacy=0x7ff58c031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:19.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.417+0000 7ff5b0251700 1 -- 172.21.15.40:0/1275135884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a806f980 msgr2=0x7ff5a806ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.417+0000 7ff5b0251700 1 --2- 172.21.15.40:0/1275135884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a806f980 0x7ff5a806ced0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff59800ebe0 tx=0x7ff59800eef0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.417+0000 7ff5b0251700 1 -- 172.21.15.40:0/1275135884 shutdown_connections 2023-09-30T22:25:19.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.417+0000 7ff5b0251700 1 --2- 172.21.15.40:0/1275135884 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff5a806fdb0 0x7ff5a806d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.417+0000 7ff5b0251700 1 --2- 172.21.15.40:0/1275135884 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5a806f070 0x7ff5a806c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.417+0000 7ff5b0251700 1 --2- 172.21.15.40:0/1275135884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a806f980 0x7ff5a806ced0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.417+0000 7ff5b0251700 1 -- 172.21.15.40:0/1275135884 >> 172.21.15.40:0/1275135884 conn(0x7ff5a80a41a0 msgr2=0x7ff5a8097530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:19.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.417+0000 7ff5b0251700 1 -- 172.21.15.40:0/1275135884 shutdown_connections 2023-09-30T22:25:19.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.417+0000 7ff5b0251700 1 -- 172.21.15.40:0/1275135884 wait complete. 2023-09-30T22:25:19.429 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:19.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.508+0000 7fb74affd700 1 -- 172.21.15.40:0/3892136946 >> v1:172.21.15.40:6816/127432 conn(0x7fb73402f510 legacy=0x7fb7340319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:19.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.512+0000 7fb759b6b700 1 -- 172.21.15.40:0/3892136946 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb738005860 con 0x7fb75409c890 2023-09-30T22:25:19.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.512+0000 7fb750ff9700 1 -- 172.21.15.40:0/3892136946 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb744017070 con 0x7fb75409c890 2023-09-30T22:25:19.513 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:19.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.514+0000 7fb759b6b700 1 -- 172.21.15.40:0/3892136946 >> v1:172.21.15.40:6816/127432 conn(0x7fb73402f510 legacy=0x7fb7340319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:19.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.514+0000 7fb759b6b700 1 -- 172.21.15.40:0/3892136946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb75409c890 msgr2=0x7fb75412d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.514+0000 7fb759b6b700 1 --2- 172.21.15.40:0/3892136946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb75409c890 0x7fb75412d0c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb74400e9b0 tx=0x7fb74400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.514+0000 7fb759b6b700 1 -- 172.21.15.40:0/3892136946 shutdown_connections 2023-09-30T22:25:19.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.514+0000 7fb759b6b700 1 --2- 172.21.15.40:0/3892136946 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb75409e2b0 0x7fb75412db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.514+0000 7fb759b6b700 1 --2- 172.21.15.40:0/3892136946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb75409c890 0x7fb75412d0c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.514+0000 7fb759b6b700 1 --2- 172.21.15.40:0/3892136946 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb75409d920 0x7fb75412d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.514+0000 7fb759b6b700 1 -- 172.21.15.40:0/3892136946 >> 172.21.15.40:0/3892136946 conn(0x7fb7540a7080 msgr2=0x7fb754132900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:19.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.515+0000 7fb759b6b700 1 -- 172.21.15.40:0/3892136946 shutdown_connections 2023-09-30T22:25:19.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.515+0000 7fb759b6b700 1 -- 172.21.15.40:0/3892136946 wait complete. 2023-09-30T22:25:19.528 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:19.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.542+0000 7fd3d3fff700 1 -- 172.21.15.40:0/3769181801 >> v1:172.21.15.40:6816/127432 conn(0x7fd3c002f510 legacy=0x7fd3c00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:19.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.544+0000 7fd3da82e700 1 -- 172.21.15.40:0/3769181801 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd3d4070610 con 0x7fd3d409e2b0 2023-09-30T22:25:19.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.544+0000 7fd3d0ff9700 1 -- 172.21.15.40:0/3769181801 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd3cc018030 con 0x7fd3d409e2b0 2023-09-30T22:25:19.545 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:19.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.546+0000 7fd3da82e700 1 -- 172.21.15.40:0/3769181801 >> v1:172.21.15.40:6816/127432 conn(0x7fd3c002f510 legacy=0x7fd3c00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:19.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.546+0000 7fd3da82e700 1 -- 172.21.15.40:0/3769181801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3d409e2b0 msgr2=0x7fd3d412dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.546+0000 7fd3da82e700 1 --2- 172.21.15.40:0/3769181801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3d409e2b0 0x7fd3d412dbe0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc00cbe0 tx=0x7fd3cc00cef0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.546+0000 7fd3da82e700 1 -- 172.21.15.40:0/3769181801 shutdown_connections 2023-09-30T22:25:19.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.546+0000 7fd3da82e700 1 --2- 172.21.15.40:0/3769181801 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd3d409c890 0x7fd3d412d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.546+0000 7fd3da82e700 1 --2- 172.21.15.40:0/3769181801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3d409e2b0 0x7fd3d412dbe0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.546+0000 7fd3da82e700 1 --2- 172.21.15.40:0/3769181801 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd3d409d920 0x7fd3d412d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.546+0000 7fd3da82e700 1 -- 172.21.15.40:0/3769181801 >> 172.21.15.40:0/3769181801 conn(0x7fd3d40a7080 msgr2=0x7fd3d4133210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:19.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.546+0000 7fd3da82e700 1 -- 172.21.15.40:0/3769181801 shutdown_connections 2023-09-30T22:25:19.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:19.546+0000 7fd3da82e700 1 -- 172.21.15.40:0/3769181801 wait complete. 2023-09-30T22:25:19.559 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:20.276 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:20.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.416+0000 7fbb17d10700 1 Processor -- start 2023-09-30T22:25:20.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.416+0000 7fbb17d10700 1 -- start start 2023-09-30T22:25:20.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.417+0000 7fbb17d10700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbb10134a90 0x7fbb10136e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.417+0000 7fbb17d10700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb101373b0 0x7fbb10139790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.417+0000 7fbb17d10700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb10131900 con 0x7fbb10131d50 2023-09-30T22:25:20.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.417+0000 7fbb17d10700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb100719e0 con 0x7fbb101373b0 2023-09-30T22:25:20.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.417+0000 7fbb17d10700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1009e820 con 0x7fbb10134a90 2023-09-30T22:25:20.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.417+0000 7fbb15aac700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbb10131d50 0x7fbb10132120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:59878/0 (socket says 172.21.15.40:59878) 2023-09-30T22:25:20.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.417+0000 7fbb152ab700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbb10134a90 0x7fbb10136e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.417+0000 7fbb15aac700 1 -- 172.21.15.40:0/1115274347 learned_addr learned my addr 172.21.15.40:0/1115274347 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:20.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.417+0000 7fbb162ad700 1 --2- 172.21.15.40:0/1115274347 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb101373b0 0x7fbb10139790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.417+0000 7fbb14aaa700 1 -- 172.21.15.40:0/1115274347 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 29960386 0 0) 0x7fbb10131900 con 0x7fbb10131d50 2023-09-30T22:25:20.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.417+0000 7fbb14aaa700 1 -- 172.21.15.40:0/1115274347 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbafc0035b0 con 0x7fbb10131d50 2023-09-30T22:25:20.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.417+0000 7fbb152ab700 1 -- 172.21.15.40:0/1115274347 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb101373b0 msgr2=0x7fbb10139790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:20.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.417+0000 7fbb152ab700 1 --2- 172.21.15.40:0/1115274347 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb101373b0 0x7fbb10139790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.417+0000 7fbb152ab700 1 -- 172.21.15.40:0/1115274347 >> v1:172.21.15.40:6789/0 conn(0x7fbb10131d50 legacy=0x7fbb10132120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.417+0000 7fbb152ab700 1 -- 172.21.15.40:0/1115274347 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb1009ef60 con 0x7fbb10134a90 2023-09-30T22:25:20.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.417+0000 7fbb162ad700 1 --2- 172.21.15.40:0/1115274347 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb101373b0 0x7fbb10139790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:20.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.418+0000 7fbb152ab700 1 --2- 172.21.15.40:0/1115274347 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbb10134a90 0x7fbb10136e70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbb00009870 tx=0x7fbb00009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c5c759762e8dfd0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:20.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.418+0000 7fbb14aaa700 1 -- 172.21.15.40:0/1115274347 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb00011830 con 0x7fbb10134a90 2023-09-30T22:25:20.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.418+0000 7fbb14aaa700 1 -- 172.21.15.40:0/1115274347 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb00011990 con 0x7fbb10134a90 2023-09-30T22:25:20.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.418+0000 7fbb14aaa700 1 -- 172.21.15.40:0/1115274347 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb00011d20 con 0x7fbb10134a90 2023-09-30T22:25:20.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.418+0000 7fbb17d10700 1 -- 172.21.15.40:0/1115274347 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbb10134a90 msgr2=0x7fbb10136e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.418+0000 7fbb17d10700 1 --2- 172.21.15.40:0/1115274347 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbb10134a90 0x7fbb10136e70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbb00009870 tx=0x7fbb00009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:20.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.418+0000 7fbb17d10700 1 -- 172.21.15.40:0/1115274347 shutdown_connections 2023-09-30T22:25:20.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.418+0000 7fbb17d10700 1 --2- 172.21.15.40:0/1115274347 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb101373b0 0x7fbb10139790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.418+0000 7fbb17d10700 1 --2- 172.21.15.40:0/1115274347 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbb10134a90 0x7fbb10136e70 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.418+0000 7fbb17d10700 1 -- 172.21.15.40:0/1115274347 >> 172.21.15.40:0/1115274347 conn(0x7fbb100a2a00 msgr2=0x7fbb100a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:20.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.418+0000 7fbb17d10700 1 -- 172.21.15.40:0/1115274347 shutdown_connections 2023-09-30T22:25:20.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.418+0000 7fbb17d10700 1 -- 172.21.15.40:0/1115274347 wait complete. 2023-09-30T22:25:20.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.420+0000 7fbb17d10700 1 Processor -- start 2023-09-30T22:25:20.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.420+0000 7fbb17d10700 1 -- start start 2023-09-30T22:25:20.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.420+0000 7fbb17d10700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbb10131d50 0x7fbb101190a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.420+0000 7fbb17d10700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb10134a90 0x7fbb101195e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.420+0000 7fbb17d10700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb101373b0 0x7fbb10119b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.420+0000 7fbb17d10700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1011cac0 con 0x7fbb101373b0 2023-09-30T22:25:20.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.420+0000 7fbb17d10700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb10137110 con 0x7fbb10134a90 2023-09-30T22:25:20.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.420+0000 7fbb17d10700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1011c520 con 0x7fbb10131d50 2023-09-30T22:25:20.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.421+0000 7fbb152ab700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb10134a90 0x7fbb101195e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.421+0000 7fbb152ab700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb10134a90 0x7fbb101195e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35376/0 (socket says 172.21.15.40:35376) 2023-09-30T22:25:20.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.421+0000 7fbb15aac700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbb10131d50 0x7fbb101190a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.421+0000 7fbb152ab700 1 -- 172.21.15.40:0/3741596256 learned_addr learned my addr 172.21.15.40:0/3741596256 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:20.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.421+0000 7fbb162ad700 1 --2- 172.21.15.40:0/3741596256 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb101373b0 0x7fbb10119b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.421+0000 7fbb152ab700 1 -- 172.21.15.40:0/3741596256 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbb10131d50 msgr2=0x7fbb101190a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.421+0000 7fbb152ab700 1 --2- 172.21.15.40:0/3741596256 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbb10131d50 0x7fbb101190a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.421+0000 7fbb152ab700 1 -- 172.21.15.40:0/3741596256 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb101373b0 msgr2=0x7fbb10119b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.421+0000 7fbb152ab700 1 --2- 172.21.15.40:0/3741596256 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb101373b0 0x7fbb10119b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.421+0000 7fbb152ab700 1 -- 172.21.15.40:0/3741596256 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb08009a70 con 0x7fbb10134a90 2023-09-30T22:25:20.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.421+0000 7fbb15aac700 1 --2- 172.21.15.40:0/3741596256 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbb10131d50 0x7fbb101190a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:20.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.421+0000 7fbb152ab700 1 --2- 172.21.15.40:0/3741596256 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb10134a90 0x7fbb101195e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbb00000c00 tx=0x7fbb00004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:20.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.421+0000 7fbb067fc700 1 -- 172.21.15.40:0/3741596256 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb00004450 con 0x7fbb10134a90 2023-09-30T22:25:20.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.421+0000 7fbb067fc700 1 -- 172.21.15.40:0/3741596256 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0001f070 con 0x7fbb10134a90 2023-09-30T22:25:20.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.421+0000 7fbb17d10700 1 -- 172.21.15.40:0/3741596256 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb000094a0 con 0x7fbb10134a90 2023-09-30T22:25:20.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.421+0000 7fbb067fc700 1 -- 172.21.15.40:0/3741596256 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb000038e0 con 0x7fbb10134a90 2023-09-30T22:25:20.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.421+0000 7fbb17d10700 1 -- 172.21.15.40:0/3741596256 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb1011b3a0 con 0x7fbb10134a90 2023-09-30T22:25:20.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.422+0000 7fbb067fc700 1 -- 172.21.15.40:0/3741596256 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fbb00003a40 con 0x7fbb10134a90 2023-09-30T22:25:20.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.422+0000 7fbb067fc700 1 -- 172.21.15.40:0/3741596256 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7fbb00021070 con 0x7fbb10134a90 2023-09-30T22:25:20.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.422+0000 7fbb15aac700 1 -- 172.21.15.40:0/3741596256 >> v1:172.21.15.40:6816/127432 conn(0x7fbaf402f510 legacy=0x7fbaf40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:20.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.422+0000 7fbb17d10700 1 -- 172.21.15.40:0/3741596256 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb1011c8f0 con 0x7fbb10134a90 2023-09-30T22:25:20.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.427+0000 7fbb067fc700 1 -- 172.21.15.40:0/3741596256 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbb0001a430 con 0x7fbb10134a90 2023-09-30T22:25:20.431 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:20.528 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:20.560 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:20.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.566+0000 7f5666fa9700 1 Processor -- start 2023-09-30T22:25:20.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.567+0000 7f5666fa9700 1 -- start start 2023-09-30T22:25:20.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.567+0000 7f5666fa9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f566009d450 0x7f566009d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.567+0000 7f5666fa9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f566009dd60 0x7f56601301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.567+0000 7f5666fa9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f566009c3b0 con 0x7f5660130700 2023-09-30T22:25:20.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.567+0000 7f5666fa9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f566009a6b0 con 0x7f566009d450 2023-09-30T22:25:20.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.567+0000 7f5666fa9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f566009b4f0 con 0x7f566009dd60 2023-09-30T22:25:20.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.568+0000 7f565ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f566009dd60 0x7f56601301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.568+0000 7f5665546700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5660130700 0x7f5660137410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:59886/0 (socket says 172.21.15.40:59886) 2023-09-30T22:25:20.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.568+0000 7f565ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f566009dd60 0x7f56601301c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41258/0 (socket says 172.21.15.40:41258) 2023-09-30T22:25:20.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.568+0000 7f5665546700 1 -- 172.21.15.40:0/2030340975 learned_addr learned my addr 172.21.15.40:0/2030340975 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:20.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.568+0000 7f5664d45700 1 --2- 172.21.15.40:0/2030340975 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f566009d450 0x7f566009d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.568+0000 7f565f7fe700 1 -- 172.21.15.40:0/2030340975 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2809100962 0 0) 0x7f566009c3b0 con 0x7f5660130700 2023-09-30T22:25:20.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.568+0000 7f565f7fe700 1 -- 172.21.15.40:0/2030340975 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56500035b0 con 0x7f5660130700 2023-09-30T22:25:20.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.568+0000 7f565ffff700 1 -- 172.21.15.40:0/2030340975 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f566009d450 msgr2=0x7f566009d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:20.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.568+0000 7f565ffff700 1 --2- 172.21.15.40:0/2030340975 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f566009d450 0x7f566009d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.568+0000 7f565ffff700 1 -- 172.21.15.40:0/2030340975 >> v1:172.21.15.40:6789/0 conn(0x7f5660130700 legacy=0x7f5660137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.568+0000 7f565ffff700 1 -- 172.21.15.40:0/2030340975 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566009af90 con 0x7f566009dd60 2023-09-30T22:25:20.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.568+0000 7f565ffff700 1 --2- 172.21.15.40:0/2030340975 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f566009dd60 0x7f56601301c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f564c009870 tx=0x7f564c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dff41584a394bda8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:20.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.568+0000 7f565f7fe700 1 -- 172.21.15.40:0/2030340975 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c011830 con 0x7f566009dd60 2023-09-30T22:25:20.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.568+0000 7f565f7fe700 1 -- 172.21.15.40:0/2030340975 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564c011990 con 0x7f566009dd60 2023-09-30T22:25:20.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.569+0000 7f565f7fe700 1 -- 172.21.15.40:0/2030340975 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c011d00 con 0x7f566009dd60 2023-09-30T22:25:20.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.569+0000 7f5666fa9700 1 -- 172.21.15.40:0/2030340975 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f566009dd60 msgr2=0x7f56601301c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.569+0000 7f5666fa9700 1 --2- 172.21.15.40:0/2030340975 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f566009dd60 0x7f56601301c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f564c009870 tx=0x7f564c009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:20.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.569+0000 7f5666fa9700 1 -- 172.21.15.40:0/2030340975 shutdown_connections 2023-09-30T22:25:20.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.569+0000 7f5666fa9700 1 --2- 172.21.15.40:0/2030340975 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f566009d450 0x7f566009d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.569+0000 7f5666fa9700 1 --2- 172.21.15.40:0/2030340975 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f566009dd60 0x7f56601301c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.569+0000 7f5666fa9700 1 -- 172.21.15.40:0/2030340975 >> 172.21.15.40:0/2030340975 conn(0x7f56600a2a00 msgr2=0x7f56600a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:20.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.570+0000 7f5666fa9700 1 -- 172.21.15.40:0/2030340975 shutdown_connections 2023-09-30T22:25:20.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.570+0000 7f5666fa9700 1 -- 172.21.15.40:0/2030340975 wait complete. 2023-09-30T22:25:20.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.570+0000 7f5666fa9700 1 Processor -- start 2023-09-30T22:25:20.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.571+0000 7f5666fa9700 1 -- start start 2023-09-30T22:25:20.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.571+0000 7f5666fa9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f566009d450 0x7f56601c3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.571+0000 7f5666fa9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f566009dd60 0x7f56601c4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.571+0000 7f5666fa9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5660130700 0x7f56601c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.571+0000 7f5666fa9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566011d0a0 con 0x7f566009dd60 2023-09-30T22:25:20.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.571+0000 7f5666fa9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f566011ce70 con 0x7f566009d450 2023-09-30T22:25:20.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.571+0000 7f5666fa9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f566011dae0 con 0x7f5660130700 2023-09-30T22:25:20.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.571+0000 7f565ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f566009dd60 0x7f56601c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.571+0000 7f565ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f566009dd60 0x7f56601c4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60754/0 (socket says 172.21.15.40:60754) 2023-09-30T22:25:20.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.571+0000 7f565ffff700 1 -- 172.21.15.40:0/3858467225 learned_addr learned my addr 172.21.15.40:0/3858467225 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:20.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.572+0000 7f5665546700 1 --2- 172.21.15.40:0/3858467225 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5660130700 0x7f56601c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.572+0000 7f5664d45700 1 --2- 172.21.15.40:0/3858467225 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f566009d450 0x7f56601c3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.572+0000 7f565ffff700 1 -- 172.21.15.40:0/3858467225 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5660130700 msgr2=0x7f56601c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.572+0000 7f565ffff700 1 --2- 172.21.15.40:0/3858467225 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5660130700 0x7f56601c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.572+0000 7f565ffff700 1 -- 172.21.15.40:0/3858467225 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f566009d450 msgr2=0x7f56601c3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.572+0000 7f565ffff700 1 --2- 172.21.15.40:0/3858467225 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f566009d450 0x7f56601c3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.572+0000 7f565ffff700 1 -- 172.21.15.40:0/3858467225 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564c0094a0 con 0x7f566009dd60 2023-09-30T22:25:20.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.572+0000 7f565ffff700 1 --2- 172.21.15.40:0/3858467225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f566009dd60 0x7f56601c4480 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f564c009bc0 tx=0x7f564c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:20.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.572+0000 7f565d7fa700 1 -- 172.21.15.40:0/3858467225 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c0042c0 con 0x7f566009dd60 2023-09-30T22:25:20.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.572+0000 7f5666fa9700 1 -- 172.21.15.40:0/3858467225 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f566011e7e0 con 0x7f566009dd60 2023-09-30T22:25:20.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.572+0000 7f5666fa9700 1 -- 172.21.15.40:0/3858467225 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f566011edf0 con 0x7f566009dd60 2023-09-30T22:25:20.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.573+0000 7f565d7fa700 1 -- 172.21.15.40:0/3858467225 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564c01f070 con 0x7f566009dd60 2023-09-30T22:25:20.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.573+0000 7f565d7fa700 1 -- 172.21.15.40:0/3858467225 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c0036a0 con 0x7f566009dd60 2023-09-30T22:25:20.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.574+0000 7f565d7fa700 1 -- 172.21.15.40:0/3858467225 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f564c021030 con 0x7f566009dd60 2023-09-30T22:25:20.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.574+0000 7f5666fa9700 1 -- 172.21.15.40:0/3858467225 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56400052e0 con 0x7f566009dd60 2023-09-30T22:25:20.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.574+0000 7f565d7fa700 1 -- 172.21.15.40:0/3858467225 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f564c040e60 con 0x7f566009dd60 2023-09-30T22:25:20.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.574+0000 7f5664d45700 1 -- 172.21.15.40:0/3858467225 >> v1:172.21.15.40:6816/127432 conn(0x7f564402f510 legacy=0x7f56440319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:20.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.579+0000 7f565d7fa700 1 -- 172.21.15.40:0/3858467225 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f564c0239c0 con 0x7f566009dd60 2023-09-30T22:25:20.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.623+0000 7fbb15aac700 1 -- 172.21.15.40:0/3741596256 >> v1:172.21.15.40:6816/127432 conn(0x7fbaf402f510 legacy=0x7fbaf40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:20.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.639+0000 7fbb17d10700 1 -- 172.21.15.40:0/3741596256 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbb1012ee90 con 0x7fbb10134a90 2023-09-30T22:25:20.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.640+0000 7fbb067fc700 1 -- 172.21.15.40:0/3741596256 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbb00015030 con 0x7fbb10134a90 2023-09-30T22:25:20.640 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:20.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.642+0000 7fbb17d10700 1 -- 172.21.15.40:0/3741596256 >> v1:172.21.15.40:6816/127432 conn(0x7fbaf402f510 legacy=0x7fbaf40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:20.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.642+0000 7fbb17d10700 1 -- 172.21.15.40:0/3741596256 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb10134a90 msgr2=0x7fbb101195e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.642+0000 7fbb17d10700 1 --2- 172.21.15.40:0/3741596256 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb10134a90 0x7fbb101195e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbb00000c00 tx=0x7fbb00004750 comp rx=0 tx=0).stop 2023-09-30T22:25:20.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.642+0000 7fbb17d10700 1 -- 172.21.15.40:0/3741596256 shutdown_connections 2023-09-30T22:25:20.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.642+0000 7fbb17d10700 1 --2- 172.21.15.40:0/3741596256 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbb10131d50 0x7fbb101190a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.642+0000 7fbb17d10700 1 --2- 172.21.15.40:0/3741596256 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb101373b0 0x7fbb10119b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.642+0000 7fbb17d10700 1 --2- 172.21.15.40:0/3741596256 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb10134a90 0x7fbb101195e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.642+0000 7fbb17d10700 1 -- 172.21.15.40:0/3741596256 >> 172.21.15.40:0/3741596256 conn(0x7fbb100a2a00 msgr2=0x7fbb10134e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:20.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.642+0000 7fbb17d10700 1 -- 172.21.15.40:0/3741596256 shutdown_connections 2023-09-30T22:25:20.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.642+0000 7fbb17d10700 1 -- 172.21.15.40:0/3741596256 wait complete. 2023-09-30T22:25:20.661 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:20.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.689+0000 7f7f1f59e700 1 Processor -- start 2023-09-30T22:25:20.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.689+0000 7f7f1f59e700 1 -- start start 2023-09-30T22:25:20.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.690+0000 7f7f1f59e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7f2009e850 0x7f7f2009ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.690+0000 7f7f1f59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f2009f160 0x7f7f20131730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.690+0000 7f7f1f59e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f2009f550 0x7f7f20131c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.690+0000 7f7f1f59e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f200a0180 con 0x7f7f2009e850 2023-09-30T22:25:20.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.690+0000 7f7f1f59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2009ac70 con 0x7f7f2009f160 2023-09-30T22:25:20.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.690+0000 7f7f1f59e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2009bc20 con 0x7f7f2009f550 2023-09-30T22:25:20.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.690+0000 7f7f1dd9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f2009f160 0x7f7f20131730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.690+0000 7f7f1e59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7f2009e850 0x7f7f2009ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.690+0000 7f7f1e59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7f2009e850 0x7f7f2009ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60764/0 (socket says 172.21.15.40:60764) 2023-09-30T22:25:20.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.690+0000 7f7f1dd9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f2009f160 0x7f7f20131730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35410/0 (socket says 172.21.15.40:35410) 2023-09-30T22:25:20.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.690+0000 7f7f1e59c700 1 -- 172.21.15.40:0/896946256 learned_addr learned my addr 172.21.15.40:0/896946256 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:20.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.690+0000 7f7f1ed9d700 1 --2- 172.21.15.40:0/896946256 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f2009f550 0x7f7f20131c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.690+0000 7f7f1e59c700 1 -- 172.21.15.40:0/896946256 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f2009f550 msgr2=0x7f7f20131c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:20.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.690+0000 7f7f1e59c700 1 --2- 172.21.15.40:0/896946256 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f2009f550 0x7f7f20131c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.690+0000 7f7f1e59c700 1 -- 172.21.15.40:0/896946256 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f2009f160 msgr2=0x7f7f20131730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:20.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.690+0000 7f7f1e59c700 1 --2- 172.21.15.40:0/896946256 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f2009f160 0x7f7f20131730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.690+0000 7f7f1e59c700 1 -- 172.21.15.40:0/896946256 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2009b680 con 0x7f7f2009e850 2023-09-30T22:25:20.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.690+0000 7f7f1e59c700 1 --2- 172.21.15.40:0/896946256 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f2009e850 0x7f7f2009ec20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7f100098f0 tx=0x7f7f10009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d19821956f3fd8e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:20.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.691+0000 7f7f1d59a700 1 -- 172.21.15.40:0/896946256 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f10011830 con 0x7f7f2009e850 2023-09-30T22:25:20.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.691+0000 7f7f1d59a700 1 -- 172.21.15.40:0/896946256 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f10011990 con 0x7f7f2009e850 2023-09-30T22:25:20.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.691+0000 7f7f1d59a700 1 -- 172.21.15.40:0/896946256 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f10011d20 con 0x7f7f2009e850 2023-09-30T22:25:20.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.691+0000 7f7f1f59e700 1 -- 172.21.15.40:0/896946256 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f2009e850 msgr2=0x7f7f2009ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.691+0000 7f7f1f59e700 1 --2- 172.21.15.40:0/896946256 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f2009e850 0x7f7f2009ec20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7f100098f0 tx=0x7f7f10009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:20.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.691+0000 7f7f1f59e700 1 -- 172.21.15.40:0/896946256 shutdown_connections 2023-09-30T22:25:20.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.691+0000 7f7f1f59e700 1 --2- 172.21.15.40:0/896946256 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f2009f550 0x7f7f20131c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.691+0000 7f7f1f59e700 1 --2- 172.21.15.40:0/896946256 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f2009e850 0x7f7f2009ec20 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.691+0000 7f7f1f59e700 1 --2- 172.21.15.40:0/896946256 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f2009f160 0x7f7f20131730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.691+0000 7f7f1f59e700 1 -- 172.21.15.40:0/896946256 >> 172.21.15.40:0/896946256 conn(0x7f7f200a4130 msgr2=0x7f7f200a4500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:20.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.691+0000 7f7f1f59e700 1 -- 172.21.15.40:0/896946256 shutdown_connections 2023-09-30T22:25:20.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.691+0000 7f7f1f59e700 1 -- 172.21.15.40:0/896946256 wait complete. 2023-09-30T22:25:20.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.692+0000 7f7f1f59e700 1 Processor -- start 2023-09-30T22:25:20.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.693+0000 7f7f1f59e700 1 -- start start 2023-09-30T22:25:20.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.693+0000 7f7f1f59e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f2009e850 0x7f7f201c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.693+0000 7f7f1f59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f2009f160 0x7f7f201c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.693+0000 7f7f1f59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f2009f550 0x7f7f201c6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.693+0000 7f7f1f59e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f20122420 con 0x7f7f2009f550 2023-09-30T22:25:20.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.693+0000 7f7f1f59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f200a2f80 con 0x7f7f2009f160 2023-09-30T22:25:20.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.693+0000 7f7f1f59e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f20120da0 con 0x7f7f2009e850 2023-09-30T22:25:20.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.693+0000 7f7f1e59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f2009e850 0x7f7f201c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.693+0000 7f7f1e59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f2009e850 0x7f7f201c5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41278/0 (socket says 172.21.15.40:41278) 2023-09-30T22:25:20.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.693+0000 7f7f1e59c700 1 -- 172.21.15.40:0/382325629 learned_addr learned my addr 172.21.15.40:0/382325629 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:20.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.693+0000 7f7f1dd9b700 1 --2- 172.21.15.40:0/382325629 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f2009f160 0x7f7f201c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.693+0000 7f7f1ed9d700 1 --2- 172.21.15.40:0/382325629 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f2009f550 0x7f7f201c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.693+0000 7f7f1e59c700 1 -- 172.21.15.40:0/382325629 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f2009f160 msgr2=0x7f7f201c62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.693+0000 7f7f1e59c700 1 --2- 172.21.15.40:0/382325629 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f2009f160 0x7f7f201c62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.693+0000 7f7f1e59c700 1 -- 172.21.15.40:0/382325629 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f2009f550 msgr2=0x7f7f201c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.693+0000 7f7f1e59c700 1 --2- 172.21.15.40:0/382325629 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f2009f550 0x7f7f201c6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.693+0000 7f7f1e59c700 1 -- 172.21.15.40:0/382325629 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f10009550 con 0x7f7f2009e850 2023-09-30T22:25:20.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.694+0000 7f7f1e59c700 1 --2- 172.21.15.40:0/382325629 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f2009e850 0x7f7f201c5db0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7f10000c00 tx=0x7f7f10004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:20.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.694+0000 7f7f0effd700 1 -- 172.21.15.40:0/382325629 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f10004450 con 0x7f7f2009e850 2023-09-30T22:25:20.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.694+0000 7f7f0effd700 1 -- 172.21.15.40:0/382325629 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f100045b0 con 0x7f7f2009e850 2023-09-30T22:25:20.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.694+0000 7f7f1f59e700 1 -- 172.21.15.40:0/382325629 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f2009da30 con 0x7f7f2009e850 2023-09-30T22:25:20.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.694+0000 7f7f0effd700 1 -- 172.21.15.40:0/382325629 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f100038e0 con 0x7f7f2009e850 2023-09-30T22:25:20.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.694+0000 7f7f1f59e700 1 -- 172.21.15.40:0/382325629 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f2011f1c0 con 0x7f7f2009e850 2023-09-30T22:25:20.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.695+0000 7f7f0effd700 1 -- 172.21.15.40:0/382325629 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7f10021070 con 0x7f7f2009e850 2023-09-30T22:25:20.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.695+0000 7f7f1dd9b700 1 -- 172.21.15.40:0/382325629 >> v1:172.21.15.40:6816/127432 conn(0x7f7f0002f510 legacy=0x7f7f000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:20.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.695+0000 7f7f0effd700 1 -- 172.21.15.40:0/382325629 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f7f10040e40 con 0x7f7f2009e850 2023-09-30T22:25:20.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.695+0000 7f7f1f59e700 1 -- 172.21.15.40:0/382325629 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f20062380 con 0x7f7f2009e850 2023-09-30T22:25:20.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.700+0000 7f7f0effd700 1 -- 172.21.15.40:0/382325629 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7f10029080 con 0x7f7f2009e850 2023-09-30T22:25:20.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.703+0000 7fe9324d8700 1 Processor -- start 2023-09-30T22:25:20.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.703+0000 7fe9324d8700 1 -- start start 2023-09-30T22:25:20.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.703+0000 7fe9324d8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe92c06a6d0 0x7fe92c06aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.703+0000 7fe9324d8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe92c06afe0 0x7fe92c1318b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.704+0000 7fe9324d8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe92c09eb60 con 0x7fe92c131df0 2023-09-30T22:25:20.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.704+0000 7fe9324d8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c09db70 con 0x7fe92c06afe0 2023-09-30T22:25:20.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.704+0000 7fe9324d8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c09ddf0 con 0x7fe92c06a6d0 2023-09-30T22:25:20.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.704+0000 7fe92bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe92c06a6d0 0x7fe92c06aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.704+0000 7fe930a75700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe92c131df0 0x7fe92c138b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:59892/0 (socket says 172.21.15.40:59892) 2023-09-30T22:25:20.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.704+0000 7fe930a75700 1 -- 172.21.15.40:0/2032470012 learned_addr learned my addr 172.21.15.40:0/2032470012 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:20.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.704+0000 7fe92b7fe700 1 --2- 172.21.15.40:0/2032470012 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe92c06afe0 0x7fe92c1318b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.704+0000 7fe92bfff700 1 -- 172.21.15.40:0/2032470012 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe92c06afe0 msgr2=0x7fe92c1318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:20.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.704+0000 7fe92bfff700 1 --2- 172.21.15.40:0/2032470012 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe92c06afe0 0x7fe92c1318b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.704+0000 7fe92bfff700 1 -- 172.21.15.40:0/2032470012 >> v1:172.21.15.40:6789/0 conn(0x7fe92c131df0 legacy=0x7fe92c138b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.704+0000 7fe92bfff700 1 -- 172.21.15.40:0/2032470012 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92c09c9a0 con 0x7fe92c06a6d0 2023-09-30T22:25:20.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.704+0000 7fe92b7fe700 1 --2- 172.21.15.40:0/2032470012 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe92c06afe0 0x7fe92c1318b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:20.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.704+0000 7fe92affd700 1 -- 172.21.15.40:0/2032470012 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2897304902 0 0) 0x7fe92c09eb60 con 0x7fe92c131df0 2023-09-30T22:25:20.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.704+0000 7fe92bfff700 1 --2- 172.21.15.40:0/2032470012 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe92c06a6d0 0x7fe92c06aaa0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe91c009850 tx=0x7fe91c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94d55f01354d9f25 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:20.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.704+0000 7fe92affd700 1 -- 172.21.15.40:0/2032470012 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c005e30 con 0x7fe92c06a6d0 2023-09-30T22:25:20.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.704+0000 7fe92affd700 1 -- 172.21.15.40:0/2032470012 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91c006030 con 0x7fe92c06a6d0 2023-09-30T22:25:20.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.704+0000 7fe92affd700 1 -- 172.21.15.40:0/2032470012 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c0063e0 con 0x7fe92c06a6d0 2023-09-30T22:25:20.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.705+0000 7fe9324d8700 1 -- 172.21.15.40:0/2032470012 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe92c06a6d0 msgr2=0x7fe92c06aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.705+0000 7fe9324d8700 1 --2- 172.21.15.40:0/2032470012 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe92c06a6d0 0x7fe92c06aaa0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe91c009850 tx=0x7fe91c009b60 comp rx=0 tx=0).stop 2023-09-30T22:25:20.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.705+0000 7fe9324d8700 1 -- 172.21.15.40:0/2032470012 shutdown_connections 2023-09-30T22:25:20.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.705+0000 7fe9324d8700 1 --2- 172.21.15.40:0/2032470012 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe92c06a6d0 0x7fe92c06aaa0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.705+0000 7fe9324d8700 1 --2- 172.21.15.40:0/2032470012 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe92c06afe0 0x7fe92c1318b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.705+0000 7fe9324d8700 1 -- 172.21.15.40:0/2032470012 >> 172.21.15.40:0/2032470012 conn(0x7fe92c09fb20 msgr2=0x7fe92c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:20.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.705+0000 7fe9324d8700 1 -- 172.21.15.40:0/2032470012 shutdown_connections 2023-09-30T22:25:20.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.705+0000 7fe9324d8700 1 -- 172.21.15.40:0/2032470012 wait complete. 2023-09-30T22:25:20.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.706+0000 7fe9324d8700 1 Processor -- start 2023-09-30T22:25:20.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.706+0000 7fe9324d8700 1 -- start start 2023-09-30T22:25:20.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.707+0000 7fe9324d8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe92c06a6d0 0x7fe92c11e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.707+0000 7fe9324d8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe92c06afe0 0x7fe92c11eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.707+0000 7fe9324d8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe92c131df0 0x7fe92c11f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.707+0000 7fe9324d8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c0715d0 con 0x7fe92c131df0 2023-09-30T22:25:20.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.707+0000 7fe9324d8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c120370 con 0x7fe92c06a6d0 2023-09-30T22:25:20.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.707+0000 7fe9324d8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c121e90 con 0x7fe92c06afe0 2023-09-30T22:25:20.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.707+0000 7fe92b7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe92c06afe0 0x7fe92c11eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.707+0000 7fe92b7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe92c06afe0 0x7fe92c11eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41302/0 (socket says 172.21.15.40:41302) 2023-09-30T22:25:20.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.707+0000 7fe930a75700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe92c131df0 0x7fe92c11f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.707+0000 7fe92b7fe700 1 -- 172.21.15.40:0/2152180383 learned_addr learned my addr 172.21.15.40:0/2152180383 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:20.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.707+0000 7fe92bfff700 1 --2- 172.21.15.40:0/2152180383 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe92c06a6d0 0x7fe92c11e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.707+0000 7fe92b7fe700 1 -- 172.21.15.40:0/2152180383 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe92c06a6d0 msgr2=0x7fe92c11e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.707+0000 7fe92b7fe700 1 --2- 172.21.15.40:0/2152180383 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe92c06a6d0 0x7fe92c11e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.707+0000 7fe92b7fe700 1 -- 172.21.15.40:0/2152180383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe92c131df0 msgr2=0x7fe92c11f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.707+0000 7fe92b7fe700 1 --2- 172.21.15.40:0/2152180383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe92c131df0 0x7fe92c11f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.707+0000 7fe92b7fe700 1 -- 172.21.15.40:0/2152180383 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92000f610 con 0x7fe92c06afe0 2023-09-30T22:25:20.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.707+0000 7fe930a75700 1 --2- 172.21.15.40:0/2152180383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe92c131df0 0x7fe92c11f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:20.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.707+0000 7fe92b7fe700 1 --2- 172.21.15.40:0/2152180383 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe92c06afe0 0x7fe92c11eb90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe920009d40 tx=0x7fe9200133b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:20.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.708+0000 7fe928ff9700 1 -- 172.21.15.40:0/2152180383 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe920013d20 con 0x7fe92c06afe0 2023-09-30T22:25:20.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.708+0000 7fe928ff9700 1 -- 172.21.15.40:0/2152180383 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe920015040 con 0x7fe92c06afe0 2023-09-30T22:25:20.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.708+0000 7fe9324d8700 1 -- 172.21.15.40:0/2152180383 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe91c009430 con 0x7fe92c06afe0 2023-09-30T22:25:20.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.708+0000 7fe928ff9700 1 -- 172.21.15.40:0/2152180383 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92001b640 con 0x7fe92c06afe0 2023-09-30T22:25:20.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.708+0000 7fe9324d8700 1 -- 172.21.15.40:0/2152180383 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe92c09e420 con 0x7fe92c06afe0 2023-09-30T22:25:20.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.708+0000 7fe928ff9700 1 -- 172.21.15.40:0/2152180383 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe92001b7a0 con 0x7fe92c06afe0 2023-09-30T22:25:20.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.709+0000 7fe928ff9700 1 -- 172.21.15.40:0/2152180383 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7fe920043c30 con 0x7fe92c06afe0 2023-09-30T22:25:20.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.709+0000 7fe92bfff700 1 -- 172.21.15.40:0/2152180383 >> v1:172.21.15.40:6816/127432 conn(0x7fe91802f510 legacy=0x7fe9180319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:20.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.709+0000 7fe9324d8700 1 -- 172.21.15.40:0/2152180383 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe92c09e260 con 0x7fe92c06afe0 2023-09-30T22:25:20.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.714+0000 7fe928ff9700 1 -- 172.21.15.40:0/2152180383 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe920020070 con 0x7fe92c06afe0 2023-09-30T22:25:20.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.775+0000 7f5664d45700 1 -- 172.21.15.40:0/3858467225 >> v1:172.21.15.40:6816/127432 conn(0x7f564402f510 legacy=0x7f56440319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:20.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.812+0000 7f5666fa9700 1 -- 172.21.15.40:0/3858467225 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5640005860 con 0x7f566009dd60 2023-09-30T22:25:20.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.812+0000 7f565d7fa700 1 -- 172.21.15.40:0/3858467225 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f564c015020 con 0x7f566009dd60 2023-09-30T22:25:20.813 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:20.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.814+0000 7f5666fa9700 1 -- 172.21.15.40:0/3858467225 >> v1:172.21.15.40:6816/127432 conn(0x7f564402f510 legacy=0x7f56440319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:20.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.814+0000 7f5666fa9700 1 -- 172.21.15.40:0/3858467225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f566009dd60 msgr2=0x7f56601c4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.814+0000 7f5666fa9700 1 --2- 172.21.15.40:0/3858467225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f566009dd60 0x7f56601c4480 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f564c009bc0 tx=0x7f564c004750 comp rx=0 tx=0).stop 2023-09-30T22:25:20.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.814+0000 7f5666fa9700 1 -- 172.21.15.40:0/3858467225 shutdown_connections 2023-09-30T22:25:20.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.814+0000 7f5666fa9700 1 --2- 172.21.15.40:0/3858467225 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5660130700 0x7f56601c49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.814+0000 7f5666fa9700 1 --2- 172.21.15.40:0/3858467225 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f566009d450 0x7f56601c3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.814+0000 7f5666fa9700 1 --2- 172.21.15.40:0/3858467225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f566009dd60 0x7f56601c4480 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.814+0000 7f5666fa9700 1 -- 172.21.15.40:0/3858467225 >> 172.21.15.40:0/3858467225 conn(0x7f56600a2a00 msgr2=0x7f56601b7ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:20.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.815+0000 7f5666fa9700 1 -- 172.21.15.40:0/3858467225 shutdown_connections 2023-09-30T22:25:20.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.815+0000 7f5666fa9700 1 -- 172.21.15.40:0/3858467225 wait complete. 2023-09-30T22:25:20.827 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:20.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.896+0000 7f7f1dd9b700 1 -- 172.21.15.40:0/382325629 >> v1:172.21.15.40:6816/127432 conn(0x7f7f0002f510 legacy=0x7f7f000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:20.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.900+0000 7f7f1f59e700 1 -- 172.21.15.40:0/382325629 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7f2009b8a0 con 0x7f7f2009e850 2023-09-30T22:25:20.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.901+0000 7f7f0effd700 1 -- 172.21.15.40:0/382325629 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7f10015020 con 0x7f7f2009e850 2023-09-30T22:25:20.901 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:20.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.903+0000 7f7f1f59e700 1 -- 172.21.15.40:0/382325629 >> v1:172.21.15.40:6816/127432 conn(0x7f7f0002f510 legacy=0x7f7f000319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:20.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.903+0000 7f7f1f59e700 1 -- 172.21.15.40:0/382325629 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f2009e850 msgr2=0x7f7f201c5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.903+0000 7f7f1f59e700 1 --2- 172.21.15.40:0/382325629 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f2009e850 0x7f7f201c5db0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7f10000c00 tx=0x7f7f10004750 comp rx=0 tx=0).stop 2023-09-30T22:25:20.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.903+0000 7f7f1f59e700 1 -- 172.21.15.40:0/382325629 shutdown_connections 2023-09-30T22:25:20.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.903+0000 7f7f1f59e700 1 --2- 172.21.15.40:0/382325629 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f2009e850 0x7f7f201c5db0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.903+0000 7f7f1f59e700 1 --2- 172.21.15.40:0/382325629 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f2009f550 0x7f7f201c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.903+0000 7f7f1f59e700 1 --2- 172.21.15.40:0/382325629 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f2009f160 0x7f7f201c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.903+0000 7f7f1f59e700 1 -- 172.21.15.40:0/382325629 >> 172.21.15.40:0/382325629 conn(0x7f7f200a4130 msgr2=0x7f7f201b8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:20.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.903+0000 7f7f1f59e700 1 -- 172.21.15.40:0/382325629 shutdown_connections 2023-09-30T22:25:20.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.903+0000 7f7f1f59e700 1 -- 172.21.15.40:0/382325629 wait complete. 2023-09-30T22:25:20.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.910+0000 7fe92bfff700 1 -- 172.21.15.40:0/2152180383 >> v1:172.21.15.40:6816/127432 conn(0x7fe91802f510 legacy=0x7fe9180319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:20.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.911+0000 7fe9324d8700 1 -- 172.21.15.40:0/2152180383 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe92c062380 con 0x7fe92c06afe0 2023-09-30T22:25:20.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.911+0000 7fe928ff9700 1 -- 172.21.15.40:0/2152180383 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe920009e30 con 0x7fe92c06afe0 2023-09-30T22:25:20.912 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:20.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.914+0000 7fe9324d8700 1 -- 172.21.15.40:0/2152180383 >> v1:172.21.15.40:6816/127432 conn(0x7fe91802f510 legacy=0x7fe9180319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:20.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.914+0000 7fe9324d8700 1 -- 172.21.15.40:0/2152180383 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe92c06afe0 msgr2=0x7fe92c11eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.914+0000 7fe9324d8700 1 --2- 172.21.15.40:0/2152180383 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe92c06afe0 0x7fe92c11eb90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe920009d40 tx=0x7fe9200133b0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.914+0000 7fe9324d8700 1 -- 172.21.15.40:0/2152180383 shutdown_connections 2023-09-30T22:25:20.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.914+0000 7fe9324d8700 1 --2- 172.21.15.40:0/2152180383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe92c131df0 0x7fe92c11f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.914+0000 7fe9324d8700 1 --2- 172.21.15.40:0/2152180383 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe92c06a6d0 0x7fe92c11e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.914+0000 7fe9324d8700 1 --2- 172.21.15.40:0/2152180383 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe92c06afe0 0x7fe92c11eb90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.914+0000 7fe9324d8700 1 -- 172.21.15.40:0/2152180383 >> 172.21.15.40:0/2152180383 conn(0x7fe92c09fb20 msgr2=0x7fe92c06e180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:20.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.914+0000 7fe9324d8700 1 -- 172.21.15.40:0/2152180383 shutdown_connections 2023-09-30T22:25:20.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:20.914+0000 7fe9324d8700 1 -- 172.21.15.40:0/2152180383 wait complete. 2023-09-30T22:25:20.916 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:20.927 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:21.661 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:21.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.803+0000 7f62c3a11700 1 Processor -- start 2023-09-30T22:25:21.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.803+0000 7f62c3a11700 1 -- start start 2023-09-30T22:25:21.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.804+0000 7f62c3a11700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f62bc09c890 0x7f62bc09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:21.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.804+0000 7f62c3a11700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62bc09e480 0x7f62bc13bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:21.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.804+0000 7f62c3a11700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62bc0a2600 con 0x7f62bc09d920 2023-09-30T22:25:21.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.804+0000 7f62c3a11700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62bc0a29d0 con 0x7f62bc09c890 2023-09-30T22:25:21.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.804+0000 7f62c3a11700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc09fb40 con 0x7f62bc09e480 2023-09-30T22:25:21.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.804+0000 7f62c17ad700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f62bc09c890 0x7f62bc09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:21.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.804+0000 7f62c1fae700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62bc09e480 0x7f62bc13bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:21.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.804+0000 7f62c1fae700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62bc09e480 0x7f62bc13bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41308/0 (socket says 172.21.15.40:41308) 2023-09-30T22:25:21.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.804+0000 7f62c17ad700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f62bc09c890 0x7f62bc09cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60786/0 (socket says 172.21.15.40:60786) 2023-09-30T22:25:21.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.804+0000 7f62c1fae700 1 -- 172.21.15.40:0/1193787336 learned_addr learned my addr 172.21.15.40:0/1193787336 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:21.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.804+0000 7f62c1fae700 1 -- 172.21.15.40:0/1193787336 >> v2:172.21.15.40:3300/0 conn(0x7f62bc09c890 msgr2=0x7f62bc09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:21.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.804+0000 7f62c1fae700 1 --2- 172.21.15.40:0/1193787336 >> v2:172.21.15.40:3300/0 conn(0x7f62bc09c890 0x7f62bc09cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.804+0000 7f62c1fae700 1 -- 172.21.15.40:0/1193787336 >> v1:172.21.15.40:6789/0 conn(0x7f62bc09d920 legacy=0x7f62bc09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:21.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.804+0000 7f62c1fae700 1 -- 172.21.15.40:0/1193787336 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc09fed0 con 0x7f62bc09e480 2023-09-30T22:25:21.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.804+0000 7f62c17ad700 1 --2- 172.21.15.40:0/1193787336 >> v2:172.21.15.40:3300/0 conn(0x7f62bc09c890 0x7f62bc09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:21.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.804+0000 7f62c1fae700 1 --2- 172.21.15.40:0/1193787336 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62bc09e480 0x7f62bc13bc20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f62b4009e50 tx=0x7f62b400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e331283953ce86a7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:21.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.805+0000 7f62b3fff700 1 -- 172.21.15.40:0/1193787336 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b400e070 con 0x7f62bc09e480 2023-09-30T22:25:21.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.805+0000 7f62b3fff700 1 -- 172.21.15.40:0/1193787336 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b400b910 con 0x7f62bc09e480 2023-09-30T22:25:21.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.805+0000 7f62b3fff700 1 -- 172.21.15.40:0/1193787336 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b400bcc0 con 0x7f62bc09e480 2023-09-30T22:25:21.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.805+0000 7f62c3a11700 1 -- 172.21.15.40:0/1193787336 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62bc09e480 msgr2=0x7f62bc13bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:21.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.805+0000 7f62c3a11700 1 --2- 172.21.15.40:0/1193787336 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62bc09e480 0x7f62bc13bc20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f62b4009e50 tx=0x7f62b400b330 comp rx=0 tx=0).stop 2023-09-30T22:25:21.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.805+0000 7f62c3a11700 1 -- 172.21.15.40:0/1193787336 shutdown_connections 2023-09-30T22:25:21.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.805+0000 7f62c3a11700 1 --2- 172.21.15.40:0/1193787336 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62bc09e480 0x7f62bc13bc20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.805+0000 7f62c3a11700 1 --2- 172.21.15.40:0/1193787336 >> v2:172.21.15.40:3300/0 conn(0x7f62bc09c890 0x7f62bc09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.805+0000 7f62c3a11700 1 -- 172.21.15.40:0/1193787336 >> 172.21.15.40:0/1193787336 conn(0x7f62bc0a7080 msgr2=0x7f62bc0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:21.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.805+0000 7f62c3a11700 1 -- 172.21.15.40:0/1193787336 shutdown_connections 2023-09-30T22:25:21.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.805+0000 7f62c3a11700 1 -- 172.21.15.40:0/1193787336 wait complete. 2023-09-30T22:25:21.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.806+0000 7f62c3a11700 1 Processor -- start 2023-09-30T22:25:21.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.807+0000 7f62c3a11700 1 -- start start 2023-09-30T22:25:21.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.807+0000 7f62c3a11700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62bc09c890 0x7f62bc12d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:21.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.807+0000 7f62c3a11700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62bc09d920 0x7f62bc12d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:21.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.807+0000 7f62c3a11700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62bc09e480 0x7f62bc12de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:21.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.807+0000 7f62c3a11700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc12ee40 con 0x7f62bc09e480 2023-09-30T22:25:21.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.807+0000 7f62c3a11700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc12ec50 con 0x7f62bc09d920 2023-09-30T22:25:21.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.807+0000 7f62c3a11700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc12f520 con 0x7f62bc09c890 2023-09-30T22:25:21.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.807+0000 7f62c17ad700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62bc09c890 0x7f62bc12d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:21.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.807+0000 7f62c17ad700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62bc09c890 0x7f62bc12d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41314/0 (socket says 172.21.15.40:41314) 2023-09-30T22:25:21.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.807+0000 7f62c17ad700 1 -- 172.21.15.40:0/2398735927 learned_addr learned my addr 172.21.15.40:0/2398735927 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:21.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.807+0000 7f62c0fac700 1 --2- 172.21.15.40:0/2398735927 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62bc09d920 0x7f62bc12d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:21.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.807+0000 7f62c1fae700 1 --2- 172.21.15.40:0/2398735927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62bc09e480 0x7f62bc12de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:21.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.808+0000 7f62c17ad700 1 -- 172.21.15.40:0/2398735927 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62bc09d920 msgr2=0x7f62bc12d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:21.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.808+0000 7f62c17ad700 1 --2- 172.21.15.40:0/2398735927 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62bc09d920 0x7f62bc12d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.808+0000 7f62c17ad700 1 -- 172.21.15.40:0/2398735927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62bc09e480 msgr2=0x7f62bc12de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:21.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.808+0000 7f62c17ad700 1 --2- 172.21.15.40:0/2398735927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62bc09e480 0x7f62bc12de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.808+0000 7f62c17ad700 1 -- 172.21.15.40:0/2398735927 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b8009430 con 0x7f62bc09c890 2023-09-30T22:25:21.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.808+0000 7f62c17ad700 1 --2- 172.21.15.40:0/2398735927 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62bc09c890 0x7f62bc12d3d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f62b800ebe0 tx=0x7f62b800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:21.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.808+0000 7f62b1ffb700 1 -- 172.21.15.40:0/2398735927 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b8009740 con 0x7f62bc09c890 2023-09-30T22:25:21.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.808+0000 7f62b1ffb700 1 -- 172.21.15.40:0/2398735927 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b8005a20 con 0x7f62bc09c890 2023-09-30T22:25:21.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.808+0000 7f62b1ffb700 1 -- 172.21.15.40:0/2398735927 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b8005db0 con 0x7f62bc09c890 2023-09-30T22:25:21.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.808+0000 7f62c3a11700 1 -- 172.21.15.40:0/2398735927 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b4009b30 con 0x7f62bc09c890 2023-09-30T22:25:21.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.808+0000 7f62c3a11700 1 -- 172.21.15.40:0/2398735927 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62bc1305c0 con 0x7f62bc09c890 2023-09-30T22:25:21.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.809+0000 7f62b1ffb700 1 -- 172.21.15.40:0/2398735927 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f62b800c850 con 0x7f62bc09c890 2023-09-30T22:25:21.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.809+0000 7f62b1ffb700 1 -- 172.21.15.40:0/2398735927 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f62b803fdf0 con 0x7f62bc09c890 2023-09-30T22:25:21.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.809+0000 7f62c0fac700 1 -- 172.21.15.40:0/2398735927 >> v1:172.21.15.40:6816/127432 conn(0x7f62a002f510 legacy=0x7f62a00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:21.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.809+0000 7f62c3a11700 1 -- 172.21.15.40:0/2398735927 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62bc12ffc0 con 0x7f62bc09c890 2023-09-30T22:25:21.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.814+0000 7f62b1ffb700 1 -- 172.21.15.40:0/2398735927 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f62b8020020 con 0x7f62bc09c890 2023-09-30T22:25:21.829 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:21.917 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:21.928 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:21.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.958+0000 7f35c68b4700 1 Processor -- start 2023-09-30T22:25:21.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.958+0000 7f35c68b4700 1 -- start start 2023-09-30T22:25:21.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.959+0000 7f35c68b4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f35c009c890 0x7f35c009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:21.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.959+0000 7f35c68b4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35c009d920 0x7f35c009dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:21.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.959+0000 7f35c68b4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f35c009e2b0 0x7f35c013ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:21.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.959+0000 7f35c68b4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c00a29d0 con 0x7f35c009c890 2023-09-30T22:25:21.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.959+0000 7f35c68b4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c009fb40 con 0x7f35c009d920 2023-09-30T22:25:21.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.959+0000 7f35c68b4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35c00a2600 con 0x7f35c009e2b0 2023-09-30T22:25:21.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.959+0000 7f35bffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f35c009c890 0x7f35c009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:21.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.959+0000 7f35bffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f35c009c890 0x7f35c009cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60816/0 (socket says 172.21.15.40:60816) 2023-09-30T22:25:21.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.959+0000 7f35bffff700 1 -- 172.21.15.40:0/3720966001 learned_addr learned my addr 172.21.15.40:0/3720966001 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:21.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.959+0000 7f35c4e51700 1 --2- 172.21.15.40:0/3720966001 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f35c009e2b0 0x7f35c013ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:21.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.959+0000 7f35bf7fe700 1 --2- 172.21.15.40:0/3720966001 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35c009d920 0x7f35c009dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:21.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.959+0000 7f35bffff700 1 -- 172.21.15.40:0/3720966001 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f35c009e2b0 msgr2=0x7f35c013ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:21.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.959+0000 7f35bffff700 1 --2- 172.21.15.40:0/3720966001 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f35c009e2b0 0x7f35c013ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.959+0000 7f35bffff700 1 -- 172.21.15.40:0/3720966001 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35c009d920 msgr2=0x7f35c009dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:21.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.959+0000 7f35bffff700 1 --2- 172.21.15.40:0/3720966001 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35c009d920 0x7f35c009dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.960+0000 7f35bffff700 1 -- 172.21.15.40:0/3720966001 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c009fed0 con 0x7f35c009c890 2023-09-30T22:25:21.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.960+0000 7f35bffff700 1 --2- 172.21.15.40:0/3720966001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35c009c890 0x7f35c009cc60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f35b0006fd0 tx=0x7f35b0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc99ff25f21a25e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:21.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.960+0000 7f35beffd700 1 -- 172.21.15.40:0/3720966001 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b0005e30 con 0x7f35c009c890 2023-09-30T22:25:21.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.960+0000 7f35beffd700 1 -- 172.21.15.40:0/3720966001 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b0004030 con 0x7f35c009c890 2023-09-30T22:25:21.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.960+0000 7f35beffd700 1 -- 172.21.15.40:0/3720966001 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b00043e0 con 0x7f35c009c890 2023-09-30T22:25:21.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.961+0000 7f35c68b4700 1 -- 172.21.15.40:0/3720966001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35c009c890 msgr2=0x7f35c009cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:21.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.961+0000 7f35c68b4700 1 --2- 172.21.15.40:0/3720966001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35c009c890 0x7f35c009cc60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f35b0006fd0 tx=0x7f35b0009bd0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.961+0000 7f35c68b4700 1 -- 172.21.15.40:0/3720966001 shutdown_connections 2023-09-30T22:25:21.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.961+0000 7f35c68b4700 1 --2- 172.21.15.40:0/3720966001 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f35c009e2b0 0x7f35c013ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.961+0000 7f35c68b4700 1 --2- 172.21.15.40:0/3720966001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35c009c890 0x7f35c009cc60 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.961+0000 7f35c68b4700 1 --2- 172.21.15.40:0/3720966001 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35c009d920 0x7f35c009dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.961+0000 7f35c68b4700 1 -- 172.21.15.40:0/3720966001 >> 172.21.15.40:0/3720966001 conn(0x7f35c00a7080 msgr2=0x7f35c00a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:21.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.961+0000 7f35c68b4700 1 -- 172.21.15.40:0/3720966001 shutdown_connections 2023-09-30T22:25:21.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.961+0000 7f35c68b4700 1 -- 172.21.15.40:0/3720966001 wait complete. 2023-09-30T22:25:21.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.962+0000 7f35c68b4700 1 Processor -- start 2023-09-30T22:25:21.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.962+0000 7f35c68b4700 1 -- start start 2023-09-30T22:25:21.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.962+0000 7f35c68b4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f35c009c890 0x7f35c012d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:21.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.962+0000 7f35c68b4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35c009d920 0x7f35c012db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:21.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.962+0000 7f35c68b4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35c009e2b0 0x7f35c012e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:21.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.962+0000 7f35c68b4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c009c2c0 con 0x7f35c009d920 2023-09-30T22:25:21.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.962+0000 7f35c68b4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c009ecf0 con 0x7f35c009e2b0 2023-09-30T22:25:21.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.962+0000 7f35c68b4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35c012f240 con 0x7f35c009c890 2023-09-30T22:25:21.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.963+0000 7f35bf7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35c009d920 0x7f35c012db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:21.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.963+0000 7f35bf7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35c009d920 0x7f35c012db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60830/0 (socket says 172.21.15.40:60830) 2023-09-30T22:25:21.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.963+0000 7f35bf7fe700 1 -- 172.21.15.40:0/37638423 learned_addr learned my addr 172.21.15.40:0/37638423 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:21.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.963+0000 7f35bffff700 1 --2- 172.21.15.40:0/37638423 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f35c009c890 0x7f35c012d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:21.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.963+0000 7f35c4e51700 1 --2- 172.21.15.40:0/37638423 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35c009e2b0 0x7f35c012e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:21.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.963+0000 7f35bf7fe700 1 -- 172.21.15.40:0/37638423 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f35c009c890 msgr2=0x7f35c012d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:21.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.963+0000 7f35bf7fe700 1 --2- 172.21.15.40:0/37638423 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f35c009c890 0x7f35c012d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.963+0000 7f35bf7fe700 1 -- 172.21.15.40:0/37638423 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35c009e2b0 msgr2=0x7f35c012e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:21.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.963+0000 7f35bf7fe700 1 --2- 172.21.15.40:0/37638423 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35c009e2b0 0x7f35c012e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.963+0000 7f35bf7fe700 1 -- 172.21.15.40:0/37638423 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b0009500 con 0x7f35c009d920 2023-09-30T22:25:21.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.963+0000 7f35bf7fe700 1 --2- 172.21.15.40:0/37638423 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35c009d920 0x7f35c012db10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f35b400e960 tx=0x7f35b400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:21.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.963+0000 7f35bcff9700 1 -- 172.21.15.40:0/37638423 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b4013680 con 0x7f35c009d920 2023-09-30T22:25:21.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.963+0000 7f35bcff9700 1 -- 172.21.15.40:0/37638423 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b40137e0 con 0x7f35c009d920 2023-09-30T22:25:21.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.963+0000 7f35c68b4700 1 -- 172.21.15.40:0/37638423 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c00a5cb0 con 0x7f35c009d920 2023-09-30T22:25:21.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.963+0000 7f35bcff9700 1 -- 172.21.15.40:0/37638423 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b4013b50 con 0x7f35c009d920 2023-09-30T22:25:21.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.964+0000 7f35c68b4700 1 -- 172.21.15.40:0/37638423 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c008f3e0 con 0x7f35c009d920 2023-09-30T22:25:21.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.964+0000 7f35bcff9700 1 -- 172.21.15.40:0/37638423 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f35b4013cb0 con 0x7f35c009d920 2023-09-30T22:25:21.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.965+0000 7f35c68b4700 1 -- 172.21.15.40:0/37638423 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c004f2a0 con 0x7f35c009d920 2023-09-30T22:25:21.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.965+0000 7f35bcff9700 1 -- 172.21.15.40:0/37638423 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f35b403fbb0 con 0x7f35c009d920 2023-09-30T22:25:21.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.965+0000 7f35bffff700 1 -- 172.21.15.40:0/37638423 >> v1:172.21.15.40:6816/127432 conn(0x7f35ac02f510 legacy=0x7f35ac0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:21.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:21.974+0000 7f35bcff9700 1 -- 172.21.15.40:0/37638423 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f35b401b820 con 0x7f35c009d920 2023-09-30T22:25:22.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.010+0000 7f62c0fac700 1 -- 172.21.15.40:0/2398735927 >> v1:172.21.15.40:6816/127432 conn(0x7f62a002f510 legacy=0x7f62a00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:22.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.018+0000 7f62c3a11700 1 -- 172.21.15.40:0/2398735927 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f62bc070610 con 0x7f62bc09c890 2023-09-30T22:25:22.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.018+0000 7f62b1ffb700 1 -- 172.21.15.40:0/2398735927 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f62b8006030 con 0x7f62bc09c890 2023-09-30T22:25:22.019 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:22.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.022+0000 7f62c3a11700 1 -- 172.21.15.40:0/2398735927 >> v1:172.21.15.40:6816/127432 conn(0x7f62a002f510 legacy=0x7f62a00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:22.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.022+0000 7f62c3a11700 1 -- 172.21.15.40:0/2398735927 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62bc09c890 msgr2=0x7f62bc12d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:22.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.022+0000 7f62c3a11700 1 --2- 172.21.15.40:0/2398735927 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62bc09c890 0x7f62bc12d3d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f62b800ebe0 tx=0x7f62b800eef0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.022+0000 7f62c3a11700 1 -- 172.21.15.40:0/2398735927 shutdown_connections 2023-09-30T22:25:22.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.022+0000 7f62c3a11700 1 --2- 172.21.15.40:0/2398735927 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62bc09c890 0x7f62bc12d3d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.022+0000 7f62c3a11700 1 --2- 172.21.15.40:0/2398735927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62bc09e480 0x7f62bc12de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.022+0000 7f62c3a11700 1 --2- 172.21.15.40:0/2398735927 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62bc09d920 0x7f62bc12d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.022+0000 7f62c3a11700 1 -- 172.21.15.40:0/2398735927 >> 172.21.15.40:0/2398735927 conn(0x7f62bc0a7080 msgr2=0x7f62bc1333e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:22.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.022+0000 7f62c3a11700 1 -- 172.21.15.40:0/2398735927 shutdown_connections 2023-09-30T22:25:22.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.022+0000 7f62c3a11700 1 -- 172.21.15.40:0/2398735927 wait complete. 2023-09-30T22:25:22.041 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:22.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.056+0000 7fc9fb3d2700 1 Processor -- start 2023-09-30T22:25:22.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.056+0000 7fc9fb3d2700 1 -- start start 2023-09-30T22:25:22.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.057+0000 7fc9fb3d2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc9f4133e00 0x7fc9f41341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.057+0000 7fc9fb3d2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc9f409d400 0x7fc9f409d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.057+0000 7fc9fb3d2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9f4133940 con 0x7fc9f409dd70 2023-09-30T22:25:22.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.057+0000 7fc9fb3d2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9f409f0d0 con 0x7fc9f4133e00 2023-09-30T22:25:22.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.057+0000 7fc9fb3d2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f4133be0 con 0x7fc9f409d400 2023-09-30T22:25:22.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.057+0000 7fc9f896d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc9f409d400 0x7fc9f409d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:22.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.057+0000 7fc9f896d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc9f409d400 0x7fc9f409d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41336/0 (socket says 172.21.15.40:41336) 2023-09-30T22:25:22.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.057+0000 7fc9f896d700 1 -- 172.21.15.40:0/4258022611 learned_addr learned my addr 172.21.15.40:0/4258022611 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:22.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.057+0000 7fc9f916e700 1 --2- 172.21.15.40:0/4258022611 >> v2:172.21.15.40:3300/0 conn(0x7fc9f4133e00 0x7fc9f41341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:22.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.057+0000 7fc9f916e700 1 -- 172.21.15.40:0/4258022611 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc9f409d400 msgr2=0x7fc9f409d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:22.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.057+0000 7fc9f916e700 1 --2- 172.21.15.40:0/4258022611 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc9f409d400 0x7fc9f409d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.057+0000 7fc9f916e700 1 -- 172.21.15.40:0/4258022611 >> v1:172.21.15.40:6789/0 conn(0x7fc9f409dd70 legacy=0x7fc9f413ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:22.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.057+0000 7fc9f916e700 1 -- 172.21.15.40:0/4258022611 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f409a860 con 0x7fc9f4133e00 2023-09-30T22:25:22.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.057+0000 7fc9f896d700 1 --2- 172.21.15.40:0/4258022611 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc9f409d400 0x7fc9f409d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:22.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.057+0000 7fc9f916e700 1 --2- 172.21.15.40:0/4258022611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9f4133e00 0x7fc9f41341d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0009840 tx=0x7fc9f0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=864ab1c60a920a87 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:22.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.057+0000 7fc9ebfff700 1 -- 172.21.15.40:0/4258022611 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f0011830 con 0x7fc9f4133e00 2023-09-30T22:25:22.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.058+0000 7fc9ebfff700 1 -- 172.21.15.40:0/4258022611 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f0011990 con 0x7fc9f4133e00 2023-09-30T22:25:22.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.058+0000 7fc9ebfff700 1 -- 172.21.15.40:0/4258022611 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f0011d20 con 0x7fc9f4133e00 2023-09-30T22:25:22.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.058+0000 7fc9fb3d2700 1 -- 172.21.15.40:0/4258022611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9f4133e00 msgr2=0x7fc9f41341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:22.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.058+0000 7fc9fb3d2700 1 --2- 172.21.15.40:0/4258022611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9f4133e00 0x7fc9f41341d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0009840 tx=0x7fc9f0009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:22.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.058+0000 7fc9fb3d2700 1 -- 172.21.15.40:0/4258022611 shutdown_connections 2023-09-30T22:25:22.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.058+0000 7fc9fb3d2700 1 --2- 172.21.15.40:0/4258022611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9f4133e00 0x7fc9f41341d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.058+0000 7fc9fb3d2700 1 --2- 172.21.15.40:0/4258022611 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc9f409d400 0x7fc9f409d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.058+0000 7fc9fb3d2700 1 -- 172.21.15.40:0/4258022611 >> 172.21.15.40:0/4258022611 conn(0x7fc9f40a2a00 msgr2=0x7fc9f40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:22.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.059+0000 7fc9fb3d2700 1 -- 172.21.15.40:0/4258022611 shutdown_connections 2023-09-30T22:25:22.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.059+0000 7fc9fb3d2700 1 -- 172.21.15.40:0/4258022611 wait complete. 2023-09-30T22:25:22.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.060+0000 7fc9fb3d2700 1 Processor -- start 2023-09-30T22:25:22.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.060+0000 7fc9fb3d2700 1 -- start start 2023-09-30T22:25:22.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.061+0000 7fc9fb3d2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9f409d400 0x7fc9f4119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.061+0000 7fc9fb3d2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc9f409dd70 0x7fc9f4119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.061+0000 7fc9fb3d2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc9f4133e00 0x7fc9f4119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.061+0000 7fc9fb3d2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f411cd70 con 0x7fc9f409d400 2023-09-30T22:25:22.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.061+0000 7fc9fb3d2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f411c3b0 con 0x7fc9f409dd70 2023-09-30T22:25:22.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.061+0000 7fc9fb3d2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f411b780 con 0x7fc9f4133e00 2023-09-30T22:25:22.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.061+0000 7fc9f896d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc9f409dd70 0x7fc9f4119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:22.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.061+0000 7fc9f996f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc9f4133e00 0x7fc9f4119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:22.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.061+0000 7fc9f896d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc9f409dd70 0x7fc9f4119590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35468/0 (socket says 172.21.15.40:35468) 2023-09-30T22:25:22.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.061+0000 7fc9f896d700 1 -- 172.21.15.40:0/1356298429 learned_addr learned my addr 172.21.15.40:0/1356298429 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:22.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.061+0000 7fc9f916e700 1 --2- 172.21.15.40:0/1356298429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9f409d400 0x7fc9f4119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:22.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.061+0000 7fc9f996f700 1 -- 172.21.15.40:0/1356298429 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc9f409dd70 msgr2=0x7fc9f4119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:22.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.061+0000 7fc9f996f700 1 --2- 172.21.15.40:0/1356298429 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc9f409dd70 0x7fc9f4119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.061+0000 7fc9f996f700 1 -- 172.21.15.40:0/1356298429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9f409d400 msgr2=0x7fc9f4119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:22.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.061+0000 7fc9f996f700 1 --2- 172.21.15.40:0/1356298429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9f409d400 0x7fc9f4119050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.061+0000 7fc9f996f700 1 -- 172.21.15.40:0/1356298429 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e4009550 con 0x7fc9f4133e00 2023-09-30T22:25:22.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.061+0000 7fc9f896d700 1 --2- 172.21.15.40:0/1356298429 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc9f409dd70 0x7fc9f4119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:22.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.061+0000 7fc9f996f700 1 --2- 172.21.15.40:0/1356298429 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc9f4133e00 0x7fc9f4119ad0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec00cb10 tx=0x7fc9ec00ce20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:22.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.062+0000 7fc9e9ffb700 1 -- 172.21.15.40:0/1356298429 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec003c00 con 0x7fc9f4133e00 2023-09-30T22:25:22.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.062+0000 7fc9e9ffb700 1 -- 172.21.15.40:0/1356298429 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ec003d60 con 0x7fc9f4133e00 2023-09-30T22:25:22.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.062+0000 7fc9e9ffb700 1 -- 172.21.15.40:0/1356298429 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec00a9e0 con 0x7fc9f4133e00 2023-09-30T22:25:22.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.063+0000 7fc9fb3d2700 1 -- 172.21.15.40:0/1356298429 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9f00094a0 con 0x7fc9f4133e00 2023-09-30T22:25:22.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.063+0000 7fc9fb3d2700 1 -- 172.21.15.40:0/1356298429 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9f409ffe0 con 0x7fc9f4133e00 2023-09-30T22:25:22.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.063+0000 7fc9e9ffb700 1 -- 172.21.15.40:0/1356298429 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc9ec00ab40 con 0x7fc9f4133e00 2023-09-30T22:25:22.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.063+0000 7fc9e9ffb700 1 -- 172.21.15.40:0/1356298429 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7fc9ec03fa00 con 0x7fc9f4133e00 2023-09-30T22:25:22.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.063+0000 7fc9f916e700 1 -- 172.21.15.40:0/1356298429 >> v1:172.21.15.40:6816/127432 conn(0x7fc9d802f510 legacy=0x7fc9d80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:22.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.064+0000 7fc9fb3d2700 1 -- 172.21.15.40:0/1356298429 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9f411bd70 con 0x7fc9f4133e00 2023-09-30T22:25:22.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.073+0000 7fc9e9ffb700 1 -- 172.21.15.40:0/1356298429 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc9f411bd70 con 0x7fc9f4133e00 2023-09-30T22:25:22.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.102+0000 7f516551f700 1 Processor -- start 2023-09-30T22:25:22.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.103+0000 7f516551f700 1 -- start start 2023-09-30T22:25:22.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.103+0000 7f516551f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f516006f070 0x7f516006f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.103+0000 7f516551f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f516006f980 0x7f5160097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.103+0000 7f516551f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5160070830 con 0x7f516006fdb0 2023-09-30T22:25:22.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.103+0000 7f516551f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5160071af0 con 0x7f516006f980 2023-09-30T22:25:22.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.103+0000 7f516551f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5160070ad0 con 0x7f516006f070 2023-09-30T22:25:22.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.103+0000 7f515effd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f516006f070 0x7f516006f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:22.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.103+0000 7f515e7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f516006f980 0x7f5160097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:22.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.103+0000 7f515f7fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f516006fdb0 0x7f51600975d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:59906/0 (socket says 172.21.15.40:59906) 2023-09-30T22:25:22.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.103+0000 7f515effd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f516006f070 0x7f516006f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41340/0 (socket says 172.21.15.40:41340) 2023-09-30T22:25:22.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.103+0000 7f515f7fe700 1 -- 172.21.15.40:0/1308832623 learned_addr learned my addr 172.21.15.40:0/1308832623 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:22.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.104+0000 7f515dffb700 1 -- 172.21.15.40:0/1308832623 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3462600704 0 0) 0x7f5160070830 con 0x7f516006fdb0 2023-09-30T22:25:22.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.104+0000 7f515e7fc700 1 -- 172.21.15.40:0/1308832623 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f516006f070 msgr2=0x7f516006f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:22.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.104+0000 7f515e7fc700 1 --2- 172.21.15.40:0/1308832623 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f516006f070 0x7f516006f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.104+0000 7f515e7fc700 1 -- 172.21.15.40:0/1308832623 >> v1:172.21.15.40:6789/0 conn(0x7f516006fdb0 legacy=0x7f51600975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:22.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.104+0000 7f515e7fc700 1 -- 172.21.15.40:0/1308832623 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5160070de0 con 0x7f516006f980 2023-09-30T22:25:22.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.104+0000 7f515effd700 1 --2- 172.21.15.40:0/1308832623 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f516006f070 0x7f516006f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:22.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.104+0000 7f515e7fc700 1 --2- 172.21.15.40:0/1308832623 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f516006f980 0x7f5160097090 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5154009870 tx=0x7f5154009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b423e9acf2f7d8fa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:22.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.104+0000 7f515dffb700 1 -- 172.21.15.40:0/1308832623 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5154011830 con 0x7f516006f980 2023-09-30T22:25:22.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.104+0000 7f515dffb700 1 -- 172.21.15.40:0/1308832623 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5154011990 con 0x7f516006f980 2023-09-30T22:25:22.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.104+0000 7f515dffb700 1 -- 172.21.15.40:0/1308832623 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5154011d20 con 0x7f516006f980 2023-09-30T22:25:22.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.105+0000 7f516551f700 1 -- 172.21.15.40:0/1308832623 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f516006f980 msgr2=0x7f5160097090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:22.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.105+0000 7f516551f700 1 --2- 172.21.15.40:0/1308832623 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f516006f980 0x7f5160097090 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5154009870 tx=0x7f5154009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:22.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.105+0000 7f516551f700 1 -- 172.21.15.40:0/1308832623 shutdown_connections 2023-09-30T22:25:22.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.105+0000 7f516551f700 1 --2- 172.21.15.40:0/1308832623 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f516006f070 0x7f516006f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.105+0000 7f516551f700 1 --2- 172.21.15.40:0/1308832623 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f516006f980 0x7f5160097090 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.105+0000 7f516551f700 1 -- 172.21.15.40:0/1308832623 >> 172.21.15.40:0/1308832623 conn(0x7f51600a41a0 msgr2=0x7f51600a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:22.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.105+0000 7f516551f700 1 -- 172.21.15.40:0/1308832623 shutdown_connections 2023-09-30T22:25:22.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.105+0000 7f516551f700 1 -- 172.21.15.40:0/1308832623 wait complete. 2023-09-30T22:25:22.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.106+0000 7f516551f700 1 Processor -- start 2023-09-30T22:25:22.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.106+0000 7f516551f700 1 -- start start 2023-09-30T22:25:22.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.107+0000 7f516551f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f516006f070 0x7f516012d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.107+0000 7f516551f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f516006f980 0x7f516012d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.107+0000 7f516551f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f516006fdb0 0x7f516012dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.107+0000 7f516551f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516012ff70 con 0x7f516006f980 2023-09-30T22:25:22.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.107+0000 7f516551f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5160129380 con 0x7f516006fdb0 2023-09-30T22:25:22.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.107+0000 7f516551f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f516012fb40 con 0x7f516006f070 2023-09-30T22:25:22.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.107+0000 7f515f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f516006fdb0 0x7f516012dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:22.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.107+0000 7f515f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f516006fdb0 0x7f516012dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35496/0 (socket says 172.21.15.40:35496) 2023-09-30T22:25:22.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.107+0000 7f515f7fe700 1 -- 172.21.15.40:0/2674115862 learned_addr learned my addr 172.21.15.40:0/2674115862 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:22.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.107+0000 7f515effd700 1 --2- 172.21.15.40:0/2674115862 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f516006f070 0x7f516012d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:22.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.107+0000 7f515e7fc700 1 --2- 172.21.15.40:0/2674115862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f516006f980 0x7f516012d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:22.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.107+0000 7f515f7fe700 1 -- 172.21.15.40:0/2674115862 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f516006f070 msgr2=0x7f516012d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:22.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.107+0000 7f515f7fe700 1 --2- 172.21.15.40:0/2674115862 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f516006f070 0x7f516012d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.107+0000 7f515f7fe700 1 -- 172.21.15.40:0/2674115862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f516006f980 msgr2=0x7f516012d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:22.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.107+0000 7f515f7fe700 1 --2- 172.21.15.40:0/2674115862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f516006f980 0x7f516012d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.107+0000 7f515f7fe700 1 -- 172.21.15.40:0/2674115862 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51500094a0 con 0x7f516006fdb0 2023-09-30T22:25:22.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.108+0000 7f515f7fe700 1 --2- 172.21.15.40:0/2674115862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f516006fdb0 0x7f516012dc40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5158002200 tx=0x7f515800cf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:22.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.108+0000 7f51477fe700 1 -- 172.21.15.40:0/2674115862 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5158011a90 con 0x7f516006fdb0 2023-09-30T22:25:22.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.108+0000 7f51477fe700 1 -- 172.21.15.40:0/2674115862 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5158011c10 con 0x7f516006fdb0 2023-09-30T22:25:22.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.108+0000 7f516551f700 1 -- 172.21.15.40:0/2674115862 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51540094a0 con 0x7f516006fdb0 2023-09-30T22:25:22.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.108+0000 7f51477fe700 1 -- 172.21.15.40:0/2674115862 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515800a560 con 0x7f516006fdb0 2023-09-30T22:25:22.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.108+0000 7f516551f700 1 -- 172.21.15.40:0/2674115862 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5160131470 con 0x7f516006fdb0 2023-09-30T22:25:22.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.109+0000 7f51477fe700 1 -- 172.21.15.40:0/2674115862 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5158017020 con 0x7f516006fdb0 2023-09-30T22:25:22.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.109+0000 7f51477fe700 1 -- 172.21.15.40:0/2674115862 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f5158043de0 con 0x7f516006fdb0 2023-09-30T22:25:22.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.109+0000 7f515effd700 1 -- 172.21.15.40:0/2674115862 >> v1:172.21.15.40:6816/127432 conn(0x7f514c02f510 legacy=0x7f514c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:22.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.109+0000 7f516551f700 1 -- 172.21.15.40:0/2674115862 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5160130840 con 0x7f516006fdb0 2023-09-30T22:25:22.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.114+0000 7f51477fe700 1 -- 172.21.15.40:0/2674115862 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5158020070 con 0x7f516006fdb0 2023-09-30T22:25:22.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.166+0000 7f35bffff700 1 -- 172.21.15.40:0/37638423 >> v1:172.21.15.40:6816/127432 conn(0x7f35ac02f510 legacy=0x7f35ac0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:22.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.191+0000 7f35c68b4700 1 -- 172.21.15.40:0/37638423 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f35c00a5200 con 0x7f35c009d920 2023-09-30T22:25:22.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.191+0000 7f35bcff9700 1 -- 172.21.15.40:0/37638423 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f35b4017030 con 0x7f35c009d920 2023-09-30T22:25:22.192 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:22.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.194+0000 7f35c68b4700 1 -- 172.21.15.40:0/37638423 >> v1:172.21.15.40:6816/127432 conn(0x7f35ac02f510 legacy=0x7f35ac0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:22.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.194+0000 7f35c68b4700 1 -- 172.21.15.40:0/37638423 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35c009d920 msgr2=0x7f35c012db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:22.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.194+0000 7f35c68b4700 1 --2- 172.21.15.40:0/37638423 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35c009d920 0x7f35c012db10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f35b400e960 tx=0x7f35b400ec70 comp rx=0 tx=0).stop 2023-09-30T22:25:22.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.194+0000 7f35c68b4700 1 -- 172.21.15.40:0/37638423 shutdown_connections 2023-09-30T22:25:22.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.194+0000 7f35c68b4700 1 --2- 172.21.15.40:0/37638423 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f35c009c890 0x7f35c012d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.194+0000 7f35c68b4700 1 --2- 172.21.15.40:0/37638423 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35c009e2b0 0x7f35c012e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.194+0000 7f35c68b4700 1 --2- 172.21.15.40:0/37638423 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35c009d920 0x7f35c012db10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.194+0000 7f35c68b4700 1 -- 172.21.15.40:0/37638423 >> 172.21.15.40:0/37638423 conn(0x7f35c00a7080 msgr2=0x7f35c00a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:22.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.194+0000 7f35c68b4700 1 -- 172.21.15.40:0/37638423 shutdown_connections 2023-09-30T22:25:22.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.194+0000 7f35c68b4700 1 -- 172.21.15.40:0/37638423 wait complete. 2023-09-30T22:25:22.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:22.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.265+0000 7fc9f916e700 1 -- 172.21.15.40:0/1356298429 >> v1:172.21.15.40:6816/127432 conn(0x7fc9d802f510 legacy=0x7fc9d80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:22.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.283+0000 7fc9fb3d2700 1 -- 172.21.15.40:0/1356298429 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc9f411bd70 con 0x7fc9f4133e00 2023-09-30T22:25:22.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.284+0000 7fc9e9ffb700 1 -- 172.21.15.40:0/1356298429 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc9f411bd70 con 0x7fc9f4133e00 2023-09-30T22:25:22.284 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:22.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.286+0000 7fc9fb3d2700 1 -- 172.21.15.40:0/1356298429 >> v1:172.21.15.40:6816/127432 conn(0x7fc9d802f510 legacy=0x7fc9d80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:22.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.286+0000 7fc9fb3d2700 1 -- 172.21.15.40:0/1356298429 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc9f4133e00 msgr2=0x7fc9f4119ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:22.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.286+0000 7fc9fb3d2700 1 --2- 172.21.15.40:0/1356298429 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc9f4133e00 0x7fc9f4119ad0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec00cb10 tx=0x7fc9ec00ce20 comp rx=0 tx=0).stop 2023-09-30T22:25:22.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.286+0000 7fc9fb3d2700 1 -- 172.21.15.40:0/1356298429 shutdown_connections 2023-09-30T22:25:22.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.286+0000 7fc9fb3d2700 1 --2- 172.21.15.40:0/1356298429 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc9f4133e00 0x7fc9f4119ad0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.286+0000 7fc9fb3d2700 1 --2- 172.21.15.40:0/1356298429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9f409d400 0x7fc9f4119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.286+0000 7fc9fb3d2700 1 --2- 172.21.15.40:0/1356298429 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc9f409dd70 0x7fc9f4119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.286+0000 7fc9fb3d2700 1 -- 172.21.15.40:0/1356298429 >> 172.21.15.40:0/1356298429 conn(0x7fc9f40a2a00 msgr2=0x7fc9f412d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:22.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.286+0000 7fc9fb3d2700 1 -- 172.21.15.40:0/1356298429 shutdown_connections 2023-09-30T22:25:22.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.286+0000 7fc9fb3d2700 1 -- 172.21.15.40:0/1356298429 wait complete. 2023-09-30T22:25:22.299 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:22.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.310+0000 7f515effd700 1 -- 172.21.15.40:0/2674115862 >> v1:172.21.15.40:6816/127432 conn(0x7f514c02f510 legacy=0x7f514c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:22.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.314+0000 7f516551f700 1 -- 172.21.15.40:0/2674115862 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f51601306a0 con 0x7f516006fdb0 2023-09-30T22:25:22.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.314+0000 7f51477fe700 1 -- 172.21.15.40:0/2674115862 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f51601306a0 con 0x7f516006fdb0 2023-09-30T22:25:22.315 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:22.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.316+0000 7f516551f700 1 -- 172.21.15.40:0/2674115862 >> v1:172.21.15.40:6816/127432 conn(0x7f514c02f510 legacy=0x7f514c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:22.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.316+0000 7f516551f700 1 -- 172.21.15.40:0/2674115862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f516006fdb0 msgr2=0x7f516012dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:22.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.316+0000 7f516551f700 1 --2- 172.21.15.40:0/2674115862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f516006fdb0 0x7f516012dc40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5158002200 tx=0x7f515800cf50 comp rx=0 tx=0).stop 2023-09-30T22:25:22.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.316+0000 7f516551f700 1 -- 172.21.15.40:0/2674115862 shutdown_connections 2023-09-30T22:25:22.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.316+0000 7f516551f700 1 --2- 172.21.15.40:0/2674115862 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f516006f070 0x7f516012d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.316+0000 7f516551f700 1 --2- 172.21.15.40:0/2674115862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f516006fdb0 0x7f516012dc40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.316+0000 7f516551f700 1 --2- 172.21.15.40:0/2674115862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f516006f980 0x7f516012d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.316+0000 7f516551f700 1 -- 172.21.15.40:0/2674115862 >> 172.21.15.40:0/2674115862 conn(0x7f51600a41a0 msgr2=0x7f51600973c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:22.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.316+0000 7f516551f700 1 -- 172.21.15.40:0/2674115862 shutdown_connections 2023-09-30T22:25:22.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:22.316+0000 7f516551f700 1 -- 172.21.15.40:0/2674115862 wait complete. 2023-09-30T22:25:22.329 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:23.041 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:23.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.182+0000 7f9be2c0d700 1 Processor -- start 2023-09-30T22:25:23.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.182+0000 7f9be2c0d700 1 -- start start 2023-09-30T22:25:23.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.183+0000 7f9be2c0d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9bdc136c50 0x7f9bdc139030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.183+0000 7f9be2c0d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bdc139570 0x7f9bdc13b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.183+0000 7f9be2c0d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bdc133940 con 0x7f9bdc133e00 2023-09-30T22:25:23.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.183+0000 7f9be2c0d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bdc09af70 con 0x7f9bdc136c50 2023-09-30T22:25:23.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.183+0000 7f9be2c0d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bdc09ab20 con 0x7f9bdc139570 2023-09-30T22:25:23.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.183+0000 7f9be11aa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bdc139570 0x7f9bdc13b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.183+0000 7f9bdbfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9bdc136c50 0x7f9bdc139030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.183+0000 7f9be11aa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bdc139570 0x7f9bdc13b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35498/0 (socket says 172.21.15.40:35498) 2023-09-30T22:25:23.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.183+0000 7f9be11aa700 1 -- 172.21.15.40:0/3003192221 learned_addr learned my addr 172.21.15.40:0/3003192221 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:23.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.183+0000 7f9be09a9700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9bdc133e00 0x7f9bdc1341d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:59920/0 (socket says 172.21.15.40:59920) 2023-09-30T22:25:23.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.184+0000 7f9be11aa700 1 -- 172.21.15.40:0/3003192221 >> v2:172.21.15.40:3300/0 conn(0x7f9bdc136c50 msgr2=0x7f9bdc139030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:23.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.184+0000 7f9be11aa700 1 --2- 172.21.15.40:0/3003192221 >> v2:172.21.15.40:3300/0 conn(0x7f9bdc136c50 0x7f9bdc139030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.184+0000 7f9be11aa700 1 -- 172.21.15.40:0/3003192221 >> v1:172.21.15.40:6789/0 conn(0x7f9bdc133e00 legacy=0x7f9bdc1341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.184+0000 7f9be11aa700 1 -- 172.21.15.40:0/3003192221 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bdc09f0d0 con 0x7f9bdc139570 2023-09-30T22:25:23.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.184+0000 7f9bdbfff700 1 --2- 172.21.15.40:0/3003192221 >> v2:172.21.15.40:3300/0 conn(0x7f9bdc136c50 0x7f9bdc139030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:23.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.184+0000 7f9be11aa700 1 --2- 172.21.15.40:0/3003192221 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bdc139570 0x7f9bdc13b950 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4009e50 tx=0x7f9bd400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fba2e76d19ab25f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:23.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.184+0000 7f9bdb7fe700 1 -- 172.21.15.40:0/3003192221 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd400e070 con 0x7f9bdc139570 2023-09-30T22:25:23.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.184+0000 7f9bdb7fe700 1 -- 172.21.15.40:0/3003192221 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd400b910 con 0x7f9bdc139570 2023-09-30T22:25:23.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.184+0000 7f9bdb7fe700 1 -- 172.21.15.40:0/3003192221 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd400bcc0 con 0x7f9bdc139570 2023-09-30T22:25:23.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.185+0000 7f9be2c0d700 1 -- 172.21.15.40:0/3003192221 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bdc139570 msgr2=0x7f9bdc13b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.185+0000 7f9be2c0d700 1 --2- 172.21.15.40:0/3003192221 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bdc139570 0x7f9bdc13b950 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4009e50 tx=0x7f9bd400b330 comp rx=0 tx=0).stop 2023-09-30T22:25:23.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.185+0000 7f9be2c0d700 1 -- 172.21.15.40:0/3003192221 shutdown_connections 2023-09-30T22:25:23.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.185+0000 7f9be2c0d700 1 --2- 172.21.15.40:0/3003192221 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bdc139570 0x7f9bdc13b950 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.185+0000 7f9be2c0d700 1 --2- 172.21.15.40:0/3003192221 >> v2:172.21.15.40:3300/0 conn(0x7f9bdc136c50 0x7f9bdc139030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.185+0000 7f9be2c0d700 1 -- 172.21.15.40:0/3003192221 >> 172.21.15.40:0/3003192221 conn(0x7f9bdc0a2a00 msgr2=0x7f9bdc0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:23.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.185+0000 7f9be2c0d700 1 -- 172.21.15.40:0/3003192221 shutdown_connections 2023-09-30T22:25:23.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.185+0000 7f9be2c0d700 1 -- 172.21.15.40:0/3003192221 wait complete. 2023-09-30T22:25:23.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.186+0000 7f9be2c0d700 1 Processor -- start 2023-09-30T22:25:23.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.186+0000 7f9be2c0d700 1 -- start start 2023-09-30T22:25:23.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.187+0000 7f9be2c0d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9bdc133e00 0x7f9bdc119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.187+0000 7f9be2c0d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bdc136c50 0x7f9bdc119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.187+0000 7f9be2c0d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bdc139570 0x7f9bdc119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.187+0000 7f9be2c0d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bdc11bb50 con 0x7f9bdc136c50 2023-09-30T22:25:23.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.187+0000 7f9be2c0d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bdc12dfb0 con 0x7f9bdc139570 2023-09-30T22:25:23.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.187+0000 7f9be2c0d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9bdc12e180 con 0x7f9bdc133e00 2023-09-30T22:25:23.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.187+0000 7f9bdbfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bdc136c50 0x7f9bdc119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.187+0000 7f9be11aa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bdc139570 0x7f9bdc119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.187+0000 7f9bdbfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bdc136c50 0x7f9bdc119590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44448/0 (socket says 172.21.15.40:44448) 2023-09-30T22:25:23.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.187+0000 7f9bdbfff700 1 -- 172.21.15.40:0/3731787298 learned_addr learned my addr 172.21.15.40:0/3731787298 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:23.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.187+0000 7f9be11aa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bdc139570 0x7f9bdc119ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38942/0 (socket says 172.21.15.40:38942) 2023-09-30T22:25:23.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.187+0000 7f9be09a9700 1 --2- 172.21.15.40:0/3731787298 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9bdc133e00 0x7f9bdc119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.187+0000 7f9bdbfff700 1 -- 172.21.15.40:0/3731787298 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9bdc133e00 msgr2=0x7f9bdc119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.187+0000 7f9bdbfff700 1 --2- 172.21.15.40:0/3731787298 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9bdc133e00 0x7f9bdc119050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.187+0000 7f9bdbfff700 1 -- 172.21.15.40:0/3731787298 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bdc139570 msgr2=0x7f9bdc119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.187+0000 7f9bdbfff700 1 --2- 172.21.15.40:0/3731787298 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bdc139570 0x7f9bdc119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.187+0000 7f9bdbfff700 1 -- 172.21.15.40:0/3731787298 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc80094a0 con 0x7f9bdc136c50 2023-09-30T22:25:23.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.187+0000 7f9be11aa700 1 --2- 172.21.15.40:0/3731787298 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bdc139570 0x7f9bdc119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:23.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.188+0000 7f9bdbfff700 1 --2- 172.21.15.40:0/3731787298 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bdc136c50 0x7f9bdc119590 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9bc800ebe0 tx=0x7f9bc800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:23.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.188+0000 7f9bd97fa700 1 -- 172.21.15.40:0/3731787298 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc800c850 con 0x7f9bdc136c50 2023-09-30T22:25:23.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.188+0000 7f9bd97fa700 1 -- 172.21.15.40:0/3731787298 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc800c9b0 con 0x7f9bdc136c50 2023-09-30T22:25:23.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.188+0000 7f9bd97fa700 1 -- 172.21.15.40:0/3731787298 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc800cd40 con 0x7f9bdc136c50 2023-09-30T22:25:23.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.188+0000 7f9be2c0d700 1 -- 172.21.15.40:0/3731787298 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bd4009b30 con 0x7f9bdc136c50 2023-09-30T22:25:23.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.188+0000 7f9be2c0d700 1 -- 172.21.15.40:0/3731787298 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bdc131070 con 0x7f9bdc136c50 2023-09-30T22:25:23.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.189+0000 7f9bd97fa700 1 -- 172.21.15.40:0/3731787298 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9bc8013470 con 0x7f9bdc136c50 2023-09-30T22:25:23.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.189+0000 7f9be2c0d700 1 -- 172.21.15.40:0/3731787298 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bdc11b510 con 0x7f9bdc136c50 2023-09-30T22:25:23.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.189+0000 7f9bd97fa700 1 -- 172.21.15.40:0/3731787298 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f9bc8040070 con 0x7f9bdc136c50 2023-09-30T22:25:23.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.189+0000 7f9be09a9700 1 -- 172.21.15.40:0/3731787298 >> v1:172.21.15.40:6816/127432 conn(0x7f9bc002f510 legacy=0x7f9bc00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:23.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.193+0000 7f9bd97fa700 1 -- 172.21.15.40:0/3731787298 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9bdc11b510 con 0x7f9bdc136c50 2023-09-30T22:25:23.208 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:23.300 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:23.330 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:23.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.336+0000 7f18b2650700 1 Processor -- start 2023-09-30T22:25:23.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.336+0000 7f18b2650700 1 -- start start 2023-09-30T22:25:23.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.337+0000 7f18b2650700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18ac133e00 0x7f18ac1341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.337+0000 7f18b2650700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f18ac09df40 0x7f18ac13bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.337+0000 7f18b2650700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18ac133940 con 0x7f18ac09d400 2023-09-30T22:25:23.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.337+0000 7f18b2650700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18ac09f0d0 con 0x7f18ac09df40 2023-09-30T22:25:23.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.337+0000 7f18b2650700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac133be0 con 0x7f18ac133e00 2023-09-30T22:25:23.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.337+0000 7f18abfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18ac133e00 0x7f18ac1341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.337+0000 7f18abfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18ac133e00 0x7f18ac1341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:47964/0 (socket says 172.21.15.40:47964) 2023-09-30T22:25:23.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.337+0000 7f18abfff700 1 -- 172.21.15.40:0/630861190 learned_addr learned my addr 172.21.15.40:0/630861190 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:23.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.337+0000 7f18b0bed700 1 --2- 172.21.15.40:0/630861190 >> v2:172.21.15.40:3300/0 conn(0x7f18ac09df40 0x7f18ac13bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.338+0000 7f18b0bed700 1 -- 172.21.15.40:0/630861190 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18ac133e00 msgr2=0x7f18ac1341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:23.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.338+0000 7f18b0bed700 1 --2- 172.21.15.40:0/630861190 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18ac133e00 0x7f18ac1341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.338+0000 7f18b0bed700 1 -- 172.21.15.40:0/630861190 >> v1:172.21.15.40:6789/0 conn(0x7f18ac09d400 legacy=0x7f18ac09d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:23.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.338+0000 7f18b0bed700 1 -- 172.21.15.40:0/630861190 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ac09a860 con 0x7f18ac09df40 2023-09-30T22:25:23.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.338+0000 7f18b0bed700 1 --2- 172.21.15.40:0/630861190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18ac09df40 0x7f18ac13bc80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f18a4009d90 tx=0x7f18a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe8680ec66de2114 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:23.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.338+0000 7f18aaffd700 1 -- 172.21.15.40:0/630861190 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a400e070 con 0x7f18ac09df40 2023-09-30T22:25:23.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.338+0000 7f18aaffd700 1 -- 172.21.15.40:0/630861190 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a400bae0 con 0x7f18ac09df40 2023-09-30T22:25:23.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.338+0000 7f18aaffd700 1 -- 172.21.15.40:0/630861190 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a400be90 con 0x7f18ac09df40 2023-09-30T22:25:23.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.339+0000 7f18b2650700 1 -- 172.21.15.40:0/630861190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18ac09df40 msgr2=0x7f18ac13bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.339+0000 7f18b2650700 1 --2- 172.21.15.40:0/630861190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18ac09df40 0x7f18ac13bc80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f18a4009d90 tx=0x7f18a400b330 comp rx=0 tx=0).stop 2023-09-30T22:25:23.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.339+0000 7f18b2650700 1 -- 172.21.15.40:0/630861190 shutdown_connections 2023-09-30T22:25:23.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.339+0000 7f18b2650700 1 --2- 172.21.15.40:0/630861190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18ac09df40 0x7f18ac13bc80 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.339+0000 7f18b2650700 1 --2- 172.21.15.40:0/630861190 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18ac133e00 0x7f18ac1341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.339+0000 7f18b2650700 1 -- 172.21.15.40:0/630861190 >> 172.21.15.40:0/630861190 conn(0x7f18ac0a2a00 msgr2=0x7f18ac0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:23.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.339+0000 7f18b2650700 1 -- 172.21.15.40:0/630861190 shutdown_connections 2023-09-30T22:25:23.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.339+0000 7f18b2650700 1 -- 172.21.15.40:0/630861190 wait complete. 2023-09-30T22:25:23.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.340+0000 7f18b2650700 1 Processor -- start 2023-09-30T22:25:23.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.340+0000 7f18b2650700 1 -- start start 2023-09-30T22:25:23.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.341+0000 7f18b2650700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18ac09d400 0x7f18ac06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.341+0000 7f18b2650700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18ac09df40 0x7f18ac06f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.341+0000 7f18b2650700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18ac133e00 0x7f18ac06f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.341+0000 7f18b2650700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac070430 con 0x7f18ac09d400 2023-09-30T22:25:23.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.341+0000 7f18b2650700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac11ad40 con 0x7f18ac133e00 2023-09-30T22:25:23.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.341+0000 7f18b2650700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac11a0a0 con 0x7f18ac09df40 2023-09-30T22:25:23.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.341+0000 7f18abfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18ac09d400 0x7f18ac06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.341+0000 7f18abfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18ac09d400 0x7f18ac06ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44472/0 (socket says 172.21.15.40:44472) 2023-09-30T22:25:23.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.341+0000 7f18abfff700 1 -- 172.21.15.40:0/2617957450 learned_addr learned my addr 172.21.15.40:0/2617957450 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:23.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.341+0000 7f18ab7fe700 1 --2- 172.21.15.40:0/2617957450 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18ac09df40 0x7f18ac06f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.341+0000 7f18ab7fe700 1 -- 172.21.15.40:0/2617957450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18ac133e00 msgr2=0x7f18ac06f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.341+0000 7f18ab7fe700 1 --2- 172.21.15.40:0/2617957450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18ac133e00 0x7f18ac06f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.341+0000 7f18ab7fe700 1 -- 172.21.15.40:0/2617957450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18ac09d400 msgr2=0x7f18ac06ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.341+0000 7f18ab7fe700 1 --2- 172.21.15.40:0/2617957450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18ac09d400 0x7f18ac06ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.341+0000 7f18ab7fe700 1 -- 172.21.15.40:0/2617957450 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a4009a70 con 0x7f18ac09df40 2023-09-30T22:25:23.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.342+0000 7f18abfff700 1 --2- 172.21.15.40:0/2617957450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18ac09d400 0x7f18ac06ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:23.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.342+0000 7f18ab7fe700 1 --2- 172.21.15.40:0/2617957450 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18ac09df40 0x7f18ac06f4a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f18a000b3c0 tx=0x7f18a000b6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:23.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.342+0000 7f18a8ff9700 1 -- 172.21.15.40:0/2617957450 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a0011830 con 0x7f18ac09df40 2023-09-30T22:25:23.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.342+0000 7f18a8ff9700 1 -- 172.21.15.40:0/2617957450 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a0011990 con 0x7f18ac09df40 2023-09-30T22:25:23.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.342+0000 7f18b2650700 1 -- 172.21.15.40:0/2617957450 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18ac070bf0 con 0x7f18ac09df40 2023-09-30T22:25:23.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.342+0000 7f18a8ff9700 1 -- 172.21.15.40:0/2617957450 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a0011d40 con 0x7f18ac09df40 2023-09-30T22:25:23.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.342+0000 7f18b2650700 1 -- 172.21.15.40:0/2617957450 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18ac11a380 con 0x7f18ac09df40 2023-09-30T22:25:23.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.343+0000 7f18b2650700 1 -- 172.21.15.40:0/2617957450 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18ac11a1e0 con 0x7f18ac09df40 2023-09-30T22:25:23.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.343+0000 7f18a8ff9700 1 -- 172.21.15.40:0/2617957450 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f18a001a400 con 0x7f18ac09df40 2023-09-30T22:25:23.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.343+0000 7f18a8ff9700 1 -- 172.21.15.40:0/2617957450 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f18a003f7b0 con 0x7f18ac09df40 2023-09-30T22:25:23.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.344+0000 7f18abfff700 1 -- 172.21.15.40:0/2617957450 >> v1:172.21.15.40:6816/127432 conn(0x7f189802f510 legacy=0x7f18980319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:23.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.349+0000 7f18a8ff9700 1 -- 172.21.15.40:0/2617957450 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f18ac11a1e0 con 0x7f18ac09df40 2023-09-30T22:25:23.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.390+0000 7f9be09a9700 1 -- 172.21.15.40:0/3731787298 >> v1:172.21.15.40:6816/127432 conn(0x7f9bc002f510 legacy=0x7f9bc00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:23.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.398+0000 7f9be2c0d700 1 -- 172.21.15.40:0/3731787298 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9bdc11b510 con 0x7f9bdc136c50 2023-09-30T22:25:23.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.399+0000 7f9bd97fa700 1 -- 172.21.15.40:0/3731787298 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9bdc11b510 con 0x7f9bdc136c50 2023-09-30T22:25:23.399 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:23.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.402+0000 7f9be2c0d700 1 -- 172.21.15.40:0/3731787298 >> v1:172.21.15.40:6816/127432 conn(0x7f9bc002f510 legacy=0x7f9bc00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:23.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.402+0000 7f9be2c0d700 1 -- 172.21.15.40:0/3731787298 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bdc136c50 msgr2=0x7f9bdc119590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.402+0000 7f9be2c0d700 1 --2- 172.21.15.40:0/3731787298 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bdc136c50 0x7f9bdc119590 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9bc800ebe0 tx=0x7f9bc800eef0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.403+0000 7f9be2c0d700 1 -- 172.21.15.40:0/3731787298 shutdown_connections 2023-09-30T22:25:23.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.403+0000 7f9be2c0d700 1 --2- 172.21.15.40:0/3731787298 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9bdc133e00 0x7f9bdc119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.403+0000 7f9be2c0d700 1 --2- 172.21.15.40:0/3731787298 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9bdc139570 0x7f9bdc119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.403+0000 7f9be2c0d700 1 --2- 172.21.15.40:0/3731787298 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bdc136c50 0x7f9bdc119590 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.403+0000 7f9be2c0d700 1 -- 172.21.15.40:0/3731787298 >> 172.21.15.40:0/3731787298 conn(0x7f9bdc0a2a00 msgr2=0x7f9bdc09b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:23.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.403+0000 7f9be2c0d700 1 -- 172.21.15.40:0/3731787298 shutdown_connections 2023-09-30T22:25:23.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.403+0000 7f9be2c0d700 1 -- 172.21.15.40:0/3731787298 wait complete. 2023-09-30T22:25:23.422 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:23.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.435+0000 7fe6a1b0e700 1 Processor -- start 2023-09-30T22:25:23.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.436+0000 7fe6a1b0e700 1 -- start start 2023-09-30T22:25:23.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.436+0000 7fe6a1b0e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe69c136c50 0x7fe69c139030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.436+0000 7fe6a1b0e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe69c139570 0x7fe69c13b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.436+0000 7fe6a1b0e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe69c133940 con 0x7fe69c133e00 2023-09-30T22:25:23.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.436+0000 7fe6a1b0e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c09af70 con 0x7fe69c136c50 2023-09-30T22:25:23.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.436+0000 7fe6a1b0e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c09ab20 con 0x7fe69c139570 2023-09-30T22:25:23.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.437+0000 7fe69b7fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe69c133e00 0x7fe69c1341d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:35032/0 (socket says 172.21.15.40:35032) 2023-09-30T22:25:23.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.437+0000 7fe69b7fe700 1 -- 172.21.15.40:0/3700971075 learned_addr learned my addr 172.21.15.40:0/3700971075 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:23.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.437+0000 7fe69bfff700 1 --2- 172.21.15.40:0/3700971075 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe69c139570 0x7fe69c13b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.437+0000 7fe69affd700 1 --2- 172.21.15.40:0/3700971075 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe69c136c50 0x7fe69c139030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.437+0000 7fe69a7fc700 1 -- 172.21.15.40:0/3700971075 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 66921568 0 0) 0x7fe69c133940 con 0x7fe69c133e00 2023-09-30T22:25:23.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.437+0000 7fe69a7fc700 1 -- 172.21.15.40:0/3700971075 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6840035b0 con 0x7fe69c133e00 2023-09-30T22:25:23.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.437+0000 7fe69bfff700 1 -- 172.21.15.40:0/3700971075 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe69c136c50 msgr2=0x7fe69c139030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:23.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.437+0000 7fe69bfff700 1 --2- 172.21.15.40:0/3700971075 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe69c136c50 0x7fe69c139030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.437+0000 7fe69bfff700 1 -- 172.21.15.40:0/3700971075 >> v1:172.21.15.40:6789/0 conn(0x7fe69c133e00 legacy=0x7fe69c1341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.437+0000 7fe69bfff700 1 -- 172.21.15.40:0/3700971075 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe69c09f0d0 con 0x7fe69c139570 2023-09-30T22:25:23.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.437+0000 7fe69affd700 1 --2- 172.21.15.40:0/3700971075 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe69c136c50 0x7fe69c139030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:23.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.437+0000 7fe69bfff700 1 --2- 172.21.15.40:0/3700971075 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe69c139570 0x7fe69c13b950 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe694009dc0 tx=0x7fe69400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c7e52f1e0f83c05 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:23.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.437+0000 7fe69a7fc700 1 -- 172.21.15.40:0/3700971075 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69400e070 con 0x7fe69c139570 2023-09-30T22:25:23.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.437+0000 7fe69a7fc700 1 -- 172.21.15.40:0/3700971075 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe69400bb20 con 0x7fe69c139570 2023-09-30T22:25:23.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.437+0000 7fe69a7fc700 1 -- 172.21.15.40:0/3700971075 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe694012430 con 0x7fe69c139570 2023-09-30T22:25:23.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.438+0000 7fe6a1b0e700 1 -- 172.21.15.40:0/3700971075 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe69c139570 msgr2=0x7fe69c13b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.438+0000 7fe6a1b0e700 1 --2- 172.21.15.40:0/3700971075 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe69c139570 0x7fe69c13b950 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe694009dc0 tx=0x7fe69400b330 comp rx=0 tx=0).stop 2023-09-30T22:25:23.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.438+0000 7fe6a1b0e700 1 -- 172.21.15.40:0/3700971075 shutdown_connections 2023-09-30T22:25:23.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.438+0000 7fe6a1b0e700 1 --2- 172.21.15.40:0/3700971075 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe69c139570 0x7fe69c13b950 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.438+0000 7fe6a1b0e700 1 --2- 172.21.15.40:0/3700971075 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe69c136c50 0x7fe69c139030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.438+0000 7fe6a1b0e700 1 -- 172.21.15.40:0/3700971075 >> 172.21.15.40:0/3700971075 conn(0x7fe69c0a2a00 msgr2=0x7fe69c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:23.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.438+0000 7fe6a1b0e700 1 -- 172.21.15.40:0/3700971075 shutdown_connections 2023-09-30T22:25:23.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.438+0000 7fe6a1b0e700 1 -- 172.21.15.40:0/3700971075 wait complete. 2023-09-30T22:25:23.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.439+0000 7fe6a1b0e700 1 Processor -- start 2023-09-30T22:25:23.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.439+0000 7fe6a1b0e700 1 -- start start 2023-09-30T22:25:23.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.440+0000 7fe6a1b0e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe69c133e00 0x7fe69c119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.440+0000 7fe6a1b0e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe69c136c50 0x7fe69c119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.440+0000 7fe6a1b0e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69c139570 0x7fe69c119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.440+0000 7fe6a1b0e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c0a2110 con 0x7fe69c139570 2023-09-30T22:25:23.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.440+0000 7fe6a1b0e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c11b5b0 con 0x7fe69c136c50 2023-09-30T22:25:23.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.440+0000 7fe6a1b0e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c11c120 con 0x7fe69c133e00 2023-09-30T22:25:23.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.440+0000 7fe69affd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe69c136c50 0x7fe69c119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.440+0000 7fe69affd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe69c136c50 0x7fe69c119590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38966/0 (socket says 172.21.15.40:38966) 2023-09-30T22:25:23.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.440+0000 7fe69b7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe69c133e00 0x7fe69c119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.440+0000 7fe69affd700 1 -- 172.21.15.40:0/1009721753 learned_addr learned my addr 172.21.15.40:0/1009721753 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:23.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.440+0000 7fe69bfff700 1 --2- 172.21.15.40:0/1009721753 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69c139570 0x7fe69c119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.440+0000 7fe69b7fe700 1 -- 172.21.15.40:0/1009721753 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe69c136c50 msgr2=0x7fe69c119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.440+0000 7fe69b7fe700 1 --2- 172.21.15.40:0/1009721753 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe69c136c50 0x7fe69c119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.440+0000 7fe69b7fe700 1 -- 172.21.15.40:0/1009721753 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69c139570 msgr2=0x7fe69c119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.440+0000 7fe69b7fe700 1 --2- 172.21.15.40:0/1009721753 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69c139570 0x7fe69c119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.440+0000 7fe69b7fe700 1 -- 172.21.15.40:0/1009721753 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6900094a0 con 0x7fe69c133e00 2023-09-30T22:25:23.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.440+0000 7fe69b7fe700 1 --2- 172.21.15.40:0/1009721753 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe69c133e00 0x7fe69c119050 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe68c00c4c0 tx=0x7fe68c00c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:23.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.441+0000 7fe683fff700 1 -- 172.21.15.40:0/1009721753 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c005d70 con 0x7fe69c133e00 2023-09-30T22:25:23.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.441+0000 7fe683fff700 1 -- 172.21.15.40:0/1009721753 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68c0070d0 con 0x7fe69c133e00 2023-09-30T22:25:23.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.441+0000 7fe6a1b0e700 1 -- 172.21.15.40:0/1009721753 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe694009a70 con 0x7fe69c133e00 2023-09-30T22:25:23.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.441+0000 7fe683fff700 1 -- 172.21.15.40:0/1009721753 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c007440 con 0x7fe69c133e00 2023-09-30T22:25:23.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.441+0000 7fe6a1b0e700 1 -- 172.21.15.40:0/1009721753 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe69c1391d0 con 0x7fe69c133e00 2023-09-30T22:25:23.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.442+0000 7fe683fff700 1 -- 172.21.15.40:0/1009721753 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe68c0075a0 con 0x7fe69c133e00 2023-09-30T22:25:23.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.442+0000 7fe683fff700 1 -- 172.21.15.40:0/1009721753 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7fe68c03ef40 con 0x7fe69c133e00 2023-09-30T22:25:23.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.442+0000 7fe69affd700 1 -- 172.21.15.40:0/1009721753 >> v1:172.21.15.40:6816/127432 conn(0x7fe68802f510 legacy=0x7fe6880319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:23.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.442+0000 7fe6a1b0e700 1 -- 172.21.15.40:0/1009721753 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe69c062380 con 0x7fe69c133e00 2023-09-30T22:25:23.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.451+0000 7fe683fff700 1 -- 172.21.15.40:0/1009721753 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe68c017020 con 0x7fe69c133e00 2023-09-30T22:25:23.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.474+0000 7f9e03335700 1 Processor -- start 2023-09-30T22:25:23.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.475+0000 7f9e03335700 1 -- start start 2023-09-30T22:25:23.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.475+0000 7f9e03335700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9dfc06f070 0x7f9dfc06f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.475+0000 7f9e03335700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dfc06fdb0 0x7f9dfc0977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.475+0000 7f9e03335700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dfc070830 con 0x7f9dfc06f980 2023-09-30T22:25:23.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.475+0000 7f9e03335700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dfc070ad0 con 0x7f9dfc06f070 2023-09-30T22:25:23.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.475+0000 7f9e03335700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc070de0 con 0x7f9dfc06fdb0 2023-09-30T22:25:23.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.476+0000 7f9e018d2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dfc06fdb0 0x7f9dfc0977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.476+0000 7f9e010d1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9dfc06f070 0x7f9dfc06f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.476+0000 7f9e018d2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dfc06fdb0 0x7f9dfc0977a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38980/0 (socket says 172.21.15.40:38980) 2023-09-30T22:25:23.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.476+0000 7f9e010d1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9dfc06f070 0x7f9dfc06f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44496/0 (socket says 172.21.15.40:44496) 2023-09-30T22:25:23.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.476+0000 7f9e018d2700 1 -- 172.21.15.40:0/93777668 learned_addr learned my addr 172.21.15.40:0/93777668 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:23.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.476+0000 7f9e018d2700 1 -- 172.21.15.40:0/93777668 >> v2:172.21.15.40:3300/0 conn(0x7f9dfc06f070 msgr2=0x7f9dfc06f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:23.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.476+0000 7f9e018d2700 1 --2- 172.21.15.40:0/93777668 >> v2:172.21.15.40:3300/0 conn(0x7f9dfc06f070 0x7f9dfc06f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.476+0000 7f9e018d2700 1 -- 172.21.15.40:0/93777668 >> v1:172.21.15.40:6789/0 conn(0x7f9dfc06f980 legacy=0x7f9dfc097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.476+0000 7f9e018d2700 1 -- 172.21.15.40:0/93777668 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dfc09fe20 con 0x7f9dfc06fdb0 2023-09-30T22:25:23.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.476+0000 7f9e010d1700 1 --2- 172.21.15.40:0/93777668 >> v2:172.21.15.40:3300/0 conn(0x7f9dfc06f070 0x7f9dfc06f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:23.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.476+0000 7f9e018d2700 1 --2- 172.21.15.40:0/93777668 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dfc06fdb0 0x7f9dfc0977a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9df4009e50 tx=0x7f9df400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fab61d25a992b24a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:23.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.476+0000 7f9df3fff700 1 -- 172.21.15.40:0/93777668 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df400e070 con 0x7f9dfc06fdb0 2023-09-30T22:25:23.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.476+0000 7f9df3fff700 1 -- 172.21.15.40:0/93777668 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df400b910 con 0x7f9dfc06fdb0 2023-09-30T22:25:23.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.476+0000 7f9df3fff700 1 -- 172.21.15.40:0/93777668 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df400bcc0 con 0x7f9dfc06fdb0 2023-09-30T22:25:23.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.477+0000 7f9e03335700 1 -- 172.21.15.40:0/93777668 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dfc06fdb0 msgr2=0x7f9dfc0977a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.477+0000 7f9e03335700 1 --2- 172.21.15.40:0/93777668 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dfc06fdb0 0x7f9dfc0977a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9df4009e50 tx=0x7f9df400b330 comp rx=0 tx=0).stop 2023-09-30T22:25:23.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.477+0000 7f9e03335700 1 -- 172.21.15.40:0/93777668 shutdown_connections 2023-09-30T22:25:23.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.477+0000 7f9e03335700 1 --2- 172.21.15.40:0/93777668 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dfc06fdb0 0x7f9dfc0977a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.477+0000 7f9e03335700 1 --2- 172.21.15.40:0/93777668 >> v2:172.21.15.40:3300/0 conn(0x7f9dfc06f070 0x7f9dfc06f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.477+0000 7f9e03335700 1 -- 172.21.15.40:0/93777668 >> 172.21.15.40:0/93777668 conn(0x7f9dfc0a41a0 msgr2=0x7f9dfc0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:23.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.477+0000 7f9e03335700 1 -- 172.21.15.40:0/93777668 shutdown_connections 2023-09-30T22:25:23.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.477+0000 7f9e03335700 1 -- 172.21.15.40:0/93777668 wait complete. 2023-09-30T22:25:23.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.478+0000 7f9e03335700 1 Processor -- start 2023-09-30T22:25:23.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.478+0000 7f9e03335700 1 -- start start 2023-09-30T22:25:23.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.479+0000 7f9e03335700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dfc06f070 0x7f9dfc12d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.479+0000 7f9e03335700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dfc06f980 0x7f9dfc12da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.479+0000 7f9e03335700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9dfc06fdb0 0x7f9dfc12dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.479+0000 7f9e03335700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc12ff30 con 0x7f9dfc06f980 2023-09-30T22:25:23.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.479+0000 7f9e03335700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc130910 con 0x7f9dfc06f070 2023-09-30T22:25:23.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.479+0000 7f9e03335700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc1292a0 con 0x7f9dfc06fdb0 2023-09-30T22:25:23.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.479+0000 7f9e010d1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dfc06f070 0x7f9dfc12d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.479+0000 7f9e008d0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dfc06f980 0x7f9dfc12da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.479+0000 7f9e010d1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dfc06f070 0x7f9dfc12d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38986/0 (socket says 172.21.15.40:38986) 2023-09-30T22:25:23.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.479+0000 7f9e010d1700 1 -- 172.21.15.40:0/3291294028 learned_addr learned my addr 172.21.15.40:0/3291294028 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:23.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.479+0000 7f9e018d2700 1 --2- 172.21.15.40:0/3291294028 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9dfc06fdb0 0x7f9dfc12dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.479+0000 7f9e008d0700 1 -- 172.21.15.40:0/3291294028 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9dfc06fdb0 msgr2=0x7f9dfc12dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.479+0000 7f9e008d0700 1 --2- 172.21.15.40:0/3291294028 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9dfc06fdb0 0x7f9dfc12dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.479+0000 7f9e008d0700 1 -- 172.21.15.40:0/3291294028 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dfc06f070 msgr2=0x7f9dfc12d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.479+0000 7f9e008d0700 1 --2- 172.21.15.40:0/3291294028 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dfc06f070 0x7f9dfc12d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.479+0000 7f9e008d0700 1 -- 172.21.15.40:0/3291294028 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df80094a0 con 0x7f9dfc06f980 2023-09-30T22:25:23.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.479+0000 7f9e010d1700 1 --2- 172.21.15.40:0/3291294028 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dfc06f070 0x7f9dfc12d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:23.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.480+0000 7f9e008d0700 1 --2- 172.21.15.40:0/3291294028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dfc06f980 0x7f9dfc12da70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9dec000f60 tx=0x7f9dec00c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:23.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.480+0000 7f9df1ffb700 1 -- 172.21.15.40:0/3291294028 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec0052d0 con 0x7f9dfc06f980 2023-09-30T22:25:23.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.480+0000 7f9df1ffb700 1 -- 172.21.15.40:0/3291294028 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dec005430 con 0x7f9dfc06f980 2023-09-30T22:25:23.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.480+0000 7f9e03335700 1 -- 172.21.15.40:0/3291294028 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9df4009b30 con 0x7f9dfc06f980 2023-09-30T22:25:23.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.480+0000 7f9df1ffb700 1 -- 172.21.15.40:0/3291294028 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec0038c0 con 0x7f9dfc06f980 2023-09-30T22:25:23.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.480+0000 7f9e03335700 1 -- 172.21.15.40:0/3291294028 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dfc130650 con 0x7f9dfc06f980 2023-09-30T22:25:23.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.481+0000 7f9e03335700 1 -- 172.21.15.40:0/3291294028 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dfc12fb60 con 0x7f9dfc06f980 2023-09-30T22:25:23.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.481+0000 7f9df1ffb700 1 -- 172.21.15.40:0/3291294028 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9dec003a20 con 0x7f9dfc06f980 2023-09-30T22:25:23.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.481+0000 7f9df1ffb700 1 -- 172.21.15.40:0/3291294028 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4137+0+0 (secure 0 0 0) 0x7f9dec03eef0 con 0x7f9dfc06f980 2023-09-30T22:25:23.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.481+0000 7f9e010d1700 1 -- 172.21.15.40:0/3291294028 >> v1:172.21.15.40:6816/127432 conn(0x7f9de002f510 legacy=0x7f9de00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.40:6816/127432 2023-09-30T22:25:23.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.486+0000 7f9df1ffb700 1 -- 172.21.15.40:0/3291294028 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9dec011590 con 0x7f9dfc06f980 2023-09-30T22:25:23.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.527+0000 7f18a8ff9700 1 -- 172.21.15.40:0/2617957450 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f18a001a6b0 con 0x7f18ac09df40 2023-09-30T22:25:23.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.527+0000 7f18a8ff9700 1 -- 172.21.15.40:0/2617957450 >> v1:172.21.15.40:6816/127432 conn(0x7f189802f510 legacy=0x7f18980319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:23.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.527+0000 7fe683fff700 1 -- 172.21.15.40:0/1009721753 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe68c01b8d0 con 0x7fe69c133e00 2023-09-30T22:25:23.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.527+0000 7fe683fff700 1 -- 172.21.15.40:0/1009721753 >> v1:172.21.15.40:6816/127432 conn(0x7fe68802f510 legacy=0x7fe6880319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:23.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.527+0000 7f9df1ffb700 1 -- 172.21.15.40:0/3291294028 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9dec003cd0 con 0x7f9dfc06f980 2023-09-30T22:25:23.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.527+0000 7f9df1ffb700 1 -- 172.21.15.40:0/3291294028 >> v1:172.21.15.40:6816/127432 conn(0x7f9de002f510 legacy=0x7f9de00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:23.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.569+0000 7f18b2650700 1 -- 172.21.15.40:0/2617957450 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f18ac11a1e0 con 0x7f18ac09df40 2023-09-30T22:25:23.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.570+0000 7f18a8ff9700 1 -- 172.21.15.40:0/2617957450 <== mon.2 v2:172.21.15.40:3302/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f18ac11a1e0 con 0x7f18ac09df40 2023-09-30T22:25:23.570 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:23.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.573+0000 7f18b2650700 1 -- 172.21.15.40:0/2617957450 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18ac09df40 msgr2=0x7f18ac06f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.573+0000 7f18b2650700 1 --2- 172.21.15.40:0/2617957450 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18ac09df40 0x7f18ac06f4a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f18a000b3c0 tx=0x7f18a000b6d0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.573+0000 7f18b2650700 1 -- 172.21.15.40:0/2617957450 shutdown_connections 2023-09-30T22:25:23.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.573+0000 7f18b2650700 1 --2- 172.21.15.40:0/2617957450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18ac133e00 0x7f18ac06f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.573+0000 7f18b2650700 1 --2- 172.21.15.40:0/2617957450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18ac09d400 0x7f18ac06ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.573+0000 7f18b2650700 1 --2- 172.21.15.40:0/2617957450 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18ac09df40 0x7f18ac06f4a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.573+0000 7f18b2650700 1 -- 172.21.15.40:0/2617957450 >> 172.21.15.40:0/2617957450 conn(0x7f18ac0a2a00 msgr2=0x7f18ac12d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:23.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.573+0000 7f18b2650700 1 -- 172.21.15.40:0/2617957450 shutdown_connections 2023-09-30T22:25:23.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.573+0000 7f18b2650700 1 -- 172.21.15.40:0/2617957450 wait complete. 2023-09-30T22:25:23.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:23.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.662+0000 7fe6a1b0e700 1 -- 172.21.15.40:0/1009721753 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe69c11aa80 con 0x7fe69c133e00 2023-09-30T22:25:23.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.663+0000 7fe683fff700 1 -- 172.21.15.40:0/1009721753 <== mon.2 v2:172.21.15.40:3302/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe68c019d70 con 0x7fe69c133e00 2023-09-30T22:25:23.663 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:23.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.665+0000 7fe6a1b0e700 1 -- 172.21.15.40:0/1009721753 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe69c133e00 msgr2=0x7fe69c119050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.665+0000 7fe6a1b0e700 1 --2- 172.21.15.40:0/1009721753 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe69c133e00 0x7fe69c119050 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe68c00c4c0 tx=0x7fe68c00c7d0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.665+0000 7fe6a1b0e700 1 -- 172.21.15.40:0/1009721753 shutdown_connections 2023-09-30T22:25:23.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.665+0000 7fe6a1b0e700 1 --2- 172.21.15.40:0/1009721753 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe69c133e00 0x7fe69c119050 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.665+0000 7fe6a1b0e700 1 --2- 172.21.15.40:0/1009721753 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69c139570 0x7fe69c119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.665+0000 7fe6a1b0e700 1 --2- 172.21.15.40:0/1009721753 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe69c136c50 0x7fe69c119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.665+0000 7fe6a1b0e700 1 -- 172.21.15.40:0/1009721753 >> 172.21.15.40:0/1009721753 conn(0x7fe69c0a2a00 msgr2=0x7fe69c130420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:23.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.665+0000 7fe6a1b0e700 1 -- 172.21.15.40:0/1009721753 shutdown_connections 2023-09-30T22:25:23.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.665+0000 7fe6a1b0e700 1 -- 172.21.15.40:0/1009721753 wait complete. 2023-09-30T22:25:23.678 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:23.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.703+0000 7f9e03335700 1 -- 172.21.15.40:0/3291294028 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9dfc0a02c0 con 0x7f9dfc06f980 2023-09-30T22:25:23.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.703+0000 7f9df1ffb700 1 -- 172.21.15.40:0/3291294028 <== mon.0 v2:172.21.15.40:3300/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9dec017070 con 0x7f9dfc06f980 2023-09-30T22:25:23.704 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:23.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.705+0000 7f9e03335700 1 -- 172.21.15.40:0/3291294028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dfc06f980 msgr2=0x7f9dfc12da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.705+0000 7f9e03335700 1 --2- 172.21.15.40:0/3291294028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dfc06f980 0x7f9dfc12da70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9dec000f60 tx=0x7f9dec00c730 comp rx=0 tx=0).stop 2023-09-30T22:25:23.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.706+0000 7f9e03335700 1 -- 172.21.15.40:0/3291294028 shutdown_connections 2023-09-30T22:25:23.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.706+0000 7f9e03335700 1 --2- 172.21.15.40:0/3291294028 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9dfc06fdb0 0x7f9dfc12dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.706+0000 7f9e03335700 1 --2- 172.21.15.40:0/3291294028 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dfc06f070 0x7f9dfc12d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.706+0000 7f9e03335700 1 --2- 172.21.15.40:0/3291294028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dfc06f980 0x7f9dfc12da70 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.706+0000 7f9e03335700 1 -- 172.21.15.40:0/3291294028 >> 172.21.15.40:0/3291294028 conn(0x7f9dfc0a41a0 msgr2=0x7f9dfc097580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:23.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.706+0000 7f9e03335700 1 -- 172.21.15.40:0/3291294028 shutdown_connections 2023-09-30T22:25:23.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:23.706+0000 7f9e03335700 1 -- 172.21.15.40:0/3291294028 wait complete. 2023-09-30T22:25:23.718 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:24.422 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:24.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.565+0000 7fb3ce22d700 1 Processor -- start 2023-09-30T22:25:24.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.565+0000 7fb3ce22d700 1 -- start start 2023-09-30T22:25:24.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.565+0000 7fb3ce22d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb3c809c890 0x7fb3c809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.565+0000 7fb3ce22d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb3c809d920 0x7fb3c809dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.565+0000 7fb3ce22d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3c80a2600 con 0x7fb3c809e2b0 2023-09-30T22:25:24.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.565+0000 7fb3ce22d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c80a29d0 con 0x7fb3c809c890 2023-09-30T22:25:24.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.565+0000 7fb3ce22d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c809fb40 con 0x7fb3c809d920 2023-09-30T22:25:24.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.565+0000 7fb3c77fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb3c809c890 0x7fb3c809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.565+0000 7fb3c77fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb3c809c890 0x7fb3c809cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39002/0 (socket says 172.21.15.40:39002) 2023-09-30T22:25:24.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.565+0000 7fb3c77fe700 1 -- 172.21.15.40:0/4132699029 learned_addr learned my addr 172.21.15.40:0/4132699029 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:24.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.565+0000 7fb3c6ffd700 1 --2- 172.21.15.40:0/4132699029 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb3c809d920 0x7fb3c809dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.566+0000 7fb3c77fe700 1 -- 172.21.15.40:0/4132699029 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb3c809d920 msgr2=0x7fb3c809dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:24.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.566+0000 7fb3c77fe700 1 --2- 172.21.15.40:0/4132699029 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb3c809d920 0x7fb3c809dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.566+0000 7fb3c77fe700 1 -- 172.21.15.40:0/4132699029 >> v1:172.21.15.40:6789/0 conn(0x7fb3c809e2b0 legacy=0x7fb3c813ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.566+0000 7fb3c77fe700 1 -- 172.21.15.40:0/4132699029 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c809e720 con 0x7fb3c809c890 2023-09-30T22:25:24.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.566+0000 7fb3c6ffd700 1 --2- 172.21.15.40:0/4132699029 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb3c809d920 0x7fb3c809dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:24.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.566+0000 7fb3c77fe700 1 --2- 172.21.15.40:0/4132699029 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb3c809c890 0x7fb3c809cc60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb3b80098f0 tx=0x7fb3b8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8bf178430496b17 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:24.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.566+0000 7fb3c67fc700 1 -- 172.21.15.40:0/4132699029 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8005e30 con 0x7fb3c809c890 2023-09-30T22:25:24.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.566+0000 7fb3c67fc700 1 -- 172.21.15.40:0/4132699029 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b8004030 con 0x7fb3c809c890 2023-09-30T22:25:24.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.566+0000 7fb3c67fc700 1 -- 172.21.15.40:0/4132699029 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b80043e0 con 0x7fb3c809c890 2023-09-30T22:25:24.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.566+0000 7fb3ce22d700 1 -- 172.21.15.40:0/4132699029 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb3c809c890 msgr2=0x7fb3c809cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.567+0000 7fb3ce22d700 1 --2- 172.21.15.40:0/4132699029 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb3c809c890 0x7fb3c809cc60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb3b80098f0 tx=0x7fb3b8009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:24.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.567+0000 7fb3ce22d700 1 -- 172.21.15.40:0/4132699029 shutdown_connections 2023-09-30T22:25:24.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.567+0000 7fb3ce22d700 1 --2- 172.21.15.40:0/4132699029 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb3c809c890 0x7fb3c809cc60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.567+0000 7fb3ce22d700 1 --2- 172.21.15.40:0/4132699029 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb3c809d920 0x7fb3c809dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.567+0000 7fb3ce22d700 1 -- 172.21.15.40:0/4132699029 >> 172.21.15.40:0/4132699029 conn(0x7fb3c80a7080 msgr2=0x7fb3c80a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:24.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.567+0000 7fb3ce22d700 1 -- 172.21.15.40:0/4132699029 shutdown_connections 2023-09-30T22:25:24.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.567+0000 7fb3ce22d700 1 -- 172.21.15.40:0/4132699029 wait complete. 2023-09-30T22:25:24.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.568+0000 7fb3ce22d700 1 Processor -- start 2023-09-30T22:25:24.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.568+0000 7fb3ce22d700 1 -- start start 2023-09-30T22:25:24.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.569+0000 7fb3ce22d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb3c809c890 0x7fb3c812d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.569+0000 7fb3ce22d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb3c809d920 0x7fb3c812d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.569+0000 7fb3ce22d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3c809e2b0 0x7fb3c812df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.569+0000 7fb3ce22d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c812f230 con 0x7fb3c809e2b0 2023-09-30T22:25:24.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.569+0000 7fb3ce22d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c80a5dd0 con 0x7fb3c809c890 2023-09-30T22:25:24.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.569+0000 7fb3ce22d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c81300a0 con 0x7fb3c809d920 2023-09-30T22:25:24.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.569+0000 7fb3c77fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb3c809c890 0x7fb3c812d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.569+0000 7fb3c7fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3c809e2b0 0x7fb3c812df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.569+0000 7fb3c77fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb3c809c890 0x7fb3c812d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39014/0 (socket says 172.21.15.40:39014) 2023-09-30T22:25:24.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.569+0000 7fb3c77fe700 1 -- 172.21.15.40:0/639527922 learned_addr learned my addr 172.21.15.40:0/639527922 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:24.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.569+0000 7fb3c6ffd700 1 --2- 172.21.15.40:0/639527922 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb3c809d920 0x7fb3c812d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.569+0000 7fb3c77fe700 1 -- 172.21.15.40:0/639527922 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb3c809d920 msgr2=0x7fb3c812d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.569+0000 7fb3c77fe700 1 --2- 172.21.15.40:0/639527922 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb3c809d920 0x7fb3c812d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.569+0000 7fb3c77fe700 1 -- 172.21.15.40:0/639527922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3c809e2b0 msgr2=0x7fb3c812df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.569+0000 7fb3c77fe700 1 --2- 172.21.15.40:0/639527922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3c809e2b0 0x7fb3c812df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.569+0000 7fb3c77fe700 1 -- 172.21.15.40:0/639527922 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b00094a0 con 0x7fb3c809c890 2023-09-30T22:25:24.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.569+0000 7fb3c77fe700 1 --2- 172.21.15.40:0/639527922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb3c809c890 0x7fb3c812d4b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8000c00 tx=0x7fb3b8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:24.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.570+0000 7fb3bffff700 1 -- 172.21.15.40:0/639527922 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b801c420 con 0x7fb3c809c890 2023-09-30T22:25:24.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.570+0000 7fb3bffff700 1 -- 172.21.15.40:0/639527922 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b801c5a0 con 0x7fb3c809c890 2023-09-30T22:25:24.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.570+0000 7fb3bffff700 1 -- 172.21.15.40:0/639527922 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b801c950 con 0x7fb3c809c890 2023-09-30T22:25:24.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.570+0000 7fb3ce22d700 1 -- 172.21.15.40:0/639527922 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3b8009500 con 0x7fb3c809c890 2023-09-30T22:25:24.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.570+0000 7fb3ce22d700 1 -- 172.21.15.40:0/639527922 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c81304f0 con 0x7fb3c809c890 2023-09-30T22:25:24.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.570+0000 7fb3bffff700 1 -- 172.21.15.40:0/639527922 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb3b801cab0 con 0x7fb3c809c890 2023-09-30T22:25:24.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.571+0000 7fb3bffff700 1 -- 172.21.15.40:0/639527922 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb3b8040690 con 0x7fb3c809c890 2023-09-30T22:25:24.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.571+0000 7fb3ce22d700 1 -- 172.21.15.40:0/639527922 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3c8062380 con 0x7fb3c809c890 2023-09-30T22:25:24.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.575+0000 7fb3bffff700 1 -- 172.21.15.40:0/639527922 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb3b8016080 con 0x7fb3c809c890 2023-09-30T22:25:24.591 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:24.679 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:24.719 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:24.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.724+0000 7f3c83a88700 1 Processor -- start 2023-09-30T22:25:24.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.724+0000 7f3c83a88700 1 -- start start 2023-09-30T22:25:24.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.724+0000 7f3c83a88700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3c7c138250 0x7f3c7c138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.724+0000 7f3c83a88700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c7c09d400 0x7f3c7c09d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.724+0000 7f3c83a88700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c7c137e20 con 0x7f3c7c09dd50 2023-09-30T22:25:24.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.724+0000 7f3c83a88700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c7c138050 con 0x7f3c7c138250 2023-09-30T22:25:24.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.724+0000 7f3c83a88700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7c09b010 con 0x7f3c7c09d400 2023-09-30T22:25:24.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.725+0000 7f3c81023700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c7c09d400 0x7f3c7c09d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.725+0000 7f3c81023700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c7c09d400 0x7f3c7c09d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39016/0 (socket says 172.21.15.40:39016) 2023-09-30T22:25:24.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.725+0000 7f3c81023700 1 -- 172.21.15.40:0/119608614 learned_addr learned my addr 172.21.15.40:0/119608614 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:24.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.725+0000 7f3c81824700 1 --2- 172.21.15.40:0/119608614 >> v2:172.21.15.40:3300/0 conn(0x7f3c7c138250 0x7f3c7c138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.725+0000 7f3c81824700 1 -- 172.21.15.40:0/119608614 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c7c09d400 msgr2=0x7f3c7c09d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:24.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.725+0000 7f3c81824700 1 --2- 172.21.15.40:0/119608614 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c7c09d400 0x7f3c7c09d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.725+0000 7f3c81824700 1 -- 172.21.15.40:0/119608614 >> v1:172.21.15.40:6789/0 conn(0x7f3c7c09dd50 legacy=0x7f3c7c13f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.725+0000 7f3c81824700 1 -- 172.21.15.40:0/119608614 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c7c09f1f0 con 0x7f3c7c138250 2023-09-30T22:25:24.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.725+0000 7f3c81824700 1 --2- 172.21.15.40:0/119608614 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c7c138250 0x7f3c7c138620 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3c78009840 tx=0x7f3c78009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10b50806f77039d0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:24.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.725+0000 7f3c80822700 1 -- 172.21.15.40:0/119608614 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c78011830 con 0x7f3c7c138250 2023-09-30T22:25:24.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.726+0000 7f3c80822700 1 -- 172.21.15.40:0/119608614 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c78011990 con 0x7f3c7c138250 2023-09-30T22:25:24.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.726+0000 7f3c80822700 1 -- 172.21.15.40:0/119608614 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c78011d20 con 0x7f3c7c138250 2023-09-30T22:25:24.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.726+0000 7f3c83a88700 1 -- 172.21.15.40:0/119608614 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c7c138250 msgr2=0x7f3c7c138620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.726+0000 7f3c83a88700 1 --2- 172.21.15.40:0/119608614 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c7c138250 0x7f3c7c138620 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3c78009840 tx=0x7f3c78009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:24.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.726+0000 7f3c83a88700 1 -- 172.21.15.40:0/119608614 shutdown_connections 2023-09-30T22:25:24.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.726+0000 7f3c83a88700 1 --2- 172.21.15.40:0/119608614 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c7c138250 0x7f3c7c138620 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.726+0000 7f3c83a88700 1 --2- 172.21.15.40:0/119608614 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c7c09d400 0x7f3c7c09d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.727+0000 7f3c83a88700 1 -- 172.21.15.40:0/119608614 >> 172.21.15.40:0/119608614 conn(0x7f3c7c0a2a00 msgr2=0x7f3c7c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:24.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.727+0000 7f3c83a88700 1 -- 172.21.15.40:0/119608614 shutdown_connections 2023-09-30T22:25:24.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.727+0000 7f3c83a88700 1 -- 172.21.15.40:0/119608614 wait complete. 2023-09-30T22:25:24.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.728+0000 7f3c83a88700 1 Processor -- start 2023-09-30T22:25:24.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.728+0000 7f3c83a88700 1 -- start start 2023-09-30T22:25:24.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.729+0000 7f3c83a88700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c7c09d400 0x7f3c7c127570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.729+0000 7f3c83a88700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c7c09dd50 0x7f3c7c127ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.729+0000 7f3c83a88700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c7c138250 0x7f3c7c126120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.729+0000 7f3c83a88700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7c140b80 con 0x7f3c7c09dd50 2023-09-30T22:25:24.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.729+0000 7f3c83a88700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7c09a300 con 0x7f3c7c138250 2023-09-30T22:25:24.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.729+0000 7f3c83a88700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7c135750 con 0x7f3c7c09d400 2023-09-30T22:25:24.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.729+0000 7f3c82025700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c7c138250 0x7f3c7c126120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.729+0000 7f3c82025700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c7c138250 0x7f3c7c126120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39030/0 (socket says 172.21.15.40:39030) 2023-09-30T22:25:24.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.729+0000 7f3c82025700 1 -- 172.21.15.40:0/2114608959 learned_addr learned my addr 172.21.15.40:0/2114608959 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:24.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.729+0000 7f3c81023700 1 --2- 172.21.15.40:0/2114608959 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c7c09dd50 0x7f3c7c127ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.729+0000 7f3c81824700 1 --2- 172.21.15.40:0/2114608959 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c7c09d400 0x7f3c7c127570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.729+0000 7f3c82025700 1 -- 172.21.15.40:0/2114608959 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c7c09d400 msgr2=0x7f3c7c127570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.729+0000 7f3c82025700 1 --2- 172.21.15.40:0/2114608959 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c7c09d400 0x7f3c7c127570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.729+0000 7f3c82025700 1 -- 172.21.15.40:0/2114608959 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c7c09dd50 msgr2=0x7f3c7c127ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.729+0000 7f3c82025700 1 --2- 172.21.15.40:0/2114608959 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c7c09dd50 0x7f3c7c127ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.729+0000 7f3c82025700 1 -- 172.21.15.40:0/2114608959 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c780094a0 con 0x7f3c7c138250 2023-09-30T22:25:24.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.730+0000 7f3c82025700 1 --2- 172.21.15.40:0/2114608959 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c7c138250 0x7f3c7c126120 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3c7400cc50 tx=0x7f3c7400cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:24.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.730+0000 7f3c727fc700 1 -- 172.21.15.40:0/2114608959 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c74003c00 con 0x7f3c7c138250 2023-09-30T22:25:24.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.730+0000 7f3c727fc700 1 -- 172.21.15.40:0/2114608959 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c74003d60 con 0x7f3c7c138250 2023-09-30T22:25:24.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.730+0000 7f3c83a88700 1 -- 172.21.15.40:0/2114608959 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c7c127ff0 con 0x7f3c7c138250 2023-09-30T22:25:24.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.730+0000 7f3c727fc700 1 -- 172.21.15.40:0/2114608959 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7400aab0 con 0x7f3c7c138250 2023-09-30T22:25:24.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.730+0000 7f3c83a88700 1 -- 172.21.15.40:0/2114608959 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c7c13f5a0 con 0x7f3c7c138250 2023-09-30T22:25:24.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.731+0000 7f3c83a88700 1 -- 172.21.15.40:0/2114608959 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c7c13e7d0 con 0x7f3c7c138250 2023-09-30T22:25:24.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.731+0000 7f3c727fc700 1 -- 172.21.15.40:0/2114608959 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3c7400ac10 con 0x7f3c7c138250 2023-09-30T22:25:24.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.731+0000 7f3c727fc700 1 -- 172.21.15.40:0/2114608959 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3c7403f670 con 0x7f3c7c138250 2023-09-30T22:25:24.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.740+0000 7f3c727fc700 1 -- 172.21.15.40:0/2114608959 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3c7c13e7d0 con 0x7f3c7c138250 2023-09-30T22:25:24.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.789+0000 7fb3ce22d700 1 -- 172.21.15.40:0/639527922 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb3c8074620 con 0x7fb3c809c890 2023-09-30T22:25:24.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.790+0000 7fb3bffff700 1 -- 172.21.15.40:0/639527922 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb3b802a020 con 0x7fb3c809c890 2023-09-30T22:25:24.790 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:24.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.792+0000 7fb3ce22d700 1 -- 172.21.15.40:0/639527922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb3c809c890 msgr2=0x7fb3c812d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.792+0000 7fb3ce22d700 1 --2- 172.21.15.40:0/639527922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb3c809c890 0x7fb3c812d4b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8000c00 tx=0x7fb3b8004750 comp rx=0 tx=0).stop 2023-09-30T22:25:24.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.792+0000 7fb3ce22d700 1 -- 172.21.15.40:0/639527922 shutdown_connections 2023-09-30T22:25:24.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.792+0000 7fb3ce22d700 1 --2- 172.21.15.40:0/639527922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3c809e2b0 0x7fb3c812df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.792+0000 7fb3ce22d700 1 --2- 172.21.15.40:0/639527922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb3c809c890 0x7fb3c812d4b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.792+0000 7fb3ce22d700 1 --2- 172.21.15.40:0/639527922 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb3c809d920 0x7fb3c812d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.792+0000 7fb3ce22d700 1 -- 172.21.15.40:0/639527922 >> 172.21.15.40:0/639527922 conn(0x7fb3c80a7080 msgr2=0x7fb3c80a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:24.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.792+0000 7fb3ce22d700 1 -- 172.21.15.40:0/639527922 shutdown_connections 2023-09-30T22:25:24.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.792+0000 7fb3ce22d700 1 -- 172.21.15.40:0/639527922 wait complete. 2023-09-30T22:25:24.807 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:24.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.817+0000 7f0782d97700 1 Processor -- start 2023-09-30T22:25:24.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.818+0000 7f0782d97700 1 -- start start 2023-09-30T22:25:24.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.818+0000 7f0782d97700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f077c09c890 0x7f077c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.818+0000 7f0782d97700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f077c09d920 0x7f077c09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.818+0000 7f0782d97700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f077c09e2b0 0x7f077c13ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.818+0000 7f0782d97700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f077c0a29d0 con 0x7f077c09d920 2023-09-30T22:25:24.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.818+0000 7f0782d97700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077c09fb40 con 0x7f077c09c890 2023-09-30T22:25:24.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.818+0000 7f0782d97700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f077c0a2600 con 0x7f077c09e2b0 2023-09-30T22:25:24.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.818+0000 7f0780b33700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f077c09c890 0x7f077c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.818+0000 7f0780b33700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f077c09c890 0x7f077c09cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39034/0 (socket says 172.21.15.40:39034) 2023-09-30T22:25:24.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.818+0000 7f0780b33700 1 -- 172.21.15.40:0/1173342131 learned_addr learned my addr 172.21.15.40:0/1173342131 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:24.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.818+0000 7f0781334700 1 --2- 172.21.15.40:0/1173342131 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f077c09e2b0 0x7f077c13ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.818+0000 7f077bfff700 1 --2- 172.21.15.40:0/1173342131 >> v2:172.21.15.40:3300/0 conn(0x7f077c09d920 0x7f077c09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.819+0000 7f0781334700 1 -- 172.21.15.40:0/1173342131 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f077c09c890 msgr2=0x7f077c09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:24.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.819+0000 7f0781334700 1 --2- 172.21.15.40:0/1173342131 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f077c09c890 0x7f077c09cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.819+0000 7f0781334700 1 -- 172.21.15.40:0/1173342131 >> v2:172.21.15.40:3300/0 conn(0x7f077c09d920 msgr2=0x7f077c09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:24.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.819+0000 7f0781334700 1 --2- 172.21.15.40:0/1173342131 >> v2:172.21.15.40:3300/0 conn(0x7f077c09d920 0x7f077c09dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.819+0000 7f0781334700 1 -- 172.21.15.40:0/1173342131 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077c09e750 con 0x7f077c09e2b0 2023-09-30T22:25:24.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.819+0000 7f0780b33700 1 --2- 172.21.15.40:0/1173342131 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f077c09c890 0x7f077c09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:24.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.819+0000 7f0781334700 1 --2- 172.21.15.40:0/1173342131 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f077c09e2b0 0x7f077c13ac10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0774009d90 tx=0x7f077400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ba342c4085bf6a8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:24.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.819+0000 7f077b7fe700 1 -- 172.21.15.40:0/1173342131 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077400e070 con 0x7f077c09e2b0 2023-09-30T22:25:24.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.819+0000 7f077b7fe700 1 -- 172.21.15.40:0/1173342131 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077400bb20 con 0x7f077c09e2b0 2023-09-30T22:25:24.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.819+0000 7f077b7fe700 1 -- 172.21.15.40:0/1173342131 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0774012430 con 0x7f077c09e2b0 2023-09-30T22:25:24.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.820+0000 7f0782d97700 1 -- 172.21.15.40:0/1173342131 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f077c09e2b0 msgr2=0x7f077c13ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.820+0000 7f0782d97700 1 --2- 172.21.15.40:0/1173342131 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f077c09e2b0 0x7f077c13ac10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0774009d90 tx=0x7f077400b330 comp rx=0 tx=0).stop 2023-09-30T22:25:24.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.820+0000 7f0782d97700 1 -- 172.21.15.40:0/1173342131 shutdown_connections 2023-09-30T22:25:24.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.820+0000 7f0782d97700 1 --2- 172.21.15.40:0/1173342131 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f077c09e2b0 0x7f077c13ac10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.820+0000 7f0782d97700 1 --2- 172.21.15.40:0/1173342131 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f077c09c890 0x7f077c09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.820+0000 7f0782d97700 1 --2- 172.21.15.40:0/1173342131 >> v2:172.21.15.40:3300/0 conn(0x7f077c09d920 0x7f077c09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.820+0000 7f0782d97700 1 -- 172.21.15.40:0/1173342131 >> 172.21.15.40:0/1173342131 conn(0x7f077c0a7080 msgr2=0x7f077c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:24.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.820+0000 7f0782d97700 1 -- 172.21.15.40:0/1173342131 shutdown_connections 2023-09-30T22:25:24.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.820+0000 7f0782d97700 1 -- 172.21.15.40:0/1173342131 wait complete. 2023-09-30T22:25:24.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.821+0000 7f0782d97700 1 Processor -- start 2023-09-30T22:25:24.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.821+0000 7f0782d97700 1 -- start start 2023-09-30T22:25:24.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.821+0000 7f0782d97700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f077c09c890 0x7f077c12d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.821+0000 7f0782d97700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f077c09d920 0x7f077c12dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.821+0000 7f0782d97700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f077c09e2b0 0x7f077c12e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.821+0000 7f0782d97700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077c09c490 con 0x7f077c09c890 2023-09-30T22:25:24.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.821+0000 7f0782d97700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077c12f820 con 0x7f077c09e2b0 2023-09-30T22:25:24.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.821+0000 7f0782d97700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f077c130bd0 con 0x7f077c09d920 2023-09-30T22:25:24.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.822+0000 7f077bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f077c09d920 0x7f077c12dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.822+0000 7f077bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f077c09d920 0x7f077c12dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48026/0 (socket says 172.21.15.40:48026) 2023-09-30T22:25:24.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.822+0000 7f077bfff700 1 -- 172.21.15.40:0/3066716701 learned_addr learned my addr 172.21.15.40:0/3066716701 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:24.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.822+0000 7f0780b33700 1 --2- 172.21.15.40:0/3066716701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f077c09c890 0x7f077c12d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.822+0000 7f0781334700 1 --2- 172.21.15.40:0/3066716701 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f077c09e2b0 0x7f077c12e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.822+0000 7f077bfff700 1 -- 172.21.15.40:0/3066716701 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f077c09e2b0 msgr2=0x7f077c12e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.822+0000 7f077bfff700 1 --2- 172.21.15.40:0/3066716701 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f077c09e2b0 0x7f077c12e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.822+0000 7f077bfff700 1 -- 172.21.15.40:0/3066716701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f077c09c890 msgr2=0x7f077c12d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.822+0000 7f077bfff700 1 --2- 172.21.15.40:0/3066716701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f077c09c890 0x7f077c12d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.822+0000 7f077bfff700 1 -- 172.21.15.40:0/3066716701 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0770009500 con 0x7f077c09d920 2023-09-30T22:25:24.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.822+0000 7f0781334700 1 --2- 172.21.15.40:0/3066716701 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f077c09e2b0 0x7f077c12e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:24.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.822+0000 7f077bfff700 1 --2- 172.21.15.40:0/3066716701 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f077c09d920 0x7f077c12dc70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f076800e980 tx=0x7f076800ed40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:24.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.822+0000 7f07797fa700 1 -- 172.21.15.40:0/3066716701 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0768009710 con 0x7f077c09d920 2023-09-30T22:25:24.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.822+0000 7f07797fa700 1 -- 172.21.15.40:0/3066716701 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076800eec0 con 0x7f077c09d920 2023-09-30T22:25:24.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.822+0000 7f0782d97700 1 -- 172.21.15.40:0/3066716701 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0774009a70 con 0x7f077c09d920 2023-09-30T22:25:24.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.822+0000 7f07797fa700 1 -- 172.21.15.40:0/3066716701 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076800ca70 con 0x7f077c09d920 2023-09-30T22:25:24.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.822+0000 7f0782d97700 1 -- 172.21.15.40:0/3066716701 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f077c130910 con 0x7f077c09d920 2023-09-30T22:25:24.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.823+0000 7f07797fa700 1 -- 172.21.15.40:0/3066716701 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f076800cbd0 con 0x7f077c09d920 2023-09-30T22:25:24.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.823+0000 7f07797fa700 1 -- 172.21.15.40:0/3066716701 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f076803f8e0 con 0x7f077c09d920 2023-09-30T22:25:24.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.824+0000 7f0782d97700 1 -- 172.21.15.40:0/3066716701 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f077c062380 con 0x7f077c09d920 2023-09-30T22:25:24.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.833+0000 7f07797fa700 1 -- 172.21.15.40:0/3066716701 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0768021070 con 0x7f077c09d920 2023-09-30T22:25:24.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.862+0000 7fdb2da9f700 1 Processor -- start 2023-09-30T22:25:24.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.862+0000 7fdb2da9f700 1 -- start start 2023-09-30T22:25:24.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.863+0000 7fdb2da9f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb2809d920 0x7fdb2809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.863+0000 7fdb2da9f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb2809e230 0x7fdb281343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.863+0000 7fdb2da9f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb2809f940 con 0x7fdb2809f0f0 2023-09-30T22:25:24.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.863+0000 7fdb2da9f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2806b4c0 con 0x7fdb2809e230 2023-09-30T22:25:24.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.863+0000 7fdb2da9f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2809a8f0 con 0x7fdb2809d920 2023-09-30T22:25:24.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.863+0000 7fdb26ffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fdb2809f0f0 0x7fdb28133ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:35066/0 (socket says 172.21.15.40:35066) 2023-09-30T22:25:24.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.863+0000 7fdb26ffd700 1 -- 172.21.15.40:0/4031004625 learned_addr learned my addr 172.21.15.40:0/4031004625 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:24.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.863+0000 7fdb27fff700 1 --2- 172.21.15.40:0/4031004625 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb2809e230 0x7fdb281343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.863+0000 7fdb277fe700 1 --2- 172.21.15.40:0/4031004625 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb2809d920 0x7fdb2809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.863+0000 7fdb267fc700 1 -- 172.21.15.40:0/4031004625 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2445631766 0 0) 0x7fdb2809f940 con 0x7fdb2809f0f0 2023-09-30T22:25:24.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.863+0000 7fdb267fc700 1 -- 172.21.15.40:0/4031004625 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb100035b0 con 0x7fdb2809f0f0 2023-09-30T22:25:24.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.863+0000 7fdb27fff700 1 -- 172.21.15.40:0/4031004625 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb2809d920 msgr2=0x7fdb2809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:24.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.863+0000 7fdb27fff700 1 --2- 172.21.15.40:0/4031004625 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb2809d920 0x7fdb2809dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.863+0000 7fdb27fff700 1 -- 172.21.15.40:0/4031004625 >> v1:172.21.15.40:6789/0 conn(0x7fdb2809f0f0 legacy=0x7fdb28133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.863+0000 7fdb27fff700 1 -- 172.21.15.40:0/4031004625 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb2809f6e0 con 0x7fdb2809e230 2023-09-30T22:25:24.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.863+0000 7fdb277fe700 1 --2- 172.21.15.40:0/4031004625 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb2809d920 0x7fdb2809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:24.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.863+0000 7fdb27fff700 1 --2- 172.21.15.40:0/4031004625 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb2809e230 0x7fdb281343b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdb20009dc0 tx=0x7fdb2000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c89d8b189bbb1cda server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:24.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.864+0000 7fdb267fc700 1 -- 172.21.15.40:0/4031004625 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2000e070 con 0x7fdb2809e230 2023-09-30T22:25:24.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.864+0000 7fdb267fc700 1 -- 172.21.15.40:0/4031004625 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2000bae0 con 0x7fdb2809e230 2023-09-30T22:25:24.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.864+0000 7fdb267fc700 1 -- 172.21.15.40:0/4031004625 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2000be90 con 0x7fdb2809e230 2023-09-30T22:25:24.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.864+0000 7fdb2da9f700 1 -- 172.21.15.40:0/4031004625 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb2809e230 msgr2=0x7fdb281343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.864+0000 7fdb2da9f700 1 --2- 172.21.15.40:0/4031004625 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb2809e230 0x7fdb281343b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdb20009dc0 tx=0x7fdb2000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:24.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.864+0000 7fdb2da9f700 1 -- 172.21.15.40:0/4031004625 shutdown_connections 2023-09-30T22:25:24.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.864+0000 7fdb2da9f700 1 --2- 172.21.15.40:0/4031004625 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb2809e230 0x7fdb281343b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.864+0000 7fdb2da9f700 1 --2- 172.21.15.40:0/4031004625 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb2809d920 0x7fdb2809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.864+0000 7fdb2da9f700 1 -- 172.21.15.40:0/4031004625 >> 172.21.15.40:0/4031004625 conn(0x7fdb2809fb20 msgr2=0x7fdb2809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:24.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.864+0000 7fdb2da9f700 1 -- 172.21.15.40:0/4031004625 shutdown_connections 2023-09-30T22:25:24.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.864+0000 7fdb2da9f700 1 -- 172.21.15.40:0/4031004625 wait complete. 2023-09-30T22:25:24.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.866+0000 7fdb2da9f700 1 Processor -- start 2023-09-30T22:25:24.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.866+0000 7fdb2da9f700 1 -- start start 2023-09-30T22:25:24.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.867+0000 7fdb2da9f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb2809d920 0x7fdb28122660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.867+0000 7fdb2da9f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb2809e230 0x7fdb28122ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.867+0000 7fdb2da9f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb281230e0 0x7fdb281ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.867+0000 7fdb2da9f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb28133a30 con 0x7fdb2809d920 2023-09-30T22:25:24.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.867+0000 7fdb2da9f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb28125100 con 0x7fdb281230e0 2023-09-30T22:25:24.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.867+0000 7fdb2da9f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb28125be0 con 0x7fdb2809e230 2023-09-30T22:25:24.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.867+0000 7fdb277fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb2809d920 0x7fdb28122660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.867+0000 7fdb277fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb2809d920 0x7fdb28122660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44566/0 (socket says 172.21.15.40:44566) 2023-09-30T22:25:24.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.867+0000 7fdb277fe700 1 -- 172.21.15.40:0/2953928679 learned_addr learned my addr 172.21.15.40:0/2953928679 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:24.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.867+0000 7fdb26ffd700 1 --2- 172.21.15.40:0/2953928679 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb2809e230 0x7fdb28122ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.867+0000 7fdb27fff700 1 --2- 172.21.15.40:0/2953928679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb281230e0 0x7fdb281ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.867+0000 7fdb277fe700 1 -- 172.21.15.40:0/2953928679 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb2809e230 msgr2=0x7fdb28122ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.867+0000 7fdb277fe700 1 --2- 172.21.15.40:0/2953928679 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb2809e230 0x7fdb28122ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.867+0000 7fdb277fe700 1 -- 172.21.15.40:0/2953928679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb281230e0 msgr2=0x7fdb281ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.867+0000 7fdb277fe700 1 --2- 172.21.15.40:0/2953928679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb281230e0 0x7fdb281ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.867+0000 7fdb277fe700 1 -- 172.21.15.40:0/2953928679 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb18009430 con 0x7fdb2809d920 2023-09-30T22:25:24.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.867+0000 7fdb26ffd700 1 --2- 172.21.15.40:0/2953928679 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb2809e230 0x7fdb28122ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:24.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.867+0000 7fdb27fff700 1 --2- 172.21.15.40:0/2953928679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb281230e0 0x7fdb281ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:24.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.867+0000 7fdb277fe700 1 --2- 172.21.15.40:0/2953928679 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb2809d920 0x7fdb28122660 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdb1800ec10 tx=0x7fdb1800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:24.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.868+0000 7fdb0ffff700 1 -- 172.21.15.40:0/2953928679 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb18005a20 con 0x7fdb2809d920 2023-09-30T22:25:24.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.868+0000 7fdb0ffff700 1 -- 172.21.15.40:0/2953928679 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb18005b80 con 0x7fdb2809d920 2023-09-30T22:25:24.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.868+0000 7fdb2da9f700 1 -- 172.21.15.40:0/2953928679 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb20009a70 con 0x7fdb2809d920 2023-09-30T22:25:24.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.868+0000 7fdb0ffff700 1 -- 172.21.15.40:0/2953928679 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1800c850 con 0x7fdb2809d920 2023-09-30T22:25:24.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.868+0000 7fdb2da9f700 1 -- 172.21.15.40:0/2953928679 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb28125910 con 0x7fdb2809d920 2023-09-30T22:25:24.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.868+0000 7fdb0ffff700 1 -- 172.21.15.40:0/2953928679 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb1800c9b0 con 0x7fdb2809d920 2023-09-30T22:25:24.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.869+0000 7fdb0ffff700 1 -- 172.21.15.40:0/2953928679 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fdb1803f9b0 con 0x7fdb2809d920 2023-09-30T22:25:24.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.869+0000 7fdb2da9f700 1 -- 172.21.15.40:0/2953928679 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb2811f2e0 con 0x7fdb2809d920 2023-09-30T22:25:24.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.874+0000 7fdb0ffff700 1 -- 172.21.15.40:0/2953928679 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb18020080 con 0x7fdb2809d920 2023-09-30T22:25:24.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.943+0000 7f3c83a88700 1 -- 172.21.15.40:0/2114608959 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3c7c13e990 con 0x7f3c7c138250 2023-09-30T22:25:24.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.943+0000 7f3c727fc700 1 -- 172.21.15.40:0/2114608959 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3c7c13e990 con 0x7f3c7c138250 2023-09-30T22:25:24.944 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:24.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.945+0000 7f3c83a88700 1 -- 172.21.15.40:0/2114608959 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c7c138250 msgr2=0x7f3c7c126120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.945+0000 7f3c83a88700 1 --2- 172.21.15.40:0/2114608959 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c7c138250 0x7f3c7c126120 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3c7400cc50 tx=0x7f3c7400cf60 comp rx=0 tx=0).stop 2023-09-30T22:25:24.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.945+0000 7f3c83a88700 1 -- 172.21.15.40:0/2114608959 shutdown_connections 2023-09-30T22:25:24.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.945+0000 7f3c83a88700 1 --2- 172.21.15.40:0/2114608959 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c7c09d400 0x7f3c7c127570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.945+0000 7f3c83a88700 1 --2- 172.21.15.40:0/2114608959 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c7c138250 0x7f3c7c126120 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.945+0000 7f3c83a88700 1 --2- 172.21.15.40:0/2114608959 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c7c09dd50 0x7f3c7c127ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.945+0000 7f3c83a88700 1 -- 172.21.15.40:0/2114608959 >> 172.21.15.40:0/2114608959 conn(0x7f3c7c0a2a00 msgr2=0x7f3c7c09f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:24.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.945+0000 7f3c83a88700 1 -- 172.21.15.40:0/2114608959 shutdown_connections 2023-09-30T22:25:24.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:24.945+0000 7f3c83a88700 1 -- 172.21.15.40:0/2114608959 wait complete. 2023-09-30T22:25:24.958 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:25.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.032+0000 7f0782d97700 1 -- 172.21.15.40:0/3066716701 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f077c130f10 con 0x7f077c09d920 2023-09-30T22:25:25.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.032+0000 7f07797fa700 1 -- 172.21.15.40:0/3066716701 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f076802b090 con 0x7f077c09d920 2023-09-30T22:25:25.033 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:25.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.034+0000 7f0782d97700 1 -- 172.21.15.40:0/3066716701 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f077c09d920 msgr2=0x7f077c12dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:25.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.034+0000 7f0782d97700 1 --2- 172.21.15.40:0/3066716701 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f077c09d920 0x7f077c12dc70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f076800e980 tx=0x7f076800ed40 comp rx=0 tx=0).stop 2023-09-30T22:25:25.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.034+0000 7f0782d97700 1 -- 172.21.15.40:0/3066716701 shutdown_connections 2023-09-30T22:25:25.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.034+0000 7f0782d97700 1 --2- 172.21.15.40:0/3066716701 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f077c09e2b0 0x7f077c12e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.034+0000 7f0782d97700 1 --2- 172.21.15.40:0/3066716701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f077c09c890 0x7f077c12d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.034+0000 7f0782d97700 1 --2- 172.21.15.40:0/3066716701 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f077c09d920 0x7f077c12dc70 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.034+0000 7f0782d97700 1 -- 172.21.15.40:0/3066716701 >> 172.21.15.40:0/3066716701 conn(0x7f077c0a7080 msgr2=0x7f077c0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:25.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.034+0000 7f0782d97700 1 -- 172.21.15.40:0/3066716701 shutdown_connections 2023-09-30T22:25:25.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.034+0000 7f0782d97700 1 -- 172.21.15.40:0/3066716701 wait complete. 2023-09-30T22:25:25.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:25.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.073+0000 7fdb2da9f700 1 -- 172.21.15.40:0/2953928679 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdb280a2f40 con 0x7fdb2809d920 2023-09-30T22:25:25.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.074+0000 7fdb0ffff700 1 -- 172.21.15.40:0/2953928679 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdb18006030 con 0x7fdb2809d920 2023-09-30T22:25:25.074 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:25.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.076+0000 7fdb2da9f700 1 -- 172.21.15.40:0/2953928679 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb2809d920 msgr2=0x7fdb28122660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:25.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.076+0000 7fdb2da9f700 1 --2- 172.21.15.40:0/2953928679 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb2809d920 0x7fdb28122660 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdb1800ec10 tx=0x7fdb1800ef20 comp rx=0 tx=0).stop 2023-09-30T22:25:25.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.076+0000 7fdb2da9f700 1 -- 172.21.15.40:0/2953928679 shutdown_connections 2023-09-30T22:25:25.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.076+0000 7fdb2da9f700 1 --2- 172.21.15.40:0/2953928679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb281230e0 0x7fdb281ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.076+0000 7fdb2da9f700 1 --2- 172.21.15.40:0/2953928679 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb2809d920 0x7fdb28122660 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.076+0000 7fdb2da9f700 1 --2- 172.21.15.40:0/2953928679 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb2809e230 0x7fdb28122ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.076+0000 7fdb2da9f700 1 -- 172.21.15.40:0/2953928679 >> 172.21.15.40:0/2953928679 conn(0x7fdb2809fb20 msgr2=0x7fdb2806e780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:25.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.076+0000 7fdb2da9f700 1 -- 172.21.15.40:0/2953928679 shutdown_connections 2023-09-30T22:25:25.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.076+0000 7fdb2da9f700 1 -- 172.21.15.40:0/2953928679 wait complete. 2023-09-30T22:25:25.089 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:25.808 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:25.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.948+0000 7fb06cb6b700 1 Processor -- start 2023-09-30T22:25:25.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.948+0000 7fb06cb6b700 1 -- start start 2023-09-30T22:25:25.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.949+0000 7fb06cb6b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb06809c890 0x7fb06809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:25.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.949+0000 7fb06cb6b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb06809d920 0x7fb06809dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:25.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.949+0000 7fb06cb6b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0680a2600 con 0x7fb06809e2b0 2023-09-30T22:25:25.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.949+0000 7fb06cb6b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0680a29d0 con 0x7fb06809d920 2023-09-30T22:25:25.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.949+0000 7fb06cb6b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06809fb40 con 0x7fb06809c890 2023-09-30T22:25:25.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.949+0000 7fb06659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb06809c890 0x7fb06809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:25.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.949+0000 7fb065d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb06809d920 0x7fb06809dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:25.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.949+0000 7fb06659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb06809c890 0x7fb06809cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39090/0 (socket says 172.21.15.40:39090) 2023-09-30T22:25:25.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.949+0000 7fb065d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb06809d920 0x7fb06809dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44582/0 (socket says 172.21.15.40:44582) 2023-09-30T22:25:25.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.949+0000 7fb06659c700 1 -- 172.21.15.40:0/954124945 learned_addr learned my addr 172.21.15.40:0/954124945 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:25.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.949+0000 7fb06659c700 1 -- 172.21.15.40:0/954124945 >> v2:172.21.15.40:3300/0 conn(0x7fb06809d920 msgr2=0x7fb06809dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:25.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.949+0000 7fb06659c700 1 --2- 172.21.15.40:0/954124945 >> v2:172.21.15.40:3300/0 conn(0x7fb06809d920 0x7fb06809dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.949+0000 7fb06659c700 1 -- 172.21.15.40:0/954124945 >> v1:172.21.15.40:6789/0 conn(0x7fb06809e2b0 legacy=0x7fb06813ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:25.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.949+0000 7fb06659c700 1 -- 172.21.15.40:0/954124945 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb06809e750 con 0x7fb06809c890 2023-09-30T22:25:25.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.949+0000 7fb065d9b700 1 --2- 172.21.15.40:0/954124945 >> v2:172.21.15.40:3300/0 conn(0x7fb06809d920 0x7fb06809dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:25.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.950+0000 7fb06659c700 1 --2- 172.21.15.40:0/954124945 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb06809c890 0x7fb06809cc60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb058006fd0 tx=0x7fb058009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f94adfbf603035c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:25.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.950+0000 7fb06559a700 1 -- 172.21.15.40:0/954124945 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb058005e30 con 0x7fb06809c890 2023-09-30T22:25:25.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.950+0000 7fb06559a700 1 -- 172.21.15.40:0/954124945 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb058004030 con 0x7fb06809c890 2023-09-30T22:25:25.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.950+0000 7fb06559a700 1 -- 172.21.15.40:0/954124945 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0580043e0 con 0x7fb06809c890 2023-09-30T22:25:25.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.950+0000 7fb06cb6b700 1 -- 172.21.15.40:0/954124945 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb06809c890 msgr2=0x7fb06809cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:25.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.950+0000 7fb06cb6b700 1 --2- 172.21.15.40:0/954124945 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb06809c890 0x7fb06809cc60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb058006fd0 tx=0x7fb058009bd0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.950+0000 7fb06cb6b700 1 -- 172.21.15.40:0/954124945 shutdown_connections 2023-09-30T22:25:25.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.950+0000 7fb06cb6b700 1 --2- 172.21.15.40:0/954124945 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb06809c890 0x7fb06809cc60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.950+0000 7fb06cb6b700 1 --2- 172.21.15.40:0/954124945 >> v2:172.21.15.40:3300/0 conn(0x7fb06809d920 0x7fb06809dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.950+0000 7fb06cb6b700 1 -- 172.21.15.40:0/954124945 >> 172.21.15.40:0/954124945 conn(0x7fb0680a7080 msgr2=0x7fb0680a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:25.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.950+0000 7fb06cb6b700 1 -- 172.21.15.40:0/954124945 shutdown_connections 2023-09-30T22:25:25.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.950+0000 7fb06cb6b700 1 -- 172.21.15.40:0/954124945 wait complete. 2023-09-30T22:25:25.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.952+0000 7fb06cb6b700 1 Processor -- start 2023-09-30T22:25:25.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.952+0000 7fb06cb6b700 1 -- start start 2023-09-30T22:25:25.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.952+0000 7fb06cb6b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb06809c890 0x7fb0681c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:25.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.952+0000 7fb06cb6b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb06809d920 0x7fb0681c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:25.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.952+0000 7fb06cb6b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb06809e2b0 0x7fb0681c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:25.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.952+0000 7fb06cb6b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06812faf0 con 0x7fb06809e2b0 2023-09-30T22:25:25.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.952+0000 7fb06cb6b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06812f580 con 0x7fb06809d920 2023-09-30T22:25:25.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.952+0000 7fb06cb6b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0680a5d00 con 0x7fb06809c890 2023-09-30T22:25:25.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.952+0000 7fb06659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb06809c890 0x7fb0681c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:25.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.952+0000 7fb06659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb06809c890 0x7fb0681c89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48066/0 (socket says 172.21.15.40:48066) 2023-09-30T22:25:25.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.952+0000 7fb06659c700 1 -- 172.21.15.40:0/1363537395 learned_addr learned my addr 172.21.15.40:0/1363537395 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:25.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.952+0000 7fb066d9d700 1 --2- 172.21.15.40:0/1363537395 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb06809e2b0 0x7fb0681c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:25.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.952+0000 7fb065d9b700 1 --2- 172.21.15.40:0/1363537395 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb06809d920 0x7fb0681c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:25.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.952+0000 7fb06659c700 1 -- 172.21.15.40:0/1363537395 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb06809d920 msgr2=0x7fb0681c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:25.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.952+0000 7fb06659c700 1 --2- 172.21.15.40:0/1363537395 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb06809d920 0x7fb0681c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.952+0000 7fb06659c700 1 -- 172.21.15.40:0/1363537395 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb06809e2b0 msgr2=0x7fb0681c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:25.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.952+0000 7fb06659c700 1 --2- 172.21.15.40:0/1363537395 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb06809e2b0 0x7fb0681c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.952+0000 7fb06659c700 1 -- 172.21.15.40:0/1363537395 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb05c0094a0 con 0x7fb06809c890 2023-09-30T22:25:25.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.952+0000 7fb066d9d700 1 --2- 172.21.15.40:0/1363537395 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb06809e2b0 0x7fb0681c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:25.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.953+0000 7fb06659c700 1 --2- 172.21.15.40:0/1363537395 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb06809c890 0x7fb0681c89e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb058004000 tx=0x7fb058004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:25.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.953+0000 7fb056ffd700 1 -- 172.21.15.40:0/1363537395 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05801c420 con 0x7fb06809c890 2023-09-30T22:25:25.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.953+0000 7fb056ffd700 1 -- 172.21.15.40:0/1363537395 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05801c580 con 0x7fb06809c890 2023-09-30T22:25:25.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.953+0000 7fb06cb6b700 1 -- 172.21.15.40:0/1363537395 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb058009500 con 0x7fb06809c890 2023-09-30T22:25:25.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.953+0000 7fb056ffd700 1 -- 172.21.15.40:0/1363537395 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05801c930 con 0x7fb06809c890 2023-09-30T22:25:25.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.953+0000 7fb06cb6b700 1 -- 172.21.15.40:0/1363537395 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb068130d80 con 0x7fb06809c890 2023-09-30T22:25:25.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.954+0000 7fb056ffd700 1 -- 172.21.15.40:0/1363537395 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb05801ca90 con 0x7fb06809c890 2023-09-30T22:25:25.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.954+0000 7fb056ffd700 1 -- 172.21.15.40:0/1363537395 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb058040770 con 0x7fb06809c890 2023-09-30T22:25:25.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.954+0000 7fb06cb6b700 1 -- 172.21.15.40:0/1363537395 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb06809ecf0 con 0x7fb06809c890 2023-09-30T22:25:25.959 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:25.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:25.959+0000 7fb056ffd700 1 -- 172.21.15.40:0/1363537395 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb06809ecf0 con 0x7fb06809c890 2023-09-30T22:25:26.047 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:26.090 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:26.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.090+0000 7f8ecf6fa700 1 Processor -- start 2023-09-30T22:25:26.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.090+0000 7f8ecf6fa700 1 -- start start 2023-09-30T22:25:26.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.090+0000 7f8ecf6fa700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ec812f070 0x7f8ec8135c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:26.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.090+0000 7f8ecf6fa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ec8136170 0x7f8ec8138550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:26.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.090+0000 7f8ecf6fa700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ec809ab70 con 0x7f8ec812e590 2023-09-30T22:25:26.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.090+0000 7f8ecf6fa700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec809b270 con 0x7f8ec8136170 2023-09-30T22:25:26.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.090+0000 7f8ecf6fa700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec812f440 con 0x7f8ec812f070 2023-09-30T22:25:26.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.091+0000 7f8ecdc97700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ec8136170 0x7f8ec8138550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:26.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.091+0000 7f8ecd496700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8ec812e590 0x7f8ec812e960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:35090/0 (socket says 172.21.15.40:35090) 2023-09-30T22:25:26.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.091+0000 7f8ecd496700 1 -- 172.21.15.40:0/2731262820 learned_addr learned my addr 172.21.15.40:0/2731262820 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:26.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.091+0000 7f8eccc95700 1 --2- 172.21.15.40:0/2731262820 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ec812f070 0x7f8ec8135c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:26.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.091+0000 7f8ebffff700 1 -- 172.21.15.40:0/2731262820 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4088123787 0 0) 0x7f8ec809ab70 con 0x7f8ec812e590 2023-09-30T22:25:26.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.091+0000 7f8ebffff700 1 -- 172.21.15.40:0/2731262820 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8eb40057c0 con 0x7f8ec812e590 2023-09-30T22:25:26.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.091+0000 7f8ecdc97700 1 -- 172.21.15.40:0/2731262820 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ec812f070 msgr2=0x7f8ec8135c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:26.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.091+0000 7f8ecdc97700 1 --2- 172.21.15.40:0/2731262820 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ec812f070 0x7f8ec8135c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.091+0000 7f8ecdc97700 1 -- 172.21.15.40:0/2731262820 >> v1:172.21.15.40:6789/0 conn(0x7f8ec812e590 legacy=0x7f8ec812e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.091+0000 7f8ecdc97700 1 -- 172.21.15.40:0/2731262820 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec809bd70 con 0x7f8ec8136170 2023-09-30T22:25:26.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.091+0000 7f8eccc95700 1 --2- 172.21.15.40:0/2731262820 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ec812f070 0x7f8ec8135c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:26.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.091+0000 7f8ecdc97700 1 --2- 172.21.15.40:0/2731262820 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ec8136170 0x7f8ec8138550 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0009df0 tx=0x7f8ec000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1df6426d2d2d9c8a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:26.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.091+0000 7f8ebffff700 1 -- 172.21.15.40:0/2731262820 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec000e070 con 0x7f8ec8136170 2023-09-30T22:25:26.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.091+0000 7f8ebffff700 1 -- 172.21.15.40:0/2731262820 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec000bae0 con 0x7f8ec8136170 2023-09-30T22:25:26.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.091+0000 7f8ebffff700 1 -- 172.21.15.40:0/2731262820 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec000be90 con 0x7f8ec8136170 2023-09-30T22:25:26.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.092+0000 7f8ecf6fa700 1 -- 172.21.15.40:0/2731262820 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ec8136170 msgr2=0x7f8ec8138550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.092+0000 7f8ecf6fa700 1 --2- 172.21.15.40:0/2731262820 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ec8136170 0x7f8ec8138550 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0009df0 tx=0x7f8ec000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:26.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.092+0000 7f8ecf6fa700 1 -- 172.21.15.40:0/2731262820 shutdown_connections 2023-09-30T22:25:26.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.092+0000 7f8ecf6fa700 1 --2- 172.21.15.40:0/2731262820 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ec8136170 0x7f8ec8138550 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.092+0000 7f8ecf6fa700 1 --2- 172.21.15.40:0/2731262820 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ec812f070 0x7f8ec8135c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.092+0000 7f8ecf6fa700 1 -- 172.21.15.40:0/2731262820 >> 172.21.15.40:0/2731262820 conn(0x7f8ec80a2a00 msgr2=0x7f8ec80a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:26.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.092+0000 7f8ecf6fa700 1 -- 172.21.15.40:0/2731262820 shutdown_connections 2023-09-30T22:25:26.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.092+0000 7f8ecf6fa700 1 -- 172.21.15.40:0/2731262820 wait complete. 2023-09-30T22:25:26.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.093+0000 7f8ecf6fa700 1 Processor -- start 2023-09-30T22:25:26.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.093+0000 7f8ecf6fa700 1 -- start start 2023-09-30T22:25:26.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.094+0000 7f8ecf6fa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ec812e590 0x7f8ec81334a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:26.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.094+0000 7f8ecf6fa700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ec812f070 0x7f8ec81339e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:26.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.094+0000 7f8ecf6fa700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ec8136170 0x7f8ec8133f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:26.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.094+0000 7f8ecf6fa700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec80a0b20 con 0x7f8ec8136170 2023-09-30T22:25:26.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.094+0000 7f8ecf6fa700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec8135120 con 0x7f8ec812e590 2023-09-30T22:25:26.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.094+0000 7f8ecf6fa700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec811e620 con 0x7f8ec812f070 2023-09-30T22:25:26.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.094+0000 7f8ecd496700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ec812e590 0x7f8ec81334a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:26.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.094+0000 7f8ecd496700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ec812e590 0x7f8ec81334a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39126/0 (socket says 172.21.15.40:39126) 2023-09-30T22:25:26.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.094+0000 7f8ecd496700 1 -- 172.21.15.40:0/3564112245 learned_addr learned my addr 172.21.15.40:0/3564112245 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:26.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.094+0000 7f8ecdc97700 1 --2- 172.21.15.40:0/3564112245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ec8136170 0x7f8ec8133f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:26.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.094+0000 7f8ecd496700 1 -- 172.21.15.40:0/3564112245 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ec812f070 msgr2=0x7f8ec81339e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.094+0000 7f8eccc95700 1 --2- 172.21.15.40:0/3564112245 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ec812f070 0x7f8ec81339e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:26.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.094+0000 7f8ecd496700 1 --2- 172.21.15.40:0/3564112245 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ec812f070 0x7f8ec81339e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.094+0000 7f8ecd496700 1 -- 172.21.15.40:0/3564112245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ec8136170 msgr2=0x7f8ec8133f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.094+0000 7f8ecd496700 1 --2- 172.21.15.40:0/3564112245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ec8136170 0x7f8ec8133f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.095+0000 7f8ecd496700 1 -- 172.21.15.40:0/3564112245 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb80094a0 con 0x7f8ec812e590 2023-09-30T22:25:26.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.095+0000 7f8ecdc97700 1 --2- 172.21.15.40:0/3564112245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ec8136170 0x7f8ec8133f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:26.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.095+0000 7f8eccc95700 1 --2- 172.21.15.40:0/3564112245 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ec812f070 0x7f8ec81339e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:26.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.095+0000 7f8ecd496700 1 --2- 172.21.15.40:0/3564112245 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ec812e590 0x7f8ec81334a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8ec400c700 tx=0x7f8ec400cac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:26.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.095+0000 7f8ebdffb700 1 -- 172.21.15.40:0/3564112245 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec4005d70 con 0x7f8ec812e590 2023-09-30T22:25:26.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.095+0000 7f8ebdffb700 1 -- 172.21.15.40:0/3564112245 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec40070d0 con 0x7f8ec812e590 2023-09-30T22:25:26.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.095+0000 7f8ecf6fa700 1 -- 172.21.15.40:0/3564112245 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ec0009a70 con 0x7f8ec812e590 2023-09-30T22:25:26.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.095+0000 7f8ebdffb700 1 -- 172.21.15.40:0/3564112245 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec4007440 con 0x7f8ec812e590 2023-09-30T22:25:26.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.095+0000 7f8ecf6fa700 1 -- 172.21.15.40:0/3564112245 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec811e8e0 con 0x7f8ec812e590 2023-09-30T22:25:26.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.096+0000 7f8ebdffb700 1 -- 172.21.15.40:0/3564112245 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8ec40075a0 con 0x7f8ec812e590 2023-09-30T22:25:26.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.096+0000 7f8ecf6fa700 1 -- 172.21.15.40:0/3564112245 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec8062380 con 0x7f8ec812e590 2023-09-30T22:25:26.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.097+0000 7f8ebdffb700 1 -- 172.21.15.40:0/3564112245 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f8ec403ec40 con 0x7f8ec812e590 2023-09-30T22:25:26.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.106+0000 7f8ebdffb700 1 -- 172.21.15.40:0/3564112245 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ec401b8d0 con 0x7f8ec812e590 2023-09-30T22:25:26.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.157+0000 7fb06cb6b700 1 -- 172.21.15.40:0/1363537395 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb06809ecf0 con 0x7fb06809c890 2023-09-30T22:25:26.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.158+0000 7fb056ffd700 1 -- 172.21.15.40:0/1363537395 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb06809ecf0 con 0x7fb06809c890 2023-09-30T22:25:26.158 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:26.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.160+0000 7fb06cb6b700 1 -- 172.21.15.40:0/1363537395 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb06809c890 msgr2=0x7fb0681c89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.160+0000 7fb06cb6b700 1 --2- 172.21.15.40:0/1363537395 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb06809c890 0x7fb0681c89e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb058004000 tx=0x7fb058004750 comp rx=0 tx=0).stop 2023-09-30T22:25:26.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.160+0000 7fb06cb6b700 1 -- 172.21.15.40:0/1363537395 shutdown_connections 2023-09-30T22:25:26.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.160+0000 7fb06cb6b700 1 --2- 172.21.15.40:0/1363537395 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb06809c890 0x7fb0681c89e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.160+0000 7fb06cb6b700 1 --2- 172.21.15.40:0/1363537395 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb06809e2b0 0x7fb0681c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.160+0000 7fb06cb6b700 1 --2- 172.21.15.40:0/1363537395 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb06809d920 0x7fb0681c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.160+0000 7fb06cb6b700 1 -- 172.21.15.40:0/1363537395 >> 172.21.15.40:0/1363537395 conn(0x7fb0680a7080 msgr2=0x7fb0680a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:26.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.160+0000 7fb06cb6b700 1 -- 172.21.15.40:0/1363537395 shutdown_connections 2023-09-30T22:25:26.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.160+0000 7fb06cb6b700 1 -- 172.21.15.40:0/1363537395 wait complete. 2023-09-30T22:25:26.173 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:26.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.195+0000 7f5950891700 1 Processor -- start 2023-09-30T22:25:26.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.195+0000 7f5950891700 1 -- start start 2023-09-30T22:25:26.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.196+0000 7f5950891700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f594c09d920 0x7f594c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:26.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.196+0000 7f5950891700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f594c09e230 0x7f594c1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:26.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.196+0000 7f5950891700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f594c09f940 con 0x7f594c09f0f0 2023-09-30T22:25:26.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.196+0000 7f5950891700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f594c06b4c0 con 0x7f594c09e230 2023-09-30T22:25:26.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.196+0000 7f5950891700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f594c09a8f0 con 0x7f594c09d920 2023-09-30T22:25:26.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.196+0000 7f594a59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f594c09d920 0x7f594c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:26.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.196+0000 7f594a59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f594c09d920 0x7f594c09dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48112/0 (socket says 172.21.15.40:48112) 2023-09-30T22:25:26.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.196+0000 7f594a59c700 1 -- 172.21.15.40:0/595152111 learned_addr learned my addr 172.21.15.40:0/595152111 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:26.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.196+0000 7f5949d9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f594c09f0f0 0x7f594c133ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:35092/0 (socket says 172.21.15.40:35092) 2023-09-30T22:25:26.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.196+0000 7f594ad9d700 1 --2- 172.21.15.40:0/595152111 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f594c09e230 0x7f594c1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:26.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.196+0000 7f594a59c700 1 -- 172.21.15.40:0/595152111 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f594c09e230 msgr2=0x7f594c1343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:26.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.196+0000 7f594959a700 1 -- 172.21.15.40:0/595152111 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2345965184 0 0) 0x7f594c09f940 con 0x7f594c09f0f0 2023-09-30T22:25:26.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.196+0000 7f594a59c700 1 --2- 172.21.15.40:0/595152111 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f594c09e230 0x7f594c1343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.196+0000 7f594a59c700 1 -- 172.21.15.40:0/595152111 >> v1:172.21.15.40:6789/0 conn(0x7f594c09f0f0 legacy=0x7f594c133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.196+0000 7f594a59c700 1 -- 172.21.15.40:0/595152111 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f594c09f6e0 con 0x7f594c09d920 2023-09-30T22:25:26.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.196+0000 7f594ad9d700 1 --2- 172.21.15.40:0/595152111 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f594c09e230 0x7f594c1343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:26.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.196+0000 7f594a59c700 1 --2- 172.21.15.40:0/595152111 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f594c09d920 0x7f594c09dcf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f593c009920 tx=0x7f593c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18e480e920051b2f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:26.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.197+0000 7f594959a700 1 -- 172.21.15.40:0/595152111 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c005e30 con 0x7f594c09d920 2023-09-30T22:25:26.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.197+0000 7f594959a700 1 -- 172.21.15.40:0/595152111 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593c004030 con 0x7f594c09d920 2023-09-30T22:25:26.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.197+0000 7f594959a700 1 -- 172.21.15.40:0/595152111 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c0043e0 con 0x7f594c09d920 2023-09-30T22:25:26.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.197+0000 7f5950891700 1 -- 172.21.15.40:0/595152111 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f594c09d920 msgr2=0x7f594c09dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.197+0000 7f5950891700 1 --2- 172.21.15.40:0/595152111 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f594c09d920 0x7f594c09dcf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f593c009920 tx=0x7f593c009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:26.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.197+0000 7f5950891700 1 -- 172.21.15.40:0/595152111 shutdown_connections 2023-09-30T22:25:26.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.197+0000 7f5950891700 1 --2- 172.21.15.40:0/595152111 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f594c09e230 0x7f594c1343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.197+0000 7f5950891700 1 --2- 172.21.15.40:0/595152111 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f594c09d920 0x7f594c09dcf0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.197+0000 7f5950891700 1 -- 172.21.15.40:0/595152111 >> 172.21.15.40:0/595152111 conn(0x7f594c09fb20 msgr2=0x7f594c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:26.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.197+0000 7f5950891700 1 -- 172.21.15.40:0/595152111 shutdown_connections 2023-09-30T22:25:26.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.197+0000 7f5950891700 1 -- 172.21.15.40:0/595152111 wait complete. 2023-09-30T22:25:26.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.198+0000 7f5950891700 1 Processor -- start 2023-09-30T22:25:26.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.199+0000 7f5950891700 1 -- start start 2023-09-30T22:25:26.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.199+0000 7f5950891700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f594c09d920 0x7f594c1226c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:26.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.199+0000 7f5950891700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f594c09e230 0x7f594c122c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:26.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.199+0000 7f5950891700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f594c123140 0x7f594c1ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:26.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.199+0000 7f5950891700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594c125f00 con 0x7f594c09e230 2023-09-30T22:25:26.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.199+0000 7f5950891700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f594c125160 con 0x7f594c123140 2023-09-30T22:25:26.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.199+0000 7f5950891700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f594c09c9e0 con 0x7f594c09d920 2023-09-30T22:25:26.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.199+0000 7f594a59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f594c09d920 0x7f594c1226c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:26.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.199+0000 7f594a59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f594c09d920 0x7f594c1226c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48120/0 (socket says 172.21.15.40:48120) 2023-09-30T22:25:26.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.199+0000 7f594a59c700 1 -- 172.21.15.40:0/1689556991 learned_addr learned my addr 172.21.15.40:0/1689556991 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:26.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.199+0000 7f594ad9d700 1 --2- 172.21.15.40:0/1689556991 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f594c123140 0x7f594c1ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:26.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.199+0000 7f5949d9b700 1 --2- 172.21.15.40:0/1689556991 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f594c09e230 0x7f594c122c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:26.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.199+0000 7f594a59c700 1 -- 172.21.15.40:0/1689556991 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f594c123140 msgr2=0x7f594c1ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.199+0000 7f594a59c700 1 --2- 172.21.15.40:0/1689556991 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f594c123140 0x7f594c1ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.199+0000 7f594a59c700 1 -- 172.21.15.40:0/1689556991 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f594c09e230 msgr2=0x7f594c122c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.199+0000 7f594a59c700 1 --2- 172.21.15.40:0/1689556991 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f594c09e230 0x7f594c122c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.199+0000 7f594a59c700 1 -- 172.21.15.40:0/1689556991 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5944009a70 con 0x7f594c09d920 2023-09-30T22:25:26.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.200+0000 7f5949d9b700 1 --2- 172.21.15.40:0/1689556991 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f594c09e230 0x7f594c122c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:26.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.200+0000 7f594a59c700 1 --2- 172.21.15.40:0/1689556991 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f594c09d920 0x7f594c1226c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f593c014040 tx=0x7f593c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:26.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.200+0000 7f593affd700 1 -- 172.21.15.40:0/1689556991 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c003dd0 con 0x7f594c09d920 2023-09-30T22:25:26.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.200+0000 7f593affd700 1 -- 172.21.15.40:0/1689556991 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593c011420 con 0x7f594c09d920 2023-09-30T22:25:26.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.200+0000 7f5950891700 1 -- 172.21.15.40:0/1689556991 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f593c009500 con 0x7f594c09d920 2023-09-30T22:25:26.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.200+0000 7f593affd700 1 -- 172.21.15.40:0/1689556991 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c0117d0 con 0x7f594c09d920 2023-09-30T22:25:26.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.200+0000 7f5950891700 1 -- 172.21.15.40:0/1689556991 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f594c0a2fb0 con 0x7f594c09d920 2023-09-30T22:25:26.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.201+0000 7f5950891700 1 -- 172.21.15.40:0/1689556991 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f594c062380 con 0x7f594c09d920 2023-09-30T22:25:26.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.201+0000 7f593affd700 1 -- 172.21.15.40:0/1689556991 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f593c018070 con 0x7f594c09d920 2023-09-30T22:25:26.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.202+0000 7f593affd700 1 -- 172.21.15.40:0/1689556991 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f593c0406f0 con 0x7f594c09d920 2023-09-30T22:25:26.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.206+0000 7f593affd700 1 -- 172.21.15.40:0/1689556991 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f593c011930 con 0x7f594c09d920 2023-09-30T22:25:26.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.231+0000 7f7651a2c700 1 Processor -- start 2023-09-30T22:25:26.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.231+0000 7f7651a2c700 1 -- start start 2023-09-30T22:25:26.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.232+0000 7f7651a2c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f764c136bf0 0x7f764c138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:26.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.232+0000 7f7651a2c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f764c139510 0x7f764c13b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:26.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.232+0000 7f7651a2c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f764c0a2600 con 0x7f764c09c890 2023-09-30T22:25:26.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.232+0000 7f7651a2c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f764c0a29d0 con 0x7f764c136bf0 2023-09-30T22:25:26.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.232+0000 7f7651a2c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764c09fb40 con 0x7f764c139510 2023-09-30T22:25:26.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.232+0000 7f764a7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f764c136bf0 0x7f764c138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:26.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.232+0000 7f764b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f764c139510 0x7f764c13b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:26.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.232+0000 7f764a7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f764c136bf0 0x7f764c138fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44626/0 (socket says 172.21.15.40:44626) 2023-09-30T22:25:26.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.232+0000 7f764b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f764c139510 0x7f764c13b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39154/0 (socket says 172.21.15.40:39154) 2023-09-30T22:25:26.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.232+0000 7f764a7fc700 1 -- 172.21.15.40:0/788006195 learned_addr learned my addr 172.21.15.40:0/788006195 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:26.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.232+0000 7f764a7fc700 1 -- 172.21.15.40:0/788006195 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f764c139510 msgr2=0x7f764c13b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:26.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.232+0000 7f764a7fc700 1 --2- 172.21.15.40:0/788006195 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f764c139510 0x7f764c13b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.232+0000 7f764a7fc700 1 -- 172.21.15.40:0/788006195 >> v1:172.21.15.40:6789/0 conn(0x7f764c09c890 legacy=0x7f764c09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.232+0000 7f764a7fc700 1 -- 172.21.15.40:0/788006195 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764c09d370 con 0x7f764c136bf0 2023-09-30T22:25:26.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.232+0000 7f764b7fe700 1 --2- 172.21.15.40:0/788006195 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f764c139510 0x7f764c13b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:26.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.233+0000 7f764a7fc700 1 --2- 172.21.15.40:0/788006195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f764c136bf0 0x7f764c138fd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f76400098f0 tx=0x7f7640009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66922f11f45982a9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:26.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.233+0000 7f7649ffb700 1 -- 172.21.15.40:0/788006195 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7640011830 con 0x7f764c136bf0 2023-09-30T22:25:26.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.233+0000 7f7649ffb700 1 -- 172.21.15.40:0/788006195 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7640011990 con 0x7f764c136bf0 2023-09-30T22:25:26.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.233+0000 7f7649ffb700 1 -- 172.21.15.40:0/788006195 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7640011d20 con 0x7f764c136bf0 2023-09-30T22:25:26.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.233+0000 7f7651a2c700 1 -- 172.21.15.40:0/788006195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f764c136bf0 msgr2=0x7f764c138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.233+0000 7f7651a2c700 1 --2- 172.21.15.40:0/788006195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f764c136bf0 0x7f764c138fd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f76400098f0 tx=0x7f7640009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:26.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.233+0000 7f7651a2c700 1 -- 172.21.15.40:0/788006195 shutdown_connections 2023-09-30T22:25:26.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.233+0000 7f7651a2c700 1 --2- 172.21.15.40:0/788006195 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f764c139510 0x7f764c13b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.233+0000 7f7651a2c700 1 --2- 172.21.15.40:0/788006195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f764c136bf0 0x7f764c138fd0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.233+0000 7f7651a2c700 1 -- 172.21.15.40:0/788006195 >> 172.21.15.40:0/788006195 conn(0x7f764c0a7080 msgr2=0x7f764c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:26.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.233+0000 7f7651a2c700 1 -- 172.21.15.40:0/788006195 shutdown_connections 2023-09-30T22:25:26.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.233+0000 7f7651a2c700 1 -- 172.21.15.40:0/788006195 wait complete. 2023-09-30T22:25:26.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.234+0000 7f7651a2c700 1 Processor -- start 2023-09-30T22:25:26.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.235+0000 7f7651a2c700 1 -- start start 2023-09-30T22:25:26.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.235+0000 7f7651a2c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f764c09c890 0x7f764c06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:26.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.235+0000 7f7651a2c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f764c136bf0 0x7f764c06f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:26.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.235+0000 7f7651a2c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f764c139510 0x7f764c06fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:26.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.235+0000 7f7651a2c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764c0717d0 con 0x7f764c139510 2023-09-30T22:25:26.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.235+0000 7f7651a2c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764c1390e0 con 0x7f764c136bf0 2023-09-30T22:25:26.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.235+0000 7f7651a2c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f764c12c1a0 con 0x7f764c09c890 2023-09-30T22:25:26.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.235+0000 7f764b7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f764c139510 0x7f764c06fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:26.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.235+0000 7f764affd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f764c09c890 0x7f764c06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:26.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.235+0000 7f764b7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f764c139510 0x7f764c06fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44640/0 (socket says 172.21.15.40:44640) 2023-09-30T22:25:26.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.235+0000 7f764b7fe700 1 -- 172.21.15.40:0/2762056262 learned_addr learned my addr 172.21.15.40:0/2762056262 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:26.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.235+0000 7f764a7fc700 1 --2- 172.21.15.40:0/2762056262 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f764c136bf0 0x7f764c06f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:26.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.235+0000 7f764b7fe700 1 -- 172.21.15.40:0/2762056262 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f764c09c890 msgr2=0x7f764c06f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.235+0000 7f764b7fe700 1 --2- 172.21.15.40:0/2762056262 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f764c09c890 0x7f764c06f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.235+0000 7f764b7fe700 1 -- 172.21.15.40:0/2762056262 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f764c136bf0 msgr2=0x7f764c06f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.235+0000 7f764b7fe700 1 --2- 172.21.15.40:0/2762056262 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f764c136bf0 0x7f764c06f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.235+0000 7f764b7fe700 1 -- 172.21.15.40:0/2762056262 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7644009a70 con 0x7f764c139510 2023-09-30T22:25:26.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.236+0000 7f764b7fe700 1 --2- 172.21.15.40:0/2762056262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f764c139510 0x7f764c06fb30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f764400efb0 tx=0x7f764400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:26.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.236+0000 7f7633fff700 1 -- 172.21.15.40:0/2762056262 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764400cc90 con 0x7f764c139510 2023-09-30T22:25:26.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.236+0000 7f7633fff700 1 -- 172.21.15.40:0/2762056262 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764400f040 con 0x7f764c139510 2023-09-30T22:25:26.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.236+0000 7f7651a2c700 1 -- 172.21.15.40:0/2762056262 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7640009550 con 0x7f764c139510 2023-09-30T22:25:26.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.236+0000 7f7633fff700 1 -- 172.21.15.40:0/2762056262 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7644014480 con 0x7f764c139510 2023-09-30T22:25:26.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.236+0000 7f7651a2c700 1 -- 172.21.15.40:0/2762056262 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f764c070b60 con 0x7f764c139510 2023-09-30T22:25:26.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.237+0000 7f7633fff700 1 -- 172.21.15.40:0/2762056262 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f76440145e0 con 0x7f764c139510 2023-09-30T22:25:26.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.237+0000 7f7633fff700 1 -- 172.21.15.40:0/2762056262 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f7644040310 con 0x7f764c139510 2023-09-30T22:25:26.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.237+0000 7f7651a2c700 1 -- 172.21.15.40:0/2762056262 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f764c12b600 con 0x7f764c139510 2023-09-30T22:25:26.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.242+0000 7f7633fff700 1 -- 172.21.15.40:0/2762056262 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f76440076f0 con 0x7f764c139510 2023-09-30T22:25:26.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.321+0000 7f8ecf6fa700 1 -- 172.21.15.40:0/3564112245 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8ec811d4a0 con 0x7f8ec812e590 2023-09-30T22:25:26.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.321+0000 7f8ebdffb700 1 -- 172.21.15.40:0/3564112245 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ec4017030 con 0x7f8ec812e590 2023-09-30T22:25:26.322 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:26.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.323+0000 7f8ecf6fa700 1 -- 172.21.15.40:0/3564112245 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ec812e590 msgr2=0x7f8ec81334a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.323+0000 7f8ecf6fa700 1 --2- 172.21.15.40:0/3564112245 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ec812e590 0x7f8ec81334a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8ec400c700 tx=0x7f8ec400cac0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.323+0000 7f8ecf6fa700 1 -- 172.21.15.40:0/3564112245 shutdown_connections 2023-09-30T22:25:26.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.323+0000 7f8ecf6fa700 1 --2- 172.21.15.40:0/3564112245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ec8136170 0x7f8ec8133f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.323+0000 7f8ecf6fa700 1 --2- 172.21.15.40:0/3564112245 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ec812e590 0x7f8ec81334a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.323+0000 7f8ecf6fa700 1 --2- 172.21.15.40:0/3564112245 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ec812f070 0x7f8ec81339e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.323+0000 7f8ecf6fa700 1 -- 172.21.15.40:0/3564112245 >> 172.21.15.40:0/3564112245 conn(0x7f8ec80a2a00 msgr2=0x7f8ec8099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:26.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.323+0000 7f8ecf6fa700 1 -- 172.21.15.40:0/3564112245 shutdown_connections 2023-09-30T22:25:26.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.323+0000 7f8ecf6fa700 1 -- 172.21.15.40:0/3564112245 wait complete. 2023-09-30T22:25:26.336 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:26.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.429+0000 7f5950891700 1 -- 172.21.15.40:0/1689556991 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f594c125520 con 0x7f594c09d920 2023-09-30T22:25:26.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.430+0000 7f593affd700 1 -- 172.21.15.40:0/1689556991 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f593c016030 con 0x7f594c09d920 2023-09-30T22:25:26.430 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:26.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.432+0000 7f5950891700 1 -- 172.21.15.40:0/1689556991 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f594c09d920 msgr2=0x7f594c1226c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.432+0000 7f5950891700 1 --2- 172.21.15.40:0/1689556991 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f594c09d920 0x7f594c1226c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f593c014040 tx=0x7f593c004750 comp rx=0 tx=0).stop 2023-09-30T22:25:26.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.432+0000 7f5950891700 1 -- 172.21.15.40:0/1689556991 shutdown_connections 2023-09-30T22:25:26.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.432+0000 7f5950891700 1 --2- 172.21.15.40:0/1689556991 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f594c09d920 0x7f594c1226c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.432+0000 7f5950891700 1 --2- 172.21.15.40:0/1689556991 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f594c123140 0x7f594c1ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.432+0000 7f5950891700 1 --2- 172.21.15.40:0/1689556991 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f594c09e230 0x7f594c122c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.432+0000 7f5950891700 1 -- 172.21.15.40:0/1689556991 >> 172.21.15.40:0/1689556991 conn(0x7f594c09fb20 msgr2=0x7f594c070740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:26.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.432+0000 7f5950891700 1 -- 172.21.15.40:0/1689556991 shutdown_connections 2023-09-30T22:25:26.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.432+0000 7f5950891700 1 -- 172.21.15.40:0/1689556991 wait complete. 2023-09-30T22:25:26.445 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:26.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.455+0000 7f7651a2c700 1 -- 172.21.15.40:0/2762056262 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f764c12c000 con 0x7f764c139510 2023-09-30T22:25:26.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.455+0000 7f7633fff700 1 -- 172.21.15.40:0/2762056262 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f764c12c000 con 0x7f764c139510 2023-09-30T22:25:26.456 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:26.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.457+0000 7f7651a2c700 1 -- 172.21.15.40:0/2762056262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f764c139510 msgr2=0x7f764c06fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.458+0000 7f7651a2c700 1 --2- 172.21.15.40:0/2762056262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f764c139510 0x7f764c06fb30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f764400efb0 tx=0x7f764400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.458+0000 7f7651a2c700 1 -- 172.21.15.40:0/2762056262 shutdown_connections 2023-09-30T22:25:26.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.458+0000 7f7651a2c700 1 --2- 172.21.15.40:0/2762056262 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f764c09c890 0x7f764c06f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.458+0000 7f7651a2c700 1 --2- 172.21.15.40:0/2762056262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f764c139510 0x7f764c06fb30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.458+0000 7f7651a2c700 1 --2- 172.21.15.40:0/2762056262 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f764c136bf0 0x7f764c06f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.458+0000 7f7651a2c700 1 -- 172.21.15.40:0/2762056262 >> 172.21.15.40:0/2762056262 conn(0x7f764c0a7080 msgr2=0x7f764c136fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:26.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.458+0000 7f7651a2c700 1 -- 172.21.15.40:0/2762056262 shutdown_connections 2023-09-30T22:25:26.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:26.458+0000 7f7651a2c700 1 -- 172.21.15.40:0/2762056262 wait complete. 2023-09-30T22:25:26.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:27.174 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:27.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.314+0000 7ff9352b8700 1 Processor -- start 2023-09-30T22:25:27.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.314+0000 7ff9352b8700 1 -- start start 2023-09-30T22:25:27.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.315+0000 7ff9352b8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff93009c890 0x7ff93009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.315+0000 7ff9352b8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff93009d920 0x7ff93009dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.315+0000 7ff9352b8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff93009e2b0 0x7ff93013ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.315+0000 7ff9352b8700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9300a29d0 con 0x7ff93009c890 2023-09-30T22:25:27.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.315+0000 7ff9352b8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93009fb40 con 0x7ff93009d920 2023-09-30T22:25:27.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.315+0000 7ff9352b8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9300a2600 con 0x7ff93009e2b0 2023-09-30T22:25:27.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.315+0000 7ff927fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff93009d920 0x7ff93009dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.315+0000 7ff92f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff93009e2b0 0x7ff93013ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.315+0000 7ff92effd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff93009c890 0x7ff93009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.315+0000 7ff927fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff93009d920 0x7ff93009dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39172/0 (socket says 172.21.15.40:39172) 2023-09-30T22:25:27.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.315+0000 7ff92f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff93009e2b0 0x7ff93013ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48142/0 (socket says 172.21.15.40:48142) 2023-09-30T22:25:27.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.315+0000 7ff927fff700 1 -- 172.21.15.40:0/3625118000 learned_addr learned my addr 172.21.15.40:0/3625118000 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:27.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.315+0000 7ff927fff700 1 -- 172.21.15.40:0/3625118000 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff93009e2b0 msgr2=0x7ff93013ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:27.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.315+0000 7ff927fff700 1 --2- 172.21.15.40:0/3625118000 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff93009e2b0 0x7ff93013ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.315+0000 7ff927fff700 1 -- 172.21.15.40:0/3625118000 >> v2:172.21.15.40:3300/0 conn(0x7ff93009c890 msgr2=0x7ff93009cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:27.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.315+0000 7ff927fff700 1 --2- 172.21.15.40:0/3625118000 >> v2:172.21.15.40:3300/0 conn(0x7ff93009c890 0x7ff93009cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.315+0000 7ff927fff700 1 -- 172.21.15.40:0/3625118000 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93009fed0 con 0x7ff93009d920 2023-09-30T22:25:27.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.315+0000 7ff92effd700 1 --2- 172.21.15.40:0/3625118000 >> v2:172.21.15.40:3300/0 conn(0x7ff93009c890 0x7ff93009cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:27.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.315+0000 7ff927fff700 1 --2- 172.21.15.40:0/3625118000 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff93009d920 0x7ff93009dd70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff9180098f0 tx=0x7ff918009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ef2055acab58be3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:27.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.316+0000 7ff92e7fc700 1 -- 172.21.15.40:0/3625118000 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff918011830 con 0x7ff93009d920 2023-09-30T22:25:27.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.316+0000 7ff92e7fc700 1 -- 172.21.15.40:0/3625118000 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff918011990 con 0x7ff93009d920 2023-09-30T22:25:27.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.316+0000 7ff92e7fc700 1 -- 172.21.15.40:0/3625118000 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff918011d20 con 0x7ff93009d920 2023-09-30T22:25:27.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.316+0000 7ff9352b8700 1 -- 172.21.15.40:0/3625118000 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff93009d920 msgr2=0x7ff93009dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.316+0000 7ff9352b8700 1 --2- 172.21.15.40:0/3625118000 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff93009d920 0x7ff93009dd70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff9180098f0 tx=0x7ff918009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:27.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.316+0000 7ff9352b8700 1 -- 172.21.15.40:0/3625118000 shutdown_connections 2023-09-30T22:25:27.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.316+0000 7ff9352b8700 1 --2- 172.21.15.40:0/3625118000 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff93009e2b0 0x7ff93013ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.316+0000 7ff9352b8700 1 --2- 172.21.15.40:0/3625118000 >> v2:172.21.15.40:3300/0 conn(0x7ff93009c890 0x7ff93009cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.316+0000 7ff9352b8700 1 --2- 172.21.15.40:0/3625118000 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff93009d920 0x7ff93009dd70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.316+0000 7ff9352b8700 1 -- 172.21.15.40:0/3625118000 >> 172.21.15.40:0/3625118000 conn(0x7ff9300a7080 msgr2=0x7ff9300a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:27.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.316+0000 7ff9352b8700 1 -- 172.21.15.40:0/3625118000 shutdown_connections 2023-09-30T22:25:27.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.316+0000 7ff9352b8700 1 -- 172.21.15.40:0/3625118000 wait complete. 2023-09-30T22:25:27.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.317+0000 7ff9352b8700 1 Processor -- start 2023-09-30T22:25:27.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.317+0000 7ff9352b8700 1 -- start start 2023-09-30T22:25:27.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.318+0000 7ff9352b8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff93009c890 0x7ff9301c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.318+0000 7ff9352b8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff93009d920 0x7ff9301c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.318+0000 7ff9352b8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff93009e2b0 0x7ff9301c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.318+0000 7ff9352b8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93012fb90 con 0x7ff93009d920 2023-09-30T22:25:27.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.318+0000 7ff9352b8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93012f390 con 0x7ff93009c890 2023-09-30T22:25:27.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.318+0000 7ff9352b8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff93012f600 con 0x7ff93009e2b0 2023-09-30T22:25:27.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.318+0000 7ff927fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff93009d920 0x7ff9301c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.318+0000 7ff927fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff93009d920 0x7ff9301c8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44660/0 (socket says 172.21.15.40:44660) 2023-09-30T22:25:27.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.318+0000 7ff927fff700 1 -- 172.21.15.40:0/682364222 learned_addr learned my addr 172.21.15.40:0/682364222 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:27.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.318+0000 7ff92effd700 1 --2- 172.21.15.40:0/682364222 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff93009c890 0x7ff9301c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.318+0000 7ff92f7fe700 1 --2- 172.21.15.40:0/682364222 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff93009e2b0 0x7ff9301c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.318+0000 7ff92f7fe700 1 -- 172.21.15.40:0/682364222 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff93009c890 msgr2=0x7ff9301c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.318+0000 7ff92f7fe700 1 --2- 172.21.15.40:0/682364222 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff93009c890 0x7ff9301c89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.318+0000 7ff92f7fe700 1 -- 172.21.15.40:0/682364222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff93009d920 msgr2=0x7ff9301c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.318+0000 7ff92f7fe700 1 --2- 172.21.15.40:0/682364222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff93009d920 0x7ff9301c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.318+0000 7ff92f7fe700 1 -- 172.21.15.40:0/682364222 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff920009430 con 0x7ff93009e2b0 2023-09-30T22:25:27.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.318+0000 7ff927fff700 1 --2- 172.21.15.40:0/682364222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff93009d920 0x7ff9301c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:27.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.318+0000 7ff92f7fe700 1 --2- 172.21.15.40:0/682364222 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff93009e2b0 0x7ff9301c9460 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff92800efc0 tx=0x7ff92800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:27.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.318+0000 7ff9277fe700 1 -- 172.21.15.40:0/682364222 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92800cc90 con 0x7ff93009e2b0 2023-09-30T22:25:27.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.319+0000 7ff9277fe700 1 -- 172.21.15.40:0/682364222 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92800f040 con 0x7ff93009e2b0 2023-09-30T22:25:27.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.319+0000 7ff9352b8700 1 -- 172.21.15.40:0/682364222 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff918009550 con 0x7ff93009e2b0 2023-09-30T22:25:27.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.319+0000 7ff9277fe700 1 -- 172.21.15.40:0/682364222 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9280146c0 con 0x7ff93009e2b0 2023-09-30T22:25:27.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.319+0000 7ff9352b8700 1 -- 172.21.15.40:0/682364222 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff93009c270 con 0x7ff93009e2b0 2023-09-30T22:25:27.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.319+0000 7ff9277fe700 1 -- 172.21.15.40:0/682364222 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff928014820 con 0x7ff93009e2b0 2023-09-30T22:25:27.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.320+0000 7ff9277fe700 1 -- 172.21.15.40:0/682364222 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff9280405a0 con 0x7ff93009e2b0 2023-09-30T22:25:27.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.320+0000 7ff9352b8700 1 -- 172.21.15.40:0/682364222 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff930062380 con 0x7ff93009e2b0 2023-09-30T22:25:27.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.324+0000 7ff9277fe700 1 -- 172.21.15.40:0/682364222 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff928009e60 con 0x7ff93009e2b0 2023-09-30T22:25:27.337 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:27.446 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:27.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.465+0000 7fcdbdb40700 1 Processor -- start 2023-09-30T22:25:27.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.465+0000 7fcdbdb40700 1 -- start start 2023-09-30T22:25:27.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.466+0000 7fcdbdb40700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdb809d920 0x7fcdb809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.466+0000 7fcdbdb40700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdb809e230 0x7fcdb81343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.466+0000 7fcdbdb40700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdb809f940 con 0x7fcdb809f0f0 2023-09-30T22:25:27.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.466+0000 7fcdbdb40700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb806b4c0 con 0x7fcdb809d920 2023-09-30T22:25:27.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.466+0000 7fcdbdb40700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb809a8f0 con 0x7fcdb809e230 2023-09-30T22:25:27.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.466+0000 7fcdb77fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdb809d920 0x7fcdb809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.466+0000 7fcdb6ffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fcdb809f0f0 0x7fcdb8133ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:35098/0 (socket says 172.21.15.40:35098) 2023-09-30T22:25:27.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.466+0000 7fcdb6ffd700 1 -- 172.21.15.40:0/3927291530 learned_addr learned my addr 172.21.15.40:0/3927291530 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:27.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.466+0000 7fcdb7fff700 1 --2- 172.21.15.40:0/3927291530 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdb809e230 0x7fcdb81343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.467+0000 7fcdb77fe700 1 -- 172.21.15.40:0/3927291530 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdb809e230 msgr2=0x7fcdb81343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:27.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.467+0000 7fcdb77fe700 1 --2- 172.21.15.40:0/3927291530 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdb809e230 0x7fcdb81343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.467+0000 7fcdb67fc700 1 -- 172.21.15.40:0/3927291530 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1556363291 0 0) 0x7fcdb809f940 con 0x7fcdb809f0f0 2023-09-30T22:25:27.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.467+0000 7fcdb77fe700 1 -- 172.21.15.40:0/3927291530 >> v1:172.21.15.40:6789/0 conn(0x7fcdb809f0f0 legacy=0x7fcdb8133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.467+0000 7fcdb77fe700 1 -- 172.21.15.40:0/3927291530 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb809f6e0 con 0x7fcdb809d920 2023-09-30T22:25:27.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.467+0000 7fcdb7fff700 1 --2- 172.21.15.40:0/3927291530 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdb809e230 0x7fcdb81343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:27.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.467+0000 7fcdb77fe700 1 --2- 172.21.15.40:0/3927291530 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdb809d920 0x7fcdb809dcf0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcda8009850 tx=0x7fcda8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2142f9c4e36a330 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:27.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.467+0000 7fcdb67fc700 1 -- 172.21.15.40:0/3927291530 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda8005e30 con 0x7fcdb809d920 2023-09-30T22:25:27.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.467+0000 7fcdb67fc700 1 -- 172.21.15.40:0/3927291530 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda8006030 con 0x7fcdb809d920 2023-09-30T22:25:27.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.467+0000 7fcdb67fc700 1 -- 172.21.15.40:0/3927291530 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda80063e0 con 0x7fcdb809d920 2023-09-30T22:25:27.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.468+0000 7fcdbdb40700 1 -- 172.21.15.40:0/3927291530 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdb809d920 msgr2=0x7fcdb809dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.468+0000 7fcdbdb40700 1 --2- 172.21.15.40:0/3927291530 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdb809d920 0x7fcdb809dcf0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcda8009850 tx=0x7fcda8009b60 comp rx=0 tx=0).stop 2023-09-30T22:25:27.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.468+0000 7fcdbdb40700 1 -- 172.21.15.40:0/3927291530 shutdown_connections 2023-09-30T22:25:27.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.468+0000 7fcdbdb40700 1 --2- 172.21.15.40:0/3927291530 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdb809e230 0x7fcdb81343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.468+0000 7fcdbdb40700 1 --2- 172.21.15.40:0/3927291530 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdb809d920 0x7fcdb809dcf0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.468+0000 7fcdbdb40700 1 -- 172.21.15.40:0/3927291530 >> 172.21.15.40:0/3927291530 conn(0x7fcdb809fb20 msgr2=0x7fcdb809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:27.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.468+0000 7fcdbdb40700 1 -- 172.21.15.40:0/3927291530 shutdown_connections 2023-09-30T22:25:27.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.468+0000 7fcdbdb40700 1 -- 172.21.15.40:0/3927291530 wait complete. 2023-09-30T22:25:27.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.469+0000 7fcdbdb40700 1 Processor -- start 2023-09-30T22:25:27.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.469+0000 7fcdbdb40700 1 -- start start 2023-09-30T22:25:27.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.470+0000 7fcdbdb40700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdb809d920 0x7fcdb81c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.470+0000 7fcdbdb40700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdb809e230 0x7fcdb81c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.470+0000 7fcdbdb40700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdb81a9f30 0x7fcdb81c4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.470+0000 7fcdbdb40700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb809ca50 con 0x7fcdb809e230 2023-09-30T22:25:27.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.470+0000 7fcdbdb40700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb81a9490 con 0x7fcdb809d920 2023-09-30T22:25:27.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.470+0000 7fcdbdb40700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb81c9130 con 0x7fcdb81a9f30 2023-09-30T22:25:27.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.470+0000 7fcdb6ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdb809e230 0x7fcdb81c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.470+0000 7fcdb6ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdb809e230 0x7fcdb81c8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44672/0 (socket says 172.21.15.40:44672) 2023-09-30T22:25:27.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.470+0000 7fcdb6ffd700 1 -- 172.21.15.40:0/2938325338 learned_addr learned my addr 172.21.15.40:0/2938325338 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:27.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.470+0000 7fcdb7fff700 1 --2- 172.21.15.40:0/2938325338 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdb81a9f30 0x7fcdb81c4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.470+0000 7fcdb77fe700 1 --2- 172.21.15.40:0/2938325338 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdb809d920 0x7fcdb81c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.470+0000 7fcdb6ffd700 1 -- 172.21.15.40:0/2938325338 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdb81a9f30 msgr2=0x7fcdb81c4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.470+0000 7fcdb6ffd700 1 --2- 172.21.15.40:0/2938325338 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdb81a9f30 0x7fcdb81c4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.470+0000 7fcdb6ffd700 1 -- 172.21.15.40:0/2938325338 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdb809d920 msgr2=0x7fcdb81c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.470+0000 7fcdb6ffd700 1 --2- 172.21.15.40:0/2938325338 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdb809d920 0x7fcdb81c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.470+0000 7fcdb6ffd700 1 -- 172.21.15.40:0/2938325338 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb0009a70 con 0x7fcdb809e230 2023-09-30T22:25:27.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.470+0000 7fcdb7fff700 1 --2- 172.21.15.40:0/2938325338 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdb81a9f30 0x7fcdb81c4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:27.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.470+0000 7fcdb77fe700 1 --2- 172.21.15.40:0/2938325338 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdb809d920 0x7fcdb81c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:27.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.470+0000 7fcdb6ffd700 1 --2- 172.21.15.40:0/2938325338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdb809e230 0x7fcdb81c8bf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcdac00c550 tx=0x7fcdac00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:27.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.471+0000 7fcd9ffff700 1 -- 172.21.15.40:0/2938325338 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdac004c80 con 0x7fcdb809e230 2023-09-30T22:25:27.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.471+0000 7fcd9ffff700 1 -- 172.21.15.40:0/2938325338 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdac004de0 con 0x7fcdb809e230 2023-09-30T22:25:27.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.471+0000 7fcdbdb40700 1 -- 172.21.15.40:0/2938325338 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda8009430 con 0x7fcdb809e230 2023-09-30T22:25:27.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.471+0000 7fcd9ffff700 1 -- 172.21.15.40:0/2938325338 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdac007310 con 0x7fcdb809e230 2023-09-30T22:25:27.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.471+0000 7fcdbdb40700 1 -- 172.21.15.40:0/2938325338 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb81a9a30 con 0x7fcdb809e230 2023-09-30T22:25:27.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.472+0000 7fcd9ffff700 1 -- 172.21.15.40:0/2938325338 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcdac007470 con 0x7fcdb809e230 2023-09-30T22:25:27.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.472+0000 7fcdbdb40700 1 -- 172.21.15.40:0/2938325338 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb81a9620 con 0x7fcdb809e230 2023-09-30T22:25:27.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.472+0000 7fcd9ffff700 1 -- 172.21.15.40:0/2938325338 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fcdac03f4b0 con 0x7fcdb809e230 2023-09-30T22:25:27.475 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:27.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.477+0000 7fcd9ffff700 1 -- 172.21.15.40:0/2938325338 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcdb81a9620 con 0x7fcdb809e230 2023-09-30T22:25:27.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.526+0000 7ff9352b8700 1 -- 172.21.15.40:0/682364222 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff930074620 con 0x7ff93009e2b0 2023-09-30T22:25:27.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.527+0000 7ff9277fe700 1 -- 172.21.15.40:0/682364222 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff928012340 con 0x7ff93009e2b0 2023-09-30T22:25:27.527 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:27.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.529+0000 7ff9352b8700 1 -- 172.21.15.40:0/682364222 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff93009e2b0 msgr2=0x7ff9301c9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.529+0000 7ff9352b8700 1 --2- 172.21.15.40:0/682364222 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff93009e2b0 0x7ff9301c9460 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff92800efc0 tx=0x7ff92800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.529+0000 7ff9352b8700 1 -- 172.21.15.40:0/682364222 shutdown_connections 2023-09-30T22:25:27.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.529+0000 7ff9352b8700 1 --2- 172.21.15.40:0/682364222 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff93009e2b0 0x7ff9301c9460 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.529+0000 7ff9352b8700 1 --2- 172.21.15.40:0/682364222 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff93009c890 0x7ff9301c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.529+0000 7ff9352b8700 1 --2- 172.21.15.40:0/682364222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff93009d920 0x7ff9301c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.529+0000 7ff9352b8700 1 -- 172.21.15.40:0/682364222 >> 172.21.15.40:0/682364222 conn(0x7ff9300a7080 msgr2=0x7ff9300a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:27.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.529+0000 7ff9352b8700 1 -- 172.21.15.40:0/682364222 shutdown_connections 2023-09-30T22:25:27.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.529+0000 7ff9352b8700 1 -- 172.21.15.40:0/682364222 wait complete. 2023-09-30T22:25:27.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:27.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.581+0000 7f83bcc93700 1 Processor -- start 2023-09-30T22:25:27.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.581+0000 7f83bcc93700 1 -- start start 2023-09-30T22:25:27.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.582+0000 7f83bcc93700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f83b809c890 0x7f83b809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.582+0000 7f83bcc93700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83b809e480 0x7f83b813bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.582+0000 7f83bcc93700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83b80a2600 con 0x7f83b809d920 2023-09-30T22:25:27.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.582+0000 7f83bcc93700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83b80a29d0 con 0x7f83b809c890 2023-09-30T22:25:27.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.582+0000 7f83bcc93700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b809fb40 con 0x7f83b809e480 2023-09-30T22:25:27.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.582+0000 7f83b6d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83b809e480 0x7f83b813bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.582+0000 7f83b6d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83b809e480 0x7f83b813bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39198/0 (socket says 172.21.15.40:39198) 2023-09-30T22:25:27.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.582+0000 7f83b6d9d700 1 -- 172.21.15.40:0/538496857 learned_addr learned my addr 172.21.15.40:0/538496857 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:27.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.582+0000 7f83b659c700 1 --2- 172.21.15.40:0/538496857 >> v2:172.21.15.40:3300/0 conn(0x7f83b809c890 0x7f83b809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.582+0000 7f83b6d9d700 1 -- 172.21.15.40:0/538496857 >> v2:172.21.15.40:3300/0 conn(0x7f83b809c890 msgr2=0x7f83b809cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:27.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.582+0000 7f83b6d9d700 1 --2- 172.21.15.40:0/538496857 >> v2:172.21.15.40:3300/0 conn(0x7f83b809c890 0x7f83b809cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.582+0000 7f83b6d9d700 1 -- 172.21.15.40:0/538496857 >> v1:172.21.15.40:6789/0 conn(0x7f83b809d920 legacy=0x7f83b809dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.582+0000 7f83b6d9d700 1 -- 172.21.15.40:0/538496857 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b809fed0 con 0x7f83b809e480 2023-09-30T22:25:27.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.582+0000 7f83b6d9d700 1 --2- 172.21.15.40:0/538496857 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83b809e480 0x7f83b813bc20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009e50 tx=0x7f83b000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49bda3b6db994a23 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:27.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.583+0000 7f83b559a700 1 -- 172.21.15.40:0/538496857 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b000e070 con 0x7f83b809e480 2023-09-30T22:25:27.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.583+0000 7f83b559a700 1 -- 172.21.15.40:0/538496857 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b000b910 con 0x7f83b809e480 2023-09-30T22:25:27.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.583+0000 7f83b559a700 1 -- 172.21.15.40:0/538496857 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b000bcc0 con 0x7f83b809e480 2023-09-30T22:25:27.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.583+0000 7f83bcc93700 1 -- 172.21.15.40:0/538496857 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83b809e480 msgr2=0x7f83b813bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.583+0000 7f83bcc93700 1 --2- 172.21.15.40:0/538496857 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83b809e480 0x7f83b813bc20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009e50 tx=0x7f83b000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:27.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.584+0000 7f83bcc93700 1 -- 172.21.15.40:0/538496857 shutdown_connections 2023-09-30T22:25:27.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.584+0000 7f83bcc93700 1 --2- 172.21.15.40:0/538496857 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83b809e480 0x7f83b813bc20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.584+0000 7f83bcc93700 1 --2- 172.21.15.40:0/538496857 >> v2:172.21.15.40:3300/0 conn(0x7f83b809c890 0x7f83b809cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.584+0000 7f83bcc93700 1 -- 172.21.15.40:0/538496857 >> 172.21.15.40:0/538496857 conn(0x7f83b80a7080 msgr2=0x7f83b80a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:27.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.584+0000 7f83bcc93700 1 -- 172.21.15.40:0/538496857 shutdown_connections 2023-09-30T22:25:27.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.584+0000 7f83bcc93700 1 -- 172.21.15.40:0/538496857 wait complete. 2023-09-30T22:25:27.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.585+0000 7f83bcc93700 1 Processor -- start 2023-09-30T22:25:27.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.585+0000 7f83bcc93700 1 -- start start 2023-09-30T22:25:27.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.585+0000 7f83bcc93700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f83b809c890 0x7f83b812d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.585+0000 7f83bcc93700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83b809d920 0x7f83b812d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.585+0000 7f83bcc93700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83b809e480 0x7f83b812de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.585+0000 7f83bcc93700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b812ee40 con 0x7f83b809d920 2023-09-30T22:25:27.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.585+0000 7f83bcc93700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b812ec50 con 0x7f83b809e480 2023-09-30T22:25:27.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.585+0000 7f83bcc93700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83b812f520 con 0x7f83b809c890 2023-09-30T22:25:27.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.585+0000 7f83b5d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83b809d920 0x7f83b812d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.585+0000 7f83b5d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83b809d920 0x7f83b812d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44696/0 (socket says 172.21.15.40:44696) 2023-09-30T22:25:27.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.585+0000 7f83b5d9b700 1 -- 172.21.15.40:0/1194050790 learned_addr learned my addr 172.21.15.40:0/1194050790 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:27.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.585+0000 7f83b659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f83b809c890 0x7f83b812d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.585+0000 7f83b6d9d700 1 --2- 172.21.15.40:0/1194050790 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83b809e480 0x7f83b812de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.586+0000 7f83b5d9b700 1 -- 172.21.15.40:0/1194050790 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f83b809c890 msgr2=0x7f83b812d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.586+0000 7f83b5d9b700 1 --2- 172.21.15.40:0/1194050790 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f83b809c890 0x7f83b812d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.586+0000 7f83b5d9b700 1 -- 172.21.15.40:0/1194050790 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83b809e480 msgr2=0x7f83b812de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.586+0000 7f83b5d9b700 1 --2- 172.21.15.40:0/1194050790 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83b809e480 0x7f83b812de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.586+0000 7f83b5d9b700 1 -- 172.21.15.40:0/1194050790 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b0009b30 con 0x7f83b809d920 2023-09-30T22:25:27.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.586+0000 7f83b5d9b700 1 --2- 172.21.15.40:0/1194050790 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83b809d920 0x7f83b812d910 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f83ac00c4e0 tx=0x7f83ac00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:27.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.586+0000 7f83a6ffd700 1 -- 172.21.15.40:0/1194050790 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac0052d0 con 0x7f83b809d920 2023-09-30T22:25:27.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.586+0000 7f83a6ffd700 1 -- 172.21.15.40:0/1194050790 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ac005430 con 0x7f83b809d920 2023-09-30T22:25:27.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.586+0000 7f83a6ffd700 1 -- 172.21.15.40:0/1194050790 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac0038c0 con 0x7f83b809d920 2023-09-30T22:25:27.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.586+0000 7f83bcc93700 1 -- 172.21.15.40:0/1194050790 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b809ecf0 con 0x7f83b809d920 2023-09-30T22:25:27.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.586+0000 7f83bcc93700 1 -- 172.21.15.40:0/1194050790 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b8130880 con 0x7f83b809d920 2023-09-30T22:25:27.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.587+0000 7f83a6ffd700 1 -- 172.21.15.40:0/1194050790 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f83ac003a20 con 0x7f83b809d920 2023-09-30T22:25:27.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.587+0000 7f83a6ffd700 1 -- 172.21.15.40:0/1194050790 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f83ac03eac0 con 0x7f83b809d920 2023-09-30T22:25:27.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.587+0000 7f83bcc93700 1 -- 172.21.15.40:0/1194050790 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b8070610 con 0x7f83b809d920 2023-09-30T22:25:27.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.592+0000 7f83a6ffd700 1 -- 172.21.15.40:0/1194050790 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f83ac017020 con 0x7f83b809d920 2023-09-30T22:25:27.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.611+0000 7f8fb34e0700 1 Processor -- start 2023-09-30T22:25:27.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.611+0000 7f8fb34e0700 1 -- start start 2023-09-30T22:25:27.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.612+0000 7f8fb34e0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fac09c890 0x7f8fac09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.612+0000 7f8fb34e0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8fac09d920 0x7f8fac09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.612+0000 7f8fb34e0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8fac09e2b0 0x7f8fac13ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.612+0000 7f8fb34e0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fac0a29d0 con 0x7f8fac09e2b0 2023-09-30T22:25:27.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.612+0000 7f8fb34e0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac09fb40 con 0x7f8fac09c890 2023-09-30T22:25:27.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.612+0000 7f8fb34e0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac0a2600 con 0x7f8fac09d920 2023-09-30T22:25:27.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.612+0000 7f8fb1a7d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8fac09e2b0 0x7f8fac13ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.612+0000 7f8fb0a7b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8fac09d920 0x7f8fac09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.612+0000 7f8fb127c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fac09c890 0x7f8fac09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.612+0000 7f8fb0a7b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8fac09d920 0x7f8fac09dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48198/0 (socket says 172.21.15.40:48198) 2023-09-30T22:25:27.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.612+0000 7f8fb0a7b700 1 -- 172.21.15.40:0/3669345212 learned_addr learned my addr 172.21.15.40:0/3669345212 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:27.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.612+0000 7f8fb1a7d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8fac09e2b0 0x7f8fac13ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44710/0 (socket says 172.21.15.40:44710) 2023-09-30T22:25:27.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.612+0000 7f8fb127c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fac09c890 0x7f8fac09cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39218/0 (socket says 172.21.15.40:39218) 2023-09-30T22:25:27.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.613+0000 7f8fb1a7d700 1 -- 172.21.15.40:0/3669345212 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8fac09d920 msgr2=0x7f8fac09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:27.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.613+0000 7f8fb1a7d700 1 --2- 172.21.15.40:0/3669345212 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8fac09d920 0x7f8fac09dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.613+0000 7f8fb1a7d700 1 -- 172.21.15.40:0/3669345212 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fac09c890 msgr2=0x7f8fac09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:27.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.613+0000 7f8fb1a7d700 1 --2- 172.21.15.40:0/3669345212 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fac09c890 0x7f8fac09cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.613+0000 7f8fb1a7d700 1 -- 172.21.15.40:0/3669345212 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fac09e720 con 0x7f8fac09e2b0 2023-09-30T22:25:27.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.613+0000 7f8fb0a7b700 1 --2- 172.21.15.40:0/3669345212 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8fac09d920 0x7f8fac09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:27.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.613+0000 7f8fb127c700 1 --2- 172.21.15.40:0/3669345212 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fac09c890 0x7f8fac09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:27.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.613+0000 7f8fb1a7d700 1 --2- 172.21.15.40:0/3669345212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fac09e2b0 0x7f8fac13ac10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009dc0 tx=0x7f8fa400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2757b51f4109e39d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:27.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.613+0000 7f8fa3fff700 1 -- 172.21.15.40:0/3669345212 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa400e070 con 0x7f8fac09e2b0 2023-09-30T22:25:27.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.613+0000 7f8fa3fff700 1 -- 172.21.15.40:0/3669345212 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa400bae0 con 0x7f8fac09e2b0 2023-09-30T22:25:27.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.613+0000 7f8fa3fff700 1 -- 172.21.15.40:0/3669345212 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa400be90 con 0x7f8fac09e2b0 2023-09-30T22:25:27.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.613+0000 7f8fb34e0700 1 -- 172.21.15.40:0/3669345212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fac09e2b0 msgr2=0x7f8fac13ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.613+0000 7f8fb34e0700 1 --2- 172.21.15.40:0/3669345212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fac09e2b0 0x7f8fac13ac10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009dc0 tx=0x7f8fa400b330 comp rx=0 tx=0).stop 2023-09-30T22:25:27.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.614+0000 7f8fb34e0700 1 -- 172.21.15.40:0/3669345212 shutdown_connections 2023-09-30T22:25:27.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.614+0000 7f8fb34e0700 1 --2- 172.21.15.40:0/3669345212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fac09e2b0 0x7f8fac13ac10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.614+0000 7f8fb34e0700 1 --2- 172.21.15.40:0/3669345212 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fac09c890 0x7f8fac09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.614+0000 7f8fb34e0700 1 --2- 172.21.15.40:0/3669345212 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8fac09d920 0x7f8fac09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.614+0000 7f8fb34e0700 1 -- 172.21.15.40:0/3669345212 >> 172.21.15.40:0/3669345212 conn(0x7f8fac0a7080 msgr2=0x7f8fac0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:27.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.614+0000 7f8fb34e0700 1 -- 172.21.15.40:0/3669345212 shutdown_connections 2023-09-30T22:25:27.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.614+0000 7f8fb34e0700 1 -- 172.21.15.40:0/3669345212 wait complete. 2023-09-30T22:25:27.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.615+0000 7f8fb34e0700 1 Processor -- start 2023-09-30T22:25:27.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.615+0000 7f8fb34e0700 1 -- start start 2023-09-30T22:25:27.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.615+0000 7f8fb34e0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fac09c890 0x7f8fac12d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.615+0000 7f8fb34e0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8fac09d920 0x7f8fac12d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.615+0000 7f8fb34e0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fac09e2b0 0x7f8fac12dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.615+0000 7f8fb34e0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac12fbc0 con 0x7f8fac09c890 2023-09-30T22:25:27.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.615+0000 7f8fb34e0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac130c00 con 0x7f8fac09e2b0 2023-09-30T22:25:27.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.615+0000 7f8fb34e0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac12e620 con 0x7f8fac09d920 2023-09-30T22:25:27.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.615+0000 7f8fb0a7b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8fac09d920 0x7f8fac12d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.615+0000 7f8fb0a7b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8fac09d920 0x7f8fac12d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48214/0 (socket says 172.21.15.40:48214) 2023-09-30T22:25:27.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.615+0000 7f8fb0a7b700 1 -- 172.21.15.40:0/1389103788 learned_addr learned my addr 172.21.15.40:0/1389103788 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:27.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.616+0000 7f8fb127c700 1 --2- 172.21.15.40:0/1389103788 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fac09c890 0x7f8fac12d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.616+0000 7f8fb1a7d700 1 --2- 172.21.15.40:0/1389103788 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fac09e2b0 0x7f8fac12dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.616+0000 7f8fb0a7b700 1 -- 172.21.15.40:0/1389103788 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fac09e2b0 msgr2=0x7f8fac12dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.616+0000 7f8fb0a7b700 1 --2- 172.21.15.40:0/1389103788 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fac09e2b0 0x7f8fac12dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.616+0000 7f8fb0a7b700 1 -- 172.21.15.40:0/1389103788 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fac09c890 msgr2=0x7f8fac12d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.616+0000 7f8fb0a7b700 1 --2- 172.21.15.40:0/1389103788 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fac09c890 0x7f8fac12d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.616+0000 7f8fb0a7b700 1 -- 172.21.15.40:0/1389103788 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa8009430 con 0x7f8fac09d920 2023-09-30T22:25:27.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.616+0000 7f8fb127c700 1 --2- 172.21.15.40:0/1389103788 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fac09c890 0x7f8fac12d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:27.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.616+0000 7f8fb1a7d700 1 --2- 172.21.15.40:0/1389103788 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fac09e2b0 0x7f8fac12dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:27.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.616+0000 7f8fb0a7b700 1 --2- 172.21.15.40:0/1389103788 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8fac09d920 0x7f8fac12d700 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00ebe0 tx=0x7f8f9c009e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:27.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.616+0000 7f8fa1ffb700 1 -- 172.21.15.40:0/1389103788 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c00c8b0 con 0x7f8fac09d920 2023-09-30T22:25:27.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.616+0000 7f8fa1ffb700 1 -- 172.21.15.40:0/1389103788 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9c00ca10 con 0x7f8fac09d920 2023-09-30T22:25:27.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.616+0000 7f8fa1ffb700 1 -- 172.21.15.40:0/1389103788 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c00cdc0 con 0x7f8fac09d920 2023-09-30T22:25:27.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.616+0000 7f8fb34e0700 1 -- 172.21.15.40:0/1389103788 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f9c009550 con 0x7f8fac09d920 2023-09-30T22:25:27.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.616+0000 7f8fb34e0700 1 -- 172.21.15.40:0/1389103788 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa4009a70 con 0x7f8fac09d920 2023-09-30T22:25:27.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.617+0000 7f8fa1ffb700 1 -- 172.21.15.40:0/1389103788 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8f9c013470 con 0x7f8fac09d920 2023-09-30T22:25:27.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.617+0000 7f8fa1ffb700 1 -- 172.21.15.40:0/1389103788 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f8f9c03f890 con 0x7f8fac09d920 2023-09-30T22:25:27.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.618+0000 7f8fb34e0700 1 -- 172.21.15.40:0/1389103788 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fac09ecf0 con 0x7f8fac09d920 2023-09-30T22:25:27.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.622+0000 7f8fa1ffb700 1 -- 172.21.15.40:0/1389103788 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8f9c0232f0 con 0x7f8fac09d920 2023-09-30T22:25:27.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.716+0000 7fcdbdb40700 1 -- 172.21.15.40:0/2938325338 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcdb81a95d0 con 0x7fcdb809e230 2023-09-30T22:25:27.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.716+0000 7fcd9ffff700 1 -- 172.21.15.40:0/2938325338 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcdac0123b0 con 0x7fcdb809e230 2023-09-30T22:25:27.716 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:27.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.719+0000 7fcdbdb40700 1 -- 172.21.15.40:0/2938325338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdb809e230 msgr2=0x7fcdb81c8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.719+0000 7fcdbdb40700 1 --2- 172.21.15.40:0/2938325338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdb809e230 0x7fcdb81c8bf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcdac00c550 tx=0x7fcdac00c910 comp rx=0 tx=0).stop 2023-09-30T22:25:27.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.719+0000 7fcdbdb40700 1 -- 172.21.15.40:0/2938325338 shutdown_connections 2023-09-30T22:25:27.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.719+0000 7fcdbdb40700 1 --2- 172.21.15.40:0/2938325338 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdb81a9f30 0x7fcdb81c4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.719+0000 7fcdbdb40700 1 --2- 172.21.15.40:0/2938325338 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdb809d920 0x7fcdb81c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.719+0000 7fcdbdb40700 1 --2- 172.21.15.40:0/2938325338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdb809e230 0x7fcdb81c8bf0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.719+0000 7fcdbdb40700 1 -- 172.21.15.40:0/2938325338 >> 172.21.15.40:0/2938325338 conn(0x7fcdb809fb20 msgr2=0x7fcdb81baf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:27.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.719+0000 7fcdbdb40700 1 -- 172.21.15.40:0/2938325338 shutdown_connections 2023-09-30T22:25:27.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.719+0000 7fcdbdb40700 1 -- 172.21.15.40:0/2938325338 wait complete. 2023-09-30T22:25:27.736 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:27.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.802+0000 7f83bcc93700 1 -- 172.21.15.40:0/1194050790 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f83b8062380 con 0x7f83b809d920 2023-09-30T22:25:27.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.803+0000 7f83a6ffd700 1 -- 172.21.15.40:0/1194050790 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f83ac018260 con 0x7f83b809d920 2023-09-30T22:25:27.803 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:27.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.805+0000 7f83bcc93700 1 -- 172.21.15.40:0/1194050790 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83b809d920 msgr2=0x7f83b812d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.805+0000 7f83bcc93700 1 --2- 172.21.15.40:0/1194050790 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83b809d920 0x7f83b812d910 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f83ac00c4e0 tx=0x7f83ac00c7f0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.805+0000 7f83bcc93700 1 -- 172.21.15.40:0/1194050790 shutdown_connections 2023-09-30T22:25:27.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.805+0000 7f83bcc93700 1 --2- 172.21.15.40:0/1194050790 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f83b809c890 0x7f83b812d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.805+0000 7f83bcc93700 1 --2- 172.21.15.40:0/1194050790 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83b809e480 0x7f83b812de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.805+0000 7f83bcc93700 1 --2- 172.21.15.40:0/1194050790 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83b809d920 0x7f83b812d910 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.805+0000 7f83bcc93700 1 -- 172.21.15.40:0/1194050790 >> 172.21.15.40:0/1194050790 conn(0x7f83b80a7080 msgr2=0x7f83b81333e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:27.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.805+0000 7f83bcc93700 1 -- 172.21.15.40:0/1194050790 shutdown_connections 2023-09-30T22:25:27.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.805+0000 7f83bcc93700 1 -- 172.21.15.40:0/1194050790 wait complete. 2023-09-30T22:25:27.818 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:27.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.846+0000 7f8fb34e0700 1 -- 172.21.15.40:0/1389103788 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8fac062380 con 0x7f8fac09d920 2023-09-30T22:25:27.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.847+0000 7f8fa1ffb700 1 -- 172.21.15.40:0/1389103788 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8f9c021020 con 0x7f8fac09d920 2023-09-30T22:25:27.847 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:27.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.849+0000 7f8fb34e0700 1 -- 172.21.15.40:0/1389103788 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8fac09d920 msgr2=0x7f8fac12d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.849+0000 7f8fb34e0700 1 --2- 172.21.15.40:0/1389103788 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8fac09d920 0x7f8fac12d700 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00ebe0 tx=0x7f8f9c009e50 comp rx=0 tx=0).stop 2023-09-30T22:25:27.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.849+0000 7f8fb34e0700 1 -- 172.21.15.40:0/1389103788 shutdown_connections 2023-09-30T22:25:27.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.849+0000 7f8fb34e0700 1 --2- 172.21.15.40:0/1389103788 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fac09e2b0 0x7f8fac12dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.849+0000 7f8fb34e0700 1 --2- 172.21.15.40:0/1389103788 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fac09c890 0x7f8fac12d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.849+0000 7f8fb34e0700 1 --2- 172.21.15.40:0/1389103788 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8fac09d920 0x7f8fac12d700 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.849+0000 7f8fb34e0700 1 -- 172.21.15.40:0/1389103788 >> 172.21.15.40:0/1389103788 conn(0x7f8fac0a7080 msgr2=0x7f8fac0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:27.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.849+0000 7f8fb34e0700 1 -- 172.21.15.40:0/1389103788 shutdown_connections 2023-09-30T22:25:27.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:27.849+0000 7f8fb34e0700 1 -- 172.21.15.40:0/1389103788 wait complete. 2023-09-30T22:25:27.862 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:28.546 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:28.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.685+0000 7f73f2842700 1 Processor -- start 2023-09-30T22:25:28.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.686+0000 7f73f2842700 1 -- start start 2023-09-30T22:25:28.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.686+0000 7f73f2842700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f73ec09d450 0x7f73ec09d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.686+0000 7f73f2842700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73ec09dd60 0x7f73ec1301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.686+0000 7f73f2842700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73ec09c3b0 con 0x7f73ec130700 2023-09-30T22:25:28.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.686+0000 7f73f2842700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73ec09a6b0 con 0x7f73ec09d450 2023-09-30T22:25:28.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.686+0000 7f73f2842700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec09b4f0 con 0x7f73ec09dd60 2023-09-30T22:25:28.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.687+0000 7f73eb7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73ec09dd60 0x7f73ec1301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.687+0000 7f73ebfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f73ec09d450 0x7f73ec09d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.687+0000 7f73eb7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73ec09dd60 0x7f73ec1301c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48222/0 (socket says 172.21.15.40:48222) 2023-09-30T22:25:28.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.687+0000 7f73ebfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f73ec09d450 0x7f73ec09d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44732/0 (socket says 172.21.15.40:44732) 2023-09-30T22:25:28.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.687+0000 7f73eb7fe700 1 -- 172.21.15.40:0/3431789729 learned_addr learned my addr 172.21.15.40:0/3431789729 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:28.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.687+0000 7f73eb7fe700 1 -- 172.21.15.40:0/3431789729 >> v2:172.21.15.40:3300/0 conn(0x7f73ec09d450 msgr2=0x7f73ec09d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:28.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.687+0000 7f73eb7fe700 1 --2- 172.21.15.40:0/3431789729 >> v2:172.21.15.40:3300/0 conn(0x7f73ec09d450 0x7f73ec09d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.687+0000 7f73eb7fe700 1 -- 172.21.15.40:0/3431789729 >> v1:172.21.15.40:6789/0 conn(0x7f73ec130700 legacy=0x7f73ec137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:28.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.687+0000 7f73eb7fe700 1 -- 172.21.15.40:0/3431789729 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73ec09af90 con 0x7f73ec09dd60 2023-09-30T22:25:28.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.687+0000 7f73eaffd700 1 -- 172.21.15.40:0/3431789729 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2758294694 0 0) 0x7f73ec09c3b0 con 0x7f73ec130700 2023-09-30T22:25:28.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.687+0000 7f73ebfff700 1 --2- 172.21.15.40:0/3431789729 >> v2:172.21.15.40:3300/0 conn(0x7f73ec09d450 0x7f73ec09d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:28.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.687+0000 7f73eb7fe700 1 --2- 172.21.15.40:0/3431789729 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73ec09dd60 0x7f73ec1301c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f73e00098f0 tx=0x7f73e0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f27a35d520e3596d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:28.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.687+0000 7f73eaffd700 1 -- 172.21.15.40:0/3431789729 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e000f810 con 0x7f73ec09dd60 2023-09-30T22:25:28.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.687+0000 7f73eaffd700 1 -- 172.21.15.40:0/3431789729 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e000f970 con 0x7f73ec09dd60 2023-09-30T22:25:28.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.687+0000 7f73eaffd700 1 -- 172.21.15.40:0/3431789729 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e000fd00 con 0x7f73ec09dd60 2023-09-30T22:25:28.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.688+0000 7f73f2842700 1 -- 172.21.15.40:0/3431789729 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73ec09dd60 msgr2=0x7f73ec1301c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:28.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.688+0000 7f73f2842700 1 --2- 172.21.15.40:0/3431789729 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73ec09dd60 0x7f73ec1301c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f73e00098f0 tx=0x7f73e0009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:28.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.688+0000 7f73f2842700 1 -- 172.21.15.40:0/3431789729 shutdown_connections 2023-09-30T22:25:28.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.688+0000 7f73f2842700 1 --2- 172.21.15.40:0/3431789729 >> v2:172.21.15.40:3300/0 conn(0x7f73ec09d450 0x7f73ec09d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.688+0000 7f73f2842700 1 --2- 172.21.15.40:0/3431789729 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73ec09dd60 0x7f73ec1301c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.688+0000 7f73f2842700 1 -- 172.21.15.40:0/3431789729 >> 172.21.15.40:0/3431789729 conn(0x7f73ec0a2a00 msgr2=0x7f73ec0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:28.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.688+0000 7f73f2842700 1 -- 172.21.15.40:0/3431789729 shutdown_connections 2023-09-30T22:25:28.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.688+0000 7f73f2842700 1 -- 172.21.15.40:0/3431789729 wait complete. 2023-09-30T22:25:28.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.689+0000 7f73f2842700 1 Processor -- start 2023-09-30T22:25:28.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.689+0000 7f73f2842700 1 -- start start 2023-09-30T22:25:28.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.690+0000 7f73f2842700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73ec09d450 0x7f73ec1c3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.690+0000 7f73f2842700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73ec09dd60 0x7f73ec1c43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.690+0000 7f73f2842700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73ec130700 0x7f73ec1c4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.690+0000 7f73f2842700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec11d390 con 0x7f73ec09d450 2023-09-30T22:25:28.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.690+0000 7f73f2842700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec0a1ff0 con 0x7f73ec130700 2023-09-30T22:25:28.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.690+0000 7f73f2842700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec11cef0 con 0x7f73ec09dd60 2023-09-30T22:25:28.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.690+0000 7f73ebfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73ec09d450 0x7f73ec1c3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.690+0000 7f73eb7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73ec09dd60 0x7f73ec1c43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.690+0000 7f73ebfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73ec09d450 0x7f73ec1c3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44736/0 (socket says 172.21.15.40:44736) 2023-09-30T22:25:28.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.690+0000 7f73ebfff700 1 -- 172.21.15.40:0/3907103622 learned_addr learned my addr 172.21.15.40:0/3907103622 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:28.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.690+0000 7f73f0ddf700 1 --2- 172.21.15.40:0/3907103622 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73ec130700 0x7f73ec1c4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.690+0000 7f73ebfff700 1 -- 172.21.15.40:0/3907103622 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73ec09dd60 msgr2=0x7f73ec1c43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:28.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.690+0000 7f73ebfff700 1 --2- 172.21.15.40:0/3907103622 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73ec09dd60 0x7f73ec1c43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.691+0000 7f73ebfff700 1 -- 172.21.15.40:0/3907103622 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73ec130700 msgr2=0x7f73ec1c4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:28.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.691+0000 7f73ebfff700 1 --2- 172.21.15.40:0/3907103622 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73ec130700 0x7f73ec1c4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.691+0000 7f73ebfff700 1 -- 172.21.15.40:0/3907103622 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73dc0094a0 con 0x7f73ec09d450 2023-09-30T22:25:28.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.691+0000 7f73eb7fe700 1 --2- 172.21.15.40:0/3907103622 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73ec09dd60 0x7f73ec1c43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:28.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.691+0000 7f73ebfff700 1 --2- 172.21.15.40:0/3907103622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73ec09d450 0x7f73ec1c3eb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f73dc00ebe0 tx=0x7f73dc00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:28.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.691+0000 7f73e8ff9700 1 -- 172.21.15.40:0/3907103622 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73dc00c850 con 0x7f73ec09d450 2023-09-30T22:25:28.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.691+0000 7f73e8ff9700 1 -- 172.21.15.40:0/3907103622 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73dc00c9b0 con 0x7f73ec09d450 2023-09-30T22:25:28.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.691+0000 7f73f2842700 1 -- 172.21.15.40:0/3907103622 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e0009550 con 0x7f73ec09d450 2023-09-30T22:25:28.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.691+0000 7f73e8ff9700 1 -- 172.21.15.40:0/3907103622 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73dc00cd40 con 0x7f73ec09d450 2023-09-30T22:25:28.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.691+0000 7f73f2842700 1 -- 172.21.15.40:0/3907103622 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73ec11d680 con 0x7f73ec09d450 2023-09-30T22:25:28.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.692+0000 7f73e8ff9700 1 -- 172.21.15.40:0/3907103622 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f73dc013470 con 0x7f73ec09d450 2023-09-30T22:25:28.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.692+0000 7f73e8ff9700 1 -- 172.21.15.40:0/3907103622 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f73dc03f840 con 0x7f73ec09d450 2023-09-30T22:25:28.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.692+0000 7f73f2842700 1 -- 172.21.15.40:0/3907103622 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73ec062380 con 0x7f73ec09d450 2023-09-30T22:25:28.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.697+0000 7f73e8ff9700 1 -- 172.21.15.40:0/3907103622 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f73dc013720 con 0x7f73ec09d450 2023-09-30T22:25:28.738 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:28.818 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:28.863 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:28.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.874+0000 7f3a2495e700 1 Processor -- start 2023-09-30T22:25:28.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.874+0000 7f3a2495e700 1 -- start start 2023-09-30T22:25:28.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.874+0000 7f3a2495e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3a20133e00 0x7f3a201341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.874+0000 7f3a2495e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a2009d400 0x7f3a2009d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.874+0000 7f3a2495e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a20133940 con 0x7f3a2009dd70 2023-09-30T22:25:28.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.874+0000 7f3a2495e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a2009f0d0 con 0x7f3a20133e00 2023-09-30T22:25:28.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.874+0000 7f3a2495e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a20133be0 con 0x7f3a2009d400 2023-09-30T22:25:28.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.875+0000 7f3a1e59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3a20133e00 0x7f3a201341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.875+0000 7f3a1e59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3a20133e00 0x7f3a201341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44742/0 (socket says 172.21.15.40:44742) 2023-09-30T22:25:28.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.875+0000 7f3a1e59c700 1 -- 172.21.15.40:0/2384796049 learned_addr learned my addr 172.21.15.40:0/2384796049 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:28.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.875+0000 7f3a1dd9b700 1 --2- 172.21.15.40:0/2384796049 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a2009d400 0x7f3a2009d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.875+0000 7f3a1e59c700 1 -- 172.21.15.40:0/2384796049 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a2009d400 msgr2=0x7f3a2009d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:28.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.875+0000 7f3a1e59c700 1 --2- 172.21.15.40:0/2384796049 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a2009d400 0x7f3a2009d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.875+0000 7f3a1e59c700 1 -- 172.21.15.40:0/2384796049 >> v1:172.21.15.40:6789/0 conn(0x7f3a2009dd70 legacy=0x7f3a2013ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:28.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.875+0000 7f3a1e59c700 1 -- 172.21.15.40:0/2384796049 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2009a860 con 0x7f3a20133e00 2023-09-30T22:25:28.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.875+0000 7f3a1e59c700 1 --2- 172.21.15.40:0/2384796049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a20133e00 0x7f3a201341d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3a100098f0 tx=0x7f3a10009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ccf7b21dffe59cf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:28.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.875+0000 7f3a1d59a700 1 -- 172.21.15.40:0/2384796049 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a10011830 con 0x7f3a20133e00 2023-09-30T22:25:28.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.875+0000 7f3a1d59a700 1 -- 172.21.15.40:0/2384796049 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a10011990 con 0x7f3a20133e00 2023-09-30T22:25:28.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.875+0000 7f3a1d59a700 1 -- 172.21.15.40:0/2384796049 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a10011d20 con 0x7f3a20133e00 2023-09-30T22:25:28.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.876+0000 7f3a2495e700 1 -- 172.21.15.40:0/2384796049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a20133e00 msgr2=0x7f3a201341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:28.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.876+0000 7f3a2495e700 1 --2- 172.21.15.40:0/2384796049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a20133e00 0x7f3a201341d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3a100098f0 tx=0x7f3a10009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:28.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.876+0000 7f3a2495e700 1 -- 172.21.15.40:0/2384796049 shutdown_connections 2023-09-30T22:25:28.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.876+0000 7f3a2495e700 1 --2- 172.21.15.40:0/2384796049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a20133e00 0x7f3a201341d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.876+0000 7f3a2495e700 1 --2- 172.21.15.40:0/2384796049 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a2009d400 0x7f3a2009d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.876+0000 7f3a2495e700 1 -- 172.21.15.40:0/2384796049 >> 172.21.15.40:0/2384796049 conn(0x7f3a200a2a00 msgr2=0x7f3a200a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:28.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.876+0000 7f3a2495e700 1 -- 172.21.15.40:0/2384796049 shutdown_connections 2023-09-30T22:25:28.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.876+0000 7f3a2495e700 1 -- 172.21.15.40:0/2384796049 wait complete. 2023-09-30T22:25:28.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.877+0000 7f3a2495e700 1 Processor -- start 2023-09-30T22:25:28.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.878+0000 7f3a2495e700 1 -- start start 2023-09-30T22:25:28.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.878+0000 7f3a2495e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a2009d400 0x7f3a2011cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.878+0000 7f3a2495e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a2009dd70 0x7f3a2011d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.878+0000 7f3a2495e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a20133e00 0x7f3a2011d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.878+0000 7f3a2495e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a20120610 con 0x7f3a2009dd70 2023-09-30T22:25:28.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.878+0000 7f3a2495e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2011e900 con 0x7f3a2009d400 2023-09-30T22:25:28.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.878+0000 7f3a2495e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a20120270 con 0x7f3a20133e00 2023-09-30T22:25:28.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.878+0000 7f3a1e59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a2009d400 0x7f3a2011cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.878+0000 7f3a1e59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a2009d400 0x7f3a2011cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39244/0 (socket says 172.21.15.40:39244) 2023-09-30T22:25:28.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.878+0000 7f3a1dd9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a2009dd70 0x7f3a2011d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.878+0000 7f3a1e59c700 1 -- 172.21.15.40:0/363694852 learned_addr learned my addr 172.21.15.40:0/363694852 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:28.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.878+0000 7f3a1ed9d700 1 --2- 172.21.15.40:0/363694852 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a20133e00 0x7f3a2011d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.879+0000 7f3a1e59c700 1 -- 172.21.15.40:0/363694852 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a20133e00 msgr2=0x7f3a2011d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:28.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.879+0000 7f3a1e59c700 1 --2- 172.21.15.40:0/363694852 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a20133e00 0x7f3a2011d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.879+0000 7f3a1e59c700 1 -- 172.21.15.40:0/363694852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a2009dd70 msgr2=0x7f3a2011d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:28.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.879+0000 7f3a1e59c700 1 --2- 172.21.15.40:0/363694852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a2009dd70 0x7f3a2011d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.879+0000 7f3a1e59c700 1 -- 172.21.15.40:0/363694852 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a10009550 con 0x7f3a2009d400 2023-09-30T22:25:28.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.879+0000 7f3a1e59c700 1 --2- 172.21.15.40:0/363694852 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a2009d400 0x7f3a2011cdc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3a10000c00 tx=0x7f3a10004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:28.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.879+0000 7f3a0effd700 1 -- 172.21.15.40:0/363694852 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a100036a0 con 0x7f3a2009d400 2023-09-30T22:25:28.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.879+0000 7f3a0effd700 1 -- 172.21.15.40:0/363694852 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a10003800 con 0x7f3a2009d400 2023-09-30T22:25:28.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.879+0000 7f3a0effd700 1 -- 172.21.15.40:0/363694852 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a10003bb0 con 0x7f3a2009d400 2023-09-30T22:25:28.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.880+0000 7f3a2495e700 1 -- 172.21.15.40:0/363694852 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a20120810 con 0x7f3a2009d400 2023-09-30T22:25:28.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.880+0000 7f3a2495e700 1 -- 172.21.15.40:0/363694852 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a2012d810 con 0x7f3a2009d400 2023-09-30T22:25:28.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.880+0000 7f3a0effd700 1 -- 172.21.15.40:0/363694852 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3a10021070 con 0x7f3a2009d400 2023-09-30T22:25:28.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.881+0000 7f3a0effd700 1 -- 172.21.15.40:0/363694852 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3a10040bd0 con 0x7f3a2009d400 2023-09-30T22:25:28.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.881+0000 7f3a2495e700 1 -- 172.21.15.40:0/363694852 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a20062380 con 0x7f3a2009d400 2023-09-30T22:25:28.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.886+0000 7f3a0effd700 1 -- 172.21.15.40:0/363694852 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3a10029080 con 0x7f3a2009d400 2023-09-30T22:25:28.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.909+0000 7f73f2842700 1 -- 172.21.15.40:0/3907103622 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f73ec11e680 con 0x7f73ec09d450 2023-09-30T22:25:28.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.910+0000 7f73e8ff9700 1 -- 172.21.15.40:0/3907103622 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f73dc021030 con 0x7f73ec09d450 2023-09-30T22:25:28.910 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:28.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.912+0000 7f73f2842700 1 -- 172.21.15.40:0/3907103622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73ec09d450 msgr2=0x7f73ec1c3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:28.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.912+0000 7f73f2842700 1 --2- 172.21.15.40:0/3907103622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73ec09d450 0x7f73ec1c3eb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f73dc00ebe0 tx=0x7f73dc00eef0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.912+0000 7f73f2842700 1 -- 172.21.15.40:0/3907103622 shutdown_connections 2023-09-30T22:25:28.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.912+0000 7f73f2842700 1 --2- 172.21.15.40:0/3907103622 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73ec130700 0x7f73ec1c4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.912+0000 7f73f2842700 1 --2- 172.21.15.40:0/3907103622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73ec09d450 0x7f73ec1c3eb0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.912+0000 7f73f2842700 1 --2- 172.21.15.40:0/3907103622 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73ec09dd60 0x7f73ec1c43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.912+0000 7f73f2842700 1 -- 172.21.15.40:0/3907103622 >> 172.21.15.40:0/3907103622 conn(0x7f73ec0a2a00 msgr2=0x7f73ec06e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:28.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.912+0000 7f73f2842700 1 -- 172.21.15.40:0/3907103622 shutdown_connections 2023-09-30T22:25:28.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.912+0000 7f73f2842700 1 -- 172.21.15.40:0/3907103622 wait complete. 2023-09-30T22:25:28.927 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:28.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.956+0000 7f3da9ca9700 1 Processor -- start 2023-09-30T22:25:28.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.956+0000 7f3da9ca9700 1 -- start start 2023-09-30T22:25:28.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.956+0000 7f3da9ca9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3da406f3a0 0x7f3da406c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.957+0000 7f3da9ca9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3da409fbb0 0x7f3da406ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.957+0000 7f3da9ca9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3da406d410 0x7f3da413a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.957+0000 7f3da9ca9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da409ff80 con 0x7f3da406f3a0 2023-09-30T22:25:28.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.957+0000 7f3da9ca9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da40a0590 con 0x7f3da406d410 2023-09-30T22:25:28.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.957+0000 7f3da9ca9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3da406bac0 con 0x7f3da409fbb0 2023-09-30T22:25:28.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.957+0000 7f3da37fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3da406f3a0 0x7f3da406c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.957+0000 7f3da37fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3da406f3a0 0x7f3da406c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44750/0 (socket says 172.21.15.40:44750) 2023-09-30T22:25:28.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.957+0000 7f3da37fe700 1 -- 172.21.15.40:0/217595233 learned_addr learned my addr 172.21.15.40:0/217595233 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:28.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.957+0000 7f3da2ffd700 1 --2- 172.21.15.40:0/217595233 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3da409fbb0 0x7f3da406ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.957+0000 7f3da3fff700 1 --2- 172.21.15.40:0/217595233 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3da406d410 0x7f3da413a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.957+0000 7f3da37fe700 1 -- 172.21.15.40:0/217595233 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3da409fbb0 msgr2=0x7f3da406ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:28.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.957+0000 7f3da37fe700 1 --2- 172.21.15.40:0/217595233 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3da409fbb0 0x7f3da406ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.957+0000 7f3da37fe700 1 -- 172.21.15.40:0/217595233 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3da406d410 msgr2=0x7f3da413a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:28.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.957+0000 7f3da37fe700 1 --2- 172.21.15.40:0/217595233 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3da406d410 0x7f3da413a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.957+0000 7f3da37fe700 1 -- 172.21.15.40:0/217595233 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da40a0780 con 0x7f3da406f3a0 2023-09-30T22:25:28.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.957+0000 7f3da2ffd700 1 --2- 172.21.15.40:0/217595233 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3da409fbb0 0x7f3da406ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:28.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.957+0000 7f3da37fe700 1 --2- 172.21.15.40:0/217595233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3da406f3a0 0x7f3da406c990 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3d94009920 tx=0x7f3d94009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e8723913a447fff server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:28.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.957+0000 7f3da27fc700 1 -- 172.21.15.40:0/217595233 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d94011830 con 0x7f3da406f3a0 2023-09-30T22:25:28.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.957+0000 7f3da27fc700 1 -- 172.21.15.40:0/217595233 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d94011990 con 0x7f3da406f3a0 2023-09-30T22:25:28.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.958+0000 7f3da27fc700 1 -- 172.21.15.40:0/217595233 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d94011d20 con 0x7f3da406f3a0 2023-09-30T22:25:28.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.958+0000 7f3da9ca9700 1 -- 172.21.15.40:0/217595233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3da406f3a0 msgr2=0x7f3da406c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:28.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.958+0000 7f3da9ca9700 1 --2- 172.21.15.40:0/217595233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3da406f3a0 0x7f3da406c990 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3d94009920 tx=0x7f3d94009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:28.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.958+0000 7f3da9ca9700 1 -- 172.21.15.40:0/217595233 shutdown_connections 2023-09-30T22:25:28.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.958+0000 7f3da9ca9700 1 --2- 172.21.15.40:0/217595233 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3da406d410 0x7f3da413a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.958+0000 7f3da9ca9700 1 --2- 172.21.15.40:0/217595233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3da406f3a0 0x7f3da406c990 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.958+0000 7f3da9ca9700 1 --2- 172.21.15.40:0/217595233 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3da409fbb0 0x7f3da406ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.958+0000 7f3da9ca9700 1 -- 172.21.15.40:0/217595233 >> 172.21.15.40:0/217595233 conn(0x7f3da40a41a0 msgr2=0x7f3da40a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:28.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.958+0000 7f3da9ca9700 1 -- 172.21.15.40:0/217595233 shutdown_connections 2023-09-30T22:25:28.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.959+0000 7f3da9ca9700 1 -- 172.21.15.40:0/217595233 wait complete. 2023-09-30T22:25:28.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.959+0000 7f3da9ca9700 1 Processor -- start 2023-09-30T22:25:28.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.960+0000 7f3da9ca9700 1 -- start start 2023-09-30T22:25:28.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.960+0000 7f3da9ca9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3da406d410 0x7f3da4090430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.960+0000 7f3da9ca9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3da406f3a0 0x7f3da4090970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.960+0000 7f3da9ca9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3da409fbb0 0x7f3da4090eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.960+0000 7f3da9ca9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da4071eb0 con 0x7f3da406d410 2023-09-30T22:25:28.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.960+0000 7f3da9ca9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da409ade0 con 0x7f3da409fbb0 2023-09-30T22:25:28.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.960+0000 7f3da9ca9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3da40928e0 con 0x7f3da406f3a0 2023-09-30T22:25:28.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.960+0000 7f3da2ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3da406f3a0 0x7f3da4090970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.960+0000 7f3da37fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3da406d410 0x7f3da4090430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.960+0000 7f3da2ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3da406f3a0 0x7f3da4090970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48244/0 (socket says 172.21.15.40:48244) 2023-09-30T22:25:28.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.960+0000 7f3da2ffd700 1 -- 172.21.15.40:0/4215218044 learned_addr learned my addr 172.21.15.40:0/4215218044 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:28.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.960+0000 7f3da3fff700 1 --2- 172.21.15.40:0/4215218044 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3da409fbb0 0x7f3da4090eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.961+0000 7f3da3fff700 1 -- 172.21.15.40:0/4215218044 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3da406f3a0 msgr2=0x7f3da4090970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:28.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.961+0000 7f3da3fff700 1 --2- 172.21.15.40:0/4215218044 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3da406f3a0 0x7f3da4090970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.961+0000 7f3da3fff700 1 -- 172.21.15.40:0/4215218044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3da406d410 msgr2=0x7f3da4090430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:28.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.961+0000 7f3da3fff700 1 --2- 172.21.15.40:0/4215218044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3da406d410 0x7f3da4090430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.961+0000 7f3da3fff700 1 -- 172.21.15.40:0/4215218044 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d980094a0 con 0x7f3da409fbb0 2023-09-30T22:25:28.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.961+0000 7f3da2ffd700 1 --2- 172.21.15.40:0/4215218044 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3da406f3a0 0x7f3da4090970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:28.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.961+0000 7f3da3fff700 1 --2- 172.21.15.40:0/4215218044 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3da409fbb0 0x7f3da4090eb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c00eba0 tx=0x7f3d9c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:28.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.961+0000 7f3d8bfff700 1 -- 172.21.15.40:0/4215218044 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c009a80 con 0x7f3da409fbb0 2023-09-30T22:25:28.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.961+0000 7f3d8bfff700 1 -- 172.21.15.40:0/4215218044 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9c00f040 con 0x7f3da409fbb0 2023-09-30T22:25:28.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.961+0000 7f3da9ca9700 1 -- 172.21.15.40:0/4215218044 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d94009550 con 0x7f3da409fbb0 2023-09-30T22:25:28.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.961+0000 7f3d8bfff700 1 -- 172.21.15.40:0/4215218044 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c00cc40 con 0x7f3da409fbb0 2023-09-30T22:25:28.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.961+0000 7f3da9ca9700 1 -- 172.21.15.40:0/4215218044 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da406df90 con 0x7f3da409fbb0 2023-09-30T22:25:28.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.962+0000 7f3d8bfff700 1 -- 172.21.15.40:0/4215218044 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3d9c014480 con 0x7f3da409fbb0 2023-09-30T22:25:28.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.962+0000 7f3d8bfff700 1 -- 172.21.15.40:0/4215218044 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3d9c040010 con 0x7f3da409fbb0 2023-09-30T22:25:28.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.962+0000 7f3da9ca9700 1 -- 172.21.15.40:0/4215218044 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da4092ed0 con 0x7f3da409fbb0 2023-09-30T22:25:28.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:28.971+0000 7f3d8bfff700 1 -- 172.21.15.40:0/4215218044 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3d9c007720 con 0x7f3da409fbb0 2023-09-30T22:25:29.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.001+0000 7f4ca79f6700 1 Processor -- start 2023-09-30T22:25:29.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.002+0000 7f4ca79f6700 1 -- start start 2023-09-30T22:25:29.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.002+0000 7f4ca79f6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ca006a6d0 0x7f4ca006aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:29.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.002+0000 7f4ca79f6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ca0131fc0 0x7f4ca0139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:29.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.002+0000 7f4ca79f6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ca009eb50 con 0x7f4ca006afe0 2023-09-30T22:25:29.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.002+0000 7f4ca79f6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca009dde0 con 0x7f4ca006a6d0 2023-09-30T22:25:29.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.002+0000 7f4ca79f6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca009d4a0 con 0x7f4ca0131fc0 2023-09-30T22:25:29.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.002+0000 7f4ca5792700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ca006a6d0 0x7f4ca006aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:29.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.002+0000 7f4ca4f91700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f4ca006afe0 0x7f4ca01318b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:35114/0 (socket says 172.21.15.40:35114) 2023-09-30T22:25:29.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.002+0000 7f4ca5792700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ca006a6d0 0x7f4ca006aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39270/0 (socket says 172.21.15.40:39270) 2023-09-30T22:25:29.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.002+0000 7f4ca4f91700 1 -- 172.21.15.40:0/3229845184 learned_addr learned my addr 172.21.15.40:0/3229845184 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:29.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.002+0000 7f4ca5f93700 1 --2- 172.21.15.40:0/3229845184 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ca0131fc0 0x7f4ca0139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:29.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.003+0000 7f4c97fff700 1 -- 172.21.15.40:0/3229845184 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3792211696 0 0) 0x7f4ca009eb50 con 0x7f4ca006afe0 2023-09-30T22:25:29.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.003+0000 7f4c97fff700 1 -- 172.21.15.40:0/3229845184 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c8c0035b0 con 0x7f4ca006afe0 2023-09-30T22:25:29.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.003+0000 7f4ca5f93700 1 -- 172.21.15.40:0/3229845184 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ca006a6d0 msgr2=0x7f4ca006aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:29.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.003+0000 7f4ca5f93700 1 --2- 172.21.15.40:0/3229845184 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ca006a6d0 0x7f4ca006aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.003+0000 7f4ca5f93700 1 -- 172.21.15.40:0/3229845184 >> v1:172.21.15.40:6789/0 conn(0x7f4ca006afe0 legacy=0x7f4ca01318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:29.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.003+0000 7f4ca5f93700 1 -- 172.21.15.40:0/3229845184 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca009f5f0 con 0x7f4ca0131fc0 2023-09-30T22:25:29.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.003+0000 7f4ca5792700 1 --2- 172.21.15.40:0/3229845184 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ca006a6d0 0x7f4ca006aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:29.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.003+0000 7f4ca5f93700 1 --2- 172.21.15.40:0/3229845184 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ca0131fc0 0x7f4ca0139b10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4c98009dc0 tx=0x7f4c9800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b83ffac87fd5e1a4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:29.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.003+0000 7f4c97fff700 1 -- 172.21.15.40:0/3229845184 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9800e070 con 0x7f4ca0131fc0 2023-09-30T22:25:29.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.003+0000 7f4c97fff700 1 -- 172.21.15.40:0/3229845184 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9800bb20 con 0x7f4ca0131fc0 2023-09-30T22:25:29.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.003+0000 7f4c97fff700 1 -- 172.21.15.40:0/3229845184 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c98012430 con 0x7f4ca0131fc0 2023-09-30T22:25:29.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.004+0000 7f4ca79f6700 1 -- 172.21.15.40:0/3229845184 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ca0131fc0 msgr2=0x7f4ca0139b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:29.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.004+0000 7f4ca79f6700 1 --2- 172.21.15.40:0/3229845184 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ca0131fc0 0x7f4ca0139b10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4c98009dc0 tx=0x7f4c9800b330 comp rx=0 tx=0).stop 2023-09-30T22:25:29.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.004+0000 7f4ca79f6700 1 -- 172.21.15.40:0/3229845184 shutdown_connections 2023-09-30T22:25:29.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.004+0000 7f4ca79f6700 1 --2- 172.21.15.40:0/3229845184 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ca0131fc0 0x7f4ca0139b10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.004+0000 7f4ca79f6700 1 --2- 172.21.15.40:0/3229845184 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ca006a6d0 0x7f4ca006aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.004+0000 7f4ca79f6700 1 -- 172.21.15.40:0/3229845184 >> 172.21.15.40:0/3229845184 conn(0x7f4ca009fb20 msgr2=0x7f4ca009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:29.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.004+0000 7f4ca79f6700 1 -- 172.21.15.40:0/3229845184 shutdown_connections 2023-09-30T22:25:29.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.004+0000 7f4ca79f6700 1 -- 172.21.15.40:0/3229845184 wait complete. 2023-09-30T22:25:29.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.005+0000 7f4ca79f6700 1 Processor -- start 2023-09-30T22:25:29.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.005+0000 7f4ca79f6700 1 -- start start 2023-09-30T22:25:29.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.005+0000 7f4ca79f6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ca006a6d0 0x7f4ca009a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:29.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.005+0000 7f4ca79f6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ca006afe0 0x7f4ca009aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:29.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.005+0000 7f4ca79f6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ca0131fc0 0x7f4ca009afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:29.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.005+0000 7f4ca79f6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca009c160 con 0x7f4ca006afe0 2023-09-30T22:25:29.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.005+0000 7f4ca79f6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca0125b80 con 0x7f4ca006a6d0 2023-09-30T22:25:29.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.005+0000 7f4ca79f6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca0124a70 con 0x7f4ca0131fc0 2023-09-30T22:25:29.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.005+0000 7f4ca4f91700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ca006afe0 0x7f4ca009aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:29.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.005+0000 7f4ca5792700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ca006a6d0 0x7f4ca009a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:29.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.005+0000 7f4ca4f91700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ca006afe0 0x7f4ca009aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44766/0 (socket says 172.21.15.40:44766) 2023-09-30T22:25:29.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.005+0000 7f4ca5792700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ca006a6d0 0x7f4ca009a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39280/0 (socket says 172.21.15.40:39280) 2023-09-30T22:25:29.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.006+0000 7f4ca4f91700 1 -- 172.21.15.40:0/3058883406 learned_addr learned my addr 172.21.15.40:0/3058883406 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:29.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.006+0000 7f4ca5f93700 1 --2- 172.21.15.40:0/3058883406 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ca0131fc0 0x7f4ca009afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:29.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.006+0000 7f4ca5f93700 1 -- 172.21.15.40:0/3058883406 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ca006a6d0 msgr2=0x7f4ca009a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:29.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.006+0000 7f4ca5f93700 1 --2- 172.21.15.40:0/3058883406 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ca006a6d0 0x7f4ca009a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.006+0000 7f4ca5f93700 1 -- 172.21.15.40:0/3058883406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ca006afe0 msgr2=0x7f4ca009aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:29.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.006+0000 7f4ca5f93700 1 --2- 172.21.15.40:0/3058883406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ca006afe0 0x7f4ca009aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.006+0000 7f4ca5f93700 1 -- 172.21.15.40:0/3058883406 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c9c009430 con 0x7f4ca0131fc0 2023-09-30T22:25:29.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.006+0000 7f4ca4f91700 1 --2- 172.21.15.40:0/3058883406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ca006afe0 0x7f4ca009aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:29.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.006+0000 7f4ca5f93700 1 --2- 172.21.15.40:0/3058883406 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ca0131fc0 0x7f4ca009afd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4c98016000 tx=0x7f4c98004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:29.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.006+0000 7f4c95ffb700 1 -- 172.21.15.40:0/3058883406 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c98004800 con 0x7f4ca0131fc0 2023-09-30T22:25:29.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.006+0000 7f4c95ffb700 1 -- 172.21.15.40:0/3058883406 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c98020070 con 0x7f4ca0131fc0 2023-09-30T22:25:29.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.006+0000 7f4ca79f6700 1 -- 172.21.15.40:0/3058883406 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c98009a70 con 0x7f4ca0131fc0 2023-09-30T22:25:29.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.006+0000 7f4c95ffb700 1 -- 172.21.15.40:0/3058883406 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c980276c0 con 0x7f4ca0131fc0 2023-09-30T22:25:29.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.007+0000 7f4ca79f6700 1 -- 172.21.15.40:0/3058883406 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca00a3d00 con 0x7f4ca0131fc0 2023-09-30T22:25:29.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.007+0000 7f4ca79f6700 1 -- 172.21.15.40:0/3058883406 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ca00715c0 con 0x7f4ca0131fc0 2023-09-30T22:25:29.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.008+0000 7f4c95ffb700 1 -- 172.21.15.40:0/3058883406 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4c98012430 con 0x7f4ca0131fc0 2023-09-30T22:25:29.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.008+0000 7f4c95ffb700 1 -- 172.21.15.40:0/3058883406 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4c98022070 con 0x7f4ca0131fc0 2023-09-30T22:25:29.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.017+0000 7f4c95ffb700 1 -- 172.21.15.40:0/3058883406 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4c98012e40 con 0x7f4ca0131fc0 2023-09-30T22:25:29.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.097+0000 7f3a2495e700 1 -- 172.21.15.40:0/363694852 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3a20074330 con 0x7f3a2009d400 2023-09-30T22:25:29.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.097+0000 7f3a0effd700 1 -- 172.21.15.40:0/363694852 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3a10015020 con 0x7f3a2009d400 2023-09-30T22:25:29.098 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:29.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.099+0000 7f3a2495e700 1 -- 172.21.15.40:0/363694852 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a2009d400 msgr2=0x7f3a2011cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:29.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.099+0000 7f3a2495e700 1 --2- 172.21.15.40:0/363694852 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a2009d400 0x7f3a2011cdc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3a10000c00 tx=0x7f3a10004750 comp rx=0 tx=0).stop 2023-09-30T22:25:29.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.099+0000 7f3a2495e700 1 -- 172.21.15.40:0/363694852 shutdown_connections 2023-09-30T22:25:29.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.099+0000 7f3a2495e700 1 --2- 172.21.15.40:0/363694852 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a20133e00 0x7f3a2011d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.099+0000 7f3a2495e700 1 --2- 172.21.15.40:0/363694852 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a2009d400 0x7f3a2011cdc0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.099+0000 7f3a2495e700 1 --2- 172.21.15.40:0/363694852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a2009dd70 0x7f3a2011d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.099+0000 7f3a2495e700 1 -- 172.21.15.40:0/363694852 >> 172.21.15.40:0/363694852 conn(0x7f3a200a2a00 msgr2=0x7f3a201303c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:29.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.099+0000 7f3a2495e700 1 -- 172.21.15.40:0/363694852 shutdown_connections 2023-09-30T22:25:29.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.099+0000 7f3a2495e700 1 -- 172.21.15.40:0/363694852 wait complete. 2023-09-30T22:25:29.117 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:29.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.175+0000 7f3da9ca9700 1 -- 172.21.15.40:0/4215218044 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3da4062380 con 0x7f3da409fbb0 2023-09-30T22:25:29.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.176+0000 7f3d8bfff700 1 -- 172.21.15.40:0/4215218044 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3d9c02c090 con 0x7f3da409fbb0 2023-09-30T22:25:29.177 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:29.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.178+0000 7f3da9ca9700 1 -- 172.21.15.40:0/4215218044 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3da409fbb0 msgr2=0x7f3da4090eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:29.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.178+0000 7f3da9ca9700 1 --2- 172.21.15.40:0/4215218044 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3da409fbb0 0x7f3da4090eb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c00eba0 tx=0x7f3d9c00eeb0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.178+0000 7f3da9ca9700 1 -- 172.21.15.40:0/4215218044 shutdown_connections 2023-09-30T22:25:29.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.178+0000 7f3da9ca9700 1 --2- 172.21.15.40:0/4215218044 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3da409fbb0 0x7f3da4090eb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.178+0000 7f3da9ca9700 1 --2- 172.21.15.40:0/4215218044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3da406d410 0x7f3da4090430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.178+0000 7f3da9ca9700 1 --2- 172.21.15.40:0/4215218044 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3da406f3a0 0x7f3da4090970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.178+0000 7f3da9ca9700 1 -- 172.21.15.40:0/4215218044 >> 172.21.15.40:0/4215218044 conn(0x7f3da40a41a0 msgr2=0x7f3da406f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:29.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.178+0000 7f3da9ca9700 1 -- 172.21.15.40:0/4215218044 shutdown_connections 2023-09-30T22:25:29.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.178+0000 7f3da9ca9700 1 -- 172.21.15.40:0/4215218044 wait complete. 2023-09-30T22:25:29.191 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:29.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.212+0000 7f4ca79f6700 1 -- 172.21.15.40:0/3058883406 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4ca0062380 con 0x7f4ca0131fc0 2023-09-30T22:25:29.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.213+0000 7f4c95ffb700 1 -- 172.21.15.40:0/3058883406 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4c98035090 con 0x7f4ca0131fc0 2023-09-30T22:25:29.214 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:29.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.215+0000 7f4ca79f6700 1 -- 172.21.15.40:0/3058883406 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ca0131fc0 msgr2=0x7f4ca009afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:29.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.215+0000 7f4ca79f6700 1 --2- 172.21.15.40:0/3058883406 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ca0131fc0 0x7f4ca009afd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4c98016000 tx=0x7f4c98004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.215+0000 7f4ca79f6700 1 -- 172.21.15.40:0/3058883406 shutdown_connections 2023-09-30T22:25:29.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.215+0000 7f4ca79f6700 1 --2- 172.21.15.40:0/3058883406 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ca0131fc0 0x7f4ca009afd0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.215+0000 7f4ca79f6700 1 --2- 172.21.15.40:0/3058883406 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ca006a6d0 0x7f4ca009a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.215+0000 7f4ca79f6700 1 --2- 172.21.15.40:0/3058883406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ca006afe0 0x7f4ca009aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.215+0000 7f4ca79f6700 1 -- 172.21.15.40:0/3058883406 >> 172.21.15.40:0/3058883406 conn(0x7f4ca009fb20 msgr2=0x7f4ca006f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:29.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.215+0000 7f4ca79f6700 1 -- 172.21.15.40:0/3058883406 shutdown_connections 2023-09-30T22:25:29.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:29.215+0000 7f4ca79f6700 1 -- 172.21.15.40:0/3058883406 wait complete. 2023-09-30T22:25:29.227 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:29.927 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:30.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.067+0000 7f7dd89b2700 1 Processor -- start 2023-09-30T22:25:30.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.067+0000 7f7dd89b2700 1 -- start start 2023-09-30T22:25:30.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.068+0000 7f7dd89b2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dd412e590 0x7f7dd412e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.068+0000 7f7dd89b2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7dd412eea0 0x7f7dd412d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.068+0000 7f7dd89b2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7dd412d6d0 0x7f7dd412db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.068+0000 7f7dd89b2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd409ca30 con 0x7f7dd412d6d0 2023-09-30T22:25:30.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.068+0000 7f7dd89b2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd409ab70 con 0x7f7dd412e590 2023-09-30T22:25:30.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.068+0000 7f7dd89b2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd409bd70 con 0x7f7dd412eea0 2023-09-30T22:25:30.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.068+0000 7f7dd259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dd412e590 0x7f7dd412e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.068+0000 7f7dc9d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7dd412eea0 0x7f7dd412d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.068+0000 7f7dd259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dd412e590 0x7f7dd412e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39290/0 (socket says 172.21.15.40:39290) 2023-09-30T22:25:30.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.068+0000 7f7dc9d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7dd412eea0 0x7f7dd412d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48274/0 (socket says 172.21.15.40:48274) 2023-09-30T22:25:30.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.068+0000 7f7dd259c700 1 -- 172.21.15.40:0/2803171457 learned_addr learned my addr 172.21.15.40:0/2803171457 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:30.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.068+0000 7f7dd2d9d700 1 --2- 172.21.15.40:0/2803171457 >> v2:172.21.15.40:3300/0 conn(0x7f7dd412d6d0 0x7f7dd412db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.069+0000 7f7dd259c700 1 -- 172.21.15.40:0/2803171457 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7dd412eea0 msgr2=0x7f7dd412d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:30.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.069+0000 7f7dd259c700 1 --2- 172.21.15.40:0/2803171457 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7dd412eea0 0x7f7dd412d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.069+0000 7f7dd259c700 1 -- 172.21.15.40:0/2803171457 >> v2:172.21.15.40:3300/0 conn(0x7f7dd412d6d0 msgr2=0x7f7dd412db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:30.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.069+0000 7f7dd259c700 1 --2- 172.21.15.40:0/2803171457 >> v2:172.21.15.40:3300/0 conn(0x7f7dd412d6d0 0x7f7dd412db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.069+0000 7f7dd259c700 1 -- 172.21.15.40:0/2803171457 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd409b270 con 0x7f7dd412e590 2023-09-30T22:25:30.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.069+0000 7f7dc9d9b700 1 --2- 172.21.15.40:0/2803171457 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7dd412eea0 0x7f7dd412d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:30.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.069+0000 7f7dd2d9d700 1 --2- 172.21.15.40:0/2803171457 >> v2:172.21.15.40:3300/0 conn(0x7f7dd412d6d0 0x7f7dd412db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:30.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.069+0000 7f7dd259c700 1 --2- 172.21.15.40:0/2803171457 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dd412e590 0x7f7dd412e960 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7dc40098f0 tx=0x7f7dc4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9654fbc8716ac734 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:30.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.069+0000 7f7dd1d9b700 1 -- 172.21.15.40:0/2803171457 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc4011830 con 0x7f7dd412e590 2023-09-30T22:25:30.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.069+0000 7f7dd1d9b700 1 -- 172.21.15.40:0/2803171457 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc4011990 con 0x7f7dd412e590 2023-09-30T22:25:30.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.069+0000 7f7dd1d9b700 1 -- 172.21.15.40:0/2803171457 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc4011d20 con 0x7f7dd412e590 2023-09-30T22:25:30.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.069+0000 7f7dd89b2700 1 -- 172.21.15.40:0/2803171457 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dd412e590 msgr2=0x7f7dd412e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.069+0000 7f7dd89b2700 1 --2- 172.21.15.40:0/2803171457 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dd412e590 0x7f7dd412e960 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7dc40098f0 tx=0x7f7dc4009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:30.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.069+0000 7f7dd89b2700 1 -- 172.21.15.40:0/2803171457 shutdown_connections 2023-09-30T22:25:30.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.069+0000 7f7dd89b2700 1 --2- 172.21.15.40:0/2803171457 >> v2:172.21.15.40:3300/0 conn(0x7f7dd412d6d0 0x7f7dd412db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.070+0000 7f7dd89b2700 1 --2- 172.21.15.40:0/2803171457 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dd412e590 0x7f7dd412e960 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.070+0000 7f7dd89b2700 1 --2- 172.21.15.40:0/2803171457 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7dd412eea0 0x7f7dd412d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.070+0000 7f7dd89b2700 1 -- 172.21.15.40:0/2803171457 >> 172.21.15.40:0/2803171457 conn(0x7f7dd40a2a00 msgr2=0x7f7dd40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:30.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.070+0000 7f7dd89b2700 1 -- 172.21.15.40:0/2803171457 shutdown_connections 2023-09-30T22:25:30.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.070+0000 7f7dd89b2700 1 -- 172.21.15.40:0/2803171457 wait complete. 2023-09-30T22:25:30.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.071+0000 7f7dd89b2700 1 Processor -- start 2023-09-30T22:25:30.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.071+0000 7f7dd89b2700 1 -- start start 2023-09-30T22:25:30.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.071+0000 7f7dd89b2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dd412d6d0 0x7f7dd4119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.071+0000 7f7dd89b2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7dd412e590 0x7f7dd4119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.071+0000 7f7dd89b2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7dd412eea0 0x7f7dd4119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.071+0000 7f7dd89b2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd411b5a0 con 0x7f7dd412eea0 2023-09-30T22:25:30.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.071+0000 7f7dd89b2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd411c520 con 0x7f7dd412d6d0 2023-09-30T22:25:30.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.071+0000 7f7dd89b2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd40a0840 con 0x7f7dd412e590 2023-09-30T22:25:30.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.072+0000 7f7dd259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dd412d6d0 0x7f7dd4119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.072+0000 7f7dd2d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7dd412eea0 0x7f7dd4119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.072+0000 7f7dd259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dd412d6d0 0x7f7dd4119050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39302/0 (socket says 172.21.15.40:39302) 2023-09-30T22:25:30.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.072+0000 7f7dd259c700 1 -- 172.21.15.40:0/3466595899 learned_addr learned my addr 172.21.15.40:0/3466595899 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:30.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.072+0000 7f7dc9d9b700 1 --2- 172.21.15.40:0/3466595899 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7dd412e590 0x7f7dd4119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.072+0000 7f7dd259c700 1 -- 172.21.15.40:0/3466595899 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7dd412e590 msgr2=0x7f7dd4119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.072+0000 7f7dd259c700 1 --2- 172.21.15.40:0/3466595899 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7dd412e590 0x7f7dd4119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.072+0000 7f7dd259c700 1 -- 172.21.15.40:0/3466595899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7dd412eea0 msgr2=0x7f7dd4119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.072+0000 7f7dd259c700 1 --2- 172.21.15.40:0/3466595899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7dd412eea0 0x7f7dd4119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.072+0000 7f7dd259c700 1 -- 172.21.15.40:0/3466595899 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dcc0099e0 con 0x7f7dd412d6d0 2023-09-30T22:25:30.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.072+0000 7f7dd259c700 1 --2- 172.21.15.40:0/3466595899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dd412d6d0 0x7f7dd4119050 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4009c40 tx=0x7f7dc4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:30.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.072+0000 7f7dcb7fe700 1 -- 172.21.15.40:0/3466595899 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc4004240 con 0x7f7dd412d6d0 2023-09-30T22:25:30.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.072+0000 7f7dcb7fe700 1 -- 172.21.15.40:0/3466595899 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc401f070 con 0x7f7dd412d6d0 2023-09-30T22:25:30.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.072+0000 7f7dd89b2700 1 -- 172.21.15.40:0/3466595899 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dbc0094a0 con 0x7f7dd412d6d0 2023-09-30T22:25:30.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.072+0000 7f7dcb7fe700 1 -- 172.21.15.40:0/3466595899 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc40045e0 con 0x7f7dd412d6d0 2023-09-30T22:25:30.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.072+0000 7f7dd89b2700 1 -- 172.21.15.40:0/3466595899 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc4009550 con 0x7f7dd412d6d0 2023-09-30T22:25:30.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.073+0000 7f7dcb7fe700 1 -- 172.21.15.40:0/3466595899 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7dc4021030 con 0x7f7dd412d6d0 2023-09-30T22:25:30.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.073+0000 7f7dcb7fe700 1 -- 172.21.15.40:0/3466595899 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f7dc40408d0 con 0x7f7dd412d6d0 2023-09-30T22:25:30.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.073+0000 7f7dd89b2700 1 -- 172.21.15.40:0/3466595899 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd4062380 con 0x7f7dd412d6d0 2023-09-30T22:25:30.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.078+0000 7f7dcb7fe700 1 -- 172.21.15.40:0/3466595899 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7dc4015070 con 0x7f7dd412d6d0 2023-09-30T22:25:30.118 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:30.192 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:30.229 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:30.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.252+0000 7fb4a5587700 1 Processor -- start 2023-09-30T22:25:30.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.252+0000 7fb4a5587700 1 -- start start 2023-09-30T22:25:30.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.253+0000 7fb4a5587700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4a0133e00 0x7fb4a01341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.253+0000 7fb4a5587700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4a009d400 0x7fb4a009d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.253+0000 7fb4a5587700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4a0133940 con 0x7fb4a009dd70 2023-09-30T22:25:30.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.253+0000 7fb4a5587700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a009ab20 con 0x7fb4a0133e00 2023-09-30T22:25:30.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.253+0000 7fb4a5587700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a009f0d0 con 0x7fb4a009d400 2023-09-30T22:25:30.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.253+0000 7fb49e7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4a009d400 0x7fb4a009d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.253+0000 7fb49effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4a0133e00 0x7fb4a01341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.253+0000 7fb49effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4a0133e00 0x7fb4a01341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39316/0 (socket says 172.21.15.40:39316) 2023-09-30T22:25:30.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.253+0000 7fb49e7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4a009d400 0x7fb4a009d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48290/0 (socket says 172.21.15.40:48290) 2023-09-30T22:25:30.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.253+0000 7fb49effd700 1 -- 172.21.15.40:0/1250287500 learned_addr learned my addr 172.21.15.40:0/1250287500 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:30.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.253+0000 7fb49effd700 1 -- 172.21.15.40:0/1250287500 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4a009d400 msgr2=0x7fb4a009d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:30.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.253+0000 7fb49effd700 1 --2- 172.21.15.40:0/1250287500 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4a009d400 0x7fb4a009d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.253+0000 7fb49effd700 1 -- 172.21.15.40:0/1250287500 >> v1:172.21.15.40:6789/0 conn(0x7fb4a009dd70 legacy=0x7fb4a013ac70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:25:30.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.253+0000 7fb49effd700 1 -- 172.21.15.40:0/1250287500 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a009e210 con 0x7fb4a0133e00 2023-09-30T22:25:30.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.253+0000 7fb49e7fc700 1 --2- 172.21.15.40:0/1250287500 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4a009d400 0x7fb4a009d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:30.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.254+0000 7fb49effd700 1 --2- 172.21.15.40:0/1250287500 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4a0133e00 0x7fb4a01341d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb490009920 tx=0x7fb490009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99f1f27fcf0a0274 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:30.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.254+0000 7fb49dffb700 1 -- 172.21.15.40:0/1250287500 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb490004230 con 0x7fb4a0133e00 2023-09-30T22:25:30.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.254+0000 7fb49dffb700 1 -- 172.21.15.40:0/1250287500 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb490004390 con 0x7fb4a0133e00 2023-09-30T22:25:30.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.254+0000 7fb49dffb700 1 -- 172.21.15.40:0/1250287500 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4900036a0 con 0x7fb4a0133e00 2023-09-30T22:25:30.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.254+0000 7fb4a5587700 1 -- 172.21.15.40:0/1250287500 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4a0133e00 msgr2=0x7fb4a01341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.254+0000 7fb4a5587700 1 --2- 172.21.15.40:0/1250287500 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4a0133e00 0x7fb4a01341d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb490009920 tx=0x7fb490009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:30.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.255+0000 7fb4a5587700 1 -- 172.21.15.40:0/1250287500 shutdown_connections 2023-09-30T22:25:30.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.255+0000 7fb4a5587700 1 --2- 172.21.15.40:0/1250287500 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4a0133e00 0x7fb4a01341d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.255+0000 7fb4a5587700 1 --2- 172.21.15.40:0/1250287500 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4a009d400 0x7fb4a009d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.255+0000 7fb4a5587700 1 -- 172.21.15.40:0/1250287500 >> 172.21.15.40:0/1250287500 conn(0x7fb4a00a2a00 msgr2=0x7fb4a00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:30.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.255+0000 7fb4a5587700 1 -- 172.21.15.40:0/1250287500 shutdown_connections 2023-09-30T22:25:30.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.255+0000 7fb4a5587700 1 -- 172.21.15.40:0/1250287500 wait complete. 2023-09-30T22:25:30.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.256+0000 7fb4a5587700 1 Processor -- start 2023-09-30T22:25:30.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.256+0000 7fb4a5587700 1 -- start start 2023-09-30T22:25:30.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.256+0000 7fb4a5587700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4a009d400 0x7fb4a0119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.256+0000 7fb4a5587700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4a009dd70 0x7fb4a0119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.256+0000 7fb4a5587700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4a0133e00 0x7fb4a0119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.256+0000 7fb4a5587700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a011c170 con 0x7fb4a0133e00 2023-09-30T22:25:30.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.256+0000 7fb4a5587700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a011c350 con 0x7fb4a009d400 2023-09-30T22:25:30.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.256+0000 7fb4a5587700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a012e1a0 con 0x7fb4a009dd70 2023-09-30T22:25:30.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.256+0000 7fb49effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4a009d400 0x7fb4a0119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.256+0000 7fb49effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4a009d400 0x7fb4a0119050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39322/0 (socket says 172.21.15.40:39322) 2023-09-30T22:25:30.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.256+0000 7fb49effd700 1 -- 172.21.15.40:0/1637911474 learned_addr learned my addr 172.21.15.40:0/1637911474 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:30.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.256+0000 7fb49e7fc700 1 --2- 172.21.15.40:0/1637911474 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4a009dd70 0x7fb4a0119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.256+0000 7fb49f7fe700 1 --2- 172.21.15.40:0/1637911474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4a0133e00 0x7fb4a0119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.257+0000 7fb49effd700 1 -- 172.21.15.40:0/1637911474 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4a009dd70 msgr2=0x7fb4a0119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.257+0000 7fb49effd700 1 --2- 172.21.15.40:0/1637911474 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4a009dd70 0x7fb4a0119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.257+0000 7fb49effd700 1 -- 172.21.15.40:0/1637911474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4a0133e00 msgr2=0x7fb4a0119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.257+0000 7fb49effd700 1 --2- 172.21.15.40:0/1637911474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4a0133e00 0x7fb4a0119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.257+0000 7fb49effd700 1 -- 172.21.15.40:0/1637911474 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4940094a0 con 0x7fb4a009d400 2023-09-30T22:25:30.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.257+0000 7fb49f7fe700 1 --2- 172.21.15.40:0/1637911474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4a0133e00 0x7fb4a0119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:30.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.257+0000 7fb49effd700 1 --2- 172.21.15.40:0/1637911474 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4a009d400 0x7fb4a0119050 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb490000c00 tx=0x7fb490004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:30.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.257+0000 7fb4877fe700 1 -- 172.21.15.40:0/1637911474 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb490003db0 con 0x7fb4a009d400 2023-09-30T22:25:30.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.257+0000 7fb4877fe700 1 -- 172.21.15.40:0/1637911474 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb490011630 con 0x7fb4a009d400 2023-09-30T22:25:30.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.257+0000 7fb4877fe700 1 -- 172.21.15.40:0/1637911474 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4900119e0 con 0x7fb4a009d400 2023-09-30T22:25:30.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.257+0000 7fb4a5587700 1 -- 172.21.15.40:0/1637911474 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb490009550 con 0x7fb4a009d400 2023-09-30T22:25:30.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.257+0000 7fb4a5587700 1 -- 172.21.15.40:0/1637911474 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a011b1d0 con 0x7fb4a009d400 2023-09-30T22:25:30.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.258+0000 7fb4877fe700 1 -- 172.21.15.40:0/1637911474 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb490011b40 con 0x7fb4a009d400 2023-09-30T22:25:30.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.258+0000 7fb4877fe700 1 -- 172.21.15.40:0/1637911474 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb490040d10 con 0x7fb4a009d400 2023-09-30T22:25:30.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.259+0000 7fb4a5587700 1 -- 172.21.15.40:0/1637911474 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4a0062380 con 0x7fb4a009d400 2023-09-30T22:25:30.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.265+0000 7fb4877fe700 1 -- 172.21.15.40:0/1637911474 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb490028080 con 0x7fb4a009d400 2023-09-30T22:25:30.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.283+0000 7f7dd89b2700 1 -- 172.21.15.40:0/3466595899 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7dd4074330 con 0x7f7dd412d6d0 2023-09-30T22:25:30.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.283+0000 7f7dcb7fe700 1 -- 172.21.15.40:0/3466595899 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7dc401a450 con 0x7f7dd412d6d0 2023-09-30T22:25:30.284 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:30.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.287+0000 7f7dd89b2700 1 -- 172.21.15.40:0/3466595899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dd412d6d0 msgr2=0x7f7dd4119050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.287+0000 7f7dd89b2700 1 --2- 172.21.15.40:0/3466595899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dd412d6d0 0x7f7dd4119050 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4009c40 tx=0x7f7dc4004750 comp rx=0 tx=0).stop 2023-09-30T22:25:30.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.287+0000 7f7dd89b2700 1 -- 172.21.15.40:0/3466595899 shutdown_connections 2023-09-30T22:25:30.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.287+0000 7f7dd89b2700 1 --2- 172.21.15.40:0/3466595899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7dd412eea0 0x7f7dd4119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.287+0000 7f7dd89b2700 1 --2- 172.21.15.40:0/3466595899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dd412d6d0 0x7f7dd4119050 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.287+0000 7f7dd89b2700 1 --2- 172.21.15.40:0/3466595899 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7dd412e590 0x7f7dd4119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.287+0000 7f7dd89b2700 1 -- 172.21.15.40:0/3466595899 >> 172.21.15.40:0/3466595899 conn(0x7f7dd40a2a00 msgr2=0x7f7dd409d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:30.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.287+0000 7f7dd89b2700 1 -- 172.21.15.40:0/3466595899 shutdown_connections 2023-09-30T22:25:30.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.287+0000 7f7dd89b2700 1 -- 172.21.15.40:0/3466595899 wait complete. 2023-09-30T22:25:30.306 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:30.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.337+0000 7fd546d63700 1 Processor -- start 2023-09-30T22:25:30.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.337+0000 7fd546d63700 1 -- start start 2023-09-30T22:25:30.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.338+0000 7fd546d63700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd540136bf0 0x7fd540138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.338+0000 7fd546d63700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd540139510 0x7fd54013b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.338+0000 7fd546d63700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5400a2600 con 0x7fd54009c890 2023-09-30T22:25:30.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.338+0000 7fd546d63700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5400a29d0 con 0x7fd540139510 2023-09-30T22:25:30.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.338+0000 7fd546d63700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd54009fb40 con 0x7fd540136bf0 2023-09-30T22:25:30.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.338+0000 7fd544aff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd54009c890 0x7fd54009cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:35126/0 (socket says 172.21.15.40:35126) 2023-09-30T22:25:30.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.338+0000 7fd544aff700 1 -- 172.21.15.40:0/2382589943 learned_addr learned my addr 172.21.15.40:0/2382589943 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:30.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.338+0000 7fd53ffff700 1 --2- 172.21.15.40:0/2382589943 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd540136bf0 0x7fd540138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.338+0000 7fd545300700 1 --2- 172.21.15.40:0/2382589943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd540139510 0x7fd54013b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.339+0000 7fd53ffff700 1 -- 172.21.15.40:0/2382589943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd540139510 msgr2=0x7fd54013b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:30.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.339+0000 7fd53ffff700 1 --2- 172.21.15.40:0/2382589943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd540139510 0x7fd54013b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.339+0000 7fd53ffff700 1 -- 172.21.15.40:0/2382589943 >> v1:172.21.15.40:6789/0 conn(0x7fd54009c890 legacy=0x7fd54009cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.339+0000 7fd53f7fe700 1 -- 172.21.15.40:0/2382589943 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2609394146 0 0) 0x7fd5400a2600 con 0x7fd54009c890 2023-09-30T22:25:30.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.339+0000 7fd53ffff700 1 -- 172.21.15.40:0/2382589943 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54009d370 con 0x7fd540136bf0 2023-09-30T22:25:30.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.339+0000 7fd545300700 1 --2- 172.21.15.40:0/2382589943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd540139510 0x7fd54013b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:30.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.339+0000 7fd53ffff700 1 --2- 172.21.15.40:0/2382589943 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd540136bf0 0x7fd540138fd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd52c009870 tx=0x7fd52c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d7d3ee01d637b7c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:30.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.339+0000 7fd53f7fe700 1 -- 172.21.15.40:0/2382589943 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c011830 con 0x7fd540136bf0 2023-09-30T22:25:30.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.339+0000 7fd53f7fe700 1 -- 172.21.15.40:0/2382589943 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52c011990 con 0x7fd540136bf0 2023-09-30T22:25:30.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.339+0000 7fd53f7fe700 1 -- 172.21.15.40:0/2382589943 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c011d20 con 0x7fd540136bf0 2023-09-30T22:25:30.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.340+0000 7fd546d63700 1 -- 172.21.15.40:0/2382589943 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd540136bf0 msgr2=0x7fd540138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.340+0000 7fd546d63700 1 --2- 172.21.15.40:0/2382589943 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd540136bf0 0x7fd540138fd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd52c009870 tx=0x7fd52c009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:30.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.340+0000 7fd546d63700 1 -- 172.21.15.40:0/2382589943 shutdown_connections 2023-09-30T22:25:30.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.340+0000 7fd546d63700 1 --2- 172.21.15.40:0/2382589943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd540139510 0x7fd54013b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.340+0000 7fd546d63700 1 --2- 172.21.15.40:0/2382589943 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd540136bf0 0x7fd540138fd0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.340+0000 7fd546d63700 1 -- 172.21.15.40:0/2382589943 >> 172.21.15.40:0/2382589943 conn(0x7fd5400a7080 msgr2=0x7fd5400a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:30.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.340+0000 7fd546d63700 1 -- 172.21.15.40:0/2382589943 shutdown_connections 2023-09-30T22:25:30.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.340+0000 7fd546d63700 1 -- 172.21.15.40:0/2382589943 wait complete. 2023-09-30T22:25:30.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.341+0000 7fd546d63700 1 Processor -- start 2023-09-30T22:25:30.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.341+0000 7fd546d63700 1 -- start start 2023-09-30T22:25:30.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.342+0000 7fd546d63700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd54009c890 0x7fd54006ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.342+0000 7fd546d63700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd540136bf0 0x7fd54006f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.342+0000 7fd546d63700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd540139510 0x7fd54006f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.342+0000 7fd546d63700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd540070bf0 con 0x7fd540136bf0 2023-09-30T22:25:30.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.342+0000 7fd546d63700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54012b550 con 0x7fd54009c890 2023-09-30T22:25:30.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.342+0000 7fd546d63700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd540138fe0 con 0x7fd540139510 2023-09-30T22:25:30.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.342+0000 7fd53ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd540136bf0 0x7fd54006f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.342+0000 7fd544aff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd54009c890 0x7fd54006ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.342+0000 7fd53ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd540136bf0 0x7fd54006f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44806/0 (socket says 172.21.15.40:44806) 2023-09-30T22:25:30.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.342+0000 7fd53ffff700 1 -- 172.21.15.40:0/2063058222 learned_addr learned my addr 172.21.15.40:0/2063058222 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:30.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.342+0000 7fd545300700 1 --2- 172.21.15.40:0/2063058222 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd540139510 0x7fd54006f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.343+0000 7fd53ffff700 1 -- 172.21.15.40:0/2063058222 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd540139510 msgr2=0x7fd54006f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.343+0000 7fd53ffff700 1 --2- 172.21.15.40:0/2063058222 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd540139510 0x7fd54006f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.343+0000 7fd53ffff700 1 -- 172.21.15.40:0/2063058222 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd54009c890 msgr2=0x7fd54006ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.343+0000 7fd53ffff700 1 --2- 172.21.15.40:0/2063058222 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd54009c890 0x7fd54006ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.343+0000 7fd53ffff700 1 -- 172.21.15.40:0/2063058222 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd538009a70 con 0x7fd540136bf0 2023-09-30T22:25:30.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.343+0000 7fd544aff700 1 --2- 172.21.15.40:0/2063058222 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd54009c890 0x7fd54006ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:30.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.343+0000 7fd53ffff700 1 --2- 172.21.15.40:0/2063058222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd540136bf0 0x7fd54006f440 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd52c009840 tx=0x7fd52c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:30.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.343+0000 7fd53d7fa700 1 -- 172.21.15.40:0/2063058222 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c0045d0 con 0x7fd540136bf0 2023-09-30T22:25:30.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.343+0000 7fd53d7fa700 1 -- 172.21.15.40:0/2063058222 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52c01f070 con 0x7fd540136bf0 2023-09-30T22:25:30.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.343+0000 7fd546d63700 1 -- 172.21.15.40:0/2063058222 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd52c0094a0 con 0x7fd540136bf0 2023-09-30T22:25:30.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.343+0000 7fd53d7fa700 1 -- 172.21.15.40:0/2063058222 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c0038c0 con 0x7fd540136bf0 2023-09-30T22:25:30.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.343+0000 7fd546d63700 1 -- 172.21.15.40:0/2063058222 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd54012bd50 con 0x7fd540136bf0 2023-09-30T22:25:30.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.344+0000 7fd53d7fa700 1 -- 172.21.15.40:0/2063058222 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd52c003a20 con 0x7fd540136bf0 2023-09-30T22:25:30.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.344+0000 7fd53d7fa700 1 -- 172.21.15.40:0/2063058222 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd52c021070 con 0x7fd540136bf0 2023-09-30T22:25:30.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.344+0000 7fd546d63700 1 -- 172.21.15.40:0/2063058222 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5400712c0 con 0x7fd540136bf0 2023-09-30T22:25:30.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.353+0000 7fd53d7fa700 1 -- 172.21.15.40:0/2063058222 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd52c024380 con 0x7fd540136bf0 2023-09-30T22:25:30.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.376+0000 7f7d39da3700 1 Processor -- start 2023-09-30T22:25:30.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.376+0000 7f7d39da3700 1 -- start start 2023-09-30T22:25:30.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.377+0000 7f7d39da3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d34136c50 0x7f7d34139030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.377+0000 7f7d39da3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7d34139570 0x7f7d3413b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.377+0000 7f7d39da3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d34133940 con 0x7f7d34133e00 2023-09-30T22:25:30.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.377+0000 7f7d39da3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d3409ab20 con 0x7f7d34139570 2023-09-30T22:25:30.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.377+0000 7f7d39da3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3409f0d0 con 0x7f7d34136c50 2023-09-30T22:25:30.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.377+0000 7f7d337fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7d34133e00 0x7f7d341341d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:35130/0 (socket says 172.21.15.40:35130) 2023-09-30T22:25:30.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.377+0000 7f7d337fe700 1 -- 172.21.15.40:0/1306919588 learned_addr learned my addr 172.21.15.40:0/1306919588 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:30.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.377+0000 7f7d32ffd700 1 --2- 172.21.15.40:0/1306919588 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d34136c50 0x7f7d34139030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.377+0000 7f7d33fff700 1 --2- 172.21.15.40:0/1306919588 >> v2:172.21.15.40:3300/0 conn(0x7f7d34139570 0x7f7d3413b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.378+0000 7f7d32ffd700 1 -- 172.21.15.40:0/1306919588 >> v2:172.21.15.40:3300/0 conn(0x7f7d34139570 msgr2=0x7f7d3413b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:30.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.378+0000 7f7d32ffd700 1 --2- 172.21.15.40:0/1306919588 >> v2:172.21.15.40:3300/0 conn(0x7f7d34139570 0x7f7d3413b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.378+0000 7f7d32ffd700 1 -- 172.21.15.40:0/1306919588 >> v1:172.21.15.40:6789/0 conn(0x7f7d34133e00 legacy=0x7f7d341341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.378+0000 7f7d32ffd700 1 -- 172.21.15.40:0/1306919588 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d34133be0 con 0x7f7d34136c50 2023-09-30T22:25:30.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.378+0000 7f7d327fc700 1 -- 172.21.15.40:0/1306919588 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3433702051 0 0) 0x7f7d34133940 con 0x7f7d34133e00 2023-09-30T22:25:30.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.378+0000 7f7d33fff700 1 --2- 172.21.15.40:0/1306919588 >> v2:172.21.15.40:3300/0 conn(0x7f7d34139570 0x7f7d3413b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:30.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.378+0000 7f7d32ffd700 1 --2- 172.21.15.40:0/1306919588 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d34136c50 0x7f7d34139030 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7d28009840 tx=0x7f7d28009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b3d01c6d78d1f2e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:30.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.378+0000 7f7d327fc700 1 -- 172.21.15.40:0/1306919588 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d28011830 con 0x7f7d34136c50 2023-09-30T22:25:30.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.378+0000 7f7d327fc700 1 -- 172.21.15.40:0/1306919588 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d28011990 con 0x7f7d34136c50 2023-09-30T22:25:30.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.378+0000 7f7d327fc700 1 -- 172.21.15.40:0/1306919588 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d28011d20 con 0x7f7d34136c50 2023-09-30T22:25:30.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.379+0000 7f7d39da3700 1 -- 172.21.15.40:0/1306919588 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d34136c50 msgr2=0x7f7d34139030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.379+0000 7f7d39da3700 1 --2- 172.21.15.40:0/1306919588 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d34136c50 0x7f7d34139030 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7d28009840 tx=0x7f7d28009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:30.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.379+0000 7f7d39da3700 1 -- 172.21.15.40:0/1306919588 shutdown_connections 2023-09-30T22:25:30.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.379+0000 7f7d39da3700 1 --2- 172.21.15.40:0/1306919588 >> v2:172.21.15.40:3300/0 conn(0x7f7d34139570 0x7f7d3413b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.379+0000 7f7d39da3700 1 --2- 172.21.15.40:0/1306919588 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d34136c50 0x7f7d34139030 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.379+0000 7f7d39da3700 1 -- 172.21.15.40:0/1306919588 >> 172.21.15.40:0/1306919588 conn(0x7f7d340a2a00 msgr2=0x7f7d340a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:30.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.379+0000 7f7d39da3700 1 -- 172.21.15.40:0/1306919588 shutdown_connections 2023-09-30T22:25:30.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.379+0000 7f7d39da3700 1 -- 172.21.15.40:0/1306919588 wait complete. 2023-09-30T22:25:30.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.380+0000 7f7d39da3700 1 Processor -- start 2023-09-30T22:25:30.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.380+0000 7f7d39da3700 1 -- start start 2023-09-30T22:25:30.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.381+0000 7f7d39da3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7d34133e00 0x7f7d34119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.381+0000 7f7d39da3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d34136c50 0x7f7d34119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.381+0000 7f7d39da3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d34139570 0x7f7d34119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.381+0000 7f7d39da3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d34130ff0 con 0x7f7d34136c50 2023-09-30T22:25:30.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.381+0000 7f7d39da3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3411b400 con 0x7f7d34139570 2023-09-30T22:25:30.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.381+0000 7f7d39da3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d34136820 con 0x7f7d34133e00 2023-09-30T22:25:30.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.381+0000 7f7d33fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d34139570 0x7f7d34119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.381+0000 7f7d33fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d34139570 0x7f7d34119ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39356/0 (socket says 172.21.15.40:39356) 2023-09-30T22:25:30.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.381+0000 7f7d33fff700 1 -- 172.21.15.40:0/1231135590 learned_addr learned my addr 172.21.15.40:0/1231135590 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:30.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.381+0000 7f7d32ffd700 1 --2- 172.21.15.40:0/1231135590 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d34136c50 0x7f7d34119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.381+0000 7f7d337fe700 1 --2- 172.21.15.40:0/1231135590 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7d34133e00 0x7f7d34119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.381+0000 7f7d33fff700 1 -- 172.21.15.40:0/1231135590 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7d34133e00 msgr2=0x7f7d34119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.381+0000 7f7d33fff700 1 --2- 172.21.15.40:0/1231135590 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7d34133e00 0x7f7d34119050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.381+0000 7f7d33fff700 1 -- 172.21.15.40:0/1231135590 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d34136c50 msgr2=0x7f7d34119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.381+0000 7f7d33fff700 1 --2- 172.21.15.40:0/1231135590 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d34136c50 0x7f7d34119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.381+0000 7f7d33fff700 1 -- 172.21.15.40:0/1231135590 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d280094a0 con 0x7f7d34139570 2023-09-30T22:25:30.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.381+0000 7f7d33fff700 1 --2- 172.21.15.40:0/1231135590 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d34139570 0x7f7d34119ad0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c007ec0 tx=0x7f7d2c00d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:30.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.382+0000 7f7d1bfff700 1 -- 172.21.15.40:0/1231135590 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c00dde0 con 0x7f7d34139570 2023-09-30T22:25:30.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.382+0000 7f7d1bfff700 1 -- 172.21.15.40:0/1231135590 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d2c00f040 con 0x7f7d34139570 2023-09-30T22:25:30.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.382+0000 7f7d39da3700 1 -- 172.21.15.40:0/1231135590 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d3412dce0 con 0x7f7d34139570 2023-09-30T22:25:30.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.382+0000 7f7d1bfff700 1 -- 172.21.15.40:0/1231135590 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c015640 con 0x7f7d34139570 2023-09-30T22:25:30.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.382+0000 7f7d39da3700 1 -- 172.21.15.40:0/1231135590 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d34130530 con 0x7f7d34139570 2023-09-30T22:25:30.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.383+0000 7f7d39da3700 1 -- 172.21.15.40:0/1231135590 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d3411b590 con 0x7f7d34139570 2023-09-30T22:25:30.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.383+0000 7f7d1bfff700 1 -- 172.21.15.40:0/1231135590 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7d2c01e3b0 con 0x7f7d34139570 2023-09-30T22:25:30.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.383+0000 7f7d1bfff700 1 -- 172.21.15.40:0/1231135590 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f7d2c03f830 con 0x7f7d34139570 2023-09-30T22:25:30.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.387+0000 7f7d1bfff700 1 -- 172.21.15.40:0/1231135590 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d3411b590 con 0x7f7d34139570 2023-09-30T22:25:30.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.465+0000 7fb4a5587700 1 -- 172.21.15.40:0/1637911474 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb4a011abc0 con 0x7fb4a009d400 2023-09-30T22:25:30.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.466+0000 7fb4877fe700 1 -- 172.21.15.40:0/1637911474 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb490032090 con 0x7fb4a009d400 2023-09-30T22:25:30.467 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:30.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.468+0000 7fb4a5587700 1 -- 172.21.15.40:0/1637911474 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4a009d400 msgr2=0x7fb4a0119050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.468+0000 7fb4a5587700 1 --2- 172.21.15.40:0/1637911474 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4a009d400 0x7fb4a0119050 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb490000c00 tx=0x7fb490004750 comp rx=0 tx=0).stop 2023-09-30T22:25:30.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.468+0000 7fb4a5587700 1 -- 172.21.15.40:0/1637911474 shutdown_connections 2023-09-30T22:25:30.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.468+0000 7fb4a5587700 1 --2- 172.21.15.40:0/1637911474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4a0133e00 0x7fb4a0119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.468+0000 7fb4a5587700 1 --2- 172.21.15.40:0/1637911474 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4a009d400 0x7fb4a0119050 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.468+0000 7fb4a5587700 1 --2- 172.21.15.40:0/1637911474 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4a009dd70 0x7fb4a0119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.468+0000 7fb4a5587700 1 -- 172.21.15.40:0/1637911474 >> 172.21.15.40:0/1637911474 conn(0x7fb4a00a2a00 msgr2=0x7fb4a012d880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:30.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.468+0000 7fb4a5587700 1 -- 172.21.15.40:0/1637911474 shutdown_connections 2023-09-30T22:25:30.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.468+0000 7fb4a5587700 1 -- 172.21.15.40:0/1637911474 wait complete. 2023-09-30T22:25:30.481 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:30.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.553+0000 7fd546d63700 1 -- 172.21.15.40:0/2063058222 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd540062380 con 0x7fd540136bf0 2023-09-30T22:25:30.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.553+0000 7fd53d7fa700 1 -- 172.21.15.40:0/2063058222 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd52c019ba0 con 0x7fd540136bf0 2023-09-30T22:25:30.554 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:30.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.555+0000 7fd546d63700 1 -- 172.21.15.40:0/2063058222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd540136bf0 msgr2=0x7fd54006f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.555+0000 7fd546d63700 1 --2- 172.21.15.40:0/2063058222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd540136bf0 0x7fd54006f440 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd52c009840 tx=0x7fd52c004750 comp rx=0 tx=0).stop 2023-09-30T22:25:30.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.555+0000 7fd546d63700 1 -- 172.21.15.40:0/2063058222 shutdown_connections 2023-09-30T22:25:30.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.555+0000 7fd546d63700 1 --2- 172.21.15.40:0/2063058222 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd540139510 0x7fd54006f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.555+0000 7fd546d63700 1 --2- 172.21.15.40:0/2063058222 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd54009c890 0x7fd54006ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.555+0000 7fd546d63700 1 --2- 172.21.15.40:0/2063058222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd540136bf0 0x7fd54006f440 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.555+0000 7fd546d63700 1 -- 172.21.15.40:0/2063058222 >> 172.21.15.40:0/2063058222 conn(0x7fd5400a7080 msgr2=0x7fd540136fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:30.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.555+0000 7fd546d63700 1 -- 172.21.15.40:0/2063058222 shutdown_connections 2023-09-30T22:25:30.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.555+0000 7fd546d63700 1 -- 172.21.15.40:0/2063058222 wait complete. 2023-09-30T22:25:30.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:30.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.585+0000 7f7d39da3700 1 -- 172.21.15.40:0/1231135590 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7d3411b540 con 0x7f7d34139570 2023-09-30T22:25:30.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.586+0000 7f7d1bfff700 1 -- 172.21.15.40:0/1231135590 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7d2c01a070 con 0x7f7d34139570 2023-09-30T22:25:30.586 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:30.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.588+0000 7f7d39da3700 1 -- 172.21.15.40:0/1231135590 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d34139570 msgr2=0x7f7d34119ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.588+0000 7f7d39da3700 1 --2- 172.21.15.40:0/1231135590 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d34139570 0x7f7d34119ad0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c007ec0 tx=0x7f7d2c00d3b0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.588+0000 7f7d39da3700 1 -- 172.21.15.40:0/1231135590 shutdown_connections 2023-09-30T22:25:30.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.588+0000 7f7d39da3700 1 --2- 172.21.15.40:0/1231135590 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7d34133e00 0x7f7d34119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.588+0000 7f7d39da3700 1 --2- 172.21.15.40:0/1231135590 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d34139570 0x7f7d34119ad0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.588+0000 7f7d39da3700 1 --2- 172.21.15.40:0/1231135590 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d34136c50 0x7f7d34119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.588+0000 7f7d39da3700 1 -- 172.21.15.40:0/1231135590 >> 172.21.15.40:0/1231135590 conn(0x7f7d340a2a00 msgr2=0x7f7d34134a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:30.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.588+0000 7f7d39da3700 1 -- 172.21.15.40:0/1231135590 shutdown_connections 2023-09-30T22:25:30.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:30.588+0000 7f7d39da3700 1 -- 172.21.15.40:0/1231135590 wait complete. 2023-09-30T22:25:30.600 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:31.307 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:31.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.447+0000 7fb508675700 1 Processor -- start 2023-09-30T22:25:31.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.447+0000 7fb508675700 1 -- start start 2023-09-30T22:25:31.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.448+0000 7fb508675700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb50009df30 0x7fb500135400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.448+0000 7fb508675700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb500135940 0x7fb500137d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.448+0000 7fb508675700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb50009e8b0 con 0x7fb50009d450 2023-09-30T22:25:31.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.448+0000 7fb508675700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb50009c3b0 con 0x7fb500135940 2023-09-30T22:25:31.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.448+0000 7fb508675700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb50009a6b0 con 0x7fb50009df30 2023-09-30T22:25:31.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.448+0000 7fb505c10700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb50009df30 0x7fb500135400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.448+0000 7fb506411700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb50009d450 0x7fb50009d820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:35140/0 (socket says 172.21.15.40:35140) 2023-09-30T22:25:31.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.448+0000 7fb506411700 1 -- 172.21.15.40:0/2092659151 learned_addr learned my addr 172.21.15.40:0/2092659151 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:31.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.448+0000 7fb506c12700 1 --2- 172.21.15.40:0/2092659151 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb500135940 0x7fb500137d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.449+0000 7fb505c10700 1 -- 172.21.15.40:0/2092659151 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb500135940 msgr2=0x7fb500137d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:31.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.449+0000 7fb505c10700 1 --2- 172.21.15.40:0/2092659151 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb500135940 0x7fb500137d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.449+0000 7fb505c10700 1 -- 172.21.15.40:0/2092659151 >> v1:172.21.15.40:6789/0 conn(0x7fb50009d450 legacy=0x7fb50009d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.449+0000 7fb505c10700 1 -- 172.21.15.40:0/2092659151 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb50009b4f0 con 0x7fb50009df30 2023-09-30T22:25:31.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.449+0000 7fb50540f700 1 -- 172.21.15.40:0/2092659151 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1886818661 0 0) 0x7fb50009e8b0 con 0x7fb50009d450 2023-09-30T22:25:31.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.449+0000 7fb505c10700 1 --2- 172.21.15.40:0/2092659151 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb50009df30 0x7fb500135400 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc009870 tx=0x7fb4fc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f8c2c1f591b4ece server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:31.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.449+0000 7fb50540f700 1 -- 172.21.15.40:0/2092659151 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc011830 con 0x7fb50009df30 2023-09-30T22:25:31.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.449+0000 7fb50540f700 1 -- 172.21.15.40:0/2092659151 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4fc011990 con 0x7fb50009df30 2023-09-30T22:25:31.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.449+0000 7fb50540f700 1 -- 172.21.15.40:0/2092659151 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc011d20 con 0x7fb50009df30 2023-09-30T22:25:31.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.449+0000 7fb508675700 1 -- 172.21.15.40:0/2092659151 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb50009df30 msgr2=0x7fb500135400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.449+0000 7fb508675700 1 --2- 172.21.15.40:0/2092659151 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb50009df30 0x7fb500135400 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc009870 tx=0x7fb4fc009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:31.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.450+0000 7fb508675700 1 -- 172.21.15.40:0/2092659151 shutdown_connections 2023-09-30T22:25:31.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.450+0000 7fb508675700 1 --2- 172.21.15.40:0/2092659151 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb500135940 0x7fb500137d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.450+0000 7fb508675700 1 --2- 172.21.15.40:0/2092659151 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb50009df30 0x7fb500135400 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.450+0000 7fb508675700 1 -- 172.21.15.40:0/2092659151 >> 172.21.15.40:0/2092659151 conn(0x7fb5000a2a00 msgr2=0x7fb5000a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:31.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.450+0000 7fb508675700 1 -- 172.21.15.40:0/2092659151 shutdown_connections 2023-09-30T22:25:31.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.450+0000 7fb508675700 1 -- 172.21.15.40:0/2092659151 wait complete. 2023-09-30T22:25:31.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.450+0000 7fb508675700 1 Processor -- start 2023-09-30T22:25:31.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.451+0000 7fb508675700 1 -- start start 2023-09-30T22:25:31.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.451+0000 7fb508675700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb50009d450 0x7fb50012c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.451+0000 7fb508675700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb50009df30 0x7fb50012cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.451+0000 7fb508675700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb500135940 0x7fb500139270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.451+0000 7fb508675700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb500135600 con 0x7fb50009d450 2023-09-30T22:25:31.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.451+0000 7fb508675700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb50009c5d0 con 0x7fb500135940 2023-09-30T22:25:31.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.451+0000 7fb508675700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb500134080 con 0x7fb50009df30 2023-09-30T22:25:31.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.451+0000 7fb506411700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb50009d450 0x7fb50012c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.451+0000 7fb506411700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb50009d450 0x7fb50012c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44832/0 (socket says 172.21.15.40:44832) 2023-09-30T22:25:31.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.451+0000 7fb506411700 1 -- 172.21.15.40:0/3750585420 learned_addr learned my addr 172.21.15.40:0/3750585420 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:31.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.451+0000 7fb506c12700 1 --2- 172.21.15.40:0/3750585420 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb500135940 0x7fb500139270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.451+0000 7fb505c10700 1 --2- 172.21.15.40:0/3750585420 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb50009df30 0x7fb50012cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.451+0000 7fb506411700 1 -- 172.21.15.40:0/3750585420 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb50009df30 msgr2=0x7fb50012cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.451+0000 7fb506411700 1 --2- 172.21.15.40:0/3750585420 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb50009df30 0x7fb50012cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.451+0000 7fb506411700 1 -- 172.21.15.40:0/3750585420 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb500135940 msgr2=0x7fb500139270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.452+0000 7fb506411700 1 --2- 172.21.15.40:0/3750585420 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb500135940 0x7fb500139270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.452+0000 7fb506411700 1 -- 172.21.15.40:0/3750585420 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4fc0094a0 con 0x7fb50009d450 2023-09-30T22:25:31.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.452+0000 7fb506c12700 1 --2- 172.21.15.40:0/3750585420 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb500135940 0x7fb500139270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:31.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.452+0000 7fb506411700 1 --2- 172.21.15.40:0/3750585420 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb50009d450 0x7fb50012c5d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb4f000c520 tx=0x7fb4f000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:31.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.452+0000 7fb4f6ffd700 1 -- 172.21.15.40:0/3750585420 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f0004c80 con 0x7fb50009d450 2023-09-30T22:25:31.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.452+0000 7fb4f6ffd700 1 -- 172.21.15.40:0/3750585420 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f0004de0 con 0x7fb50009d450 2023-09-30T22:25:31.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.452+0000 7fb508675700 1 -- 172.21.15.40:0/3750585420 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb500135300 con 0x7fb50009d450 2023-09-30T22:25:31.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.452+0000 7fb4f6ffd700 1 -- 172.21.15.40:0/3750585420 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f0007310 con 0x7fb50009d450 2023-09-30T22:25:31.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.452+0000 7fb508675700 1 -- 172.21.15.40:0/3750585420 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb500070ae0 con 0x7fb50009d450 2023-09-30T22:25:31.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.453+0000 7fb4f6ffd700 1 -- 172.21.15.40:0/3750585420 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb4f0007470 con 0x7fb50009d450 2023-09-30T22:25:31.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.453+0000 7fb4f6ffd700 1 -- 172.21.15.40:0/3750585420 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb4f003f2c0 con 0x7fb50009d450 2023-09-30T22:25:31.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.453+0000 7fb508675700 1 -- 172.21.15.40:0/3750585420 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb500062380 con 0x7fb50009d450 2023-09-30T22:25:31.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.457+0000 7fb4f6ffd700 1 -- 172.21.15.40:0/3750585420 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb4f00123b0 con 0x7fb50009d450 2023-09-30T22:25:31.481 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:31.569 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:31.601 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:31.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.610+0000 7f79db69c700 1 Processor -- start 2023-09-30T22:25:31.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.610+0000 7f79db69c700 1 -- start start 2023-09-30T22:25:31.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.611+0000 7f79db69c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f79d4134a90 0x7f79d4136e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.611+0000 7f79db69c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f79d41373b0 0x7f79d4139790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.611+0000 7f79db69c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79d4131900 con 0x7f79d4131d50 2023-09-30T22:25:31.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.611+0000 7f79db69c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79d40719e0 con 0x7f79d4134a90 2023-09-30T22:25:31.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.611+0000 7f79db69c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79d409e820 con 0x7f79d41373b0 2023-09-30T22:25:31.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.611+0000 7f79d8c37700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f79d4134a90 0x7f79d4136e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.611+0000 7f79d9c39700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f79d41373b0 0x7f79d4139790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.611+0000 7f79d8c37700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f79d4134a90 0x7f79d4136e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44838/0 (socket says 172.21.15.40:44838) 2023-09-30T22:25:31.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.611+0000 7f79d8c37700 1 -- 172.21.15.40:0/223227310 learned_addr learned my addr 172.21.15.40:0/223227310 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:31.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.611+0000 7f79d8c37700 1 -- 172.21.15.40:0/223227310 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f79d41373b0 msgr2=0x7f79d4139790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:31.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.611+0000 7f79d8c37700 1 --2- 172.21.15.40:0/223227310 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f79d41373b0 0x7f79d4139790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.611+0000 7f79d8c37700 1 -- 172.21.15.40:0/223227310 >> v1:172.21.15.40:6789/0 conn(0x7f79d4131d50 legacy=0x7f79d4132120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.611+0000 7f79cbfff700 1 -- 172.21.15.40:0/223227310 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1128263741 0 0) 0x7f79d4131900 con 0x7f79d4131d50 2023-09-30T22:25:31.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.612+0000 7f79d8c37700 1 -- 172.21.15.40:0/223227310 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d409ef60 con 0x7f79d4134a90 2023-09-30T22:25:31.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.612+0000 7f79d8c37700 1 --2- 172.21.15.40:0/223227310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79d4134a90 0x7f79d4136e70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f79c40098f0 tx=0x7f79c4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e07a9ed1a2d0e34 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:31.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.612+0000 7f79cbfff700 1 -- 172.21.15.40:0/223227310 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c4011830 con 0x7f79d4134a90 2023-09-30T22:25:31.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.612+0000 7f79cbfff700 1 -- 172.21.15.40:0/223227310 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c4011990 con 0x7f79d4134a90 2023-09-30T22:25:31.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.612+0000 7f79cbfff700 1 -- 172.21.15.40:0/223227310 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c4011d20 con 0x7f79d4134a90 2023-09-30T22:25:31.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.613+0000 7f79db69c700 1 -- 172.21.15.40:0/223227310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79d4134a90 msgr2=0x7f79d4136e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.613+0000 7f79db69c700 1 --2- 172.21.15.40:0/223227310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79d4134a90 0x7f79d4136e70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f79c40098f0 tx=0x7f79c4009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:31.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.613+0000 7f79db69c700 1 -- 172.21.15.40:0/223227310 shutdown_connections 2023-09-30T22:25:31.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.613+0000 7f79db69c700 1 --2- 172.21.15.40:0/223227310 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f79d41373b0 0x7f79d4139790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.613+0000 7f79db69c700 1 --2- 172.21.15.40:0/223227310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79d4134a90 0x7f79d4136e70 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.613+0000 7f79db69c700 1 -- 172.21.15.40:0/223227310 >> 172.21.15.40:0/223227310 conn(0x7f79d40a2a00 msgr2=0x7f79d40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:31.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.613+0000 7f79db69c700 1 -- 172.21.15.40:0/223227310 shutdown_connections 2023-09-30T22:25:31.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.613+0000 7f79db69c700 1 -- 172.21.15.40:0/223227310 wait complete. 2023-09-30T22:25:31.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.614+0000 7f79db69c700 1 Processor -- start 2023-09-30T22:25:31.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.614+0000 7f79db69c700 1 -- start start 2023-09-30T22:25:31.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.614+0000 7f79db69c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f79d4131d50 0x7f79d41c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.614+0000 7f79db69c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f79d4134a90 0x7f79d41c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.614+0000 7f79db69c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79d41373b0 0x7f79d4099a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.614+0000 7f79db69c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d409ead0 con 0x7f79d41373b0 2023-09-30T22:25:31.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.614+0000 7f79db69c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d4071040 con 0x7f79d4131d50 2023-09-30T22:25:31.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.614+0000 7f79db69c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79d41c9370 con 0x7f79d4134a90 2023-09-30T22:25:31.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.615+0000 7f79d8c37700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f79d4134a90 0x7f79d41c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.615+0000 7f79d8c37700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f79d4134a90 0x7f79d41c8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48390/0 (socket says 172.21.15.40:48390) 2023-09-30T22:25:31.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.615+0000 7f79d8c37700 1 -- 172.21.15.40:0/1968826018 learned_addr learned my addr 172.21.15.40:0/1968826018 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:31.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.615+0000 7f79d9c39700 1 --2- 172.21.15.40:0/1968826018 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79d41373b0 0x7f79d4099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.615+0000 7f79d9438700 1 --2- 172.21.15.40:0/1968826018 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f79d4131d50 0x7f79d41c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.615+0000 7f79d8c37700 1 -- 172.21.15.40:0/1968826018 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f79d4131d50 msgr2=0x7f79d41c88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.615+0000 7f79d8c37700 1 --2- 172.21.15.40:0/1968826018 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f79d4131d50 0x7f79d41c88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.615+0000 7f79d8c37700 1 -- 172.21.15.40:0/1968826018 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79d41373b0 msgr2=0x7f79d4099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.615+0000 7f79d8c37700 1 --2- 172.21.15.40:0/1968826018 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79d41373b0 0x7f79d4099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.615+0000 7f79d8c37700 1 -- 172.21.15.40:0/1968826018 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c4009550 con 0x7f79d4134a90 2023-09-30T22:25:31.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.615+0000 7f79d9438700 1 --2- 172.21.15.40:0/1968826018 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f79d4131d50 0x7f79d41c88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:31.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.615+0000 7f79d8c37700 1 --2- 172.21.15.40:0/1968826018 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f79d4134a90 0x7f79d41c8e30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f79c4009c40 tx=0x7f79c4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:31.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.615+0000 7f79c9ffb700 1 -- 172.21.15.40:0/1968826018 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c4004300 con 0x7f79d4134a90 2023-09-30T22:25:31.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.616+0000 7f79c9ffb700 1 -- 172.21.15.40:0/1968826018 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c401f070 con 0x7f79d4134a90 2023-09-30T22:25:31.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.616+0000 7f79db69c700 1 -- 172.21.15.40:0/1968826018 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d412dfe0 con 0x7f79d4134a90 2023-09-30T22:25:31.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.616+0000 7f79c9ffb700 1 -- 172.21.15.40:0/1968826018 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c40036a0 con 0x7f79d4134a90 2023-09-30T22:25:31.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.616+0000 7f79db69c700 1 -- 172.21.15.40:0/1968826018 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d409acd0 con 0x7f79d4134a90 2023-09-30T22:25:31.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.617+0000 7f79c9ffb700 1 -- 172.21.15.40:0/1968826018 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f79c4021030 con 0x7f79d4134a90 2023-09-30T22:25:31.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.617+0000 7f79db69c700 1 -- 172.21.15.40:0/1968826018 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d4062380 con 0x7f79d4134a90 2023-09-30T22:25:31.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.617+0000 7f79c9ffb700 1 -- 172.21.15.40:0/1968826018 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f79c4040a50 con 0x7f79d4134a90 2023-09-30T22:25:31.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.626+0000 7f79c9ffb700 1 -- 172.21.15.40:0/1968826018 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f79c4023790 con 0x7f79d4134a90 2023-09-30T22:25:31.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.694+0000 7fb508675700 1 -- 172.21.15.40:0/3750585420 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb500074330 con 0x7fb50009d450 2023-09-30T22:25:31.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.694+0000 7fb4f6ffd700 1 -- 172.21.15.40:0/3750585420 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb4f00102c0 con 0x7fb50009d450 2023-09-30T22:25:31.695 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:31.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.696+0000 7fb508675700 1 -- 172.21.15.40:0/3750585420 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb50009d450 msgr2=0x7fb50012c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.696+0000 7fb508675700 1 --2- 172.21.15.40:0/3750585420 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb50009d450 0x7fb50012c5d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb4f000c520 tx=0x7fb4f000c830 comp rx=0 tx=0).stop 2023-09-30T22:25:31.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.696+0000 7fb508675700 1 -- 172.21.15.40:0/3750585420 shutdown_connections 2023-09-30T22:25:31.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.696+0000 7fb508675700 1 --2- 172.21.15.40:0/3750585420 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb500135940 0x7fb500139270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.696+0000 7fb508675700 1 --2- 172.21.15.40:0/3750585420 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb50009d450 0x7fb50012c5d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.696+0000 7fb508675700 1 --2- 172.21.15.40:0/3750585420 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb50009df30 0x7fb50012cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.696+0000 7fb508675700 1 -- 172.21.15.40:0/3750585420 >> 172.21.15.40:0/3750585420 conn(0x7fb5000a2a00 msgr2=0x7fb500136ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:31.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.697+0000 7fb508675700 1 -- 172.21.15.40:0/3750585420 shutdown_connections 2023-09-30T22:25:31.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.697+0000 7fb508675700 1 -- 172.21.15.40:0/3750585420 wait complete. 2023-09-30T22:25:31.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.708+0000 7ffa5a648700 1 Processor -- start 2023-09-30T22:25:31.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.709+0000 7ffa5a648700 1 -- start start 2023-09-30T22:25:31.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.709+0000 7ffa5a648700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa5409d920 0x7ffa5409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.709+0000 7ffa5a648700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa5409e230 0x7ffa541343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.709+0000 7ffa5a648700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa5409f940 con 0x7ffa5409f0f0 2023-09-30T22:25:31.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.709+0000 7ffa5a648700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5406b4c0 con 0x7ffa5409e230 2023-09-30T22:25:31.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.709+0000 7ffa5a648700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5409a8f0 con 0x7ffa5409d920 2023-09-30T22:25:31.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.710+0000 7ffa53fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa5409d920 0x7ffa5409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.710+0000 7ffa58be5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa5409e230 0x7ffa541343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.710+0000 7ffa53fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa5409d920 0x7ffa5409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48396/0 (socket says 172.21.15.40:48396) 2023-09-30T22:25:31.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.710+0000 7ffa53fff700 1 -- 172.21.15.40:0/491387063 learned_addr learned my addr 172.21.15.40:0/491387063 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:31.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.710+0000 7ffa58be5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa5409e230 0x7ffa541343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39378/0 (socket says 172.21.15.40:39378) 2023-09-30T22:25:31.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.710+0000 7ffa53fff700 1 -- 172.21.15.40:0/491387063 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa5409e230 msgr2=0x7ffa541343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:31.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.710+0000 7ffa53fff700 1 --2- 172.21.15.40:0/491387063 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa5409e230 0x7ffa541343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.710+0000 7ffa53fff700 1 -- 172.21.15.40:0/491387063 >> v1:172.21.15.40:6789/0 conn(0x7ffa5409f0f0 legacy=0x7ffa54133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.710+0000 7ffa52ffd700 1 -- 172.21.15.40:0/491387063 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2396580223 0 0) 0x7ffa5409f940 con 0x7ffa5409f0f0 2023-09-30T22:25:31.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.710+0000 7ffa53fff700 1 -- 172.21.15.40:0/491387063 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5409f6e0 con 0x7ffa5409d920 2023-09-30T22:25:31.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.710+0000 7ffa53fff700 1 --2- 172.21.15.40:0/491387063 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa5409d920 0x7ffa5409dcf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ffa44009920 tx=0x7ffa44009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cc139c6106c5a90 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:31.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.711+0000 7ffa52ffd700 1 -- 172.21.15.40:0/491387063 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa44005e30 con 0x7ffa5409d920 2023-09-30T22:25:31.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.711+0000 7ffa52ffd700 1 -- 172.21.15.40:0/491387063 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa44004030 con 0x7ffa5409d920 2023-09-30T22:25:31.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.711+0000 7ffa52ffd700 1 -- 172.21.15.40:0/491387063 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa440043e0 con 0x7ffa5409d920 2023-09-30T22:25:31.713 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:31.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.711+0000 7ffa5a648700 1 -- 172.21.15.40:0/491387063 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa5409d920 msgr2=0x7ffa5409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.711+0000 7ffa5a648700 1 --2- 172.21.15.40:0/491387063 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa5409d920 0x7ffa5409dcf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ffa44009920 tx=0x7ffa44009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:31.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.711+0000 7ffa5a648700 1 -- 172.21.15.40:0/491387063 shutdown_connections 2023-09-30T22:25:31.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.711+0000 7ffa5a648700 1 --2- 172.21.15.40:0/491387063 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa5409e230 0x7ffa541343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.711+0000 7ffa5a648700 1 --2- 172.21.15.40:0/491387063 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa5409d920 0x7ffa5409dcf0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.711+0000 7ffa5a648700 1 -- 172.21.15.40:0/491387063 >> 172.21.15.40:0/491387063 conn(0x7ffa5409fb20 msgr2=0x7ffa5409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:31.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.712+0000 7ffa5a648700 1 -- 172.21.15.40:0/491387063 shutdown_connections 2023-09-30T22:25:31.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.712+0000 7ffa5a648700 1 -- 172.21.15.40:0/491387063 wait complete. 2023-09-30T22:25:31.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.712+0000 7ffa5a648700 1 Processor -- start 2023-09-30T22:25:31.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.713+0000 7ffa5a648700 1 -- start start 2023-09-30T22:25:31.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.713+0000 7ffa5a648700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa5409d920 0x7ffa54122720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.713+0000 7ffa5a648700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa5409e230 0x7ffa54122c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.713+0000 7ffa5a648700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa541231a0 0x7ffa541ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.713+0000 7ffa5a648700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa54125f10 con 0x7ffa5409d920 2023-09-30T22:25:31.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.713+0000 7ffa5a648700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5409c9e0 con 0x7ffa541231a0 2023-09-30T22:25:31.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.713+0000 7ffa5a648700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa54124b40 con 0x7ffa5409e230 2023-09-30T22:25:31.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.713+0000 7ffa537fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa5409e230 0x7ffa54122c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.713+0000 7ffa537fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa5409e230 0x7ffa54122c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48406/0 (socket says 172.21.15.40:48406) 2023-09-30T22:25:31.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.713+0000 7ffa537fe700 1 -- 172.21.15.40:0/3140235718 learned_addr learned my addr 172.21.15.40:0/3140235718 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:31.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.713+0000 7ffa58be5700 1 --2- 172.21.15.40:0/3140235718 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa541231a0 0x7ffa541ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.713+0000 7ffa53fff700 1 --2- 172.21.15.40:0/3140235718 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa5409d920 0x7ffa54122720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.714+0000 7ffa58be5700 1 -- 172.21.15.40:0/3140235718 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa5409e230 msgr2=0x7ffa54122c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.714+0000 7ffa58be5700 1 --2- 172.21.15.40:0/3140235718 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa5409e230 0x7ffa54122c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.714+0000 7ffa58be5700 1 -- 172.21.15.40:0/3140235718 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa5409d920 msgr2=0x7ffa54122720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.714+0000 7ffa58be5700 1 --2- 172.21.15.40:0/3140235718 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa5409d920 0x7ffa54122720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.714+0000 7ffa58be5700 1 -- 172.21.15.40:0/3140235718 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa44009500 con 0x7ffa541231a0 2023-09-30T22:25:31.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.714+0000 7ffa53fff700 1 --2- 172.21.15.40:0/3140235718 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa5409d920 0x7ffa54122720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:31.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.714+0000 7ffa537fe700 1 --2- 172.21.15.40:0/3140235718 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa5409e230 0x7ffa54122c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:31.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.714+0000 7ffa58be5700 1 --2- 172.21.15.40:0/3140235718 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa541231a0 0x7ffa541ce9c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c009d90 tx=0x7ffa4c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:31.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.714+0000 7ffa50ff9700 1 -- 172.21.15.40:0/3140235718 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c009c00 con 0x7ffa541231a0 2023-09-30T22:25:31.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.714+0000 7ffa50ff9700 1 -- 172.21.15.40:0/3140235718 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4c00f040 con 0x7ffa541231a0 2023-09-30T22:25:31.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.714+0000 7ffa5a648700 1 -- 172.21.15.40:0/3140235718 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa540a2fd0 con 0x7ffa541231a0 2023-09-30T22:25:31.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.714+0000 7ffa50ff9700 1 -- 172.21.15.40:0/3140235718 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c014480 con 0x7ffa541231a0 2023-09-30T22:25:31.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.714+0000 7ffa5a648700 1 -- 172.21.15.40:0/3140235718 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa54125100 con 0x7ffa541231a0 2023-09-30T22:25:31.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.715+0000 7ffa50ff9700 1 -- 172.21.15.40:0/3140235718 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffa4c0145e0 con 0x7ffa541231a0 2023-09-30T22:25:31.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.715+0000 7ffa50ff9700 1 -- 172.21.15.40:0/3140235718 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ffa4c040310 con 0x7ffa541231a0 2023-09-30T22:25:31.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.715+0000 7ffa5a648700 1 -- 172.21.15.40:0/3140235718 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa54062380 con 0x7ffa541231a0 2023-09-30T22:25:31.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.720+0000 7ffa50ff9700 1 -- 172.21.15.40:0/3140235718 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa4c007510 con 0x7ffa541231a0 2023-09-30T22:25:31.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.776+0000 7faf20605700 1 Processor -- start 2023-09-30T22:25:31.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.776+0000 7faf20605700 1 -- start start 2023-09-30T22:25:31.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.777+0000 7faf20605700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faf1809d920 0x7faf1809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.777+0000 7faf20605700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf1809f0f0 0x7faf1809e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.777+0000 7faf20605700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faf18133ca0 0x7faf18134110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.777+0000 7faf20605700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf1806b4c0 con 0x7faf1809d920 2023-09-30T22:25:31.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.777+0000 7faf20605700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf1809a8f0 con 0x7faf1809f0f0 2023-09-30T22:25:31.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.777+0000 7faf20605700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf1809f940 con 0x7faf18133ca0 2023-09-30T22:25:31.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.777+0000 7faf1e3a1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faf1809d920 0x7faf1809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.777+0000 7faf1e3a1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faf1809d920 0x7faf1809dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44876/0 (socket says 172.21.15.40:44876) 2023-09-30T22:25:31.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.777+0000 7faf1e3a1700 1 -- 172.21.15.40:0/726066559 learned_addr learned my addr 172.21.15.40:0/726066559 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:31.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.777+0000 7faf1dba0700 1 --2- 172.21.15.40:0/726066559 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf1809f0f0 0x7faf1809e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.777+0000 7faf1eba2700 1 --2- 172.21.15.40:0/726066559 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faf18133ca0 0x7faf18134110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.778+0000 7faf1eba2700 1 -- 172.21.15.40:0/726066559 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf1809f0f0 msgr2=0x7faf1809e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:31.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.778+0000 7faf1eba2700 1 --2- 172.21.15.40:0/726066559 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf1809f0f0 0x7faf1809e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.778+0000 7faf1eba2700 1 -- 172.21.15.40:0/726066559 >> v2:172.21.15.40:3300/0 conn(0x7faf1809d920 msgr2=0x7faf1809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:31.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.778+0000 7faf1eba2700 1 --2- 172.21.15.40:0/726066559 >> v2:172.21.15.40:3300/0 conn(0x7faf1809d920 0x7faf1809dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.778+0000 7faf1eba2700 1 -- 172.21.15.40:0/726066559 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1809f6e0 con 0x7faf18133ca0 2023-09-30T22:25:31.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.778+0000 7faf1dba0700 1 --2- 172.21.15.40:0/726066559 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf1809f0f0 0x7faf1809e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:31.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.778+0000 7faf1eba2700 1 --2- 172.21.15.40:0/726066559 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faf18133ca0 0x7faf18134110 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faf10009dc0 tx=0x7faf1000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48cd0035f25f02e2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:31.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.778+0000 7faf1d39f700 1 -- 172.21.15.40:0/726066559 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1000e070 con 0x7faf18133ca0 2023-09-30T22:25:31.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.778+0000 7faf1d39f700 1 -- 172.21.15.40:0/726066559 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1000bae0 con 0x7faf18133ca0 2023-09-30T22:25:31.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.778+0000 7faf1d39f700 1 -- 172.21.15.40:0/726066559 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1000be90 con 0x7faf18133ca0 2023-09-30T22:25:31.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.779+0000 7faf20605700 1 -- 172.21.15.40:0/726066559 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faf18133ca0 msgr2=0x7faf18134110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.779+0000 7faf20605700 1 --2- 172.21.15.40:0/726066559 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faf18133ca0 0x7faf18134110 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faf10009dc0 tx=0x7faf1000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:31.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.779+0000 7faf20605700 1 -- 172.21.15.40:0/726066559 shutdown_connections 2023-09-30T22:25:31.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.779+0000 7faf20605700 1 --2- 172.21.15.40:0/726066559 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faf18133ca0 0x7faf18134110 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.779+0000 7faf20605700 1 --2- 172.21.15.40:0/726066559 >> v2:172.21.15.40:3300/0 conn(0x7faf1809d920 0x7faf1809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.779+0000 7faf20605700 1 --2- 172.21.15.40:0/726066559 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf1809f0f0 0x7faf1809e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.779+0000 7faf20605700 1 -- 172.21.15.40:0/726066559 >> 172.21.15.40:0/726066559 conn(0x7faf1809fb20 msgr2=0x7faf1809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:31.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.779+0000 7faf20605700 1 -- 172.21.15.40:0/726066559 shutdown_connections 2023-09-30T22:25:31.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.779+0000 7faf20605700 1 -- 172.21.15.40:0/726066559 wait complete. 2023-09-30T22:25:31.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.780+0000 7faf20605700 1 Processor -- start 2023-09-30T22:25:31.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.780+0000 7faf20605700 1 -- start start 2023-09-30T22:25:31.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.781+0000 7faf20605700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf1809d920 0x7faf18122a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.781+0000 7faf20605700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faf18133ca0 0x7faf18122f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.781+0000 7faf20605700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf181234a0 0x7faf181c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.781+0000 7faf20605700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf18123ef0 con 0x7faf181234a0 2023-09-30T22:25:31.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.781+0000 7faf20605700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf18124630 con 0x7faf1809d920 2023-09-30T22:25:31.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.781+0000 7faf20605700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf18133970 con 0x7faf18133ca0 2023-09-30T22:25:31.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.781+0000 7faf1dba0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faf18133ca0 0x7faf18122f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.781+0000 7faf1e3a1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf1809d920 0x7faf18122a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.781+0000 7faf1dba0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faf18133ca0 0x7faf18122f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48426/0 (socket says 172.21.15.40:48426) 2023-09-30T22:25:31.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.781+0000 7faf1dba0700 1 -- 172.21.15.40:0/1438297772 learned_addr learned my addr 172.21.15.40:0/1438297772 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:31.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.781+0000 7faf1e3a1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf1809d920 0x7faf18122a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39400/0 (socket says 172.21.15.40:39400) 2023-09-30T22:25:31.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.781+0000 7faf1eba2700 1 --2- 172.21.15.40:0/1438297772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf181234a0 0x7faf181c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.782+0000 7faf1e3a1700 1 -- 172.21.15.40:0/1438297772 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faf18133ca0 msgr2=0x7faf18122f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.782+0000 7faf1e3a1700 1 --2- 172.21.15.40:0/1438297772 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faf18133ca0 0x7faf18122f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.782+0000 7faf1e3a1700 1 -- 172.21.15.40:0/1438297772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf181234a0 msgr2=0x7faf181c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.782+0000 7faf1e3a1700 1 --2- 172.21.15.40:0/1438297772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf181234a0 0x7faf181c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.782+0000 7faf1e3a1700 1 -- 172.21.15.40:0/1438297772 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf080094a0 con 0x7faf1809d920 2023-09-30T22:25:31.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.782+0000 7faf1e3a1700 1 --2- 172.21.15.40:0/1438297772 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf1809d920 0x7faf18122a20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7faf14006fd0 tx=0x7faf1400eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:31.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.782+0000 7faf0effd700 1 -- 172.21.15.40:0/1438297772 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf14005a20 con 0x7faf1809d920 2023-09-30T22:25:31.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.782+0000 7faf0effd700 1 -- 172.21.15.40:0/1438297772 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf14005b80 con 0x7faf1809d920 2023-09-30T22:25:31.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.782+0000 7faf0effd700 1 -- 172.21.15.40:0/1438297772 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf14013740 con 0x7faf1809d920 2023-09-30T22:25:31.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.782+0000 7faf20605700 1 -- 172.21.15.40:0/1438297772 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf10009a70 con 0x7faf1809d920 2023-09-30T22:25:31.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.782+0000 7faf20605700 1 -- 172.21.15.40:0/1438297772 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf180a2d70 con 0x7faf1809d920 2023-09-30T22:25:31.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.783+0000 7faf0effd700 1 -- 172.21.15.40:0/1438297772 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faf140138a0 con 0x7faf1809d920 2023-09-30T22:25:31.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.783+0000 7faf20605700 1 -- 172.21.15.40:0/1438297772 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf18062380 con 0x7faf1809d920 2023-09-30T22:25:31.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.783+0000 7faf0effd700 1 -- 172.21.15.40:0/1438297772 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7faf1403f6a0 con 0x7faf1809d920 2023-09-30T22:25:31.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.788+0000 7faf0effd700 1 -- 172.21.15.40:0/1438297772 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faf14006030 con 0x7faf1809d920 2023-09-30T22:25:31.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.835+0000 7f79db69c700 1 -- 172.21.15.40:0/1968826018 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f79d411d5f0 con 0x7f79d4134a90 2023-09-30T22:25:31.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.836+0000 7f79c9ffb700 1 -- 172.21.15.40:0/1968826018 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f79c401b430 con 0x7f79d4134a90 2023-09-30T22:25:31.836 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:31.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.838+0000 7f79db69c700 1 -- 172.21.15.40:0/1968826018 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f79d4134a90 msgr2=0x7f79d41c8e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.838+0000 7f79db69c700 1 --2- 172.21.15.40:0/1968826018 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f79d4134a90 0x7f79d41c8e30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f79c4009c40 tx=0x7f79c4004750 comp rx=0 tx=0).stop 2023-09-30T22:25:31.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.838+0000 7f79db69c700 1 -- 172.21.15.40:0/1968826018 shutdown_connections 2023-09-30T22:25:31.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.838+0000 7f79db69c700 1 --2- 172.21.15.40:0/1968826018 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79d41373b0 0x7f79d4099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.838+0000 7f79db69c700 1 --2- 172.21.15.40:0/1968826018 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f79d4131d50 0x7f79d41c88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.838+0000 7f79db69c700 1 --2- 172.21.15.40:0/1968826018 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f79d4134a90 0x7f79d41c8e30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.838+0000 7f79db69c700 1 -- 172.21.15.40:0/1968826018 >> 172.21.15.40:0/1968826018 conn(0x7f79d40a2a00 msgr2=0x7f79d409f360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:31.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.838+0000 7f79db69c700 1 -- 172.21.15.40:0/1968826018 shutdown_connections 2023-09-30T22:25:31.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.838+0000 7f79db69c700 1 -- 172.21.15.40:0/1968826018 wait complete. 2023-09-30T22:25:31.851 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:31.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.933+0000 7ffa5a648700 1 -- 172.21.15.40:0/3140235718 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffa54074720 con 0x7ffa541231a0 2023-09-30T22:25:31.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.933+0000 7ffa50ff9700 1 -- 172.21.15.40:0/3140235718 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffa4c02c090 con 0x7ffa541231a0 2023-09-30T22:25:31.934 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:31.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.935+0000 7ffa5a648700 1 -- 172.21.15.40:0/3140235718 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa541231a0 msgr2=0x7ffa541ce9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.935+0000 7ffa5a648700 1 --2- 172.21.15.40:0/3140235718 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa541231a0 0x7ffa541ce9c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c009d90 tx=0x7ffa4c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.935+0000 7ffa5a648700 1 -- 172.21.15.40:0/3140235718 shutdown_connections 2023-09-30T22:25:31.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.935+0000 7ffa5a648700 1 --2- 172.21.15.40:0/3140235718 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa541231a0 0x7ffa541ce9c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.935+0000 7ffa5a648700 1 --2- 172.21.15.40:0/3140235718 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa5409d920 0x7ffa54122720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.935+0000 7ffa5a648700 1 --2- 172.21.15.40:0/3140235718 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa5409e230 0x7ffa54122c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.935+0000 7ffa5a648700 1 -- 172.21.15.40:0/3140235718 >> 172.21.15.40:0/3140235718 conn(0x7ffa5409fb20 msgr2=0x7ffa54070720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:31.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.935+0000 7ffa5a648700 1 -- 172.21.15.40:0/3140235718 shutdown_connections 2023-09-30T22:25:31.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.935+0000 7ffa5a648700 1 -- 172.21.15.40:0/3140235718 wait complete. 2023-09-30T22:25:31.948 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:31.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.988+0000 7faf20605700 1 -- 172.21.15.40:0/1438297772 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faf18133540 con 0x7faf1809d920 2023-09-30T22:25:31.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.989+0000 7faf0effd700 1 -- 172.21.15.40:0/1438297772 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faf14011350 con 0x7faf1809d920 2023-09-30T22:25:31.989 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:31.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.991+0000 7faf20605700 1 -- 172.21.15.40:0/1438297772 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf1809d920 msgr2=0x7faf18122a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.991+0000 7faf20605700 1 --2- 172.21.15.40:0/1438297772 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf1809d920 0x7faf18122a20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7faf14006fd0 tx=0x7faf1400eb20 comp rx=0 tx=0).stop 2023-09-30T22:25:31.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.991+0000 7faf20605700 1 -- 172.21.15.40:0/1438297772 shutdown_connections 2023-09-30T22:25:31.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.991+0000 7faf20605700 1 --2- 172.21.15.40:0/1438297772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf181234a0 0x7faf181c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.991+0000 7faf20605700 1 --2- 172.21.15.40:0/1438297772 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf1809d920 0x7faf18122a20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.991+0000 7faf20605700 1 --2- 172.21.15.40:0/1438297772 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faf18133ca0 0x7faf18122f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.991+0000 7faf20605700 1 -- 172.21.15.40:0/1438297772 >> 172.21.15.40:0/1438297772 conn(0x7faf1809fb20 msgr2=0x7faf180a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:31.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.991+0000 7faf20605700 1 -- 172.21.15.40:0/1438297772 shutdown_connections 2023-09-30T22:25:31.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:31.991+0000 7faf20605700 1 -- 172.21.15.40:0/1438297772 wait complete. 2023-09-30T22:25:32.004 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:32.715 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:32.851 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:32.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.853+0000 7f22d2f49700 1 Processor -- start 2023-09-30T22:25:32.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.854+0000 7f22d2f49700 1 -- start start 2023-09-30T22:25:32.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.854+0000 7f22d2f49700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f22cc09d920 0x7f22cc09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:32.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.854+0000 7f22d2f49700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22cc09f0f0 0x7f22cc09e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:32.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.854+0000 7f22d2f49700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22cc09f940 con 0x7f22cc133ca0 2023-09-30T22:25:32.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.854+0000 7f22d2f49700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22cc06b4c0 con 0x7f22cc09d920 2023-09-30T22:25:32.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.854+0000 7f22d2f49700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc09a8f0 con 0x7f22cc09f0f0 2023-09-30T22:25:32.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.854+0000 7f22d0ce5700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f22cc09d920 0x7f22cc09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:32.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.854+0000 7f22cbfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22cc09f0f0 0x7f22cc09e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:32.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.854+0000 7f22d0ce5700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f22cc09d920 0x7f22cc09dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44884/0 (socket says 172.21.15.40:44884) 2023-09-30T22:25:32.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.854+0000 7f22d0ce5700 1 -- 172.21.15.40:0/4162421079 learned_addr learned my addr 172.21.15.40:0/4162421079 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:32.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.855+0000 7f22d0ce5700 1 -- 172.21.15.40:0/4162421079 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22cc09f0f0 msgr2=0x7f22cc09e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:32.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.855+0000 7f22d0ce5700 1 --2- 172.21.15.40:0/4162421079 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22cc09f0f0 0x7f22cc09e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.855+0000 7f22d0ce5700 1 -- 172.21.15.40:0/4162421079 >> v1:172.21.15.40:6789/0 conn(0x7f22cc133ca0 legacy=0x7f22cc134120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:32.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.855+0000 7f22d0ce5700 1 -- 172.21.15.40:0/4162421079 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22cc09f6e0 con 0x7f22cc09d920 2023-09-30T22:25:32.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.855+0000 7f22cb7fe700 1 -- 172.21.15.40:0/4162421079 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2391536126 0 0) 0x7f22cc09f940 con 0x7f22cc133ca0 2023-09-30T22:25:32.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.855+0000 7f22cbfff700 1 --2- 172.21.15.40:0/4162421079 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22cc09f0f0 0x7f22cc09e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:32.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.855+0000 7f22d0ce5700 1 --2- 172.21.15.40:0/4162421079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22cc09d920 0x7f22cc09dcf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f22c00098f0 tx=0x7f22c0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=540815656d4a7ca2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:32.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.855+0000 7f22cb7fe700 1 -- 172.21.15.40:0/4162421079 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c0005e30 con 0x7f22cc09d920 2023-09-30T22:25:32.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.855+0000 7f22cb7fe700 1 -- 172.21.15.40:0/4162421079 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c0004030 con 0x7f22cc09d920 2023-09-30T22:25:32.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.855+0000 7f22cb7fe700 1 -- 172.21.15.40:0/4162421079 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c00043e0 con 0x7f22cc09d920 2023-09-30T22:25:32.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.856+0000 7f22d2f49700 1 -- 172.21.15.40:0/4162421079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22cc09d920 msgr2=0x7f22cc09dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:32.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.856+0000 7f22d2f49700 1 --2- 172.21.15.40:0/4162421079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22cc09d920 0x7f22cc09dcf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f22c00098f0 tx=0x7f22c0009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:32.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.856+0000 7f22d2f49700 1 -- 172.21.15.40:0/4162421079 shutdown_connections 2023-09-30T22:25:32.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.856+0000 7f22d2f49700 1 --2- 172.21.15.40:0/4162421079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22cc09d920 0x7f22cc09dcf0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.856+0000 7f22d2f49700 1 --2- 172.21.15.40:0/4162421079 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22cc09f0f0 0x7f22cc09e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.856+0000 7f22d2f49700 1 -- 172.21.15.40:0/4162421079 >> 172.21.15.40:0/4162421079 conn(0x7f22cc09fb20 msgr2=0x7f22cc09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:32.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.856+0000 7f22d2f49700 1 -- 172.21.15.40:0/4162421079 shutdown_connections 2023-09-30T22:25:32.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.856+0000 7f22d2f49700 1 -- 172.21.15.40:0/4162421079 wait complete. 2023-09-30T22:25:32.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.857+0000 7f22d2f49700 1 Processor -- start 2023-09-30T22:25:32.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.857+0000 7f22d2f49700 1 -- start start 2023-09-30T22:25:32.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.857+0000 7f22d2f49700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22cc09d920 0x7f22cc11e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:32.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.857+0000 7f22d2f49700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22cc133ca0 0x7f22cc11eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:32.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.857+0000 7f22d2f49700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22cc11f030 0x7f22cc1ceb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:32.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.857+0000 7f22d2f49700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc122080 con 0x7f22cc11f030 2023-09-30T22:25:32.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.857+0000 7f22d2f49700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc120790 con 0x7f22cc09d920 2023-09-30T22:25:32.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.857+0000 7f22d2f49700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc121810 con 0x7f22cc133ca0 2023-09-30T22:25:32.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.858+0000 7f22d0ce5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22cc09d920 0x7f22cc11e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:32.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.858+0000 7f22d0ce5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22cc09d920 0x7f22cc11e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39418/0 (socket says 172.21.15.40:39418) 2023-09-30T22:25:32.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.858+0000 7f22d0ce5700 1 -- 172.21.15.40:0/3144668280 learned_addr learned my addr 172.21.15.40:0/3144668280 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:32.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.858+0000 7f22d14e6700 1 --2- 172.21.15.40:0/3144668280 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22cc11f030 0x7f22cc1ceb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:32.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.858+0000 7f22cbfff700 1 --2- 172.21.15.40:0/3144668280 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22cc133ca0 0x7f22cc11eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:32.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.858+0000 7f22d0ce5700 1 -- 172.21.15.40:0/3144668280 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22cc133ca0 msgr2=0x7f22cc11eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:32.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.858+0000 7f22d0ce5700 1 --2- 172.21.15.40:0/3144668280 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22cc133ca0 0x7f22cc11eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.858+0000 7f22d0ce5700 1 -- 172.21.15.40:0/3144668280 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22cc11f030 msgr2=0x7f22cc1ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:32.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.858+0000 7f22d0ce5700 1 --2- 172.21.15.40:0/3144668280 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22cc11f030 0x7f22cc1ceb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.858+0000 7f22d0ce5700 1 -- 172.21.15.40:0/3144668280 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b80094a0 con 0x7f22cc09d920 2023-09-30T22:25:32.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.858+0000 7f22d0ce5700 1 --2- 172.21.15.40:0/3144668280 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22cc09d920 0x7f22cc11e5b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f22c0000c00 tx=0x7f22c0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:32.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.858+0000 7f22c97fa700 1 -- 172.21.15.40:0/3144668280 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c001c420 con 0x7f22cc09d920 2023-09-30T22:25:32.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.858+0000 7f22c97fa700 1 -- 172.21.15.40:0/3144668280 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c001c5a0 con 0x7f22cc09d920 2023-09-30T22:25:32.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.858+0000 7f22d2f49700 1 -- 172.21.15.40:0/3144668280 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22c0009500 con 0x7f22cc09d920 2023-09-30T22:25:32.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.858+0000 7f22c97fa700 1 -- 172.21.15.40:0/3144668280 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c001c950 con 0x7f22cc09d920 2023-09-30T22:25:32.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.858+0000 7f22d2f49700 1 -- 172.21.15.40:0/3144668280 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22cc0a2460 con 0x7f22cc09d920 2023-09-30T22:25:32.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.859+0000 7f22c97fa700 1 -- 172.21.15.40:0/3144668280 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f22c001cab0 con 0x7f22cc09d920 2023-09-30T22:25:32.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.859+0000 7f22d2f49700 1 -- 172.21.15.40:0/3144668280 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22cc06f6f0 con 0x7f22cc09d920 2023-09-30T22:25:32.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.860+0000 7f22c97fa700 1 -- 172.21.15.40:0/3144668280 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f22c0040810 con 0x7f22cc09d920 2023-09-30T22:25:32.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.865+0000 7f22c97fa700 1 -- 172.21.15.40:0/3144668280 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f22c001cd60 con 0x7f22cc09d920 2023-09-30T22:25:32.949 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:32.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.982+0000 7f5bf0a03700 1 Processor -- start 2023-09-30T22:25:32.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.982+0000 7f5bf0a03700 1 -- start start 2023-09-30T22:25:32.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.982+0000 7f5bf0a03700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5bec09d8b0 0x7f5bec09dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:32.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.982+0000 7f5bf0a03700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bec09e1c0 0x7f5bec130770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:32.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.982+0000 7f5bf0a03700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bec130cb0 0x7f5bec131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:32.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.982+0000 7f5bf0a03700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bec09f2f0 con 0x7f5bec09d8b0 2023-09-30T22:25:32.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.982+0000 7f5bf0a03700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec09b160 con 0x7f5bec09e1c0 2023-09-30T22:25:32.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.982+0000 7f5bf0a03700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec09ab30 con 0x7f5bec130cb0 2023-09-30T22:25:32.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.982+0000 7f5beb59e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bec130cb0 0x7f5bec131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:32.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.982+0000 7f5bea59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bec09e1c0 0x7f5bec130770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:32.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.982+0000 7f5beb59e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bec130cb0 0x7f5bec131130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48448/0 (socket says 172.21.15.40:48448) 2023-09-30T22:25:32.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.982+0000 7f5bea59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bec09e1c0 0x7f5bec130770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39422/0 (socket says 172.21.15.40:39422) 2023-09-30T22:25:32.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.982+0000 7f5beb59e700 1 -- 172.21.15.40:0/1571064599 learned_addr learned my addr 172.21.15.40:0/1571064599 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:32.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.983+0000 7f5bead9d700 1 --2- 172.21.15.40:0/1571064599 >> v2:172.21.15.40:3300/0 conn(0x7f5bec09d8b0 0x7f5bec09dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:32.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.983+0000 7f5bea59c700 1 -- 172.21.15.40:0/1571064599 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bec130cb0 msgr2=0x7f5bec131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:32.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.983+0000 7f5bea59c700 1 --2- 172.21.15.40:0/1571064599 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bec130cb0 0x7f5bec131130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.983+0000 7f5bea59c700 1 -- 172.21.15.40:0/1571064599 >> v2:172.21.15.40:3300/0 conn(0x7f5bec09d8b0 msgr2=0x7f5bec09dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:32.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.983+0000 7f5bea59c700 1 --2- 172.21.15.40:0/1571064599 >> v2:172.21.15.40:3300/0 conn(0x7f5bec09d8b0 0x7f5bec09dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.983+0000 7f5bea59c700 1 -- 172.21.15.40:0/1571064599 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec09c700 con 0x7f5bec09e1c0 2023-09-30T22:25:32.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.983+0000 7f5beb59e700 1 --2- 172.21.15.40:0/1571064599 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bec130cb0 0x7f5bec131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:32.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.983+0000 7f5bea59c700 1 --2- 172.21.15.40:0/1571064599 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bec09e1c0 0x7f5bec130770 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5be0009840 tx=0x7f5be0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0e6e4e649e2e0c7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:32.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.983+0000 7f5be9d9b700 1 -- 172.21.15.40:0/1571064599 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be0011830 con 0x7f5bec09e1c0 2023-09-30T22:25:32.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.983+0000 7f5be9d9b700 1 -- 172.21.15.40:0/1571064599 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be0011990 con 0x7f5bec09e1c0 2023-09-30T22:25:32.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.983+0000 7f5be9d9b700 1 -- 172.21.15.40:0/1571064599 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be0011d20 con 0x7f5bec09e1c0 2023-09-30T22:25:32.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.984+0000 7f5bf0a03700 1 -- 172.21.15.40:0/1571064599 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bec09e1c0 msgr2=0x7f5bec130770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:32.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.984+0000 7f5bf0a03700 1 --2- 172.21.15.40:0/1571064599 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bec09e1c0 0x7f5bec130770 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5be0009840 tx=0x7f5be0009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:32.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.984+0000 7f5bf0a03700 1 -- 172.21.15.40:0/1571064599 shutdown_connections 2023-09-30T22:25:32.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.984+0000 7f5bf0a03700 1 --2- 172.21.15.40:0/1571064599 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bec130cb0 0x7f5bec131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.984+0000 7f5bf0a03700 1 --2- 172.21.15.40:0/1571064599 >> v2:172.21.15.40:3300/0 conn(0x7f5bec09d8b0 0x7f5bec09dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.984+0000 7f5bf0a03700 1 --2- 172.21.15.40:0/1571064599 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bec09e1c0 0x7f5bec130770 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.984+0000 7f5bf0a03700 1 -- 172.21.15.40:0/1571064599 >> 172.21.15.40:0/1571064599 conn(0x7f5bec0a2fb0 msgr2=0x7f5bec0a33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:32.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.984+0000 7f5bf0a03700 1 -- 172.21.15.40:0/1571064599 shutdown_connections 2023-09-30T22:25:32.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.984+0000 7f5bf0a03700 1 -- 172.21.15.40:0/1571064599 wait complete. 2023-09-30T22:25:32.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.985+0000 7f5bf0a03700 1 Processor -- start 2023-09-30T22:25:32.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.985+0000 7f5bf0a03700 1 -- start start 2023-09-30T22:25:32.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.986+0000 7f5bf0a03700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bec09d8b0 0x7f5bec120190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:32.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.986+0000 7f5bf0a03700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bec09e1c0 0x7f5bec1206d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:32.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.986+0000 7f5bf0a03700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bec130cb0 0x7f5bec120c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:32.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.986+0000 7f5bf0a03700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec121660 con 0x7f5bec09d8b0 2023-09-30T22:25:32.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.986+0000 7f5bf0a03700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec122f60 con 0x7f5bec130cb0 2023-09-30T22:25:32.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.986+0000 7f5bf0a03700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec121e90 con 0x7f5bec09e1c0 2023-09-30T22:25:32.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.986+0000 7f5bead9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bec09d8b0 0x7f5bec120190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:32.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.986+0000 7f5bead9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bec09d8b0 0x7f5bec120190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44920/0 (socket says 172.21.15.40:44920) 2023-09-30T22:25:32.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.986+0000 7f5bead9d700 1 -- 172.21.15.40:0/2062770691 learned_addr learned my addr 172.21.15.40:0/2062770691 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:32.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.986+0000 7f5bea59c700 1 --2- 172.21.15.40:0/2062770691 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bec09e1c0 0x7f5bec1206d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:32.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.986+0000 7f5beb59e700 1 --2- 172.21.15.40:0/2062770691 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bec130cb0 0x7f5bec120c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:32.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.986+0000 7f5bead9d700 1 -- 172.21.15.40:0/2062770691 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bec09e1c0 msgr2=0x7f5bec1206d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:32.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.986+0000 7f5bead9d700 1 --2- 172.21.15.40:0/2062770691 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bec09e1c0 0x7f5bec1206d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.986+0000 7f5bead9d700 1 -- 172.21.15.40:0/2062770691 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bec130cb0 msgr2=0x7f5bec120c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:32.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.986+0000 7f5bead9d700 1 --2- 172.21.15.40:0/2062770691 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bec130cb0 0x7f5bec120c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.986+0000 7f5bead9d700 1 -- 172.21.15.40:0/2062770691 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be4009b30 con 0x7f5bec09d8b0 2023-09-30T22:25:32.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.986+0000 7f5bea59c700 1 --2- 172.21.15.40:0/2062770691 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bec09e1c0 0x7f5bec1206d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:32.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.986+0000 7f5beb59e700 1 --2- 172.21.15.40:0/2062770691 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bec130cb0 0x7f5bec120c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:32.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.987+0000 7f5bead9d700 1 --2- 172.21.15.40:0/2062770691 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bec09d8b0 0x7f5bec120190 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00e9e0 tx=0x7f5bdc00ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:32.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.987+0000 7f5bd37fe700 1 -- 172.21.15.40:0/2062770691 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc009710 con 0x7f5bec09d8b0 2023-09-30T22:25:32.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.987+0000 7f5bf0a03700 1 -- 172.21.15.40:0/2062770691 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be00094a0 con 0x7f5bec09d8b0 2023-09-30T22:25:32.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.987+0000 7f5bd37fe700 1 -- 172.21.15.40:0/2062770691 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bdc00c640 con 0x7f5bec09d8b0 2023-09-30T22:25:32.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.987+0000 7f5bd37fe700 1 -- 172.21.15.40:0/2062770691 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc00c9b0 con 0x7f5bec09d8b0 2023-09-30T22:25:32.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.987+0000 7f5bf0a03700 1 -- 172.21.15.40:0/2062770691 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bec123c70 con 0x7f5bec09d8b0 2023-09-30T22:25:32.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.988+0000 7f5bf0a03700 1 -- 172.21.15.40:0/2062770691 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bec09c920 con 0x7f5bec09d8b0 2023-09-30T22:25:32.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.988+0000 7f5bd37fe700 1 -- 172.21.15.40:0/2062770691 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5bdc00cd20 con 0x7f5bec09d8b0 2023-09-30T22:25:32.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.988+0000 7f5bd37fe700 1 -- 172.21.15.40:0/2062770691 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5bdc03f800 con 0x7f5bec09d8b0 2023-09-30T22:25:32.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:32.993+0000 7f5bd37fe700 1 -- 172.21.15.40:0/2062770691 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5bdc013560 con 0x7f5bec09d8b0 2023-09-30T22:25:33.005 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:33.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.070+0000 7f22d2f49700 1 -- 172.21.15.40:0/3144668280 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f22cc121c20 con 0x7f22cc09d920 2023-09-30T22:25:33.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.070+0000 7f22c97fa700 1 -- 172.21.15.40:0/3144668280 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f22c002a070 con 0x7f22cc09d920 2023-09-30T22:25:33.071 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:33.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.074+0000 7f22d2f49700 1 -- 172.21.15.40:0/3144668280 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22cc09d920 msgr2=0x7f22cc11e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:33.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.074+0000 7f22d2f49700 1 --2- 172.21.15.40:0/3144668280 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22cc09d920 0x7f22cc11e5b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f22c0000c00 tx=0x7f22c0004750 comp rx=0 tx=0).stop 2023-09-30T22:25:33.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.074+0000 7f22d2f49700 1 -- 172.21.15.40:0/3144668280 shutdown_connections 2023-09-30T22:25:33.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.074+0000 7f22d2f49700 1 --2- 172.21.15.40:0/3144668280 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22cc11f030 0x7f22cc1ceb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.074+0000 7f22d2f49700 1 --2- 172.21.15.40:0/3144668280 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22cc09d920 0x7f22cc11e5b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.074+0000 7f22d2f49700 1 --2- 172.21.15.40:0/3144668280 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22cc133ca0 0x7f22cc11eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.074+0000 7f22d2f49700 1 -- 172.21.15.40:0/3144668280 >> 172.21.15.40:0/3144668280 conn(0x7f22cc09fb20 msgr2=0x7f22cc1331a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:33.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.075+0000 7f22d2f49700 1 -- 172.21.15.40:0/3144668280 shutdown_connections 2023-09-30T22:25:33.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.075+0000 7f22d2f49700 1 -- 172.21.15.40:0/3144668280 wait complete. 2023-09-30T22:25:33.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.086+0000 7f24c1a8a700 1 Processor -- start 2023-09-30T22:25:33.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.086+0000 7f24c1a8a700 1 -- start start 2023-09-30T22:25:33.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.087+0000 7f24c1a8a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f24bc09d920 0x7f24bc09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:33.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.087+0000 7f24c1a8a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f24bc09f0f0 0x7f24bc09e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:33.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.087+0000 7f24c1a8a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24bc09f940 con 0x7f24bc133ca0 2023-09-30T22:25:33.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.087+0000 7f24c1a8a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24bc06b4c0 con 0x7f24bc09f0f0 2023-09-30T22:25:33.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.087+0000 7f24c1a8a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24bc09a8f0 con 0x7f24bc09d920 2023-09-30T22:25:33.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.087+0000 7f24bb7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f24bc09d920 0x7f24bc09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:33.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.087+0000 7f24bb7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f24bc09d920 0x7f24bc09dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39442/0 (socket says 172.21.15.40:39442) 2023-09-30T22:25:33.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.087+0000 7f24bb7fe700 1 -- 172.21.15.40:0/1624820305 learned_addr learned my addr 172.21.15.40:0/1624820305 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:33.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.088+0000 7f24baffd700 1 --2- 172.21.15.40:0/1624820305 >> v2:172.21.15.40:3300/0 conn(0x7f24bc09f0f0 0x7f24bc09e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:33.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.088+0000 7f24bb7fe700 1 -- 172.21.15.40:0/1624820305 >> v2:172.21.15.40:3300/0 conn(0x7f24bc09f0f0 msgr2=0x7f24bc09e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:33.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.088+0000 7f24bb7fe700 1 --2- 172.21.15.40:0/1624820305 >> v2:172.21.15.40:3300/0 conn(0x7f24bc09f0f0 0x7f24bc09e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.088+0000 7f24bb7fe700 1 -- 172.21.15.40:0/1624820305 >> v1:172.21.15.40:6789/0 conn(0x7f24bc133ca0 legacy=0x7f24bc134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:33.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.088+0000 7f24bb7fe700 1 -- 172.21.15.40:0/1624820305 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24bc09f6e0 con 0x7f24bc09d920 2023-09-30T22:25:33.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.088+0000 7f24bb7fe700 1 --2- 172.21.15.40:0/1624820305 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f24bc09d920 0x7f24bc09dcf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f24ac006fd0 tx=0x7f24ac009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=383061be80017980 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:33.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.088+0000 7f24ba7fc700 1 -- 172.21.15.40:0/1624820305 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac005e30 con 0x7f24bc09d920 2023-09-30T22:25:33.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.088+0000 7f24ba7fc700 1 -- 172.21.15.40:0/1624820305 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24ac004030 con 0x7f24bc09d920 2023-09-30T22:25:33.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.088+0000 7f24ba7fc700 1 -- 172.21.15.40:0/1624820305 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac0043e0 con 0x7f24bc09d920 2023-09-30T22:25:33.091 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:33.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.089+0000 7f24c1a8a700 1 -- 172.21.15.40:0/1624820305 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f24bc09d920 msgr2=0x7f24bc09dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:33.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.089+0000 7f24c1a8a700 1 --2- 172.21.15.40:0/1624820305 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f24bc09d920 0x7f24bc09dcf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f24ac006fd0 tx=0x7f24ac009bd0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.089+0000 7f24c1a8a700 1 -- 172.21.15.40:0/1624820305 shutdown_connections 2023-09-30T22:25:33.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.089+0000 7f24c1a8a700 1 --2- 172.21.15.40:0/1624820305 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f24bc09d920 0x7f24bc09dcf0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.089+0000 7f24c1a8a700 1 --2- 172.21.15.40:0/1624820305 >> v2:172.21.15.40:3300/0 conn(0x7f24bc09f0f0 0x7f24bc09e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.089+0000 7f24c1a8a700 1 -- 172.21.15.40:0/1624820305 >> 172.21.15.40:0/1624820305 conn(0x7f24bc09fb20 msgr2=0x7f24bc09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:33.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.090+0000 7f24c1a8a700 1 -- 172.21.15.40:0/1624820305 shutdown_connections 2023-09-30T22:25:33.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.090+0000 7f24c1a8a700 1 -- 172.21.15.40:0/1624820305 wait complete. 2023-09-30T22:25:33.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.091+0000 7f24c1a8a700 1 Processor -- start 2023-09-30T22:25:33.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.091+0000 7f24c1a8a700 1 -- start start 2023-09-30T22:25:33.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.092+0000 7f24c1a8a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24bc09d920 0x7f24bc120870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:33.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.092+0000 7f24c1a8a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f24bc133ca0 0x7f24bc120db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:33.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.092+0000 7f24c1a8a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f24bc1212f0 0x7f24bc1cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:33.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.092+0000 7f24c1a8a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24bc0a2830 con 0x7f24bc09d920 2023-09-30T22:25:33.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.092+0000 7f24c1a8a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24bc1339e0 con 0x7f24bc133ca0 2023-09-30T22:25:33.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.092+0000 7f24c1a8a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24bc124170 con 0x7f24bc1212f0 2023-09-30T22:25:33.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.092+0000 7f24bb7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24bc09d920 0x7f24bc120870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:33.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.092+0000 7f24bb7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24bc09d920 0x7f24bc120870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44942/0 (socket says 172.21.15.40:44942) 2023-09-30T22:25:33.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.092+0000 7f24bb7fe700 1 -- 172.21.15.40:0/3296226822 learned_addr learned my addr 172.21.15.40:0/3296226822 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:33.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.092+0000 7f24baffd700 1 --2- 172.21.15.40:0/3296226822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f24bc133ca0 0x7f24bc120db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:33.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.092+0000 7f24baffd700 1 -- 172.21.15.40:0/3296226822 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f24bc1212f0 msgr2=0x7f24bc1cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:33.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.092+0000 7f24baffd700 1 --2- 172.21.15.40:0/3296226822 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f24bc1212f0 0x7f24bc1cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.092+0000 7f24baffd700 1 -- 172.21.15.40:0/3296226822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24bc09d920 msgr2=0x7f24bc120870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:33.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.092+0000 7f24baffd700 1 --2- 172.21.15.40:0/3296226822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24bc09d920 0x7f24bc120870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.092+0000 7f24baffd700 1 -- 172.21.15.40:0/3296226822 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ac009500 con 0x7f24bc133ca0 2023-09-30T22:25:33.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.092+0000 7f24bb7fe700 1 --2- 172.21.15.40:0/3296226822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24bc09d920 0x7f24bc120870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:33.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.093+0000 7f24baffd700 1 --2- 172.21.15.40:0/3296226822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f24bc133ca0 0x7f24bc120db0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f24bc06b7b0 tx=0x7f24b000ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:33.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.093+0000 7f24a3fff700 1 -- 172.21.15.40:0/3296226822 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b0013680 con 0x7f24bc133ca0 2023-09-30T22:25:33.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.093+0000 7f24a3fff700 1 -- 172.21.15.40:0/3296226822 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b00137e0 con 0x7f24bc133ca0 2023-09-30T22:25:33.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.093+0000 7f24a3fff700 1 -- 172.21.15.40:0/3296226822 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b0013b50 con 0x7f24bc133ca0 2023-09-30T22:25:33.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.093+0000 7f24c1a8a700 1 -- 172.21.15.40:0/3296226822 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24bc09c9e0 con 0x7f24bc133ca0 2023-09-30T22:25:33.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.093+0000 7f24c1a8a700 1 -- 172.21.15.40:0/3296226822 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24bc122740 con 0x7f24bc133ca0 2023-09-30T22:25:33.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.094+0000 7f24a3fff700 1 -- 172.21.15.40:0/3296226822 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f24b0013cb0 con 0x7f24bc133ca0 2023-09-30T22:25:33.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.094+0000 7f24c1a8a700 1 -- 172.21.15.40:0/3296226822 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24bc123d80 con 0x7f24bc133ca0 2023-09-30T22:25:33.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.094+0000 7f24a3fff700 1 -- 172.21.15.40:0/3296226822 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f24b00421c0 con 0x7f24bc133ca0 2023-09-30T22:25:33.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.099+0000 7f24a3fff700 1 -- 172.21.15.40:0/3296226822 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f24bc123d80 con 0x7f24bc133ca0 2023-09-30T22:25:33.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.140+0000 7f500ecfc700 1 Processor -- start 2023-09-30T22:25:33.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.140+0000 7f500ecfc700 1 -- start start 2023-09-30T22:25:33.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.140+0000 7f500ecfc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f500809c890 0x7f500809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:33.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.140+0000 7f500ecfc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f500809d920 0x7f500809dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:33.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.140+0000 7f500ecfc700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50080a2600 con 0x7f500809e2b0 2023-09-30T22:25:33.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.140+0000 7f500ecfc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50080a29d0 con 0x7f500809d920 2023-09-30T22:25:33.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.140+0000 7f500ecfc700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f500809fb40 con 0x7f500809c890 2023-09-30T22:25:33.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.140+0000 7f5007fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f500809d920 0x7f500809dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:33.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.140+0000 7f5007fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f500809d920 0x7f500809dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39470/0 (socket says 172.21.15.40:39470) 2023-09-30T22:25:33.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.140+0000 7f5007fff700 1 -- 172.21.15.40:0/3913950190 learned_addr learned my addr 172.21.15.40:0/3913950190 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:33.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.140+0000 7f500ca98700 1 --2- 172.21.15.40:0/3913950190 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f500809c890 0x7f500809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:33.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.141+0000 7f5007fff700 1 -- 172.21.15.40:0/3913950190 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f500809c890 msgr2=0x7f500809cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:33.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.141+0000 7f5007fff700 1 --2- 172.21.15.40:0/3913950190 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f500809c890 0x7f500809cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.141+0000 7f5007fff700 1 -- 172.21.15.40:0/3913950190 >> v1:172.21.15.40:6789/0 conn(0x7f500809e2b0 legacy=0x7f500813ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:33.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.141+0000 7f5007fff700 1 -- 172.21.15.40:0/3913950190 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500809e720 con 0x7f500809d920 2023-09-30T22:25:33.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.141+0000 7f50077fe700 1 -- 172.21.15.40:0/3913950190 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2468689028 0 0) 0x7f50080a2600 con 0x7f500809e2b0 2023-09-30T22:25:33.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.141+0000 7f5007fff700 1 --2- 172.21.15.40:0/3913950190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f500809d920 0x7f500809dd70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4009920 tx=0x7f4ff4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f0bd399a6b47105 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:33.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.141+0000 7f50077fe700 1 -- 172.21.15.40:0/3913950190 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4011830 con 0x7f500809d920 2023-09-30T22:25:33.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.141+0000 7f50077fe700 1 -- 172.21.15.40:0/3913950190 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff4011990 con 0x7f500809d920 2023-09-30T22:25:33.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.141+0000 7f50077fe700 1 -- 172.21.15.40:0/3913950190 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4011d20 con 0x7f500809d920 2023-09-30T22:25:33.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.142+0000 7f500ecfc700 1 -- 172.21.15.40:0/3913950190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f500809d920 msgr2=0x7f500809dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:33.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.142+0000 7f500ecfc700 1 --2- 172.21.15.40:0/3913950190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f500809d920 0x7f500809dd70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4009920 tx=0x7f4ff4009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:33.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.142+0000 7f500ecfc700 1 -- 172.21.15.40:0/3913950190 shutdown_connections 2023-09-30T22:25:33.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.142+0000 7f500ecfc700 1 --2- 172.21.15.40:0/3913950190 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f500809c890 0x7f500809cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.142+0000 7f500ecfc700 1 --2- 172.21.15.40:0/3913950190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f500809d920 0x7f500809dd70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.142+0000 7f500ecfc700 1 -- 172.21.15.40:0/3913950190 >> 172.21.15.40:0/3913950190 conn(0x7f50080a7080 msgr2=0x7f50080a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:33.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.142+0000 7f500ecfc700 1 -- 172.21.15.40:0/3913950190 shutdown_connections 2023-09-30T22:25:33.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.142+0000 7f500ecfc700 1 -- 172.21.15.40:0/3913950190 wait complete. 2023-09-30T22:25:33.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.143+0000 7f500ecfc700 1 Processor -- start 2023-09-30T22:25:33.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.143+0000 7f500ecfc700 1 -- start start 2023-09-30T22:25:33.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.144+0000 7f500ecfc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f500809c890 0x7f500812cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:33.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.144+0000 7f500ecfc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f500809d920 0x7f500812d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:33.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.144+0000 7f500ecfc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f500809e2b0 0x7f500812da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:33.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.144+0000 7f500ecfc700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5008130770 con 0x7f500809d920 2023-09-30T22:25:33.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.144+0000 7f500ecfc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50080a5ab0 con 0x7f500809e2b0 2023-09-30T22:25:33.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.144+0000 7f500ecfc700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f500809ecf0 con 0x7f500809c890 2023-09-30T22:25:33.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.144+0000 7f5007fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f500809d920 0x7f500812d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:33.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.144+0000 7f5007fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f500809d920 0x7f500812d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44944/0 (socket says 172.21.15.40:44944) 2023-09-30T22:25:33.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.144+0000 7f5007fff700 1 -- 172.21.15.40:0/222535725 learned_addr learned my addr 172.21.15.40:0/222535725 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:33.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.144+0000 7f500ca98700 1 --2- 172.21.15.40:0/222535725 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f500809c890 0x7f500812cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:33.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.144+0000 7f500d299700 1 --2- 172.21.15.40:0/222535725 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f500809e2b0 0x7f500812da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:33.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.144+0000 7f5007fff700 1 -- 172.21.15.40:0/222535725 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f500809c890 msgr2=0x7f500812cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:33.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.144+0000 7f5007fff700 1 --2- 172.21.15.40:0/222535725 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f500809c890 0x7f500812cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.144+0000 7f5007fff700 1 -- 172.21.15.40:0/222535725 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f500809e2b0 msgr2=0x7f500812da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:33.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.144+0000 7f5007fff700 1 --2- 172.21.15.40:0/222535725 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f500809e2b0 0x7f500812da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.144+0000 7f5007fff700 1 -- 172.21.15.40:0/222535725 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff4009550 con 0x7f500809d920 2023-09-30T22:25:33.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.144+0000 7f500ca98700 1 --2- 172.21.15.40:0/222535725 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f500809c890 0x7f500812cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:33.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.145+0000 7f5007fff700 1 --2- 172.21.15.40:0/222535725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f500809d920 0x7f500812d4f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4009130 tx=0x7f4ff4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:33.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.145+0000 7f50057fa700 1 -- 172.21.15.40:0/222535725 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4004240 con 0x7f500809d920 2023-09-30T22:25:33.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.145+0000 7f500ecfc700 1 -- 172.21.15.40:0/222535725 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f500809c2b0 con 0x7f500809d920 2023-09-30T22:25:33.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.145+0000 7f500ecfc700 1 -- 172.21.15.40:0/222535725 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50081311e0 con 0x7f500809d920 2023-09-30T22:25:33.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.145+0000 7f50057fa700 1 -- 172.21.15.40:0/222535725 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff401f070 con 0x7f500809d920 2023-09-30T22:25:33.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.145+0000 7f50057fa700 1 -- 172.21.15.40:0/222535725 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff40045a0 con 0x7f500809d920 2023-09-30T22:25:33.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.146+0000 7f50057fa700 1 -- 172.21.15.40:0/222535725 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4ff4021030 con 0x7f500809d920 2023-09-30T22:25:33.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.146+0000 7f50057fa700 1 -- 172.21.15.40:0/222535725 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4ff4040500 con 0x7f500809d920 2023-09-30T22:25:33.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.146+0000 7f500ecfc700 1 -- 172.21.15.40:0/222535725 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fe80052e0 con 0x7f500809d920 2023-09-30T22:25:33.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.151+0000 7f50057fa700 1 -- 172.21.15.40:0/222535725 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4ff401a450 con 0x7f500809d920 2023-09-30T22:25:33.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.197+0000 7f5bf0a03700 1 -- 172.21.15.40:0/2062770691 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5bec123c70 con 0x7f5bec09d8b0 2023-09-30T22:25:33.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.197+0000 7f5bd37fe700 1 -- 172.21.15.40:0/2062770691 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5bec123c70 con 0x7f5bec09d8b0 2023-09-30T22:25:33.198 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:33.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.199+0000 7f5bf0a03700 1 -- 172.21.15.40:0/2062770691 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bec09d8b0 msgr2=0x7f5bec120190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:33.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.199+0000 7f5bf0a03700 1 --2- 172.21.15.40:0/2062770691 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bec09d8b0 0x7f5bec120190 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00e9e0 tx=0x7f5bdc00ecf0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.199+0000 7f5bf0a03700 1 -- 172.21.15.40:0/2062770691 shutdown_connections 2023-09-30T22:25:33.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.199+0000 7f5bf0a03700 1 --2- 172.21.15.40:0/2062770691 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bec130cb0 0x7f5bec120c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.199+0000 7f5bf0a03700 1 --2- 172.21.15.40:0/2062770691 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bec09d8b0 0x7f5bec120190 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.199+0000 7f5bf0a03700 1 --2- 172.21.15.40:0/2062770691 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bec09e1c0 0x7f5bec1206d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.199+0000 7f5bf0a03700 1 -- 172.21.15.40:0/2062770691 >> 172.21.15.40:0/2062770691 conn(0x7f5bec0a2fb0 msgr2=0x7f5bec0a1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:33.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.200+0000 7f5bf0a03700 1 -- 172.21.15.40:0/2062770691 shutdown_connections 2023-09-30T22:25:33.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.200+0000 7f5bf0a03700 1 -- 172.21.15.40:0/2062770691 wait complete. 2023-09-30T22:25:33.213 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:33.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.295+0000 7f24c1a8a700 1 -- 172.21.15.40:0/3296226822 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f24bc123d80 con 0x7f24bc133ca0 2023-09-30T22:25:33.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.295+0000 7f24a3fff700 1 -- 172.21.15.40:0/3296226822 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f24bc123d80 con 0x7f24bc133ca0 2023-09-30T22:25:33.296 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:33.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.298+0000 7f24c1a8a700 1 -- 172.21.15.40:0/3296226822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f24bc133ca0 msgr2=0x7f24bc120db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:33.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.298+0000 7f24c1a8a700 1 --2- 172.21.15.40:0/3296226822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f24bc133ca0 0x7f24bc120db0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f24bc06b7b0 tx=0x7f24b000ebb0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.298+0000 7f24c1a8a700 1 -- 172.21.15.40:0/3296226822 shutdown_connections 2023-09-30T22:25:33.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.298+0000 7f24c1a8a700 1 --2- 172.21.15.40:0/3296226822 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f24bc1212f0 0x7f24bc1cecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.298+0000 7f24c1a8a700 1 --2- 172.21.15.40:0/3296226822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24bc09d920 0x7f24bc120870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.298+0000 7f24c1a8a700 1 --2- 172.21.15.40:0/3296226822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f24bc133ca0 0x7f24bc120db0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.298+0000 7f24c1a8a700 1 -- 172.21.15.40:0/3296226822 >> 172.21.15.40:0/3296226822 conn(0x7f24bc09fb20 msgr2=0x7f24bc1ba8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:33.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.298+0000 7f24c1a8a700 1 -- 172.21.15.40:0/3296226822 shutdown_connections 2023-09-30T22:25:33.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.298+0000 7f24c1a8a700 1 -- 172.21.15.40:0/3296226822 wait complete. 2023-09-30T22:25:33.315 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:33.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.357+0000 7f500ecfc700 1 -- 172.21.15.40:0/222535725 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4fe8005590 con 0x7f500809d920 2023-09-30T22:25:33.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.357+0000 7f50057fa700 1 -- 172.21.15.40:0/222535725 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4ff4015030 con 0x7f500809d920 2023-09-30T22:25:33.358 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:33.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.359+0000 7f500ecfc700 1 -- 172.21.15.40:0/222535725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f500809d920 msgr2=0x7f500812d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:33.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.359+0000 7f500ecfc700 1 --2- 172.21.15.40:0/222535725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f500809d920 0x7f500812d4f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4009130 tx=0x7f4ff4004750 comp rx=0 tx=0).stop 2023-09-30T22:25:33.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.359+0000 7f500ecfc700 1 -- 172.21.15.40:0/222535725 shutdown_connections 2023-09-30T22:25:33.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.359+0000 7f500ecfc700 1 --2- 172.21.15.40:0/222535725 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f500809c890 0x7f500812cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.359+0000 7f500ecfc700 1 --2- 172.21.15.40:0/222535725 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f500809e2b0 0x7f500812da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.359+0000 7f500ecfc700 1 --2- 172.21.15.40:0/222535725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f500809d920 0x7f500812d4f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.359+0000 7f500ecfc700 1 -- 172.21.15.40:0/222535725 >> 172.21.15.40:0/222535725 conn(0x7f50080a7080 msgr2=0x7f5008132820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:33.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.359+0000 7f500ecfc700 1 -- 172.21.15.40:0/222535725 shutdown_connections 2023-09-30T22:25:33.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:33.359+0000 7f500ecfc700 1 -- 172.21.15.40:0/222535725 wait complete. 2023-09-30T22:25:33.372 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:34.092 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:34.213 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:34.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.232+0000 7fd85f7ee700 1 Processor -- start 2023-09-30T22:25:34.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.232+0000 7fd85f7ee700 1 -- start start 2023-09-30T22:25:34.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.232+0000 7fd85f7ee700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd85806b1b0 0x7fd858136af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.232+0000 7fd85f7ee700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd858137030 0x7fd858139410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.232+0000 7fd85f7ee700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd85809eb50 con 0x7fd85806a6d0 2023-09-30T22:25:34.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.232+0000 7fd85f7ee700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd85806b580 con 0x7fd858137030 2023-09-30T22:25:34.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.232+0000 7fd85f7ee700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd85809dde0 con 0x7fd85806b1b0 2023-09-30T22:25:34.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.232+0000 7fd85dd8b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd858137030 0x7fd858139410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.232+0000 7fd85cd89700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd85806b1b0 0x7fd858136af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.232+0000 7fd85cd89700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd85806b1b0 0x7fd858136af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55218/0 (socket says 172.21.15.40:55218) 2023-09-30T22:25:34.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.232+0000 7fd85dd8b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd858137030 0x7fd858139410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50886/0 (socket says 172.21.15.40:50886) 2023-09-30T22:25:34.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.232+0000 7fd85cd89700 1 -- 172.21.15.40:0/2039624397 learned_addr learned my addr 172.21.15.40:0/2039624397 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:34.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.233+0000 7fd85cd89700 1 -- 172.21.15.40:0/2039624397 >> v2:172.21.15.40:3300/0 conn(0x7fd858137030 msgr2=0x7fd858139410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:34.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.233+0000 7fd85cd89700 1 --2- 172.21.15.40:0/2039624397 >> v2:172.21.15.40:3300/0 conn(0x7fd858137030 0x7fd858139410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.233+0000 7fd85cd89700 1 -- 172.21.15.40:0/2039624397 >> v1:172.21.15.40:6789/0 conn(0x7fd85806a6d0 legacy=0x7fd85806aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.233+0000 7fd84ffff700 1 -- 172.21.15.40:0/2039624397 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2754199569 0 0) 0x7fd85809eb50 con 0x7fd85806a6d0 2023-09-30T22:25:34.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.233+0000 7fd85cd89700 1 -- 172.21.15.40:0/2039624397 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85809d4a0 con 0x7fd85806b1b0 2023-09-30T22:25:34.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.233+0000 7fd85dd8b700 1 --2- 172.21.15.40:0/2039624397 >> v2:172.21.15.40:3300/0 conn(0x7fd858137030 0x7fd858139410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:34.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.233+0000 7fd85cd89700 1 --2- 172.21.15.40:0/2039624397 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd85806b1b0 0x7fd858136af0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd8480098f0 tx=0x7fd848009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1adb3da4f3eb9de5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:34.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.233+0000 7fd84ffff700 1 -- 172.21.15.40:0/2039624397 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd848011830 con 0x7fd85806b1b0 2023-09-30T22:25:34.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.233+0000 7fd84ffff700 1 -- 172.21.15.40:0/2039624397 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd848011990 con 0x7fd85806b1b0 2023-09-30T22:25:34.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.233+0000 7fd84ffff700 1 -- 172.21.15.40:0/2039624397 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd848011d20 con 0x7fd85806b1b0 2023-09-30T22:25:34.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.234+0000 7fd85f7ee700 1 -- 172.21.15.40:0/2039624397 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd85806b1b0 msgr2=0x7fd858136af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.234+0000 7fd85f7ee700 1 --2- 172.21.15.40:0/2039624397 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd85806b1b0 0x7fd858136af0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd8480098f0 tx=0x7fd848009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:34.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.234+0000 7fd85f7ee700 1 -- 172.21.15.40:0/2039624397 shutdown_connections 2023-09-30T22:25:34.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.234+0000 7fd85f7ee700 1 --2- 172.21.15.40:0/2039624397 >> v2:172.21.15.40:3300/0 conn(0x7fd858137030 0x7fd858139410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.234+0000 7fd85f7ee700 1 --2- 172.21.15.40:0/2039624397 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd85806b1b0 0x7fd858136af0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.234+0000 7fd85f7ee700 1 -- 172.21.15.40:0/2039624397 >> 172.21.15.40:0/2039624397 conn(0x7fd85809fb20 msgr2=0x7fd85809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:34.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.234+0000 7fd85f7ee700 1 -- 172.21.15.40:0/2039624397 shutdown_connections 2023-09-30T22:25:34.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.234+0000 7fd85f7ee700 1 -- 172.21.15.40:0/2039624397 wait complete. 2023-09-30T22:25:34.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.235+0000 7fd85f7ee700 1 Processor -- start 2023-09-30T22:25:34.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.235+0000 7fd85f7ee700 1 -- start start 2023-09-30T22:25:34.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.236+0000 7fd85f7ee700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd85806a6d0 0x7fd85809ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.236+0000 7fd85f7ee700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd85806b1b0 0x7fd85809b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.236+0000 7fd85f7ee700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd858137030 0x7fd8581c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.236+0000 7fd85f7ee700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd858122270 con 0x7fd858137030 2023-09-30T22:25:34.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.236+0000 7fd85f7ee700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd85809aa10 con 0x7fd85806b1b0 2023-09-30T22:25:34.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.236+0000 7fd85f7ee700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd858122470 con 0x7fd85806a6d0 2023-09-30T22:25:34.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.236+0000 7fd85cd89700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd85806b1b0 0x7fd85809b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.236+0000 7fd85d58a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd85806a6d0 0x7fd85809ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.236+0000 7fd85cd89700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd85806b1b0 0x7fd85809b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60334/0 (socket says 172.21.15.40:60334) 2023-09-30T22:25:34.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.236+0000 7fd85cd89700 1 -- 172.21.15.40:0/2926586656 learned_addr learned my addr 172.21.15.40:0/2926586656 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:34.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.236+0000 7fd85dd8b700 1 --2- 172.21.15.40:0/2926586656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd858137030 0x7fd8581c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.236+0000 7fd85cd89700 1 -- 172.21.15.40:0/2926586656 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd85806a6d0 msgr2=0x7fd85809ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.236+0000 7fd85cd89700 1 --2- 172.21.15.40:0/2926586656 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd85806a6d0 0x7fd85809ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.236+0000 7fd85cd89700 1 -- 172.21.15.40:0/2926586656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd858137030 msgr2=0x7fd8581c8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.236+0000 7fd85cd89700 1 --2- 172.21.15.40:0/2926586656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd858137030 0x7fd8581c8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.236+0000 7fd85cd89700 1 -- 172.21.15.40:0/2926586656 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd850009a70 con 0x7fd85806b1b0 2023-09-30T22:25:34.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.236+0000 7fd85dd8b700 1 --2- 172.21.15.40:0/2926586656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd858137030 0x7fd8581c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:34.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.236+0000 7fd85cd89700 1 --2- 172.21.15.40:0/2926586656 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd85806b1b0 0x7fd85809b2c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd85809df20 tx=0x7fd848004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:34.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.236+0000 7fd84dffb700 1 -- 172.21.15.40:0/2926586656 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8480045d0 con 0x7fd85806b1b0 2023-09-30T22:25:34.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.237+0000 7fd84dffb700 1 -- 172.21.15.40:0/2926586656 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84801f070 con 0x7fd85806b1b0 2023-09-30T22:25:34.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.237+0000 7fd85f7ee700 1 -- 172.21.15.40:0/2926586656 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd848009550 con 0x7fd85806b1b0 2023-09-30T22:25:34.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.237+0000 7fd84dffb700 1 -- 172.21.15.40:0/2926586656 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8480038c0 con 0x7fd85806b1b0 2023-09-30T22:25:34.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.237+0000 7fd85f7ee700 1 -- 172.21.15.40:0/2926586656 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd85809c170 con 0x7fd85806b1b0 2023-09-30T22:25:34.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.237+0000 7fd84dffb700 1 -- 172.21.15.40:0/2926586656 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd848003a20 con 0x7fd85806b1b0 2023-09-30T22:25:34.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.238+0000 7fd84dffb700 1 -- 172.21.15.40:0/2926586656 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd848021070 con 0x7fd85806b1b0 2023-09-30T22:25:34.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.238+0000 7fd85f7ee700 1 -- 172.21.15.40:0/2926586656 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd85809c110 con 0x7fd85806b1b0 2023-09-30T22:25:34.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.243+0000 7fd84dffb700 1 -- 172.21.15.40:0/2926586656 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd848015020 con 0x7fd85806b1b0 2023-09-30T22:25:34.316 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:34.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.345+0000 7f86ebdd2700 1 Processor -- start 2023-09-30T22:25:34.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.345+0000 7f86ebdd2700 1 -- start start 2023-09-30T22:25:34.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.345+0000 7f86ebdd2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f86e4133e00 0x7f86e41341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.345+0000 7f86ebdd2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f86e409df40 0x7f86e413bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.345+0000 7f86ebdd2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e4133940 con 0x7f86e409d400 2023-09-30T22:25:34.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.345+0000 7f86ebdd2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e409ab20 con 0x7f86e409df40 2023-09-30T22:25:34.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.345+0000 7f86ebdd2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86e409f0d0 con 0x7f86e4133e00 2023-09-30T22:25:34.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.345+0000 7f86e9b6e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f86e4133e00 0x7f86e41341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.345+0000 7f86ea36f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f86e409df40 0x7f86e413bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.345+0000 7f86e936d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f86e409d400 0x7f86e409d830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45524/0 (socket says 172.21.15.40:45524) 2023-09-30T22:25:34.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.345+0000 7f86e936d700 1 -- 172.21.15.40:0/3207552270 learned_addr learned my addr 172.21.15.40:0/3207552270 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:34.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.346+0000 7f86e9b6e700 1 -- 172.21.15.40:0/3207552270 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f86e409df40 msgr2=0x7f86e413bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:34.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.346+0000 7f86e9b6e700 1 --2- 172.21.15.40:0/3207552270 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f86e409df40 0x7f86e413bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.346+0000 7f86e9b6e700 1 -- 172.21.15.40:0/3207552270 >> v1:172.21.15.40:6789/0 conn(0x7f86e409d400 legacy=0x7f86e409d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.346+0000 7f86e9b6e700 1 -- 172.21.15.40:0/3207552270 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e4133be0 con 0x7f86e4133e00 2023-09-30T22:25:34.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.346+0000 7f86ea36f700 1 --2- 172.21.15.40:0/3207552270 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f86e409df40 0x7f86e413bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:34.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.346+0000 7f86e9b6e700 1 --2- 172.21.15.40:0/3207552270 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f86e4133e00 0x7f86e41341d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f86e0009870 tx=0x7f86e0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1864a49d8d5488b3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:34.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.346+0000 7f86e8b6c700 1 -- 172.21.15.40:0/3207552270 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e0011830 con 0x7f86e4133e00 2023-09-30T22:25:34.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.346+0000 7f86e8b6c700 1 -- 172.21.15.40:0/3207552270 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e0011990 con 0x7f86e4133e00 2023-09-30T22:25:34.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.346+0000 7f86e8b6c700 1 -- 172.21.15.40:0/3207552270 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e0011d20 con 0x7f86e4133e00 2023-09-30T22:25:34.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.347+0000 7f86ebdd2700 1 -- 172.21.15.40:0/3207552270 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f86e4133e00 msgr2=0x7f86e41341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.347+0000 7f86ebdd2700 1 --2- 172.21.15.40:0/3207552270 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f86e4133e00 0x7f86e41341d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f86e0009870 tx=0x7f86e0009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:34.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.347+0000 7f86ebdd2700 1 -- 172.21.15.40:0/3207552270 shutdown_connections 2023-09-30T22:25:34.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.347+0000 7f86ebdd2700 1 --2- 172.21.15.40:0/3207552270 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f86e409df40 0x7f86e413bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.347+0000 7f86ebdd2700 1 --2- 172.21.15.40:0/3207552270 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f86e4133e00 0x7f86e41341d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.347+0000 7f86ebdd2700 1 -- 172.21.15.40:0/3207552270 >> 172.21.15.40:0/3207552270 conn(0x7f86e40a2a00 msgr2=0x7f86e40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:34.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.347+0000 7f86ebdd2700 1 -- 172.21.15.40:0/3207552270 shutdown_connections 2023-09-30T22:25:34.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.347+0000 7f86ebdd2700 1 -- 172.21.15.40:0/3207552270 wait complete. 2023-09-30T22:25:34.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.348+0000 7f86ebdd2700 1 Processor -- start 2023-09-30T22:25:34.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.348+0000 7f86ebdd2700 1 -- start start 2023-09-30T22:25:34.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.348+0000 7f86ebdd2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f86e409d400 0x7f86e4119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.348+0000 7f86ebdd2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86e409df40 0x7f86e4119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.348+0000 7f86ebdd2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f86e4133e00 0x7f86e4119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.348+0000 7f86ebdd2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e411a530 con 0x7f86e409df40 2023-09-30T22:25:34.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.348+0000 7f86ebdd2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e411ab30 con 0x7f86e4133e00 2023-09-30T22:25:34.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.348+0000 7f86ebdd2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86e411b760 con 0x7f86e409d400 2023-09-30T22:25:34.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.349+0000 7f86e936d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86e409df40 0x7f86e4119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.349+0000 7f86e936d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86e409df40 0x7f86e4119590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50910/0 (socket says 172.21.15.40:50910) 2023-09-30T22:25:34.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.349+0000 7f86ea36f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f86e4133e00 0x7f86e4119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.349+0000 7f86e936d700 1 -- 172.21.15.40:0/4042837046 learned_addr learned my addr 172.21.15.40:0/4042837046 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:34.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.349+0000 7f86e9b6e700 1 --2- 172.21.15.40:0/4042837046 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f86e409d400 0x7f86e4119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.349+0000 7f86e936d700 1 -- 172.21.15.40:0/4042837046 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f86e409d400 msgr2=0x7f86e4119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.349+0000 7f86e936d700 1 --2- 172.21.15.40:0/4042837046 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f86e409d400 0x7f86e4119050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.349+0000 7f86e936d700 1 -- 172.21.15.40:0/4042837046 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f86e4133e00 msgr2=0x7f86e4119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.349+0000 7f86e936d700 1 --2- 172.21.15.40:0/4042837046 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f86e4133e00 0x7f86e4119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.349+0000 7f86e936d700 1 -- 172.21.15.40:0/4042837046 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86dc009a70 con 0x7f86e409df40 2023-09-30T22:25:34.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.349+0000 7f86e936d700 1 --2- 172.21.15.40:0/4042837046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86e409df40 0x7f86e4119590 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f86d400c530 tx=0x7f86d400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:34.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.349+0000 7f86da7fc700 1 -- 172.21.15.40:0/4042837046 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d4005d70 con 0x7f86e409df40 2023-09-30T22:25:34.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.349+0000 7f86da7fc700 1 -- 172.21.15.40:0/4042837046 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d40070d0 con 0x7f86e409df40 2023-09-30T22:25:34.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.349+0000 7f86ebdd2700 1 -- 172.21.15.40:0/4042837046 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e00094a0 con 0x7f86e409df40 2023-09-30T22:25:34.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.349+0000 7f86da7fc700 1 -- 172.21.15.40:0/4042837046 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d4007440 con 0x7f86e409df40 2023-09-30T22:25:34.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.349+0000 7f86ebdd2700 1 -- 172.21.15.40:0/4042837046 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e411c190 con 0x7f86e409df40 2023-09-30T22:25:34.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.350+0000 7f86da7fc700 1 -- 172.21.15.40:0/4042837046 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f86d40075a0 con 0x7f86e409df40 2023-09-30T22:25:34.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.351+0000 7f86da7fc700 1 -- 172.21.15.40:0/4042837046 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f86d403e8c0 con 0x7f86e409df40 2023-09-30T22:25:34.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.351+0000 7f86ebdd2700 1 -- 172.21.15.40:0/4042837046 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e411c190 con 0x7f86e409df40 2023-09-30T22:25:34.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.361+0000 7f86da7fc700 1 -- 172.21.15.40:0/4042837046 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f86e411c190 con 0x7f86e409df40 2023-09-30T22:25:34.373 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:34.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.447+0000 7fd85f7ee700 1 -- 172.21.15.40:0/2926586656 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd858062380 con 0x7fd85806b1b0 2023-09-30T22:25:34.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.447+0000 7fd84dffb700 1 -- 172.21.15.40:0/2926586656 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd84800b7a0 con 0x7fd85806b1b0 2023-09-30T22:25:34.448 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:34.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.450+0000 7fd85f7ee700 1 -- 172.21.15.40:0/2926586656 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd85806b1b0 msgr2=0x7fd85809b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.450+0000 7fd85f7ee700 1 --2- 172.21.15.40:0/2926586656 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd85806b1b0 0x7fd85809b2c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd85809df20 tx=0x7fd848004750 comp rx=0 tx=0).stop 2023-09-30T22:25:34.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.450+0000 7fd85f7ee700 1 -- 172.21.15.40:0/2926586656 shutdown_connections 2023-09-30T22:25:34.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.450+0000 7fd85f7ee700 1 --2- 172.21.15.40:0/2926586656 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd85806a6d0 0x7fd85809ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.450+0000 7fd85f7ee700 1 --2- 172.21.15.40:0/2926586656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd858137030 0x7fd8581c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.450+0000 7fd85f7ee700 1 --2- 172.21.15.40:0/2926586656 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd85806b1b0 0x7fd85809b2c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.450+0000 7fd85f7ee700 1 -- 172.21.15.40:0/2926586656 >> 172.21.15.40:0/2926586656 conn(0x7fd85809fb20 msgr2=0x7fd858135f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:34.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.450+0000 7fd85f7ee700 1 -- 172.21.15.40:0/2926586656 shutdown_connections 2023-09-30T22:25:34.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.450+0000 7fd85f7ee700 1 -- 172.21.15.40:0/2926586656 wait complete. 2023-09-30T22:25:34.469 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:34.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.471+0000 7f3798ed7700 1 Processor -- start 2023-09-30T22:25:34.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.471+0000 7f3798ed7700 1 -- start start 2023-09-30T22:25:34.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.472+0000 7f3798ed7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f379409d920 0x7f379409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.472+0000 7f3798ed7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f379409e230 0x7f37941308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.472+0000 7f3798ed7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3794130de0 0x7f3794131260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.472+0000 7f3798ed7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f379409edf0 con 0x7f379409e230 2023-09-30T22:25:34.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.472+0000 7f3798ed7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f379409adf0 con 0x7f379409d920 2023-09-30T22:25:34.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.472+0000 7f3798ed7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f379409b660 con 0x7f3794130de0 2023-09-30T22:25:34.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.472+0000 7f3792d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3794130de0 0x7f3794131260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.472+0000 7f3791d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f379409e230 0x7f37941308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.472+0000 7f379259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f379409d920 0x7f379409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.472+0000 7f3792d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3794130de0 0x7f3794131260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55262/0 (socket says 172.21.15.40:55262) 2023-09-30T22:25:34.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.472+0000 7f3791d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f379409e230 0x7f37941308a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50924/0 (socket says 172.21.15.40:50924) 2023-09-30T22:25:34.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.472+0000 7f3792d9d700 1 -- 172.21.15.40:0/2661498515 learned_addr learned my addr 172.21.15.40:0/2661498515 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:34.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.473+0000 7f3791d9b700 1 -- 172.21.15.40:0/2661498515 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3794130de0 msgr2=0x7f3794131260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:34.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.473+0000 7f3791d9b700 1 --2- 172.21.15.40:0/2661498515 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3794130de0 0x7f3794131260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.473+0000 7f3791d9b700 1 -- 172.21.15.40:0/2661498515 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f379409d920 msgr2=0x7f379409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:34.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.473+0000 7f3791d9b700 1 --2- 172.21.15.40:0/2661498515 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f379409d920 0x7f379409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.473+0000 7f3791d9b700 1 -- 172.21.15.40:0/2661498515 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f379409a6e0 con 0x7f379409e230 2023-09-30T22:25:34.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.473+0000 7f3792d9d700 1 --2- 172.21.15.40:0/2661498515 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3794130de0 0x7f3794131260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:34.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.473+0000 7f379259c700 1 --2- 172.21.15.40:0/2661498515 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f379409d920 0x7f379409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:34.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.473+0000 7f3791d9b700 1 --2- 172.21.15.40:0/2661498515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f379409e230 0x7f37941308a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3788009840 tx=0x7f3788009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ad0e02e633fcfe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:34.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.473+0000 7f379159a700 1 -- 172.21.15.40:0/2661498515 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378800f8a0 con 0x7f379409e230 2023-09-30T22:25:34.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.473+0000 7f379159a700 1 -- 172.21.15.40:0/2661498515 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378800fa00 con 0x7f379409e230 2023-09-30T22:25:34.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.473+0000 7f379159a700 1 -- 172.21.15.40:0/2661498515 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378800fd90 con 0x7f379409e230 2023-09-30T22:25:34.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.474+0000 7f3798ed7700 1 -- 172.21.15.40:0/2661498515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f379409e230 msgr2=0x7f37941308a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.474+0000 7f3798ed7700 1 --2- 172.21.15.40:0/2661498515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f379409e230 0x7f37941308a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3788009840 tx=0x7f3788009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:34.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.474+0000 7f3798ed7700 1 -- 172.21.15.40:0/2661498515 shutdown_connections 2023-09-30T22:25:34.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.474+0000 7f3798ed7700 1 --2- 172.21.15.40:0/2661498515 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3794130de0 0x7f3794131260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.474+0000 7f3798ed7700 1 --2- 172.21.15.40:0/2661498515 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f379409d920 0x7f379409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.474+0000 7f3798ed7700 1 --2- 172.21.15.40:0/2661498515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f379409e230 0x7f37941308a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.474+0000 7f3798ed7700 1 -- 172.21.15.40:0/2661498515 >> 172.21.15.40:0/2661498515 conn(0x7f379409fb20 msgr2=0x7f379409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:34.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.474+0000 7f3798ed7700 1 -- 172.21.15.40:0/2661498515 shutdown_connections 2023-09-30T22:25:34.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.474+0000 7f3798ed7700 1 -- 172.21.15.40:0/2661498515 wait complete. 2023-09-30T22:25:34.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.475+0000 7f3798ed7700 1 Processor -- start 2023-09-30T22:25:34.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.475+0000 7f3798ed7700 1 -- start start 2023-09-30T22:25:34.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.475+0000 7f3798ed7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f379409d920 0x7f379411db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.475+0000 7f3798ed7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f379409e230 0x7f379411e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.475+0000 7f3798ed7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3794130de0 0x7f379411e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.475+0000 7f3798ed7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379412c580 con 0x7f379409d920 2023-09-30T22:25:34.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.475+0000 7f3798ed7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3794120750 con 0x7f3794130de0 2023-09-30T22:25:34.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.475+0000 7f3798ed7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3794121660 con 0x7f379409e230 2023-09-30T22:25:34.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.476+0000 7f379259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f379409d920 0x7f379411db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.476+0000 7f379259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f379409d920 0x7f379411db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50934/0 (socket says 172.21.15.40:50934) 2023-09-30T22:25:34.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.476+0000 7f379259c700 1 -- 172.21.15.40:0/1856043133 learned_addr learned my addr 172.21.15.40:0/1856043133 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:34.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.476+0000 7f3791d9b700 1 --2- 172.21.15.40:0/1856043133 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f379409e230 0x7f379411e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.476+0000 7f3792d9d700 1 --2- 172.21.15.40:0/1856043133 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3794130de0 0x7f379411e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.476+0000 7f3791d9b700 1 -- 172.21.15.40:0/1856043133 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3794130de0 msgr2=0x7f379411e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.476+0000 7f3791d9b700 1 --2- 172.21.15.40:0/1856043133 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3794130de0 0x7f379411e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.476+0000 7f3791d9b700 1 -- 172.21.15.40:0/1856043133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f379409d920 msgr2=0x7f379411db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.476+0000 7f3791d9b700 1 --2- 172.21.15.40:0/1856043133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f379409d920 0x7f379411db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.476+0000 7f3791d9b700 1 -- 172.21.15.40:0/1856043133 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3784009430 con 0x7f379409e230 2023-09-30T22:25:34.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.476+0000 7f379259c700 1 --2- 172.21.15.40:0/1856043133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f379409d920 0x7f379411db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:34.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.476+0000 7f3791d9b700 1 --2- 172.21.15.40:0/1856043133 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f379409e230 0x7f379411e080 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3788018000 tx=0x7f3788004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:34.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.476+0000 7f3782ffd700 1 -- 172.21.15.40:0/1856043133 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37880038a0 con 0x7f379409e230 2023-09-30T22:25:34.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.476+0000 7f3782ffd700 1 -- 172.21.15.40:0/1856043133 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3788003a20 con 0x7f379409e230 2023-09-30T22:25:34.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.476+0000 7f3782ffd700 1 -- 172.21.15.40:0/1856043133 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3788003dd0 con 0x7f379409e230 2023-09-30T22:25:34.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.476+0000 7f3798ed7700 1 -- 172.21.15.40:0/1856043133 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f378c009b30 con 0x7f379409e230 2023-09-30T22:25:34.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.477+0000 7f3798ed7700 1 -- 172.21.15.40:0/1856043133 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37880094a0 con 0x7f379409e230 2023-09-30T22:25:34.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.477+0000 7f3782ffd700 1 -- 172.21.15.40:0/1856043133 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f378802c430 con 0x7f379409e230 2023-09-30T22:25:34.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.478+0000 7f3782ffd700 1 -- 172.21.15.40:0/1856043133 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3788040870 con 0x7f379409e230 2023-09-30T22:25:34.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.478+0000 7f3798ed7700 1 -- 172.21.15.40:0/1856043133 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3794120480 con 0x7f379409e230 2023-09-30T22:25:34.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.483+0000 7f3782ffd700 1 -- 172.21.15.40:0/1856043133 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f37880178f0 con 0x7f379409e230 2023-09-30T22:25:34.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.504+0000 7fbb76a81700 1 Processor -- start 2023-09-30T22:25:34.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.504+0000 7fbb76a81700 1 -- start start 2023-09-30T22:25:34.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.504+0000 7fbb76a81700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb7009c890 0x7fbb7009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.504+0000 7fbb76a81700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbb7009d920 0x7fbb7009dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.504+0000 7fbb76a81700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbb7009e2b0 0x7fbb7013ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.505+0000 7fbb76a81700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb700a29d0 con 0x7fbb7009d920 2023-09-30T22:25:34.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.505+0000 7fbb76a81700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7009fb40 con 0x7fbb7009c890 2023-09-30T22:25:34.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.505+0000 7fbb76a81700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb700a2600 con 0x7fbb7009e2b0 2023-09-30T22:25:34.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.505+0000 7fbb7481d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb7009c890 0x7fbb7009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.505+0000 7fbb7481d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb7009c890 0x7fbb7009cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60386/0 (socket says 172.21.15.40:60386) 2023-09-30T22:25:34.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.505+0000 7fbb7481d700 1 -- 172.21.15.40:0/97761539 learned_addr learned my addr 172.21.15.40:0/97761539 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:34.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.505+0000 7fbb7501e700 1 --2- 172.21.15.40:0/97761539 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbb7009e2b0 0x7fbb7013ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.505+0000 7fbb7481d700 1 -- 172.21.15.40:0/97761539 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbb7009e2b0 msgr2=0x7fbb7013ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:34.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.505+0000 7fbb7481d700 1 --2- 172.21.15.40:0/97761539 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbb7009e2b0 0x7fbb7013ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.505+0000 7fbb7481d700 1 -- 172.21.15.40:0/97761539 >> v2:172.21.15.40:3300/0 conn(0x7fbb7009d920 msgr2=0x7fbb7009dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:34.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.505+0000 7fbb7481d700 1 --2- 172.21.15.40:0/97761539 >> v2:172.21.15.40:3300/0 conn(0x7fbb7009d920 0x7fbb7009dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.505+0000 7fbb7481d700 1 -- 172.21.15.40:0/97761539 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb7009e750 con 0x7fbb7009c890 2023-09-30T22:25:34.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.505+0000 7fbb7501e700 1 --2- 172.21.15.40:0/97761539 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbb7009e2b0 0x7fbb7013ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:34.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.505+0000 7fbb7481d700 1 --2- 172.21.15.40:0/97761539 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb7009c890 0x7fbb7009cc60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbb64006fd0 tx=0x7fbb64009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97471c721e1ef5ab server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:34.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.505+0000 7fbb6f7fe700 1 -- 172.21.15.40:0/97761539 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb64005e30 con 0x7fbb7009c890 2023-09-30T22:25:34.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.506+0000 7fbb6f7fe700 1 -- 172.21.15.40:0/97761539 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb64004030 con 0x7fbb7009c890 2023-09-30T22:25:34.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.506+0000 7fbb6f7fe700 1 -- 172.21.15.40:0/97761539 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb640043e0 con 0x7fbb7009c890 2023-09-30T22:25:34.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.506+0000 7fbb76a81700 1 -- 172.21.15.40:0/97761539 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb7009c890 msgr2=0x7fbb7009cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.506+0000 7fbb76a81700 1 --2- 172.21.15.40:0/97761539 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb7009c890 0x7fbb7009cc60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbb64006fd0 tx=0x7fbb64009bd0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.506+0000 7fbb76a81700 1 -- 172.21.15.40:0/97761539 shutdown_connections 2023-09-30T22:25:34.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.506+0000 7fbb76a81700 1 --2- 172.21.15.40:0/97761539 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbb7009e2b0 0x7fbb7013ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.506+0000 7fbb76a81700 1 --2- 172.21.15.40:0/97761539 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb7009c890 0x7fbb7009cc60 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.506+0000 7fbb76a81700 1 --2- 172.21.15.40:0/97761539 >> v2:172.21.15.40:3300/0 conn(0x7fbb7009d920 0x7fbb7009dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.506+0000 7fbb76a81700 1 -- 172.21.15.40:0/97761539 >> 172.21.15.40:0/97761539 conn(0x7fbb700a7080 msgr2=0x7fbb700a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:34.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.506+0000 7fbb76a81700 1 -- 172.21.15.40:0/97761539 shutdown_connections 2023-09-30T22:25:34.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.506+0000 7fbb76a81700 1 -- 172.21.15.40:0/97761539 wait complete. 2023-09-30T22:25:34.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.507+0000 7fbb76a81700 1 Processor -- start 2023-09-30T22:25:34.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.508+0000 7fbb76a81700 1 -- start start 2023-09-30T22:25:34.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.508+0000 7fbb76a81700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbb7009c890 0x7fbb701c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.508+0000 7fbb76a81700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb7009d920 0x7fbb701c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.508+0000 7fbb76a81700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb7009e2b0 0x7fbb701c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.508+0000 7fbb76a81700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7009ecf0 con 0x7fbb7009e2b0 2023-09-30T22:25:34.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.508+0000 7fbb76a81700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb70130620 con 0x7fbb7009d920 2023-09-30T22:25:34.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.508+0000 7fbb76a81700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb70130df0 con 0x7fbb7009c890 2023-09-30T22:25:34.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.509+0000 7fbb7481d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbb7009c890 0x7fbb701c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.509+0000 7fbb7481d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbb7009c890 0x7fbb701c89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55288/0 (socket says 172.21.15.40:55288) 2023-09-30T22:25:34.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.509+0000 7fbb7481d700 1 -- 172.21.15.40:0/899305993 learned_addr learned my addr 172.21.15.40:0/899305993 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:34.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.509+0000 7fbb7501e700 1 --2- 172.21.15.40:0/899305993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb7009e2b0 0x7fbb701c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.509+0000 7fbb6ffff700 1 --2- 172.21.15.40:0/899305993 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb7009d920 0x7fbb701c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.509+0000 7fbb7481d700 1 -- 172.21.15.40:0/899305993 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb7009d920 msgr2=0x7fbb701c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.509+0000 7fbb7481d700 1 --2- 172.21.15.40:0/899305993 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb7009d920 0x7fbb701c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.509+0000 7fbb7481d700 1 -- 172.21.15.40:0/899305993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb7009e2b0 msgr2=0x7fbb701c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.509+0000 7fbb7481d700 1 --2- 172.21.15.40:0/899305993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb7009e2b0 0x7fbb701c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.509+0000 7fbb7481d700 1 -- 172.21.15.40:0/899305993 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb64009500 con 0x7fbb7009c890 2023-09-30T22:25:34.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.509+0000 7fbb7481d700 1 --2- 172.21.15.40:0/899305993 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbb7009c890 0x7fbb701c89e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbb64009130 tx=0x7fbb64004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:34.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.509+0000 7fbb6d7fa700 1 -- 172.21.15.40:0/899305993 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb64003cf0 con 0x7fbb7009c890 2023-09-30T22:25:34.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.509+0000 7fbb6d7fa700 1 -- 172.21.15.40:0/899305993 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb64003e70 con 0x7fbb7009c890 2023-09-30T22:25:34.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.509+0000 7fbb76a81700 1 -- 172.21.15.40:0/899305993 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb700a5d80 con 0x7fbb7009c890 2023-09-30T22:25:34.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.509+0000 7fbb6d7fa700 1 -- 172.21.15.40:0/899305993 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6401d650 con 0x7fbb7009c890 2023-09-30T22:25:34.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.509+0000 7fbb76a81700 1 -- 172.21.15.40:0/899305993 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb7012fd00 con 0x7fbb7009c890 2023-09-30T22:25:34.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.510+0000 7fbb6d7fa700 1 -- 172.21.15.40:0/899305993 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbb6401d7b0 con 0x7fbb7009c890 2023-09-30T22:25:34.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.510+0000 7fbb76a81700 1 -- 172.21.15.40:0/899305993 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb701307b0 con 0x7fbb7009c890 2023-09-30T22:25:34.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.511+0000 7fbb6d7fa700 1 -- 172.21.15.40:0/899305993 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fbb64040ea0 con 0x7fbb7009c890 2023-09-30T22:25:34.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.515+0000 7fbb6d7fa700 1 -- 172.21.15.40:0/899305993 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbb64016070 con 0x7fbb7009c890 2023-09-30T22:25:34.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.601+0000 7f86ebdd2700 1 -- 172.21.15.40:0/4042837046 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f86e411c190 con 0x7f86e409df40 2023-09-30T22:25:34.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.601+0000 7f86da7fc700 1 -- 172.21.15.40:0/4042837046 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f86e411c190 con 0x7f86e409df40 2023-09-30T22:25:34.602 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:34.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.603+0000 7f86ebdd2700 1 -- 172.21.15.40:0/4042837046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86e409df40 msgr2=0x7f86e4119590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.603+0000 7f86ebdd2700 1 --2- 172.21.15.40:0/4042837046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86e409df40 0x7f86e4119590 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f86d400c530 tx=0x7f86d400c840 comp rx=0 tx=0).stop 2023-09-30T22:25:34.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.603+0000 7f86ebdd2700 1 -- 172.21.15.40:0/4042837046 shutdown_connections 2023-09-30T22:25:34.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.604+0000 7f86ebdd2700 1 --2- 172.21.15.40:0/4042837046 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f86e409d400 0x7f86e4119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.604+0000 7f86ebdd2700 1 --2- 172.21.15.40:0/4042837046 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f86e4133e00 0x7f86e4119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.604+0000 7f86ebdd2700 1 --2- 172.21.15.40:0/4042837046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86e409df40 0x7f86e4119590 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.604+0000 7f86ebdd2700 1 -- 172.21.15.40:0/4042837046 >> 172.21.15.40:0/4042837046 conn(0x7f86e40a2a00 msgr2=0x7f86e412d980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:34.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.604+0000 7f86ebdd2700 1 -- 172.21.15.40:0/4042837046 shutdown_connections 2023-09-30T22:25:34.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.604+0000 7f86ebdd2700 1 -- 172.21.15.40:0/4042837046 wait complete. 2023-09-30T22:25:34.616 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:34.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.683+0000 7f3798ed7700 1 -- 172.21.15.40:0/1856043133 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f379412e880 con 0x7f379409e230 2023-09-30T22:25:34.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.683+0000 7f3782ffd700 1 -- 172.21.15.40:0/1856043133 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f37880223a0 con 0x7f379409e230 2023-09-30T22:25:34.684 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:34.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.685+0000 7f3798ed7700 1 -- 172.21.15.40:0/1856043133 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f379409e230 msgr2=0x7f379411e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.685+0000 7f3798ed7700 1 --2- 172.21.15.40:0/1856043133 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f379409e230 0x7f379411e080 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3788018000 tx=0x7f3788004750 comp rx=0 tx=0).stop 2023-09-30T22:25:34.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.685+0000 7f3798ed7700 1 -- 172.21.15.40:0/1856043133 shutdown_connections 2023-09-30T22:25:34.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.685+0000 7f3798ed7700 1 --2- 172.21.15.40:0/1856043133 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3794130de0 0x7f379411e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.685+0000 7f3798ed7700 1 --2- 172.21.15.40:0/1856043133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f379409d920 0x7f379411db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.685+0000 7f3798ed7700 1 --2- 172.21.15.40:0/1856043133 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f379409e230 0x7f379411e080 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.685+0000 7f3798ed7700 1 -- 172.21.15.40:0/1856043133 >> 172.21.15.40:0/1856043133 conn(0x7f379409fb20 msgr2=0x7f379412df40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:34.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.685+0000 7f3798ed7700 1 -- 172.21.15.40:0/1856043133 shutdown_connections 2023-09-30T22:25:34.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.685+0000 7f3798ed7700 1 -- 172.21.15.40:0/1856043133 wait complete. 2023-09-30T22:25:34.703 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:34.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.722+0000 7fbb76a81700 1 -- 172.21.15.40:0/899305993 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbb70062380 con 0x7fbb7009c890 2023-09-30T22:25:34.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.722+0000 7fbb6d7fa700 1 -- 172.21.15.40:0/899305993 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbb64021030 con 0x7fbb7009c890 2023-09-30T22:25:34.723 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:34.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.724+0000 7fbb76a81700 1 -- 172.21.15.40:0/899305993 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbb7009c890 msgr2=0x7fbb701c89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.724+0000 7fbb76a81700 1 --2- 172.21.15.40:0/899305993 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbb7009c890 0x7fbb701c89e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbb64009130 tx=0x7fbb64004750 comp rx=0 tx=0).stop 2023-09-30T22:25:34.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.724+0000 7fbb76a81700 1 -- 172.21.15.40:0/899305993 shutdown_connections 2023-09-30T22:25:34.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.724+0000 7fbb76a81700 1 --2- 172.21.15.40:0/899305993 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbb7009c890 0x7fbb701c89e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.724+0000 7fbb76a81700 1 --2- 172.21.15.40:0/899305993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb7009e2b0 0x7fbb701c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.724+0000 7fbb76a81700 1 --2- 172.21.15.40:0/899305993 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb7009d920 0x7fbb701c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.724+0000 7fbb76a81700 1 -- 172.21.15.40:0/899305993 >> 172.21.15.40:0/899305993 conn(0x7fbb700a7080 msgr2=0x7fbb700a3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:34.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.724+0000 7fbb76a81700 1 -- 172.21.15.40:0/899305993 shutdown_connections 2023-09-30T22:25:34.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:34.724+0000 7fbb76a81700 1 -- 172.21.15.40:0/899305993 wait complete. 2023-09-30T22:25:34.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:35.470 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:35.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.612+0000 7ff689410700 1 Processor -- start 2023-09-30T22:25:35.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.612+0000 7ff689410700 1 -- start start 2023-09-30T22:25:35.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.612+0000 7ff689410700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff684136bf0 0x7ff684138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.612+0000 7ff689410700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff684139510 0x7ff68413b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.612+0000 7ff689410700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6840a2600 con 0x7ff68409c890 2023-09-30T22:25:35.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.612+0000 7ff689410700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6840a29d0 con 0x7ff684139510 2023-09-30T22:25:35.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.612+0000 7ff689410700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff68409fb40 con 0x7ff684136bf0 2023-09-30T22:25:35.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.613+0000 7ff682ffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff68409c890 0x7ff68409cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45536/0 (socket says 172.21.15.40:45536) 2023-09-30T22:25:35.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.613+0000 7ff6837fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff684139510 0x7ff68413b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.613+0000 7ff682ffd700 1 -- 172.21.15.40:0/928396501 learned_addr learned my addr 172.21.15.40:0/928396501 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:35.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.613+0000 7ff6827fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff684136bf0 0x7ff684138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.613+0000 7ff681ffb700 1 -- 172.21.15.40:0/928396501 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3706717929 0 0) 0x7ff6840a2600 con 0x7ff68409c890 2023-09-30T22:25:35.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.613+0000 7ff681ffb700 1 -- 172.21.15.40:0/928396501 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff66c0035b0 con 0x7ff68409c890 2023-09-30T22:25:35.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.613+0000 7ff6837fe700 1 -- 172.21.15.40:0/928396501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff684136bf0 msgr2=0x7ff684138fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:35.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.613+0000 7ff6837fe700 1 --2- 172.21.15.40:0/928396501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff684136bf0 0x7ff684138fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.613+0000 7ff6837fe700 1 -- 172.21.15.40:0/928396501 >> v1:172.21.15.40:6789/0 conn(0x7ff68409c890 legacy=0x7ff68409cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.613+0000 7ff6837fe700 1 -- 172.21.15.40:0/928396501 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff68409d370 con 0x7ff684139510 2023-09-30T22:25:35.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.613+0000 7ff6827fc700 1 --2- 172.21.15.40:0/928396501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff684136bf0 0x7ff684138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:35.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.613+0000 7ff6837fe700 1 --2- 172.21.15.40:0/928396501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff684139510 0x7ff68413b8f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff67c009dc0 tx=0x7ff67c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa142997fb1f8996 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:35.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.613+0000 7ff681ffb700 1 -- 172.21.15.40:0/928396501 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67c00e070 con 0x7ff684139510 2023-09-30T22:25:35.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.613+0000 7ff681ffb700 1 -- 172.21.15.40:0/928396501 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67c00bb20 con 0x7ff684139510 2023-09-30T22:25:35.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.613+0000 7ff681ffb700 1 -- 172.21.15.40:0/928396501 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67c012430 con 0x7ff684139510 2023-09-30T22:25:35.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.614+0000 7ff689410700 1 -- 172.21.15.40:0/928396501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff684139510 msgr2=0x7ff68413b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.614+0000 7ff689410700 1 --2- 172.21.15.40:0/928396501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff684139510 0x7ff68413b8f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff67c009dc0 tx=0x7ff67c00b330 comp rx=0 tx=0).stop 2023-09-30T22:25:35.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.614+0000 7ff689410700 1 -- 172.21.15.40:0/928396501 shutdown_connections 2023-09-30T22:25:35.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.614+0000 7ff689410700 1 --2- 172.21.15.40:0/928396501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff684139510 0x7ff68413b8f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.614+0000 7ff689410700 1 --2- 172.21.15.40:0/928396501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff684136bf0 0x7ff684138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.614+0000 7ff689410700 1 -- 172.21.15.40:0/928396501 >> 172.21.15.40:0/928396501 conn(0x7ff6840a7080 msgr2=0x7ff6840a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:35.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.614+0000 7ff689410700 1 -- 172.21.15.40:0/928396501 shutdown_connections 2023-09-30T22:25:35.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.614+0000 7ff689410700 1 -- 172.21.15.40:0/928396501 wait complete. 2023-09-30T22:25:35.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.615+0000 7ff689410700 1 Processor -- start 2023-09-30T22:25:35.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.615+0000 7ff689410700 1 -- start start 2023-09-30T22:25:35.621 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:35.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.615+0000 7ff689410700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff68409c890 0x7ff68406eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.615+0000 7ff689410700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff684136bf0 0x7ff68406f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.615+0000 7ff689410700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff684139510 0x7ff68406f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.615+0000 7ff689410700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff684071600 con 0x7ff68409c890 2023-09-30T22:25:35.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.615+0000 7ff689410700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff684070890 con 0x7ff684139510 2023-09-30T22:25:35.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.615+0000 7ff689410700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff684071b30 con 0x7ff684136bf0 2023-09-30T22:25:35.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.616+0000 7ff682ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff68409c890 0x7ff68406eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.616+0000 7ff6827fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff684136bf0 0x7ff68406f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.616+0000 7ff6837fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff684139510 0x7ff68406f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.616+0000 7ff6827fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff684136bf0 0x7ff68406f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55312/0 (socket says 172.21.15.40:55312) 2023-09-30T22:25:35.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.616+0000 7ff6827fc700 1 -- 172.21.15.40:0/3713459982 learned_addr learned my addr 172.21.15.40:0/3713459982 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:35.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.616+0000 7ff682ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff68409c890 0x7ff68406eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50956/0 (socket says 172.21.15.40:50956) 2023-09-30T22:25:35.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.616+0000 7ff6837fe700 1 -- 172.21.15.40:0/3713459982 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff684136bf0 msgr2=0x7ff68406f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.616+0000 7ff6837fe700 1 --2- 172.21.15.40:0/3713459982 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff684136bf0 0x7ff68406f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.616+0000 7ff6837fe700 1 -- 172.21.15.40:0/3713459982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff68409c890 msgr2=0x7ff68406eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.616+0000 7ff6837fe700 1 --2- 172.21.15.40:0/3713459982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff68409c890 0x7ff68406eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.616+0000 7ff6837fe700 1 -- 172.21.15.40:0/3713459982 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6780094a0 con 0x7ff684139510 2023-09-30T22:25:35.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.616+0000 7ff6827fc700 1 --2- 172.21.15.40:0/3713459982 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff684136bf0 0x7ff68406f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:35.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.616+0000 7ff6837fe700 1 --2- 172.21.15.40:0/3713459982 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff684139510 0x7ff68406f950 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff67c016000 tx=0x7ff67c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:35.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.616+0000 7ff66b7fe700 1 -- 172.21.15.40:0/3713459982 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67c012430 con 0x7ff684139510 2023-09-30T22:25:35.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.616+0000 7ff66b7fe700 1 -- 172.21.15.40:0/3713459982 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67c020070 con 0x7ff684139510 2023-09-30T22:25:35.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.616+0000 7ff689410700 1 -- 172.21.15.40:0/3713459982 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff67c009a70 con 0x7ff684139510 2023-09-30T22:25:35.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.616+0000 7ff66b7fe700 1 -- 172.21.15.40:0/3713459982 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67c004280 con 0x7ff684139510 2023-09-30T22:25:35.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.616+0000 7ff689410700 1 -- 172.21.15.40:0/3713459982 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff68412bb90 con 0x7ff684139510 2023-09-30T22:25:35.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.617+0000 7ff66b7fe700 1 -- 172.21.15.40:0/3713459982 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff67c0043e0 con 0x7ff684139510 2023-09-30T22:25:35.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.617+0000 7ff689410700 1 -- 172.21.15.40:0/3713459982 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff684062380 con 0x7ff684139510 2023-09-30T22:25:35.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.617+0000 7ff66b7fe700 1 -- 172.21.15.40:0/3713459982 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff67c022070 con 0x7ff684139510 2023-09-30T22:25:35.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.622+0000 7ff66b7fe700 1 -- 172.21.15.40:0/3713459982 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff67c027480 con 0x7ff684139510 2023-09-30T22:25:35.703 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:35.738 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:35.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.753+0000 7f66f3c2c700 1 Processor -- start 2023-09-30T22:25:35.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.754+0000 7f66f3c2c700 1 -- start start 2023-09-30T22:25:35.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.754+0000 7f66f3c2c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66ec09df30 0x7f66ec135400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.754+0000 7f66f3c2c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f66ec135940 0x7f66ec137d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.754+0000 7f66f3c2c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66ec09e8b0 con 0x7f66ec09d450 2023-09-30T22:25:35.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.754+0000 7f66f3c2c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66ec09c3b0 con 0x7f66ec135940 2023-09-30T22:25:35.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.754+0000 7f66f3c2c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec09a6b0 con 0x7f66ec09df30 2023-09-30T22:25:35.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.754+0000 7f66f11c7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66ec09df30 0x7f66ec135400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.754+0000 7f66f11c7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66ec09df30 0x7f66ec135400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55322/0 (socket says 172.21.15.40:55322) 2023-09-30T22:25:35.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.754+0000 7f66f11c7700 1 -- 172.21.15.40:0/1858709995 learned_addr learned my addr 172.21.15.40:0/1858709995 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:35.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.755+0000 7f66f21c9700 1 --2- 172.21.15.40:0/1858709995 >> v2:172.21.15.40:3300/0 conn(0x7f66ec135940 0x7f66ec137d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.755+0000 7f66f11c7700 1 -- 172.21.15.40:0/1858709995 >> v2:172.21.15.40:3300/0 conn(0x7f66ec135940 msgr2=0x7f66ec137d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:35.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.755+0000 7f66f11c7700 1 --2- 172.21.15.40:0/1858709995 >> v2:172.21.15.40:3300/0 conn(0x7f66ec135940 0x7f66ec137d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.755+0000 7f66f11c7700 1 -- 172.21.15.40:0/1858709995 >> v1:172.21.15.40:6789/0 conn(0x7f66ec09d450 legacy=0x7f66ec09d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.755+0000 7f66f11c7700 1 -- 172.21.15.40:0/1858709995 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ec09b4f0 con 0x7f66ec09df30 2023-09-30T22:25:35.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.755+0000 7f66f11c7700 1 --2- 172.21.15.40:0/1858709995 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66ec09df30 0x7f66ec135400 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00bb90 tx=0x7f66dc00bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c7078a4463f6be0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:35.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.755+0000 7f66f09c6700 1 -- 172.21.15.40:0/1858709995 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc009040 con 0x7f66ec09df30 2023-09-30T22:25:35.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.755+0000 7f66f09c6700 1 -- 172.21.15.40:0/1858709995 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66dc00dd70 con 0x7f66ec09df30 2023-09-30T22:25:35.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.755+0000 7f66f09c6700 1 -- 172.21.15.40:0/1858709995 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc018550 con 0x7f66ec09df30 2023-09-30T22:25:35.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.756+0000 7f66f3c2c700 1 -- 172.21.15.40:0/1858709995 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66ec09df30 msgr2=0x7f66ec135400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.756+0000 7f66f3c2c700 1 --2- 172.21.15.40:0/1858709995 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66ec09df30 0x7f66ec135400 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00bb90 tx=0x7f66dc00bea0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.756+0000 7f66f3c2c700 1 -- 172.21.15.40:0/1858709995 shutdown_connections 2023-09-30T22:25:35.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.756+0000 7f66f3c2c700 1 --2- 172.21.15.40:0/1858709995 >> v2:172.21.15.40:3300/0 conn(0x7f66ec135940 0x7f66ec137d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.756+0000 7f66f3c2c700 1 --2- 172.21.15.40:0/1858709995 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66ec09df30 0x7f66ec135400 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.756+0000 7f66f3c2c700 1 -- 172.21.15.40:0/1858709995 >> 172.21.15.40:0/1858709995 conn(0x7f66ec0a2a00 msgr2=0x7f66ec0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:35.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.756+0000 7f66f3c2c700 1 -- 172.21.15.40:0/1858709995 shutdown_connections 2023-09-30T22:25:35.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.756+0000 7f66f3c2c700 1 -- 172.21.15.40:0/1858709995 wait complete. 2023-09-30T22:25:35.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.758+0000 7f66f3c2c700 1 Processor -- start 2023-09-30T22:25:35.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.758+0000 7f66f3c2c700 1 -- start start 2023-09-30T22:25:35.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.758+0000 7f66f3c2c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66ec09d450 0x7f66ec133330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.758+0000 7f66f3c2c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66ec09df30 0x7f66ec133870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.758+0000 7f66f3c2c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66ec135940 0x7f66ec133db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.758+0000 7f66f3c2c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec06f4b0 con 0x7f66ec09d450 2023-09-30T22:25:35.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.758+0000 7f66f3c2c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec12f1b0 con 0x7f66ec135940 2023-09-30T22:25:35.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.758+0000 7f66f3c2c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec09c5d0 con 0x7f66ec09df30 2023-09-30T22:25:35.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.758+0000 7f66f21c9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66ec135940 0x7f66ec133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.759+0000 7f66f21c9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66ec135940 0x7f66ec133db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60430/0 (socket says 172.21.15.40:60430) 2023-09-30T22:25:35.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.759+0000 7f66f21c9700 1 -- 172.21.15.40:0/259850661 learned_addr learned my addr 172.21.15.40:0/259850661 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:35.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.759+0000 7f66f19c8700 1 --2- 172.21.15.40:0/259850661 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66ec09d450 0x7f66ec133330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.759+0000 7f66f11c7700 1 --2- 172.21.15.40:0/259850661 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66ec09df30 0x7f66ec133870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.759+0000 7f66f21c9700 1 -- 172.21.15.40:0/259850661 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66ec09df30 msgr2=0x7f66ec133870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.759+0000 7f66f21c9700 1 --2- 172.21.15.40:0/259850661 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66ec09df30 0x7f66ec133870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.759+0000 7f66f21c9700 1 -- 172.21.15.40:0/259850661 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66ec09d450 msgr2=0x7f66ec133330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.759+0000 7f66f21c9700 1 --2- 172.21.15.40:0/259850661 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66ec09d450 0x7f66ec133330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.759+0000 7f66f21c9700 1 -- 172.21.15.40:0/259850661 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66dc00b7f0 con 0x7f66ec135940 2023-09-30T22:25:35.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.759+0000 7f66f21c9700 1 --2- 172.21.15.40:0/259850661 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66ec135940 0x7f66ec133db0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f66e4004690 tx=0x7f66e40049a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:35.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.759+0000 7f66e27fc700 1 -- 172.21.15.40:0/259850661 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e4014040 con 0x7f66ec135940 2023-09-30T22:25:35.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.759+0000 7f66f3c2c700 1 -- 172.21.15.40:0/259850661 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66ec135050 con 0x7f66ec135940 2023-09-30T22:25:35.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.759+0000 7f66e27fc700 1 -- 172.21.15.40:0/259850661 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e4018420 con 0x7f66ec135940 2023-09-30T22:25:35.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.759+0000 7f66e27fc700 1 -- 172.21.15.40:0/259850661 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e40187d0 con 0x7f66ec135940 2023-09-30T22:25:35.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.760+0000 7f66f3c2c700 1 -- 172.21.15.40:0/259850661 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66ec070570 con 0x7f66ec135940 2023-09-30T22:25:35.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.761+0000 7f66e27fc700 1 -- 172.21.15.40:0/259850661 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f66e4018930 con 0x7f66ec135940 2023-09-30T22:25:35.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.761+0000 7f66f3c2c700 1 -- 172.21.15.40:0/259850661 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66ec071840 con 0x7f66ec135940 2023-09-30T22:25:35.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.762+0000 7f66e27fc700 1 -- 172.21.15.40:0/259850661 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f66e40442b0 con 0x7f66ec135940 2023-09-30T22:25:35.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.771+0000 7f66e27fc700 1 -- 172.21.15.40:0/259850661 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f66e4018be0 con 0x7f66ec135940 2023-09-30T22:25:35.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.829+0000 7ff689410700 1 -- 172.21.15.40:0/3713459982 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff684131390 con 0x7ff684139510 2023-09-30T22:25:35.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.830+0000 7ff66b7fe700 1 -- 172.21.15.40:0/3713459982 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff67c036090 con 0x7ff684139510 2023-09-30T22:25:35.832 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:35.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.832+0000 7ff689410700 1 -- 172.21.15.40:0/3713459982 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff684139510 msgr2=0x7ff68406f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.832+0000 7ff689410700 1 --2- 172.21.15.40:0/3713459982 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff684139510 0x7ff68406f950 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff67c016000 tx=0x7ff67c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.832+0000 7ff689410700 1 -- 172.21.15.40:0/3713459982 shutdown_connections 2023-09-30T22:25:35.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.832+0000 7ff689410700 1 --2- 172.21.15.40:0/3713459982 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff684139510 0x7ff68406f950 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.832+0000 7ff689410700 1 --2- 172.21.15.40:0/3713459982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff68409c890 0x7ff68406eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.832+0000 7ff689410700 1 --2- 172.21.15.40:0/3713459982 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff684136bf0 0x7ff68406f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.832+0000 7ff689410700 1 -- 172.21.15.40:0/3713459982 >> 172.21.15.40:0/3713459982 conn(0x7ff6840a7080 msgr2=0x7ff684136fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:35.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.832+0000 7ff689410700 1 -- 172.21.15.40:0/3713459982 shutdown_connections 2023-09-30T22:25:35.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.832+0000 7ff689410700 1 -- 172.21.15.40:0/3713459982 wait complete. 2023-09-30T22:25:35.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.842+0000 7fbc0ee3c700 1 Processor -- start 2023-09-30T22:25:35.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.842+0000 7fbc0ee3c700 1 -- start start 2023-09-30T22:25:35.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.843+0000 7fbc0ee3c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbc0809e400 0x7fbc08135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.843+0000 7fbc0ee3c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc08136230 0x7fbc08138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.843+0000 7fbc0ee3c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc0809adf0 con 0x7fbc0809d920 2023-09-30T22:25:35.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.843+0000 7fbc0ee3c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc0809edf0 con 0x7fbc0809e400 2023-09-30T22:25:35.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.843+0000 7fbc0ee3c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0809b660 con 0x7fbc08136230 2023-09-30T22:25:35.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.843+0000 7fbc07fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbc0809e400 0x7fbc08135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.843+0000 7fbc0d3d9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc08136230 0x7fbc08138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.843+0000 7fbc07fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbc0809e400 0x7fbc08135cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50980/0 (socket says 172.21.15.40:50980) 2023-09-30T22:25:35.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.843+0000 7fbc0d3d9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc08136230 0x7fbc08138610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55332/0 (socket says 172.21.15.40:55332) 2023-09-30T22:25:35.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.843+0000 7fbc07fff700 1 -- 172.21.15.40:0/1882860088 learned_addr learned my addr 172.21.15.40:0/1882860088 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:35.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.844+0000 7fbc07fff700 1 -- 172.21.15.40:0/1882860088 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc08136230 msgr2=0x7fbc08138610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:35.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.844+0000 7fbc07fff700 1 --2- 172.21.15.40:0/1882860088 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc08136230 0x7fbc08138610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.844+0000 7fbc07fff700 1 -- 172.21.15.40:0/1882860088 >> v1:172.21.15.40:6789/0 conn(0x7fbc0809d920 legacy=0x7fbc0809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.844+0000 7fbc07fff700 1 -- 172.21.15.40:0/1882860088 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc0809a6e0 con 0x7fbc0809e400 2023-09-30T22:25:35.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.844+0000 7fbc07fff700 1 --2- 172.21.15.40:0/1882860088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc0809e400 0x7fbc08135cf0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbbf400dd20 tx=0x7fbbf400f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ecd76332ae345f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:35.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.844+0000 7fbc077fe700 1 -- 172.21.15.40:0/1882860088 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4012070 con 0x7fbc0809e400 2023-09-30T22:25:35.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.844+0000 7fbc077fe700 1 -- 172.21.15.40:0/1882860088 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf400de70 con 0x7fbc0809e400 2023-09-30T22:25:35.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.844+0000 7fbc077fe700 1 -- 172.21.15.40:0/1882860088 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf400fd20 con 0x7fbc0809e400 2023-09-30T22:25:35.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.845+0000 7fbc0ee3c700 1 -- 172.21.15.40:0/1882860088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc0809e400 msgr2=0x7fbc08135cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.845+0000 7fbc0ee3c700 1 --2- 172.21.15.40:0/1882860088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc0809e400 0x7fbc08135cf0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbbf400dd20 tx=0x7fbbf400f330 comp rx=0 tx=0).stop 2023-09-30T22:25:35.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.845+0000 7fbc0ee3c700 1 -- 172.21.15.40:0/1882860088 shutdown_connections 2023-09-30T22:25:35.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.845+0000 7fbc0ee3c700 1 --2- 172.21.15.40:0/1882860088 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc08136230 0x7fbc08138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.845+0000 7fbc0ee3c700 1 --2- 172.21.15.40:0/1882860088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc0809e400 0x7fbc08135cf0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.845+0000 7fbc0ee3c700 1 -- 172.21.15.40:0/1882860088 >> 172.21.15.40:0/1882860088 conn(0x7fbc0809fb20 msgr2=0x7fbc0809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:35.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.845+0000 7fbc0ee3c700 1 -- 172.21.15.40:0/1882860088 shutdown_connections 2023-09-30T22:25:35.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.845+0000 7fbc0ee3c700 1 -- 172.21.15.40:0/1882860088 wait complete. 2023-09-30T22:25:35.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.846+0000 7fbc0ee3c700 1 Processor -- start 2023-09-30T22:25:35.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.846+0000 7fbc0ee3c700 1 -- start start 2023-09-30T22:25:35.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.847+0000 7fbc0ee3c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc0809d920 0x7fbc0811e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.847+0000 7fbc0ee3c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc0809e400 0x7fbc0811eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.847+0000 7fbc0ee3c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc08136230 0x7fbc0811f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.847+0000 7fbc0ee3c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc081209c0 con 0x7fbc0809e400 2023-09-30T22:25:35.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.847+0000 7fbc0ee3c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc080a2f20 con 0x7fbc0809d920 2023-09-30T22:25:35.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.847+0000 7fbc0ee3c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc08121a10 con 0x7fbc08136230 2023-09-30T22:25:35.849 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:35.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.848+0000 7fbc0d3d9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc08136230 0x7fbc0811f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.848+0000 7fbc0d3d9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc08136230 0x7fbc0811f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55338/0 (socket says 172.21.15.40:55338) 2023-09-30T22:25:35.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.848+0000 7fbc0d3d9700 1 -- 172.21.15.40:0/2426119817 learned_addr learned my addr 172.21.15.40:0/2426119817 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:35.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.848+0000 7fbc0cbd8700 1 --2- 172.21.15.40:0/2426119817 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc0809d920 0x7fbc0811e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.848+0000 7fbc07fff700 1 --2- 172.21.15.40:0/2426119817 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc0809e400 0x7fbc0811eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.848+0000 7fbc0d3d9700 1 -- 172.21.15.40:0/2426119817 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc0809d920 msgr2=0x7fbc0811e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.848+0000 7fbc0d3d9700 1 --2- 172.21.15.40:0/2426119817 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc0809d920 0x7fbc0811e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.848+0000 7fbc0d3d9700 1 -- 172.21.15.40:0/2426119817 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc0809e400 msgr2=0x7fbc0811eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.848+0000 7fbc0d3d9700 1 --2- 172.21.15.40:0/2426119817 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc0809e400 0x7fbc0811eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.848+0000 7fbc0d3d9700 1 -- 172.21.15.40:0/2426119817 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf400da00 con 0x7fbc08136230 2023-09-30T22:25:35.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.848+0000 7fbc0cbd8700 1 --2- 172.21.15.40:0/2426119817 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc0809d920 0x7fbc0811e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:35.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.848+0000 7fbc0d3d9700 1 --2- 172.21.15.40:0/2426119817 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc08136230 0x7fbc0811f1e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbc0000efc0 tx=0x7fbc0000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:35.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.848+0000 7fbc057fa700 1 -- 172.21.15.40:0/2426119817 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc00009ea0 con 0x7fbc08136230 2023-09-30T22:25:35.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.848+0000 7fbc057fa700 1 -- 172.21.15.40:0/2426119817 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc0000f040 con 0x7fbc08136230 2023-09-30T22:25:35.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.848+0000 7fbc057fa700 1 -- 172.21.15.40:0/2426119817 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0000ced0 con 0x7fbc08136230 2023-09-30T22:25:35.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.849+0000 7fbc0ee3c700 1 -- 172.21.15.40:0/2426119817 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc08122320 con 0x7fbc08136230 2023-09-30T22:25:35.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.849+0000 7fbc0ee3c700 1 -- 172.21.15.40:0/2426119817 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc08121fa0 con 0x7fbc08136230 2023-09-30T22:25:35.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.850+0000 7fbc057fa700 1 -- 172.21.15.40:0/2426119817 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbc00014480 con 0x7fbc08136230 2023-09-30T22:25:35.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.850+0000 7fbc057fa700 1 -- 172.21.15.40:0/2426119817 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fbc0003fef0 con 0x7fbc08136230 2023-09-30T22:25:35.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.851+0000 7fbc0ee3c700 1 -- 172.21.15.40:0/2426119817 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc08062380 con 0x7fbc08136230 2023-09-30T22:25:35.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.860+0000 7fbc057fa700 1 -- 172.21.15.40:0/2426119817 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbc00018020 con 0x7fbc08136230 2023-09-30T22:25:35.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.883+0000 7fba2f034700 1 Processor -- start 2023-09-30T22:25:35.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.884+0000 7fba2f034700 1 -- start start 2023-09-30T22:25:35.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.884+0000 7fba2f034700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fba28136bf0 0x7fba28138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.884+0000 7fba2f034700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba28139510 0x7fba2813b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.884+0000 7fba2f034700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba280a2600 con 0x7fba2809c890 2023-09-30T22:25:35.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.884+0000 7fba2f034700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba280a29d0 con 0x7fba28136bf0 2023-09-30T22:25:35.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.884+0000 7fba2f034700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba2809fb40 con 0x7fba28139510 2023-09-30T22:25:35.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.884+0000 7fba2d5d1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba28139510 0x7fba2813b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.884+0000 7fba27fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fba28136bf0 0x7fba28138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.884+0000 7fba2d5d1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba28139510 0x7fba2813b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60440/0 (socket says 172.21.15.40:60440) 2023-09-30T22:25:35.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.884+0000 7fba27fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fba28136bf0 0x7fba28138fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51006/0 (socket says 172.21.15.40:51006) 2023-09-30T22:25:35.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.884+0000 7fba2d5d1700 1 -- 172.21.15.40:0/3059780241 learned_addr learned my addr 172.21.15.40:0/3059780241 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:35.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.885+0000 7fba2d5d1700 1 -- 172.21.15.40:0/3059780241 >> v2:172.21.15.40:3300/0 conn(0x7fba28136bf0 msgr2=0x7fba28138fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:35.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.885+0000 7fba2d5d1700 1 --2- 172.21.15.40:0/3059780241 >> v2:172.21.15.40:3300/0 conn(0x7fba28136bf0 0x7fba28138fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.885+0000 7fba2d5d1700 1 -- 172.21.15.40:0/3059780241 >> v1:172.21.15.40:6789/0 conn(0x7fba2809c890 legacy=0x7fba2809cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.885+0000 7fba2d5d1700 1 -- 172.21.15.40:0/3059780241 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2809d370 con 0x7fba28139510 2023-09-30T22:25:35.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.885+0000 7fba2d5d1700 1 --2- 172.21.15.40:0/3059780241 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba28139510 0x7fba2813b8f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fba20009e50 tx=0x7fba2000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf0a3f65f76a56a2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:35.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.885+0000 7fba277fe700 1 -- 172.21.15.40:0/3059780241 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2000e070 con 0x7fba28139510 2023-09-30T22:25:35.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.885+0000 7fba277fe700 1 -- 172.21.15.40:0/3059780241 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2000b910 con 0x7fba28139510 2023-09-30T22:25:35.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.885+0000 7fba277fe700 1 -- 172.21.15.40:0/3059780241 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2000bcc0 con 0x7fba28139510 2023-09-30T22:25:35.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.885+0000 7fba2f034700 1 -- 172.21.15.40:0/3059780241 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba28139510 msgr2=0x7fba2813b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.885+0000 7fba2f034700 1 --2- 172.21.15.40:0/3059780241 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba28139510 0x7fba2813b8f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fba20009e50 tx=0x7fba2000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:35.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.886+0000 7fba2f034700 1 -- 172.21.15.40:0/3059780241 shutdown_connections 2023-09-30T22:25:35.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.886+0000 7fba2f034700 1 --2- 172.21.15.40:0/3059780241 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba28139510 0x7fba2813b8f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.886+0000 7fba2f034700 1 --2- 172.21.15.40:0/3059780241 >> v2:172.21.15.40:3300/0 conn(0x7fba28136bf0 0x7fba28138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.886+0000 7fba2f034700 1 -- 172.21.15.40:0/3059780241 >> 172.21.15.40:0/3059780241 conn(0x7fba280a7080 msgr2=0x7fba280a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:35.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.886+0000 7fba2f034700 1 -- 172.21.15.40:0/3059780241 shutdown_connections 2023-09-30T22:25:35.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.886+0000 7fba2f034700 1 -- 172.21.15.40:0/3059780241 wait complete. 2023-09-30T22:25:35.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.886+0000 7fba2f034700 1 Processor -- start 2023-09-30T22:25:35.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.887+0000 7fba2f034700 1 -- start start 2023-09-30T22:25:35.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.887+0000 7fba2f034700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba2809c890 0x7fba2806f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.887+0000 7fba2f034700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba28136bf0 0x7fba2806f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.887+0000 7fba2f034700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fba28139510 0x7fba2806fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.887+0000 7fba2f034700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2812c350 con 0x7fba28136bf0 2023-09-30T22:25:35.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.887+0000 7fba2f034700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba2812b4e0 con 0x7fba2809c890 2023-09-30T22:25:35.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.887+0000 7fba2f034700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba2809ecf0 con 0x7fba28139510 2023-09-30T22:25:35.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.887+0000 7fba27fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba28136bf0 0x7fba2806f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.887+0000 7fba27fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba28136bf0 0x7fba2806f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51018/0 (socket says 172.21.15.40:51018) 2023-09-30T22:25:35.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.887+0000 7fba27fff700 1 -- 172.21.15.40:0/3296694218 learned_addr learned my addr 172.21.15.40:0/3296694218 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:35.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.887+0000 7fba2d5d1700 1 --2- 172.21.15.40:0/3296694218 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fba28139510 0x7fba2806fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.887+0000 7fba2cdd0700 1 --2- 172.21.15.40:0/3296694218 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba2809c890 0x7fba2806f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.888+0000 7fba27fff700 1 -- 172.21.15.40:0/3296694218 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fba28139510 msgr2=0x7fba2806fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.888+0000 7fba27fff700 1 --2- 172.21.15.40:0/3296694218 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fba28139510 0x7fba2806fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.888+0000 7fba27fff700 1 -- 172.21.15.40:0/3296694218 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba2809c890 msgr2=0x7fba2806f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.888+0000 7fba27fff700 1 --2- 172.21.15.40:0/3296694218 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba2809c890 0x7fba2806f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.888+0000 7fba27fff700 1 -- 172.21.15.40:0/3296694218 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba20009b30 con 0x7fba28136bf0 2023-09-30T22:25:35.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.888+0000 7fba27fff700 1 --2- 172.21.15.40:0/3296694218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba28136bf0 0x7fba2806f670 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fba1400e9b0 tx=0x7fba1400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:35.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.888+0000 7fba257fa700 1 -- 172.21.15.40:0/3296694218 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba14009710 con 0x7fba28136bf0 2023-09-30T22:25:35.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.888+0000 7fba257fa700 1 -- 172.21.15.40:0/3296694218 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1400ee50 con 0x7fba28136bf0 2023-09-30T22:25:35.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.888+0000 7fba2f034700 1 -- 172.21.15.40:0/3296694218 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba2812bb70 con 0x7fba28136bf0 2023-09-30T22:25:35.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.888+0000 7fba257fa700 1 -- 172.21.15.40:0/3296694218 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba14017e60 con 0x7fba28136bf0 2023-09-30T22:25:35.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.888+0000 7fba2f034700 1 -- 172.21.15.40:0/3296694218 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba2812c8a0 con 0x7fba28136bf0 2023-09-30T22:25:35.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.889+0000 7fba257fa700 1 -- 172.21.15.40:0/3296694218 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fba1400c640 con 0x7fba28136bf0 2023-09-30T22:25:35.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.889+0000 7fba257fa700 1 -- 172.21.15.40:0/3296694218 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fba14047a60 con 0x7fba28136bf0 2023-09-30T22:25:35.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.890+0000 7fba2f034700 1 -- 172.21.15.40:0/3296694218 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba28062380 con 0x7fba28136bf0 2023-09-30T22:25:35.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.894+0000 7fba257fa700 1 -- 172.21.15.40:0/3296694218 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fba14024080 con 0x7fba28136bf0 2023-09-30T22:25:35.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.982+0000 7f66f3c2c700 1 -- 172.21.15.40:0/259850661 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f66ec062380 con 0x7f66ec135940 2023-09-30T22:25:35.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.983+0000 7f66e27fc700 1 -- 172.21.15.40:0/259850661 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f66e40371e0 con 0x7f66ec135940 2023-09-30T22:25:35.983 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:35.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.985+0000 7f66f3c2c700 1 -- 172.21.15.40:0/259850661 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66ec135940 msgr2=0x7f66ec133db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.985+0000 7f66f3c2c700 1 --2- 172.21.15.40:0/259850661 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66ec135940 0x7f66ec133db0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f66e4004690 tx=0x7f66e40049a0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.985+0000 7f66f3c2c700 1 -- 172.21.15.40:0/259850661 shutdown_connections 2023-09-30T22:25:35.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.985+0000 7f66f3c2c700 1 --2- 172.21.15.40:0/259850661 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66ec135940 0x7f66ec133db0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.985+0000 7f66f3c2c700 1 --2- 172.21.15.40:0/259850661 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66ec09d450 0x7f66ec133330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.985+0000 7f66f3c2c700 1 --2- 172.21.15.40:0/259850661 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66ec09df30 0x7f66ec133870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.985+0000 7f66f3c2c700 1 -- 172.21.15.40:0/259850661 >> 172.21.15.40:0/259850661 conn(0x7f66ec0a2a00 msgr2=0x7f66ec131470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:35.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.985+0000 7f66f3c2c700 1 -- 172.21.15.40:0/259850661 shutdown_connections 2023-09-30T22:25:35.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:35.985+0000 7f66f3c2c700 1 -- 172.21.15.40:0/259850661 wait complete. 2023-09-30T22:25:35.998 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:36.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.059+0000 7fbc0ee3c700 1 -- 172.21.15.40:0/2426119817 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbc08121b50 con 0x7fbc08136230 2023-09-30T22:25:36.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.059+0000 7fbc057fa700 1 -- 172.21.15.40:0/2426119817 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbc00018020 con 0x7fbc08136230 2023-09-30T22:25:36.060 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:36.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.061+0000 7fbc0ee3c700 1 -- 172.21.15.40:0/2426119817 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc08136230 msgr2=0x7fbc0811f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:36.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.061+0000 7fbc0ee3c700 1 --2- 172.21.15.40:0/2426119817 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc08136230 0x7fbc0811f1e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbc0000efc0 tx=0x7fbc0000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.061+0000 7fbc0ee3c700 1 -- 172.21.15.40:0/2426119817 shutdown_connections 2023-09-30T22:25:36.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.061+0000 7fbc0ee3c700 1 --2- 172.21.15.40:0/2426119817 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc08136230 0x7fbc0811f1e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.061+0000 7fbc0ee3c700 1 --2- 172.21.15.40:0/2426119817 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc0809d920 0x7fbc0811e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.061+0000 7fbc0ee3c700 1 --2- 172.21.15.40:0/2426119817 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc0809e400 0x7fbc0811eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.061+0000 7fbc0ee3c700 1 -- 172.21.15.40:0/2426119817 >> 172.21.15.40:0/2426119817 conn(0x7fbc0809fb20 msgr2=0x7fbc080706b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:36.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.061+0000 7fbc0ee3c700 1 -- 172.21.15.40:0/2426119817 shutdown_connections 2023-09-30T22:25:36.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.061+0000 7fbc0ee3c700 1 -- 172.21.15.40:0/2426119817 wait complete. 2023-09-30T22:25:36.074 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:36.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.092+0000 7fba2f034700 1 -- 172.21.15.40:0/3296694218 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fba280a5e00 con 0x7fba28136bf0 2023-09-30T22:25:36.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.092+0000 7fba257fa700 1 -- 172.21.15.40:0/3296694218 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fba1401f440 con 0x7fba28136bf0 2023-09-30T22:25:36.093 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:36.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.094+0000 7fba2f034700 1 -- 172.21.15.40:0/3296694218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba28136bf0 msgr2=0x7fba2806f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:36.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.094+0000 7fba2f034700 1 --2- 172.21.15.40:0/3296694218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba28136bf0 0x7fba2806f670 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fba1400e9b0 tx=0x7fba1400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.094+0000 7fba2f034700 1 -- 172.21.15.40:0/3296694218 shutdown_connections 2023-09-30T22:25:36.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.094+0000 7fba2f034700 1 --2- 172.21.15.40:0/3296694218 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fba28139510 0x7fba2806fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.094+0000 7fba2f034700 1 --2- 172.21.15.40:0/3296694218 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba2809c890 0x7fba2806f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.094+0000 7fba2f034700 1 --2- 172.21.15.40:0/3296694218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba28136bf0 0x7fba2806f670 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.094+0000 7fba2f034700 1 -- 172.21.15.40:0/3296694218 >> 172.21.15.40:0/3296694218 conn(0x7fba280a7080 msgr2=0x7fba28135a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:36.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.094+0000 7fba2f034700 1 -- 172.21.15.40:0/3296694218 shutdown_connections 2023-09-30T22:25:36.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.094+0000 7fba2f034700 1 -- 172.21.15.40:0/3296694218 wait complete. 2023-09-30T22:25:36.107 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:36.850 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:36.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.989+0000 7fb6159b0700 1 Processor -- start 2023-09-30T22:25:36.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.989+0000 7fb6159b0700 1 -- start start 2023-09-30T22:25:36.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.990+0000 7fb6159b0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb61006f070 0x7fb61006f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:36.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.990+0000 7fb6159b0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb61006f980 0x7fb610097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:36.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.990+0000 7fb6159b0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb610070830 con 0x7fb61006fdb0 2023-09-30T22:25:36.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.990+0000 7fb6159b0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb610071af0 con 0x7fb61006f980 2023-09-30T22:25:36.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.990+0000 7fb6159b0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb610070ad0 con 0x7fb61006f070 2023-09-30T22:25:36.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.990+0000 7fb60effd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb61006f070 0x7fb61006f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:36.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.990+0000 7fb60e7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb61006f980 0x7fb610097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:36.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.990+0000 7fb60effd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb61006f070 0x7fb61006f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55358/0 (socket says 172.21.15.40:55358) 2023-09-30T22:25:36.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.990+0000 7fb60effd700 1 -- 172.21.15.40:0/1266318546 learned_addr learned my addr 172.21.15.40:0/1266318546 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:36.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.990+0000 7fb60e7fc700 1 --2- 172.21.15.40:0/1266318546 >> v2:172.21.15.40:3300/0 conn(0x7fb61006f980 0x7fb610097090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51022/0 (socket says 172.21.15.40:51022) 2023-09-30T22:25:36.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.990+0000 7fb60effd700 1 -- 172.21.15.40:0/1266318546 >> v2:172.21.15.40:3300/0 conn(0x7fb61006f980 msgr2=0x7fb610097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:36.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.990+0000 7fb60effd700 1 --2- 172.21.15.40:0/1266318546 >> v2:172.21.15.40:3300/0 conn(0x7fb61006f980 0x7fb610097090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.990+0000 7fb60effd700 1 -- 172.21.15.40:0/1266318546 >> v1:172.21.15.40:6789/0 conn(0x7fb61006fdb0 legacy=0x7fb6100975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:36.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.990+0000 7fb60effd700 1 -- 172.21.15.40:0/1266318546 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb610070de0 con 0x7fb61006f070 2023-09-30T22:25:36.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.990+0000 7fb60e7fc700 1 --2- 172.21.15.40:0/1266318546 >> v2:172.21.15.40:3300/0 conn(0x7fb61006f980 0x7fb610097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:36.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.991+0000 7fb60effd700 1 --2- 172.21.15.40:0/1266318546 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb61006f070 0x7fb61006f440 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb600009950 tx=0x7fb600009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fe71336b7a177bf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:36.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.991+0000 7fb60dffb700 1 -- 172.21.15.40:0/1266318546 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb600011830 con 0x7fb61006f070 2023-09-30T22:25:36.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.991+0000 7fb60dffb700 1 -- 172.21.15.40:0/1266318546 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb600011990 con 0x7fb61006f070 2023-09-30T22:25:36.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.991+0000 7fb60dffb700 1 -- 172.21.15.40:0/1266318546 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb600011d40 con 0x7fb61006f070 2023-09-30T22:25:36.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.991+0000 7fb6159b0700 1 -- 172.21.15.40:0/1266318546 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb61006f070 msgr2=0x7fb61006f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:36.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.991+0000 7fb6159b0700 1 --2- 172.21.15.40:0/1266318546 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb61006f070 0x7fb61006f440 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb600009950 tx=0x7fb600009c60 comp rx=0 tx=0).stop 2023-09-30T22:25:36.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.991+0000 7fb6159b0700 1 -- 172.21.15.40:0/1266318546 shutdown_connections 2023-09-30T22:25:36.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.991+0000 7fb6159b0700 1 --2- 172.21.15.40:0/1266318546 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb61006f070 0x7fb61006f440 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.991+0000 7fb6159b0700 1 --2- 172.21.15.40:0/1266318546 >> v2:172.21.15.40:3300/0 conn(0x7fb61006f980 0x7fb610097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.991+0000 7fb6159b0700 1 -- 172.21.15.40:0/1266318546 >> 172.21.15.40:0/1266318546 conn(0x7fb6100a41a0 msgr2=0x7fb6100a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:36.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.991+0000 7fb6159b0700 1 -- 172.21.15.40:0/1266318546 shutdown_connections 2023-09-30T22:25:36.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.991+0000 7fb6159b0700 1 -- 172.21.15.40:0/1266318546 wait complete. 2023-09-30T22:25:36.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.992+0000 7fb6159b0700 1 Processor -- start 2023-09-30T22:25:36.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.993+0000 7fb6159b0700 1 -- start start 2023-09-30T22:25:36.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.993+0000 7fb6159b0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb61006f070 0x7fb61012c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:36.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.993+0000 7fb6159b0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb61006f980 0x7fb61012c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:36.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.993+0000 7fb6159b0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb61006fdb0 0x7fb61012cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:36.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.993+0000 7fb6159b0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61009ddf0 con 0x7fb61006f980 2023-09-30T22:25:37.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.993+0000 7fb6159b0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb61012f370 con 0x7fb61006f070 2023-09-30T22:25:37.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.993+0000 7fb6159b0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb61012d810 con 0x7fb61006fdb0 2023-09-30T22:25:37.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.993+0000 7fb60effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb61006f070 0x7fb61012c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.993+0000 7fb60f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb61006fdb0 0x7fb61012cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.993+0000 7fb60effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb61006f070 0x7fb61012c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60454/0 (socket says 172.21.15.40:60454) 2023-09-30T22:25:37.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.993+0000 7fb60effd700 1 -- 172.21.15.40:0/3093805317 learned_addr learned my addr 172.21.15.40:0/3093805317 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:37.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.993+0000 7fb60e7fc700 1 --2- 172.21.15.40:0/3093805317 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb61006f980 0x7fb61012c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.993+0000 7fb60effd700 1 -- 172.21.15.40:0/3093805317 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb61006fdb0 msgr2=0x7fb61012cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.993+0000 7fb60effd700 1 --2- 172.21.15.40:0/3093805317 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb61006fdb0 0x7fb61012cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.993+0000 7fb60effd700 1 -- 172.21.15.40:0/3093805317 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb61006f980 msgr2=0x7fb61012c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.993+0000 7fb60effd700 1 --2- 172.21.15.40:0/3093805317 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb61006f980 0x7fb61012c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.993+0000 7fb60effd700 1 -- 172.21.15.40:0/3093805317 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60400d940 con 0x7fb61006f070 2023-09-30T22:25:37.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.993+0000 7fb60f7fe700 1 --2- 172.21.15.40:0/3093805317 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb61006fdb0 0x7fb61012cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:37.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.994+0000 7fb60effd700 1 --2- 172.21.15.40:0/3093805317 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb61006f070 0x7fb61012c2d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb600011db0 tx=0x7fb600004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:37.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.994+0000 7fb5f7fff700 1 -- 172.21.15.40:0/3093805317 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb600004380 con 0x7fb61006f070 2023-09-30T22:25:37.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.994+0000 7fb5f7fff700 1 -- 172.21.15.40:0/3093805317 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60001f070 con 0x7fb61006f070 2023-09-30T22:25:37.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.994+0000 7fb6159b0700 1 -- 172.21.15.40:0/3093805317 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb600009550 con 0x7fb61006f070 2023-09-30T22:25:37.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.994+0000 7fb5f7fff700 1 -- 172.21.15.40:0/3093805317 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6000036a0 con 0x7fb61006f070 2023-09-30T22:25:37.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.994+0000 7fb6159b0700 1 -- 172.21.15.40:0/3093805317 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb61012e6d0 con 0x7fb61006f070 2023-09-30T22:25:37.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.995+0000 7fb5f7fff700 1 -- 172.21.15.40:0/3093805317 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb600021030 con 0x7fb61006f070 2023-09-30T22:25:37.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.995+0000 7fb6159b0700 1 -- 172.21.15.40:0/3093805317 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb61012e520 con 0x7fb61006f070 2023-09-30T22:25:37.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.995+0000 7fb5f7fff700 1 -- 172.21.15.40:0/3093805317 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb6000409b0 con 0x7fb61006f070 2023-09-30T22:25:37.003 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:37.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:36.999+0000 7fb5f7fff700 1 -- 172.21.15.40:0/3093805317 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb6000239c0 con 0x7fb61006f070 2023-09-30T22:25:37.075 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:37.108 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:37.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.136+0000 7f891a678700 1 Processor -- start 2023-09-30T22:25:37.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.136+0000 7f891a678700 1 -- start start 2023-09-30T22:25:37.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.137+0000 7f891a678700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f891413b130 0x7f891413d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.137+0000 7f891a678700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f891413da50 0x7f891413fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.137+0000 7f891a678700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8914137e20 con 0x7f8914138250 2023-09-30T22:25:37.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.137+0000 7f891a678700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8914138d30 con 0x7f891413b130 2023-09-30T22:25:37.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.137+0000 7f891a678700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8914138050 con 0x7f891413da50 2023-09-30T22:25:37.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.137+0000 7f8918c15700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f891413da50 0x7f891413fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.137+0000 7f8918c15700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f891413da50 0x7f891413fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60466/0 (socket says 172.21.15.40:60466) 2023-09-30T22:25:37.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.137+0000 7f8918c15700 1 -- 172.21.15.40:0/2546872727 learned_addr learned my addr 172.21.15.40:0/2546872727 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:37.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.137+0000 7f89137fe700 1 --2- 172.21.15.40:0/2546872727 >> v2:172.21.15.40:3300/0 conn(0x7f891413b130 0x7f891413d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.137+0000 7f89137fe700 1 -- 172.21.15.40:0/2546872727 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f891413da50 msgr2=0x7f891413fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:37.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.137+0000 7f89137fe700 1 --2- 172.21.15.40:0/2546872727 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f891413da50 0x7f891413fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.137+0000 7f89137fe700 1 -- 172.21.15.40:0/2546872727 >> v1:172.21.15.40:6789/0 conn(0x7f8914138250 legacy=0x7f8914138620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.137+0000 7f89137fe700 1 -- 172.21.15.40:0/2546872727 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f891409b010 con 0x7f891413b130 2023-09-30T22:25:37.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.137+0000 7f8918c15700 1 --2- 172.21.15.40:0/2546872727 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f891413da50 0x7f891413fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:37.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.138+0000 7f89137fe700 1 --2- 172.21.15.40:0/2546872727 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f891413b130 0x7f891413d510 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8908009840 tx=0x7f8908009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a5e6c2c90ad226 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:37.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.138+0000 7f8912ffd700 1 -- 172.21.15.40:0/2546872727 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8908011830 con 0x7f891413b130 2023-09-30T22:25:37.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.138+0000 7f8912ffd700 1 -- 172.21.15.40:0/2546872727 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8908011990 con 0x7f891413b130 2023-09-30T22:25:37.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.138+0000 7f8912ffd700 1 -- 172.21.15.40:0/2546872727 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8908011d20 con 0x7f891413b130 2023-09-30T22:25:37.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.139+0000 7f891a678700 1 -- 172.21.15.40:0/2546872727 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f891413b130 msgr2=0x7f891413d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.139+0000 7f891a678700 1 --2- 172.21.15.40:0/2546872727 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f891413b130 0x7f891413d510 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8908009840 tx=0x7f8908009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:37.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.139+0000 7f891a678700 1 -- 172.21.15.40:0/2546872727 shutdown_connections 2023-09-30T22:25:37.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.139+0000 7f891a678700 1 --2- 172.21.15.40:0/2546872727 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f891413da50 0x7f891413fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.139+0000 7f891a678700 1 --2- 172.21.15.40:0/2546872727 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f891413b130 0x7f891413d510 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.139+0000 7f891a678700 1 -- 172.21.15.40:0/2546872727 >> 172.21.15.40:0/2546872727 conn(0x7f89140a2a00 msgr2=0x7f89140a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:37.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.139+0000 7f891a678700 1 -- 172.21.15.40:0/2546872727 shutdown_connections 2023-09-30T22:25:37.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.139+0000 7f891a678700 1 -- 172.21.15.40:0/2546872727 wait complete. 2023-09-30T22:25:37.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.140+0000 7f891a678700 1 Processor -- start 2023-09-30T22:25:37.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.140+0000 7f891a678700 1 -- start start 2023-09-30T22:25:37.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.141+0000 7f891a678700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8914138250 0x7f891406d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.141+0000 7f891a678700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f891413b130 0x7f891406db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.141+0000 7f891a678700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f891413da50 0x7f891406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.141+0000 7f891a678700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891406fc50 con 0x7f8914138250 2023-09-30T22:25:37.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.141+0000 7f891a678700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f891406f6a0 con 0x7f891413b130 2023-09-30T22:25:37.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.141+0000 7f891a678700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8914070520 con 0x7f891413da50 2023-09-30T22:25:37.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.141+0000 7f89137fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f891413b130 0x7f891406db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.141+0000 7f8918c15700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f891413da50 0x7f891406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.141+0000 7f89137fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f891413b130 0x7f891406db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60472/0 (socket says 172.21.15.40:60472) 2023-09-30T22:25:37.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.141+0000 7f89137fe700 1 -- 172.21.15.40:0/2068815436 learned_addr learned my addr 172.21.15.40:0/2068815436 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:37.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.141+0000 7f8913fff700 1 --2- 172.21.15.40:0/2068815436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8914138250 0x7f891406d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.142+0000 7f8918c15700 1 -- 172.21.15.40:0/2068815436 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f891413b130 msgr2=0x7f891406db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.142+0000 7f8918c15700 1 --2- 172.21.15.40:0/2068815436 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f891413b130 0x7f891406db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.142+0000 7f8918c15700 1 -- 172.21.15.40:0/2068815436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8914138250 msgr2=0x7f891406d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.142+0000 7f8918c15700 1 --2- 172.21.15.40:0/2068815436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8914138250 0x7f891406d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.142+0000 7f8918c15700 1 -- 172.21.15.40:0/2068815436 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f890c009b30 con 0x7f891413da50 2023-09-30T22:25:37.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.142+0000 7f8918c15700 1 --2- 172.21.15.40:0/2068815436 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f891413da50 0x7f891406e090 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f890c009e50 tx=0x7f890c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:37.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.142+0000 7f8910ff9700 1 -- 172.21.15.40:0/2068815436 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c018070 con 0x7f891413da50 2023-09-30T22:25:37.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.142+0000 7f8910ff9700 1 -- 172.21.15.40:0/2068815436 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f890c00f040 con 0x7f891413da50 2023-09-30T22:25:37.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.142+0000 7f891a678700 1 -- 172.21.15.40:0/2068815436 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89080094a0 con 0x7f891413da50 2023-09-30T22:25:37.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.142+0000 7f8910ff9700 1 -- 172.21.15.40:0/2068815436 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c003c40 con 0x7f891413da50 2023-09-30T22:25:37.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.142+0000 7f891a678700 1 -- 172.21.15.40:0/2068815436 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8914140f40 con 0x7f891413da50 2023-09-30T22:25:37.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.143+0000 7f8910ff9700 1 -- 172.21.15.40:0/2068815436 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f890c00c880 con 0x7f891413da50 2023-09-30T22:25:37.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.143+0000 7f8910ff9700 1 -- 172.21.15.40:0/2068815436 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f890c03f690 con 0x7f891413da50 2023-09-30T22:25:37.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.144+0000 7f891a678700 1 -- 172.21.15.40:0/2068815436 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8914062380 con 0x7f891413da50 2023-09-30T22:25:37.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.153+0000 7f8910ff9700 1 -- 172.21.15.40:0/2068815436 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f890c00cb30 con 0x7f891413da50 2023-09-30T22:25:37.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.202+0000 7fb6159b0700 1 -- 172.21.15.40:0/3093805317 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb610099840 con 0x7fb61006f070 2023-09-30T22:25:37.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.202+0000 7fb5f7fff700 1 -- 172.21.15.40:0/3093805317 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb60001b430 con 0x7fb61006f070 2023-09-30T22:25:37.203 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:37.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.204+0000 7fb6159b0700 1 -- 172.21.15.40:0/3093805317 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb61006f070 msgr2=0x7fb61012c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.204+0000 7fb6159b0700 1 --2- 172.21.15.40:0/3093805317 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb61006f070 0x7fb61012c2d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb600011db0 tx=0x7fb600004750 comp rx=0 tx=0).stop 2023-09-30T22:25:37.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.204+0000 7fb6159b0700 1 -- 172.21.15.40:0/3093805317 shutdown_connections 2023-09-30T22:25:37.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.204+0000 7fb6159b0700 1 --2- 172.21.15.40:0/3093805317 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb61006fdb0 0x7fb61012cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.204+0000 7fb6159b0700 1 --2- 172.21.15.40:0/3093805317 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb61006f070 0x7fb61012c2d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.204+0000 7fb6159b0700 1 --2- 172.21.15.40:0/3093805317 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb61006f980 0x7fb61012c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.204+0000 7fb6159b0700 1 -- 172.21.15.40:0/3093805317 >> 172.21.15.40:0/3093805317 conn(0x7fb6100a41a0 msgr2=0x7fb6100973c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:37.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.204+0000 7fb6159b0700 1 -- 172.21.15.40:0/3093805317 shutdown_connections 2023-09-30T22:25:37.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.205+0000 7fb6159b0700 1 -- 172.21.15.40:0/3093805317 wait complete. 2023-09-30T22:25:37.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.215+0000 7f3e0375d700 1 Processor -- start 2023-09-30T22:25:37.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.215+0000 7f3e0375d700 1 -- start start 2023-09-30T22:25:37.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.215+0000 7f3e0375d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3dfc06a6d0 0x7f3dfc06aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.215+0000 7f3e0375d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3dfc06afe0 0x7f3dfc1318b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.215+0000 7f3e0375d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dfc09eb50 con 0x7f3dfc131df0 2023-09-30T22:25:37.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.215+0000 7f3e0375d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc09dde0 con 0x7f3dfc06afe0 2023-09-30T22:25:37.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.215+0000 7f3e0375d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc09d4a0 con 0x7f3dfc06a6d0 2023-09-30T22:25:37.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.216+0000 7f3e00cf8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3dfc06afe0 0x7f3dfc1318b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.216+0000 7f3e014f9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3dfc06a6d0 0x7f3dfc06aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.216+0000 7f3e00cf8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3dfc06afe0 0x7f3dfc1318b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60482/0 (socket says 172.21.15.40:60482) 2023-09-30T22:25:37.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.216+0000 7f3e00cf8700 1 -- 172.21.15.40:0/2477182620 learned_addr learned my addr 172.21.15.40:0/2477182620 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:37.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.216+0000 7f3e014f9700 1 -- 172.21.15.40:0/2477182620 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3dfc06afe0 msgr2=0x7f3dfc1318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:37.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.216+0000 7f3e014f9700 1 --2- 172.21.15.40:0/2477182620 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3dfc06afe0 0x7f3dfc1318b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.216+0000 7f3e014f9700 1 -- 172.21.15.40:0/2477182620 >> v1:172.21.15.40:6789/0 conn(0x7f3dfc131df0 legacy=0x7f3dfc138b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.216+0000 7f3e014f9700 1 -- 172.21.15.40:0/2477182620 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dfc09f5f0 con 0x7f3dfc06a6d0 2023-09-30T22:25:37.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.216+0000 7f3e00cf8700 1 --2- 172.21.15.40:0/2477182620 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3dfc06afe0 0x7f3dfc1318b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:37.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.216+0000 7f3e014f9700 1 --2- 172.21.15.40:0/2477182620 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3dfc06a6d0 0x7f3dfc06aaa0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3df8009850 tx=0x7f3df8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1b08ef4b63333a1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:37.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.216+0000 7f3df3fff700 1 -- 172.21.15.40:0/2477182620 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df8005e30 con 0x7f3dfc06a6d0 2023-09-30T22:25:37.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.217+0000 7f3df3fff700 1 -- 172.21.15.40:0/2477182620 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df8006030 con 0x7f3dfc06a6d0 2023-09-30T22:25:37.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.217+0000 7f3df3fff700 1 -- 172.21.15.40:0/2477182620 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df80063e0 con 0x7f3dfc06a6d0 2023-09-30T22:25:37.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.217+0000 7f3e0375d700 1 -- 172.21.15.40:0/2477182620 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3dfc06a6d0 msgr2=0x7f3dfc06aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.217+0000 7f3e0375d700 1 --2- 172.21.15.40:0/2477182620 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3dfc06a6d0 0x7f3dfc06aaa0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3df8009850 tx=0x7f3df8009b60 comp rx=0 tx=0).stop 2023-09-30T22:25:37.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.217+0000 7f3e0375d700 1 -- 172.21.15.40:0/2477182620 shutdown_connections 2023-09-30T22:25:37.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.217+0000 7f3e0375d700 1 --2- 172.21.15.40:0/2477182620 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3dfc06a6d0 0x7f3dfc06aaa0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.217+0000 7f3e0375d700 1 --2- 172.21.15.40:0/2477182620 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3dfc06afe0 0x7f3dfc1318b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.217+0000 7f3e0375d700 1 -- 172.21.15.40:0/2477182620 >> 172.21.15.40:0/2477182620 conn(0x7f3dfc09fb20 msgr2=0x7f3dfc09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:37.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.217+0000 7f3e0375d700 1 -- 172.21.15.40:0/2477182620 shutdown_connections 2023-09-30T22:25:37.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.217+0000 7f3e0375d700 1 -- 172.21.15.40:0/2477182620 wait complete. 2023-09-30T22:25:37.220 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:37.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.218+0000 7f3e0375d700 1 Processor -- start 2023-09-30T22:25:37.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.219+0000 7f3e0375d700 1 -- start start 2023-09-30T22:25:37.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.219+0000 7f3e0375d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3dfc06a6d0 0x7f3dfc09afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.219+0000 7f3e0375d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3dfc06afe0 0x7f3dfc09b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.219+0000 7f3e0375d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3dfc131df0 0x7f3dfc1c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.219+0000 7f3e0375d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc0715d0 con 0x7f3dfc06a6d0 2023-09-30T22:25:37.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.219+0000 7f3e0375d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc121ed0 con 0x7f3dfc06afe0 2023-09-30T22:25:37.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.219+0000 7f3e0375d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc122190 con 0x7f3dfc131df0 2023-09-30T22:25:37.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.219+0000 7f3e00cf8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3dfc06afe0 0x7f3dfc09b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.219+0000 7f3e01cfa700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3dfc131df0 0x7f3dfc1c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.219+0000 7f3e00cf8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3dfc06afe0 0x7f3dfc09b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60496/0 (socket says 172.21.15.40:60496) 2023-09-30T22:25:37.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.219+0000 7f3e00cf8700 1 -- 172.21.15.40:0/2978466894 learned_addr learned my addr 172.21.15.40:0/2978466894 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:37.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.219+0000 7f3e014f9700 1 --2- 172.21.15.40:0/2978466894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3dfc06a6d0 0x7f3dfc09afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.219+0000 7f3e01cfa700 1 -- 172.21.15.40:0/2978466894 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3dfc06afe0 msgr2=0x7f3dfc09b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.220+0000 7f3e01cfa700 1 --2- 172.21.15.40:0/2978466894 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3dfc06afe0 0x7f3dfc09b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.220+0000 7f3e01cfa700 1 -- 172.21.15.40:0/2978466894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3dfc06a6d0 msgr2=0x7f3dfc09afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.220+0000 7f3e01cfa700 1 --2- 172.21.15.40:0/2978466894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3dfc06a6d0 0x7f3dfc09afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.220+0000 7f3e01cfa700 1 -- 172.21.15.40:0/2978466894 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dec009550 con 0x7f3dfc131df0 2023-09-30T22:25:37.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.220+0000 7f3e014f9700 1 --2- 172.21.15.40:0/2978466894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3dfc06a6d0 0x7f3dfc09afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:37.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.220+0000 7f3e00cf8700 1 --2- 172.21.15.40:0/2978466894 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3dfc06afe0 0x7f3dfc09b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:37.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.220+0000 7f3e01cfa700 1 --2- 172.21.15.40:0/2978466894 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3dfc131df0 0x7f3dfc1c8410 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3df400cb90 tx=0x7f3df400cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:37.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.220+0000 7f3df1ffb700 1 -- 172.21.15.40:0/2978466894 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df4003c00 con 0x7f3dfc131df0 2023-09-30T22:25:37.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.220+0000 7f3df1ffb700 1 -- 172.21.15.40:0/2978466894 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df4003d60 con 0x7f3dfc131df0 2023-09-30T22:25:37.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.220+0000 7f3df1ffb700 1 -- 172.21.15.40:0/2978466894 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df400aa80 con 0x7f3dfc131df0 2023-09-30T22:25:37.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.221+0000 7f3e0375d700 1 -- 172.21.15.40:0/2978466894 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df8009430 con 0x7f3dfc131df0 2023-09-30T22:25:37.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.221+0000 7f3e0375d700 1 -- 172.21.15.40:0/2978466894 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dfc09c240 con 0x7f3dfc131df0 2023-09-30T22:25:37.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.221+0000 7f3df1ffb700 1 -- 172.21.15.40:0/2978466894 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3df400abe0 con 0x7f3dfc131df0 2023-09-30T22:25:37.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.222+0000 7f3df1ffb700 1 -- 172.21.15.40:0/2978466894 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3df403f580 con 0x7f3dfc131df0 2023-09-30T22:25:37.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.222+0000 7f3e0375d700 1 -- 172.21.15.40:0/2978466894 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dfc09ba30 con 0x7f3dfc131df0 2023-09-30T22:25:37.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.227+0000 7f3df1ffb700 1 -- 172.21.15.40:0/2978466894 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3df40198f0 con 0x7f3dfc131df0 2023-09-30T22:25:37.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.261+0000 7f242513c700 1 Processor -- start 2023-09-30T22:25:37.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.261+0000 7f242513c700 1 -- start start 2023-09-30T22:25:37.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.262+0000 7f242513c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f242009d920 0x7f242009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.262+0000 7f242513c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f242009e230 0x7f24201343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.262+0000 7f242513c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f242009f940 con 0x7f242009f0f0 2023-09-30T22:25:37.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.262+0000 7f242513c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f242006b4c0 con 0x7f242009e230 2023-09-30T22:25:37.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.262+0000 7f242513c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f242009a8f0 con 0x7f242009d920 2023-09-30T22:25:37.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.262+0000 7f241ed9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f242009d920 0x7f242009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.262+0000 7f241ed9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f242009d920 0x7f242009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55386/0 (socket says 172.21.15.40:55386) 2023-09-30T22:25:37.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.262+0000 7f241ed9d700 1 -- 172.21.15.40:0/988129480 learned_addr learned my addr 172.21.15.40:0/988129480 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:37.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.262+0000 7f241e59c700 1 --1- 172.21.15.40:0/988129480 >> v1:172.21.15.40:6789/0 conn(0x7f242009f0f0 0x7f2420133ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45594/0 (socket says 172.21.15.40:45594) 2023-09-30T22:25:37.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.262+0000 7f241f59e700 1 --2- 172.21.15.40:0/988129480 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f242009e230 0x7f24201343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.263+0000 7f241ed9d700 1 -- 172.21.15.40:0/988129480 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f242009e230 msgr2=0x7f24201343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:37.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.263+0000 7f241ed9d700 1 --2- 172.21.15.40:0/988129480 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f242009e230 0x7f24201343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.263+0000 7f241ed9d700 1 -- 172.21.15.40:0/988129480 >> v1:172.21.15.40:6789/0 conn(0x7f242009f0f0 legacy=0x7f2420133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.263+0000 7f241ed9d700 1 -- 172.21.15.40:0/988129480 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f242009f6e0 con 0x7f242009d920 2023-09-30T22:25:37.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.263+0000 7f241ed9d700 1 --2- 172.21.15.40:0/988129480 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f242009d920 0x7f242009dcf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2410009920 tx=0x7f2410009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ed8c75538ac7ba3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:37.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.263+0000 7f241dd9b700 1 -- 172.21.15.40:0/988129480 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2410005e30 con 0x7f242009d920 2023-09-30T22:25:37.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.263+0000 7f241dd9b700 1 -- 172.21.15.40:0/988129480 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2410004030 con 0x7f242009d920 2023-09-30T22:25:37.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.263+0000 7f241dd9b700 1 -- 172.21.15.40:0/988129480 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24100043e0 con 0x7f242009d920 2023-09-30T22:25:37.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.264+0000 7f242513c700 1 -- 172.21.15.40:0/988129480 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f242009d920 msgr2=0x7f242009dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.264+0000 7f242513c700 1 --2- 172.21.15.40:0/988129480 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f242009d920 0x7f242009dcf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2410009920 tx=0x7f2410009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:37.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.264+0000 7f242513c700 1 -- 172.21.15.40:0/988129480 shutdown_connections 2023-09-30T22:25:37.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.264+0000 7f242513c700 1 --2- 172.21.15.40:0/988129480 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f242009e230 0x7f24201343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.264+0000 7f242513c700 1 --2- 172.21.15.40:0/988129480 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f242009d920 0x7f242009dcf0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.264+0000 7f242513c700 1 -- 172.21.15.40:0/988129480 >> 172.21.15.40:0/988129480 conn(0x7f242009fb20 msgr2=0x7f242009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:37.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.264+0000 7f242513c700 1 -- 172.21.15.40:0/988129480 shutdown_connections 2023-09-30T22:25:37.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.264+0000 7f242513c700 1 -- 172.21.15.40:0/988129480 wait complete. 2023-09-30T22:25:37.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.265+0000 7f242513c700 1 Processor -- start 2023-09-30T22:25:37.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.265+0000 7f242513c700 1 -- start start 2023-09-30T22:25:37.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.266+0000 7f242513c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f242009d920 0x7f2420122990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.266+0000 7f242513c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f242009e230 0x7f2420122ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.266+0000 7f242513c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2420123410 0x7f24201c8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.266+0000 7f242513c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2420133930 con 0x7f242009d920 2023-09-30T22:25:37.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.266+0000 7f242513c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f242009c9e0 con 0x7f242009e230 2023-09-30T22:25:37.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.266+0000 7f242513c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2420126140 con 0x7f2420123410 2023-09-30T22:25:37.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.266+0000 7f241e59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f242009e230 0x7f2420122ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.266+0000 7f241ed9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f242009d920 0x7f2420122990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.266+0000 7f241e59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f242009e230 0x7f2420122ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60508/0 (socket says 172.21.15.40:60508) 2023-09-30T22:25:37.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.266+0000 7f241ed9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f242009d920 0x7f2420122990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51066/0 (socket says 172.21.15.40:51066) 2023-09-30T22:25:37.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.266+0000 7f241e59c700 1 -- 172.21.15.40:0/1132445732 learned_addr learned my addr 172.21.15.40:0/1132445732 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:37.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.266+0000 7f241f59e700 1 --2- 172.21.15.40:0/1132445732 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2420123410 0x7f24201c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.266+0000 7f241e59c700 1 -- 172.21.15.40:0/1132445732 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2420123410 msgr2=0x7f24201c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.266+0000 7f241e59c700 1 --2- 172.21.15.40:0/1132445732 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2420123410 0x7f24201c8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.266+0000 7f241e59c700 1 -- 172.21.15.40:0/1132445732 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f242009d920 msgr2=0x7f2420122990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.266+0000 7f241e59c700 1 --2- 172.21.15.40:0/1132445732 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f242009d920 0x7f2420122990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.266+0000 7f241e59c700 1 -- 172.21.15.40:0/1132445732 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2410009500 con 0x7f242009e230 2023-09-30T22:25:37.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.266+0000 7f241e59c700 1 --2- 172.21.15.40:0/1132445732 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f242009e230 0x7f2420122ed0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f241400c500 tx=0x7f241400c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:37.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.266+0000 7f24077fe700 1 -- 172.21.15.40:0/1132445732 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2414005cb0 con 0x7f242009e230 2023-09-30T22:25:37.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.266+0000 7f24077fe700 1 -- 172.21.15.40:0/1132445732 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2414005e10 con 0x7f242009e230 2023-09-30T22:25:37.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.266+0000 7f242513c700 1 -- 172.21.15.40:0/1132445732 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2420124620 con 0x7f242009e230 2023-09-30T22:25:37.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.267+0000 7f24077fe700 1 -- 172.21.15.40:0/1132445732 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24140072f0 con 0x7f242009e230 2023-09-30T22:25:37.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.267+0000 7f242513c700 1 -- 172.21.15.40:0/1132445732 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24200a3470 con 0x7f242009e230 2023-09-30T22:25:37.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.267+0000 7f24077fe700 1 -- 172.21.15.40:0/1132445732 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2414007450 con 0x7f242009e230 2023-09-30T22:25:37.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.267+0000 7f242513c700 1 -- 172.21.15.40:0/1132445732 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2420126540 con 0x7f242009e230 2023-09-30T22:25:37.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.268+0000 7f24077fe700 1 -- 172.21.15.40:0/1132445732 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f241403ea60 con 0x7f242009e230 2023-09-30T22:25:37.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.272+0000 7f24077fe700 1 -- 172.21.15.40:0/1132445732 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2414007700 con 0x7f242009e230 2023-09-30T22:25:37.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.367+0000 7f891a678700 1 -- 172.21.15.40:0/2068815436 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f891406ea10 con 0x7f891413da50 2023-09-30T22:25:37.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.367+0000 7f8910ff9700 1 -- 172.21.15.40:0/2068815436 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f890c01de00 con 0x7f891413da50 2023-09-30T22:25:37.368 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:37.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.369+0000 7f891a678700 1 -- 172.21.15.40:0/2068815436 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f891413da50 msgr2=0x7f891406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.369+0000 7f891a678700 1 --2- 172.21.15.40:0/2068815436 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f891413da50 0x7f891406e090 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f890c009e50 tx=0x7f890c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.369+0000 7f891a678700 1 -- 172.21.15.40:0/2068815436 shutdown_connections 2023-09-30T22:25:37.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.369+0000 7f891a678700 1 --2- 172.21.15.40:0/2068815436 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f891413da50 0x7f891406e090 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.369+0000 7f891a678700 1 --2- 172.21.15.40:0/2068815436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8914138250 0x7f891406d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.369+0000 7f891a678700 1 --2- 172.21.15.40:0/2068815436 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f891413b130 0x7f891406db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.369+0000 7f891a678700 1 -- 172.21.15.40:0/2068815436 >> 172.21.15.40:0/2068815436 conn(0x7f89140a2a00 msgr2=0x7f891409d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:37.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.370+0000 7f891a678700 1 -- 172.21.15.40:0/2068815436 shutdown_connections 2023-09-30T22:25:37.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.373+0000 7f891a678700 1 -- 172.21.15.40:0/2068815436 wait complete. 2023-09-30T22:25:37.386 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:37.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.426+0000 7f3e0375d700 1 -- 172.21.15.40:0/2978466894 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3dfc122350 con 0x7f3dfc131df0 2023-09-30T22:25:37.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.426+0000 7f3df1ffb700 1 -- 172.21.15.40:0/2978466894 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3df4019300 con 0x7f3dfc131df0 2023-09-30T22:25:37.427 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:37.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.428+0000 7f3e0375d700 1 -- 172.21.15.40:0/2978466894 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3dfc131df0 msgr2=0x7f3dfc1c8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.428+0000 7f3e0375d700 1 --2- 172.21.15.40:0/2978466894 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3dfc131df0 0x7f3dfc1c8410 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3df400cb90 tx=0x7f3df400cea0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.428+0000 7f3e0375d700 1 -- 172.21.15.40:0/2978466894 shutdown_connections 2023-09-30T22:25:37.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.428+0000 7f3e0375d700 1 --2- 172.21.15.40:0/2978466894 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3dfc131df0 0x7f3dfc1c8410 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.428+0000 7f3e0375d700 1 --2- 172.21.15.40:0/2978466894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3dfc06a6d0 0x7f3dfc09afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.428+0000 7f3e0375d700 1 --2- 172.21.15.40:0/2978466894 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3dfc06afe0 0x7f3dfc09b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.428+0000 7f3e0375d700 1 -- 172.21.15.40:0/2978466894 >> 172.21.15.40:0/2978466894 conn(0x7f3dfc09fb20 msgr2=0x7f3dfc0a28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:37.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.428+0000 7f3e0375d700 1 -- 172.21.15.40:0/2978466894 shutdown_connections 2023-09-30T22:25:37.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.428+0000 7f3e0375d700 1 -- 172.21.15.40:0/2978466894 wait complete. 2023-09-30T22:25:37.441 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:37.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.468+0000 7f242513c700 1 -- 172.21.15.40:0/1132445732 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2420126280 con 0x7f242009e230 2023-09-30T22:25:37.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.468+0000 7f24077fe700 1 -- 172.21.15.40:0/1132445732 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2420126280 con 0x7f242009e230 2023-09-30T22:25:37.469 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:37.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.470+0000 7f242513c700 1 -- 172.21.15.40:0/1132445732 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f242009e230 msgr2=0x7f2420122ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.470+0000 7f242513c700 1 --2- 172.21.15.40:0/1132445732 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f242009e230 0x7f2420122ed0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f241400c500 tx=0x7f241400c810 comp rx=0 tx=0).stop 2023-09-30T22:25:37.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.470+0000 7f242513c700 1 -- 172.21.15.40:0/1132445732 shutdown_connections 2023-09-30T22:25:37.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.470+0000 7f242513c700 1 --2- 172.21.15.40:0/1132445732 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2420123410 0x7f24201c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.470+0000 7f242513c700 1 --2- 172.21.15.40:0/1132445732 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f242009d920 0x7f2420122990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.470+0000 7f242513c700 1 --2- 172.21.15.40:0/1132445732 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f242009e230 0x7f2420122ed0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.470+0000 7f242513c700 1 -- 172.21.15.40:0/1132445732 >> 172.21.15.40:0/1132445732 conn(0x7f242009fb20 msgr2=0x7f24200a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:37.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.470+0000 7f242513c700 1 -- 172.21.15.40:0/1132445732 shutdown_connections 2023-09-30T22:25:37.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:37.470+0000 7f242513c700 1 -- 172.21.15.40:0/1132445732 wait complete. 2023-09-30T22:25:37.483 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:38.221 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:38.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.360+0000 7fb85b9c2700 1 Processor -- start 2023-09-30T22:25:38.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.360+0000 7fb85b9c2700 1 -- start start 2023-09-30T22:25:38.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.361+0000 7fb85b9c2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb85409d450 0x7fb85409d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.361+0000 7fb85b9c2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb8541308d0 0x7fb854138420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.361+0000 7fb85b9c2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb85409c3b0 con 0x7fb85409dd60 2023-09-30T22:25:38.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.361+0000 7fb85b9c2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb85409a6b0 con 0x7fb8541308d0 2023-09-30T22:25:38.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.361+0000 7fb85b9c2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb85409b4f0 con 0x7fb85409d450 2023-09-30T22:25:38.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.361+0000 7fb859f5f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb8541308d0 0x7fb854138420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.361+0000 7fb85975e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb85409d450 0x7fb85409d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.361+0000 7fb859f5f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb8541308d0 0x7fb854138420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51070/0 (socket says 172.21.15.40:51070) 2023-09-30T22:25:38.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.361+0000 7fb859f5f700 1 -- 172.21.15.40:0/1029215691 learned_addr learned my addr 172.21.15.40:0/1029215691 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:38.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.362+0000 7fb85975e700 1 -- 172.21.15.40:0/1029215691 >> v2:172.21.15.40:3300/0 conn(0x7fb8541308d0 msgr2=0x7fb854138420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:38.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.362+0000 7fb85975e700 1 --2- 172.21.15.40:0/1029215691 >> v2:172.21.15.40:3300/0 conn(0x7fb8541308d0 0x7fb854138420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.362+0000 7fb85975e700 1 -- 172.21.15.40:0/1029215691 >> v1:172.21.15.40:6789/0 conn(0x7fb85409dd60 legacy=0x7fb8541301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.362+0000 7fb85975e700 1 -- 172.21.15.40:0/1029215691 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85409af90 con 0x7fb85409d450 2023-09-30T22:25:38.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.362+0000 7fb859f5f700 1 --2- 172.21.15.40:0/1029215691 >> v2:172.21.15.40:3300/0 conn(0x7fb8541308d0 0x7fb854138420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:38.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.362+0000 7fb85975e700 1 --2- 172.21.15.40:0/1029215691 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb85409d450 0x7fb85409d820 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb850009d90 tx=0x7fb85000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b95bb84803d2e822 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:38.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.362+0000 7fb84bfff700 1 -- 172.21.15.40:0/1029215691 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85000e070 con 0x7fb85409d450 2023-09-30T22:25:38.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.362+0000 7fb84bfff700 1 -- 172.21.15.40:0/1029215691 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85000bb20 con 0x7fb85409d450 2023-09-30T22:25:38.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.362+0000 7fb84bfff700 1 -- 172.21.15.40:0/1029215691 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb850012430 con 0x7fb85409d450 2023-09-30T22:25:38.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.362+0000 7fb85b9c2700 1 -- 172.21.15.40:0/1029215691 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb85409d450 msgr2=0x7fb85409d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.362+0000 7fb85b9c2700 1 --2- 172.21.15.40:0/1029215691 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb85409d450 0x7fb85409d820 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb850009d90 tx=0x7fb85000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:38.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.363+0000 7fb85b9c2700 1 -- 172.21.15.40:0/1029215691 shutdown_connections 2023-09-30T22:25:38.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.363+0000 7fb85b9c2700 1 --2- 172.21.15.40:0/1029215691 >> v2:172.21.15.40:3300/0 conn(0x7fb8541308d0 0x7fb854138420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.363+0000 7fb85b9c2700 1 --2- 172.21.15.40:0/1029215691 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb85409d450 0x7fb85409d820 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.363+0000 7fb85b9c2700 1 -- 172.21.15.40:0/1029215691 >> 172.21.15.40:0/1029215691 conn(0x7fb8540a2a00 msgr2=0x7fb8540a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:38.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.363+0000 7fb85b9c2700 1 -- 172.21.15.40:0/1029215691 shutdown_connections 2023-09-30T22:25:38.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.363+0000 7fb85b9c2700 1 -- 172.21.15.40:0/1029215691 wait complete. 2023-09-30T22:25:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.364+0000 7fb85b9c2700 1 Processor -- start 2023-09-30T22:25:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.364+0000 7fb85b9c2700 1 -- start start 2023-09-30T22:25:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.365+0000 7fb85b9c2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb85409d450 0x7fb854130d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.365+0000 7fb85b9c2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb85409dd60 0x7fb854131260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.365+0000 7fb85b9c2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8541308d0 0x7fb8541317a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.365+0000 7fb85b9c2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb854134080 con 0x7fb85409dd60 2023-09-30T22:25:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.365+0000 7fb85b9c2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb854138a30 con 0x7fb8541308d0 2023-09-30T22:25:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.365+0000 7fb85b9c2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb854133190 con 0x7fb85409d450 2023-09-30T22:25:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.365+0000 7fb858f5d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb85409dd60 0x7fb854131260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.365+0000 7fb859f5f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8541308d0 0x7fb8541317a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.365+0000 7fb858f5d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb85409dd60 0x7fb854131260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51072/0 (socket says 172.21.15.40:51072) 2023-09-30T22:25:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.365+0000 7fb858f5d700 1 -- 172.21.15.40:0/2732902351 learned_addr learned my addr 172.21.15.40:0/2732902351 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.365+0000 7fb859f5f700 1 --2- 172.21.15.40:0/2732902351 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8541308d0 0x7fb8541317a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60516/0 (socket says 172.21.15.40:60516) 2023-09-30T22:25:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.365+0000 7fb85975e700 1 --2- 172.21.15.40:0/2732902351 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb85409d450 0x7fb854130d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.365+0000 7fb858f5d700 1 -- 172.21.15.40:0/2732902351 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb85409d450 msgr2=0x7fb854130d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.365+0000 7fb858f5d700 1 --2- 172.21.15.40:0/2732902351 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb85409d450 0x7fb854130d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.365+0000 7fb858f5d700 1 -- 172.21.15.40:0/2732902351 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8541308d0 msgr2=0x7fb8541317a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.365+0000 7fb858f5d700 1 --2- 172.21.15.40:0/2732902351 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8541308d0 0x7fb8541317a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.365+0000 7fb858f5d700 1 -- 172.21.15.40:0/2732902351 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84c009550 con 0x7fb85409dd60 2023-09-30T22:25:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.365+0000 7fb85975e700 1 --2- 172.21.15.40:0/2732902351 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb85409d450 0x7fb854130d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.365+0000 7fb858f5d700 1 --2- 172.21.15.40:0/2732902351 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb85409dd60 0x7fb854131260 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb84400c4e0 tx=0x7fb84400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.365+0000 7fb849ffb700 1 -- 172.21.15.40:0/2732902351 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8440052d0 con 0x7fb85409dd60 2023-09-30T22:25:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.366+0000 7fb849ffb700 1 -- 172.21.15.40:0/2732902351 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb844005430 con 0x7fb85409dd60 2023-09-30T22:25:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.366+0000 7fb85b9c2700 1 -- 172.21.15.40:0/2732902351 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb850009a70 con 0x7fb85409dd60 2023-09-30T22:25:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.366+0000 7fb849ffb700 1 -- 172.21.15.40:0/2732902351 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8440038c0 con 0x7fb85409dd60 2023-09-30T22:25:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.366+0000 7fb85b9c2700 1 -- 172.21.15.40:0/2732902351 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8540a22e0 con 0x7fb85409dd60 2023-09-30T22:25:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.366+0000 7fb849ffb700 1 -- 172.21.15.40:0/2732902351 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb844003a20 con 0x7fb85409dd60 2023-09-30T22:25:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.367+0000 7fb849ffb700 1 -- 172.21.15.40:0/2732902351 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb84403ea10 con 0x7fb85409dd60 2023-09-30T22:25:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.367+0000 7fb85b9c2700 1 -- 172.21.15.40:0/2732902351 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb85409c630 con 0x7fb85409dd60 2023-09-30T22:25:38.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.371+0000 7fb849ffb700 1 -- 172.21.15.40:0/2732902351 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb8440192c0 con 0x7fb85409dd60 2023-09-30T22:25:38.386 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:38.442 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:38.484 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:38.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.522+0000 7f67a7330700 1 Processor -- start 2023-09-30T22:25:38.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.522+0000 7f67a7330700 1 -- start start 2023-09-30T22:25:38.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.523+0000 7f67a7330700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f67a012c5f0 0x7f67a009a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.523+0000 7f67a7330700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67a009aa60 0x7f67a0130f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.523+0000 7f67a7330700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67a009b8f0 con 0x7f67a009b050 2023-09-30T22:25:38.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.523+0000 7f67a7330700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67a009e580 con 0x7f67a012c5f0 2023-09-30T22:25:38.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.523+0000 7f67a7330700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67a006ce60 con 0x7f67a009aa60 2023-09-30T22:25:38.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.523+0000 7f67a58cd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67a009aa60 0x7f67a0130f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.523+0000 7f67a48cb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f67a012c5f0 0x7f67a009a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.523+0000 7f67a58cd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67a009aa60 0x7f67a0130f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60530/0 (socket says 172.21.15.40:60530) 2023-09-30T22:25:38.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.523+0000 7f67a58cd700 1 -- 172.21.15.40:0/3613064796 learned_addr learned my addr 172.21.15.40:0/3613064796 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:38.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.523+0000 7f67a58cd700 1 -- 172.21.15.40:0/3613064796 >> v2:172.21.15.40:3300/0 conn(0x7f67a012c5f0 msgr2=0x7f67a009a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:38.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.523+0000 7f67a58cd700 1 --2- 172.21.15.40:0/3613064796 >> v2:172.21.15.40:3300/0 conn(0x7f67a012c5f0 0x7f67a009a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.523+0000 7f67a58cd700 1 -- 172.21.15.40:0/3613064796 >> v1:172.21.15.40:6789/0 conn(0x7f67a009b050 legacy=0x7f67a009de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.523+0000 7f67a58cd700 1 -- 172.21.15.40:0/3613064796 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a009be20 con 0x7f67a009aa60 2023-09-30T22:25:38.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.524+0000 7f67a58cd700 1 --2- 172.21.15.40:0/3613064796 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67a009aa60 0x7f67a0130f00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6798009e50 tx=0x7f679800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a53c556823279ebe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:38.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.524+0000 7f6793fff700 1 -- 172.21.15.40:0/3613064796 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679800e070 con 0x7f67a009aa60 2023-09-30T22:25:38.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.524+0000 7f6793fff700 1 -- 172.21.15.40:0/3613064796 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f679800b9c0 con 0x7f67a009aa60 2023-09-30T22:25:38.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.524+0000 7f6793fff700 1 -- 172.21.15.40:0/3613064796 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679800bd70 con 0x7f67a009aa60 2023-09-30T22:25:38.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.525+0000 7f67a7330700 1 -- 172.21.15.40:0/3613064796 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67a009aa60 msgr2=0x7f67a0130f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.525+0000 7f67a7330700 1 --2- 172.21.15.40:0/3613064796 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67a009aa60 0x7f67a0130f00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6798009e50 tx=0x7f679800b330 comp rx=0 tx=0).stop 2023-09-30T22:25:38.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.525+0000 7f67a7330700 1 -- 172.21.15.40:0/3613064796 shutdown_connections 2023-09-30T22:25:38.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.525+0000 7f67a7330700 1 --2- 172.21.15.40:0/3613064796 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67a009aa60 0x7f67a0130f00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.525+0000 7f67a7330700 1 --2- 172.21.15.40:0/3613064796 >> v2:172.21.15.40:3300/0 conn(0x7f67a012c5f0 0x7f67a009a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.525+0000 7f67a7330700 1 -- 172.21.15.40:0/3613064796 >> 172.21.15.40:0/3613064796 conn(0x7f67a00a2c70 msgr2=0x7f67a009eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:38.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.525+0000 7f67a7330700 1 -- 172.21.15.40:0/3613064796 shutdown_connections 2023-09-30T22:25:38.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.525+0000 7f67a7330700 1 -- 172.21.15.40:0/3613064796 wait complete. 2023-09-30T22:25:38.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.526+0000 7f67a7330700 1 Processor -- start 2023-09-30T22:25:38.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.526+0000 7f67a7330700 1 -- start start 2023-09-30T22:25:38.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.527+0000 7f67a7330700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67a009b050 0x7f67a01c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.527+0000 7f67a7330700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67a012c5f0 0x7f67a01c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.527+0000 7f67a7330700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f67a006fb00 0x7f67a01c9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.527+0000 7f67a7330700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a0071390 con 0x7f67a009b050 2023-09-30T22:25:38.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.527+0000 7f67a7330700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67a0070cf0 con 0x7f67a012c5f0 2023-09-30T22:25:38.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.527+0000 7f67a7330700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67a0070f40 con 0x7f67a006fb00 2023-09-30T22:25:38.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.527+0000 7f67a50cc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67a009b050 0x7f67a01c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.528+0000 7f67a50cc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67a009b050 0x7f67a01c86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51094/0 (socket says 172.21.15.40:51094) 2023-09-30T22:25:38.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.528+0000 7f67a50cc700 1 -- 172.21.15.40:0/2059505905 learned_addr learned my addr 172.21.15.40:0/2059505905 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:38.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.528+0000 7f67a50cc700 1 -- 172.21.15.40:0/2059505905 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f67a006fb00 msgr2=0x7f67a01c9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.528+0000 7f67a50cc700 1 --2- 172.21.15.40:0/2059505905 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f67a006fb00 0x7f67a01c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.528+0000 7f67a50cc700 1 -- 172.21.15.40:0/2059505905 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67a012c5f0 msgr2=0x7f67a01c8bf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-30T22:25:38.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.528+0000 7f67a50cc700 1 --2- 172.21.15.40:0/2059505905 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67a012c5f0 0x7f67a01c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.528+0000 7f67a50cc700 1 -- 172.21.15.40:0/2059505905 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6798009b30 con 0x7f67a009b050 2023-09-30T22:25:38.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.528+0000 7f67a50cc700 1 --2- 172.21.15.40:0/2059505905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67a009b050 0x7f67a01c86b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f679400c4d0 tx=0x7f679400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:38.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.528+0000 7f6791ffb700 1 -- 172.21.15.40:0/2059505905 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67940054e0 con 0x7f67a009b050 2023-09-30T22:25:38.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.528+0000 7f6791ffb700 1 -- 172.21.15.40:0/2059505905 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6794003680 con 0x7f67a009b050 2023-09-30T22:25:38.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.528+0000 7f67a7330700 1 -- 172.21.15.40:0/2059505905 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67a0071e00 con 0x7f67a009b050 2023-09-30T22:25:38.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.529+0000 7f6791ffb700 1 -- 172.21.15.40:0/2059505905 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6794003a30 con 0x7f67a009b050 2023-09-30T22:25:38.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.529+0000 7f67a7330700 1 -- 172.21.15.40:0/2059505905 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67a006f400 con 0x7f67a009b050 2023-09-30T22:25:38.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.530+0000 7f67a7330700 1 -- 172.21.15.40:0/2059505905 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67a00a1d40 con 0x7f67a009b050 2023-09-30T22:25:38.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.530+0000 7f6791ffb700 1 -- 172.21.15.40:0/2059505905 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6794003b90 con 0x7f67a009b050 2023-09-30T22:25:38.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.531+0000 7f6791ffb700 1 -- 172.21.15.40:0/2059505905 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f679403ec20 con 0x7f67a009b050 2023-09-30T22:25:38.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.540+0000 7f6791ffb700 1 -- 172.21.15.40:0/2059505905 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6794003e40 con 0x7f67a009b050 2023-09-30T22:25:38.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.577+0000 7fe4c711d700 1 Processor -- start 2023-09-30T22:25:38.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.577+0000 7fe4c711d700 1 -- start start 2023-09-30T22:25:38.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.578+0000 7fe4c711d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe4c009c890 0x7fe4c009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.578+0000 7fe4c711d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe4c009e480 0x7fe4c013bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.578+0000 7fe4c711d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4c00a2600 con 0x7fe4c009d920 2023-09-30T22:25:38.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.578+0000 7fe4c711d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c00a29d0 con 0x7fe4c009e480 2023-09-30T22:25:38.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.578+0000 7fe4c711d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c009fb40 con 0x7fe4c009c890 2023-09-30T22:25:38.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.578+0000 7fe4c56ba700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe4c009e480 0x7fe4c013bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.578+0000 7fe4c56ba700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe4c009e480 0x7fe4c013bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60550/0 (socket says 172.21.15.40:60550) 2023-09-30T22:25:38.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.578+0000 7fe4c56ba700 1 -- 172.21.15.40:0/1811053975 learned_addr learned my addr 172.21.15.40:0/1811053975 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:38.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.578+0000 7fe4c56ba700 1 -- 172.21.15.40:0/1811053975 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe4c009c890 msgr2=0x7fe4c009cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:38.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.578+0000 7fe4c56ba700 1 --2- 172.21.15.40:0/1811053975 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe4c009c890 0x7fe4c009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.579+0000 7fe4c56ba700 1 -- 172.21.15.40:0/1811053975 >> v1:172.21.15.40:6789/0 conn(0x7fe4c009d920 legacy=0x7fe4c009dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:38.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.579+0000 7fe4c56ba700 1 -- 172.21.15.40:0/1811053975 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c009fed0 con 0x7fe4c009e480 2023-09-30T22:25:38.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.579+0000 7fe4c56ba700 1 --2- 172.21.15.40:0/1811053975 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe4c009e480 0x7fe4c013bc20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8009e80 tx=0x7fe4b800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55e2b26154d0d361 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:38.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.579+0000 7fe4bf7fe700 1 -- 172.21.15.40:0/1811053975 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b800e070 con 0x7fe4c009e480 2023-09-30T22:25:38.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.579+0000 7fe4bf7fe700 1 -- 172.21.15.40:0/1811053975 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b8003a20 con 0x7fe4c009e480 2023-09-30T22:25:38.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.579+0000 7fe4bf7fe700 1 -- 172.21.15.40:0/1811053975 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b8003dd0 con 0x7fe4c009e480 2023-09-30T22:25:38.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.580+0000 7fe4c711d700 1 -- 172.21.15.40:0/1811053975 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe4c009e480 msgr2=0x7fe4c013bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.580+0000 7fe4c711d700 1 --2- 172.21.15.40:0/1811053975 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe4c009e480 0x7fe4c013bc20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8009e80 tx=0x7fe4b800b330 comp rx=0 tx=0).stop 2023-09-30T22:25:38.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.580+0000 7fe4c711d700 1 -- 172.21.15.40:0/1811053975 shutdown_connections 2023-09-30T22:25:38.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.580+0000 7fe4c711d700 1 --2- 172.21.15.40:0/1811053975 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe4c009e480 0x7fe4c013bc20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.580+0000 7fe4c711d700 1 --2- 172.21.15.40:0/1811053975 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe4c009c890 0x7fe4c009cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.580+0000 7fe4c711d700 1 -- 172.21.15.40:0/1811053975 >> 172.21.15.40:0/1811053975 conn(0x7fe4c00a7080 msgr2=0x7fe4c00a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:38.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.580+0000 7fe4c711d700 1 -- 172.21.15.40:0/1811053975 shutdown_connections 2023-09-30T22:25:38.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.580+0000 7fe4c711d700 1 -- 172.21.15.40:0/1811053975 wait complete. 2023-09-30T22:25:38.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.581+0000 7fe4c711d700 1 Processor -- start 2023-09-30T22:25:38.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.581+0000 7fe4c711d700 1 -- start start 2023-09-30T22:25:38.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.582+0000 7fe4c711d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe4c009c890 0x7fe4c01c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.582+0000 7fe4c711d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe4c009d920 0x7fe4c01c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.582+0000 7fe4c711d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4c009e480 0x7fe4c012d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.582+0000 7fe4c711d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c012f5b0 con 0x7fe4c009e480 2023-09-30T22:25:38.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.582+0000 7fe4c711d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c008f560 con 0x7fe4c009d920 2023-09-30T22:25:38.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.582+0000 7fe4c711d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c01308b0 con 0x7fe4c009c890 2023-09-30T22:25:38.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.582+0000 7fe4bffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe4c009d920 0x7fe4c01c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.582+0000 7fe4bffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe4c009d920 0x7fe4c01c9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60566/0 (socket says 172.21.15.40:60566) 2023-09-30T22:25:38.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.582+0000 7fe4bffff700 1 -- 172.21.15.40:0/1629593753 learned_addr learned my addr 172.21.15.40:0/1629593753 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:38.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.582+0000 7fe4bffff700 1 -- 172.21.15.40:0/1629593753 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe4c009c890 msgr2=0x7fe4c01c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.582+0000 7fe4bffff700 1 --2- 172.21.15.40:0/1629593753 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe4c009c890 0x7fe4c01c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.582+0000 7fe4bffff700 1 -- 172.21.15.40:0/1629593753 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4c009e480 msgr2=0x7fe4c012d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.582+0000 7fe4bffff700 1 --2- 172.21.15.40:0/1629593753 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4c009e480 0x7fe4c012d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.582+0000 7fe4bffff700 1 -- 172.21.15.40:0/1629593753 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b8009b30 con 0x7fe4c009d920 2023-09-30T22:25:38.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.583+0000 7fe4bffff700 1 --2- 172.21.15.40:0/1629593753 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe4c009d920 0x7fe4c01c9190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac00c4a0 tx=0x7fe4ac00c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:38.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.583+0000 7fe4bd7fa700 1 -- 172.21.15.40:0/1629593753 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac0054e0 con 0x7fe4c009d920 2023-09-30T22:25:38.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.583+0000 7fe4bd7fa700 1 -- 172.21.15.40:0/1629593753 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4ac003680 con 0x7fe4c009d920 2023-09-30T22:25:38.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.583+0000 7fe4c711d700 1 -- 172.21.15.40:0/1629593753 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4c00a5d60 con 0x7fe4c009d920 2023-09-30T22:25:38.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.583+0000 7fe4bd7fa700 1 -- 172.21.15.40:0/1629593753 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac003a10 con 0x7fe4c009d920 2023-09-30T22:25:38.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.583+0000 7fe4c711d700 1 -- 172.21.15.40:0/1629593753 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4c0130e50 con 0x7fe4c009d920 2023-09-30T22:25:38.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.584+0000 7fe4bd7fa700 1 -- 172.21.15.40:0/1629593753 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe4ac003b70 con 0x7fe4c009d920 2023-09-30T22:25:38.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.584+0000 7fe4c711d700 1 -- 172.21.15.40:0/1629593753 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4c009bfe0 con 0x7fe4c009d920 2023-09-30T22:25:38.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.584+0000 7fe4bd7fa700 1 -- 172.21.15.40:0/1629593753 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe4ac019e60 con 0x7fe4c009d920 2023-09-30T22:25:38.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.589+0000 7fe4bd7fa700 1 -- 172.21.15.40:0/1629593753 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe4ac017070 con 0x7fe4c009d920 2023-09-30T22:25:38.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.623+0000 7f0681db5700 1 Processor -- start 2023-09-30T22:25:38.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.623+0000 7f0681db5700 1 -- start start 2023-09-30T22:25:38.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.623+0000 7f0681db5700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f067c09c890 0x7f067c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.623+0000 7f0681db5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f067c09e480 0x7f067c13bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.623+0000 7f0681db5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f067c0a2600 con 0x7f067c09d920 2023-09-30T22:25:38.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.623+0000 7f0681db5700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f067c0a29d0 con 0x7f067c09c890 2023-09-30T22:25:38.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.623+0000 7f0681db5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f067c09fb40 con 0x7f067c09e480 2023-09-30T22:25:38.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.624+0000 7f067bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f067c09e480 0x7f067c13bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.624+0000 7f067affd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f067c09d920 0x7f067c09dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45640/0 (socket says 172.21.15.40:45640) 2023-09-30T22:25:38.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.624+0000 7f067affd700 1 -- 172.21.15.40:0/1194336922 learned_addr learned my addr 172.21.15.40:0/1194336922 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:38.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.624+0000 7f067bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f067c09e480 0x7f067c13bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60580/0 (socket says 172.21.15.40:60580) 2023-09-30T22:25:38.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.624+0000 7f067b7fe700 1 --2- 172.21.15.40:0/1194336922 >> v2:172.21.15.40:3300/0 conn(0x7f067c09c890 0x7f067c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.624+0000 7f067bfff700 1 -- 172.21.15.40:0/1194336922 >> v2:172.21.15.40:3300/0 conn(0x7f067c09c890 msgr2=0x7f067c09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:38.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.624+0000 7f067bfff700 1 --2- 172.21.15.40:0/1194336922 >> v2:172.21.15.40:3300/0 conn(0x7f067c09c890 0x7f067c09cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.624+0000 7f067a7fc700 1 -- 172.21.15.40:0/1194336922 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1343011104 0 0) 0x7f067c0a2600 con 0x7f067c09d920 2023-09-30T22:25:38.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.624+0000 7f067bfff700 1 -- 172.21.15.40:0/1194336922 >> v1:172.21.15.40:6789/0 conn(0x7f067c09d920 legacy=0x7f067c09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.624+0000 7f067bfff700 1 -- 172.21.15.40:0/1194336922 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f067c09fed0 con 0x7f067c09e480 2023-09-30T22:25:38.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.624+0000 7f067bfff700 1 --2- 172.21.15.40:0/1194336922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f067c09e480 0x7f067c13bc20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0674009d90 tx=0x7f067400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31d9c7df5a3bdb8a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:38.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.624+0000 7f067a7fc700 1 -- 172.21.15.40:0/1194336922 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067400e070 con 0x7f067c09e480 2023-09-30T22:25:38.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.624+0000 7f067a7fc700 1 -- 172.21.15.40:0/1194336922 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067400bb20 con 0x7f067c09e480 2023-09-30T22:25:38.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.624+0000 7f067a7fc700 1 -- 172.21.15.40:0/1194336922 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0674012430 con 0x7f067c09e480 2023-09-30T22:25:38.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.625+0000 7f0681db5700 1 -- 172.21.15.40:0/1194336922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f067c09e480 msgr2=0x7f067c13bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.625+0000 7f0681db5700 1 --2- 172.21.15.40:0/1194336922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f067c09e480 0x7f067c13bc20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0674009d90 tx=0x7f067400b330 comp rx=0 tx=0).stop 2023-09-30T22:25:38.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.625+0000 7f0681db5700 1 -- 172.21.15.40:0/1194336922 shutdown_connections 2023-09-30T22:25:38.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.625+0000 7f0681db5700 1 --2- 172.21.15.40:0/1194336922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f067c09e480 0x7f067c13bc20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.625+0000 7f0681db5700 1 --2- 172.21.15.40:0/1194336922 >> v2:172.21.15.40:3300/0 conn(0x7f067c09c890 0x7f067c09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.625+0000 7f0681db5700 1 -- 172.21.15.40:0/1194336922 >> 172.21.15.40:0/1194336922 conn(0x7f067c0a7080 msgr2=0x7f067c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:38.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.625+0000 7f0681db5700 1 -- 172.21.15.40:0/1194336922 shutdown_connections 2023-09-30T22:25:38.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.625+0000 7f0681db5700 1 -- 172.21.15.40:0/1194336922 wait complete. 2023-09-30T22:25:38.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.626+0000 7f0681db5700 1 Processor -- start 2023-09-30T22:25:38.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.626+0000 7f0681db5700 1 -- start start 2023-09-30T22:25:38.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.627+0000 7f0681db5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f067c09c890 0x7f067c12b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.627+0000 7f0681db5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f067c09d920 0x7f067c12ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.627+0000 7f0681db5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f067c09e480 0x7f067c12bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.627+0000 7f0681db5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f067c12caa0 con 0x7f067c09c890 2023-09-30T22:25:38.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.627+0000 7f0681db5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f067c0a5a40 con 0x7f067c09e480 2023-09-30T22:25:38.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.627+0000 7f0681db5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f067c09ecf0 con 0x7f067c09d920 2023-09-30T22:25:38.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.627+0000 7f067bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f067c09e480 0x7f067c12bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.627+0000 7f067bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f067c09e480 0x7f067c12bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60586/0 (socket says 172.21.15.40:60586) 2023-09-30T22:25:38.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.627+0000 7f067bfff700 1 -- 172.21.15.40:0/2019764634 learned_addr learned my addr 172.21.15.40:0/2019764634 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:38.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.627+0000 7f067b7fe700 1 --2- 172.21.15.40:0/2019764634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f067c09c890 0x7f067c12b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.627+0000 7f067bfff700 1 -- 172.21.15.40:0/2019764634 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f067c09d920 msgr2=0x7f067c12ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.627+0000 7f067bfff700 1 --2- 172.21.15.40:0/2019764634 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f067c09d920 0x7f067c12ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.627+0000 7f067bfff700 1 -- 172.21.15.40:0/2019764634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f067c09c890 msgr2=0x7f067c12b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.627+0000 7f067bfff700 1 --2- 172.21.15.40:0/2019764634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f067c09c890 0x7f067c12b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.627+0000 7f067bfff700 1 -- 172.21.15.40:0/2019764634 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0674009a70 con 0x7f067c09e480 2023-09-30T22:25:38.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.627+0000 7f067bfff700 1 --2- 172.21.15.40:0/2019764634 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f067c09e480 0x7f067c12bf60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f067c09fc80 tx=0x7f0674004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:38.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.628+0000 7fb85b9c2700 1 -- 172.21.15.40:0/2732902351 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb854062380 con 0x7fb85409dd60 2023-09-30T22:25:38.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.627+0000 7f0663fff700 1 -- 172.21.15.40:0/2019764634 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0674012430 con 0x7f067c09e480 2023-09-30T22:25:38.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.628+0000 7f0663fff700 1 -- 172.21.15.40:0/2019764634 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0674020070 con 0x7f067c09e480 2023-09-30T22:25:38.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.628+0000 7f0663fff700 1 -- 172.21.15.40:0/2019764634 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0674004040 con 0x7f067c09e480 2023-09-30T22:25:38.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.628+0000 7f0681db5700 1 -- 172.21.15.40:0/2019764634 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f067c12e8c0 con 0x7f067c09e480 2023-09-30T22:25:38.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.628+0000 7f0681db5700 1 -- 172.21.15.40:0/2019764634 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f067c071980 con 0x7f067c09e480 2023-09-30T22:25:38.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.628+0000 7fb849ffb700 1 -- 172.21.15.40:0/2732902351 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb844017020 con 0x7fb85409dd60 2023-09-30T22:25:38.632 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:38.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.629+0000 7f0681db5700 1 -- 172.21.15.40:0/2019764634 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f067c06e600 con 0x7f067c09e480 2023-09-30T22:25:38.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.629+0000 7f0663fff700 1 -- 172.21.15.40:0/2019764634 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f06740041a0 con 0x7f067c09e480 2023-09-30T22:25:38.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.630+0000 7f0663fff700 1 -- 172.21.15.40:0/2019764634 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f0674022070 con 0x7f067c09e480 2023-09-30T22:25:38.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.630+0000 7fb85b9c2700 1 -- 172.21.15.40:0/2732902351 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb85409dd60 msgr2=0x7fb854131260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.630+0000 7fb85b9c2700 1 --2- 172.21.15.40:0/2732902351 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb85409dd60 0x7fb854131260 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb84400c4e0 tx=0x7fb84400c7f0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.631+0000 7fb85b9c2700 1 -- 172.21.15.40:0/2732902351 shutdown_connections 2023-09-30T22:25:38.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.631+0000 7fb85b9c2700 1 --2- 172.21.15.40:0/2732902351 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb85409d450 0x7fb854130d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.631+0000 7fb85b9c2700 1 --2- 172.21.15.40:0/2732902351 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8541308d0 0x7fb8541317a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.631+0000 7fb85b9c2700 1 --2- 172.21.15.40:0/2732902351 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb85409dd60 0x7fb854131260 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.631+0000 7fb85b9c2700 1 -- 172.21.15.40:0/2732902351 >> 172.21.15.40:0/2732902351 conn(0x7fb8540a2a00 msgr2=0x7fb854070390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:38.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.631+0000 7fb85b9c2700 1 -- 172.21.15.40:0/2732902351 shutdown_connections 2023-09-30T22:25:38.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.631+0000 7fb85b9c2700 1 -- 172.21.15.40:0/2732902351 wait complete. 2023-09-30T22:25:38.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.634+0000 7f0663fff700 1 -- 172.21.15.40:0/2019764634 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0674004450 con 0x7f067c09e480 2023-09-30T22:25:38.648 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:38.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.783+0000 7f67a7330700 1 -- 172.21.15.40:0/2059505905 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f67a0062380 con 0x7f67a009b050 2023-09-30T22:25:38.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.783+0000 7f6791ffb700 1 -- 172.21.15.40:0/2059505905 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6794017070 con 0x7f67a009b050 2023-09-30T22:25:38.784 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:38.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.785+0000 7f67a7330700 1 -- 172.21.15.40:0/2059505905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67a009b050 msgr2=0x7f67a01c86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.785+0000 7f67a7330700 1 --2- 172.21.15.40:0/2059505905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67a009b050 0x7f67a01c86b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f679400c4d0 tx=0x7f679400c890 comp rx=0 tx=0).stop 2023-09-30T22:25:38.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.785+0000 7f67a7330700 1 -- 172.21.15.40:0/2059505905 shutdown_connections 2023-09-30T22:25:38.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.785+0000 7f67a7330700 1 --2- 172.21.15.40:0/2059505905 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f67a006fb00 0x7f67a01c9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.785+0000 7f67a7330700 1 --2- 172.21.15.40:0/2059505905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67a009b050 0x7f67a01c86b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.785+0000 7f67a7330700 1 --2- 172.21.15.40:0/2059505905 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67a012c5f0 0x7f67a01c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.785+0000 7f67a7330700 1 -- 172.21.15.40:0/2059505905 >> 172.21.15.40:0/2059505905 conn(0x7f67a00a2c70 msgr2=0x7f67a012b090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:38.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.785+0000 7f67a7330700 1 -- 172.21.15.40:0/2059505905 shutdown_connections 2023-09-30T22:25:38.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.785+0000 7f67a7330700 1 -- 172.21.15.40:0/2059505905 wait complete. 2023-09-30T22:25:38.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.788+0000 7fe4c711d700 1 -- 172.21.15.40:0/1629593753 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe4c0062380 con 0x7fe4c009d920 2023-09-30T22:25:38.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.789+0000 7fe4bd7fa700 1 -- 172.21.15.40:0/1629593753 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe4ac02ce60 con 0x7fe4c009d920 2023-09-30T22:25:38.789 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:38.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.792+0000 7fe4c711d700 1 -- 172.21.15.40:0/1629593753 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe4c009d920 msgr2=0x7fe4c01c9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.792+0000 7fe4c711d700 1 --2- 172.21.15.40:0/1629593753 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe4c009d920 0x7fe4c01c9190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac00c4a0 tx=0x7fe4ac00c860 comp rx=0 tx=0).stop 2023-09-30T22:25:38.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.793+0000 7fe4c711d700 1 -- 172.21.15.40:0/1629593753 shutdown_connections 2023-09-30T22:25:38.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.793+0000 7fe4c711d700 1 --2- 172.21.15.40:0/1629593753 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe4c009c890 0x7fe4c01c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.793+0000 7fe4c711d700 1 --2- 172.21.15.40:0/1629593753 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4c009e480 0x7fe4c012d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.793+0000 7fe4c711d700 1 --2- 172.21.15.40:0/1629593753 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe4c009d920 0x7fe4c01c9190 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.793+0000 7fe4c711d700 1 -- 172.21.15.40:0/1629593753 >> 172.21.15.40:0/1629593753 conn(0x7fe4c00a7080 msgr2=0x7fe4c00a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:38.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.793+0000 7fe4c711d700 1 -- 172.21.15.40:0/1629593753 shutdown_connections 2023-09-30T22:25:38.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.793+0000 7fe4c711d700 1 -- 172.21.15.40:0/1629593753 wait complete. 2023-09-30T22:25:38.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:38.808 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:38.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.839+0000 7f0681db5700 1 -- 172.21.15.40:0/2019764634 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f067c062380 con 0x7f067c09e480 2023-09-30T22:25:38.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.839+0000 7f0663fff700 1 -- 172.21.15.40:0/2019764634 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f067402c020 con 0x7f067c09e480 2023-09-30T22:25:38.840 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:38.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.841+0000 7f0681db5700 1 -- 172.21.15.40:0/2019764634 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f067c09e480 msgr2=0x7f067c12bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.841+0000 7f0681db5700 1 --2- 172.21.15.40:0/2019764634 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f067c09e480 0x7f067c12bf60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f067c09fc80 tx=0x7f0674004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.841+0000 7f0681db5700 1 -- 172.21.15.40:0/2019764634 shutdown_connections 2023-09-30T22:25:38.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.841+0000 7f0681db5700 1 --2- 172.21.15.40:0/2019764634 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f067c09e480 0x7f067c12bf60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.841+0000 7f0681db5700 1 --2- 172.21.15.40:0/2019764634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f067c09c890 0x7f067c12b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.841+0000 7f0681db5700 1 --2- 172.21.15.40:0/2019764634 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f067c09d920 0x7f067c12ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.841+0000 7f0681db5700 1 -- 172.21.15.40:0/2019764634 >> 172.21.15.40:0/2019764634 conn(0x7f067c0a7080 msgr2=0x7f067c1bb080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:38.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.841+0000 7f0681db5700 1 -- 172.21.15.40:0/2019764634 shutdown_connections 2023-09-30T22:25:38.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:38.841+0000 7f0681db5700 1 -- 172.21.15.40:0/2019764634 wait complete. 2023-09-30T22:25:38.854 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:39.649 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:39.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.789+0000 7ff4d240b700 1 Processor -- start 2023-09-30T22:25:39.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.789+0000 7ff4d240b700 1 -- start start 2023-09-30T22:25:39.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.789+0000 7ff4d240b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff4cc09d920 0x7ff4cc09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.789+0000 7ff4d240b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff4cc09e230 0x7ff4cc1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.789+0000 7ff4d240b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4cc09f940 con 0x7ff4cc09f0f0 2023-09-30T22:25:39.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.789+0000 7ff4d240b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4cc06b4c0 con 0x7ff4cc09d920 2023-09-30T22:25:39.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.789+0000 7ff4d240b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4cc09a8f0 con 0x7ff4cc09e230 2023-09-30T22:25:39.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.790+0000 7ff4cbfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff4cc09d920 0x7ff4cc09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.790+0000 7ff4d09a8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff4cc09e230 0x7ff4cc1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.790+0000 7ff4cbfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff4cc09d920 0x7ff4cc09dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51144/0 (socket says 172.21.15.40:51144) 2023-09-30T22:25:39.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.790+0000 7ff4cbfff700 1 -- 172.21.15.40:0/987612876 learned_addr learned my addr 172.21.15.40:0/987612876 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:39.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.790+0000 7ff4cbfff700 1 -- 172.21.15.40:0/987612876 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff4cc09e230 msgr2=0x7ff4cc1343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:39.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.790+0000 7ff4cbfff700 1 --2- 172.21.15.40:0/987612876 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff4cc09e230 0x7ff4cc1343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.790+0000 7ff4cbfff700 1 -- 172.21.15.40:0/987612876 >> v1:172.21.15.40:6789/0 conn(0x7ff4cc09f0f0 legacy=0x7ff4cc133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:39.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.790+0000 7ff4cbfff700 1 -- 172.21.15.40:0/987612876 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4cc09f6e0 con 0x7ff4cc09d920 2023-09-30T22:25:39.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.790+0000 7ff4d09a8700 1 --2- 172.21.15.40:0/987612876 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff4cc09e230 0x7ff4cc1343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:39.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.790+0000 7ff4cbfff700 1 --2- 172.21.15.40:0/987612876 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4cc09d920 0x7ff4cc09dcf0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc006fd0 tx=0x7ff4bc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a10f0dd745497e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:39.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.790+0000 7ff4caffd700 1 -- 172.21.15.40:0/987612876 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc005e30 con 0x7ff4cc09d920 2023-09-30T22:25:39.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.790+0000 7ff4caffd700 1 -- 172.21.15.40:0/987612876 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4bc004030 con 0x7ff4cc09d920 2023-09-30T22:25:39.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.790+0000 7ff4caffd700 1 -- 172.21.15.40:0/987612876 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc0043e0 con 0x7ff4cc09d920 2023-09-30T22:25:39.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.791+0000 7ff4d240b700 1 -- 172.21.15.40:0/987612876 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4cc09d920 msgr2=0x7ff4cc09dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:39.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.791+0000 7ff4d240b700 1 --2- 172.21.15.40:0/987612876 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4cc09d920 0x7ff4cc09dcf0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc006fd0 tx=0x7ff4bc009bd0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.791+0000 7ff4d240b700 1 -- 172.21.15.40:0/987612876 shutdown_connections 2023-09-30T22:25:39.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.791+0000 7ff4d240b700 1 --2- 172.21.15.40:0/987612876 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff4cc09e230 0x7ff4cc1343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.791+0000 7ff4d240b700 1 --2- 172.21.15.40:0/987612876 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4cc09d920 0x7ff4cc09dcf0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.791+0000 7ff4d240b700 1 -- 172.21.15.40:0/987612876 >> 172.21.15.40:0/987612876 conn(0x7ff4cc09fb20 msgr2=0x7ff4cc09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:39.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.791+0000 7ff4d240b700 1 -- 172.21.15.40:0/987612876 shutdown_connections 2023-09-30T22:25:39.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.791+0000 7ff4d240b700 1 -- 172.21.15.40:0/987612876 wait complete. 2023-09-30T22:25:39.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.792+0000 7ff4d240b700 1 Processor -- start 2023-09-30T22:25:39.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.792+0000 7ff4d240b700 1 -- start start 2023-09-30T22:25:39.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.793+0000 7ff4d240b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff4cc09d920 0x7ff4cc1a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.793+0000 7ff4d240b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4cc09e230 0x7ff4cc1a68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.793+0000 7ff4d240b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4cc1a6e10 0x7ff4cc1cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.793+0000 7ff4d240b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4cc1a7860 con 0x7ff4cc1a6e10 2023-09-30T22:25:39.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.793+0000 7ff4d240b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4cc1b9780 con 0x7ff4cc09e230 2023-09-30T22:25:39.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.793+0000 7ff4d240b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4cc1a91f0 con 0x7ff4cc09d920 2023-09-30T22:25:39.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.793+0000 7ff4cbfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff4cc09d920 0x7ff4cc1a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.793+0000 7ff4cbfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff4cc09d920 0x7ff4cc1a6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55484/0 (socket says 172.21.15.40:55484) 2023-09-30T22:25:39.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.793+0000 7ff4cbfff700 1 -- 172.21.15.40:0/3831759603 learned_addr learned my addr 172.21.15.40:0/3831759603 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:39.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.793+0000 7ff4d09a8700 1 --2- 172.21.15.40:0/3831759603 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4cc1a6e10 0x7ff4cc1cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.793+0000 7ff4cb7fe700 1 --2- 172.21.15.40:0/3831759603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4cc09e230 0x7ff4cc1a68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.793+0000 7ff4cbfff700 1 -- 172.21.15.40:0/3831759603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4cc09e230 msgr2=0x7ff4cc1a68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:39.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.793+0000 7ff4cbfff700 1 --2- 172.21.15.40:0/3831759603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4cc09e230 0x7ff4cc1a68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.793+0000 7ff4cbfff700 1 -- 172.21.15.40:0/3831759603 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4cc1a6e10 msgr2=0x7ff4cc1cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:39.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.793+0000 7ff4cbfff700 1 --2- 172.21.15.40:0/3831759603 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4cc1a6e10 0x7ff4cc1cecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.793+0000 7ff4cbfff700 1 -- 172.21.15.40:0/3831759603 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c4009a70 con 0x7ff4cc09d920 2023-09-30T22:25:39.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.794+0000 7ff4cbfff700 1 --2- 172.21.15.40:0/3831759603 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff4cc09d920 0x7ff4cc1a6390 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc004000 tx=0x7ff4bc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:39.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.794+0000 7ff4c8ff9700 1 -- 172.21.15.40:0/3831759603 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc003ce0 con 0x7ff4cc09d920 2023-09-30T22:25:39.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.794+0000 7ff4c8ff9700 1 -- 172.21.15.40:0/3831759603 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4bc003e40 con 0x7ff4cc09d920 2023-09-30T22:25:39.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.794+0000 7ff4d240b700 1 -- 172.21.15.40:0/3831759603 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4bc009500 con 0x7ff4cc09d920 2023-09-30T22:25:39.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.794+0000 7ff4c8ff9700 1 -- 172.21.15.40:0/3831759603 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc01c640 con 0x7ff4cc09d920 2023-09-30T22:25:39.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.794+0000 7ff4d240b700 1 -- 172.21.15.40:0/3831759603 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4cc1a9640 con 0x7ff4cc09d920 2023-09-30T22:25:39.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.795+0000 7ff4c8ff9700 1 -- 172.21.15.40:0/3831759603 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff4bc01c7a0 con 0x7ff4cc09d920 2023-09-30T22:25:39.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.795+0000 7ff4c8ff9700 1 -- 172.21.15.40:0/3831759603 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff4bc040670 con 0x7ff4cc09d920 2023-09-30T22:25:39.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.795+0000 7ff4d240b700 1 -- 172.21.15.40:0/3831759603 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4cc0a34b0 con 0x7ff4cc09d920 2023-09-30T22:25:39.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.800+0000 7ff4c8ff9700 1 -- 172.21.15.40:0/3831759603 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff4bc02a020 con 0x7ff4cc09d920 2023-09-30T22:25:39.804 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:39.809 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:39.855 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:39.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.936+0000 7fe15ba40700 1 Processor -- start 2023-09-30T22:25:39.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.936+0000 7fe15ba40700 1 -- start start 2023-09-30T22:25:39.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.937+0000 7fe15ba40700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe15409d450 0x7fe15409d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.937+0000 7fe15ba40700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe15409dd60 0x7fe1541301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.937+0000 7fe15ba40700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe15409c3b0 con 0x7fe154130700 2023-09-30T22:25:39.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.937+0000 7fe15ba40700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe15409a6b0 con 0x7fe15409d450 2023-09-30T22:25:39.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.937+0000 7fe15ba40700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe15409b4f0 con 0x7fe15409dd60 2023-09-30T22:25:39.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.937+0000 7fe1597dc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe15409d450 0x7fe15409d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.937+0000 7fe158fdb700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe15409dd60 0x7fe1541301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.937+0000 7fe1597dc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe15409d450 0x7fe15409d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51160/0 (socket says 172.21.15.40:51160) 2023-09-30T22:25:39.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.937+0000 7fe158fdb700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe15409dd60 0x7fe1541301c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55498/0 (socket says 172.21.15.40:55498) 2023-09-30T22:25:39.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.937+0000 7fe1597dc700 1 -- 172.21.15.40:0/1470226733 learned_addr learned my addr 172.21.15.40:0/1470226733 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:39.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.937+0000 7fe158fdb700 1 -- 172.21.15.40:0/1470226733 >> v2:172.21.15.40:3300/0 conn(0x7fe15409d450 msgr2=0x7fe15409d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:39.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.937+0000 7fe158fdb700 1 --2- 172.21.15.40:0/1470226733 >> v2:172.21.15.40:3300/0 conn(0x7fe15409d450 0x7fe15409d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.937+0000 7fe158fdb700 1 -- 172.21.15.40:0/1470226733 >> v1:172.21.15.40:6789/0 conn(0x7fe154130700 legacy=0x7fe154137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:39.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.938+0000 7fe158fdb700 1 -- 172.21.15.40:0/1470226733 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe15409af90 con 0x7fe15409dd60 2023-09-30T22:25:39.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.938+0000 7fe158fdb700 1 --2- 172.21.15.40:0/1470226733 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe15409dd60 0x7fe1541301c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe144009840 tx=0x7fe144009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e5d6a2e1456ddbe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:39.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.938+0000 7fe14bfff700 1 -- 172.21.15.40:0/1470226733 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe144011830 con 0x7fe15409dd60 2023-09-30T22:25:39.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.938+0000 7fe14bfff700 1 -- 172.21.15.40:0/1470226733 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe144011990 con 0x7fe15409dd60 2023-09-30T22:25:39.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.938+0000 7fe14bfff700 1 -- 172.21.15.40:0/1470226733 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe144011d20 con 0x7fe15409dd60 2023-09-30T22:25:39.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.939+0000 7fe15ba40700 1 -- 172.21.15.40:0/1470226733 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe15409dd60 msgr2=0x7fe1541301c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:39.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.939+0000 7fe15ba40700 1 --2- 172.21.15.40:0/1470226733 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe15409dd60 0x7fe1541301c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe144009840 tx=0x7fe144009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:39.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.939+0000 7fe15ba40700 1 -- 172.21.15.40:0/1470226733 shutdown_connections 2023-09-30T22:25:39.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.939+0000 7fe15ba40700 1 --2- 172.21.15.40:0/1470226733 >> v2:172.21.15.40:3300/0 conn(0x7fe15409d450 0x7fe15409d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.939+0000 7fe15ba40700 1 --2- 172.21.15.40:0/1470226733 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe15409dd60 0x7fe1541301c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.939+0000 7fe15ba40700 1 -- 172.21.15.40:0/1470226733 >> 172.21.15.40:0/1470226733 conn(0x7fe1540a2a00 msgr2=0x7fe1540a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:39.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.939+0000 7fe15ba40700 1 -- 172.21.15.40:0/1470226733 shutdown_connections 2023-09-30T22:25:39.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.939+0000 7fe15ba40700 1 -- 172.21.15.40:0/1470226733 wait complete. 2023-09-30T22:25:39.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.940+0000 7fe15ba40700 1 Processor -- start 2023-09-30T22:25:39.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.940+0000 7fe15ba40700 1 -- start start 2023-09-30T22:25:39.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.941+0000 7fe15ba40700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe15409d450 0x7fe15411bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.941+0000 7fe15ba40700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe15409dd60 0x7fe15411c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.941+0000 7fe15ba40700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe154130700 0x7fe1541c40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.941+0000 7fe15ba40700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15411c700 con 0x7fe15409d450 2023-09-30T22:25:39.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.941+0000 7fe15ba40700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe15411ee80 con 0x7fe154130700 2023-09-30T22:25:39.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.941+0000 7fe15ba40700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe15411b770 con 0x7fe15409dd60 2023-09-30T22:25:39.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.941+0000 7fe1597dc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe15409d450 0x7fe15411bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.941+0000 7fe1597dc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe15409d450 0x7fe15411bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51174/0 (socket says 172.21.15.40:51174) 2023-09-30T22:25:39.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.941+0000 7fe158fdb700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe15409dd60 0x7fe15411c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.941+0000 7fe1597dc700 1 -- 172.21.15.40:0/1668606503 learned_addr learned my addr 172.21.15.40:0/1668606503 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:39.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.941+0000 7fe158fdb700 1 -- 172.21.15.40:0/1668606503 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe154130700 msgr2=0x7fe1541c40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:39.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.941+0000 7fe158fdb700 1 --2- 172.21.15.40:0/1668606503 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe154130700 0x7fe1541c40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.941+0000 7fe158fdb700 1 -- 172.21.15.40:0/1668606503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe15409d450 msgr2=0x7fe15411bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:39.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.942+0000 7fe158fdb700 1 --2- 172.21.15.40:0/1668606503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe15409d450 0x7fe15411bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.942+0000 7fe158fdb700 1 -- 172.21.15.40:0/1668606503 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1440094a0 con 0x7fe15409dd60 2023-09-30T22:25:39.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.942+0000 7fe1597dc700 1 --2- 172.21.15.40:0/1668606503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe15409d450 0x7fe15411bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:39.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.942+0000 7fe158fdb700 1 --2- 172.21.15.40:0/1668606503 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe15409dd60 0x7fe15411c1c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe144016000 tx=0x7fe144004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:39.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.942+0000 7fe149ffb700 1 -- 172.21.15.40:0/1668606503 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1440043c0 con 0x7fe15409dd60 2023-09-30T22:25:39.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.942+0000 7fe149ffb700 1 -- 172.21.15.40:0/1668606503 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14401f070 con 0x7fe15409dd60 2023-09-30T22:25:39.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.942+0000 7fe149ffb700 1 -- 172.21.15.40:0/1668606503 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1440036a0 con 0x7fe15409dd60 2023-09-30T22:25:39.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.943+0000 7fe15ba40700 1 -- 172.21.15.40:0/1668606503 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1540a2400 con 0x7fe15409dd60 2023-09-30T22:25:39.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.943+0000 7fe15ba40700 1 -- 172.21.15.40:0/1668606503 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe15411dae0 con 0x7fe15409dd60 2023-09-30T22:25:39.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.944+0000 7fe149ffb700 1 -- 172.21.15.40:0/1668606503 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe144021030 con 0x7fe15409dd60 2023-09-30T22:25:39.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.944+0000 7fe149ffb700 1 -- 172.21.15.40:0/1668606503 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe144040a70 con 0x7fe15409dd60 2023-09-30T22:25:39.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.944+0000 7fe1377fe700 1 -- 172.21.15.40:0/1668606503 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1300052e0 con 0x7fe15409dd60 2023-09-30T22:25:39.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.953+0000 7fe149ffb700 1 -- 172.21.15.40:0/1668606503 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe144022970 con 0x7fe15409dd60 2023-09-30T22:25:39.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.983+0000 7f1283878700 1 Processor -- start 2023-09-30T22:25:39.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.983+0000 7f1283878700 1 -- start start 2023-09-30T22:25:39.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.984+0000 7f1283878700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f127c12e590 0x7f127c12e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.984+0000 7f1283878700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f127c12eea0 0x7f127c12d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.984+0000 7f1283878700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f127c12d6d0 0x7f127c12db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.984+0000 7f1283878700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f127c09ca30 con 0x7f127c12d6d0 2023-09-30T22:25:39.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.984+0000 7f1283878700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f127c09ab70 con 0x7f127c12e590 2023-09-30T22:25:39.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.984+0000 7f1283878700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f127c09bd70 con 0x7f127c12eea0 2023-09-30T22:25:39.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.984+0000 7f1281e15700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f127c12d6d0 0x7f127c12db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.984+0000 7f1280e13700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f127c12eea0 0x7f127c12d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.984+0000 7f1280e13700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f127c12eea0 0x7f127c12d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55522/0 (socket says 172.21.15.40:55522) 2023-09-30T22:25:39.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.984+0000 7f1281e15700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f127c12d6d0 0x7f127c12db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51188/0 (socket says 172.21.15.40:51188) 2023-09-30T22:25:39.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.984+0000 7f1280e13700 1 -- 172.21.15.40:0/835737443 learned_addr learned my addr 172.21.15.40:0/835737443 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:39.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.984+0000 7f1281614700 1 --2- 172.21.15.40:0/835737443 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f127c12e590 0x7f127c12e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.984+0000 7f1280e13700 1 -- 172.21.15.40:0/835737443 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f127c12e590 msgr2=0x7f127c12e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:39.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.984+0000 7f1280e13700 1 --2- 172.21.15.40:0/835737443 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f127c12e590 0x7f127c12e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.984+0000 7f1280e13700 1 -- 172.21.15.40:0/835737443 >> v2:172.21.15.40:3300/0 conn(0x7f127c12d6d0 msgr2=0x7f127c12db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:39.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.984+0000 7f1280e13700 1 --2- 172.21.15.40:0/835737443 >> v2:172.21.15.40:3300/0 conn(0x7f127c12d6d0 0x7f127c12db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.985+0000 7f1280e13700 1 -- 172.21.15.40:0/835737443 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f127c09b270 con 0x7f127c12eea0 2023-09-30T22:25:39.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.985+0000 7f1281614700 1 --2- 172.21.15.40:0/835737443 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f127c12e590 0x7f127c12e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:39.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.985+0000 7f1280e13700 1 --2- 172.21.15.40:0/835737443 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f127c12eea0 0x7f127c12d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f126c00dd20 tx=0x7f126c00f330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52839fc634cfdc78 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:39.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.985+0000 7f1273fff700 1 -- 172.21.15.40:0/835737443 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c012070 con 0x7f127c12eea0 2023-09-30T22:25:39.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.985+0000 7f1273fff700 1 -- 172.21.15.40:0/835737443 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126c00de70 con 0x7f127c12eea0 2023-09-30T22:25:39.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.985+0000 7f1273fff700 1 -- 172.21.15.40:0/835737443 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c00fd20 con 0x7f127c12eea0 2023-09-30T22:25:39.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.986+0000 7f1283878700 1 -- 172.21.15.40:0/835737443 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f127c12eea0 msgr2=0x7f127c12d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:39.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.986+0000 7f1283878700 1 --2- 172.21.15.40:0/835737443 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f127c12eea0 0x7f127c12d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f126c00dd20 tx=0x7f126c00f330 comp rx=0 tx=0).stop 2023-09-30T22:25:39.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.986+0000 7f1283878700 1 -- 172.21.15.40:0/835737443 shutdown_connections 2023-09-30T22:25:39.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.986+0000 7f1283878700 1 --2- 172.21.15.40:0/835737443 >> v2:172.21.15.40:3300/0 conn(0x7f127c12d6d0 0x7f127c12db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.986+0000 7f1283878700 1 --2- 172.21.15.40:0/835737443 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f127c12e590 0x7f127c12e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.986+0000 7f1283878700 1 --2- 172.21.15.40:0/835737443 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f127c12eea0 0x7f127c12d190 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.986+0000 7f1283878700 1 -- 172.21.15.40:0/835737443 >> 172.21.15.40:0/835737443 conn(0x7f127c0a2a00 msgr2=0x7f127c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:39.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.986+0000 7f1283878700 1 -- 172.21.15.40:0/835737443 shutdown_connections 2023-09-30T22:25:39.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.986+0000 7f1283878700 1 -- 172.21.15.40:0/835737443 wait complete. 2023-09-30T22:25:39.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.987+0000 7f1283878700 1 Processor -- start 2023-09-30T22:25:39.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.987+0000 7f1283878700 1 -- start start 2023-09-30T22:25:39.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.987+0000 7f1283878700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f127c12d6d0 0x7f127c119910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.987+0000 7f1283878700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f127c12e590 0x7f127c119e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.987+0000 7f1283878700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f127c12eea0 0x7f127c11a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.987+0000 7f1283878700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127c11cc10 con 0x7f127c12d6d0 2023-09-30T22:25:39.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.987+0000 7f1283878700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f127c11b530 con 0x7f127c12eea0 2023-09-30T22:25:39.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.987+0000 7f1283878700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f127c11d0c0 con 0x7f127c12e590 2023-09-30T22:25:39.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.988+0000 7f1281e15700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f127c12eea0 0x7f127c11a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.988+0000 7f1281e15700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f127c12eea0 0x7f127c11a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60630/0 (socket says 172.21.15.40:60630) 2023-09-30T22:25:39.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.988+0000 7f1281e15700 1 -- 172.21.15.40:0/237171548 learned_addr learned my addr 172.21.15.40:0/237171548 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:39.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.988+0000 7f1281614700 1 --2- 172.21.15.40:0/237171548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f127c12d6d0 0x7f127c119910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.988+0000 7f1280e13700 1 --2- 172.21.15.40:0/237171548 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f127c12e590 0x7f127c119e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.988+0000 7f1281e15700 1 -- 172.21.15.40:0/237171548 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f127c12e590 msgr2=0x7f127c119e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:39.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.988+0000 7f1281e15700 1 --2- 172.21.15.40:0/237171548 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f127c12e590 0x7f127c119e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.988+0000 7f1281e15700 1 -- 172.21.15.40:0/237171548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f127c12d6d0 msgr2=0x7f127c119910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:39.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.988+0000 7f1281e15700 1 --2- 172.21.15.40:0/237171548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f127c12d6d0 0x7f127c119910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.988+0000 7f1281e15700 1 -- 172.21.15.40:0/237171548 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126c00da00 con 0x7f127c12eea0 2023-09-30T22:25:39.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.988+0000 7f1281e15700 1 --2- 172.21.15.40:0/237171548 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f127c12eea0 0x7f127c11a390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f127400ef00 tx=0x7f127400b390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:39.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.988+0000 7f1271ffb700 1 -- 172.21.15.40:0/237171548 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1274010040 con 0x7f127c12eea0 2023-09-30T22:25:39.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.988+0000 7f1271ffb700 1 -- 172.21.15.40:0/237171548 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127400bd30 con 0x7f127c12eea0 2023-09-30T22:25:39.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.988+0000 7f1283878700 1 -- 172.21.15.40:0/237171548 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f127c09fd50 con 0x7f127c12eea0 2023-09-30T22:25:39.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.988+0000 7f1271ffb700 1 -- 172.21.15.40:0/237171548 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127400bea0 con 0x7f127c12eea0 2023-09-30T22:25:39.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.989+0000 7f1283878700 1 -- 172.21.15.40:0/237171548 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f127c11c6e0 con 0x7f127c12eea0 2023-09-30T22:25:39.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.990+0000 7f1283878700 1 -- 172.21.15.40:0/237171548 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f127c06edb0 con 0x7f127c12eea0 2023-09-30T22:25:39.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.990+0000 7f1271ffb700 1 -- 172.21.15.40:0/237171548 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1274014640 con 0x7f127c12eea0 2023-09-30T22:25:39.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.990+0000 7f1271ffb700 1 -- 172.21.15.40:0/237171548 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f127403fbb0 con 0x7f127c12eea0 2023-09-30T22:25:39.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:39.995+0000 7f1271ffb700 1 -- 172.21.15.40:0/237171548 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1274009e40 con 0x7f127c12eea0 2023-09-30T22:25:40.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.002+0000 7ff4d240b700 1 -- 172.21.15.40:0/3831759603 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff4cc09c9e0 con 0x7ff4cc09d920 2023-09-30T22:25:40.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.003+0000 7ff4c8ff9700 1 -- 172.21.15.40:0/3831759603 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff4bc016070 con 0x7ff4cc09d920 2023-09-30T22:25:40.003 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:40.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.005+0000 7ff4d240b700 1 -- 172.21.15.40:0/3831759603 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff4cc09d920 msgr2=0x7ff4cc1a6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:40.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.005+0000 7ff4d240b700 1 --2- 172.21.15.40:0/3831759603 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff4cc09d920 0x7ff4cc1a6390 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc004000 tx=0x7ff4bc004750 comp rx=0 tx=0).stop 2023-09-30T22:25:40.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.005+0000 7ff4d240b700 1 -- 172.21.15.40:0/3831759603 shutdown_connections 2023-09-30T22:25:40.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.005+0000 7ff4d240b700 1 --2- 172.21.15.40:0/3831759603 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff4cc09d920 0x7ff4cc1a6390 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.005+0000 7ff4d240b700 1 --2- 172.21.15.40:0/3831759603 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4cc1a6e10 0x7ff4cc1cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.005+0000 7ff4d240b700 1 --2- 172.21.15.40:0/3831759603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4cc09e230 0x7ff4cc1a68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.005+0000 7ff4d240b700 1 -- 172.21.15.40:0/3831759603 >> 172.21.15.40:0/3831759603 conn(0x7ff4cc09fb20 msgr2=0x7ff4cc1bb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:40.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.005+0000 7ff4d240b700 1 -- 172.21.15.40:0/3831759603 shutdown_connections 2023-09-30T22:25:40.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.005+0000 7ff4d240b700 1 -- 172.21.15.40:0/3831759603 wait complete. 2023-09-30T22:25:40.019 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.031+0000 7f0ace729700 1 Processor -- start 2023-09-30T22:25:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.031+0000 7f0ace729700 1 -- start start 2023-09-30T22:25:40.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.031+0000 7f0ace729700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0ac809d920 0x7f0ac809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:40.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.031+0000 7f0ace729700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac809e230 0x7f0ac81343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:40.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.031+0000 7f0ace729700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac809f940 con 0x7f0ac809f0f0 2023-09-30T22:25:40.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.031+0000 7f0ace729700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac806b4c0 con 0x7f0ac809d920 2023-09-30T22:25:40.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.031+0000 7f0ace729700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac809a8f0 con 0x7f0ac809e230 2023-09-30T22:25:40.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.032+0000 7f0acccc6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac809e230 0x7f0ac81343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:40.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.032+0000 7f0ac7fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0ac809d920 0x7f0ac809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:40.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.032+0000 7f0acccc6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac809e230 0x7f0ac81343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60642/0 (socket says 172.21.15.40:60642) 2023-09-30T22:25:40.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.032+0000 7f0acccc6700 1 -- 172.21.15.40:0/297804620 learned_addr learned my addr 172.21.15.40:0/297804620 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:40.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.032+0000 7f0ac7fff700 1 -- 172.21.15.40:0/297804620 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac809e230 msgr2=0x7f0ac81343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:40.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.032+0000 7f0ac7fff700 1 --2- 172.21.15.40:0/297804620 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac809e230 0x7f0ac81343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.032+0000 7f0ac7fff700 1 -- 172.21.15.40:0/297804620 >> v1:172.21.15.40:6789/0 conn(0x7f0ac809f0f0 legacy=0x7f0ac8133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.032+0000 7f0ac7fff700 1 -- 172.21.15.40:0/297804620 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac809f6e0 con 0x7f0ac809d920 2023-09-30T22:25:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.032+0000 7f0acccc6700 1 --2- 172.21.15.40:0/297804620 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac809e230 0x7f0ac81343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.032+0000 7f0ac7fff700 1 --2- 172.21.15.40:0/297804620 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ac809d920 0x7f0ac809dcf0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8009820 tx=0x7f0ab8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31768e58771d251e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.032+0000 7f0ac6ffd700 1 -- 172.21.15.40:0/297804620 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab8005e30 con 0x7f0ac809d920 2023-09-30T22:25:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.032+0000 7f0ac6ffd700 1 -- 172.21.15.40:0/297804620 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab8004030 con 0x7f0ac809d920 2023-09-30T22:25:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.032+0000 7f0ac6ffd700 1 -- 172.21.15.40:0/297804620 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab80043c0 con 0x7f0ac809d920 2023-09-30T22:25:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.033+0000 7f0ace729700 1 -- 172.21.15.40:0/297804620 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ac809d920 msgr2=0x7f0ac809dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.033+0000 7f0ace729700 1 --2- 172.21.15.40:0/297804620 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ac809d920 0x7f0ac809dcf0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8009820 tx=0x7f0ab8009b30 comp rx=0 tx=0).stop 2023-09-30T22:25:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.033+0000 7f0ace729700 1 -- 172.21.15.40:0/297804620 shutdown_connections 2023-09-30T22:25:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.033+0000 7f0ace729700 1 --2- 172.21.15.40:0/297804620 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac809e230 0x7f0ac81343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.033+0000 7f0ace729700 1 --2- 172.21.15.40:0/297804620 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ac809d920 0x7f0ac809dcf0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.033+0000 7f0ace729700 1 -- 172.21.15.40:0/297804620 >> 172.21.15.40:0/297804620 conn(0x7f0ac809fb20 msgr2=0x7f0ac809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.033+0000 7f0ace729700 1 -- 172.21.15.40:0/297804620 shutdown_connections 2023-09-30T22:25:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.033+0000 7f0ace729700 1 -- 172.21.15.40:0/297804620 wait complete. 2023-09-30T22:25:40.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.034+0000 7f0ace729700 1 Processor -- start 2023-09-30T22:25:40.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.034+0000 7f0ace729700 1 -- start start 2023-09-30T22:25:40.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.035+0000 7f0ace729700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ac809d920 0x7f0ac81a8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:40.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.035+0000 7f0ace729700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ac809e230 0x7f0ac81a8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:40.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.035+0000 7f0ace729700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac81ac1c0 0x7f0ac81a8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:40.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.035+0000 7f0ace729700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac81aa390 con 0x7f0ac809e230 2023-09-30T22:25:40.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.035+0000 7f0ace729700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac81ab450 con 0x7f0ac81ac1c0 2023-09-30T22:25:40.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.035+0000 7f0ace729700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac809c9e0 con 0x7f0ac809d920 2023-09-30T22:25:40.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.035+0000 7f0ac7fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ac809d920 0x7f0ac81a8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:40.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.035+0000 7f0ac7fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ac809d920 0x7f0ac81a8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55546/0 (socket says 172.21.15.40:55546) 2023-09-30T22:25:40.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.035+0000 7f0ac7fff700 1 -- 172.21.15.40:0/3099293218 learned_addr learned my addr 172.21.15.40:0/3099293218 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:40.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.035+0000 7f0acccc6700 1 --2- 172.21.15.40:0/3099293218 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac81ac1c0 0x7f0ac81a8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:40.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.035+0000 7f0ac77fe700 1 --2- 172.21.15.40:0/3099293218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ac809e230 0x7f0ac81a8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:40.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.035+0000 7f0ac7fff700 1 -- 172.21.15.40:0/3099293218 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac81ac1c0 msgr2=0x7f0ac81a8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:40.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.035+0000 7f0ac7fff700 1 --2- 172.21.15.40:0/3099293218 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac81ac1c0 0x7f0ac81a8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.035+0000 7f0ac7fff700 1 -- 172.21.15.40:0/3099293218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ac809e230 msgr2=0x7f0ac81a8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:40.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.035+0000 7f0ac7fff700 1 --2- 172.21.15.40:0/3099293218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ac809e230 0x7f0ac81a8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.035+0000 7f0ac7fff700 1 -- 172.21.15.40:0/3099293218 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac0009b30 con 0x7f0ac809d920 2023-09-30T22:25:40.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.035+0000 7f0ac7fff700 1 --2- 172.21.15.40:0/3099293218 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ac809d920 0x7f0ac81a8230 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8000c00 tx=0x7f0ab8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:40.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.035+0000 7f0ac4ff9700 1 -- 172.21.15.40:0/3099293218 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab801c420 con 0x7f0ac809d920 2023-09-30T22:25:40.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.036+0000 7f0ac4ff9700 1 -- 172.21.15.40:0/3099293218 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab801c580 con 0x7f0ac809d920 2023-09-30T22:25:40.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.036+0000 7f0ace729700 1 -- 172.21.15.40:0/3099293218 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ab8009430 con 0x7f0ac809d920 2023-09-30T22:25:40.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.036+0000 7f0ac4ff9700 1 -- 172.21.15.40:0/3099293218 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab801c910 con 0x7f0ac809d920 2023-09-30T22:25:40.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.036+0000 7f0ace729700 1 -- 172.21.15.40:0/3099293218 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac81a9db0 con 0x7f0ac809d920 2023-09-30T22:25:40.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.036+0000 7f0ac4ff9700 1 -- 172.21.15.40:0/3099293218 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0ab801ca70 con 0x7f0ac809d920 2023-09-30T22:25:40.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.037+0000 7f0ace729700 1 -- 172.21.15.40:0/3099293218 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac81ab860 con 0x7f0ac809d920 2023-09-30T22:25:40.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.037+0000 7f0ac4ff9700 1 -- 172.21.15.40:0/3099293218 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f0ab8040890 con 0x7f0ac809d920 2023-09-30T22:25:40.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.042+0000 7f0ac4ff9700 1 -- 172.21.15.40:0/3099293218 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0ab802a020 con 0x7f0ac809d920 2023-09-30T22:25:40.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.156+0000 7fe1377fe700 1 -- 172.21.15.40:0/1668606503 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe130005590 con 0x7fe15409dd60 2023-09-30T22:25:40.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.157+0000 7fe149ffb700 1 -- 172.21.15.40:0/1668606503 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe144015020 con 0x7fe15409dd60 2023-09-30T22:25:40.158 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:40.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.159+0000 7fe1377fe700 1 -- 172.21.15.40:0/1668606503 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe15409dd60 msgr2=0x7fe15411c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:40.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.159+0000 7fe1377fe700 1 --2- 172.21.15.40:0/1668606503 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe15409dd60 0x7fe15411c1c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe144016000 tx=0x7fe144004750 comp rx=0 tx=0).stop 2023-09-30T22:25:40.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.159+0000 7fe1377fe700 1 -- 172.21.15.40:0/1668606503 shutdown_connections 2023-09-30T22:25:40.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.159+0000 7fe1377fe700 1 --2- 172.21.15.40:0/1668606503 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe154130700 0x7fe1541c40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.159+0000 7fe1377fe700 1 --2- 172.21.15.40:0/1668606503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe15409d450 0x7fe15411bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.159+0000 7fe1377fe700 1 --2- 172.21.15.40:0/1668606503 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe15409dd60 0x7fe15411c1c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.159+0000 7fe1377fe700 1 -- 172.21.15.40:0/1668606503 >> 172.21.15.40:0/1668606503 conn(0x7fe1540a2a00 msgr2=0x7fe1541b7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:40.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.159+0000 7fe1377fe700 1 -- 172.21.15.40:0/1668606503 shutdown_connections 2023-09-30T22:25:40.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.159+0000 7fe1377fe700 1 -- 172.21.15.40:0/1668606503 wait complete. 2023-09-30T22:25:40.172 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:40.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.193+0000 7f1283878700 1 -- 172.21.15.40:0/237171548 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f127c062380 con 0x7f127c12eea0 2023-09-30T22:25:40.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.193+0000 7f1271ffb700 1 -- 172.21.15.40:0/237171548 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1274018030 con 0x7f127c12eea0 2023-09-30T22:25:40.194 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:40.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.195+0000 7f1283878700 1 -- 172.21.15.40:0/237171548 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f127c12eea0 msgr2=0x7f127c11a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:40.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.195+0000 7f1283878700 1 --2- 172.21.15.40:0/237171548 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f127c12eea0 0x7f127c11a390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f127400ef00 tx=0x7f127400b390 comp rx=0 tx=0).stop 2023-09-30T22:25:40.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.195+0000 7f1283878700 1 -- 172.21.15.40:0/237171548 shutdown_connections 2023-09-30T22:25:40.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.195+0000 7f1283878700 1 --2- 172.21.15.40:0/237171548 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f127c12eea0 0x7f127c11a390 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.196+0000 7f1283878700 1 --2- 172.21.15.40:0/237171548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f127c12d6d0 0x7f127c119910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.196+0000 7f1283878700 1 --2- 172.21.15.40:0/237171548 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f127c12e590 0x7f127c119e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.196+0000 7f1283878700 1 -- 172.21.15.40:0/237171548 >> 172.21.15.40:0/237171548 conn(0x7f127c0a2a00 msgr2=0x7f127c12c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:40.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.196+0000 7f1283878700 1 -- 172.21.15.40:0/237171548 shutdown_connections 2023-09-30T22:25:40.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.196+0000 7f1283878700 1 -- 172.21.15.40:0/237171548 wait complete. 2023-09-30T22:25:40.208 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:40.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.241+0000 7f0ace729700 1 -- 172.21.15.40:0/3099293218 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0ac8062380 con 0x7f0ac809d920 2023-09-30T22:25:40.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.241+0000 7f0ac4ff9700 1 -- 172.21.15.40:0/3099293218 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0ab8016070 con 0x7f0ac809d920 2023-09-30T22:25:40.242 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:40.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.243+0000 7f0ace729700 1 -- 172.21.15.40:0/3099293218 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ac809d920 msgr2=0x7f0ac81a8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:40.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.243+0000 7f0ace729700 1 --2- 172.21.15.40:0/3099293218 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ac809d920 0x7f0ac81a8230 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8000c00 tx=0x7f0ab8004750 comp rx=0 tx=0).stop 2023-09-30T22:25:40.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.243+0000 7f0ace729700 1 -- 172.21.15.40:0/3099293218 shutdown_connections 2023-09-30T22:25:40.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.243+0000 7f0ace729700 1 --2- 172.21.15.40:0/3099293218 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ac809d920 0x7f0ac81a8230 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.243+0000 7f0ace729700 1 --2- 172.21.15.40:0/3099293218 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac81ac1c0 0x7f0ac81a8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.243+0000 7f0ace729700 1 --2- 172.21.15.40:0/3099293218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ac809e230 0x7f0ac81a8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.243+0000 7f0ace729700 1 -- 172.21.15.40:0/3099293218 >> 172.21.15.40:0/3099293218 conn(0x7f0ac809fb20 msgr2=0x7f0ac80714e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:40.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.244+0000 7f0ace729700 1 -- 172.21.15.40:0/3099293218 shutdown_connections 2023-09-30T22:25:40.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:40.244+0000 7f0ace729700 1 -- 172.21.15.40:0/3099293218 wait complete. 2023-09-30T22:25:40.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:41.021 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:41.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.161+0000 7f4315224700 1 Processor -- start 2023-09-30T22:25:41.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.161+0000 7f4315224700 1 -- start start 2023-09-30T22:25:41.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.162+0000 7f4315224700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4310136bf0 0x7f4310138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.162+0000 7f4315224700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4310139510 0x7f431013b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.162+0000 7f4315224700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43100a2600 con 0x7f431009c890 2023-09-30T22:25:41.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.162+0000 7f4315224700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43100a29d0 con 0x7f4310139510 2023-09-30T22:25:41.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.162+0000 7f4315224700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f431009fb40 con 0x7f4310136bf0 2023-09-30T22:25:41.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.162+0000 7f430ed9d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f431009c890 0x7f431009cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45660/0 (socket says 172.21.15.40:45660) 2023-09-30T22:25:41.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.162+0000 7f430ed9d700 1 -- 172.21.15.40:0/3694726660 learned_addr learned my addr 172.21.15.40:0/3694726660 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:41.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.162+0000 7f430f59e700 1 --2- 172.21.15.40:0/3694726660 >> v2:172.21.15.40:3300/0 conn(0x7f4310139510 0x7f431013b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.162+0000 7f430e59c700 1 --2- 172.21.15.40:0/3694726660 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4310136bf0 0x7f4310138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.162+0000 7f430f59e700 1 -- 172.21.15.40:0/3694726660 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4310136bf0 msgr2=0x7f4310138fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:41.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.162+0000 7f430f59e700 1 --2- 172.21.15.40:0/3694726660 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4310136bf0 0x7f4310138fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.162+0000 7f430f59e700 1 -- 172.21.15.40:0/3694726660 >> v1:172.21.15.40:6789/0 conn(0x7f431009c890 legacy=0x7f431009cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.162+0000 7f430dd9b700 1 -- 172.21.15.40:0/3694726660 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1347798050 0 0) 0x7f43100a2600 con 0x7f431009c890 2023-09-30T22:25:41.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.162+0000 7f430f59e700 1 -- 172.21.15.40:0/3694726660 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f431009d370 con 0x7f4310139510 2023-09-30T22:25:41.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.162+0000 7f430e59c700 1 --2- 172.21.15.40:0/3694726660 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4310136bf0 0x7f4310138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:41.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.162+0000 7f430f59e700 1 --2- 172.21.15.40:0/3694726660 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4310139510 0x7f431013b8f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4308009d90 tx=0x7f430800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2312b9093819bee0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:41.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.163+0000 7f430dd9b700 1 -- 172.21.15.40:0/3694726660 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430800e070 con 0x7f4310139510 2023-09-30T22:25:41.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.163+0000 7f430dd9b700 1 -- 172.21.15.40:0/3694726660 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f430800bb20 con 0x7f4310139510 2023-09-30T22:25:41.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.163+0000 7f430dd9b700 1 -- 172.21.15.40:0/3694726660 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4308012430 con 0x7f4310139510 2023-09-30T22:25:41.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.163+0000 7f4315224700 1 -- 172.21.15.40:0/3694726660 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4310139510 msgr2=0x7f431013b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.163+0000 7f4315224700 1 --2- 172.21.15.40:0/3694726660 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4310139510 0x7f431013b8f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4308009d90 tx=0x7f430800b330 comp rx=0 tx=0).stop 2023-09-30T22:25:41.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.163+0000 7f4315224700 1 -- 172.21.15.40:0/3694726660 shutdown_connections 2023-09-30T22:25:41.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.163+0000 7f4315224700 1 --2- 172.21.15.40:0/3694726660 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4310139510 0x7f431013b8f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.163+0000 7f4315224700 1 --2- 172.21.15.40:0/3694726660 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4310136bf0 0x7f4310138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.163+0000 7f4315224700 1 -- 172.21.15.40:0/3694726660 >> 172.21.15.40:0/3694726660 conn(0x7f43100a7080 msgr2=0x7f43100a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:41.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.163+0000 7f4315224700 1 -- 172.21.15.40:0/3694726660 shutdown_connections 2023-09-30T22:25:41.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.163+0000 7f4315224700 1 -- 172.21.15.40:0/3694726660 wait complete. 2023-09-30T22:25:41.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.164+0000 7f4315224700 1 Processor -- start 2023-09-30T22:25:41.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.165+0000 7f4315224700 1 -- start start 2023-09-30T22:25:41.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.165+0000 7f4315224700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f431009c890 0x7f431006edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.165+0000 7f4315224700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4310136bf0 0x7f431006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.165+0000 7f4315224700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4310139510 0x7f431006f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.165+0000 7f4315224700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f431012b4e0 con 0x7f4310139510 2023-09-30T22:25:41.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.165+0000 7f4315224700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43100708c0 con 0x7f4310136bf0 2023-09-30T22:25:41.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.165+0000 7f4315224700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4310071d20 con 0x7f431009c890 2023-09-30T22:25:41.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.165+0000 7f430ed9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f431009c890 0x7f431006edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.165+0000 7f430e59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4310136bf0 0x7f431006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.165+0000 7f430f59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4310139510 0x7f431006f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.165+0000 7f430ed9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f431009c890 0x7f431006edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55554/0 (socket says 172.21.15.40:55554) 2023-09-30T22:25:41.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.165+0000 7f430ed9d700 1 -- 172.21.15.40:0/3856506460 learned_addr learned my addr 172.21.15.40:0/3856506460 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:41.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.165+0000 7f430ed9d700 1 -- 172.21.15.40:0/3856506460 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4310136bf0 msgr2=0x7f431006f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.165+0000 7f430ed9d700 1 --2- 172.21.15.40:0/3856506460 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4310136bf0 0x7f431006f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.165+0000 7f430ed9d700 1 -- 172.21.15.40:0/3856506460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4310139510 msgr2=0x7f431006f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.165+0000 7f430ed9d700 1 --2- 172.21.15.40:0/3856506460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4310139510 0x7f431006f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.165+0000 7f430ed9d700 1 -- 172.21.15.40:0/3856506460 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f80094a0 con 0x7f431009c890 2023-09-30T22:25:41.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.165+0000 7f430f59e700 1 --2- 172.21.15.40:0/3856506460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4310139510 0x7f431006f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:41.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.166+0000 7f430ed9d700 1 --2- 172.21.15.40:0/3856506460 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f431009c890 0x7f431006edd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f430000c700 tx=0x7f430000ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:41.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.166+0000 7f43077fe700 1 -- 172.21.15.40:0/3856506460 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43000074e0 con 0x7f431009c890 2023-09-30T22:25:41.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.166+0000 7f43077fe700 1 -- 172.21.15.40:0/3856506460 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4300007640 con 0x7f431009c890 2023-09-30T22:25:41.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.166+0000 7f4315224700 1 -- 172.21.15.40:0/3856506460 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4308009a70 con 0x7f431009c890 2023-09-30T22:25:41.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.166+0000 7f43077fe700 1 -- 172.21.15.40:0/3856506460 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4300005a70 con 0x7f431009c890 2023-09-30T22:25:41.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.166+0000 7f4315224700 1 -- 172.21.15.40:0/3856506460 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f431012be90 con 0x7f431009c890 2023-09-30T22:25:41.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.167+0000 7f43077fe700 1 -- 172.21.15.40:0/3856506460 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4300005bd0 con 0x7f431009c890 2023-09-30T22:25:41.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.167+0000 7f43077fe700 1 -- 172.21.15.40:0/3856506460 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f430003eb20 con 0x7f431009c890 2023-09-30T22:25:41.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.167+0000 7f4315224700 1 -- 172.21.15.40:0/3856506460 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4310070230 con 0x7f431009c890 2023-09-30T22:25:41.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.172+0000 7f43077fe700 1 -- 172.21.15.40:0/3856506460 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4300017080 con 0x7f431009c890 2023-09-30T22:25:41.172 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:41.209 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:41.257 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:41.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.321+0000 7fd779fce700 1 Processor -- start 2023-09-30T22:25:41.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.321+0000 7fd779fce700 1 -- start start 2023-09-30T22:25:41.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.321+0000 7fd779fce700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd77406d0a0 0x7fd77406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.321+0000 7fd779fce700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd774139380 0x7fd77413b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.321+0000 7fd779fce700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd77406e3f0 con 0x7fd77409fbb0 2023-09-30T22:25:41.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.321+0000 7fd779fce700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd77409ff80 con 0x7fd77406d0a0 2023-09-30T22:25:41.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.321+0000 7fd779fce700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77406ec40 con 0x7fd774139380 2023-09-30T22:25:41.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.321+0000 7fd773fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd774139380 0x7fd77413b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.321+0000 7fd76affd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd77406d0a0 0x7fd77406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.321+0000 7fd773fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd774139380 0x7fd77413b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60674/0 (socket says 172.21.15.40:60674) 2023-09-30T22:25:41.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.321+0000 7fd773fff700 1 -- 172.21.15.40:0/3519958613 learned_addr learned my addr 172.21.15.40:0/3519958613 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:41.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.322+0000 7fd76affd700 1 -- 172.21.15.40:0/3519958613 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd774139380 msgr2=0x7fd77413b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:41.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.322+0000 7fd76affd700 1 --2- 172.21.15.40:0/3519958613 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd774139380 0x7fd77413b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.322+0000 7fd76affd700 1 -- 172.21.15.40:0/3519958613 >> v1:172.21.15.40:6789/0 conn(0x7fd77409fbb0 legacy=0x7fd77406c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.322+0000 7fd76affd700 1 -- 172.21.15.40:0/3519958613 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd77406d9f0 con 0x7fd77406d0a0 2023-09-30T22:25:41.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.322+0000 7fd772ffd700 1 -- 172.21.15.40:0/3519958613 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913392841 0 0) 0x7fd77406e3f0 con 0x7fd77409fbb0 2023-09-30T22:25:41.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.322+0000 7fd773fff700 1 --2- 172.21.15.40:0/3519958613 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd774139380 0x7fd77413b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:41.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.322+0000 7fd76affd700 1 --2- 172.21.15.40:0/3519958613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd77406d0a0 0x7fd77406d4b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd75c009840 tx=0x7fd75c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9046c4fb6b4402bc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:41.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.322+0000 7fd772ffd700 1 -- 172.21.15.40:0/3519958613 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75c011830 con 0x7fd77406d0a0 2023-09-30T22:25:41.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.322+0000 7fd772ffd700 1 -- 172.21.15.40:0/3519958613 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75c011990 con 0x7fd77406d0a0 2023-09-30T22:25:41.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.322+0000 7fd772ffd700 1 -- 172.21.15.40:0/3519958613 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75c011d20 con 0x7fd77406d0a0 2023-09-30T22:25:41.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.323+0000 7fd779fce700 1 -- 172.21.15.40:0/3519958613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd77406d0a0 msgr2=0x7fd77406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.323+0000 7fd779fce700 1 --2- 172.21.15.40:0/3519958613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd77406d0a0 0x7fd77406d4b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd75c009840 tx=0x7fd75c009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:41.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.323+0000 7fd779fce700 1 -- 172.21.15.40:0/3519958613 shutdown_connections 2023-09-30T22:25:41.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.323+0000 7fd779fce700 1 --2- 172.21.15.40:0/3519958613 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd774139380 0x7fd77413b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.323+0000 7fd779fce700 1 --2- 172.21.15.40:0/3519958613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd77406d0a0 0x7fd77406d4b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.323+0000 7fd779fce700 1 -- 172.21.15.40:0/3519958613 >> 172.21.15.40:0/3519958613 conn(0x7fd7740a41a0 msgr2=0x7fd7740a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:41.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.323+0000 7fd779fce700 1 -- 172.21.15.40:0/3519958613 shutdown_connections 2023-09-30T22:25:41.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.323+0000 7fd779fce700 1 -- 172.21.15.40:0/3519958613 wait complete. 2023-09-30T22:25:41.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.325+0000 7fd779fce700 1 Processor -- start 2023-09-30T22:25:41.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.325+0000 7fd779fce700 1 -- start start 2023-09-30T22:25:41.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.326+0000 7fd779fce700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd77406d0a0 0x7fd7741385a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.326+0000 7fd779fce700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd77409fbb0 0x7fd774138ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.326+0000 7fd779fce700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd774139380 0x7fd7740959a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.326+0000 7fd779fce700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd774094bc0 con 0x7fd77406d0a0 2023-09-30T22:25:41.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.326+0000 7fd779fce700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd774097140 con 0x7fd77409fbb0 2023-09-30T22:25:41.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.326+0000 7fd779fce700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd774092f20 con 0x7fd774139380 2023-09-30T22:25:41.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.326+0000 7fd7737fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd77406d0a0 0x7fd7741385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.326+0000 7fd7737fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd77406d0a0 0x7fd7741385a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51260/0 (socket says 172.21.15.40:51260) 2023-09-30T22:25:41.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.326+0000 7fd7737fe700 1 -- 172.21.15.40:0/695377160 learned_addr learned my addr 172.21.15.40:0/695377160 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:41.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.326+0000 7fd76affd700 1 --2- 172.21.15.40:0/695377160 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd77409fbb0 0x7fd774138ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.326+0000 7fd7737fe700 1 -- 172.21.15.40:0/695377160 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd774139380 msgr2=0x7fd7740959a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.326+0000 7fd7737fe700 1 --2- 172.21.15.40:0/695377160 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd774139380 0x7fd7740959a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.326+0000 7fd7737fe700 1 -- 172.21.15.40:0/695377160 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd77409fbb0 msgr2=0x7fd774138ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.326+0000 7fd7737fe700 1 --2- 172.21.15.40:0/695377160 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd77409fbb0 0x7fd774138ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.326+0000 7fd7737fe700 1 -- 172.21.15.40:0/695377160 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76c009b30 con 0x7fd77406d0a0 2023-09-30T22:25:41.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.327+0000 7fd7737fe700 1 --2- 172.21.15.40:0/695377160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd77406d0a0 0x7fd7741385a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd76400c4a0 tx=0x7fd76400c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:41.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.327+0000 7fd770ff9700 1 -- 172.21.15.40:0/695377160 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7640054e0 con 0x7fd77406d0a0 2023-09-30T22:25:41.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.327+0000 7fd770ff9700 1 -- 172.21.15.40:0/695377160 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd764003680 con 0x7fd77406d0a0 2023-09-30T22:25:41.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.327+0000 7fd770ff9700 1 -- 172.21.15.40:0/695377160 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7640039f0 con 0x7fd77406d0a0 2023-09-30T22:25:41.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.327+0000 7fd779fce700 1 -- 172.21.15.40:0/695377160 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd75c0094a0 con 0x7fd77406d0a0 2023-09-30T22:25:41.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.327+0000 7fd779fce700 1 -- 172.21.15.40:0/695377160 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7740a3a00 con 0x7fd77406d0a0 2023-09-30T22:25:41.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.328+0000 7fd779fce700 1 -- 172.21.15.40:0/695377160 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd774071db0 con 0x7fd77406d0a0 2023-09-30T22:25:41.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.329+0000 7fd770ff9700 1 -- 172.21.15.40:0/695377160 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd764003b50 con 0x7fd77406d0a0 2023-09-30T22:25:41.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.329+0000 7fd770ff9700 1 -- 172.21.15.40:0/695377160 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd76403f0a0 con 0x7fd77406d0a0 2023-09-30T22:25:41.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.333+0000 7fd770ff9700 1 -- 172.21.15.40:0/695377160 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd76401b3b0 con 0x7fd77406d0a0 2023-09-30T22:25:41.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.360+0000 7fa1faa10700 1 Processor -- start 2023-09-30T22:25:41.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.360+0000 7fa1faa10700 1 -- start start 2023-09-30T22:25:41.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.361+0000 7fa1faa10700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa1f406a6d0 0x7fa1f409d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.361+0000 7fa1faa10700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa1f409de60 0x7fa1f409e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.361+0000 7fa1faa10700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f409e790 con 0x7fa1f413c490 2023-09-30T22:25:41.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.361+0000 7fa1faa10700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f406aaa0 con 0x7fa1f406a6d0 2023-09-30T22:25:41.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.361+0000 7fa1faa10700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f411d980 con 0x7fa1f409de60 2023-09-30T22:25:41.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.361+0000 7fa1f37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa1f409de60 0x7fa1f409e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.361+0000 7fa1f37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa1f409de60 0x7fa1f409e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60698/0 (socket says 172.21.15.40:60698) 2023-09-30T22:25:41.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.361+0000 7fa1f37fe700 1 -- 172.21.15.40:0/847741336 learned_addr learned my addr 172.21.15.40:0/847741336 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:41.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.361+0000 7fa1f3fff700 1 --2- 172.21.15.40:0/847741336 >> v2:172.21.15.40:3300/0 conn(0x7fa1f406a6d0 0x7fa1f409d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.361+0000 7fa1f37fe700 1 -- 172.21.15.40:0/847741336 >> v2:172.21.15.40:3300/0 conn(0x7fa1f406a6d0 msgr2=0x7fa1f409d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:41.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.361+0000 7fa1f37fe700 1 --2- 172.21.15.40:0/847741336 >> v2:172.21.15.40:3300/0 conn(0x7fa1f406a6d0 0x7fa1f409d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.361+0000 7fa1f37fe700 1 -- 172.21.15.40:0/847741336 >> v1:172.21.15.40:6789/0 conn(0x7fa1f413c490 legacy=0x7fa1f413e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.362+0000 7fa1f37fe700 1 -- 172.21.15.40:0/847741336 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f411daf0 con 0x7fa1f409de60 2023-09-30T22:25:41.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.362+0000 7fa1f37fe700 1 --2- 172.21.15.40:0/847741336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa1f409de60 0x7fa1f409e250 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8009920 tx=0x7fa1e8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffa46b62087e4a56 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:41.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.362+0000 7fa1f2ffd700 1 -- 172.21.15.40:0/847741336 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e8011830 con 0x7fa1f409de60 2023-09-30T22:25:41.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.362+0000 7fa1f2ffd700 1 -- 172.21.15.40:0/847741336 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e8011990 con 0x7fa1f409de60 2023-09-30T22:25:41.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.362+0000 7fa1f2ffd700 1 -- 172.21.15.40:0/847741336 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e8011d20 con 0x7fa1f409de60 2023-09-30T22:25:41.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.363+0000 7fa1faa10700 1 -- 172.21.15.40:0/847741336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa1f409de60 msgr2=0x7fa1f409e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.363+0000 7fa1faa10700 1 --2- 172.21.15.40:0/847741336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa1f409de60 0x7fa1f409e250 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8009920 tx=0x7fa1e8009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:41.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.363+0000 7fa1faa10700 1 -- 172.21.15.40:0/847741336 shutdown_connections 2023-09-30T22:25:41.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.363+0000 7fa1faa10700 1 --2- 172.21.15.40:0/847741336 >> v2:172.21.15.40:3300/0 conn(0x7fa1f406a6d0 0x7fa1f409d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.363+0000 7fa1faa10700 1 --2- 172.21.15.40:0/847741336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa1f409de60 0x7fa1f409e250 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.363+0000 7fa1faa10700 1 -- 172.21.15.40:0/847741336 >> 172.21.15.40:0/847741336 conn(0x7fa1f409fb20 msgr2=0x7fa1f409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:41.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.363+0000 7fa1faa10700 1 -- 172.21.15.40:0/847741336 shutdown_connections 2023-09-30T22:25:41.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.363+0000 7fa1faa10700 1 -- 172.21.15.40:0/847741336 wait complete. 2023-09-30T22:25:41.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.364+0000 7fa1faa10700 1 Processor -- start 2023-09-30T22:25:41.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.364+0000 7fa1faa10700 1 -- start start 2023-09-30T22:25:41.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.364+0000 7fa1faa10700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa1f406a6d0 0x7fa1f413aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.364+0000 7fa1faa10700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa1f409de60 0x7fa1f413b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.364+0000 7fa1faa10700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1f413c490 0x7fa1f413b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.364+0000 7fa1faa10700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f4140530 con 0x7fa1f413c490 2023-09-30T22:25:41.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.364+0000 7fa1faa10700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f41352e0 con 0x7fa1f409de60 2023-09-30T22:25:41.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.364+0000 7fa1faa10700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f413d700 con 0x7fa1f406a6d0 2023-09-30T22:25:41.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.364+0000 7fa1f3fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa1f406a6d0 0x7fa1f413aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.364+0000 7fa1f3fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa1f406a6d0 0x7fa1f413aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55584/0 (socket says 172.21.15.40:55584) 2023-09-30T22:25:41.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.364+0000 7fa1f3fff700 1 -- 172.21.15.40:0/2227135246 learned_addr learned my addr 172.21.15.40:0/2227135246 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:41.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.365+0000 7fa1f37fe700 1 --2- 172.21.15.40:0/2227135246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa1f409de60 0x7fa1f413b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.365+0000 7fa1f8fad700 1 --2- 172.21.15.40:0/2227135246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1f413c490 0x7fa1f413b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.365+0000 7fa1f37fe700 1 -- 172.21.15.40:0/2227135246 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa1f406a6d0 msgr2=0x7fa1f413aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.365+0000 7fa1f37fe700 1 --2- 172.21.15.40:0/2227135246 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa1f406a6d0 0x7fa1f413aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.365+0000 7fa1f37fe700 1 -- 172.21.15.40:0/2227135246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1f413c490 msgr2=0x7fa1f413b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.365+0000 7fa1f37fe700 1 --2- 172.21.15.40:0/2227135246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1f413c490 0x7fa1f413b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.365+0000 7fa1f37fe700 1 -- 172.21.15.40:0/2227135246 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e8009550 con 0x7fa1f409de60 2023-09-30T22:25:41.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.365+0000 7fa1f37fe700 1 --2- 172.21.15.40:0/2227135246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa1f409de60 0x7fa1f413b030 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8016000 tx=0x7fa1e8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:41.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.365+0000 7fa1f0ff9700 1 -- 172.21.15.40:0/2227135246 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e8004590 con 0x7fa1f409de60 2023-09-30T22:25:41.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.365+0000 7fa1f0ff9700 1 -- 172.21.15.40:0/2227135246 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e80036a0 con 0x7fa1f409de60 2023-09-30T22:25:41.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.365+0000 7fa1f0ff9700 1 -- 172.21.15.40:0/2227135246 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e8003a70 con 0x7fa1f409de60 2023-09-30T22:25:41.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.366+0000 7fa1faa10700 1 -- 172.21.15.40:0/2227135246 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f411e750 con 0x7fa1f409de60 2023-09-30T22:25:41.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.366+0000 7fa1faa10700 1 -- 172.21.15.40:0/2227135246 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f413f310 con 0x7fa1f409de60 2023-09-30T22:25:41.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.367+0000 7fa1faa10700 1 -- 172.21.15.40:0/2227135246 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f409f5b0 con 0x7fa1f409de60 2023-09-30T22:25:41.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.367+0000 7fa1f0ff9700 1 -- 172.21.15.40:0/2227135246 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa1e8003bd0 con 0x7fa1f409de60 2023-09-30T22:25:41.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.367+0000 7fa1f0ff9700 1 -- 172.21.15.40:0/2227135246 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa1e8021030 con 0x7fa1f409de60 2023-09-30T22:25:41.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.376+0000 7fa1f0ff9700 1 -- 172.21.15.40:0/2227135246 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa1f409f5b0 con 0x7fa1f409de60 2023-09-30T22:25:41.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.381+0000 7f4315224700 1 -- 172.21.15.40:0/3856506460 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4310062380 con 0x7f431009c890 2023-09-30T22:25:41.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.381+0000 7f43077fe700 1 -- 172.21.15.40:0/3856506460 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4300018260 con 0x7f431009c890 2023-09-30T22:25:41.381 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:41.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.383+0000 7f4315224700 1 -- 172.21.15.40:0/3856506460 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f431009c890 msgr2=0x7f431006edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.383+0000 7f4315224700 1 --2- 172.21.15.40:0/3856506460 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f431009c890 0x7f431006edd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f430000c700 tx=0x7f430000ca10 comp rx=0 tx=0).stop 2023-09-30T22:25:41.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.383+0000 7f4315224700 1 -- 172.21.15.40:0/3856506460 shutdown_connections 2023-09-30T22:25:41.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.383+0000 7f4315224700 1 --2- 172.21.15.40:0/3856506460 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f431009c890 0x7f431006edd0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.383+0000 7f4315224700 1 --2- 172.21.15.40:0/3856506460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4310139510 0x7f431006f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.383+0000 7f4315224700 1 --2- 172.21.15.40:0/3856506460 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4310136bf0 0x7f431006f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.383+0000 7f4315224700 1 -- 172.21.15.40:0/3856506460 >> 172.21.15.40:0/3856506460 conn(0x7f43100a7080 msgr2=0x7f43101349d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:41.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.383+0000 7f4315224700 1 -- 172.21.15.40:0/3856506460 shutdown_connections 2023-09-30T22:25:41.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.383+0000 7f4315224700 1 -- 172.21.15.40:0/3856506460 wait complete. 2023-09-30T22:25:41.397 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:41.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.429+0000 7ff4241ba700 1 Processor -- start 2023-09-30T22:25:41.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.429+0000 7ff4241ba700 1 -- start start 2023-09-30T22:25:41.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.430+0000 7ff4241ba700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff41c06a6d0 0x7ff41c06aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.430+0000 7ff4241ba700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff41c06afe0 0x7ff41c1318b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.430+0000 7ff4241ba700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff41c131df0 0x7ff41c132290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.430+0000 7ff4241ba700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff41c09eb60 con 0x7ff41c131df0 2023-09-30T22:25:41.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.430+0000 7ff4241ba700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c09db70 con 0x7ff41c06afe0 2023-09-30T22:25:41.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.430+0000 7ff4241ba700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c09ddf0 con 0x7ff41c06a6d0 2023-09-30T22:25:41.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.430+0000 7ff421f56700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff41c06a6d0 0x7ff41c06aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.430+0000 7ff421f56700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff41c06a6d0 0x7ff41c06aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55592/0 (socket says 172.21.15.40:55592) 2023-09-30T22:25:41.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.430+0000 7ff421f56700 1 -- 172.21.15.40:0/4159024322 learned_addr learned my addr 172.21.15.40:0/4159024322 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:41.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.430+0000 7ff421755700 1 --2- 172.21.15.40:0/4159024322 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff41c06afe0 0x7ff41c1318b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.430+0000 7ff422757700 1 --2- 172.21.15.40:0/4159024322 >> v2:172.21.15.40:3300/0 conn(0x7ff41c131df0 0x7ff41c132290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.431+0000 7ff421f56700 1 -- 172.21.15.40:0/4159024322 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff41c06afe0 msgr2=0x7ff41c1318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:41.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.431+0000 7ff421f56700 1 --2- 172.21.15.40:0/4159024322 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff41c06afe0 0x7ff41c1318b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.431+0000 7ff421f56700 1 -- 172.21.15.40:0/4159024322 >> v2:172.21.15.40:3300/0 conn(0x7ff41c131df0 msgr2=0x7ff41c132290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:41.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.431+0000 7ff421f56700 1 --2- 172.21.15.40:0/4159024322 >> v2:172.21.15.40:3300/0 conn(0x7ff41c131df0 0x7ff41c132290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.431+0000 7ff421f56700 1 -- 172.21.15.40:0/4159024322 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41c09c9a0 con 0x7ff41c06a6d0 2023-09-30T22:25:41.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.431+0000 7ff421f56700 1 --2- 172.21.15.40:0/4159024322 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff41c06a6d0 0x7ff41c06aaa0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff418006fd0 tx=0x7ff418009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8dae047300967f1d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:41.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.431+0000 7ff420f54700 1 -- 172.21.15.40:0/4159024322 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff418005e30 con 0x7ff41c06a6d0 2023-09-30T22:25:41.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.431+0000 7ff420f54700 1 -- 172.21.15.40:0/4159024322 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff418004030 con 0x7ff41c06a6d0 2023-09-30T22:25:41.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.431+0000 7ff420f54700 1 -- 172.21.15.40:0/4159024322 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4180043e0 con 0x7ff41c06a6d0 2023-09-30T22:25:41.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.432+0000 7ff4241ba700 1 -- 172.21.15.40:0/4159024322 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff41c06a6d0 msgr2=0x7ff41c06aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.432+0000 7ff4241ba700 1 --2- 172.21.15.40:0/4159024322 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff41c06a6d0 0x7ff41c06aaa0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff418006fd0 tx=0x7ff418009bd0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.432+0000 7ff4241ba700 1 -- 172.21.15.40:0/4159024322 shutdown_connections 2023-09-30T22:25:41.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.432+0000 7ff4241ba700 1 --2- 172.21.15.40:0/4159024322 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff41c06a6d0 0x7ff41c06aaa0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.432+0000 7ff4241ba700 1 --2- 172.21.15.40:0/4159024322 >> v2:172.21.15.40:3300/0 conn(0x7ff41c131df0 0x7ff41c132290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.432+0000 7ff4241ba700 1 --2- 172.21.15.40:0/4159024322 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff41c06afe0 0x7ff41c1318b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.432+0000 7ff4241ba700 1 -- 172.21.15.40:0/4159024322 >> 172.21.15.40:0/4159024322 conn(0x7ff41c09fb20 msgr2=0x7ff41c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:41.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.432+0000 7ff4241ba700 1 -- 172.21.15.40:0/4159024322 shutdown_connections 2023-09-30T22:25:41.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.432+0000 7ff4241ba700 1 -- 172.21.15.40:0/4159024322 wait complete. 2023-09-30T22:25:41.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.433+0000 7ff4241ba700 1 Processor -- start 2023-09-30T22:25:41.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.433+0000 7ff4241ba700 1 -- start start 2023-09-30T22:25:41.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.433+0000 7ff4241ba700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff41c06a6d0 0x7ff41c1c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.433+0000 7ff4241ba700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff41c06afe0 0x7ff41c1c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.433+0000 7ff4241ba700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff41c131df0 0x7ff41c1c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.433+0000 7ff4241ba700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c120e70 con 0x7ff41c131df0 2023-09-30T22:25:41.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.433+0000 7ff4241ba700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c131700 con 0x7ff41c06afe0 2023-09-30T22:25:41.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.433+0000 7ff4241ba700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c121f40 con 0x7ff41c06a6d0 2023-09-30T22:25:41.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.433+0000 7ff421755700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff41c06afe0 0x7ff41c1c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.433+0000 7ff421f56700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff41c06a6d0 0x7ff41c1c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.433+0000 7ff421f56700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff41c06a6d0 0x7ff41c1c8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55594/0 (socket says 172.21.15.40:55594) 2023-09-30T22:25:41.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.433+0000 7ff421755700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff41c06afe0 0x7ff41c1c8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60730/0 (socket says 172.21.15.40:60730) 2023-09-30T22:25:41.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.433+0000 7ff421f56700 1 -- 172.21.15.40:0/3907063744 learned_addr learned my addr 172.21.15.40:0/3907063744 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:41.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.433+0000 7ff422757700 1 --2- 172.21.15.40:0/3907063744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff41c131df0 0x7ff41c1c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.434+0000 7ff421755700 1 -- 172.21.15.40:0/3907063744 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff41c06a6d0 msgr2=0x7ff41c1c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.434+0000 7ff421755700 1 --2- 172.21.15.40:0/3907063744 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff41c06a6d0 0x7ff41c1c8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.434+0000 7ff421755700 1 -- 172.21.15.40:0/3907063744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff41c131df0 msgr2=0x7ff41c1c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.434+0000 7ff421755700 1 --2- 172.21.15.40:0/3907063744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff41c131df0 0x7ff41c1c8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.434+0000 7ff421755700 1 -- 172.21.15.40:0/3907063744 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff418009500 con 0x7ff41c06afe0 2023-09-30T22:25:41.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.434+0000 7ff421f56700 1 --2- 172.21.15.40:0/3907063744 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff41c06a6d0 0x7ff41c1c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:41.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.434+0000 7ff421755700 1 --2- 172.21.15.40:0/3907063744 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff41c06afe0 0x7ff41c1c8970 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff40c00e840 tx=0x7ff40c00eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:41.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.434+0000 7ff4127fc700 1 -- 172.21.15.40:0/3907063744 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c013680 con 0x7ff41c06afe0 2023-09-30T22:25:41.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.434+0000 7ff4127fc700 1 -- 172.21.15.40:0/3907063744 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40c0137e0 con 0x7ff41c06afe0 2023-09-30T22:25:41.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.434+0000 7ff4127fc700 1 -- 172.21.15.40:0/3907063744 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c013b70 con 0x7ff41c06afe0 2023-09-30T22:25:41.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.434+0000 7ff4241ba700 1 -- 172.21.15.40:0/3907063744 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff41c09e420 con 0x7ff41c06afe0 2023-09-30T22:25:41.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.434+0000 7ff4241ba700 1 -- 172.21.15.40:0/3907063744 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff41c122c70 con 0x7ff41c06afe0 2023-09-30T22:25:41.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.435+0000 7ff4127fc700 1 -- 172.21.15.40:0/3907063744 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff40c013cd0 con 0x7ff41c06afe0 2023-09-30T22:25:41.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.436+0000 7ff4127fc700 1 -- 172.21.15.40:0/3907063744 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff40c03f910 con 0x7ff41c06afe0 2023-09-30T22:25:41.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.436+0000 7ff4241ba700 1 -- 172.21.15.40:0/3907063744 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff41c062380 con 0x7ff41c06afe0 2023-09-30T22:25:41.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.445+0000 7ff4127fc700 1 -- 172.21.15.40:0/3907063744 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff40c0119a0 con 0x7ff41c06afe0 2023-09-30T22:25:41.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.582+0000 7fa1faa10700 1 -- 172.21.15.40:0/2227135246 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa1f411e750 con 0x7fa1f409de60 2023-09-30T22:25:41.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.583+0000 7fa1f0ff9700 1 -- 172.21.15.40:0/2227135246 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa1f411e750 con 0x7fa1f409de60 2023-09-30T22:25:41.584 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:41.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.585+0000 7fa1faa10700 1 -- 172.21.15.40:0/2227135246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa1f409de60 msgr2=0x7fa1f413b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.585+0000 7fa1faa10700 1 --2- 172.21.15.40:0/2227135246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa1f409de60 0x7fa1f413b030 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8016000 tx=0x7fa1e8004750 comp rx=0 tx=0).stop 2023-09-30T22:25:41.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.585+0000 7fa1faa10700 1 -- 172.21.15.40:0/2227135246 shutdown_connections 2023-09-30T22:25:41.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.585+0000 7fa1faa10700 1 --2- 172.21.15.40:0/2227135246 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa1f406a6d0 0x7fa1f413aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.585+0000 7fa1faa10700 1 --2- 172.21.15.40:0/2227135246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1f413c490 0x7fa1f413b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.585+0000 7fa1faa10700 1 --2- 172.21.15.40:0/2227135246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa1f409de60 0x7fa1f413b030 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.585+0000 7fa1faa10700 1 -- 172.21.15.40:0/2227135246 >> 172.21.15.40:0/2227135246 conn(0x7fa1f409fb20 msgr2=0x7fa1f4070510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:41.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.585+0000 7fa1faa10700 1 -- 172.21.15.40:0/2227135246 shutdown_connections 2023-09-30T22:25:41.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.585+0000 7fa1faa10700 1 -- 172.21.15.40:0/2227135246 wait complete. 2023-09-30T22:25:41.598 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:41.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.608+0000 7fd779fce700 1 -- 172.21.15.40:0/695377160 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd774062380 con 0x7fd77406d0a0 2023-09-30T22:25:41.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.608+0000 7fd770ff9700 1 -- 172.21.15.40:0/695377160 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd764017030 con 0x7fd77406d0a0 2023-09-30T22:25:41.609 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:41.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.610+0000 7fd779fce700 1 -- 172.21.15.40:0/695377160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd77406d0a0 msgr2=0x7fd7741385a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.610+0000 7fd779fce700 1 --2- 172.21.15.40:0/695377160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd77406d0a0 0x7fd7741385a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd76400c4a0 tx=0x7fd76400c7b0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.610+0000 7fd779fce700 1 -- 172.21.15.40:0/695377160 shutdown_connections 2023-09-30T22:25:41.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.610+0000 7fd779fce700 1 --2- 172.21.15.40:0/695377160 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd774139380 0x7fd7740959a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.610+0000 7fd779fce700 1 --2- 172.21.15.40:0/695377160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd77406d0a0 0x7fd7741385a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.610+0000 7fd779fce700 1 --2- 172.21.15.40:0/695377160 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd77409fbb0 0x7fd774138ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.610+0000 7fd779fce700 1 -- 172.21.15.40:0/695377160 >> 172.21.15.40:0/695377160 conn(0x7fd7740a41a0 msgr2=0x7fd7740a20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:41.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.610+0000 7fd779fce700 1 -- 172.21.15.40:0/695377160 shutdown_connections 2023-09-30T22:25:41.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.610+0000 7fd779fce700 1 -- 172.21.15.40:0/695377160 wait complete. 2023-09-30T22:25:41.623 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:41.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.671+0000 7ff4241ba700 1 -- 172.21.15.40:0/3907063744 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff41c09e270 con 0x7ff41c06afe0 2023-09-30T22:25:41.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.672+0000 7ff4127fc700 1 -- 172.21.15.40:0/3907063744 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff40c017020 con 0x7ff41c06afe0 2023-09-30T22:25:41.672 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:41.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.674+0000 7ff4241ba700 1 -- 172.21.15.40:0/3907063744 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff41c06afe0 msgr2=0x7ff41c1c8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.674+0000 7ff4241ba700 1 --2- 172.21.15.40:0/3907063744 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff41c06afe0 0x7ff41c1c8970 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff40c00e840 tx=0x7ff40c00eb50 comp rx=0 tx=0).stop 2023-09-30T22:25:41.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.674+0000 7ff4241ba700 1 -- 172.21.15.40:0/3907063744 shutdown_connections 2023-09-30T22:25:41.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.674+0000 7ff4241ba700 1 --2- 172.21.15.40:0/3907063744 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff41c06a6d0 0x7ff41c1c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.674+0000 7ff4241ba700 1 --2- 172.21.15.40:0/3907063744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff41c131df0 0x7ff41c1c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.674+0000 7ff4241ba700 1 --2- 172.21.15.40:0/3907063744 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff41c06afe0 0x7ff41c1c8970 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.674+0000 7ff4241ba700 1 -- 172.21.15.40:0/3907063744 >> 172.21.15.40:0/3907063744 conn(0x7ff41c09fb20 msgr2=0x7ff41c06f760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:41.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.674+0000 7ff4241ba700 1 -- 172.21.15.40:0/3907063744 shutdown_connections 2023-09-30T22:25:41.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:41.674+0000 7ff4241ba700 1 -- 172.21.15.40:0/3907063744 wait complete. 2023-09-30T22:25:41.686 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:42.397 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:42.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.539+0000 7f9c17c75700 1 Processor -- start 2023-09-30T22:25:42.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.539+0000 7f9c17c75700 1 -- start start 2023-09-30T22:25:42.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.540+0000 7f9c17c75700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9c10133e00 0x7f9c101341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.540+0000 7f9c17c75700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9c1009df70 0x7f9c1013bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.540+0000 7f9c17c75700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c10133940 con 0x7f9c1009d400 2023-09-30T22:25:42.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.540+0000 7f9c17c75700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c1009ab20 con 0x7f9c10133e00 2023-09-30T22:25:42.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.540+0000 7f9c17c75700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1009f0d0 con 0x7f9c1009df70 2023-09-30T22:25:42.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.540+0000 7f9c15a11700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9c10133e00 0x7f9c101341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.540+0000 7f9c15a11700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9c10133e00 0x7f9c101341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51312/0 (socket says 172.21.15.40:51312) 2023-09-30T22:25:42.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.540+0000 7f9c16212700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9c1009df70 0x7f9c1013bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.540+0000 7f9c15a11700 1 -- 172.21.15.40:0/4159202434 learned_addr learned my addr 172.21.15.40:0/4159202434 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:42.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.540+0000 7f9c16212700 1 -- 172.21.15.40:0/4159202434 >> v2:172.21.15.40:3300/0 conn(0x7f9c10133e00 msgr2=0x7f9c101341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:42.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.540+0000 7f9c16212700 1 --2- 172.21.15.40:0/4159202434 >> v2:172.21.15.40:3300/0 conn(0x7f9c10133e00 0x7f9c101341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.540+0000 7f9c16212700 1 -- 172.21.15.40:0/4159202434 >> v1:172.21.15.40:6789/0 conn(0x7f9c1009d400 legacy=0x7f9c1009d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.540+0000 7f9c16212700 1 -- 172.21.15.40:0/4159202434 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c10133be0 con 0x7f9c1009df70 2023-09-30T22:25:42.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.540+0000 7f9c15a11700 1 --2- 172.21.15.40:0/4159202434 >> v2:172.21.15.40:3300/0 conn(0x7f9c10133e00 0x7f9c101341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:42.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.540+0000 7f9c16212700 1 --2- 172.21.15.40:0/4159202434 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9c1009df70 0x7f9c1013bc80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9c08009d90 tx=0x7f9c0800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15c8e8269adf26a0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:42.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.540+0000 7f9c14a0f700 1 -- 172.21.15.40:0/4159202434 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0800e070 con 0x7f9c1009df70 2023-09-30T22:25:42.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.541+0000 7f9c14a0f700 1 -- 172.21.15.40:0/4159202434 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0800bb20 con 0x7f9c1009df70 2023-09-30T22:25:42.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.541+0000 7f9c14a0f700 1 -- 172.21.15.40:0/4159202434 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c08012430 con 0x7f9c1009df70 2023-09-30T22:25:42.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.541+0000 7f9c17c75700 1 -- 172.21.15.40:0/4159202434 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9c1009df70 msgr2=0x7f9c1013bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.541+0000 7f9c17c75700 1 --2- 172.21.15.40:0/4159202434 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9c1009df70 0x7f9c1013bc80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9c08009d90 tx=0x7f9c0800b330 comp rx=0 tx=0).stop 2023-09-30T22:25:42.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.541+0000 7f9c17c75700 1 -- 172.21.15.40:0/4159202434 shutdown_connections 2023-09-30T22:25:42.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.541+0000 7f9c17c75700 1 --2- 172.21.15.40:0/4159202434 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9c1009df70 0x7f9c1013bc80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.541+0000 7f9c17c75700 1 --2- 172.21.15.40:0/4159202434 >> v2:172.21.15.40:3300/0 conn(0x7f9c10133e00 0x7f9c101341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.541+0000 7f9c17c75700 1 -- 172.21.15.40:0/4159202434 >> 172.21.15.40:0/4159202434 conn(0x7f9c100a2a00 msgr2=0x7f9c100a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:42.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.541+0000 7f9c17c75700 1 -- 172.21.15.40:0/4159202434 shutdown_connections 2023-09-30T22:25:42.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.541+0000 7f9c17c75700 1 -- 172.21.15.40:0/4159202434 wait complete. 2023-09-30T22:25:42.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.542+0000 7f9c17c75700 1 Processor -- start 2023-09-30T22:25:42.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.542+0000 7f9c17c75700 1 -- start start 2023-09-30T22:25:42.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.543+0000 7f9c17c75700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c1009d400 0x7f9c10119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.543+0000 7f9c17c75700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c1009df70 0x7f9c10119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.543+0000 7f9c17c75700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9c10133e00 0x7f9c10119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.543+0000 7f9c17c75700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1011c100 con 0x7f9c1009df70 2023-09-30T22:25:42.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.543+0000 7f9c17c75700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1012c000 con 0x7f9c1009d400 2023-09-30T22:25:42.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.543+0000 7f9c17c75700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1011a420 con 0x7f9c10133e00 2023-09-30T22:25:42.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.543+0000 7f9c15a11700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c1009d400 0x7f9c10119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.543+0000 7f9c15a11700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c1009d400 0x7f9c10119050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60736/0 (socket says 172.21.15.40:60736) 2023-09-30T22:25:42.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.543+0000 7f9c15210700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c1009df70 0x7f9c10119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.543+0000 7f9c15a11700 1 -- 172.21.15.40:0/1992218799 learned_addr learned my addr 172.21.15.40:0/1992218799 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:42.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.543+0000 7f9c16212700 1 --2- 172.21.15.40:0/1992218799 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9c10133e00 0x7f9c10119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.543+0000 7f9c15a11700 1 -- 172.21.15.40:0/1992218799 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9c10133e00 msgr2=0x7f9c10119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.543+0000 7f9c15a11700 1 --2- 172.21.15.40:0/1992218799 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9c10133e00 0x7f9c10119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.543+0000 7f9c15a11700 1 -- 172.21.15.40:0/1992218799 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c1009df70 msgr2=0x7f9c10119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.543+0000 7f9c15a11700 1 --2- 172.21.15.40:0/1992218799 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c1009df70 0x7f9c10119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.543+0000 7f9c15a11700 1 -- 172.21.15.40:0/1992218799 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0c009550 con 0x7f9c1009d400 2023-09-30T22:25:42.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.543+0000 7f9c15210700 1 --2- 172.21.15.40:0/1992218799 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c1009df70 0x7f9c10119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:42.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.543+0000 7f9c16212700 1 --2- 172.21.15.40:0/1992218799 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9c10133e00 0x7f9c10119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:42.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.543+0000 7f9c15a11700 1 --2- 172.21.15.40:0/1992218799 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c1009d400 0x7f9c10119050 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c00ebe0 tx=0x7f9c0c00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:42.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.543+0000 7f9c067fc700 1 -- 172.21.15.40:0/1992218799 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c00c850 con 0x7f9c1009d400 2023-09-30T22:25:42.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.544+0000 7f9c067fc700 1 -- 172.21.15.40:0/1992218799 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0c00c9b0 con 0x7f9c1009d400 2023-09-30T22:25:42.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.544+0000 7f9c17c75700 1 -- 172.21.15.40:0/1992218799 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c08009a70 con 0x7f9c1009d400 2023-09-30T22:25:42.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.544+0000 7f9c067fc700 1 -- 172.21.15.40:0/1992218799 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c00cd40 con 0x7f9c1009d400 2023-09-30T22:25:42.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.544+0000 7f9c17c75700 1 -- 172.21.15.40:0/1992218799 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c1009ff80 con 0x7f9c1009d400 2023-09-30T22:25:42.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.544+0000 7f9c067fc700 1 -- 172.21.15.40:0/1992218799 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9c0c013470 con 0x7f9c1009d400 2023-09-30T22:25:42.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.544+0000 7f9c067fc700 1 -- 172.21.15.40:0/1992218799 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9c0c03f880 con 0x7f9c1009d400 2023-09-30T22:25:42.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.545+0000 7f9c17c75700 1 -- 172.21.15.40:0/1992218799 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c10062380 con 0x7f9c1009d400 2023-09-30T22:25:42.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.549+0000 7f9c067fc700 1 -- 172.21.15.40:0/1992218799 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9c0c021080 con 0x7f9c1009d400 2023-09-30T22:25:42.599 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:42.624 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:42.687 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:42.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.731+0000 7fa72d23d700 1 Processor -- start 2023-09-30T22:25:42.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.731+0000 7fa72d23d700 1 -- start start 2023-09-30T22:25:42.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.732+0000 7fa72d23d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa728133e00 0x7fa7281341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.732+0000 7fa72d23d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa72809df40 0x7fa72813bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.732+0000 7fa72d23d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa728133940 con 0x7fa72809d400 2023-09-30T22:25:42.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.732+0000 7fa72d23d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa72809ab20 con 0x7fa72809df40 2023-09-30T22:25:42.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.732+0000 7fa72d23d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa72809f0d0 con 0x7fa728133e00 2023-09-30T22:25:42.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.732+0000 7fa726d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa728133e00 0x7fa7281341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.732+0000 7fa72759e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa72809df40 0x7fa72813bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.732+0000 7fa726d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa728133e00 0x7fa7281341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55620/0 (socket says 172.21.15.40:55620) 2023-09-30T22:25:42.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.732+0000 7fa72759e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa72809df40 0x7fa72813bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60750/0 (socket says 172.21.15.40:60750) 2023-09-30T22:25:42.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.732+0000 7fa726d9d700 1 -- 172.21.15.40:0/4190386115 learned_addr learned my addr 172.21.15.40:0/4190386115 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:42.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.733+0000 7fa72759e700 1 -- 172.21.15.40:0/4190386115 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa728133e00 msgr2=0x7fa7281341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:42.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.733+0000 7fa72759e700 1 --2- 172.21.15.40:0/4190386115 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa728133e00 0x7fa7281341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.733+0000 7fa72759e700 1 -- 172.21.15.40:0/4190386115 >> v1:172.21.15.40:6789/0 conn(0x7fa72809d400 legacy=0x7fa72809d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.733+0000 7fa72759e700 1 -- 172.21.15.40:0/4190386115 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa728133be0 con 0x7fa72809df40 2023-09-30T22:25:42.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.733+0000 7fa726d9d700 1 --2- 172.21.15.40:0/4190386115 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa728133e00 0x7fa7281341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:42.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.733+0000 7fa72759e700 1 --2- 172.21.15.40:0/4190386115 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa72809df40 0x7fa72813bc80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa720009dc0 tx=0x7fa72000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68987725c10c54df server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:42.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.733+0000 7fa725d9b700 1 -- 172.21.15.40:0/4190386115 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72000e070 con 0x7fa72809df40 2023-09-30T22:25:42.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.733+0000 7fa725d9b700 1 -- 172.21.15.40:0/4190386115 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa720003a20 con 0x7fa72809df40 2023-09-30T22:25:42.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.733+0000 7fa725d9b700 1 -- 172.21.15.40:0/4190386115 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa720003dd0 con 0x7fa72809df40 2023-09-30T22:25:42.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.734+0000 7fa72d23d700 1 -- 172.21.15.40:0/4190386115 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa72809df40 msgr2=0x7fa72813bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.734+0000 7fa72d23d700 1 --2- 172.21.15.40:0/4190386115 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa72809df40 0x7fa72813bc80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa720009dc0 tx=0x7fa72000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:42.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.734+0000 7fa72d23d700 1 -- 172.21.15.40:0/4190386115 shutdown_connections 2023-09-30T22:25:42.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.734+0000 7fa72d23d700 1 --2- 172.21.15.40:0/4190386115 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa72809df40 0x7fa72813bc80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.734+0000 7fa72d23d700 1 --2- 172.21.15.40:0/4190386115 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa728133e00 0x7fa7281341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.734+0000 7fa72d23d700 1 -- 172.21.15.40:0/4190386115 >> 172.21.15.40:0/4190386115 conn(0x7fa7280a2a00 msgr2=0x7fa7280a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:42.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.734+0000 7fa72d23d700 1 -- 172.21.15.40:0/4190386115 shutdown_connections 2023-09-30T22:25:42.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.734+0000 7fa72d23d700 1 -- 172.21.15.40:0/4190386115 wait complete. 2023-09-30T22:25:42.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.735+0000 7fa72d23d700 1 Processor -- start 2023-09-30T22:25:42.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.736+0000 7fa72d23d700 1 -- start start 2023-09-30T22:25:42.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.736+0000 7fa72d23d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa72809d400 0x7fa728119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.736+0000 7fa72d23d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa72809df40 0x7fa728119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.736+0000 7fa72d23d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa728133e00 0x7fa728119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.736+0000 7fa72d23d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa72811bca0 con 0x7fa72809d400 2023-09-30T22:25:42.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.736+0000 7fa72d23d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa72812e1a0 con 0x7fa728133e00 2023-09-30T22:25:42.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.736+0000 7fa72d23d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa72809ff70 con 0x7fa72809df40 2023-09-30T22:25:42.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.736+0000 7fa72659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa72809df40 0x7fa728119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.737+0000 7fa72659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa72809df40 0x7fa728119590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55622/0 (socket says 172.21.15.40:55622) 2023-09-30T22:25:42.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.737+0000 7fa72659c700 1 -- 172.21.15.40:0/2651090071 learned_addr learned my addr 172.21.15.40:0/2651090071 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:42.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.737+0000 7fa726d9d700 1 --2- 172.21.15.40:0/2651090071 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa72809d400 0x7fa728119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.737+0000 7fa72759e700 1 --2- 172.21.15.40:0/2651090071 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa728133e00 0x7fa728119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.737+0000 7fa72659c700 1 -- 172.21.15.40:0/2651090071 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa728133e00 msgr2=0x7fa728119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.737+0000 7fa72659c700 1 --2- 172.21.15.40:0/2651090071 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa728133e00 0x7fa728119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.737+0000 7fa72659c700 1 -- 172.21.15.40:0/2651090071 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa72809d400 msgr2=0x7fa728119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.737+0000 7fa72659c700 1 --2- 172.21.15.40:0/2651090071 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa72809d400 0x7fa728119050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.737+0000 7fa72659c700 1 -- 172.21.15.40:0/2651090071 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa718009550 con 0x7fa72809df40 2023-09-30T22:25:42.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.737+0000 7fa72659c700 1 --2- 172.21.15.40:0/2651090071 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa72809df40 0x7fa728119590 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa71c00c780 tx=0x7fa71c00ca90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:42.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.737+0000 7fa70f7fe700 1 -- 172.21.15.40:0/2651090071 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71c0054e0 con 0x7fa72809df40 2023-09-30T22:25:42.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.737+0000 7fa70f7fe700 1 -- 172.21.15.40:0/2651090071 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa71c003680 con 0x7fa72809df40 2023-09-30T22:25:42.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.737+0000 7fa70f7fe700 1 -- 172.21.15.40:0/2651090071 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71c003a30 con 0x7fa72809df40 2023-09-30T22:25:42.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.738+0000 7fa72d23d700 1 -- 172.21.15.40:0/2651090071 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa720009a70 con 0x7fa72809df40 2023-09-30T22:25:42.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.739+0000 7fa72d23d700 1 -- 172.21.15.40:0/2651090071 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa72811b850 con 0x7fa72809df40 2023-09-30T22:25:42.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.739+0000 7fa70f7fe700 1 -- 172.21.15.40:0/2651090071 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa71c003b90 con 0x7fa72809df40 2023-09-30T22:25:42.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.740+0000 7fa70f7fe700 1 -- 172.21.15.40:0/2651090071 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa71c03e990 con 0x7fa72809df40 2023-09-30T22:25:42.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.740+0000 7fa72d23d700 1 -- 172.21.15.40:0/2651090071 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa72811bed0 con 0x7fa72809df40 2023-09-30T22:25:42.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.745+0000 7fa70f7fe700 1 -- 172.21.15.40:0/2651090071 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa72811bed0 con 0x7fa72809df40 2023-09-30T22:25:42.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.748+0000 7f9c17c75700 1 -- 172.21.15.40:0/1992218799 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9c100008d0 con 0x7f9c1009d400 2023-09-30T22:25:42.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.748+0000 7f9c067fc700 1 -- 172.21.15.40:0/1992218799 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9c0c0232f0 con 0x7f9c1009d400 2023-09-30T22:25:42.749 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:42.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.750+0000 7f9c17c75700 1 -- 172.21.15.40:0/1992218799 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c1009d400 msgr2=0x7f9c10119050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.750+0000 7f9c17c75700 1 --2- 172.21.15.40:0/1992218799 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c1009d400 0x7f9c10119050 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c00ebe0 tx=0x7f9c0c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.750+0000 7f9c17c75700 1 -- 172.21.15.40:0/1992218799 shutdown_connections 2023-09-30T22:25:42.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.750+0000 7f9c17c75700 1 --2- 172.21.15.40:0/1992218799 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9c10133e00 0x7f9c10119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.750+0000 7f9c17c75700 1 --2- 172.21.15.40:0/1992218799 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c1009d400 0x7f9c10119050 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.751+0000 7f9c17c75700 1 --2- 172.21.15.40:0/1992218799 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c1009df70 0x7f9c10119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.751+0000 7f9c17c75700 1 -- 172.21.15.40:0/1992218799 >> 172.21.15.40:0/1992218799 conn(0x7f9c100a2a00 msgr2=0x7f9c1012d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:42.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.751+0000 7f9c17c75700 1 -- 172.21.15.40:0/1992218799 shutdown_connections 2023-09-30T22:25:42.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.751+0000 7f9c17c75700 1 -- 172.21.15.40:0/1992218799 wait complete. 2023-09-30T22:25:42.764 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:42.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.793+0000 7fc6a544c700 1 Processor -- start 2023-09-30T22:25:42.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.793+0000 7fc6a544c700 1 -- start start 2023-09-30T22:25:42.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.794+0000 7fc6a544c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc6a009c890 0x7fc6a009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.794+0000 7fc6a544c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc6a009d920 0x7fc6a009dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.794+0000 7fc6a544c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a00a2600 con 0x7fc6a009e2b0 2023-09-30T22:25:42.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.794+0000 7fc6a544c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6a00a29d0 con 0x7fc6a009d920 2023-09-30T22:25:42.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.794+0000 7fc6a544c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a009fb40 con 0x7fc6a009c890 2023-09-30T22:25:42.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.794+0000 7fc69e7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc6a009d920 0x7fc6a009dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.794+0000 7fc69e7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc6a009d920 0x7fc6a009dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51342/0 (socket says 172.21.15.40:51342) 2023-09-30T22:25:42.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.794+0000 7fc69e7fc700 1 -- 172.21.15.40:0/913265698 learned_addr learned my addr 172.21.15.40:0/913265698 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:42.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.794+0000 7fc69effd700 1 --2- 172.21.15.40:0/913265698 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc6a009c890 0x7fc6a009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.794+0000 7fc69e7fc700 1 -- 172.21.15.40:0/913265698 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc6a009c890 msgr2=0x7fc6a009cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:42.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.794+0000 7fc69e7fc700 1 --2- 172.21.15.40:0/913265698 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc6a009c890 0x7fc6a009cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.794+0000 7fc69e7fc700 1 -- 172.21.15.40:0/913265698 >> v1:172.21.15.40:6789/0 conn(0x7fc6a009e2b0 legacy=0x7fc6a013ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.794+0000 7fc69e7fc700 1 -- 172.21.15.40:0/913265698 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a009e750 con 0x7fc6a009d920 2023-09-30T22:25:42.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.794+0000 7fc69e7fc700 1 --2- 172.21.15.40:0/913265698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6a009d920 0x7fc6a009dd70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc6940098f0 tx=0x7fc694009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5a1d6b991c2b93 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:42.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.795+0000 7fc69dffb700 1 -- 172.21.15.40:0/913265698 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc694011830 con 0x7fc6a009d920 2023-09-30T22:25:42.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.795+0000 7fc69dffb700 1 -- 172.21.15.40:0/913265698 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc694011990 con 0x7fc6a009d920 2023-09-30T22:25:42.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.795+0000 7fc69dffb700 1 -- 172.21.15.40:0/913265698 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc694011d20 con 0x7fc6a009d920 2023-09-30T22:25:42.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.795+0000 7fc6a544c700 1 -- 172.21.15.40:0/913265698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6a009d920 msgr2=0x7fc6a009dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.795+0000 7fc6a544c700 1 --2- 172.21.15.40:0/913265698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6a009d920 0x7fc6a009dd70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc6940098f0 tx=0x7fc694009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:42.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.795+0000 7fc6a544c700 1 -- 172.21.15.40:0/913265698 shutdown_connections 2023-09-30T22:25:42.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.795+0000 7fc6a544c700 1 --2- 172.21.15.40:0/913265698 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc6a009c890 0x7fc6a009cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.795+0000 7fc6a544c700 1 --2- 172.21.15.40:0/913265698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6a009d920 0x7fc6a009dd70 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.795+0000 7fc6a544c700 1 -- 172.21.15.40:0/913265698 >> 172.21.15.40:0/913265698 conn(0x7fc6a00a7080 msgr2=0x7fc6a00a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:42.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.795+0000 7fc6a544c700 1 -- 172.21.15.40:0/913265698 shutdown_connections 2023-09-30T22:25:42.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.795+0000 7fc6a544c700 1 -- 172.21.15.40:0/913265698 wait complete. 2023-09-30T22:25:42.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.796+0000 7fc6a544c700 1 Processor -- start 2023-09-30T22:25:42.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.796+0000 7fc6a544c700 1 -- start start 2023-09-30T22:25:42.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.797+0000 7fc6a544c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc6a009c890 0x7fc6a012d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.797+0000 7fc6a544c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6a009d920 0x7fc6a012d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.797+0000 7fc6a544c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6a009e2b0 0x7fc6a012def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.797+0000 7fc6a544c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a01308e0 con 0x7fc6a009e2b0 2023-09-30T22:25:42.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.797+0000 7fc6a544c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a00a5be0 con 0x7fc6a009d920 2023-09-30T22:25:42.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.797+0000 7fc6a544c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a009c320 con 0x7fc6a009c890 2023-09-30T22:25:42.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.797+0000 7fc69e7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6a009d920 0x7fc6a012d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.797+0000 7fc69f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6a009e2b0 0x7fc6a012def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.797+0000 7fc69e7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6a009d920 0x7fc6a012d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60772/0 (socket says 172.21.15.40:60772) 2023-09-30T22:25:42.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.797+0000 7fc69e7fc700 1 -- 172.21.15.40:0/973518731 learned_addr learned my addr 172.21.15.40:0/973518731 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:42.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.797+0000 7fc69effd700 1 --2- 172.21.15.40:0/973518731 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc6a009c890 0x7fc6a012d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.797+0000 7fc69f7fe700 1 -- 172.21.15.40:0/973518731 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc6a009c890 msgr2=0x7fc6a012d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.797+0000 7fc69f7fe700 1 --2- 172.21.15.40:0/973518731 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc6a009c890 0x7fc6a012d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.797+0000 7fc69f7fe700 1 -- 172.21.15.40:0/973518731 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6a009d920 msgr2=0x7fc6a012d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.797+0000 7fc69f7fe700 1 --2- 172.21.15.40:0/973518731 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6a009d920 0x7fc6a012d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.797+0000 7fc69f7fe700 1 -- 172.21.15.40:0/973518731 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc694009550 con 0x7fc6a009e2b0 2023-09-30T22:25:42.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.797+0000 7fc69e7fc700 1 --2- 172.21.15.40:0/973518731 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6a009d920 0x7fc6a012d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:42.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.798+0000 7fc69f7fe700 1 --2- 172.21.15.40:0/973518731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6a009e2b0 0x7fc6a012def0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc69800cb90 tx=0x7fc69800cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:42.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.798+0000 7fc6877fe700 1 -- 172.21.15.40:0/973518731 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc698003c00 con 0x7fc6a009e2b0 2023-09-30T22:25:42.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.798+0000 7fc6877fe700 1 -- 172.21.15.40:0/973518731 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc698003d60 con 0x7fc6a009e2b0 2023-09-30T22:25:42.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.798+0000 7fc6a544c700 1 -- 172.21.15.40:0/973518731 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a009ecf0 con 0x7fc6a009e2b0 2023-09-30T22:25:42.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.798+0000 7fc6877fe700 1 -- 172.21.15.40:0/973518731 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69800aa80 con 0x7fc6a009e2b0 2023-09-30T22:25:42.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.798+0000 7fc6a544c700 1 -- 172.21.15.40:0/973518731 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a012f240 con 0x7fc6a009e2b0 2023-09-30T22:25:42.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.799+0000 7fc6877fe700 1 -- 172.21.15.40:0/973518731 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc69800abe0 con 0x7fc6a009e2b0 2023-09-30T22:25:42.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.799+0000 7fc6877fe700 1 -- 172.21.15.40:0/973518731 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc69803f580 con 0x7fc6a009e2b0 2023-09-30T22:25:42.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.799+0000 7fc6a544c700 1 -- 172.21.15.40:0/973518731 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6a0062380 con 0x7fc6a009e2b0 2023-09-30T22:25:42.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.804+0000 7fc6877fe700 1 -- 172.21.15.40:0/973518731 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc6980198f0 con 0x7fc6a009e2b0 2023-09-30T22:25:42.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.824+0000 7fb3239f0700 1 Processor -- start 2023-09-30T22:25:42.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.824+0000 7fb3239f0700 1 -- start start 2023-09-30T22:25:42.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.825+0000 7fb3239f0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb31c09d920 0x7fb31c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.825+0000 7fb3239f0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb31c09e230 0x7fb31c1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.825+0000 7fb3239f0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb31c09f940 con 0x7fb31c09f0f0 2023-09-30T22:25:42.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.825+0000 7fb3239f0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb31c06b4c0 con 0x7fb31c09e230 2023-09-30T22:25:42.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.825+0000 7fb3239f0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c09a8f0 con 0x7fb31c09d920 2023-09-30T22:25:42.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.825+0000 7fb320f8b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb31c09f0f0 0x7fb31c133ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45720/0 (socket says 172.21.15.40:45720) 2023-09-30T22:25:42.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.825+0000 7fb320f8b700 1 -- 172.21.15.40:0/1327453625 learned_addr learned my addr 172.21.15.40:0/1327453625 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:42.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.825+0000 7fb321f8d700 1 --2- 172.21.15.40:0/1327453625 >> v2:172.21.15.40:3300/0 conn(0x7fb31c09e230 0x7fb31c1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.825+0000 7fb32178c700 1 --2- 172.21.15.40:0/1327453625 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb31c09d920 0x7fb31c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.825+0000 7fb321f8d700 1 -- 172.21.15.40:0/1327453625 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb31c09d920 msgr2=0x7fb31c09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:42.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.825+0000 7fb321f8d700 1 --2- 172.21.15.40:0/1327453625 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb31c09d920 0x7fb31c09dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.825+0000 7fb321f8d700 1 -- 172.21.15.40:0/1327453625 >> v1:172.21.15.40:6789/0 conn(0x7fb31c09f0f0 legacy=0x7fb31c133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.825+0000 7fb313fff700 1 -- 172.21.15.40:0/1327453625 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2339542723 0 0) 0x7fb31c09f940 con 0x7fb31c09f0f0 2023-09-30T22:25:42.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.825+0000 7fb321f8d700 1 -- 172.21.15.40:0/1327453625 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31c09f6e0 con 0x7fb31c09e230 2023-09-30T22:25:42.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.826+0000 7fb321f8d700 1 --2- 172.21.15.40:0/1327453625 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb31c09e230 0x7fb31c1343b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb314009dc0 tx=0x7fb31400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8d619eedd45f04 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:42.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.826+0000 7fb313fff700 1 -- 172.21.15.40:0/1327453625 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31400e070 con 0x7fb31c09e230 2023-09-30T22:25:42.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.826+0000 7fb313fff700 1 -- 172.21.15.40:0/1327453625 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31400bae0 con 0x7fb31c09e230 2023-09-30T22:25:42.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.826+0000 7fb313fff700 1 -- 172.21.15.40:0/1327453625 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31400be90 con 0x7fb31c09e230 2023-09-30T22:25:42.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.826+0000 7fb3239f0700 1 -- 172.21.15.40:0/1327453625 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb31c09e230 msgr2=0x7fb31c1343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.826+0000 7fb3239f0700 1 --2- 172.21.15.40:0/1327453625 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb31c09e230 0x7fb31c1343b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb314009dc0 tx=0x7fb31400b330 comp rx=0 tx=0).stop 2023-09-30T22:25:42.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.826+0000 7fb3239f0700 1 -- 172.21.15.40:0/1327453625 shutdown_connections 2023-09-30T22:25:42.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.827+0000 7fb3239f0700 1 --2- 172.21.15.40:0/1327453625 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb31c09e230 0x7fb31c1343b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.827+0000 7fb3239f0700 1 --2- 172.21.15.40:0/1327453625 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb31c09d920 0x7fb31c09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.827+0000 7fb3239f0700 1 -- 172.21.15.40:0/1327453625 >> 172.21.15.40:0/1327453625 conn(0x7fb31c09fb20 msgr2=0x7fb31c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:42.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.827+0000 7fb3239f0700 1 -- 172.21.15.40:0/1327453625 shutdown_connections 2023-09-30T22:25:42.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.827+0000 7fb3239f0700 1 -- 172.21.15.40:0/1327453625 wait complete. 2023-09-30T22:25:42.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.828+0000 7fb3239f0700 1 Processor -- start 2023-09-30T22:25:42.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.828+0000 7fb3239f0700 1 -- start start 2023-09-30T22:25:42.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.829+0000 7fb3239f0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb31c09d920 0x7fb31c1a61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.829+0000 7fb3239f0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb31c09e230 0x7fb31c1a66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.829+0000 7fb3239f0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb31c1aa180 0x7fb31c1a6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.829+0000 7fb3239f0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c1a7d70 con 0x7fb31c09d920 2023-09-30T22:25:42.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.829+0000 7fb3239f0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c1a75c0 con 0x7fb31c09e230 2023-09-30T22:25:42.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.829+0000 7fb3239f0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c09c9e0 con 0x7fb31c1aa180 2023-09-30T22:25:42.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.829+0000 7fb320f8b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb31c09e230 0x7fb31c1a66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.829+0000 7fb320f8b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb31c09e230 0x7fb31c1a66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60792/0 (socket says 172.21.15.40:60792) 2023-09-30T22:25:42.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.829+0000 7fb320f8b700 1 -- 172.21.15.40:0/110063726 learned_addr learned my addr 172.21.15.40:0/110063726 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:42.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.829+0000 7fb32178c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb31c09d920 0x7fb31c1a61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.829+0000 7fb321f8d700 1 --2- 172.21.15.40:0/110063726 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb31c1aa180 0x7fb31c1a6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.829+0000 7fb320f8b700 1 -- 172.21.15.40:0/110063726 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb31c1aa180 msgr2=0x7fb31c1a6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.829+0000 7fb320f8b700 1 --2- 172.21.15.40:0/110063726 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb31c1aa180 0x7fb31c1a6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.829+0000 7fb320f8b700 1 -- 172.21.15.40:0/110063726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb31c09d920 msgr2=0x7fb31c1a61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.829+0000 7fb320f8b700 1 --2- 172.21.15.40:0/110063726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb31c09d920 0x7fb31c1a61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.829+0000 7fb320f8b700 1 -- 172.21.15.40:0/110063726 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb314009a70 con 0x7fb31c09e230 2023-09-30T22:25:42.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.829+0000 7fb32178c700 1 --2- 172.21.15.40:0/110063726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb31c09d920 0x7fb31c1a61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:42.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.830+0000 7fb320f8b700 1 --2- 172.21.15.40:0/110063726 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb31c09e230 0x7fb31c1a66e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb30c00c580 tx=0x7fb30c00c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:42.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.830+0000 7fb311ffb700 1 -- 172.21.15.40:0/110063726 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30c004c80 con 0x7fb31c09e230 2023-09-30T22:25:42.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.830+0000 7fb311ffb700 1 -- 172.21.15.40:0/110063726 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30c004e20 con 0x7fb31c09e230 2023-09-30T22:25:42.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.830+0000 7fb311ffb700 1 -- 172.21.15.40:0/110063726 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30c007310 con 0x7fb31c09e230 2023-09-30T22:25:42.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.831+0000 7fb3239f0700 1 -- 172.21.15.40:0/110063726 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb31c1a99a0 con 0x7fb31c09e230 2023-09-30T22:25:42.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.831+0000 7fb3239f0700 1 -- 172.21.15.40:0/110063726 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb31c1a8fc0 con 0x7fb31c09e230 2023-09-30T22:25:42.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.831+0000 7fb311ffb700 1 -- 172.21.15.40:0/110063726 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb30c007470 con 0x7fb31c09e230 2023-09-30T22:25:42.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.831+0000 7fb311ffb700 1 -- 172.21.15.40:0/110063726 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb30c03f260 con 0x7fb31c09e230 2023-09-30T22:25:42.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.832+0000 7fb3239f0700 1 -- 172.21.15.40:0/110063726 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb31c0a3010 con 0x7fb31c09e230 2023-09-30T22:25:42.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.837+0000 7fb311ffb700 1 -- 172.21.15.40:0/110063726 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb30c0123b0 con 0x7fb31c09e230 2023-09-30T22:25:42.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.966+0000 7fa72d23d700 1 -- 172.21.15.40:0/2651090071 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa72811bed0 con 0x7fa72809df40 2023-09-30T22:25:42.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.967+0000 7fa70f7fe700 1 -- 172.21.15.40:0/2651090071 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa72811bed0 con 0x7fa72809df40 2023-09-30T22:25:42.967 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:42.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.969+0000 7fa72d23d700 1 -- 172.21.15.40:0/2651090071 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa72809df40 msgr2=0x7fa728119590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.969+0000 7fa72d23d700 1 --2- 172.21.15.40:0/2651090071 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa72809df40 0x7fa728119590 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa71c00c780 tx=0x7fa71c00ca90 comp rx=0 tx=0).stop 2023-09-30T22:25:42.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.969+0000 7fa72d23d700 1 -- 172.21.15.40:0/2651090071 shutdown_connections 2023-09-30T22:25:42.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.969+0000 7fa72d23d700 1 --2- 172.21.15.40:0/2651090071 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa728133e00 0x7fa728119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.969+0000 7fa72d23d700 1 --2- 172.21.15.40:0/2651090071 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa72809d400 0x7fa728119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.969+0000 7fa72d23d700 1 --2- 172.21.15.40:0/2651090071 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa72809df40 0x7fa728119590 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.969+0000 7fa72d23d700 1 -- 172.21.15.40:0/2651090071 >> 172.21.15.40:0/2651090071 conn(0x7fa7280a2a00 msgr2=0x7fa72812da10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:42.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.969+0000 7fa72d23d700 1 -- 172.21.15.40:0/2651090071 shutdown_connections 2023-09-30T22:25:42.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:42.969+0000 7fa72d23d700 1 -- 172.21.15.40:0/2651090071 wait complete. 2023-09-30T22:25:42.982 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:43.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.004+0000 7fc6a544c700 1 -- 172.21.15.40:0/973518731 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc6a0074620 con 0x7fc6a009e2b0 2023-09-30T22:25:43.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.004+0000 7fc6877fe700 1 -- 172.21.15.40:0/973518731 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc698019300 con 0x7fc6a009e2b0 2023-09-30T22:25:43.005 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:43.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.006+0000 7fc6a544c700 1 -- 172.21.15.40:0/973518731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6a009e2b0 msgr2=0x7fc6a012def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:43.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.006+0000 7fc6a544c700 1 --2- 172.21.15.40:0/973518731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6a009e2b0 0x7fc6a012def0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc69800cb90 tx=0x7fc69800cea0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.006+0000 7fc6a544c700 1 -- 172.21.15.40:0/973518731 shutdown_connections 2023-09-30T22:25:43.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.006+0000 7fc6a544c700 1 --2- 172.21.15.40:0/973518731 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc6a009c890 0x7fc6a012d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.006+0000 7fc6a544c700 1 --2- 172.21.15.40:0/973518731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6a009e2b0 0x7fc6a012def0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.006+0000 7fc6a544c700 1 --2- 172.21.15.40:0/973518731 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6a009d920 0x7fc6a012d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.006+0000 7fc6a544c700 1 -- 172.21.15.40:0/973518731 >> 172.21.15.40:0/973518731 conn(0x7fc6a00a7080 msgr2=0x7fc6a00a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:43.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.006+0000 7fc6a544c700 1 -- 172.21.15.40:0/973518731 shutdown_connections 2023-09-30T22:25:43.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.006+0000 7fc6a544c700 1 -- 172.21.15.40:0/973518731 wait complete. 2023-09-30T22:25:43.019 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:43.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.033+0000 7fb3239f0700 1 -- 172.21.15.40:0/110063726 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb31c062380 con 0x7fb31c09e230 2023-09-30T22:25:43.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.034+0000 7fb311ffb700 1 -- 172.21.15.40:0/110063726 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb30c011360 con 0x7fb31c09e230 2023-09-30T22:25:43.035 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:43.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.036+0000 7fb3239f0700 1 -- 172.21.15.40:0/110063726 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb31c09e230 msgr2=0x7fb31c1a66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:43.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.036+0000 7fb3239f0700 1 --2- 172.21.15.40:0/110063726 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb31c09e230 0x7fb31c1a66e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb30c00c580 tx=0x7fb30c00c890 comp rx=0 tx=0).stop 2023-09-30T22:25:43.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.036+0000 7fb3239f0700 1 -- 172.21.15.40:0/110063726 shutdown_connections 2023-09-30T22:25:43.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.036+0000 7fb3239f0700 1 --2- 172.21.15.40:0/110063726 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb31c1aa180 0x7fb31c1a6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.036+0000 7fb3239f0700 1 --2- 172.21.15.40:0/110063726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb31c09d920 0x7fb31c1a61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.036+0000 7fb3239f0700 1 --2- 172.21.15.40:0/110063726 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb31c09e230 0x7fb31c1a66e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.036+0000 7fb3239f0700 1 -- 172.21.15.40:0/110063726 >> 172.21.15.40:0/110063726 conn(0x7fb31c09fb20 msgr2=0x7fb31c1bb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:43.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.036+0000 7fb3239f0700 1 -- 172.21.15.40:0/110063726 shutdown_connections 2023-09-30T22:25:43.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.036+0000 7fb3239f0700 1 -- 172.21.15.40:0/110063726 wait complete. 2023-09-30T22:25:43.049 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:43.765 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:43.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.905+0000 7fd0a1900700 1 Processor -- start 2023-09-30T22:25:43.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.905+0000 7fd0a1900700 1 -- start start 2023-09-30T22:25:43.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.906+0000 7fd0a1900700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd09c06a6d0 0x7fd09c06aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:43.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.906+0000 7fd0a1900700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd09c131fc0 0x7fd09c139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:43.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.906+0000 7fd0a1900700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd09c09eb50 con 0x7fd09c06afe0 2023-09-30T22:25:43.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.906+0000 7fd0a1900700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c09dde0 con 0x7fd09c131fc0 2023-09-30T22:25:43.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.906+0000 7fd0a1900700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c09d4a0 con 0x7fd09c06a6d0 2023-09-30T22:25:43.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.906+0000 7fd09affd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd09c06a6d0 0x7fd09c06aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:43.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.906+0000 7fd093fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd09c06afe0 0x7fd09c1318b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56066/0 (socket says 172.21.15.40:56066) 2023-09-30T22:25:43.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.906+0000 7fd09b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd09c131fc0 0x7fd09c139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:43.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.906+0000 7fd093fff700 1 -- 172.21.15.40:0/2107709964 learned_addr learned my addr 172.21.15.40:0/2107709964 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:43.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.906+0000 7fd09a7fc700 1 -- 172.21.15.40:0/2107709964 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2606320304 0 0) 0x7fd09c09eb50 con 0x7fd09c06afe0 2023-09-30T22:25:43.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.907+0000 7fd09a7fc700 1 -- 172.21.15.40:0/2107709964 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0880035b0 con 0x7fd09c06afe0 2023-09-30T22:25:43.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.907+0000 7fd09affd700 1 -- 172.21.15.40:0/2107709964 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd09c131fc0 msgr2=0x7fd09c139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:43.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.907+0000 7fd09affd700 1 --2- 172.21.15.40:0/2107709964 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd09c131fc0 0x7fd09c139b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.907+0000 7fd09affd700 1 -- 172.21.15.40:0/2107709964 >> v1:172.21.15.40:6789/0 conn(0x7fd09c06afe0 legacy=0x7fd09c1318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:43.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.907+0000 7fd09affd700 1 -- 172.21.15.40:0/2107709964 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd09c09f5f0 con 0x7fd09c06a6d0 2023-09-30T22:25:43.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.907+0000 7fd09b7fe700 1 --2- 172.21.15.40:0/2107709964 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd09c131fc0 0x7fd09c139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:43.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.907+0000 7fd09affd700 1 --2- 172.21.15.40:0/2107709964 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd09c06a6d0 0x7fd09c06aaa0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd08c009850 tx=0x7fd08c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fbe8a636de6b68a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:43.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.907+0000 7fd09a7fc700 1 -- 172.21.15.40:0/2107709964 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08c005e30 con 0x7fd09c06a6d0 2023-09-30T22:25:43.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.907+0000 7fd09a7fc700 1 -- 172.21.15.40:0/2107709964 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08c006030 con 0x7fd09c06a6d0 2023-09-30T22:25:43.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.907+0000 7fd09a7fc700 1 -- 172.21.15.40:0/2107709964 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08c0063a0 con 0x7fd09c06a6d0 2023-09-30T22:25:43.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.907+0000 7fd0a1900700 1 -- 172.21.15.40:0/2107709964 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd09c06a6d0 msgr2=0x7fd09c06aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:43.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.907+0000 7fd0a1900700 1 --2- 172.21.15.40:0/2107709964 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd09c06a6d0 0x7fd09c06aaa0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd08c009850 tx=0x7fd08c009b60 comp rx=0 tx=0).stop 2023-09-30T22:25:43.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.908+0000 7fd0a1900700 1 -- 172.21.15.40:0/2107709964 shutdown_connections 2023-09-30T22:25:43.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.908+0000 7fd0a1900700 1 --2- 172.21.15.40:0/2107709964 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd09c131fc0 0x7fd09c139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.908+0000 7fd0a1900700 1 --2- 172.21.15.40:0/2107709964 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd09c06a6d0 0x7fd09c06aaa0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.908+0000 7fd0a1900700 1 -- 172.21.15.40:0/2107709964 >> 172.21.15.40:0/2107709964 conn(0x7fd09c09fb20 msgr2=0x7fd09c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:43.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.908+0000 7fd0a1900700 1 -- 172.21.15.40:0/2107709964 shutdown_connections 2023-09-30T22:25:43.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.908+0000 7fd0a1900700 1 -- 172.21.15.40:0/2107709964 wait complete. 2023-09-30T22:25:43.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.909+0000 7fd0a1900700 1 Processor -- start 2023-09-30T22:25:43.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.909+0000 7fd0a1900700 1 -- start start 2023-09-30T22:25:43.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.910+0000 7fd0a1900700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd09c06a6d0 0x7fd09c120490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:43.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.910+0000 7fd0a1900700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd09c06afe0 0x7fd09c1209d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:43.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.910+0000 7fd0a1900700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd09c131fc0 0x7fd09c120f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:43.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.910+0000 7fd0a1900700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c123a10 con 0x7fd09c06afe0 2023-09-30T22:25:43.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.910+0000 7fd0a1900700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c123db0 con 0x7fd09c131fc0 2023-09-30T22:25:43.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.910+0000 7fd0a1900700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c1218f0 con 0x7fd09c06a6d0 2023-09-30T22:25:43.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.910+0000 7fd09affd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd09c06a6d0 0x7fd09c120490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:43.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.910+0000 7fd09affd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd09c06a6d0 0x7fd09c120490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33704/0 (socket says 172.21.15.40:33704) 2023-09-30T22:25:43.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.910+0000 7fd09affd700 1 -- 172.21.15.40:0/4135931173 learned_addr learned my addr 172.21.15.40:0/4135931173 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:43.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.910+0000 7fd093fff700 1 --2- 172.21.15.40:0/4135931173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd09c06afe0 0x7fd09c1209d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:43.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.910+0000 7fd09b7fe700 1 --2- 172.21.15.40:0/4135931173 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd09c131fc0 0x7fd09c120f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:43.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.910+0000 7fd09affd700 1 -- 172.21.15.40:0/4135931173 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd09c131fc0 msgr2=0x7fd09c120f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:43.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.910+0000 7fd09affd700 1 --2- 172.21.15.40:0/4135931173 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd09c131fc0 0x7fd09c120f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.910+0000 7fd09affd700 1 -- 172.21.15.40:0/4135931173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd09c06afe0 msgr2=0x7fd09c1209d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:43.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.910+0000 7fd09affd700 1 --2- 172.21.15.40:0/4135931173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd09c06afe0 0x7fd09c1209d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.910+0000 7fd09affd700 1 -- 172.21.15.40:0/4135931173 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd094009a70 con 0x7fd09c06a6d0 2023-09-30T22:25:43.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.910+0000 7fd09affd700 1 --2- 172.21.15.40:0/4135931173 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd09c06a6d0 0x7fd09c120490 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd08c000c00 tx=0x7fd08c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:43.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.910+0000 7fd098ff9700 1 -- 172.21.15.40:0/4135931173 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08c006850 con 0x7fd09c06a6d0 2023-09-30T22:25:43.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.910+0000 7fd098ff9700 1 -- 172.21.15.40:0/4135931173 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08c020070 con 0x7fd09c06a6d0 2023-09-30T22:25:43.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.910+0000 7fd0a1900700 1 -- 172.21.15.40:0/4135931173 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd08c009430 con 0x7fd09c06a6d0 2023-09-30T22:25:43.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.910+0000 7fd098ff9700 1 -- 172.21.15.40:0/4135931173 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08c004280 con 0x7fd09c06a6d0 2023-09-30T22:25:43.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.911+0000 7fd0a1900700 1 -- 172.21.15.40:0/4135931173 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd09c122140 con 0x7fd09c06a6d0 2023-09-30T22:25:43.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.911+0000 7fd098ff9700 1 -- 172.21.15.40:0/4135931173 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd08c022030 con 0x7fd09c06a6d0 2023-09-30T22:25:43.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.911+0000 7fd098ff9700 1 -- 172.21.15.40:0/4135931173 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd08c040ab0 con 0x7fd09c06a6d0 2023-09-30T22:25:43.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.911+0000 7fd0a1900700 1 -- 172.21.15.40:0/4135931173 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd09c123bd0 con 0x7fd09c06a6d0 2023-09-30T22:25:43.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:43.916+0000 7fd098ff9700 1 -- 172.21.15.40:0/4135931173 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd08c0069b0 con 0x7fd09c06a6d0 2023-09-30T22:25:43.983 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:44.019 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:44.050 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:44.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.117+0000 7f421a333700 1 Processor -- start 2023-09-30T22:25:44.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.118+0000 7f421a333700 1 -- start start 2023-09-30T22:25:44.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.118+0000 7f421a333700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f421409d920 0x7f421409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.118+0000 7f421a333700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f421409f0f0 0x7f421409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.118+0000 7f421a333700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4214133ca0 0x7f4214134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.118+0000 7f421a333700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f421406b4c0 con 0x7f421409f0f0 2023-09-30T22:25:44.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.118+0000 7f421a333700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f421409a8f0 con 0x7f421409d920 2023-09-30T22:25:44.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.118+0000 7f421a333700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f421409f940 con 0x7f4214133ca0 2023-09-30T22:25:44.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.118+0000 7f42137fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f421409f0f0 0x7f421409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.118+0000 7f42188d0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4214133ca0 0x7f4214134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.118+0000 7f42137fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f421409f0f0 0x7f421409e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42764/0 (socket says 172.21.15.40:42764) 2023-09-30T22:25:44.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.118+0000 7f42137fe700 1 -- 172.21.15.40:0/1448316719 learned_addr learned my addr 172.21.15.40:0/1448316719 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:44.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.119+0000 7f42188d0700 1 -- 172.21.15.40:0/1448316719 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f421409d920 msgr2=0x7f421409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:44.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.119+0000 7f4213fff700 1 --2- 172.21.15.40:0/1448316719 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f421409d920 0x7f421409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.119+0000 7f42188d0700 1 --2- 172.21.15.40:0/1448316719 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f421409d920 0x7f421409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.119+0000 7f42188d0700 1 -- 172.21.15.40:0/1448316719 >> v2:172.21.15.40:3300/0 conn(0x7f421409f0f0 msgr2=0x7f421409e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:44.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.119+0000 7f42188d0700 1 --2- 172.21.15.40:0/1448316719 >> v2:172.21.15.40:3300/0 conn(0x7f421409f0f0 0x7f421409e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.119+0000 7f42188d0700 1 -- 172.21.15.40:0/1448316719 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421409f6e0 con 0x7f4214133ca0 2023-09-30T22:25:44.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.119+0000 7f42137fe700 1 --2- 172.21.15.40:0/1448316719 >> v2:172.21.15.40:3300/0 conn(0x7f421409f0f0 0x7f421409e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:44.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.119+0000 7f4213fff700 1 --2- 172.21.15.40:0/1448316719 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f421409d920 0x7f421409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:44.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.119+0000 7f42188d0700 1 --2- 172.21.15.40:0/1448316719 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4214133ca0 0x7f4214134140 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f420c009dc0 tx=0x7f420c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a5dbd4c56f79cc8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:44.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.119+0000 7f4212ffd700 1 -- 172.21.15.40:0/1448316719 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c00e070 con 0x7f4214133ca0 2023-09-30T22:25:44.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.119+0000 7f4212ffd700 1 -- 172.21.15.40:0/1448316719 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420c00bae0 con 0x7f4214133ca0 2023-09-30T22:25:44.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.119+0000 7f4212ffd700 1 -- 172.21.15.40:0/1448316719 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c00be90 con 0x7f4214133ca0 2023-09-30T22:25:44.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.120+0000 7f421a333700 1 -- 172.21.15.40:0/1448316719 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4214133ca0 msgr2=0x7f4214134140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.120+0000 7f421a333700 1 --2- 172.21.15.40:0/1448316719 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4214133ca0 0x7f4214134140 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f420c009dc0 tx=0x7f420c00b330 comp rx=0 tx=0).stop 2023-09-30T22:25:44.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.120+0000 7f421a333700 1 -- 172.21.15.40:0/1448316719 shutdown_connections 2023-09-30T22:25:44.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.120+0000 7f421a333700 1 --2- 172.21.15.40:0/1448316719 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4214133ca0 0x7f4214134140 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.120+0000 7f421a333700 1 --2- 172.21.15.40:0/1448316719 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f421409d920 0x7f421409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.120+0000 7f421a333700 1 --2- 172.21.15.40:0/1448316719 >> v2:172.21.15.40:3300/0 conn(0x7f421409f0f0 0x7f421409e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.120+0000 7f421a333700 1 -- 172.21.15.40:0/1448316719 >> 172.21.15.40:0/1448316719 conn(0x7f421409fb20 msgr2=0x7f421409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:44.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.120+0000 7f421a333700 1 -- 172.21.15.40:0/1448316719 shutdown_connections 2023-09-30T22:25:44.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.120+0000 7f421a333700 1 -- 172.21.15.40:0/1448316719 wait complete. 2023-09-30T22:25:44.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.121+0000 7f421a333700 1 Processor -- start 2023-09-30T22:25:44.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.121+0000 7fd0a1900700 1 -- 172.21.15.40:0/4135931173 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd09c071560 con 0x7fd09c06a6d0 2023-09-30T22:25:44.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.121+0000 7f421a333700 1 -- start start 2023-09-30T22:25:44.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.121+0000 7fd098ff9700 1 -- 172.21.15.40:0/4135931173 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd08c01c410 con 0x7fd09c06a6d0 2023-09-30T22:25:44.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.122+0000 7f421a333700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f421409d920 0x7f4214122a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.122+0000 7f421a333700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4214133ca0 0x7f4214122f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.122+0000 7f421a333700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4214123490 0x7f42141c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.122+0000 7f421a333700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4214133610 con 0x7f4214133ca0 2023-09-30T22:25:44.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.122+0000 7f421a333700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4214125ca0 con 0x7f421409d920 2023-09-30T22:25:44.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.122+0000 7f421a333700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4214071110 con 0x7f4214123490 2023-09-30T22:25:44.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.122+0000 7f4213fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f421409d920 0x7f4214122a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.122+0000 7f42188d0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4214123490 0x7f42141c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.122+0000 7f4213fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f421409d920 0x7f4214122a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52918/0 (socket says 172.21.15.40:52918) 2023-09-30T22:25:44.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.122+0000 7f42188d0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4214123490 0x7f42141c8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33720/0 (socket says 172.21.15.40:33720) 2023-09-30T22:25:44.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.122+0000 7f4213fff700 1 -- 172.21.15.40:0/3793247631 learned_addr learned my addr 172.21.15.40:0/3793247631 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:44.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.122+0000 7f42137fe700 1 --2- 172.21.15.40:0/3793247631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4214133ca0 0x7f4214122f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.122+0000 7f4213fff700 1 -- 172.21.15.40:0/3793247631 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4214123490 msgr2=0x7f42141c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.122+0000 7f4213fff700 1 --2- 172.21.15.40:0/3793247631 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4214123490 0x7f42141c8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.122+0000 7f4213fff700 1 -- 172.21.15.40:0/3793247631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4214133ca0 msgr2=0x7f4214122f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.122+0000 7f4213fff700 1 --2- 172.21.15.40:0/3793247631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4214133ca0 0x7f4214122f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.122+0000 7f4213fff700 1 -- 172.21.15.40:0/3793247631 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4208009550 con 0x7f421409d920 2023-09-30T22:25:44.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.122+0000 7f4213fff700 1 --2- 172.21.15.40:0/3793247631 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f421409d920 0x7f4214122a10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f420400c7c0 tx=0x7f420400cad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:44.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.123+0000 7f4210ff9700 1 -- 172.21.15.40:0/3793247631 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4204005c20 con 0x7f421409d920 2023-09-30T22:25:44.128 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:44.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.123+0000 7f421a333700 1 -- 172.21.15.40:0/3793247631 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f420c009a70 con 0x7f421409d920 2023-09-30T22:25:44.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.123+0000 7f421a333700 1 -- 172.21.15.40:0/3793247631 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4214125f90 con 0x7f421409d920 2023-09-30T22:25:44.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.124+0000 7f4210ff9700 1 -- 172.21.15.40:0/3793247631 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4204005d80 con 0x7f421409d920 2023-09-30T22:25:44.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.124+0000 7f421a333700 1 -- 172.21.15.40:0/3793247631 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4214062380 con 0x7f421409d920 2023-09-30T22:25:44.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.124+0000 7f4210ff9700 1 -- 172.21.15.40:0/3793247631 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4204011820 con 0x7f421409d920 2023-09-30T22:25:44.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.125+0000 7f4210ff9700 1 -- 172.21.15.40:0/3793247631 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4204011980 con 0x7f421409d920 2023-09-30T22:25:44.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.125+0000 7f4210ff9700 1 -- 172.21.15.40:0/3793247631 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f420403f880 con 0x7f421409d920 2023-09-30T22:25:44.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.125+0000 7fd0a1900700 1 -- 172.21.15.40:0/4135931173 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd09c06a6d0 msgr2=0x7fd09c120490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.125+0000 7fd0a1900700 1 --2- 172.21.15.40:0/4135931173 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd09c06a6d0 0x7fd09c120490 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd08c000c00 tx=0x7fd08c004750 comp rx=0 tx=0).stop 2023-09-30T22:25:44.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.125+0000 7fd0a1900700 1 -- 172.21.15.40:0/4135931173 shutdown_connections 2023-09-30T22:25:44.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.125+0000 7fd0a1900700 1 --2- 172.21.15.40:0/4135931173 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd09c06a6d0 0x7fd09c120490 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.125+0000 7fd0a1900700 1 --2- 172.21.15.40:0/4135931173 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd09c131fc0 0x7fd09c120f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.125+0000 7fd0a1900700 1 --2- 172.21.15.40:0/4135931173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd09c06afe0 0x7fd09c1209d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.125+0000 7fd0a1900700 1 -- 172.21.15.40:0/4135931173 >> 172.21.15.40:0/4135931173 conn(0x7fd09c09fb20 msgr2=0x7fd09c0a2500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:44.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.128+0000 7fd0a1900700 1 -- 172.21.15.40:0/4135931173 shutdown_connections 2023-09-30T22:25:44.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.128+0000 7fd0a1900700 1 -- 172.21.15.40:0/4135931173 wait complete. 2023-09-30T22:25:44.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.133+0000 7f4210ff9700 1 -- 172.21.15.40:0/3793247631 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4204020300 con 0x7f421409d920 2023-09-30T22:25:44.142 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:44.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.165+0000 7f7a88067700 1 Processor -- start 2023-09-30T22:25:44.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.166+0000 7f7a88067700 1 -- start start 2023-09-30T22:25:44.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.166+0000 7f7a88067700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a8009c890 0x7f7a8009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.166+0000 7f7a88067700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a8009d920 0x7f7a8009dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.166+0000 7f7a88067700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a800a2600 con 0x7f7a8009e2b0 2023-09-30T22:25:44.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.166+0000 7f7a88067700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a800a29d0 con 0x7f7a8009c890 2023-09-30T22:25:44.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.166+0000 7f7a88067700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8009fb40 con 0x7f7a8009d920 2023-09-30T22:25:44.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.167+0000 7f7a85e03700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a8009c890 0x7f7a8009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.167+0000 7f7a85602700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a8009d920 0x7f7a8009dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.167+0000 7f7a86604700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7a8009e2b0 0x7f7a8013ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56080/0 (socket says 172.21.15.40:56080) 2023-09-30T22:25:44.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.167+0000 7f7a85e03700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a8009c890 0x7f7a8009cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52930/0 (socket says 172.21.15.40:52930) 2023-09-30T22:25:44.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.167+0000 7f7a86604700 1 -- 172.21.15.40:0/2808444647 learned_addr learned my addr 172.21.15.40:0/2808444647 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:44.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.167+0000 7f7a85602700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a8009d920 0x7f7a8009dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33724/0 (socket says 172.21.15.40:33724) 2023-09-30T22:25:44.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.167+0000 7f7a85602700 1 -- 172.21.15.40:0/2808444647 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a8009c890 msgr2=0x7f7a8009cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:44.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.167+0000 7f7a85602700 1 --2- 172.21.15.40:0/2808444647 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a8009c890 0x7f7a8009cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.167+0000 7f7a85602700 1 -- 172.21.15.40:0/2808444647 >> v1:172.21.15.40:6789/0 conn(0x7f7a8009e2b0 legacy=0x7f7a8013ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.167+0000 7f7a85602700 1 -- 172.21.15.40:0/2808444647 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8009e720 con 0x7f7a8009d920 2023-09-30T22:25:44.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.167+0000 7f7a85e03700 1 --2- 172.21.15.40:0/2808444647 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a8009c890 0x7f7a8009cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:44.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.167+0000 7f7a84e01700 1 -- 172.21.15.40:0/2808444647 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 934853353 0 0) 0x7f7a800a2600 con 0x7f7a8009e2b0 2023-09-30T22:25:44.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.167+0000 7f7a85602700 1 --2- 172.21.15.40:0/2808444647 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a8009d920 0x7f7a8009dd70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7a70009870 tx=0x7f7a70009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ac0f9bd1b959d7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:44.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.167+0000 7f7a84e01700 1 -- 172.21.15.40:0/2808444647 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a70011830 con 0x7f7a8009d920 2023-09-30T22:25:44.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.167+0000 7f7a84e01700 1 -- 172.21.15.40:0/2808444647 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a70011990 con 0x7f7a8009d920 2023-09-30T22:25:44.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.167+0000 7f7a84e01700 1 -- 172.21.15.40:0/2808444647 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a70011d20 con 0x7f7a8009d920 2023-09-30T22:25:44.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.168+0000 7f7a88067700 1 -- 172.21.15.40:0/2808444647 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a8009d920 msgr2=0x7f7a8009dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.168+0000 7f7a88067700 1 --2- 172.21.15.40:0/2808444647 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a8009d920 0x7f7a8009dd70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7a70009870 tx=0x7f7a70009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:44.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.168+0000 7f7a88067700 1 -- 172.21.15.40:0/2808444647 shutdown_connections 2023-09-30T22:25:44.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.168+0000 7f7a88067700 1 --2- 172.21.15.40:0/2808444647 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a8009c890 0x7f7a8009cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.168+0000 7f7a88067700 1 --2- 172.21.15.40:0/2808444647 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a8009d920 0x7f7a8009dd70 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.168+0000 7f7a88067700 1 -- 172.21.15.40:0/2808444647 >> 172.21.15.40:0/2808444647 conn(0x7f7a800a7080 msgr2=0x7f7a800a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:44.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.168+0000 7f7a88067700 1 -- 172.21.15.40:0/2808444647 shutdown_connections 2023-09-30T22:25:44.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.168+0000 7f7a88067700 1 -- 172.21.15.40:0/2808444647 wait complete. 2023-09-30T22:25:44.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.170+0000 7f7a88067700 1 Processor -- start 2023-09-30T22:25:44.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.170+0000 7f7a88067700 1 -- start start 2023-09-30T22:25:44.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.170+0000 7f7a88067700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a8009c890 0x7f7a801c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.170+0000 7f7a88067700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a8009d920 0x7f7a801c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.171+0000 7f7a88067700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a8009e2b0 0x7f7a8012d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.171+0000 7f7a88067700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a80130b70 con 0x7f7a8009e2b0 2023-09-30T22:25:44.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.171+0000 7f7a88067700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a80130d50 con 0x7f7a8009d920 2023-09-30T22:25:44.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.171+0000 7f7a88067700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a800a59b0 con 0x7f7a8009c890 2023-09-30T22:25:44.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.171+0000 7f7a85602700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a8009d920 0x7f7a801c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.171+0000 7f7a85602700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a8009d920 0x7f7a801c9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52940/0 (socket says 172.21.15.40:52940) 2023-09-30T22:25:44.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.171+0000 7f7a85602700 1 -- 172.21.15.40:0/2258493123 learned_addr learned my addr 172.21.15.40:0/2258493123 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:44.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.171+0000 7f7a86604700 1 --2- 172.21.15.40:0/2258493123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a8009e2b0 0x7f7a8012d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.171+0000 7f7a85e03700 1 --2- 172.21.15.40:0/2258493123 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a8009c890 0x7f7a801c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.171+0000 7f7a85602700 1 -- 172.21.15.40:0/2258493123 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a8009c890 msgr2=0x7f7a801c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.171+0000 7f7a85602700 1 --2- 172.21.15.40:0/2258493123 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a8009c890 0x7f7a801c8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.171+0000 7f7a85602700 1 -- 172.21.15.40:0/2258493123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a8009e2b0 msgr2=0x7f7a8012d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.171+0000 7f7a85602700 1 --2- 172.21.15.40:0/2258493123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a8009e2b0 0x7f7a8012d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.171+0000 7f7a85602700 1 -- 172.21.15.40:0/2258493123 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7c009440 con 0x7f7a8009d920 2023-09-30T22:25:44.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.171+0000 7f7a85602700 1 --2- 172.21.15.40:0/2258493123 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a8009d920 0x7f7a801c9100 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7a70013000 tx=0x7f7a70004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:44.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.171+0000 7f7a767fc700 1 -- 172.21.15.40:0/2258493123 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a70004510 con 0x7f7a8009d920 2023-09-30T22:25:44.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.171+0000 7f7a767fc700 1 -- 172.21.15.40:0/2258493123 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7001f070 con 0x7f7a8009d920 2023-09-30T22:25:44.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.172+0000 7f7a88067700 1 -- 172.21.15.40:0/2258493123 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a700094a0 con 0x7f7a8009d920 2023-09-30T22:25:44.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.172+0000 7f7a767fc700 1 -- 172.21.15.40:0/2258493123 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a700038c0 con 0x7f7a8009d920 2023-09-30T22:25:44.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.172+0000 7f7a88067700 1 -- 172.21.15.40:0/2258493123 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a8012fbd0 con 0x7f7a8009d920 2023-09-30T22:25:44.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.172+0000 7f7a767fc700 1 -- 172.21.15.40:0/2258493123 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7a70003a20 con 0x7f7a8009d920 2023-09-30T22:25:44.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.172+0000 7f7a767fc700 1 -- 172.21.15.40:0/2258493123 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f7a70021070 con 0x7f7a8009d920 2023-09-30T22:25:44.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.173+0000 7f7a88067700 1 -- 172.21.15.40:0/2258493123 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a80062380 con 0x7f7a8009d920 2023-09-30T22:25:44.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.178+0000 7f7a767fc700 1 -- 172.21.15.40:0/2258493123 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7a70015020 con 0x7f7a8009d920 2023-09-30T22:25:44.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.214+0000 7f219789a700 1 Processor -- start 2023-09-30T22:25:44.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.214+0000 7f219789a700 1 -- start start 2023-09-30T22:25:44.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.215+0000 7f219789a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f219009c890 0x7f219009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.215+0000 7f219789a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f219009e480 0x7f219013bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.215+0000 7f219789a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21900a2600 con 0x7f219009d920 2023-09-30T22:25:44.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.215+0000 7f219789a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21900a29d0 con 0x7f219009c890 2023-09-30T22:25:44.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.215+0000 7f219789a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f219009fb40 con 0x7f219009e480 2023-09-30T22:25:44.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.215+0000 7f2195636700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f219009c890 0x7f219009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.215+0000 7f2195636700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f219009c890 0x7f219009cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42780/0 (socket says 172.21.15.40:42780) 2023-09-30T22:25:44.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.215+0000 7f2195636700 1 -- 172.21.15.40:0/2721192952 learned_addr learned my addr 172.21.15.40:0/2721192952 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:44.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.215+0000 7f2195e37700 1 --2- 172.21.15.40:0/2721192952 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f219009e480 0x7f219013bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.215+0000 7f2195636700 1 -- 172.21.15.40:0/2721192952 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f219009e480 msgr2=0x7f219013bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:44.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.215+0000 7f2195636700 1 --2- 172.21.15.40:0/2721192952 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f219009e480 0x7f219013bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.215+0000 7f2195636700 1 -- 172.21.15.40:0/2721192952 >> v1:172.21.15.40:6789/0 conn(0x7f219009d920 legacy=0x7f219009dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.215+0000 7f2195636700 1 -- 172.21.15.40:0/2721192952 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219009fed0 con 0x7f219009c890 2023-09-30T22:25:44.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.216+0000 7f2195636700 1 --2- 172.21.15.40:0/2721192952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f219009c890 0x7f219009cc60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f218c006fd0 tx=0x7f218c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e6305a734a0ce4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:44.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.216+0000 7f2187fff700 1 -- 172.21.15.40:0/2721192952 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c005e30 con 0x7f219009c890 2023-09-30T22:25:44.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.216+0000 7f2187fff700 1 -- 172.21.15.40:0/2721192952 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218c004030 con 0x7f219009c890 2023-09-30T22:25:44.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.216+0000 7f2187fff700 1 -- 172.21.15.40:0/2721192952 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c0043e0 con 0x7f219009c890 2023-09-30T22:25:44.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.217+0000 7f219789a700 1 -- 172.21.15.40:0/2721192952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f219009c890 msgr2=0x7f219009cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.217+0000 7f219789a700 1 --2- 172.21.15.40:0/2721192952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f219009c890 0x7f219009cc60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f218c006fd0 tx=0x7f218c009bd0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.217+0000 7f219789a700 1 -- 172.21.15.40:0/2721192952 shutdown_connections 2023-09-30T22:25:44.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.217+0000 7f219789a700 1 --2- 172.21.15.40:0/2721192952 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f219009e480 0x7f219013bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.217+0000 7f219789a700 1 --2- 172.21.15.40:0/2721192952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f219009c890 0x7f219009cc60 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.217+0000 7f219789a700 1 -- 172.21.15.40:0/2721192952 >> 172.21.15.40:0/2721192952 conn(0x7f21900a7080 msgr2=0x7f21900a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:44.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.217+0000 7f219789a700 1 -- 172.21.15.40:0/2721192952 shutdown_connections 2023-09-30T22:25:44.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.217+0000 7f219789a700 1 -- 172.21.15.40:0/2721192952 wait complete. 2023-09-30T22:25:44.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.218+0000 7f219789a700 1 Processor -- start 2023-09-30T22:25:44.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.218+0000 7f219789a700 1 -- start start 2023-09-30T22:25:44.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.218+0000 7f219789a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f219009c890 0x7f21901c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.218+0000 7f219789a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f219009d920 0x7f21901c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.218+0000 7f219789a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f219009e480 0x7f219012d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.218+0000 7f219789a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2190130780 con 0x7f219009c890 2023-09-30T22:25:44.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.218+0000 7f219789a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f219012f810 con 0x7f219009e480 2023-09-30T22:25:44.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.218+0000 7f219789a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21901309a0 con 0x7f219009d920 2023-09-30T22:25:44.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.218+0000 7f2194e35700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f219009d920 0x7f21901c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.218+0000 7f2195e37700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f219009e480 0x7f219012d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.219+0000 7f2194e35700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f219009d920 0x7f21901c9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33750/0 (socket says 172.21.15.40:33750) 2023-09-30T22:25:44.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.219+0000 7f2194e35700 1 -- 172.21.15.40:0/2016820107 learned_addr learned my addr 172.21.15.40:0/2016820107 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:44.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.219+0000 7f2195e37700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f219009e480 0x7f219012d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52956/0 (socket says 172.21.15.40:52956) 2023-09-30T22:25:44.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.219+0000 7f2195636700 1 --2- 172.21.15.40:0/2016820107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f219009c890 0x7f21901c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.219+0000 7f2195e37700 1 -- 172.21.15.40:0/2016820107 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f219009d920 msgr2=0x7f21901c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.219+0000 7f2195e37700 1 --2- 172.21.15.40:0/2016820107 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f219009d920 0x7f21901c9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.219+0000 7f2195e37700 1 -- 172.21.15.40:0/2016820107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f219009c890 msgr2=0x7f21901c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.219+0000 7f2195e37700 1 --2- 172.21.15.40:0/2016820107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f219009c890 0x7f21901c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.219+0000 7f2195e37700 1 -- 172.21.15.40:0/2016820107 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f218c009500 con 0x7f219009e480 2023-09-30T22:25:44.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.219+0000 7f2194e35700 1 --2- 172.21.15.40:0/2016820107 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f219009d920 0x7f21901c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:44.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.219+0000 7f2195e37700 1 --2- 172.21.15.40:0/2016820107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f219009e480 0x7f219012d4a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2188009d90 tx=0x7f218800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:44.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.219+0000 7f2185ffb700 1 -- 172.21.15.40:0/2016820107 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2188009c00 con 0x7f219009e480 2023-09-30T22:25:44.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.219+0000 7f2185ffb700 1 -- 172.21.15.40:0/2016820107 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218800f040 con 0x7f219009e480 2023-09-30T22:25:44.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.219+0000 7f219789a700 1 -- 172.21.15.40:0/2016820107 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f219009bc50 con 0x7f219009e480 2023-09-30T22:25:44.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.219+0000 7f2185ffb700 1 -- 172.21.15.40:0/2016820107 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2188014480 con 0x7f219009e480 2023-09-30T22:25:44.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.220+0000 7f219789a700 1 -- 172.21.15.40:0/2016820107 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f219009ed40 con 0x7f219009e480 2023-09-30T22:25:44.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.220+0000 7f2185ffb700 1 -- 172.21.15.40:0/2016820107 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f21880145e0 con 0x7f219009e480 2023-09-30T22:25:44.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.220+0000 7f2185ffb700 1 -- 172.21.15.40:0/2016820107 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f2188040200 con 0x7f219009e480 2023-09-30T22:25:44.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.221+0000 7f219789a700 1 -- 172.21.15.40:0/2016820107 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2190062380 con 0x7f219009e480 2023-09-30T22:25:44.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.225+0000 7f2185ffb700 1 -- 172.21.15.40:0/2016820107 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2188007920 con 0x7f219009e480 2023-09-30T22:25:44.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.334+0000 7f421a333700 1 -- 172.21.15.40:0/3793247631 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4214074720 con 0x7f421409d920 2023-09-30T22:25:44.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.334+0000 7f4210ff9700 1 -- 172.21.15.40:0/3793247631 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4204028090 con 0x7f421409d920 2023-09-30T22:25:44.335 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:44.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.336+0000 7f421a333700 1 -- 172.21.15.40:0/3793247631 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f421409d920 msgr2=0x7f4214122a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.336+0000 7f421a333700 1 --2- 172.21.15.40:0/3793247631 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f421409d920 0x7f4214122a10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f420400c7c0 tx=0x7f420400cad0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.336+0000 7f421a333700 1 -- 172.21.15.40:0/3793247631 shutdown_connections 2023-09-30T22:25:44.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.336+0000 7f421a333700 1 --2- 172.21.15.40:0/3793247631 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4214123490 0x7f42141c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.336+0000 7f421a333700 1 --2- 172.21.15.40:0/3793247631 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f421409d920 0x7f4214122a10 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.336+0000 7f421a333700 1 --2- 172.21.15.40:0/3793247631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4214133ca0 0x7f4214122f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.336+0000 7f421a333700 1 -- 172.21.15.40:0/3793247631 >> 172.21.15.40:0/3793247631 conn(0x7f421409fb20 msgr2=0x7f42140a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:44.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.336+0000 7f421a333700 1 -- 172.21.15.40:0/3793247631 shutdown_connections 2023-09-30T22:25:44.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.336+0000 7f421a333700 1 -- 172.21.15.40:0/3793247631 wait complete. 2023-09-30T22:25:44.349 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:44.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.394+0000 7f7a88067700 1 -- 172.21.15.40:0/2258493123 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7a80074620 con 0x7f7a8009d920 2023-09-30T22:25:44.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.394+0000 7f7a767fc700 1 -- 172.21.15.40:0/2258493123 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7a7001a950 con 0x7f7a8009d920 2023-09-30T22:25:44.395 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.397+0000 7f7a88067700 1 -- 172.21.15.40:0/2258493123 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a8009d920 msgr2=0x7f7a801c9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.397+0000 7f7a88067700 1 --2- 172.21.15.40:0/2258493123 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a8009d920 0x7f7a801c9100 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7a70013000 tx=0x7f7a70004750 comp rx=0 tx=0).stop 2023-09-30T22:25:44.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.397+0000 7f7a88067700 1 -- 172.21.15.40:0/2258493123 shutdown_connections 2023-09-30T22:25:44.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.397+0000 7f7a88067700 1 --2- 172.21.15.40:0/2258493123 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a8009c890 0x7f7a801c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.397+0000 7f7a88067700 1 --2- 172.21.15.40:0/2258493123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a8009e2b0 0x7f7a8012d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.397+0000 7f7a88067700 1 --2- 172.21.15.40:0/2258493123 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a8009d920 0x7f7a801c9100 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.397+0000 7f7a88067700 1 -- 172.21.15.40:0/2258493123 >> 172.21.15.40:0/2258493123 conn(0x7f7a800a7080 msgr2=0x7f7a80132700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:44.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.397+0000 7f7a88067700 1 -- 172.21.15.40:0/2258493123 shutdown_connections 2023-09-30T22:25:44.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.397+0000 7f7a88067700 1 -- 172.21.15.40:0/2258493123 wait complete. 2023-09-30T22:25:44.410 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:44.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.424+0000 7f219789a700 1 -- 172.21.15.40:0/2016820107 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2190131000 con 0x7f219009e480 2023-09-30T22:25:44.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.424+0000 7f2185ffb700 1 -- 172.21.15.40:0/2016820107 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f218802b090 con 0x7f219009e480 2023-09-30T22:25:44.425 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:44.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.427+0000 7f219789a700 1 -- 172.21.15.40:0/2016820107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f219009e480 msgr2=0x7f219012d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.427+0000 7f219789a700 1 --2- 172.21.15.40:0/2016820107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f219009e480 0x7f219012d4a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2188009d90 tx=0x7f218800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.427+0000 7f219789a700 1 -- 172.21.15.40:0/2016820107 shutdown_connections 2023-09-30T22:25:44.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.427+0000 7f219789a700 1 --2- 172.21.15.40:0/2016820107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f219009e480 0x7f219012d4a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.427+0000 7f219789a700 1 --2- 172.21.15.40:0/2016820107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f219009c890 0x7f21901c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.427+0000 7f219789a700 1 --2- 172.21.15.40:0/2016820107 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f219009d920 0x7f21901c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.427+0000 7f219789a700 1 -- 172.21.15.40:0/2016820107 >> 172.21.15.40:0/2016820107 conn(0x7f21900a7080 msgr2=0x7f21900a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:44.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.427+0000 7f219789a700 1 -- 172.21.15.40:0/2016820107 shutdown_connections 2023-09-30T22:25:44.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:44.427+0000 7f219789a700 1 -- 172.21.15.40:0/2016820107 wait complete. 2023-09-30T22:25:44.439 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:45.142 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:45.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.282+0000 7f048fcb2700 1 Processor -- start 2023-09-30T22:25:45.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.282+0000 7f048fcb2700 1 -- start start 2023-09-30T22:25:45.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.283+0000 7f048fcb2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f048809df30 0x7f0488135400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.283+0000 7f048fcb2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0488135940 0x7f0488137d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.283+0000 7f048fcb2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f048809e8b0 con 0x7f048809d450 2023-09-30T22:25:45.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.283+0000 7f048fcb2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f048809c3b0 con 0x7f048809df30 2023-09-30T22:25:45.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.283+0000 7f048fcb2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f048809a6b0 con 0x7f0488135940 2023-09-30T22:25:45.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.283+0000 7f048da4e700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f048809d450 0x7f048809d820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56098/0 (socket says 172.21.15.40:56098) 2023-09-30T22:25:45.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.283+0000 7f048da4e700 1 -- 172.21.15.40:0/2742269063 learned_addr learned my addr 172.21.15.40:0/2742269063 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:45.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.283+0000 7f048e24f700 1 --2- 172.21.15.40:0/2742269063 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0488135940 0x7f0488137d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.283+0000 7f048d24d700 1 --2- 172.21.15.40:0/2742269063 >> v2:172.21.15.40:3300/0 conn(0x7f048809df30 0x7f0488135400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.284+0000 7f048d24d700 1 -- 172.21.15.40:0/2742269063 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0488135940 msgr2=0x7f0488137d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:45.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.284+0000 7f048d24d700 1 --2- 172.21.15.40:0/2742269063 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0488135940 0x7f0488137d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.284+0000 7f048d24d700 1 -- 172.21.15.40:0/2742269063 >> v1:172.21.15.40:6789/0 conn(0x7f048809d450 legacy=0x7f048809d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.284+0000 7f048d24d700 1 -- 172.21.15.40:0/2742269063 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f048809b4f0 con 0x7f048809df30 2023-09-30T22:25:45.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.284+0000 7f048e24f700 1 --2- 172.21.15.40:0/2742269063 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0488135940 0x7f0488137d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:45.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.284+0000 7f048d24d700 1 --2- 172.21.15.40:0/2742269063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f048809df30 0x7f0488135400 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f047800a9e0 tx=0x7f047800acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc2c0880ed39a37 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:45.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.284+0000 7f048ca4c700 1 -- 172.21.15.40:0/2742269063 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047800cb70 con 0x7f048809df30 2023-09-30T22:25:45.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.284+0000 7f048ca4c700 1 -- 172.21.15.40:0/2742269063 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f047800ccd0 con 0x7f048809df30 2023-09-30T22:25:45.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.284+0000 7f048ca4c700 1 -- 172.21.15.40:0/2742269063 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0478018620 con 0x7f048809df30 2023-09-30T22:25:45.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.284+0000 7f048fcb2700 1 -- 172.21.15.40:0/2742269063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f048809df30 msgr2=0x7f0488135400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.284+0000 7f048fcb2700 1 --2- 172.21.15.40:0/2742269063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f048809df30 0x7f0488135400 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f047800a9e0 tx=0x7f047800acf0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.285+0000 7f048fcb2700 1 -- 172.21.15.40:0/2742269063 shutdown_connections 2023-09-30T22:25:45.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.285+0000 7f048fcb2700 1 --2- 172.21.15.40:0/2742269063 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0488135940 0x7f0488137d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.285+0000 7f048fcb2700 1 --2- 172.21.15.40:0/2742269063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f048809df30 0x7f0488135400 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.285+0000 7f048fcb2700 1 -- 172.21.15.40:0/2742269063 >> 172.21.15.40:0/2742269063 conn(0x7f04880a2a00 msgr2=0x7f04880a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:45.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.285+0000 7f048fcb2700 1 -- 172.21.15.40:0/2742269063 shutdown_connections 2023-09-30T22:25:45.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.285+0000 7f048fcb2700 1 -- 172.21.15.40:0/2742269063 wait complete. 2023-09-30T22:25:45.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.286+0000 7f048fcb2700 1 Processor -- start 2023-09-30T22:25:45.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.286+0000 7f048fcb2700 1 -- start start 2023-09-30T22:25:45.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.287+0000 7f048fcb2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f048809d450 0x7f048806e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.287+0000 7f048fcb2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f048809df30 0x7f048806eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.287+0000 7f048fcb2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0488135940 0x7f04881c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.287+0000 7f048fcb2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f048806f030 con 0x7f048809df30 2023-09-30T22:25:45.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.287+0000 7f048fcb2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f048806e1d0 con 0x7f0488135940 2023-09-30T22:25:45.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.287+0000 7f048fcb2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04880a2050 con 0x7f048809d450 2023-09-30T22:25:45.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.287+0000 7f048da4e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f048809d450 0x7f048806e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.287+0000 7f048d24d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f048809df30 0x7f048806eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.287+0000 7f048d24d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f048809df30 0x7f048806eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42802/0 (socket says 172.21.15.40:42802) 2023-09-30T22:25:45.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.287+0000 7f048d24d700 1 -- 172.21.15.40:0/772997357 learned_addr learned my addr 172.21.15.40:0/772997357 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:45.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.287+0000 7f048e24f700 1 --2- 172.21.15.40:0/772997357 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0488135940 0x7f04881c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.287+0000 7f048d24d700 1 -- 172.21.15.40:0/772997357 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f048809d450 msgr2=0x7f048806e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.287+0000 7f048d24d700 1 --2- 172.21.15.40:0/772997357 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f048809d450 0x7f048806e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.287+0000 7f048d24d700 1 -- 172.21.15.40:0/772997357 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0488135940 msgr2=0x7f04881c62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.287+0000 7f048d24d700 1 --2- 172.21.15.40:0/772997357 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0488135940 0x7f04881c62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.287+0000 7f048d24d700 1 -- 172.21.15.40:0/772997357 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0480009a70 con 0x7f048809df30 2023-09-30T22:25:45.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.287+0000 7f048d24d700 1 --2- 172.21.15.40:0/772997357 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f048809df30 0x7f048806eaf0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f047800ad30 tx=0x7f04780047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:45.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.287+0000 7f047e7fc700 1 -- 172.21.15.40:0/772997357 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04780038b0 con 0x7f048809df30 2023-09-30T22:25:45.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.288+0000 7f047e7fc700 1 -- 172.21.15.40:0/772997357 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0478003a30 con 0x7f048809df30 2023-09-30T22:25:45.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.288+0000 7f048fcb2700 1 -- 172.21.15.40:0/772997357 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f047800a640 con 0x7f048809df30 2023-09-30T22:25:45.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.288+0000 7f047e7fc700 1 -- 172.21.15.40:0/772997357 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0478003de0 con 0x7f048809df30 2023-09-30T22:25:45.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.288+0000 7f048fcb2700 1 -- 172.21.15.40:0/772997357 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04880703e0 con 0x7f048809df30 2023-09-30T22:25:45.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.288+0000 7f047e7fc700 1 -- 172.21.15.40:0/772997357 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0478018400 con 0x7f048809df30 2023-09-30T22:25:45.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.288+0000 7f047e7fc700 1 -- 172.21.15.40:0/772997357 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f0478040bc0 con 0x7f048809df30 2023-09-30T22:25:45.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.288+0000 7f048fcb2700 1 -- 172.21.15.40:0/772997357 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0488062380 con 0x7f048809df30 2023-09-30T22:25:45.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.293+0000 7f047e7fc700 1 -- 172.21.15.40:0/772997357 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0478029770 con 0x7f048809df30 2023-09-30T22:25:45.349 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:45.410 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:45.440 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:45.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.483+0000 7f52d2735700 1 Processor -- start 2023-09-30T22:25:45.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.483+0000 7f52d2735700 1 -- start start 2023-09-30T22:25:45.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.484+0000 7f52d2735700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f52cc09d450 0x7f52cc09d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.484+0000 7f52d2735700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f52cc1308d0 0x7f52cc138420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.484+0000 7f52d2735700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52cc09c3b0 con 0x7f52cc09dd60 2023-09-30T22:25:45.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.484+0000 7f52d2735700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52cc09a6b0 con 0x7f52cc1308d0 2023-09-30T22:25:45.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.484+0000 7f52d2735700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc09b4f0 con 0x7f52cc09d450 2023-09-30T22:25:45.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.484+0000 7f52d0cd2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f52cc1308d0 0x7f52cc138420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.484+0000 7f52d0cd2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f52cc1308d0 0x7f52cc138420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42816/0 (socket says 172.21.15.40:42816) 2023-09-30T22:25:45.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.484+0000 7f52d0cd2700 1 -- 172.21.15.40:0/1305569509 learned_addr learned my addr 172.21.15.40:0/1305569509 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:45.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.484+0000 7f52cbfff700 1 --2- 172.21.15.40:0/1305569509 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f52cc09d450 0x7f52cc09d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.485+0000 7f52d0cd2700 1 -- 172.21.15.40:0/1305569509 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f52cc09d450 msgr2=0x7f52cc09d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:45.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.485+0000 7f52d0cd2700 1 --2- 172.21.15.40:0/1305569509 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f52cc09d450 0x7f52cc09d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.485+0000 7f52d0cd2700 1 -- 172.21.15.40:0/1305569509 >> v1:172.21.15.40:6789/0 conn(0x7f52cc09dd60 legacy=0x7f52cc1301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.485+0000 7f52caffd700 1 -- 172.21.15.40:0/1305569509 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3170476347 0 0) 0x7f52cc09c3b0 con 0x7f52cc09dd60 2023-09-30T22:25:45.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.485+0000 7f52d0cd2700 1 -- 172.21.15.40:0/1305569509 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52cc09af90 con 0x7f52cc1308d0 2023-09-30T22:25:45.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.485+0000 7f52cbfff700 1 --2- 172.21.15.40:0/1305569509 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f52cc09d450 0x7f52cc09d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:45.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.485+0000 7f52d0cd2700 1 --2- 172.21.15.40:0/1305569509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52cc1308d0 0x7f52cc138420 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f52c400d150 tx=0x7f52c400d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f659dfbf339fd7a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:45.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.485+0000 7f52caffd700 1 -- 172.21.15.40:0/1305569509 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c4010070 con 0x7f52cc1308d0 2023-09-30T22:25:45.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.485+0000 7f52caffd700 1 -- 172.21.15.40:0/1305569509 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c400db00 con 0x7f52cc1308d0 2023-09-30T22:25:45.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.485+0000 7f52caffd700 1 -- 172.21.15.40:0/1305569509 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c4016400 con 0x7f52cc1308d0 2023-09-30T22:25:45.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.486+0000 7f52d2735700 1 -- 172.21.15.40:0/1305569509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52cc1308d0 msgr2=0x7f52cc138420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.486+0000 7f52d2735700 1 --2- 172.21.15.40:0/1305569509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52cc1308d0 0x7f52cc138420 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f52c400d150 tx=0x7f52c400d460 comp rx=0 tx=0).stop 2023-09-30T22:25:45.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.487+0000 7f52d2735700 1 -- 172.21.15.40:0/1305569509 shutdown_connections 2023-09-30T22:25:45.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.487+0000 7f52d2735700 1 --2- 172.21.15.40:0/1305569509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52cc1308d0 0x7f52cc138420 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.487+0000 7f52d2735700 1 --2- 172.21.15.40:0/1305569509 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f52cc09d450 0x7f52cc09d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.487+0000 7f52d2735700 1 -- 172.21.15.40:0/1305569509 >> 172.21.15.40:0/1305569509 conn(0x7f52cc0a2a00 msgr2=0x7f52cc0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:45.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.487+0000 7f52d2735700 1 -- 172.21.15.40:0/1305569509 shutdown_connections 2023-09-30T22:25:45.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.487+0000 7f52d2735700 1 -- 172.21.15.40:0/1305569509 wait complete. 2023-09-30T22:25:45.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.488+0000 7f52d2735700 1 Processor -- start 2023-09-30T22:25:45.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.488+0000 7f52d2735700 1 -- start start 2023-09-30T22:25:45.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.489+0000 7f52d2735700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f52cc09d450 0x7f52cc11b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.489+0000 7f52d2735700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52cc09dd60 0x7f52cc11b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.489+0000 7f52d2735700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52cc1308d0 0x7f52cc11bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.489+0000 7f52d2735700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc11d380 con 0x7f52cc1308d0 2023-09-30T22:25:45.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.489+0000 7f52d2735700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc09c640 con 0x7f52cc09dd60 2023-09-30T22:25:45.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.489+0000 7f52d2735700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc0a2260 con 0x7f52cc09d450 2023-09-30T22:25:45.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.489+0000 7f52cbfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f52cc09d450 0x7f52cc11b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.489+0000 7f52cbfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f52cc09d450 0x7f52cc11b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33784/0 (socket says 172.21.15.40:33784) 2023-09-30T22:25:45.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.489+0000 7f52cbfff700 1 -- 172.21.15.40:0/1970277224 learned_addr learned my addr 172.21.15.40:0/1970277224 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:45.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.489+0000 7f52d0cd2700 1 --2- 172.21.15.40:0/1970277224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52cc1308d0 0x7f52cc11bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.489+0000 7f52cb7fe700 1 --2- 172.21.15.40:0/1970277224 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52cc09dd60 0x7f52cc11b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.490+0000 7f52cbfff700 1 -- 172.21.15.40:0/1970277224 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52cc09dd60 msgr2=0x7f52cc11b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.490+0000 7f52cbfff700 1 --2- 172.21.15.40:0/1970277224 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52cc09dd60 0x7f52cc11b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.490+0000 7f52cbfff700 1 -- 172.21.15.40:0/1970277224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52cc1308d0 msgr2=0x7f52cc11bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.490+0000 7f52cbfff700 1 --2- 172.21.15.40:0/1970277224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52cc1308d0 0x7f52cc11bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.490+0000 7f52cbfff700 1 -- 172.21.15.40:0/1970277224 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52bc0094a0 con 0x7f52cc09d450 2023-09-30T22:25:45.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.490+0000 7f52cbfff700 1 --2- 172.21.15.40:0/1970277224 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f52cc09d450 0x7f52cc11b150 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f52bc00ebe0 tx=0x7f52bc00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:45.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.490+0000 7f52c8ff9700 1 -- 172.21.15.40:0/1970277224 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc00c850 con 0x7f52cc09d450 2023-09-30T22:25:45.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.490+0000 7f52c8ff9700 1 -- 172.21.15.40:0/1970277224 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52bc00c9b0 con 0x7f52cc09d450 2023-09-30T22:25:45.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.490+0000 7f52c8ff9700 1 -- 172.21.15.40:0/1970277224 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc00cd40 con 0x7f52cc09d450 2023-09-30T22:25:45.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.490+0000 7f52d2735700 1 -- 172.21.15.40:0/1970277224 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c400bd40 con 0x7f52cc09d450 2023-09-30T22:25:45.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.490+0000 7f52d2735700 1 -- 172.21.15.40:0/1970277224 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52cc11ecc0 con 0x7f52cc09d450 2023-09-30T22:25:45.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.491+0000 7f52c8ff9700 1 -- 172.21.15.40:0/1970277224 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f52bc013470 con 0x7f52cc09d450 2023-09-30T22:25:45.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.492+0000 7f52c8ff9700 1 -- 172.21.15.40:0/1970277224 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f52bc03f9f0 con 0x7f52cc09d450 2023-09-30T22:25:45.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.492+0000 7f52d2735700 1 -- 172.21.15.40:0/1970277224 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52cc11eae0 con 0x7f52cc09d450 2023-09-30T22:25:45.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.497+0000 7f52c8ff9700 1 -- 172.21.15.40:0/1970277224 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f52bc017080 con 0x7f52cc09d450 2023-09-30T22:25:45.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.501+0000 7f048fcb2700 1 -- 172.21.15.40:0/772997357 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0488074330 con 0x7f048809df30 2023-09-30T22:25:45.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.502+0000 7f047e7fc700 1 -- 172.21.15.40:0/772997357 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0478026030 con 0x7f048809df30 2023-09-30T22:25:45.502 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:45.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.506+0000 7f048fcb2700 1 -- 172.21.15.40:0/772997357 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f048809df30 msgr2=0x7f048806eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.506+0000 7f048fcb2700 1 --2- 172.21.15.40:0/772997357 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f048809df30 0x7f048806eaf0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f047800ad30 tx=0x7f04780047c0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.506+0000 7f048fcb2700 1 -- 172.21.15.40:0/772997357 shutdown_connections 2023-09-30T22:25:45.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.506+0000 7f048fcb2700 1 --2- 172.21.15.40:0/772997357 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f048809d450 0x7f048806e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.506+0000 7f048fcb2700 1 --2- 172.21.15.40:0/772997357 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0488135940 0x7f04881c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.506+0000 7f048fcb2700 1 --2- 172.21.15.40:0/772997357 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f048809df30 0x7f048806eaf0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.506+0000 7f048fcb2700 1 -- 172.21.15.40:0/772997357 >> 172.21.15.40:0/772997357 conn(0x7f04880a2a00 msgr2=0x7f0488136bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:45.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.506+0000 7f048fcb2700 1 -- 172.21.15.40:0/772997357 shutdown_connections 2023-09-30T22:25:45.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.506+0000 7f048fcb2700 1 -- 172.21.15.40:0/772997357 wait complete. 2023-09-30T22:25:45.525 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:45.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.564+0000 7f7febdb0700 1 Processor -- start 2023-09-30T22:25:45.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.564+0000 7f7febdb0700 1 -- start start 2023-09-30T22:25:45.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.565+0000 7f7febdb0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7fe409c890 0x7f7fe409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.565+0000 7f7febdb0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7fe409e480 0x7f7fe413bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.565+0000 7f7febdb0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe40a2600 con 0x7f7fe409d920 2023-09-30T22:25:45.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.565+0000 7f7febdb0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe40a29d0 con 0x7f7fe409e480 2023-09-30T22:25:45.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.565+0000 7f7febdb0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe409fb40 con 0x7f7fe409c890 2023-09-30T22:25:45.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.565+0000 7f7fe9b4c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7fe409c890 0x7f7fe409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.565+0000 7f7fea34d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7fe409e480 0x7f7fe413bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.565+0000 7f7fea34d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7fe409e480 0x7f7fe413bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42834/0 (socket says 172.21.15.40:42834) 2023-09-30T22:25:45.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.565+0000 7f7fe9b4c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7fe409c890 0x7f7fe409cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33786/0 (socket says 172.21.15.40:33786) 2023-09-30T22:25:45.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.565+0000 7f7fea34d700 1 -- 172.21.15.40:0/166263772 learned_addr learned my addr 172.21.15.40:0/166263772 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:45.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.566+0000 7f7fe9b4c700 1 -- 172.21.15.40:0/166263772 >> v2:172.21.15.40:3300/0 conn(0x7f7fe409e480 msgr2=0x7f7fe413bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:45.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.566+0000 7f7fe9b4c700 1 --2- 172.21.15.40:0/166263772 >> v2:172.21.15.40:3300/0 conn(0x7f7fe409e480 0x7f7fe413bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.566+0000 7f7fe9b4c700 1 -- 172.21.15.40:0/166263772 >> v1:172.21.15.40:6789/0 conn(0x7f7fe409d920 legacy=0x7f7fe409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.566+0000 7f7fe9b4c700 1 -- 172.21.15.40:0/166263772 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe409fed0 con 0x7f7fe409c890 2023-09-30T22:25:45.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.566+0000 7f7fea34d700 1 --2- 172.21.15.40:0/166263772 >> v2:172.21.15.40:3300/0 conn(0x7f7fe409e480 0x7f7fe413bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:45.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.566+0000 7f7fe9b4c700 1 --2- 172.21.15.40:0/166263772 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7fe409c890 0x7f7fe409cc60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0009820 tx=0x7f7fe0009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68476c00b0eb2cda server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:45.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.566+0000 7f7fe8b4a700 1 -- 172.21.15.40:0/166263772 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe0005e30 con 0x7f7fe409c890 2023-09-30T22:25:45.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.566+0000 7f7fe8b4a700 1 -- 172.21.15.40:0/166263772 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe0006030 con 0x7f7fe409c890 2023-09-30T22:25:45.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.566+0000 7f7fe8b4a700 1 -- 172.21.15.40:0/166263772 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe00063c0 con 0x7f7fe409c890 2023-09-30T22:25:45.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.567+0000 7f7febdb0700 1 -- 172.21.15.40:0/166263772 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7fe409c890 msgr2=0x7f7fe409cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.567+0000 7f7febdb0700 1 --2- 172.21.15.40:0/166263772 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7fe409c890 0x7f7fe409cc60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0009820 tx=0x7f7fe0009b30 comp rx=0 tx=0).stop 2023-09-30T22:25:45.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.567+0000 7f7febdb0700 1 -- 172.21.15.40:0/166263772 shutdown_connections 2023-09-30T22:25:45.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.567+0000 7f7febdb0700 1 --2- 172.21.15.40:0/166263772 >> v2:172.21.15.40:3300/0 conn(0x7f7fe409e480 0x7f7fe413bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.567+0000 7f7febdb0700 1 --2- 172.21.15.40:0/166263772 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7fe409c890 0x7f7fe409cc60 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.567+0000 7f7febdb0700 1 -- 172.21.15.40:0/166263772 >> 172.21.15.40:0/166263772 conn(0x7f7fe40a7080 msgr2=0x7f7fe40a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:45.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.567+0000 7f7febdb0700 1 -- 172.21.15.40:0/166263772 shutdown_connections 2023-09-30T22:25:45.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.567+0000 7f7febdb0700 1 -- 172.21.15.40:0/166263772 wait complete. 2023-09-30T22:25:45.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.568+0000 7f7febdb0700 1 Processor -- start 2023-09-30T22:25:45.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.568+0000 7f7febdb0700 1 -- start start 2023-09-30T22:25:45.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.569+0000 7f7febdb0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fe409c890 0x7f7fe412d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.569+0000 7f7febdb0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7fe409d920 0x7f7fe412db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.569+0000 7f7febdb0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7fe409e480 0x7f7fe412e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.569+0000 7f7febdb0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe4130ab0 con 0x7f7fe409c890 2023-09-30T22:25:45.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.569+0000 7f7febdb0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe4130fe0 con 0x7f7fe409d920 2023-09-30T22:25:45.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.569+0000 7f7febdb0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe412f660 con 0x7f7fe409e480 2023-09-30T22:25:45.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.569+0000 7f7fe9b4c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fe409c890 0x7f7fe412d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.569+0000 7f7fea34d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7fe409e480 0x7f7fe412e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.569+0000 7f7fea34d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7fe409e480 0x7f7fe412e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33800/0 (socket says 172.21.15.40:33800) 2023-09-30T22:25:45.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.569+0000 7f7fea34d700 1 -- 172.21.15.40:0/1211594583 learned_addr learned my addr 172.21.15.40:0/1211594583 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:45.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.569+0000 7f7fe9b4c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fe409c890 0x7f7fe412d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42838/0 (socket says 172.21.15.40:42838) 2023-09-30T22:25:45.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.569+0000 7f7fe9b4c700 1 -- 172.21.15.40:0/1211594583 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7fe409e480 msgr2=0x7f7fe412e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.569+0000 7f7fe9b4c700 1 --2- 172.21.15.40:0/1211594583 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7fe409e480 0x7f7fe412e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.569+0000 7f7fe9b4c700 1 -- 172.21.15.40:0/1211594583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7fe409d920 msgr2=0x7f7fe412db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.569+0000 7f7fe9b4c700 1 --2- 172.21.15.40:0/1211594583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7fe409d920 0x7f7fe412db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.569+0000 7f7fe9b4c700 1 -- 172.21.15.40:0/1211594583 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fdc009b30 con 0x7f7fe409c890 2023-09-30T22:25:45.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.569+0000 7f7fea34d700 1 --2- 172.21.15.40:0/1211594583 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7fe409e480 0x7f7fe412e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:45.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.570+0000 7f7fe9b4c700 1 --2- 172.21.15.40:0/1211594583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fe409c890 0x7f7fe412d610 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0015000 tx=0x7f7fe0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:45.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.570+0000 7f7fda7fc700 1 -- 172.21.15.40:0/1211594583 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe00065b0 con 0x7f7fe409c890 2023-09-30T22:25:45.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.570+0000 7f7fda7fc700 1 -- 172.21.15.40:0/1211594583 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe0006710 con 0x7f7fe409c890 2023-09-30T22:25:45.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.570+0000 7f7fda7fc700 1 -- 172.21.15.40:0/1211594583 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe0004560 con 0x7f7fe409c890 2023-09-30T22:25:45.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.570+0000 7f7febdb0700 1 -- 172.21.15.40:0/1211594583 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe0009430 con 0x7f7fe409c890 2023-09-30T22:25:45.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.570+0000 7f7febdb0700 1 -- 172.21.15.40:0/1211594583 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe408f650 con 0x7f7fe409c890 2023-09-30T22:25:45.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.571+0000 7f7fda7fc700 1 -- 172.21.15.40:0/1211594583 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7fe0022070 con 0x7f7fe409c890 2023-09-30T22:25:45.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.571+0000 7f7fda7fc700 1 -- 172.21.15.40:0/1211594583 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f7fe0040e30 con 0x7f7fe409c890 2023-09-30T22:25:45.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.571+0000 7f7fc7fff700 1 -- 172.21.15.40:0/1211594583 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fc00052e0 con 0x7f7fe409c890 2023-09-30T22:25:45.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.580+0000 7f7fda7fc700 1 -- 172.21.15.40:0/1211594583 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7fe002a030 con 0x7f7fe409c890 2023-09-30T22:25:45.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.611+0000 7fed36233700 1 Processor -- start 2023-09-30T22:25:45.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.611+0000 7fed36233700 1 -- start start 2023-09-30T22:25:45.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.612+0000 7fed36233700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fed3006f070 0x7fed3006f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.612+0000 7fed36233700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed3006fdb0 0x7fed300977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.612+0000 7fed36233700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed30070830 con 0x7fed3006f980 2023-09-30T22:25:45.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.612+0000 7fed36233700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed30070ad0 con 0x7fed3006f070 2023-09-30T22:25:45.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.612+0000 7fed36233700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed30070de0 con 0x7fed3006fdb0 2023-09-30T22:25:45.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.612+0000 7fed2ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed3006fdb0 0x7fed300977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.612+0000 7fed2f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fed3006f070 0x7fed3006f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.612+0000 7fed2f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fed3006f070 0x7fed3006f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42848/0 (socket says 172.21.15.40:42848) 2023-09-30T22:25:45.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.612+0000 7fed2ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed3006fdb0 0x7fed300977a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53008/0 (socket says 172.21.15.40:53008) 2023-09-30T22:25:45.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.612+0000 7fed2f7fe700 1 -- 172.21.15.40:0/419557630 learned_addr learned my addr 172.21.15.40:0/419557630 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:45.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.612+0000 7fed2f7fe700 1 -- 172.21.15.40:0/419557630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed3006fdb0 msgr2=0x7fed300977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:45.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.612+0000 7fed2f7fe700 1 --2- 172.21.15.40:0/419557630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed3006fdb0 0x7fed300977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.612+0000 7fed2f7fe700 1 -- 172.21.15.40:0/419557630 >> v1:172.21.15.40:6789/0 conn(0x7fed3006f980 legacy=0x7fed30097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.612+0000 7fed2f7fe700 1 -- 172.21.15.40:0/419557630 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3009fe20 con 0x7fed3006f070 2023-09-30T22:25:45.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.612+0000 7fed2f7fe700 1 --2- 172.21.15.40:0/419557630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed3006f070 0x7fed3006f440 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fed200098f0 tx=0x7fed20009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1298f3eba508594d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:45.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.613+0000 7fed2e7fc700 1 -- 172.21.15.40:0/419557630 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed20011830 con 0x7fed3006f070 2023-09-30T22:25:45.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.613+0000 7fed2e7fc700 1 -- 172.21.15.40:0/419557630 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed20011990 con 0x7fed3006f070 2023-09-30T22:25:45.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.613+0000 7fed2e7fc700 1 -- 172.21.15.40:0/419557630 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed20011d20 con 0x7fed3006f070 2023-09-30T22:25:45.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.613+0000 7fed36233700 1 -- 172.21.15.40:0/419557630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed3006f070 msgr2=0x7fed3006f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.613+0000 7fed36233700 1 --2- 172.21.15.40:0/419557630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed3006f070 0x7fed3006f440 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fed200098f0 tx=0x7fed20009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:45.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.613+0000 7fed36233700 1 -- 172.21.15.40:0/419557630 shutdown_connections 2023-09-30T22:25:45.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.613+0000 7fed36233700 1 --2- 172.21.15.40:0/419557630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed3006fdb0 0x7fed300977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.613+0000 7fed36233700 1 --2- 172.21.15.40:0/419557630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed3006f070 0x7fed3006f440 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.613+0000 7fed36233700 1 -- 172.21.15.40:0/419557630 >> 172.21.15.40:0/419557630 conn(0x7fed300a41a0 msgr2=0x7fed300a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:45.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.613+0000 7fed36233700 1 -- 172.21.15.40:0/419557630 shutdown_connections 2023-09-30T22:25:45.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.613+0000 7fed36233700 1 -- 172.21.15.40:0/419557630 wait complete. 2023-09-30T22:25:45.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.614+0000 7fed36233700 1 Processor -- start 2023-09-30T22:25:45.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.614+0000 7fed36233700 1 -- start start 2023-09-30T22:25:45.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.615+0000 7fed36233700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed3006f070 0x7fed3008bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.615+0000 7fed36233700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fed3006f980 0x7fed300980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.615+0000 7fed36233700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed3006fdb0 0x7fed300985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.615+0000 7fed36233700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3008b730 con 0x7fed3006fdb0 2023-09-30T22:25:45.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.615+0000 7fed36233700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed30130c50 con 0x7fed3006f070 2023-09-30T22:25:45.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.615+0000 7fed36233700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed30099af0 con 0x7fed3006f980 2023-09-30T22:25:45.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.615+0000 7fed2ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed3006fdb0 0x7fed300985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.615+0000 7fed2effd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fed3006f980 0x7fed300980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.615+0000 7fed2ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed3006fdb0 0x7fed300985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42854/0 (socket says 172.21.15.40:42854) 2023-09-30T22:25:45.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.615+0000 7fed2ffff700 1 -- 172.21.15.40:0/3044075101 learned_addr learned my addr 172.21.15.40:0/3044075101 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:45.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.615+0000 7fed2f7fe700 1 --2- 172.21.15.40:0/3044075101 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed3006f070 0x7fed3008bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.615+0000 7fed2ffff700 1 -- 172.21.15.40:0/3044075101 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fed3006f980 msgr2=0x7fed300980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.615+0000 7fed2ffff700 1 --2- 172.21.15.40:0/3044075101 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fed3006f980 0x7fed300980a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.615+0000 7fed2ffff700 1 -- 172.21.15.40:0/3044075101 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed3006f070 msgr2=0x7fed3008bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.615+0000 7fed2ffff700 1 --2- 172.21.15.40:0/3044075101 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed3006f070 0x7fed3008bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.615+0000 7fed2ffff700 1 -- 172.21.15.40:0/3044075101 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed20009550 con 0x7fed3006fdb0 2023-09-30T22:25:45.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.615+0000 7fed2ffff700 1 --2- 172.21.15.40:0/3044075101 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed3006fdb0 0x7fed300985e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fed2800efc0 tx=0x7fed2800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:45.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.616+0000 7fed17fff700 1 -- 172.21.15.40:0/3044075101 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed28009ea0 con 0x7fed3006fdb0 2023-09-30T22:25:45.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.616+0000 7fed17fff700 1 -- 172.21.15.40:0/3044075101 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed2800f040 con 0x7fed3006fdb0 2023-09-30T22:25:45.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.616+0000 7fed17fff700 1 -- 172.21.15.40:0/3044075101 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2800ced0 con 0x7fed3006fdb0 2023-09-30T22:25:45.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.616+0000 7fed36233700 1 -- 172.21.15.40:0/3044075101 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed3012c2d0 con 0x7fed3006fdb0 2023-09-30T22:25:45.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.616+0000 7fed36233700 1 -- 172.21.15.40:0/3044075101 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed30096ba0 con 0x7fed3006fdb0 2023-09-30T22:25:45.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.617+0000 7fed17fff700 1 -- 172.21.15.40:0/3044075101 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fed28014480 con 0x7fed3006fdb0 2023-09-30T22:25:45.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.617+0000 7fed36233700 1 -- 172.21.15.40:0/3044075101 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed30062380 con 0x7fed3006fdb0 2023-09-30T22:25:45.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.617+0000 7fed17fff700 1 -- 172.21.15.40:0/3044075101 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fed28040200 con 0x7fed3006fdb0 2023-09-30T22:25:45.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.622+0000 7fed17fff700 1 -- 172.21.15.40:0/3044075101 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fed28007920 con 0x7fed3006fdb0 2023-09-30T22:25:45.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.708+0000 7f52d2735700 1 -- 172.21.15.40:0/1970277224 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f52cc11ecc0 con 0x7f52cc09d450 2023-09-30T22:25:45.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.708+0000 7f52c8ff9700 1 -- 172.21.15.40:0/1970277224 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f52cc11ecc0 con 0x7f52cc09d450 2023-09-30T22:25:45.709 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:45.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.710+0000 7f52d2735700 1 -- 172.21.15.40:0/1970277224 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f52cc09d450 msgr2=0x7f52cc11b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.710+0000 7f52d2735700 1 --2- 172.21.15.40:0/1970277224 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f52cc09d450 0x7f52cc11b150 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f52bc00ebe0 tx=0x7f52bc00eef0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.710+0000 7f52d2735700 1 -- 172.21.15.40:0/1970277224 shutdown_connections 2023-09-30T22:25:45.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.710+0000 7f52d2735700 1 --2- 172.21.15.40:0/1970277224 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f52cc09d450 0x7f52cc11b150 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.710+0000 7f52d2735700 1 --2- 172.21.15.40:0/1970277224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52cc1308d0 0x7f52cc11bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.710+0000 7f52d2735700 1 --2- 172.21.15.40:0/1970277224 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52cc09dd60 0x7f52cc11b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.710+0000 7f52d2735700 1 -- 172.21.15.40:0/1970277224 >> 172.21.15.40:0/1970277224 conn(0x7f52cc0a2a00 msgr2=0x7f52cc1b7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:45.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.710+0000 7f52d2735700 1 -- 172.21.15.40:0/1970277224 shutdown_connections 2023-09-30T22:25:45.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.710+0000 7f52d2735700 1 -- 172.21.15.40:0/1970277224 wait complete. 2023-09-30T22:25:45.723 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:45.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.779+0000 7f7fc7fff700 1 -- 172.21.15.40:0/1211594583 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7fc0005590 con 0x7f7fe409c890 2023-09-30T22:25:45.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.779+0000 7f7fda7fc700 1 -- 172.21.15.40:0/1211594583 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7fe002f800 con 0x7f7fe409c890 2023-09-30T22:25:45.780 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:45.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.781+0000 7f7fc7fff700 1 -- 172.21.15.40:0/1211594583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fe409c890 msgr2=0x7f7fe412d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.781+0000 7f7fc7fff700 1 --2- 172.21.15.40:0/1211594583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fe409c890 0x7f7fe412d610 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0015000 tx=0x7f7fe0004750 comp rx=0 tx=0).stop 2023-09-30T22:25:45.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.781+0000 7f7fc7fff700 1 -- 172.21.15.40:0/1211594583 shutdown_connections 2023-09-30T22:25:45.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.781+0000 7f7fc7fff700 1 --2- 172.21.15.40:0/1211594583 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7fe409e480 0x7f7fe412e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.781+0000 7f7fc7fff700 1 --2- 172.21.15.40:0/1211594583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fe409c890 0x7f7fe412d610 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.781+0000 7f7fc7fff700 1 --2- 172.21.15.40:0/1211594583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7fe409d920 0x7f7fe412db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.781+0000 7f7fc7fff700 1 -- 172.21.15.40:0/1211594583 >> 172.21.15.40:0/1211594583 conn(0x7f7fe40a7080 msgr2=0x7f7fe40a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:45.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.781+0000 7f7fc7fff700 1 -- 172.21.15.40:0/1211594583 shutdown_connections 2023-09-30T22:25:45.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.781+0000 7f7fc7fff700 1 -- 172.21.15.40:0/1211594583 wait complete. 2023-09-30T22:25:45.794 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:45.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.817+0000 7fed36233700 1 -- 172.21.15.40:0/3044075101 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fed30074620 con 0x7fed3006fdb0 2023-09-30T22:25:45.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.818+0000 7fed17fff700 1 -- 172.21.15.40:0/3044075101 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fed28007330 con 0x7fed3006fdb0 2023-09-30T22:25:45.818 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:45.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.820+0000 7fed36233700 1 -- 172.21.15.40:0/3044075101 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed3006fdb0 msgr2=0x7fed300985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.820+0000 7fed36233700 1 --2- 172.21.15.40:0/3044075101 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed3006fdb0 0x7fed300985e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fed2800efc0 tx=0x7fed2800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.820+0000 7fed36233700 1 -- 172.21.15.40:0/3044075101 shutdown_connections 2023-09-30T22:25:45.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.820+0000 7fed36233700 1 --2- 172.21.15.40:0/3044075101 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed3006fdb0 0x7fed300985e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.820+0000 7fed36233700 1 --2- 172.21.15.40:0/3044075101 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed3006f070 0x7fed3008bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.820+0000 7fed36233700 1 --2- 172.21.15.40:0/3044075101 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fed3006f980 0x7fed300980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.820+0000 7fed36233700 1 -- 172.21.15.40:0/3044075101 >> 172.21.15.40:0/3044075101 conn(0x7fed300a41a0 msgr2=0x7fed300975a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:45.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.820+0000 7fed36233700 1 -- 172.21.15.40:0/3044075101 shutdown_connections 2023-09-30T22:25:45.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:45.820+0000 7fed36233700 1 -- 172.21.15.40:0/3044075101 wait complete. 2023-09-30T22:25:45.833 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:46.525 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:46.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.667+0000 7f3c79438700 1 Processor -- start 2023-09-30T22:25:46.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.667+0000 7f3c79438700 1 -- start start 2023-09-30T22:25:46.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.668+0000 7f3c79438700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3c74133e00 0x7f3c741341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.668+0000 7f3c79438700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c7409d400 0x7f3c7409d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.668+0000 7f3c79438700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c7409dd70 0x7f3c7413ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.668+0000 7f3c79438700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c7409ab20 con 0x7f3c74133e00 2023-09-30T22:25:46.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.668+0000 7f3c79438700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c74133940 con 0x7f3c7409d400 2023-09-30T22:25:46.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.668+0000 7f3c79438700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7409f0d0 con 0x7f3c7409dd70 2023-09-30T22:25:46.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.668+0000 7f3c72ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3c74133e00 0x7f3c741341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.668+0000 7f3c6bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c7409d400 0x7f3c7409d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.668+0000 7f3c737fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c7409dd70 0x7f3c7413ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.668+0000 7f3c72ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3c74133e00 0x7f3c741341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42858/0 (socket says 172.21.15.40:42858) 2023-09-30T22:25:46.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.668+0000 7f3c6bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c7409d400 0x7f3c7409d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53016/0 (socket says 172.21.15.40:53016) 2023-09-30T22:25:46.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.668+0000 7f3c72ffd700 1 -- 172.21.15.40:0/1394846999 learned_addr learned my addr 172.21.15.40:0/1394846999 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:46.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.669+0000 7f3c6bfff700 1 -- 172.21.15.40:0/1394846999 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c7409dd70 msgr2=0x7f3c7413ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:46.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.669+0000 7f3c6bfff700 1 --2- 172.21.15.40:0/1394846999 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c7409dd70 0x7f3c7413ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.669+0000 7f3c6bfff700 1 -- 172.21.15.40:0/1394846999 >> v2:172.21.15.40:3300/0 conn(0x7f3c74133e00 msgr2=0x7f3c741341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:46.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.669+0000 7f3c6bfff700 1 --2- 172.21.15.40:0/1394846999 >> v2:172.21.15.40:3300/0 conn(0x7f3c74133e00 0x7f3c741341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.669+0000 7f3c6bfff700 1 -- 172.21.15.40:0/1394846999 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c74133be0 con 0x7f3c7409d400 2023-09-30T22:25:46.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.669+0000 7f3c72ffd700 1 --2- 172.21.15.40:0/1394846999 >> v2:172.21.15.40:3300/0 conn(0x7f3c74133e00 0x7f3c741341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:46.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.669+0000 7f3c737fe700 1 --2- 172.21.15.40:0/1394846999 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c7409dd70 0x7f3c7413ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:46.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.669+0000 7f3c6bfff700 1 --2- 172.21.15.40:0/1394846999 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c7409d400 0x7f3c7409d830 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c009840 tx=0x7f3c5c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8998c8dcf4f57f91 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:46.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.669+0000 7f3c727fc700 1 -- 172.21.15.40:0/1394846999 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c011830 con 0x7f3c7409d400 2023-09-30T22:25:46.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.669+0000 7f3c727fc700 1 -- 172.21.15.40:0/1394846999 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5c011990 con 0x7f3c7409d400 2023-09-30T22:25:46.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.669+0000 7f3c727fc700 1 -- 172.21.15.40:0/1394846999 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c011d20 con 0x7f3c7409d400 2023-09-30T22:25:46.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.670+0000 7f3c79438700 1 -- 172.21.15.40:0/1394846999 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c7409d400 msgr2=0x7f3c7409d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:46.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.670+0000 7f3c79438700 1 --2- 172.21.15.40:0/1394846999 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c7409d400 0x7f3c7409d830 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c009840 tx=0x7f3c5c009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:46.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.670+0000 7f3c79438700 1 -- 172.21.15.40:0/1394846999 shutdown_connections 2023-09-30T22:25:46.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.670+0000 7f3c79438700 1 --2- 172.21.15.40:0/1394846999 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c7409dd70 0x7f3c7413ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.670+0000 7f3c79438700 1 --2- 172.21.15.40:0/1394846999 >> v2:172.21.15.40:3300/0 conn(0x7f3c74133e00 0x7f3c741341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.670+0000 7f3c79438700 1 --2- 172.21.15.40:0/1394846999 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c7409d400 0x7f3c7409d830 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.670+0000 7f3c79438700 1 -- 172.21.15.40:0/1394846999 >> 172.21.15.40:0/1394846999 conn(0x7f3c740a2a00 msgr2=0x7f3c740a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:46.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.670+0000 7f3c79438700 1 -- 172.21.15.40:0/1394846999 shutdown_connections 2023-09-30T22:25:46.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.670+0000 7f3c79438700 1 -- 172.21.15.40:0/1394846999 wait complete. 2023-09-30T22:25:46.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.671+0000 7f3c79438700 1 Processor -- start 2023-09-30T22:25:46.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.672+0000 7f3c79438700 1 -- start start 2023-09-30T22:25:46.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.672+0000 7f3c79438700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c7409d400 0x7f3c74119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.672+0000 7f3c79438700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c7409dd70 0x7f3c74119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.672+0000 7f3c79438700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c74133e00 0x7f3c74119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.672+0000 7f3c79438700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7411c340 con 0x7f3c7409d400 2023-09-30T22:25:46.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.672+0000 7f3c79438700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7411ccb0 con 0x7f3c74133e00 2023-09-30T22:25:46.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.672+0000 7f3c79438700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7412e1a0 con 0x7f3c7409dd70 2023-09-30T22:25:46.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.672+0000 7f3c72ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c7409d400 0x7f3c74119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.672+0000 7f3c72ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c7409d400 0x7f3c74119050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42862/0 (socket says 172.21.15.40:42862) 2023-09-30T22:25:46.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.672+0000 7f3c737fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c74133e00 0x7f3c74119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.672+0000 7f3c72ffd700 1 -- 172.21.15.40:0/1627986651 learned_addr learned my addr 172.21.15.40:0/1627986651 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:46.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.672+0000 7f3c6bfff700 1 --2- 172.21.15.40:0/1627986651 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c7409dd70 0x7f3c74119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.673+0000 7f3c72ffd700 1 -- 172.21.15.40:0/1627986651 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c7409dd70 msgr2=0x7f3c74119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:46.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.673+0000 7f3c72ffd700 1 --2- 172.21.15.40:0/1627986651 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c7409dd70 0x7f3c74119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.673+0000 7f3c72ffd700 1 -- 172.21.15.40:0/1627986651 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c74133e00 msgr2=0x7f3c74119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:46.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.673+0000 7f3c72ffd700 1 --2- 172.21.15.40:0/1627986651 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c74133e00 0x7f3c74119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.673+0000 7f3c72ffd700 1 -- 172.21.15.40:0/1627986651 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6c009a70 con 0x7f3c7409d400 2023-09-30T22:25:46.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.673+0000 7f3c737fe700 1 --2- 172.21.15.40:0/1627986651 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c74133e00 0x7f3c74119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:46.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.673+0000 7f3c72ffd700 1 --2- 172.21.15.40:0/1627986651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c7409d400 0x7f3c74119050 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3c6400ec10 tx=0x7f3c6400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:46.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.673+0000 7f3c6b7fe700 1 -- 172.21.15.40:0/1627986651 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6400c7f0 con 0x7f3c7409d400 2023-09-30T22:25:46.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.673+0000 7f3c6b7fe700 1 -- 172.21.15.40:0/1627986651 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6400c950 con 0x7f3c7409d400 2023-09-30T22:25:46.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.673+0000 7f3c79438700 1 -- 172.21.15.40:0/1627986651 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c64009550 con 0x7f3c7409d400 2023-09-30T22:25:46.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.673+0000 7f3c6b7fe700 1 -- 172.21.15.40:0/1627986651 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6400ccc0 con 0x7f3c7409d400 2023-09-30T22:25:46.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.673+0000 7f3c79438700 1 -- 172.21.15.40:0/1627986651 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c5c0094a0 con 0x7f3c7409d400 2023-09-30T22:25:46.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.674+0000 7f3c6b7fe700 1 -- 172.21.15.40:0/1627986651 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3c64013470 con 0x7f3c7409d400 2023-09-30T22:25:46.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.674+0000 7f3c6b7fe700 1 -- 172.21.15.40:0/1627986651 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3c6403faa0 con 0x7f3c7409d400 2023-09-30T22:25:46.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.674+0000 7f3c79438700 1 -- 172.21.15.40:0/1627986651 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c7411a4d0 con 0x7f3c7409d400 2023-09-30T22:25:46.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.679+0000 7f3c6b7fe700 1 -- 172.21.15.40:0/1627986651 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3c64013720 con 0x7f3c7409d400 2023-09-30T22:25:46.725 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:46.795 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:46.834 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:46.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.858+0000 7fe4649b2700 1 Processor -- start 2023-09-30T22:25:46.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.858+0000 7fe4649b2700 1 -- start start 2023-09-30T22:25:46.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.859+0000 7fe4649b2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe46009df30 0x7fe460135400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.859+0000 7fe4649b2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe460135940 0x7fe460137d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.859+0000 7fe4649b2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe46009e8b0 con 0x7fe46009d450 2023-09-30T22:25:46.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.859+0000 7fe4649b2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe46009c3b0 con 0x7fe46009df30 2023-09-30T22:25:46.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.859+0000 7fe4649b2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe46009a6b0 con 0x7fe460135940 2023-09-30T22:25:46.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.859+0000 7fe45dd9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe46009df30 0x7fe460135400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.859+0000 7fe45dd9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe46009df30 0x7fe460135400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42866/0 (socket says 172.21.15.40:42866) 2023-09-30T22:25:46.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.859+0000 7fe45dd9b700 1 -- 172.21.15.40:0/1847774916 learned_addr learned my addr 172.21.15.40:0/1847774916 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:46.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.859+0000 7fe45ed9d700 1 --2- 172.21.15.40:0/1847774916 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe460135940 0x7fe460137d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.859+0000 7fe45ed9d700 1 -- 172.21.15.40:0/1847774916 >> v2:172.21.15.40:3300/0 conn(0x7fe46009df30 msgr2=0x7fe460135400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:46.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.859+0000 7fe45ed9d700 1 --2- 172.21.15.40:0/1847774916 >> v2:172.21.15.40:3300/0 conn(0x7fe46009df30 0x7fe460135400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.859+0000 7fe45ed9d700 1 -- 172.21.15.40:0/1847774916 >> v1:172.21.15.40:6789/0 conn(0x7fe46009d450 legacy=0x7fe46009d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:46.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.859+0000 7fe45ed9d700 1 -- 172.21.15.40:0/1847774916 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe46009b4f0 con 0x7fe460135940 2023-09-30T22:25:46.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.859+0000 7fe45ed9d700 1 --2- 172.21.15.40:0/1847774916 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe460135940 0x7fe460137d20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe45800aea0 tx=0x7fe45800c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=778325c92840cb95 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:46.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.860+0000 7fe45d59a700 1 -- 172.21.15.40:0/1847774916 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45800f070 con 0x7fe460135940 2023-09-30T22:25:46.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.860+0000 7fe45d59a700 1 -- 172.21.15.40:0/1847774916 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe45800a2e0 con 0x7fe460135940 2023-09-30T22:25:46.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.860+0000 7fe45d59a700 1 -- 172.21.15.40:0/1847774916 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45800cb30 con 0x7fe460135940 2023-09-30T22:25:46.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.860+0000 7fe4649b2700 1 -- 172.21.15.40:0/1847774916 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe460135940 msgr2=0x7fe460137d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:46.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.860+0000 7fe4649b2700 1 --2- 172.21.15.40:0/1847774916 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe460135940 0x7fe460137d20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe45800aea0 tx=0x7fe45800c330 comp rx=0 tx=0).stop 2023-09-30T22:25:46.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.861+0000 7fe4649b2700 1 -- 172.21.15.40:0/1847774916 shutdown_connections 2023-09-30T22:25:46.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.861+0000 7fe4649b2700 1 --2- 172.21.15.40:0/1847774916 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe460135940 0x7fe460137d20 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.861+0000 7fe4649b2700 1 --2- 172.21.15.40:0/1847774916 >> v2:172.21.15.40:3300/0 conn(0x7fe46009df30 0x7fe460135400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.861+0000 7fe4649b2700 1 -- 172.21.15.40:0/1847774916 >> 172.21.15.40:0/1847774916 conn(0x7fe4600a2a00 msgr2=0x7fe4600a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:46.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.861+0000 7fe4649b2700 1 -- 172.21.15.40:0/1847774916 shutdown_connections 2023-09-30T22:25:46.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.861+0000 7fe4649b2700 1 -- 172.21.15.40:0/1847774916 wait complete. 2023-09-30T22:25:46.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.862+0000 7fe4649b2700 1 Processor -- start 2023-09-30T22:25:46.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.862+0000 7fe4649b2700 1 -- start start 2023-09-30T22:25:46.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.863+0000 7fe4649b2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe46009d450 0x7fe4601347a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.863+0000 7fe4649b2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe46009df30 0x7fe460134ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.863+0000 7fe4649b2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe460135940 0x7fe460135220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.863+0000 7fe4649b2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe460133450 con 0x7fe46009d450 2023-09-30T22:25:46.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.863+0000 7fe4649b2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe460129fb0 con 0x7fe460135940 2023-09-30T22:25:46.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.863+0000 7fe4649b2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe460132af0 con 0x7fe46009df30 2023-09-30T22:25:46.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.863+0000 7fe45ed9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe460135940 0x7fe460135220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.863+0000 7fe45ed9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe460135940 0x7fe460135220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53038/0 (socket says 172.21.15.40:53038) 2023-09-30T22:25:46.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.863+0000 7fe45ed9d700 1 -- 172.21.15.40:0/2608008359 learned_addr learned my addr 172.21.15.40:0/2608008359 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:46.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.863+0000 7fe45dd9b700 1 --2- 172.21.15.40:0/2608008359 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe46009df30 0x7fe460134ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.863+0000 7fe45e59c700 1 --2- 172.21.15.40:0/2608008359 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe46009d450 0x7fe4601347a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.864+0000 7fe45e59c700 1 -- 172.21.15.40:0/2608008359 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe46009df30 msgr2=0x7fe460134ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:46.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.864+0000 7fe45e59c700 1 --2- 172.21.15.40:0/2608008359 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe46009df30 0x7fe460134ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.864+0000 7fe45e59c700 1 -- 172.21.15.40:0/2608008359 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe460135940 msgr2=0x7fe460135220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:46.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.864+0000 7fe45e59c700 1 --2- 172.21.15.40:0/2608008359 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe460135940 0x7fe460135220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.864+0000 7fe45e59c700 1 -- 172.21.15.40:0/2608008359 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45800ab80 con 0x7fe46009d450 2023-09-30T22:25:46.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.864+0000 7fe45ed9d700 1 --2- 172.21.15.40:0/2608008359 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe460135940 0x7fe460135220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:46.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.864+0000 7fe45e59c700 1 --2- 172.21.15.40:0/2608008359 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe46009d450 0x7fe4601347a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe450000f60 tx=0x7fe45000c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:46.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.864+0000 7fe44effd700 1 -- 172.21.15.40:0/2608008359 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4500052d0 con 0x7fe46009d450 2023-09-30T22:25:46.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.864+0000 7fe44effd700 1 -- 172.21.15.40:0/2608008359 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe450005430 con 0x7fe46009d450 2023-09-30T22:25:46.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.864+0000 7fe4649b2700 1 -- 172.21.15.40:0/2608008359 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe460071370 con 0x7fe46009d450 2023-09-30T22:25:46.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.864+0000 7fe44effd700 1 -- 172.21.15.40:0/2608008359 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4500038c0 con 0x7fe46009d450 2023-09-30T22:25:46.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.864+0000 7fe4649b2700 1 -- 172.21.15.40:0/2608008359 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe460134350 con 0x7fe46009d450 2023-09-30T22:25:46.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.865+0000 7fe4649b2700 1 -- 172.21.15.40:0/2608008359 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe460062380 con 0x7fe46009d450 2023-09-30T22:25:46.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.866+0000 7fe44effd700 1 -- 172.21.15.40:0/2608008359 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe450003a20 con 0x7fe46009d450 2023-09-30T22:25:46.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.866+0000 7fe44effd700 1 -- 172.21.15.40:0/2608008359 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe45003ea20 con 0x7fe46009d450 2023-09-30T22:25:46.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.875+0000 7fe44effd700 1 -- 172.21.15.40:0/2608008359 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe450011590 con 0x7fe46009d450 2023-09-30T22:25:46.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.883+0000 7f3c79438700 1 -- 172.21.15.40:0/1627986651 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3c74062380 con 0x7f3c7409d400 2023-09-30T22:25:46.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.883+0000 7f3c6b7fe700 1 -- 172.21.15.40:0/1627986651 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3c64017020 con 0x7f3c7409d400 2023-09-30T22:25:46.884 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:46.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.885+0000 7f3c79438700 1 -- 172.21.15.40:0/1627986651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c7409d400 msgr2=0x7f3c74119050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:46.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.885+0000 7f3c79438700 1 --2- 172.21.15.40:0/1627986651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c7409d400 0x7f3c74119050 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3c6400ec10 tx=0x7f3c6400ef20 comp rx=0 tx=0).stop 2023-09-30T22:25:46.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.885+0000 7f3c79438700 1 -- 172.21.15.40:0/1627986651 shutdown_connections 2023-09-30T22:25:46.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.885+0000 7f3c79438700 1 --2- 172.21.15.40:0/1627986651 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c74133e00 0x7f3c74119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.885+0000 7f3c79438700 1 --2- 172.21.15.40:0/1627986651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c7409d400 0x7f3c74119050 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.885+0000 7f3c79438700 1 --2- 172.21.15.40:0/1627986651 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c7409dd70 0x7f3c74119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.885+0000 7f3c79438700 1 -- 172.21.15.40:0/1627986651 >> 172.21.15.40:0/1627986651 conn(0x7f3c740a2a00 msgr2=0x7f3c7412d920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:46.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.885+0000 7f3c79438700 1 -- 172.21.15.40:0/1627986651 shutdown_connections 2023-09-30T22:25:46.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.885+0000 7f3c79438700 1 -- 172.21.15.40:0/1627986651 wait complete. 2023-09-30T22:25:46.899 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:46.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.954+0000 7fb5cf736700 1 Processor -- start 2023-09-30T22:25:46.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.955+0000 7fb5cf736700 1 -- start start 2023-09-30T22:25:46.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.955+0000 7fb5cf736700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb5c809d920 0x7fb5c809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.955+0000 7fb5cf736700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5c809f0f0 0x7fb5c809e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.955+0000 7fb5cf736700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb5c8133ca0 0x7fb5c8134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.955+0000 7fb5cf736700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c806b4c0 con 0x7fb5c8133ca0 2023-09-30T22:25:46.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.955+0000 7fb5cf736700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c809a8f0 con 0x7fb5c809f0f0 2023-09-30T22:25:46.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.955+0000 7fb5cf736700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c809f940 con 0x7fb5c809d920 2023-09-30T22:25:46.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.956+0000 7fb5cd4d2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb5c809d920 0x7fb5c809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.956+0000 7fb5cccd1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5c809f0f0 0x7fb5c809e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.956+0000 7fb5cd4d2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb5c809d920 0x7fb5c809dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33846/0 (socket says 172.21.15.40:33846) 2023-09-30T22:25:46.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.956+0000 7fb5cccd1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5c809f0f0 0x7fb5c809e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53044/0 (socket says 172.21.15.40:53044) 2023-09-30T22:25:46.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.956+0000 7fb5cd4d2700 1 -- 172.21.15.40:0/2207238968 learned_addr learned my addr 172.21.15.40:0/2207238968 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:46.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.956+0000 7fb5cdcd3700 1 --2- 172.21.15.40:0/2207238968 >> v2:172.21.15.40:3300/0 conn(0x7fb5c8133ca0 0x7fb5c8134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.956+0000 7fb5cd4d2700 1 -- 172.21.15.40:0/2207238968 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5c809f0f0 msgr2=0x7fb5c809e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:46.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.956+0000 7fb5cd4d2700 1 --2- 172.21.15.40:0/2207238968 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5c809f0f0 0x7fb5c809e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.956+0000 7fb5cd4d2700 1 -- 172.21.15.40:0/2207238968 >> v2:172.21.15.40:3300/0 conn(0x7fb5c8133ca0 msgr2=0x7fb5c8134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:46.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.956+0000 7fb5cd4d2700 1 --2- 172.21.15.40:0/2207238968 >> v2:172.21.15.40:3300/0 conn(0x7fb5c8133ca0 0x7fb5c8134140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.956+0000 7fb5cd4d2700 1 -- 172.21.15.40:0/2207238968 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c809f6e0 con 0x7fb5c809d920 2023-09-30T22:25:46.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.956+0000 7fb5cdcd3700 1 --2- 172.21.15.40:0/2207238968 >> v2:172.21.15.40:3300/0 conn(0x7fb5c8133ca0 0x7fb5c8134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:46.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.956+0000 7fb5cccd1700 1 --2- 172.21.15.40:0/2207238968 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5c809f0f0 0x7fb5c809e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:46.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.956+0000 7fb5cd4d2700 1 --2- 172.21.15.40:0/2207238968 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb5c809d920 0x7fb5c809dcf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb5c40098f0 tx=0x7fb5c4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c6e5306ac630107 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:46.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.956+0000 7fb5bffff700 1 -- 172.21.15.40:0/2207238968 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c4005e30 con 0x7fb5c809d920 2023-09-30T22:25:46.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.957+0000 7fb5bffff700 1 -- 172.21.15.40:0/2207238968 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c4004030 con 0x7fb5c809d920 2023-09-30T22:25:46.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.957+0000 7fb5bffff700 1 -- 172.21.15.40:0/2207238968 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c40043e0 con 0x7fb5c809d920 2023-09-30T22:25:46.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.957+0000 7fb5cf736700 1 -- 172.21.15.40:0/2207238968 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb5c809d920 msgr2=0x7fb5c809dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:46.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.957+0000 7fb5cf736700 1 --2- 172.21.15.40:0/2207238968 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb5c809d920 0x7fb5c809dcf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb5c40098f0 tx=0x7fb5c4009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:46.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.957+0000 7fb5cf736700 1 -- 172.21.15.40:0/2207238968 shutdown_connections 2023-09-30T22:25:46.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.957+0000 7fb5cf736700 1 --2- 172.21.15.40:0/2207238968 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb5c809d920 0x7fb5c809dcf0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.957+0000 7fb5cf736700 1 --2- 172.21.15.40:0/2207238968 >> v2:172.21.15.40:3300/0 conn(0x7fb5c8133ca0 0x7fb5c8134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.957+0000 7fb5cf736700 1 --2- 172.21.15.40:0/2207238968 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5c809f0f0 0x7fb5c809e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.957+0000 7fb5cf736700 1 -- 172.21.15.40:0/2207238968 >> 172.21.15.40:0/2207238968 conn(0x7fb5c809fb20 msgr2=0x7fb5c809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:46.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.958+0000 7fb5cf736700 1 -- 172.21.15.40:0/2207238968 shutdown_connections 2023-09-30T22:25:46.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.958+0000 7fb5cf736700 1 -- 172.21.15.40:0/2207238968 wait complete. 2023-09-30T22:25:46.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.959+0000 7fb5cf736700 1 Processor -- start 2023-09-30T22:25:46.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.959+0000 7fb5cf736700 1 -- start start 2023-09-30T22:25:46.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.960+0000 7fb5cf736700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5c809d920 0x7fb5c8120450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.960+0000 7fb5cf736700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5c8133ca0 0x7fb5c8120990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.960+0000 7fb5cf736700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb5c8124470 0x7fb5c8120ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.960+0000 7fb5cf736700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c8122640 con 0x7fb5c8133ca0 2023-09-30T22:25:46.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.960+0000 7fb5cf736700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c8123700 con 0x7fb5c809d920 2023-09-30T22:25:46.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.960+0000 7fb5cf736700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c809c9e0 con 0x7fb5c8124470 2023-09-30T22:25:46.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.960+0000 7fb5cccd1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5c8133ca0 0x7fb5c8120990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.960+0000 7fb5cccd1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5c8133ca0 0x7fb5c8120990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42900/0 (socket says 172.21.15.40:42900) 2023-09-30T22:25:46.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.960+0000 7fb5cccd1700 1 -- 172.21.15.40:0/2192622504 learned_addr learned my addr 172.21.15.40:0/2192622504 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:46.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.960+0000 7fb5cdcd3700 1 --2- 172.21.15.40:0/2192622504 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb5c8124470 0x7fb5c8120ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.960+0000 7fb5cd4d2700 1 --2- 172.21.15.40:0/2192622504 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5c809d920 0x7fb5c8120450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.960+0000 7fb5cccd1700 1 -- 172.21.15.40:0/2192622504 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb5c8124470 msgr2=0x7fb5c8120ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:46.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.960+0000 7fb5cccd1700 1 --2- 172.21.15.40:0/2192622504 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb5c8124470 0x7fb5c8120ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.960+0000 7fb5cccd1700 1 -- 172.21.15.40:0/2192622504 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5c809d920 msgr2=0x7fb5c8120450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:46.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.960+0000 7fb5cccd1700 1 --2- 172.21.15.40:0/2192622504 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5c809d920 0x7fb5c8120450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.960+0000 7fb5cccd1700 1 -- 172.21.15.40:0/2192622504 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b80094a0 con 0x7fb5c8133ca0 2023-09-30T22:25:46.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.960+0000 7fb5cd4d2700 1 --2- 172.21.15.40:0/2192622504 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5c809d920 0x7fb5c8120450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:46.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.961+0000 7fb5cccd1700 1 --2- 172.21.15.40:0/2192622504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5c8133ca0 0x7fb5c8120990 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb5b800e9b0 tx=0x7fb5b800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:46.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.961+0000 7fb5bdffb700 1 -- 172.21.15.40:0/2192622504 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b800ee40 con 0x7fb5c8133ca0 2023-09-30T22:25:46.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.961+0000 7fb5bdffb700 1 -- 172.21.15.40:0/2192622504 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b800c850 con 0x7fb5c8133ca0 2023-09-30T22:25:46.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.961+0000 7fb5cf736700 1 -- 172.21.15.40:0/2192622504 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c0009a70 con 0x7fb5c8133ca0 2023-09-30T22:25:46.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.961+0000 7fb5bdffb700 1 -- 172.21.15.40:0/2192622504 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b800cbc0 con 0x7fb5c8133ca0 2023-09-30T22:25:46.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.961+0000 7fb5cf736700 1 -- 172.21.15.40:0/2192622504 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c4009500 con 0x7fb5c8133ca0 2023-09-30T22:25:46.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.962+0000 7fb5cf736700 1 -- 172.21.15.40:0/2192622504 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c8123af0 con 0x7fb5c8133ca0 2023-09-30T22:25:46.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.962+0000 7fb5bdffb700 1 -- 172.21.15.40:0/2192622504 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb5b800cd20 con 0x7fb5c8133ca0 2023-09-30T22:25:46.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.963+0000 7fb5bdffb700 1 -- 172.21.15.40:0/2192622504 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb5b803f6b0 con 0x7fb5c8133ca0 2023-09-30T22:25:46.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.971+0000 7fb5bdffb700 1 -- 172.21.15.40:0/2192622504 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb5c8123af0 con 0x7fb5c8133ca0 2023-09-30T22:25:46.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.973+0000 7f65b7992700 1 Processor -- start 2023-09-30T22:25:46.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.974+0000 7f65b7992700 1 -- start start 2023-09-30T22:25:46.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.974+0000 7f65b7992700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f65b009f0f0 0x7f65b0138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.974+0000 7f65b7992700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f65b009e400 0x7f65b013b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.974+0000 7f65b7992700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65b009f940 con 0x7f65b009d920 2023-09-30T22:25:46.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.974+0000 7f65b7992700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65b006b4c0 con 0x7f65b009e400 2023-09-30T22:25:46.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.974+0000 7f65b7992700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65b009a8f0 con 0x7f65b009f0f0 2023-09-30T22:25:46.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.974+0000 7f65b5f2f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f65b009e400 0x7f65b013b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.974+0000 7f65b572e700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f65b009d920 0x7f65b009dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56154/0 (socket says 172.21.15.40:56154) 2023-09-30T22:25:46.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.974+0000 7f65b572e700 1 -- 172.21.15.40:0/3448559808 learned_addr learned my addr 172.21.15.40:0/3448559808 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:46.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.974+0000 7f65b4f2d700 1 --2- 172.21.15.40:0/3448559808 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f65b009f0f0 0x7f65b0138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.975+0000 7f65b5f2f700 1 -- 172.21.15.40:0/3448559808 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f65b009f0f0 msgr2=0x7f65b0138ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:46.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.975+0000 7f65b5f2f700 1 --2- 172.21.15.40:0/3448559808 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f65b009f0f0 0x7f65b0138ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.975+0000 7f65b5f2f700 1 -- 172.21.15.40:0/3448559808 >> v1:172.21.15.40:6789/0 conn(0x7f65b009d920 legacy=0x7f65b009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:46.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.975+0000 7f65a7fff700 1 -- 172.21.15.40:0/3448559808 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1706233260 0 0) 0x7f65b009f940 con 0x7f65b009d920 2023-09-30T22:25:46.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.975+0000 7f65b5f2f700 1 -- 172.21.15.40:0/3448559808 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b009f6e0 con 0x7f65b009e400 2023-09-30T22:25:46.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.975+0000 7f65b5f2f700 1 --2- 172.21.15.40:0/3448559808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b009e400 0x7f65b013b430 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f65a8009dc0 tx=0x7f65a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=539d257b159c22eb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:46.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.975+0000 7f65a7fff700 1 -- 172.21.15.40:0/3448559808 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a800e070 con 0x7f65b009e400 2023-09-30T22:25:46.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.975+0000 7f65a7fff700 1 -- 172.21.15.40:0/3448559808 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a800bae0 con 0x7f65b009e400 2023-09-30T22:25:46.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.975+0000 7f65a7fff700 1 -- 172.21.15.40:0/3448559808 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a800be90 con 0x7f65b009e400 2023-09-30T22:25:46.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.976+0000 7f65b7992700 1 -- 172.21.15.40:0/3448559808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b009e400 msgr2=0x7f65b013b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:46.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.976+0000 7f65b7992700 1 --2- 172.21.15.40:0/3448559808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b009e400 0x7f65b013b430 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f65a8009dc0 tx=0x7f65a800b330 comp rx=0 tx=0).stop 2023-09-30T22:25:46.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.976+0000 7f65b7992700 1 -- 172.21.15.40:0/3448559808 shutdown_connections 2023-09-30T22:25:46.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.976+0000 7f65b7992700 1 --2- 172.21.15.40:0/3448559808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b009e400 0x7f65b013b430 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.976+0000 7f65b7992700 1 --2- 172.21.15.40:0/3448559808 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f65b009f0f0 0x7f65b0138ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.976+0000 7f65b7992700 1 -- 172.21.15.40:0/3448559808 >> 172.21.15.40:0/3448559808 conn(0x7f65b009fb20 msgr2=0x7f65b009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:46.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.976+0000 7f65b7992700 1 -- 172.21.15.40:0/3448559808 shutdown_connections 2023-09-30T22:25:46.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.976+0000 7f65b7992700 1 -- 172.21.15.40:0/3448559808 wait complete. 2023-09-30T22:25:46.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.977+0000 7f65b7992700 1 Processor -- start 2023-09-30T22:25:46.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.977+0000 7f65b7992700 1 -- start start 2023-09-30T22:25:46.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.977+0000 7f65b7992700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65b009d920 0x7f65b011db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.977+0000 7f65b7992700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b009e400 0x7f65b011e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.977+0000 7f65b7992700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f65b013a450 0x7f65b011e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.977+0000 7f65b7992700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b0120150 con 0x7f65b009e400 2023-09-30T22:25:46.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.977+0000 7f65b7992700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b0134990 con 0x7f65b009d920 2023-09-30T22:25:46.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.977+0000 7f65b7992700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65b013b5b0 con 0x7f65b013a450 2023-09-30T22:25:46.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.977+0000 7f65b5f2f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f65b013a450 0x7f65b011e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.977+0000 7f65b572e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65b009d920 0x7f65b011db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.977+0000 7f65b5f2f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f65b013a450 0x7f65b011e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33870/0 (socket says 172.21.15.40:33870) 2023-09-30T22:25:46.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.977+0000 7f65b4f2d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b009e400 0x7f65b011e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.977+0000 7f65b5f2f700 1 -- 172.21.15.40:0/545906278 learned_addr learned my addr 172.21.15.40:0/545906278 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:46.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.978+0000 7f65b5f2f700 1 -- 172.21.15.40:0/545906278 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65b009d920 msgr2=0x7f65b011db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:46.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.978+0000 7f65b5f2f700 1 --2- 172.21.15.40:0/545906278 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65b009d920 0x7f65b011db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.978+0000 7f65b5f2f700 1 -- 172.21.15.40:0/545906278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b009e400 msgr2=0x7f65b011e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:46.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.978+0000 7f65b5f2f700 1 --2- 172.21.15.40:0/545906278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b009e400 0x7f65b011e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.978+0000 7f65b5f2f700 1 -- 172.21.15.40:0/545906278 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a8009a70 con 0x7f65b013a450 2023-09-30T22:25:46.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.978+0000 7f65b4f2d700 1 --2- 172.21.15.40:0/545906278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b009e400 0x7f65b011e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:46.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.978+0000 7f65b5f2f700 1 --2- 172.21.15.40:0/545906278 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f65b013a450 0x7f65b011e5c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f65a8014040 tx=0x7f65a8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:46.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.978+0000 7f65a5ffb700 1 -- 172.21.15.40:0/545906278 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a80045d0 con 0x7f65b013a450 2023-09-30T22:25:46.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.978+0000 7f65a5ffb700 1 -- 172.21.15.40:0/545906278 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a8020070 con 0x7f65b013a450 2023-09-30T22:25:46.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.978+0000 7f65b7992700 1 -- 172.21.15.40:0/545906278 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b00a2fd0 con 0x7f65b013a450 2023-09-30T22:25:46.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.978+0000 7f65a5ffb700 1 -- 172.21.15.40:0/545906278 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a8027480 con 0x7f65b013a450 2023-09-30T22:25:46.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.979+0000 7f65b7992700 1 -- 172.21.15.40:0/545906278 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65b011fbb0 con 0x7f65b013a450 2023-09-30T22:25:46.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.979+0000 7f65a5ffb700 1 -- 172.21.15.40:0/545906278 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f65a80275e0 con 0x7f65b013a450 2023-09-30T22:25:46.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.979+0000 7f65a5ffb700 1 -- 172.21.15.40:0/545906278 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f65a8022070 con 0x7f65b013a450 2023-09-30T22:25:46.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.980+0000 7f65b7992700 1 -- 172.21.15.40:0/545906278 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65b011ff80 con 0x7f65b013a450 2023-09-30T22:25:46.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:46.984+0000 7f65a5ffb700 1 -- 172.21.15.40:0/545906278 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f65a802c080 con 0x7f65b013a450 2023-09-30T22:25:47.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:47.114+0000 7fe4649b2700 1 -- 172.21.15.40:0/2608008359 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe460074330 con 0x7fe46009d450 2023-09-30T22:25:47.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:47.114+0000 7fe44effd700 1 -- 172.21.15.40:0/2608008359 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe450017030 con 0x7fe46009d450 2023-09-30T22:25:47.115 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:47.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:47.116+0000 7fe4649b2700 1 -- 172.21.15.40:0/2608008359 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe46009d450 msgr2=0x7fe4601347a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:47.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:47.116+0000 7fe4649b2700 1 --2- 172.21.15.40:0/2608008359 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe46009d450 0x7fe4601347a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe450000f60 tx=0x7fe45000c730 comp rx=0 tx=0).stop 2023-09-30T22:25:47.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:47.116+0000 7fe4649b2700 1 -- 172.21.15.40:0/2608008359 shutdown_connections 2023-09-30T22:25:47.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:47.116+0000 7fe4649b2700 1 --2- 172.21.15.40:0/2608008359 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe460135940 0x7fe460135220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:47.116+0000 7fe4649b2700 1 --2- 172.21.15.40:0/2608008359 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe46009d450 0x7fe4601347a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:47.116+0000 7fe4649b2700 1 --2- 172.21.15.40:0/2608008359 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe46009df30 0x7fe460134ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:47.116+0000 7fe4649b2700 1 -- 172.21.15.40:0/2608008359 >> 172.21.15.40:0/2608008359 conn(0x7fe4600a2a00 msgr2=0x7fe46012c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:47.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:47.116+0000 7fe4649b2700 1 -- 172.21.15.40:0/2608008359 shutdown_connections 2023-09-30T22:25:47.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:47.116+0000 7fe4649b2700 1 -- 172.21.15.40:0/2608008359 wait complete. 2023-09-30T22:25:47.129 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:47.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:47.170+0000 7fb5cf736700 1 -- 172.21.15.40:0/2192622504 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb5c8123af0 con 0x7fb5c8133ca0 2023-09-30T22:25:47.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:47.171+0000 7fb5bdffb700 1 -- 172.21.15.40:0/2192622504 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb5c8123af0 con 0x7fb5c8133ca0 2023-09-30T22:25:47.171 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:47.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:47.173+0000 7fb5cf736700 1 -- 172.21.15.40:0/2192622504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5c8133ca0 msgr2=0x7fb5c8120990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:47.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:47.173+0000 7fb5cf736700 1 --2- 172.21.15.40:0/2192622504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5c8133ca0 0x7fb5c8120990 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb5b800e9b0 tx=0x7fb5b800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:47.173+0000 7fb5cf736700 1 -- 172.21.15.40:0/2192622504 shutdown_connections 2023-09-30T22:25:47.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:47.173+0000 7fb5cf736700 1 --2- 172.21.15.40:0/2192622504 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb5c8124470 0x7fb5c8120ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:47.173+0000 7fb5cf736700 1 --2- 172.21.15.40:0/2192622504 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5c809d920 0x7fb5c8120450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:47.173+0000 7fb5cf736700 1 --2- 172.21.15.40:0/2192622504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5c8133ca0 0x7fb5c8120990 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:47.173+0000 7fb5cf736700 1 -- 172.21.15.40:0/2192622504 >> 172.21.15.40:0/2192622504 conn(0x7fb5c809fb20 msgr2=0x7fb5c81bb090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:47.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:47.173+0000 7fb5cf736700 1 -- 172.21.15.40:0/2192622504 shutdown_connections 2023-09-30T22:25:47.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:47.173+0000 7fb5cf736700 1 -- 172.21.15.40:0/2192622504 wait complete. 2023-09-30T22:25:47.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:47.179+0000 7f65b7992700 1 -- 172.21.15.40:0/545906278 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f65b0062380 con 0x7f65b013a450 2023-09-30T22:25:47.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:47.180+0000 7f65a5ffb700 1 -- 172.21.15.40:0/545906278 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f65a8036090 con 0x7f65b013a450 2023-09-30T22:25:47.180 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:47.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:47.182+0000 7f65b7992700 1 -- 172.21.15.40:0/545906278 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f65b013a450 msgr2=0x7f65b011e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:47.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:47.182+0000 7f65b7992700 1 --2- 172.21.15.40:0/545906278 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f65b013a450 0x7f65b011e5c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f65a8014040 tx=0x7f65a8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:47.182+0000 7f65b7992700 1 -- 172.21.15.40:0/545906278 shutdown_connections 2023-09-30T22:25:47.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:47.182+0000 7f65b7992700 1 --2- 172.21.15.40:0/545906278 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f65b013a450 0x7f65b011e5c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:47.182+0000 7f65b7992700 1 --2- 172.21.15.40:0/545906278 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65b009d920 0x7f65b011db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:47.182+0000 7f65b7992700 1 --2- 172.21.15.40:0/545906278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b009e400 0x7f65b011e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:47.182+0000 7f65b7992700 1 -- 172.21.15.40:0/545906278 >> 172.21.15.40:0/545906278 conn(0x7f65b009fb20 msgr2=0x7f65b0136f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:47.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:47.182+0000 7f65b7992700 1 -- 172.21.15.40:0/545906278 shutdown_connections 2023-09-30T22:25:47.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:47.182+0000 7f65b7992700 1 -- 172.21.15.40:0/545906278 wait complete. 2023-09-30T22:25:47.186 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:47.195 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:47.900 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:48.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.041+0000 7f5636a33700 1 Processor -- start 2023-09-30T22:25:48.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.041+0000 7f5636a33700 1 -- start start 2023-09-30T22:25:48.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.042+0000 7f5636a33700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f563012e590 0x7f563012e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.042+0000 7f5636a33700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f563012d8a0 0x7f5630138c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.042+0000 7f5636a33700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f563009ab70 con 0x7f563012eea0 2023-09-30T22:25:48.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.042+0000 7f5636a33700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f563009b270 con 0x7f563012e590 2023-09-30T22:25:48.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.042+0000 7f5636a33700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f563009bab0 con 0x7f563012d8a0 2023-09-30T22:25:48.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.042+0000 7f562ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f563012e590 0x7f563012e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.042+0000 7f5634fd0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f563012d8a0 0x7f5630138c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.042+0000 7f562ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f563012e590 0x7f563012e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42930/0 (socket says 172.21.15.40:42930) 2023-09-30T22:25:48.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.042+0000 7f562ffff700 1 -- 172.21.15.40:0/3854051095 learned_addr learned my addr 172.21.15.40:0/3854051095 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:48.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.042+0000 7f5634fd0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f563012d8a0 0x7f5630138c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53082/0 (socket says 172.21.15.40:53082) 2023-09-30T22:25:48.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.042+0000 7f562ffff700 1 -- 172.21.15.40:0/3854051095 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f563012d8a0 msgr2=0x7f5630138c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:48.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.042+0000 7f562ffff700 1 --2- 172.21.15.40:0/3854051095 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f563012d8a0 0x7f5630138c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.042+0000 7f562ffff700 1 -- 172.21.15.40:0/3854051095 >> v1:172.21.15.40:6789/0 conn(0x7f563012eea0 legacy=0x7f563012d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.042+0000 7f562ffff700 1 -- 172.21.15.40:0/3854051095 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563009bd70 con 0x7f563012e590 2023-09-30T22:25:48.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.042+0000 7f5634fd0700 1 --2- 172.21.15.40:0/3854051095 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f563012d8a0 0x7f5630138c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:48.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.042+0000 7f562ffff700 1 --2- 172.21.15.40:0/3854051095 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f563012e590 0x7f563012e960 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f56200098f0 tx=0x7f5620009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac1148b6956b34a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:48.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.042+0000 7f562effd700 1 -- 172.21.15.40:0/3854051095 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5620011830 con 0x7f563012e590 2023-09-30T22:25:48.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.043+0000 7f562effd700 1 -- 172.21.15.40:0/3854051095 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5620011990 con 0x7f563012e590 2023-09-30T22:25:48.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.043+0000 7f562effd700 1 -- 172.21.15.40:0/3854051095 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5620011d20 con 0x7f563012e590 2023-09-30T22:25:48.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.043+0000 7f5636a33700 1 -- 172.21.15.40:0/3854051095 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f563012e590 msgr2=0x7f563012e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.043+0000 7f5636a33700 1 --2- 172.21.15.40:0/3854051095 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f563012e590 0x7f563012e960 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f56200098f0 tx=0x7f5620009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:48.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.043+0000 7f5636a33700 1 -- 172.21.15.40:0/3854051095 shutdown_connections 2023-09-30T22:25:48.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.043+0000 7f5636a33700 1 --2- 172.21.15.40:0/3854051095 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f563012d8a0 0x7f5630138c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.043+0000 7f5636a33700 1 --2- 172.21.15.40:0/3854051095 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f563012e590 0x7f563012e960 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.043+0000 7f5636a33700 1 -- 172.21.15.40:0/3854051095 >> 172.21.15.40:0/3854051095 conn(0x7f56300a2a00 msgr2=0x7f56300a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:48.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.043+0000 7f5636a33700 1 -- 172.21.15.40:0/3854051095 shutdown_connections 2023-09-30T22:25:48.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.043+0000 7f5636a33700 1 -- 172.21.15.40:0/3854051095 wait complete. 2023-09-30T22:25:48.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.044+0000 7f5636a33700 1 Processor -- start 2023-09-30T22:25:48.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.044+0000 7f5636a33700 1 -- start start 2023-09-30T22:25:48.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.045+0000 7f5636a33700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f563012d8a0 0x7f563011f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.045+0000 7f5636a33700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f563012e590 0x7f563011f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.045+0000 7f5636a33700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f563012eea0 0x7f563011fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.045+0000 7f5636a33700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56300a0b40 con 0x7f563012e590 2023-09-30T22:25:48.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.045+0000 7f5636a33700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5630121700 con 0x7f563012eea0 2023-09-30T22:25:48.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.045+0000 7f5636a33700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5630123a00 con 0x7f563012d8a0 2023-09-30T22:25:48.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.045+0000 7f5634fd0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f563012eea0 0x7f563011fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.045+0000 7f562f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f563012e590 0x7f563011f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.045+0000 7f562f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f563012e590 0x7f563011f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42940/0 (socket says 172.21.15.40:42940) 2023-09-30T22:25:48.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.045+0000 7f562ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f563012d8a0 0x7f563011f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.045+0000 7f562f7fe700 1 -- 172.21.15.40:0/2800126391 learned_addr learned my addr 172.21.15.40:0/2800126391 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.045+0000 7f5634fd0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f563012eea0 0x7f563011fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53086/0 (socket says 172.21.15.40:53086) 2023-09-30T22:25:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.045+0000 7f5634fd0700 1 -- 172.21.15.40:0/2800126391 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f563012d8a0 msgr2=0x7f563011f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.045+0000 7f5634fd0700 1 --2- 172.21.15.40:0/2800126391 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f563012d8a0 0x7f563011f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.045+0000 7f5634fd0700 1 -- 172.21.15.40:0/2800126391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f563012e590 msgr2=0x7f563011f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.045+0000 7f5634fd0700 1 --2- 172.21.15.40:0/2800126391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f563012e590 0x7f563011f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.045+0000 7f5634fd0700 1 -- 172.21.15.40:0/2800126391 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5628009a70 con 0x7f563012eea0 2023-09-30T22:25:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.045+0000 7f562ffff700 1 --2- 172.21.15.40:0/2800126391 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f563012d8a0 0x7f563011f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.045+0000 7f562f7fe700 1 --2- 172.21.15.40:0/2800126391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f563012e590 0x7f563011f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.045+0000 7f5634fd0700 1 --2- 172.21.15.40:0/2800126391 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f563012eea0 0x7f563011fee0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f562800efc0 tx=0x7f562800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:48.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.046+0000 7f562cff9700 1 -- 172.21.15.40:0/2800126391 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562800ca90 con 0x7f563012eea0 2023-09-30T22:25:48.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.046+0000 7f562cff9700 1 -- 172.21.15.40:0/2800126391 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f562800f040 con 0x7f563012eea0 2023-09-30T22:25:48.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.046+0000 7f562cff9700 1 -- 172.21.15.40:0/2800126391 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562800ce30 con 0x7f563012eea0 2023-09-30T22:25:48.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.046+0000 7f5636a33700 1 -- 172.21.15.40:0/2800126391 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5620009550 con 0x7f563012eea0 2023-09-30T22:25:48.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.046+0000 7f5636a33700 1 -- 172.21.15.40:0/2800126391 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5630120f40 con 0x7f563012eea0 2023-09-30T22:25:48.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.046+0000 7f562cff9700 1 -- 172.21.15.40:0/2800126391 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5628014480 con 0x7f563012eea0 2023-09-30T22:25:48.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.047+0000 7f562cff9700 1 -- 172.21.15.40:0/2800126391 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f562803fd30 con 0x7f563012eea0 2023-09-30T22:25:48.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.047+0000 7f5636a33700 1 -- 172.21.15.40:0/2800126391 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5630123670 con 0x7f563012eea0 2023-09-30T22:25:48.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.051+0000 7f562cff9700 1 -- 172.21.15.40:0/2800126391 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5628012930 con 0x7f563012eea0 2023-09-30T22:25:48.130 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:48.187 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:48.196 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:48.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.251+0000 7f5636a33700 1 -- 172.21.15.40:0/2800126391 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5630062380 con 0x7f563012eea0 2023-09-30T22:25:48.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.252+0000 7f562cff9700 1 -- 172.21.15.40:0/2800126391 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5628012340 con 0x7f563012eea0 2023-09-30T22:25:48.252 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:48.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.254+0000 7f5636a33700 1 -- 172.21.15.40:0/2800126391 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f563012eea0 msgr2=0x7f563011fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.254+0000 7f5636a33700 1 --2- 172.21.15.40:0/2800126391 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f563012eea0 0x7f563011fee0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f562800efc0 tx=0x7f562800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.255+0000 7f5636a33700 1 -- 172.21.15.40:0/2800126391 shutdown_connections 2023-09-30T22:25:48.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.255+0000 7f5636a33700 1 --2- 172.21.15.40:0/2800126391 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f563012d8a0 0x7f563011f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.255+0000 7f5636a33700 1 --2- 172.21.15.40:0/2800126391 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f563012eea0 0x7f563011fee0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.255+0000 7f5636a33700 1 --2- 172.21.15.40:0/2800126391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f563012e590 0x7f563011f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.255+0000 7f5636a33700 1 -- 172.21.15.40:0/2800126391 >> 172.21.15.40:0/2800126391 conn(0x7f56300a2a00 msgr2=0x7f5630099a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:48.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.255+0000 7f5636a33700 1 -- 172.21.15.40:0/2800126391 shutdown_connections 2023-09-30T22:25:48.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.255+0000 7f5636a33700 1 -- 172.21.15.40:0/2800126391 wait complete. 2023-09-30T22:25:48.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.262+0000 7fa66a21c700 1 Processor -- start 2023-09-30T22:25:48.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.262+0000 7fa66a21c700 1 -- start start 2023-09-30T22:25:48.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.262+0000 7fa66a21c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa66409d920 0x7fa66409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.262+0000 7fa66a21c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa664130fb0 0x7fa664138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.262+0000 7fa66a21c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66409adf0 con 0x7fa66409e230 2023-09-30T22:25:48.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.262+0000 7fa66a21c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa66409edf0 con 0x7fa66409d920 2023-09-30T22:25:48.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.262+0000 7fa66a21c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa66409b660 con 0x7fa664130fb0 2023-09-30T22:25:48.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.262+0000 7fa6637fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa66409d920 0x7fa66409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.262+0000 7fa6637fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa66409d920 0x7fa66409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42944/0 (socket says 172.21.15.40:42944) 2023-09-30T22:25:48.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.262+0000 7fa6637fe700 1 -- 172.21.15.40:0/1332256061 learned_addr learned my addr 172.21.15.40:0/1332256061 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:48.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.263+0000 7fa663fff700 1 --2- 172.21.15.40:0/1332256061 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa664130fb0 0x7fa664138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.263+0000 7fa6637fe700 1 -- 172.21.15.40:0/1332256061 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa664130fb0 msgr2=0x7fa664138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:48.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.263+0000 7fa6637fe700 1 --2- 172.21.15.40:0/1332256061 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa664130fb0 0x7fa664138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.263+0000 7fa6637fe700 1 -- 172.21.15.40:0/1332256061 >> v1:172.21.15.40:6789/0 conn(0x7fa66409e230 legacy=0x7fa6641308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.263+0000 7fa6637fe700 1 -- 172.21.15.40:0/1332256061 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66409a6e0 con 0x7fa66409d920 2023-09-30T22:25:48.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.263+0000 7fa6637fe700 1 --2- 172.21.15.40:0/1332256061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa66409d920 0x7fa66409dcf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa654006fd0 tx=0x7fa654009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d1f179af411d563 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:48.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.263+0000 7fa6627fc700 1 -- 172.21.15.40:0/1332256061 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa654005e30 con 0x7fa66409d920 2023-09-30T22:25:48.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.263+0000 7fa6627fc700 1 -- 172.21.15.40:0/1332256061 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa654004030 con 0x7fa66409d920 2023-09-30T22:25:48.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.263+0000 7fa6627fc700 1 -- 172.21.15.40:0/1332256061 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6540043e0 con 0x7fa66409d920 2023-09-30T22:25:48.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.264+0000 7fa66a21c700 1 -- 172.21.15.40:0/1332256061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa66409d920 msgr2=0x7fa66409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.264+0000 7fa66a21c700 1 --2- 172.21.15.40:0/1332256061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa66409d920 0x7fa66409dcf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa654006fd0 tx=0x7fa654009bd0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.264+0000 7fa66a21c700 1 -- 172.21.15.40:0/1332256061 shutdown_connections 2023-09-30T22:25:48.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.264+0000 7fa66a21c700 1 --2- 172.21.15.40:0/1332256061 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa664130fb0 0x7fa664138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.264+0000 7fa66a21c700 1 --2- 172.21.15.40:0/1332256061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa66409d920 0x7fa66409dcf0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.264+0000 7fa66a21c700 1 -- 172.21.15.40:0/1332256061 >> 172.21.15.40:0/1332256061 conn(0x7fa66409fb20 msgr2=0x7fa66409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:48.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.265+0000 7fa66a21c700 1 -- 172.21.15.40:0/1332256061 shutdown_connections 2023-09-30T22:25:48.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.265+0000 7fa66a21c700 1 -- 172.21.15.40:0/1332256061 wait complete. 2023-09-30T22:25:48.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.265+0000 7fa66a21c700 1 Processor -- start 2023-09-30T22:25:48.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.266+0000 7fa66a21c700 1 -- start start 2023-09-30T22:25:48.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.266+0000 7fa66a21c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa66409d920 0x7fa664121540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.266+0000 7fa66a21c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa66409e230 0x7fa664121a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.266+0000 7fa66a21c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa664130fb0 0x7fa664121fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.266+0000 7fa66a21c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa664124ac0 con 0x7fa66409e230 2023-09-30T22:25:48.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.266+0000 7fa66a21c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa664125060 con 0x7fa66409d920 2023-09-30T22:25:48.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.266+0000 7fa66a21c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa664123970 con 0x7fa664130fb0 2023-09-30T22:25:48.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.266+0000 7fa663fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa664130fb0 0x7fa664121fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.266+0000 7fa663fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa664130fb0 0x7fa664121fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33888/0 (socket says 172.21.15.40:33888) 2023-09-30T22:25:48.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.266+0000 7fa663fff700 1 -- 172.21.15.40:0/1518228413 learned_addr learned my addr 172.21.15.40:0/1518228413 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:48.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.266+0000 7fa662ffd700 1 --2- 172.21.15.40:0/1518228413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa66409e230 0x7fa664121a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.267+0000 7fa6637fe700 1 --2- 172.21.15.40:0/1518228413 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa66409d920 0x7fa664121540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.267+0000 7fa663fff700 1 -- 172.21.15.40:0/1518228413 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa66409d920 msgr2=0x7fa664121540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.267+0000 7fa663fff700 1 --2- 172.21.15.40:0/1518228413 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa66409d920 0x7fa664121540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.267+0000 7fa663fff700 1 -- 172.21.15.40:0/1518228413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa66409e230 msgr2=0x7fa664121a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.267+0000 7fa663fff700 1 --2- 172.21.15.40:0/1518228413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa66409e230 0x7fa664121a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.267+0000 7fa663fff700 1 -- 172.21.15.40:0/1518228413 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa654009500 con 0x7fa664130fb0 2023-09-30T22:25:48.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.267+0000 7fa663fff700 1 --2- 172.21.15.40:0/1518228413 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa664130fb0 0x7fa664121fc0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa65c00efc0 tx=0x7fa65c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:48.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.267+0000 7fa64bfff700 1 -- 172.21.15.40:0/1518228413 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c009ea0 con 0x7fa664130fb0 2023-09-30T22:25:48.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.267+0000 7fa64bfff700 1 -- 172.21.15.40:0/1518228413 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65c00f040 con 0x7fa664130fb0 2023-09-30T22:25:48.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.267+0000 7fa66a21c700 1 -- 172.21.15.40:0/1518228413 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa66406b440 con 0x7fa664130fb0 2023-09-30T22:25:48.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.267+0000 7fa64bfff700 1 -- 172.21.15.40:0/1518228413 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c00ced0 con 0x7fa664130fb0 2023-09-30T22:25:48.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.268+0000 7fa64bfff700 1 -- 172.21.15.40:0/1518228413 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa65c014480 con 0x7fa664130fb0 2023-09-30T22:25:48.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.268+0000 7fa66a21c700 1 -- 172.21.15.40:0/1518228413 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa664124d80 con 0x7fa664130fb0 2023-09-30T22:25:48.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.269+0000 7fa64bfff700 1 -- 172.21.15.40:0/1518228413 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa65c014730 con 0x7fa664130fb0 2023-09-30T22:25:48.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.269+0000 7fa66a21c700 1 -- 172.21.15.40:0/1518228413 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa664062380 con 0x7fa664130fb0 2023-09-30T22:25:48.271 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:48.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.278+0000 7fa64bfff700 1 -- 172.21.15.40:0/1518228413 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa65c018030 con 0x7fa664130fb0 2023-09-30T22:25:48.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.325+0000 7f290f5ef700 1 Processor -- start 2023-09-30T22:25:48.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.325+0000 7f290f5ef700 1 -- start start 2023-09-30T22:25:48.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.326+0000 7f290f5ef700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f290809d920 0x7f290809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.326+0000 7f290f5ef700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f290809f0f0 0x7f290809e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.326+0000 7f290f5ef700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2908133ca0 0x7f2908134110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.326+0000 7f290f5ef700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f290806b4c0 con 0x7f290809d920 2023-09-30T22:25:48.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.326+0000 7f290f5ef700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f290809a8f0 con 0x7f2908133ca0 2023-09-30T22:25:48.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.326+0000 7f290f5ef700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f290809f940 con 0x7f290809f0f0 2023-09-30T22:25:48.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.326+0000 7f290cb8a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f290809f0f0 0x7f290809e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.326+0000 7f290d38b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f290809d920 0x7f290809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.326+0000 7f290cb8a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f290809f0f0 0x7f290809e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33898/0 (socket says 172.21.15.40:33898) 2023-09-30T22:25:48.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.326+0000 7f290cb8a700 1 -- 172.21.15.40:0/2409486296 learned_addr learned my addr 172.21.15.40:0/2409486296 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:48.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.326+0000 7f290db8c700 1 --2- 172.21.15.40:0/2409486296 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2908133ca0 0x7f2908134110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.326+0000 7f290cb8a700 1 -- 172.21.15.40:0/2409486296 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2908133ca0 msgr2=0x7f2908134110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:48.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.326+0000 7f290cb8a700 1 --2- 172.21.15.40:0/2409486296 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2908133ca0 0x7f2908134110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.326+0000 7f290cb8a700 1 -- 172.21.15.40:0/2409486296 >> v2:172.21.15.40:3300/0 conn(0x7f290809d920 msgr2=0x7f290809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:48.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.326+0000 7f290cb8a700 1 --2- 172.21.15.40:0/2409486296 >> v2:172.21.15.40:3300/0 conn(0x7f290809d920 0x7f290809dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.326+0000 7f290cb8a700 1 -- 172.21.15.40:0/2409486296 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f290809f6e0 con 0x7f290809f0f0 2023-09-30T22:25:48.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.326+0000 7f290d38b700 1 --2- 172.21.15.40:0/2409486296 >> v2:172.21.15.40:3300/0 conn(0x7f290809d920 0x7f290809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:48.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.326+0000 7f290db8c700 1 --2- 172.21.15.40:0/2409486296 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2908133ca0 0x7f2908134110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:48.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.327+0000 7f290cb8a700 1 --2- 172.21.15.40:0/2409486296 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f290809f0f0 0x7f290809e230 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f28f8009920 tx=0x7f28f8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35526d8897e4927 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:48.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.327+0000 7f28fffff700 1 -- 172.21.15.40:0/2409486296 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f8011830 con 0x7f290809f0f0 2023-09-30T22:25:48.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.327+0000 7f28fffff700 1 -- 172.21.15.40:0/2409486296 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f8011990 con 0x7f290809f0f0 2023-09-30T22:25:48.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.327+0000 7f28fffff700 1 -- 172.21.15.40:0/2409486296 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f8011d20 con 0x7f290809f0f0 2023-09-30T22:25:48.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.327+0000 7f290f5ef700 1 -- 172.21.15.40:0/2409486296 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f290809f0f0 msgr2=0x7f290809e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.327+0000 7f290f5ef700 1 --2- 172.21.15.40:0/2409486296 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f290809f0f0 0x7f290809e230 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f28f8009920 tx=0x7f28f8009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:48.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.327+0000 7f290f5ef700 1 -- 172.21.15.40:0/2409486296 shutdown_connections 2023-09-30T22:25:48.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.327+0000 7f290f5ef700 1 --2- 172.21.15.40:0/2409486296 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2908133ca0 0x7f2908134110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.327+0000 7f290f5ef700 1 --2- 172.21.15.40:0/2409486296 >> v2:172.21.15.40:3300/0 conn(0x7f290809d920 0x7f290809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.327+0000 7f290f5ef700 1 --2- 172.21.15.40:0/2409486296 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f290809f0f0 0x7f290809e230 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.328+0000 7f290f5ef700 1 -- 172.21.15.40:0/2409486296 >> 172.21.15.40:0/2409486296 conn(0x7f290809fb20 msgr2=0x7f290809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:48.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.328+0000 7f290f5ef700 1 -- 172.21.15.40:0/2409486296 shutdown_connections 2023-09-30T22:25:48.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.328+0000 7f290f5ef700 1 -- 172.21.15.40:0/2409486296 wait complete. 2023-09-30T22:25:48.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.329+0000 7f290f5ef700 1 Processor -- start 2023-09-30T22:25:48.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.329+0000 7f290f5ef700 1 -- start start 2023-09-30T22:25:48.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.329+0000 7f290f5ef700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f290809d920 0x7f2908122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.329+0000 7f290f5ef700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2908133ca0 0x7f2908123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.329+0000 7f290f5ef700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29081236c0 0x7f29081c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.329+0000 7f290f5ef700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f290809ca50 con 0x7f2908133ca0 2023-09-30T22:25:48.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.329+0000 7f290f5ef700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2908125060 con 0x7f29081236c0 2023-09-30T22:25:48.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.329+0000 7f290f5ef700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2908126710 con 0x7f290809d920 2023-09-30T22:25:48.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.329+0000 7f290d38b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f290809d920 0x7f2908122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.329+0000 7f290db8c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29081236c0 0x7f29081c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.329+0000 7f290db8c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29081236c0 0x7f29081c84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53124/0 (socket says 172.21.15.40:53124) 2023-09-30T22:25:48.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.329+0000 7f290d38b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f290809d920 0x7f2908122c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33902/0 (socket says 172.21.15.40:33902) 2023-09-30T22:25:48.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.329+0000 7f290db8c700 1 -- 172.21.15.40:0/1030717563 learned_addr learned my addr 172.21.15.40:0/1030717563 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:48.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.329+0000 7f290cb8a700 1 --2- 172.21.15.40:0/1030717563 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2908133ca0 0x7f2908123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.330+0000 7f290d38b700 1 -- 172.21.15.40:0/1030717563 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29081236c0 msgr2=0x7f29081c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.330+0000 7f290d38b700 1 --2- 172.21.15.40:0/1030717563 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29081236c0 0x7f29081c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.330+0000 7f290d38b700 1 -- 172.21.15.40:0/1030717563 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2908133ca0 msgr2=0x7f2908123180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.330+0000 7f290d38b700 1 --2- 172.21.15.40:0/1030717563 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2908133ca0 0x7f2908123180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.330+0000 7f290d38b700 1 -- 172.21.15.40:0/1030717563 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2904009430 con 0x7f290809d920 2023-09-30T22:25:48.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.330+0000 7f290db8c700 1 --2- 172.21.15.40:0/1030717563 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29081236c0 0x7f29081c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:48.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.330+0000 7f290cb8a700 1 --2- 172.21.15.40:0/1030717563 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2908133ca0 0x7f2908123180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:48.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.330+0000 7f290d38b700 1 --2- 172.21.15.40:0/1030717563 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f290809d920 0x7f2908122c40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f290400e900 tx=0x7f290400ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:48.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.330+0000 7f28fdffb700 1 -- 172.21.15.40:0/1030717563 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290400ee50 con 0x7f290809d920 2023-09-30T22:25:48.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.330+0000 7f28fdffb700 1 -- 172.21.15.40:0/1030717563 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2904005a20 con 0x7f290809d920 2023-09-30T22:25:48.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.330+0000 7f28fdffb700 1 -- 172.21.15.40:0/1030717563 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2904005dd0 con 0x7f290809d920 2023-09-30T22:25:48.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.330+0000 7f290f5ef700 1 -- 172.21.15.40:0/1030717563 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2900009a70 con 0x7f290809d920 2023-09-30T22:25:48.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.330+0000 7f290f5ef700 1 -- 172.21.15.40:0/1030717563 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f8009550 con 0x7f290809d920 2023-09-30T22:25:48.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.331+0000 7f28fdffb700 1 -- 172.21.15.40:0/1030717563 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2904004030 con 0x7f290809d920 2023-09-30T22:25:48.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.331+0000 7f28fdffb700 1 -- 172.21.15.40:0/1030717563 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f290403fc70 con 0x7f290809d920 2023-09-30T22:25:48.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.332+0000 7f290f5ef700 1 -- 172.21.15.40:0/1030717563 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2908124e10 con 0x7f290809d920 2023-09-30T22:25:48.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.340+0000 7f28fdffb700 1 -- 172.21.15.40:0/1030717563 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2908124e10 con 0x7f290809d920 2023-09-30T22:25:48.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.371+0000 7efc3200f700 1 Processor -- start 2023-09-30T22:25:48.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.371+0000 7efc3200f700 1 -- start start 2023-09-30T22:25:48.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.372+0000 7efc3200f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efc2c06f070 0x7efc2c06f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.372+0000 7efc3200f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efc2c06f980 0x7efc2c097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.372+0000 7efc3200f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc2c070830 con 0x7efc2c06fdb0 2023-09-30T22:25:48.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.372+0000 7efc3200f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc2c071af0 con 0x7efc2c06f980 2023-09-30T22:25:48.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.372+0000 7efc3200f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c070ad0 con 0x7efc2c06f070 2023-09-30T22:25:48.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.372+0000 7efc2b7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efc2c06f070 0x7efc2c06f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.372+0000 7efc2b7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efc2c06f070 0x7efc2c06f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33914/0 (socket says 172.21.15.40:33914) 2023-09-30T22:25:48.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.372+0000 7efc2b7fe700 1 -- 172.21.15.40:0/1971929978 learned_addr learned my addr 172.21.15.40:0/1971929978 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:48.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.372+0000 7efc2b7fe700 1 -- 172.21.15.40:0/1971929978 >> v2:172.21.15.40:3300/0 conn(0x7efc2c06f980 msgr2=0x7efc2c097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:48.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.372+0000 7efc2b7fe700 1 --2- 172.21.15.40:0/1971929978 >> v2:172.21.15.40:3300/0 conn(0x7efc2c06f980 0x7efc2c097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.372+0000 7efc2b7fe700 1 -- 172.21.15.40:0/1971929978 >> v1:172.21.15.40:6789/0 conn(0x7efc2c06fdb0 legacy=0x7efc2c0975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:48.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.372+0000 7efc2b7fe700 1 -- 172.21.15.40:0/1971929978 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2c070de0 con 0x7efc2c06f070 2023-09-30T22:25:48.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.373+0000 7efc2b7fe700 1 --2- 172.21.15.40:0/1971929978 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efc2c06f070 0x7efc2c06f440 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efc1c009950 tx=0x7efc1c009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd34f9d04d28b70a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:48.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.373+0000 7efc2affd700 1 -- 172.21.15.40:0/1971929978 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c009ea0 con 0x7efc2c06f070 2023-09-30T22:25:48.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.373+0000 7efc2affd700 1 -- 172.21.15.40:0/1971929978 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1c004230 con 0x7efc2c06f070 2023-09-30T22:25:48.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.373+0000 7efc2affd700 1 -- 172.21.15.40:0/1971929978 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c00b7e0 con 0x7efc2c06f070 2023-09-30T22:25:48.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.373+0000 7efc3200f700 1 -- 172.21.15.40:0/1971929978 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efc2c06f070 msgr2=0x7efc2c06f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.373+0000 7efc3200f700 1 --2- 172.21.15.40:0/1971929978 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efc2c06f070 0x7efc2c06f440 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efc1c009950 tx=0x7efc1c009c60 comp rx=0 tx=0).stop 2023-09-30T22:25:48.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.373+0000 7efc3200f700 1 -- 172.21.15.40:0/1971929978 shutdown_connections 2023-09-30T22:25:48.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.373+0000 7efc3200f700 1 --2- 172.21.15.40:0/1971929978 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efc2c06f070 0x7efc2c06f440 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.373+0000 7efc3200f700 1 --2- 172.21.15.40:0/1971929978 >> v2:172.21.15.40:3300/0 conn(0x7efc2c06f980 0x7efc2c097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.373+0000 7efc3200f700 1 -- 172.21.15.40:0/1971929978 >> 172.21.15.40:0/1971929978 conn(0x7efc2c0a41a0 msgr2=0x7efc2c0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:48.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.373+0000 7efc3200f700 1 -- 172.21.15.40:0/1971929978 shutdown_connections 2023-09-30T22:25:48.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.373+0000 7efc3200f700 1 -- 172.21.15.40:0/1971929978 wait complete. 2023-09-30T22:25:48.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.374+0000 7efc3200f700 1 Processor -- start 2023-09-30T22:25:48.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.375+0000 7efc3200f700 1 -- start start 2023-09-30T22:25:48.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.375+0000 7efc3200f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc2c06f070 0x7efc2c06c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.375+0000 7efc3200f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efc2c06f980 0x7efc2c06ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.375+0000 7efc3200f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efc2c06fdb0 0x7efc2c06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.375+0000 7efc3200f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c08b810 con 0x7efc2c06f070 2023-09-30T22:25:48.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.375+0000 7efc3200f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c0967b0 con 0x7efc2c06f980 2023-09-30T22:25:48.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.375+0000 7efc3200f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c12c2d0 con 0x7efc2c06fdb0 2023-09-30T22:25:48.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.375+0000 7efc2b7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc2c06f070 0x7efc2c06c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.375+0000 7efc2b7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc2c06f070 0x7efc2c06c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42998/0 (socket says 172.21.15.40:42998) 2023-09-30T22:25:48.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.375+0000 7efc2b7fe700 1 -- 172.21.15.40:0/2331015004 learned_addr learned my addr 172.21.15.40:0/2331015004 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:48.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.375+0000 7efc2bfff700 1 --2- 172.21.15.40:0/2331015004 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efc2c06fdb0 0x7efc2c06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.375+0000 7efc22ffd700 1 --2- 172.21.15.40:0/2331015004 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efc2c06f980 0x7efc2c06ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.375+0000 7efc2b7fe700 1 -- 172.21.15.40:0/2331015004 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efc2c06fdb0 msgr2=0x7efc2c06d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.375+0000 7efc2b7fe700 1 --2- 172.21.15.40:0/2331015004 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efc2c06fdb0 0x7efc2c06d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.376+0000 7efc2b7fe700 1 -- 172.21.15.40:0/2331015004 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efc2c06f980 msgr2=0x7efc2c06ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.376+0000 7efc2b7fe700 1 --2- 172.21.15.40:0/2331015004 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efc2c06f980 0x7efc2c06ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.376+0000 7efc2b7fe700 1 -- 172.21.15.40:0/2331015004 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc1c009550 con 0x7efc2c06f070 2023-09-30T22:25:48.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.376+0000 7efc2b7fe700 1 --2- 172.21.15.40:0/2331015004 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc2c06f070 0x7efc2c06c990 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7efc1c009130 tx=0x7efc1c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:48.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.376+0000 7efc28ff9700 1 -- 172.21.15.40:0/2331015004 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c0038a0 con 0x7efc2c06f070 2023-09-30T22:25:48.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.376+0000 7efc28ff9700 1 -- 172.21.15.40:0/2331015004 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1c003a00 con 0x7efc2c06f070 2023-09-30T22:25:48.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.376+0000 7efc3200f700 1 -- 172.21.15.40:0/2331015004 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc2c08c180 con 0x7efc2c06f070 2023-09-30T22:25:48.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.376+0000 7efc28ff9700 1 -- 172.21.15.40:0/2331015004 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c003db0 con 0x7efc2c06f070 2023-09-30T22:25:48.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.376+0000 7efc3200f700 1 -- 172.21.15.40:0/2331015004 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc2c06de00 con 0x7efc2c06f070 2023-09-30T22:25:48.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.377+0000 7efc28ff9700 1 -- 172.21.15.40:0/2331015004 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efc1c022070 con 0x7efc2c06f070 2023-09-30T22:25:48.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.377+0000 7efc28ff9700 1 -- 172.21.15.40:0/2331015004 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7efc1c041240 con 0x7efc2c06f070 2023-09-30T22:25:48.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.377+0000 7efc3200f700 1 -- 172.21.15.40:0/2331015004 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc2c08b1d0 con 0x7efc2c06f070 2023-09-30T22:25:48.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.382+0000 7efc28ff9700 1 -- 172.21.15.40:0/2331015004 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efc2c08b1d0 con 0x7efc2c06f070 2023-09-30T22:25:48.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.477+0000 7fa66a21c700 1 -- 172.21.15.40:0/1518228413 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa66409f160 con 0x7fa664130fb0 2023-09-30T22:25:48.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.477+0000 7fa64bfff700 1 -- 172.21.15.40:0/1518228413 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa65c007510 con 0x7fa664130fb0 2023-09-30T22:25:48.478 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:48.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.479+0000 7fa66a21c700 1 -- 172.21.15.40:0/1518228413 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa664130fb0 msgr2=0x7fa664121fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.479+0000 7fa66a21c700 1 --2- 172.21.15.40:0/1518228413 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa664130fb0 0x7fa664121fc0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa65c00efc0 tx=0x7fa65c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.480+0000 7fa66a21c700 1 -- 172.21.15.40:0/1518228413 shutdown_connections 2023-09-30T22:25:48.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.480+0000 7fa66a21c700 1 --2- 172.21.15.40:0/1518228413 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa664130fb0 0x7fa664121fc0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.480+0000 7fa66a21c700 1 --2- 172.21.15.40:0/1518228413 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa66409d920 0x7fa664121540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.480+0000 7fa66a21c700 1 --2- 172.21.15.40:0/1518228413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa66409e230 0x7fa664121a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.480+0000 7fa66a21c700 1 -- 172.21.15.40:0/1518228413 >> 172.21.15.40:0/1518228413 conn(0x7fa66409fb20 msgr2=0x7fa66412fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:48.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.480+0000 7fa66a21c700 1 -- 172.21.15.40:0/1518228413 shutdown_connections 2023-09-30T22:25:48.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.480+0000 7fa66a21c700 1 -- 172.21.15.40:0/1518228413 wait complete. 2023-09-30T22:25:48.492 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:48.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.546+0000 7f290f5ef700 1 -- 172.21.15.40:0/1030717563 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2908124e10 con 0x7f290809d920 2023-09-30T22:25:48.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.546+0000 7f28fdffb700 1 -- 172.21.15.40:0/1030717563 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2908124e10 con 0x7f290809d920 2023-09-30T22:25:48.547 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:48.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.548+0000 7f290f5ef700 1 -- 172.21.15.40:0/1030717563 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f290809d920 msgr2=0x7f2908122c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.548+0000 7f290f5ef700 1 --2- 172.21.15.40:0/1030717563 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f290809d920 0x7f2908122c40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f290400e900 tx=0x7f290400ec10 comp rx=0 tx=0).stop 2023-09-30T22:25:48.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.548+0000 7f290f5ef700 1 -- 172.21.15.40:0/1030717563 shutdown_connections 2023-09-30T22:25:48.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.548+0000 7f290f5ef700 1 --2- 172.21.15.40:0/1030717563 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f290809d920 0x7f2908122c40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.548+0000 7f290f5ef700 1 --2- 172.21.15.40:0/1030717563 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29081236c0 0x7f29081c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.548+0000 7f290f5ef700 1 --2- 172.21.15.40:0/1030717563 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2908133ca0 0x7f2908123180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.548+0000 7f290f5ef700 1 -- 172.21.15.40:0/1030717563 >> 172.21.15.40:0/1030717563 conn(0x7f290809fb20 msgr2=0x7f29080a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:48.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.548+0000 7f290f5ef700 1 -- 172.21.15.40:0/1030717563 shutdown_connections 2023-09-30T22:25:48.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.548+0000 7f290f5ef700 1 -- 172.21.15.40:0/1030717563 wait complete. 2023-09-30T22:25:48.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:48.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.581+0000 7efc3200f700 1 -- 172.21.15.40:0/2331015004 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efc2c08b1d0 con 0x7efc2c06f070 2023-09-30T22:25:48.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.581+0000 7efc28ff9700 1 -- 172.21.15.40:0/2331015004 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efc2c08b1d0 con 0x7efc2c06f070 2023-09-30T22:25:48.582 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:48.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.583+0000 7efc3200f700 1 -- 172.21.15.40:0/2331015004 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc2c06f070 msgr2=0x7efc2c06c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.583+0000 7efc3200f700 1 --2- 172.21.15.40:0/2331015004 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc2c06f070 0x7efc2c06c990 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7efc1c009130 tx=0x7efc1c004750 comp rx=0 tx=0).stop 2023-09-30T22:25:48.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.583+0000 7efc3200f700 1 -- 172.21.15.40:0/2331015004 shutdown_connections 2023-09-30T22:25:48.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.583+0000 7efc3200f700 1 --2- 172.21.15.40:0/2331015004 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efc2c06fdb0 0x7efc2c06d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.583+0000 7efc3200f700 1 --2- 172.21.15.40:0/2331015004 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc2c06f070 0x7efc2c06c990 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.583+0000 7efc3200f700 1 --2- 172.21.15.40:0/2331015004 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efc2c06f980 0x7efc2c06ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.583+0000 7efc3200f700 1 -- 172.21.15.40:0/2331015004 >> 172.21.15.40:0/2331015004 conn(0x7efc2c0a41a0 msgr2=0x7efc2c12afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:48.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.584+0000 7efc3200f700 1 -- 172.21.15.40:0/2331015004 shutdown_connections 2023-09-30T22:25:48.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:48.584+0000 7efc3200f700 1 -- 172.21.15.40:0/2331015004 wait complete. 2023-09-30T22:25:48.596 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:49.273 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:49.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.413+0000 7f83c2bbe700 1 Processor -- start 2023-09-30T22:25:49.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.413+0000 7f83c2bbe700 1 -- start start 2023-09-30T22:25:49.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.413+0000 7f83c2bbe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f83bc09fbb0 0x7f83bc06c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.413+0000 7f83c2bbe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83bc06d2c0 0x7f83bc13baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.413+0000 7f83c2bbe700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83bc0a0590 con 0x7f83bc06ced0 2023-09-30T22:25:49.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.414+0000 7f83c2bbe700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc09ff80 con 0x7f83bc06d2c0 2023-09-30T22:25:49.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.414+0000 7f83c2bbe700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc06da80 con 0x7f83bc09fbb0 2023-09-30T22:25:49.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.414+0000 7f83c095a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f83bc09fbb0 0x7f83bc06c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.414+0000 7f83bbfff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f83bc06ced0 0x7f83bc138370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56170/0 (socket says 172.21.15.40:56170) 2023-09-30T22:25:49.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.414+0000 7f83c115b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83bc06d2c0 0x7f83bc13baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.414+0000 7f83bbfff700 1 -- 172.21.15.40:0/3748115415 learned_addr learned my addr 172.21.15.40:0/3748115415 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:49.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.414+0000 7f83bb7fe700 1 -- 172.21.15.40:0/3748115415 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3053777621 0 0) 0x7f83bc0a0590 con 0x7f83bc06ced0 2023-09-30T22:25:49.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.414+0000 7f83c095a700 1 -- 172.21.15.40:0/3748115415 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83bc06d2c0 msgr2=0x7f83bc13baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:49.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.414+0000 7f83c095a700 1 --2- 172.21.15.40:0/3748115415 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83bc06d2c0 0x7f83bc13baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.414+0000 7f83c095a700 1 -- 172.21.15.40:0/3748115415 >> v1:172.21.15.40:6789/0 conn(0x7f83bc06ced0 legacy=0x7f83bc138370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.414+0000 7f83c095a700 1 -- 172.21.15.40:0/3748115415 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83bc0a0780 con 0x7f83bc09fbb0 2023-09-30T22:25:49.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.414+0000 7f83c115b700 1 --2- 172.21.15.40:0/3748115415 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83bc06d2c0 0x7f83bc13baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:49.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.414+0000 7f83c095a700 1 --2- 172.21.15.40:0/3748115415 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f83bc09fbb0 0x7f83bc06c990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009870 tx=0x7f83b0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=231f27a4984b4a60 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:49.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.414+0000 7f83bb7fe700 1 -- 172.21.15.40:0/3748115415 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b0011830 con 0x7f83bc09fbb0 2023-09-30T22:25:49.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.414+0000 7f83bb7fe700 1 -- 172.21.15.40:0/3748115415 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b0011990 con 0x7f83bc09fbb0 2023-09-30T22:25:49.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.414+0000 7f83bb7fe700 1 -- 172.21.15.40:0/3748115415 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b0011d20 con 0x7f83bc09fbb0 2023-09-30T22:25:49.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.415+0000 7f83c2bbe700 1 -- 172.21.15.40:0/3748115415 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f83bc09fbb0 msgr2=0x7f83bc06c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.415+0000 7f83c2bbe700 1 --2- 172.21.15.40:0/3748115415 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f83bc09fbb0 0x7f83bc06c990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009870 tx=0x7f83b0009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:49.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.415+0000 7f83c2bbe700 1 -- 172.21.15.40:0/3748115415 shutdown_connections 2023-09-30T22:25:49.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.415+0000 7f83c2bbe700 1 --2- 172.21.15.40:0/3748115415 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83bc06d2c0 0x7f83bc13baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.415+0000 7f83c2bbe700 1 --2- 172.21.15.40:0/3748115415 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f83bc09fbb0 0x7f83bc06c990 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.415+0000 7f83c2bbe700 1 -- 172.21.15.40:0/3748115415 >> 172.21.15.40:0/3748115415 conn(0x7f83bc0a41a0 msgr2=0x7f83bc0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:49.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.415+0000 7f83c2bbe700 1 -- 172.21.15.40:0/3748115415 shutdown_connections 2023-09-30T22:25:49.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.415+0000 7f83c2bbe700 1 -- 172.21.15.40:0/3748115415 wait complete. 2023-09-30T22:25:49.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.416+0000 7f83c2bbe700 1 Processor -- start 2023-09-30T22:25:49.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.416+0000 7f83c2bbe700 1 -- start start 2023-09-30T22:25:49.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.417+0000 7f83c2bbe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83bc06ced0 0x7f83bc0963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.417+0000 7f83c2bbe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83bc06d2c0 0x7f83bc096920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.417+0000 7f83c2bbe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f83bc09fbb0 0x7f83bc1c8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.417+0000 7f83c2bbe700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc093ba0 con 0x7f83bc06d2c0 2023-09-30T22:25:49.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.417+0000 7f83c2bbe700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc094470 con 0x7f83bc06ced0 2023-09-30T22:25:49.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.417+0000 7f83c2bbe700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc071770 con 0x7f83bc09fbb0 2023-09-30T22:25:49.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.417+0000 7f83c095a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83bc06ced0 0x7f83bc0963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.417+0000 7f83bbfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83bc06d2c0 0x7f83bc096920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.417+0000 7f83c095a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83bc06ced0 0x7f83bc0963e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53150/0 (socket says 172.21.15.40:53150) 2023-09-30T22:25:49.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.417+0000 7f83c095a700 1 -- 172.21.15.40:0/1091844499 learned_addr learned my addr 172.21.15.40:0/1091844499 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:49.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.417+0000 7f83c115b700 1 --2- 172.21.15.40:0/1091844499 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f83bc09fbb0 0x7f83bc1c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.417+0000 7f83c095a700 1 -- 172.21.15.40:0/1091844499 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f83bc09fbb0 msgr2=0x7f83bc1c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.417+0000 7f83c095a700 1 --2- 172.21.15.40:0/1091844499 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f83bc09fbb0 0x7f83bc1c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.417+0000 7f83c095a700 1 -- 172.21.15.40:0/1091844499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83bc06d2c0 msgr2=0x7f83bc096920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.417+0000 7f83c095a700 1 --2- 172.21.15.40:0/1091844499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83bc06d2c0 0x7f83bc096920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.417+0000 7f83c095a700 1 -- 172.21.15.40:0/1091844499 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b4009a70 con 0x7f83bc06ced0 2023-09-30T22:25:49.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.417+0000 7f83c095a700 1 --2- 172.21.15.40:0/1091844499 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83bc06ced0 0x7f83bc0963e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009840 tx=0x7f83b0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:49.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.417+0000 7f83b97fa700 1 -- 172.21.15.40:0/1091844499 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b00044d0 con 0x7f83bc06ced0 2023-09-30T22:25:49.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.417+0000 7f83b97fa700 1 -- 172.21.15.40:0/1091844499 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b00036a0 con 0x7f83bc06ced0 2023-09-30T22:25:49.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.417+0000 7f83c2bbe700 1 -- 172.21.15.40:0/1091844499 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b00094a0 con 0x7f83bc06ced0 2023-09-30T22:25:49.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.417+0000 7f83b97fa700 1 -- 172.21.15.40:0/1091844499 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b0003a50 con 0x7f83bc06ced0 2023-09-30T22:25:49.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.417+0000 7f83c2bbe700 1 -- 172.21.15.40:0/1091844499 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83bc06df90 con 0x7f83bc06ced0 2023-09-30T22:25:49.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.418+0000 7f83b97fa700 1 -- 172.21.15.40:0/1091844499 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f83b0003bb0 con 0x7f83bc06ced0 2023-09-30T22:25:49.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.418+0000 7f83b97fa700 1 -- 172.21.15.40:0/1091844499 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f83b00408a0 con 0x7f83bc06ced0 2023-09-30T22:25:49.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.418+0000 7f83c2bbe700 1 -- 172.21.15.40:0/1091844499 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83bc062380 con 0x7f83bc06ced0 2023-09-30T22:25:49.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.423+0000 7f83b97fa700 1 -- 172.21.15.40:0/1091844499 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f83b0015070 con 0x7f83bc06ced0 2023-09-30T22:25:49.493 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:49.562 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:49.597 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:49.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.630+0000 7f10b1584700 1 Processor -- start 2023-09-30T22:25:49.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.630+0000 7f10b1584700 1 -- start start 2023-09-30T22:25:49.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.631+0000 7f10b1584700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ac12e590 0x7f10ac12e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.631+0000 7f10b1584700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f10ac12eea0 0x7f10ac12d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.631+0000 7f10b1584700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10ac09ab70 con 0x7f10ac12d6d0 2023-09-30T22:25:49.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.631+0000 7f10b1584700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10ac09b270 con 0x7f10ac12eea0 2023-09-30T22:25:49.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.631+0000 7f10b1584700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10ac09bab0 con 0x7f10ac12e590 2023-09-30T22:25:49.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.631+0000 7f10aa7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f10ac12eea0 0x7f10ac12d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.631+0000 7f10aa7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f10ac12eea0 0x7f10ac12d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43008/0 (socket says 172.21.15.40:43008) 2023-09-30T22:25:49.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.631+0000 7f10aa7fc700 1 -- 172.21.15.40:0/2929385781 learned_addr learned my addr 172.21.15.40:0/2929385781 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:49.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.631+0000 7f10aaffd700 1 --2- 172.21.15.40:0/2929385781 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ac12e590 0x7f10ac12e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.632+0000 7f83c2bbe700 1 -- 172.21.15.40:0/1091844499 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f83bc071230 con 0x7f83bc06ced0 2023-09-30T22:25:49.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.632+0000 7f10aaffd700 1 -- 172.21.15.40:0/2929385781 >> v2:172.21.15.40:3300/0 conn(0x7f10ac12eea0 msgr2=0x7f10ac12d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:49.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.632+0000 7f10aaffd700 1 --2- 172.21.15.40:0/2929385781 >> v2:172.21.15.40:3300/0 conn(0x7f10ac12eea0 0x7f10ac12d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.632+0000 7f10aaffd700 1 -- 172.21.15.40:0/2929385781 >> v1:172.21.15.40:6789/0 conn(0x7f10ac12d6d0 legacy=0x7f10ac137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.632+0000 7f10aaffd700 1 -- 172.21.15.40:0/2929385781 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ac09bd70 con 0x7f10ac12e590 2023-09-30T22:25:49.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.632+0000 7f10aaffd700 1 --2- 172.21.15.40:0/2929385781 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ac12e590 0x7f10ac12e960 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f109c00bb10 tx=0x7f109c00be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78aa88fa25658bee server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:49.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.632+0000 7f10a9ffb700 1 -- 172.21.15.40:0/2929385781 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c00dc30 con 0x7f10ac12e590 2023-09-30T22:25:49.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.632+0000 7f10a9ffb700 1 -- 172.21.15.40:0/2929385781 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109c00dd90 con 0x7f10ac12e590 2023-09-30T22:25:49.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.632+0000 7f10a9ffb700 1 -- 172.21.15.40:0/2929385781 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c012990 con 0x7f10ac12e590 2023-09-30T22:25:49.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.632+0000 7f83b97fa700 1 -- 172.21.15.40:0/1091844499 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f83b002e970 con 0x7f83bc06ced0 2023-09-30T22:25:49.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.633+0000 7f10b1584700 1 -- 172.21.15.40:0/2929385781 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ac12e590 msgr2=0x7f10ac12e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.633+0000 7f10b1584700 1 --2- 172.21.15.40:0/2929385781 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ac12e590 0x7f10ac12e960 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f109c00bb10 tx=0x7f109c00be20 comp rx=0 tx=0).stop 2023-09-30T22:25:49.635 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:49.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.633+0000 7f10b1584700 1 -- 172.21.15.40:0/2929385781 shutdown_connections 2023-09-30T22:25:49.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.633+0000 7f10b1584700 1 --2- 172.21.15.40:0/2929385781 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ac12e590 0x7f10ac12e960 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.633+0000 7f10b1584700 1 --2- 172.21.15.40:0/2929385781 >> v2:172.21.15.40:3300/0 conn(0x7f10ac12eea0 0x7f10ac12d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.633+0000 7f10b1584700 1 -- 172.21.15.40:0/2929385781 >> 172.21.15.40:0/2929385781 conn(0x7f10ac0a2a00 msgr2=0x7f10ac0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:49.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.633+0000 7f10b1584700 1 -- 172.21.15.40:0/2929385781 shutdown_connections 2023-09-30T22:25:49.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.633+0000 7f10b1584700 1 -- 172.21.15.40:0/2929385781 wait complete. 2023-09-30T22:25:49.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.635+0000 7f10b1584700 1 Processor -- start 2023-09-30T22:25:49.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.635+0000 7f10b1584700 1 -- start start 2023-09-30T22:25:49.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.635+0000 7f83c2bbe700 1 -- 172.21.15.40:0/1091844499 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83bc06ced0 msgr2=0x7f83bc0963e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.635+0000 7f83c2bbe700 1 --2- 172.21.15.40:0/1091844499 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83bc06ced0 0x7f83bc0963e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009840 tx=0x7f83b0004750 comp rx=0 tx=0).stop 2023-09-30T22:25:49.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.635+0000 7f83c2bbe700 1 -- 172.21.15.40:0/1091844499 shutdown_connections 2023-09-30T22:25:49.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.635+0000 7f83c2bbe700 1 --2- 172.21.15.40:0/1091844499 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f83bc09fbb0 0x7f83bc1c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.635+0000 7f83c2bbe700 1 --2- 172.21.15.40:0/1091844499 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83bc06ced0 0x7f83bc0963e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.635+0000 7f83c2bbe700 1 --2- 172.21.15.40:0/1091844499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83bc06d2c0 0x7f83bc096920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.635+0000 7f83c2bbe700 1 -- 172.21.15.40:0/1091844499 >> 172.21.15.40:0/1091844499 conn(0x7f83bc0a41a0 msgr2=0x7f83bc0a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:49.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.635+0000 7f83c2bbe700 1 -- 172.21.15.40:0/1091844499 shutdown_connections 2023-09-30T22:25:49.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.635+0000 7f83c2bbe700 1 -- 172.21.15.40:0/1091844499 wait complete. 2023-09-30T22:25:49.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.635+0000 7f10b1584700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ac12d6d0 0x7f10ac11aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.635+0000 7f10b1584700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10ac12e590 0x7f10ac11aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.635+0000 7f10b1584700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10ac12eea0 0x7f10ac11b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.635+0000 7f10b1584700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ac11bf80 con 0x7f10ac12e590 2023-09-30T22:25:49.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.635+0000 7f10b1584700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10ac12ce90 con 0x7f10ac12d6d0 2023-09-30T22:25:49.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.636+0000 7f10b1584700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10ac11d910 con 0x7f10ac12eea0 2023-09-30T22:25:49.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.636+0000 7f10aaffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ac12d6d0 0x7f10ac11aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.636+0000 7f10aaffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ac12d6d0 0x7f10ac11aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53178/0 (socket says 172.21.15.40:53178) 2023-09-30T22:25:49.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.636+0000 7f10aaffd700 1 -- 172.21.15.40:0/3332839251 learned_addr learned my addr 172.21.15.40:0/3332839251 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:49.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.636+0000 7f10ab7fe700 1 --2- 172.21.15.40:0/3332839251 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10ac12eea0 0x7f10ac11b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.636+0000 7f10aa7fc700 1 --2- 172.21.15.40:0/3332839251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10ac12e590 0x7f10ac11aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.636+0000 7f10aa7fc700 1 -- 172.21.15.40:0/3332839251 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10ac12eea0 msgr2=0x7f10ac11b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.636+0000 7f10aa7fc700 1 --2- 172.21.15.40:0/3332839251 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10ac12eea0 0x7f10ac11b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.636+0000 7f10aa7fc700 1 -- 172.21.15.40:0/3332839251 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ac12d6d0 msgr2=0x7f10ac11aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.636+0000 7f10aa7fc700 1 --2- 172.21.15.40:0/3332839251 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ac12d6d0 0x7f10ac11aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.636+0000 7f10aa7fc700 1 -- 172.21.15.40:0/3332839251 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f109c00b740 con 0x7f10ac12e590 2023-09-30T22:25:49.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.636+0000 7f10aaffd700 1 --2- 172.21.15.40:0/3332839251 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ac12d6d0 0x7f10ac11aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:49.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.636+0000 7f10aa7fc700 1 --2- 172.21.15.40:0/3332839251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10ac12e590 0x7f10ac11aff0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f10a000e8e0 tx=0x7f10a000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:49.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.637+0000 7f10937fe700 1 -- 172.21.15.40:0/3332839251 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a0013680 con 0x7f10ac12e590 2023-09-30T22:25:49.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.637+0000 7f10937fe700 1 -- 172.21.15.40:0/3332839251 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a00137e0 con 0x7f10ac12e590 2023-09-30T22:25:49.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.637+0000 7f10937fe700 1 -- 172.21.15.40:0/3332839251 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a0013b50 con 0x7f10ac12e590 2023-09-30T22:25:49.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.637+0000 7f10b1584700 1 -- 172.21.15.40:0/3332839251 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10ac09cdb0 con 0x7f10ac12e590 2023-09-30T22:25:49.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.637+0000 7f10b1584700 1 -- 172.21.15.40:0/3332839251 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10ac11dd60 con 0x7f10ac12e590 2023-09-30T22:25:49.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.638+0000 7f10937fe700 1 -- 172.21.15.40:0/3332839251 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f10a0013cb0 con 0x7f10ac12e590 2023-09-30T22:25:49.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.638+0000 7f10937fe700 1 -- 172.21.15.40:0/3332839251 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f10a003f640 con 0x7f10ac12e590 2023-09-30T22:25:49.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.638+0000 7f10b1584700 1 -- 172.21.15.40:0/3332839251 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10ac09dff0 con 0x7f10ac12e590 2023-09-30T22:25:49.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.643+0000 7f10937fe700 1 -- 172.21.15.40:0/3332839251 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f10a001bde0 con 0x7f10ac12e590 2023-09-30T22:25:49.651 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:49.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.697+0000 7f67174a7700 1 Processor -- start 2023-09-30T22:25:49.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.697+0000 7f67174a7700 1 -- start start 2023-09-30T22:25:49.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.698+0000 7f67174a7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f671009d920 0x7f671009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.698+0000 7f67174a7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f671009e230 0x7f67101343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.698+0000 7f67174a7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f671009f940 con 0x7f671009f0f0 2023-09-30T22:25:49.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.698+0000 7f67174a7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f671006b4c0 con 0x7f671009d920 2023-09-30T22:25:49.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.698+0000 7f67174a7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f671009a8f0 con 0x7f671009e230 2023-09-30T22:25:49.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.698+0000 7f6715a44700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f671009e230 0x7f67101343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.698+0000 7f6715243700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f671009d920 0x7f671009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.698+0000 7f6715243700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f671009d920 0x7f671009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43034/0 (socket says 172.21.15.40:43034) 2023-09-30T22:25:49.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.698+0000 7f6715a44700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f671009e230 0x7f67101343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53194/0 (socket says 172.21.15.40:53194) 2023-09-30T22:25:49.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.698+0000 7f6715243700 1 -- 172.21.15.40:0/2920078325 learned_addr learned my addr 172.21.15.40:0/2920078325 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:49.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.698+0000 7f6715243700 1 -- 172.21.15.40:0/2920078325 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f671009e230 msgr2=0x7f67101343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:49.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.698+0000 7f6715243700 1 --2- 172.21.15.40:0/2920078325 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f671009e230 0x7f67101343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.698+0000 7f6715243700 1 -- 172.21.15.40:0/2920078325 >> v1:172.21.15.40:6789/0 conn(0x7f671009f0f0 legacy=0x7f6710133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.698+0000 7f6715243700 1 -- 172.21.15.40:0/2920078325 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f671009f6e0 con 0x7f671009d920 2023-09-30T22:25:49.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.698+0000 7f6715243700 1 --2- 172.21.15.40:0/2920078325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f671009d920 0x7f671009dcf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f670c006fd0 tx=0x7f670c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b12a299dc9a3920 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:49.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.699+0000 7f6707fff700 1 -- 172.21.15.40:0/2920078325 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c005e30 con 0x7f671009d920 2023-09-30T22:25:49.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.699+0000 7f6707fff700 1 -- 172.21.15.40:0/2920078325 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670c004030 con 0x7f671009d920 2023-09-30T22:25:49.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.699+0000 7f6707fff700 1 -- 172.21.15.40:0/2920078325 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c0043e0 con 0x7f671009d920 2023-09-30T22:25:49.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.699+0000 7f67174a7700 1 -- 172.21.15.40:0/2920078325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f671009d920 msgr2=0x7f671009dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.699+0000 7f67174a7700 1 --2- 172.21.15.40:0/2920078325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f671009d920 0x7f671009dcf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f670c006fd0 tx=0x7f670c009bd0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.699+0000 7f67174a7700 1 -- 172.21.15.40:0/2920078325 shutdown_connections 2023-09-30T22:25:49.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.699+0000 7f67174a7700 1 --2- 172.21.15.40:0/2920078325 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f671009e230 0x7f67101343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.699+0000 7f67174a7700 1 --2- 172.21.15.40:0/2920078325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f671009d920 0x7f671009dcf0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.699+0000 7f67174a7700 1 -- 172.21.15.40:0/2920078325 >> 172.21.15.40:0/2920078325 conn(0x7f671009fb20 msgr2=0x7f671009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:49.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.699+0000 7f67174a7700 1 -- 172.21.15.40:0/2920078325 shutdown_connections 2023-09-30T22:25:49.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.699+0000 7f67174a7700 1 -- 172.21.15.40:0/2920078325 wait complete. 2023-09-30T22:25:49.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.700+0000 7f67174a7700 1 Processor -- start 2023-09-30T22:25:49.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.700+0000 7f67174a7700 1 -- start start 2023-09-30T22:25:49.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.701+0000 7f67174a7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f671009d920 0x7f67101a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.701+0000 7f67174a7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f671009e230 0x7f67101a67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.701+0000 7f67174a7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67101a6ce0 0x7f67101ced60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.701+0000 7f67174a7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67101a7730 con 0x7f671009e230 2023-09-30T22:25:49.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.701+0000 7f67174a7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67101a9d80 con 0x7f67101a6ce0 2023-09-30T22:25:49.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.701+0000 7f67174a7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67101a9150 con 0x7f671009d920 2023-09-30T22:25:49.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.701+0000 7f6715243700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f671009d920 0x7f67101a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.701+0000 7f6715243700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f671009d920 0x7f67101a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33960/0 (socket says 172.21.15.40:33960) 2023-09-30T22:25:49.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.701+0000 7f6715243700 1 -- 172.21.15.40:0/2710721628 learned_addr learned my addr 172.21.15.40:0/2710721628 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:49.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.701+0000 7f6714a42700 1 --2- 172.21.15.40:0/2710721628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f671009e230 0x7f67101a67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.701+0000 7f6715a44700 1 --2- 172.21.15.40:0/2710721628 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67101a6ce0 0x7f67101ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.701+0000 7f6715a44700 1 -- 172.21.15.40:0/2710721628 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f671009d920 msgr2=0x7f67101a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.701+0000 7f6715a44700 1 --2- 172.21.15.40:0/2710721628 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f671009d920 0x7f67101a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.701+0000 7f6715a44700 1 -- 172.21.15.40:0/2710721628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f671009e230 msgr2=0x7f67101a67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.701+0000 7f6715a44700 1 --2- 172.21.15.40:0/2710721628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f671009e230 0x7f67101a67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.701+0000 7f6715a44700 1 -- 172.21.15.40:0/2710721628 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670c009500 con 0x7f67101a6ce0 2023-09-30T22:25:49.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.702+0000 7f6714a42700 1 --2- 172.21.15.40:0/2710721628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f671009e230 0x7f67101a67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:49.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.702+0000 7f6715a44700 1 --2- 172.21.15.40:0/2710721628 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67101a6ce0 0x7f67101ced60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6708009d90 tx=0x7f670800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:49.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.702+0000 7f6705ffb700 1 -- 172.21.15.40:0/2710721628 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6708009c00 con 0x7f67101a6ce0 2023-09-30T22:25:49.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.702+0000 7f6705ffb700 1 -- 172.21.15.40:0/2710721628 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670800f040 con 0x7f67101a6ce0 2023-09-30T22:25:49.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.702+0000 7f67174a7700 1 -- 172.21.15.40:0/2710721628 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67101a8450 con 0x7f67101a6ce0 2023-09-30T22:25:49.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.702+0000 7f6705ffb700 1 -- 172.21.15.40:0/2710721628 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6708014480 con 0x7f67101a6ce0 2023-09-30T22:25:49.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.702+0000 7f67174a7700 1 -- 172.21.15.40:0/2710721628 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f671009c9e0 con 0x7f67101a6ce0 2023-09-30T22:25:49.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.703+0000 7f6705ffb700 1 -- 172.21.15.40:0/2710721628 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f67080145e0 con 0x7f67101a6ce0 2023-09-30T22:25:49.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.703+0000 7f6705ffb700 1 -- 172.21.15.40:0/2710721628 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6708040200 con 0x7f67101a6ce0 2023-09-30T22:25:49.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.703+0000 7f67174a7700 1 -- 172.21.15.40:0/2710721628 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67101a9740 con 0x7f67101a6ce0 2023-09-30T22:25:49.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.712+0000 7f6705ffb700 1 -- 172.21.15.40:0/2710721628 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f67101a9740 con 0x7f67101a6ce0 2023-09-30T22:25:49.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.742+0000 7f21dc463700 1 Processor -- start 2023-09-30T22:25:49.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.743+0000 7f21dc463700 1 -- start start 2023-09-30T22:25:49.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.743+0000 7f21dc463700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f21d4099510 0x7f21d40998e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.743+0000 7f21dc463700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f21d4099e20 0x7f21d4130160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.743+0000 7f21dc463700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d409a630 con 0x7f21d41306a0 2023-09-30T22:25:49.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.743+0000 7f21dc463700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d409a950 con 0x7f21d4099510 2023-09-30T22:25:49.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.743+0000 7f21dc463700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21d409ba50 con 0x7f21d4099e20 2023-09-30T22:25:49.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.743+0000 7f21da1ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f21d4099510 0x7f21d40998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.743+0000 7f21da1ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f21d4099510 0x7f21d40998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43058/0 (socket says 172.21.15.40:43058) 2023-09-30T22:25:49.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.743+0000 7f21da1ff700 1 -- 172.21.15.40:0/3526145460 learned_addr learned my addr 172.21.15.40:0/3526145460 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:49.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.743+0000 7f21d99fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f21d4099e20 0x7f21d4130160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.743+0000 7f21daa00700 1 --1- 172.21.15.40:0/3526145460 >> v1:172.21.15.40:6789/0 conn(0x7f21d41306a0 0x7f21d41373b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56206/0 (socket says 172.21.15.40:56206) 2023-09-30T22:25:49.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.744+0000 7f21d99fe700 1 -- 172.21.15.40:0/3526145460 >> v2:172.21.15.40:3300/0 conn(0x7f21d4099510 msgr2=0x7f21d40998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:49.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.744+0000 7f21d99fe700 1 --2- 172.21.15.40:0/3526145460 >> v2:172.21.15.40:3300/0 conn(0x7f21d4099510 0x7f21d40998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.744+0000 7f21d99fe700 1 -- 172.21.15.40:0/3526145460 >> v1:172.21.15.40:6789/0 conn(0x7f21d41306a0 legacy=0x7f21d41373b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.744+0000 7f21d99fe700 1 -- 172.21.15.40:0/3526145460 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d409b7a0 con 0x7f21d4099e20 2023-09-30T22:25:49.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.744+0000 7f21da1ff700 1 --2- 172.21.15.40:0/3526145460 >> v2:172.21.15.40:3300/0 conn(0x7f21d4099510 0x7f21d40998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:49.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.744+0000 7f21d99fe700 1 --2- 172.21.15.40:0/3526145460 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f21d4099e20 0x7f21d4130160 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f21c4009840 tx=0x7f21c4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b246145b64af7901 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:49.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.744+0000 7f21d91fd700 1 -- 172.21.15.40:0/3526145460 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c4011830 con 0x7f21d4099e20 2023-09-30T22:25:49.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.744+0000 7f21d91fd700 1 -- 172.21.15.40:0/3526145460 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c4011990 con 0x7f21d4099e20 2023-09-30T22:25:49.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.744+0000 7f21d91fd700 1 -- 172.21.15.40:0/3526145460 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c4011d20 con 0x7f21d4099e20 2023-09-30T22:25:49.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.745+0000 7f21dc463700 1 -- 172.21.15.40:0/3526145460 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f21d4099e20 msgr2=0x7f21d4130160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.745+0000 7f21dc463700 1 --2- 172.21.15.40:0/3526145460 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f21d4099e20 0x7f21d4130160 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f21c4009840 tx=0x7f21c4009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:49.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.745+0000 7f21dc463700 1 -- 172.21.15.40:0/3526145460 shutdown_connections 2023-09-30T22:25:49.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.745+0000 7f21dc463700 1 --2- 172.21.15.40:0/3526145460 >> v2:172.21.15.40:3300/0 conn(0x7f21d4099510 0x7f21d40998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.745+0000 7f21dc463700 1 --2- 172.21.15.40:0/3526145460 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f21d4099e20 0x7f21d4130160 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.745+0000 7f21dc463700 1 -- 172.21.15.40:0/3526145460 >> 172.21.15.40:0/3526145460 conn(0x7f21d409eb10 msgr2=0x7f21d409ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:49.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.745+0000 7f21dc463700 1 -- 172.21.15.40:0/3526145460 shutdown_connections 2023-09-30T22:25:49.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.745+0000 7f21dc463700 1 -- 172.21.15.40:0/3526145460 wait complete. 2023-09-30T22:25:49.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.746+0000 7f21dc463700 1 Processor -- start 2023-09-30T22:25:49.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.746+0000 7f21dc463700 1 -- start start 2023-09-30T22:25:49.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.746+0000 7f21dc463700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21d4099510 0x7f21d4097530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.746+0000 7f21dc463700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f21d4099e20 0x7f21d4097a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.746+0000 7f21dc463700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f21d41306a0 0x7f21d4097fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.746+0000 7f21dc463700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d413ae70 con 0x7f21d4099510 2023-09-30T22:25:49.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.746+0000 7f21dc463700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d413ac80 con 0x7f21d4099e20 2023-09-30T22:25:49.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.746+0000 7f21dc463700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21d413b550 con 0x7f21d41306a0 2023-09-30T22:25:49.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.747+0000 7f21d99fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f21d4099e20 0x7f21d4097a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.747+0000 7f21daa00700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f21d41306a0 0x7f21d4097fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.747+0000 7f21da1ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21d4099510 0x7f21d4097530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.747+0000 7f21d99fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f21d4099e20 0x7f21d4097a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53206/0 (socket says 172.21.15.40:53206) 2023-09-30T22:25:49.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.747+0000 7f21d99fe700 1 -- 172.21.15.40:0/2358356030 learned_addr learned my addr 172.21.15.40:0/2358356030 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:49.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.747+0000 7f21da1ff700 1 -- 172.21.15.40:0/2358356030 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f21d41306a0 msgr2=0x7f21d4097fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.747+0000 7f21da1ff700 1 --2- 172.21.15.40:0/2358356030 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f21d41306a0 0x7f21d4097fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.747+0000 7f21da1ff700 1 -- 172.21.15.40:0/2358356030 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f21d4099e20 msgr2=0x7f21d4097a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.747+0000 7f21da1ff700 1 --2- 172.21.15.40:0/2358356030 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f21d4099e20 0x7f21d4097a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.747+0000 7f21da1ff700 1 -- 172.21.15.40:0/2358356030 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d0009500 con 0x7f21d4099510 2023-09-30T22:25:49.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.747+0000 7f21daa00700 1 --2- 172.21.15.40:0/2358356030 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f21d41306a0 0x7f21d4097fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:49.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.747+0000 7f21da1ff700 1 --2- 172.21.15.40:0/2358356030 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21d4099510 0x7f21d4097530 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f21d000ebe0 tx=0x7f21d000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:49.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.747+0000 7f21caffd700 1 -- 172.21.15.40:0/2358356030 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d0005a20 con 0x7f21d4099510 2023-09-30T22:25:49.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.747+0000 7f21caffd700 1 -- 172.21.15.40:0/2358356030 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d0005b80 con 0x7f21d4099510 2023-09-30T22:25:49.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.747+0000 7f21dc463700 1 -- 172.21.15.40:0/2358356030 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c40094a0 con 0x7f21d4099510 2023-09-30T22:25:49.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.747+0000 7f21caffd700 1 -- 172.21.15.40:0/2358356030 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d000c850 con 0x7f21d4099510 2023-09-30T22:25:49.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.747+0000 7f21dc463700 1 -- 172.21.15.40:0/2358356030 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d4098930 con 0x7f21d4099510 2023-09-30T22:25:49.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.748+0000 7f21caffd700 1 -- 172.21.15.40:0/2358356030 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f21d000c9b0 con 0x7f21d4099510 2023-09-30T22:25:49.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.748+0000 7f21caffd700 1 -- 172.21.15.40:0/2358356030 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f21d003f970 con 0x7f21d4099510 2023-09-30T22:25:49.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.749+0000 7f21dc463700 1 -- 172.21.15.40:0/2358356030 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d413c530 con 0x7f21d4099510 2023-09-30T22:25:49.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.753+0000 7f21caffd700 1 -- 172.21.15.40:0/2358356030 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f21d413c530 con 0x7f21d4099510 2023-09-30T22:25:49.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.877+0000 7f10b1584700 1 -- 172.21.15.40:0/3332839251 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f10ac09b4b0 con 0x7f10ac12e590 2023-09-30T22:25:49.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.877+0000 7f10937fe700 1 -- 172.21.15.40:0/3332839251 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f10a0017030 con 0x7f10ac12e590 2023-09-30T22:25:49.878 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:49.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.879+0000 7f10b1584700 1 -- 172.21.15.40:0/3332839251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10ac12e590 msgr2=0x7f10ac11aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.879+0000 7f10b1584700 1 --2- 172.21.15.40:0/3332839251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10ac12e590 0x7f10ac11aff0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f10a000e8e0 tx=0x7f10a000ebf0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.879+0000 7f10b1584700 1 -- 172.21.15.40:0/3332839251 shutdown_connections 2023-09-30T22:25:49.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.879+0000 7f10b1584700 1 --2- 172.21.15.40:0/3332839251 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10ac12eea0 0x7f10ac11b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.879+0000 7f10b1584700 1 --2- 172.21.15.40:0/3332839251 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ac12d6d0 0x7f10ac11aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.879+0000 7f10b1584700 1 --2- 172.21.15.40:0/3332839251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10ac12e590 0x7f10ac11aff0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.879+0000 7f10b1584700 1 -- 172.21.15.40:0/3332839251 >> 172.21.15.40:0/3332839251 conn(0x7f10ac0a2a00 msgr2=0x7f10ac099a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:49.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.880+0000 7f10b1584700 1 -- 172.21.15.40:0/3332839251 shutdown_connections 2023-09-30T22:25:49.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.880+0000 7f10b1584700 1 -- 172.21.15.40:0/3332839251 wait complete. 2023-09-30T22:25:49.897 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:49.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.909+0000 7f67174a7700 1 -- 172.21.15.40:0/2710721628 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f67101a9740 con 0x7f67101a6ce0 2023-09-30T22:25:49.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.910+0000 7f6705ffb700 1 -- 172.21.15.40:0/2710721628 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f67101a9740 con 0x7f67101a6ce0 2023-09-30T22:25:49.910 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:49.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.912+0000 7f67174a7700 1 -- 172.21.15.40:0/2710721628 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67101a6ce0 msgr2=0x7f67101ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.912+0000 7f67174a7700 1 --2- 172.21.15.40:0/2710721628 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67101a6ce0 0x7f67101ced60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6708009d90 tx=0x7f670800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.912+0000 7f67174a7700 1 -- 172.21.15.40:0/2710721628 shutdown_connections 2023-09-30T22:25:49.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.912+0000 7f67174a7700 1 --2- 172.21.15.40:0/2710721628 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f671009d920 0x7f67101a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.912+0000 7f67174a7700 1 --2- 172.21.15.40:0/2710721628 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67101a6ce0 0x7f67101ced60 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.912+0000 7f67174a7700 1 --2- 172.21.15.40:0/2710721628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f671009e230 0x7f67101a67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.912+0000 7f67174a7700 1 -- 172.21.15.40:0/2710721628 >> 172.21.15.40:0/2710721628 conn(0x7f671009fb20 msgr2=0x7f67101bb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:49.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.912+0000 7f67174a7700 1 -- 172.21.15.40:0/2710721628 shutdown_connections 2023-09-30T22:25:49.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.912+0000 7f67174a7700 1 -- 172.21.15.40:0/2710721628 wait complete. 2023-09-30T22:25:49.925 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:49.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.988+0000 7f21dc463700 1 -- 172.21.15.40:0/2358356030 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f21d413c530 con 0x7f21d4099510 2023-09-30T22:25:49.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.988+0000 7f21caffd700 1 -- 172.21.15.40:0/2358356030 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f21d0020080 con 0x7f21d4099510 2023-09-30T22:25:49.990 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:49.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.991+0000 7f21dc463700 1 -- 172.21.15.40:0/2358356030 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21d4099510 msgr2=0x7f21d4097530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.991+0000 7f21dc463700 1 --2- 172.21.15.40:0/2358356030 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21d4099510 0x7f21d4097530 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f21d000ebe0 tx=0x7f21d000eef0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.991+0000 7f21dc463700 1 -- 172.21.15.40:0/2358356030 shutdown_connections 2023-09-30T22:25:49.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.991+0000 7f21dc463700 1 --2- 172.21.15.40:0/2358356030 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f21d41306a0 0x7f21d4097fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.991+0000 7f21dc463700 1 --2- 172.21.15.40:0/2358356030 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21d4099510 0x7f21d4097530 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.991+0000 7f21dc463700 1 --2- 172.21.15.40:0/2358356030 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f21d4099e20 0x7f21d4097a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.991+0000 7f21dc463700 1 -- 172.21.15.40:0/2358356030 >> 172.21.15.40:0/2358356030 conn(0x7f21d409eb10 msgr2=0x7f21d406e180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:49.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.991+0000 7f21dc463700 1 -- 172.21.15.40:0/2358356030 shutdown_connections 2023-09-30T22:25:49.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:49.991+0000 7f21dc463700 1 -- 172.21.15.40:0/2358356030 wait complete. 2023-09-30T22:25:50.003 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:50.652 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:50.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.790+0000 7fa8ba451700 1 Processor -- start 2023-09-30T22:25:50.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.790+0000 7fa8ba451700 1 -- start start 2023-09-30T22:25:50.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.790+0000 7fa8ba451700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa8b4136bf0 0x7fa8b4138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:50.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.790+0000 7fa8ba451700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa8b4139510 0x7fa8b413b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:50.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.790+0000 7fa8ba451700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b40a2600 con 0x7fa8b409c890 2023-09-30T22:25:50.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.790+0000 7fa8ba451700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b40a29d0 con 0x7fa8b4136bf0 2023-09-30T22:25:50.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.790+0000 7fa8ba451700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b409fb40 con 0x7fa8b4139510 2023-09-30T22:25:50.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.790+0000 7fa8b89ee700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa8b4139510 0x7fa8b413b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:50.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.790+0000 7fa8b37fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa8b4136bf0 0x7fa8b4138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:50.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.790+0000 7fa8b89ee700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa8b4139510 0x7fa8b413b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33990/0 (socket says 172.21.15.40:33990) 2023-09-30T22:25:50.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.790+0000 7fa8b89ee700 1 -- 172.21.15.40:0/1516152162 learned_addr learned my addr 172.21.15.40:0/1516152162 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:50.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.791+0000 7fa8b89ee700 1 -- 172.21.15.40:0/1516152162 >> v2:172.21.15.40:3300/0 conn(0x7fa8b4136bf0 msgr2=0x7fa8b4138fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:50.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.791+0000 7fa8b89ee700 1 --2- 172.21.15.40:0/1516152162 >> v2:172.21.15.40:3300/0 conn(0x7fa8b4136bf0 0x7fa8b4138fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:50.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.791+0000 7fa8b89ee700 1 -- 172.21.15.40:0/1516152162 >> v1:172.21.15.40:6789/0 conn(0x7fa8b409c890 legacy=0x7fa8b409cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:50.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.791+0000 7fa8b89ee700 1 -- 172.21.15.40:0/1516152162 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b409d370 con 0x7fa8b4139510 2023-09-30T22:25:50.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.791+0000 7fa8b37fe700 1 --2- 172.21.15.40:0/1516152162 >> v2:172.21.15.40:3300/0 conn(0x7fa8b4136bf0 0x7fa8b4138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:50.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.791+0000 7fa8b89ee700 1 --2- 172.21.15.40:0/1516152162 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa8b4139510 0x7fa8b413b8f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac009e50 tx=0x7fa8ac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d4e9426ce877a0c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:50.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.791+0000 7fa8b2ffd700 1 -- 172.21.15.40:0/1516152162 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac00e070 con 0x7fa8b4139510 2023-09-30T22:25:50.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.791+0000 7fa8b2ffd700 1 -- 172.21.15.40:0/1516152162 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ac00b910 con 0x7fa8b4139510 2023-09-30T22:25:50.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.791+0000 7fa8b2ffd700 1 -- 172.21.15.40:0/1516152162 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac00bcc0 con 0x7fa8b4139510 2023-09-30T22:25:50.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.791+0000 7fa8ba451700 1 -- 172.21.15.40:0/1516152162 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa8b4139510 msgr2=0x7fa8b413b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:50.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.791+0000 7fa8ba451700 1 --2- 172.21.15.40:0/1516152162 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa8b4139510 0x7fa8b413b8f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac009e50 tx=0x7fa8ac00b330 comp rx=0 tx=0).stop 2023-09-30T22:25:50.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.792+0000 7fa8ba451700 1 -- 172.21.15.40:0/1516152162 shutdown_connections 2023-09-30T22:25:50.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.792+0000 7fa8ba451700 1 --2- 172.21.15.40:0/1516152162 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa8b4139510 0x7fa8b413b8f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:50.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.792+0000 7fa8ba451700 1 --2- 172.21.15.40:0/1516152162 >> v2:172.21.15.40:3300/0 conn(0x7fa8b4136bf0 0x7fa8b4138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:50.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.792+0000 7fa8ba451700 1 -- 172.21.15.40:0/1516152162 >> 172.21.15.40:0/1516152162 conn(0x7fa8b40a7080 msgr2=0x7fa8b40a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:50.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.792+0000 7fa8ba451700 1 -- 172.21.15.40:0/1516152162 shutdown_connections 2023-09-30T22:25:50.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.792+0000 7fa8ba451700 1 -- 172.21.15.40:0/1516152162 wait complete. 2023-09-30T22:25:50.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.793+0000 7fa8ba451700 1 Processor -- start 2023-09-30T22:25:50.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.793+0000 7fa8ba451700 1 -- start start 2023-09-30T22:25:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.793+0000 7fa8ba451700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8b409c890 0x7fa8b406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.793+0000 7fa8ba451700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8b4136bf0 0x7fa8b406f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.793+0000 7fa8ba451700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa8b4139510 0x7fa8b406fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.793+0000 7fa8ba451700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b4070cb0 con 0x7fa8b4136bf0 2023-09-30T22:25:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.793+0000 7fa8ba451700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b409ecf0 con 0x7fa8b409c890 2023-09-30T22:25:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.793+0000 7fa8ba451700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b412bcb0 con 0x7fa8b4139510 2023-09-30T22:25:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.793+0000 7fa8b3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8b409c890 0x7fa8b406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.793+0000 7fa8b89ee700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa8b4139510 0x7fa8b406fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.793+0000 7fa8b37fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8b4136bf0 0x7fa8b406f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.793+0000 7fa8b3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8b409c890 0x7fa8b406f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53216/0 (socket says 172.21.15.40:53216) 2023-09-30T22:25:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.793+0000 7fa8b37fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8b4136bf0 0x7fa8b406f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43084/0 (socket says 172.21.15.40:43084) 2023-09-30T22:25:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.793+0000 7fa8b89ee700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa8b4139510 0x7fa8b406fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:33998/0 (socket says 172.21.15.40:33998) 2023-09-30T22:25:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.793+0000 7fa8b3fff700 1 -- 172.21.15.40:0/2858460256 learned_addr learned my addr 172.21.15.40:0/2858460256 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.794+0000 7fa8b37fe700 1 -- 172.21.15.40:0/2858460256 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa8b4139510 msgr2=0x7fa8b406fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.794+0000 7fa8b37fe700 1 --2- 172.21.15.40:0/2858460256 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa8b4139510 0x7fa8b406fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.794+0000 7fa8b37fe700 1 -- 172.21.15.40:0/2858460256 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8b409c890 msgr2=0x7fa8b406f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.794+0000 7fa8b37fe700 1 --2- 172.21.15.40:0/2858460256 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8b409c890 0x7fa8b406f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.794+0000 7fa8b37fe700 1 -- 172.21.15.40:0/2858460256 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a80094a0 con 0x7fa8b4136bf0 2023-09-30T22:25:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.794+0000 7fa8b89ee700 1 --2- 172.21.15.40:0/2858460256 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa8b4139510 0x7fa8b406fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.794+0000 7fa8b37fe700 1 --2- 172.21.15.40:0/2858460256 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8b4136bf0 0x7fa8b406f5c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa8a800e9b0 tx=0x7fa8a800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.794+0000 7fa8b0ff9700 1 -- 172.21.15.40:0/2858460256 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a800ee50 con 0x7fa8b4136bf0 2023-09-30T22:25:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.794+0000 7fa8b0ff9700 1 -- 172.21.15.40:0/2858460256 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a800c850 con 0x7fa8b4136bf0 2023-09-30T22:25:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.794+0000 7fa8ba451700 1 -- 172.21.15.40:0/2858460256 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8ac009b30 con 0x7fa8b4136bf0 2023-09-30T22:25:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.794+0000 7fa8b0ff9700 1 -- 172.21.15.40:0/2858460256 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a800cc00 con 0x7fa8b4136bf0 2023-09-30T22:25:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.794+0000 7fa8ba451700 1 -- 172.21.15.40:0/2858460256 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b412c720 con 0x7fa8b4136bf0 2023-09-30T22:25:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.795+0000 7fa8b0ff9700 1 -- 172.21.15.40:0/2858460256 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa8a8013470 con 0x7fa8b4136bf0 2023-09-30T22:25:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.795+0000 7fa8b0ff9700 1 -- 172.21.15.40:0/2858460256 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa8a803f730 con 0x7fa8b4136bf0 2023-09-30T22:25:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.795+0000 7fa8ba451700 1 -- 172.21.15.40:0/2858460256 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b4062380 con 0x7fa8b4136bf0 2023-09-30T22:25:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.800+0000 7fa8b0ff9700 1 -- 172.21.15.40:0/2858460256 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa8a8021020 con 0x7fa8b4136bf0 2023-09-30T22:25:50.898 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:50.926 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:50.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.998+0000 7fa8ba451700 1 -- 172.21.15.40:0/2858460256 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa8b4074620 con 0x7fa8b4136bf0 2023-09-30T22:25:50.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:50.998+0000 7fa8b0ff9700 1 -- 172.21.15.40:0/2858460256 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa8a8013720 con 0x7fa8b4136bf0 2023-09-30T22:25:50.999 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:51.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.000+0000 7fa8ba451700 1 -- 172.21.15.40:0/2858460256 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8b4136bf0 msgr2=0x7fa8b406f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.000+0000 7fa8ba451700 1 --2- 172.21.15.40:0/2858460256 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8b4136bf0 0x7fa8b406f5c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa8a800e9b0 tx=0x7fa8a800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.000+0000 7fa8ba451700 1 -- 172.21.15.40:0/2858460256 shutdown_connections 2023-09-30T22:25:51.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.000+0000 7fa8ba451700 1 --2- 172.21.15.40:0/2858460256 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa8b4139510 0x7fa8b406fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.000+0000 7fa8ba451700 1 --2- 172.21.15.40:0/2858460256 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8b409c890 0x7fa8b406f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.000+0000 7fa8ba451700 1 --2- 172.21.15.40:0/2858460256 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8b4136bf0 0x7fa8b406f5c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.000+0000 7fa8ba451700 1 -- 172.21.15.40:0/2858460256 >> 172.21.15.40:0/2858460256 conn(0x7fa8b40a7080 msgr2=0x7fa8b41349d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:51.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.000+0000 7fa8ba451700 1 -- 172.21.15.40:0/2858460256 shutdown_connections 2023-09-30T22:25:51.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.000+0000 7fa8ba451700 1 -- 172.21.15.40:0/2858460256 wait complete. 2023-09-30T22:25:51.005 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:51.014 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:51.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.030+0000 7fc16460f700 1 Processor -- start 2023-09-30T22:25:51.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.030+0000 7fc16460f700 1 -- start start 2023-09-30T22:25:51.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.030+0000 7fc16460f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc15c06a6d0 0x7fc15c06aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:51.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.030+0000 7fc16460f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc15c06afe0 0x7fc15c1318b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:51.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.031+0000 7fc16460f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc15c09eb60 con 0x7fc15c131df0 2023-09-30T22:25:51.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.031+0000 7fc16460f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc15c09db70 con 0x7fc15c06afe0 2023-09-30T22:25:51.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.031+0000 7fc16460f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc15c09ddf0 con 0x7fc15c06a6d0 2023-09-30T22:25:51.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.031+0000 7fc1623ab700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc15c06a6d0 0x7fc15c06aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:51.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.031+0000 7fc1623ab700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc15c06a6d0 0x7fc15c06aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:34012/0 (socket says 172.21.15.40:34012) 2023-09-30T22:25:51.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.031+0000 7fc1623ab700 1 -- 172.21.15.40:0/2398160703 learned_addr learned my addr 172.21.15.40:0/2398160703 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:51.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.031+0000 7fc161baa700 1 --2- 172.21.15.40:0/2398160703 >> v2:172.21.15.40:3300/0 conn(0x7fc15c06afe0 0x7fc15c1318b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:51.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.031+0000 7fc1623ab700 1 -- 172.21.15.40:0/2398160703 >> v2:172.21.15.40:3300/0 conn(0x7fc15c06afe0 msgr2=0x7fc15c1318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:51.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.031+0000 7fc1623ab700 1 --2- 172.21.15.40:0/2398160703 >> v2:172.21.15.40:3300/0 conn(0x7fc15c06afe0 0x7fc15c1318b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.031+0000 7fc1623ab700 1 -- 172.21.15.40:0/2398160703 >> v1:172.21.15.40:6789/0 conn(0x7fc15c131df0 legacy=0x7fc15c138b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.031+0000 7fc1623ab700 1 -- 172.21.15.40:0/2398160703 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc15c09c9a0 con 0x7fc15c06a6d0 2023-09-30T22:25:51.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.031+0000 7fc1623ab700 1 --2- 172.21.15.40:0/2398160703 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc15c06a6d0 0x7fc15c06aaa0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc158006fd0 tx=0x7fc158009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5a7e7f70e3fcda2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:51.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.031+0000 7fc1613a9700 1 -- 172.21.15.40:0/2398160703 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc158005e30 con 0x7fc15c06a6d0 2023-09-30T22:25:51.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.032+0000 7fc1613a9700 1 -- 172.21.15.40:0/2398160703 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc158004030 con 0x7fc15c06a6d0 2023-09-30T22:25:51.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.032+0000 7fc1613a9700 1 -- 172.21.15.40:0/2398160703 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1580043e0 con 0x7fc15c06a6d0 2023-09-30T22:25:51.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.032+0000 7fc16460f700 1 -- 172.21.15.40:0/2398160703 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc15c06a6d0 msgr2=0x7fc15c06aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.032+0000 7fc16460f700 1 --2- 172.21.15.40:0/2398160703 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc15c06a6d0 0x7fc15c06aaa0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc158006fd0 tx=0x7fc158009bd0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.032+0000 7fc16460f700 1 -- 172.21.15.40:0/2398160703 shutdown_connections 2023-09-30T22:25:51.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.032+0000 7fc16460f700 1 --2- 172.21.15.40:0/2398160703 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc15c06a6d0 0x7fc15c06aaa0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.032+0000 7fc16460f700 1 --2- 172.21.15.40:0/2398160703 >> v2:172.21.15.40:3300/0 conn(0x7fc15c06afe0 0x7fc15c1318b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.032+0000 7fc16460f700 1 -- 172.21.15.40:0/2398160703 >> 172.21.15.40:0/2398160703 conn(0x7fc15c09fb20 msgr2=0x7fc15c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:51.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.032+0000 7fc16460f700 1 -- 172.21.15.40:0/2398160703 shutdown_connections 2023-09-30T22:25:51.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.032+0000 7fc16460f700 1 -- 172.21.15.40:0/2398160703 wait complete. 2023-09-30T22:25:51.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.033+0000 7fc16460f700 1 Processor -- start 2023-09-30T22:25:51.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.034+0000 7fc16460f700 1 -- start start 2023-09-30T22:25:51.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.034+0000 7fc16460f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc15c06a6d0 0x7fc15c11d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:51.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.034+0000 7fc16460f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc15c06afe0 0x7fc15c1c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:51.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.034+0000 7fc16460f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc15c131df0 0x7fc15c1c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:51.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.034+0000 7fc16460f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15c1319d0 con 0x7fc15c06a6d0 2023-09-30T22:25:51.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.034+0000 7fc16460f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc15c11cfa0 con 0x7fc15c06afe0 2023-09-30T22:25:51.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.034+0000 7fc16460f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc15c0715d0 con 0x7fc15c131df0 2023-09-30T22:25:51.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.034+0000 7fc162bac700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc15c131df0 0x7fc15c1c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:51.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.034+0000 7fc161baa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc15c06afe0 0x7fc15c1c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:51.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.034+0000 7fc1623ab700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc15c06a6d0 0x7fc15c11d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:51.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.034+0000 7fc162bac700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc15c131df0 0x7fc15c1c6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:34028/0 (socket says 172.21.15.40:34028) 2023-09-30T22:25:51.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.034+0000 7fc162bac700 1 -- 172.21.15.40:0/283790954 learned_addr learned my addr 172.21.15.40:0/283790954 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:51.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.035+0000 7fc1623ab700 1 -- 172.21.15.40:0/283790954 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc15c131df0 msgr2=0x7fc15c1c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.035+0000 7fc1623ab700 1 --2- 172.21.15.40:0/283790954 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc15c131df0 0x7fc15c1c6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.035+0000 7fc1623ab700 1 -- 172.21.15.40:0/283790954 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc15c06afe0 msgr2=0x7fc15c1c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.035+0000 7fc1623ab700 1 --2- 172.21.15.40:0/283790954 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc15c06afe0 0x7fc15c1c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.035+0000 7fc1623ab700 1 -- 172.21.15.40:0/283790954 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc158009500 con 0x7fc15c06a6d0 2023-09-30T22:25:51.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.035+0000 7fc162bac700 1 --2- 172.21.15.40:0/283790954 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc15c131df0 0x7fc15c1c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:51.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.035+0000 7fc1623ab700 1 --2- 172.21.15.40:0/283790954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc15c06a6d0 0x7fc15c11d720 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc158009fd0 tx=0x7fc158004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:51.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.035+0000 7fc152ffd700 1 -- 172.21.15.40:0/283790954 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc158003c70 con 0x7fc15c06a6d0 2023-09-30T22:25:51.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.035+0000 7fc152ffd700 1 -- 172.21.15.40:0/283790954 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc158003df0 con 0x7fc15c06a6d0 2023-09-30T22:25:51.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.035+0000 7fc16460f700 1 -- 172.21.15.40:0/283790954 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc15c09e420 con 0x7fc15c06a6d0 2023-09-30T22:25:51.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.035+0000 7fc152ffd700 1 -- 172.21.15.40:0/283790954 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15801c660 con 0x7fc15c06a6d0 2023-09-30T22:25:51.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.035+0000 7fc16460f700 1 -- 172.21.15.40:0/283790954 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc15c120290 con 0x7fc15c06a6d0 2023-09-30T22:25:51.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.036+0000 7fc152ffd700 1 -- 172.21.15.40:0/283790954 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc15801c7c0 con 0x7fc15c06a6d0 2023-09-30T22:25:51.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.036+0000 7fc16460f700 1 -- 172.21.15.40:0/283790954 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc15c0a3f20 con 0x7fc15c06a6d0 2023-09-30T22:25:51.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.036+0000 7fc152ffd700 1 -- 172.21.15.40:0/283790954 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc158040660 con 0x7fc15c06a6d0 2023-09-30T22:25:51.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.041+0000 7fc152ffd700 1 -- 172.21.15.40:0/283790954 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc15802a020 con 0x7fc15c06a6d0 2023-09-30T22:25:51.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.073+0000 7f47518ec700 1 Processor -- start 2023-09-30T22:25:51.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.073+0000 7f47518ec700 1 -- start start 2023-09-30T22:25:51.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.073+0000 7f47518ec700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f474c09c890 0x7f474c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:51.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.073+0000 7f47518ec700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f474c09e480 0x7f474c13bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:51.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.074+0000 7f47518ec700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f474c0a2600 con 0x7f474c09d920 2023-09-30T22:25:51.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.074+0000 7f47518ec700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f474c0a29d0 con 0x7f474c09c890 2023-09-30T22:25:51.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.074+0000 7f47518ec700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f474c09fb40 con 0x7f474c09e480 2023-09-30T22:25:51.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.074+0000 7f474b7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f474c09e480 0x7f474c13bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:51.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.074+0000 7f474a7fc700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f474c09d920 0x7f474c09dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56232/0 (socket says 172.21.15.40:56232) 2023-09-30T22:25:51.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.074+0000 7f474a7fc700 1 -- 172.21.15.40:0/1012977804 learned_addr learned my addr 172.21.15.40:0/1012977804 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:51.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.074+0000 7f474affd700 1 --2- 172.21.15.40:0/1012977804 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f474c09c890 0x7f474c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:51.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.074+0000 7f474affd700 1 -- 172.21.15.40:0/1012977804 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f474c09e480 msgr2=0x7f474c13bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:51.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.074+0000 7f474affd700 1 --2- 172.21.15.40:0/1012977804 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f474c09e480 0x7f474c13bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.074+0000 7f474affd700 1 -- 172.21.15.40:0/1012977804 >> v1:172.21.15.40:6789/0 conn(0x7f474c09d920 legacy=0x7f474c09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.074+0000 7f474affd700 1 -- 172.21.15.40:0/1012977804 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f474c09fed0 con 0x7f474c09c890 2023-09-30T22:25:51.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.074+0000 7f4749ffb700 1 -- 172.21.15.40:0/1012977804 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1888136085 0 0) 0x7f474c0a2600 con 0x7f474c09d920 2023-09-30T22:25:51.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.074+0000 7f474b7fe700 1 --2- 172.21.15.40:0/1012977804 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f474c09e480 0x7f474c13bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:51.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.074+0000 7f474affd700 1 --2- 172.21.15.40:0/1012977804 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f474c09c890 0x7f474c09cc60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f473c009850 tx=0x7f473c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f39d57bbef7a288 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:51.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.074+0000 7f4749ffb700 1 -- 172.21.15.40:0/1012977804 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c005e30 con 0x7f474c09c890 2023-09-30T22:25:51.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.075+0000 7f4749ffb700 1 -- 172.21.15.40:0/1012977804 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473c006030 con 0x7f474c09c890 2023-09-30T22:25:51.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.075+0000 7f4749ffb700 1 -- 172.21.15.40:0/1012977804 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c0063e0 con 0x7f474c09c890 2023-09-30T22:25:51.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.075+0000 7f47518ec700 1 -- 172.21.15.40:0/1012977804 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f474c09c890 msgr2=0x7f474c09cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.075+0000 7f47518ec700 1 --2- 172.21.15.40:0/1012977804 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f474c09c890 0x7f474c09cc60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f473c009850 tx=0x7f473c009b60 comp rx=0 tx=0).stop 2023-09-30T22:25:51.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.075+0000 7f47518ec700 1 -- 172.21.15.40:0/1012977804 shutdown_connections 2023-09-30T22:25:51.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.075+0000 7f47518ec700 1 --2- 172.21.15.40:0/1012977804 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f474c09e480 0x7f474c13bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.075+0000 7f47518ec700 1 --2- 172.21.15.40:0/1012977804 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f474c09c890 0x7f474c09cc60 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.075+0000 7f47518ec700 1 -- 172.21.15.40:0/1012977804 >> 172.21.15.40:0/1012977804 conn(0x7f474c0a7080 msgr2=0x7f474c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:51.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.075+0000 7f47518ec700 1 -- 172.21.15.40:0/1012977804 shutdown_connections 2023-09-30T22:25:51.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.075+0000 7f47518ec700 1 -- 172.21.15.40:0/1012977804 wait complete. 2023-09-30T22:25:51.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.076+0000 7f47518ec700 1 Processor -- start 2023-09-30T22:25:51.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.076+0000 7f47518ec700 1 -- start start 2023-09-30T22:25:51.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.077+0000 7f47518ec700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f474c09c890 0x7f474c12d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:51.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.077+0000 7f47518ec700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f474c09d920 0x7f474c12d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:51.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.077+0000 7f47518ec700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f474c09e480 0x7f474c12db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:51.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.077+0000 7f47518ec700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474c130b60 con 0x7f474c09c890 2023-09-30T22:25:51.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.077+0000 7f47518ec700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f474c12fb00 con 0x7f474c09d920 2023-09-30T22:25:51.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.077+0000 7f47518ec700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f474c0a5cd0 con 0x7f474c09e480 2023-09-30T22:25:51.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.077+0000 7f474affd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f474c09c890 0x7f474c12d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:51.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.077+0000 7f474affd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f474c09c890 0x7f474c12d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43120/0 (socket says 172.21.15.40:43120) 2023-09-30T22:25:51.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.077+0000 7f474affd700 1 -- 172.21.15.40:0/282160770 learned_addr learned my addr 172.21.15.40:0/282160770 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:51.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.077+0000 7f474a7fc700 1 --2- 172.21.15.40:0/282160770 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f474c09d920 0x7f474c12d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:51.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.077+0000 7f474b7fe700 1 --2- 172.21.15.40:0/282160770 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f474c09e480 0x7f474c12db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:51.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.077+0000 7f474affd700 1 -- 172.21.15.40:0/282160770 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f474c09e480 msgr2=0x7f474c12db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.077+0000 7f474affd700 1 --2- 172.21.15.40:0/282160770 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f474c09e480 0x7f474c12db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.077+0000 7f474affd700 1 -- 172.21.15.40:0/282160770 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f474c09d920 msgr2=0x7f474c12d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.077+0000 7f474affd700 1 --2- 172.21.15.40:0/282160770 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f474c09d920 0x7f474c12d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.077+0000 7f474affd700 1 -- 172.21.15.40:0/282160770 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4744009a70 con 0x7f474c09c890 2023-09-30T22:25:51.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.077+0000 7f474a7fc700 1 --2- 172.21.15.40:0/282160770 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f474c09d920 0x7f474c12d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:51.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.077+0000 7f474b7fe700 1 --2- 172.21.15.40:0/282160770 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f474c09e480 0x7f474c12db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:51.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.077+0000 7f474affd700 1 --2- 172.21.15.40:0/282160770 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f474c09c890 0x7f474c12d0e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f473c013040 tx=0x7f473c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:51.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.078+0000 7f4733fff700 1 -- 172.21.15.40:0/282160770 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c004040 con 0x7f474c09c890 2023-09-30T22:25:51.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.078+0000 7f4733fff700 1 -- 172.21.15.40:0/282160770 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473c0041c0 con 0x7f474c09c890 2023-09-30T22:25:51.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.078+0000 7f47518ec700 1 -- 172.21.15.40:0/282160770 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f473c009430 con 0x7f474c09c890 2023-09-30T22:25:51.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.078+0000 7f4733fff700 1 -- 172.21.15.40:0/282160770 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c004570 con 0x7f474c09c890 2023-09-30T22:25:51.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.078+0000 7f47518ec700 1 -- 172.21.15.40:0/282160770 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f474c130340 con 0x7f474c09c890 2023-09-30T22:25:51.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.079+0000 7f47518ec700 1 -- 172.21.15.40:0/282160770 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f474c062380 con 0x7f474c09c890 2023-09-30T22:25:51.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.079+0000 7f4733fff700 1 -- 172.21.15.40:0/282160770 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f473c022070 con 0x7f474c09c890 2023-09-30T22:25:51.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.079+0000 7f4733fff700 1 -- 172.21.15.40:0/282160770 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f473c040e90 con 0x7f474c09c890 2023-09-30T22:25:51.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.083+0000 7f4733fff700 1 -- 172.21.15.40:0/282160770 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f473c019770 con 0x7f474c09c890 2023-09-30T22:25:51.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.141+0000 7f13079e9700 1 Processor -- start 2023-09-30T22:25:51.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.141+0000 7f13079e9700 1 -- start start 2023-09-30T22:25:51.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.141+0000 7f13079e9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1300136c50 0x7f1300139030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:51.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.141+0000 7f13079e9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1300139570 0x7f130013b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:51.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.141+0000 7f13079e9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1300133940 con 0x7f1300133e00 2023-09-30T22:25:51.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.141+0000 7f13079e9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f130009af70 con 0x7f1300136c50 2023-09-30T22:25:51.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.141+0000 7f13079e9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f130009ab20 con 0x7f1300139570 2023-09-30T22:25:51.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.141+0000 7f1305f86700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1300139570 0x7f130013b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:51.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.141+0000 7f1304f84700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1300136c50 0x7f1300139030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:51.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.142+0000 7f1305f86700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1300139570 0x7f130013b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:34048/0 (socket says 172.21.15.40:34048) 2023-09-30T22:25:51.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.142+0000 7f1305f86700 1 -- 172.21.15.40:0/3749346728 learned_addr learned my addr 172.21.15.40:0/3749346728 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:51.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.142+0000 7f1305785700 1 --1- 172.21.15.40:0/3749346728 >> v1:172.21.15.40:6789/0 conn(0x7f1300133e00 0x7f13001341d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56240/0 (socket says 172.21.15.40:56240) 2023-09-30T22:25:51.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.142+0000 7f1304f84700 1 -- 172.21.15.40:0/3749346728 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1300139570 msgr2=0x7f130013b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:51.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.142+0000 7f1304f84700 1 --2- 172.21.15.40:0/3749346728 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1300139570 0x7f130013b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.142+0000 7f1304f84700 1 -- 172.21.15.40:0/3749346728 >> v1:172.21.15.40:6789/0 conn(0x7f1300133e00 legacy=0x7f13001341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.142+0000 7f1304f84700 1 -- 172.21.15.40:0/3749346728 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130009f0d0 con 0x7f1300136c50 2023-09-30T22:25:51.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.142+0000 7f12f7fff700 1 -- 172.21.15.40:0/3749346728 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 470413321 0 0) 0x7f1300133940 con 0x7f1300133e00 2023-09-30T22:25:51.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.142+0000 7f1305f86700 1 --2- 172.21.15.40:0/3749346728 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1300139570 0x7f130013b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:51.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.142+0000 7f1304f84700 1 --2- 172.21.15.40:0/3749346728 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1300136c50 0x7f1300139030 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009840 tx=0x7f12f0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5150a0e343a44645 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:51.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.142+0000 7f12f7fff700 1 -- 172.21.15.40:0/3749346728 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f0011830 con 0x7f1300136c50 2023-09-30T22:25:51.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.142+0000 7f12f7fff700 1 -- 172.21.15.40:0/3749346728 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f0011990 con 0x7f1300136c50 2023-09-30T22:25:51.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.142+0000 7f12f7fff700 1 -- 172.21.15.40:0/3749346728 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f0011d20 con 0x7f1300136c50 2023-09-30T22:25:51.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.143+0000 7f13079e9700 1 -- 172.21.15.40:0/3749346728 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1300136c50 msgr2=0x7f1300139030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.143+0000 7f13079e9700 1 --2- 172.21.15.40:0/3749346728 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1300136c50 0x7f1300139030 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009840 tx=0x7f12f0009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:51.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.143+0000 7f13079e9700 1 -- 172.21.15.40:0/3749346728 shutdown_connections 2023-09-30T22:25:51.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.143+0000 7f13079e9700 1 --2- 172.21.15.40:0/3749346728 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1300139570 0x7f130013b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.143+0000 7f13079e9700 1 --2- 172.21.15.40:0/3749346728 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1300136c50 0x7f1300139030 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.143+0000 7f13079e9700 1 -- 172.21.15.40:0/3749346728 >> 172.21.15.40:0/3749346728 conn(0x7f13000a2a00 msgr2=0x7f13000a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:51.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.143+0000 7f13079e9700 1 -- 172.21.15.40:0/3749346728 shutdown_connections 2023-09-30T22:25:51.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.143+0000 7f13079e9700 1 -- 172.21.15.40:0/3749346728 wait complete. 2023-09-30T22:25:51.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.144+0000 7f13079e9700 1 Processor -- start 2023-09-30T22:25:51.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.144+0000 7f13079e9700 1 -- start start 2023-09-30T22:25:51.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.144+0000 7f13079e9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1300133e00 0x7f1300119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:51.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.144+0000 7f13079e9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1300136c50 0x7f1300119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:51.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.144+0000 7f13079e9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1300139570 0x7f1300119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:51.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.144+0000 7f13079e9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130011a510 con 0x7f1300133e00 2023-09-30T22:25:51.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.144+0000 7f13079e9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130012dd50 con 0x7f1300139570 2023-09-30T22:25:51.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.144+0000 7f13079e9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f130011b980 con 0x7f1300136c50 2023-09-30T22:25:51.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.145+0000 7f1304f84700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1300136c50 0x7f1300119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:51.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.145+0000 7f1305785700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1300133e00 0x7f1300119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:51.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.145+0000 7f1304f84700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1300136c50 0x7f1300119590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:34050/0 (socket says 172.21.15.40:34050) 2023-09-30T22:25:51.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.145+0000 7f1304f84700 1 -- 172.21.15.40:0/781833819 learned_addr learned my addr 172.21.15.40:0/781833819 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:51.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.145+0000 7f1305f86700 1 --2- 172.21.15.40:0/781833819 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1300139570 0x7f1300119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:51.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.145+0000 7f1304f84700 1 -- 172.21.15.40:0/781833819 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1300139570 msgr2=0x7f1300119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.145+0000 7f1304f84700 1 --2- 172.21.15.40:0/781833819 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1300139570 0x7f1300119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.145+0000 7f1304f84700 1 -- 172.21.15.40:0/781833819 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1300133e00 msgr2=0x7f1300119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.145+0000 7f1304f84700 1 --2- 172.21.15.40:0/781833819 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1300133e00 0x7f1300119050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.145+0000 7f1304f84700 1 -- 172.21.15.40:0/781833819 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f8009b30 con 0x7f1300136c50 2023-09-30T22:25:51.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.145+0000 7f1304f84700 1 --2- 172.21.15.40:0/781833819 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1300136c50 0x7f1300119590 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009fd0 tx=0x7f12f0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:51.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.145+0000 7f12f5ffb700 1 -- 172.21.15.40:0/781833819 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f00036a0 con 0x7f1300136c50 2023-09-30T22:25:51.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.145+0000 7f12f5ffb700 1 -- 172.21.15.40:0/781833819 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f001f070 con 0x7f1300136c50 2023-09-30T22:25:51.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.145+0000 7f12f5ffb700 1 -- 172.21.15.40:0/781833819 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f0003a60 con 0x7f1300136c50 2023-09-30T22:25:51.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.145+0000 7f13079e9700 1 -- 172.21.15.40:0/781833819 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f00094a0 con 0x7f1300136c50 2023-09-30T22:25:51.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.146+0000 7f13079e9700 1 -- 172.21.15.40:0/781833819 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f130012e1a0 con 0x7f1300136c50 2023-09-30T22:25:51.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.147+0000 7f13079e9700 1 -- 172.21.15.40:0/781833819 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1300062380 con 0x7f1300136c50 2023-09-30T22:25:51.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.147+0000 7f12f5ffb700 1 -- 172.21.15.40:0/781833819 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f12f0003bc0 con 0x7f1300136c50 2023-09-30T22:25:51.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.147+0000 7f12f5ffb700 1 -- 172.21.15.40:0/781833819 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f12f0021070 con 0x7f1300136c50 2023-09-30T22:25:51.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.152+0000 7f12f5ffb700 1 -- 172.21.15.40:0/781833819 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f12f0010d50 con 0x7f1300136c50 2023-09-30T22:25:51.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.241+0000 7fc16460f700 1 -- 172.21.15.40:0/283790954 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc15c062380 con 0x7fc15c06a6d0 2023-09-30T22:25:51.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.241+0000 7fc152ffd700 1 -- 172.21.15.40:0/283790954 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc158016070 con 0x7fc15c06a6d0 2023-09-30T22:25:51.242 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:51.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.243+0000 7fc16460f700 1 -- 172.21.15.40:0/283790954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc15c06a6d0 msgr2=0x7fc15c11d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.243+0000 7fc16460f700 1 --2- 172.21.15.40:0/283790954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc15c06a6d0 0x7fc15c11d720 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc158009fd0 tx=0x7fc158004750 comp rx=0 tx=0).stop 2023-09-30T22:25:51.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.243+0000 7fc16460f700 1 -- 172.21.15.40:0/283790954 shutdown_connections 2023-09-30T22:25:51.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.243+0000 7fc16460f700 1 --2- 172.21.15.40:0/283790954 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc15c131df0 0x7fc15c1c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.243+0000 7fc16460f700 1 --2- 172.21.15.40:0/283790954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc15c06a6d0 0x7fc15c11d720 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.243+0000 7fc16460f700 1 --2- 172.21.15.40:0/283790954 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc15c06afe0 0x7fc15c1c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.244+0000 7fc16460f700 1 -- 172.21.15.40:0/283790954 >> 172.21.15.40:0/283790954 conn(0x7fc15c09fb20 msgr2=0x7fc15c06f760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:51.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.244+0000 7fc16460f700 1 -- 172.21.15.40:0/283790954 shutdown_connections 2023-09-30T22:25:51.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.244+0000 7fc16460f700 1 -- 172.21.15.40:0/283790954 wait complete. 2023-09-30T22:25:51.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:51.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.282+0000 7f47518ec700 1 -- 172.21.15.40:0/282160770 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f474c130990 con 0x7f474c09c890 2023-09-30T22:25:51.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.282+0000 7f4733fff700 1 -- 172.21.15.40:0/282160770 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f473c01c410 con 0x7f474c09c890 2023-09-30T22:25:51.283 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:51.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.284+0000 7f47518ec700 1 -- 172.21.15.40:0/282160770 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f474c09c890 msgr2=0x7f474c12d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.284+0000 7f47518ec700 1 --2- 172.21.15.40:0/282160770 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f474c09c890 0x7f474c12d0e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f473c013040 tx=0x7f473c004750 comp rx=0 tx=0).stop 2023-09-30T22:25:51.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.284+0000 7f47518ec700 1 -- 172.21.15.40:0/282160770 shutdown_connections 2023-09-30T22:25:51.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.284+0000 7f47518ec700 1 --2- 172.21.15.40:0/282160770 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f474c09e480 0x7f474c12db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.284+0000 7f47518ec700 1 --2- 172.21.15.40:0/282160770 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f474c09c890 0x7f474c12d0e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.284+0000 7f47518ec700 1 --2- 172.21.15.40:0/282160770 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f474c09d920 0x7f474c12d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.284+0000 7f47518ec700 1 -- 172.21.15.40:0/282160770 >> 172.21.15.40:0/282160770 conn(0x7f474c0a7080 msgr2=0x7f474c0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:51.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.284+0000 7f47518ec700 1 -- 172.21.15.40:0/282160770 shutdown_connections 2023-09-30T22:25:51.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.284+0000 7f47518ec700 1 -- 172.21.15.40:0/282160770 wait complete. 2023-09-30T22:25:51.297 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:51.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.345+0000 7f13079e9700 1 -- 172.21.15.40:0/781833819 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f130011b760 con 0x7f1300136c50 2023-09-30T22:25:51.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.346+0000 7f12f5ffb700 1 -- 172.21.15.40:0/781833819 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f12f0015030 con 0x7f1300136c50 2023-09-30T22:25:51.346 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:51.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.348+0000 7f13079e9700 1 -- 172.21.15.40:0/781833819 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1300136c50 msgr2=0x7f1300119590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.348+0000 7f13079e9700 1 --2- 172.21.15.40:0/781833819 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1300136c50 0x7f1300119590 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009fd0 tx=0x7f12f0004750 comp rx=0 tx=0).stop 2023-09-30T22:25:51.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.348+0000 7f13079e9700 1 -- 172.21.15.40:0/781833819 shutdown_connections 2023-09-30T22:25:51.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.348+0000 7f13079e9700 1 --2- 172.21.15.40:0/781833819 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1300139570 0x7f1300119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.348+0000 7f13079e9700 1 --2- 172.21.15.40:0/781833819 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1300133e00 0x7f1300119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.348+0000 7f13079e9700 1 --2- 172.21.15.40:0/781833819 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1300136c50 0x7f1300119590 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.348+0000 7f13079e9700 1 -- 172.21.15.40:0/781833819 >> 172.21.15.40:0/781833819 conn(0x7f13000a2a00 msgr2=0x7f130009b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:51.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.348+0000 7f13079e9700 1 -- 172.21.15.40:0/781833819 shutdown_connections 2023-09-30T22:25:51.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:51.348+0000 7f13079e9700 1 -- 172.21.15.40:0/781833819 wait complete. 2023-09-30T22:25:51.360 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:52.016 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:52.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.157+0000 7fe5a5dc5700 1 Processor -- start 2023-09-30T22:25:52.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.157+0000 7fe5a5dc5700 1 -- start start 2023-09-30T22:25:52.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.158+0000 7fe5a5dc5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5a0133e00 0x7fe5a01341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.158+0000 7fe5a5dc5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe5a009df40 0x7fe5a013bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.158+0000 7fe5a5dc5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a0133940 con 0x7fe5a009d400 2023-09-30T22:25:52.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.158+0000 7fe5a5dc5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a009ab20 con 0x7fe5a0133e00 2023-09-30T22:25:52.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.158+0000 7fe5a5dc5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a009f0d0 con 0x7fe5a009df40 2023-09-30T22:25:52.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.158+0000 7fe59ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe5a009df40 0x7fe5a013bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.158+0000 7fe59effd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe5a009d400 0x7fe5a009d830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56250/0 (socket says 172.21.15.40:56250) 2023-09-30T22:25:52.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.158+0000 7fe59effd700 1 -- 172.21.15.40:0/1060978282 learned_addr learned my addr 172.21.15.40:0/1060978282 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:52.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.158+0000 7fe59f7fe700 1 --2- 172.21.15.40:0/1060978282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5a0133e00 0x7fe5a01341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.158+0000 7fe59e7fc700 1 -- 172.21.15.40:0/1060978282 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 213097286 0 0) 0x7fe5a0133940 con 0x7fe5a009d400 2023-09-30T22:25:52.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.158+0000 7fe59f7fe700 1 -- 172.21.15.40:0/1060978282 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe5a009df40 msgr2=0x7fe5a013bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:52.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.158+0000 7fe59f7fe700 1 --2- 172.21.15.40:0/1060978282 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe5a009df40 0x7fe5a013bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.158+0000 7fe59f7fe700 1 -- 172.21.15.40:0/1060978282 >> v1:172.21.15.40:6789/0 conn(0x7fe5a009d400 legacy=0x7fe5a009d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.158+0000 7fe59f7fe700 1 -- 172.21.15.40:0/1060978282 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a0133be0 con 0x7fe5a0133e00 2023-09-30T22:25:52.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.158+0000 7fe59ffff700 1 --2- 172.21.15.40:0/1060978282 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe5a009df40 0x7fe5a013bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:52.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.158+0000 7fe59f7fe700 1 --2- 172.21.15.40:0/1060978282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5a0133e00 0x7fe5a01341d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe590009870 tx=0x7fe590009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=253135846e9cef40 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:52.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.159+0000 7fe59e7fc700 1 -- 172.21.15.40:0/1060978282 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe590011830 con 0x7fe5a0133e00 2023-09-30T22:25:52.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.159+0000 7fe59e7fc700 1 -- 172.21.15.40:0/1060978282 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe590011990 con 0x7fe5a0133e00 2023-09-30T22:25:52.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.159+0000 7fe59e7fc700 1 -- 172.21.15.40:0/1060978282 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe590011d20 con 0x7fe5a0133e00 2023-09-30T22:25:52.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.159+0000 7fe5a5dc5700 1 -- 172.21.15.40:0/1060978282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5a0133e00 msgr2=0x7fe5a01341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.159+0000 7fe5a5dc5700 1 --2- 172.21.15.40:0/1060978282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5a0133e00 0x7fe5a01341d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe590009870 tx=0x7fe590009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:52.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.159+0000 7fe5a5dc5700 1 -- 172.21.15.40:0/1060978282 shutdown_connections 2023-09-30T22:25:52.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.159+0000 7fe5a5dc5700 1 --2- 172.21.15.40:0/1060978282 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe5a009df40 0x7fe5a013bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.159+0000 7fe5a5dc5700 1 --2- 172.21.15.40:0/1060978282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5a0133e00 0x7fe5a01341d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.159+0000 7fe5a5dc5700 1 -- 172.21.15.40:0/1060978282 >> 172.21.15.40:0/1060978282 conn(0x7fe5a00a2a00 msgr2=0x7fe5a00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:52.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.159+0000 7fe5a5dc5700 1 -- 172.21.15.40:0/1060978282 shutdown_connections 2023-09-30T22:25:52.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.159+0000 7fe5a5dc5700 1 -- 172.21.15.40:0/1060978282 wait complete. 2023-09-30T22:25:52.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.161+0000 7fe5a5dc5700 1 Processor -- start 2023-09-30T22:25:52.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.161+0000 7fe5a5dc5700 1 -- start start 2023-09-30T22:25:52.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.161+0000 7fe5a5dc5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe5a009d400 0x7fe5a011a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.161+0000 7fe5a5dc5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5a009df40 0x7fe5a011ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.161+0000 7fe5a5dc5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5a0133e00 0x7fe5a011b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.161+0000 7fe5a5dc5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a012e270 con 0x7fe5a0133e00 2023-09-30T22:25:52.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.161+0000 7fe5a5dc5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a011c670 con 0x7fe5a009df40 2023-09-30T22:25:52.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.161+0000 7fe5a5dc5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a011c480 con 0x7fe5a009d400 2023-09-30T22:25:52.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.162+0000 7fe59ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5a0133e00 0x7fe5a011b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.162+0000 7fe59f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe5a009d400 0x7fe5a011a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.162+0000 7fe59effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5a009df40 0x7fe5a011ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.162+0000 7fe59ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5a0133e00 0x7fe5a011b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43154/0 (socket says 172.21.15.40:43154) 2023-09-30T22:25:52.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.162+0000 7fe59f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe5a009d400 0x7fe5a011a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:34070/0 (socket says 172.21.15.40:34070) 2023-09-30T22:25:52.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.162+0000 7fe59ffff700 1 -- 172.21.15.40:0/2841777079 learned_addr learned my addr 172.21.15.40:0/2841777079 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:52.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.162+0000 7fe59f7fe700 1 -- 172.21.15.40:0/2841777079 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5a009df40 msgr2=0x7fe5a011ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.162+0000 7fe59f7fe700 1 --2- 172.21.15.40:0/2841777079 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5a009df40 0x7fe5a011ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.162+0000 7fe59f7fe700 1 -- 172.21.15.40:0/2841777079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5a0133e00 msgr2=0x7fe5a011b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.162+0000 7fe59f7fe700 1 --2- 172.21.15.40:0/2841777079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5a0133e00 0x7fe5a011b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.162+0000 7fe59f7fe700 1 -- 172.21.15.40:0/2841777079 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe598009a70 con 0x7fe5a009d400 2023-09-30T22:25:52.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.162+0000 7fe59ffff700 1 --2- 172.21.15.40:0/2841777079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5a0133e00 0x7fe5a011b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:52.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.162+0000 7fe59f7fe700 1 --2- 172.21.15.40:0/2841777079 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe5a009d400 0x7fe5a011a950 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe590016000 tx=0x7fe590004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:52.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.162+0000 7fe587fff700 1 -- 172.21.15.40:0/2841777079 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe590004510 con 0x7fe5a009d400 2023-09-30T22:25:52.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.162+0000 7fe587fff700 1 -- 172.21.15.40:0/2841777079 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5900036a0 con 0x7fe5a009d400 2023-09-30T22:25:52.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.162+0000 7fe5a5dc5700 1 -- 172.21.15.40:0/2841777079 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5900094a0 con 0x7fe5a009d400 2023-09-30T22:25:52.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.162+0000 7fe587fff700 1 -- 172.21.15.40:0/2841777079 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe590003a50 con 0x7fe5a009d400 2023-09-30T22:25:52.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.162+0000 7fe5a5dc5700 1 -- 172.21.15.40:0/2841777079 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a011e3e0 con 0x7fe5a009d400 2023-09-30T22:25:52.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.163+0000 7fe587fff700 1 -- 172.21.15.40:0/2841777079 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe590003bb0 con 0x7fe5a009d400 2023-09-30T22:25:52.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.163+0000 7fe587fff700 1 -- 172.21.15.40:0/2841777079 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe590040020 con 0x7fe5a009d400 2023-09-30T22:25:52.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.163+0000 7fe5a5dc5700 1 -- 172.21.15.40:0/2841777079 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a011e3e0 con 0x7fe5a009d400 2023-09-30T22:25:52.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.168+0000 7fe587fff700 1 -- 172.21.15.40:0/2841777079 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe5a011e3e0 con 0x7fe5a009d400 2023-09-30T22:25:52.257 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:52.298 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:52.361 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:52.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.377+0000 7fe5a5dc5700 1 -- 172.21.15.40:0/2841777079 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe5a011e3e0 con 0x7fe5a009d400 2023-09-30T22:25:52.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.377+0000 7fe587fff700 1 -- 172.21.15.40:0/2841777079 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe5a011e3e0 con 0x7fe5a009d400 2023-09-30T22:25:52.378 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:52.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.380+0000 7fe5a5dc5700 1 -- 172.21.15.40:0/2841777079 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe5a009d400 msgr2=0x7fe5a011a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.380+0000 7fe5a5dc5700 1 --2- 172.21.15.40:0/2841777079 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe5a009d400 0x7fe5a011a950 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe590016000 tx=0x7fe590004750 comp rx=0 tx=0).stop 2023-09-30T22:25:52.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.380+0000 7fe5a5dc5700 1 -- 172.21.15.40:0/2841777079 shutdown_connections 2023-09-30T22:25:52.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.380+0000 7fe5a5dc5700 1 --2- 172.21.15.40:0/2841777079 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe5a009d400 0x7fe5a011a950 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.380+0000 7fe5a5dc5700 1 --2- 172.21.15.40:0/2841777079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5a0133e00 0x7fe5a011b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.380+0000 7fe5a5dc5700 1 --2- 172.21.15.40:0/2841777079 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5a009df40 0x7fe5a011ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.380+0000 7fe5a5dc5700 1 -- 172.21.15.40:0/2841777079 >> 172.21.15.40:0/2841777079 conn(0x7fe5a00a2a00 msgr2=0x7fe5a01b9950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:52.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.380+0000 7fe5a5dc5700 1 -- 172.21.15.40:0/2841777079 shutdown_connections 2023-09-30T22:25:52.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.380+0000 7fe5a5dc5700 1 -- 172.21.15.40:0/2841777079 wait complete. 2023-09-30T22:25:52.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.392+0000 7f3831287700 1 Processor -- start 2023-09-30T22:25:52.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.392+0000 7f3831287700 1 -- start start 2023-09-30T22:25:52.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.392+0000 7f3831287700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f382c09f0f0 0x7f382c138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.392+0000 7f3831287700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f382c09e400 0x7f382c13b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.392+0000 7f3831287700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f382c09f940 con 0x7f382c09d920 2023-09-30T22:25:52.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.392+0000 7f3831287700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382c06b4c0 con 0x7f382c09e400 2023-09-30T22:25:52.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.392+0000 7f3831287700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f382c09a8f0 con 0x7f382c09f0f0 2023-09-30T22:25:52.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.392+0000 7f382a7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f382c09f0f0 0x7f382c138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.392+0000 7f382b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f382c09e400 0x7f382c13b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.392+0000 7f382a7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f382c09f0f0 0x7f382c138ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:34080/0 (socket says 172.21.15.40:34080) 2023-09-30T22:25:52.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.392+0000 7f382a7fc700 1 -- 172.21.15.40:0/3357742856 learned_addr learned my addr 172.21.15.40:0/3357742856 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:52.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.393+0000 7f382a7fc700 1 -- 172.21.15.40:0/3357742856 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f382c09e400 msgr2=0x7f382c13b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:52.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.393+0000 7f382a7fc700 1 --2- 172.21.15.40:0/3357742856 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f382c09e400 0x7f382c13b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.393+0000 7f382a7fc700 1 -- 172.21.15.40:0/3357742856 >> v1:172.21.15.40:6789/0 conn(0x7f382c09d920 legacy=0x7f382c09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:52.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.393+0000 7f382a7fc700 1 -- 172.21.15.40:0/3357742856 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382c09f6e0 con 0x7f382c09f0f0 2023-09-30T22:25:52.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.393+0000 7f382b7fe700 1 --2- 172.21.15.40:0/3357742856 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f382c09e400 0x7f382c13b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:52.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.393+0000 7f382a7fc700 1 --2- 172.21.15.40:0/3357742856 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f382c09f0f0 0x7f382c138ee0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3820009950 tx=0x7f3820009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=255246e9e412a593 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:52.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.393+0000 7f3829ffb700 1 -- 172.21.15.40:0/3357742856 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3820004230 con 0x7f382c09f0f0 2023-09-30T22:25:52.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.393+0000 7f3829ffb700 1 -- 172.21.15.40:0/3357742856 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3820004390 con 0x7f382c09f0f0 2023-09-30T22:25:52.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.393+0000 7f3829ffb700 1 -- 172.21.15.40:0/3357742856 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38200036a0 con 0x7f382c09f0f0 2023-09-30T22:25:52.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.394+0000 7f3831287700 1 -- 172.21.15.40:0/3357742856 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f382c09f0f0 msgr2=0x7f382c138ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.394+0000 7f3831287700 1 --2- 172.21.15.40:0/3357742856 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f382c09f0f0 0x7f382c138ee0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3820009950 tx=0x7f3820009c60 comp rx=0 tx=0).stop 2023-09-30T22:25:52.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.394+0000 7f3831287700 1 -- 172.21.15.40:0/3357742856 shutdown_connections 2023-09-30T22:25:52.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.394+0000 7f3831287700 1 --2- 172.21.15.40:0/3357742856 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f382c09e400 0x7f382c13b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.394+0000 7f3831287700 1 --2- 172.21.15.40:0/3357742856 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f382c09f0f0 0x7f382c138ee0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.394+0000 7f3831287700 1 -- 172.21.15.40:0/3357742856 >> 172.21.15.40:0/3357742856 conn(0x7f382c09fb20 msgr2=0x7f382c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:52.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.394+0000 7f3831287700 1 -- 172.21.15.40:0/3357742856 shutdown_connections 2023-09-30T22:25:52.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.394+0000 7f3831287700 1 -- 172.21.15.40:0/3357742856 wait complete. 2023-09-30T22:25:52.397 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:52.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.395+0000 7f3831287700 1 Processor -- start 2023-09-30T22:25:52.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.396+0000 7f3831287700 1 -- start start 2023-09-30T22:25:52.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.396+0000 7f3831287700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f382c09d920 0x7f382c11e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.396+0000 7f3831287700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f382c09e400 0x7f382c11edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.396+0000 7f3831287700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f382c11f330 0x7f382c1350d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.396+0000 7f3831287700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382c120b10 con 0x7f382c09d920 2023-09-30T22:25:52.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.396+0000 7f3831287700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382c11f760 con 0x7f382c09e400 2023-09-30T22:25:52.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.396+0000 7f3831287700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f382c0a3480 con 0x7f382c11f330 2023-09-30T22:25:52.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.396+0000 7f382b7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f382c11f330 0x7f382c1350d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.396+0000 7f382a7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f382c09e400 0x7f382c11edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.396+0000 7f382b7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f382c11f330 0x7f382c1350d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:34082/0 (socket says 172.21.15.40:34082) 2023-09-30T22:25:52.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.396+0000 7f382b7fe700 1 -- 172.21.15.40:0/524614183 learned_addr learned my addr 172.21.15.40:0/524614183 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:52.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.396+0000 7f382affd700 1 --2- 172.21.15.40:0/524614183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f382c09d920 0x7f382c11e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.396+0000 7f382a7fc700 1 -- 172.21.15.40:0/524614183 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f382c11f330 msgr2=0x7f382c1350d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.396+0000 7f382a7fc700 1 --2- 172.21.15.40:0/524614183 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f382c11f330 0x7f382c1350d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.396+0000 7f382a7fc700 1 -- 172.21.15.40:0/524614183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f382c09d920 msgr2=0x7f382c11e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.397+0000 7f382a7fc700 1 --2- 172.21.15.40:0/524614183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f382c09d920 0x7f382c11e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.397+0000 7f382a7fc700 1 -- 172.21.15.40:0/524614183 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3824009a70 con 0x7f382c09e400 2023-09-30T22:25:52.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.397+0000 7f382b7fe700 1 --2- 172.21.15.40:0/524614183 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f382c11f330 0x7f382c1350d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:52.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.397+0000 7f382a7fc700 1 --2- 172.21.15.40:0/524614183 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f382c09e400 0x7f382c11edf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3820015000 tx=0x7f3820004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:52.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.397+0000 7f38137fe700 1 -- 172.21.15.40:0/524614183 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3820003d60 con 0x7f382c09e400 2023-09-30T22:25:52.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.397+0000 7f38137fe700 1 -- 172.21.15.40:0/524614183 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3820011630 con 0x7f382c09e400 2023-09-30T22:25:52.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.397+0000 7f3831287700 1 -- 172.21.15.40:0/524614183 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3820009550 con 0x7f382c09e400 2023-09-30T22:25:52.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.397+0000 7f38137fe700 1 -- 172.21.15.40:0/524614183 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38200119e0 con 0x7f382c09e400 2023-09-30T22:25:52.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.397+0000 7f3831287700 1 -- 172.21.15.40:0/524614183 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f382c122470 con 0x7f382c09e400 2023-09-30T22:25:52.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.398+0000 7f3831287700 1 -- 172.21.15.40:0/524614183 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f382c121d40 con 0x7f382c09e400 2023-09-30T22:25:52.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.398+0000 7f38137fe700 1 -- 172.21.15.40:0/524614183 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3820021070 con 0x7f382c09e400 2023-09-30T22:25:52.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.399+0000 7f38137fe700 1 -- 172.21.15.40:0/524614183 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3820040d40 con 0x7f382c09e400 2023-09-30T22:25:52.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.403+0000 7f38137fe700 1 -- 172.21.15.40:0/524614183 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f382002d3a0 con 0x7f382c09e400 2023-09-30T22:25:52.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.431+0000 7f63f7b10700 1 Processor -- start 2023-09-30T22:25:52.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.432+0000 7f63f7b10700 1 -- start start 2023-09-30T22:25:52.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.432+0000 7f63f7b10700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f63f006d0a0 0x7f63f0139380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.432+0000 7f63f7b10700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63f006d490 0x7f63f013b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.432+0000 7f63f7b10700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63f00a0590 con 0x7f63f009fbb0 2023-09-30T22:25:52.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.432+0000 7f63f7b10700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f009ff80 con 0x7f63f006d0a0 2023-09-30T22:25:52.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.432+0000 7f63f7b10700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f006da80 con 0x7f63f006d490 2023-09-30T22:25:52.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.432+0000 7f63f50ab700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f63f006d0a0 0x7f63f0139380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.432+0000 7f63f60ad700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63f006d490 0x7f63f013b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.432+0000 7f63f50ab700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f63f006d0a0 0x7f63f0139380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43160/0 (socket says 172.21.15.40:43160) 2023-09-30T22:25:52.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.432+0000 7f63f50ab700 1 -- 172.21.15.40:0/3572241320 learned_addr learned my addr 172.21.15.40:0/3572241320 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:52.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.433+0000 7f63f60ad700 1 -- 172.21.15.40:0/3572241320 >> v2:172.21.15.40:3300/0 conn(0x7f63f006d0a0 msgr2=0x7f63f0139380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:52.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.433+0000 7f63f60ad700 1 --2- 172.21.15.40:0/3572241320 >> v2:172.21.15.40:3300/0 conn(0x7f63f006d0a0 0x7f63f0139380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.433+0000 7f63f60ad700 1 -- 172.21.15.40:0/3572241320 >> v1:172.21.15.40:6789/0 conn(0x7f63f009fbb0 legacy=0x7f63f006c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.433+0000 7f63f60ad700 1 -- 172.21.15.40:0/3572241320 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f00a0780 con 0x7f63f006d490 2023-09-30T22:25:52.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.433+0000 7f63f50ab700 1 --2- 172.21.15.40:0/3572241320 >> v2:172.21.15.40:3300/0 conn(0x7f63f006d0a0 0x7f63f0139380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:52.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.433+0000 7f63f60ad700 1 --2- 172.21.15.40:0/3572241320 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63f006d490 0x7f63f013b8d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f63e8009d90 tx=0x7f63e800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b869b66366f718d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:52.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.433+0000 7f63f48aa700 1 -- 172.21.15.40:0/3572241320 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e800e070 con 0x7f63f006d490 2023-09-30T22:25:52.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.433+0000 7f63f48aa700 1 -- 172.21.15.40:0/3572241320 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e800bb20 con 0x7f63f006d490 2023-09-30T22:25:52.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.433+0000 7f63f48aa700 1 -- 172.21.15.40:0/3572241320 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e8012430 con 0x7f63f006d490 2023-09-30T22:25:52.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.434+0000 7f63f7b10700 1 -- 172.21.15.40:0/3572241320 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63f006d490 msgr2=0x7f63f013b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.434+0000 7f63f7b10700 1 --2- 172.21.15.40:0/3572241320 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63f006d490 0x7f63f013b8d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f63e8009d90 tx=0x7f63e800b330 comp rx=0 tx=0).stop 2023-09-30T22:25:52.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.434+0000 7f63f7b10700 1 -- 172.21.15.40:0/3572241320 shutdown_connections 2023-09-30T22:25:52.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.434+0000 7f63f7b10700 1 --2- 172.21.15.40:0/3572241320 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63f006d490 0x7f63f013b8d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.434+0000 7f63f7b10700 1 --2- 172.21.15.40:0/3572241320 >> v2:172.21.15.40:3300/0 conn(0x7f63f006d0a0 0x7f63f0139380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.434+0000 7f63f7b10700 1 -- 172.21.15.40:0/3572241320 >> 172.21.15.40:0/3572241320 conn(0x7f63f00a41a0 msgr2=0x7f63f00a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:52.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.434+0000 7f63f7b10700 1 -- 172.21.15.40:0/3572241320 shutdown_connections 2023-09-30T22:25:52.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.434+0000 7f63f7b10700 1 -- 172.21.15.40:0/3572241320 wait complete. 2023-09-30T22:25:52.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.435+0000 7f63f7b10700 1 Processor -- start 2023-09-30T22:25:52.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.435+0000 7f63f7b10700 1 -- start start 2023-09-30T22:25:52.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.435+0000 7f63f7b10700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63f006d0a0 0x7f63f00923b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.435+0000 7f63f7b10700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63f006d490 0x7f63f0090870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.435+0000 7f63f7b10700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f63f009fbb0 0x7f63f0090db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.435+0000 7f63f7b10700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f006f8a0 con 0x7f63f006d0a0 2023-09-30T22:25:52.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.435+0000 7f63f7b10700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f0093db0 con 0x7f63f006d490 2023-09-30T22:25:52.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.435+0000 7f63f7b10700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63f00929d0 con 0x7f63f009fbb0 2023-09-30T22:25:52.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.435+0000 7f63f50ab700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63f006d490 0x7f63f0090870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.435+0000 7f63f50ab700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63f006d490 0x7f63f0090870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53312/0 (socket says 172.21.15.40:53312) 2023-09-30T22:25:52.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.435+0000 7f63f50ab700 1 -- 172.21.15.40:0/526889956 learned_addr learned my addr 172.21.15.40:0/526889956 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:52.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.435+0000 7f63f58ac700 1 --2- 172.21.15.40:0/526889956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63f006d0a0 0x7f63f00923b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.435+0000 7f63f60ad700 1 --2- 172.21.15.40:0/526889956 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f63f009fbb0 0x7f63f0090db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.436+0000 7f63f50ab700 1 -- 172.21.15.40:0/526889956 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f63f009fbb0 msgr2=0x7f63f0090db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.436+0000 7f63f50ab700 1 --2- 172.21.15.40:0/526889956 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f63f009fbb0 0x7f63f0090db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.436+0000 7f63f50ab700 1 -- 172.21.15.40:0/526889956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63f006d0a0 msgr2=0x7f63f00923b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.436+0000 7f63f50ab700 1 --2- 172.21.15.40:0/526889956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63f006d0a0 0x7f63f00923b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.436+0000 7f63f50ab700 1 -- 172.21.15.40:0/526889956 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e0009550 con 0x7f63f006d490 2023-09-30T22:25:52.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.436+0000 7f63f50ab700 1 --2- 172.21.15.40:0/526889956 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63f006d490 0x7f63f0090870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f63e000ebe0 tx=0x7f63e000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:52.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.436+0000 7f63e67fc700 1 -- 172.21.15.40:0/526889956 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e000c850 con 0x7f63f006d490 2023-09-30T22:25:52.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.436+0000 7f63e67fc700 1 -- 172.21.15.40:0/526889956 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e000c9b0 con 0x7f63f006d490 2023-09-30T22:25:52.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.436+0000 7f63f7b10700 1 -- 172.21.15.40:0/526889956 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e8009a70 con 0x7f63f006d490 2023-09-30T22:25:52.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.436+0000 7f63e67fc700 1 -- 172.21.15.40:0/526889956 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e000cd20 con 0x7f63f006d490 2023-09-30T22:25:52.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.436+0000 7f63f7b10700 1 -- 172.21.15.40:0/526889956 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f0094820 con 0x7f63f006d490 2023-09-30T22:25:52.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.437+0000 7f63f7b10700 1 -- 172.21.15.40:0/526889956 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63f0093ef0 con 0x7f63f006d490 2023-09-30T22:25:52.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.438+0000 7f63e67fc700 1 -- 172.21.15.40:0/526889956 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f63e0013470 con 0x7f63f006d490 2023-09-30T22:25:52.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.438+0000 7f63e67fc700 1 -- 172.21.15.40:0/526889956 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f63e003fea0 con 0x7f63f006d490 2023-09-30T22:25:52.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.446+0000 7f63e67fc700 1 -- 172.21.15.40:0/526889956 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f63e0013720 con 0x7f63f006d490 2023-09-30T22:25:52.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.500+0000 7fea1619b700 1 Processor -- start 2023-09-30T22:25:52.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.500+0000 7fea1619b700 1 -- start start 2023-09-30T22:25:52.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.500+0000 7fea1619b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea1009d920 0x7fea1009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.500+0000 7fea1619b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fea1009f0f0 0x7fea1009e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.500+0000 7fea1619b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fea10133ca0 0x7fea10134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.500+0000 7fea1619b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea1006b4c0 con 0x7fea10133ca0 2023-09-30T22:25:52.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.500+0000 7fea1619b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1009a8f0 con 0x7fea1009f0f0 2023-09-30T22:25:52.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.500+0000 7fea1619b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea1009f940 con 0x7fea1009d920 2023-09-30T22:25:52.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.500+0000 7fea0effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fea1009f0f0 0x7fea1009e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.500+0000 7fea0f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea1009d920 0x7fea1009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.500+0000 7fea0effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fea1009f0f0 0x7fea1009e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53326/0 (socket says 172.21.15.40:53326) 2023-09-30T22:25:52.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.500+0000 7fea0f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea1009d920 0x7fea1009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:34096/0 (socket says 172.21.15.40:34096) 2023-09-30T22:25:52.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.500+0000 7fea0effd700 1 -- 172.21.15.40:0/2218780094 learned_addr learned my addr 172.21.15.40:0/2218780094 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:52.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.500+0000 7fea0ffff700 1 --2- 172.21.15.40:0/2218780094 >> v2:172.21.15.40:3300/0 conn(0x7fea10133ca0 0x7fea10134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.501+0000 7fea0effd700 1 -- 172.21.15.40:0/2218780094 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea1009d920 msgr2=0x7fea1009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:52.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.501+0000 7fea0effd700 1 --2- 172.21.15.40:0/2218780094 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea1009d920 0x7fea1009dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.501+0000 7fea0effd700 1 -- 172.21.15.40:0/2218780094 >> v2:172.21.15.40:3300/0 conn(0x7fea10133ca0 msgr2=0x7fea10134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:52.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.501+0000 7fea0effd700 1 --2- 172.21.15.40:0/2218780094 >> v2:172.21.15.40:3300/0 conn(0x7fea10133ca0 0x7fea10134140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.501+0000 7fea0effd700 1 -- 172.21.15.40:0/2218780094 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1009f6e0 con 0x7fea1009f0f0 2023-09-30T22:25:52.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.501+0000 7fea0f7fe700 1 --2- 172.21.15.40:0/2218780094 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea1009d920 0x7fea1009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:52.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.501+0000 7fea0effd700 1 --2- 172.21.15.40:0/2218780094 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fea1009f0f0 0x7fea1009e230 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fea04009950 tx=0x7fea04009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6864c5403e1277d3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:52.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.501+0000 7fea0e7fc700 1 -- 172.21.15.40:0/2218780094 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea04011830 con 0x7fea1009f0f0 2023-09-30T22:25:52.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.501+0000 7fea0e7fc700 1 -- 172.21.15.40:0/2218780094 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea04011990 con 0x7fea1009f0f0 2023-09-30T22:25:52.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.501+0000 7fea0e7fc700 1 -- 172.21.15.40:0/2218780094 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea04011d40 con 0x7fea1009f0f0 2023-09-30T22:25:52.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.502+0000 7fea1619b700 1 -- 172.21.15.40:0/2218780094 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fea1009f0f0 msgr2=0x7fea1009e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.502+0000 7fea1619b700 1 --2- 172.21.15.40:0/2218780094 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fea1009f0f0 0x7fea1009e230 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fea04009950 tx=0x7fea04009c60 comp rx=0 tx=0).stop 2023-09-30T22:25:52.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.502+0000 7fea1619b700 1 -- 172.21.15.40:0/2218780094 shutdown_connections 2023-09-30T22:25:52.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.502+0000 7fea1619b700 1 --2- 172.21.15.40:0/2218780094 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea1009d920 0x7fea1009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.502+0000 7fea1619b700 1 --2- 172.21.15.40:0/2218780094 >> v2:172.21.15.40:3300/0 conn(0x7fea10133ca0 0x7fea10134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.502+0000 7fea1619b700 1 --2- 172.21.15.40:0/2218780094 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fea1009f0f0 0x7fea1009e230 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.502+0000 7fea1619b700 1 -- 172.21.15.40:0/2218780094 >> 172.21.15.40:0/2218780094 conn(0x7fea1009fb20 msgr2=0x7fea1009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:52.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.502+0000 7fea1619b700 1 -- 172.21.15.40:0/2218780094 shutdown_connections 2023-09-30T22:25:52.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.502+0000 7fea1619b700 1 -- 172.21.15.40:0/2218780094 wait complete. 2023-09-30T22:25:52.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.503+0000 7fea1619b700 1 Processor -- start 2023-09-30T22:25:52.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.503+0000 7fea1619b700 1 -- start start 2023-09-30T22:25:52.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.503+0000 7fea1619b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea1009d920 0x7fea101219a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.503+0000 7fea1619b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea10133ca0 0x7fea10121ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.503+0000 7fea1619b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fea10122420 0x7fea101c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.503+0000 7fea1619b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea10124ea0 con 0x7fea10133ca0 2023-09-30T22:25:52.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.504+0000 7fea1619b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea10123a80 con 0x7fea10122420 2023-09-30T22:25:52.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.504+0000 7fea1619b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea10126020 con 0x7fea1009d920 2023-09-30T22:25:52.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.504+0000 7fea0f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea1009d920 0x7fea101219a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.504+0000 7fea0f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea1009d920 0x7fea101219a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:34110/0 (socket says 172.21.15.40:34110) 2023-09-30T22:25:52.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.504+0000 7fea0f7fe700 1 -- 172.21.15.40:0/538466267 learned_addr learned my addr 172.21.15.40:0/538466267 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:52.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.504+0000 7fea0effd700 1 --2- 172.21.15.40:0/538466267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea10133ca0 0x7fea10121ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.504+0000 7fea0ffff700 1 --2- 172.21.15.40:0/538466267 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fea10122420 0x7fea101c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.504+0000 7fea0ffff700 1 -- 172.21.15.40:0/538466267 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea1009d920 msgr2=0x7fea101219a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.504+0000 7fea0ffff700 1 --2- 172.21.15.40:0/538466267 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea1009d920 0x7fea101219a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.504+0000 7fea0ffff700 1 -- 172.21.15.40:0/538466267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea10133ca0 msgr2=0x7fea10121ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.504+0000 7fea0ffff700 1 --2- 172.21.15.40:0/538466267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea10133ca0 0x7fea10121ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.504+0000 7fea0ffff700 1 -- 172.21.15.40:0/538466267 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea00009430 con 0x7fea10122420 2023-09-30T22:25:52.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.504+0000 7fea0effd700 1 --2- 172.21.15.40:0/538466267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea10133ca0 0x7fea10121ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:52.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.504+0000 7fea0ffff700 1 --2- 172.21.15.40:0/538466267 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fea10122420 0x7fea101c87b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fea0800efc0 tx=0x7fea0800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:52.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.504+0000 7fe9f7fff700 1 -- 172.21.15.40:0/538466267 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0800cc90 con 0x7fea10122420 2023-09-30T22:25:52.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.505+0000 7fe9f7fff700 1 -- 172.21.15.40:0/538466267 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0800f040 con 0x7fea10122420 2023-09-30T22:25:52.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.505+0000 7fea1619b700 1 -- 172.21.15.40:0/538466267 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea04009550 con 0x7fea10122420 2023-09-30T22:25:52.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.505+0000 7fe9f7fff700 1 -- 172.21.15.40:0/538466267 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea080146c0 con 0x7fea10122420 2023-09-30T22:25:52.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.505+0000 7fea1619b700 1 -- 172.21.15.40:0/538466267 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea10123560 con 0x7fea10122420 2023-09-30T22:25:52.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.506+0000 7fea1619b700 1 -- 172.21.15.40:0/538466267 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea10062380 con 0x7fea10122420 2023-09-30T22:25:52.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.506+0000 7fe9f7fff700 1 -- 172.21.15.40:0/538466267 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fea08014820 con 0x7fea10122420 2023-09-30T22:25:52.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.507+0000 7fe9f7fff700 1 -- 172.21.15.40:0/538466267 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fea08040950 con 0x7fea10122420 2023-09-30T22:25:52.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.511+0000 7fe9f7fff700 1 -- 172.21.15.40:0/538466267 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fea08014ad0 con 0x7fea10122420 2023-09-30T22:25:52.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.606+0000 7f3831287700 1 -- 172.21.15.40:0/524614183 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f382c062380 con 0x7f382c09e400 2023-09-30T22:25:52.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.606+0000 7f38137fe700 1 -- 172.21.15.40:0/524614183 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3820029030 con 0x7f382c09e400 2023-09-30T22:25:52.607 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:52.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.608+0000 7f3831287700 1 -- 172.21.15.40:0/524614183 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f382c09e400 msgr2=0x7f382c11edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.608+0000 7f3831287700 1 --2- 172.21.15.40:0/524614183 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f382c09e400 0x7f382c11edf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3820015000 tx=0x7f3820004750 comp rx=0 tx=0).stop 2023-09-30T22:25:52.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.608+0000 7f3831287700 1 -- 172.21.15.40:0/524614183 shutdown_connections 2023-09-30T22:25:52.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.608+0000 7f3831287700 1 --2- 172.21.15.40:0/524614183 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f382c11f330 0x7f382c1350d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.608+0000 7f3831287700 1 --2- 172.21.15.40:0/524614183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f382c09d920 0x7f382c11e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.608+0000 7f3831287700 1 --2- 172.21.15.40:0/524614183 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f382c09e400 0x7f382c11edf0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.608+0000 7f3831287700 1 -- 172.21.15.40:0/524614183 >> 172.21.15.40:0/524614183 conn(0x7f382c09fb20 msgr2=0x7f382c070a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:52.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.608+0000 7f3831287700 1 -- 172.21.15.40:0/524614183 shutdown_connections 2023-09-30T22:25:52.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.608+0000 7f3831287700 1 -- 172.21.15.40:0/524614183 wait complete. 2023-09-30T22:25:52.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:52.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.646+0000 7f63f7b10700 1 -- 172.21.15.40:0/526889956 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f63f0093ef0 con 0x7f63f006d490 2023-09-30T22:25:52.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.646+0000 7f63e67fc700 1 -- 172.21.15.40:0/526889956 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f63f0093ef0 con 0x7f63f006d490 2023-09-30T22:25:52.649 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:52.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.648+0000 7f63f7b10700 1 -- 172.21.15.40:0/526889956 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63f006d490 msgr2=0x7f63f0090870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.648+0000 7f63f7b10700 1 --2- 172.21.15.40:0/526889956 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63f006d490 0x7f63f0090870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f63e000ebe0 tx=0x7f63e000eef0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.649+0000 7f63f7b10700 1 -- 172.21.15.40:0/526889956 shutdown_connections 2023-09-30T22:25:52.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.649+0000 7f63f7b10700 1 --2- 172.21.15.40:0/526889956 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f63f009fbb0 0x7f63f0090db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.649+0000 7f63f7b10700 1 --2- 172.21.15.40:0/526889956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63f006d0a0 0x7f63f00923b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.649+0000 7f63f7b10700 1 --2- 172.21.15.40:0/526889956 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63f006d490 0x7f63f0090870 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.649+0000 7f63f7b10700 1 -- 172.21.15.40:0/526889956 >> 172.21.15.40:0/526889956 conn(0x7f63f00a41a0 msgr2=0x7f63f00a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:52.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.649+0000 7f63f7b10700 1 -- 172.21.15.40:0/526889956 shutdown_connections 2023-09-30T22:25:52.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.649+0000 7f63f7b10700 1 -- 172.21.15.40:0/526889956 wait complete. 2023-09-30T22:25:52.661 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:52.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.718+0000 7fea1619b700 1 -- 172.21.15.40:0/538466267 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fea10074720 con 0x7fea10122420 2023-09-30T22:25:52.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.719+0000 7fe9f7fff700 1 -- 172.21.15.40:0/538466267 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fea080263e0 con 0x7fea10122420 2023-09-30T22:25:52.720 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:52.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.721+0000 7fea1619b700 1 -- 172.21.15.40:0/538466267 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fea10122420 msgr2=0x7fea101c87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.721+0000 7fea1619b700 1 --2- 172.21.15.40:0/538466267 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fea10122420 0x7fea101c87b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fea0800efc0 tx=0x7fea0800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.721+0000 7fea1619b700 1 -- 172.21.15.40:0/538466267 shutdown_connections 2023-09-30T22:25:52.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.721+0000 7fea1619b700 1 --2- 172.21.15.40:0/538466267 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea1009d920 0x7fea101219a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.721+0000 7fea1619b700 1 --2- 172.21.15.40:0/538466267 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fea10122420 0x7fea101c87b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.721+0000 7fea1619b700 1 --2- 172.21.15.40:0/538466267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea10133ca0 0x7fea10121ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.721+0000 7fea1619b700 1 -- 172.21.15.40:0/538466267 >> 172.21.15.40:0/538466267 conn(0x7fea1009fb20 msgr2=0x7fea100a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:52.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.721+0000 7fea1619b700 1 -- 172.21.15.40:0/538466267 shutdown_connections 2023-09-30T22:25:52.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:52.721+0000 7fea1619b700 1 -- 172.21.15.40:0/538466267 wait complete. 2023-09-30T22:25:52.734 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:53.398 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:53.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.538+0000 7fe6d4d1c700 1 Processor -- start 2023-09-30T22:25:53.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.538+0000 7fe6d4d1c700 1 -- start start 2023-09-30T22:25:53.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.539+0000 7fe6d4d1c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe6d006d0a0 0x7fe6d0139380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.539+0000 7fe6d4d1c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe6d006d490 0x7fe6d013b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.539+0000 7fe6d4d1c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d00a0590 con 0x7fe6d009fbb0 2023-09-30T22:25:53.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.539+0000 7fe6d4d1c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6d009ff80 con 0x7fe6d006d490 2023-09-30T22:25:53.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.539+0000 7fe6d4d1c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d006da80 con 0x7fe6d006d0a0 2023-09-30T22:25:53.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.539+0000 7fe6cdd9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe6d006d0a0 0x7fe6d0139380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.539+0000 7fe6cdd9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe6d006d0a0 0x7fe6d0139380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:43500/0 (socket says 172.21.15.40:43500) 2023-09-30T22:25:53.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.539+0000 7fe6cdd9b700 1 -- 172.21.15.40:0/317275690 learned_addr learned my addr 172.21.15.40:0/317275690 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:53.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.539+0000 7fe6ced9d700 1 --2- 172.21.15.40:0/317275690 >> v2:172.21.15.40:3300/0 conn(0x7fe6d006d490 0x7fe6d013b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.539+0000 7fe6cdd9b700 1 -- 172.21.15.40:0/317275690 >> v2:172.21.15.40:3300/0 conn(0x7fe6d006d490 msgr2=0x7fe6d013b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:53.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.539+0000 7fe6cdd9b700 1 --2- 172.21.15.40:0/317275690 >> v2:172.21.15.40:3300/0 conn(0x7fe6d006d490 0x7fe6d013b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.539+0000 7fe6cdd9b700 1 -- 172.21.15.40:0/317275690 >> v1:172.21.15.40:6789/0 conn(0x7fe6d009fbb0 legacy=0x7fe6d006c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.539+0000 7fe6cdd9b700 1 -- 172.21.15.40:0/317275690 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d00a0780 con 0x7fe6d006d0a0 2023-09-30T22:25:53.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.540+0000 7fe6cdd9b700 1 --2- 172.21.15.40:0/317275690 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe6d006d0a0 0x7fe6d0139380 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe6b80098f0 tx=0x7fe6b8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd66bfbe93d59dce server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:53.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.542+0000 7fe6cd59a700 1 -- 172.21.15.40:0/317275690 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b8011830 con 0x7fe6d006d0a0 2023-09-30T22:25:53.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.542+0000 7fe6cd59a700 1 -- 172.21.15.40:0/317275690 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b8011990 con 0x7fe6d006d0a0 2023-09-30T22:25:53.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.542+0000 7fe6cd59a700 1 -- 172.21.15.40:0/317275690 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b8011d20 con 0x7fe6d006d0a0 2023-09-30T22:25:53.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.542+0000 7fe6d4d1c700 1 -- 172.21.15.40:0/317275690 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe6d006d0a0 msgr2=0x7fe6d0139380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.542+0000 7fe6d4d1c700 1 --2- 172.21.15.40:0/317275690 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe6d006d0a0 0x7fe6d0139380 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe6b80098f0 tx=0x7fe6b8009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:53.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.542+0000 7fe6d4d1c700 1 -- 172.21.15.40:0/317275690 shutdown_connections 2023-09-30T22:25:53.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.542+0000 7fe6d4d1c700 1 --2- 172.21.15.40:0/317275690 >> v2:172.21.15.40:3300/0 conn(0x7fe6d006d490 0x7fe6d013b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.543+0000 7fe6d4d1c700 1 --2- 172.21.15.40:0/317275690 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe6d006d0a0 0x7fe6d0139380 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.543+0000 7fe6d4d1c700 1 -- 172.21.15.40:0/317275690 >> 172.21.15.40:0/317275690 conn(0x7fe6d00a41a0 msgr2=0x7fe6d00a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:53.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.543+0000 7fe6d4d1c700 1 -- 172.21.15.40:0/317275690 shutdown_connections 2023-09-30T22:25:53.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.543+0000 7fe6d4d1c700 1 -- 172.21.15.40:0/317275690 wait complete. 2023-09-30T22:25:53.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.544+0000 7fe6d4d1c700 1 Processor -- start 2023-09-30T22:25:53.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.544+0000 7fe6d4d1c700 1 -- start start 2023-09-30T22:25:53.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.544+0000 7fe6d4d1c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe6d006d0a0 0x7fe6d00906c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.544+0000 7fe6d4d1c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6d006d490 0x7fe6d0090c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.544+0000 7fe6d4d1c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe6d009fbb0 0x7fe6d0091140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.544+0000 7fe6d4d1c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d0093b80 con 0x7fe6d006d490 2023-09-30T22:25:53.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.544+0000 7fe6d4d1c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d006f830 con 0x7fe6d006d0a0 2023-09-30T22:25:53.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.544+0000 7fe6d4d1c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d0071eb0 con 0x7fe6d009fbb0 2023-09-30T22:25:53.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.544+0000 7fe6ce59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe6d006d0a0 0x7fe6d00906c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.544+0000 7fe6cdd9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6d006d490 0x7fe6d0090c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.544+0000 7fe6cdd9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6d006d490 0x7fe6d0090c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45054/0 (socket says 172.21.15.40:45054) 2023-09-30T22:25:53.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.544+0000 7fe6ce59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe6d006d0a0 0x7fe6d00906c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:33506/0 (socket says 172.21.15.40:33506) 2023-09-30T22:25:53.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.544+0000 7fe6cdd9b700 1 -- 172.21.15.40:0/979018120 learned_addr learned my addr 172.21.15.40:0/979018120 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:53.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.544+0000 7fe6ced9d700 1 --2- 172.21.15.40:0/979018120 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe6d009fbb0 0x7fe6d0091140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.545+0000 7fe6cdd9b700 1 -- 172.21.15.40:0/979018120 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe6d009fbb0 msgr2=0x7fe6d0091140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.545+0000 7fe6cdd9b700 1 --2- 172.21.15.40:0/979018120 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe6d009fbb0 0x7fe6d0091140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.545+0000 7fe6cdd9b700 1 -- 172.21.15.40:0/979018120 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe6d006d0a0 msgr2=0x7fe6d00906c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.545+0000 7fe6cdd9b700 1 --2- 172.21.15.40:0/979018120 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe6d006d0a0 0x7fe6d00906c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.545+0000 7fe6cdd9b700 1 -- 172.21.15.40:0/979018120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b8009550 con 0x7fe6d006d490 2023-09-30T22:25:53.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.545+0000 7fe6ce59c700 1 --2- 172.21.15.40:0/979018120 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe6d006d0a0 0x7fe6d00906c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:53.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.545+0000 7fe6cdd9b700 1 --2- 172.21.15.40:0/979018120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6d006d490 0x7fe6d0090c00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8000c00 tx=0x7fe6b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:53.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.546+0000 7fe6c6ffd700 1 -- 172.21.15.40:0/979018120 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b80036a0 con 0x7fe6d006d490 2023-09-30T22:25:53.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.546+0000 7fe6c6ffd700 1 -- 172.21.15.40:0/979018120 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b8003800 con 0x7fe6d006d490 2023-09-30T22:25:53.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.547+0000 7fe6d4d1c700 1 -- 172.21.15.40:0/979018120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d00948b0 con 0x7fe6d006d490 2023-09-30T22:25:53.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.547+0000 7fe6c6ffd700 1 -- 172.21.15.40:0/979018120 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b8003bb0 con 0x7fe6d006d490 2023-09-30T22:25:53.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.547+0000 7fe6d4d1c700 1 -- 172.21.15.40:0/979018120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d00921a0 con 0x7fe6d006d490 2023-09-30T22:25:53.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.547+0000 7fe6c6ffd700 1 -- 172.21.15.40:0/979018120 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe6b8021070 con 0x7fe6d006d490 2023-09-30T22:25:53.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.548+0000 7fe6c6ffd700 1 -- 172.21.15.40:0/979018120 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe6b8040c30 con 0x7fe6d006d490 2023-09-30T22:25:53.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.548+0000 7fe6d4d1c700 1 -- 172.21.15.40:0/979018120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d0062380 con 0x7fe6d006d490 2023-09-30T22:25:53.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.553+0000 7fe6c6ffd700 1 -- 172.21.15.40:0/979018120 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe6b8015070 con 0x7fe6d006d490 2023-09-30T22:25:53.626 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:53.662 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:53.734 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:53.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.758+0000 7f4003a53700 1 Processor -- start 2023-09-30T22:25:53.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.758+0000 7f4003a53700 1 -- start start 2023-09-30T22:25:53.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.759+0000 7f4003a53700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ffc131d50 0x7f3ffc132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.759+0000 7f4003a53700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ffc09c7d0 0x7f3ffc139ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.759+0000 7f4003a53700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ffc132660 con 0x7f3ffc09bc50 2023-09-30T22:25:53.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.759+0000 7f4003a53700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc0719e0 con 0x7f3ffc09c7d0 2023-09-30T22:25:53.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.759+0000 7f4003a53700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc131900 con 0x7f3ffc131d50 2023-09-30T22:25:53.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.759+0000 7f4000fee700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3ffc09bc50 0x7f3ffc09c0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60038/0 (socket says 172.21.15.40:60038) 2023-09-30T22:25:53.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.759+0000 7f4000fee700 1 -- 172.21.15.40:0/1732725968 learned_addr learned my addr 172.21.15.40:0/1732725968 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:53.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.759+0000 7f40017ef700 1 --2- 172.21.15.40:0/1732725968 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ffc131d50 0x7f3ffc132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.759+0000 7f4001ff0700 1 --2- 172.21.15.40:0/1732725968 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ffc09c7d0 0x7f3ffc139ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.760+0000 7f40017ef700 1 -- 172.21.15.40:0/1732725968 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ffc09c7d0 msgr2=0x7f3ffc139ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:53.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.760+0000 7f40017ef700 1 --2- 172.21.15.40:0/1732725968 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ffc09c7d0 0x7f3ffc139ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.760+0000 7f3ff3fff700 1 -- 172.21.15.40:0/1732725968 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2355987219 0 0) 0x7f3ffc132660 con 0x7f3ffc09bc50 2023-09-30T22:25:53.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.760+0000 7f40017ef700 1 -- 172.21.15.40:0/1732725968 >> v1:172.21.15.40:6789/0 conn(0x7f3ffc09bc50 legacy=0x7f3ffc09c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.760+0000 7f40017ef700 1 -- 172.21.15.40:0/1732725968 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ffc09e820 con 0x7f3ffc131d50 2023-09-30T22:25:53.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.760+0000 7f4001ff0700 1 --2- 172.21.15.40:0/1732725968 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ffc09c7d0 0x7f3ffc139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:53.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.760+0000 7f40017ef700 1 --2- 172.21.15.40:0/1732725968 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ffc131d50 0x7f3ffc132120 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3ff80098a0 tx=0x7f3ff8009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77c8ff48fabde937 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:53.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.760+0000 7f3ff3fff700 1 -- 172.21.15.40:0/1732725968 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8011830 con 0x7f3ffc131d50 2023-09-30T22:25:53.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.760+0000 7f3ff3fff700 1 -- 172.21.15.40:0/1732725968 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff8011990 con 0x7f3ffc131d50 2023-09-30T22:25:53.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.760+0000 7f3ff3fff700 1 -- 172.21.15.40:0/1732725968 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8011d40 con 0x7f3ffc131d50 2023-09-30T22:25:53.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.761+0000 7f4003a53700 1 -- 172.21.15.40:0/1732725968 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ffc131d50 msgr2=0x7f3ffc132120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.761+0000 7f4003a53700 1 --2- 172.21.15.40:0/1732725968 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ffc131d50 0x7f3ffc132120 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3ff80098a0 tx=0x7f3ff8009bb0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.761+0000 7f4003a53700 1 -- 172.21.15.40:0/1732725968 shutdown_connections 2023-09-30T22:25:53.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.761+0000 7f4003a53700 1 --2- 172.21.15.40:0/1732725968 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ffc09c7d0 0x7f3ffc139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.761+0000 7f4003a53700 1 --2- 172.21.15.40:0/1732725968 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ffc131d50 0x7f3ffc132120 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.761+0000 7f4003a53700 1 -- 172.21.15.40:0/1732725968 >> 172.21.15.40:0/1732725968 conn(0x7f3ffc0a2a00 msgr2=0x7f3ffc0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:53.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.761+0000 7f4003a53700 1 -- 172.21.15.40:0/1732725968 shutdown_connections 2023-09-30T22:25:53.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.761+0000 7f4003a53700 1 -- 172.21.15.40:0/1732725968 wait complete. 2023-09-30T22:25:53.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.762+0000 7f4003a53700 1 Processor -- start 2023-09-30T22:25:53.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.762+0000 7f4003a53700 1 -- start start 2023-09-30T22:25:53.764 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:53.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.762+0000 7fe6d4d1c700 1 -- 172.21.15.40:0/979018120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe6d0074620 con 0x7fe6d006d490 2023-09-30T22:25:53.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.762+0000 7fe6c6ffd700 1 -- 172.21.15.40:0/979018120 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe6b800b3e0 con 0x7fe6d006d490 2023-09-30T22:25:53.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.763+0000 7f4003a53700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ffc09bc50 0x7f3ffc099a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.763+0000 7f4003a53700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ffc09c7d0 0x7f3ffc099fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.763+0000 7f4003a53700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ffc131d50 0x7f3ffc09a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.763+0000 7f4003a53700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc120690 con 0x7f3ffc09bc50 2023-09-30T22:25:53.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.763+0000 7f4003a53700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc11f3f0 con 0x7f3ffc09c7d0 2023-09-30T22:25:53.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.763+0000 7f4003a53700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc11f6a0 con 0x7f3ffc131d50 2023-09-30T22:25:53.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.763+0000 7f40017ef700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ffc09bc50 0x7f3ffc099a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.763+0000 7f40017ef700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ffc09bc50 0x7f3ffc099a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45064/0 (socket says 172.21.15.40:45064) 2023-09-30T22:25:53.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.763+0000 7f40017ef700 1 -- 172.21.15.40:0/3849813058 learned_addr learned my addr 172.21.15.40:0/3849813058 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:53.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.763+0000 7f4001ff0700 1 --2- 172.21.15.40:0/3849813058 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ffc131d50 0x7f3ffc09a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.763+0000 7f4000fee700 1 --2- 172.21.15.40:0/3849813058 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ffc09c7d0 0x7f3ffc099fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.763+0000 7f40017ef700 1 -- 172.21.15.40:0/3849813058 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ffc131d50 msgr2=0x7f3ffc09a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.763+0000 7f40017ef700 1 --2- 172.21.15.40:0/3849813058 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ffc131d50 0x7f3ffc09a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.763+0000 7f40017ef700 1 -- 172.21.15.40:0/3849813058 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ffc09c7d0 msgr2=0x7f3ffc099fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.763+0000 7f40017ef700 1 --2- 172.21.15.40:0/3849813058 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ffc09c7d0 0x7f3ffc099fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.763+0000 7f40017ef700 1 -- 172.21.15.40:0/3849813058 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff80094a0 con 0x7f3ffc09bc50 2023-09-30T22:25:53.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.763+0000 7f4001ff0700 1 --2- 172.21.15.40:0/3849813058 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ffc131d50 0x7f3ffc09a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:53.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.764+0000 7f40017ef700 1 --2- 172.21.15.40:0/3849813058 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ffc09bc50 0x7f3ffc099a70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc131a40 tx=0x7f3ff8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:53.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.764+0000 7f3ff1ffb700 1 -- 172.21.15.40:0/3849813058 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff801a830 con 0x7f3ffc09bc50 2023-09-30T22:25:53.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.764+0000 7f3ff1ffb700 1 -- 172.21.15.40:0/3849813058 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff801a9d0 con 0x7f3ffc09bc50 2023-09-30T22:25:53.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.764+0000 7f4003a53700 1 -- 172.21.15.40:0/3849813058 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ffc12dfd0 con 0x7f3ffc09bc50 2023-09-30T22:25:53.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.764+0000 7f3ff1ffb700 1 -- 172.21.15.40:0/3849813058 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff801ad80 con 0x7f3ffc09bc50 2023-09-30T22:25:53.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.764+0000 7f4003a53700 1 -- 172.21.15.40:0/3849813058 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ffc09ea60 con 0x7f3ffc09bc50 2023-09-30T22:25:53.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.765+0000 7f4003a53700 1 -- 172.21.15.40:0/3849813058 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ffc1202f0 con 0x7f3ffc09bc50 2023-09-30T22:25:53.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.765+0000 7f3ff1ffb700 1 -- 172.21.15.40:0/3849813058 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3ff802e450 con 0x7f3ffc09bc50 2023-09-30T22:25:53.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.765+0000 7fe6d4d1c700 1 -- 172.21.15.40:0/979018120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6d006d490 msgr2=0x7fe6d0090c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.765+0000 7fe6d4d1c700 1 --2- 172.21.15.40:0/979018120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6d006d490 0x7fe6d0090c00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8000c00 tx=0x7fe6b8004750 comp rx=0 tx=0).stop 2023-09-30T22:25:53.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.766+0000 7f3ff1ffb700 1 -- 172.21.15.40:0/3849813058 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3ff8040a30 con 0x7f3ffc09bc50 2023-09-30T22:25:53.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.767+0000 7fe6d4d1c700 1 -- 172.21.15.40:0/979018120 shutdown_connections 2023-09-30T22:25:53.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.767+0000 7fe6d4d1c700 1 --2- 172.21.15.40:0/979018120 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe6d009fbb0 0x7fe6d0091140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.767+0000 7fe6d4d1c700 1 --2- 172.21.15.40:0/979018120 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe6d006d0a0 0x7fe6d00906c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.767+0000 7fe6d4d1c700 1 --2- 172.21.15.40:0/979018120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6d006d490 0x7fe6d0090c00 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.767+0000 7fe6d4d1c700 1 -- 172.21.15.40:0/979018120 >> 172.21.15.40:0/979018120 conn(0x7fe6d00a41a0 msgr2=0x7fe6d00a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:53.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.769+0000 7fe6d4d1c700 1 -- 172.21.15.40:0/979018120 shutdown_connections 2023-09-30T22:25:53.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.769+0000 7fe6d4d1c700 1 -- 172.21.15.40:0/979018120 wait complete. 2023-09-30T22:25:53.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.771+0000 7f3ff1ffb700 1 -- 172.21.15.40:0/3849813058 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3ffc1202f0 con 0x7f3ffc09bc50 2023-09-30T22:25:53.789 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:53.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.809+0000 7f4eb8e72700 1 Processor -- start 2023-09-30T22:25:53.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.809+0000 7f4eb8e72700 1 -- start start 2023-09-30T22:25:53.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.810+0000 7f4eb8e72700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4eb4099510 0x7f4eb40998e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.810+0000 7f4eb8e72700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4eb4099e20 0x7f4eb4130160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.810+0000 7f4eb8e72700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4eb41306a0 0x7f4eb4130b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.810+0000 7f4eb8e72700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eb409a950 con 0x7f4eb4099e20 2023-09-30T22:25:53.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.810+0000 7f4eb8e72700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb409a630 con 0x7f4eb41306a0 2023-09-30T22:25:53.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.810+0000 7f4eb8e72700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb409ba50 con 0x7f4eb4099510 2023-09-30T22:25:53.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.810+0000 7f4eb259c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4eb4099510 0x7f4eb40998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.810+0000 7f4eb259c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4eb4099510 0x7f4eb40998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:43542/0 (socket says 172.21.15.40:43542) 2023-09-30T22:25:53.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.810+0000 7f4eb259c700 1 -- 172.21.15.40:0/305702467 learned_addr learned my addr 172.21.15.40:0/305702467 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:53.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.810+0000 7f4eb1d9b700 1 --2- 172.21.15.40:0/305702467 >> v2:172.21.15.40:3300/0 conn(0x7f4eb4099e20 0x7f4eb4130160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.810+0000 7f4eb2d9d700 1 --2- 172.21.15.40:0/305702467 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4eb41306a0 0x7f4eb4130b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.810+0000 7f4eb259c700 1 -- 172.21.15.40:0/305702467 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4eb41306a0 msgr2=0x7f4eb4130b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:53.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.810+0000 7f4eb259c700 1 --2- 172.21.15.40:0/305702467 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4eb41306a0 0x7f4eb4130b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.810+0000 7f4eb259c700 1 -- 172.21.15.40:0/305702467 >> v2:172.21.15.40:3300/0 conn(0x7f4eb4099e20 msgr2=0x7f4eb4130160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:53.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.810+0000 7f4eb259c700 1 --2- 172.21.15.40:0/305702467 >> v2:172.21.15.40:3300/0 conn(0x7f4eb4099e20 0x7f4eb4130160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.810+0000 7f4eb259c700 1 -- 172.21.15.40:0/305702467 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb409b7a0 con 0x7f4eb4099510 2023-09-30T22:25:53.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.810+0000 7f4eb259c700 1 --2- 172.21.15.40:0/305702467 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4eb4099510 0x7f4eb40998e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4006fd0 tx=0x7f4ea400be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=127307d232410d47 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:53.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.811+0000 7f4eb159a700 1 -- 172.21.15.40:0/305702467 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea4005e30 con 0x7f4eb4099510 2023-09-30T22:25:53.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.811+0000 7f4eb159a700 1 -- 172.21.15.40:0/305702467 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea4004030 con 0x7f4eb4099510 2023-09-30T22:25:53.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.811+0000 7f4eb159a700 1 -- 172.21.15.40:0/305702467 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea40043e0 con 0x7f4eb4099510 2023-09-30T22:25:53.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.811+0000 7f4eb8e72700 1 -- 172.21.15.40:0/305702467 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4eb4099510 msgr2=0x7f4eb40998e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.811+0000 7f4eb8e72700 1 --2- 172.21.15.40:0/305702467 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4eb4099510 0x7f4eb40998e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4006fd0 tx=0x7f4ea400be70 comp rx=0 tx=0).stop 2023-09-30T22:25:53.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.811+0000 7f4eb8e72700 1 -- 172.21.15.40:0/305702467 shutdown_connections 2023-09-30T22:25:53.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.811+0000 7f4eb8e72700 1 --2- 172.21.15.40:0/305702467 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4eb4099510 0x7f4eb40998e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.811+0000 7f4eb8e72700 1 --2- 172.21.15.40:0/305702467 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4eb41306a0 0x7f4eb4130b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.811+0000 7f4eb8e72700 1 --2- 172.21.15.40:0/305702467 >> v2:172.21.15.40:3300/0 conn(0x7f4eb4099e20 0x7f4eb4130160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.811+0000 7f4eb8e72700 1 -- 172.21.15.40:0/305702467 >> 172.21.15.40:0/305702467 conn(0x7f4eb409eb10 msgr2=0x7f4eb409ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:53.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.811+0000 7f4eb8e72700 1 -- 172.21.15.40:0/305702467 shutdown_connections 2023-09-30T22:25:53.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.812+0000 7f4eb8e72700 1 -- 172.21.15.40:0/305702467 wait complete. 2023-09-30T22:25:53.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.813+0000 7f4eb8e72700 1 Processor -- start 2023-09-30T22:25:53.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.813+0000 7f4eb8e72700 1 -- start start 2023-09-30T22:25:53.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.813+0000 7f4eb8e72700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4eb4099510 0x7f4eb412e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.813+0000 7f4eb8e72700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4eb4099e20 0x7f4eb41c42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.813+0000 7f4eb8e72700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4eb41306a0 0x7f4eb41c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.813+0000 7f4eb8e72700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb412f9f0 con 0x7f4eb4099e20 2023-09-30T22:25:53.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.813+0000 7f4eb8e72700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb412fc40 con 0x7f4eb4099510 2023-09-30T22:25:53.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.813+0000 7f4eb8e72700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb408b3d0 con 0x7f4eb41306a0 2023-09-30T22:25:53.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.813+0000 7f4eb259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4eb4099510 0x7f4eb412e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.813+0000 7f4eb259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4eb4099510 0x7f4eb412e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:33536/0 (socket says 172.21.15.40:33536) 2023-09-30T22:25:53.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.813+0000 7f4eb259c700 1 -- 172.21.15.40:0/1906322834 learned_addr learned my addr 172.21.15.40:0/1906322834 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:53.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.813+0000 7f4eb2d9d700 1 --2- 172.21.15.40:0/1906322834 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4eb41306a0 0x7f4eb41c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.813+0000 7f4eb1d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4eb4099e20 0x7f4eb41c42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.814+0000 7f4eb2d9d700 1 -- 172.21.15.40:0/1906322834 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4eb4099510 msgr2=0x7f4eb412e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.814+0000 7f4eb2d9d700 1 --2- 172.21.15.40:0/1906322834 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4eb4099510 0x7f4eb412e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.814+0000 7f4eb2d9d700 1 -- 172.21.15.40:0/1906322834 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4eb4099e20 msgr2=0x7f4eb41c42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.814+0000 7f4eb2d9d700 1 --2- 172.21.15.40:0/1906322834 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4eb4099e20 0x7f4eb41c42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.814+0000 7f4eb2d9d700 1 -- 172.21.15.40:0/1906322834 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea400b7a0 con 0x7f4eb41306a0 2023-09-30T22:25:53.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.814+0000 7f4eb1d9b700 1 --2- 172.21.15.40:0/1906322834 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4eb4099e20 0x7f4eb41c42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:53.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.814+0000 7f4eb2d9d700 1 --2- 172.21.15.40:0/1906322834 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4eb41306a0 0x7f4eb41c47f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4eac00efc0 tx=0x7f4eac00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:53.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.814+0000 7f4ea2ffd700 1 -- 172.21.15.40:0/1906322834 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eac00cc90 con 0x7f4eb41306a0 2023-09-30T22:25:53.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.814+0000 7f4ea2ffd700 1 -- 172.21.15.40:0/1906322834 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eac00f040 con 0x7f4eb41306a0 2023-09-30T22:25:53.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.814+0000 7f4eb8e72700 1 -- 172.21.15.40:0/1906322834 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eb41c4d30 con 0x7f4eb41306a0 2023-09-30T22:25:53.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.814+0000 7f4ea2ffd700 1 -- 172.21.15.40:0/1906322834 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eac009e60 con 0x7f4eb41306a0 2023-09-30T22:25:53.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.814+0000 7f4eb8e72700 1 -- 172.21.15.40:0/1906322834 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eb412eb80 con 0x7f4eb41306a0 2023-09-30T22:25:53.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.815+0000 7f4ea2ffd700 1 -- 172.21.15.40:0/1906322834 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4eac014480 con 0x7f4eb41306a0 2023-09-30T22:25:53.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.815+0000 7f4ea2ffd700 1 -- 172.21.15.40:0/1906322834 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4eac040160 con 0x7f4eb41306a0 2023-09-30T22:25:53.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.815+0000 7f4eb8e72700 1 -- 172.21.15.40:0/1906322834 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eb4062380 con 0x7f4eb41306a0 2023-09-30T22:25:53.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.824+0000 7f4ea2ffd700 1 -- 172.21.15.40:0/1906322834 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4eac018020 con 0x7f4eb41306a0 2023-09-30T22:25:53.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.874+0000 7f68143c8700 1 Processor -- start 2023-09-30T22:25:53.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.874+0000 7f68143c8700 1 -- start start 2023-09-30T22:25:53.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.875+0000 7f68143c8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f680c12e590 0x7f680c12e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.875+0000 7f68143c8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f680c12d8a0 0x7f680c138c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.875+0000 7f68143c8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f680c09ab70 con 0x7f680c12eea0 2023-09-30T22:25:53.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.875+0000 7f68143c8700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f680c09b270 con 0x7f680c12d8a0 2023-09-30T22:25:53.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.875+0000 7f68143c8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f680c09bab0 con 0x7f680c12e590 2023-09-30T22:25:53.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.875+0000 7f6812164700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f680c12e590 0x7f680c12e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.875+0000 7f6811963700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f680c12eea0 0x7f680c12d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60052/0 (socket says 172.21.15.40:60052) 2023-09-30T22:25:53.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.875+0000 7f6811963700 1 -- 172.21.15.40:0/988113043 learned_addr learned my addr 172.21.15.40:0/988113043 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:53.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.875+0000 7f6812164700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f680c12e590 0x7f680c12e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:43560/0 (socket says 172.21.15.40:43560) 2023-09-30T22:25:53.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.875+0000 7f6812965700 1 --2- 172.21.15.40:0/988113043 >> v2:172.21.15.40:3300/0 conn(0x7f680c12d8a0 0x7f680c138c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.875+0000 7f6812164700 1 -- 172.21.15.40:0/988113043 >> v2:172.21.15.40:3300/0 conn(0x7f680c12d8a0 msgr2=0x7f680c138c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:53.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.875+0000 7f6812164700 1 --2- 172.21.15.40:0/988113043 >> v2:172.21.15.40:3300/0 conn(0x7f680c12d8a0 0x7f680c138c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.875+0000 7f6812164700 1 -- 172.21.15.40:0/988113043 >> v1:172.21.15.40:6789/0 conn(0x7f680c12eea0 legacy=0x7f680c12d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.875+0000 7f6812164700 1 -- 172.21.15.40:0/988113043 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680c09bd70 con 0x7f680c12e590 2023-09-30T22:25:53.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.875+0000 7f6812164700 1 --2- 172.21.15.40:0/988113043 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f680c12e590 0x7f680c12e960 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6808009870 tx=0x7f6808009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8647ae1d7ed33f1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:53.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.875+0000 7f6811162700 1 -- 172.21.15.40:0/988113043 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6808011830 con 0x7f680c12e590 2023-09-30T22:25:53.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.876+0000 7f6811162700 1 -- 172.21.15.40:0/988113043 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6808011990 con 0x7f680c12e590 2023-09-30T22:25:53.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.876+0000 7f6811162700 1 -- 172.21.15.40:0/988113043 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6808011d20 con 0x7f680c12e590 2023-09-30T22:25:53.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.876+0000 7f68143c8700 1 -- 172.21.15.40:0/988113043 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f680c12e590 msgr2=0x7f680c12e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.876+0000 7f68143c8700 1 --2- 172.21.15.40:0/988113043 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f680c12e590 0x7f680c12e960 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6808009870 tx=0x7f6808009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:53.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.876+0000 7f68143c8700 1 -- 172.21.15.40:0/988113043 shutdown_connections 2023-09-30T22:25:53.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.876+0000 7f68143c8700 1 --2- 172.21.15.40:0/988113043 >> v2:172.21.15.40:3300/0 conn(0x7f680c12d8a0 0x7f680c138c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.876+0000 7f68143c8700 1 --2- 172.21.15.40:0/988113043 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f680c12e590 0x7f680c12e960 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.876+0000 7f68143c8700 1 -- 172.21.15.40:0/988113043 >> 172.21.15.40:0/988113043 conn(0x7f680c0a2a00 msgr2=0x7f680c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:53.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.876+0000 7f68143c8700 1 -- 172.21.15.40:0/988113043 shutdown_connections 2023-09-30T22:25:53.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.876+0000 7f68143c8700 1 -- 172.21.15.40:0/988113043 wait complete. 2023-09-30T22:25:53.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.877+0000 7f68143c8700 1 Processor -- start 2023-09-30T22:25:53.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.877+0000 7f68143c8700 1 -- start start 2023-09-30T22:25:53.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.878+0000 7f68143c8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f680c12d8a0 0x7f680c138df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.878+0000 7f68143c8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f680c12e590 0x7f680c137660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.878+0000 7f68143c8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f680c12eea0 0x7f680c137ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.878+0000 7f68143c8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680c1344a0 con 0x7f680c12e590 2023-09-30T22:25:53.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.878+0000 7f68143c8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680c138710 con 0x7f680c12eea0 2023-09-30T22:25:53.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.878+0000 7f68143c8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f680c09dfc0 con 0x7f680c12d8a0 2023-09-30T22:25:53.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.878+0000 7f6812164700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f680c12d8a0 0x7f680c138df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.878+0000 7f6812164700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f680c12d8a0 0x7f680c138df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:43568/0 (socket says 172.21.15.40:43568) 2023-09-30T22:25:53.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.878+0000 7f6812164700 1 -- 172.21.15.40:0/4148707482 learned_addr learned my addr 172.21.15.40:0/4148707482 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:53.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.878+0000 7f6812965700 1 --2- 172.21.15.40:0/4148707482 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f680c12eea0 0x7f680c137ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.878+0000 7f6811963700 1 --2- 172.21.15.40:0/4148707482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f680c12e590 0x7f680c137660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.878+0000 7f6812164700 1 -- 172.21.15.40:0/4148707482 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f680c12eea0 msgr2=0x7f680c137ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.878+0000 7f6812164700 1 --2- 172.21.15.40:0/4148707482 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f680c12eea0 0x7f680c137ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.878+0000 7f6812164700 1 -- 172.21.15.40:0/4148707482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f680c12e590 msgr2=0x7f680c137660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.878+0000 7f6812164700 1 --2- 172.21.15.40:0/4148707482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f680c12e590 0x7f680c137660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.878+0000 7f6812164700 1 -- 172.21.15.40:0/4148707482 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68080094a0 con 0x7f680c12d8a0 2023-09-30T22:25:53.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.878+0000 7f6811963700 1 --2- 172.21.15.40:0/4148707482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f680c12e590 0x7f680c137660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:53.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.878+0000 7f6812164700 1 --2- 172.21.15.40:0/4148707482 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f680c12d8a0 0x7f680c138df0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f68080090b0 tx=0x7f6808004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:53.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.879+0000 7f6802ffd700 1 -- 172.21.15.40:0/4148707482 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68080036a0 con 0x7f680c12d8a0 2023-09-30T22:25:53.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.879+0000 7f6802ffd700 1 -- 172.21.15.40:0/4148707482 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f680801f070 con 0x7f680c12d8a0 2023-09-30T22:25:53.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.879+0000 7f68143c8700 1 -- 172.21.15.40:0/4148707482 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f680c09b4b0 con 0x7f680c12d8a0 2023-09-30T22:25:53.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.879+0000 7f6802ffd700 1 -- 172.21.15.40:0/4148707482 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6808003a40 con 0x7f680c12d8a0 2023-09-30T22:25:53.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.879+0000 7f68143c8700 1 -- 172.21.15.40:0/4148707482 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f680c137210 con 0x7f680c12d8a0 2023-09-30T22:25:53.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.880+0000 7f6802ffd700 1 -- 172.21.15.40:0/4148707482 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6808003ba0 con 0x7f680c12d8a0 2023-09-30T22:25:53.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.880+0000 7f6800ff9700 1 -- 172.21.15.40:0/4148707482 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67e80052e0 con 0x7f680c12d8a0 2023-09-30T22:25:53.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.880+0000 7f6802ffd700 1 -- 172.21.15.40:0/4148707482 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6808021070 con 0x7f680c12d8a0 2023-09-30T22:25:53.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.889+0000 7f6802ffd700 1 -- 172.21.15.40:0/4148707482 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6808019d80 con 0x7f680c12d8a0 2023-09-30T22:25:53.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.982+0000 7f4003a53700 1 -- 172.21.15.40:0/3849813058 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3ffc06fa30 con 0x7f3ffc09bc50 2023-09-30T22:25:53.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.983+0000 7f3ff1ffb700 1 -- 172.21.15.40:0/3849813058 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3ff8015020 con 0x7f3ffc09bc50 2023-09-30T22:25:53.984 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:53.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.985+0000 7f4003a53700 1 -- 172.21.15.40:0/3849813058 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ffc09bc50 msgr2=0x7f3ffc099a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.985+0000 7f4003a53700 1 --2- 172.21.15.40:0/3849813058 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ffc09bc50 0x7f3ffc099a70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc131a40 tx=0x7f3ff8004750 comp rx=0 tx=0).stop 2023-09-30T22:25:53.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.985+0000 7f4003a53700 1 -- 172.21.15.40:0/3849813058 shutdown_connections 2023-09-30T22:25:53.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.985+0000 7f4003a53700 1 --2- 172.21.15.40:0/3849813058 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ffc131d50 0x7f3ffc09a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.985+0000 7f4003a53700 1 --2- 172.21.15.40:0/3849813058 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ffc09bc50 0x7f3ffc099a70 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.985+0000 7f4003a53700 1 --2- 172.21.15.40:0/3849813058 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ffc09c7d0 0x7f3ffc099fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.985+0000 7f4003a53700 1 -- 172.21.15.40:0/3849813058 >> 172.21.15.40:0/3849813058 conn(0x7f3ffc0a2a00 msgr2=0x7f3ffc1b8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:53.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.985+0000 7f4003a53700 1 -- 172.21.15.40:0/3849813058 shutdown_connections 2023-09-30T22:25:53.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:53.985+0000 7f4003a53700 1 -- 172.21.15.40:0/3849813058 wait complete. 2023-09-30T22:25:53.998 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:54.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.022+0000 7f4eb8e72700 1 -- 172.21.15.40:0/1906322834 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4eb412e100 con 0x7f4eb41306a0 2023-09-30T22:25:54.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.023+0000 7f4ea2ffd700 1 -- 172.21.15.40:0/1906322834 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4eac02b090 con 0x7f4eb41306a0 2023-09-30T22:25:54.023 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:54.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.024+0000 7f4eb8e72700 1 -- 172.21.15.40:0/1906322834 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4eb41306a0 msgr2=0x7f4eb41c47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:54.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.024+0000 7f4eb8e72700 1 --2- 172.21.15.40:0/1906322834 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4eb41306a0 0x7f4eb41c47f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4eac00efc0 tx=0x7f4eac00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.025+0000 7f4eb8e72700 1 -- 172.21.15.40:0/1906322834 shutdown_connections 2023-09-30T22:25:54.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.025+0000 7f4eb8e72700 1 --2- 172.21.15.40:0/1906322834 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4eb41306a0 0x7f4eb41c47f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.025+0000 7f4eb8e72700 1 --2- 172.21.15.40:0/1906322834 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4eb4099510 0x7f4eb412e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.025+0000 7f4eb8e72700 1 --2- 172.21.15.40:0/1906322834 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4eb4099e20 0x7f4eb41c42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.025+0000 7f4eb8e72700 1 -- 172.21.15.40:0/1906322834 >> 172.21.15.40:0/1906322834 conn(0x7f4eb409eb10 msgr2=0x7f4eb40a07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:54.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.025+0000 7f4eb8e72700 1 -- 172.21.15.40:0/1906322834 shutdown_connections 2023-09-30T22:25:54.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.025+0000 7f4eb8e72700 1 -- 172.21.15.40:0/1906322834 wait complete. 2023-09-30T22:25:54.038 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:54.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.086+0000 7f6800ff9700 1 -- 172.21.15.40:0/4148707482 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f67e8005590 con 0x7f680c12d8a0 2023-09-30T22:25:54.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.086+0000 7f6802ffd700 1 -- 172.21.15.40:0/4148707482 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6808034020 con 0x7f680c12d8a0 2023-09-30T22:25:54.087 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:54.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.088+0000 7f6800ff9700 1 -- 172.21.15.40:0/4148707482 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f680c12d8a0 msgr2=0x7f680c138df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:54.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.088+0000 7f6800ff9700 1 --2- 172.21.15.40:0/4148707482 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f680c12d8a0 0x7f680c138df0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f68080090b0 tx=0x7f6808004750 comp rx=0 tx=0).stop 2023-09-30T22:25:54.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.088+0000 7f6800ff9700 1 -- 172.21.15.40:0/4148707482 shutdown_connections 2023-09-30T22:25:54.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.088+0000 7f6800ff9700 1 --2- 172.21.15.40:0/4148707482 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f680c12d8a0 0x7f680c138df0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.088+0000 7f6800ff9700 1 --2- 172.21.15.40:0/4148707482 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f680c12eea0 0x7f680c137ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.088+0000 7f6800ff9700 1 --2- 172.21.15.40:0/4148707482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f680c12e590 0x7f680c137660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.088+0000 7f6800ff9700 1 -- 172.21.15.40:0/4148707482 >> 172.21.15.40:0/4148707482 conn(0x7f680c0a2a00 msgr2=0x7f680c130e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:54.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.088+0000 7f6800ff9700 1 -- 172.21.15.40:0/4148707482 shutdown_connections 2023-09-30T22:25:54.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.089+0000 7f6800ff9700 1 -- 172.21.15.40:0/4148707482 wait complete. 2023-09-30T22:25:54.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:54.790 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:54.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.931+0000 7efdda4ab700 1 Processor -- start 2023-09-30T22:25:54.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.931+0000 7efdda4ab700 1 -- start start 2023-09-30T22:25:54.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.932+0000 7efdda4ab700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efdd4131d50 0x7efdd4132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:54.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.932+0000 7efdda4ab700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efdd409bc50 0x7efdd409c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:54.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.932+0000 7efdda4ab700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efdd409c600 0x7efdd4138ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:54.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.932+0000 7efdda4ab700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdd40719e0 con 0x7efdd4131d50 2023-09-30T22:25:54.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.932+0000 7efdda4ab700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd4132660 con 0x7efdd409bc50 2023-09-30T22:25:54.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.932+0000 7efdda4ab700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efdd409ca50 con 0x7efdd409c600 2023-09-30T22:25:54.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.932+0000 7efdd37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efdd409bc50 0x7efdd409c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:54.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.932+0000 7efdd3fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efdd4131d50 0x7efdd4132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:54.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.932+0000 7efdd8a48700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efdd409c600 0x7efdd4138ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:54.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.932+0000 7efdd3fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efdd4131d50 0x7efdd4132120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45110/0 (socket says 172.21.15.40:45110) 2023-09-30T22:25:54.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.932+0000 7efdd37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efdd409bc50 0x7efdd409c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:33554/0 (socket says 172.21.15.40:33554) 2023-09-30T22:25:54.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.932+0000 7efdd3fff700 1 -- 172.21.15.40:0/2794297632 learned_addr learned my addr 172.21.15.40:0/2794297632 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:54.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.932+0000 7efdd8a48700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efdd409c600 0x7efdd4138ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:43576/0 (socket says 172.21.15.40:43576) 2023-09-30T22:25:54.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.933+0000 7efdd37fe700 1 -- 172.21.15.40:0/2794297632 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efdd409c600 msgr2=0x7efdd4138ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:54.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.933+0000 7efdd37fe700 1 --2- 172.21.15.40:0/2794297632 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efdd409c600 0x7efdd4138ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.933+0000 7efdd37fe700 1 -- 172.21.15.40:0/2794297632 >> v2:172.21.15.40:3300/0 conn(0x7efdd4131d50 msgr2=0x7efdd4132120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:54.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.933+0000 7efdd37fe700 1 --2- 172.21.15.40:0/2794297632 >> v2:172.21.15.40:3300/0 conn(0x7efdd4131d50 0x7efdd4132120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.933+0000 7efdd37fe700 1 -- 172.21.15.40:0/2794297632 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd4131900 con 0x7efdd409bc50 2023-09-30T22:25:54.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.933+0000 7efdd8a48700 1 --2- 172.21.15.40:0/2794297632 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efdd409c600 0x7efdd4138ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:54.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.933+0000 7efdd37fe700 1 --2- 172.21.15.40:0/2794297632 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efdd409bc50 0x7efdd409c0c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efdc8009840 tx=0x7efdc8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=617f64c7df66e46b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:54.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.933+0000 7efdd2ffd700 1 -- 172.21.15.40:0/2794297632 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc8011830 con 0x7efdd409bc50 2023-09-30T22:25:54.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.933+0000 7efdd2ffd700 1 -- 172.21.15.40:0/2794297632 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc8011990 con 0x7efdd409bc50 2023-09-30T22:25:54.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.933+0000 7efdd2ffd700 1 -- 172.21.15.40:0/2794297632 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc8011d20 con 0x7efdd409bc50 2023-09-30T22:25:54.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.934+0000 7efdda4ab700 1 -- 172.21.15.40:0/2794297632 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efdd409bc50 msgr2=0x7efdd409c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:54.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.934+0000 7efdda4ab700 1 --2- 172.21.15.40:0/2794297632 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efdd409bc50 0x7efdd409c0c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efdc8009840 tx=0x7efdc8009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:54.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.934+0000 7efdda4ab700 1 -- 172.21.15.40:0/2794297632 shutdown_connections 2023-09-30T22:25:54.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.934+0000 7efdda4ab700 1 --2- 172.21.15.40:0/2794297632 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efdd409c600 0x7efdd4138ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.934+0000 7efdda4ab700 1 --2- 172.21.15.40:0/2794297632 >> v2:172.21.15.40:3300/0 conn(0x7efdd4131d50 0x7efdd4132120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.934+0000 7efdda4ab700 1 --2- 172.21.15.40:0/2794297632 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efdd409bc50 0x7efdd409c0c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.934+0000 7efdda4ab700 1 -- 172.21.15.40:0/2794297632 >> 172.21.15.40:0/2794297632 conn(0x7efdd40a2a00 msgr2=0x7efdd40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:54.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.934+0000 7efdda4ab700 1 -- 172.21.15.40:0/2794297632 shutdown_connections 2023-09-30T22:25:54.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.934+0000 7efdda4ab700 1 -- 172.21.15.40:0/2794297632 wait complete. 2023-09-30T22:25:54.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.935+0000 7efdda4ab700 1 Processor -- start 2023-09-30T22:25:54.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.935+0000 7efdda4ab700 1 -- start start 2023-09-30T22:25:54.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.935+0000 7efdda4ab700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdd409bc50 0x7efdd411bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:54.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.935+0000 7efdda4ab700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efdd409c600 0x7efdd411c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:54.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.936+0000 7efdda4ab700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efdd4131d50 0x7efdd411c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:54.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.936+0000 7efdda4ab700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd411ef50 con 0x7efdd409bc50 2023-09-30T22:25:54.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.936+0000 7efdda4ab700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd412ee50 con 0x7efdd4131d50 2023-09-30T22:25:54.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.936+0000 7efdda4ab700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efdd411e6d0 con 0x7efdd409c600 2023-09-30T22:25:54.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.936+0000 7efdd3fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdd409bc50 0x7efdd411bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:54.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.936+0000 7efdd37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efdd409c600 0x7efdd411c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:54.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.936+0000 7efdd3fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdd409bc50 0x7efdd411bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45126/0 (socket says 172.21.15.40:45126) 2023-09-30T22:25:54.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.936+0000 7efdd3fff700 1 -- 172.21.15.40:0/2677785695 learned_addr learned my addr 172.21.15.40:0/2677785695 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:54.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.936+0000 7efdd8a48700 1 --2- 172.21.15.40:0/2677785695 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efdd4131d50 0x7efdd411c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:54.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.936+0000 7efdd3fff700 1 -- 172.21.15.40:0/2677785695 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efdd409c600 msgr2=0x7efdd411c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:54.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.936+0000 7efdd3fff700 1 --2- 172.21.15.40:0/2677785695 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efdd409c600 0x7efdd411c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.936+0000 7efdd3fff700 1 -- 172.21.15.40:0/2677785695 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efdd4131d50 msgr2=0x7efdd411c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:54.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.936+0000 7efdd3fff700 1 --2- 172.21.15.40:0/2677785695 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efdd4131d50 0x7efdd411c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:54.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.936+0000 7efdd3fff700 1 -- 172.21.15.40:0/2677785695 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdcc009a70 con 0x7efdd409bc50 2023-09-30T22:25:54.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.936+0000 7efdd37fe700 1 --2- 172.21.15.40:0/2677785695 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efdd409c600 0x7efdd411c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:54.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.936+0000 7efdd3fff700 1 --2- 172.21.15.40:0/2677785695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdd409bc50 0x7efdd411bd40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7efdc400e910 tx=0x7efdc400ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:54.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.936+0000 7efdd0ff9700 1 -- 172.21.15.40:0/2677785695 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc40096a0 con 0x7efdd409bc50 2023-09-30T22:25:54.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.936+0000 7efdd0ff9700 1 -- 172.21.15.40:0/2677785695 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc400c640 con 0x7efdd409bc50 2023-09-30T22:25:54.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.936+0000 7efdda4ab700 1 -- 172.21.15.40:0/2677785695 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc80094a0 con 0x7efdd409bc50 2023-09-30T22:25:54.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.936+0000 7efdd0ff9700 1 -- 172.21.15.40:0/2677785695 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc400c9f0 con 0x7efdd409bc50 2023-09-30T22:25:54.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.936+0000 7efdda4ab700 1 -- 172.21.15.40:0/2677785695 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd411fcc0 con 0x7efdd409bc50 2023-09-30T22:25:54.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.937+0000 7efdd0ff9700 1 -- 172.21.15.40:0/2677785695 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efdc400cb50 con 0x7efdd409bc50 2023-09-30T22:25:54.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.937+0000 7efdd0ff9700 1 -- 172.21.15.40:0/2677785695 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7efdc403f6b0 con 0x7efdd409bc50 2023-09-30T22:25:54.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.937+0000 7efdda4ab700 1 -- 172.21.15.40:0/2677785695 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd4062380 con 0x7efdd409bc50 2023-09-30T22:25:54.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:54.942+0000 7efdd0ff9700 1 -- 172.21.15.40:0/2677785695 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efdc4013470 con 0x7efdd409bc50 2023-09-30T22:25:54.999 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:55.039 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:55.102 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:55.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.128+0000 7f7e8546f700 1 Processor -- start 2023-09-30T22:25:55.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.129+0000 7f7e8546f700 1 -- start start 2023-09-30T22:25:55.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.129+0000 7f7e8546f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e8009e030 0x7f7e8013d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.129+0000 7f7e8546f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e8009e420 0x7f7e8013f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.129+0000 7f7e8546f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e8011d980 con 0x7f7e8006a6d0 2023-09-30T22:25:55.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.129+0000 7f7e8546f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8006aaa0 con 0x7f7e8009e030 2023-09-30T22:25:55.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.129+0000 7f7e8546f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8006b150 con 0x7f7e8009e420 2023-09-30T22:25:55.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.129+0000 7f7e7effd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7e8006a6d0 0x7f7e8009d920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60058/0 (socket says 172.21.15.40:60058) 2023-09-30T22:25:55.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.129+0000 7f7e7effd700 1 -- 172.21.15.40:0/3997453499 learned_addr learned my addr 172.21.15.40:0/3997453499 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:55.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.129+0000 7f7e7f7fe700 1 --2- 172.21.15.40:0/3997453499 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e8009e420 0x7f7e8013f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.129+0000 7f7e7dffb700 1 -- 172.21.15.40:0/3997453499 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 472338887 0 0) 0x7f7e8011d980 con 0x7f7e8006a6d0 2023-09-30T22:25:55.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.130+0000 7f7e7dffb700 1 -- 172.21.15.40:0/3997453499 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e680035b0 con 0x7f7e8006a6d0 2023-09-30T22:25:55.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.130+0000 7f7e7e7fc700 1 --2- 172.21.15.40:0/3997453499 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e8009e030 0x7f7e8013d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.130+0000 7f7e7f7fe700 1 -- 172.21.15.40:0/3997453499 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e8009e030 msgr2=0x7f7e8013d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:55.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.130+0000 7f7e7f7fe700 1 --2- 172.21.15.40:0/3997453499 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e8009e030 0x7f7e8013d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.130+0000 7f7e7f7fe700 1 -- 172.21.15.40:0/3997453499 >> v1:172.21.15.40:6789/0 conn(0x7f7e8006a6d0 legacy=0x7f7e8009d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.130+0000 7f7e7dffb700 1 -- 172.21.15.40:0/3997453499 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4249572420 0 0) 0x7f7e680035b0 con 0x7f7e8006a6d0 2023-09-30T22:25:55.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.130+0000 7f7e7f7fe700 1 -- 172.21.15.40:0/3997453499 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8009f300 con 0x7f7e8009e420 2023-09-30T22:25:55.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.130+0000 7f7e7f7fe700 1 --2- 172.21.15.40:0/3997453499 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e8009e420 0x7f7e8013f9f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7e78009dc0 tx=0x7f7e7800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d23e7e97c0dbc816 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:55.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.130+0000 7f7e7dffb700 1 -- 172.21.15.40:0/3997453499 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7800e070 con 0x7f7e8009e420 2023-09-30T22:25:55.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.130+0000 7f7e7dffb700 1 -- 172.21.15.40:0/3997453499 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e78003a20 con 0x7f7e8009e420 2023-09-30T22:25:55.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.130+0000 7f7e7dffb700 1 -- 172.21.15.40:0/3997453499 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e700017f0 con 0x7f7e8009e420 2023-09-30T22:25:55.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.131+0000 7f7e8546f700 1 -- 172.21.15.40:0/3997453499 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e8009e420 msgr2=0x7f7e8013f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.131+0000 7f7e8546f700 1 --2- 172.21.15.40:0/3997453499 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e8009e420 0x7f7e8013f9f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7e78009dc0 tx=0x7f7e7800b330 comp rx=0 tx=0).stop 2023-09-30T22:25:55.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.132+0000 7f7e8546f700 1 -- 172.21.15.40:0/3997453499 shutdown_connections 2023-09-30T22:25:55.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.132+0000 7f7e8546f700 1 --2- 172.21.15.40:0/3997453499 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e8009e420 0x7f7e8013f9f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.132+0000 7f7e8546f700 1 --2- 172.21.15.40:0/3997453499 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e8009e030 0x7f7e8013d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.132+0000 7f7e8546f700 1 -- 172.21.15.40:0/3997453499 >> 172.21.15.40:0/3997453499 conn(0x7f7e8009fb20 msgr2=0x7f7e8009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:55.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.132+0000 7f7e8546f700 1 -- 172.21.15.40:0/3997453499 shutdown_connections 2023-09-30T22:25:55.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.132+0000 7f7e8546f700 1 -- 172.21.15.40:0/3997453499 wait complete. 2023-09-30T22:25:55.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.133+0000 7f7e8546f700 1 Processor -- start 2023-09-30T22:25:55.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.133+0000 7f7e8546f700 1 -- start start 2023-09-30T22:25:55.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.134+0000 7f7e8546f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e8006a6d0 0x7f7e80131180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.134+0000 7f7e8546f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e8009e030 0x7f7e8011c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.134+0000 7f7e8546f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e8009e420 0x7f7e8011ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.134+0000 7f7e8546f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e80123620 con 0x7f7e8009e030 2023-09-30T22:25:55.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.134+0000 7f7e8546f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8011e500 con 0x7f7e8009e420 2023-09-30T22:25:55.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.134+0000 7f7e8546f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e800a2510 con 0x7f7e8006a6d0 2023-09-30T22:25:55.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.134+0000 7f7e7e7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e8009e030 0x7f7e8011c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.134+0000 7f7e7e7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e8009e030 0x7f7e8011c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45130/0 (socket says 172.21.15.40:45130) 2023-09-30T22:25:55.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.134+0000 7f7e7e7fc700 1 -- 172.21.15.40:0/1058888594 learned_addr learned my addr 172.21.15.40:0/1058888594 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:55.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.134+0000 7f7e7effd700 1 --2- 172.21.15.40:0/1058888594 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e8006a6d0 0x7f7e80131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.134+0000 7f7e7e7fc700 1 -- 172.21.15.40:0/1058888594 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e8006a6d0 msgr2=0x7f7e80131180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.134+0000 7f7e7e7fc700 1 --2- 172.21.15.40:0/1058888594 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e8006a6d0 0x7f7e80131180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.134+0000 7f7e7e7fc700 1 -- 172.21.15.40:0/1058888594 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e8009e420 msgr2=0x7f7e8011ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.134+0000 7f7e7e7fc700 1 --2- 172.21.15.40:0/1058888594 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e8009e420 0x7f7e8011ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.134+0000 7f7e7e7fc700 1 -- 172.21.15.40:0/1058888594 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e78009a70 con 0x7f7e8009e030 2023-09-30T22:25:55.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.134+0000 7f7e7e7fc700 1 --2- 172.21.15.40:0/1058888594 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e8009e030 0x7f7e8011c910 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7e7400e810 tx=0x7f7e7400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:55.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.134+0000 7f7e677fe700 1 -- 172.21.15.40:0/1058888594 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e74013610 con 0x7f7e8009e030 2023-09-30T22:25:55.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.134+0000 7f7e677fe700 1 -- 172.21.15.40:0/1058888594 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e74013770 con 0x7f7e8009e030 2023-09-30T22:25:55.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.134+0000 7f7e677fe700 1 -- 172.21.15.40:0/1058888594 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e74013b20 con 0x7f7e8009e030 2023-09-30T22:25:55.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.135+0000 7f7e8546f700 1 -- 172.21.15.40:0/1058888594 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e8009f540 con 0x7f7e8009e030 2023-09-30T22:25:55.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.135+0000 7f7e8546f700 1 -- 172.21.15.40:0/1058888594 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e8011ffb0 con 0x7f7e8009e030 2023-09-30T22:25:55.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.136+0000 7f7e8546f700 1 -- 172.21.15.40:0/1058888594 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e80062380 con 0x7f7e8009e030 2023-09-30T22:25:55.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.136+0000 7f7e677fe700 1 -- 172.21.15.40:0/1058888594 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7e74013c80 con 0x7f7e8009e030 2023-09-30T22:25:55.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.136+0000 7f7e677fe700 1 -- 172.21.15.40:0/1058888594 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f7e7403f8e0 con 0x7f7e8009e030 2023-09-30T22:25:55.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.141+0000 7f7e677fe700 1 -- 172.21.15.40:0/1058888594 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e74026480 con 0x7f7e8009e030 2023-09-30T22:25:55.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.151+0000 7efdda4ab700 1 -- 172.21.15.40:0/2677785695 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efdd409ea60 con 0x7efdd409bc50 2023-09-30T22:25:55.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.152+0000 7efdd0ff9700 1 -- 172.21.15.40:0/2677785695 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efdc4021030 con 0x7efdd409bc50 2023-09-30T22:25:55.152 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:55.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.155+0000 7efdda4ab700 1 -- 172.21.15.40:0/2677785695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdd409bc50 msgr2=0x7efdd411bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.155+0000 7efdda4ab700 1 --2- 172.21.15.40:0/2677785695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdd409bc50 0x7efdd411bd40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7efdc400e910 tx=0x7efdc400ec20 comp rx=0 tx=0).stop 2023-09-30T22:25:55.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.155+0000 7efdda4ab700 1 -- 172.21.15.40:0/2677785695 shutdown_connections 2023-09-30T22:25:55.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.155+0000 7efdda4ab700 1 --2- 172.21.15.40:0/2677785695 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efdd4131d50 0x7efdd411c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.155+0000 7efdda4ab700 1 --2- 172.21.15.40:0/2677785695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdd409bc50 0x7efdd411bd40 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.155+0000 7efdda4ab700 1 --2- 172.21.15.40:0/2677785695 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efdd409c600 0x7efdd411c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.155+0000 7efdda4ab700 1 -- 172.21.15.40:0/2677785695 >> 172.21.15.40:0/2677785695 conn(0x7efdd40a2a00 msgr2=0x7efdd40a0900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:55.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.155+0000 7efdda4ab700 1 -- 172.21.15.40:0/2677785695 shutdown_connections 2023-09-30T22:25:55.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.155+0000 7efdda4ab700 1 -- 172.21.15.40:0/2677785695 wait complete. 2023-09-30T22:25:55.174 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:55.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.178+0000 7f40423b9700 1 Processor -- start 2023-09-30T22:25:55.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.178+0000 7f40423b9700 1 -- start start 2023-09-30T22:25:55.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.179+0000 7f40423b9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f403c12e590 0x7f403c12e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.179+0000 7f40423b9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f403c12eea0 0x7f403c12d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.179+0000 7f40423b9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f403c09ab70 con 0x7f403c12d6d0 2023-09-30T22:25:55.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.179+0000 7f40423b9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f403c09b270 con 0x7f403c12eea0 2023-09-30T22:25:55.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.179+0000 7f40423b9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f403c09bab0 con 0x7f403c12e590 2023-09-30T22:25:55.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.179+0000 7f403b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f403c12eea0 0x7f403c12d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.179+0000 7f403b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f403c12eea0 0x7f403c12d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45140/0 (socket says 172.21.15.40:45140) 2023-09-30T22:25:55.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.179+0000 7f403b7fe700 1 -- 172.21.15.40:0/587092044 learned_addr learned my addr 172.21.15.40:0/587092044 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:55.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.179+0000 7f403bfff700 1 --2- 172.21.15.40:0/587092044 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f403c12e590 0x7f403c12e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.179+0000 7f403b7fe700 1 -- 172.21.15.40:0/587092044 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f403c12e590 msgr2=0x7f403c12e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:55.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.179+0000 7f403b7fe700 1 --2- 172.21.15.40:0/587092044 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f403c12e590 0x7f403c12e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.179+0000 7f403b7fe700 1 -- 172.21.15.40:0/587092044 >> v1:172.21.15.40:6789/0 conn(0x7f403c12d6d0 legacy=0x7f403c137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.179+0000 7f403b7fe700 1 -- 172.21.15.40:0/587092044 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f403c09bd70 con 0x7f403c12eea0 2023-09-30T22:25:55.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.179+0000 7f403b7fe700 1 --2- 172.21.15.40:0/587092044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f403c12eea0 0x7f403c12d190 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f403000bbc0 tx=0x7f403000bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c857ccc5d72d9f94 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:55.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.180+0000 7f403affd700 1 -- 172.21.15.40:0/587092044 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403000dcf0 con 0x7f403c12eea0 2023-09-30T22:25:55.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.180+0000 7f403affd700 1 -- 172.21.15.40:0/587092044 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403000de50 con 0x7f403c12eea0 2023-09-30T22:25:55.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.180+0000 7f403affd700 1 -- 172.21.15.40:0/587092044 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4030010690 con 0x7f403c12eea0 2023-09-30T22:25:55.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.180+0000 7f40423b9700 1 -- 172.21.15.40:0/587092044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f403c12eea0 msgr2=0x7f403c12d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.180+0000 7f40423b9700 1 --2- 172.21.15.40:0/587092044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f403c12eea0 0x7f403c12d190 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f403000bbc0 tx=0x7f403000bed0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.181+0000 7f40423b9700 1 -- 172.21.15.40:0/587092044 shutdown_connections 2023-09-30T22:25:55.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.181+0000 7f40423b9700 1 --2- 172.21.15.40:0/587092044 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f403c12e590 0x7f403c12e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.181+0000 7f40423b9700 1 --2- 172.21.15.40:0/587092044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f403c12eea0 0x7f403c12d190 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.181+0000 7f40423b9700 1 -- 172.21.15.40:0/587092044 >> 172.21.15.40:0/587092044 conn(0x7f403c0a2a00 msgr2=0x7f403c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:55.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.181+0000 7f40423b9700 1 -- 172.21.15.40:0/587092044 shutdown_connections 2023-09-30T22:25:55.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.181+0000 7f40423b9700 1 -- 172.21.15.40:0/587092044 wait complete. 2023-09-30T22:25:55.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.182+0000 7f40423b9700 1 Processor -- start 2023-09-30T22:25:55.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.182+0000 7f40423b9700 1 -- start start 2023-09-30T22:25:55.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.183+0000 7f40423b9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f403c12d6d0 0x7f403c11ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.183+0000 7f40423b9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f403c12e590 0x7f403c11b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.183+0000 7f40423b9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f403c12eea0 0x7f403c11b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.183+0000 7f40423b9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f403c11e5e0 con 0x7f403c12d6d0 2023-09-30T22:25:55.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.183+0000 7f40423b9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f403c11ccf0 con 0x7f403c12eea0 2023-09-30T22:25:55.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.183+0000 7f40423b9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f403c11dd70 con 0x7f403c12e590 2023-09-30T22:25:55.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.183+0000 7f403b7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f403c12e590 0x7f403c11b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.183+0000 7f403b7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f403c12e590 0x7f403c11b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:43614/0 (socket says 172.21.15.40:43614) 2023-09-30T22:25:55.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.183+0000 7f403b7fe700 1 -- 172.21.15.40:0/1044291490 learned_addr learned my addr 172.21.15.40:0/1044291490 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:55.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.183+0000 7f403bfff700 1 --2- 172.21.15.40:0/1044291490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f403c12d6d0 0x7f403c11ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.183+0000 7f403b7fe700 1 -- 172.21.15.40:0/1044291490 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f403c12eea0 msgr2=0x7f403c11b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.183+0000 7f403b7fe700 1 --2- 172.21.15.40:0/1044291490 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f403c12eea0 0x7f403c11b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.183+0000 7f403b7fe700 1 -- 172.21.15.40:0/1044291490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f403c12d6d0 msgr2=0x7f403c11ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.183+0000 7f403b7fe700 1 --2- 172.21.15.40:0/1044291490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f403c12d6d0 0x7f403c11ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.183+0000 7f403b7fe700 1 -- 172.21.15.40:0/1044291490 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f403000b7f0 con 0x7f403c12e590 2023-09-30T22:25:55.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.183+0000 7f403bfff700 1 --2- 172.21.15.40:0/1044291490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f403c12d6d0 0x7f403c11ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:55.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.184+0000 7f403b7fe700 1 --2- 172.21.15.40:0/1044291490 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f403c12e590 0x7f403c11b050 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4030015000 tx=0x7f4030004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:55.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.184+0000 7f4038ff9700 1 -- 172.21.15.40:0/1044291490 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403001f070 con 0x7f403c12e590 2023-09-30T22:25:55.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.184+0000 7f4038ff9700 1 -- 172.21.15.40:0/1044291490 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4030003970 con 0x7f403c12e590 2023-09-30T22:25:55.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.184+0000 7f40423b9700 1 -- 172.21.15.40:0/1044291490 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f403c09cdb0 con 0x7f403c12e590 2023-09-30T22:25:55.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.184+0000 7f4038ff9700 1 -- 172.21.15.40:0/1044291490 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4030003d20 con 0x7f403c12e590 2023-09-30T22:25:55.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.184+0000 7f40423b9700 1 -- 172.21.15.40:0/1044291490 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f403c12cea0 con 0x7f403c12e590 2023-09-30T22:25:55.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.185+0000 7f4038ff9700 1 -- 172.21.15.40:0/1044291490 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4030019400 con 0x7f403c12e590 2023-09-30T22:25:55.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.185+0000 7f4038ff9700 1 -- 172.21.15.40:0/1044291490 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4030042ac0 con 0x7f403c12e590 2023-09-30T22:25:55.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.185+0000 7f40423b9700 1 -- 172.21.15.40:0/1044291490 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f403c062380 con 0x7f403c12e590 2023-09-30T22:25:55.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.190+0000 7f4038ff9700 1 -- 172.21.15.40:0/1044291490 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f403000f3d0 con 0x7f403c12e590 2023-09-30T22:25:55.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.239+0000 7f606a5c7700 1 Processor -- start 2023-09-30T22:25:55.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.239+0000 7f606a5c7700 1 -- start start 2023-09-30T22:25:55.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.240+0000 7f606a5c7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f606409c890 0x7f606409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.240+0000 7f606a5c7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f606409d920 0x7f606409dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.240+0000 7f606a5c7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60640a2600 con 0x7f606409e2b0 2023-09-30T22:25:55.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.240+0000 7f606a5c7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60640a29d0 con 0x7f606409d920 2023-09-30T22:25:55.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.240+0000 7f606a5c7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f606409fb40 con 0x7f606409c890 2023-09-30T22:25:55.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.240+0000 7f6063fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f606409c890 0x7f606409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.240+0000 7f6068b64700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f606409e2b0 0x7f606413ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60070/0 (socket says 172.21.15.40:60070) 2023-09-30T22:25:55.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.240+0000 7f6068b64700 1 -- 172.21.15.40:0/244552193 learned_addr learned my addr 172.21.15.40:0/244552193 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:55.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.240+0000 7f60637fe700 1 --2- 172.21.15.40:0/244552193 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f606409d920 0x7f606409dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.240+0000 7f6063fff700 1 -- 172.21.15.40:0/244552193 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f606409d920 msgr2=0x7f606409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:55.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.240+0000 7f6063fff700 1 --2- 172.21.15.40:0/244552193 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f606409d920 0x7f606409dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.240+0000 7f6063fff700 1 -- 172.21.15.40:0/244552193 >> v1:172.21.15.40:6789/0 conn(0x7f606409e2b0 legacy=0x7f606413ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.240+0000 7f6063fff700 1 -- 172.21.15.40:0/244552193 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606409e720 con 0x7f606409c890 2023-09-30T22:25:55.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.240+0000 7f60637fe700 1 --2- 172.21.15.40:0/244552193 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f606409d920 0x7f606409dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:55.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.241+0000 7f6063fff700 1 --2- 172.21.15.40:0/244552193 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f606409c890 0x7f606409cc60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6054009850 tx=0x7f6054009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=290823098648aaa2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:55.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.241+0000 7f6062ffd700 1 -- 172.21.15.40:0/244552193 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6054005e30 con 0x7f606409c890 2023-09-30T22:25:55.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.241+0000 7f6062ffd700 1 -- 172.21.15.40:0/244552193 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6054006030 con 0x7f606409c890 2023-09-30T22:25:55.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.241+0000 7f6062ffd700 1 -- 172.21.15.40:0/244552193 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60540063e0 con 0x7f606409c890 2023-09-30T22:25:55.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.241+0000 7f606a5c7700 1 -- 172.21.15.40:0/244552193 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f606409c890 msgr2=0x7f606409cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.241+0000 7f606a5c7700 1 --2- 172.21.15.40:0/244552193 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f606409c890 0x7f606409cc60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6054009850 tx=0x7f6054009b60 comp rx=0 tx=0).stop 2023-09-30T22:25:55.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.241+0000 7f606a5c7700 1 -- 172.21.15.40:0/244552193 shutdown_connections 2023-09-30T22:25:55.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.241+0000 7f606a5c7700 1 --2- 172.21.15.40:0/244552193 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f606409c890 0x7f606409cc60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.241+0000 7f606a5c7700 1 --2- 172.21.15.40:0/244552193 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f606409d920 0x7f606409dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.241+0000 7f606a5c7700 1 -- 172.21.15.40:0/244552193 >> 172.21.15.40:0/244552193 conn(0x7f60640a7080 msgr2=0x7f60640a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:55.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.241+0000 7f606a5c7700 1 -- 172.21.15.40:0/244552193 shutdown_connections 2023-09-30T22:25:55.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.242+0000 7f606a5c7700 1 -- 172.21.15.40:0/244552193 wait complete. 2023-09-30T22:25:55.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.243+0000 7f606a5c7700 1 Processor -- start 2023-09-30T22:25:55.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.243+0000 7f606a5c7700 1 -- start start 2023-09-30T22:25:55.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.244+0000 7f606a5c7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f606409c890 0x7f60641c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.244+0000 7f606a5c7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f606409d920 0x7f60641c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.244+0000 7f606a5c7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f606409e2b0 0x7f606412d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.244+0000 7f606a5c7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6064130740 con 0x7f606409c890 2023-09-30T22:25:55.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.244+0000 7f606a5c7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60640a5d60 con 0x7f606409e2b0 2023-09-30T22:25:55.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.244+0000 7f606a5c7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f606409ecf0 con 0x7f606409d920 2023-09-30T22:25:55.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.244+0000 7f60637fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f606409d920 0x7f60641c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.244+0000 7f60637fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f606409d920 0x7f60641c9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:43632/0 (socket says 172.21.15.40:43632) 2023-09-30T22:25:55.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.244+0000 7f60637fe700 1 -- 172.21.15.40:0/3881019081 learned_addr learned my addr 172.21.15.40:0/3881019081 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:55.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.244+0000 7f6063fff700 1 --2- 172.21.15.40:0/3881019081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f606409c890 0x7f60641c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.244+0000 7f6068b64700 1 --2- 172.21.15.40:0/3881019081 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f606409e2b0 0x7f606412d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.244+0000 7f6063fff700 1 -- 172.21.15.40:0/3881019081 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f606409d920 msgr2=0x7f60641c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.244+0000 7f6063fff700 1 --2- 172.21.15.40:0/3881019081 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f606409d920 0x7f60641c9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.244+0000 7f6063fff700 1 -- 172.21.15.40:0/3881019081 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f606409e2b0 msgr2=0x7f606412d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.244+0000 7f6063fff700 1 --2- 172.21.15.40:0/3881019081 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f606409e2b0 0x7f606412d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.244+0000 7f6063fff700 1 -- 172.21.15.40:0/3881019081 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60580094a0 con 0x7f606409c890 2023-09-30T22:25:55.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.245+0000 7f6063fff700 1 --2- 172.21.15.40:0/3881019081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f606409c890 0x7f60641c8c50 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6054015000 tx=0x7f6054004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:55.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.245+0000 7f6060ff9700 1 -- 172.21.15.40:0/3881019081 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6054004040 con 0x7f606409c890 2023-09-30T22:25:55.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.245+0000 7f6060ff9700 1 -- 172.21.15.40:0/3881019081 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60540041a0 con 0x7f606409c890 2023-09-30T22:25:55.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.245+0000 7f606a5c7700 1 -- 172.21.15.40:0/3881019081 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6054009430 con 0x7f606409c890 2023-09-30T22:25:55.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.245+0000 7f6060ff9700 1 -- 172.21.15.40:0/3881019081 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6054004550 con 0x7f606409c890 2023-09-30T22:25:55.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.245+0000 7f606a5c7700 1 -- 172.21.15.40:0/3881019081 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6064130ce0 con 0x7f606409c890 2023-09-30T22:25:55.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.246+0000 7f6060ff9700 1 -- 172.21.15.40:0/3881019081 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6054022020 con 0x7f606409c890 2023-09-30T22:25:55.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.246+0000 7f606a5c7700 1 -- 172.21.15.40:0/3881019081 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6064062380 con 0x7f606409c890 2023-09-30T22:25:55.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.246+0000 7f6060ff9700 1 -- 172.21.15.40:0/3881019081 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6054040cc0 con 0x7f606409c890 2023-09-30T22:25:55.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.255+0000 7f6060ff9700 1 -- 172.21.15.40:0/3881019081 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f605402a030 con 0x7f606409c890 2023-09-30T22:25:55.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.361+0000 7f7e8546f700 1 -- 172.21.15.40:0/1058888594 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7e80074720 con 0x7f7e8009e030 2023-09-30T22:25:55.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.362+0000 7f7e677fe700 1 -- 172.21.15.40:0/1058888594 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7e7402b090 con 0x7f7e8009e030 2023-09-30T22:25:55.363 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:55.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.364+0000 7f7e8546f700 1 -- 172.21.15.40:0/1058888594 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e8009e030 msgr2=0x7f7e8011c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.364+0000 7f7e8546f700 1 --2- 172.21.15.40:0/1058888594 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e8009e030 0x7f7e8011c910 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7e7400e810 tx=0x7f7e7400ebd0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.364+0000 7f7e8546f700 1 -- 172.21.15.40:0/1058888594 shutdown_connections 2023-09-30T22:25:55.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.364+0000 7f7e8546f700 1 --2- 172.21.15.40:0/1058888594 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e8006a6d0 0x7f7e80131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.364+0000 7f7e8546f700 1 --2- 172.21.15.40:0/1058888594 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e8009e420 0x7f7e8011ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.364+0000 7f7e8546f700 1 --2- 172.21.15.40:0/1058888594 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e8009e030 0x7f7e8011c910 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.364+0000 7f7e8546f700 1 -- 172.21.15.40:0/1058888594 >> 172.21.15.40:0/1058888594 conn(0x7f7e8009fb20 msgr2=0x7f7e80123840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:55.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.364+0000 7f7e8546f700 1 -- 172.21.15.40:0/1058888594 shutdown_connections 2023-09-30T22:25:55.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.364+0000 7f7e8546f700 1 -- 172.21.15.40:0/1058888594 wait complete. 2023-09-30T22:25:55.378 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:55.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.390+0000 7f40423b9700 1 -- 172.21.15.40:0/1044291490 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f403c11d920 con 0x7f403c12e590 2023-09-30T22:25:55.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.391+0000 7f4038ff9700 1 -- 172.21.15.40:0/1044291490 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f403002a310 con 0x7f403c12e590 2023-09-30T22:25:55.391 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:55.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.393+0000 7f40423b9700 1 -- 172.21.15.40:0/1044291490 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f403c12e590 msgr2=0x7f403c11b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.393+0000 7f40423b9700 1 --2- 172.21.15.40:0/1044291490 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f403c12e590 0x7f403c11b050 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4030015000 tx=0x7f4030004750 comp rx=0 tx=0).stop 2023-09-30T22:25:55.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.393+0000 7f40423b9700 1 -- 172.21.15.40:0/1044291490 shutdown_connections 2023-09-30T22:25:55.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.393+0000 7f40423b9700 1 --2- 172.21.15.40:0/1044291490 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f403c12eea0 0x7f403c11b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.393+0000 7f40423b9700 1 --2- 172.21.15.40:0/1044291490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f403c12d6d0 0x7f403c11ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.393+0000 7f40423b9700 1 --2- 172.21.15.40:0/1044291490 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f403c12e590 0x7f403c11b050 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.393+0000 7f40423b9700 1 -- 172.21.15.40:0/1044291490 >> 172.21.15.40:0/1044291490 conn(0x7f403c0a2a00 msgr2=0x7f403c09d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:55.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.393+0000 7f40423b9700 1 -- 172.21.15.40:0/1044291490 shutdown_connections 2023-09-30T22:25:55.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.393+0000 7f40423b9700 1 -- 172.21.15.40:0/1044291490 wait complete. 2023-09-30T22:25:55.405 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:55.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.451+0000 7f606a5c7700 1 -- 172.21.15.40:0/3881019081 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6064074620 con 0x7f606409c890 2023-09-30T22:25:55.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.452+0000 7f6060ff9700 1 -- 172.21.15.40:0/3881019081 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6054033090 con 0x7f606409c890 2023-09-30T22:25:55.452 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:55.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.454+0000 7f606a5c7700 1 -- 172.21.15.40:0/3881019081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f606409c890 msgr2=0x7f60641c8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.454+0000 7f606a5c7700 1 --2- 172.21.15.40:0/3881019081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f606409c890 0x7f60641c8c50 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6054015000 tx=0x7f6054004750 comp rx=0 tx=0).stop 2023-09-30T22:25:55.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.454+0000 7f606a5c7700 1 -- 172.21.15.40:0/3881019081 shutdown_connections 2023-09-30T22:25:55.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.454+0000 7f606a5c7700 1 --2- 172.21.15.40:0/3881019081 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f606409e2b0 0x7f606412d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.454+0000 7f606a5c7700 1 --2- 172.21.15.40:0/3881019081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f606409c890 0x7f60641c8c50 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.454+0000 7f606a5c7700 1 --2- 172.21.15.40:0/3881019081 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f606409d920 0x7f60641c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.454+0000 7f606a5c7700 1 -- 172.21.15.40:0/3881019081 >> 172.21.15.40:0/3881019081 conn(0x7f60640a7080 msgr2=0x7f60640a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:55.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.454+0000 7f606a5c7700 1 -- 172.21.15.40:0/3881019081 shutdown_connections 2023-09-30T22:25:55.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:55.454+0000 7f606a5c7700 1 -- 172.21.15.40:0/3881019081 wait complete. 2023-09-30T22:25:55.466 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:56.175 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:56.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.313+0000 7f9e22a88700 1 Processor -- start 2023-09-30T22:25:56.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.313+0000 7f9e22a88700 1 -- start start 2023-09-30T22:25:56.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.314+0000 7f9e22a88700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e1c099510 0x7f9e1c0998e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.314+0000 7f9e22a88700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e1c099e20 0x7f9e1c130160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.314+0000 7f9e22a88700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9e1c1306a0 0x7f9e1c130b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.314+0000 7f9e22a88700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e1c09a950 con 0x7f9e1c1306a0 2023-09-30T22:25:56.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.314+0000 7f9e22a88700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1c09a630 con 0x7f9e1c099510 2023-09-30T22:25:56.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.314+0000 7f9e22a88700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1c09ba50 con 0x7f9e1c099e20 2023-09-30T22:25:56.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.314+0000 7f9e20824700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e1c099510 0x7f9e1c0998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.314+0000 7f9e1bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e1c099e20 0x7f9e1c130160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.314+0000 7f9e20824700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e1c099510 0x7f9e1c0998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:33606/0 (socket says 172.21.15.40:33606) 2023-09-30T22:25:56.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.314+0000 7f9e20824700 1 -- 172.21.15.40:0/10794600 learned_addr learned my addr 172.21.15.40:0/10794600 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:56.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.314+0000 7f9e21025700 1 --2- 172.21.15.40:0/10794600 >> v2:172.21.15.40:3300/0 conn(0x7f9e1c1306a0 0x7f9e1c130b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.314+0000 7f9e1bfff700 1 -- 172.21.15.40:0/10794600 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e1c099510 msgr2=0x7f9e1c0998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:56.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.314+0000 7f9e1bfff700 1 --2- 172.21.15.40:0/10794600 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e1c099510 0x7f9e1c0998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.314+0000 7f9e1bfff700 1 -- 172.21.15.40:0/10794600 >> v2:172.21.15.40:3300/0 conn(0x7f9e1c1306a0 msgr2=0x7f9e1c130b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:56.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.314+0000 7f9e1bfff700 1 --2- 172.21.15.40:0/10794600 >> v2:172.21.15.40:3300/0 conn(0x7f9e1c1306a0 0x7f9e1c130b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.314+0000 7f9e1bfff700 1 -- 172.21.15.40:0/10794600 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e1c09b7a0 con 0x7f9e1c099e20 2023-09-30T22:25:56.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.314+0000 7f9e20824700 1 --2- 172.21.15.40:0/10794600 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e1c099510 0x7f9e1c0998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:56.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.314+0000 7f9e21025700 1 --2- 172.21.15.40:0/10794600 >> v2:172.21.15.40:3300/0 conn(0x7f9e1c1306a0 0x7f9e1c130b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:56.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.314+0000 7f9e1bfff700 1 --2- 172.21.15.40:0/10794600 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e1c099e20 0x7f9e1c130160 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9e10009840 tx=0x7f9e10009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b136969da8dce4fe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:56.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.315+0000 7f9e1b7fe700 1 -- 172.21.15.40:0/10794600 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e10011830 con 0x7f9e1c099e20 2023-09-30T22:25:56.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.315+0000 7f9e1b7fe700 1 -- 172.21.15.40:0/10794600 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e10011990 con 0x7f9e1c099e20 2023-09-30T22:25:56.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.315+0000 7f9e1b7fe700 1 -- 172.21.15.40:0/10794600 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e10011d20 con 0x7f9e1c099e20 2023-09-30T22:25:56.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.315+0000 7f9e22a88700 1 -- 172.21.15.40:0/10794600 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e1c099e20 msgr2=0x7f9e1c130160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.315+0000 7f9e22a88700 1 --2- 172.21.15.40:0/10794600 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e1c099e20 0x7f9e1c130160 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9e10009840 tx=0x7f9e10009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:56.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.315+0000 7f9e22a88700 1 -- 172.21.15.40:0/10794600 shutdown_connections 2023-09-30T22:25:56.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.315+0000 7f9e22a88700 1 --2- 172.21.15.40:0/10794600 >> v2:172.21.15.40:3300/0 conn(0x7f9e1c1306a0 0x7f9e1c130b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.315+0000 7f9e22a88700 1 --2- 172.21.15.40:0/10794600 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e1c099510 0x7f9e1c0998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.315+0000 7f9e22a88700 1 --2- 172.21.15.40:0/10794600 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e1c099e20 0x7f9e1c130160 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.315+0000 7f9e22a88700 1 -- 172.21.15.40:0/10794600 >> 172.21.15.40:0/10794600 conn(0x7f9e1c09eb10 msgr2=0x7f9e1c09ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:56.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.315+0000 7f9e22a88700 1 -- 172.21.15.40:0/10794600 shutdown_connections 2023-09-30T22:25:56.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.315+0000 7f9e22a88700 1 -- 172.21.15.40:0/10794600 wait complete. 2023-09-30T22:25:56.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.316+0000 7f9e22a88700 1 Processor -- start 2023-09-30T22:25:56.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.316+0000 7f9e22a88700 1 -- start start 2023-09-30T22:25:56.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.317+0000 7f9e22a88700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e1c099510 0x7f9e1c129180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.317+0000 7f9e22a88700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e1c099e20 0x7f9e1c1296c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.317+0000 7f9e22a88700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e1c1306a0 0x7f9e1c129c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.317+0000 7f9e22a88700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1c130360 con 0x7f9e1c099510 2023-09-30T22:25:56.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.317+0000 7f9e22a88700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1c12c5c0 con 0x7f9e1c099e20 2023-09-30T22:25:56.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.317+0000 7f9e22a88700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1c071600 con 0x7f9e1c1306a0 2023-09-30T22:25:56.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.317+0000 7f9e20824700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e1c099510 0x7f9e1c129180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.317+0000 7f9e20824700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e1c099510 0x7f9e1c129180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45168/0 (socket says 172.21.15.40:45168) 2023-09-30T22:25:56.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.317+0000 7f9e20824700 1 -- 172.21.15.40:0/977880696 learned_addr learned my addr 172.21.15.40:0/977880696 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:56.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.317+0000 7f9e1bfff700 1 --2- 172.21.15.40:0/977880696 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e1c099e20 0x7f9e1c1296c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.317+0000 7f9e21025700 1 --2- 172.21.15.40:0/977880696 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e1c1306a0 0x7f9e1c129c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.317+0000 7f9e20824700 1 -- 172.21.15.40:0/977880696 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e1c1306a0 msgr2=0x7f9e1c129c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.317+0000 7f9e20824700 1 --2- 172.21.15.40:0/977880696 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e1c1306a0 0x7f9e1c129c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.317+0000 7f9e20824700 1 -- 172.21.15.40:0/977880696 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e1c099e20 msgr2=0x7f9e1c1296c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.317+0000 7f9e20824700 1 --2- 172.21.15.40:0/977880696 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e1c099e20 0x7f9e1c1296c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.317+0000 7f9e20824700 1 -- 172.21.15.40:0/977880696 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c00f880 con 0x7f9e1c099510 2023-09-30T22:25:56.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.318+0000 7f9e20824700 1 --2- 172.21.15.40:0/977880696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e1c099510 0x7f9e1c129180 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c00eb90 tx=0x7f9e0c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:56.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.318+0000 7f9e197fa700 1 -- 172.21.15.40:0/977880696 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c014040 con 0x7f9e1c099510 2023-09-30T22:25:56.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.318+0000 7f9e197fa700 1 -- 172.21.15.40:0/977880696 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0c004230 con 0x7f9e1c099510 2023-09-30T22:25:56.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.318+0000 7f9e22a88700 1 -- 172.21.15.40:0/977880696 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e14009a70 con 0x7f9e1c099510 2023-09-30T22:25:56.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.318+0000 7f9e197fa700 1 -- 172.21.15.40:0/977880696 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c0098b0 con 0x7f9e1c099510 2023-09-30T22:25:56.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.318+0000 7f9e22a88700 1 -- 172.21.15.40:0/977880696 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e100094a0 con 0x7f9e1c099510 2023-09-30T22:25:56.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.318+0000 7f9e197fa700 1 -- 172.21.15.40:0/977880696 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9e0c009a10 con 0x7f9e1c099510 2023-09-30T22:25:56.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.319+0000 7f9e197fa700 1 -- 172.21.15.40:0/977880696 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9e0c043030 con 0x7f9e1c099510 2023-09-30T22:25:56.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.319+0000 7f9e22a88700 1 -- 172.21.15.40:0/977880696 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e1c12c7e0 con 0x7f9e1c099510 2023-09-30T22:25:56.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.323+0000 7f9e197fa700 1 -- 172.21.15.40:0/977880696 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9e0c01d030 con 0x7f9e1c099510 2023-09-30T22:25:56.378 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:56.406 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:56.467 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:56.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.509+0000 7fd08cb71700 1 Processor -- start 2023-09-30T22:25:56.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.509+0000 7fd08cb71700 1 -- start start 2023-09-30T22:25:56.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.509+0000 7fd08cb71700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd08806a6d0 0x7fd08809d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.509+0000 7fd08cb71700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd08809de60 0x7fd08809e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.509+0000 7fd08cb71700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd08813c490 0x7fd08813e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.509+0000 7fd08cb71700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd08806aaa0 con 0x7fd08809de60 2023-09-30T22:25:56.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.509+0000 7fd08cb71700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd08809e790 con 0x7fd08813c490 2023-09-30T22:25:56.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.509+0000 7fd08cb71700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd08806b150 con 0x7fd08806a6d0 2023-09-30T22:25:56.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.510+0000 7fd086d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd08813c490 0x7fd08813e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.510+0000 7fd08659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd08806a6d0 0x7fd08809d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.510+0000 7fd086d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd08813c490 0x7fd08813e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:33626/0 (socket says 172.21.15.40:33626) 2023-09-30T22:25:56.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.510+0000 7fd086d9d700 1 -- 172.21.15.40:0/1583589645 learned_addr learned my addr 172.21.15.40:0/1583589645 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:56.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.510+0000 7fd085d9b700 1 --2- 172.21.15.40:0/1583589645 >> v2:172.21.15.40:3300/0 conn(0x7fd08809de60 0x7fd08809e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.510+0000 7fd08659c700 1 -- 172.21.15.40:0/1583589645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd08813c490 msgr2=0x7fd08813e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:56.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.510+0000 7fd08659c700 1 --2- 172.21.15.40:0/1583589645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd08813c490 0x7fd08813e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.510+0000 7fd08659c700 1 -- 172.21.15.40:0/1583589645 >> v2:172.21.15.40:3300/0 conn(0x7fd08809de60 msgr2=0x7fd08809e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:56.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.510+0000 7fd08659c700 1 --2- 172.21.15.40:0/1583589645 >> v2:172.21.15.40:3300/0 conn(0x7fd08809de60 0x7fd08809e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.510+0000 7fd08659c700 1 -- 172.21.15.40:0/1583589645 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08809f300 con 0x7fd08806a6d0 2023-09-30T22:25:56.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.510+0000 7fd086d9d700 1 --2- 172.21.15.40:0/1583589645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd08813c490 0x7fd08813e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:56.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.510+0000 7fd085d9b700 1 --2- 172.21.15.40:0/1583589645 >> v2:172.21.15.40:3300/0 conn(0x7fd08809de60 0x7fd08809e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:56.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.510+0000 7fd08659c700 1 --2- 172.21.15.40:0/1583589645 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd08806a6d0 0x7fd08809d920 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd078009850 tx=0x7fd078009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65f305f2544c3ec5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:56.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.511+0000 7fd08559a700 1 -- 172.21.15.40:0/1583589645 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd078005e30 con 0x7fd08806a6d0 2023-09-30T22:25:56.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.511+0000 7fd08559a700 1 -- 172.21.15.40:0/1583589645 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd078006030 con 0x7fd08806a6d0 2023-09-30T22:25:56.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.511+0000 7fd08559a700 1 -- 172.21.15.40:0/1583589645 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0780063c0 con 0x7fd08806a6d0 2023-09-30T22:25:56.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.512+0000 7fd08cb71700 1 -- 172.21.15.40:0/1583589645 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd08806a6d0 msgr2=0x7fd08809d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.512+0000 7fd08cb71700 1 --2- 172.21.15.40:0/1583589645 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd08806a6d0 0x7fd08809d920 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd078009850 tx=0x7fd078009b60 comp rx=0 tx=0).stop 2023-09-30T22:25:56.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.512+0000 7fd08cb71700 1 -- 172.21.15.40:0/1583589645 shutdown_connections 2023-09-30T22:25:56.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.512+0000 7fd08cb71700 1 --2- 172.21.15.40:0/1583589645 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd08806a6d0 0x7fd08809d920 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.512+0000 7fd08cb71700 1 --2- 172.21.15.40:0/1583589645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd08813c490 0x7fd08813e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.512+0000 7fd08cb71700 1 --2- 172.21.15.40:0/1583589645 >> v2:172.21.15.40:3300/0 conn(0x7fd08809de60 0x7fd08809e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.512+0000 7fd08cb71700 1 -- 172.21.15.40:0/1583589645 >> 172.21.15.40:0/1583589645 conn(0x7fd08809fb20 msgr2=0x7fd08809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:56.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.512+0000 7fd08cb71700 1 -- 172.21.15.40:0/1583589645 shutdown_connections 2023-09-30T22:25:56.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.512+0000 7fd08cb71700 1 -- 172.21.15.40:0/1583589645 wait complete. 2023-09-30T22:25:56.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.513+0000 7fd08cb71700 1 Processor -- start 2023-09-30T22:25:56.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.513+0000 7fd08cb71700 1 -- start start 2023-09-30T22:25:56.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.514+0000 7fd08cb71700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd08806a6d0 0x7fd08811db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.514+0000 7fd08cb71700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd08809de60 0x7fd08811e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.514+0000 7fd08cb71700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd08813c490 0x7fd08811e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.514+0000 7fd08cb71700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08811d570 con 0x7fd08813c490 2023-09-30T22:25:56.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.514+0000 7fd08cb71700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd08811f890 con 0x7fd08806a6d0 2023-09-30T22:25:56.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.514+0000 7fd08cb71700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd08811ffb0 con 0x7fd08809de60 2023-09-30T22:25:56.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.514+0000 7fd085d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd08809de60 0x7fd08811e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.514+0000 7fd086d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd08813c490 0x7fd08811e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.514+0000 7fd085d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd08809de60 0x7fd08811e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:43658/0 (socket says 172.21.15.40:43658) 2023-09-30T22:25:56.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.514+0000 7fd085d9b700 1 -- 172.21.15.40:0/3057442587 learned_addr learned my addr 172.21.15.40:0/3057442587 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:56.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.515+0000 7fd085d9b700 1 -- 172.21.15.40:0/3057442587 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd08806a6d0 msgr2=0x7fd08811db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.515+0000 7fd085d9b700 1 --2- 172.21.15.40:0/3057442587 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd08806a6d0 0x7fd08811db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.515+0000 7fd085d9b700 1 -- 172.21.15.40:0/3057442587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd08813c490 msgr2=0x7fd08811e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.515+0000 7fd085d9b700 1 --2- 172.21.15.40:0/3057442587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd08813c490 0x7fd08811e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.515+0000 7fd085d9b700 1 -- 172.21.15.40:0/3057442587 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd07c0094a0 con 0x7fd08809de60 2023-09-30T22:25:56.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.515+0000 7fd086d9d700 1 --2- 172.21.15.40:0/3057442587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd08813c490 0x7fd08811e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:56.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.515+0000 7fd085d9b700 1 --2- 172.21.15.40:0/3057442587 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd08809de60 0x7fd08811e070 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd07c00ebe0 tx=0x7fd07c009e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:56.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.515+0000 7fd076ffd700 1 -- 172.21.15.40:0/3057442587 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07c00c8b0 con 0x7fd08809de60 2023-09-30T22:25:56.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.515+0000 7fd076ffd700 1 -- 172.21.15.40:0/3057442587 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07c00ca10 con 0x7fd08809de60 2023-09-30T22:25:56.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.515+0000 7fd08cb71700 1 -- 172.21.15.40:0/3057442587 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd080009b30 con 0x7fd08809de60 2023-09-30T22:25:56.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.515+0000 7fd076ffd700 1 -- 172.21.15.40:0/3057442587 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07c00cda0 con 0x7fd08809de60 2023-09-30T22:25:56.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.515+0000 7fd08cb71700 1 -- 172.21.15.40:0/3057442587 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd078009430 con 0x7fd08809de60 2023-09-30T22:25:56.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.516+0000 7fd08cb71700 1 -- 172.21.15.40:0/3057442587 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd08809c320 con 0x7fd08809de60 2023-09-30T22:25:56.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.516+0000 7fd076ffd700 1 -- 172.21.15.40:0/3057442587 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd07c013470 con 0x7fd08809de60 2023-09-30T22:25:56.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.517+0000 7fd076ffd700 1 -- 172.21.15.40:0/3057442587 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd07c03f900 con 0x7fd08809de60 2023-09-30T22:25:56.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.526+0000 7fd076ffd700 1 -- 172.21.15.40:0/3057442587 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd07c0232f0 con 0x7fd08809de60 2023-09-30T22:25:56.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.528+0000 7f9e22a88700 1 -- 172.21.15.40:0/977880696 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9e1c12d3f0 con 0x7f9e1c099510 2023-09-30T22:25:56.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.529+0000 7f9e197fa700 1 -- 172.21.15.40:0/977880696 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9e0c0166f0 con 0x7f9e1c099510 2023-09-30T22:25:56.529 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:56.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.531+0000 7f9e22a88700 1 -- 172.21.15.40:0/977880696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e1c099510 msgr2=0x7f9e1c129180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.531+0000 7f9e22a88700 1 --2- 172.21.15.40:0/977880696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e1c099510 0x7f9e1c129180 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c00eb90 tx=0x7f9e0c00eea0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.531+0000 7f9e22a88700 1 -- 172.21.15.40:0/977880696 shutdown_connections 2023-09-30T22:25:56.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.531+0000 7f9e22a88700 1 --2- 172.21.15.40:0/977880696 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e1c1306a0 0x7f9e1c129c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.531+0000 7f9e22a88700 1 --2- 172.21.15.40:0/977880696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e1c099510 0x7f9e1c129180 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.531+0000 7f9e22a88700 1 --2- 172.21.15.40:0/977880696 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e1c099e20 0x7f9e1c1296c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.531+0000 7f9e22a88700 1 -- 172.21.15.40:0/977880696 >> 172.21.15.40:0/977880696 conn(0x7f9e1c09eb10 msgr2=0x7f9e1c09ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:56.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.532+0000 7f9e22a88700 1 -- 172.21.15.40:0/977880696 shutdown_connections 2023-09-30T22:25:56.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.533+0000 7f9e22a88700 1 -- 172.21.15.40:0/977880696 wait complete. 2023-09-30T22:25:56.549 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:56.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.559+0000 7f1828724700 1 Processor -- start 2023-09-30T22:25:56.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.559+0000 7f1828724700 1 -- start start 2023-09-30T22:25:56.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.560+0000 7f1828724700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f182009df30 0x7f1820135400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.560+0000 7f1828724700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1820135940 0x7f1820137d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.560+0000 7f1828724700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f182009e8b0 con 0x7f182009d450 2023-09-30T22:25:56.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.560+0000 7f1828724700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f182009c3b0 con 0x7f182009df30 2023-09-30T22:25:56.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.560+0000 7f1828724700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f182009a6b0 con 0x7f1820135940 2023-09-30T22:25:56.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.560+0000 7f1825cbf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f182009df30 0x7f1820135400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.560+0000 7f1826cc1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1820135940 0x7f1820137d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.560+0000 7f1825cbf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f182009df30 0x7f1820135400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45204/0 (socket says 172.21.15.40:45204) 2023-09-30T22:25:56.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.560+0000 7f1825cbf700 1 -- 172.21.15.40:0/659770432 learned_addr learned my addr 172.21.15.40:0/659770432 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:56.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.561+0000 7f1826cc1700 1 -- 172.21.15.40:0/659770432 >> v2:172.21.15.40:3300/0 conn(0x7f182009df30 msgr2=0x7f1820135400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:56.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.561+0000 7f1826cc1700 1 --2- 172.21.15.40:0/659770432 >> v2:172.21.15.40:3300/0 conn(0x7f182009df30 0x7f1820135400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.561+0000 7f1826cc1700 1 -- 172.21.15.40:0/659770432 >> v1:172.21.15.40:6789/0 conn(0x7f182009d450 legacy=0x7f182009d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.561+0000 7f1826cc1700 1 -- 172.21.15.40:0/659770432 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f182009b4f0 con 0x7f1820135940 2023-09-30T22:25:56.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.561+0000 7f1825cbf700 1 --2- 172.21.15.40:0/659770432 >> v2:172.21.15.40:3300/0 conn(0x7f182009df30 0x7f1820135400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:56.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.561+0000 7f1826cc1700 1 --2- 172.21.15.40:0/659770432 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1820135940 0x7f1820137d20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f181800bfa0 tx=0x7f181800d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3790f33b3c97ada server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:56.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.561+0000 7f18254be700 1 -- 172.21.15.40:0/659770432 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1818010070 con 0x7f1820135940 2023-09-30T22:25:56.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.561+0000 7f18254be700 1 -- 172.21.15.40:0/659770432 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181800b2e0 con 0x7f1820135940 2023-09-30T22:25:56.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.561+0000 7f18254be700 1 -- 172.21.15.40:0/659770432 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181800dc40 con 0x7f1820135940 2023-09-30T22:25:56.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.562+0000 7f1828724700 1 -- 172.21.15.40:0/659770432 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1820135940 msgr2=0x7f1820137d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.562+0000 7f1828724700 1 --2- 172.21.15.40:0/659770432 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1820135940 0x7f1820137d20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f181800bfa0 tx=0x7f181800d330 comp rx=0 tx=0).stop 2023-09-30T22:25:56.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.562+0000 7f1828724700 1 -- 172.21.15.40:0/659770432 shutdown_connections 2023-09-30T22:25:56.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.562+0000 7f1828724700 1 --2- 172.21.15.40:0/659770432 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1820135940 0x7f1820137d20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.562+0000 7f1828724700 1 --2- 172.21.15.40:0/659770432 >> v2:172.21.15.40:3300/0 conn(0x7f182009df30 0x7f1820135400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.562+0000 7f1828724700 1 -- 172.21.15.40:0/659770432 >> 172.21.15.40:0/659770432 conn(0x7f18200a2a00 msgr2=0x7f18200a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:56.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.562+0000 7f1828724700 1 -- 172.21.15.40:0/659770432 shutdown_connections 2023-09-30T22:25:56.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.562+0000 7f1828724700 1 -- 172.21.15.40:0/659770432 wait complete. 2023-09-30T22:25:56.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.563+0000 7f1828724700 1 Processor -- start 2023-09-30T22:25:56.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.563+0000 7f1828724700 1 -- start start 2023-09-30T22:25:56.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.563+0000 7f1828724700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f182009d450 0x7f182011d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.563+0000 7f1828724700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f182009df30 0x7f182011d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.563+0000 7f1828724700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1820135940 0x7f182011dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.563+0000 7f1828724700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18200711a0 con 0x7f1820135940 2023-09-30T22:25:56.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.563+0000 7f1828724700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1820120400 con 0x7f182009df30 2023-09-30T22:25:56.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.563+0000 7f1828724700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18201205e0 con 0x7f182009d450 2023-09-30T22:25:56.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.563+0000 7f18264c0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f182009d450 0x7f182011d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.563+0000 7f18264c0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f182009d450 0x7f182011d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:43678/0 (socket says 172.21.15.40:43678) 2023-09-30T22:25:56.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.563+0000 7f18264c0700 1 -- 172.21.15.40:0/194370766 learned_addr learned my addr 172.21.15.40:0/194370766 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:56.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.563+0000 7f1826cc1700 1 --2- 172.21.15.40:0/194370766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1820135940 0x7f182011dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.564+0000 7f18264c0700 1 -- 172.21.15.40:0/194370766 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f182009df30 msgr2=0x7f182011d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.564+0000 7f18264c0700 1 --2- 172.21.15.40:0/194370766 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f182009df30 0x7f182011d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.564+0000 7f18264c0700 1 -- 172.21.15.40:0/194370766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1820135940 msgr2=0x7f182011dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.564+0000 7f18264c0700 1 --2- 172.21.15.40:0/194370766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1820135940 0x7f182011dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.564+0000 7f18264c0700 1 -- 172.21.15.40:0/194370766 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1810009550 con 0x7f182009d450 2023-09-30T22:25:56.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.564+0000 7f18264c0700 1 --2- 172.21.15.40:0/194370766 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f182009d450 0x7f182011d460 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f181c00c4e0 tx=0x7f181c00c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:56.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.564+0000 7f1816ffd700 1 -- 172.21.15.40:0/194370766 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c0052d0 con 0x7f182009d450 2023-09-30T22:25:56.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.564+0000 7f1816ffd700 1 -- 172.21.15.40:0/194370766 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181c005430 con 0x7f182009d450 2023-09-30T22:25:56.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.564+0000 7f1816ffd700 1 -- 172.21.15.40:0/194370766 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c0038c0 con 0x7f182009d450 2023-09-30T22:25:56.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.564+0000 7f1828724700 1 -- 172.21.15.40:0/194370766 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f181800bc80 con 0x7f182009d450 2023-09-30T22:25:56.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.564+0000 7f1828724700 1 -- 172.21.15.40:0/194370766 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1820120040 con 0x7f182009d450 2023-09-30T22:25:56.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.565+0000 7f1816ffd700 1 -- 172.21.15.40:0/194370766 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f181c003a20 con 0x7f182009d450 2023-09-30T22:25:56.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.565+0000 7f1816ffd700 1 -- 172.21.15.40:0/194370766 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f181c03eb40 con 0x7f182009d450 2023-09-30T22:25:56.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.565+0000 7f1828724700 1 -- 172.21.15.40:0/194370766 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1820062380 con 0x7f182009d450 2023-09-30T22:25:56.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.570+0000 7f1816ffd700 1 -- 172.21.15.40:0/194370766 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f181c017080 con 0x7f182009d450 2023-09-30T22:25:56.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.606+0000 7f56fd8f5700 1 Processor -- start 2023-09-30T22:25:56.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.606+0000 7f56fd8f5700 1 -- start start 2023-09-30T22:25:56.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.607+0000 7f56fd8f5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56f809d920 0x7f56f809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.607+0000 7f56fd8f5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56f809f0f0 0x7f56f809e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.607+0000 7f56fd8f5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56f809f940 con 0x7f56f8133ca0 2023-09-30T22:25:56.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.607+0000 7f56fd8f5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f806b4c0 con 0x7f56f809f0f0 2023-09-30T22:25:56.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.607+0000 7f56fd8f5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56f809a8f0 con 0x7f56f809d920 2023-09-30T22:25:56.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.607+0000 7f56f6ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56f809d920 0x7f56f809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.607+0000 7f56f6ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56f809d920 0x7f56f809dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:43680/0 (socket says 172.21.15.40:43680) 2023-09-30T22:25:56.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.607+0000 7f56f6ffd700 1 -- 172.21.15.40:0/65811190 learned_addr learned my addr 172.21.15.40:0/65811190 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:56.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.607+0000 7f56f77fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f56f8133ca0 0x7f56f8134140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60082/0 (socket says 172.21.15.40:60082) 2023-09-30T22:25:56.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.607+0000 7f56f67fc700 1 --2- 172.21.15.40:0/65811190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56f809f0f0 0x7f56f809e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.607+0000 7f56f5ffb700 1 -- 172.21.15.40:0/65811190 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2165950193 0 0) 0x7f56f809f940 con 0x7f56f8133ca0 2023-09-30T22:25:56.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.607+0000 7f56f5ffb700 1 -- 172.21.15.40:0/65811190 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56e00035b0 con 0x7f56f8133ca0 2023-09-30T22:25:56.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.607+0000 7f56f67fc700 1 -- 172.21.15.40:0/65811190 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56f809d920 msgr2=0x7f56f809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:56.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.607+0000 7f56f67fc700 1 --2- 172.21.15.40:0/65811190 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56f809d920 0x7f56f809dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.607+0000 7f56f67fc700 1 -- 172.21.15.40:0/65811190 >> v1:172.21.15.40:6789/0 conn(0x7f56f8133ca0 legacy=0x7f56f8134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.608+0000 7f56f67fc700 1 -- 172.21.15.40:0/65811190 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f809f6e0 con 0x7f56f809f0f0 2023-09-30T22:25:56.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.608+0000 7f56f6ffd700 1 --2- 172.21.15.40:0/65811190 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56f809d920 0x7f56f809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:56.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.608+0000 7f56f67fc700 1 --2- 172.21.15.40:0/65811190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56f809f0f0 0x7f56f809e230 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f56ec009870 tx=0x7f56ec009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb98af2bdbc8f456 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:56.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.608+0000 7f56f5ffb700 1 -- 172.21.15.40:0/65811190 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec011830 con 0x7f56f809f0f0 2023-09-30T22:25:56.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.608+0000 7f56f5ffb700 1 -- 172.21.15.40:0/65811190 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56ec011990 con 0x7f56f809f0f0 2023-09-30T22:25:56.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.608+0000 7f56f5ffb700 1 -- 172.21.15.40:0/65811190 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec011d20 con 0x7f56f809f0f0 2023-09-30T22:25:56.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.608+0000 7f56fd8f5700 1 -- 172.21.15.40:0/65811190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56f809f0f0 msgr2=0x7f56f809e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.608+0000 7f56fd8f5700 1 --2- 172.21.15.40:0/65811190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56f809f0f0 0x7f56f809e230 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f56ec009870 tx=0x7f56ec009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:56.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.608+0000 7f56fd8f5700 1 -- 172.21.15.40:0/65811190 shutdown_connections 2023-09-30T22:25:56.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.608+0000 7f56fd8f5700 1 --2- 172.21.15.40:0/65811190 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56f809d920 0x7f56f809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.608+0000 7f56fd8f5700 1 --2- 172.21.15.40:0/65811190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56f809f0f0 0x7f56f809e230 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.608+0000 7f56fd8f5700 1 -- 172.21.15.40:0/65811190 >> 172.21.15.40:0/65811190 conn(0x7f56f809fb20 msgr2=0x7f56f809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:56.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.609+0000 7f56fd8f5700 1 -- 172.21.15.40:0/65811190 shutdown_connections 2023-09-30T22:25:56.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.609+0000 7f56fd8f5700 1 -- 172.21.15.40:0/65811190 wait complete. 2023-09-30T22:25:56.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.609+0000 7f56fd8f5700 1 Processor -- start 2023-09-30T22:25:56.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.610+0000 7f56fd8f5700 1 -- start start 2023-09-30T22:25:56.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.610+0000 7f56fd8f5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56f809d920 0x7f56f811e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.610+0000 7f56fd8f5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56f8133ca0 0x7f56f811e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.610+0000 7f56fd8f5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56f81223d0 0x7f56f811ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.610+0000 7f56fd8f5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f811ffc0 con 0x7f56f81223d0 2023-09-30T22:25:56.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.610+0000 7f56fd8f5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f8121210 con 0x7f56f8133ca0 2023-09-30T22:25:56.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.610+0000 7f56fd8f5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56f81205a0 con 0x7f56f809d920 2023-09-30T22:25:56.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.610+0000 7f56f6ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56f809d920 0x7f56f811e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.610+0000 7f56f6ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56f809d920 0x7f56f811e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:43696/0 (socket says 172.21.15.40:43696) 2023-09-30T22:25:56.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.610+0000 7f56f6ffd700 1 -- 172.21.15.40:0/3438377645 learned_addr learned my addr 172.21.15.40:0/3438377645 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:56.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.610+0000 7f56f67fc700 1 --2- 172.21.15.40:0/3438377645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56f8133ca0 0x7f56f811e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.610+0000 7f56f77fe700 1 --2- 172.21.15.40:0/3438377645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56f81223d0 0x7f56f811ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.611+0000 7f56f6ffd700 1 -- 172.21.15.40:0/3438377645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56f8133ca0 msgr2=0x7f56f811e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.611+0000 7f56f6ffd700 1 --2- 172.21.15.40:0/3438377645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56f8133ca0 0x7f56f811e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.611+0000 7f56f6ffd700 1 -- 172.21.15.40:0/3438377645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56f81223d0 msgr2=0x7f56f811ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.611+0000 7f56f6ffd700 1 --2- 172.21.15.40:0/3438377645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56f81223d0 0x7f56f811ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.611+0000 7f56f6ffd700 1 -- 172.21.15.40:0/3438377645 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e8009500 con 0x7f56f809d920 2023-09-30T22:25:56.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.611+0000 7f56f67fc700 1 --2- 172.21.15.40:0/3438377645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56f8133ca0 0x7f56f811e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:56.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.611+0000 7f56f6ffd700 1 --2- 172.21.15.40:0/3438377645 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56f809d920 0x7f56f811e3b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f56e800e9a0 tx=0x7f56e800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:56.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.611+0000 7f56dffff700 1 -- 172.21.15.40:0/3438377645 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e8005a20 con 0x7f56f809d920 2023-09-30T22:25:56.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.611+0000 7f56dffff700 1 -- 172.21.15.40:0/3438377645 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e8005b80 con 0x7f56f809d920 2023-09-30T22:25:56.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.611+0000 7f56fd8f5700 1 -- 172.21.15.40:0/3438377645 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56ec0094a0 con 0x7f56f809d920 2023-09-30T22:25:56.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.611+0000 7f56dffff700 1 -- 172.21.15.40:0/3438377645 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e800c690 con 0x7f56f809d920 2023-09-30T22:25:56.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.611+0000 7f56fd8f5700 1 -- 172.21.15.40:0/3438377645 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56f8121660 con 0x7f56f809d920 2023-09-30T22:25:56.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.612+0000 7f56dffff700 1 -- 172.21.15.40:0/3438377645 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f56e800c7f0 con 0x7f56f809d920 2023-09-30T22:25:56.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.612+0000 7f56dffff700 1 -- 172.21.15.40:0/3438377645 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f56e803f8c0 con 0x7f56f809d920 2023-09-30T22:25:56.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.612+0000 7f56fd8f5700 1 -- 172.21.15.40:0/3438377645 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56f80a2690 con 0x7f56f809d920 2023-09-30T22:25:56.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.617+0000 7f56dffff700 1 -- 172.21.15.40:0/3438377645 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f56e8020080 con 0x7f56f809d920 2023-09-30T22:25:56.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.731+0000 7fd08cb71700 1 -- 172.21.15.40:0/3057442587 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd088062380 con 0x7fd08809de60 2023-09-30T22:25:56.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.731+0000 7fd076ffd700 1 -- 172.21.15.40:0/3057442587 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd07c011350 con 0x7fd08809de60 2023-09-30T22:25:56.732 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:56.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.733+0000 7fd08cb71700 1 -- 172.21.15.40:0/3057442587 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd08809de60 msgr2=0x7fd08811e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.733+0000 7fd08cb71700 1 --2- 172.21.15.40:0/3057442587 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd08809de60 0x7fd08811e070 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd07c00ebe0 tx=0x7fd07c009e20 comp rx=0 tx=0).stop 2023-09-30T22:25:56.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.734+0000 7fd08cb71700 1 -- 172.21.15.40:0/3057442587 shutdown_connections 2023-09-30T22:25:56.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.734+0000 7fd08cb71700 1 --2- 172.21.15.40:0/3057442587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd08813c490 0x7fd08811e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.734+0000 7fd08cb71700 1 --2- 172.21.15.40:0/3057442587 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd08806a6d0 0x7fd08811db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.734+0000 7fd08cb71700 1 --2- 172.21.15.40:0/3057442587 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd08809de60 0x7fd08811e070 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.734+0000 7fd08cb71700 1 -- 172.21.15.40:0/3057442587 >> 172.21.15.40:0/3057442587 conn(0x7fd08809fb20 msgr2=0x7fd08813d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:56.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.734+0000 7fd08cb71700 1 -- 172.21.15.40:0/3057442587 shutdown_connections 2023-09-30T22:25:56.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.734+0000 7fd08cb71700 1 -- 172.21.15.40:0/3057442587 wait complete. 2023-09-30T22:25:56.746 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:56.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.806+0000 7f1828724700 1 -- 172.21.15.40:0/194370766 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f182011e6d0 con 0x7f182009d450 2023-09-30T22:25:56.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.807+0000 7f1816ffd700 1 -- 172.21.15.40:0/194370766 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f181c018260 con 0x7f182009d450 2023-09-30T22:25:56.808 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:56.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.809+0000 7f1828724700 1 -- 172.21.15.40:0/194370766 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f182009d450 msgr2=0x7f182011d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.809+0000 7f1828724700 1 --2- 172.21.15.40:0/194370766 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f182009d450 0x7f182011d460 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f181c00c4e0 tx=0x7f181c00c7f0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.809+0000 7f1828724700 1 -- 172.21.15.40:0/194370766 shutdown_connections 2023-09-30T22:25:56.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.809+0000 7f1828724700 1 --2- 172.21.15.40:0/194370766 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f182009d450 0x7f182011d460 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.809+0000 7f1828724700 1 --2- 172.21.15.40:0/194370766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1820135940 0x7f182011dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.809+0000 7f1828724700 1 --2- 172.21.15.40:0/194370766 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f182009df30 0x7f182011d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.809+0000 7f1828724700 1 -- 172.21.15.40:0/194370766 >> 172.21.15.40:0/194370766 conn(0x7f18200a2a00 msgr2=0x7f1820130a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:56.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.809+0000 7f1828724700 1 -- 172.21.15.40:0/194370766 shutdown_connections 2023-09-30T22:25:56.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.809+0000 7f1828724700 1 -- 172.21.15.40:0/194370766 wait complete. 2023-09-30T22:25:56.822 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:56.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.853+0000 7f56fd8f5700 1 -- 172.21.15.40:0/3438377645 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f56f806f6f0 con 0x7f56f809d920 2023-09-30T22:25:56.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.853+0000 7f56dffff700 1 -- 172.21.15.40:0/3438377645 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f56e8006030 con 0x7f56f809d920 2023-09-30T22:25:56.854 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:56.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.855+0000 7f56fd8f5700 1 -- 172.21.15.40:0/3438377645 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56f809d920 msgr2=0x7f56f811e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.855+0000 7f56fd8f5700 1 --2- 172.21.15.40:0/3438377645 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56f809d920 0x7f56f811e3b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f56e800e9a0 tx=0x7f56e800ecb0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.855+0000 7f56fd8f5700 1 -- 172.21.15.40:0/3438377645 shutdown_connections 2023-09-30T22:25:56.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.855+0000 7f56fd8f5700 1 --2- 172.21.15.40:0/3438377645 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56f809d920 0x7f56f811e3b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.855+0000 7f56fd8f5700 1 --2- 172.21.15.40:0/3438377645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56f81223d0 0x7f56f811ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.855+0000 7f56fd8f5700 1 --2- 172.21.15.40:0/3438377645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56f8133ca0 0x7f56f811e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.855+0000 7f56fd8f5700 1 -- 172.21.15.40:0/3438377645 >> 172.21.15.40:0/3438377645 conn(0x7f56f809fb20 msgr2=0x7f56f8133260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:56.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.855+0000 7f56fd8f5700 1 -- 172.21.15.40:0/3438377645 shutdown_connections 2023-09-30T22:25:56.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:56.855+0000 7f56fd8f5700 1 -- 172.21.15.40:0/3438377645 wait complete. 2023-09-30T22:25:56.868 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:57.550 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:57.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.689+0000 7f78ca3a4700 1 Processor -- start 2023-09-30T22:25:57.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.689+0000 7f78ca3a4700 1 -- start start 2023-09-30T22:25:57.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.690+0000 7f78ca3a4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f78c406f070 0x7f78c406f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.690+0000 7f78ca3a4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78c406f980 0x7f78c4097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.690+0000 7f78ca3a4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f78c406fdb0 0x7f78c40975d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.690+0000 7f78ca3a4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78c4071af0 con 0x7f78c406fdb0 2023-09-30T22:25:57.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.690+0000 7f78ca3a4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c4070830 con 0x7f78c406f980 2023-09-30T22:25:57.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.690+0000 7f78ca3a4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78c4070ad0 con 0x7f78c406f070 2023-09-30T22:25:57.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.690+0000 7f78c8941700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f78c406fdb0 0x7f78c40975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:57.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.690+0000 7f78c3fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f78c406f070 0x7f78c406f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:57.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.690+0000 7f78c37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78c406f980 0x7f78c4097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:57.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.690+0000 7f78c8941700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f78c406fdb0 0x7f78c40975d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45228/0 (socket says 172.21.15.40:45228) 2023-09-30T22:25:57.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.690+0000 7f78c8941700 1 -- 172.21.15.40:0/408519507 learned_addr learned my addr 172.21.15.40:0/408519507 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:57.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.690+0000 7f78c3fff700 1 -- 172.21.15.40:0/408519507 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78c406f980 msgr2=0x7f78c4097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:57.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.690+0000 7f78c3fff700 1 --2- 172.21.15.40:0/408519507 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78c406f980 0x7f78c4097090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.690+0000 7f78c3fff700 1 -- 172.21.15.40:0/408519507 >> v2:172.21.15.40:3300/0 conn(0x7f78c406fdb0 msgr2=0x7f78c40975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:57.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.690+0000 7f78c3fff700 1 --2- 172.21.15.40:0/408519507 >> v2:172.21.15.40:3300/0 conn(0x7f78c406fdb0 0x7f78c40975d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.690+0000 7f78c3fff700 1 -- 172.21.15.40:0/408519507 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c4070de0 con 0x7f78c406f070 2023-09-30T22:25:57.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.690+0000 7f78c37fe700 1 --2- 172.21.15.40:0/408519507 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78c406f980 0x7f78c4097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:57.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.690+0000 7f78c8941700 1 --2- 172.21.15.40:0/408519507 >> v2:172.21.15.40:3300/0 conn(0x7f78c406fdb0 0x7f78c40975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:57.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.691+0000 7f78c3fff700 1 --2- 172.21.15.40:0/408519507 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f78c406f070 0x7f78c406f440 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f78b4009870 tx=0x7f78b4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c527ffd07592d7d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:57.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.691+0000 7f78c2ffd700 1 -- 172.21.15.40:0/408519507 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b4011830 con 0x7f78c406f070 2023-09-30T22:25:57.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.691+0000 7f78c2ffd700 1 -- 172.21.15.40:0/408519507 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b4011990 con 0x7f78c406f070 2023-09-30T22:25:57.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.691+0000 7f78c2ffd700 1 -- 172.21.15.40:0/408519507 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b4011d20 con 0x7f78c406f070 2023-09-30T22:25:57.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.691+0000 7f78ca3a4700 1 -- 172.21.15.40:0/408519507 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f78c406f070 msgr2=0x7f78c406f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:57.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.691+0000 7f78ca3a4700 1 --2- 172.21.15.40:0/408519507 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f78c406f070 0x7f78c406f440 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f78b4009870 tx=0x7f78b4009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:57.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.691+0000 7f78ca3a4700 1 -- 172.21.15.40:0/408519507 shutdown_connections 2023-09-30T22:25:57.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.691+0000 7f78ca3a4700 1 --2- 172.21.15.40:0/408519507 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f78c406f070 0x7f78c406f440 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.691+0000 7f78ca3a4700 1 --2- 172.21.15.40:0/408519507 >> v2:172.21.15.40:3300/0 conn(0x7f78c406fdb0 0x7f78c40975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.691+0000 7f78ca3a4700 1 --2- 172.21.15.40:0/408519507 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78c406f980 0x7f78c4097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.691+0000 7f78ca3a4700 1 -- 172.21.15.40:0/408519507 >> 172.21.15.40:0/408519507 conn(0x7f78c40a41a0 msgr2=0x7f78c40a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:57.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.691+0000 7f78ca3a4700 1 -- 172.21.15.40:0/408519507 shutdown_connections 2023-09-30T22:25:57.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.691+0000 7f78ca3a4700 1 -- 172.21.15.40:0/408519507 wait complete. 2023-09-30T22:25:57.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.692+0000 7f78ca3a4700 1 Processor -- start 2023-09-30T22:25:57.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.692+0000 7f78ca3a4700 1 -- start start 2023-09-30T22:25:57.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.693+0000 7f78ca3a4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78c406f070 0x7f78c412d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.693+0000 7f78ca3a4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f78c406f980 0x7f78c412da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.693+0000 7f78ca3a4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78c406fdb0 0x7f78c412dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.693+0000 7f78ca3a4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c412c340 con 0x7f78c406fdb0 2023-09-30T22:25:57.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.693+0000 7f78ca3a4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c412f980 con 0x7f78c406f070 2023-09-30T22:25:57.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.693+0000 7f78ca3a4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78c4132500 con 0x7f78c406f980 2023-09-30T22:25:57.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.693+0000 7f78c3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78c406f070 0x7f78c412d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:57.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.693+0000 7f78c37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f78c406f980 0x7f78c412da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:57.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.693+0000 7f78c3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78c406f070 0x7f78c412d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:33690/0 (socket says 172.21.15.40:33690) 2023-09-30T22:25:57.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.693+0000 7f78c3fff700 1 -- 172.21.15.40:0/2477418548 learned_addr learned my addr 172.21.15.40:0/2477418548 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:57.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.693+0000 7f78c8941700 1 --2- 172.21.15.40:0/2477418548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78c406fdb0 0x7f78c412dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:57.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.693+0000 7f78c3fff700 1 -- 172.21.15.40:0/2477418548 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f78c406f980 msgr2=0x7f78c412da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:57.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.693+0000 7f78c3fff700 1 --2- 172.21.15.40:0/2477418548 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f78c406f980 0x7f78c412da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.693+0000 7f78c3fff700 1 -- 172.21.15.40:0/2477418548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78c406fdb0 msgr2=0x7f78c412dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:57.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.693+0000 7f78c3fff700 1 --2- 172.21.15.40:0/2477418548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78c406fdb0 0x7f78c412dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.693+0000 7f78c3fff700 1 -- 172.21.15.40:0/2477418548 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b80094a0 con 0x7f78c406f070 2023-09-30T22:25:57.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.693+0000 7f78c37fe700 1 --2- 172.21.15.40:0/2477418548 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f78c406f980 0x7f78c412da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:57.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.693+0000 7f78c8941700 1 --2- 172.21.15.40:0/2477418548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78c406fdb0 0x7f78c412dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:57.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.694+0000 7f78c3fff700 1 --2- 172.21.15.40:0/2477418548 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78c406f070 0x7f78c412d530 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f78b40090b0 tx=0x7f78b4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:57.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.694+0000 7f78c0ff9700 1 -- 172.21.15.40:0/2477418548 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b4004300 con 0x7f78c406f070 2023-09-30T22:25:57.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.694+0000 7f78c0ff9700 1 -- 172.21.15.40:0/2477418548 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b401f070 con 0x7f78c406f070 2023-09-30T22:25:57.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.694+0000 7f78c0ff9700 1 -- 172.21.15.40:0/2477418548 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b40036a0 con 0x7f78c406f070 2023-09-30T22:25:57.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.694+0000 7f78ca3a4700 1 -- 172.21.15.40:0/2477418548 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78bc009b30 con 0x7f78c406f070 2023-09-30T22:25:57.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.694+0000 7f78ca3a4700 1 -- 172.21.15.40:0/2477418548 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b40094a0 con 0x7f78c406f070 2023-09-30T22:25:57.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.694+0000 7f78c0ff9700 1 -- 172.21.15.40:0/2477418548 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f78b4021030 con 0x7f78c406f070 2023-09-30T22:25:57.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.695+0000 7f78c0ff9700 1 -- 172.21.15.40:0/2477418548 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f78b40406d0 con 0x7f78c406f070 2023-09-30T22:25:57.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.695+0000 7f78ca3a4700 1 -- 172.21.15.40:0/2477418548 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78c4130a60 con 0x7f78c406f070 2023-09-30T22:25:57.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.700+0000 7f78c0ff9700 1 -- 172.21.15.40:0/2477418548 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f78b4015080 con 0x7f78c406f070 2023-09-30T22:25:57.748 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:57.823 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:57.869 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:57.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.878+0000 7f1d07f5c700 1 Processor -- start 2023-09-30T22:25:57.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.878+0000 7f1d07f5c700 1 -- start start 2023-09-30T22:25:57.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.879+0000 7f1d07f5c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d00131d50 0x7f1d00132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.879+0000 7f1d07f5c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d0009bc50 0x7f1d0009c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.879+0000 7f1d07f5c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1d0009c600 0x7f1d00138ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.879+0000 7f1d07f5c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d0009cb00 con 0x7f1d0009c600 2023-09-30T22:25:57.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.879+0000 7f1d07f5c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d00071920 con 0x7f1d00131d50 2023-09-30T22:25:57.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.879+0000 7f1d07f5c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d00132660 con 0x7f1d0009bc50 2023-09-30T22:25:57.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.879+0000 7f1d064f9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1d0009c600 0x7f1d00138ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:57.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.880+0000 7f1d05cf8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d00131d50 0x7f1d00132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:57.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.880+0000 7f1d064f9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1d0009c600 0x7f1d00138ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45246/0 (socket says 172.21.15.40:45246) 2023-09-30T22:25:57.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.880+0000 7f1d064f9700 1 -- 172.21.15.40:0/3762660987 learned_addr learned my addr 172.21.15.40:0/3762660987 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:57.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.880+0000 7f1d054f7700 1 --2- 172.21.15.40:0/3762660987 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d0009bc50 0x7f1d0009c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:57.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.880+0000 7f1d054f7700 1 -- 172.21.15.40:0/3762660987 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d00131d50 msgr2=0x7f1d00132120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:57.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.880+0000 7f1d054f7700 1 --2- 172.21.15.40:0/3762660987 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d00131d50 0x7f1d00132120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.880+0000 7f1d054f7700 1 -- 172.21.15.40:0/3762660987 >> v2:172.21.15.40:3300/0 conn(0x7f1d0009c600 msgr2=0x7f1d00138ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:57.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.880+0000 7f1d054f7700 1 --2- 172.21.15.40:0/3762660987 >> v2:172.21.15.40:3300/0 conn(0x7f1d0009c600 0x7f1d00138ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.880+0000 7f1d054f7700 1 -- 172.21.15.40:0/3762660987 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d00131900 con 0x7f1d0009bc50 2023-09-30T22:25:57.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.880+0000 7f1d064f9700 1 --2- 172.21.15.40:0/3762660987 >> v2:172.21.15.40:3300/0 conn(0x7f1d0009c600 0x7f1d00138ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:57.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.880+0000 7f1d054f7700 1 --2- 172.21.15.40:0/3762660987 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d0009bc50 0x7f1d0009c0c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4009840 tx=0x7f1cf4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=303384284b88f77 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:57.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.880+0000 7f1d04cf6700 1 -- 172.21.15.40:0/3762660987 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf4010a90 con 0x7f1d0009bc50 2023-09-30T22:25:57.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.880+0000 7f1d04cf6700 1 -- 172.21.15.40:0/3762660987 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf4010bf0 con 0x7f1d0009bc50 2023-09-30T22:25:57.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.880+0000 7f1d04cf6700 1 -- 172.21.15.40:0/3762660987 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf4018440 con 0x7f1d0009bc50 2023-09-30T22:25:57.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.881+0000 7f1d07f5c700 1 -- 172.21.15.40:0/3762660987 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d0009bc50 msgr2=0x7f1d0009c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:57.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.881+0000 7f1d07f5c700 1 --2- 172.21.15.40:0/3762660987 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d0009bc50 0x7f1d0009c0c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4009840 tx=0x7f1cf4009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:57.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.881+0000 7f1d07f5c700 1 -- 172.21.15.40:0/3762660987 shutdown_connections 2023-09-30T22:25:57.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.881+0000 7f1d07f5c700 1 --2- 172.21.15.40:0/3762660987 >> v2:172.21.15.40:3300/0 conn(0x7f1d0009c600 0x7f1d00138ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.881+0000 7f1d07f5c700 1 --2- 172.21.15.40:0/3762660987 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d00131d50 0x7f1d00132120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.881+0000 7f1d07f5c700 1 --2- 172.21.15.40:0/3762660987 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d0009bc50 0x7f1d0009c0c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.881+0000 7f1d07f5c700 1 -- 172.21.15.40:0/3762660987 >> 172.21.15.40:0/3762660987 conn(0x7f1d000a2a00 msgr2=0x7f1d000a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:57.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.882+0000 7f1d07f5c700 1 -- 172.21.15.40:0/3762660987 shutdown_connections 2023-09-30T22:25:57.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.882+0000 7f1d07f5c700 1 -- 172.21.15.40:0/3762660987 wait complete. 2023-09-30T22:25:57.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.884+0000 7f1d07f5c700 1 Processor -- start 2023-09-30T22:25:57.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.884+0000 7f1d07f5c700 1 -- start start 2023-09-30T22:25:57.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.884+0000 7f1d07f5c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d0009bc50 0x7f1d00119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.884+0000 7f1d07f5c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d0009c600 0x7f1d00119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.884+0000 7f1d07f5c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d00131d50 0x7f1d00119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.884+0000 7f1d07f5c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d000711a0 con 0x7f1d00131d50 2023-09-30T22:25:57.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.884+0000 7f1d07f5c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0011cd30 con 0x7f1d0009bc50 2023-09-30T22:25:57.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.884+0000 7f1d07f5c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0011b6b0 con 0x7f1d0009c600 2023-09-30T22:25:57.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.885+0000 7f1d05cf8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d0009bc50 0x7f1d00119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:57.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.885+0000 7f1d05cf8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d0009bc50 0x7f1d00119050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:33710/0 (socket says 172.21.15.40:33710) 2023-09-30T22:25:57.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.885+0000 7f1d05cf8700 1 -- 172.21.15.40:0/2846603103 learned_addr learned my addr 172.21.15.40:0/2846603103 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:57.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.885+0000 7f1d064f9700 1 --2- 172.21.15.40:0/2846603103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d00131d50 0x7f1d00119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:57.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.885+0000 7f1d054f7700 1 --2- 172.21.15.40:0/2846603103 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d0009c600 0x7f1d00119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:57.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.885+0000 7f1d064f9700 1 -- 172.21.15.40:0/2846603103 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d0009c600 msgr2=0x7f1d00119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:57.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.885+0000 7f1d064f9700 1 --2- 172.21.15.40:0/2846603103 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d0009c600 0x7f1d00119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.885+0000 7f1d064f9700 1 -- 172.21.15.40:0/2846603103 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d0009bc50 msgr2=0x7f1d00119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:57.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.885+0000 7f1d064f9700 1 --2- 172.21.15.40:0/2846603103 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d0009bc50 0x7f1d00119050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.885+0000 7f1d064f9700 1 -- 172.21.15.40:0/2846603103 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cfc009550 con 0x7f1d00131d50 2023-09-30T22:25:57.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.885+0000 7f1d05cf8700 1 --2- 172.21.15.40:0/2846603103 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d0009bc50 0x7f1d00119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:57.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.885+0000 7f1d064f9700 1 --2- 172.21.15.40:0/2846603103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d00131d50 0x7f1d00119ad0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc00e830 tx=0x7f1cfc00eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:57.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.885+0000 7f1cf27fc700 1 -- 172.21.15.40:0/2846603103 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc004020 con 0x7f1d00131d50 2023-09-30T22:25:57.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.885+0000 7f1cf27fc700 1 -- 172.21.15.40:0/2846603103 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cfc0041a0 con 0x7f1d00131d50 2023-09-30T22:25:57.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.885+0000 7f1cf27fc700 1 -- 172.21.15.40:0/2846603103 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc004550 con 0x7f1d00131d50 2023-09-30T22:25:57.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.885+0000 7f1d07f5c700 1 -- 172.21.15.40:0/2846603103 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf40094a0 con 0x7f1d00131d50 2023-09-30T22:25:57.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.886+0000 7f1d07f5c700 1 -- 172.21.15.40:0/2846603103 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d0009fdb0 con 0x7f1d00131d50 2023-09-30T22:25:57.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.887+0000 7f1d07f5c700 1 -- 172.21.15.40:0/2846603103 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d0009eac0 con 0x7f1d00131d50 2023-09-30T22:25:57.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.887+0000 7f1cf27fc700 1 -- 172.21.15.40:0/2846603103 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1cfc0036a0 con 0x7f1d00131d50 2023-09-30T22:25:57.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.887+0000 7f1cf27fc700 1 -- 172.21.15.40:0/2846603103 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f1cfc03fa50 con 0x7f1d00131d50 2023-09-30T22:25:57.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.891+0000 7f1cf27fc700 1 -- 172.21.15.40:0/2846603103 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1cfc013680 con 0x7f1d00131d50 2023-09-30T22:25:57.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.909+0000 7f78ca3a4700 1 -- 172.21.15.40:0/2477418548 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f78c4062380 con 0x7f78c406f070 2023-09-30T22:25:57.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.910+0000 7f78c0ff9700 1 -- 172.21.15.40:0/2477418548 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f78b40199a0 con 0x7f78c406f070 2023-09-30T22:25:57.910 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:57.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.913+0000 7f78ca3a4700 1 -- 172.21.15.40:0/2477418548 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78c406f070 msgr2=0x7f78c412d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:57.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.913+0000 7f78ca3a4700 1 --2- 172.21.15.40:0/2477418548 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78c406f070 0x7f78c412d530 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f78b40090b0 tx=0x7f78b4004750 comp rx=0 tx=0).stop 2023-09-30T22:25:57.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.913+0000 7f78ca3a4700 1 -- 172.21.15.40:0/2477418548 shutdown_connections 2023-09-30T22:25:57.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.913+0000 7f78ca3a4700 1 --2- 172.21.15.40:0/2477418548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78c406fdb0 0x7f78c412dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.913+0000 7f78ca3a4700 1 --2- 172.21.15.40:0/2477418548 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78c406f070 0x7f78c412d530 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.913+0000 7f78ca3a4700 1 --2- 172.21.15.40:0/2477418548 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f78c406f980 0x7f78c412da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.913+0000 7f78ca3a4700 1 -- 172.21.15.40:0/2477418548 >> 172.21.15.40:0/2477418548 conn(0x7f78c40a41a0 msgr2=0x7f78c41292a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:57.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.913+0000 7f78ca3a4700 1 -- 172.21.15.40:0/2477418548 shutdown_connections 2023-09-30T22:25:57.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.913+0000 7f78ca3a4700 1 -- 172.21.15.40:0/2477418548 wait complete. 2023-09-30T22:25:57.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:57.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.958+0000 7f319ccbb700 1 Processor -- start 2023-09-30T22:25:57.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.958+0000 7f319ccbb700 1 -- start start 2023-09-30T22:25:57.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.959+0000 7f319ccbb700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f319809c890 0x7f319809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.959+0000 7f319ccbb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319809d920 0x7f319809dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.959+0000 7f319ccbb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f319809e2b0 0x7f319813ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.959+0000 7f319ccbb700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31980a29d0 con 0x7f319809e2b0 2023-09-30T22:25:57.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.959+0000 7f319ccbb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319809fb40 con 0x7f319809d920 2023-09-30T22:25:57.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.959+0000 7f319ccbb700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31980a2600 con 0x7f319809c890 2023-09-30T22:25:57.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.959+0000 7f319659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f319809c890 0x7f319809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:57.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.959+0000 7f319659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f319809c890 0x7f319809cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:43754/0 (socket says 172.21.15.40:43754) 2023-09-30T22:25:57.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.959+0000 7f319659c700 1 -- 172.21.15.40:0/2755099131 learned_addr learned my addr 172.21.15.40:0/2755099131 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:57.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.959+0000 7f3195d9b700 1 --2- 172.21.15.40:0/2755099131 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319809d920 0x7f319809dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:57.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.959+0000 7f3196d9d700 1 --2- 172.21.15.40:0/2755099131 >> v2:172.21.15.40:3300/0 conn(0x7f319809e2b0 0x7f319813ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:57.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.959+0000 7f3195d9b700 1 -- 172.21.15.40:0/2755099131 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f319809c890 msgr2=0x7f319809cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:57.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.959+0000 7f3195d9b700 1 --2- 172.21.15.40:0/2755099131 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f319809c890 0x7f319809cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.959+0000 7f3195d9b700 1 -- 172.21.15.40:0/2755099131 >> v2:172.21.15.40:3300/0 conn(0x7f319809e2b0 msgr2=0x7f319813ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:57.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.959+0000 7f3195d9b700 1 --2- 172.21.15.40:0/2755099131 >> v2:172.21.15.40:3300/0 conn(0x7f319809e2b0 0x7f319813ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.959+0000 7f3195d9b700 1 -- 172.21.15.40:0/2755099131 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319809e720 con 0x7f319809d920 2023-09-30T22:25:57.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.959+0000 7f319659c700 1 --2- 172.21.15.40:0/2755099131 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f319809c890 0x7f319809cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:57.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.960+0000 7f3195d9b700 1 --2- 172.21.15.40:0/2755099131 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319809d920 0x7f319809dd70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f318c009870 tx=0x7f318c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab8b6d8fef6118c7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:57.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.960+0000 7f319559a700 1 -- 172.21.15.40:0/2755099131 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318c011830 con 0x7f319809d920 2023-09-30T22:25:57.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.960+0000 7f319559a700 1 -- 172.21.15.40:0/2755099131 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318c011990 con 0x7f319809d920 2023-09-30T22:25:57.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.960+0000 7f319559a700 1 -- 172.21.15.40:0/2755099131 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318c011d20 con 0x7f319809d920 2023-09-30T22:25:57.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.960+0000 7f319ccbb700 1 -- 172.21.15.40:0/2755099131 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319809d920 msgr2=0x7f319809dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:57.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.960+0000 7f319ccbb700 1 --2- 172.21.15.40:0/2755099131 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319809d920 0x7f319809dd70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f318c009870 tx=0x7f318c009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:57.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.960+0000 7f319ccbb700 1 -- 172.21.15.40:0/2755099131 shutdown_connections 2023-09-30T22:25:57.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.960+0000 7f319ccbb700 1 --2- 172.21.15.40:0/2755099131 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f319809c890 0x7f319809cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.960+0000 7f319ccbb700 1 --2- 172.21.15.40:0/2755099131 >> v2:172.21.15.40:3300/0 conn(0x7f319809e2b0 0x7f319813ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.960+0000 7f319ccbb700 1 --2- 172.21.15.40:0/2755099131 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319809d920 0x7f319809dd70 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.960+0000 7f319ccbb700 1 -- 172.21.15.40:0/2755099131 >> 172.21.15.40:0/2755099131 conn(0x7f31980a7080 msgr2=0x7f31980a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.961+0000 7f319ccbb700 1 -- 172.21.15.40:0/2755099131 shutdown_connections 2023-09-30T22:25:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.961+0000 7f319ccbb700 1 -- 172.21.15.40:0/2755099131 wait complete. 2023-09-30T22:25:57.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.962+0000 7f319ccbb700 1 Processor -- start 2023-09-30T22:25:57.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.962+0000 7f319ccbb700 1 -- start start 2023-09-30T22:25:57.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.962+0000 7f319ccbb700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f319809c890 0x7f319812d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.962+0000 7f319ccbb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319809d920 0x7f319812d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.962+0000 7f319ccbb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f319809e2b0 0x7f319812dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.962+0000 7f319ccbb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3198130990 con 0x7f319809e2b0 2023-09-30T22:25:57.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.962+0000 7f319ccbb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3198130b70 con 0x7f319809d920 2023-09-30T22:25:57.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.962+0000 7f319ccbb700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31980a5be0 con 0x7f319809c890 2023-09-30T22:25:57.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.962+0000 7f3195d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319809d920 0x7f319812d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:57.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.962+0000 7f3195d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319809d920 0x7f319812d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:33732/0 (socket says 172.21.15.40:33732) 2023-09-30T22:25:57.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.962+0000 7f3195d9b700 1 -- 172.21.15.40:0/2152761810 learned_addr learned my addr 172.21.15.40:0/2152761810 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:57.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.962+0000 7f319659c700 1 --2- 172.21.15.40:0/2152761810 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f319809c890 0x7f319812d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:57.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.962+0000 7f3196d9d700 1 --2- 172.21.15.40:0/2152761810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f319809e2b0 0x7f319812dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:57.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.963+0000 7f3195d9b700 1 -- 172.21.15.40:0/2152761810 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f319809c890 msgr2=0x7f319812d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:57.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.963+0000 7f3195d9b700 1 --2- 172.21.15.40:0/2152761810 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f319809c890 0x7f319812d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.963+0000 7f3195d9b700 1 -- 172.21.15.40:0/2152761810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f319809e2b0 msgr2=0x7f319812dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:57.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.963+0000 7f3195d9b700 1 --2- 172.21.15.40:0/2152761810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f319809e2b0 0x7f319812dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.963+0000 7f3195d9b700 1 -- 172.21.15.40:0/2152761810 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3188009500 con 0x7f319809d920 2023-09-30T22:25:57.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.963+0000 7f3195d9b700 1 --2- 172.21.15.40:0/2152761810 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319809d920 0x7f319812d720 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f318c0097c0 tx=0x7f318c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:57.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.963+0000 7f3186ffd700 1 -- 172.21.15.40:0/2152761810 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318c004450 con 0x7f319809d920 2023-09-30T22:25:57.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.963+0000 7f3186ffd700 1 -- 172.21.15.40:0/2152761810 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318c01f070 con 0x7f319809d920 2023-09-30T22:25:57.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.963+0000 7f3186ffd700 1 -- 172.21.15.40:0/2152761810 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318c0038e0 con 0x7f319809d920 2023-09-30T22:25:57.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.964+0000 7f319ccbb700 1 -- 172.21.15.40:0/2152761810 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f318c0094a0 con 0x7f319809d920 2023-09-30T22:25:57.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.964+0000 7f319ccbb700 1 -- 172.21.15.40:0/2152761810 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f319812f140 con 0x7f319809d920 2023-09-30T22:25:57.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.964+0000 7f319ccbb700 1 -- 172.21.15.40:0/2152761810 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f319809c2d0 con 0x7f319809d920 2023-09-30T22:25:57.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.965+0000 7f3186ffd700 1 -- 172.21.15.40:0/2152761810 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f318c003a40 con 0x7f319809d920 2023-09-30T22:25:57.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.965+0000 7f3186ffd700 1 -- 172.21.15.40:0/2152761810 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f318c021070 con 0x7f319809d920 2023-09-30T22:25:57.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:57.974+0000 7f3186ffd700 1 -- 172.21.15.40:0/2152761810 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f318c003cf0 con 0x7f319809d920 2023-09-30T22:25:58.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.017+0000 7fd5a7176700 1 Processor -- start 2023-09-30T22:25:58.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.017+0000 7fd5a7176700 1 -- start start 2023-09-30T22:25:58.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.018+0000 7fd5a7176700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd5a009c890 0x7fd5a009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:58.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.018+0000 7fd5a7176700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd5a009e480 0x7fd5a013bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:58.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.018+0000 7fd5a7176700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5a00a2600 con 0x7fd5a009d920 2023-09-30T22:25:58.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.018+0000 7fd5a7176700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a00a29d0 con 0x7fd5a009c890 2023-09-30T22:25:58.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.018+0000 7fd5a7176700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a009fb40 con 0x7fd5a009e480 2023-09-30T22:25:58.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.018+0000 7fd59ffff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd5a009d920 0x7fd5a009dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60092/0 (socket says 172.21.15.40:60092) 2023-09-30T22:25:58.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.018+0000 7fd59ffff700 1 -- 172.21.15.40:0/700858167 learned_addr learned my addr 172.21.15.40:0/700858167 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:58.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.018+0000 7fd5a4f12700 1 --2- 172.21.15.40:0/700858167 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd5a009c890 0x7fd5a009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:58.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.018+0000 7fd5a5713700 1 --2- 172.21.15.40:0/700858167 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd5a009e480 0x7fd5a013bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:58.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.018+0000 7fd59f7fe700 1 -- 172.21.15.40:0/700858167 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1885252792 0 0) 0x7fd5a00a2600 con 0x7fd5a009d920 2023-09-30T22:25:58.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.018+0000 7fd5a4f12700 1 -- 172.21.15.40:0/700858167 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd5a009e480 msgr2=0x7fd5a013bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:58.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.018+0000 7fd5a4f12700 1 --2- 172.21.15.40:0/700858167 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd5a009e480 0x7fd5a013bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.018+0000 7fd5a4f12700 1 -- 172.21.15.40:0/700858167 >> v1:172.21.15.40:6789/0 conn(0x7fd5a009d920 legacy=0x7fd5a009dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:58.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.018+0000 7fd5a4f12700 1 -- 172.21.15.40:0/700858167 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a009fed0 con 0x7fd5a009c890 2023-09-30T22:25:58.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.018+0000 7fd5a5713700 1 --2- 172.21.15.40:0/700858167 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd5a009e480 0x7fd5a013bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:58.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.018+0000 7fd5a4f12700 1 --2- 172.21.15.40:0/700858167 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd5a009c890 0x7fd5a009cc60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd594009850 tx=0x7fd594009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=baa992a4bb119f5b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:58.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.019+0000 7fd59f7fe700 1 -- 172.21.15.40:0/700858167 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd594005e30 con 0x7fd5a009c890 2023-09-30T22:25:58.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.019+0000 7fd59f7fe700 1 -- 172.21.15.40:0/700858167 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd594006030 con 0x7fd5a009c890 2023-09-30T22:25:58.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.019+0000 7fd59f7fe700 1 -- 172.21.15.40:0/700858167 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5940063e0 con 0x7fd5a009c890 2023-09-30T22:25:58.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.019+0000 7fd5a7176700 1 -- 172.21.15.40:0/700858167 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd5a009c890 msgr2=0x7fd5a009cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:58.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.019+0000 7fd5a7176700 1 --2- 172.21.15.40:0/700858167 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd5a009c890 0x7fd5a009cc60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd594009850 tx=0x7fd594009b60 comp rx=0 tx=0).stop 2023-09-30T22:25:58.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.019+0000 7fd5a7176700 1 -- 172.21.15.40:0/700858167 shutdown_connections 2023-09-30T22:25:58.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.019+0000 7fd5a7176700 1 --2- 172.21.15.40:0/700858167 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd5a009e480 0x7fd5a013bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.019+0000 7fd5a7176700 1 --2- 172.21.15.40:0/700858167 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd5a009c890 0x7fd5a009cc60 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.019+0000 7fd5a7176700 1 -- 172.21.15.40:0/700858167 >> 172.21.15.40:0/700858167 conn(0x7fd5a00a7080 msgr2=0x7fd5a00a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:58.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.019+0000 7fd5a7176700 1 -- 172.21.15.40:0/700858167 shutdown_connections 2023-09-30T22:25:58.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.019+0000 7fd5a7176700 1 -- 172.21.15.40:0/700858167 wait complete. 2023-09-30T22:25:58.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.020+0000 7fd5a7176700 1 Processor -- start 2023-09-30T22:25:58.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.020+0000 7fd5a7176700 1 -- start start 2023-09-30T22:25:58.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.021+0000 7fd5a7176700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd5a009c890 0x7fd5a012d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:58.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.021+0000 7fd5a7176700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5a009d920 0x7fd5a012d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:58.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.021+0000 7fd5a7176700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd5a009e480 0x7fd5a012db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:58.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.021+0000 7fd5a7176700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a0130b60 con 0x7fd5a009d920 2023-09-30T22:25:58.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.021+0000 7fd5a7176700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a012fb00 con 0x7fd5a009e480 2023-09-30T22:25:58.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.021+0000 7fd5a7176700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a00a5cd0 con 0x7fd5a009c890 2023-09-30T22:25:58.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.021+0000 7fd59ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5a009d920 0x7fd5a012d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:58.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.021+0000 7fd59ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5a009d920 0x7fd5a012d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45266/0 (socket says 172.21.15.40:45266) 2023-09-30T22:25:58.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.021+0000 7fd5a4f12700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd5a009c890 0x7fd5a012d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:58.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.021+0000 7fd59ffff700 1 -- 172.21.15.40:0/3340246471 learned_addr learned my addr 172.21.15.40:0/3340246471 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:58.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.021+0000 7fd5a5713700 1 --2- 172.21.15.40:0/3340246471 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd5a009e480 0x7fd5a012db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:58.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.021+0000 7fd5a5713700 1 -- 172.21.15.40:0/3340246471 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd5a009c890 msgr2=0x7fd5a012d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:58.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.021+0000 7fd5a5713700 1 --2- 172.21.15.40:0/3340246471 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd5a009c890 0x7fd5a012d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.021+0000 7fd5a5713700 1 -- 172.21.15.40:0/3340246471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5a009d920 msgr2=0x7fd5a012d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:58.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.021+0000 7fd5a5713700 1 --2- 172.21.15.40:0/3340246471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5a009d920 0x7fd5a012d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.021+0000 7fd5a5713700 1 -- 172.21.15.40:0/3340246471 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd598009a70 con 0x7fd5a009e480 2023-09-30T22:25:58.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.021+0000 7fd59ffff700 1 --2- 172.21.15.40:0/3340246471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5a009d920 0x7fd5a012d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:58.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.022+0000 7fd5a5713700 1 --2- 172.21.15.40:0/3340246471 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd5a009e480 0x7fd5a012db60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd59800efc0 tx=0x7fd59800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:58.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.022+0000 7fd59d7fa700 1 -- 172.21.15.40:0/3340246471 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59800ca90 con 0x7fd5a009e480 2023-09-30T22:25:58.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.022+0000 7fd59d7fa700 1 -- 172.21.15.40:0/3340246471 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59800f040 con 0x7fd5a009e480 2023-09-30T22:25:58.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.022+0000 7fd59d7fa700 1 -- 172.21.15.40:0/3340246471 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59800ce30 con 0x7fd5a009e480 2023-09-30T22:25:58.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.022+0000 7fd5a7176700 1 -- 172.21.15.40:0/3340246471 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd594009430 con 0x7fd5a009e480 2023-09-30T22:25:58.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.022+0000 7fd5a7176700 1 -- 172.21.15.40:0/3340246471 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a009ecf0 con 0x7fd5a009e480 2023-09-30T22:25:58.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.023+0000 7fd59d7fa700 1 -- 172.21.15.40:0/3340246471 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd598014480 con 0x7fd5a009e480 2023-09-30T22:25:58.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.023+0000 7fd5a7176700 1 -- 172.21.15.40:0/3340246471 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a01309c0 con 0x7fd5a009e480 2023-09-30T22:25:58.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.023+0000 7fd59d7fa700 1 -- 172.21.15.40:0/3340246471 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd59803fcb0 con 0x7fd5a009e480 2023-09-30T22:25:58.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.032+0000 7fd59d7fa700 1 -- 172.21.15.40:0/3340246471 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd5a01309c0 con 0x7fd5a009e480 2023-09-30T22:25:58.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.105+0000 7f1d07f5c700 1 -- 172.21.15.40:0/2846603103 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1d0009b1e0 con 0x7f1d00131d50 2023-09-30T22:25:58.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.105+0000 7f1cf27fc700 1 -- 172.21.15.40:0/2846603103 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1cfc020070 con 0x7f1d00131d50 2023-09-30T22:25:58.106 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:58.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.107+0000 7f1d07f5c700 1 -- 172.21.15.40:0/2846603103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d00131d50 msgr2=0x7f1d00119ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:58.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.107+0000 7f1d07f5c700 1 --2- 172.21.15.40:0/2846603103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d00131d50 0x7f1d00119ad0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc00e830 tx=0x7f1cfc00eb40 comp rx=0 tx=0).stop 2023-09-30T22:25:58.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.107+0000 7f1d07f5c700 1 -- 172.21.15.40:0/2846603103 shutdown_connections 2023-09-30T22:25:58.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.107+0000 7f1d07f5c700 1 --2- 172.21.15.40:0/2846603103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d00131d50 0x7f1d00119ad0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.107+0000 7f1d07f5c700 1 --2- 172.21.15.40:0/2846603103 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d0009bc50 0x7f1d00119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.107+0000 7f1d07f5c700 1 --2- 172.21.15.40:0/2846603103 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d0009c600 0x7f1d00119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.107+0000 7f1d07f5c700 1 -- 172.21.15.40:0/2846603103 >> 172.21.15.40:0/2846603103 conn(0x7f1d000a2a00 msgr2=0x7f1d0012d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:58.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.107+0000 7f1d07f5c700 1 -- 172.21.15.40:0/2846603103 shutdown_connections 2023-09-30T22:25:58.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.107+0000 7f1d07f5c700 1 -- 172.21.15.40:0/2846603103 wait complete. 2023-09-30T22:25:58.121 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:58.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.172+0000 7f319ccbb700 1 -- 172.21.15.40:0/2152761810 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3198062380 con 0x7f319809d920 2023-09-30T22:25:58.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.172+0000 7f3186ffd700 1 -- 172.21.15.40:0/2152761810 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f318c02b070 con 0x7f319809d920 2023-09-30T22:25:58.173 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:58.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.174+0000 7f319ccbb700 1 -- 172.21.15.40:0/2152761810 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319809d920 msgr2=0x7f319812d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:58.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.174+0000 7f319ccbb700 1 --2- 172.21.15.40:0/2152761810 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319809d920 0x7f319812d720 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f318c0097c0 tx=0x7f318c004750 comp rx=0 tx=0).stop 2023-09-30T22:25:58.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.174+0000 7f319ccbb700 1 -- 172.21.15.40:0/2152761810 shutdown_connections 2023-09-30T22:25:58.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.174+0000 7f319ccbb700 1 --2- 172.21.15.40:0/2152761810 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f319809c890 0x7f319812d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.174+0000 7f319ccbb700 1 --2- 172.21.15.40:0/2152761810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f319809e2b0 0x7f319812dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.174+0000 7f319ccbb700 1 --2- 172.21.15.40:0/2152761810 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319809d920 0x7f319812d720 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.174+0000 7f319ccbb700 1 -- 172.21.15.40:0/2152761810 >> 172.21.15.40:0/2152761810 conn(0x7f31980a7080 msgr2=0x7f31980a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:58.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.174+0000 7f319ccbb700 1 -- 172.21.15.40:0/2152761810 shutdown_connections 2023-09-30T22:25:58.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.174+0000 7f319ccbb700 1 -- 172.21.15.40:0/2152761810 wait complete. 2023-09-30T22:25:58.189 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:58.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.231+0000 7fd5a7176700 1 -- 172.21.15.40:0/3340246471 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd5a0130990 con 0x7fd5a009e480 2023-09-30T22:25:58.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.231+0000 7fd59d7fa700 1 -- 172.21.15.40:0/3340246471 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd598012910 con 0x7fd5a009e480 2023-09-30T22:25:58.232 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:58.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.233+0000 7fd5a7176700 1 -- 172.21.15.40:0/3340246471 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd5a009e480 msgr2=0x7fd5a012db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:58.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.233+0000 7fd5a7176700 1 --2- 172.21.15.40:0/3340246471 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd5a009e480 0x7fd5a012db60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd59800efc0 tx=0x7fd59800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.233+0000 7fd5a7176700 1 -- 172.21.15.40:0/3340246471 shutdown_connections 2023-09-30T22:25:58.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.233+0000 7fd5a7176700 1 --2- 172.21.15.40:0/3340246471 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd5a009c890 0x7fd5a012d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.233+0000 7fd5a7176700 1 --2- 172.21.15.40:0/3340246471 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd5a009e480 0x7fd5a012db60 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.233+0000 7fd5a7176700 1 --2- 172.21.15.40:0/3340246471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5a009d920 0x7fd5a012d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.233+0000 7fd5a7176700 1 -- 172.21.15.40:0/3340246471 >> 172.21.15.40:0/3340246471 conn(0x7fd5a00a7080 msgr2=0x7fd5a00a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:58.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.233+0000 7fd5a7176700 1 -- 172.21.15.40:0/3340246471 shutdown_connections 2023-09-30T22:25:58.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:58.233+0000 7fd5a7176700 1 -- 172.21.15.40:0/3340246471 wait complete. 2023-09-30T22:25:58.246 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:25:58.934 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:59.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.074+0000 7fe69def7700 1 Processor -- start 2023-09-30T22:25:59.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.074+0000 7fe69def7700 1 -- start start 2023-09-30T22:25:59.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.075+0000 7fe69def7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe69809d920 0x7fe69809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.075+0000 7fe69def7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe698130fb0 0x7fe698138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.075+0000 7fe69def7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe69809adf0 con 0x7fe69809e230 2023-09-30T22:25:59.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.075+0000 7fe69def7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69809edf0 con 0x7fe69809d920 2023-09-30T22:25:59.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.075+0000 7fe69def7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe69809b660 con 0x7fe698130fb0 2023-09-30T22:25:59.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.075+0000 7fe6977fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe69809d920 0x7fe69809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.075+0000 7fe697fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe698130fb0 0x7fe698138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.075+0000 7fe68ffff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe69809e230 0x7fe6981308a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60100/0 (socket says 172.21.15.40:60100) 2023-09-30T22:25:59.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.075+0000 7fe68ffff700 1 -- 172.21.15.40:0/3832095917 learned_addr learned my addr 172.21.15.40:0/3832095917 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:25:59.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.076+0000 7fe6977fe700 1 -- 172.21.15.40:0/3832095917 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe698130fb0 msgr2=0x7fe698138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:59.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.076+0000 7fe6977fe700 1 --2- 172.21.15.40:0/3832095917 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe698130fb0 0x7fe698138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.076+0000 7fe6977fe700 1 -- 172.21.15.40:0/3832095917 >> v1:172.21.15.40:6789/0 conn(0x7fe69809e230 legacy=0x7fe6981308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.076+0000 7fe6977fe700 1 -- 172.21.15.40:0/3832095917 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe69809a6e0 con 0x7fe69809d920 2023-09-30T22:25:59.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.076+0000 7fe697fff700 1 --2- 172.21.15.40:0/3832095917 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe698130fb0 0x7fe698138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:59.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.076+0000 7fe6977fe700 1 --2- 172.21.15.40:0/3832095917 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe69809d920 0x7fe69809dcf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe688009850 tx=0x7fe688009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58fb5a5557e33f16 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:59.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.076+0000 7fe696ffd700 1 -- 172.21.15.40:0/3832095917 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe688005e30 con 0x7fe69809d920 2023-09-30T22:25:59.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.076+0000 7fe696ffd700 1 -- 172.21.15.40:0/3832095917 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe688004030 con 0x7fe69809d920 2023-09-30T22:25:59.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.076+0000 7fe696ffd700 1 -- 172.21.15.40:0/3832095917 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6880043e0 con 0x7fe69809d920 2023-09-30T22:25:59.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.077+0000 7fe69def7700 1 -- 172.21.15.40:0/3832095917 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe69809d920 msgr2=0x7fe69809dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.077+0000 7fe69def7700 1 --2- 172.21.15.40:0/3832095917 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe69809d920 0x7fe69809dcf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe688009850 tx=0x7fe688009b60 comp rx=0 tx=0).stop 2023-09-30T22:25:59.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.077+0000 7fe69def7700 1 -- 172.21.15.40:0/3832095917 shutdown_connections 2023-09-30T22:25:59.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.077+0000 7fe69def7700 1 --2- 172.21.15.40:0/3832095917 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe698130fb0 0x7fe698138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.077+0000 7fe69def7700 1 --2- 172.21.15.40:0/3832095917 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe69809d920 0x7fe69809dcf0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.077+0000 7fe69def7700 1 -- 172.21.15.40:0/3832095917 >> 172.21.15.40:0/3832095917 conn(0x7fe69809fb20 msgr2=0x7fe69809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:59.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.077+0000 7fe69def7700 1 -- 172.21.15.40:0/3832095917 shutdown_connections 2023-09-30T22:25:59.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.077+0000 7fe69def7700 1 -- 172.21.15.40:0/3832095917 wait complete. 2023-09-30T22:25:59.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.078+0000 7fe69def7700 1 Processor -- start 2023-09-30T22:25:59.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.078+0000 7fe69def7700 1 -- start start 2023-09-30T22:25:59.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.079+0000 7fe69def7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69809d920 0x7fe6981212e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.079+0000 7fe69def7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe69809e230 0x7fe698121820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.079+0000 7fe69def7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe698130fb0 0x7fe698121d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.079+0000 7fe69def7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe698123120 con 0x7fe69809d920 2023-09-30T22:25:59.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.079+0000 7fe69def7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69806b4e0 con 0x7fe698130fb0 2023-09-30T22:25:59.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.079+0000 7fe69def7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe69809cb00 con 0x7fe69809e230 2023-09-30T22:25:59.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.079+0000 7fe6977fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69809d920 0x7fe6981212e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.079+0000 7fe6977fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69809d920 0x7fe6981212e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45268/0 (socket says 172.21.15.40:45268) 2023-09-30T22:25:59.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.079+0000 7fe68ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe69809e230 0x7fe698121820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.079+0000 7fe6977fe700 1 -- 172.21.15.40:0/2104088260 learned_addr learned my addr 172.21.15.40:0/2104088260 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:59.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.079+0000 7fe697fff700 1 --2- 172.21.15.40:0/2104088260 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe698130fb0 0x7fe698121d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.079+0000 7fe6977fe700 1 -- 172.21.15.40:0/2104088260 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe69809e230 msgr2=0x7fe698121820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.079+0000 7fe6977fe700 1 --2- 172.21.15.40:0/2104088260 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe69809e230 0x7fe698121820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.079+0000 7fe6977fe700 1 -- 172.21.15.40:0/2104088260 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe698130fb0 msgr2=0x7fe698121d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.079+0000 7fe6977fe700 1 --2- 172.21.15.40:0/2104088260 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe698130fb0 0x7fe698121d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.079+0000 7fe6977fe700 1 -- 172.21.15.40:0/2104088260 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe690009a70 con 0x7fe69809d920 2023-09-30T22:25:59.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.079+0000 7fe6977fe700 1 --2- 172.21.15.40:0/2104088260 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69809d920 0x7fe6981212e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe698068450 tx=0x7fe688004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:59.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.080+0000 7fe694ff9700 1 -- 172.21.15.40:0/2104088260 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe688003d60 con 0x7fe69809d920 2023-09-30T22:25:59.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.080+0000 7fe694ff9700 1 -- 172.21.15.40:0/2104088260 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68801d430 con 0x7fe69809d920 2023-09-30T22:25:59.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.080+0000 7fe69def7700 1 -- 172.21.15.40:0/2104088260 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe688009430 con 0x7fe69809d920 2023-09-30T22:25:59.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.080+0000 7fe694ff9700 1 -- 172.21.15.40:0/2104088260 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68801d7c0 con 0x7fe69809d920 2023-09-30T22:25:59.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.080+0000 7fe69def7700 1 -- 172.21.15.40:0/2104088260 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe698122730 con 0x7fe69809d920 2023-09-30T22:25:59.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.080+0000 7fe694ff9700 1 -- 172.21.15.40:0/2104088260 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe68801d920 con 0x7fe69809d920 2023-09-30T22:25:59.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.081+0000 7fe694ff9700 1 -- 172.21.15.40:0/2104088260 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe6880405f0 con 0x7fe69809d920 2023-09-30T22:25:59.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.081+0000 7fe69def7700 1 -- 172.21.15.40:0/2104088260 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe69811bee0 con 0x7fe69809d920 2023-09-30T22:25:59.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.085+0000 7fe694ff9700 1 -- 172.21.15.40:0/2104088260 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe688021020 con 0x7fe69809d920 2023-09-30T22:25:59.122 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:59.191 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:59.247 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:59.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.250+0000 7f9355926700 1 Processor -- start 2023-09-30T22:25:59.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.250+0000 7f9355926700 1 -- start start 2023-09-30T22:25:59.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.251+0000 7f9355926700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f935012e590 0x7f935012e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.251+0000 7f9355926700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f935012eea0 0x7f935012d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.251+0000 7f9355926700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f935012d6d0 0x7f935012db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.251+0000 7f9355926700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f935009ca30 con 0x7f935012eea0 2023-09-30T22:25:59.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.251+0000 7f9355926700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f935009ab70 con 0x7f935012e590 2023-09-30T22:25:59.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.251+0000 7f9355926700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f935009bd70 con 0x7f935012d6d0 2023-09-30T22:25:59.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.251+0000 7f934effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f935012e590 0x7f935012e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.251+0000 7f934e7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f935012eea0 0x7f935012d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.251+0000 7f934effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f935012e590 0x7f935012e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:33784/0 (socket says 172.21.15.40:33784) 2023-09-30T22:25:59.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.251+0000 7f934effd700 1 -- 172.21.15.40:0/2432681313 learned_addr learned my addr 172.21.15.40:0/2432681313 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:59.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.252+0000 7f934f7fe700 1 --2- 172.21.15.40:0/2432681313 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f935012d6d0 0x7f935012db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.252+0000 7f934e7fc700 1 -- 172.21.15.40:0/2432681313 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f935012d6d0 msgr2=0x7f935012db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:59.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.252+0000 7f934e7fc700 1 --2- 172.21.15.40:0/2432681313 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f935012d6d0 0x7f935012db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.252+0000 7f934e7fc700 1 -- 172.21.15.40:0/2432681313 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f935012e590 msgr2=0x7f935012e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:59.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.252+0000 7f934e7fc700 1 --2- 172.21.15.40:0/2432681313 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f935012e590 0x7f935012e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.252+0000 7f934e7fc700 1 -- 172.21.15.40:0/2432681313 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f935009b270 con 0x7f935012eea0 2023-09-30T22:25:59.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.252+0000 7f934effd700 1 --2- 172.21.15.40:0/2432681313 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f935012e590 0x7f935012e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:59.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.252+0000 7f934e7fc700 1 --2- 172.21.15.40:0/2432681313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f935012eea0 0x7f935012d190 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9344009870 tx=0x7f9344009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b45b4690d783efa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:59.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.252+0000 7f934dffb700 1 -- 172.21.15.40:0/2432681313 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9344011830 con 0x7f935012eea0 2023-09-30T22:25:59.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.252+0000 7f934dffb700 1 -- 172.21.15.40:0/2432681313 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9344011990 con 0x7f935012eea0 2023-09-30T22:25:59.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.252+0000 7f934dffb700 1 -- 172.21.15.40:0/2432681313 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9344011d20 con 0x7f935012eea0 2023-09-30T22:25:59.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.253+0000 7f9355926700 1 -- 172.21.15.40:0/2432681313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f935012eea0 msgr2=0x7f935012d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.253+0000 7f9355926700 1 --2- 172.21.15.40:0/2432681313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f935012eea0 0x7f935012d190 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9344009870 tx=0x7f9344009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:59.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.253+0000 7f9355926700 1 -- 172.21.15.40:0/2432681313 shutdown_connections 2023-09-30T22:25:59.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.253+0000 7f9355926700 1 --2- 172.21.15.40:0/2432681313 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f935012d6d0 0x7f935012db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.253+0000 7f9355926700 1 --2- 172.21.15.40:0/2432681313 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f935012e590 0x7f935012e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.253+0000 7f9355926700 1 --2- 172.21.15.40:0/2432681313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f935012eea0 0x7f935012d190 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.253+0000 7f9355926700 1 -- 172.21.15.40:0/2432681313 >> 172.21.15.40:0/2432681313 conn(0x7f93500a2a00 msgr2=0x7f93500a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:59.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.253+0000 7f9355926700 1 -- 172.21.15.40:0/2432681313 shutdown_connections 2023-09-30T22:25:59.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.253+0000 7f9355926700 1 -- 172.21.15.40:0/2432681313 wait complete. 2023-09-30T22:25:59.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.255+0000 7f9355926700 1 Processor -- start 2023-09-30T22:25:59.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.255+0000 7f9355926700 1 -- start start 2023-09-30T22:25:59.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.256+0000 7f9355926700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f935012d6d0 0x7f935011dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.256+0000 7f9355926700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f935012e590 0x7f935011e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.256+0000 7f9355926700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f935012eea0 0x7f935011e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.256+0000 7f9355926700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935009fc70 con 0x7f935012d6d0 2023-09-30T22:25:59.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.256+0000 7f9355926700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f935009b4b0 con 0x7f935012e590 2023-09-30T22:25:59.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.256+0000 7f9355926700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9350120fc0 con 0x7f935012eea0 2023-09-30T22:25:59.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.256+0000 7f934e7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f935012e590 0x7f935011e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.256+0000 7f934e7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f935012e590 0x7f935011e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:33798/0 (socket says 172.21.15.40:33798) 2023-09-30T22:25:59.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.256+0000 7f934e7fc700 1 -- 172.21.15.40:0/3856860947 learned_addr learned my addr 172.21.15.40:0/3856860947 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:59.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.256+0000 7f934effd700 1 --2- 172.21.15.40:0/3856860947 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f935012d6d0 0x7f935011dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.256+0000 7f934f7fe700 1 --2- 172.21.15.40:0/3856860947 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f935012eea0 0x7f935011e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.256+0000 7f934f7fe700 1 -- 172.21.15.40:0/3856860947 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f935012e590 msgr2=0x7f935011e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.256+0000 7f934f7fe700 1 --2- 172.21.15.40:0/3856860947 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f935012e590 0x7f935011e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.256+0000 7f934f7fe700 1 -- 172.21.15.40:0/3856860947 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f935012d6d0 msgr2=0x7f935011dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.256+0000 7f934f7fe700 1 --2- 172.21.15.40:0/3856860947 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f935012d6d0 0x7f935011dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.256+0000 7f934f7fe700 1 -- 172.21.15.40:0/3856860947 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934000b7f0 con 0x7f935012eea0 2023-09-30T22:25:59.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.256+0000 7f934effd700 1 --2- 172.21.15.40:0/3856860947 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f935012d6d0 0x7f935011dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:59.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.257+0000 7f934e7fc700 1 --2- 172.21.15.40:0/3856860947 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f935012e590 0x7f935011e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:59.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.257+0000 7f934f7fe700 1 --2- 172.21.15.40:0/3856860947 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f935012eea0 0x7f935011e860 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f934800eed0 tx=0x7f934800b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:59.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.257+0000 7f9337fff700 1 -- 172.21.15.40:0/3856860947 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9348010040 con 0x7f935012eea0 2023-09-30T22:25:59.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.257+0000 7f9337fff700 1 -- 172.21.15.40:0/3856860947 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934800ba80 con 0x7f935012eea0 2023-09-30T22:25:59.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.257+0000 7f9355926700 1 -- 172.21.15.40:0/3856860947 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93440094a0 con 0x7f935012eea0 2023-09-30T22:25:59.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.257+0000 7f9337fff700 1 -- 172.21.15.40:0/3856860947 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934800be30 con 0x7f935012eea0 2023-09-30T22:25:59.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.257+0000 7f9355926700 1 -- 172.21.15.40:0/3856860947 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9350120110 con 0x7f935012eea0 2023-09-30T22:25:59.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.258+0000 7f9355926700 1 -- 172.21.15.40:0/3856860947 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f935006edb0 con 0x7f935012eea0 2023-09-30T22:25:59.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.259+0000 7f9337fff700 1 -- 172.21.15.40:0/3856860947 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f934801d400 con 0x7f935012eea0 2023-09-30T22:25:59.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.259+0000 7f9337fff700 1 -- 172.21.15.40:0/3856860947 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f93480403a0 con 0x7f935012eea0 2023-09-30T22:25:59.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.268+0000 7f9337fff700 1 -- 172.21.15.40:0/3856860947 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9348007330 con 0x7f935012eea0 2023-09-30T22:25:59.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.288+0000 7fe69def7700 1 -- 172.21.15.40:0/2104088260 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe698062380 con 0x7fe69809d920 2023-09-30T22:25:59.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.288+0000 7fe694ff9700 1 -- 172.21.15.40:0/2104088260 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe688016070 con 0x7fe69809d920 2023-09-30T22:25:59.289 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:59.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.290+0000 7fe69def7700 1 -- 172.21.15.40:0/2104088260 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69809d920 msgr2=0x7fe6981212e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.290+0000 7fe69def7700 1 --2- 172.21.15.40:0/2104088260 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69809d920 0x7fe6981212e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe698068450 tx=0x7fe688004750 comp rx=0 tx=0).stop 2023-09-30T22:25:59.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.290+0000 7fe69def7700 1 -- 172.21.15.40:0/2104088260 shutdown_connections 2023-09-30T22:25:59.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.290+0000 7fe69def7700 1 --2- 172.21.15.40:0/2104088260 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe698130fb0 0x7fe698121d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.290+0000 7fe69def7700 1 --2- 172.21.15.40:0/2104088260 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe69809d920 0x7fe6981212e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.290+0000 7fe69def7700 1 --2- 172.21.15.40:0/2104088260 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe69809e230 0x7fe698121820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.290+0000 7fe69def7700 1 -- 172.21.15.40:0/2104088260 >> 172.21.15.40:0/2104088260 conn(0x7fe69809fb20 msgr2=0x7fe698071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:59.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.290+0000 7fe69def7700 1 -- 172.21.15.40:0/2104088260 shutdown_connections 2023-09-30T22:25:59.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.290+0000 7fe69def7700 1 -- 172.21.15.40:0/2104088260 wait complete. 2023-09-30T22:25:59.309 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:25:59.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.332+0000 7f5685fac700 1 Processor -- start 2023-09-30T22:25:59.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.332+0000 7f5685fac700 1 -- start start 2023-09-30T22:25:59.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.332+0000 7f5685fac700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f568009d920 0x7f568009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.332+0000 7f5685fac700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f568009f0f0 0x7f568009e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.332+0000 7f5685fac700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5680133ca0 0x7f5680134110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.332+0000 7f5685fac700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f568006b4c0 con 0x7f568009d920 2023-09-30T22:25:59.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.333+0000 7f5685fac700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f568009a8f0 con 0x7f5680133ca0 2023-09-30T22:25:59.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.333+0000 7f5685fac700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f568009f940 con 0x7f568009f0f0 2023-09-30T22:25:59.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.333+0000 7f567f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f568009d920 0x7f568009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.333+0000 7f567effd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f568009f0f0 0x7f568009e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.333+0000 7f567effd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f568009f0f0 0x7f568009e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:43822/0 (socket says 172.21.15.40:43822) 2023-09-30T22:25:59.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.333+0000 7f567f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f568009d920 0x7f568009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45306/0 (socket says 172.21.15.40:45306) 2023-09-30T22:25:59.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.333+0000 7f567effd700 1 -- 172.21.15.40:0/463382967 learned_addr learned my addr 172.21.15.40:0/463382967 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:59.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.333+0000 7f567ffff700 1 --2- 172.21.15.40:0/463382967 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5680133ca0 0x7f5680134110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.333+0000 7f567effd700 1 -- 172.21.15.40:0/463382967 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5680133ca0 msgr2=0x7f5680134110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:59.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.333+0000 7f567effd700 1 --2- 172.21.15.40:0/463382967 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5680133ca0 0x7f5680134110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.333+0000 7f567effd700 1 -- 172.21.15.40:0/463382967 >> v2:172.21.15.40:3300/0 conn(0x7f568009d920 msgr2=0x7f568009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:59.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.333+0000 7f567effd700 1 --2- 172.21.15.40:0/463382967 >> v2:172.21.15.40:3300/0 conn(0x7f568009d920 0x7f568009dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.333+0000 7f567effd700 1 -- 172.21.15.40:0/463382967 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568009f6e0 con 0x7f568009f0f0 2023-09-30T22:25:59.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.333+0000 7f567f7fe700 1 --2- 172.21.15.40:0/463382967 >> v2:172.21.15.40:3300/0 conn(0x7f568009d920 0x7f568009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:59.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.333+0000 7f567effd700 1 --2- 172.21.15.40:0/463382967 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f568009f0f0 0x7f568009e230 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5674009920 tx=0x7f5674009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1573af8066436b7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:59.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.333+0000 7f567e7fc700 1 -- 172.21.15.40:0/463382967 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5674011830 con 0x7f568009f0f0 2023-09-30T22:25:59.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.334+0000 7f567e7fc700 1 -- 172.21.15.40:0/463382967 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5674011990 con 0x7f568009f0f0 2023-09-30T22:25:59.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.334+0000 7f567e7fc700 1 -- 172.21.15.40:0/463382967 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5674011d20 con 0x7f568009f0f0 2023-09-30T22:25:59.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.334+0000 7f5685fac700 1 -- 172.21.15.40:0/463382967 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f568009f0f0 msgr2=0x7f568009e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.334+0000 7f5685fac700 1 --2- 172.21.15.40:0/463382967 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f568009f0f0 0x7f568009e230 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5674009920 tx=0x7f5674009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:59.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.334+0000 7f5685fac700 1 -- 172.21.15.40:0/463382967 shutdown_connections 2023-09-30T22:25:59.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.334+0000 7f5685fac700 1 --2- 172.21.15.40:0/463382967 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5680133ca0 0x7f5680134110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.334+0000 7f5685fac700 1 --2- 172.21.15.40:0/463382967 >> v2:172.21.15.40:3300/0 conn(0x7f568009d920 0x7f568009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.334+0000 7f5685fac700 1 --2- 172.21.15.40:0/463382967 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f568009f0f0 0x7f568009e230 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.334+0000 7f5685fac700 1 -- 172.21.15.40:0/463382967 >> 172.21.15.40:0/463382967 conn(0x7f568009fb20 msgr2=0x7f568009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:59.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.334+0000 7f5685fac700 1 -- 172.21.15.40:0/463382967 shutdown_connections 2023-09-30T22:25:59.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.334+0000 7f5685fac700 1 -- 172.21.15.40:0/463382967 wait complete. 2023-09-30T22:25:59.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.335+0000 7f5685fac700 1 Processor -- start 2023-09-30T22:25:59.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.335+0000 7f5685fac700 1 -- start start 2023-09-30T22:25:59.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.336+0000 7f5685fac700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f568009d920 0x7f5680122c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.336+0000 7f5685fac700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5680133ca0 0x7f56801231d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.336+0000 7f5685fac700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5680123710 0x7f56801c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.336+0000 7f5685fac700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5680126820 con 0x7f5680123710 2023-09-30T22:25:59.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.336+0000 7f5685fac700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5680127290 con 0x7f5680133ca0 2023-09-30T22:25:59.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.336+0000 7f5685fac700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56801263d0 con 0x7f568009d920 2023-09-30T22:25:59.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.336+0000 7f567f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f568009d920 0x7f5680122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.336+0000 7f567effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5680133ca0 0x7f56801231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.336+0000 7f567f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f568009d920 0x7f5680122c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:43838/0 (socket says 172.21.15.40:43838) 2023-09-30T22:25:59.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.336+0000 7f567ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5680123710 0x7f56801c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.336+0000 7f567effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5680133ca0 0x7f56801231d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:33828/0 (socket says 172.21.15.40:33828) 2023-09-30T22:25:59.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.336+0000 7f567f7fe700 1 -- 172.21.15.40:0/1124577547 learned_addr learned my addr 172.21.15.40:0/1124577547 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:59.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.336+0000 7f567f7fe700 1 -- 172.21.15.40:0/1124577547 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5680133ca0 msgr2=0x7f56801231d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.336+0000 7f567f7fe700 1 --2- 172.21.15.40:0/1124577547 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5680133ca0 0x7f56801231d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.336+0000 7f567f7fe700 1 -- 172.21.15.40:0/1124577547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5680123710 msgr2=0x7f56801c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.336+0000 7f567f7fe700 1 --2- 172.21.15.40:0/1124577547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5680123710 0x7f56801c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.336+0000 7f567f7fe700 1 -- 172.21.15.40:0/1124577547 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5670009430 con 0x7f568009d920 2023-09-30T22:25:59.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.336+0000 7f567ffff700 1 --2- 172.21.15.40:0/1124577547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5680123710 0x7f56801c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:59.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.337+0000 7f567f7fe700 1 --2- 172.21.15.40:0/1124577547 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f568009d920 0x7f5680122c90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f567000e990 tx=0x7f567000eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:59.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.337+0000 7f5667fff700 1 -- 172.21.15.40:0/1124577547 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56700096c0 con 0x7f568009d920 2023-09-30T22:25:59.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.337+0000 7f5667fff700 1 -- 172.21.15.40:0/1124577547 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5670005a20 con 0x7f568009d920 2023-09-30T22:25:59.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.337+0000 7f5685fac700 1 -- 172.21.15.40:0/1124577547 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5674009550 con 0x7f568009d920 2023-09-30T22:25:59.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.337+0000 7f5667fff700 1 -- 172.21.15.40:0/1124577547 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5670005db0 con 0x7f568009d920 2023-09-30T22:25:59.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.337+0000 7f5685fac700 1 -- 172.21.15.40:0/1124577547 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5680071290 con 0x7f568009d920 2023-09-30T22:25:59.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.338+0000 7f5667fff700 1 -- 172.21.15.40:0/1124577547 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5670013680 con 0x7f568009d920 2023-09-30T22:25:59.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.338+0000 7f5685fac700 1 -- 172.21.15.40:0/1124577547 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5680124db0 con 0x7f568009d920 2023-09-30T22:25:59.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.338+0000 7f5667fff700 1 -- 172.21.15.40:0/1124577547 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f567003f930 con 0x7f568009d920 2023-09-30T22:25:59.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.343+0000 7f5667fff700 1 -- 172.21.15.40:0/1124577547 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5680124db0 con 0x7f568009d920 2023-09-30T22:25:59.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.389+0000 7f378525b700 1 Processor -- start 2023-09-30T22:25:59.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.389+0000 7f378525b700 1 -- start start 2023-09-30T22:25:59.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.390+0000 7f378525b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f378009c890 0x7f378009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.390+0000 7f378525b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f378009e480 0x7f378013bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.390+0000 7f378525b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37800a2600 con 0x7f378009d920 2023-09-30T22:25:59.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.390+0000 7f378525b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37800a29d0 con 0x7f378009c890 2023-09-30T22:25:59.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.390+0000 7f378525b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f378009fb40 con 0x7f378009e480 2023-09-30T22:25:59.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.390+0000 7f377f59e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f378009e480 0x7f378013bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.390+0000 7f377ed9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f378009c890 0x7f378009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.390+0000 7f377ed9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f378009c890 0x7f378009cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:33842/0 (socket says 172.21.15.40:33842) 2023-09-30T22:25:59.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.390+0000 7f377f59e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f378009e480 0x7f378013bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:43842/0 (socket says 172.21.15.40:43842) 2023-09-30T22:25:59.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.390+0000 7f377ed9d700 1 -- 172.21.15.40:0/4061541721 learned_addr learned my addr 172.21.15.40:0/4061541721 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:59.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.390+0000 7f377ed9d700 1 -- 172.21.15.40:0/4061541721 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f378009e480 msgr2=0x7f378013bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:59.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.390+0000 7f377ed9d700 1 --2- 172.21.15.40:0/4061541721 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f378009e480 0x7f378013bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.390+0000 7f377ed9d700 1 -- 172.21.15.40:0/4061541721 >> v1:172.21.15.40:6789/0 conn(0x7f378009d920 legacy=0x7f378009dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:59.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.390+0000 7f377ed9d700 1 -- 172.21.15.40:0/4061541721 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f378009fed0 con 0x7f378009c890 2023-09-30T22:25:59.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.390+0000 7f377f59e700 1 --2- 172.21.15.40:0/4061541721 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f378009e480 0x7f378013bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:59.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.391+0000 7f377ed9d700 1 --2- 172.21.15.40:0/4061541721 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f378009c890 0x7f378009cc60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f37700098f0 tx=0x7f3770009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e24b68d40074838a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:59.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.391+0000 7f377dd9b700 1 -- 172.21.15.40:0/4061541721 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770005e30 con 0x7f378009c890 2023-09-30T22:25:59.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.391+0000 7f377dd9b700 1 -- 172.21.15.40:0/4061541721 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3770006030 con 0x7f378009c890 2023-09-30T22:25:59.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.391+0000 7f377dd9b700 1 -- 172.21.15.40:0/4061541721 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37700063c0 con 0x7f378009c890 2023-09-30T22:25:59.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.391+0000 7f378525b700 1 -- 172.21.15.40:0/4061541721 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f378009c890 msgr2=0x7f378009cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.391+0000 7f378525b700 1 --2- 172.21.15.40:0/4061541721 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f378009c890 0x7f378009cc60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f37700098f0 tx=0x7f3770009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:59.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.391+0000 7f378525b700 1 -- 172.21.15.40:0/4061541721 shutdown_connections 2023-09-30T22:25:59.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.391+0000 7f378525b700 1 --2- 172.21.15.40:0/4061541721 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f378009e480 0x7f378013bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.391+0000 7f378525b700 1 --2- 172.21.15.40:0/4061541721 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f378009c890 0x7f378009cc60 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.391+0000 7f378525b700 1 -- 172.21.15.40:0/4061541721 >> 172.21.15.40:0/4061541721 conn(0x7f37800a7080 msgr2=0x7f37800a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:59.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.391+0000 7f378525b700 1 -- 172.21.15.40:0/4061541721 shutdown_connections 2023-09-30T22:25:59.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.391+0000 7f378525b700 1 -- 172.21.15.40:0/4061541721 wait complete. 2023-09-30T22:25:59.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.393+0000 7f378525b700 1 Processor -- start 2023-09-30T22:25:59.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.393+0000 7f378525b700 1 -- start start 2023-09-30T22:25:59.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.394+0000 7f378525b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f378009c890 0x7f378012d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.394+0000 7f378525b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f378009d920 0x7f378012d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.394+0000 7f378525b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f378009e480 0x7f378012df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.394+0000 7f378525b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378012f550 con 0x7f378009c890 2023-09-30T22:25:59.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.394+0000 7f378525b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37801308c0 con 0x7f378009e480 2023-09-30T22:25:59.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.394+0000 7f378525b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3780130b10 con 0x7f378009d920 2023-09-30T22:25:59.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.394+0000 7f377ed9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f378009c890 0x7f378012d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.394+0000 7f377ed9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f378009c890 0x7f378012d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45334/0 (socket says 172.21.15.40:45334) 2023-09-30T22:25:59.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.394+0000 7f377f59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f378009e480 0x7f378012df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.394+0000 7f377ed9d700 1 -- 172.21.15.40:0/415675755 learned_addr learned my addr 172.21.15.40:0/415675755 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:25:59.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.394+0000 7f377e59c700 1 --2- 172.21.15.40:0/415675755 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f378009d920 0x7f378012d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.394+0000 7f377f59e700 1 -- 172.21.15.40:0/415675755 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f378009d920 msgr2=0x7f378012d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.394+0000 7f377f59e700 1 --2- 172.21.15.40:0/415675755 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f378009d920 0x7f378012d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.394+0000 7f377f59e700 1 -- 172.21.15.40:0/415675755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f378009c890 msgr2=0x7f378012d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.394+0000 7f377f59e700 1 --2- 172.21.15.40:0/415675755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f378009c890 0x7f378012d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.394+0000 7f377f59e700 1 -- 172.21.15.40:0/415675755 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3778009a70 con 0x7f378009e480 2023-09-30T22:25:59.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.394+0000 7f377ed9d700 1 --2- 172.21.15.40:0/415675755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f378009c890 0x7f378012d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:59.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.395+0000 7f377f59e700 1 --2- 172.21.15.40:0/415675755 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f378009e480 0x7f378012df10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f377800efc0 tx=0x7f377800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:59.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.395+0000 7f37677fe700 1 -- 172.21.15.40:0/415675755 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377800ca90 con 0x7f378009e480 2023-09-30T22:25:59.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.395+0000 7f37677fe700 1 -- 172.21.15.40:0/415675755 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377800f040 con 0x7f378009e480 2023-09-30T22:25:59.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.395+0000 7f37677fe700 1 -- 172.21.15.40:0/415675755 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377800ce30 con 0x7f378009e480 2023-09-30T22:25:59.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.396+0000 7f378525b700 1 -- 172.21.15.40:0/415675755 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3770009500 con 0x7f378009e480 2023-09-30T22:25:59.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.396+0000 7f378525b700 1 -- 172.21.15.40:0/415675755 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f378008f3e0 con 0x7f378009e480 2023-09-30T22:25:59.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.396+0000 7f378525b700 1 -- 172.21.15.40:0/415675755 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3780062380 con 0x7f378009e480 2023-09-30T22:25:59.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.397+0000 7f37677fe700 1 -- 172.21.15.40:0/415675755 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3778014480 con 0x7f378009e480 2023-09-30T22:25:59.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.397+0000 7f37677fe700 1 -- 172.21.15.40:0/415675755 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f377803fc60 con 0x7f378009e480 2023-09-30T22:25:59.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.406+0000 7f37677fe700 1 -- 172.21.15.40:0/415675755 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3778012930 con 0x7f378009e480 2023-09-30T22:25:59.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.500+0000 7f9355926700 1 -- 172.21.15.40:0/3856860947 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9350062380 con 0x7f935012eea0 2023-09-30T22:25:59.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.501+0000 7f9337fff700 1 -- 172.21.15.40:0/3856860947 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f934802a020 con 0x7f935012eea0 2023-09-30T22:25:59.501 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:25:59.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.504+0000 7f9355926700 1 -- 172.21.15.40:0/3856860947 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f935012eea0 msgr2=0x7f935011e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.504+0000 7f9355926700 1 --2- 172.21.15.40:0/3856860947 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f935012eea0 0x7f935011e860 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f934800eed0 tx=0x7f934800b390 comp rx=0 tx=0).stop 2023-09-30T22:25:59.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.504+0000 7f9355926700 1 -- 172.21.15.40:0/3856860947 shutdown_connections 2023-09-30T22:25:59.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.504+0000 7f9355926700 1 --2- 172.21.15.40:0/3856860947 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f935012eea0 0x7f935011e860 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.504+0000 7f9355926700 1 --2- 172.21.15.40:0/3856860947 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f935012d6d0 0x7f935011dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.504+0000 7f9355926700 1 --2- 172.21.15.40:0/3856860947 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f935012e590 0x7f935011e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.504+0000 7f9355926700 1 -- 172.21.15.40:0/3856860947 >> 172.21.15.40:0/3856860947 conn(0x7f93500a2a00 msgr2=0x7f935012c950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:59.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.504+0000 7f9355926700 1 -- 172.21.15.40:0/3856860947 shutdown_connections 2023-09-30T22:25:59.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.504+0000 7f9355926700 1 -- 172.21.15.40:0/3856860947 wait complete. 2023-09-30T22:25:59.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:25:59.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.569+0000 7f5685fac700 1 -- 172.21.15.40:0/1124577547 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f56801240f0 con 0x7f568009d920 2023-09-30T22:25:59.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.570+0000 7f5667fff700 1 -- 172.21.15.40:0/1124577547 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5670020030 con 0x7f568009d920 2023-09-30T22:25:59.571 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:25:59.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.572+0000 7f5685fac700 1 -- 172.21.15.40:0/1124577547 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f568009d920 msgr2=0x7f5680122c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.572+0000 7f5685fac700 1 --2- 172.21.15.40:0/1124577547 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f568009d920 0x7f5680122c90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f567000e990 tx=0x7f567000eca0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.572+0000 7f5685fac700 1 -- 172.21.15.40:0/1124577547 shutdown_connections 2023-09-30T22:25:59.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.572+0000 7f5685fac700 1 --2- 172.21.15.40:0/1124577547 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f568009d920 0x7f5680122c90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.572+0000 7f5685fac700 1 --2- 172.21.15.40:0/1124577547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5680123710 0x7f56801c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.572+0000 7f5685fac700 1 --2- 172.21.15.40:0/1124577547 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5680133ca0 0x7f56801231d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.572+0000 7f5685fac700 1 -- 172.21.15.40:0/1124577547 >> 172.21.15.40:0/1124577547 conn(0x7f568009fb20 msgr2=0x7f56800a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:59.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.572+0000 7f5685fac700 1 -- 172.21.15.40:0/1124577547 shutdown_connections 2023-09-30T22:25:59.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.572+0000 7f5685fac700 1 -- 172.21.15.40:0/1124577547 wait complete. 2023-09-30T22:25:59.585 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:25:59.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.607+0000 7f378525b700 1 -- 172.21.15.40:0/415675755 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3780074620 con 0x7f378009e480 2023-09-30T22:25:59.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.607+0000 7f37677fe700 1 -- 172.21.15.40:0/415675755 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3778012340 con 0x7f378009e480 2023-09-30T22:25:59.608 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:25:59.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.609+0000 7f378525b700 1 -- 172.21.15.40:0/415675755 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f378009e480 msgr2=0x7f378012df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.609+0000 7f378525b700 1 --2- 172.21.15.40:0/415675755 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f378009e480 0x7f378012df10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f377800efc0 tx=0x7f377800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.609+0000 7f378525b700 1 -- 172.21.15.40:0/415675755 shutdown_connections 2023-09-30T22:25:59.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.609+0000 7f378525b700 1 --2- 172.21.15.40:0/415675755 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f378009e480 0x7f378012df10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.609+0000 7f378525b700 1 --2- 172.21.15.40:0/415675755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f378009c890 0x7f378012d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.609+0000 7f378525b700 1 --2- 172.21.15.40:0/415675755 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f378009d920 0x7f378012d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.609+0000 7f378525b700 1 -- 172.21.15.40:0/415675755 >> 172.21.15.40:0/415675755 conn(0x7f37800a7080 msgr2=0x7f37801329b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:59.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.609+0000 7f378525b700 1 -- 172.21.15.40:0/415675755 shutdown_connections 2023-09-30T22:25:59.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:25:59.609+0000 7f378525b700 1 -- 172.21.15.40:0/415675755 wait complete. 2023-09-30T22:25:59.623 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:00.310 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:00.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.451+0000 7ff930e92700 1 Processor -- start 2023-09-30T22:26:00.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.451+0000 7ff930e92700 1 -- start start 2023-09-30T22:26:00.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.452+0000 7ff930e92700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff92c06fb50 0x7ff92c136c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.452+0000 7ff930e92700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff92c1371b0 0x7ff92c139590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.452+0000 7ff930e92700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff92c070830 con 0x7ff92c06f070 2023-09-30T22:26:00.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.452+0000 7ff930e92700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff92c070ad0 con 0x7ff92c06fb50 2023-09-30T22:26:00.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.452+0000 7ff930e92700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c070de0 con 0x7ff92c1371b0 2023-09-30T22:26:00.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.452+0000 7ff92a59c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff92c06f070 0x7ff92c06f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60122/0 (socket says 172.21.15.40:60122) 2023-09-30T22:26:00.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.452+0000 7ff92a59c700 1 -- 172.21.15.40:0/3813625879 learned_addr learned my addr 172.21.15.40:0/3813625879 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:00.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.452+0000 7ff92ad9d700 1 --2- 172.21.15.40:0/3813625879 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff92c1371b0 0x7ff92c139590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.452+0000 7ff921d9b700 1 --2- 172.21.15.40:0/3813625879 >> v2:172.21.15.40:3300/0 conn(0x7ff92c06fb50 0x7ff92c136c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.453+0000 7ff921d9b700 1 -- 172.21.15.40:0/3813625879 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff92c1371b0 msgr2=0x7ff92c139590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:00.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.453+0000 7ff921d9b700 1 --2- 172.21.15.40:0/3813625879 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff92c1371b0 0x7ff92c139590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.453+0000 7ff921d9b700 1 -- 172.21.15.40:0/3813625879 >> v1:172.21.15.40:6789/0 conn(0x7ff92c06f070 legacy=0x7ff92c06f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.453+0000 7ff921d9b700 1 -- 172.21.15.40:0/3813625879 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff92c09fe20 con 0x7ff92c06fb50 2023-09-30T22:26:00.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.453+0000 7ff92ad9d700 1 --2- 172.21.15.40:0/3813625879 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff92c1371b0 0x7ff92c139590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:00.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.453+0000 7ff921d9b700 1 --2- 172.21.15.40:0/3813625879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff92c06fb50 0x7ff92c136c70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff914009840 tx=0x7ff914009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbbd0ada0136855f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:00.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.453+0000 7ff929d9b700 1 -- 172.21.15.40:0/3813625879 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff914011830 con 0x7ff92c06fb50 2023-09-30T22:26:00.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.453+0000 7ff929d9b700 1 -- 172.21.15.40:0/3813625879 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff914011990 con 0x7ff92c06fb50 2023-09-30T22:26:00.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.453+0000 7ff929d9b700 1 -- 172.21.15.40:0/3813625879 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff914011d20 con 0x7ff92c06fb50 2023-09-30T22:26:00.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.453+0000 7ff930e92700 1 -- 172.21.15.40:0/3813625879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff92c06fb50 msgr2=0x7ff92c136c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.453+0000 7ff930e92700 1 --2- 172.21.15.40:0/3813625879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff92c06fb50 0x7ff92c136c70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff914009840 tx=0x7ff914009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:00.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.453+0000 7ff930e92700 1 -- 172.21.15.40:0/3813625879 shutdown_connections 2023-09-30T22:26:00.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.453+0000 7ff930e92700 1 --2- 172.21.15.40:0/3813625879 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff92c1371b0 0x7ff92c139590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.453+0000 7ff930e92700 1 --2- 172.21.15.40:0/3813625879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff92c06fb50 0x7ff92c136c70 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.453+0000 7ff930e92700 1 -- 172.21.15.40:0/3813625879 >> 172.21.15.40:0/3813625879 conn(0x7ff92c0a41a0 msgr2=0x7ff92c0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:00.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.453+0000 7ff930e92700 1 -- 172.21.15.40:0/3813625879 shutdown_connections 2023-09-30T22:26:00.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.454+0000 7ff930e92700 1 -- 172.21.15.40:0/3813625879 wait complete. 2023-09-30T22:26:00.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.455+0000 7ff930e92700 1 Processor -- start 2023-09-30T22:26:00.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.455+0000 7ff930e92700 1 -- start start 2023-09-30T22:26:00.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.455+0000 7ff930e92700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff92c06f070 0x7ff92c134910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.455+0000 7ff930e92700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff92c06fb50 0x7ff92c134e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.455+0000 7ff930e92700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff92c1371b0 0x7ff92c135390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.455+0000 7ff930e92700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c131e60 con 0x7ff92c06f070 2023-09-30T22:26:00.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.455+0000 7ff930e92700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c12def0 con 0x7ff92c06fb50 2023-09-30T22:26:00.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.455+0000 7ff930e92700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c12d950 con 0x7ff92c1371b0 2023-09-30T22:26:00.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.455+0000 7ff921d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff92c06fb50 0x7ff92c134e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.455+0000 7ff92ad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff92c1371b0 0x7ff92c135390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.455+0000 7ff921d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff92c06fb50 0x7ff92c134e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:33858/0 (socket says 172.21.15.40:33858) 2023-09-30T22:26:00.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.455+0000 7ff92ad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff92c1371b0 0x7ff92c135390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:43880/0 (socket says 172.21.15.40:43880) 2023-09-30T22:26:00.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.455+0000 7ff921d9b700 1 -- 172.21.15.40:0/3178455800 learned_addr learned my addr 172.21.15.40:0/3178455800 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:00.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.455+0000 7ff92a59c700 1 --2- 172.21.15.40:0/3178455800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff92c06f070 0x7ff92c134910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.456+0000 7ff921d9b700 1 -- 172.21.15.40:0/3178455800 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff92c1371b0 msgr2=0x7ff92c135390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.456+0000 7ff921d9b700 1 --2- 172.21.15.40:0/3178455800 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff92c1371b0 0x7ff92c135390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.456+0000 7ff921d9b700 1 -- 172.21.15.40:0/3178455800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff92c06f070 msgr2=0x7ff92c134910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.456+0000 7ff921d9b700 1 --2- 172.21.15.40:0/3178455800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff92c06f070 0x7ff92c134910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.456+0000 7ff921d9b700 1 -- 172.21.15.40:0/3178455800 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff924009a70 con 0x7ff92c06fb50 2023-09-30T22:26:00.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.456+0000 7ff92a59c700 1 --2- 172.21.15.40:0/3178455800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff92c06f070 0x7ff92c134910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:00.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.456+0000 7ff92ad9d700 1 --2- 172.21.15.40:0/3178455800 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff92c1371b0 0x7ff92c135390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:00.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.456+0000 7ff921d9b700 1 --2- 172.21.15.40:0/3178455800 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff92c06fb50 0x7ff92c134e50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff914009fd0 tx=0x7ff914004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:00.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.456+0000 7ff9237fe700 1 -- 172.21.15.40:0/3178455800 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9140045d0 con 0x7ff92c06fb50 2023-09-30T22:26:00.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.456+0000 7ff9237fe700 1 -- 172.21.15.40:0/3178455800 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91401d7c0 con 0x7ff92c06fb50 2023-09-30T22:26:00.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.456+0000 7ff930e92700 1 -- 172.21.15.40:0/3178455800 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9140094a0 con 0x7ff92c06fb50 2023-09-30T22:26:00.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.456+0000 7ff9237fe700 1 -- 172.21.15.40:0/3178455800 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91401db70 con 0x7ff92c06fb50 2023-09-30T22:26:00.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.456+0000 7ff930e92700 1 -- 172.21.15.40:0/3178455800 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff92c12dc10 con 0x7ff92c06fb50 2023-09-30T22:26:00.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.457+0000 7ff9237fe700 1 -- 172.21.15.40:0/3178455800 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff91401dcd0 con 0x7ff92c06fb50 2023-09-30T22:26:00.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.457+0000 7ff9237fe700 1 -- 172.21.15.40:0/3178455800 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff9140449a0 con 0x7ff92c06fb50 2023-09-30T22:26:00.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.457+0000 7ff930e92700 1 -- 172.21.15.40:0/3178455800 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff92c12d7b0 con 0x7ff92c06fb50 2023-09-30T22:26:00.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.462+0000 7ff9237fe700 1 -- 172.21.15.40:0/3178455800 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff92c12d7b0 con 0x7ff92c06fb50 2023-09-30T22:26:00.522 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:00.585 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:00.624 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:00.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.653+0000 7f5201653700 1 Processor -- start 2023-09-30T22:26:00.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.653+0000 7f5201653700 1 -- start start 2023-09-30T22:26:00.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.653+0000 7f5201653700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f51fc136bf0 0x7f51fc138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.653+0000 7f5201653700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51fc139510 0x7f51fc13b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.653+0000 7f5201653700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51fc0a2600 con 0x7f51fc09c890 2023-09-30T22:26:00.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.653+0000 7f5201653700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51fc0a29d0 con 0x7f51fc136bf0 2023-09-30T22:26:00.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.653+0000 7f5201653700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51fc09fb40 con 0x7f51fc139510 2023-09-30T22:26:00.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.653+0000 7f51fb7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51fc139510 0x7f51fc13b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.653+0000 7f51fb7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51fc139510 0x7f51fc13b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:33866/0 (socket says 172.21.15.40:33866) 2023-09-30T22:26:00.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.653+0000 7f51fb7fe700 1 -- 172.21.15.40:0/3418355708 learned_addr learned my addr 172.21.15.40:0/3418355708 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:00.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.654+0000 7f51fb7fe700 1 -- 172.21.15.40:0/3418355708 >> v2:172.21.15.40:3300/0 conn(0x7f51fc136bf0 msgr2=0x7f51fc138fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:00.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.654+0000 7f51fb7fe700 1 --2- 172.21.15.40:0/3418355708 >> v2:172.21.15.40:3300/0 conn(0x7f51fc136bf0 0x7f51fc138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.654+0000 7f51fb7fe700 1 -- 172.21.15.40:0/3418355708 >> v1:172.21.15.40:6789/0 conn(0x7f51fc09c890 legacy=0x7f51fc09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:00.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.654+0000 7f51fb7fe700 1 -- 172.21.15.40:0/3418355708 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51fc09d370 con 0x7f51fc139510 2023-09-30T22:26:00.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.654+0000 7f51fb7fe700 1 --2- 172.21.15.40:0/3418355708 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51fc139510 0x7f51fc13b8f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f51f4009e50 tx=0x7f51f400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a62bf25a85d164c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:00.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.654+0000 7f51f9ffb700 1 -- 172.21.15.40:0/3418355708 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f400e070 con 0x7f51fc139510 2023-09-30T22:26:00.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.654+0000 7f51f9ffb700 1 -- 172.21.15.40:0/3418355708 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f4003a20 con 0x7f51fc139510 2023-09-30T22:26:00.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.654+0000 7f51f9ffb700 1 -- 172.21.15.40:0/3418355708 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f4003dd0 con 0x7f51fc139510 2023-09-30T22:26:00.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.655+0000 7f5201653700 1 -- 172.21.15.40:0/3418355708 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51fc139510 msgr2=0x7f51fc13b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.655+0000 7f5201653700 1 --2- 172.21.15.40:0/3418355708 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51fc139510 0x7f51fc13b8f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f51f4009e50 tx=0x7f51f400b330 comp rx=0 tx=0).stop 2023-09-30T22:26:00.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.655+0000 7f5201653700 1 -- 172.21.15.40:0/3418355708 shutdown_connections 2023-09-30T22:26:00.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.655+0000 7f5201653700 1 --2- 172.21.15.40:0/3418355708 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51fc139510 0x7f51fc13b8f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.655+0000 7f5201653700 1 --2- 172.21.15.40:0/3418355708 >> v2:172.21.15.40:3300/0 conn(0x7f51fc136bf0 0x7f51fc138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.655+0000 7f5201653700 1 -- 172.21.15.40:0/3418355708 >> 172.21.15.40:0/3418355708 conn(0x7f51fc0a7080 msgr2=0x7f51fc0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:00.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.655+0000 7f5201653700 1 -- 172.21.15.40:0/3418355708 shutdown_connections 2023-09-30T22:26:00.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.655+0000 7f5201653700 1 -- 172.21.15.40:0/3418355708 wait complete. 2023-09-30T22:26:00.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.656+0000 7f5201653700 1 Processor -- start 2023-09-30T22:26:00.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.656+0000 7f5201653700 1 -- start start 2023-09-30T22:26:00.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.657+0000 7f5201653700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51fc09c890 0x7f51fc06ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.657+0000 7f5201653700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51fc136bf0 0x7f51fc06f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.657+0000 7f5201653700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f51fc139510 0x7f51fc06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.657+0000 7f5201653700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51fc070c60 con 0x7f51fc09c890 2023-09-30T22:26:00.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.657+0000 7f5201653700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51fc0a6110 con 0x7f51fc136bf0 2023-09-30T22:26:00.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.657+0000 7f5201653700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51fc09ecf0 con 0x7f51fc139510 2023-09-30T22:26:00.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.657+0000 7f51fa7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51fc136bf0 0x7f51fc06f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.657+0000 7f51fa7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51fc136bf0 0x7f51fc06f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:33876/0 (socket says 172.21.15.40:33876) 2023-09-30T22:26:00.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.657+0000 7f51fa7fc700 1 -- 172.21.15.40:0/3932759103 learned_addr learned my addr 172.21.15.40:0/3932759103 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:00.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.657+0000 7f51fb7fe700 1 --2- 172.21.15.40:0/3932759103 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f51fc139510 0x7f51fc06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.657+0000 7f51faffd700 1 --2- 172.21.15.40:0/3932759103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51fc09c890 0x7f51fc06ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.658+0000 7f51fb7fe700 1 -- 172.21.15.40:0/3932759103 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51fc136bf0 msgr2=0x7f51fc06f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.658+0000 7f51fb7fe700 1 --2- 172.21.15.40:0/3932759103 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51fc136bf0 0x7f51fc06f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.658+0000 7f51fb7fe700 1 -- 172.21.15.40:0/3932759103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51fc09c890 msgr2=0x7f51fc06ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.658+0000 7f51fb7fe700 1 --2- 172.21.15.40:0/3932759103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51fc09c890 0x7f51fc06ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.658+0000 7f51fb7fe700 1 -- 172.21.15.40:0/3932759103 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f4009b30 con 0x7f51fc139510 2023-09-30T22:26:00.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.658+0000 7f51faffd700 1 --2- 172.21.15.40:0/3932759103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51fc09c890 0x7f51fc06ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:00.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.658+0000 7f51fb7fe700 1 --2- 172.21.15.40:0/3932759103 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f51fc139510 0x7f51fc06fa10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f51f4014000 tx=0x7f51f4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:00.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.658+0000 7f51e37fe700 1 -- 172.21.15.40:0/3932759103 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f40092e0 con 0x7f51fc139510 2023-09-30T22:26:00.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.658+0000 7f51e37fe700 1 -- 172.21.15.40:0/3932759103 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f4004240 con 0x7f51fc139510 2023-09-30T22:26:00.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.658+0000 7f51e37fe700 1 -- 172.21.15.40:0/3932759103 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f4004610 con 0x7f51fc139510 2023-09-30T22:26:00.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.659+0000 7f5201653700 1 -- 172.21.15.40:0/3932759103 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51fc071ce0 con 0x7f51fc139510 2023-09-30T22:26:00.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.659+0000 7f5201653700 1 -- 172.21.15.40:0/3932759103 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51fc12b5c0 con 0x7f51fc139510 2023-09-30T22:26:00.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.659+0000 7f51e37fe700 1 -- 172.21.15.40:0/3932759103 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f51f4019070 con 0x7f51fc139510 2023-09-30T22:26:00.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.660+0000 7f51e37fe700 1 -- 172.21.15.40:0/3932759103 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f51f4040440 con 0x7f51fc139510 2023-09-30T22:26:00.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.660+0000 7f5201653700 1 -- 172.21.15.40:0/3932759103 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51fc062380 con 0x7f51fc139510 2023-09-30T22:26:00.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.669+0000 7f51e37fe700 1 -- 172.21.15.40:0/3932759103 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f51f4019b70 con 0x7f51fc139510 2023-09-30T22:26:00.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.673+0000 7ff930e92700 1 -- 172.21.15.40:0/3178455800 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff92c12d7b0 con 0x7ff92c06fb50 2023-09-30T22:26:00.674 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:00.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.674+0000 7ff9237fe700 1 -- 172.21.15.40:0/3178455800 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff92c12d7b0 con 0x7ff92c06fb50 2023-09-30T22:26:00.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.677+0000 7ff930e92700 1 -- 172.21.15.40:0/3178455800 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff92c06fb50 msgr2=0x7ff92c134e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.677+0000 7ff930e92700 1 --2- 172.21.15.40:0/3178455800 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff92c06fb50 0x7ff92c134e50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff914009fd0 tx=0x7ff914004750 comp rx=0 tx=0).stop 2023-09-30T22:26:00.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.678+0000 7ff930e92700 1 -- 172.21.15.40:0/3178455800 shutdown_connections 2023-09-30T22:26:00.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.678+0000 7ff930e92700 1 --2- 172.21.15.40:0/3178455800 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff92c1371b0 0x7ff92c135390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.678+0000 7ff930e92700 1 --2- 172.21.15.40:0/3178455800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff92c06f070 0x7ff92c134910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.678+0000 7ff930e92700 1 --2- 172.21.15.40:0/3178455800 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff92c06fb50 0x7ff92c134e50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.678+0000 7ff930e92700 1 -- 172.21.15.40:0/3178455800 >> 172.21.15.40:0/3178455800 conn(0x7ff92c0a41a0 msgr2=0x7ff92c137630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:00.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.678+0000 7ff930e92700 1 -- 172.21.15.40:0/3178455800 shutdown_connections 2023-09-30T22:26:00.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.678+0000 7ff930e92700 1 -- 172.21.15.40:0/3178455800 wait complete. 2023-09-30T22:26:00.697 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:00.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.732+0000 7ff1ecadc700 1 Processor -- start 2023-09-30T22:26:00.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.732+0000 7ff1ecadc700 1 -- start start 2023-09-30T22:26:00.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.733+0000 7ff1ecadc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff1e809d920 0x7ff1e809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.733+0000 7ff1ecadc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff1e809f0f0 0x7ff1e809e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.733+0000 7ff1ecadc700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e809f940 con 0x7ff1e8133ca0 2023-09-30T22:26:00.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.733+0000 7ff1ecadc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e806b4c0 con 0x7ff1e809d920 2023-09-30T22:26:00.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.733+0000 7ff1ecadc700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e809a8f0 con 0x7ff1e809f0f0 2023-09-30T22:26:00.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.733+0000 7ff1e5d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff1e809f0f0 0x7ff1e809e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.733+0000 7ff1e659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff1e809d920 0x7ff1e809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.733+0000 7ff1e5d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff1e809f0f0 0x7ff1e809e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:43884/0 (socket says 172.21.15.40:43884) 2023-09-30T22:26:00.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.733+0000 7ff1e659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff1e809d920 0x7ff1e809dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:33882/0 (socket says 172.21.15.40:33882) 2023-09-30T22:26:00.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.733+0000 7ff1e6d9d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff1e8133ca0 0x7ff1e8134140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60144/0 (socket says 172.21.15.40:60144) 2023-09-30T22:26:00.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.733+0000 7ff1e5d9b700 1 -- 172.21.15.40:0/1940817821 learned_addr learned my addr 172.21.15.40:0/1940817821 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:00.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.733+0000 7ff1e559a700 1 -- 172.21.15.40:0/1940817821 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1047628978 0 0) 0x7ff1e809f940 con 0x7ff1e8133ca0 2023-09-30T22:26:00.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.733+0000 7ff1e5d9b700 1 -- 172.21.15.40:0/1940817821 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff1e809d920 msgr2=0x7ff1e809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:00.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.733+0000 7ff1e5d9b700 1 --2- 172.21.15.40:0/1940817821 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff1e809d920 0x7ff1e809dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.733+0000 7ff1e5d9b700 1 -- 172.21.15.40:0/1940817821 >> v1:172.21.15.40:6789/0 conn(0x7ff1e8133ca0 legacy=0x7ff1e8134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.733+0000 7ff1e5d9b700 1 -- 172.21.15.40:0/1940817821 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e809f6e0 con 0x7ff1e809f0f0 2023-09-30T22:26:00.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.733+0000 7ff1e5d9b700 1 --2- 172.21.15.40:0/1940817821 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff1e809f0f0 0x7ff1e809e230 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc009950 tx=0x7ff1dc009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64830b561caff834 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:00.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.734+0000 7ff1e559a700 1 -- 172.21.15.40:0/1940817821 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc011830 con 0x7ff1e809f0f0 2023-09-30T22:26:00.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.734+0000 7ff1e559a700 1 -- 172.21.15.40:0/1940817821 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1dc011990 con 0x7ff1e809f0f0 2023-09-30T22:26:00.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.734+0000 7ff1e559a700 1 -- 172.21.15.40:0/1940817821 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc011d40 con 0x7ff1e809f0f0 2023-09-30T22:26:00.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.734+0000 7ff1ecadc700 1 -- 172.21.15.40:0/1940817821 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff1e809f0f0 msgr2=0x7ff1e809e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.735+0000 7ff1ecadc700 1 --2- 172.21.15.40:0/1940817821 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff1e809f0f0 0x7ff1e809e230 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc009950 tx=0x7ff1dc009c60 comp rx=0 tx=0).stop 2023-09-30T22:26:00.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.735+0000 7ff1ecadc700 1 -- 172.21.15.40:0/1940817821 shutdown_connections 2023-09-30T22:26:00.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.735+0000 7ff1ecadc700 1 --2- 172.21.15.40:0/1940817821 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff1e809d920 0x7ff1e809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.735+0000 7ff1ecadc700 1 --2- 172.21.15.40:0/1940817821 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff1e809f0f0 0x7ff1e809e230 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.735+0000 7ff1ecadc700 1 -- 172.21.15.40:0/1940817821 >> 172.21.15.40:0/1940817821 conn(0x7ff1e809fb20 msgr2=0x7ff1e809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:00.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.735+0000 7ff1ecadc700 1 -- 172.21.15.40:0/1940817821 shutdown_connections 2023-09-30T22:26:00.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.735+0000 7ff1ecadc700 1 -- 172.21.15.40:0/1940817821 wait complete. 2023-09-30T22:26:00.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.736+0000 7ff1ecadc700 1 Processor -- start 2023-09-30T22:26:00.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.736+0000 7ff1ecadc700 1 -- start start 2023-09-30T22:26:00.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.736+0000 7ff1ecadc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff1e809d920 0x7ff1e81316f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.736+0000 7ff1ecadc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff1e8133ca0 0x7ff1e811e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.736+0000 7ff1ecadc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1e811e890 0x7ff1e811ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.736+0000 7ff1ecadc700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e81209d0 con 0x7ff1e811e890 2023-09-30T22:26:00.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.736+0000 7ff1ecadc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e81227e0 con 0x7ff1e809d920 2023-09-30T22:26:00.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.736+0000 7ff1ecadc700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e8121e20 con 0x7ff1e8133ca0 2023-09-30T22:26:00.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.736+0000 7ff1e659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff1e809d920 0x7ff1e81316f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.737+0000 7ff1e659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff1e809d920 0x7ff1e81316f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:33898/0 (socket says 172.21.15.40:33898) 2023-09-30T22:26:00.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.737+0000 7ff1e659c700 1 -- 172.21.15.40:0/2535191889 learned_addr learned my addr 172.21.15.40:0/2535191889 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:00.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.737+0000 7ff1e6d9d700 1 --2- 172.21.15.40:0/2535191889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1e811e890 0x7ff1e811ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.737+0000 7ff1e5d9b700 1 --2- 172.21.15.40:0/2535191889 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff1e8133ca0 0x7ff1e811e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.737+0000 7ff1e659c700 1 -- 172.21.15.40:0/2535191889 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff1e8133ca0 msgr2=0x7ff1e811e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.737+0000 7ff1e659c700 1 --2- 172.21.15.40:0/2535191889 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff1e8133ca0 0x7ff1e811e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.737+0000 7ff1e659c700 1 -- 172.21.15.40:0/2535191889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1e811e890 msgr2=0x7ff1e811ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.737+0000 7ff1e659c700 1 --2- 172.21.15.40:0/2535191889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1e811e890 0x7ff1e811ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.737+0000 7ff1e659c700 1 -- 172.21.15.40:0/2535191889 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1dc009550 con 0x7ff1e809d920 2023-09-30T22:26:00.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.737+0000 7ff1e6d9d700 1 --2- 172.21.15.40:0/2535191889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1e811e890 0x7ff1e811ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:00.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.737+0000 7ff1e659c700 1 --2- 172.21.15.40:0/2535191889 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff1e809d920 0x7ff1e81316f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff1d800e900 tx=0x7ff1d800ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:00.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.737+0000 7ff1d6ffd700 1 -- 172.21.15.40:0/2535191889 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8013680 con 0x7ff1e809d920 2023-09-30T22:26:00.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.737+0000 7ff1d6ffd700 1 -- 172.21.15.40:0/2535191889 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d80137e0 con 0x7ff1e809d920 2023-09-30T22:26:00.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.737+0000 7ff1ecadc700 1 -- 172.21.15.40:0/2535191889 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e80a2710 con 0x7ff1e809d920 2023-09-30T22:26:00.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.737+0000 7ff1d6ffd700 1 -- 172.21.15.40:0/2535191889 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8013b50 con 0x7ff1e809d920 2023-09-30T22:26:00.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.737+0000 7ff1ecadc700 1 -- 172.21.15.40:0/2535191889 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e809c9e0 con 0x7ff1e809d920 2023-09-30T22:26:00.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.738+0000 7ff1d6ffd700 1 -- 172.21.15.40:0/2535191889 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff1d8013cb0 con 0x7ff1e809d920 2023-09-30T22:26:00.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.738+0000 7ff1d6ffd700 1 -- 172.21.15.40:0/2535191889 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff1d803fa50 con 0x7ff1e809d920 2023-09-30T22:26:00.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.739+0000 7ff1ecadc700 1 -- 172.21.15.40:0/2535191889 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e806f6f0 con 0x7ff1e809d920 2023-09-30T22:26:00.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.743+0000 7ff1d6ffd700 1 -- 172.21.15.40:0/2535191889 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff1d8017080 con 0x7ff1e809d920 2023-09-30T22:26:00.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.793+0000 7fd12e58f700 1 Processor -- start 2023-09-30T22:26:00.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.793+0000 7fd12e58f700 1 -- start start 2023-09-30T22:26:00.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.794+0000 7fd12e58f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd12809d450 0x7fd12809d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.794+0000 7fd12e58f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1281308d0 0x7fd128138420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.794+0000 7fd12e58f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd12809e8b0 con 0x7fd12809dd60 2023-09-30T22:26:00.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.794+0000 7fd12e58f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd12809c3b0 con 0x7fd1281308d0 2023-09-30T22:26:00.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.794+0000 7fd12e58f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd12809a6b0 con 0x7fd12809d450 2023-09-30T22:26:00.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.794+0000 7fd12cb2c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1281308d0 0x7fd128138420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.794+0000 7fd1277fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd12809dd60 0x7fd1281301c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60158/0 (socket says 172.21.15.40:60158) 2023-09-30T22:26:00.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.794+0000 7fd127fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd12809d450 0x7fd12809d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.794+0000 7fd1277fe700 1 -- 172.21.15.40:0/3634127647 learned_addr learned my addr 172.21.15.40:0/3634127647 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:00.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.795+0000 7fd127fff700 1 -- 172.21.15.40:0/3634127647 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1281308d0 msgr2=0x7fd128138420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:00.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.795+0000 7fd127fff700 1 --2- 172.21.15.40:0/3634127647 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1281308d0 0x7fd128138420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.795+0000 7fd127fff700 1 -- 172.21.15.40:0/3634127647 >> v1:172.21.15.40:6789/0 conn(0x7fd12809dd60 legacy=0x7fd1281301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.795+0000 7fd127fff700 1 -- 172.21.15.40:0/3634127647 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd12809b4f0 con 0x7fd12809d450 2023-09-30T22:26:00.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.795+0000 7fd126ffd700 1 -- 172.21.15.40:0/3634127647 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 179447872 0 0) 0x7fd12809e8b0 con 0x7fd12809dd60 2023-09-30T22:26:00.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.795+0000 7fd12cb2c700 1 --2- 172.21.15.40:0/3634127647 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1281308d0 0x7fd128138420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:00.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.795+0000 7fd127fff700 1 --2- 172.21.15.40:0/3634127647 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd12809d450 0x7fd12809d820 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd118009870 tx=0x7fd118009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdd2184b612c7839 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:00.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.795+0000 7fd126ffd700 1 -- 172.21.15.40:0/3634127647 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd118011830 con 0x7fd12809d450 2023-09-30T22:26:00.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.795+0000 7fd126ffd700 1 -- 172.21.15.40:0/3634127647 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd118011990 con 0x7fd12809d450 2023-09-30T22:26:00.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.795+0000 7fd126ffd700 1 -- 172.21.15.40:0/3634127647 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd118011d20 con 0x7fd12809d450 2023-09-30T22:26:00.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.796+0000 7fd12e58f700 1 -- 172.21.15.40:0/3634127647 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd12809d450 msgr2=0x7fd12809d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.796+0000 7fd12e58f700 1 --2- 172.21.15.40:0/3634127647 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd12809d450 0x7fd12809d820 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd118009870 tx=0x7fd118009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:00.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.796+0000 7fd12e58f700 1 -- 172.21.15.40:0/3634127647 shutdown_connections 2023-09-30T22:26:00.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.796+0000 7fd12e58f700 1 --2- 172.21.15.40:0/3634127647 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1281308d0 0x7fd128138420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.796+0000 7fd12e58f700 1 --2- 172.21.15.40:0/3634127647 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd12809d450 0x7fd12809d820 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.796+0000 7fd12e58f700 1 -- 172.21.15.40:0/3634127647 >> 172.21.15.40:0/3634127647 conn(0x7fd1280a2a00 msgr2=0x7fd1280a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:00.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.796+0000 7fd12e58f700 1 -- 172.21.15.40:0/3634127647 shutdown_connections 2023-09-30T22:26:00.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.796+0000 7fd12e58f700 1 -- 172.21.15.40:0/3634127647 wait complete. 2023-09-30T22:26:00.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.797+0000 7fd12e58f700 1 Processor -- start 2023-09-30T22:26:00.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.797+0000 7fd12e58f700 1 -- start start 2023-09-30T22:26:00.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.797+0000 7fd12e58f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd12809dd60 0x7fd128137b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.797+0000 7fd12e58f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1281308d0 0x7fd12813a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.797+0000 7fd12e58f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd12813a8c0 0x7fd12813ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.797+0000 7fd12e58f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12813bb20 con 0x7fd12809dd60 2023-09-30T22:26:00.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.797+0000 7fd12e58f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd12809c5d0 con 0x7fd1281308d0 2023-09-30T22:26:00.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.797+0000 7fd12e58f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd12813b4a0 con 0x7fd12813a8c0 2023-09-30T22:26:00.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.798+0000 7fd1277fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1281308d0 0x7fd12813a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.798+0000 7fd1277fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1281308d0 0x7fd12813a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:33916/0 (socket says 172.21.15.40:33916) 2023-09-30T22:26:00.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.798+0000 7fd1277fe700 1 -- 172.21.15.40:0/1260340317 learned_addr learned my addr 172.21.15.40:0/1260340317 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:00.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.798+0000 7fd127fff700 1 --2- 172.21.15.40:0/1260340317 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd12809dd60 0x7fd128137b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.798+0000 7fd12cb2c700 1 --2- 172.21.15.40:0/1260340317 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd12813a8c0 0x7fd12813ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.798+0000 7fd1277fe700 1 -- 172.21.15.40:0/1260340317 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd12813a8c0 msgr2=0x7fd12813ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.798+0000 7fd1277fe700 1 --2- 172.21.15.40:0/1260340317 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd12813a8c0 0x7fd12813ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.798+0000 7fd1277fe700 1 -- 172.21.15.40:0/1260340317 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd12809dd60 msgr2=0x7fd128137b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.798+0000 7fd1277fe700 1 --2- 172.21.15.40:0/1260340317 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd12809dd60 0x7fd128137b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.798+0000 7fd1277fe700 1 -- 172.21.15.40:0/1260340317 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd120009a70 con 0x7fd1281308d0 2023-09-30T22:26:00.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.798+0000 7fd1277fe700 1 --2- 172.21.15.40:0/1260340317 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1281308d0 0x7fd12813a380 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd11c001eb0 tx=0x7fd11c00c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:00.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.798+0000 7fd124ff9700 1 -- 172.21.15.40:0/1260340317 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c004c80 con 0x7fd1281308d0 2023-09-30T22:26:00.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.798+0000 7fd124ff9700 1 -- 172.21.15.40:0/1260340317 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11c004de0 con 0x7fd1281308d0 2023-09-30T22:26:00.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.798+0000 7fd12e58f700 1 -- 172.21.15.40:0/1260340317 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1180094a0 con 0x7fd1281308d0 2023-09-30T22:26:00.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.798+0000 7fd124ff9700 1 -- 172.21.15.40:0/1260340317 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c0072d0 con 0x7fd1281308d0 2023-09-30T22:26:00.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.798+0000 7fd12e58f700 1 -- 172.21.15.40:0/1260340317 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd128138070 con 0x7fd1281308d0 2023-09-30T22:26:00.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.799+0000 7fd124ff9700 1 -- 172.21.15.40:0/1260340317 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd11c007430 con 0x7fd1281308d0 2023-09-30T22:26:00.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.799+0000 7fd124ff9700 1 -- 172.21.15.40:0/1260340317 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd11c03f290 con 0x7fd1281308d0 2023-09-30T22:26:00.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.800+0000 7fd12e58f700 1 -- 172.21.15.40:0/1260340317 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd12813bdc0 con 0x7fd1281308d0 2023-09-30T22:26:00.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.804+0000 7fd124ff9700 1 -- 172.21.15.40:0/1260340317 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd11c0076e0 con 0x7fd1281308d0 2023-09-30T22:26:00.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.885+0000 7f5201653700 1 -- 172.21.15.40:0/3932759103 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f51fc12bd20 con 0x7f51fc139510 2023-09-30T22:26:00.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.885+0000 7f51e37fe700 1 -- 172.21.15.40:0/3932759103 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f51f4017020 con 0x7f51fc139510 2023-09-30T22:26:00.886 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:00.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.888+0000 7f5201653700 1 -- 172.21.15.40:0/3932759103 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f51fc139510 msgr2=0x7f51fc06fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.888+0000 7f5201653700 1 --2- 172.21.15.40:0/3932759103 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f51fc139510 0x7f51fc06fa10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f51f4014000 tx=0x7f51f4004ad0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.888+0000 7f5201653700 1 -- 172.21.15.40:0/3932759103 shutdown_connections 2023-09-30T22:26:00.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.888+0000 7f5201653700 1 --2- 172.21.15.40:0/3932759103 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f51fc139510 0x7f51fc06fa10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.888+0000 7f5201653700 1 --2- 172.21.15.40:0/3932759103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51fc09c890 0x7f51fc06ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.888+0000 7f5201653700 1 --2- 172.21.15.40:0/3932759103 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51fc136bf0 0x7f51fc06f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.888+0000 7f5201653700 1 -- 172.21.15.40:0/3932759103 >> 172.21.15.40:0/3932759103 conn(0x7f51fc0a7080 msgr2=0x7f51fc136fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:00.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.888+0000 7f5201653700 1 -- 172.21.15.40:0/3932759103 shutdown_connections 2023-09-30T22:26:00.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.888+0000 7f5201653700 1 -- 172.21.15.40:0/3932759103 wait complete. 2023-09-30T22:26:00.901 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:00.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.962+0000 7ff1ecadc700 1 -- 172.21.15.40:0/2535191889 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff1e8062380 con 0x7ff1e809d920 2023-09-30T22:26:00.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.962+0000 7ff1d6ffd700 1 -- 172.21.15.40:0/2535191889 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff1d801a9b0 con 0x7ff1e809d920 2023-09-30T22:26:00.963 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:00.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.965+0000 7ff1ecadc700 1 -- 172.21.15.40:0/2535191889 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff1e809d920 msgr2=0x7ff1e81316f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.965+0000 7ff1ecadc700 1 --2- 172.21.15.40:0/2535191889 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff1e809d920 0x7ff1e81316f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff1d800e900 tx=0x7ff1d800ec10 comp rx=0 tx=0).stop 2023-09-30T22:26:00.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.965+0000 7ff1ecadc700 1 -- 172.21.15.40:0/2535191889 shutdown_connections 2023-09-30T22:26:00.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.965+0000 7ff1ecadc700 1 --2- 172.21.15.40:0/2535191889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1e811e890 0x7ff1e811ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.965+0000 7ff1ecadc700 1 --2- 172.21.15.40:0/2535191889 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff1e809d920 0x7ff1e81316f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.965+0000 7ff1ecadc700 1 --2- 172.21.15.40:0/2535191889 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff1e8133ca0 0x7ff1e811e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.965+0000 7ff1ecadc700 1 -- 172.21.15.40:0/2535191889 >> 172.21.15.40:0/2535191889 conn(0x7ff1e809fb20 msgr2=0x7ff1e8133380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:00.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.965+0000 7ff1ecadc700 1 -- 172.21.15.40:0/2535191889 shutdown_connections 2023-09-30T22:26:00.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:00.965+0000 7ff1ecadc700 1 -- 172.21.15.40:0/2535191889 wait complete. 2023-09-30T22:26:00.978 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:01.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.004+0000 7fd12e58f700 1 -- 172.21.15.40:0/1260340317 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd128062380 con 0x7fd1281308d0 2023-09-30T22:26:01.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.004+0000 7fd124ff9700 1 -- 172.21.15.40:0/1260340317 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd11c011360 con 0x7fd1281308d0 2023-09-30T22:26:01.005 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:01.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.006+0000 7fd12e58f700 1 -- 172.21.15.40:0/1260340317 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1281308d0 msgr2=0x7fd12813a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:01.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.006+0000 7fd12e58f700 1 --2- 172.21.15.40:0/1260340317 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1281308d0 0x7fd12813a380 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd11c001eb0 tx=0x7fd11c00c800 comp rx=0 tx=0).stop 2023-09-30T22:26:01.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.006+0000 7fd12e58f700 1 -- 172.21.15.40:0/1260340317 shutdown_connections 2023-09-30T22:26:01.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.006+0000 7fd12e58f700 1 --2- 172.21.15.40:0/1260340317 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd12813a8c0 0x7fd12813ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:01.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.007+0000 7fd12e58f700 1 --2- 172.21.15.40:0/1260340317 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd12809dd60 0x7fd128137b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:01.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.007+0000 7fd12e58f700 1 --2- 172.21.15.40:0/1260340317 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1281308d0 0x7fd12813a380 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:01.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.007+0000 7fd12e58f700 1 -- 172.21.15.40:0/1260340317 >> 172.21.15.40:0/1260340317 conn(0x7fd1280a2a00 msgr2=0x7fd128070490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:01.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.007+0000 7fd12e58f700 1 -- 172.21.15.40:0/1260340317 shutdown_connections 2023-09-30T22:26:01.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.007+0000 7fd12e58f700 1 -- 172.21.15.40:0/1260340317 wait complete. 2023-09-30T22:26:01.019 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:01.698 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:01.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.839+0000 7f464ad30700 1 Processor -- start 2023-09-30T22:26:01.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.839+0000 7f464ad30700 1 -- start start 2023-09-30T22:26:01.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.839+0000 7f464ad30700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f464406a6d0 0x7f464406aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:01.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.839+0000 7f464ad30700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f464406afe0 0x7f46441318b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:01.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.840+0000 7f464ad30700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f464409eb50 con 0x7f4644131df0 2023-09-30T22:26:01.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.840+0000 7f464ad30700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464409dde0 con 0x7f464406a6d0 2023-09-30T22:26:01.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.840+0000 7f464ad30700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f464409d4a0 con 0x7f464406afe0 2023-09-30T22:26:01.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.840+0000 7f4648acc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f464406a6d0 0x7f464406aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:01.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.840+0000 7f46492cd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f4644131df0 0x7f4644138b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60174/0 (socket says 172.21.15.40:60174) 2023-09-30T22:26:01.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.840+0000 7f4648acc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f464406a6d0 0x7f464406aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:33932/0 (socket says 172.21.15.40:33932) 2023-09-30T22:26:01.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.840+0000 7f46492cd700 1 -- 172.21.15.40:0/3529357163 learned_addr learned my addr 172.21.15.40:0/3529357163 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:01.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.840+0000 7f4643fff700 1 --2- 172.21.15.40:0/3529357163 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f464406afe0 0x7f46441318b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:01.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.840+0000 7f46437fe700 1 -- 172.21.15.40:0/3529357163 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3126004789 0 0) 0x7f464409eb50 con 0x7f4644131df0 2023-09-30T22:26:01.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.840+0000 7f46437fe700 1 -- 172.21.15.40:0/3529357163 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46340035b0 con 0x7f4644131df0 2023-09-30T22:26:01.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.840+0000 7f4643fff700 1 -- 172.21.15.40:0/3529357163 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f464406a6d0 msgr2=0x7f464406aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:01.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.840+0000 7f4643fff700 1 --2- 172.21.15.40:0/3529357163 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f464406a6d0 0x7f464406aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:01.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.840+0000 7f4643fff700 1 -- 172.21.15.40:0/3529357163 >> v1:172.21.15.40:6789/0 conn(0x7f4644131df0 legacy=0x7f4644138b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:01.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.840+0000 7f4643fff700 1 -- 172.21.15.40:0/3529357163 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f464409f5f0 con 0x7f464406afe0 2023-09-30T22:26:01.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.840+0000 7f4648acc700 1 --2- 172.21.15.40:0/3529357163 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f464406a6d0 0x7f464406aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:01.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.840+0000 7f4643fff700 1 --2- 172.21.15.40:0/3529357163 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f464406afe0 0x7f46441318b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4630009870 tx=0x7f4630009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4aa8d441f99fbe0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:01.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.840+0000 7f46437fe700 1 -- 172.21.15.40:0/3529357163 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4630011830 con 0x7f464406afe0 2023-09-30T22:26:01.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.840+0000 7f46437fe700 1 -- 172.21.15.40:0/3529357163 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4630011990 con 0x7f464406afe0 2023-09-30T22:26:01.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.840+0000 7f46437fe700 1 -- 172.21.15.40:0/3529357163 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4630011d20 con 0x7f464406afe0 2023-09-30T22:26:01.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.841+0000 7f464ad30700 1 -- 172.21.15.40:0/3529357163 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f464406afe0 msgr2=0x7f46441318b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:01.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.841+0000 7f464ad30700 1 --2- 172.21.15.40:0/3529357163 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f464406afe0 0x7f46441318b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4630009870 tx=0x7f4630009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:01.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.841+0000 7f464ad30700 1 -- 172.21.15.40:0/3529357163 shutdown_connections 2023-09-30T22:26:01.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.841+0000 7f464ad30700 1 --2- 172.21.15.40:0/3529357163 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f464406a6d0 0x7f464406aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:01.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.841+0000 7f464ad30700 1 --2- 172.21.15.40:0/3529357163 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f464406afe0 0x7f46441318b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:01.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.841+0000 7f464ad30700 1 -- 172.21.15.40:0/3529357163 >> 172.21.15.40:0/3529357163 conn(0x7f464409fb20 msgr2=0x7f464409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:01.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.841+0000 7f464ad30700 1 -- 172.21.15.40:0/3529357163 shutdown_connections 2023-09-30T22:26:01.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.841+0000 7f464ad30700 1 -- 172.21.15.40:0/3529357163 wait complete. 2023-09-30T22:26:01.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.842+0000 7f464ad30700 1 Processor -- start 2023-09-30T22:26:01.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.842+0000 7f464ad30700 1 -- start start 2023-09-30T22:26:01.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.843+0000 7f464ad30700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f464406a6d0 0x7f464409aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:01.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.843+0000 7f464ad30700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f464406afe0 0x7f464409b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:01.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.843+0000 7f464ad30700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4644131df0 0x7f46441c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:01.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.843+0000 7f464ad30700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4644131450 con 0x7f4644131df0 2023-09-30T22:26:01.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.843+0000 7f464ad30700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464409aa20 con 0x7f464406afe0 2023-09-30T22:26:01.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.843+0000 7f464ad30700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46441220f0 con 0x7f464406a6d0 2023-09-30T22:26:01.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.843+0000 7f4648acc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f464406a6d0 0x7f464409aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:01.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.843+0000 7f4648acc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f464406a6d0 0x7f464409aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:43944/0 (socket says 172.21.15.40:43944) 2023-09-30T22:26:01.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.843+0000 7f4643fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f464406afe0 0x7f464409b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:01.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.843+0000 7f4648acc700 1 -- 172.21.15.40:0/2100893690 learned_addr learned my addr 172.21.15.40:0/2100893690 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:01.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.843+0000 7f46492cd700 1 --2- 172.21.15.40:0/2100893690 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4644131df0 0x7f46441c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:01.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.843+0000 7f4648acc700 1 -- 172.21.15.40:0/2100893690 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f464406afe0 msgr2=0x7f464409b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:01.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.843+0000 7f4648acc700 1 --2- 172.21.15.40:0/2100893690 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f464406afe0 0x7f464409b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:01.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.843+0000 7f4648acc700 1 -- 172.21.15.40:0/2100893690 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4644131df0 msgr2=0x7f46441c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:01.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.843+0000 7f4648acc700 1 --2- 172.21.15.40:0/2100893690 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4644131df0 0x7f46441c8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:01.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.843+0000 7f4648acc700 1 -- 172.21.15.40:0/2100893690 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4638009430 con 0x7f464406a6d0 2023-09-30T22:26:01.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.843+0000 7f4643fff700 1 --2- 172.21.15.40:0/2100893690 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f464406afe0 0x7f464409b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:01.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.843+0000 7f46492cd700 1 --2- 172.21.15.40:0/2100893690 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4644131df0 0x7f46441c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:01.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.843+0000 7f4648acc700 1 --2- 172.21.15.40:0/2100893690 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f464406a6d0 0x7f464409aeb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f463800ebe0 tx=0x7f463800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:01.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.844+0000 7f46417fa700 1 -- 172.21.15.40:0/2100893690 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4638005a20 con 0x7f464406a6d0 2023-09-30T22:26:01.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.844+0000 7f46417fa700 1 -- 172.21.15.40:0/2100893690 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4638005b80 con 0x7f464406a6d0 2023-09-30T22:26:01.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.844+0000 7f46417fa700 1 -- 172.21.15.40:0/2100893690 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463800c910 con 0x7f464406a6d0 2023-09-30T22:26:01.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.844+0000 7f464ad30700 1 -- 172.21.15.40:0/2100893690 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46300094a0 con 0x7f464406a6d0 2023-09-30T22:26:01.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.844+0000 7f464ad30700 1 -- 172.21.15.40:0/2100893690 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4644071560 con 0x7f464406a6d0 2023-09-30T22:26:01.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.844+0000 7f46417fa700 1 -- 172.21.15.40:0/2100893690 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f463800ca70 con 0x7f464406a6d0 2023-09-30T22:26:01.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.844+0000 7f46417fa700 1 -- 172.21.15.40:0/2100893690 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f463803fa20 con 0x7f464406a6d0 2023-09-30T22:26:01.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.845+0000 7f464ad30700 1 -- 172.21.15.40:0/2100893690 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4644062380 con 0x7f464406a6d0 2023-09-30T22:26:01.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:01.849+0000 7f46417fa700 1 -- 172.21.15.40:0/2100893690 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4638020020 con 0x7f464406a6d0 2023-09-30T22:26:01.901 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:01.979 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:02.020 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:02.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.030+0000 7fad4d2e2700 1 Processor -- start 2023-09-30T22:26:02.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.030+0000 7fad4d2e2700 1 -- start start 2023-09-30T22:26:02.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.031+0000 7fad4d2e2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fad48133e00 0x7fad481341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.031+0000 7fad4d2e2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad4809df40 0x7fad4813bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.031+0000 7fad4d2e2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad48133940 con 0x7fad4809d400 2023-09-30T22:26:02.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.031+0000 7fad4d2e2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4809ab20 con 0x7fad4809df40 2023-09-30T22:26:02.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.031+0000 7fad4d2e2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad4809f0d0 con 0x7fad48133e00 2023-09-30T22:26:02.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.031+0000 7fad46ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fad48133e00 0x7fad481341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.031+0000 7fad46ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fad48133e00 0x7fad481341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:43954/0 (socket says 172.21.15.40:43954) 2023-09-30T22:26:02.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.031+0000 7fad467fc700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fad4809d400 0x7fad4809d830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60186/0 (socket says 172.21.15.40:60186) 2023-09-30T22:26:02.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.031+0000 7fad46ffd700 1 -- 172.21.15.40:0/2594971856 learned_addr learned my addr 172.21.15.40:0/2594971856 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:02.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.031+0000 7fad46ffd700 1 -- 172.21.15.40:0/2594971856 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad4809df40 msgr2=0x7fad4813bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:02.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.031+0000 7fad46ffd700 1 --2- 172.21.15.40:0/2594971856 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad4809df40 0x7fad4813bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.031+0000 7fad46ffd700 1 -- 172.21.15.40:0/2594971856 >> v1:172.21.15.40:6789/0 conn(0x7fad4809d400 legacy=0x7fad4809d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.032+0000 7fad46ffd700 1 -- 172.21.15.40:0/2594971856 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad48133be0 con 0x7fad48133e00 2023-09-30T22:26:02.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.032+0000 7fad46ffd700 1 --2- 172.21.15.40:0/2594971856 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fad48133e00 0x7fad481341d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fad38009920 tx=0x7fad38009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1121168762182ce4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:02.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.032+0000 7fad45ffb700 1 -- 172.21.15.40:0/2594971856 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad38004230 con 0x7fad48133e00 2023-09-30T22:26:02.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.032+0000 7fad45ffb700 1 -- 172.21.15.40:0/2594971856 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad38004390 con 0x7fad48133e00 2023-09-30T22:26:02.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.032+0000 7fad45ffb700 1 -- 172.21.15.40:0/2594971856 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad38009e70 con 0x7fad48133e00 2023-09-30T22:26:02.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.033+0000 7fad4d2e2700 1 -- 172.21.15.40:0/2594971856 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fad48133e00 msgr2=0x7fad481341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.033+0000 7fad4d2e2700 1 --2- 172.21.15.40:0/2594971856 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fad48133e00 0x7fad481341d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fad38009920 tx=0x7fad38009c30 comp rx=0 tx=0).stop 2023-09-30T22:26:02.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.033+0000 7fad4d2e2700 1 -- 172.21.15.40:0/2594971856 shutdown_connections 2023-09-30T22:26:02.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.033+0000 7fad4d2e2700 1 --2- 172.21.15.40:0/2594971856 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad4809df40 0x7fad4813bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.033+0000 7fad4d2e2700 1 --2- 172.21.15.40:0/2594971856 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fad48133e00 0x7fad481341d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.033+0000 7fad4d2e2700 1 -- 172.21.15.40:0/2594971856 >> 172.21.15.40:0/2594971856 conn(0x7fad480a2a00 msgr2=0x7fad480a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:02.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.033+0000 7fad4d2e2700 1 -- 172.21.15.40:0/2594971856 shutdown_connections 2023-09-30T22:26:02.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.033+0000 7fad4d2e2700 1 -- 172.21.15.40:0/2594971856 wait complete. 2023-09-30T22:26:02.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.034+0000 7fad4d2e2700 1 Processor -- start 2023-09-30T22:26:02.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.034+0000 7fad4d2e2700 1 -- start start 2023-09-30T22:26:02.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.035+0000 7fad4d2e2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fad4809d400 0x7fad4811bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.035+0000 7fad4d2e2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad4809df40 0x7fad4811c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.035+0000 7fad4d2e2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad48133e00 0x7fad4811c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.035+0000 7fad4d2e2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad480a0090 con 0x7fad4809df40 2023-09-30T22:26:02.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.035+0000 7fad4d2e2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4812e1a0 con 0x7fad48133e00 2023-09-30T22:26:02.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.035+0000 7fad4d2e2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad4811e6f0 con 0x7fad4809d400 2023-09-30T22:26:02.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.035+0000 7fad46ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fad4809d400 0x7fad4811bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.035+0000 7fad46ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fad4809d400 0x7fad4811bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:43962/0 (socket says 172.21.15.40:43962) 2023-09-30T22:26:02.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.035+0000 7fad46ffd700 1 -- 172.21.15.40:0/2829314175 learned_addr learned my addr 172.21.15.40:0/2829314175 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:02.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.035+0000 7fad467fc700 1 --2- 172.21.15.40:0/2829314175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad4809df40 0x7fad4811c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.035+0000 7fad477fe700 1 --2- 172.21.15.40:0/2829314175 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad48133e00 0x7fad4811c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.035+0000 7fad467fc700 1 -- 172.21.15.40:0/2829314175 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fad4809d400 msgr2=0x7fad4811bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.035+0000 7fad467fc700 1 --2- 172.21.15.40:0/2829314175 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fad4809d400 0x7fad4811bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.035+0000 7fad467fc700 1 -- 172.21.15.40:0/2829314175 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad48133e00 msgr2=0x7fad4811c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.035+0000 7fad467fc700 1 --2- 172.21.15.40:0/2829314175 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad48133e00 0x7fad4811c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.035+0000 7fad467fc700 1 -- 172.21.15.40:0/2829314175 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad38009550 con 0x7fad4809df40 2023-09-30T22:26:02.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.035+0000 7fad46ffd700 1 --2- 172.21.15.40:0/2829314175 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fad4809d400 0x7fad4811bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:02.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.035+0000 7fad477fe700 1 --2- 172.21.15.40:0/2829314175 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad48133e00 0x7fad4811c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:26:02.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.036+0000 7fad467fc700 1 --2- 172.21.15.40:0/2829314175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad4809df40 0x7fad4811c2a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fad3c00c750 tx=0x7fad3c00ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:02.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.036+0000 7fad2f7fe700 1 -- 172.21.15.40:0/2829314175 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c004c80 con 0x7fad4809df40 2023-09-30T22:26:02.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.036+0000 7fad2f7fe700 1 -- 172.21.15.40:0/2829314175 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3c004de0 con 0x7fad4809df40 2023-09-30T22:26:02.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.036+0000 7fad2f7fe700 1 -- 172.21.15.40:0/2829314175 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c007310 con 0x7fad4809df40 2023-09-30T22:26:02.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.036+0000 7fad4d2e2700 1 -- 172.21.15.40:0/2829314175 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad4811ef70 con 0x7fad4809df40 2023-09-30T22:26:02.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.036+0000 7fad4d2e2700 1 -- 172.21.15.40:0/2829314175 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad4811ff70 con 0x7fad4809df40 2023-09-30T22:26:02.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.037+0000 7fad4d2e2700 1 -- 172.21.15.40:0/2829314175 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad48062380 con 0x7fad4809df40 2023-09-30T22:26:02.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.037+0000 7fad2f7fe700 1 -- 172.21.15.40:0/2829314175 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fad3c007470 con 0x7fad4809df40 2023-09-30T22:26:02.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.038+0000 7fad2f7fe700 1 -- 172.21.15.40:0/2829314175 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fad3c03f4e0 con 0x7fad4809df40 2023-09-30T22:26:02.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.043+0000 7fad2f7fe700 1 -- 172.21.15.40:0/2829314175 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fad3c007720 con 0x7fad4809df40 2023-09-30T22:26:02.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.052+0000 7f464ad30700 1 -- 172.21.15.40:0/2100893690 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4644131bd0 con 0x7f464406a6d0 2023-09-30T22:26:02.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.053+0000 7f46417fa700 1 -- 172.21.15.40:0/2100893690 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4638022300 con 0x7f464406a6d0 2023-09-30T22:26:02.053 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:02.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.055+0000 7f464ad30700 1 -- 172.21.15.40:0/2100893690 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f464406a6d0 msgr2=0x7f464409aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.055+0000 7f464ad30700 1 --2- 172.21.15.40:0/2100893690 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f464406a6d0 0x7f464409aeb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f463800ebe0 tx=0x7f463800eef0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.055+0000 7f464ad30700 1 -- 172.21.15.40:0/2100893690 shutdown_connections 2023-09-30T22:26:02.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.055+0000 7f464ad30700 1 --2- 172.21.15.40:0/2100893690 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f464406a6d0 0x7f464409aeb0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.055+0000 7f464ad30700 1 --2- 172.21.15.40:0/2100893690 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4644131df0 0x7f46441c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.055+0000 7f464ad30700 1 --2- 172.21.15.40:0/2100893690 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f464406afe0 0x7f464409b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.055+0000 7f464ad30700 1 -- 172.21.15.40:0/2100893690 >> 172.21.15.40:0/2100893690 conn(0x7f464409fb20 msgr2=0x7f464406f770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:02.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.055+0000 7f464ad30700 1 -- 172.21.15.40:0/2100893690 shutdown_connections 2023-09-30T22:26:02.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.055+0000 7f464ad30700 1 -- 172.21.15.40:0/2100893690 wait complete. 2023-09-30T22:26:02.070 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:02.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.112+0000 7f4bcf471700 1 Processor -- start 2023-09-30T22:26:02.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.113+0000 7f4bcf471700 1 -- start start 2023-09-30T22:26:02.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.113+0000 7f4bcf471700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4bc809d920 0x7f4bc809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.113+0000 7f4bcf471700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4bc809e230 0x7f4bc81343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.113+0000 7f4bcf471700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bc809f940 con 0x7f4bc809f0f0 2023-09-30T22:26:02.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.113+0000 7f4bcf471700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bc806b4c0 con 0x7f4bc809e230 2023-09-30T22:26:02.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.113+0000 7f4bcf471700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc809a8f0 con 0x7f4bc809d920 2023-09-30T22:26:02.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.113+0000 7f4bcd20d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4bc809d920 0x7f4bc809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.113+0000 7f4bcda0e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4bc809e230 0x7f4bc81343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.113+0000 7f4bcd20d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4bc809d920 0x7f4bc809dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:33966/0 (socket says 172.21.15.40:33966) 2023-09-30T22:26:02.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.113+0000 7f4bcda0e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4bc809e230 0x7f4bc81343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45434/0 (socket says 172.21.15.40:45434) 2023-09-30T22:26:02.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.113+0000 7f4bcd20d700 1 -- 172.21.15.40:0/99370459 learned_addr learned my addr 172.21.15.40:0/99370459 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:02.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.113+0000 7f4bcca0c700 1 --1- 172.21.15.40:0/99370459 >> v1:172.21.15.40:6789/0 conn(0x7f4bc809f0f0 0x7f4bc8133ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60192/0 (socket says 172.21.15.40:60192) 2023-09-30T22:26:02.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.114+0000 7f4bcd20d700 1 -- 172.21.15.40:0/99370459 >> v2:172.21.15.40:3300/0 conn(0x7f4bc809e230 msgr2=0x7f4bc81343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:02.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.114+0000 7f4bcd20d700 1 --2- 172.21.15.40:0/99370459 >> v2:172.21.15.40:3300/0 conn(0x7f4bc809e230 0x7f4bc81343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.114+0000 7f4bcd20d700 1 -- 172.21.15.40:0/99370459 >> v1:172.21.15.40:6789/0 conn(0x7f4bc809f0f0 legacy=0x7f4bc8133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.114+0000 7f4bcd20d700 1 -- 172.21.15.40:0/99370459 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc809f6e0 con 0x7f4bc809d920 2023-09-30T22:26:02.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.114+0000 7f4bcda0e700 1 --2- 172.21.15.40:0/99370459 >> v2:172.21.15.40:3300/0 conn(0x7f4bc809e230 0x7f4bc81343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:02.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.114+0000 7f4bcd20d700 1 --2- 172.21.15.40:0/99370459 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4bc809d920 0x7f4bc809dcf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4006fd0 tx=0x7f4bc4009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a520f033968952b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:02.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.114+0000 7f4bbffff700 1 -- 172.21.15.40:0/99370459 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc4005e30 con 0x7f4bc809d920 2023-09-30T22:26:02.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.114+0000 7f4bbffff700 1 -- 172.21.15.40:0/99370459 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc4004030 con 0x7f4bc809d920 2023-09-30T22:26:02.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.114+0000 7f4bbffff700 1 -- 172.21.15.40:0/99370459 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc40043e0 con 0x7f4bc809d920 2023-09-30T22:26:02.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.115+0000 7f4bcf471700 1 -- 172.21.15.40:0/99370459 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4bc809d920 msgr2=0x7f4bc809dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.115+0000 7f4bcf471700 1 --2- 172.21.15.40:0/99370459 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4bc809d920 0x7f4bc809dcf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4006fd0 tx=0x7f4bc4009bd0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.115+0000 7f4bcf471700 1 -- 172.21.15.40:0/99370459 shutdown_connections 2023-09-30T22:26:02.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.115+0000 7f4bcf471700 1 --2- 172.21.15.40:0/99370459 >> v2:172.21.15.40:3300/0 conn(0x7f4bc809e230 0x7f4bc81343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.115+0000 7f4bcf471700 1 --2- 172.21.15.40:0/99370459 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4bc809d920 0x7f4bc809dcf0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.115+0000 7f4bcf471700 1 -- 172.21.15.40:0/99370459 >> 172.21.15.40:0/99370459 conn(0x7f4bc809fb20 msgr2=0x7f4bc809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:02.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.115+0000 7f4bcf471700 1 -- 172.21.15.40:0/99370459 shutdown_connections 2023-09-30T22:26:02.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.115+0000 7f4bcf471700 1 -- 172.21.15.40:0/99370459 wait complete. 2023-09-30T22:26:02.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.116+0000 7f4bcf471700 1 Processor -- start 2023-09-30T22:26:02.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.116+0000 7f4bcf471700 1 -- start start 2023-09-30T22:26:02.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.116+0000 7f4bcf471700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4bc809d920 0x7f4bc81c5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.116+0000 7f4bcf471700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4bc809e230 0x7f4bc81c5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.116+0000 7f4bcf471700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4bc81a8fb0 0x7f4bc81c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.116+0000 7f4bcf471700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc81a6440 con 0x7f4bc809d920 2023-09-30T22:26:02.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.116+0000 7f4bcf471700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc81a88b0 con 0x7f4bc81a8fb0 2023-09-30T22:26:02.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.116+0000 7f4bcf471700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc81a7df0 con 0x7f4bc809e230 2023-09-30T22:26:02.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.117+0000 7f4bcd20d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4bc809d920 0x7f4bc81c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.117+0000 7f4bcd20d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4bc809d920 0x7f4bc81c5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45442/0 (socket says 172.21.15.40:45442) 2023-09-30T22:26:02.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.117+0000 7f4bcd20d700 1 -- 172.21.15.40:0/2530063656 learned_addr learned my addr 172.21.15.40:0/2530063656 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:02.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.117+0000 7f4bcca0c700 1 --2- 172.21.15.40:0/2530063656 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4bc809e230 0x7f4bc81c5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.117+0000 7f4bcda0e700 1 --2- 172.21.15.40:0/2530063656 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4bc81a8fb0 0x7f4bc81c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.117+0000 7f4bcd20d700 1 -- 172.21.15.40:0/2530063656 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4bc809e230 msgr2=0x7f4bc81c5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.117+0000 7f4bcd20d700 1 --2- 172.21.15.40:0/2530063656 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4bc809e230 0x7f4bc81c5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.117+0000 7f4bcd20d700 1 -- 172.21.15.40:0/2530063656 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4bc81a8fb0 msgr2=0x7f4bc81c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.117+0000 7f4bcd20d700 1 --2- 172.21.15.40:0/2530063656 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4bc81a8fb0 0x7f4bc81c8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.117+0000 7f4bcd20d700 1 -- 172.21.15.40:0/2530063656 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc0009a70 con 0x7f4bc809d920 2023-09-30T22:26:02.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.117+0000 7f4bcca0c700 1 --2- 172.21.15.40:0/2530063656 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4bc809e230 0x7f4bc81c5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:02.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.117+0000 7f4bcd20d700 1 --2- 172.21.15.40:0/2530063656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4bc809d920 0x7f4bc81c5420 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4000c00 tx=0x7f4bc4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:02.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.117+0000 7f4bbdffb700 1 -- 172.21.15.40:0/2530063656 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc4003d20 con 0x7f4bc809d920 2023-09-30T22:26:02.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.117+0000 7f4bbdffb700 1 -- 172.21.15.40:0/2530063656 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc4003e80 con 0x7f4bc809d920 2023-09-30T22:26:02.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.117+0000 7f4bbdffb700 1 -- 172.21.15.40:0/2530063656 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc401c640 con 0x7f4bc809d920 2023-09-30T22:26:02.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.117+0000 7f4bcf471700 1 -- 172.21.15.40:0/2530063656 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bc4009500 con 0x7f4bc809d920 2023-09-30T22:26:02.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.118+0000 7f4bcf471700 1 -- 172.21.15.40:0/2530063656 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bc81a6ba0 con 0x7f4bc809d920 2023-09-30T22:26:02.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.119+0000 7f4bcf471700 1 -- 172.21.15.40:0/2530063656 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bc80a37a0 con 0x7f4bc809d920 2023-09-30T22:26:02.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.119+0000 7f4bbdffb700 1 -- 172.21.15.40:0/2530063656 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4bc401c7a0 con 0x7f4bc809d920 2023-09-30T22:26:02.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.119+0000 7f4bbdffb700 1 -- 172.21.15.40:0/2530063656 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4bc40406d0 con 0x7f4bc809d920 2023-09-30T22:26:02.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.124+0000 7f4bbdffb700 1 -- 172.21.15.40:0/2530063656 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4bc4011420 con 0x7f4bc809d920 2023-09-30T22:26:02.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.156+0000 7f15bff7a700 1 Processor -- start 2023-09-30T22:26:02.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.156+0000 7f15bff7a700 1 -- start start 2023-09-30T22:26:02.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.157+0000 7f15bff7a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f15b809c890 0x7f15b809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.157+0000 7f15bff7a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15b809d920 0x7f15b809dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.157+0000 7f15bff7a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15b80a2600 con 0x7f15b809e2b0 2023-09-30T22:26:02.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.157+0000 7f15bff7a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15b80a29d0 con 0x7f15b809c890 2023-09-30T22:26:02.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.157+0000 7f15bff7a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b809fb40 con 0x7f15b809d920 2023-09-30T22:26:02.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.157+0000 7f15bdd16700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f15b809c890 0x7f15b809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.157+0000 7f15bd515700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15b809d920 0x7f15b809dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.157+0000 7f15bdd16700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f15b809c890 0x7f15b809cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45456/0 (socket says 172.21.15.40:45456) 2023-09-30T22:26:02.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.157+0000 7f15bdd16700 1 -- 172.21.15.40:0/853082670 learned_addr learned my addr 172.21.15.40:0/853082670 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:02.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.157+0000 7f15bdd16700 1 -- 172.21.15.40:0/853082670 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15b809d920 msgr2=0x7f15b809dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:02.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.157+0000 7f15bdd16700 1 --2- 172.21.15.40:0/853082670 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15b809d920 0x7f15b809dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.157+0000 7f15bcd14700 1 -- 172.21.15.40:0/853082670 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266170139 0 0) 0x7f15b80a2600 con 0x7f15b809e2b0 2023-09-30T22:26:02.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.157+0000 7f15bdd16700 1 -- 172.21.15.40:0/853082670 >> v1:172.21.15.40:6789/0 conn(0x7f15b809e2b0 legacy=0x7f15b813ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.157+0000 7f15bdd16700 1 -- 172.21.15.40:0/853082670 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b809e730 con 0x7f15b809c890 2023-09-30T22:26:02.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.157+0000 7f15bdd16700 1 --2- 172.21.15.40:0/853082670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15b809c890 0x7f15b809cc60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f15b4006fd0 tx=0x7f15b4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f9757e413babe34 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:02.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.158+0000 7f15bcd14700 1 -- 172.21.15.40:0/853082670 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b4005e30 con 0x7f15b809c890 2023-09-30T22:26:02.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.158+0000 7f15bcd14700 1 -- 172.21.15.40:0/853082670 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b4004030 con 0x7f15b809c890 2023-09-30T22:26:02.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.158+0000 7f15bcd14700 1 -- 172.21.15.40:0/853082670 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b40043e0 con 0x7f15b809c890 2023-09-30T22:26:02.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.158+0000 7f15bff7a700 1 -- 172.21.15.40:0/853082670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15b809c890 msgr2=0x7f15b809cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.158+0000 7f15bff7a700 1 --2- 172.21.15.40:0/853082670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15b809c890 0x7f15b809cc60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f15b4006fd0 tx=0x7f15b4009bd0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.158+0000 7f15bff7a700 1 -- 172.21.15.40:0/853082670 shutdown_connections 2023-09-30T22:26:02.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.158+0000 7f15bff7a700 1 --2- 172.21.15.40:0/853082670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15b809c890 0x7f15b809cc60 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.158+0000 7f15bff7a700 1 --2- 172.21.15.40:0/853082670 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15b809d920 0x7f15b809dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.158+0000 7f15bff7a700 1 -- 172.21.15.40:0/853082670 >> 172.21.15.40:0/853082670 conn(0x7f15b80a7080 msgr2=0x7f15b80a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:02.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.158+0000 7f15bff7a700 1 -- 172.21.15.40:0/853082670 shutdown_connections 2023-09-30T22:26:02.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.158+0000 7f15bff7a700 1 -- 172.21.15.40:0/853082670 wait complete. 2023-09-30T22:26:02.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.160+0000 7f15bff7a700 1 Processor -- start 2023-09-30T22:26:02.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.160+0000 7f15bff7a700 1 -- start start 2023-09-30T22:26:02.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.160+0000 7f15bff7a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15b809c890 0x7f15b812f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.160+0000 7f15bff7a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f15b809d920 0x7f15b812fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.160+0000 7f15bff7a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15b809e2b0 0x7f15b81300b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.160+0000 7f15bff7a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b812f410 con 0x7f15b809c890 2023-09-30T22:26:02.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.161+0000 7f15bff7a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b812e520 con 0x7f15b809e2b0 2023-09-30T22:26:02.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.161+0000 7f15bff7a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15b812cff0 con 0x7f15b809d920 2023-09-30T22:26:02.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.161+0000 7f15bdd16700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15b809c890 0x7f15b812f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.161+0000 7f15bd515700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f15b809d920 0x7f15b812fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.161+0000 7f15bdd16700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15b809c890 0x7f15b812f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45462/0 (socket says 172.21.15.40:45462) 2023-09-30T22:26:02.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.161+0000 7f15bd515700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f15b809d920 0x7f15b812fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:43994/0 (socket says 172.21.15.40:43994) 2023-09-30T22:26:02.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.161+0000 7f15bdd16700 1 -- 172.21.15.40:0/4179695960 learned_addr learned my addr 172.21.15.40:0/4179695960 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:02.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.161+0000 7f15be517700 1 --2- 172.21.15.40:0/4179695960 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15b809e2b0 0x7f15b81300b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.161+0000 7f15bd515700 1 -- 172.21.15.40:0/4179695960 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15b809e2b0 msgr2=0x7f15b81300b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.161+0000 7f15bd515700 1 --2- 172.21.15.40:0/4179695960 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15b809e2b0 0x7f15b81300b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.161+0000 7f15bd515700 1 -- 172.21.15.40:0/4179695960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15b809c890 msgr2=0x7f15b812f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.161+0000 7f15bd515700 1 --2- 172.21.15.40:0/4179695960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15b809c890 0x7f15b812f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.161+0000 7f15bd515700 1 -- 172.21.15.40:0/4179695960 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b4009500 con 0x7f15b809d920 2023-09-30T22:26:02.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.161+0000 7f15bdd16700 1 --2- 172.21.15.40:0/4179695960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15b809c890 0x7f15b812f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:02.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.161+0000 7f15bd515700 1 --2- 172.21.15.40:0/4179695960 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f15b809d920 0x7f15b812fb70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f15a800e900 tx=0x7f15a800ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:02.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.161+0000 7f15ae7fc700 1 -- 172.21.15.40:0/4179695960 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a8013680 con 0x7f15b809d920 2023-09-30T22:26:02.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.161+0000 7f15ae7fc700 1 -- 172.21.15.40:0/4179695960 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a80137e0 con 0x7f15b809d920 2023-09-30T22:26:02.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.161+0000 7f15ae7fc700 1 -- 172.21.15.40:0/4179695960 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a8013b70 con 0x7f15b809d920 2023-09-30T22:26:02.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.161+0000 7f15bff7a700 1 -- 172.21.15.40:0/4179695960 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15b812d710 con 0x7f15b809d920 2023-09-30T22:26:02.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.162+0000 7f15bff7a700 1 -- 172.21.15.40:0/4179695960 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15b812cc10 con 0x7f15b809d920 2023-09-30T22:26:02.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.162+0000 7f15ae7fc700 1 -- 172.21.15.40:0/4179695960 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f15a8013cd0 con 0x7f15b809d920 2023-09-30T22:26:02.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.162+0000 7f15ae7fc700 1 -- 172.21.15.40:0/4179695960 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f15a803f670 con 0x7f15b809d920 2023-09-30T22:26:02.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.163+0000 7f15bff7a700 1 -- 172.21.15.40:0/4179695960 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15b806e600 con 0x7f15b809d920 2023-09-30T22:26:02.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.172+0000 7f15ae7fc700 1 -- 172.21.15.40:0/4179695960 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f15a801bc30 con 0x7f15b809d920 2023-09-30T22:26:02.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.247+0000 7fad4d2e2700 1 -- 172.21.15.40:0/2829314175 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fad48074330 con 0x7fad4809df40 2023-09-30T22:26:02.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.247+0000 7fad2f7fe700 1 -- 172.21.15.40:0/2829314175 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fad3c011e80 con 0x7fad4809df40 2023-09-30T22:26:02.248 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:02.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.249+0000 7fad4d2e2700 1 -- 172.21.15.40:0/2829314175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad4809df40 msgr2=0x7fad4811c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.249+0000 7fad4d2e2700 1 --2- 172.21.15.40:0/2829314175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad4809df40 0x7fad4811c2a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fad3c00c750 tx=0x7fad3c00ca60 comp rx=0 tx=0).stop 2023-09-30T22:26:02.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.249+0000 7fad4d2e2700 1 -- 172.21.15.40:0/2829314175 shutdown_connections 2023-09-30T22:26:02.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.249+0000 7fad4d2e2700 1 --2- 172.21.15.40:0/2829314175 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fad4809d400 0x7fad4811bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.249+0000 7fad4d2e2700 1 --2- 172.21.15.40:0/2829314175 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad48133e00 0x7fad4811c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.249+0000 7fad4d2e2700 1 --2- 172.21.15.40:0/2829314175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad4809df40 0x7fad4811c2a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.249+0000 7fad4d2e2700 1 -- 172.21.15.40:0/2829314175 >> 172.21.15.40:0/2829314175 conn(0x7fad480a2a00 msgr2=0x7fad481303c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:02.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.249+0000 7fad4d2e2700 1 -- 172.21.15.40:0/2829314175 shutdown_connections 2023-09-30T22:26:02.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.249+0000 7fad4d2e2700 1 -- 172.21.15.40:0/2829314175 wait complete. 2023-09-30T22:26:02.262 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:02.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.326+0000 7f4bcf471700 1 -- 172.21.15.40:0/2530063656 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4bc8062380 con 0x7f4bc809d920 2023-09-30T22:26:02.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.326+0000 7f4bbdffb700 1 -- 172.21.15.40:0/2530063656 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4bc402a070 con 0x7f4bc809d920 2023-09-30T22:26:02.327 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:02.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.328+0000 7f4bcf471700 1 -- 172.21.15.40:0/2530063656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4bc809d920 msgr2=0x7f4bc81c5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.328+0000 7f4bcf471700 1 --2- 172.21.15.40:0/2530063656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4bc809d920 0x7f4bc81c5420 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4000c00 tx=0x7f4bc4004750 comp rx=0 tx=0).stop 2023-09-30T22:26:02.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.328+0000 7f4bcf471700 1 -- 172.21.15.40:0/2530063656 shutdown_connections 2023-09-30T22:26:02.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.328+0000 7f4bcf471700 1 --2- 172.21.15.40:0/2530063656 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4bc81a8fb0 0x7f4bc81c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.328+0000 7f4bcf471700 1 --2- 172.21.15.40:0/2530063656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4bc809d920 0x7f4bc81c5420 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.328+0000 7f4bcf471700 1 --2- 172.21.15.40:0/2530063656 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4bc809e230 0x7f4bc81c5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.328+0000 7f4bcf471700 1 -- 172.21.15.40:0/2530063656 >> 172.21.15.40:0/2530063656 conn(0x7f4bc809fb20 msgr2=0x7f4bc81ba120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:02.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.328+0000 7f4bcf471700 1 -- 172.21.15.40:0/2530063656 shutdown_connections 2023-09-30T22:26:02.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.328+0000 7f4bcf471700 1 -- 172.21.15.40:0/2530063656 wait complete. 2023-09-30T22:26:02.341 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:02.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.368+0000 7f15bff7a700 1 -- 172.21.15.40:0/4179695960 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f15b8062380 con 0x7f15b809d920 2023-09-30T22:26:02.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.368+0000 7f15ae7fc700 1 -- 172.21.15.40:0/4179695960 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f15a8021030 con 0x7f15b809d920 2023-09-30T22:26:02.369 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:02.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.370+0000 7f15bff7a700 1 -- 172.21.15.40:0/4179695960 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f15b809d920 msgr2=0x7f15b812fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.370+0000 7f15bff7a700 1 --2- 172.21.15.40:0/4179695960 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f15b809d920 0x7f15b812fb70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f15a800e900 tx=0x7f15a800ec10 comp rx=0 tx=0).stop 2023-09-30T22:26:02.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.370+0000 7f15bff7a700 1 -- 172.21.15.40:0/4179695960 shutdown_connections 2023-09-30T22:26:02.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.370+0000 7f15bff7a700 1 --2- 172.21.15.40:0/4179695960 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15b809e2b0 0x7f15b81300b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.370+0000 7f15bff7a700 1 --2- 172.21.15.40:0/4179695960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15b809c890 0x7f15b812f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.370+0000 7f15bff7a700 1 --2- 172.21.15.40:0/4179695960 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f15b809d920 0x7f15b812fb70 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.370+0000 7f15bff7a700 1 -- 172.21.15.40:0/4179695960 >> 172.21.15.40:0/4179695960 conn(0x7f15b80a7080 msgr2=0x7f15b81bb0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:02.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.370+0000 7f15bff7a700 1 -- 172.21.15.40:0/4179695960 shutdown_connections 2023-09-30T22:26:02.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:02.370+0000 7f15bff7a700 1 -- 172.21.15.40:0/4179695960 wait complete. 2023-09-30T22:26:02.383 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:03.070 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:03.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.211+0000 7fccb62a9700 1 Processor -- start 2023-09-30T22:26:03.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.211+0000 7fccb62a9700 1 -- start start 2023-09-30T22:26:03.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.212+0000 7fccb62a9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fccb009d450 0x7fccb009d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.212+0000 7fccb62a9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fccb009dd60 0x7fccb01301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.212+0000 7fccb62a9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccb009c3b0 con 0x7fccb0130700 2023-09-30T22:26:03.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.212+0000 7fccb62a9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccb009a6b0 con 0x7fccb009dd60 2023-09-30T22:26:03.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.212+0000 7fccb62a9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fccb009b4f0 con 0x7fccb009d450 2023-09-30T22:26:03.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.212+0000 7fccaf7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fccb009dd60 0x7fccb01301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:03.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.212+0000 7fccaffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fccb009d450 0x7fccb009d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:03.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.212+0000 7fccaffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fccb009d450 0x7fccb009d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41406/0 (socket says 172.21.15.40:41406) 2023-09-30T22:26:03.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.212+0000 7fccaf7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fccb009dd60 0x7fccb01301c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36706/0 (socket says 172.21.15.40:36706) 2023-09-30T22:26:03.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.212+0000 7fccaffff700 1 -- 172.21.15.40:0/2941679211 learned_addr learned my addr 172.21.15.40:0/2941679211 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:03.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.212+0000 7fccb4846700 1 --1- 172.21.15.40:0/2941679211 >> v1:172.21.15.40:6789/0 conn(0x7fccb0130700 0x7fccb0137410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40716/0 (socket says 172.21.15.40:40716) 2023-09-30T22:26:03.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.212+0000 7fccaffff700 1 -- 172.21.15.40:0/2941679211 >> v2:172.21.15.40:3300/0 conn(0x7fccb009dd60 msgr2=0x7fccb01301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:03.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.212+0000 7fccaffff700 1 --2- 172.21.15.40:0/2941679211 >> v2:172.21.15.40:3300/0 conn(0x7fccb009dd60 0x7fccb01301c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.212+0000 7fccaffff700 1 -- 172.21.15.40:0/2941679211 >> v1:172.21.15.40:6789/0 conn(0x7fccb0130700 legacy=0x7fccb0137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.212+0000 7fccaffff700 1 -- 172.21.15.40:0/2941679211 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb009af90 con 0x7fccb009d450 2023-09-30T22:26:03.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.212+0000 7fccaf7fe700 1 --2- 172.21.15.40:0/2941679211 >> v2:172.21.15.40:3300/0 conn(0x7fccb009dd60 0x7fccb01301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:03.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.212+0000 7fccaffff700 1 --2- 172.21.15.40:0/2941679211 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fccb009d450 0x7fccb009d820 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcca00098f0 tx=0x7fcca0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da6978439b0b002f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:03.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.213+0000 7fccaeffd700 1 -- 172.21.15.40:0/2941679211 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca0010800 con 0x7fccb009d450 2023-09-30T22:26:03.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.213+0000 7fccaeffd700 1 -- 172.21.15.40:0/2941679211 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca0010960 con 0x7fccb009d450 2023-09-30T22:26:03.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.213+0000 7fccaeffd700 1 -- 172.21.15.40:0/2941679211 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca0010cf0 con 0x7fccb009d450 2023-09-30T22:26:03.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.213+0000 7fccb62a9700 1 -- 172.21.15.40:0/2941679211 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fccb009d450 msgr2=0x7fccb009d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.213+0000 7fccb62a9700 1 --2- 172.21.15.40:0/2941679211 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fccb009d450 0x7fccb009d820 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcca00098f0 tx=0x7fcca0009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:03.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.213+0000 7fccb62a9700 1 -- 172.21.15.40:0/2941679211 shutdown_connections 2023-09-30T22:26:03.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.213+0000 7fccb62a9700 1 --2- 172.21.15.40:0/2941679211 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fccb009d450 0x7fccb009d820 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.213+0000 7fccb62a9700 1 --2- 172.21.15.40:0/2941679211 >> v2:172.21.15.40:3300/0 conn(0x7fccb009dd60 0x7fccb01301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.213+0000 7fccb62a9700 1 -- 172.21.15.40:0/2941679211 >> 172.21.15.40:0/2941679211 conn(0x7fccb00a2a00 msgr2=0x7fccb00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:03.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.213+0000 7fccb62a9700 1 -- 172.21.15.40:0/2941679211 shutdown_connections 2023-09-30T22:26:03.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.213+0000 7fccb62a9700 1 -- 172.21.15.40:0/2941679211 wait complete. 2023-09-30T22:26:03.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.214+0000 7fccb62a9700 1 Processor -- start 2023-09-30T22:26:03.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.214+0000 7fccb62a9700 1 -- start start 2023-09-30T22:26:03.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.215+0000 7fccb62a9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fccb009d450 0x7fccb006d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.215+0000 7fccb62a9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fccb009dd60 0x7fccb006db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.215+0000 7fccb62a9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccb0130700 0x7fccb006e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.215+0000 7fccb62a9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb0071480 con 0x7fccb0130700 2023-09-30T22:26:03.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.215+0000 7fccb62a9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb009c5d0 con 0x7fccb009dd60 2023-09-30T22:26:03.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.215+0000 7fccb62a9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fccb0124cd0 con 0x7fccb009d450 2023-09-30T22:26:03.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.215+0000 7fccaffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fccb009d450 0x7fccb006d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:03.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.215+0000 7fccb4846700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccb0130700 0x7fccb006e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:03.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.215+0000 7fccaffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fccb009d450 0x7fccb006d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41420/0 (socket says 172.21.15.40:41420) 2023-09-30T22:26:03.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.215+0000 7fccaf7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fccb009dd60 0x7fccb006db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:03.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.215+0000 7fccaffff700 1 -- 172.21.15.40:0/3721264633 learned_addr learned my addr 172.21.15.40:0/3721264633 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:03.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.215+0000 7fccaffff700 1 -- 172.21.15.40:0/3721264633 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fccb009dd60 msgr2=0x7fccb006db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.215+0000 7fccaffff700 1 --2- 172.21.15.40:0/3721264633 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fccb009dd60 0x7fccb006db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.215+0000 7fccaffff700 1 -- 172.21.15.40:0/3721264633 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccb0130700 msgr2=0x7fccb006e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.215+0000 7fccaffff700 1 --2- 172.21.15.40:0/3721264633 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccb0130700 0x7fccb006e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.215+0000 7fccaffff700 1 -- 172.21.15.40:0/3721264633 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca40094a0 con 0x7fccb009d450 2023-09-30T22:26:03.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.215+0000 7fccb4846700 1 --2- 172.21.15.40:0/3721264633 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccb0130700 0x7fccb006e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:03.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.215+0000 7fccaf7fe700 1 --2- 172.21.15.40:0/3721264633 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fccb009dd60 0x7fccb006db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:03.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.215+0000 7fccaffff700 1 --2- 172.21.15.40:0/3721264633 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fccb009d450 0x7fccb006d640 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcca0000c00 tx=0x7fcca0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:03.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.215+0000 7fccacff9700 1 -- 172.21.15.40:0/3721264633 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca0003ab0 con 0x7fccb009d450 2023-09-30T22:26:03.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.216+0000 7fccacff9700 1 -- 172.21.15.40:0/3721264633 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca0003c30 con 0x7fccb009d450 2023-09-30T22:26:03.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.216+0000 7fccb62a9700 1 -- 172.21.15.40:0/3721264633 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca0009550 con 0x7fccb009d450 2023-09-30T22:26:03.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.216+0000 7fccacff9700 1 -- 172.21.15.40:0/3721264633 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca0004560 con 0x7fccb009d450 2023-09-30T22:26:03.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.216+0000 7fccb62a9700 1 -- 172.21.15.40:0/3721264633 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb0125620 con 0x7fccb009d450 2023-09-30T22:26:03.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.216+0000 7fccacff9700 1 -- 172.21.15.40:0/3721264633 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcca0018400 con 0x7fccb009d450 2023-09-30T22:26:03.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.216+0000 7fccacff9700 1 -- 172.21.15.40:0/3721264633 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fcca00408e0 con 0x7fccb009d450 2023-09-30T22:26:03.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.217+0000 7fccb62a9700 1 -- 172.21.15.40:0/3721264633 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccb0125460 con 0x7fccb009d450 2023-09-30T22:26:03.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.221+0000 7fccacff9700 1 -- 172.21.15.40:0/3721264633 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcca0026070 con 0x7fccb009d450 2023-09-30T22:26:03.263 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:03.342 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:03.383 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:03.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.391+0000 7f67034fe700 1 Processor -- start 2023-09-30T22:26:03.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.391+0000 7f67034fe700 1 -- start start 2023-09-30T22:26:03.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.392+0000 7f67034fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66fc12f070 0x7f66fc135c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.392+0000 7f67034fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66fc136170 0x7f66fc138550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.392+0000 7f67034fe700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66fc09ab70 con 0x7f66fc12e590 2023-09-30T22:26:03.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.392+0000 7f67034fe700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc09b270 con 0x7f66fc136170 2023-09-30T22:26:03.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.392+0000 7f67034fe700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc12f440 con 0x7f66fc12f070 2023-09-30T22:26:03.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.392+0000 7f670129a700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f66fc12e590 0x7f66fc12e960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40722/0 (socket says 172.21.15.40:40722) 2023-09-30T22:26:03.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.392+0000 7f670129a700 1 -- 172.21.15.40:0/3966508732 learned_addr learned my addr 172.21.15.40:0/3966508732 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:03.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.392+0000 7f6701a9b700 1 --2- 172.21.15.40:0/3966508732 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66fc136170 0x7f66fc138550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:03.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.392+0000 7f6700a99700 1 --2- 172.21.15.40:0/3966508732 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66fc12f070 0x7f66fc135c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:03.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.393+0000 7f6701a9b700 1 -- 172.21.15.40:0/3966508732 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66fc12f070 msgr2=0x7f66fc135c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:03.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.393+0000 7f6701a9b700 1 --2- 172.21.15.40:0/3966508732 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66fc12f070 0x7f66fc135c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.393+0000 7f6701a9b700 1 -- 172.21.15.40:0/3966508732 >> v1:172.21.15.40:6789/0 conn(0x7f66fc12e590 legacy=0x7f66fc12e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.393+0000 7f6701a9b700 1 -- 172.21.15.40:0/3966508732 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66fc09bd70 con 0x7f66fc136170 2023-09-30T22:26:03.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.393+0000 7f6701a9b700 1 --2- 172.21.15.40:0/3966508732 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66fc136170 0x7f66fc138550 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f66f80098a0 tx=0x7f66f8009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=663c12b44af13524 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:03.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.393+0000 7f66effff700 1 -- 172.21.15.40:0/3966508732 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f8011830 con 0x7f66fc136170 2023-09-30T22:26:03.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.393+0000 7f66effff700 1 -- 172.21.15.40:0/3966508732 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f8011990 con 0x7f66fc136170 2023-09-30T22:26:03.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.393+0000 7f66effff700 1 -- 172.21.15.40:0/3966508732 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f8011d20 con 0x7f66fc136170 2023-09-30T22:26:03.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.394+0000 7f67034fe700 1 -- 172.21.15.40:0/3966508732 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66fc136170 msgr2=0x7f66fc138550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.394+0000 7f67034fe700 1 --2- 172.21.15.40:0/3966508732 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66fc136170 0x7f66fc138550 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f66f80098a0 tx=0x7f66f8009bb0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.394+0000 7f67034fe700 1 -- 172.21.15.40:0/3966508732 shutdown_connections 2023-09-30T22:26:03.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.394+0000 7f67034fe700 1 --2- 172.21.15.40:0/3966508732 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66fc136170 0x7f66fc138550 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.394+0000 7f67034fe700 1 --2- 172.21.15.40:0/3966508732 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66fc12f070 0x7f66fc135c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.394+0000 7f67034fe700 1 -- 172.21.15.40:0/3966508732 >> 172.21.15.40:0/3966508732 conn(0x7f66fc0a2a00 msgr2=0x7f66fc0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:03.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.394+0000 7f67034fe700 1 -- 172.21.15.40:0/3966508732 shutdown_connections 2023-09-30T22:26:03.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.394+0000 7f67034fe700 1 -- 172.21.15.40:0/3966508732 wait complete. 2023-09-30T22:26:03.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.395+0000 7f67034fe700 1 Processor -- start 2023-09-30T22:26:03.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.396+0000 7f67034fe700 1 -- start start 2023-09-30T22:26:03.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.396+0000 7f67034fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66fc12e590 0x7f66fc134180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.396+0000 7f67034fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66fc12f070 0x7f66fc1346c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.396+0000 7f67034fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66fc136170 0x7f66fc1c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.396+0000 7f67034fe700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc133db0 con 0x7f66fc136170 2023-09-30T22:26:03.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.396+0000 7f67034fe700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc12dc80 con 0x7f66fc12f070 2023-09-30T22:26:03.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.396+0000 7f67034fe700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc0a2710 con 0x7f66fc12e590 2023-09-30T22:26:03.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.396+0000 7f670129a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66fc12e590 0x7f66fc134180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:03.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.396+0000 7f6700a99700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66fc12f070 0x7f66fc1346c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:03.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.396+0000 7f6700a99700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66fc12f070 0x7f66fc1346c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:51856/0 (socket says 172.21.15.40:51856) 2023-09-30T22:26:03.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.397+0000 7f670129a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66fc12e590 0x7f66fc134180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41434/0 (socket says 172.21.15.40:41434) 2023-09-30T22:26:03.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.397+0000 7f6700a99700 1 -- 172.21.15.40:0/2931334166 learned_addr learned my addr 172.21.15.40:0/2931334166 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:03.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.397+0000 7f6701a9b700 1 --2- 172.21.15.40:0/2931334166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66fc136170 0x7f66fc1c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:03.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.397+0000 7f6700a99700 1 -- 172.21.15.40:0/2931334166 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66fc12e590 msgr2=0x7f66fc134180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.397+0000 7f6700a99700 1 --2- 172.21.15.40:0/2931334166 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66fc12e590 0x7f66fc134180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.397+0000 7f6700a99700 1 -- 172.21.15.40:0/2931334166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66fc136170 msgr2=0x7f66fc1c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.397+0000 7f6700a99700 1 --2- 172.21.15.40:0/2931334166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66fc136170 0x7f66fc1c8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.397+0000 7f6700a99700 1 -- 172.21.15.40:0/2931334166 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f80094a0 con 0x7f66fc12f070 2023-09-30T22:26:03.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.397+0000 7f6700a99700 1 --2- 172.21.15.40:0/2931334166 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66fc12f070 0x7f66fc1346c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f66f000e9b0 tx=0x7f66f000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:03.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.397+0000 7f66edffb700 1 -- 172.21.15.40:0/2931334166 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f0009710 con 0x7f66fc12f070 2023-09-30T22:26:03.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.397+0000 7f67034fe700 1 -- 172.21.15.40:0/2931334166 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66fc09b4b0 con 0x7f66fc12f070 2023-09-30T22:26:03.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.397+0000 7f66edffb700 1 -- 172.21.15.40:0/2931334166 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f000ee50 con 0x7f66fc12f070 2023-09-30T22:26:03.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.397+0000 7f66edffb700 1 -- 172.21.15.40:0/2931334166 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f000ca50 con 0x7f66fc12f070 2023-09-30T22:26:03.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.398+0000 7f67034fe700 1 -- 172.21.15.40:0/2931334166 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66fc11f5c0 con 0x7f66fc12f070 2023-09-30T22:26:03.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.399+0000 7f67034fe700 1 -- 172.21.15.40:0/2931334166 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66fc062380 con 0x7f66fc12f070 2023-09-30T22:26:03.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.399+0000 7f66edffb700 1 -- 172.21.15.40:0/2931334166 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f66f000cbb0 con 0x7f66fc12f070 2023-09-30T22:26:03.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.399+0000 7f66edffb700 1 -- 172.21.15.40:0/2931334166 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f66f003ffe0 con 0x7f66fc12f070 2023-09-30T22:26:03.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.404+0000 7f66edffb700 1 -- 172.21.15.40:0/2931334166 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f66f0011350 con 0x7f66fc12f070 2023-09-30T22:26:03.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.427+0000 7fccb62a9700 1 -- 172.21.15.40:0/3721264633 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fccb0062380 con 0x7fccb009d450 2023-09-30T22:26:03.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.428+0000 7fccacff9700 1 -- 172.21.15.40:0/3721264633 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcca0026070 con 0x7fccb009d450 2023-09-30T22:26:03.429 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:03.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.431+0000 7fccb62a9700 1 -- 172.21.15.40:0/3721264633 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fccb009d450 msgr2=0x7fccb006d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.431+0000 7fccb62a9700 1 --2- 172.21.15.40:0/3721264633 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fccb009d450 0x7fccb006d640 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcca0000c00 tx=0x7fcca0004750 comp rx=0 tx=0).stop 2023-09-30T22:26:03.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.431+0000 7fccb62a9700 1 -- 172.21.15.40:0/3721264633 shutdown_connections 2023-09-30T22:26:03.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.432+0000 7fccb62a9700 1 --2- 172.21.15.40:0/3721264633 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fccb009d450 0x7fccb006d640 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.432+0000 7fccb62a9700 1 --2- 172.21.15.40:0/3721264633 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccb0130700 0x7fccb006e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.432+0000 7fccb62a9700 1 --2- 172.21.15.40:0/3721264633 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fccb009dd60 0x7fccb006db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.432+0000 7fccb62a9700 1 -- 172.21.15.40:0/3721264633 >> 172.21.15.40:0/3721264633 conn(0x7fccb00a2a00 msgr2=0x7fccb00a1900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:03.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.432+0000 7fccb62a9700 1 -- 172.21.15.40:0/3721264633 shutdown_connections 2023-09-30T22:26:03.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.432+0000 7fccb62a9700 1 -- 172.21.15.40:0/3721264633 wait complete. 2023-09-30T22:26:03.451 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:03.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.478+0000 7f054c97d700 1 Processor -- start 2023-09-30T22:26:03.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.478+0000 7f054c97d700 1 -- start start 2023-09-30T22:26:03.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.479+0000 7f054c97d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f054809c890 0x7f054809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.479+0000 7f054c97d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f054809d920 0x7f054809dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.479+0000 7f054c97d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05480a2600 con 0x7f054809e2b0 2023-09-30T22:26:03.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.479+0000 7f054c97d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05480a29d0 con 0x7f054809c890 2023-09-30T22:26:03.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.479+0000 7f054c97d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f054809fb40 con 0x7f054809d920 2023-09-30T22:26:03.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.479+0000 7f054659c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f054809c890 0x7f054809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:03.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.479+0000 7f0545d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f054809d920 0x7f054809dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:03.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.479+0000 7f054659c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f054809c890 0x7f054809cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36742/0 (socket says 172.21.15.40:36742) 2023-09-30T22:26:03.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.479+0000 7f054659c700 1 -- 172.21.15.40:0/2857137341 learned_addr learned my addr 172.21.15.40:0/2857137341 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:03.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.479+0000 7f0545d9b700 1 -- 172.21.15.40:0/2857137341 >> v2:172.21.15.40:3300/0 conn(0x7f054809c890 msgr2=0x7f054809cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:03.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.479+0000 7f0545d9b700 1 --2- 172.21.15.40:0/2857137341 >> v2:172.21.15.40:3300/0 conn(0x7f054809c890 0x7f054809cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.479+0000 7f0545d9b700 1 -- 172.21.15.40:0/2857137341 >> v1:172.21.15.40:6789/0 conn(0x7f054809e2b0 legacy=0x7f054813ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.479+0000 7f0545d9b700 1 -- 172.21.15.40:0/2857137341 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054809e730 con 0x7f054809d920 2023-09-30T22:26:03.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.479+0000 7f054659c700 1 --2- 172.21.15.40:0/2857137341 >> v2:172.21.15.40:3300/0 conn(0x7f054809c890 0x7f054809cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:03.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.479+0000 7f0545d9b700 1 --2- 172.21.15.40:0/2857137341 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f054809d920 0x7f054809dd70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f053c009840 tx=0x7f053c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc22aef341904d1f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:03.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.479+0000 7f054559a700 1 -- 172.21.15.40:0/2857137341 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c011830 con 0x7f054809d920 2023-09-30T22:26:03.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.480+0000 7f054559a700 1 -- 172.21.15.40:0/2857137341 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053c011990 con 0x7f054809d920 2023-09-30T22:26:03.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.480+0000 7f054559a700 1 -- 172.21.15.40:0/2857137341 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c011d20 con 0x7f054809d920 2023-09-30T22:26:03.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.480+0000 7f054c97d700 1 -- 172.21.15.40:0/2857137341 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f054809d920 msgr2=0x7f054809dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.480+0000 7f054c97d700 1 --2- 172.21.15.40:0/2857137341 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f054809d920 0x7f054809dd70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f053c009840 tx=0x7f053c009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:03.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.480+0000 7f054c97d700 1 -- 172.21.15.40:0/2857137341 shutdown_connections 2023-09-30T22:26:03.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.480+0000 7f054c97d700 1 --2- 172.21.15.40:0/2857137341 >> v2:172.21.15.40:3300/0 conn(0x7f054809c890 0x7f054809cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.480+0000 7f054c97d700 1 --2- 172.21.15.40:0/2857137341 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f054809d920 0x7f054809dd70 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.480+0000 7f054c97d700 1 -- 172.21.15.40:0/2857137341 >> 172.21.15.40:0/2857137341 conn(0x7f05480a7080 msgr2=0x7f05480a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:03.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.480+0000 7f054c97d700 1 -- 172.21.15.40:0/2857137341 shutdown_connections 2023-09-30T22:26:03.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.480+0000 7f054c97d700 1 -- 172.21.15.40:0/2857137341 wait complete. 2023-09-30T22:26:03.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.481+0000 7f054c97d700 1 Processor -- start 2023-09-30T22:26:03.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.481+0000 7f054c97d700 1 -- start start 2023-09-30T22:26:03.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.482+0000 7f054c97d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f054809c890 0x7f054812d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.482+0000 7f054c97d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f054809d920 0x7f054812da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.482+0000 7f054c97d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f054809e2b0 0x7f054812dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.482+0000 7f054c97d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054808f480 con 0x7f054809c890 2023-09-30T22:26:03.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.482+0000 7f054c97d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0548130a10 con 0x7f054809e2b0 2023-09-30T22:26:03.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.482+0000 7f054c97d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05480a5da0 con 0x7f054809d920 2023-09-30T22:26:03.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.482+0000 7f0545d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f054809d920 0x7f054812da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:03.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.482+0000 7f0545d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f054809d920 0x7f054812da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41452/0 (socket says 172.21.15.40:41452) 2023-09-30T22:26:03.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.482+0000 7f0545d9b700 1 -- 172.21.15.40:0/3271242531 learned_addr learned my addr 172.21.15.40:0/3271242531 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:03.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.482+0000 7f0546d9d700 1 --2- 172.21.15.40:0/3271242531 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f054809e2b0 0x7f054812dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:03.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.482+0000 7f054659c700 1 --2- 172.21.15.40:0/3271242531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f054809c890 0x7f054812d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:03.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.482+0000 7f0545d9b700 1 -- 172.21.15.40:0/3271242531 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f054809e2b0 msgr2=0x7f054812dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.482+0000 7f0545d9b700 1 --2- 172.21.15.40:0/3271242531 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f054809e2b0 0x7f054812dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.482+0000 7f0545d9b700 1 -- 172.21.15.40:0/3271242531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f054809c890 msgr2=0x7f054812d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.482+0000 7f0545d9b700 1 --2- 172.21.15.40:0/3271242531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f054809c890 0x7f054812d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.482+0000 7f0545d9b700 1 -- 172.21.15.40:0/3271242531 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0538009500 con 0x7f054809d920 2023-09-30T22:26:03.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.482+0000 7f054659c700 1 --2- 172.21.15.40:0/3271242531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f054809c890 0x7f054812d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:26:03.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.483+0000 7f0545d9b700 1 --2- 172.21.15.40:0/3271242531 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f054809d920 0x7f054812da80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f053c009fd0 tx=0x7f053c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:03.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.483+0000 7f0536ffd700 1 -- 172.21.15.40:0/3271242531 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c004480 con 0x7f054809d920 2023-09-30T22:26:03.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.483+0000 7f0536ffd700 1 -- 172.21.15.40:0/3271242531 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053c01f070 con 0x7f054809d920 2023-09-30T22:26:03.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.483+0000 7f054c97d700 1 -- 172.21.15.40:0/3271242531 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f053c0094a0 con 0x7f054809d920 2023-09-30T22:26:03.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.483+0000 7f0536ffd700 1 -- 172.21.15.40:0/3271242531 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c0038e0 con 0x7f054809d920 2023-09-30T22:26:03.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.483+0000 7f054c97d700 1 -- 172.21.15.40:0/3271242531 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f054809ed40 con 0x7f054809d920 2023-09-30T22:26:03.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.484+0000 7f0536ffd700 1 -- 172.21.15.40:0/3271242531 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f053c021030 con 0x7f054809d920 2023-09-30T22:26:03.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.484+0000 7f0536ffd700 1 -- 172.21.15.40:0/3271242531 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f053c0409d0 con 0x7f054809d920 2023-09-30T22:26:03.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.484+0000 7f054c97d700 1 -- 172.21.15.40:0/3271242531 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05481306b0 con 0x7f054809d920 2023-09-30T22:26:03.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.489+0000 7f0536ffd700 1 -- 172.21.15.40:0/3271242531 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f053c01a7d0 con 0x7f054809d920 2023-09-30T22:26:03.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.531+0000 7f8df56d7700 1 Processor -- start 2023-09-30T22:26:03.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.531+0000 7f8df56d7700 1 -- start start 2023-09-30T22:26:03.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.531+0000 7f8df56d7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8df009d920 0x7f8df009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.531+0000 7f8df56d7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8df009f0f0 0x7f8df009e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.531+0000 7f8df56d7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8df009f940 con 0x7f8df0133ca0 2023-09-30T22:26:03.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.531+0000 7f8df56d7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8df006b4c0 con 0x7f8df009f0f0 2023-09-30T22:26:03.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.531+0000 7f8df56d7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8df009a8f0 con 0x7f8df009d920 2023-09-30T22:26:03.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.532+0000 7f8deeffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8df009d920 0x7f8df009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:03.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.532+0000 7f8deeffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8df009d920 0x7f8df009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41464/0 (socket says 172.21.15.40:41464) 2023-09-30T22:26:03.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.532+0000 7f8deeffd700 1 -- 172.21.15.40:0/3542325739 learned_addr learned my addr 172.21.15.40:0/3542325739 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:03.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.532+0000 7f8dee7fc700 1 --2- 172.21.15.40:0/3542325739 >> v2:172.21.15.40:3300/0 conn(0x7f8df009f0f0 0x7f8df009e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:03.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.532+0000 7f8deeffd700 1 -- 172.21.15.40:0/3542325739 >> v2:172.21.15.40:3300/0 conn(0x7f8df009f0f0 msgr2=0x7f8df009e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:03.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.532+0000 7f8deeffd700 1 --2- 172.21.15.40:0/3542325739 >> v2:172.21.15.40:3300/0 conn(0x7f8df009f0f0 0x7f8df009e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.532+0000 7f8deeffd700 1 -- 172.21.15.40:0/3542325739 >> v1:172.21.15.40:6789/0 conn(0x7f8df0133ca0 legacy=0x7f8df0134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.532+0000 7f8deeffd700 1 -- 172.21.15.40:0/3542325739 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df009f6e0 con 0x7f8df009d920 2023-09-30T22:26:03.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.532+0000 7f8deeffd700 1 --2- 172.21.15.40:0/3542325739 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8df009d920 0x7f8df009dcf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8de0006fd0 tx=0x7f8de0009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75ceb1b352aff979 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:03.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.532+0000 7f8dedffb700 1 -- 172.21.15.40:0/3542325739 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de0005e30 con 0x7f8df009d920 2023-09-30T22:26:03.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.532+0000 7f8dedffb700 1 -- 172.21.15.40:0/3542325739 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de0004030 con 0x7f8df009d920 2023-09-30T22:26:03.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.532+0000 7f8dedffb700 1 -- 172.21.15.40:0/3542325739 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de00043e0 con 0x7f8df009d920 2023-09-30T22:26:03.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.533+0000 7f8df56d7700 1 -- 172.21.15.40:0/3542325739 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8df009d920 msgr2=0x7f8df009dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.533+0000 7f8df56d7700 1 --2- 172.21.15.40:0/3542325739 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8df009d920 0x7f8df009dcf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8de0006fd0 tx=0x7f8de0009bd0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.533+0000 7f8df56d7700 1 -- 172.21.15.40:0/3542325739 shutdown_connections 2023-09-30T22:26:03.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.533+0000 7f8df56d7700 1 --2- 172.21.15.40:0/3542325739 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8df009d920 0x7f8df009dcf0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.533+0000 7f8df56d7700 1 --2- 172.21.15.40:0/3542325739 >> v2:172.21.15.40:3300/0 conn(0x7f8df009f0f0 0x7f8df009e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.533+0000 7f8df56d7700 1 -- 172.21.15.40:0/3542325739 >> 172.21.15.40:0/3542325739 conn(0x7f8df009fb20 msgr2=0x7f8df009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:03.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.533+0000 7f8df56d7700 1 -- 172.21.15.40:0/3542325739 shutdown_connections 2023-09-30T22:26:03.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.533+0000 7f8df56d7700 1 -- 172.21.15.40:0/3542325739 wait complete. 2023-09-30T22:26:03.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.534+0000 7f8df56d7700 1 Processor -- start 2023-09-30T22:26:03.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.534+0000 7f8df56d7700 1 -- start start 2023-09-30T22:26:03.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.534+0000 7f8df56d7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8df009d920 0x7f8df0120460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.534+0000 7f8df56d7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8df0133ca0 0x7f8df01209a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.534+0000 7f8df56d7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8df01243e0 0x7f8df0120ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.535+0000 7f8df56d7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df0121910 con 0x7f8df0133ca0 2023-09-30T22:26:03.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.535+0000 7f8df56d7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df0121fd0 con 0x7f8df01243e0 2023-09-30T22:26:03.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.535+0000 7f8df56d7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8df0123220 con 0x7f8df009d920 2023-09-30T22:26:03.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.535+0000 7f8dee7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8df0133ca0 0x7f8df01209a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:03.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.535+0000 7f8dee7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8df0133ca0 0x7f8df01209a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36762/0 (socket says 172.21.15.40:36762) 2023-09-30T22:26:03.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.535+0000 7f8def7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8df01243e0 0x7f8df0120ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:03.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.535+0000 7f8dee7fc700 1 -- 172.21.15.40:0/54107227 learned_addr learned my addr 172.21.15.40:0/54107227 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:03.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.535+0000 7f8deeffd700 1 --2- 172.21.15.40:0/54107227 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8df009d920 0x7f8df0120460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:03.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.535+0000 7f8deeffd700 1 -- 172.21.15.40:0/54107227 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8df01243e0 msgr2=0x7f8df0120ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.535+0000 7f8deeffd700 1 --2- 172.21.15.40:0/54107227 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8df01243e0 0x7f8df0120ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.535+0000 7f8deeffd700 1 -- 172.21.15.40:0/54107227 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8df0133ca0 msgr2=0x7f8df01209a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.535+0000 7f8deeffd700 1 --2- 172.21.15.40:0/54107227 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8df0133ca0 0x7f8df01209a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.535+0000 7f8deeffd700 1 -- 172.21.15.40:0/54107227 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de0009500 con 0x7f8df009d920 2023-09-30T22:26:03.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.535+0000 7f8dee7fc700 1 --2- 172.21.15.40:0/54107227 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8df0133ca0 0x7f8df01209a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:03.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.535+0000 7f8deeffd700 1 --2- 172.21.15.40:0/54107227 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8df009d920 0x7f8df0120460 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8de0013000 tx=0x7f8de0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:03.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.535+0000 7f8dd77fe700 1 -- 172.21.15.40:0/54107227 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de0003c30 con 0x7f8df009d920 2023-09-30T22:26:03.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.535+0000 7f8dd77fe700 1 -- 172.21.15.40:0/54107227 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de0003db0 con 0x7f8df009d920 2023-09-30T22:26:03.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.535+0000 7f8df56d7700 1 -- 172.21.15.40:0/54107227 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8df01225b0 con 0x7f8df009d920 2023-09-30T22:26:03.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.535+0000 7f8dd77fe700 1 -- 172.21.15.40:0/54107227 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de001c660 con 0x7f8df009d920 2023-09-30T22:26:03.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.535+0000 7f8df56d7700 1 -- 172.21.15.40:0/54107227 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8df00a28a0 con 0x7f8df009d920 2023-09-30T22:26:03.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.536+0000 7f8dd77fe700 1 -- 172.21.15.40:0/54107227 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8de001c7c0 con 0x7f8df009d920 2023-09-30T22:26:03.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.536+0000 7f8dd77fe700 1 -- 172.21.15.40:0/54107227 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f8de00405d0 con 0x7f8df009d920 2023-09-30T22:26:03.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.536+0000 7f8df56d7700 1 -- 172.21.15.40:0/54107227 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8df0071700 con 0x7f8df009d920 2023-09-30T22:26:03.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.541+0000 7f8dd77fe700 1 -- 172.21.15.40:0/54107227 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8de002a020 con 0x7f8df009d920 2023-09-30T22:26:03.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.641+0000 7f67034fe700 1 -- 172.21.15.40:0/2931334166 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f66fc074330 con 0x7f66fc12f070 2023-09-30T22:26:03.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.641+0000 7f66edffb700 1 -- 172.21.15.40:0/2931334166 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f66f002a090 con 0x7f66fc12f070 2023-09-30T22:26:03.642 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:03.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.644+0000 7f67034fe700 1 -- 172.21.15.40:0/2931334166 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66fc12f070 msgr2=0x7f66fc1346c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.644+0000 7f67034fe700 1 --2- 172.21.15.40:0/2931334166 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66fc12f070 0x7f66fc1346c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f66f000e9b0 tx=0x7f66f000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.644+0000 7f67034fe700 1 -- 172.21.15.40:0/2931334166 shutdown_connections 2023-09-30T22:26:03.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.644+0000 7f67034fe700 1 --2- 172.21.15.40:0/2931334166 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66fc12e590 0x7f66fc134180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.644+0000 7f67034fe700 1 --2- 172.21.15.40:0/2931334166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66fc136170 0x7f66fc1c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.644+0000 7f67034fe700 1 --2- 172.21.15.40:0/2931334166 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66fc12f070 0x7f66fc1346c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.644+0000 7f67034fe700 1 -- 172.21.15.40:0/2931334166 >> 172.21.15.40:0/2931334166 conn(0x7f66fc0a2a00 msgr2=0x7f66fc09d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:03.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.644+0000 7f67034fe700 1 -- 172.21.15.40:0/2931334166 shutdown_connections 2023-09-30T22:26:03.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.644+0000 7f67034fe700 1 -- 172.21.15.40:0/2931334166 wait complete. 2023-09-30T22:26:03.658 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:03.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.723+0000 7f054c97d700 1 -- 172.21.15.40:0/3271242531 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0548062380 con 0x7f054809d920 2023-09-30T22:26:03.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.723+0000 7f0536ffd700 1 -- 172.21.15.40:0/3271242531 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f053c015020 con 0x7f054809d920 2023-09-30T22:26:03.725 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:03.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.727+0000 7f054c97d700 1 -- 172.21.15.40:0/3271242531 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f054809d920 msgr2=0x7f054812da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.727+0000 7f054c97d700 1 --2- 172.21.15.40:0/3271242531 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f054809d920 0x7f054812da80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f053c009fd0 tx=0x7f053c004750 comp rx=0 tx=0).stop 2023-09-30T22:26:03.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.727+0000 7f054c97d700 1 -- 172.21.15.40:0/3271242531 shutdown_connections 2023-09-30T22:26:03.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.727+0000 7f054c97d700 1 --2- 172.21.15.40:0/3271242531 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f054809e2b0 0x7f054812dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.727+0000 7f054c97d700 1 --2- 172.21.15.40:0/3271242531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f054809c890 0x7f054812d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.727+0000 7f054c97d700 1 --2- 172.21.15.40:0/3271242531 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f054809d920 0x7f054812da80 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.727+0000 7f054c97d700 1 -- 172.21.15.40:0/3271242531 >> 172.21.15.40:0/3271242531 conn(0x7f05480a7080 msgr2=0x7f05480a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:03.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.727+0000 7f054c97d700 1 -- 172.21.15.40:0/3271242531 shutdown_connections 2023-09-30T22:26:03.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.727+0000 7f054c97d700 1 -- 172.21.15.40:0/3271242531 wait complete. 2023-09-30T22:26:03.742 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:03.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.747+0000 7f8df56d7700 1 -- 172.21.15.40:0/54107227 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8df0123af0 con 0x7f8df009d920 2023-09-30T22:26:03.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.747+0000 7f8dd77fe700 1 -- 172.21.15.40:0/54107227 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8de0016070 con 0x7f8df009d920 2023-09-30T22:26:03.748 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:03.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.749+0000 7f8df56d7700 1 -- 172.21.15.40:0/54107227 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8df009d920 msgr2=0x7f8df0120460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.749+0000 7f8df56d7700 1 --2- 172.21.15.40:0/54107227 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8df009d920 0x7f8df0120460 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8de0013000 tx=0x7f8de0004750 comp rx=0 tx=0).stop 2023-09-30T22:26:03.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.749+0000 7f8df56d7700 1 -- 172.21.15.40:0/54107227 shutdown_connections 2023-09-30T22:26:03.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.749+0000 7f8df56d7700 1 --2- 172.21.15.40:0/54107227 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8df009d920 0x7f8df0120460 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.749+0000 7f8df56d7700 1 --2- 172.21.15.40:0/54107227 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8df01243e0 0x7f8df0120ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.749+0000 7f8df56d7700 1 --2- 172.21.15.40:0/54107227 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8df0133ca0 0x7f8df01209a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.749+0000 7f8df56d7700 1 -- 172.21.15.40:0/54107227 >> 172.21.15.40:0/54107227 conn(0x7f8df009fb20 msgr2=0x7f8df00a1900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:03.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.749+0000 7f8df56d7700 1 -- 172.21.15.40:0/54107227 shutdown_connections 2023-09-30T22:26:03.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:03.749+0000 7f8df56d7700 1 -- 172.21.15.40:0/54107227 wait complete. 2023-09-30T22:26:03.762 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:04.453 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:04.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.594+0000 7f853267a700 1 Processor -- start 2023-09-30T22:26:04.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.594+0000 7f853267a700 1 -- start start 2023-09-30T22:26:04.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.595+0000 7f853267a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f852c09d450 0x7f852c09d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.595+0000 7f853267a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f852c09dd60 0x7f852c1301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.595+0000 7f853267a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f852c130700 0x7f852c130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.595+0000 7f853267a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f852c09e8b0 con 0x7f852c130700 2023-09-30T22:26:04.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.595+0000 7f853267a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f852c09c3b0 con 0x7f852c09d450 2023-09-30T22:26:04.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.595+0000 7f853267a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f852c09a6b0 con 0x7f852c09dd60 2023-09-30T22:26:04.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.595+0000 7f852bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f852c09d450 0x7f852c09d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.595+0000 7f852b7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f852c09dd60 0x7f852c1301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.595+0000 7f8530c17700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f852c130700 0x7f852c130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.595+0000 7f8530c17700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f852c130700 0x7f852c130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36772/0 (socket says 172.21.15.40:36772) 2023-09-30T22:26:04.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.595+0000 7f852b7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f852c09dd60 0x7f852c1301c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41476/0 (socket says 172.21.15.40:41476) 2023-09-30T22:26:04.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.595+0000 7f852bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f852c09d450 0x7f852c09d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:51884/0 (socket says 172.21.15.40:51884) 2023-09-30T22:26:04.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.595+0000 7f8530c17700 1 -- 172.21.15.40:0/858981858 learned_addr learned my addr 172.21.15.40:0/858981858 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:04.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.596+0000 7f852bfff700 1 -- 172.21.15.40:0/858981858 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f852c09dd60 msgr2=0x7f852c1301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:04.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.596+0000 7f852bfff700 1 --2- 172.21.15.40:0/858981858 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f852c09dd60 0x7f852c1301c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.596+0000 7f852bfff700 1 -- 172.21.15.40:0/858981858 >> v2:172.21.15.40:3300/0 conn(0x7f852c130700 msgr2=0x7f852c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:04.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.596+0000 7f852bfff700 1 --2- 172.21.15.40:0/858981858 >> v2:172.21.15.40:3300/0 conn(0x7f852c130700 0x7f852c130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.596+0000 7f852bfff700 1 -- 172.21.15.40:0/858981858 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f852c09b4f0 con 0x7f852c09d450 2023-09-30T22:26:04.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.596+0000 7f852b7fe700 1 --2- 172.21.15.40:0/858981858 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f852c09dd60 0x7f852c1301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:04.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.596+0000 7f8530c17700 1 --2- 172.21.15.40:0/858981858 >> v2:172.21.15.40:3300/0 conn(0x7f852c130700 0x7f852c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:04.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.596+0000 7f852bfff700 1 --2- 172.21.15.40:0/858981858 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f852c09d450 0x7f852c09d820 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f851c00a9e0 tx=0x7f851c00acf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=370643599c47001c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:04.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.596+0000 7f852affd700 1 -- 172.21.15.40:0/858981858 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c00cb70 con 0x7f852c09d450 2023-09-30T22:26:04.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.596+0000 7f852affd700 1 -- 172.21.15.40:0/858981858 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851c00ccd0 con 0x7f852c09d450 2023-09-30T22:26:04.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.596+0000 7f852affd700 1 -- 172.21.15.40:0/858981858 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c00f690 con 0x7f852c09d450 2023-09-30T22:26:04.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.596+0000 7f853267a700 1 -- 172.21.15.40:0/858981858 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f852c09d450 msgr2=0x7f852c09d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:04.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.596+0000 7f853267a700 1 --2- 172.21.15.40:0/858981858 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f852c09d450 0x7f852c09d820 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f851c00a9e0 tx=0x7f851c00acf0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.596+0000 7f853267a700 1 -- 172.21.15.40:0/858981858 shutdown_connections 2023-09-30T22:26:04.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.596+0000 7f853267a700 1 --2- 172.21.15.40:0/858981858 >> v2:172.21.15.40:3300/0 conn(0x7f852c130700 0x7f852c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.596+0000 7f853267a700 1 --2- 172.21.15.40:0/858981858 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f852c09d450 0x7f852c09d820 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.596+0000 7f853267a700 1 --2- 172.21.15.40:0/858981858 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f852c09dd60 0x7f852c1301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.597+0000 7f853267a700 1 -- 172.21.15.40:0/858981858 >> 172.21.15.40:0/858981858 conn(0x7f852c0a2a00 msgr2=0x7f852c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:04.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.597+0000 7f853267a700 1 -- 172.21.15.40:0/858981858 shutdown_connections 2023-09-30T22:26:04.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.597+0000 7f853267a700 1 -- 172.21.15.40:0/858981858 wait complete. 2023-09-30T22:26:04.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.598+0000 7f853267a700 1 Processor -- start 2023-09-30T22:26:04.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.598+0000 7f853267a700 1 -- start start 2023-09-30T22:26:04.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.599+0000 7f853267a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f852c09d450 0x7f852c1c4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.599+0000 7f853267a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f852c09dd60 0x7f852c1c4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.599+0000 7f853267a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f852c130700 0x7f852c1c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.599+0000 7f853267a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852c09c5d0 con 0x7f852c09d450 2023-09-30T22:26:04.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.599+0000 7f853267a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f852c120a80 con 0x7f852c09dd60 2023-09-30T22:26:04.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.599+0000 7f853267a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f852c1203c0 con 0x7f852c130700 2023-09-30T22:26:04.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.599+0000 7f852b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f852c09dd60 0x7f852c1c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.599+0000 7f852b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f852c09dd60 0x7f852c1c4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:51890/0 (socket says 172.21.15.40:51890) 2023-09-30T22:26:04.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.599+0000 7f852b7fe700 1 -- 172.21.15.40:0/1708863698 learned_addr learned my addr 172.21.15.40:0/1708863698 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:04.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.599+0000 7f852bfff700 1 --2- 172.21.15.40:0/1708863698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f852c09d450 0x7f852c1c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.599+0000 7f8530c17700 1 --2- 172.21.15.40:0/1708863698 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f852c130700 0x7f852c1c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.599+0000 7f852b7fe700 1 -- 172.21.15.40:0/1708863698 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f852c130700 msgr2=0x7f852c1c4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:04.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.599+0000 7f852b7fe700 1 --2- 172.21.15.40:0/1708863698 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f852c130700 0x7f852c1c4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.599+0000 7f852b7fe700 1 -- 172.21.15.40:0/1708863698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f852c09d450 msgr2=0x7f852c1c4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:04.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.599+0000 7f852b7fe700 1 --2- 172.21.15.40:0/1708863698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f852c09d450 0x7f852c1c4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.599+0000 7f852b7fe700 1 -- 172.21.15.40:0/1708863698 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85200094a0 con 0x7f852c09dd60 2023-09-30T22:26:04.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.599+0000 7f852bfff700 1 --2- 172.21.15.40:0/1708863698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f852c09d450 0x7f852c1c4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:04.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.599+0000 7f8530c17700 1 --2- 172.21.15.40:0/1708863698 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f852c130700 0x7f852c1c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:04.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.599+0000 7f852b7fe700 1 --2- 172.21.15.40:0/1708863698 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f852c09dd60 0x7f852c1c4570 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f852000ebb0 tx=0x7f852000eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:04.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.599+0000 7f8528ff9700 1 -- 172.21.15.40:0/1708863698 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852000c850 con 0x7f852c09dd60 2023-09-30T22:26:04.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.600+0000 7f8528ff9700 1 -- 172.21.15.40:0/1708863698 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852000c9b0 con 0x7f852c09dd60 2023-09-30T22:26:04.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.600+0000 7f853267a700 1 -- 172.21.15.40:0/1708863698 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8524009b30 con 0x7f852c09dd60 2023-09-30T22:26:04.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.600+0000 7f8528ff9700 1 -- 172.21.15.40:0/1708863698 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852000cd40 con 0x7f852c09dd60 2023-09-30T22:26:04.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.600+0000 7f853267a700 1 -- 172.21.15.40:0/1708863698 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f851c00a640 con 0x7f852c09dd60 2023-09-30T22:26:04.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.600+0000 7f8528ff9700 1 -- 172.21.15.40:0/1708863698 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8520013470 con 0x7f852c09dd60 2023-09-30T22:26:04.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.600+0000 7f8528ff9700 1 -- 172.21.15.40:0/1708863698 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f852003f8c0 con 0x7f852c09dd60 2023-09-30T22:26:04.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.601+0000 7f853267a700 1 -- 172.21.15.40:0/1708863698 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f852c1216e0 con 0x7f852c09dd60 2023-09-30T22:26:04.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.606+0000 7f8528ff9700 1 -- 172.21.15.40:0/1708863698 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8520017080 con 0x7f852c09dd60 2023-09-30T22:26:04.658 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:04.743 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:04.763 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:04.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.785+0000 7fb95b545700 1 Processor -- start 2023-09-30T22:26:04.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.786+0000 7fb95b545700 1 -- start start 2023-09-30T22:26:04.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.786+0000 7fb95b545700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb954133e00 0x7fb9541341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.786+0000 7fb95b545700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb95409d400 0x7fb95409d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.786+0000 7fb95b545700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb954133940 con 0x7fb95409dd70 2023-09-30T22:26:04.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.786+0000 7fb95b545700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb95409f0d0 con 0x7fb954133e00 2023-09-30T22:26:04.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.786+0000 7fb95b545700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb954133be0 con 0x7fb95409d400 2023-09-30T22:26:04.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.786+0000 7fb958ae0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb95409d400 0x7fb95409d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.786+0000 7fb958ae0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb95409d400 0x7fb95409d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:51902/0 (socket says 172.21.15.40:51902) 2023-09-30T22:26:04.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.786+0000 7fb958ae0700 1 -- 172.21.15.40:0/829952918 learned_addr learned my addr 172.21.15.40:0/829952918 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:04.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.786+0000 7fb9592e1700 1 --2- 172.21.15.40:0/829952918 >> v2:172.21.15.40:3300/0 conn(0x7fb954133e00 0x7fb9541341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.787+0000 7fb9592e1700 1 -- 172.21.15.40:0/829952918 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb95409d400 msgr2=0x7fb95409d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:04.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.787+0000 7fb9592e1700 1 --2- 172.21.15.40:0/829952918 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb95409d400 0x7fb95409d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.787+0000 7fb9592e1700 1 -- 172.21.15.40:0/829952918 >> v1:172.21.15.40:6789/0 conn(0x7fb95409dd70 legacy=0x7fb95413ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:04.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.787+0000 7fb9592e1700 1 -- 172.21.15.40:0/829952918 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb95409a860 con 0x7fb954133e00 2023-09-30T22:26:04.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.787+0000 7fb958ae0700 1 --2- 172.21.15.40:0/829952918 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb95409d400 0x7fb95409d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:04.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.787+0000 7fb9592e1700 1 --2- 172.21.15.40:0/829952918 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb954133e00 0x7fb9541341d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb950009840 tx=0x7fb950009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df47d52fccdea565 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:04.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.787+0000 7fb94bfff700 1 -- 172.21.15.40:0/829952918 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb950011830 con 0x7fb954133e00 2023-09-30T22:26:04.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.787+0000 7fb94bfff700 1 -- 172.21.15.40:0/829952918 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb950011990 con 0x7fb954133e00 2023-09-30T22:26:04.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.787+0000 7fb94bfff700 1 -- 172.21.15.40:0/829952918 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb950011d20 con 0x7fb954133e00 2023-09-30T22:26:04.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.788+0000 7fb95b545700 1 -- 172.21.15.40:0/829952918 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb954133e00 msgr2=0x7fb9541341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:04.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.788+0000 7fb95b545700 1 --2- 172.21.15.40:0/829952918 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb954133e00 0x7fb9541341d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb950009840 tx=0x7fb950009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:04.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.788+0000 7fb95b545700 1 -- 172.21.15.40:0/829952918 shutdown_connections 2023-09-30T22:26:04.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.788+0000 7fb95b545700 1 --2- 172.21.15.40:0/829952918 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb954133e00 0x7fb9541341d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.788+0000 7fb95b545700 1 --2- 172.21.15.40:0/829952918 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb95409d400 0x7fb95409d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.788+0000 7fb95b545700 1 -- 172.21.15.40:0/829952918 >> 172.21.15.40:0/829952918 conn(0x7fb9540a2a00 msgr2=0x7fb9540a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:04.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.789+0000 7fb95b545700 1 -- 172.21.15.40:0/829952918 shutdown_connections 2023-09-30T22:26:04.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.789+0000 7fb95b545700 1 -- 172.21.15.40:0/829952918 wait complete. 2023-09-30T22:26:04.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.790+0000 7fb95b545700 1 Processor -- start 2023-09-30T22:26:04.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.790+0000 7fb95b545700 1 -- start start 2023-09-30T22:26:04.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.791+0000 7fb95b545700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb95409d400 0x7fb95411cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.791+0000 7fb95b545700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb95409dd70 0x7fb95411d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.791+0000 7fb95b545700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb954133e00 0x7fb95411d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.791+0000 7fb95b545700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb954120830 con 0x7fb95409dd70 2023-09-30T22:26:04.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.791+0000 7fb95b545700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9540a0140 con 0x7fb95409d400 2023-09-30T22:26:04.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.791+0000 7fb95b545700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb95411e9c0 con 0x7fb954133e00 2023-09-30T22:26:04.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.791+0000 7fb9592e1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb95409d400 0x7fb95411cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.791+0000 7fb9592e1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb95409d400 0x7fb95411cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:51916/0 (socket says 172.21.15.40:51916) 2023-09-30T22:26:04.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.791+0000 7fb9592e1700 1 -- 172.21.15.40:0/3223131049 learned_addr learned my addr 172.21.15.40:0/3223131049 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:04.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.791+0000 7fb958ae0700 1 --2- 172.21.15.40:0/3223131049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb95409dd70 0x7fb95411d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.791+0000 7fb959ae2700 1 --2- 172.21.15.40:0/3223131049 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb954133e00 0x7fb95411d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.791+0000 7fb9592e1700 1 -- 172.21.15.40:0/3223131049 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb954133e00 msgr2=0x7fb95411d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:04.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.791+0000 7fb9592e1700 1 --2- 172.21.15.40:0/3223131049 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb954133e00 0x7fb95411d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.791+0000 7fb9592e1700 1 -- 172.21.15.40:0/3223131049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb95409dd70 msgr2=0x7fb95411d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:04.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.791+0000 7fb9592e1700 1 --2- 172.21.15.40:0/3223131049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb95409dd70 0x7fb95411d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.791+0000 7fb9592e1700 1 -- 172.21.15.40:0/3223131049 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb944009550 con 0x7fb95409d400 2023-09-30T22:26:04.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.792+0000 7fb9592e1700 1 --2- 172.21.15.40:0/3223131049 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb95409d400 0x7fb95411cdf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb950009fd0 tx=0x7fb950004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:04.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.792+0000 7fb949ffb700 1 -- 172.21.15.40:0/3223131049 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb950004480 con 0x7fb95409d400 2023-09-30T22:26:04.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.792+0000 7fb95b545700 1 -- 172.21.15.40:0/3223131049 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9500094a0 con 0x7fb95409d400 2023-09-30T22:26:04.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.792+0000 7fb95b545700 1 -- 172.21.15.40:0/3223131049 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb95412e0b0 con 0x7fb95409d400 2023-09-30T22:26:04.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.792+0000 7fb949ffb700 1 -- 172.21.15.40:0/3223131049 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95001f070 con 0x7fb95409d400 2023-09-30T22:26:04.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.792+0000 7fb949ffb700 1 -- 172.21.15.40:0/3223131049 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9500038a0 con 0x7fb95409d400 2023-09-30T22:26:04.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.793+0000 7fb949ffb700 1 -- 172.21.15.40:0/3223131049 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb950021030 con 0x7fb95409d400 2023-09-30T22:26:04.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.793+0000 7fb949ffb700 1 -- 172.21.15.40:0/3223131049 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb9500409e0 con 0x7fb95409d400 2023-09-30T22:26:04.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.793+0000 7fb95b545700 1 -- 172.21.15.40:0/3223131049 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9340052e0 con 0x7fb95409d400 2023-09-30T22:26:04.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.799+0000 7fb949ffb700 1 -- 172.21.15.40:0/3223131049 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb950015080 con 0x7fb95409d400 2023-09-30T22:26:04.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.810+0000 7f853267a700 1 -- 172.21.15.40:0/1708863698 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f852c062380 con 0x7f852c09dd60 2023-09-30T22:26:04.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.810+0000 7f8528ff9700 1 -- 172.21.15.40:0/1708863698 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f85200232f0 con 0x7f852c09dd60 2023-09-30T22:26:04.811 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:04.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.813+0000 7f853267a700 1 -- 172.21.15.40:0/1708863698 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f852c09dd60 msgr2=0x7f852c1c4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:04.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.813+0000 7f853267a700 1 --2- 172.21.15.40:0/1708863698 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f852c09dd60 0x7f852c1c4570 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f852000ebb0 tx=0x7f852000eec0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.814+0000 7f853267a700 1 -- 172.21.15.40:0/1708863698 shutdown_connections 2023-09-30T22:26:04.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.814+0000 7f853267a700 1 --2- 172.21.15.40:0/1708863698 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f852c130700 0x7f852c1c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.814+0000 7f853267a700 1 --2- 172.21.15.40:0/1708863698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f852c09d450 0x7f852c1c4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.814+0000 7f853267a700 1 --2- 172.21.15.40:0/1708863698 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f852c09dd60 0x7f852c1c4570 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.814+0000 7f853267a700 1 -- 172.21.15.40:0/1708863698 >> 172.21.15.40:0/1708863698 conn(0x7f852c0a2a00 msgr2=0x7f852c0a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:04.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.814+0000 7f853267a700 1 -- 172.21.15.40:0/1708863698 shutdown_connections 2023-09-30T22:26:04.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.814+0000 7f853267a700 1 -- 172.21.15.40:0/1708863698 wait complete. 2023-09-30T22:26:04.828 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:04.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.877+0000 7ff6477e6700 1 Processor -- start 2023-09-30T22:26:04.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.877+0000 7ff6477e6700 1 -- start start 2023-09-30T22:26:04.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.878+0000 7ff6477e6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff64009fbb0 0x7ff64006c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.878+0000 7ff6477e6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff64006ced0 0x7ff64006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.878+0000 7ff6477e6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff64006d800 con 0x7ff640138370 2023-09-30T22:26:04.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.878+0000 7ff6477e6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff64009ff80 con 0x7ff64006ced0 2023-09-30T22:26:04.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.878+0000 7ff6477e6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff64006da80 con 0x7ff64009fbb0 2023-09-30T22:26:04.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.878+0000 7ff644d81700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff64006ced0 0x7ff64006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.878+0000 7ff644d81700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff64006ced0 0x7ff64006d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36804/0 (socket says 172.21.15.40:36804) 2023-09-30T22:26:04.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.878+0000 7ff644d81700 1 -- 172.21.15.40:0/3282942452 learned_addr learned my addr 172.21.15.40:0/3282942452 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:04.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.878+0000 7ff645582700 1 --2- 172.21.15.40:0/3282942452 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff64009fbb0 0x7ff64006c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.878+0000 7ff644d81700 1 -- 172.21.15.40:0/3282942452 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff64009fbb0 msgr2=0x7ff64006c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:04.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.878+0000 7ff644d81700 1 --2- 172.21.15.40:0/3282942452 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff64009fbb0 0x7ff64006c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.878+0000 7ff644d81700 1 -- 172.21.15.40:0/3282942452 >> v1:172.21.15.40:6789/0 conn(0x7ff640138370 legacy=0x7ff64013a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:04.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.878+0000 7ff644d81700 1 -- 172.21.15.40:0/3282942452 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6400a0590 con 0x7ff64006ced0 2023-09-30T22:26:04.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.878+0000 7ff644d81700 1 --2- 172.21.15.40:0/3282942452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff64006ced0 0x7ff64006d2c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff6300098f0 tx=0x7ff630009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d656e220ead7ace3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:04.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.878+0000 7ff637fff700 1 -- 172.21.15.40:0/3282942452 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63000b8a0 con 0x7ff64006ced0 2023-09-30T22:26:04.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.879+0000 7ff637fff700 1 -- 172.21.15.40:0/3282942452 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63000ba00 con 0x7ff64006ced0 2023-09-30T22:26:04.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.879+0000 7ff637fff700 1 -- 172.21.15.40:0/3282942452 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63000bd90 con 0x7ff64006ced0 2023-09-30T22:26:04.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.879+0000 7ff6477e6700 1 -- 172.21.15.40:0/3282942452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff64006ced0 msgr2=0x7ff64006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:04.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.879+0000 7ff6477e6700 1 --2- 172.21.15.40:0/3282942452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff64006ced0 0x7ff64006d2c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff6300098f0 tx=0x7ff630009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:04.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.879+0000 7ff6477e6700 1 -- 172.21.15.40:0/3282942452 shutdown_connections 2023-09-30T22:26:04.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.879+0000 7ff6477e6700 1 --2- 172.21.15.40:0/3282942452 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff64009fbb0 0x7ff64006c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.879+0000 7ff6477e6700 1 --2- 172.21.15.40:0/3282942452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff64006ced0 0x7ff64006d2c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.879+0000 7ff6477e6700 1 -- 172.21.15.40:0/3282942452 >> 172.21.15.40:0/3282942452 conn(0x7ff6400a41a0 msgr2=0x7ff6400a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:04.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.879+0000 7ff6477e6700 1 -- 172.21.15.40:0/3282942452 shutdown_connections 2023-09-30T22:26:04.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.879+0000 7ff6477e6700 1 -- 172.21.15.40:0/3282942452 wait complete. 2023-09-30T22:26:04.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.880+0000 7ff6477e6700 1 Processor -- start 2023-09-30T22:26:04.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.880+0000 7ff6477e6700 1 -- start start 2023-09-30T22:26:04.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.881+0000 7ff6477e6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff64006ced0 0x7ff640091350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.881+0000 7ff6477e6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff64009fbb0 0x7ff640091890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.881+0000 7ff6477e6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff640138370 0x7ff6401c8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.881+0000 7ff6477e6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff640092ca0 con 0x7ff640138370 2023-09-30T22:26:04.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.881+0000 7ff6477e6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff640094070 con 0x7ff64006ced0 2023-09-30T22:26:04.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.881+0000 7ff6477e6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff640090dd0 con 0x7ff64009fbb0 2023-09-30T22:26:04.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.881+0000 7ff645582700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff64006ced0 0x7ff640091350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.881+0000 7ff645d83700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff640138370 0x7ff6401c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.881+0000 7ff645582700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff64006ced0 0x7ff640091350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:51932/0 (socket says 172.21.15.40:51932) 2023-09-30T22:26:04.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.881+0000 7ff645d83700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff640138370 0x7ff6401c8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36812/0 (socket says 172.21.15.40:36812) 2023-09-30T22:26:04.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.881+0000 7ff645582700 1 -- 172.21.15.40:0/48508658 learned_addr learned my addr 172.21.15.40:0/48508658 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:04.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.881+0000 7ff644d81700 1 --2- 172.21.15.40:0/48508658 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff64009fbb0 0x7ff640091890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.881+0000 7ff645d83700 1 -- 172.21.15.40:0/48508658 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff64009fbb0 msgr2=0x7ff640091890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:04.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.881+0000 7ff645d83700 1 --2- 172.21.15.40:0/48508658 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff64009fbb0 0x7ff640091890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.881+0000 7ff645d83700 1 -- 172.21.15.40:0/48508658 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff64006ced0 msgr2=0x7ff640091350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:04.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.881+0000 7ff645d83700 1 --2- 172.21.15.40:0/48508658 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff64006ced0 0x7ff640091350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.881+0000 7ff645d83700 1 -- 172.21.15.40:0/48508658 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff630009550 con 0x7ff640138370 2023-09-30T22:26:04.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.882+0000 7ff645d83700 1 --2- 172.21.15.40:0/48508658 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff640138370 0x7ff6401c8670 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff6400683c0 tx=0x7ff63800ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:04.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.882+0000 7ff635ffb700 1 -- 172.21.15.40:0/48508658 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff638003c00 con 0x7ff640138370 2023-09-30T22:26:04.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.882+0000 7ff635ffb700 1 -- 172.21.15.40:0/48508658 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff638003d60 con 0x7ff640138370 2023-09-30T22:26:04.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.882+0000 7ff6477e6700 1 -- 172.21.15.40:0/48508658 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6400a07f0 con 0x7ff640138370 2023-09-30T22:26:04.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.882+0000 7ff635ffb700 1 -- 172.21.15.40:0/48508658 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63800a990 con 0x7ff640138370 2023-09-30T22:26:04.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.882+0000 7ff6477e6700 1 -- 172.21.15.40:0/48508658 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff640071eb0 con 0x7ff640138370 2023-09-30T22:26:04.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.883+0000 7ff635ffb700 1 -- 172.21.15.40:0/48508658 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff63800aaf0 con 0x7ff640138370 2023-09-30T22:26:04.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.883+0000 7ff6477e6700 1 -- 172.21.15.40:0/48508658 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff640062380 con 0x7ff640138370 2023-09-30T22:26:04.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.883+0000 7ff635ffb700 1 -- 172.21.15.40:0/48508658 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff63803f440 con 0x7ff640138370 2023-09-30T22:26:04.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.892+0000 7ff635ffb700 1 -- 172.21.15.40:0/48508658 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff638019710 con 0x7ff640138370 2023-09-30T22:26:04.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.922+0000 7f9fbec16700 1 Processor -- start 2023-09-30T22:26:04.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.922+0000 7f9fbec16700 1 -- start start 2023-09-30T22:26:04.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.923+0000 7f9fbec16700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9fb809c890 0x7f9fb809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.923+0000 7f9fbec16700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9fb809e480 0x7f9fb813bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.923+0000 7f9fbec16700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fb80a2600 con 0x7f9fb809d920 2023-09-30T22:26:04.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.923+0000 7f9fbec16700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fb80a29d0 con 0x7f9fb809c890 2023-09-30T22:26:04.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.923+0000 7f9fbec16700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb809fb40 con 0x7f9fb809e480 2023-09-30T22:26:04.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.923+0000 7f9fbc9b2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9fb809c890 0x7f9fb809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.923+0000 7f9fbc9b2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9fb809c890 0x7f9fb809cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36814/0 (socket says 172.21.15.40:36814) 2023-09-30T22:26:04.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.923+0000 7f9fbc9b2700 1 -- 172.21.15.40:0/3993560791 learned_addr learned my addr 172.21.15.40:0/3993560791 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:04.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.923+0000 7f9fbc9b2700 1 -- 172.21.15.40:0/3993560791 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9fb809e480 msgr2=0x7f9fb813bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:04.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.923+0000 7f9fbc9b2700 1 --2- 172.21.15.40:0/3993560791 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9fb809e480 0x7f9fb813bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.923+0000 7f9fbc9b2700 1 -- 172.21.15.40:0/3993560791 >> v1:172.21.15.40:6789/0 conn(0x7f9fb809d920 legacy=0x7f9fb809dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:04.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.923+0000 7f9fbc9b2700 1 -- 172.21.15.40:0/3993560791 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb809fed0 con 0x7f9fb809c890 2023-09-30T22:26:04.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.923+0000 7f9fbc9b2700 1 --2- 172.21.15.40:0/3993560791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fb809c890 0x7f9fb809cc60 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9fac006fd0 tx=0x7f9fac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8910eb87476c8229 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:04.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.924+0000 7f9fb77fe700 1 -- 172.21.15.40:0/3993560791 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac005e30 con 0x7f9fb809c890 2023-09-30T22:26:04.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.924+0000 7f9fb77fe700 1 -- 172.21.15.40:0/3993560791 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fac004030 con 0x7f9fb809c890 2023-09-30T22:26:04.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.924+0000 7f9fb77fe700 1 -- 172.21.15.40:0/3993560791 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac0043e0 con 0x7f9fb809c890 2023-09-30T22:26:04.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.924+0000 7f9fbec16700 1 -- 172.21.15.40:0/3993560791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fb809c890 msgr2=0x7f9fb809cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:04.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.924+0000 7f9fbec16700 1 --2- 172.21.15.40:0/3993560791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fb809c890 0x7f9fb809cc60 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9fac006fd0 tx=0x7f9fac009bd0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.924+0000 7f9fbec16700 1 -- 172.21.15.40:0/3993560791 shutdown_connections 2023-09-30T22:26:04.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.924+0000 7f9fbec16700 1 --2- 172.21.15.40:0/3993560791 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9fb809e480 0x7f9fb813bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.924+0000 7f9fbec16700 1 --2- 172.21.15.40:0/3993560791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fb809c890 0x7f9fb809cc60 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.924+0000 7f9fbec16700 1 -- 172.21.15.40:0/3993560791 >> 172.21.15.40:0/3993560791 conn(0x7f9fb80a7080 msgr2=0x7f9fb80a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:04.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.924+0000 7f9fbec16700 1 -- 172.21.15.40:0/3993560791 shutdown_connections 2023-09-30T22:26:04.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.924+0000 7f9fbec16700 1 -- 172.21.15.40:0/3993560791 wait complete. 2023-09-30T22:26:04.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.925+0000 7f9fbec16700 1 Processor -- start 2023-09-30T22:26:04.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.925+0000 7f9fbec16700 1 -- start start 2023-09-30T22:26:04.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.926+0000 7f9fbec16700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9fb809c890 0x7f9fb81c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.926+0000 7f9fbec16700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fb809d920 0x7f9fb81c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.926+0000 7f9fbec16700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9fb809e480 0x7f9fb812d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.926+0000 7f9fbec16700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb8130a20 con 0x7f9fb809d920 2023-09-30T22:26:04.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.926+0000 7f9fbec16700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb809bd00 con 0x7f9fb809c890 2023-09-30T22:26:04.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.926+0000 7f9fbec16700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb8130ce0 con 0x7f9fb809e480 2023-09-30T22:26:04.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.926+0000 7f9fb7fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fb809d920 0x7f9fb81c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.926+0000 7f9fb7fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fb809d920 0x7f9fb81c9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36822/0 (socket says 172.21.15.40:36822) 2023-09-30T22:26:04.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.926+0000 7f9fb7fff700 1 -- 172.21.15.40:0/4127873283 learned_addr learned my addr 172.21.15.40:0/4127873283 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:04.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.926+0000 7f9fbc9b2700 1 --2- 172.21.15.40:0/4127873283 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9fb809c890 0x7f9fb81c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.926+0000 7f9fbd1b3700 1 --2- 172.21.15.40:0/4127873283 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9fb809e480 0x7f9fb812d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.926+0000 7f9fb7fff700 1 -- 172.21.15.40:0/4127873283 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9fb809e480 msgr2=0x7f9fb812d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:04.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.926+0000 7f9fb7fff700 1 --2- 172.21.15.40:0/4127873283 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9fb809e480 0x7f9fb812d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.926+0000 7f9fb7fff700 1 -- 172.21.15.40:0/4127873283 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9fb809c890 msgr2=0x7f9fb81c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:04.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.926+0000 7f9fb7fff700 1 --2- 172.21.15.40:0/4127873283 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9fb809c890 0x7f9fb81c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.926+0000 7f9fb7fff700 1 -- 172.21.15.40:0/4127873283 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fac009500 con 0x7f9fb809d920 2023-09-30T22:26:04.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.926+0000 7f9fbd1b3700 1 --2- 172.21.15.40:0/4127873283 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9fb809e480 0x7f9fb812d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:04.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.926+0000 7f9fb7fff700 1 --2- 172.21.15.40:0/4127873283 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fb809d920 0x7f9fb81c9190 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9fa400c4e0 tx=0x7f9fa400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:04.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.927+0000 7f9fb57fa700 1 -- 172.21.15.40:0/4127873283 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa40052d0 con 0x7f9fb809d920 2023-09-30T22:26:04.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.927+0000 7f9fb57fa700 1 -- 172.21.15.40:0/4127873283 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa4005430 con 0x7f9fb809d920 2023-09-30T22:26:04.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.927+0000 7f9fb57fa700 1 -- 172.21.15.40:0/4127873283 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa40038c0 con 0x7f9fb809d920 2023-09-30T22:26:04.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.927+0000 7f9fbec16700 1 -- 172.21.15.40:0/4127873283 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fb812f650 con 0x7f9fb809d920 2023-09-30T22:26:04.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.927+0000 7f9fbec16700 1 -- 172.21.15.40:0/4127873283 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb81314c0 con 0x7f9fb809d920 2023-09-30T22:26:04.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.928+0000 7f9fb57fa700 1 -- 172.21.15.40:0/4127873283 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9fa4003a20 con 0x7f9fb809d920 2023-09-30T22:26:04.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.928+0000 7f9fbec16700 1 -- 172.21.15.40:0/4127873283 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb8062380 con 0x7f9fb809d920 2023-09-30T22:26:04.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.928+0000 7f9fb57fa700 1 -- 172.21.15.40:0/4127873283 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9fa403eba0 con 0x7f9fb809d920 2023-09-30T22:26:04.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:04.937+0000 7f9fb57fa700 1 -- 172.21.15.40:0/4127873283 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9fa4018260 con 0x7f9fb809d920 2023-09-30T22:26:05.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.007+0000 7fb95b545700 1 -- 172.21.15.40:0/3223131049 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb934005590 con 0x7fb95409d400 2023-09-30T22:26:05.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.007+0000 7fb949ffb700 1 -- 172.21.15.40:0/3223131049 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb950019590 con 0x7fb95409d400 2023-09-30T22:26:05.008 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:05.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.010+0000 7fb95b545700 1 -- 172.21.15.40:0/3223131049 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb95409d400 msgr2=0x7fb95411cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:05.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.010+0000 7fb95b545700 1 --2- 172.21.15.40:0/3223131049 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb95409d400 0x7fb95411cdf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb950009fd0 tx=0x7fb950004750 comp rx=0 tx=0).stop 2023-09-30T22:26:05.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.010+0000 7fb95b545700 1 -- 172.21.15.40:0/3223131049 shutdown_connections 2023-09-30T22:26:05.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.010+0000 7fb95b545700 1 --2- 172.21.15.40:0/3223131049 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb954133e00 0x7fb95411d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:05.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.010+0000 7fb95b545700 1 --2- 172.21.15.40:0/3223131049 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb95409d400 0x7fb95411cdf0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:05.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.010+0000 7fb95b545700 1 --2- 172.21.15.40:0/3223131049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb95409dd70 0x7fb95411d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:05.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.010+0000 7fb95b545700 1 -- 172.21.15.40:0/3223131049 >> 172.21.15.40:0/3223131049 conn(0x7fb9540a2a00 msgr2=0x7fb9540a0900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:05.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.010+0000 7fb95b545700 1 -- 172.21.15.40:0/3223131049 shutdown_connections 2023-09-30T22:26:05.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.010+0000 7fb95b545700 1 -- 172.21.15.40:0/3223131049 wait complete. 2023-09-30T22:26:05.023 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.093+0000 7ff6477e6700 1 -- 172.21.15.40:0/48508658 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff64006d800 con 0x7ff640138370 2023-09-30T22:26:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.093+0000 7ff635ffb700 1 -- 172.21.15.40:0/48508658 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff64006d800 con 0x7ff640138370 2023-09-30T22:26:05.094 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:05.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.096+0000 7ff6477e6700 1 -- 172.21.15.40:0/48508658 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff640138370 msgr2=0x7ff6401c8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:05.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.096+0000 7ff6477e6700 1 --2- 172.21.15.40:0/48508658 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff640138370 0x7ff6401c8670 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff6400683c0 tx=0x7ff63800ce70 comp rx=0 tx=0).stop 2023-09-30T22:26:05.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.096+0000 7ff6477e6700 1 -- 172.21.15.40:0/48508658 shutdown_connections 2023-09-30T22:26:05.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.096+0000 7ff6477e6700 1 --2- 172.21.15.40:0/48508658 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff640138370 0x7ff6401c8670 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:05.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.096+0000 7ff6477e6700 1 --2- 172.21.15.40:0/48508658 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff64006ced0 0x7ff640091350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:05.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.096+0000 7ff6477e6700 1 --2- 172.21.15.40:0/48508658 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff64009fbb0 0x7ff640091890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:05.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.096+0000 7ff6477e6700 1 -- 172.21.15.40:0/48508658 >> 172.21.15.40:0/48508658 conn(0x7ff6400a41a0 msgr2=0x7ff640137590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:05.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.096+0000 7ff6477e6700 1 -- 172.21.15.40:0/48508658 shutdown_connections 2023-09-30T22:26:05.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.096+0000 7ff6477e6700 1 -- 172.21.15.40:0/48508658 wait complete. 2023-09-30T22:26:05.109 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:05.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.133+0000 7f9fbec16700 1 -- 172.21.15.40:0/4127873283 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9fb8074620 con 0x7f9fb809d920 2023-09-30T22:26:05.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.133+0000 7f9fb57fa700 1 -- 172.21.15.40:0/4127873283 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9fa4017030 con 0x7f9fb809d920 2023-09-30T22:26:05.133 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:05.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.135+0000 7f9fbec16700 1 -- 172.21.15.40:0/4127873283 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fb809d920 msgr2=0x7f9fb81c9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:05.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.135+0000 7f9fbec16700 1 --2- 172.21.15.40:0/4127873283 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fb809d920 0x7f9fb81c9190 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9fa400c4e0 tx=0x7f9fa400c7f0 comp rx=0 tx=0).stop 2023-09-30T22:26:05.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.135+0000 7f9fbec16700 1 -- 172.21.15.40:0/4127873283 shutdown_connections 2023-09-30T22:26:05.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.135+0000 7f9fbec16700 1 --2- 172.21.15.40:0/4127873283 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9fb809e480 0x7f9fb812d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:05.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.135+0000 7f9fbec16700 1 --2- 172.21.15.40:0/4127873283 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9fb809c890 0x7f9fb81c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:05.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.135+0000 7f9fbec16700 1 --2- 172.21.15.40:0/4127873283 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fb809d920 0x7f9fb81c9190 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:05.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.135+0000 7f9fbec16700 1 -- 172.21.15.40:0/4127873283 >> 172.21.15.40:0/4127873283 conn(0x7f9fb80a7080 msgr2=0x7f9fb80a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:05.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.135+0000 7f9fbec16700 1 -- 172.21.15.40:0/4127873283 shutdown_connections 2023-09-30T22:26:05.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.135+0000 7f9fbec16700 1 -- 172.21.15.40:0/4127873283 wait complete. 2023-09-30T22:26:05.147 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:05.829 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:05.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.968+0000 7f1d9c362700 1 Processor -- start 2023-09-30T22:26:05.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.968+0000 7f1d9c362700 1 -- start start 2023-09-30T22:26:05.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.969+0000 7f1d9c362700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d9409d920 0x7f1d9409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:05.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.969+0000 7f1d9c362700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1d94130fb0 0x7f1d94138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:05.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.969+0000 7f1d9c362700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d9409adf0 con 0x7f1d9409e230 2023-09-30T22:26:05.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.969+0000 7f1d9c362700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d9409edf0 con 0x7f1d94130fb0 2023-09-30T22:26:05.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.969+0000 7f1d9c362700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9409b660 con 0x7f1d9409d920 2023-09-30T22:26:05.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.969+0000 7f1d9a0fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d9409d920 0x7f1d9409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:05.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.969+0000 7f1d9a0fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d9409d920 0x7f1d9409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41532/0 (socket says 172.21.15.40:41532) 2023-09-30T22:26:05.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.969+0000 7f1d9a0fe700 1 -- 172.21.15.40:0/1443414048 learned_addr learned my addr 172.21.15.40:0/1443414048 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:05.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.969+0000 7f1d9a8ff700 1 --2- 172.21.15.40:0/1443414048 >> v2:172.21.15.40:3300/0 conn(0x7f1d94130fb0 0x7f1d94138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:05.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.969+0000 7f1d9a0fe700 1 -- 172.21.15.40:0/1443414048 >> v2:172.21.15.40:3300/0 conn(0x7f1d94130fb0 msgr2=0x7f1d94138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:05.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.969+0000 7f1d9a0fe700 1 --2- 172.21.15.40:0/1443414048 >> v2:172.21.15.40:3300/0 conn(0x7f1d94130fb0 0x7f1d94138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:05.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.969+0000 7f1d9a0fe700 1 -- 172.21.15.40:0/1443414048 >> v1:172.21.15.40:6789/0 conn(0x7f1d9409e230 legacy=0x7f1d941308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:05.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.969+0000 7f1d9a0fe700 1 -- 172.21.15.40:0/1443414048 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d9409a6e0 con 0x7f1d9409d920 2023-09-30T22:26:05.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.969+0000 7f1d9a8ff700 1 --2- 172.21.15.40:0/1443414048 >> v2:172.21.15.40:3300/0 conn(0x7f1d94130fb0 0x7f1d94138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:05.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.969+0000 7f1d9a0fe700 1 --2- 172.21.15.40:0/1443414048 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d9409d920 0x7f1d9409dcf0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1d90006fd0 tx=0x7f1d90009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13555f09464faabb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:05.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.969+0000 7f1d990fc700 1 -- 172.21.15.40:0/1443414048 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d90005e30 con 0x7f1d9409d920 2023-09-30T22:26:05.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.969+0000 7f1d990fc700 1 -- 172.21.15.40:0/1443414048 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d90004030 con 0x7f1d9409d920 2023-09-30T22:26:05.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.969+0000 7f1d990fc700 1 -- 172.21.15.40:0/1443414048 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d900043e0 con 0x7f1d9409d920 2023-09-30T22:26:05.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.970+0000 7f1d9c362700 1 -- 172.21.15.40:0/1443414048 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d9409d920 msgr2=0x7f1d9409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:05.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.970+0000 7f1d9c362700 1 --2- 172.21.15.40:0/1443414048 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d9409d920 0x7f1d9409dcf0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1d90006fd0 tx=0x7f1d90009bd0 comp rx=0 tx=0).stop 2023-09-30T22:26:05.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.970+0000 7f1d9c362700 1 -- 172.21.15.40:0/1443414048 shutdown_connections 2023-09-30T22:26:05.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.970+0000 7f1d9c362700 1 --2- 172.21.15.40:0/1443414048 >> v2:172.21.15.40:3300/0 conn(0x7f1d94130fb0 0x7f1d94138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:05.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.970+0000 7f1d9c362700 1 --2- 172.21.15.40:0/1443414048 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d9409d920 0x7f1d9409dcf0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:05.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.970+0000 7f1d9c362700 1 -- 172.21.15.40:0/1443414048 >> 172.21.15.40:0/1443414048 conn(0x7f1d9409fb20 msgr2=0x7f1d9409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:05.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.970+0000 7f1d9c362700 1 -- 172.21.15.40:0/1443414048 shutdown_connections 2023-09-30T22:26:05.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.970+0000 7f1d9c362700 1 -- 172.21.15.40:0/1443414048 wait complete. 2023-09-30T22:26:05.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.971+0000 7f1d9c362700 1 Processor -- start 2023-09-30T22:26:05.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.971+0000 7f1d9c362700 1 -- start start 2023-09-30T22:26:05.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.972+0000 7f1d9c362700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d9409d920 0x7f1d94121510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:05.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.972+0000 7f1d9c362700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d9409e230 0x7f1d94121a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:05.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.972+0000 7f1d9c362700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d94130fb0 0x7f1d94121f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:05.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.972+0000 7f1d9c362700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9406b370 con 0x7f1d9409e230 2023-09-30T22:26:05.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.972+0000 7f1d9c362700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9409cb00 con 0x7f1d9409d920 2023-09-30T22:26:05.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.972+0000 7f1d9c362700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d94124730 con 0x7f1d94130fb0 2023-09-30T22:26:05.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.972+0000 7f1d9a0fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d9409d920 0x7f1d94121510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:05.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.972+0000 7f1d9a8ff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d94130fb0 0x7f1d94121f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:05.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.972+0000 7f1d9a0fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d9409d920 0x7f1d94121510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:51964/0 (socket says 172.21.15.40:51964) 2023-09-30T22:26:05.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.972+0000 7f1d9a0fe700 1 -- 172.21.15.40:0/721844198 learned_addr learned my addr 172.21.15.40:0/721844198 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:05.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.972+0000 7f1d998fd700 1 --2- 172.21.15.40:0/721844198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d9409e230 0x7f1d94121a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:05.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.972+0000 7f1d9a0fe700 1 -- 172.21.15.40:0/721844198 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d94130fb0 msgr2=0x7f1d94121f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:05.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.972+0000 7f1d9a0fe700 1 --2- 172.21.15.40:0/721844198 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d94130fb0 0x7f1d94121f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:05.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.973+0000 7f1d9a0fe700 1 -- 172.21.15.40:0/721844198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d9409e230 msgr2=0x7f1d94121a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:05.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.973+0000 7f1d9a0fe700 1 --2- 172.21.15.40:0/721844198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d9409e230 0x7f1d94121a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:05.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.973+0000 7f1d9a0fe700 1 -- 172.21.15.40:0/721844198 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8c009a70 con 0x7f1d9409d920 2023-09-30T22:26:05.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.973+0000 7f1d9a8ff700 1 --2- 172.21.15.40:0/721844198 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d94130fb0 0x7f1d94121f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:05.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.973+0000 7f1d9a0fe700 1 --2- 172.21.15.40:0/721844198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d9409d920 0x7f1d94121510 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1d90009130 tx=0x7f1d90004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:05.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.973+0000 7f1d8affd700 1 -- 172.21.15.40:0/721844198 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9001f070 con 0x7f1d9409d920 2023-09-30T22:26:05.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.973+0000 7f1d8affd700 1 -- 172.21.15.40:0/721844198 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d90006b70 con 0x7f1d9409d920 2023-09-30T22:26:05.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.973+0000 7f1d9c362700 1 -- 172.21.15.40:0/721844198 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d90009500 con 0x7f1d9409d920 2023-09-30T22:26:05.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.973+0000 7f1d8affd700 1 -- 172.21.15.40:0/721844198 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9000f8c0 con 0x7f1d9409d920 2023-09-30T22:26:05.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.973+0000 7f1d9c362700 1 -- 172.21.15.40:0/721844198 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d94123840 con 0x7f1d9409d920 2023-09-30T22:26:05.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.974+0000 7f1d8affd700 1 -- 172.21.15.40:0/721844198 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1d9000fa20 con 0x7f1d9409d920 2023-09-30T22:26:05.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.974+0000 7f1d8affd700 1 -- 172.21.15.40:0/721844198 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f1d9003ff80 con 0x7f1d9409d920 2023-09-30T22:26:05.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.974+0000 7f1d9c362700 1 -- 172.21.15.40:0/721844198 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d94062380 con 0x7f1d9409d920 2023-09-30T22:26:05.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:05.978+0000 7f1d8affd700 1 -- 172.21.15.40:0/721844198 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1d90028020 con 0x7f1d9409d920 2023-09-30T22:26:06.023 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:06.110 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:06.148 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:06.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.153+0000 7f5fd89e9700 1 Processor -- start 2023-09-30T22:26:06.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.153+0000 7f5fd89e9700 1 -- start start 2023-09-30T22:26:06.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.154+0000 7f5fd89e9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5fd406f070 0x7f5fd406f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.154+0000 7f5fd89e9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5fd406fdb0 0x7f5fd40977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.154+0000 7f5fd89e9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fd4070830 con 0x7f5fd406f980 2023-09-30T22:26:06.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.154+0000 7f5fd89e9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fd4071af0 con 0x7f5fd406fdb0 2023-09-30T22:26:06.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.154+0000 7f5fd89e9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd4070ad0 con 0x7f5fd406f070 2023-09-30T22:26:06.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.154+0000 7f5fd259c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5fd406f070 0x7f5fd406f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.154+0000 7f5fd2d9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5fd406fdb0 0x7f5fd40977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.154+0000 7f5fd259c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5fd406f070 0x7f5fd406f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41544/0 (socket says 172.21.15.40:41544) 2023-09-30T22:26:06.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.154+0000 7f5fd259c700 1 -- 172.21.15.40:0/2442584284 learned_addr learned my addr 172.21.15.40:0/2442584284 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:06.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.155+0000 7f5fd259c700 1 -- 172.21.15.40:0/2442584284 >> v2:172.21.15.40:3300/0 conn(0x7f5fd406fdb0 msgr2=0x7f5fd40977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:06.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.155+0000 7f5fd259c700 1 --2- 172.21.15.40:0/2442584284 >> v2:172.21.15.40:3300/0 conn(0x7f5fd406fdb0 0x7f5fd40977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.155+0000 7f5fd259c700 1 -- 172.21.15.40:0/2442584284 >> v1:172.21.15.40:6789/0 conn(0x7f5fd406f980 legacy=0x7f5fd4097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:06.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.155+0000 7f5fd259c700 1 -- 172.21.15.40:0/2442584284 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd4070de0 con 0x7f5fd406f070 2023-09-30T22:26:06.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.155+0000 7f5fd259c700 1 --2- 172.21.15.40:0/2442584284 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5fd406f070 0x7f5fd406f440 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4009950 tx=0x7f5fc4009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=648d3c77d6c6506d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:06.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.155+0000 7f5fd159a700 1 -- 172.21.15.40:0/2442584284 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc4011830 con 0x7f5fd406f070 2023-09-30T22:26:06.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.155+0000 7f5fd159a700 1 -- 172.21.15.40:0/2442584284 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc4011990 con 0x7f5fd406f070 2023-09-30T22:26:06.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.155+0000 7f5fd159a700 1 -- 172.21.15.40:0/2442584284 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc4011d40 con 0x7f5fd406f070 2023-09-30T22:26:06.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.156+0000 7f5fd89e9700 1 -- 172.21.15.40:0/2442584284 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5fd406f070 msgr2=0x7f5fd406f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:06.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.156+0000 7f5fd89e9700 1 --2- 172.21.15.40:0/2442584284 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5fd406f070 0x7f5fd406f440 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4009950 tx=0x7f5fc4009c60 comp rx=0 tx=0).stop 2023-09-30T22:26:06.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.156+0000 7f5fd89e9700 1 -- 172.21.15.40:0/2442584284 shutdown_connections 2023-09-30T22:26:06.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.156+0000 7f5fd89e9700 1 --2- 172.21.15.40:0/2442584284 >> v2:172.21.15.40:3300/0 conn(0x7f5fd406fdb0 0x7f5fd40977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.156+0000 7f5fd89e9700 1 --2- 172.21.15.40:0/2442584284 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5fd406f070 0x7f5fd406f440 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.156+0000 7f5fd89e9700 1 -- 172.21.15.40:0/2442584284 >> 172.21.15.40:0/2442584284 conn(0x7f5fd40a41a0 msgr2=0x7f5fd40a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:06.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.156+0000 7f5fd89e9700 1 -- 172.21.15.40:0/2442584284 shutdown_connections 2023-09-30T22:26:06.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.156+0000 7f5fd89e9700 1 -- 172.21.15.40:0/2442584284 wait complete. 2023-09-30T22:26:06.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.158+0000 7f5fd89e9700 1 Processor -- start 2023-09-30T22:26:06.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.158+0000 7f5fd89e9700 1 -- start start 2023-09-30T22:26:06.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.158+0000 7f5fd89e9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5fd406f070 0x7f5fd409c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.159+0000 7f5fd89e9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fd406f980 0x7f5fd409c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.159+0000 7f5fd89e9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5fd406fdb0 0x7f5fd409cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.159+0000 7f5fd89e9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd409dcb0 con 0x7f5fd406f980 2023-09-30T22:26:06.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.159+0000 7f5fd89e9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd412d110 con 0x7f5fd406f070 2023-09-30T22:26:06.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.159+0000 7f5fd89e9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd412d3e0 con 0x7f5fd406fdb0 2023-09-30T22:26:06.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.159+0000 7f5fd2d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5fd406fdb0 0x7f5fd409cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.159+0000 7f5fd2d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5fd406fdb0 0x7f5fd409cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41548/0 (socket says 172.21.15.40:41548) 2023-09-30T22:26:06.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.159+0000 7f5fd2d9d700 1 -- 172.21.15.40:0/2292496557 learned_addr learned my addr 172.21.15.40:0/2292496557 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:06.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.159+0000 7f5fd1d9b700 1 --2- 172.21.15.40:0/2292496557 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fd406f980 0x7f5fd409c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.159+0000 7f5fd259c700 1 --2- 172.21.15.40:0/2292496557 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5fd406f070 0x7f5fd409c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.159+0000 7f5fd259c700 1 -- 172.21.15.40:0/2292496557 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5fd406fdb0 msgr2=0x7f5fd409cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:06.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.159+0000 7f5fd259c700 1 --2- 172.21.15.40:0/2292496557 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5fd406fdb0 0x7f5fd409cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.159+0000 7f5fd259c700 1 -- 172.21.15.40:0/2292496557 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fd406f980 msgr2=0x7f5fd409c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:06.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.159+0000 7f5fd259c700 1 --2- 172.21.15.40:0/2292496557 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fd406f980 0x7f5fd409c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.159+0000 7f5fd259c700 1 -- 172.21.15.40:0/2292496557 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc4009550 con 0x7f5fd406f070 2023-09-30T22:26:06.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.159+0000 7f5fd1d9b700 1 --2- 172.21.15.40:0/2292496557 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fd406f980 0x7f5fd409c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:06.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.160+0000 7f5fd259c700 1 --2- 172.21.15.40:0/2292496557 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5fd406f070 0x7f5fd409c1a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4067a60 tx=0x7f5fc4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:06.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.160+0000 7f5fc2ffd700 1 -- 172.21.15.40:0/2292496557 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc4004590 con 0x7f5fd406f070 2023-09-30T22:26:06.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.160+0000 7f5fc2ffd700 1 -- 172.21.15.40:0/2292496557 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc40036a0 con 0x7f5fd406f070 2023-09-30T22:26:06.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.160+0000 7f5fd89e9700 1 -- 172.21.15.40:0/2292496557 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd412d6a0 con 0x7f5fd406f070 2023-09-30T22:26:06.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.160+0000 7f5fc2ffd700 1 -- 172.21.15.40:0/2292496557 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc4003a30 con 0x7f5fd406f070 2023-09-30T22:26:06.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.160+0000 7f5fd89e9700 1 -- 172.21.15.40:0/2292496557 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fd412c360 con 0x7f5fd406f070 2023-09-30T22:26:06.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.161+0000 7f5fd89e9700 1 -- 172.21.15.40:0/2292496557 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fd4062380 con 0x7f5fd406f070 2023-09-30T22:26:06.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.162+0000 7f5fc2ffd700 1 -- 172.21.15.40:0/2292496557 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5fc4021070 con 0x7f5fd406f070 2023-09-30T22:26:06.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.162+0000 7f5fc2ffd700 1 -- 172.21.15.40:0/2292496557 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5fc4040d50 con 0x7f5fd406f070 2023-09-30T22:26:06.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.167+0000 7f5fc2ffd700 1 -- 172.21.15.40:0/2292496557 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5fc400bc40 con 0x7f5fd406f070 2023-09-30T22:26:06.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.183+0000 7f1d9c362700 1 -- 172.21.15.40:0/721844198 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1d94124960 con 0x7f1d9409d920 2023-09-30T22:26:06.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.183+0000 7f1d8affd700 1 -- 172.21.15.40:0/721844198 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1d9002c430 con 0x7f1d9409d920 2023-09-30T22:26:06.183 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:06.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.186+0000 7f1d9c362700 1 -- 172.21.15.40:0/721844198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d9409d920 msgr2=0x7f1d94121510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:06.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.186+0000 7f1d9c362700 1 --2- 172.21.15.40:0/721844198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d9409d920 0x7f1d94121510 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1d90009130 tx=0x7f1d90004750 comp rx=0 tx=0).stop 2023-09-30T22:26:06.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.190+0000 7f1d9c362700 1 -- 172.21.15.40:0/721844198 shutdown_connections 2023-09-30T22:26:06.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.190+0000 7f1d9c362700 1 --2- 172.21.15.40:0/721844198 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d94130fb0 0x7f1d94121f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.190+0000 7f1d9c362700 1 --2- 172.21.15.40:0/721844198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d9409d920 0x7f1d94121510 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.190+0000 7f1d9c362700 1 --2- 172.21.15.40:0/721844198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d9409e230 0x7f1d94121a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.190+0000 7f1d9c362700 1 -- 172.21.15.40:0/721844198 >> 172.21.15.40:0/721844198 conn(0x7f1d9409fb20 msgr2=0x7f1d94130060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:06.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.190+0000 7f1d9c362700 1 -- 172.21.15.40:0/721844198 shutdown_connections 2023-09-30T22:26:06.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.190+0000 7f1d9c362700 1 -- 172.21.15.40:0/721844198 wait complete. 2023-09-30T22:26:06.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:06.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.247+0000 7f3cea78e700 1 Processor -- start 2023-09-30T22:26:06.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.247+0000 7f3cea78e700 1 -- start start 2023-09-30T22:26:06.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.248+0000 7f3cea78e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3ce409fbb0 0x7f3ce406c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.248+0000 7f3cea78e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ce406d2c0 0x7f3ce413baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.248+0000 7f3cea78e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce40a0590 con 0x7f3ce406ced0 2023-09-30T22:26:06.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.248+0000 7f3cea78e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ce409ff80 con 0x7f3ce409fbb0 2023-09-30T22:26:06.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.248+0000 7f3cea78e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce406da80 con 0x7f3ce406d2c0 2023-09-30T22:26:06.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.248+0000 7f3ce3fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3ce409fbb0 0x7f3ce406c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.248+0000 7f3ce8d2b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ce406d2c0 0x7f3ce413baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.248+0000 7f3ce3fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3ce409fbb0 0x7f3ce406c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36846/0 (socket says 172.21.15.40:36846) 2023-09-30T22:26:06.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.248+0000 7f3ce3fff700 1 -- 172.21.15.40:0/4242495918 learned_addr learned my addr 172.21.15.40:0/4242495918 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:06.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.248+0000 7f3ce3fff700 1 -- 172.21.15.40:0/4242495918 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ce406d2c0 msgr2=0x7f3ce413baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:06.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.248+0000 7f3ce3fff700 1 --2- 172.21.15.40:0/4242495918 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ce406d2c0 0x7f3ce413baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.248+0000 7f3ce3fff700 1 -- 172.21.15.40:0/4242495918 >> v1:172.21.15.40:6789/0 conn(0x7f3ce406ced0 legacy=0x7f3ce4138370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:06.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.248+0000 7f3ce3fff700 1 -- 172.21.15.40:0/4242495918 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce40a0780 con 0x7f3ce409fbb0 2023-09-30T22:26:06.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.248+0000 7f3ce8d2b700 1 --2- 172.21.15.40:0/4242495918 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ce406d2c0 0x7f3ce413baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:06.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.248+0000 7f3ce3fff700 1 --2- 172.21.15.40:0/4242495918 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ce409fbb0 0x7f3ce406c990 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f3cd40098f0 tx=0x7f3cd4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2fca569e5b087f6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:06.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.249+0000 7f3ce2ffd700 1 -- 172.21.15.40:0/4242495918 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4011830 con 0x7f3ce409fbb0 2023-09-30T22:26:06.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.249+0000 7f3ce2ffd700 1 -- 172.21.15.40:0/4242495918 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd4011990 con 0x7f3ce409fbb0 2023-09-30T22:26:06.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.249+0000 7f3ce2ffd700 1 -- 172.21.15.40:0/4242495918 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4011d20 con 0x7f3ce409fbb0 2023-09-30T22:26:06.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.249+0000 7f3cea78e700 1 -- 172.21.15.40:0/4242495918 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ce409fbb0 msgr2=0x7f3ce406c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:06.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.249+0000 7f3cea78e700 1 --2- 172.21.15.40:0/4242495918 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ce409fbb0 0x7f3ce406c990 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f3cd40098f0 tx=0x7f3cd4009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:06.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.249+0000 7f3cea78e700 1 -- 172.21.15.40:0/4242495918 shutdown_connections 2023-09-30T22:26:06.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.249+0000 7f3cea78e700 1 --2- 172.21.15.40:0/4242495918 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ce406d2c0 0x7f3ce413baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.249+0000 7f3cea78e700 1 --2- 172.21.15.40:0/4242495918 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ce409fbb0 0x7f3ce406c990 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.249+0000 7f3cea78e700 1 -- 172.21.15.40:0/4242495918 >> 172.21.15.40:0/4242495918 conn(0x7f3ce40a41a0 msgr2=0x7f3ce40a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:06.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.249+0000 7f3cea78e700 1 -- 172.21.15.40:0/4242495918 shutdown_connections 2023-09-30T22:26:06.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.249+0000 7f3cea78e700 1 -- 172.21.15.40:0/4242495918 wait complete. 2023-09-30T22:26:06.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.251+0000 7f3cea78e700 1 Processor -- start 2023-09-30T22:26:06.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.251+0000 7f3cea78e700 1 -- start start 2023-09-30T22:26:06.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.252+0000 7f3cea78e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ce406ced0 0x7f3ce40962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.252+0000 7f3cea78e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ce406d2c0 0x7f3ce4096820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.252+0000 7f3cea78e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ce409fbb0 0x7f3ce41c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.252+0000 7f3cea78e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce4095000 con 0x7f3ce406d2c0 2023-09-30T22:26:06.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.252+0000 7f3cea78e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce4097230 con 0x7f3ce406ced0 2023-09-30T22:26:06.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.252+0000 7f3cea78e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce40942c0 con 0x7f3ce409fbb0 2023-09-30T22:26:06.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.252+0000 7f3ce3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ce406ced0 0x7f3ce40962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.252+0000 7f3ce37fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ce406d2c0 0x7f3ce4096820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.252+0000 7f3ce3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ce406ced0 0x7f3ce40962e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:51986/0 (socket says 172.21.15.40:51986) 2023-09-30T22:26:06.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.252+0000 7f3ce3fff700 1 -- 172.21.15.40:0/2166987059 learned_addr learned my addr 172.21.15.40:0/2166987059 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:06.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.252+0000 7f3ce8d2b700 1 --2- 172.21.15.40:0/2166987059 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ce409fbb0 0x7f3ce41c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.252+0000 7f3ce3fff700 1 -- 172.21.15.40:0/2166987059 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ce409fbb0 msgr2=0x7f3ce41c8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:06.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.252+0000 7f3ce3fff700 1 --2- 172.21.15.40:0/2166987059 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ce409fbb0 0x7f3ce41c8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.252+0000 7f3ce3fff700 1 -- 172.21.15.40:0/2166987059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ce406d2c0 msgr2=0x7f3ce4096820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:06.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.252+0000 7f3ce3fff700 1 --2- 172.21.15.40:0/2166987059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ce406d2c0 0x7f3ce4096820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.252+0000 7f3ce3fff700 1 -- 172.21.15.40:0/2166987059 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cdc009a70 con 0x7f3ce406ced0 2023-09-30T22:26:06.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.252+0000 7f3ce37fe700 1 --2- 172.21.15.40:0/2166987059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ce406d2c0 0x7f3ce4096820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:06.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.253+0000 7f3ce3fff700 1 --2- 172.21.15.40:0/2166987059 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ce406ced0 0x7f3ce40962e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4000c00 tx=0x7f3cd4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:06.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.253+0000 7f3ce0ff9700 1 -- 172.21.15.40:0/2166987059 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd40043c0 con 0x7f3ce406ced0 2023-09-30T22:26:06.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.253+0000 7f3ce0ff9700 1 -- 172.21.15.40:0/2166987059 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd401f070 con 0x7f3ce406ced0 2023-09-30T22:26:06.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.253+0000 7f3cea78e700 1 -- 172.21.15.40:0/2166987059 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd4009550 con 0x7f3ce406ced0 2023-09-30T22:26:06.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.253+0000 7f3ce0ff9700 1 -- 172.21.15.40:0/2166987059 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd40038c0 con 0x7f3ce406ced0 2023-09-30T22:26:06.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.253+0000 7f3cea78e700 1 -- 172.21.15.40:0/2166987059 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce4093b60 con 0x7f3ce406ced0 2023-09-30T22:26:06.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.254+0000 7f3cea78e700 1 -- 172.21.15.40:0/2166987059 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce409bab0 con 0x7f3ce406ced0 2023-09-30T22:26:06.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.254+0000 7f3ce0ff9700 1 -- 172.21.15.40:0/2166987059 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3cd4021030 con 0x7f3ce406ced0 2023-09-30T22:26:06.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.254+0000 7f3ce0ff9700 1 -- 172.21.15.40:0/2166987059 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3cd4040970 con 0x7f3ce406ced0 2023-09-30T22:26:06.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.263+0000 7f3ce0ff9700 1 -- 172.21.15.40:0/2166987059 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3cd4019960 con 0x7f3ce406ced0 2023-09-30T22:26:06.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.287+0000 7f0c11cfa700 1 Processor -- start 2023-09-30T22:26:06.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.287+0000 7f0c11cfa700 1 -- start start 2023-09-30T22:26:06.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.288+0000 7f0c11cfa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0c0c09d920 0x7f0c0c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.288+0000 7f0c11cfa700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0c0c09f0f0 0x7f0c0c09e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.288+0000 7f0c11cfa700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0c0c133ca0 0x7f0c0c134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.288+0000 7f0c11cfa700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c0c06b4c0 con 0x7f0c0c09f0f0 2023-09-30T22:26:06.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.288+0000 7f0c11cfa700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c09a8f0 con 0x7f0c0c09d920 2023-09-30T22:26:06.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.288+0000 7f0c11cfa700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c09f940 con 0x7f0c0c133ca0 2023-09-30T22:26:06.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.288+0000 7f0c0b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0c0c09d920 0x7f0c0c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.288+0000 7f0c0affd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0c0c09f0f0 0x7f0c0c09e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.288+0000 7f0c0bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0c0c133ca0 0x7f0c0c134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.288+0000 7f0c0b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0c0c09d920 0x7f0c0c09dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:51988/0 (socket says 172.21.15.40:51988) 2023-09-30T22:26:06.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.288+0000 7f0c0affd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0c0c09f0f0 0x7f0c0c09e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36858/0 (socket says 172.21.15.40:36858) 2023-09-30T22:26:06.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.288+0000 7f0c0b7fe700 1 -- 172.21.15.40:0/3933114774 learned_addr learned my addr 172.21.15.40:0/3933114774 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:06.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.289+0000 7f0c0b7fe700 1 -- 172.21.15.40:0/3933114774 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0c0c133ca0 msgr2=0x7f0c0c134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:06.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.289+0000 7f0c0b7fe700 1 --2- 172.21.15.40:0/3933114774 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0c0c133ca0 0x7f0c0c134140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.289+0000 7f0c0b7fe700 1 -- 172.21.15.40:0/3933114774 >> v2:172.21.15.40:3300/0 conn(0x7f0c0c09f0f0 msgr2=0x7f0c0c09e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:06.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.289+0000 7f0c0b7fe700 1 --2- 172.21.15.40:0/3933114774 >> v2:172.21.15.40:3300/0 conn(0x7f0c0c09f0f0 0x7f0c0c09e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.289+0000 7f0c0b7fe700 1 -- 172.21.15.40:0/3933114774 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c0c09f6e0 con 0x7f0c0c09d920 2023-09-30T22:26:06.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.289+0000 7f0c0affd700 1 --2- 172.21.15.40:0/3933114774 >> v2:172.21.15.40:3300/0 conn(0x7f0c0c09f0f0 0x7f0c0c09e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:06.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.289+0000 7f0c0b7fe700 1 --2- 172.21.15.40:0/3933114774 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0c0c09d920 0x7f0c0c09dcf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc009920 tx=0x7f0bfc009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=890f0b37d118fcac server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:06.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.289+0000 7f0c0a7fc700 1 -- 172.21.15.40:0/3933114774 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc005e30 con 0x7f0c0c09d920 2023-09-30T22:26:06.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.289+0000 7f0c0a7fc700 1 -- 172.21.15.40:0/3933114774 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bfc004030 con 0x7f0c0c09d920 2023-09-30T22:26:06.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.289+0000 7f0c0a7fc700 1 -- 172.21.15.40:0/3933114774 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc0043e0 con 0x7f0c0c09d920 2023-09-30T22:26:06.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.289+0000 7f0c11cfa700 1 -- 172.21.15.40:0/3933114774 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0c0c09d920 msgr2=0x7f0c0c09dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:06.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.289+0000 7f0c11cfa700 1 --2- 172.21.15.40:0/3933114774 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0c0c09d920 0x7f0c0c09dcf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc009920 tx=0x7f0bfc009c30 comp rx=0 tx=0).stop 2023-09-30T22:26:06.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.289+0000 7f0c11cfa700 1 -- 172.21.15.40:0/3933114774 shutdown_connections 2023-09-30T22:26:06.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.290+0000 7f0c11cfa700 1 --2- 172.21.15.40:0/3933114774 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0c0c133ca0 0x7f0c0c134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.290+0000 7f0c11cfa700 1 --2- 172.21.15.40:0/3933114774 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0c0c09d920 0x7f0c0c09dcf0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.290+0000 7f0c11cfa700 1 --2- 172.21.15.40:0/3933114774 >> v2:172.21.15.40:3300/0 conn(0x7f0c0c09f0f0 0x7f0c0c09e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.290+0000 7f0c11cfa700 1 -- 172.21.15.40:0/3933114774 >> 172.21.15.40:0/3933114774 conn(0x7f0c0c09fb20 msgr2=0x7f0c0c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:06.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.290+0000 7f0c11cfa700 1 -- 172.21.15.40:0/3933114774 shutdown_connections 2023-09-30T22:26:06.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.290+0000 7f0c11cfa700 1 -- 172.21.15.40:0/3933114774 wait complete. 2023-09-30T22:26:06.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.291+0000 7f0c11cfa700 1 Processor -- start 2023-09-30T22:26:06.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.291+0000 7f0c11cfa700 1 -- start start 2023-09-30T22:26:06.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.292+0000 7f0c11cfa700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0c0c09d920 0x7f0c0c119730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.292+0000 7f0c11cfa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0c0c133ca0 0x7f0c0c119c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.292+0000 7f0c11cfa700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c0c071990 0x7f0c0c11a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.292+0000 7f0c11cfa700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c11c980 con 0x7f0c0c071990 2023-09-30T22:26:06.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.292+0000 7f0c11cfa700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c11b580 con 0x7f0c0c133ca0 2023-09-30T22:26:06.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.292+0000 7f0c11cfa700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c11acb0 con 0x7f0c0c09d920 2023-09-30T22:26:06.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.292+0000 7f0c0affd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0c0c133ca0 0x7f0c0c119c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.292+0000 7f0c0affd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0c0c133ca0 0x7f0c0c119c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:51992/0 (socket says 172.21.15.40:51992) 2023-09-30T22:26:06.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.292+0000 7f0c0affd700 1 -- 172.21.15.40:0/2085317069 learned_addr learned my addr 172.21.15.40:0/2085317069 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:06.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.292+0000 7f0c0b7fe700 1 --2- 172.21.15.40:0/2085317069 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0c0c09d920 0x7f0c0c119730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.292+0000 7f0c0bfff700 1 --2- 172.21.15.40:0/2085317069 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c0c071990 0x7f0c0c11a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.292+0000 7f0c0affd700 1 -- 172.21.15.40:0/2085317069 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0c0c09d920 msgr2=0x7f0c0c119730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:06.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.292+0000 7f0c0affd700 1 --2- 172.21.15.40:0/2085317069 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0c0c09d920 0x7f0c0c119730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.292+0000 7f0c0affd700 1 -- 172.21.15.40:0/2085317069 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c0c071990 msgr2=0x7f0c0c11a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:06.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.292+0000 7f0c0affd700 1 --2- 172.21.15.40:0/2085317069 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c0c071990 0x7f0c0c11a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.292+0000 7f0c0affd700 1 -- 172.21.15.40:0/2085317069 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c000094a0 con 0x7f0c0c133ca0 2023-09-30T22:26:06.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.292+0000 7f0c0bfff700 1 --2- 172.21.15.40:0/2085317069 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c0c071990 0x7f0c0c11a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:06.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.292+0000 7f0c0affd700 1 --2- 172.21.15.40:0/2085317069 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0c0c133ca0 0x7f0c0c119c70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0c0000ea10 tx=0x7f0c0000ed20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:06.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.293+0000 7f0bf3fff700 1 -- 172.21.15.40:0/2085317069 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0000eeb0 con 0x7f0c0c133ca0 2023-09-30T22:26:06.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.293+0000 7f0bf3fff700 1 -- 172.21.15.40:0/2085317069 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c0000c850 con 0x7f0c0c133ca0 2023-09-30T22:26:06.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.293+0000 7f0c11cfa700 1 -- 172.21.15.40:0/2085317069 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bfc009500 con 0x7f0c0c133ca0 2023-09-30T22:26:06.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.293+0000 7f0bf3fff700 1 -- 172.21.15.40:0/2085317069 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0000cbc0 con 0x7f0c0c133ca0 2023-09-30T22:26:06.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.293+0000 7f0c11cfa700 1 -- 172.21.15.40:0/2085317069 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c0c11bf00 con 0x7f0c0c133ca0 2023-09-30T22:26:06.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.294+0000 7f0c11cfa700 1 -- 172.21.15.40:0/2085317069 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c0c062380 con 0x7f0c0c133ca0 2023-09-30T22:26:06.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.294+0000 7f0bf3fff700 1 -- 172.21.15.40:0/2085317069 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0c0000cd20 con 0x7f0c0c133ca0 2023-09-30T22:26:06.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.294+0000 7f0bf3fff700 1 -- 172.21.15.40:0/2085317069 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f0c0003fae0 con 0x7f0c0c133ca0 2023-09-30T22:26:06.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.303+0000 7f0bf3fff700 1 -- 172.21.15.40:0/2085317069 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0c0001b3b0 con 0x7f0c0c133ca0 2023-09-30T22:26:06.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.377+0000 7f5fd89e9700 1 -- 172.21.15.40:0/2292496557 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5fd409f970 con 0x7f5fd406f070 2023-09-30T22:26:06.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.378+0000 7f5fc2ffd700 1 -- 172.21.15.40:0/2292496557 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5fc4032090 con 0x7f5fd406f070 2023-09-30T22:26:06.377 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:06.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.380+0000 7f5fd89e9700 1 -- 172.21.15.40:0/2292496557 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5fd406f070 msgr2=0x7f5fd409c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:06.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.380+0000 7f5fd89e9700 1 --2- 172.21.15.40:0/2292496557 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5fd406f070 0x7f5fd409c1a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4067a60 tx=0x7f5fc4004750 comp rx=0 tx=0).stop 2023-09-30T22:26:06.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.380+0000 7f5fd89e9700 1 -- 172.21.15.40:0/2292496557 shutdown_connections 2023-09-30T22:26:06.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.380+0000 7f5fd89e9700 1 --2- 172.21.15.40:0/2292496557 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5fd406fdb0 0x7f5fd409cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.380+0000 7f5fd89e9700 1 --2- 172.21.15.40:0/2292496557 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5fd406f070 0x7f5fd409c1a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.380+0000 7f5fd89e9700 1 --2- 172.21.15.40:0/2292496557 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fd406f980 0x7f5fd409c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.380+0000 7f5fd89e9700 1 -- 172.21.15.40:0/2292496557 >> 172.21.15.40:0/2292496557 conn(0x7f5fd40a41a0 msgr2=0x7f5fd4097530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:06.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.380+0000 7f5fd89e9700 1 -- 172.21.15.40:0/2292496557 shutdown_connections 2023-09-30T22:26:06.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.380+0000 7f5fd89e9700 1 -- 172.21.15.40:0/2292496557 wait complete. 2023-09-30T22:26:06.392 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:06.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.465+0000 7f3cea78e700 1 -- 172.21.15.40:0/2166987059 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3ce4062380 con 0x7f3ce406ced0 2023-09-30T22:26:06.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.466+0000 7f3ce0ff9700 1 -- 172.21.15.40:0/2166987059 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3cd4015030 con 0x7f3ce406ced0 2023-09-30T22:26:06.466 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:06.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.468+0000 7f3cea78e700 1 -- 172.21.15.40:0/2166987059 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ce406ced0 msgr2=0x7f3ce40962e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:06.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.468+0000 7f3cea78e700 1 --2- 172.21.15.40:0/2166987059 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ce406ced0 0x7f3ce40962e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4000c00 tx=0x7f3cd4004750 comp rx=0 tx=0).stop 2023-09-30T22:26:06.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.468+0000 7f3cea78e700 1 -- 172.21.15.40:0/2166987059 shutdown_connections 2023-09-30T22:26:06.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.468+0000 7f3cea78e700 1 --2- 172.21.15.40:0/2166987059 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ce409fbb0 0x7f3ce41c8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.468+0000 7f3cea78e700 1 --2- 172.21.15.40:0/2166987059 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ce406ced0 0x7f3ce40962e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.468+0000 7f3cea78e700 1 --2- 172.21.15.40:0/2166987059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ce406d2c0 0x7f3ce4096820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.468+0000 7f3cea78e700 1 -- 172.21.15.40:0/2166987059 >> 172.21.15.40:0/2166987059 conn(0x7f3ce40a41a0 msgr2=0x7f3ce40a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:06.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.468+0000 7f3cea78e700 1 -- 172.21.15.40:0/2166987059 shutdown_connections 2023-09-30T22:26:06.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.468+0000 7f3cea78e700 1 -- 172.21.15.40:0/2166987059 wait complete. 2023-09-30T22:26:06.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:06.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.498+0000 7f0c11cfa700 1 -- 172.21.15.40:0/2085317069 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0c0c074720 con 0x7f0c0c133ca0 2023-09-30T22:26:06.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.499+0000 7f0bf3fff700 1 -- 172.21.15.40:0/2085317069 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0c00021070 con 0x7f0c0c133ca0 2023-09-30T22:26:06.499 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:06.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.501+0000 7f0c11cfa700 1 -- 172.21.15.40:0/2085317069 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0c0c133ca0 msgr2=0x7f0c0c119c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:06.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.501+0000 7f0c11cfa700 1 --2- 172.21.15.40:0/2085317069 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0c0c133ca0 0x7f0c0c119c70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0c0000ea10 tx=0x7f0c0000ed20 comp rx=0 tx=0).stop 2023-09-30T22:26:06.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.501+0000 7f0c11cfa700 1 -- 172.21.15.40:0/2085317069 shutdown_connections 2023-09-30T22:26:06.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.501+0000 7f0c11cfa700 1 --2- 172.21.15.40:0/2085317069 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0c0c09d920 0x7f0c0c119730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.501+0000 7f0c11cfa700 1 --2- 172.21.15.40:0/2085317069 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c0c071990 0x7f0c0c11a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.501+0000 7f0c11cfa700 1 --2- 172.21.15.40:0/2085317069 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0c0c133ca0 0x7f0c0c119c70 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.501+0000 7f0c11cfa700 1 -- 172.21.15.40:0/2085317069 >> 172.21.15.40:0/2085317069 conn(0x7f0c0c09fb20 msgr2=0x7f0c0c130a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:06.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.501+0000 7f0c11cfa700 1 -- 172.21.15.40:0/2085317069 shutdown_connections 2023-09-30T22:26:06.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:06.501+0000 7f0c11cfa700 1 -- 172.21.15.40:0/2085317069 wait complete. 2023-09-30T22:26:06.513 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:07.203 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:07.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.344+0000 7fac78d00700 1 Processor -- start 2023-09-30T22:26:07.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.344+0000 7fac78d00700 1 -- start start 2023-09-30T22:26:07.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.345+0000 7fac78d00700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fac7406f070 0x7fac7406f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.345+0000 7fac78d00700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac7406f980 0x7fac74097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.345+0000 7fac78d00700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac74070830 con 0x7fac7406fdb0 2023-09-30T22:26:07.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.345+0000 7fac78d00700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac74071af0 con 0x7fac7406f980 2023-09-30T22:26:07.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.345+0000 7fac78d00700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac74070ad0 con 0x7fac7406f070 2023-09-30T22:26:07.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.345+0000 7fac7259c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fac7406f070 0x7fac7406f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.345+0000 7fac71d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac7406f980 0x7fac74097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.345+0000 7fac7259c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fac7406f070 0x7fac7406f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41564/0 (socket says 172.21.15.40:41564) 2023-09-30T22:26:07.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.345+0000 7fac7259c700 1 -- 172.21.15.40:0/3403526561 learned_addr learned my addr 172.21.15.40:0/3403526561 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:07.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.345+0000 7fac7259c700 1 -- 172.21.15.40:0/3403526561 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac7406f980 msgr2=0x7fac74097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:07.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.345+0000 7fac7259c700 1 --2- 172.21.15.40:0/3403526561 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac7406f980 0x7fac74097090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.345+0000 7fac7259c700 1 -- 172.21.15.40:0/3403526561 >> v1:172.21.15.40:6789/0 conn(0x7fac7406fdb0 legacy=0x7fac740975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.345+0000 7fac7159a700 1 -- 172.21.15.40:0/3403526561 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3158812748 0 0) 0x7fac74070830 con 0x7fac7406fdb0 2023-09-30T22:26:07.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.345+0000 7fac7259c700 1 -- 172.21.15.40:0/3403526561 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac74070de0 con 0x7fac7406f070 2023-09-30T22:26:07.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.345+0000 7fac71d9b700 1 --2- 172.21.15.40:0/3403526561 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac7406f980 0x7fac74097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:07.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.346+0000 7fac7259c700 1 --2- 172.21.15.40:0/3403526561 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fac7406f070 0x7fac7406f440 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fac64009950 tx=0x7fac64009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47b7a00231f696bd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:07.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.346+0000 7fac7159a700 1 -- 172.21.15.40:0/3403526561 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac64011830 con 0x7fac7406f070 2023-09-30T22:26:07.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.346+0000 7fac7159a700 1 -- 172.21.15.40:0/3403526561 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac64011990 con 0x7fac7406f070 2023-09-30T22:26:07.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.346+0000 7fac7159a700 1 -- 172.21.15.40:0/3403526561 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac64011d40 con 0x7fac7406f070 2023-09-30T22:26:07.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.346+0000 7fac78d00700 1 -- 172.21.15.40:0/3403526561 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fac7406f070 msgr2=0x7fac7406f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.346+0000 7fac78d00700 1 --2- 172.21.15.40:0/3403526561 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fac7406f070 0x7fac7406f440 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fac64009950 tx=0x7fac64009c60 comp rx=0 tx=0).stop 2023-09-30T22:26:07.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.346+0000 7fac78d00700 1 -- 172.21.15.40:0/3403526561 shutdown_connections 2023-09-30T22:26:07.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.346+0000 7fac78d00700 1 --2- 172.21.15.40:0/3403526561 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fac7406f070 0x7fac7406f440 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.346+0000 7fac78d00700 1 --2- 172.21.15.40:0/3403526561 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac7406f980 0x7fac74097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.346+0000 7fac78d00700 1 -- 172.21.15.40:0/3403526561 >> 172.21.15.40:0/3403526561 conn(0x7fac740a41a0 msgr2=0x7fac740a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:07.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.347+0000 7fac78d00700 1 -- 172.21.15.40:0/3403526561 shutdown_connections 2023-09-30T22:26:07.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.347+0000 7fac78d00700 1 -- 172.21.15.40:0/3403526561 wait complete. 2023-09-30T22:26:07.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.348+0000 7fac78d00700 1 Processor -- start 2023-09-30T22:26:07.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.348+0000 7fac78d00700 1 -- start start 2023-09-30T22:26:07.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.348+0000 7fac78d00700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac7406f070 0x7fac7406c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.348+0000 7fac78d00700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac7406f980 0x7fac7406ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.348+0000 7fac78d00700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fac7406fdb0 0x7fac7406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.348+0000 7fac78d00700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7406e590 con 0x7fac7406f070 2023-09-30T22:26:07.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.348+0000 7fac78d00700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac7408bf80 con 0x7fac7406f980 2023-09-30T22:26:07.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.348+0000 7fac78d00700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac741292a0 con 0x7fac7406fdb0 2023-09-30T22:26:07.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.348+0000 7fac71d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac7406f980 0x7fac7406ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.348+0000 7fac72d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fac7406fdb0 0x7fac7406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.348+0000 7fac71d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac7406f980 0x7fac7406ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52006/0 (socket says 172.21.15.40:52006) 2023-09-30T22:26:07.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.348+0000 7fac71d9b700 1 -- 172.21.15.40:0/3032461387 learned_addr learned my addr 172.21.15.40:0/3032461387 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:07.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.348+0000 7fac7259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac7406f070 0x7fac7406c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.349+0000 7fac71d9b700 1 -- 172.21.15.40:0/3032461387 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fac7406fdb0 msgr2=0x7fac7406d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.349+0000 7fac71d9b700 1 --2- 172.21.15.40:0/3032461387 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fac7406fdb0 0x7fac7406d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.349+0000 7fac71d9b700 1 -- 172.21.15.40:0/3032461387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac7406f070 msgr2=0x7fac7406c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.349+0000 7fac71d9b700 1 --2- 172.21.15.40:0/3032461387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac7406f070 0x7fac7406c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.349+0000 7fac71d9b700 1 -- 172.21.15.40:0/3032461387 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac5c0094a0 con 0x7fac7406f980 2023-09-30T22:26:07.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.349+0000 7fac72d9d700 1 --2- 172.21.15.40:0/3032461387 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fac7406fdb0 0x7fac7406d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:07.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.349+0000 7fac7259c700 1 --2- 172.21.15.40:0/3032461387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac7406f070 0x7fac7406c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:07.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.349+0000 7fac71d9b700 1 --2- 172.21.15.40:0/3032461387 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac7406f980 0x7fac7406ced0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fac5c00ebb0 tx=0x7fac5c00eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:07.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.349+0000 7fac6affd700 1 -- 172.21.15.40:0/3032461387 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5c00c850 con 0x7fac7406f980 2023-09-30T22:26:07.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.349+0000 7fac6affd700 1 -- 172.21.15.40:0/3032461387 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac5c00c9b0 con 0x7fac7406f980 2023-09-30T22:26:07.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.349+0000 7fac78d00700 1 -- 172.21.15.40:0/3032461387 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac64009550 con 0x7fac7406f980 2023-09-30T22:26:07.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.349+0000 7fac6affd700 1 -- 172.21.15.40:0/3032461387 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5c00cd40 con 0x7fac7406f980 2023-09-30T22:26:07.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.349+0000 7fac78d00700 1 -- 172.21.15.40:0/3032461387 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac7408b3a0 con 0x7fac7406f980 2023-09-30T22:26:07.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.350+0000 7fac6affd700 1 -- 172.21.15.40:0/3032461387 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fac5c013470 con 0x7fac7406f980 2023-09-30T22:26:07.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.350+0000 7fac6affd700 1 -- 172.21.15.40:0/3032461387 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fac5c03f7b0 con 0x7fac7406f980 2023-09-30T22:26:07.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.350+0000 7fac78d00700 1 -- 172.21.15.40:0/3032461387 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac74062380 con 0x7fac7406f980 2023-09-30T22:26:07.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.355+0000 7fac6affd700 1 -- 172.21.15.40:0/3032461387 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fac5c0232f0 con 0x7fac7406f980 2023-09-30T22:26:07.393 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:07.480 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:07.514 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:07.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.521+0000 7f0d5903a700 1 Processor -- start 2023-09-30T22:26:07.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.521+0000 7f0d5903a700 1 -- start start 2023-09-30T22:26:07.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.522+0000 7f0d5903a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0d5409d920 0x7f0d5409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.522+0000 7f0d5903a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0d5409f0f0 0x7f0d5409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.522+0000 7f0d5903a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0d54133ca0 0x7f0d54134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.522+0000 7f0d5903a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d5406b4c0 con 0x7f0d54133ca0 2023-09-30T22:26:07.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.522+0000 7f0d5903a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5409a8f0 con 0x7f0d5409d920 2023-09-30T22:26:07.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.522+0000 7f0d5903a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5409f940 con 0x7f0d5409f0f0 2023-09-30T22:26:07.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.522+0000 7f0d52d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0d5409d920 0x7f0d5409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.522+0000 7f0d5259c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0d5409f0f0 0x7f0d5409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.522+0000 7f0d5259c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0d5409f0f0 0x7f0d5409e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41596/0 (socket says 172.21.15.40:41596) 2023-09-30T22:26:07.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.522+0000 7f0d52d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0d5409d920 0x7f0d5409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52020/0 (socket says 172.21.15.40:52020) 2023-09-30T22:26:07.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.522+0000 7f0d5259c700 1 -- 172.21.15.40:0/1935932904 learned_addr learned my addr 172.21.15.40:0/1935932904 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:07.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.522+0000 7f0d5359e700 1 --2- 172.21.15.40:0/1935932904 >> v2:172.21.15.40:3300/0 conn(0x7f0d54133ca0 0x7f0d54134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.522+0000 7f0d52d9d700 1 -- 172.21.15.40:0/1935932904 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0d5409f0f0 msgr2=0x7f0d5409e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:07.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.522+0000 7f0d52d9d700 1 --2- 172.21.15.40:0/1935932904 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0d5409f0f0 0x7f0d5409e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.522+0000 7f0d52d9d700 1 -- 172.21.15.40:0/1935932904 >> v2:172.21.15.40:3300/0 conn(0x7f0d54133ca0 msgr2=0x7f0d54134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:07.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.522+0000 7f0d52d9d700 1 --2- 172.21.15.40:0/1935932904 >> v2:172.21.15.40:3300/0 conn(0x7f0d54133ca0 0x7f0d54134140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.522+0000 7f0d52d9d700 1 -- 172.21.15.40:0/1935932904 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5409f6e0 con 0x7f0d5409d920 2023-09-30T22:26:07.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.523+0000 7f0d52d9d700 1 --2- 172.21.15.40:0/1935932904 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0d5409d920 0x7f0d5409dcf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0d44009880 tx=0x7f0d44009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4c4a121bf4d6e62 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:07.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.523+0000 7f0d51d9b700 1 -- 172.21.15.40:0/1935932904 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d44005e30 con 0x7f0d5409d920 2023-09-30T22:26:07.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.523+0000 7f0d51d9b700 1 -- 172.21.15.40:0/1935932904 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d44006030 con 0x7f0d5409d920 2023-09-30T22:26:07.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.523+0000 7f0d51d9b700 1 -- 172.21.15.40:0/1935932904 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d440063c0 con 0x7f0d5409d920 2023-09-30T22:26:07.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.524+0000 7f0d5903a700 1 -- 172.21.15.40:0/1935932904 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0d5409d920 msgr2=0x7f0d5409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.524+0000 7f0d5903a700 1 --2- 172.21.15.40:0/1935932904 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0d5409d920 0x7f0d5409dcf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0d44009880 tx=0x7f0d44009b90 comp rx=0 tx=0).stop 2023-09-30T22:26:07.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.524+0000 7f0d5903a700 1 -- 172.21.15.40:0/1935932904 shutdown_connections 2023-09-30T22:26:07.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.524+0000 7f0d5903a700 1 --2- 172.21.15.40:0/1935932904 >> v2:172.21.15.40:3300/0 conn(0x7f0d54133ca0 0x7f0d54134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.524+0000 7f0d5903a700 1 --2- 172.21.15.40:0/1935932904 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0d5409d920 0x7f0d5409dcf0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.524+0000 7f0d5903a700 1 --2- 172.21.15.40:0/1935932904 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0d5409f0f0 0x7f0d5409e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.524+0000 7f0d5903a700 1 -- 172.21.15.40:0/1935932904 >> 172.21.15.40:0/1935932904 conn(0x7f0d5409fb20 msgr2=0x7f0d5409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:07.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.524+0000 7f0d5903a700 1 -- 172.21.15.40:0/1935932904 shutdown_connections 2023-09-30T22:26:07.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.524+0000 7f0d5903a700 1 -- 172.21.15.40:0/1935932904 wait complete. 2023-09-30T22:26:07.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.525+0000 7f0d5903a700 1 Processor -- start 2023-09-30T22:26:07.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.525+0000 7f0d5903a700 1 -- start start 2023-09-30T22:26:07.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.526+0000 7f0d5903a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0d5409d920 0x7f0d54121830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.526+0000 7f0d5903a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d54133ca0 0x7f0d54121d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.526+0000 7f0d5903a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0d541222b0 0x7f0d541c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.526+0000 7f0d5903a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d54125070 con 0x7f0d54133ca0 2023-09-30T22:26:07.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.526+0000 7f0d5903a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d54122c90 con 0x7f0d5409d920 2023-09-30T22:26:07.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.526+0000 7f0d5903a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d54123550 con 0x7f0d541222b0 2023-09-30T22:26:07.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.526+0000 7f0d52d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0d5409d920 0x7f0d54121830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.526+0000 7f0d52d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0d5409d920 0x7f0d54121830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52036/0 (socket says 172.21.15.40:52036) 2023-09-30T22:26:07.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.526+0000 7f0d52d9d700 1 -- 172.21.15.40:0/351490871 learned_addr learned my addr 172.21.15.40:0/351490871 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:07.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.526+0000 7f0d5259c700 1 --2- 172.21.15.40:0/351490871 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d54133ca0 0x7f0d54121d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.526+0000 7f0d5359e700 1 --2- 172.21.15.40:0/351490871 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0d541222b0 0x7f0d541c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.526+0000 7f0d5259c700 1 -- 172.21.15.40:0/351490871 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0d541222b0 msgr2=0x7f0d541c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.526+0000 7f0d5259c700 1 --2- 172.21.15.40:0/351490871 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0d541222b0 0x7f0d541c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.526+0000 7f0d5259c700 1 -- 172.21.15.40:0/351490871 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0d5409d920 msgr2=0x7f0d54121830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.526+0000 7f0d5259c700 1 --2- 172.21.15.40:0/351490871 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0d5409d920 0x7f0d54121830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.526+0000 7f0d5259c700 1 -- 172.21.15.40:0/351490871 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d44009430 con 0x7f0d54133ca0 2023-09-30T22:26:07.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.526+0000 7f0d5359e700 1 --2- 172.21.15.40:0/351490871 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0d541222b0 0x7f0d541c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:07.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.527+0000 7f0d5259c700 1 --2- 172.21.15.40:0/351490871 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d54133ca0 0x7f0d54121d70 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0d4800e840 tx=0x7f0d4800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:07.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.527+0000 7f0d3b7fe700 1 -- 172.21.15.40:0/351490871 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d48013680 con 0x7f0d54133ca0 2023-09-30T22:26:07.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.527+0000 7f0d3b7fe700 1 -- 172.21.15.40:0/351490871 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d480137e0 con 0x7f0d54133ca0 2023-09-30T22:26:07.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.527+0000 7f0d3b7fe700 1 -- 172.21.15.40:0/351490871 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d48013b50 con 0x7f0d54133ca0 2023-09-30T22:26:07.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.528+0000 7f0d5903a700 1 -- 172.21.15.40:0/351490871 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d5409c9e0 con 0x7f0d54133ca0 2023-09-30T22:26:07.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.528+0000 7f0d5903a700 1 -- 172.21.15.40:0/351490871 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d54132350 con 0x7f0d54133ca0 2023-09-30T22:26:07.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.529+0000 7f0d3b7fe700 1 -- 172.21.15.40:0/351490871 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0d48013cb0 con 0x7f0d54133ca0 2023-09-30T22:26:07.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.529+0000 7f0d5903a700 1 -- 172.21.15.40:0/351490871 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d54062380 con 0x7f0d54133ca0 2023-09-30T22:26:07.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.529+0000 7f0d3b7fe700 1 -- 172.21.15.40:0/351490871 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f0d4803f8d0 con 0x7f0d54133ca0 2023-09-30T22:26:07.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.538+0000 7f0d3b7fe700 1 -- 172.21.15.40:0/351490871 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0d4801ada0 con 0x7f0d54133ca0 2023-09-30T22:26:07.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.561+0000 7fac78d00700 1 -- 172.21.15.40:0/3032461387 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fac74074620 con 0x7fac7406f980 2023-09-30T22:26:07.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.561+0000 7fac6affd700 1 -- 172.21.15.40:0/3032461387 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fac5c021030 con 0x7fac7406f980 2023-09-30T22:26:07.563 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:07.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.563+0000 7fac78d00700 1 -- 172.21.15.40:0/3032461387 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac7406f980 msgr2=0x7fac7406ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.563+0000 7fac78d00700 1 --2- 172.21.15.40:0/3032461387 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac7406f980 0x7fac7406ced0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fac5c00ebb0 tx=0x7fac5c00eec0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.563+0000 7fac78d00700 1 -- 172.21.15.40:0/3032461387 shutdown_connections 2023-09-30T22:26:07.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.563+0000 7fac78d00700 1 --2- 172.21.15.40:0/3032461387 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fac7406fdb0 0x7fac7406d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.563+0000 7fac78d00700 1 --2- 172.21.15.40:0/3032461387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac7406f070 0x7fac7406c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.563+0000 7fac78d00700 1 --2- 172.21.15.40:0/3032461387 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac7406f980 0x7fac7406ced0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.563+0000 7fac78d00700 1 -- 172.21.15.40:0/3032461387 >> 172.21.15.40:0/3032461387 conn(0x7fac740a41a0 msgr2=0x7fac74097530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:07.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.563+0000 7fac78d00700 1 -- 172.21.15.40:0/3032461387 shutdown_connections 2023-09-30T22:26:07.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.563+0000 7fac78d00700 1 -- 172.21.15.40:0/3032461387 wait complete. 2023-09-30T22:26:07.577 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:07.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.617+0000 7fc4bf960700 1 Processor -- start 2023-09-30T22:26:07.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.617+0000 7fc4bf960700 1 -- start start 2023-09-30T22:26:07.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.618+0000 7fc4bf960700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4b806f3a0 0x7fc4b806c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.618+0000 7fc4bf960700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc4b809fbb0 0x7fc4b806ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.618+0000 7fc4bf960700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc4b806d410 0x7fc4b813a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.618+0000 7fc4bf960700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4b809ff80 con 0x7fc4b809fbb0 2023-09-30T22:26:07.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.618+0000 7fc4bf960700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b80a0590 con 0x7fc4b806f3a0 2023-09-30T22:26:07.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.618+0000 7fc4bf960700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b806bac0 con 0x7fc4b806d410 2023-09-30T22:26:07.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.618+0000 7fc4bd6fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4b806f3a0 0x7fc4b806c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.618+0000 7fc4bd6fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4b806f3a0 0x7fc4b806c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52050/0 (socket says 172.21.15.40:52050) 2023-09-30T22:26:07.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.618+0000 7fc4bd6fc700 1 -- 172.21.15.40:0/1276719543 learned_addr learned my addr 172.21.15.40:0/1276719543 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:07.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.618+0000 7fc4bcefb700 1 --2- 172.21.15.40:0/1276719543 >> v2:172.21.15.40:3300/0 conn(0x7fc4b809fbb0 0x7fc4b806ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.618+0000 7fc4bdefd700 1 --2- 172.21.15.40:0/1276719543 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc4b806d410 0x7fc4b813a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.619+0000 7fc4bcefb700 1 -- 172.21.15.40:0/1276719543 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc4b806d410 msgr2=0x7fc4b813a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:07.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.619+0000 7fc4bcefb700 1 --2- 172.21.15.40:0/1276719543 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc4b806d410 0x7fc4b813a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.619+0000 7fc4bcefb700 1 -- 172.21.15.40:0/1276719543 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4b806f3a0 msgr2=0x7fc4b806c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:07.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.619+0000 7fc4bcefb700 1 --2- 172.21.15.40:0/1276719543 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4b806f3a0 0x7fc4b806c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.619+0000 7fc4bcefb700 1 -- 172.21.15.40:0/1276719543 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b80a0780 con 0x7fc4b809fbb0 2023-09-30T22:26:07.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.619+0000 7fc4bdefd700 1 --2- 172.21.15.40:0/1276719543 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc4b806d410 0x7fc4b813a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:07.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.619+0000 7fc4bd6fc700 1 --2- 172.21.15.40:0/1276719543 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4b806f3a0 0x7fc4b806c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:07.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.619+0000 7fc4bcefb700 1 --2- 172.21.15.40:0/1276719543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4b809fbb0 0x7fc4b806ced0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8009870 tx=0x7fc4a8009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb9f6ac0afb920f8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:07.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.619+0000 7fc4affff700 1 -- 172.21.15.40:0/1276719543 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8011830 con 0x7fc4b809fbb0 2023-09-30T22:26:07.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.619+0000 7fc4affff700 1 -- 172.21.15.40:0/1276719543 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a8011990 con 0x7fc4b809fbb0 2023-09-30T22:26:07.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.619+0000 7fc4affff700 1 -- 172.21.15.40:0/1276719543 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8011d20 con 0x7fc4b809fbb0 2023-09-30T22:26:07.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.620+0000 7fc4bf960700 1 -- 172.21.15.40:0/1276719543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4b809fbb0 msgr2=0x7fc4b806ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.620+0000 7fc4bf960700 1 --2- 172.21.15.40:0/1276719543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4b809fbb0 0x7fc4b806ced0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8009870 tx=0x7fc4a8009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:07.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.620+0000 7fc4bf960700 1 -- 172.21.15.40:0/1276719543 shutdown_connections 2023-09-30T22:26:07.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.620+0000 7fc4bf960700 1 --2- 172.21.15.40:0/1276719543 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc4b806d410 0x7fc4b813a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.620+0000 7fc4bf960700 1 --2- 172.21.15.40:0/1276719543 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4b806f3a0 0x7fc4b806c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.620+0000 7fc4bf960700 1 --2- 172.21.15.40:0/1276719543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4b809fbb0 0x7fc4b806ced0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.620+0000 7fc4bf960700 1 -- 172.21.15.40:0/1276719543 >> 172.21.15.40:0/1276719543 conn(0x7fc4b80a41a0 msgr2=0x7fc4b80a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:07.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.620+0000 7fc4bf960700 1 -- 172.21.15.40:0/1276719543 shutdown_connections 2023-09-30T22:26:07.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.620+0000 7fc4bf960700 1 -- 172.21.15.40:0/1276719543 wait complete. 2023-09-30T22:26:07.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.621+0000 7fc4bf960700 1 Processor -- start 2023-09-30T22:26:07.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.621+0000 7fc4bf960700 1 -- start start 2023-09-30T22:26:07.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.621+0000 7fc4bf960700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc4b806d410 0x7fc4b808f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.621+0000 7fc4bf960700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4b806f3a0 0x7fc4b808fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.621+0000 7fc4bf960700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4b809fbb0 0x7fc4b80901b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.621+0000 7fc4bf960700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b8092dd0 con 0x7fc4b806f3a0 2023-09-30T22:26:07.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.621+0000 7fc4bf960700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b8092fd0 con 0x7fc4b809fbb0 2023-09-30T22:26:07.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.621+0000 7fc4bf960700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b8091070 con 0x7fc4b806d410 2023-09-30T22:26:07.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.621+0000 7fc4bcefb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4b806f3a0 0x7fc4b808fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.621+0000 7fc4bd6fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc4b806d410 0x7fc4b808f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.621+0000 7fc4bcefb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4b806f3a0 0x7fc4b808fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36908/0 (socket says 172.21.15.40:36908) 2023-09-30T22:26:07.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.621+0000 7fc4bcefb700 1 -- 172.21.15.40:0/134724693 learned_addr learned my addr 172.21.15.40:0/134724693 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:07.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.622+0000 7fc4bdefd700 1 --2- 172.21.15.40:0/134724693 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4b809fbb0 0x7fc4b80901b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.622+0000 7fc4bd6fc700 1 -- 172.21.15.40:0/134724693 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4b809fbb0 msgr2=0x7fc4b80901b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.622+0000 7fc4bd6fc700 1 --2- 172.21.15.40:0/134724693 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4b809fbb0 0x7fc4b80901b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.622+0000 7fc4bd6fc700 1 -- 172.21.15.40:0/134724693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4b806f3a0 msgr2=0x7fc4b808fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.622+0000 7fc4bd6fc700 1 --2- 172.21.15.40:0/134724693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4b806f3a0 0x7fc4b808fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.622+0000 7fc4bd6fc700 1 -- 172.21.15.40:0/134724693 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b0009a70 con 0x7fc4b806d410 2023-09-30T22:26:07.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.622+0000 7fc4bd6fc700 1 --2- 172.21.15.40:0/134724693 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc4b806d410 0x7fc4b808f730 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc4b400e980 tx=0x7fc4b400ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:07.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.622+0000 7fc4adffb700 1 -- 172.21.15.40:0/134724693 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4004030 con 0x7fc4b806d410 2023-09-30T22:26:07.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.622+0000 7fc4adffb700 1 -- 172.21.15.40:0/134724693 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b4004190 con 0x7fc4b806d410 2023-09-30T22:26:07.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.622+0000 7fc4adffb700 1 -- 172.21.15.40:0/134724693 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4004520 con 0x7fc4b806d410 2023-09-30T22:26:07.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.622+0000 7fc4bf960700 1 -- 172.21.15.40:0/134724693 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4b4009550 con 0x7fc4b806d410 2023-09-30T22:26:07.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.622+0000 7fc4bf960700 1 -- 172.21.15.40:0/134724693 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a80094a0 con 0x7fc4b806d410 2023-09-30T22:26:07.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.623+0000 7fc4adffb700 1 -- 172.21.15.40:0/134724693 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc4b40036a0 con 0x7fc4b806d410 2023-09-30T22:26:07.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.623+0000 7fc4bf960700 1 -- 172.21.15.40:0/134724693 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4b806df90 con 0x7fc4b806d410 2023-09-30T22:26:07.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.623+0000 7fc4adffb700 1 -- 172.21.15.40:0/134724693 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc4b403fb60 con 0x7fc4b806d410 2023-09-30T22:26:07.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.628+0000 7fc4adffb700 1 -- 172.21.15.40:0/134724693 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc4b4020030 con 0x7fc4b806d410 2023-09-30T22:26:07.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.655+0000 7fe54d2a4700 1 Processor -- start 2023-09-30T22:26:07.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.656+0000 7fe54d2a4700 1 -- start start 2023-09-30T22:26:07.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.656+0000 7fe54d2a4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe54812e590 0x7fe54812e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.656+0000 7fe54d2a4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe54812d8a0 0x7fe548138c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.656+0000 7fe54d2a4700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe54809ab70 con 0x7fe54812eea0 2023-09-30T22:26:07.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.656+0000 7fe54d2a4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe54809b270 con 0x7fe54812e590 2023-09-30T22:26:07.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.656+0000 7fe54d2a4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe54809bab0 con 0x7fe54812d8a0 2023-09-30T22:26:07.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.656+0000 7fe5467fc700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe54812eea0 0x7fe54812d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40800/0 (socket says 172.21.15.40:40800) 2023-09-30T22:26:07.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.656+0000 7fe5467fc700 1 -- 172.21.15.40:0/2814585730 learned_addr learned my addr 172.21.15.40:0/2814585730 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:07.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.656+0000 7fe546ffd700 1 --2- 172.21.15.40:0/2814585730 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe54812e590 0x7fe54812e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.656+0000 7fe5477fe700 1 --2- 172.21.15.40:0/2814585730 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe54812d8a0 0x7fe548138c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.657+0000 7fe545ffb700 1 -- 172.21.15.40:0/2814585730 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2603952689 0 0) 0x7fe54809ab70 con 0x7fe54812eea0 2023-09-30T22:26:07.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.657+0000 7fe5477fe700 1 -- 172.21.15.40:0/2814585730 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe54812e590 msgr2=0x7fe54812e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:07.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.657+0000 7fe5477fe700 1 --2- 172.21.15.40:0/2814585730 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe54812e590 0x7fe54812e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.657+0000 7fe5477fe700 1 -- 172.21.15.40:0/2814585730 >> v1:172.21.15.40:6789/0 conn(0x7fe54812eea0 legacy=0x7fe54812d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.657+0000 7fe5477fe700 1 -- 172.21.15.40:0/2814585730 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54809bd70 con 0x7fe54812d8a0 2023-09-30T22:26:07.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.657+0000 7fe546ffd700 1 --2- 172.21.15.40:0/2814585730 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe54812e590 0x7fe54812e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:07.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.657+0000 7fe5477fe700 1 --2- 172.21.15.40:0/2814585730 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe54812d8a0 0x7fe548138c50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe540009dc0 tx=0x7fe54000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1986f3f26fd7f76f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:07.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.657+0000 7fe545ffb700 1 -- 172.21.15.40:0/2814585730 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54000e070 con 0x7fe54812d8a0 2023-09-30T22:26:07.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.657+0000 7fe545ffb700 1 -- 172.21.15.40:0/2814585730 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54000bb20 con 0x7fe54812d8a0 2023-09-30T22:26:07.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.657+0000 7fe545ffb700 1 -- 172.21.15.40:0/2814585730 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe540012430 con 0x7fe54812d8a0 2023-09-30T22:26:07.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.658+0000 7fe54d2a4700 1 -- 172.21.15.40:0/2814585730 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe54812d8a0 msgr2=0x7fe548138c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.658+0000 7fe54d2a4700 1 --2- 172.21.15.40:0/2814585730 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe54812d8a0 0x7fe548138c50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe540009dc0 tx=0x7fe54000b330 comp rx=0 tx=0).stop 2023-09-30T22:26:07.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.658+0000 7fe54d2a4700 1 -- 172.21.15.40:0/2814585730 shutdown_connections 2023-09-30T22:26:07.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.658+0000 7fe54d2a4700 1 --2- 172.21.15.40:0/2814585730 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe54812d8a0 0x7fe548138c50 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.658+0000 7fe54d2a4700 1 --2- 172.21.15.40:0/2814585730 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe54812e590 0x7fe54812e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.658+0000 7fe54d2a4700 1 -- 172.21.15.40:0/2814585730 >> 172.21.15.40:0/2814585730 conn(0x7fe5480a2a00 msgr2=0x7fe5480a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:07.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.658+0000 7fe54d2a4700 1 -- 172.21.15.40:0/2814585730 shutdown_connections 2023-09-30T22:26:07.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.658+0000 7fe54d2a4700 1 -- 172.21.15.40:0/2814585730 wait complete. 2023-09-30T22:26:07.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.659+0000 7fe54d2a4700 1 Processor -- start 2023-09-30T22:26:07.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.659+0000 7fe54d2a4700 1 -- start start 2023-09-30T22:26:07.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.659+0000 7fe54d2a4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe54812d8a0 0x7fe5481c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.659+0000 7fe54d2a4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe54812e590 0x7fe5481c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.660+0000 7fe54d2a4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe54812eea0 0x7fe5481c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.660+0000 7fe54d2a4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54811d790 con 0x7fe54812d8a0 2023-09-30T22:26:07.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.660+0000 7fe54d2a4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe54812f590 con 0x7fe54812e590 2023-09-30T22:26:07.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.660+0000 7fe54d2a4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe54811da10 con 0x7fe54812eea0 2023-09-30T22:26:07.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.660+0000 7fe5467fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe54812e590 0x7fe5481c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.660+0000 7fe5467fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe54812e590 0x7fe5481c88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52068/0 (socket says 172.21.15.40:52068) 2023-09-30T22:26:07.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.660+0000 7fe5467fc700 1 -- 172.21.15.40:0/3830505865 learned_addr learned my addr 172.21.15.40:0/3830505865 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:07.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.660+0000 7fe5477fe700 1 --2- 172.21.15.40:0/3830505865 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe54812eea0 0x7fe5481c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.660+0000 7fe546ffd700 1 --2- 172.21.15.40:0/3830505865 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe54812d8a0 0x7fe5481c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.660+0000 7fe5467fc700 1 -- 172.21.15.40:0/3830505865 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe54812eea0 msgr2=0x7fe5481c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.660+0000 7fe5467fc700 1 --2- 172.21.15.40:0/3830505865 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe54812eea0 0x7fe5481c8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.660+0000 7fe5467fc700 1 -- 172.21.15.40:0/3830505865 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe54812d8a0 msgr2=0x7fe5481c8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.660+0000 7fe5467fc700 1 --2- 172.21.15.40:0/3830505865 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe54812d8a0 0x7fe5481c8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.660+0000 7fe5467fc700 1 -- 172.21.15.40:0/3830505865 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5380094a0 con 0x7fe54812e590 2023-09-30T22:26:07.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.660+0000 7fe5477fe700 1 --2- 172.21.15.40:0/3830505865 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe54812eea0 0x7fe5481c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:07.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.660+0000 7fe5467fc700 1 --2- 172.21.15.40:0/3830505865 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe54812e590 0x7fe5481c88a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe53c001eb0 tx=0x7fe53c00c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:07.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.660+0000 7fe52f7fe700 1 -- 172.21.15.40:0/3830505865 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c004c80 con 0x7fe54812e590 2023-09-30T22:26:07.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.660+0000 7fe52f7fe700 1 -- 172.21.15.40:0/3830505865 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53c004de0 con 0x7fe54812e590 2023-09-30T22:26:07.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.660+0000 7fe54d2a4700 1 -- 172.21.15.40:0/3830505865 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe540009a70 con 0x7fe54812e590 2023-09-30T22:26:07.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.660+0000 7fe52f7fe700 1 -- 172.21.15.40:0/3830505865 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c007310 con 0x7fe54812e590 2023-09-30T22:26:07.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.661+0000 7fe54d2a4700 1 -- 172.21.15.40:0/3830505865 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe54811dcd0 con 0x7fe54812e590 2023-09-30T22:26:07.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.661+0000 7fe52f7fe700 1 -- 172.21.15.40:0/3830505865 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe53c007470 con 0x7fe54812e590 2023-09-30T22:26:07.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.661+0000 7fe52f7fe700 1 -- 172.21.15.40:0/3830505865 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe53c03f390 con 0x7fe54812e590 2023-09-30T22:26:07.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.662+0000 7fe54d2a4700 1 -- 172.21.15.40:0/3830505865 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe548062380 con 0x7fe54812e590 2023-09-30T22:26:07.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.666+0000 7fe52f7fe700 1 -- 172.21.15.40:0/3830505865 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe53c0123b0 con 0x7fe54812e590 2023-09-30T22:26:07.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.742+0000 7f0d5903a700 1 -- 172.21.15.40:0/351490871 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0d54125b40 con 0x7f0d54133ca0 2023-09-30T22:26:07.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.742+0000 7f0d3b7fe700 1 -- 172.21.15.40:0/351490871 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0d48017030 con 0x7f0d54133ca0 2023-09-30T22:26:07.742 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:07.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.746+0000 7f0d5903a700 1 -- 172.21.15.40:0/351490871 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d54133ca0 msgr2=0x7f0d54121d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.746+0000 7f0d5903a700 1 --2- 172.21.15.40:0/351490871 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d54133ca0 0x7f0d54121d70 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0d4800e840 tx=0x7f0d4800eb50 comp rx=0 tx=0).stop 2023-09-30T22:26:07.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.746+0000 7f0d5903a700 1 -- 172.21.15.40:0/351490871 shutdown_connections 2023-09-30T22:26:07.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.746+0000 7f0d5903a700 1 --2- 172.21.15.40:0/351490871 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0d541222b0 0x7f0d541c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.746+0000 7f0d5903a700 1 --2- 172.21.15.40:0/351490871 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0d5409d920 0x7f0d54121830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.746+0000 7f0d5903a700 1 --2- 172.21.15.40:0/351490871 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d54133ca0 0x7f0d54121d70 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.746+0000 7f0d5903a700 1 -- 172.21.15.40:0/351490871 >> 172.21.15.40:0/351490871 conn(0x7f0d5409fb20 msgr2=0x7f0d540a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:07.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.746+0000 7f0d5903a700 1 -- 172.21.15.40:0/351490871 shutdown_connections 2023-09-30T22:26:07.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.746+0000 7f0d5903a700 1 -- 172.21.15.40:0/351490871 wait complete. 2023-09-30T22:26:07.763 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:07.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.827+0000 7fc4bf960700 1 -- 172.21.15.40:0/134724693 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc4b8062380 con 0x7fc4b806d410 2023-09-30T22:26:07.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.828+0000 7fc4adffb700 1 -- 172.21.15.40:0/134724693 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc4b4029070 con 0x7fc4b806d410 2023-09-30T22:26:07.827 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:07.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.830+0000 7fc4bf960700 1 -- 172.21.15.40:0/134724693 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc4b806d410 msgr2=0x7fc4b808f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.830+0000 7fc4bf960700 1 --2- 172.21.15.40:0/134724693 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc4b806d410 0x7fc4b808f730 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc4b400e980 tx=0x7fc4b400ec90 comp rx=0 tx=0).stop 2023-09-30T22:26:07.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.830+0000 7fc4bf960700 1 -- 172.21.15.40:0/134724693 shutdown_connections 2023-09-30T22:26:07.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.830+0000 7fc4bf960700 1 --2- 172.21.15.40:0/134724693 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc4b806d410 0x7fc4b808f730 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.830+0000 7fc4bf960700 1 --2- 172.21.15.40:0/134724693 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4b809fbb0 0x7fc4b80901b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.830+0000 7fc4bf960700 1 --2- 172.21.15.40:0/134724693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4b806f3a0 0x7fc4b808fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.830+0000 7fc4bf960700 1 -- 172.21.15.40:0/134724693 >> 172.21.15.40:0/134724693 conn(0x7fc4b80a41a0 msgr2=0x7fc4b806f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:07.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.830+0000 7fc4bf960700 1 -- 172.21.15.40:0/134724693 shutdown_connections 2023-09-30T22:26:07.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.830+0000 7fc4bf960700 1 -- 172.21.15.40:0/134724693 wait complete. 2023-09-30T22:26:07.841 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:07.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.871+0000 7fe54d2a4700 1 -- 172.21.15.40:0/3830505865 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe548130ac0 con 0x7fe54812e590 2023-09-30T22:26:07.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.871+0000 7fe52f7fe700 1 -- 172.21.15.40:0/3830505865 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe53c011360 con 0x7fe54812e590 2023-09-30T22:26:07.871 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:07.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.874+0000 7fe54d2a4700 1 -- 172.21.15.40:0/3830505865 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe54812e590 msgr2=0x7fe5481c88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.874+0000 7fe54d2a4700 1 --2- 172.21.15.40:0/3830505865 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe54812e590 0x7fe5481c88a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe53c001eb0 tx=0x7fe53c00c800 comp rx=0 tx=0).stop 2023-09-30T22:26:07.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.874+0000 7fe54d2a4700 1 -- 172.21.15.40:0/3830505865 shutdown_connections 2023-09-30T22:26:07.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.874+0000 7fe54d2a4700 1 --2- 172.21.15.40:0/3830505865 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe54812eea0 0x7fe5481c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.874+0000 7fe54d2a4700 1 --2- 172.21.15.40:0/3830505865 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe54812d8a0 0x7fe5481c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.874+0000 7fe54d2a4700 1 --2- 172.21.15.40:0/3830505865 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe54812e590 0x7fe5481c88a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.874+0000 7fe54d2a4700 1 -- 172.21.15.40:0/3830505865 >> 172.21.15.40:0/3830505865 conn(0x7fe5480a2a00 msgr2=0x7fe54809d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:07.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.874+0000 7fe54d2a4700 1 -- 172.21.15.40:0/3830505865 shutdown_connections 2023-09-30T22:26:07.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:07.874+0000 7fe54d2a4700 1 -- 172.21.15.40:0/3830505865 wait complete. 2023-09-30T22:26:07.886 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:08.577 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:08.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.721+0000 7f13337e4700 1 Processor -- start 2023-09-30T22:26:08.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.721+0000 7f13337e4700 1 -- start start 2023-09-30T22:26:08.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.722+0000 7f13337e4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f132c09fbb0 0x7f132c06c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:08.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.722+0000 7f13337e4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f132c06ced0 0x7f132c06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:08.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.722+0000 7f13337e4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f132c138370 0x7f132c13a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:08.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.722+0000 7f13337e4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f132c09ff80 con 0x7f132c138370 2023-09-30T22:26:08.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.722+0000 7f13337e4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f132c06da80 con 0x7f132c09fbb0 2023-09-30T22:26:08.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.722+0000 7f13337e4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f132c06d800 con 0x7f132c06ced0 2023-09-30T22:26:08.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.722+0000 7f1330d7f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f132c06ced0 0x7f132c06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:08.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.722+0000 7f1331580700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f132c09fbb0 0x7f132c06c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:08.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.722+0000 7f1331d81700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f132c138370 0x7f132c13a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:08.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.722+0000 7f1330d7f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f132c06ced0 0x7f132c06d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41642/0 (socket says 172.21.15.40:41642) 2023-09-30T22:26:08.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.722+0000 7f1331580700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f132c09fbb0 0x7f132c06c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52082/0 (socket says 172.21.15.40:52082) 2023-09-30T22:26:08.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.722+0000 7f1330d7f700 1 -- 172.21.15.40:0/1569799947 learned_addr learned my addr 172.21.15.40:0/1569799947 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:08.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.722+0000 7f1331d81700 1 -- 172.21.15.40:0/1569799947 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f132c06ced0 msgr2=0x7f132c06d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:08.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.722+0000 7f1331d81700 1 --2- 172.21.15.40:0/1569799947 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f132c06ced0 0x7f132c06d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:08.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.722+0000 7f1331d81700 1 -- 172.21.15.40:0/1569799947 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f132c09fbb0 msgr2=0x7f132c06c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:08.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.722+0000 7f1331d81700 1 --2- 172.21.15.40:0/1569799947 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f132c09fbb0 0x7f132c06c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:08.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.722+0000 7f1331d81700 1 -- 172.21.15.40:0/1569799947 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132c0a0590 con 0x7f132c138370 2023-09-30T22:26:08.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.722+0000 7f1330d7f700 1 --2- 172.21.15.40:0/1569799947 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f132c06ced0 0x7f132c06d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:08.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.722+0000 7f1331580700 1 --2- 172.21.15.40:0/1569799947 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f132c09fbb0 0x7f132c06c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:08.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.722+0000 7f1331d81700 1 --2- 172.21.15.40:0/1569799947 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f132c138370 0x7f132c13a750 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1324009d90 tx=0x7f132400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ba95521e583c253 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:08.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.722+0000 7f131ffff700 1 -- 172.21.15.40:0/1569799947 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132400e070 con 0x7f132c138370 2023-09-30T22:26:08.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.723+0000 7f131ffff700 1 -- 172.21.15.40:0/1569799947 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132400bb20 con 0x7f132c138370 2023-09-30T22:26:08.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.723+0000 7f131ffff700 1 -- 172.21.15.40:0/1569799947 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1324012430 con 0x7f132c138370 2023-09-30T22:26:08.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.723+0000 7f13337e4700 1 -- 172.21.15.40:0/1569799947 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f132c138370 msgr2=0x7f132c13a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:08.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.723+0000 7f13337e4700 1 --2- 172.21.15.40:0/1569799947 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f132c138370 0x7f132c13a750 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1324009d90 tx=0x7f132400b330 comp rx=0 tx=0).stop 2023-09-30T22:26:08.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.723+0000 7f13337e4700 1 -- 172.21.15.40:0/1569799947 shutdown_connections 2023-09-30T22:26:08.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.723+0000 7f13337e4700 1 --2- 172.21.15.40:0/1569799947 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f132c138370 0x7f132c13a750 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:08.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.723+0000 7f13337e4700 1 --2- 172.21.15.40:0/1569799947 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f132c09fbb0 0x7f132c06c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:08.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.723+0000 7f13337e4700 1 --2- 172.21.15.40:0/1569799947 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f132c06ced0 0x7f132c06d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:08.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.723+0000 7f13337e4700 1 -- 172.21.15.40:0/1569799947 >> 172.21.15.40:0/1569799947 conn(0x7f132c0a41a0 msgr2=0x7f132c0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:08.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.723+0000 7f13337e4700 1 -- 172.21.15.40:0/1569799947 shutdown_connections 2023-09-30T22:26:08.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.723+0000 7f13337e4700 1 -- 172.21.15.40:0/1569799947 wait complete. 2023-09-30T22:26:08.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.724+0000 7f13337e4700 1 Processor -- start 2023-09-30T22:26:08.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.724+0000 7f13337e4700 1 -- start start 2023-09-30T22:26:08.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.725+0000 7f13337e4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f132c06ced0 0x7f132c137850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:08.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.725+0000 7f13337e4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f132c09fbb0 0x7f132c137d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:08.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.725+0000 7f13337e4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f132c138370 0x7f132c095bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:08.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.725+0000 7f13337e4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132c0939a0 con 0x7f132c138370 2023-09-30T22:26:08.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.725+0000 7f13337e4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f132c09f5f0 con 0x7f132c09fbb0 2023-09-30T22:26:08.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.725+0000 7f13337e4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f132c071eb0 con 0x7f132c06ced0 2023-09-30T22:26:08.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.725+0000 7f1331580700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f132c06ced0 0x7f132c137850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:08.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.725+0000 7f1331d81700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f132c138370 0x7f132c095bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:08.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.725+0000 7f1331580700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f132c06ced0 0x7f132c137850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41648/0 (socket says 172.21.15.40:41648) 2023-09-30T22:26:08.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.725+0000 7f1331580700 1 -- 172.21.15.40:0/2579233417 learned_addr learned my addr 172.21.15.40:0/2579233417 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:08.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.725+0000 7f1330d7f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f132c09fbb0 0x7f132c137d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:08.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.725+0000 7f1331d81700 1 -- 172.21.15.40:0/2579233417 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f132c06ced0 msgr2=0x7f132c137850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:08.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.725+0000 7f1331d81700 1 --2- 172.21.15.40:0/2579233417 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f132c06ced0 0x7f132c137850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:08.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.725+0000 7f1331d81700 1 -- 172.21.15.40:0/2579233417 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f132c09fbb0 msgr2=0x7f132c137d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:08.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.725+0000 7f1331d81700 1 --2- 172.21.15.40:0/2579233417 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f132c09fbb0 0x7f132c137d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:08.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.725+0000 7f1331d81700 1 -- 172.21.15.40:0/2579233417 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1320009550 con 0x7f132c138370 2023-09-30T22:26:08.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.725+0000 7f1331d81700 1 --2- 172.21.15.40:0/2579233417 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f132c138370 0x7f132c095bc0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f132c0978d0 tx=0x7f1324004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:08.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.725+0000 7f131dffb700 1 -- 172.21.15.40:0/2579233417 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1324004880 con 0x7f132c138370 2023-09-30T22:26:08.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.725+0000 7f131dffb700 1 -- 172.21.15.40:0/2579233417 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1324020070 con 0x7f132c138370 2023-09-30T22:26:08.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.725+0000 7f13337e4700 1 -- 172.21.15.40:0/2579233417 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13280094a0 con 0x7f132c138370 2023-09-30T22:26:08.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.725+0000 7f131dffb700 1 -- 172.21.15.40:0/2579233417 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13240276c0 con 0x7f132c138370 2023-09-30T22:26:08.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.726+0000 7f13337e4700 1 -- 172.21.15.40:0/2579233417 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1324009a70 con 0x7f132c138370 2023-09-30T22:26:08.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.726+0000 7f131dffb700 1 -- 172.21.15.40:0/2579233417 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1324012430 con 0x7f132c138370 2023-09-30T22:26:08.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.727+0000 7f131dffb700 1 -- 172.21.15.40:0/2579233417 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f1324022070 con 0x7f132c138370 2023-09-30T22:26:08.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.727+0000 7f13337e4700 1 -- 172.21.15.40:0/2579233417 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f132c062380 con 0x7f132c138370 2023-09-30T22:26:08.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.731+0000 7f131dffb700 1 -- 172.21.15.40:0/2579233417 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1324003e30 con 0x7f132c138370 2023-09-30T22:26:08.764 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:08.842 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:08.887 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:08.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.895+0000 7f37a622c700 1 Processor -- start 2023-09-30T22:26:08.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.895+0000 7f37a622c700 1 -- start start 2023-09-30T22:26:08.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.896+0000 7f37a622c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f37a0133e00 0x7f37a01341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:08.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.896+0000 7f37a622c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f37a009d400 0x7f37a009d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:08.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.896+0000 7f37a622c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37a009dd70 0x7f37a013ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:08.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.896+0000 7f37a622c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37a009ab20 con 0x7f37a009d400 2023-09-30T22:26:08.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.896+0000 7f37a622c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a0133940 con 0x7f37a009dd70 2023-09-30T22:26:08.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.896+0000 7f37a622c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37a009f0d0 con 0x7f37a0133e00 2023-09-30T22:26:08.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.896+0000 7f379f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f37a0133e00 0x7f37a01341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:08.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.896+0000 7f379effd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f37a009d400 0x7f37a009d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:08.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.896+0000 7f379f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f37a0133e00 0x7f37a01341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41656/0 (socket says 172.21.15.40:41656) 2023-09-30T22:26:08.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.896+0000 7f379f7fe700 1 -- 172.21.15.40:0/3625275736 learned_addr learned my addr 172.21.15.40:0/3625275736 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:08.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.896+0000 7f379ffff700 1 --2- 172.21.15.40:0/3625275736 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37a009dd70 0x7f37a013ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:08.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.897+0000 7f379effd700 1 -- 172.21.15.40:0/3625275736 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f37a0133e00 msgr2=0x7f37a01341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:08.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.897+0000 7f379effd700 1 --2- 172.21.15.40:0/3625275736 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f37a0133e00 0x7f37a01341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:08.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.897+0000 7f379effd700 1 -- 172.21.15.40:0/3625275736 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37a009dd70 msgr2=0x7f37a013ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:08.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.897+0000 7f379effd700 1 --2- 172.21.15.40:0/3625275736 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37a009dd70 0x7f37a013ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:08.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.897+0000 7f379effd700 1 -- 172.21.15.40:0/3625275736 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a009e210 con 0x7f37a009d400 2023-09-30T22:26:08.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.897+0000 7f379effd700 1 --2- 172.21.15.40:0/3625275736 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37a009d400 0x7f37a009d830 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3794009840 tx=0x7f3794009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=538eaa912886dd38 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:08.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.897+0000 7f379e7fc700 1 -- 172.21.15.40:0/3625275736 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3794011830 con 0x7f37a009d400 2023-09-30T22:26:08.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.897+0000 7f379e7fc700 1 -- 172.21.15.40:0/3625275736 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3794011990 con 0x7f37a009d400 2023-09-30T22:26:08.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.897+0000 7f379e7fc700 1 -- 172.21.15.40:0/3625275736 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3794011d20 con 0x7f37a009d400 2023-09-30T22:26:08.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.898+0000 7f37a622c700 1 -- 172.21.15.40:0/3625275736 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37a009d400 msgr2=0x7f37a009d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:08.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.898+0000 7f37a622c700 1 --2- 172.21.15.40:0/3625275736 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37a009d400 0x7f37a009d830 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3794009840 tx=0x7f3794009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:08.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.898+0000 7f37a622c700 1 -- 172.21.15.40:0/3625275736 shutdown_connections 2023-09-30T22:26:08.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.898+0000 7f37a622c700 1 --2- 172.21.15.40:0/3625275736 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f37a0133e00 0x7f37a01341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:08.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.898+0000 7f37a622c700 1 --2- 172.21.15.40:0/3625275736 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37a009dd70 0x7f37a013ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:08.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.898+0000 7f37a622c700 1 --2- 172.21.15.40:0/3625275736 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37a009d400 0x7f37a009d830 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:08.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.898+0000 7f37a622c700 1 -- 172.21.15.40:0/3625275736 >> 172.21.15.40:0/3625275736 conn(0x7f37a00a2a00 msgr2=0x7f37a00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:08.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.898+0000 7f37a622c700 1 -- 172.21.15.40:0/3625275736 shutdown_connections 2023-09-30T22:26:08.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.898+0000 7f37a622c700 1 -- 172.21.15.40:0/3625275736 wait complete. 2023-09-30T22:26:08.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.899+0000 7f37a622c700 1 Processor -- start 2023-09-30T22:26:08.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.900+0000 7f37a622c700 1 -- start start 2023-09-30T22:26:08.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.900+0000 7f37a622c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37a009d400 0x7f37a0119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:08.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.900+0000 7f37a622c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f37a009dd70 0x7f37a0119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:08.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.900+0000 7f37a622c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37a0133e00 0x7f37a0119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:08.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.900+0000 7f37a622c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a011c630 con 0x7f37a009d400 2023-09-30T22:26:08.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.900+0000 7f37a622c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a012e1a0 con 0x7f37a0133e00 2023-09-30T22:26:08.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.900+0000 7f37a622c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37a009c4f0 con 0x7f37a009dd70 2023-09-30T22:26:08.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.901+0000 7f379f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37a009d400 0x7f37a0119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:08.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.901+0000 7f379f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37a009d400 0x7f37a0119050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36950/0 (socket says 172.21.15.40:36950) 2023-09-30T22:26:08.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.901+0000 7f379f7fe700 1 -- 172.21.15.40:0/2650977671 learned_addr learned my addr 172.21.15.40:0/2650977671 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:08.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.901+0000 7f379ffff700 1 --2- 172.21.15.40:0/2650977671 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37a0133e00 0x7f37a0119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:08.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.901+0000 7f379f7fe700 1 -- 172.21.15.40:0/2650977671 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f37a009dd70 msgr2=0x7f37a0119590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:26:08.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.901+0000 7f379f7fe700 1 --2- 172.21.15.40:0/2650977671 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f37a009dd70 0x7f37a0119590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:08.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.901+0000 7f379f7fe700 1 -- 172.21.15.40:0/2650977671 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37a0133e00 msgr2=0x7f37a0119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:08.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.901+0000 7f379f7fe700 1 --2- 172.21.15.40:0/2650977671 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37a0133e00 0x7f37a0119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:08.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.901+0000 7f379f7fe700 1 -- 172.21.15.40:0/2650977671 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37940094a0 con 0x7f37a009d400 2023-09-30T22:26:08.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.901+0000 7f379f7fe700 1 --2- 172.21.15.40:0/2650977671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37a009d400 0x7f37a0119050 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f379000e910 tx=0x7f379000ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:08.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.901+0000 7f3787fff700 1 -- 172.21.15.40:0/2650977671 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37900096a0 con 0x7f37a009d400 2023-09-30T22:26:08.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.901+0000 7f37a622c700 1 -- 172.21.15.40:0/2650977671 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37a011bd20 con 0x7f37a009d400 2023-09-30T22:26:08.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.901+0000 7f3787fff700 1 -- 172.21.15.40:0/2650977671 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379000ee60 con 0x7f37a009d400 2023-09-30T22:26:08.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.901+0000 7f37a622c700 1 -- 172.21.15.40:0/2650977671 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a011abd0 con 0x7f37a009d400 2023-09-30T22:26:08.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.902+0000 7f3787fff700 1 -- 172.21.15.40:0/2650977671 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379000ca50 con 0x7f37a009d400 2023-09-30T22:26:08.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.902+0000 7f3787fff700 1 -- 172.21.15.40:0/2650977671 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f379000cbb0 con 0x7f37a009d400 2023-09-30T22:26:08.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.903+0000 7f3787fff700 1 -- 172.21.15.40:0/2650977671 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f379003fa10 con 0x7f37a009d400 2023-09-30T22:26:08.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.903+0000 7f37a622c700 1 -- 172.21.15.40:0/2650977671 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37800052e0 con 0x7f37a009d400 2023-09-30T22:26:08.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.909+0000 7f3787fff700 1 -- 172.21.15.40:0/2650977671 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3790017080 con 0x7f37a009d400 2023-09-30T22:26:08.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.941+0000 7f13337e4700 1 -- 172.21.15.40:0/2579233417 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f132c094980 con 0x7f132c138370 2023-09-30T22:26:08.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.941+0000 7f131dffb700 1 -- 172.21.15.40:0/2579233417 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f132401ab70 con 0x7f132c138370 2023-09-30T22:26:08.941 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:08.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.943+0000 7f13337e4700 1 -- 172.21.15.40:0/2579233417 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f132c138370 msgr2=0x7f132c095bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:08.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.943+0000 7f13337e4700 1 --2- 172.21.15.40:0/2579233417 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f132c138370 0x7f132c095bc0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f132c0978d0 tx=0x7f1324004ad0 comp rx=0 tx=0).stop 2023-09-30T22:26:08.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.943+0000 7f13337e4700 1 -- 172.21.15.40:0/2579233417 shutdown_connections 2023-09-30T22:26:08.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.943+0000 7f13337e4700 1 --2- 172.21.15.40:0/2579233417 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f132c06ced0 0x7f132c137850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:08.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.943+0000 7f13337e4700 1 --2- 172.21.15.40:0/2579233417 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f132c138370 0x7f132c095bc0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:08.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.943+0000 7f13337e4700 1 --2- 172.21.15.40:0/2579233417 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f132c09fbb0 0x7f132c137d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:08.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.943+0000 7f13337e4700 1 -- 172.21.15.40:0/2579233417 >> 172.21.15.40:0/2579233417 conn(0x7f132c0a41a0 msgr2=0x7f132c0a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:08.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.943+0000 7f13337e4700 1 -- 172.21.15.40:0/2579233417 shutdown_connections 2023-09-30T22:26:08.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.944+0000 7f13337e4700 1 -- 172.21.15.40:0/2579233417 wait complete. 2023-09-30T22:26:08.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:08.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.979+0000 7f5994034700 1 Processor -- start 2023-09-30T22:26:08.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.980+0000 7f5994034700 1 -- start start 2023-09-30T22:26:08.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.980+0000 7f5994034700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f598c09fbb0 0x7f598c06c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:08.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.980+0000 7f5994034700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f598c139380 0x7f598c13b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:08.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.980+0000 7f5994034700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f598c06e3f0 con 0x7f598c06ced0 2023-09-30T22:26:08.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.980+0000 7f5994034700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f598c09ff80 con 0x7f598c139380 2023-09-30T22:26:08.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.980+0000 7f5994034700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f598c06ec40 con 0x7f598c09fbb0 2023-09-30T22:26:08.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.980+0000 7f59915cf700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f598c06ced0 0x7f598c06d2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40806/0 (socket says 172.21.15.40:40806) 2023-09-30T22:26:08.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.980+0000 7f59915cf700 1 -- 172.21.15.40:0/3289779333 learned_addr learned my addr 172.21.15.40:0/3289779333 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:08.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.980+0000 7f5991dd0700 1 --2- 172.21.15.40:0/3289779333 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f598c09fbb0 0x7f598c06c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:08.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.980+0000 7f59925d1700 1 --2- 172.21.15.40:0/3289779333 >> v2:172.21.15.40:3300/0 conn(0x7f598c139380 0x7f598c13b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:08.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.981+0000 7f5991dd0700 1 -- 172.21.15.40:0/3289779333 >> v2:172.21.15.40:3300/0 conn(0x7f598c139380 msgr2=0x7f598c13b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:08.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.981+0000 7f5991dd0700 1 --2- 172.21.15.40:0/3289779333 >> v2:172.21.15.40:3300/0 conn(0x7f598c139380 0x7f598c13b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:08.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.981+0000 7f5991dd0700 1 -- 172.21.15.40:0/3289779333 >> v1:172.21.15.40:6789/0 conn(0x7f598c06ced0 legacy=0x7f598c06d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:08.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.981+0000 7f5990dce700 1 -- 172.21.15.40:0/3289779333 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 7561137 0 0) 0x7f598c06e3f0 con 0x7f598c06ced0 2023-09-30T22:26:08.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.981+0000 7f5991dd0700 1 -- 172.21.15.40:0/3289779333 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f598c06d9f0 con 0x7f598c09fbb0 2023-09-30T22:26:08.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.981+0000 7f59925d1700 1 --2- 172.21.15.40:0/3289779333 >> v2:172.21.15.40:3300/0 conn(0x7f598c139380 0x7f598c13b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:08.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.981+0000 7f5991dd0700 1 --2- 172.21.15.40:0/3289779333 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f598c09fbb0 0x7f598c06c990 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5988009840 tx=0x7f5988009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=232b01762c2e757b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:08.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.981+0000 7f5990dce700 1 -- 172.21.15.40:0/3289779333 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5988011830 con 0x7f598c09fbb0 2023-09-30T22:26:08.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.981+0000 7f5990dce700 1 -- 172.21.15.40:0/3289779333 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5988011990 con 0x7f598c09fbb0 2023-09-30T22:26:08.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.981+0000 7f5990dce700 1 -- 172.21.15.40:0/3289779333 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5988011d20 con 0x7f598c09fbb0 2023-09-30T22:26:08.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.982+0000 7f5994034700 1 -- 172.21.15.40:0/3289779333 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f598c09fbb0 msgr2=0x7f598c06c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:08.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.982+0000 7f5994034700 1 --2- 172.21.15.40:0/3289779333 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f598c09fbb0 0x7f598c06c990 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5988009840 tx=0x7f5988009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:08.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.982+0000 7f5994034700 1 -- 172.21.15.40:0/3289779333 shutdown_connections 2023-09-30T22:26:08.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.982+0000 7f5994034700 1 --2- 172.21.15.40:0/3289779333 >> v2:172.21.15.40:3300/0 conn(0x7f598c139380 0x7f598c13b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:08.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.982+0000 7f5994034700 1 --2- 172.21.15.40:0/3289779333 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f598c09fbb0 0x7f598c06c990 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:08.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.982+0000 7f5994034700 1 -- 172.21.15.40:0/3289779333 >> 172.21.15.40:0/3289779333 conn(0x7f598c0a41a0 msgr2=0x7f598c0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:08.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.982+0000 7f5994034700 1 -- 172.21.15.40:0/3289779333 shutdown_connections 2023-09-30T22:26:08.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.982+0000 7f5994034700 1 -- 172.21.15.40:0/3289779333 wait complete. 2023-09-30T22:26:08.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.983+0000 7f5994034700 1 Processor -- start 2023-09-30T22:26:08.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.983+0000 7f5994034700 1 -- start start 2023-09-30T22:26:08.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.984+0000 7f5994034700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f598c06ced0 0x7f598c1386e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:08.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.984+0000 7f5994034700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f598c09fbb0 0x7f598c138c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:08.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.984+0000 7f5994034700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f598c139380 0x7f598c0959d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:08.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.984+0000 7f5994034700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598c092f80 con 0x7f598c09fbb0 2023-09-30T22:26:08.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.984+0000 7f5994034700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f598c097170 con 0x7f598c139380 2023-09-30T22:26:08.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.984+0000 7f5994034700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f598c094850 con 0x7f598c06ced0 2023-09-30T22:26:08.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.984+0000 7f59915cf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f598c09fbb0 0x7f598c138c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:08.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.984+0000 7f59925d1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f598c139380 0x7f598c0959d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:08.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.984+0000 7f59925d1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f598c139380 0x7f598c0959d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52120/0 (socket says 172.21.15.40:52120) 2023-09-30T22:26:08.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.984+0000 7f59925d1700 1 -- 172.21.15.40:0/2032700969 learned_addr learned my addr 172.21.15.40:0/2032700969 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:08.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.984+0000 7f59915cf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f598c09fbb0 0x7f598c138c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36974/0 (socket says 172.21.15.40:36974) 2023-09-30T22:26:08.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.984+0000 7f59915cf700 1 -- 172.21.15.40:0/2032700969 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f598c06ced0 msgr2=0x7f598c1386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:08.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.984+0000 7f59915cf700 1 --2- 172.21.15.40:0/2032700969 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f598c06ced0 0x7f598c1386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:08.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.984+0000 7f59915cf700 1 -- 172.21.15.40:0/2032700969 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f598c139380 msgr2=0x7f598c0959d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:08.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.984+0000 7f59915cf700 1 --2- 172.21.15.40:0/2032700969 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f598c139380 0x7f598c0959d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:08.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.984+0000 7f59915cf700 1 -- 172.21.15.40:0/2032700969 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5984009a70 con 0x7f598c09fbb0 2023-09-30T22:26:08.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.984+0000 7f59925d1700 1 --2- 172.21.15.40:0/2032700969 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f598c139380 0x7f598c0959d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:08.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.985+0000 7f59915cf700 1 --2- 172.21.15.40:0/2032700969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f598c09fbb0 0x7f598c138c20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f598c067db0 tx=0x7f597c00c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:08.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.985+0000 7f59827fc700 1 -- 172.21.15.40:0/2032700969 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597c004c80 con 0x7f598c09fbb0 2023-09-30T22:26:08.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.985+0000 7f59827fc700 1 -- 172.21.15.40:0/2032700969 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597c004de0 con 0x7f598c09fbb0 2023-09-30T22:26:08.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.985+0000 7f5994034700 1 -- 172.21.15.40:0/2032700969 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59880094a0 con 0x7f598c09fbb0 2023-09-30T22:26:08.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.985+0000 7f59827fc700 1 -- 172.21.15.40:0/2032700969 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597c007310 con 0x7f598c09fbb0 2023-09-30T22:26:08.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.985+0000 7f5994034700 1 -- 172.21.15.40:0/2032700969 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f598c095580 con 0x7f598c09fbb0 2023-09-30T22:26:08.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.986+0000 7f59827fc700 1 -- 172.21.15.40:0/2032700969 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f597c007470 con 0x7f598c09fbb0 2023-09-30T22:26:08.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.986+0000 7f59827fc700 1 -- 172.21.15.40:0/2032700969 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f597c03f2b0 con 0x7f598c09fbb0 2023-09-30T22:26:08.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.986+0000 7f5994034700 1 -- 172.21.15.40:0/2032700969 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f598c062380 con 0x7f598c09fbb0 2023-09-30T22:26:08.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:08.991+0000 7f59827fc700 1 -- 172.21.15.40:0/2032700969 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f597c007720 con 0x7f598c09fbb0 2023-09-30T22:26:09.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.024+0000 7f8f73f41700 1 Processor -- start 2023-09-30T22:26:09.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.024+0000 7f8f73f41700 1 -- start start 2023-09-30T22:26:09.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.024+0000 7f8f73f41700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f6c06f070 0x7f8f6c06f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:09.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.025+0000 7f8f73f41700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f6c06fdb0 0x7f8f6c0977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:09.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.025+0000 7f8f73f41700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f6c070830 con 0x7f8f6c06f980 2023-09-30T22:26:09.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.025+0000 7f8f73f41700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c070ad0 con 0x7f8f6c06f070 2023-09-30T22:26:09.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.025+0000 7f8f73f41700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c070de0 con 0x7f8f6c06fdb0 2023-09-30T22:26:09.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.025+0000 7f8f71cdd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f6c06f070 0x7f8f6c06f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:09.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.025+0000 7f8f724de700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f6c06fdb0 0x7f8f6c0977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:09.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.025+0000 7f8f71cdd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f6c06f070 0x7f8f6c06f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52124/0 (socket says 172.21.15.40:52124) 2023-09-30T22:26:09.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.025+0000 7f8f714dc700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8f6c06f980 0x7f8f6c097090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40814/0 (socket says 172.21.15.40:40814) 2023-09-30T22:26:09.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.025+0000 7f8f71cdd700 1 -- 172.21.15.40:0/4052490081 learned_addr learned my addr 172.21.15.40:0/4052490081 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:09.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.025+0000 7f8f724de700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f6c06fdb0 0x7f8f6c0977a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41678/0 (socket says 172.21.15.40:41678) 2023-09-30T22:26:09.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.025+0000 7f8f71cdd700 1 -- 172.21.15.40:0/4052490081 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f6c06fdb0 msgr2=0x7f8f6c0977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:09.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.025+0000 7f8f71cdd700 1 --2- 172.21.15.40:0/4052490081 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f6c06fdb0 0x7f8f6c0977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.025+0000 7f8f71cdd700 1 -- 172.21.15.40:0/4052490081 >> v1:172.21.15.40:6789/0 conn(0x7f8f6c06f980 legacy=0x7f8f6c097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:09.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.025+0000 7f8f70cdb700 1 -- 172.21.15.40:0/4052490081 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1673886023 0 0) 0x7f8f6c070830 con 0x7f8f6c06f980 2023-09-30T22:26:09.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.025+0000 7f8f71cdd700 1 -- 172.21.15.40:0/4052490081 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f6c09fe20 con 0x7f8f6c06f070 2023-09-30T22:26:09.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.025+0000 7f8f71cdd700 1 --2- 172.21.15.40:0/4052490081 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f6c06f070 0x7f8f6c06f440 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8f68009920 tx=0x7f8f68009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c49cc1d68c8425ab server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:09.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.025+0000 7f8f70cdb700 1 -- 172.21.15.40:0/4052490081 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f68011830 con 0x7f8f6c06f070 2023-09-30T22:26:09.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.025+0000 7f8f70cdb700 1 -- 172.21.15.40:0/4052490081 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f68011990 con 0x7f8f6c06f070 2023-09-30T22:26:09.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.026+0000 7f8f70cdb700 1 -- 172.21.15.40:0/4052490081 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f68011d20 con 0x7f8f6c06f070 2023-09-30T22:26:09.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.026+0000 7f8f73f41700 1 -- 172.21.15.40:0/4052490081 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f6c06f070 msgr2=0x7f8f6c06f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:09.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.026+0000 7f8f73f41700 1 --2- 172.21.15.40:0/4052490081 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f6c06f070 0x7f8f6c06f440 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8f68009920 tx=0x7f8f68009c30 comp rx=0 tx=0).stop 2023-09-30T22:26:09.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.026+0000 7f8f73f41700 1 -- 172.21.15.40:0/4052490081 shutdown_connections 2023-09-30T22:26:09.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.026+0000 7f8f73f41700 1 --2- 172.21.15.40:0/4052490081 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f6c06fdb0 0x7f8f6c0977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.026+0000 7f8f73f41700 1 --2- 172.21.15.40:0/4052490081 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f6c06f070 0x7f8f6c06f440 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.026+0000 7f8f73f41700 1 -- 172.21.15.40:0/4052490081 >> 172.21.15.40:0/4052490081 conn(0x7f8f6c0a41a0 msgr2=0x7f8f6c0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:09.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.027+0000 7f8f73f41700 1 -- 172.21.15.40:0/4052490081 shutdown_connections 2023-09-30T22:26:09.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.027+0000 7f8f73f41700 1 -- 172.21.15.40:0/4052490081 wait complete. 2023-09-30T22:26:09.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.027+0000 7f8f73f41700 1 Processor -- start 2023-09-30T22:26:09.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.027+0000 7f8f73f41700 1 -- start start 2023-09-30T22:26:09.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.028+0000 7f8f73f41700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f6c06f070 0x7f8f6c12d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:09.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.028+0000 7f8f73f41700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f6c06f980 0x7f8f6c12d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:09.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.028+0000 7f8f73f41700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f6c06fdb0 0x7f8f6c12da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:09.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.028+0000 7f8f73f41700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c12f990 con 0x7f8f6c06f980 2023-09-30T22:26:09.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.028+0000 7f8f73f41700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c130560 con 0x7f8f6c06f070 2023-09-30T22:26:09.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.028+0000 7f8f73f41700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c1293c0 con 0x7f8f6c06fdb0 2023-09-30T22:26:09.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.028+0000 7f8f71cdd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f6c06f070 0x7f8f6c12d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:09.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.028+0000 7f8f71cdd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f6c06f070 0x7f8f6c12d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52132/0 (socket says 172.21.15.40:52132) 2023-09-30T22:26:09.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.028+0000 7f8f71cdd700 1 -- 172.21.15.40:0/2317919411 learned_addr learned my addr 172.21.15.40:0/2317919411 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:09.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.028+0000 7f8f714dc700 1 --2- 172.21.15.40:0/2317919411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f6c06f980 0x7f8f6c12d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:09.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.028+0000 7f8f724de700 1 --2- 172.21.15.40:0/2317919411 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f6c06fdb0 0x7f8f6c12da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:09.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.028+0000 7f8f71cdd700 1 -- 172.21.15.40:0/2317919411 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f6c06fdb0 msgr2=0x7f8f6c12da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:09.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.028+0000 7f8f71cdd700 1 --2- 172.21.15.40:0/2317919411 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f6c06fdb0 0x7f8f6c12da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.028+0000 7f8f71cdd700 1 -- 172.21.15.40:0/2317919411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f6c06f980 msgr2=0x7f8f6c12d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:09.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.028+0000 7f8f71cdd700 1 --2- 172.21.15.40:0/2317919411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f6c06f980 0x7f8f6c12d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.028+0000 7f8f71cdd700 1 -- 172.21.15.40:0/2317919411 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f68009550 con 0x7f8f6c06f070 2023-09-30T22:26:09.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.029+0000 7f8f71cdd700 1 --2- 172.21.15.40:0/2317919411 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f6c06f070 0x7f8f6c12d010 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8f68000c00 tx=0x7f8f68004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:09.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.029+0000 7f8f627fc700 1 -- 172.21.15.40:0/2317919411 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f68004510 con 0x7f8f6c06f070 2023-09-30T22:26:09.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.029+0000 7f8f627fc700 1 -- 172.21.15.40:0/2317919411 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f680036a0 con 0x7f8f6c06f070 2023-09-30T22:26:09.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.029+0000 7f8f627fc700 1 -- 172.21.15.40:0/2317919411 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f68003a10 con 0x7f8f6c06f070 2023-09-30T22:26:09.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.029+0000 7f8f73f41700 1 -- 172.21.15.40:0/2317919411 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f6c130790 con 0x7f8f6c06f070 2023-09-30T22:26:09.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.029+0000 7f8f73f41700 1 -- 172.21.15.40:0/2317919411 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f6c12f040 con 0x7f8f6c06f070 2023-09-30T22:26:09.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.030+0000 7f8f73f41700 1 -- 172.21.15.40:0/2317919411 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f6c062380 con 0x7f8f6c06f070 2023-09-30T22:26:09.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.030+0000 7f8f627fc700 1 -- 172.21.15.40:0/2317919411 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8f68021070 con 0x7f8f6c06f070 2023-09-30T22:26:09.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.031+0000 7f8f627fc700 1 -- 172.21.15.40:0/2317919411 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f8f68040a80 con 0x7f8f6c06f070 2023-09-30T22:26:09.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.039+0000 7f8f627fc700 1 -- 172.21.15.40:0/2317919411 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8f6802d760 con 0x7f8f6c06f070 2023-09-30T22:26:09.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.133+0000 7f37a622c700 1 -- 172.21.15.40:0/2650977671 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3780005590 con 0x7f37a009d400 2023-09-30T22:26:09.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.133+0000 7f3787fff700 1 -- 172.21.15.40:0/2650977671 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3790021020 con 0x7f37a009d400 2023-09-30T22:26:09.133 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:09.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.135+0000 7f37a622c700 1 -- 172.21.15.40:0/2650977671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37a009d400 msgr2=0x7f37a0119050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:09.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.135+0000 7f37a622c700 1 --2- 172.21.15.40:0/2650977671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37a009d400 0x7f37a0119050 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f379000e910 tx=0x7f379000ec20 comp rx=0 tx=0).stop 2023-09-30T22:26:09.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.135+0000 7f37a622c700 1 -- 172.21.15.40:0/2650977671 shutdown_connections 2023-09-30T22:26:09.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.135+0000 7f37a622c700 1 --2- 172.21.15.40:0/2650977671 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37a0133e00 0x7f37a0119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.135+0000 7f37a622c700 1 --2- 172.21.15.40:0/2650977671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37a009d400 0x7f37a0119050 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.135+0000 7f37a622c700 1 --2- 172.21.15.40:0/2650977671 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f37a009dd70 0x7f37a0119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.135+0000 7f37a622c700 1 -- 172.21.15.40:0/2650977671 >> 172.21.15.40:0/2650977671 conn(0x7f37a00a2a00 msgr2=0x7f37a012d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:09.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.135+0000 7f37a622c700 1 -- 172.21.15.40:0/2650977671 shutdown_connections 2023-09-30T22:26:09.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.135+0000 7f37a622c700 1 -- 172.21.15.40:0/2650977671 wait complete. 2023-09-30T22:26:09.147 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:09.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.207+0000 7f5994034700 1 -- 172.21.15.40:0/2032700969 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f598c094a10 con 0x7f598c09fbb0 2023-09-30T22:26:09.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.208+0000 7f59827fc700 1 -- 172.21.15.40:0/2032700969 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f597c011360 con 0x7f598c09fbb0 2023-09-30T22:26:09.207 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:09.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.210+0000 7f5994034700 1 -- 172.21.15.40:0/2032700969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f598c09fbb0 msgr2=0x7f598c138c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:09.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.210+0000 7f5994034700 1 --2- 172.21.15.40:0/2032700969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f598c09fbb0 0x7f598c138c20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f598c067db0 tx=0x7f597c00c750 comp rx=0 tx=0).stop 2023-09-30T22:26:09.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.210+0000 7f5994034700 1 -- 172.21.15.40:0/2032700969 shutdown_connections 2023-09-30T22:26:09.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.210+0000 7f5994034700 1 --2- 172.21.15.40:0/2032700969 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f598c06ced0 0x7f598c1386e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.210+0000 7f5994034700 1 --2- 172.21.15.40:0/2032700969 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f598c139380 0x7f598c0959d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.210+0000 7f5994034700 1 --2- 172.21.15.40:0/2032700969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f598c09fbb0 0x7f598c138c20 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.210+0000 7f5994034700 1 -- 172.21.15.40:0/2032700969 >> 172.21.15.40:0/2032700969 conn(0x7f598c0a41a0 msgr2=0x7f598c0a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:09.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.210+0000 7f5994034700 1 -- 172.21.15.40:0/2032700969 shutdown_connections 2023-09-30T22:26:09.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.210+0000 7f5994034700 1 -- 172.21.15.40:0/2032700969 wait complete. 2023-09-30T22:26:09.221 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:09.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.237+0000 7f8f73f41700 1 -- 172.21.15.40:0/2317919411 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8f6c131650 con 0x7f8f6c06f070 2023-09-30T22:26:09.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.237+0000 7f8f627fc700 1 -- 172.21.15.40:0/2317919411 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8f68029070 con 0x7f8f6c06f070 2023-09-30T22:26:09.237 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:09.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.239+0000 7f8f73f41700 1 -- 172.21.15.40:0/2317919411 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f6c06f070 msgr2=0x7f8f6c12d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:09.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.239+0000 7f8f73f41700 1 --2- 172.21.15.40:0/2317919411 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f6c06f070 0x7f8f6c12d010 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8f68000c00 tx=0x7f8f68004750 comp rx=0 tx=0).stop 2023-09-30T22:26:09.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.239+0000 7f8f73f41700 1 -- 172.21.15.40:0/2317919411 shutdown_connections 2023-09-30T22:26:09.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.239+0000 7f8f73f41700 1 --2- 172.21.15.40:0/2317919411 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f6c06fdb0 0x7f8f6c12da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.239+0000 7f8f73f41700 1 --2- 172.21.15.40:0/2317919411 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f6c06f070 0x7f8f6c12d010 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.239+0000 7f8f73f41700 1 --2- 172.21.15.40:0/2317919411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f6c06f980 0x7f8f6c12d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.239+0000 7f8f73f41700 1 -- 172.21.15.40:0/2317919411 >> 172.21.15.40:0/2317919411 conn(0x7f8f6c0a41a0 msgr2=0x7f8f6c0975c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:09.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.239+0000 7f8f73f41700 1 -- 172.21.15.40:0/2317919411 shutdown_connections 2023-09-30T22:26:09.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:09.239+0000 7f8f73f41700 1 -- 172.21.15.40:0/2317919411 wait complete. 2023-09-30T22:26:09.251 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:09.958 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:10.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.099+0000 7fe089b07700 1 Processor -- start 2023-09-30T22:26:10.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.100+0000 7fe089b07700 1 -- start start 2023-09-30T22:26:10.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.100+0000 7fe089b07700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe08412e590 0x7fe08412e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.100+0000 7fe089b07700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe08412d8a0 0x7fe084138c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.100+0000 7fe089b07700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe08409ab70 con 0x7fe08412eea0 2023-09-30T22:26:10.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.100+0000 7fe089b07700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe08409b270 con 0x7fe08412d8a0 2023-09-30T22:26:10.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.100+0000 7fe089b07700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe08409bab0 con 0x7fe08412e590 2023-09-30T22:26:10.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.101+0000 7fe0837fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe08412e590 0x7fe08412e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.101+0000 7fe083fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe08412d8a0 0x7fe084138c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.101+0000 7fe083fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe08412d8a0 0x7fe084138c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36994/0 (socket says 172.21.15.40:36994) 2023-09-30T22:26:10.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.101+0000 7fe0837fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe08412e590 0x7fe08412e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52136/0 (socket says 172.21.15.40:52136) 2023-09-30T22:26:10.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.101+0000 7fe083fff700 1 -- 172.21.15.40:0/1573862985 learned_addr learned my addr 172.21.15.40:0/1573862985 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:10.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.101+0000 7fe0837fe700 1 -- 172.21.15.40:0/1573862985 >> v2:172.21.15.40:3300/0 conn(0x7fe08412d8a0 msgr2=0x7fe084138c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:10.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.101+0000 7fe0837fe700 1 --2- 172.21.15.40:0/1573862985 >> v2:172.21.15.40:3300/0 conn(0x7fe08412d8a0 0x7fe084138c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.101+0000 7fe0837fe700 1 -- 172.21.15.40:0/1573862985 >> v1:172.21.15.40:6789/0 conn(0x7fe08412eea0 legacy=0x7fe08412d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.101+0000 7fe0837fe700 1 -- 172.21.15.40:0/1573862985 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe08409bd70 con 0x7fe08412e590 2023-09-30T22:26:10.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.101+0000 7fe083fff700 1 --2- 172.21.15.40:0/1573862985 >> v2:172.21.15.40:3300/0 conn(0x7fe08412d8a0 0x7fe084138c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:10.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.101+0000 7fe0837fe700 1 --2- 172.21.15.40:0/1573862985 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe08412e590 0x7fe08412e960 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe074009870 tx=0x7fe074009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c367956b7d6a8c80 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:10.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.101+0000 7fe0827fc700 1 -- 172.21.15.40:0/1573862985 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe074011830 con 0x7fe08412e590 2023-09-30T22:26:10.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.101+0000 7fe0827fc700 1 -- 172.21.15.40:0/1573862985 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe074011990 con 0x7fe08412e590 2023-09-30T22:26:10.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.101+0000 7fe0827fc700 1 -- 172.21.15.40:0/1573862985 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe074011d20 con 0x7fe08412e590 2023-09-30T22:26:10.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.102+0000 7fe089b07700 1 -- 172.21.15.40:0/1573862985 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe08412e590 msgr2=0x7fe08412e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.102+0000 7fe089b07700 1 --2- 172.21.15.40:0/1573862985 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe08412e590 0x7fe08412e960 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe074009870 tx=0x7fe074009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:10.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.102+0000 7fe089b07700 1 -- 172.21.15.40:0/1573862985 shutdown_connections 2023-09-30T22:26:10.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.102+0000 7fe089b07700 1 --2- 172.21.15.40:0/1573862985 >> v2:172.21.15.40:3300/0 conn(0x7fe08412d8a0 0x7fe084138c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.102+0000 7fe089b07700 1 --2- 172.21.15.40:0/1573862985 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe08412e590 0x7fe08412e960 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.102+0000 7fe089b07700 1 -- 172.21.15.40:0/1573862985 >> 172.21.15.40:0/1573862985 conn(0x7fe0840a2a00 msgr2=0x7fe0840a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:10.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.102+0000 7fe089b07700 1 -- 172.21.15.40:0/1573862985 shutdown_connections 2023-09-30T22:26:10.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.102+0000 7fe089b07700 1 -- 172.21.15.40:0/1573862985 wait complete. 2023-09-30T22:26:10.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.103+0000 7fe089b07700 1 Processor -- start 2023-09-30T22:26:10.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.103+0000 7fe089b07700 1 -- start start 2023-09-30T22:26:10.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.104+0000 7fe089b07700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe08412d8a0 0x7fe0841c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.104+0000 7fe089b07700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe08412e590 0x7fe0841c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.104+0000 7fe089b07700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe08412eea0 0x7fe084139190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.104+0000 7fe089b07700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe084119500 con 0x7fe08412d8a0 2023-09-30T22:26:10.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.104+0000 7fe089b07700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0841c8520 con 0x7fe08412e590 2023-09-30T22:26:10.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.104+0000 7fe089b07700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe08409b4b0 con 0x7fe08412eea0 2023-09-30T22:26:10.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.104+0000 7fe0837fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe08412d8a0 0x7fe0841c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.104+0000 7fe0837fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe08412d8a0 0x7fe0841c8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37002/0 (socket says 172.21.15.40:37002) 2023-09-30T22:26:10.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.104+0000 7fe082ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe08412e590 0x7fe0841c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.104+0000 7fe0837fe700 1 -- 172.21.15.40:0/4263654010 learned_addr learned my addr 172.21.15.40:0/4263654010 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:10.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.104+0000 7fe083fff700 1 --2- 172.21.15.40:0/4263654010 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe08412eea0 0x7fe084139190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.104+0000 7fe0837fe700 1 -- 172.21.15.40:0/4263654010 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe08412eea0 msgr2=0x7fe084139190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.104+0000 7fe0837fe700 1 --2- 172.21.15.40:0/4263654010 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe08412eea0 0x7fe084139190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.104+0000 7fe0837fe700 1 -- 172.21.15.40:0/4263654010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe08412e590 msgr2=0x7fe0841c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.104+0000 7fe0837fe700 1 --2- 172.21.15.40:0/4263654010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe08412e590 0x7fe0841c8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.104+0000 7fe0837fe700 1 -- 172.21.15.40:0/4263654010 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07c009b30 con 0x7fe08412d8a0 2023-09-30T22:26:10.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.104+0000 7fe0837fe700 1 --2- 172.21.15.40:0/4263654010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe08412d8a0 0x7fe0841c8970 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe0740090b0 tx=0x7fe074004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:10.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.104+0000 7fe06bfff700 1 -- 172.21.15.40:0/4263654010 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0740044d0 con 0x7fe08412d8a0 2023-09-30T22:26:10.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.104+0000 7fe06bfff700 1 -- 172.21.15.40:0/4263654010 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07401f070 con 0x7fe08412d8a0 2023-09-30T22:26:10.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.104+0000 7fe06bfff700 1 -- 172.21.15.40:0/4263654010 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0740038e0 con 0x7fe08412d8a0 2023-09-30T22:26:10.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.104+0000 7fe089b07700 1 -- 172.21.15.40:0/4263654010 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0740094a0 con 0x7fe08412d8a0 2023-09-30T22:26:10.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.104+0000 7fe089b07700 1 -- 172.21.15.40:0/4263654010 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe08409cdb0 con 0x7fe08412d8a0 2023-09-30T22:26:10.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.105+0000 7fe06bfff700 1 -- 172.21.15.40:0/4263654010 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe074003a40 con 0x7fe08412d8a0 2023-09-30T22:26:10.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.105+0000 7fe06bfff700 1 -- 172.21.15.40:0/4263654010 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe074021070 con 0x7fe08412d8a0 2023-09-30T22:26:10.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.105+0000 7fe089b07700 1 -- 172.21.15.40:0/4263654010 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe08409e010 con 0x7fe08412d8a0 2023-09-30T22:26:10.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.110+0000 7fe06bfff700 1 -- 172.21.15.40:0/4263654010 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe07402b070 con 0x7fe08412d8a0 2023-09-30T22:26:10.149 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:10.223 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:10.252 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:10.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.288+0000 7f3d100af700 1 Processor -- start 2023-09-30T22:26:10.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.289+0000 7f3d100af700 1 -- start start 2023-09-30T22:26:10.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.289+0000 7f3d100af700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d0809d450 0x7f3d0809d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.289+0000 7f3d100af700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d0809dd60 0x7f3d081301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.289+0000 7f3d100af700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3d08130700 0x7f3d08130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.289+0000 7f3d100af700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d0809e8b0 con 0x7f3d08130700 2023-09-30T22:26:10.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.289+0000 7f3d100af700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0809c3b0 con 0x7f3d0809d450 2023-09-30T22:26:10.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.289+0000 7f3d100af700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0809a6b0 con 0x7f3d0809dd60 2023-09-30T22:26:10.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.290+0000 7f3d0de4b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d0809d450 0x7f3d0809d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.290+0000 7f3d0de4b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d0809d450 0x7f3d0809d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52158/0 (socket says 172.21.15.40:52158) 2023-09-30T22:26:10.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.290+0000 7f3d0de4b700 1 -- 172.21.15.40:0/325336793 learned_addr learned my addr 172.21.15.40:0/325336793 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:10.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.290+0000 7f3d0e64c700 1 --2- 172.21.15.40:0/325336793 >> v2:172.21.15.40:3300/0 conn(0x7f3d08130700 0x7f3d08130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.290+0000 7f3d0de4b700 1 -- 172.21.15.40:0/325336793 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d0809dd60 msgr2=0x7f3d081301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:10.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.290+0000 7f3d0de4b700 1 --2- 172.21.15.40:0/325336793 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d0809dd60 0x7f3d081301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.290+0000 7f3d0de4b700 1 -- 172.21.15.40:0/325336793 >> v2:172.21.15.40:3300/0 conn(0x7f3d08130700 msgr2=0x7f3d08130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:10.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.290+0000 7f3d0de4b700 1 --2- 172.21.15.40:0/325336793 >> v2:172.21.15.40:3300/0 conn(0x7f3d08130700 0x7f3d08130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.290+0000 7f3d0de4b700 1 -- 172.21.15.40:0/325336793 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0809b4f0 con 0x7f3d0809d450 2023-09-30T22:26:10.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.290+0000 7f3d0e64c700 1 --2- 172.21.15.40:0/325336793 >> v2:172.21.15.40:3300/0 conn(0x7f3d08130700 0x7f3d08130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:10.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.290+0000 7f3d0de4b700 1 --2- 172.21.15.40:0/325336793 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d0809d450 0x7f3d0809d820 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3d0400b9a0 tx=0x7f3d0400bcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=589f63982e0b3516 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:10.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.291+0000 7f3d0ce49700 1 -- 172.21.15.40:0/325336793 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0400caa0 con 0x7f3d0809d450 2023-09-30T22:26:10.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.291+0000 7f3d0ce49700 1 -- 172.21.15.40:0/325336793 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0400cc00 con 0x7f3d0809d450 2023-09-30T22:26:10.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.291+0000 7f3d0ce49700 1 -- 172.21.15.40:0/325336793 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0400f460 con 0x7f3d0809d450 2023-09-30T22:26:10.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.292+0000 7f3d100af700 1 -- 172.21.15.40:0/325336793 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d0809d450 msgr2=0x7f3d0809d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.292+0000 7f3d100af700 1 --2- 172.21.15.40:0/325336793 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d0809d450 0x7f3d0809d820 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3d0400b9a0 tx=0x7f3d0400bcb0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.292+0000 7f3d100af700 1 -- 172.21.15.40:0/325336793 shutdown_connections 2023-09-30T22:26:10.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.292+0000 7f3d100af700 1 --2- 172.21.15.40:0/325336793 >> v2:172.21.15.40:3300/0 conn(0x7f3d08130700 0x7f3d08130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.292+0000 7f3d100af700 1 --2- 172.21.15.40:0/325336793 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d0809d450 0x7f3d0809d820 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.292+0000 7f3d100af700 1 --2- 172.21.15.40:0/325336793 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d0809dd60 0x7f3d081301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.292+0000 7f3d100af700 1 -- 172.21.15.40:0/325336793 >> 172.21.15.40:0/325336793 conn(0x7f3d080a2a00 msgr2=0x7f3d080a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:10.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.292+0000 7f3d100af700 1 -- 172.21.15.40:0/325336793 shutdown_connections 2023-09-30T22:26:10.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.292+0000 7f3d100af700 1 -- 172.21.15.40:0/325336793 wait complete. 2023-09-30T22:26:10.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.293+0000 7f3d100af700 1 Processor -- start 2023-09-30T22:26:10.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.293+0000 7f3d100af700 1 -- start start 2023-09-30T22:26:10.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.294+0000 7f3d100af700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d0809d450 0x7f3d081c4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.294+0000 7f3d100af700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d0809dd60 0x7f3d081c4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.294+0000 7f3d100af700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d08130700 0x7f3d081c4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.294+0000 7f3d100af700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0811d090 con 0x7f3d08130700 2023-09-30T22:26:10.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.294+0000 7f3d100af700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0811cea0 con 0x7f3d0809d450 2023-09-30T22:26:10.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.294+0000 7f3d100af700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0811d770 con 0x7f3d0809dd60 2023-09-30T22:26:10.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.294+0000 7f3d0e64c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d08130700 0x7f3d081c4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.294+0000 7f3d0e64c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d08130700 0x7f3d081c4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37026/0 (socket says 172.21.15.40:37026) 2023-09-30T22:26:10.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.294+0000 7f3d0e64c700 1 -- 172.21.15.40:0/1542299830 learned_addr learned my addr 172.21.15.40:0/1542299830 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:10.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.294+0000 7f3d0de4b700 1 --2- 172.21.15.40:0/1542299830 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d0809d450 0x7f3d081c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.295+0000 7f3d0d64a700 1 --2- 172.21.15.40:0/1542299830 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d0809dd60 0x7f3d081c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.295+0000 7f3d0e64c700 1 -- 172.21.15.40:0/1542299830 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d0809dd60 msgr2=0x7f3d081c4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.295+0000 7f3d0e64c700 1 --2- 172.21.15.40:0/1542299830 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d0809dd60 0x7f3d081c4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.295+0000 7f3d0e64c700 1 -- 172.21.15.40:0/1542299830 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d0809d450 msgr2=0x7f3d081c4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.295+0000 7f3d0e64c700 1 --2- 172.21.15.40:0/1542299830 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d0809d450 0x7f3d081c4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.295+0000 7f3d0e64c700 1 -- 172.21.15.40:0/1542299830 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0000f050 con 0x7f3d08130700 2023-09-30T22:26:10.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.295+0000 7f3d0de4b700 1 --2- 172.21.15.40:0/1542299830 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d0809d450 0x7f3d081c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:10.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.295+0000 7f3d0e64c700 1 --2- 172.21.15.40:0/1542299830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d08130700 0x7f3d081c4dc0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3d0000d720 tx=0x7f3d0000d750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:10.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.295+0000 7f3cfe7fc700 1 -- 172.21.15.40:0/1542299830 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d00012050 con 0x7f3d08130700 2023-09-30T22:26:10.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.295+0000 7f3cfe7fc700 1 -- 172.21.15.40:0/1542299830 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d00013040 con 0x7f3d08130700 2023-09-30T22:26:10.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.295+0000 7f3cfe7fc700 1 -- 172.21.15.40:0/1542299830 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d00003c60 con 0x7f3d08130700 2023-09-30T22:26:10.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.296+0000 7f3d100af700 1 -- 172.21.15.40:0/1542299830 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d0400b600 con 0x7f3d08130700 2023-09-30T22:26:10.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.296+0000 7f3d100af700 1 -- 172.21.15.40:0/1542299830 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d0809c5d0 con 0x7f3d08130700 2023-09-30T22:26:10.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.297+0000 7f3d100af700 1 -- 172.21.15.40:0/1542299830 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cf00052e0 con 0x7f3d08130700 2023-09-30T22:26:10.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.297+0000 7f3cfe7fc700 1 -- 172.21.15.40:0/1542299830 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3d0001b9c0 con 0x7f3d08130700 2023-09-30T22:26:10.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.297+0000 7f3cfe7fc700 1 -- 172.21.15.40:0/1542299830 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3d00048360 con 0x7f3d08130700 2023-09-30T22:26:10.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.302+0000 7f3cfe7fc700 1 -- 172.21.15.40:0/1542299830 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3d0001bc70 con 0x7f3d08130700 2023-09-30T22:26:10.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.318+0000 7fe089b07700 1 -- 172.21.15.40:0/4263654010 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe084062380 con 0x7fe08412d8a0 2023-09-30T22:26:10.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.318+0000 7fe06bfff700 1 -- 172.21.15.40:0/4263654010 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe074015030 con 0x7fe08412d8a0 2023-09-30T22:26:10.318 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:10.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.321+0000 7fe089b07700 1 -- 172.21.15.40:0/4263654010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe08412d8a0 msgr2=0x7fe0841c8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.321+0000 7fe089b07700 1 --2- 172.21.15.40:0/4263654010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe08412d8a0 0x7fe0841c8970 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe0740090b0 tx=0x7fe074004750 comp rx=0 tx=0).stop 2023-09-30T22:26:10.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.321+0000 7fe089b07700 1 -- 172.21.15.40:0/4263654010 shutdown_connections 2023-09-30T22:26:10.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.321+0000 7fe089b07700 1 --2- 172.21.15.40:0/4263654010 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe08412eea0 0x7fe084139190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.321+0000 7fe089b07700 1 --2- 172.21.15.40:0/4263654010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe08412d8a0 0x7fe0841c8970 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.321+0000 7fe089b07700 1 --2- 172.21.15.40:0/4263654010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe08412e590 0x7fe0841c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.321+0000 7fe089b07700 1 -- 172.21.15.40:0/4263654010 >> 172.21.15.40:0/4263654010 conn(0x7fe0840a2a00 msgr2=0x7fe084130d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:10.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.322+0000 7fe089b07700 1 -- 172.21.15.40:0/4263654010 shutdown_connections 2023-09-30T22:26:10.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.323+0000 7fe089b07700 1 -- 172.21.15.40:0/4263654010 wait complete. 2023-09-30T22:26:10.335 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:10.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.366+0000 7f6bb1b28700 1 Processor -- start 2023-09-30T22:26:10.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.366+0000 7f6bb1b28700 1 -- start start 2023-09-30T22:26:10.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.367+0000 7f6bb1b28700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6bac09c890 0x7f6bac09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.367+0000 7f6bb1b28700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6bac09d920 0x7f6bac09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.367+0000 7f6bb1b28700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bac0a2600 con 0x7f6bac09e2b0 2023-09-30T22:26:10.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.367+0000 7f6bb1b28700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bac0a29d0 con 0x7f6bac09d920 2023-09-30T22:26:10.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.367+0000 7f6bb1b28700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac09fb40 con 0x7f6bac09c890 2023-09-30T22:26:10.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.367+0000 7f6baaffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6bac09d920 0x7f6bac09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.367+0000 7f6bab7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6bac09c890 0x7f6bac09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.367+0000 7f6baaffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6bac09d920 0x7f6bac09dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37028/0 (socket says 172.21.15.40:37028) 2023-09-30T22:26:10.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.367+0000 7f6baaffd700 1 -- 172.21.15.40:0/2804257194 learned_addr learned my addr 172.21.15.40:0/2804257194 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:10.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.367+0000 7f6bab7fe700 1 -- 172.21.15.40:0/2804257194 >> v2:172.21.15.40:3300/0 conn(0x7f6bac09d920 msgr2=0x7f6bac09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:10.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.367+0000 7f6bab7fe700 1 --2- 172.21.15.40:0/2804257194 >> v2:172.21.15.40:3300/0 conn(0x7f6bac09d920 0x7f6bac09dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.367+0000 7f6bab7fe700 1 -- 172.21.15.40:0/2804257194 >> v1:172.21.15.40:6789/0 conn(0x7f6bac09e2b0 legacy=0x7f6bac13ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.367+0000 7f6bab7fe700 1 -- 172.21.15.40:0/2804257194 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bac09e750 con 0x7f6bac09c890 2023-09-30T22:26:10.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.367+0000 7f6bab7fe700 1 --2- 172.21.15.40:0/2804257194 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6bac09c890 0x7f6bac09cc60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c009de0 tx=0x7f6b9c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edc2ab8bd812007d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:10.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.367+0000 7f6baa7fc700 1 -- 172.21.15.40:0/2804257194 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c00e070 con 0x7f6bac09c890 2023-09-30T22:26:10.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.368+0000 7f6baa7fc700 1 -- 172.21.15.40:0/2804257194 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9c00bb20 con 0x7f6bac09c890 2023-09-30T22:26:10.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.368+0000 7f6baa7fc700 1 -- 172.21.15.40:0/2804257194 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c012430 con 0x7f6bac09c890 2023-09-30T22:26:10.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.368+0000 7f6bb1b28700 1 -- 172.21.15.40:0/2804257194 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6bac09c890 msgr2=0x7f6bac09cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.368+0000 7f6bb1b28700 1 --2- 172.21.15.40:0/2804257194 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6bac09c890 0x7f6bac09cc60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c009de0 tx=0x7f6b9c00b330 comp rx=0 tx=0).stop 2023-09-30T22:26:10.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.368+0000 7f6bb1b28700 1 -- 172.21.15.40:0/2804257194 shutdown_connections 2023-09-30T22:26:10.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.368+0000 7f6bb1b28700 1 --2- 172.21.15.40:0/2804257194 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6bac09c890 0x7f6bac09cc60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.368+0000 7f6bb1b28700 1 --2- 172.21.15.40:0/2804257194 >> v2:172.21.15.40:3300/0 conn(0x7f6bac09d920 0x7f6bac09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.368+0000 7f6bb1b28700 1 -- 172.21.15.40:0/2804257194 >> 172.21.15.40:0/2804257194 conn(0x7f6bac0a7080 msgr2=0x7f6bac0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:10.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.368+0000 7f6bb1b28700 1 -- 172.21.15.40:0/2804257194 shutdown_connections 2023-09-30T22:26:10.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.368+0000 7f6bb1b28700 1 -- 172.21.15.40:0/2804257194 wait complete. 2023-09-30T22:26:10.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.370+0000 7f6bb1b28700 1 Processor -- start 2023-09-30T22:26:10.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.370+0000 7f6bb1b28700 1 -- start start 2023-09-30T22:26:10.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.371+0000 7f6bb1b28700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bac09c890 0x7f6bac12d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.371+0000 7f6bb1b28700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6bac09d920 0x7f6bac12da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.371+0000 7f6bb1b28700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6bac09e2b0 0x7f6bac12df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.371+0000 7f6bb1b28700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac0a5d00 con 0x7f6bac09c890 2023-09-30T22:26:10.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.371+0000 7f6bb1b28700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac1300c0 con 0x7f6bac09e2b0 2023-09-30T22:26:10.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.371+0000 7f6bb1b28700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac12fc90 con 0x7f6bac09d920 2023-09-30T22:26:10.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.371+0000 7f6baaffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6bac09d920 0x7f6bac12da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.371+0000 7f6baaffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6bac09d920 0x7f6bac12da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41760/0 (socket says 172.21.15.40:41760) 2023-09-30T22:26:10.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.371+0000 7f6baaffd700 1 -- 172.21.15.40:0/681413564 learned_addr learned my addr 172.21.15.40:0/681413564 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:10.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.371+0000 7f6bab7fe700 1 --2- 172.21.15.40:0/681413564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bac09c890 0x7f6bac12d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.371+0000 7f6babfff700 1 --2- 172.21.15.40:0/681413564 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6bac09e2b0 0x7f6bac12df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.371+0000 7f6baaffd700 1 -- 172.21.15.40:0/681413564 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6bac09e2b0 msgr2=0x7f6bac12df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.371+0000 7f6baaffd700 1 --2- 172.21.15.40:0/681413564 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6bac09e2b0 0x7f6bac12df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.371+0000 7f6baaffd700 1 -- 172.21.15.40:0/681413564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bac09c890 msgr2=0x7f6bac12d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.371+0000 7f6baaffd700 1 --2- 172.21.15.40:0/681413564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bac09c890 0x7f6bac12d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.371+0000 7f6baaffd700 1 -- 172.21.15.40:0/681413564 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9c009a70 con 0x7f6bac09d920 2023-09-30T22:26:10.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.371+0000 7f6baaffd700 1 --2- 172.21.15.40:0/681413564 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6bac09d920 0x7f6bac12da10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6b9400e8e0 tx=0x7f6b9400ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:10.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.371+0000 7f6ba3fff700 1 -- 172.21.15.40:0/681413564 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b94013680 con 0x7f6bac09d920 2023-09-30T22:26:10.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.372+0000 7f6ba3fff700 1 -- 172.21.15.40:0/681413564 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b940137e0 con 0x7f6bac09d920 2023-09-30T22:26:10.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.372+0000 7f6bb1b28700 1 -- 172.21.15.40:0/681413564 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bac130510 con 0x7f6bac09d920 2023-09-30T22:26:10.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.372+0000 7f6ba3fff700 1 -- 172.21.15.40:0/681413564 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b94013b50 con 0x7f6bac09d920 2023-09-30T22:26:10.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.372+0000 7f6bb1b28700 1 -- 172.21.15.40:0/681413564 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bac12e490 con 0x7f6bac09d920 2023-09-30T22:26:10.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.373+0000 7f6bb1b28700 1 -- 172.21.15.40:0/681413564 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bac130bb0 con 0x7f6bac09d920 2023-09-30T22:26:10.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.373+0000 7f6ba3fff700 1 -- 172.21.15.40:0/681413564 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6b94013cb0 con 0x7f6bac09d920 2023-09-30T22:26:10.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.373+0000 7f6ba3fff700 1 -- 172.21.15.40:0/681413564 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6b9403f640 con 0x7f6bac09d920 2023-09-30T22:26:10.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.378+0000 7f6ba3fff700 1 -- 172.21.15.40:0/681413564 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6b9401be10 con 0x7f6bac09d920 2023-09-30T22:26:10.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.428+0000 7f3dd3a52700 1 Processor -- start 2023-09-30T22:26:10.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.428+0000 7f3dd3a52700 1 -- start start 2023-09-30T22:26:10.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.429+0000 7f3dd3a52700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3dcc136bf0 0x7f3dcc138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.429+0000 7f3dd3a52700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3dcc139510 0x7f3dcc13b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.429+0000 7f3dd3a52700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dcc0a2600 con 0x7f3dcc09c890 2023-09-30T22:26:10.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.429+0000 7f3dd3a52700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dcc0a29d0 con 0x7f3dcc139510 2023-09-30T22:26:10.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.429+0000 7f3dd3a52700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc09fb40 con 0x7f3dcc136bf0 2023-09-30T22:26:10.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.429+0000 7f3dd0fed700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3dcc136bf0 0x7f3dcc138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.429+0000 7f3dd1fef700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3dcc139510 0x7f3dcc13b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.429+0000 7f3dd0fed700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3dcc136bf0 0x7f3dcc138fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52184/0 (socket says 172.21.15.40:52184) 2023-09-30T22:26:10.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.429+0000 7f3dd0fed700 1 -- 172.21.15.40:0/2924834786 learned_addr learned my addr 172.21.15.40:0/2924834786 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:10.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.429+0000 7f3dd1fef700 1 -- 172.21.15.40:0/2924834786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3dcc136bf0 msgr2=0x7f3dcc138fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:10.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.429+0000 7f3dd1fef700 1 --2- 172.21.15.40:0/2924834786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3dcc136bf0 0x7f3dcc138fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.429+0000 7f3dd1fef700 1 -- 172.21.15.40:0/2924834786 >> v1:172.21.15.40:6789/0 conn(0x7f3dcc09c890 legacy=0x7f3dcc09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.429+0000 7f3dd1fef700 1 -- 172.21.15.40:0/2924834786 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dcc09d370 con 0x7f3dcc139510 2023-09-30T22:26:10.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.429+0000 7f3dd0fed700 1 --2- 172.21.15.40:0/2924834786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3dcc136bf0 0x7f3dcc138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:10.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.429+0000 7f3dd1fef700 1 --2- 172.21.15.40:0/2924834786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3dcc139510 0x7f3dcc13b8f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4009d90 tx=0x7f3dc400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27125781ae153b4f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:10.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.429+0000 7f3dc3fff700 1 -- 172.21.15.40:0/2924834786 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc400e070 con 0x7f3dcc139510 2023-09-30T22:26:10.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.430+0000 7f3dc3fff700 1 -- 172.21.15.40:0/2924834786 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc400bb20 con 0x7f3dcc139510 2023-09-30T22:26:10.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.430+0000 7f3dc3fff700 1 -- 172.21.15.40:0/2924834786 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4012430 con 0x7f3dcc139510 2023-09-30T22:26:10.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.430+0000 7f3dd3a52700 1 -- 172.21.15.40:0/2924834786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3dcc139510 msgr2=0x7f3dcc13b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.430+0000 7f3dd3a52700 1 --2- 172.21.15.40:0/2924834786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3dcc139510 0x7f3dcc13b8f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4009d90 tx=0x7f3dc400b330 comp rx=0 tx=0).stop 2023-09-30T22:26:10.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.430+0000 7f3dd3a52700 1 -- 172.21.15.40:0/2924834786 shutdown_connections 2023-09-30T22:26:10.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.430+0000 7f3dd3a52700 1 --2- 172.21.15.40:0/2924834786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3dcc139510 0x7f3dcc13b8f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.430+0000 7f3dd3a52700 1 --2- 172.21.15.40:0/2924834786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3dcc136bf0 0x7f3dcc138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.430+0000 7f3dd3a52700 1 -- 172.21.15.40:0/2924834786 >> 172.21.15.40:0/2924834786 conn(0x7f3dcc0a7080 msgr2=0x7f3dcc0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:10.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.430+0000 7f3dd3a52700 1 -- 172.21.15.40:0/2924834786 shutdown_connections 2023-09-30T22:26:10.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.430+0000 7f3dd3a52700 1 -- 172.21.15.40:0/2924834786 wait complete. 2023-09-30T22:26:10.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.431+0000 7f3dd3a52700 1 Processor -- start 2023-09-30T22:26:10.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.431+0000 7f3dd3a52700 1 -- start start 2023-09-30T22:26:10.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.432+0000 7f3dd3a52700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3dcc09c890 0x7f3dcc06ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.432+0000 7f3dd3a52700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3dcc136bf0 0x7f3dcc06f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.432+0000 7f3dd3a52700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3dcc139510 0x7f3dcc06f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.432+0000 7f3dd3a52700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc12b4e0 con 0x7f3dcc136bf0 2023-09-30T22:26:10.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.432+0000 7f3dd3a52700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc070970 con 0x7f3dcc09c890 2023-09-30T22:26:10.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.432+0000 7f3dd3a52700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc12c000 con 0x7f3dcc139510 2023-09-30T22:26:10.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.432+0000 7f3dd0fed700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3dcc136bf0 0x7f3dcc06f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.432+0000 7f3dd17ee700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3dcc09c890 0x7f3dcc06ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.432+0000 7f3dd0fed700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3dcc136bf0 0x7f3dcc06f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37060/0 (socket says 172.21.15.40:37060) 2023-09-30T22:26:10.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.432+0000 7f3dd0fed700 1 -- 172.21.15.40:0/3336188450 learned_addr learned my addr 172.21.15.40:0/3336188450 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:10.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.432+0000 7f3dd1fef700 1 --2- 172.21.15.40:0/3336188450 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3dcc139510 0x7f3dcc06f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.432+0000 7f3dd0fed700 1 -- 172.21.15.40:0/3336188450 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3dcc139510 msgr2=0x7f3dcc06f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.432+0000 7f3dd0fed700 1 --2- 172.21.15.40:0/3336188450 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3dcc139510 0x7f3dcc06f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.432+0000 7f3dd0fed700 1 -- 172.21.15.40:0/3336188450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3dcc09c890 msgr2=0x7f3dcc06ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.432+0000 7f3dd0fed700 1 --2- 172.21.15.40:0/3336188450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3dcc09c890 0x7f3dcc06ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.432+0000 7f3dd0fed700 1 -- 172.21.15.40:0/3336188450 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dbc009550 con 0x7f3dcc136bf0 2023-09-30T22:26:10.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.432+0000 7f3dd1fef700 1 --2- 172.21.15.40:0/3336188450 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3dcc139510 0x7f3dcc06f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:10.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.432+0000 7f3dd17ee700 1 --2- 172.21.15.40:0/3336188450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3dcc09c890 0x7f3dcc06ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:10.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.432+0000 7f3dd0fed700 1 --2- 172.21.15.40:0/3336188450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3dcc136bf0 0x7f3dcc06f450 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc00ebe0 tx=0x7f3dbc009e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:10.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.433+0000 7f3dc1ffb700 1 -- 172.21.15.40:0/3336188450 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc00c8b0 con 0x7f3dcc136bf0 2023-09-30T22:26:10.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.433+0000 7f3dc1ffb700 1 -- 172.21.15.40:0/3336188450 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dbc00ca10 con 0x7f3dcc136bf0 2023-09-30T22:26:10.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.433+0000 7f3dd3a52700 1 -- 172.21.15.40:0/3336188450 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dc4009a70 con 0x7f3dcc136bf0 2023-09-30T22:26:10.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.433+0000 7f3dc1ffb700 1 -- 172.21.15.40:0/3336188450 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc00cd80 con 0x7f3dcc136bf0 2023-09-30T22:26:10.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.433+0000 7f3dd3a52700 1 -- 172.21.15.40:0/3336188450 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dcc0715e0 con 0x7f3dcc136bf0 2023-09-30T22:26:10.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.434+0000 7f3dd3a52700 1 -- 172.21.15.40:0/3336188450 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dcc12be60 con 0x7f3dcc136bf0 2023-09-30T22:26:10.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.434+0000 7f3dc1ffb700 1 -- 172.21.15.40:0/3336188450 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3dbc013470 con 0x7f3dcc136bf0 2023-09-30T22:26:10.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.435+0000 7f3dc1ffb700 1 -- 172.21.15.40:0/3336188450 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3dbc03ff60 con 0x7f3dcc136bf0 2023-09-30T22:26:10.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.439+0000 7f3dc1ffb700 1 -- 172.21.15.40:0/3336188450 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3dbc06b750 con 0x7f3dcc136bf0 2023-09-30T22:26:10.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.538+0000 7f3d100af700 1 -- 172.21.15.40:0/1542299830 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3cf0005590 con 0x7f3d08130700 2023-09-30T22:26:10.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.538+0000 7f3cfe7fc700 1 -- 172.21.15.40:0/1542299830 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3d00028030 con 0x7f3d08130700 2023-09-30T22:26:10.538 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:10.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.540+0000 7f3d100af700 1 -- 172.21.15.40:0/1542299830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d08130700 msgr2=0x7f3d081c4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.540+0000 7f3d100af700 1 --2- 172.21.15.40:0/1542299830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d08130700 0x7f3d081c4dc0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3d0000d720 tx=0x7f3d0000d750 comp rx=0 tx=0).stop 2023-09-30T22:26:10.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.540+0000 7f3d100af700 1 -- 172.21.15.40:0/1542299830 shutdown_connections 2023-09-30T22:26:10.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.540+0000 7f3d100af700 1 --2- 172.21.15.40:0/1542299830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d08130700 0x7f3d081c4dc0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.540+0000 7f3d100af700 1 --2- 172.21.15.40:0/1542299830 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d0809d450 0x7f3d081c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.540+0000 7f3d100af700 1 --2- 172.21.15.40:0/1542299830 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d0809dd60 0x7f3d081c4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.540+0000 7f3d100af700 1 -- 172.21.15.40:0/1542299830 >> 172.21.15.40:0/1542299830 conn(0x7f3d080a2a00 msgr2=0x7f3d080a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:10.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.540+0000 7f3d100af700 1 -- 172.21.15.40:0/1542299830 shutdown_connections 2023-09-30T22:26:10.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.540+0000 7f3d100af700 1 -- 172.21.15.40:0/1542299830 wait complete. 2023-09-30T22:26:10.552 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:10.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.575+0000 7f6bb1b28700 1 -- 172.21.15.40:0/681413564 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6bac09ecf0 con 0x7f6bac09d920 2023-09-30T22:26:10.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.575+0000 7f6ba3fff700 1 -- 172.21.15.40:0/681413564 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6b9401b3b0 con 0x7f6bac09d920 2023-09-30T22:26:10.575 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:10.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.577+0000 7f6bb1b28700 1 -- 172.21.15.40:0/681413564 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6bac09d920 msgr2=0x7f6bac12da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.577+0000 7f6bb1b28700 1 --2- 172.21.15.40:0/681413564 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6bac09d920 0x7f6bac12da10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6b9400e8e0 tx=0x7f6b9400ebf0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.577+0000 7f6bb1b28700 1 -- 172.21.15.40:0/681413564 shutdown_connections 2023-09-30T22:26:10.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.577+0000 7f6bb1b28700 1 --2- 172.21.15.40:0/681413564 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6bac09e2b0 0x7f6bac12df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.577+0000 7f6bb1b28700 1 --2- 172.21.15.40:0/681413564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bac09c890 0x7f6bac12d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.577+0000 7f6bb1b28700 1 --2- 172.21.15.40:0/681413564 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6bac09d920 0x7f6bac12da10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.577+0000 7f6bb1b28700 1 -- 172.21.15.40:0/681413564 >> 172.21.15.40:0/681413564 conn(0x7f6bac0a7080 msgr2=0x7f6bac0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:10.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.578+0000 7f6bb1b28700 1 -- 172.21.15.40:0/681413564 shutdown_connections 2023-09-30T22:26:10.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.578+0000 7f6bb1b28700 1 -- 172.21.15.40:0/681413564 wait complete. 2023-09-30T22:26:10.589 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:10.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.636+0000 7f3dd3a52700 1 -- 172.21.15.40:0/3336188450 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3dcc12be00 con 0x7f3dcc136bf0 2023-09-30T22:26:10.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.636+0000 7f3dc1ffb700 1 -- 172.21.15.40:0/3336188450 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3dbc021020 con 0x7f3dcc136bf0 2023-09-30T22:26:10.636 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:10.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.638+0000 7f3dd3a52700 1 -- 172.21.15.40:0/3336188450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3dcc136bf0 msgr2=0x7f3dcc06f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.638+0000 7f3dd3a52700 1 --2- 172.21.15.40:0/3336188450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3dcc136bf0 0x7f3dcc06f450 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc00ebe0 tx=0x7f3dbc009e70 comp rx=0 tx=0).stop 2023-09-30T22:26:10.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.638+0000 7f3dd3a52700 1 -- 172.21.15.40:0/3336188450 shutdown_connections 2023-09-30T22:26:10.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.638+0000 7f3dd3a52700 1 --2- 172.21.15.40:0/3336188450 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3dcc139510 0x7f3dcc06f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.638+0000 7f3dd3a52700 1 --2- 172.21.15.40:0/3336188450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3dcc09c890 0x7f3dcc06ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.638+0000 7f3dd3a52700 1 --2- 172.21.15.40:0/3336188450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3dcc136bf0 0x7f3dcc06f450 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.638+0000 7f3dd3a52700 1 -- 172.21.15.40:0/3336188450 >> 172.21.15.40:0/3336188450 conn(0x7f3dcc0a7080 msgr2=0x7f3dcc136fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:10.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.638+0000 7f3dd3a52700 1 -- 172.21.15.40:0/3336188450 shutdown_connections 2023-09-30T22:26:10.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:10.638+0000 7f3dd3a52700 1 -- 172.21.15.40:0/3336188450 wait complete. 2023-09-30T22:26:10.650 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:11.336 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:11.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.478+0000 7f20d5b45700 1 Processor -- start 2023-09-30T22:26:11.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.478+0000 7f20d5b45700 1 -- start start 2023-09-30T22:26:11.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.479+0000 7f20d5b45700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20d009e400 0x7f20d0135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.479+0000 7f20d5b45700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f20d0136230 0x7f20d0138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.479+0000 7f20d5b45700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d009adf0 con 0x7f20d009d920 2023-09-30T22:26:11.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.479+0000 7f20d5b45700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d009e7f0 con 0x7f20d0136230 2023-09-30T22:26:11.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.479+0000 7f20d5b45700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20d009edf0 con 0x7f20d009e400 2023-09-30T22:26:11.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.479+0000 7f20c7fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20d009e400 0x7f20d0135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.479+0000 7f20cf7fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f20d009d920 0x7f20d009dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40840/0 (socket says 172.21.15.40:40840) 2023-09-30T22:26:11.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.479+0000 7f20cf7fe700 1 -- 172.21.15.40:0/1736243523 learned_addr learned my addr 172.21.15.40:0/1736243523 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:11.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.479+0000 7f20cffff700 1 --2- 172.21.15.40:0/1736243523 >> v2:172.21.15.40:3300/0 conn(0x7f20d0136230 0x7f20d0138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.479+0000 7f20c7fff700 1 -- 172.21.15.40:0/1736243523 >> v2:172.21.15.40:3300/0 conn(0x7f20d0136230 msgr2=0x7f20d0138610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:11.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.479+0000 7f20c7fff700 1 --2- 172.21.15.40:0/1736243523 >> v2:172.21.15.40:3300/0 conn(0x7f20d0136230 0x7f20d0138610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.479+0000 7f20c7fff700 1 -- 172.21.15.40:0/1736243523 >> v1:172.21.15.40:6789/0 conn(0x7f20d009d920 legacy=0x7f20d009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:11.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.479+0000 7f20c7fff700 1 -- 172.21.15.40:0/1736243523 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d009b660 con 0x7f20d009e400 2023-09-30T22:26:11.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.479+0000 7f20cffff700 1 --2- 172.21.15.40:0/1736243523 >> v2:172.21.15.40:3300/0 conn(0x7f20d0136230 0x7f20d0138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:11.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.480+0000 7f20c7fff700 1 --2- 172.21.15.40:0/1736243523 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20d009e400 0x7f20d0135cf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f20b8009840 tx=0x7f20b8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcdbc0d0cb342273 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:11.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.480+0000 7f20ceffd700 1 -- 172.21.15.40:0/1736243523 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b8011830 con 0x7f20d009e400 2023-09-30T22:26:11.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.480+0000 7f20ceffd700 1 -- 172.21.15.40:0/1736243523 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b8011990 con 0x7f20d009e400 2023-09-30T22:26:11.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.480+0000 7f20ceffd700 1 -- 172.21.15.40:0/1736243523 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b8011d20 con 0x7f20d009e400 2023-09-30T22:26:11.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.480+0000 7f20d5b45700 1 -- 172.21.15.40:0/1736243523 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20d009e400 msgr2=0x7f20d0135cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:11.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.480+0000 7f20d5b45700 1 --2- 172.21.15.40:0/1736243523 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20d009e400 0x7f20d0135cf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f20b8009840 tx=0x7f20b8009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:11.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.480+0000 7f20d5b45700 1 -- 172.21.15.40:0/1736243523 shutdown_connections 2023-09-30T22:26:11.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.480+0000 7f20d5b45700 1 --2- 172.21.15.40:0/1736243523 >> v2:172.21.15.40:3300/0 conn(0x7f20d0136230 0x7f20d0138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.480+0000 7f20d5b45700 1 --2- 172.21.15.40:0/1736243523 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20d009e400 0x7f20d0135cf0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.480+0000 7f20d5b45700 1 -- 172.21.15.40:0/1736243523 >> 172.21.15.40:0/1736243523 conn(0x7f20d009fb20 msgr2=0x7f20d009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:11.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.480+0000 7f20d5b45700 1 -- 172.21.15.40:0/1736243523 shutdown_connections 2023-09-30T22:26:11.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.480+0000 7f20d5b45700 1 -- 172.21.15.40:0/1736243523 wait complete. 2023-09-30T22:26:11.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.481+0000 7f20d5b45700 1 Processor -- start 2023-09-30T22:26:11.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.481+0000 7f20d5b45700 1 -- start start 2023-09-30T22:26:11.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.482+0000 7f20d5b45700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20d009d920 0x7f20d01206d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.482+0000 7f20d5b45700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20d009e400 0x7f20d0120c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.482+0000 7f20d5b45700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20d0136230 0x7f20d0121150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.482+0000 7f20d5b45700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d009cb70 con 0x7f20d009e400 2023-09-30T22:26:11.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.482+0000 7f20d5b45700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d0122850 con 0x7f20d0136230 2023-09-30T22:26:11.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.482+0000 7f20d5b45700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20d00a1e10 con 0x7f20d009d920 2023-09-30T22:26:11.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.482+0000 7f20c7fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20d009e400 0x7f20d0120c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.482+0000 7f20cf7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20d009d920 0x7f20d01206d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.482+0000 7f20c7fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20d009e400 0x7f20d0120c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37088/0 (socket says 172.21.15.40:37088) 2023-09-30T22:26:11.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.482+0000 7f20c7fff700 1 -- 172.21.15.40:0/3972521042 learned_addr learned my addr 172.21.15.40:0/3972521042 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:11.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.482+0000 7f20cffff700 1 --2- 172.21.15.40:0/3972521042 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20d0136230 0x7f20d0121150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.482+0000 7f20cf7fe700 1 -- 172.21.15.40:0/3972521042 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20d0136230 msgr2=0x7f20d0121150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:11.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.482+0000 7f20cf7fe700 1 --2- 172.21.15.40:0/3972521042 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20d0136230 0x7f20d0121150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.482+0000 7f20cf7fe700 1 -- 172.21.15.40:0/3972521042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20d009e400 msgr2=0x7f20d0120c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:11.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.482+0000 7f20cf7fe700 1 --2- 172.21.15.40:0/3972521042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20d009e400 0x7f20d0120c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.482+0000 7f20cf7fe700 1 -- 172.21.15.40:0/3972521042 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c8009a70 con 0x7f20d009d920 2023-09-30T22:26:11.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.482+0000 7f20cf7fe700 1 --2- 172.21.15.40:0/3972521042 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20d009d920 0x7f20d01206d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f20c000c500 tx=0x7f20c000c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:11.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.483+0000 7f20ccff9700 1 -- 172.21.15.40:0/3972521042 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c00074e0 con 0x7f20d009d920 2023-09-30T22:26:11.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.483+0000 7f20ccff9700 1 -- 172.21.15.40:0/3972521042 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c0007640 con 0x7f20d009d920 2023-09-30T22:26:11.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.483+0000 7f20ccff9700 1 -- 172.21.15.40:0/3972521042 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c0005a50 con 0x7f20d009d920 2023-09-30T22:26:11.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.483+0000 7f20d5b45700 1 -- 172.21.15.40:0/3972521042 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b80094a0 con 0x7f20d009d920 2023-09-30T22:26:11.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.483+0000 7f20d5b45700 1 -- 172.21.15.40:0/3972521042 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d0123e80 con 0x7f20d009d920 2023-09-30T22:26:11.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.483+0000 7f20ccff9700 1 -- 172.21.15.40:0/3972521042 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f20c0005bb0 con 0x7f20d009d920 2023-09-30T22:26:11.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.484+0000 7f20ccff9700 1 -- 172.21.15.40:0/3972521042 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f20c003e7b0 con 0x7f20d009d920 2023-09-30T22:26:11.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.484+0000 7f20d5b45700 1 -- 172.21.15.40:0/3972521042 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d0062380 con 0x7f20d009d920 2023-09-30T22:26:11.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.489+0000 7f20ccff9700 1 -- 172.21.15.40:0/3972521042 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f20c001a360 con 0x7f20d009d920 2023-09-30T22:26:11.553 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:11.591 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:11.651 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:11.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.690+0000 7fa75ede3700 1 Processor -- start 2023-09-30T22:26:11.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.690+0000 7fa75ede3700 1 -- start start 2023-09-30T22:26:11.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.690+0000 7fa75ede3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa75812e590 0x7fa75812e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.690+0000 7fa75ede3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa75812eea0 0x7fa75812d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.690+0000 7fa75ede3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa75812d6d0 0x7fa75812db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.690+0000 7fa75ede3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa75809ca30 con 0x7fa75812eea0 2023-09-30T22:26:11.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.690+0000 7fa75ede3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75809ab70 con 0x7fa75812e590 2023-09-30T22:26:11.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.690+0000 7fa75ede3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa75809bd70 con 0x7fa75812d6d0 2023-09-30T22:26:11.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.690+0000 7fa75cb7f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa75812e590 0x7fa75812e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.690+0000 7fa75cb7f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa75812e590 0x7fa75812e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52216/0 (socket says 172.21.15.40:52216) 2023-09-30T22:26:11.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.690+0000 7fa75cb7f700 1 -- 172.21.15.40:0/2510617092 learned_addr learned my addr 172.21.15.40:0/2510617092 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:11.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.690+0000 7fa75d380700 1 --2- 172.21.15.40:0/2510617092 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa75812d6d0 0x7fa75812db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.691+0000 7fa75d380700 1 -- 172.21.15.40:0/2510617092 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa75812e590 msgr2=0x7fa75812e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:11.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.691+0000 7fa75d380700 1 --2- 172.21.15.40:0/2510617092 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa75812e590 0x7fa75812e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.691+0000 7fa75d380700 1 -- 172.21.15.40:0/2510617092 >> v2:172.21.15.40:3300/0 conn(0x7fa75812eea0 msgr2=0x7fa75812d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:11.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.691+0000 7fa75d380700 1 --2- 172.21.15.40:0/2510617092 >> v2:172.21.15.40:3300/0 conn(0x7fa75812eea0 0x7fa75812d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.691+0000 7fa75d380700 1 -- 172.21.15.40:0/2510617092 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75809b270 con 0x7fa75812d6d0 2023-09-30T22:26:11.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.691+0000 7fa75cb7f700 1 --2- 172.21.15.40:0/2510617092 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa75812e590 0x7fa75812e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:11.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.691+0000 7fa75d380700 1 --2- 172.21.15.40:0/2510617092 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa75812d6d0 0x7fa75812db70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa750009d90 tx=0x7fa75000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33f1158be1b7970c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:11.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.691+0000 7fa7577fe700 1 -- 172.21.15.40:0/2510617092 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75000e070 con 0x7fa75812d6d0 2023-09-30T22:26:11.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.691+0000 7fa7577fe700 1 -- 172.21.15.40:0/2510617092 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75000bb20 con 0x7fa75812d6d0 2023-09-30T22:26:11.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.691+0000 7fa7577fe700 1 -- 172.21.15.40:0/2510617092 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa750012430 con 0x7fa75812d6d0 2023-09-30T22:26:11.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.692+0000 7fa75ede3700 1 -- 172.21.15.40:0/2510617092 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa75812d6d0 msgr2=0x7fa75812db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:11.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.692+0000 7fa75ede3700 1 --2- 172.21.15.40:0/2510617092 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa75812d6d0 0x7fa75812db70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa750009d90 tx=0x7fa75000b330 comp rx=0 tx=0).stop 2023-09-30T22:26:11.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.692+0000 7fa75ede3700 1 -- 172.21.15.40:0/2510617092 shutdown_connections 2023-09-30T22:26:11.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.692+0000 7fa75ede3700 1 --2- 172.21.15.40:0/2510617092 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa75812d6d0 0x7fa75812db70 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.692+0000 7fa75ede3700 1 --2- 172.21.15.40:0/2510617092 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa75812e590 0x7fa75812e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.692+0000 7fa75ede3700 1 --2- 172.21.15.40:0/2510617092 >> v2:172.21.15.40:3300/0 conn(0x7fa75812eea0 0x7fa75812d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.692+0000 7fa75ede3700 1 -- 172.21.15.40:0/2510617092 >> 172.21.15.40:0/2510617092 conn(0x7fa7580a2a00 msgr2=0x7fa7580a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:11.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.692+0000 7fa75ede3700 1 -- 172.21.15.40:0/2510617092 shutdown_connections 2023-09-30T22:26:11.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.692+0000 7fa75ede3700 1 -- 172.21.15.40:0/2510617092 wait complete. 2023-09-30T22:26:11.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.693+0000 7fa75ede3700 1 Processor -- start 2023-09-30T22:26:11.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.693+0000 7fa75ede3700 1 -- start start 2023-09-30T22:26:11.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.694+0000 7fa75ede3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa75812d6d0 0x7fa75811a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.694+0000 7fa75ede3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa75812e590 0x7fa75811af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.694+0000 7fa75ede3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa75812eea0 0x7fa75811b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.694+0000 7fa75ede3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75811be80 con 0x7fa75812eea0 2023-09-30T22:26:11.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.694+0000 7fa75ede3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75811c540 con 0x7fa75812d6d0 2023-09-30T22:26:11.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.694+0000 7fa75ede3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa75811cb60 con 0x7fa75812e590 2023-09-30T22:26:11.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.694+0000 7fa757fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa75812e590 0x7fa75811af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.694+0000 7fa75cb7f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa75812d6d0 0x7fa75811a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.694+0000 7fa757fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa75812e590 0x7fa75811af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41798/0 (socket says 172.21.15.40:41798) 2023-09-30T22:26:11.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.694+0000 7fa757fff700 1 -- 172.21.15.40:0/3097103952 learned_addr learned my addr 172.21.15.40:0/3097103952 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:11.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.695+0000 7fa75cb7f700 1 -- 172.21.15.40:0/3097103952 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa75812e590 msgr2=0x7fa75811af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:11.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.695+0000 7fa75cb7f700 1 --2- 172.21.15.40:0/3097103952 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa75812e590 0x7fa75811af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.695+0000 7fa75cb7f700 1 -- 172.21.15.40:0/3097103952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa75812eea0 msgr2=0x7fa75811b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:11.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.695+0000 7fa75cb7f700 1 --2- 172.21.15.40:0/3097103952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa75812eea0 0x7fa75811b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.695+0000 7fa75cb7f700 1 -- 172.21.15.40:0/3097103952 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74c00b7f0 con 0x7fa75812d6d0 2023-09-30T22:26:11.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.695+0000 7fa757fff700 1 --2- 172.21.15.40:0/3097103952 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa75812e590 0x7fa75811af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:11.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.695+0000 7fa75cb7f700 1 --2- 172.21.15.40:0/3097103952 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa75812d6d0 0x7fa75811a9d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa74c010f60 tx=0x7fa74c010f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:11.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.695+0000 7fa7557fa700 1 -- 172.21.15.40:0/3097103952 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c004230 con 0x7fa75812d6d0 2023-09-30T22:26:11.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.695+0000 7fa7557fa700 1 -- 172.21.15.40:0/3097103952 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74c004390 con 0x7fa75812d6d0 2023-09-30T22:26:11.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.695+0000 7fa75ede3700 1 -- 172.21.15.40:0/3097103952 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa750009a70 con 0x7fa75812d6d0 2023-09-30T22:26:11.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.695+0000 7fa7557fa700 1 -- 172.21.15.40:0/3097103952 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c00ee50 con 0x7fa75812d6d0 2023-09-30T22:26:11.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.695+0000 7fa75ede3700 1 -- 172.21.15.40:0/3097103952 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa75811e1c0 con 0x7fa75812d6d0 2023-09-30T22:26:11.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.697+0000 7fa75ede3700 1 -- 172.21.15.40:0/3097103952 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa75809b4b0 con 0x7fa75812d6d0 2023-09-30T22:26:11.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.697+0000 7fa7557fa700 1 -- 172.21.15.40:0/3097103952 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa74c0036a0 con 0x7fa75812d6d0 2023-09-30T22:26:11.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.697+0000 7fa7557fa700 1 -- 172.21.15.40:0/3097103952 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa74c042100 con 0x7fa75812d6d0 2023-09-30T22:26:11.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.701+0000 7f20d5b45700 1 -- 172.21.15.40:0/3972521042 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f20d0122a40 con 0x7f20d009d920 2023-09-30T22:26:11.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.701+0000 7fa7557fa700 1 -- 172.21.15.40:0/3097103952 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa74c00d940 con 0x7fa75812d6d0 2023-09-30T22:26:11.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.702+0000 7f20ccff9700 1 -- 172.21.15.40:0/3972521042 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f20c0018270 con 0x7f20d009d920 2023-09-30T22:26:11.702 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:11.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.704+0000 7f20d5b45700 1 -- 172.21.15.40:0/3972521042 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20d009d920 msgr2=0x7f20d01206d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:11.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.704+0000 7f20d5b45700 1 --2- 172.21.15.40:0/3972521042 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20d009d920 0x7f20d01206d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f20c000c500 tx=0x7f20c000c810 comp rx=0 tx=0).stop 2023-09-30T22:26:11.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.704+0000 7f20d5b45700 1 -- 172.21.15.40:0/3972521042 shutdown_connections 2023-09-30T22:26:11.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.704+0000 7f20d5b45700 1 --2- 172.21.15.40:0/3972521042 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20d009d920 0x7f20d01206d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.704+0000 7f20d5b45700 1 --2- 172.21.15.40:0/3972521042 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20d0136230 0x7f20d0121150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.704+0000 7f20d5b45700 1 --2- 172.21.15.40:0/3972521042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20d009e400 0x7f20d0120c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.704+0000 7f20d5b45700 1 -- 172.21.15.40:0/3972521042 >> 172.21.15.40:0/3972521042 conn(0x7f20d009fb20 msgr2=0x7f20d00a2450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:11.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.704+0000 7f20d5b45700 1 -- 172.21.15.40:0/3972521042 shutdown_connections 2023-09-30T22:26:11.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.704+0000 7f20d5b45700 1 -- 172.21.15.40:0/3972521042 wait complete. 2023-09-30T22:26:11.717 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:11.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.752+0000 7ffb4b43f700 1 Processor -- start 2023-09-30T22:26:11.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.752+0000 7ffb4b43f700 1 -- start start 2023-09-30T22:26:11.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.752+0000 7ffb4b43f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffb4406f070 0x7ffb4406f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.752+0000 7ffb4b43f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb4406f980 0x7ffb44097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.752+0000 7ffb4b43f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb4406fdb0 0x7ffb440975d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.752+0000 7ffb4b43f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb44070830 con 0x7ffb4406f070 2023-09-30T22:26:11.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.752+0000 7ffb4b43f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb44070ad0 con 0x7ffb4406fdb0 2023-09-30T22:26:11.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.752+0000 7ffb4b43f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb44070de0 con 0x7ffb4406f980 2023-09-30T22:26:11.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.752+0000 7ffb489da700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb4406f980 0x7ffb44097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.752+0000 7ffb489da700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb4406f980 0x7ffb44097090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41808/0 (socket says 172.21.15.40:41808) 2023-09-30T22:26:11.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.752+0000 7ffb489da700 1 -- 172.21.15.40:0/2907506652 learned_addr learned my addr 172.21.15.40:0/2907506652 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:11.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.752+0000 7ffb499dc700 1 --2- 172.21.15.40:0/2907506652 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb4406fdb0 0x7ffb440975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.753+0000 7ffb491db700 1 --2- 172.21.15.40:0/2907506652 >> v2:172.21.15.40:3300/0 conn(0x7ffb4406f070 0x7ffb4406f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.753+0000 7ffb489da700 1 -- 172.21.15.40:0/2907506652 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb4406fdb0 msgr2=0x7ffb440975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:11.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.753+0000 7ffb489da700 1 --2- 172.21.15.40:0/2907506652 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb4406fdb0 0x7ffb440975d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.753+0000 7ffb489da700 1 -- 172.21.15.40:0/2907506652 >> v2:172.21.15.40:3300/0 conn(0x7ffb4406f070 msgr2=0x7ffb4406f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:11.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.753+0000 7ffb489da700 1 --2- 172.21.15.40:0/2907506652 >> v2:172.21.15.40:3300/0 conn(0x7ffb4406f070 0x7ffb4406f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.753+0000 7ffb489da700 1 -- 172.21.15.40:0/2907506652 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb4409fe20 con 0x7ffb4406f980 2023-09-30T22:26:11.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.753+0000 7ffb499dc700 1 --2- 172.21.15.40:0/2907506652 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb4406fdb0 0x7ffb440975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:11.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.753+0000 7ffb489da700 1 --2- 172.21.15.40:0/2907506652 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb4406f980 0x7ffb44097090 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ffb380098f0 tx=0x7ffb38009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b27e2940279670c7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:11.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.753+0000 7ffb43fff700 1 -- 172.21.15.40:0/2907506652 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb38011830 con 0x7ffb4406f980 2023-09-30T22:26:11.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.753+0000 7ffb43fff700 1 -- 172.21.15.40:0/2907506652 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb38011990 con 0x7ffb4406f980 2023-09-30T22:26:11.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.753+0000 7ffb43fff700 1 -- 172.21.15.40:0/2907506652 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb38011d20 con 0x7ffb4406f980 2023-09-30T22:26:11.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.754+0000 7ffb4b43f700 1 -- 172.21.15.40:0/2907506652 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb4406f980 msgr2=0x7ffb44097090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:11.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.754+0000 7ffb4b43f700 1 --2- 172.21.15.40:0/2907506652 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb4406f980 0x7ffb44097090 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ffb380098f0 tx=0x7ffb38009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:11.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.754+0000 7ffb4b43f700 1 -- 172.21.15.40:0/2907506652 shutdown_connections 2023-09-30T22:26:11.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.754+0000 7ffb4b43f700 1 --2- 172.21.15.40:0/2907506652 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb4406fdb0 0x7ffb440975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.754+0000 7ffb4b43f700 1 --2- 172.21.15.40:0/2907506652 >> v2:172.21.15.40:3300/0 conn(0x7ffb4406f070 0x7ffb4406f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.754+0000 7ffb4b43f700 1 --2- 172.21.15.40:0/2907506652 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb4406f980 0x7ffb44097090 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.754+0000 7ffb4b43f700 1 -- 172.21.15.40:0/2907506652 >> 172.21.15.40:0/2907506652 conn(0x7ffb440a41a0 msgr2=0x7ffb440a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:11.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.754+0000 7ffb4b43f700 1 -- 172.21.15.40:0/2907506652 shutdown_connections 2023-09-30T22:26:11.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.754+0000 7ffb4b43f700 1 -- 172.21.15.40:0/2907506652 wait complete. 2023-09-30T22:26:11.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.755+0000 7ffb4b43f700 1 Processor -- start 2023-09-30T22:26:11.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.755+0000 7ffb4b43f700 1 -- start start 2023-09-30T22:26:11.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.755+0000 7ffb4b43f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb4406f070 0x7ffb4406c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.755+0000 7ffb4b43f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb4406f980 0x7ffb4406ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.755+0000 7ffb4b43f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb4406fdb0 0x7ffb4406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.756+0000 7ffb4b43f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4408b810 con 0x7ffb4406fdb0 2023-09-30T22:26:11.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.756+0000 7ffb4b43f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4409f430 con 0x7ffb4406f070 2023-09-30T22:26:11.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.756+0000 7ffb4b43f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb441322a0 con 0x7ffb4406f980 2023-09-30T22:26:11.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.756+0000 7ffb491db700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb4406f070 0x7ffb4406c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.756+0000 7ffb489da700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb4406f980 0x7ffb4406ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.756+0000 7ffb491db700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb4406f070 0x7ffb4406c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52240/0 (socket says 172.21.15.40:52240) 2023-09-30T22:26:11.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.756+0000 7ffb491db700 1 -- 172.21.15.40:0/2759095484 learned_addr learned my addr 172.21.15.40:0/2759095484 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:11.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.756+0000 7ffb499dc700 1 --2- 172.21.15.40:0/2759095484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb4406fdb0 0x7ffb4406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.756+0000 7ffb489da700 1 -- 172.21.15.40:0/2759095484 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb4406f070 msgr2=0x7ffb4406c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:11.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.756+0000 7ffb489da700 1 --2- 172.21.15.40:0/2759095484 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb4406f070 0x7ffb4406c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.756+0000 7ffb489da700 1 -- 172.21.15.40:0/2759095484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb4406fdb0 msgr2=0x7ffb4406d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:11.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.756+0000 7ffb489da700 1 --2- 172.21.15.40:0/2759095484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb4406fdb0 0x7ffb4406d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.756+0000 7ffb489da700 1 -- 172.21.15.40:0/2759095484 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb3c0094a0 con 0x7ffb4406f980 2023-09-30T22:26:11.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.756+0000 7ffb489da700 1 --2- 172.21.15.40:0/2759095484 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb4406f980 0x7ffb4406ced0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ffb38016000 tx=0x7ffb38004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:11.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.756+0000 7ffb41ffb700 1 -- 172.21.15.40:0/2759095484 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb38004240 con 0x7ffb4406f980 2023-09-30T22:26:11.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.756+0000 7ffb41ffb700 1 -- 172.21.15.40:0/2759095484 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3801f070 con 0x7ffb4406f980 2023-09-30T22:26:11.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.756+0000 7ffb4b43f700 1 -- 172.21.15.40:0/2759095484 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb38009550 con 0x7ffb4406f980 2023-09-30T22:26:11.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.756+0000 7ffb41ffb700 1 -- 172.21.15.40:0/2759095484 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb380036a0 con 0x7ffb4406f980 2023-09-30T22:26:11.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.757+0000 7ffb4b43f700 1 -- 172.21.15.40:0/2759095484 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb4412c290 con 0x7ffb4406f980 2023-09-30T22:26:11.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.758+0000 7ffb41ffb700 1 -- 172.21.15.40:0/2759095484 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffb38021030 con 0x7ffb4406f980 2023-09-30T22:26:11.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.758+0000 7ffb4b43f700 1 -- 172.21.15.40:0/2759095484 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb4408b450 con 0x7ffb4406f980 2023-09-30T22:26:11.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.758+0000 7ffb41ffb700 1 -- 172.21.15.40:0/2759095484 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ffb38040760 con 0x7ffb4406f980 2023-09-30T22:26:11.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.762+0000 7ffb41ffb700 1 -- 172.21.15.40:0/2759095484 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb380239c0 con 0x7ffb4406f980 2023-09-30T22:26:11.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.791+0000 7f38c39af700 1 Processor -- start 2023-09-30T22:26:11.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.791+0000 7f38c39af700 1 -- start start 2023-09-30T22:26:11.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.792+0000 7f38c39af700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f38bc09c890 0x7f38bc09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.792+0000 7f38c39af700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f38bc09e480 0x7f38bc13bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.792+0000 7f38c39af700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38bc0a2600 con 0x7f38bc09d920 2023-09-30T22:26:11.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.792+0000 7f38c39af700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38bc0a29d0 con 0x7f38bc09c890 2023-09-30T22:26:11.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.792+0000 7f38c39af700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc09fb40 con 0x7f38bc09e480 2023-09-30T22:26:11.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.792+0000 7f38c174b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f38bc09c890 0x7f38bc09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.792+0000 7f38c1f4c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f38bc09e480 0x7f38bc13bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.792+0000 7f38c174b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f38bc09c890 0x7f38bc09cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37138/0 (socket says 172.21.15.40:37138) 2023-09-30T22:26:11.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.792+0000 7f38c174b700 1 -- 172.21.15.40:0/618786174 learned_addr learned my addr 172.21.15.40:0/618786174 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:11.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.792+0000 7f38c174b700 1 -- 172.21.15.40:0/618786174 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f38bc09e480 msgr2=0x7f38bc13bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:11.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.792+0000 7f38c174b700 1 --2- 172.21.15.40:0/618786174 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f38bc09e480 0x7f38bc13bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.792+0000 7f38c174b700 1 -- 172.21.15.40:0/618786174 >> v1:172.21.15.40:6789/0 conn(0x7f38bc09d920 legacy=0x7f38bc09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:11.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.792+0000 7f38c174b700 1 -- 172.21.15.40:0/618786174 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38bc09fed0 con 0x7f38bc09c890 2023-09-30T22:26:11.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.792+0000 7f38c1f4c700 1 --2- 172.21.15.40:0/618786174 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f38bc09e480 0x7f38bc13bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:11.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.792+0000 7f38c174b700 1 --2- 172.21.15.40:0/618786174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38bc09c890 0x7f38bc09cc60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f38b8006fd0 tx=0x7f38b8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae9888ea862a5391 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:11.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.793+0000 7f38b3fff700 1 -- 172.21.15.40:0/618786174 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b8005e30 con 0x7f38bc09c890 2023-09-30T22:26:11.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.793+0000 7f38b3fff700 1 -- 172.21.15.40:0/618786174 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b8004030 con 0x7f38bc09c890 2023-09-30T22:26:11.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.793+0000 7f38b3fff700 1 -- 172.21.15.40:0/618786174 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b80043e0 con 0x7f38bc09c890 2023-09-30T22:26:11.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.793+0000 7f38c39af700 1 -- 172.21.15.40:0/618786174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38bc09c890 msgr2=0x7f38bc09cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:11.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.793+0000 7f38c39af700 1 --2- 172.21.15.40:0/618786174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38bc09c890 0x7f38bc09cc60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f38b8006fd0 tx=0x7f38b8009bd0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.793+0000 7f38c39af700 1 -- 172.21.15.40:0/618786174 shutdown_connections 2023-09-30T22:26:11.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.793+0000 7f38c39af700 1 --2- 172.21.15.40:0/618786174 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f38bc09e480 0x7f38bc13bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.793+0000 7f38c39af700 1 --2- 172.21.15.40:0/618786174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38bc09c890 0x7f38bc09cc60 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.793+0000 7f38c39af700 1 -- 172.21.15.40:0/618786174 >> 172.21.15.40:0/618786174 conn(0x7f38bc0a7080 msgr2=0x7f38bc0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:11.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.793+0000 7f38c39af700 1 -- 172.21.15.40:0/618786174 shutdown_connections 2023-09-30T22:26:11.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.793+0000 7f38c39af700 1 -- 172.21.15.40:0/618786174 wait complete. 2023-09-30T22:26:11.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.795+0000 7f38c39af700 1 Processor -- start 2023-09-30T22:26:11.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.795+0000 7f38c39af700 1 -- start start 2023-09-30T22:26:11.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.795+0000 7f38c39af700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38bc09c890 0x7f38bc1c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.795+0000 7f38c39af700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38bc09d920 0x7f38bc1c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.795+0000 7f38c39af700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f38bc09e480 0x7f38bc12d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.795+0000 7f38c39af700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc09be20 con 0x7f38bc09d920 2023-09-30T22:26:11.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.795+0000 7f38c39af700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc12f110 con 0x7f38bc09c890 2023-09-30T22:26:11.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.795+0000 7f38c174b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38bc09c890 0x7f38bc1c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.795+0000 7f38c39af700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc0a5d60 con 0x7f38bc09e480 2023-09-30T22:26:11.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.795+0000 7f38c174b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38bc09c890 0x7f38bc1c8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52252/0 (socket says 172.21.15.40:52252) 2023-09-30T22:26:11.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.796+0000 7f38c174b700 1 -- 172.21.15.40:0/3858227929 learned_addr learned my addr 172.21.15.40:0/3858227929 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:11.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.796+0000 7f38c1f4c700 1 --2- 172.21.15.40:0/3858227929 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f38bc09e480 0x7f38bc12d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.796+0000 7f38c0f4a700 1 --2- 172.21.15.40:0/3858227929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38bc09d920 0x7f38bc1c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.796+0000 7f38c174b700 1 -- 172.21.15.40:0/3858227929 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f38bc09e480 msgr2=0x7f38bc12d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:11.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.796+0000 7f38c174b700 1 --2- 172.21.15.40:0/3858227929 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f38bc09e480 0x7f38bc12d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.796+0000 7f38c174b700 1 -- 172.21.15.40:0/3858227929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38bc09d920 msgr2=0x7f38bc1c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:11.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.796+0000 7f38c174b700 1 --2- 172.21.15.40:0/3858227929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38bc09d920 0x7f38bc1c9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.796+0000 7f38c174b700 1 -- 172.21.15.40:0/3858227929 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b4009a70 con 0x7f38bc09c890 2023-09-30T22:26:11.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.796+0000 7f38c0f4a700 1 --2- 172.21.15.40:0/3858227929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38bc09d920 0x7f38bc1c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:11.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.796+0000 7f38c1f4c700 1 --2- 172.21.15.40:0/3858227929 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f38bc09e480 0x7f38bc12d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:11.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.796+0000 7f38c174b700 1 --2- 172.21.15.40:0/3858227929 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38bc09c890 0x7f38bc1c8c50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f38b8004000 tx=0x7f38b8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:11.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.796+0000 7f38b1ffb700 1 -- 172.21.15.40:0/3858227929 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b8003ce0 con 0x7f38bc09c890 2023-09-30T22:26:11.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.796+0000 7f38b1ffb700 1 -- 172.21.15.40:0/3858227929 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b8003e40 con 0x7f38bc09c890 2023-09-30T22:26:11.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.796+0000 7f38c39af700 1 -- 172.21.15.40:0/3858227929 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38b8009500 con 0x7f38bc09c890 2023-09-30T22:26:11.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.796+0000 7f38b1ffb700 1 -- 172.21.15.40:0/3858227929 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b801c640 con 0x7f38bc09c890 2023-09-30T22:26:11.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.797+0000 7f38c39af700 1 -- 172.21.15.40:0/3858227929 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38bc130a80 con 0x7f38bc09c890 2023-09-30T22:26:11.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.798+0000 7f38b1ffb700 1 -- 172.21.15.40:0/3858227929 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f38b801c7a0 con 0x7f38bc09c890 2023-09-30T22:26:11.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.798+0000 7f38b1ffb700 1 -- 172.21.15.40:0/3858227929 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f38b8040670 con 0x7f38bc09c890 2023-09-30T22:26:11.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.798+0000 7f38c39af700 1 -- 172.21.15.40:0/3858227929 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38bc062380 con 0x7f38bc09c890 2023-09-30T22:26:11.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.802+0000 7f38b1ffb700 1 -- 172.21.15.40:0/3858227929 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f38b8016070 con 0x7f38bc09c890 2023-09-30T22:26:11.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.924+0000 7fa75ede3700 1 -- 172.21.15.40:0/3097103952 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa75811e1c0 con 0x7fa75812d6d0 2023-09-30T22:26:11.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.925+0000 7fa7557fa700 1 -- 172.21.15.40:0/3097103952 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa75811e1c0 con 0x7fa75812d6d0 2023-09-30T22:26:11.924 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:11.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.927+0000 7fa75ede3700 1 -- 172.21.15.40:0/3097103952 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa75812d6d0 msgr2=0x7fa75811a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:11.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.927+0000 7fa75ede3700 1 --2- 172.21.15.40:0/3097103952 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa75812d6d0 0x7fa75811a9d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa74c010f60 tx=0x7fa74c010f90 comp rx=0 tx=0).stop 2023-09-30T22:26:11.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.927+0000 7fa75ede3700 1 -- 172.21.15.40:0/3097103952 shutdown_connections 2023-09-30T22:26:11.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.927+0000 7fa75ede3700 1 --2- 172.21.15.40:0/3097103952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa75812eea0 0x7fa75811b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.927+0000 7fa75ede3700 1 --2- 172.21.15.40:0/3097103952 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa75812d6d0 0x7fa75811a9d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.927+0000 7fa75ede3700 1 --2- 172.21.15.40:0/3097103952 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa75812e590 0x7fa75811af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.927+0000 7fa75ede3700 1 -- 172.21.15.40:0/3097103952 >> 172.21.15.40:0/3097103952 conn(0x7fa7580a2a00 msgr2=0x7fa758131070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:11.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.927+0000 7fa75ede3700 1 -- 172.21.15.40:0/3097103952 shutdown_connections 2023-09-30T22:26:11.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.927+0000 7fa75ede3700 1 -- 172.21.15.40:0/3097103952 wait complete. 2023-09-30T22:26:11.939 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:11.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.960+0000 7ffb4b43f700 1 -- 172.21.15.40:0/2759095484 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ffb44062380 con 0x7ffb4406f980 2023-09-30T22:26:11.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.961+0000 7ffb41ffb700 1 -- 172.21.15.40:0/2759095484 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffb3801b430 con 0x7ffb4406f980 2023-09-30T22:26:11.961 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:11.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.963+0000 7ffb4b43f700 1 -- 172.21.15.40:0/2759095484 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb4406f980 msgr2=0x7ffb4406ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:11.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.963+0000 7ffb4b43f700 1 --2- 172.21.15.40:0/2759095484 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb4406f980 0x7ffb4406ced0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ffb38016000 tx=0x7ffb38004750 comp rx=0 tx=0).stop 2023-09-30T22:26:11.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.963+0000 7ffb4b43f700 1 -- 172.21.15.40:0/2759095484 shutdown_connections 2023-09-30T22:26:11.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.963+0000 7ffb4b43f700 1 --2- 172.21.15.40:0/2759095484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb4406fdb0 0x7ffb4406d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.963+0000 7ffb4b43f700 1 --2- 172.21.15.40:0/2759095484 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb4406f070 0x7ffb4406c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.963+0000 7ffb4b43f700 1 --2- 172.21.15.40:0/2759095484 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb4406f980 0x7ffb4406ced0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.963+0000 7ffb4b43f700 1 -- 172.21.15.40:0/2759095484 >> 172.21.15.40:0/2759095484 conn(0x7ffb440a41a0 msgr2=0x7ffb440a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:11.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.963+0000 7ffb4b43f700 1 -- 172.21.15.40:0/2759095484 shutdown_connections 2023-09-30T22:26:11.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:11.963+0000 7ffb4b43f700 1 -- 172.21.15.40:0/2759095484 wait complete. 2023-09-30T22:26:11.975 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:11.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.000+0000 7f38c39af700 1 -- 172.21.15.40:0/3858227929 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f38bc0a5840 con 0x7f38bc09c890 2023-09-30T22:26:12.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.000+0000 7f38b1ffb700 1 -- 172.21.15.40:0/3858227929 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f38b8033090 con 0x7f38bc09c890 2023-09-30T22:26:12.000 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:12.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.003+0000 7f38c39af700 1 -- 172.21.15.40:0/3858227929 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38bc09c890 msgr2=0x7f38bc1c8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:12.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.003+0000 7f38c39af700 1 --2- 172.21.15.40:0/3858227929 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38bc09c890 0x7f38bc1c8c50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f38b8004000 tx=0x7f38b8004750 comp rx=0 tx=0).stop 2023-09-30T22:26:12.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.003+0000 7f38c39af700 1 -- 172.21.15.40:0/3858227929 shutdown_connections 2023-09-30T22:26:12.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.003+0000 7f38c39af700 1 --2- 172.21.15.40:0/3858227929 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f38bc09e480 0x7f38bc12d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:12.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.003+0000 7f38c39af700 1 --2- 172.21.15.40:0/3858227929 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38bc09c890 0x7f38bc1c8c50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:12.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.003+0000 7f38c39af700 1 --2- 172.21.15.40:0/3858227929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38bc09d920 0x7f38bc1c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:12.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.003+0000 7f38c39af700 1 -- 172.21.15.40:0/3858227929 >> 172.21.15.40:0/3858227929 conn(0x7f38bc0a7080 msgr2=0x7f38bc0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:12.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.003+0000 7f38c39af700 1 -- 172.21.15.40:0/3858227929 shutdown_connections 2023-09-30T22:26:12.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.003+0000 7f38c39af700 1 -- 172.21.15.40:0/3858227929 wait complete. 2023-09-30T22:26:12.014 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:12.718 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:12.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.853+0000 7faa7cc85700 1 Processor -- start 2023-09-30T22:26:12.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.853+0000 7faa7cc85700 1 -- start start 2023-09-30T22:26:12.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.854+0000 7faa7cc85700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa7806b1b0 0x7faa78136af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:12.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.854+0000 7faa7cc85700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa78137030 0x7faa78139410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:12.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.854+0000 7faa7cc85700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa7809eb50 con 0x7faa7806a6d0 2023-09-30T22:26:12.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.854+0000 7faa7cc85700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa7809dde0 con 0x7faa7806b1b0 2023-09-30T22:26:12.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.854+0000 7faa7cc85700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa7809d4a0 con 0x7faa78137030 2023-09-30T22:26:12.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.854+0000 7faa75d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa7806b1b0 0x7faa78136af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:12.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.854+0000 7faa76d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa78137030 0x7faa78139410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:12.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.854+0000 7faa75d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa7806b1b0 0x7faa78136af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37152/0 (socket says 172.21.15.40:37152) 2023-09-30T22:26:12.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.854+0000 7faa75d9b700 1 -- 172.21.15.40:0/3248721728 learned_addr learned my addr 172.21.15.40:0/3248721728 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:12.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.854+0000 7faa76d9d700 1 -- 172.21.15.40:0/3248721728 >> v2:172.21.15.40:3300/0 conn(0x7faa7806b1b0 msgr2=0x7faa78136af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:12.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.854+0000 7faa76d9d700 1 --2- 172.21.15.40:0/3248721728 >> v2:172.21.15.40:3300/0 conn(0x7faa7806b1b0 0x7faa78136af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:12.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.854+0000 7faa76d9d700 1 -- 172.21.15.40:0/3248721728 >> v1:172.21.15.40:6789/0 conn(0x7faa7806a6d0 legacy=0x7faa7806aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:12.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.854+0000 7faa76d9d700 1 -- 172.21.15.40:0/3248721728 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa7809f5f0 con 0x7faa78137030 2023-09-30T22:26:12.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.854+0000 7faa75d9b700 1 --2- 172.21.15.40:0/3248721728 >> v2:172.21.15.40:3300/0 conn(0x7faa7806b1b0 0x7faa78136af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:12.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.854+0000 7faa76d9d700 1 --2- 172.21.15.40:0/3248721728 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa78137030 0x7faa78139410 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faa70009d90 tx=0x7faa7000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bc955ff8f35ff1a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:12.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.855+0000 7faa7559a700 1 -- 172.21.15.40:0/3248721728 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7000e070 con 0x7faa78137030 2023-09-30T22:26:12.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.855+0000 7faa7559a700 1 -- 172.21.15.40:0/3248721728 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa7000bb20 con 0x7faa78137030 2023-09-30T22:26:12.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.855+0000 7faa7559a700 1 -- 172.21.15.40:0/3248721728 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa70012430 con 0x7faa78137030 2023-09-30T22:26:12.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.855+0000 7faa7cc85700 1 -- 172.21.15.40:0/3248721728 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa78137030 msgr2=0x7faa78139410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:12.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.855+0000 7faa7cc85700 1 --2- 172.21.15.40:0/3248721728 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa78137030 0x7faa78139410 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faa70009d90 tx=0x7faa7000b330 comp rx=0 tx=0).stop 2023-09-30T22:26:12.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.855+0000 7faa7cc85700 1 -- 172.21.15.40:0/3248721728 shutdown_connections 2023-09-30T22:26:12.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.855+0000 7faa7cc85700 1 --2- 172.21.15.40:0/3248721728 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa78137030 0x7faa78139410 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:12.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.855+0000 7faa7cc85700 1 --2- 172.21.15.40:0/3248721728 >> v2:172.21.15.40:3300/0 conn(0x7faa7806b1b0 0x7faa78136af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:12.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.855+0000 7faa7cc85700 1 -- 172.21.15.40:0/3248721728 >> 172.21.15.40:0/3248721728 conn(0x7faa7809fb20 msgr2=0x7faa7809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:12.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.855+0000 7faa7cc85700 1 -- 172.21.15.40:0/3248721728 shutdown_connections 2023-09-30T22:26:12.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.855+0000 7faa7cc85700 1 -- 172.21.15.40:0/3248721728 wait complete. 2023-09-30T22:26:12.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.856+0000 7faa7cc85700 1 Processor -- start 2023-09-30T22:26:12.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.856+0000 7faa7cc85700 1 -- start start 2023-09-30T22:26:12.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.857+0000 7faa7cc85700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faa7806a6d0 0x7faa7809a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:12.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.857+0000 7faa7cc85700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa7806b1b0 0x7faa7809aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:12.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.857+0000 7faa7cc85700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa78137030 0x7faa7809afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:12.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.857+0000 7faa7cc85700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7809b9b0 con 0x7faa78137030 2023-09-30T22:26:12.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.857+0000 7faa7cc85700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa78071560 con 0x7faa7806b1b0 2023-09-30T22:26:12.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.857+0000 7faa7cc85700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa781243c0 con 0x7faa7806a6d0 2023-09-30T22:26:12.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.857+0000 7faa75d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa7806b1b0 0x7faa7809aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:12.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.857+0000 7faa76d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa78137030 0x7faa7809afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:12.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.857+0000 7faa75d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa7806b1b0 0x7faa7809aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52272/0 (socket says 172.21.15.40:52272) 2023-09-30T22:26:12.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.857+0000 7faa75d9b700 1 -- 172.21.15.40:0/1017506035 learned_addr learned my addr 172.21.15.40:0/1017506035 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:12.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.857+0000 7faa76d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa78137030 0x7faa7809afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37158/0 (socket says 172.21.15.40:37158) 2023-09-30T22:26:12.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.857+0000 7faa7659c700 1 --2- 172.21.15.40:0/1017506035 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faa7806a6d0 0x7faa7809a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:12.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.857+0000 7faa76d9d700 1 -- 172.21.15.40:0/1017506035 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faa7806a6d0 msgr2=0x7faa7809a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:12.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.857+0000 7faa76d9d700 1 --2- 172.21.15.40:0/1017506035 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faa7806a6d0 0x7faa7809a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:12.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.857+0000 7faa76d9d700 1 -- 172.21.15.40:0/1017506035 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa7806b1b0 msgr2=0x7faa7809aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:12.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.857+0000 7faa76d9d700 1 --2- 172.21.15.40:0/1017506035 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa7806b1b0 0x7faa7809aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:12.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.857+0000 7faa76d9d700 1 -- 172.21.15.40:0/1017506035 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa68009550 con 0x7faa78137030 2023-09-30T22:26:12.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.857+0000 7faa75d9b700 1 --2- 172.21.15.40:0/1017506035 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa7806b1b0 0x7faa7809aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:12.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.857+0000 7faa76d9d700 1 --2- 172.21.15.40:0/1017506035 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa78137030 0x7faa7809afd0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7faa70016000 tx=0x7faa70004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:12.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.858+0000 7faa6effd700 1 -- 172.21.15.40:0/1017506035 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa70012430 con 0x7faa78137030 2023-09-30T22:26:12.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.858+0000 7faa6effd700 1 -- 172.21.15.40:0/1017506035 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa70020070 con 0x7faa78137030 2023-09-30T22:26:12.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.858+0000 7faa7cc85700 1 -- 172.21.15.40:0/1017506035 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa70009a70 con 0x7faa78137030 2023-09-30T22:26:12.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.858+0000 7faa6effd700 1 -- 172.21.15.40:0/1017506035 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa700098f0 con 0x7faa78137030 2023-09-30T22:26:12.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.858+0000 7faa7cc85700 1 -- 172.21.15.40:0/1017506035 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa78122f80 con 0x7faa78137030 2023-09-30T22:26:12.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.858+0000 7faa6effd700 1 -- 172.21.15.40:0/1017506035 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faa70004040 con 0x7faa78137030 2023-09-30T22:26:12.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.858+0000 7faa6effd700 1 -- 172.21.15.40:0/1017506035 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7faa70022070 con 0x7faa78137030 2023-09-30T22:26:12.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.859+0000 7faa7cc85700 1 -- 172.21.15.40:0/1017506035 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa78062380 con 0x7faa78137030 2023-09-30T22:26:12.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:12.863+0000 7faa6effd700 1 -- 172.21.15.40:0/1017506035 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faa70011980 con 0x7faa78137030 2023-09-30T22:26:12.940 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:12.976 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:13.015 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:13.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.072+0000 7faa7cc85700 1 -- 172.21.15.40:0/1017506035 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faa78123fc0 con 0x7faa78137030 2023-09-30T22:26:13.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.073+0000 7faa6effd700 1 -- 172.21.15.40:0/1017506035 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faa7001b400 con 0x7faa78137030 2023-09-30T22:26:13.072 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:13.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.075+0000 7faa7cc85700 1 -- 172.21.15.40:0/1017506035 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa78137030 msgr2=0x7faa7809afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:13.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.075+0000 7faa7cc85700 1 --2- 172.21.15.40:0/1017506035 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa78137030 0x7faa7809afd0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7faa70016000 tx=0x7faa70004ad0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.076+0000 7faa7cc85700 1 -- 172.21.15.40:0/1017506035 shutdown_connections 2023-09-30T22:26:13.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.076+0000 7faa7cc85700 1 --2- 172.21.15.40:0/1017506035 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faa7806a6d0 0x7faa7809a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.076+0000 7faa7cc85700 1 --2- 172.21.15.40:0/1017506035 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa78137030 0x7faa7809afd0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.076+0000 7faa7cc85700 1 --2- 172.21.15.40:0/1017506035 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa7806b1b0 0x7faa7809aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.076+0000 7faa7cc85700 1 -- 172.21.15.40:0/1017506035 >> 172.21.15.40:0/1017506035 conn(0x7faa7809fb20 msgr2=0x7faa78070190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:13.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.076+0000 7faa7cc85700 1 -- 172.21.15.40:0/1017506035 shutdown_connections 2023-09-30T22:26:13.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.076+0000 7faa7cc85700 1 -- 172.21.15.40:0/1017506035 wait complete. 2023-09-30T22:26:13.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.085+0000 7f2ff101c700 1 Processor -- start 2023-09-30T22:26:13.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.085+0000 7f2ff101c700 1 -- start start 2023-09-30T22:26:13.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.086+0000 7f2ff101c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2fec06a6d0 0x7f2fec09d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.086+0000 7f2ff101c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2fec09e280 0x7f2fec13fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.086+0000 7f2ff101c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fec11d980 con 0x7f2fec09de60 2023-09-30T22:26:13.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.086+0000 7f2ff101c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fec06aaa0 con 0x7f2fec06a6d0 2023-09-30T22:26:13.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.086+0000 7f2ff101c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec06b150 con 0x7f2fec09e280 2023-09-30T22:26:13.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.086+0000 7f2feb59e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2fec09e280 0x7f2fec13fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:13.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.086+0000 7f2feb59e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2fec09e280 0x7f2fec13fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41852/0 (socket says 172.21.15.40:41852) 2023-09-30T22:26:13.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.086+0000 7f2feb59e700 1 -- 172.21.15.40:0/3663631369 learned_addr learned my addr 172.21.15.40:0/3663631369 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:13.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.086+0000 7f2fead9d700 1 --2- 172.21.15.40:0/3663631369 >> v2:172.21.15.40:3300/0 conn(0x7f2fec06a6d0 0x7f2fec09d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:13.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.086+0000 7f2feb59e700 1 -- 172.21.15.40:0/3663631369 >> v2:172.21.15.40:3300/0 conn(0x7f2fec06a6d0 msgr2=0x7f2fec09d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:13.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.086+0000 7f2feb59e700 1 --2- 172.21.15.40:0/3663631369 >> v2:172.21.15.40:3300/0 conn(0x7f2fec06a6d0 0x7f2fec09d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.086+0000 7f2feb59e700 1 -- 172.21.15.40:0/3663631369 >> v1:172.21.15.40:6789/0 conn(0x7f2fec09de60 legacy=0x7f2fec13c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:13.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.086+0000 7f2feb59e700 1 -- 172.21.15.40:0/3663631369 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fec09f300 con 0x7f2fec09e280 2023-09-30T22:26:13.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.086+0000 7f2feb59e700 1 --2- 172.21.15.40:0/3663631369 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2fec09e280 0x7f2fec13fbc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4009e50 tx=0x7f2fe400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d643de62aa7aae server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:13.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.087+0000 7f2fe9d9b700 1 -- 172.21.15.40:0/3663631369 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe400e070 con 0x7f2fec09e280 2023-09-30T22:26:13.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.087+0000 7f2fe9d9b700 1 -- 172.21.15.40:0/3663631369 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe400b910 con 0x7f2fec09e280 2023-09-30T22:26:13.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.087+0000 7f2fe9d9b700 1 -- 172.21.15.40:0/3663631369 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe400bcc0 con 0x7f2fec09e280 2023-09-30T22:26:13.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.087+0000 7f2ff101c700 1 -- 172.21.15.40:0/3663631369 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2fec09e280 msgr2=0x7f2fec13fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:13.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.087+0000 7f2ff101c700 1 --2- 172.21.15.40:0/3663631369 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2fec09e280 0x7f2fec13fbc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4009e50 tx=0x7f2fe400b330 comp rx=0 tx=0).stop 2023-09-30T22:26:13.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.087+0000 7f2ff101c700 1 -- 172.21.15.40:0/3663631369 shutdown_connections 2023-09-30T22:26:13.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.087+0000 7f2ff101c700 1 --2- 172.21.15.40:0/3663631369 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2fec09e280 0x7f2fec13fbc0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.087+0000 7f2ff101c700 1 --2- 172.21.15.40:0/3663631369 >> v2:172.21.15.40:3300/0 conn(0x7f2fec06a6d0 0x7f2fec09d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.087+0000 7f2ff101c700 1 -- 172.21.15.40:0/3663631369 >> 172.21.15.40:0/3663631369 conn(0x7f2fec09fb20 msgr2=0x7f2fec09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:13.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.088+0000 7f2ff101c700 1 -- 172.21.15.40:0/3663631369 shutdown_connections 2023-09-30T22:26:13.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.088+0000 7f2ff101c700 1 -- 172.21.15.40:0/3663631369 wait complete. 2023-09-30T22:26:13.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.089+0000 7f2ff101c700 1 Processor -- start 2023-09-30T22:26:13.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.089+0000 7f2ff101c700 1 -- start start 2023-09-30T22:26:13.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.089+0000 7f2ff101c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2fec06a6d0 0x7f2fec130550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.089+0000 7f2ff101c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2fec09de60 0x7f2fec12efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.089+0000 7f2ff101c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fec09e280 0x7f2fec12f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.089+0000 7f2ff101c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec135c60 con 0x7f2fec09e280 2023-09-30T22:26:13.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.089+0000 7f2ff101c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec130a90 con 0x7f2fec06a6d0 2023-09-30T22:26:13.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.089+0000 7f2ff101c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec11d590 con 0x7f2fec09de60 2023-09-30T22:26:13.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.090+0000 7f2feb59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fec09e280 0x7f2fec12f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:13.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.090+0000 7f2feb59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fec09e280 0x7f2fec12f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37182/0 (socket says 172.21.15.40:37182) 2023-09-30T22:26:13.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.090+0000 7f2feb59e700 1 -- 172.21.15.40:0/4197588316 learned_addr learned my addr 172.21.15.40:0/4197588316 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:13.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.090+0000 7f2fea59c700 1 --2- 172.21.15.40:0/4197588316 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2fec09de60 0x7f2fec12efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:13.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.090+0000 7f2feb59e700 1 -- 172.21.15.40:0/4197588316 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2fec09de60 msgr2=0x7f2fec12efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:13.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.090+0000 7f2feb59e700 1 --2- 172.21.15.40:0/4197588316 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2fec09de60 0x7f2fec12efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.090+0000 7f2feb59e700 1 -- 172.21.15.40:0/4197588316 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2fec06a6d0 msgr2=0x7f2fec130550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:13.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.090+0000 7f2feb59e700 1 --2- 172.21.15.40:0/4197588316 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2fec06a6d0 0x7f2fec130550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.090+0000 7f2feb59e700 1 -- 172.21.15.40:0/4197588316 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe4009b30 con 0x7f2fec09e280 2023-09-30T22:26:13.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.090+0000 7f2feb59e700 1 --2- 172.21.15.40:0/4197588316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fec09e280 0x7f2fec12f500 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f2fec06b290 tx=0x7f2fe4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:13.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.091+0000 7f2fd37fe700 1 -- 172.21.15.40:0/4197588316 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe4003ea0 con 0x7f2fec09e280 2023-09-30T22:26:13.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.091+0000 7f2fd37fe700 1 -- 172.21.15.40:0/4197588316 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe40099b0 con 0x7f2fec09e280 2023-09-30T22:26:13.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.091+0000 7f2ff101c700 1 -- 172.21.15.40:0/4197588316 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fec1345e0 con 0x7f2fec09e280 2023-09-30T22:26:13.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.091+0000 7f2fd37fe700 1 -- 172.21.15.40:0/4197588316 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe4004970 con 0x7f2fec09e280 2023-09-30T22:26:13.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.091+0000 7f2ff101c700 1 -- 172.21.15.40:0/4197588316 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fec09f540 con 0x7f2fec09e280 2023-09-30T22:26:13.093 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:13.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.091+0000 7f2fd37fe700 1 -- 172.21.15.40:0/4197588316 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2fe401c660 con 0x7f2fec09e280 2023-09-30T22:26:13.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.092+0000 7f2fd37fe700 1 -- 172.21.15.40:0/4197588316 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f2fe4041380 con 0x7f2fec09e280 2023-09-30T22:26:13.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.092+0000 7f2ff101c700 1 -- 172.21.15.40:0/4197588316 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fec062380 con 0x7f2fec09e280 2023-09-30T22:26:13.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.097+0000 7f2fd37fe700 1 -- 172.21.15.40:0/4197588316 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2fe402d940 con 0x7f2fec09e280 2023-09-30T22:26:13.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.126+0000 7ff2e87d3700 1 Processor -- start 2023-09-30T22:26:13.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.126+0000 7ff2e87d3700 1 -- start start 2023-09-30T22:26:13.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.127+0000 7ff2e87d3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff2e009c890 0x7ff2e009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.127+0000 7ff2e87d3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff2e009d920 0x7ff2e009dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.127+0000 7ff2e87d3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff2e009e2b0 0x7ff2e013ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.127+0000 7ff2e87d3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e00a29d0 con 0x7ff2e009c890 2023-09-30T22:26:13.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.127+0000 7ff2e87d3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e009fb40 con 0x7ff2e009e2b0 2023-09-30T22:26:13.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.127+0000 7ff2e87d3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e00a2600 con 0x7ff2e009d920 2023-09-30T22:26:13.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.127+0000 7ff2e5d6e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff2e009d920 0x7ff2e009dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:13.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.127+0000 7ff2e5d6e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff2e009d920 0x7ff2e009dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41870/0 (socket says 172.21.15.40:41870) 2023-09-30T22:26:13.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.127+0000 7ff2e5d6e700 1 -- 172.21.15.40:0/2507589797 learned_addr learned my addr 172.21.15.40:0/2507589797 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:13.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.127+0000 7ff2e656f700 1 --2- 172.21.15.40:0/2507589797 >> v2:172.21.15.40:3300/0 conn(0x7ff2e009c890 0x7ff2e009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:13.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.127+0000 7ff2e6d70700 1 --2- 172.21.15.40:0/2507589797 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff2e009e2b0 0x7ff2e013ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:13.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.127+0000 7ff2e656f700 1 -- 172.21.15.40:0/2507589797 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff2e009d920 msgr2=0x7ff2e009dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:13.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.127+0000 7ff2e656f700 1 --2- 172.21.15.40:0/2507589797 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff2e009d920 0x7ff2e009dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.127+0000 7ff2e656f700 1 -- 172.21.15.40:0/2507589797 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff2e009e2b0 msgr2=0x7ff2e013ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:13.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.127+0000 7ff2e656f700 1 --2- 172.21.15.40:0/2507589797 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff2e009e2b0 0x7ff2e013ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.127+0000 7ff2e656f700 1 -- 172.21.15.40:0/2507589797 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e009fed0 con 0x7ff2e009c890 2023-09-30T22:26:13.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.127+0000 7ff2e5d6e700 1 --2- 172.21.15.40:0/2507589797 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff2e009d920 0x7ff2e009dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:13.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.128+0000 7ff2e656f700 1 --2- 172.21.15.40:0/2507589797 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2e009c890 0x7ff2e009cc60 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc009820 tx=0x7ff2dc009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6708dee452a0cbd6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:13.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.128+0000 7ff2e556d700 1 -- 172.21.15.40:0/2507589797 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc005e30 con 0x7ff2e009c890 2023-09-30T22:26:13.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.128+0000 7ff2e556d700 1 -- 172.21.15.40:0/2507589797 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2dc006030 con 0x7ff2e009c890 2023-09-30T22:26:13.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.128+0000 7ff2e556d700 1 -- 172.21.15.40:0/2507589797 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc0063c0 con 0x7ff2e009c890 2023-09-30T22:26:13.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.128+0000 7ff2e87d3700 1 -- 172.21.15.40:0/2507589797 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2e009c890 msgr2=0x7ff2e009cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:13.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.128+0000 7ff2e87d3700 1 --2- 172.21.15.40:0/2507589797 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2e009c890 0x7ff2e009cc60 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc009820 tx=0x7ff2dc009b30 comp rx=0 tx=0).stop 2023-09-30T22:26:13.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.129+0000 7ff2e87d3700 1 -- 172.21.15.40:0/2507589797 shutdown_connections 2023-09-30T22:26:13.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.129+0000 7ff2e87d3700 1 --2- 172.21.15.40:0/2507589797 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff2e009e2b0 0x7ff2e013ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.129+0000 7ff2e87d3700 1 --2- 172.21.15.40:0/2507589797 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2e009c890 0x7ff2e009cc60 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.129+0000 7ff2e87d3700 1 --2- 172.21.15.40:0/2507589797 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff2e009d920 0x7ff2e009dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.129+0000 7ff2e87d3700 1 -- 172.21.15.40:0/2507589797 >> 172.21.15.40:0/2507589797 conn(0x7ff2e00a7080 msgr2=0x7ff2e00a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:13.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.129+0000 7ff2e87d3700 1 -- 172.21.15.40:0/2507589797 shutdown_connections 2023-09-30T22:26:13.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.129+0000 7ff2e87d3700 1 -- 172.21.15.40:0/2507589797 wait complete. 2023-09-30T22:26:13.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.130+0000 7ff2e87d3700 1 Processor -- start 2023-09-30T22:26:13.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.130+0000 7ff2e87d3700 1 -- start start 2023-09-30T22:26:13.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.130+0000 7ff2e87d3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff2e009c890 0x7ff2e01c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.130+0000 7ff2e87d3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff2e009d920 0x7ff2e01c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.130+0000 7ff2e87d3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2e009e2b0 0x7ff2e012d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.130+0000 7ff2e87d3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e00a5d90 con 0x7ff2e009e2b0 2023-09-30T22:26:13.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.130+0000 7ff2e87d3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e009c0c0 con 0x7ff2e009c890 2023-09-30T22:26:13.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.130+0000 7ff2e87d3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e0130780 con 0x7ff2e009d920 2023-09-30T22:26:13.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.130+0000 7ff2e5d6e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff2e009d920 0x7ff2e01c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:13.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.130+0000 7ff2e5d6e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff2e009d920 0x7ff2e01c9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41876/0 (socket says 172.21.15.40:41876) 2023-09-30T22:26:13.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.130+0000 7ff2e5d6e700 1 -- 172.21.15.40:0/2969883667 learned_addr learned my addr 172.21.15.40:0/2969883667 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:13.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.130+0000 7ff2e6d70700 1 --2- 172.21.15.40:0/2969883667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2e009e2b0 0x7ff2e012d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:13.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.130+0000 7ff2e656f700 1 --2- 172.21.15.40:0/2969883667 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff2e009c890 0x7ff2e01c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:13.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.131+0000 7ff2e5d6e700 1 -- 172.21.15.40:0/2969883667 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff2e009c890 msgr2=0x7ff2e01c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:13.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.131+0000 7ff2e5d6e700 1 --2- 172.21.15.40:0/2969883667 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff2e009c890 0x7ff2e01c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.131+0000 7ff2e5d6e700 1 -- 172.21.15.40:0/2969883667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2e009e2b0 msgr2=0x7ff2e012d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:13.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.131+0000 7ff2e5d6e700 1 --2- 172.21.15.40:0/2969883667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2e009e2b0 0x7ff2e012d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.131+0000 7ff2e5d6e700 1 -- 172.21.15.40:0/2969883667 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d0009550 con 0x7ff2e009d920 2023-09-30T22:26:13.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.131+0000 7ff2e5d6e700 1 --2- 172.21.15.40:0/2969883667 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff2e009d920 0x7ff2e01c9190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff2d000ebe0 tx=0x7ff2d000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:13.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.131+0000 7ff2d6ffd700 1 -- 172.21.15.40:0/2969883667 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d0004030 con 0x7ff2e009d920 2023-09-30T22:26:13.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.131+0000 7ff2d6ffd700 1 -- 172.21.15.40:0/2969883667 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d0004190 con 0x7ff2e009d920 2023-09-30T22:26:13.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.131+0000 7ff2e87d3700 1 -- 172.21.15.40:0/2969883667 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2dc009430 con 0x7ff2e009d920 2023-09-30T22:26:13.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.131+0000 7ff2d6ffd700 1 -- 172.21.15.40:0/2969883667 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d0004520 con 0x7ff2e009d920 2023-09-30T22:26:13.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.131+0000 7ff2e87d3700 1 -- 172.21.15.40:0/2969883667 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e0130f70 con 0x7ff2e009d920 2023-09-30T22:26:13.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.132+0000 7ff2d6ffd700 1 -- 172.21.15.40:0/2969883667 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff2d000c850 con 0x7ff2e009d920 2023-09-30T22:26:13.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.132+0000 7ff2d6ffd700 1 -- 172.21.15.40:0/2969883667 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff2d003f580 con 0x7ff2e009d920 2023-09-30T22:26:13.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.132+0000 7ff2e87d3700 1 -- 172.21.15.40:0/2969883667 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e0062380 con 0x7ff2e009d920 2023-09-30T22:26:13.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.137+0000 7ff2d6ffd700 1 -- 172.21.15.40:0/2969883667 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff2d00036a0 con 0x7ff2e009d920 2023-09-30T22:26:13.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.172+0000 7f389a964700 1 Processor -- start 2023-09-30T22:26:13.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.172+0000 7f389a964700 1 -- start start 2023-09-30T22:26:13.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.172+0000 7f389a964700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f389406f3a0 0x7f389406c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.172+0000 7f389a964700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f389409fbb0 0x7f389406ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.172+0000 7f389a964700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f389406d410 0x7f389413a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.172+0000 7f389a964700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f389409ff80 con 0x7f389406f3a0 2023-09-30T22:26:13.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.172+0000 7f389a964700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38940a0590 con 0x7f389406d410 2023-09-30T22:26:13.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.172+0000 7f389a964700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f389406bac0 con 0x7f389409fbb0 2023-09-30T22:26:13.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.172+0000 7f3893fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f389406f3a0 0x7f389406c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:13.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.172+0000 7f38937fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f389409fbb0 0x7f389406ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:13.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.172+0000 7f38937fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f389409fbb0 0x7f389406ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41890/0 (socket says 172.21.15.40:41890) 2023-09-30T22:26:13.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.172+0000 7f3893fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f389406f3a0 0x7f389406c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37204/0 (socket says 172.21.15.40:37204) 2023-09-30T22:26:13.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.172+0000 7f38937fe700 1 -- 172.21.15.40:0/1638499143 learned_addr learned my addr 172.21.15.40:0/1638499143 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:13.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.173+0000 7f3898f01700 1 --2- 172.21.15.40:0/1638499143 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f389406d410 0x7f389413a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:13.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.173+0000 7f38937fe700 1 -- 172.21.15.40:0/1638499143 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f389406d410 msgr2=0x7f389413a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:13.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.173+0000 7f38937fe700 1 --2- 172.21.15.40:0/1638499143 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f389406d410 0x7f389413a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.173+0000 7f38937fe700 1 -- 172.21.15.40:0/1638499143 >> v2:172.21.15.40:3300/0 conn(0x7f389406f3a0 msgr2=0x7f389406c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:13.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.173+0000 7f38937fe700 1 --2- 172.21.15.40:0/1638499143 >> v2:172.21.15.40:3300/0 conn(0x7f389406f3a0 0x7f389406c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.173+0000 7f38937fe700 1 -- 172.21.15.40:0/1638499143 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38940a0780 con 0x7f389409fbb0 2023-09-30T22:26:13.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.173+0000 7f3893fff700 1 --2- 172.21.15.40:0/1638499143 >> v2:172.21.15.40:3300/0 conn(0x7f389406f3a0 0x7f389406c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:13.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.173+0000 7f38937fe700 1 --2- 172.21.15.40:0/1638499143 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f389409fbb0 0x7f389406ced0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3888009920 tx=0x7f3888009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b6102cdee7b8d77 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:13.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.173+0000 7f3892ffd700 1 -- 172.21.15.40:0/1638499143 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3888011830 con 0x7f389409fbb0 2023-09-30T22:26:13.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.173+0000 7f3892ffd700 1 -- 172.21.15.40:0/1638499143 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3888011990 con 0x7f389409fbb0 2023-09-30T22:26:13.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.173+0000 7f3892ffd700 1 -- 172.21.15.40:0/1638499143 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3888011d20 con 0x7f389409fbb0 2023-09-30T22:26:13.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.174+0000 7f389a964700 1 -- 172.21.15.40:0/1638499143 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f389409fbb0 msgr2=0x7f389406ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:13.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.174+0000 7f389a964700 1 --2- 172.21.15.40:0/1638499143 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f389409fbb0 0x7f389406ced0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3888009920 tx=0x7f3888009c30 comp rx=0 tx=0).stop 2023-09-30T22:26:13.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.174+0000 7f389a964700 1 -- 172.21.15.40:0/1638499143 shutdown_connections 2023-09-30T22:26:13.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.174+0000 7f389a964700 1 --2- 172.21.15.40:0/1638499143 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f389406d410 0x7f389413a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.174+0000 7f389a964700 1 --2- 172.21.15.40:0/1638499143 >> v2:172.21.15.40:3300/0 conn(0x7f389406f3a0 0x7f389406c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.174+0000 7f389a964700 1 --2- 172.21.15.40:0/1638499143 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f389409fbb0 0x7f389406ced0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.174+0000 7f389a964700 1 -- 172.21.15.40:0/1638499143 >> 172.21.15.40:0/1638499143 conn(0x7f38940a41a0 msgr2=0x7f38940a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:13.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.174+0000 7f389a964700 1 -- 172.21.15.40:0/1638499143 shutdown_connections 2023-09-30T22:26:13.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.174+0000 7f389a964700 1 -- 172.21.15.40:0/1638499143 wait complete. 2023-09-30T22:26:13.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.175+0000 7f389a964700 1 Processor -- start 2023-09-30T22:26:13.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.175+0000 7f389a964700 1 -- start start 2023-09-30T22:26:13.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.175+0000 7f389a964700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f389406d410 0x7f389408f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.175+0000 7f389a964700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f389406f3a0 0x7f389408fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.175+0000 7f389a964700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f389409fbb0 0x7f38940902a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.175+0000 7f389a964700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3894092e90 con 0x7f389406f3a0 2023-09-30T22:26:13.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.175+0000 7f389a964700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3894093d50 con 0x7f389409fbb0 2023-09-30T22:26:13.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.175+0000 7f389a964700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38940917a0 con 0x7f389406d410 2023-09-30T22:26:13.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.176+0000 7f3893fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f389406d410 0x7f389408f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:13.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.176+0000 7f3893fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f389406d410 0x7f389408f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41892/0 (socket says 172.21.15.40:41892) 2023-09-30T22:26:13.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.176+0000 7f3893fff700 1 -- 172.21.15.40:0/2902517818 learned_addr learned my addr 172.21.15.40:0/2902517818 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:13.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.176+0000 7f3898f01700 1 --2- 172.21.15.40:0/2902517818 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f389409fbb0 0x7f38940902a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:13.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.176+0000 7f38937fe700 1 --2- 172.21.15.40:0/2902517818 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f389406f3a0 0x7f389408fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:13.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.176+0000 7f3893fff700 1 -- 172.21.15.40:0/2902517818 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f389409fbb0 msgr2=0x7f38940902a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:13.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.176+0000 7f3893fff700 1 --2- 172.21.15.40:0/2902517818 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f389409fbb0 0x7f38940902a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.176+0000 7f3893fff700 1 -- 172.21.15.40:0/2902517818 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f389406f3a0 msgr2=0x7f389408fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:13.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.176+0000 7f3893fff700 1 --2- 172.21.15.40:0/2902517818 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f389406f3a0 0x7f389408fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.176+0000 7f3893fff700 1 -- 172.21.15.40:0/2902517818 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38840094a0 con 0x7f389406d410 2023-09-30T22:26:13.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.176+0000 7f3898f01700 1 --2- 172.21.15.40:0/2902517818 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f389409fbb0 0x7f38940902a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:13.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.176+0000 7f38937fe700 1 --2- 172.21.15.40:0/2902517818 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f389406f3a0 0x7f389408fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:13.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.176+0000 7f3893fff700 1 --2- 172.21.15.40:0/2902517818 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f389406d410 0x7f389408f820 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f388400ebe0 tx=0x7f388400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:13.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.176+0000 7f3890ff9700 1 -- 172.21.15.40:0/2902517818 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3884009760 con 0x7f389406d410 2023-09-30T22:26:13.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.177+0000 7f3890ff9700 1 -- 172.21.15.40:0/2902517818 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388400c850 con 0x7f389406d410 2023-09-30T22:26:13.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.177+0000 7f3890ff9700 1 -- 172.21.15.40:0/2902517818 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388400cbe0 con 0x7f389406d410 2023-09-30T22:26:13.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.177+0000 7f389a964700 1 -- 172.21.15.40:0/2902517818 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3888009550 con 0x7f389406d410 2023-09-30T22:26:13.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.177+0000 7f389a964700 1 -- 172.21.15.40:0/2902517818 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f389406df90 con 0x7f389406d410 2023-09-30T22:26:13.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.177+0000 7f3890ff9700 1 -- 172.21.15.40:0/2902517818 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f388400cd40 con 0x7f389406d410 2023-09-30T22:26:13.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.178+0000 7f389a964700 1 -- 172.21.15.40:0/2902517818 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3894090c80 con 0x7f389406d410 2023-09-30T22:26:13.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.178+0000 7f3890ff9700 1 -- 172.21.15.40:0/2902517818 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f388403f6f0 con 0x7f389406d410 2023-09-30T22:26:13.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.183+0000 7f3890ff9700 1 -- 172.21.15.40:0/2902517818 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f38840232f0 con 0x7f389406d410 2023-09-30T22:26:13.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.295+0000 7f2ff101c700 1 -- 172.21.15.40:0/4197588316 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2fec136730 con 0x7f2fec09e280 2023-09-30T22:26:13.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.295+0000 7f2fd37fe700 1 -- 172.21.15.40:0/4197588316 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2fe402d350 con 0x7f2fec09e280 2023-09-30T22:26:13.296 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:13.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.297+0000 7f2ff101c700 1 -- 172.21.15.40:0/4197588316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fec09e280 msgr2=0x7f2fec12f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:13.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.297+0000 7f2ff101c700 1 --2- 172.21.15.40:0/4197588316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fec09e280 0x7f2fec12f500 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f2fec06b290 tx=0x7f2fe4004ad0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.297+0000 7f2ff101c700 1 -- 172.21.15.40:0/4197588316 shutdown_connections 2023-09-30T22:26:13.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.297+0000 7f2ff101c700 1 --2- 172.21.15.40:0/4197588316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fec09e280 0x7f2fec12f500 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.297+0000 7f2ff101c700 1 --2- 172.21.15.40:0/4197588316 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2fec06a6d0 0x7f2fec130550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.297+0000 7f2ff101c700 1 --2- 172.21.15.40:0/4197588316 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2fec09de60 0x7f2fec12efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.297+0000 7f2ff101c700 1 -- 172.21.15.40:0/4197588316 >> 172.21.15.40:0/4197588316 conn(0x7f2fec09fb20 msgr2=0x7f2fec06e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:13.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.298+0000 7f2ff101c700 1 -- 172.21.15.40:0/4197588316 shutdown_connections 2023-09-30T22:26:13.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.298+0000 7f2ff101c700 1 -- 172.21.15.40:0/4197588316 wait complete. 2023-09-30T22:26:13.311 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:13.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.348+0000 7ff2e87d3700 1 -- 172.21.15.40:0/2969883667 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff2e00726e0 con 0x7ff2e009d920 2023-09-30T22:26:13.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.348+0000 7ff2d6ffd700 1 -- 172.21.15.40:0/2969883667 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff2d0013e60 con 0x7ff2e009d920 2023-09-30T22:26:13.349 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:13.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.350+0000 7ff2e87d3700 1 -- 172.21.15.40:0/2969883667 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff2e009d920 msgr2=0x7ff2e01c9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:13.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.350+0000 7ff2e87d3700 1 --2- 172.21.15.40:0/2969883667 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff2e009d920 0x7ff2e01c9190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff2d000ebe0 tx=0x7ff2d000eef0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.350+0000 7ff2e87d3700 1 -- 172.21.15.40:0/2969883667 shutdown_connections 2023-09-30T22:26:13.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.350+0000 7ff2e87d3700 1 --2- 172.21.15.40:0/2969883667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2e009e2b0 0x7ff2e012d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.350+0000 7ff2e87d3700 1 --2- 172.21.15.40:0/2969883667 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff2e009c890 0x7ff2e01c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.350+0000 7ff2e87d3700 1 --2- 172.21.15.40:0/2969883667 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff2e009d920 0x7ff2e01c9190 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.350+0000 7ff2e87d3700 1 -- 172.21.15.40:0/2969883667 >> 172.21.15.40:0/2969883667 conn(0x7ff2e00a7080 msgr2=0x7ff2e00a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:13.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.350+0000 7ff2e87d3700 1 -- 172.21.15.40:0/2969883667 shutdown_connections 2023-09-30T22:26:13.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.350+0000 7ff2e87d3700 1 -- 172.21.15.40:0/2969883667 wait complete. 2023-09-30T22:26:13.363 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:13.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.379+0000 7f389a964700 1 -- 172.21.15.40:0/2902517818 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3894092b30 con 0x7f389406d410 2023-09-30T22:26:13.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.379+0000 7f3890ff9700 1 -- 172.21.15.40:0/2902517818 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3884017070 con 0x7f389406d410 2023-09-30T22:26:13.380 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:13.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.381+0000 7f389a964700 1 -- 172.21.15.40:0/2902517818 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f389406d410 msgr2=0x7f389408f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:13.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.381+0000 7f389a964700 1 --2- 172.21.15.40:0/2902517818 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f389406d410 0x7f389408f820 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f388400ebe0 tx=0x7f388400eef0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.381+0000 7f389a964700 1 -- 172.21.15.40:0/2902517818 shutdown_connections 2023-09-30T22:26:13.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.381+0000 7f389a964700 1 --2- 172.21.15.40:0/2902517818 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f389406d410 0x7f389408f820 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.381+0000 7f389a964700 1 --2- 172.21.15.40:0/2902517818 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f389409fbb0 0x7f38940902a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.381+0000 7f389a964700 1 --2- 172.21.15.40:0/2902517818 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f389406f3a0 0x7f389408fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.381+0000 7f389a964700 1 -- 172.21.15.40:0/2902517818 >> 172.21.15.40:0/2902517818 conn(0x7f38940a41a0 msgr2=0x7f389406f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:13.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.381+0000 7f389a964700 1 -- 172.21.15.40:0/2902517818 shutdown_connections 2023-09-30T22:26:13.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:13.381+0000 7f389a964700 1 -- 172.21.15.40:0/2902517818 wait complete. 2023-09-30T22:26:13.394 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:14.095 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:14.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.236+0000 7f5e7d3bc700 1 Processor -- start 2023-09-30T22:26:14.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.236+0000 7f5e7d3bc700 1 -- start start 2023-09-30T22:26:14.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.236+0000 7f5e7d3bc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e7809d450 0x7f5e7809d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.236+0000 7f5e7d3bc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e7809dd60 0x7f5e781301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.236+0000 7f5e7d3bc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5e78130700 0x7f5e78130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.237+0000 7f5e7d3bc700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e7809e8b0 con 0x7f5e78130700 2023-09-30T22:26:14.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.237+0000 7f5e7d3bc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7809c3b0 con 0x7f5e7809d450 2023-09-30T22:26:14.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.237+0000 7f5e7d3bc700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7809a6b0 con 0x7f5e7809dd60 2023-09-30T22:26:14.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.237+0000 7f5e767fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e7809dd60 0x7f5e781301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.237+0000 7f5e76ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e7809d450 0x7f5e7809d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.237+0000 7f5e777fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5e78130700 0x7f5e78130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.237+0000 7f5e767fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e7809dd60 0x7f5e781301c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52816/0 (socket says 172.21.15.40:52816) 2023-09-30T22:26:14.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.237+0000 7f5e767fc700 1 -- 172.21.15.40:0/1312989507 learned_addr learned my addr 172.21.15.40:0/1312989507 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:14.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.237+0000 7f5e76ffd700 1 -- 172.21.15.40:0/1312989507 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e7809dd60 msgr2=0x7f5e781301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:14.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.237+0000 7f5e76ffd700 1 --2- 172.21.15.40:0/1312989507 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e7809dd60 0x7f5e781301c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.237+0000 7f5e76ffd700 1 -- 172.21.15.40:0/1312989507 >> v2:172.21.15.40:3300/0 conn(0x7f5e78130700 msgr2=0x7f5e78130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:14.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.237+0000 7f5e76ffd700 1 --2- 172.21.15.40:0/1312989507 >> v2:172.21.15.40:3300/0 conn(0x7f5e78130700 0x7f5e78130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.237+0000 7f5e76ffd700 1 -- 172.21.15.40:0/1312989507 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7809b4f0 con 0x7f5e7809d450 2023-09-30T22:26:14.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.237+0000 7f5e777fe700 1 --2- 172.21.15.40:0/1312989507 >> v2:172.21.15.40:3300/0 conn(0x7f5e78130700 0x7f5e78130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:14.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.237+0000 7f5e767fc700 1 --2- 172.21.15.40:0/1312989507 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e7809dd60 0x7f5e781301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:14.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.237+0000 7f5e76ffd700 1 --2- 172.21.15.40:0/1312989507 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e7809d450 0x7f5e7809d820 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5e68009840 tx=0x7f5e68009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41b212049cb2ccc9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:14.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.237+0000 7f5e75ffb700 1 -- 172.21.15.40:0/1312989507 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e68011830 con 0x7f5e7809d450 2023-09-30T22:26:14.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.237+0000 7f5e75ffb700 1 -- 172.21.15.40:0/1312989507 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e68011990 con 0x7f5e7809d450 2023-09-30T22:26:14.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.237+0000 7f5e75ffb700 1 -- 172.21.15.40:0/1312989507 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e68011d20 con 0x7f5e7809d450 2023-09-30T22:26:14.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.238+0000 7f5e7d3bc700 1 -- 172.21.15.40:0/1312989507 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e7809d450 msgr2=0x7f5e7809d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.238+0000 7f5e7d3bc700 1 --2- 172.21.15.40:0/1312989507 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e7809d450 0x7f5e7809d820 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5e68009840 tx=0x7f5e68009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:14.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.238+0000 7f5e7d3bc700 1 -- 172.21.15.40:0/1312989507 shutdown_connections 2023-09-30T22:26:14.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.238+0000 7f5e7d3bc700 1 --2- 172.21.15.40:0/1312989507 >> v2:172.21.15.40:3300/0 conn(0x7f5e78130700 0x7f5e78130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.238+0000 7f5e7d3bc700 1 --2- 172.21.15.40:0/1312989507 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e7809d450 0x7f5e7809d820 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.238+0000 7f5e7d3bc700 1 --2- 172.21.15.40:0/1312989507 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e7809dd60 0x7f5e781301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.238+0000 7f5e7d3bc700 1 -- 172.21.15.40:0/1312989507 >> 172.21.15.40:0/1312989507 conn(0x7f5e780a2a00 msgr2=0x7f5e780a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:14.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.238+0000 7f5e7d3bc700 1 -- 172.21.15.40:0/1312989507 shutdown_connections 2023-09-30T22:26:14.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.238+0000 7f5e7d3bc700 1 -- 172.21.15.40:0/1312989507 wait complete. 2023-09-30T22:26:14.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.239+0000 7f5e7d3bc700 1 Processor -- start 2023-09-30T22:26:14.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.240+0000 7f5e7d3bc700 1 -- start start 2023-09-30T22:26:14.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.240+0000 7f5e7d3bc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e7809d450 0x7f5e781c3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.240+0000 7f5e7d3bc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e7809dd60 0x7f5e781c3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.240+0000 7f5e7d3bc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e78130700 0x7f5e781c4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.240+0000 7f5e7d3bc700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e78120350 con 0x7f5e78130700 2023-09-30T22:26:14.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.240+0000 7f5e7d3bc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e780a18c0 con 0x7f5e7809dd60 2023-09-30T22:26:14.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.240+0000 7f5e7d3bc700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7809c5d0 con 0x7f5e7809d450 2023-09-30T22:26:14.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.240+0000 7f5e76ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e7809d450 0x7f5e781c3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.240+0000 7f5e76ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e7809d450 0x7f5e781c3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52826/0 (socket says 172.21.15.40:52826) 2023-09-30T22:26:14.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.240+0000 7f5e76ffd700 1 -- 172.21.15.40:0/303553270 learned_addr learned my addr 172.21.15.40:0/303553270 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:14.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.240+0000 7f5e767fc700 1 --2- 172.21.15.40:0/303553270 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e7809dd60 0x7f5e781c3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.240+0000 7f5e777fe700 1 --2- 172.21.15.40:0/303553270 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e78130700 0x7f5e781c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.241+0000 7f5e76ffd700 1 -- 172.21.15.40:0/303553270 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e7809dd60 msgr2=0x7f5e781c3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.241+0000 7f5e76ffd700 1 --2- 172.21.15.40:0/303553270 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e7809dd60 0x7f5e781c3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.241+0000 7f5e76ffd700 1 -- 172.21.15.40:0/303553270 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e78130700 msgr2=0x7f5e781c4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.241+0000 7f5e76ffd700 1 --2- 172.21.15.40:0/303553270 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e78130700 0x7f5e781c4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.241+0000 7f5e76ffd700 1 -- 172.21.15.40:0/303553270 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6c00b7f0 con 0x7f5e7809d450 2023-09-30T22:26:14.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.241+0000 7f5e767fc700 1 --2- 172.21.15.40:0/303553270 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e7809dd60 0x7f5e781c3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:14.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.241+0000 7f5e76ffd700 1 --2- 172.21.15.40:0/303553270 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e7809d450 0x7f5e781c3300 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5e680090b0 tx=0x7f5e68004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:14.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.241+0000 7f5e5f7fe700 1 -- 172.21.15.40:0/303553270 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e68004240 con 0x7f5e7809d450 2023-09-30T22:26:14.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.241+0000 7f5e5f7fe700 1 -- 172.21.15.40:0/303553270 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6801f070 con 0x7f5e7809d450 2023-09-30T22:26:14.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.241+0000 7f5e7d3bc700 1 -- 172.21.15.40:0/303553270 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e70009a70 con 0x7f5e7809d450 2023-09-30T22:26:14.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.241+0000 7f5e5f7fe700 1 -- 172.21.15.40:0/303553270 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e680036a0 con 0x7f5e7809d450 2023-09-30T22:26:14.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.241+0000 7f5e7d3bc700 1 -- 172.21.15.40:0/303553270 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e680094a0 con 0x7f5e7809d450 2023-09-30T22:26:14.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.242+0000 7f5e5f7fe700 1 -- 172.21.15.40:0/303553270 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5e68021030 con 0x7f5e7809d450 2023-09-30T22:26:14.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.242+0000 7f5e5f7fe700 1 -- 172.21.15.40:0/303553270 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5e68040690 con 0x7f5e7809d450 2023-09-30T22:26:14.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.242+0000 7f5e7d3bc700 1 -- 172.21.15.40:0/303553270 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e78121910 con 0x7f5e7809d450 2023-09-30T22:26:14.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.247+0000 7f5e5f7fe700 1 -- 172.21.15.40:0/303553270 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5e78121910 con 0x7f5e7809d450 2023-09-30T22:26:14.312 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:14.365 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:14.395 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:14.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.445+0000 7f352368a700 1 Processor -- start 2023-09-30T22:26:14.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.445+0000 7f352368a700 1 -- start start 2023-09-30T22:26:14.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.446+0000 7f352368a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f351c12e590 0x7f351c12e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.446+0000 7f352368a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f351c12d8a0 0x7f351c138c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.446+0000 7f352368a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f351c09ab70 con 0x7f351c12eea0 2023-09-30T22:26:14.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.446+0000 7f352368a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351c09b270 con 0x7f351c12d8a0 2023-09-30T22:26:14.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.446+0000 7f352368a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f351c09bab0 con 0x7f351c12e590 2023-09-30T22:26:14.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.446+0000 7f3520c25700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f351c12eea0 0x7f351c12d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40030/0 (socket says 172.21.15.40:40030) 2023-09-30T22:26:14.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.446+0000 7f3520c25700 1 -- 172.21.15.40:0/1742555151 learned_addr learned my addr 172.21.15.40:0/1742555151 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:14.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.446+0000 7f3521426700 1 --2- 172.21.15.40:0/1742555151 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f351c12e590 0x7f351c12e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.446+0000 7f3513fff700 1 -- 172.21.15.40:0/1742555151 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3647066511 0 0) 0x7f351c09ab70 con 0x7f351c12eea0 2023-09-30T22:26:14.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.446+0000 7f3513fff700 1 -- 172.21.15.40:0/1742555151 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35080057c0 con 0x7f351c12eea0 2023-09-30T22:26:14.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.447+0000 7f3521426700 1 -- 172.21.15.40:0/1742555151 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f351c12d8a0 msgr2=0x7f351c138c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:14.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.447+0000 7f3521426700 1 --2- 172.21.15.40:0/1742555151 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f351c12d8a0 0x7f351c138c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.447+0000 7f3521426700 1 -- 172.21.15.40:0/1742555151 >> v1:172.21.15.40:6789/0 conn(0x7f351c12eea0 legacy=0x7f351c12d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.447+0000 7f3521426700 1 -- 172.21.15.40:0/1742555151 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f351c09bd70 con 0x7f351c12e590 2023-09-30T22:26:14.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.447+0000 7f3521426700 1 --2- 172.21.15.40:0/1742555151 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f351c12e590 0x7f351c12e960 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3518009870 tx=0x7f3518009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1412e4627854c237 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:14.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.447+0000 7f3513fff700 1 -- 172.21.15.40:0/1742555151 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3518011830 con 0x7f351c12e590 2023-09-30T22:26:14.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.447+0000 7f3513fff700 1 -- 172.21.15.40:0/1742555151 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3518011990 con 0x7f351c12e590 2023-09-30T22:26:14.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.447+0000 7f3513fff700 1 -- 172.21.15.40:0/1742555151 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3518011d20 con 0x7f351c12e590 2023-09-30T22:26:14.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.448+0000 7f352368a700 1 -- 172.21.15.40:0/1742555151 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f351c12e590 msgr2=0x7f351c12e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.448+0000 7f352368a700 1 --2- 172.21.15.40:0/1742555151 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f351c12e590 0x7f351c12e960 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3518009870 tx=0x7f3518009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:14.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.448+0000 7f352368a700 1 -- 172.21.15.40:0/1742555151 shutdown_connections 2023-09-30T22:26:14.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.448+0000 7f352368a700 1 --2- 172.21.15.40:0/1742555151 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f351c12d8a0 0x7f351c138c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.448+0000 7f352368a700 1 --2- 172.21.15.40:0/1742555151 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f351c12e590 0x7f351c12e960 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.448+0000 7f352368a700 1 -- 172.21.15.40:0/1742555151 >> 172.21.15.40:0/1742555151 conn(0x7f351c0a2a00 msgr2=0x7f351c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:14.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.448+0000 7f352368a700 1 -- 172.21.15.40:0/1742555151 shutdown_connections 2023-09-30T22:26:14.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.448+0000 7f352368a700 1 -- 172.21.15.40:0/1742555151 wait complete. 2023-09-30T22:26:14.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.449+0000 7f352368a700 1 Processor -- start 2023-09-30T22:26:14.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.449+0000 7f352368a700 1 -- start start 2023-09-30T22:26:14.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.450+0000 7f352368a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f351c12d8a0 0x7f351c11aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.450+0000 7f352368a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f351c12e590 0x7f351c11af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.450+0000 7f352368a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f351c12eea0 0x7f351c11b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.450+0000 7f352368a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351c11bed0 con 0x7f351c12e590 2023-09-30T22:26:14.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.450+0000 7f352368a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351c11c5a0 con 0x7f351c12eea0 2023-09-30T22:26:14.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.450+0000 7f352368a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f351c11d7f0 con 0x7f351c12d8a0 2023-09-30T22:26:14.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.450+0000 7f3520c25700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f351c12e590 0x7f351c11af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.450+0000 7f3520c25700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f351c12e590 0x7f351c11af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43566/0 (socket says 172.21.15.40:43566) 2023-09-30T22:26:14.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.450+0000 7f3520c25700 1 -- 172.21.15.40:0/1675762773 learned_addr learned my addr 172.21.15.40:0/1675762773 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:14.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.450+0000 7f3521c27700 1 --2- 172.21.15.40:0/1675762773 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f351c12eea0 0x7f351c11b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.450+0000 7f3521426700 1 --2- 172.21.15.40:0/1675762773 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f351c12d8a0 0x7f351c11aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.450+0000 7f3520c25700 1 -- 172.21.15.40:0/1675762773 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f351c12d8a0 msgr2=0x7f351c11aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.450+0000 7f3520c25700 1 --2- 172.21.15.40:0/1675762773 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f351c12d8a0 0x7f351c11aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.450+0000 7f3520c25700 1 -- 172.21.15.40:0/1675762773 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f351c12eea0 msgr2=0x7f351c11b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.450+0000 7f3520c25700 1 --2- 172.21.15.40:0/1675762773 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f351c12eea0 0x7f351c11b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.450+0000 7f3520c25700 1 -- 172.21.15.40:0/1675762773 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35180094a0 con 0x7f351c12e590 2023-09-30T22:26:14.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.450+0000 7f3521c27700 1 --2- 172.21.15.40:0/1675762773 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f351c12eea0 0x7f351c11b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:14.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.451+0000 7f3520c25700 1 --2- 172.21.15.40:0/1675762773 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f351c12e590 0x7f351c11af60 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f350c00c700 tx=0x7f350c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:14.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.451+0000 7f3511ffb700 1 -- 172.21.15.40:0/1675762773 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c005d70 con 0x7f351c12e590 2023-09-30T22:26:14.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.451+0000 7f3511ffb700 1 -- 172.21.15.40:0/1675762773 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350c0070d0 con 0x7f351c12e590 2023-09-30T22:26:14.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.451+0000 7f352368a700 1 -- 172.21.15.40:0/1675762773 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f351c11e1d0 con 0x7f351c12e590 2023-09-30T22:26:14.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.451+0000 7f3511ffb700 1 -- 172.21.15.40:0/1675762773 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c007440 con 0x7f351c12e590 2023-09-30T22:26:14.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.451+0000 7f352368a700 1 -- 172.21.15.40:0/1675762773 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f351c09a7c0 con 0x7f351c12e590 2023-09-30T22:26:14.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.452+0000 7f352368a700 1 -- 172.21.15.40:0/1675762773 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f351c09b510 con 0x7f351c12e590 2023-09-30T22:26:14.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.452+0000 7f3511ffb700 1 -- 172.21.15.40:0/1675762773 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f350c0075a0 con 0x7f351c12e590 2023-09-30T22:26:14.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.454+0000 7f3511ffb700 1 -- 172.21.15.40:0/1675762773 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f350c010950 con 0x7f351c12e590 2023-09-30T22:26:14.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.462+0000 7f3511ffb700 1 -- 172.21.15.40:0/1675762773 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f350c019d20 con 0x7f351c12e590 2023-09-30T22:26:14.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.463+0000 7f5e7d3bc700 1 -- 172.21.15.40:0/303553270 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5e78121910 con 0x7f5e7809d450 2023-09-30T22:26:14.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.463+0000 7f5e5f7fe700 1 -- 172.21.15.40:0/303553270 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5e78121910 con 0x7f5e7809d450 2023-09-30T22:26:14.464 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:14.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.466+0000 7f5e7d3bc700 1 -- 172.21.15.40:0/303553270 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e7809d450 msgr2=0x7f5e781c3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.466+0000 7f5e7d3bc700 1 --2- 172.21.15.40:0/303553270 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e7809d450 0x7f5e781c3300 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5e680090b0 tx=0x7f5e68004750 comp rx=0 tx=0).stop 2023-09-30T22:26:14.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.466+0000 7f5e7d3bc700 1 -- 172.21.15.40:0/303553270 shutdown_connections 2023-09-30T22:26:14.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.466+0000 7f5e7d3bc700 1 --2- 172.21.15.40:0/303553270 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e7809d450 0x7f5e781c3300 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.466+0000 7f5e7d3bc700 1 --2- 172.21.15.40:0/303553270 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e78130700 0x7f5e781c4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.466+0000 7f5e7d3bc700 1 --2- 172.21.15.40:0/303553270 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e7809dd60 0x7f5e781c3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.466+0000 7f5e7d3bc700 1 -- 172.21.15.40:0/303553270 >> 172.21.15.40:0/303553270 conn(0x7f5e780a2a00 msgr2=0x7f5e7806fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:14.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.466+0000 7f5e7d3bc700 1 -- 172.21.15.40:0/303553270 shutdown_connections 2023-09-30T22:26:14.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.466+0000 7f5e7d3bc700 1 -- 172.21.15.40:0/303553270 wait complete. 2023-09-30T22:26:14.485 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:14.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.500+0000 7f9d92be7700 1 Processor -- start 2023-09-30T22:26:14.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.500+0000 7f9d92be7700 1 -- start start 2023-09-30T22:26:14.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.501+0000 7f9d92be7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d8c06f070 0x7f9d8c06f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.501+0000 7f9d92be7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d8c06f980 0x7f9d8c097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.501+0000 7f9d92be7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d8c070830 con 0x7f9d8c06fdb0 2023-09-30T22:26:14.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.501+0000 7f9d92be7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c071af0 con 0x7f9d8c06f980 2023-09-30T22:26:14.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.501+0000 7f9d92be7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c070ad0 con 0x7f9d8c06f070 2023-09-30T22:26:14.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.501+0000 7f9d8bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d8c06f980 0x7f9d8c097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.501+0000 7f9d90983700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d8c06f070 0x7f9d8c06f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.501+0000 7f9d8bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d8c06f980 0x7f9d8c097090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48718/0 (socket says 172.21.15.40:48718) 2023-09-30T22:26:14.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.501+0000 7f9d8bfff700 1 -- 172.21.15.40:0/3790622978 learned_addr learned my addr 172.21.15.40:0/3790622978 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:14.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.501+0000 7f9d90983700 1 -- 172.21.15.40:0/3790622978 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d8c06f980 msgr2=0x7f9d8c097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:14.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.501+0000 7f9d90983700 1 --2- 172.21.15.40:0/3790622978 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d8c06f980 0x7f9d8c097090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.501+0000 7f9d90983700 1 -- 172.21.15.40:0/3790622978 >> v1:172.21.15.40:6789/0 conn(0x7f9d8c06fdb0 legacy=0x7f9d8c0975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.501+0000 7f9d90983700 1 -- 172.21.15.40:0/3790622978 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8c070de0 con 0x7f9d8c06f070 2023-09-30T22:26:14.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.501+0000 7f9d8bfff700 1 --2- 172.21.15.40:0/3790622978 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d8c06f980 0x7f9d8c097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:14.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.501+0000 7f9d90983700 1 --2- 172.21.15.40:0/3790622978 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d8c06f070 0x7f9d8c06f440 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9d8400f3d0 tx=0x7f9d8400f6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0bc537e352d0305 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:14.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.501+0000 7f9d8b7fe700 1 -- 172.21.15.40:0/3790622978 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d84012070 con 0x7f9d8c06f070 2023-09-30T22:26:14.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.502+0000 7f9d8b7fe700 1 -- 172.21.15.40:0/3790622978 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8400fe90 con 0x7f9d8c06f070 2023-09-30T22:26:14.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.502+0000 7f9d8b7fe700 1 -- 172.21.15.40:0/3790622978 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8400d310 con 0x7f9d8c06f070 2023-09-30T22:26:14.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.502+0000 7f9d92be7700 1 -- 172.21.15.40:0/3790622978 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d8c06f070 msgr2=0x7f9d8c06f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.502+0000 7f9d92be7700 1 --2- 172.21.15.40:0/3790622978 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d8c06f070 0x7f9d8c06f440 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9d8400f3d0 tx=0x7f9d8400f6e0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.502+0000 7f9d92be7700 1 -- 172.21.15.40:0/3790622978 shutdown_connections 2023-09-30T22:26:14.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.502+0000 7f9d92be7700 1 --2- 172.21.15.40:0/3790622978 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d8c06f070 0x7f9d8c06f440 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.502+0000 7f9d92be7700 1 --2- 172.21.15.40:0/3790622978 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d8c06f980 0x7f9d8c097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.502+0000 7f9d92be7700 1 -- 172.21.15.40:0/3790622978 >> 172.21.15.40:0/3790622978 conn(0x7f9d8c0a41a0 msgr2=0x7f9d8c0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:14.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.502+0000 7f9d92be7700 1 -- 172.21.15.40:0/3790622978 shutdown_connections 2023-09-30T22:26:14.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.502+0000 7f9d92be7700 1 -- 172.21.15.40:0/3790622978 wait complete. 2023-09-30T22:26:14.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.503+0000 7f9d92be7700 1 Processor -- start 2023-09-30T22:26:14.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.503+0000 7f9d92be7700 1 -- start start 2023-09-30T22:26:14.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.504+0000 7f9d92be7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d8c06f070 0x7f9d8c09c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.504+0000 7f9d92be7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d8c06f980 0x7f9d8c09c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.504+0000 7f9d92be7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d8c06fdb0 0x7f9d8c09cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.504+0000 7f9d92be7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c12d760 con 0x7f9d8c06f980 2023-09-30T22:26:14.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.504+0000 7f9d92be7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c12d940 con 0x7f9d8c06fdb0 2023-09-30T22:26:14.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.504+0000 7f9d92be7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c06cd10 con 0x7f9d8c06f070 2023-09-30T22:26:14.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.504+0000 7f9d90983700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d8c06f070 0x7f9d8c09c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.504+0000 7f9d90983700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d8c06f070 0x7f9d8c09c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52862/0 (socket says 172.21.15.40:52862) 2023-09-30T22:26:14.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.504+0000 7f9d90983700 1 -- 172.21.15.40:0/1168923634 learned_addr learned my addr 172.21.15.40:0/1168923634 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:14.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.504+0000 7f9d8bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d8c06f980 0x7f9d8c09c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.504+0000 7f9d91184700 1 --2- 172.21.15.40:0/1168923634 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d8c06fdb0 0x7f9d8c09cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.505+0000 7f9d8bfff700 1 -- 172.21.15.40:0/1168923634 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d8c06f070 msgr2=0x7f9d8c09c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.505+0000 7f9d8bfff700 1 --2- 172.21.15.40:0/1168923634 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d8c06f070 0x7f9d8c09c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.505+0000 7f9d8bfff700 1 -- 172.21.15.40:0/1168923634 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d8c06fdb0 msgr2=0x7f9d8c09cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.505+0000 7f9d8bfff700 1 --2- 172.21.15.40:0/1168923634 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d8c06fdb0 0x7f9d8c09cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.505+0000 7f9d8bfff700 1 -- 172.21.15.40:0/1168923634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7c009550 con 0x7f9d8c06f980 2023-09-30T22:26:14.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.505+0000 7f9d90983700 1 --2- 172.21.15.40:0/1168923634 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d8c06f070 0x7f9d8c09c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:14.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.505+0000 7f9d8bfff700 1 --2- 172.21.15.40:0/1168923634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d8c06f980 0x7f9d8c09c7e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c067db0 tx=0x7f9d7c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:14.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.505+0000 7f9d897fa700 1 -- 172.21.15.40:0/1168923634 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c004240 con 0x7f9d8c06f980 2023-09-30T22:26:14.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.505+0000 7f9d897fa700 1 -- 172.21.15.40:0/1168923634 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7c0043a0 con 0x7f9d8c06f980 2023-09-30T22:26:14.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.505+0000 7f9d92be7700 1 -- 172.21.15.40:0/1168923634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d8400f050 con 0x7f9d8c06f980 2023-09-30T22:26:14.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.505+0000 7f9d897fa700 1 -- 172.21.15.40:0/1168923634 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c0036a0 con 0x7f9d8c06f980 2023-09-30T22:26:14.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.505+0000 7f9d92be7700 1 -- 172.21.15.40:0/1168923634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d8c12d3a0 con 0x7f9d8c06f980 2023-09-30T22:26:14.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.506+0000 7f9d92be7700 1 -- 172.21.15.40:0/1168923634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d8c12d590 con 0x7f9d8c06f980 2023-09-30T22:26:14.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.507+0000 7f9d897fa700 1 -- 172.21.15.40:0/1168923634 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d7c003800 con 0x7f9d8c06f980 2023-09-30T22:26:14.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.507+0000 7f9d897fa700 1 -- 172.21.15.40:0/1168923634 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9d7c03fc30 con 0x7f9d8c06f980 2023-09-30T22:26:14.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.511+0000 7f9d897fa700 1 -- 172.21.15.40:0/1168923634 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d7c012c00 con 0x7f9d8c06f980 2023-09-30T22:26:14.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.550+0000 7f6cc60e7700 1 Processor -- start 2023-09-30T22:26:14.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.550+0000 7f6cc60e7700 1 -- start start 2023-09-30T22:26:14.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.551+0000 7f6cc60e7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6cc009d920 0x7f6cc009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.551+0000 7f6cc60e7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6cc009f0f0 0x7f6cc009e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.551+0000 7f6cc60e7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6cc0133ca0 0x7f6cc0134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.551+0000 7f6cc60e7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cc006b4c0 con 0x7f6cc0133ca0 2023-09-30T22:26:14.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.551+0000 7f6cc60e7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc009a8f0 con 0x7f6cc009d920 2023-09-30T22:26:14.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.551+0000 7f6cc60e7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc009f940 con 0x7f6cc009f0f0 2023-09-30T22:26:14.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.551+0000 7f6cbffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6cc0133ca0 0x7f6cc0134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.551+0000 7f6cbf7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6cc009d920 0x7f6cc009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.551+0000 7f6cbffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6cc0133ca0 0x7f6cc0134140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43588/0 (socket says 172.21.15.40:43588) 2023-09-30T22:26:14.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.551+0000 7f6cbffff700 1 -- 172.21.15.40:0/646297059 learned_addr learned my addr 172.21.15.40:0/646297059 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:14.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.551+0000 7f6cbeffd700 1 --2- 172.21.15.40:0/646297059 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6cc009f0f0 0x7f6cc009e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.551+0000 7f6cbf7fe700 1 -- 172.21.15.40:0/646297059 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6cc009f0f0 msgr2=0x7f6cc009e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:14.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.551+0000 7f6cbf7fe700 1 --2- 172.21.15.40:0/646297059 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6cc009f0f0 0x7f6cc009e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.551+0000 7f6cbf7fe700 1 -- 172.21.15.40:0/646297059 >> v2:172.21.15.40:3300/0 conn(0x7f6cc0133ca0 msgr2=0x7f6cc0134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:14.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.551+0000 7f6cbf7fe700 1 --2- 172.21.15.40:0/646297059 >> v2:172.21.15.40:3300/0 conn(0x7f6cc0133ca0 0x7f6cc0134140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.551+0000 7f6cbf7fe700 1 -- 172.21.15.40:0/646297059 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc009f6e0 con 0x7f6cc009d920 2023-09-30T22:26:14.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.551+0000 7f6cbeffd700 1 --2- 172.21.15.40:0/646297059 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6cc009f0f0 0x7f6cc009e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:14.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.552+0000 7f6cbf7fe700 1 --2- 172.21.15.40:0/646297059 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6cc009d920 0x7f6cc009dcf0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0009880 tx=0x7f6cb0009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=146b79856640c7b0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:14.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.552+0000 7f6cbe7fc700 1 -- 172.21.15.40:0/646297059 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0005e30 con 0x7f6cc009d920 2023-09-30T22:26:14.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.552+0000 7f6cbe7fc700 1 -- 172.21.15.40:0/646297059 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb0006030 con 0x7f6cc009d920 2023-09-30T22:26:14.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.552+0000 7f6cbe7fc700 1 -- 172.21.15.40:0/646297059 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb00063c0 con 0x7f6cc009d920 2023-09-30T22:26:14.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.553+0000 7f6cc60e7700 1 -- 172.21.15.40:0/646297059 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6cc009d920 msgr2=0x7f6cc009dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.553+0000 7f6cc60e7700 1 --2- 172.21.15.40:0/646297059 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6cc009d920 0x7f6cc009dcf0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0009880 tx=0x7f6cb0009b90 comp rx=0 tx=0).stop 2023-09-30T22:26:14.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.553+0000 7f6cc60e7700 1 -- 172.21.15.40:0/646297059 shutdown_connections 2023-09-30T22:26:14.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.553+0000 7f6cc60e7700 1 --2- 172.21.15.40:0/646297059 >> v2:172.21.15.40:3300/0 conn(0x7f6cc0133ca0 0x7f6cc0134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.553+0000 7f6cc60e7700 1 --2- 172.21.15.40:0/646297059 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6cc009d920 0x7f6cc009dcf0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.553+0000 7f6cc60e7700 1 --2- 172.21.15.40:0/646297059 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6cc009f0f0 0x7f6cc009e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.553+0000 7f6cc60e7700 1 -- 172.21.15.40:0/646297059 >> 172.21.15.40:0/646297059 conn(0x7f6cc009fb20 msgr2=0x7f6cc009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:14.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.553+0000 7f6cc60e7700 1 -- 172.21.15.40:0/646297059 shutdown_connections 2023-09-30T22:26:14.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.553+0000 7f6cc60e7700 1 -- 172.21.15.40:0/646297059 wait complete. 2023-09-30T22:26:14.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.554+0000 7f6cc60e7700 1 Processor -- start 2023-09-30T22:26:14.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.554+0000 7f6cc60e7700 1 -- start start 2023-09-30T22:26:14.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.555+0000 7f6cc60e7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cc009d920 0x7f6cc0121880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.555+0000 7f6cc60e7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6cc0133ca0 0x7f6cc0121dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.555+0000 7f6cc60e7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6cc0122300 0x7f6cc01c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.555+0000 7f6cc60e7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc009c9e0 con 0x7f6cc009d920 2023-09-30T22:26:14.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.555+0000 7f6cc60e7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc01250c0 con 0x7f6cc0133ca0 2023-09-30T22:26:14.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.555+0000 7f6cc60e7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc00a2a80 con 0x7f6cc0122300 2023-09-30T22:26:14.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.555+0000 7f6cbf7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cc009d920 0x7f6cc0121880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.555+0000 7f6cbf7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cc009d920 0x7f6cc0121880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43596/0 (socket says 172.21.15.40:43596) 2023-09-30T22:26:14.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.555+0000 7f6cbf7fe700 1 -- 172.21.15.40:0/455907374 learned_addr learned my addr 172.21.15.40:0/455907374 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:14.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.555+0000 7f6cbffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6cc0122300 0x7f6cc01c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.555+0000 7f6cbeffd700 1 --2- 172.21.15.40:0/455907374 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6cc0133ca0 0x7f6cc0121dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.556+0000 7f6cbf7fe700 1 -- 172.21.15.40:0/455907374 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6cc0122300 msgr2=0x7f6cc01c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.556+0000 7f6cbf7fe700 1 --2- 172.21.15.40:0/455907374 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6cc0122300 0x7f6cc01c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.556+0000 7f6cbf7fe700 1 -- 172.21.15.40:0/455907374 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6cc0133ca0 msgr2=0x7f6cc0121dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.556+0000 7f6cbf7fe700 1 --2- 172.21.15.40:0/455907374 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6cc0133ca0 0x7f6cc0121dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.556+0000 7f6cbf7fe700 1 -- 172.21.15.40:0/455907374 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb40094a0 con 0x7f6cc009d920 2023-09-30T22:26:14.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.556+0000 7f6cbeffd700 1 --2- 172.21.15.40:0/455907374 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6cc0133ca0 0x7f6cc0121dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:14.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.556+0000 7f6cbf7fe700 1 --2- 172.21.15.40:0/455907374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cc009d920 0x7f6cc0121880 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0009bd0 tx=0x7f6cb0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:14.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.556+0000 7f6ca7fff700 1 -- 172.21.15.40:0/455907374 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb00065b0 con 0x7f6cc009d920 2023-09-30T22:26:14.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.556+0000 7f6ca7fff700 1 -- 172.21.15.40:0/455907374 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb0006710 con 0x7f6cc009d920 2023-09-30T22:26:14.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.556+0000 7f6cc60e7700 1 -- 172.21.15.40:0/455907374 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb0009430 con 0x7f6cc009d920 2023-09-30T22:26:14.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.556+0000 7f6ca7fff700 1 -- 172.21.15.40:0/455907374 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0004560 con 0x7f6cc009d920 2023-09-30T22:26:14.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.556+0000 7f6cc60e7700 1 -- 172.21.15.40:0/455907374 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cc01323a0 con 0x7f6cc009d920 2023-09-30T22:26:14.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.557+0000 7f6ca7fff700 1 -- 172.21.15.40:0/455907374 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6cb0022070 con 0x7f6cc009d920 2023-09-30T22:26:14.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.557+0000 7f6ca7fff700 1 -- 172.21.15.40:0/455907374 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6cb0040dc0 con 0x7f6cc009d920 2023-09-30T22:26:14.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.557+0000 7f6cc60e7700 1 -- 172.21.15.40:0/455907374 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cc0062380 con 0x7f6cc009d920 2023-09-30T22:26:14.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.562+0000 7f6ca7fff700 1 -- 172.21.15.40:0/455907374 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6cb002a030 con 0x7f6cc009d920 2023-09-30T22:26:14.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.669+0000 7f352368a700 1 -- 172.21.15.40:0/1675762773 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f351c062380 con 0x7f351c12e590 2023-09-30T22:26:14.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.670+0000 7f3511ffb700 1 -- 172.21.15.40:0/1675762773 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f350c017070 con 0x7f351c12e590 2023-09-30T22:26:14.670 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:14.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.672+0000 7f352368a700 1 -- 172.21.15.40:0/1675762773 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f351c12e590 msgr2=0x7f351c11af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.672+0000 7f352368a700 1 --2- 172.21.15.40:0/1675762773 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f351c12e590 0x7f351c11af60 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f350c00c700 tx=0x7f350c00ca10 comp rx=0 tx=0).stop 2023-09-30T22:26:14.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.672+0000 7f352368a700 1 -- 172.21.15.40:0/1675762773 shutdown_connections 2023-09-30T22:26:14.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.672+0000 7f352368a700 1 --2- 172.21.15.40:0/1675762773 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f351c12d8a0 0x7f351c11aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.672+0000 7f352368a700 1 --2- 172.21.15.40:0/1675762773 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f351c12eea0 0x7f351c11b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.672+0000 7f352368a700 1 --2- 172.21.15.40:0/1675762773 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f351c12e590 0x7f351c11af60 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.672+0000 7f352368a700 1 -- 172.21.15.40:0/1675762773 >> 172.21.15.40:0/1675762773 conn(0x7f351c0a2a00 msgr2=0x7f351c130c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:14.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.672+0000 7f352368a700 1 -- 172.21.15.40:0/1675762773 shutdown_connections 2023-09-30T22:26:14.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.672+0000 7f352368a700 1 -- 172.21.15.40:0/1675762773 wait complete. 2023-09-30T22:26:14.685 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:14.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.709+0000 7f9d92be7700 1 -- 172.21.15.40:0/1168923634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9d8c062380 con 0x7f9d8c06f980 2023-09-30T22:26:14.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.710+0000 7f9d897fa700 1 -- 172.21.15.40:0/1168923634 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9d7c0123d0 con 0x7f9d8c06f980 2023-09-30T22:26:14.711 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:14.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.712+0000 7f9d92be7700 1 -- 172.21.15.40:0/1168923634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d8c06f980 msgr2=0x7f9d8c09c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.712+0000 7f9d92be7700 1 --2- 172.21.15.40:0/1168923634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d8c06f980 0x7f9d8c09c7e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c067db0 tx=0x7f9d7c00ec80 comp rx=0 tx=0).stop 2023-09-30T22:26:14.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.712+0000 7f9d92be7700 1 -- 172.21.15.40:0/1168923634 shutdown_connections 2023-09-30T22:26:14.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.712+0000 7f9d92be7700 1 --2- 172.21.15.40:0/1168923634 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d8c06f070 0x7f9d8c09c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.712+0000 7f9d92be7700 1 --2- 172.21.15.40:0/1168923634 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d8c06fdb0 0x7f9d8c09cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.712+0000 7f9d92be7700 1 --2- 172.21.15.40:0/1168923634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d8c06f980 0x7f9d8c09c7e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.712+0000 7f9d92be7700 1 -- 172.21.15.40:0/1168923634 >> 172.21.15.40:0/1168923634 conn(0x7f9d8c0a41a0 msgr2=0x7f9d8c0975c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:14.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.712+0000 7f9d92be7700 1 -- 172.21.15.40:0/1168923634 shutdown_connections 2023-09-30T22:26:14.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.712+0000 7f9d92be7700 1 -- 172.21.15.40:0/1168923634 wait complete. 2023-09-30T22:26:14.724 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:14.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.759+0000 7f6cc60e7700 1 -- 172.21.15.40:0/455907374 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6cc0074720 con 0x7f6cc009d920 2023-09-30T22:26:14.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.759+0000 7f6ca7fff700 1 -- 172.21.15.40:0/455907374 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6cb0003e00 con 0x7f6cc009d920 2023-09-30T22:26:14.760 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:14.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.761+0000 7f6cc60e7700 1 -- 172.21.15.40:0/455907374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cc009d920 msgr2=0x7f6cc0121880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.761+0000 7f6cc60e7700 1 --2- 172.21.15.40:0/455907374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cc009d920 0x7f6cc0121880 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0009bd0 tx=0x7f6cb0004750 comp rx=0 tx=0).stop 2023-09-30T22:26:14.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.761+0000 7f6cc60e7700 1 -- 172.21.15.40:0/455907374 shutdown_connections 2023-09-30T22:26:14.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.761+0000 7f6cc60e7700 1 --2- 172.21.15.40:0/455907374 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6cc0122300 0x7f6cc01c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.761+0000 7f6cc60e7700 1 --2- 172.21.15.40:0/455907374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cc009d920 0x7f6cc0121880 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.761+0000 7f6cc60e7700 1 --2- 172.21.15.40:0/455907374 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6cc0133ca0 0x7f6cc0121dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.761+0000 7f6cc60e7700 1 -- 172.21.15.40:0/455907374 >> 172.21.15.40:0/455907374 conn(0x7f6cc009fb20 msgr2=0x7f6cc00a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:14.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.761+0000 7f6cc60e7700 1 -- 172.21.15.40:0/455907374 shutdown_connections 2023-09-30T22:26:14.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:14.761+0000 7f6cc60e7700 1 -- 172.21.15.40:0/455907374 wait complete. 2023-09-30T22:26:14.774 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:15.486 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:15.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.628+0000 7fdb44370700 1 Processor -- start 2023-09-30T22:26:15.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.628+0000 7fdb44370700 1 -- start start 2023-09-30T22:26:15.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.628+0000 7fdb44370700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb3c09d920 0x7fdb3c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:15.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.628+0000 7fdb44370700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdb3c09e230 0x7fdb3c1308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:15.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.628+0000 7fdb44370700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb3c09adf0 con 0x7fdb3c130de0 2023-09-30T22:26:15.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.628+0000 7fdb44370700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb3c09edf0 con 0x7fdb3c09e230 2023-09-30T22:26:15.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.628+0000 7fdb44370700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3c09b660 con 0x7fdb3c09d920 2023-09-30T22:26:15.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.629+0000 7fdb4210c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb3c09d920 0x7fdb3c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:15.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.629+0000 7fdb4190b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdb3c09e230 0x7fdb3c1308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:15.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.629+0000 7fdb4210c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb3c09d920 0x7fdb3c09dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52892/0 (socket says 172.21.15.40:52892) 2023-09-30T22:26:15.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.629+0000 7fdb4210c700 1 -- 172.21.15.40:0/1860272478 learned_addr learned my addr 172.21.15.40:0/1860272478 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:15.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.629+0000 7fdb4210c700 1 -- 172.21.15.40:0/1860272478 >> v2:172.21.15.40:3300/0 conn(0x7fdb3c09e230 msgr2=0x7fdb3c1308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:15.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.629+0000 7fdb4210c700 1 --2- 172.21.15.40:0/1860272478 >> v2:172.21.15.40:3300/0 conn(0x7fdb3c09e230 0x7fdb3c1308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:15.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.629+0000 7fdb4210c700 1 -- 172.21.15.40:0/1860272478 >> v1:172.21.15.40:6789/0 conn(0x7fdb3c130de0 legacy=0x7fdb3c137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:15.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.629+0000 7fdb4210c700 1 -- 172.21.15.40:0/1860272478 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb3c09a6e0 con 0x7fdb3c09d920 2023-09-30T22:26:15.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.629+0000 7fdb4210c700 1 --2- 172.21.15.40:0/1860272478 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb3c09d920 0x7fdb3c09dcf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdb38006fd0 tx=0x7fdb3800be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b2f3b0206db7f4d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:15.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.629+0000 7fdb4110a700 1 -- 172.21.15.40:0/1860272478 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb38005e30 con 0x7fdb3c09d920 2023-09-30T22:26:15.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.629+0000 7fdb4110a700 1 -- 172.21.15.40:0/1860272478 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb38004030 con 0x7fdb3c09d920 2023-09-30T22:26:15.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.629+0000 7fdb4110a700 1 -- 172.21.15.40:0/1860272478 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb380043e0 con 0x7fdb3c09d920 2023-09-30T22:26:15.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.630+0000 7fdb44370700 1 -- 172.21.15.40:0/1860272478 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb3c09d920 msgr2=0x7fdb3c09dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:15.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.630+0000 7fdb44370700 1 --2- 172.21.15.40:0/1860272478 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb3c09d920 0x7fdb3c09dcf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdb38006fd0 tx=0x7fdb3800be70 comp rx=0 tx=0).stop 2023-09-30T22:26:15.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.630+0000 7fdb44370700 1 -- 172.21.15.40:0/1860272478 shutdown_connections 2023-09-30T22:26:15.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.630+0000 7fdb44370700 1 --2- 172.21.15.40:0/1860272478 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb3c09d920 0x7fdb3c09dcf0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:15.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.630+0000 7fdb44370700 1 --2- 172.21.15.40:0/1860272478 >> v2:172.21.15.40:3300/0 conn(0x7fdb3c09e230 0x7fdb3c1308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:15.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.630+0000 7fdb44370700 1 -- 172.21.15.40:0/1860272478 >> 172.21.15.40:0/1860272478 conn(0x7fdb3c09fb20 msgr2=0x7fdb3c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:15.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.630+0000 7fdb44370700 1 -- 172.21.15.40:0/1860272478 shutdown_connections 2023-09-30T22:26:15.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.630+0000 7fdb44370700 1 -- 172.21.15.40:0/1860272478 wait complete. 2023-09-30T22:26:15.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.631+0000 7fdb44370700 1 Processor -- start 2023-09-30T22:26:15.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.631+0000 7fdb44370700 1 -- start start 2023-09-30T22:26:15.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.631+0000 7fdb44370700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb3c09d920 0x7fdb3c1203b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:15.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.631+0000 7fdb44370700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb3c09e230 0x7fdb3c1208f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:15.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.631+0000 7fdb44370700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb3c130de0 0x7fdb3c120e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:15.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.631+0000 7fdb44370700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3c122560 con 0x7fdb3c09e230 2023-09-30T22:26:15.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.631+0000 7fdb44370700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3c06b1b0 con 0x7fdb3c130de0 2023-09-30T22:26:15.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.631+0000 7fdb44370700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3c09cb00 con 0x7fdb3c09d920 2023-09-30T22:26:15.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.631+0000 7fdb4210c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb3c09d920 0x7fdb3c1203b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:15.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.631+0000 7fdb4190b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb3c09e230 0x7fdb3c1208f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:15.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.631+0000 7fdb4210c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb3c09d920 0x7fdb3c1203b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52900/0 (socket says 172.21.15.40:52900) 2023-09-30T22:26:15.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.631+0000 7fdb4210c700 1 -- 172.21.15.40:0/1189039448 learned_addr learned my addr 172.21.15.40:0/1189039448 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:15.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.632+0000 7fdb4290d700 1 --2- 172.21.15.40:0/1189039448 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb3c130de0 0x7fdb3c120e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:15.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.632+0000 7fdb4210c700 1 -- 172.21.15.40:0/1189039448 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb3c130de0 msgr2=0x7fdb3c120e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:15.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.632+0000 7fdb4210c700 1 --2- 172.21.15.40:0/1189039448 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb3c130de0 0x7fdb3c120e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:15.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.632+0000 7fdb4210c700 1 -- 172.21.15.40:0/1189039448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb3c09e230 msgr2=0x7fdb3c1208f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:15.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.632+0000 7fdb4210c700 1 --2- 172.21.15.40:0/1189039448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb3c09e230 0x7fdb3c1208f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:15.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.632+0000 7fdb4210c700 1 -- 172.21.15.40:0/1189039448 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb3800b7a0 con 0x7fdb3c09d920 2023-09-30T22:26:15.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.632+0000 7fdb4190b700 1 --2- 172.21.15.40:0/1189039448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb3c09e230 0x7fdb3c1208f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:15.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.632+0000 7fdb4210c700 1 --2- 172.21.15.40:0/1189039448 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb3c09d920 0x7fdb3c1203b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdb3800b340 tx=0x7fdb38004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:15.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.632+0000 7fdb32ffd700 1 -- 172.21.15.40:0/1189039448 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3801e070 con 0x7fdb3c09d920 2023-09-30T22:26:15.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.632+0000 7fdb32ffd700 1 -- 172.21.15.40:0/1189039448 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb38006b70 con 0x7fdb3c09d920 2023-09-30T22:26:15.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.632+0000 7fdb44370700 1 -- 172.21.15.40:0/1189039448 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb3c123660 con 0x7fdb3c09d920 2023-09-30T22:26:15.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.632+0000 7fdb32ffd700 1 -- 172.21.15.40:0/1189039448 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb38003ad0 con 0x7fdb3c09d920 2023-09-30T22:26:15.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.632+0000 7fdb44370700 1 -- 172.21.15.40:0/1189039448 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb3c1227b0 con 0x7fdb3c09d920 2023-09-30T22:26:15.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.633+0000 7fdb32ffd700 1 -- 172.21.15.40:0/1189039448 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb38003c30 con 0x7fdb3c09d920 2023-09-30T22:26:15.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.633+0000 7fdb32ffd700 1 -- 172.21.15.40:0/1189039448 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fdb38040440 con 0x7fdb3c09d920 2023-09-30T22:26:15.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.633+0000 7fdb44370700 1 -- 172.21.15.40:0/1189039448 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb3c062380 con 0x7fdb3c09d920 2023-09-30T22:26:15.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.638+0000 7fdb32ffd700 1 -- 172.21.15.40:0/1189039448 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb38027080 con 0x7fdb3c09d920 2023-09-30T22:26:15.686 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:15.726 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:15.775 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:15.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.820+0000 7fb923b4d700 1 Processor -- start 2023-09-30T22:26:15.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.820+0000 7fb923b4d700 1 -- start start 2023-09-30T22:26:15.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.820+0000 7fb923b4d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb91c13b130 0x7fb91c13d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:15.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.820+0000 7fb923b4d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb91c13da50 0x7fb91c13fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:15.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.820+0000 7fb923b4d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb91c137e20 con 0x7fb91c138250 2023-09-30T22:26:15.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.820+0000 7fb923b4d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb91c138d30 con 0x7fb91c13b130 2023-09-30T22:26:15.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.820+0000 7fb923b4d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c138050 con 0x7fb91c13da50 2023-09-30T22:26:15.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.821+0000 7fb9210e8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb91c13b130 0x7fb91c13d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:15.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.821+0000 7fb9220ea700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb91c13da50 0x7fb91c13fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:15.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.821+0000 7fb9210e8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb91c13b130 0x7fb91c13d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43620/0 (socket says 172.21.15.40:43620) 2023-09-30T22:26:15.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.821+0000 7fb9210e8700 1 -- 172.21.15.40:0/3095996743 learned_addr learned my addr 172.21.15.40:0/3095996743 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:15.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.821+0000 7fb9220ea700 1 -- 172.21.15.40:0/3095996743 >> v2:172.21.15.40:3300/0 conn(0x7fb91c13b130 msgr2=0x7fb91c13d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:15.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.821+0000 7fb9220ea700 1 --2- 172.21.15.40:0/3095996743 >> v2:172.21.15.40:3300/0 conn(0x7fb91c13b130 0x7fb91c13d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:15.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.821+0000 7fb9220ea700 1 -- 172.21.15.40:0/3095996743 >> v1:172.21.15.40:6789/0 conn(0x7fb91c138250 legacy=0x7fb91c138620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:15.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.821+0000 7fb9220ea700 1 -- 172.21.15.40:0/3095996743 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91c09b010 con 0x7fb91c13da50 2023-09-30T22:26:15.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.821+0000 7fb9210e8700 1 --2- 172.21.15.40:0/3095996743 >> v2:172.21.15.40:3300/0 conn(0x7fb91c13b130 0x7fb91c13d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:15.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.821+0000 7fb9220ea700 1 --2- 172.21.15.40:0/3095996743 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb91c13da50 0x7fb91c13fe30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb914009d90 tx=0x7fb91400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7fcc2f586d6c561 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:15.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.821+0000 7fb9208e7700 1 -- 172.21.15.40:0/3095996743 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91400e070 con 0x7fb91c13da50 2023-09-30T22:26:15.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.821+0000 7fb9208e7700 1 -- 172.21.15.40:0/3095996743 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91400bb20 con 0x7fb91c13da50 2023-09-30T22:26:15.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.821+0000 7fb9208e7700 1 -- 172.21.15.40:0/3095996743 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb914012430 con 0x7fb91c13da50 2023-09-30T22:26:15.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.822+0000 7fb923b4d700 1 -- 172.21.15.40:0/3095996743 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb91c13da50 msgr2=0x7fb91c13fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:15.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.822+0000 7fb923b4d700 1 --2- 172.21.15.40:0/3095996743 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb91c13da50 0x7fb91c13fe30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb914009d90 tx=0x7fb91400b330 comp rx=0 tx=0).stop 2023-09-30T22:26:15.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.822+0000 7fb923b4d700 1 -- 172.21.15.40:0/3095996743 shutdown_connections 2023-09-30T22:26:15.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.822+0000 7fb923b4d700 1 --2- 172.21.15.40:0/3095996743 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb91c13da50 0x7fb91c13fe30 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:15.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.822+0000 7fb923b4d700 1 --2- 172.21.15.40:0/3095996743 >> v2:172.21.15.40:3300/0 conn(0x7fb91c13b130 0x7fb91c13d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:15.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.822+0000 7fb923b4d700 1 -- 172.21.15.40:0/3095996743 >> 172.21.15.40:0/3095996743 conn(0x7fb91c0a2a00 msgr2=0x7fb91c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:15.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.822+0000 7fb923b4d700 1 -- 172.21.15.40:0/3095996743 shutdown_connections 2023-09-30T22:26:15.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.822+0000 7fb923b4d700 1 -- 172.21.15.40:0/3095996743 wait complete. 2023-09-30T22:26:15.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.823+0000 7fb923b4d700 1 Processor -- start 2023-09-30T22:26:15.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.823+0000 7fb923b4d700 1 -- start start 2023-09-30T22:26:15.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.824+0000 7fb923b4d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb91c138250 0x7fb91c13f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:15.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.824+0000 7fb923b4d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb91c13b130 0x7fb91c13fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:15.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.824+0000 7fb923b4d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb91c13da50 0x7fb91c1402d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:15.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.824+0000 7fb923b4d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c09a300 con 0x7fb91c13b130 2023-09-30T22:26:15.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.824+0000 7fb923b4d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c070750 con 0x7fb91c138250 2023-09-30T22:26:15.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.824+0000 7fb923b4d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c140f50 con 0x7fb91c13da50 2023-09-30T22:26:15.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.824+0000 7fb9218e9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb91c138250 0x7fb91c13f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:15.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.824+0000 7fb9218e9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb91c138250 0x7fb91c13f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48768/0 (socket says 172.21.15.40:48768) 2023-09-30T22:26:15.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.824+0000 7fb9218e9700 1 -- 172.21.15.40:0/472556426 learned_addr learned my addr 172.21.15.40:0/472556426 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:15.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.824+0000 7fb9210e8700 1 --2- 172.21.15.40:0/472556426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb91c13b130 0x7fb91c13fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:15.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.824+0000 7fb9218e9700 1 -- 172.21.15.40:0/472556426 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb91c13da50 msgr2=0x7fb91c1402d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:26:15.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.824+0000 7fb9218e9700 1 --2- 172.21.15.40:0/472556426 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb91c13da50 0x7fb91c1402d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:15.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.824+0000 7fb9218e9700 1 -- 172.21.15.40:0/472556426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb91c13b130 msgr2=0x7fb91c13fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:15.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.824+0000 7fb9218e9700 1 --2- 172.21.15.40:0/472556426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb91c13b130 0x7fb91c13fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:15.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.824+0000 7fb9218e9700 1 -- 172.21.15.40:0/472556426 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90c009550 con 0x7fb91c138250 2023-09-30T22:26:15.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.824+0000 7fb9218e9700 1 --2- 172.21.15.40:0/472556426 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb91c138250 0x7fb91c13f850 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb91800c4e0 tx=0x7fb91800c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:15.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.825+0000 7fb9127fc700 1 -- 172.21.15.40:0/472556426 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9180052d0 con 0x7fb91c138250 2023-09-30T22:26:15.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.825+0000 7fb923b4d700 1 -- 172.21.15.40:0/472556426 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb914009a70 con 0x7fb91c138250 2023-09-30T22:26:15.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.825+0000 7fb9127fc700 1 -- 172.21.15.40:0/472556426 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb918005430 con 0x7fb91c138250 2023-09-30T22:26:15.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.825+0000 7fb9127fc700 1 -- 172.21.15.40:0/472556426 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9180038c0 con 0x7fb91c138250 2023-09-30T22:26:15.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.825+0000 7fb923b4d700 1 -- 172.21.15.40:0/472556426 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb91c06fa60 con 0x7fb91c138250 2023-09-30T22:26:15.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.825+0000 7fb9127fc700 1 -- 172.21.15.40:0/472556426 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb918003a20 con 0x7fb91c138250 2023-09-30T22:26:15.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.827+0000 7fb923b4d700 1 -- 172.21.15.40:0/472556426 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb91c062380 con 0x7fb91c138250 2023-09-30T22:26:15.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.827+0000 7fb9127fc700 1 -- 172.21.15.40:0/472556426 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb918010e00 con 0x7fb91c138250 2023-09-30T22:26:15.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.836+0000 7fb9127fc700 1 -- 172.21.15.40:0/472556426 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb918017070 con 0x7fb91c138250 2023-09-30T22:26:15.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.854+0000 7fdb44370700 1 -- 172.21.15.40:0/1189039448 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdb3c074720 con 0x7fdb3c09d920 2023-09-30T22:26:15.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.855+0000 7fdb32ffd700 1 -- 172.21.15.40:0/1189039448 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdb38020310 con 0x7fdb3c09d920 2023-09-30T22:26:15.855 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:15.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.858+0000 7fdb44370700 1 -- 172.21.15.40:0/1189039448 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb3c09d920 msgr2=0x7fdb3c1203b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:15.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.858+0000 7fdb44370700 1 --2- 172.21.15.40:0/1189039448 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb3c09d920 0x7fdb3c1203b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdb3800b340 tx=0x7fdb38004750 comp rx=0 tx=0).stop 2023-09-30T22:26:15.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.859+0000 7fdb44370700 1 -- 172.21.15.40:0/1189039448 shutdown_connections 2023-09-30T22:26:15.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.859+0000 7fdb44370700 1 --2- 172.21.15.40:0/1189039448 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb3c09d920 0x7fdb3c1203b0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:15.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.859+0000 7fdb44370700 1 --2- 172.21.15.40:0/1189039448 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb3c130de0 0x7fdb3c120e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:15.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.859+0000 7fdb44370700 1 --2- 172.21.15.40:0/1189039448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb3c09e230 0x7fdb3c1208f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:15.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.859+0000 7fdb44370700 1 -- 172.21.15.40:0/1189039448 >> 172.21.15.40:0/1189039448 conn(0x7fdb3c09fb20 msgr2=0x7fdb3c130140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:15.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.859+0000 7fdb44370700 1 -- 172.21.15.40:0/1189039448 shutdown_connections 2023-09-30T22:26:15.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.859+0000 7fdb44370700 1 -- 172.21.15.40:0/1189039448 wait complete. 2023-09-30T22:26:15.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.870+0000 7fd0e2123700 1 Processor -- start 2023-09-30T22:26:15.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.870+0000 7fd0e2123700 1 -- start start 2023-09-30T22:26:15.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.870+0000 7fd0e2123700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0dc133e00 0x7fd0dc1341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:15.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.870+0000 7fd0e2123700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd0dc09df40 0x7fd0dc13bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:15.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.870+0000 7fd0e2123700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0dc133940 con 0x7fd0dc09d400 2023-09-30T22:26:15.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.870+0000 7fd0e2123700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc09ab20 con 0x7fd0dc133e00 2023-09-30T22:26:15.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.870+0000 7fd0e2123700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc09f0d0 con 0x7fd0dc09df40 2023-09-30T22:26:15.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.870+0000 7fd0dbfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd0dc09df40 0x7fd0dc13bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:15.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.870+0000 7fd0db7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0dc133e00 0x7fd0dc1341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:15.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.871+0000 7fd0dbfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd0dc09df40 0x7fd0dc13bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52908/0 (socket says 172.21.15.40:52908) 2023-09-30T22:26:15.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.871+0000 7fd0db7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0dc133e00 0x7fd0dc1341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48782/0 (socket says 172.21.15.40:48782) 2023-09-30T22:26:15.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.871+0000 7fd0dbfff700 1 -- 172.21.15.40:0/756046140 learned_addr learned my addr 172.21.15.40:0/756046140 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:15.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.871+0000 7fd0dbfff700 1 -- 172.21.15.40:0/756046140 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0dc133e00 msgr2=0x7fd0dc1341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:15.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.871+0000 7fd0dbfff700 1 --2- 172.21.15.40:0/756046140 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0dc133e00 0x7fd0dc1341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:15.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.871+0000 7fd0dbfff700 1 -- 172.21.15.40:0/756046140 >> v1:172.21.15.40:6789/0 conn(0x7fd0dc09d400 legacy=0x7fd0dc09d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:15.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.871+0000 7fd0da7fc700 1 -- 172.21.15.40:0/756046140 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3997444153 0 0) 0x7fd0dc133940 con 0x7fd0dc09d400 2023-09-30T22:26:15.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.871+0000 7fd0dbfff700 1 -- 172.21.15.40:0/756046140 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0dc133be0 con 0x7fd0dc09df40 2023-09-30T22:26:15.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.871+0000 7fd0dbfff700 1 --2- 172.21.15.40:0/756046140 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd0dc09df40 0x7fd0dc13bc80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4009e80 tx=0x7fd0d400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f32011b5b058ca7c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:15.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.871+0000 7fd0da7fc700 1 -- 172.21.15.40:0/756046140 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d400e070 con 0x7fd0dc09df40 2023-09-30T22:26:15.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.871+0000 7fd0da7fc700 1 -- 172.21.15.40:0/756046140 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d400b910 con 0x7fd0dc09df40 2023-09-30T22:26:15.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.871+0000 7fd0da7fc700 1 -- 172.21.15.40:0/756046140 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d400bcc0 con 0x7fd0dc09df40 2023-09-30T22:26:15.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.872+0000 7fd0e2123700 1 -- 172.21.15.40:0/756046140 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd0dc09df40 msgr2=0x7fd0dc13bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:15.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.872+0000 7fd0e2123700 1 --2- 172.21.15.40:0/756046140 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd0dc09df40 0x7fd0dc13bc80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4009e80 tx=0x7fd0d400b330 comp rx=0 tx=0).stop 2023-09-30T22:26:15.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.872+0000 7fd0e2123700 1 -- 172.21.15.40:0/756046140 shutdown_connections 2023-09-30T22:26:15.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.872+0000 7fd0e2123700 1 --2- 172.21.15.40:0/756046140 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd0dc09df40 0x7fd0dc13bc80 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:15.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.872+0000 7fd0e2123700 1 --2- 172.21.15.40:0/756046140 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0dc133e00 0x7fd0dc1341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:15.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.872+0000 7fd0e2123700 1 -- 172.21.15.40:0/756046140 >> 172.21.15.40:0/756046140 conn(0x7fd0dc0a2a00 msgr2=0x7fd0dc0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:15.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.872+0000 7fd0e2123700 1 -- 172.21.15.40:0/756046140 shutdown_connections 2023-09-30T22:26:15.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.872+0000 7fd0e2123700 1 -- 172.21.15.40:0/756046140 wait complete. 2023-09-30T22:26:15.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.873+0000 7fd0e2123700 1 Processor -- start 2023-09-30T22:26:15.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.874+0000 7fd0e2123700 1 -- start start 2023-09-30T22:26:15.880 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:15.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.874+0000 7fd0e2123700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0dc09d400 0x7fd0dc11aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:15.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.874+0000 7fd0e2123700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0dc09df40 0x7fd0dc11af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:15.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.874+0000 7fd0e2123700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd0dc133e00 0x7fd0dc11b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:15.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.874+0000 7fd0e2123700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc12dbb0 con 0x7fd0dc09df40 2023-09-30T22:26:15.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.874+0000 7fd0e2123700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc09fe00 con 0x7fd0dc09d400 2023-09-30T22:26:15.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.874+0000 7fd0e2123700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc11e4e0 con 0x7fd0dc133e00 2023-09-30T22:26:15.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.874+0000 7fd0dbfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd0dc133e00 0x7fd0dc11b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:15.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.874+0000 7fd0daffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0dc09df40 0x7fd0dc11af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:15.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.874+0000 7fd0dbfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd0dc133e00 0x7fd0dc11b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52918/0 (socket says 172.21.15.40:52918) 2023-09-30T22:26:15.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.874+0000 7fd0dbfff700 1 -- 172.21.15.40:0/3597849583 learned_addr learned my addr 172.21.15.40:0/3597849583 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:15.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.874+0000 7fd0db7fe700 1 --2- 172.21.15.40:0/3597849583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0dc09d400 0x7fd0dc11aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:15.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.875+0000 7fd0daffd700 1 -- 172.21.15.40:0/3597849583 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd0dc133e00 msgr2=0x7fd0dc11b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:15.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.875+0000 7fd0daffd700 1 --2- 172.21.15.40:0/3597849583 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd0dc133e00 0x7fd0dc11b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:15.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.875+0000 7fd0daffd700 1 -- 172.21.15.40:0/3597849583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0dc09d400 msgr2=0x7fd0dc11aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:15.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.875+0000 7fd0daffd700 1 --2- 172.21.15.40:0/3597849583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0dc09d400 0x7fd0dc11aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:15.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.875+0000 7fd0daffd700 1 -- 172.21.15.40:0/3597849583 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d4009b30 con 0x7fd0dc09df40 2023-09-30T22:26:15.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.875+0000 7fd0db7fe700 1 --2- 172.21.15.40:0/3597849583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0dc09d400 0x7fd0dc11aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:15.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.875+0000 7fd0daffd700 1 --2- 172.21.15.40:0/3597849583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0dc09df40 0x7fd0dc11af70 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc067fd0 tx=0x7fd0d000c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:15.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.875+0000 7fd0c3fff700 1 -- 172.21.15.40:0/3597849583 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d00054e0 con 0x7fd0dc09df40 2023-09-30T22:26:15.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.875+0000 7fd0c3fff700 1 -- 172.21.15.40:0/3597849583 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d000ce10 con 0x7fd0dc09df40 2023-09-30T22:26:15.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.875+0000 7fd0e2123700 1 -- 172.21.15.40:0/3597849583 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0dc11d210 con 0x7fd0dc09df40 2023-09-30T22:26:15.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.875+0000 7fd0c3fff700 1 -- 172.21.15.40:0/3597849583 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d00038c0 con 0x7fd0dc09df40 2023-09-30T22:26:15.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.875+0000 7fd0e2123700 1 -- 172.21.15.40:0/3597849583 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0dc11c460 con 0x7fd0dc09df40 2023-09-30T22:26:15.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.876+0000 7fd0c3fff700 1 -- 172.21.15.40:0/3597849583 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd0d0003a20 con 0x7fd0dc09df40 2023-09-30T22:26:15.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.876+0000 7fd0c3fff700 1 -- 172.21.15.40:0/3597849583 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd0d003e9d0 con 0x7fd0dc09df40 2023-09-30T22:26:15.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.876+0000 7fd0e2123700 1 -- 172.21.15.40:0/3597849583 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0dc11e320 con 0x7fd0dc09df40 2023-09-30T22:26:15.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.881+0000 7fd0c3fff700 1 -- 172.21.15.40:0/3597849583 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd0dc11e320 con 0x7fd0dc09df40 2023-09-30T22:26:15.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.918+0000 7fb086865700 1 Processor -- start 2023-09-30T22:26:15.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.919+0000 7fb086865700 1 -- start start 2023-09-30T22:26:15.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.919+0000 7fb086865700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb08009e400 0x7fb080135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:15.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.919+0000 7fb086865700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb080136230 0x7fb080138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:15.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.919+0000 7fb086865700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb08009adf0 con 0x7fb08009d920 2023-09-30T22:26:15.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.919+0000 7fb086865700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb08009edf0 con 0x7fb08009e400 2023-09-30T22:26:15.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.919+0000 7fb086865700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb08009b660 con 0x7fb080136230 2023-09-30T22:26:15.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.919+0000 7fb07f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb08009e400 0x7fb080135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:15.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.920+0000 7fb07f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb08009e400 0x7fb080135cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43654/0 (socket says 172.21.15.40:43654) 2023-09-30T22:26:15.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.920+0000 7fb07f7fe700 1 -- 172.21.15.40:0/149434560 learned_addr learned my addr 172.21.15.40:0/149434560 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:15.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.920+0000 7fb084e02700 1 --2- 172.21.15.40:0/149434560 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb080136230 0x7fb080138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:15.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.920+0000 7fb07f7fe700 1 -- 172.21.15.40:0/149434560 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb080136230 msgr2=0x7fb080138610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:15.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.920+0000 7fb07f7fe700 1 --2- 172.21.15.40:0/149434560 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb080136230 0x7fb080138610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:15.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.920+0000 7fb07f7fe700 1 -- 172.21.15.40:0/149434560 >> v1:172.21.15.40:6789/0 conn(0x7fb08009d920 legacy=0x7fb08009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:15.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.920+0000 7fb07f7fe700 1 -- 172.21.15.40:0/149434560 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08009a6e0 con 0x7fb08009e400 2023-09-30T22:26:15.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.920+0000 7fb07f7fe700 1 --2- 172.21.15.40:0/149434560 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb08009e400 0x7fb080135cf0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb07400bb90 tx=0x7fb07400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e0ac9ee74742d61 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:15.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.920+0000 7fb07effd700 1 -- 172.21.15.40:0/149434560 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07400dc70 con 0x7fb08009e400 2023-09-30T22:26:15.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.920+0000 7fb07effd700 1 -- 172.21.15.40:0/149434560 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07400ddd0 con 0x7fb08009e400 2023-09-30T22:26:15.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.920+0000 7fb07effd700 1 -- 172.21.15.40:0/149434560 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074012990 con 0x7fb08009e400 2023-09-30T22:26:15.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.921+0000 7fb086865700 1 -- 172.21.15.40:0/149434560 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb08009e400 msgr2=0x7fb080135cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:15.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.921+0000 7fb086865700 1 --2- 172.21.15.40:0/149434560 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb08009e400 0x7fb080135cf0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb07400bb90 tx=0x7fb07400bea0 comp rx=0 tx=0).stop 2023-09-30T22:26:15.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.921+0000 7fb086865700 1 -- 172.21.15.40:0/149434560 shutdown_connections 2023-09-30T22:26:15.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.921+0000 7fb086865700 1 --2- 172.21.15.40:0/149434560 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb080136230 0x7fb080138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:15.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.921+0000 7fb086865700 1 --2- 172.21.15.40:0/149434560 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb08009e400 0x7fb080135cf0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:15.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.921+0000 7fb086865700 1 -- 172.21.15.40:0/149434560 >> 172.21.15.40:0/149434560 conn(0x7fb08009fb20 msgr2=0x7fb08009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:15.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.921+0000 7fb086865700 1 -- 172.21.15.40:0/149434560 shutdown_connections 2023-09-30T22:26:15.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.921+0000 7fb086865700 1 -- 172.21.15.40:0/149434560 wait complete. 2023-09-30T22:26:15.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.923+0000 7fb086865700 1 Processor -- start 2023-09-30T22:26:15.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.923+0000 7fb086865700 1 -- start start 2023-09-30T22:26:15.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.924+0000 7fb086865700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb08009d920 0x7fb08011e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:15.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.924+0000 7fb086865700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb08009e400 0x7fb08011ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:15.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.924+0000 7fb086865700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb080136230 0x7fb08011f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:15.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.924+0000 7fb086865700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb080121e40 con 0x7fb08009d920 2023-09-30T22:26:15.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.924+0000 7fb086865700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb080135ff0 con 0x7fb08009e400 2023-09-30T22:26:15.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.924+0000 7fb086865700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb08009cb00 con 0x7fb080136230 2023-09-30T22:26:15.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.924+0000 7fb07f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb08009e400 0x7fb08011ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:15.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.924+0000 7fb07f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb08009e400 0x7fb08011ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48812/0 (socket says 172.21.15.40:48812) 2023-09-30T22:26:15.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.924+0000 7fb07f7fe700 1 -- 172.21.15.40:0/863520184 learned_addr learned my addr 172.21.15.40:0/863520184 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:15.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.924+0000 7fb07ffff700 1 --2- 172.21.15.40:0/863520184 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb08009d920 0x7fb08011e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:15.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.924+0000 7fb07f7fe700 1 -- 172.21.15.40:0/863520184 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb080136230 msgr2=0x7fb08011f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:15.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.924+0000 7fb07f7fe700 1 --2- 172.21.15.40:0/863520184 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb080136230 0x7fb08011f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:15.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.924+0000 7fb07f7fe700 1 -- 172.21.15.40:0/863520184 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb08009d920 msgr2=0x7fb08011e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:15.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.924+0000 7fb07f7fe700 1 --2- 172.21.15.40:0/863520184 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb08009d920 0x7fb08011e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:15.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.924+0000 7fb07f7fe700 1 -- 172.21.15.40:0/863520184 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07400b7f0 con 0x7fb08009e400 2023-09-30T22:26:15.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.924+0000 7fb07ffff700 1 --2- 172.21.15.40:0/863520184 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb08009d920 0x7fb08011e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:15.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.924+0000 7fb07f7fe700 1 --2- 172.21.15.40:0/863520184 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb08009e400 0x7fb08011ee00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb074000c00 tx=0x7fb074004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:15.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.924+0000 7fb07cff9700 1 -- 172.21.15.40:0/863520184 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074020070 con 0x7fb08009e400 2023-09-30T22:26:15.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.925+0000 7fb07cff9700 1 -- 172.21.15.40:0/863520184 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb074012770 con 0x7fb08009e400 2023-09-30T22:26:15.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.925+0000 7fb086865700 1 -- 172.21.15.40:0/863520184 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb080121a90 con 0x7fb08009e400 2023-09-30T22:26:15.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.925+0000 7fb07cff9700 1 -- 172.21.15.40:0/863520184 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074012b20 con 0x7fb08009e400 2023-09-30T22:26:15.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.925+0000 7fb086865700 1 -- 172.21.15.40:0/863520184 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb080120be0 con 0x7fb08009e400 2023-09-30T22:26:15.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.926+0000 7fb086865700 1 -- 172.21.15.40:0/863520184 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb080121c80 con 0x7fb08009e400 2023-09-30T22:26:15.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.926+0000 7fb07cff9700 1 -- 172.21.15.40:0/863520184 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb074024070 con 0x7fb08009e400 2023-09-30T22:26:15.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.926+0000 7fb07cff9700 1 -- 172.21.15.40:0/863520184 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb074044650 con 0x7fb08009e400 2023-09-30T22:26:15.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:15.931+0000 7fb07cff9700 1 -- 172.21.15.40:0/863520184 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb07401b400 con 0x7fb08009e400 2023-09-30T22:26:16.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:16.044+0000 7fb923b4d700 1 -- 172.21.15.40:0/472556426 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb91c09abb0 con 0x7fb91c138250 2023-09-30T22:26:16.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:16.045+0000 7fb9127fc700 1 -- 172.21.15.40:0/472556426 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb918017030 con 0x7fb91c138250 2023-09-30T22:26:16.045 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:16.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:16.047+0000 7fb923b4d700 1 -- 172.21.15.40:0/472556426 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb91c138250 msgr2=0x7fb91c13f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:16.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:16.047+0000 7fb923b4d700 1 --2- 172.21.15.40:0/472556426 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb91c138250 0x7fb91c13f850 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb91800c4e0 tx=0x7fb91800c8a0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:16.047+0000 7fb923b4d700 1 -- 172.21.15.40:0/472556426 shutdown_connections 2023-09-30T22:26:16.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:16.047+0000 7fb923b4d700 1 --2- 172.21.15.40:0/472556426 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb91c13da50 0x7fb91c1402d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:16.047+0000 7fb923b4d700 1 --2- 172.21.15.40:0/472556426 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb91c138250 0x7fb91c13f850 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:16.047+0000 7fb923b4d700 1 --2- 172.21.15.40:0/472556426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb91c13b130 0x7fb91c13fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:16.047+0000 7fb923b4d700 1 -- 172.21.15.40:0/472556426 >> 172.21.15.40:0/472556426 conn(0x7fb91c0a2a00 msgr2=0x7fb91c137610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:16.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:16.048+0000 7fb923b4d700 1 -- 172.21.15.40:0/472556426 shutdown_connections 2023-09-30T22:26:16.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:16.048+0000 7fb923b4d700 1 -- 172.21.15.40:0/472556426 wait complete. 2023-09-30T22:26:16.060 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:16.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:16.080+0000 7fd0e2123700 1 -- 172.21.15.40:0/3597849583 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd0dc11e320 con 0x7fd0dc09df40 2023-09-30T22:26:16.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:16.080+0000 7fd0c3fff700 1 -- 172.21.15.40:0/3597849583 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd0dc11e320 con 0x7fd0dc09df40 2023-09-30T22:26:16.081 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:16.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:16.082+0000 7fd0e2123700 1 -- 172.21.15.40:0/3597849583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0dc09df40 msgr2=0x7fd0dc11af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:16.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:16.082+0000 7fd0e2123700 1 --2- 172.21.15.40:0/3597849583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0dc09df40 0x7fd0dc11af70 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc067fd0 tx=0x7fd0d000c710 comp rx=0 tx=0).stop 2023-09-30T22:26:16.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:16.082+0000 7fd0e2123700 1 -- 172.21.15.40:0/3597849583 shutdown_connections 2023-09-30T22:26:16.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:16.082+0000 7fd0e2123700 1 --2- 172.21.15.40:0/3597849583 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd0dc133e00 0x7fd0dc11b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:16.082+0000 7fd0e2123700 1 --2- 172.21.15.40:0/3597849583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0dc09d400 0x7fd0dc11aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:16.082+0000 7fd0e2123700 1 --2- 172.21.15.40:0/3597849583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0dc09df40 0x7fd0dc11af70 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:16.082+0000 7fd0e2123700 1 -- 172.21.15.40:0/3597849583 >> 172.21.15.40:0/3597849583 conn(0x7fd0dc0a2a00 msgr2=0x7fd0dc1bb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:16.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:16.083+0000 7fd0e2123700 1 -- 172.21.15.40:0/3597849583 shutdown_connections 2023-09-30T22:26:16.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:16.083+0000 7fd0e2123700 1 -- 172.21.15.40:0/3597849583 wait complete. 2023-09-30T22:26:16.095 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:16.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:16.126+0000 7fb086865700 1 -- 172.21.15.40:0/863520184 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb080062380 con 0x7fb08009e400 2023-09-30T22:26:16.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:16.127+0000 7fb07cff9700 1 -- 172.21.15.40:0/863520184 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb07402b020 con 0x7fb08009e400 2023-09-30T22:26:16.127 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:16.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:16.129+0000 7fb086865700 1 -- 172.21.15.40:0/863520184 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb08009e400 msgr2=0x7fb08011ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:16.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:16.129+0000 7fb086865700 1 --2- 172.21.15.40:0/863520184 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb08009e400 0x7fb08011ee00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb074000c00 tx=0x7fb074004750 comp rx=0 tx=0).stop 2023-09-30T22:26:16.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:16.129+0000 7fb086865700 1 -- 172.21.15.40:0/863520184 shutdown_connections 2023-09-30T22:26:16.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:16.129+0000 7fb086865700 1 --2- 172.21.15.40:0/863520184 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb080136230 0x7fb08011f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:16.129+0000 7fb086865700 1 --2- 172.21.15.40:0/863520184 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb08009d920 0x7fb08011e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:16.129+0000 7fb086865700 1 --2- 172.21.15.40:0/863520184 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb08009e400 0x7fb08011ee00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:16.129+0000 7fb086865700 1 -- 172.21.15.40:0/863520184 >> 172.21.15.40:0/863520184 conn(0x7fb08009fb20 msgr2=0x7fb0800a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:16.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:16.129+0000 7fb086865700 1 -- 172.21.15.40:0/863520184 shutdown_connections 2023-09-30T22:26:16.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:16.129+0000 7fb086865700 1 -- 172.21.15.40:0/863520184 wait complete. 2023-09-30T22:26:16.141 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:16.881 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:17.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.020+0000 7f5c397ed700 1 Processor -- start 2023-09-30T22:26:17.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.021+0000 7f5c397ed700 1 -- start start 2023-09-30T22:26:17.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.021+0000 7f5c397ed700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c3409d920 0x7f5c3409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.021+0000 7f5c397ed700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c34130fb0 0x7f5c34138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.021+0000 7f5c397ed700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c3409adf0 con 0x7f5c3409e230 2023-09-30T22:26:17.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.021+0000 7f5c397ed700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3409edf0 con 0x7f5c3409d920 2023-09-30T22:26:17.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.021+0000 7f5c397ed700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3409b660 con 0x7f5c34130fb0 2023-09-30T22:26:17.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.021+0000 7f5c337fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c34130fb0 0x7f5c34138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.022+0000 7f5c327fc700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5c3409e230 0x7f5c341308a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40084/0 (socket says 172.21.15.40:40084) 2023-09-30T22:26:17.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.022+0000 7f5c32ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c3409d920 0x7f5c3409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.022+0000 7f5c327fc700 1 -- 172.21.15.40:0/635025840 learned_addr learned my addr 172.21.15.40:0/635025840 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:17.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.022+0000 7f5c32ffd700 1 -- 172.21.15.40:0/635025840 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c34130fb0 msgr2=0x7f5c34138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:17.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.022+0000 7f5c32ffd700 1 --2- 172.21.15.40:0/635025840 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c34130fb0 0x7f5c34138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.022+0000 7f5c32ffd700 1 -- 172.21.15.40:0/635025840 >> v1:172.21.15.40:6789/0 conn(0x7f5c3409e230 legacy=0x7f5c341308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.022+0000 7f5c31ffb700 1 -- 172.21.15.40:0/635025840 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1878545525 0 0) 0x7f5c3409adf0 con 0x7f5c3409e230 2023-09-30T22:26:17.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.022+0000 7f5c32ffd700 1 -- 172.21.15.40:0/635025840 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c3409a6e0 con 0x7f5c3409d920 2023-09-30T22:26:17.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.022+0000 7f5c337fe700 1 --2- 172.21.15.40:0/635025840 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c34130fb0 0x7f5c34138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:17.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.022+0000 7f5c32ffd700 1 --2- 172.21.15.40:0/635025840 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c3409d920 0x7f5c3409dcf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5c24009850 tx=0x7f5c24009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84cfabffa90dca21 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:17.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.022+0000 7f5c31ffb700 1 -- 172.21.15.40:0/635025840 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c24005e30 con 0x7f5c3409d920 2023-09-30T22:26:17.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.022+0000 7f5c31ffb700 1 -- 172.21.15.40:0/635025840 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c24006030 con 0x7f5c3409d920 2023-09-30T22:26:17.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.022+0000 7f5c31ffb700 1 -- 172.21.15.40:0/635025840 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c240063e0 con 0x7f5c3409d920 2023-09-30T22:26:17.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.023+0000 7f5c397ed700 1 -- 172.21.15.40:0/635025840 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c3409d920 msgr2=0x7f5c3409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.023+0000 7f5c397ed700 1 --2- 172.21.15.40:0/635025840 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c3409d920 0x7f5c3409dcf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5c24009850 tx=0x7f5c24009b60 comp rx=0 tx=0).stop 2023-09-30T22:26:17.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.023+0000 7f5c397ed700 1 -- 172.21.15.40:0/635025840 shutdown_connections 2023-09-30T22:26:17.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.023+0000 7f5c397ed700 1 --2- 172.21.15.40:0/635025840 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c34130fb0 0x7f5c34138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.023+0000 7f5c397ed700 1 --2- 172.21.15.40:0/635025840 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c3409d920 0x7f5c3409dcf0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.023+0000 7f5c397ed700 1 -- 172.21.15.40:0/635025840 >> 172.21.15.40:0/635025840 conn(0x7f5c3409fb20 msgr2=0x7f5c3409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:17.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.023+0000 7f5c397ed700 1 -- 172.21.15.40:0/635025840 shutdown_connections 2023-09-30T22:26:17.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.023+0000 7f5c397ed700 1 -- 172.21.15.40:0/635025840 wait complete. 2023-09-30T22:26:17.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.024+0000 7f5c397ed700 1 Processor -- start 2023-09-30T22:26:17.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.024+0000 7f5c397ed700 1 -- start start 2023-09-30T22:26:17.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.024+0000 7f5c397ed700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c3409d920 0x7f5c341c0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.024+0000 7f5c397ed700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c3409e230 0x7f5c341c1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.024+0000 7f5c397ed700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c34130fb0 0x7f5c341c3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.024+0000 7f5c397ed700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3411e460 con 0x7f5c3409e230 2023-09-30T22:26:17.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.024+0000 7f5c397ed700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c34120a80 con 0x7f5c3409d920 2023-09-30T22:26:17.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.024+0000 7f5c397ed700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c341c1940 con 0x7f5c34130fb0 2023-09-30T22:26:17.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.025+0000 7f5c327fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c3409e230 0x7f5c341c1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.025+0000 7f5c337fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c34130fb0 0x7f5c341c3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.025+0000 7f5c337fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c34130fb0 0x7f5c341c3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52964/0 (socket says 172.21.15.40:52964) 2023-09-30T22:26:17.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.025+0000 7f5c337fe700 1 -- 172.21.15.40:0/3987656181 learned_addr learned my addr 172.21.15.40:0/3987656181 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:17.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.025+0000 7f5c32ffd700 1 --2- 172.21.15.40:0/3987656181 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c3409d920 0x7f5c341c0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.025+0000 7f5c337fe700 1 -- 172.21.15.40:0/3987656181 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c3409d920 msgr2=0x7f5c341c0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.025+0000 7f5c337fe700 1 --2- 172.21.15.40:0/3987656181 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c3409d920 0x7f5c341c0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.025+0000 7f5c337fe700 1 -- 172.21.15.40:0/3987656181 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c3409e230 msgr2=0x7f5c341c1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.025+0000 7f5c337fe700 1 --2- 172.21.15.40:0/3987656181 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c3409e230 0x7f5c341c1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.025+0000 7f5c337fe700 1 -- 172.21.15.40:0/3987656181 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c2c00bc80 con 0x7f5c34130fb0 2023-09-30T22:26:17.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.025+0000 7f5c327fc700 1 --2- 172.21.15.40:0/3987656181 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c3409e230 0x7f5c341c1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:17.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.025+0000 7f5c337fe700 1 --2- 172.21.15.40:0/3987656181 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c34130fb0 0x7f5c341c3ee0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c00e160 tx=0x7f5c2c00e470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:17.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.025+0000 7f5c1b7fe700 1 -- 172.21.15.40:0/3987656181 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c019070 con 0x7f5c34130fb0 2023-09-30T22:26:17.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.025+0000 7f5c1b7fe700 1 -- 172.21.15.40:0/3987656181 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2c011040 con 0x7f5c34130fb0 2023-09-30T22:26:17.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.025+0000 7f5c397ed700 1 -- 172.21.15.40:0/3987656181 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c24009430 con 0x7f5c34130fb0 2023-09-30T22:26:17.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.025+0000 7f5c1b7fe700 1 -- 172.21.15.40:0/3987656181 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c010050 con 0x7f5c34130fb0 2023-09-30T22:26:17.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.025+0000 7f5c397ed700 1 -- 172.21.15.40:0/3987656181 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c3411fdc0 con 0x7f5c34130fb0 2023-09-30T22:26:17.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.026+0000 7f5c1b7fe700 1 -- 172.21.15.40:0/3987656181 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5c2c00ea70 con 0x7f5c34130fb0 2023-09-30T22:26:17.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.026+0000 7f5c1b7fe700 1 -- 172.21.15.40:0/3987656181 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5c2c0415c0 con 0x7f5c34130fb0 2023-09-30T22:26:17.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.026+0000 7f5c397ed700 1 -- 172.21.15.40:0/3987656181 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c34120440 con 0x7f5c34130fb0 2023-09-30T22:26:17.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.031+0000 7f5c1b7fe700 1 -- 172.21.15.40:0/3987656181 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5c2c01e410 con 0x7f5c34130fb0 2023-09-30T22:26:17.061 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:17.096 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:17.143 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:17.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.204+0000 7efe91f9b700 1 Processor -- start 2023-09-30T22:26:17.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.204+0000 7efe91f9b700 1 -- start start 2023-09-30T22:26:17.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.204+0000 7efe91f9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efe8c133e00 0x7efe8c1341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.204+0000 7efe91f9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe8c09d400 0x7efe8c09d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.204+0000 7efe91f9b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe8c133940 con 0x7efe8c09dd70 2023-09-30T22:26:17.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.204+0000 7efe91f9b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe8c09f0d0 con 0x7efe8c133e00 2023-09-30T22:26:17.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.205+0000 7efe91f9b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c133be0 con 0x7efe8c09d400 2023-09-30T22:26:17.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.205+0000 7efe8b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efe8c133e00 0x7efe8c1341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.205+0000 7efe8b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efe8c133e00 0x7efe8c1341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43676/0 (socket says 172.21.15.40:43676) 2023-09-30T22:26:17.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.205+0000 7efe8b7fe700 1 -- 172.21.15.40:0/1707372640 learned_addr learned my addr 172.21.15.40:0/1707372640 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:17.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.205+0000 7efe8affd700 1 --2- 172.21.15.40:0/1707372640 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe8c09d400 0x7efe8c09d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.205+0000 7efe8b7fe700 1 -- 172.21.15.40:0/1707372640 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe8c09d400 msgr2=0x7efe8c09d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:17.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.205+0000 7efe8b7fe700 1 --2- 172.21.15.40:0/1707372640 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe8c09d400 0x7efe8c09d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.206+0000 7efe8b7fe700 1 -- 172.21.15.40:0/1707372640 >> v1:172.21.15.40:6789/0 conn(0x7efe8c09dd70 legacy=0x7efe8c13ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.206+0000 7efe8b7fe700 1 -- 172.21.15.40:0/1707372640 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8c09a860 con 0x7efe8c133e00 2023-09-30T22:26:17.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.206+0000 7efe8affd700 1 --2- 172.21.15.40:0/1707372640 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe8c09d400 0x7efe8c09d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:17.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.206+0000 7efe8b7fe700 1 --2- 172.21.15.40:0/1707372640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe8c133e00 0x7efe8c1341d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efe7c0098f0 tx=0x7efe7c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5fdcdecfbc09560 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:17.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.206+0000 7efe8a7fc700 1 -- 172.21.15.40:0/1707372640 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c00b8a0 con 0x7efe8c133e00 2023-09-30T22:26:17.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.206+0000 7efe8a7fc700 1 -- 172.21.15.40:0/1707372640 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7c00ba00 con 0x7efe8c133e00 2023-09-30T22:26:17.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.206+0000 7efe8a7fc700 1 -- 172.21.15.40:0/1707372640 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c00bd90 con 0x7efe8c133e00 2023-09-30T22:26:17.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.207+0000 7efe91f9b700 1 -- 172.21.15.40:0/1707372640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe8c133e00 msgr2=0x7efe8c1341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.207+0000 7efe91f9b700 1 --2- 172.21.15.40:0/1707372640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe8c133e00 0x7efe8c1341d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efe7c0098f0 tx=0x7efe7c009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:17.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.207+0000 7efe91f9b700 1 -- 172.21.15.40:0/1707372640 shutdown_connections 2023-09-30T22:26:17.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.207+0000 7efe91f9b700 1 --2- 172.21.15.40:0/1707372640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe8c133e00 0x7efe8c1341d0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.207+0000 7efe91f9b700 1 --2- 172.21.15.40:0/1707372640 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe8c09d400 0x7efe8c09d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.207+0000 7efe91f9b700 1 -- 172.21.15.40:0/1707372640 >> 172.21.15.40:0/1707372640 conn(0x7efe8c0a2a00 msgr2=0x7efe8c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:17.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.207+0000 7efe91f9b700 1 -- 172.21.15.40:0/1707372640 shutdown_connections 2023-09-30T22:26:17.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.207+0000 7efe91f9b700 1 -- 172.21.15.40:0/1707372640 wait complete. 2023-09-30T22:26:17.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.208+0000 7efe91f9b700 1 Processor -- start 2023-09-30T22:26:17.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.208+0000 7efe91f9b700 1 -- start start 2023-09-30T22:26:17.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.209+0000 7efe91f9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe8c09d400 0x7efe8c11a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.209+0000 7efe91f9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efe8c09dd70 0x7efe8c11ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.209+0000 7efe91f9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe8c133e00 0x7efe8c11b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.209+0000 7efe91f9b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c11de20 con 0x7efe8c133e00 2023-09-30T22:26:17.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.209+0000 7efe91f9b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c11c630 con 0x7efe8c09d400 2023-09-30T22:26:17.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.209+0000 7efe91f9b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c0a0000 con 0x7efe8c09dd70 2023-09-30T22:26:17.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.209+0000 7efe8b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe8c09d400 0x7efe8c11a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.209+0000 7efe8b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe8c09d400 0x7efe8c11a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48840/0 (socket says 172.21.15.40:48840) 2023-09-30T22:26:17.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.209+0000 7efe8b7fe700 1 -- 172.21.15.40:0/3145950214 learned_addr learned my addr 172.21.15.40:0/3145950214 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:17.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.209+0000 7efe8affd700 1 --2- 172.21.15.40:0/3145950214 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efe8c09dd70 0x7efe8c11ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.209+0000 7efe8bfff700 1 --2- 172.21.15.40:0/3145950214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe8c133e00 0x7efe8c11b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.210+0000 7efe8b7fe700 1 -- 172.21.15.40:0/3145950214 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efe8c09dd70 msgr2=0x7efe8c11ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.210+0000 7efe8b7fe700 1 --2- 172.21.15.40:0/3145950214 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efe8c09dd70 0x7efe8c11ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.210+0000 7efe8b7fe700 1 -- 172.21.15.40:0/3145950214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe8c133e00 msgr2=0x7efe8c11b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.210+0000 7efe8b7fe700 1 --2- 172.21.15.40:0/3145950214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe8c133e00 0x7efe8c11b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.210+0000 7efe8b7fe700 1 -- 172.21.15.40:0/3145950214 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe7c009550 con 0x7efe8c09d400 2023-09-30T22:26:17.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.210+0000 7efe8bfff700 1 --2- 172.21.15.40:0/3145950214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe8c133e00 0x7efe8c11b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:17.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.210+0000 7efe8b7fe700 1 --2- 172.21.15.40:0/3145950214 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe8c09d400 0x7efe8c11a930 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efe7c000c00 tx=0x7efe7c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:17.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.210+0000 7efe73fff700 1 -- 172.21.15.40:0/3145950214 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c004380 con 0x7efe8c09d400 2023-09-30T22:26:17.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.210+0000 7efe73fff700 1 -- 172.21.15.40:0/3145950214 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7c01f070 con 0x7efe8c09d400 2023-09-30T22:26:17.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.210+0000 7efe91f9b700 1 -- 172.21.15.40:0/3145950214 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe8c11e3c0 con 0x7efe8c09d400 2023-09-30T22:26:17.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.210+0000 7efe73fff700 1 -- 172.21.15.40:0/3145950214 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c0036a0 con 0x7efe8c09d400 2023-09-30T22:26:17.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.210+0000 7efe91f9b700 1 -- 172.21.15.40:0/3145950214 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe8c12e1f0 con 0x7efe8c09d400 2023-09-30T22:26:17.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.211+0000 7efe73fff700 1 -- 172.21.15.40:0/3145950214 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efe7c021030 con 0x7efe8c09d400 2023-09-30T22:26:17.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.211+0000 7efe73fff700 1 -- 172.21.15.40:0/3145950214 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7efe7c040ab0 con 0x7efe8c09d400 2023-09-30T22:26:17.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.212+0000 7efe91f9b700 1 -- 172.21.15.40:0/3145950214 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe8c11db50 con 0x7efe8c09d400 2023-09-30T22:26:17.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.216+0000 7efe73fff700 1 -- 172.21.15.40:0/3145950214 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efe7c023990 con 0x7efe8c09d400 2023-09-30T22:26:17.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.238+0000 7fd1c3d44700 1 Processor -- start 2023-09-30T22:26:17.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.238+0000 7fd1c3d44700 1 -- start start 2023-09-30T22:26:17.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.239+0000 7fd1c3d44700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd1bc09c890 0x7fd1bc09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.239+0000 7fd1c3d44700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd1bc09e480 0x7fd1bc13bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.239+0000 7fd1c3d44700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1bc0a2600 con 0x7fd1bc09d920 2023-09-30T22:26:17.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.239+0000 7fd1c3d44700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1bc0a29d0 con 0x7fd1bc09e480 2023-09-30T22:26:17.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.239+0000 7fd1c3d44700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc09fb40 con 0x7fd1bc09c890 2023-09-30T22:26:17.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.239+0000 7fd1c22e1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd1bc09e480 0x7fd1bc13bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.239+0000 7fd1c22e1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd1bc09e480 0x7fd1bc13bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43702/0 (socket says 172.21.15.40:43702) 2023-09-30T22:26:17.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.239+0000 7fd1c22e1700 1 -- 172.21.15.40:0/1675078191 learned_addr learned my addr 172.21.15.40:0/1675078191 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:17.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.239+0000 7fd1c1ae0700 1 --2- 172.21.15.40:0/1675078191 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd1bc09c890 0x7fd1bc09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.239+0000 7fd1c22e1700 1 -- 172.21.15.40:0/1675078191 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd1bc09c890 msgr2=0x7fd1bc09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:17.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.239+0000 7fd1c22e1700 1 --2- 172.21.15.40:0/1675078191 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd1bc09c890 0x7fd1bc09cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.239+0000 7fd1c22e1700 1 -- 172.21.15.40:0/1675078191 >> v1:172.21.15.40:6789/0 conn(0x7fd1bc09d920 legacy=0x7fd1bc09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.239+0000 7fd1c22e1700 1 -- 172.21.15.40:0/1675078191 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1bc09fed0 con 0x7fd1bc09e480 2023-09-30T22:26:17.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.240+0000 7fd1c22e1700 1 --2- 172.21.15.40:0/1675078191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1bc09e480 0x7fd1bc13bc20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4009e50 tx=0x7fd1b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7c0ffa0e09d17cf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:17.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.240+0000 7fd1c0ade700 1 -- 172.21.15.40:0/1675078191 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b400e070 con 0x7fd1bc09e480 2023-09-30T22:26:17.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.240+0000 7fd1c0ade700 1 -- 172.21.15.40:0/1675078191 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b400b910 con 0x7fd1bc09e480 2023-09-30T22:26:17.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.240+0000 7fd1c0ade700 1 -- 172.21.15.40:0/1675078191 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b400bcc0 con 0x7fd1bc09e480 2023-09-30T22:26:17.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.240+0000 7fd1c3d44700 1 -- 172.21.15.40:0/1675078191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1bc09e480 msgr2=0x7fd1bc13bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.240+0000 7fd1c3d44700 1 --2- 172.21.15.40:0/1675078191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1bc09e480 0x7fd1bc13bc20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4009e50 tx=0x7fd1b400b330 comp rx=0 tx=0).stop 2023-09-30T22:26:17.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.240+0000 7fd1c3d44700 1 -- 172.21.15.40:0/1675078191 shutdown_connections 2023-09-30T22:26:17.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.240+0000 7fd1c3d44700 1 --2- 172.21.15.40:0/1675078191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1bc09e480 0x7fd1bc13bc20 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.240+0000 7fd1c3d44700 1 --2- 172.21.15.40:0/1675078191 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd1bc09c890 0x7fd1bc09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.240+0000 7fd1c3d44700 1 -- 172.21.15.40:0/1675078191 >> 172.21.15.40:0/1675078191 conn(0x7fd1bc0a7080 msgr2=0x7fd1bc0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:17.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.241+0000 7fd1c3d44700 1 -- 172.21.15.40:0/1675078191 shutdown_connections 2023-09-30T22:26:17.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.241+0000 7fd1c3d44700 1 -- 172.21.15.40:0/1675078191 wait complete. 2023-09-30T22:26:17.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.241+0000 7fd1c3d44700 1 Processor -- start 2023-09-30T22:26:17.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.242+0000 7fd1c3d44700 1 -- start start 2023-09-30T22:26:17.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.242+0000 7fd1c3d44700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd1bc09c890 0x7fd1bc1c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.242+0000 7fd1c3d44700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1bc09d920 0x7fd1bc1c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.242+0000 7fd1c3d44700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1bc09e480 0x7fd1bc12d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.242+0000 7fd1c3d44700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc130da0 con 0x7fd1bc09e480 2023-09-30T22:26:17.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.242+0000 7fd1c3d44700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc09ecf0 con 0x7fd1bc09d920 2023-09-30T22:26:17.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.242+0000 7fd1c3d44700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc12f6f0 con 0x7fd1bc09c890 2023-09-30T22:26:17.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.242+0000 7fd1c1ae0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd1bc09c890 0x7fd1bc1c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.242+0000 7fd1c1ae0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd1bc09c890 0x7fd1bc1c8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52994/0 (socket says 172.21.15.40:52994) 2023-09-30T22:26:17.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.242+0000 7fd1c1ae0700 1 -- 172.21.15.40:0/1886239202 learned_addr learned my addr 172.21.15.40:0/1886239202 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:17.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.242+0000 7fd1c12df700 1 --2- 172.21.15.40:0/1886239202 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1bc09d920 0x7fd1bc1c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.243+0000 7fd1c22e1700 1 --2- 172.21.15.40:0/1886239202 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1bc09e480 0x7fd1bc12d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.243+0000 7fd1c1ae0700 1 -- 172.21.15.40:0/1886239202 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1bc09d920 msgr2=0x7fd1bc1c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.243+0000 7fd1c1ae0700 1 --2- 172.21.15.40:0/1886239202 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1bc09d920 0x7fd1bc1c9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.243+0000 7fd1c1ae0700 1 -- 172.21.15.40:0/1886239202 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1bc09e480 msgr2=0x7fd1bc12d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.243+0000 7fd1c1ae0700 1 --2- 172.21.15.40:0/1886239202 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1bc09e480 0x7fd1bc12d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.243+0000 7fd1c1ae0700 1 -- 172.21.15.40:0/1886239202 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b4009b30 con 0x7fd1bc09c890 2023-09-30T22:26:17.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.243+0000 7fd1c22e1700 1 --2- 172.21.15.40:0/1886239202 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1bc09e480 0x7fd1bc12d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:17.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.243+0000 7fd1c1ae0700 1 --2- 172.21.15.40:0/1886239202 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd1bc09c890 0x7fd1bc1c8bc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd1b800e900 tx=0x7fd1b800ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:17.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.243+0000 7fd1b27fc700 1 -- 172.21.15.40:0/1886239202 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b8009650 con 0x7fd1bc09c890 2023-09-30T22:26:17.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.243+0000 7fd1b27fc700 1 -- 172.21.15.40:0/1886239202 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b800ee50 con 0x7fd1bc09c890 2023-09-30T22:26:17.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.243+0000 7fd1c3d44700 1 -- 172.21.15.40:0/1886239202 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1bc0a5e60 con 0x7fd1bc09c890 2023-09-30T22:26:17.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.243+0000 7fd1b27fc700 1 -- 172.21.15.40:0/1886239202 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b800ca50 con 0x7fd1bc09c890 2023-09-30T22:26:17.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.243+0000 7fd1c3d44700 1 -- 172.21.15.40:0/1886239202 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1bc1312a0 con 0x7fd1bc09c890 2023-09-30T22:26:17.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.244+0000 7fd1b27fc700 1 -- 172.21.15.40:0/1886239202 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd1b800cbb0 con 0x7fd1bc09c890 2023-09-30T22:26:17.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.244+0000 7fd1b27fc700 1 -- 172.21.15.40:0/1886239202 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd1b803fbc0 con 0x7fd1bc09c890 2023-09-30T22:26:17.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.245+0000 7fd1c3d44700 1 -- 172.21.15.40:0/1886239202 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1bc1309e0 con 0x7fd1bc09c890 2023-09-30T22:26:17.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.250+0000 7fd1b27fc700 1 -- 172.21.15.40:0/1886239202 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd1b8021080 con 0x7fd1bc09c890 2023-09-30T22:26:17.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.280+0000 7f5c397ed700 1 -- 172.21.15.40:0/3987656181 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5c341206e0 con 0x7f5c34130fb0 2023-09-30T22:26:17.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.280+0000 7f5c1b7fe700 1 -- 172.21.15.40:0/3987656181 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5c2c02c090 con 0x7f5c34130fb0 2023-09-30T22:26:17.280 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:17.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.281+0000 7f9dc88ff700 1 Processor -- start 2023-09-30T22:26:17.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.282+0000 7f9dc88ff700 1 -- start start 2023-09-30T22:26:17.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.282+0000 7f9dc88ff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9dc4133e00 0x7f9dc41341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.282+0000 7f9dc88ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9dc409d400 0x7f9dc409d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.282+0000 7f9dc88ff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dc409dd70 0x7f9dc413ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.282+0000 7f9dc88ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dc409ab20 con 0x7f9dc409d400 2023-09-30T22:26:17.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.282+0000 7f9dc88ff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc4133940 con 0x7f9dc409dd70 2023-09-30T22:26:17.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.282+0000 7f9dc88ff700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc409f0d0 con 0x7f9dc4133e00 2023-09-30T22:26:17.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.282+0000 7f9dc259c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9dc4133e00 0x7f9dc41341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.282+0000 7f9dc259c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9dc4133e00 0x7f9dc41341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:53008/0 (socket says 172.21.15.40:53008) 2023-09-30T22:26:17.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.282+0000 7f9dc259c700 1 -- 172.21.15.40:0/2909944249 learned_addr learned my addr 172.21.15.40:0/2909944249 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:17.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.283+0000 7f9dc1d9b700 1 --2- 172.21.15.40:0/2909944249 >> v2:172.21.15.40:3300/0 conn(0x7f9dc409d400 0x7f9dc409d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.283+0000 7f9dc2d9d700 1 --2- 172.21.15.40:0/2909944249 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dc409dd70 0x7f9dc413ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.283+0000 7f5c397ed700 1 -- 172.21.15.40:0/3987656181 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c34130fb0 msgr2=0x7f5c341c3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.283+0000 7f5c397ed700 1 --2- 172.21.15.40:0/3987656181 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c34130fb0 0x7f5c341c3ee0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c00e160 tx=0x7f5c2c00e470 comp rx=0 tx=0).stop 2023-09-30T22:26:17.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.283+0000 7f5c397ed700 1 -- 172.21.15.40:0/3987656181 shutdown_connections 2023-09-30T22:26:17.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.283+0000 7f5c397ed700 1 --2- 172.21.15.40:0/3987656181 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c34130fb0 0x7f5c341c3ee0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.283+0000 7f5c397ed700 1 --2- 172.21.15.40:0/3987656181 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c3409d920 0x7f5c341c0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.283+0000 7f5c397ed700 1 --2- 172.21.15.40:0/3987656181 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c3409e230 0x7f5c341c1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.283+0000 7f5c397ed700 1 -- 172.21.15.40:0/3987656181 >> 172.21.15.40:0/3987656181 conn(0x7f5c3409fb20 msgr2=0x7f5c34130110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:17.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.283+0000 7f9dc259c700 1 -- 172.21.15.40:0/2909944249 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dc409dd70 msgr2=0x7f9dc413ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:17.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.283+0000 7f9dc259c700 1 --2- 172.21.15.40:0/2909944249 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dc409dd70 0x7f9dc413ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.283+0000 7f9dc259c700 1 -- 172.21.15.40:0/2909944249 >> v2:172.21.15.40:3300/0 conn(0x7f9dc409d400 msgr2=0x7f9dc409d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:17.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.283+0000 7f9dc259c700 1 --2- 172.21.15.40:0/2909944249 >> v2:172.21.15.40:3300/0 conn(0x7f9dc409d400 0x7f9dc409d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.283+0000 7f9dc259c700 1 -- 172.21.15.40:0/2909944249 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc409e210 con 0x7f9dc4133e00 2023-09-30T22:26:17.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.283+0000 7f9dc259c700 1 --2- 172.21.15.40:0/2909944249 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9dc4133e00 0x7f9dc41341d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9db40098f0 tx=0x7f9db4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=389a5e4adae0600a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:17.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.283+0000 7f9dc159a700 1 -- 172.21.15.40:0/2909944249 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db4011830 con 0x7f9dc4133e00 2023-09-30T22:26:17.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.283+0000 7f9dc159a700 1 -- 172.21.15.40:0/2909944249 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db4011990 con 0x7f9dc4133e00 2023-09-30T22:26:17.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.283+0000 7f9dc159a700 1 -- 172.21.15.40:0/2909944249 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db4011d20 con 0x7f9dc4133e00 2023-09-30T22:26:17.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.284+0000 7f5c397ed700 1 -- 172.21.15.40:0/3987656181 shutdown_connections 2023-09-30T22:26:17.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.284+0000 7f9dc88ff700 1 -- 172.21.15.40:0/2909944249 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9dc4133e00 msgr2=0x7f9dc41341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.284+0000 7f9dc88ff700 1 --2- 172.21.15.40:0/2909944249 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9dc4133e00 0x7f9dc41341d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9db40098f0 tx=0x7f9db4009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:17.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.284+0000 7f9dc88ff700 1 -- 172.21.15.40:0/2909944249 shutdown_connections 2023-09-30T22:26:17.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.284+0000 7f9dc88ff700 1 --2- 172.21.15.40:0/2909944249 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9dc4133e00 0x7f9dc41341d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.284+0000 7f9dc88ff700 1 --2- 172.21.15.40:0/2909944249 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dc409dd70 0x7f9dc413ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.284+0000 7f9dc88ff700 1 --2- 172.21.15.40:0/2909944249 >> v2:172.21.15.40:3300/0 conn(0x7f9dc409d400 0x7f9dc409d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.284+0000 7f9dc88ff700 1 -- 172.21.15.40:0/2909944249 >> 172.21.15.40:0/2909944249 conn(0x7f9dc40a2a00 msgr2=0x7f9dc40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:17.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.284+0000 7f9dc88ff700 1 -- 172.21.15.40:0/2909944249 shutdown_connections 2023-09-30T22:26:17.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.284+0000 7f9dc88ff700 1 -- 172.21.15.40:0/2909944249 wait complete. 2023-09-30T22:26:17.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.285+0000 7f9dc88ff700 1 Processor -- start 2023-09-30T22:26:17.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.285+0000 7f9dc88ff700 1 -- start start 2023-09-30T22:26:17.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.286+0000 7f9dc88ff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dc409d400 0x7f9dc40a1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.286+0000 7f9dc88ff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9dc409dd70 0x7f9dc40a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.286+0000 7f9dc88ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dc4133e00 0x7f9dc40a1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.286+0000 7f9dc88ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc41193e0 con 0x7f9dc4133e00 2023-09-30T22:26:17.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.286+0000 7f9dc88ff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc40a26b0 con 0x7f9dc409d400 2023-09-30T22:26:17.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.286+0000 7f9dc88ff700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc411ae50 con 0x7f9dc409dd70 2023-09-30T22:26:17.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.286+0000 7f9dc259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dc409d400 0x7f9dc40a1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.286+0000 7f9dc259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dc409d400 0x7f9dc40a1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48882/0 (socket says 172.21.15.40:48882) 2023-09-30T22:26:17.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.286+0000 7f9dc259c700 1 -- 172.21.15.40:0/1076209638 learned_addr learned my addr 172.21.15.40:0/1076209638 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:17.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.286+0000 7f9dc2d9d700 1 --2- 172.21.15.40:0/1076209638 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dc4133e00 0x7f9dc40a1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.286+0000 7f9dc1d9b700 1 --2- 172.21.15.40:0/1076209638 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9dc409dd70 0x7f9dc40a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.286+0000 7f9dc259c700 1 -- 172.21.15.40:0/1076209638 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9dc409dd70 msgr2=0x7f9dc40a1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.286+0000 7f9dc259c700 1 --2- 172.21.15.40:0/1076209638 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9dc409dd70 0x7f9dc40a1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.286+0000 7f9dc259c700 1 -- 172.21.15.40:0/1076209638 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dc4133e00 msgr2=0x7f9dc40a1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.286+0000 7f9dc259c700 1 --2- 172.21.15.40:0/1076209638 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dc4133e00 0x7f9dc40a1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.286+0000 7f9dc259c700 1 -- 172.21.15.40:0/1076209638 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db4009550 con 0x7f9dc409d400 2023-09-30T22:26:17.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.286+0000 7f9dc259c700 1 --2- 172.21.15.40:0/1076209638 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dc409d400 0x7f9dc40a1200 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9db4000c00 tx=0x7f9db4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:17.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.287+0000 7f9db2ffd700 1 -- 172.21.15.40:0/1076209638 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db4004450 con 0x7f9dc409d400 2023-09-30T22:26:17.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.287+0000 7f9db2ffd700 1 -- 172.21.15.40:0/1076209638 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db40045b0 con 0x7f9dc409d400 2023-09-30T22:26:17.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.287+0000 7f9dc88ff700 1 -- 172.21.15.40:0/1076209638 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dc411a1e0 con 0x7f9dc409d400 2023-09-30T22:26:17.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.287+0000 7f9db2ffd700 1 -- 172.21.15.40:0/1076209638 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db40038c0 con 0x7f9dc409d400 2023-09-30T22:26:17.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.287+0000 7f9dc88ff700 1 -- 172.21.15.40:0/1076209638 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dc412e1f0 con 0x7f9dc409d400 2023-09-30T22:26:17.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.287+0000 7f9db2ffd700 1 -- 172.21.15.40:0/1076209638 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9db4021070 con 0x7f9dc409d400 2023-09-30T22:26:17.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.288+0000 7f5c397ed700 1 -- 172.21.15.40:0/3987656181 wait complete. 2023-09-30T22:26:17.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.288+0000 7f9db2ffd700 1 -- 172.21.15.40:0/1076209638 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9db4040a80 con 0x7f9dc409d400 2023-09-30T22:26:17.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.288+0000 7f9dc88ff700 1 -- 172.21.15.40:0/1076209638 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dc411b1c0 con 0x7f9dc409d400 2023-09-30T22:26:17.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.293+0000 7f9db2ffd700 1 -- 172.21.15.40:0/1076209638 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9dc411b1c0 con 0x7f9dc409d400 2023-09-30T22:26:17.308 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:17.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.451+0000 7fd1c3d44700 1 -- 172.21.15.40:0/1886239202 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd1bc062380 con 0x7fd1bc09c890 2023-09-30T22:26:17.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.451+0000 7fd1b27fc700 1 -- 172.21.15.40:0/1886239202 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd1b8017020 con 0x7fd1bc09c890 2023-09-30T22:26:17.452 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:17.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.453+0000 7fd1c3d44700 1 -- 172.21.15.40:0/1886239202 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd1bc09c890 msgr2=0x7fd1bc1c8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.453+0000 7fd1c3d44700 1 --2- 172.21.15.40:0/1886239202 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd1bc09c890 0x7fd1bc1c8bc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd1b800e900 tx=0x7fd1b800ec10 comp rx=0 tx=0).stop 2023-09-30T22:26:17.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.453+0000 7fd1c3d44700 1 -- 172.21.15.40:0/1886239202 shutdown_connections 2023-09-30T22:26:17.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.453+0000 7fd1c3d44700 1 --2- 172.21.15.40:0/1886239202 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd1bc09c890 0x7fd1bc1c8bc0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.453+0000 7fd1c3d44700 1 --2- 172.21.15.40:0/1886239202 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1bc09e480 0x7fd1bc12d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.453+0000 7fd1c3d44700 1 --2- 172.21.15.40:0/1886239202 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1bc09d920 0x7fd1bc1c9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.453+0000 7fd1c3d44700 1 -- 172.21.15.40:0/1886239202 >> 172.21.15.40:0/1886239202 conn(0x7fd1bc0a7080 msgr2=0x7fd1bc0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:17.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.453+0000 7fd1c3d44700 1 -- 172.21.15.40:0/1886239202 shutdown_connections 2023-09-30T22:26:17.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.453+0000 7fd1c3d44700 1 -- 172.21.15.40:0/1886239202 wait complete. 2023-09-30T22:26:17.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.459+0000 7efe91f9b700 1 -- 172.21.15.40:0/3145950214 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efe8c11e200 con 0x7efe8c09d400 2023-09-30T22:26:17.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.459+0000 7efe73fff700 1 -- 172.21.15.40:0/3145950214 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efe7c01b430 con 0x7efe8c09d400 2023-09-30T22:26:17.459 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:17.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.461+0000 7efe91f9b700 1 -- 172.21.15.40:0/3145950214 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe8c09d400 msgr2=0x7efe8c11a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.461+0000 7efe91f9b700 1 --2- 172.21.15.40:0/3145950214 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe8c09d400 0x7efe8c11a930 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efe7c000c00 tx=0x7efe7c004750 comp rx=0 tx=0).stop 2023-09-30T22:26:17.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.464+0000 7efe91f9b700 1 -- 172.21.15.40:0/3145950214 shutdown_connections 2023-09-30T22:26:17.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.464+0000 7efe91f9b700 1 --2- 172.21.15.40:0/3145950214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe8c133e00 0x7efe8c11b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.464+0000 7efe91f9b700 1 --2- 172.21.15.40:0/3145950214 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe8c09d400 0x7efe8c11a930 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.464+0000 7efe91f9b700 1 --2- 172.21.15.40:0/3145950214 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efe8c09dd70 0x7efe8c11ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.464+0000 7efe91f9b700 1 -- 172.21.15.40:0/3145950214 >> 172.21.15.40:0/3145950214 conn(0x7efe8c0a2a00 msgr2=0x7efe8c132550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:17.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.464+0000 7efe91f9b700 1 -- 172.21.15.40:0/3145950214 shutdown_connections 2023-09-30T22:26:17.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.464+0000 7efe91f9b700 1 -- 172.21.15.40:0/3145950214 wait complete. 2023-09-30T22:26:17.467 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:17.477 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:17.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.492+0000 7f9dc88ff700 1 -- 172.21.15.40:0/1076209638 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9dc411b1c0 con 0x7f9dc409d400 2023-09-30T22:26:17.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.493+0000 7f9db2ffd700 1 -- 172.21.15.40:0/1076209638 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9dc411b1c0 con 0x7f9dc409d400 2023-09-30T22:26:17.493 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:17.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.495+0000 7f9dc88ff700 1 -- 172.21.15.40:0/1076209638 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dc409d400 msgr2=0x7f9dc40a1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.495+0000 7f9dc88ff700 1 --2- 172.21.15.40:0/1076209638 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dc409d400 0x7f9dc40a1200 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9db4000c00 tx=0x7f9db4004750 comp rx=0 tx=0).stop 2023-09-30T22:26:17.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.495+0000 7f9dc88ff700 1 -- 172.21.15.40:0/1076209638 shutdown_connections 2023-09-30T22:26:17.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.495+0000 7f9dc88ff700 1 --2- 172.21.15.40:0/1076209638 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dc4133e00 0x7f9dc40a1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.495+0000 7f9dc88ff700 1 --2- 172.21.15.40:0/1076209638 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dc409d400 0x7f9dc40a1200 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.495+0000 7f9dc88ff700 1 --2- 172.21.15.40:0/1076209638 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9dc409dd70 0x7f9dc40a1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.495+0000 7f9dc88ff700 1 -- 172.21.15.40:0/1076209638 >> 172.21.15.40:0/1076209638 conn(0x7f9dc40a2a00 msgr2=0x7f9dc412c660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:17.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.495+0000 7f9dc88ff700 1 -- 172.21.15.40:0/1076209638 shutdown_connections 2023-09-30T22:26:17.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:17.495+0000 7f9dc88ff700 1 -- 172.21.15.40:0/1076209638 wait complete. 2023-09-30T22:26:17.507 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:18.309 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:18.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.450+0000 7f05c66ff700 1 Processor -- start 2023-09-30T22:26:18.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.450+0000 7f05c66ff700 1 -- start start 2023-09-30T22:26:18.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.450+0000 7f05c66ff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05c009c890 0x7f05c009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.450+0000 7f05c66ff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05c009e480 0x7f05c013bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.450+0000 7f05c66ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c00a2600 con 0x7f05c009d920 2023-09-30T22:26:18.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.450+0000 7f05c66ff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c00a29d0 con 0x7f05c009e480 2023-09-30T22:26:18.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.450+0000 7f05c66ff700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05c009fb40 con 0x7f05c009c890 2023-09-30T22:26:18.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.450+0000 7f05bffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05c009c890 0x7f05c009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.450+0000 7f05c4c9c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05c009e480 0x7f05c013bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.450+0000 7f05bf7fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f05c009d920 0x7f05c009dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40112/0 (socket says 172.21.15.40:40112) 2023-09-30T22:26:18.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.450+0000 7f05bf7fe700 1 -- 172.21.15.40:0/203787342 learned_addr learned my addr 172.21.15.40:0/203787342 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:18.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.451+0000 7f05bffff700 1 -- 172.21.15.40:0/203787342 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05c009e480 msgr2=0x7f05c013bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:18.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.451+0000 7f05bffff700 1 --2- 172.21.15.40:0/203787342 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05c009e480 0x7f05c013bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.451+0000 7f05bffff700 1 -- 172.21.15.40:0/203787342 >> v1:172.21.15.40:6789/0 conn(0x7f05c009d920 legacy=0x7f05c009dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:18.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.451+0000 7f05bffff700 1 -- 172.21.15.40:0/203787342 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c009fed0 con 0x7f05c009c890 2023-09-30T22:26:18.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.451+0000 7f05c4c9c700 1 --2- 172.21.15.40:0/203787342 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05c009e480 0x7f05c013bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:18.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.451+0000 7f05bffff700 1 --2- 172.21.15.40:0/203787342 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05c009c890 0x7f05c009cc60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f05b0009850 tx=0x7f05b0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f149567e468bfc7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:18.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.451+0000 7f05beffd700 1 -- 172.21.15.40:0/203787342 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b0005e30 con 0x7f05c009c890 2023-09-30T22:26:18.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.451+0000 7f05beffd700 1 -- 172.21.15.40:0/203787342 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b0006030 con 0x7f05c009c890 2023-09-30T22:26:18.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.451+0000 7f05beffd700 1 -- 172.21.15.40:0/203787342 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b00063e0 con 0x7f05c009c890 2023-09-30T22:26:18.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.451+0000 7f05c66ff700 1 -- 172.21.15.40:0/203787342 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05c009c890 msgr2=0x7f05c009cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:18.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.451+0000 7f05c66ff700 1 --2- 172.21.15.40:0/203787342 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05c009c890 0x7f05c009cc60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f05b0009850 tx=0x7f05b0009b60 comp rx=0 tx=0).stop 2023-09-30T22:26:18.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.451+0000 7f05c66ff700 1 -- 172.21.15.40:0/203787342 shutdown_connections 2023-09-30T22:26:18.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.451+0000 7f05c66ff700 1 --2- 172.21.15.40:0/203787342 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05c009e480 0x7f05c013bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.451+0000 7f05c66ff700 1 --2- 172.21.15.40:0/203787342 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05c009c890 0x7f05c009cc60 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.452+0000 7f05c66ff700 1 -- 172.21.15.40:0/203787342 >> 172.21.15.40:0/203787342 conn(0x7f05c00a7080 msgr2=0x7f05c00a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:18.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.452+0000 7f05c66ff700 1 -- 172.21.15.40:0/203787342 shutdown_connections 2023-09-30T22:26:18.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.452+0000 7f05c66ff700 1 -- 172.21.15.40:0/203787342 wait complete. 2023-09-30T22:26:18.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.452+0000 7f05c66ff700 1 Processor -- start 2023-09-30T22:26:18.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.453+0000 7f05c66ff700 1 -- start start 2023-09-30T22:26:18.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.453+0000 7f05c66ff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05c009c890 0x7f05c01c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.453+0000 7f05c66ff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05c009d920 0x7f05c01c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.453+0000 7f05c66ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05c009e480 0x7f05c012d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.453+0000 7f05c66ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c012f8a0 con 0x7f05c009e480 2023-09-30T22:26:18.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.453+0000 7f05c66ff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c0130920 con 0x7f05c009d920 2023-09-30T22:26:18.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.453+0000 7f05c66ff700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05c01314f0 con 0x7f05c009c890 2023-09-30T22:26:18.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.453+0000 7f05bffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05c009c890 0x7f05c01c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.453+0000 7f05bf7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05c009d920 0x7f05c01c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.453+0000 7f05bffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05c009c890 0x7f05c01c8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:53018/0 (socket says 172.21.15.40:53018) 2023-09-30T22:26:18.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.453+0000 7f05bffff700 1 -- 172.21.15.40:0/1406872826 learned_addr learned my addr 172.21.15.40:0/1406872826 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:18.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.453+0000 7f05c4c9c700 1 --2- 172.21.15.40:0/1406872826 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05c009e480 0x7f05c012d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.454+0000 7f05bf7fe700 1 -- 172.21.15.40:0/1406872826 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05c009c890 msgr2=0x7f05c01c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:18.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.454+0000 7f05bf7fe700 1 --2- 172.21.15.40:0/1406872826 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05c009c890 0x7f05c01c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.454+0000 7f05bf7fe700 1 -- 172.21.15.40:0/1406872826 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05c009e480 msgr2=0x7f05c012d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:18.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.454+0000 7f05bf7fe700 1 --2- 172.21.15.40:0/1406872826 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05c009e480 0x7f05c012d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.454+0000 7f05bf7fe700 1 -- 172.21.15.40:0/1406872826 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b8009a70 con 0x7f05c009d920 2023-09-30T22:26:18.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.454+0000 7f05bffff700 1 --2- 172.21.15.40:0/1406872826 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05c009c890 0x7f05c01c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:18.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.454+0000 7f05bf7fe700 1 --2- 172.21.15.40:0/1406872826 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05c009d920 0x7f05c01c9190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f05b400c4d0 tx=0x7f05b400c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:18.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.454+0000 7f05bcff9700 1 -- 172.21.15.40:0/1406872826 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b4005d70 con 0x7f05c009d920 2023-09-30T22:26:18.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.454+0000 7f05bcff9700 1 -- 172.21.15.40:0/1406872826 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b400ce70 con 0x7f05c009d920 2023-09-30T22:26:18.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.454+0000 7f05bcff9700 1 -- 172.21.15.40:0/1406872826 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b40072d0 con 0x7f05c009d920 2023-09-30T22:26:18.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.454+0000 7f05c66ff700 1 -- 172.21.15.40:0/1406872826 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b0009430 con 0x7f05c009d920 2023-09-30T22:26:18.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.454+0000 7f05c66ff700 1 -- 172.21.15.40:0/1406872826 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c0130be0 con 0x7f05c009d920 2023-09-30T22:26:18.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.455+0000 7f05bcff9700 1 -- 172.21.15.40:0/1406872826 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f05b4007430 con 0x7f05c009d920 2023-09-30T22:26:18.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.455+0000 7f05c66ff700 1 -- 172.21.15.40:0/1406872826 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c0062380 con 0x7f05c009d920 2023-09-30T22:26:18.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.455+0000 7f05bcff9700 1 -- 172.21.15.40:0/1406872826 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f05b403e960 con 0x7f05c009d920 2023-09-30T22:26:18.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.460+0000 7f05bcff9700 1 -- 172.21.15.40:0/1406872826 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f05b4017020 con 0x7f05c009d920 2023-09-30T22:26:18.468 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:18.478 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:18.509 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:18.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.607+0000 7fb9cb3c5700 1 Processor -- start 2023-09-30T22:26:18.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.607+0000 7fb9cb3c5700 1 -- start start 2023-09-30T22:26:18.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.607+0000 7fb9cb3c5700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb9c409d450 0x7fb9c409d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.607+0000 7fb9cb3c5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9c409dd60 0x7fb9c41301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.607+0000 7fb9cb3c5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9c4130700 0x7fb9c4130b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.607+0000 7fb9cb3c5700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c409e8b0 con 0x7fb9c409d450 2023-09-30T22:26:18.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.607+0000 7fb9cb3c5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c409c3b0 con 0x7fb9c4130700 2023-09-30T22:26:18.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.607+0000 7fb9cb3c5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c409a6b0 con 0x7fb9c409dd60 2023-09-30T22:26:18.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.607+0000 7fb9c9962700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9c4130700 0x7fb9c4130b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.607+0000 7fb9c9962700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9c4130700 0x7fb9c4130b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48912/0 (socket says 172.21.15.40:48912) 2023-09-30T22:26:18.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.607+0000 7fb9c9962700 1 -- 172.21.15.40:0/240942845 learned_addr learned my addr 172.21.15.40:0/240942845 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:18.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.608+0000 7fb9c9161700 1 --2- 172.21.15.40:0/240942845 >> v2:172.21.15.40:3300/0 conn(0x7fb9c409d450 0x7fb9c409d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.608+0000 7fb9c8960700 1 --2- 172.21.15.40:0/240942845 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9c409dd60 0x7fb9c41301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.608+0000 7fb9c9962700 1 -- 172.21.15.40:0/240942845 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9c409dd60 msgr2=0x7fb9c41301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:18.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.608+0000 7fb9c9962700 1 --2- 172.21.15.40:0/240942845 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9c409dd60 0x7fb9c41301c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.608+0000 7fb9c9962700 1 -- 172.21.15.40:0/240942845 >> v2:172.21.15.40:3300/0 conn(0x7fb9c409d450 msgr2=0x7fb9c409d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:18.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.608+0000 7fb9c9962700 1 --2- 172.21.15.40:0/240942845 >> v2:172.21.15.40:3300/0 conn(0x7fb9c409d450 0x7fb9c409d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.608+0000 7fb9c9962700 1 -- 172.21.15.40:0/240942845 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c409b4f0 con 0x7fb9c4130700 2023-09-30T22:26:18.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.608+0000 7fb9c9962700 1 --2- 172.21.15.40:0/240942845 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9c4130700 0x7fb9c4130b80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc009e50 tx=0x7fb9bc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=556cf3b472352de6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:18.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.608+0000 7fb9bbfff700 1 -- 172.21.15.40:0/240942845 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc00e070 con 0x7fb9c4130700 2023-09-30T22:26:18.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.608+0000 7fb9bbfff700 1 -- 172.21.15.40:0/240942845 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9bc00b9c0 con 0x7fb9c4130700 2023-09-30T22:26:18.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.608+0000 7fb9bbfff700 1 -- 172.21.15.40:0/240942845 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc00bd70 con 0x7fb9c4130700 2023-09-30T22:26:18.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.609+0000 7fb9cb3c5700 1 -- 172.21.15.40:0/240942845 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9c4130700 msgr2=0x7fb9c4130b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:18.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.609+0000 7fb9cb3c5700 1 --2- 172.21.15.40:0/240942845 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9c4130700 0x7fb9c4130b80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc009e50 tx=0x7fb9bc00b330 comp rx=0 tx=0).stop 2023-09-30T22:26:18.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.609+0000 7fb9cb3c5700 1 -- 172.21.15.40:0/240942845 shutdown_connections 2023-09-30T22:26:18.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.609+0000 7fb9cb3c5700 1 --2- 172.21.15.40:0/240942845 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9c4130700 0x7fb9c4130b80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.609+0000 7fb9cb3c5700 1 --2- 172.21.15.40:0/240942845 >> v2:172.21.15.40:3300/0 conn(0x7fb9c409d450 0x7fb9c409d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.609+0000 7fb9cb3c5700 1 --2- 172.21.15.40:0/240942845 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9c409dd60 0x7fb9c41301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.609+0000 7fb9cb3c5700 1 -- 172.21.15.40:0/240942845 >> 172.21.15.40:0/240942845 conn(0x7fb9c40a2a00 msgr2=0x7fb9c40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:18.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.609+0000 7fb9cb3c5700 1 -- 172.21.15.40:0/240942845 shutdown_connections 2023-09-30T22:26:18.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.609+0000 7fb9cb3c5700 1 -- 172.21.15.40:0/240942845 wait complete. 2023-09-30T22:26:18.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.610+0000 7fb9cb3c5700 1 Processor -- start 2023-09-30T22:26:18.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.610+0000 7fb9cb3c5700 1 -- start start 2023-09-30T22:26:18.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.611+0000 7fb9cb3c5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9c409d450 0x7fb9c41c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.611+0000 7fb9cb3c5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9c409dd60 0x7fb9c41c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.611+0000 7fb9cb3c5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9c4130700 0x7fb9c41c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.611+0000 7fb9cb3c5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c4121810 con 0x7fb9c409dd60 2023-09-30T22:26:18.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.611+0000 7fb9cb3c5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c4122260 con 0x7fb9c4130700 2023-09-30T22:26:18.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.611+0000 7fb9cb3c5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c411fa00 con 0x7fb9c409d450 2023-09-30T22:26:18.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.611+0000 7fb9c9962700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9c4130700 0x7fb9c41c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.611+0000 7fb9c9161700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9c409d450 0x7fb9c41c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.611+0000 7fb9c9962700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9c4130700 0x7fb9c41c9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48920/0 (socket says 172.21.15.40:48920) 2023-09-30T22:26:18.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.611+0000 7fb9c9962700 1 -- 172.21.15.40:0/517634417 learned_addr learned my addr 172.21.15.40:0/517634417 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:18.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.611+0000 7fb9c8960700 1 --2- 172.21.15.40:0/517634417 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9c409dd60 0x7fb9c41c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.611+0000 7fb9c9962700 1 -- 172.21.15.40:0/517634417 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9c409d450 msgr2=0x7fb9c41c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:18.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.611+0000 7fb9c9962700 1 --2- 172.21.15.40:0/517634417 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9c409d450 0x7fb9c41c8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.611+0000 7fb9c9962700 1 -- 172.21.15.40:0/517634417 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9c409dd60 msgr2=0x7fb9c41c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:18.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.611+0000 7fb9c9962700 1 --2- 172.21.15.40:0/517634417 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9c409dd60 0x7fb9c41c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.611+0000 7fb9c9962700 1 -- 172.21.15.40:0/517634417 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9bc009b30 con 0x7fb9c4130700 2023-09-30T22:26:18.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.611+0000 7fb9c9962700 1 --2- 172.21.15.40:0/517634417 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9c4130700 0x7fb9c41c9080 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb9c409c4f0 tx=0x7fb9bc004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:18.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.612+0000 7fb9b9ffb700 1 -- 172.21.15.40:0/517634417 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc004240 con 0x7fb9c4130700 2023-09-30T22:26:18.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.612+0000 7fb9cb3c5700 1 -- 172.21.15.40:0/517634417 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c4071e80 con 0x7fb9c4130700 2023-09-30T22:26:18.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.612+0000 7fb9b9ffb700 1 -- 172.21.15.40:0/517634417 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9bc0043c0 con 0x7fb9c4130700 2023-09-30T22:26:18.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.612+0000 7fb9b9ffb700 1 -- 172.21.15.40:0/517634417 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc004770 con 0x7fb9c4130700 2023-09-30T22:26:18.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.612+0000 7fb9cb3c5700 1 -- 172.21.15.40:0/517634417 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c41227d0 con 0x7fb9c4130700 2023-09-30T22:26:18.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.613+0000 7fb9b9ffb700 1 -- 172.21.15.40:0/517634417 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb9bc025460 con 0x7fb9c4130700 2023-09-30T22:26:18.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.613+0000 7fb9b9ffb700 1 -- 172.21.15.40:0/517634417 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb9bc041250 con 0x7fb9c4130700 2023-09-30T22:26:18.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.613+0000 7fb9cb3c5700 1 -- 172.21.15.40:0/517634417 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c4122a90 con 0x7fb9c4130700 2023-09-30T22:26:18.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.622+0000 7fb9b9ffb700 1 -- 172.21.15.40:0/517634417 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb9c4122a90 con 0x7fb9c4130700 2023-09-30T22:26:18.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.653+0000 7f73ba4b2700 1 Processor -- start 2023-09-30T22:26:18.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.653+0000 7f7ceec58700 1 Processor -- start 2023-09-30T22:26:18.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.653+0000 7f73ba4b2700 1 -- start start 2023-09-30T22:26:18.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.653+0000 7f7ceec58700 1 -- start start 2023-09-30T22:26:18.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.654+0000 7f73ba4b2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73b406a6d0 0x7f73b409d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.654+0000 7f73ba4b2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f73b409de60 0x7f73b409e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.654+0000 7f73ba4b2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73b413c490 0x7f73b413e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.654+0000 7f73ba4b2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73b406aaa0 con 0x7f73b409de60 2023-09-30T22:26:18.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.654+0000 7f73ba4b2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b409e790 con 0x7f73b406a6d0 2023-09-30T22:26:18.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.654+0000 7f73ba4b2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73b411d980 con 0x7f73b413c490 2023-09-30T22:26:18.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.654+0000 7f7ceec58700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ce809c890 0x7f7ce809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.654+0000 7f7ceec58700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7ce809d920 0x7f7ce809dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.654+0000 7f7ceec58700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ce80a2600 con 0x7f7ce809e2b0 2023-09-30T22:26:18.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.654+0000 7f7ceec58700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce80a29d0 con 0x7f7ce809c890 2023-09-30T22:26:18.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.654+0000 7f7ceec58700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce809fb40 con 0x7f7ce809d920 2023-09-30T22:26:18.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.654+0000 7f7ce7fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7ce809d920 0x7f7ce809dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.654+0000 7f7ce7fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7ce809d920 0x7f7ce809dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:53066/0 (socket says 172.21.15.40:53066) 2023-09-30T22:26:18.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.654+0000 7f7ce7fff700 1 -- 172.21.15.40:0/4109683307 learned_addr learned my addr 172.21.15.40:0/4109683307 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:18.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.654+0000 7f7cec9f4700 1 --2- 172.21.15.40:0/4109683307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ce809c890 0x7f7ce809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.654+0000 7f73b3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73b406a6d0 0x7f73b409d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.654+0000 7f73b3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73b406a6d0 0x7f73b409d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48932/0 (socket says 172.21.15.40:48932) 2023-09-30T22:26:18.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.654+0000 7f73b3fff700 1 -- 172.21.15.40:0/4010039322 learned_addr learned my addr 172.21.15.40:0/4010039322 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:18.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.654+0000 7f73b8a4f700 1 --2- 172.21.15.40:0/4010039322 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73b413c490 0x7f73b413e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.654+0000 7f73b3fff700 1 -- 172.21.15.40:0/4010039322 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73b413c490 msgr2=0x7f73b413e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:18.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.654+0000 7f73b3fff700 1 --2- 172.21.15.40:0/4010039322 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73b413c490 0x7f73b413e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.654+0000 7f73b3fff700 1 -- 172.21.15.40:0/4010039322 >> v2:172.21.15.40:3300/0 conn(0x7f73b409de60 msgr2=0x7f73b409e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:18.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.654+0000 7f73b3fff700 1 --2- 172.21.15.40:0/4010039322 >> v2:172.21.15.40:3300/0 conn(0x7f73b409de60 0x7f73b409e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.654+0000 7f73b3fff700 1 -- 172.21.15.40:0/4010039322 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b406b150 con 0x7f73b406a6d0 2023-09-30T22:26:18.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.655+0000 7f7ce7fff700 1 -- 172.21.15.40:0/4109683307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ce809c890 msgr2=0x7f7ce809cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:18.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.655+0000 7f7ce7fff700 1 --2- 172.21.15.40:0/4109683307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ce809c890 0x7f7ce809cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.655+0000 7f7ce7fff700 1 -- 172.21.15.40:0/4109683307 >> v1:172.21.15.40:6789/0 conn(0x7f7ce809e2b0 legacy=0x7f7ce813ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:18.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.655+0000 7f7ce7fff700 1 -- 172.21.15.40:0/4109683307 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce809e720 con 0x7f7ce809d920 2023-09-30T22:26:18.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.654+0000 7f73b3fff700 1 --2- 172.21.15.40:0/4010039322 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73b406a6d0 0x7f73b409d920 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f73a8006fd0 tx=0x7f73a8009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d898dfadd6aa20f6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:18.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.655+0000 7f73b2ffd700 1 -- 172.21.15.40:0/4010039322 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a8005e30 con 0x7f73b406a6d0 2023-09-30T22:26:18.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.655+0000 7f73b2ffd700 1 -- 172.21.15.40:0/4010039322 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a8004030 con 0x7f73b406a6d0 2023-09-30T22:26:18.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.655+0000 7f73b2ffd700 1 -- 172.21.15.40:0/4010039322 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a80043e0 con 0x7f73b406a6d0 2023-09-30T22:26:18.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.655+0000 7f7ce7fff700 1 --2- 172.21.15.40:0/4109683307 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7ce809d920 0x7f7ce809dd70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4009920 tx=0x7f7cd4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bdb2f18f67628ec server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:18.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.655+0000 7f7ce77fe700 1 -- 172.21.15.40:0/4109683307 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd4004230 con 0x7f7ce809d920 2023-09-30T22:26:18.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.655+0000 7f7ce77fe700 1 -- 172.21.15.40:0/4109683307 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd4004390 con 0x7f7ce809d920 2023-09-30T22:26:18.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.655+0000 7f7ce77fe700 1 -- 172.21.15.40:0/4109683307 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd40036a0 con 0x7f7ce809d920 2023-09-30T22:26:18.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.656+0000 7f73ba4b2700 1 -- 172.21.15.40:0/4010039322 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73b406a6d0 msgr2=0x7f73b409d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:18.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.656+0000 7f73ba4b2700 1 --2- 172.21.15.40:0/4010039322 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73b406a6d0 0x7f73b409d920 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f73a8006fd0 tx=0x7f73a8009bd0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.656+0000 7f73ba4b2700 1 -- 172.21.15.40:0/4010039322 shutdown_connections 2023-09-30T22:26:18.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.656+0000 7f73ba4b2700 1 --2- 172.21.15.40:0/4010039322 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73b413c490 0x7f73b413e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.656+0000 7f73ba4b2700 1 --2- 172.21.15.40:0/4010039322 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73b406a6d0 0x7f73b409d920 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.656+0000 7f73ba4b2700 1 --2- 172.21.15.40:0/4010039322 >> v2:172.21.15.40:3300/0 conn(0x7f73b409de60 0x7f73b409e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.656+0000 7f73ba4b2700 1 -- 172.21.15.40:0/4010039322 >> 172.21.15.40:0/4010039322 conn(0x7f73b409fb20 msgr2=0x7f73b409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:18.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.656+0000 7f7ceec58700 1 -- 172.21.15.40:0/4109683307 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7ce809d920 msgr2=0x7f7ce809dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:18.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.656+0000 7f7ceec58700 1 --2- 172.21.15.40:0/4109683307 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7ce809d920 0x7f7ce809dd70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4009920 tx=0x7f7cd4009c30 comp rx=0 tx=0).stop 2023-09-30T22:26:18.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.656+0000 7f7ceec58700 1 -- 172.21.15.40:0/4109683307 shutdown_connections 2023-09-30T22:26:18.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.656+0000 7f7ceec58700 1 --2- 172.21.15.40:0/4109683307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ce809c890 0x7f7ce809cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.656+0000 7f7ceec58700 1 --2- 172.21.15.40:0/4109683307 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7ce809d920 0x7f7ce809dd70 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.656+0000 7f7ceec58700 1 -- 172.21.15.40:0/4109683307 >> 172.21.15.40:0/4109683307 conn(0x7f7ce80a7080 msgr2=0x7f7ce80a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:18.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.656+0000 7f73ba4b2700 1 -- 172.21.15.40:0/4010039322 shutdown_connections 2023-09-30T22:26:18.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.656+0000 7f73ba4b2700 1 -- 172.21.15.40:0/4010039322 wait complete. 2023-09-30T22:26:18.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.656+0000 7f7ceec58700 1 -- 172.21.15.40:0/4109683307 shutdown_connections 2023-09-30T22:26:18.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.657+0000 7f73ba4b2700 1 Processor -- start 2023-09-30T22:26:18.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.657+0000 7f73ba4b2700 1 -- start start 2023-09-30T22:26:18.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.658+0000 7f73ba4b2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73b406a6d0 0x7f73b4126350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.658+0000 7f73ba4b2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73b409de60 0x7f73b4126890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.658+0000 7f73ba4b2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73b413c490 0x7f73b4126dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.658+0000 7f73ba4b2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b411d410 con 0x7f73b409de60 2023-09-30T22:26:18.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.658+0000 7f73ba4b2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b409f540 con 0x7f73b413c490 2023-09-30T22:26:18.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.658+0000 7f73ba4b2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73b409c2b0 con 0x7f73b406a6d0 2023-09-30T22:26:18.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.658+0000 7f73b37fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73b409de60 0x7f73b4126890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.658+0000 7f73b37fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73b409de60 0x7f73b4126890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43764/0 (socket says 172.21.15.40:43764) 2023-09-30T22:26:18.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.658+0000 7f73b37fe700 1 -- 172.21.15.40:0/1819560176 learned_addr learned my addr 172.21.15.40:0/1819560176 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:18.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.658+0000 7f73b37fe700 1 -- 172.21.15.40:0/1819560176 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73b406a6d0 msgr2=0x7f73b4126350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:26:18.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.658+0000 7f73b37fe700 1 --2- 172.21.15.40:0/1819560176 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73b406a6d0 0x7f73b4126350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.658+0000 7f73b37fe700 1 -- 172.21.15.40:0/1819560176 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73b413c490 msgr2=0x7f73b4126dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:18.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.658+0000 7f73b37fe700 1 --2- 172.21.15.40:0/1819560176 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73b413c490 0x7f73b4126dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.658+0000 7f73b37fe700 1 -- 172.21.15.40:0/1819560176 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a8009500 con 0x7f73b409de60 2023-09-30T22:26:18.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.658+0000 7f73b37fe700 1 --2- 172.21.15.40:0/1819560176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73b409de60 0x7f73b4126890 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f73a400b500 tx=0x7f73a400b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:18.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.659+0000 7f73b0ff9700 1 -- 172.21.15.40:0/1819560176 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a4011830 con 0x7f73b409de60 2023-09-30T22:26:18.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.659+0000 7f73b0ff9700 1 -- 172.21.15.40:0/1819560176 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a4011990 con 0x7f73b409de60 2023-09-30T22:26:18.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.659+0000 7f73b0ff9700 1 -- 172.21.15.40:0/1819560176 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a4011d40 con 0x7f73b409de60 2023-09-30T22:26:18.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.659+0000 7f73ba4b2700 1 -- 172.21.15.40:0/1819560176 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73b413bf80 con 0x7f73b409de60 2023-09-30T22:26:18.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.659+0000 7f73ba4b2700 1 -- 172.21.15.40:0/1819560176 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73b411c970 con 0x7f73b409de60 2023-09-30T22:26:18.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.660+0000 7f73b0ff9700 1 -- 172.21.15.40:0/1819560176 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f73a401a400 con 0x7f73b409de60 2023-09-30T22:26:18.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.660+0000 7f73b0ff9700 1 -- 172.21.15.40:0/1819560176 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f73a400f4c0 con 0x7f73b409de60 2023-09-30T22:26:18.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.660+0000 7f73ba4b2700 1 -- 172.21.15.40:0/1819560176 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73b4128820 con 0x7f73b409de60 2023-09-30T22:26:18.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.658+0000 7f7ceec58700 1 -- 172.21.15.40:0/4109683307 wait complete. 2023-09-30T22:26:18.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.659+0000 7f7ceec58700 1 Processor -- start 2023-09-30T22:26:18.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.659+0000 7f7ceec58700 1 -- start start 2023-09-30T22:26:18.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.660+0000 7f7ceec58700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ce809c890 0x7f7ce808a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.660+0000 7f7ceec58700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ce809d920 0x7f7ce80890b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.660+0000 7f7ceec58700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7ce809e2b0 0x7f7ce80895f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.660+0000 7f7ceec58700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce81308d0 con 0x7f7ce809d920 2023-09-30T22:26:18.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.660+0000 7f7ceec58700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce812fd60 con 0x7f7ce809c890 2023-09-30T22:26:18.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.660+0000 7f7ceec58700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce809ecf0 con 0x7f7ce809e2b0 2023-09-30T22:26:18.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.660+0000 7f7ce7fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ce809d920 0x7f7ce80890b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.660+0000 7f7ce7fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ce809d920 0x7f7ce80890b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43778/0 (socket says 172.21.15.40:43778) 2023-09-30T22:26:18.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.660+0000 7f7ce7fff700 1 -- 172.21.15.40:0/462996408 learned_addr learned my addr 172.21.15.40:0/462996408 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:18.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.660+0000 7f7ced1f5700 1 --2- 172.21.15.40:0/462996408 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7ce809e2b0 0x7f7ce80895f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.660+0000 7f7ce7fff700 1 -- 172.21.15.40:0/462996408 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7ce809e2b0 msgr2=0x7f7ce80895f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:18.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.660+0000 7f7ce7fff700 1 --2- 172.21.15.40:0/462996408 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7ce809e2b0 0x7f7ce80895f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.660+0000 7f7ce7fff700 1 -- 172.21.15.40:0/462996408 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ce809c890 msgr2=0x7f7ce808a560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:26:18.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.660+0000 7f7ce7fff700 1 --2- 172.21.15.40:0/462996408 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ce809c890 0x7f7ce808a560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.660+0000 7f7ce7fff700 1 -- 172.21.15.40:0/462996408 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd4009550 con 0x7f7ce809d920 2023-09-30T22:26:18.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.662+0000 7f7ce7fff700 1 --2- 172.21.15.40:0/462996408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ce809d920 0x7f7ce80890b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7ce809fc80 tx=0x7f7cd4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:18.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.665+0000 7f73b0ff9700 1 -- 172.21.15.40:0/1819560176 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f73a40193b0 con 0x7f73b409de60 2023-09-30T22:26:18.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.665+0000 7f7ce57fa700 1 -- 172.21.15.40:0/462996408 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd4003ad0 con 0x7f7ce809d920 2023-09-30T22:26:18.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.665+0000 7f7ce57fa700 1 -- 172.21.15.40:0/462996408 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd401f070 con 0x7f7ce809d920 2023-09-30T22:26:18.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.665+0000 7f7ce57fa700 1 -- 172.21.15.40:0/462996408 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd4003e90 con 0x7f7ce809d920 2023-09-30T22:26:18.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.665+0000 7f7ceec58700 1 -- 172.21.15.40:0/462996408 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ce812f740 con 0x7f7ce809d920 2023-09-30T22:26:18.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.666+0000 7f7ceec58700 1 -- 172.21.15.40:0/462996408 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ce808f3e0 con 0x7f7ce809d920 2023-09-30T22:26:18.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.667+0000 7f7ceec58700 1 -- 172.21.15.40:0/462996408 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ce8062380 con 0x7f7ce809d920 2023-09-30T22:26:18.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.669+0000 7f7ce57fa700 1 -- 172.21.15.40:0/462996408 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7cd4021030 con 0x7f7ce809d920 2023-09-30T22:26:18.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.669+0000 7f7ce57fa700 1 -- 172.21.15.40:0/462996408 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f7cd4040fb0 con 0x7f7ce809d920 2023-09-30T22:26:18.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.672+0000 7f7ce57fa700 1 -- 172.21.15.40:0/462996408 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7cd4011630 con 0x7f7ce809d920 2023-09-30T22:26:18.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.674+0000 7f05c66ff700 1 -- 172.21.15.40:0/1406872826 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f05c0074620 con 0x7f05c009d920 2023-09-30T22:26:18.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.676+0000 7f05bcff9700 1 -- 172.21.15.40:0/1406872826 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f05b401b3b0 con 0x7f05c009d920 2023-09-30T22:26:18.677 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:18.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.679+0000 7f05c66ff700 1 -- 172.21.15.40:0/1406872826 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05c009d920 msgr2=0x7f05c01c9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:18.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.679+0000 7f05c66ff700 1 --2- 172.21.15.40:0/1406872826 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05c009d920 0x7f05c01c9190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f05b400c4d0 tx=0x7f05b400c7e0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.679+0000 7f05c66ff700 1 -- 172.21.15.40:0/1406872826 shutdown_connections 2023-09-30T22:26:18.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.679+0000 7f05c66ff700 1 --2- 172.21.15.40:0/1406872826 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05c009c890 0x7f05c01c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.679+0000 7f05c66ff700 1 --2- 172.21.15.40:0/1406872826 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05c009e480 0x7f05c012d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.679+0000 7f05c66ff700 1 --2- 172.21.15.40:0/1406872826 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05c009d920 0x7f05c01c9190 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.679+0000 7f05c66ff700 1 -- 172.21.15.40:0/1406872826 >> 172.21.15.40:0/1406872826 conn(0x7f05c00a7080 msgr2=0x7f05c00a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:18.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.680+0000 7f05c66ff700 1 -- 172.21.15.40:0/1406872826 shutdown_connections 2023-09-30T22:26:18.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.680+0000 7f05c66ff700 1 -- 172.21.15.40:0/1406872826 wait complete. 2023-09-30T22:26:18.694 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:18.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.824+0000 7fb9cb3c5700 1 -- 172.21.15.40:0/517634417 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb9c4122a90 con 0x7fb9c4130700 2023-09-30T22:26:18.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.824+0000 7fb9b9ffb700 1 -- 172.21.15.40:0/517634417 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb9c4122a90 con 0x7fb9c4130700 2023-09-30T22:26:18.825 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:18.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.826+0000 7fb9cb3c5700 1 -- 172.21.15.40:0/517634417 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9c4130700 msgr2=0x7fb9c41c9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:18.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.826+0000 7fb9cb3c5700 1 --2- 172.21.15.40:0/517634417 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9c4130700 0x7fb9c41c9080 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb9c409c4f0 tx=0x7fb9bc004ad0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.827+0000 7fb9cb3c5700 1 -- 172.21.15.40:0/517634417 shutdown_connections 2023-09-30T22:26:18.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.827+0000 7fb9cb3c5700 1 --2- 172.21.15.40:0/517634417 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9c409d450 0x7fb9c41c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.827+0000 7fb9cb3c5700 1 --2- 172.21.15.40:0/517634417 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9c4130700 0x7fb9c41c9080 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.827+0000 7fb9cb3c5700 1 --2- 172.21.15.40:0/517634417 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9c409dd60 0x7fb9c41c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.827+0000 7fb9cb3c5700 1 -- 172.21.15.40:0/517634417 >> 172.21.15.40:0/517634417 conn(0x7fb9c40a2a00 msgr2=0x7fb9c41b7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:18.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.827+0000 7fb9cb3c5700 1 -- 172.21.15.40:0/517634417 shutdown_connections 2023-09-30T22:26:18.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.827+0000 7fb9cb3c5700 1 -- 172.21.15.40:0/517634417 wait complete. 2023-09-30T22:26:18.840 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:18.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.864+0000 7f73ba4b2700 1 -- 172.21.15.40:0/1819560176 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f73b4062380 con 0x7f73b409de60 2023-09-30T22:26:18.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.865+0000 7f73b0ff9700 1 -- 172.21.15.40:0/1819560176 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f73a400f2e0 con 0x7f73b409de60 2023-09-30T22:26:18.866 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:18.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.867+0000 7f73ba4b2700 1 -- 172.21.15.40:0/1819560176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73b409de60 msgr2=0x7f73b4126890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:18.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.867+0000 7f73ba4b2700 1 --2- 172.21.15.40:0/1819560176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73b409de60 0x7f73b4126890 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f73a400b500 tx=0x7f73a400b8c0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.867+0000 7f73ba4b2700 1 -- 172.21.15.40:0/1819560176 shutdown_connections 2023-09-30T22:26:18.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.867+0000 7f73ba4b2700 1 --2- 172.21.15.40:0/1819560176 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73b406a6d0 0x7f73b4126350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.867+0000 7f73ba4b2700 1 --2- 172.21.15.40:0/1819560176 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73b413c490 0x7f73b4126dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.867+0000 7f73ba4b2700 1 --2- 172.21.15.40:0/1819560176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73b409de60 0x7f73b4126890 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.867+0000 7f73ba4b2700 1 -- 172.21.15.40:0/1819560176 >> 172.21.15.40:0/1819560176 conn(0x7f73b409fb20 msgr2=0x7f73b413d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:18.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.867+0000 7f73ba4b2700 1 -- 172.21.15.40:0/1819560176 shutdown_connections 2023-09-30T22:26:18.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.867+0000 7f73ba4b2700 1 -- 172.21.15.40:0/1819560176 wait complete. 2023-09-30T22:26:18.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.870+0000 7f7ceec58700 1 -- 172.21.15.40:0/462996408 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7ce8062380 con 0x7f7ce809d920 2023-09-30T22:26:18.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.871+0000 7f7ce57fa700 1 -- 172.21.15.40:0/462996408 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7cd40233d0 con 0x7f7ce809d920 2023-09-30T22:26:18.871 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:18.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.873+0000 7f7ceec58700 1 -- 172.21.15.40:0/462996408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ce809d920 msgr2=0x7f7ce80890b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:18.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.873+0000 7f7ceec58700 1 --2- 172.21.15.40:0/462996408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ce809d920 0x7f7ce80890b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7ce809fc80 tx=0x7f7cd4004750 comp rx=0 tx=0).stop 2023-09-30T22:26:18.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.873+0000 7f7ceec58700 1 -- 172.21.15.40:0/462996408 shutdown_connections 2023-09-30T22:26:18.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.873+0000 7f7ceec58700 1 --2- 172.21.15.40:0/462996408 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7ce809e2b0 0x7f7ce80895f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.873+0000 7f7ceec58700 1 --2- 172.21.15.40:0/462996408 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ce809c890 0x7f7ce808a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.873+0000 7f7ceec58700 1 --2- 172.21.15.40:0/462996408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ce809d920 0x7f7ce80890b0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.873+0000 7f7ceec58700 1 -- 172.21.15.40:0/462996408 >> 172.21.15.40:0/462996408 conn(0x7f7ce80a7080 msgr2=0x7f7ce80a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:18.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.873+0000 7f7ceec58700 1 -- 172.21.15.40:0/462996408 shutdown_connections 2023-09-30T22:26:18.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:18.873+0000 7f7ceec58700 1 -- 172.21.15.40:0/462996408 wait complete. 2023-09-30T22:26:18.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:18.886 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:19.695 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:19.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.837+0000 7f491bd36700 1 Processor -- start 2023-09-30T22:26:19.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.837+0000 7f491bd36700 1 -- start start 2023-09-30T22:26:19.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.837+0000 7f491bd36700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f491409c890 0x7f491409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:19.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.837+0000 7f491bd36700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f491409d920 0x7f491409dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:19.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.837+0000 7f491bd36700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49140a2600 con 0x7f491409e2b0 2023-09-30T22:26:19.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.837+0000 7f491bd36700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49140a29d0 con 0x7f491409d920 2023-09-30T22:26:19.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.837+0000 7f491bd36700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491409fb40 con 0x7f491409c890 2023-09-30T22:26:19.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.837+0000 7f4919ad2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f491409c890 0x7f491409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:19.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.837+0000 7f49192d1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f491409d920 0x7f491409dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:19.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.837+0000 7f49192d1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f491409d920 0x7f491409dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43782/0 (socket says 172.21.15.40:43782) 2023-09-30T22:26:19.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.837+0000 7f4919ad2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f491409c890 0x7f491409cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48956/0 (socket says 172.21.15.40:48956) 2023-09-30T22:26:19.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.837+0000 7f49192d1700 1 -- 172.21.15.40:0/3339347544 learned_addr learned my addr 172.21.15.40:0/3339347544 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:19.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.838+0000 7f4919ad2700 1 -- 172.21.15.40:0/3339347544 >> v2:172.21.15.40:3300/0 conn(0x7f491409d920 msgr2=0x7f491409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:19.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.838+0000 7f4919ad2700 1 --2- 172.21.15.40:0/3339347544 >> v2:172.21.15.40:3300/0 conn(0x7f491409d920 0x7f491409dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:19.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.838+0000 7f4919ad2700 1 -- 172.21.15.40:0/3339347544 >> v1:172.21.15.40:6789/0 conn(0x7f491409e2b0 legacy=0x7f491413ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:19.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.838+0000 7f4919ad2700 1 -- 172.21.15.40:0/3339347544 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491409e750 con 0x7f491409c890 2023-09-30T22:26:19.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.838+0000 7f49192d1700 1 --2- 172.21.15.40:0/3339347544 >> v2:172.21.15.40:3300/0 conn(0x7f491409d920 0x7f491409dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:19.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.838+0000 7f4919ad2700 1 --2- 172.21.15.40:0/3339347544 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f491409c890 0x7f491409cc60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4910009820 tx=0x7f4910009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13dee233cc2e5511 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:19.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.838+0000 7f4918ad0700 1 -- 172.21.15.40:0/3339347544 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4910005e30 con 0x7f491409c890 2023-09-30T22:26:19.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.838+0000 7f4918ad0700 1 -- 172.21.15.40:0/3339347544 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4910006030 con 0x7f491409c890 2023-09-30T22:26:19.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.838+0000 7f4918ad0700 1 -- 172.21.15.40:0/3339347544 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49100063c0 con 0x7f491409c890 2023-09-30T22:26:19.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.839+0000 7f491bd36700 1 -- 172.21.15.40:0/3339347544 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f491409c890 msgr2=0x7f491409cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:19.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.839+0000 7f491bd36700 1 --2- 172.21.15.40:0/3339347544 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f491409c890 0x7f491409cc60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4910009820 tx=0x7f4910009b30 comp rx=0 tx=0).stop 2023-09-30T22:26:19.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.839+0000 7f491bd36700 1 -- 172.21.15.40:0/3339347544 shutdown_connections 2023-09-30T22:26:19.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.839+0000 7f491bd36700 1 --2- 172.21.15.40:0/3339347544 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f491409c890 0x7f491409cc60 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:19.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.839+0000 7f491bd36700 1 --2- 172.21.15.40:0/3339347544 >> v2:172.21.15.40:3300/0 conn(0x7f491409d920 0x7f491409dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:19.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.839+0000 7f491bd36700 1 -- 172.21.15.40:0/3339347544 >> 172.21.15.40:0/3339347544 conn(0x7f49140a7080 msgr2=0x7f49140a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:19.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.839+0000 7f491bd36700 1 -- 172.21.15.40:0/3339347544 shutdown_connections 2023-09-30T22:26:19.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.839+0000 7f491bd36700 1 -- 172.21.15.40:0/3339347544 wait complete. 2023-09-30T22:26:19.842 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:19.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.840+0000 7f491bd36700 1 Processor -- start 2023-09-30T22:26:19.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.840+0000 7f491bd36700 1 -- start start 2023-09-30T22:26:19.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.840+0000 7f491bd36700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f491409c890 0x7f49141c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:19.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.840+0000 7f491bd36700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f491409d920 0x7f49141c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:19.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.840+0000 7f491bd36700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f491409e2b0 0x7f49141c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:19.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.840+0000 7f491bd36700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4914130070 con 0x7f491409d920 2023-09-30T22:26:19.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.840+0000 7f491bd36700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491409c230 con 0x7f491409c890 2023-09-30T22:26:19.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.840+0000 7f491bd36700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f491409ecf0 con 0x7f491409e2b0 2023-09-30T22:26:19.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.840+0000 7f4919ad2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f491409c890 0x7f49141c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:19.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.840+0000 7f49192d1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f491409d920 0x7f49141c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:19.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.840+0000 7f4919ad2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f491409c890 0x7f49141c89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48960/0 (socket says 172.21.15.40:48960) 2023-09-30T22:26:19.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.840+0000 7f4919ad2700 1 -- 172.21.15.40:0/2688040510 learned_addr learned my addr 172.21.15.40:0/2688040510 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:19.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.840+0000 7f491a2d3700 1 --2- 172.21.15.40:0/2688040510 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f491409e2b0 0x7f49141c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:19.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.841+0000 7f4919ad2700 1 -- 172.21.15.40:0/2688040510 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f491409e2b0 msgr2=0x7f49141c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:19.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.841+0000 7f4919ad2700 1 --2- 172.21.15.40:0/2688040510 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f491409e2b0 0x7f49141c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:19.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.841+0000 7f4919ad2700 1 -- 172.21.15.40:0/2688040510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f491409d920 msgr2=0x7f49141c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:19.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.841+0000 7f4919ad2700 1 --2- 172.21.15.40:0/2688040510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f491409d920 0x7f49141c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:19.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.841+0000 7f4919ad2700 1 -- 172.21.15.40:0/2688040510 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4904009550 con 0x7f491409c890 2023-09-30T22:26:19.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.841+0000 7f49192d1700 1 --2- 172.21.15.40:0/2688040510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f491409d920 0x7f49141c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:19.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.841+0000 7f4919ad2700 1 --2- 172.21.15.40:0/2688040510 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f491409c890 0x7f49141c89e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f491409fc80 tx=0x7f4910004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:19.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.841+0000 7f490a7fc700 1 -- 172.21.15.40:0/2688040510 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4910004040 con 0x7f491409c890 2023-09-30T22:26:19.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.841+0000 7f490a7fc700 1 -- 172.21.15.40:0/2688040510 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49100041a0 con 0x7f491409c890 2023-09-30T22:26:19.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.841+0000 7f491bd36700 1 -- 172.21.15.40:0/2688040510 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4910009430 con 0x7f491409c890 2023-09-30T22:26:19.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.841+0000 7f490a7fc700 1 -- 172.21.15.40:0/2688040510 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4910004510 con 0x7f491409c890 2023-09-30T22:26:19.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.841+0000 7f491bd36700 1 -- 172.21.15.40:0/2688040510 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4914130970 con 0x7f491409c890 2023-09-30T22:26:19.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.842+0000 7f491bd36700 1 -- 172.21.15.40:0/2688040510 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4914062380 con 0x7f491409c890 2023-09-30T22:26:19.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.842+0000 7f490a7fc700 1 -- 172.21.15.40:0/2688040510 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4910022070 con 0x7f491409c890 2023-09-30T22:26:19.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.842+0000 7f490a7fc700 1 -- 172.21.15.40:0/2688040510 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4910040cc0 con 0x7f491409c890 2023-09-30T22:26:19.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.847+0000 7f490a7fc700 1 -- 172.21.15.40:0/2688040510 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f491001a7a0 con 0x7f491409c890 2023-09-30T22:26:19.881 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:19.887 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:19.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.980+0000 7f32ea9c8700 1 Processor -- start 2023-09-30T22:26:19.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.980+0000 7f32ea9c8700 1 -- start start 2023-09-30T22:26:19.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.981+0000 7f32ea9c8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32e4136c50 0x7f32e4139030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:19.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.981+0000 7f32ea9c8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f32e4139570 0x7f32e413b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:19.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.981+0000 7f32ea9c8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32e4133940 con 0x7f32e4133e00 2023-09-30T22:26:19.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.981+0000 7f32ea9c8700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32e409ab20 con 0x7f32e4139570 2023-09-30T22:26:19.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.981+0000 7f32ea9c8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e409f0d0 con 0x7f32e4136c50 2023-09-30T22:26:19.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.981+0000 7f32e3fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f32e4133e00 0x7f32e41341d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40142/0 (socket says 172.21.15.40:40142) 2023-09-30T22:26:19.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.981+0000 7f32e3fff700 1 -- 172.21.15.40:0/4206007419 learned_addr learned my addr 172.21.15.40:0/4206007419 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:19.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.981+0000 7f32e37fe700 1 --2- 172.21.15.40:0/4206007419 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32e4136c50 0x7f32e4139030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:19.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.982+0000 7f32e8f65700 1 --2- 172.21.15.40:0/4206007419 >> v2:172.21.15.40:3300/0 conn(0x7f32e4139570 0x7f32e413b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:19.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.982+0000 7f32e37fe700 1 -- 172.21.15.40:0/4206007419 >> v2:172.21.15.40:3300/0 conn(0x7f32e4139570 msgr2=0x7f32e413b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:19.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.982+0000 7f32e37fe700 1 --2- 172.21.15.40:0/4206007419 >> v2:172.21.15.40:3300/0 conn(0x7f32e4139570 0x7f32e413b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:19.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.982+0000 7f32e2ffd700 1 -- 172.21.15.40:0/4206007419 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3328034344 0 0) 0x7f32e4133940 con 0x7f32e4133e00 2023-09-30T22:26:19.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.982+0000 7f32e37fe700 1 -- 172.21.15.40:0/4206007419 >> v1:172.21.15.40:6789/0 conn(0x7f32e4133e00 legacy=0x7f32e41341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:19.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.982+0000 7f32e37fe700 1 -- 172.21.15.40:0/4206007419 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e4133be0 con 0x7f32e4136c50 2023-09-30T22:26:19.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.982+0000 7f32e37fe700 1 --2- 172.21.15.40:0/4206007419 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32e4136c50 0x7f32e4139030 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f32d8009840 tx=0x7f32d8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42d10617c68b146d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:19.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.982+0000 7f32e2ffd700 1 -- 172.21.15.40:0/4206007419 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d8011830 con 0x7f32e4136c50 2023-09-30T22:26:19.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.982+0000 7f32e2ffd700 1 -- 172.21.15.40:0/4206007419 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d8011990 con 0x7f32e4136c50 2023-09-30T22:26:19.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.982+0000 7f32e2ffd700 1 -- 172.21.15.40:0/4206007419 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d8011d20 con 0x7f32e4136c50 2023-09-30T22:26:19.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.983+0000 7f32ea9c8700 1 -- 172.21.15.40:0/4206007419 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32e4136c50 msgr2=0x7f32e4139030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:19.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.983+0000 7f32ea9c8700 1 --2- 172.21.15.40:0/4206007419 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32e4136c50 0x7f32e4139030 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f32d8009840 tx=0x7f32d8009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:19.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.983+0000 7f32ea9c8700 1 -- 172.21.15.40:0/4206007419 shutdown_connections 2023-09-30T22:26:19.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.983+0000 7f32ea9c8700 1 --2- 172.21.15.40:0/4206007419 >> v2:172.21.15.40:3300/0 conn(0x7f32e4139570 0x7f32e413b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:19.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.983+0000 7f32ea9c8700 1 --2- 172.21.15.40:0/4206007419 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32e4136c50 0x7f32e4139030 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:19.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.983+0000 7f32ea9c8700 1 -- 172.21.15.40:0/4206007419 >> 172.21.15.40:0/4206007419 conn(0x7f32e40a2a00 msgr2=0x7f32e40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:19.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.983+0000 7f32ea9c8700 1 -- 172.21.15.40:0/4206007419 shutdown_connections 2023-09-30T22:26:19.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.983+0000 7f32ea9c8700 1 -- 172.21.15.40:0/4206007419 wait complete. 2023-09-30T22:26:19.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.984+0000 7f32ea9c8700 1 Processor -- start 2023-09-30T22:26:19.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.985+0000 7f32ea9c8700 1 -- start start 2023-09-30T22:26:19.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.985+0000 7f32ea9c8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32e4133e00 0x7f32e4119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:19.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.985+0000 7f32ea9c8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f32e4136c50 0x7f32e4119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:19.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.985+0000 7f32ea9c8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32e4139570 0x7f32e4119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:19.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.985+0000 7f32ea9c8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e412e210 con 0x7f32e4139570 2023-09-30T22:26:19.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.985+0000 7f32ea9c8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e41368e0 con 0x7f32e4133e00 2023-09-30T22:26:19.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.985+0000 7f32ea9c8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32e4131340 con 0x7f32e4136c50 2023-09-30T22:26:19.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.985+0000 7f32e37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f32e4136c50 0x7f32e4119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:19.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.985+0000 7f32e37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f32e4136c50 0x7f32e4119590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:53098/0 (socket says 172.21.15.40:53098) 2023-09-30T22:26:19.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.985+0000 7f32e37fe700 1 -- 172.21.15.40:0/1361414179 learned_addr learned my addr 172.21.15.40:0/1361414179 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:19.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.985+0000 7f32e3fff700 1 --2- 172.21.15.40:0/1361414179 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32e4133e00 0x7f32e4119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:19.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.985+0000 7f32e8f65700 1 --2- 172.21.15.40:0/1361414179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32e4139570 0x7f32e4119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:19.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.986+0000 7f32e3fff700 1 -- 172.21.15.40:0/1361414179 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f32e4136c50 msgr2=0x7f32e4119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:19.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.986+0000 7f32e3fff700 1 --2- 172.21.15.40:0/1361414179 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f32e4136c50 0x7f32e4119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:19.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.986+0000 7f32e3fff700 1 -- 172.21.15.40:0/1361414179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32e4139570 msgr2=0x7f32e4119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:19.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.986+0000 7f32e3fff700 1 --2- 172.21.15.40:0/1361414179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32e4139570 0x7f32e4119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:19.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.986+0000 7f32e3fff700 1 -- 172.21.15.40:0/1361414179 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d80094a0 con 0x7f32e4133e00 2023-09-30T22:26:19.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.986+0000 7f32e8f65700 1 --2- 172.21.15.40:0/1361414179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32e4139570 0x7f32e4119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:19.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.986+0000 7f32e3fff700 1 --2- 172.21.15.40:0/1361414179 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32e4133e00 0x7f32e4119050 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f32d400c470 tx=0x7f32d400c780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:19.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.986+0000 7f32e0ff9700 1 -- 172.21.15.40:0/1361414179 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d4004c80 con 0x7f32e4133e00 2023-09-30T22:26:19.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.986+0000 7f32e0ff9700 1 -- 172.21.15.40:0/1361414179 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d4004de0 con 0x7f32e4133e00 2023-09-30T22:26:19.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.986+0000 7f32e0ff9700 1 -- 172.21.15.40:0/1361414179 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d4007310 con 0x7f32e4133e00 2023-09-30T22:26:19.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.987+0000 7f32ea9c8700 1 -- 172.21.15.40:0/1361414179 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e412df10 con 0x7f32e4133e00 2023-09-30T22:26:19.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.987+0000 7f32ea9c8700 1 -- 172.21.15.40:0/1361414179 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e4130990 con 0x7f32e4133e00 2023-09-30T22:26:19.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.988+0000 7f32e0ff9700 1 -- 172.21.15.40:0/1361414179 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f32d4007470 con 0x7f32e4133e00 2023-09-30T22:26:19.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.988+0000 7f32ea9c8700 1 -- 172.21.15.40:0/1361414179 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32e4062380 con 0x7f32e4133e00 2023-09-30T22:26:19.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.988+0000 7f32e0ff9700 1 -- 172.21.15.40:0/1361414179 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f32d403f350 con 0x7f32e4133e00 2023-09-30T22:26:19.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:19.993+0000 7f32e0ff9700 1 -- 172.21.15.40:0/1361414179 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f32d4007720 con 0x7f32e4133e00 2023-09-30T22:26:20.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.024+0000 7f752b8f0700 1 Processor -- start 2023-09-30T22:26:20.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.025+0000 7f752b8f0700 1 -- start start 2023-09-30T22:26:20.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.025+0000 7f752b8f0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f752409d450 0x7f752409d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:20.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.025+0000 7f752b8f0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75241308d0 0x7f7524138420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:20.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.025+0000 7f752b8f0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f752409e8b0 con 0x7f752409dd60 2023-09-30T22:26:20.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.025+0000 7f752b8f0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f752409c3b0 con 0x7f752409d450 2023-09-30T22:26:20.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.025+0000 7f752b8f0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f752409a6b0 con 0x7f75241308d0 2023-09-30T22:26:20.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.025+0000 7f7529e8d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75241308d0 0x7f7524138420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:20.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.025+0000 7f7529e8d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75241308d0 0x7f7524138420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:53114/0 (socket says 172.21.15.40:53114) 2023-09-30T22:26:20.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.025+0000 7f7529e8d700 1 -- 172.21.15.40:0/1617203916 learned_addr learned my addr 172.21.15.40:0/1617203916 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:20.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.025+0000 7f752968c700 1 --2- 172.21.15.40:0/1617203916 >> v2:172.21.15.40:3300/0 conn(0x7f752409d450 0x7f752409d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:20.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.026+0000 7f7529e8d700 1 -- 172.21.15.40:0/1617203916 >> v2:172.21.15.40:3300/0 conn(0x7f752409d450 msgr2=0x7f752409d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:20.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.026+0000 7f7529e8d700 1 --2- 172.21.15.40:0/1617203916 >> v2:172.21.15.40:3300/0 conn(0x7f752409d450 0x7f752409d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.026+0000 7f7529e8d700 1 -- 172.21.15.40:0/1617203916 >> v1:172.21.15.40:6789/0 conn(0x7f752409dd60 legacy=0x7f75241301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.026+0000 7f7529e8d700 1 -- 172.21.15.40:0/1617203916 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752409b4f0 con 0x7f75241308d0 2023-09-30T22:26:20.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.026+0000 7f7529e8d700 1 --2- 172.21.15.40:0/1617203916 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75241308d0 0x7f7524138420 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f751c00d150 tx=0x7f751c00d460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6eb13af8b0a3e3b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:20.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.026+0000 7f751bfff700 1 -- 172.21.15.40:0/1617203916 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c010070 con 0x7f75241308d0 2023-09-30T22:26:20.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.026+0000 7f751bfff700 1 -- 172.21.15.40:0/1617203916 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751c00db00 con 0x7f75241308d0 2023-09-30T22:26:20.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.026+0000 7f751bfff700 1 -- 172.21.15.40:0/1617203916 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c016400 con 0x7f75241308d0 2023-09-30T22:26:20.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.027+0000 7f752b8f0700 1 -- 172.21.15.40:0/1617203916 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75241308d0 msgr2=0x7f7524138420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.027+0000 7f752b8f0700 1 --2- 172.21.15.40:0/1617203916 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75241308d0 0x7f7524138420 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f751c00d150 tx=0x7f751c00d460 comp rx=0 tx=0).stop 2023-09-30T22:26:20.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.027+0000 7f752b8f0700 1 -- 172.21.15.40:0/1617203916 shutdown_connections 2023-09-30T22:26:20.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.027+0000 7f752b8f0700 1 --2- 172.21.15.40:0/1617203916 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75241308d0 0x7f7524138420 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.027+0000 7f752b8f0700 1 --2- 172.21.15.40:0/1617203916 >> v2:172.21.15.40:3300/0 conn(0x7f752409d450 0x7f752409d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.027+0000 7f752b8f0700 1 -- 172.21.15.40:0/1617203916 >> 172.21.15.40:0/1617203916 conn(0x7f75240a2a00 msgr2=0x7f75240a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:20.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.027+0000 7f752b8f0700 1 -- 172.21.15.40:0/1617203916 shutdown_connections 2023-09-30T22:26:20.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.027+0000 7f752b8f0700 1 -- 172.21.15.40:0/1617203916 wait complete. 2023-09-30T22:26:20.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.028+0000 7f752b8f0700 1 Processor -- start 2023-09-30T22:26:20.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.028+0000 7f752b8f0700 1 -- start start 2023-09-30T22:26:20.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.028+0000 7f752b8f0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f752409d450 0x7f75241b9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:20.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.028+0000 7f752b8f0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f752409dd60 0x7f75241b97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:20.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.029+0000 7f752b8f0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75241308d0 0x7f75241b9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:20.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.029+0000 7f752b8f0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75241bb430 con 0x7f752409dd60 2023-09-30T22:26:20.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.029+0000 7f752b8f0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752411f100 con 0x7f75241308d0 2023-09-30T22:26:20.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.029+0000 7f752b8f0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f752411e740 con 0x7f752409d450 2023-09-30T22:26:20.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.029+0000 7f752968c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f752409d450 0x7f75241b9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:20.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.029+0000 7f752968c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f752409d450 0x7f75241b9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:53124/0 (socket says 172.21.15.40:53124) 2023-09-30T22:26:20.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.029+0000 7f752968c700 1 -- 172.21.15.40:0/1058792780 learned_addr learned my addr 172.21.15.40:0/1058792780 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:20.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.029+0000 7f7528e8b700 1 --2- 172.21.15.40:0/1058792780 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f752409dd60 0x7f75241b97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:20.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.029+0000 7f7529e8d700 1 --2- 172.21.15.40:0/1058792780 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75241308d0 0x7f75241b9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:20.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.029+0000 7f752968c700 1 -- 172.21.15.40:0/1058792780 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75241308d0 msgr2=0x7f75241b9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.029+0000 7f752968c700 1 --2- 172.21.15.40:0/1058792780 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75241308d0 0x7f75241b9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.029+0000 7f752968c700 1 -- 172.21.15.40:0/1058792780 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f752409dd60 msgr2=0x7f75241b97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.029+0000 7f752968c700 1 --2- 172.21.15.40:0/1058792780 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f752409dd60 0x7f75241b97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.029+0000 7f752968c700 1 -- 172.21.15.40:0/1058792780 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751c00bd40 con 0x7f752409d450 2023-09-30T22:26:20.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.029+0000 7f752968c700 1 --2- 172.21.15.40:0/1058792780 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f752409d450 0x7f75241b9260 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f752000e9e0 tx=0x7f752000ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:20.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.029+0000 7f7519ffb700 1 -- 172.21.15.40:0/1058792780 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7520009710 con 0x7f752409d450 2023-09-30T22:26:20.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.029+0000 7f7519ffb700 1 -- 172.21.15.40:0/1058792780 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752000ee80 con 0x7f752409d450 2023-09-30T22:26:20.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.029+0000 7f7519ffb700 1 -- 172.21.15.40:0/1058792780 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752000ca50 con 0x7f752409d450 2023-09-30T22:26:20.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.029+0000 7f752b8f0700 1 -- 172.21.15.40:0/1058792780 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f752411db10 con 0x7f752409d450 2023-09-30T22:26:20.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.030+0000 7f752b8f0700 1 -- 172.21.15.40:0/1058792780 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f752409c5d0 con 0x7f752409d450 2023-09-30T22:26:20.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.031+0000 7f7519ffb700 1 -- 172.21.15.40:0/1058792780 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f752000cbb0 con 0x7f752409d450 2023-09-30T22:26:20.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.031+0000 7f752b8f0700 1 -- 172.21.15.40:0/1058792780 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7524062380 con 0x7f752409d450 2023-09-30T22:26:20.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.031+0000 7f7519ffb700 1 -- 172.21.15.40:0/1058792780 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f752003f720 con 0x7f752409d450 2023-09-30T22:26:20.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.036+0000 7f040d3bd700 1 Processor -- start 2023-09-30T22:26:20.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.036+0000 7f040d3bd700 1 -- start start 2023-09-30T22:26:20.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.037+0000 7f040d3bd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0408133e00 0x7f04081341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:20.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.037+0000 7f040d3bd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f040809d400 0x7f040809d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:20.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.037+0000 7f040d3bd700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0408133940 con 0x7f040809dd70 2023-09-30T22:26:20.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.037+0000 7f040d3bd700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f040809f0d0 con 0x7f040809d400 2023-09-30T22:26:20.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.037+0000 7f040d3bd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f040809e210 con 0x7f0408133e00 2023-09-30T22:26:20.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.037+0000 7f0406ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0408133e00 0x7f04081341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:20.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.037+0000 7f0406ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0408133e00 0x7f04081341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:49000/0 (socket says 172.21.15.40:49000) 2023-09-30T22:26:20.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.037+0000 7f0406ffd700 1 -- 172.21.15.40:0/1952696133 learned_addr learned my addr 172.21.15.40:0/1952696133 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:20.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.037+0000 7f0406ffd700 1 -- 172.21.15.40:0/1952696133 >> v2:172.21.15.40:3300/0 conn(0x7f040809d400 msgr2=0x7f040809d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:20.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.037+0000 7f0406ffd700 1 --2- 172.21.15.40:0/1952696133 >> v2:172.21.15.40:3300/0 conn(0x7f040809d400 0x7f040809d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.037+0000 7f0406ffd700 1 -- 172.21.15.40:0/1952696133 >> v1:172.21.15.40:6789/0 conn(0x7f040809dd70 legacy=0x7f040813ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:20.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.037+0000 7f0406ffd700 1 -- 172.21.15.40:0/1952696133 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0408133be0 con 0x7f0408133e00 2023-09-30T22:26:20.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.037+0000 7f0406ffd700 1 --2- 172.21.15.40:0/1952696133 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0408133e00 0x7f04081341d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f03f80098f0 tx=0x7f03f8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22792e65f9c64225 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:20.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.038+0000 7f0405ffb700 1 -- 172.21.15.40:0/1952696133 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f8004230 con 0x7f0408133e00 2023-09-30T22:26:20.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.038+0000 7f0405ffb700 1 -- 172.21.15.40:0/1952696133 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f8004390 con 0x7f0408133e00 2023-09-30T22:26:20.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.038+0000 7f0405ffb700 1 -- 172.21.15.40:0/1952696133 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f80036a0 con 0x7f0408133e00 2023-09-30T22:26:20.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.038+0000 7f7519ffb700 1 -- 172.21.15.40:0/1058792780 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f75200232f0 con 0x7f752409d450 2023-09-30T22:26:20.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.039+0000 7f040d3bd700 1 -- 172.21.15.40:0/1952696133 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0408133e00 msgr2=0x7f04081341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.039+0000 7f040d3bd700 1 --2- 172.21.15.40:0/1952696133 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0408133e00 0x7f04081341d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f03f80098f0 tx=0x7f03f8009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:20.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.039+0000 7f040d3bd700 1 -- 172.21.15.40:0/1952696133 shutdown_connections 2023-09-30T22:26:20.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.039+0000 7f040d3bd700 1 --2- 172.21.15.40:0/1952696133 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0408133e00 0x7f04081341d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.039+0000 7f040d3bd700 1 --2- 172.21.15.40:0/1952696133 >> v2:172.21.15.40:3300/0 conn(0x7f040809d400 0x7f040809d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.039+0000 7f040d3bd700 1 -- 172.21.15.40:0/1952696133 >> 172.21.15.40:0/1952696133 conn(0x7f04080a2a00 msgr2=0x7f04080a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:20.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.039+0000 7f040d3bd700 1 -- 172.21.15.40:0/1952696133 shutdown_connections 2023-09-30T22:26:20.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.039+0000 7f040d3bd700 1 -- 172.21.15.40:0/1952696133 wait complete. 2023-09-30T22:26:20.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.040+0000 7f040d3bd700 1 Processor -- start 2023-09-30T22:26:20.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.040+0000 7f040d3bd700 1 -- start start 2023-09-30T22:26:20.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.041+0000 7f040d3bd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f040809d400 0x7f040811a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:20.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.041+0000 7f040d3bd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f040809dd70 0x7f040811ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:20.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.041+0000 7f040d3bd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0408133e00 0x7f040811b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:20.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.041+0000 7f040d3bd700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040811cb30 con 0x7f040809d400 2023-09-30T22:26:20.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.041+0000 7f040d3bd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f040811de80 con 0x7f040809dd70 2023-09-30T22:26:20.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.041+0000 7f040d3bd700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f040811c690 con 0x7f0408133e00 2023-09-30T22:26:20.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.041+0000 7f04077fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0408133e00 0x7f040811b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:20.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.041+0000 7f04077fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0408133e00 0x7f040811b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:53126/0 (socket says 172.21.15.40:53126) 2023-09-30T22:26:20.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.041+0000 7f04077fe700 1 -- 172.21.15.40:0/457950494 learned_addr learned my addr 172.21.15.40:0/457950494 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:20.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.041+0000 7f0406ffd700 1 --2- 172.21.15.40:0/457950494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f040809d400 0x7f040811a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:20.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.041+0000 7f04067fc700 1 --2- 172.21.15.40:0/457950494 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f040809dd70 0x7f040811ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:20.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.042+0000 7f04077fe700 1 -- 172.21.15.40:0/457950494 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f040809dd70 msgr2=0x7f040811ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.042+0000 7f04077fe700 1 --2- 172.21.15.40:0/457950494 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f040809dd70 0x7f040811ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.042+0000 7f04077fe700 1 -- 172.21.15.40:0/457950494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f040809d400 msgr2=0x7f040811a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.042+0000 7f04077fe700 1 --2- 172.21.15.40:0/457950494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f040809d400 0x7f040811a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.042+0000 7f04077fe700 1 -- 172.21.15.40:0/457950494 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f8009550 con 0x7f0408133e00 2023-09-30T22:26:20.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.042+0000 7f04077fe700 1 --2- 172.21.15.40:0/457950494 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0408133e00 0x7f040811b3d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f040000c7a0 tx=0x7f040000cab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:20.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.042+0000 7f03ef7fe700 1 -- 172.21.15.40:0/457950494 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0400003e10 con 0x7f0408133e00 2023-09-30T22:26:20.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.042+0000 7f03ef7fe700 1 -- 172.21.15.40:0/457950494 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0400005070 con 0x7f0408133e00 2023-09-30T22:26:20.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.042+0000 7f03ef7fe700 1 -- 172.21.15.40:0/457950494 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0400005420 con 0x7f0408133e00 2023-09-30T22:26:20.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.043+0000 7f040d3bd700 1 -- 172.21.15.40:0/457950494 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04080a1310 con 0x7f0408133e00 2023-09-30T22:26:20.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.043+0000 7f040d3bd700 1 -- 172.21.15.40:0/457950494 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f040811d760 con 0x7f0408133e00 2023-09-30T22:26:20.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.044+0000 7f03ef7fe700 1 -- 172.21.15.40:0/457950494 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0400005580 con 0x7f0408133e00 2023-09-30T22:26:20.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.044+0000 7f040d3bd700 1 -- 172.21.15.40:0/457950494 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0408062380 con 0x7f0408133e00 2023-09-30T22:26:20.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.044+0000 7f03ef7fe700 1 -- 172.21.15.40:0/457950494 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f040003eab0 con 0x7f0408133e00 2023-09-30T22:26:20.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.049+0000 7f03ef7fe700 1 -- 172.21.15.40:0/457950494 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0400005830 con 0x7f0408133e00 2023-09-30T22:26:20.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.082+0000 7f491bd36700 1 -- 172.21.15.40:0/2688040510 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4914074620 con 0x7f491409c890 2023-09-30T22:26:20.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.082+0000 7f490a7fc700 1 -- 172.21.15.40:0/2688040510 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f491002a020 con 0x7f491409c890 2023-09-30T22:26:20.083 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:20.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.085+0000 7f491bd36700 1 -- 172.21.15.40:0/2688040510 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f491409c890 msgr2=0x7f49141c89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.085+0000 7f491bd36700 1 --2- 172.21.15.40:0/2688040510 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f491409c890 0x7f49141c89e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f491409fc80 tx=0x7f4910004750 comp rx=0 tx=0).stop 2023-09-30T22:26:20.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.085+0000 7f491bd36700 1 -- 172.21.15.40:0/2688040510 shutdown_connections 2023-09-30T22:26:20.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.085+0000 7f491bd36700 1 --2- 172.21.15.40:0/2688040510 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f491409e2b0 0x7f49141c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.085+0000 7f491bd36700 1 --2- 172.21.15.40:0/2688040510 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f491409c890 0x7f49141c89e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.085+0000 7f491bd36700 1 --2- 172.21.15.40:0/2688040510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f491409d920 0x7f49141c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.085+0000 7f491bd36700 1 -- 172.21.15.40:0/2688040510 >> 172.21.15.40:0/2688040510 conn(0x7f49140a7080 msgr2=0x7f49140a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:20.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.085+0000 7f491bd36700 1 -- 172.21.15.40:0/2688040510 shutdown_connections 2023-09-30T22:26:20.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.085+0000 7f491bd36700 1 -- 172.21.15.40:0/2688040510 wait complete. 2023-09-30T22:26:20.103 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:20.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.196+0000 7f32ea9c8700 1 -- 172.21.15.40:0/1361414179 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f32e41366c0 con 0x7f32e4133e00 2023-09-30T22:26:20.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.197+0000 7f32e0ff9700 1 -- 172.21.15.40:0/1361414179 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f32d4011360 con 0x7f32e4133e00 2023-09-30T22:26:20.198 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:20.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.198+0000 7f32ea9c8700 1 -- 172.21.15.40:0/1361414179 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32e4133e00 msgr2=0x7f32e4119050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.198+0000 7f32ea9c8700 1 --2- 172.21.15.40:0/1361414179 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32e4133e00 0x7f32e4119050 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f32d400c470 tx=0x7f32d400c780 comp rx=0 tx=0).stop 2023-09-30T22:26:20.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.198+0000 7f32ea9c8700 1 -- 172.21.15.40:0/1361414179 shutdown_connections 2023-09-30T22:26:20.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.199+0000 7f32ea9c8700 1 --2- 172.21.15.40:0/1361414179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32e4139570 0x7f32e4119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.199+0000 7f32ea9c8700 1 --2- 172.21.15.40:0/1361414179 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32e4133e00 0x7f32e4119050 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.199+0000 7f32ea9c8700 1 --2- 172.21.15.40:0/1361414179 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f32e4136c50 0x7f32e4119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.199+0000 7f32ea9c8700 1 -- 172.21.15.40:0/1361414179 >> 172.21.15.40:0/1361414179 conn(0x7f32e40a2a00 msgr2=0x7f32e4134a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:20.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.199+0000 7f32ea9c8700 1 -- 172.21.15.40:0/1361414179 shutdown_connections 2023-09-30T22:26:20.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.199+0000 7f32ea9c8700 1 -- 172.21.15.40:0/1361414179 wait complete. 2023-09-30T22:26:20.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:20.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.237+0000 7f752b8f0700 1 -- 172.21.15.40:0/1058792780 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7524074330 con 0x7f752409d450 2023-09-30T22:26:20.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.237+0000 7f7519ffb700 1 -- 172.21.15.40:0/1058792780 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f752001ae80 con 0x7f752409d450 2023-09-30T22:26:20.238 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:20.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.240+0000 7f752b8f0700 1 -- 172.21.15.40:0/1058792780 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f752409d450 msgr2=0x7f75241b9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.240+0000 7f752b8f0700 1 --2- 172.21.15.40:0/1058792780 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f752409d450 0x7f75241b9260 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f752000e9e0 tx=0x7f752000ecf0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.240+0000 7f752b8f0700 1 -- 172.21.15.40:0/1058792780 shutdown_connections 2023-09-30T22:26:20.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.240+0000 7f752b8f0700 1 --2- 172.21.15.40:0/1058792780 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f752409d450 0x7f75241b9260 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.240+0000 7f752b8f0700 1 --2- 172.21.15.40:0/1058792780 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75241308d0 0x7f75241b9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.240+0000 7f752b8f0700 1 --2- 172.21.15.40:0/1058792780 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f752409dd60 0x7f75241b97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.240+0000 7f752b8f0700 1 -- 172.21.15.40:0/1058792780 >> 172.21.15.40:0/1058792780 conn(0x7f75240a2a00 msgr2=0x7f752412fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:20.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.240+0000 7f752b8f0700 1 -- 172.21.15.40:0/1058792780 shutdown_connections 2023-09-30T22:26:20.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.240+0000 7f752b8f0700 1 -- 172.21.15.40:0/1058792780 wait complete. 2023-09-30T22:26:20.252 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:20.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.271+0000 7f040d3bd700 1 -- 172.21.15.40:0/457950494 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f040811e200 con 0x7f0408133e00 2023-09-30T22:26:20.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.271+0000 7f03ef7fe700 1 -- 172.21.15.40:0/457950494 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0400017090 con 0x7f0408133e00 2023-09-30T22:26:20.272 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:20.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.273+0000 7f040d3bd700 1 -- 172.21.15.40:0/457950494 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0408133e00 msgr2=0x7f040811b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.273+0000 7f040d3bd700 1 --2- 172.21.15.40:0/457950494 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0408133e00 0x7f040811b3d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f040000c7a0 tx=0x7f040000cab0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.274+0000 7f040d3bd700 1 -- 172.21.15.40:0/457950494 shutdown_connections 2023-09-30T22:26:20.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.274+0000 7f040d3bd700 1 --2- 172.21.15.40:0/457950494 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0408133e00 0x7f040811b3d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.274+0000 7f040d3bd700 1 --2- 172.21.15.40:0/457950494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f040809d400 0x7f040811a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.274+0000 7f040d3bd700 1 --2- 172.21.15.40:0/457950494 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f040809dd70 0x7f040811ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.274+0000 7f040d3bd700 1 -- 172.21.15.40:0/457950494 >> 172.21.15.40:0/457950494 conn(0x7f04080a2a00 msgr2=0x7f04081b9950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:20.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.274+0000 7f040d3bd700 1 -- 172.21.15.40:0/457950494 shutdown_connections 2023-09-30T22:26:20.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:20.274+0000 7f040d3bd700 1 -- 172.21.15.40:0/457950494 wait complete. 2023-09-30T22:26:20.287 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:21.104 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:21.212 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:21.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.246+0000 7fe0c1b1f700 1 Processor -- start 2023-09-30T22:26:21.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.247+0000 7fe0c1b1f700 1 -- start start 2023-09-30T22:26:21.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.247+0000 7fe0c1b1f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0bc09fbb0 0x7fe0bc06c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.247+0000 7fe0c1b1f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe0bc06ced0 0x7fe0bc06d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.247+0000 7fe0c1b1f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe0bc138370 0x7fe0bc13a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.247+0000 7fe0c1b1f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0bc09ff80 con 0x7fe0bc138370 2023-09-30T22:26:21.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.247+0000 7fe0c1b1f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc06ec40 con 0x7fe0bc09fbb0 2023-09-30T22:26:21.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.247+0000 7fe0c1b1f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc06f510 con 0x7fe0bc06ced0 2023-09-30T22:26:21.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.247+0000 7fe0bb7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0bc09fbb0 0x7fe0bc06c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.247+0000 7fe0baffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe0bc06ced0 0x7fe0bc06d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.247+0000 7fe0bbfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe0bc138370 0x7fe0bc13a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.247+0000 7fe0baffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe0bc06ced0 0x7fe0bc06d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:53128/0 (socket says 172.21.15.40:53128) 2023-09-30T22:26:21.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.247+0000 7fe0bb7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0bc09fbb0 0x7fe0bc06c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:49014/0 (socket says 172.21.15.40:49014) 2023-09-30T22:26:21.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.247+0000 7fe0baffd700 1 -- 172.21.15.40:0/3768907726 learned_addr learned my addr 172.21.15.40:0/3768907726 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:21.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.247+0000 7fe0bbfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe0bc138370 0x7fe0bc13a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43852/0 (socket says 172.21.15.40:43852) 2023-09-30T22:26:21.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.248+0000 7fe0bb7fe700 1 -- 172.21.15.40:0/3768907726 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe0bc06ced0 msgr2=0x7fe0bc06d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:21.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.248+0000 7fe0bb7fe700 1 --2- 172.21.15.40:0/3768907726 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe0bc06ced0 0x7fe0bc06d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.248+0000 7fe0bb7fe700 1 -- 172.21.15.40:0/3768907726 >> v2:172.21.15.40:3300/0 conn(0x7fe0bc138370 msgr2=0x7fe0bc13a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:21.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.248+0000 7fe0bb7fe700 1 --2- 172.21.15.40:0/3768907726 >> v2:172.21.15.40:3300/0 conn(0x7fe0bc138370 0x7fe0bc13a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.248+0000 7fe0bb7fe700 1 -- 172.21.15.40:0/3768907726 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0bc06e3f0 con 0x7fe0bc09fbb0 2023-09-30T22:26:21.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.248+0000 7fe0baffd700 1 --2- 172.21.15.40:0/3768907726 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe0bc06ced0 0x7fe0bc06d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:21.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.248+0000 7fe0bb7fe700 1 --2- 172.21.15.40:0/3768907726 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0bc09fbb0 0x7fe0bc06c990 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac009870 tx=0x7fe0ac009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e9547a81ad305c4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:21.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.248+0000 7fe0ba7fc700 1 -- 172.21.15.40:0/3768907726 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac011830 con 0x7fe0bc09fbb0 2023-09-30T22:26:21.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.248+0000 7fe0ba7fc700 1 -- 172.21.15.40:0/3768907726 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ac011990 con 0x7fe0bc09fbb0 2023-09-30T22:26:21.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.248+0000 7fe0ba7fc700 1 -- 172.21.15.40:0/3768907726 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac011d20 con 0x7fe0bc09fbb0 2023-09-30T22:26:21.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.248+0000 7fe0c1b1f700 1 -- 172.21.15.40:0/3768907726 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0bc09fbb0 msgr2=0x7fe0bc06c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.249+0000 7fe0c1b1f700 1 --2- 172.21.15.40:0/3768907726 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0bc09fbb0 0x7fe0bc06c990 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac009870 tx=0x7fe0ac009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:21.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.249+0000 7fe0c1b1f700 1 -- 172.21.15.40:0/3768907726 shutdown_connections 2023-09-30T22:26:21.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.249+0000 7fe0c1b1f700 1 --2- 172.21.15.40:0/3768907726 >> v2:172.21.15.40:3300/0 conn(0x7fe0bc138370 0x7fe0bc13a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.249+0000 7fe0c1b1f700 1 --2- 172.21.15.40:0/3768907726 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0bc09fbb0 0x7fe0bc06c990 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.249+0000 7fe0c1b1f700 1 --2- 172.21.15.40:0/3768907726 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe0bc06ced0 0x7fe0bc06d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.249+0000 7fe0c1b1f700 1 -- 172.21.15.40:0/3768907726 >> 172.21.15.40:0/3768907726 conn(0x7fe0bc0a41a0 msgr2=0x7fe0bc0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:21.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.249+0000 7fe0c1b1f700 1 -- 172.21.15.40:0/3768907726 shutdown_connections 2023-09-30T22:26:21.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.249+0000 7fe0c1b1f700 1 -- 172.21.15.40:0/3768907726 wait complete. 2023-09-30T22:26:21.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.250+0000 7fe0c1b1f700 1 Processor -- start 2023-09-30T22:26:21.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.250+0000 7fe0c1b1f700 1 -- start start 2023-09-30T22:26:21.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.250+0000 7fe0c1b1f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0bc06ced0 0x7fe0bc137a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.250+0000 7fe0c1b1f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe0bc09fbb0 0x7fe0bc095a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.250+0000 7fe0c1b1f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0bc138370 0x7fe0bc095f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.250+0000 7fe0c1b1f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc0945c0 con 0x7fe0bc138370 2023-09-30T22:26:21.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.250+0000 7fe0c1b1f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc096bc0 con 0x7fe0bc06ced0 2023-09-30T22:26:21.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.250+0000 7fe0c1b1f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc094910 con 0x7fe0bc09fbb0 2023-09-30T22:26:21.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.250+0000 7fe0bb7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0bc06ced0 0x7fe0bc137a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.250+0000 7fe0baffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe0bc09fbb0 0x7fe0bc095a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.250+0000 7fe0bb7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0bc06ced0 0x7fe0bc137a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:49024/0 (socket says 172.21.15.40:49024) 2023-09-30T22:26:21.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.250+0000 7fe0baffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe0bc09fbb0 0x7fe0bc095a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:53138/0 (socket says 172.21.15.40:53138) 2023-09-30T22:26:21.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.250+0000 7fe0bb7fe700 1 -- 172.21.15.40:0/2922218532 learned_addr learned my addr 172.21.15.40:0/2922218532 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:21.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.251+0000 7fe0bbfff700 1 --2- 172.21.15.40:0/2922218532 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0bc138370 0x7fe0bc095f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.251+0000 7fe0bb7fe700 1 -- 172.21.15.40:0/2922218532 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe0bc09fbb0 msgr2=0x7fe0bc095a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.251+0000 7fe0bb7fe700 1 --2- 172.21.15.40:0/2922218532 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe0bc09fbb0 0x7fe0bc095a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.251+0000 7fe0bb7fe700 1 -- 172.21.15.40:0/2922218532 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0bc138370 msgr2=0x7fe0bc095f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.251+0000 7fe0bb7fe700 1 --2- 172.21.15.40:0/2922218532 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0bc138370 0x7fe0bc095f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.251+0000 7fe0bb7fe700 1 -- 172.21.15.40:0/2922218532 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b0009550 con 0x7fe0bc06ced0 2023-09-30T22:26:21.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.251+0000 7fe0baffd700 1 --2- 172.21.15.40:0/2922218532 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe0bc09fbb0 0x7fe0bc095a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:21.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.251+0000 7fe0bb7fe700 1 --2- 172.21.15.40:0/2922218532 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0bc06ced0 0x7fe0bc137a80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac0090b0 tx=0x7fe0ac004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:21.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.251+0000 7fe0a3fff700 1 -- 172.21.15.40:0/2922218532 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac004450 con 0x7fe0bc06ced0 2023-09-30T22:26:21.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.251+0000 7fe0a3fff700 1 -- 172.21.15.40:0/2922218532 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ac01f070 con 0x7fe0bc06ced0 2023-09-30T22:26:21.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.251+0000 7fe0c1b1f700 1 -- 172.21.15.40:0/2922218532 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0ac0094a0 con 0x7fe0bc06ced0 2023-09-30T22:26:21.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.251+0000 7fe0a3fff700 1 -- 172.21.15.40:0/2922218532 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac0038e0 con 0x7fe0bc06ced0 2023-09-30T22:26:21.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.251+0000 7fe0c1b1f700 1 -- 172.21.15.40:0/2922218532 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0bc0955b0 con 0x7fe0bc06ced0 2023-09-30T22:26:21.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.252+0000 7fe0a3fff700 1 -- 172.21.15.40:0/2922218532 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe0ac003a40 con 0x7fe0bc06ced0 2023-09-30T22:26:21.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.252+0000 7fe0c1b1f700 1 -- 172.21.15.40:0/2922218532 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0bc062380 con 0x7fe0bc06ced0 2023-09-30T22:26:21.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.252+0000 7fe0a3fff700 1 -- 172.21.15.40:0/2922218532 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe0ac021070 con 0x7fe0bc06ced0 2023-09-30T22:26:21.258 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:21.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.257+0000 7fe0a3fff700 1 -- 172.21.15.40:0/2922218532 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe0ac024380 con 0x7fe0bc06ced0 2023-09-30T22:26:21.289 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:21.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.352+0000 7f9e7f697700 1 Processor -- start 2023-09-30T22:26:21.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.352+0000 7f9e7f697700 1 -- start start 2023-09-30T22:26:21.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.352+0000 7f9e7f697700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e78131d50 0x7f9e78132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.352+0000 7f9e7f697700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9e7809bc50 0x7f9e7809c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.352+0000 7f9e7f697700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e7809c600 0x7f9e78138ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.352+0000 7f9e7f697700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e78071920 con 0x7f9e7809bc50 2023-09-30T22:26:21.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.352+0000 7f9e7f697700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e78132660 con 0x7f9e78131d50 2023-09-30T22:26:21.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.352+0000 7f9e7f697700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e78131900 con 0x7f9e7809c600 2023-09-30T22:26:21.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.353+0000 7f9e7cc32700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9e7809bc50 0x7f9e7809c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.353+0000 7f9e7dc34700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e7809c600 0x7f9e78138ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.353+0000 7f9e7cc32700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9e7809bc50 0x7f9e7809c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43866/0 (socket says 172.21.15.40:43866) 2023-09-30T22:26:21.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.353+0000 7f9e7cc32700 1 -- 172.21.15.40:0/1392251117 learned_addr learned my addr 172.21.15.40:0/1392251117 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:21.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.353+0000 7f9e7d433700 1 --2- 172.21.15.40:0/1392251117 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e78131d50 0x7f9e78132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.353+0000 7f9e7cc32700 1 -- 172.21.15.40:0/1392251117 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e7809c600 msgr2=0x7f9e78138ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:21.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.353+0000 7f9e7cc32700 1 --2- 172.21.15.40:0/1392251117 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e7809c600 0x7f9e78138ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.353+0000 7f9e7cc32700 1 -- 172.21.15.40:0/1392251117 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e78131d50 msgr2=0x7f9e78132120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:21.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.353+0000 7f9e7cc32700 1 --2- 172.21.15.40:0/1392251117 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e78131d50 0x7f9e78132120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.353+0000 7f9e7cc32700 1 -- 172.21.15.40:0/1392251117 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e7809e820 con 0x7f9e7809bc50 2023-09-30T22:26:21.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.353+0000 7f9e7dc34700 1 --2- 172.21.15.40:0/1392251117 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e7809c600 0x7f9e78138ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:21.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.353+0000 7f9e7d433700 1 --2- 172.21.15.40:0/1392251117 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e78131d50 0x7f9e78132120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:26:21.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.353+0000 7f9e7cc32700 1 --2- 172.21.15.40:0/1392251117 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e7809bc50 0x7f9e7809c0c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f9e680098f0 tx=0x7f9e68009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd67684aea45fa46 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:21.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.353+0000 7f9e6ffff700 1 -- 172.21.15.40:0/1392251117 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e68011830 con 0x7f9e7809bc50 2023-09-30T22:26:21.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.354+0000 7f9e6ffff700 1 -- 172.21.15.40:0/1392251117 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e68011990 con 0x7f9e7809bc50 2023-09-30T22:26:21.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.354+0000 7f9e6ffff700 1 -- 172.21.15.40:0/1392251117 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e68011d20 con 0x7f9e7809bc50 2023-09-30T22:26:21.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.354+0000 7f9e7f697700 1 -- 172.21.15.40:0/1392251117 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e7809bc50 msgr2=0x7f9e7809c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.354+0000 7f9e7f697700 1 --2- 172.21.15.40:0/1392251117 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e7809bc50 0x7f9e7809c0c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f9e680098f0 tx=0x7f9e68009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:21.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.354+0000 7f9e7f697700 1 -- 172.21.15.40:0/1392251117 shutdown_connections 2023-09-30T22:26:21.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.354+0000 7f9e7f697700 1 --2- 172.21.15.40:0/1392251117 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e7809c600 0x7f9e78138ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.354+0000 7f9e7f697700 1 --2- 172.21.15.40:0/1392251117 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e78131d50 0x7f9e78132120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.354+0000 7f9e7f697700 1 --2- 172.21.15.40:0/1392251117 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e7809bc50 0x7f9e7809c0c0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.354+0000 7f9e7f697700 1 -- 172.21.15.40:0/1392251117 >> 172.21.15.40:0/1392251117 conn(0x7f9e780a2a00 msgr2=0x7f9e780a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:21.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.354+0000 7f9e7f697700 1 -- 172.21.15.40:0/1392251117 shutdown_connections 2023-09-30T22:26:21.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.354+0000 7f9e7f697700 1 -- 172.21.15.40:0/1392251117 wait complete. 2023-09-30T22:26:21.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.355+0000 7f9e7f697700 1 Processor -- start 2023-09-30T22:26:21.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.355+0000 7f9e7f697700 1 -- start start 2023-09-30T22:26:21.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.356+0000 7f9e7f697700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e7809bc50 0x7f9e78119b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.356+0000 7f9e7f697700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e7809c600 0x7f9e7811a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.356+0000 7f9e7f697700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e78131d50 0x7f9e7811a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.356+0000 7f9e7f697700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7811aff0 con 0x7f9e7809c600 2023-09-30T22:26:21.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.356+0000 7f9e7f697700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7811bce0 con 0x7f9e7809bc50 2023-09-30T22:26:21.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.356+0000 7f9e7f697700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7811d5a0 con 0x7f9e78131d50 2023-09-30T22:26:21.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.356+0000 7f9e7dc34700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e78131d50 0x7f9e7811a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.356+0000 7f9e7dc34700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e78131d50 0x7f9e7811a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:53148/0 (socket says 172.21.15.40:53148) 2023-09-30T22:26:21.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.356+0000 7f9e7dc34700 1 -- 172.21.15.40:0/2274514375 learned_addr learned my addr 172.21.15.40:0/2274514375 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:21.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.356+0000 7f9e7d433700 1 --2- 172.21.15.40:0/2274514375 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e7809bc50 0x7f9e78119b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.356+0000 7f9e7dc34700 1 -- 172.21.15.40:0/2274514375 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e7809bc50 msgr2=0x7f9e78119b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.356+0000 7f9e7dc34700 1 --2- 172.21.15.40:0/2274514375 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e7809bc50 0x7f9e78119b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.356+0000 7f9e7dc34700 1 -- 172.21.15.40:0/2274514375 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e7809c600 msgr2=0x7f9e7811a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.356+0000 7f9e7dc34700 1 --2- 172.21.15.40:0/2274514375 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e7809c600 0x7f9e7811a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.357+0000 7f9e7dc34700 1 -- 172.21.15.40:0/2274514375 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e70009a70 con 0x7f9e78131d50 2023-09-30T22:26:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.357+0000 7f9e7dc34700 1 --2- 172.21.15.40:0/2274514375 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e78131d50 0x7f9e7811a5a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9e7000ef00 tx=0x7f9e7000b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.357+0000 7f9e6dffb700 1 -- 172.21.15.40:0/2274514375 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e70010040 con 0x7f9e78131d50 2023-09-30T22:26:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.357+0000 7f9e6dffb700 1 -- 172.21.15.40:0/2274514375 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7000bb30 con 0x7f9e78131d50 2023-09-30T22:26:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.357+0000 7f9e6dffb700 1 -- 172.21.15.40:0/2274514375 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e70003a20 con 0x7f9e78131d50 2023-09-30T22:26:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.357+0000 7f9e7f697700 1 -- 172.21.15.40:0/2274514375 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e68009550 con 0x7f9e78131d50 2023-09-30T22:26:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.357+0000 7f9e7f697700 1 -- 172.21.15.40:0/2274514375 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e7812ecd0 con 0x7f9e78131d50 2023-09-30T22:26:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.358+0000 7f9e7f697700 1 -- 172.21.15.40:0/2274514375 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e7809eac0 con 0x7f9e78131d50 2023-09-30T22:26:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.359+0000 7f9e6dffb700 1 -- 172.21.15.40:0/2274514375 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9e7001d410 con 0x7f9e78131d50 2023-09-30T22:26:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.359+0000 7f9e6dffb700 1 -- 172.21.15.40:0/2274514375 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9e70047350 con 0x7f9e78131d50 2023-09-30T22:26:21.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.367+0000 7f9e6dffb700 1 -- 172.21.15.40:0/2274514375 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9e70044060 con 0x7f9e78131d50 2023-09-30T22:26:21.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.391+0000 7fe731192700 1 Processor -- start 2023-09-30T22:26:21.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.391+0000 7fe731192700 1 -- start start 2023-09-30T22:26:21.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.392+0000 7fe731192700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe72c09d920 0x7fe72c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.392+0000 7fe731192700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe72c09f0f0 0x7fe72c09e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.392+0000 7fe731192700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe72c133ca0 0x7fe72c134110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.392+0000 7fe731192700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe72c06b4c0 con 0x7fe72c09d920 2023-09-30T22:26:21.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.392+0000 7fe731192700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe72c09a8f0 con 0x7fe72c09f0f0 2023-09-30T22:26:21.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.392+0000 7fe731192700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe72c09f940 con 0x7fe72c133ca0 2023-09-30T22:26:21.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.392+0000 7fe72b59e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe72c133ca0 0x7fe72c134110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.392+0000 7fe72b59e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe72c133ca0 0x7fe72c134110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:53160/0 (socket says 172.21.15.40:53160) 2023-09-30T22:26:21.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.392+0000 7fe72b59e700 1 -- 172.21.15.40:0/454430613 learned_addr learned my addr 172.21.15.40:0/454430613 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:21.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.392+0000 7fe72ad9d700 1 --2- 172.21.15.40:0/454430613 >> v2:172.21.15.40:3300/0 conn(0x7fe72c09d920 0x7fe72c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.392+0000 7fe72a59c700 1 --2- 172.21.15.40:0/454430613 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe72c09f0f0 0x7fe72c09e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.393+0000 7fe72b59e700 1 -- 172.21.15.40:0/454430613 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe72c09f0f0 msgr2=0x7fe72c09e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:21.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.393+0000 7fe72b59e700 1 --2- 172.21.15.40:0/454430613 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe72c09f0f0 0x7fe72c09e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.393+0000 7fe72b59e700 1 -- 172.21.15.40:0/454430613 >> v2:172.21.15.40:3300/0 conn(0x7fe72c09d920 msgr2=0x7fe72c09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:21.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.393+0000 7fe72b59e700 1 --2- 172.21.15.40:0/454430613 >> v2:172.21.15.40:3300/0 conn(0x7fe72c09d920 0x7fe72c09dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.393+0000 7fe72b59e700 1 -- 172.21.15.40:0/454430613 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe72c09f6e0 con 0x7fe72c133ca0 2023-09-30T22:26:21.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.393+0000 7fe72ad9d700 1 --2- 172.21.15.40:0/454430613 >> v2:172.21.15.40:3300/0 conn(0x7fe72c09d920 0x7fe72c09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:21.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.393+0000 7fe72b59e700 1 --2- 172.21.15.40:0/454430613 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe72c133ca0 0x7fe72c134110 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe724009e80 tx=0x7fe72400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78a111ae4a9d2bec server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:21.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.393+0000 7fe729d9b700 1 -- 172.21.15.40:0/454430613 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72400e070 con 0x7fe72c133ca0 2023-09-30T22:26:21.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.393+0000 7fe729d9b700 1 -- 172.21.15.40:0/454430613 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72400b8d0 con 0x7fe72c133ca0 2023-09-30T22:26:21.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.393+0000 7fe729d9b700 1 -- 172.21.15.40:0/454430613 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72400bc80 con 0x7fe72c133ca0 2023-09-30T22:26:21.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.394+0000 7fe731192700 1 -- 172.21.15.40:0/454430613 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe72c133ca0 msgr2=0x7fe72c134110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.394+0000 7fe731192700 1 --2- 172.21.15.40:0/454430613 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe72c133ca0 0x7fe72c134110 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe724009e80 tx=0x7fe72400b330 comp rx=0 tx=0).stop 2023-09-30T22:26:21.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.394+0000 7fe731192700 1 -- 172.21.15.40:0/454430613 shutdown_connections 2023-09-30T22:26:21.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.394+0000 7fe731192700 1 --2- 172.21.15.40:0/454430613 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe72c133ca0 0x7fe72c134110 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.394+0000 7fe731192700 1 --2- 172.21.15.40:0/454430613 >> v2:172.21.15.40:3300/0 conn(0x7fe72c09d920 0x7fe72c09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.394+0000 7fe731192700 1 --2- 172.21.15.40:0/454430613 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe72c09f0f0 0x7fe72c09e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.394+0000 7fe731192700 1 -- 172.21.15.40:0/454430613 >> 172.21.15.40:0/454430613 conn(0x7fe72c09fb20 msgr2=0x7fe72c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:21.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.394+0000 7fe731192700 1 -- 172.21.15.40:0/454430613 shutdown_connections 2023-09-30T22:26:21.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.394+0000 7fe731192700 1 -- 172.21.15.40:0/454430613 wait complete. 2023-09-30T22:26:21.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.395+0000 7fe731192700 1 Processor -- start 2023-09-30T22:26:21.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.395+0000 7fe731192700 1 -- start start 2023-09-30T22:26:21.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.396+0000 7fe731192700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe72c09d920 0x7fe72c122cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.396+0000 7fe731192700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe72c133ca0 0x7fe72c123210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.396+0000 7fe731192700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe72c123750 0x7fe72c1c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.396+0000 7fe731192700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72c1240c0 con 0x7fe72c133ca0 2023-09-30T22:26:21.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.396+0000 7fe731192700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe72c1246a0 con 0x7fe72c123750 2023-09-30T22:26:21.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.396+0000 7fe731192700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe72c1263b0 con 0x7fe72c09d920 2023-09-30T22:26:21.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.396+0000 7fe72ad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe72c09d920 0x7fe72c122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.396+0000 7fe72a59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe72c133ca0 0x7fe72c123210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.396+0000 7fe72b59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe72c123750 0x7fe72c1c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.396+0000 7fe72ad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe72c09d920 0x7fe72c122cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:53166/0 (socket says 172.21.15.40:53166) 2023-09-30T22:26:21.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.396+0000 7fe72ad9d700 1 -- 172.21.15.40:0/186670390 learned_addr learned my addr 172.21.15.40:0/186670390 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:21.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.396+0000 7fe72a59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe72c133ca0 0x7fe72c123210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43894/0 (socket says 172.21.15.40:43894) 2023-09-30T22:26:21.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.396+0000 7fe72ad9d700 1 -- 172.21.15.40:0/186670390 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe72c123750 msgr2=0x7fe72c1c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.396+0000 7fe72ad9d700 1 --2- 172.21.15.40:0/186670390 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe72c123750 0x7fe72c1c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.396+0000 7fe72ad9d700 1 -- 172.21.15.40:0/186670390 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe72c133ca0 msgr2=0x7fe72c123210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.396+0000 7fe72ad9d700 1 --2- 172.21.15.40:0/186670390 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe72c133ca0 0x7fe72c123210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.396+0000 7fe72ad9d700 1 -- 172.21.15.40:0/186670390 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe71c009430 con 0x7fe72c09d920 2023-09-30T22:26:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.396+0000 7fe72a59c700 1 --2- 172.21.15.40:0/186670390 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe72c133ca0 0x7fe72c123210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.396+0000 7fe72ad9d700 1 --2- 172.21.15.40:0/186670390 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe72c09d920 0x7fe72c122cd0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe71c00e960 tx=0x7fe71c00ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.397+0000 7fe7137fe700 1 -- 172.21.15.40:0/186670390 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c0096c0 con 0x7fe72c09d920 2023-09-30T22:26:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.397+0000 7fe7137fe700 1 -- 172.21.15.40:0/186670390 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71c005a20 con 0x7fe72c09d920 2023-09-30T22:26:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.397+0000 7fe731192700 1 -- 172.21.15.40:0/186670390 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe724009b30 con 0x7fe72c09d920 2023-09-30T22:26:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.397+0000 7fe7137fe700 1 -- 172.21.15.40:0/186670390 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c005db0 con 0x7fe72c09d920 2023-09-30T22:26:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.397+0000 7fe731192700 1 -- 172.21.15.40:0/186670390 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe72c124ca0 con 0x7fe72c09d920 2023-09-30T22:26:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.398+0000 7fe7137fe700 1 -- 172.21.15.40:0/186670390 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe71c013680 con 0x7fe72c09d920 2023-09-30T22:26:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.398+0000 7fe7137fe700 1 -- 172.21.15.40:0/186670390 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe71c03f8e0 con 0x7fe72c09d920 2023-09-30T22:26:21.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.399+0000 7fe731192700 1 -- 172.21.15.40:0/186670390 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe72c062380 con 0x7fe72c09d920 2023-09-30T22:26:21.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.408+0000 7fe7137fe700 1 -- 172.21.15.40:0/186670390 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe71c013930 con 0x7fe72c09d920 2023-09-30T22:26:21.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.442+0000 7f939e927700 1 Processor -- start 2023-09-30T22:26:21.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.442+0000 7f939e927700 1 -- start start 2023-09-30T22:26:21.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.443+0000 7f939e927700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f939809f0f0 0x7f9398138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.443+0000 7f939e927700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f939809e400 0x7f939813b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.443+0000 7f939e927700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f939809f940 con 0x7f939809d920 2023-09-30T22:26:21.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.443+0000 7f939e927700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f939806b4c0 con 0x7f939809e400 2023-09-30T22:26:21.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.443+0000 7f939e927700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f939809a8f0 con 0x7f939809f0f0 2023-09-30T22:26:21.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.443+0000 7f93977fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f939809f0f0 0x7f9398138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.443+0000 7f93977fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f939809f0f0 0x7f9398138ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:53180/0 (socket says 172.21.15.40:53180) 2023-09-30T22:26:21.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.443+0000 7f93977fe700 1 -- 172.21.15.40:0/1412584347 learned_addr learned my addr 172.21.15.40:0/1412584347 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:21.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.443+0000 7f939cec4700 1 --2- 172.21.15.40:0/1412584347 >> v2:172.21.15.40:3300/0 conn(0x7f939809e400 0x7f939813b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.443+0000 7f93977fe700 1 -- 172.21.15.40:0/1412584347 >> v2:172.21.15.40:3300/0 conn(0x7f939809e400 msgr2=0x7f939813b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:21.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.443+0000 7f93977fe700 1 --2- 172.21.15.40:0/1412584347 >> v2:172.21.15.40:3300/0 conn(0x7f939809e400 0x7f939813b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.443+0000 7f93977fe700 1 -- 172.21.15.40:0/1412584347 >> v1:172.21.15.40:6789/0 conn(0x7f939809d920 legacy=0x7f939809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.443+0000 7f93977fe700 1 -- 172.21.15.40:0/1412584347 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f939809f6e0 con 0x7f939809f0f0 2023-09-30T22:26:21.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.443+0000 7f9396ffd700 1 -- 172.21.15.40:0/1412584347 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 527949268 0 0) 0x7f939809f940 con 0x7f939809d920 2023-09-30T22:26:21.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.443+0000 7f939cec4700 1 --2- 172.21.15.40:0/1412584347 >> v2:172.21.15.40:3300/0 conn(0x7f939809e400 0x7f939813b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:21.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.444+0000 7f93977fe700 1 --2- 172.21.15.40:0/1412584347 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f939809f0f0 0x7f9398138ee0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f938c0098f0 tx=0x7f938c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbe2b26ff0dbcff server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:21.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.444+0000 7f9396ffd700 1 -- 172.21.15.40:0/1412584347 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c011830 con 0x7f939809f0f0 2023-09-30T22:26:21.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.444+0000 7f9396ffd700 1 -- 172.21.15.40:0/1412584347 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938c011990 con 0x7f939809f0f0 2023-09-30T22:26:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.444+0000 7f9396ffd700 1 -- 172.21.15.40:0/1412584347 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c011d20 con 0x7f939809f0f0 2023-09-30T22:26:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.444+0000 7f939e927700 1 -- 172.21.15.40:0/1412584347 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f939809f0f0 msgr2=0x7f9398138ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.444+0000 7f939e927700 1 --2- 172.21.15.40:0/1412584347 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f939809f0f0 0x7f9398138ee0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f938c0098f0 tx=0x7f938c009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.444+0000 7f939e927700 1 -- 172.21.15.40:0/1412584347 shutdown_connections 2023-09-30T22:26:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.444+0000 7f939e927700 1 --2- 172.21.15.40:0/1412584347 >> v2:172.21.15.40:3300/0 conn(0x7f939809e400 0x7f939813b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.444+0000 7f939e927700 1 --2- 172.21.15.40:0/1412584347 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f939809f0f0 0x7f9398138ee0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.444+0000 7f939e927700 1 -- 172.21.15.40:0/1412584347 >> 172.21.15.40:0/1412584347 conn(0x7f939809fb20 msgr2=0x7f939809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.445+0000 7f939e927700 1 -- 172.21.15.40:0/1412584347 shutdown_connections 2023-09-30T22:26:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.445+0000 7f939e927700 1 -- 172.21.15.40:0/1412584347 wait complete. 2023-09-30T22:26:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.445+0000 7f939e927700 1 Processor -- start 2023-09-30T22:26:21.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.446+0000 7f939e927700 1 -- start start 2023-09-30T22:26:21.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.446+0000 7f939e927700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f939809d920 0x7f939811db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.446+0000 7f939e927700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f939809e400 0x7f939811e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.446+0000 7f939e927700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f939811e5c0 0x7f93981ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.446+0000 7f939e927700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9398134a00 con 0x7f939809e400 2023-09-30T22:26:21.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.446+0000 7f939e927700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f939811ec70 con 0x7f939811e5c0 2023-09-30T22:26:21.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.446+0000 7f939e927700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f939811f420 con 0x7f939809d920 2023-09-30T22:26:21.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.446+0000 7f9397fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f939809d920 0x7f939811db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.446+0000 7f9397fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f939809d920 0x7f939811db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:53192/0 (socket says 172.21.15.40:53192) 2023-09-30T22:26:21.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.446+0000 7f9397fff700 1 -- 172.21.15.40:0/1856647810 learned_addr learned my addr 172.21.15.40:0/1856647810 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:21.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.446+0000 7f93977fe700 1 --2- 172.21.15.40:0/1856647810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f939809e400 0x7f939811e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.446+0000 7f939cec4700 1 --2- 172.21.15.40:0/1856647810 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f939811e5c0 0x7f93981ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.447+0000 7f9397fff700 1 -- 172.21.15.40:0/1856647810 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f939811e5c0 msgr2=0x7f93981ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.447+0000 7f9397fff700 1 --2- 172.21.15.40:0/1856647810 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f939811e5c0 0x7f93981ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.447+0000 7f9397fff700 1 -- 172.21.15.40:0/1856647810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f939809e400 msgr2=0x7f939811e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.447+0000 7f9397fff700 1 --2- 172.21.15.40:0/1856647810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f939809e400 0x7f939811e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.447+0000 7f9397fff700 1 -- 172.21.15.40:0/1856647810 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9390009a70 con 0x7f939809d920 2023-09-30T22:26:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.447+0000 7f9397fff700 1 --2- 172.21.15.40:0/1856647810 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f939809d920 0x7f939811db40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f938800c550 tx=0x7f938800c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.447+0000 7f9394ff9700 1 -- 172.21.15.40:0/1856647810 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93880054e0 con 0x7f939809d920 2023-09-30T22:26:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.447+0000 7f9394ff9700 1 -- 172.21.15.40:0/1856647810 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93880036a0 con 0x7f939809d920 2023-09-30T22:26:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.447+0000 7f9394ff9700 1 -- 172.21.15.40:0/1856647810 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9388003a30 con 0x7f939809d920 2023-09-30T22:26:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.447+0000 7f939e927700 1 -- 172.21.15.40:0/1856647810 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f938c009550 con 0x7f939809d920 2023-09-30T22:26:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.447+0000 7f939e927700 1 -- 172.21.15.40:0/1856647810 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9398120a50 con 0x7f939809d920 2023-09-30T22:26:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.448+0000 7f9394ff9700 1 -- 172.21.15.40:0/1856647810 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9388003b90 con 0x7f939809d920 2023-09-30T22:26:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.448+0000 7f939e927700 1 -- 172.21.15.40:0/1856647810 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f939809c9e0 con 0x7f939809d920 2023-09-30T22:26:21.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.449+0000 7f9394ff9700 1 -- 172.21.15.40:0/1856647810 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f938803eb30 con 0x7f939809d920 2023-09-30T22:26:21.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.458+0000 7f9394ff9700 1 -- 172.21.15.40:0/1856647810 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9388003e40 con 0x7f939809d920 2023-09-30T22:26:21.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.473+0000 7fe0c1b1f700 1 -- 172.21.15.40:0/2922218532 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe0bc0a04e0 con 0x7fe0bc06ced0 2023-09-30T22:26:21.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.473+0000 7fe0a3fff700 1 -- 172.21.15.40:0/2922218532 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe0ac02eb90 con 0x7fe0bc06ced0 2023-09-30T22:26:21.474 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:21.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.475+0000 7fe0c1b1f700 1 -- 172.21.15.40:0/2922218532 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0bc06ced0 msgr2=0x7fe0bc137a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.475+0000 7fe0c1b1f700 1 --2- 172.21.15.40:0/2922218532 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0bc06ced0 0x7fe0bc137a80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac0090b0 tx=0x7fe0ac004750 comp rx=0 tx=0).stop 2023-09-30T22:26:21.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.476+0000 7fe0c1b1f700 1 -- 172.21.15.40:0/2922218532 shutdown_connections 2023-09-30T22:26:21.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.476+0000 7fe0c1b1f700 1 --2- 172.21.15.40:0/2922218532 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0bc138370 0x7fe0bc095f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.476+0000 7fe0c1b1f700 1 --2- 172.21.15.40:0/2922218532 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0bc06ced0 0x7fe0bc137a80 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.476+0000 7fe0c1b1f700 1 --2- 172.21.15.40:0/2922218532 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe0bc09fbb0 0x7fe0bc095a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.476+0000 7fe0c1b1f700 1 -- 172.21.15.40:0/2922218532 >> 172.21.15.40:0/2922218532 conn(0x7fe0bc0a41a0 msgr2=0x7fe0bc0a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:21.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.476+0000 7fe0c1b1f700 1 -- 172.21.15.40:0/2922218532 shutdown_connections 2023-09-30T22:26:21.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.476+0000 7fe0c1b1f700 1 -- 172.21.15.40:0/2922218532 wait complete. 2023-09-30T22:26:21.493 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:21.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.570+0000 7f9e7f697700 1 -- 172.21.15.40:0/2274514375 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9e7811cf60 con 0x7f9e78131d50 2023-09-30T22:26:21.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.570+0000 7f9e6dffb700 1 -- 172.21.15.40:0/2274514375 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9e70044020 con 0x7f9e78131d50 2023-09-30T22:26:21.571 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:21.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.572+0000 7f9e7f697700 1 -- 172.21.15.40:0/2274514375 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e78131d50 msgr2=0x7f9e7811a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.572+0000 7f9e7f697700 1 --2- 172.21.15.40:0/2274514375 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e78131d50 0x7f9e7811a5a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9e7000ef00 tx=0x7f9e7000b390 comp rx=0 tx=0).stop 2023-09-30T22:26:21.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.572+0000 7f9e7f697700 1 -- 172.21.15.40:0/2274514375 shutdown_connections 2023-09-30T22:26:21.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.572+0000 7f9e7f697700 1 --2- 172.21.15.40:0/2274514375 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e78131d50 0x7f9e7811a5a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.572+0000 7f9e7f697700 1 --2- 172.21.15.40:0/2274514375 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e7809bc50 0x7f9e78119b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.572+0000 7f9e7f697700 1 --2- 172.21.15.40:0/2274514375 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e7809c600 0x7f9e7811a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.572+0000 7f9e7f697700 1 -- 172.21.15.40:0/2274514375 >> 172.21.15.40:0/2274514375 conn(0x7f9e780a2a00 msgr2=0x7f9e780a0900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:21.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.572+0000 7f9e7f697700 1 -- 172.21.15.40:0/2274514375 shutdown_connections 2023-09-30T22:26:21.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.572+0000 7f9e7f697700 1 -- 172.21.15.40:0/2274514375 wait complete. 2023-09-30T22:26:21.585 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:21.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.619+0000 7fe731192700 1 -- 172.21.15.40:0/186670390 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe72c074720 con 0x7fe72c09d920 2023-09-30T22:26:21.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.620+0000 7fe7137fe700 1 -- 172.21.15.40:0/186670390 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe71c02a090 con 0x7fe72c09d920 2023-09-30T22:26:21.621 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:21.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.622+0000 7fe731192700 1 -- 172.21.15.40:0/186670390 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe72c09d920 msgr2=0x7fe72c122cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.622+0000 7fe731192700 1 --2- 172.21.15.40:0/186670390 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe72c09d920 0x7fe72c122cd0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe71c00e960 tx=0x7fe71c00ec70 comp rx=0 tx=0).stop 2023-09-30T22:26:21.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.622+0000 7fe731192700 1 -- 172.21.15.40:0/186670390 shutdown_connections 2023-09-30T22:26:21.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.622+0000 7fe731192700 1 --2- 172.21.15.40:0/186670390 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe72c09d920 0x7fe72c122cd0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.622+0000 7fe731192700 1 --2- 172.21.15.40:0/186670390 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe72c123750 0x7fe72c1c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.622+0000 7fe731192700 1 --2- 172.21.15.40:0/186670390 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe72c133ca0 0x7fe72c123210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.622+0000 7fe731192700 1 -- 172.21.15.40:0/186670390 >> 172.21.15.40:0/186670390 conn(0x7fe72c09fb20 msgr2=0x7fe72c0a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:21.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.622+0000 7fe731192700 1 -- 172.21.15.40:0/186670390 shutdown_connections 2023-09-30T22:26:21.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.622+0000 7fe731192700 1 -- 172.21.15.40:0/186670390 wait complete. 2023-09-30T22:26:21.635 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:21.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.657+0000 7f939e927700 1 -- 172.21.15.40:0/1856647810 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9398062380 con 0x7f939809d920 2023-09-30T22:26:21.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.658+0000 7f9394ff9700 1 -- 172.21.15.40:0/1856647810 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9388017020 con 0x7f939809d920 2023-09-30T22:26:21.659 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:21.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.660+0000 7f939e927700 1 -- 172.21.15.40:0/1856647810 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f939809d920 msgr2=0x7f939811db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.660+0000 7f939e927700 1 --2- 172.21.15.40:0/1856647810 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f939809d920 0x7f939811db40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f938800c550 tx=0x7f938800c860 comp rx=0 tx=0).stop 2023-09-30T22:26:21.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.660+0000 7f939e927700 1 -- 172.21.15.40:0/1856647810 shutdown_connections 2023-09-30T22:26:21.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.660+0000 7f939e927700 1 --2- 172.21.15.40:0/1856647810 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f939809d920 0x7f939811db40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.660+0000 7f939e927700 1 --2- 172.21.15.40:0/1856647810 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f939811e5c0 0x7f93981ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.660+0000 7f939e927700 1 --2- 172.21.15.40:0/1856647810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f939809e400 0x7f939811e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.660+0000 7f939e927700 1 -- 172.21.15.40:0/1856647810 >> 172.21.15.40:0/1856647810 conn(0x7f939809fb20 msgr2=0x7f93980a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:21.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.660+0000 7f939e927700 1 -- 172.21.15.40:0/1856647810 shutdown_connections 2023-09-30T22:26:21.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:21.660+0000 7f939e927700 1 -- 172.21.15.40:0/1856647810 wait complete. 2023-09-30T22:26:21.673 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:22.494 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:22.586 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:22.636 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:22.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.636+0000 7ff080db4700 1 Processor -- start 2023-09-30T22:26:22.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.636+0000 7ff080db4700 1 -- start start 2023-09-30T22:26:22.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.637+0000 7ff080db4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff07c09d920 0x7ff07c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:22.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.637+0000 7ff080db4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff07c130fb0 0x7ff07c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:22.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.637+0000 7ff080db4700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff07c09adf0 con 0x7ff07c09e230 2023-09-30T22:26:22.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.637+0000 7ff080db4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff07c09edf0 con 0x7ff07c130fb0 2023-09-30T22:26:22.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.637+0000 7ff080db4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c09b660 con 0x7ff07c09d920 2023-09-30T22:26:22.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.637+0000 7ff07a59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff07c09d920 0x7ff07c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:22.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.637+0000 7ff07ad9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff07c130fb0 0x7ff07c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:22.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.637+0000 7ff07a59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff07c09d920 0x7ff07c09dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:49056/0 (socket says 172.21.15.40:49056) 2023-09-30T22:26:22.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.637+0000 7ff07ad9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff07c130fb0 0x7ff07c138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43926/0 (socket says 172.21.15.40:43926) 2023-09-30T22:26:22.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.637+0000 7ff07a59c700 1 -- 172.21.15.40:0/252140510 learned_addr learned my addr 172.21.15.40:0/252140510 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:22.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.637+0000 7ff07a59c700 1 -- 172.21.15.40:0/252140510 >> v2:172.21.15.40:3300/0 conn(0x7ff07c130fb0 msgr2=0x7ff07c138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:22.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.637+0000 7ff07a59c700 1 --2- 172.21.15.40:0/252140510 >> v2:172.21.15.40:3300/0 conn(0x7ff07c130fb0 0x7ff07c138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:22.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.637+0000 7ff07a59c700 1 -- 172.21.15.40:0/252140510 >> v1:172.21.15.40:6789/0 conn(0x7ff07c09e230 legacy=0x7ff07c1308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:22.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.637+0000 7ff07a59c700 1 -- 172.21.15.40:0/252140510 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff07c09a6e0 con 0x7ff07c09d920 2023-09-30T22:26:22.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.637+0000 7ff07ad9d700 1 --2- 172.21.15.40:0/252140510 >> v2:172.21.15.40:3300/0 conn(0x7ff07c130fb0 0x7ff07c138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:22.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.638+0000 7ff07a59c700 1 --2- 172.21.15.40:0/252140510 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff07c09d920 0x7ff07c09dcf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff06c006fd0 tx=0x7ff06c00be70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9df4836947ef6690 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:22.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.638+0000 7ff07959a700 1 -- 172.21.15.40:0/252140510 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06c005e30 con 0x7ff07c09d920 2023-09-30T22:26:22.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.638+0000 7ff07959a700 1 -- 172.21.15.40:0/252140510 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06c004030 con 0x7ff07c09d920 2023-09-30T22:26:22.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.638+0000 7ff07959a700 1 -- 172.21.15.40:0/252140510 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06c0043e0 con 0x7ff07c09d920 2023-09-30T22:26:22.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.638+0000 7ff080db4700 1 -- 172.21.15.40:0/252140510 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff07c09d920 msgr2=0x7ff07c09dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:22.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.638+0000 7ff080db4700 1 --2- 172.21.15.40:0/252140510 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff07c09d920 0x7ff07c09dcf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff06c006fd0 tx=0x7ff06c00be70 comp rx=0 tx=0).stop 2023-09-30T22:26:22.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.639+0000 7ff080db4700 1 -- 172.21.15.40:0/252140510 shutdown_connections 2023-09-30T22:26:22.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.639+0000 7ff080db4700 1 --2- 172.21.15.40:0/252140510 >> v2:172.21.15.40:3300/0 conn(0x7ff07c130fb0 0x7ff07c138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:22.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.639+0000 7ff080db4700 1 --2- 172.21.15.40:0/252140510 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff07c09d920 0x7ff07c09dcf0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:22.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.639+0000 7ff080db4700 1 -- 172.21.15.40:0/252140510 >> 172.21.15.40:0/252140510 conn(0x7ff07c09fb20 msgr2=0x7ff07c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:22.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.639+0000 7ff080db4700 1 -- 172.21.15.40:0/252140510 shutdown_connections 2023-09-30T22:26:22.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.639+0000 7ff080db4700 1 -- 172.21.15.40:0/252140510 wait complete. 2023-09-30T22:26:22.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.640+0000 7ff080db4700 1 Processor -- start 2023-09-30T22:26:22.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.640+0000 7ff080db4700 1 -- start start 2023-09-30T22:26:22.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.641+0000 7ff080db4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff07c09d920 0x7ff07c121510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:22.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.641+0000 7ff080db4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff07c09e230 0x7ff07c121a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:22.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.641+0000 7ff080db4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff07c130fb0 0x7ff07c121f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:22.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.641+0000 7ff080db4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c06b370 con 0x7ff07c09e230 2023-09-30T22:26:22.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.641+0000 7ff080db4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c09cb00 con 0x7ff07c09d920 2023-09-30T22:26:22.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.641+0000 7ff080db4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c124730 con 0x7ff07c130fb0 2023-09-30T22:26:22.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.641+0000 7ff079d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff07c09e230 0x7ff07c121a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:22.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.641+0000 7ff079d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff07c09e230 0x7ff07c121a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43930/0 (socket says 172.21.15.40:43930) 2023-09-30T22:26:22.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.641+0000 7ff079d9b700 1 -- 172.21.15.40:0/3690440958 learned_addr learned my addr 172.21.15.40:0/3690440958 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:22.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.641+0000 7ff07ad9d700 1 --2- 172.21.15.40:0/3690440958 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff07c130fb0 0x7ff07c121f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:22.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.641+0000 7ff07a59c700 1 --2- 172.21.15.40:0/3690440958 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff07c09d920 0x7ff07c121510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:22.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.642+0000 7ff079d9b700 1 -- 172.21.15.40:0/3690440958 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff07c130fb0 msgr2=0x7ff07c121f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:22.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.642+0000 7ff079d9b700 1 --2- 172.21.15.40:0/3690440958 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff07c130fb0 0x7ff07c121f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:22.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.642+0000 7ff079d9b700 1 -- 172.21.15.40:0/3690440958 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff07c09d920 msgr2=0x7ff07c121510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:22.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.642+0000 7ff079d9b700 1 --2- 172.21.15.40:0/3690440958 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff07c09d920 0x7ff07c121510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:22.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.642+0000 7ff079d9b700 1 -- 172.21.15.40:0/3690440958 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff074009a70 con 0x7ff07c09e230 2023-09-30T22:26:22.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.642+0000 7ff079d9b700 1 --2- 172.21.15.40:0/3690440958 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff07c09e230 0x7ff07c121a50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff07000c4b0 tx=0x7ff07000c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:22.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.642+0000 7ff06affd700 1 -- 172.21.15.40:0/3690440958 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0700052d0 con 0x7ff07c09e230 2023-09-30T22:26:22.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.642+0000 7ff06affd700 1 -- 172.21.15.40:0/3690440958 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff070005430 con 0x7ff07c09e230 2023-09-30T22:26:22.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.642+0000 7ff06affd700 1 -- 172.21.15.40:0/3690440958 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0700038c0 con 0x7ff07c09e230 2023-09-30T22:26:22.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.642+0000 7ff080db4700 1 -- 172.21.15.40:0/3690440958 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff06c00b7a0 con 0x7ff07c09e230 2023-09-30T22:26:22.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.642+0000 7ff080db4700 1 -- 172.21.15.40:0/3690440958 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff07c123840 con 0x7ff07c09e230 2023-09-30T22:26:22.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.643+0000 7ff080db4700 1 -- 172.21.15.40:0/3690440958 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff07c062380 con 0x7ff07c09e230 2023-09-30T22:26:22.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.643+0000 7ff06affd700 1 -- 172.21.15.40:0/3690440958 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff070003a20 con 0x7ff07c09e230 2023-09-30T22:26:22.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.644+0000 7ff06affd700 1 -- 172.21.15.40:0/3690440958 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff07003ea60 con 0x7ff07c09e230 2023-09-30T22:26:22.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.648+0000 7ff06affd700 1 -- 172.21.15.40:0/3690440958 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff070018260 con 0x7ff07c09e230 2023-09-30T22:26:22.674 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:22.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.726+0000 7fdf091ab700 1 Processor -- start 2023-09-30T22:26:22.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.726+0000 7fdf091ab700 1 -- start start 2023-09-30T22:26:22.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.727+0000 7fdf091ab700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf0409d860 0x7fdf0409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:22.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.727+0000 7fdf091ab700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf04133730 0x7fdf04133b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:22.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.727+0000 7fdf091ab700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdf041340c0 0x7fdf0413aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:22.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.727+0000 7fdf091ab700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf0409ac00 con 0x7fdf041340c0 2023-09-30T22:26:22.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.727+0000 7fdf091ab700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0409f350 con 0x7fdf04133730 2023-09-30T22:26:22.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.727+0000 7fdf091ab700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0409a660 con 0x7fdf0409d860 2023-09-30T22:26:22.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.727+0000 7fdf02d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf0409d860 0x7fdf0409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:22.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.727+0000 7fdf0259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf04133730 0x7fdf04133b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:22.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.727+0000 7fdf0259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf04133730 0x7fdf04133b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:49070/0 (socket says 172.21.15.40:49070) 2023-09-30T22:26:22.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.727+0000 7fdf02d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf0409d860 0x7fdf0409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:53220/0 (socket says 172.21.15.40:53220) 2023-09-30T22:26:22.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.727+0000 7fdf0259c700 1 -- 172.21.15.40:0/1966818291 learned_addr learned my addr 172.21.15.40:0/1966818291 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:22.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.727+0000 7fdf0359e700 1 --2- 172.21.15.40:0/1966818291 >> v2:172.21.15.40:3300/0 conn(0x7fdf041340c0 0x7fdf0413aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:22.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.728+0000 7fdf0259c700 1 -- 172.21.15.40:0/1966818291 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf0409d860 msgr2=0x7fdf0409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:22.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.728+0000 7fdf0259c700 1 --2- 172.21.15.40:0/1966818291 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf0409d860 0x7fdf0409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:22.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.728+0000 7fdf0259c700 1 -- 172.21.15.40:0/1966818291 >> v2:172.21.15.40:3300/0 conn(0x7fdf041340c0 msgr2=0x7fdf0413aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:22.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.728+0000 7fdf0259c700 1 --2- 172.21.15.40:0/1966818291 >> v2:172.21.15.40:3300/0 conn(0x7fdf041340c0 0x7fdf0413aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:22.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.728+0000 7fdf0259c700 1 -- 172.21.15.40:0/1966818291 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf04134530 con 0x7fdf04133730 2023-09-30T22:26:22.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.728+0000 7fdf0359e700 1 --2- 172.21.15.40:0/1966818291 >> v2:172.21.15.40:3300/0 conn(0x7fdf041340c0 0x7fdf0413aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:26:22.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.728+0000 7fdf02d9d700 1 --2- 172.21.15.40:0/1966818291 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf0409d860 0x7fdf0409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:22.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.728+0000 7fdf0259c700 1 --2- 172.21.15.40:0/1966818291 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf04133730 0x7fdf04133b80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdef80098f0 tx=0x7fdef8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d756136f4af9b8b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:22.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.728+0000 7fdf01d9b700 1 -- 172.21.15.40:0/1966818291 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef8011830 con 0x7fdf04133730 2023-09-30T22:26:22.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.728+0000 7fdf01d9b700 1 -- 172.21.15.40:0/1966818291 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef8011990 con 0x7fdf04133730 2023-09-30T22:26:22.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.728+0000 7fdf01d9b700 1 -- 172.21.15.40:0/1966818291 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef8011d20 con 0x7fdf04133730 2023-09-30T22:26:22.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.729+0000 7fdf091ab700 1 -- 172.21.15.40:0/1966818291 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf04133730 msgr2=0x7fdf04133b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:22.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.729+0000 7fdf091ab700 1 --2- 172.21.15.40:0/1966818291 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf04133730 0x7fdf04133b80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdef80098f0 tx=0x7fdef8009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:22.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.729+0000 7fdf091ab700 1 -- 172.21.15.40:0/1966818291 shutdown_connections 2023-09-30T22:26:22.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.729+0000 7fdf091ab700 1 --2- 172.21.15.40:0/1966818291 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf0409d860 0x7fdf0409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:22.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.729+0000 7fdf091ab700 1 --2- 172.21.15.40:0/1966818291 >> v2:172.21.15.40:3300/0 conn(0x7fdf041340c0 0x7fdf0413aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:22.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.729+0000 7fdf091ab700 1 --2- 172.21.15.40:0/1966818291 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf04133730 0x7fdf04133b80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:22.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.729+0000 7fdf091ab700 1 -- 172.21.15.40:0/1966818291 >> 172.21.15.40:0/1966818291 conn(0x7fdf0406a6d0 msgr2=0x7fdf0406aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:22.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.729+0000 7fdf091ab700 1 -- 172.21.15.40:0/1966818291 shutdown_connections 2023-09-30T22:26:22.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.729+0000 7fdf091ab700 1 -- 172.21.15.40:0/1966818291 wait complete. 2023-09-30T22:26:22.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.730+0000 7fdf091ab700 1 Processor -- start 2023-09-30T22:26:22.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.730+0000 7fdf091ab700 1 -- start start 2023-09-30T22:26:22.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.731+0000 7fdf091ab700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf0409d860 0x7fdf0411dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:22.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.731+0000 7fdf091ab700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf04133730 0x7fdf0411e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:22.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.731+0000 7fdf091ab700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf041340c0 0x7fdf0411e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:22.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.731+0000 7fdf091ab700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf04120270 con 0x7fdf0409d860 2023-09-30T22:26:22.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.731+0000 7fdf091ab700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0411ff50 con 0x7fdf04133730 2023-09-30T22:26:22.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.731+0000 7fdf091ab700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf040a0f90 con 0x7fdf041340c0 2023-09-30T22:26:22.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.731+0000 7fdf0359e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf041340c0 0x7fdf0411e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:22.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.731+0000 7fdf0359e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf041340c0 0x7fdf0411e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:53224/0 (socket says 172.21.15.40:53224) 2023-09-30T22:26:22.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.731+0000 7fdf0359e700 1 -- 172.21.15.40:0/1695421635 learned_addr learned my addr 172.21.15.40:0/1695421635 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:22.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.731+0000 7fdf02d9d700 1 --2- 172.21.15.40:0/1695421635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf0409d860 0x7fdf0411dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:22.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.731+0000 7fdf0259c700 1 --2- 172.21.15.40:0/1695421635 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf04133730 0x7fdf0411e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:22.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.731+0000 7fdf0359e700 1 -- 172.21.15.40:0/1695421635 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf04133730 msgr2=0x7fdf0411e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:22.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.731+0000 7fdf0359e700 1 --2- 172.21.15.40:0/1695421635 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf04133730 0x7fdf0411e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:22.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.731+0000 7fdf0359e700 1 -- 172.21.15.40:0/1695421635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf0409d860 msgr2=0x7fdf0411dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:22.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.731+0000 7fdf0359e700 1 --2- 172.21.15.40:0/1695421635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf0409d860 0x7fdf0411dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:22.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.731+0000 7fdf0359e700 1 -- 172.21.15.40:0/1695421635 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef40094a0 con 0x7fdf041340c0 2023-09-30T22:26:22.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.731+0000 7fdf02d9d700 1 --2- 172.21.15.40:0/1695421635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf0409d860 0x7fdf0411dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:22.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.732+0000 7fdf0359e700 1 --2- 172.21.15.40:0/1695421635 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf041340c0 0x7fdf0411e810 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdefc00cef0 tx=0x7fdefc00cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:22.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.732+0000 7fdeeb7fe700 1 -- 172.21.15.40:0/1695421635 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc00ad00 con 0x7fdf041340c0 2023-09-30T22:26:22.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.732+0000 7fdeeb7fe700 1 -- 172.21.15.40:0/1695421635 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdefc00ae60 con 0x7fdf041340c0 2023-09-30T22:26:22.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.732+0000 7fdf091ab700 1 -- 172.21.15.40:0/1695421635 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdef8009550 con 0x7fdf041340c0 2023-09-30T22:26:22.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.732+0000 7fdeeb7fe700 1 -- 172.21.15.40:0/1695421635 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc015680 con 0x7fdf041340c0 2023-09-30T22:26:22.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.732+0000 7fdf091ab700 1 -- 172.21.15.40:0/1695421635 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf04121950 con 0x7fdf041340c0 2023-09-30T22:26:22.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.733+0000 7fdeeb7fe700 1 -- 172.21.15.40:0/1695421635 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdefc00d430 con 0x7fdf041340c0 2023-09-30T22:26:22.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.733+0000 7fdeeb7fe700 1 -- 172.21.15.40:0/1695421635 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fdefc03fb30 con 0x7fdf041340c0 2023-09-30T22:26:22.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.734+0000 7fdf091ab700 1 -- 172.21.15.40:0/1695421635 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf0411a860 con 0x7fdf041340c0 2023-09-30T22:26:22.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.742+0000 7fdeeb7fe700 1 -- 172.21.15.40:0/1695421635 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdefc008910 con 0x7fdf041340c0 2023-09-30T22:26:22.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.775+0000 7f647c584700 1 Processor -- start 2023-09-30T22:26:22.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.775+0000 7f647c584700 1 -- start start 2023-09-30T22:26:22.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.776+0000 7f647c584700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f647409d920 0x7f647409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:22.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.776+0000 7f647c584700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f647409f0f0 0x7f647409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:22.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.776+0000 7f647c584700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f647409f940 con 0x7f6474133ca0 2023-09-30T22:26:22.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.776+0000 7f647c584700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647406b4c0 con 0x7f647409f0f0 2023-09-30T22:26:22.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.776+0000 7f647c584700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f647409a8f0 con 0x7f647409d920 2023-09-30T22:26:22.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.776+0000 7f647a320700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f647409d920 0x7f647409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:22.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.776+0000 7f647a320700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f647409d920 0x7f647409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:53238/0 (socket says 172.21.15.40:53238) 2023-09-30T22:26:22.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.776+0000 7f647a320700 1 -- 172.21.15.40:0/3536476368 learned_addr learned my addr 172.21.15.40:0/3536476368 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:22.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.776+0000 7f6479b1f700 1 --2- 172.21.15.40:0/3536476368 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f647409f0f0 0x7f647409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:22.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.777+0000 7f647a320700 1 -- 172.21.15.40:0/3536476368 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f647409f0f0 msgr2=0x7f647409e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:22.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.777+0000 7f647a320700 1 --2- 172.21.15.40:0/3536476368 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f647409f0f0 0x7f647409e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:22.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.777+0000 7f647a320700 1 -- 172.21.15.40:0/3536476368 >> v1:172.21.15.40:6789/0 conn(0x7f6474133ca0 legacy=0x7f6474134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:22.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.777+0000 7f647a320700 1 -- 172.21.15.40:0/3536476368 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f647409f6e0 con 0x7f647409d920 2023-09-30T22:26:22.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.777+0000 7f647a320700 1 --2- 172.21.15.40:0/3536476368 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f647409d920 0x7f647409dcf0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6470009920 tx=0x7f6470009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c715ade9a4461eb2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:22.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.777+0000 7f647931e700 1 -- 172.21.15.40:0/3536476368 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6470005e30 con 0x7f647409d920 2023-09-30T22:26:22.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.777+0000 7f647931e700 1 -- 172.21.15.40:0/3536476368 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6470004030 con 0x7f647409d920 2023-09-30T22:26:22.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.777+0000 7f647931e700 1 -- 172.21.15.40:0/3536476368 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64700043e0 con 0x7f647409d920 2023-09-30T22:26:22.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.778+0000 7f647c584700 1 -- 172.21.15.40:0/3536476368 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f647409d920 msgr2=0x7f647409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:22.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.778+0000 7f647c584700 1 --2- 172.21.15.40:0/3536476368 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f647409d920 0x7f647409dcf0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6470009920 tx=0x7f6470009c30 comp rx=0 tx=0).stop 2023-09-30T22:26:22.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.778+0000 7f647c584700 1 -- 172.21.15.40:0/3536476368 shutdown_connections 2023-09-30T22:26:22.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.778+0000 7f647c584700 1 --2- 172.21.15.40:0/3536476368 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f647409d920 0x7f647409dcf0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:22.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.778+0000 7f647c584700 1 --2- 172.21.15.40:0/3536476368 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f647409f0f0 0x7f647409e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:22.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.778+0000 7f647c584700 1 -- 172.21.15.40:0/3536476368 >> 172.21.15.40:0/3536476368 conn(0x7f647409fb20 msgr2=0x7f647409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:22.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.778+0000 7f647c584700 1 -- 172.21.15.40:0/3536476368 shutdown_connections 2023-09-30T22:26:22.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.778+0000 7f647c584700 1 -- 172.21.15.40:0/3536476368 wait complete. 2023-09-30T22:26:22.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.779+0000 7f647c584700 1 Processor -- start 2023-09-30T22:26:22.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.779+0000 7f647c584700 1 -- start start 2023-09-30T22:26:22.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.779+0000 7f647c584700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f647409d920 0x7f6474121840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:22.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.779+0000 7f647c584700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6474133ca0 0x7f6474121d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:22.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.780+0000 7f647c584700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f64741222c0 0x7f64741c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:22.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.780+0000 7f647c584700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6474125360 con 0x7f647409d920 2023-09-30T22:26:22.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.780+0000 7f647c584700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6474122ca0 con 0x7f64741222c0 2023-09-30T22:26:22.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.780+0000 7f647c584700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f647409c9e0 con 0x7f6474133ca0 2023-09-30T22:26:22.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.780+0000 7f647ab21700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f64741222c0 0x7f64741c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:22.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.780+0000 7f647ab21700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f64741222c0 0x7f64741c8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:49100/0 (socket says 172.21.15.40:49100) 2023-09-30T22:26:22.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.780+0000 7f647ab21700 1 -- 172.21.15.40:0/453000797 learned_addr learned my addr 172.21.15.40:0/453000797 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:22.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.780+0000 7f6479b1f700 1 --2- 172.21.15.40:0/453000797 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6474133ca0 0x7f6474121d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:22.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.780+0000 7f647ab21700 1 -- 172.21.15.40:0/453000797 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6474133ca0 msgr2=0x7f6474121d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:22.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.780+0000 7f647ab21700 1 --2- 172.21.15.40:0/453000797 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6474133ca0 0x7f6474121d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:22.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.780+0000 7f647ab21700 1 -- 172.21.15.40:0/453000797 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f647409d920 msgr2=0x7f6474121840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:26:22.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.780+0000 7f647ab21700 1 --2- 172.21.15.40:0/453000797 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f647409d920 0x7f6474121840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:22.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.780+0000 7f647ab21700 1 -- 172.21.15.40:0/453000797 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6470009500 con 0x7f64741222c0 2023-09-30T22:26:22.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.780+0000 7f6479b1f700 1 --2- 172.21.15.40:0/453000797 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6474133ca0 0x7f6474121d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:26:22.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.780+0000 7f647ab21700 1 --2- 172.21.15.40:0/453000797 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f64741222c0 0x7f64741c8980 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f646c00cc80 tx=0x7f646c00a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:22.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.780+0000 7f646affd700 1 -- 172.21.15.40:0/453000797 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c00ad40 con 0x7f64741222c0 2023-09-30T22:26:22.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.780+0000 7f646affd700 1 -- 172.21.15.40:0/453000797 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646c00ce80 con 0x7f64741222c0 2023-09-30T22:26:22.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.780+0000 7f647c584700 1 -- 172.21.15.40:0/453000797 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6474123cb0 con 0x7f64741222c0 2023-09-30T22:26:22.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.780+0000 7f646affd700 1 -- 172.21.15.40:0/453000797 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c00aea0 con 0x7f64741222c0 2023-09-30T22:26:22.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.781+0000 7f647c584700 1 -- 172.21.15.40:0/453000797 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6474132790 con 0x7f64741222c0 2023-09-30T22:26:22.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.782+0000 7f647c584700 1 -- 172.21.15.40:0/453000797 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6474062380 con 0x7f64741222c0 2023-09-30T22:26:22.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.782+0000 7f646affd700 1 -- 172.21.15.40:0/453000797 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f646c003c40 con 0x7f64741222c0 2023-09-30T22:26:22.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.782+0000 7f646affd700 1 -- 172.21.15.40:0/453000797 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f646c040380 con 0x7f64741222c0 2023-09-30T22:26:22.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.791+0000 7f646affd700 1 -- 172.21.15.40:0/453000797 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f646c011740 con 0x7f64741222c0 2023-09-30T22:26:22.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.816+0000 7f34da867700 1 Processor -- start 2023-09-30T22:26:22.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.816+0000 7f34da867700 1 -- start start 2023-09-30T22:26:22.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.816+0000 7f34da867700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34d409d920 0x7f34d409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:22.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.816+0000 7f34da867700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f34d4130fb0 0x7f34d4138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:22.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.816+0000 7f34da867700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34d409adf0 con 0x7f34d409e230 2023-09-30T22:26:22.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.816+0000 7f34da867700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34d409edf0 con 0x7f34d4130fb0 2023-09-30T22:26:22.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.816+0000 7f34da867700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d409b660 con 0x7f34d409d920 2023-09-30T22:26:22.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.817+0000 7f34d37fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f34d409e230 0x7f34d41308a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40188/0 (socket says 172.21.15.40:40188) 2023-09-30T22:26:22.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.817+0000 7f34d37fe700 1 -- 172.21.15.40:0/2477231977 learned_addr learned my addr 172.21.15.40:0/2477231977 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:22.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.817+0000 7f34d8e04700 1 --2- 172.21.15.40:0/2477231977 >> v2:172.21.15.40:3300/0 conn(0x7f34d4130fb0 0x7f34d4138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:22.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.817+0000 7f34d3fff700 1 --2- 172.21.15.40:0/2477231977 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34d409d920 0x7f34d409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:22.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.817+0000 7f34d2ffd700 1 -- 172.21.15.40:0/2477231977 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3229888182 0 0) 0x7f34d409adf0 con 0x7f34d409e230 2023-09-30T22:26:22.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.817+0000 7f34d2ffd700 1 -- 172.21.15.40:0/2477231977 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34bc0035b0 con 0x7f34d409e230 2023-09-30T22:26:22.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.817+0000 7f34d8e04700 1 -- 172.21.15.40:0/2477231977 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34d409d920 msgr2=0x7f34d409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:22.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.817+0000 7f34d8e04700 1 --2- 172.21.15.40:0/2477231977 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34d409d920 0x7f34d409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:22.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.817+0000 7f34d8e04700 1 -- 172.21.15.40:0/2477231977 >> v1:172.21.15.40:6789/0 conn(0x7f34d409e230 legacy=0x7f34d41308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:22.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.817+0000 7f34d8e04700 1 -- 172.21.15.40:0/2477231977 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d409a6e0 con 0x7f34d4130fb0 2023-09-30T22:26:22.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.817+0000 7f34d3fff700 1 --2- 172.21.15.40:0/2477231977 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34d409d920 0x7f34d409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:22.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.817+0000 7f34d8e04700 1 --2- 172.21.15.40:0/2477231977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34d4130fb0 0x7f34d4138d10 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f34cc00bfa0 tx=0x7f34cc00d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f85e4a298b387d65 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:22.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.818+0000 7f34d2ffd700 1 -- 172.21.15.40:0/2477231977 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc010070 con 0x7f34d4130fb0 2023-09-30T22:26:22.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.818+0000 7f34d2ffd700 1 -- 172.21.15.40:0/2477231977 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34cc00b2e0 con 0x7f34d4130fb0 2023-09-30T22:26:22.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.818+0000 7f34d2ffd700 1 -- 172.21.15.40:0/2477231977 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc003c20 con 0x7f34d4130fb0 2023-09-30T22:26:22.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.818+0000 7f34da867700 1 -- 172.21.15.40:0/2477231977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34d4130fb0 msgr2=0x7f34d4138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:22.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.818+0000 7f34da867700 1 --2- 172.21.15.40:0/2477231977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34d4130fb0 0x7f34d4138d10 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f34cc00bfa0 tx=0x7f34cc00d330 comp rx=0 tx=0).stop 2023-09-30T22:26:22.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.818+0000 7f34da867700 1 -- 172.21.15.40:0/2477231977 shutdown_connections 2023-09-30T22:26:22.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.818+0000 7f34da867700 1 --2- 172.21.15.40:0/2477231977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34d4130fb0 0x7f34d4138d10 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:22.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.818+0000 7f34da867700 1 --2- 172.21.15.40:0/2477231977 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34d409d920 0x7f34d409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:22.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.818+0000 7f34da867700 1 -- 172.21.15.40:0/2477231977 >> 172.21.15.40:0/2477231977 conn(0x7f34d409fb20 msgr2=0x7f34d409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:22.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.819+0000 7f34da867700 1 -- 172.21.15.40:0/2477231977 shutdown_connections 2023-09-30T22:26:22.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.819+0000 7f34da867700 1 -- 172.21.15.40:0/2477231977 wait complete. 2023-09-30T22:26:22.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.820+0000 7f34da867700 1 Processor -- start 2023-09-30T22:26:22.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.820+0000 7f34da867700 1 -- start start 2023-09-30T22:26:22.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.821+0000 7f34da867700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f34d409d920 0x7f34d411d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:22.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.821+0000 7f34da867700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34d409e230 0x7f34d411d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:22.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.821+0000 7f34da867700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34d4130fb0 0x7f34d411dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:22.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.821+0000 7f34da867700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d409cb00 con 0x7f34d409e230 2023-09-30T22:26:22.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.821+0000 7f34da867700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d41208a0 con 0x7f34d4130fb0 2023-09-30T22:26:22.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.821+0000 7f34da867700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34d411ed10 con 0x7f34d409d920 2023-09-30T22:26:22.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.821+0000 7f34d37fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34d409e230 0x7f34d411d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:22.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.821+0000 7f34d37fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34d409e230 0x7f34d411d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43970/0 (socket says 172.21.15.40:43970) 2023-09-30T22:26:22.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.821+0000 7f34d37fe700 1 -- 172.21.15.40:0/3959287448 learned_addr learned my addr 172.21.15.40:0/3959287448 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:22.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.821+0000 7f34d3fff700 1 --2- 172.21.15.40:0/3959287448 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f34d409d920 0x7f34d411d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:22.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.821+0000 7f34d8e04700 1 --2- 172.21.15.40:0/3959287448 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34d4130fb0 0x7f34d411dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:22.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.821+0000 7f34d37fe700 1 -- 172.21.15.40:0/3959287448 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f34d409d920 msgr2=0x7f34d411d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:22.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.821+0000 7f34d37fe700 1 --2- 172.21.15.40:0/3959287448 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f34d409d920 0x7f34d411d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:22.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.821+0000 7f34d37fe700 1 -- 172.21.15.40:0/3959287448 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34d4130fb0 msgr2=0x7f34d411dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:22.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.821+0000 7f34d37fe700 1 --2- 172.21.15.40:0/3959287448 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34d4130fb0 0x7f34d411dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:22.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.821+0000 7f34d37fe700 1 -- 172.21.15.40:0/3959287448 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c4009430 con 0x7f34d409e230 2023-09-30T22:26:22.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.822+0000 7f34d8e04700 1 --2- 172.21.15.40:0/3959287448 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34d4130fb0 0x7f34d411dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:22.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.822+0000 7f34d37fe700 1 --2- 172.21.15.40:0/3959287448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34d409e230 0x7f34d411d670 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f34c800c570 tx=0x7f34c800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:22.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.822+0000 7f34d0ff9700 1 -- 172.21.15.40:0/3959287448 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c8004c80 con 0x7f34d409e230 2023-09-30T22:26:22.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.822+0000 7f34d0ff9700 1 -- 172.21.15.40:0/3959287448 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c8004de0 con 0x7f34d409e230 2023-09-30T22:26:22.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.822+0000 7f34da867700 1 -- 172.21.15.40:0/3959287448 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34cc00bc80 con 0x7f34d409e230 2023-09-30T22:26:22.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.822+0000 7f34d0ff9700 1 -- 172.21.15.40:0/3959287448 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c80072f0 con 0x7f34d409e230 2023-09-30T22:26:22.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.822+0000 7f34da867700 1 -- 172.21.15.40:0/3959287448 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d411f370 con 0x7f34d409e230 2023-09-30T22:26:22.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.823+0000 7f34d0ff9700 1 -- 172.21.15.40:0/3959287448 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f34c8007450 con 0x7f34d409e230 2023-09-30T22:26:22.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.823+0000 7f34d0ff9700 1 -- 172.21.15.40:0/3959287448 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f34c803f550 con 0x7f34d409e230 2023-09-30T22:26:22.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.823+0000 7f34da867700 1 -- 172.21.15.40:0/3959287448 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34d4120520 con 0x7f34d409e230 2023-09-30T22:26:22.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.828+0000 7f34d0ff9700 1 -- 172.21.15.40:0/3959287448 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f34d4120520 con 0x7f34d409e230 2023-09-30T22:26:22.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.860+0000 7ff080db4700 1 -- 172.21.15.40:0/3690440958 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff07c124900 con 0x7ff07c09e230 2023-09-30T22:26:22.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.860+0000 7ff06affd700 1 -- 172.21.15.40:0/3690440958 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff070017070 con 0x7ff07c09e230 2023-09-30T22:26:22.861 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:22.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.862+0000 7ff080db4700 1 -- 172.21.15.40:0/3690440958 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff07c09e230 msgr2=0x7ff07c121a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:22.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.862+0000 7ff080db4700 1 --2- 172.21.15.40:0/3690440958 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff07c09e230 0x7ff07c121a50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff07000c4b0 tx=0x7ff07000c7c0 comp rx=0 tx=0).stop 2023-09-30T22:26:22.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.862+0000 7ff080db4700 1 -- 172.21.15.40:0/3690440958 shutdown_connections 2023-09-30T22:26:22.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.862+0000 7ff080db4700 1 --2- 172.21.15.40:0/3690440958 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff07c130fb0 0x7ff07c121f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:22.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.862+0000 7ff080db4700 1 --2- 172.21.15.40:0/3690440958 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff07c09d920 0x7ff07c121510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:22.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.862+0000 7ff080db4700 1 --2- 172.21.15.40:0/3690440958 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff07c09e230 0x7ff07c121a50 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:22.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.862+0000 7ff080db4700 1 -- 172.21.15.40:0/3690440958 >> 172.21.15.40:0/3690440958 conn(0x7ff07c09fb20 msgr2=0x7ff07c130060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:22.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.862+0000 7ff080db4700 1 -- 172.21.15.40:0/3690440958 shutdown_connections 2023-09-30T22:26:22.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.862+0000 7ff080db4700 1 -- 172.21.15.40:0/3690440958 wait complete. 2023-09-30T22:26:22.880 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:22.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.954+0000 7fdf091ab700 1 -- 172.21.15.40:0/1695421635 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdf04121220 con 0x7fdf041340c0 2023-09-30T22:26:22.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.954+0000 7fdeeb7fe700 1 -- 172.21.15.40:0/1695421635 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdefc01a020 con 0x7fdf041340c0 2023-09-30T22:26:22.955 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:22.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.956+0000 7fdf091ab700 1 -- 172.21.15.40:0/1695421635 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf041340c0 msgr2=0x7fdf0411e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:22.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.956+0000 7fdf091ab700 1 --2- 172.21.15.40:0/1695421635 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf041340c0 0x7fdf0411e810 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdefc00cef0 tx=0x7fdefc00cf20 comp rx=0 tx=0).stop 2023-09-30T22:26:22.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.956+0000 7fdf091ab700 1 -- 172.21.15.40:0/1695421635 shutdown_connections 2023-09-30T22:26:22.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.956+0000 7fdf091ab700 1 --2- 172.21.15.40:0/1695421635 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf041340c0 0x7fdf0411e810 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:22.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.956+0000 7fdf091ab700 1 --2- 172.21.15.40:0/1695421635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf0409d860 0x7fdf0411dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:22.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.956+0000 7fdf091ab700 1 --2- 172.21.15.40:0/1695421635 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf04133730 0x7fdf0411e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:22.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.956+0000 7fdf091ab700 1 -- 172.21.15.40:0/1695421635 >> 172.21.15.40:0/1695421635 conn(0x7fdf0406a6d0 msgr2=0x7fdf041bb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:22.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.956+0000 7fdf091ab700 1 -- 172.21.15.40:0/1695421635 shutdown_connections 2023-09-30T22:26:22.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:22.956+0000 7fdf091ab700 1 -- 172.21.15.40:0/1695421635 wait complete. 2023-09-30T22:26:22.969 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:23.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:23.023+0000 7f647c584700 1 -- 172.21.15.40:0/453000797 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6474124f00 con 0x7f64741222c0 2023-09-30T22:26:23.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:23.024+0000 7f646affd700 1 -- 172.21.15.40:0/453000797 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f646c01b400 con 0x7f64741222c0 2023-09-30T22:26:23.024 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:23.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:23.026+0000 7f647c584700 1 -- 172.21.15.40:0/453000797 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f64741222c0 msgr2=0x7f64741c8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:23.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:23.026+0000 7f647c584700 1 --2- 172.21.15.40:0/453000797 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f64741222c0 0x7f64741c8980 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f646c00cc80 tx=0x7f646c00a340 comp rx=0 tx=0).stop 2023-09-30T22:26:23.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:23.026+0000 7f647c584700 1 -- 172.21.15.40:0/453000797 shutdown_connections 2023-09-30T22:26:23.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:23.026+0000 7f647c584700 1 --2- 172.21.15.40:0/453000797 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f64741222c0 0x7f64741c8980 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:23.026+0000 7f647c584700 1 --2- 172.21.15.40:0/453000797 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f647409d920 0x7f6474121840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:23.026+0000 7f647c584700 1 --2- 172.21.15.40:0/453000797 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6474133ca0 0x7f6474121d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:23.026+0000 7f647c584700 1 -- 172.21.15.40:0/453000797 >> 172.21.15.40:0/453000797 conn(0x7f647409fb20 msgr2=0x7f64740a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:23.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:23.026+0000 7f647c584700 1 -- 172.21.15.40:0/453000797 shutdown_connections 2023-09-30T22:26:23.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:23.026+0000 7f647c584700 1 -- 172.21.15.40:0/453000797 wait complete. 2023-09-30T22:26:23.039 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:23.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:23.050+0000 7f34da867700 1 -- 172.21.15.40:0/3959287448 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f34d4120520 con 0x7f34d409e230 2023-09-30T22:26:23.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:23.050+0000 7f34d0ff9700 1 -- 172.21.15.40:0/3959287448 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f34d4120520 con 0x7f34d409e230 2023-09-30T22:26:23.051 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:23.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:23.052+0000 7f34da867700 1 -- 172.21.15.40:0/3959287448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34d409e230 msgr2=0x7f34d411d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:23.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:23.052+0000 7f34da867700 1 --2- 172.21.15.40:0/3959287448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34d409e230 0x7f34d411d670 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f34c800c570 tx=0x7f34c800c880 comp rx=0 tx=0).stop 2023-09-30T22:26:23.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:23.053+0000 7f34da867700 1 -- 172.21.15.40:0/3959287448 shutdown_connections 2023-09-30T22:26:23.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:23.053+0000 7f34da867700 1 --2- 172.21.15.40:0/3959287448 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f34d409d920 0x7f34d411d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:23.053+0000 7f34da867700 1 --2- 172.21.15.40:0/3959287448 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34d4130fb0 0x7f34d411dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:23.053+0000 7f34da867700 1 --2- 172.21.15.40:0/3959287448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34d409e230 0x7f34d411d670 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:23.053+0000 7f34da867700 1 -- 172.21.15.40:0/3959287448 >> 172.21.15.40:0/3959287448 conn(0x7f34d409fb20 msgr2=0x7f34d412fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:23.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:23.053+0000 7f34da867700 1 -- 172.21.15.40:0/3959287448 shutdown_connections 2023-09-30T22:26:23.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:23.053+0000 7f34da867700 1 -- 172.21.15.40:0/3959287448 wait complete. 2023-09-30T22:26:23.065 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:23.881 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:23.970 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:24.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.023+0000 7f606ce4a700 1 Processor -- start 2023-09-30T22:26:24.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.023+0000 7f606ce4a700 1 -- start start 2023-09-30T22:26:24.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.024+0000 7f606ce4a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6068131d50 0x7f6068132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.024+0000 7f606ce4a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f606809c7d0 0x7f6068139ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.024+0000 7f606ce4a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6068132660 con 0x7f606809bc50 2023-09-30T22:26:24.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.024+0000 7f606ce4a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60680719b0 con 0x7f606809c7d0 2023-09-30T22:26:24.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.024+0000 7f606ce4a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6068131900 con 0x7f6068131d50 2023-09-30T22:26:24.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.024+0000 7f606659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6068131d50 0x7f6068132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.024+0000 7f6066d9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f606809c7d0 0x7f6068139ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.024+0000 7f6066d9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f606809c7d0 0x7f6068139ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33262/0 (socket says 172.21.15.40:33262) 2023-09-30T22:26:24.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.024+0000 7f6066d9d700 1 -- 172.21.15.40:0/250320981 learned_addr learned my addr 172.21.15.40:0/250320981 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:24.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.024+0000 7f606659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6068131d50 0x7f6068132120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53428/0 (socket says 172.21.15.40:53428) 2023-09-30T22:26:24.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.025+0000 7f606659c700 1 -- 172.21.15.40:0/250320981 >> v2:172.21.15.40:3300/0 conn(0x7f606809c7d0 msgr2=0x7f6068139ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:24.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.025+0000 7f606659c700 1 --2- 172.21.15.40:0/250320981 >> v2:172.21.15.40:3300/0 conn(0x7f606809c7d0 0x7f6068139ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.025+0000 7f606659c700 1 -- 172.21.15.40:0/250320981 >> v1:172.21.15.40:6789/0 conn(0x7f606809bc50 legacy=0x7f606809c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.025+0000 7f606659c700 1 -- 172.21.15.40:0/250320981 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606809e820 con 0x7f6068131d50 2023-09-30T22:26:24.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.025+0000 7f6066d9d700 1 --2- 172.21.15.40:0/250320981 >> v2:172.21.15.40:3300/0 conn(0x7f606809c7d0 0x7f6068139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:24.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.025+0000 7f606659c700 1 --2- 172.21.15.40:0/250320981 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6068131d50 0x7f6068132120 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6058009840 tx=0x7f6058009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b0864b79bfbbd0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:24.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.025+0000 7f6065d9b700 1 -- 172.21.15.40:0/250320981 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6058011830 con 0x7f6068131d50 2023-09-30T22:26:24.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.025+0000 7f6065d9b700 1 -- 172.21.15.40:0/250320981 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6058011990 con 0x7f6068131d50 2023-09-30T22:26:24.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.025+0000 7f6065d9b700 1 -- 172.21.15.40:0/250320981 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6058011d20 con 0x7f6068131d50 2023-09-30T22:26:24.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.026+0000 7f606ce4a700 1 -- 172.21.15.40:0/250320981 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6068131d50 msgr2=0x7f6068132120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.026+0000 7f606ce4a700 1 --2- 172.21.15.40:0/250320981 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6068131d50 0x7f6068132120 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6058009840 tx=0x7f6058009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:24.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.026+0000 7f606ce4a700 1 -- 172.21.15.40:0/250320981 shutdown_connections 2023-09-30T22:26:24.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.026+0000 7f606ce4a700 1 --2- 172.21.15.40:0/250320981 >> v2:172.21.15.40:3300/0 conn(0x7f606809c7d0 0x7f6068139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.026+0000 7f606ce4a700 1 --2- 172.21.15.40:0/250320981 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6068131d50 0x7f6068132120 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.026+0000 7f606ce4a700 1 -- 172.21.15.40:0/250320981 >> 172.21.15.40:0/250320981 conn(0x7f60680a2a00 msgr2=0x7f60680a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:24.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.026+0000 7f606ce4a700 1 -- 172.21.15.40:0/250320981 shutdown_connections 2023-09-30T22:26:24.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.026+0000 7f606ce4a700 1 -- 172.21.15.40:0/250320981 wait complete. 2023-09-30T22:26:24.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.027+0000 7f606ce4a700 1 Processor -- start 2023-09-30T22:26:24.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.027+0000 7f606ce4a700 1 -- start start 2023-09-30T22:26:24.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.027+0000 7f606ce4a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f606809bc50 0x7f606811bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.027+0000 7f606ce4a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f606809c7d0 0x7f606811c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.028+0000 7f606ce4a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6068131d50 0x7f606811c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.028+0000 7f606ce4a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606809ead0 con 0x7f606809bc50 2023-09-30T22:26:24.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.028+0000 7f606ce4a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f606811d170 con 0x7f606809c7d0 2023-09-30T22:26:24.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.028+0000 7f606ce4a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f606811f520 con 0x7f6068131d50 2023-09-30T22:26:24.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.028+0000 7f605ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f606809c7d0 0x7f606811c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.028+0000 7f6066d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6068131d50 0x7f606811c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.028+0000 7f606659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f606809bc50 0x7f606811bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.028+0000 7f6066d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6068131d50 0x7f606811c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:37948/0 (socket says 172.21.15.40:37948) 2023-09-30T22:26:24.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.028+0000 7f606659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f606809bc50 0x7f606811bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33268/0 (socket says 172.21.15.40:33268) 2023-09-30T22:26:24.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.028+0000 7f605ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f606809c7d0 0x7f606811c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53444/0 (socket says 172.21.15.40:53444) 2023-09-30T22:26:24.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.028+0000 7f606659c700 1 -- 172.21.15.40:0/117967242 learned_addr learned my addr 172.21.15.40:0/117967242 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:24.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.028+0000 7f606659c700 1 -- 172.21.15.40:0/117967242 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6068131d50 msgr2=0x7f606811c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.028+0000 7f606659c700 1 --2- 172.21.15.40:0/117967242 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6068131d50 0x7f606811c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.028+0000 7f606659c700 1 -- 172.21.15.40:0/117967242 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f606809c7d0 msgr2=0x7f606811c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.028+0000 7f606659c700 1 --2- 172.21.15.40:0/117967242 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f606809c7d0 0x7f606811c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.028+0000 7f606659c700 1 -- 172.21.15.40:0/117967242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6060009b30 con 0x7f606809bc50 2023-09-30T22:26:24.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.028+0000 7f6066d9d700 1 --2- 172.21.15.40:0/117967242 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6068131d50 0x7f606811c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:24.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.028+0000 7f605ffff700 1 --2- 172.21.15.40:0/117967242 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f606809c7d0 0x7f606811c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:24.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.028+0000 7f606659c700 1 --2- 172.21.15.40:0/117967242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f606809bc50 0x7f606811bd30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f6058009fd0 tx=0x7f6058004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:24.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.028+0000 7f605effd700 1 -- 172.21.15.40:0/117967242 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60580036a0 con 0x7f606809bc50 2023-09-30T22:26:24.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.028+0000 7f605effd700 1 -- 172.21.15.40:0/117967242 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f605801f070 con 0x7f606809bc50 2023-09-30T22:26:24.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.028+0000 7f606ce4a700 1 -- 172.21.15.40:0/117967242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60580094a0 con 0x7f606809bc50 2023-09-30T22:26:24.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.028+0000 7f605effd700 1 -- 172.21.15.40:0/117967242 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6058003a60 con 0x7f606809bc50 2023-09-30T22:26:24.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.029+0000 7f606ce4a700 1 -- 172.21.15.40:0/117967242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f606811e160 con 0x7f606809bc50 2023-09-30T22:26:24.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.029+0000 7f605effd700 1 -- 172.21.15.40:0/117967242 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6058003bc0 con 0x7f606809bc50 2023-09-30T22:26:24.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.029+0000 7f605effd700 1 -- 172.21.15.40:0/117967242 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6058021070 con 0x7f606809bc50 2023-09-30T22:26:24.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.030+0000 7f606ce4a700 1 -- 172.21.15.40:0/117967242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6068062380 con 0x7f606809bc50 2023-09-30T22:26:24.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.034+0000 7f605effd700 1 -- 172.21.15.40:0/117967242 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6058015080 con 0x7f606809bc50 2023-09-30T22:26:24.040 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:24.066 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:24.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.107+0000 7fa5dfcb7700 1 Processor -- start 2023-09-30T22:26:24.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.108+0000 7fa5dfcb7700 1 -- start start 2023-09-30T22:26:24.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.108+0000 7fa5dfcb7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa5d806b1b0 0x7fa5d8136af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.108+0000 7fa5dfcb7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa5d8137030 0x7fa5d8139410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.108+0000 7fa5dfcb7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5d809eb50 con 0x7fa5d806a6d0 2023-09-30T22:26:24.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.108+0000 7fa5dfcb7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5d806b580 con 0x7fa5d8137030 2023-09-30T22:26:24.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.108+0000 7fa5dfcb7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d809dde0 con 0x7fa5d806b1b0 2023-09-30T22:26:24.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.108+0000 7fa5de254700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa5d8137030 0x7fa5d8139410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.108+0000 7fa5dd252700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa5d806b1b0 0x7fa5d8136af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.108+0000 7fa5de254700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa5d8137030 0x7fa5d8139410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33274/0 (socket says 172.21.15.40:33274) 2023-09-30T22:26:24.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.108+0000 7fa5dd252700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa5d806b1b0 0x7fa5d8136af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:37964/0 (socket says 172.21.15.40:37964) 2023-09-30T22:26:24.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.108+0000 7fa5de254700 1 -- 172.21.15.40:0/686659972 learned_addr learned my addr 172.21.15.40:0/686659972 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:24.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.109+0000 7fa5de254700 1 -- 172.21.15.40:0/686659972 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa5d806b1b0 msgr2=0x7fa5d8136af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:24.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.109+0000 7fa5de254700 1 --2- 172.21.15.40:0/686659972 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa5d806b1b0 0x7fa5d8136af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.109+0000 7fa5de254700 1 -- 172.21.15.40:0/686659972 >> v1:172.21.15.40:6789/0 conn(0x7fa5d806a6d0 legacy=0x7fa5d806aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.109+0000 7fa5de254700 1 -- 172.21.15.40:0/686659972 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d809d4a0 con 0x7fa5d8137030 2023-09-30T22:26:24.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.109+0000 7fa5de254700 1 --2- 172.21.15.40:0/686659972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5d8137030 0x7fa5d8139410 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0009e50 tx=0x7fa5d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=543cef0787ef4bac server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:24.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.109+0000 7fa5dca51700 1 -- 172.21.15.40:0/686659972 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d000e070 con 0x7fa5d8137030 2023-09-30T22:26:24.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.109+0000 7fa5dca51700 1 -- 172.21.15.40:0/686659972 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d000b910 con 0x7fa5d8137030 2023-09-30T22:26:24.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.109+0000 7fa5dca51700 1 -- 172.21.15.40:0/686659972 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d000bcc0 con 0x7fa5d8137030 2023-09-30T22:26:24.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.110+0000 7fa5dfcb7700 1 -- 172.21.15.40:0/686659972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5d8137030 msgr2=0x7fa5d8139410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.110+0000 7fa5dfcb7700 1 --2- 172.21.15.40:0/686659972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5d8137030 0x7fa5d8139410 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0009e50 tx=0x7fa5d000b330 comp rx=0 tx=0).stop 2023-09-30T22:26:24.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.110+0000 7fa5dfcb7700 1 -- 172.21.15.40:0/686659972 shutdown_connections 2023-09-30T22:26:24.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.110+0000 7fa5dfcb7700 1 --2- 172.21.15.40:0/686659972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5d8137030 0x7fa5d8139410 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.110+0000 7fa5dfcb7700 1 --2- 172.21.15.40:0/686659972 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa5d806b1b0 0x7fa5d8136af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.110+0000 7fa5dfcb7700 1 -- 172.21.15.40:0/686659972 >> 172.21.15.40:0/686659972 conn(0x7fa5d809fb20 msgr2=0x7fa5d809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:24.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.110+0000 7fa5dfcb7700 1 -- 172.21.15.40:0/686659972 shutdown_connections 2023-09-30T22:26:24.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.110+0000 7fa5dfcb7700 1 -- 172.21.15.40:0/686659972 wait complete. 2023-09-30T22:26:24.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.111+0000 7fa5dfcb7700 1 Processor -- start 2023-09-30T22:26:24.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.111+0000 7fa5dfcb7700 1 -- start start 2023-09-30T22:26:24.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.112+0000 7fa5dfcb7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5d806a6d0 0x7fa5d8119730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.112+0000 7fa5dfcb7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5d806b1b0 0x7fa5d8119c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.112+0000 7fa5dfcb7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa5d8137030 0x7fa5d811a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.112+0000 7fa5dfcb7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d8136d60 con 0x7fa5d806a6d0 2023-09-30T22:26:24.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.112+0000 7fa5dfcb7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d811aa50 con 0x7fa5d806b1b0 2023-09-30T22:26:24.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.112+0000 7fa5dfcb7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d811be10 con 0x7fa5d8137030 2023-09-30T22:26:24.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.112+0000 7fa5dd252700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5d806b1b0 0x7fa5d8119c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.112+0000 7fa5dd252700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5d806b1b0 0x7fa5d8119c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53454/0 (socket says 172.21.15.40:53454) 2023-09-30T22:26:24.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.112+0000 7fa5dd252700 1 -- 172.21.15.40:0/3491566121 learned_addr learned my addr 172.21.15.40:0/3491566121 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:24.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.112+0000 7fa5dd252700 1 -- 172.21.15.40:0/3491566121 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa5d8137030 msgr2=0x7fa5d811a1b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:26:24.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.112+0000 7fa5dd252700 1 --2- 172.21.15.40:0/3491566121 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa5d8137030 0x7fa5d811a1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.112+0000 7fa5dd252700 1 -- 172.21.15.40:0/3491566121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5d806a6d0 msgr2=0x7fa5d8119730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.112+0000 7fa5dd252700 1 --2- 172.21.15.40:0/3491566121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5d806a6d0 0x7fa5d8119730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.112+0000 7fa5dd252700 1 -- 172.21.15.40:0/3491566121 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d0009b30 con 0x7fa5d806b1b0 2023-09-30T22:26:24.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.112+0000 7fa5dd252700 1 --2- 172.21.15.40:0/3491566121 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5d806b1b0 0x7fa5d8119c70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa5c800dd40 tx=0x7fa5c80103a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:24.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.113+0000 7fa5ce7fc700 1 -- 172.21.15.40:0/3491566121 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c8010bb0 con 0x7fa5d806b1b0 2023-09-30T22:26:24.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.113+0000 7fa5ce7fc700 1 -- 172.21.15.40:0/3491566121 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c8013040 con 0x7fa5d806b1b0 2023-09-30T22:26:24.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.113+0000 7fa5dfcb7700 1 -- 172.21.15.40:0/3491566121 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5d809a210 con 0x7fa5d806b1b0 2023-09-30T22:26:24.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.113+0000 7fa5ce7fc700 1 -- 172.21.15.40:0/3491566121 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c800d2e0 con 0x7fa5d806b1b0 2023-09-30T22:26:24.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.113+0000 7fa5dfcb7700 1 -- 172.21.15.40:0/3491566121 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d811ac50 con 0x7fa5d806b1b0 2023-09-30T22:26:24.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.114+0000 7fa5dfcb7700 1 -- 172.21.15.40:0/3491566121 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5d8062380 con 0x7fa5d806b1b0 2023-09-30T22:26:24.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.114+0000 7fa5ce7fc700 1 -- 172.21.15.40:0/3491566121 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa5c8018480 con 0x7fa5d806b1b0 2023-09-30T22:26:24.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.117+0000 7fa5ce7fc700 1 -- 172.21.15.40:0/3491566121 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa5c8018910 con 0x7fa5d806b1b0 2023-09-30T22:26:24.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.120+0000 7fa5ce7fc700 1 -- 172.21.15.40:0/3491566121 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa5c8078750 con 0x7fa5d806b1b0 2023-09-30T22:26:24.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.201+0000 7f38d5c28700 1 Processor -- start 2023-09-30T22:26:24.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.201+0000 7f38d5c28700 1 -- start start 2023-09-30T22:26:24.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.202+0000 7f38d5c28700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38d009d920 0x7f38d009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.202+0000 7f38d5c28700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f38d009f0f0 0x7f38d009e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.202+0000 7f38d5c28700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d009f940 con 0x7f38d0133ca0 2023-09-30T22:26:24.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.202+0000 7f38d5c28700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d006b4c0 con 0x7f38d009f0f0 2023-09-30T22:26:24.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.202+0000 7f38d5c28700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d009a8f0 con 0x7f38d009d920 2023-09-30T22:26:24.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.202+0000 7f38cf7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38d009d920 0x7f38d009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.202+0000 7f38cf7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38d009d920 0x7f38d009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53470/0 (socket says 172.21.15.40:53470) 2023-09-30T22:26:24.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.202+0000 7f38cf7fe700 1 -- 172.21.15.40:0/895121186 learned_addr learned my addr 172.21.15.40:0/895121186 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:24.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.202+0000 7f38ceffd700 1 --2- 172.21.15.40:0/895121186 >> v2:172.21.15.40:3300/0 conn(0x7f38d009f0f0 0x7f38d009e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.202+0000 7f38ceffd700 1 -- 172.21.15.40:0/895121186 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38d009d920 msgr2=0x7f38d009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:24.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.202+0000 7f38ceffd700 1 --2- 172.21.15.40:0/895121186 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38d009d920 0x7f38d009dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.202+0000 7f38ceffd700 1 -- 172.21.15.40:0/895121186 >> v1:172.21.15.40:6789/0 conn(0x7f38d0133ca0 legacy=0x7f38d0134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.202+0000 7f38ceffd700 1 -- 172.21.15.40:0/895121186 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d009f6e0 con 0x7f38d009f0f0 2023-09-30T22:26:24.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.203+0000 7f38ceffd700 1 --2- 172.21.15.40:0/895121186 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38d009f0f0 0x7f38d009e230 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f38b8009870 tx=0x7f38b8009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3095646d7d93c549 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:24.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.203+0000 7f38ce7fc700 1 -- 172.21.15.40:0/895121186 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b8011830 con 0x7f38d009f0f0 2023-09-30T22:26:24.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.203+0000 7f38ce7fc700 1 -- 172.21.15.40:0/895121186 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b8011990 con 0x7f38d009f0f0 2023-09-30T22:26:24.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.203+0000 7f38ce7fc700 1 -- 172.21.15.40:0/895121186 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b8011d20 con 0x7f38d009f0f0 2023-09-30T22:26:24.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.203+0000 7f38d5c28700 1 -- 172.21.15.40:0/895121186 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38d009f0f0 msgr2=0x7f38d009e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.203+0000 7f38d5c28700 1 --2- 172.21.15.40:0/895121186 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38d009f0f0 0x7f38d009e230 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f38b8009870 tx=0x7f38b8009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:24.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.204+0000 7f38d5c28700 1 -- 172.21.15.40:0/895121186 shutdown_connections 2023-09-30T22:26:24.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.204+0000 7f38d5c28700 1 --2- 172.21.15.40:0/895121186 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38d009d920 0x7f38d009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.204+0000 7f38d5c28700 1 --2- 172.21.15.40:0/895121186 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38d009f0f0 0x7f38d009e230 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.204+0000 7f38d5c28700 1 -- 172.21.15.40:0/895121186 >> 172.21.15.40:0/895121186 conn(0x7f38d009fb20 msgr2=0x7f38d009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:24.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.204+0000 7f38d5c28700 1 -- 172.21.15.40:0/895121186 shutdown_connections 2023-09-30T22:26:24.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.204+0000 7f38d5c28700 1 -- 172.21.15.40:0/895121186 wait complete. 2023-09-30T22:26:24.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.205+0000 7f38d5c28700 1 Processor -- start 2023-09-30T22:26:24.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.205+0000 7f38d5c28700 1 -- start start 2023-09-30T22:26:24.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.206+0000 7f38d5c28700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f38d009d920 0x7f38d0120860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.206+0000 7f38d5c28700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38d0133ca0 0x7f38d0120da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.206+0000 7f38d5c28700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38d01212e0 0x7f38d01c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.206+0000 7f38d5c28700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d01240a0 con 0x7f38d01212e0 2023-09-30T22:26:24.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.206+0000 7f38d5c28700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d00a28c0 con 0x7f38d0133ca0 2023-09-30T22:26:24.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.206+0000 7f38d5c28700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38d0121ca0 con 0x7f38d009d920 2023-09-30T22:26:24.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.206+0000 7f38cf7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f38d009d920 0x7f38d0120860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.206+0000 7f38cf7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f38d009d920 0x7f38d0120860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:37966/0 (socket says 172.21.15.40:37966) 2023-09-30T22:26:24.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.206+0000 7f38cf7fe700 1 -- 172.21.15.40:0/1611661350 learned_addr learned my addr 172.21.15.40:0/1611661350 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:24.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.206+0000 7f38cffff700 1 --2- 172.21.15.40:0/1611661350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38d01212e0 0x7f38d01c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.206+0000 7f38ceffd700 1 --2- 172.21.15.40:0/1611661350 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38d0133ca0 0x7f38d0120da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.207+0000 7f38cf7fe700 1 -- 172.21.15.40:0/1611661350 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38d0133ca0 msgr2=0x7f38d0120da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.207+0000 7f38cf7fe700 1 --2- 172.21.15.40:0/1611661350 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38d0133ca0 0x7f38d0120da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.207+0000 7f38cf7fe700 1 -- 172.21.15.40:0/1611661350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38d01212e0 msgr2=0x7f38d01c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.207+0000 7f38cf7fe700 1 --2- 172.21.15.40:0/1611661350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38d01212e0 0x7f38d01c8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.207+0000 7f38cf7fe700 1 -- 172.21.15.40:0/1611661350 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b80094a0 con 0x7f38d009d920 2023-09-30T22:26:24.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.207+0000 7f38cf7fe700 1 --2- 172.21.15.40:0/1611661350 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f38d009d920 0x7f38d0120860 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f38c000e820 tx=0x7f38c000eb30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:24.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.207+0000 7f38c7fff700 1 -- 172.21.15.40:0/1611661350 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c0013680 con 0x7f38d009d920 2023-09-30T22:26:24.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.207+0000 7f38d5c28700 1 -- 172.21.15.40:0/1611661350 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d0122580 con 0x7f38d009d920 2023-09-30T22:26:24.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.207+0000 7f38d5c28700 1 -- 172.21.15.40:0/1611661350 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d0122a20 con 0x7f38d009d920 2023-09-30T22:26:24.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.207+0000 7f38c7fff700 1 -- 172.21.15.40:0/1611661350 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c00137e0 con 0x7f38d009d920 2023-09-30T22:26:24.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.207+0000 7f38c7fff700 1 -- 172.21.15.40:0/1611661350 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c0013b50 con 0x7f38d009d920 2023-09-30T22:26:24.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.209+0000 7f38d5c28700 1 -- 172.21.15.40:0/1611661350 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38b40052e0 con 0x7f38d009d920 2023-09-30T22:26:24.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.209+0000 7f38c7fff700 1 -- 172.21.15.40:0/1611661350 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f38c0013cb0 con 0x7f38d009d920 2023-09-30T22:26:24.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.209+0000 7f38c7fff700 1 -- 172.21.15.40:0/1611661350 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f38c003fe50 con 0x7f38d009d920 2023-09-30T22:26:24.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.218+0000 7f38c7fff700 1 -- 172.21.15.40:0/1611661350 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f38c001c970 con 0x7f38d009d920 2023-09-30T22:26:24.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.220+0000 7f211d0e5700 1 Processor -- start 2023-09-30T22:26:24.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.220+0000 7f211d0e5700 1 -- start start 2023-09-30T22:26:24.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.221+0000 7f211d0e5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f211809c890 0x7f211809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.221+0000 7f211d0e5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f211809d920 0x7f211809dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.221+0000 7f211d0e5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21180a2600 con 0x7f211809e2b0 2023-09-30T22:26:24.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.221+0000 7f211d0e5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21180a29d0 con 0x7f211809d920 2023-09-30T22:26:24.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.221+0000 7f211d0e5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f211809fb40 con 0x7f211809c890 2023-09-30T22:26:24.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.221+0000 7f2116d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f211809c890 0x7f211809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.221+0000 7f2116d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f211809c890 0x7f211809cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:37982/0 (socket says 172.21.15.40:37982) 2023-09-30T22:26:24.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.221+0000 7f2116d9d700 1 -- 172.21.15.40:0/386927486 learned_addr learned my addr 172.21.15.40:0/386927486 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:24.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.221+0000 7f211659c700 1 --2- 172.21.15.40:0/386927486 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f211809d920 0x7f211809dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.221+0000 7f2116d9d700 1 -- 172.21.15.40:0/386927486 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f211809d920 msgr2=0x7f211809dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:24.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.221+0000 7f2116d9d700 1 --2- 172.21.15.40:0/386927486 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f211809d920 0x7f211809dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.221+0000 7f2116d9d700 1 -- 172.21.15.40:0/386927486 >> v1:172.21.15.40:6789/0 conn(0x7f211809e2b0 legacy=0x7f211813ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.221+0000 7f2116d9d700 1 -- 172.21.15.40:0/386927486 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211809e720 con 0x7f211809c890 2023-09-30T22:26:24.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.221+0000 7f211659c700 1 --2- 172.21.15.40:0/386927486 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f211809d920 0x7f211809dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:26:24.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.222+0000 7f2116d9d700 1 --2- 172.21.15.40:0/386927486 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f211809c890 0x7f211809cc60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f21080098f0 tx=0x7f2108009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57830b03da859b85 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:24.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.226+0000 7f2115d9b700 1 -- 172.21.15.40:0/386927486 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2108005e30 con 0x7f211809c890 2023-09-30T22:26:24.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.226+0000 7f2115d9b700 1 -- 172.21.15.40:0/386927486 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2108004030 con 0x7f211809c890 2023-09-30T22:26:24.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.226+0000 7f2115d9b700 1 -- 172.21.15.40:0/386927486 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21080043e0 con 0x7f211809c890 2023-09-30T22:26:24.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.226+0000 7f211d0e5700 1 -- 172.21.15.40:0/386927486 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f211809c890 msgr2=0x7f211809cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.226+0000 7f211d0e5700 1 --2- 172.21.15.40:0/386927486 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f211809c890 0x7f211809cc60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f21080098f0 tx=0x7f2108009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:24.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.226+0000 7f211d0e5700 1 -- 172.21.15.40:0/386927486 shutdown_connections 2023-09-30T22:26:24.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.226+0000 7f211d0e5700 1 --2- 172.21.15.40:0/386927486 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f211809c890 0x7f211809cc60 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.226+0000 7f211d0e5700 1 --2- 172.21.15.40:0/386927486 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f211809d920 0x7f211809dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.226+0000 7f211d0e5700 1 -- 172.21.15.40:0/386927486 >> 172.21.15.40:0/386927486 conn(0x7f21180a7080 msgr2=0x7f21180a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:24.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.227+0000 7f211d0e5700 1 -- 172.21.15.40:0/386927486 shutdown_connections 2023-09-30T22:26:24.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.227+0000 7f211d0e5700 1 -- 172.21.15.40:0/386927486 wait complete. 2023-09-30T22:26:24.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.228+0000 7f211d0e5700 1 Processor -- start 2023-09-30T22:26:24.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.228+0000 7f211d0e5700 1 -- start start 2023-09-30T22:26:24.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.228+0000 7f211d0e5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f211809c890 0x7f211809a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.228+0000 7f211d0e5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f211809d920 0x7f211809ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.228+0000 7f211d0e5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f211809e2b0 0x7f211809b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.228+0000 7f211d0e5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211809bce0 con 0x7f211809e2b0 2023-09-30T22:26:24.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.228+0000 7f211d0e5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211806e080 con 0x7f211809d920 2023-09-30T22:26:24.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.228+0000 7f211d0e5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21180a5d70 con 0x7f211809c890 2023-09-30T22:26:24.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.228+0000 7f2116d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f211809c890 0x7f211809a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.228+0000 7f211659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f211809d920 0x7f211809ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.229+0000 7f2116d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f211809c890 0x7f211809a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:37988/0 (socket says 172.21.15.40:37988) 2023-09-30T22:26:24.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.229+0000 7f2116d9d700 1 -- 172.21.15.40:0/2082068914 learned_addr learned my addr 172.21.15.40:0/2082068914 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:24.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.229+0000 7f211759e700 1 --2- 172.21.15.40:0/2082068914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f211809e2b0 0x7f211809b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.229+0000 7f2116d9d700 1 -- 172.21.15.40:0/2082068914 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f211809d920 msgr2=0x7f211809ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.229+0000 7f2116d9d700 1 --2- 172.21.15.40:0/2082068914 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f211809d920 0x7f211809ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.229+0000 7f2116d9d700 1 -- 172.21.15.40:0/2082068914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f211809e2b0 msgr2=0x7f211809b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.229+0000 7f2116d9d700 1 --2- 172.21.15.40:0/2082068914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f211809e2b0 0x7f211809b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.229+0000 7f2116d9d700 1 -- 172.21.15.40:0/2082068914 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2108009500 con 0x7f211809c890 2023-09-30T22:26:24.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.229+0000 7f211659c700 1 --2- 172.21.15.40:0/2082068914 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f211809d920 0x7f211809ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:24.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.229+0000 7f2116d9d700 1 --2- 172.21.15.40:0/2082068914 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f211809c890 0x7f211809a910 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2108009c40 tx=0x7f2108004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:24.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.229+0000 7f20ff7fe700 1 -- 172.21.15.40:0/2082068914 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210800b490 con 0x7f211809c890 2023-09-30T22:26:24.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.229+0000 7f211d0e5700 1 -- 172.21.15.40:0/2082068914 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f211806e700 con 0x7f211809c890 2023-09-30T22:26:24.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.229+0000 7f211d0e5700 1 -- 172.21.15.40:0/2082068914 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f211809ecf0 con 0x7f211809c890 2023-09-30T22:26:24.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.229+0000 7f20ff7fe700 1 -- 172.21.15.40:0/2082068914 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210800b5f0 con 0x7f211809c890 2023-09-30T22:26:24.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.229+0000 7f20ff7fe700 1 -- 172.21.15.40:0/2082068914 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210800b9a0 con 0x7f211809c890 2023-09-30T22:26:24.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.230+0000 7f211d0e5700 1 -- 172.21.15.40:0/2082068914 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f80052e0 con 0x7f211809c890 2023-09-30T22:26:24.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.230+0000 7f20ff7fe700 1 -- 172.21.15.40:0/2082068914 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f210800bb00 con 0x7f211809c890 2023-09-30T22:26:24.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.231+0000 7f20ff7fe700 1 -- 172.21.15.40:0/2082068914 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f2108040940 con 0x7f211809c890 2023-09-30T22:26:24.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.240+0000 7f20ff7fe700 1 -- 172.21.15.40:0/2082068914 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f210800bdb0 con 0x7f211809c890 2023-09-30T22:26:24.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.246+0000 7f606ce4a700 1 -- 172.21.15.40:0/117967242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f606812c800 con 0x7f606809bc50 2023-09-30T22:26:24.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.246+0000 7f605effd700 1 -- 172.21.15.40:0/117967242 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f605802b020 con 0x7f606809bc50 2023-09-30T22:26:24.247 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:24.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.248+0000 7f606ce4a700 1 -- 172.21.15.40:0/117967242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f606809bc50 msgr2=0x7f606811bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.248+0000 7f606ce4a700 1 --2- 172.21.15.40:0/117967242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f606809bc50 0x7f606811bd30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f6058009fd0 tx=0x7f6058004750 comp rx=0 tx=0).stop 2023-09-30T22:26:24.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.248+0000 7f606ce4a700 1 -- 172.21.15.40:0/117967242 shutdown_connections 2023-09-30T22:26:24.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.248+0000 7f606ce4a700 1 --2- 172.21.15.40:0/117967242 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6068131d50 0x7f606811c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.248+0000 7f606ce4a700 1 --2- 172.21.15.40:0/117967242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f606809bc50 0x7f606811bd30 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.248+0000 7f606ce4a700 1 --2- 172.21.15.40:0/117967242 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f606809c7d0 0x7f606811c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.248+0000 7f606ce4a700 1 -- 172.21.15.40:0/117967242 >> 172.21.15.40:0/117967242 conn(0x7f60680a2a00 msgr2=0x7f606812f680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:24.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.248+0000 7f606ce4a700 1 -- 172.21.15.40:0/117967242 shutdown_connections 2023-09-30T22:26:24.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.248+0000 7f606ce4a700 1 -- 172.21.15.40:0/117967242 wait complete. 2023-09-30T22:26:24.262 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:24.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.385+0000 7fa5dfcb7700 1 -- 172.21.15.40:0/3491566121 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa5d80715a0 con 0x7fa5d806b1b0 2023-09-30T22:26:24.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.386+0000 7fa5ce7fc700 1 -- 172.21.15.40:0/3491566121 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa5d80715a0 con 0x7fa5d806b1b0 2023-09-30T22:26:24.386 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:24.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.388+0000 7fa5dfcb7700 1 -- 172.21.15.40:0/3491566121 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5d806b1b0 msgr2=0x7fa5d8119c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.388+0000 7fa5dfcb7700 1 --2- 172.21.15.40:0/3491566121 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5d806b1b0 0x7fa5d8119c70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa5c800dd40 tx=0x7fa5c80103a0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.388+0000 7fa5dfcb7700 1 -- 172.21.15.40:0/3491566121 shutdown_connections 2023-09-30T22:26:24.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.388+0000 7fa5dfcb7700 1 --2- 172.21.15.40:0/3491566121 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa5d8137030 0x7fa5d811a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.388+0000 7fa5dfcb7700 1 --2- 172.21.15.40:0/3491566121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5d806a6d0 0x7fa5d8119730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.388+0000 7fa5dfcb7700 1 --2- 172.21.15.40:0/3491566121 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5d806b1b0 0x7fa5d8119c70 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.388+0000 7fa5dfcb7700 1 -- 172.21.15.40:0/3491566121 >> 172.21.15.40:0/3491566121 conn(0x7fa5d809fb20 msgr2=0x7fa5d80a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:24.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.388+0000 7fa5dfcb7700 1 -- 172.21.15.40:0/3491566121 shutdown_connections 2023-09-30T22:26:24.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.388+0000 7fa5dfcb7700 1 -- 172.21.15.40:0/3491566121 wait complete. 2023-09-30T22:26:24.401 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:24.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.438+0000 7f211d0e5700 1 -- 172.21.15.40:0/2082068914 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f20f8005590 con 0x7f211809c890 2023-09-30T22:26:24.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.438+0000 7f20ff7fe700 1 -- 172.21.15.40:0/2082068914 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f210802a070 con 0x7f211809c890 2023-09-30T22:26:24.439 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:24.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.440+0000 7f211d0e5700 1 -- 172.21.15.40:0/2082068914 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f211809c890 msgr2=0x7f211809a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.440+0000 7f211d0e5700 1 --2- 172.21.15.40:0/2082068914 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f211809c890 0x7f211809a910 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2108009c40 tx=0x7f2108004750 comp rx=0 tx=0).stop 2023-09-30T22:26:24.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.440+0000 7f211d0e5700 1 -- 172.21.15.40:0/2082068914 shutdown_connections 2023-09-30T22:26:24.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.440+0000 7f211d0e5700 1 --2- 172.21.15.40:0/2082068914 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f211809c890 0x7f211809a910 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.440+0000 7f211d0e5700 1 --2- 172.21.15.40:0/2082068914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f211809e2b0 0x7f211809b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.440+0000 7f211d0e5700 1 --2- 172.21.15.40:0/2082068914 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f211809d920 0x7f211809ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.440+0000 7f211d0e5700 1 -- 172.21.15.40:0/2082068914 >> 172.21.15.40:0/2082068914 conn(0x7f21180a7080 msgr2=0x7f2118132970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:24.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.440+0000 7f211d0e5700 1 -- 172.21.15.40:0/2082068914 shutdown_connections 2023-09-30T22:26:24.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.440+0000 7f211d0e5700 1 -- 172.21.15.40:0/2082068914 wait complete. 2023-09-30T22:26:24.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.446+0000 7f38d5c28700 1 -- 172.21.15.40:0/1611661350 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f38b4005590 con 0x7f38d009d920 2023-09-30T22:26:24.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.446+0000 7f38c7fff700 1 -- 172.21.15.40:0/1611661350 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f38c0017020 con 0x7f38d009d920 2023-09-30T22:26:24.447 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:24.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.448+0000 7f38d5c28700 1 -- 172.21.15.40:0/1611661350 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f38d009d920 msgr2=0x7f38d0120860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.448+0000 7f38d5c28700 1 --2- 172.21.15.40:0/1611661350 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f38d009d920 0x7f38d0120860 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f38c000e820 tx=0x7f38c000eb30 comp rx=0 tx=0).stop 2023-09-30T22:26:24.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.448+0000 7f38d5c28700 1 -- 172.21.15.40:0/1611661350 shutdown_connections 2023-09-30T22:26:24.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.448+0000 7f38d5c28700 1 --2- 172.21.15.40:0/1611661350 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f38d009d920 0x7f38d0120860 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.448+0000 7f38d5c28700 1 --2- 172.21.15.40:0/1611661350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38d01212e0 0x7f38d01c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.448+0000 7f38d5c28700 1 --2- 172.21.15.40:0/1611661350 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38d0133ca0 0x7f38d0120da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.448+0000 7f38d5c28700 1 -- 172.21.15.40:0/1611661350 >> 172.21.15.40:0/1611661350 conn(0x7f38d009fb20 msgr2=0x7f38d00a1940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:24.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.448+0000 7f38d5c28700 1 -- 172.21.15.40:0/1611661350 shutdown_connections 2023-09-30T22:26:24.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:24.448+0000 7f38d5c28700 1 -- 172.21.15.40:0/1611661350 wait complete. 2023-09-30T22:26:24.454 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:24.461 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:25.265 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:25.403 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:25.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.405+0000 7fb319c14700 1 Processor -- start 2023-09-30T22:26:25.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.405+0000 7fb319c14700 1 -- start start 2023-09-30T22:26:25.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.406+0000 7fb319c14700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb31412e590 0x7fb31412e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.406+0000 7fb319c14700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb31412eea0 0x7fb31412d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.406+0000 7fb319c14700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb31409ab70 con 0x7fb31412d6d0 2023-09-30T22:26:25.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.406+0000 7fb319c14700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb31409b270 con 0x7fb31412eea0 2023-09-30T22:26:25.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.406+0000 7fb319c14700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb31409bab0 con 0x7fb31412e590 2023-09-30T22:26:25.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.406+0000 7fb3137fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb31412e590 0x7fb31412e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.406+0000 7fb312ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb31412eea0 0x7fb31412d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.406+0000 7fb3137fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb31412e590 0x7fb31412e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:38000/0 (socket says 172.21.15.40:38000) 2023-09-30T22:26:25.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.406+0000 7fb3137fe700 1 -- 172.21.15.40:0/3956820174 learned_addr learned my addr 172.21.15.40:0/3956820174 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:25.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.407+0000 7fb312ffd700 1 -- 172.21.15.40:0/3956820174 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb31412e590 msgr2=0x7fb31412e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:25.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.407+0000 7fb312ffd700 1 --2- 172.21.15.40:0/3956820174 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb31412e590 0x7fb31412e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.407+0000 7fb312ffd700 1 -- 172.21.15.40:0/3956820174 >> v1:172.21.15.40:6789/0 conn(0x7fb31412d6d0 legacy=0x7fb314137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:25.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.407+0000 7fb312ffd700 1 -- 172.21.15.40:0/3956820174 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31409bd70 con 0x7fb31412eea0 2023-09-30T22:26:25.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.407+0000 7fb3137fe700 1 --2- 172.21.15.40:0/3956820174 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb31412e590 0x7fb31412e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:25.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.407+0000 7fb312ffd700 1 --2- 172.21.15.40:0/3956820174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb31412eea0 0x7fb31412d190 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb308009870 tx=0x7fb308009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2cebf993bd25799 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:25.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.407+0000 7fb3127fc700 1 -- 172.21.15.40:0/3956820174 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb308011830 con 0x7fb31412eea0 2023-09-30T22:26:25.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.407+0000 7fb3127fc700 1 -- 172.21.15.40:0/3956820174 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb308011990 con 0x7fb31412eea0 2023-09-30T22:26:25.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.407+0000 7fb3127fc700 1 -- 172.21.15.40:0/3956820174 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb308011d20 con 0x7fb31412eea0 2023-09-30T22:26:25.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.408+0000 7fb319c14700 1 -- 172.21.15.40:0/3956820174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb31412eea0 msgr2=0x7fb31412d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:25.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.408+0000 7fb319c14700 1 --2- 172.21.15.40:0/3956820174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb31412eea0 0x7fb31412d190 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb308009870 tx=0x7fb308009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:25.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.408+0000 7fb319c14700 1 -- 172.21.15.40:0/3956820174 shutdown_connections 2023-09-30T22:26:25.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.408+0000 7fb319c14700 1 --2- 172.21.15.40:0/3956820174 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb31412e590 0x7fb31412e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.408+0000 7fb319c14700 1 --2- 172.21.15.40:0/3956820174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb31412eea0 0x7fb31412d190 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.408+0000 7fb319c14700 1 -- 172.21.15.40:0/3956820174 >> 172.21.15.40:0/3956820174 conn(0x7fb3140a2a00 msgr2=0x7fb3140a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:25.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.408+0000 7fb319c14700 1 -- 172.21.15.40:0/3956820174 shutdown_connections 2023-09-30T22:26:25.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.408+0000 7fb319c14700 1 -- 172.21.15.40:0/3956820174 wait complete. 2023-09-30T22:26:25.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.409+0000 7fb319c14700 1 Processor -- start 2023-09-30T22:26:25.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.409+0000 7fb319c14700 1 -- start start 2023-09-30T22:26:25.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.410+0000 7fb319c14700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb31412d6d0 0x7fb31406f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.410+0000 7fb319c14700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb31412e590 0x7fb31406fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.410+0000 7fb319c14700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb31412eea0 0x7fb314070360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.410+0000 7fb319c14700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb314127bc0 con 0x7fb31412d6d0 2023-09-30T22:26:25.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.410+0000 7fb319c14700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3140713a0 con 0x7fb31412e590 2023-09-30T22:26:25.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.410+0000 7fb319c14700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb314129440 con 0x7fb31412eea0 2023-09-30T22:26:25.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.410+0000 7fb312ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb31412e590 0x7fb31406fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.410+0000 7fb313fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb31412eea0 0x7fb314070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.410+0000 7fb312ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb31412e590 0x7fb31406fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53506/0 (socket says 172.21.15.40:53506) 2023-09-30T22:26:25.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.410+0000 7fb312ffd700 1 -- 172.21.15.40:0/2042323140 learned_addr learned my addr 172.21.15.40:0/2042323140 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:25.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.410+0000 7fb3137fe700 1 --2- 172.21.15.40:0/2042323140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb31412d6d0 0x7fb31406f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.410+0000 7fb313fff700 1 -- 172.21.15.40:0/2042323140 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb31412e590 msgr2=0x7fb31406fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:25.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.410+0000 7fb313fff700 1 --2- 172.21.15.40:0/2042323140 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb31412e590 0x7fb31406fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.410+0000 7fb313fff700 1 -- 172.21.15.40:0/2042323140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb31412d6d0 msgr2=0x7fb31406f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:25.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.410+0000 7fb313fff700 1 --2- 172.21.15.40:0/2042323140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb31412d6d0 0x7fb31406f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.410+0000 7fb313fff700 1 -- 172.21.15.40:0/2042323140 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb304009550 con 0x7fb31412eea0 2023-09-30T22:26:25.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.410+0000 7fb3137fe700 1 --2- 172.21.15.40:0/2042323140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb31412d6d0 0x7fb31406f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:25.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.411+0000 7fb313fff700 1 --2- 172.21.15.40:0/2042323140 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb31412eea0 0x7fb314070360 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb30c00cae0 tx=0x7fb30c00cdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:25.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.411+0000 7fb2fbfff700 1 -- 172.21.15.40:0/2042323140 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30c003c00 con 0x7fb31412eea0 2023-09-30T22:26:25.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.411+0000 7fb2fbfff700 1 -- 172.21.15.40:0/2042323140 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30c003d60 con 0x7fb31412eea0 2023-09-30T22:26:25.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.411+0000 7fb319c14700 1 -- 172.21.15.40:0/2042323140 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3080094a0 con 0x7fb31412eea0 2023-09-30T22:26:25.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.411+0000 7fb2fbfff700 1 -- 172.21.15.40:0/2042323140 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30c00aa20 con 0x7fb31412eea0 2023-09-30T22:26:25.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.411+0000 7fb319c14700 1 -- 172.21.15.40:0/2042323140 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb314128f20 con 0x7fb31412eea0 2023-09-30T22:26:25.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.412+0000 7fb319c14700 1 -- 172.21.15.40:0/2042323140 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3141278a0 con 0x7fb31412eea0 2023-09-30T22:26:25.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.412+0000 7fb2fbfff700 1 -- 172.21.15.40:0/2042323140 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb30c00ab80 con 0x7fb31412eea0 2023-09-30T22:26:25.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.412+0000 7fb2fbfff700 1 -- 172.21.15.40:0/2042323140 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb30c040380 con 0x7fb31412eea0 2023-09-30T22:26:25.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.417+0000 7fb2fbfff700 1 -- 172.21.15.40:0/2042323140 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb30c00ae30 con 0x7fb31412eea0 2023-09-30T22:26:25.454 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:25.462 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:25.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.543+0000 7f644df3f700 1 Processor -- start 2023-09-30T22:26:25.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.543+0000 7f644df3f700 1 -- start start 2023-09-30T22:26:25.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.543+0000 7f644df3f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f644809df30 0x7f6448135400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.543+0000 7f644df3f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6448135940 0x7f6448137d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.543+0000 7f644df3f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f644809e8b0 con 0x7f644809d450 2023-09-30T22:26:25.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.544+0000 7f644df3f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f644809c3b0 con 0x7f6448135940 2023-09-30T22:26:25.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.544+0000 7f644df3f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644809a6b0 con 0x7f644809df30 2023-09-30T22:26:25.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.544+0000 7f6447fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6448135940 0x7f6448137d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.544+0000 7f6447fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6448135940 0x7f6448137d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33330/0 (socket says 172.21.15.40:33330) 2023-09-30T22:26:25.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.544+0000 7f6447fff700 1 -- 172.21.15.40:0/1608284630 learned_addr learned my addr 172.21.15.40:0/1608284630 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:25.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.544+0000 7f6447fff700 1 -- 172.21.15.40:0/1608284630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f644809df30 msgr2=0x7f6448135400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:25.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.544+0000 7f6447fff700 1 --2- 172.21.15.40:0/1608284630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f644809df30 0x7f6448135400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.544+0000 7f6447fff700 1 -- 172.21.15.40:0/1608284630 >> v1:172.21.15.40:6789/0 conn(0x7f644809d450 legacy=0x7f644809d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:25.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.544+0000 7f6447fff700 1 -- 172.21.15.40:0/1608284630 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644809b4f0 con 0x7f6448135940 2023-09-30T22:26:25.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.544+0000 7f6447fff700 1 --2- 172.21.15.40:0/1608284630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6448135940 0x7f6448137d20 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6440009e50 tx=0x7f644000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e7624d4630ce85 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:25.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.544+0000 7f64467fc700 1 -- 172.21.15.40:0/1608284630 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644000e070 con 0x7f6448135940 2023-09-30T22:26:25.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.545+0000 7f64467fc700 1 -- 172.21.15.40:0/1608284630 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644000b9c0 con 0x7f6448135940 2023-09-30T22:26:25.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.545+0000 7f64467fc700 1 -- 172.21.15.40:0/1608284630 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644000bd70 con 0x7f6448135940 2023-09-30T22:26:25.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.545+0000 7f644df3f700 1 -- 172.21.15.40:0/1608284630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6448135940 msgr2=0x7f6448137d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:25.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.545+0000 7f644df3f700 1 --2- 172.21.15.40:0/1608284630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6448135940 0x7f6448137d20 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6440009e50 tx=0x7f644000b330 comp rx=0 tx=0).stop 2023-09-30T22:26:25.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.545+0000 7f644df3f700 1 -- 172.21.15.40:0/1608284630 shutdown_connections 2023-09-30T22:26:25.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.546+0000 7f644df3f700 1 --2- 172.21.15.40:0/1608284630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6448135940 0x7f6448137d20 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.546+0000 7f644df3f700 1 --2- 172.21.15.40:0/1608284630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f644809df30 0x7f6448135400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.546+0000 7f644df3f700 1 -- 172.21.15.40:0/1608284630 >> 172.21.15.40:0/1608284630 conn(0x7f64480a2a00 msgr2=0x7f64480a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:25.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.546+0000 7f644df3f700 1 -- 172.21.15.40:0/1608284630 shutdown_connections 2023-09-30T22:26:25.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.546+0000 7f644df3f700 1 -- 172.21.15.40:0/1608284630 wait complete. 2023-09-30T22:26:25.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.547+0000 7f644df3f700 1 Processor -- start 2023-09-30T22:26:25.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.547+0000 7f644df3f700 1 -- start start 2023-09-30T22:26:25.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.548+0000 7f644df3f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f644809d450 0x7f6448138030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.548+0000 7f644df3f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f644809df30 0x7f6448138570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.548+0000 7f644df3f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6448135940 0x7f6448138ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.548+0000 7f644df3f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644813bab0 con 0x7f644809df30 2023-09-30T22:26:25.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.548+0000 7f644df3f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6448139ba0 con 0x7f644809d450 2023-09-30T22:26:25.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.548+0000 7f644df3f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f64480a1e70 con 0x7f6448135940 2023-09-30T22:26:25.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.548+0000 7f64477fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f644809d450 0x7f6448138030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.548+0000 7f6446ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f644809df30 0x7f6448138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.548+0000 7f64477fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f644809d450 0x7f6448138030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53528/0 (socket says 172.21.15.40:53528) 2023-09-30T22:26:25.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.548+0000 7f64477fe700 1 -- 172.21.15.40:0/3266879167 learned_addr learned my addr 172.21.15.40:0/3266879167 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:25.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.548+0000 7f6446ffd700 1 -- 172.21.15.40:0/3266879167 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6448135940 msgr2=0x7f6448138ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:25.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.548+0000 7f6446ffd700 1 --2- 172.21.15.40:0/3266879167 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6448135940 0x7f6448138ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.548+0000 7f6446ffd700 1 -- 172.21.15.40:0/3266879167 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f644809d450 msgr2=0x7f6448138030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:25.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.548+0000 7f6446ffd700 1 --2- 172.21.15.40:0/3266879167 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f644809d450 0x7f6448138030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.548+0000 7f6446ffd700 1 -- 172.21.15.40:0/3266879167 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6440009b30 con 0x7f644809df30 2023-09-30T22:26:25.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.549+0000 7f6446ffd700 1 --2- 172.21.15.40:0/3266879167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f644809df30 0x7f6448138570 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f643c00b450 tx=0x7f643c00b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:25.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.549+0000 7f642ffff700 1 -- 172.21.15.40:0/3266879167 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c011830 con 0x7f644809df30 2023-09-30T22:26:25.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.549+0000 7f642ffff700 1 -- 172.21.15.40:0/3266879167 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643c011990 con 0x7f644809df30 2023-09-30T22:26:25.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.549+0000 7f642ffff700 1 -- 172.21.15.40:0/3266879167 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c011d40 con 0x7f644809df30 2023-09-30T22:26:25.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.549+0000 7f644df3f700 1 -- 172.21.15.40:0/3266879167 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f644809c5d0 con 0x7f644809df30 2023-09-30T22:26:25.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.549+0000 7f644df3f700 1 -- 172.21.15.40:0/3266879167 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f644813a350 con 0x7f644809df30 2023-09-30T22:26:25.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.550+0000 7f642ffff700 1 -- 172.21.15.40:0/3266879167 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f643c01a400 con 0x7f644809df30 2023-09-30T22:26:25.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.550+0000 7f642ffff700 1 -- 172.21.15.40:0/3266879167 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f643c03f790 con 0x7f644809df30 2023-09-30T22:26:25.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.550+0000 7f644df3f700 1 -- 172.21.15.40:0/3266879167 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f644813b630 con 0x7f644809df30 2023-09-30T22:26:25.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.555+0000 7f642ffff700 1 -- 172.21.15.40:0/3266879167 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f644813b630 con 0x7f644809df30 2023-09-30T22:26:25.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.589+0000 7fcc9b514700 1 Processor -- start 2023-09-30T22:26:25.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.589+0000 7fcc9b514700 1 -- start start 2023-09-30T22:26:25.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.589+0000 7fcc9b514700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc9406a6d0 0x7fcc9409d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.589+0000 7fcc9b514700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc9409de60 0x7fcc9409e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.589+0000 7fcc9b514700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc9409e790 con 0x7fcc9413c490 2023-09-30T22:26:25.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.589+0000 7fcc9b514700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9406aaa0 con 0x7fcc9406a6d0 2023-09-30T22:26:25.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.589+0000 7fcc9b514700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9411d980 con 0x7fcc9409de60 2023-09-30T22:26:25.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.590+0000 7fcc98aaf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc9409de60 0x7fcc9409e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.590+0000 7fcc99ab1700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fcc9413c490 0x7fcc9413e870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49838/0 (socket says 172.21.15.40:49838) 2023-09-30T22:26:25.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.590+0000 7fcc99ab1700 1 -- 172.21.15.40:0/2143512425 learned_addr learned my addr 172.21.15.40:0/2143512425 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:25.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.590+0000 7fcc992b0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc9406a6d0 0x7fcc9409d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.590+0000 7fcc98aaf700 1 -- 172.21.15.40:0/2143512425 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc9406a6d0 msgr2=0x7fcc9409d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:25.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.590+0000 7fcc98aaf700 1 --2- 172.21.15.40:0/2143512425 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc9406a6d0 0x7fcc9409d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.590+0000 7fcc98aaf700 1 -- 172.21.15.40:0/2143512425 >> v1:172.21.15.40:6789/0 conn(0x7fcc9413c490 legacy=0x7fcc9413e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:25.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.590+0000 7fcc98aaf700 1 -- 172.21.15.40:0/2143512425 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc9411daf0 con 0x7fcc9409de60 2023-09-30T22:26:25.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.590+0000 7fcc992b0700 1 --2- 172.21.15.40:0/2143512425 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc9406a6d0 0x7fcc9409d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:25.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.590+0000 7fcc98aaf700 1 --2- 172.21.15.40:0/2143512425 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc9409de60 0x7fcc9409e250 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcc840098a0 tx=0x7fcc84009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa82a5be449837aa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:25.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.590+0000 7fcc8bfff700 1 -- 172.21.15.40:0/2143512425 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc84011830 con 0x7fcc9409de60 2023-09-30T22:26:25.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.590+0000 7fcc8bfff700 1 -- 172.21.15.40:0/2143512425 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc84011990 con 0x7fcc9409de60 2023-09-30T22:26:25.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.590+0000 7fcc8bfff700 1 -- 172.21.15.40:0/2143512425 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc84011d20 con 0x7fcc9409de60 2023-09-30T22:26:25.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.591+0000 7fcc9b514700 1 -- 172.21.15.40:0/2143512425 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc9409de60 msgr2=0x7fcc9409e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:25.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.591+0000 7fcc9b514700 1 --2- 172.21.15.40:0/2143512425 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc9409de60 0x7fcc9409e250 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcc840098a0 tx=0x7fcc84009bb0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.591+0000 7fcc9b514700 1 -- 172.21.15.40:0/2143512425 shutdown_connections 2023-09-30T22:26:25.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.591+0000 7fcc9b514700 1 --2- 172.21.15.40:0/2143512425 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc9406a6d0 0x7fcc9409d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.591+0000 7fcc9b514700 1 --2- 172.21.15.40:0/2143512425 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc9409de60 0x7fcc9409e250 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.591+0000 7fcc9b514700 1 -- 172.21.15.40:0/2143512425 >> 172.21.15.40:0/2143512425 conn(0x7fcc9409fb20 msgr2=0x7fcc9409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:25.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.591+0000 7fcc9b514700 1 -- 172.21.15.40:0/2143512425 shutdown_connections 2023-09-30T22:26:25.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.591+0000 7fcc9b514700 1 -- 172.21.15.40:0/2143512425 wait complete. 2023-09-30T22:26:25.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.592+0000 7fcc9b514700 1 Processor -- start 2023-09-30T22:26:25.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.592+0000 7fcc9b514700 1 -- start start 2023-09-30T22:26:25.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.593+0000 7fcc9b514700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc9406a6d0 0x7fcc9413e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.593+0000 7fcc9b514700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc9409de60 0x7fcc9413a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.593+0000 7fcc9b514700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc9413c490 0x7fcc9413ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.593+0000 7fcc9b514700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9413f090 con 0x7fcc9406a6d0 2023-09-30T22:26:25.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.593+0000 7fcc9b514700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9411e1a0 con 0x7fcc9413c490 2023-09-30T22:26:25.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.593+0000 7fcc9b514700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9411e3a0 con 0x7fcc9409de60 2023-09-30T22:26:25.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.593+0000 7fcc99ab1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc9413c490 0x7fcc9413ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.593+0000 7fcc99ab1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc9413c490 0x7fcc9413ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53554/0 (socket says 172.21.15.40:53554) 2023-09-30T22:26:25.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.593+0000 7fcc99ab1700 1 -- 172.21.15.40:0/2120747613 learned_addr learned my addr 172.21.15.40:0/2120747613 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:25.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.593+0000 7fcc992b0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc9406a6d0 0x7fcc9413e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.593+0000 7fcc98aaf700 1 --2- 172.21.15.40:0/2120747613 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc9409de60 0x7fcc9413a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.593+0000 7fcc99ab1700 1 -- 172.21.15.40:0/2120747613 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc9409de60 msgr2=0x7fcc9413a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:25.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.593+0000 7fcc99ab1700 1 --2- 172.21.15.40:0/2120747613 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc9409de60 0x7fcc9413a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.593+0000 7fcc99ab1700 1 -- 172.21.15.40:0/2120747613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc9406a6d0 msgr2=0x7fcc9413e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:25.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.593+0000 7fcc99ab1700 1 --2- 172.21.15.40:0/2120747613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc9406a6d0 0x7fcc9413e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.593+0000 7fcc99ab1700 1 -- 172.21.15.40:0/2120747613 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc90009430 con 0x7fcc9413c490 2023-09-30T22:26:25.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.593+0000 7fcc992b0700 1 --2- 172.21.15.40:0/2120747613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc9406a6d0 0x7fcc9413e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:25.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.594+0000 7fcc99ab1700 1 --2- 172.21.15.40:0/2120747613 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc9413c490 0x7fcc9413ae30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c00caf0 tx=0x7fcc8c00ce00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:25.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.594+0000 7fcc89ffb700 1 -- 172.21.15.40:0/2120747613 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c00aaa0 con 0x7fcc9413c490 2023-09-30T22:26:25.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.594+0000 7fcc89ffb700 1 -- 172.21.15.40:0/2120747613 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc8c00ac00 con 0x7fcc9413c490 2023-09-30T22:26:25.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.594+0000 7fcc9b514700 1 -- 172.21.15.40:0/2120747613 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc840094a0 con 0x7fcc9413c490 2023-09-30T22:26:25.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.594+0000 7fcc89ffb700 1 -- 172.21.15.40:0/2120747613 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c012400 con 0x7fcc9413c490 2023-09-30T22:26:25.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.594+0000 7fcc9b514700 1 -- 172.21.15.40:0/2120747613 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc9409f540 con 0x7fcc9413c490 2023-09-30T22:26:25.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.595+0000 7fcc89ffb700 1 -- 172.21.15.40:0/2120747613 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcc8c01b3b0 con 0x7fcc9413c490 2023-09-30T22:26:25.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.595+0000 7fcc9b514700 1 -- 172.21.15.40:0/2120747613 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc9411de60 con 0x7fcc9413c490 2023-09-30T22:26:25.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.596+0000 7fcc89ffb700 1 -- 172.21.15.40:0/2120747613 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fcc8c03f210 con 0x7fcc9413c490 2023-09-30T22:26:25.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.605+0000 7fcc89ffb700 1 -- 172.21.15.40:0/2120747613 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcc9411de60 con 0x7fcc9413c490 2023-09-30T22:26:25.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.632+0000 7f655dd0f700 1 Processor -- start 2023-09-30T22:26:25.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.632+0000 7f655dd0f700 1 -- start start 2023-09-30T22:26:25.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.632+0000 7f655dd0f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f655809d920 0x7f655809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.632+0000 7f655dd0f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f655809f0f0 0x7f655809e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.632+0000 7f655dd0f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f655809f940 con 0x7f6558133ca0 2023-09-30T22:26:25.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.632+0000 7f655dd0f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f655806b4c0 con 0x7f655809f0f0 2023-09-30T22:26:25.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.632+0000 7f655dd0f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f655809a8f0 con 0x7f655809d920 2023-09-30T22:26:25.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.633+0000 7f65577fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f655809d920 0x7f655809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.633+0000 7f6556ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f655809f0f0 0x7f655809e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.633+0000 7f6556ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f655809f0f0 0x7f655809e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33360/0 (socket says 172.21.15.40:33360) 2023-09-30T22:26:25.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.633+0000 7f6556ffd700 1 -- 172.21.15.40:0/2312248023 learned_addr learned my addr 172.21.15.40:0/2312248023 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:25.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.633+0000 7f65577fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f655809d920 0x7f655809dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:38038/0 (socket says 172.21.15.40:38038) 2023-09-30T22:26:25.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.633+0000 7f6556ffd700 1 -- 172.21.15.40:0/2312248023 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f655809d920 msgr2=0x7f655809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:25.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.633+0000 7f6556ffd700 1 --2- 172.21.15.40:0/2312248023 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f655809d920 0x7f655809dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.633+0000 7f6556ffd700 1 -- 172.21.15.40:0/2312248023 >> v1:172.21.15.40:6789/0 conn(0x7f6558133ca0 legacy=0x7f6558134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:25.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.633+0000 7f6556ffd700 1 -- 172.21.15.40:0/2312248023 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f655809f6e0 con 0x7f655809f0f0 2023-09-30T22:26:25.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.633+0000 7f65577fe700 1 --2- 172.21.15.40:0/2312248023 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f655809d920 0x7f655809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:25.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.633+0000 7f6556ffd700 1 --2- 172.21.15.40:0/2312248023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f655809f0f0 0x7f655809e230 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f654c009920 tx=0x7f654c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd5b1198f658cb0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:25.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.633+0000 7f65567fc700 1 -- 172.21.15.40:0/2312248023 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c011830 con 0x7f655809f0f0 2023-09-30T22:26:25.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.633+0000 7f65567fc700 1 -- 172.21.15.40:0/2312248023 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654c011990 con 0x7f655809f0f0 2023-09-30T22:26:25.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.633+0000 7f65567fc700 1 -- 172.21.15.40:0/2312248023 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c011d20 con 0x7f655809f0f0 2023-09-30T22:26:25.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.634+0000 7f655dd0f700 1 -- 172.21.15.40:0/2312248023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f655809f0f0 msgr2=0x7f655809e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:25.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.634+0000 7f655dd0f700 1 --2- 172.21.15.40:0/2312248023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f655809f0f0 0x7f655809e230 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f654c009920 tx=0x7f654c009c30 comp rx=0 tx=0).stop 2023-09-30T22:26:25.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.634+0000 7f655dd0f700 1 -- 172.21.15.40:0/2312248023 shutdown_connections 2023-09-30T22:26:25.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.634+0000 7f655dd0f700 1 --2- 172.21.15.40:0/2312248023 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f655809d920 0x7f655809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.634+0000 7f655dd0f700 1 --2- 172.21.15.40:0/2312248023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f655809f0f0 0x7f655809e230 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.634+0000 7f655dd0f700 1 -- 172.21.15.40:0/2312248023 >> 172.21.15.40:0/2312248023 conn(0x7f655809fb20 msgr2=0x7f655809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:25.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.634+0000 7f655dd0f700 1 -- 172.21.15.40:0/2312248023 shutdown_connections 2023-09-30T22:26:25.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.634+0000 7f655dd0f700 1 -- 172.21.15.40:0/2312248023 wait complete. 2023-09-30T22:26:25.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.636+0000 7f655dd0f700 1 Processor -- start 2023-09-30T22:26:25.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.636+0000 7f655dd0f700 1 -- start start 2023-09-30T22:26:25.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.637+0000 7f655dd0f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f655809d920 0x7f6558121910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.637+0000 7f655dd0f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6558133ca0 0x7f6558121e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.637+0000 7f655dd0f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6558122390 0x7f65581c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.637+0000 7f655dd0f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65581251b0 con 0x7f655809d920 2023-09-30T22:26:25.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.637+0000 7f655dd0f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6558125f90 con 0x7f6558122390 2023-09-30T22:26:25.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.637+0000 7f655dd0f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6558122d70 con 0x7f6558133ca0 2023-09-30T22:26:25.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.637+0000 7f65577fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f655809d920 0x7f6558121910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.637+0000 7f65577fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f655809d920 0x7f6558121910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33370/0 (socket says 172.21.15.40:33370) 2023-09-30T22:26:25.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.637+0000 7f65577fe700 1 -- 172.21.15.40:0/2987841921 learned_addr learned my addr 172.21.15.40:0/2987841921 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:25.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.637+0000 7f6556ffd700 1 --2- 172.21.15.40:0/2987841921 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6558133ca0 0x7f6558121e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.637+0000 7f6557fff700 1 --2- 172.21.15.40:0/2987841921 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6558122390 0x7f65581c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.637+0000 7f65577fe700 1 -- 172.21.15.40:0/2987841921 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6558133ca0 msgr2=0x7f6558121e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:25.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.637+0000 7f65577fe700 1 --2- 172.21.15.40:0/2987841921 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6558133ca0 0x7f6558121e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.637+0000 7f65577fe700 1 -- 172.21.15.40:0/2987841921 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6558122390 msgr2=0x7f65581c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:25.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.637+0000 7f65577fe700 1 --2- 172.21.15.40:0/2987841921 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6558122390 0x7f65581c8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.637+0000 7f65577fe700 1 -- 172.21.15.40:0/2987841921 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6548009430 con 0x7f655809d920 2023-09-30T22:26:25.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.637+0000 7f6557fff700 1 --2- 172.21.15.40:0/2987841921 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6558122390 0x7f65581c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:25.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.637+0000 7f65577fe700 1 --2- 172.21.15.40:0/2987841921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f655809d920 0x7f6558121910 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f654800ec10 tx=0x7f654800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:25.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.638+0000 7f653ffff700 1 -- 172.21.15.40:0/2987841921 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6548005a20 con 0x7f655809d920 2023-09-30T22:26:25.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.638+0000 7f653ffff700 1 -- 172.21.15.40:0/2987841921 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6548005b80 con 0x7f655809d920 2023-09-30T22:26:25.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.638+0000 7f653ffff700 1 -- 172.21.15.40:0/2987841921 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654800c850 con 0x7f655809d920 2023-09-30T22:26:25.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.638+0000 7f655dd0f700 1 -- 172.21.15.40:0/2987841921 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f654c009550 con 0x7f655809d920 2023-09-30T22:26:25.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.638+0000 7f655dd0f700 1 -- 172.21.15.40:0/2987841921 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6558123430 con 0x7f655809d920 2023-09-30T22:26:25.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.639+0000 7f655dd0f700 1 -- 172.21.15.40:0/2987841921 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65580a2a10 con 0x7f655809d920 2023-09-30T22:26:25.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.639+0000 7f653ffff700 1 -- 172.21.15.40:0/2987841921 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f654800c9b0 con 0x7f655809d920 2023-09-30T22:26:25.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.639+0000 7f653ffff700 1 -- 172.21.15.40:0/2987841921 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f654803fe30 con 0x7f655809d920 2023-09-30T22:26:25.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.648+0000 7f653ffff700 1 -- 172.21.15.40:0/2987841921 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6548006030 con 0x7f655809d920 2023-09-30T22:26:25.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.655+0000 7fb319c14700 1 -- 172.21.15.40:0/2042323140 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb314062380 con 0x7fb31412eea0 2023-09-30T22:26:25.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.655+0000 7fb2fbfff700 1 -- 172.21.15.40:0/2042323140 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb30c023380 con 0x7fb31412eea0 2023-09-30T22:26:25.656 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:25.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.658+0000 7fb319c14700 1 -- 172.21.15.40:0/2042323140 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb31412eea0 msgr2=0x7fb314070360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:25.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.658+0000 7fb319c14700 1 --2- 172.21.15.40:0/2042323140 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb31412eea0 0x7fb314070360 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb30c00cae0 tx=0x7fb30c00cdf0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.658+0000 7fb319c14700 1 -- 172.21.15.40:0/2042323140 shutdown_connections 2023-09-30T22:26:25.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.658+0000 7fb319c14700 1 --2- 172.21.15.40:0/2042323140 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb31412eea0 0x7fb314070360 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.658+0000 7fb319c14700 1 --2- 172.21.15.40:0/2042323140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb31412d6d0 0x7fb31406f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.658+0000 7fb319c14700 1 --2- 172.21.15.40:0/2042323140 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb31412e590 0x7fb31406fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.658+0000 7fb319c14700 1 -- 172.21.15.40:0/2042323140 >> 172.21.15.40:0/2042323140 conn(0x7fb3140a2a00 msgr2=0x7fb31409d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:25.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.658+0000 7fb319c14700 1 -- 172.21.15.40:0/2042323140 shutdown_connections 2023-09-30T22:26:25.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.658+0000 7fb319c14700 1 -- 172.21.15.40:0/2042323140 wait complete. 2023-09-30T22:26:25.677 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:25.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.792+0000 7f644df3f700 1 -- 172.21.15.40:0/3266879167 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f644813b630 con 0x7f644809df30 2023-09-30T22:26:25.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.793+0000 7f642ffff700 1 -- 172.21.15.40:0/3266879167 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f644813b630 con 0x7f644809df30 2023-09-30T22:26:25.793 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:25.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.796+0000 7f644df3f700 1 -- 172.21.15.40:0/3266879167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f644809df30 msgr2=0x7f6448138570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:25.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.796+0000 7f644df3f700 1 --2- 172.21.15.40:0/3266879167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f644809df30 0x7f6448138570 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f643c00b450 tx=0x7f643c00b760 comp rx=0 tx=0).stop 2023-09-30T22:26:25.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.796+0000 7f644df3f700 1 -- 172.21.15.40:0/3266879167 shutdown_connections 2023-09-30T22:26:25.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.796+0000 7f644df3f700 1 --2- 172.21.15.40:0/3266879167 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6448135940 0x7f6448138ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.796+0000 7f644df3f700 1 --2- 172.21.15.40:0/3266879167 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f644809d450 0x7f6448138030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.796+0000 7f644df3f700 1 --2- 172.21.15.40:0/3266879167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f644809df30 0x7f6448138570 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.796+0000 7f644df3f700 1 -- 172.21.15.40:0/3266879167 >> 172.21.15.40:0/3266879167 conn(0x7f64480a2a00 msgr2=0x7f644812c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:25.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.796+0000 7f644df3f700 1 -- 172.21.15.40:0/3266879167 shutdown_connections 2023-09-30T22:26:25.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.796+0000 7f644df3f700 1 -- 172.21.15.40:0/3266879167 wait complete. 2023-09-30T22:26:25.813 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:25.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.818+0000 7fcc9b514700 1 -- 172.21.15.40:0/2120747613 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcc9409e790 con 0x7fcc9413c490 2023-09-30T22:26:25.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.818+0000 7fcc89ffb700 1 -- 172.21.15.40:0/2120747613 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcc9409e790 con 0x7fcc9413c490 2023-09-30T22:26:25.819 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:25.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.820+0000 7fcc9b514700 1 -- 172.21.15.40:0/2120747613 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc9413c490 msgr2=0x7fcc9413ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:25.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.820+0000 7fcc9b514700 1 --2- 172.21.15.40:0/2120747613 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc9413c490 0x7fcc9413ae30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c00caf0 tx=0x7fcc8c00ce00 comp rx=0 tx=0).stop 2023-09-30T22:26:25.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.820+0000 7fcc9b514700 1 -- 172.21.15.40:0/2120747613 shutdown_connections 2023-09-30T22:26:25.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.820+0000 7fcc9b514700 1 --2- 172.21.15.40:0/2120747613 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc9413c490 0x7fcc9413ae30 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.820+0000 7fcc9b514700 1 --2- 172.21.15.40:0/2120747613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc9406a6d0 0x7fcc9413e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.820+0000 7fcc9b514700 1 --2- 172.21.15.40:0/2120747613 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc9409de60 0x7fcc9413a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.820+0000 7fcc9b514700 1 -- 172.21.15.40:0/2120747613 >> 172.21.15.40:0/2120747613 conn(0x7fcc9409fb20 msgr2=0x7fcc940a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:25.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.820+0000 7fcc9b514700 1 -- 172.21.15.40:0/2120747613 shutdown_connections 2023-09-30T22:26:25.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.820+0000 7fcc9b514700 1 -- 172.21.15.40:0/2120747613 wait complete. 2023-09-30T22:26:25.832 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:25.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.845+0000 7f655dd0f700 1 -- 172.21.15.40:0/2987841921 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6558062380 con 0x7f655809d920 2023-09-30T22:26:25.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.846+0000 7f653ffff700 1 -- 172.21.15.40:0/2987841921 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6548023350 con 0x7f655809d920 2023-09-30T22:26:25.846 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:25.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.848+0000 7f655dd0f700 1 -- 172.21.15.40:0/2987841921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f655809d920 msgr2=0x7f6558121910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:25.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.848+0000 7f655dd0f700 1 --2- 172.21.15.40:0/2987841921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f655809d920 0x7f6558121910 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f654800ec10 tx=0x7f654800ef20 comp rx=0 tx=0).stop 2023-09-30T22:26:25.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.848+0000 7f655dd0f700 1 -- 172.21.15.40:0/2987841921 shutdown_connections 2023-09-30T22:26:25.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.848+0000 7f655dd0f700 1 --2- 172.21.15.40:0/2987841921 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6558122390 0x7f65581c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.848+0000 7f655dd0f700 1 --2- 172.21.15.40:0/2987841921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f655809d920 0x7f6558121910 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.848+0000 7f655dd0f700 1 --2- 172.21.15.40:0/2987841921 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6558133ca0 0x7f6558121e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.848+0000 7f655dd0f700 1 -- 172.21.15.40:0/2987841921 >> 172.21.15.40:0/2987841921 conn(0x7f655809fb20 msgr2=0x7f65580a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:25.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.848+0000 7f655dd0f700 1 -- 172.21.15.40:0/2987841921 shutdown_connections 2023-09-30T22:26:25.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:25.848+0000 7f655dd0f700 1 -- 172.21.15.40:0/2987841921 wait complete. 2023-09-30T22:26:25.861 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:26.678 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:26.814 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:26.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.820+0000 7f678b6aa700 1 Processor -- start 2023-09-30T22:26:26.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.821+0000 7f678b6aa700 1 -- start start 2023-09-30T22:26:26.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.821+0000 7f678b6aa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f678409d920 0x7f678409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:26.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.821+0000 7f678b6aa700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f678409e230 0x7f67841343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:26.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.821+0000 7f678b6aa700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f678409f940 con 0x7f678409f0f0 2023-09-30T22:26:26.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.821+0000 7f678b6aa700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f678406b4c0 con 0x7f678409e230 2023-09-30T22:26:26.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.821+0000 7f678b6aa700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f678409a8f0 con 0x7f678409d920 2023-09-30T22:26:26.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.821+0000 7f6789446700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f678409d920 0x7f678409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:26.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.821+0000 7f6789446700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f678409d920 0x7f678409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53580/0 (socket says 172.21.15.40:53580) 2023-09-30T22:26:26.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.821+0000 7f6789446700 1 -- 172.21.15.40:0/915614605 learned_addr learned my addr 172.21.15.40:0/915614605 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:26.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.821+0000 7f6789c47700 1 --2- 172.21.15.40:0/915614605 >> v2:172.21.15.40:3300/0 conn(0x7f678409e230 0x7f67841343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:26.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.822+0000 7f6789446700 1 -- 172.21.15.40:0/915614605 >> v2:172.21.15.40:3300/0 conn(0x7f678409e230 msgr2=0x7f67841343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:26.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.822+0000 7f6789446700 1 --2- 172.21.15.40:0/915614605 >> v2:172.21.15.40:3300/0 conn(0x7f678409e230 0x7f67841343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:26.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.822+0000 7f6789446700 1 -- 172.21.15.40:0/915614605 >> v1:172.21.15.40:6789/0 conn(0x7f678409f0f0 legacy=0x7f6784133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:26.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.822+0000 7f6789446700 1 -- 172.21.15.40:0/915614605 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f678409f6e0 con 0x7f678409d920 2023-09-30T22:26:26.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.822+0000 7f6789446700 1 --2- 172.21.15.40:0/915614605 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f678409d920 0x7f678409dcf0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6780006fd0 tx=0x7f6780009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2862d32fbea306f4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:26.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.822+0000 7f677bfff700 1 -- 172.21.15.40:0/915614605 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6780005e30 con 0x7f678409d920 2023-09-30T22:26:26.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.822+0000 7f677bfff700 1 -- 172.21.15.40:0/915614605 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6780004030 con 0x7f678409d920 2023-09-30T22:26:26.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.822+0000 7f677bfff700 1 -- 172.21.15.40:0/915614605 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67800043e0 con 0x7f678409d920 2023-09-30T22:26:26.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.823+0000 7f678b6aa700 1 -- 172.21.15.40:0/915614605 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f678409d920 msgr2=0x7f678409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:26.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.823+0000 7f678b6aa700 1 --2- 172.21.15.40:0/915614605 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f678409d920 0x7f678409dcf0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6780006fd0 tx=0x7f6780009bd0 comp rx=0 tx=0).stop 2023-09-30T22:26:26.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.823+0000 7f678b6aa700 1 -- 172.21.15.40:0/915614605 shutdown_connections 2023-09-30T22:26:26.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.823+0000 7f678b6aa700 1 --2- 172.21.15.40:0/915614605 >> v2:172.21.15.40:3300/0 conn(0x7f678409e230 0x7f67841343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:26.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.823+0000 7f678b6aa700 1 --2- 172.21.15.40:0/915614605 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f678409d920 0x7f678409dcf0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:26.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.823+0000 7f678b6aa700 1 -- 172.21.15.40:0/915614605 >> 172.21.15.40:0/915614605 conn(0x7f678409fb20 msgr2=0x7f678409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:26.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.823+0000 7f678b6aa700 1 -- 172.21.15.40:0/915614605 shutdown_connections 2023-09-30T22:26:26.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.823+0000 7f678b6aa700 1 -- 172.21.15.40:0/915614605 wait complete. 2023-09-30T22:26:26.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.824+0000 7f678b6aa700 1 Processor -- start 2023-09-30T22:26:26.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.824+0000 7f678b6aa700 1 -- start start 2023-09-30T22:26:26.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.824+0000 7f678b6aa700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f678409d920 0x7f67841a60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:26.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.824+0000 7f678b6aa700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f678409e230 0x7f67841a65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:26.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.824+0000 7f678b6aa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67841b94a0 0x7f67841a6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:26.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.824+0000 7f678b6aa700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67841aa590 con 0x7f678409d920 2023-09-30T22:26:26.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.824+0000 7f678b6aa700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67841a9bd0 con 0x7f67841b94a0 2023-09-30T22:26:26.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.824+0000 7f678b6aa700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67841a8f10 con 0x7f678409e230 2023-09-30T22:26:26.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.824+0000 7f6789446700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f678409d920 0x7f67841a60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:26.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.824+0000 7f6789446700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f678409d920 0x7f67841a60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33392/0 (socket says 172.21.15.40:33392) 2023-09-30T22:26:26.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.824+0000 7f6789446700 1 -- 172.21.15.40:0/3902096295 learned_addr learned my addr 172.21.15.40:0/3902096295 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:26.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.825+0000 7f6788c45700 1 --2- 172.21.15.40:0/3902096295 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f678409e230 0x7f67841a65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:26.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.825+0000 7f6789446700 1 -- 172.21.15.40:0/3902096295 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f678409e230 msgr2=0x7f67841a65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:26.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.825+0000 7f6789446700 1 --2- 172.21.15.40:0/3902096295 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f678409e230 0x7f67841a65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:26.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.825+0000 7f6789446700 1 -- 172.21.15.40:0/3902096295 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67841b94a0 msgr2=0x7f67841a6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:26.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.825+0000 7f6789446700 1 --2- 172.21.15.40:0/3902096295 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67841b94a0 0x7f67841a6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:26.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.825+0000 7f6789446700 1 -- 172.21.15.40:0/3902096295 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6780009500 con 0x7f678409d920 2023-09-30T22:26:26.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.825+0000 7f6789446700 1 --2- 172.21.15.40:0/3902096295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f678409d920 0x7f67841a60b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6780004000 tx=0x7f6780004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:26.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.825+0000 7f6779ffb700 1 -- 172.21.15.40:0/3902096295 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6780003c60 con 0x7f678409d920 2023-09-30T22:26:26.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.825+0000 7f6779ffb700 1 -- 172.21.15.40:0/3902096295 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6780003dc0 con 0x7f678409d920 2023-09-30T22:26:26.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.825+0000 7f678b6aa700 1 -- 172.21.15.40:0/3902096295 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67840a3630 con 0x7f678409d920 2023-09-30T22:26:26.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.825+0000 7f6779ffb700 1 -- 172.21.15.40:0/3902096295 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678001c640 con 0x7f678409d920 2023-09-30T22:26:26.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.825+0000 7f678b6aa700 1 -- 172.21.15.40:0/3902096295 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67841a7cc0 con 0x7f678409d920 2023-09-30T22:26:26.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.826+0000 7f6779ffb700 1 -- 172.21.15.40:0/3902096295 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f678001c7a0 con 0x7f678409d920 2023-09-30T22:26:26.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.827+0000 7f6779ffb700 1 -- 172.21.15.40:0/3902096295 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6780040780 con 0x7f678409d920 2023-09-30T22:26:26.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.827+0000 7f678b6aa700 1 -- 172.21.15.40:0/3902096295 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67841a9770 con 0x7f678409d920 2023-09-30T22:26:26.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.831+0000 7f6779ffb700 1 -- 172.21.15.40:0/3902096295 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f678002a020 con 0x7f678409d920 2023-09-30T22:26:26.833 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:26.861 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:26.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.949+0000 7fbecfbaf700 1 Processor -- start 2023-09-30T22:26:26.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.949+0000 7fbecfbaf700 1 -- start start 2023-09-30T22:26:26.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.950+0000 7fbecfbaf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbec8133e00 0x7fbec81341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:26.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.950+0000 7fbecfbaf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbec809d400 0x7fbec809d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:26.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.950+0000 7fbecfbaf700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbec8133940 con 0x7fbec809dd70 2023-09-30T22:26:26.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.950+0000 7fbecfbaf700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbec809f0d0 con 0x7fbec8133e00 2023-09-30T22:26:26.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.950+0000 7fbecfbaf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbec8133be0 con 0x7fbec809d400 2023-09-30T22:26:26.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.950+0000 7fbecd94b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbec8133e00 0x7fbec81341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:26.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.950+0000 7fbecd14a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbec809d400 0x7fbec809d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:26.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.950+0000 7fbecd14a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbec809d400 0x7fbec809d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:38066/0 (socket says 172.21.15.40:38066) 2023-09-30T22:26:26.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.950+0000 7fbecd94b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbec8133e00 0x7fbec81341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33404/0 (socket says 172.21.15.40:33404) 2023-09-30T22:26:26.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.950+0000 7fbecd14a700 1 -- 172.21.15.40:0/2878215952 learned_addr learned my addr 172.21.15.40:0/2878215952 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:26.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.950+0000 7fbecd14a700 1 -- 172.21.15.40:0/2878215952 >> v2:172.21.15.40:3300/0 conn(0x7fbec8133e00 msgr2=0x7fbec81341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:26.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.950+0000 7fbecd14a700 1 --2- 172.21.15.40:0/2878215952 >> v2:172.21.15.40:3300/0 conn(0x7fbec8133e00 0x7fbec81341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:26.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.950+0000 7fbecd14a700 1 -- 172.21.15.40:0/2878215952 >> v1:172.21.15.40:6789/0 conn(0x7fbec809dd70 legacy=0x7fbec813ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:26.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.950+0000 7fbecd14a700 1 -- 172.21.15.40:0/2878215952 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec809a860 con 0x7fbec809d400 2023-09-30T22:26:26.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.950+0000 7fbecd14a700 1 --2- 172.21.15.40:0/2878215952 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbec809d400 0x7fbec809d830 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbeb80098f0 tx=0x7fbeb8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9e5dd72fcc73bd4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:26.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.950+0000 7fbecc949700 1 -- 172.21.15.40:0/2878215952 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb8011830 con 0x7fbec809d400 2023-09-30T22:26:26.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.951+0000 7fbecc949700 1 -- 172.21.15.40:0/2878215952 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb8011990 con 0x7fbec809d400 2023-09-30T22:26:26.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.951+0000 7fbecc949700 1 -- 172.21.15.40:0/2878215952 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb8011d20 con 0x7fbec809d400 2023-09-30T22:26:26.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.951+0000 7fbecfbaf700 1 -- 172.21.15.40:0/2878215952 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbec809d400 msgr2=0x7fbec809d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:26.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.951+0000 7fbecfbaf700 1 --2- 172.21.15.40:0/2878215952 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbec809d400 0x7fbec809d830 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbeb80098f0 tx=0x7fbeb8009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:26.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.951+0000 7fbecfbaf700 1 -- 172.21.15.40:0/2878215952 shutdown_connections 2023-09-30T22:26:26.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.951+0000 7fbecfbaf700 1 --2- 172.21.15.40:0/2878215952 >> v2:172.21.15.40:3300/0 conn(0x7fbec8133e00 0x7fbec81341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:26.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.951+0000 7fbecfbaf700 1 --2- 172.21.15.40:0/2878215952 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbec809d400 0x7fbec809d830 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:26.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.951+0000 7fbecfbaf700 1 -- 172.21.15.40:0/2878215952 >> 172.21.15.40:0/2878215952 conn(0x7fbec80a2a00 msgr2=0x7fbec80a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:26.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.951+0000 7fbecfbaf700 1 -- 172.21.15.40:0/2878215952 shutdown_connections 2023-09-30T22:26:26.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.951+0000 7fbecfbaf700 1 -- 172.21.15.40:0/2878215952 wait complete. 2023-09-30T22:26:26.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.952+0000 7fbecfbaf700 1 Processor -- start 2023-09-30T22:26:26.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.952+0000 7fbecfbaf700 1 -- start start 2023-09-30T22:26:26.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.953+0000 7fbecfbaf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbec809d400 0x7fbec811caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:26.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.953+0000 7fbecfbaf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbec809dd70 0x7fbec811d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:26.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.953+0000 7fbecfbaf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbec8133e00 0x7fbec81c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:26.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.953+0000 7fbecfbaf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec811e690 con 0x7fbec8133e00 2023-09-30T22:26:26.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.953+0000 7fbecfbaf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec811fcb0 con 0x7fbec809d400 2023-09-30T22:26:26.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.953+0000 7fbecfbaf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbec811c700 con 0x7fbec809dd70 2023-09-30T22:26:26.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.953+0000 7fbecd14a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbec809dd70 0x7fbec811d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:26.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.953+0000 7fbecd14a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbec809dd70 0x7fbec811d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:38070/0 (socket says 172.21.15.40:38070) 2023-09-30T22:26:26.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.953+0000 7fbecd14a700 1 -- 172.21.15.40:0/2580826679 learned_addr learned my addr 172.21.15.40:0/2580826679 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:26.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.953+0000 7fbece14c700 1 --2- 172.21.15.40:0/2580826679 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbec8133e00 0x7fbec81c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:26.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.953+0000 7fbece14c700 1 -- 172.21.15.40:0/2580826679 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbec809dd70 msgr2=0x7fbec811d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:26.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.953+0000 7fbece14c700 1 --2- 172.21.15.40:0/2580826679 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbec809dd70 0x7fbec811d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:26.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.953+0000 7fbece14c700 1 -- 172.21.15.40:0/2580826679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbec809d400 msgr2=0x7fbec811caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:26.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.953+0000 7fbece14c700 1 --2- 172.21.15.40:0/2580826679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbec809d400 0x7fbec811caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:26.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.953+0000 7fbece14c700 1 -- 172.21.15.40:0/2580826679 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb8009550 con 0x7fbec8133e00 2023-09-30T22:26:26.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.953+0000 7fbece14c700 1 --2- 172.21.15.40:0/2580826679 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbec8133e00 0x7fbec81c8ab0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fbec000cae0 tx=0x7fbec000cdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:26.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.954+0000 7fbebe7fc700 1 -- 172.21.15.40:0/2580826679 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec0003c00 con 0x7fbec8133e00 2023-09-30T22:26:26.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.954+0000 7fbebe7fc700 1 -- 172.21.15.40:0/2580826679 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec0003d60 con 0x7fbec8133e00 2023-09-30T22:26:26.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.954+0000 7fbebe7fc700 1 -- 172.21.15.40:0/2580826679 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec000aae0 con 0x7fbec8133e00 2023-09-30T22:26:26.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.954+0000 7fbecfbaf700 1 -- 172.21.15.40:0/2580826679 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbec80a01b0 con 0x7fbec8133e00 2023-09-30T22:26:26.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.954+0000 7fbecfbaf700 1 -- 172.21.15.40:0/2580826679 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbec811dda0 con 0x7fbec8133e00 2023-09-30T22:26:26.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.955+0000 7fbebe7fc700 1 -- 172.21.15.40:0/2580826679 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbec000ac40 con 0x7fbec8133e00 2023-09-30T22:26:26.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.955+0000 7fbebe7fc700 1 -- 172.21.15.40:0/2580826679 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fbec003f5a0 con 0x7fbec8133e00 2023-09-30T22:26:26.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.955+0000 7fbecfbaf700 1 -- 172.21.15.40:0/2580826679 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbec8062380 con 0x7fbec8133e00 2023-09-30T22:26:26.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.960+0000 7fbebe7fc700 1 -- 172.21.15.40:0/2580826679 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbec00052b0 con 0x7fbec8133e00 2023-09-30T22:26:26.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.974+0000 7f779a256700 1 Processor -- start 2023-09-30T22:26:26.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.974+0000 7f779a256700 1 -- start start 2023-09-30T22:26:26.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.975+0000 7f779a256700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f779409c890 0x7f779409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:26.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.975+0000 7f779a256700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f779409e480 0x7f779413bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:26.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.975+0000 7f779a256700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77940a2600 con 0x7f779409d920 2023-09-30T22:26:26.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.975+0000 7f779a256700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77940a29d0 con 0x7f779409c890 2023-09-30T22:26:26.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.975+0000 7f779a256700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f779409fb40 con 0x7f779409e480 2023-09-30T22:26:26.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.975+0000 7f77937fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f779409c890 0x7f779409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:26.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.975+0000 7f7793fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f779409e480 0x7f779413bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:26.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.976+0000 7f77937fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f779409c890 0x7f779409cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33414/0 (socket says 172.21.15.40:33414) 2023-09-30T22:26:26.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.976+0000 7f77937fe700 1 -- 172.21.15.40:0/694457285 learned_addr learned my addr 172.21.15.40:0/694457285 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:26.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.976+0000 7f77937fe700 1 -- 172.21.15.40:0/694457285 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f779409e480 msgr2=0x7f779413bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:26.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.976+0000 7f77937fe700 1 --2- 172.21.15.40:0/694457285 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f779409e480 0x7f779413bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:26.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.976+0000 7f77937fe700 1 -- 172.21.15.40:0/694457285 >> v1:172.21.15.40:6789/0 conn(0x7f779409d920 legacy=0x7f779409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:26.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.976+0000 7f77937fe700 1 -- 172.21.15.40:0/694457285 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779409fed0 con 0x7f779409c890 2023-09-30T22:26:26.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.976+0000 7f77937fe700 1 --2- 172.21.15.40:0/694457285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f779409c890 0x7f779409cc60 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7784006fd0 tx=0x7f7784009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9e1b0db78dc525 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:26.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.976+0000 7f77927fc700 1 -- 172.21.15.40:0/694457285 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7784005e30 con 0x7f779409c890 2023-09-30T22:26:26.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.976+0000 7f77927fc700 1 -- 172.21.15.40:0/694457285 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7784004030 con 0x7f779409c890 2023-09-30T22:26:26.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.976+0000 7f77927fc700 1 -- 172.21.15.40:0/694457285 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77840043e0 con 0x7f779409c890 2023-09-30T22:26:26.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.977+0000 7f779a256700 1 -- 172.21.15.40:0/694457285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f779409c890 msgr2=0x7f779409cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:26.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.977+0000 7f779a256700 1 --2- 172.21.15.40:0/694457285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f779409c890 0x7f779409cc60 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7784006fd0 tx=0x7f7784009bd0 comp rx=0 tx=0).stop 2023-09-30T22:26:26.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.977+0000 7f779a256700 1 -- 172.21.15.40:0/694457285 shutdown_connections 2023-09-30T22:26:26.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.977+0000 7f779a256700 1 --2- 172.21.15.40:0/694457285 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f779409e480 0x7f779413bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:26.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.977+0000 7f779a256700 1 --2- 172.21.15.40:0/694457285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f779409c890 0x7f779409cc60 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:26.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.977+0000 7f779a256700 1 -- 172.21.15.40:0/694457285 >> 172.21.15.40:0/694457285 conn(0x7f77940a7080 msgr2=0x7f77940a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:26.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.977+0000 7f779a256700 1 -- 172.21.15.40:0/694457285 shutdown_connections 2023-09-30T22:26:26.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.977+0000 7f779a256700 1 -- 172.21.15.40:0/694457285 wait complete. 2023-09-30T22:26:26.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.979+0000 7f779a256700 1 Processor -- start 2023-09-30T22:26:26.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.979+0000 7f779a256700 1 -- start start 2023-09-30T22:26:26.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.980+0000 7f779a256700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f779409c890 0x7f77941c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:26.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.980+0000 7f779a256700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f779409d920 0x7f77941c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:26.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.980+0000 7f779a256700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f779409e480 0x7f779412d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:26.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.980+0000 7f779a256700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77941315b0 con 0x7f779409c890 2023-09-30T22:26:26.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.980+0000 7f779a256700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77941309e0 con 0x7f779409e480 2023-09-30T22:26:26.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.980+0000 7f779a256700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f779409bd00 con 0x7f779409d920 2023-09-30T22:26:26.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.980+0000 7f77937fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f779409c890 0x7f77941c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:26.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.980+0000 7f7793fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f779409e480 0x7f779412d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:26.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.980+0000 7f77937fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f779409c890 0x7f77941c8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33430/0 (socket says 172.21.15.40:33430) 2023-09-30T22:26:26.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.980+0000 7f77937fe700 1 -- 172.21.15.40:0/154409179 learned_addr learned my addr 172.21.15.40:0/154409179 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:26.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.980+0000 7f7792ffd700 1 --2- 172.21.15.40:0/154409179 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f779409d920 0x7f77941c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:26.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.980+0000 7f7793fff700 1 -- 172.21.15.40:0/154409179 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f779409d920 msgr2=0x7f77941c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:26.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.980+0000 7f7793fff700 1 --2- 172.21.15.40:0/154409179 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f779409d920 0x7f77941c9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:26.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.980+0000 7f7793fff700 1 -- 172.21.15.40:0/154409179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f779409c890 msgr2=0x7f77941c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:26.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.980+0000 7f7793fff700 1 --2- 172.21.15.40:0/154409179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f779409c890 0x7f77941c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:26.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.980+0000 7f7793fff700 1 -- 172.21.15.40:0/154409179 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7784009500 con 0x7f779409e480 2023-09-30T22:26:26.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.980+0000 7f7792ffd700 1 --2- 172.21.15.40:0/154409179 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f779409d920 0x7f77941c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:26.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.980+0000 7f7793fff700 1 --2- 172.21.15.40:0/154409179 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f779409e480 0x7f779412d580 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f778c00efc0 tx=0x7f778c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:26.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.981+0000 7f777bfff700 1 -- 172.21.15.40:0/154409179 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778c00cc30 con 0x7f779409e480 2023-09-30T22:26:26.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.981+0000 7f777bfff700 1 -- 172.21.15.40:0/154409179 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778c00f040 con 0x7f779409e480 2023-09-30T22:26:26.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.981+0000 7f779a256700 1 -- 172.21.15.40:0/154409179 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7794130f80 con 0x7f779409e480 2023-09-30T22:26:26.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.981+0000 7f777bfff700 1 -- 172.21.15.40:0/154409179 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778c009e60 con 0x7f779409e480 2023-09-30T22:26:26.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.981+0000 7f779a256700 1 -- 172.21.15.40:0/154409179 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77940a5e70 con 0x7f779409e480 2023-09-30T22:26:26.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.982+0000 7f777bfff700 1 -- 172.21.15.40:0/154409179 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f778c014480 con 0x7f779409e480 2023-09-30T22:26:26.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.982+0000 7f777bfff700 1 -- 172.21.15.40:0/154409179 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f778c040200 con 0x7f779409e480 2023-09-30T22:26:26.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.982+0000 7f779a256700 1 -- 172.21.15.40:0/154409179 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7794062380 con 0x7f779409e480 2023-09-30T22:26:26.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:26.991+0000 7f777bfff700 1 -- 172.21.15.40:0/154409179 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f778c018030 con 0x7f779409e480 2023-09-30T22:26:27.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.030+0000 7f6429417700 1 Processor -- start 2023-09-30T22:26:27.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.030+0000 7f6429417700 1 -- start start 2023-09-30T22:26:27.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.030+0000 7f6429417700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f642409d920 0x7f642409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:27.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.030+0000 7f6429417700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f642409e230 0x7f64241343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:27.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.030+0000 7f6429417700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f642409f940 con 0x7f642409f0f0 2023-09-30T22:26:27.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.031+0000 7f6429417700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f642406b4c0 con 0x7f642409e230 2023-09-30T22:26:27.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.031+0000 7f6429417700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f642409a8f0 con 0x7f642409d920 2023-09-30T22:26:27.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.031+0000 7f64227fc700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f642409f0f0 0x7f6424133ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49888/0 (socket says 172.21.15.40:49888) 2023-09-30T22:26:27.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.031+0000 7f64227fc700 1 -- 172.21.15.40:0/1934952945 learned_addr learned my addr 172.21.15.40:0/1934952945 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:27.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.031+0000 7f64237fe700 1 --2- 172.21.15.40:0/1934952945 >> v2:172.21.15.40:3300/0 conn(0x7f642409e230 0x7f64241343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:27.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.031+0000 7f6422ffd700 1 --2- 172.21.15.40:0/1934952945 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f642409d920 0x7f642409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:27.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.031+0000 7f6421ffb700 1 -- 172.21.15.40:0/1934952945 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1874314392 0 0) 0x7f642409f940 con 0x7f642409f0f0 2023-09-30T22:26:27.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.031+0000 7f6421ffb700 1 -- 172.21.15.40:0/1934952945 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f640c0035b0 con 0x7f642409f0f0 2023-09-30T22:26:27.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.031+0000 7f64237fe700 1 -- 172.21.15.40:0/1934952945 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f642409d920 msgr2=0x7f642409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:27.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.031+0000 7f64237fe700 1 --2- 172.21.15.40:0/1934952945 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f642409d920 0x7f642409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.031+0000 7f64237fe700 1 -- 172.21.15.40:0/1934952945 >> v1:172.21.15.40:6789/0 conn(0x7f642409f0f0 legacy=0x7f6424133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:27.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.031+0000 7f64237fe700 1 -- 172.21.15.40:0/1934952945 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f642409f6e0 con 0x7f642409e230 2023-09-30T22:26:27.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.031+0000 7f6422ffd700 1 --2- 172.21.15.40:0/1934952945 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f642409d920 0x7f642409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:27.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.032+0000 7f64237fe700 1 --2- 172.21.15.40:0/1934952945 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f642409e230 0x7f64241343b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f641c009dc0 tx=0x7f641c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eab2c043501ca62 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:27.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.032+0000 7f6421ffb700 1 -- 172.21.15.40:0/1934952945 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641c00e070 con 0x7f642409e230 2023-09-30T22:26:27.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.032+0000 7f6421ffb700 1 -- 172.21.15.40:0/1934952945 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641c00bae0 con 0x7f642409e230 2023-09-30T22:26:27.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.032+0000 7f6421ffb700 1 -- 172.21.15.40:0/1934952945 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641c00be50 con 0x7f642409e230 2023-09-30T22:26:27.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.032+0000 7f6429417700 1 -- 172.21.15.40:0/1934952945 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f642409e230 msgr2=0x7f64241343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:27.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.032+0000 7f6429417700 1 --2- 172.21.15.40:0/1934952945 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f642409e230 0x7f64241343b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f641c009dc0 tx=0x7f641c00b330 comp rx=0 tx=0).stop 2023-09-30T22:26:27.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.032+0000 7f6429417700 1 -- 172.21.15.40:0/1934952945 shutdown_connections 2023-09-30T22:26:27.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.032+0000 7f6429417700 1 --2- 172.21.15.40:0/1934952945 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f642409e230 0x7f64241343b0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.032+0000 7f6429417700 1 --2- 172.21.15.40:0/1934952945 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f642409d920 0x7f642409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.032+0000 7f6429417700 1 -- 172.21.15.40:0/1934952945 >> 172.21.15.40:0/1934952945 conn(0x7f642409fb20 msgr2=0x7f642409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:27.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.032+0000 7f6429417700 1 -- 172.21.15.40:0/1934952945 shutdown_connections 2023-09-30T22:26:27.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.033+0000 7f6429417700 1 -- 172.21.15.40:0/1934952945 wait complete. 2023-09-30T22:26:27.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.034+0000 7f6429417700 1 Processor -- start 2023-09-30T22:26:27.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.034+0000 7f6429417700 1 -- start start 2023-09-30T22:26:27.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.034+0000 7f6429417700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f642409d920 0x7f64241c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:27.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.034+0000 7f6429417700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f642409e230 0x7f64241c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:27.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.034+0000 7f6429417700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64241c4c80 0x7f64241c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:27.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.034+0000 7f6429417700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64241a7390 con 0x7f64241c4c80 2023-09-30T22:26:27.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.034+0000 7f6429417700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64241a8880 con 0x7f642409d920 2023-09-30T22:26:27.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.034+0000 7f6429417700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f64241a8cb0 con 0x7f642409e230 2023-09-30T22:26:27.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.034+0000 7f6422ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f642409d920 0x7f64241c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:27.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.034+0000 7f6422ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f642409d920 0x7f64241c87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53628/0 (socket says 172.21.15.40:53628) 2023-09-30T22:26:27.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.034+0000 7f6422ffd700 1 -- 172.21.15.40:0/4139796062 learned_addr learned my addr 172.21.15.40:0/4139796062 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:27.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.034+0000 7f64237fe700 1 --2- 172.21.15.40:0/4139796062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64241c4c80 0x7f64241c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:27.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.034+0000 7f64227fc700 1 --2- 172.21.15.40:0/4139796062 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f642409e230 0x7f64241c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:27.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.035+0000 7f64237fe700 1 -- 172.21.15.40:0/4139796062 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f642409e230 msgr2=0x7f64241c8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:27.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.035+0000 7f64237fe700 1 --2- 172.21.15.40:0/4139796062 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f642409e230 0x7f64241c8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.035+0000 7f64237fe700 1 -- 172.21.15.40:0/4139796062 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f642409d920 msgr2=0x7f64241c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:27.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.035+0000 7f64237fe700 1 --2- 172.21.15.40:0/4139796062 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f642409d920 0x7f64241c87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.035+0000 7f64237fe700 1 -- 172.21.15.40:0/4139796062 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f641c009a70 con 0x7f64241c4c80 2023-09-30T22:26:27.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.035+0000 7f64237fe700 1 --2- 172.21.15.40:0/4139796062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64241c4c80 0x7f64241c50d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f641c016000 tx=0x7f641c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:27.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.035+0000 7f640b7fe700 1 -- 172.21.15.40:0/4139796062 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641c004240 con 0x7f64241c4c80 2023-09-30T22:26:27.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.035+0000 7f640b7fe700 1 -- 172.21.15.40:0/4139796062 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641c01f070 con 0x7f64241c4c80 2023-09-30T22:26:27.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.035+0000 7f640b7fe700 1 -- 172.21.15.40:0/4139796062 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641c004600 con 0x7f64241c4c80 2023-09-30T22:26:27.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.035+0000 7f6429417700 1 -- 172.21.15.40:0/4139796062 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64241a94a0 con 0x7f64241c4c80 2023-09-30T22:26:27.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.035+0000 7f6429417700 1 -- 172.21.15.40:0/4139796062 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64241aa1d0 con 0x7f64241c4c80 2023-09-30T22:26:27.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.037+0000 7f6429417700 1 -- 172.21.15.40:0/4139796062 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6424062380 con 0x7f64241c4c80 2023-09-30T22:26:27.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.037+0000 7f640b7fe700 1 -- 172.21.15.40:0/4139796062 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f641c004760 con 0x7f64241c4c80 2023-09-30T22:26:27.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.038+0000 7f640b7fe700 1 -- 172.21.15.40:0/4139796062 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f641c0409a0 con 0x7f64241c4c80 2023-09-30T22:26:27.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.046+0000 7f640b7fe700 1 -- 172.21.15.40:0/4139796062 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f641c01a790 con 0x7f64241c4c80 2023-09-30T22:26:27.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.049+0000 7f678b6aa700 1 -- 172.21.15.40:0/3902096295 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6784062380 con 0x7f678409d920 2023-09-30T22:26:27.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.049+0000 7f6779ffb700 1 -- 172.21.15.40:0/3902096295 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6780016070 con 0x7f678409d920 2023-09-30T22:26:27.050 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:27.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.051+0000 7f678b6aa700 1 -- 172.21.15.40:0/3902096295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f678409d920 msgr2=0x7f67841a60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:27.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.051+0000 7f678b6aa700 1 --2- 172.21.15.40:0/3902096295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f678409d920 0x7f67841a60b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6780004000 tx=0x7f6780004750 comp rx=0 tx=0).stop 2023-09-30T22:26:27.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.051+0000 7f678b6aa700 1 -- 172.21.15.40:0/3902096295 shutdown_connections 2023-09-30T22:26:27.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.051+0000 7f678b6aa700 1 --2- 172.21.15.40:0/3902096295 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67841b94a0 0x7f67841a6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.051+0000 7f678b6aa700 1 --2- 172.21.15.40:0/3902096295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f678409d920 0x7f67841a60b0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.051+0000 7f678b6aa700 1 --2- 172.21.15.40:0/3902096295 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f678409e230 0x7f67841a65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.051+0000 7f678b6aa700 1 -- 172.21.15.40:0/3902096295 >> 172.21.15.40:0/3902096295 conn(0x7f678409fb20 msgr2=0x7f67841bb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:27.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.051+0000 7f678b6aa700 1 -- 172.21.15.40:0/3902096295 shutdown_connections 2023-09-30T22:26:27.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.051+0000 7f678b6aa700 1 -- 172.21.15.40:0/3902096295 wait complete. 2023-09-30T22:26:27.064 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:27.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.163+0000 7fbecfbaf700 1 -- 172.21.15.40:0/2580826679 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbec812e1a0 con 0x7fbec8133e00 2023-09-30T22:26:27.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.163+0000 7fbebe7fc700 1 -- 172.21.15.40:0/2580826679 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbec0019300 con 0x7fbec8133e00 2023-09-30T22:26:27.164 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:27.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.165+0000 7fbecfbaf700 1 -- 172.21.15.40:0/2580826679 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbec8133e00 msgr2=0x7fbec81c8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:27.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.165+0000 7fbecfbaf700 1 --2- 172.21.15.40:0/2580826679 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbec8133e00 0x7fbec81c8ab0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fbec000cae0 tx=0x7fbec000cdf0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.165+0000 7fbecfbaf700 1 -- 172.21.15.40:0/2580826679 shutdown_connections 2023-09-30T22:26:27.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.165+0000 7fbecfbaf700 1 --2- 172.21.15.40:0/2580826679 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbec8133e00 0x7fbec81c8ab0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.165+0000 7fbecfbaf700 1 --2- 172.21.15.40:0/2580826679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbec809d400 0x7fbec811caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.165+0000 7fbecfbaf700 1 --2- 172.21.15.40:0/2580826679 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbec809dd70 0x7fbec811d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.165+0000 7fbecfbaf700 1 -- 172.21.15.40:0/2580826679 >> 172.21.15.40:0/2580826679 conn(0x7fbec80a2a00 msgr2=0x7fbec81303c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:27.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.165+0000 7fbecfbaf700 1 -- 172.21.15.40:0/2580826679 shutdown_connections 2023-09-30T22:26:27.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.165+0000 7fbecfbaf700 1 -- 172.21.15.40:0/2580826679 wait complete. 2023-09-30T22:26:27.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:27.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.211+0000 7f779a256700 1 -- 172.21.15.40:0/154409179 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7794074620 con 0x7f779409e480 2023-09-30T22:26:27.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.211+0000 7f777bfff700 1 -- 172.21.15.40:0/154409179 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f778c007920 con 0x7f779409e480 2023-09-30T22:26:27.212 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:27.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.213+0000 7f779a256700 1 -- 172.21.15.40:0/154409179 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f779409e480 msgr2=0x7f779412d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:27.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.213+0000 7f779a256700 1 --2- 172.21.15.40:0/154409179 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f779409e480 0x7f779412d580 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f778c00efc0 tx=0x7f778c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.213+0000 7f779a256700 1 -- 172.21.15.40:0/154409179 shutdown_connections 2023-09-30T22:26:27.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.213+0000 7f779a256700 1 --2- 172.21.15.40:0/154409179 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f779409e480 0x7f779412d580 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.213+0000 7f779a256700 1 --2- 172.21.15.40:0/154409179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f779409c890 0x7f77941c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.213+0000 7f779a256700 1 --2- 172.21.15.40:0/154409179 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f779409d920 0x7f77941c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.213+0000 7f779a256700 1 -- 172.21.15.40:0/154409179 >> 172.21.15.40:0/154409179 conn(0x7f77940a7080 msgr2=0x7f7794132970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:27.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.213+0000 7f779a256700 1 -- 172.21.15.40:0/154409179 shutdown_connections 2023-09-30T22:26:27.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.213+0000 7f779a256700 1 -- 172.21.15.40:0/154409179 wait complete. 2023-09-30T22:26:27.226 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:27.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.242+0000 7f6429417700 1 -- 172.21.15.40:0/4139796062 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6424074720 con 0x7f64241c4c80 2023-09-30T22:26:27.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.242+0000 7f640b7fe700 1 -- 172.21.15.40:0/4139796062 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f641c011390 con 0x7f64241c4c80 2023-09-30T22:26:27.243 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:27.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.244+0000 7f6429417700 1 -- 172.21.15.40:0/4139796062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64241c4c80 msgr2=0x7f64241c50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:27.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.244+0000 7f6429417700 1 --2- 172.21.15.40:0/4139796062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64241c4c80 0x7f64241c50d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f641c016000 tx=0x7f641c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.245+0000 7f6429417700 1 -- 172.21.15.40:0/4139796062 shutdown_connections 2023-09-30T22:26:27.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.245+0000 7f6429417700 1 --2- 172.21.15.40:0/4139796062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64241c4c80 0x7f64241c50d0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.245+0000 7f6429417700 1 --2- 172.21.15.40:0/4139796062 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f642409d920 0x7f64241c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.245+0000 7f6429417700 1 --2- 172.21.15.40:0/4139796062 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f642409e230 0x7f64241c8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.245+0000 7f6429417700 1 -- 172.21.15.40:0/4139796062 >> 172.21.15.40:0/4139796062 conn(0x7f642409fb20 msgr2=0x7f64241bafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:27.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.245+0000 7f6429417700 1 -- 172.21.15.40:0/4139796062 shutdown_connections 2023-09-30T22:26:27.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:27.245+0000 7f6429417700 1 -- 172.21.15.40:0/4139796062 wait complete. 2023-09-30T22:26:27.257 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:28.066 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:28.179 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:28.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.210+0000 7f731f8d8700 1 Processor -- start 2023-09-30T22:26:28.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.210+0000 7f731f8d8700 1 -- start start 2023-09-30T22:26:28.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.210+0000 7f731f8d8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f731806a6d0 0x7f731806aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.210+0000 7f731f8d8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7318131fc0 0x7f7318139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.210+0000 7f731f8d8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f731809eb50 con 0x7f731806afe0 2023-09-30T22:26:28.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.211+0000 7f731f8d8700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f731809dde0 con 0x7f731806a6d0 2023-09-30T22:26:28.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.211+0000 7f731f8d8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f731809d4a0 con 0x7f7318131fc0 2023-09-30T22:26:28.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.211+0000 7f731ce73700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f731806afe0 0x7f73181318b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49896/0 (socket says 172.21.15.40:49896) 2023-09-30T22:26:28.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.211+0000 7f731ce73700 1 -- 172.21.15.40:0/2468003663 learned_addr learned my addr 172.21.15.40:0/2468003663 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:28.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.211+0000 7f731de75700 1 --2- 172.21.15.40:0/2468003663 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7318131fc0 0x7f7318139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.211+0000 7f731d674700 1 --2- 172.21.15.40:0/2468003663 >> v2:172.21.15.40:3300/0 conn(0x7f731806a6d0 0x7f731806aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.211+0000 7f731de75700 1 -- 172.21.15.40:0/2468003663 >> v2:172.21.15.40:3300/0 conn(0x7f731806a6d0 msgr2=0x7f731806aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:28.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.211+0000 7f731de75700 1 --2- 172.21.15.40:0/2468003663 >> v2:172.21.15.40:3300/0 conn(0x7f731806a6d0 0x7f731806aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.211+0000 7f731de75700 1 -- 172.21.15.40:0/2468003663 >> v1:172.21.15.40:6789/0 conn(0x7f731806afe0 legacy=0x7f73181318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.211+0000 7f731de75700 1 -- 172.21.15.40:0/2468003663 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731809f5f0 con 0x7f7318131fc0 2023-09-30T22:26:28.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.211+0000 7f731d674700 1 --2- 172.21.15.40:0/2468003663 >> v2:172.21.15.40:3300/0 conn(0x7f731806a6d0 0x7f731806aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:28.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.211+0000 7f731de75700 1 --2- 172.21.15.40:0/2468003663 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7318131fc0 0x7f7318139b10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7310009d90 tx=0x7f731000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c85473529f6feb53 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:28.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.211+0000 7f730ffff700 1 -- 172.21.15.40:0/2468003663 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731000e070 con 0x7f7318131fc0 2023-09-30T22:26:28.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.211+0000 7f730ffff700 1 -- 172.21.15.40:0/2468003663 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731000bb20 con 0x7f7318131fc0 2023-09-30T22:26:28.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.212+0000 7f730ffff700 1 -- 172.21.15.40:0/2468003663 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7310012430 con 0x7f7318131fc0 2023-09-30T22:26:28.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.212+0000 7f731f8d8700 1 -- 172.21.15.40:0/2468003663 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7318131fc0 msgr2=0x7f7318139b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.212+0000 7f731f8d8700 1 --2- 172.21.15.40:0/2468003663 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7318131fc0 0x7f7318139b10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7310009d90 tx=0x7f731000b330 comp rx=0 tx=0).stop 2023-09-30T22:26:28.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.212+0000 7f731f8d8700 1 -- 172.21.15.40:0/2468003663 shutdown_connections 2023-09-30T22:26:28.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.212+0000 7f731f8d8700 1 --2- 172.21.15.40:0/2468003663 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7318131fc0 0x7f7318139b10 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.212+0000 7f731f8d8700 1 --2- 172.21.15.40:0/2468003663 >> v2:172.21.15.40:3300/0 conn(0x7f731806a6d0 0x7f731806aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.212+0000 7f731f8d8700 1 -- 172.21.15.40:0/2468003663 >> 172.21.15.40:0/2468003663 conn(0x7f731809fb20 msgr2=0x7f731809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:28.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.212+0000 7f731f8d8700 1 -- 172.21.15.40:0/2468003663 shutdown_connections 2023-09-30T22:26:28.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.212+0000 7f731f8d8700 1 -- 172.21.15.40:0/2468003663 wait complete. 2023-09-30T22:26:28.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.213+0000 7f731f8d8700 1 Processor -- start 2023-09-30T22:26:28.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.213+0000 7f731f8d8700 1 -- start start 2023-09-30T22:26:28.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.214+0000 7f731f8d8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f731806a6d0 0x7f73181235b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.214+0000 7f731f8d8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f731806afe0 0x7f7318123af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.214+0000 7f731f8d8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7318131fc0 0x7f73181c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.214+0000 7f731f8d8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7318126560 con 0x7f731806afe0 2023-09-30T22:26:28.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.214+0000 7f731f8d8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7318124ee0 con 0x7f731806a6d0 2023-09-30T22:26:28.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.214+0000 7f731f8d8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7318124930 con 0x7f7318131fc0 2023-09-30T22:26:28.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.214+0000 7f731de75700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7318131fc0 0x7f73181c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.214+0000 7f731de75700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7318131fc0 0x7f73181c84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:38116/0 (socket says 172.21.15.40:38116) 2023-09-30T22:26:28.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.214+0000 7f731de75700 1 -- 172.21.15.40:0/283364555 learned_addr learned my addr 172.21.15.40:0/283364555 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:28.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.214+0000 7f731d674700 1 --2- 172.21.15.40:0/283364555 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f731806a6d0 0x7f73181235b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.214+0000 7f731ce73700 1 --2- 172.21.15.40:0/283364555 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f731806afe0 0x7f7318123af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.214+0000 7f731de75700 1 -- 172.21.15.40:0/283364555 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f731806a6d0 msgr2=0x7f73181235b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.214+0000 7f731de75700 1 --2- 172.21.15.40:0/283364555 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f731806a6d0 0x7f73181235b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.214+0000 7f731de75700 1 -- 172.21.15.40:0/283364555 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f731806afe0 msgr2=0x7f7318123af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.214+0000 7f731de75700 1 --2- 172.21.15.40:0/283364555 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f731806afe0 0x7f7318123af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.214+0000 7f731de75700 1 -- 172.21.15.40:0/283364555 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7314009430 con 0x7f7318131fc0 2023-09-30T22:26:28.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.214+0000 7f731de75700 1 --2- 172.21.15.40:0/283364555 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7318131fc0 0x7f73181c84e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7310014040 tx=0x7f7310004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:28.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.215+0000 7f730dffb700 1 -- 172.21.15.40:0/283364555 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7310012430 con 0x7f7318131fc0 2023-09-30T22:26:28.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.215+0000 7f730dffb700 1 -- 172.21.15.40:0/283364555 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7310020070 con 0x7f7318131fc0 2023-09-30T22:26:28.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.215+0000 7f731f8d8700 1 -- 172.21.15.40:0/283364555 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7310009a70 con 0x7f7318131fc0 2023-09-30T22:26:28.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.215+0000 7f730dffb700 1 -- 172.21.15.40:0/283364555 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7310003ea0 con 0x7f7318131fc0 2023-09-30T22:26:28.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.215+0000 7f731f8d8700 1 -- 172.21.15.40:0/283364555 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7318126fd0 con 0x7f7318131fc0 2023-09-30T22:26:28.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.215+0000 7f730dffb700 1 -- 172.21.15.40:0/283364555 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7310004040 con 0x7f7318131fc0 2023-09-30T22:26:28.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.216+0000 7f730dffb700 1 -- 172.21.15.40:0/283364555 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f7310022070 con 0x7f7318131fc0 2023-09-30T22:26:28.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.216+0000 7f731f8d8700 1 -- 172.21.15.40:0/283364555 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7318062380 con 0x7f7318131fc0 2023-09-30T22:26:28.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.221+0000 7f730dffb700 1 -- 172.21.15.40:0/283364555 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7310025970 con 0x7f7318131fc0 2023-09-30T22:26:28.227 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:28.258 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:28.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.326+0000 7fb4fc38a700 1 Processor -- start 2023-09-30T22:26:28.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.326+0000 7fb4fc38a700 1 -- start start 2023-09-30T22:26:28.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.327+0000 7fb4fc38a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4f413b130 0x7fb4f413d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.327+0000 7fb4fc38a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb4f413da50 0x7fb4f413fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.327+0000 7fb4fc38a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f4137e20 con 0x7fb4f4138250 2023-09-30T22:26:28.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.327+0000 7fb4fc38a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f4138d30 con 0x7fb4f413da50 2023-09-30T22:26:28.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.327+0000 7fb4fc38a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f4138050 con 0x7fb4f413b130 2023-09-30T22:26:28.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.327+0000 7fb4f9925700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4f413b130 0x7fb4f413d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.327+0000 7fb4fa927700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb4f413da50 0x7fb4f413fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.327+0000 7fb4f9925700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4f413b130 0x7fb4f413d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53652/0 (socket says 172.21.15.40:53652) 2023-09-30T22:26:28.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.327+0000 7fb4fa927700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb4f413da50 0x7fb4f413fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33482/0 (socket says 172.21.15.40:33482) 2023-09-30T22:26:28.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.327+0000 7fb4f9925700 1 -- 172.21.15.40:0/1682858917 learned_addr learned my addr 172.21.15.40:0/1682858917 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:28.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.327+0000 7fb4fa927700 1 -- 172.21.15.40:0/1682858917 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4f413b130 msgr2=0x7fb4f413d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:28.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.327+0000 7fb4fa927700 1 --2- 172.21.15.40:0/1682858917 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4f413b130 0x7fb4f413d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.327+0000 7fb4fa927700 1 -- 172.21.15.40:0/1682858917 >> v1:172.21.15.40:6789/0 conn(0x7fb4f4138250 legacy=0x7fb4f4138620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.327+0000 7fb4fa927700 1 -- 172.21.15.40:0/1682858917 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f409b010 con 0x7fb4f413da50 2023-09-30T22:26:28.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.327+0000 7fb4f9925700 1 --2- 172.21.15.40:0/1682858917 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4f413b130 0x7fb4f413d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:28.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.328+0000 7fb4fa927700 1 --2- 172.21.15.40:0/1682858917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4f413da50 0x7fb4f413fe30 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec009dc0 tx=0x7fb4ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf56b2694c86b3b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:28.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.328+0000 7fb4f9124700 1 -- 172.21.15.40:0/1682858917 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec00e070 con 0x7fb4f413da50 2023-09-30T22:26:28.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.328+0000 7fb4f9124700 1 -- 172.21.15.40:0/1682858917 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4ec00bae0 con 0x7fb4f413da50 2023-09-30T22:26:28.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.328+0000 7fb4f9124700 1 -- 172.21.15.40:0/1682858917 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec00be90 con 0x7fb4f413da50 2023-09-30T22:26:28.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.328+0000 7fb4fc38a700 1 -- 172.21.15.40:0/1682858917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4f413da50 msgr2=0x7fb4f413fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.328+0000 7fb4fc38a700 1 --2- 172.21.15.40:0/1682858917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4f413da50 0x7fb4f413fe30 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec009dc0 tx=0x7fb4ec00b330 comp rx=0 tx=0).stop 2023-09-30T22:26:28.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.329+0000 7fb4fc38a700 1 -- 172.21.15.40:0/1682858917 shutdown_connections 2023-09-30T22:26:28.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.329+0000 7fb4fc38a700 1 --2- 172.21.15.40:0/1682858917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4f413da50 0x7fb4f413fe30 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.329+0000 7fb4fc38a700 1 --2- 172.21.15.40:0/1682858917 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4f413b130 0x7fb4f413d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.329+0000 7fb4fc38a700 1 -- 172.21.15.40:0/1682858917 >> 172.21.15.40:0/1682858917 conn(0x7fb4f40a2a00 msgr2=0x7fb4f40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:28.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.329+0000 7fb4fc38a700 1 -- 172.21.15.40:0/1682858917 shutdown_connections 2023-09-30T22:26:28.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.329+0000 7fb4fc38a700 1 -- 172.21.15.40:0/1682858917 wait complete. 2023-09-30T22:26:28.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.330+0000 7fb4fc38a700 1 Processor -- start 2023-09-30T22:26:28.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.330+0000 7fb4fc38a700 1 -- start start 2023-09-30T22:26:28.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.330+0000 7fb4fc38a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4f4138250 0x7fb4f406f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.330+0000 7fb4fc38a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4f413b130 0x7fb4f406fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.330+0000 7fb4fc38a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4f413da50 0x7fb4f4070070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.330+0000 7fb4fc38a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f4071200 con 0x7fb4f413b130 2023-09-30T22:26:28.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.330+0000 7fb4fc38a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f4135620 con 0x7fb4f4138250 2023-09-30T22:26:28.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.330+0000 7fb4fc38a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f41231c0 con 0x7fb4f413da50 2023-09-30T22:26:28.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.330+0000 7fb4fa126700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4f4138250 0x7fb4f406f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.331+0000 7fb4fa126700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4f4138250 0x7fb4f406f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53666/0 (socket says 172.21.15.40:53666) 2023-09-30T22:26:28.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.331+0000 7fb4fa126700 1 -- 172.21.15.40:0/1312376793 learned_addr learned my addr 172.21.15.40:0/1312376793 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:28.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.331+0000 7fb4f9925700 1 --2- 172.21.15.40:0/1312376793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4f413b130 0x7fb4f406fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.331+0000 7fb4fa126700 1 -- 172.21.15.40:0/1312376793 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4f413da50 msgr2=0x7fb4f4070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.331+0000 7fb4fa126700 1 --2- 172.21.15.40:0/1312376793 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4f413da50 0x7fb4f4070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.331+0000 7fb4fa126700 1 -- 172.21.15.40:0/1312376793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4f413b130 msgr2=0x7fb4f406fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.331+0000 7fb4fa126700 1 --2- 172.21.15.40:0/1312376793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4f413b130 0x7fb4f406fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.331+0000 7fb4fa126700 1 -- 172.21.15.40:0/1312376793 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e4009550 con 0x7fb4f4138250 2023-09-30T22:26:28.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.331+0000 7fb4fa126700 1 --2- 172.21.15.40:0/1312376793 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4f4138250 0x7fb4f406f5f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb4f000c4e0 tx=0x7fb4f000c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:28.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.331+0000 7fb4eaffd700 1 -- 172.21.15.40:0/1312376793 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f0011790 con 0x7fb4f4138250 2023-09-30T22:26:28.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.331+0000 7fb4eaffd700 1 -- 172.21.15.40:0/1312376793 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f00118f0 con 0x7fb4f4138250 2023-09-30T22:26:28.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.331+0000 7fb4eaffd700 1 -- 172.21.15.40:0/1312376793 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f0011c60 con 0x7fb4f4138250 2023-09-30T22:26:28.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.331+0000 7fb4fc38a700 1 -- 172.21.15.40:0/1312376793 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4ec009a70 con 0x7fb4f4138250 2023-09-30T22:26:28.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.331+0000 7fb4fc38a700 1 -- 172.21.15.40:0/1312376793 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f409c680 con 0x7fb4f4138250 2023-09-30T22:26:28.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.332+0000 7fb4eaffd700 1 -- 172.21.15.40:0/1312376793 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb4f0005080 con 0x7fb4f4138250 2023-09-30T22:26:28.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.333+0000 7fb4eaffd700 1 -- 172.21.15.40:0/1312376793 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb4f003f020 con 0x7fb4f4138250 2023-09-30T22:26:28.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.333+0000 7fb4fc38a700 1 -- 172.21.15.40:0/1312376793 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f4121b20 con 0x7fb4f4138250 2023-09-30T22:26:28.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.342+0000 7fb4eaffd700 1 -- 172.21.15.40:0/1312376793 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb4f0011dc0 con 0x7fb4f4138250 2023-09-30T22:26:28.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.361+0000 7fe8e50a0700 1 Processor -- start 2023-09-30T22:26:28.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.362+0000 7fe8e50a0700 1 -- start start 2023-09-30T22:26:28.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.362+0000 7fe8e50a0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe8e009e400 0x7fe8e0135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.362+0000 7fe8e50a0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe8e0136230 0x7fe8e0138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.362+0000 7fe8e50a0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e009adf0 con 0x7fe8e009d920 2023-09-30T22:26:28.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.362+0000 7fe8e50a0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e009e7f0 con 0x7fe8e0136230 2023-09-30T22:26:28.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.362+0000 7fe8e50a0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e009edf0 con 0x7fe8e009e400 2023-09-30T22:26:28.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.362+0000 7fe8de59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe8e009e400 0x7fe8e0135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.362+0000 7fe8de59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe8e009e400 0x7fe8e0135cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53668/0 (socket says 172.21.15.40:53668) 2023-09-30T22:26:28.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.362+0000 7fe8de59c700 1 -- 172.21.15.40:0/3861039643 learned_addr learned my addr 172.21.15.40:0/3861039643 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:28.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.363+0000 7fe8de59c700 1 -- 172.21.15.40:0/3861039643 >> v2:172.21.15.40:3300/0 conn(0x7fe8e0136230 msgr2=0x7fe8e0138610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:28.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.363+0000 7fe8df59e700 1 --2- 172.21.15.40:0/3861039643 >> v2:172.21.15.40:3300/0 conn(0x7fe8e0136230 0x7fe8e0138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.363+0000 7fe8de59c700 1 --2- 172.21.15.40:0/3861039643 >> v2:172.21.15.40:3300/0 conn(0x7fe8e0136230 0x7fe8e0138610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.363+0000 7fe8de59c700 1 -- 172.21.15.40:0/3861039643 >> v1:172.21.15.40:6789/0 conn(0x7fe8e009d920 legacy=0x7fe8e009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:28.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.363+0000 7fe8de59c700 1 -- 172.21.15.40:0/3861039643 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e009b660 con 0x7fe8e009e400 2023-09-30T22:26:28.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.363+0000 7fe8df59e700 1 --2- 172.21.15.40:0/3861039643 >> v2:172.21.15.40:3300/0 conn(0x7fe8e0136230 0x7fe8e0138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:26:28.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.363+0000 7fe8de59c700 1 --2- 172.21.15.40:0/3861039643 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe8e009e400 0x7fe8e0135cf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40098f0 tx=0x7fe8d4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbb26dd90fcda00a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:28.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.363+0000 7fe8ddd9b700 1 -- 172.21.15.40:0/3861039643 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4004230 con 0x7fe8e009e400 2023-09-30T22:26:28.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.363+0000 7fe8ddd9b700 1 -- 172.21.15.40:0/3861039643 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d4004390 con 0x7fe8e009e400 2023-09-30T22:26:28.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.363+0000 7fe8ddd9b700 1 -- 172.21.15.40:0/3861039643 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d40036a0 con 0x7fe8e009e400 2023-09-30T22:26:28.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.364+0000 7fe8e50a0700 1 -- 172.21.15.40:0/3861039643 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe8e009e400 msgr2=0x7fe8e0135cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.364+0000 7fe8e50a0700 1 --2- 172.21.15.40:0/3861039643 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe8e009e400 0x7fe8e0135cf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40098f0 tx=0x7fe8d4009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:28.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.364+0000 7fe8e50a0700 1 -- 172.21.15.40:0/3861039643 shutdown_connections 2023-09-30T22:26:28.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.364+0000 7fe8e50a0700 1 --2- 172.21.15.40:0/3861039643 >> v2:172.21.15.40:3300/0 conn(0x7fe8e0136230 0x7fe8e0138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.364+0000 7fe8e50a0700 1 --2- 172.21.15.40:0/3861039643 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe8e009e400 0x7fe8e0135cf0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.364+0000 7fe8e50a0700 1 -- 172.21.15.40:0/3861039643 >> 172.21.15.40:0/3861039643 conn(0x7fe8e009fb20 msgr2=0x7fe8e009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:28.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.364+0000 7fe8e50a0700 1 -- 172.21.15.40:0/3861039643 shutdown_connections 2023-09-30T22:26:28.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.364+0000 7fe8e50a0700 1 -- 172.21.15.40:0/3861039643 wait complete. 2023-09-30T22:26:28.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.365+0000 7fe8e50a0700 1 Processor -- start 2023-09-30T22:26:28.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.365+0000 7fe8e50a0700 1 -- start start 2023-09-30T22:26:28.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.366+0000 7fe8e50a0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe8e009d920 0x7fe8e0136c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.366+0000 7fe8e50a0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe8e009e400 0x7fe8e0137160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.366+0000 7fe8e50a0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8e0136230 0x7fe8e01376a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.366+0000 7fe8e50a0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e013b130 con 0x7fe8e0136230 2023-09-30T22:26:28.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.366+0000 7fe8e50a0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e013a310 con 0x7fe8e009e400 2023-09-30T22:26:28.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.366+0000 7fe8e50a0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e0139fb0 con 0x7fe8e009d920 2023-09-30T22:26:28.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.366+0000 7fe8de59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe8e009e400 0x7fe8e0137160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.366+0000 7fe8de59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe8e009e400 0x7fe8e0137160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53680/0 (socket says 172.21.15.40:53680) 2023-09-30T22:26:28.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.366+0000 7fe8de59c700 1 -- 172.21.15.40:0/836546251 learned_addr learned my addr 172.21.15.40:0/836546251 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:28.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.366+0000 7fe8df59e700 1 --2- 172.21.15.40:0/836546251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8e0136230 0x7fe8e01376a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.366+0000 7fe8de59c700 1 -- 172.21.15.40:0/836546251 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe8e009d920 msgr2=0x7fe8e0136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.366+0000 7fe8de59c700 1 --2- 172.21.15.40:0/836546251 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe8e009d920 0x7fe8e0136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.366+0000 7fe8de59c700 1 -- 172.21.15.40:0/836546251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8e0136230 msgr2=0x7fe8e01376a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.366+0000 7fe8de59c700 1 --2- 172.21.15.40:0/836546251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8e0136230 0x7fe8e01376a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.366+0000 7fe8de59c700 1 -- 172.21.15.40:0/836546251 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d4009550 con 0x7fe8e009e400 2023-09-30T22:26:28.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.367+0000 7fe8de59c700 1 --2- 172.21.15.40:0/836546251 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe8e009e400 0x7fe8e0137160 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00a3010 tx=0x7fe8d4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:28.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.367+0000 7fe8c77fe700 1 -- 172.21.15.40:0/836546251 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d400b660 con 0x7fe8e009e400 2023-09-30T22:26:28.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.367+0000 7fe8c77fe700 1 -- 172.21.15.40:0/836546251 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d400b7e0 con 0x7fe8e009e400 2023-09-30T22:26:28.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.367+0000 7fe8e50a0700 1 -- 172.21.15.40:0/836546251 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e0138e70 con 0x7fe8e009e400 2023-09-30T22:26:28.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.367+0000 7fe8c77fe700 1 -- 172.21.15.40:0/836546251 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d400bb90 con 0x7fe8e009e400 2023-09-30T22:26:28.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.367+0000 7fe8e50a0700 1 -- 172.21.15.40:0/836546251 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e0139d60 con 0x7fe8e009e400 2023-09-30T22:26:28.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.368+0000 7fe8c77fe700 1 -- 172.21.15.40:0/836546251 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe8d4021070 con 0x7fe8e009e400 2023-09-30T22:26:28.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.368+0000 7fe8e50a0700 1 -- 172.21.15.40:0/836546251 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e009a660 con 0x7fe8e009e400 2023-09-30T22:26:28.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.368+0000 7fe8c77fe700 1 -- 172.21.15.40:0/836546251 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe8d4040f90 con 0x7fe8e009e400 2023-09-30T22:26:28.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.373+0000 7fe8c77fe700 1 -- 172.21.15.40:0/836546251 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe8d400bcf0 con 0x7fe8e009e400 2023-09-30T22:26:28.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.402+0000 7f0cab434700 1 Processor -- start 2023-09-30T22:26:28.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.402+0000 7f0cab434700 1 -- start start 2023-09-30T22:26:28.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.403+0000 7f0cab434700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0ca409d920 0x7f0ca409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.403+0000 7f0cab434700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ca409f0f0 0x7f0ca409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.403+0000 7f0cab434700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ca4133ca0 0x7f0ca4134110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.403+0000 7f0cab434700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca406b4c0 con 0x7f0ca409d920 2023-09-30T22:26:28.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.403+0000 7f0cab434700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca409a8f0 con 0x7f0ca409f0f0 2023-09-30T22:26:28.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.403+0000 7f0cab434700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca409f940 con 0x7f0ca4133ca0 2023-09-30T22:26:28.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.403+0000 7f0ca91d0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0ca409d920 0x7f0ca409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.403+0000 7f0ca91d0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0ca409d920 0x7f0ca409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33512/0 (socket says 172.21.15.40:33512) 2023-09-30T22:26:28.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.403+0000 7f0ca91d0700 1 -- 172.21.15.40:0/3557250465 learned_addr learned my addr 172.21.15.40:0/3557250465 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:28.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.403+0000 7f0ca89cf700 1 --2- 172.21.15.40:0/3557250465 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ca409f0f0 0x7f0ca409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.403+0000 7f0ca99d1700 1 --2- 172.21.15.40:0/3557250465 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ca4133ca0 0x7f0ca4134110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.404+0000 7f0ca91d0700 1 -- 172.21.15.40:0/3557250465 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ca4133ca0 msgr2=0x7f0ca4134110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:28.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.404+0000 7f0ca91d0700 1 --2- 172.21.15.40:0/3557250465 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ca4133ca0 0x7f0ca4134110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.404+0000 7f0ca91d0700 1 -- 172.21.15.40:0/3557250465 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ca409f0f0 msgr2=0x7f0ca409e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:28.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.404+0000 7f0ca91d0700 1 --2- 172.21.15.40:0/3557250465 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ca409f0f0 0x7f0ca409e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.404+0000 7f0ca91d0700 1 -- 172.21.15.40:0/3557250465 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca409f6e0 con 0x7f0ca409d920 2023-09-30T22:26:28.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.404+0000 7f0ca91d0700 1 --2- 172.21.15.40:0/3557250465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ca409d920 0x7f0ca409dcf0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0ca00098f0 tx=0x7f0ca0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9aee9b06e284e4c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:28.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.404+0000 7f0c9bfff700 1 -- 172.21.15.40:0/3557250465 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca0005e30 con 0x7f0ca409d920 2023-09-30T22:26:28.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.404+0000 7f0c9bfff700 1 -- 172.21.15.40:0/3557250465 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca0004030 con 0x7f0ca409d920 2023-09-30T22:26:28.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.404+0000 7f0c9bfff700 1 -- 172.21.15.40:0/3557250465 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca00043e0 con 0x7f0ca409d920 2023-09-30T22:26:28.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.405+0000 7f0cab434700 1 -- 172.21.15.40:0/3557250465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ca409d920 msgr2=0x7f0ca409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.405+0000 7f0cab434700 1 --2- 172.21.15.40:0/3557250465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ca409d920 0x7f0ca409dcf0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0ca00098f0 tx=0x7f0ca0009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:28.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.405+0000 7f0cab434700 1 -- 172.21.15.40:0/3557250465 shutdown_connections 2023-09-30T22:26:28.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.405+0000 7f0cab434700 1 --2- 172.21.15.40:0/3557250465 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ca4133ca0 0x7f0ca4134110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.405+0000 7f0cab434700 1 --2- 172.21.15.40:0/3557250465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ca409d920 0x7f0ca409dcf0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.405+0000 7f0cab434700 1 --2- 172.21.15.40:0/3557250465 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ca409f0f0 0x7f0ca409e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.405+0000 7f0cab434700 1 -- 172.21.15.40:0/3557250465 >> 172.21.15.40:0/3557250465 conn(0x7f0ca409fb20 msgr2=0x7f0ca409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:28.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.405+0000 7f0cab434700 1 -- 172.21.15.40:0/3557250465 shutdown_connections 2023-09-30T22:26:28.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.405+0000 7f0cab434700 1 -- 172.21.15.40:0/3557250465 wait complete. 2023-09-30T22:26:28.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.406+0000 7f0cab434700 1 Processor -- start 2023-09-30T22:26:28.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.406+0000 7f0cab434700 1 -- start start 2023-09-30T22:26:28.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.407+0000 7f0cab434700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ca4133ca0 0x7f0ca41229d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.407+0000 7f0cab434700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ca4122f10 0x7f0ca4123340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.407+0000 7f0cab434700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ca41c87d0 0x7f0ca41c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.407+0000 7f0cab434700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca41245e0 con 0x7f0ca4122f10 2023-09-30T22:26:28.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.407+0000 7f0cab434700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca4123880 con 0x7f0ca4133ca0 2023-09-30T22:26:28.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.407+0000 7f0cab434700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca4133560 con 0x7f0ca41c87d0 2023-09-30T22:26:28.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.407+0000 7f0ca91d0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ca4133ca0 0x7f0ca41229d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.407+0000 7f0ca91d0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ca4133ca0 0x7f0ca41229d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53700/0 (socket says 172.21.15.40:53700) 2023-09-30T22:26:28.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.407+0000 7f0ca91d0700 1 -- 172.21.15.40:0/3056080175 learned_addr learned my addr 172.21.15.40:0/3056080175 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:28.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.407+0000 7f0ca89cf700 1 --2- 172.21.15.40:0/3056080175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ca4122f10 0x7f0ca4123340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.407+0000 7f0ca99d1700 1 --2- 172.21.15.40:0/3056080175 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ca41c87d0 0x7f0ca41c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.407+0000 7f0ca91d0700 1 -- 172.21.15.40:0/3056080175 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ca41c87d0 msgr2=0x7f0ca41c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.407+0000 7f0ca91d0700 1 --2- 172.21.15.40:0/3056080175 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ca41c87d0 0x7f0ca41c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.407+0000 7f0ca91d0700 1 -- 172.21.15.40:0/3056080175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ca4122f10 msgr2=0x7f0ca4123340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.407+0000 7f0ca91d0700 1 --2- 172.21.15.40:0/3056080175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ca4122f10 0x7f0ca4123340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.407+0000 7f0ca91d0700 1 -- 172.21.15.40:0/3056080175 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca0009500 con 0x7f0ca4133ca0 2023-09-30T22:26:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.408+0000 7f0ca91d0700 1 --2- 172.21.15.40:0/3056080175 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ca4133ca0 0x7f0ca41229d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0000c00 tx=0x7f0ca0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.408+0000 7f0c99ffb700 1 -- 172.21.15.40:0/3056080175 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca00038d0 con 0x7f0ca4133ca0 2023-09-30T22:26:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.408+0000 7f0c99ffb700 1 -- 172.21.15.40:0/3056080175 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca0003a30 con 0x7f0ca4133ca0 2023-09-30T22:26:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.408+0000 7f0cab434700 1 -- 172.21.15.40:0/3056080175 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca4125f50 con 0x7f0ca4133ca0 2023-09-30T22:26:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.408+0000 7f0c99ffb700 1 -- 172.21.15.40:0/3056080175 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca0003de0 con 0x7f0ca4133ca0 2023-09-30T22:26:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.408+0000 7f0cab434700 1 -- 172.21.15.40:0/3056080175 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca409c9e0 con 0x7f0ca4133ca0 2023-09-30T22:26:28.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.410+0000 7f0cab434700 1 -- 172.21.15.40:0/3056080175 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca4062380 con 0x7f0ca4133ca0 2023-09-30T22:26:28.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.410+0000 7f0c99ffb700 1 -- 172.21.15.40:0/3056080175 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0ca0028020 con 0x7f0ca4133ca0 2023-09-30T22:26:28.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.410+0000 7f0c99ffb700 1 -- 172.21.15.40:0/3056080175 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f0ca0048480 con 0x7f0ca4133ca0 2023-09-30T22:26:28.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.414+0000 7f0c99ffb700 1 -- 172.21.15.40:0/3056080175 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0ca0010de0 con 0x7f0ca4133ca0 2023-09-30T22:26:28.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.442+0000 7f731f8d8700 1 -- 172.21.15.40:0/283364555 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7318126200 con 0x7f7318131fc0 2023-09-30T22:26:28.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.442+0000 7f730dffb700 1 -- 172.21.15.40:0/283364555 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7310035090 con 0x7f7318131fc0 2023-09-30T22:26:28.443 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:28.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.446+0000 7f731f8d8700 1 -- 172.21.15.40:0/283364555 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7318131fc0 msgr2=0x7f73181c84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.446+0000 7f731f8d8700 1 --2- 172.21.15.40:0/283364555 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7318131fc0 0x7f73181c84e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7310014040 tx=0x7f7310004ad0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.446+0000 7f731f8d8700 1 -- 172.21.15.40:0/283364555 shutdown_connections 2023-09-30T22:26:28.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.446+0000 7f731f8d8700 1 --2- 172.21.15.40:0/283364555 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7318131fc0 0x7f73181c84e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.446+0000 7f731f8d8700 1 --2- 172.21.15.40:0/283364555 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f731806a6d0 0x7f73181235b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.446+0000 7f731f8d8700 1 --2- 172.21.15.40:0/283364555 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f731806afe0 0x7f7318123af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.446+0000 7f731f8d8700 1 -- 172.21.15.40:0/283364555 >> 172.21.15.40:0/283364555 conn(0x7f731809fb20 msgr2=0x7f731806f760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:28.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.446+0000 7f731f8d8700 1 -- 172.21.15.40:0/283364555 shutdown_connections 2023-09-30T22:26:28.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.446+0000 7f731f8d8700 1 -- 172.21.15.40:0/283364555 wait complete. 2023-09-30T22:26:28.465 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:28.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.548+0000 7fb4fc38a700 1 -- 172.21.15.40:0/1312376793 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb4f409f240 con 0x7fb4f4138250 2023-09-30T22:26:28.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.548+0000 7fb4eaffd700 1 -- 172.21.15.40:0/1312376793 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb4f0019310 con 0x7fb4f4138250 2023-09-30T22:26:28.550 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:28.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.550+0000 7fb4fc38a700 1 -- 172.21.15.40:0/1312376793 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4f4138250 msgr2=0x7fb4f406f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.550+0000 7fb4fc38a700 1 --2- 172.21.15.40:0/1312376793 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4f4138250 0x7fb4f406f5f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb4f000c4e0 tx=0x7fb4f000c7f0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.550+0000 7fb4fc38a700 1 -- 172.21.15.40:0/1312376793 shutdown_connections 2023-09-30T22:26:28.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.550+0000 7fb4fc38a700 1 --2- 172.21.15.40:0/1312376793 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4f413da50 0x7fb4f4070070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.550+0000 7fb4fc38a700 1 --2- 172.21.15.40:0/1312376793 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4f4138250 0x7fb4f406f5f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.550+0000 7fb4fc38a700 1 --2- 172.21.15.40:0/1312376793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4f413b130 0x7fb4f406fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.550+0000 7fb4fc38a700 1 -- 172.21.15.40:0/1312376793 >> 172.21.15.40:0/1312376793 conn(0x7fb4f40a2a00 msgr2=0x7fb4f409d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:28.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.551+0000 7fb4fc38a700 1 -- 172.21.15.40:0/1312376793 shutdown_connections 2023-09-30T22:26:28.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.551+0000 7fb4fc38a700 1 -- 172.21.15.40:0/1312376793 wait complete. 2023-09-30T22:26:28.563 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:28.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.579+0000 7fe8e50a0700 1 -- 172.21.15.40:0/836546251 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe8e0062380 con 0x7fe8e009e400 2023-09-30T22:26:28.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.580+0000 7fe8c77fe700 1 -- 172.21.15.40:0/836546251 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe8d402dbe0 con 0x7fe8e009e400 2023-09-30T22:26:28.581 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:28.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.582+0000 7fe8e50a0700 1 -- 172.21.15.40:0/836546251 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe8e009e400 msgr2=0x7fe8e0137160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.582+0000 7fe8e50a0700 1 --2- 172.21.15.40:0/836546251 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe8e009e400 0x7fe8e0137160 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00a3010 tx=0x7fe8d4004750 comp rx=0 tx=0).stop 2023-09-30T22:26:28.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.582+0000 7fe8e50a0700 1 -- 172.21.15.40:0/836546251 shutdown_connections 2023-09-30T22:26:28.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.582+0000 7fe8e50a0700 1 --2- 172.21.15.40:0/836546251 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe8e009d920 0x7fe8e0136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.582+0000 7fe8e50a0700 1 --2- 172.21.15.40:0/836546251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8e0136230 0x7fe8e01376a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.582+0000 7fe8e50a0700 1 --2- 172.21.15.40:0/836546251 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe8e009e400 0x7fe8e0137160 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.582+0000 7fe8e50a0700 1 -- 172.21.15.40:0/836546251 >> 172.21.15.40:0/836546251 conn(0x7fe8e009fb20 msgr2=0x7fe8e011b740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:28.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.582+0000 7fe8e50a0700 1 -- 172.21.15.40:0/836546251 shutdown_connections 2023-09-30T22:26:28.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.582+0000 7fe8e50a0700 1 -- 172.21.15.40:0/836546251 wait complete. 2023-09-30T22:26:28.595 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:28.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.615+0000 7f0cab434700 1 -- 172.21.15.40:0/3056080175 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0ca4126270 con 0x7f0ca4133ca0 2023-09-30T22:26:28.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.616+0000 7f0c99ffb700 1 -- 172.21.15.40:0/3056080175 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0ca0030030 con 0x7f0ca4133ca0 2023-09-30T22:26:28.617 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:28.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.618+0000 7f0cab434700 1 -- 172.21.15.40:0/3056080175 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ca4133ca0 msgr2=0x7f0ca41229d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.618+0000 7f0cab434700 1 --2- 172.21.15.40:0/3056080175 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ca4133ca0 0x7f0ca41229d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0000c00 tx=0x7f0ca0004750 comp rx=0 tx=0).stop 2023-09-30T22:26:28.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.618+0000 7f0cab434700 1 -- 172.21.15.40:0/3056080175 shutdown_connections 2023-09-30T22:26:28.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.618+0000 7f0cab434700 1 --2- 172.21.15.40:0/3056080175 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ca41c87d0 0x7f0ca41c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.618+0000 7f0cab434700 1 --2- 172.21.15.40:0/3056080175 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ca4133ca0 0x7f0ca41229d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.618+0000 7f0cab434700 1 --2- 172.21.15.40:0/3056080175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ca4122f10 0x7f0ca4123340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.618+0000 7f0cab434700 1 -- 172.21.15.40:0/3056080175 >> 172.21.15.40:0/3056080175 conn(0x7f0ca409fb20 msgr2=0x7f0ca40a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:28.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.618+0000 7f0cab434700 1 -- 172.21.15.40:0/3056080175 shutdown_connections 2023-09-30T22:26:28.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:28.618+0000 7f0cab434700 1 -- 172.21.15.40:0/3056080175 wait complete. 2023-09-30T22:26:28.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:29.465 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:29.564 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:29.596 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:29.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.608+0000 7f92df657700 1 Processor -- start 2023-09-30T22:26:29.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.608+0000 7f92df657700 1 -- start start 2023-09-30T22:26:29.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.609+0000 7f92df657700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92d809c890 0x7f92d809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:29.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.609+0000 7f92df657700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f92d809d920 0x7f92d809dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:29.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.609+0000 7f92df657700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d80a2600 con 0x7f92d809e2b0 2023-09-30T22:26:29.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.609+0000 7f92df657700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d80a29d0 con 0x7f92d809c890 2023-09-30T22:26:29.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.609+0000 7f92df657700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92d809fb40 con 0x7f92d809d920 2023-09-30T22:26:29.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.609+0000 7f92dcbf2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f92d809d920 0x7f92d809dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:29.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.609+0000 7f92ddbf4700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f92d809e2b0 0x7f92d813ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49908/0 (socket says 172.21.15.40:49908) 2023-09-30T22:26:29.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.609+0000 7f92ddbf4700 1 -- 172.21.15.40:0/3725913855 learned_addr learned my addr 172.21.15.40:0/3725913855 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:29.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.609+0000 7f92dd3f3700 1 --2- 172.21.15.40:0/3725913855 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92d809c890 0x7f92d809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:29.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.609+0000 7f92dd3f3700 1 -- 172.21.15.40:0/3725913855 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f92d809d920 msgr2=0x7f92d809dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:29.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.609+0000 7f92dd3f3700 1 --2- 172.21.15.40:0/3725913855 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f92d809d920 0x7f92d809dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:29.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.609+0000 7f92dd3f3700 1 -- 172.21.15.40:0/3725913855 >> v1:172.21.15.40:6789/0 conn(0x7f92d809e2b0 legacy=0x7f92d813ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:29.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.609+0000 7f92cffff700 1 -- 172.21.15.40:0/3725913855 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1376864249 0 0) 0x7f92d80a2600 con 0x7f92d809e2b0 2023-09-30T22:26:29.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.609+0000 7f92dd3f3700 1 -- 172.21.15.40:0/3725913855 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d809e720 con 0x7f92d809c890 2023-09-30T22:26:29.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.609+0000 7f92dcbf2700 1 --2- 172.21.15.40:0/3725913855 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f92d809d920 0x7f92d809dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:29.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.610+0000 7f92dd3f3700 1 --2- 172.21.15.40:0/3725913855 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92d809c890 0x7f92d809cc60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f92c8009850 tx=0x7f92c8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb3bc63eb5bc5875 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:29.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.610+0000 7f92cffff700 1 -- 172.21.15.40:0/3725913855 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c8005e30 con 0x7f92d809c890 2023-09-30T22:26:29.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.610+0000 7f92cffff700 1 -- 172.21.15.40:0/3725913855 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c8006030 con 0x7f92d809c890 2023-09-30T22:26:29.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.610+0000 7f92cffff700 1 -- 172.21.15.40:0/3725913855 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c80063e0 con 0x7f92d809c890 2023-09-30T22:26:29.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.611+0000 7f92df657700 1 -- 172.21.15.40:0/3725913855 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92d809c890 msgr2=0x7f92d809cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:29.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.611+0000 7f92df657700 1 --2- 172.21.15.40:0/3725913855 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92d809c890 0x7f92d809cc60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f92c8009850 tx=0x7f92c8009b60 comp rx=0 tx=0).stop 2023-09-30T22:26:29.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.611+0000 7f92df657700 1 -- 172.21.15.40:0/3725913855 shutdown_connections 2023-09-30T22:26:29.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.611+0000 7f92df657700 1 --2- 172.21.15.40:0/3725913855 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92d809c890 0x7f92d809cc60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:29.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.611+0000 7f92df657700 1 --2- 172.21.15.40:0/3725913855 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f92d809d920 0x7f92d809dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:29.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.611+0000 7f92df657700 1 -- 172.21.15.40:0/3725913855 >> 172.21.15.40:0/3725913855 conn(0x7f92d80a7080 msgr2=0x7f92d80a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:29.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.611+0000 7f92df657700 1 -- 172.21.15.40:0/3725913855 shutdown_connections 2023-09-30T22:26:29.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.611+0000 7f92df657700 1 -- 172.21.15.40:0/3725913855 wait complete. 2023-09-30T22:26:29.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.612+0000 7f92df657700 1 Processor -- start 2023-09-30T22:26:29.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.612+0000 7f92df657700 1 -- start start 2023-09-30T22:26:29.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.612+0000 7f92df657700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f92d809c890 0x7f92d812f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:29.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.612+0000 7f92df657700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d809d920 0x7f92d812fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:29.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.612+0000 7f92df657700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92d809e2b0 0x7f92d812fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:29.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.613+0000 7f92df657700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d80a5b90 con 0x7f92d809d920 2023-09-30T22:26:29.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.613+0000 7f92df657700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d8131550 con 0x7f92d809e2b0 2023-09-30T22:26:29.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.613+0000 7f92df657700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92d812e3f0 con 0x7f92d809c890 2023-09-30T22:26:29.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.613+0000 7f92dd3f3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f92d809c890 0x7f92d812f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:29.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.613+0000 7f92dd3f3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f92d809c890 0x7f92d812f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:38170/0 (socket says 172.21.15.40:38170) 2023-09-30T22:26:29.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.613+0000 7f92dd3f3700 1 -- 172.21.15.40:0/3364150761 learned_addr learned my addr 172.21.15.40:0/3364150761 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:29.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.613+0000 7f92ddbf4700 1 --2- 172.21.15.40:0/3364150761 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92d809e2b0 0x7f92d812fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:29.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.613+0000 7f92dcbf2700 1 --2- 172.21.15.40:0/3364150761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d809d920 0x7f92d812fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:29.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.613+0000 7f92dd3f3700 1 -- 172.21.15.40:0/3364150761 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92d809e2b0 msgr2=0x7f92d812fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:29.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.613+0000 7f92dd3f3700 1 --2- 172.21.15.40:0/3364150761 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92d809e2b0 0x7f92d812fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:29.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.613+0000 7f92dd3f3700 1 -- 172.21.15.40:0/3364150761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d809d920 msgr2=0x7f92d812fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:29.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.613+0000 7f92dd3f3700 1 --2- 172.21.15.40:0/3364150761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d809d920 0x7f92d812fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:29.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.613+0000 7f92dd3f3700 1 -- 172.21.15.40:0/3364150761 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d40094a0 con 0x7f92d809c890 2023-09-30T22:26:29.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.613+0000 7f92dcbf2700 1 --2- 172.21.15.40:0/3364150761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d809d920 0x7f92d812fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:29.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.613+0000 7f92dd3f3700 1 --2- 172.21.15.40:0/3364150761 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f92d809c890 0x7f92d812f570 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f92d806ca30 tx=0x7f92c8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:29.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.613+0000 7f92cdffb700 1 -- 172.21.15.40:0/3364150761 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c8025670 con 0x7f92d809c890 2023-09-30T22:26:29.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.614+0000 7f92cdffb700 1 -- 172.21.15.40:0/3364150761 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c80257f0 con 0x7f92d809c890 2023-09-30T22:26:29.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.614+0000 7f92df657700 1 -- 172.21.15.40:0/3364150761 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c8009430 con 0x7f92d809c890 2023-09-30T22:26:29.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.614+0000 7f92cdffb700 1 -- 172.21.15.40:0/3364150761 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c8025ba0 con 0x7f92d809c890 2023-09-30T22:26:29.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.614+0000 7f92df657700 1 -- 172.21.15.40:0/3364150761 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d812d270 con 0x7f92d809c890 2023-09-30T22:26:29.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.614+0000 7f92cdffb700 1 -- 172.21.15.40:0/3364150761 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f92c8022070 con 0x7f92d809c890 2023-09-30T22:26:29.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.615+0000 7f92cdffb700 1 -- 172.21.15.40:0/3364150761 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f92c8041090 con 0x7f92d809c890 2023-09-30T22:26:29.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.615+0000 7f92df657700 1 -- 172.21.15.40:0/3364150761 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92d806e600 con 0x7f92d809c890 2023-09-30T22:26:29.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.621+0000 7f92cdffb700 1 -- 172.21.15.40:0/3364150761 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f92c802a070 con 0x7f92d809c890 2023-09-30T22:26:29.633 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:29.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.732+0000 7f8368c2d700 1 Processor -- start 2023-09-30T22:26:29.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.732+0000 7f8368c2d700 1 -- start start 2023-09-30T22:26:29.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.732+0000 7f8368c2d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f836409e030 0x7f836413d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:29.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.732+0000 7f8368c2d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f836409e420 0x7f836413f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:29.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.732+0000 7f8368c2d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f836411d980 con 0x7f836406a6d0 2023-09-30T22:26:29.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.732+0000 7f8368c2d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f836406aaa0 con 0x7f836409e420 2023-09-30T22:26:29.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.732+0000 7f8368c2d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f836406b150 con 0x7f836409e030 2023-09-30T22:26:29.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.733+0000 7f836259c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f836406a6d0 0x7f836409d920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49916/0 (socket says 172.21.15.40:49916) 2023-09-30T22:26:29.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.733+0000 7f836259c700 1 -- 172.21.15.40:0/2211134979 learned_addr learned my addr 172.21.15.40:0/2211134979 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:29.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.733+0000 7f8361d9b700 1 --2- 172.21.15.40:0/2211134979 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f836409e030 0x7f836413d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:29.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.733+0000 7f8362d9d700 1 --2- 172.21.15.40:0/2211134979 >> v2:172.21.15.40:3300/0 conn(0x7f836409e420 0x7f836413f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:29.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.733+0000 7f836159a700 1 -- 172.21.15.40:0/2211134979 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126065906 0 0) 0x7f836411d980 con 0x7f836406a6d0 2023-09-30T22:26:29.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.733+0000 7f836159a700 1 -- 172.21.15.40:0/2211134979 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f834c0035b0 con 0x7f836406a6d0 2023-09-30T22:26:29.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.733+0000 7f8361d9b700 1 -- 172.21.15.40:0/2211134979 >> v2:172.21.15.40:3300/0 conn(0x7f836409e420 msgr2=0x7f836413f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:29.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.733+0000 7f8361d9b700 1 --2- 172.21.15.40:0/2211134979 >> v2:172.21.15.40:3300/0 conn(0x7f836409e420 0x7f836413f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:29.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.733+0000 7f8361d9b700 1 -- 172.21.15.40:0/2211134979 >> v1:172.21.15.40:6789/0 conn(0x7f836406a6d0 legacy=0x7f836409d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:29.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.733+0000 7f8361d9b700 1 -- 172.21.15.40:0/2211134979 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836409f300 con 0x7f836409e030 2023-09-30T22:26:29.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.733+0000 7f8362d9d700 1 --2- 172.21.15.40:0/2211134979 >> v2:172.21.15.40:3300/0 conn(0x7f836409e420 0x7f836413f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:29.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.733+0000 7f8361d9b700 1 --2- 172.21.15.40:0/2211134979 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f836409e030 0x7f836413d4a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8358009840 tx=0x7f8358009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdd99ca13c11c1b5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:29.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.734+0000 7f836159a700 1 -- 172.21.15.40:0/2211134979 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8358011830 con 0x7f836409e030 2023-09-30T22:26:29.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.734+0000 7f836159a700 1 -- 172.21.15.40:0/2211134979 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8358011990 con 0x7f836409e030 2023-09-30T22:26:29.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.734+0000 7f836159a700 1 -- 172.21.15.40:0/2211134979 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8358011d20 con 0x7f836409e030 2023-09-30T22:26:29.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.734+0000 7f8368c2d700 1 -- 172.21.15.40:0/2211134979 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f836409e030 msgr2=0x7f836413d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:29.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.734+0000 7f8368c2d700 1 --2- 172.21.15.40:0/2211134979 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f836409e030 0x7f836413d4a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8358009840 tx=0x7f8358009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:29.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.734+0000 7f8368c2d700 1 -- 172.21.15.40:0/2211134979 shutdown_connections 2023-09-30T22:26:29.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.734+0000 7f8368c2d700 1 --2- 172.21.15.40:0/2211134979 >> v2:172.21.15.40:3300/0 conn(0x7f836409e420 0x7f836413f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:29.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.734+0000 7f8368c2d700 1 --2- 172.21.15.40:0/2211134979 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f836409e030 0x7f836413d4a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:29.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.734+0000 7f8368c2d700 1 -- 172.21.15.40:0/2211134979 >> 172.21.15.40:0/2211134979 conn(0x7f836409fb20 msgr2=0x7f836409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:29.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.734+0000 7f8368c2d700 1 -- 172.21.15.40:0/2211134979 shutdown_connections 2023-09-30T22:26:29.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.734+0000 7f8368c2d700 1 -- 172.21.15.40:0/2211134979 wait complete. 2023-09-30T22:26:29.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.735+0000 7f8368c2d700 1 Processor -- start 2023-09-30T22:26:29.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.736+0000 7f8368c2d700 1 -- start start 2023-09-30T22:26:29.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.736+0000 7f8368c2d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f836406a6d0 0x7f8364131280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:29.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.736+0000 7f8368c2d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f836409e030 0x7f836411c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:29.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.736+0000 7f8368c2d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f836409e420 0x7f836411cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:29.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.736+0000 7f8368c2d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836411f5e0 con 0x7f836409e030 2023-09-30T22:26:29.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.736+0000 7f8368c2d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836411e400 con 0x7f836406a6d0 2023-09-30T22:26:29.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.736+0000 7f8368c2d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83640a13a0 con 0x7f836409e420 2023-09-30T22:26:29.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.736+0000 7f8362d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f836409e420 0x7f836411cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:29.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.736+0000 7f8362d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f836409e420 0x7f836411cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:38188/0 (socket says 172.21.15.40:38188) 2023-09-30T22:26:29.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.736+0000 7f8362d9d700 1 -- 172.21.15.40:0/1482560653 learned_addr learned my addr 172.21.15.40:0/1482560653 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:29.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.736+0000 7f836259c700 1 --2- 172.21.15.40:0/1482560653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f836406a6d0 0x7f8364131280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:29.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.736+0000 7f8361d9b700 1 --2- 172.21.15.40:0/1482560653 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f836409e030 0x7f836411c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:29.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.737+0000 7f836259c700 1 -- 172.21.15.40:0/1482560653 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f836409e420 msgr2=0x7f836411cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:29.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.737+0000 7f836259c700 1 --2- 172.21.15.40:0/1482560653 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f836409e420 0x7f836411cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:29.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.737+0000 7f836259c700 1 -- 172.21.15.40:0/1482560653 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f836409e030 msgr2=0x7f836411c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:29.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.737+0000 7f836259c700 1 --2- 172.21.15.40:0/1482560653 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f836409e030 0x7f836411c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:29.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.737+0000 7f836259c700 1 -- 172.21.15.40:0/1482560653 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835c009a70 con 0x7f836406a6d0 2023-09-30T22:26:29.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.737+0000 7f8362d9d700 1 --2- 172.21.15.40:0/1482560653 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f836409e420 0x7f836411cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:29.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.737+0000 7f836259c700 1 --2- 172.21.15.40:0/1482560653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f836406a6d0 0x7f8364131280 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f835400c700 tx=0x7f835400ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:29.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.737+0000 7f8352ffd700 1 -- 172.21.15.40:0/1482560653 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83540074e0 con 0x7f836406a6d0 2023-09-30T22:26:29.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.737+0000 7f8352ffd700 1 -- 172.21.15.40:0/1482560653 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8354007640 con 0x7f836406a6d0 2023-09-30T22:26:29.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.737+0000 7f8352ffd700 1 -- 172.21.15.40:0/1482560653 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8354005a30 con 0x7f836406a6d0 2023-09-30T22:26:29.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.737+0000 7f8368c2d700 1 -- 172.21.15.40:0/1482560653 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83580094a0 con 0x7f836406a6d0 2023-09-30T22:26:29.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.737+0000 7f8368c2d700 1 -- 172.21.15.40:0/1482560653 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f836411fd70 con 0x7f836406a6d0 2023-09-30T22:26:29.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.738+0000 7f8352ffd700 1 -- 172.21.15.40:0/1482560653 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8354005b90 con 0x7f836406a6d0 2023-09-30T22:26:29.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.738+0000 7f8368c2d700 1 -- 172.21.15.40:0/1482560653 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8364062380 con 0x7f836406a6d0 2023-09-30T22:26:29.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.738+0000 7f8352ffd700 1 -- 172.21.15.40:0/1482560653 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f835403e9c0 con 0x7f836406a6d0 2023-09-30T22:26:29.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.743+0000 7f9502292700 1 Processor -- start 2023-09-30T22:26:29.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.743+0000 7f9502292700 1 -- start start 2023-09-30T22:26:29.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.743+0000 7f8352ffd700 1 -- 172.21.15.40:0/1482560653 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8354005e40 con 0x7f836406a6d0 2023-09-30T22:26:29.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.743+0000 7f9502292700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94fc09d920 0x7f94fc09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:29.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.743+0000 7f9502292700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f94fc09f0f0 0x7f94fc09e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:29.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.744+0000 7f9502292700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94fc09f940 con 0x7f94fc133ca0 2023-09-30T22:26:29.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.744+0000 7f9502292700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94fc06b4c0 con 0x7f94fc09f0f0 2023-09-30T22:26:29.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.744+0000 7f9502292700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94fc09a8f0 con 0x7f94fc09d920 2023-09-30T22:26:29.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.744+0000 7f94fbfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94fc09d920 0x7f94fc09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:29.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.744+0000 7f94fbfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94fc09d920 0x7f94fc09dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53738/0 (socket says 172.21.15.40:53738) 2023-09-30T22:26:29.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.744+0000 7f94fbfff700 1 -- 172.21.15.40:0/3813248650 learned_addr learned my addr 172.21.15.40:0/3813248650 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:29.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.744+0000 7f94fbfff700 1 -- 172.21.15.40:0/3813248650 >> v2:172.21.15.40:3300/0 conn(0x7f94fc09f0f0 msgr2=0x7f94fc09e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:29.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.744+0000 7f94fb7fe700 1 --2- 172.21.15.40:0/3813248650 >> v2:172.21.15.40:3300/0 conn(0x7f94fc09f0f0 0x7f94fc09e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:29.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.744+0000 7f94fbfff700 1 --2- 172.21.15.40:0/3813248650 >> v2:172.21.15.40:3300/0 conn(0x7f94fc09f0f0 0x7f94fc09e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:29.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.744+0000 7f94fbfff700 1 -- 172.21.15.40:0/3813248650 >> v1:172.21.15.40:6789/0 conn(0x7f94fc133ca0 legacy=0x7f94fc134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:29.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.744+0000 7f94fbfff700 1 -- 172.21.15.40:0/3813248650 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94fc09f6e0 con 0x7f94fc09d920 2023-09-30T22:26:29.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.744+0000 7f94fb7fe700 1 --2- 172.21.15.40:0/3813248650 >> v2:172.21.15.40:3300/0 conn(0x7f94fc09f0f0 0x7f94fc09e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:26:29.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.744+0000 7f94fbfff700 1 --2- 172.21.15.40:0/3813248650 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94fc09d920 0x7f94fc09dcf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f94ec006fd0 tx=0x7f94ec009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b682919d924df57 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:29.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.745+0000 7f94faffd700 1 -- 172.21.15.40:0/3813248650 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec005e30 con 0x7f94fc09d920 2023-09-30T22:26:29.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.745+0000 7f94faffd700 1 -- 172.21.15.40:0/3813248650 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ec006030 con 0x7f94fc09d920 2023-09-30T22:26:29.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.745+0000 7f94faffd700 1 -- 172.21.15.40:0/3813248650 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec0063c0 con 0x7f94fc09d920 2023-09-30T22:26:29.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.745+0000 7f9502292700 1 -- 172.21.15.40:0/3813248650 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94fc09d920 msgr2=0x7f94fc09dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:29.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.745+0000 7f9502292700 1 --2- 172.21.15.40:0/3813248650 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94fc09d920 0x7f94fc09dcf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f94ec006fd0 tx=0x7f94ec009bd0 comp rx=0 tx=0).stop 2023-09-30T22:26:29.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.745+0000 7f9502292700 1 -- 172.21.15.40:0/3813248650 shutdown_connections 2023-09-30T22:26:29.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.745+0000 7f9502292700 1 --2- 172.21.15.40:0/3813248650 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94fc09d920 0x7f94fc09dcf0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:29.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.745+0000 7f9502292700 1 --2- 172.21.15.40:0/3813248650 >> v2:172.21.15.40:3300/0 conn(0x7f94fc09f0f0 0x7f94fc09e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:29.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.745+0000 7f9502292700 1 -- 172.21.15.40:0/3813248650 >> 172.21.15.40:0/3813248650 conn(0x7f94fc09fb20 msgr2=0x7f94fc09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:29.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.746+0000 7f9502292700 1 -- 172.21.15.40:0/3813248650 shutdown_connections 2023-09-30T22:26:29.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.746+0000 7f9502292700 1 -- 172.21.15.40:0/3813248650 wait complete. 2023-09-30T22:26:29.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.747+0000 7f9502292700 1 Processor -- start 2023-09-30T22:26:29.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.747+0000 7f9502292700 1 -- start start 2023-09-30T22:26:29.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.748+0000 7f9502292700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f94fc09d920 0x7f94fc11e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:29.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.748+0000 7f9502292700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94fc133ca0 0x7f94fc11e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:29.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.748+0000 7f9502292700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94fc131750 0x7f94fc11ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:29.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.748+0000 7f9502292700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94fc1205c0 con 0x7f94fc131750 2023-09-30T22:26:29.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.748+0000 7f9502292700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94fc122840 con 0x7f94fc133ca0 2023-09-30T22:26:29.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.748+0000 7f9502292700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f94fc121e80 con 0x7f94fc09d920 2023-09-30T22:26:29.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.748+0000 7f94fb7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94fc133ca0 0x7f94fc11e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:29.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.748+0000 7f94fb7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94fc133ca0 0x7f94fc11e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53740/0 (socket says 172.21.15.40:53740) 2023-09-30T22:26:29.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.748+0000 7f94fb7fe700 1 -- 172.21.15.40:0/1081877003 learned_addr learned my addr 172.21.15.40:0/1081877003 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:29.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.748+0000 7f950082f700 1 --2- 172.21.15.40:0/1081877003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94fc131750 0x7f94fc11ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:29.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.748+0000 7f94fbfff700 1 --2- 172.21.15.40:0/1081877003 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f94fc09d920 0x7f94fc11e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:29.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.748+0000 7f94fb7fe700 1 -- 172.21.15.40:0/1081877003 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f94fc09d920 msgr2=0x7f94fc11e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:29.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.748+0000 7f94fb7fe700 1 --2- 172.21.15.40:0/1081877003 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f94fc09d920 0x7f94fc11e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:29.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.748+0000 7f94fb7fe700 1 -- 172.21.15.40:0/1081877003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94fc131750 msgr2=0x7f94fc11ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:29.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.748+0000 7f94fb7fe700 1 --2- 172.21.15.40:0/1081877003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94fc131750 0x7f94fc11ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:29.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.748+0000 7f94fb7fe700 1 -- 172.21.15.40:0/1081877003 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ec009500 con 0x7f94fc133ca0 2023-09-30T22:26:29.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.748+0000 7f950082f700 1 --2- 172.21.15.40:0/1081877003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94fc131750 0x7f94fc11ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:29.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.748+0000 7f94fb7fe700 1 --2- 172.21.15.40:0/1081877003 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94fc133ca0 0x7f94fc11e8a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f94f000c7b0 tx=0x7f94f000cb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:29.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.749+0000 7f94f8ff9700 1 -- 172.21.15.40:0/1081877003 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f0011800 con 0x7f94fc133ca0 2023-09-30T22:26:29.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.749+0000 7f94f8ff9700 1 -- 172.21.15.40:0/1081877003 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f0011960 con 0x7f94fc133ca0 2023-09-30T22:26:29.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.749+0000 7f94f8ff9700 1 -- 172.21.15.40:0/1081877003 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f0011d10 con 0x7f94fc133ca0 2023-09-30T22:26:29.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.749+0000 7f9502292700 1 -- 172.21.15.40:0/1081877003 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94fc121610 con 0x7f94fc133ca0 2023-09-30T22:26:29.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.749+0000 7f9502292700 1 -- 172.21.15.40:0/1081877003 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94fc09c9e0 con 0x7f94fc133ca0 2023-09-30T22:26:29.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.750+0000 7f94f8ff9700 1 -- 172.21.15.40:0/1081877003 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f94f0018360 con 0x7f94fc133ca0 2023-09-30T22:26:29.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.750+0000 7f94f8ff9700 1 -- 172.21.15.40:0/1081877003 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f94f003f7e0 con 0x7f94fc133ca0 2023-09-30T22:26:29.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.752+0000 7f9502292700 1 -- 172.21.15.40:0/1081877003 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94fc11ffd0 con 0x7f94fc133ca0 2023-09-30T22:26:29.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.761+0000 7f94f8ff9700 1 -- 172.21.15.40:0/1081877003 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f94f000e2f0 con 0x7f94fc133ca0 2023-09-30T22:26:29.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.768+0000 7f6f57bd0700 1 Processor -- start 2023-09-30T22:26:29.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.768+0000 7f6f57bd0700 1 -- start start 2023-09-30T22:26:29.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.769+0000 7f6f57bd0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6f5009d450 0x7f6f5009d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:29.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.769+0000 7f6f57bd0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f501308d0 0x7f6f50138420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:29.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.769+0000 7f6f57bd0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5009e8b0 con 0x7f6f5009dd60 2023-09-30T22:26:29.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.769+0000 7f6f57bd0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f5009c3b0 con 0x7f6f5009d450 2023-09-30T22:26:29.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.769+0000 7f6f57bd0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5009a6b0 con 0x7f6f501308d0 2023-09-30T22:26:29.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.769+0000 7f6f5616d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f501308d0 0x7f6f50138420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:29.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.769+0000 7f6f5596c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6f5009d450 0x7f6f5009d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:29.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.769+0000 7f6f5616d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f501308d0 0x7f6f50138420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53750/0 (socket says 172.21.15.40:53750) 2023-09-30T22:26:29.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.769+0000 7f6f5616d700 1 -- 172.21.15.40:0/3577320387 learned_addr learned my addr 172.21.15.40:0/3577320387 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:29.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.769+0000 7f6f5616d700 1 -- 172.21.15.40:0/3577320387 >> v2:172.21.15.40:3300/0 conn(0x7f6f5009d450 msgr2=0x7f6f5009d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:29.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.769+0000 7f6f5616d700 1 --2- 172.21.15.40:0/3577320387 >> v2:172.21.15.40:3300/0 conn(0x7f6f5009d450 0x7f6f5009d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:29.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.769+0000 7f6f5616d700 1 -- 172.21.15.40:0/3577320387 >> v1:172.21.15.40:6789/0 conn(0x7f6f5009dd60 legacy=0x7f6f501301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:29.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.769+0000 7f6f5616d700 1 -- 172.21.15.40:0/3577320387 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5009b4f0 con 0x7f6f501308d0 2023-09-30T22:26:29.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.769+0000 7f6f5596c700 1 --2- 172.21.15.40:0/3577320387 >> v2:172.21.15.40:3300/0 conn(0x7f6f5009d450 0x7f6f5009d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:29.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.770+0000 7f6f5616d700 1 --2- 172.21.15.40:0/3577320387 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f501308d0 0x7f6f50138420 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6f48009e50 tx=0x7f6f4800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=632672c655da2d2e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:29.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.770+0000 7f6f5496a700 1 -- 172.21.15.40:0/3577320387 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4800e070 con 0x7f6f501308d0 2023-09-30T22:26:29.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.770+0000 7f6f5496a700 1 -- 172.21.15.40:0/3577320387 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4800b910 con 0x7f6f501308d0 2023-09-30T22:26:29.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.770+0000 7f6f5496a700 1 -- 172.21.15.40:0/3577320387 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4800bcc0 con 0x7f6f501308d0 2023-09-30T22:26:29.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.770+0000 7f6f57bd0700 1 -- 172.21.15.40:0/3577320387 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f501308d0 msgr2=0x7f6f50138420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:29.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.770+0000 7f6f57bd0700 1 --2- 172.21.15.40:0/3577320387 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f501308d0 0x7f6f50138420 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6f48009e50 tx=0x7f6f4800b330 comp rx=0 tx=0).stop 2023-09-30T22:26:29.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.771+0000 7f6f57bd0700 1 -- 172.21.15.40:0/3577320387 shutdown_connections 2023-09-30T22:26:29.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.771+0000 7f6f57bd0700 1 --2- 172.21.15.40:0/3577320387 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f501308d0 0x7f6f50138420 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:29.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.771+0000 7f6f57bd0700 1 --2- 172.21.15.40:0/3577320387 >> v2:172.21.15.40:3300/0 conn(0x7f6f5009d450 0x7f6f5009d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:29.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.771+0000 7f6f57bd0700 1 -- 172.21.15.40:0/3577320387 >> 172.21.15.40:0/3577320387 conn(0x7f6f500a2a00 msgr2=0x7f6f500a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:29.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.771+0000 7f6f57bd0700 1 -- 172.21.15.40:0/3577320387 shutdown_connections 2023-09-30T22:26:29.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.771+0000 7f6f57bd0700 1 -- 172.21.15.40:0/3577320387 wait complete. 2023-09-30T22:26:29.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.772+0000 7f6f57bd0700 1 Processor -- start 2023-09-30T22:26:29.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.772+0000 7f6f57bd0700 1 -- start start 2023-09-30T22:26:29.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.772+0000 7f6f57bd0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f5009d450 0x7f6f5013a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:29.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.772+0000 7f6f57bd0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6f5009dd60 0x7f6f5013a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:29.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.772+0000 7f6f57bd0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f501308d0 0x7f6f5013ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:29.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.772+0000 7f6f57bd0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f50139420 con 0x7f6f5009d450 2023-09-30T22:26:29.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.772+0000 7f6f57bd0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f50139600 con 0x7f6f501308d0 2023-09-30T22:26:29.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.772+0000 7f6f57bd0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5013b980 con 0x7f6f5009dd60 2023-09-30T22:26:29.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.773+0000 7f6f5596c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f5009d450 0x7f6f5013a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:29.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.773+0000 7f6f5516b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6f5009dd60 0x7f6f5013a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:29.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.773+0000 7f6f5596c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f5009d450 0x7f6f5013a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33574/0 (socket says 172.21.15.40:33574) 2023-09-30T22:26:29.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.773+0000 7f6f5596c700 1 -- 172.21.15.40:0/2893046999 learned_addr learned my addr 172.21.15.40:0/2893046999 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:29.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.773+0000 7f6f5616d700 1 --2- 172.21.15.40:0/2893046999 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f501308d0 0x7f6f5013ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:29.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.773+0000 7f6f5596c700 1 -- 172.21.15.40:0/2893046999 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6f5009dd60 msgr2=0x7f6f5013a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:29.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.773+0000 7f6f5596c700 1 --2- 172.21.15.40:0/2893046999 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6f5009dd60 0x7f6f5013a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:29.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.773+0000 7f6f5596c700 1 -- 172.21.15.40:0/2893046999 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f501308d0 msgr2=0x7f6f5013ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:29.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.773+0000 7f6f5596c700 1 --2- 172.21.15.40:0/2893046999 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f501308d0 0x7f6f5013ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:29.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.773+0000 7f6f5596c700 1 -- 172.21.15.40:0/2893046999 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4c0094a0 con 0x7f6f5009d450 2023-09-30T22:26:29.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.773+0000 7f6f5616d700 1 --2- 172.21.15.40:0/2893046999 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f501308d0 0x7f6f5013ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:29.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.773+0000 7f6f5596c700 1 --2- 172.21.15.40:0/2893046999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f5009d450 0x7f6f5013a1e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c00ec10 tx=0x7f6f4c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:29.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.773+0000 7f6f467fc700 1 -- 172.21.15.40:0/2893046999 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c00c910 con 0x7f6f5009d450 2023-09-30T22:26:29.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.773+0000 7f6f57bd0700 1 -- 172.21.15.40:0/2893046999 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f48009b30 con 0x7f6f5009d450 2023-09-30T22:26:29.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.773+0000 7f6f57bd0700 1 -- 172.21.15.40:0/2893046999 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f5013b290 con 0x7f6f5009d450 2023-09-30T22:26:29.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.773+0000 7f6f467fc700 1 -- 172.21.15.40:0/2893046999 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4c00ca70 con 0x7f6f5009d450 2023-09-30T22:26:29.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.774+0000 7f6f467fc700 1 -- 172.21.15.40:0/2893046999 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c00ce00 con 0x7f6f5009d450 2023-09-30T22:26:29.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.775+0000 7f6f57bd0700 1 -- 172.21.15.40:0/2893046999 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f380052e0 con 0x7f6f5009d450 2023-09-30T22:26:29.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.775+0000 7f6f467fc700 1 -- 172.21.15.40:0/2893046999 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6f4c013470 con 0x7f6f5009d450 2023-09-30T22:26:29.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.776+0000 7f6f467fc700 1 -- 172.21.15.40:0/2893046999 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6f4c0401b0 con 0x7f6f5009d450 2023-09-30T22:26:29.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.784+0000 7f6f467fc700 1 -- 172.21.15.40:0/2893046999 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6f4c011350 con 0x7f6f5009d450 2023-09-30T22:26:29.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.871+0000 7f92df657700 1 -- 172.21.15.40:0/3364150761 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f92d8062380 con 0x7f92d809c890 2023-09-30T22:26:29.872 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:29.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.871+0000 7f92cdffb700 1 -- 172.21.15.40:0/3364150761 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f92c8023780 con 0x7f92d809c890 2023-09-30T22:26:29.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.873+0000 7f92df657700 1 -- 172.21.15.40:0/3364150761 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f92d809c890 msgr2=0x7f92d812f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:29.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.873+0000 7f92df657700 1 --2- 172.21.15.40:0/3364150761 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f92d809c890 0x7f92d812f570 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f92d806ca30 tx=0x7f92c8004750 comp rx=0 tx=0).stop 2023-09-30T22:26:29.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.873+0000 7f92df657700 1 -- 172.21.15.40:0/3364150761 shutdown_connections 2023-09-30T22:26:29.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.873+0000 7f92df657700 1 --2- 172.21.15.40:0/3364150761 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f92d809c890 0x7f92d812f570 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:29.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.873+0000 7f92df657700 1 --2- 172.21.15.40:0/3364150761 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92d809e2b0 0x7f92d812fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:29.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.873+0000 7f92df657700 1 --2- 172.21.15.40:0/3364150761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d809d920 0x7f92d812fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:29.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.873+0000 7f92df657700 1 -- 172.21.15.40:0/3364150761 >> 172.21.15.40:0/3364150761 conn(0x7f92d80a7080 msgr2=0x7f92d81bafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:29.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.874+0000 7f92df657700 1 -- 172.21.15.40:0/3364150761 shutdown_connections 2023-09-30T22:26:29.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.874+0000 7f92df657700 1 -- 172.21.15.40:0/3364150761 wait complete. 2023-09-30T22:26:29.887 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:29.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.965+0000 7f8368c2d700 1 -- 172.21.15.40:0/1482560653 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f836411ebf0 con 0x7f836406a6d0 2023-09-30T22:26:29.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.965+0000 7f8352ffd700 1 -- 172.21.15.40:0/1482560653 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f83540192c0 con 0x7f836406a6d0 2023-09-30T22:26:29.966 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:29.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.967+0000 7f8368c2d700 1 -- 172.21.15.40:0/1482560653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f836406a6d0 msgr2=0x7f8364131280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:29.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.967+0000 7f8368c2d700 1 --2- 172.21.15.40:0/1482560653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f836406a6d0 0x7f8364131280 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f835400c700 tx=0x7f835400ca10 comp rx=0 tx=0).stop 2023-09-30T22:26:29.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.967+0000 7f8368c2d700 1 -- 172.21.15.40:0/1482560653 shutdown_connections 2023-09-30T22:26:29.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.967+0000 7f8368c2d700 1 --2- 172.21.15.40:0/1482560653 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f836409e420 0x7f836411cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:29.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.967+0000 7f8368c2d700 1 --2- 172.21.15.40:0/1482560653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f836406a6d0 0x7f8364131280 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:29.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.967+0000 7f8368c2d700 1 --2- 172.21.15.40:0/1482560653 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f836409e030 0x7f836411c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:29.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.967+0000 7f8368c2d700 1 -- 172.21.15.40:0/1482560653 >> 172.21.15.40:0/1482560653 conn(0x7f836409fb20 msgr2=0x7f8364123840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:29.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.968+0000 7f8368c2d700 1 -- 172.21.15.40:0/1482560653 shutdown_connections 2023-09-30T22:26:29.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.968+0000 7f8368c2d700 1 -- 172.21.15.40:0/1482560653 wait complete. 2023-09-30T22:26:29.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.968+0000 7f9502292700 1 -- 172.21.15.40:0/1081877003 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f94fc062380 con 0x7f94fc133ca0 2023-09-30T22:26:29.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.968+0000 7f94f8ff9700 1 -- 172.21.15.40:0/1081877003 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f94f0015020 con 0x7f94fc133ca0 2023-09-30T22:26:29.970 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:29.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.971+0000 7f9502292700 1 -- 172.21.15.40:0/1081877003 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94fc133ca0 msgr2=0x7f94fc11e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:29.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.971+0000 7f9502292700 1 --2- 172.21.15.40:0/1081877003 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94fc133ca0 0x7f94fc11e8a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f94f000c7b0 tx=0x7f94f000cb70 comp rx=0 tx=0).stop 2023-09-30T22:26:29.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.972+0000 7f9502292700 1 -- 172.21.15.40:0/1081877003 shutdown_connections 2023-09-30T22:26:29.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.972+0000 7f9502292700 1 --2- 172.21.15.40:0/1081877003 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f94fc09d920 0x7f94fc11e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:29.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.972+0000 7f9502292700 1 --2- 172.21.15.40:0/1081877003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94fc131750 0x7f94fc11ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:29.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.972+0000 7f9502292700 1 --2- 172.21.15.40:0/1081877003 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94fc133ca0 0x7f94fc11e8a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:29.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.972+0000 7f9502292700 1 -- 172.21.15.40:0/1081877003 >> 172.21.15.40:0/1081877003 conn(0x7f94fc09fb20 msgr2=0x7f94fc133360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:29.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.972+0000 7f9502292700 1 -- 172.21.15.40:0/1081877003 shutdown_connections 2023-09-30T22:26:29.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.972+0000 7f9502292700 1 -- 172.21.15.40:0/1081877003 wait complete. 2023-09-30T22:26:29.986 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:29.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:29.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.998+0000 7f6f57bd0700 1 -- 172.21.15.40:0/2893046999 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6f38005860 con 0x7f6f5009d450 2023-09-30T22:26:29.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:29.999+0000 7f6f467fc700 1 -- 172.21.15.40:0/2893046999 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6f4c021070 con 0x7f6f5009d450 2023-09-30T22:26:29.999 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:30.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:30.001+0000 7f6f57bd0700 1 -- 172.21.15.40:0/2893046999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f5009d450 msgr2=0x7f6f5013a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:30.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:30.001+0000 7f6f57bd0700 1 --2- 172.21.15.40:0/2893046999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f5009d450 0x7f6f5013a1e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c00ec10 tx=0x7f6f4c00ef20 comp rx=0 tx=0).stop 2023-09-30T22:26:30.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:30.001+0000 7f6f57bd0700 1 -- 172.21.15.40:0/2893046999 shutdown_connections 2023-09-30T22:26:30.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:30.001+0000 7f6f57bd0700 1 --2- 172.21.15.40:0/2893046999 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f501308d0 0x7f6f5013ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:30.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:30.001+0000 7f6f57bd0700 1 --2- 172.21.15.40:0/2893046999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f5009d450 0x7f6f5013a1e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:30.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:30.001+0000 7f6f57bd0700 1 --2- 172.21.15.40:0/2893046999 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6f5009dd60 0x7f6f5013a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:30.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:30.001+0000 7f6f57bd0700 1 -- 172.21.15.40:0/2893046999 >> 172.21.15.40:0/2893046999 conn(0x7f6f500a2a00 msgr2=0x7f6f500a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:30.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:30.001+0000 7f6f57bd0700 1 -- 172.21.15.40:0/2893046999 shutdown_connections 2023-09-30T22:26:30.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:30.001+0000 7f6f57bd0700 1 -- 172.21.15.40:0/2893046999 wait complete. 2023-09-30T22:26:30.013 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:30.887 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:30.988 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:30.990 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:31.014 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:31.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.031+0000 7fbb4874a700 1 Processor -- start 2023-09-30T22:26:31.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.031+0000 7fbb4874a700 1 -- start start 2023-09-30T22:26:31.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.031+0000 7fbb4874a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbb4009d920 0x7fbb4009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.031+0000 7fbb4874a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb4009e230 0x7fbb401308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.031+0000 7fbb4874a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb4009adf0 con 0x7fbb40130de0 2023-09-30T22:26:31.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.031+0000 7fbb4874a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb4009edf0 con 0x7fbb4009d920 2023-09-30T22:26:31.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.031+0000 7fbb4874a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4009b660 con 0x7fbb4009e230 2023-09-30T22:26:31.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.032+0000 7fbb464e6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbb4009d920 0x7fbb4009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.032+0000 7fbb464e6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbb4009d920 0x7fbb4009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33590/0 (socket says 172.21.15.40:33590) 2023-09-30T22:26:31.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.032+0000 7fbb46ce7700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbb40130de0 0x7fbb40137d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49952/0 (socket says 172.21.15.40:49952) 2023-09-30T22:26:31.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.032+0000 7fbb464e6700 1 -- 172.21.15.40:0/3045645790 learned_addr learned my addr 172.21.15.40:0/3045645790 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:31.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.032+0000 7fbb45ce5700 1 --2- 172.21.15.40:0/3045645790 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb4009e230 0x7fbb401308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.032+0000 7fbb464e6700 1 -- 172.21.15.40:0/3045645790 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb4009e230 msgr2=0x7fbb401308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:31.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.032+0000 7fbb464e6700 1 --2- 172.21.15.40:0/3045645790 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb4009e230 0x7fbb401308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.032+0000 7fbb464e6700 1 -- 172.21.15.40:0/3045645790 >> v1:172.21.15.40:6789/0 conn(0x7fbb40130de0 legacy=0x7fbb40137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.032+0000 7fbb464e6700 1 -- 172.21.15.40:0/3045645790 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb4009a6e0 con 0x7fbb4009d920 2023-09-30T22:26:31.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.032+0000 7fbb454e4700 1 -- 172.21.15.40:0/3045645790 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4290366182 0 0) 0x7fbb4009adf0 con 0x7fbb40130de0 2023-09-30T22:26:31.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.032+0000 7fbb464e6700 1 --2- 172.21.15.40:0/3045645790 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb4009d920 0x7fbb4009dcf0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c006fd0 tx=0x7fbb3c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=117b34bf199b918 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:31.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.032+0000 7fbb454e4700 1 -- 172.21.15.40:0/3045645790 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c005e30 con 0x7fbb4009d920 2023-09-30T22:26:31.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.032+0000 7fbb454e4700 1 -- 172.21.15.40:0/3045645790 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3c004030 con 0x7fbb4009d920 2023-09-30T22:26:31.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.032+0000 7fbb454e4700 1 -- 172.21.15.40:0/3045645790 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c0043e0 con 0x7fbb4009d920 2023-09-30T22:26:31.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.033+0000 7fbb4874a700 1 -- 172.21.15.40:0/3045645790 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb4009d920 msgr2=0x7fbb4009dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.033+0000 7fbb4874a700 1 --2- 172.21.15.40:0/3045645790 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb4009d920 0x7fbb4009dcf0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c006fd0 tx=0x7fbb3c009bd0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.033+0000 7fbb4874a700 1 -- 172.21.15.40:0/3045645790 shutdown_connections 2023-09-30T22:26:31.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.033+0000 7fbb4874a700 1 --2- 172.21.15.40:0/3045645790 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb4009d920 0x7fbb4009dcf0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.033+0000 7fbb4874a700 1 --2- 172.21.15.40:0/3045645790 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb4009e230 0x7fbb401308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.033+0000 7fbb4874a700 1 -- 172.21.15.40:0/3045645790 >> 172.21.15.40:0/3045645790 conn(0x7fbb4009fb20 msgr2=0x7fbb4009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:31.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.033+0000 7fbb4874a700 1 -- 172.21.15.40:0/3045645790 shutdown_connections 2023-09-30T22:26:31.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.033+0000 7fbb4874a700 1 -- 172.21.15.40:0/3045645790 wait complete. 2023-09-30T22:26:31.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.035+0000 7fbb4874a700 1 Processor -- start 2023-09-30T22:26:31.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.035+0000 7fbb4874a700 1 -- start start 2023-09-30T22:26:31.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.035+0000 7fbb4874a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb4009d920 0x7fbb4012ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.035+0000 7fbb4874a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbb4009e230 0x7fbb4012f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.035+0000 7fbb4874a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb40130de0 0x7fbb4012f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.035+0000 7fbb4874a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb401328d0 con 0x7fbb40130de0 2023-09-30T22:26:31.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.035+0000 7fbb4874a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb40133160 con 0x7fbb4009d920 2023-09-30T22:26:31.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.035+0000 7fbb4874a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb40139520 con 0x7fbb4009e230 2023-09-30T22:26:31.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.036+0000 7fbb464e6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb4009d920 0x7fbb4012ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.036+0000 7fbb464e6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb4009d920 0x7fbb4012ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53774/0 (socket says 172.21.15.40:53774) 2023-09-30T22:26:31.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.036+0000 7fbb464e6700 1 -- 172.21.15.40:0/1307321931 learned_addr learned my addr 172.21.15.40:0/1307321931 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:31.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.036+0000 7fbb45ce5700 1 --2- 172.21.15.40:0/1307321931 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbb4009e230 0x7fbb4012f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.036+0000 7fbb464e6700 1 -- 172.21.15.40:0/1307321931 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbb4009e230 msgr2=0x7fbb4012f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.036+0000 7fbb464e6700 1 --2- 172.21.15.40:0/1307321931 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbb4009e230 0x7fbb4012f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.036+0000 7fbb464e6700 1 -- 172.21.15.40:0/1307321931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb40130de0 msgr2=0x7fbb4012f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.036+0000 7fbb464e6700 1 --2- 172.21.15.40:0/1307321931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb40130de0 0x7fbb4012f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.036+0000 7fbb464e6700 1 -- 172.21.15.40:0/1307321931 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb3c009500 con 0x7fbb4009d920 2023-09-30T22:26:31.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.036+0000 7fbb45ce5700 1 --2- 172.21.15.40:0/1307321931 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbb4009e230 0x7fbb4012f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:31.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.036+0000 7fbb464e6700 1 --2- 172.21.15.40:0/1307321931 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb4009d920 0x7fbb4012ec60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c009c10 tx=0x7fbb3c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:31.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.036+0000 7fbb36ffd700 1 -- 172.21.15.40:0/1307321931 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c01c420 con 0x7fbb4009d920 2023-09-30T22:26:31.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.037+0000 7fbb4874a700 1 -- 172.21.15.40:0/1307321931 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb4009cb00 con 0x7fbb4009d920 2023-09-30T22:26:31.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.037+0000 7fbb36ffd700 1 -- 172.21.15.40:0/1307321931 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3c01c580 con 0x7fbb4009d920 2023-09-30T22:26:31.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.037+0000 7fbb36ffd700 1 -- 172.21.15.40:0/1307321931 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c01c930 con 0x7fbb4009d920 2023-09-30T22:26:31.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.037+0000 7fbb4874a700 1 -- 172.21.15.40:0/1307321931 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb40132bc0 con 0x7fbb4009d920 2023-09-30T22:26:31.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.038+0000 7fbb36ffd700 1 -- 172.21.15.40:0/1307321931 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbb3c01ca90 con 0x7fbb4009d920 2023-09-30T22:26:31.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.038+0000 7fbb36ffd700 1 -- 172.21.15.40:0/1307321931 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fbb3c0409b0 con 0x7fbb4009d920 2023-09-30T22:26:31.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.038+0000 7fbb34ff9700 1 -- 172.21.15.40:0/1307321931 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb1c0052e0 con 0x7fbb4009d920 2023-09-30T22:26:31.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.044+0000 7fbb36ffd700 1 -- 172.21.15.40:0/1307321931 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbb3c016020 con 0x7fbb4009d920 2023-09-30T22:26:31.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.125+0000 7f0cb108b700 1 Processor -- start 2023-09-30T22:26:31.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.125+0000 7f0cb108b700 1 -- start start 2023-09-30T22:26:31.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.125+0000 7f0cb108b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0cac09c890 0x7f0cac09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.125+0000 7f0cb108b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0cac09e480 0x7f0cac13bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.125+0000 7f0cb108b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cac0a2600 con 0x7f0cac09d920 2023-09-30T22:26:31.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.125+0000 7f0cb108b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cac0a29d0 con 0x7f0cac09e480 2023-09-30T22:26:31.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.126+0000 7f0cb108b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cac09fb40 con 0x7f0cac09c890 2023-09-30T22:26:31.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.126+0000 7f0cab59e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0cac09e480 0x7f0cac13bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.126+0000 7f0caad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0cac09c890 0x7f0cac09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.126+0000 7f0cab59e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0cac09e480 0x7f0cac13bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33604/0 (socket says 172.21.15.40:33604) 2023-09-30T22:26:31.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.126+0000 7f0cab59e700 1 -- 172.21.15.40:0/1766916273 learned_addr learned my addr 172.21.15.40:0/1766916273 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:31.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.126+0000 7f0caad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0cac09c890 0x7f0cac09cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:38230/0 (socket says 172.21.15.40:38230) 2023-09-30T22:26:31.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.126+0000 7f0caad9d700 1 -- 172.21.15.40:0/1766916273 >> v2:172.21.15.40:3300/0 conn(0x7f0cac09e480 msgr2=0x7f0cac13bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:31.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.126+0000 7f0caad9d700 1 --2- 172.21.15.40:0/1766916273 >> v2:172.21.15.40:3300/0 conn(0x7f0cac09e480 0x7f0cac13bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.126+0000 7f0caad9d700 1 -- 172.21.15.40:0/1766916273 >> v1:172.21.15.40:6789/0 conn(0x7f0cac09d920 legacy=0x7f0cac09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.126+0000 7f0caad9d700 1 -- 172.21.15.40:0/1766916273 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cac09fed0 con 0x7f0cac09c890 2023-09-30T22:26:31.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.126+0000 7f0cab59e700 1 --2- 172.21.15.40:0/1766916273 >> v2:172.21.15.40:3300/0 conn(0x7f0cac09e480 0x7f0cac13bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:31.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.126+0000 7f0caad9d700 1 --2- 172.21.15.40:0/1766916273 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0cac09c890 0x7f0cac09cc60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c013e00 tx=0x7f0c9c0095f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c1f8b0e2547b0ba server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:31.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.126+0000 7f0ca9d9b700 1 -- 172.21.15.40:0/1766916273 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c005a20 con 0x7f0cac09c890 2023-09-30T22:26:31.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.126+0000 7f0ca9d9b700 1 -- 172.21.15.40:0/1766916273 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9c005b80 con 0x7f0cac09c890 2023-09-30T22:26:31.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.126+0000 7f0ca9d9b700 1 -- 172.21.15.40:0/1766916273 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c0128e0 con 0x7f0cac09c890 2023-09-30T22:26:31.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.127+0000 7f0cb108b700 1 -- 172.21.15.40:0/1766916273 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0cac09c890 msgr2=0x7f0cac09cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.127+0000 7f0cb108b700 1 --2- 172.21.15.40:0/1766916273 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0cac09c890 0x7f0cac09cc60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c013e00 tx=0x7f0c9c0095f0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.127+0000 7f0cb108b700 1 -- 172.21.15.40:0/1766916273 shutdown_connections 2023-09-30T22:26:31.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.127+0000 7f0cb108b700 1 --2- 172.21.15.40:0/1766916273 >> v2:172.21.15.40:3300/0 conn(0x7f0cac09e480 0x7f0cac13bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.127+0000 7f0cb108b700 1 --2- 172.21.15.40:0/1766916273 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0cac09c890 0x7f0cac09cc60 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.127+0000 7f0cb108b700 1 -- 172.21.15.40:0/1766916273 >> 172.21.15.40:0/1766916273 conn(0x7f0cac0a7080 msgr2=0x7f0cac0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:31.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.127+0000 7f0cb108b700 1 -- 172.21.15.40:0/1766916273 shutdown_connections 2023-09-30T22:26:31.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.127+0000 7f0cb108b700 1 -- 172.21.15.40:0/1766916273 wait complete. 2023-09-30T22:26:31.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.129+0000 7f0cb108b700 1 Processor -- start 2023-09-30T22:26:31.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.129+0000 7f0cb108b700 1 -- start start 2023-09-30T22:26:31.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.129+0000 7f0cb108b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cac09c890 0x7f0cac12d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.129+0000 7f0cb108b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0cac09d920 0x7f0cac12dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.129+0000 7f0cb108b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0cac09e480 0x7f0cac12e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.129+0000 7f0cb108b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cac1311e0 con 0x7f0cac09c890 2023-09-30T22:26:31.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.129+0000 7f0cb108b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cac09ecf0 con 0x7f0cac09e480 2023-09-30T22:26:31.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.129+0000 7f0cb108b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cac12ec00 con 0x7f0cac09d920 2023-09-30T22:26:31.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.130+0000 7f0caad9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cac09c890 0x7f0cac12d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.130+0000 7f0caad9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cac09c890 0x7f0cac12d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33606/0 (socket says 172.21.15.40:33606) 2023-09-30T22:26:31.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.130+0000 7f0caad9d700 1 -- 172.21.15.40:0/945222983 learned_addr learned my addr 172.21.15.40:0/945222983 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:31.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.130+0000 7f0caa59c700 1 --2- 172.21.15.40:0/945222983 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0cac09d920 0x7f0cac12dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.130+0000 7f0caa59c700 1 -- 172.21.15.40:0/945222983 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0cac09e480 msgr2=0x7f0cac12e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.130+0000 7f0caa59c700 1 --2- 172.21.15.40:0/945222983 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0cac09e480 0x7f0cac12e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.130+0000 7f0caa59c700 1 -- 172.21.15.40:0/945222983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cac09c890 msgr2=0x7f0cac12d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.130+0000 7f0caa59c700 1 --2- 172.21.15.40:0/945222983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cac09c890 0x7f0cac12d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.130+0000 7f0caa59c700 1 -- 172.21.15.40:0/945222983 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca4009b30 con 0x7f0cac09d920 2023-09-30T22:26:31.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.130+0000 7f0caad9d700 1 --2- 172.21.15.40:0/945222983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cac09c890 0x7f0cac12d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:31.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.130+0000 7f0caa59c700 1 --2- 172.21.15.40:0/945222983 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0cac09d920 0x7f0cac12dc90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0cac0a0ae0 tx=0x7f0ca000c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:31.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.130+0000 7f0c937fe700 1 -- 172.21.15.40:0/945222983 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca00052d0 con 0x7f0cac09d920 2023-09-30T22:26:31.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.130+0000 7f0c937fe700 1 -- 172.21.15.40:0/945222983 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca0005430 con 0x7f0cac09d920 2023-09-30T22:26:31.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.130+0000 7f0cb108b700 1 -- 172.21.15.40:0/945222983 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c9c013a10 con 0x7f0cac09d920 2023-09-30T22:26:31.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.130+0000 7f0c937fe700 1 -- 172.21.15.40:0/945222983 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca00038c0 con 0x7f0cac09d920 2023-09-30T22:26:31.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.130+0000 7f0cb108b700 1 -- 172.21.15.40:0/945222983 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cac0a5df0 con 0x7f0cac09d920 2023-09-30T22:26:31.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.131+0000 7f0c937fe700 1 -- 172.21.15.40:0/945222983 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0ca0003a20 con 0x7f0cac09d920 2023-09-30T22:26:31.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.132+0000 7f0c937fe700 1 -- 172.21.15.40:0/945222983 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f0ca003e9e0 con 0x7f0cac09d920 2023-09-30T22:26:31.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.132+0000 7f0cb108b700 1 -- 172.21.15.40:0/945222983 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cac130ae0 con 0x7f0cac09d920 2023-09-30T22:26:31.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.136+0000 7f0c937fe700 1 -- 172.21.15.40:0/945222983 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0cac130ae0 con 0x7f0cac09d920 2023-09-30T22:26:31.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.165+0000 7f89f7274700 1 Processor -- start 2023-09-30T22:26:31.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.165+0000 7f89f7274700 1 -- start start 2023-09-30T22:26:31.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.166+0000 7f89f7274700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f89f0131d50 0x7f89f0132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.166+0000 7f89f7274700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f89f009c7d0 0x7f89f0139ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.166+0000 7f89f7274700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f0132660 con 0x7f89f009bc50 2023-09-30T22:26:31.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.166+0000 7f89f7274700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f00719e0 con 0x7f89f0131d50 2023-09-30T22:26:31.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.166+0000 7f89f7274700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89f0131900 con 0x7f89f009c7d0 2023-09-30T22:26:31.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.166+0000 7f89f480f700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f89f009bc50 0x7f89f009c0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49972/0 (socket says 172.21.15.40:49972) 2023-09-30T22:26:31.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.166+0000 7f89f480f700 1 -- 172.21.15.40:0/1704252391 learned_addr learned my addr 172.21.15.40:0/1704252391 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:31.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.166+0000 7f89f5811700 1 --2- 172.21.15.40:0/1704252391 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f89f009c7d0 0x7f89f0139ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.166+0000 7f89f5811700 1 -- 172.21.15.40:0/1704252391 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f89f0131d50 msgr2=0x7f89f0132120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:31.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.166+0000 7f89f5811700 1 --2- 172.21.15.40:0/1704252391 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f89f0131d50 0x7f89f0132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.166+0000 7f89e7fff700 1 -- 172.21.15.40:0/1704252391 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331236855 0 0) 0x7f89f0132660 con 0x7f89f009bc50 2023-09-30T22:26:31.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.166+0000 7f89f5811700 1 -- 172.21.15.40:0/1704252391 >> v1:172.21.15.40:6789/0 conn(0x7f89f009bc50 legacy=0x7f89f009c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.166+0000 7f89f5811700 1 -- 172.21.15.40:0/1704252391 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f009e820 con 0x7f89f009c7d0 2023-09-30T22:26:31.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.167+0000 7f89f5811700 1 --2- 172.21.15.40:0/1704252391 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f89f009c7d0 0x7f89f0139ac0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f89e8009df0 tx=0x7f89e800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0d33c47b4eac5bc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:31.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.167+0000 7f89e7fff700 1 -- 172.21.15.40:0/1704252391 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e800e070 con 0x7f89f009c7d0 2023-09-30T22:26:31.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.167+0000 7f89e7fff700 1 -- 172.21.15.40:0/1704252391 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e800bb90 con 0x7f89f009c7d0 2023-09-30T22:26:31.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.167+0000 7f89e7fff700 1 -- 172.21.15.40:0/1704252391 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e8012430 con 0x7f89f009c7d0 2023-09-30T22:26:31.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.167+0000 7f89f7274700 1 -- 172.21.15.40:0/1704252391 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f89f009c7d0 msgr2=0x7f89f0139ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.167+0000 7f89f7274700 1 --2- 172.21.15.40:0/1704252391 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f89f009c7d0 0x7f89f0139ac0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f89e8009df0 tx=0x7f89e800b330 comp rx=0 tx=0).stop 2023-09-30T22:26:31.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.167+0000 7f89f7274700 1 -- 172.21.15.40:0/1704252391 shutdown_connections 2023-09-30T22:26:31.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.168+0000 7f89f7274700 1 --2- 172.21.15.40:0/1704252391 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f89f009c7d0 0x7f89f0139ac0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.168+0000 7f89f7274700 1 --2- 172.21.15.40:0/1704252391 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f89f0131d50 0x7f89f0132120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.168+0000 7f89f7274700 1 -- 172.21.15.40:0/1704252391 >> 172.21.15.40:0/1704252391 conn(0x7f89f00a2a00 msgr2=0x7f89f00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:31.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.168+0000 7f89f7274700 1 -- 172.21.15.40:0/1704252391 shutdown_connections 2023-09-30T22:26:31.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.168+0000 7f89f7274700 1 -- 172.21.15.40:0/1704252391 wait complete. 2023-09-30T22:26:31.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.169+0000 7f89f7274700 1 Processor -- start 2023-09-30T22:26:31.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.169+0000 7f89f7274700 1 -- start start 2023-09-30T22:26:31.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.169+0000 7f89f7274700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f89f009bc50 0x7f89f01c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.169+0000 7f89f7274700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f89f009c7d0 0x7f89f01c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.169+0000 7f89f7274700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f89f0131d50 0x7f89f01c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.169+0000 7f89f7274700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f0137670 con 0x7f89f009c7d0 2023-09-30T22:26:31.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.169+0000 7f89f7274700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f009ea60 con 0x7f89f0131d50 2023-09-30T22:26:31.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.169+0000 7f89f7274700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89f01359d0 con 0x7f89f009bc50 2023-09-30T22:26:31.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.169+0000 7f89f5010700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f89f009bc50 0x7f89f01c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.169+0000 7f89f5010700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f89f009bc50 0x7f89f01c84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:38260/0 (socket says 172.21.15.40:38260) 2023-09-30T22:26:31.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.169+0000 7f89f5010700 1 -- 172.21.15.40:0/2608431327 learned_addr learned my addr 172.21.15.40:0/2608431327 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:31.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.169+0000 7f89f480f700 1 --2- 172.21.15.40:0/2608431327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f89f009c7d0 0x7f89f01c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.169+0000 7f89f5811700 1 --2- 172.21.15.40:0/2608431327 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f89f0131d50 0x7f89f01c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.170+0000 7f89f480f700 1 -- 172.21.15.40:0/2608431327 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f89f009bc50 msgr2=0x7f89f01c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.170+0000 7f89f480f700 1 --2- 172.21.15.40:0/2608431327 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f89f009bc50 0x7f89f01c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.170+0000 7f89f480f700 1 -- 172.21.15.40:0/2608431327 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f89f0131d50 msgr2=0x7f89f01c8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.170+0000 7f89f480f700 1 --2- 172.21.15.40:0/2608431327 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f89f0131d50 0x7f89f01c8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.170+0000 7f89f480f700 1 -- 172.21.15.40:0/2608431327 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e8009a70 con 0x7f89f009c7d0 2023-09-30T22:26:31.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.170+0000 7f89f480f700 1 --2- 172.21.15.40:0/2608431327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f89f009c7d0 0x7f89f01c8a30 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f89f00716e0 tx=0x7f89e000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:31.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.170+0000 7f89e5ffb700 1 -- 172.21.15.40:0/2608431327 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e0004c80 con 0x7f89f009c7d0 2023-09-30T22:26:31.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.170+0000 7f89e5ffb700 1 -- 172.21.15.40:0/2608431327 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e0004de0 con 0x7f89f009c7d0 2023-09-30T22:26:31.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.170+0000 7f89e5ffb700 1 -- 172.21.15.40:0/2608431327 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e0007310 con 0x7f89f009c7d0 2023-09-30T22:26:31.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.170+0000 7f89f7274700 1 -- 172.21.15.40:0/2608431327 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f009fbb0 con 0x7f89f009c7d0 2023-09-30T22:26:31.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.171+0000 7f89f7274700 1 -- 172.21.15.40:0/2608431327 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f0138070 con 0x7f89f009c7d0 2023-09-30T22:26:31.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.171+0000 7f89f7274700 1 -- 172.21.15.40:0/2608431327 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f0062380 con 0x7f89f009c7d0 2023-09-30T22:26:31.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.172+0000 7f3bc71c7700 1 Processor -- start 2023-09-30T22:26:31.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.172+0000 7f3bc71c7700 1 -- start start 2023-09-30T22:26:31.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.172+0000 7f3bc71c7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3bc012cac0 0x7f3bc012ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.172+0000 7f3bc71c7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bc012c3a0 0x7f3bc0099510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.172+0000 7f3bc71c7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3bc0099a50 0x7f3bc0099ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.172+0000 7f3bc71c7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc009aae0 con 0x7f3bc012cac0 2023-09-30T22:26:31.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.172+0000 7f3bc71c7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc009e7c0 con 0x7f3bc012c3a0 2023-09-30T22:26:31.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.172+0000 7f3bc71c7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc009b4d0 con 0x7f3bc0099a50 2023-09-30T22:26:31.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.172+0000 7f89e5ffb700 1 -- 172.21.15.40:0/2608431327 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f89e0007470 con 0x7f89f009c7d0 2023-09-30T22:26:31.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.172+0000 7f3bbffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bc012c3a0 0x7f3bc0099510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.173+0000 7f3bbffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bc012c3a0 0x7f3bc0099510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53828/0 (socket says 172.21.15.40:53828) 2023-09-30T22:26:31.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.173+0000 7f3bbffff700 1 -- 172.21.15.40:0/3093171828 learned_addr learned my addr 172.21.15.40:0/3093171828 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:31.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.173+0000 7f89e5ffb700 1 -- 172.21.15.40:0/2608431327 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f89e003f340 con 0x7f89f009c7d0 2023-09-30T22:26:31.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.173+0000 7f3bc5764700 1 --2- 172.21.15.40:0/3093171828 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3bc0099a50 0x7f3bc0099ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.173+0000 7f3bc4f63700 1 --2- 172.21.15.40:0/3093171828 >> v2:172.21.15.40:3300/0 conn(0x7f3bc012cac0 0x7f3bc012ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.173+0000 7f3bbffff700 1 -- 172.21.15.40:0/3093171828 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3bc0099a50 msgr2=0x7f3bc0099ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:31.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.173+0000 7f3bbffff700 1 --2- 172.21.15.40:0/3093171828 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3bc0099a50 0x7f3bc0099ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.173+0000 7f3bbffff700 1 -- 172.21.15.40:0/3093171828 >> v2:172.21.15.40:3300/0 conn(0x7f3bc012cac0 msgr2=0x7f3bc012ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:31.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.173+0000 7f3bbffff700 1 --2- 172.21.15.40:0/3093171828 >> v2:172.21.15.40:3300/0 conn(0x7f3bc012cac0 0x7f3bc012ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.173+0000 7f3bbffff700 1 -- 172.21.15.40:0/3093171828 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc012c8a0 con 0x7f3bc012c3a0 2023-09-30T22:26:31.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.173+0000 7f3bbffff700 1 --2- 172.21.15.40:0/3093171828 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bc012c3a0 0x7f3bc0099510 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4006e60 tx=0x7f3bb4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=381f0fc19e0b4f4c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:31.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.173+0000 7f3bbf7fe700 1 -- 172.21.15.40:0/3093171828 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4004230 con 0x7f3bc012c3a0 2023-09-30T22:26:31.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.173+0000 7f3bbf7fe700 1 -- 172.21.15.40:0/3093171828 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb4004390 con 0x7f3bc012c3a0 2023-09-30T22:26:31.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.173+0000 7f3bbf7fe700 1 -- 172.21.15.40:0/3093171828 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4010380 con 0x7f3bc012c3a0 2023-09-30T22:26:31.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.174+0000 7f3bc71c7700 1 -- 172.21.15.40:0/3093171828 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bc012c3a0 msgr2=0x7f3bc0099510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.174+0000 7f3bc71c7700 1 --2- 172.21.15.40:0/3093171828 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bc012c3a0 0x7f3bc0099510 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4006e60 tx=0x7f3bb4009c30 comp rx=0 tx=0).stop 2023-09-30T22:26:31.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.174+0000 7f3bc71c7700 1 -- 172.21.15.40:0/3093171828 shutdown_connections 2023-09-30T22:26:31.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.174+0000 7f3bc71c7700 1 --2- 172.21.15.40:0/3093171828 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3bc0099a50 0x7f3bc0099ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.174+0000 7f3bc71c7700 1 --2- 172.21.15.40:0/3093171828 >> v2:172.21.15.40:3300/0 conn(0x7f3bc012cac0 0x7f3bc012ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.174+0000 7f3bc71c7700 1 --2- 172.21.15.40:0/3093171828 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bc012c3a0 0x7f3bc0099510 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.174+0000 7f3bc71c7700 1 -- 172.21.15.40:0/3093171828 >> 172.21.15.40:0/3093171828 conn(0x7f3bc00a2c70 msgr2=0x7f3bc009eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:31.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.174+0000 7f3bc71c7700 1 -- 172.21.15.40:0/3093171828 shutdown_connections 2023-09-30T22:26:31.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.174+0000 7f3bc71c7700 1 -- 172.21.15.40:0/3093171828 wait complete. 2023-09-30T22:26:31.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.176+0000 7f3bc71c7700 1 Processor -- start 2023-09-30T22:26:31.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.176+0000 7f3bc71c7700 1 -- start start 2023-09-30T22:26:31.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.176+0000 7f3bc71c7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bc0099a50 0x7f3bc00983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.176+0000 7f3bc71c7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bc012c3a0 0x7f3bc0098930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.176+0000 7f3bc71c7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3bc012cac0 0x7f3bc012ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.176+0000 7f3bc71c7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc006e5a0 con 0x7f3bc012c3a0 2023-09-30T22:26:31.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.176+0000 7f3bc71c7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc006d180 con 0x7f3bc0099a50 2023-09-30T22:26:31.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.176+0000 7f3bc71c7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc006f7c0 con 0x7f3bc012cac0 2023-09-30T22:26:31.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.176+0000 7f3bc4f63700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bc0099a50 0x7f3bc00983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.176+0000 7f3bbffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bc012c3a0 0x7f3bc0098930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.176+0000 7f3bc4f63700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bc0099a50 0x7f3bc00983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53840/0 (socket says 172.21.15.40:53840) 2023-09-30T22:26:31.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.176+0000 7f3bc4f63700 1 -- 172.21.15.40:0/883265705 learned_addr learned my addr 172.21.15.40:0/883265705 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:31.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.177+0000 7f3bc5764700 1 --2- 172.21.15.40:0/883265705 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3bc012cac0 0x7f3bc012ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.177+0000 7f3bc4f63700 1 -- 172.21.15.40:0/883265705 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3bc012cac0 msgr2=0x7f3bc012ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.177+0000 7f3bc4f63700 1 --2- 172.21.15.40:0/883265705 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3bc012cac0 0x7f3bc012ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.177+0000 7f3bc4f63700 1 -- 172.21.15.40:0/883265705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bc012c3a0 msgr2=0x7f3bc0098930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.177+0000 7f3bc4f63700 1 --2- 172.21.15.40:0/883265705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bc012c3a0 0x7f3bc0098930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.177+0000 7f3bc4f63700 1 -- 172.21.15.40:0/883265705 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb4009550 con 0x7f3bc0099a50 2023-09-30T22:26:31.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.177+0000 7f3bc4f63700 1 --2- 172.21.15.40:0/883265705 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bc0099a50 0x7f3bc00983f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3bb000da20 tx=0x7f3bb000dd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:31.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.177+0000 7f3bbd7fa700 1 -- 172.21.15.40:0/883265705 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb000a9d0 con 0x7f3bc0099a50 2023-09-30T22:26:31.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.177+0000 7f3bbd7fa700 1 -- 172.21.15.40:0/883265705 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb000ab30 con 0x7f3bc0099a50 2023-09-30T22:26:31.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.177+0000 7f3bbd7fa700 1 -- 172.21.15.40:0/883265705 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb0010470 con 0x7f3bc0099a50 2023-09-30T22:26:31.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.177+0000 7f3bc71c7700 1 -- 172.21.15.40:0/883265705 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc012b410 con 0x7f3bc0099a50 2023-09-30T22:26:31.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.177+0000 7f3bc71c7700 1 -- 172.21.15.40:0/883265705 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc0098e70 con 0x7f3bc0099a50 2023-09-30T22:26:31.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.179+0000 7f3bc71c7700 1 -- 172.21.15.40:0/883265705 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc0062380 con 0x7f3bc0099a50 2023-09-30T22:26:31.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.179+0000 7f89e5ffb700 1 -- 172.21.15.40:0/2608431327 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f89e00102c0 con 0x7f89f009c7d0 2023-09-30T22:26:31.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.180+0000 7f3bbd7fa700 1 -- 172.21.15.40:0/883265705 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3bb0005a20 con 0x7f3bc0099a50 2023-09-30T22:26:31.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.180+0000 7f3bbd7fa700 1 -- 172.21.15.40:0/883265705 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3bb0040130 con 0x7f3bc0099a50 2023-09-30T22:26:31.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.188+0000 7f3bbd7fa700 1 -- 172.21.15.40:0/883265705 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3bb00227b0 con 0x7f3bc0099a50 2023-09-30T22:26:31.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.310+0000 7fbb34ff9700 1 -- 172.21.15.40:0/1307321931 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbb1c005590 con 0x7fbb4009d920 2023-09-30T22:26:31.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.311+0000 7fbb36ffd700 1 -- 172.21.15.40:0/1307321931 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbb3c02a070 con 0x7fbb4009d920 2023-09-30T22:26:31.311 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:31.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.313+0000 7fbb34ff9700 1 -- 172.21.15.40:0/1307321931 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb4009d920 msgr2=0x7fbb4012ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.313+0000 7fbb34ff9700 1 --2- 172.21.15.40:0/1307321931 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb4009d920 0x7fbb4012ec60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c009c10 tx=0x7fbb3c004750 comp rx=0 tx=0).stop 2023-09-30T22:26:31.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.313+0000 7fbb34ff9700 1 -- 172.21.15.40:0/1307321931 shutdown_connections 2023-09-30T22:26:31.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.313+0000 7fbb34ff9700 1 --2- 172.21.15.40:0/1307321931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb40130de0 0x7fbb4012f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.313+0000 7fbb34ff9700 1 --2- 172.21.15.40:0/1307321931 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb4009d920 0x7fbb4012ec60 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.313+0000 7fbb34ff9700 1 --2- 172.21.15.40:0/1307321931 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbb4009e230 0x7fbb4012f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.313+0000 7fbb34ff9700 1 -- 172.21.15.40:0/1307321931 >> 172.21.15.40:0/1307321931 conn(0x7fbb4009fb20 msgr2=0x7fbb4006ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:31.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.313+0000 7fbb34ff9700 1 -- 172.21.15.40:0/1307321931 shutdown_connections 2023-09-30T22:26:31.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.313+0000 7fbb34ff9700 1 -- 172.21.15.40:0/1307321931 wait complete. 2023-09-30T22:26:31.326 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:31.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.369+0000 7f0cb108b700 1 -- 172.21.15.40:0/945222983 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0cac130ae0 con 0x7f0cac09d920 2023-09-30T22:26:31.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.370+0000 7f0c937fe700 1 -- 172.21.15.40:0/945222983 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0cac130ae0 con 0x7f0cac09d920 2023-09-30T22:26:31.371 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:31.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.372+0000 7f0cb108b700 1 -- 172.21.15.40:0/945222983 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0cac09d920 msgr2=0x7f0cac12dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.372+0000 7f0cb108b700 1 --2- 172.21.15.40:0/945222983 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0cac09d920 0x7f0cac12dc90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0cac0a0ae0 tx=0x7f0ca000c730 comp rx=0 tx=0).stop 2023-09-30T22:26:31.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.372+0000 7f0cb108b700 1 -- 172.21.15.40:0/945222983 shutdown_connections 2023-09-30T22:26:31.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.372+0000 7f0cb108b700 1 --2- 172.21.15.40:0/945222983 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0cac09e480 0x7f0cac12e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.372+0000 7f0cb108b700 1 --2- 172.21.15.40:0/945222983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cac09c890 0x7f0cac12d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.372+0000 7f0cb108b700 1 --2- 172.21.15.40:0/945222983 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0cac09d920 0x7f0cac12dc90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.372+0000 7f0cb108b700 1 -- 172.21.15.40:0/945222983 >> 172.21.15.40:0/945222983 conn(0x7f0cac0a7080 msgr2=0x7f0cac0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:31.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.372+0000 7f0cb108b700 1 -- 172.21.15.40:0/945222983 shutdown_connections 2023-09-30T22:26:31.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.372+0000 7f0cb108b700 1 -- 172.21.15.40:0/945222983 wait complete. 2023-09-30T22:26:31.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.379+0000 7f89f7274700 1 -- 172.21.15.40:0/2608431327 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f89f0074330 con 0x7f89f009c7d0 2023-09-30T22:26:31.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.380+0000 7f89e5ffb700 1 -- 172.21.15.40:0/2608431327 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f89e0011e80 con 0x7f89f009c7d0 2023-09-30T22:26:31.380 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:31.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.382+0000 7f89f7274700 1 -- 172.21.15.40:0/2608431327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f89f009c7d0 msgr2=0x7f89f01c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.382+0000 7f89f7274700 1 --2- 172.21.15.40:0/2608431327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f89f009c7d0 0x7f89f01c8a30 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f89f00716e0 tx=0x7f89e000c6a0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.382+0000 7f89f7274700 1 -- 172.21.15.40:0/2608431327 shutdown_connections 2023-09-30T22:26:31.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.382+0000 7f89f7274700 1 --2- 172.21.15.40:0/2608431327 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f89f009bc50 0x7f89f01c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.382+0000 7f89f7274700 1 --2- 172.21.15.40:0/2608431327 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f89f0131d50 0x7f89f01c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.382+0000 7f89f7274700 1 --2- 172.21.15.40:0/2608431327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f89f009c7d0 0x7f89f01c8a30 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.382+0000 7f89f7274700 1 -- 172.21.15.40:0/2608431327 >> 172.21.15.40:0/2608431327 conn(0x7f89f00a2a00 msgr2=0x7f89f009afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:31.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.382+0000 7f89f7274700 1 -- 172.21.15.40:0/2608431327 shutdown_connections 2023-09-30T22:26:31.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.382+0000 7f89f7274700 1 -- 172.21.15.40:0/2608431327 wait complete. 2023-09-30T22:26:31.385 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:31.395 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:31.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.419+0000 7f3bc71c7700 1 -- 172.21.15.40:0/883265705 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3bc009b6d0 con 0x7f3bc0099a50 2023-09-30T22:26:31.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.419+0000 7f3bbd7fa700 1 -- 172.21.15.40:0/883265705 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3bb001e020 con 0x7f3bc0099a50 2023-09-30T22:26:31.420 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:31.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.422+0000 7f3bc71c7700 1 -- 172.21.15.40:0/883265705 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bc0099a50 msgr2=0x7f3bc00983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.422+0000 7f3bc71c7700 1 --2- 172.21.15.40:0/883265705 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bc0099a50 0x7f3bc00983f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3bb000da20 tx=0x7f3bb000dd30 comp rx=0 tx=0).stop 2023-09-30T22:26:31.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.422+0000 7f3bc71c7700 1 -- 172.21.15.40:0/883265705 shutdown_connections 2023-09-30T22:26:31.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.422+0000 7f3bc71c7700 1 --2- 172.21.15.40:0/883265705 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3bc012cac0 0x7f3bc012ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.422+0000 7f3bc71c7700 1 --2- 172.21.15.40:0/883265705 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bc0099a50 0x7f3bc00983f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.422+0000 7f3bc71c7700 1 --2- 172.21.15.40:0/883265705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bc012c3a0 0x7f3bc0098930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.422+0000 7f3bc71c7700 1 -- 172.21.15.40:0/883265705 >> 172.21.15.40:0/883265705 conn(0x7f3bc00a2c70 msgr2=0x7f3bc00a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:31.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.422+0000 7f3bc71c7700 1 -- 172.21.15.40:0/883265705 shutdown_connections 2023-09-30T22:26:31.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:31.422+0000 7f3bc71c7700 1 -- 172.21.15.40:0/883265705 wait complete. 2023-09-30T22:26:31.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:32.327 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:32.385 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:32.396 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:32.435 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:32.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.470+0000 7f127fe3a700 1 Processor -- start 2023-09-30T22:26:32.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.470+0000 7f127fe3a700 1 -- start start 2023-09-30T22:26:32.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.471+0000 7f127fe3a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1278133e00 0x7f12781341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.471+0000 7f127fe3a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f127809df40 0x7f127813bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.471+0000 7f127fe3a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1278133940 con 0x7f127809d400 2023-09-30T22:26:32.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.471+0000 7f127fe3a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f127809f0d0 con 0x7f127809df40 2023-09-30T22:26:32.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.471+0000 7f127fe3a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1278133be0 con 0x7f1278133e00 2023-09-30T22:26:32.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.471+0000 7f127e3d7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f127809df40 0x7f127813bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.471+0000 7f127e3d7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f127809df40 0x7f127813bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33644/0 (socket says 172.21.15.40:33644) 2023-09-30T22:26:32.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.471+0000 7f127e3d7700 1 -- 172.21.15.40:0/3902610064 learned_addr learned my addr 172.21.15.40:0/3902610064 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:32.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.471+0000 7f127dbd6700 1 --2- 172.21.15.40:0/3902610064 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1278133e00 0x7f12781341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.471+0000 7f127e3d7700 1 -- 172.21.15.40:0/3902610064 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1278133e00 msgr2=0x7f12781341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:32.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.471+0000 7f127e3d7700 1 --2- 172.21.15.40:0/3902610064 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1278133e00 0x7f12781341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.471+0000 7f127e3d7700 1 -- 172.21.15.40:0/3902610064 >> v1:172.21.15.40:6789/0 conn(0x7f127809d400 legacy=0x7f127809d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.471+0000 7f127e3d7700 1 -- 172.21.15.40:0/3902610064 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f127809a860 con 0x7f127809df40 2023-09-30T22:26:32.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.472+0000 7f127e3d7700 1 --2- 172.21.15.40:0/3902610064 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f127809df40 0x7f127813bc80 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1270009e50 tx=0x7f127000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=461511868a1032dd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:32.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.472+0000 7f127cbd4700 1 -- 172.21.15.40:0/3902610064 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127000bb10 con 0x7f127809df40 2023-09-30T22:26:32.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.472+0000 7f127cbd4700 1 -- 172.21.15.40:0/3902610064 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127000bc70 con 0x7f127809df40 2023-09-30T22:26:32.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.472+0000 7f127cbd4700 1 -- 172.21.15.40:0/3902610064 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12700148d0 con 0x7f127809df40 2023-09-30T22:26:32.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.473+0000 7f127fe3a700 1 -- 172.21.15.40:0/3902610064 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f127809df40 msgr2=0x7f127813bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.473+0000 7f127fe3a700 1 --2- 172.21.15.40:0/3902610064 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f127809df40 0x7f127813bc80 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1270009e50 tx=0x7f127000b330 comp rx=0 tx=0).stop 2023-09-30T22:26:32.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.473+0000 7f127fe3a700 1 -- 172.21.15.40:0/3902610064 shutdown_connections 2023-09-30T22:26:32.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.473+0000 7f127fe3a700 1 --2- 172.21.15.40:0/3902610064 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f127809df40 0x7f127813bc80 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.473+0000 7f127fe3a700 1 --2- 172.21.15.40:0/3902610064 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1278133e00 0x7f12781341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.473+0000 7f127fe3a700 1 -- 172.21.15.40:0/3902610064 >> 172.21.15.40:0/3902610064 conn(0x7f12780a2a00 msgr2=0x7f12780a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:32.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.473+0000 7f127fe3a700 1 -- 172.21.15.40:0/3902610064 shutdown_connections 2023-09-30T22:26:32.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.473+0000 7f127fe3a700 1 -- 172.21.15.40:0/3902610064 wait complete. 2023-09-30T22:26:32.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.474+0000 7f127fe3a700 1 Processor -- start 2023-09-30T22:26:32.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.474+0000 7f127fe3a700 1 -- start start 2023-09-30T22:26:32.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.475+0000 7f127fe3a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f127809d400 0x7f127806eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.475+0000 7f127fe3a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f127809df40 0x7f127806f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.475+0000 7f127fe3a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1278133e00 0x7f127806f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.475+0000 7f127fe3a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127811ad60 con 0x7f127809df40 2023-09-30T22:26:32.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.475+0000 7f127fe3a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1278071430 con 0x7f1278133e00 2023-09-30T22:26:32.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.475+0000 7f127fe3a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f127811a3a0 con 0x7f127809d400 2023-09-30T22:26:32.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.475+0000 7f127dbd6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f127809d400 0x7f127806eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.475+0000 7f127d3d5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f127809df40 0x7f127806f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.475+0000 7f127dbd6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f127809d400 0x7f127806eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:38288/0 (socket says 172.21.15.40:38288) 2023-09-30T22:26:32.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.475+0000 7f127dbd6700 1 -- 172.21.15.40:0/3218306404 learned_addr learned my addr 172.21.15.40:0/3218306404 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:32.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.475+0000 7f127e3d7700 1 --2- 172.21.15.40:0/3218306404 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1278133e00 0x7f127806f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.476+0000 7f127dbd6700 1 -- 172.21.15.40:0/3218306404 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1278133e00 msgr2=0x7f127806f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.476+0000 7f127dbd6700 1 --2- 172.21.15.40:0/3218306404 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1278133e00 0x7f127806f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.476+0000 7f127dbd6700 1 -- 172.21.15.40:0/3218306404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f127809df40 msgr2=0x7f127806f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.476+0000 7f127dbd6700 1 --2- 172.21.15.40:0/3218306404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f127809df40 0x7f127806f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.476+0000 7f127dbd6700 1 -- 172.21.15.40:0/3218306404 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1270009b30 con 0x7f127809d400 2023-09-30T22:26:32.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.476+0000 7f127d3d5700 1 --2- 172.21.15.40:0/3218306404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f127809df40 0x7f127806f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:32.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.476+0000 7f127dbd6700 1 --2- 172.21.15.40:0/3218306404 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f127809d400 0x7f127806eec0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f127400e9e0 tx=0x7f127400ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:32.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.476+0000 7f126e7fc700 1 -- 172.21.15.40:0/3218306404 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1274009710 con 0x7f127809d400 2023-09-30T22:26:32.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.476+0000 7f126e7fc700 1 -- 172.21.15.40:0/3218306404 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127400ee80 con 0x7f127809d400 2023-09-30T22:26:32.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.476+0000 7f127fe3a700 1 -- 172.21.15.40:0/3218306404 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f127812e1a0 con 0x7f127809d400 2023-09-30T22:26:32.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.476+0000 7f126e7fc700 1 -- 172.21.15.40:0/3218306404 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127400ca50 con 0x7f127809d400 2023-09-30T22:26:32.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.476+0000 7f127fe3a700 1 -- 172.21.15.40:0/3218306404 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1278070a90 con 0x7f127809d400 2023-09-30T22:26:32.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.477+0000 7f126e7fc700 1 -- 172.21.15.40:0/3218306404 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f127400cbb0 con 0x7f127809d400 2023-09-30T22:26:32.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.478+0000 7f126e7fc700 1 -- 172.21.15.40:0/3218306404 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f1274011e20 con 0x7f127809d400 2023-09-30T22:26:32.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.478+0000 7f127fe3a700 1 -- 172.21.15.40:0/3218306404 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f127812fb30 con 0x7f127809d400 2023-09-30T22:26:32.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.487+0000 7f126e7fc700 1 -- 172.21.15.40:0/3218306404 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1274017020 con 0x7f127809d400 2023-09-30T22:26:32.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.527+0000 7f7f04dbc700 1 Processor -- start 2023-09-30T22:26:32.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.527+0000 7f7f04dbc700 1 -- start start 2023-09-30T22:26:32.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.528+0000 7f7f04dbc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f00134a90 0x7f7f00136e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.528+0000 7f7f04dbc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7f001373b0 0x7f7f00139790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.528+0000 7f7f04dbc700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f00131900 con 0x7f7f00131d50 2023-09-30T22:26:32.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.528+0000 7f7f04dbc700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f000719b0 con 0x7f7f001373b0 2023-09-30T22:26:32.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.528+0000 7f7f04dbc700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0009e820 con 0x7f7f00134a90 2023-09-30T22:26:32.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.528+0000 7f7efdd9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f00134a90 0x7f7f00136e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.528+0000 7f7efed9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7f001373b0 0x7f7f00139790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.528+0000 7f7efdd9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f00134a90 0x7f7f00136e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:38300/0 (socket says 172.21.15.40:38300) 2023-09-30T22:26:32.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.528+0000 7f7efdd9b700 1 -- 172.21.15.40:0/3865681630 learned_addr learned my addr 172.21.15.40:0/3865681630 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:32.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.529+0000 7f7efdd9b700 1 -- 172.21.15.40:0/3865681630 >> v2:172.21.15.40:3300/0 conn(0x7f7f001373b0 msgr2=0x7f7f00139790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:32.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.529+0000 7f7efdd9b700 1 --2- 172.21.15.40:0/3865681630 >> v2:172.21.15.40:3300/0 conn(0x7f7f001373b0 0x7f7f00139790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.529+0000 7f7efdd9b700 1 -- 172.21.15.40:0/3865681630 >> v1:172.21.15.40:6789/0 conn(0x7f7f00131d50 legacy=0x7f7f00132120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.529+0000 7f7efdd9b700 1 -- 172.21.15.40:0/3865681630 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0009ef60 con 0x7f7f00134a90 2023-09-30T22:26:32.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.529+0000 7f7efdd9b700 1 --2- 172.21.15.40:0/3865681630 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f00134a90 0x7f7f00136e70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40098f0 tx=0x7f7ef4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d17ae0846e769ec server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:32.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.529+0000 7f7efd59a700 1 -- 172.21.15.40:0/3865681630 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4011830 con 0x7f7f00134a90 2023-09-30T22:26:32.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.529+0000 7f7efd59a700 1 -- 172.21.15.40:0/3865681630 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef4011990 con 0x7f7f00134a90 2023-09-30T22:26:32.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.529+0000 7f7efd59a700 1 -- 172.21.15.40:0/3865681630 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4011d20 con 0x7f7f00134a90 2023-09-30T22:26:32.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.530+0000 7f7f04dbc700 1 -- 172.21.15.40:0/3865681630 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f00134a90 msgr2=0x7f7f00136e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.530+0000 7f7f04dbc700 1 --2- 172.21.15.40:0/3865681630 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f00134a90 0x7f7f00136e70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40098f0 tx=0x7f7ef4009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:32.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.530+0000 7f7f04dbc700 1 -- 172.21.15.40:0/3865681630 shutdown_connections 2023-09-30T22:26:32.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.530+0000 7f7f04dbc700 1 --2- 172.21.15.40:0/3865681630 >> v2:172.21.15.40:3300/0 conn(0x7f7f001373b0 0x7f7f00139790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.530+0000 7f7f04dbc700 1 --2- 172.21.15.40:0/3865681630 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f00134a90 0x7f7f00136e70 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.530+0000 7f7f04dbc700 1 -- 172.21.15.40:0/3865681630 >> 172.21.15.40:0/3865681630 conn(0x7f7f000a2a00 msgr2=0x7f7f000a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:32.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.530+0000 7f7f04dbc700 1 -- 172.21.15.40:0/3865681630 shutdown_connections 2023-09-30T22:26:32.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.530+0000 7f7f04dbc700 1 -- 172.21.15.40:0/3865681630 wait complete. 2023-09-30T22:26:32.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.531+0000 7f7f04dbc700 1 Processor -- start 2023-09-30T22:26:32.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.531+0000 7f7f04dbc700 1 -- start start 2023-09-30T22:26:32.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.532+0000 7f7f04dbc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f00131d50 0x7f7f0012d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.532+0000 7f7f04dbc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f00134a90 0x7f7f0012d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.532+0000 7f7f04dbc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f001373b0 0x7f7f001c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.532+0000 7f7f04dbc700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0011b860 con 0x7f7f00131d50 2023-09-30T22:26:32.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.532+0000 7f7f04dbc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0011ba40 con 0x7f7f00134a90 2023-09-30T22:26:32.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.532+0000 7f7f04dbc700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0009c980 con 0x7f7f001373b0 2023-09-30T22:26:32.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.532+0000 7f7efdd9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f00134a90 0x7f7f0012d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.532+0000 7f7efdd9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f00134a90 0x7f7f0012d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53872/0 (socket says 172.21.15.40:53872) 2023-09-30T22:26:32.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.532+0000 7f7efed9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f001373b0 0x7f7f001c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.532+0000 7f7efdd9b700 1 -- 172.21.15.40:0/537588110 learned_addr learned my addr 172.21.15.40:0/537588110 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:32.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.532+0000 7f7efe59c700 1 --2- 172.21.15.40:0/537588110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f00131d50 0x7f7f0012d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.532+0000 7f7efed9d700 1 -- 172.21.15.40:0/537588110 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f00134a90 msgr2=0x7f7f0012d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.532+0000 7f7efed9d700 1 --2- 172.21.15.40:0/537588110 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f00134a90 0x7f7f0012d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.532+0000 7f7efed9d700 1 -- 172.21.15.40:0/537588110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f00131d50 msgr2=0x7f7f0012d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.532+0000 7f7efed9d700 1 --2- 172.21.15.40:0/537588110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f00131d50 0x7f7f0012d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.532+0000 7f7efed9d700 1 -- 172.21.15.40:0/537588110 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef4009550 con 0x7f7f001373b0 2023-09-30T22:26:32.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.532+0000 7f7efdd9b700 1 --2- 172.21.15.40:0/537588110 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f00134a90 0x7f7f0012d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:32.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.532+0000 7f7efed9d700 1 --2- 172.21.15.40:0/537588110 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f001373b0 0x7f7f001c65a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7ef800b360 tx=0x7f7ef800b670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:32.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.533+0000 7f7eeeffd700 1 -- 172.21.15.40:0/537588110 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef8015070 con 0x7f7f001373b0 2023-09-30T22:26:32.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.533+0000 7f7eeeffd700 1 -- 172.21.15.40:0/537588110 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef800bce0 con 0x7f7f001373b0 2023-09-30T22:26:32.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.533+0000 7f7f04dbc700 1 -- 172.21.15.40:0/537588110 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f0009ea60 con 0x7f7f001373b0 2023-09-30T22:26:32.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.533+0000 7f7eeeffd700 1 -- 172.21.15.40:0/537588110 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef8019630 con 0x7f7f001373b0 2023-09-30T22:26:32.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.533+0000 7f7f04dbc700 1 -- 172.21.15.40:0/537588110 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f0011a5c0 con 0x7f7f001373b0 2023-09-30T22:26:32.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.534+0000 7f7f04dbc700 1 -- 172.21.15.40:0/537588110 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f0006dc80 con 0x7f7f001373b0 2023-09-30T22:26:32.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.534+0000 7f7eeeffd700 1 -- 172.21.15.40:0/537588110 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7ef8019790 con 0x7f7f001373b0 2023-09-30T22:26:32.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.534+0000 7f7eeeffd700 1 -- 172.21.15.40:0/537588110 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f7ef80434d0 con 0x7f7f001373b0 2023-09-30T22:26:32.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.543+0000 7f7eeeffd700 1 -- 172.21.15.40:0/537588110 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7ef80223b0 con 0x7f7f001373b0 2023-09-30T22:26:32.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.567+0000 7f6b5d922700 1 Processor -- start 2023-09-30T22:26:32.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.567+0000 7f6b5d922700 1 -- start start 2023-09-30T22:26:32.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.568+0000 7f6b5d922700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b5806a6d0 0x7f6b5809d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.568+0000 7f6b5d922700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b5809e250 0x7f6b5813fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.568+0000 7f6b5d922700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b5811d980 con 0x7f6b5809de60 2023-09-30T22:26:32.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.568+0000 7f6b5d922700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5806aaa0 con 0x7f6b5809e250 2023-09-30T22:26:32.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.568+0000 7f6b5d922700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5806b150 con 0x7f6b5806a6d0 2023-09-30T22:26:32.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.568+0000 7f6b577fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b5809e250 0x7f6b5813fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.568+0000 7f6b577fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b5809e250 0x7f6b5813fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53884/0 (socket says 172.21.15.40:53884) 2023-09-30T22:26:32.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.568+0000 7f6b577fe700 1 -- 172.21.15.40:0/2235762645 learned_addr learned my addr 172.21.15.40:0/2235762645 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:32.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.568+0000 7f6b56ffd700 1 --2- 172.21.15.40:0/2235762645 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b5806a6d0 0x7f6b5809d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.569+0000 7f6b577fe700 1 -- 172.21.15.40:0/2235762645 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b5806a6d0 msgr2=0x7f6b5809d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:32.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.569+0000 7f6b577fe700 1 --2- 172.21.15.40:0/2235762645 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b5806a6d0 0x7f6b5809d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.569+0000 7f6b577fe700 1 -- 172.21.15.40:0/2235762645 >> v1:172.21.15.40:6789/0 conn(0x7f6b5809de60 legacy=0x7f6b5813c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.569+0000 7f6b577fe700 1 -- 172.21.15.40:0/2235762645 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b5809f300 con 0x7f6b5809e250 2023-09-30T22:26:32.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.569+0000 7f6b577fe700 1 --2- 172.21.15.40:0/2235762645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b5809e250 0x7f6b5813fbc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6b50009e80 tx=0x7f6b5000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b82565305d9ba73 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:32.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.569+0000 7f6b55ffb700 1 -- 172.21.15.40:0/2235762645 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5000e070 con 0x7f6b5809e250 2023-09-30T22:26:32.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.569+0000 7f6b55ffb700 1 -- 172.21.15.40:0/2235762645 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b5000b910 con 0x7f6b5809e250 2023-09-30T22:26:32.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.569+0000 7f6b55ffb700 1 -- 172.21.15.40:0/2235762645 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5000bcc0 con 0x7f6b5809e250 2023-09-30T22:26:32.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.570+0000 7f6b5d922700 1 -- 172.21.15.40:0/2235762645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b5809e250 msgr2=0x7f6b5813fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.570+0000 7f6b5d922700 1 --2- 172.21.15.40:0/2235762645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b5809e250 0x7f6b5813fbc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6b50009e80 tx=0x7f6b5000b330 comp rx=0 tx=0).stop 2023-09-30T22:26:32.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.570+0000 7f6b5d922700 1 -- 172.21.15.40:0/2235762645 shutdown_connections 2023-09-30T22:26:32.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.570+0000 7f6b5d922700 1 --2- 172.21.15.40:0/2235762645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b5809e250 0x7f6b5813fbc0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.570+0000 7f6b5d922700 1 --2- 172.21.15.40:0/2235762645 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b5806a6d0 0x7f6b5809d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.570+0000 7f6b5d922700 1 -- 172.21.15.40:0/2235762645 >> 172.21.15.40:0/2235762645 conn(0x7f6b5809fb20 msgr2=0x7f6b5809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:32.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.570+0000 7f6b5d922700 1 -- 172.21.15.40:0/2235762645 shutdown_connections 2023-09-30T22:26:32.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.570+0000 7f6b5d922700 1 -- 172.21.15.40:0/2235762645 wait complete. 2023-09-30T22:26:32.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.571+0000 7f6b5d922700 1 Processor -- start 2023-09-30T22:26:32.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.572+0000 7f6b5d922700 1 -- start start 2023-09-30T22:26:32.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.572+0000 7f6b5d922700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b5806a6d0 0x7f6b581325f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.572+0000 7f6b5d922700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b5809de60 0x7f6b5811dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.572+0000 7f6b5d922700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b5809e250 0x7f6b5811e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.572+0000 7f6b5d922700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b58121200 con 0x7f6b5809e250 2023-09-30T22:26:32.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.572+0000 7f6b5d922700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b580a3380 con 0x7f6b5806a6d0 2023-09-30T22:26:32.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.572+0000 7f6b5d922700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5809f540 con 0x7f6b5809de60 2023-09-30T22:26:32.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.572+0000 7f6b567fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b5809de60 0x7f6b5811dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.572+0000 7f6b577fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b5809e250 0x7f6b5811e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.572+0000 7f6b567fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b5809de60 0x7f6b5811dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:38336/0 (socket says 172.21.15.40:38336) 2023-09-30T22:26:32.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.573+0000 7f6b577fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b5809e250 0x7f6b5811e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33686/0 (socket says 172.21.15.40:33686) 2023-09-30T22:26:32.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.573+0000 7f6b567fc700 1 -- 172.21.15.40:0/2514255551 learned_addr learned my addr 172.21.15.40:0/2514255551 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:32.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.573+0000 7f6b56ffd700 1 --2- 172.21.15.40:0/2514255551 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b5806a6d0 0x7f6b581325f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.573+0000 7f6b56ffd700 1 -- 172.21.15.40:0/2514255551 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b5809de60 msgr2=0x7f6b5811dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.573+0000 7f6b56ffd700 1 --2- 172.21.15.40:0/2514255551 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b5809de60 0x7f6b5811dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.573+0000 7f6b56ffd700 1 -- 172.21.15.40:0/2514255551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b5809e250 msgr2=0x7f6b5811e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.573+0000 7f6b56ffd700 1 --2- 172.21.15.40:0/2514255551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b5809e250 0x7f6b5811e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.573+0000 7f6b56ffd700 1 -- 172.21.15.40:0/2514255551 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b50009b30 con 0x7f6b5806a6d0 2023-09-30T22:26:32.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.573+0000 7f6b567fc700 1 --2- 172.21.15.40:0/2514255551 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b5809de60 0x7f6b5811dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:32.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.573+0000 7f6b56ffd700 1 --2- 172.21.15.40:0/2514255551 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b5806a6d0 0x7f6b581325f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6b4800e8d0 tx=0x7f6b4800ebe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:32.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.573+0000 7f6b3ffff700 1 -- 172.21.15.40:0/2514255551 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b48013680 con 0x7f6b5806a6d0 2023-09-30T22:26:32.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.574+0000 7f6b3ffff700 1 -- 172.21.15.40:0/2514255551 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b480137e0 con 0x7f6b5806a6d0 2023-09-30T22:26:32.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.574+0000 7f6b5d922700 1 -- 172.21.15.40:0/2514255551 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b5811fe50 con 0x7f6b5806a6d0 2023-09-30T22:26:32.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.574+0000 7f6b3ffff700 1 -- 172.21.15.40:0/2514255551 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b48013b50 con 0x7f6b5806a6d0 2023-09-30T22:26:32.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.574+0000 7f6b5d922700 1 -- 172.21.15.40:0/2514255551 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b581217a0 con 0x7f6b5806a6d0 2023-09-30T22:26:32.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.575+0000 7f6b3ffff700 1 -- 172.21.15.40:0/2514255551 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6b48013cb0 con 0x7f6b5806a6d0 2023-09-30T22:26:32.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.575+0000 7f6b3ffff700 1 -- 172.21.15.40:0/2514255551 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6b4803fac0 con 0x7f6b5806a6d0 2023-09-30T22:26:32.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.575+0000 7f6b5d922700 1 -- 172.21.15.40:0/2514255551 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b58121370 con 0x7f6b5806a6d0 2023-09-30T22:26:32.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.580+0000 7f6b3ffff700 1 -- 172.21.15.40:0/2514255551 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6b4801adc0 con 0x7f6b5806a6d0 2023-09-30T22:26:32.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.610+0000 7f7d13d01700 1 Processor -- start 2023-09-30T22:26:32.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.610+0000 7f7d13d01700 1 -- start start 2023-09-30T22:26:32.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.611+0000 7f7d13d01700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d0c133e00 0x7f7d0c1341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.611+0000 7f7d13d01700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7d0c09d400 0x7f7d0c09d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.611+0000 7f7d13d01700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d0c133940 con 0x7f7d0c09dd70 2023-09-30T22:26:32.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.611+0000 7f7d13d01700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d0c09f0d0 con 0x7f7d0c09d400 2023-09-30T22:26:32.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.611+0000 7f7d13d01700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c09e210 con 0x7f7d0c133e00 2023-09-30T22:26:32.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.611+0000 7f7d1129c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7d0c09d400 0x7f7d0c09d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.611+0000 7f7d11a9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d0c133e00 0x7f7d0c1341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.611+0000 7f7d1129c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7d0c09d400 0x7f7d0c09d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33702/0 (socket says 172.21.15.40:33702) 2023-09-30T22:26:32.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.612+0000 7f7d1129c700 1 -- 172.21.15.40:0/2050796569 learned_addr learned my addr 172.21.15.40:0/2050796569 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:32.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.611+0000 7f7d11a9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d0c133e00 0x7f7d0c1341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53904/0 (socket says 172.21.15.40:53904) 2023-09-30T22:26:32.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.612+0000 7f7d1229e700 1 --1- 172.21.15.40:0/2050796569 >> v1:172.21.15.40:6789/0 conn(0x7f7d0c09dd70 0x7f7d0c13ac70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50000/0 (socket says 172.21.15.40:50000) 2023-09-30T22:26:32.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.612+0000 7f7d11a9d700 1 -- 172.21.15.40:0/2050796569 >> v2:172.21.15.40:3300/0 conn(0x7f7d0c09d400 msgr2=0x7f7d0c09d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:32.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.612+0000 7f7d11a9d700 1 --2- 172.21.15.40:0/2050796569 >> v2:172.21.15.40:3300/0 conn(0x7f7d0c09d400 0x7f7d0c09d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.612+0000 7f7d11a9d700 1 -- 172.21.15.40:0/2050796569 >> v1:172.21.15.40:6789/0 conn(0x7f7d0c09dd70 legacy=0x7f7d0c13ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.612+0000 7f7d11a9d700 1 -- 172.21.15.40:0/2050796569 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0c133be0 con 0x7f7d0c133e00 2023-09-30T22:26:32.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.612+0000 7f7d10a9b700 1 -- 172.21.15.40:0/2050796569 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 130183423 0 0) 0x7f7d0c133940 con 0x7f7d0c09dd70 2023-09-30T22:26:32.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.612+0000 7f7d1129c700 1 --2- 172.21.15.40:0/2050796569 >> v2:172.21.15.40:3300/0 conn(0x7f7d0c09d400 0x7f7d0c09d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:32.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.612+0000 7f7d11a9d700 1 --2- 172.21.15.40:0/2050796569 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d0c133e00 0x7f7d0c1341d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7d08009840 tx=0x7f7d08009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4822272c5419497 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:32.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.612+0000 7f7d10a9b700 1 -- 172.21.15.40:0/2050796569 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d08011830 con 0x7f7d0c133e00 2023-09-30T22:26:32.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.612+0000 7f7d10a9b700 1 -- 172.21.15.40:0/2050796569 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d08011990 con 0x7f7d0c133e00 2023-09-30T22:26:32.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.612+0000 7f7d10a9b700 1 -- 172.21.15.40:0/2050796569 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d08011d20 con 0x7f7d0c133e00 2023-09-30T22:26:32.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.613+0000 7f7d13d01700 1 -- 172.21.15.40:0/2050796569 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d0c133e00 msgr2=0x7f7d0c1341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.613+0000 7f7d13d01700 1 --2- 172.21.15.40:0/2050796569 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d0c133e00 0x7f7d0c1341d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7d08009840 tx=0x7f7d08009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:32.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.613+0000 7f7d13d01700 1 -- 172.21.15.40:0/2050796569 shutdown_connections 2023-09-30T22:26:32.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.613+0000 7f7d13d01700 1 --2- 172.21.15.40:0/2050796569 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d0c133e00 0x7f7d0c1341d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.613+0000 7f7d13d01700 1 --2- 172.21.15.40:0/2050796569 >> v2:172.21.15.40:3300/0 conn(0x7f7d0c09d400 0x7f7d0c09d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.613+0000 7f7d13d01700 1 -- 172.21.15.40:0/2050796569 >> 172.21.15.40:0/2050796569 conn(0x7f7d0c0a2a00 msgr2=0x7f7d0c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:32.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.613+0000 7f7d13d01700 1 -- 172.21.15.40:0/2050796569 shutdown_connections 2023-09-30T22:26:32.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.613+0000 7f7d13d01700 1 -- 172.21.15.40:0/2050796569 wait complete. 2023-09-30T22:26:32.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.614+0000 7f7d13d01700 1 Processor -- start 2023-09-30T22:26:32.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.614+0000 7f7d13d01700 1 -- start start 2023-09-30T22:26:32.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.615+0000 7f7d13d01700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7d0c09d400 0x7f7d0c119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.615+0000 7f7d13d01700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d0c09dd70 0x7f7d0c119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.615+0000 7f7d13d01700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d0c133e00 0x7f7d0c119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.615+0000 7f7d13d01700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c11c4b0 con 0x7f7d0c09dd70 2023-09-30T22:26:32.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.615+0000 7f7d13d01700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c11b880 con 0x7f7d0c133e00 2023-09-30T22:26:32.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.615+0000 7f7d13d01700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c12e1a0 con 0x7f7d0c09d400 2023-09-30T22:26:32.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.615+0000 7f7d11a9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7d0c09d400 0x7f7d0c119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.615+0000 7f7d11a9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7d0c09d400 0x7f7d0c119050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:38352/0 (socket says 172.21.15.40:38352) 2023-09-30T22:26:32.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.615+0000 7f7d11a9d700 1 -- 172.21.15.40:0/1545459091 learned_addr learned my addr 172.21.15.40:0/1545459091 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:32.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.615+0000 7f7d1129c700 1 --2- 172.21.15.40:0/1545459091 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d0c09dd70 0x7f7d0c119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.615+0000 7f7d1229e700 1 --2- 172.21.15.40:0/1545459091 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d0c133e00 0x7f7d0c119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.615+0000 7f7d11a9d700 1 -- 172.21.15.40:0/1545459091 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d0c133e00 msgr2=0x7f7d0c119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.615+0000 7f7d11a9d700 1 --2- 172.21.15.40:0/1545459091 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d0c133e00 0x7f7d0c119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.615+0000 7f7d11a9d700 1 -- 172.21.15.40:0/1545459091 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d0c09dd70 msgr2=0x7f7d0c119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.615+0000 7f7d11a9d700 1 --2- 172.21.15.40:0/1545459091 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d0c09dd70 0x7f7d0c119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.615+0000 7f7d11a9d700 1 -- 172.21.15.40:0/1545459091 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cfc009550 con 0x7f7d0c09d400 2023-09-30T22:26:32.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.615+0000 7f7d1129c700 1 --2- 172.21.15.40:0/1545459091 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d0c09dd70 0x7f7d0c119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:32.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.615+0000 7f7d11a9d700 1 --2- 172.21.15.40:0/1545459091 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7d0c09d400 0x7f7d0c119050 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7d08009fd0 tx=0x7f7d08004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:32.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.616+0000 7f7d027fc700 1 -- 172.21.15.40:0/1545459091 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d08004590 con 0x7f7d0c09d400 2023-09-30T22:26:32.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.616+0000 7f7d027fc700 1 -- 172.21.15.40:0/1545459091 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d080036a0 con 0x7f7d0c09d400 2023-09-30T22:26:32.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.616+0000 7f7d13d01700 1 -- 172.21.15.40:0/1545459091 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d080094a0 con 0x7f7d0c09d400 2023-09-30T22:26:32.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.616+0000 7f7d13d01700 1 -- 172.21.15.40:0/1545459091 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d0c11a5a0 con 0x7f7d0c09d400 2023-09-30T22:26:32.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.616+0000 7f7d027fc700 1 -- 172.21.15.40:0/1545459091 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d08003a30 con 0x7f7d0c09d400 2023-09-30T22:26:32.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.617+0000 7f7d027fc700 1 -- 172.21.15.40:0/1545459091 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7d08003b90 con 0x7f7d0c09d400 2023-09-30T22:26:32.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.617+0000 7f7d027fc700 1 -- 172.21.15.40:0/1545459091 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f7d08040b80 con 0x7f7d0c09d400 2023-09-30T22:26:32.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.621+0000 7f7d13d01700 1 -- 172.21.15.40:0/1545459091 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf40052e0 con 0x7f7d0c09d400 2023-09-30T22:26:32.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.626+0000 7f7d027fc700 1 -- 172.21.15.40:0/1545459091 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d08003e40 con 0x7f7d0c09d400 2023-09-30T22:26:32.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.693+0000 7f127fe3a700 1 -- 172.21.15.40:0/3218306404 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1278062380 con 0x7f127809d400 2023-09-30T22:26:32.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.693+0000 7f126e7fc700 1 -- 172.21.15.40:0/3218306404 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1274044060 con 0x7f127809d400 2023-09-30T22:26:32.694 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:32.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.696+0000 7f127fe3a700 1 -- 172.21.15.40:0/3218306404 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f127809d400 msgr2=0x7f127806eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.696+0000 7f127fe3a700 1 --2- 172.21.15.40:0/3218306404 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f127809d400 0x7f127806eec0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f127400e9e0 tx=0x7f127400ecf0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.696+0000 7f127fe3a700 1 -- 172.21.15.40:0/3218306404 shutdown_connections 2023-09-30T22:26:32.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.696+0000 7f127fe3a700 1 --2- 172.21.15.40:0/3218306404 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f127809d400 0x7f127806eec0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.696+0000 7f127fe3a700 1 --2- 172.21.15.40:0/3218306404 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1278133e00 0x7f127806f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.696+0000 7f127fe3a700 1 --2- 172.21.15.40:0/3218306404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f127809df40 0x7f127806f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.696+0000 7f127fe3a700 1 -- 172.21.15.40:0/3218306404 >> 172.21.15.40:0/3218306404 conn(0x7f12780a2a00 msgr2=0x7f127812d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:32.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.696+0000 7f127fe3a700 1 -- 172.21.15.40:0/3218306404 shutdown_connections 2023-09-30T22:26:32.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.696+0000 7f127fe3a700 1 -- 172.21.15.40:0/3218306404 wait complete. 2023-09-30T22:26:32.709 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:32.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.760+0000 7f7f04dbc700 1 -- 172.21.15.40:0/537588110 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7f0011b660 con 0x7f7f001373b0 2023-09-30T22:26:32.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.761+0000 7f7eeeffd700 1 -- 172.21.15.40:0/537588110 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7ef801e030 con 0x7f7f001373b0 2023-09-30T22:26:32.761 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:32.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.763+0000 7f7f04dbc700 1 -- 172.21.15.40:0/537588110 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f001373b0 msgr2=0x7f7f001c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.763+0000 7f7f04dbc700 1 --2- 172.21.15.40:0/537588110 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f001373b0 0x7f7f001c65a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7ef800b360 tx=0x7f7ef800b670 comp rx=0 tx=0).stop 2023-09-30T22:26:32.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.763+0000 7f7f04dbc700 1 -- 172.21.15.40:0/537588110 shutdown_connections 2023-09-30T22:26:32.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.763+0000 7f7f04dbc700 1 --2- 172.21.15.40:0/537588110 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f001373b0 0x7f7f001c65a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.763+0000 7f7f04dbc700 1 --2- 172.21.15.40:0/537588110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f00131d50 0x7f7f0012d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.763+0000 7f7f04dbc700 1 --2- 172.21.15.40:0/537588110 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f00134a90 0x7f7f0012d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.763+0000 7f7f04dbc700 1 -- 172.21.15.40:0/537588110 >> 172.21.15.40:0/537588110 conn(0x7f7f000a2a00 msgr2=0x7f7f0009f360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:32.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.763+0000 7f7f04dbc700 1 -- 172.21.15.40:0/537588110 shutdown_connections 2023-09-30T22:26:32.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.763+0000 7f7f04dbc700 1 -- 172.21.15.40:0/537588110 wait complete. 2023-09-30T22:26:32.776 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:32.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.794+0000 7f6b5d922700 1 -- 172.21.15.40:0/2514255551 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6b58062380 con 0x7f6b5806a6d0 2023-09-30T22:26:32.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.795+0000 7f6b3ffff700 1 -- 172.21.15.40:0/2514255551 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6b48021030 con 0x7f6b5806a6d0 2023-09-30T22:26:32.796 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:32.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.797+0000 7f6b5d922700 1 -- 172.21.15.40:0/2514255551 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b5806a6d0 msgr2=0x7f6b581325f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.797+0000 7f6b5d922700 1 --2- 172.21.15.40:0/2514255551 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b5806a6d0 0x7f6b581325f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6b4800e8d0 tx=0x7f6b4800ebe0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.797+0000 7f6b5d922700 1 -- 172.21.15.40:0/2514255551 shutdown_connections 2023-09-30T22:26:32.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.797+0000 7f6b5d922700 1 --2- 172.21.15.40:0/2514255551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b5809e250 0x7f6b5811e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.797+0000 7f6b5d922700 1 --2- 172.21.15.40:0/2514255551 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b5806a6d0 0x7f6b581325f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.797+0000 7f6b5d922700 1 --2- 172.21.15.40:0/2514255551 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b5809de60 0x7f6b5811dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.797+0000 7f6b5d922700 1 -- 172.21.15.40:0/2514255551 >> 172.21.15.40:0/2514255551 conn(0x7f6b5809fb20 msgr2=0x7f6b5806e940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:32.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.797+0000 7f6b5d922700 1 -- 172.21.15.40:0/2514255551 shutdown_connections 2023-09-30T22:26:32.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.797+0000 7f6b5d922700 1 -- 172.21.15.40:0/2514255551 wait complete. 2023-09-30T22:26:32.810 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:32.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.824+0000 7f7d13d01700 1 -- 172.21.15.40:0/1545459091 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7cf4005590 con 0x7f7d0c09d400 2023-09-30T22:26:32.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.825+0000 7f7d027fc700 1 -- 172.21.15.40:0/1545459091 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7d08015020 con 0x7f7d0c09d400 2023-09-30T22:26:32.825 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:32.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.827+0000 7f7d13d01700 1 -- 172.21.15.40:0/1545459091 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7d0c09d400 msgr2=0x7f7d0c119050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.827+0000 7f7d13d01700 1 --2- 172.21.15.40:0/1545459091 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7d0c09d400 0x7f7d0c119050 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7d08009fd0 tx=0x7f7d08004750 comp rx=0 tx=0).stop 2023-09-30T22:26:32.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.827+0000 7f7d13d01700 1 -- 172.21.15.40:0/1545459091 shutdown_connections 2023-09-30T22:26:32.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.827+0000 7f7d13d01700 1 --2- 172.21.15.40:0/1545459091 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7d0c09d400 0x7f7d0c119050 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.827+0000 7f7d13d01700 1 --2- 172.21.15.40:0/1545459091 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d0c133e00 0x7f7d0c119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.827+0000 7f7d13d01700 1 --2- 172.21.15.40:0/1545459091 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d0c09dd70 0x7f7d0c119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.827+0000 7f7d13d01700 1 -- 172.21.15.40:0/1545459091 >> 172.21.15.40:0/1545459091 conn(0x7f7d0c0a2a00 msgr2=0x7f7d0c12d760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:32.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.827+0000 7f7d13d01700 1 -- 172.21.15.40:0/1545459091 shutdown_connections 2023-09-30T22:26:32.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:32.827+0000 7f7d13d01700 1 -- 172.21.15.40:0/1545459091 wait complete. 2023-09-30T22:26:32.839 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:33.710 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:33.777 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:33.811 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:33.840 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:33.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.855+0000 7f705365b700 1 Processor -- start 2023-09-30T22:26:33.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.855+0000 7f705365b700 1 -- start start 2023-09-30T22:26:33.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.855+0000 7f705365b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f704c09c890 0x7f704c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:33.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.855+0000 7f705365b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f704c09d920 0x7f704c09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:33.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.855+0000 7f705365b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f704c0a2600 con 0x7f704c09e2b0 2023-09-30T22:26:33.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.855+0000 7f705365b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f704c0a29d0 con 0x7f704c09c890 2023-09-30T22:26:33.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.855+0000 7f705365b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f704c09fb40 con 0x7f704c09d920 2023-09-30T22:26:33.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.855+0000 7f70513f7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f704c09c890 0x7f704c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:33.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.855+0000 7f7050bf6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f704c09d920 0x7f704c09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:33.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.856+0000 7f70513f7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f704c09c890 0x7f704c09cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:37774/0 (socket says 172.21.15.40:37774) 2023-09-30T22:26:33.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.856+0000 7f7050bf6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f704c09d920 0x7f704c09dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:44334/0 (socket says 172.21.15.40:44334) 2023-09-30T22:26:33.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.856+0000 7f70513f7700 1 -- 172.21.15.40:0/2155821807 learned_addr learned my addr 172.21.15.40:0/2155821807 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:33.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.856+0000 7f70513f7700 1 -- 172.21.15.40:0/2155821807 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f704c09d920 msgr2=0x7f704c09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:33.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.856+0000 7f70513f7700 1 --2- 172.21.15.40:0/2155821807 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f704c09d920 0x7f704c09dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:33.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.856+0000 7f70513f7700 1 -- 172.21.15.40:0/2155821807 >> v1:172.21.15.40:6789/0 conn(0x7f704c09e2b0 legacy=0x7f704c13ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:33.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.856+0000 7f70513f7700 1 -- 172.21.15.40:0/2155821807 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f704c09e720 con 0x7f704c09c890 2023-09-30T22:26:33.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.856+0000 7f7043fff700 1 -- 172.21.15.40:0/2155821807 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2574775893 0 0) 0x7f704c0a2600 con 0x7f704c09e2b0 2023-09-30T22:26:33.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.856+0000 7f70513f7700 1 --2- 172.21.15.40:0/2155821807 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f704c09c890 0x7f704c09cc60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f70480098f0 tx=0x7f7048009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9314ab40179da2e9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:33.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.856+0000 7f7043fff700 1 -- 172.21.15.40:0/2155821807 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7048005e30 con 0x7f704c09c890 2023-09-30T22:26:33.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.856+0000 7f7043fff700 1 -- 172.21.15.40:0/2155821807 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7048004030 con 0x7f704c09c890 2023-09-30T22:26:33.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.856+0000 7f7043fff700 1 -- 172.21.15.40:0/2155821807 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70480043e0 con 0x7f704c09c890 2023-09-30T22:26:33.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.857+0000 7f705365b700 1 -- 172.21.15.40:0/2155821807 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f704c09c890 msgr2=0x7f704c09cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:33.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.857+0000 7f705365b700 1 --2- 172.21.15.40:0/2155821807 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f704c09c890 0x7f704c09cc60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f70480098f0 tx=0x7f7048009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:33.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.857+0000 7f705365b700 1 -- 172.21.15.40:0/2155821807 shutdown_connections 2023-09-30T22:26:33.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.857+0000 7f705365b700 1 --2- 172.21.15.40:0/2155821807 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f704c09c890 0x7f704c09cc60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:33.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.857+0000 7f705365b700 1 --2- 172.21.15.40:0/2155821807 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f704c09d920 0x7f704c09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:33.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.857+0000 7f705365b700 1 -- 172.21.15.40:0/2155821807 >> 172.21.15.40:0/2155821807 conn(0x7f704c0a7080 msgr2=0x7f704c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:33.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.857+0000 7f705365b700 1 -- 172.21.15.40:0/2155821807 shutdown_connections 2023-09-30T22:26:33.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.857+0000 7f705365b700 1 -- 172.21.15.40:0/2155821807 wait complete. 2023-09-30T22:26:33.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.859+0000 7f705365b700 1 Processor -- start 2023-09-30T22:26:33.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.859+0000 7f705365b700 1 -- start start 2023-09-30T22:26:33.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.859+0000 7f705365b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f704c09c890 0x7f704c12f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:33.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.859+0000 7f705365b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f704c09d920 0x7f704c12fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:33.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.860+0000 7f705365b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f704c09e2b0 0x7f704c130180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:33.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.860+0000 7f705365b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704c12d1f0 con 0x7f704c09d920 2023-09-30T22:26:33.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.860+0000 7f705365b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f704c12e580 con 0x7f704c09e2b0 2023-09-30T22:26:33.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.860+0000 7f705365b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f704c09ed20 con 0x7f704c09c890 2023-09-30T22:26:33.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.860+0000 7f70513f7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f704c09c890 0x7f704c12f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:33.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.860+0000 7f70513f7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f704c09c890 0x7f704c12f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:44344/0 (socket says 172.21.15.40:44344) 2023-09-30T22:26:33.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.860+0000 7f70513f7700 1 -- 172.21.15.40:0/4015792159 learned_addr learned my addr 172.21.15.40:0/4015792159 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:33.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.860+0000 7f7050bf6700 1 --2- 172.21.15.40:0/4015792159 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f704c09d920 0x7f704c12fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:33.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.860+0000 7f7051bf8700 1 --2- 172.21.15.40:0/4015792159 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f704c09e2b0 0x7f704c130180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:33.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.860+0000 7f7051bf8700 1 -- 172.21.15.40:0/4015792159 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f704c09c890 msgr2=0x7f704c12f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:33.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.860+0000 7f7051bf8700 1 --2- 172.21.15.40:0/4015792159 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f704c09c890 0x7f704c12f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:33.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.860+0000 7f7051bf8700 1 -- 172.21.15.40:0/4015792159 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f704c09d920 msgr2=0x7f704c12fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:33.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.860+0000 7f7051bf8700 1 --2- 172.21.15.40:0/4015792159 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f704c09d920 0x7f704c12fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:33.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.860+0000 7f7051bf8700 1 -- 172.21.15.40:0/4015792159 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7048009500 con 0x7f704c09e2b0 2023-09-30T22:26:33.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.860+0000 7f70513f7700 1 --2- 172.21.15.40:0/4015792159 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f704c09c890 0x7f704c12f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:33.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.860+0000 7f7051bf8700 1 --2- 172.21.15.40:0/4015792159 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f704c09e2b0 0x7f704c130180 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f704400c7f0 tx=0x7f704400cb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:33.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.861+0000 7f7041ffb700 1 -- 172.21.15.40:0/4015792159 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7044003e30 con 0x7f704c09e2b0 2023-09-30T22:26:33.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.861+0000 7f7041ffb700 1 -- 172.21.15.40:0/4015792159 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7044005070 con 0x7f704c09e2b0 2023-09-30T22:26:33.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.861+0000 7f705365b700 1 -- 172.21.15.40:0/4015792159 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f704c12d8f0 con 0x7f704c09e2b0 2023-09-30T22:26:33.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.861+0000 7f7041ffb700 1 -- 172.21.15.40:0/4015792159 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7044005420 con 0x7f704c09e2b0 2023-09-30T22:26:33.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.861+0000 7f7041ffb700 1 -- 172.21.15.40:0/4015792159 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7044005580 con 0x7f704c09e2b0 2023-09-30T22:26:33.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.862+0000 7f705365b700 1 -- 172.21.15.40:0/4015792159 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f704c12eb20 con 0x7f704c09e2b0 2023-09-30T22:26:33.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.862+0000 7f7041ffb700 1 -- 172.21.15.40:0/4015792159 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f7044005830 con 0x7f704c09e2b0 2023-09-30T22:26:33.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.863+0000 7f705365b700 1 -- 172.21.15.40:0/4015792159 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f704c06e600 con 0x7f704c09e2b0 2023-09-30T22:26:33.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.869+0000 7f7041ffb700 1 -- 172.21.15.40:0/4015792159 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7044017070 con 0x7f704c09e2b0 2023-09-30T22:26:33.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.938+0000 7fdb0fd65700 1 Processor -- start 2023-09-30T22:26:33.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.938+0000 7fdb0fd65700 1 -- start start 2023-09-30T22:26:33.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.939+0000 7fdb0fd65700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdb0809d920 0x7fdb0809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:33.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.939+0000 7fdb0fd65700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb0809f0f0 0x7fdb0809e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:33.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.939+0000 7fdb0fd65700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb0809f940 con 0x7fdb08133ca0 2023-09-30T22:26:33.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.939+0000 7fdb0fd65700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb0806b4c0 con 0x7fdb0809d920 2023-09-30T22:26:33.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.939+0000 7fdb0fd65700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0809a8f0 con 0x7fdb0809f0f0 2023-09-30T22:26:33.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.939+0000 7fdb0d300700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb0809f0f0 0x7fdb0809e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:33.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.939+0000 7fdb0db01700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdb0809d920 0x7fdb0809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:33.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.939+0000 7fdb0d300700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb0809f0f0 0x7fdb0809e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:37800/0 (socket says 172.21.15.40:37800) 2023-09-30T22:26:33.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.939+0000 7fdb0d300700 1 -- 172.21.15.40:0/605124894 learned_addr learned my addr 172.21.15.40:0/605124894 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:33.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.940+0000 7fdb0db01700 1 -- 172.21.15.40:0/605124894 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb0809f0f0 msgr2=0x7fdb0809e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:33.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.940+0000 7fdb0db01700 1 --2- 172.21.15.40:0/605124894 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb0809f0f0 0x7fdb0809e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:33.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.940+0000 7fdb0db01700 1 -- 172.21.15.40:0/605124894 >> v1:172.21.15.40:6789/0 conn(0x7fdb08133ca0 legacy=0x7fdb08134120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:33.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.940+0000 7fdb0db01700 1 -- 172.21.15.40:0/605124894 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0809f6e0 con 0x7fdb0809d920 2023-09-30T22:26:33.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.940+0000 7fdb0d300700 1 --2- 172.21.15.40:0/605124894 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb0809f0f0 0x7fdb0809e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:33.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.940+0000 7fdb0db01700 1 --2- 172.21.15.40:0/605124894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb0809d920 0x7fdb0809dcf0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fdb04009850 tx=0x7fdb04009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e7f85aab246eb4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:33.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.941+0000 7fdb0caff700 1 -- 172.21.15.40:0/605124894 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb04005e30 con 0x7fdb0809d920 2023-09-30T22:26:33.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.941+0000 7fdb0caff700 1 -- 172.21.15.40:0/605124894 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb04006030 con 0x7fdb0809d920 2023-09-30T22:26:33.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.941+0000 7fdb0caff700 1 -- 172.21.15.40:0/605124894 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb040063c0 con 0x7fdb0809d920 2023-09-30T22:26:33.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.941+0000 7fdb0fd65700 1 -- 172.21.15.40:0/605124894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb0809d920 msgr2=0x7fdb0809dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:33.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.941+0000 7fdb0fd65700 1 --2- 172.21.15.40:0/605124894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb0809d920 0x7fdb0809dcf0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fdb04009850 tx=0x7fdb04009b60 comp rx=0 tx=0).stop 2023-09-30T22:26:33.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.941+0000 7fdb0fd65700 1 -- 172.21.15.40:0/605124894 shutdown_connections 2023-09-30T22:26:33.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.941+0000 7fdb0fd65700 1 --2- 172.21.15.40:0/605124894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb0809d920 0x7fdb0809dcf0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:33.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.941+0000 7fdb0fd65700 1 --2- 172.21.15.40:0/605124894 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb0809f0f0 0x7fdb0809e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:33.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.941+0000 7fdb0fd65700 1 -- 172.21.15.40:0/605124894 >> 172.21.15.40:0/605124894 conn(0x7fdb0809fb20 msgr2=0x7fdb0809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:33.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.942+0000 7fdb0fd65700 1 -- 172.21.15.40:0/605124894 shutdown_connections 2023-09-30T22:26:33.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.942+0000 7fdb0fd65700 1 -- 172.21.15.40:0/605124894 wait complete. 2023-09-30T22:26:33.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.943+0000 7fdb0fd65700 1 Processor -- start 2023-09-30T22:26:33.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.943+0000 7fdb0fd65700 1 -- start start 2023-09-30T22:26:33.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.944+0000 7fdb0fd65700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb08133ca0 0x7fdb081217d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:33.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.944+0000 7fdb0fd65700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb08121d10 0x7fdb08122140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:33.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.944+0000 7fdb0fd65700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb081cc980 0x7fdb081ced60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:33.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.944+0000 7fdb0fd65700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb08122680 con 0x7fdb08133ca0 2023-09-30T22:26:33.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.944+0000 7fdb0fd65700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb080a2a30 con 0x7fdb081cc980 2023-09-30T22:26:33.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.944+0000 7fdb0fd65700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0809c9e0 con 0x7fdb08121d10 2023-09-30T22:26:33.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.944+0000 7fdb0db01700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb08133ca0 0x7fdb081217d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:33.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.944+0000 7fdb0e302700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb081cc980 0x7fdb081ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:33.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.944+0000 7fdb0db01700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb08133ca0 0x7fdb081217d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34204/0 (socket says 172.21.15.40:34204) 2023-09-30T22:26:33.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.944+0000 7fdb0db01700 1 -- 172.21.15.40:0/1452206063 learned_addr learned my addr 172.21.15.40:0/1452206063 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:33.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.944+0000 7fdb0d300700 1 --2- 172.21.15.40:0/1452206063 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb08121d10 0x7fdb08122140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:33.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.944+0000 7fdb0e302700 1 -- 172.21.15.40:0/1452206063 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb08121d10 msgr2=0x7fdb08122140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:33.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.944+0000 7fdb0e302700 1 --2- 172.21.15.40:0/1452206063 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb08121d10 0x7fdb08122140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:33.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.944+0000 7fdb0e302700 1 -- 172.21.15.40:0/1452206063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb08133ca0 msgr2=0x7fdb081217d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:33.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.944+0000 7fdb0e302700 1 --2- 172.21.15.40:0/1452206063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb08133ca0 0x7fdb081217d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:33.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.944+0000 7fdb0e302700 1 -- 172.21.15.40:0/1452206063 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf8009550 con 0x7fdb081cc980 2023-09-30T22:26:33.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.944+0000 7fdb0e302700 1 --2- 172.21.15.40:0/1452206063 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb081cc980 0x7fdb081ced60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdb0000cb90 tx=0x7fdb0000cea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:33.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.945+0000 7fdafe7fc700 1 -- 172.21.15.40:0/1452206063 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb00003c00 con 0x7fdb081cc980 2023-09-30T22:26:33.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.945+0000 7fdafe7fc700 1 -- 172.21.15.40:0/1452206063 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb00003d60 con 0x7fdb081cc980 2023-09-30T22:26:33.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.945+0000 7fdafe7fc700 1 -- 172.21.15.40:0/1452206063 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0000aa80 con 0x7fdb081cc980 2023-09-30T22:26:33.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.945+0000 7fdb0fd65700 1 -- 172.21.15.40:0/1452206063 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb04009430 con 0x7fdb081cc980 2023-09-30T22:26:33.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.945+0000 7fdb0fd65700 1 -- 172.21.15.40:0/1452206063 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb08124a80 con 0x7fdb081cc980 2023-09-30T22:26:33.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.946+0000 7fdb0fd65700 1 -- 172.21.15.40:0/1452206063 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb08062380 con 0x7fdb081cc980 2023-09-30T22:26:33.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.947+0000 7fdafe7fc700 1 -- 172.21.15.40:0/1452206063 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb0000abe0 con 0x7fdb081cc980 2023-09-30T22:26:33.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.947+0000 7fdafe7fc700 1 -- 172.21.15.40:0/1452206063 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fdb00040080 con 0x7fdb081cc980 2023-09-30T22:26:33.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.951+0000 7fdafe7fc700 1 -- 172.21.15.40:0/1452206063 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb00011560 con 0x7fdb081cc980 2023-09-30T22:26:33.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.957+0000 7efed743a700 1 Processor -- start 2023-09-30T22:26:33.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.957+0000 7efed743a700 1 -- start start 2023-09-30T22:26:33.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.958+0000 7efed743a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efed009c890 0x7efed009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:33.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.958+0000 7efed743a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efed009e480 0x7efed013bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:33.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.958+0000 7efed743a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed00a2600 con 0x7efed009d920 2023-09-30T22:26:33.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.958+0000 7efed743a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed00a29d0 con 0x7efed009c890 2023-09-30T22:26:33.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.958+0000 7efed743a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efed009fb40 con 0x7efed009e480 2023-09-30T22:26:33.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.958+0000 7efed59d7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efed009e480 0x7efed013bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:33.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.958+0000 7efed49d5700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7efed009d920 0x7efed009dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46578/0 (socket says 172.21.15.40:46578) 2023-09-30T22:26:33.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.958+0000 7efed49d5700 1 -- 172.21.15.40:0/1940889351 learned_addr learned my addr 172.21.15.40:0/1940889351 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:33.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.958+0000 7efed59d7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efed009e480 0x7efed013bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:44368/0 (socket says 172.21.15.40:44368) 2023-09-30T22:26:33.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.958+0000 7efed51d6700 1 --2- 172.21.15.40:0/1940889351 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efed009c890 0x7efed009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:33.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.958+0000 7efed59d7700 1 -- 172.21.15.40:0/1940889351 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efed009c890 msgr2=0x7efed009cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:33.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.958+0000 7efed59d7700 1 --2- 172.21.15.40:0/1940889351 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efed009c890 0x7efed009cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:33.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.958+0000 7efed59d7700 1 -- 172.21.15.40:0/1940889351 >> v1:172.21.15.40:6789/0 conn(0x7efed009d920 legacy=0x7efed009dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:33.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.958+0000 7efec7fff700 1 -- 172.21.15.40:0/1940889351 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 224396218 0 0) 0x7efed00a2600 con 0x7efed009d920 2023-09-30T22:26:33.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.958+0000 7efed59d7700 1 -- 172.21.15.40:0/1940889351 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed009fed0 con 0x7efed009e480 2023-09-30T22:26:33.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.959+0000 7efed59d7700 1 --2- 172.21.15.40:0/1940889351 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efed009e480 0x7efed013bc20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7efec8009dc0 tx=0x7efec800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93f9e3b7a5c51cdf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:33.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.959+0000 7efec7fff700 1 -- 172.21.15.40:0/1940889351 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec800e070 con 0x7efed009e480 2023-09-30T22:26:33.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.959+0000 7efec7fff700 1 -- 172.21.15.40:0/1940889351 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec800bb20 con 0x7efed009e480 2023-09-30T22:26:33.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.959+0000 7efec7fff700 1 -- 172.21.15.40:0/1940889351 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec8012430 con 0x7efed009e480 2023-09-30T22:26:33.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.959+0000 7efed743a700 1 -- 172.21.15.40:0/1940889351 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efed009e480 msgr2=0x7efed013bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:33.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.959+0000 7efed743a700 1 --2- 172.21.15.40:0/1940889351 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efed009e480 0x7efed013bc20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7efec8009dc0 tx=0x7efec800b330 comp rx=0 tx=0).stop 2023-09-30T22:26:33.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.959+0000 7efed743a700 1 -- 172.21.15.40:0/1940889351 shutdown_connections 2023-09-30T22:26:33.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.959+0000 7efed743a700 1 --2- 172.21.15.40:0/1940889351 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efed009e480 0x7efed013bc20 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:33.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.960+0000 7efed743a700 1 --2- 172.21.15.40:0/1940889351 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efed009c890 0x7efed009cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:33.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.960+0000 7efed743a700 1 -- 172.21.15.40:0/1940889351 >> 172.21.15.40:0/1940889351 conn(0x7efed00a7080 msgr2=0x7efed00a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:33.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.960+0000 7efed743a700 1 -- 172.21.15.40:0/1940889351 shutdown_connections 2023-09-30T22:26:33.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.960+0000 7efed743a700 1 -- 172.21.15.40:0/1940889351 wait complete. 2023-09-30T22:26:33.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.961+0000 7efed743a700 1 Processor -- start 2023-09-30T22:26:33.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.961+0000 7efed743a700 1 -- start start 2023-09-30T22:26:33.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.961+0000 7efed743a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efed009c890 0x7efed012d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:33.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.961+0000 7efed743a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efed009d920 0x7efed012d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:33.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.961+0000 7efed743a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efed009e480 0x7efed012ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:33.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.961+0000 7efed743a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed0130a20 con 0x7efed009c890 2023-09-30T22:26:33.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.961+0000 7efed743a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed0130c00 con 0x7efed009d920 2023-09-30T22:26:33.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.961+0000 7efed743a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efed00a5b40 con 0x7efed009e480 2023-09-30T22:26:33.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.961+0000 7efed49d5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efed009d920 0x7efed012d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:33.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.961+0000 7efed51d6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efed009c890 0x7efed012d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:33.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.961+0000 7efed49d5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efed009d920 0x7efed012d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:37836/0 (socket says 172.21.15.40:37836) 2023-09-30T22:26:33.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.961+0000 7efed49d5700 1 -- 172.21.15.40:0/253460376 learned_addr learned my addr 172.21.15.40:0/253460376 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:33.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.961+0000 7efed59d7700 1 --2- 172.21.15.40:0/253460376 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efed009e480 0x7efed012ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:33.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.962+0000 7efed49d5700 1 -- 172.21.15.40:0/253460376 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efed009e480 msgr2=0x7efed012ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:33.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.962+0000 7efed49d5700 1 --2- 172.21.15.40:0/253460376 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efed009e480 0x7efed012ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:33.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.962+0000 7efed49d5700 1 -- 172.21.15.40:0/253460376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efed009c890 msgr2=0x7efed012d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:33.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.962+0000 7efed49d5700 1 --2- 172.21.15.40:0/253460376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efed009c890 0x7efed012d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:33.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.962+0000 7efed49d5700 1 -- 172.21.15.40:0/253460376 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec8009a70 con 0x7efed009d920 2023-09-30T22:26:33.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.962+0000 7efed49d5700 1 --2- 172.21.15.40:0/253460376 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efed009d920 0x7efed012d880 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7efec0001eb0 tx=0x7efec000c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:33.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.962+0000 7efec5ffb700 1 -- 172.21.15.40:0/253460376 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec0004c80 con 0x7efed009d920 2023-09-30T22:26:33.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.962+0000 7efec5ffb700 1 -- 172.21.15.40:0/253460376 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec0004de0 con 0x7efed009d920 2023-09-30T22:26:33.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.962+0000 7efed743a700 1 -- 172.21.15.40:0/253460376 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efed009ecf0 con 0x7efed009d920 2023-09-30T22:26:33.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.962+0000 7efec5ffb700 1 -- 172.21.15.40:0/253460376 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec0007310 con 0x7efed009d920 2023-09-30T22:26:33.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.962+0000 7efed743a700 1 -- 172.21.15.40:0/253460376 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed012f200 con 0x7efed009d920 2023-09-30T22:26:33.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.963+0000 7efec5ffb700 1 -- 172.21.15.40:0/253460376 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efec0007470 con 0x7efed009d920 2023-09-30T22:26:33.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.963+0000 7efec5ffb700 1 -- 172.21.15.40:0/253460376 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7efec003f310 con 0x7efed009d920 2023-09-30T22:26:33.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.963+0000 7efed743a700 1 -- 172.21.15.40:0/253460376 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed0070610 con 0x7efed009d920 2023-09-30T22:26:33.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:33.968+0000 7efec5ffb700 1 -- 172.21.15.40:0/253460376 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efec00123b0 con 0x7efed009d920 2023-09-30T22:26:34.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.008+0000 7f673ae38700 1 Processor -- start 2023-09-30T22:26:34.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.008+0000 7f673ae38700 1 -- start start 2023-09-30T22:26:34.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.009+0000 7f673ae38700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f673412e590 0x7f673412e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:34.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.009+0000 7f673ae38700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f673412eea0 0x7f673412d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:34.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.009+0000 7f673ae38700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f673409ab70 con 0x7f673412d6d0 2023-09-30T22:26:34.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.009+0000 7f673ae38700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f673409b270 con 0x7f673412e590 2023-09-30T22:26:34.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.009+0000 7f673ae38700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f673409bab0 con 0x7f673412eea0 2023-09-30T22:26:34.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.009+0000 7f6733fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f673412eea0 0x7f673412d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:34.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.009+0000 7f6733fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f673412eea0 0x7f673412d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:44382/0 (socket says 172.21.15.40:44382) 2023-09-30T22:26:34.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.009+0000 7f6733fff700 1 -- 172.21.15.40:0/425291321 learned_addr learned my addr 172.21.15.40:0/425291321 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:34.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.009+0000 7f6738bd4700 1 --2- 172.21.15.40:0/425291321 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f673412e590 0x7f673412e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:34.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.010+0000 7f6733fff700 1 -- 172.21.15.40:0/425291321 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f673412e590 msgr2=0x7f673412e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:34.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.010+0000 7f6733fff700 1 --2- 172.21.15.40:0/425291321 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f673412e590 0x7f673412e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.010+0000 7f6733fff700 1 -- 172.21.15.40:0/425291321 >> v1:172.21.15.40:6789/0 conn(0x7f673412d6d0 legacy=0x7f6734137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.010+0000 7f6733fff700 1 -- 172.21.15.40:0/425291321 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f673409bd70 con 0x7f673412eea0 2023-09-30T22:26:34.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.010+0000 7f6738bd4700 1 --2- 172.21.15.40:0/425291321 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f673412e590 0x7f673412e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:34.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.010+0000 7f6733fff700 1 --2- 172.21.15.40:0/425291321 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f673412eea0 0x7f673412d190 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6720009920 tx=0x7f6720009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2ef268a99ddcedc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:34.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.010+0000 7f67337fe700 1 -- 172.21.15.40:0/425291321 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6720011830 con 0x7f673412eea0 2023-09-30T22:26:34.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.010+0000 7f67337fe700 1 -- 172.21.15.40:0/425291321 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6720011990 con 0x7f673412eea0 2023-09-30T22:26:34.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.010+0000 7f67337fe700 1 -- 172.21.15.40:0/425291321 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6720011d20 con 0x7f673412eea0 2023-09-30T22:26:34.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.011+0000 7f673ae38700 1 -- 172.21.15.40:0/425291321 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f673412eea0 msgr2=0x7f673412d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.011+0000 7f673ae38700 1 --2- 172.21.15.40:0/425291321 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f673412eea0 0x7f673412d190 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6720009920 tx=0x7f6720009c30 comp rx=0 tx=0).stop 2023-09-30T22:26:34.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.011+0000 7f673ae38700 1 -- 172.21.15.40:0/425291321 shutdown_connections 2023-09-30T22:26:34.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.011+0000 7f673ae38700 1 --2- 172.21.15.40:0/425291321 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f673412e590 0x7f673412e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.011+0000 7f673ae38700 1 --2- 172.21.15.40:0/425291321 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f673412eea0 0x7f673412d190 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.011+0000 7f673ae38700 1 -- 172.21.15.40:0/425291321 >> 172.21.15.40:0/425291321 conn(0x7f67340a2a00 msgr2=0x7f67340a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:34.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.011+0000 7f673ae38700 1 -- 172.21.15.40:0/425291321 shutdown_connections 2023-09-30T22:26:34.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.011+0000 7f673ae38700 1 -- 172.21.15.40:0/425291321 wait complete. 2023-09-30T22:26:34.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.012+0000 7f673ae38700 1 Processor -- start 2023-09-30T22:26:34.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.013+0000 7f673ae38700 1 -- start start 2023-09-30T22:26:34.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.013+0000 7f673ae38700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f673412d6d0 0x7f673406eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:34.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.013+0000 7f673ae38700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f673412e590 0x7f673406efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:34.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.013+0000 7f673ae38700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f673412eea0 0x7f673406f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:34.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.013+0000 7f673ae38700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6734070d10 con 0x7f673412d6d0 2023-09-30T22:26:34.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.013+0000 7f673ae38700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6734070070 con 0x7f673412e590 2023-09-30T22:26:34.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.013+0000 7f673ae38700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6734126700 con 0x7f673412eea0 2023-09-30T22:26:34.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.014+0000 7f6733fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f673412e590 0x7f673406efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:34.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.014+0000 7f6733fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f673412e590 0x7f673406efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:37850/0 (socket says 172.21.15.40:37850) 2023-09-30T22:26:34.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.014+0000 7f6733fff700 1 -- 172.21.15.40:0/209002501 learned_addr learned my addr 172.21.15.40:0/209002501 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:34.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.014+0000 7f6738bd4700 1 --2- 172.21.15.40:0/209002501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f673412d6d0 0x7f673406eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:34.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.014+0000 7f67393d5700 1 --2- 172.21.15.40:0/209002501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f673412eea0 0x7f673406f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:34.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.014+0000 7f6733fff700 1 -- 172.21.15.40:0/209002501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f673412eea0 msgr2=0x7f673406f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.014+0000 7f6733fff700 1 --2- 172.21.15.40:0/209002501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f673412eea0 0x7f673406f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.014+0000 7f6733fff700 1 -- 172.21.15.40:0/209002501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f673412d6d0 msgr2=0x7f673406eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.014+0000 7f6733fff700 1 --2- 172.21.15.40:0/209002501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f673412d6d0 0x7f673406eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.014+0000 7f6733fff700 1 -- 172.21.15.40:0/209002501 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67280094a0 con 0x7f673412e590 2023-09-30T22:26:34.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.014+0000 7f6733fff700 1 --2- 172.21.15.40:0/209002501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f673412e590 0x7f673406efe0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f67200098f0 tx=0x7f6720004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:34.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.014+0000 7f67317fa700 1 -- 172.21.15.40:0/209002501 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6720004450 con 0x7f673412e590 2023-09-30T22:26:34.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.015+0000 7f67317fa700 1 -- 172.21.15.40:0/209002501 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67200045b0 con 0x7f673412e590 2023-09-30T22:26:34.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.015+0000 7f67317fa700 1 -- 172.21.15.40:0/209002501 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67200038e0 con 0x7f673412e590 2023-09-30T22:26:34.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.015+0000 7f673ae38700 1 -- 172.21.15.40:0/209002501 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6720009550 con 0x7f673412e590 2023-09-30T22:26:34.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.015+0000 7f673ae38700 1 -- 172.21.15.40:0/209002501 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f673409cdb0 con 0x7f673412e590 2023-09-30T22:26:34.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.016+0000 7f673ae38700 1 -- 172.21.15.40:0/209002501 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6734070b30 con 0x7f673412e590 2023-09-30T22:26:34.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.017+0000 7f67317fa700 1 -- 172.21.15.40:0/209002501 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6720003a40 con 0x7f673412e590 2023-09-30T22:26:34.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.022+0000 7f67317fa700 1 -- 172.21.15.40:0/209002501 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f672000bcb0 con 0x7f673412e590 2023-09-30T22:26:34.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.025+0000 7f67317fa700 1 -- 172.21.15.40:0/209002501 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f672002c7d0 con 0x7f673412e590 2023-09-30T22:26:34.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.105+0000 7f705365b700 1 -- 172.21.15.40:0/4015792159 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f704c0a6170 con 0x7f704c09e2b0 2023-09-30T22:26:34.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.105+0000 7f7041ffb700 1 -- 172.21.15.40:0/4015792159 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7044017030 con 0x7f704c09e2b0 2023-09-30T22:26:34.106 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:34.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.108+0000 7f705365b700 1 -- 172.21.15.40:0/4015792159 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f704c09e2b0 msgr2=0x7f704c130180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.108+0000 7f705365b700 1 --2- 172.21.15.40:0/4015792159 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f704c09e2b0 0x7f704c130180 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f704400c7f0 tx=0x7f704400cb00 comp rx=0 tx=0).stop 2023-09-30T22:26:34.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.108+0000 7f705365b700 1 -- 172.21.15.40:0/4015792159 shutdown_connections 2023-09-30T22:26:34.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.108+0000 7f705365b700 1 --2- 172.21.15.40:0/4015792159 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f704c09c890 0x7f704c12f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.108+0000 7f705365b700 1 --2- 172.21.15.40:0/4015792159 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f704c09e2b0 0x7f704c130180 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.108+0000 7f705365b700 1 --2- 172.21.15.40:0/4015792159 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f704c09d920 0x7f704c12fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.108+0000 7f705365b700 1 -- 172.21.15.40:0/4015792159 >> 172.21.15.40:0/4015792159 conn(0x7f704c0a7080 msgr2=0x7f704c1bb120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:34.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.108+0000 7f705365b700 1 -- 172.21.15.40:0/4015792159 shutdown_connections 2023-09-30T22:26:34.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.108+0000 7f705365b700 1 -- 172.21.15.40:0/4015792159 wait complete. 2023-09-30T22:26:34.126 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:34.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.180+0000 7fdb0fd65700 1 -- 172.21.15.40:0/1452206063 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdb08124cb0 con 0x7fdb081cc980 2023-09-30T22:26:34.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.181+0000 7fdafe7fc700 1 -- 172.21.15.40:0/1452206063 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdb00011380 con 0x7fdb081cc980 2023-09-30T22:26:34.181 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:34.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.184+0000 7fdb0fd65700 1 -- 172.21.15.40:0/1452206063 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb081cc980 msgr2=0x7fdb081ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.184+0000 7fdb0fd65700 1 --2- 172.21.15.40:0/1452206063 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb081cc980 0x7fdb081ced60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdb0000cb90 tx=0x7fdb0000cea0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.184+0000 7fdb0fd65700 1 -- 172.21.15.40:0/1452206063 shutdown_connections 2023-09-30T22:26:34.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.184+0000 7fdb0fd65700 1 --2- 172.21.15.40:0/1452206063 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb081cc980 0x7fdb081ced60 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.184+0000 7fdb0fd65700 1 --2- 172.21.15.40:0/1452206063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb08133ca0 0x7fdb081217d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.184+0000 7fdb0fd65700 1 --2- 172.21.15.40:0/1452206063 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb08121d10 0x7fdb08122140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.184+0000 7fdb0fd65700 1 -- 172.21.15.40:0/1452206063 >> 172.21.15.40:0/1452206063 conn(0x7fdb0809fb20 msgr2=0x7fdb080a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:34.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.184+0000 7fdb0fd65700 1 -- 172.21.15.40:0/1452206063 shutdown_connections 2023-09-30T22:26:34.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.184+0000 7fdb0fd65700 1 -- 172.21.15.40:0/1452206063 wait complete. 2023-09-30T22:26:34.197 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:34.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.197+0000 7efed743a700 1 -- 172.21.15.40:0/253460376 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efed01306a0 con 0x7efed009d920 2023-09-30T22:26:34.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.198+0000 7efec5ffb700 1 -- 172.21.15.40:0/253460376 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efed01306a0 con 0x7efed009d920 2023-09-30T22:26:34.198 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:34.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.200+0000 7efed743a700 1 -- 172.21.15.40:0/253460376 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efed009d920 msgr2=0x7efed012d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.200+0000 7efed743a700 1 --2- 172.21.15.40:0/253460376 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efed009d920 0x7efed012d880 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7efec0001eb0 tx=0x7efec000c800 comp rx=0 tx=0).stop 2023-09-30T22:26:34.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.200+0000 7efed743a700 1 -- 172.21.15.40:0/253460376 shutdown_connections 2023-09-30T22:26:34.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.200+0000 7efed743a700 1 --2- 172.21.15.40:0/253460376 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efed009e480 0x7efed012ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.200+0000 7efed743a700 1 --2- 172.21.15.40:0/253460376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efed009c890 0x7efed012d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.200+0000 7efed743a700 1 --2- 172.21.15.40:0/253460376 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efed009d920 0x7efed012d880 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.200+0000 7efed743a700 1 -- 172.21.15.40:0/253460376 >> 172.21.15.40:0/253460376 conn(0x7efed00a7080 msgr2=0x7efed0133290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:34.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.200+0000 7efed743a700 1 -- 172.21.15.40:0/253460376 shutdown_connections 2023-09-30T22:26:34.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.200+0000 7efed743a700 1 -- 172.21.15.40:0/253460376 wait complete. 2023-09-30T22:26:34.213 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:34.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.260+0000 7f673ae38700 1 -- 172.21.15.40:0/209002501 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6734070b30 con 0x7f673412e590 2023-09-30T22:26:34.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.260+0000 7f67317fa700 1 -- 172.21.15.40:0/209002501 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6734070b30 con 0x7f673412e590 2023-09-30T22:26:34.261 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:34.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.262+0000 7f673ae38700 1 -- 172.21.15.40:0/209002501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f673412e590 msgr2=0x7f673406efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.262+0000 7f673ae38700 1 --2- 172.21.15.40:0/209002501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f673412e590 0x7f673406efe0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f67200098f0 tx=0x7f6720004750 comp rx=0 tx=0).stop 2023-09-30T22:26:34.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.262+0000 7f673ae38700 1 -- 172.21.15.40:0/209002501 shutdown_connections 2023-09-30T22:26:34.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.262+0000 7f673ae38700 1 --2- 172.21.15.40:0/209002501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f673412eea0 0x7f673406f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.262+0000 7f673ae38700 1 --2- 172.21.15.40:0/209002501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f673412d6d0 0x7f673406eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.262+0000 7f673ae38700 1 --2- 172.21.15.40:0/209002501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f673412e590 0x7f673406efe0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.262+0000 7f673ae38700 1 -- 172.21.15.40:0/209002501 >> 172.21.15.40:0/209002501 conn(0x7f67340a2a00 msgr2=0x7f67341309d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:34.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.263+0000 7f673ae38700 1 -- 172.21.15.40:0/209002501 shutdown_connections 2023-09-30T22:26:34.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:34.263+0000 7f673ae38700 1 -- 172.21.15.40:0/209002501 wait complete. 2023-09-30T22:26:34.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:35.127 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:35.198 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:35.213 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:35.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.272+0000 7f4b3b1c8700 1 Processor -- start 2023-09-30T22:26:35.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.273+0000 7f4b3b1c8700 1 -- start start 2023-09-30T22:26:35.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.273+0000 7f4b3b1c8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4b34136bf0 0x7f4b34138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.273+0000 7f4b3b1c8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4b34139510 0x7f4b3413b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.273+0000 7f4b3b1c8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b340a2600 con 0x7f4b3409c890 2023-09-30T22:26:35.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.273+0000 7f4b3b1c8700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b340a29d0 con 0x7f4b34139510 2023-09-30T22:26:35.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.273+0000 7f4b3b1c8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3409fb40 con 0x7f4b34136bf0 2023-09-30T22:26:35.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.273+0000 7f4b38f64700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f4b3409c890 0x7f4b3409cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46604/0 (socket says 172.21.15.40:46604) 2023-09-30T22:26:35.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.273+0000 7f4b38f64700 1 -- 172.21.15.40:0/3962600723 learned_addr learned my addr 172.21.15.40:0/3962600723 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:35.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.273+0000 7f4b39765700 1 --2- 172.21.15.40:0/3962600723 >> v2:172.21.15.40:3300/0 conn(0x7f4b34139510 0x7f4b3413b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.273+0000 7f4b33fff700 1 --2- 172.21.15.40:0/3962600723 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4b34136bf0 0x7f4b34138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.274+0000 7f4b39765700 1 -- 172.21.15.40:0/3962600723 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4b34136bf0 msgr2=0x7f4b34138fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:35.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.274+0000 7f4b39765700 1 --2- 172.21.15.40:0/3962600723 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4b34136bf0 0x7f4b34138fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.274+0000 7f4b39765700 1 -- 172.21.15.40:0/3962600723 >> v1:172.21.15.40:6789/0 conn(0x7f4b3409c890 legacy=0x7f4b3409cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.274+0000 7f4b39765700 1 -- 172.21.15.40:0/3962600723 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3409d370 con 0x7f4b34139510 2023-09-30T22:26:35.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.274+0000 7f4b39765700 1 --2- 172.21.15.40:0/3962600723 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b34139510 0x7f4b3413b8f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c009d90 tx=0x7f4b2c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42a0f854219c0f39 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:35.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.274+0000 7f4b337fe700 1 -- 172.21.15.40:0/3962600723 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c00e070 con 0x7f4b34139510 2023-09-30T22:26:35.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.274+0000 7f4b337fe700 1 -- 172.21.15.40:0/3962600723 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2c00bb20 con 0x7f4b34139510 2023-09-30T22:26:35.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.274+0000 7f4b337fe700 1 -- 172.21.15.40:0/3962600723 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c012430 con 0x7f4b34139510 2023-09-30T22:26:35.276 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:35.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.275+0000 7f4b3b1c8700 1 -- 172.21.15.40:0/3962600723 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b34139510 msgr2=0x7f4b3413b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.275+0000 7f4b3b1c8700 1 --2- 172.21.15.40:0/3962600723 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b34139510 0x7f4b3413b8f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c009d90 tx=0x7f4b2c00b330 comp rx=0 tx=0).stop 2023-09-30T22:26:35.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.275+0000 7f4b3b1c8700 1 -- 172.21.15.40:0/3962600723 shutdown_connections 2023-09-30T22:26:35.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.275+0000 7f4b3b1c8700 1 --2- 172.21.15.40:0/3962600723 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b34139510 0x7f4b3413b8f0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.275+0000 7f4b3b1c8700 1 --2- 172.21.15.40:0/3962600723 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4b34136bf0 0x7f4b34138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.275+0000 7f4b3b1c8700 1 -- 172.21.15.40:0/3962600723 >> 172.21.15.40:0/3962600723 conn(0x7f4b340a7080 msgr2=0x7f4b340a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:35.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.275+0000 7f4b3b1c8700 1 -- 172.21.15.40:0/3962600723 shutdown_connections 2023-09-30T22:26:35.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.275+0000 7f4b3b1c8700 1 -- 172.21.15.40:0/3962600723 wait complete. 2023-09-30T22:26:35.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.276+0000 7f4b3b1c8700 1 Processor -- start 2023-09-30T22:26:35.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.276+0000 7f4b3b1c8700 1 -- start start 2023-09-30T22:26:35.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.277+0000 7f4b3b1c8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4b3409c890 0x7f4b3406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.277+0000 7f4b3b1c8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4b34136bf0 0x7f4b3406f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.277+0000 7f4b3b1c8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b34139510 0x7f4b3406fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.277+0000 7f4b3b1c8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b340a5eb0 con 0x7f4b34139510 2023-09-30T22:26:35.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.277+0000 7f4b3b1c8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3412c2e0 con 0x7f4b3409c890 2023-09-30T22:26:35.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.277+0000 7f4b3b1c8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b34070df0 con 0x7f4b34136bf0 2023-09-30T22:26:35.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.277+0000 7f4b33fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4b34136bf0 0x7f4b3406f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.277+0000 7f4b39765700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b34139510 0x7f4b3406fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.277+0000 7f4b33fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4b34136bf0 0x7f4b3406f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:44406/0 (socket says 172.21.15.40:44406) 2023-09-30T22:26:35.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.277+0000 7f4b33fff700 1 -- 172.21.15.40:0/1518892578 learned_addr learned my addr 172.21.15.40:0/1518892578 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:35.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.277+0000 7f4b38f64700 1 --2- 172.21.15.40:0/1518892578 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4b3409c890 0x7f4b3406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.277+0000 7f4b33fff700 1 -- 172.21.15.40:0/1518892578 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4b3409c890 msgr2=0x7f4b3406f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.277+0000 7f4b33fff700 1 --2- 172.21.15.40:0/1518892578 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4b3409c890 0x7f4b3406f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.277+0000 7f4b33fff700 1 -- 172.21.15.40:0/1518892578 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b34139510 msgr2=0x7f4b3406fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.277+0000 7f4b33fff700 1 --2- 172.21.15.40:0/1518892578 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b34139510 0x7f4b3406fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.277+0000 7f4b33fff700 1 -- 172.21.15.40:0/1518892578 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2c009a70 con 0x7f4b34136bf0 2023-09-30T22:26:35.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.277+0000 7f4b39765700 1 --2- 172.21.15.40:0/1518892578 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b34139510 0x7f4b3406fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:35.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.277+0000 7f4b33fff700 1 --2- 172.21.15.40:0/1518892578 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4b34136bf0 0x7f4b3406f660 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4b2000e9b0 tx=0x7f4b2000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:35.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.278+0000 7f4b317fa700 1 -- 172.21.15.40:0/1518892578 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b20009710 con 0x7f4b34136bf0 2023-09-30T22:26:35.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.278+0000 7f4b317fa700 1 -- 172.21.15.40:0/1518892578 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2000ee50 con 0x7f4b34136bf0 2023-09-30T22:26:35.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.278+0000 7f4b3b1c8700 1 -- 172.21.15.40:0/1518892578 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b3412bb60 con 0x7f4b34136bf0 2023-09-30T22:26:35.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.278+0000 7f4b317fa700 1 -- 172.21.15.40:0/1518892578 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2000ca50 con 0x7f4b34136bf0 2023-09-30T22:26:35.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.278+0000 7f4b3b1c8700 1 -- 172.21.15.40:0/1518892578 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b340714d0 con 0x7f4b34136bf0 2023-09-30T22:26:35.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.279+0000 7f4b3b1c8700 1 -- 172.21.15.40:0/1518892578 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b34062380 con 0x7f4b34136bf0 2023-09-30T22:26:35.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.279+0000 7f4b317fa700 1 -- 172.21.15.40:0/1518892578 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4b2000cbb0 con 0x7f4b34136bf0 2023-09-30T22:26:35.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.280+0000 7f4b317fa700 1 -- 172.21.15.40:0/1518892578 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4b2003f8b0 con 0x7f4b34136bf0 2023-09-30T22:26:35.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.288+0000 7f4b317fa700 1 -- 172.21.15.40:0/1518892578 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b2001be10 con 0x7f4b34136bf0 2023-09-30T22:26:35.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.340+0000 7f8a5062f700 1 Processor -- start 2023-09-30T22:26:35.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.340+0000 7f8a5062f700 1 -- start start 2023-09-30T22:26:35.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.341+0000 7f8a5062f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8a4809f0f0 0x7f8a48138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.341+0000 7f8a5062f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a4809e400 0x7f8a4813b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.341+0000 7f8a5062f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a4809f940 con 0x7f8a4809d920 2023-09-30T22:26:35.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.341+0000 7f8a5062f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a4806b4c0 con 0x7f8a4809f0f0 2023-09-30T22:26:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.341+0000 7f8a5062f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4809a8f0 con 0x7f8a4809e400 2023-09-30T22:26:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.341+0000 7f8a4dbca700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8a4809f0f0 0x7f8a48138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.341+0000 7f8a4dbca700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8a4809f0f0 0x7f8a48138ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34264/0 (socket says 172.21.15.40:34264) 2023-09-30T22:26:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.341+0000 7f8a4dbca700 1 -- 172.21.15.40:0/507605609 learned_addr learned my addr 172.21.15.40:0/507605609 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.341+0000 7f8a4ebcc700 1 --2- 172.21.15.40:0/507605609 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a4809e400 0x7f8a4813b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.341+0000 7f8a4dbca700 1 -- 172.21.15.40:0/507605609 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a4809e400 msgr2=0x7f8a4813b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.341+0000 7f8a4dbca700 1 --2- 172.21.15.40:0/507605609 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a4809e400 0x7f8a4813b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.341+0000 7f8a4dbca700 1 -- 172.21.15.40:0/507605609 >> v1:172.21.15.40:6789/0 conn(0x7f8a4809d920 legacy=0x7f8a4809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.341+0000 7f8a4dbca700 1 -- 172.21.15.40:0/507605609 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4809f6e0 con 0x7f8a4809f0f0 2023-09-30T22:26:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.341+0000 7f8a4dbca700 1 --2- 172.21.15.40:0/507605609 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a4809f0f0 0x7f8a48138ee0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8a380098f0 tx=0x7f8a38009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e16492b91e2acdcf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.342+0000 7f8a4d3c9700 1 -- 172.21.15.40:0/507605609 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a38004230 con 0x7f8a4809f0f0 2023-09-30T22:26:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.342+0000 7f8a4d3c9700 1 -- 172.21.15.40:0/507605609 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a38004390 con 0x7f8a4809f0f0 2023-09-30T22:26:35.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.342+0000 7f8a4d3c9700 1 -- 172.21.15.40:0/507605609 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a380036a0 con 0x7f8a4809f0f0 2023-09-30T22:26:35.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.343+0000 7f8a5062f700 1 -- 172.21.15.40:0/507605609 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a4809f0f0 msgr2=0x7f8a48138ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.343+0000 7f8a5062f700 1 --2- 172.21.15.40:0/507605609 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a4809f0f0 0x7f8a48138ee0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8a380098f0 tx=0x7f8a38009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:35.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.343+0000 7f8a5062f700 1 -- 172.21.15.40:0/507605609 shutdown_connections 2023-09-30T22:26:35.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.343+0000 7f8a5062f700 1 --2- 172.21.15.40:0/507605609 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a4809e400 0x7f8a4813b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.343+0000 7f8a5062f700 1 --2- 172.21.15.40:0/507605609 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a4809f0f0 0x7f8a48138ee0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.343+0000 7f8a5062f700 1 -- 172.21.15.40:0/507605609 >> 172.21.15.40:0/507605609 conn(0x7f8a4809fb20 msgr2=0x7f8a4809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:35.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.343+0000 7f8a5062f700 1 -- 172.21.15.40:0/507605609 shutdown_connections 2023-09-30T22:26:35.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.343+0000 7f8a5062f700 1 -- 172.21.15.40:0/507605609 wait complete. 2023-09-30T22:26:35.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.344+0000 7f8a5062f700 1 Processor -- start 2023-09-30T22:26:35.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.344+0000 7f8a5062f700 1 -- start start 2023-09-30T22:26:35.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.345+0000 7f8a5062f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a4809d920 0x7f8a4811e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.345+0000 7f8a5062f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a4809e400 0x7f8a4811ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.345+0000 7f8a5062f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a4811f350 0x7f8a481c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.345+0000 7f8a5062f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a48122400 con 0x7f8a4811f350 2023-09-30T22:26:35.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.345+0000 7f8a5062f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a480a3460 con 0x7f8a4809d920 2023-09-30T22:26:35.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.345+0000 7f8a5062f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4809c9e0 con 0x7f8a4809e400 2023-09-30T22:26:35.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.345+0000 7f8a4e3cb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a4809d920 0x7f8a4811e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.345+0000 7f8a4e3cb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a4809d920 0x7f8a4811e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:37872/0 (socket says 172.21.15.40:37872) 2023-09-30T22:26:35.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.345+0000 7f8a4e3cb700 1 -- 172.21.15.40:0/444414459 learned_addr learned my addr 172.21.15.40:0/444414459 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:35.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.345+0000 7f8a4dbca700 1 --2- 172.21.15.40:0/444414459 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a4809e400 0x7f8a4811ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.345+0000 7f8a4ebcc700 1 --2- 172.21.15.40:0/444414459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a4811f350 0x7f8a481c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.345+0000 7f8a4e3cb700 1 -- 172.21.15.40:0/444414459 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a4809e400 msgr2=0x7f8a4811ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.345+0000 7f8a4e3cb700 1 --2- 172.21.15.40:0/444414459 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a4809e400 0x7f8a4811ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.345+0000 7f8a4e3cb700 1 -- 172.21.15.40:0/444414459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a4811f350 msgr2=0x7f8a481c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.345+0000 7f8a4e3cb700 1 --2- 172.21.15.40:0/444414459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a4811f350 0x7f8a481c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.345+0000 7f8a4e3cb700 1 -- 172.21.15.40:0/444414459 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a38009550 con 0x7f8a4809d920 2023-09-30T22:26:35.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.346+0000 7f8a4e3cb700 1 --2- 172.21.15.40:0/444414459 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a4809d920 0x7f8a4811e8d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8a4400c450 tx=0x7f8a4400c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:35.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.346+0000 7f8a3effd700 1 -- 172.21.15.40:0/444414459 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a440054e0 con 0x7f8a4809d920 2023-09-30T22:26:35.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.346+0000 7f8a3effd700 1 -- 172.21.15.40:0/444414459 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4400ce20 con 0x7f8a4809d920 2023-09-30T22:26:35.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.346+0000 7f8a5062f700 1 -- 172.21.15.40:0/444414459 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a4811fcc0 con 0x7f8a4809d920 2023-09-30T22:26:35.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.346+0000 7f8a3effd700 1 -- 172.21.15.40:0/444414459 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a440038c0 con 0x7f8a4809d920 2023-09-30T22:26:35.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.346+0000 7f8a5062f700 1 -- 172.21.15.40:0/444414459 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a48122080 con 0x7f8a4809d920 2023-09-30T22:26:35.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.347+0000 7f8a5062f700 1 -- 172.21.15.40:0/444414459 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a48121cd0 con 0x7f8a4809d920 2023-09-30T22:26:35.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.347+0000 7f8a3effd700 1 -- 172.21.15.40:0/444414459 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8a44003a20 con 0x7f8a4809d920 2023-09-30T22:26:35.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.347+0000 7f8a3effd700 1 -- 172.21.15.40:0/444414459 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f8a4403e6c0 con 0x7f8a4809d920 2023-09-30T22:26:35.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.356+0000 7f8a3effd700 1 -- 172.21.15.40:0/444414459 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8a44018cd0 con 0x7f8a4809d920 2023-09-30T22:26:35.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.397+0000 7fbdee32e700 1 Processor -- start 2023-09-30T22:26:35.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.397+0000 7fbdee32e700 1 -- start start 2023-09-30T22:26:35.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.397+0000 7fbdee32e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbde809d920 0x7fbde809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.397+0000 7fbdee32e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbde809f0f0 0x7fbde809e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.397+0000 7fbdee32e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbde809f940 con 0x7fbde8133ca0 2023-09-30T22:26:35.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.397+0000 7fbdee32e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbde806b4c0 con 0x7fbde809d920 2023-09-30T22:26:35.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.397+0000 7fbdee32e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbde809a8f0 con 0x7fbde809f0f0 2023-09-30T22:26:35.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.397+0000 7fbde77fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbde809f0f0 0x7fbde809e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.398+0000 7fbde77fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbde809f0f0 0x7fbde809e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:37878/0 (socket says 172.21.15.40:37878) 2023-09-30T22:26:35.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.398+0000 7fbde7fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbde809d920 0x7fbde809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.398+0000 7fbde77fe700 1 -- 172.21.15.40:0/4026854953 learned_addr learned my addr 172.21.15.40:0/4026854953 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:35.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.398+0000 7fbde7fff700 1 -- 172.21.15.40:0/4026854953 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbde809f0f0 msgr2=0x7fbde809e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:35.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.398+0000 7fbde7fff700 1 --2- 172.21.15.40:0/4026854953 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbde809f0f0 0x7fbde809e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.398+0000 7fbde7fff700 1 -- 172.21.15.40:0/4026854953 >> v1:172.21.15.40:6789/0 conn(0x7fbde8133ca0 legacy=0x7fbde8134120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.398+0000 7fbde7fff700 1 -- 172.21.15.40:0/4026854953 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde809f6e0 con 0x7fbde809d920 2023-09-30T22:26:35.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.398+0000 7fbde77fe700 1 --2- 172.21.15.40:0/4026854953 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbde809f0f0 0x7fbde809e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:35.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.398+0000 7fbde7fff700 1 --2- 172.21.15.40:0/4026854953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbde809d920 0x7fbde809dcf0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8009850 tx=0x7fbdd8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b236b01583b01c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:35.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.398+0000 7fbde6ffd700 1 -- 172.21.15.40:0/4026854953 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd8005e30 con 0x7fbde809d920 2023-09-30T22:26:35.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.398+0000 7fbde6ffd700 1 -- 172.21.15.40:0/4026854953 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd8006030 con 0x7fbde809d920 2023-09-30T22:26:35.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.398+0000 7fbde6ffd700 1 -- 172.21.15.40:0/4026854953 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd80063c0 con 0x7fbde809d920 2023-09-30T22:26:35.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.399+0000 7fbdee32e700 1 -- 172.21.15.40:0/4026854953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbde809d920 msgr2=0x7fbde809dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.399+0000 7fbdee32e700 1 --2- 172.21.15.40:0/4026854953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbde809d920 0x7fbde809dcf0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8009850 tx=0x7fbdd8009b60 comp rx=0 tx=0).stop 2023-09-30T22:26:35.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.399+0000 7fbdee32e700 1 -- 172.21.15.40:0/4026854953 shutdown_connections 2023-09-30T22:26:35.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.399+0000 7fbdee32e700 1 --2- 172.21.15.40:0/4026854953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbde809d920 0x7fbde809dcf0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.399+0000 7fbdee32e700 1 --2- 172.21.15.40:0/4026854953 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbde809f0f0 0x7fbde809e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.399+0000 7fbdee32e700 1 -- 172.21.15.40:0/4026854953 >> 172.21.15.40:0/4026854953 conn(0x7fbde809fb20 msgr2=0x7fbde809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:35.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.399+0000 7fbdee32e700 1 -- 172.21.15.40:0/4026854953 shutdown_connections 2023-09-30T22:26:35.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.399+0000 7fbdee32e700 1 -- 172.21.15.40:0/4026854953 wait complete. 2023-09-30T22:26:35.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.400+0000 7fbdee32e700 1 Processor -- start 2023-09-30T22:26:35.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.400+0000 7fbdee32e700 1 -- start start 2023-09-30T22:26:35.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.401+0000 7fbdee32e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbde809d920 0x7fbde811eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.401+0000 7fbdee32e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbde8133ca0 0x7fbde811f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.401+0000 7fbdee32e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbde80a18b0 0x7fbde811f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.401+0000 7fbdee32e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde81200e0 con 0x7fbde809d920 2023-09-30T22:26:35.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.401+0000 7fbdee32e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbde8121310 con 0x7fbde8133ca0 2023-09-30T22:26:35.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.401+0000 7fbdee32e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbde809c9e0 con 0x7fbde80a18b0 2023-09-30T22:26:35.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.401+0000 7fbde7fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbde809d920 0x7fbde811eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.401+0000 7fbde7fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbde809d920 0x7fbde811eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34294/0 (socket says 172.21.15.40:34294) 2023-09-30T22:26:35.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.401+0000 7fbde7fff700 1 -- 172.21.15.40:0/85791691 learned_addr learned my addr 172.21.15.40:0/85791691 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:35.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.401+0000 7fbde77fe700 1 --2- 172.21.15.40:0/85791691 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbde8133ca0 0x7fbde811f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.401+0000 7fbdec8cb700 1 --2- 172.21.15.40:0/85791691 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbde80a18b0 0x7fbde811f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.401+0000 7fbde77fe700 1 -- 172.21.15.40:0/85791691 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbde80a18b0 msgr2=0x7fbde811f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.401+0000 7fbde77fe700 1 --2- 172.21.15.40:0/85791691 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbde80a18b0 0x7fbde811f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.401+0000 7fbde77fe700 1 -- 172.21.15.40:0/85791691 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbde809d920 msgr2=0x7fbde811eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.401+0000 7fbde77fe700 1 --2- 172.21.15.40:0/85791691 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbde809d920 0x7fbde811eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.401+0000 7fbde77fe700 1 -- 172.21.15.40:0/85791691 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbddc009550 con 0x7fbde8133ca0 2023-09-30T22:26:35.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.402+0000 7fbde77fe700 1 --2- 172.21.15.40:0/85791691 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbde8133ca0 0x7fbde811f0d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbddc00e9a0 tx=0x7fbddc00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:35.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.402+0000 7fbde4ff9700 1 -- 172.21.15.40:0/85791691 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbddc004030 con 0x7fbde8133ca0 2023-09-30T22:26:35.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.402+0000 7fbde4ff9700 1 -- 172.21.15.40:0/85791691 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbddc004190 con 0x7fbde8133ca0 2023-09-30T22:26:35.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.402+0000 7fbdee32e700 1 -- 172.21.15.40:0/85791691 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd8009430 con 0x7fbde8133ca0 2023-09-30T22:26:35.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.402+0000 7fbde4ff9700 1 -- 172.21.15.40:0/85791691 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbddc004520 con 0x7fbde8133ca0 2023-09-30T22:26:35.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.402+0000 7fbdee32e700 1 -- 172.21.15.40:0/85791691 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbde8120680 con 0x7fbde8133ca0 2023-09-30T22:26:35.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.403+0000 7fbde4ff9700 1 -- 172.21.15.40:0/85791691 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbddc00c850 con 0x7fbde8133ca0 2023-09-30T22:26:35.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.403+0000 7fbdee32e700 1 -- 172.21.15.40:0/85791691 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbde80a27f0 con 0x7fbde8133ca0 2023-09-30T22:26:35.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.403+0000 7fbde4ff9700 1 -- 172.21.15.40:0/85791691 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fbddc03f920 con 0x7fbde8133ca0 2023-09-30T22:26:35.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.412+0000 7fbde4ff9700 1 -- 172.21.15.40:0/85791691 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbddc0036a0 con 0x7fbde8133ca0 2023-09-30T22:26:35.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.415+0000 7f3e6569d700 1 Processor -- start 2023-09-30T22:26:35.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.415+0000 7f3e6569d700 1 -- start start 2023-09-30T22:26:35.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.416+0000 7f3e6569d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3e6009d920 0x7f3e6009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.416+0000 7f3e6569d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e6009f0f0 0x7f3e6009e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.416+0000 7f3e6569d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e6009f940 con 0x7f3e60133ca0 2023-09-30T22:26:35.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.416+0000 7f3e6569d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e6006b4c0 con 0x7f3e6009d920 2023-09-30T22:26:35.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.416+0000 7f3e6569d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6009a8f0 con 0x7f3e6009f0f0 2023-09-30T22:26:35.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.416+0000 7f3e5effd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3e6009d920 0x7f3e6009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.416+0000 7f3e5effd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3e6009d920 0x7f3e6009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34306/0 (socket says 172.21.15.40:34306) 2023-09-30T22:26:35.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.416+0000 7f3e5effd700 1 -- 172.21.15.40:0/2080303293 learned_addr learned my addr 172.21.15.40:0/2080303293 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:35.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.416+0000 7f3e5effd700 1 -- 172.21.15.40:0/2080303293 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e6009f0f0 msgr2=0x7f3e6009e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:35.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.416+0000 7f3e5effd700 1 --2- 172.21.15.40:0/2080303293 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e6009f0f0 0x7f3e6009e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.416+0000 7f3e5effd700 1 -- 172.21.15.40:0/2080303293 >> v1:172.21.15.40:6789/0 conn(0x7f3e60133ca0 legacy=0x7f3e60134120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.416+0000 7f3e5effd700 1 -- 172.21.15.40:0/2080303293 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e6009f6e0 con 0x7f3e6009d920 2023-09-30T22:26:35.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.417+0000 7f3e5effd700 1 --2- 172.21.15.40:0/2080303293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e6009d920 0x7f3e6009dcf0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f3e500098f0 tx=0x7f3e50009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a38a960cb0da7a0e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:35.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.417+0000 7f3e5dffb700 1 -- 172.21.15.40:0/2080303293 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e50005e30 con 0x7f3e6009d920 2023-09-30T22:26:35.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.417+0000 7f3e5dffb700 1 -- 172.21.15.40:0/2080303293 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e50004030 con 0x7f3e6009d920 2023-09-30T22:26:35.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.417+0000 7f3e5dffb700 1 -- 172.21.15.40:0/2080303293 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e500043e0 con 0x7f3e6009d920 2023-09-30T22:26:35.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.417+0000 7f3e6569d700 1 -- 172.21.15.40:0/2080303293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e6009d920 msgr2=0x7f3e6009dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.417+0000 7f3e6569d700 1 --2- 172.21.15.40:0/2080303293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e6009d920 0x7f3e6009dcf0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f3e500098f0 tx=0x7f3e50009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:35.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.417+0000 7f3e6569d700 1 -- 172.21.15.40:0/2080303293 shutdown_connections 2023-09-30T22:26:35.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.417+0000 7f3e6569d700 1 --2- 172.21.15.40:0/2080303293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e6009d920 0x7f3e6009dcf0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.417+0000 7f3e6569d700 1 --2- 172.21.15.40:0/2080303293 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e6009f0f0 0x7f3e6009e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.417+0000 7f3e6569d700 1 -- 172.21.15.40:0/2080303293 >> 172.21.15.40:0/2080303293 conn(0x7f3e6009fb20 msgr2=0x7f3e6009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:35.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.418+0000 7f3e6569d700 1 -- 172.21.15.40:0/2080303293 shutdown_connections 2023-09-30T22:26:35.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.418+0000 7f3e6569d700 1 -- 172.21.15.40:0/2080303293 wait complete. 2023-09-30T22:26:35.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.419+0000 7f3e6569d700 1 Processor -- start 2023-09-30T22:26:35.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.419+0000 7f3e6569d700 1 -- start start 2023-09-30T22:26:35.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.419+0000 7f3e6569d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e6009d920 0x7f3e6011e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.419+0000 7f3e6569d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e60133ca0 0x7f3e6011e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.419+0000 7f3e6569d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e60122440 0x7f3e6011eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.419+0000 7f3e6569d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6011f8b0 con 0x7f3e6009d920 2023-09-30T22:26:35.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.419+0000 7f3e6569d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e60120030 con 0x7f3e60133ca0 2023-09-30T22:26:35.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.419+0000 7f3e6569d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e60120650 con 0x7f3e60122440 2023-09-30T22:26:35.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.419+0000 7f3e5effd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e6009d920 0x7f3e6011e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.419+0000 7f3e5f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e60122440 0x7f3e6011eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.419+0000 7f3e5effd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e6009d920 0x7f3e6011e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34308/0 (socket says 172.21.15.40:34308) 2023-09-30T22:26:35.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.419+0000 7f3e5effd700 1 -- 172.21.15.40:0/1415181134 learned_addr learned my addr 172.21.15.40:0/1415181134 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:35.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.420+0000 7f3e5effd700 1 -- 172.21.15.40:0/1415181134 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e60122440 msgr2=0x7f3e6011eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.420+0000 7f3e5effd700 1 --2- 172.21.15.40:0/1415181134 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e60122440 0x7f3e6011eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.420+0000 7f3e5effd700 1 -- 172.21.15.40:0/1415181134 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e60133ca0 msgr2=0x7f3e6011e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.420+0000 7f3e5effd700 1 --2- 172.21.15.40:0/1415181134 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e60133ca0 0x7f3e6011e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.420+0000 7f3e5effd700 1 -- 172.21.15.40:0/1415181134 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e50009500 con 0x7f3e6009d920 2023-09-30T22:26:35.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.420+0000 7f3e5effd700 1 --2- 172.21.15.40:0/1415181134 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e6009d920 0x7f3e6011e420 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f3e6009aff0 tx=0x7f3e50004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:35.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.420+0000 7f3e477fe700 1 -- 172.21.15.40:0/1415181134 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e500045e0 con 0x7f3e6009d920 2023-09-30T22:26:35.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.420+0000 7f3e477fe700 1 -- 172.21.15.40:0/1415181134 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e50003d90 con 0x7f3e6009d920 2023-09-30T22:26:35.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.420+0000 7f3e6569d700 1 -- 172.21.15.40:0/1415181134 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e60121280 con 0x7f3e6009d920 2023-09-30T22:26:35.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.420+0000 7f3e477fe700 1 -- 172.21.15.40:0/1415181134 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e50011660 con 0x7f3e6009d920 2023-09-30T22:26:35.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.420+0000 7f3e6569d700 1 -- 172.21.15.40:0/1415181134 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e600a29a0 con 0x7f3e6009d920 2023-09-30T22:26:35.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.421+0000 7f3e6569d700 1 -- 172.21.15.40:0/1415181134 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e60062380 con 0x7f3e6009d920 2023-09-30T22:26:35.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.422+0000 7f3e477fe700 1 -- 172.21.15.40:0/1415181134 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3e50018070 con 0x7f3e6009d920 2023-09-30T22:26:35.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.422+0000 7f3e477fe700 1 -- 172.21.15.40:0/1415181134 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3e50040540 con 0x7f3e6009d920 2023-09-30T22:26:35.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.430+0000 7f3e477fe700 1 -- 172.21.15.40:0/1415181134 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3e500117c0 con 0x7f3e6009d920 2023-09-30T22:26:35.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.499+0000 7f4b3b1c8700 1 -- 172.21.15.40:0/1518892578 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4b34074620 con 0x7f4b34136bf0 2023-09-30T22:26:35.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.499+0000 7f4b317fa700 1 -- 172.21.15.40:0/1518892578 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4b20021030 con 0x7f4b34136bf0 2023-09-30T22:26:35.500 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:35.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.502+0000 7f4b3b1c8700 1 -- 172.21.15.40:0/1518892578 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4b34136bf0 msgr2=0x7f4b3406f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.502+0000 7f4b3b1c8700 1 --2- 172.21.15.40:0/1518892578 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4b34136bf0 0x7f4b3406f660 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4b2000e9b0 tx=0x7f4b2000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.502+0000 7f4b3b1c8700 1 -- 172.21.15.40:0/1518892578 shutdown_connections 2023-09-30T22:26:35.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.502+0000 7f4b3b1c8700 1 --2- 172.21.15.40:0/1518892578 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b34139510 0x7f4b3406fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.502+0000 7f4b3b1c8700 1 --2- 172.21.15.40:0/1518892578 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4b3409c890 0x7f4b3406f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.502+0000 7f4b3b1c8700 1 --2- 172.21.15.40:0/1518892578 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4b34136bf0 0x7f4b3406f660 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.502+0000 7f4b3b1c8700 1 -- 172.21.15.40:0/1518892578 >> 172.21.15.40:0/1518892578 conn(0x7f4b340a7080 msgr2=0x7f4b34135ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:35.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.502+0000 7f4b3b1c8700 1 -- 172.21.15.40:0/1518892578 shutdown_connections 2023-09-30T22:26:35.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.502+0000 7f4b3b1c8700 1 -- 172.21.15.40:0/1518892578 wait complete. 2023-09-30T22:26:35.519 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:35.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.585+0000 7f8a5062f700 1 -- 172.21.15.40:0/444414459 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8a48062380 con 0x7f8a4809d920 2023-09-30T22:26:35.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.585+0000 7f8a3effd700 1 -- 172.21.15.40:0/444414459 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8a44017070 con 0x7f8a4809d920 2023-09-30T22:26:35.586 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:35.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.588+0000 7f8a5062f700 1 -- 172.21.15.40:0/444414459 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a4809d920 msgr2=0x7f8a4811e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.588+0000 7f8a5062f700 1 --2- 172.21.15.40:0/444414459 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a4809d920 0x7f8a4811e8d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8a4400c450 tx=0x7f8a4400c760 comp rx=0 tx=0).stop 2023-09-30T22:26:35.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.588+0000 7f8a5062f700 1 -- 172.21.15.40:0/444414459 shutdown_connections 2023-09-30T22:26:35.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.588+0000 7f8a5062f700 1 --2- 172.21.15.40:0/444414459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a4811f350 0x7f8a481c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.588+0000 7f8a5062f700 1 --2- 172.21.15.40:0/444414459 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a4809d920 0x7f8a4811e8d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.588+0000 7f8a5062f700 1 --2- 172.21.15.40:0/444414459 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a4809e400 0x7f8a4811ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.588+0000 7f8a5062f700 1 -- 172.21.15.40:0/444414459 >> 172.21.15.40:0/444414459 conn(0x7f8a4809fb20 msgr2=0x7f8a48070990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:35.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.588+0000 7f8a5062f700 1 -- 172.21.15.40:0/444414459 shutdown_connections 2023-09-30T22:26:35.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.588+0000 7f8a5062f700 1 -- 172.21.15.40:0/444414459 wait complete. 2023-09-30T22:26:35.606 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:35.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.621+0000 7fbdee32e700 1 -- 172.21.15.40:0/85791691 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbde8062380 con 0x7fbde8133ca0 2023-09-30T22:26:35.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.622+0000 7fbde4ff9700 1 -- 172.21.15.40:0/85791691 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbddc013e60 con 0x7fbde8133ca0 2023-09-30T22:26:35.622 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:35.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.624+0000 7fbdee32e700 1 -- 172.21.15.40:0/85791691 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbde8133ca0 msgr2=0x7fbde811f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.624+0000 7fbdee32e700 1 --2- 172.21.15.40:0/85791691 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbde8133ca0 0x7fbde811f0d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbddc00e9a0 tx=0x7fbddc00ecb0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.624+0000 7fbdee32e700 1 -- 172.21.15.40:0/85791691 shutdown_connections 2023-09-30T22:26:35.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.624+0000 7fbdee32e700 1 --2- 172.21.15.40:0/85791691 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbde80a18b0 0x7fbde811f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.624+0000 7fbdee32e700 1 --2- 172.21.15.40:0/85791691 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbde809d920 0x7fbde811eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.624+0000 7fbdee32e700 1 --2- 172.21.15.40:0/85791691 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbde8133ca0 0x7fbde811f0d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.624+0000 7fbdee32e700 1 -- 172.21.15.40:0/85791691 >> 172.21.15.40:0/85791691 conn(0x7fbde809fb20 msgr2=0x7fbde8133360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:35.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.624+0000 7fbdee32e700 1 -- 172.21.15.40:0/85791691 shutdown_connections 2023-09-30T22:26:35.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.624+0000 7fbdee32e700 1 -- 172.21.15.40:0/85791691 wait complete. 2023-09-30T22:26:35.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.631+0000 7f3e6569d700 1 -- 172.21.15.40:0/1415181134 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3e60121b50 con 0x7f3e6009d920 2023-09-30T22:26:35.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.632+0000 7f3e477fe700 1 -- 172.21.15.40:0/1415181134 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3e50016070 con 0x7f3e6009d920 2023-09-30T22:26:35.633 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:35.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.634+0000 7f3e6569d700 1 -- 172.21.15.40:0/1415181134 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e6009d920 msgr2=0x7f3e6011e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.634+0000 7f3e6569d700 1 --2- 172.21.15.40:0/1415181134 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e6009d920 0x7f3e6011e420 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f3e6009aff0 tx=0x7f3e50004750 comp rx=0 tx=0).stop 2023-09-30T22:26:35.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.634+0000 7f3e6569d700 1 -- 172.21.15.40:0/1415181134 shutdown_connections 2023-09-30T22:26:35.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.634+0000 7f3e6569d700 1 --2- 172.21.15.40:0/1415181134 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e60122440 0x7f3e6011eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.634+0000 7f3e6569d700 1 --2- 172.21.15.40:0/1415181134 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e6009d920 0x7f3e6011e420 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.634+0000 7f3e6569d700 1 --2- 172.21.15.40:0/1415181134 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e60133ca0 0x7f3e6011e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.634+0000 7f3e6569d700 1 -- 172.21.15.40:0/1415181134 >> 172.21.15.40:0/1415181134 conn(0x7f3e6009fb20 msgr2=0x7f3e60133360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:35.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.634+0000 7f3e6569d700 1 -- 172.21.15.40:0/1415181134 shutdown_connections 2023-09-30T22:26:35.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:35.634+0000 7f3e6569d700 1 -- 172.21.15.40:0/1415181134 wait complete. 2023-09-30T22:26:35.637 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:35.648 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:36.520 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:36.607 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:36.638 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:36.649 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:36.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.666+0000 7fefe199e700 1 Processor -- start 2023-09-30T22:26:36.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.666+0000 7fefe199e700 1 -- start start 2023-09-30T22:26:36.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.667+0000 7fefe199e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefdc12e590 0x7fefdc12e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:36.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.667+0000 7fefe199e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefdc12d8a0 0x7fefdc138c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:36.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.667+0000 7fefe199e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefdc09ab70 con 0x7fefdc12eea0 2023-09-30T22:26:36.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.667+0000 7fefe199e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc09b270 con 0x7fefdc12e590 2023-09-30T22:26:36.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.667+0000 7fefe199e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc09bab0 con 0x7fefdc12d8a0 2023-09-30T22:26:36.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.667+0000 7fefdaffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefdc12e590 0x7fefdc12e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:36.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.667+0000 7fefdaffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefdc12e590 0x7fefdc12e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:37926/0 (socket says 172.21.15.40:37926) 2023-09-30T22:26:36.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.667+0000 7fefdaffd700 1 -- 172.21.15.40:0/3428651288 learned_addr learned my addr 172.21.15.40:0/3428651288 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:36.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.667+0000 7fefdb7fe700 1 --2- 172.21.15.40:0/3428651288 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefdc12d8a0 0x7fefdc138c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:36.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.668+0000 7fefdb7fe700 1 -- 172.21.15.40:0/3428651288 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefdc12e590 msgr2=0x7fefdc12e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:36.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.668+0000 7fefdb7fe700 1 --2- 172.21.15.40:0/3428651288 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefdc12e590 0x7fefdc12e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:36.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.668+0000 7fefdb7fe700 1 -- 172.21.15.40:0/3428651288 >> v1:172.21.15.40:6789/0 conn(0x7fefdc12eea0 legacy=0x7fefdc12d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:36.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.668+0000 7fefd9ffb700 1 -- 172.21.15.40:0/3428651288 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 688954806 0 0) 0x7fefdc09ab70 con 0x7fefdc12eea0 2023-09-30T22:26:36.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.668+0000 7fefdb7fe700 1 -- 172.21.15.40:0/3428651288 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefdc09bd70 con 0x7fefdc12d8a0 2023-09-30T22:26:36.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.668+0000 7fefdb7fe700 1 --2- 172.21.15.40:0/3428651288 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefdc12d8a0 0x7fefdc138c50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fefd4009dc0 tx=0x7fefd400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e468fb61bf0b16f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:36.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.668+0000 7fefd9ffb700 1 -- 172.21.15.40:0/3428651288 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd400e070 con 0x7fefdc12d8a0 2023-09-30T22:26:36.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.668+0000 7fefd9ffb700 1 -- 172.21.15.40:0/3428651288 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd400bb20 con 0x7fefdc12d8a0 2023-09-30T22:26:36.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.668+0000 7fefd9ffb700 1 -- 172.21.15.40:0/3428651288 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd4012430 con 0x7fefdc12d8a0 2023-09-30T22:26:36.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.669+0000 7fefe199e700 1 -- 172.21.15.40:0/3428651288 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefdc12d8a0 msgr2=0x7fefdc138c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:36.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.669+0000 7fefe199e700 1 --2- 172.21.15.40:0/3428651288 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefdc12d8a0 0x7fefdc138c50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fefd4009dc0 tx=0x7fefd400b330 comp rx=0 tx=0).stop 2023-09-30T22:26:36.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.669+0000 7fefe199e700 1 -- 172.21.15.40:0/3428651288 shutdown_connections 2023-09-30T22:26:36.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.669+0000 7fefe199e700 1 --2- 172.21.15.40:0/3428651288 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefdc12d8a0 0x7fefdc138c50 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:36.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.669+0000 7fefe199e700 1 --2- 172.21.15.40:0/3428651288 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefdc12e590 0x7fefdc12e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:36.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.669+0000 7fefe199e700 1 -- 172.21.15.40:0/3428651288 >> 172.21.15.40:0/3428651288 conn(0x7fefdc0a2a00 msgr2=0x7fefdc0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:36.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.669+0000 7fefe199e700 1 -- 172.21.15.40:0/3428651288 shutdown_connections 2023-09-30T22:26:36.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.669+0000 7fefe199e700 1 -- 172.21.15.40:0/3428651288 wait complete. 2023-09-30T22:26:36.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.670+0000 7fefe199e700 1 Processor -- start 2023-09-30T22:26:36.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.671+0000 7fefe199e700 1 -- start start 2023-09-30T22:26:36.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.671+0000 7fefe199e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefdc12d8a0 0x7fefdc11dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:36.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.671+0000 7fefe199e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefdc12e590 0x7fefdc11e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:36.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.671+0000 7fefe199e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefdc12eea0 0x7fefdc11e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:36.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.671+0000 7fefe199e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc09fd90 con 0x7fefdc12e590 2023-09-30T22:26:36.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.671+0000 7fefe199e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc120040 con 0x7fefdc12d8a0 2023-09-30T22:26:36.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.671+0000 7fefe199e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc09b4b0 con 0x7fefdc12eea0 2023-09-30T22:26:36.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.672+0000 7fefdaffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefdc12d8a0 0x7fefdc11dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:36.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.672+0000 7fefdb7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefdc12eea0 0x7fefdc11e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:36.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.672+0000 7fefda7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefdc12e590 0x7fefdc11e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:36.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.672+0000 7fefdaffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefdc12d8a0 0x7fefdc11dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:37930/0 (socket says 172.21.15.40:37930) 2023-09-30T22:26:36.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.672+0000 7fefdaffd700 1 -- 172.21.15.40:0/303298512 learned_addr learned my addr 172.21.15.40:0/303298512 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:36.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.672+0000 7fefdaffd700 1 -- 172.21.15.40:0/303298512 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefdc12eea0 msgr2=0x7fefdc11e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:36.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.672+0000 7fefdaffd700 1 --2- 172.21.15.40:0/303298512 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefdc12eea0 0x7fefdc11e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:36.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.672+0000 7fefdaffd700 1 -- 172.21.15.40:0/303298512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefdc12e590 msgr2=0x7fefdc11e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:36.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.672+0000 7fefdaffd700 1 --2- 172.21.15.40:0/303298512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefdc12e590 0x7fefdc11e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:36.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.672+0000 7fefdaffd700 1 -- 172.21.15.40:0/303298512 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd4009a70 con 0x7fefdc12d8a0 2023-09-30T22:26:36.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.672+0000 7fefda7fc700 1 --2- 172.21.15.40:0/303298512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefdc12e590 0x7fefdc11e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:36.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.672+0000 7fefdaffd700 1 --2- 172.21.15.40:0/303298512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefdc12d8a0 0x7fefdc11dbd0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fefcc00b240 tx=0x7fefcc00d630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:36.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.673+0000 7fefc3fff700 1 -- 172.21.15.40:0/303298512 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc00dd90 con 0x7fefdc12d8a0 2023-09-30T22:26:36.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.673+0000 7fefc3fff700 1 -- 172.21.15.40:0/303298512 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefcc010440 con 0x7fefdc12d8a0 2023-09-30T22:26:36.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.673+0000 7fefe199e700 1 -- 172.21.15.40:0/303298512 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefdc12bf70 con 0x7fefdc12d8a0 2023-09-30T22:26:36.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.673+0000 7fefc3fff700 1 -- 172.21.15.40:0/303298512 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc0107d0 con 0x7fefdc12d8a0 2023-09-30T22:26:36.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.673+0000 7fefe199e700 1 -- 172.21.15.40:0/303298512 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefdc121410 con 0x7fefdc12d8a0 2023-09-30T22:26:36.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.674+0000 7fefc3fff700 1 -- 172.21.15.40:0/303298512 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fefcc010930 con 0x7fefdc12d8a0 2023-09-30T22:26:36.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.674+0000 7fefc3fff700 1 -- 172.21.15.40:0/303298512 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fefcc014030 con 0x7fefdc12d8a0 2023-09-30T22:26:36.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.674+0000 7fefe199e700 1 -- 172.21.15.40:0/303298512 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefdc06edb0 con 0x7fefdc12d8a0 2023-09-30T22:26:36.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.679+0000 7fefc3fff700 1 -- 172.21.15.40:0/303298512 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fefcc00cb60 con 0x7fefdc12d8a0 2023-09-30T22:26:36.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.750+0000 7f4359dc9700 1 Processor -- start 2023-09-30T22:26:36.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.750+0000 7f4359dc9700 1 -- start start 2023-09-30T22:26:36.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.751+0000 7f4359dc9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4354136c50 0x7f4354139030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:36.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.751+0000 7f4359dc9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4354139570 0x7f435413b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:36.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.751+0000 7f4359dc9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4354133940 con 0x7f4354133e00 2023-09-30T22:26:36.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.751+0000 7f4359dc9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f435409ab20 con 0x7f4354139570 2023-09-30T22:26:36.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.751+0000 7f4359dc9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435409f0d0 con 0x7f4354136c50 2023-09-30T22:26:36.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.751+0000 7f43537fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f4354133e00 0x7f43541341d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46654/0 (socket says 172.21.15.40:46654) 2023-09-30T22:26:36.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.751+0000 7f43537fe700 1 -- 172.21.15.40:0/188446314 learned_addr learned my addr 172.21.15.40:0/188446314 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:36.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.751+0000 7f4352ffd700 1 --2- 172.21.15.40:0/188446314 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4354136c50 0x7f4354139030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:36.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.751+0000 7f4353fff700 1 --2- 172.21.15.40:0/188446314 >> v2:172.21.15.40:3300/0 conn(0x7f4354139570 0x7f435413b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:36.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.752+0000 7f43527fc700 1 -- 172.21.15.40:0/188446314 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2507500173 0 0) 0x7f4354133940 con 0x7f4354133e00 2023-09-30T22:26:36.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.752+0000 7f43527fc700 1 -- 172.21.15.40:0/188446314 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f433c0035b0 con 0x7f4354133e00 2023-09-30T22:26:36.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.752+0000 7f4352ffd700 1 -- 172.21.15.40:0/188446314 >> v2:172.21.15.40:3300/0 conn(0x7f4354139570 msgr2=0x7f435413b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:36.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.752+0000 7f4352ffd700 1 --2- 172.21.15.40:0/188446314 >> v2:172.21.15.40:3300/0 conn(0x7f4354139570 0x7f435413b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:36.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.752+0000 7f4352ffd700 1 -- 172.21.15.40:0/188446314 >> v1:172.21.15.40:6789/0 conn(0x7f4354133e00 legacy=0x7f43541341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:36.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.752+0000 7f4352ffd700 1 -- 172.21.15.40:0/188446314 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4354133be0 con 0x7f4354136c50 2023-09-30T22:26:36.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.752+0000 7f4352ffd700 1 --2- 172.21.15.40:0/188446314 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4354136c50 0x7f4354139030 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4348009840 tx=0x7f4348009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bde830c0b61b5c4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:36.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.752+0000 7f43527fc700 1 -- 172.21.15.40:0/188446314 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4348004230 con 0x7f4354136c50 2023-09-30T22:26:36.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.752+0000 7f43527fc700 1 -- 172.21.15.40:0/188446314 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4348004390 con 0x7f4354136c50 2023-09-30T22:26:36.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.752+0000 7f43527fc700 1 -- 172.21.15.40:0/188446314 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43480036a0 con 0x7f4354136c50 2023-09-30T22:26:36.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.753+0000 7f4359dc9700 1 -- 172.21.15.40:0/188446314 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4354136c50 msgr2=0x7f4354139030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:36.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.753+0000 7f4359dc9700 1 --2- 172.21.15.40:0/188446314 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4354136c50 0x7f4354139030 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4348009840 tx=0x7f4348009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:36.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.753+0000 7f4359dc9700 1 -- 172.21.15.40:0/188446314 shutdown_connections 2023-09-30T22:26:36.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.753+0000 7f4359dc9700 1 --2- 172.21.15.40:0/188446314 >> v2:172.21.15.40:3300/0 conn(0x7f4354139570 0x7f435413b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:36.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.753+0000 7f4359dc9700 1 --2- 172.21.15.40:0/188446314 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4354136c50 0x7f4354139030 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:36.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.753+0000 7f4359dc9700 1 -- 172.21.15.40:0/188446314 >> 172.21.15.40:0/188446314 conn(0x7f43540a2a00 msgr2=0x7f43540a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:36.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.753+0000 7f4359dc9700 1 -- 172.21.15.40:0/188446314 shutdown_connections 2023-09-30T22:26:36.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.753+0000 7f4359dc9700 1 -- 172.21.15.40:0/188446314 wait complete. 2023-09-30T22:26:36.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.754+0000 7f4359dc9700 1 Processor -- start 2023-09-30T22:26:36.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.754+0000 7f4359dc9700 1 -- start start 2023-09-30T22:26:36.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.755+0000 7f4359dc9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4354133e00 0x7f4354119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:36.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.755+0000 7f4359dc9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4354136c50 0x7f4354119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:36.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.755+0000 7f4359dc9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4354139570 0x7f4354119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:36.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.755+0000 7f4359dc9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435411ba20 con 0x7f4354139570 2023-09-30T22:26:36.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.755+0000 7f4359dc9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435412dd50 con 0x7f4354136c50 2023-09-30T22:26:36.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.755+0000 7f4359dc9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f435411a2a0 con 0x7f4354133e00 2023-09-30T22:26:36.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.755+0000 7f4353fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4354139570 0x7f4354119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:36.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.755+0000 7f4353fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4354139570 0x7f4354119ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34340/0 (socket says 172.21.15.40:34340) 2023-09-30T22:26:36.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.755+0000 7f4353fff700 1 -- 172.21.15.40:0/2208493212 learned_addr learned my addr 172.21.15.40:0/2208493212 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:36.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.755+0000 7f43537fe700 1 --2- 172.21.15.40:0/2208493212 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4354133e00 0x7f4354119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:36.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.755+0000 7f4352ffd700 1 --2- 172.21.15.40:0/2208493212 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4354136c50 0x7f4354119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:36.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.756+0000 7f4353fff700 1 -- 172.21.15.40:0/2208493212 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4354133e00 msgr2=0x7f4354119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:36.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.756+0000 7f4353fff700 1 --2- 172.21.15.40:0/2208493212 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4354133e00 0x7f4354119050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:36.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.756+0000 7f4353fff700 1 -- 172.21.15.40:0/2208493212 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4354136c50 msgr2=0x7f4354119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:36.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.756+0000 7f4353fff700 1 --2- 172.21.15.40:0/2208493212 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4354136c50 0x7f4354119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:36.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.756+0000 7f4353fff700 1 -- 172.21.15.40:0/2208493212 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43480094a0 con 0x7f4354139570 2023-09-30T22:26:36.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.756+0000 7f4353fff700 1 --2- 172.21.15.40:0/2208493212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4354139570 0x7f4354119ad0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f434c00efc0 tx=0x7f434c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:36.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.756+0000 7f433bfff700 1 -- 172.21.15.40:0/2208493212 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c00cc90 con 0x7f4354139570 2023-09-30T22:26:36.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.756+0000 7f433bfff700 1 -- 172.21.15.40:0/2208493212 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434c00f040 con 0x7f4354139570 2023-09-30T22:26:36.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.756+0000 7f433bfff700 1 -- 172.21.15.40:0/2208493212 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c014480 con 0x7f4354139570 2023-09-30T22:26:36.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.756+0000 7f4359dc9700 1 -- 172.21.15.40:0/2208493212 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4354136900 con 0x7f4354139570 2023-09-30T22:26:36.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.757+0000 7f4359dc9700 1 -- 172.21.15.40:0/2208493212 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f435411b6a0 con 0x7f4354139570 2023-09-30T22:26:36.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.758+0000 7f433bfff700 1 -- 172.21.15.40:0/2208493212 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f434c014600 con 0x7f4354139570 2023-09-30T22:26:36.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.758+0000 7f4359dc9700 1 -- 172.21.15.40:0/2208493212 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4354062380 con 0x7f4354139570 2023-09-30T22:26:36.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.758+0000 7f433bfff700 1 -- 172.21.15.40:0/2208493212 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f434c040070 con 0x7f4354139570 2023-09-30T22:26:36.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.762+0000 7f433bfff700 1 -- 172.21.15.40:0/2208493212 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f434c0246c0 con 0x7f4354139570 2023-09-30T22:26:36.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.787+0000 7f8e204e5700 1 Processor -- start 2023-09-30T22:26:36.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.788+0000 7f8e204e5700 1 -- start start 2023-09-30T22:26:36.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.788+0000 7f8e204e5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e1809d920 0x7f8e1809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:36.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.788+0000 7f8e204e5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e1809e230 0x7f8e181308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:36.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.788+0000 7f8e204e5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e1809adf0 con 0x7f8e18130de0 2023-09-30T22:26:36.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.788+0000 7f8e204e5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1809edf0 con 0x7f8e1809d920 2023-09-30T22:26:36.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.788+0000 7f8e204e5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1809b660 con 0x7f8e1809e230 2023-09-30T22:26:36.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.788+0000 7f8e1e281700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e1809d920 0x7f8e1809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:36.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.788+0000 7f8e1ea82700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8e18130de0 0x7f8e18137d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46668/0 (socket says 172.21.15.40:46668) 2023-09-30T22:26:36.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.788+0000 7f8e1ea82700 1 -- 172.21.15.40:0/2722530296 learned_addr learned my addr 172.21.15.40:0/2722530296 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:36.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.789+0000 7f8e1e281700 1 -- 172.21.15.40:0/2722530296 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e1809e230 msgr2=0x7f8e181308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:36.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.789+0000 7f8e1e281700 1 --2- 172.21.15.40:0/2722530296 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e1809e230 0x7f8e181308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:36.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.789+0000 7f8e1e281700 1 -- 172.21.15.40:0/2722530296 >> v1:172.21.15.40:6789/0 conn(0x7f8e18130de0 legacy=0x7f8e18137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:36.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.789+0000 7f8e1e281700 1 -- 172.21.15.40:0/2722530296 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1809a6e0 con 0x7f8e1809d920 2023-09-30T22:26:36.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.789+0000 7f8e1d27f700 1 -- 172.21.15.40:0/2722530296 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2266908221 0 0) 0x7f8e1809adf0 con 0x7f8e18130de0 2023-09-30T22:26:36.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.789+0000 7f8e1e281700 1 --2- 172.21.15.40:0/2722530296 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e1809d920 0x7f8e1809dcf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8e1400baf0 tx=0x7f8e1400be00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbc40884b709a54d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:36.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.789+0000 7f8e1d27f700 1 -- 172.21.15.40:0/2722530296 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e14005e30 con 0x7f8e1809d920 2023-09-30T22:26:36.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.789+0000 7f8e1d27f700 1 -- 172.21.15.40:0/2722530296 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1400d920 con 0x7f8e1809d920 2023-09-30T22:26:36.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.789+0000 7f8e1d27f700 1 -- 172.21.15.40:0/2722530296 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1400dcb0 con 0x7f8e1809d920 2023-09-30T22:26:36.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.790+0000 7f8e204e5700 1 -- 172.21.15.40:0/2722530296 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e1809d920 msgr2=0x7f8e1809dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:36.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.790+0000 7f8e204e5700 1 --2- 172.21.15.40:0/2722530296 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e1809d920 0x7f8e1809dcf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8e1400baf0 tx=0x7f8e1400be00 comp rx=0 tx=0).stop 2023-09-30T22:26:36.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.790+0000 7f8e204e5700 1 -- 172.21.15.40:0/2722530296 shutdown_connections 2023-09-30T22:26:36.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.790+0000 7f8e204e5700 1 --2- 172.21.15.40:0/2722530296 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e1809d920 0x7f8e1809dcf0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:36.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.790+0000 7f8e204e5700 1 --2- 172.21.15.40:0/2722530296 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e1809e230 0x7f8e181308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:36.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.790+0000 7f8e204e5700 1 -- 172.21.15.40:0/2722530296 >> 172.21.15.40:0/2722530296 conn(0x7f8e1809fb20 msgr2=0x7f8e1809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:36.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.790+0000 7f8e204e5700 1 -- 172.21.15.40:0/2722530296 shutdown_connections 2023-09-30T22:26:36.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.790+0000 7f8e204e5700 1 -- 172.21.15.40:0/2722530296 wait complete. 2023-09-30T22:26:36.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.791+0000 7f8e204e5700 1 Processor -- start 2023-09-30T22:26:36.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.791+0000 7f8e204e5700 1 -- start start 2023-09-30T22:26:36.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.791+0000 7f8e204e5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e1809d920 0x7f8e18121210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:36.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.791+0000 7f8e204e5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e1809e230 0x7f8e18121750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:36.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.791+0000 7f8e204e5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e18130de0 0x7f8e18121c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:36.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.791+0000 7f8e204e5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e18122d60 con 0x7f8e18130de0 2023-09-30T22:26:36.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.791+0000 7f8e204e5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e181235c0 con 0x7f8e1809e230 2023-09-30T22:26:36.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.791+0000 7f8e204e5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e181246f0 con 0x7f8e1809d920 2023-09-30T22:26:36.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.792+0000 7f8e1da80700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e1809e230 0x7f8e18121750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:36.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.792+0000 7f8e1da80700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e1809e230 0x7f8e18121750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:37966/0 (socket says 172.21.15.40:37966) 2023-09-30T22:26:36.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.792+0000 7f8e1da80700 1 -- 172.21.15.40:0/3065651698 learned_addr learned my addr 172.21.15.40:0/3065651698 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:36.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.792+0000 7f8e1ea82700 1 --2- 172.21.15.40:0/3065651698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e18130de0 0x7f8e18121c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:36.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.792+0000 7f8e1e281700 1 --2- 172.21.15.40:0/3065651698 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e1809d920 0x7f8e18121210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:36.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.792+0000 7f8e1ea82700 1 -- 172.21.15.40:0/3065651698 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e1809d920 msgr2=0x7f8e18121210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:36.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.792+0000 7f8e1ea82700 1 --2- 172.21.15.40:0/3065651698 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e1809d920 0x7f8e18121210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:36.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.792+0000 7f8e1ea82700 1 -- 172.21.15.40:0/3065651698 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e1809e230 msgr2=0x7f8e18121750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:36.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.792+0000 7f8e1ea82700 1 --2- 172.21.15.40:0/3065651698 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e1809e230 0x7f8e18121750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:36.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.792+0000 7f8e1ea82700 1 -- 172.21.15.40:0/3065651698 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1400b6d0 con 0x7f8e18130de0 2023-09-30T22:26:36.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.792+0000 7f8e1ea82700 1 --2- 172.21.15.40:0/3065651698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e18130de0 0x7f8e18121c90 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f8e1000cc10 tx=0x7f8e1000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:36.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.792+0000 7f8e0effd700 1 -- 172.21.15.40:0/3065651698 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1000ab10 con 0x7f8e18130de0 2023-09-30T22:26:36.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.792+0000 7f8e0effd700 1 -- 172.21.15.40:0/3065651698 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1000ac70 con 0x7f8e18130de0 2023-09-30T22:26:36.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.792+0000 7f8e204e5700 1 -- 172.21.15.40:0/3065651698 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e181225e0 con 0x7f8e18130de0 2023-09-30T22:26:36.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.792+0000 7f8e0effd700 1 -- 172.21.15.40:0/3065651698 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e100070d0 con 0x7f8e18130de0 2023-09-30T22:26:36.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.792+0000 7f8e204e5700 1 -- 172.21.15.40:0/3065651698 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e1809cb00 con 0x7f8e18130de0 2023-09-30T22:26:36.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.793+0000 7f8e0effd700 1 -- 172.21.15.40:0/3065651698 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8e10007230 con 0x7f8e18130de0 2023-09-30T22:26:36.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.793+0000 7f8e204e5700 1 -- 172.21.15.40:0/3065651698 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e181225e0 con 0x7f8e18130de0 2023-09-30T22:26:36.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.793+0000 7f8e0effd700 1 -- 172.21.15.40:0/3065651698 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f8e1003f420 con 0x7f8e18130de0 2023-09-30T22:26:36.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.798+0000 7f8e0effd700 1 -- 172.21.15.40:0/3065651698 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e10018070 con 0x7f8e18130de0 2023-09-30T22:26:36.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.839+0000 7efc53660700 1 Processor -- start 2023-09-30T22:26:36.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.839+0000 7efc53660700 1 -- start start 2023-09-30T22:26:36.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.839+0000 7efc53660700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efc4c09c890 0x7efc4c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:36.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.839+0000 7efc53660700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efc4c09e480 0x7efc4c13bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:36.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.839+0000 7efc53660700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc4c0a2600 con 0x7efc4c09d920 2023-09-30T22:26:36.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.839+0000 7efc53660700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc4c0a29d0 con 0x7efc4c09e480 2023-09-30T22:26:36.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.839+0000 7efc53660700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc4c09fb40 con 0x7efc4c09c890 2023-09-30T22:26:36.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.840+0000 7efc50bfb700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7efc4c09d920 0x7efc4c09dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46682/0 (socket says 172.21.15.40:46682) 2023-09-30T22:26:36.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.840+0000 7efc50bfb700 1 -- 172.21.15.40:0/632570349 learned_addr learned my addr 172.21.15.40:0/632570349 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:36.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.840+0000 7efc51bfd700 1 --2- 172.21.15.40:0/632570349 >> v2:172.21.15.40:3300/0 conn(0x7efc4c09e480 0x7efc4c13bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:36.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.840+0000 7efc513fc700 1 --2- 172.21.15.40:0/632570349 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efc4c09c890 0x7efc4c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:36.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.840+0000 7efc43fff700 1 -- 172.21.15.40:0/632570349 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3903453140 0 0) 0x7efc4c0a2600 con 0x7efc4c09d920 2023-09-30T22:26:36.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.840+0000 7efc43fff700 1 -- 172.21.15.40:0/632570349 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc380035b0 con 0x7efc4c09d920 2023-09-30T22:26:36.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.840+0000 7efc51bfd700 1 -- 172.21.15.40:0/632570349 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efc4c09c890 msgr2=0x7efc4c09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:36.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.840+0000 7efc51bfd700 1 --2- 172.21.15.40:0/632570349 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efc4c09c890 0x7efc4c09cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:36.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.840+0000 7efc51bfd700 1 -- 172.21.15.40:0/632570349 >> v1:172.21.15.40:6789/0 conn(0x7efc4c09d920 legacy=0x7efc4c09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:36.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.840+0000 7efc51bfd700 1 -- 172.21.15.40:0/632570349 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4c09fed0 con 0x7efc4c09e480 2023-09-30T22:26:36.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.840+0000 7efc51bfd700 1 --2- 172.21.15.40:0/632570349 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc4c09e480 0x7efc4c13bc20 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7efc44009d90 tx=0x7efc4400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0433247565e732 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:36.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.840+0000 7efc43fff700 1 -- 172.21.15.40:0/632570349 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4400e070 con 0x7efc4c09e480 2023-09-30T22:26:36.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.841+0000 7efc43fff700 1 -- 172.21.15.40:0/632570349 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4400bb20 con 0x7efc4c09e480 2023-09-30T22:26:36.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.841+0000 7efc43fff700 1 -- 172.21.15.40:0/632570349 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc44012430 con 0x7efc4c09e480 2023-09-30T22:26:36.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.841+0000 7efc53660700 1 -- 172.21.15.40:0/632570349 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc4c09e480 msgr2=0x7efc4c13bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:36.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.841+0000 7efc53660700 1 --2- 172.21.15.40:0/632570349 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc4c09e480 0x7efc4c13bc20 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7efc44009d90 tx=0x7efc4400b330 comp rx=0 tx=0).stop 2023-09-30T22:26:36.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.841+0000 7efc53660700 1 -- 172.21.15.40:0/632570349 shutdown_connections 2023-09-30T22:26:36.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.841+0000 7efc53660700 1 --2- 172.21.15.40:0/632570349 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc4c09e480 0x7efc4c13bc20 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:36.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.841+0000 7efc53660700 1 --2- 172.21.15.40:0/632570349 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efc4c09c890 0x7efc4c09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:36.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.841+0000 7efc53660700 1 -- 172.21.15.40:0/632570349 >> 172.21.15.40:0/632570349 conn(0x7efc4c0a7080 msgr2=0x7efc4c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:36.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.841+0000 7efc53660700 1 -- 172.21.15.40:0/632570349 shutdown_connections 2023-09-30T22:26:36.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.841+0000 7efc53660700 1 -- 172.21.15.40:0/632570349 wait complete. 2023-09-30T22:26:36.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.842+0000 7efc53660700 1 Processor -- start 2023-09-30T22:26:36.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.842+0000 7efc53660700 1 -- start start 2023-09-30T22:26:36.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.843+0000 7efc53660700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc4c09c890 0x7efc4c12d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:36.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.843+0000 7efc53660700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efc4c09d920 0x7efc4c12d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:36.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.843+0000 7efc53660700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efc4c09e480 0x7efc4c12dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:36.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.843+0000 7efc53660700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4c09c230 con 0x7efc4c09c890 2023-09-30T22:26:36.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.843+0000 7efc53660700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc4c130510 con 0x7efc4c09d920 2023-09-30T22:26:36.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.843+0000 7efc53660700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc4c09ecf0 con 0x7efc4c09e480 2023-09-30T22:26:36.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.843+0000 7efc50bfb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efc4c09d920 0x7efc4c12d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:36.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.843+0000 7efc50bfb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efc4c09d920 0x7efc4c12d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:37976/0 (socket says 172.21.15.40:37976) 2023-09-30T22:26:36.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.843+0000 7efc50bfb700 1 -- 172.21.15.40:0/1371692133 learned_addr learned my addr 172.21.15.40:0/1371692133 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:36.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.843+0000 7efc51bfd700 1 --2- 172.21.15.40:0/1371692133 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efc4c09e480 0x7efc4c12dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:36.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.844+0000 7efc50bfb700 1 -- 172.21.15.40:0/1371692133 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efc4c09e480 msgr2=0x7efc4c12dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:36.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.844+0000 7efc50bfb700 1 --2- 172.21.15.40:0/1371692133 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efc4c09e480 0x7efc4c12dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:36.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.844+0000 7efc50bfb700 1 -- 172.21.15.40:0/1371692133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc4c09c890 msgr2=0x7efc4c12d190 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:26:36.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.844+0000 7efc50bfb700 1 --2- 172.21.15.40:0/1371692133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc4c09c890 0x7efc4c12d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:36.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.844+0000 7efc50bfb700 1 -- 172.21.15.40:0/1371692133 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc44009a70 con 0x7efc4c09d920 2023-09-30T22:26:36.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.844+0000 7efc51bfd700 1 --2- 172.21.15.40:0/1371692133 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efc4c09e480 0x7efc4c12dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:36.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.844+0000 7efc50bfb700 1 --2- 172.21.15.40:0/1371692133 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efc4c09d920 0x7efc4c12d6d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7efc3c005910 tx=0x7efc3c00c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:36.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.844+0000 7efc41ffb700 1 -- 172.21.15.40:0/1371692133 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c005d70 con 0x7efc4c09d920 2023-09-30T22:26:36.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.844+0000 7efc41ffb700 1 -- 172.21.15.40:0/1371692133 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3c0070d0 con 0x7efc4c09d920 2023-09-30T22:26:36.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.844+0000 7efc53660700 1 -- 172.21.15.40:0/1371692133 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc4c1307d0 con 0x7efc4c09d920 2023-09-30T22:26:36.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.844+0000 7efc53660700 1 -- 172.21.15.40:0/1371692133 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc4c12edc0 con 0x7efc4c09d920 2023-09-30T22:26:36.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.844+0000 7efc41ffb700 1 -- 172.21.15.40:0/1371692133 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c007440 con 0x7efc4c09d920 2023-09-30T22:26:36.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.845+0000 7efc41ffb700 1 -- 172.21.15.40:0/1371692133 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efc3c0075a0 con 0x7efc4c09d920 2023-09-30T22:26:36.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.845+0000 7efc41ffb700 1 -- 172.21.15.40:0/1371692133 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7efc3c03ec50 con 0x7efc4c09d920 2023-09-30T22:26:36.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.846+0000 7efc53660700 1 -- 172.21.15.40:0/1371692133 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc2c0052e0 con 0x7efc4c09d920 2023-09-30T22:26:36.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.854+0000 7efc41ffb700 1 -- 172.21.15.40:0/1371692133 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efc3c03ee60 con 0x7efc4c09d920 2023-09-30T22:26:36.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.963+0000 7f4359dc9700 1 -- 172.21.15.40:0/2208493212 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4354074330 con 0x7f4354139570 2023-09-30T22:26:36.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.964+0000 7f433bfff700 1 -- 172.21.15.40:0/2208493212 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f434c024300 con 0x7f4354139570 2023-09-30T22:26:36.964 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:36.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.966+0000 7fefe199e700 1 -- 172.21.15.40:0/303298512 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fefdc062380 con 0x7fefdc12d8a0 2023-09-30T22:26:36.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.967+0000 7fefc3fff700 1 -- 172.21.15.40:0/303298512 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fefcc01e020 con 0x7fefdc12d8a0 2023-09-30T22:26:36.967 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:36.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.967+0000 7f4359dc9700 1 -- 172.21.15.40:0/2208493212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4354139570 msgr2=0x7f4354119ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:36.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.967+0000 7f4359dc9700 1 --2- 172.21.15.40:0/2208493212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4354139570 0x7f4354119ad0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f434c00efc0 tx=0x7f434c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:26:36.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.967+0000 7f4359dc9700 1 -- 172.21.15.40:0/2208493212 shutdown_connections 2023-09-30T22:26:36.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.967+0000 7f4359dc9700 1 --2- 172.21.15.40:0/2208493212 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4354133e00 0x7f4354119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:36.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.967+0000 7f4359dc9700 1 --2- 172.21.15.40:0/2208493212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4354139570 0x7f4354119ad0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:36.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.967+0000 7f4359dc9700 1 --2- 172.21.15.40:0/2208493212 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4354136c50 0x7f4354119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:36.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.967+0000 7f4359dc9700 1 -- 172.21.15.40:0/2208493212 >> 172.21.15.40:0/2208493212 conn(0x7f43540a2a00 msgr2=0x7f43541373d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:36.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.967+0000 7f4359dc9700 1 -- 172.21.15.40:0/2208493212 shutdown_connections 2023-09-30T22:26:36.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.967+0000 7f4359dc9700 1 -- 172.21.15.40:0/2208493212 wait complete. 2023-09-30T22:26:36.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.969+0000 7fefe199e700 1 -- 172.21.15.40:0/303298512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefdc12d8a0 msgr2=0x7fefdc11dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:36.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.969+0000 7fefe199e700 1 --2- 172.21.15.40:0/303298512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefdc12d8a0 0x7fefdc11dbd0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fefcc00b240 tx=0x7fefcc00d630 comp rx=0 tx=0).stop 2023-09-30T22:26:36.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.970+0000 7fefe199e700 1 -- 172.21.15.40:0/303298512 shutdown_connections 2023-09-30T22:26:36.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.970+0000 7fefe199e700 1 --2- 172.21.15.40:0/303298512 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefdc12eea0 0x7fefdc11e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:36.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.970+0000 7fefe199e700 1 --2- 172.21.15.40:0/303298512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefdc12d8a0 0x7fefdc11dbd0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:36.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.970+0000 7fefe199e700 1 --2- 172.21.15.40:0/303298512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefdc12e590 0x7fefdc11e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:36.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.970+0000 7fefe199e700 1 -- 172.21.15.40:0/303298512 >> 172.21.15.40:0/303298512 conn(0x7fefdc0a2a00 msgr2=0x7fefdc12c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:36.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.970+0000 7fefe199e700 1 -- 172.21.15.40:0/303298512 shutdown_connections 2023-09-30T22:26:36.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:36.970+0000 7fefe199e700 1 -- 172.21.15.40:0/303298512 wait complete. 2023-09-30T22:26:36.986 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:36.987 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:37.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:37.004+0000 7f8e204e5700 1 -- 172.21.15.40:0/3065651698 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8e18062380 con 0x7f8e18130de0 2023-09-30T22:26:37.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:37.005+0000 7f8e0effd700 1 -- 172.21.15.40:0/3065651698 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8e1001c3b0 con 0x7f8e18130de0 2023-09-30T22:26:37.005 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:37.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:37.007+0000 7f8e204e5700 1 -- 172.21.15.40:0/3065651698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e18130de0 msgr2=0x7f8e18121c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:37.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:37.007+0000 7f8e204e5700 1 --2- 172.21.15.40:0/3065651698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e18130de0 0x7f8e18121c90 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f8e1000cc10 tx=0x7f8e1000cf20 comp rx=0 tx=0).stop 2023-09-30T22:26:37.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:37.007+0000 7f8e204e5700 1 -- 172.21.15.40:0/3065651698 shutdown_connections 2023-09-30T22:26:37.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:37.007+0000 7f8e204e5700 1 --2- 172.21.15.40:0/3065651698 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e1809d920 0x7f8e18121210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:37.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:37.007+0000 7f8e204e5700 1 --2- 172.21.15.40:0/3065651698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e18130de0 0x7f8e18121c90 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:37.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:37.007+0000 7f8e204e5700 1 --2- 172.21.15.40:0/3065651698 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e1809e230 0x7f8e18121750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:37.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:37.007+0000 7f8e204e5700 1 -- 172.21.15.40:0/3065651698 >> 172.21.15.40:0/3065651698 conn(0x7f8e1809fb20 msgr2=0x7f8e1812fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:37.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:37.007+0000 7f8e204e5700 1 -- 172.21.15.40:0/3065651698 shutdown_connections 2023-09-30T22:26:37.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:37.007+0000 7f8e204e5700 1 -- 172.21.15.40:0/3065651698 wait complete. 2023-09-30T22:26:37.019 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:37.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:37.071+0000 7efc53660700 1 -- 172.21.15.40:0/1371692133 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efc2c005590 con 0x7efc4c09d920 2023-09-30T22:26:37.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:37.071+0000 7efc41ffb700 1 -- 172.21.15.40:0/1371692133 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efc3c017080 con 0x7efc4c09d920 2023-09-30T22:26:37.072 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:37.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:37.073+0000 7efc53660700 1 -- 172.21.15.40:0/1371692133 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efc4c09d920 msgr2=0x7efc4c12d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:37.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:37.073+0000 7efc53660700 1 --2- 172.21.15.40:0/1371692133 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efc4c09d920 0x7efc4c12d6d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7efc3c005910 tx=0x7efc3c00c9e0 comp rx=0 tx=0).stop 2023-09-30T22:26:37.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:37.073+0000 7efc53660700 1 -- 172.21.15.40:0/1371692133 shutdown_connections 2023-09-30T22:26:37.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:37.073+0000 7efc53660700 1 --2- 172.21.15.40:0/1371692133 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efc4c09e480 0x7efc4c12dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:37.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:37.073+0000 7efc53660700 1 --2- 172.21.15.40:0/1371692133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc4c09c890 0x7efc4c12d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:37.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:37.073+0000 7efc53660700 1 --2- 172.21.15.40:0/1371692133 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efc4c09d920 0x7efc4c12d6d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:37.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:37.073+0000 7efc53660700 1 -- 172.21.15.40:0/1371692133 >> 172.21.15.40:0/1371692133 conn(0x7efc4c0a7080 msgr2=0x7efc4c1332c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:37.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:37.073+0000 7efc53660700 1 -- 172.21.15.40:0/1371692133 shutdown_connections 2023-09-30T22:26:37.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:37.073+0000 7efc53660700 1 -- 172.21.15.40:0/1371692133 wait complete. 2023-09-30T22:26:37.086 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:37.987 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:37.988 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:38.021 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:38.086 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:38.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.145+0000 7f4e2abdd700 1 Processor -- start 2023-09-30T22:26:38.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.145+0000 7f4e2abdd700 1 -- start start 2023-09-30T22:26:38.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.146+0000 7f4e2abdd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e24131d50 0x7f4e24132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.146+0000 7f4e2abdd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e2409c7d0 0x7f4e24139ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.146+0000 7f4e2abdd700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e24132660 con 0x7f4e2409bc50 2023-09-30T22:26:38.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.146+0000 7f4e2abdd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e240719e0 con 0x7f4e2409c7d0 2023-09-30T22:26:38.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.146+0000 7f4e2abdd700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e24131900 con 0x7f4e24131d50 2023-09-30T22:26:38.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.146+0000 7f4e28979700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e24131d50 0x7f4e24132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.146+0000 7f4e28979700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e24131d50 0x7f4e24132120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:44504/0 (socket says 172.21.15.40:44504) 2023-09-30T22:26:38.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.146+0000 7f4e28979700 1 -- 172.21.15.40:0/2400491755 learned_addr learned my addr 172.21.15.40:0/2400491755 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:38.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.146+0000 7f4e23fff700 1 --1- 172.21.15.40:0/2400491755 >> v1:172.21.15.40:6789/0 conn(0x7f4e2409bc50 0x7f4e2409c0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46690/0 (socket says 172.21.15.40:46690) 2023-09-30T22:26:38.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.146+0000 7f4e2917a700 1 --2- 172.21.15.40:0/2400491755 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e2409c7d0 0x7f4e24139ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.146+0000 7f4e28979700 1 -- 172.21.15.40:0/2400491755 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e2409c7d0 msgr2=0x7f4e24139ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:38.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.146+0000 7f4e28979700 1 --2- 172.21.15.40:0/2400491755 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e2409c7d0 0x7f4e24139ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.146+0000 7f4e28979700 1 -- 172.21.15.40:0/2400491755 >> v1:172.21.15.40:6789/0 conn(0x7f4e2409bc50 legacy=0x7f4e2409c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.146+0000 7f4e28979700 1 -- 172.21.15.40:0/2400491755 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e2409e820 con 0x7f4e24131d50 2023-09-30T22:26:38.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.147+0000 7f4e28979700 1 --2- 172.21.15.40:0/2400491755 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e24131d50 0x7f4e24132120 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4e18009950 tx=0x7f4e18009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29f4f838fbd599d0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:38.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.147+0000 7f4e237fe700 1 -- 172.21.15.40:0/2400491755 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e18011830 con 0x7f4e24131d50 2023-09-30T22:26:38.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.147+0000 7f4e237fe700 1 -- 172.21.15.40:0/2400491755 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e18011990 con 0x7f4e24131d50 2023-09-30T22:26:38.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.147+0000 7f4e237fe700 1 -- 172.21.15.40:0/2400491755 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e18011d40 con 0x7f4e24131d50 2023-09-30T22:26:38.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.148+0000 7f4e2abdd700 1 -- 172.21.15.40:0/2400491755 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e24131d50 msgr2=0x7f4e24132120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.148+0000 7f4e2abdd700 1 --2- 172.21.15.40:0/2400491755 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e24131d50 0x7f4e24132120 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4e18009950 tx=0x7f4e18009c60 comp rx=0 tx=0).stop 2023-09-30T22:26:38.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.148+0000 7f4e2abdd700 1 -- 172.21.15.40:0/2400491755 shutdown_connections 2023-09-30T22:26:38.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.148+0000 7f4e2abdd700 1 --2- 172.21.15.40:0/2400491755 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e2409c7d0 0x7f4e24139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.148+0000 7f4e2abdd700 1 --2- 172.21.15.40:0/2400491755 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e24131d50 0x7f4e24132120 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.148+0000 7f4e2abdd700 1 -- 172.21.15.40:0/2400491755 >> 172.21.15.40:0/2400491755 conn(0x7f4e240a2a00 msgr2=0x7f4e240a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:38.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.148+0000 7f4e2abdd700 1 -- 172.21.15.40:0/2400491755 shutdown_connections 2023-09-30T22:26:38.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.148+0000 7f4e2abdd700 1 -- 172.21.15.40:0/2400491755 wait complete. 2023-09-30T22:26:38.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.149+0000 7f4e2abdd700 1 Processor -- start 2023-09-30T22:26:38.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.150+0000 7f4e2abdd700 1 -- start start 2023-09-30T22:26:38.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.150+0000 7ff097d88700 1 Processor -- start 2023-09-30T22:26:38.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.150+0000 7ff097d88700 1 -- start start 2023-09-30T22:26:38.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.150+0000 7f4e2abdd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e2409bc50 0x7f4e24134840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.150+0000 7f4e2abdd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e2409c7d0 0x7f4e24134d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.150+0000 7f4e2abdd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e24131d50 0x7f4e241c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.150+0000 7f4e2abdd700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e24136b90 con 0x7f4e2409bc50 2023-09-30T22:26:38.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.150+0000 7f4e2abdd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2413ae00 con 0x7f4e2409c7d0 2023-09-30T22:26:38.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.150+0000 7f4e2abdd700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e24134460 con 0x7f4e24131d50 2023-09-30T22:26:38.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.151+0000 7f4e23fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e2409c7d0 0x7f4e24134d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.151+0000 7f4e23fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e2409c7d0 0x7f4e24134d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:37990/0 (socket says 172.21.15.40:37990) 2023-09-30T22:26:38.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.151+0000 7f4e23fff700 1 -- 172.21.15.40:0/1399380288 learned_addr learned my addr 172.21.15.40:0/1399380288 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:38.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.151+0000 7f4e28979700 1 --2- 172.21.15.40:0/1399380288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e2409bc50 0x7f4e24134840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.151+0000 7f4e2917a700 1 --2- 172.21.15.40:0/1399380288 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e24131d50 0x7f4e241c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.151+0000 7ff097d88700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff09009d920 0x7ff09009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.151+0000 7ff097d88700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff09009f0f0 0x7ff09009e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.151+0000 7ff097d88700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff090133ca0 0x7ff090134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.151+0000 7ff097d88700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff09006b4c0 con 0x7ff090133ca0 2023-09-30T22:26:38.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.151+0000 7ff097d88700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff09009a8f0 con 0x7ff09009d920 2023-09-30T22:26:38.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.151+0000 7ff097d88700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff09009f940 con 0x7ff09009f0f0 2023-09-30T22:26:38.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.151+0000 7ff096325700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff090133ca0 0x7ff090134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.151+0000 7ff096325700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff090133ca0 0x7ff090134140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34382/0 (socket says 172.21.15.40:34382) 2023-09-30T22:26:38.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.151+0000 7ff096325700 1 -- 172.21.15.40:0/2636952658 learned_addr learned my addr 172.21.15.40:0/2636952658 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:38.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.151+0000 7ff095b24700 1 --2- 172.21.15.40:0/2636952658 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff09009d920 0x7ff09009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.151+0000 7f4e28979700 1 -- 172.21.15.40:0/1399380288 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e24131d50 msgr2=0x7f4e241c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.151+0000 7f4e28979700 1 --2- 172.21.15.40:0/1399380288 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e24131d50 0x7f4e241c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.151+0000 7f4e28979700 1 -- 172.21.15.40:0/1399380288 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e2409c7d0 msgr2=0x7f4e24134d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.151+0000 7f4e28979700 1 --2- 172.21.15.40:0/1399380288 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e2409c7d0 0x7f4e24134d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.151+0000 7f4e28979700 1 -- 172.21.15.40:0/1399380288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e18009550 con 0x7f4e2409bc50 2023-09-30T22:26:38.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.151+0000 7ff096325700 1 -- 172.21.15.40:0/2636952658 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff09009f0f0 msgr2=0x7ff09009e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:38.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.151+0000 7ff096325700 1 --2- 172.21.15.40:0/2636952658 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff09009f0f0 0x7ff09009e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.151+0000 7ff096325700 1 -- 172.21.15.40:0/2636952658 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff09009d920 msgr2=0x7ff09009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:38.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.151+0000 7ff096325700 1 --2- 172.21.15.40:0/2636952658 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff09009d920 0x7ff09009dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.151+0000 7ff096325700 1 -- 172.21.15.40:0/2636952658 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09009f6e0 con 0x7ff090133ca0 2023-09-30T22:26:38.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.152+0000 7f4e28979700 1 --2- 172.21.15.40:0/1399380288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e2409bc50 0x7f4e24134840 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4e18016000 tx=0x7f4e18004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:38.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.152+0000 7ff096325700 1 --2- 172.21.15.40:0/2636952658 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff090133ca0 0x7ff090134140 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff088009e80 tx=0x7ff08800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a953cc8c53e77f58 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:38.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.152+0000 7f4e217fa700 1 -- 172.21.15.40:0/1399380288 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e18004510 con 0x7f4e2409bc50 2023-09-30T22:26:38.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.152+0000 7f4e217fa700 1 -- 172.21.15.40:0/1399380288 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e180036a0 con 0x7f4e2409bc50 2023-09-30T22:26:38.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.152+0000 7ff094b22700 1 -- 172.21.15.40:0/2636952658 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08800e070 con 0x7ff090133ca0 2023-09-30T22:26:38.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.152+0000 7f4e217fa700 1 -- 172.21.15.40:0/1399380288 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e18003a10 con 0x7f4e2409bc50 2023-09-30T22:26:38.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.152+0000 7ff094b22700 1 -- 172.21.15.40:0/2636952658 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08800b8d0 con 0x7ff090133ca0 2023-09-30T22:26:38.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.152+0000 7ff094b22700 1 -- 172.21.15.40:0/2636952658 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08800bc80 con 0x7ff090133ca0 2023-09-30T22:26:38.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.152+0000 7f4e2abdd700 1 -- 172.21.15.40:0/1399380288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e241352c0 con 0x7f4e2409bc50 2023-09-30T22:26:38.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.152+0000 7f4e2abdd700 1 -- 172.21.15.40:0/1399380288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e24136750 con 0x7f4e2409bc50 2023-09-30T22:26:38.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.153+0000 7ff097d88700 1 -- 172.21.15.40:0/2636952658 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff090133ca0 msgr2=0x7ff090134140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.153+0000 7ff097d88700 1 --2- 172.21.15.40:0/2636952658 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff090133ca0 0x7ff090134140 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff088009e80 tx=0x7ff08800b330 comp rx=0 tx=0).stop 2023-09-30T22:26:38.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.153+0000 7f4e2abdd700 1 -- 172.21.15.40:0/1399380288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e24062380 con 0x7f4e2409bc50 2023-09-30T22:26:38.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.154+0000 7f4e217fa700 1 -- 172.21.15.40:0/1399380288 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4e18003b70 con 0x7f4e2409bc50 2023-09-30T22:26:38.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.154+0000 7f4e217fa700 1 -- 172.21.15.40:0/1399380288 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4e180405c0 con 0x7f4e2409bc50 2023-09-30T22:26:38.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.157+0000 7ff097d88700 1 -- 172.21.15.40:0/2636952658 shutdown_connections 2023-09-30T22:26:38.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.158+0000 7ff097d88700 1 --2- 172.21.15.40:0/2636952658 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff090133ca0 0x7ff090134140 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.158+0000 7ff097d88700 1 --2- 172.21.15.40:0/2636952658 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff09009d920 0x7ff09009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.158+0000 7ff097d88700 1 --2- 172.21.15.40:0/2636952658 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff09009f0f0 0x7ff09009e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.158+0000 7ff097d88700 1 -- 172.21.15.40:0/2636952658 >> 172.21.15.40:0/2636952658 conn(0x7ff09009fb20 msgr2=0x7ff09009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:38.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.158+0000 7f4e217fa700 1 -- 172.21.15.40:0/1399380288 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4e1802b760 con 0x7f4e2409bc50 2023-09-30T22:26:38.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.158+0000 7ff097d88700 1 -- 172.21.15.40:0/2636952658 shutdown_connections 2023-09-30T22:26:38.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.159+0000 7ff097d88700 1 -- 172.21.15.40:0/2636952658 wait complete. 2023-09-30T22:26:38.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.160+0000 7ff097d88700 1 Processor -- start 2023-09-30T22:26:38.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.160+0000 7ff097d88700 1 -- start start 2023-09-30T22:26:38.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.161+0000 7ff097d88700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff09009d920 0x7ff090122930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.161+0000 7ff097d88700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff090133ca0 0x7ff090122e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.161+0000 7ff097d88700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0901233b0 0x7ff0901c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.161+0000 7ff097d88700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff090123800 con 0x7ff0901233b0 2023-09-30T22:26:38.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.161+0000 7ff097d88700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff090125eb0 con 0x7ff090133ca0 2023-09-30T22:26:38.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.161+0000 7ff097d88700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0901334c0 con 0x7ff09009d920 2023-09-30T22:26:38.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.161+0000 7ff095b24700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff09009d920 0x7ff090122930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.161+0000 7ff095b24700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff09009d920 0x7ff090122930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:44532/0 (socket says 172.21.15.40:44532) 2023-09-30T22:26:38.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.161+0000 7ff095b24700 1 -- 172.21.15.40:0/3160885499 learned_addr learned my addr 172.21.15.40:0/3160885499 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:38.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.161+0000 7ff095b24700 1 -- 172.21.15.40:0/3160885499 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff090133ca0 msgr2=0x7ff090122e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.161+0000 7ff095b24700 1 --2- 172.21.15.40:0/3160885499 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff090133ca0 0x7ff090122e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.161+0000 7ff095b24700 1 -- 172.21.15.40:0/3160885499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0901233b0 msgr2=0x7ff0901c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.161+0000 7ff095b24700 1 --2- 172.21.15.40:0/3160885499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0901233b0 0x7ff0901c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.161+0000 7ff095b24700 1 -- 172.21.15.40:0/3160885499 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff088009b30 con 0x7ff09009d920 2023-09-30T22:26:38.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.162+0000 7ff095b24700 1 --2- 172.21.15.40:0/3160885499 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff09009d920 0x7ff090122930 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff08c00e930 tx=0x7ff08c00ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:38.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.162+0000 7ff0867fc700 1 -- 172.21.15.40:0/3160885499 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c009650 con 0x7ff09009d920 2023-09-30T22:26:38.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.162+0000 7ff0867fc700 1 -- 172.21.15.40:0/3160885499 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08c00c850 con 0x7ff09009d920 2023-09-30T22:26:38.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.162+0000 7ff097d88700 1 -- 172.21.15.40:0/3160885499 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff090126450 con 0x7ff09009d920 2023-09-30T22:26:38.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.162+0000 7ff0867fc700 1 -- 172.21.15.40:0/3160885499 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c00cbc0 con 0x7ff09009d920 2023-09-30T22:26:38.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.162+0000 7ff097d88700 1 -- 172.21.15.40:0/3160885499 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff09009c9e0 con 0x7ff09009d920 2023-09-30T22:26:38.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.163+0000 7ff0867fc700 1 -- 172.21.15.40:0/3160885499 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff08c00cd20 con 0x7ff09009d920 2023-09-30T22:26:38.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.163+0000 7ff0867fc700 1 -- 172.21.15.40:0/3160885499 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff08c03fc00 con 0x7ff09009d920 2023-09-30T22:26:38.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.163+0000 7ff097d88700 1 -- 172.21.15.40:0/3160885499 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff090062380 con 0x7ff09009d920 2023-09-30T22:26:38.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.172+0000 7ff0867fc700 1 -- 172.21.15.40:0/3160885499 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff08c017080 con 0x7ff09009d920 2023-09-30T22:26:38.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.178+0000 7f7b47b4c700 1 Processor -- start 2023-09-30T22:26:38.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.179+0000 7f7b47b4c700 1 -- start start 2023-09-30T22:26:38.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.179+0000 7f7b47b4c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7b4012e590 0x7f7b4012e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.179+0000 7f7b47b4c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7b4012eea0 0x7f7b4012d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.179+0000 7f7b47b4c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4009ab70 con 0x7f7b4012d6d0 2023-09-30T22:26:38.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.179+0000 7f7b47b4c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b4009b270 con 0x7f7b4012e590 2023-09-30T22:26:38.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.179+0000 7f7b47b4c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4009bab0 con 0x7f7b4012eea0 2023-09-30T22:26:38.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.179+0000 7f7b460e9700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7b4012d6d0 0x7f7b40137c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46706/0 (socket says 172.21.15.40:46706) 2023-09-30T22:26:38.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.179+0000 7f7b460e9700 1 -- 172.21.15.40:0/2009672596 learned_addr learned my addr 172.21.15.40:0/2009672596 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:38.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.179+0000 7f7b450e7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7b4012eea0 0x7f7b4012d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.179+0000 7f7b458e8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7b4012e590 0x7f7b4012e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.180+0000 7f7b450e7700 1 -- 172.21.15.40:0/2009672596 >> v2:172.21.15.40:3300/0 conn(0x7f7b4012e590 msgr2=0x7f7b4012e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:38.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.180+0000 7f7b450e7700 1 --2- 172.21.15.40:0/2009672596 >> v2:172.21.15.40:3300/0 conn(0x7f7b4012e590 0x7f7b4012e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.180+0000 7f7b450e7700 1 -- 172.21.15.40:0/2009672596 >> v1:172.21.15.40:6789/0 conn(0x7f7b4012d6d0 legacy=0x7f7b40137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.180+0000 7f7b450e7700 1 -- 172.21.15.40:0/2009672596 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4009bd70 con 0x7f7b4012eea0 2023-09-30T22:26:38.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.180+0000 7f7b450e7700 1 --2- 172.21.15.40:0/2009672596 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7b4012eea0 0x7f7b4012d190 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7b30009870 tx=0x7f7b30009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a07200643729faac server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:38.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.180+0000 7f7b448e6700 1 -- 172.21.15.40:0/2009672596 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b30011830 con 0x7f7b4012eea0 2023-09-30T22:26:38.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.180+0000 7f7b448e6700 1 -- 172.21.15.40:0/2009672596 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b30011990 con 0x7f7b4012eea0 2023-09-30T22:26:38.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.180+0000 7f7b448e6700 1 -- 172.21.15.40:0/2009672596 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b30011d20 con 0x7f7b4012eea0 2023-09-30T22:26:38.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.181+0000 7f7b47b4c700 1 -- 172.21.15.40:0/2009672596 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7b4012eea0 msgr2=0x7f7b4012d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.181+0000 7f7b47b4c700 1 --2- 172.21.15.40:0/2009672596 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7b4012eea0 0x7f7b4012d190 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7b30009870 tx=0x7f7b30009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:38.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.181+0000 7f7b47b4c700 1 -- 172.21.15.40:0/2009672596 shutdown_connections 2023-09-30T22:26:38.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.181+0000 7f7b47b4c700 1 --2- 172.21.15.40:0/2009672596 >> v2:172.21.15.40:3300/0 conn(0x7f7b4012e590 0x7f7b4012e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.181+0000 7f7b47b4c700 1 --2- 172.21.15.40:0/2009672596 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7b4012eea0 0x7f7b4012d190 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.181+0000 7f7b47b4c700 1 -- 172.21.15.40:0/2009672596 >> 172.21.15.40:0/2009672596 conn(0x7f7b400a2a00 msgr2=0x7f7b400a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:38.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.181+0000 7f7b47b4c700 1 -- 172.21.15.40:0/2009672596 shutdown_connections 2023-09-30T22:26:38.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.181+0000 7f7b47b4c700 1 -- 172.21.15.40:0/2009672596 wait complete. 2023-09-30T22:26:38.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.182+0000 7f7b47b4c700 1 Processor -- start 2023-09-30T22:26:38.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.182+0000 7f7b47b4c700 1 -- start start 2023-09-30T22:26:38.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.182+0000 7f7b47b4c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b4012d6d0 0x7f7b40079ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.182+0000 7f7b47b4c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b4012e590 0x7f7b4007a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.182+0000 7f7b47b4c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7b4012eea0 0x7f7b4007aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.182+0000 7f7b47b4c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4007b4c0 con 0x7f7b4012e590 2023-09-30T22:26:38.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.182+0000 7f7b47b4c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4009b520 con 0x7f7b4012d6d0 2023-09-30T22:26:38.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.182+0000 7f7b47b4c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4007bcf0 con 0x7f7b4012eea0 2023-09-30T22:26:38.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.183+0000 7f7b458e8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b4012d6d0 0x7f7b40079ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.183+0000 7f7b460e9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7b4012eea0 0x7f7b4007aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.183+0000 7f7b458e8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b4012d6d0 0x7f7b40079ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38002/0 (socket says 172.21.15.40:38002) 2023-09-30T22:26:38.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.183+0000 7f7b458e8700 1 -- 172.21.15.40:0/2352461621 learned_addr learned my addr 172.21.15.40:0/2352461621 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:38.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.183+0000 7f7b450e7700 1 --2- 172.21.15.40:0/2352461621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b4012e590 0x7f7b4007a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.183+0000 7f7b460e9700 1 -- 172.21.15.40:0/2352461621 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b4012d6d0 msgr2=0x7f7b40079ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.183+0000 7f7b460e9700 1 --2- 172.21.15.40:0/2352461621 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b4012d6d0 0x7f7b40079ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.183+0000 7f7b460e9700 1 -- 172.21.15.40:0/2352461621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b4012e590 msgr2=0x7f7b4007a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.183+0000 7f7b460e9700 1 --2- 172.21.15.40:0/2352461621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b4012e590 0x7f7b4007a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.183+0000 7f7b460e9700 1 -- 172.21.15.40:0/2352461621 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b300094a0 con 0x7f7b4012eea0 2023-09-30T22:26:38.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.183+0000 7f7b458e8700 1 --2- 172.21.15.40:0/2352461621 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b4012d6d0 0x7f7b40079ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:38.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.183+0000 7f7b460e9700 1 --2- 172.21.15.40:0/2352461621 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7b4012eea0 0x7f7b4007aa70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7b3800cad0 tx=0x7f7b3800cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:38.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.183+0000 7f7b367fc700 1 -- 172.21.15.40:0/2352461621 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3800a900 con 0x7f7b4012eea0 2023-09-30T22:26:38.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.183+0000 7f7b47b4c700 1 -- 172.21.15.40:0/2352461621 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b4007c3d0 con 0x7f7b4012eea0 2023-09-30T22:26:38.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.183+0000 7f7b367fc700 1 -- 172.21.15.40:0/2352461621 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3800aa60 con 0x7f7b4012eea0 2023-09-30T22:26:38.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.183+0000 7f7b367fc700 1 -- 172.21.15.40:0/2352461621 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3800add0 con 0x7f7b4012eea0 2023-09-30T22:26:38.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.183+0000 7f7b47b4c700 1 -- 172.21.15.40:0/2352461621 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b4007dae0 con 0x7f7b4012eea0 2023-09-30T22:26:38.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.185+0000 7f7b367fc700 1 -- 172.21.15.40:0/2352461621 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7b3801b3b0 con 0x7f7b4012eea0 2023-09-30T22:26:38.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.185+0000 7f7b47b4c700 1 -- 172.21.15.40:0/2352461621 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b40062380 con 0x7f7b4012eea0 2023-09-30T22:26:38.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.185+0000 7f7b367fc700 1 -- 172.21.15.40:0/2352461621 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f7b3803f350 con 0x7f7b4012eea0 2023-09-30T22:26:38.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.194+0000 7f7b367fc700 1 -- 172.21.15.40:0/2352461621 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7b38017080 con 0x7f7b4012eea0 2023-09-30T22:26:38.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.241+0000 7f8298b3e700 1 Processor -- start 2023-09-30T22:26:38.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.241+0000 7f8298b3e700 1 -- start start 2023-09-30T22:26:38.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.241+0000 7f8298b3e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f829409c890 0x7f829409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.241+0000 7f8298b3e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f829409d920 0x7f829409dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.242+0000 7f8298b3e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f829409e2b0 0x7f829413ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.242+0000 7f8298b3e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82940a29d0 con 0x7f829409c890 2023-09-30T22:26:38.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.242+0000 7f8298b3e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829409fb40 con 0x7f829409e2b0 2023-09-30T22:26:38.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.242+0000 7f8298b3e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82940a2600 con 0x7f829409d920 2023-09-30T22:26:38.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.242+0000 7f829259c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f829409c890 0x7f829409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.242+0000 7f829259c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f829409c890 0x7f829409cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34418/0 (socket says 172.21.15.40:34418) 2023-09-30T22:26:38.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.242+0000 7f8291d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f829409d920 0x7f829409dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.242+0000 7f829259c700 1 -- 172.21.15.40:0/4065481400 learned_addr learned my addr 172.21.15.40:0/4065481400 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:38.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.242+0000 7f8292d9d700 1 --2- 172.21.15.40:0/4065481400 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f829409e2b0 0x7f829413ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.242+0000 7f8291d9b700 1 -- 172.21.15.40:0/4065481400 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f829409e2b0 msgr2=0x7f829413ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:38.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.242+0000 7f8291d9b700 1 --2- 172.21.15.40:0/4065481400 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f829409e2b0 0x7f829413ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.242+0000 7f8291d9b700 1 -- 172.21.15.40:0/4065481400 >> v2:172.21.15.40:3300/0 conn(0x7f829409c890 msgr2=0x7f829409cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:38.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.242+0000 7f8291d9b700 1 --2- 172.21.15.40:0/4065481400 >> v2:172.21.15.40:3300/0 conn(0x7f829409c890 0x7f829409cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.242+0000 7f8291d9b700 1 -- 172.21.15.40:0/4065481400 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829409fed0 con 0x7f829409d920 2023-09-30T22:26:38.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.242+0000 7f8291d9b700 1 --2- 172.21.15.40:0/4065481400 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f829409d920 0x7f829409dd70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8288009840 tx=0x7f8288009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfdb3aed4489f6da server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:38.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.243+0000 7f829159a700 1 -- 172.21.15.40:0/4065481400 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8288011830 con 0x7f829409d920 2023-09-30T22:26:38.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.243+0000 7f829159a700 1 -- 172.21.15.40:0/4065481400 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8288011990 con 0x7f829409d920 2023-09-30T22:26:38.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.243+0000 7f829159a700 1 -- 172.21.15.40:0/4065481400 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8288011d20 con 0x7f829409d920 2023-09-30T22:26:38.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.243+0000 7f8298b3e700 1 -- 172.21.15.40:0/4065481400 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f829409d920 msgr2=0x7f829409dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.243+0000 7f8298b3e700 1 --2- 172.21.15.40:0/4065481400 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f829409d920 0x7f829409dd70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8288009840 tx=0x7f8288009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:38.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.244+0000 7f8298b3e700 1 -- 172.21.15.40:0/4065481400 shutdown_connections 2023-09-30T22:26:38.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.244+0000 7f8298b3e700 1 --2- 172.21.15.40:0/4065481400 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f829409e2b0 0x7f829413ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.244+0000 7f8298b3e700 1 --2- 172.21.15.40:0/4065481400 >> v2:172.21.15.40:3300/0 conn(0x7f829409c890 0x7f829409cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.244+0000 7f8298b3e700 1 --2- 172.21.15.40:0/4065481400 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f829409d920 0x7f829409dd70 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.244+0000 7f8298b3e700 1 -- 172.21.15.40:0/4065481400 >> 172.21.15.40:0/4065481400 conn(0x7f82940a7080 msgr2=0x7f82940a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:38.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.244+0000 7f8298b3e700 1 -- 172.21.15.40:0/4065481400 shutdown_connections 2023-09-30T22:26:38.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.244+0000 7f8298b3e700 1 -- 172.21.15.40:0/4065481400 wait complete. 2023-09-30T22:26:38.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.245+0000 7f8298b3e700 1 Processor -- start 2023-09-30T22:26:38.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.245+0000 7f8298b3e700 1 -- start start 2023-09-30T22:26:38.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.246+0000 7f8298b3e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f829409c890 0x7f829412d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.246+0000 7f8298b3e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f829409d920 0x7f829412d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.246+0000 7f8298b3e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f829409e2b0 0x7f829412dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.246+0000 7f8298b3e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82940a5d60 con 0x7f829409c890 2023-09-30T22:26:38.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.246+0000 7f8298b3e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8294130560 con 0x7f829409e2b0 2023-09-30T22:26:38.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.246+0000 7f8298b3e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f829409c310 con 0x7f829409d920 2023-09-30T22:26:38.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.246+0000 7f829259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f829409c890 0x7f829412d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.246+0000 7f829259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f829409c890 0x7f829412d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34424/0 (socket says 172.21.15.40:34424) 2023-09-30T22:26:38.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.246+0000 7f829259c700 1 -- 172.21.15.40:0/1353465287 learned_addr learned my addr 172.21.15.40:0/1353465287 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:38.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.246+0000 7f8291d9b700 1 --2- 172.21.15.40:0/1353465287 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f829409d920 0x7f829412d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.246+0000 7f8292d9d700 1 --2- 172.21.15.40:0/1353465287 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f829409e2b0 0x7f829412dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.247+0000 7f829259c700 1 -- 172.21.15.40:0/1353465287 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f829409d920 msgr2=0x7f829412d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.247+0000 7f829259c700 1 --2- 172.21.15.40:0/1353465287 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f829409d920 0x7f829412d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.247+0000 7f829259c700 1 -- 172.21.15.40:0/1353465287 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f829409e2b0 msgr2=0x7f829412dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.247+0000 7f829259c700 1 --2- 172.21.15.40:0/1353465287 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f829409e2b0 0x7f829412dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.247+0000 7f829259c700 1 -- 172.21.15.40:0/1353465287 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82880094a0 con 0x7f829409c890 2023-09-30T22:26:38.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.247+0000 7f829259c700 1 --2- 172.21.15.40:0/1353465287 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f829409c890 0x7f829412d210 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f828400e840 tx=0x7f828400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:38.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.247+0000 7f8282ffd700 1 -- 172.21.15.40:0/1353465287 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8284013680 con 0x7f829409c890 2023-09-30T22:26:38.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.247+0000 7f8282ffd700 1 -- 172.21.15.40:0/1353465287 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82840137e0 con 0x7f829409c890 2023-09-30T22:26:38.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.247+0000 7f8298b3e700 1 -- 172.21.15.40:0/1353465287 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8294130070 con 0x7f829409c890 2023-09-30T22:26:38.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.247+0000 7f8282ffd700 1 -- 172.21.15.40:0/1353465287 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8284013b50 con 0x7f829409c890 2023-09-30T22:26:38.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.247+0000 7f8298b3e700 1 -- 172.21.15.40:0/1353465287 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f829412e1d0 con 0x7f829409c890 2023-09-30T22:26:38.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.248+0000 7f8282ffd700 1 -- 172.21.15.40:0/1353465287 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8284013cb0 con 0x7f829409c890 2023-09-30T22:26:38.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.248+0000 7f8282ffd700 1 -- 172.21.15.40:0/1353465287 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f828403f8c0 con 0x7f829409c890 2023-09-30T22:26:38.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.249+0000 7f8298b3e700 1 -- 172.21.15.40:0/1353465287 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82941306a0 con 0x7f829409c890 2023-09-30T22:26:38.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.255+0000 7f8282ffd700 1 -- 172.21.15.40:0/1353465287 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8284017080 con 0x7f829409c890 2023-09-30T22:26:38.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.365+0000 7f4e2abdd700 1 -- 172.21.15.40:0/1399380288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4e241366f0 con 0x7f4e2409bc50 2023-09-30T22:26:38.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.366+0000 7f4e217fa700 1 -- 172.21.15.40:0/1399380288 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4e18031020 con 0x7f4e2409bc50 2023-09-30T22:26:38.366 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.368+0000 7f4e2abdd700 1 -- 172.21.15.40:0/1399380288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e2409bc50 msgr2=0x7f4e24134840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.368+0000 7f4e2abdd700 1 --2- 172.21.15.40:0/1399380288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e2409bc50 0x7f4e24134840 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4e18016000 tx=0x7f4e18004750 comp rx=0 tx=0).stop 2023-09-30T22:26:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.368+0000 7f4e2abdd700 1 -- 172.21.15.40:0/1399380288 shutdown_connections 2023-09-30T22:26:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.368+0000 7f4e2abdd700 1 --2- 172.21.15.40:0/1399380288 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e24131d50 0x7f4e241c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.368+0000 7f4e2abdd700 1 --2- 172.21.15.40:0/1399380288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e2409bc50 0x7f4e24134840 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.368+0000 7f4e2abdd700 1 --2- 172.21.15.40:0/1399380288 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e2409c7d0 0x7f4e24134d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.368+0000 7f4e2abdd700 1 -- 172.21.15.40:0/1399380288 >> 172.21.15.40:0/1399380288 conn(0x7f4e240a2a00 msgr2=0x7f4e24130cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.369+0000 7f4e2abdd700 1 -- 172.21.15.40:0/1399380288 shutdown_connections 2023-09-30T22:26:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.369+0000 7f4e2abdd700 1 -- 172.21.15.40:0/1399380288 wait complete. 2023-09-30T22:26:38.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.374+0000 7ff097d88700 1 -- 172.21.15.40:0/3160885499 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff090074720 con 0x7ff09009d920 2023-09-30T22:26:38.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.375+0000 7ff0867fc700 1 -- 172.21.15.40:0/3160885499 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff08c021020 con 0x7ff09009d920 2023-09-30T22:26:38.375 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:38.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.377+0000 7ff097d88700 1 -- 172.21.15.40:0/3160885499 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff09009d920 msgr2=0x7ff090122930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.377+0000 7ff097d88700 1 --2- 172.21.15.40:0/3160885499 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff09009d920 0x7ff090122930 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff08c00e930 tx=0x7ff08c00ecf0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.377+0000 7ff097d88700 1 -- 172.21.15.40:0/3160885499 shutdown_connections 2023-09-30T22:26:38.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.377+0000 7ff097d88700 1 --2- 172.21.15.40:0/3160885499 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff09009d920 0x7ff090122930 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.377+0000 7ff097d88700 1 --2- 172.21.15.40:0/3160885499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0901233b0 0x7ff0901c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.377+0000 7ff097d88700 1 --2- 172.21.15.40:0/3160885499 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff090133ca0 0x7ff090122e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.377+0000 7ff097d88700 1 -- 172.21.15.40:0/3160885499 >> 172.21.15.40:0/3160885499 conn(0x7ff09009fb20 msgr2=0x7ff0900a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:38.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.377+0000 7ff097d88700 1 -- 172.21.15.40:0/3160885499 shutdown_connections 2023-09-30T22:26:38.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.377+0000 7ff097d88700 1 -- 172.21.15.40:0/3160885499 wait complete. 2023-09-30T22:26:38.383 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:38.390 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:38.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.430+0000 7f7b47b4c700 1 -- 172.21.15.40:0/2352461621 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7b40071950 con 0x7f7b4012eea0 2023-09-30T22:26:38.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.430+0000 7f7b367fc700 1 -- 172.21.15.40:0/2352461621 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7b380192c0 con 0x7f7b4012eea0 2023-09-30T22:26:38.431 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:38.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.433+0000 7f7b47b4c700 1 -- 172.21.15.40:0/2352461621 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7b4012eea0 msgr2=0x7f7b4007aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.433+0000 7f7b47b4c700 1 --2- 172.21.15.40:0/2352461621 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7b4012eea0 0x7f7b4007aa70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7b3800cad0 tx=0x7f7b3800cde0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.433+0000 7f7b47b4c700 1 -- 172.21.15.40:0/2352461621 shutdown_connections 2023-09-30T22:26:38.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.433+0000 7f7b47b4c700 1 --2- 172.21.15.40:0/2352461621 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7b4012eea0 0x7f7b4007aa70 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.433+0000 7f7b47b4c700 1 --2- 172.21.15.40:0/2352461621 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b4012d6d0 0x7f7b40079ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.433+0000 7f7b47b4c700 1 --2- 172.21.15.40:0/2352461621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b4012e590 0x7f7b4007a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.433+0000 7f7b47b4c700 1 -- 172.21.15.40:0/2352461621 >> 172.21.15.40:0/2352461621 conn(0x7f7b400a2a00 msgr2=0x7f7b40130e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:38.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.433+0000 7f7b47b4c700 1 -- 172.21.15.40:0/2352461621 shutdown_connections 2023-09-30T22:26:38.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.433+0000 7f7b47b4c700 1 -- 172.21.15.40:0/2352461621 wait complete. 2023-09-30T22:26:38.445 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:38.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.473+0000 7f8298b3e700 1 -- 172.21.15.40:0/1353465287 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8294062380 con 0x7f829409c890 2023-09-30T22:26:38.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.473+0000 7f8282ffd700 1 -- 172.21.15.40:0/1353465287 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f82840117c0 con 0x7f829409c890 2023-09-30T22:26:38.474 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:38.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.475+0000 7f8298b3e700 1 -- 172.21.15.40:0/1353465287 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f829409c890 msgr2=0x7f829412d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.475+0000 7f8298b3e700 1 --2- 172.21.15.40:0/1353465287 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f829409c890 0x7f829412d210 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f828400e840 tx=0x7f828400eb50 comp rx=0 tx=0).stop 2023-09-30T22:26:38.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.475+0000 7f8298b3e700 1 -- 172.21.15.40:0/1353465287 shutdown_connections 2023-09-30T22:26:38.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.475+0000 7f8298b3e700 1 --2- 172.21.15.40:0/1353465287 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f829409e2b0 0x7f829412dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.475+0000 7f8298b3e700 1 --2- 172.21.15.40:0/1353465287 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f829409c890 0x7f829412d210 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.475+0000 7f8298b3e700 1 --2- 172.21.15.40:0/1353465287 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f829409d920 0x7f829412d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.475+0000 7f8298b3e700 1 -- 172.21.15.40:0/1353465287 >> 172.21.15.40:0/1353465287 conn(0x7f82940a7080 msgr2=0x7f82940a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:38.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.475+0000 7f8298b3e700 1 -- 172.21.15.40:0/1353465287 shutdown_connections 2023-09-30T22:26:38.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:38.475+0000 7f8298b3e700 1 -- 172.21.15.40:0/1353465287 wait complete. 2023-09-30T22:26:38.488 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:39.384 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:39.392 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:39.446 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:39.489 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:39.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.539+0000 7fdf106dc700 1 Processor -- start 2023-09-30T22:26:39.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.539+0000 7fdf106dc700 1 -- start start 2023-09-30T22:26:39.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.539+0000 7fdf106dc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf0809df30 0x7fdf08135400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.539+0000 7fdf106dc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdf08135940 0x7fdf08137d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.539+0000 7fdf106dc700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf0809e8b0 con 0x7fdf0809d450 2023-09-30T22:26:39.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.539+0000 7fdf106dc700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf0809c3b0 con 0x7fdf08135940 2023-09-30T22:26:39.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.539+0000 7fdf106dc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0809a6b0 con 0x7fdf0809df30 2023-09-30T22:26:39.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.540+0000 7fdf0ec79700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdf08135940 0x7fdf08137d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.540+0000 7fdf0ec79700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdf08135940 0x7fdf08137d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34436/0 (socket says 172.21.15.40:34436) 2023-09-30T22:26:39.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.540+0000 7fdf0ec79700 1 -- 172.21.15.40:0/1867379411 learned_addr learned my addr 172.21.15.40:0/1867379411 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:39.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.540+0000 7fdf0dc77700 1 --2- 172.21.15.40:0/1867379411 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf0809df30 0x7fdf08135400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.540+0000 7fdf0ec79700 1 -- 172.21.15.40:0/1867379411 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf0809df30 msgr2=0x7fdf08135400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:39.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.540+0000 7fdf0ec79700 1 --2- 172.21.15.40:0/1867379411 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf0809df30 0x7fdf08135400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.540+0000 7fdf0ec79700 1 -- 172.21.15.40:0/1867379411 >> v1:172.21.15.40:6789/0 conn(0x7fdf0809d450 legacy=0x7fdf0809d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.540+0000 7fdf0ec79700 1 -- 172.21.15.40:0/1867379411 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0809b4f0 con 0x7fdf08135940 2023-09-30T22:26:39.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.540+0000 7fdf0ec79700 1 --2- 172.21.15.40:0/1867379411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf08135940 0x7fdf08137d20 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fdf0000d150 tx=0x7fdf0000d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5494a79b04be2129 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:39.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.540+0000 7fdf0d476700 1 -- 172.21.15.40:0/1867379411 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf00010070 con 0x7fdf08135940 2023-09-30T22:26:39.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.541+0000 7fdf0d476700 1 -- 172.21.15.40:0/1867379411 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf0000db00 con 0x7fdf08135940 2023-09-30T22:26:39.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.541+0000 7fdf0d476700 1 -- 172.21.15.40:0/1867379411 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf00016400 con 0x7fdf08135940 2023-09-30T22:26:39.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.541+0000 7fdf106dc700 1 -- 172.21.15.40:0/1867379411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf08135940 msgr2=0x7fdf08137d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.541+0000 7fdf106dc700 1 --2- 172.21.15.40:0/1867379411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf08135940 0x7fdf08137d20 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fdf0000d150 tx=0x7fdf0000d460 comp rx=0 tx=0).stop 2023-09-30T22:26:39.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.541+0000 7fdf106dc700 1 -- 172.21.15.40:0/1867379411 shutdown_connections 2023-09-30T22:26:39.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.541+0000 7fdf106dc700 1 --2- 172.21.15.40:0/1867379411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf08135940 0x7fdf08137d20 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.541+0000 7fdf106dc700 1 --2- 172.21.15.40:0/1867379411 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf0809df30 0x7fdf08135400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.541+0000 7fdf106dc700 1 -- 172.21.15.40:0/1867379411 >> 172.21.15.40:0/1867379411 conn(0x7fdf080a2a00 msgr2=0x7fdf080a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:39.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.541+0000 7fdf106dc700 1 -- 172.21.15.40:0/1867379411 shutdown_connections 2023-09-30T22:26:39.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.541+0000 7fdf106dc700 1 -- 172.21.15.40:0/1867379411 wait complete. 2023-09-30T22:26:39.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.542+0000 7fdf106dc700 1 Processor -- start 2023-09-30T22:26:39.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.542+0000 7fdf106dc700 1 -- start start 2023-09-30T22:26:39.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.543+0000 7fdf106dc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf0809d450 0x7fdf0806e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.543+0000 7fdf106dc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf0809df30 0x7fdf0806e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.543+0000 7fdf106dc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf08135940 0x7fdf0806ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.543+0000 7fdf106dc700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf08070c40 con 0x7fdf0809df30 2023-09-30T22:26:39.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.543+0000 7fdf106dc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0811d710 con 0x7fdf0809d450 2023-09-30T22:26:39.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.543+0000 7fdf106dc700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0806fec0 con 0x7fdf08135940 2023-09-30T22:26:39.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.543+0000 7fdf0dc77700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf0809df30 0x7fdf0806e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.543+0000 7fdf0dc77700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf0809df30 0x7fdf0806e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34444/0 (socket says 172.21.15.40:34444) 2023-09-30T22:26:39.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.543+0000 7fdf0dc77700 1 -- 172.21.15.40:0/2619477198 learned_addr learned my addr 172.21.15.40:0/2619477198 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:39.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.543+0000 7fdf0ec79700 1 --2- 172.21.15.40:0/2619477198 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf08135940 0x7fdf0806ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.544+0000 7fdf0dc77700 1 -- 172.21.15.40:0/2619477198 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf08135940 msgr2=0x7fdf0806ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.544+0000 7fdf0dc77700 1 --2- 172.21.15.40:0/2619477198 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf08135940 0x7fdf0806ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.544+0000 7fdf0dc77700 1 -- 172.21.15.40:0/2619477198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf0809d450 msgr2=0x7fdf0806e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.544+0000 7fdf0dc77700 1 --2- 172.21.15.40:0/2619477198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf0809d450 0x7fdf0806e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.544+0000 7fdf0dc77700 1 -- 172.21.15.40:0/2619477198 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0000bd40 con 0x7fdf0809df30 2023-09-30T22:26:39.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.544+0000 7fdf0ec79700 1 --2- 172.21.15.40:0/2619477198 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf08135940 0x7fdf0806ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:39.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.544+0000 7fdf0dc77700 1 --2- 172.21.15.40:0/2619477198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf0809df30 0x7fdf0806e9d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fdef800e9e0 tx=0x7fdef800ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:39.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.544+0000 7fdefeffd700 1 -- 172.21.15.40:0/2619477198 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef8009710 con 0x7fdf0809df30 2023-09-30T22:26:39.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.544+0000 7fdf106dc700 1 -- 172.21.15.40:0/2619477198 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf080a23b0 con 0x7fdf0809df30 2023-09-30T22:26:39.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.544+0000 7fdf106dc700 1 -- 172.21.15.40:0/2619477198 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf08070fb0 con 0x7fdf0809df30 2023-09-30T22:26:39.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.544+0000 7fdefeffd700 1 -- 172.21.15.40:0/2619477198 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef800c850 con 0x7fdf0809df30 2023-09-30T22:26:39.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.544+0000 7fdefeffd700 1 -- 172.21.15.40:0/2619477198 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef800cbc0 con 0x7fdf0809df30 2023-09-30T22:26:39.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.546+0000 7fdf106dc700 1 -- 172.21.15.40:0/2619477198 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdef00052e0 con 0x7fdf0809df30 2023-09-30T22:26:39.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.546+0000 7fdefeffd700 1 -- 172.21.15.40:0/2619477198 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdef800cd20 con 0x7fdf0809df30 2023-09-30T22:26:39.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.546+0000 7fdefeffd700 1 -- 172.21.15.40:0/2619477198 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fdef803fe80 con 0x7fdf0809df30 2023-09-30T22:26:39.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.551+0000 7fdefeffd700 1 -- 172.21.15.40:0/2619477198 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdef801acf0 con 0x7fdf0809df30 2023-09-30T22:26:39.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.576+0000 7ffb3c082700 1 Processor -- start 2023-09-30T22:26:39.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.577+0000 7ffb3c082700 1 -- start start 2023-09-30T22:26:39.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.577+0000 7ffb3c082700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb3406f3a0 0x7ffb3406c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.577+0000 7ffb3c082700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb34139380 0x7ffb3413b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.578+0000 7ffb3c082700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb340a0780 con 0x7ffb3409fbb0 2023-09-30T22:26:39.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.578+0000 7ffb3c082700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3409ff80 con 0x7ffb34139380 2023-09-30T22:26:39.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.578+0000 7ffb3c082700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb340a0590 con 0x7ffb3406f3a0 2023-09-30T22:26:39.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.578+0000 7ffb39e1e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb3406f3a0 0x7ffb3406c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.578+0000 7ffb3961d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ffb3409fbb0 0x7ffb3406ced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46724/0 (socket says 172.21.15.40:46724) 2023-09-30T22:26:39.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.578+0000 7ffb3961d700 1 -- 172.21.15.40:0/360360954 learned_addr learned my addr 172.21.15.40:0/360360954 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:39.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.578+0000 7ffb3a61f700 1 --2- 172.21.15.40:0/360360954 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb34139380 0x7ffb3413b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.578+0000 7ffb38e1c700 1 -- 172.21.15.40:0/360360954 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1169273761 0 0) 0x7ffb340a0780 con 0x7ffb3409fbb0 2023-09-30T22:26:39.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.578+0000 7ffb38e1c700 1 -- 172.21.15.40:0/360360954 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb200035b0 con 0x7ffb3409fbb0 2023-09-30T22:26:39.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.578+0000 7ffb3a61f700 1 -- 172.21.15.40:0/360360954 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb3406f3a0 msgr2=0x7ffb3406c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:39.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.578+0000 7ffb3a61f700 1 --2- 172.21.15.40:0/360360954 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb3406f3a0 0x7ffb3406c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.578+0000 7ffb3a61f700 1 -- 172.21.15.40:0/360360954 >> v1:172.21.15.40:6789/0 conn(0x7ffb3409fbb0 legacy=0x7ffb3406ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.578+0000 7ffb3a61f700 1 -- 172.21.15.40:0/360360954 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb3406df90 con 0x7ffb34139380 2023-09-30T22:26:39.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.578+0000 7ffb3a61f700 1 --2- 172.21.15.40:0/360360954 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb34139380 0x7ffb3413b760 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c009dc0 tx=0x7ffb2c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=976770ba32986c42 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:39.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.579+0000 7ffb38e1c700 1 -- 172.21.15.40:0/360360954 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c00e070 con 0x7ffb34139380 2023-09-30T22:26:39.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.579+0000 7ffb38e1c700 1 -- 172.21.15.40:0/360360954 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2c00bb20 con 0x7ffb34139380 2023-09-30T22:26:39.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.579+0000 7ffb38e1c700 1 -- 172.21.15.40:0/360360954 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c012430 con 0x7ffb34139380 2023-09-30T22:26:39.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.579+0000 7ffb3c082700 1 -- 172.21.15.40:0/360360954 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb34139380 msgr2=0x7ffb3413b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.579+0000 7ffb3c082700 1 --2- 172.21.15.40:0/360360954 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb34139380 0x7ffb3413b760 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c009dc0 tx=0x7ffb2c00b330 comp rx=0 tx=0).stop 2023-09-30T22:26:39.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.579+0000 7ffb3c082700 1 -- 172.21.15.40:0/360360954 shutdown_connections 2023-09-30T22:26:39.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.579+0000 7ffb3c082700 1 --2- 172.21.15.40:0/360360954 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb34139380 0x7ffb3413b760 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.579+0000 7ffb3c082700 1 --2- 172.21.15.40:0/360360954 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb3406f3a0 0x7ffb3406c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.579+0000 7ffb3c082700 1 -- 172.21.15.40:0/360360954 >> 172.21.15.40:0/360360954 conn(0x7ffb340a41a0 msgr2=0x7ffb340a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:39.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.579+0000 7ffb3c082700 1 -- 172.21.15.40:0/360360954 shutdown_connections 2023-09-30T22:26:39.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.580+0000 7ffb3c082700 1 -- 172.21.15.40:0/360360954 wait complete. 2023-09-30T22:26:39.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.581+0000 7ffb3c082700 1 Processor -- start 2023-09-30T22:26:39.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.581+0000 7ffb3c082700 1 -- start start 2023-09-30T22:26:39.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.582+0000 7ffb3c082700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb3406f3a0 0x7ffb341385a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.582+0000 7ffb3c082700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb3409fbb0 0x7ffb34138ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.582+0000 7ffb3c082700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb34139380 0x7ffb34095930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.582+0000 7ffb3c082700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb34094ae0 con 0x7ffb3409fbb0 2023-09-30T22:26:39.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.582+0000 7ffb3c082700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb34094d50 con 0x7ffb34139380 2023-09-30T22:26:39.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.582+0000 7ffb3c082700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb340970d0 con 0x7ffb3406f3a0 2023-09-30T22:26:39.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.582+0000 7ffb39e1e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb3406f3a0 0x7ffb341385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.582+0000 7ffb39e1e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb3406f3a0 0x7ffb341385a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:44588/0 (socket says 172.21.15.40:44588) 2023-09-30T22:26:39.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.582+0000 7ffb39e1e700 1 -- 172.21.15.40:0/520698010 learned_addr learned my addr 172.21.15.40:0/520698010 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:39.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.582+0000 7ffb3961d700 1 --2- 172.21.15.40:0/520698010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb3409fbb0 0x7ffb34138ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.582+0000 7ffb3a61f700 1 --2- 172.21.15.40:0/520698010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb34139380 0x7ffb34095930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.582+0000 7ffb3961d700 1 -- 172.21.15.40:0/520698010 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb3406f3a0 msgr2=0x7ffb341385a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.582+0000 7ffb3961d700 1 --2- 172.21.15.40:0/520698010 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb3406f3a0 0x7ffb341385a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.582+0000 7ffb3961d700 1 -- 172.21.15.40:0/520698010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb34139380 msgr2=0x7ffb34095930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.582+0000 7ffb3961d700 1 --2- 172.21.15.40:0/520698010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb34139380 0x7ffb34095930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.582+0000 7ffb3961d700 1 -- 172.21.15.40:0/520698010 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb2c009a70 con 0x7ffb3409fbb0 2023-09-30T22:26:39.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.582+0000 7ffb39e1e700 1 --2- 172.21.15.40:0/520698010 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb3406f3a0 0x7ffb341385a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:39.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.582+0000 7ffb3961d700 1 --2- 172.21.15.40:0/520698010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb3409fbb0 0x7ffb34138ae0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ffb24001c90 tx=0x7ffb2400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:39.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.583+0000 7ffb2a7fc700 1 -- 172.21.15.40:0/520698010 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2400ade0 con 0x7ffb3409fbb0 2023-09-30T22:26:39.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.583+0000 7ffb3c082700 1 -- 172.21.15.40:0/520698010 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb340713f0 con 0x7ffb3409fbb0 2023-09-30T22:26:39.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.583+0000 7ffb2a7fc700 1 -- 172.21.15.40:0/520698010 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb24005940 con 0x7ffb3409fbb0 2023-09-30T22:26:39.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.583+0000 7ffb2a7fc700 1 -- 172.21.15.40:0/520698010 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb24005cd0 con 0x7ffb3409fbb0 2023-09-30T22:26:39.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.583+0000 7ffb3c082700 1 -- 172.21.15.40:0/520698010 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb340954e0 con 0x7ffb3409fbb0 2023-09-30T22:26:39.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.584+0000 7ffb3c082700 1 -- 172.21.15.40:0/520698010 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb34062380 con 0x7ffb3409fbb0 2023-09-30T22:26:39.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.584+0000 7ffb2a7fc700 1 -- 172.21.15.40:0/520698010 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffb240138e0 con 0x7ffb3409fbb0 2023-09-30T22:26:39.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.584+0000 7ffb2a7fc700 1 -- 172.21.15.40:0/520698010 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ffb240477f0 con 0x7ffb3409fbb0 2023-09-30T22:26:39.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.593+0000 7ffb2a7fc700 1 -- 172.21.15.40:0/520698010 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb2401b340 con 0x7ffb3409fbb0 2023-09-30T22:26:39.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.632+0000 7fb79513a700 1 Processor -- start 2023-09-30T22:26:39.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.632+0000 7fb79513a700 1 -- start start 2023-09-30T22:26:39.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.632+0000 7fb79513a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb79009d920 0x7fb79009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.633+0000 7fb79513a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb790130fb0 0x7fb790138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.633+0000 7fb79513a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb79009adf0 con 0x7fb79009e230 2023-09-30T22:26:39.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.633+0000 7fb79513a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb79009edf0 con 0x7fb790130fb0 2023-09-30T22:26:39.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.633+0000 7fb79513a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb79009b660 con 0x7fb79009d920 2023-09-30T22:26:39.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.633+0000 7fb78e59c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb79009e230 0x7fb7901308a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46726/0 (socket says 172.21.15.40:46726) 2023-09-30T22:26:39.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.633+0000 7fb78e59c700 1 -- 172.21.15.40:0/2862651834 learned_addr learned my addr 172.21.15.40:0/2862651834 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:39.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.633+0000 7fb78ed9d700 1 --2- 172.21.15.40:0/2862651834 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb79009d920 0x7fb79009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.633+0000 7fb78f59e700 1 --2- 172.21.15.40:0/2862651834 >> v2:172.21.15.40:3300/0 conn(0x7fb790130fb0 0x7fb790138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.633+0000 7fb78ed9d700 1 -- 172.21.15.40:0/2862651834 >> v2:172.21.15.40:3300/0 conn(0x7fb790130fb0 msgr2=0x7fb790138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:39.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.633+0000 7fb78ed9d700 1 --2- 172.21.15.40:0/2862651834 >> v2:172.21.15.40:3300/0 conn(0x7fb790130fb0 0x7fb790138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.633+0000 7fb78ed9d700 1 -- 172.21.15.40:0/2862651834 >> v1:172.21.15.40:6789/0 conn(0x7fb79009e230 legacy=0x7fb7901308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.633+0000 7fb78dd9b700 1 -- 172.21.15.40:0/2862651834 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 718898542 0 0) 0x7fb79009adf0 con 0x7fb79009e230 2023-09-30T22:26:39.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.633+0000 7fb78ed9d700 1 -- 172.21.15.40:0/2862651834 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb79009a6e0 con 0x7fb79009d920 2023-09-30T22:26:39.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.633+0000 7fb78ed9d700 1 --2- 172.21.15.40:0/2862651834 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb79009d920 0x7fb79009dcf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb78000bac0 tx=0x7fb78000bdd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d94fc081a0939afa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:39.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.634+0000 7fb78dd9b700 1 -- 172.21.15.40:0/2862651834 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb780005e30 con 0x7fb79009d920 2023-09-30T22:26:39.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.634+0000 7fb78dd9b700 1 -- 172.21.15.40:0/2862651834 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb78000d920 con 0x7fb79009d920 2023-09-30T22:26:39.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.634+0000 7fb78dd9b700 1 -- 172.21.15.40:0/2862651834 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78000dcb0 con 0x7fb79009d920 2023-09-30T22:26:39.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.634+0000 7fb79513a700 1 -- 172.21.15.40:0/2862651834 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb79009d920 msgr2=0x7fb79009dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.634+0000 7fb79513a700 1 --2- 172.21.15.40:0/2862651834 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb79009d920 0x7fb79009dcf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb78000bac0 tx=0x7fb78000bdd0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.635+0000 7fb79513a700 1 -- 172.21.15.40:0/2862651834 shutdown_connections 2023-09-30T22:26:39.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.635+0000 7fb79513a700 1 --2- 172.21.15.40:0/2862651834 >> v2:172.21.15.40:3300/0 conn(0x7fb790130fb0 0x7fb790138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.635+0000 7fb79513a700 1 --2- 172.21.15.40:0/2862651834 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb79009d920 0x7fb79009dcf0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.635+0000 7fb79513a700 1 -- 172.21.15.40:0/2862651834 >> 172.21.15.40:0/2862651834 conn(0x7fb79009fb20 msgr2=0x7fb79009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:39.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.635+0000 7fb79513a700 1 -- 172.21.15.40:0/2862651834 shutdown_connections 2023-09-30T22:26:39.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.635+0000 7fb79513a700 1 -- 172.21.15.40:0/2862651834 wait complete. 2023-09-30T22:26:39.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.636+0000 7fb79513a700 1 Processor -- start 2023-09-30T22:26:39.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.636+0000 7fb79513a700 1 -- start start 2023-09-30T22:26:39.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.637+0000 7fb79513a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb79009d920 0x7fb790121440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.637+0000 7fb79513a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb79009e230 0x7fb790121980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.637+0000 7fb79513a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb790130fb0 0x7fb790121ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.637+0000 7fb79513a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb790124f60 con 0x7fb79009e230 2023-09-30T22:26:39.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.637+0000 7fb79513a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb790123670 con 0x7fb790130fb0 2023-09-30T22:26:39.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.637+0000 7fb79513a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb79009cb00 con 0x7fb79009d920 2023-09-30T22:26:39.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.637+0000 7fb78f59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb790130fb0 0x7fb790121ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.637+0000 7fb78f59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb790130fb0 0x7fb790121ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38064/0 (socket says 172.21.15.40:38064) 2023-09-30T22:26:39.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.637+0000 7fb78f59e700 1 -- 172.21.15.40:0/3829603868 learned_addr learned my addr 172.21.15.40:0/3829603868 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:39.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.637+0000 7fb78ed9d700 1 --2- 172.21.15.40:0/3829603868 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb79009d920 0x7fb790121440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.637+0000 7fb78e59c700 1 --2- 172.21.15.40:0/3829603868 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb79009e230 0x7fb790121980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.638+0000 7fb78f59e700 1 -- 172.21.15.40:0/3829603868 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb79009d920 msgr2=0x7fb790121440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.638+0000 7fb78f59e700 1 --2- 172.21.15.40:0/3829603868 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb79009d920 0x7fb790121440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.638+0000 7fb78f59e700 1 -- 172.21.15.40:0/3829603868 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb79009e230 msgr2=0x7fb790121980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.638+0000 7fb78f59e700 1 --2- 172.21.15.40:0/3829603868 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb79009e230 0x7fb790121980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.638+0000 7fb78f59e700 1 -- 172.21.15.40:0/3829603868 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78000b6d0 con 0x7fb790130fb0 2023-09-30T22:26:39.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.638+0000 7fb78f59e700 1 --2- 172.21.15.40:0/3829603868 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb790130fb0 0x7fb790121ec0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb788007e70 tx=0x7fb78800e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:39.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.638+0000 7fb7777fe700 1 -- 172.21.15.40:0/3829603868 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78800ed30 con 0x7fb790130fb0 2023-09-30T22:26:39.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.638+0000 7fb7777fe700 1 -- 172.21.15.40:0/3829603868 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb78800eeb0 con 0x7fb790130fb0 2023-09-30T22:26:39.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.638+0000 7fb79513a700 1 -- 172.21.15.40:0/3829603868 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb790123050 con 0x7fb790130fb0 2023-09-30T22:26:39.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.638+0000 7fb7777fe700 1 -- 172.21.15.40:0/3829603868 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb788014640 con 0x7fb790130fb0 2023-09-30T22:26:39.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.638+0000 7fb79513a700 1 -- 172.21.15.40:0/3829603868 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb79012f360 con 0x7fb790130fb0 2023-09-30T22:26:39.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.640+0000 7fb79513a700 1 -- 172.21.15.40:0/3829603868 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb790124920 con 0x7fb790130fb0 2023-09-30T22:26:39.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.640+0000 7fb7777fe700 1 -- 172.21.15.40:0/3829603868 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb7880147a0 con 0x7fb790130fb0 2023-09-30T22:26:39.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.640+0000 7fb7777fe700 1 -- 172.21.15.40:0/3829603868 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb78803ff60 con 0x7fb790130fb0 2023-09-30T22:26:39.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.646+0000 7fb7777fe700 1 -- 172.21.15.40:0/3829603868 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb790124920 con 0x7fb790130fb0 2023-09-30T22:26:39.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.681+0000 7fb7230f4700 1 Processor -- start 2023-09-30T22:26:39.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.681+0000 7fb7230f4700 1 -- start start 2023-09-30T22:26:39.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.681+0000 7fb7230f4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb71c09c890 0x7fb71c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.681+0000 7fb7230f4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb71c09e480 0x7fb71c13bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.681+0000 7fb7230f4700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb71c0a2600 con 0x7fb71c09d920 2023-09-30T22:26:39.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.681+0000 7fb7230f4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb71c0a29d0 con 0x7fb71c09c890 2023-09-30T22:26:39.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.681+0000 7fb7230f4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c09fb40 con 0x7fb71c09e480 2023-09-30T22:26:39.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.681+0000 7fb71bfff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb71c09d920 0x7fb71c09dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46732/0 (socket says 172.21.15.40:46732) 2023-09-30T22:26:39.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.681+0000 7fb71bfff700 1 -- 172.21.15.40:0/3594231090 learned_addr learned my addr 172.21.15.40:0/3594231090 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:39.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.681+0000 7fb721691700 1 --2- 172.21.15.40:0/3594231090 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb71c09e480 0x7fb71c13bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.682+0000 7fb71b7fe700 1 -- 172.21.15.40:0/3594231090 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3086135220 0 0) 0x7fb71c0a2600 con 0x7fb71c09d920 2023-09-30T22:26:39.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.682+0000 7fb720e90700 1 --2- 172.21.15.40:0/3594231090 >> v2:172.21.15.40:3300/0 conn(0x7fb71c09c890 0x7fb71c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.682+0000 7fb71b7fe700 1 -- 172.21.15.40:0/3594231090 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb70c0035b0 con 0x7fb71c09d920 2023-09-30T22:26:39.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.682+0000 7fb721691700 1 -- 172.21.15.40:0/3594231090 >> v2:172.21.15.40:3300/0 conn(0x7fb71c09c890 msgr2=0x7fb71c09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:39.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.682+0000 7fb721691700 1 --2- 172.21.15.40:0/3594231090 >> v2:172.21.15.40:3300/0 conn(0x7fb71c09c890 0x7fb71c09cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.682+0000 7fb721691700 1 -- 172.21.15.40:0/3594231090 >> v1:172.21.15.40:6789/0 conn(0x7fb71c09d920 legacy=0x7fb71c09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.682+0000 7fb721691700 1 -- 172.21.15.40:0/3594231090 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb71c09fed0 con 0x7fb71c09e480 2023-09-30T22:26:39.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.682+0000 7fb720e90700 1 --2- 172.21.15.40:0/3594231090 >> v2:172.21.15.40:3300/0 conn(0x7fb71c09c890 0x7fb71c09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:26:39.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.682+0000 7fb721691700 1 --2- 172.21.15.40:0/3594231090 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb71c09e480 0x7fb71c13bc20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb714009d90 tx=0x7fb71400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35f2519d97cfeaa9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:39.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.682+0000 7fb71b7fe700 1 -- 172.21.15.40:0/3594231090 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71400e070 con 0x7fb71c09e480 2023-09-30T22:26:39.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.682+0000 7fb71b7fe700 1 -- 172.21.15.40:0/3594231090 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71400bae0 con 0x7fb71c09e480 2023-09-30T22:26:39.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.682+0000 7fb71b7fe700 1 -- 172.21.15.40:0/3594231090 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71400be90 con 0x7fb71c09e480 2023-09-30T22:26:39.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.683+0000 7fb7230f4700 1 -- 172.21.15.40:0/3594231090 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb71c09e480 msgr2=0x7fb71c13bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.683+0000 7fb7230f4700 1 --2- 172.21.15.40:0/3594231090 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb71c09e480 0x7fb71c13bc20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb714009d90 tx=0x7fb71400b330 comp rx=0 tx=0).stop 2023-09-30T22:26:39.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.683+0000 7fb7230f4700 1 -- 172.21.15.40:0/3594231090 shutdown_connections 2023-09-30T22:26:39.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.683+0000 7fb7230f4700 1 --2- 172.21.15.40:0/3594231090 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb71c09e480 0x7fb71c13bc20 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.683+0000 7fb7230f4700 1 --2- 172.21.15.40:0/3594231090 >> v2:172.21.15.40:3300/0 conn(0x7fb71c09c890 0x7fb71c09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.683+0000 7fb7230f4700 1 -- 172.21.15.40:0/3594231090 >> 172.21.15.40:0/3594231090 conn(0x7fb71c0a7080 msgr2=0x7fb71c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:39.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.683+0000 7fb7230f4700 1 -- 172.21.15.40:0/3594231090 shutdown_connections 2023-09-30T22:26:39.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.683+0000 7fb7230f4700 1 -- 172.21.15.40:0/3594231090 wait complete. 2023-09-30T22:26:39.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.684+0000 7fb7230f4700 1 Processor -- start 2023-09-30T22:26:39.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.684+0000 7fb7230f4700 1 -- start start 2023-09-30T22:26:39.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.684+0000 7fb7230f4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb71c09c890 0x7fb71c1c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.684+0000 7fb7230f4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb71c09d920 0x7fb71c1c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.684+0000 7fb7230f4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb71c09e480 0x7fb71c12b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.684+0000 7fb7230f4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c12e2f0 con 0x7fb71c09c890 2023-09-30T22:26:39.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.684+0000 7fb7230f4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c12f200 con 0x7fb71c09e480 2023-09-30T22:26:39.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.684+0000 7fb7230f4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c12db40 con 0x7fb71c09d920 2023-09-30T22:26:39.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.685+0000 7fb71bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb71c09d920 0x7fb71c1c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.685+0000 7fb71bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb71c09d920 0x7fb71c1c5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:44614/0 (socket says 172.21.15.40:44614) 2023-09-30T22:26:39.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.685+0000 7fb71bfff700 1 -- 172.21.15.40:0/312071742 learned_addr learned my addr 172.21.15.40:0/312071742 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:39.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.685+0000 7fb721691700 1 --2- 172.21.15.40:0/312071742 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb71c09e480 0x7fb71c12b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.685+0000 7fb720e90700 1 --2- 172.21.15.40:0/312071742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb71c09c890 0x7fb71c1c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.685+0000 7fb71bfff700 1 -- 172.21.15.40:0/312071742 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb71c09e480 msgr2=0x7fb71c12b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.685+0000 7fb71bfff700 1 --2- 172.21.15.40:0/312071742 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb71c09e480 0x7fb71c12b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.685+0000 7fb71bfff700 1 -- 172.21.15.40:0/312071742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb71c09c890 msgr2=0x7fb71c1c5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.685+0000 7fb71bfff700 1 --2- 172.21.15.40:0/312071742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb71c09c890 0x7fb71c1c5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.685+0000 7fb71bfff700 1 -- 172.21.15.40:0/312071742 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb714009a70 con 0x7fb71c09d920 2023-09-30T22:26:39.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.685+0000 7fb721691700 1 --2- 172.21.15.40:0/312071742 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb71c09e480 0x7fb71c12b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:39.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.685+0000 7fb71bfff700 1 --2- 172.21.15.40:0/312071742 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb71c09d920 0x7fb71c1c5590 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb70800c750 tx=0x7fb70800ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:39.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.685+0000 7fb7197fa700 1 -- 172.21.15.40:0/312071742 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb708004c80 con 0x7fb71c09d920 2023-09-30T22:26:39.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.685+0000 7fb7197fa700 1 -- 172.21.15.40:0/312071742 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb708004e00 con 0x7fb71c09d920 2023-09-30T22:26:39.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.685+0000 7fb7230f4700 1 -- 172.21.15.40:0/312071742 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb71c12d6f0 con 0x7fb71c09d920 2023-09-30T22:26:39.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.685+0000 7fb7197fa700 1 -- 172.21.15.40:0/312071742 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb708007310 con 0x7fb71c09d920 2023-09-30T22:26:39.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.685+0000 7fb7230f4700 1 -- 172.21.15.40:0/312071742 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb71c1c4bb0 con 0x7fb71c09d920 2023-09-30T22:26:39.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.686+0000 7fb7197fa700 1 -- 172.21.15.40:0/312071742 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb708007470 con 0x7fb71c09d920 2023-09-30T22:26:39.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.687+0000 7fb7230f4700 1 -- 172.21.15.40:0/312071742 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb71c12e460 con 0x7fb71c09d920 2023-09-30T22:26:39.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.687+0000 7fb7197fa700 1 -- 172.21.15.40:0/312071742 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb70803f310 con 0x7fb71c09d920 2023-09-30T22:26:39.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.692+0000 7fb7197fa700 1 -- 172.21.15.40:0/312071742 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb7080123b0 con 0x7fb71c09d920 2023-09-30T22:26:39.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.772+0000 7fdf106dc700 1 -- 172.21.15.40:0/2619477198 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdef0005590 con 0x7fdf0809df30 2023-09-30T22:26:39.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.773+0000 7fdefeffd700 1 -- 172.21.15.40:0/2619477198 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdef8021030 con 0x7fdf0809df30 2023-09-30T22:26:39.773 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:39.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.775+0000 7fdf106dc700 1 -- 172.21.15.40:0/2619477198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf0809df30 msgr2=0x7fdf0806e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.775+0000 7fdf106dc700 1 --2- 172.21.15.40:0/2619477198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf0809df30 0x7fdf0806e9d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fdef800e9e0 tx=0x7fdef800ecf0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.775+0000 7fdf106dc700 1 -- 172.21.15.40:0/2619477198 shutdown_connections 2023-09-30T22:26:39.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.775+0000 7fdf106dc700 1 --2- 172.21.15.40:0/2619477198 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf08135940 0x7fdf0806ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.775+0000 7fdf106dc700 1 --2- 172.21.15.40:0/2619477198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf0809d450 0x7fdf0806e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.775+0000 7fdf106dc700 1 --2- 172.21.15.40:0/2619477198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf0809df30 0x7fdf0806e9d0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.775+0000 7fdf106dc700 1 -- 172.21.15.40:0/2619477198 >> 172.21.15.40:0/2619477198 conn(0x7fdf080a2a00 msgr2=0x7fdf080a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:39.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.775+0000 7fdf106dc700 1 -- 172.21.15.40:0/2619477198 shutdown_connections 2023-09-30T22:26:39.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.775+0000 7fdf106dc700 1 -- 172.21.15.40:0/2619477198 wait complete. 2023-09-30T22:26:39.788 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:39.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.830+0000 7ffb3c082700 1 -- 172.21.15.40:0/520698010 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ffb340946f0 con 0x7ffb3409fbb0 2023-09-30T22:26:39.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.830+0000 7ffb2a7fc700 1 -- 172.21.15.40:0/520698010 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffb24023020 con 0x7ffb3409fbb0 2023-09-30T22:26:39.831 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:39.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.832+0000 7ffb3c082700 1 -- 172.21.15.40:0/520698010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb3409fbb0 msgr2=0x7ffb34138ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.832+0000 7ffb3c082700 1 --2- 172.21.15.40:0/520698010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb3409fbb0 0x7ffb34138ae0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ffb24001c90 tx=0x7ffb2400a340 comp rx=0 tx=0).stop 2023-09-30T22:26:39.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.832+0000 7ffb3c082700 1 -- 172.21.15.40:0/520698010 shutdown_connections 2023-09-30T22:26:39.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.832+0000 7ffb3c082700 1 --2- 172.21.15.40:0/520698010 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb3406f3a0 0x7ffb341385a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.832+0000 7ffb3c082700 1 --2- 172.21.15.40:0/520698010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb34139380 0x7ffb34095930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.832+0000 7ffb3c082700 1 --2- 172.21.15.40:0/520698010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb3409fbb0 0x7ffb34138ae0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.832+0000 7ffb3c082700 1 -- 172.21.15.40:0/520698010 >> 172.21.15.40:0/520698010 conn(0x7ffb340a41a0 msgr2=0x7ffb3406f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:39.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.832+0000 7ffb3c082700 1 -- 172.21.15.40:0/520698010 shutdown_connections 2023-09-30T22:26:39.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.832+0000 7ffb3c082700 1 -- 172.21.15.40:0/520698010 wait complete. 2023-09-30T22:26:39.846 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:39.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.869+0000 7fb79513a700 1 -- 172.21.15.40:0/3829603868 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb790124920 con 0x7fb790130fb0 2023-09-30T22:26:39.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.869+0000 7fb7777fe700 1 -- 172.21.15.40:0/3829603868 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb790124920 con 0x7fb790130fb0 2023-09-30T22:26:39.870 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:39.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.871+0000 7fb79513a700 1 -- 172.21.15.40:0/3829603868 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb790130fb0 msgr2=0x7fb790121ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.871+0000 7fb79513a700 1 --2- 172.21.15.40:0/3829603868 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb790130fb0 0x7fb790121ec0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb788007e70 tx=0x7fb78800e3c0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.871+0000 7fb79513a700 1 -- 172.21.15.40:0/3829603868 shutdown_connections 2023-09-30T22:26:39.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.871+0000 7fb79513a700 1 --2- 172.21.15.40:0/3829603868 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb79009d920 0x7fb790121440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.871+0000 7fb79513a700 1 --2- 172.21.15.40:0/3829603868 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb790130fb0 0x7fb790121ec0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.871+0000 7fb79513a700 1 --2- 172.21.15.40:0/3829603868 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb79009e230 0x7fb790121980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.872+0000 7fb79513a700 1 -- 172.21.15.40:0/3829603868 >> 172.21.15.40:0/3829603868 conn(0x7fb79009fb20 msgr2=0x7fb79012fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:39.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.872+0000 7fb79513a700 1 -- 172.21.15.40:0/3829603868 shutdown_connections 2023-09-30T22:26:39.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.872+0000 7fb79513a700 1 -- 172.21.15.40:0/3829603868 wait complete. 2023-09-30T22:26:39.885 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:39.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.906+0000 7fb7230f4700 1 -- 172.21.15.40:0/312071742 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb71c062380 con 0x7fb71c09d920 2023-09-30T22:26:39.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.906+0000 7fb7197fa700 1 -- 172.21.15.40:0/312071742 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb708011360 con 0x7fb71c09d920 2023-09-30T22:26:39.907 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:39.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.908+0000 7fb7230f4700 1 -- 172.21.15.40:0/312071742 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb71c09d920 msgr2=0x7fb71c1c5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.908+0000 7fb7230f4700 1 --2- 172.21.15.40:0/312071742 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb71c09d920 0x7fb71c1c5590 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb70800c750 tx=0x7fb70800ca60 comp rx=0 tx=0).stop 2023-09-30T22:26:39.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.908+0000 7fb7230f4700 1 -- 172.21.15.40:0/312071742 shutdown_connections 2023-09-30T22:26:39.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.908+0000 7fb7230f4700 1 --2- 172.21.15.40:0/312071742 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb71c09e480 0x7fb71c12b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.908+0000 7fb7230f4700 1 --2- 172.21.15.40:0/312071742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb71c09c890 0x7fb71c1c5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.908+0000 7fb7230f4700 1 --2- 172.21.15.40:0/312071742 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb71c09d920 0x7fb71c1c5590 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.908+0000 7fb7230f4700 1 -- 172.21.15.40:0/312071742 >> 172.21.15.40:0/312071742 conn(0x7fb71c0a7080 msgr2=0x7fb71c1badd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:39.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.908+0000 7fb7230f4700 1 -- 172.21.15.40:0/312071742 shutdown_connections 2023-09-30T22:26:39.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:39.908+0000 7fb7230f4700 1 -- 172.21.15.40:0/312071742 wait complete. 2023-09-30T22:26:39.921 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:40.789 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:40.847 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:40.885 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:40.921 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:40.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.932+0000 7f3b19955700 1 Processor -- start 2023-09-30T22:26:40.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.932+0000 7f3b19955700 1 -- start start 2023-09-30T22:26:40.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.933+0000 7f3b19955700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b1412e590 0x7f3b1412e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:40.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.933+0000 7f3b19955700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b1412eea0 0x7f3b1412d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:40.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.933+0000 7f3b19955700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b1409ab70 con 0x7f3b1412d6d0 2023-09-30T22:26:40.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.933+0000 7f3b19955700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1409b270 con 0x7f3b1412e590 2023-09-30T22:26:40.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.933+0000 7f3b19955700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1409bab0 con 0x7f3b1412eea0 2023-09-30T22:26:40.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.933+0000 7f3b12ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b1412e590 0x7f3b1412e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:40.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.933+0000 7f3b137fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3b1412d6d0 0x7f3b14137c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46744/0 (socket says 172.21.15.40:46744) 2023-09-30T22:26:40.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.933+0000 7f3b137fe700 1 -- 172.21.15.40:0/3370591285 learned_addr learned my addr 172.21.15.40:0/3370591285 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:40.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.933+0000 7f3b127fc700 1 --2- 172.21.15.40:0/3370591285 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b1412eea0 0x7f3b1412d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:40.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.933+0000 7f3b127fc700 1 -- 172.21.15.40:0/3370591285 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b1412e590 msgr2=0x7f3b1412e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:40.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.934+0000 7f3b127fc700 1 --2- 172.21.15.40:0/3370591285 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b1412e590 0x7f3b1412e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:40.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.934+0000 7f3b127fc700 1 -- 172.21.15.40:0/3370591285 >> v1:172.21.15.40:6789/0 conn(0x7f3b1412d6d0 legacy=0x7f3b14137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:40.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.933+0000 7f3b11ffb700 1 -- 172.21.15.40:0/3370591285 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2827205146 0 0) 0x7f3b1409ab70 con 0x7f3b1412d6d0 2023-09-30T22:26:40.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.934+0000 7f3b127fc700 1 -- 172.21.15.40:0/3370591285 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b1409bd70 con 0x7f3b1412eea0 2023-09-30T22:26:40.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.934+0000 7f3b127fc700 1 --2- 172.21.15.40:0/3370591285 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b1412eea0 0x7f3b1412d190 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3b08009870 tx=0x7f3b08009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=148855cd33514c9e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:40.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.934+0000 7f3b11ffb700 1 -- 172.21.15.40:0/3370591285 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b08011830 con 0x7f3b1412eea0 2023-09-30T22:26:40.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.934+0000 7f3b11ffb700 1 -- 172.21.15.40:0/3370591285 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b08011990 con 0x7f3b1412eea0 2023-09-30T22:26:40.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.934+0000 7f3b11ffb700 1 -- 172.21.15.40:0/3370591285 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b08011d20 con 0x7f3b1412eea0 2023-09-30T22:26:40.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.935+0000 7f3b19955700 1 -- 172.21.15.40:0/3370591285 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b1412eea0 msgr2=0x7f3b1412d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:40.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.935+0000 7f3b19955700 1 --2- 172.21.15.40:0/3370591285 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b1412eea0 0x7f3b1412d190 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3b08009870 tx=0x7f3b08009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:40.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.936+0000 7f3b19955700 1 -- 172.21.15.40:0/3370591285 shutdown_connections 2023-09-30T22:26:40.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.936+0000 7f3b19955700 1 --2- 172.21.15.40:0/3370591285 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b1412e590 0x7f3b1412e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:40.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.936+0000 7f3b19955700 1 --2- 172.21.15.40:0/3370591285 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b1412eea0 0x7f3b1412d190 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:40.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.936+0000 7f3b19955700 1 -- 172.21.15.40:0/3370591285 >> 172.21.15.40:0/3370591285 conn(0x7f3b140a2a00 msgr2=0x7f3b140a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:40.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.936+0000 7f3b19955700 1 -- 172.21.15.40:0/3370591285 shutdown_connections 2023-09-30T22:26:40.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.936+0000 7f3b19955700 1 -- 172.21.15.40:0/3370591285 wait complete. 2023-09-30T22:26:40.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.937+0000 7f3b19955700 1 Processor -- start 2023-09-30T22:26:40.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.937+0000 7f3b19955700 1 -- start start 2023-09-30T22:26:40.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.937+0000 7f3b19955700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b1412d6d0 0x7f3b141c8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:40.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.937+0000 7f3b19955700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b1412e590 0x7f3b141c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:40.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.937+0000 7f3b19955700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b1412eea0 0x7f3b141c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:40.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.937+0000 7f3b19955700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b141321b0 con 0x7f3b1412eea0 2023-09-30T22:26:40.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.937+0000 7f3b19955700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1413a480 con 0x7f3b1412d6d0 2023-09-30T22:26:40.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.937+0000 7f3b19955700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b14139f50 con 0x7f3b1412e590 2023-09-30T22:26:40.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.938+0000 7f3b12ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b1412d6d0 0x7f3b141c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:40.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.938+0000 7f3b12ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b1412d6d0 0x7f3b141c8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38080/0 (socket says 172.21.15.40:38080) 2023-09-30T22:26:40.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.938+0000 7f3b12ffd700 1 -- 172.21.15.40:0/3389883521 learned_addr learned my addr 172.21.15.40:0/3389883521 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:40.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.938+0000 7f3b127fc700 1 --2- 172.21.15.40:0/3389883521 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b1412e590 0x7f3b141c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:40.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.938+0000 7f3b137fe700 1 --2- 172.21.15.40:0/3389883521 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b1412eea0 0x7f3b141c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:40.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.938+0000 7f3b12ffd700 1 -- 172.21.15.40:0/3389883521 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b1412e590 msgr2=0x7f3b141c88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:40.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.938+0000 7f3b12ffd700 1 --2- 172.21.15.40:0/3389883521 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b1412e590 0x7f3b141c88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:40.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.938+0000 7f3b12ffd700 1 -- 172.21.15.40:0/3389883521 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b1412eea0 msgr2=0x7f3b141c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:40.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.938+0000 7f3b12ffd700 1 --2- 172.21.15.40:0/3389883521 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b1412eea0 0x7f3b141c8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:40.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.938+0000 7f3b12ffd700 1 -- 172.21.15.40:0/3389883521 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b080094a0 con 0x7f3b1412d6d0 2023-09-30T22:26:40.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.939+0000 7f3b12ffd700 1 --2- 172.21.15.40:0/3389883521 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b1412d6d0 0x7f3b141c8370 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3b0400e9b0 tx=0x7f3b0400ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:40.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.939+0000 7f3afbfff700 1 -- 172.21.15.40:0/3389883521 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b04009710 con 0x7f3b1412d6d0 2023-09-30T22:26:40.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.939+0000 7f3afbfff700 1 -- 172.21.15.40:0/3389883521 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0400ee50 con 0x7f3b1412d6d0 2023-09-30T22:26:40.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.939+0000 7f3b19955700 1 -- 172.21.15.40:0/3389883521 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b1409cdb0 con 0x7f3b1412d6d0 2023-09-30T22:26:40.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.939+0000 7f3afbfff700 1 -- 172.21.15.40:0/3389883521 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0400ca50 con 0x7f3b1412d6d0 2023-09-30T22:26:40.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.939+0000 7f3b19955700 1 -- 172.21.15.40:0/3389883521 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b1413bb00 con 0x7f3b1412d6d0 2023-09-30T22:26:40.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.940+0000 7f3b19955700 1 -- 172.21.15.40:0/3389883521 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b14131dd0 con 0x7f3b1412d6d0 2023-09-30T22:26:40.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.941+0000 7f3afbfff700 1 -- 172.21.15.40:0/3389883521 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3b0400cbb0 con 0x7f3b1412d6d0 2023-09-30T22:26:40.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.941+0000 7f3afbfff700 1 -- 172.21.15.40:0/3389883521 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3b0403fb80 con 0x7f3b1412d6d0 2023-09-30T22:26:40.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.946+0000 7f3afbfff700 1 -- 172.21.15.40:0/3389883521 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3b04041e60 con 0x7f3b1412d6d0 2023-09-30T22:26:40.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.992+0000 7faaf492b700 1 Processor -- start 2023-09-30T22:26:40.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.993+0000 7faaf492b700 1 -- start start 2023-09-30T22:26:40.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.993+0000 7faaf492b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faaf006a6d0 0x7faaf009d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:40.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.993+0000 7faaf492b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faaf009e250 0x7faaf013fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:40.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.993+0000 7faaf492b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaf011d980 con 0x7faaf009de60 2023-09-30T22:26:40.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.993+0000 7faaf492b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaf006aaa0 con 0x7faaf009e250 2023-09-30T22:26:40.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.993+0000 7faaf492b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faaf006b150 con 0x7faaf006a6d0 2023-09-30T22:26:40.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.993+0000 7faaee59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faaf006a6d0 0x7faaf009d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:40.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.993+0000 7faaee59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faaf006a6d0 0x7faaf009d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:44642/0 (socket says 172.21.15.40:44642) 2023-09-30T22:26:40.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.993+0000 7faaee59c700 1 -- 172.21.15.40:0/240434388 learned_addr learned my addr 172.21.15.40:0/240434388 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:40.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.993+0000 7faaeed9d700 1 --2- 172.21.15.40:0/240434388 >> v2:172.21.15.40:3300/0 conn(0x7faaf009e250 0x7faaf013fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:40.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.994+0000 7faaee59c700 1 -- 172.21.15.40:0/240434388 >> v2:172.21.15.40:3300/0 conn(0x7faaf009e250 msgr2=0x7faaf013fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:40.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.994+0000 7faaee59c700 1 --2- 172.21.15.40:0/240434388 >> v2:172.21.15.40:3300/0 conn(0x7faaf009e250 0x7faaf013fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:40.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.994+0000 7faaee59c700 1 -- 172.21.15.40:0/240434388 >> v1:172.21.15.40:6789/0 conn(0x7faaf009de60 legacy=0x7faaf013c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:40.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.994+0000 7faaee59c700 1 -- 172.21.15.40:0/240434388 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf009f300 con 0x7faaf006a6d0 2023-09-30T22:26:40.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.994+0000 7faaeed9d700 1 --2- 172.21.15.40:0/240434388 >> v2:172.21.15.40:3300/0 conn(0x7faaf009e250 0x7faaf013fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:40.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.994+0000 7faaee59c700 1 --2- 172.21.15.40:0/240434388 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faaf006a6d0 0x7faaf009d920 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7faae0006fd0 tx=0x7faae0009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4ffda775ec365f5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:40.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.994+0000 7faaed59a700 1 -- 172.21.15.40:0/240434388 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae0005e30 con 0x7faaf006a6d0 2023-09-30T22:26:40.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.994+0000 7faaed59a700 1 -- 172.21.15.40:0/240434388 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae0006030 con 0x7faaf006a6d0 2023-09-30T22:26:40.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.994+0000 7faaed59a700 1 -- 172.21.15.40:0/240434388 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae00063c0 con 0x7faaf006a6d0 2023-09-30T22:26:40.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.995+0000 7faaf492b700 1 -- 172.21.15.40:0/240434388 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faaf006a6d0 msgr2=0x7faaf009d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:40.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.995+0000 7faaf492b700 1 --2- 172.21.15.40:0/240434388 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faaf006a6d0 0x7faaf009d920 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7faae0006fd0 tx=0x7faae0009bd0 comp rx=0 tx=0).stop 2023-09-30T22:26:40.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.995+0000 7faaf492b700 1 -- 172.21.15.40:0/240434388 shutdown_connections 2023-09-30T22:26:40.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.995+0000 7faaf492b700 1 --2- 172.21.15.40:0/240434388 >> v2:172.21.15.40:3300/0 conn(0x7faaf009e250 0x7faaf013fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:40.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.995+0000 7faaf492b700 1 --2- 172.21.15.40:0/240434388 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faaf006a6d0 0x7faaf009d920 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:40.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.995+0000 7faaf492b700 1 -- 172.21.15.40:0/240434388 >> 172.21.15.40:0/240434388 conn(0x7faaf009fb20 msgr2=0x7faaf009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:40.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.995+0000 7faaf492b700 1 -- 172.21.15.40:0/240434388 shutdown_connections 2023-09-30T22:26:40.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.995+0000 7faaf492b700 1 -- 172.21.15.40:0/240434388 wait complete. 2023-09-30T22:26:41.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.996+0000 7faaf492b700 1 Processor -- start 2023-09-30T22:26:41.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.996+0000 7faaf492b700 1 -- start start 2023-09-30T22:26:41.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.997+0000 7faaf492b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faaf006a6d0 0x7faaf0132450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:41.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.997+0000 7faaf492b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faaf009de60 0x7faaf011efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:41.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.997+0000 7faaf492b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faaf009e250 0x7faaf011f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:41.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.997+0000 7faaf492b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf0122700 con 0x7faaf009e250 2023-09-30T22:26:41.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.997+0000 7faaf492b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf0121080 con 0x7faaf009de60 2023-09-30T22:26:41.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.997+0000 7faaf492b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faaf0120b70 con 0x7faaf006a6d0 2023-09-30T22:26:41.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.997+0000 7faaee59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faaf006a6d0 0x7faaf0132450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:41.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.997+0000 7faaee59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faaf006a6d0 0x7faaf0132450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:44648/0 (socket says 172.21.15.40:44648) 2023-09-30T22:26:41.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.997+0000 7faaee59c700 1 -- 172.21.15.40:0/1503872041 learned_addr learned my addr 172.21.15.40:0/1503872041 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:41.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.997+0000 7faaeed9d700 1 --2- 172.21.15.40:0/1503872041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faaf009e250 0x7faaf011f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:41.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.997+0000 7faaee59c700 1 -- 172.21.15.40:0/1503872041 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faaf009de60 msgr2=0x7faaf011efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:41.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.997+0000 7faaee59c700 1 --2- 172.21.15.40:0/1503872041 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faaf009de60 0x7faaf011efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.997+0000 7faaee59c700 1 -- 172.21.15.40:0/1503872041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faaf009e250 msgr2=0x7faaf011f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:41.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.997+0000 7faaee59c700 1 --2- 172.21.15.40:0/1503872041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faaf009e250 0x7faaf011f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.997+0000 7faaee59c700 1 -- 172.21.15.40:0/1503872041 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae8009a70 con 0x7faaf006a6d0 2023-09-30T22:26:41.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.997+0000 7faaee59c700 1 --2- 172.21.15.40:0/1503872041 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faaf006a6d0 0x7faaf0132450 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7faae0013040 tx=0x7faae0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:41.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.998+0000 7faadeffd700 1 -- 172.21.15.40:0/1503872041 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae0011620 con 0x7faaf006a6d0 2023-09-30T22:26:41.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.998+0000 7faadeffd700 1 -- 172.21.15.40:0/1503872041 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae00117a0 con 0x7faaf006a6d0 2023-09-30T22:26:41.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.998+0000 7faaf492b700 1 -- 172.21.15.40:0/1503872041 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae0009500 con 0x7faaf006a6d0 2023-09-30T22:26:41.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.998+0000 7faadeffd700 1 -- 172.21.15.40:0/1503872041 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae0011b50 con 0x7faaf006a6d0 2023-09-30T22:26:41.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.998+0000 7faaf492b700 1 -- 172.21.15.40:0/1503872041 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf0123170 con 0x7faaf006a6d0 2023-09-30T22:26:41.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.999+0000 7faadeffd700 1 -- 172.21.15.40:0/1503872041 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faae0011cb0 con 0x7faaf006a6d0 2023-09-30T22:26:41.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.999+0000 7faadeffd700 1 -- 172.21.15.40:0/1503872041 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7faae0040af0 con 0x7faaf006a6d0 2023-09-30T22:26:41.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:40.999+0000 7faaf492b700 1 -- 172.21.15.40:0/1503872041 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaf0122320 con 0x7faaf006a6d0 2023-09-30T22:26:41.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.008+0000 7faadeffd700 1 -- 172.21.15.40:0/1503872041 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faae0019df0 con 0x7faaf006a6d0 2023-09-30T22:26:41.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.029+0000 7f6762ea6700 1 Processor -- start 2023-09-30T22:26:41.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.029+0000 7f6762ea6700 1 -- start start 2023-09-30T22:26:41.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.030+0000 7f6762ea6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f675c09c890 0x7f675c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:41.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.030+0000 7f6762ea6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f675c09e480 0x7f675c13bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:41.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.030+0000 7f6762ea6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f675c0a2600 con 0x7f675c09d920 2023-09-30T22:26:41.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.030+0000 7f6762ea6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f675c0a29d0 con 0x7f675c09c890 2023-09-30T22:26:41.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.030+0000 7f6762ea6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f675c09fb40 con 0x7f675c09e480 2023-09-30T22:26:41.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.030+0000 7f675bfff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f675c09d920 0x7f675c09dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46748/0 (socket says 172.21.15.40:46748) 2023-09-30T22:26:41.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.030+0000 7f675bfff700 1 -- 172.21.15.40:0/1320794710 learned_addr learned my addr 172.21.15.40:0/1320794710 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:41.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.030+0000 7f6761443700 1 --2- 172.21.15.40:0/1320794710 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f675c09e480 0x7f675c13bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:41.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.030+0000 7f6760c42700 1 --2- 172.21.15.40:0/1320794710 >> v2:172.21.15.40:3300/0 conn(0x7f675c09c890 0x7f675c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:41.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.030+0000 7f675b7fe700 1 -- 172.21.15.40:0/1320794710 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3746637076 0 0) 0x7f675c0a2600 con 0x7f675c09d920 2023-09-30T22:26:41.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.030+0000 7f675b7fe700 1 -- 172.21.15.40:0/1320794710 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f674c0035b0 con 0x7f675c09d920 2023-09-30T22:26:41.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.030+0000 7f6761443700 1 -- 172.21.15.40:0/1320794710 >> v2:172.21.15.40:3300/0 conn(0x7f675c09c890 msgr2=0x7f675c09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:41.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.031+0000 7f6761443700 1 --2- 172.21.15.40:0/1320794710 >> v2:172.21.15.40:3300/0 conn(0x7f675c09c890 0x7f675c09cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.031+0000 7f6761443700 1 -- 172.21.15.40:0/1320794710 >> v1:172.21.15.40:6789/0 conn(0x7f675c09d920 legacy=0x7f675c09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:41.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.031+0000 7f6761443700 1 -- 172.21.15.40:0/1320794710 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f675c09fed0 con 0x7f675c09e480 2023-09-30T22:26:41.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.031+0000 7f6761443700 1 --2- 172.21.15.40:0/1320794710 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f675c09e480 0x7f675c13bc20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6754009d90 tx=0x7f675400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85fecbd81df8c96d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:41.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.031+0000 7f675b7fe700 1 -- 172.21.15.40:0/1320794710 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675400e070 con 0x7f675c09e480 2023-09-30T22:26:41.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.031+0000 7f675b7fe700 1 -- 172.21.15.40:0/1320794710 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675400bb20 con 0x7f675c09e480 2023-09-30T22:26:41.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.031+0000 7f675b7fe700 1 -- 172.21.15.40:0/1320794710 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6754012430 con 0x7f675c09e480 2023-09-30T22:26:41.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.031+0000 7f6762ea6700 1 -- 172.21.15.40:0/1320794710 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f675c09e480 msgr2=0x7f675c13bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:41.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.031+0000 7f6762ea6700 1 --2- 172.21.15.40:0/1320794710 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f675c09e480 0x7f675c13bc20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6754009d90 tx=0x7f675400b330 comp rx=0 tx=0).stop 2023-09-30T22:26:41.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.032+0000 7f6762ea6700 1 -- 172.21.15.40:0/1320794710 shutdown_connections 2023-09-30T22:26:41.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.032+0000 7f6762ea6700 1 --2- 172.21.15.40:0/1320794710 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f675c09e480 0x7f675c13bc20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.032+0000 7f6762ea6700 1 --2- 172.21.15.40:0/1320794710 >> v2:172.21.15.40:3300/0 conn(0x7f675c09c890 0x7f675c09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.032+0000 7f6762ea6700 1 -- 172.21.15.40:0/1320794710 >> 172.21.15.40:0/1320794710 conn(0x7f675c0a7080 msgr2=0x7f675c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:41.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.032+0000 7f6762ea6700 1 -- 172.21.15.40:0/1320794710 shutdown_connections 2023-09-30T22:26:41.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.032+0000 7f6762ea6700 1 -- 172.21.15.40:0/1320794710 wait complete. 2023-09-30T22:26:41.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.033+0000 7f6762ea6700 1 Processor -- start 2023-09-30T22:26:41.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.033+0000 7f6762ea6700 1 -- start start 2023-09-30T22:26:41.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.033+0000 7f6762ea6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f675c09c890 0x7f675c12f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:41.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.033+0000 7f6762ea6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f675c09d920 0x7f675c12fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:41.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.033+0000 7f6762ea6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f675c09e480 0x7f675c1300d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:41.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.033+0000 7f6762ea6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675c12ebf0 con 0x7f675c09d920 2023-09-30T22:26:41.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.033+0000 7f6762ea6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f675c12cb60 con 0x7f675c09e480 2023-09-30T22:26:41.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.033+0000 7f6762ea6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f675c12d7d0 con 0x7f675c09c890 2023-09-30T22:26:41.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.033+0000 7f6761443700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f675c09e480 0x7f675c1300d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:41.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.033+0000 7f6760c42700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f675c09c890 0x7f675c12f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:41.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.033+0000 7f6761443700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f675c09e480 0x7f675c1300d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38114/0 (socket says 172.21.15.40:38114) 2023-09-30T22:26:41.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.033+0000 7f6761443700 1 -- 172.21.15.40:0/148102591 learned_addr learned my addr 172.21.15.40:0/148102591 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:41.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.033+0000 7f675bfff700 1 --2- 172.21.15.40:0/148102591 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f675c09d920 0x7f675c12fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:41.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.034+0000 7f6761443700 1 -- 172.21.15.40:0/148102591 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f675c09c890 msgr2=0x7f675c12f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:41.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.034+0000 7f6761443700 1 --2- 172.21.15.40:0/148102591 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f675c09c890 0x7f675c12f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.034+0000 7f6761443700 1 -- 172.21.15.40:0/148102591 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f675c09d920 msgr2=0x7f675c12fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:41.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.034+0000 7f6761443700 1 --2- 172.21.15.40:0/148102591 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f675c09d920 0x7f675c12fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.034+0000 7f6761443700 1 -- 172.21.15.40:0/148102591 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6754009a70 con 0x7f675c09e480 2023-09-30T22:26:41.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.034+0000 7f6761443700 1 --2- 172.21.15.40:0/148102591 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f675c09e480 0x7f675c1300d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6754014040 tx=0x7f6754004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:41.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.034+0000 7f67597fa700 1 -- 172.21.15.40:0/148102591 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6754012a90 con 0x7f675c09e480 2023-09-30T22:26:41.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.034+0000 7f67597fa700 1 -- 172.21.15.40:0/148102591 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6754020070 con 0x7f675c09e480 2023-09-30T22:26:41.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.034+0000 7f6762ea6700 1 -- 172.21.15.40:0/148102591 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f675c09ecf0 con 0x7f675c09e480 2023-09-30T22:26:41.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.034+0000 7f67597fa700 1 -- 172.21.15.40:0/148102591 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6754012e50 con 0x7f675c09e480 2023-09-30T22:26:41.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.035+0000 7f6762ea6700 1 -- 172.21.15.40:0/148102591 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f675c12dce0 con 0x7f675c09e480 2023-09-30T22:26:41.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.036+0000 7f67597fa700 1 -- 172.21.15.40:0/148102591 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6754004040 con 0x7f675c09e480 2023-09-30T22:26:41.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.036+0000 7f67597fa700 1 -- 172.21.15.40:0/148102591 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6754022070 con 0x7f675c09e480 2023-09-30T22:26:41.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.036+0000 7f6762ea6700 1 -- 172.21.15.40:0/148102591 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f675c12e6b0 con 0x7f675c09e480 2023-09-30T22:26:41.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.045+0000 7f67597fa700 1 -- 172.21.15.40:0/148102591 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6754046060 con 0x7f675c09e480 2023-09-30T22:26:41.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.077+0000 7fbbea7aa700 1 Processor -- start 2023-09-30T22:26:41.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.077+0000 7fbbea7aa700 1 -- start start 2023-09-30T22:26:41.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.078+0000 7fbbea7aa700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbbe4133e00 0x7fbbe41341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:41.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.078+0000 7fbbea7aa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbbe409d400 0x7fbbe409d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:41.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.078+0000 7fbbea7aa700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe4133940 con 0x7fbbe409dd70 2023-09-30T22:26:41.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.078+0000 7fbbea7aa700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe409ab20 con 0x7fbbe409d400 2023-09-30T22:26:41.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.078+0000 7fbbea7aa700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe409f0d0 con 0x7fbbe4133e00 2023-09-30T22:26:41.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.078+0000 7fbbe3fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbbe4133e00 0x7fbbe41341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:41.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.078+0000 7fbbe3fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbbe4133e00 0x7fbbe41341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:44674/0 (socket says 172.21.15.40:44674) 2023-09-30T22:26:41.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.078+0000 7fbbe3fff700 1 -- 172.21.15.40:0/4069922323 learned_addr learned my addr 172.21.15.40:0/4069922323 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:41.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.078+0000 7fbbe8d47700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbbe409dd70 0x7fbbe413ac70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46758/0 (socket says 172.21.15.40:46758) 2023-09-30T22:26:41.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.078+0000 7fbbe37fe700 1 --2- 172.21.15.40:0/4069922323 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbbe409d400 0x7fbbe409d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:41.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.078+0000 7fbbe3fff700 1 -- 172.21.15.40:0/4069922323 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbbe409d400 msgr2=0x7fbbe409d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:41.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.078+0000 7fbbe3fff700 1 --2- 172.21.15.40:0/4069922323 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbbe409d400 0x7fbbe409d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.078+0000 7fbbe3fff700 1 -- 172.21.15.40:0/4069922323 >> v1:172.21.15.40:6789/0 conn(0x7fbbe409dd70 legacy=0x7fbbe413ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:41.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.079+0000 7fbbe3fff700 1 -- 172.21.15.40:0/4069922323 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe409e210 con 0x7fbbe4133e00 2023-09-30T22:26:41.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.079+0000 7fbbe3fff700 1 --2- 172.21.15.40:0/4069922323 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbbe4133e00 0x7fbbe41341d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4009920 tx=0x7fbbd4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fda74065e8a505 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:41.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.079+0000 7fbbe2ffd700 1 -- 172.21.15.40:0/4069922323 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4011830 con 0x7fbbe4133e00 2023-09-30T22:26:41.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.079+0000 7fbbe2ffd700 1 -- 172.21.15.40:0/4069922323 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd4011990 con 0x7fbbe4133e00 2023-09-30T22:26:41.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.079+0000 7fbbe2ffd700 1 -- 172.21.15.40:0/4069922323 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4011d20 con 0x7fbbe4133e00 2023-09-30T22:26:41.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.080+0000 7fbbea7aa700 1 -- 172.21.15.40:0/4069922323 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbbe4133e00 msgr2=0x7fbbe41341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:41.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.080+0000 7fbbea7aa700 1 --2- 172.21.15.40:0/4069922323 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbbe4133e00 0x7fbbe41341d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4009920 tx=0x7fbbd4009c30 comp rx=0 tx=0).stop 2023-09-30T22:26:41.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.080+0000 7fbbea7aa700 1 -- 172.21.15.40:0/4069922323 shutdown_connections 2023-09-30T22:26:41.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.080+0000 7fbbea7aa700 1 --2- 172.21.15.40:0/4069922323 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbbe4133e00 0x7fbbe41341d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.080+0000 7fbbea7aa700 1 --2- 172.21.15.40:0/4069922323 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbbe409d400 0x7fbbe409d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.080+0000 7fbbea7aa700 1 -- 172.21.15.40:0/4069922323 >> 172.21.15.40:0/4069922323 conn(0x7fbbe40a2a00 msgr2=0x7fbbe40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:41.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.080+0000 7fbbea7aa700 1 -- 172.21.15.40:0/4069922323 shutdown_connections 2023-09-30T22:26:41.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.080+0000 7fbbea7aa700 1 -- 172.21.15.40:0/4069922323 wait complete. 2023-09-30T22:26:41.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.081+0000 7fbbea7aa700 1 Processor -- start 2023-09-30T22:26:41.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.081+0000 7fbbea7aa700 1 -- start start 2023-09-30T22:26:41.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.081+0000 7fbbea7aa700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbbe409d400 0x7fbbe4119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:41.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.081+0000 7fbbea7aa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbbe409dd70 0x7fbbe4119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:41.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.081+0000 7fbbea7aa700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe4133e00 0x7fbbe4119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:41.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.081+0000 7fbbea7aa700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe411b000 con 0x7fbbe4133e00 2023-09-30T22:26:41.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.081+0000 7fbbea7aa700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe411be90 con 0x7fbbe409dd70 2023-09-30T22:26:41.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.081+0000 7fbbea7aa700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe40a10f0 con 0x7fbbe409d400 2023-09-30T22:26:41.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.081+0000 7fbbe8d47700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe4133e00 0x7fbbe4119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:41.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.081+0000 7fbbe8d47700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe4133e00 0x7fbbe4119ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34568/0 (socket says 172.21.15.40:34568) 2023-09-30T22:26:41.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.081+0000 7fbbe8d47700 1 -- 172.21.15.40:0/336621933 learned_addr learned my addr 172.21.15.40:0/336621933 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:41.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.082+0000 7fbbe3fff700 1 --2- 172.21.15.40:0/336621933 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbbe409d400 0x7fbbe4119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:41.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.082+0000 7fbbe37fe700 1 --2- 172.21.15.40:0/336621933 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbbe409dd70 0x7fbbe4119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:41.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.082+0000 7fbbe8d47700 1 -- 172.21.15.40:0/336621933 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbbe409d400 msgr2=0x7fbbe4119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:41.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.082+0000 7fbbe8d47700 1 --2- 172.21.15.40:0/336621933 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbbe409d400 0x7fbbe4119050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.082+0000 7fbbe8d47700 1 -- 172.21.15.40:0/336621933 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbbe409dd70 msgr2=0x7fbbe4119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:41.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.082+0000 7fbbe8d47700 1 --2- 172.21.15.40:0/336621933 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbbe409dd70 0x7fbbe4119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.082+0000 7fbbe8d47700 1 -- 172.21.15.40:0/336621933 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd4009550 con 0x7fbbe4133e00 2023-09-30T22:26:41.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.082+0000 7fbbe3fff700 1 --2- 172.21.15.40:0/336621933 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbbe409d400 0x7fbbe4119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:41.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.082+0000 7fbbe8d47700 1 --2- 172.21.15.40:0/336621933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe4133e00 0x7fbbe4119ad0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc00cbd0 tx=0x7fbbdc00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:41.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.082+0000 7fbbe0ff9700 1 -- 172.21.15.40:0/336621933 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc00ab00 con 0x7fbbe4133e00 2023-09-30T22:26:41.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.082+0000 7fbbe0ff9700 1 -- 172.21.15.40:0/336621933 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbdc00ac60 con 0x7fbbe4133e00 2023-09-30T22:26:41.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.082+0000 7fbbea7aa700 1 -- 172.21.15.40:0/336621933 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe411a630 con 0x7fbbe4133e00 2023-09-30T22:26:41.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.082+0000 7fbbea7aa700 1 -- 172.21.15.40:0/336621933 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe411c430 con 0x7fbbe4133e00 2023-09-30T22:26:41.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.082+0000 7fbbe0ff9700 1 -- 172.21.15.40:0/336621933 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc007070 con 0x7fbbe4133e00 2023-09-30T22:26:41.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.083+0000 7fbbe0ff9700 1 -- 172.21.15.40:0/336621933 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbbdc0071d0 con 0x7fbbe4133e00 2023-09-30T22:26:41.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.083+0000 7fbbea7aa700 1 -- 172.21.15.40:0/336621933 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbc40052e0 con 0x7fbbe4133e00 2023-09-30T22:26:41.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.084+0000 7fbbe0ff9700 1 -- 172.21.15.40:0/336621933 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fbbdc03f430 con 0x7fbbe4133e00 2023-09-30T22:26:41.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.088+0000 7fbbe0ff9700 1 -- 172.21.15.40:0/336621933 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbbdc017080 con 0x7fbbe4133e00 2023-09-30T22:26:41.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.212+0000 7f3b19955700 1 -- 172.21.15.40:0/3389883521 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3b14062380 con 0x7f3b1412d6d0 2023-09-30T22:26:41.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.212+0000 7f3afbfff700 1 -- 172.21.15.40:0/3389883521 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3b04021020 con 0x7f3b1412d6d0 2023-09-30T22:26:41.213 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:41.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.215+0000 7f3b19955700 1 -- 172.21.15.40:0/3389883521 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b1412d6d0 msgr2=0x7f3b141c8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:41.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.215+0000 7f3b19955700 1 --2- 172.21.15.40:0/3389883521 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b1412d6d0 0x7f3b141c8370 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3b0400e9b0 tx=0x7f3b0400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.215+0000 7f3b19955700 1 -- 172.21.15.40:0/3389883521 shutdown_connections 2023-09-30T22:26:41.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.215+0000 7f3b19955700 1 --2- 172.21.15.40:0/3389883521 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b1412eea0 0x7f3b141c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.215+0000 7f3b19955700 1 --2- 172.21.15.40:0/3389883521 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b1412d6d0 0x7f3b141c8370 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.215+0000 7f3b19955700 1 --2- 172.21.15.40:0/3389883521 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b1412e590 0x7f3b141c88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.215+0000 7f3b19955700 1 -- 172.21.15.40:0/3389883521 >> 172.21.15.40:0/3389883521 conn(0x7f3b140a2a00 msgr2=0x7f3b14099a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:41.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.216+0000 7f3b19955700 1 -- 172.21.15.40:0/3389883521 shutdown_connections 2023-09-30T22:26:41.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.216+0000 7f3b19955700 1 -- 172.21.15.40:0/3389883521 wait complete. 2023-09-30T22:26:41.234 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:41.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.253+0000 7f6762ea6700 1 -- 172.21.15.40:0/148102591 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f675c06e600 con 0x7f675c09e480 2023-09-30T22:26:41.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.254+0000 7f67597fa700 1 -- 172.21.15.40:0/148102591 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f675401a970 con 0x7f675c09e480 2023-09-30T22:26:41.254 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:41.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.256+0000 7f6762ea6700 1 -- 172.21.15.40:0/148102591 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f675c09e480 msgr2=0x7f675c1300d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:41.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.256+0000 7f6762ea6700 1 --2- 172.21.15.40:0/148102591 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f675c09e480 0x7f675c1300d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6754014040 tx=0x7f6754004ad0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.256+0000 7f6762ea6700 1 -- 172.21.15.40:0/148102591 shutdown_connections 2023-09-30T22:26:41.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.256+0000 7f6762ea6700 1 --2- 172.21.15.40:0/148102591 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f675c09c890 0x7f675c12f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.256+0000 7f6762ea6700 1 --2- 172.21.15.40:0/148102591 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f675c09e480 0x7f675c1300d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.256+0000 7f6762ea6700 1 --2- 172.21.15.40:0/148102591 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f675c09d920 0x7f675c12fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.256+0000 7f6762ea6700 1 -- 172.21.15.40:0/148102591 >> 172.21.15.40:0/148102591 conn(0x7f675c0a7080 msgr2=0x7f675c1bb120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:41.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.256+0000 7f6762ea6700 1 -- 172.21.15.40:0/148102591 shutdown_connections 2023-09-30T22:26:41.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.256+0000 7f6762ea6700 1 -- 172.21.15.40:0/148102591 wait complete. 2023-09-30T22:26:41.269 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:41.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.275+0000 7faaf492b700 1 -- 172.21.15.40:0/1503872041 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faaf0062380 con 0x7faaf006a6d0 2023-09-30T22:26:41.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.276+0000 7faadeffd700 1 -- 172.21.15.40:0/1503872041 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faae0034090 con 0x7faaf006a6d0 2023-09-30T22:26:41.276 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:41.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.278+0000 7faaf492b700 1 -- 172.21.15.40:0/1503872041 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faaf006a6d0 msgr2=0x7faaf0132450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:41.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.278+0000 7faaf492b700 1 --2- 172.21.15.40:0/1503872041 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faaf006a6d0 0x7faaf0132450 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7faae0013040 tx=0x7faae0004750 comp rx=0 tx=0).stop 2023-09-30T22:26:41.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.278+0000 7faaf492b700 1 -- 172.21.15.40:0/1503872041 shutdown_connections 2023-09-30T22:26:41.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.278+0000 7faaf492b700 1 --2- 172.21.15.40:0/1503872041 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faaf006a6d0 0x7faaf0132450 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.278+0000 7faaf492b700 1 --2- 172.21.15.40:0/1503872041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faaf009e250 0x7faaf011f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.278+0000 7faaf492b700 1 --2- 172.21.15.40:0/1503872041 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faaf009de60 0x7faaf011efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.278+0000 7faaf492b700 1 -- 172.21.15.40:0/1503872041 >> 172.21.15.40:0/1503872041 conn(0x7faaf009fb20 msgr2=0x7faaf00709c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:41.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.278+0000 7faaf492b700 1 -- 172.21.15.40:0/1503872041 shutdown_connections 2023-09-30T22:26:41.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.278+0000 7faaf492b700 1 -- 172.21.15.40:0/1503872041 wait complete. 2023-09-30T22:26:41.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.287+0000 7fbbea7aa700 1 -- 172.21.15.40:0/336621933 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbbc4005590 con 0x7fbbe4133e00 2023-09-30T22:26:41.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.287+0000 7fbbe0ff9700 1 -- 172.21.15.40:0/336621933 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbbdc01b3b0 con 0x7fbbe4133e00 2023-09-30T22:26:41.288 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:41.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.289+0000 7fbbea7aa700 1 -- 172.21.15.40:0/336621933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe4133e00 msgr2=0x7fbbe4119ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:41.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.289+0000 7fbbea7aa700 1 --2- 172.21.15.40:0/336621933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe4133e00 0x7fbbe4119ad0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc00cbd0 tx=0x7fbbdc00cee0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.289+0000 7fbbea7aa700 1 -- 172.21.15.40:0/336621933 shutdown_connections 2023-09-30T22:26:41.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.289+0000 7fbbea7aa700 1 --2- 172.21.15.40:0/336621933 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbbe409d400 0x7fbbe4119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.289+0000 7fbbea7aa700 1 --2- 172.21.15.40:0/336621933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe4133e00 0x7fbbe4119ad0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.289+0000 7fbbea7aa700 1 --2- 172.21.15.40:0/336621933 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbbe409dd70 0x7fbbe4119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.289+0000 7fbbea7aa700 1 -- 172.21.15.40:0/336621933 >> 172.21.15.40:0/336621933 conn(0x7fbbe40a2a00 msgr2=0x7fbbe412d980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:41.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.289+0000 7fbbea7aa700 1 -- 172.21.15.40:0/336621933 shutdown_connections 2023-09-30T22:26:41.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:41.289+0000 7fbbea7aa700 1 -- 172.21.15.40:0/336621933 wait complete. 2023-09-30T22:26:41.291 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:41.302 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:42.235 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:42.270 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:42.293 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:42.303 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:42.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.381+0000 7f58194f2700 1 Processor -- start 2023-09-30T22:26:42.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.381+0000 7f58194f2700 1 -- start start 2023-09-30T22:26:42.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.382+0000 7f58194f2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f581409d920 0x7f581409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.382+0000 7f58194f2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f581409e230 0x7f58141308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.382+0000 7f58194f2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f581409adf0 con 0x7f5814130de0 2023-09-30T22:26:42.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.382+0000 7f58194f2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f581409edf0 con 0x7f581409e230 2023-09-30T22:26:42.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.382+0000 7f58194f2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f581409b660 con 0x7f581409d920 2023-09-30T22:26:42.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.382+0000 7f58137fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5814130de0 0x7f5814137d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46764/0 (socket says 172.21.15.40:46764) 2023-09-30T22:26:42.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.383+0000 7f58137fe700 1 -- 172.21.15.40:0/3557480978 learned_addr learned my addr 172.21.15.40:0/3557480978 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:42.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.383+0000 7f5812ffd700 1 --2- 172.21.15.40:0/3557480978 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f581409d920 0x7f581409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.383+0000 7f58127fc700 1 --2- 172.21.15.40:0/3557480978 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f581409e230 0x7f58141308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.383+0000 7f5811ffb700 1 -- 172.21.15.40:0/3557480978 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1812143619 0 0) 0x7f581409adf0 con 0x7f5814130de0 2023-09-30T22:26:42.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.383+0000 7f5811ffb700 1 -- 172.21.15.40:0/3557480978 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57fc0035b0 con 0x7f5814130de0 2023-09-30T22:26:42.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.383+0000 7f5812ffd700 1 -- 172.21.15.40:0/3557480978 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f581409e230 msgr2=0x7f58141308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:42.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.383+0000 7f5812ffd700 1 --2- 172.21.15.40:0/3557480978 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f581409e230 0x7f58141308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.383+0000 7f5812ffd700 1 -- 172.21.15.40:0/3557480978 >> v1:172.21.15.40:6789/0 conn(0x7f5814130de0 legacy=0x7f5814137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:42.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.383+0000 7f5812ffd700 1 -- 172.21.15.40:0/3557480978 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f581409a6e0 con 0x7f581409d920 2023-09-30T22:26:42.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.383+0000 7f5812ffd700 1 --2- 172.21.15.40:0/3557480978 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f581409d920 0x7f581409dcf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5804009850 tx=0x7f5804009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78e2786c5518191b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:42.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.383+0000 7f5811ffb700 1 -- 172.21.15.40:0/3557480978 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5804005e30 con 0x7f581409d920 2023-09-30T22:26:42.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.383+0000 7f5811ffb700 1 -- 172.21.15.40:0/3557480978 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5804006030 con 0x7f581409d920 2023-09-30T22:26:42.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.383+0000 7f5811ffb700 1 -- 172.21.15.40:0/3557480978 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58040063a0 con 0x7f581409d920 2023-09-30T22:26:42.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.384+0000 7f58194f2700 1 -- 172.21.15.40:0/3557480978 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f581409d920 msgr2=0x7f581409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:42.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.384+0000 7f58194f2700 1 --2- 172.21.15.40:0/3557480978 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f581409d920 0x7f581409dcf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5804009850 tx=0x7f5804009b60 comp rx=0 tx=0).stop 2023-09-30T22:26:42.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.384+0000 7f58194f2700 1 -- 172.21.15.40:0/3557480978 shutdown_connections 2023-09-30T22:26:42.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.384+0000 7f58194f2700 1 --2- 172.21.15.40:0/3557480978 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f581409d920 0x7f581409dcf0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.384+0000 7f58194f2700 1 --2- 172.21.15.40:0/3557480978 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f581409e230 0x7f58141308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.384+0000 7f58194f2700 1 -- 172.21.15.40:0/3557480978 >> 172.21.15.40:0/3557480978 conn(0x7f581409fb20 msgr2=0x7f581409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:42.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.385+0000 7f58194f2700 1 -- 172.21.15.40:0/3557480978 shutdown_connections 2023-09-30T22:26:42.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.385+0000 7f58194f2700 1 -- 172.21.15.40:0/3557480978 wait complete. 2023-09-30T22:26:42.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.386+0000 7f58194f2700 1 Processor -- start 2023-09-30T22:26:42.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.386+0000 7f58194f2700 1 -- start start 2023-09-30T22:26:42.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.386+0000 7f58194f2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f581409d920 0x7f5814129df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.386+0000 7f58194f2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f581409e230 0x7f581413a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.386+0000 7f58194f2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5814130de0 0x7f581413a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.386+0000 7f58194f2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581413c1c0 con 0x7f5814130de0 2023-09-30T22:26:42.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.386+0000 7f58194f2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f581413bfd0 con 0x7f581409e230 2023-09-30T22:26:42.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.386+0000 7f58194f2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f581412ed70 con 0x7f581409d920 2023-09-30T22:26:42.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.387+0000 7f5812ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f581409d920 0x7f5814129df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.387+0000 7f58127fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f581409e230 0x7f581413a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.387+0000 7f5812ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f581409d920 0x7f5814129df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:44684/0 (socket says 172.21.15.40:44684) 2023-09-30T22:26:42.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.387+0000 7f5812ffd700 1 -- 172.21.15.40:0/2781323452 learned_addr learned my addr 172.21.15.40:0/2781323452 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:42.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.387+0000 7f58137fe700 1 --2- 172.21.15.40:0/2781323452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5814130de0 0x7f581413a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.387+0000 7f5812ffd700 1 -- 172.21.15.40:0/2781323452 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f581409e230 msgr2=0x7f581413a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:42.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.387+0000 7f5812ffd700 1 --2- 172.21.15.40:0/2781323452 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f581409e230 0x7f581413a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.387+0000 7f5812ffd700 1 -- 172.21.15.40:0/2781323452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5814130de0 msgr2=0x7f581413a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:42.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.387+0000 7f5812ffd700 1 --2- 172.21.15.40:0/2781323452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5814130de0 0x7f581413a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.387+0000 7f5812ffd700 1 -- 172.21.15.40:0/2781323452 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5804009430 con 0x7f581409d920 2023-09-30T22:26:42.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.387+0000 7f5812ffd700 1 --2- 172.21.15.40:0/2781323452 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f581409d920 0x7f5814129df0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5804009ba0 tx=0x7f5804004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:42.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.387+0000 7f57fb7fe700 1 -- 172.21.15.40:0/2781323452 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5804006870 con 0x7f581409d920 2023-09-30T22:26:42.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.387+0000 7f58194f2700 1 -- 172.21.15.40:0/2781323452 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f581413a0a0 con 0x7f581409d920 2023-09-30T22:26:42.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.387+0000 7f57fb7fe700 1 -- 172.21.15.40:0/2781323452 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5804020070 con 0x7f581409d920 2023-09-30T22:26:42.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.388+0000 7f57fb7fe700 1 -- 172.21.15.40:0/2781323452 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5804004040 con 0x7f581409d920 2023-09-30T22:26:42.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.388+0000 7f58194f2700 1 -- 172.21.15.40:0/2781323452 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5814130110 con 0x7f581409d920 2023-09-30T22:26:42.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.388+0000 7f57fb7fe700 1 -- 172.21.15.40:0/2781323452 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5804022030 con 0x7f581409d920 2023-09-30T22:26:42.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.389+0000 7f57fb7fe700 1 -- 172.21.15.40:0/2781323452 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5804040ca0 con 0x7f581409d920 2023-09-30T22:26:42.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.389+0000 7f58194f2700 1 -- 172.21.15.40:0/2781323452 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5814139620 con 0x7f581409d920 2023-09-30T22:26:42.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.398+0000 7f57fb7fe700 1 -- 172.21.15.40:0/2781323452 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f58040197c0 con 0x7f581409d920 2023-09-30T22:26:42.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.427+0000 7f4e778b7700 1 Processor -- start 2023-09-30T22:26:42.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.427+0000 7f4e778b7700 1 -- start start 2023-09-30T22:26:42.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.427+0000 7f4e778b7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e7009f0f0 0x7f4e70138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.428+0000 7f4e778b7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4e7009e400 0x7f4e7013b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.428+0000 7f4e778b7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e7009f940 con 0x7f4e7009d920 2023-09-30T22:26:42.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.428+0000 7f4e778b7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e7006b4c0 con 0x7f4e7009e400 2023-09-30T22:26:42.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.428+0000 7f4e778b7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7009a8f0 con 0x7f4e7009f0f0 2023-09-30T22:26:42.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.428+0000 7f4e75653700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f4e7009d920 0x7f4e7009dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46768/0 (socket says 172.21.15.40:46768) 2023-09-30T22:26:42.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.428+0000 7f4e75653700 1 -- 172.21.15.40:0/3465408064 learned_addr learned my addr 172.21.15.40:0/3465408064 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:42.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.428+0000 7f4e74e52700 1 --2- 172.21.15.40:0/3465408064 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e7009f0f0 0x7f4e70138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.428+0000 7f4e75e54700 1 --2- 172.21.15.40:0/3465408064 >> v2:172.21.15.40:3300/0 conn(0x7f4e7009e400 0x7f4e7013b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.428+0000 7f4e74e52700 1 -- 172.21.15.40:0/3465408064 >> v2:172.21.15.40:3300/0 conn(0x7f4e7009e400 msgr2=0x7f4e7013b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:42.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.428+0000 7f4e74e52700 1 --2- 172.21.15.40:0/3465408064 >> v2:172.21.15.40:3300/0 conn(0x7f4e7009e400 0x7f4e7013b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.428+0000 7f4e74e52700 1 -- 172.21.15.40:0/3465408064 >> v1:172.21.15.40:6789/0 conn(0x7f4e7009d920 legacy=0x7f4e7009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:42.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.428+0000 7f4e74e52700 1 -- 172.21.15.40:0/3465408064 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e7009f6e0 con 0x7f4e7009f0f0 2023-09-30T22:26:42.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.428+0000 7f4e74e52700 1 --2- 172.21.15.40:0/3465408064 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e7009f0f0 0x7f4e70138ee0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4e60009840 tx=0x7f4e60009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc3b709213ccf43e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:42.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.428+0000 7f4e67fff700 1 -- 172.21.15.40:0/3465408064 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e60011830 con 0x7f4e7009f0f0 2023-09-30T22:26:42.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.429+0000 7f4e67fff700 1 -- 172.21.15.40:0/3465408064 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e60011990 con 0x7f4e7009f0f0 2023-09-30T22:26:42.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.429+0000 7f4e67fff700 1 -- 172.21.15.40:0/3465408064 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e60011d20 con 0x7f4e7009f0f0 2023-09-30T22:26:42.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.429+0000 7f4e778b7700 1 -- 172.21.15.40:0/3465408064 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e7009f0f0 msgr2=0x7f4e70138ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:42.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.429+0000 7f4e778b7700 1 --2- 172.21.15.40:0/3465408064 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e7009f0f0 0x7f4e70138ee0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4e60009840 tx=0x7f4e60009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:42.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.429+0000 7f4e778b7700 1 -- 172.21.15.40:0/3465408064 shutdown_connections 2023-09-30T22:26:42.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.429+0000 7f4e778b7700 1 --2- 172.21.15.40:0/3465408064 >> v2:172.21.15.40:3300/0 conn(0x7f4e7009e400 0x7f4e7013b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.429+0000 7f4e778b7700 1 --2- 172.21.15.40:0/3465408064 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e7009f0f0 0x7f4e70138ee0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.429+0000 7f4e778b7700 1 -- 172.21.15.40:0/3465408064 >> 172.21.15.40:0/3465408064 conn(0x7f4e7009fb20 msgr2=0x7f4e7009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:42.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.429+0000 7f4e778b7700 1 -- 172.21.15.40:0/3465408064 shutdown_connections 2023-09-30T22:26:42.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.429+0000 7f4e778b7700 1 -- 172.21.15.40:0/3465408064 wait complete. 2023-09-30T22:26:42.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.430+0000 7f4e778b7700 1 Processor -- start 2023-09-30T22:26:42.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.430+0000 7f4e778b7700 1 -- start start 2023-09-30T22:26:42.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.431+0000 7f4e778b7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e7009d920 0x7f4e7011e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.431+0000 7f4e778b7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e7009e400 0x7f4e7011ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.431+0000 7f4e778b7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e7011f270 0x7f4e701ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.431+0000 7f4e778b7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7011f680 con 0x7f4e7009e400 2023-09-30T22:26:42.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.431+0000 7f4e778b7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e700a31d0 con 0x7f4e7009d920 2023-09-30T22:26:42.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.431+0000 7f4e778b7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7009c9e0 con 0x7f4e7011f270 2023-09-30T22:26:42.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.431+0000 7f4e75653700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e7009d920 0x7f4e7011e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.431+0000 7f4e75653700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e7009d920 0x7f4e7011e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38144/0 (socket says 172.21.15.40:38144) 2023-09-30T22:26:42.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.431+0000 7f4e75653700 1 -- 172.21.15.40:0/3679852899 learned_addr learned my addr 172.21.15.40:0/3679852899 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:42.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.431+0000 7f4e74e52700 1 --2- 172.21.15.40:0/3679852899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e7009e400 0x7f4e7011ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.431+0000 7f4e75653700 1 -- 172.21.15.40:0/3679852899 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e7011f270 msgr2=0x7f4e701ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:42.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.431+0000 7f4e75653700 1 --2- 172.21.15.40:0/3679852899 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e7011f270 0x7f4e701ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.431+0000 7f4e75653700 1 -- 172.21.15.40:0/3679852899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e7009e400 msgr2=0x7f4e7011ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:42.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.431+0000 7f4e75653700 1 --2- 172.21.15.40:0/3679852899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e7009e400 0x7f4e7011ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.431+0000 7f4e75653700 1 -- 172.21.15.40:0/3679852899 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e600094a0 con 0x7f4e7009d920 2023-09-30T22:26:42.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.431+0000 7f4e74e52700 1 --2- 172.21.15.40:0/3679852899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e7009e400 0x7f4e7011ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:42.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.431+0000 7f4e75653700 1 --2- 172.21.15.40:0/3679852899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e7009d920 0x7f4e7011e7f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c00c730 tx=0x7f4e6c00ca40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:42.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.432+0000 7f4e65ffb700 1 -- 172.21.15.40:0/3679852899 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c0074e0 con 0x7f4e7009d920 2023-09-30T22:26:42.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.432+0000 7f4e65ffb700 1 -- 172.21.15.40:0/3679852899 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e6c007640 con 0x7f4e7009d920 2023-09-30T22:26:42.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.432+0000 7f4e778b7700 1 -- 172.21.15.40:0/3679852899 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e70121a50 con 0x7f4e7009d920 2023-09-30T22:26:42.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.432+0000 7f4e65ffb700 1 -- 172.21.15.40:0/3679852899 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c005a30 con 0x7f4e7009d920 2023-09-30T22:26:42.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.432+0000 7f4e778b7700 1 -- 172.21.15.40:0/3679852899 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e70120ba0 con 0x7f4e7009d920 2023-09-30T22:26:42.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.433+0000 7f4e65ffb700 1 -- 172.21.15.40:0/3679852899 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4e6c005b90 con 0x7f4e7009d920 2023-09-30T22:26:42.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.433+0000 7f4e65ffb700 1 -- 172.21.15.40:0/3679852899 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4e6c011e10 con 0x7f4e7009d920 2023-09-30T22:26:42.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.433+0000 7f4e778b7700 1 -- 172.21.15.40:0/3679852899 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e70121c40 con 0x7f4e7009d920 2023-09-30T22:26:42.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.438+0000 7f4e65ffb700 1 -- 172.21.15.40:0/3679852899 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4e6c017070 con 0x7f4e7009d920 2023-09-30T22:26:42.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.461+0000 7f806e005700 1 Processor -- start 2023-09-30T22:26:42.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.461+0000 7f806e005700 1 -- start start 2023-09-30T22:26:42.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.461+0000 7f806e005700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f806809c890 0x7f806809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.461+0000 7f806e005700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f806809d920 0x7f806809dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.462+0000 7f806e005700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f806809e2b0 0x7f806813ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.462+0000 7f806e005700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80680a29d0 con 0x7f806809e2b0 2023-09-30T22:26:42.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.462+0000 7f806e005700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f806809fb40 con 0x7f806809d920 2023-09-30T22:26:42.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.462+0000 7f806e005700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80680a2600 con 0x7f806809c890 2023-09-30T22:26:42.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.462+0000 7f8066ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f806809d920 0x7f806809dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.462+0000 7f80677fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f806809c890 0x7f806809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.462+0000 7f8066ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f806809d920 0x7f806809dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38150/0 (socket says 172.21.15.40:38150) 2023-09-30T22:26:42.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.462+0000 7f8066ffd700 1 -- 172.21.15.40:0/577323605 learned_addr learned my addr 172.21.15.40:0/577323605 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:42.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.462+0000 7f8067fff700 1 --2- 172.21.15.40:0/577323605 >> v2:172.21.15.40:3300/0 conn(0x7f806809e2b0 0x7f806813ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.462+0000 7f80677fe700 1 -- 172.21.15.40:0/577323605 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f806809d920 msgr2=0x7f806809dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:42.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.462+0000 7f80677fe700 1 --2- 172.21.15.40:0/577323605 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f806809d920 0x7f806809dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.462+0000 7f80677fe700 1 -- 172.21.15.40:0/577323605 >> v2:172.21.15.40:3300/0 conn(0x7f806809e2b0 msgr2=0x7f806813ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:42.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.462+0000 7f80677fe700 1 --2- 172.21.15.40:0/577323605 >> v2:172.21.15.40:3300/0 conn(0x7f806809e2b0 0x7f806813ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.462+0000 7f80677fe700 1 -- 172.21.15.40:0/577323605 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f806809e720 con 0x7f806809c890 2023-09-30T22:26:42.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.462+0000 7f80677fe700 1 --2- 172.21.15.40:0/577323605 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f806809c890 0x7f806809cc60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8058009820 tx=0x7f8058009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6e8712ad11d86d5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:42.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.462+0000 7f80667fc700 1 -- 172.21.15.40:0/577323605 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8058005e30 con 0x7f806809c890 2023-09-30T22:26:42.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.463+0000 7f80667fc700 1 -- 172.21.15.40:0/577323605 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8058006030 con 0x7f806809c890 2023-09-30T22:26:42.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.463+0000 7f80667fc700 1 -- 172.21.15.40:0/577323605 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80580063c0 con 0x7f806809c890 2023-09-30T22:26:42.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.463+0000 7f806e005700 1 -- 172.21.15.40:0/577323605 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f806809c890 msgr2=0x7f806809cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:42.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.463+0000 7f806e005700 1 --2- 172.21.15.40:0/577323605 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f806809c890 0x7f806809cc60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8058009820 tx=0x7f8058009b30 comp rx=0 tx=0).stop 2023-09-30T22:26:42.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.463+0000 7f806e005700 1 -- 172.21.15.40:0/577323605 shutdown_connections 2023-09-30T22:26:42.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.463+0000 7f806e005700 1 --2- 172.21.15.40:0/577323605 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f806809c890 0x7f806809cc60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.463+0000 7f806e005700 1 --2- 172.21.15.40:0/577323605 >> v2:172.21.15.40:3300/0 conn(0x7f806809e2b0 0x7f806813ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.463+0000 7f806e005700 1 --2- 172.21.15.40:0/577323605 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f806809d920 0x7f806809dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.463+0000 7f806e005700 1 -- 172.21.15.40:0/577323605 >> 172.21.15.40:0/577323605 conn(0x7f80680a7080 msgr2=0x7f80680a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:42.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.463+0000 7f806e005700 1 -- 172.21.15.40:0/577323605 shutdown_connections 2023-09-30T22:26:42.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.463+0000 7f806e005700 1 -- 172.21.15.40:0/577323605 wait complete. 2023-09-30T22:26:42.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.465+0000 7f806e005700 1 Processor -- start 2023-09-30T22:26:42.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.465+0000 7f806e005700 1 -- start start 2023-09-30T22:26:42.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.465+0000 7f806e005700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f806809c890 0x7f80681c0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.465+0000 7f806e005700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f806809d920 0x7f80681c1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.465+0000 7f806e005700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f806809e2b0 0x7f80681c3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.465+0000 7f806e005700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80681315c0 con 0x7f806809e2b0 2023-09-30T22:26:42.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.465+0000 7f806e005700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8068130cc0 con 0x7f806809c890 2023-09-30T22:26:42.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.465+0000 7f806e005700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f806812f210 con 0x7f806809d920 2023-09-30T22:26:42.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.466+0000 7f80677fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f806809c890 0x7f80681c0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.466+0000 7f8067fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f806809e2b0 0x7f80681c3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.466+0000 7f80677fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f806809c890 0x7f80681c0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38164/0 (socket says 172.21.15.40:38164) 2023-09-30T22:26:42.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.466+0000 7f8067fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f806809e2b0 0x7f80681c3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34612/0 (socket says 172.21.15.40:34612) 2023-09-30T22:26:42.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.466+0000 7f80677fe700 1 -- 172.21.15.40:0/2864269174 learned_addr learned my addr 172.21.15.40:0/2864269174 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:42.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.466+0000 7f8066ffd700 1 --2- 172.21.15.40:0/2864269174 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f806809d920 0x7f80681c1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.466+0000 7f8067fff700 1 -- 172.21.15.40:0/2864269174 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f806809d920 msgr2=0x7f80681c1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:42.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.466+0000 7f8067fff700 1 --2- 172.21.15.40:0/2864269174 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f806809d920 0x7f80681c1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.466+0000 7f8067fff700 1 -- 172.21.15.40:0/2864269174 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f806809c890 msgr2=0x7f80681c0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:42.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.466+0000 7f8067fff700 1 --2- 172.21.15.40:0/2864269174 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f806809c890 0x7f80681c0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.466+0000 7f8067fff700 1 -- 172.21.15.40:0/2864269174 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8058009430 con 0x7f806809e2b0 2023-09-30T22:26:42.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.466+0000 7f8067fff700 1 --2- 172.21.15.40:0/2864269174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f806809e2b0 0x7f80681c3ed0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f806000efc0 tx=0x7f806000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:42.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.466+0000 7f804ffff700 1 -- 172.21.15.40:0/2864269174 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806000cd40 con 0x7f806809e2b0 2023-09-30T22:26:42.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.466+0000 7f804ffff700 1 -- 172.21.15.40:0/2864269174 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806000f040 con 0x7f806809e2b0 2023-09-30T22:26:42.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.466+0000 7f804ffff700 1 -- 172.21.15.40:0/2864269174 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80600146c0 con 0x7f806809e2b0 2023-09-30T22:26:42.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.466+0000 7f806e005700 1 -- 172.21.15.40:0/2864269174 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8068130250 con 0x7f806809e2b0 2023-09-30T22:26:42.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.466+0000 7f806e005700 1 -- 172.21.15.40:0/2864269174 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80681c16c0 con 0x7f806809e2b0 2023-09-30T22:26:42.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.467+0000 7f804ffff700 1 -- 172.21.15.40:0/2864269174 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8060014820 con 0x7f806809e2b0 2023-09-30T22:26:42.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.467+0000 7f806e005700 1 -- 172.21.15.40:0/2864269174 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f806812e960 con 0x7f806809e2b0 2023-09-30T22:26:42.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.468+0000 7f804ffff700 1 -- 172.21.15.40:0/2864269174 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f80600404f0 con 0x7f806809e2b0 2023-09-30T22:26:42.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.477+0000 7f804ffff700 1 -- 172.21.15.40:0/2864269174 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8060007920 con 0x7f806809e2b0 2023-09-30T22:26:42.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.493+0000 7f61b22e1700 1 Processor -- start 2023-09-30T22:26:42.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.493+0000 7f61b22e1700 1 -- start start 2023-09-30T22:26:42.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.493+0000 7f61b22e1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61ac06c990 0x7f61ac06cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.493+0000 7f61b22e1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f61ac06d2a0 0x7f61ac13c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.493+0000 7f61b22e1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61ac06df30 con 0x7f61ac13c8f0 2023-09-30T22:26:42.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.493+0000 7f61b22e1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac06ec40 con 0x7f61ac06c990 2023-09-30T22:26:42.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.493+0000 7f61b22e1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac06ea40 con 0x7f61ac06d2a0 2023-09-30T22:26:42.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.493+0000 7f61ab7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f61ac06d2a0 0x7f61ac13c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.493+0000 7f61abfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61ac06c990 0x7f61ac06cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.493+0000 7f61ab7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f61ac06d2a0 0x7f61ac13c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:44738/0 (socket says 172.21.15.40:44738) 2023-09-30T22:26:42.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.493+0000 7f61abfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61ac06c990 0x7f61ac06cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38168/0 (socket says 172.21.15.40:38168) 2023-09-30T22:26:42.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.493+0000 7f61ab7fe700 1 -- 172.21.15.40:0/2625034071 learned_addr learned my addr 172.21.15.40:0/2625034071 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:42.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.494+0000 7f61abfff700 1 -- 172.21.15.40:0/2625034071 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f61ac06d2a0 msgr2=0x7f61ac13c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:42.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.494+0000 7f61abfff700 1 --2- 172.21.15.40:0/2625034071 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f61ac06d2a0 0x7f61ac13c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.494+0000 7f61abfff700 1 -- 172.21.15.40:0/2625034071 >> v1:172.21.15.40:6789/0 conn(0x7f61ac13c8f0 legacy=0x7f61ac13ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:42.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.494+0000 7f61abfff700 1 -- 172.21.15.40:0/2625034071 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ac072050 con 0x7f61ac06c990 2023-09-30T22:26:42.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.494+0000 7f61abfff700 1 --2- 172.21.15.40:0/2625034071 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61ac06c990 0x7f61ac06cd60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f619c009870 tx=0x7f619c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=502581ed5c556ff6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:42.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.494+0000 7f61aaffd700 1 -- 172.21.15.40:0/2625034071 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c004230 con 0x7f61ac06c990 2023-09-30T22:26:42.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.494+0000 7f61aaffd700 1 -- 172.21.15.40:0/2625034071 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619c004390 con 0x7f61ac06c990 2023-09-30T22:26:42.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.494+0000 7f61aaffd700 1 -- 172.21.15.40:0/2625034071 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c0036a0 con 0x7f61ac06c990 2023-09-30T22:26:42.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.495+0000 7f61b22e1700 1 -- 172.21.15.40:0/2625034071 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61ac06c990 msgr2=0x7f61ac06cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:42.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.495+0000 7f61b22e1700 1 --2- 172.21.15.40:0/2625034071 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61ac06c990 0x7f61ac06cd60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f619c009870 tx=0x7f619c009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:42.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.495+0000 7f61b22e1700 1 -- 172.21.15.40:0/2625034071 shutdown_connections 2023-09-30T22:26:42.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.495+0000 7f61b22e1700 1 --2- 172.21.15.40:0/2625034071 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61ac06c990 0x7f61ac06cd60 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.495+0000 7f61b22e1700 1 --2- 172.21.15.40:0/2625034071 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f61ac06d2a0 0x7f61ac13c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.495+0000 7f61b22e1700 1 -- 172.21.15.40:0/2625034071 >> 172.21.15.40:0/2625034071 conn(0x7f61ac0a41a0 msgr2=0x7f61ac0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:42.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.495+0000 7f61b22e1700 1 -- 172.21.15.40:0/2625034071 shutdown_connections 2023-09-30T22:26:42.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.495+0000 7f61b22e1700 1 -- 172.21.15.40:0/2625034071 wait complete. 2023-09-30T22:26:42.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.496+0000 7f61b22e1700 1 Processor -- start 2023-09-30T22:26:42.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.496+0000 7f61b22e1700 1 -- start start 2023-09-30T22:26:42.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.496+0000 7f61b22e1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61ac06c990 0x7f61ac08cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.496+0000 7f61b22e1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61ac06d2a0 0x7f61ac08d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.496+0000 7f61b22e1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f61ac13c8f0 0x7f61ac1ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.496+0000 7f61b22e1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac129ea0 con 0x7f61ac06d2a0 2023-09-30T22:26:42.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.496+0000 7f61b22e1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac129b70 con 0x7f61ac06c990 2023-09-30T22:26:42.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.496+0000 7f61b22e1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac08e6d0 con 0x7f61ac13c8f0 2023-09-30T22:26:42.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.496+0000 7f61ab7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61ac06d2a0 0x7f61ac08d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.497+0000 7f61ab7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61ac06d2a0 0x7f61ac08d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34614/0 (socket says 172.21.15.40:34614) 2023-09-30T22:26:42.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.497+0000 7f61ab7fe700 1 -- 172.21.15.40:0/3702430950 learned_addr learned my addr 172.21.15.40:0/3702430950 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:42.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.497+0000 7f61abfff700 1 --2- 172.21.15.40:0/3702430950 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61ac06c990 0x7f61ac08cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.497+0000 7f61b087e700 1 --2- 172.21.15.40:0/3702430950 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f61ac13c8f0 0x7f61ac1ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.497+0000 7f61ab7fe700 1 -- 172.21.15.40:0/3702430950 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f61ac13c8f0 msgr2=0x7f61ac1ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:42.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.497+0000 7f61ab7fe700 1 --2- 172.21.15.40:0/3702430950 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f61ac13c8f0 0x7f61ac1ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.497+0000 7f61ab7fe700 1 -- 172.21.15.40:0/3702430950 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61ac06c990 msgr2=0x7f61ac08cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:42.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.497+0000 7f61ab7fe700 1 --2- 172.21.15.40:0/3702430950 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61ac06c990 0x7f61ac08cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.497+0000 7f61ab7fe700 1 -- 172.21.15.40:0/3702430950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f619c0094a0 con 0x7f61ac06d2a0 2023-09-30T22:26:42.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.497+0000 7f61ab7fe700 1 --2- 172.21.15.40:0/3702430950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61ac06d2a0 0x7f61ac08d270 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f61a000e910 tx=0x7f61a000ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:42.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.497+0000 7f61a8ff9700 1 -- 172.21.15.40:0/3702430950 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a0013680 con 0x7f61ac06d2a0 2023-09-30T22:26:42.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.497+0000 7f61b22e1700 1 -- 172.21.15.40:0/3702430950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61ac08c790 con 0x7f61ac06d2a0 2023-09-30T22:26:42.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.497+0000 7f61b22e1700 1 -- 172.21.15.40:0/3702430950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61ac08e430 con 0x7f61ac06d2a0 2023-09-30T22:26:42.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.497+0000 7f61a8ff9700 1 -- 172.21.15.40:0/3702430950 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a00137e0 con 0x7f61ac06d2a0 2023-09-30T22:26:42.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.497+0000 7f61a8ff9700 1 -- 172.21.15.40:0/3702430950 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a0013b70 con 0x7f61ac06d2a0 2023-09-30T22:26:42.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.499+0000 7f61b22e1700 1 -- 172.21.15.40:0/3702430950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f618c0052e0 con 0x7f61ac06d2a0 2023-09-30T22:26:42.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.499+0000 7f61a8ff9700 1 -- 172.21.15.40:0/3702430950 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f61a0013cd0 con 0x7f61ac06d2a0 2023-09-30T22:26:42.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.499+0000 7f61a8ff9700 1 -- 172.21.15.40:0/3702430950 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f61a003f5b0 con 0x7f61ac06d2a0 2023-09-30T22:26:42.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.508+0000 7f61a8ff9700 1 -- 172.21.15.40:0/3702430950 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f61a001bc30 con 0x7f61ac06d2a0 2023-09-30T22:26:42.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.645+0000 7f4e778b7700 1 -- 172.21.15.40:0/3679852899 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4e70062380 con 0x7f4e7009d920 2023-09-30T22:26:42.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.646+0000 7f4e65ffb700 1 -- 172.21.15.40:0/3679852899 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4e6c017020 con 0x7f4e7009d920 2023-09-30T22:26:42.647 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:42.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.648+0000 7f4e778b7700 1 -- 172.21.15.40:0/3679852899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e7009d920 msgr2=0x7f4e7011e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:42.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.648+0000 7f4e778b7700 1 --2- 172.21.15.40:0/3679852899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e7009d920 0x7f4e7011e7f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c00c730 tx=0x7f4e6c00ca40 comp rx=0 tx=0).stop 2023-09-30T22:26:42.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.648+0000 7f4e778b7700 1 -- 172.21.15.40:0/3679852899 shutdown_connections 2023-09-30T22:26:42.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.648+0000 7f4e778b7700 1 --2- 172.21.15.40:0/3679852899 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e7011f270 0x7f4e701ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.648+0000 7f4e778b7700 1 --2- 172.21.15.40:0/3679852899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e7009d920 0x7f4e7011e7f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.648+0000 7f4e778b7700 1 --2- 172.21.15.40:0/3679852899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e7009e400 0x7f4e7011ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.648+0000 7f4e778b7700 1 -- 172.21.15.40:0/3679852899 >> 172.21.15.40:0/3679852899 conn(0x7f4e7009fb20 msgr2=0x7f4e700a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:42.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.648+0000 7f4e778b7700 1 -- 172.21.15.40:0/3679852899 shutdown_connections 2023-09-30T22:26:42.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.648+0000 7f4e778b7700 1 -- 172.21.15.40:0/3679852899 wait complete. 2023-09-30T22:26:42.661 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:42.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.679+0000 7f806e005700 1 -- 172.21.15.40:0/2864269174 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8068062380 con 0x7f806809e2b0 2023-09-30T22:26:42.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.680+0000 7f804ffff700 1 -- 172.21.15.40:0/2864269174 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8060018030 con 0x7f806809e2b0 2023-09-30T22:26:42.680 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:42.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.681+0000 7f806e005700 1 -- 172.21.15.40:0/2864269174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f806809e2b0 msgr2=0x7f80681c3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:42.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.681+0000 7f806e005700 1 --2- 172.21.15.40:0/2864269174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f806809e2b0 0x7f80681c3ed0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f806000efc0 tx=0x7f806000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.682+0000 7f806e005700 1 -- 172.21.15.40:0/2864269174 shutdown_connections 2023-09-30T22:26:42.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.682+0000 7f806e005700 1 --2- 172.21.15.40:0/2864269174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f806809e2b0 0x7f80681c3ed0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.682+0000 7f806e005700 1 --2- 172.21.15.40:0/2864269174 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f806809c890 0x7f80681c0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.682+0000 7f806e005700 1 --2- 172.21.15.40:0/2864269174 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f806809d920 0x7f80681c1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.682+0000 7f806e005700 1 -- 172.21.15.40:0/2864269174 >> 172.21.15.40:0/2864269174 conn(0x7f80680a7080 msgr2=0x7f80680a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:42.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.682+0000 7f806e005700 1 -- 172.21.15.40:0/2864269174 shutdown_connections 2023-09-30T22:26:42.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.682+0000 7f806e005700 1 -- 172.21.15.40:0/2864269174 wait complete. 2023-09-30T22:26:42.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.684+0000 7f58194f2700 1 -- 172.21.15.40:0/2781323452 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5814062380 con 0x7f581409d920 2023-09-30T22:26:42.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.684+0000 7f57fb7fe700 1 -- 172.21.15.40:0/2781323452 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f580401b410 con 0x7f581409d920 2023-09-30T22:26:42.685 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:42.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.686+0000 7f58194f2700 1 -- 172.21.15.40:0/2781323452 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f581409d920 msgr2=0x7f5814129df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:42.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.686+0000 7f58194f2700 1 --2- 172.21.15.40:0/2781323452 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f581409d920 0x7f5814129df0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5804009ba0 tx=0x7f5804004750 comp rx=0 tx=0).stop 2023-09-30T22:26:42.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.686+0000 7f58194f2700 1 -- 172.21.15.40:0/2781323452 shutdown_connections 2023-09-30T22:26:42.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.686+0000 7f58194f2700 1 --2- 172.21.15.40:0/2781323452 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f581409d920 0x7f5814129df0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.686+0000 7f58194f2700 1 --2- 172.21.15.40:0/2781323452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5814130de0 0x7f581413a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.686+0000 7f58194f2700 1 --2- 172.21.15.40:0/2781323452 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f581409e230 0x7f581413a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.686+0000 7f58194f2700 1 -- 172.21.15.40:0/2781323452 >> 172.21.15.40:0/2781323452 conn(0x7f581409fb20 msgr2=0x7f581406ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:42.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.686+0000 7f58194f2700 1 -- 172.21.15.40:0/2781323452 shutdown_connections 2023-09-30T22:26:42.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.686+0000 7f58194f2700 1 -- 172.21.15.40:0/2781323452 wait complete. 2023-09-30T22:26:42.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:42.700 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:42.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.750+0000 7f61b22e1700 1 -- 172.21.15.40:0/3702430950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f618c005590 con 0x7f61ac06d2a0 2023-09-30T22:26:42.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.750+0000 7f61a8ff9700 1 -- 172.21.15.40:0/3702430950 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f61a0021070 con 0x7f61ac06d2a0 2023-09-30T22:26:42.751 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:42.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.752+0000 7f61b22e1700 1 -- 172.21.15.40:0/3702430950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61ac06d2a0 msgr2=0x7f61ac08d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:42.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.752+0000 7f61b22e1700 1 --2- 172.21.15.40:0/3702430950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61ac06d2a0 0x7f61ac08d270 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f61a000e910 tx=0x7f61a000ec20 comp rx=0 tx=0).stop 2023-09-30T22:26:42.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.752+0000 7f61b22e1700 1 -- 172.21.15.40:0/3702430950 shutdown_connections 2023-09-30T22:26:42.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.752+0000 7f61b22e1700 1 --2- 172.21.15.40:0/3702430950 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f61ac13c8f0 0x7f61ac1ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.752+0000 7f61b22e1700 1 --2- 172.21.15.40:0/3702430950 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61ac06c990 0x7f61ac08cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.752+0000 7f61b22e1700 1 --2- 172.21.15.40:0/3702430950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61ac06d2a0 0x7f61ac08d270 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.752+0000 7f61b22e1700 1 -- 172.21.15.40:0/3702430950 >> 172.21.15.40:0/3702430950 conn(0x7f61ac0a41a0 msgr2=0x7f61ac0a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:42.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.753+0000 7f61b22e1700 1 -- 172.21.15.40:0/3702430950 shutdown_connections 2023-09-30T22:26:42.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:42.753+0000 7f61b22e1700 1 -- 172.21.15.40:0/3702430950 wait complete. 2023-09-30T22:26:42.765 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:43.662 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:43.697 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:43.701 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:43.767 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:43.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.812+0000 7f2e32361700 1 Processor -- start 2023-09-30T22:26:43.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.813+0000 7f2e32361700 1 -- start start 2023-09-30T22:26:43.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.813+0000 7f2e32361700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e2c133e00 0x7f2e2c1341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:43.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.813+0000 7f2e32361700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e2c09d400 0x7f2e2c09d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:43.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.813+0000 7f2e32361700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e2c133940 con 0x7f2e2c09dd70 2023-09-30T22:26:43.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.813+0000 7f2e32361700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c09ab20 con 0x7f2e2c09d400 2023-09-30T22:26:43.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.813+0000 7f2e32361700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c09f0d0 con 0x7f2e2c133e00 2023-09-30T22:26:43.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.813+0000 7f2e2bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e2c133e00 0x7f2e2c1341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:43.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.813+0000 7f2e2bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e2c133e00 0x7f2e2c1341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60214/0 (socket says 172.21.15.40:60214) 2023-09-30T22:26:43.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.813+0000 7f2e2bfff700 1 -- 172.21.15.40:0/4049179769 learned_addr learned my addr 172.21.15.40:0/4049179769 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:43.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.814+0000 7f2e2bfff700 1 -- 172.21.15.40:0/4049179769 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e2c09d400 msgr2=0x7f2e2c09d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:43.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.814+0000 7f2e2bfff700 1 --2- 172.21.15.40:0/4049179769 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e2c09d400 0x7f2e2c09d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:43.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.814+0000 7f2e2bfff700 1 -- 172.21.15.40:0/4049179769 >> v1:172.21.15.40:6789/0 conn(0x7f2e2c09dd70 legacy=0x7f2e2c13ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.814+0000 7f2e2bfff700 1 -- 172.21.15.40:0/4049179769 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2c09e210 con 0x7f2e2c133e00 2023-09-30T22:26:43.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.814+0000 7f2e2bfff700 1 --2- 172.21.15.40:0/4049179769 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e2c133e00 0x7f2e2c1341d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c009920 tx=0x7f2e1c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b1e94d3fcffdec0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:43.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.814+0000 7f2e2affd700 1 -- 172.21.15.40:0/4049179769 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c00ba60 con 0x7f2e2c133e00 2023-09-30T22:26:43.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.814+0000 7f2e2affd700 1 -- 172.21.15.40:0/4049179769 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1c00bbc0 con 0x7f2e2c133e00 2023-09-30T22:26:43.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.814+0000 7f2e2affd700 1 -- 172.21.15.40:0/4049179769 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c009e70 con 0x7f2e2c133e00 2023-09-30T22:26:43.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.815+0000 7f2e32361700 1 -- 172.21.15.40:0/4049179769 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e2c133e00 msgr2=0x7f2e2c1341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.815+0000 7f2e32361700 1 --2- 172.21.15.40:0/4049179769 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e2c133e00 0x7f2e2c1341d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c009920 tx=0x7f2e1c009c30 comp rx=0 tx=0).stop 2023-09-30T22:26:43.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.815+0000 7f2e32361700 1 -- 172.21.15.40:0/4049179769 shutdown_connections 2023-09-30T22:26:43.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.815+0000 7f2e32361700 1 --2- 172.21.15.40:0/4049179769 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e2c133e00 0x7f2e2c1341d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:43.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.815+0000 7f2e32361700 1 --2- 172.21.15.40:0/4049179769 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e2c09d400 0x7f2e2c09d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:43.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.815+0000 7f2e32361700 1 -- 172.21.15.40:0/4049179769 >> 172.21.15.40:0/4049179769 conn(0x7f2e2c0a2a00 msgr2=0x7f2e2c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:43.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.815+0000 7f2e32361700 1 -- 172.21.15.40:0/4049179769 shutdown_connections 2023-09-30T22:26:43.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.815+0000 7f2e32361700 1 -- 172.21.15.40:0/4049179769 wait complete. 2023-09-30T22:26:43.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.816+0000 7f2e32361700 1 Processor -- start 2023-09-30T22:26:43.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.817+0000 7f2e32361700 1 -- start start 2023-09-30T22:26:43.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.817+0000 7f2e32361700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e2c09d400 0x7f2e2c11cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:43.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.817+0000 7f2e32361700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e2c09dd70 0x7f2e2c11d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:43.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.817+0000 7f2e32361700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e2c11d870 0x7f2e2c1c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:43.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.817+0000 7f2e32361700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c1206c0 con 0x7f2e2c11d870 2023-09-30T22:26:43.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.817+0000 7f2e32361700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c11ea50 con 0x7f2e2c09dd70 2023-09-30T22:26:43.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.817+0000 7f2e32361700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c1208c0 con 0x7f2e2c09d400 2023-09-30T22:26:43.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.817+0000 7f2e2bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e2c09d400 0x7f2e2c11cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:43.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.817+0000 7f2e2bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e2c09d400 0x7f2e2c11cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60222/0 (socket says 172.21.15.40:60222) 2023-09-30T22:26:43.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.817+0000 7f2e2bfff700 1 -- 172.21.15.40:0/3687387943 learned_addr learned my addr 172.21.15.40:0/3687387943 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:43.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.818+0000 7f2e308fe700 1 --2- 172.21.15.40:0/3687387943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e2c11d870 0x7f2e2c1c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:43.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.818+0000 7f2e2b7fe700 1 --2- 172.21.15.40:0/3687387943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e2c09dd70 0x7f2e2c11d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:43.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.818+0000 7f2e2bfff700 1 -- 172.21.15.40:0/3687387943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e2c09dd70 msgr2=0x7f2e2c11d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.818+0000 7f2e2bfff700 1 --2- 172.21.15.40:0/3687387943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e2c09dd70 0x7f2e2c11d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:43.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.818+0000 7f2e2bfff700 1 -- 172.21.15.40:0/3687387943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e2c11d870 msgr2=0x7f2e2c1c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.818+0000 7f2e2bfff700 1 --2- 172.21.15.40:0/3687387943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e2c11d870 0x7f2e2c1c8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:43.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.818+0000 7f2e2bfff700 1 -- 172.21.15.40:0/3687387943 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1c009550 con 0x7f2e2c09d400 2023-09-30T22:26:43.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.818+0000 7f2e2bfff700 1 --2- 172.21.15.40:0/3687387943 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e2c09d400 0x7f2e2c11cdf0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c013000 tx=0x7f2e1c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:43.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.818+0000 7f2e28ff9700 1 -- 172.21.15.40:0/3687387943 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c0044d0 con 0x7f2e2c09d400 2023-09-30T22:26:43.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.819+0000 7f2e28ff9700 1 -- 172.21.15.40:0/3687387943 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1c01f070 con 0x7f2e2c09d400 2023-09-30T22:26:43.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.819+0000 7f2e28ff9700 1 -- 172.21.15.40:0/3687387943 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c0038e0 con 0x7f2e2c09d400 2023-09-30T22:26:43.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.820+0000 7f2e32361700 1 -- 172.21.15.40:0/3687387943 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e2c0a14a0 con 0x7f2e2c09d400 2023-09-30T22:26:43.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.820+0000 7f2e32361700 1 -- 172.21.15.40:0/3687387943 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e2c120320 con 0x7f2e2c09d400 2023-09-30T22:26:43.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.821+0000 7f2e32361700 1 -- 172.21.15.40:0/3687387943 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e2c120500 con 0x7f2e2c09d400 2023-09-30T22:26:43.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.821+0000 7f2e28ff9700 1 -- 172.21.15.40:0/3687387943 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2e1c003a40 con 0x7f2e2c09d400 2023-09-30T22:26:43.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.821+0000 7f2e28ff9700 1 -- 172.21.15.40:0/3687387943 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f2e1c021070 con 0x7f2e2c09d400 2023-09-30T22:26:43.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.827+0000 7f2e28ff9700 1 -- 172.21.15.40:0/3687387943 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e1c01a430 con 0x7f2e2c09d400 2023-09-30T22:26:43.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.849+0000 7f3d4b553700 1 Processor -- start 2023-09-30T22:26:43.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.849+0000 7f3d4b553700 1 -- start start 2023-09-30T22:26:43.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.849+0000 7f3d4b553700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d4412e780 0x7f3d4412eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:43.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.849+0000 7f3d4b553700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3d441316b0 0x7f3d44131ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:43.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.849+0000 7f3d4b553700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d44132020 0x7f3d441389e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:43.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.849+0000 7f3d4b553700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d4412f090 con 0x7f3d441316b0 2023-09-30T22:26:43.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.849+0000 7f3d4b553700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4412e560 con 0x7f3d4412e780 2023-09-30T22:26:43.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.849+0000 7f3d4b553700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4409b220 con 0x7f3d44132020 2023-09-30T22:26:43.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.850+0000 7f3d48aee700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3d441316b0 0x7f3d44131ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:43.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.850+0000 7f3d48aee700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3d441316b0 0x7f3d44131ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48868/0 (socket says 172.21.15.40:48868) 2023-09-30T22:26:43.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.850+0000 7f3d48aee700 1 -- 172.21.15.40:0/481286747 learned_addr learned my addr 172.21.15.40:0/481286747 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:43.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.850+0000 7f2301976700 1 Processor -- start 2023-09-30T22:26:43.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.850+0000 7f2301976700 1 -- start start 2023-09-30T22:26:43.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.850+0000 7f3d492ef700 1 --2- 172.21.15.40:0/481286747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d4412e780 0x7f3d4412eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:43.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.850+0000 7f3d492ef700 1 -- 172.21.15.40:0/481286747 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d44132020 msgr2=0x7f3d441389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:43.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.850+0000 7f3d492ef700 1 --2- 172.21.15.40:0/481286747 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d44132020 0x7f3d441389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:43.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.850+0000 7f3d492ef700 1 -- 172.21.15.40:0/481286747 >> v2:172.21.15.40:3300/0 conn(0x7f3d441316b0 msgr2=0x7f3d44131ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:43.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.850+0000 7f3d492ef700 1 --2- 172.21.15.40:0/481286747 >> v2:172.21.15.40:3300/0 conn(0x7f3d441316b0 0x7f3d44131ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:43.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.850+0000 7f3d492ef700 1 -- 172.21.15.40:0/481286747 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4409c4a0 con 0x7f3d4412e780 2023-09-30T22:26:43.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.850+0000 7f3d492ef700 1 --2- 172.21.15.40:0/481286747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d4412e780 0x7f3d4412eb50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3d40009820 tx=0x7f3d40009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d03337366424f7b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:43.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.850+0000 7f2301976700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22fc131d50 0x7f22fc132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:43.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.851+0000 7f3d3bfff700 1 -- 172.21.15.40:0/481286747 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d40005e30 con 0x7f3d4412e780 2023-09-30T22:26:43.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.850+0000 7f2301976700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f22fc09c7d0 0x7f22fc139ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:43.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.850+0000 7f2301976700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22fc132660 con 0x7f22fc09bc50 2023-09-30T22:26:43.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.851+0000 7f2301976700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22fc0719b0 con 0x7f22fc09c7d0 2023-09-30T22:26:43.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.851+0000 7f2301976700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc131900 con 0x7f22fc131d50 2023-09-30T22:26:43.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.851+0000 7f22fb7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f22fc09c7d0 0x7f22fc139ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:43.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.851+0000 7f22fb7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f22fc09c7d0 0x7f22fc139ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48878/0 (socket says 172.21.15.40:48878) 2023-09-30T22:26:43.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.851+0000 7f22fb7fe700 1 -- 172.21.15.40:0/3194258066 learned_addr learned my addr 172.21.15.40:0/3194258066 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:43.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.851+0000 7f3d3bfff700 1 -- 172.21.15.40:0/481286747 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d40006030 con 0x7f3d4412e780 2023-09-30T22:26:43.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.851+0000 7f3d3bfff700 1 -- 172.21.15.40:0/481286747 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d400063a0 con 0x7f3d4412e780 2023-09-30T22:26:43.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.851+0000 7f22faffd700 1 --2- 172.21.15.40:0/3194258066 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22fc131d50 0x7f22fc132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:43.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.851+0000 7f3d4b553700 1 -- 172.21.15.40:0/481286747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d4412e780 msgr2=0x7f3d4412eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.851+0000 7f3d4b553700 1 --2- 172.21.15.40:0/481286747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d4412e780 0x7f3d4412eb50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3d40009820 tx=0x7f3d40009b30 comp rx=0 tx=0).stop 2023-09-30T22:26:43.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.852+0000 7f3d4b553700 1 -- 172.21.15.40:0/481286747 shutdown_connections 2023-09-30T22:26:43.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.852+0000 7f3d4b553700 1 --2- 172.21.15.40:0/481286747 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d44132020 0x7f3d441389e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:43.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.852+0000 7f3d4b553700 1 --2- 172.21.15.40:0/481286747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d4412e780 0x7f3d4412eb50 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:43.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.852+0000 7f3d4b553700 1 --2- 172.21.15.40:0/481286747 >> v2:172.21.15.40:3300/0 conn(0x7f3d441316b0 0x7f3d44131ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:43.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.852+0000 7f3d4b553700 1 -- 172.21.15.40:0/481286747 >> 172.21.15.40:0/481286747 conn(0x7f3d4409eb10 msgr2=0x7f3d4409ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:43.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.852+0000 7f3d4b553700 1 -- 172.21.15.40:0/481286747 shutdown_connections 2023-09-30T22:26:43.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.852+0000 7f3d4b553700 1 -- 172.21.15.40:0/481286747 wait complete. 2023-09-30T22:26:43.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.851+0000 7f22fb7fe700 1 -- 172.21.15.40:0/3194258066 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22fc131d50 msgr2=0x7f22fc132120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:43.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.851+0000 7f22fb7fe700 1 --2- 172.21.15.40:0/3194258066 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22fc131d50 0x7f22fc132120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:43.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.851+0000 7f22fb7fe700 1 -- 172.21.15.40:0/3194258066 >> v1:172.21.15.40:6789/0 conn(0x7f22fc09bc50 legacy=0x7f22fc09c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.851+0000 7f22fb7fe700 1 -- 172.21.15.40:0/3194258066 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22fc09e820 con 0x7f22fc09c7d0 2023-09-30T22:26:43.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.851+0000 7f22fb7fe700 1 --2- 172.21.15.40:0/3194258066 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22fc09c7d0 0x7f22fc139ac0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f22f4009e50 tx=0x7f22f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b14662f443242d9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:43.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.851+0000 7f22f9ffb700 1 -- 172.21.15.40:0/3194258066 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f400e070 con 0x7f22fc09c7d0 2023-09-30T22:26:43.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.851+0000 7f22f9ffb700 1 -- 172.21.15.40:0/3194258066 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f400b910 con 0x7f22fc09c7d0 2023-09-30T22:26:43.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.851+0000 7f22f9ffb700 1 -- 172.21.15.40:0/3194258066 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f400bc80 con 0x7f22fc09c7d0 2023-09-30T22:26:43.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.852+0000 7f2301976700 1 -- 172.21.15.40:0/3194258066 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22fc09c7d0 msgr2=0x7f22fc139ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.852+0000 7f2301976700 1 --2- 172.21.15.40:0/3194258066 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22fc09c7d0 0x7f22fc139ac0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f22f4009e50 tx=0x7f22f400b330 comp rx=0 tx=0).stop 2023-09-30T22:26:43.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.852+0000 7f2301976700 1 -- 172.21.15.40:0/3194258066 shutdown_connections 2023-09-30T22:26:43.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.852+0000 7f2301976700 1 --2- 172.21.15.40:0/3194258066 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22fc09c7d0 0x7f22fc139ac0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:43.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.852+0000 7f2301976700 1 --2- 172.21.15.40:0/3194258066 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22fc131d50 0x7f22fc132120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:43.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.852+0000 7f2301976700 1 -- 172.21.15.40:0/3194258066 >> 172.21.15.40:0/3194258066 conn(0x7f22fc0a2a00 msgr2=0x7f22fc0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:43.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.853+0000 7f2301976700 1 -- 172.21.15.40:0/3194258066 shutdown_connections 2023-09-30T22:26:43.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.853+0000 7f2301976700 1 -- 172.21.15.40:0/3194258066 wait complete. 2023-09-30T22:26:43.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.853+0000 7f3d4b553700 1 Processor -- start 2023-09-30T22:26:43.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.854+0000 7f3d4b553700 1 -- start start 2023-09-30T22:26:43.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.854+0000 7f3d4b553700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d4412e780 0x7f3d4412b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:43.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.854+0000 7f3d4b553700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d441316b0 0x7f3d4412b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:43.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.854+0000 7f3d4b553700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d44132020 0x7f3d4412bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:43.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.854+0000 7f3d4b553700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4408b910 con 0x7f3d4412e780 2023-09-30T22:26:43.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.854+0000 7f3d4b553700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4408b4c0 con 0x7f3d441316b0 2023-09-30T22:26:43.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.854+0000 7f3d4b553700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d440987a0 con 0x7f3d44132020 2023-09-30T22:26:43.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.854+0000 7f2301976700 1 Processor -- start 2023-09-30T22:26:43.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.854+0000 7f3d48aee700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d441316b0 0x7f3d4412b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:43.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.854+0000 7f3d49af0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d44132020 0x7f3d4412bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:43.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.854+0000 7f3d48aee700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d441316b0 0x7f3d4412b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42772/0 (socket says 172.21.15.40:42772) 2023-09-30T22:26:43.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.854+0000 7f3d48aee700 1 -- 172.21.15.40:0/3773360348 learned_addr learned my addr 172.21.15.40:0/3773360348 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:43.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.855+0000 7f3d48aee700 1 -- 172.21.15.40:0/3773360348 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d44132020 msgr2=0x7f3d4412bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.855+0000 7f3d48aee700 1 --2- 172.21.15.40:0/3773360348 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d44132020 0x7f3d4412bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:43.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.855+0000 7f3d48aee700 1 -- 172.21.15.40:0/3773360348 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d4412e780 msgr2=0x7f3d4412b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.855+0000 7f3d48aee700 1 --2- 172.21.15.40:0/3773360348 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d4412e780 0x7f3d4412b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:43.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.855+0000 7f3d48aee700 1 -- 172.21.15.40:0/3773360348 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d40009430 con 0x7f3d441316b0 2023-09-30T22:26:43.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.855+0000 7f3d49af0700 1 --2- 172.21.15.40:0/3773360348 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d44132020 0x7f3d4412bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:43.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.855+0000 7f3d48aee700 1 --2- 172.21.15.40:0/3773360348 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d441316b0 0x7f3d4412b770 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3d3400e8e0 tx=0x7f3d3400ebf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:43.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.855+0000 7f3d39ffb700 1 -- 172.21.15.40:0/3773360348 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d34013680 con 0x7f3d441316b0 2023-09-30T22:26:43.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.855+0000 7f3d39ffb700 1 -- 172.21.15.40:0/3773360348 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d340137e0 con 0x7f3d441316b0 2023-09-30T22:26:43.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.855+0000 7f3d4b553700 1 -- 172.21.15.40:0/3773360348 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d4412d200 con 0x7f3d441316b0 2023-09-30T22:26:43.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.855+0000 7f3d39ffb700 1 -- 172.21.15.40:0/3773360348 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d34013b50 con 0x7f3d441316b0 2023-09-30T22:26:43.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.855+0000 7f3d4b553700 1 -- 172.21.15.40:0/3773360348 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d4408b250 con 0x7f3d441316b0 2023-09-30T22:26:43.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.855+0000 7f2301976700 1 -- start start 2023-09-30T22:26:43.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.856+0000 7f2301976700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22fc09bc50 0x7f22fc12d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:43.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.856+0000 7f2301976700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22fc09c7d0 0x7f22fc12d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:43.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.856+0000 7f2301976700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22fc131d50 0x7f22fc1d5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:43.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.856+0000 7f2301976700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc12ba90 con 0x7f22fc09bc50 2023-09-30T22:26:43.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.856+0000 7f2301976700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc12bc80 con 0x7f22fc09c7d0 2023-09-30T22:26:43.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.856+0000 7f2301976700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc12cb90 con 0x7f22fc131d50 2023-09-30T22:26:43.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.856+0000 7f22faffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22fc09bc50 0x7f22fc12d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:43.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.856+0000 7f22faffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22fc09bc50 0x7f22fc12d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48900/0 (socket says 172.21.15.40:48900) 2023-09-30T22:26:43.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.856+0000 7f22faffd700 1 -- 172.21.15.40:0/3865328581 learned_addr learned my addr 172.21.15.40:0/3865328581 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:43.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.856+0000 7f22fa7fc700 1 --2- 172.21.15.40:0/3865328581 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22fc09c7d0 0x7f22fc12d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:43.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.857+0000 7f22faffd700 1 -- 172.21.15.40:0/3865328581 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22fc131d50 msgr2=0x7f22fc1d5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.857+0000 7f22faffd700 1 --2- 172.21.15.40:0/3865328581 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22fc131d50 0x7f22fc1d5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:43.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.857+0000 7f22faffd700 1 -- 172.21.15.40:0/3865328581 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22fc09c7d0 msgr2=0x7f22fc12d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.857+0000 7f22faffd700 1 --2- 172.21.15.40:0/3865328581 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22fc09c7d0 0x7f22fc12d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:43.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.857+0000 7f22faffd700 1 -- 172.21.15.40:0/3865328581 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f4009b30 con 0x7f22fc09bc50 2023-09-30T22:26:43.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.857+0000 7f22faffd700 1 --2- 172.21.15.40:0/3865328581 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22fc09bc50 0x7f22fc12d290 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00e9e0 tx=0x7f22ec00ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:43.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.857+0000 7f3d4b553700 1 -- 172.21.15.40:0/3773360348 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d4408b700 con 0x7f3d441316b0 2023-09-30T22:26:43.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.857+0000 7f3d39ffb700 1 -- 172.21.15.40:0/3773360348 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3d34013cb0 con 0x7f3d441316b0 2023-09-30T22:26:43.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.857+0000 7f22e3fff700 1 -- 172.21.15.40:0/3865328581 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec00c850 con 0x7f22fc09bc50 2023-09-30T22:26:43.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.857+0000 7f22e3fff700 1 -- 172.21.15.40:0/3865328581 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ec00c9b0 con 0x7f22fc09bc50 2023-09-30T22:26:43.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.857+0000 7f22e3fff700 1 -- 172.21.15.40:0/3865328581 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec00cd20 con 0x7f22fc09bc50 2023-09-30T22:26:43.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.858+0000 7f2301976700 1 -- 172.21.15.40:0/3865328581 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22fc139c90 con 0x7f22fc09bc50 2023-09-30T22:26:43.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.858+0000 7f2301976700 1 -- 172.21.15.40:0/3865328581 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22fc12ce00 con 0x7f22fc09bc50 2023-09-30T22:26:43.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.859+0000 7f22e3fff700 1 -- 172.21.15.40:0/3865328581 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f22ec013470 con 0x7f22fc09bc50 2023-09-30T22:26:43.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.859+0000 7f22e3fff700 1 -- 172.21.15.40:0/3865328581 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f22ec0421c0 con 0x7f22fc09bc50 2023-09-30T22:26:43.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.859+0000 7f2301976700 1 -- 172.21.15.40:0/3865328581 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22fc09eac0 con 0x7f22fc09bc50 2023-09-30T22:26:43.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.858+0000 7f3d39ffb700 1 -- 172.21.15.40:0/3773360348 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3d3403fb80 con 0x7f3d441316b0 2023-09-30T22:26:43.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.863+0000 7f3d39ffb700 1 -- 172.21.15.40:0/3773360348 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3d34041e60 con 0x7f3d441316b0 2023-09-30T22:26:43.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.868+0000 7f22e3fff700 1 -- 172.21.15.40:0/3865328581 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f22ec017020 con 0x7f22fc09bc50 2023-09-30T22:26:43.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.912+0000 7f07b6e27700 1 Processor -- start 2023-09-30T22:26:43.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.913+0000 7f07b6e27700 1 -- start start 2023-09-30T22:26:43.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.913+0000 7f07b6e27700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07b0136c50 0x7f07b0139030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:43.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.913+0000 7f07b6e27700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07b0139570 0x7f07b013b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:43.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.913+0000 7f07b6e27700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07b0133940 con 0x7f07b0133e00 2023-09-30T22:26:43.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.913+0000 7f07b6e27700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b009af70 con 0x7f07b0136c50 2023-09-30T22:26:43.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.913+0000 7f07b6e27700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07b009ab20 con 0x7f07b0139570 2023-09-30T22:26:43.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.913+0000 7f07b4bc3700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f07b0133e00 0x7f07b01341d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60582/0 (socket says 172.21.15.40:60582) 2023-09-30T22:26:43.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.913+0000 7f07b4bc3700 1 -- 172.21.15.40:0/942302699 learned_addr learned my addr 172.21.15.40:0/942302699 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:43.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.913+0000 7f07affff700 1 --2- 172.21.15.40:0/942302699 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07b0136c50 0x7f07b0139030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:43.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.913+0000 7f07b53c4700 1 --2- 172.21.15.40:0/942302699 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07b0139570 0x7f07b013b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:43.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.914+0000 7f07af7fe700 1 -- 172.21.15.40:0/942302699 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3387804870 0 0) 0x7f07b0133940 con 0x7f07b0133e00 2023-09-30T22:26:43.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.914+0000 7f07af7fe700 1 -- 172.21.15.40:0/942302699 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07a00035b0 con 0x7f07b0133e00 2023-09-30T22:26:43.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.914+0000 7f07affff700 1 -- 172.21.15.40:0/942302699 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07b0139570 msgr2=0x7f07b013b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:43.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.914+0000 7f07affff700 1 --2- 172.21.15.40:0/942302699 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07b0139570 0x7f07b013b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:43.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.914+0000 7f07affff700 1 -- 172.21.15.40:0/942302699 >> v1:172.21.15.40:6789/0 conn(0x7f07b0133e00 legacy=0x7f07b01341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.914+0000 7f07affff700 1 -- 172.21.15.40:0/942302699 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b009f0d0 con 0x7f07b0136c50 2023-09-30T22:26:43.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.914+0000 7f07affff700 1 --2- 172.21.15.40:0/942302699 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07b0136c50 0x7f07b0139030 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f079c009870 tx=0x7f079c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2932488da3aa0ef5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:43.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.914+0000 7f07af7fe700 1 -- 172.21.15.40:0/942302699 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079c004230 con 0x7f07b0136c50 2023-09-30T22:26:43.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.914+0000 7f07af7fe700 1 -- 172.21.15.40:0/942302699 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079c004390 con 0x7f07b0136c50 2023-09-30T22:26:43.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.914+0000 7f07af7fe700 1 -- 172.21.15.40:0/942302699 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079c0036a0 con 0x7f07b0136c50 2023-09-30T22:26:43.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.915+0000 7f07b6e27700 1 -- 172.21.15.40:0/942302699 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07b0136c50 msgr2=0x7f07b0139030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.915+0000 7f07b6e27700 1 --2- 172.21.15.40:0/942302699 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07b0136c50 0x7f07b0139030 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f079c009870 tx=0x7f079c009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:43.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.915+0000 7f07b6e27700 1 -- 172.21.15.40:0/942302699 shutdown_connections 2023-09-30T22:26:43.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.915+0000 7f07b6e27700 1 --2- 172.21.15.40:0/942302699 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07b0139570 0x7f07b013b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:43.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.915+0000 7f07b6e27700 1 --2- 172.21.15.40:0/942302699 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07b0136c50 0x7f07b0139030 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:43.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.915+0000 7f07b6e27700 1 -- 172.21.15.40:0/942302699 >> 172.21.15.40:0/942302699 conn(0x7f07b00a2a00 msgr2=0x7f07b00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:43.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.915+0000 7f07b6e27700 1 -- 172.21.15.40:0/942302699 shutdown_connections 2023-09-30T22:26:43.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.915+0000 7f07b6e27700 1 -- 172.21.15.40:0/942302699 wait complete. 2023-09-30T22:26:43.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.916+0000 7f07b6e27700 1 Processor -- start 2023-09-30T22:26:43.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.916+0000 7f07b6e27700 1 -- start start 2023-09-30T22:26:43.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.916+0000 7f07b6e27700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07b0133e00 0x7f07b0119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:43.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.916+0000 7f07b6e27700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07b0136c50 0x7f07b0119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:43.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.916+0000 7f07b6e27700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07b0139570 0x7f07b0119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:43.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.916+0000 7f07b6e27700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b012d790 con 0x7f07b0133e00 2023-09-30T22:26:43.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.916+0000 7f07b6e27700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b0138b20 con 0x7f07b0139570 2023-09-30T22:26:43.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.916+0000 7f07b6e27700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07b012dd50 con 0x7f07b0136c50 2023-09-30T22:26:43.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.916+0000 7f07b4bc3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07b0133e00 0x7f07b0119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:43.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.916+0000 7f07b4bc3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07b0133e00 0x7f07b0119050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48902/0 (socket says 172.21.15.40:48902) 2023-09-30T22:26:43.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.916+0000 7f07b4bc3700 1 -- 172.21.15.40:0/1990913190 learned_addr learned my addr 172.21.15.40:0/1990913190 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:43.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.916+0000 7f07affff700 1 --2- 172.21.15.40:0/1990913190 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07b0136c50 0x7f07b0119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:43.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.917+0000 7f07b53c4700 1 --2- 172.21.15.40:0/1990913190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07b0139570 0x7f07b0119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:43.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.917+0000 7f07b53c4700 1 -- 172.21.15.40:0/1990913190 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07b0136c50 msgr2=0x7f07b0119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.917+0000 7f07b53c4700 1 --2- 172.21.15.40:0/1990913190 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07b0136c50 0x7f07b0119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:43.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.917+0000 7f07b53c4700 1 -- 172.21.15.40:0/1990913190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07b0133e00 msgr2=0x7f07b0119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.917+0000 7f07b53c4700 1 --2- 172.21.15.40:0/1990913190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07b0133e00 0x7f07b0119050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:43.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.917+0000 7f07b53c4700 1 -- 172.21.15.40:0/1990913190 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f079c0094a0 con 0x7f07b0139570 2023-09-30T22:26:43.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.917+0000 7f07b4bc3700 1 --2- 172.21.15.40:0/1990913190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07b0133e00 0x7f07b0119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:43.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.917+0000 7f07b53c4700 1 --2- 172.21.15.40:0/1990913190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07b0139570 0x7f07b0119ad0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f07b0131500 tx=0x7f07a800ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:43.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.917+0000 7f07ad7fa700 1 -- 172.21.15.40:0/1990913190 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a800cc20 con 0x7f07b0139570 2023-09-30T22:26:43.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.917+0000 7f07ad7fa700 1 -- 172.21.15.40:0/1990913190 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a800f040 con 0x7f07b0139570 2023-09-30T22:26:43.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.917+0000 7f07ad7fa700 1 -- 172.21.15.40:0/1990913190 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a8009e60 con 0x7f07b0139570 2023-09-30T22:26:43.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.917+0000 7f07b6e27700 1 -- 172.21.15.40:0/1990913190 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b011a2d0 con 0x7f07b0139570 2023-09-30T22:26:43.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.917+0000 7f07b6e27700 1 -- 172.21.15.40:0/1990913190 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b011b700 con 0x7f07b0139570 2023-09-30T22:26:43.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.918+0000 7f07b6e27700 1 -- 172.21.15.40:0/1990913190 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07b0062380 con 0x7f07b0139570 2023-09-30T22:26:43.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.919+0000 7f07ad7fa700 1 -- 172.21.15.40:0/1990913190 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f07a8014480 con 0x7f07b0139570 2023-09-30T22:26:43.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.919+0000 7f07ad7fa700 1 -- 172.21.15.40:0/1990913190 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f07a8040190 con 0x7f07b0139570 2023-09-30T22:26:43.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:43.928+0000 7f07ad7fa700 1 -- 172.21.15.40:0/1990913190 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f07a8007900 con 0x7f07b0139570 2023-09-30T22:26:44.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.042+0000 7f2e32361700 1 -- 172.21.15.40:0/3687387943 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2e2c062380 con 0x7f2e2c09d400 2023-09-30T22:26:44.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.043+0000 7f2e28ff9700 1 -- 172.21.15.40:0/3687387943 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2e1c015020 con 0x7f2e2c09d400 2023-09-30T22:26:44.044 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:44.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.045+0000 7f2e32361700 1 -- 172.21.15.40:0/3687387943 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e2c09d400 msgr2=0x7f2e2c11cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.045+0000 7f2e32361700 1 --2- 172.21.15.40:0/3687387943 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e2c09d400 0x7f2e2c11cdf0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c013000 tx=0x7f2e1c004750 comp rx=0 tx=0).stop 2023-09-30T22:26:44.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.045+0000 7f2e32361700 1 -- 172.21.15.40:0/3687387943 shutdown_connections 2023-09-30T22:26:44.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.045+0000 7f2e32361700 1 --2- 172.21.15.40:0/3687387943 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e2c09d400 0x7f2e2c11cdf0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.045+0000 7f2e32361700 1 --2- 172.21.15.40:0/3687387943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e2c11d870 0x7f2e2c1c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.045+0000 7f2e32361700 1 --2- 172.21.15.40:0/3687387943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e2c09dd70 0x7f2e2c11d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.045+0000 7f2e32361700 1 -- 172.21.15.40:0/3687387943 >> 172.21.15.40:0/3687387943 conn(0x7f2e2c0a2a00 msgr2=0x7f2e2c09b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:44.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.045+0000 7f2e32361700 1 -- 172.21.15.40:0/3687387943 shutdown_connections 2023-09-30T22:26:44.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.045+0000 7f2e32361700 1 -- 172.21.15.40:0/3687387943 wait complete. 2023-09-30T22:26:44.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.062+0000 7f3d4b553700 1 -- 172.21.15.40:0/3773360348 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3d44062380 con 0x7f3d441316b0 2023-09-30T22:26:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.062+0000 7f3d39ffb700 1 -- 172.21.15.40:0/3773360348 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3d34021090 con 0x7f3d441316b0 2023-09-30T22:26:44.063 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:44.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.064+0000 7f3d4b553700 1 -- 172.21.15.40:0/3773360348 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d441316b0 msgr2=0x7f3d4412b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.064+0000 7f3d4b553700 1 --2- 172.21.15.40:0/3773360348 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d441316b0 0x7f3d4412b770 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3d3400e8e0 tx=0x7f3d3400ebf0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.064+0000 7f3d4b553700 1 -- 172.21.15.40:0/3773360348 shutdown_connections 2023-09-30T22:26:44.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.064+0000 7f3d4b553700 1 --2- 172.21.15.40:0/3773360348 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d44132020 0x7f3d4412bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.064+0000 7f3d4b553700 1 --2- 172.21.15.40:0/3773360348 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d4412e780 0x7f3d4412b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.064+0000 7f3d4b553700 1 --2- 172.21.15.40:0/3773360348 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d441316b0 0x7f3d4412b770 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.064+0000 7f3d4b553700 1 -- 172.21.15.40:0/3773360348 >> 172.21.15.40:0/3773360348 conn(0x7f3d4409eb10 msgr2=0x7f3d4412f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:44.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.064+0000 7f3d4b553700 1 -- 172.21.15.40:0/3773360348 shutdown_connections 2023-09-30T22:26:44.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.064+0000 7f3d4b553700 1 -- 172.21.15.40:0/3773360348 wait complete. 2023-09-30T22:26:44.077 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:44.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.105+0000 7f2301976700 1 -- 172.21.15.40:0/3865328581 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f22fc12bfa0 con 0x7f22fc09bc50 2023-09-30T22:26:44.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.105+0000 7f22e3fff700 1 -- 172.21.15.40:0/3865328581 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f22fc12bfa0 con 0x7f22fc09bc50 2023-09-30T22:26:44.106 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:44.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.107+0000 7f2301976700 1 -- 172.21.15.40:0/3865328581 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22fc09bc50 msgr2=0x7f22fc12d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.107+0000 7f2301976700 1 --2- 172.21.15.40:0/3865328581 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22fc09bc50 0x7f22fc12d290 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00e9e0 tx=0x7f22ec00ecf0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.107+0000 7f2301976700 1 -- 172.21.15.40:0/3865328581 shutdown_connections 2023-09-30T22:26:44.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.107+0000 7f2301976700 1 --2- 172.21.15.40:0/3865328581 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22fc131d50 0x7f22fc1d5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.107+0000 7f2301976700 1 --2- 172.21.15.40:0/3865328581 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22fc09bc50 0x7f22fc12d290 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.107+0000 7f2301976700 1 --2- 172.21.15.40:0/3865328581 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22fc09c7d0 0x7f22fc12d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.107+0000 7f2301976700 1 -- 172.21.15.40:0/3865328581 >> 172.21.15.40:0/3865328581 conn(0x7f22fc0a2a00 msgr2=0x7f22fc127230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:44.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.107+0000 7f2301976700 1 -- 172.21.15.40:0/3865328581 shutdown_connections 2023-09-30T22:26:44.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.107+0000 7f2301976700 1 -- 172.21.15.40:0/3865328581 wait complete. 2023-09-30T22:26:44.120 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:44.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.159+0000 7f07b6e27700 1 -- 172.21.15.40:0/1990913190 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f07b0074330 con 0x7f07b0139570 2023-09-30T22:26:44.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.159+0000 7f07ad7fa700 1 -- 172.21.15.40:0/1990913190 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f07a8007330 con 0x7f07b0139570 2023-09-30T22:26:44.161 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:44.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.161+0000 7f07b6e27700 1 -- 172.21.15.40:0/1990913190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07b0139570 msgr2=0x7f07b0119ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.161+0000 7f07b6e27700 1 --2- 172.21.15.40:0/1990913190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07b0139570 0x7f07b0119ad0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f07b0131500 tx=0x7f07a800ef90 comp rx=0 tx=0).stop 2023-09-30T22:26:44.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.161+0000 7f07b6e27700 1 -- 172.21.15.40:0/1990913190 shutdown_connections 2023-09-30T22:26:44.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.161+0000 7f07b6e27700 1 --2- 172.21.15.40:0/1990913190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07b0139570 0x7f07b0119ad0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.161+0000 7f07b6e27700 1 --2- 172.21.15.40:0/1990913190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07b0133e00 0x7f07b0119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.161+0000 7f07b6e27700 1 --2- 172.21.15.40:0/1990913190 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07b0136c50 0x7f07b0119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.162+0000 7f07b6e27700 1 -- 172.21.15.40:0/1990913190 >> 172.21.15.40:0/1990913190 conn(0x7f07b00a2a00 msgr2=0x7f07b00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:44.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.162+0000 7f07b6e27700 1 -- 172.21.15.40:0/1990913190 shutdown_connections 2023-09-30T22:26:44.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:44.162+0000 7f07b6e27700 1 -- 172.21.15.40:0/1990913190 wait complete. 2023-09-30T22:26:44.174 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:45.059 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:45.078 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:45.121 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:45.175 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:45.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.205+0000 7f6da79c3700 1 Processor -- start 2023-09-30T22:26:45.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.205+0000 7f6da79c3700 1 -- start start 2023-09-30T22:26:45.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.205+0000 7f6da79c3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6da009d920 0x7f6da009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.205+0000 7f6da79c3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6da009f0f0 0x7f6da009e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.205+0000 7f6da79c3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6da0133ca0 0x7f6da0134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.205+0000 7f6da79c3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6da006b4c0 con 0x7f6da0133ca0 2023-09-30T22:26:45.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.205+0000 7f6da79c3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da009a8f0 con 0x7f6da009f0f0 2023-09-30T22:26:45.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.205+0000 7f6da79c3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6da009f940 con 0x7f6da009d920 2023-09-30T22:26:45.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.206+0000 7f6da4f5e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6da009f0f0 0x7f6da009e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.206+0000 7f6da5f60700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6da0133ca0 0x7f6da0134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.206+0000 7f6da575f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6da009d920 0x7f6da009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.206+0000 7f6da4f5e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6da009f0f0 0x7f6da009e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42794/0 (socket says 172.21.15.40:42794) 2023-09-30T22:26:45.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.206+0000 7f6da4f5e700 1 -- 172.21.15.40:0/1405097475 learned_addr learned my addr 172.21.15.40:0/1405097475 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:45.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.206+0000 7f6da5f60700 1 -- 172.21.15.40:0/1405097475 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6da009d920 msgr2=0x7f6da009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:45.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.206+0000 7f6da5f60700 1 --2- 172.21.15.40:0/1405097475 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6da009d920 0x7f6da009dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.206+0000 7f6da5f60700 1 -- 172.21.15.40:0/1405097475 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6da009f0f0 msgr2=0x7f6da009e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:45.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.206+0000 7f6da5f60700 1 --2- 172.21.15.40:0/1405097475 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6da009f0f0 0x7f6da009e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.206+0000 7f6da5f60700 1 -- 172.21.15.40:0/1405097475 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da009f6e0 con 0x7f6da0133ca0 2023-09-30T22:26:45.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.206+0000 7f6da4f5e700 1 --2- 172.21.15.40:0/1405097475 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6da009f0f0 0x7f6da009e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:45.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.206+0000 7f6da5f60700 1 --2- 172.21.15.40:0/1405097475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6da0133ca0 0x7f6da0134140 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f6d98009dc0 tx=0x7f6d9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ece46955dbf139fd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:45.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.206+0000 7f6d97fff700 1 -- 172.21.15.40:0/1405097475 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9800e070 con 0x7f6da0133ca0 2023-09-30T22:26:45.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.207+0000 7f6d97fff700 1 -- 172.21.15.40:0/1405097475 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d9800bae0 con 0x7f6da0133ca0 2023-09-30T22:26:45.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.207+0000 7f6d97fff700 1 -- 172.21.15.40:0/1405097475 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9800be90 con 0x7f6da0133ca0 2023-09-30T22:26:45.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.207+0000 7f6da79c3700 1 -- 172.21.15.40:0/1405097475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6da0133ca0 msgr2=0x7f6da0134140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.207+0000 7f6da79c3700 1 --2- 172.21.15.40:0/1405097475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6da0133ca0 0x7f6da0134140 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f6d98009dc0 tx=0x7f6d9800b330 comp rx=0 tx=0).stop 2023-09-30T22:26:45.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.207+0000 7f6da79c3700 1 -- 172.21.15.40:0/1405097475 shutdown_connections 2023-09-30T22:26:45.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.207+0000 7f6da79c3700 1 --2- 172.21.15.40:0/1405097475 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6da009d920 0x7f6da009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.207+0000 7f6da79c3700 1 --2- 172.21.15.40:0/1405097475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6da0133ca0 0x7f6da0134140 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.207+0000 7f6da79c3700 1 --2- 172.21.15.40:0/1405097475 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6da009f0f0 0x7f6da009e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.207+0000 7f6da79c3700 1 -- 172.21.15.40:0/1405097475 >> 172.21.15.40:0/1405097475 conn(0x7f6da009fb20 msgr2=0x7f6da009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:45.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.208+0000 7f6da79c3700 1 -- 172.21.15.40:0/1405097475 shutdown_connections 2023-09-30T22:26:45.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.208+0000 7f6da79c3700 1 -- 172.21.15.40:0/1405097475 wait complete. 2023-09-30T22:26:45.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.209+0000 7f6da79c3700 1 Processor -- start 2023-09-30T22:26:45.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.209+0000 7f6da79c3700 1 -- start start 2023-09-30T22:26:45.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.209+0000 7f6da79c3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6da009d920 0x7f6da0121860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.209+0000 7f6da79c3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6da0133ca0 0x7f6da0121da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.210+0000 7f6da79c3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6da01222e0 0x7f6da01c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.210+0000 7f6da79c3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da0125380 con 0x7f6da009d920 2023-09-30T22:26:45.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.210+0000 7f6da79c3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da0123d00 con 0x7f6da01222e0 2023-09-30T22:26:45.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.210+0000 7f6da79c3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6da0123470 con 0x7f6da0133ca0 2023-09-30T22:26:45.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.210+0000 7f6da4f5e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6da0133ca0 0x7f6da0121da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.210+0000 7f6da4f5e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6da0133ca0 0x7f6da0121da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60290/0 (socket says 172.21.15.40:60290) 2023-09-30T22:26:45.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.210+0000 7f6da4f5e700 1 -- 172.21.15.40:0/3418414265 learned_addr learned my addr 172.21.15.40:0/3418414265 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:45.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.210+0000 7f6da5f60700 1 --2- 172.21.15.40:0/3418414265 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6da01222e0 0x7f6da01c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.210+0000 7f6da575f700 1 --2- 172.21.15.40:0/3418414265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6da009d920 0x7f6da0121860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.210+0000 7f6da4f5e700 1 -- 172.21.15.40:0/3418414265 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6da01222e0 msgr2=0x7f6da01c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.210+0000 7f6da4f5e700 1 --2- 172.21.15.40:0/3418414265 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6da01222e0 0x7f6da01c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.210+0000 7f6da4f5e700 1 -- 172.21.15.40:0/3418414265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6da009d920 msgr2=0x7f6da0121860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.210+0000 7f6da4f5e700 1 --2- 172.21.15.40:0/3418414265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6da009d920 0x7f6da0121860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.210+0000 7f6da4f5e700 1 -- 172.21.15.40:0/3418414265 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d98009a70 con 0x7f6da0133ca0 2023-09-30T22:26:45.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.210+0000 7f6da4f5e700 1 --2- 172.21.15.40:0/3418414265 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6da0133ca0 0x7f6da0121da0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6d9000d800 tx=0x7f6d9000db10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:45.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.211+0000 7f6d95ffb700 1 -- 172.21.15.40:0/3418414265 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d90014620 con 0x7f6da0133ca0 2023-09-30T22:26:45.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.211+0000 7f6d95ffb700 1 -- 172.21.15.40:0/3418414265 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d90014780 con 0x7f6da0133ca0 2023-09-30T22:26:45.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.211+0000 7f6da79c3700 1 -- 172.21.15.40:0/3418414265 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6da00a2a60 con 0x7f6da0133ca0 2023-09-30T22:26:45.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.211+0000 7f6d95ffb700 1 -- 172.21.15.40:0/3418414265 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d90014b30 con 0x7f6da0133ca0 2023-09-30T22:26:45.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.211+0000 7f6da79c3700 1 -- 172.21.15.40:0/3418414265 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6da01327b0 con 0x7f6da0133ca0 2023-09-30T22:26:45.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.212+0000 7f6da79c3700 1 -- 172.21.15.40:0/3418414265 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6da0124f00 con 0x7f6da0133ca0 2023-09-30T22:26:45.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.213+0000 7f6d95ffb700 1 -- 172.21.15.40:0/3418414265 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6d90014c90 con 0x7f6da0133ca0 2023-09-30T22:26:45.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.213+0000 7f6d95ffb700 1 -- 172.21.15.40:0/3418414265 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6d9003ffb0 con 0x7f6da0133ca0 2023-09-30T22:26:45.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.218+0000 7f6d95ffb700 1 -- 172.21.15.40:0/3418414265 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6d90026db0 con 0x7f6da0133ca0 2023-09-30T22:26:45.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.248+0000 7f525d277700 1 Processor -- start 2023-09-30T22:26:45.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.248+0000 7f525d277700 1 -- start start 2023-09-30T22:26:45.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.248+0000 7f525d277700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f525806fb50 0x7f5258136c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.248+0000 7f525d277700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f52581371b0 0x7f5258139590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.248+0000 7f525d277700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5258070830 con 0x7f525806f070 2023-09-30T22:26:45.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.248+0000 7f525d277700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5258071af0 con 0x7f52581371b0 2023-09-30T22:26:45.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.248+0000 7f525d277700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5258070ad0 con 0x7f525806fb50 2023-09-30T22:26:45.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.248+0000 7f5256ffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f525806f070 0x7f525806f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60592/0 (socket says 172.21.15.40:60592) 2023-09-30T22:26:45.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.248+0000 7f5256ffd700 1 -- 172.21.15.40:0/2894870186 learned_addr learned my addr 172.21.15.40:0/2894870186 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:45.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.249+0000 7f52567fc700 1 --2- 172.21.15.40:0/2894870186 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f525806fb50 0x7f5258136c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.249+0000 7f52577fe700 1 --2- 172.21.15.40:0/2894870186 >> v2:172.21.15.40:3300/0 conn(0x7f52581371b0 0x7f5258139590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.249+0000 7f52567fc700 1 -- 172.21.15.40:0/2894870186 >> v2:172.21.15.40:3300/0 conn(0x7f52581371b0 msgr2=0x7f5258139590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:45.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.249+0000 7f52567fc700 1 --2- 172.21.15.40:0/2894870186 >> v2:172.21.15.40:3300/0 conn(0x7f52581371b0 0x7f5258139590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.249+0000 7f52567fc700 1 -- 172.21.15.40:0/2894870186 >> v1:172.21.15.40:6789/0 conn(0x7f525806f070 legacy=0x7f525806f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.249+0000 7f52567fc700 1 -- 172.21.15.40:0/2894870186 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5258070de0 con 0x7f525806fb50 2023-09-30T22:26:45.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.249+0000 7f52567fc700 1 --2- 172.21.15.40:0/2894870186 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f525806fb50 0x7f5258136c70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f524c009840 tx=0x7f524c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5ac543992ee063 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:45.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.249+0000 7f5255ffb700 1 -- 172.21.15.40:0/2894870186 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524c011830 con 0x7f525806fb50 2023-09-30T22:26:45.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.249+0000 7f5255ffb700 1 -- 172.21.15.40:0/2894870186 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f524c011990 con 0x7f525806fb50 2023-09-30T22:26:45.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.249+0000 7f5255ffb700 1 -- 172.21.15.40:0/2894870186 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524c011d20 con 0x7f525806fb50 2023-09-30T22:26:45.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.250+0000 7f525d277700 1 -- 172.21.15.40:0/2894870186 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f525806fb50 msgr2=0x7f5258136c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.250+0000 7f525d277700 1 --2- 172.21.15.40:0/2894870186 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f525806fb50 0x7f5258136c70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f524c009840 tx=0x7f524c009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:45.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.250+0000 7f525d277700 1 -- 172.21.15.40:0/2894870186 shutdown_connections 2023-09-30T22:26:45.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.250+0000 7f525d277700 1 --2- 172.21.15.40:0/2894870186 >> v2:172.21.15.40:3300/0 conn(0x7f52581371b0 0x7f5258139590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.250+0000 7f525d277700 1 --2- 172.21.15.40:0/2894870186 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f525806fb50 0x7f5258136c70 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.250+0000 7f525d277700 1 -- 172.21.15.40:0/2894870186 >> 172.21.15.40:0/2894870186 conn(0x7f52580a41a0 msgr2=0x7f52580a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:45.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.251+0000 7f525d277700 1 -- 172.21.15.40:0/2894870186 shutdown_connections 2023-09-30T22:26:45.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.251+0000 7f525d277700 1 -- 172.21.15.40:0/2894870186 wait complete. 2023-09-30T22:26:45.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.252+0000 7f525d277700 1 Processor -- start 2023-09-30T22:26:45.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.252+0000 7f525d277700 1 -- start start 2023-09-30T22:26:45.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.252+0000 7f525d277700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f525806f070 0x7f5258134ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.252+0000 7f525d277700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f525806fb50 0x7f5258135010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.252+0000 7f525d277700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52581371b0 0x7f5258135550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.252+0000 7f525d277700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525812db40 con 0x7f525806fb50 2023-09-30T22:26:45.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.252+0000 7f525d277700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f525812e1c0 con 0x7f52581371b0 2023-09-30T22:26:45.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.252+0000 7f525d277700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5258136660 con 0x7f525806f070 2023-09-30T22:26:45.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.252+0000 7f52577fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52581371b0 0x7f5258135550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.252+0000 7f52577fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52581371b0 0x7f5258135550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42816/0 (socket says 172.21.15.40:42816) 2023-09-30T22:26:45.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.252+0000 7f52577fe700 1 -- 172.21.15.40:0/999587170 learned_addr learned my addr 172.21.15.40:0/999587170 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:45.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.252+0000 7f52567fc700 1 --2- 172.21.15.40:0/999587170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f525806fb50 0x7f5258135010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.253+0000 7f52577fe700 1 -- 172.21.15.40:0/999587170 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f525806f070 msgr2=0x7f5258134ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.253+0000 7f52577fe700 1 --2- 172.21.15.40:0/999587170 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f525806f070 0x7f5258134ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.253+0000 7f52577fe700 1 -- 172.21.15.40:0/999587170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f525806fb50 msgr2=0x7f5258135010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.253+0000 7f52577fe700 1 --2- 172.21.15.40:0/999587170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f525806fb50 0x7f5258135010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.253+0000 7f52577fe700 1 -- 172.21.15.40:0/999587170 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524c0094a0 con 0x7f52581371b0 2023-09-30T22:26:45.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.253+0000 7f52567fc700 1 --2- 172.21.15.40:0/999587170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f525806fb50 0x7f5258135010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:45.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.253+0000 7f52577fe700 1 --2- 172.21.15.40:0/999587170 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52581371b0 0x7f5258135550 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f525000efc0 tx=0x7f525000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:45.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.253+0000 7f523f7fe700 1 -- 172.21.15.40:0/999587170 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5250009ea0 con 0x7f52581371b0 2023-09-30T22:26:45.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.253+0000 7f523f7fe700 1 -- 172.21.15.40:0/999587170 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525000f040 con 0x7f52581371b0 2023-09-30T22:26:45.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.253+0000 7f523f7fe700 1 -- 172.21.15.40:0/999587170 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5250014480 con 0x7f52581371b0 2023-09-30T22:26:45.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.254+0000 7f525d277700 1 -- 172.21.15.40:0/999587170 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5258136ee0 con 0x7f52581371b0 2023-09-30T22:26:45.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.254+0000 7f525d277700 1 -- 172.21.15.40:0/999587170 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f525812c910 con 0x7f52581371b0 2023-09-30T22:26:45.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.255+0000 7f523f7fe700 1 -- 172.21.15.40:0/999587170 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f52500145e0 con 0x7f52581371b0 2023-09-30T22:26:45.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.255+0000 7f525d277700 1 -- 172.21.15.40:0/999587170 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5258135f30 con 0x7f52581371b0 2023-09-30T22:26:45.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.255+0000 7f523f7fe700 1 -- 172.21.15.40:0/999587170 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f525003ffc0 con 0x7f52581371b0 2023-09-30T22:26:45.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.264+0000 7f523f7fe700 1 -- 172.21.15.40:0/999587170 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5250071750 con 0x7f52581371b0 2023-09-30T22:26:45.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.295+0000 7fc09903d700 1 Processor -- start 2023-09-30T22:26:45.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.295+0000 7fc09903d700 1 -- start start 2023-09-30T22:26:45.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.295+0000 7fc09903d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc094133e00 0x7fc0941341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.295+0000 7fc09903d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc09409d400 0x7fc09409d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.295+0000 7fc09903d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc09409dd70 0x7fc09413ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.295+0000 7fc09903d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc09409ab20 con 0x7fc09409dd70 2023-09-30T22:26:45.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.295+0000 7fc09903d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc094133940 con 0x7fc09409d400 2023-09-30T22:26:45.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.295+0000 7fc09903d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc09409f0d0 con 0x7fc094133e00 2023-09-30T22:26:45.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.296+0000 7fc09359e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc09409dd70 0x7fc09413ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.296+0000 7fc09359e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc09409dd70 0x7fc09413ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48960/0 (socket says 172.21.15.40:48960) 2023-09-30T22:26:45.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.296+0000 7fc09359e700 1 -- 172.21.15.40:0/2944376892 learned_addr learned my addr 172.21.15.40:0/2944376892 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:45.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.296+0000 7fc092d9d700 1 --2- 172.21.15.40:0/2944376892 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc094133e00 0x7fc0941341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.296+0000 7fc09259c700 1 --2- 172.21.15.40:0/2944376892 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc09409d400 0x7fc09409d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.296+0000 7fc092d9d700 1 -- 172.21.15.40:0/2944376892 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc09409d400 msgr2=0x7fc09409d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:45.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.296+0000 7fc092d9d700 1 --2- 172.21.15.40:0/2944376892 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc09409d400 0x7fc09409d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.296+0000 7fc092d9d700 1 -- 172.21.15.40:0/2944376892 >> v2:172.21.15.40:3300/0 conn(0x7fc09409dd70 msgr2=0x7fc09413ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:45.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.296+0000 7fc092d9d700 1 --2- 172.21.15.40:0/2944376892 >> v2:172.21.15.40:3300/0 conn(0x7fc09409dd70 0x7fc09413ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.296+0000 7fc092d9d700 1 -- 172.21.15.40:0/2944376892 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09409e210 con 0x7fc094133e00 2023-09-30T22:26:45.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.296+0000 7fc09259c700 1 --2- 172.21.15.40:0/2944376892 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc09409d400 0x7fc09409d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:45.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.296+0000 7fc092d9d700 1 --2- 172.21.15.40:0/2944376892 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc094133e00 0x7fc0941341d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc084009840 tx=0x7fc084009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1372b3b0d11bd9c4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:45.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.296+0000 7fc091d9b700 1 -- 172.21.15.40:0/2944376892 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc084011830 con 0x7fc094133e00 2023-09-30T22:26:45.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.297+0000 7fc091d9b700 1 -- 172.21.15.40:0/2944376892 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc084011990 con 0x7fc094133e00 2023-09-30T22:26:45.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.297+0000 7fc091d9b700 1 -- 172.21.15.40:0/2944376892 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc084011d20 con 0x7fc094133e00 2023-09-30T22:26:45.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.297+0000 7fc09903d700 1 -- 172.21.15.40:0/2944376892 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc094133e00 msgr2=0x7fc0941341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.297+0000 7fc09903d700 1 --2- 172.21.15.40:0/2944376892 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc094133e00 0x7fc0941341d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc084009840 tx=0x7fc084009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:45.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.297+0000 7fc09903d700 1 -- 172.21.15.40:0/2944376892 shutdown_connections 2023-09-30T22:26:45.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.297+0000 7fc09903d700 1 --2- 172.21.15.40:0/2944376892 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc094133e00 0x7fc0941341d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.297+0000 7fc09903d700 1 --2- 172.21.15.40:0/2944376892 >> v2:172.21.15.40:3300/0 conn(0x7fc09409dd70 0x7fc09413ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.297+0000 7fc09903d700 1 --2- 172.21.15.40:0/2944376892 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc09409d400 0x7fc09409d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.297+0000 7fc09903d700 1 -- 172.21.15.40:0/2944376892 >> 172.21.15.40:0/2944376892 conn(0x7fc0940a2a00 msgr2=0x7fc0940a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:45.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.298+0000 7fc09903d700 1 -- 172.21.15.40:0/2944376892 shutdown_connections 2023-09-30T22:26:45.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.298+0000 7fc09903d700 1 -- 172.21.15.40:0/2944376892 wait complete. 2023-09-30T22:26:45.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.299+0000 7fc09903d700 1 Processor -- start 2023-09-30T22:26:45.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.299+0000 7fc09903d700 1 -- start start 2023-09-30T22:26:45.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.300+0000 7fc09903d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc09409d400 0x7fc094119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.300+0000 7fc09903d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc09409dd70 0x7fc094119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.300+0000 7fc09903d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc094133e00 0x7fc094119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.300+0000 7fc09903d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09411c2c0 con 0x7fc09409d400 2023-09-30T22:26:45.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.300+0000 7fc09903d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09411b690 con 0x7fc094133e00 2023-09-30T22:26:45.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.300+0000 7fc09903d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0940a0ed0 con 0x7fc09409dd70 2023-09-30T22:26:45.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.300+0000 7fc09259c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc09409dd70 0x7fc094119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.300+0000 7fc09359e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc094133e00 0x7fc094119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.300+0000 7fc09359e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc094133e00 0x7fc094119ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42836/0 (socket says 172.21.15.40:42836) 2023-09-30T22:26:45.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.300+0000 7fc09359e700 1 -- 172.21.15.40:0/4029655539 learned_addr learned my addr 172.21.15.40:0/4029655539 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:45.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.300+0000 7fc09359e700 1 -- 172.21.15.40:0/4029655539 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc09409dd70 msgr2=0x7fc094119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.300+0000 7fc09359e700 1 --2- 172.21.15.40:0/4029655539 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc09409dd70 0x7fc094119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.300+0000 7fc09359e700 1 -- 172.21.15.40:0/4029655539 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc09409d400 msgr2=0x7fc094119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.300+0000 7fc09359e700 1 --2- 172.21.15.40:0/4029655539 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc09409d400 0x7fc094119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.300+0000 7fc09359e700 1 -- 172.21.15.40:0/4029655539 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0880094a0 con 0x7fc094133e00 2023-09-30T22:26:45.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.300+0000 7fc09259c700 1 --2- 172.21.15.40:0/4029655539 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc09409dd70 0x7fc094119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:45.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.300+0000 7fc09359e700 1 --2- 172.21.15.40:0/4029655539 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc094133e00 0x7fc094119ad0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc08c00efc0 tx=0x7fc08c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:45.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.301+0000 7fc07b7fe700 1 -- 172.21.15.40:0/4029655539 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c003c20 con 0x7fc094133e00 2023-09-30T22:26:45.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.301+0000 7fc07b7fe700 1 -- 172.21.15.40:0/4029655539 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08c00f040 con 0x7fc094133e00 2023-09-30T22:26:45.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.301+0000 7fc07b7fe700 1 -- 172.21.15.40:0/4029655539 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c009e60 con 0x7fc094133e00 2023-09-30T22:26:45.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.302+0000 7fc09903d700 1 -- 172.21.15.40:0/4029655539 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0840094a0 con 0x7fc094133e00 2023-09-30T22:26:45.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.302+0000 7fc09903d700 1 -- 172.21.15.40:0/4029655539 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc09411ba50 con 0x7fc094133e00 2023-09-30T22:26:45.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.302+0000 7fc07b7fe700 1 -- 172.21.15.40:0/4029655539 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc08c00c930 con 0x7fc094133e00 2023-09-30T22:26:45.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.302+0000 7fc09903d700 1 -- 172.21.15.40:0/4029655539 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc094132fe0 con 0x7fc094133e00 2023-09-30T22:26:45.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.303+0000 7fc07b7fe700 1 -- 172.21.15.40:0/4029655539 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc08c03fa60 con 0x7fc094133e00 2023-09-30T22:26:45.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.312+0000 7fc07b7fe700 1 -- 172.21.15.40:0/4029655539 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc08c01c360 con 0x7fc094133e00 2023-09-30T22:26:45.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.328+0000 7fd629c51700 1 Processor -- start 2023-09-30T22:26:45.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.328+0000 7fd629c51700 1 -- start start 2023-09-30T22:26:45.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.328+0000 7fd629c51700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd62413b130 0x7fd62413d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.328+0000 7fd629c51700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd62413da50 0x7fd62413fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.328+0000 7fd629c51700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd624137e20 con 0x7fd624138250 2023-09-30T22:26:45.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.328+0000 7fd629c51700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd624138d30 con 0x7fd62413b130 2023-09-30T22:26:45.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.328+0000 7fd629c51700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd624138050 con 0x7fd62413da50 2023-09-30T22:26:45.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.328+0000 7fd623fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd62413da50 0x7fd62413fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.328+0000 7fd6237fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd624138250 0x7fd624138620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60594/0 (socket says 172.21.15.40:60594) 2023-09-30T22:26:45.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.328+0000 7fd6237fe700 1 -- 172.21.15.40:0/2511111288 learned_addr learned my addr 172.21.15.40:0/2511111288 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:45.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.328+0000 7fd622ffd700 1 --2- 172.21.15.40:0/2511111288 >> v2:172.21.15.40:3300/0 conn(0x7fd62413b130 0x7fd62413d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.329+0000 7fd622ffd700 1 -- 172.21.15.40:0/2511111288 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd62413da50 msgr2=0x7fd62413fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:45.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.329+0000 7fd622ffd700 1 --2- 172.21.15.40:0/2511111288 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd62413da50 0x7fd62413fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.329+0000 7fd622ffd700 1 -- 172.21.15.40:0/2511111288 >> v1:172.21.15.40:6789/0 conn(0x7fd624138250 legacy=0x7fd624138620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.329+0000 7fd6227fc700 1 -- 172.21.15.40:0/2511111288 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 563320161 0 0) 0x7fd624137e20 con 0x7fd624138250 2023-09-30T22:26:45.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.329+0000 7fd622ffd700 1 -- 172.21.15.40:0/2511111288 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62409b010 con 0x7fd62413b130 2023-09-30T22:26:45.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.329+0000 7fd622ffd700 1 --2- 172.21.15.40:0/2511111288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd62413b130 0x7fd62413d510 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fd618009840 tx=0x7fd618009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0f1acf1515f5b98 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:45.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.329+0000 7fd6227fc700 1 -- 172.21.15.40:0/2511111288 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd618011830 con 0x7fd62413b130 2023-09-30T22:26:45.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.329+0000 7fd6227fc700 1 -- 172.21.15.40:0/2511111288 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd618011990 con 0x7fd62413b130 2023-09-30T22:26:45.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.329+0000 7fd6227fc700 1 -- 172.21.15.40:0/2511111288 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd618011d20 con 0x7fd62413b130 2023-09-30T22:26:45.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.330+0000 7fd629c51700 1 -- 172.21.15.40:0/2511111288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd62413b130 msgr2=0x7fd62413d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.330+0000 7fd629c51700 1 --2- 172.21.15.40:0/2511111288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd62413b130 0x7fd62413d510 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fd618009840 tx=0x7fd618009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:45.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.330+0000 7fd629c51700 1 -- 172.21.15.40:0/2511111288 shutdown_connections 2023-09-30T22:26:45.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.330+0000 7fd629c51700 1 --2- 172.21.15.40:0/2511111288 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd62413da50 0x7fd62413fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.330+0000 7fd629c51700 1 --2- 172.21.15.40:0/2511111288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd62413b130 0x7fd62413d510 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.330+0000 7fd629c51700 1 -- 172.21.15.40:0/2511111288 >> 172.21.15.40:0/2511111288 conn(0x7fd6240a2a00 msgr2=0x7fd6240a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:45.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.330+0000 7fd629c51700 1 -- 172.21.15.40:0/2511111288 shutdown_connections 2023-09-30T22:26:45.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.330+0000 7fd629c51700 1 -- 172.21.15.40:0/2511111288 wait complete. 2023-09-30T22:26:45.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.331+0000 7fd629c51700 1 Processor -- start 2023-09-30T22:26:45.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.331+0000 7fd629c51700 1 -- start start 2023-09-30T22:26:45.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.332+0000 7fd629c51700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd624138250 0x7fd624070d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.332+0000 7fd629c51700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd62413b130 0x7fd62413f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.332+0000 7fd629c51700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd62413da50 0x7fd62413fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.332+0000 7fd629c51700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62406e260 con 0x7fd624138250 2023-09-30T22:26:45.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.332+0000 7fd629c51700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd62413d520 con 0x7fd62413da50 2023-09-30T22:26:45.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.332+0000 7fd629c51700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd62409a300 con 0x7fd62413b130 2023-09-30T22:26:45.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.332+0000 7fd6237fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd624138250 0x7fd624070d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.332+0000 7fd6237fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd624138250 0x7fd624070d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48982/0 (socket says 172.21.15.40:48982) 2023-09-30T22:26:45.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.332+0000 7fd6237fe700 1 -- 172.21.15.40:0/27709792 learned_addr learned my addr 172.21.15.40:0/27709792 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:45.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.332+0000 7fd623fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd62413da50 0x7fd62413fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.332+0000 7fd622ffd700 1 --2- 172.21.15.40:0/27709792 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd62413b130 0x7fd62413f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.332+0000 7fd623fff700 1 -- 172.21.15.40:0/27709792 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd62413b130 msgr2=0x7fd62413f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.332+0000 7fd623fff700 1 --2- 172.21.15.40:0/27709792 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd62413b130 0x7fd62413f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.332+0000 7fd623fff700 1 -- 172.21.15.40:0/27709792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd624138250 msgr2=0x7fd624070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.332+0000 7fd623fff700 1 --2- 172.21.15.40:0/27709792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd624138250 0x7fd624070d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.332+0000 7fd623fff700 1 -- 172.21.15.40:0/27709792 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6180094a0 con 0x7fd62413da50 2023-09-30T22:26:45.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.332+0000 7fd6237fe700 1 --2- 172.21.15.40:0/27709792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd624138250 0x7fd624070d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:45.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.333+0000 7fd623fff700 1 --2- 172.21.15.40:0/27709792 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd62413da50 0x7fd62413fc10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd61c00efc0 tx=0x7fd61c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:45.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.333+0000 7fd60bfff700 1 -- 172.21.15.40:0/27709792 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61c00cc90 con 0x7fd62413da50 2023-09-30T22:26:45.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.333+0000 7fd60bfff700 1 -- 172.21.15.40:0/27709792 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61c00f040 con 0x7fd62413da50 2023-09-30T22:26:45.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.333+0000 7fd629c51700 1 -- 172.21.15.40:0/27709792 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd62406d9f0 con 0x7fd62413da50 2023-09-30T22:26:45.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.333+0000 7fd60bfff700 1 -- 172.21.15.40:0/27709792 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61c0146c0 con 0x7fd62413da50 2023-09-30T22:26:45.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.333+0000 7fd629c51700 1 -- 172.21.15.40:0/27709792 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd624070550 con 0x7fd62413da50 2023-09-30T22:26:45.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.334+0000 7fd60bfff700 1 -- 172.21.15.40:0/27709792 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd61c014820 con 0x7fd62413da50 2023-09-30T22:26:45.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.334+0000 7fd60bfff700 1 -- 172.21.15.40:0/27709792 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd61c041950 con 0x7fd62413da50 2023-09-30T22:26:45.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.335+0000 7fd629c51700 1 -- 172.21.15.40:0/27709792 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd624062380 con 0x7fd62413da50 2023-09-30T22:26:45.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.339+0000 7fd60bfff700 1 -- 172.21.15.40:0/27709792 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd61c018020 con 0x7fd62413da50 2023-09-30T22:26:45.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.430+0000 7f6da79c3700 1 -- 172.21.15.40:0/3418414265 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6da0124f00 con 0x7f6da0133ca0 2023-09-30T22:26:45.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.430+0000 7f6d95ffb700 1 -- 172.21.15.40:0/3418414265 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6da0124f00 con 0x7f6da0133ca0 2023-09-30T22:26:45.431 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:45.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.433+0000 7f6da79c3700 1 -- 172.21.15.40:0/3418414265 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6da0133ca0 msgr2=0x7f6da0121da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.433+0000 7f6da79c3700 1 --2- 172.21.15.40:0/3418414265 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6da0133ca0 0x7f6da0121da0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6d9000d800 tx=0x7f6d9000db10 comp rx=0 tx=0).stop 2023-09-30T22:26:45.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.433+0000 7f6da79c3700 1 -- 172.21.15.40:0/3418414265 shutdown_connections 2023-09-30T22:26:45.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.433+0000 7f6da79c3700 1 --2- 172.21.15.40:0/3418414265 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6da01222e0 0x7f6da01c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.433+0000 7f6da79c3700 1 --2- 172.21.15.40:0/3418414265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6da009d920 0x7f6da0121860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.433+0000 7f6da79c3700 1 --2- 172.21.15.40:0/3418414265 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6da0133ca0 0x7f6da0121da0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.433+0000 7f6da79c3700 1 -- 172.21.15.40:0/3418414265 >> 172.21.15.40:0/3418414265 conn(0x7f6da009fb20 msgr2=0x7f6da00a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:45.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.434+0000 7f6da79c3700 1 -- 172.21.15.40:0/3418414265 shutdown_connections 2023-09-30T22:26:45.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.434+0000 7f6da79c3700 1 -- 172.21.15.40:0/3418414265 wait complete. 2023-09-30T22:26:45.451 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:45.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.495+0000 7f525d277700 1 -- 172.21.15.40:0/999587170 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5258074620 con 0x7f52581371b0 2023-09-30T22:26:45.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.496+0000 7f523f7fe700 1 -- 172.21.15.40:0/999587170 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5250018020 con 0x7f52581371b0 2023-09-30T22:26:45.497 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:45.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.498+0000 7f525d277700 1 -- 172.21.15.40:0/999587170 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52581371b0 msgr2=0x7f5258135550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.498+0000 7f525d277700 1 --2- 172.21.15.40:0/999587170 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52581371b0 0x7f5258135550 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f525000efc0 tx=0x7f525000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.498+0000 7f525d277700 1 -- 172.21.15.40:0/999587170 shutdown_connections 2023-09-30T22:26:45.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.498+0000 7f525d277700 1 --2- 172.21.15.40:0/999587170 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f525806f070 0x7f5258134ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.498+0000 7f525d277700 1 --2- 172.21.15.40:0/999587170 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52581371b0 0x7f5258135550 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.498+0000 7f525d277700 1 --2- 172.21.15.40:0/999587170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f525806fb50 0x7f5258135010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.498+0000 7f525d277700 1 -- 172.21.15.40:0/999587170 >> 172.21.15.40:0/999587170 conn(0x7f52580a41a0 msgr2=0x7f525809a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:45.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.498+0000 7f525d277700 1 -- 172.21.15.40:0/999587170 shutdown_connections 2023-09-30T22:26:45.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.498+0000 7f525d277700 1 -- 172.21.15.40:0/999587170 wait complete. 2023-09-30T22:26:45.511 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:45.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.525+0000 7fc09903d700 1 -- 172.21.15.40:0/4029655539 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc094062380 con 0x7fc094133e00 2023-09-30T22:26:45.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.525+0000 7fc07b7fe700 1 -- 172.21.15.40:0/4029655539 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc08c007610 con 0x7fc094133e00 2023-09-30T22:26:45.525 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:45.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.527+0000 7fc09903d700 1 -- 172.21.15.40:0/4029655539 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc094133e00 msgr2=0x7fc094119ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.527+0000 7fc09903d700 1 --2- 172.21.15.40:0/4029655539 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc094133e00 0x7fc094119ad0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc08c00efc0 tx=0x7fc08c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.527+0000 7fc09903d700 1 -- 172.21.15.40:0/4029655539 shutdown_connections 2023-09-30T22:26:45.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.527+0000 7fc09903d700 1 --2- 172.21.15.40:0/4029655539 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc094133e00 0x7fc094119ad0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.527+0000 7fc09903d700 1 --2- 172.21.15.40:0/4029655539 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc09409d400 0x7fc094119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.527+0000 7fc09903d700 1 --2- 172.21.15.40:0/4029655539 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc09409dd70 0x7fc094119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.527+0000 7fc09903d700 1 -- 172.21.15.40:0/4029655539 >> 172.21.15.40:0/4029655539 conn(0x7fc0940a2a00 msgr2=0x7fc09412d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:45.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.527+0000 7fc09903d700 1 -- 172.21.15.40:0/4029655539 shutdown_connections 2023-09-30T22:26:45.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.527+0000 7fc09903d700 1 -- 172.21.15.40:0/4029655539 wait complete. 2023-09-30T22:26:45.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:45.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.551+0000 7fd629c51700 1 -- 172.21.15.40:0/27709792 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd62406f330 con 0x7fd62413da50 2023-09-30T22:26:45.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.551+0000 7fd60bfff700 1 -- 172.21.15.40:0/27709792 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd62406f330 con 0x7fd62413da50 2023-09-30T22:26:45.552 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:45.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.553+0000 7fd629c51700 1 -- 172.21.15.40:0/27709792 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd62413da50 msgr2=0x7fd62413fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.553+0000 7fd629c51700 1 --2- 172.21.15.40:0/27709792 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd62413da50 0x7fd62413fc10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd61c00efc0 tx=0x7fd61c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.553+0000 7fd629c51700 1 -- 172.21.15.40:0/27709792 shutdown_connections 2023-09-30T22:26:45.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.553+0000 7fd629c51700 1 --2- 172.21.15.40:0/27709792 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd62413da50 0x7fd62413fc10 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.553+0000 7fd629c51700 1 --2- 172.21.15.40:0/27709792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd624138250 0x7fd624070d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.553+0000 7fd629c51700 1 --2- 172.21.15.40:0/27709792 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd62413b130 0x7fd62413f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.553+0000 7fd629c51700 1 -- 172.21.15.40:0/27709792 >> 172.21.15.40:0/27709792 conn(0x7fd6240a2a00 msgr2=0x7fd62413cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:45.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.554+0000 7fd629c51700 1 -- 172.21.15.40:0/27709792 shutdown_connections 2023-09-30T22:26:45.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:45.554+0000 7fd629c51700 1 -- 172.21.15.40:0/27709792 wait complete. 2023-09-30T22:26:45.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:46.452 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:46.512 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:46.542 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:46.567 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:46.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.600+0000 7f3dbb0f2700 1 Processor -- start 2023-09-30T22:26:46.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.600+0000 7f3dbb0f2700 1 -- start start 2023-09-30T22:26:46.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.600+0000 7f3dbb0f2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3db412e590 0x7f3db412e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.600+0000 7f3dbb0f2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3db412eea0 0x7f3db412d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.601+0000 7f3dbb0f2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3db409ab70 con 0x7f3db412d6d0 2023-09-30T22:26:46.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.601+0000 7f3dbb0f2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3db409b270 con 0x7f3db412eea0 2023-09-30T22:26:46.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.601+0000 7f3dbb0f2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3db409bab0 con 0x7f3db412e590 2023-09-30T22:26:46.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.601+0000 7f3db3fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3db412eea0 0x7f3db412d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.601+0000 7f3db3fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3db412eea0 0x7f3db412d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48998/0 (socket says 172.21.15.40:48998) 2023-09-30T22:26:46.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.601+0000 7f3db3fff700 1 -- 172.21.15.40:0/2707318022 learned_addr learned my addr 172.21.15.40:0/2707318022 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:46.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.601+0000 7f3db8e8e700 1 --2- 172.21.15.40:0/2707318022 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3db412e590 0x7f3db412e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.601+0000 7f3db3fff700 1 -- 172.21.15.40:0/2707318022 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3db412e590 msgr2=0x7f3db412e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:46.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.601+0000 7f3db3fff700 1 --2- 172.21.15.40:0/2707318022 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3db412e590 0x7f3db412e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.601+0000 7f3db3fff700 1 -- 172.21.15.40:0/2707318022 >> v1:172.21.15.40:6789/0 conn(0x7f3db412d6d0 legacy=0x7f3db4137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.601+0000 7f3db3fff700 1 -- 172.21.15.40:0/2707318022 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db409bd70 con 0x7f3db412eea0 2023-09-30T22:26:46.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.601+0000 7f3db3fff700 1 --2- 172.21.15.40:0/2707318022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3db412eea0 0x7f3db412d190 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f3da0009920 tx=0x7f3da0009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa49fdee1656eca9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:46.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.602+0000 7f3db37fe700 1 -- 172.21.15.40:0/2707318022 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da0011830 con 0x7f3db412eea0 2023-09-30T22:26:46.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.602+0000 7f3db37fe700 1 -- 172.21.15.40:0/2707318022 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da0011990 con 0x7f3db412eea0 2023-09-30T22:26:46.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.602+0000 7f3db37fe700 1 -- 172.21.15.40:0/2707318022 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da0011d20 con 0x7f3db412eea0 2023-09-30T22:26:46.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.602+0000 7f3dbb0f2700 1 -- 172.21.15.40:0/2707318022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3db412eea0 msgr2=0x7f3db412d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.602+0000 7f3dbb0f2700 1 --2- 172.21.15.40:0/2707318022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3db412eea0 0x7f3db412d190 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f3da0009920 tx=0x7f3da0009c30 comp rx=0 tx=0).stop 2023-09-30T22:26:46.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.603+0000 7f3dbb0f2700 1 -- 172.21.15.40:0/2707318022 shutdown_connections 2023-09-30T22:26:46.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.603+0000 7f3dbb0f2700 1 --2- 172.21.15.40:0/2707318022 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3db412e590 0x7f3db412e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.603+0000 7f3dbb0f2700 1 --2- 172.21.15.40:0/2707318022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3db412eea0 0x7f3db412d190 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.603+0000 7f3dbb0f2700 1 -- 172.21.15.40:0/2707318022 >> 172.21.15.40:0/2707318022 conn(0x7f3db40a2a00 msgr2=0x7f3db40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:46.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.603+0000 7f3dbb0f2700 1 -- 172.21.15.40:0/2707318022 shutdown_connections 2023-09-30T22:26:46.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.603+0000 7f3dbb0f2700 1 -- 172.21.15.40:0/2707318022 wait complete. 2023-09-30T22:26:46.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.604+0000 7f3dbb0f2700 1 Processor -- start 2023-09-30T22:26:46.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.604+0000 7f3dbb0f2700 1 -- start start 2023-09-30T22:26:46.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.605+0000 7f3dbb0f2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3db412d6d0 0x7f3db4070280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.605+0000 7f3dbb0f2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3db412e590 0x7f3db40707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.605+0000 7f3dbb0f2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3db412eea0 0x7f3db41c6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.605+0000 7f3dbb0f2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db4070d00 con 0x7f3db412e590 2023-09-30T22:26:46.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.605+0000 7f3dbb0f2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db409fd70 con 0x7f3db412eea0 2023-09-30T22:26:46.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.605+0000 7f3dbb0f2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3db41280d0 con 0x7f3db412d6d0 2023-09-30T22:26:46.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.605+0000 7f3db8e8e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3db412d6d0 0x7f3db4070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.605+0000 7f3db8e8e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3db412d6d0 0x7f3db4070280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60372/0 (socket says 172.21.15.40:60372) 2023-09-30T22:26:46.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.605+0000 7f3db8e8e700 1 -- 172.21.15.40:0/2642406032 learned_addr learned my addr 172.21.15.40:0/2642406032 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:46.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.605+0000 7f3db3fff700 1 --2- 172.21.15.40:0/2642406032 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3db412e590 0x7f3db40707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.605+0000 7f3db8e8e700 1 -- 172.21.15.40:0/2642406032 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3db412eea0 msgr2=0x7f3db41c6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.605+0000 7f3db8e8e700 1 --2- 172.21.15.40:0/2642406032 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3db412eea0 0x7f3db41c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.605+0000 7f3db8e8e700 1 -- 172.21.15.40:0/2642406032 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3db412e590 msgr2=0x7f3db40707c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.605+0000 7f3db8e8e700 1 --2- 172.21.15.40:0/2642406032 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3db412e590 0x7f3db40707c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.605+0000 7f3db8e8e700 1 -- 172.21.15.40:0/2642406032 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da0009550 con 0x7f3db412d6d0 2023-09-30T22:26:46.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.606+0000 7f3db8e8e700 1 --2- 172.21.15.40:0/2642406032 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3db412d6d0 0x7f3db4070280 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3da800e9b0 tx=0x7f3da800ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:46.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.606+0000 7f3db17fa700 1 -- 172.21.15.40:0/2642406032 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da8009710 con 0x7f3db412d6d0 2023-09-30T22:26:46.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.606+0000 7f3db17fa700 1 -- 172.21.15.40:0/2642406032 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da800c850 con 0x7f3db412d6d0 2023-09-30T22:26:46.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.606+0000 7f3db17fa700 1 -- 172.21.15.40:0/2642406032 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da800cbc0 con 0x7f3db412d6d0 2023-09-30T22:26:46.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.606+0000 7f3dbb0f2700 1 -- 172.21.15.40:0/2642406032 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3db409cdb0 con 0x7f3db412d6d0 2023-09-30T22:26:46.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.606+0000 7f3dbb0f2700 1 -- 172.21.15.40:0/2642406032 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3db4127a70 con 0x7f3db412d6d0 2023-09-30T22:26:46.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.607+0000 7f3db17fa700 1 -- 172.21.15.40:0/2642406032 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3da800cd20 con 0x7f3db412d6d0 2023-09-30T22:26:46.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.607+0000 7f3db17fa700 1 -- 172.21.15.40:0/2642406032 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3da803f640 con 0x7f3db412d6d0 2023-09-30T22:26:46.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.608+0000 7f3dbb0f2700 1 -- 172.21.15.40:0/2642406032 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3db4128ce0 con 0x7f3db412d6d0 2023-09-30T22:26:46.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.614+0000 7f3db17fa700 1 -- 172.21.15.40:0/2642406032 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3da8013470 con 0x7f3db412d6d0 2023-09-30T22:26:46.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.652+0000 7f7305899700 1 Processor -- start 2023-09-30T22:26:46.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.652+0000 7f7305899700 1 -- start start 2023-09-30T22:26:46.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.653+0000 7f7305899700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f730009c890 0x7f730009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.653+0000 7f7305899700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f730009d920 0x7f730009dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.653+0000 7f7305899700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f730009e2b0 0x7f730013ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.653+0000 7f7305899700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73000a29d0 con 0x7f730009d920 2023-09-30T22:26:46.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.653+0000 7f7305899700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730009fb40 con 0x7f730009c890 2023-09-30T22:26:46.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.653+0000 7f7305899700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73000a2600 con 0x7f730009e2b0 2023-09-30T22:26:46.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.653+0000 7f72feffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f730009c890 0x7f730009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.653+0000 7f72feffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f730009c890 0x7f730009cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42866/0 (socket says 172.21.15.40:42866) 2023-09-30T22:26:46.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.653+0000 7f72feffd700 1 -- 172.21.15.40:0/2007770225 learned_addr learned my addr 172.21.15.40:0/2007770225 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:46.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.653+0000 7f72fe7fc700 1 --2- 172.21.15.40:0/2007770225 >> v2:172.21.15.40:3300/0 conn(0x7f730009d920 0x7f730009dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.653+0000 7f72feffd700 1 -- 172.21.15.40:0/2007770225 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f730009e2b0 msgr2=0x7f730013ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:46.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.653+0000 7f72feffd700 1 --2- 172.21.15.40:0/2007770225 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f730009e2b0 0x7f730013ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.653+0000 7f72feffd700 1 -- 172.21.15.40:0/2007770225 >> v2:172.21.15.40:3300/0 conn(0x7f730009d920 msgr2=0x7f730009dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:46.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.653+0000 7f72feffd700 1 --2- 172.21.15.40:0/2007770225 >> v2:172.21.15.40:3300/0 conn(0x7f730009d920 0x7f730009dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.653+0000 7f72feffd700 1 -- 172.21.15.40:0/2007770225 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f730009e750 con 0x7f730009c890 2023-09-30T22:26:46.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.653+0000 7f72fe7fc700 1 --2- 172.21.15.40:0/2007770225 >> v2:172.21.15.40:3300/0 conn(0x7f730009d920 0x7f730009dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:46.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.654+0000 7f72feffd700 1 --2- 172.21.15.40:0/2007770225 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f730009c890 0x7f730009cc60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f72f0006fd0 tx=0x7f72f0009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9be795ec92ac08f9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:46.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.654+0000 7f72fdffb700 1 -- 172.21.15.40:0/2007770225 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f0005e30 con 0x7f730009c890 2023-09-30T22:26:46.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.654+0000 7f72fdffb700 1 -- 172.21.15.40:0/2007770225 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f0004030 con 0x7f730009c890 2023-09-30T22:26:46.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.654+0000 7f72fdffb700 1 -- 172.21.15.40:0/2007770225 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f00043e0 con 0x7f730009c890 2023-09-30T22:26:46.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.654+0000 7f7305899700 1 -- 172.21.15.40:0/2007770225 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f730009c890 msgr2=0x7f730009cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.654+0000 7f7305899700 1 --2- 172.21.15.40:0/2007770225 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f730009c890 0x7f730009cc60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f72f0006fd0 tx=0x7f72f0009bd0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.655+0000 7f7305899700 1 -- 172.21.15.40:0/2007770225 shutdown_connections 2023-09-30T22:26:46.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.655+0000 7f7305899700 1 --2- 172.21.15.40:0/2007770225 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f730009e2b0 0x7f730013ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.655+0000 7f7305899700 1 --2- 172.21.15.40:0/2007770225 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f730009c890 0x7f730009cc60 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.655+0000 7f7305899700 1 --2- 172.21.15.40:0/2007770225 >> v2:172.21.15.40:3300/0 conn(0x7f730009d920 0x7f730009dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.655+0000 7f7305899700 1 -- 172.21.15.40:0/2007770225 >> 172.21.15.40:0/2007770225 conn(0x7f73000a7080 msgr2=0x7f73000a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:46.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.655+0000 7f7305899700 1 -- 172.21.15.40:0/2007770225 shutdown_connections 2023-09-30T22:26:46.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.655+0000 7f7305899700 1 -- 172.21.15.40:0/2007770225 wait complete. 2023-09-30T22:26:46.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.655+0000 7f7305899700 1 Processor -- start 2023-09-30T22:26:46.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.656+0000 7f7305899700 1 -- start start 2023-09-30T22:26:46.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.656+0000 7f7305899700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f730009c890 0x7f730012d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.656+0000 7f7305899700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f730009d920 0x7f730012dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.656+0000 7f7305899700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f730009e2b0 0x7f730012e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.656+0000 7f7305899700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73001308c0 con 0x7f730009d920 2023-09-30T22:26:46.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.656+0000 7f7305899700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730009bbe0 con 0x7f730009e2b0 2023-09-30T22:26:46.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.656+0000 7f7305899700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73000a5dc0 con 0x7f730009c890 2023-09-30T22:26:46.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.656+0000 7f72fe7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f730009d920 0x7f730012dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.656+0000 7f72ff7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f730009e2b0 0x7f730012e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.656+0000 7f72fe7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f730009d920 0x7f730012dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49020/0 (socket says 172.21.15.40:49020) 2023-09-30T22:26:46.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.656+0000 7f72ff7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f730009e2b0 0x7f730012e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42878/0 (socket says 172.21.15.40:42878) 2023-09-30T22:26:46.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.656+0000 7f72fe7fc700 1 -- 172.21.15.40:0/3098949499 learned_addr learned my addr 172.21.15.40:0/3098949499 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:46.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.657+0000 7f72fe7fc700 1 -- 172.21.15.40:0/3098949499 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f730009c890 msgr2=0x7f730012d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.657+0000 7f72fe7fc700 1 --2- 172.21.15.40:0/3098949499 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f730009c890 0x7f730012d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.657+0000 7f72fe7fc700 1 -- 172.21.15.40:0/3098949499 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f730009e2b0 msgr2=0x7f730012e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.657+0000 7f72fe7fc700 1 --2- 172.21.15.40:0/3098949499 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f730009e2b0 0x7f730012e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.657+0000 7f72fe7fc700 1 -- 172.21.15.40:0/3098949499 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f40094a0 con 0x7f730009d920 2023-09-30T22:26:46.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.657+0000 7f72ff7fe700 1 --2- 172.21.15.40:0/3098949499 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f730009e2b0 0x7f730012e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:46.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.657+0000 7f72fe7fc700 1 --2- 172.21.15.40:0/3098949499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f730009d920 0x7f730012dc00 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f72f400ebe0 tx=0x7f72f400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:46.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.657+0000 7f72e7fff700 1 -- 172.21.15.40:0/3098949499 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f400c910 con 0x7f730009d920 2023-09-30T22:26:46.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.657+0000 7f72e7fff700 1 -- 172.21.15.40:0/3098949499 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f400ca70 con 0x7f730009d920 2023-09-30T22:26:46.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.657+0000 7f72e7fff700 1 -- 172.21.15.40:0/3098949499 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f400ce00 con 0x7f730009d920 2023-09-30T22:26:46.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.657+0000 7f7305899700 1 -- 172.21.15.40:0/3098949499 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72f0009500 con 0x7f730009d920 2023-09-30T22:26:46.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.657+0000 7f7305899700 1 -- 172.21.15.40:0/3098949499 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f730008f4f0 con 0x7f730009d920 2023-09-30T22:26:46.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.658+0000 7f72e7fff700 1 -- 172.21.15.40:0/3098949499 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f72f4013470 con 0x7f730009d920 2023-09-30T22:26:46.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.658+0000 7f7305899700 1 -- 172.21.15.40:0/3098949499 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7300062380 con 0x7f730009d920 2023-09-30T22:26:46.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.659+0000 7f72e7fff700 1 -- 172.21.15.40:0/3098949499 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f72f403f880 con 0x7f730009d920 2023-09-30T22:26:46.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.663+0000 7f72e7fff700 1 -- 172.21.15.40:0/3098949499 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f72f40232f0 con 0x7f730009d920 2023-09-30T22:26:46.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.732+0000 7fe2630d5700 1 Processor -- start 2023-09-30T22:26:46.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.732+0000 7fe2630d5700 1 -- start start 2023-09-30T22:26:46.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.732+0000 7fe2630d5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe25c06a6d0 0x7fe25c09d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.732+0000 7fe2630d5700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe25c09de60 0x7fe25c09e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.732+0000 7fe2630d5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe25c09e790 con 0x7fe25c13c490 2023-09-30T22:26:46.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.732+0000 7fe2630d5700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe25c06aaa0 con 0x7fe25c09de60 2023-09-30T22:26:46.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.732+0000 7fe2630d5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c11d980 con 0x7fe25c06a6d0 2023-09-30T22:26:46.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.733+0000 7fe25bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe25c09de60 0x7fe25c09e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.733+0000 7fe25bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe25c09de60 0x7fe25c09e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49032/0 (socket says 172.21.15.40:49032) 2023-09-30T22:26:46.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.733+0000 7fe25bfff700 1 -- 172.21.15.40:0/397484128 learned_addr learned my addr 172.21.15.40:0/397484128 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:46.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.733+0000 7fe260e71700 1 --2- 172.21.15.40:0/397484128 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe25c06a6d0 0x7fe25c09d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.733+0000 7fe25bfff700 1 -- 172.21.15.40:0/397484128 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe25c06a6d0 msgr2=0x7fe25c09d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:46.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.733+0000 7fe25bfff700 1 --2- 172.21.15.40:0/397484128 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe25c06a6d0 0x7fe25c09d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.733+0000 7fe25bfff700 1 -- 172.21.15.40:0/397484128 >> v1:172.21.15.40:6789/0 conn(0x7fe25c13c490 legacy=0x7fe25c13e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.733+0000 7fe25bfff700 1 -- 172.21.15.40:0/397484128 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe25c06b150 con 0x7fe25c09de60 2023-09-30T22:26:46.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.733+0000 7f83661c9700 1 Processor -- start 2023-09-30T22:26:46.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.733+0000 7f83661c9700 1 -- start start 2023-09-30T22:26:46.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.733+0000 7fe25bfff700 1 --2- 172.21.15.40:0/397484128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe25c09de60 0x7fe25c09e250 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe2480098f0 tx=0x7fe248009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6909dce368e3f840 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:46.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.734+0000 7fe25b7fe700 1 -- 172.21.15.40:0/397484128 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe248011830 con 0x7fe25c09de60 2023-09-30T22:26:46.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.734+0000 7fe25b7fe700 1 -- 172.21.15.40:0/397484128 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe248011990 con 0x7fe25c09de60 2023-09-30T22:26:46.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.734+0000 7fe25b7fe700 1 -- 172.21.15.40:0/397484128 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe248011d20 con 0x7fe25c09de60 2023-09-30T22:26:46.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.734+0000 7f83661c9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8360134a90 0x7f8360136e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.734+0000 7f83661c9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f83601373b0 0x7f8360139790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.734+0000 7f83661c9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8360131900 con 0x7f8360131d50 2023-09-30T22:26:46.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.734+0000 7f83661c9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83600719e0 con 0x7f8360134a90 2023-09-30T22:26:46.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.734+0000 7f83661c9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f836009e820 con 0x7f83601373b0 2023-09-30T22:26:46.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.734+0000 7f835effd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8360134a90 0x7f8360136e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.734+0000 7f835f7fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8360131d50 0x7f8360132120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60614/0 (socket says 172.21.15.40:60614) 2023-09-30T22:26:46.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.734+0000 7f835f7fe700 1 -- 172.21.15.40:0/1705698283 learned_addr learned my addr 172.21.15.40:0/1705698283 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:46.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.734+0000 7fe2630d5700 1 -- 172.21.15.40:0/397484128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe25c09de60 msgr2=0x7fe25c09e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.734+0000 7fe2630d5700 1 --2- 172.21.15.40:0/397484128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe25c09de60 0x7fe25c09e250 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe2480098f0 tx=0x7fe248009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:46.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.734+0000 7fe2630d5700 1 -- 172.21.15.40:0/397484128 shutdown_connections 2023-09-30T22:26:46.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.734+0000 7fe2630d5700 1 --2- 172.21.15.40:0/397484128 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe25c06a6d0 0x7fe25c09d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.734+0000 7fe2630d5700 1 --2- 172.21.15.40:0/397484128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe25c09de60 0x7fe25c09e250 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.735+0000 7fe2630d5700 1 -- 172.21.15.40:0/397484128 >> 172.21.15.40:0/397484128 conn(0x7fe25c09fb20 msgr2=0x7fe25c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:46.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.735+0000 7f835effd700 1 -- 172.21.15.40:0/1705698283 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f83601373b0 msgr2=0x7f8360139790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:46.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.735+0000 7f835ffff700 1 --2- 172.21.15.40:0/1705698283 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f83601373b0 0x7f8360139790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.735+0000 7f835effd700 1 --2- 172.21.15.40:0/1705698283 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f83601373b0 0x7f8360139790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.735+0000 7f835e7fc700 1 -- 172.21.15.40:0/1705698283 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 717276120 0 0) 0x7f8360131900 con 0x7f8360131d50 2023-09-30T22:26:46.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.735+0000 7f835effd700 1 -- 172.21.15.40:0/1705698283 >> v1:172.21.15.40:6789/0 conn(0x7f8360131d50 legacy=0x7f8360132120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.735+0000 7fe2630d5700 1 -- 172.21.15.40:0/397484128 shutdown_connections 2023-09-30T22:26:46.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.735+0000 7f835effd700 1 -- 172.21.15.40:0/1705698283 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836009ef60 con 0x7f8360134a90 2023-09-30T22:26:46.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.735+0000 7f835ffff700 1 --2- 172.21.15.40:0/1705698283 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f83601373b0 0x7f8360139790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:26:46.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.735+0000 7f835effd700 1 --2- 172.21.15.40:0/1705698283 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8360134a90 0x7f8360136e70 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f8354009840 tx=0x7f8354009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96a59580c760a05c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:46.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.735+0000 7f835e7fc700 1 -- 172.21.15.40:0/1705698283 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8354011830 con 0x7f8360134a90 2023-09-30T22:26:46.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.735+0000 7f835e7fc700 1 -- 172.21.15.40:0/1705698283 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8354011990 con 0x7f8360134a90 2023-09-30T22:26:46.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.735+0000 7f835e7fc700 1 -- 172.21.15.40:0/1705698283 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8354011d20 con 0x7f8360134a90 2023-09-30T22:26:46.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.735+0000 7fe2630d5700 1 -- 172.21.15.40:0/397484128 wait complete. 2023-09-30T22:26:46.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.736+0000 7fe2630d5700 1 Processor -- start 2023-09-30T22:26:46.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.736+0000 7fe2630d5700 1 -- start start 2023-09-30T22:26:46.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.736+0000 7f83661c9700 1 -- 172.21.15.40:0/1705698283 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8360134a90 msgr2=0x7f8360136e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.736+0000 7f83661c9700 1 --2- 172.21.15.40:0/1705698283 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8360134a90 0x7f8360136e70 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f8354009840 tx=0x7f8354009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:46.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.737+0000 7fe2630d5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe25c06a6d0 0x7fe25c1383b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.737+0000 7fe2630d5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe25c09de60 0x7fe25c1388f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.737+0000 7fe2630d5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe25c13c490 0x7fe25c138e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.737+0000 7fe2630d5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c13b440 con 0x7fe25c09de60 2023-09-30T22:26:46.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.737+0000 7fe2630d5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c13a330 con 0x7fe25c13c490 2023-09-30T22:26:46.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.737+0000 7fe2630d5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c0a21b0 con 0x7fe25c06a6d0 2023-09-30T22:26:46.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.737+0000 7fe25bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe25c09de60 0x7fe25c1388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.737+0000 7fe260e71700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe25c06a6d0 0x7fe25c1383b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.737+0000 7fe25bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe25c09de60 0x7fe25c1388f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49058/0 (socket says 172.21.15.40:49058) 2023-09-30T22:26:46.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.737+0000 7fe25bfff700 1 -- 172.21.15.40:0/3971226646 learned_addr learned my addr 172.21.15.40:0/3971226646 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:46.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.737+0000 7fe260e71700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe25c06a6d0 0x7fe25c1383b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60412/0 (socket says 172.21.15.40:60412) 2023-09-30T22:26:46.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.737+0000 7f83661c9700 1 -- 172.21.15.40:0/1705698283 shutdown_connections 2023-09-30T22:26:46.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.737+0000 7f83661c9700 1 --2- 172.21.15.40:0/1705698283 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f83601373b0 0x7f8360139790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.737+0000 7f83661c9700 1 --2- 172.21.15.40:0/1705698283 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8360134a90 0x7f8360136e70 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.737+0000 7f83661c9700 1 -- 172.21.15.40:0/1705698283 >> 172.21.15.40:0/1705698283 conn(0x7f83600a2a00 msgr2=0x7f83600a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:46.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.737+0000 7fe261672700 1 --2- 172.21.15.40:0/3971226646 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe25c13c490 0x7fe25c138e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.737+0000 7fe25bfff700 1 -- 172.21.15.40:0/3971226646 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe25c06a6d0 msgr2=0x7fe25c1383b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.737+0000 7fe25bfff700 1 --2- 172.21.15.40:0/3971226646 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe25c06a6d0 0x7fe25c1383b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.737+0000 7fe25bfff700 1 -- 172.21.15.40:0/3971226646 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe25c13c490 msgr2=0x7fe25c138e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.737+0000 7fe25bfff700 1 --2- 172.21.15.40:0/3971226646 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe25c13c490 0x7fe25c138e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.737+0000 7fe25bfff700 1 -- 172.21.15.40:0/3971226646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe248009550 con 0x7fe25c09de60 2023-09-30T22:26:46.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.737+0000 7fe260e71700 1 --2- 172.21.15.40:0/3971226646 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe25c06a6d0 0x7fe25c1383b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:46.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.738+0000 7fe25bfff700 1 --2- 172.21.15.40:0/3971226646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe25c09de60 0x7fe25c1388f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe248013000 tx=0x7fe248004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:46.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.738+0000 7f83661c9700 1 -- 172.21.15.40:0/1705698283 shutdown_connections 2023-09-30T22:26:46.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.738+0000 7f83661c9700 1 -- 172.21.15.40:0/1705698283 wait complete. 2023-09-30T22:26:46.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.738+0000 7fe2597fa700 1 -- 172.21.15.40:0/3971226646 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe248004300 con 0x7fe25c09de60 2023-09-30T22:26:46.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.738+0000 7fe2597fa700 1 -- 172.21.15.40:0/3971226646 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24801f070 con 0x7fe25c09de60 2023-09-30T22:26:46.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.738+0000 7fe2630d5700 1 -- 172.21.15.40:0/3971226646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe25c09f540 con 0x7fe25c09de60 2023-09-30T22:26:46.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.738+0000 7fe2597fa700 1 -- 172.21.15.40:0/3971226646 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2480036a0 con 0x7fe25c09de60 2023-09-30T22:26:46.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.738+0000 7fe2630d5700 1 -- 172.21.15.40:0/3971226646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe25c13b700 con 0x7fe25c09de60 2023-09-30T22:26:46.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.739+0000 7f83661c9700 1 Processor -- start 2023-09-30T22:26:46.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.739+0000 7fe2597fa700 1 -- 172.21.15.40:0/3971226646 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe248021030 con 0x7fe25c09de60 2023-09-30T22:26:46.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.739+0000 7fe2630d5700 1 -- 172.21.15.40:0/3971226646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe25c062380 con 0x7fe25c09de60 2023-09-30T22:26:46.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.739+0000 7fe2597fa700 1 -- 172.21.15.40:0/3971226646 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe248040980 con 0x7fe25c09de60 2023-09-30T22:26:46.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.739+0000 7f83661c9700 1 -- start start 2023-09-30T22:26:46.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.740+0000 7f83661c9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8360131d50 0x7f83601cc920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.740+0000 7f83661c9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8360134a90 0x7f83601cce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.740+0000 7f83661c9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83601373b0 0x7f83601cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.740+0000 7f83661c9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8360071020 con 0x7f8360134a90 2023-09-30T22:26:46.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.740+0000 7f83661c9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8360119830 con 0x7f83601373b0 2023-09-30T22:26:46.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.740+0000 7f83661c9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f836006f8c0 con 0x7f8360131d50 2023-09-30T22:26:46.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.740+0000 7f835f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8360131d50 0x7f83601cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.740+0000 7f835f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8360131d50 0x7f83601cc920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60420/0 (socket says 172.21.15.40:60420) 2023-09-30T22:26:46.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.740+0000 7f835f7fe700 1 -- 172.21.15.40:0/916790848 learned_addr learned my addr 172.21.15.40:0/916790848 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:46.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.740+0000 7f835ffff700 1 --2- 172.21.15.40:0/916790848 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83601373b0 0x7f83601cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.740+0000 7f835effd700 1 --2- 172.21.15.40:0/916790848 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8360134a90 0x7f83601cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.741+0000 7f835f7fe700 1 -- 172.21.15.40:0/916790848 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83601373b0 msgr2=0x7f83601cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.741+0000 7f835f7fe700 1 --2- 172.21.15.40:0/916790848 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83601373b0 0x7f83601cd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.741+0000 7f835f7fe700 1 -- 172.21.15.40:0/916790848 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8360134a90 msgr2=0x7f83601cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.741+0000 7f835f7fe700 1 --2- 172.21.15.40:0/916790848 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8360134a90 0x7f83601cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.741+0000 7f835f7fe700 1 -- 172.21.15.40:0/916790848 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83540094a0 con 0x7f8360131d50 2023-09-30T22:26:46.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.741+0000 7f835f7fe700 1 --2- 172.21.15.40:0/916790848 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8360131d50 0x7f83601cc920 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f835000c550 tx=0x7f835000c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:46.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.741+0000 7f8347fff700 1 -- 172.21.15.40:0/916790848 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8350004c80 con 0x7f8360131d50 2023-09-30T22:26:46.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.741+0000 7f83661c9700 1 -- 172.21.15.40:0/916790848 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8360137100 con 0x7f8360131d50 2023-09-30T22:26:46.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.741+0000 7f83661c9700 1 -- 172.21.15.40:0/916790848 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f836006f330 con 0x7f8360131d50 2023-09-30T22:26:46.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.741+0000 7f8347fff700 1 -- 172.21.15.40:0/916790848 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8350004de0 con 0x7f8360131d50 2023-09-30T22:26:46.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.741+0000 7f8347fff700 1 -- 172.21.15.40:0/916790848 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83500072d0 con 0x7f8360131d50 2023-09-30T22:26:46.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.742+0000 7f8347fff700 1 -- 172.21.15.40:0/916790848 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8350007430 con 0x7f8360131d50 2023-09-30T22:26:46.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.742+0000 7f83661c9700 1 -- 172.21.15.40:0/916790848 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83400052e0 con 0x7f8360131d50 2023-09-30T22:26:46.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.742+0000 7f8347fff700 1 -- 172.21.15.40:0/916790848 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f835003f210 con 0x7f8360131d50 2023-09-30T22:26:46.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.747+0000 7fe2597fa700 1 -- 172.21.15.40:0/3971226646 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe248015080 con 0x7fe25c09de60 2023-09-30T22:26:46.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.749+0000 7f8347fff700 1 -- 172.21.15.40:0/916790848 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f83500076e0 con 0x7f8360131d50 2023-09-30T22:26:46.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.884+0000 7f7305899700 1 -- 172.21.15.40:0/3098949499 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7300130c40 con 0x7f730009d920 2023-09-30T22:26:46.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.884+0000 7f72e7fff700 1 -- 172.21.15.40:0/3098949499 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f72f4021070 con 0x7f730009d920 2023-09-30T22:26:46.885 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:46.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.886+0000 7f7305899700 1 -- 172.21.15.40:0/3098949499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f730009d920 msgr2=0x7f730012dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.886+0000 7f7305899700 1 --2- 172.21.15.40:0/3098949499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f730009d920 0x7f730012dc00 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f72f400ebe0 tx=0x7f72f400eef0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.886+0000 7f7305899700 1 -- 172.21.15.40:0/3098949499 shutdown_connections 2023-09-30T22:26:46.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.886+0000 7f7305899700 1 --2- 172.21.15.40:0/3098949499 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f730009c890 0x7f730012d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.886+0000 7f7305899700 1 --2- 172.21.15.40:0/3098949499 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f730009e2b0 0x7f730012e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.886+0000 7f7305899700 1 --2- 172.21.15.40:0/3098949499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f730009d920 0x7f730012dc00 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.886+0000 7f7305899700 1 -- 172.21.15.40:0/3098949499 >> 172.21.15.40:0/3098949499 conn(0x7f73000a7080 msgr2=0x7f73000a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:46.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.887+0000 7f7305899700 1 -- 172.21.15.40:0/3098949499 shutdown_connections 2023-09-30T22:26:46.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.887+0000 7f7305899700 1 -- 172.21.15.40:0/3098949499 wait complete. 2023-09-30T22:26:46.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.896+0000 7f3dbb0f2700 1 -- 172.21.15.40:0/2642406032 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3db4127a10 con 0x7f3db412d6d0 2023-09-30T22:26:46.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.896+0000 7f3db17fa700 1 -- 172.21.15.40:0/2642406032 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3da8021030 con 0x7f3db412d6d0 2023-09-30T22:26:46.897 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:46.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.898+0000 7f3dbb0f2700 1 -- 172.21.15.40:0/2642406032 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3db412d6d0 msgr2=0x7f3db4070280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.898+0000 7f3dbb0f2700 1 --2- 172.21.15.40:0/2642406032 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3db412d6d0 0x7f3db4070280 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3da800e9b0 tx=0x7f3da800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.899+0000 7f3dbb0f2700 1 -- 172.21.15.40:0/2642406032 shutdown_connections 2023-09-30T22:26:46.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.899+0000 7f3dbb0f2700 1 --2- 172.21.15.40:0/2642406032 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3db412d6d0 0x7f3db4070280 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.899+0000 7f3dbb0f2700 1 --2- 172.21.15.40:0/2642406032 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3db412eea0 0x7f3db41c6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.899+0000 7f3dbb0f2700 1 --2- 172.21.15.40:0/2642406032 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3db412e590 0x7f3db40707c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.899+0000 7f3dbb0f2700 1 -- 172.21.15.40:0/2642406032 >> 172.21.15.40:0/2642406032 conn(0x7f3db40a2a00 msgr2=0x7f3db409d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:46.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.899+0000 7f3dbb0f2700 1 -- 172.21.15.40:0/2642406032 shutdown_connections 2023-09-30T22:26:46.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.899+0000 7f3dbb0f2700 1 -- 172.21.15.40:0/2642406032 wait complete. 2023-09-30T22:26:46.901 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:46.912 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:46.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.965+0000 7fe2630d5700 1 -- 172.21.15.40:0/3971226646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe25c074720 con 0x7fe25c09de60 2023-09-30T22:26:46.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.966+0000 7fe2597fa700 1 -- 172.21.15.40:0/3971226646 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe248006d60 con 0x7fe25c09de60 2023-09-30T22:26:46.966 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:46.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.968+0000 7fe2630d5700 1 -- 172.21.15.40:0/3971226646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe25c09de60 msgr2=0x7fe25c1388f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.968+0000 7fe2630d5700 1 --2- 172.21.15.40:0/3971226646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe25c09de60 0x7fe25c1388f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe248013000 tx=0x7fe248004750 comp rx=0 tx=0).stop 2023-09-30T22:26:46.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.968+0000 7fe2630d5700 1 -- 172.21.15.40:0/3971226646 shutdown_connections 2023-09-30T22:26:46.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.968+0000 7fe2630d5700 1 --2- 172.21.15.40:0/3971226646 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe25c06a6d0 0x7fe25c1383b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.968+0000 7fe2630d5700 1 --2- 172.21.15.40:0/3971226646 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe25c13c490 0x7fe25c138e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.968+0000 7fe2630d5700 1 --2- 172.21.15.40:0/3971226646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe25c09de60 0x7fe25c1388f0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.968+0000 7fe2630d5700 1 -- 172.21.15.40:0/3971226646 >> 172.21.15.40:0/3971226646 conn(0x7fe25c09fb20 msgr2=0x7fe25c070620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:46.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.968+0000 7fe2630d5700 1 -- 172.21.15.40:0/3971226646 shutdown_connections 2023-09-30T22:26:46.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.968+0000 7fe2630d5700 1 -- 172.21.15.40:0/3971226646 wait complete. 2023-09-30T22:26:46.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.971+0000 7f83661c9700 1 -- 172.21.15.40:0/916790848 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8340005590 con 0x7f8360131d50 2023-09-30T22:26:46.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.971+0000 7f8347fff700 1 -- 172.21.15.40:0/916790848 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f835001c390 con 0x7f8360131d50 2023-09-30T22:26:46.972 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:46.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.973+0000 7f83661c9700 1 -- 172.21.15.40:0/916790848 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8360131d50 msgr2=0x7f83601cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.973+0000 7f83661c9700 1 --2- 172.21.15.40:0/916790848 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8360131d50 0x7f83601cc920 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f835000c550 tx=0x7f835000c860 comp rx=0 tx=0).stop 2023-09-30T22:26:46.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.974+0000 7f83661c9700 1 -- 172.21.15.40:0/916790848 shutdown_connections 2023-09-30T22:26:46.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.974+0000 7f83661c9700 1 --2- 172.21.15.40:0/916790848 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8360131d50 0x7f83601cc920 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.974+0000 7f83661c9700 1 --2- 172.21.15.40:0/916790848 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83601373b0 0x7f83601cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.974+0000 7f83661c9700 1 --2- 172.21.15.40:0/916790848 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8360134a90 0x7f83601cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.974+0000 7f83661c9700 1 -- 172.21.15.40:0/916790848 >> 172.21.15.40:0/916790848 conn(0x7f83600a2a00 msgr2=0x7f836009f360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:46.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.974+0000 7f83661c9700 1 -- 172.21.15.40:0/916790848 shutdown_connections 2023-09-30T22:26:46.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:46.974+0000 7f83661c9700 1 -- 172.21.15.40:0/916790848 wait complete. 2023-09-30T22:26:46.982 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:46.986 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:47.902 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:47.913 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:47.982 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:47.987 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:48.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.053+0000 7f4ef9ffa700 1 Processor -- start 2023-09-30T22:26:48.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.053+0000 7f4ef9ffa700 1 -- start start 2023-09-30T22:26:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.054+0000 7f4ef9ffa700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ef406d0a0 0x7f4ef406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.054+0000 7f4ef9ffa700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4ef4139380 0x7f4ef413b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.054+0000 7f4ef9ffa700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef406e3f0 con 0x7f4ef409fbb0 2023-09-30T22:26:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.054+0000 7f4ef9ffa700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef409ff80 con 0x7f4ef4139380 2023-09-30T22:26:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.054+0000 7f4ef9ffa700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef406ec40 con 0x7f4ef406d0a0 2023-09-30T22:26:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.054+0000 7f4ef3fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4ef4139380 0x7f4ef413b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.054+0000 7f4ef37fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f4ef409fbb0 0x7f4ef406c990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60630/0 (socket says 172.21.15.40:60630) 2023-09-30T22:26:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.054+0000 7f4ef2ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ef406d0a0 0x7f4ef406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.054+0000 7f4ef37fe700 1 -- 172.21.15.40:0/442830165 learned_addr learned my addr 172.21.15.40:0/442830165 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.054+0000 7f4ef3fff700 1 -- 172.21.15.40:0/442830165 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ef406d0a0 msgr2=0x7f4ef406d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:48.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.055+0000 7f4ef3fff700 1 --2- 172.21.15.40:0/442830165 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ef406d0a0 0x7f4ef406d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.055+0000 7f4ef3fff700 1 -- 172.21.15.40:0/442830165 >> v1:172.21.15.40:6789/0 conn(0x7f4ef409fbb0 legacy=0x7f4ef406c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.055+0000 7f4ef27fc700 1 -- 172.21.15.40:0/442830165 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3520510804 0 0) 0x7f4ef406e3f0 con 0x7f4ef409fbb0 2023-09-30T22:26:48.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.055+0000 7f4ef3fff700 1 -- 172.21.15.40:0/442830165 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef406d9f0 con 0x7f4ef4139380 2023-09-30T22:26:48.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.055+0000 7f4ef2ffd700 1 --2- 172.21.15.40:0/442830165 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ef406d0a0 0x7f4ef406d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:48.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.055+0000 7f4ef3fff700 1 --2- 172.21.15.40:0/442830165 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ef4139380 0x7f4ef413b760 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f4eec009d90 tx=0x7f4eec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed34513256c6a6a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:48.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.055+0000 7f4ef27fc700 1 -- 172.21.15.40:0/442830165 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eec00e070 con 0x7f4ef4139380 2023-09-30T22:26:48.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.055+0000 7f4ef27fc700 1 -- 172.21.15.40:0/442830165 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eec00bb20 con 0x7f4ef4139380 2023-09-30T22:26:48.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.055+0000 7f4ef27fc700 1 -- 172.21.15.40:0/442830165 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eec012430 con 0x7f4ef4139380 2023-09-30T22:26:48.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.056+0000 7f4ef9ffa700 1 -- 172.21.15.40:0/442830165 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ef4139380 msgr2=0x7f4ef413b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.056+0000 7f4ef9ffa700 1 --2- 172.21.15.40:0/442830165 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ef4139380 0x7f4ef413b760 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f4eec009d90 tx=0x7f4eec00b330 comp rx=0 tx=0).stop 2023-09-30T22:26:48.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.056+0000 7f4ef9ffa700 1 -- 172.21.15.40:0/442830165 shutdown_connections 2023-09-30T22:26:48.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.056+0000 7f4ef9ffa700 1 --2- 172.21.15.40:0/442830165 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ef4139380 0x7f4ef413b760 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.056+0000 7f4ef9ffa700 1 --2- 172.21.15.40:0/442830165 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ef406d0a0 0x7f4ef406d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.056+0000 7f4ef9ffa700 1 -- 172.21.15.40:0/442830165 >> 172.21.15.40:0/442830165 conn(0x7f4ef40a41a0 msgr2=0x7f4ef40a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:48.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.056+0000 7f4ef9ffa700 1 -- 172.21.15.40:0/442830165 shutdown_connections 2023-09-30T22:26:48.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.056+0000 7f4ef9ffa700 1 -- 172.21.15.40:0/442830165 wait complete. 2023-09-30T22:26:48.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.057+0000 7f4ef9ffa700 1 Processor -- start 2023-09-30T22:26:48.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.057+0000 7f4ef9ffa700 1 -- start start 2023-09-30T22:26:48.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.057+0000 7f4ef9ffa700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ef406d0a0 0x7f4ef4138390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.058+0000 7f4ef9ffa700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ef409fbb0 0x7f4ef41388d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.058+0000 7f4ef9ffa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ef4139380 0x7f4ef4138e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.058+0000 7f4ef9ffa700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef4090910 con 0x7f4ef406d0a0 2023-09-30T22:26:48.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.058+0000 7f4ef9ffa700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef4091b60 con 0x7f4ef4139380 2023-09-30T22:26:48.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.058+0000 7f4ef9ffa700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef4091170 con 0x7f4ef409fbb0 2023-09-30T22:26:48.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.058+0000 7f4ef37fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ef406d0a0 0x7f4ef4138390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:48.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.058+0000 7f4ef37fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ef406d0a0 0x7f4ef4138390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49078/0 (socket says 172.21.15.40:49078) 2023-09-30T22:26:48.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.058+0000 7f4ef37fe700 1 -- 172.21.15.40:0/4179972783 learned_addr learned my addr 172.21.15.40:0/4179972783 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:48.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.058+0000 7f4ef3fff700 1 --2- 172.21.15.40:0/4179972783 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ef4139380 0x7f4ef4138e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:48.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.058+0000 7f4ef3fff700 1 -- 172.21.15.40:0/4179972783 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ef409fbb0 msgr2=0x7f4ef41388d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.058+0000 7f4ef3fff700 1 --2- 172.21.15.40:0/4179972783 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ef409fbb0 0x7f4ef41388d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.058+0000 7f4ef3fff700 1 -- 172.21.15.40:0/4179972783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ef406d0a0 msgr2=0x7f4ef4138390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.058+0000 7f4ef3fff700 1 --2- 172.21.15.40:0/4179972783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ef406d0a0 0x7f4ef4138390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.058+0000 7f4ef3fff700 1 -- 172.21.15.40:0/4179972783 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee80094a0 con 0x7f4ef4139380 2023-09-30T22:26:48.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.058+0000 7f4ef3fff700 1 --2- 172.21.15.40:0/4179972783 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ef4139380 0x7f4ef4138e10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4067ed0 tx=0x7f4eec004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:48.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.059+0000 7f4edbfff700 1 -- 172.21.15.40:0/4179972783 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eec012430 con 0x7f4ef4139380 2023-09-30T22:26:48.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.059+0000 7f4edbfff700 1 -- 172.21.15.40:0/4179972783 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eec020070 con 0x7f4ef4139380 2023-09-30T22:26:48.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.059+0000 7f4ef9ffa700 1 -- 172.21.15.40:0/4179972783 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eec009a70 con 0x7f4ef4139380 2023-09-30T22:26:48.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.059+0000 7f4edbfff700 1 -- 172.21.15.40:0/4179972783 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eec004280 con 0x7f4ef4139380 2023-09-30T22:26:48.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.059+0000 7f4ef9ffa700 1 -- 172.21.15.40:0/4179972783 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef4097f10 con 0x7f4ef4139380 2023-09-30T22:26:48.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.060+0000 7f4ef9ffa700 1 -- 172.21.15.40:0/4179972783 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef40a3270 con 0x7f4ef4139380 2023-09-30T22:26:48.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.061+0000 7f4edbfff700 1 -- 172.21.15.40:0/4179972783 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4eec0043e0 con 0x7f4ef4139380 2023-09-30T22:26:48.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.061+0000 7f4edbfff700 1 -- 172.21.15.40:0/4179972783 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4eec022070 con 0x7f4ef4139380 2023-09-30T22:26:48.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.065+0000 7f4edbfff700 1 -- 172.21.15.40:0/4179972783 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4eec0048d0 con 0x7f4ef4139380 2023-09-30T22:26:48.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.089+0000 7fb70d363700 1 Processor -- start 2023-09-30T22:26:48.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.089+0000 7fb70d363700 1 -- start start 2023-09-30T22:26:48.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.090+0000 7fb70d363700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb70809e400 0x7fb708135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.090+0000 7fb70d363700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb708136230 0x7fb708138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.090+0000 7fb70d363700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb70809adf0 con 0x7fb70809d920 2023-09-30T22:26:48.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.090+0000 7fb70d363700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb70809edf0 con 0x7fb70809e400 2023-09-30T22:26:48.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.090+0000 7fb70d363700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb70809b660 con 0x7fb708136230 2023-09-30T22:26:48.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.090+0000 7fb7067fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb70809e400 0x7fb708135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:48.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.090+0000 7fb7067fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb70809e400 0x7fb708135cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49080/0 (socket says 172.21.15.40:49080) 2023-09-30T22:26:48.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.090+0000 7fb7077fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb708136230 0x7fb708138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:48.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.090+0000 7fb7067fc700 1 -- 172.21.15.40:0/2660594488 learned_addr learned my addr 172.21.15.40:0/2660594488 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:48.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.090+0000 7fb7077fe700 1 -- 172.21.15.40:0/2660594488 >> v2:172.21.15.40:3300/0 conn(0x7fb70809e400 msgr2=0x7fb708135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:48.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.090+0000 7fb7077fe700 1 --2- 172.21.15.40:0/2660594488 >> v2:172.21.15.40:3300/0 conn(0x7fb70809e400 0x7fb708135cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.090+0000 7fb7077fe700 1 -- 172.21.15.40:0/2660594488 >> v1:172.21.15.40:6789/0 conn(0x7fb70809d920 legacy=0x7fb70809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.090+0000 7fb705ffb700 1 -- 172.21.15.40:0/2660594488 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 266383166 0 0) 0x7fb70809adf0 con 0x7fb70809d920 2023-09-30T22:26:48.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.090+0000 7fb7077fe700 1 -- 172.21.15.40:0/2660594488 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb70809a6e0 con 0x7fb708136230 2023-09-30T22:26:48.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.090+0000 7fb7067fc700 1 --2- 172.21.15.40:0/2660594488 >> v2:172.21.15.40:3300/0 conn(0x7fb70809e400 0x7fb708135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:48.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.090+0000 7fb7077fe700 1 --2- 172.21.15.40:0/2660594488 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb708136230 0x7fb708138610 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb70000f370 tx=0x7fb70000f680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fd2312de1ed75a6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:48.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.091+0000 7fb705ffb700 1 -- 172.21.15.40:0/2660594488 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb700012070 con 0x7fb708136230 2023-09-30T22:26:48.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.091+0000 7fb705ffb700 1 -- 172.21.15.40:0/2660594488 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70000fe70 con 0x7fb708136230 2023-09-30T22:26:48.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.091+0000 7fb705ffb700 1 -- 172.21.15.40:0/2660594488 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70000d2f0 con 0x7fb708136230 2023-09-30T22:26:48.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.091+0000 7fb70d363700 1 -- 172.21.15.40:0/2660594488 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb708136230 msgr2=0x7fb708138610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.091+0000 7fb70d363700 1 --2- 172.21.15.40:0/2660594488 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb708136230 0x7fb708138610 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb70000f370 tx=0x7fb70000f680 comp rx=0 tx=0).stop 2023-09-30T22:26:48.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.091+0000 7fb70d363700 1 -- 172.21.15.40:0/2660594488 shutdown_connections 2023-09-30T22:26:48.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.091+0000 7fb70d363700 1 --2- 172.21.15.40:0/2660594488 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb708136230 0x7fb708138610 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.091+0000 7fb70d363700 1 --2- 172.21.15.40:0/2660594488 >> v2:172.21.15.40:3300/0 conn(0x7fb70809e400 0x7fb708135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.091+0000 7fb70d363700 1 -- 172.21.15.40:0/2660594488 >> 172.21.15.40:0/2660594488 conn(0x7fb70809fb20 msgr2=0x7fb70809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:48.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.091+0000 7fb70d363700 1 -- 172.21.15.40:0/2660594488 shutdown_connections 2023-09-30T22:26:48.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.091+0000 7fb70d363700 1 -- 172.21.15.40:0/2660594488 wait complete. 2023-09-30T22:26:48.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.093+0000 7fb70d363700 1 Processor -- start 2023-09-30T22:26:48.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.093+0000 7fb70d363700 1 -- start start 2023-09-30T22:26:48.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.094+0000 7fb70d363700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb70809d920 0x7fb70811e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.094+0000 7fb70d363700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb70809e400 0x7fb70811ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.094+0000 7fb70d363700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb708136230 0x7fb70811ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.094+0000 7fb70d363700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70811f960 con 0x7fb70809e400 2023-09-30T22:26:48.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.094+0000 7fb70d363700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb708120290 con 0x7fb708136230 2023-09-30T22:26:48.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.094+0000 7fb70d363700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb70809cb00 con 0x7fb70809d920 2023-09-30T22:26:48.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.094+0000 7fb706ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb70809d920 0x7fb70811e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:48.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.094+0000 7fb7077fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb708136230 0x7fb70811ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:48.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.094+0000 7fb706ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb70809d920 0x7fb70811e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60444/0 (socket says 172.21.15.40:60444) 2023-09-30T22:26:48.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.094+0000 7fb706ffd700 1 -- 172.21.15.40:0/1770297096 learned_addr learned my addr 172.21.15.40:0/1770297096 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:48.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.094+0000 7fb7067fc700 1 --2- 172.21.15.40:0/1770297096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb70809e400 0x7fb70811ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:48.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.094+0000 7fb7077fe700 1 -- 172.21.15.40:0/1770297096 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb70809d920 msgr2=0x7fb70811e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.094+0000 7fb7077fe700 1 --2- 172.21.15.40:0/1770297096 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb70809d920 0x7fb70811e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.094+0000 7fb7077fe700 1 -- 172.21.15.40:0/1770297096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb70809e400 msgr2=0x7fb70811ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.094+0000 7fb7077fe700 1 --2- 172.21.15.40:0/1770297096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb70809e400 0x7fb70811ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.094+0000 7fb7077fe700 1 -- 172.21.15.40:0/1770297096 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6fc00b600 con 0x7fb708136230 2023-09-30T22:26:48.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.094+0000 7fb7077fe700 1 --2- 172.21.15.40:0/1770297096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb708136230 0x7fb70811ef80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb700019000 tx=0x7fb700004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:48.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.095+0000 7fb6ef7fe700 1 -- 172.21.15.40:0/1770297096 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70000bb50 con 0x7fb708136230 2023-09-30T22:26:48.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.095+0000 7fb6ef7fe700 1 -- 172.21.15.40:0/1770297096 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70000bcb0 con 0x7fb708136230 2023-09-30T22:26:48.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.095+0000 7fb70d363700 1 -- 172.21.15.40:0/1770297096 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb70000f050 con 0x7fb708136230 2023-09-30T22:26:48.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.095+0000 7fb6ef7fe700 1 -- 172.21.15.40:0/1770297096 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb700004240 con 0x7fb708136230 2023-09-30T22:26:48.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.095+0000 7fb70d363700 1 -- 172.21.15.40:0/1770297096 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb708121360 con 0x7fb708136230 2023-09-30T22:26:48.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.096+0000 7fb6ef7fe700 1 -- 172.21.15.40:0/1770297096 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb7000043a0 con 0x7fb708136230 2023-09-30T22:26:48.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.096+0000 7fb6ef7fe700 1 -- 172.21.15.40:0/1770297096 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb700045810 con 0x7fb708136230 2023-09-30T22:26:48.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.096+0000 7fb70d363700 1 -- 172.21.15.40:0/1770297096 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb708062380 con 0x7fb708136230 2023-09-30T22:26:48.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.101+0000 7fb6ef7fe700 1 -- 172.21.15.40:0/1770297096 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb70002e080 con 0x7fb708136230 2023-09-30T22:26:48.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.133+0000 7f822abda700 1 Processor -- start 2023-09-30T22:26:48.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.133+0000 7f822abda700 1 -- start start 2023-09-30T22:26:48.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.134+0000 7f822abda700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f822409c890 0x7f822409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.134+0000 7f822abda700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f822409e480 0x7f822413bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.134+0000 7f822abda700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82240a2600 con 0x7f822409d920 2023-09-30T22:26:48.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.134+0000 7f822abda700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82240a29d0 con 0x7f822409e480 2023-09-30T22:26:48.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.134+0000 7f822abda700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f822409fb40 con 0x7f822409c890 2023-09-30T22:26:48.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.134+0000 7f8223fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f822409d920 0x7f822409dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60660/0 (socket says 172.21.15.40:60660) 2023-09-30T22:26:48.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.134+0000 7f8228976700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f822409c890 0x7f822409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:48.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.134+0000 7f8223fff700 1 -- 172.21.15.40:0/279586891 learned_addr learned my addr 172.21.15.40:0/279586891 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:48.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.134+0000 7f8229177700 1 --2- 172.21.15.40:0/279586891 >> v2:172.21.15.40:3300/0 conn(0x7f822409e480 0x7f822413bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:48.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.134+0000 7f82237fe700 1 -- 172.21.15.40:0/279586891 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1057002506 0 0) 0x7f82240a2600 con 0x7f822409d920 2023-09-30T22:26:48.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.134+0000 7f82237fe700 1 -- 172.21.15.40:0/279586891 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82140035b0 con 0x7f822409d920 2023-09-30T22:26:48.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.134+0000 7f8229177700 1 -- 172.21.15.40:0/279586891 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f822409c890 msgr2=0x7f822409cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:48.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.134+0000 7f8229177700 1 --2- 172.21.15.40:0/279586891 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f822409c890 0x7f822409cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.135+0000 7f8229177700 1 -- 172.21.15.40:0/279586891 >> v1:172.21.15.40:6789/0 conn(0x7f822409d920 legacy=0x7f822409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.135+0000 7f8229177700 1 -- 172.21.15.40:0/279586891 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f822409fed0 con 0x7f822409e480 2023-09-30T22:26:48.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.135+0000 7f8229177700 1 --2- 172.21.15.40:0/279586891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f822409e480 0x7f822413bc20 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f821c009d90 tx=0x7f821c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f0a907e612c03b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:48.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.135+0000 7f8228976700 1 --2- 172.21.15.40:0/279586891 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f822409c890 0x7f822409cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:48.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.135+0000 7f82237fe700 1 -- 172.21.15.40:0/279586891 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821c00e070 con 0x7f822409e480 2023-09-30T22:26:48.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.135+0000 7f82237fe700 1 -- 172.21.15.40:0/279586891 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821c00bb20 con 0x7f822409e480 2023-09-30T22:26:48.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.135+0000 7f82237fe700 1 -- 172.21.15.40:0/279586891 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821c012430 con 0x7f822409e480 2023-09-30T22:26:48.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.136+0000 7f822abda700 1 -- 172.21.15.40:0/279586891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f822409e480 msgr2=0x7f822413bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.136+0000 7f822abda700 1 --2- 172.21.15.40:0/279586891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f822409e480 0x7f822413bc20 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f821c009d90 tx=0x7f821c00b330 comp rx=0 tx=0).stop 2023-09-30T22:26:48.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.136+0000 7f822abda700 1 -- 172.21.15.40:0/279586891 shutdown_connections 2023-09-30T22:26:48.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.136+0000 7f822abda700 1 --2- 172.21.15.40:0/279586891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f822409e480 0x7f822413bc20 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.136+0000 7f822abda700 1 --2- 172.21.15.40:0/279586891 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f822409c890 0x7f822409cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.136+0000 7f822abda700 1 -- 172.21.15.40:0/279586891 >> 172.21.15.40:0/279586891 conn(0x7f82240a7080 msgr2=0x7f82240a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:48.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.136+0000 7f822abda700 1 -- 172.21.15.40:0/279586891 shutdown_connections 2023-09-30T22:26:48.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.136+0000 7f822abda700 1 -- 172.21.15.40:0/279586891 wait complete. 2023-09-30T22:26:48.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.137+0000 7f822abda700 1 Processor -- start 2023-09-30T22:26:48.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.137+0000 7f822abda700 1 -- start start 2023-09-30T22:26:48.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.138+0000 7f822abda700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f822409c890 0x7f822412d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.138+0000 7f822abda700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f822409d920 0x7f822412daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.138+0000 7f822abda700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f822409e480 0x7f822412e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.138+0000 7f822abda700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822409bfe0 con 0x7f822409d920 2023-09-30T22:26:48.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.138+0000 7f822abda700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f822408f480 con 0x7f822409c890 2023-09-30T22:26:48.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.138+0000 7f822abda700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f822409ecf0 con 0x7f822409e480 2023-09-30T22:26:48.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.138+0000 7f8229177700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f822409e480 0x7f822412e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:48.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.138+0000 7f8229177700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f822409e480 0x7f822412e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60472/0 (socket says 172.21.15.40:60472) 2023-09-30T22:26:48.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.138+0000 7f8229177700 1 -- 172.21.15.40:0/1307287529 learned_addr learned my addr 172.21.15.40:0/1307287529 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:48.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.138+0000 7f8228976700 1 --2- 172.21.15.40:0/1307287529 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f822409c890 0x7f822412d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:48.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.139+0000 7f8229177700 1 -- 172.21.15.40:0/1307287529 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f822409c890 msgr2=0x7f822412d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.139+0000 7f8229177700 1 --2- 172.21.15.40:0/1307287529 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f822409c890 0x7f822412d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.139+0000 7f8229177700 1 -- 172.21.15.40:0/1307287529 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f822409d920 msgr2=0x7f822412daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.139+0000 7f8229177700 1 --2- 172.21.15.40:0/1307287529 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f822409d920 0x7f822412daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.139+0000 7f8229177700 1 -- 172.21.15.40:0/1307287529 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8218009430 con 0x7f822409e480 2023-09-30T22:26:48.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.139+0000 7f8229177700 1 --2- 172.21.15.40:0/1307287529 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f822409e480 0x7f822412e030 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f82240684e0 tx=0x7f821c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:48.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.139+0000 7f82217fa700 1 -- 172.21.15.40:0/1307287529 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821c012430 con 0x7f822409e480 2023-09-30T22:26:48.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.139+0000 7f82217fa700 1 -- 172.21.15.40:0/1307287529 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821c004470 con 0x7f822409e480 2023-09-30T22:26:48.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.139+0000 7f822abda700 1 -- 172.21.15.40:0/1307287529 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f821c009a70 con 0x7f822409e480 2023-09-30T22:26:48.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.139+0000 7f82217fa700 1 -- 172.21.15.40:0/1307287529 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821c004820 con 0x7f822409e480 2023-09-30T22:26:48.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.139+0000 7f822abda700 1 -- 172.21.15.40:0/1307287529 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f822412e570 con 0x7f822409e480 2023-09-30T22:26:48.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.140+0000 7f82217fa700 1 -- 172.21.15.40:0/1307287529 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f821c01c400 con 0x7f822409e480 2023-09-30T22:26:48.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.140+0000 7f82217fa700 1 -- 172.21.15.40:0/1307287529 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f821c041910 con 0x7f822409e480 2023-09-30T22:26:48.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.140+0000 7f822abda700 1 -- 172.21.15.40:0/1307287529 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82240a5610 con 0x7f822409e480 2023-09-30T22:26:48.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.145+0000 7f82217fa700 1 -- 172.21.15.40:0/1307287529 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f821c01c6b0 con 0x7f822409e480 2023-09-30T22:26:48.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.165+0000 7fe6221e4700 1 Processor -- start 2023-09-30T22:26:48.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.165+0000 7fe6221e4700 1 -- start start 2023-09-30T22:26:48.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.166+0000 7fe6221e4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe61c06f070 0x7fe61c06f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.166+0000 7fe6221e4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe61c06f980 0x7fe61c097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.166+0000 7fe6221e4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe61c06fdb0 0x7fe61c0975d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.166+0000 7fe6221e4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe61c071af0 con 0x7fe61c06fdb0 2023-09-30T22:26:48.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.166+0000 7fe6221e4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c070830 con 0x7fe61c06f070 2023-09-30T22:26:48.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.166+0000 7fe6221e4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c070ad0 con 0x7fe61c06f980 2023-09-30T22:26:48.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.166+0000 7fe61bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe61c06fdb0 0x7fe61c0975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:48.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.166+0000 7fe61bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe61c06fdb0 0x7fe61c0975d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49122/0 (socket says 172.21.15.40:49122) 2023-09-30T22:26:48.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.166+0000 7fe61bfff700 1 -- 172.21.15.40:0/1045873562 learned_addr learned my addr 172.21.15.40:0/1045873562 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:48.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.166+0000 7fe61affd700 1 --2- 172.21.15.40:0/1045873562 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe61c06f980 0x7fe61c097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:48.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.166+0000 7fe61b7fe700 1 --2- 172.21.15.40:0/1045873562 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe61c06f070 0x7fe61c06f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:48.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.167+0000 7fe61bfff700 1 -- 172.21.15.40:0/1045873562 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe61c06f980 msgr2=0x7fe61c097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:48.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.167+0000 7fe61bfff700 1 --2- 172.21.15.40:0/1045873562 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe61c06f980 0x7fe61c097090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.167+0000 7fe61bfff700 1 -- 172.21.15.40:0/1045873562 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe61c06f070 msgr2=0x7fe61c06f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:48.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.167+0000 7fe61bfff700 1 --2- 172.21.15.40:0/1045873562 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe61c06f070 0x7fe61c06f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.167+0000 7fe61bfff700 1 -- 172.21.15.40:0/1045873562 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe61c070de0 con 0x7fe61c06fdb0 2023-09-30T22:26:48.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.167+0000 7fe61bfff700 1 --2- 172.21.15.40:0/1045873562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe61c06fdb0 0x7fe61c0975d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fe614009e50 tx=0x7fe61400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d523c161684e35cd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:48.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.167+0000 7fe61a7fc700 1 -- 172.21.15.40:0/1045873562 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61400e070 con 0x7fe61c06fdb0 2023-09-30T22:26:48.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.167+0000 7fe61a7fc700 1 -- 172.21.15.40:0/1045873562 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61400b910 con 0x7fe61c06fdb0 2023-09-30T22:26:48.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.167+0000 7fe61a7fc700 1 -- 172.21.15.40:0/1045873562 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61400bcc0 con 0x7fe61c06fdb0 2023-09-30T22:26:48.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.168+0000 7fe6221e4700 1 -- 172.21.15.40:0/1045873562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe61c06fdb0 msgr2=0x7fe61c0975d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.168+0000 7fe6221e4700 1 --2- 172.21.15.40:0/1045873562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe61c06fdb0 0x7fe61c0975d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fe614009e50 tx=0x7fe61400b330 comp rx=0 tx=0).stop 2023-09-30T22:26:48.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.168+0000 7fe6221e4700 1 -- 172.21.15.40:0/1045873562 shutdown_connections 2023-09-30T22:26:48.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.168+0000 7fe6221e4700 1 --2- 172.21.15.40:0/1045873562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe61c06fdb0 0x7fe61c0975d0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.168+0000 7fe6221e4700 1 --2- 172.21.15.40:0/1045873562 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe61c06f070 0x7fe61c06f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.168+0000 7fe6221e4700 1 --2- 172.21.15.40:0/1045873562 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe61c06f980 0x7fe61c097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.168+0000 7fe6221e4700 1 -- 172.21.15.40:0/1045873562 >> 172.21.15.40:0/1045873562 conn(0x7fe61c0a41a0 msgr2=0x7fe61c0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:48.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.168+0000 7fe6221e4700 1 -- 172.21.15.40:0/1045873562 shutdown_connections 2023-09-30T22:26:48.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.168+0000 7fe6221e4700 1 -- 172.21.15.40:0/1045873562 wait complete. 2023-09-30T22:26:48.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.169+0000 7fe6221e4700 1 Processor -- start 2023-09-30T22:26:48.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.169+0000 7fe6221e4700 1 -- start start 2023-09-30T22:26:48.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.170+0000 7fe6221e4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe61c06f070 0x7fe61c06c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.170+0000 7fe6221e4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe61c06f980 0x7fe61c06ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.170+0000 7fe6221e4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe61c06fdb0 0x7fe61c06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.170+0000 7fe6221e4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c1324f0 con 0x7fe61c06f980 2023-09-30T22:26:48.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.170+0000 7fe6221e4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c08b530 con 0x7fe61c06f070 2023-09-30T22:26:48.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.170+0000 7fe6221e4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c09af50 con 0x7fe61c06fdb0 2023-09-30T22:26:48.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.170+0000 7fe61bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe61c06fdb0 0x7fe61c06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:48.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.170+0000 7fe61bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe61c06fdb0 0x7fe61c06d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60498/0 (socket says 172.21.15.40:60498) 2023-09-30T22:26:48.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.170+0000 7fe61b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe61c06f070 0x7fe61c06c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:48.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.170+0000 7fe61bfff700 1 -- 172.21.15.40:0/74457000 learned_addr learned my addr 172.21.15.40:0/74457000 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:48.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.170+0000 7fe61affd700 1 --2- 172.21.15.40:0/74457000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe61c06f980 0x7fe61c06ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:48.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.171+0000 7fe61bfff700 1 -- 172.21.15.40:0/74457000 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe61c06f070 msgr2=0x7fe61c06c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.171+0000 7fe61bfff700 1 --2- 172.21.15.40:0/74457000 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe61c06f070 0x7fe61c06c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.171+0000 7fe61bfff700 1 -- 172.21.15.40:0/74457000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe61c06f980 msgr2=0x7fe61c06ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.171+0000 7fe61bfff700 1 --2- 172.21.15.40:0/74457000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe61c06f980 0x7fe61c06ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.171+0000 7fe61bfff700 1 -- 172.21.15.40:0/74457000 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe614009b30 con 0x7fe61c06fdb0 2023-09-30T22:26:48.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.171+0000 7fe61b7fe700 1 --2- 172.21.15.40:0/74457000 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe61c06f070 0x7fe61c06c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:48.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.171+0000 7fe61bfff700 1 --2- 172.21.15.40:0/74457000 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe61c06fdb0 0x7fe61c06d410 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe61400b680 tx=0x7fe614004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:48.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.171+0000 7fe603fff700 1 -- 172.21.15.40:0/74457000 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe614004450 con 0x7fe61c06fdb0 2023-09-30T22:26:48.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.171+0000 7fe603fff700 1 -- 172.21.15.40:0/74457000 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6140045d0 con 0x7fe61c06fdb0 2023-09-30T22:26:48.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.171+0000 7fe6221e4700 1 -- 172.21.15.40:0/74457000 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe61c06e890 con 0x7fe61c06fdb0 2023-09-30T22:26:48.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.171+0000 7fe603fff700 1 -- 172.21.15.40:0/74457000 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6140099b0 con 0x7fe61c06fdb0 2023-09-30T22:26:48.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.171+0000 7fe6221e4700 1 -- 172.21.15.40:0/74457000 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe61c12c330 con 0x7fe61c06fdb0 2023-09-30T22:26:48.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.173+0000 7fe6221e4700 1 -- 172.21.15.40:0/74457000 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe61c062380 con 0x7fe61c06fdb0 2023-09-30T22:26:48.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.173+0000 7fe603fff700 1 -- 172.21.15.40:0/74457000 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe61401c410 con 0x7fe61c06fdb0 2023-09-30T22:26:48.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.174+0000 7fe603fff700 1 -- 172.21.15.40:0/74457000 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe614040eb0 con 0x7fe61c06fdb0 2023-09-30T22:26:48.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.182+0000 7fe603fff700 1 -- 172.21.15.40:0/74457000 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe61402d350 con 0x7fe61c06fdb0 2023-09-30T22:26:48.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.306+0000 7fb70d363700 1 -- 172.21.15.40:0/1770297096 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb708074720 con 0x7fb708136230 2023-09-30T22:26:48.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.307+0000 7fb6ef7fe700 1 -- 172.21.15.40:0/1770297096 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb700038090 con 0x7fb708136230 2023-09-30T22:26:48.308 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:48.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.310+0000 7fb70d363700 1 -- 172.21.15.40:0/1770297096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb708136230 msgr2=0x7fb70811ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.310+0000 7fb70d363700 1 --2- 172.21.15.40:0/1770297096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb708136230 0x7fb70811ef80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb700019000 tx=0x7fb700004ad0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.310+0000 7fb70d363700 1 -- 172.21.15.40:0/1770297096 shutdown_connections 2023-09-30T22:26:48.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.310+0000 7fb70d363700 1 --2- 172.21.15.40:0/1770297096 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb70809d920 0x7fb70811e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.310+0000 7fb70d363700 1 --2- 172.21.15.40:0/1770297096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb708136230 0x7fb70811ef80 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.310+0000 7fb70d363700 1 --2- 172.21.15.40:0/1770297096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb70809e400 0x7fb70811ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.310+0000 7fb70d363700 1 -- 172.21.15.40:0/1770297096 >> 172.21.15.40:0/1770297096 conn(0x7fb70809fb20 msgr2=0x7fb7080703f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:48.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.310+0000 7fb70d363700 1 -- 172.21.15.40:0/1770297096 shutdown_connections 2023-09-30T22:26:48.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.310+0000 7fb70d363700 1 -- 172.21.15.40:0/1770297096 wait complete. 2023-09-30T22:26:48.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.316+0000 7f4ef9ffa700 1 -- 172.21.15.40:0/4179972783 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4ef4071db0 con 0x7f4ef4139380 2023-09-30T22:26:48.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.316+0000 7f4edbfff700 1 -- 172.21.15.40:0/4179972783 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4eec035090 con 0x7f4ef4139380 2023-09-30T22:26:48.316 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:48.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.318+0000 7f4ef9ffa700 1 -- 172.21.15.40:0/4179972783 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ef4139380 msgr2=0x7f4ef4138e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.318+0000 7f4ef9ffa700 1 --2- 172.21.15.40:0/4179972783 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ef4139380 0x7f4ef4138e10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4067ed0 tx=0x7f4eec004ad0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.318+0000 7f4ef9ffa700 1 -- 172.21.15.40:0/4179972783 shutdown_connections 2023-09-30T22:26:48.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.318+0000 7f4ef9ffa700 1 --2- 172.21.15.40:0/4179972783 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ef4139380 0x7f4ef4138e10 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.318+0000 7f4ef9ffa700 1 --2- 172.21.15.40:0/4179972783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ef406d0a0 0x7f4ef4138390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.318+0000 7f4ef9ffa700 1 --2- 172.21.15.40:0/4179972783 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ef409fbb0 0x7f4ef41388d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.318+0000 7f4ef9ffa700 1 -- 172.21.15.40:0/4179972783 >> 172.21.15.40:0/4179972783 conn(0x7f4ef40a41a0 msgr2=0x7f4ef413b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:48.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.318+0000 7f4ef9ffa700 1 -- 172.21.15.40:0/4179972783 shutdown_connections 2023-09-30T22:26:48.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.319+0000 7f4ef9ffa700 1 -- 172.21.15.40:0/4179972783 wait complete. 2023-09-30T22:26:48.324 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:48.337 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:48.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.352+0000 7f822abda700 1 -- 172.21.15.40:0/1307287529 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8224062380 con 0x7f822409e480 2023-09-30T22:26:48.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.352+0000 7f82217fa700 1 -- 172.21.15.40:0/1307287529 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f821c035090 con 0x7f822409e480 2023-09-30T22:26:48.354 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:48.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.354+0000 7f822abda700 1 -- 172.21.15.40:0/1307287529 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f822409e480 msgr2=0x7f822412e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.354+0000 7f822abda700 1 --2- 172.21.15.40:0/1307287529 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f822409e480 0x7f822412e030 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f82240684e0 tx=0x7f821c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.355+0000 7f822abda700 1 -- 172.21.15.40:0/1307287529 shutdown_connections 2023-09-30T22:26:48.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.355+0000 7f822abda700 1 --2- 172.21.15.40:0/1307287529 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f822409e480 0x7f822412e030 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.355+0000 7f822abda700 1 --2- 172.21.15.40:0/1307287529 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f822409c890 0x7f822412d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.355+0000 7f822abda700 1 --2- 172.21.15.40:0/1307287529 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f822409d920 0x7f822412daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.355+0000 7f822abda700 1 -- 172.21.15.40:0/1307287529 >> 172.21.15.40:0/1307287529 conn(0x7f82240a7080 msgr2=0x7f82240a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:48.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.355+0000 7f822abda700 1 -- 172.21.15.40:0/1307287529 shutdown_connections 2023-09-30T22:26:48.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.355+0000 7f822abda700 1 -- 172.21.15.40:0/1307287529 wait complete. 2023-09-30T22:26:48.368 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:48.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.386+0000 7fe6221e4700 1 -- 172.21.15.40:0/74457000 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe61c074620 con 0x7fe61c06fdb0 2023-09-30T22:26:48.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.387+0000 7fe603fff700 1 -- 172.21.15.40:0/74457000 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe61402a020 con 0x7fe61c06fdb0 2023-09-30T22:26:48.387 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:48.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.388+0000 7fe6221e4700 1 -- 172.21.15.40:0/74457000 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe61c06fdb0 msgr2=0x7fe61c06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.389+0000 7fe6221e4700 1 --2- 172.21.15.40:0/74457000 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe61c06fdb0 0x7fe61c06d410 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe61400b680 tx=0x7fe614004ad0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.389+0000 7fe6221e4700 1 -- 172.21.15.40:0/74457000 shutdown_connections 2023-09-30T22:26:48.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.389+0000 7fe6221e4700 1 --2- 172.21.15.40:0/74457000 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe61c06fdb0 0x7fe61c06d410 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.389+0000 7fe6221e4700 1 --2- 172.21.15.40:0/74457000 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe61c06f070 0x7fe61c06c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.389+0000 7fe6221e4700 1 --2- 172.21.15.40:0/74457000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe61c06f980 0x7fe61c06ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.389+0000 7fe6221e4700 1 -- 172.21.15.40:0/74457000 >> 172.21.15.40:0/74457000 conn(0x7fe61c0a41a0 msgr2=0x7fe61c0a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:48.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.389+0000 7fe6221e4700 1 -- 172.21.15.40:0/74457000 shutdown_connections 2023-09-30T22:26:48.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:48.389+0000 7fe6221e4700 1 -- 172.21.15.40:0/74457000 wait complete. 2023-09-30T22:26:48.401 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:49.325 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:49.338 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:49.368 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:49.403 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:49.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.471+0000 7f2db4eea700 1 Processor -- start 2023-09-30T22:26:49.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.471+0000 7f2db4eea700 1 -- start start 2023-09-30T22:26:49.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.472+0000 7f2db4eea700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2db009d920 0x7f2db009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.472+0000 7f2db4eea700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2db009f0f0 0x7f2db009e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.472+0000 7f2db4eea700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2db0133ca0 0x7f2db0134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.472+0000 7f2db4eea700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db006b4c0 con 0x7f2db0133ca0 2023-09-30T22:26:49.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.472+0000 7f2db4eea700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db009a8f0 con 0x7f2db009f0f0 2023-09-30T22:26:49.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.472+0000 7f2db4eea700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2db009f940 con 0x7f2db009d920 2023-09-30T22:26:49.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.472+0000 7f2dadd9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2db009f0f0 0x7f2db009e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.472+0000 7f2dadd9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2db009f0f0 0x7f2db009e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42954/0 (socket says 172.21.15.40:42954) 2023-09-30T22:26:49.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.472+0000 7f2dadd9b700 1 -- 172.21.15.40:0/3358295929 learned_addr learned my addr 172.21.15.40:0/3358295929 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:49.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.472+0000 7f2daed9d700 1 --2- 172.21.15.40:0/3358295929 >> v2:172.21.15.40:3300/0 conn(0x7f2db0133ca0 0x7f2db0134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.473+0000 7f2dae59c700 1 --2- 172.21.15.40:0/3358295929 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2db009d920 0x7f2db009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.473+0000 7f2daed9d700 1 -- 172.21.15.40:0/3358295929 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2db009d920 msgr2=0x7f2db009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:49.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.473+0000 7f2daed9d700 1 --2- 172.21.15.40:0/3358295929 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2db009d920 0x7f2db009dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.473+0000 7f2daed9d700 1 -- 172.21.15.40:0/3358295929 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2db009f0f0 msgr2=0x7f2db009e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:49.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.473+0000 7f2daed9d700 1 --2- 172.21.15.40:0/3358295929 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2db009f0f0 0x7f2db009e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.473+0000 7f2daed9d700 1 -- 172.21.15.40:0/3358295929 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db009f6e0 con 0x7f2db0133ca0 2023-09-30T22:26:49.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.473+0000 7f2dadd9b700 1 --2- 172.21.15.40:0/3358295929 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2db009f0f0 0x7f2db009e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:49.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.473+0000 7f2daed9d700 1 --2- 172.21.15.40:0/3358295929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2db0133ca0 0x7f2db0134140 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2da8009dc0 tx=0x7f2da800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4e412ee7fa04b2e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:49.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.473+0000 7f2dad59a700 1 -- 172.21.15.40:0/3358295929 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da800e070 con 0x7f2db0133ca0 2023-09-30T22:26:49.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.473+0000 7f2dad59a700 1 -- 172.21.15.40:0/3358295929 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da800bae0 con 0x7f2db0133ca0 2023-09-30T22:26:49.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.473+0000 7f2dad59a700 1 -- 172.21.15.40:0/3358295929 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da800be90 con 0x7f2db0133ca0 2023-09-30T22:26:49.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.474+0000 7f2db4eea700 1 -- 172.21.15.40:0/3358295929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2db0133ca0 msgr2=0x7f2db0134140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.474+0000 7f2db4eea700 1 --2- 172.21.15.40:0/3358295929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2db0133ca0 0x7f2db0134140 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2da8009dc0 tx=0x7f2da800b330 comp rx=0 tx=0).stop 2023-09-30T22:26:49.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.474+0000 7f2db4eea700 1 -- 172.21.15.40:0/3358295929 shutdown_connections 2023-09-30T22:26:49.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.474+0000 7f2db4eea700 1 --2- 172.21.15.40:0/3358295929 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2db009d920 0x7f2db009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.474+0000 7f2db4eea700 1 --2- 172.21.15.40:0/3358295929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2db0133ca0 0x7f2db0134140 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.474+0000 7f2db4eea700 1 --2- 172.21.15.40:0/3358295929 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2db009f0f0 0x7f2db009e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.474+0000 7f2db4eea700 1 -- 172.21.15.40:0/3358295929 >> 172.21.15.40:0/3358295929 conn(0x7f2db009fb20 msgr2=0x7f2db009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:49.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.474+0000 7f2db4eea700 1 -- 172.21.15.40:0/3358295929 shutdown_connections 2023-09-30T22:26:49.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.474+0000 7f2db4eea700 1 -- 172.21.15.40:0/3358295929 wait complete. 2023-09-30T22:26:49.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.476+0000 7f2db4eea700 1 Processor -- start 2023-09-30T22:26:49.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.476+0000 7f2db4eea700 1 -- start start 2023-09-30T22:26:49.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.476+0000 7f2db4eea700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2db009d920 0x7f2db01cca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.476+0000 7f2db4eea700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2db0133ca0 0x7f2db01ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.476+0000 7f2db4eea700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2db0119760 0x7f2db0119bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.476+0000 7f2db4eea700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db00a2a60 con 0x7f2db009d920 2023-09-30T22:26:49.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.476+0000 7f2db4eea700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db009c9e0 con 0x7f2db0119760 2023-09-30T22:26:49.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.476+0000 7f2db4eea700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2db011cce0 con 0x7f2db0133ca0 2023-09-30T22:26:49.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.476+0000 7f2dadd9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2db0133ca0 0x7f2db01ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.476+0000 7f2dadd9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2db0133ca0 0x7f2db01ccfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60508/0 (socket says 172.21.15.40:60508) 2023-09-30T22:26:49.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.476+0000 7f2dadd9b700 1 -- 172.21.15.40:0/4133222046 learned_addr learned my addr 172.21.15.40:0/4133222046 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:49.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.476+0000 7f2daed9d700 1 --2- 172.21.15.40:0/4133222046 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2db0119760 0x7f2db0119bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.477+0000 7f2dadd9b700 1 -- 172.21.15.40:0/4133222046 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2db0119760 msgr2=0x7f2db0119bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.477+0000 7f2dadd9b700 1 --2- 172.21.15.40:0/4133222046 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2db0119760 0x7f2db0119bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.477+0000 7f2dadd9b700 1 -- 172.21.15.40:0/4133222046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2db009d920 msgr2=0x7f2db01cca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.477+0000 7f2dadd9b700 1 --2- 172.21.15.40:0/4133222046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2db009d920 0x7f2db01cca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.477+0000 7f2dadd9b700 1 -- 172.21.15.40:0/4133222046 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da4009550 con 0x7f2db0133ca0 2023-09-30T22:26:49.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.477+0000 7f2dadd9b700 1 --2- 172.21.15.40:0/4133222046 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2db0133ca0 0x7f2db01ccfa0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2da400ebb0 tx=0x7f2da400eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:49.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.477+0000 7f2d9effd700 1 -- 172.21.15.40:0/4133222046 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da400c850 con 0x7f2db0133ca0 2023-09-30T22:26:49.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.477+0000 7f2d9effd700 1 -- 172.21.15.40:0/4133222046 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da400c9b0 con 0x7f2db0133ca0 2023-09-30T22:26:49.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.477+0000 7f2d9effd700 1 -- 172.21.15.40:0/4133222046 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da400cd20 con 0x7f2db0133ca0 2023-09-30T22:26:49.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.477+0000 7f2db4eea700 1 -- 172.21.15.40:0/4133222046 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da8009a70 con 0x7f2db0133ca0 2023-09-30T22:26:49.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.478+0000 7f2db4eea700 1 -- 172.21.15.40:0/4133222046 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db01cd4e0 con 0x7f2db0133ca0 2023-09-30T22:26:49.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.479+0000 7f2d9effd700 1 -- 172.21.15.40:0/4133222046 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2da4013470 con 0x7f2db0133ca0 2023-09-30T22:26:49.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.479+0000 7f2db4eea700 1 -- 172.21.15.40:0/4133222046 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db011ce50 con 0x7f2db0133ca0 2023-09-30T22:26:49.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.479+0000 7f2d9effd700 1 -- 172.21.15.40:0/4133222046 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f2da403f890 con 0x7f2db0133ca0 2023-09-30T22:26:49.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.484+0000 7f2d9effd700 1 -- 172.21.15.40:0/4133222046 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2da40232f0 con 0x7f2db0133ca0 2023-09-30T22:26:49.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.514+0000 7fb33cd4b700 1 Processor -- start 2023-09-30T22:26:49.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.514+0000 7fb33cd4b700 1 -- start start 2023-09-30T22:26:49.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.515+0000 7fb33cd4b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb338138250 0x7fb338138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.515+0000 7fb33cd4b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb33809d400 0x7fb33809d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.515+0000 7fb33cd4b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb33809dd50 0x7fb33813f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.515+0000 7fb33cd4b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb338137e20 con 0x7fb33809dd50 2023-09-30T22:26:49.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.515+0000 7fb33cd4b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb338138050 con 0x7fb33809d400 2023-09-30T22:26:49.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.515+0000 7fb33cd4b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb33809b010 con 0x7fb338138250 2023-09-30T22:26:49.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.515+0000 7fb335d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb33809d400 0x7fb33809d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.515+0000 7fb335d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb33809d400 0x7fb33809d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42970/0 (socket says 172.21.15.40:42970) 2023-09-30T22:26:49.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.515+0000 7fb335d9b700 1 -- 172.21.15.40:0/2438615199 learned_addr learned my addr 172.21.15.40:0/2438615199 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:49.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.515+0000 7fb33659c700 1 --2- 172.21.15.40:0/2438615199 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb338138250 0x7fb338138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.515+0000 7fb336d9d700 1 --2- 172.21.15.40:0/2438615199 >> v2:172.21.15.40:3300/0 conn(0x7fb33809dd50 0x7fb33813f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.515+0000 7fb335d9b700 1 -- 172.21.15.40:0/2438615199 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb338138250 msgr2=0x7fb338138620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:49.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.515+0000 7fb335d9b700 1 --2- 172.21.15.40:0/2438615199 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb338138250 0x7fb338138620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.515+0000 7fb335d9b700 1 -- 172.21.15.40:0/2438615199 >> v2:172.21.15.40:3300/0 conn(0x7fb33809dd50 msgr2=0x7fb33813f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:49.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.515+0000 7fb335d9b700 1 --2- 172.21.15.40:0/2438615199 >> v2:172.21.15.40:3300/0 conn(0x7fb33809dd50 0x7fb33813f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.516+0000 7fb335d9b700 1 -- 172.21.15.40:0/2438615199 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb33809e1f0 con 0x7fb33809d400 2023-09-30T22:26:49.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.516+0000 7fb335d9b700 1 --2- 172.21.15.40:0/2438615199 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb33809d400 0x7fb33809d810 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb32c0098f0 tx=0x7fb32c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7d10fabbd76a786 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:49.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.516+0000 7fb33559a700 1 -- 172.21.15.40:0/2438615199 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32c011830 con 0x7fb33809d400 2023-09-30T22:26:49.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.516+0000 7fb33559a700 1 -- 172.21.15.40:0/2438615199 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb32c011990 con 0x7fb33809d400 2023-09-30T22:26:49.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.516+0000 7fb33559a700 1 -- 172.21.15.40:0/2438615199 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32c011d20 con 0x7fb33809d400 2023-09-30T22:26:49.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.517+0000 7fb33cd4b700 1 -- 172.21.15.40:0/2438615199 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb33809d400 msgr2=0x7fb33809d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.517+0000 7fb33cd4b700 1 --2- 172.21.15.40:0/2438615199 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb33809d400 0x7fb33809d810 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb32c0098f0 tx=0x7fb32c009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:49.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.517+0000 7fb33cd4b700 1 -- 172.21.15.40:0/2438615199 shutdown_connections 2023-09-30T22:26:49.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.517+0000 7fb33cd4b700 1 --2- 172.21.15.40:0/2438615199 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb338138250 0x7fb338138620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.517+0000 7fb33cd4b700 1 --2- 172.21.15.40:0/2438615199 >> v2:172.21.15.40:3300/0 conn(0x7fb33809dd50 0x7fb33813f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.517+0000 7fb33cd4b700 1 --2- 172.21.15.40:0/2438615199 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb33809d400 0x7fb33809d810 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.517+0000 7fb33cd4b700 1 -- 172.21.15.40:0/2438615199 >> 172.21.15.40:0/2438615199 conn(0x7fb3380a2a00 msgr2=0x7fb3380a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:49.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.517+0000 7fb33cd4b700 1 -- 172.21.15.40:0/2438615199 shutdown_connections 2023-09-30T22:26:49.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.517+0000 7fb33cd4b700 1 -- 172.21.15.40:0/2438615199 wait complete. 2023-09-30T22:26:49.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.518+0000 7fb33cd4b700 1 Processor -- start 2023-09-30T22:26:49.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.518+0000 7fb33cd4b700 1 -- start start 2023-09-30T22:26:49.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.518+0000 7fb33cd4b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb33809d400 0x7fb3381228b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.518+0000 7fb33cd4b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb33809dd50 0x7fb338122df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.518+0000 7fb33cd4b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb338138250 0x7fb338123330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.518+0000 7fb33cd4b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb338125860 con 0x7fb33809dd50 2023-09-30T22:26:49.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.518+0000 7fb33cd4b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb338123c10 con 0x7fb338138250 2023-09-30T22:26:49.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.518+0000 7fb33cd4b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb338123f00 con 0x7fb33809d400 2023-09-30T22:26:49.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.518+0000 7fb33659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb33809d400 0x7fb3381228b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.518+0000 7fb33659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb33809d400 0x7fb3381228b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60536/0 (socket says 172.21.15.40:60536) 2023-09-30T22:26:49.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.518+0000 7fb33659c700 1 -- 172.21.15.40:0/3996172475 learned_addr learned my addr 172.21.15.40:0/3996172475 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:49.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.518+0000 7fb336d9d700 1 --2- 172.21.15.40:0/3996172475 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb338138250 0x7fb338123330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.519+0000 7fb335d9b700 1 --2- 172.21.15.40:0/3996172475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb33809dd50 0x7fb338122df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.519+0000 7fb33659c700 1 -- 172.21.15.40:0/3996172475 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb338138250 msgr2=0x7fb338123330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.519+0000 7fb33659c700 1 --2- 172.21.15.40:0/3996172475 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb338138250 0x7fb338123330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.519+0000 7fb33659c700 1 -- 172.21.15.40:0/3996172475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb33809dd50 msgr2=0x7fb338122df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.519+0000 7fb33659c700 1 --2- 172.21.15.40:0/3996172475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb33809dd50 0x7fb338122df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.519+0000 7fb33659c700 1 -- 172.21.15.40:0/3996172475 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb32c009550 con 0x7fb33809d400 2023-09-30T22:26:49.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.519+0000 7fb33659c700 1 --2- 172.21.15.40:0/3996172475 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb33809d400 0x7fb3381228b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb32800e9b0 tx=0x7fb32800ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:49.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.519+0000 7fb326ffd700 1 -- 172.21.15.40:0/3996172475 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32800ee50 con 0x7fb33809d400 2023-09-30T22:26:49.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.519+0000 7fb326ffd700 1 -- 172.21.15.40:0/3996172475 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb32800c850 con 0x7fb33809d400 2023-09-30T22:26:49.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.519+0000 7fb33cd4b700 1 -- 172.21.15.40:0/3996172475 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb338136560 con 0x7fb33809d400 2023-09-30T22:26:49.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.519+0000 7fb326ffd700 1 -- 172.21.15.40:0/3996172475 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32800cbc0 con 0x7fb33809d400 2023-09-30T22:26:49.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.519+0000 7fb33cd4b700 1 -- 172.21.15.40:0/3996172475 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3381245e0 con 0x7fb33809d400 2023-09-30T22:26:49.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.520+0000 7fb326ffd700 1 -- 172.21.15.40:0/3996172475 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb32800cd20 con 0x7fb33809d400 2023-09-30T22:26:49.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.521+0000 7fb326ffd700 1 -- 172.21.15.40:0/3996172475 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb32803f8c0 con 0x7fb33809d400 2023-09-30T22:26:49.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.521+0000 7fb33cd4b700 1 -- 172.21.15.40:0/3996172475 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb33806edb0 con 0x7fb33809d400 2023-09-30T22:26:49.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.521+0000 7f6edab61700 1 Processor -- start 2023-09-30T22:26:49.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.521+0000 7f6edab61700 1 -- start start 2023-09-30T22:26:49.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.521+0000 7f6edab61700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6ed406b1b0 0x7f6ed4136af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.521+0000 7f6edab61700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ed4137030 0x7f6ed4139410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.521+0000 7f6edab61700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ed409eb50 con 0x7f6ed406a6d0 2023-09-30T22:26:49.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.521+0000 7f6edab61700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed406b580 con 0x7f6ed4137030 2023-09-30T22:26:49.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.521+0000 7f6edab61700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed409dde0 con 0x7f6ed406b1b0 2023-09-30T22:26:49.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.522+0000 7f6ed88fd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6ed406a6d0 0x7f6ed406aaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60668/0 (socket says 172.21.15.40:60668) 2023-09-30T22:26:49.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.522+0000 7f6ed88fd700 1 -- 172.21.15.40:0/2790466420 learned_addr learned my addr 172.21.15.40:0/2790466420 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:49.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.522+0000 7f6ed90fe700 1 --2- 172.21.15.40:0/2790466420 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ed4137030 0x7f6ed4139410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.522+0000 7f6ed90fe700 1 -- 172.21.15.40:0/2790466420 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6ed406b1b0 msgr2=0x7f6ed4136af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:49.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.522+0000 7f6ed90fe700 1 --2- 172.21.15.40:0/2790466420 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6ed406b1b0 0x7f6ed4136af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.522+0000 7f6ed90fe700 1 -- 172.21.15.40:0/2790466420 >> v1:172.21.15.40:6789/0 conn(0x7f6ed406a6d0 legacy=0x7f6ed406aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.522+0000 7f6ed90fe700 1 -- 172.21.15.40:0/2790466420 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed409d4a0 con 0x7f6ed4137030 2023-09-30T22:26:49.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.522+0000 7f6ed90fe700 1 --2- 172.21.15.40:0/2790466420 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ed4137030 0x7f6ed4139410 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc009dc0 tx=0x7f6ecc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd25005d9be60af9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:49.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.522+0000 7f6ed37fe700 1 -- 172.21.15.40:0/2790466420 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc00e070 con 0x7f6ed4137030 2023-09-30T22:26:49.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.522+0000 7f6ed37fe700 1 -- 172.21.15.40:0/2790466420 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ecc00bbd0 con 0x7f6ed4137030 2023-09-30T22:26:49.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.522+0000 7f6ed37fe700 1 -- 172.21.15.40:0/2790466420 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc012430 con 0x7f6ed4137030 2023-09-30T22:26:49.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.523+0000 7f6edab61700 1 -- 172.21.15.40:0/2790466420 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ed4137030 msgr2=0x7f6ed4139410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.523+0000 7f6edab61700 1 --2- 172.21.15.40:0/2790466420 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ed4137030 0x7f6ed4139410 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc009dc0 tx=0x7f6ecc00b330 comp rx=0 tx=0).stop 2023-09-30T22:26:49.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.523+0000 7f6edab61700 1 -- 172.21.15.40:0/2790466420 shutdown_connections 2023-09-30T22:26:49.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.523+0000 7f6edab61700 1 --2- 172.21.15.40:0/2790466420 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ed4137030 0x7f6ed4139410 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.523+0000 7f6edab61700 1 --2- 172.21.15.40:0/2790466420 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6ed406b1b0 0x7f6ed4136af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.523+0000 7f6edab61700 1 -- 172.21.15.40:0/2790466420 >> 172.21.15.40:0/2790466420 conn(0x7f6ed409fb20 msgr2=0x7f6ed409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:49.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.523+0000 7f6edab61700 1 -- 172.21.15.40:0/2790466420 shutdown_connections 2023-09-30T22:26:49.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.523+0000 7f6edab61700 1 -- 172.21.15.40:0/2790466420 wait complete. 2023-09-30T22:26:49.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.524+0000 7f6edab61700 1 Processor -- start 2023-09-30T22:26:49.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.524+0000 7f6edab61700 1 -- start start 2023-09-30T22:26:49.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.525+0000 7f6edab61700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ed406a6d0 0x7f6ed41227a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.525+0000 7f6edab61700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6ed406b1b0 0x7f6ed4122ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.525+0000 7f6edab61700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ed4137030 0x7f6ed41c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.525+0000 7f6edab61700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed41245c0 con 0x7f6ed406a6d0 2023-09-30T22:26:49.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.525+0000 7f6edab61700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed41252c0 con 0x7f6ed4137030 2023-09-30T22:26:49.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.525+0000 7f6edab61700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed4136640 con 0x7f6ed406b1b0 2023-09-30T22:26:49.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.525+0000 7f6ed88fd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ed406a6d0 0x7f6ed41227a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.525+0000 7f6ed88fd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ed406a6d0 0x7f6ed41227a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49184/0 (socket says 172.21.15.40:49184) 2023-09-30T22:26:49.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.525+0000 7f6ed88fd700 1 -- 172.21.15.40:0/3918919246 learned_addr learned my addr 172.21.15.40:0/3918919246 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:49.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.525+0000 7f6ed3fff700 1 --2- 172.21.15.40:0/3918919246 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6ed406b1b0 0x7f6ed4122ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.525+0000 7f6ed90fe700 1 --2- 172.21.15.40:0/3918919246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ed4137030 0x7f6ed41c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.525+0000 7f6ed88fd700 1 -- 172.21.15.40:0/3918919246 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6ed406b1b0 msgr2=0x7f6ed4122ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.525+0000 7f6ed88fd700 1 --2- 172.21.15.40:0/3918919246 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6ed406b1b0 0x7f6ed4122ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.525+0000 7f6ed88fd700 1 -- 172.21.15.40:0/3918919246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ed4137030 msgr2=0x7f6ed41c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.525+0000 7f6ed88fd700 1 --2- 172.21.15.40:0/3918919246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ed4137030 0x7f6ed41c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.525+0000 7f6ed88fd700 1 -- 172.21.15.40:0/3918919246 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ecc009a70 con 0x7f6ed406a6d0 2023-09-30T22:26:49.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.525+0000 7f6ed3fff700 1 --2- 172.21.15.40:0/3918919246 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6ed406b1b0 0x7f6ed4122ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:49.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.526+0000 7f6ed88fd700 1 --2- 172.21.15.40:0/3918919246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ed406a6d0 0x7f6ed41227a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f6ec800c500 tx=0x7f6ec800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:49.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.526+0000 7f6ed17fa700 1 -- 172.21.15.40:0/3918919246 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec80074e0 con 0x7f6ed406a6d0 2023-09-30T22:26:49.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.526+0000 7f6ed17fa700 1 -- 172.21.15.40:0/3918919246 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec8007640 con 0x7f6ed406a6d0 2023-09-30T22:26:49.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.526+0000 7f6edab61700 1 -- 172.21.15.40:0/3918919246 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ed41254f0 con 0x7f6ed406a6d0 2023-09-30T22:26:49.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.526+0000 7f6ed17fa700 1 -- 172.21.15.40:0/3918919246 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec8005a30 con 0x7f6ed406a6d0 2023-09-30T22:26:49.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.526+0000 7f6edab61700 1 -- 172.21.15.40:0/3918919246 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed409a520 con 0x7f6ed406a6d0 2023-09-30T22:26:49.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.527+0000 7f6edab61700 1 -- 172.21.15.40:0/3918919246 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ed4123e90 con 0x7f6ed406a6d0 2023-09-30T22:26:49.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.528+0000 7f6ed17fa700 1 -- 172.21.15.40:0/3918919246 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6ec8005b90 con 0x7f6ed406a6d0 2023-09-30T22:26:49.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.528+0000 7f6ed17fa700 1 -- 172.21.15.40:0/3918919246 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6ec803eeb0 con 0x7f6ed406a6d0 2023-09-30T22:26:49.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.530+0000 7fb326ffd700 1 -- 172.21.15.40:0/3996172475 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb3280232f0 con 0x7fb33809d400 2023-09-30T22:26:49.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.532+0000 7f6ed17fa700 1 -- 172.21.15.40:0/3918919246 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6ec8005e40 con 0x7f6ed406a6d0 2023-09-30T22:26:49.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.560+0000 7f72e0dbb700 1 Processor -- start 2023-09-30T22:26:49.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.560+0000 7f72e0dbb700 1 -- start start 2023-09-30T22:26:49.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.561+0000 7f72e0dbb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f72dc09d920 0x7f72dc09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.561+0000 7f72e0dbb700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f72dc09e230 0x7f72dc1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.561+0000 7f72e0dbb700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72dc09f940 con 0x7f72dc09f0f0 2023-09-30T22:26:49.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.561+0000 7f72e0dbb700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72dc06b4c0 con 0x7f72dc09d920 2023-09-30T22:26:49.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.561+0000 7f72e0dbb700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc09a8f0 con 0x7f72dc09e230 2023-09-30T22:26:49.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.562+0000 7f72dad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f72dc09e230 0x7f72dc1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.562+0000 7f72da59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f72dc09d920 0x7f72dc09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.562+0000 7f72dad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f72dc09e230 0x7f72dc1343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60558/0 (socket says 172.21.15.40:60558) 2023-09-30T22:26:49.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.562+0000 7f72dad9d700 1 -- 172.21.15.40:0/1479677686 learned_addr learned my addr 172.21.15.40:0/1479677686 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:49.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.562+0000 7f72da59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f72dc09d920 0x7f72dc09dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49194/0 (socket says 172.21.15.40:49194) 2023-09-30T22:26:49.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.562+0000 7f72da59c700 1 -- 172.21.15.40:0/1479677686 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f72dc09e230 msgr2=0x7f72dc1343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:49.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.562+0000 7f72da59c700 1 --2- 172.21.15.40:0/1479677686 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f72dc09e230 0x7f72dc1343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.562+0000 7f72da59c700 1 -- 172.21.15.40:0/1479677686 >> v1:172.21.15.40:6789/0 conn(0x7f72dc09f0f0 legacy=0x7f72dc133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.562+0000 7f72da59c700 1 -- 172.21.15.40:0/1479677686 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72dc09f6e0 con 0x7f72dc09d920 2023-09-30T22:26:49.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.562+0000 7f72da59c700 1 --2- 172.21.15.40:0/1479677686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72dc09d920 0x7f72dc09dcf0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f72cc009820 tx=0x7f72cc009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d6b8b45095bf75e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:49.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.563+0000 7f72d959a700 1 -- 172.21.15.40:0/1479677686 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc005e30 con 0x7f72dc09d920 2023-09-30T22:26:49.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.563+0000 7f72d959a700 1 -- 172.21.15.40:0/1479677686 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72cc006030 con 0x7f72dc09d920 2023-09-30T22:26:49.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.563+0000 7f72d959a700 1 -- 172.21.15.40:0/1479677686 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc0063c0 con 0x7f72dc09d920 2023-09-30T22:26:49.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.563+0000 7f72e0dbb700 1 -- 172.21.15.40:0/1479677686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72dc09d920 msgr2=0x7f72dc09dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.563+0000 7f72e0dbb700 1 --2- 172.21.15.40:0/1479677686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72dc09d920 0x7f72dc09dcf0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f72cc009820 tx=0x7f72cc009b30 comp rx=0 tx=0).stop 2023-09-30T22:26:49.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.567+0000 7f72e0dbb700 1 -- 172.21.15.40:0/1479677686 shutdown_connections 2023-09-30T22:26:49.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.567+0000 7f72e0dbb700 1 --2- 172.21.15.40:0/1479677686 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f72dc09e230 0x7f72dc1343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.567+0000 7f72e0dbb700 1 --2- 172.21.15.40:0/1479677686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72dc09d920 0x7f72dc09dcf0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.567+0000 7f72e0dbb700 1 -- 172.21.15.40:0/1479677686 >> 172.21.15.40:0/1479677686 conn(0x7f72dc09fb20 msgr2=0x7f72dc09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:49.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.569+0000 7f72e0dbb700 1 -- 172.21.15.40:0/1479677686 shutdown_connections 2023-09-30T22:26:49.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.569+0000 7f72e0dbb700 1 -- 172.21.15.40:0/1479677686 wait complete. 2023-09-30T22:26:49.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.570+0000 7f72e0dbb700 1 Processor -- start 2023-09-30T22:26:49.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.570+0000 7f72e0dbb700 1 -- start start 2023-09-30T22:26:49.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.571+0000 7f72e0dbb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72dc09d920 0x7f72dc1a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.571+0000 7f72e0dbb700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f72dc09e230 0x7f72dc1a65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.571+0000 7f72e0dbb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f72dc1b9460 0x7f72dc1a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.571+0000 7f72e0dbb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc1a82d0 con 0x7f72dc09d920 2023-09-30T22:26:49.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.571+0000 7f72e0dbb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc1aa550 con 0x7f72dc1b9460 2023-09-30T22:26:49.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.571+0000 7f72e0dbb700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc1a9b90 con 0x7f72dc09e230 2023-09-30T22:26:49.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.571+0000 7f72d9d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f72dc09e230 0x7f72dc1a65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.571+0000 7f72da59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72dc09d920 0x7f72dc1a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.571+0000 7f72d9d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f72dc09e230 0x7f72dc1a65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60564/0 (socket says 172.21.15.40:60564) 2023-09-30T22:26:49.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.571+0000 7f72da59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72dc09d920 0x7f72dc1a6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49196/0 (socket says 172.21.15.40:49196) 2023-09-30T22:26:49.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.571+0000 7f72d9d9b700 1 -- 172.21.15.40:0/646994992 learned_addr learned my addr 172.21.15.40:0/646994992 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:49.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.571+0000 7f72dad9d700 1 --2- 172.21.15.40:0/646994992 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f72dc1b9460 0x7f72dc1a6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.571+0000 7f72da59c700 1 -- 172.21.15.40:0/646994992 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f72dc09e230 msgr2=0x7f72dc1a65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.571+0000 7f72da59c700 1 --2- 172.21.15.40:0/646994992 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f72dc09e230 0x7f72dc1a65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.571+0000 7f72da59c700 1 -- 172.21.15.40:0/646994992 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f72dc1b9460 msgr2=0x7f72dc1a6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.571+0000 7f72da59c700 1 --2- 172.21.15.40:0/646994992 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f72dc1b9460 0x7f72dc1a6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.571+0000 7f72da59c700 1 -- 172.21.15.40:0/646994992 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72cc009430 con 0x7f72dc09d920 2023-09-30T22:26:49.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.572+0000 7f72da59c700 1 --2- 172.21.15.40:0/646994992 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72dc09d920 0x7f72dc1a6070 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f72cc015000 tx=0x7f72cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:49.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.572+0000 7f72caffd700 1 -- 172.21.15.40:0/646994992 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc0061a0 con 0x7f72dc09d920 2023-09-30T22:26:49.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.572+0000 7f72caffd700 1 -- 172.21.15.40:0/646994992 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72cc020070 con 0x7f72dc09d920 2023-09-30T22:26:49.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.572+0000 7f72caffd700 1 -- 172.21.15.40:0/646994992 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc006540 con 0x7f72dc09d920 2023-09-30T22:26:49.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.572+0000 7f72e0dbb700 1 -- 172.21.15.40:0/646994992 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72dc1a8f60 con 0x7f72dc09d920 2023-09-30T22:26:49.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.572+0000 7f72e0dbb700 1 -- 172.21.15.40:0/646994992 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72dc09c9e0 con 0x7f72dc09d920 2023-09-30T22:26:49.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.573+0000 7f72e0dbb700 1 -- 172.21.15.40:0/646994992 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72dc1a9710 con 0x7f72dc09d920 2023-09-30T22:26:49.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.573+0000 7f72caffd700 1 -- 172.21.15.40:0/646994992 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f72cc022030 con 0x7f72dc09d920 2023-09-30T22:26:49.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.574+0000 7f72caffd700 1 -- 172.21.15.40:0/646994992 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f72cc040d60 con 0x7f72dc09d920 2023-09-30T22:26:49.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.578+0000 7f72caffd700 1 -- 172.21.15.40:0/646994992 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f72dc1a9710 con 0x7f72dc09d920 2023-09-30T22:26:49.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.693+0000 7f2db4eea700 1 -- 172.21.15.40:0/4133222046 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2db0062380 con 0x7f2db0133ca0 2023-09-30T22:26:49.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.693+0000 7f2d9effd700 1 -- 172.21.15.40:0/4133222046 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2da4021030 con 0x7f2db0133ca0 2023-09-30T22:26:49.694 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:49.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.696+0000 7f2db4eea700 1 -- 172.21.15.40:0/4133222046 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2db0133ca0 msgr2=0x7f2db01ccfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.696+0000 7f2db4eea700 1 --2- 172.21.15.40:0/4133222046 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2db0133ca0 0x7f2db01ccfa0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2da400ebb0 tx=0x7f2da400eec0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.696+0000 7f2db4eea700 1 -- 172.21.15.40:0/4133222046 shutdown_connections 2023-09-30T22:26:49.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.696+0000 7f2db4eea700 1 --2- 172.21.15.40:0/4133222046 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2db0119760 0x7f2db0119bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.696+0000 7f2db4eea700 1 --2- 172.21.15.40:0/4133222046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2db009d920 0x7f2db01cca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.696+0000 7f2db4eea700 1 --2- 172.21.15.40:0/4133222046 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2db0133ca0 0x7f2db01ccfa0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.696+0000 7f2db4eea700 1 -- 172.21.15.40:0/4133222046 >> 172.21.15.40:0/4133222046 conn(0x7f2db009fb20 msgr2=0x7f2db00a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:49.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.696+0000 7f2db4eea700 1 -- 172.21.15.40:0/4133222046 shutdown_connections 2023-09-30T22:26:49.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.696+0000 7f2db4eea700 1 -- 172.21.15.40:0/4133222046 wait complete. 2023-09-30T22:26:49.714 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:49.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.729+0000 7fb33cd4b700 1 -- 172.21.15.40:0/3996172475 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb338062380 con 0x7fb33809d400 2023-09-30T22:26:49.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.729+0000 7fb326ffd700 1 -- 172.21.15.40:0/3996172475 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb32801ae80 con 0x7fb33809d400 2023-09-30T22:26:49.730 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:49.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.732+0000 7fb33cd4b700 1 -- 172.21.15.40:0/3996172475 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb33809d400 msgr2=0x7fb3381228b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.732+0000 7fb33cd4b700 1 --2- 172.21.15.40:0/3996172475 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb33809d400 0x7fb3381228b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb32800e9b0 tx=0x7fb32800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.732+0000 7fb33cd4b700 1 -- 172.21.15.40:0/3996172475 shutdown_connections 2023-09-30T22:26:49.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.732+0000 7fb33cd4b700 1 --2- 172.21.15.40:0/3996172475 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb33809d400 0x7fb3381228b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.732+0000 7fb33cd4b700 1 --2- 172.21.15.40:0/3996172475 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb338138250 0x7fb338123330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.732+0000 7fb33cd4b700 1 --2- 172.21.15.40:0/3996172475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb33809dd50 0x7fb338122df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.732+0000 7fb33cd4b700 1 -- 172.21.15.40:0/3996172475 >> 172.21.15.40:0/3996172475 conn(0x7fb3380a2a00 msgr2=0x7fb3381bf680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:49.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.732+0000 7fb33cd4b700 1 -- 172.21.15.40:0/3996172475 shutdown_connections 2023-09-30T22:26:49.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.732+0000 7fb33cd4b700 1 -- 172.21.15.40:0/3996172475 wait complete. 2023-09-30T22:26:49.745 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:49.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.761+0000 7f6edab61700 1 -- 172.21.15.40:0/3918919246 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6ed4062380 con 0x7f6ed406a6d0 2023-09-30T22:26:49.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.761+0000 7f6ed17fa700 1 -- 172.21.15.40:0/3918919246 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6ec8017030 con 0x7f6ed406a6d0 2023-09-30T22:26:49.762 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:49.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.763+0000 7f6edab61700 1 -- 172.21.15.40:0/3918919246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ed406a6d0 msgr2=0x7f6ed41227a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.763+0000 7f6edab61700 1 --2- 172.21.15.40:0/3918919246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ed406a6d0 0x7f6ed41227a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f6ec800c500 tx=0x7f6ec800c810 comp rx=0 tx=0).stop 2023-09-30T22:26:49.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.763+0000 7f6edab61700 1 -- 172.21.15.40:0/3918919246 shutdown_connections 2023-09-30T22:26:49.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.763+0000 7f6edab61700 1 --2- 172.21.15.40:0/3918919246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ed4137030 0x7f6ed41c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.763+0000 7f6edab61700 1 --2- 172.21.15.40:0/3918919246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ed406a6d0 0x7f6ed41227a0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.763+0000 7f6edab61700 1 --2- 172.21.15.40:0/3918919246 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6ed406b1b0 0x7f6ed4122ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.763+0000 7f6edab61700 1 -- 172.21.15.40:0/3918919246 >> 172.21.15.40:0/3918919246 conn(0x7f6ed409fb20 msgr2=0x7f6ed40a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:49.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.763+0000 7f6edab61700 1 -- 172.21.15.40:0/3918919246 shutdown_connections 2023-09-30T22:26:49.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.763+0000 7f6edab61700 1 -- 172.21.15.40:0/3918919246 wait complete. 2023-09-30T22:26:49.776 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:49.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.808+0000 7f72e0dbb700 1 -- 172.21.15.40:0/646994992 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f72dc1a9710 con 0x7f72dc09d920 2023-09-30T22:26:49.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.809+0000 7f72caffd700 1 -- 172.21.15.40:0/646994992 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f72cc019590 con 0x7f72dc09d920 2023-09-30T22:26:49.809 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:49.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.811+0000 7f72e0dbb700 1 -- 172.21.15.40:0/646994992 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72dc09d920 msgr2=0x7f72dc1a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.811+0000 7f72e0dbb700 1 --2- 172.21.15.40:0/646994992 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72dc09d920 0x7f72dc1a6070 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f72cc015000 tx=0x7f72cc004750 comp rx=0 tx=0).stop 2023-09-30T22:26:49.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.811+0000 7f72e0dbb700 1 -- 172.21.15.40:0/646994992 shutdown_connections 2023-09-30T22:26:49.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.811+0000 7f72e0dbb700 1 --2- 172.21.15.40:0/646994992 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f72dc1b9460 0x7f72dc1a6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.811+0000 7f72e0dbb700 1 --2- 172.21.15.40:0/646994992 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72dc09d920 0x7f72dc1a6070 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.811+0000 7f72e0dbb700 1 --2- 172.21.15.40:0/646994992 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f72dc09e230 0x7f72dc1a65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.811+0000 7f72e0dbb700 1 -- 172.21.15.40:0/646994992 >> 172.21.15.40:0/646994992 conn(0x7f72dc09fb20 msgr2=0x7f72dc1bb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:49.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.811+0000 7f72e0dbb700 1 -- 172.21.15.40:0/646994992 shutdown_connections 2023-09-30T22:26:49.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:49.811+0000 7f72e0dbb700 1 -- 172.21.15.40:0/646994992 wait complete. 2023-09-30T22:26:49.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:50.715 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:50.745 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:50.777 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:50.825 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:50.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.870+0000 7fae5e8b7700 1 Processor -- start 2023-09-30T22:26:50.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.870+0000 7fae5e8b7700 1 -- start start 2023-09-30T22:26:50.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.871+0000 7fae5e8b7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae5809d920 0x7fae5809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.871+0000 7fae5e8b7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fae5809e230 0x7fae581308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.871+0000 7fae5e8b7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae5809adf0 con 0x7fae58130de0 2023-09-30T22:26:50.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.871+0000 7fae5e8b7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae5809edf0 con 0x7fae5809e230 2023-09-30T22:26:50.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.871+0000 7fae5e8b7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae5809b660 con 0x7fae5809d920 2023-09-30T22:26:50.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.871+0000 7fae5ce54700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fae58130de0 0x7fae58137d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60684/0 (socket says 172.21.15.40:60684) 2023-09-30T22:26:50.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.871+0000 7fae5ce54700 1 -- 172.21.15.40:0/4271645218 learned_addr learned my addr 172.21.15.40:0/4271645218 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:50.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.871+0000 7fae57fff700 1 --2- 172.21.15.40:0/4271645218 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae5809d920 0x7fae5809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.871+0000 7fae577fe700 1 --2- 172.21.15.40:0/4271645218 >> v2:172.21.15.40:3300/0 conn(0x7fae5809e230 0x7fae581308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.871+0000 7fae56ffd700 1 -- 172.21.15.40:0/4271645218 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 82318791 0 0) 0x7fae5809adf0 con 0x7fae58130de0 2023-09-30T22:26:50.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.871+0000 7fae56ffd700 1 -- 172.21.15.40:0/4271645218 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae400035b0 con 0x7fae58130de0 2023-09-30T22:26:50.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.871+0000 7fae57fff700 1 -- 172.21.15.40:0/4271645218 >> v2:172.21.15.40:3300/0 conn(0x7fae5809e230 msgr2=0x7fae581308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:50.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.871+0000 7fae57fff700 1 --2- 172.21.15.40:0/4271645218 >> v2:172.21.15.40:3300/0 conn(0x7fae5809e230 0x7fae581308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.871+0000 7fae57fff700 1 -- 172.21.15.40:0/4271645218 >> v1:172.21.15.40:6789/0 conn(0x7fae58130de0 legacy=0x7fae58137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.871+0000 7fae57fff700 1 -- 172.21.15.40:0/4271645218 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae5809a6e0 con 0x7fae5809d920 2023-09-30T22:26:50.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.872+0000 7fae57fff700 1 --2- 172.21.15.40:0/4271645218 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae5809d920 0x7fae5809dcf0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fae48009820 tx=0x7fae48009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36c3fae21e08e6cd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:50.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.872+0000 7fae56ffd700 1 -- 172.21.15.40:0/4271645218 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae48005e30 con 0x7fae5809d920 2023-09-30T22:26:50.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.872+0000 7fae56ffd700 1 -- 172.21.15.40:0/4271645218 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae48006030 con 0x7fae5809d920 2023-09-30T22:26:50.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.872+0000 7fae56ffd700 1 -- 172.21.15.40:0/4271645218 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae480063c0 con 0x7fae5809d920 2023-09-30T22:26:50.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.873+0000 7fae5e8b7700 1 -- 172.21.15.40:0/4271645218 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae5809d920 msgr2=0x7fae5809dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.873+0000 7fae5e8b7700 1 --2- 172.21.15.40:0/4271645218 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae5809d920 0x7fae5809dcf0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fae48009820 tx=0x7fae48009b30 comp rx=0 tx=0).stop 2023-09-30T22:26:50.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.873+0000 7fae5e8b7700 1 -- 172.21.15.40:0/4271645218 shutdown_connections 2023-09-30T22:26:50.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.873+0000 7fae5e8b7700 1 --2- 172.21.15.40:0/4271645218 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae5809d920 0x7fae5809dcf0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.873+0000 7fae5e8b7700 1 --2- 172.21.15.40:0/4271645218 >> v2:172.21.15.40:3300/0 conn(0x7fae5809e230 0x7fae581308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.873+0000 7fae5e8b7700 1 -- 172.21.15.40:0/4271645218 >> 172.21.15.40:0/4271645218 conn(0x7fae5809fb20 msgr2=0x7fae5809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:50.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.874+0000 7fae5e8b7700 1 -- 172.21.15.40:0/4271645218 shutdown_connections 2023-09-30T22:26:50.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.874+0000 7fae5e8b7700 1 -- 172.21.15.40:0/4271645218 wait complete. 2023-09-30T22:26:50.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.876+0000 7fae5e8b7700 1 Processor -- start 2023-09-30T22:26:50.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.876+0000 7fae5e8b7700 1 -- start start 2023-09-30T22:26:50.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.876+0000 7fae5e8b7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae5809d920 0x7fae5812ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.876+0000 7fae5e8b7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae5809e230 0x7fae5812f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.876+0000 7fae5e8b7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae58130de0 0x7fae5812f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.876+0000 7fae5e8b7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae58132770 con 0x7fae5809d920 2023-09-30T22:26:50.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.876+0000 7fae5e8b7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae58130750 con 0x7fae5809e230 2023-09-30T22:26:50.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.876+0000 7fae5e8b7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae58133090 con 0x7fae58130de0 2023-09-30T22:26:50.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.877+0000 7fae577fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae5809e230 0x7fae5812f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.877+0000 7fae5ce54700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae58130de0 0x7fae5812f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.877+0000 7fae577fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae5809e230 0x7fae5812f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:43050/0 (socket says 172.21.15.40:43050) 2023-09-30T22:26:50.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.877+0000 7fae577fe700 1 -- 172.21.15.40:0/2110862584 learned_addr learned my addr 172.21.15.40:0/2110862584 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:50.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.877+0000 7fae57fff700 1 --2- 172.21.15.40:0/2110862584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae5809d920 0x7fae5812ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.877+0000 7fae577fe700 1 -- 172.21.15.40:0/2110862584 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae58130de0 msgr2=0x7fae5812f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.877+0000 7fae577fe700 1 --2- 172.21.15.40:0/2110862584 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae58130de0 0x7fae5812f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.877+0000 7fae577fe700 1 -- 172.21.15.40:0/2110862584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae5809d920 msgr2=0x7fae5812ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.877+0000 7fae577fe700 1 --2- 172.21.15.40:0/2110862584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae5809d920 0x7fae5812ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.877+0000 7fae577fe700 1 -- 172.21.15.40:0/2110862584 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae48009430 con 0x7fae5809e230 2023-09-30T22:26:50.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.877+0000 7fae577fe700 1 --2- 172.21.15.40:0/2110862584 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae5809e230 0x7fae5812f120 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fae4c00e7e0 tx=0x7fae4c00eaf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:50.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.878+0000 7fae54ff9700 1 -- 172.21.15.40:0/2110862584 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4c00c070 con 0x7fae5809e230 2023-09-30T22:26:50.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.878+0000 7fae54ff9700 1 -- 172.21.15.40:0/2110862584 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4c013610 con 0x7fae5809e230 2023-09-30T22:26:50.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.878+0000 7fae5e8b7700 1 -- 172.21.15.40:0/2110862584 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae5813a1e0 con 0x7fae5809e230 2023-09-30T22:26:50.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.878+0000 7fae54ff9700 1 -- 172.21.15.40:0/2110862584 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4c013980 con 0x7fae5809e230 2023-09-30T22:26:50.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.878+0000 7fae5e8b7700 1 -- 172.21.15.40:0/2110862584 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae58132db0 con 0x7fae5809e230 2023-09-30T22:26:50.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.879+0000 7fae54ff9700 1 -- 172.21.15.40:0/2110862584 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fae4c013ae0 con 0x7fae5809e230 2023-09-30T22:26:50.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.879+0000 7fae54ff9700 1 -- 172.21.15.40:0/2110862584 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fae4c03f420 con 0x7fae5809e230 2023-09-30T22:26:50.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.879+0000 7fae5e8b7700 1 -- 172.21.15.40:0/2110862584 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae58062380 con 0x7fae5809e230 2023-09-30T22:26:50.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.888+0000 7fae54ff9700 1 -- 172.21.15.40:0/2110862584 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fae4c010910 con 0x7fae5809e230 2023-09-30T22:26:50.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.898+0000 7f2542cec700 1 Processor -- start 2023-09-30T22:26:50.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.898+0000 7f2542cec700 1 -- start start 2023-09-30T22:26:50.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.899+0000 7f2542cec700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f253c133e00 0x7f253c1341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.899+0000 7f2542cec700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f253c09df40 0x7f253c13bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.899+0000 7f2542cec700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f253c133940 con 0x7f253c09d400 2023-09-30T22:26:50.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.899+0000 7f2542cec700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253c09ab20 con 0x7f253c09df40 2023-09-30T22:26:50.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.899+0000 7f2542cec700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f253c09f0d0 con 0x7f253c133e00 2023-09-30T22:26:50.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.899+0000 7f2540a88700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f253c133e00 0x7f253c1341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.899+0000 7f253bfff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f253c09d400 0x7f253c09d830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60692/0 (socket says 172.21.15.40:60692) 2023-09-30T22:26:50.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.899+0000 7f253bfff700 1 -- 172.21.15.40:0/3868137988 learned_addr learned my addr 172.21.15.40:0/3868137988 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:50.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.899+0000 7f2541289700 1 --2- 172.21.15.40:0/3868137988 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f253c09df40 0x7f253c13bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.899+0000 7f2540a88700 1 -- 172.21.15.40:0/3868137988 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f253c09df40 msgr2=0x7f253c13bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:50.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.899+0000 7f2540a88700 1 --2- 172.21.15.40:0/3868137988 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f253c09df40 0x7f253c13bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.899+0000 7f2540a88700 1 -- 172.21.15.40:0/3868137988 >> v1:172.21.15.40:6789/0 conn(0x7f253c09d400 legacy=0x7f253c09d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.899+0000 7f253b7fe700 1 -- 172.21.15.40:0/3868137988 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4043251506 0 0) 0x7f253c133940 con 0x7f253c09d400 2023-09-30T22:26:50.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.899+0000 7f2540a88700 1 -- 172.21.15.40:0/3868137988 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253c133be0 con 0x7f253c133e00 2023-09-30T22:26:50.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.900+0000 7f2540a88700 1 --2- 172.21.15.40:0/3868137988 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f253c133e00 0x7f253c1341d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f252c009870 tx=0x7f252c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fda859b878adc04 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:50.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.900+0000 7f253b7fe700 1 -- 172.21.15.40:0/3868137988 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c011830 con 0x7f253c133e00 2023-09-30T22:26:50.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.900+0000 7f253b7fe700 1 -- 172.21.15.40:0/3868137988 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252c011990 con 0x7f253c133e00 2023-09-30T22:26:50.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.900+0000 7f253b7fe700 1 -- 172.21.15.40:0/3868137988 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c011d20 con 0x7f253c133e00 2023-09-30T22:26:50.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.900+0000 7f2542cec700 1 -- 172.21.15.40:0/3868137988 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f253c133e00 msgr2=0x7f253c1341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.900+0000 7f2542cec700 1 --2- 172.21.15.40:0/3868137988 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f253c133e00 0x7f253c1341d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f252c009870 tx=0x7f252c009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:50.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.901+0000 7f2542cec700 1 -- 172.21.15.40:0/3868137988 shutdown_connections 2023-09-30T22:26:50.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.901+0000 7f2542cec700 1 --2- 172.21.15.40:0/3868137988 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f253c09df40 0x7f253c13bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.901+0000 7f2542cec700 1 --2- 172.21.15.40:0/3868137988 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f253c133e00 0x7f253c1341d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.901+0000 7f2542cec700 1 -- 172.21.15.40:0/3868137988 >> 172.21.15.40:0/3868137988 conn(0x7f253c0a2a00 msgr2=0x7f253c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:50.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.901+0000 7f2542cec700 1 -- 172.21.15.40:0/3868137988 shutdown_connections 2023-09-30T22:26:50.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.901+0000 7f2542cec700 1 -- 172.21.15.40:0/3868137988 wait complete. 2023-09-30T22:26:50.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.902+0000 7f2542cec700 1 Processor -- start 2023-09-30T22:26:50.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.902+0000 7f2542cec700 1 -- start start 2023-09-30T22:26:50.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.902+0000 7f2542cec700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f253c09d400 0x7f253c11aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.902+0000 7f2542cec700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f253c09df40 0x7f253c11afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.902+0000 7f2542cec700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f253c133e00 0x7f253c11b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.902+0000 7f2542cec700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253c11dd40 con 0x7f253c09df40 2023-09-30T22:26:50.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.902+0000 7f2542cec700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253c11c6d0 con 0x7f253c09d400 2023-09-30T22:26:50.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.902+0000 7f2542cec700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f253c11e1f0 con 0x7f253c133e00 2023-09-30T22:26:50.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.903+0000 7f2540a88700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f253c09d400 0x7f253c11aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.903+0000 7f2540a88700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f253c09d400 0x7f253c11aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:43080/0 (socket says 172.21.15.40:43080) 2023-09-30T22:26:50.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.903+0000 7f2540a88700 1 -- 172.21.15.40:0/583150867 learned_addr learned my addr 172.21.15.40:0/583150867 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:50.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.903+0000 7f253bfff700 1 --2- 172.21.15.40:0/583150867 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f253c09df40 0x7f253c11afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.903+0000 7f2541289700 1 --2- 172.21.15.40:0/583150867 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f253c133e00 0x7f253c11b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.903+0000 7f2540a88700 1 -- 172.21.15.40:0/583150867 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f253c133e00 msgr2=0x7f253c11b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.903+0000 7f2540a88700 1 --2- 172.21.15.40:0/583150867 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f253c133e00 0x7f253c11b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.903+0000 7f2540a88700 1 -- 172.21.15.40:0/583150867 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f253c09df40 msgr2=0x7f253c11afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.903+0000 7f2540a88700 1 --2- 172.21.15.40:0/583150867 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f253c09df40 0x7f253c11afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.903+0000 7f2540a88700 1 -- 172.21.15.40:0/583150867 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f252c0094a0 con 0x7f253c09d400 2023-09-30T22:26:50.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.903+0000 7f2540a88700 1 --2- 172.21.15.40:0/583150867 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f253c09d400 0x7f253c11aa70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f252c009bc0 tx=0x7f252c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:50.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.904+0000 7f25397fa700 1 -- 172.21.15.40:0/583150867 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c004450 con 0x7f253c09d400 2023-09-30T22:26:50.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.904+0000 7f25397fa700 1 -- 172.21.15.40:0/583150867 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252c0045b0 con 0x7f253c09d400 2023-09-30T22:26:50.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.904+0000 7f25397fa700 1 -- 172.21.15.40:0/583150867 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c0038c0 con 0x7f253c09d400 2023-09-30T22:26:50.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.904+0000 7f2542cec700 1 -- 172.21.15.40:0/583150867 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f253c11cb70 con 0x7f253c09d400 2023-09-30T22:26:50.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.904+0000 7f2542cec700 1 -- 172.21.15.40:0/583150867 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f253c11e4d0 con 0x7f253c09d400 2023-09-30T22:26:50.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.905+0000 7f25397fa700 1 -- 172.21.15.40:0/583150867 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f252c003a20 con 0x7f253c09d400 2023-09-30T22:26:50.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.905+0000 7f2542cec700 1 -- 172.21.15.40:0/583150867 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f253c12fb50 con 0x7f253c09d400 2023-09-30T22:26:50.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.905+0000 7f25397fa700 1 -- 172.21.15.40:0/583150867 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f252c040280 con 0x7f253c09d400 2023-09-30T22:26:50.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.914+0000 7f25397fa700 1 -- 172.21.15.40:0/583150867 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f252c01a420 con 0x7f253c09d400 2023-09-30T22:26:50.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.969+0000 7fbc0db9c700 1 Processor -- start 2023-09-30T22:26:50.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.970+0000 7fbc0db9c700 1 -- start start 2023-09-30T22:26:50.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.970+0000 7fbc0db9c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc0806a6d0 0x7fbc0806aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.970+0000 7fbc0db9c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc08131fc0 0x7fbc08139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.970+0000 7fbc0db9c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc0809eb50 con 0x7fbc0806afe0 2023-09-30T22:26:50.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.970+0000 7fbc0db9c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0809dde0 con 0x7fbc08131fc0 2023-09-30T22:26:50.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.970+0000 7fbc0db9c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0809d4a0 con 0x7fbc0806a6d0 2023-09-30T22:26:50.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.971+0000 7fbc07fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc08131fc0 0x7fbc08139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.971+0000 7fbc07fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc08131fc0 0x7fbc08139b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:43084/0 (socket says 172.21.15.40:43084) 2023-09-30T22:26:50.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.971+0000 7fbc06ffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbc0806afe0 0x7fbc081318b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60704/0 (socket says 172.21.15.40:60704) 2023-09-30T22:26:50.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.971+0000 7fbc07fff700 1 -- 172.21.15.40:0/1986867924 learned_addr learned my addr 172.21.15.40:0/1986867924 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:50.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.971+0000 7fbc077fe700 1 --2- 172.21.15.40:0/1986867924 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc0806a6d0 0x7fbc0806aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.971+0000 7fbc07fff700 1 -- 172.21.15.40:0/1986867924 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc0806a6d0 msgr2=0x7fbc0806aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:50.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.971+0000 7fbc07fff700 1 --2- 172.21.15.40:0/1986867924 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc0806a6d0 0x7fbc0806aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.971+0000 7fbc067fc700 1 -- 172.21.15.40:0/1986867924 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 509393085 0 0) 0x7fbc0809eb50 con 0x7fbc0806afe0 2023-09-30T22:26:50.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.971+0000 7fbc07fff700 1 -- 172.21.15.40:0/1986867924 >> v1:172.21.15.40:6789/0 conn(0x7fbc0806afe0 legacy=0x7fbc081318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.971+0000 7fbc07fff700 1 -- 172.21.15.40:0/1986867924 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc0809f5f0 con 0x7fbc08131fc0 2023-09-30T22:26:50.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.971+0000 7fbc07fff700 1 --2- 172.21.15.40:0/1986867924 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc08131fc0 0x7fbc08139b10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbc00009e80 tx=0x7fbc0000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5adb7dae94c44562 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:50.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.971+0000 7fbc067fc700 1 -- 172.21.15.40:0/1986867924 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0000e070 con 0x7fbc08131fc0 2023-09-30T22:26:50.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.972+0000 7fbc067fc700 1 -- 172.21.15.40:0/1986867924 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc0000b910 con 0x7fbc08131fc0 2023-09-30T22:26:50.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.972+0000 7fbc067fc700 1 -- 172.21.15.40:0/1986867924 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0000bcc0 con 0x7fbc08131fc0 2023-09-30T22:26:50.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.972+0000 7fbc0db9c700 1 -- 172.21.15.40:0/1986867924 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc08131fc0 msgr2=0x7fbc08139b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.972+0000 7fbc0db9c700 1 --2- 172.21.15.40:0/1986867924 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc08131fc0 0x7fbc08139b10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbc00009e80 tx=0x7fbc0000b330 comp rx=0 tx=0).stop 2023-09-30T22:26:50.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.972+0000 7fbc0db9c700 1 -- 172.21.15.40:0/1986867924 shutdown_connections 2023-09-30T22:26:50.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.972+0000 7fbc0db9c700 1 --2- 172.21.15.40:0/1986867924 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc08131fc0 0x7fbc08139b10 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.972+0000 7fbc0db9c700 1 --2- 172.21.15.40:0/1986867924 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc0806a6d0 0x7fbc0806aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.972+0000 7fbc0db9c700 1 -- 172.21.15.40:0/1986867924 >> 172.21.15.40:0/1986867924 conn(0x7fbc0809fb20 msgr2=0x7fbc0809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:50.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.972+0000 7fbc0db9c700 1 -- 172.21.15.40:0/1986867924 shutdown_connections 2023-09-30T22:26:50.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.972+0000 7fbc0db9c700 1 -- 172.21.15.40:0/1986867924 wait complete. 2023-09-30T22:26:50.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.973+0000 7fbc0db9c700 1 Processor -- start 2023-09-30T22:26:50.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.974+0000 7fbc0db9c700 1 -- start start 2023-09-30T22:26:50.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.974+0000 7fbc0db9c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc0806a6d0 0x7fbc081204f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.974+0000 7fbc0db9c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc0806afe0 0x7fbc08120a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.974+0000 7fbc0db9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc08131fc0 0x7fbc08120f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.974+0000 7fbc0db9c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc080a3c30 con 0x7fbc08131fc0 2023-09-30T22:26:50.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.974+0000 7fbc0db9c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc08071560 con 0x7fbc0806afe0 2023-09-30T22:26:50.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.974+0000 7fbc0db9c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc08122820 con 0x7fbc0806a6d0 2023-09-30T22:26:50.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.974+0000 7fbc06ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc0806afe0 0x7fbc08120a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.974+0000 7fbc06ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc0806afe0 0x7fbc08120a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:43094/0 (socket says 172.21.15.40:43094) 2023-09-30T22:26:50.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.974+0000 7fbc06ffd700 1 -- 172.21.15.40:0/2828114786 learned_addr learned my addr 172.21.15.40:0/2828114786 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:50.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.974+0000 7fbc077fe700 1 --2- 172.21.15.40:0/2828114786 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc0806a6d0 0x7fbc081204f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.974+0000 7fbc07fff700 1 --2- 172.21.15.40:0/2828114786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc08131fc0 0x7fbc08120f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.975+0000 7fbc06ffd700 1 -- 172.21.15.40:0/2828114786 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc0806a6d0 msgr2=0x7fbc081204f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.975+0000 7fbc06ffd700 1 --2- 172.21.15.40:0/2828114786 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc0806a6d0 0x7fbc081204f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.975+0000 7fbc06ffd700 1 -- 172.21.15.40:0/2828114786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc08131fc0 msgr2=0x7fbc08120f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.975+0000 7fbc06ffd700 1 --2- 172.21.15.40:0/2828114786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc08131fc0 0x7fbc08120f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.975+0000 7fbc06ffd700 1 -- 172.21.15.40:0/2828114786 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc00009b30 con 0x7fbc0806afe0 2023-09-30T22:26:50.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.975+0000 7fbc06ffd700 1 --2- 172.21.15.40:0/2828114786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc0806afe0 0x7fbc08120a30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc0011e0 tx=0x7fbbfc00ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:50.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.975+0000 7fbbeffff700 1 -- 172.21.15.40:0/2828114786 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc004c80 con 0x7fbc0806afe0 2023-09-30T22:26:50.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.975+0000 7fbbeffff700 1 -- 172.21.15.40:0/2828114786 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbfc004e00 con 0x7fbc0806afe0 2023-09-30T22:26:50.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.975+0000 7fbc0db9c700 1 -- 172.21.15.40:0/2828114786 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc08122df0 con 0x7fbc0806afe0 2023-09-30T22:26:50.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.975+0000 7fbbeffff700 1 -- 172.21.15.40:0/2828114786 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc007310 con 0x7fbc0806afe0 2023-09-30T22:26:50.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.975+0000 7fbc0db9c700 1 -- 172.21.15.40:0/2828114786 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc08123f80 con 0x7fbc0806afe0 2023-09-30T22:26:50.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.976+0000 7fbbeffff700 1 -- 172.21.15.40:0/2828114786 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbbfc007470 con 0x7fbc0806afe0 2023-09-30T22:26:50.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.976+0000 7fbc0db9c700 1 -- 172.21.15.40:0/2828114786 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc08062380 con 0x7fbc0806afe0 2023-09-30T22:26:50.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.976+0000 7fbbeffff700 1 -- 172.21.15.40:0/2828114786 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fbbfc03f310 con 0x7fbc0806afe0 2023-09-30T22:26:50.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.985+0000 7fbbeffff700 1 -- 172.21.15.40:0/2828114786 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbbfc0133c0 con 0x7fbc0806afe0 2023-09-30T22:26:50.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.996+0000 7f7645e97700 1 Processor -- start 2023-09-30T22:26:50.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.996+0000 7f7645e97700 1 -- start start 2023-09-30T22:26:50.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.997+0000 7f7645e97700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f764009d920 0x7f764009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.997+0000 7f7645e97700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f764009e230 0x7f76401308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.997+0000 7f7645e97700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7640130de0 0x7f7640131280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.997+0000 7f7645e97700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f764009edf0 con 0x7f7640130de0 2023-09-30T22:26:50.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.997+0000 7f7645e97700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764009adf0 con 0x7f764009e230 2023-09-30T22:26:50.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.997+0000 7f7645e97700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f764009b660 con 0x7f764009d920 2023-09-30T22:26:50.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.997+0000 7f763ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7640130de0 0x7f7640131280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.997+0000 7f763f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f764009d920 0x7f764009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.997+0000 7f763ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7640130de0 0x7f7640131280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49236/0 (socket says 172.21.15.40:49236) 2023-09-30T22:26:50.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.997+0000 7f763ffff700 1 -- 172.21.15.40:0/1206107889 learned_addr learned my addr 172.21.15.40:0/1206107889 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:51.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.997+0000 7f763f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f764009d920 0x7f764009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60630/0 (socket says 172.21.15.40:60630) 2023-09-30T22:26:51.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.998+0000 7f763ffff700 1 -- 172.21.15.40:0/1206107889 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f764009d920 msgr2=0x7f764009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:51.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.998+0000 7f763ffff700 1 --2- 172.21.15.40:0/1206107889 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f764009d920 0x7f764009dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:51.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.998+0000 7f763ffff700 1 -- 172.21.15.40:0/1206107889 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f764009e230 msgr2=0x7f76401308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:51.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.998+0000 7f763ffff700 1 --2- 172.21.15.40:0/1206107889 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f764009e230 0x7f76401308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:51.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.998+0000 7f763ffff700 1 -- 172.21.15.40:0/1206107889 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764009a6e0 con 0x7f7640130de0 2023-09-30T22:26:51.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.998+0000 7f763ffff700 1 --2- 172.21.15.40:0/1206107889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7640130de0 0x7f7640131280 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7638009e50 tx=0x7f763800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b928adf4d6c972f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:51.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.998+0000 7f763e7fc700 1 -- 172.21.15.40:0/1206107889 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763800e070 con 0x7f7640130de0 2023-09-30T22:26:51.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.998+0000 7f763e7fc700 1 -- 172.21.15.40:0/1206107889 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763800b910 con 0x7f7640130de0 2023-09-30T22:26:51.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.998+0000 7f763e7fc700 1 -- 172.21.15.40:0/1206107889 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763800bcc0 con 0x7f7640130de0 2023-09-30T22:26:51.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.998+0000 7f7645e97700 1 -- 172.21.15.40:0/1206107889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7640130de0 msgr2=0x7f7640131280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:51.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.998+0000 7f7645e97700 1 --2- 172.21.15.40:0/1206107889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7640130de0 0x7f7640131280 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7638009e50 tx=0x7f763800b330 comp rx=0 tx=0).stop 2023-09-30T22:26:51.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.999+0000 7f7645e97700 1 -- 172.21.15.40:0/1206107889 shutdown_connections 2023-09-30T22:26:51.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.999+0000 7f7645e97700 1 --2- 172.21.15.40:0/1206107889 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f764009d920 0x7f764009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:51.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.999+0000 7f7645e97700 1 --2- 172.21.15.40:0/1206107889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7640130de0 0x7f7640131280 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:51.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.999+0000 7f7645e97700 1 --2- 172.21.15.40:0/1206107889 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f764009e230 0x7f76401308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:51.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.999+0000 7f7645e97700 1 -- 172.21.15.40:0/1206107889 >> 172.21.15.40:0/1206107889 conn(0x7f764009fb20 msgr2=0x7f764009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:51.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.999+0000 7f7645e97700 1 -- 172.21.15.40:0/1206107889 shutdown_connections 2023-09-30T22:26:51.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.999+0000 7f7645e97700 1 -- 172.21.15.40:0/1206107889 wait complete. 2023-09-30T22:26:51.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:50.999+0000 7f7645e97700 1 Processor -- start 2023-09-30T22:26:51.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.000+0000 7f7645e97700 1 -- start start 2023-09-30T22:26:51.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.000+0000 7f7645e97700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f764009d920 0x7f76401c4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:51.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.000+0000 7f7645e97700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f764009e230 0x7f76401c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:51.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.000+0000 7f7645e97700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7640130de0 0x7f7640119730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:51.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.000+0000 7f7645e97700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764012c6c0 con 0x7f7640130de0 2023-09-30T22:26:51.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.000+0000 7f7645e97700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76401c3fb0 con 0x7f764009e230 2023-09-30T22:26:51.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.000+0000 7f7645e97700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f764011ca60 con 0x7f764009d920 2023-09-30T22:26:51.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.001+0000 7f763effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f764009e230 0x7f76401c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:51.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.001+0000 7f763f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f764009d920 0x7f76401c4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:51.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.001+0000 7f763effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f764009e230 0x7f76401c49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:43108/0 (socket says 172.21.15.40:43108) 2023-09-30T22:26:51.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.001+0000 7f763effd700 1 -- 172.21.15.40:0/1055148626 learned_addr learned my addr 172.21.15.40:0/1055148626 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:51.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.001+0000 7f763f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f764009d920 0x7f76401c4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60642/0 (socket says 172.21.15.40:60642) 2023-09-30T22:26:51.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.001+0000 7f763ffff700 1 --2- 172.21.15.40:0/1055148626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7640130de0 0x7f7640119730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:51.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.001+0000 7f763effd700 1 -- 172.21.15.40:0/1055148626 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f764009d920 msgr2=0x7f76401c4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:51.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.001+0000 7f763effd700 1 --2- 172.21.15.40:0/1055148626 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f764009d920 0x7f76401c4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:51.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.001+0000 7f763effd700 1 -- 172.21.15.40:0/1055148626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7640130de0 msgr2=0x7f7640119730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:51.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.001+0000 7f763effd700 1 --2- 172.21.15.40:0/1055148626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7640130de0 0x7f7640119730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:51.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.001+0000 7f763effd700 1 -- 172.21.15.40:0/1055148626 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7638009b30 con 0x7f764009e230 2023-09-30T22:26:51.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.001+0000 7f763effd700 1 --2- 172.21.15.40:0/1055148626 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f764009e230 0x7f76401c49d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f763400fa10 tx=0x7f763400fd20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:51.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.001+0000 7f7627fff700 1 -- 172.21.15.40:0/1055148626 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7634007770 con 0x7f764009e230 2023-09-30T22:26:51.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.001+0000 7f7645e97700 1 -- 172.21.15.40:0/1055148626 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f764011ba50 con 0x7f764009e230 2023-09-30T22:26:51.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.001+0000 7f7645e97700 1 -- 172.21.15.40:0/1055148626 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f764011bf60 con 0x7f764009e230 2023-09-30T22:26:51.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.001+0000 7f7627fff700 1 -- 172.21.15.40:0/1055148626 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763400b070 con 0x7f764009e230 2023-09-30T22:26:51.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.001+0000 7f7627fff700 1 -- 172.21.15.40:0/1055148626 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7634007b30 con 0x7f764009e230 2023-09-30T22:26:51.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.003+0000 7f7645e97700 1 -- 172.21.15.40:0/1055148626 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76200052e0 con 0x7f764009e230 2023-09-30T22:26:51.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.003+0000 7f7627fff700 1 -- 172.21.15.40:0/1055148626 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7634007c90 con 0x7f764009e230 2023-09-30T22:26:51.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.003+0000 7f7627fff700 1 -- 172.21.15.40:0/1055148626 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f7634017780 con 0x7f764009e230 2023-09-30T22:26:51.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.012+0000 7f7627fff700 1 -- 172.21.15.40:0/1055148626 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7634017400 con 0x7f764009e230 2023-09-30T22:26:51.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.105+0000 7fae5e8b7700 1 -- 172.21.15.40:0/2110862584 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fae58132c10 con 0x7fae5809e230 2023-09-30T22:26:51.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.106+0000 7fae54ff9700 1 -- 172.21.15.40:0/2110862584 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fae58132c10 con 0x7fae5809e230 2023-09-30T22:26:51.107 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:51.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.109+0000 7fae5e8b7700 1 -- 172.21.15.40:0/2110862584 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae5809e230 msgr2=0x7fae5812f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:51.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.109+0000 7fae5e8b7700 1 --2- 172.21.15.40:0/2110862584 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae5809e230 0x7fae5812f120 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fae4c00e7e0 tx=0x7fae4c00eaf0 comp rx=0 tx=0).stop 2023-09-30T22:26:51.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.109+0000 7fae5e8b7700 1 -- 172.21.15.40:0/2110862584 shutdown_connections 2023-09-30T22:26:51.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.109+0000 7fae5e8b7700 1 --2- 172.21.15.40:0/2110862584 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae58130de0 0x7fae5812f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:51.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.109+0000 7fae5e8b7700 1 --2- 172.21.15.40:0/2110862584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae5809d920 0x7fae5812ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:51.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.109+0000 7fae5e8b7700 1 --2- 172.21.15.40:0/2110862584 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae5809e230 0x7fae5812f120 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:51.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.109+0000 7fae5e8b7700 1 -- 172.21.15.40:0/2110862584 >> 172.21.15.40:0/2110862584 conn(0x7fae5809fb20 msgr2=0x7fae5806ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:51.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.109+0000 7fae5e8b7700 1 -- 172.21.15.40:0/2110862584 shutdown_connections 2023-09-30T22:26:51.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.109+0000 7fae5e8b7700 1 -- 172.21.15.40:0/2110862584 wait complete. 2023-09-30T22:26:51.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.119+0000 7f2542cec700 1 -- 172.21.15.40:0/583150867 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f253c062380 con 0x7f253c09d400 2023-09-30T22:26:51.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.119+0000 7f25397fa700 1 -- 172.21.15.40:0/583150867 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f252c028030 con 0x7f253c09d400 2023-09-30T22:26:51.120 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:51.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.121+0000 7f2542cec700 1 -- 172.21.15.40:0/583150867 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f253c09d400 msgr2=0x7f253c11aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:51.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.121+0000 7f2542cec700 1 --2- 172.21.15.40:0/583150867 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f253c09d400 0x7f253c11aa70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f252c009bc0 tx=0x7f252c004750 comp rx=0 tx=0).stop 2023-09-30T22:26:51.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.121+0000 7f2542cec700 1 -- 172.21.15.40:0/583150867 shutdown_connections 2023-09-30T22:26:51.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.121+0000 7f2542cec700 1 --2- 172.21.15.40:0/583150867 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f253c133e00 0x7f253c11b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:51.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.121+0000 7f2542cec700 1 --2- 172.21.15.40:0/583150867 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f253c09d400 0x7f253c11aa70 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:51.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.121+0000 7f2542cec700 1 --2- 172.21.15.40:0/583150867 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f253c09df40 0x7f253c11afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:51.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.121+0000 7f2542cec700 1 -- 172.21.15.40:0/583150867 >> 172.21.15.40:0/583150867 conn(0x7f253c0a2a00 msgr2=0x7f253c1bb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:51.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.121+0000 7f2542cec700 1 -- 172.21.15.40:0/583150867 shutdown_connections 2023-09-30T22:26:51.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.121+0000 7f2542cec700 1 -- 172.21.15.40:0/583150867 wait complete. 2023-09-30T22:26:51.127 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:51.135 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:51.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.186+0000 7fbc0db9c700 1 -- 172.21.15.40:0/2828114786 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbc08074720 con 0x7fbc0806afe0 2023-09-30T22:26:51.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.186+0000 7fbbeffff700 1 -- 172.21.15.40:0/2828114786 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbbfc01b340 con 0x7fbc0806afe0 2023-09-30T22:26:51.187 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:51.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.188+0000 7fbc0db9c700 1 -- 172.21.15.40:0/2828114786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc0806afe0 msgr2=0x7fbc08120a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:51.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.188+0000 7fbc0db9c700 1 --2- 172.21.15.40:0/2828114786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc0806afe0 0x7fbc08120a30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc0011e0 tx=0x7fbbfc00ca30 comp rx=0 tx=0).stop 2023-09-30T22:26:51.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.188+0000 7fbc0db9c700 1 -- 172.21.15.40:0/2828114786 shutdown_connections 2023-09-30T22:26:51.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.188+0000 7fbc0db9c700 1 --2- 172.21.15.40:0/2828114786 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc0806a6d0 0x7fbc081204f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:51.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.188+0000 7fbc0db9c700 1 --2- 172.21.15.40:0/2828114786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc08131fc0 0x7fbc08120f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:51.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.188+0000 7fbc0db9c700 1 --2- 172.21.15.40:0/2828114786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc0806afe0 0x7fbc08120a30 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:51.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.188+0000 7fbc0db9c700 1 -- 172.21.15.40:0/2828114786 >> 172.21.15.40:0/2828114786 conn(0x7fbc0809fb20 msgr2=0x7fbc0806f540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:51.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.188+0000 7fbc0db9c700 1 -- 172.21.15.40:0/2828114786 shutdown_connections 2023-09-30T22:26:51.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.188+0000 7fbc0db9c700 1 -- 172.21.15.40:0/2828114786 wait complete. 2023-09-30T22:26:51.205 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:51.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.226+0000 7f7645e97700 1 -- 172.21.15.40:0/1055148626 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7620005590 con 0x7f764009e230 2023-09-30T22:26:51.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.226+0000 7f7627fff700 1 -- 172.21.15.40:0/1055148626 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f763401b170 con 0x7f764009e230 2023-09-30T22:26:51.227 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:51.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.228+0000 7f7645e97700 1 -- 172.21.15.40:0/1055148626 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f764009e230 msgr2=0x7f76401c49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:51.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.228+0000 7f7645e97700 1 --2- 172.21.15.40:0/1055148626 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f764009e230 0x7f76401c49d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f763400fa10 tx=0x7f763400fd20 comp rx=0 tx=0).stop 2023-09-30T22:26:51.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.228+0000 7f7645e97700 1 -- 172.21.15.40:0/1055148626 shutdown_connections 2023-09-30T22:26:51.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.228+0000 7f7645e97700 1 --2- 172.21.15.40:0/1055148626 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f764009d920 0x7f76401c4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:51.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.228+0000 7f7645e97700 1 --2- 172.21.15.40:0/1055148626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7640130de0 0x7f7640119730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:51.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.228+0000 7f7645e97700 1 --2- 172.21.15.40:0/1055148626 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f764009e230 0x7f76401c49d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:51.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.228+0000 7f7645e97700 1 -- 172.21.15.40:0/1055148626 >> 172.21.15.40:0/1055148626 conn(0x7f764009fb20 msgr2=0x7f764012df40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:51.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.228+0000 7f7645e97700 1 -- 172.21.15.40:0/1055148626 shutdown_connections 2023-09-30T22:26:51.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:51.229+0000 7f7645e97700 1 -- 172.21.15.40:0/1055148626 wait complete. 2023-09-30T22:26:51.241 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:52.128 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:52.135 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:52.205 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:52.242 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:52.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.272+0000 7f33c042d700 1 Processor -- start 2023-09-30T22:26:52.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.272+0000 7f33c042d700 1 -- start start 2023-09-30T22:26:52.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.273+0000 7f33c042d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f33b806a6d0 0x7f33b806aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.273+0000 7f33c042d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f33b8131fc0 0x7f33b8139b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.273+0000 7f33c042d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b809eb60 con 0x7f33b806afe0 2023-09-30T22:26:52.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.273+0000 7f33c042d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b809db70 con 0x7f33b8131fc0 2023-09-30T22:26:52.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.273+0000 7f33c042d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33b809ddf0 con 0x7f33b806a6d0 2023-09-30T22:26:52.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.273+0000 7f33be9ca700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f33b8131fc0 0x7f33b8139b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.273+0000 7f33be9ca700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f33b8131fc0 0x7f33b8139b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49246/0 (socket says 172.21.15.40:49246) 2023-09-30T22:26:52.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.273+0000 7f33be9ca700 1 -- 172.21.15.40:0/2990988364 learned_addr learned my addr 172.21.15.40:0/2990988364 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:52.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.273+0000 7f33be1c9700 1 --2- 172.21.15.40:0/2990988364 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f33b806a6d0 0x7f33b806aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.274+0000 7f33be9ca700 1 -- 172.21.15.40:0/2990988364 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f33b806a6d0 msgr2=0x7f33b806aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:52.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.274+0000 7f33be9ca700 1 --2- 172.21.15.40:0/2990988364 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f33b806a6d0 0x7f33b806aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.274+0000 7f33be9ca700 1 -- 172.21.15.40:0/2990988364 >> v1:172.21.15.40:6789/0 conn(0x7f33b806afe0 legacy=0x7f33b81318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.274+0000 7f33be9ca700 1 -- 172.21.15.40:0/2990988364 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b809c9a0 con 0x7f33b8131fc0 2023-09-30T22:26:52.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.274+0000 7f33be9ca700 1 --2- 172.21.15.40:0/2990988364 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33b8131fc0 0x7f33b8139b80 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f33b0009e50 tx=0x7f33b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef2f8948770ddf1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:52.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.274+0000 7f33bd1c7700 1 -- 172.21.15.40:0/2990988364 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b000e070 con 0x7f33b8131fc0 2023-09-30T22:26:52.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.274+0000 7f33bd1c7700 1 -- 172.21.15.40:0/2990988364 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b000b910 con 0x7f33b8131fc0 2023-09-30T22:26:52.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.274+0000 7f33bd1c7700 1 -- 172.21.15.40:0/2990988364 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b000bcc0 con 0x7f33b8131fc0 2023-09-30T22:26:52.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.275+0000 7f33c042d700 1 -- 172.21.15.40:0/2990988364 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33b8131fc0 msgr2=0x7f33b8139b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.275+0000 7f33c042d700 1 --2- 172.21.15.40:0/2990988364 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33b8131fc0 0x7f33b8139b80 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f33b0009e50 tx=0x7f33b000b330 comp rx=0 tx=0).stop 2023-09-30T22:26:52.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.275+0000 7f33c042d700 1 -- 172.21.15.40:0/2990988364 shutdown_connections 2023-09-30T22:26:52.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.275+0000 7f33c042d700 1 --2- 172.21.15.40:0/2990988364 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33b8131fc0 0x7f33b8139b80 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.275+0000 7f33c042d700 1 --2- 172.21.15.40:0/2990988364 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f33b806a6d0 0x7f33b806aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.275+0000 7f33c042d700 1 -- 172.21.15.40:0/2990988364 >> 172.21.15.40:0/2990988364 conn(0x7f33b809fb20 msgr2=0x7f33b809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:52.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.275+0000 7f33c042d700 1 -- 172.21.15.40:0/2990988364 shutdown_connections 2023-09-30T22:26:52.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.275+0000 7f33c042d700 1 -- 172.21.15.40:0/2990988364 wait complete. 2023-09-30T22:26:52.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.277+0000 7f33c042d700 1 Processor -- start 2023-09-30T22:26:52.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.277+0000 7f33c042d700 1 -- start start 2023-09-30T22:26:52.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.277+0000 7f33c042d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f33b806a6d0 0x7f33b81c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.277+0000 7f33c042d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33b806afe0 0x7f33b81c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.277+0000 7f33c042d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33b8131fc0 0x7f33b8130d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.277+0000 7f33c042d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b81199d0 con 0x7f33b8131fc0 2023-09-30T22:26:52.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.277+0000 7f33c042d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b81c9460 con 0x7f33b806afe0 2023-09-30T22:26:52.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.277+0000 7f33c042d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33b809c440 con 0x7f33b806a6d0 2023-09-30T22:26:52.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.278+0000 7f33be1c9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f33b806a6d0 0x7f33b81c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.278+0000 7f33be1c9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f33b806a6d0 0x7f33b81c89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60654/0 (socket says 172.21.15.40:60654) 2023-09-30T22:26:52.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.278+0000 7f33be1c9700 1 -- 172.21.15.40:0/943591513 learned_addr learned my addr 172.21.15.40:0/943591513 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:52.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.278+0000 7f33bd9c8700 1 --2- 172.21.15.40:0/943591513 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33b806afe0 0x7f33b81c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.278+0000 7f33be9ca700 1 --2- 172.21.15.40:0/943591513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33b8131fc0 0x7f33b8130d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.278+0000 7f33be1c9700 1 -- 172.21.15.40:0/943591513 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33b806afe0 msgr2=0x7f33b81c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.278+0000 7f33be1c9700 1 --2- 172.21.15.40:0/943591513 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33b806afe0 0x7f33b81c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.278+0000 7f33be1c9700 1 -- 172.21.15.40:0/943591513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33b8131fc0 msgr2=0x7f33b8130d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.278+0000 7f33be1c9700 1 --2- 172.21.15.40:0/943591513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33b8131fc0 0x7f33b8130d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.278+0000 7f33be1c9700 1 -- 172.21.15.40:0/943591513 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b0009b30 con 0x7f33b806a6d0 2023-09-30T22:26:52.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.278+0000 7f33be1c9700 1 --2- 172.21.15.40:0/943591513 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f33b806a6d0 0x7f33b81c89e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f33b400e900 tx=0x7f33b400ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:52.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.278+0000 7f33aeffd700 1 -- 172.21.15.40:0/943591513 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b4009650 con 0x7f33b806a6d0 2023-09-30T22:26:52.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.278+0000 7f33aeffd700 1 -- 172.21.15.40:0/943591513 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b400ee50 con 0x7f33b806a6d0 2023-09-30T22:26:52.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.278+0000 7f33c042d700 1 -- 172.21.15.40:0/943591513 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33b809e420 con 0x7f33b806a6d0 2023-09-30T22:26:52.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.279+0000 7f33aeffd700 1 -- 172.21.15.40:0/943591513 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b400ca50 con 0x7f33b806a6d0 2023-09-30T22:26:52.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.279+0000 7f33c042d700 1 -- 172.21.15.40:0/943591513 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b8138d20 con 0x7f33b806a6d0 2023-09-30T22:26:52.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.279+0000 7f33aeffd700 1 -- 172.21.15.40:0/943591513 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f33b400cbb0 con 0x7f33b806a6d0 2023-09-30T22:26:52.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.280+0000 7f33aeffd700 1 -- 172.21.15.40:0/943591513 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f33b403fab0 con 0x7f33b806a6d0 2023-09-30T22:26:52.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.280+0000 7f33c042d700 1 -- 172.21.15.40:0/943591513 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33b8119b10 con 0x7f33b806a6d0 2023-09-30T22:26:52.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.285+0000 7f33aeffd700 1 -- 172.21.15.40:0/943591513 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f33b8119b10 con 0x7f33b806a6d0 2023-09-30T22:26:52.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.315+0000 7f34f8736700 1 Processor -- start 2023-09-30T22:26:52.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.315+0000 7f34f8736700 1 -- start start 2023-09-30T22:26:52.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.316+0000 7f34f8736700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f34f006a6d0 0x7f34f009d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.316+0000 7f34f8736700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34f009de60 0x7f34f009e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.316+0000 7f34f8736700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f34f013c490 0x7f34f013e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.316+0000 7f34f8736700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f006aaa0 con 0x7f34f006a6d0 2023-09-30T22:26:52.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.316+0000 7f34f8736700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f009e790 con 0x7f34f009de60 2023-09-30T22:26:52.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.316+0000 7f34f8736700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34f011d980 con 0x7f34f013c490 2023-09-30T22:26:52.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.316+0000 7f34f64d2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f34f006a6d0 0x7f34f009d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.316+0000 7f34f64d2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f34f006a6d0 0x7f34f009d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49252/0 (socket says 172.21.15.40:49252) 2023-09-30T22:26:52.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.316+0000 7f34f6cd3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f34f013c490 0x7f34f013e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.316+0000 7f34f64d2700 1 -- 172.21.15.40:0/3545973744 learned_addr learned my addr 172.21.15.40:0/3545973744 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:52.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.316+0000 7f34f5cd1700 1 --2- 172.21.15.40:0/3545973744 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34f009de60 0x7f34f009e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.316+0000 7f34f5cd1700 1 -- 172.21.15.40:0/3545973744 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f34f013c490 msgr2=0x7f34f013e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:52.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.316+0000 7f34f5cd1700 1 --2- 172.21.15.40:0/3545973744 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f34f013c490 0x7f34f013e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.316+0000 7f34f5cd1700 1 -- 172.21.15.40:0/3545973744 >> v2:172.21.15.40:3300/0 conn(0x7f34f006a6d0 msgr2=0x7f34f009d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:52.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.316+0000 7f34f5cd1700 1 --2- 172.21.15.40:0/3545973744 >> v2:172.21.15.40:3300/0 conn(0x7f34f006a6d0 0x7f34f009d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.316+0000 7f34f5cd1700 1 -- 172.21.15.40:0/3545973744 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f006b150 con 0x7f34f009de60 2023-09-30T22:26:52.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.316+0000 7f34f64d2700 1 --2- 172.21.15.40:0/3545973744 >> v2:172.21.15.40:3300/0 conn(0x7f34f006a6d0 0x7f34f009d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:52.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.316+0000 7f34f6cd3700 1 --2- 172.21.15.40:0/3545973744 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f34f013c490 0x7f34f013e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:52.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.317+0000 7f34f5cd1700 1 --2- 172.21.15.40:0/3545973744 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34f009de60 0x7f34f009e250 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f34e0009870 tx=0x7f34e0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f095cf283453227a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:52.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.317+0000 7f34f54d0700 1 -- 172.21.15.40:0/3545973744 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e0011830 con 0x7f34f009de60 2023-09-30T22:26:52.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.317+0000 7f34f54d0700 1 -- 172.21.15.40:0/3545973744 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e0011990 con 0x7f34f009de60 2023-09-30T22:26:52.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.317+0000 7f34f54d0700 1 -- 172.21.15.40:0/3545973744 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e0011d20 con 0x7f34f009de60 2023-09-30T22:26:52.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.317+0000 7f34f8736700 1 -- 172.21.15.40:0/3545973744 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34f009de60 msgr2=0x7f34f009e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.317+0000 7f34f8736700 1 --2- 172.21.15.40:0/3545973744 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34f009de60 0x7f34f009e250 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f34e0009870 tx=0x7f34e0009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:52.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.318+0000 7f34f8736700 1 -- 172.21.15.40:0/3545973744 shutdown_connections 2023-09-30T22:26:52.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.318+0000 7f34f8736700 1 --2- 172.21.15.40:0/3545973744 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f34f013c490 0x7f34f013e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.318+0000 7f34f8736700 1 --2- 172.21.15.40:0/3545973744 >> v2:172.21.15.40:3300/0 conn(0x7f34f006a6d0 0x7f34f009d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.318+0000 7f34f8736700 1 --2- 172.21.15.40:0/3545973744 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34f009de60 0x7f34f009e250 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.318+0000 7f34f8736700 1 -- 172.21.15.40:0/3545973744 >> 172.21.15.40:0/3545973744 conn(0x7f34f009fb20 msgr2=0x7f34f009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:52.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.318+0000 7f34f8736700 1 -- 172.21.15.40:0/3545973744 shutdown_connections 2023-09-30T22:26:52.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.318+0000 7f34f8736700 1 -- 172.21.15.40:0/3545973744 wait complete. 2023-09-30T22:26:52.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.319+0000 7f34f8736700 1 Processor -- start 2023-09-30T22:26:52.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.319+0000 7f34f8736700 1 -- start start 2023-09-30T22:26:52.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.319+0000 7f34f8736700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34f006a6d0 0x7f34f01cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.319+0000 7f34f8736700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f34f009de60 0x7f34f01ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.319+0000 7f34f8736700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34f013c490 0x7f34f01cd420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.319+0000 7f34f8736700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f01292e0 con 0x7f34f006a6d0 2023-09-30T22:26:52.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.319+0000 7f34f8736700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f009f540 con 0x7f34f013c490 2023-09-30T22:26:52.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.319+0000 7f34f8736700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34f0129cd0 con 0x7f34f009de60 2023-09-30T22:26:52.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.319+0000 7f34f64d2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34f006a6d0 0x7f34f01cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.319+0000 7f34f64d2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34f006a6d0 0x7f34f01cc9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49256/0 (socket says 172.21.15.40:49256) 2023-09-30T22:26:52.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.319+0000 7f34f64d2700 1 -- 172.21.15.40:0/3661343683 learned_addr learned my addr 172.21.15.40:0/3661343683 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:52.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.319+0000 7f34f6cd3700 1 --2- 172.21.15.40:0/3661343683 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34f013c490 0x7f34f01cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.320+0000 7f34f5cd1700 1 --2- 172.21.15.40:0/3661343683 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f34f009de60 0x7f34f01ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.320+0000 7f34f64d2700 1 -- 172.21.15.40:0/3661343683 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f34f009de60 msgr2=0x7f34f01ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.320+0000 7f34f64d2700 1 --2- 172.21.15.40:0/3661343683 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f34f009de60 0x7f34f01ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.320+0000 7f34f64d2700 1 -- 172.21.15.40:0/3661343683 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34f013c490 msgr2=0x7f34f01cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.320+0000 7f34f64d2700 1 --2- 172.21.15.40:0/3661343683 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34f013c490 0x7f34f01cd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.320+0000 7f34f64d2700 1 -- 172.21.15.40:0/3661343683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ec009500 con 0x7f34f006a6d0 2023-09-30T22:26:52.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.320+0000 7f34f64d2700 1 --2- 172.21.15.40:0/3661343683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34f006a6d0 0x7f34f01cc9a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f34ec00ebb0 tx=0x7f34ec00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:52.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.320+0000 7f34e6ffd700 1 -- 172.21.15.40:0/3661343683 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec009790 con 0x7f34f006a6d0 2023-09-30T22:26:52.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.320+0000 7f34e6ffd700 1 -- 172.21.15.40:0/3661343683 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ec005a20 con 0x7f34f006a6d0 2023-09-30T22:26:52.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.320+0000 7f34f8736700 1 -- 172.21.15.40:0/3661343683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e00094a0 con 0x7f34f006a6d0 2023-09-30T22:26:52.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.320+0000 7f34e6ffd700 1 -- 172.21.15.40:0/3661343683 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec005db0 con 0x7f34f006a6d0 2023-09-30T22:26:52.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.320+0000 7f34f8736700 1 -- 172.21.15.40:0/3661343683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f012aa00 con 0x7f34f006a6d0 2023-09-30T22:26:52.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.321+0000 7f34e6ffd700 1 -- 172.21.15.40:0/3661343683 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f34ec00c850 con 0x7f34f006a6d0 2023-09-30T22:26:52.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.322+0000 7f34e6ffd700 1 -- 172.21.15.40:0/3661343683 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f34ec0421c0 con 0x7f34f006a6d0 2023-09-30T22:26:52.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.322+0000 7f34f8736700 1 -- 172.21.15.40:0/3661343683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f0062380 con 0x7f34f006a6d0 2023-09-30T22:26:52.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.331+0000 7f34e6ffd700 1 -- 172.21.15.40:0/3661343683 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f34ec044060 con 0x7f34f006a6d0 2023-09-30T22:26:52.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.367+0000 7f4dbb734700 1 Processor -- start 2023-09-30T22:26:52.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.368+0000 7f4dbb734700 1 -- start start 2023-09-30T22:26:52.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.368+0000 7f4dbb734700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4db4133e00 0x7f4db41341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.368+0000 7f4dbb734700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4db409df70 0x7f4db413bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.368+0000 7f4dbb734700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db4133940 con 0x7f4db409d400 2023-09-30T22:26:52.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.368+0000 7f4dbb734700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4db409ab20 con 0x7f4db4133e00 2023-09-30T22:26:52.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.368+0000 7f4dbb734700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4db409f0d0 con 0x7f4db409df70 2023-09-30T22:26:52.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.368+0000 7f4db9cd1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4db409df70 0x7f4db413bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.368+0000 7f4db94d0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4db4133e00 0x7f4db41341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.368+0000 7f4db94d0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4db4133e00 0x7f4db41341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49266/0 (socket says 172.21.15.40:49266) 2023-09-30T22:26:52.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.368+0000 7f4db9cd1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4db409df70 0x7f4db413bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60682/0 (socket says 172.21.15.40:60682) 2023-09-30T22:26:52.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.368+0000 7f4db94d0700 1 -- 172.21.15.40:0/4058627571 learned_addr learned my addr 172.21.15.40:0/4058627571 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:52.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.369+0000 7f4db9cd1700 1 -- 172.21.15.40:0/4058627571 >> v2:172.21.15.40:3300/0 conn(0x7f4db4133e00 msgr2=0x7f4db41341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:52.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.369+0000 7f4db9cd1700 1 --2- 172.21.15.40:0/4058627571 >> v2:172.21.15.40:3300/0 conn(0x7f4db4133e00 0x7f4db41341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.369+0000 7f4db9cd1700 1 -- 172.21.15.40:0/4058627571 >> v1:172.21.15.40:6789/0 conn(0x7f4db409d400 legacy=0x7f4db409d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.369+0000 7f4db9cd1700 1 -- 172.21.15.40:0/4058627571 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db4133be0 con 0x7f4db409df70 2023-09-30T22:26:52.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.369+0000 7f4db94d0700 1 --2- 172.21.15.40:0/4058627571 >> v2:172.21.15.40:3300/0 conn(0x7f4db4133e00 0x7f4db41341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:52.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.369+0000 7f4db9cd1700 1 --2- 172.21.15.40:0/4058627571 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4db409df70 0x7f4db413bc80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4dac009d90 tx=0x7f4dac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=582e42a1297b972 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:52.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.369+0000 7f4dabfff700 1 -- 172.21.15.40:0/4058627571 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac00e070 con 0x7f4db409df70 2023-09-30T22:26:52.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.369+0000 7f4dabfff700 1 -- 172.21.15.40:0/4058627571 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dac00bb20 con 0x7f4db409df70 2023-09-30T22:26:52.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.369+0000 7f4dabfff700 1 -- 172.21.15.40:0/4058627571 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac012430 con 0x7f4db409df70 2023-09-30T22:26:52.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.370+0000 7f4dbb734700 1 -- 172.21.15.40:0/4058627571 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4db409df70 msgr2=0x7f4db413bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.370+0000 7f4dbb734700 1 --2- 172.21.15.40:0/4058627571 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4db409df70 0x7f4db413bc80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4dac009d90 tx=0x7f4dac00b330 comp rx=0 tx=0).stop 2023-09-30T22:26:52.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.370+0000 7f4dbb734700 1 -- 172.21.15.40:0/4058627571 shutdown_connections 2023-09-30T22:26:52.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.370+0000 7f4dbb734700 1 --2- 172.21.15.40:0/4058627571 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4db409df70 0x7f4db413bc80 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.370+0000 7f4dbb734700 1 --2- 172.21.15.40:0/4058627571 >> v2:172.21.15.40:3300/0 conn(0x7f4db4133e00 0x7f4db41341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.370+0000 7f4dbb734700 1 -- 172.21.15.40:0/4058627571 >> 172.21.15.40:0/4058627571 conn(0x7f4db40a2a00 msgr2=0x7f4db40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:52.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.370+0000 7f4dbb734700 1 -- 172.21.15.40:0/4058627571 shutdown_connections 2023-09-30T22:26:52.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.370+0000 7f4dbb734700 1 -- 172.21.15.40:0/4058627571 wait complete. 2023-09-30T22:26:52.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.371+0000 7f4dbb734700 1 Processor -- start 2023-09-30T22:26:52.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.371+0000 7f4dbb734700 1 -- start start 2023-09-30T22:26:52.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.371+0000 7f4dbb734700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4db409d400 0x7f4db4119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.371+0000 7f4dbb734700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4db409df70 0x7f4db4119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.371+0000 7f4dbb734700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4db4133e00 0x7f4db4119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.371+0000 7f4dbb734700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db411c100 con 0x7f4db409df70 2023-09-30T22:26:52.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.371+0000 7f4dbb734700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db412c000 con 0x7f4db409d400 2023-09-30T22:26:52.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.371+0000 7f4dbb734700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4db411a420 con 0x7f4db4133e00 2023-09-30T22:26:52.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.372+0000 7f4db8ccf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4db409df70 0x7f4db4119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.372+0000 7f4db9cd1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4db4133e00 0x7f4db4119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.372+0000 7f4db94d0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4db409d400 0x7f4db4119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.372+0000 7f4db8ccf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4db409df70 0x7f4db4119590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49280/0 (socket says 172.21.15.40:49280) 2023-09-30T22:26:52.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.372+0000 7f4db8ccf700 1 -- 172.21.15.40:0/348444034 learned_addr learned my addr 172.21.15.40:0/348444034 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:52.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.372+0000 7f4db9cd1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4db4133e00 0x7f4db4119ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60688/0 (socket says 172.21.15.40:60688) 2023-09-30T22:26:52.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.372+0000 7f4db8ccf700 1 -- 172.21.15.40:0/348444034 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4db4133e00 msgr2=0x7f4db4119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.372+0000 7f4db8ccf700 1 --2- 172.21.15.40:0/348444034 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4db4133e00 0x7f4db4119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.372+0000 7f4db8ccf700 1 -- 172.21.15.40:0/348444034 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4db409d400 msgr2=0x7f4db4119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.372+0000 7f4db8ccf700 1 --2- 172.21.15.40:0/348444034 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4db409d400 0x7f4db4119050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.372+0000 7f4db8ccf700 1 -- 172.21.15.40:0/348444034 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db0009550 con 0x7f4db409df70 2023-09-30T22:26:52.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.372+0000 7f4db8ccf700 1 --2- 172.21.15.40:0/348444034 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4db409df70 0x7f4db4119590 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f4da400c4e0 tx=0x7f4da400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:52.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.373+0000 7f4da9ffb700 1 -- 172.21.15.40:0/348444034 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da40052d0 con 0x7f4db409df70 2023-09-30T22:26:52.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.373+0000 7f4da9ffb700 1 -- 172.21.15.40:0/348444034 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da4005430 con 0x7f4db409df70 2023-09-30T22:26:52.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.373+0000 7f4dbb734700 1 -- 172.21.15.40:0/348444034 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dac009a70 con 0x7f4db409df70 2023-09-30T22:26:52.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.373+0000 7f4da9ffb700 1 -- 172.21.15.40:0/348444034 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da40038c0 con 0x7f4db409df70 2023-09-30T22:26:52.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.373+0000 7f4dbb734700 1 -- 172.21.15.40:0/348444034 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db412e1a0 con 0x7f4db409df70 2023-09-30T22:26:52.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.374+0000 7f4da9ffb700 1 -- 172.21.15.40:0/348444034 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4da4003a20 con 0x7f4db409df70 2023-09-30T22:26:52.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.374+0000 7f4da9ffb700 1 -- 172.21.15.40:0/348444034 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4da403ebe0 con 0x7f4db409df70 2023-09-30T22:26:52.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.374+0000 7f4dbb734700 1 -- 172.21.15.40:0/348444034 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4db4062380 con 0x7f4db409df70 2023-09-30T22:26:52.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.379+0000 7f4da9ffb700 1 -- 172.21.15.40:0/348444034 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4da4017020 con 0x7f4db409df70 2023-09-30T22:26:52.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.402+0000 7f461d6e0700 1 Processor -- start 2023-09-30T22:26:52.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.402+0000 7f461d6e0700 1 -- start start 2023-09-30T22:26:52.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.403+0000 7f461d6e0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4618138250 0x7f4618138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.403+0000 7f461d6e0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f461809df20 0x7f4618140160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.403+0000 7f461d6e0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4618137e20 con 0x7f461809d400 2023-09-30T22:26:52.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.403+0000 7f461d6e0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4618138050 con 0x7f4618138250 2023-09-30T22:26:52.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.403+0000 7f461d6e0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f461809b010 con 0x7f461809df20 2023-09-30T22:26:52.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.403+0000 7f46167fc700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f461809d400 0x7f461809d810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60734/0 (socket says 172.21.15.40:60734) 2023-09-30T22:26:52.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.403+0000 7f46167fc700 1 -- 172.21.15.40:0/2163716945 learned_addr learned my addr 172.21.15.40:0/2163716945 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:52.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.403+0000 7f46177fe700 1 --2- 172.21.15.40:0/2163716945 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f461809df20 0x7f4618140160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.403+0000 7f4616ffd700 1 --2- 172.21.15.40:0/2163716945 >> v2:172.21.15.40:3300/0 conn(0x7f4618138250 0x7f4618138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.403+0000 7f4615ffb700 1 -- 172.21.15.40:0/2163716945 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2143738668 0 0) 0x7f4618137e20 con 0x7f461809d400 2023-09-30T22:26:52.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.403+0000 7f4615ffb700 1 -- 172.21.15.40:0/2163716945 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46000035b0 con 0x7f461809d400 2023-09-30T22:26:52.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.404+0000 7f46177fe700 1 -- 172.21.15.40:0/2163716945 >> v2:172.21.15.40:3300/0 conn(0x7f4618138250 msgr2=0x7f4618138620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:52.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.404+0000 7f46177fe700 1 --2- 172.21.15.40:0/2163716945 >> v2:172.21.15.40:3300/0 conn(0x7f4618138250 0x7f4618138620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.404+0000 7f46177fe700 1 -- 172.21.15.40:0/2163716945 >> v1:172.21.15.40:6789/0 conn(0x7f461809d400 legacy=0x7f461809d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.404+0000 7f46177fe700 1 -- 172.21.15.40:0/2163716945 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f461809f1f0 con 0x7f461809df20 2023-09-30T22:26:52.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.404+0000 7f46177fe700 1 --2- 172.21.15.40:0/2163716945 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f461809df20 0x7f4618140160 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4610009d90 tx=0x7f461000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=448add64df6fb974 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:52.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.404+0000 7f4615ffb700 1 -- 172.21.15.40:0/2163716945 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461000e070 con 0x7f461809df20 2023-09-30T22:26:52.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.404+0000 7f4615ffb700 1 -- 172.21.15.40:0/2163716945 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461000bb20 con 0x7f461809df20 2023-09-30T22:26:52.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.404+0000 7f4615ffb700 1 -- 172.21.15.40:0/2163716945 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4610012430 con 0x7f461809df20 2023-09-30T22:26:52.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.405+0000 7f461d6e0700 1 -- 172.21.15.40:0/2163716945 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f461809df20 msgr2=0x7f4618140160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.405+0000 7f461d6e0700 1 --2- 172.21.15.40:0/2163716945 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f461809df20 0x7f4618140160 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4610009d90 tx=0x7f461000b330 comp rx=0 tx=0).stop 2023-09-30T22:26:52.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.405+0000 7f461d6e0700 1 -- 172.21.15.40:0/2163716945 shutdown_connections 2023-09-30T22:26:52.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.405+0000 7f461d6e0700 1 --2- 172.21.15.40:0/2163716945 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f461809df20 0x7f4618140160 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.405+0000 7f461d6e0700 1 --2- 172.21.15.40:0/2163716945 >> v2:172.21.15.40:3300/0 conn(0x7f4618138250 0x7f4618138620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.405+0000 7f461d6e0700 1 -- 172.21.15.40:0/2163716945 >> 172.21.15.40:0/2163716945 conn(0x7f46180a2a00 msgr2=0x7f46180a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:52.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.405+0000 7f461d6e0700 1 -- 172.21.15.40:0/2163716945 shutdown_connections 2023-09-30T22:26:52.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.405+0000 7f461d6e0700 1 -- 172.21.15.40:0/2163716945 wait complete. 2023-09-30T22:26:52.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.406+0000 7f461d6e0700 1 Processor -- start 2023-09-30T22:26:52.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.406+0000 7f461d6e0700 1 -- start start 2023-09-30T22:26:52.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.407+0000 7f461d6e0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f461809d400 0x7f4618124230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.407+0000 7f461d6e0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f461809df20 0x7f4618124770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.407+0000 7f461d6e0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4618138250 0x7f4618124cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.407+0000 7f461d6e0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4618128580 con 0x7f461809df20 2023-09-30T22:26:52.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.407+0000 7f461d6e0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4618126570 con 0x7f461809d400 2023-09-30T22:26:52.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.407+0000 7f461d6e0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4618127360 con 0x7f4618138250 2023-09-30T22:26:52.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.407+0000 7f46177fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4618138250 0x7f4618124cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.407+0000 7f46177fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4618138250 0x7f4618124cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60716/0 (socket says 172.21.15.40:60716) 2023-09-30T22:26:52.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.407+0000 7f46177fe700 1 -- 172.21.15.40:0/115791135 learned_addr learned my addr 172.21.15.40:0/115791135 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:52.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.407+0000 7f46167fc700 1 --2- 172.21.15.40:0/115791135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f461809df20 0x7f4618124770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.407+0000 7f46177fe700 1 -- 172.21.15.40:0/115791135 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f461809d400 msgr2=0x7f4618124230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.407+0000 7f46177fe700 1 --2- 172.21.15.40:0/115791135 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f461809d400 0x7f4618124230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.407+0000 7f46177fe700 1 -- 172.21.15.40:0/115791135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f461809df20 msgr2=0x7f4618124770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.407+0000 7f46177fe700 1 --2- 172.21.15.40:0/115791135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f461809df20 0x7f4618124770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.407+0000 7f46177fe700 1 -- 172.21.15.40:0/115791135 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4610009a70 con 0x7f4618138250 2023-09-30T22:26:52.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.407+0000 7f46177fe700 1 --2- 172.21.15.40:0/115791135 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4618138250 0x7f4618124cb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4610014040 tx=0x7f4610004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:52.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.408+0000 7f45ff7fe700 1 -- 172.21.15.40:0/115791135 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4610012a90 con 0x7f4618138250 2023-09-30T22:26:52.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.408+0000 7f45ff7fe700 1 -- 172.21.15.40:0/115791135 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4610020070 con 0x7f4618138250 2023-09-30T22:26:52.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.408+0000 7f461d6e0700 1 -- 172.21.15.40:0/115791135 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4618127690 con 0x7f4618138250 2023-09-30T22:26:52.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.408+0000 7f461d6e0700 1 -- 172.21.15.40:0/115791135 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46181280d0 con 0x7f4618138250 2023-09-30T22:26:52.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.408+0000 7f45ff7fe700 1 -- 172.21.15.40:0/115791135 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4610012e50 con 0x7f4618138250 2023-09-30T22:26:52.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.409+0000 7f461d6e0700 1 -- 172.21.15.40:0/115791135 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f80052e0 con 0x7f4618138250 2023-09-30T22:26:52.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.409+0000 7f45ff7fe700 1 -- 172.21.15.40:0/115791135 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4610004040 con 0x7f4618138250 2023-09-30T22:26:52.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.414+0000 7f45ff7fe700 1 -- 172.21.15.40:0/115791135 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4610022070 con 0x7f4618138250 2023-09-30T22:26:52.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.414+0000 7f45ff7fe700 1 -- 172.21.15.40:0/115791135 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4610046060 con 0x7f4618138250 2023-09-30T22:26:52.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.490+0000 7f33c042d700 1 -- 172.21.15.40:0/943591513 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f33b8119b10 con 0x7f33b806a6d0 2023-09-30T22:26:52.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.491+0000 7f33aeffd700 1 -- 172.21.15.40:0/943591513 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f33b8119b10 con 0x7f33b806a6d0 2023-09-30T22:26:52.492 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:52.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.493+0000 7f33c042d700 1 -- 172.21.15.40:0/943591513 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f33b806a6d0 msgr2=0x7f33b81c89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.493+0000 7f33c042d700 1 --2- 172.21.15.40:0/943591513 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f33b806a6d0 0x7f33b81c89e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f33b400e900 tx=0x7f33b400ec10 comp rx=0 tx=0).stop 2023-09-30T22:26:52.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.493+0000 7f33c042d700 1 -- 172.21.15.40:0/943591513 shutdown_connections 2023-09-30T22:26:52.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.493+0000 7f33c042d700 1 --2- 172.21.15.40:0/943591513 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f33b806a6d0 0x7f33b81c89e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.493+0000 7f33c042d700 1 --2- 172.21.15.40:0/943591513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33b8131fc0 0x7f33b8130d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.493+0000 7f33c042d700 1 --2- 172.21.15.40:0/943591513 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33b806afe0 0x7f33b81c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.493+0000 7f33c042d700 1 -- 172.21.15.40:0/943591513 >> 172.21.15.40:0/943591513 conn(0x7f33b809fb20 msgr2=0x7f33b813a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:52.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.493+0000 7f33c042d700 1 -- 172.21.15.40:0/943591513 shutdown_connections 2023-09-30T22:26:52.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.493+0000 7f33c042d700 1 -- 172.21.15.40:0/943591513 wait complete. 2023-09-30T22:26:52.506 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:52.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.547+0000 7f34f8736700 1 -- 172.21.15.40:0/3661343683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f34f0074720 con 0x7f34f006a6d0 2023-09-30T22:26:52.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.547+0000 7f34e6ffd700 1 -- 172.21.15.40:0/3661343683 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f34ec006030 con 0x7f34f006a6d0 2023-09-30T22:26:52.548 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:52.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.549+0000 7f34f8736700 1 -- 172.21.15.40:0/3661343683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34f006a6d0 msgr2=0x7f34f01cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.549+0000 7f34f8736700 1 --2- 172.21.15.40:0/3661343683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34f006a6d0 0x7f34f01cc9a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f34ec00ebb0 tx=0x7f34ec00eec0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.549+0000 7f34f8736700 1 -- 172.21.15.40:0/3661343683 shutdown_connections 2023-09-30T22:26:52.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.549+0000 7f34f8736700 1 --2- 172.21.15.40:0/3661343683 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34f013c490 0x7f34f01cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.549+0000 7f34f8736700 1 --2- 172.21.15.40:0/3661343683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34f006a6d0 0x7f34f01cc9a0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.549+0000 7f34f8736700 1 --2- 172.21.15.40:0/3661343683 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f34f009de60 0x7f34f01ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.549+0000 7f34f8736700 1 -- 172.21.15.40:0/3661343683 >> 172.21.15.40:0/3661343683 conn(0x7f34f009fb20 msgr2=0x7f34f013b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:52.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.550+0000 7f34f8736700 1 -- 172.21.15.40:0/3661343683 shutdown_connections 2023-09-30T22:26:52.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.550+0000 7f34f8736700 1 -- 172.21.15.40:0/3661343683 wait complete. 2023-09-30T22:26:52.562 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:52.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.578+0000 7f4dbb734700 1 -- 172.21.15.40:0/348444034 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4db411ab30 con 0x7f4db409df70 2023-09-30T22:26:52.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.578+0000 7f4da9ffb700 1 -- 172.21.15.40:0/348444034 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4da4018260 con 0x7f4db409df70 2023-09-30T22:26:52.579 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:52.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.580+0000 7f4dbb734700 1 -- 172.21.15.40:0/348444034 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4db409df70 msgr2=0x7f4db4119590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.580+0000 7f4dbb734700 1 --2- 172.21.15.40:0/348444034 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4db409df70 0x7f4db4119590 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f4da400c4e0 tx=0x7f4da400c7f0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.580+0000 7f4dbb734700 1 -- 172.21.15.40:0/348444034 shutdown_connections 2023-09-30T22:26:52.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.580+0000 7f4dbb734700 1 --2- 172.21.15.40:0/348444034 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4db4133e00 0x7f4db4119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.580+0000 7f4dbb734700 1 --2- 172.21.15.40:0/348444034 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4db409d400 0x7f4db4119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.580+0000 7f4dbb734700 1 --2- 172.21.15.40:0/348444034 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4db409df70 0x7f4db4119590 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.580+0000 7f4dbb734700 1 -- 172.21.15.40:0/348444034 >> 172.21.15.40:0/348444034 conn(0x7f4db40a2a00 msgr2=0x7f4db412d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:52.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.581+0000 7f4dbb734700 1 -- 172.21.15.40:0/348444034 shutdown_connections 2023-09-30T22:26:52.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.581+0000 7f4dbb734700 1 -- 172.21.15.40:0/348444034 wait complete. 2023-09-30T22:26:52.593 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:52.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.611+0000 7f461d6e0700 1 -- 172.21.15.40:0/115791135 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f45f8005590 con 0x7f4618138250 2023-09-30T22:26:52.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.611+0000 7f45ff7fe700 1 -- 172.21.15.40:0/115791135 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4610046070 con 0x7f4618138250 2023-09-30T22:26:52.612 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:52.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.613+0000 7f461d6e0700 1 -- 172.21.15.40:0/115791135 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4618138250 msgr2=0x7f4618124cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.613+0000 7f461d6e0700 1 --2- 172.21.15.40:0/115791135 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4618138250 0x7f4618124cb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4610014040 tx=0x7f4610004ad0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.614+0000 7f461d6e0700 1 -- 172.21.15.40:0/115791135 shutdown_connections 2023-09-30T22:26:52.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.614+0000 7f461d6e0700 1 --2- 172.21.15.40:0/115791135 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4618138250 0x7f4618124cb0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.614+0000 7f461d6e0700 1 --2- 172.21.15.40:0/115791135 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f461809d400 0x7f4618124230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.614+0000 7f461d6e0700 1 --2- 172.21.15.40:0/115791135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f461809df20 0x7f4618124770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.614+0000 7f461d6e0700 1 -- 172.21.15.40:0/115791135 >> 172.21.15.40:0/115791135 conn(0x7f46180a2a00 msgr2=0x7f4618137810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:52.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.614+0000 7f461d6e0700 1 -- 172.21.15.40:0/115791135 shutdown_connections 2023-09-30T22:26:52.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:52.614+0000 7f461d6e0700 1 -- 172.21.15.40:0/115791135 wait complete. 2023-09-30T22:26:52.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:53.507 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:53.564 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:53.594 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:53.628 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:53.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.651+0000 7fc019dc6700 1 Processor -- start 2023-09-30T22:26:53.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.651+0000 7fc019dc6700 1 -- start start 2023-09-30T22:26:53.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.652+0000 7fc019dc6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc014131d50 0x7fc014132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.652+0000 7fc019dc6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc01409bc50 0x7fc01409c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.652+0000 7fc019dc6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc01409c600 0x7fc014138ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.652+0000 7fc019dc6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc01409cb00 con 0x7fc01409c600 2023-09-30T22:26:53.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.652+0000 7fc019dc6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc014071920 con 0x7fc01409bc50 2023-09-30T22:26:53.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.652+0000 7fc019dc6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc014132660 con 0x7fc014131d50 2023-09-30T22:26:53.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.652+0000 7fc013fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc01409c600 0x7fc014138ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.652+0000 7fc012ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc01409bc50 0x7fc01409c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.652+0000 7fc0137fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc014131d50 0x7fc014132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.652+0000 7fc013fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc01409c600 0x7fc014138ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35998/0 (socket says 172.21.15.40:35998) 2023-09-30T22:26:53.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.652+0000 7fc012ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc01409bc50 0x7fc01409c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:36004/0 (socket says 172.21.15.40:36004) 2023-09-30T22:26:53.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.652+0000 7fc0137fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc014131d50 0x7fc014132120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51736/0 (socket says 172.21.15.40:51736) 2023-09-30T22:26:53.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.652+0000 7fc013fff700 1 -- 172.21.15.40:0/479927804 learned_addr learned my addr 172.21.15.40:0/479927804 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:53.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.652+0000 7fc012ffd700 1 -- 172.21.15.40:0/479927804 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc014131d50 msgr2=0x7fc014132120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:53.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.652+0000 7fc012ffd700 1 --2- 172.21.15.40:0/479927804 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc014131d50 0x7fc014132120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.652+0000 7fc012ffd700 1 -- 172.21.15.40:0/479927804 >> v2:172.21.15.40:3300/0 conn(0x7fc01409c600 msgr2=0x7fc014138ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:53.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.652+0000 7fc012ffd700 1 --2- 172.21.15.40:0/479927804 >> v2:172.21.15.40:3300/0 conn(0x7fc01409c600 0x7fc014138ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.652+0000 7fc012ffd700 1 -- 172.21.15.40:0/479927804 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc014131900 con 0x7fc01409bc50 2023-09-30T22:26:53.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.652+0000 7fc013fff700 1 --2- 172.21.15.40:0/479927804 >> v2:172.21.15.40:3300/0 conn(0x7fc01409c600 0x7fc014138ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:53.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.653+0000 7fc012ffd700 1 --2- 172.21.15.40:0/479927804 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc01409bc50 0x7fc01409c0c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc008009840 tx=0x7fc008009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e901a8c333da5282 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:53.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.653+0000 7fc0127fc700 1 -- 172.21.15.40:0/479927804 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc008011830 con 0x7fc01409bc50 2023-09-30T22:26:53.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.653+0000 7fc0127fc700 1 -- 172.21.15.40:0/479927804 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc008011990 con 0x7fc01409bc50 2023-09-30T22:26:53.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.653+0000 7fc0127fc700 1 -- 172.21.15.40:0/479927804 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc008011d20 con 0x7fc01409bc50 2023-09-30T22:26:53.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.654+0000 7fc019dc6700 1 -- 172.21.15.40:0/479927804 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc01409bc50 msgr2=0x7fc01409c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.654+0000 7fc019dc6700 1 --2- 172.21.15.40:0/479927804 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc01409bc50 0x7fc01409c0c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc008009840 tx=0x7fc008009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:53.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.654+0000 7fc019dc6700 1 -- 172.21.15.40:0/479927804 shutdown_connections 2023-09-30T22:26:53.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.654+0000 7fc019dc6700 1 --2- 172.21.15.40:0/479927804 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc014131d50 0x7fc014132120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.654+0000 7fc019dc6700 1 --2- 172.21.15.40:0/479927804 >> v2:172.21.15.40:3300/0 conn(0x7fc01409c600 0x7fc014138ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.654+0000 7fc019dc6700 1 --2- 172.21.15.40:0/479927804 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc01409bc50 0x7fc01409c0c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.654+0000 7fc019dc6700 1 -- 172.21.15.40:0/479927804 >> 172.21.15.40:0/479927804 conn(0x7fc0140a2a00 msgr2=0x7fc0140a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:53.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.654+0000 7fc019dc6700 1 -- 172.21.15.40:0/479927804 shutdown_connections 2023-09-30T22:26:53.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.654+0000 7fc019dc6700 1 -- 172.21.15.40:0/479927804 wait complete. 2023-09-30T22:26:53.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.655+0000 7fc019dc6700 1 Processor -- start 2023-09-30T22:26:53.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.655+0000 7fc019dc6700 1 -- start start 2023-09-30T22:26:53.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.656+0000 7fc019dc6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc01409bc50 0x7fc01411aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.656+0000 7fc019dc6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc01409c600 0x7fc01411aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.656+0000 7fc019dc6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc014131d50 0x7fc01411b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.656+0000 7fc019dc6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01409ea60 con 0x7fc014131d50 2023-09-30T22:26:53.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.656+0000 7fc019dc6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01411d390 con 0x7fc01409c600 2023-09-30T22:26:53.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.656+0000 7fc019dc6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc01411c6a0 con 0x7fc01409bc50 2023-09-30T22:26:53.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.656+0000 7fc0137fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc01409bc50 0x7fc01411aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.656+0000 7fc013fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc014131d50 0x7fc01411b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.656+0000 7fc0137fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc01409bc50 0x7fc01411aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51746/0 (socket says 172.21.15.40:51746) 2023-09-30T22:26:53.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.656+0000 7fc013fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc014131d50 0x7fc01411b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36014/0 (socket says 172.21.15.40:36014) 2023-09-30T22:26:53.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.656+0000 7fc0137fe700 1 -- 172.21.15.40:0/367921637 learned_addr learned my addr 172.21.15.40:0/367921637 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:53.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.656+0000 7fc012ffd700 1 --2- 172.21.15.40:0/367921637 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc01409c600 0x7fc01411aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.656+0000 7fc0137fe700 1 -- 172.21.15.40:0/367921637 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc01409c600 msgr2=0x7fc01411aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.656+0000 7fc0137fe700 1 --2- 172.21.15.40:0/367921637 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc01409c600 0x7fc01411aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.656+0000 7fc0137fe700 1 -- 172.21.15.40:0/367921637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc014131d50 msgr2=0x7fc01411b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.656+0000 7fc0137fe700 1 --2- 172.21.15.40:0/367921637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc014131d50 0x7fc01411b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.656+0000 7fc0137fe700 1 -- 172.21.15.40:0/367921637 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc00c009b30 con 0x7fc01409bc50 2023-09-30T22:26:53.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.656+0000 7fc013fff700 1 --2- 172.21.15.40:0/367921637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc014131d50 0x7fc01411b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:53.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.657+0000 7fc0137fe700 1 --2- 172.21.15.40:0/367921637 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc01409bc50 0x7fc01411aab0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc00400e9b0 tx=0x7fc00400ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:53.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.657+0000 7fbffbfff700 1 -- 172.21.15.40:0/367921637 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc004009710 con 0x7fc01409bc50 2023-09-30T22:26:53.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.657+0000 7fbffbfff700 1 -- 172.21.15.40:0/367921637 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00400ee50 con 0x7fc01409bc50 2023-09-30T22:26:53.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.657+0000 7fc019dc6700 1 -- 172.21.15.40:0/367921637 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0080094a0 con 0x7fc01409bc50 2023-09-30T22:26:53.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.657+0000 7fbffbfff700 1 -- 172.21.15.40:0/367921637 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00400ca50 con 0x7fc01409bc50 2023-09-30T22:26:53.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.657+0000 7fc019dc6700 1 -- 172.21.15.40:0/367921637 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc01411e510 con 0x7fc01409bc50 2023-09-30T22:26:53.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.658+0000 7fc019dc6700 1 -- 172.21.15.40:0/367921637 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc01411dde0 con 0x7fc01409bc50 2023-09-30T22:26:53.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.658+0000 7fbffbfff700 1 -- 172.21.15.40:0/367921637 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc00400cbb0 con 0x7fc01409bc50 2023-09-30T22:26:53.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.659+0000 7fbffbfff700 1 -- 172.21.15.40:0/367921637 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc00403f8b0 con 0x7fc01409bc50 2023-09-30T22:26:53.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.663+0000 7fbffbfff700 1 -- 172.21.15.40:0/367921637 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc00401be10 con 0x7fc01409bc50 2023-09-30T22:26:53.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.704+0000 7f1900c69700 1 Processor -- start 2023-09-30T22:26:53.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.704+0000 7f1900c69700 1 -- start start 2023-09-30T22:26:53.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.705+0000 7f1900c69700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f18fc131d50 0x7f18fc132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.705+0000 7f1900c69700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18fc09c7d0 0x7f18fc139ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.705+0000 7f1900c69700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18fc132660 con 0x7f18fc09bc50 2023-09-30T22:26:53.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.705+0000 7f1900c69700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18fc0719e0 con 0x7f18fc131d50 2023-09-30T22:26:53.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.705+0000 7f1900c69700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc131900 con 0x7f18fc09c7d0 2023-09-30T22:26:53.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.705+0000 7f18fa59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f18fc131d50 0x7f18fc132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.705+0000 7f18fa59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f18fc131d50 0x7f18fc132120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36022/0 (socket says 172.21.15.40:36022) 2023-09-30T22:26:53.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.705+0000 7f18fa59c700 1 -- 172.21.15.40:0/4247686220 learned_addr learned my addr 172.21.15.40:0/4247686220 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:53.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.705+0000 7f18fad9d700 1 --2- 172.21.15.40:0/4247686220 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18fc09c7d0 0x7f18fc139ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.705+0000 7f18fa59c700 1 -- 172.21.15.40:0/4247686220 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18fc09c7d0 msgr2=0x7f18fc139ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:53.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.705+0000 7f18fa59c700 1 --2- 172.21.15.40:0/4247686220 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18fc09c7d0 0x7f18fc139ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.705+0000 7f18fa59c700 1 -- 172.21.15.40:0/4247686220 >> v1:172.21.15.40:6789/0 conn(0x7f18fc09bc50 legacy=0x7f18fc09c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.705+0000 7f18fa59c700 1 -- 172.21.15.40:0/4247686220 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18fc09e820 con 0x7f18fc131d50 2023-09-30T22:26:53.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.705+0000 7f18fad9d700 1 --2- 172.21.15.40:0/4247686220 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18fc09c7d0 0x7f18fc139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:53.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.705+0000 7f18fa59c700 1 --2- 172.21.15.40:0/4247686220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18fc131d50 0x7f18fc132120 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f18ec0098f0 tx=0x7f18ec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b9d3822cf2e3c39 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:53.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.706+0000 7f18f959a700 1 -- 172.21.15.40:0/4247686220 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec00b8a0 con 0x7f18fc131d50 2023-09-30T22:26:53.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.706+0000 7f18f959a700 1 -- 172.21.15.40:0/4247686220 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ec00ba00 con 0x7f18fc131d50 2023-09-30T22:26:53.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.706+0000 7f18f959a700 1 -- 172.21.15.40:0/4247686220 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec00bd90 con 0x7f18fc131d50 2023-09-30T22:26:53.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.707+0000 7f1900c69700 1 -- 172.21.15.40:0/4247686220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18fc131d50 msgr2=0x7f18fc132120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.707+0000 7f1900c69700 1 --2- 172.21.15.40:0/4247686220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18fc131d50 0x7f18fc132120 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f18ec0098f0 tx=0x7f18ec009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:53.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.707+0000 7f1900c69700 1 -- 172.21.15.40:0/4247686220 shutdown_connections 2023-09-30T22:26:53.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.707+0000 7f1900c69700 1 --2- 172.21.15.40:0/4247686220 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18fc09c7d0 0x7f18fc139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.707+0000 7f1900c69700 1 --2- 172.21.15.40:0/4247686220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18fc131d50 0x7f18fc132120 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.707+0000 7f1900c69700 1 -- 172.21.15.40:0/4247686220 >> 172.21.15.40:0/4247686220 conn(0x7f18fc0a2a00 msgr2=0x7f18fc0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:53.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.707+0000 7f1900c69700 1 -- 172.21.15.40:0/4247686220 shutdown_connections 2023-09-30T22:26:53.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.707+0000 7f1900c69700 1 -- 172.21.15.40:0/4247686220 wait complete. 2023-09-30T22:26:53.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.708+0000 7f1900c69700 1 Processor -- start 2023-09-30T22:26:53.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.708+0000 7f1900c69700 1 -- start start 2023-09-30T22:26:53.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.709+0000 7f1900c69700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18fc09bc50 0x7f18fc099a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.709+0000 7f1900c69700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18fc09c7d0 0x7f18fc099fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.709+0000 7f1900c69700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18fc131d50 0x7f18fc09a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.709+0000 7f1900c69700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc11f2f0 con 0x7f18fc09c7d0 2023-09-30T22:26:53.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.709+0000 7f1900c69700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc12ed80 con 0x7f18fc131d50 2023-09-30T22:26:53.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.709+0000 7f1900c69700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc120760 con 0x7f18fc09bc50 2023-09-30T22:26:53.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.709+0000 7f18fa59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18fc09bc50 0x7f18fc099a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.709+0000 7f18fa59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18fc09bc50 0x7f18fc099a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51756/0 (socket says 172.21.15.40:51756) 2023-09-30T22:26:53.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.709+0000 7f18fa59c700 1 -- 172.21.15.40:0/4214866263 learned_addr learned my addr 172.21.15.40:0/4214866263 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:53.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.709+0000 7f18f9d9b700 1 --2- 172.21.15.40:0/4214866263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18fc09c7d0 0x7f18fc099fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.709+0000 7f18fad9d700 1 --2- 172.21.15.40:0/4214866263 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18fc131d50 0x7f18fc09a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.709+0000 7f18fa59c700 1 -- 172.21.15.40:0/4214866263 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18fc131d50 msgr2=0x7f18fc09a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.709+0000 7f18fa59c700 1 --2- 172.21.15.40:0/4214866263 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18fc131d50 0x7f18fc09a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.709+0000 7f18fa59c700 1 -- 172.21.15.40:0/4214866263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18fc09c7d0 msgr2=0x7f18fc099fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.709+0000 7f18fa59c700 1 --2- 172.21.15.40:0/4214866263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18fc09c7d0 0x7f18fc099fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.709+0000 7f18fa59c700 1 -- 172.21.15.40:0/4214866263 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ec009550 con 0x7f18fc09bc50 2023-09-30T22:26:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.709+0000 7f18f9d9b700 1 --2- 172.21.15.40:0/4214866263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18fc09c7d0 0x7f18fc099fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.710+0000 7f18fa59c700 1 --2- 172.21.15.40:0/4214866263 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18fc09bc50 0x7f18fc099a70 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f18ec000c00 tx=0x7f18ec004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.710+0000 7f18eaffd700 1 -- 172.21.15.40:0/4214866263 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec004510 con 0x7f18fc09bc50 2023-09-30T22:26:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.710+0000 7f18eaffd700 1 -- 172.21.15.40:0/4214866263 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ec0036a0 con 0x7f18fc09bc50 2023-09-30T22:26:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.710+0000 7f18eaffd700 1 -- 172.21.15.40:0/4214866263 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec003a30 con 0x7f18fc09bc50 2023-09-30T22:26:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.710+0000 7f1900c69700 1 -- 172.21.15.40:0/4214866263 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18fc09ea60 con 0x7f18fc09bc50 2023-09-30T22:26:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.710+0000 7f1900c69700 1 -- 172.21.15.40:0/4214866263 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18fc11f670 con 0x7f18fc09bc50 2023-09-30T22:26:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.711+0000 7f18eaffd700 1 -- 172.21.15.40:0/4214866263 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f18ec021070 con 0x7f18fc09bc50 2023-09-30T22:26:53.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.711+0000 7f18eaffd700 1 -- 172.21.15.40:0/4214866263 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f18ec040a30 con 0x7f18fc09bc50 2023-09-30T22:26:53.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.711+0000 7f1900c69700 1 -- 172.21.15.40:0/4214866263 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18fc1202e0 con 0x7f18fc09bc50 2023-09-30T22:26:53.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.721+0000 7f18eaffd700 1 -- 172.21.15.40:0/4214866263 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f18fc1202e0 con 0x7f18fc09bc50 2023-09-30T22:26:53.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.747+0000 7f075d140700 1 Processor -- start 2023-09-30T22:26:53.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.747+0000 7f075d140700 1 -- start start 2023-09-30T22:26:53.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.748+0000 7f075d140700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f075809d920 0x7f075809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.748+0000 7f075d140700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f075809e230 0x7f07581308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.748+0000 7f075d140700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f075809adf0 con 0x7f0758130de0 2023-09-30T22:26:53.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.748+0000 7f075d140700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f075809edf0 con 0x7f075809e230 2023-09-30T22:26:53.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.748+0000 7f075d140700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f075809b660 con 0x7f075809d920 2023-09-30T22:26:53.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.748+0000 7f075659c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f075809e230 0x7f07581308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.748+0000 7f075659c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f075809e230 0x7f07581308a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36048/0 (socket says 172.21.15.40:36048) 2023-09-30T22:26:53.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.748+0000 7f075659c700 1 -- 172.21.15.40:0/2615057773 learned_addr learned my addr 172.21.15.40:0/2615057773 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:53.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.748+0000 7f0756d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f075809d920 0x7f075809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.749+0000 7f075659c700 1 -- 172.21.15.40:0/2615057773 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f075809d920 msgr2=0x7f075809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:53.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.749+0000 7f075659c700 1 --2- 172.21.15.40:0/2615057773 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f075809d920 0x7f075809dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.749+0000 7f075659c700 1 -- 172.21.15.40:0/2615057773 >> v1:172.21.15.40:6789/0 conn(0x7f0758130de0 legacy=0x7f0758137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.749+0000 7f075659c700 1 -- 172.21.15.40:0/2615057773 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f075809a6e0 con 0x7f075809e230 2023-09-30T22:26:53.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.749+0000 7f075659c700 1 --2- 172.21.15.40:0/2615057773 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f075809e230 0x7f07581308a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f074c00b9a0 tx=0x7f074c00bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c88e7703e018d15e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:53.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.749+0000 7f0755d9b700 1 -- 172.21.15.40:0/2615057773 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c00caa0 con 0x7f075809e230 2023-09-30T22:26:53.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.749+0000 7f0755d9b700 1 -- 172.21.15.40:0/2615057773 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074c00cc00 con 0x7f075809e230 2023-09-30T22:26:53.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.749+0000 7f0755d9b700 1 -- 172.21.15.40:0/2615057773 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c00f460 con 0x7f075809e230 2023-09-30T22:26:53.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.750+0000 7f075d140700 1 -- 172.21.15.40:0/2615057773 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f075809e230 msgr2=0x7f07581308a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.750+0000 7f075d140700 1 --2- 172.21.15.40:0/2615057773 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f075809e230 0x7f07581308a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f074c00b9a0 tx=0x7f074c00bcb0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.750+0000 7f075d140700 1 -- 172.21.15.40:0/2615057773 shutdown_connections 2023-09-30T22:26:53.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.750+0000 7f075d140700 1 --2- 172.21.15.40:0/2615057773 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f075809d920 0x7f075809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.750+0000 7f075d140700 1 --2- 172.21.15.40:0/2615057773 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f075809e230 0x7f07581308a0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.750+0000 7f075d140700 1 -- 172.21.15.40:0/2615057773 >> 172.21.15.40:0/2615057773 conn(0x7f075809fb20 msgr2=0x7f075809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:53.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.750+0000 7f075d140700 1 -- 172.21.15.40:0/2615057773 shutdown_connections 2023-09-30T22:26:53.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.750+0000 7f075d140700 1 -- 172.21.15.40:0/2615057773 wait complete. 2023-09-30T22:26:53.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.752+0000 7f075d140700 1 Processor -- start 2023-09-30T22:26:53.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.752+0000 7f075d140700 1 -- start start 2023-09-30T22:26:53.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.752+0000 7f075d140700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f075809d920 0x7f07581c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.752+0000 7f075d140700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f075809e230 0x7f07581c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.752+0000 7f075d140700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0758130de0 0x7f0758119730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.752+0000 7f075d140700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075812c700 con 0x7f075809e230 2023-09-30T22:26:53.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.752+0000 7f075d140700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07581c3ff0 con 0x7f0758130de0 2023-09-30T22:26:53.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.752+0000 7f075d140700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07581c4f30 con 0x7f075809d920 2023-09-30T22:26:53.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.753+0000 7f0756d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f075809d920 0x7f07581c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.753+0000 7f0756d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f075809d920 0x7f07581c44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51768/0 (socket says 172.21.15.40:51768) 2023-09-30T22:26:53.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.753+0000 7f0756d9d700 1 -- 172.21.15.40:0/1709671469 learned_addr learned my addr 172.21.15.40:0/1709671469 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:53.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.753+0000 7f075759e700 1 --2- 172.21.15.40:0/1709671469 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0758130de0 0x7f0758119730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.753+0000 7f075659c700 1 --2- 172.21.15.40:0/1709671469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f075809e230 0x7f07581c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.753+0000 7f0756d9d700 1 -- 172.21.15.40:0/1709671469 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0758130de0 msgr2=0x7f0758119730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.753+0000 7f0756d9d700 1 --2- 172.21.15.40:0/1709671469 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0758130de0 0x7f0758119730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.753+0000 7f0756d9d700 1 -- 172.21.15.40:0/1709671469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f075809e230 msgr2=0x7f07581c49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.753+0000 7f0756d9d700 1 --2- 172.21.15.40:0/1709671469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f075809e230 0x7f07581c49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.753+0000 7f0756d9d700 1 -- 172.21.15.40:0/1709671469 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074c00b600 con 0x7f075809d920 2023-09-30T22:26:53.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.753+0000 7f075759e700 1 --2- 172.21.15.40:0/1709671469 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0758130de0 0x7f0758119730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:53.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.753+0000 7f0756d9d700 1 --2- 172.21.15.40:0/1709671469 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f075809d920 0x7f07581c44b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0748012c40 tx=0x7f0748012f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:53.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.753+0000 7f073f7fe700 1 -- 172.21.15.40:0/1709671469 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074800daf0 con 0x7f075809d920 2023-09-30T22:26:53.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.754+0000 7f073f7fe700 1 -- 172.21.15.40:0/1709671469 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0748013040 con 0x7f075809d920 2023-09-30T22:26:53.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.754+0000 7f075d140700 1 -- 172.21.15.40:0/1709671469 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f075811c9c0 con 0x7f075809d920 2023-09-30T22:26:53.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.754+0000 7f073f7fe700 1 -- 172.21.15.40:0/1709671469 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0748010ad0 con 0x7f075809d920 2023-09-30T22:26:53.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.754+0000 7f075d140700 1 -- 172.21.15.40:0/1709671469 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f075812e880 con 0x7f075809d920 2023-09-30T22:26:53.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.755+0000 7f073f7fe700 1 -- 172.21.15.40:0/1709671469 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0748010c30 con 0x7f075809d920 2023-09-30T22:26:53.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.755+0000 7f075d140700 1 -- 172.21.15.40:0/1709671469 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f075809cb00 con 0x7f075809d920 2023-09-30T22:26:53.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.755+0000 7f073f7fe700 1 -- 172.21.15.40:0/1709671469 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f0748043ba0 con 0x7f075809d920 2023-09-30T22:26:53.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.764+0000 7f073f7fe700 1 -- 172.21.15.40:0/1709671469 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0748022460 con 0x7f075809d920 2023-09-30T22:26:53.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.799+0000 7fc3e8051700 1 Processor -- start 2023-09-30T22:26:53.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.799+0000 7fc3e8051700 1 -- start start 2023-09-30T22:26:53.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.800+0000 7fc3e8051700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3e009fbb0 0x7fc3e006c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.800+0000 7fc3e8051700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc3e006ced0 0x7fc3e006d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.800+0000 7fc3e8051700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3e0138370 0x7fc3e013a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.800+0000 7fc3e8051700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e009ff80 con 0x7fc3e006ced0 2023-09-30T22:26:53.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.800+0000 7fc3e8051700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e006ec40 con 0x7fc3e0138370 2023-09-30T22:26:53.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.800+0000 7fc3e8051700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e006f510 con 0x7fc3e009fbb0 2023-09-30T22:26:53.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.800+0000 7fc3e65ee700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3e0138370 0x7fc3e013a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.800+0000 7fc3e5ded700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3e009fbb0 0x7fc3e006c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.800+0000 7fc3e65ee700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3e0138370 0x7fc3e013a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:36048/0 (socket says 172.21.15.40:36048) 2023-09-30T22:26:53.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.800+0000 7fc3e65ee700 1 -- 172.21.15.40:0/3953138005 learned_addr learned my addr 172.21.15.40:0/3953138005 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:53.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.800+0000 7fc3e65ee700 1 -- 172.21.15.40:0/3953138005 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3e009fbb0 msgr2=0x7fc3e006c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:53.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.800+0000 7fc3e65ee700 1 --2- 172.21.15.40:0/3953138005 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3e009fbb0 0x7fc3e006c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.800+0000 7fc3e65ee700 1 -- 172.21.15.40:0/3953138005 >> v2:172.21.15.40:3300/0 conn(0x7fc3e006ced0 msgr2=0x7fc3e006d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:53.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.800+0000 7fc3e65ee700 1 --2- 172.21.15.40:0/3953138005 >> v2:172.21.15.40:3300/0 conn(0x7fc3e006ced0 0x7fc3e006d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.800+0000 7fc3e65ee700 1 -- 172.21.15.40:0/3953138005 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e006e3f0 con 0x7fc3e0138370 2023-09-30T22:26:53.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.800+0000 7fc3e65ee700 1 --2- 172.21.15.40:0/3953138005 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3e0138370 0x7fc3e013a750 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8009e80 tx=0x7fc3d800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b8b14e321e4d22b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:53.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.801+0000 7fc3e4deb700 1 -- 172.21.15.40:0/3953138005 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d800e070 con 0x7fc3e0138370 2023-09-30T22:26:53.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.801+0000 7fc3e4deb700 1 -- 172.21.15.40:0/3953138005 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d800b8d0 con 0x7fc3e0138370 2023-09-30T22:26:53.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.801+0000 7fc3e4deb700 1 -- 172.21.15.40:0/3953138005 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d800bc80 con 0x7fc3e0138370 2023-09-30T22:26:53.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.801+0000 7fc3e8051700 1 -- 172.21.15.40:0/3953138005 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3e0138370 msgr2=0x7fc3e013a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.801+0000 7fc3e8051700 1 --2- 172.21.15.40:0/3953138005 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3e0138370 0x7fc3e013a750 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8009e80 tx=0x7fc3d800b330 comp rx=0 tx=0).stop 2023-09-30T22:26:53.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.801+0000 7fc3e8051700 1 -- 172.21.15.40:0/3953138005 shutdown_connections 2023-09-30T22:26:53.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.801+0000 7fc3e8051700 1 --2- 172.21.15.40:0/3953138005 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3e009fbb0 0x7fc3e006c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.801+0000 7fc3e8051700 1 --2- 172.21.15.40:0/3953138005 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3e0138370 0x7fc3e013a750 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.801+0000 7fc3e8051700 1 --2- 172.21.15.40:0/3953138005 >> v2:172.21.15.40:3300/0 conn(0x7fc3e006ced0 0x7fc3e006d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.801+0000 7fc3e8051700 1 -- 172.21.15.40:0/3953138005 >> 172.21.15.40:0/3953138005 conn(0x7fc3e00a41a0 msgr2=0x7fc3e00a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:53.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.801+0000 7fc3e8051700 1 -- 172.21.15.40:0/3953138005 shutdown_connections 2023-09-30T22:26:53.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.802+0000 7fc3e8051700 1 -- 172.21.15.40:0/3953138005 wait complete. 2023-09-30T22:26:53.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.803+0000 7fc3e8051700 1 Processor -- start 2023-09-30T22:26:53.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.803+0000 7fc3e8051700 1 -- start start 2023-09-30T22:26:53.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.804+0000 7fc3e8051700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3e006ced0 0x7fc3e0137590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.804+0000 7fc3e8051700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3e009fbb0 0x7fc3e0137ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.804+0000 7fc3e8051700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3e0138370 0x7fc3e0095960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.804+0000 7fc3e8051700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e0071e20 con 0x7fc3e006ced0 2023-09-30T22:26:53.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.804+0000 7fc3e8051700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e0096a10 con 0x7fc3e0138370 2023-09-30T22:26:53.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.804+0000 7fc3e8051700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e00947e0 con 0x7fc3e009fbb0 2023-09-30T22:26:53.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.804+0000 7fc3e5ded700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3e006ced0 0x7fc3e0137590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.804+0000 7fc3e5ded700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3e006ced0 0x7fc3e0137590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36082/0 (socket says 172.21.15.40:36082) 2023-09-30T22:26:53.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.804+0000 7fc3e5ded700 1 -- 172.21.15.40:0/3802691246 learned_addr learned my addr 172.21.15.40:0/3802691246 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:53.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.804+0000 7fc3e65ee700 1 --2- 172.21.15.40:0/3802691246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3e0138370 0x7fc3e0095960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.804+0000 7fc3e55ec700 1 --2- 172.21.15.40:0/3802691246 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3e009fbb0 0x7fc3e0137ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.804+0000 7fc3e5ded700 1 -- 172.21.15.40:0/3802691246 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3e009fbb0 msgr2=0x7fc3e0137ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.804+0000 7fc3e5ded700 1 --2- 172.21.15.40:0/3802691246 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3e009fbb0 0x7fc3e0137ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.804+0000 7fc3e5ded700 1 -- 172.21.15.40:0/3802691246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3e0138370 msgr2=0x7fc3e0095960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.804+0000 7fc3e5ded700 1 --2- 172.21.15.40:0/3802691246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3e0138370 0x7fc3e0095960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.804+0000 7fc3e5ded700 1 -- 172.21.15.40:0/3802691246 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d8009b30 con 0x7fc3e006ced0 2023-09-30T22:26:53.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.804+0000 7fc3e65ee700 1 --2- 172.21.15.40:0/3802691246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3e0138370 0x7fc3e0095960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:53.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.804+0000 7fc3e5ded700 1 --2- 172.21.15.40:0/3802691246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3e006ced0 0x7fc3e0137590 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc00e9b0 tx=0x7fc3dc00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:53.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.805+0000 7fc3d67fc700 1 -- 172.21.15.40:0/3802691246 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc009710 con 0x7fc3e006ced0 2023-09-30T22:26:53.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.805+0000 7fc3d67fc700 1 -- 172.21.15.40:0/3802691246 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3dc00ee50 con 0x7fc3e006ced0 2023-09-30T22:26:53.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.805+0000 7fc3d67fc700 1 -- 172.21.15.40:0/3802691246 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc00ca50 con 0x7fc3e006ced0 2023-09-30T22:26:53.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.805+0000 7fc3e8051700 1 -- 172.21.15.40:0/3802691246 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e0097170 con 0x7fc3e006ced0 2023-09-30T22:26:53.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.805+0000 7fc3e8051700 1 -- 172.21.15.40:0/3802691246 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e0096cb0 con 0x7fc3e006ced0 2023-09-30T22:26:53.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.806+0000 7fc3d67fc700 1 -- 172.21.15.40:0/3802691246 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc3dc00cbb0 con 0x7fc3e006ced0 2023-09-30T22:26:53.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.806+0000 7fc3e8051700 1 -- 172.21.15.40:0/3802691246 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3e0094ce0 con 0x7fc3e006ced0 2023-09-30T22:26:53.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.806+0000 7fc3d67fc700 1 -- 172.21.15.40:0/3802691246 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc3dc03fb10 con 0x7fc3e006ced0 2023-09-30T22:26:53.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.815+0000 7fc3d67fc700 1 -- 172.21.15.40:0/3802691246 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc3dc01b3b0 con 0x7fc3e006ced0 2023-09-30T22:26:53.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.881+0000 7fc019dc6700 1 -- 172.21.15.40:0/367921637 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc01406fa30 con 0x7fc01409bc50 2023-09-30T22:26:53.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.882+0000 7fbffbfff700 1 -- 172.21.15.40:0/367921637 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc004017090 con 0x7fc01409bc50 2023-09-30T22:26:53.883 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:53.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.884+0000 7fc019dc6700 1 -- 172.21.15.40:0/367921637 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc01409bc50 msgr2=0x7fc01411aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.884+0000 7fc019dc6700 1 --2- 172.21.15.40:0/367921637 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc01409bc50 0x7fc01411aab0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc00400e9b0 tx=0x7fc00400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.884+0000 7fc019dc6700 1 -- 172.21.15.40:0/367921637 shutdown_connections 2023-09-30T22:26:53.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.884+0000 7fc019dc6700 1 --2- 172.21.15.40:0/367921637 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc01409bc50 0x7fc01411aab0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.884+0000 7fc019dc6700 1 --2- 172.21.15.40:0/367921637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc014131d50 0x7fc01411b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.884+0000 7fc019dc6700 1 --2- 172.21.15.40:0/367921637 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc01409c600 0x7fc01411aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.884+0000 7fc019dc6700 1 -- 172.21.15.40:0/367921637 >> 172.21.15.40:0/367921637 conn(0x7fc0140a2a00 msgr2=0x7fc0140a1730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:53.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.884+0000 7fc019dc6700 1 -- 172.21.15.40:0/367921637 shutdown_connections 2023-09-30T22:26:53.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.884+0000 7fc019dc6700 1 -- 172.21.15.40:0/367921637 wait complete. 2023-09-30T22:26:53.897 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:53.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.927+0000 7f1900c69700 1 -- 172.21.15.40:0/4214866263 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f18fc1202e0 con 0x7f18fc09bc50 2023-09-30T22:26:53.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.927+0000 7f18eaffd700 1 -- 172.21.15.40:0/4214866263 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f18fc1202e0 con 0x7f18fc09bc50 2023-09-30T22:26:53.928 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:53.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.930+0000 7f1900c69700 1 -- 172.21.15.40:0/4214866263 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18fc09bc50 msgr2=0x7f18fc099a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.930+0000 7f1900c69700 1 --2- 172.21.15.40:0/4214866263 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18fc09bc50 0x7f18fc099a70 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f18ec000c00 tx=0x7f18ec004750 comp rx=0 tx=0).stop 2023-09-30T22:26:53.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.930+0000 7f1900c69700 1 -- 172.21.15.40:0/4214866263 shutdown_connections 2023-09-30T22:26:53.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.930+0000 7f1900c69700 1 --2- 172.21.15.40:0/4214866263 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18fc09bc50 0x7f18fc099a70 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.930+0000 7f1900c69700 1 --2- 172.21.15.40:0/4214866263 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18fc131d50 0x7f18fc09a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.930+0000 7f1900c69700 1 --2- 172.21.15.40:0/4214866263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18fc09c7d0 0x7f18fc099fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.930+0000 7f1900c69700 1 -- 172.21.15.40:0/4214866263 >> 172.21.15.40:0/4214866263 conn(0x7f18fc0a2a00 msgr2=0x7f18fc1b8810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:53.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.931+0000 7f1900c69700 1 -- 172.21.15.40:0/4214866263 shutdown_connections 2023-09-30T22:26:53.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.931+0000 7f1900c69700 1 -- 172.21.15.40:0/4214866263 wait complete. 2023-09-30T22:26:53.948 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:53.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.979+0000 7f075d140700 1 -- 172.21.15.40:0/1709671469 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0758062380 con 0x7f075809d920 2023-09-30T22:26:53.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.980+0000 7f073f7fe700 1 -- 172.21.15.40:0/1709671469 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0748030090 con 0x7f075809d920 2023-09-30T22:26:53.981 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:53.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.982+0000 7f075d140700 1 -- 172.21.15.40:0/1709671469 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f075809d920 msgr2=0x7f07581c44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.982+0000 7f075d140700 1 --2- 172.21.15.40:0/1709671469 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f075809d920 0x7f07581c44b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0748012c40 tx=0x7f0748012f50 comp rx=0 tx=0).stop 2023-09-30T22:26:53.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.982+0000 7f075d140700 1 -- 172.21.15.40:0/1709671469 shutdown_connections 2023-09-30T22:26:53.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.982+0000 7f075d140700 1 --2- 172.21.15.40:0/1709671469 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f075809d920 0x7f07581c44b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.982+0000 7f075d140700 1 --2- 172.21.15.40:0/1709671469 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0758130de0 0x7f0758119730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.982+0000 7f075d140700 1 --2- 172.21.15.40:0/1709671469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f075809e230 0x7f07581c49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.982+0000 7f075d140700 1 -- 172.21.15.40:0/1709671469 >> 172.21.15.40:0/1709671469 conn(0x7f075809fb20 msgr2=0x7f075812df40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:53.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.982+0000 7f075d140700 1 -- 172.21.15.40:0/1709671469 shutdown_connections 2023-09-30T22:26:53.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:53.982+0000 7f075d140700 1 -- 172.21.15.40:0/1709671469 wait complete. 2023-09-30T22:26:53.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:54.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:54.021+0000 7fc3e8051700 1 -- 172.21.15.40:0/3802691246 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc3e0062380 con 0x7fc3e006ced0 2023-09-30T22:26:54.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:54.021+0000 7fc3d67fc700 1 -- 172.21.15.40:0/3802691246 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc3dc017030 con 0x7fc3e006ced0 2023-09-30T22:26:54.022 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:54.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:54.023+0000 7fc3e8051700 1 -- 172.21.15.40:0/3802691246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3e006ced0 msgr2=0x7fc3e0137590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:54.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:54.023+0000 7fc3e8051700 1 --2- 172.21.15.40:0/3802691246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3e006ced0 0x7fc3e0137590 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc00e9b0 tx=0x7fc3dc00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:26:54.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:54.023+0000 7fc3e8051700 1 -- 172.21.15.40:0/3802691246 shutdown_connections 2023-09-30T22:26:54.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:54.023+0000 7fc3e8051700 1 --2- 172.21.15.40:0/3802691246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3e0138370 0x7fc3e0095960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:54.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:54.023+0000 7fc3e8051700 1 --2- 172.21.15.40:0/3802691246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3e006ced0 0x7fc3e0137590 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:54.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:54.023+0000 7fc3e8051700 1 --2- 172.21.15.40:0/3802691246 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3e009fbb0 0x7fc3e0137ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:54.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:54.023+0000 7fc3e8051700 1 -- 172.21.15.40:0/3802691246 >> 172.21.15.40:0/3802691246 conn(0x7fc3e00a41a0 msgr2=0x7fc3e00a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:54.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:54.023+0000 7fc3e8051700 1 -- 172.21.15.40:0/3802691246 shutdown_connections 2023-09-30T22:26:54.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:54.023+0000 7fc3e8051700 1 -- 172.21.15.40:0/3802691246 wait complete. 2023-09-30T22:26:54.036 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:54.899 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:54.948 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:54.995 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:55.037 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:55.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.043+0000 7fe23e611700 1 Processor -- start 2023-09-30T22:26:55.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.043+0000 7fe23e611700 1 -- start start 2023-09-30T22:26:55.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.043+0000 7fe23e611700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe23806a6d0 0x7fe23806aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:55.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.043+0000 7fe23e611700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe23806afe0 0x7fe2381318b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:55.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.043+0000 7fe23e611700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe238131df0 0x7fe238132270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:55.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.043+0000 7fe23e611700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe23809eb50 con 0x7fe23806afe0 2023-09-30T22:26:55.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.043+0000 7fe23e611700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe23809dde0 con 0x7fe238131df0 2023-09-30T22:26:55.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.043+0000 7fe23e611700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe23809d4a0 con 0x7fe23806a6d0 2023-09-30T22:26:55.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.044+0000 7fe237fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe23806a6d0 0x7fe23806aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:55.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.044+0000 7fe23cbae700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe238131df0 0x7fe238132270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:55.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.044+0000 7fe237fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe23806a6d0 0x7fe23806aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51792/0 (socket says 172.21.15.40:51792) 2023-09-30T22:26:55.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.044+0000 7fe23cbae700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe238131df0 0x7fe238132270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:36078/0 (socket says 172.21.15.40:36078) 2023-09-30T22:26:55.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.044+0000 7fe237fff700 1 -- 172.21.15.40:0/2689179727 learned_addr learned my addr 172.21.15.40:0/2689179727 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:55.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.044+0000 7fe2377fe700 1 --2- 172.21.15.40:0/2689179727 >> v2:172.21.15.40:3300/0 conn(0x7fe23806afe0 0x7fe2381318b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:55.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.044+0000 7fe237fff700 1 -- 172.21.15.40:0/2689179727 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe238131df0 msgr2=0x7fe238132270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:55.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.044+0000 7fe237fff700 1 --2- 172.21.15.40:0/2689179727 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe238131df0 0x7fe238132270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.044+0000 7fe237fff700 1 -- 172.21.15.40:0/2689179727 >> v2:172.21.15.40:3300/0 conn(0x7fe23806afe0 msgr2=0x7fe2381318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:55.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.044+0000 7fe237fff700 1 --2- 172.21.15.40:0/2689179727 >> v2:172.21.15.40:3300/0 conn(0x7fe23806afe0 0x7fe2381318b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.044+0000 7fe237fff700 1 -- 172.21.15.40:0/2689179727 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe23809f5f0 con 0x7fe23806a6d0 2023-09-30T22:26:55.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.044+0000 7fe2377fe700 1 --2- 172.21.15.40:0/2689179727 >> v2:172.21.15.40:3300/0 conn(0x7fe23806afe0 0x7fe2381318b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:55.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.044+0000 7fe237fff700 1 --2- 172.21.15.40:0/2689179727 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe23806a6d0 0x7fe23806aaa0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe228006fd0 tx=0x7fe228009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60bfa30b07d56daa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:55.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.045+0000 7fe236ffd700 1 -- 172.21.15.40:0/2689179727 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe228005e30 con 0x7fe23806a6d0 2023-09-30T22:26:55.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.045+0000 7fe236ffd700 1 -- 172.21.15.40:0/2689179727 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe228004030 con 0x7fe23806a6d0 2023-09-30T22:26:55.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.045+0000 7fe236ffd700 1 -- 172.21.15.40:0/2689179727 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2280043e0 con 0x7fe23806a6d0 2023-09-30T22:26:55.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.045+0000 7fe23e611700 1 -- 172.21.15.40:0/2689179727 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe23806a6d0 msgr2=0x7fe23806aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:55.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.045+0000 7fe23e611700 1 --2- 172.21.15.40:0/2689179727 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe23806a6d0 0x7fe23806aaa0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe228006fd0 tx=0x7fe228009bd0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.045+0000 7fe23e611700 1 -- 172.21.15.40:0/2689179727 shutdown_connections 2023-09-30T22:26:55.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.045+0000 7fe23e611700 1 --2- 172.21.15.40:0/2689179727 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe23806a6d0 0x7fe23806aaa0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.045+0000 7fe23e611700 1 --2- 172.21.15.40:0/2689179727 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe238131df0 0x7fe238132270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.045+0000 7fe23e611700 1 --2- 172.21.15.40:0/2689179727 >> v2:172.21.15.40:3300/0 conn(0x7fe23806afe0 0x7fe2381318b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.045+0000 7fe23e611700 1 -- 172.21.15.40:0/2689179727 >> 172.21.15.40:0/2689179727 conn(0x7fe23809fb20 msgr2=0x7fe23809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:55.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.045+0000 7fe23e611700 1 -- 172.21.15.40:0/2689179727 shutdown_connections 2023-09-30T22:26:55.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.046+0000 7fe23e611700 1 -- 172.21.15.40:0/2689179727 wait complete. 2023-09-30T22:26:55.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.046+0000 7fe23e611700 1 Processor -- start 2023-09-30T22:26:55.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.047+0000 7fe23e611700 1 -- start start 2023-09-30T22:26:55.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.047+0000 7fe23e611700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe23806a6d0 0x7fe2381c6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:55.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.047+0000 7fe23e611700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe23806afe0 0x7fe2381c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:55.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.047+0000 7fe23e611700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe238131df0 0x7fe23811c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:55.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.047+0000 7fe23e611700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2381bb270 con 0x7fe238131df0 2023-09-30T22:26:55.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.047+0000 7fe23e611700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe238131390 con 0x7fe23806a6d0 2023-09-30T22:26:55.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.047+0000 7fe23e611700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe238071560 con 0x7fe23806afe0 2023-09-30T22:26:55.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.047+0000 7fe237fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe23806a6d0 0x7fe2381c6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:55.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.047+0000 7fe237fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe23806a6d0 0x7fe2381c6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:36082/0 (socket says 172.21.15.40:36082) 2023-09-30T22:26:55.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.047+0000 7fe237fff700 1 -- 172.21.15.40:0/988486083 learned_addr learned my addr 172.21.15.40:0/988486083 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:55.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.047+0000 7fe2377fe700 1 --2- 172.21.15.40:0/988486083 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe23806afe0 0x7fe2381c6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:55.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.047+0000 7fe23cbae700 1 --2- 172.21.15.40:0/988486083 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe238131df0 0x7fe23811c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:55.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.048+0000 7fe237fff700 1 -- 172.21.15.40:0/988486083 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe23806afe0 msgr2=0x7fe2381c6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:55.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.048+0000 7fe237fff700 1 --2- 172.21.15.40:0/988486083 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe23806afe0 0x7fe2381c6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.048+0000 7fe237fff700 1 -- 172.21.15.40:0/988486083 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe238131df0 msgr2=0x7fe23811c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:55.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.048+0000 7fe237fff700 1 --2- 172.21.15.40:0/988486083 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe238131df0 0x7fe23811c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.048+0000 7fe237fff700 1 -- 172.21.15.40:0/988486083 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe22c0094a0 con 0x7fe23806a6d0 2023-09-30T22:26:55.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.048+0000 7fe2377fe700 1 --2- 172.21.15.40:0/988486083 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe23806afe0 0x7fe2381c6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:55.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.048+0000 7fe237fff700 1 --2- 172.21.15.40:0/988486083 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe23806a6d0 0x7fe2381c6790 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe228009c10 tx=0x7fe228004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:55.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.048+0000 7fe234ff9700 1 -- 172.21.15.40:0/988486083 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe228003c70 con 0x7fe23806a6d0 2023-09-30T22:26:55.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.048+0000 7fe234ff9700 1 -- 172.21.15.40:0/988486083 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe228003dd0 con 0x7fe23806a6d0 2023-09-30T22:26:55.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.048+0000 7fe23e611700 1 -- 172.21.15.40:0/988486083 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe228009500 con 0x7fe23806a6d0 2023-09-30T22:26:55.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.048+0000 7fe234ff9700 1 -- 172.21.15.40:0/988486083 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22801c640 con 0x7fe23806a6d0 2023-09-30T22:26:55.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.049+0000 7fe234ff9700 1 -- 172.21.15.40:0/988486083 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe22801c7a0 con 0x7fe23806a6d0 2023-09-30T22:26:55.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.049+0000 7fe23e611700 1 -- 172.21.15.40:0/988486083 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe238131860 con 0x7fe23806a6d0 2023-09-30T22:26:55.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.050+0000 7fe234ff9700 1 -- 172.21.15.40:0/988486083 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe228024570 con 0x7fe23806a6d0 2023-09-30T22:26:55.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.051+0000 7fe23e611700 1 -- 172.21.15.40:0/988486083 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe238062380 con 0x7fe23806a6d0 2023-09-30T22:26:55.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.056+0000 7fe234ff9700 1 -- 172.21.15.40:0/988486083 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe228016080 con 0x7fe23806a6d0 2023-09-30T22:26:55.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.099+0000 7fcc76b82700 1 Processor -- start 2023-09-30T22:26:55.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.099+0000 7fcc76b82700 1 -- start start 2023-09-30T22:26:55.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.099+0000 7fcc76b82700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc7009d920 0x7fcc7009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:55.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.099+0000 7fcc76b82700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc7009f0f0 0x7fcc7009e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:55.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.099+0000 7fcc76b82700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcc70133ca0 0x7fcc70134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:55.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.100+0000 7fcc76b82700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc7006b4c0 con 0x7fcc70133ca0 2023-09-30T22:26:55.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.100+0000 7fcc76b82700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7009a8f0 con 0x7fcc7009d920 2023-09-30T22:26:55.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.100+0000 7fcc76b82700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7009f940 con 0x7fcc7009f0f0 2023-09-30T22:26:55.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.100+0000 7fcc7491e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc7009d920 0x7fcc7009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:55.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.100+0000 7fcc7491e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc7009d920 0x7fcc7009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:36092/0 (socket says 172.21.15.40:36092) 2023-09-30T22:26:55.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.100+0000 7fcc7491e700 1 -- 172.21.15.40:0/313684490 learned_addr learned my addr 172.21.15.40:0/313684490 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:55.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.100+0000 7fcc6ffff700 1 --2- 172.21.15.40:0/313684490 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc7009f0f0 0x7fcc7009e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:55.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.100+0000 7fcc7511f700 1 --2- 172.21.15.40:0/313684490 >> v2:172.21.15.40:3300/0 conn(0x7fcc70133ca0 0x7fcc70134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:55.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.100+0000 7fcc7491e700 1 -- 172.21.15.40:0/313684490 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc7009f0f0 msgr2=0x7fcc7009e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:55.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.100+0000 7fcc7491e700 1 --2- 172.21.15.40:0/313684490 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc7009f0f0 0x7fcc7009e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.100+0000 7fcc7491e700 1 -- 172.21.15.40:0/313684490 >> v2:172.21.15.40:3300/0 conn(0x7fcc70133ca0 msgr2=0x7fcc70134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:55.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.100+0000 7fcc7491e700 1 --2- 172.21.15.40:0/313684490 >> v2:172.21.15.40:3300/0 conn(0x7fcc70133ca0 0x7fcc70134140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.100+0000 7fcc7491e700 1 -- 172.21.15.40:0/313684490 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc7009f6e0 con 0x7fcc7009d920 2023-09-30T22:26:55.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.100+0000 7fcc7491e700 1 --2- 172.21.15.40:0/313684490 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc7009d920 0x7fcc7009dcf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcc64009920 tx=0x7fcc64009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40cea8c07c185092 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:55.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.100+0000 7fcc6f7fe700 1 -- 172.21.15.40:0/313684490 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc64005e30 con 0x7fcc7009d920 2023-09-30T22:26:55.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.101+0000 7fcc6f7fe700 1 -- 172.21.15.40:0/313684490 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc64004030 con 0x7fcc7009d920 2023-09-30T22:26:55.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.101+0000 7fcc6f7fe700 1 -- 172.21.15.40:0/313684490 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc640043e0 con 0x7fcc7009d920 2023-09-30T22:26:55.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.101+0000 7fcc76b82700 1 -- 172.21.15.40:0/313684490 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc7009d920 msgr2=0x7fcc7009dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:55.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.101+0000 7fcc76b82700 1 --2- 172.21.15.40:0/313684490 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc7009d920 0x7fcc7009dcf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcc64009920 tx=0x7fcc64009c30 comp rx=0 tx=0).stop 2023-09-30T22:26:55.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.102+0000 7fcc76b82700 1 -- 172.21.15.40:0/313684490 shutdown_connections 2023-09-30T22:26:55.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.102+0000 7fcc76b82700 1 --2- 172.21.15.40:0/313684490 >> v2:172.21.15.40:3300/0 conn(0x7fcc70133ca0 0x7fcc70134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.102+0000 7fcc76b82700 1 --2- 172.21.15.40:0/313684490 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc7009d920 0x7fcc7009dcf0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.102+0000 7fcc76b82700 1 --2- 172.21.15.40:0/313684490 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc7009f0f0 0x7fcc7009e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.102+0000 7fcc76b82700 1 -- 172.21.15.40:0/313684490 >> 172.21.15.40:0/313684490 conn(0x7fcc7009fb20 msgr2=0x7fcc7009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:55.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.102+0000 7fcc76b82700 1 -- 172.21.15.40:0/313684490 shutdown_connections 2023-09-30T22:26:55.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.102+0000 7fcc76b82700 1 -- 172.21.15.40:0/313684490 wait complete. 2023-09-30T22:26:55.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.103+0000 7fcc76b82700 1 Processor -- start 2023-09-30T22:26:55.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.103+0000 7fcc76b82700 1 -- start start 2023-09-30T22:26:55.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.104+0000 7fcc76b82700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc7009d920 0x7fcc70121840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:55.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.104+0000 7fcc76b82700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc70133ca0 0x7fcc70121d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:55.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.104+0000 7fcc76b82700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc701222c0 0x7fcc701c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:55.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.104+0000 7fcc76b82700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc70125360 con 0x7fcc701222c0 2023-09-30T22:26:55.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.104+0000 7fcc76b82700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc70122ca0 con 0x7fcc7009d920 2023-09-30T22:26:55.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.104+0000 7fcc76b82700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7009c9e0 con 0x7fcc70133ca0 2023-09-30T22:26:55.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.104+0000 7fcc7491e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc7009d920 0x7fcc70121840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:55.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.104+0000 7fcc7491e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc7009d920 0x7fcc70121840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:36094/0 (socket says 172.21.15.40:36094) 2023-09-30T22:26:55.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.104+0000 7fcc7491e700 1 -- 172.21.15.40:0/1289355084 learned_addr learned my addr 172.21.15.40:0/1289355084 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:55.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.104+0000 7fcc6ffff700 1 --2- 172.21.15.40:0/1289355084 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc70133ca0 0x7fcc70121d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:55.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.104+0000 7fcc7511f700 1 --2- 172.21.15.40:0/1289355084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc701222c0 0x7fcc701c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:55.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.105+0000 7fcc7511f700 1 -- 172.21.15.40:0/1289355084 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc70133ca0 msgr2=0x7fcc70121d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:55.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.105+0000 7fcc7511f700 1 --2- 172.21.15.40:0/1289355084 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc70133ca0 0x7fcc70121d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.105+0000 7fcc7511f700 1 -- 172.21.15.40:0/1289355084 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc7009d920 msgr2=0x7fcc70121840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:55.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.105+0000 7fcc7511f700 1 --2- 172.21.15.40:0/1289355084 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc7009d920 0x7fcc70121840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.105+0000 7fcc7511f700 1 -- 172.21.15.40:0/1289355084 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc64009500 con 0x7fcc701222c0 2023-09-30T22:26:55.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.105+0000 7fcc7491e700 1 --2- 172.21.15.40:0/1289355084 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc7009d920 0x7fcc70121840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:55.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.105+0000 7fcc6ffff700 1 --2- 172.21.15.40:0/1289355084 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc70133ca0 0x7fcc70121d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:55.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.105+0000 7fcc7511f700 1 --2- 172.21.15.40:0/1289355084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc701222c0 0x7fcc701c8800 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fcc68007dc0 tx=0x7fcc6800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:55.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.105+0000 7fcc6d7fa700 1 -- 172.21.15.40:0/1289355084 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc68018070 con 0x7fcc701222c0 2023-09-30T22:26:55.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.105+0000 7fcc76b82700 1 -- 172.21.15.40:0/1289355084 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc70123cb0 con 0x7fcc701222c0 2023-09-30T22:26:55.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.105+0000 7fcc76b82700 1 -- 172.21.15.40:0/1289355084 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc70132790 con 0x7fcc701222c0 2023-09-30T22:26:55.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.106+0000 7fcc6d7fa700 1 -- 172.21.15.40:0/1289355084 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6800eb30 con 0x7fcc701222c0 2023-09-30T22:26:55.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.106+0000 7fcc6d7fa700 1 -- 172.21.15.40:0/1289355084 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6800eea0 con 0x7fcc701222c0 2023-09-30T22:26:55.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.106+0000 7fcc6d7fa700 1 -- 172.21.15.40:0/1289355084 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcc68014420 con 0x7fcc701222c0 2023-09-30T22:26:55.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.107+0000 7fcc6d7fa700 1 -- 172.21.15.40:0/1289355084 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fcc6803f600 con 0x7fcc701222c0 2023-09-30T22:26:55.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.107+0000 7fcc76b82700 1 -- 172.21.15.40:0/1289355084 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc500052e0 con 0x7fcc701222c0 2023-09-30T22:26:55.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.116+0000 7fcc6d7fa700 1 -- 172.21.15.40:0/1289355084 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcc680128d0 con 0x7fcc701222c0 2023-09-30T22:26:55.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.149+0000 7f889e2f4700 1 Processor -- start 2023-09-30T22:26:55.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.149+0000 7f889e2f4700 1 -- start start 2023-09-30T22:26:55.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.150+0000 7f889e2f4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f889806f070 0x7f889806f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:55.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.150+0000 7f889e2f4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f889806f980 0x7f8898097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:55.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.150+0000 7f889e2f4700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8898070830 con 0x7f889806fdb0 2023-09-30T22:26:55.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.150+0000 7f889e2f4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8898071af0 con 0x7f889806f980 2023-09-30T22:26:55.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.150+0000 7f889e2f4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8898070ad0 con 0x7f889806f070 2023-09-30T22:26:55.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.150+0000 7f88977fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f889806f980 0x7f8898097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:55.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.150+0000 7f88977fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f889806f980 0x7f8898097090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36116/0 (socket says 172.21.15.40:36116) 2023-09-30T22:26:55.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.150+0000 7f88977fe700 1 -- 172.21.15.40:0/1592625501 learned_addr learned my addr 172.21.15.40:0/1592625501 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:55.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.150+0000 7f8897fff700 1 --2- 172.21.15.40:0/1592625501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f889806f070 0x7f889806f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:55.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.151+0000 7f88977fe700 1 -- 172.21.15.40:0/1592625501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f889806f070 msgr2=0x7f889806f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:55.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.151+0000 7f88977fe700 1 --2- 172.21.15.40:0/1592625501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f889806f070 0x7f889806f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.151+0000 7f88977fe700 1 -- 172.21.15.40:0/1592625501 >> v1:172.21.15.40:6789/0 conn(0x7f889806fdb0 legacy=0x7f88980975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:55.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.151+0000 7f88977fe700 1 -- 172.21.15.40:0/1592625501 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8898070de0 con 0x7f889806f980 2023-09-30T22:26:55.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.151+0000 7f88977fe700 1 --2- 172.21.15.40:0/1592625501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f889806f980 0x7f8898097090 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f888c009920 tx=0x7f888c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4224ffa80d862902 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:55.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.151+0000 7f8896ffd700 1 -- 172.21.15.40:0/1592625501 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c011830 con 0x7f889806f980 2023-09-30T22:26:55.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.151+0000 7f8896ffd700 1 -- 172.21.15.40:0/1592625501 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888c011990 con 0x7f889806f980 2023-09-30T22:26:55.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.151+0000 7f8896ffd700 1 -- 172.21.15.40:0/1592625501 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c011d20 con 0x7f889806f980 2023-09-30T22:26:55.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.152+0000 7f889e2f4700 1 -- 172.21.15.40:0/1592625501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f889806f980 msgr2=0x7f8898097090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:55.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.152+0000 7f889e2f4700 1 --2- 172.21.15.40:0/1592625501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f889806f980 0x7f8898097090 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f888c009920 tx=0x7f888c009c30 comp rx=0 tx=0).stop 2023-09-30T22:26:55.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.152+0000 7f889e2f4700 1 -- 172.21.15.40:0/1592625501 shutdown_connections 2023-09-30T22:26:55.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.152+0000 7f889e2f4700 1 --2- 172.21.15.40:0/1592625501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f889806f070 0x7f889806f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.152+0000 7f889e2f4700 1 --2- 172.21.15.40:0/1592625501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f889806f980 0x7f8898097090 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.152+0000 7f889e2f4700 1 -- 172.21.15.40:0/1592625501 >> 172.21.15.40:0/1592625501 conn(0x7f88980a41a0 msgr2=0x7f88980a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:55.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.152+0000 7f889e2f4700 1 -- 172.21.15.40:0/1592625501 shutdown_connections 2023-09-30T22:26:55.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.152+0000 7f889e2f4700 1 -- 172.21.15.40:0/1592625501 wait complete. 2023-09-30T22:26:55.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.153+0000 7f889e2f4700 1 Processor -- start 2023-09-30T22:26:55.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.153+0000 7f889e2f4700 1 -- start start 2023-09-30T22:26:55.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.154+0000 7f889e2f4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f889806f070 0x7f889809b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:55.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.154+0000 7f889e2f4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f889806f980 0x7f889809bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:55.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.154+0000 7f889e2f4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f889806fdb0 0x7f889809c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:55.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.154+0000 7f889e2f4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889809dd30 con 0x7f889806fdb0 2023-09-30T22:26:55.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.154+0000 7f889e2f4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f889808b330 con 0x7f889806f070 2023-09-30T22:26:55.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.154+0000 7f889e2f4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f889809c990 con 0x7f889806f980 2023-09-30T22:26:55.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.154+0000 7f889c891700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f889806fdb0 0x7f889809c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:55.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.154+0000 7f889c891700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f889806fdb0 0x7f889809c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36130/0 (socket says 172.21.15.40:36130) 2023-09-30T22:26:55.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.154+0000 7f889c891700 1 -- 172.21.15.40:0/661254388 learned_addr learned my addr 172.21.15.40:0/661254388 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:55.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.154+0000 7f8897fff700 1 --2- 172.21.15.40:0/661254388 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f889806f070 0x7f889809b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:55.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.155+0000 7f889c891700 1 -- 172.21.15.40:0/661254388 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f889806f980 msgr2=0x7f889809bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:55.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.155+0000 7f889c891700 1 --2- 172.21.15.40:0/661254388 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f889806f980 0x7f889809bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.155+0000 7f889c891700 1 -- 172.21.15.40:0/661254388 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f889806f070 msgr2=0x7f889809b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:55.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.155+0000 7f889c891700 1 --2- 172.21.15.40:0/661254388 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f889806f070 0x7f889809b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.155+0000 7f889c891700 1 -- 172.21.15.40:0/661254388 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f888c009550 con 0x7f889806fdb0 2023-09-30T22:26:55.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.155+0000 7f889c891700 1 --2- 172.21.15.40:0/661254388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f889806fdb0 0x7f889809c020 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f889000cbf0 tx=0x7f889000cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:55.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.155+0000 7f8894ff9700 1 -- 172.21.15.40:0/661254388 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8890003c00 con 0x7f889806fdb0 2023-09-30T22:26:55.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.155+0000 7f8894ff9700 1 -- 172.21.15.40:0/661254388 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8890003d60 con 0x7f889806fdb0 2023-09-30T22:26:55.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.155+0000 7f889e2f4700 1 -- 172.21.15.40:0/661254388 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8898130ca0 con 0x7f889806fdb0 2023-09-30T22:26:55.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.155+0000 7f8894ff9700 1 -- 172.21.15.40:0/661254388 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889000ab50 con 0x7f889806fdb0 2023-09-30T22:26:55.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.155+0000 7f889e2f4700 1 -- 172.21.15.40:0/661254388 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f889812c320 con 0x7f889806fdb0 2023-09-30T22:26:55.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.156+0000 7f8894ff9700 1 -- 172.21.15.40:0/661254388 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f889000acb0 con 0x7f889806fdb0 2023-09-30T22:26:55.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.156+0000 7f8894ff9700 1 -- 172.21.15.40:0/661254388 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f889003f6b0 con 0x7f889806fdb0 2023-09-30T22:26:55.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.157+0000 7f889e2f4700 1 -- 172.21.15.40:0/661254388 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f889808b470 con 0x7f889806fdb0 2023-09-30T22:26:55.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.161+0000 7f8894ff9700 1 -- 172.21.15.40:0/661254388 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f889808b470 con 0x7f889806fdb0 2023-09-30T22:26:55.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.185+0000 7f87a2523700 1 Processor -- start 2023-09-30T22:26:55.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.185+0000 7f87a2523700 1 -- start start 2023-09-30T22:26:55.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.185+0000 7f87a2523700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f879c06fb50 0x7f879c136c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:55.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.185+0000 7f87a2523700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f879c1371b0 0x7f879c139590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:55.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.186+0000 7f87a2523700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f879c070830 con 0x7f879c06f070 2023-09-30T22:26:55.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.186+0000 7f87a2523700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f879c070ad0 con 0x7f879c06fb50 2023-09-30T22:26:55.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.186+0000 7f87a2523700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f879c070de0 con 0x7f879c1371b0 2023-09-30T22:26:55.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.186+0000 7f879b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f879c06fb50 0x7f879c136c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:55.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.186+0000 7f879b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f879c06fb50 0x7f879c136c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:36114/0 (socket says 172.21.15.40:36114) 2023-09-30T22:26:55.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.186+0000 7f879b7fe700 1 -- 172.21.15.40:0/3993294311 learned_addr learned my addr 172.21.15.40:0/3993294311 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:55.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.186+0000 7f879b7fe700 1 -- 172.21.15.40:0/3993294311 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f879c1371b0 msgr2=0x7f879c139590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:26:55.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.186+0000 7f879b7fe700 1 --2- 172.21.15.40:0/3993294311 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f879c1371b0 0x7f879c139590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.186+0000 7f879b7fe700 1 -- 172.21.15.40:0/3993294311 >> v1:172.21.15.40:6789/0 conn(0x7f879c06f070 legacy=0x7f879c06f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:55.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.186+0000 7f879b7fe700 1 -- 172.21.15.40:0/3993294311 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879c09fe20 con 0x7f879c06fb50 2023-09-30T22:26:55.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.186+0000 7f879b7fe700 1 --2- 172.21.15.40:0/3993294311 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f879c06fb50 0x7f879c136c70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8790009920 tx=0x7f8790009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2258258688af52e8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:55.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.186+0000 7f879affd700 1 -- 172.21.15.40:0/3993294311 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879000ba60 con 0x7f879c06fb50 2023-09-30T22:26:55.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.186+0000 7f879affd700 1 -- 172.21.15.40:0/3993294311 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879000bbc0 con 0x7f879c06fb50 2023-09-30T22:26:55.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.186+0000 7f879affd700 1 -- 172.21.15.40:0/3993294311 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8790009e70 con 0x7f879c06fb50 2023-09-30T22:26:55.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.187+0000 7f87a2523700 1 -- 172.21.15.40:0/3993294311 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f879c06fb50 msgr2=0x7f879c136c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:55.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.187+0000 7f87a2523700 1 --2- 172.21.15.40:0/3993294311 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f879c06fb50 0x7f879c136c70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8790009920 tx=0x7f8790009c30 comp rx=0 tx=0).stop 2023-09-30T22:26:55.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.187+0000 7f87a2523700 1 -- 172.21.15.40:0/3993294311 shutdown_connections 2023-09-30T22:26:55.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.187+0000 7f87a2523700 1 --2- 172.21.15.40:0/3993294311 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f879c1371b0 0x7f879c139590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.187+0000 7f87a2523700 1 --2- 172.21.15.40:0/3993294311 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f879c06fb50 0x7f879c136c70 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.187+0000 7f87a2523700 1 -- 172.21.15.40:0/3993294311 >> 172.21.15.40:0/3993294311 conn(0x7f879c0a41a0 msgr2=0x7f879c0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:55.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.187+0000 7f87a2523700 1 -- 172.21.15.40:0/3993294311 shutdown_connections 2023-09-30T22:26:55.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.187+0000 7f87a2523700 1 -- 172.21.15.40:0/3993294311 wait complete. 2023-09-30T22:26:55.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.189+0000 7f87a2523700 1 Processor -- start 2023-09-30T22:26:55.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.189+0000 7f87a2523700 1 -- start start 2023-09-30T22:26:55.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.189+0000 7f87a2523700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f879c06f070 0x7f879c1354c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:55.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.189+0000 7f87a2523700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f879c06fb50 0x7f879c135a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:55.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.190+0000 7f87a2523700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f879c1371b0 0x7f879c1c63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:55.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.190+0000 7f87a2523700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879c12df50 con 0x7f879c1371b0 2023-09-30T22:26:55.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.190+0000 7f87a2523700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f879c1366a0 con 0x7f879c06f070 2023-09-30T22:26:55.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.190+0000 7f87a2523700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f879c12dc90 con 0x7f879c06fb50 2023-09-30T22:26:55.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.190+0000 7f879bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f879c06f070 0x7f879c1354c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:55.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.190+0000 7f879bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f879c06f070 0x7f879c1354c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:36128/0 (socket says 172.21.15.40:36128) 2023-09-30T22:26:55.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.190+0000 7f87a0ac0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f879c1371b0 0x7f879c1c63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:55.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.190+0000 7f879bfff700 1 -- 172.21.15.40:0/3087878857 learned_addr learned my addr 172.21.15.40:0/3087878857 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:55.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.190+0000 7f879b7fe700 1 --2- 172.21.15.40:0/3087878857 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f879c06fb50 0x7f879c135a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:55.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.190+0000 7f879bfff700 1 -- 172.21.15.40:0/3087878857 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f879c06fb50 msgr2=0x7f879c135a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:55.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.190+0000 7f879bfff700 1 --2- 172.21.15.40:0/3087878857 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f879c06fb50 0x7f879c135a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.190+0000 7f879bfff700 1 -- 172.21.15.40:0/3087878857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f879c1371b0 msgr2=0x7f879c1c63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:55.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.190+0000 7f879bfff700 1 --2- 172.21.15.40:0/3087878857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f879c1371b0 0x7f879c1c63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.190+0000 7f879bfff700 1 -- 172.21.15.40:0/3087878857 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8790009550 con 0x7f879c06f070 2023-09-30T22:26:55.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.190+0000 7f87a0ac0700 1 --2- 172.21.15.40:0/3087878857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f879c1371b0 0x7f879c1c63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:55.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.190+0000 7f879bfff700 1 --2- 172.21.15.40:0/3087878857 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f879c06f070 0x7f879c1354c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f878c001c20 tx=0x7f878c014330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:55.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.190+0000 7f8798ff9700 1 -- 172.21.15.40:0/3087878857 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c012470 con 0x7f879c06f070 2023-09-30T22:26:55.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.191+0000 7f8798ff9700 1 -- 172.21.15.40:0/3087878857 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878c0125d0 con 0x7f879c06f070 2023-09-30T22:26:55.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.191+0000 7f8798ff9700 1 -- 172.21.15.40:0/3087878857 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c0052f0 con 0x7f879c06f070 2023-09-30T22:26:55.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.191+0000 7f87a2523700 1 -- 172.21.15.40:0/3087878857 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f879c135f40 con 0x7f879c06f070 2023-09-30T22:26:55.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.191+0000 7f87a2523700 1 -- 172.21.15.40:0/3087878857 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f879c1350e0 con 0x7f879c06f070 2023-09-30T22:26:55.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.192+0000 7f87a2523700 1 -- 172.21.15.40:0/3087878857 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f879c12e310 con 0x7f879c06f070 2023-09-30T22:26:55.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.193+0000 7f8798ff9700 1 -- 172.21.15.40:0/3087878857 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f878c00f070 con 0x7f879c06f070 2023-09-30T22:26:55.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.193+0000 7f8798ff9700 1 -- 172.21.15.40:0/3087878857 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f878c03efa0 con 0x7f879c06f070 2023-09-30T22:26:55.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.202+0000 7f8798ff9700 1 -- 172.21.15.40:0/3087878857 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f878c070750 con 0x7f879c06f070 2023-09-30T22:26:55.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.266+0000 7fe23e611700 1 -- 172.21.15.40:0/988486083 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe238074720 con 0x7fe23806a6d0 2023-09-30T22:26:55.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.266+0000 7fe234ff9700 1 -- 172.21.15.40:0/988486083 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe22803c090 con 0x7fe23806a6d0 2023-09-30T22:26:55.267 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:55.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.269+0000 7fe23e611700 1 -- 172.21.15.40:0/988486083 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe23806a6d0 msgr2=0x7fe2381c6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:55.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.269+0000 7fe23e611700 1 --2- 172.21.15.40:0/988486083 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe23806a6d0 0x7fe2381c6790 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe228009c10 tx=0x7fe228004750 comp rx=0 tx=0).stop 2023-09-30T22:26:55.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.269+0000 7fe23e611700 1 -- 172.21.15.40:0/988486083 shutdown_connections 2023-09-30T22:26:55.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.269+0000 7fe23e611700 1 --2- 172.21.15.40:0/988486083 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe238131df0 0x7fe23811c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.269+0000 7fe23e611700 1 --2- 172.21.15.40:0/988486083 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe23806a6d0 0x7fe2381c6790 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.269+0000 7fe23e611700 1 --2- 172.21.15.40:0/988486083 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe23806afe0 0x7fe2381c6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.269+0000 7fe23e611700 1 -- 172.21.15.40:0/988486083 >> 172.21.15.40:0/988486083 conn(0x7fe23809fb20 msgr2=0x7fe2380a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:55.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.269+0000 7fe23e611700 1 -- 172.21.15.40:0/988486083 shutdown_connections 2023-09-30T22:26:55.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.269+0000 7fe23e611700 1 -- 172.21.15.40:0/988486083 wait complete. 2023-09-30T22:26:55.282 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:55.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.318+0000 7fcc76b82700 1 -- 172.21.15.40:0/1289355084 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcc50005590 con 0x7fcc701222c0 2023-09-30T22:26:55.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.318+0000 7fcc6d7fa700 1 -- 172.21.15.40:0/1289355084 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcc680122e0 con 0x7fcc701222c0 2023-09-30T22:26:55.319 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:55.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.320+0000 7fcc76b82700 1 -- 172.21.15.40:0/1289355084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc701222c0 msgr2=0x7fcc701c8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:55.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.320+0000 7fcc76b82700 1 --2- 172.21.15.40:0/1289355084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc701222c0 0x7fcc701c8800 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fcc68007dc0 tx=0x7fcc6800e3c0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.320+0000 7fcc76b82700 1 -- 172.21.15.40:0/1289355084 shutdown_connections 2023-09-30T22:26:55.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.321+0000 7fcc76b82700 1 --2- 172.21.15.40:0/1289355084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc701222c0 0x7fcc701c8800 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.321+0000 7fcc76b82700 1 --2- 172.21.15.40:0/1289355084 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc7009d920 0x7fcc70121840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.321+0000 7fcc76b82700 1 --2- 172.21.15.40:0/1289355084 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc70133ca0 0x7fcc70121d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.321+0000 7fcc76b82700 1 -- 172.21.15.40:0/1289355084 >> 172.21.15.40:0/1289355084 conn(0x7fcc7009fb20 msgr2=0x7fcc700a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:55.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.321+0000 7fcc76b82700 1 -- 172.21.15.40:0/1289355084 shutdown_connections 2023-09-30T22:26:55.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.321+0000 7fcc76b82700 1 -- 172.21.15.40:0/1289355084 wait complete. 2023-09-30T22:26:55.334 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:55.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.367+0000 7f889e2f4700 1 -- 172.21.15.40:0/661254388 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f889808b470 con 0x7f889806fdb0 2023-09-30T22:26:55.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.367+0000 7f8894ff9700 1 -- 172.21.15.40:0/661254388 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f889808b470 con 0x7f889806fdb0 2023-09-30T22:26:55.368 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:55.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.370+0000 7f889e2f4700 1 -- 172.21.15.40:0/661254388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f889806fdb0 msgr2=0x7f889809c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:55.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.370+0000 7f889e2f4700 1 --2- 172.21.15.40:0/661254388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f889806fdb0 0x7f889809c020 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f889000cbf0 tx=0x7f889000cf00 comp rx=0 tx=0).stop 2023-09-30T22:26:55.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.370+0000 7f889e2f4700 1 -- 172.21.15.40:0/661254388 shutdown_connections 2023-09-30T22:26:55.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.370+0000 7f889e2f4700 1 --2- 172.21.15.40:0/661254388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f889806fdb0 0x7f889809c020 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.370+0000 7f889e2f4700 1 --2- 172.21.15.40:0/661254388 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f889806f070 0x7f889809b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.370+0000 7f889e2f4700 1 --2- 172.21.15.40:0/661254388 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f889806f980 0x7f889809bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.370+0000 7f889e2f4700 1 -- 172.21.15.40:0/661254388 >> 172.21.15.40:0/661254388 conn(0x7f88980a41a0 msgr2=0x7f889809a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:55.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.370+0000 7f889e2f4700 1 -- 172.21.15.40:0/661254388 shutdown_connections 2023-09-30T22:26:55.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.370+0000 7f889e2f4700 1 -- 172.21.15.40:0/661254388 wait complete. 2023-09-30T22:26:55.382 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:55.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.399+0000 7f87a2523700 1 -- 172.21.15.40:0/3087878857 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f879c062380 con 0x7f879c06f070 2023-09-30T22:26:55.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.399+0000 7f8798ff9700 1 -- 172.21.15.40:0/3087878857 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f878c005450 con 0x7f879c06f070 2023-09-30T22:26:55.400 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:55.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.401+0000 7f87a2523700 1 -- 172.21.15.40:0/3087878857 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f879c06f070 msgr2=0x7f879c1354c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:55.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.401+0000 7f87a2523700 1 --2- 172.21.15.40:0/3087878857 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f879c06f070 0x7f879c1354c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f878c001c20 tx=0x7f878c014330 comp rx=0 tx=0).stop 2023-09-30T22:26:55.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.401+0000 7f87a2523700 1 -- 172.21.15.40:0/3087878857 shutdown_connections 2023-09-30T22:26:55.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.401+0000 7f87a2523700 1 --2- 172.21.15.40:0/3087878857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f879c1371b0 0x7f879c1c63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.401+0000 7f87a2523700 1 --2- 172.21.15.40:0/3087878857 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f879c06f070 0x7f879c1354c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.401+0000 7f87a2523700 1 --2- 172.21.15.40:0/3087878857 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f879c06fb50 0x7f879c135a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.401+0000 7f87a2523700 1 -- 172.21.15.40:0/3087878857 >> 172.21.15.40:0/3087878857 conn(0x7f879c0a41a0 msgr2=0x7f879c09a460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:55.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.402+0000 7f87a2523700 1 -- 172.21.15.40:0/3087878857 shutdown_connections 2023-09-30T22:26:55.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:55.402+0000 7f87a2523700 1 -- 172.21.15.40:0/3087878857 wait complete. 2023-09-30T22:26:55.414 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:56.284 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:56.335 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:56.383 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:56.415 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:56.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.428+0000 7fb0536e6700 1 Processor -- start 2023-09-30T22:26:56.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.428+0000 7fb0536e6700 1 -- start start 2023-09-30T22:26:56.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.429+0000 7fb0536e6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb04c133e00 0x7fb04c1341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.429+0000 7fb0536e6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb04c09df70 0x7fb04c13bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.429+0000 7fb0536e6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb04c133940 con 0x7fb04c09d400 2023-09-30T22:26:56.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.429+0000 7fb0536e6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb04c09ab20 con 0x7fb04c133e00 2023-09-30T22:26:56.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.429+0000 7fb0536e6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c09f0d0 con 0x7fb04c09df70 2023-09-30T22:26:56.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.429+0000 7fb051c83700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb04c09df70 0x7fb04c13bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.429+0000 7fb051c83700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb04c09df70 0x7fb04c13bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51832/0 (socket says 172.21.15.40:51832) 2023-09-30T22:26:56.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.429+0000 7fb051c83700 1 -- 172.21.15.40:0/3327318391 learned_addr learned my addr 172.21.15.40:0/3327318391 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:56.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.429+0000 7fb051482700 1 --2- 172.21.15.40:0/3327318391 >> v2:172.21.15.40:3300/0 conn(0x7fb04c133e00 0x7fb04c1341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.430+0000 7fb051c83700 1 -- 172.21.15.40:0/3327318391 >> v2:172.21.15.40:3300/0 conn(0x7fb04c133e00 msgr2=0x7fb04c1341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:56.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.430+0000 7fb051c83700 1 --2- 172.21.15.40:0/3327318391 >> v2:172.21.15.40:3300/0 conn(0x7fb04c133e00 0x7fb04c1341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.430+0000 7fb051c83700 1 -- 172.21.15.40:0/3327318391 >> v1:172.21.15.40:6789/0 conn(0x7fb04c09d400 legacy=0x7fb04c09d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.430+0000 7fb043fff700 1 -- 172.21.15.40:0/3327318391 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1858873800 0 0) 0x7fb04c133940 con 0x7fb04c09d400 2023-09-30T22:26:56.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.430+0000 7fb051c83700 1 -- 172.21.15.40:0/3327318391 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04c133be0 con 0x7fb04c09df70 2023-09-30T22:26:56.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.430+0000 7fb051482700 1 --2- 172.21.15.40:0/3327318391 >> v2:172.21.15.40:3300/0 conn(0x7fb04c133e00 0x7fb04c1341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:56.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.430+0000 7fb051c83700 1 --2- 172.21.15.40:0/3327318391 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb04c09df70 0x7fb04c13bc80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb044014a00 tx=0x7fb044014d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9548f9e9fefd6050 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:56.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.430+0000 7fb043fff700 1 -- 172.21.15.40:0/3327318391 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb044014ea0 con 0x7fb04c09df70 2023-09-30T22:26:56.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.430+0000 7fb043fff700 1 -- 172.21.15.40:0/3327318391 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb044013af0 con 0x7fb04c09df70 2023-09-30T22:26:56.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.430+0000 7fb043fff700 1 -- 172.21.15.40:0/3327318391 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb044013ea0 con 0x7fb04c09df70 2023-09-30T22:26:56.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.431+0000 7fb0536e6700 1 -- 172.21.15.40:0/3327318391 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb04c09df70 msgr2=0x7fb04c13bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.431+0000 7fb0536e6700 1 --2- 172.21.15.40:0/3327318391 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb04c09df70 0x7fb04c13bc80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb044014a00 tx=0x7fb044014d10 comp rx=0 tx=0).stop 2023-09-30T22:26:56.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.431+0000 7fb0536e6700 1 -- 172.21.15.40:0/3327318391 shutdown_connections 2023-09-30T22:26:56.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.431+0000 7fb0536e6700 1 --2- 172.21.15.40:0/3327318391 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb04c09df70 0x7fb04c13bc80 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.431+0000 7fb0536e6700 1 --2- 172.21.15.40:0/3327318391 >> v2:172.21.15.40:3300/0 conn(0x7fb04c133e00 0x7fb04c1341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.431+0000 7fb0536e6700 1 -- 172.21.15.40:0/3327318391 >> 172.21.15.40:0/3327318391 conn(0x7fb04c0a2a00 msgr2=0x7fb04c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:56.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.431+0000 7fb0536e6700 1 -- 172.21.15.40:0/3327318391 shutdown_connections 2023-09-30T22:26:56.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.432+0000 7fb0536e6700 1 -- 172.21.15.40:0/3327318391 wait complete. 2023-09-30T22:26:56.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.432+0000 7fb0536e6700 1 Processor -- start 2023-09-30T22:26:56.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.432+0000 7fb0536e6700 1 -- start start 2023-09-30T22:26:56.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.433+0000 7fb0536e6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb04c09d400 0x7fb04c1295a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.433+0000 7fb0536e6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb04c09df70 0x7fb04c129ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.433+0000 7fb0536e6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb04c133e00 0x7fb04c06d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.433+0000 7fb0536e6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c12a020 con 0x7fb04c133e00 2023-09-30T22:26:56.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.433+0000 7fb0536e6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c06feb0 con 0x7fb04c09df70 2023-09-30T22:26:56.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.433+0000 7fb0536e6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c06e880 con 0x7fb04c09d400 2023-09-30T22:26:56.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.433+0000 7fb050c81700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb04c09df70 0x7fb04c129ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.433+0000 7fb050c81700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb04c09df70 0x7fb04c129ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:36138/0 (socket says 172.21.15.40:36138) 2023-09-30T22:26:56.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.433+0000 7fb050c81700 1 -- 172.21.15.40:0/641109848 learned_addr learned my addr 172.21.15.40:0/641109848 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:56.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.433+0000 7fb051482700 1 --2- 172.21.15.40:0/641109848 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb04c09d400 0x7fb04c1295a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.433+0000 7fb051c83700 1 --2- 172.21.15.40:0/641109848 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb04c133e00 0x7fb04c06d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.434+0000 7fb050c81700 1 -- 172.21.15.40:0/641109848 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb04c09d400 msgr2=0x7fb04c1295a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.434+0000 7fb050c81700 1 --2- 172.21.15.40:0/641109848 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb04c09d400 0x7fb04c1295a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.434+0000 7fb050c81700 1 -- 172.21.15.40:0/641109848 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb04c133e00 msgr2=0x7fb04c06d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.434+0000 7fb050c81700 1 --2- 172.21.15.40:0/641109848 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb04c133e00 0x7fb04c06d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.434+0000 7fb050c81700 1 -- 172.21.15.40:0/641109848 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0480094a0 con 0x7fb04c09df70 2023-09-30T22:26:56.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.434+0000 7fb051482700 1 --2- 172.21.15.40:0/641109848 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb04c09d400 0x7fb04c1295a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:56.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.434+0000 7fb050c81700 1 --2- 172.21.15.40:0/641109848 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb04c09df70 0x7fb04c129ae0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00c520 tx=0x7fb03c00c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:56.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.434+0000 7fb041ffb700 1 -- 172.21.15.40:0/641109848 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c0054e0 con 0x7fb04c09df70 2023-09-30T22:26:56.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.434+0000 7fb041ffb700 1 -- 172.21.15.40:0/641109848 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03c003680 con 0x7fb04c09df70 2023-09-30T22:26:56.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.434+0000 7fb0536e6700 1 -- 172.21.15.40:0/641109848 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb044014660 con 0x7fb04c09df70 2023-09-30T22:26:56.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.434+0000 7fb041ffb700 1 -- 172.21.15.40:0/641109848 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c0039f0 con 0x7fb04c09df70 2023-09-30T22:26:56.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.434+0000 7fb0536e6700 1 -- 172.21.15.40:0/641109848 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb04c070410 con 0x7fb04c09df70 2023-09-30T22:26:56.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.435+0000 7fb0536e6700 1 -- 172.21.15.40:0/641109848 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb04c12e1d0 con 0x7fb04c09df70 2023-09-30T22:26:56.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.435+0000 7fb041ffb700 1 -- 172.21.15.40:0/641109848 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb03c003b50 con 0x7fb04c09df70 2023-09-30T22:26:56.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.437+0000 7fb041ffb700 1 -- 172.21.15.40:0/641109848 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb03c01ab60 con 0x7fb04c09df70 2023-09-30T22:26:56.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.441+0000 7fb041ffb700 1 -- 172.21.15.40:0/641109848 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb03c044060 con 0x7fb04c09df70 2023-09-30T22:26:56.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.496+0000 7f8f27db4700 1 Processor -- start 2023-09-30T22:26:56.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.497+0000 7f8f27db4700 1 -- start start 2023-09-30T22:26:56.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.497+0000 7f8f27db4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f2006f070 0x7f8f2006f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.497+0000 7f8f27db4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f2006f980 0x7f8f20097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.497+0000 7f8f27db4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8f2006fdb0 0x7f8f200975d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.497+0000 7f8f27db4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f20071af0 con 0x7f8f2006fdb0 2023-09-30T22:26:56.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.497+0000 7f8f27db4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f20070830 con 0x7f8f2006f070 2023-09-30T22:26:56.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.497+0000 7f8f27db4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f20070ad0 con 0x7f8f2006f980 2023-09-30T22:26:56.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.498+0000 7f8f25b50700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f2006f070 0x7f8f2006f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.498+0000 7f8f25b50700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f2006f070 0x7f8f2006f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:36154/0 (socket says 172.21.15.40:36154) 2023-09-30T22:26:56.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.498+0000 7f8f25b50700 1 -- 172.21.15.40:0/3082876076 learned_addr learned my addr 172.21.15.40:0/3082876076 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:56.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.498+0000 7f8f26351700 1 --2- 172.21.15.40:0/3082876076 >> v2:172.21.15.40:3300/0 conn(0x7f8f2006fdb0 0x7f8f200975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.498+0000 7f8f2534f700 1 --2- 172.21.15.40:0/3082876076 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f2006f980 0x7f8f20097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.498+0000 7f8f26351700 1 -- 172.21.15.40:0/3082876076 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f2006f980 msgr2=0x7f8f20097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:56.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.498+0000 7f8f26351700 1 --2- 172.21.15.40:0/3082876076 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f2006f980 0x7f8f20097090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.498+0000 7f8f26351700 1 -- 172.21.15.40:0/3082876076 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f2006f070 msgr2=0x7f8f2006f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:56.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.498+0000 7f8f26351700 1 --2- 172.21.15.40:0/3082876076 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f2006f070 0x7f8f2006f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.498+0000 7f8f26351700 1 -- 172.21.15.40:0/3082876076 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f20070de0 con 0x7f8f2006fdb0 2023-09-30T22:26:56.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.498+0000 7f8f26351700 1 --2- 172.21.15.40:0/3082876076 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f2006fdb0 0x7f8f200975d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f8f18009d90 tx=0x7f8f1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb788aed7ff3125a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:56.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.499+0000 7f8f24b4e700 1 -- 172.21.15.40:0/3082876076 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1800e070 con 0x7f8f2006fdb0 2023-09-30T22:26:56.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.499+0000 7f8f24b4e700 1 -- 172.21.15.40:0/3082876076 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f1800bb20 con 0x7f8f2006fdb0 2023-09-30T22:26:56.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.499+0000 7f8f24b4e700 1 -- 172.21.15.40:0/3082876076 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f18012430 con 0x7f8f2006fdb0 2023-09-30T22:26:56.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.499+0000 7f8f27db4700 1 -- 172.21.15.40:0/3082876076 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f2006fdb0 msgr2=0x7f8f200975d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.499+0000 7f8f27db4700 1 --2- 172.21.15.40:0/3082876076 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f2006fdb0 0x7f8f200975d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f8f18009d90 tx=0x7f8f1800b330 comp rx=0 tx=0).stop 2023-09-30T22:26:56.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.500+0000 7f8f27db4700 1 -- 172.21.15.40:0/3082876076 shutdown_connections 2023-09-30T22:26:56.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.500+0000 7f8f27db4700 1 --2- 172.21.15.40:0/3082876076 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f2006fdb0 0x7f8f200975d0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.500+0000 7f8f27db4700 1 --2- 172.21.15.40:0/3082876076 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f2006f070 0x7f8f2006f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.500+0000 7f8f27db4700 1 --2- 172.21.15.40:0/3082876076 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f2006f980 0x7f8f20097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.500+0000 7f8f27db4700 1 -- 172.21.15.40:0/3082876076 >> 172.21.15.40:0/3082876076 conn(0x7f8f200a41a0 msgr2=0x7f8f200a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:56.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.500+0000 7f8f27db4700 1 -- 172.21.15.40:0/3082876076 shutdown_connections 2023-09-30T22:26:56.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.500+0000 7f8f27db4700 1 -- 172.21.15.40:0/3082876076 wait complete. 2023-09-30T22:26:56.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.501+0000 7f8f27db4700 1 Processor -- start 2023-09-30T22:26:56.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.501+0000 7f8f27db4700 1 -- start start 2023-09-30T22:26:56.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.502+0000 7f8f27db4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f2006f070 0x7f8f2012d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.502+0000 7f8f27db4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f2006f980 0x7f8f2012da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.502+0000 7f8f27db4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f2006fdb0 0x7f8f2012dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.502+0000 7f8f27db4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f20131540 con 0x7f8f2006f070 2023-09-30T22:26:56.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.502+0000 7f8f27db4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f20130360 con 0x7f8f2006fdb0 2023-09-30T22:26:56.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.502+0000 7f8f27db4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2012c2d0 con 0x7f8f2006f980 2023-09-30T22:26:56.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.502+0000 7f8f25b50700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f2006f070 0x7f8f2012d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.502+0000 7f8f25b50700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f2006f070 0x7f8f2012d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36180/0 (socket says 172.21.15.40:36180) 2023-09-30T22:26:56.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.502+0000 7f8f25b50700 1 -- 172.21.15.40:0/210421657 learned_addr learned my addr 172.21.15.40:0/210421657 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:56.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.502+0000 7f8f26351700 1 --2- 172.21.15.40:0/210421657 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f2006fdb0 0x7f8f2012dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.502+0000 7f8f2534f700 1 --2- 172.21.15.40:0/210421657 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f2006f980 0x7f8f2012da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.502+0000 7f8f26351700 1 -- 172.21.15.40:0/210421657 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f2006f980 msgr2=0x7f8f2012da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.502+0000 7f8f26351700 1 --2- 172.21.15.40:0/210421657 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f2006f980 0x7f8f2012da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.502+0000 7f8f26351700 1 -- 172.21.15.40:0/210421657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f2006f070 msgr2=0x7f8f2012d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.502+0000 7f8f26351700 1 --2- 172.21.15.40:0/210421657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f2006f070 0x7f8f2012d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.502+0000 7f8f26351700 1 -- 172.21.15.40:0/210421657 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f18009a70 con 0x7f8f2006fdb0 2023-09-30T22:26:56.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.502+0000 7f8f2534f700 1 --2- 172.21.15.40:0/210421657 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f2006f980 0x7f8f2012da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:56.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.503+0000 7f8f26351700 1 --2- 172.21.15.40:0/210421657 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f2006fdb0 0x7f8f2012dfb0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8f2006bbe0 tx=0x7f8f18004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:56.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.503+0000 7f8f167fc700 1 -- 172.21.15.40:0/210421657 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f18012430 con 0x7f8f2006fdb0 2023-09-30T22:26:56.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.503+0000 7f8f167fc700 1 -- 172.21.15.40:0/210421657 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f18020070 con 0x7f8f2006fdb0 2023-09-30T22:26:56.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.503+0000 7f8f167fc700 1 -- 172.21.15.40:0/210421657 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f18012ea0 con 0x7f8f2006fdb0 2023-09-30T22:26:56.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.503+0000 7f8f27db4700 1 -- 172.21.15.40:0/210421657 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f201323f0 con 0x7f8f2006fdb0 2023-09-30T22:26:56.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.503+0000 7f8f27db4700 1 -- 172.21.15.40:0/210421657 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f20130880 con 0x7f8f2006fdb0 2023-09-30T22:26:56.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.504+0000 7f8f27db4700 1 -- 172.21.15.40:0/210421657 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f20130520 con 0x7f8f2006fdb0 2023-09-30T22:26:56.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.505+0000 7f8f167fc700 1 -- 172.21.15.40:0/210421657 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8f18004040 con 0x7f8f2006fdb0 2023-09-30T22:26:56.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.505+0000 7f8f167fc700 1 -- 172.21.15.40:0/210421657 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f8f18022070 con 0x7f8f2006fdb0 2023-09-30T22:26:56.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.509+0000 7f8f167fc700 1 -- 172.21.15.40:0/210421657 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8f180269d0 con 0x7f8f2006fdb0 2023-09-30T22:26:56.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.524+0000 7f073afc7700 1 Processor -- start 2023-09-30T22:26:56.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.525+0000 7f073afc7700 1 -- start start 2023-09-30T22:26:56.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.525+0000 7f073afc7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0734133e00 0x7f07341341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.525+0000 7f073afc7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f073409df40 0x7f073413bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.525+0000 7f073afc7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0734133940 con 0x7f073409d400 2023-09-30T22:26:56.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.525+0000 7f073afc7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f073409f0d0 con 0x7f073409df40 2023-09-30T22:26:56.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.525+0000 7f073afc7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0734133be0 con 0x7f0734133e00 2023-09-30T22:26:56.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.525+0000 7f0738d63700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0734133e00 0x7f07341341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.525+0000 7f0738d63700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0734133e00 0x7f07341341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:36170/0 (socket says 172.21.15.40:36170) 2023-09-30T22:26:56.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.525+0000 7f0738d63700 1 -- 172.21.15.40:0/3393910083 learned_addr learned my addr 172.21.15.40:0/3393910083 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:56.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.525+0000 7f0739564700 1 --2- 172.21.15.40:0/3393910083 >> v2:172.21.15.40:3300/0 conn(0x7f073409df40 0x7f073413bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.526+0000 7f0738d63700 1 -- 172.21.15.40:0/3393910083 >> v2:172.21.15.40:3300/0 conn(0x7f073409df40 msgr2=0x7f073413bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:56.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.526+0000 7f0738d63700 1 --2- 172.21.15.40:0/3393910083 >> v2:172.21.15.40:3300/0 conn(0x7f073409df40 0x7f073413bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.526+0000 7f0738d63700 1 -- 172.21.15.40:0/3393910083 >> v1:172.21.15.40:6789/0 conn(0x7f073409d400 legacy=0x7f073409d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.526+0000 7f0738d63700 1 -- 172.21.15.40:0/3393910083 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073409a860 con 0x7f0734133e00 2023-09-30T22:26:56.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.526+0000 7f0738d63700 1 --2- 172.21.15.40:0/3393910083 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0734133e00 0x7f07341341d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f07280098f0 tx=0x7f0728009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efc1729acb9439df server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:56.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.526+0000 7f07337fe700 1 -- 172.21.15.40:0/3393910083 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0728011830 con 0x7f0734133e00 2023-09-30T22:26:56.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.526+0000 7f07337fe700 1 -- 172.21.15.40:0/3393910083 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0728011990 con 0x7f0734133e00 2023-09-30T22:26:56.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.526+0000 7f07337fe700 1 -- 172.21.15.40:0/3393910083 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0728011d20 con 0x7f0734133e00 2023-09-30T22:26:56.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.527+0000 7f073afc7700 1 -- 172.21.15.40:0/3393910083 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0734133e00 msgr2=0x7f07341341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.527+0000 7f073afc7700 1 --2- 172.21.15.40:0/3393910083 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0734133e00 0x7f07341341d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f07280098f0 tx=0x7f0728009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:56.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.527+0000 7f073afc7700 1 -- 172.21.15.40:0/3393910083 shutdown_connections 2023-09-30T22:26:56.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.527+0000 7f073afc7700 1 --2- 172.21.15.40:0/3393910083 >> v2:172.21.15.40:3300/0 conn(0x7f073409df40 0x7f073413bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.527+0000 7f073afc7700 1 --2- 172.21.15.40:0/3393910083 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0734133e00 0x7f07341341d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.527+0000 7f073afc7700 1 -- 172.21.15.40:0/3393910083 >> 172.21.15.40:0/3393910083 conn(0x7f07340a2a00 msgr2=0x7f07340a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:56.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.527+0000 7f073afc7700 1 -- 172.21.15.40:0/3393910083 shutdown_connections 2023-09-30T22:26:56.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.527+0000 7f073afc7700 1 -- 172.21.15.40:0/3393910083 wait complete. 2023-09-30T22:26:56.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.528+0000 7f073afc7700 1 Processor -- start 2023-09-30T22:26:56.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.528+0000 7f073afc7700 1 -- start start 2023-09-30T22:26:56.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.528+0000 7f073afc7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f073409d400 0x7f073411bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.528+0000 7f073afc7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f073409df40 0x7f073411c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.528+0000 7f073afc7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0734133e00 0x7f073411c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.528+0000 7f073afc7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073412e1a0 con 0x7f0734133e00 2023-09-30T22:26:56.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.528+0000 7f073afc7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073411f5b0 con 0x7f073409d400 2023-09-30T22:26:56.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.528+0000 7f073afc7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07340a0100 con 0x7f073409df40 2023-09-30T22:26:56.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.529+0000 7f0738d63700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f073409d400 0x7f073411bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.529+0000 7f0738d63700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f073409d400 0x7f073411bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:36172/0 (socket says 172.21.15.40:36172) 2023-09-30T22:26:56.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.529+0000 7f0738d63700 1 -- 172.21.15.40:0/927943004 learned_addr learned my addr 172.21.15.40:0/927943004 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:56.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.529+0000 7f0733fff700 1 --2- 172.21.15.40:0/927943004 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f073409df40 0x7f073411c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.529+0000 7f0739564700 1 --2- 172.21.15.40:0/927943004 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0734133e00 0x7f073411c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.529+0000 7f0738d63700 1 -- 172.21.15.40:0/927943004 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f073409df40 msgr2=0x7f073411c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.529+0000 7f0738d63700 1 --2- 172.21.15.40:0/927943004 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f073409df40 0x7f073411c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.529+0000 7f0738d63700 1 -- 172.21.15.40:0/927943004 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0734133e00 msgr2=0x7f073411c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.529+0000 7f0738d63700 1 --2- 172.21.15.40:0/927943004 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0734133e00 0x7f073411c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.529+0000 7f0738d63700 1 -- 172.21.15.40:0/927943004 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0728009550 con 0x7f073409d400 2023-09-30T22:26:56.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.529+0000 7f0738d63700 1 --2- 172.21.15.40:0/927943004 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f073409d400 0x7f073411bd70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0728009c40 tx=0x7f0728004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:56.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.529+0000 7f07317fa700 1 -- 172.21.15.40:0/927943004 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07280036a0 con 0x7f073409d400 2023-09-30T22:26:56.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.529+0000 7f073afc7700 1 -- 172.21.15.40:0/927943004 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f073411e1e0 con 0x7f073409d400 2023-09-30T22:26:56.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.529+0000 7f073afc7700 1 -- 172.21.15.40:0/927943004 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0734120020 con 0x7f073409d400 2023-09-30T22:26:56.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.529+0000 7f07317fa700 1 -- 172.21.15.40:0/927943004 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0728003800 con 0x7f073409d400 2023-09-30T22:26:56.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.529+0000 7f07317fa700 1 -- 172.21.15.40:0/927943004 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0728003b70 con 0x7f073409d400 2023-09-30T22:26:56.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.530+0000 7f07317fa700 1 -- 172.21.15.40:0/927943004 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0728021070 con 0x7f073409d400 2023-09-30T22:26:56.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.531+0000 7f073afc7700 1 -- 172.21.15.40:0/927943004 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07140052e0 con 0x7f073409d400 2023-09-30T22:26:56.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.531+0000 7f07317fa700 1 -- 172.21.15.40:0/927943004 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f0728040c00 con 0x7f073409d400 2023-09-30T22:26:56.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.539+0000 7f07317fa700 1 -- 172.21.15.40:0/927943004 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0728015070 con 0x7f073409d400 2023-09-30T22:26:56.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.576+0000 7f20cdb05700 1 Processor -- start 2023-09-30T22:26:56.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.577+0000 7f20cdb05700 1 -- start start 2023-09-30T22:26:56.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.577+0000 7f20cdb05700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f20c809d920 0x7f20c809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.577+0000 7f20cdb05700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20c8130fb0 0x7f20c8138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.577+0000 7f20cdb05700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20c809adf0 con 0x7f20c809e230 2023-09-30T22:26:56.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.577+0000 7f20cdb05700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20c809edf0 con 0x7f20c809d920 2023-09-30T22:26:56.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.577+0000 7f20cdb05700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20c809b660 con 0x7f20c8130fb0 2023-09-30T22:26:56.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.578+0000 7f20c77fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f20c809d920 0x7f20c809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.578+0000 7f20c7fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20c8130fb0 0x7f20c8138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.578+0000 7f20c77fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f20c809d920 0x7f20c809dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36208/0 (socket says 172.21.15.40:36208) 2023-09-30T22:26:56.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.578+0000 7f20c7fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20c8130fb0 0x7f20c8138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51892/0 (socket says 172.21.15.40:51892) 2023-09-30T22:26:56.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.578+0000 7f20c77fe700 1 -- 172.21.15.40:0/2376572618 learned_addr learned my addr 172.21.15.40:0/2376572618 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:56.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.578+0000 7f20c77fe700 1 -- 172.21.15.40:0/2376572618 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20c8130fb0 msgr2=0x7f20c8138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:56.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.578+0000 7f20c77fe700 1 --2- 172.21.15.40:0/2376572618 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20c8130fb0 0x7f20c8138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.578+0000 7f20c77fe700 1 -- 172.21.15.40:0/2376572618 >> v1:172.21.15.40:6789/0 conn(0x7f20c809e230 legacy=0x7f20c81308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.578+0000 7f20c77fe700 1 -- 172.21.15.40:0/2376572618 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c809a6e0 con 0x7f20c809d920 2023-09-30T22:26:56.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.578+0000 7f20c77fe700 1 --2- 172.21.15.40:0/2376572618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c809d920 0x7f20c809dcf0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f20b8006fd0 tx=0x7f20b800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b26916dc5916356f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:56.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.578+0000 7f20c67fc700 1 -- 172.21.15.40:0/2376572618 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b8005e30 con 0x7f20c809d920 2023-09-30T22:26:56.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.578+0000 7f20c67fc700 1 -- 172.21.15.40:0/2376572618 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b8004030 con 0x7f20c809d920 2023-09-30T22:26:56.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.578+0000 7f20c67fc700 1 -- 172.21.15.40:0/2376572618 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b80043e0 con 0x7f20c809d920 2023-09-30T22:26:56.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.579+0000 7f20cdb05700 1 -- 172.21.15.40:0/2376572618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c809d920 msgr2=0x7f20c809dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.579+0000 7f20cdb05700 1 --2- 172.21.15.40:0/2376572618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c809d920 0x7f20c809dcf0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f20b8006fd0 tx=0x7f20b800be70 comp rx=0 tx=0).stop 2023-09-30T22:26:56.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.579+0000 7f20cdb05700 1 -- 172.21.15.40:0/2376572618 shutdown_connections 2023-09-30T22:26:56.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.579+0000 7f20cdb05700 1 --2- 172.21.15.40:0/2376572618 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20c8130fb0 0x7f20c8138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.579+0000 7f20cdb05700 1 --2- 172.21.15.40:0/2376572618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c809d920 0x7f20c809dcf0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.579+0000 7f20cdb05700 1 -- 172.21.15.40:0/2376572618 >> 172.21.15.40:0/2376572618 conn(0x7f20c809fb20 msgr2=0x7f20c809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:56.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.579+0000 7f20cdb05700 1 -- 172.21.15.40:0/2376572618 shutdown_connections 2023-09-30T22:26:56.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.579+0000 7f20cdb05700 1 -- 172.21.15.40:0/2376572618 wait complete. 2023-09-30T22:26:56.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.581+0000 7f20cdb05700 1 Processor -- start 2023-09-30T22:26:56.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.581+0000 7f20cdb05700 1 -- start start 2023-09-30T22:26:56.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.582+0000 7f20cdb05700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20c809d920 0x7f20c811c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.582+0000 7f20cdb05700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20c809e230 0x7f20c811c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.582+0000 7f20cdb05700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c8130fb0 0x7f20c811cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.582+0000 7f20cdb05700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c811f890 con 0x7f20c8130fb0 2023-09-30T22:26:56.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.582+0000 7f20cdb05700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c809cb00 con 0x7f20c809e230 2023-09-30T22:26:56.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.582+0000 7f20cdb05700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20c811dd70 con 0x7f20c809d920 2023-09-30T22:26:56.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.582+0000 7f20c6ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20c809e230 0x7f20c811c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.582+0000 7f20c77fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20c809d920 0x7f20c811c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.582+0000 7f20c6ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20c809e230 0x7f20c811c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:36184/0 (socket says 172.21.15.40:36184) 2023-09-30T22:26:56.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.582+0000 7f20c6ffd700 1 -- 172.21.15.40:0/1024280252 learned_addr learned my addr 172.21.15.40:0/1024280252 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:56.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.582+0000 7f20c7fff700 1 --2- 172.21.15.40:0/1024280252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c8130fb0 0x7f20c811cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.582+0000 7f20c77fe700 1 -- 172.21.15.40:0/1024280252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20c809e230 msgr2=0x7f20c811c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.582+0000 7f20c77fe700 1 --2- 172.21.15.40:0/1024280252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20c809e230 0x7f20c811c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.582+0000 7f20c77fe700 1 -- 172.21.15.40:0/1024280252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c8130fb0 msgr2=0x7f20c811cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.582+0000 7f20c77fe700 1 --2- 172.21.15.40:0/1024280252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c8130fb0 0x7f20c811cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.582+0000 7f20c77fe700 1 -- 172.21.15.40:0/1024280252 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b800b7a0 con 0x7f20c809d920 2023-09-30T22:26:56.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.583+0000 7f20c77fe700 1 --2- 172.21.15.40:0/1024280252 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20c809d920 0x7f20c811c0a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f20b8016000 tx=0x7f20b8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:56.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.583+0000 7f20affff700 1 -- 172.21.15.40:0/1024280252 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b801e070 con 0x7f20c809d920 2023-09-30T22:26:56.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.583+0000 7f20affff700 1 -- 172.21.15.40:0/1024280252 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b80038b0 con 0x7f20c809d920 2023-09-30T22:26:56.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.583+0000 7f20cdb05700 1 -- 172.21.15.40:0/1024280252 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20c8071390 con 0x7f20c809d920 2023-09-30T22:26:56.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.583+0000 7f20affff700 1 -- 172.21.15.40:0/1024280252 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b8003ca0 con 0x7f20c809d920 2023-09-30T22:26:56.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.583+0000 7f20cdb05700 1 -- 172.21.15.40:0/1024280252 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20c811fb70 con 0x7f20c809d920 2023-09-30T22:26:56.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.584+0000 7f20affff700 1 -- 172.21.15.40:0/1024280252 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f20b8010470 con 0x7f20c809d920 2023-09-30T22:26:56.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.584+0000 7f20cdb05700 1 -- 172.21.15.40:0/1024280252 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20c8062380 con 0x7f20c809d920 2023-09-30T22:26:56.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.584+0000 7f20affff700 1 -- 172.21.15.40:0/1024280252 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f20b80444b0 con 0x7f20c809d920 2023-09-30T22:26:56.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.593+0000 7f20affff700 1 -- 172.21.15.40:0/1024280252 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f20b8003e00 con 0x7f20c809d920 2023-09-30T22:26:56.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.695+0000 7fb0536e6700 1 -- 172.21.15.40:0/641109848 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb04c062380 con 0x7fb04c09df70 2023-09-30T22:26:56.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.695+0000 7fb041ffb700 1 -- 172.21.15.40:0/641109848 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb03c017070 con 0x7fb04c09df70 2023-09-30T22:26:56.696 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:56.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.698+0000 7fb0536e6700 1 -- 172.21.15.40:0/641109848 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb04c09df70 msgr2=0x7fb04c129ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.698+0000 7fb0536e6700 1 --2- 172.21.15.40:0/641109848 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb04c09df70 0x7fb04c129ae0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00c520 tx=0x7fb03c00c830 comp rx=0 tx=0).stop 2023-09-30T22:26:56.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.699+0000 7fb0536e6700 1 -- 172.21.15.40:0/641109848 shutdown_connections 2023-09-30T22:26:56.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.699+0000 7fb0536e6700 1 --2- 172.21.15.40:0/641109848 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb04c09d400 0x7fb04c1295a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.699+0000 7fb0536e6700 1 --2- 172.21.15.40:0/641109848 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb04c133e00 0x7fb04c06d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.699+0000 7fb0536e6700 1 --2- 172.21.15.40:0/641109848 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb04c09df70 0x7fb04c129ae0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.699+0000 7fb0536e6700 1 -- 172.21.15.40:0/641109848 >> 172.21.15.40:0/641109848 conn(0x7fb04c0a2a00 msgr2=0x7fb04c12d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:56.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.699+0000 7fb0536e6700 1 -- 172.21.15.40:0/641109848 shutdown_connections 2023-09-30T22:26:56.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.699+0000 7fb0536e6700 1 -- 172.21.15.40:0/641109848 wait complete. 2023-09-30T22:26:56.717 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:56.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.737+0000 7f8f27db4700 1 -- 172.21.15.40:0/210421657 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8f20062380 con 0x7f8f2006fdb0 2023-09-30T22:26:56.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.737+0000 7f073afc7700 1 -- 172.21.15.40:0/927943004 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0714005150 con 0x7f073409d400 2023-09-30T22:26:56.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.737+0000 7f8f167fc700 1 -- 172.21.15.40:0/210421657 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8f18011390 con 0x7f8f2006fdb0 2023-09-30T22:26:56.740 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:56.740 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:56.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.738+0000 7f07317fa700 1 -- 172.21.15.40:0/927943004 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f072801b950 con 0x7f073409d400 2023-09-30T22:26:56.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.739+0000 7f8f27db4700 1 -- 172.21.15.40:0/210421657 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f2006fdb0 msgr2=0x7f8f2012dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.739+0000 7f8f27db4700 1 --2- 172.21.15.40:0/210421657 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f2006fdb0 0x7f8f2012dfb0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8f2006bbe0 tx=0x7f8f18004ad0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.740+0000 7f8f27db4700 1 -- 172.21.15.40:0/210421657 shutdown_connections 2023-09-30T22:26:56.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.740+0000 7f8f27db4700 1 --2- 172.21.15.40:0/210421657 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f2006fdb0 0x7f8f2012dfb0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.740+0000 7f8f27db4700 1 --2- 172.21.15.40:0/210421657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f2006f070 0x7f8f2012d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.740+0000 7f8f27db4700 1 --2- 172.21.15.40:0/210421657 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f2006f980 0x7f8f2012da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.740+0000 7f8f27db4700 1 -- 172.21.15.40:0/210421657 >> 172.21.15.40:0/210421657 conn(0x7f8f200a41a0 msgr2=0x7f8f2012ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:56.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.740+0000 7f8f27db4700 1 -- 172.21.15.40:0/210421657 shutdown_connections 2023-09-30T22:26:56.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.740+0000 7f8f27db4700 1 -- 172.21.15.40:0/210421657 wait complete. 2023-09-30T22:26:56.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.741+0000 7f073afc7700 1 -- 172.21.15.40:0/927943004 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f073409d400 msgr2=0x7f073411bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.741+0000 7f073afc7700 1 --2- 172.21.15.40:0/927943004 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f073409d400 0x7f073411bd70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0728009c40 tx=0x7f0728004750 comp rx=0 tx=0).stop 2023-09-30T22:26:56.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.741+0000 7f073afc7700 1 -- 172.21.15.40:0/927943004 shutdown_connections 2023-09-30T22:26:56.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.741+0000 7f073afc7700 1 --2- 172.21.15.40:0/927943004 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0734133e00 0x7f073411c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.741+0000 7f073afc7700 1 --2- 172.21.15.40:0/927943004 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f073409d400 0x7f073411bd70 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.741+0000 7f073afc7700 1 --2- 172.21.15.40:0/927943004 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f073409df40 0x7f073411c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.741+0000 7f073afc7700 1 -- 172.21.15.40:0/927943004 >> 172.21.15.40:0/927943004 conn(0x7f07340a2a00 msgr2=0x7f0734131840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:56.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.741+0000 7f073afc7700 1 -- 172.21.15.40:0/927943004 shutdown_connections 2023-09-30T22:26:56.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.741+0000 7f073afc7700 1 -- 172.21.15.40:0/927943004 wait complete. 2023-09-30T22:26:56.755 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:56.761 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:56.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.800+0000 7f20cdb05700 1 -- 172.21.15.40:0/1024280252 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f20c8074720 con 0x7f20c809d920 2023-09-30T22:26:56.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.800+0000 7f20affff700 1 -- 172.21.15.40:0/1024280252 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f20b800f3d0 con 0x7f20c809d920 2023-09-30T22:26:56.802 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:56.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.803+0000 7f20cdb05700 1 -- 172.21.15.40:0/1024280252 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20c809d920 msgr2=0x7f20c811c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.803+0000 7f20cdb05700 1 --2- 172.21.15.40:0/1024280252 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20c809d920 0x7f20c811c0a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f20b8016000 tx=0x7f20b8004750 comp rx=0 tx=0).stop 2023-09-30T22:26:56.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.803+0000 7f20cdb05700 1 -- 172.21.15.40:0/1024280252 shutdown_connections 2023-09-30T22:26:56.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.803+0000 7f20cdb05700 1 --2- 172.21.15.40:0/1024280252 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20c809d920 0x7f20c811c0a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.803+0000 7f20cdb05700 1 --2- 172.21.15.40:0/1024280252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c8130fb0 0x7f20c811cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.803+0000 7f20cdb05700 1 --2- 172.21.15.40:0/1024280252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20c809e230 0x7f20c811c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.803+0000 7f20cdb05700 1 -- 172.21.15.40:0/1024280252 >> 172.21.15.40:0/1024280252 conn(0x7f20c809fb20 msgr2=0x7f20c8130210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:56.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.803+0000 7f20cdb05700 1 -- 172.21.15.40:0/1024280252 shutdown_connections 2023-09-30T22:26:56.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:56.803+0000 7f20cdb05700 1 -- 172.21.15.40:0/1024280252 wait complete. 2023-09-30T22:26:56.816 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:57.717 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:57.755 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:57.761 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:57.817 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:57.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.866+0000 7f92dc91c700 1 Processor -- start 2023-09-30T22:26:57.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.867+0000 7f92dc91c700 1 -- start start 2023-09-30T22:26:57.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.867+0000 7f92dc91c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f92d812e590 0x7f92d812e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.868+0000 7f92dc91c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f92d812d8a0 0x7f92d8138c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.868+0000 7f92dc91c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d809ab70 con 0x7f92d812eea0 2023-09-30T22:26:57.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.868+0000 7f92dc91c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92d809b270 con 0x7f92d812d8a0 2023-09-30T22:26:57.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.868+0000 7f92dc91c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92d809bab0 con 0x7f92d812e590 2023-09-30T22:26:57.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.868+0000 7f92d659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f92d812e590 0x7f92d812e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.868+0000 7f92d659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f92d812e590 0x7f92d812e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51898/0 (socket says 172.21.15.40:51898) 2023-09-30T22:26:57.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.868+0000 7f92d659c700 1 -- 172.21.15.40:0/1303817089 learned_addr learned my addr 172.21.15.40:0/1303817089 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:57.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.868+0000 7f92d6d9d700 1 --2- 172.21.15.40:0/1303817089 >> v2:172.21.15.40:3300/0 conn(0x7f92d812d8a0 0x7f92d8138c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.868+0000 7f92d659c700 1 -- 172.21.15.40:0/1303817089 >> v2:172.21.15.40:3300/0 conn(0x7f92d812d8a0 msgr2=0x7f92d8138c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:57.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.868+0000 7f92d659c700 1 --2- 172.21.15.40:0/1303817089 >> v2:172.21.15.40:3300/0 conn(0x7f92d812d8a0 0x7f92d8138c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.868+0000 7f92d659c700 1 -- 172.21.15.40:0/1303817089 >> v1:172.21.15.40:6789/0 conn(0x7f92d812eea0 legacy=0x7f92d812d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:57.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.868+0000 7f92d659c700 1 -- 172.21.15.40:0/1303817089 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d809bd70 con 0x7f92d812e590 2023-09-30T22:26:57.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.869+0000 7f92d659c700 1 --2- 172.21.15.40:0/1303817089 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f92d812e590 0x7f92d812e960 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f92c8009920 tx=0x7f92c8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2d80feb429de7cf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:57.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.869+0000 7f92d559a700 1 -- 172.21.15.40:0/1303817089 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c8011830 con 0x7f92d812e590 2023-09-30T22:26:57.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.869+0000 7f92d559a700 1 -- 172.21.15.40:0/1303817089 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c8011990 con 0x7f92d812e590 2023-09-30T22:26:57.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.869+0000 7f92d559a700 1 -- 172.21.15.40:0/1303817089 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c8011d20 con 0x7f92d812e590 2023-09-30T22:26:57.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.869+0000 7f92dc91c700 1 -- 172.21.15.40:0/1303817089 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f92d812e590 msgr2=0x7f92d812e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.869+0000 7f92dc91c700 1 --2- 172.21.15.40:0/1303817089 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f92d812e590 0x7f92d812e960 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f92c8009920 tx=0x7f92c8009c30 comp rx=0 tx=0).stop 2023-09-30T22:26:57.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.870+0000 7f92dc91c700 1 -- 172.21.15.40:0/1303817089 shutdown_connections 2023-09-30T22:26:57.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.870+0000 7f92dc91c700 1 --2- 172.21.15.40:0/1303817089 >> v2:172.21.15.40:3300/0 conn(0x7f92d812d8a0 0x7f92d8138c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.870+0000 7f92dc91c700 1 --2- 172.21.15.40:0/1303817089 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f92d812e590 0x7f92d812e960 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.870+0000 7f92dc91c700 1 -- 172.21.15.40:0/1303817089 >> 172.21.15.40:0/1303817089 conn(0x7f92d80a2a00 msgr2=0x7f92d80a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:57.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.870+0000 7f92dc91c700 1 -- 172.21.15.40:0/1303817089 shutdown_connections 2023-09-30T22:26:57.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.870+0000 7f92dc91c700 1 -- 172.21.15.40:0/1303817089 wait complete. 2023-09-30T22:26:57.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.871+0000 7f92dc91c700 1 Processor -- start 2023-09-30T22:26:57.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.871+0000 7f92dc91c700 1 -- start start 2023-09-30T22:26:57.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.871+0000 7f92dc91c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d812d8a0 0x7f92d813add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.871+0000 7f92dc91c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92d812e590 0x7f92d8132f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.871+0000 7f92dc91c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f92d812eea0 0x7f92d81334c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.871+0000 7f92dc91c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d81343e0 con 0x7f92d812d8a0 2023-09-30T22:26:57.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.871+0000 7f92dc91c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d8134b50 con 0x7f92d812e590 2023-09-30T22:26:57.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.871+0000 7f92dc91c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92d81353e0 con 0x7f92d812eea0 2023-09-30T22:26:57.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.871+0000 7f92d5d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92d812e590 0x7f92d8132f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.871+0000 7f92d659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d812d8a0 0x7f92d813add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.871+0000 7f92d5d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92d812e590 0x7f92d8132f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:36198/0 (socket says 172.21.15.40:36198) 2023-09-30T22:26:57.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.871+0000 7f92d5d9b700 1 -- 172.21.15.40:0/131387552 learned_addr learned my addr 172.21.15.40:0/131387552 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:57.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.872+0000 7f92d6d9d700 1 --2- 172.21.15.40:0/131387552 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f92d812eea0 0x7f92d81334c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.872+0000 7f92d5d9b700 1 -- 172.21.15.40:0/131387552 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f92d812eea0 msgr2=0x7f92d81334c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.872+0000 7f92d5d9b700 1 --2- 172.21.15.40:0/131387552 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f92d812eea0 0x7f92d81334c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.872+0000 7f92d5d9b700 1 -- 172.21.15.40:0/131387552 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d812d8a0 msgr2=0x7f92d813add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.872+0000 7f92d5d9b700 1 --2- 172.21.15.40:0/131387552 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d812d8a0 0x7f92d813add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.872+0000 7f92d5d9b700 1 -- 172.21.15.40:0/131387552 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c8009550 con 0x7f92d812e590 2023-09-30T22:26:57.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.872+0000 7f92d5d9b700 1 --2- 172.21.15.40:0/131387552 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92d812e590 0x7f92d8132f80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f92cc00c4b0 tx=0x7f92cc00c7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:57.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.872+0000 7f92c6ffd700 1 -- 172.21.15.40:0/131387552 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92cc0052d0 con 0x7f92d812e590 2023-09-30T22:26:57.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.872+0000 7f92c6ffd700 1 -- 172.21.15.40:0/131387552 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92cc005430 con 0x7f92d812e590 2023-09-30T22:26:57.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.872+0000 7f92dc91c700 1 -- 172.21.15.40:0/131387552 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92d8136780 con 0x7f92d812e590 2023-09-30T22:26:57.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.872+0000 7f92c6ffd700 1 -- 172.21.15.40:0/131387552 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92cc0038c0 con 0x7f92d812e590 2023-09-30T22:26:57.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.873+0000 7f92dc91c700 1 -- 172.21.15.40:0/131387552 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d8135da0 con 0x7f92d812e590 2023-09-30T22:26:57.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.874+0000 7f92dc91c700 1 -- 172.21.15.40:0/131387552 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92d8062380 con 0x7f92d812e590 2023-09-30T22:26:57.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.874+0000 7f92c6ffd700 1 -- 172.21.15.40:0/131387552 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f92cc003a20 con 0x7f92d812e590 2023-09-30T22:26:57.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.875+0000 7f92c6ffd700 1 -- 172.21.15.40:0/131387552 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f92cc03ee60 con 0x7f92d812e590 2023-09-30T22:26:57.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.883+0000 7f92c6ffd700 1 -- 172.21.15.40:0/131387552 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f92cc003cd0 con 0x7f92d812e590 2023-09-30T22:26:57.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.905+0000 7f70f81ae700 1 Processor -- start 2023-09-30T22:26:57.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.905+0000 7f70f81ae700 1 -- start start 2023-09-30T22:26:57.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.905+0000 7f70f81ae700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f70f009d450 0x7f70f009d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.905+0000 7f70f81ae700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f70f01308d0 0x7f70f0138420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.905+0000 7f70f81ae700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f009e8b0 con 0x7f70f009dd60 2023-09-30T22:26:57.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.905+0000 7f70f81ae700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f009c3b0 con 0x7f70f009d450 2023-09-30T22:26:57.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.905+0000 7f70f81ae700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70f009a6b0 con 0x7f70f01308d0 2023-09-30T22:26:57.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.906+0000 7f70f674b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f70f01308d0 0x7f70f0138420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.906+0000 7f70f5f4a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f70f009d450 0x7f70f009d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.906+0000 7f70f674b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f70f01308d0 0x7f70f0138420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51902/0 (socket says 172.21.15.40:51902) 2023-09-30T22:26:57.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.906+0000 7f70f5f4a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f70f009d450 0x7f70f009d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36242/0 (socket says 172.21.15.40:36242) 2023-09-30T22:26:57.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.906+0000 7f70f674b700 1 -- 172.21.15.40:0/3541490021 learned_addr learned my addr 172.21.15.40:0/3541490021 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:57.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.906+0000 7f70f674b700 1 -- 172.21.15.40:0/3541490021 >> v2:172.21.15.40:3300/0 conn(0x7f70f009d450 msgr2=0x7f70f009d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:57.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.906+0000 7f70f674b700 1 --2- 172.21.15.40:0/3541490021 >> v2:172.21.15.40:3300/0 conn(0x7f70f009d450 0x7f70f009d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.906+0000 7f70f674b700 1 -- 172.21.15.40:0/3541490021 >> v1:172.21.15.40:6789/0 conn(0x7f70f009dd60 legacy=0x7f70f01301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.906+0000 7f70f674b700 1 -- 172.21.15.40:0/3541490021 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f009b4f0 con 0x7f70f01308d0 2023-09-30T22:26:57.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.906+0000 7f70f674b700 1 --2- 172.21.15.40:0/3541490021 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f70f01308d0 0x7f70f0138420 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f70e8010370 tx=0x7f70e8010680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3e3adee41d4bc47 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:57.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.906+0000 7f70f4f48700 1 -- 172.21.15.40:0/3541490021 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e8013070 con 0x7f70f01308d0 2023-09-30T22:26:57.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.906+0000 7f70f4f48700 1 -- 172.21.15.40:0/3541490021 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e8010e70 con 0x7f70f01308d0 2023-09-30T22:26:57.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.906+0000 7f70f4f48700 1 -- 172.21.15.40:0/3541490021 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e8017630 con 0x7f70f01308d0 2023-09-30T22:26:57.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.907+0000 7f70f81ae700 1 -- 172.21.15.40:0/3541490021 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f70f01308d0 msgr2=0x7f70f0138420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.907+0000 7f70f81ae700 1 --2- 172.21.15.40:0/3541490021 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f70f01308d0 0x7f70f0138420 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f70e8010370 tx=0x7f70e8010680 comp rx=0 tx=0).stop 2023-09-30T22:26:57.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.907+0000 7f70f81ae700 1 -- 172.21.15.40:0/3541490021 shutdown_connections 2023-09-30T22:26:57.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.907+0000 7f70f81ae700 1 --2- 172.21.15.40:0/3541490021 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f70f01308d0 0x7f70f0138420 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.907+0000 7f70f81ae700 1 --2- 172.21.15.40:0/3541490021 >> v2:172.21.15.40:3300/0 conn(0x7f70f009d450 0x7f70f009d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.907+0000 7f70f81ae700 1 -- 172.21.15.40:0/3541490021 >> 172.21.15.40:0/3541490021 conn(0x7f70f00a2a00 msgr2=0x7f70f00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:57.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.907+0000 7f70f81ae700 1 -- 172.21.15.40:0/3541490021 shutdown_connections 2023-09-30T22:26:57.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.907+0000 7f70f81ae700 1 -- 172.21.15.40:0/3541490021 wait complete. 2023-09-30T22:26:57.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.908+0000 7f70f81ae700 1 Processor -- start 2023-09-30T22:26:57.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.908+0000 7f70f81ae700 1 -- start start 2023-09-30T22:26:57.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.909+0000 7f70f81ae700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70f009d450 0x7f70f01c4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.909+0000 7f70f81ae700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f70f009dd60 0x7f70f01c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.909+0000 7f70f81ae700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f70f01308d0 0x7f70f01c4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.909+0000 7f70f81ae700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f011c310 con 0x7f70f009d450 2023-09-30T22:26:57.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.909+0000 7f70f81ae700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f00a24b0 con 0x7f70f01308d0 2023-09-30T22:26:57.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.909+0000 7f70f81ae700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70f011be70 con 0x7f70f009dd60 2023-09-30T22:26:57.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.909+0000 7f70f5749700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f70f009dd60 0x7f70f01c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.909+0000 7f70f5f4a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70f009d450 0x7f70f01c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.909+0000 7f70f5749700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f70f009dd60 0x7f70f01c45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51914/0 (socket says 172.21.15.40:51914) 2023-09-30T22:26:57.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.909+0000 7f70f5749700 1 -- 172.21.15.40:0/1695922562 learned_addr learned my addr 172.21.15.40:0/1695922562 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:57.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.909+0000 7f70f674b700 1 --2- 172.21.15.40:0/1695922562 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f70f01308d0 0x7f70f01c4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.909+0000 7f70f5f4a700 1 -- 172.21.15.40:0/1695922562 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f70f009dd60 msgr2=0x7f70f01c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.909+0000 7f70f5f4a700 1 --2- 172.21.15.40:0/1695922562 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f70f009dd60 0x7f70f01c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.909+0000 7f70f5f4a700 1 -- 172.21.15.40:0/1695922562 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f70f01308d0 msgr2=0x7f70f01c4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.909+0000 7f70f5f4a700 1 --2- 172.21.15.40:0/1695922562 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f70f01308d0 0x7f70f01c4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.909+0000 7f70f5f4a700 1 -- 172.21.15.40:0/1695922562 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e8010050 con 0x7f70f009d450 2023-09-30T22:26:57.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.909+0000 7f70f5749700 1 --2- 172.21.15.40:0/1695922562 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f70f009dd60 0x7f70f01c45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:57.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.910+0000 7f70f5f4a700 1 --2- 172.21.15.40:0/1695922562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70f009d450 0x7f70f01c4070 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00e900 tx=0x7f70ec00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:57.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.910+0000 7f70e67fc700 1 -- 172.21.15.40:0/1695922562 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec013680 con 0x7f70f009d450 2023-09-30T22:26:57.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.910+0000 7f70e67fc700 1 -- 172.21.15.40:0/1695922562 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ec0137e0 con 0x7f70f009d450 2023-09-30T22:26:57.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.910+0000 7f70f81ae700 1 -- 172.21.15.40:0/1695922562 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f011c550 con 0x7f70f009d450 2023-09-30T22:26:57.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.910+0000 7f70f81ae700 1 -- 172.21.15.40:0/1695922562 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f011dc70 con 0x7f70f009d450 2023-09-30T22:26:57.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.910+0000 7f70e67fc700 1 -- 172.21.15.40:0/1695922562 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec013b50 con 0x7f70f009d450 2023-09-30T22:26:57.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.910+0000 7fa2f283c700 1 Processor -- start 2023-09-30T22:26:57.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.911+0000 7f70e67fc700 1 -- 172.21.15.40:0/1695922562 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f70ec013cb0 con 0x7f70f009d450 2023-09-30T22:26:57.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.911+0000 7f70e67fc700 1 -- 172.21.15.40:0/1695922562 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f70ec03f9e0 con 0x7f70f009d450 2023-09-30T22:26:57.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.911+0000 7fa2f283c700 1 -- start start 2023-09-30T22:26:57.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.911+0000 7fa2f283c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa2ec09c890 0x7fa2ec09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.911+0000 7fa2f283c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa2ec09d920 0x7fa2ec09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.911+0000 7fa2f283c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2ec0a2600 con 0x7fa2ec09e2b0 2023-09-30T22:26:57.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.911+0000 7fa2f283c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec0a29d0 con 0x7fa2ec09c890 2023-09-30T22:26:57.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.911+0000 7fa2f283c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec09fb40 con 0x7fa2ec09d920 2023-09-30T22:26:57.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.911+0000 7fa2ebfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa2ec09c890 0x7fa2ec09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.912+0000 7fa2ebfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa2ec09c890 0x7fa2ec09cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:36222/0 (socket says 172.21.15.40:36222) 2023-09-30T22:26:57.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.912+0000 7fa2ebfff700 1 -- 172.21.15.40:0/720882921 learned_addr learned my addr 172.21.15.40:0/720882921 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:57.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.912+0000 7f70f81ae700 1 -- 172.21.15.40:0/1695922562 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d80052e0 con 0x7f70f009d450 2023-09-30T22:26:57.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.912+0000 7fa2eb7fe700 1 --2- 172.21.15.40:0/720882921 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa2ec09d920 0x7fa2ec09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.912+0000 7fa2ebfff700 1 -- 172.21.15.40:0/720882921 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa2ec09d920 msgr2=0x7fa2ec09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:57.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.912+0000 7fa2ebfff700 1 --2- 172.21.15.40:0/720882921 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa2ec09d920 0x7fa2ec09dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.912+0000 7fa2ebfff700 1 -- 172.21.15.40:0/720882921 >> v1:172.21.15.40:6789/0 conn(0x7fa2ec09e2b0 legacy=0x7fa2ec13ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.912+0000 7fa2ebfff700 1 -- 172.21.15.40:0/720882921 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ec09e720 con 0x7fa2ec09c890 2023-09-30T22:26:57.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.912+0000 7fa2eb7fe700 1 --2- 172.21.15.40:0/720882921 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa2ec09d920 0x7fa2ec09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:57.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.912+0000 7fa2ebfff700 1 --2- 172.21.15.40:0/720882921 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa2ec09c890 0x7fa2ec09cc60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4009ed0 tx=0x7fa2e400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc6fd0212fd72342 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:57.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.912+0000 7fa2eaffd700 1 -- 172.21.15.40:0/720882921 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e400e070 con 0x7fa2ec09c890 2023-09-30T22:26:57.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.912+0000 7fa2eaffd700 1 -- 172.21.15.40:0/720882921 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e400b9d0 con 0x7fa2ec09c890 2023-09-30T22:26:57.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.912+0000 7fa2eaffd700 1 -- 172.21.15.40:0/720882921 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e400bd80 con 0x7fa2ec09c890 2023-09-30T22:26:57.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.913+0000 7fa2f283c700 1 -- 172.21.15.40:0/720882921 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa2ec09c890 msgr2=0x7fa2ec09cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.913+0000 7fa2f283c700 1 --2- 172.21.15.40:0/720882921 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa2ec09c890 0x7fa2ec09cc60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4009ed0 tx=0x7fa2e400b330 comp rx=0 tx=0).stop 2023-09-30T22:26:57.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.913+0000 7fa2f283c700 1 -- 172.21.15.40:0/720882921 shutdown_connections 2023-09-30T22:26:57.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.913+0000 7fa2f283c700 1 --2- 172.21.15.40:0/720882921 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa2ec09c890 0x7fa2ec09cc60 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.913+0000 7fa2f283c700 1 --2- 172.21.15.40:0/720882921 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa2ec09d920 0x7fa2ec09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.913+0000 7fa2f283c700 1 -- 172.21.15.40:0/720882921 >> 172.21.15.40:0/720882921 conn(0x7fa2ec0a7080 msgr2=0x7fa2ec0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:57.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.913+0000 7fa2f283c700 1 -- 172.21.15.40:0/720882921 shutdown_connections 2023-09-30T22:26:57.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.913+0000 7fa2f283c700 1 -- 172.21.15.40:0/720882921 wait complete. 2023-09-30T22:26:57.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.914+0000 7fa2f283c700 1 Processor -- start 2023-09-30T22:26:57.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.914+0000 7fa2f283c700 1 -- start start 2023-09-30T22:26:57.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.915+0000 7fa2f283c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2ec09c890 0x7fa2ec12d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.915+0000 7fa2f283c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa2ec09d920 0x7fa2ec12d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.915+0000 7fa2f283c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa2ec09e2b0 0x7fa2ec12df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.915+0000 7fa2f283c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec130080 con 0x7fa2ec09c890 2023-09-30T22:26:57.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.915+0000 7fa2f283c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec1304d0 con 0x7fa2ec09d920 2023-09-30T22:26:57.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.915+0000 7fa2f283c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec0a5d60 con 0x7fa2ec09e2b0 2023-09-30T22:26:57.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.915+0000 7fa2ebfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2ec09c890 0x7fa2ec12d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.915+0000 7fa2ebfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2ec09c890 0x7fa2ec12d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36256/0 (socket says 172.21.15.40:36256) 2023-09-30T22:26:57.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.915+0000 7fa2eb7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa2ec09d920 0x7fa2ec12d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.915+0000 7fa2ebfff700 1 -- 172.21.15.40:0/19488581 learned_addr learned my addr 172.21.15.40:0/19488581 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:57.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.915+0000 7fa2f0dd9700 1 --2- 172.21.15.40:0/19488581 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa2ec09e2b0 0x7fa2ec12df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.915+0000 7fa2eb7fe700 1 -- 172.21.15.40:0/19488581 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa2ec09e2b0 msgr2=0x7fa2ec12df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.915+0000 7fa2eb7fe700 1 --2- 172.21.15.40:0/19488581 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa2ec09e2b0 0x7fa2ec12df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.915+0000 7fa2eb7fe700 1 -- 172.21.15.40:0/19488581 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2ec09c890 msgr2=0x7fa2ec12d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.915+0000 7fa2eb7fe700 1 --2- 172.21.15.40:0/19488581 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2ec09c890 0x7fa2ec12d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.915+0000 7fa2eb7fe700 1 -- 172.21.15.40:0/19488581 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e00094a0 con 0x7fa2ec09d920 2023-09-30T22:26:57.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.915+0000 7fa2f0dd9700 1 --2- 172.21.15.40:0/19488581 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa2ec09e2b0 0x7fa2ec12df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:57.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.916+0000 7fa2eb7fe700 1 --2- 172.21.15.40:0/19488581 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa2ec09d920 0x7fa2ec12d9d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa2e000e980 tx=0x7fa2e000ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:57.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.916+0000 7fa2e8ff9700 1 -- 172.21.15.40:0/19488581 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e000c690 con 0x7fa2ec09d920 2023-09-30T22:26:57.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.916+0000 7fa2e8ff9700 1 -- 172.21.15.40:0/19488581 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e000c7f0 con 0x7fa2ec09d920 2023-09-30T22:26:57.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.916+0000 7fa2e8ff9700 1 -- 172.21.15.40:0/19488581 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e000cb80 con 0x7fa2ec09d920 2023-09-30T22:26:57.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.917+0000 7fa2f283c700 1 -- 172.21.15.40:0/19488581 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e4009b30 con 0x7fa2ec09d920 2023-09-30T22:26:57.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.917+0000 7fa2f283c700 1 -- 172.21.15.40:0/19488581 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2ec12f620 con 0x7fa2ec09d920 2023-09-30T22:26:57.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.917+0000 7f70e67fc700 1 -- 172.21.15.40:0/1695922562 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f70ec017020 con 0x7f70f009d450 2023-09-30T22:26:57.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.918+0000 7fa2e8ff9700 1 -- 172.21.15.40:0/19488581 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa2e000cce0 con 0x7fa2ec09d920 2023-09-30T22:26:57.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.918+0000 7fa2f283c700 1 -- 172.21.15.40:0/19488581 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2ec1308a0 con 0x7fa2ec09d920 2023-09-30T22:26:57.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.918+0000 7fa2e8ff9700 1 -- 172.21.15.40:0/19488581 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa2e003f730 con 0x7fa2ec09d920 2023-09-30T22:26:57.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.927+0000 7fa2e8ff9700 1 -- 172.21.15.40:0/19488581 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa2e001bdf0 con 0x7fa2ec09d920 2023-09-30T22:26:57.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.960+0000 7f56f9851700 1 Processor -- start 2023-09-30T22:26:57.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.960+0000 7f56f9851700 1 -- start start 2023-09-30T22:26:57.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.961+0000 7f56f9851700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56f409d920 0x7f56f409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.961+0000 7f56f9851700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56f409e230 0x7f56f41308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.961+0000 7f56f9851700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56f409adf0 con 0x7f56f4130de0 2023-09-30T22:26:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.961+0000 7f56f9851700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f409edf0 con 0x7f56f409d920 2023-09-30T22:26:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.961+0000 7f56f9851700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56f409b660 con 0x7f56f409e230 2023-09-30T22:26:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.961+0000 7f56f27fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56f409e230 0x7f56f41308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.961+0000 7f56f27fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56f409e230 0x7f56f41308a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51944/0 (socket says 172.21.15.40:51944) 2023-09-30T22:26:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.961+0000 7f56f27fc700 1 -- 172.21.15.40:0/1825971338 learned_addr learned my addr 172.21.15.40:0/1825971338 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.961+0000 7f56f27fc700 1 -- 172.21.15.40:0/1825971338 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56f409d920 msgr2=0x7f56f409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.961+0000 7f56f27fc700 1 --2- 172.21.15.40:0/1825971338 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56f409d920 0x7f56f409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.961+0000 7f56f27fc700 1 -- 172.21.15.40:0/1825971338 >> v1:172.21.15.40:6789/0 conn(0x7f56f4130de0 legacy=0x7f56f4137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.961+0000 7f56f27fc700 1 -- 172.21.15.40:0/1825971338 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f409a6e0 con 0x7f56f409e230 2023-09-30T22:26:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.962+0000 7f56f27fc700 1 --2- 172.21.15.40:0/1825971338 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56f409e230 0x7f56f41308a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f56e8009920 tx=0x7f56e8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12ec4e536463b3b3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.962+0000 7f56f1ffb700 1 -- 172.21.15.40:0/1825971338 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e800ba60 con 0x7f56f409e230 2023-09-30T22:26:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.962+0000 7f56f1ffb700 1 -- 172.21.15.40:0/1825971338 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e800bbc0 con 0x7f56f409e230 2023-09-30T22:26:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.962+0000 7f56f1ffb700 1 -- 172.21.15.40:0/1825971338 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e8009e70 con 0x7f56f409e230 2023-09-30T22:26:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.962+0000 7f56f9851700 1 -- 172.21.15.40:0/1825971338 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56f409e230 msgr2=0x7f56f41308a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.962+0000 7f56f9851700 1 --2- 172.21.15.40:0/1825971338 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56f409e230 0x7f56f41308a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f56e8009920 tx=0x7f56e8009c30 comp rx=0 tx=0).stop 2023-09-30T22:26:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.962+0000 7f56f9851700 1 -- 172.21.15.40:0/1825971338 shutdown_connections 2023-09-30T22:26:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.962+0000 7f56f9851700 1 --2- 172.21.15.40:0/1825971338 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56f409d920 0x7f56f409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.962+0000 7f56f9851700 1 --2- 172.21.15.40:0/1825971338 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56f409e230 0x7f56f41308a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.962+0000 7f56f9851700 1 -- 172.21.15.40:0/1825971338 >> 172.21.15.40:0/1825971338 conn(0x7f56f409fb20 msgr2=0x7f56f409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.963+0000 7f56f9851700 1 -- 172.21.15.40:0/1825971338 shutdown_connections 2023-09-30T22:26:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.963+0000 7f56f9851700 1 -- 172.21.15.40:0/1825971338 wait complete. 2023-09-30T22:26:57.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.963+0000 7f56f9851700 1 Processor -- start 2023-09-30T22:26:57.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.964+0000 7f56f9851700 1 -- start start 2023-09-30T22:26:57.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.964+0000 7f56f9851700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56f409d920 0x7f56f4121540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.964+0000 7f56f9851700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56f409e230 0x7f56f4121a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.964+0000 7f56f9851700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56f4130de0 0x7f56f4121fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.964+0000 7f56f9851700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f4124ca0 con 0x7f56f4130de0 2023-09-30T22:26:57.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.964+0000 7f56f9851700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f4123180 con 0x7f56f409d920 2023-09-30T22:26:57.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.964+0000 7f56f9851700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56f409cb00 con 0x7f56f409e230 2023-09-30T22:26:57.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.965+0000 7f56f27fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56f409e230 0x7f56f4121a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.965+0000 7f56f27fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56f409e230 0x7f56f4121a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51950/0 (socket says 172.21.15.40:51950) 2023-09-30T22:26:57.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.965+0000 7f56f27fc700 1 -- 172.21.15.40:0/589544001 learned_addr learned my addr 172.21.15.40:0/589544001 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:57.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.965+0000 7f56f2ffd700 1 --2- 172.21.15.40:0/589544001 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56f409d920 0x7f56f4121540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.965+0000 7f56f37fe700 1 --2- 172.21.15.40:0/589544001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56f4130de0 0x7f56f4121fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.965+0000 7f56f37fe700 1 -- 172.21.15.40:0/589544001 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56f409e230 msgr2=0x7f56f4121a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.965+0000 7f56f37fe700 1 --2- 172.21.15.40:0/589544001 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56f409e230 0x7f56f4121a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.965+0000 7f56f37fe700 1 -- 172.21.15.40:0/589544001 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56f409d920 msgr2=0x7f56f4121540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.965+0000 7f56f37fe700 1 --2- 172.21.15.40:0/589544001 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56f409d920 0x7f56f4121540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.965+0000 7f56f37fe700 1 -- 172.21.15.40:0/589544001 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e8009550 con 0x7f56f4130de0 2023-09-30T22:26:57.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.965+0000 7f56f27fc700 1 --2- 172.21.15.40:0/589544001 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56f409e230 0x7f56f4121a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:57.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.965+0000 7f56f37fe700 1 --2- 172.21.15.40:0/589544001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56f4130de0 0x7f56f4121fc0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f56ec00cb90 tx=0x7f56ec00cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:57.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.966+0000 7f56dbfff700 1 -- 172.21.15.40:0/589544001 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec003c00 con 0x7f56f4130de0 2023-09-30T22:26:57.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.966+0000 7f56dbfff700 1 -- 172.21.15.40:0/589544001 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56ec003d60 con 0x7f56f4130de0 2023-09-30T22:26:57.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.966+0000 7f56dbfff700 1 -- 172.21.15.40:0/589544001 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec00aa80 con 0x7f56f4130de0 2023-09-30T22:26:57.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.967+0000 7f56f9851700 1 -- 172.21.15.40:0/589544001 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56f40711a0 con 0x7f56f4130de0 2023-09-30T22:26:57.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.967+0000 7f56f9851700 1 -- 172.21.15.40:0/589544001 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56f4125710 con 0x7f56f4130de0 2023-09-30T22:26:57.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.968+0000 7f56f9851700 1 -- 172.21.15.40:0/589544001 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56f4122a10 con 0x7f56f4130de0 2023-09-30T22:26:57.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.968+0000 7f56dbfff700 1 -- 172.21.15.40:0/589544001 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f56ec00abe0 con 0x7f56f4130de0 2023-09-30T22:26:57.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.968+0000 7f56dbfff700 1 -- 172.21.15.40:0/589544001 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f56ec03f610 con 0x7f56f4130de0 2023-09-30T22:26:57.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:57.977+0000 7f56dbfff700 1 -- 172.21.15.40:0/589544001 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f56f4122a10 con 0x7f56f4130de0 2023-09-30T22:26:58.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.086+0000 7f92dc91c700 1 -- 172.21.15.40:0/131387552 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f92d81362b0 con 0x7f92d812e590 2023-09-30T22:26:58.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.086+0000 7f92c6ffd700 1 -- 172.21.15.40:0/131387552 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f92cc017030 con 0x7f92d812e590 2023-09-30T22:26:58.087 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:58.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.088+0000 7f92dc91c700 1 -- 172.21.15.40:0/131387552 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92d812e590 msgr2=0x7f92d8132f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:58.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.088+0000 7f92dc91c700 1 --2- 172.21.15.40:0/131387552 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92d812e590 0x7f92d8132f80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f92cc00c4b0 tx=0x7f92cc00c7c0 comp rx=0 tx=0).stop 2023-09-30T22:26:58.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.089+0000 7f92dc91c700 1 -- 172.21.15.40:0/131387552 shutdown_connections 2023-09-30T22:26:58.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.089+0000 7f92dc91c700 1 --2- 172.21.15.40:0/131387552 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f92d812eea0 0x7f92d81334c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:58.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.089+0000 7f92dc91c700 1 --2- 172.21.15.40:0/131387552 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d812d8a0 0x7f92d813add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:58.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.089+0000 7f92dc91c700 1 --2- 172.21.15.40:0/131387552 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92d812e590 0x7f92d8132f80 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:58.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.089+0000 7f92dc91c700 1 -- 172.21.15.40:0/131387552 >> 172.21.15.40:0/131387552 conn(0x7f92d80a2a00 msgr2=0x7f92d8130cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:58.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.089+0000 7f92dc91c700 1 -- 172.21.15.40:0/131387552 shutdown_connections 2023-09-30T22:26:58.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.089+0000 7f92dc91c700 1 -- 172.21.15.40:0/131387552 wait complete. 2023-09-30T22:26:58.102 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:58.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.119+0000 7f70f81ae700 1 -- 172.21.15.40:0/1695922562 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f70d8005590 con 0x7f70f009d450 2023-09-30T22:26:58.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.120+0000 7f70e67fc700 1 -- 172.21.15.40:0/1695922562 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f70ec02a090 con 0x7f70f009d450 2023-09-30T22:26:58.121 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:58.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.122+0000 7f70f81ae700 1 -- 172.21.15.40:0/1695922562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70f009d450 msgr2=0x7f70f01c4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:58.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.122+0000 7f70f81ae700 1 --2- 172.21.15.40:0/1695922562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70f009d450 0x7f70f01c4070 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00e900 tx=0x7f70ec00ec10 comp rx=0 tx=0).stop 2023-09-30T22:26:58.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.122+0000 7f70f81ae700 1 -- 172.21.15.40:0/1695922562 shutdown_connections 2023-09-30T22:26:58.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.122+0000 7f70f81ae700 1 --2- 172.21.15.40:0/1695922562 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f70f01308d0 0x7f70f01c4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:58.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.122+0000 7f70f81ae700 1 --2- 172.21.15.40:0/1695922562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70f009d450 0x7f70f01c4070 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:58.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.122+0000 7f70f81ae700 1 --2- 172.21.15.40:0/1695922562 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f70f009dd60 0x7f70f01c45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:58.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.122+0000 7f70f81ae700 1 -- 172.21.15.40:0/1695922562 >> 172.21.15.40:0/1695922562 conn(0x7f70f00a2a00 msgr2=0x7f70f00a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:58.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.122+0000 7f70f81ae700 1 -- 172.21.15.40:0/1695922562 shutdown_connections 2023-09-30T22:26:58.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.122+0000 7f70f81ae700 1 -- 172.21.15.40:0/1695922562 wait complete. 2023-09-30T22:26:58.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.128+0000 7fa2f283c700 1 -- 172.21.15.40:0/19488581 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa2ec062380 con 0x7fa2ec09d920 2023-09-30T22:26:58.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.128+0000 7fa2e8ff9700 1 -- 172.21.15.40:0/19488581 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa2e0021070 con 0x7fa2ec09d920 2023-09-30T22:26:58.129 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:58.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.130+0000 7fa2f283c700 1 -- 172.21.15.40:0/19488581 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa2ec09d920 msgr2=0x7fa2ec12d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:58.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.130+0000 7fa2f283c700 1 --2- 172.21.15.40:0/19488581 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa2ec09d920 0x7fa2ec12d9d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa2e000e980 tx=0x7fa2e000ec90 comp rx=0 tx=0).stop 2023-09-30T22:26:58.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.130+0000 7fa2f283c700 1 -- 172.21.15.40:0/19488581 shutdown_connections 2023-09-30T22:26:58.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.130+0000 7fa2f283c700 1 --2- 172.21.15.40:0/19488581 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa2ec09e2b0 0x7fa2ec12df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:58.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.130+0000 7fa2f283c700 1 --2- 172.21.15.40:0/19488581 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2ec09c890 0x7fa2ec12d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:58.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.130+0000 7fa2f283c700 1 --2- 172.21.15.40:0/19488581 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa2ec09d920 0x7fa2ec12d9d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:58.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.130+0000 7fa2f283c700 1 -- 172.21.15.40:0/19488581 >> 172.21.15.40:0/19488581 conn(0x7fa2ec0a7080 msgr2=0x7fa2ec0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:58.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.131+0000 7fa2f283c700 1 -- 172.21.15.40:0/19488581 shutdown_connections 2023-09-30T22:26:58.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.131+0000 7fa2f283c700 1 -- 172.21.15.40:0/19488581 wait complete. 2023-09-30T22:26:58.135 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:58.143 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:58.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.175+0000 7f56f9851700 1 -- 172.21.15.40:0/589544001 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f56f4122a10 con 0x7f56f4130de0 2023-09-30T22:26:58.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.175+0000 7f56dbfff700 1 -- 172.21.15.40:0/589544001 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f56f4122a10 con 0x7f56f4130de0 2023-09-30T22:26:58.176 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:58.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.177+0000 7f56f9851700 1 -- 172.21.15.40:0/589544001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56f4130de0 msgr2=0x7f56f4121fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:58.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.177+0000 7f56f9851700 1 --2- 172.21.15.40:0/589544001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56f4130de0 0x7f56f4121fc0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f56ec00cb90 tx=0x7f56ec00cea0 comp rx=0 tx=0).stop 2023-09-30T22:26:58.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.177+0000 7f56f9851700 1 -- 172.21.15.40:0/589544001 shutdown_connections 2023-09-30T22:26:58.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.177+0000 7f56f9851700 1 --2- 172.21.15.40:0/589544001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56f4130de0 0x7f56f4121fc0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:58.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.177+0000 7f56f9851700 1 --2- 172.21.15.40:0/589544001 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56f409d920 0x7f56f4121540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:58.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.177+0000 7f56f9851700 1 --2- 172.21.15.40:0/589544001 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56f409e230 0x7f56f4121a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:58.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.177+0000 7f56f9851700 1 -- 172.21.15.40:0/589544001 >> 172.21.15.40:0/589544001 conn(0x7f56f409fb20 msgr2=0x7f56f412ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:58.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.177+0000 7f56f9851700 1 -- 172.21.15.40:0/589544001 shutdown_connections 2023-09-30T22:26:58.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:58.177+0000 7f56f9851700 1 -- 172.21.15.40:0/589544001 wait complete. 2023-09-30T22:26:58.190 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:26:59.103 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:59.136 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:59.145 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:59.191 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:59.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.253+0000 7ffa95c16700 1 Processor -- start 2023-09-30T22:26:59.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.253+0000 7ffa95c16700 1 -- start start 2023-09-30T22:26:59.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.254+0000 7ffa95c16700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa9012e590 0x7ffa9012e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.254+0000 7ffa95c16700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffa9012eea0 0x7ffa9012d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.254+0000 7ffa95c16700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa9009ab70 con 0x7ffa9012d6d0 2023-09-30T22:26:59.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.254+0000 7ffa95c16700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa9009b270 con 0x7ffa9012eea0 2023-09-30T22:26:59.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.254+0000 7ffa95c16700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9009bab0 con 0x7ffa9012e590 2023-09-30T22:26:59.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.254+0000 7ffa8f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa9012e590 0x7ffa9012e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:59.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.254+0000 7ffa8effd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffa9012eea0 0x7ffa9012d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:59.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.254+0000 7ffa8f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa9012e590 0x7ffa9012e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:36264/0 (socket says 172.21.15.40:36264) 2023-09-30T22:26:59.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.254+0000 7ffa8f7fe700 1 -- 172.21.15.40:0/1536783687 learned_addr learned my addr 172.21.15.40:0/1536783687 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:59.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.255+0000 7ffa8f7fe700 1 -- 172.21.15.40:0/1536783687 >> v2:172.21.15.40:3300/0 conn(0x7ffa9012eea0 msgr2=0x7ffa9012d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:59.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.255+0000 7ffa8f7fe700 1 --2- 172.21.15.40:0/1536783687 >> v2:172.21.15.40:3300/0 conn(0x7ffa9012eea0 0x7ffa9012d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.255+0000 7ffa8f7fe700 1 -- 172.21.15.40:0/1536783687 >> v1:172.21.15.40:6789/0 conn(0x7ffa9012d6d0 legacy=0x7ffa90137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:59.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.255+0000 7ffa8f7fe700 1 -- 172.21.15.40:0/1536783687 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa9009bd70 con 0x7ffa9012e590 2023-09-30T22:26:59.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.255+0000 7ffa8e7fc700 1 -- 172.21.15.40:0/1536783687 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2852936222 0 0) 0x7ffa9009ab70 con 0x7ffa9012d6d0 2023-09-30T22:26:59.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.255+0000 7ffa8effd700 1 --2- 172.21.15.40:0/1536783687 >> v2:172.21.15.40:3300/0 conn(0x7ffa9012eea0 0x7ffa9012d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:59.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.255+0000 7ffa8f7fe700 1 --2- 172.21.15.40:0/1536783687 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa9012e590 0x7ffa9012e960 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ffa80009920 tx=0x7ffa80009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=518d0957be8e15b0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:59.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.255+0000 7ffa8e7fc700 1 -- 172.21.15.40:0/1536783687 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa80011830 con 0x7ffa9012e590 2023-09-30T22:26:59.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.255+0000 7ffa8e7fc700 1 -- 172.21.15.40:0/1536783687 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa80011990 con 0x7ffa9012e590 2023-09-30T22:26:59.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.255+0000 7ffa8e7fc700 1 -- 172.21.15.40:0/1536783687 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa80011d20 con 0x7ffa9012e590 2023-09-30T22:26:59.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.256+0000 7ffa95c16700 1 -- 172.21.15.40:0/1536783687 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa9012e590 msgr2=0x7ffa9012e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:59.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.256+0000 7ffa95c16700 1 --2- 172.21.15.40:0/1536783687 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa9012e590 0x7ffa9012e960 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ffa80009920 tx=0x7ffa80009c30 comp rx=0 tx=0).stop 2023-09-30T22:26:59.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.256+0000 7ffa95c16700 1 -- 172.21.15.40:0/1536783687 shutdown_connections 2023-09-30T22:26:59.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.256+0000 7ffa95c16700 1 --2- 172.21.15.40:0/1536783687 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa9012e590 0x7ffa9012e960 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.256+0000 7ffa95c16700 1 --2- 172.21.15.40:0/1536783687 >> v2:172.21.15.40:3300/0 conn(0x7ffa9012eea0 0x7ffa9012d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.256+0000 7ffa95c16700 1 -- 172.21.15.40:0/1536783687 >> 172.21.15.40:0/1536783687 conn(0x7ffa900a2a00 msgr2=0x7ffa900a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:59.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.256+0000 7ffa95c16700 1 -- 172.21.15.40:0/1536783687 shutdown_connections 2023-09-30T22:26:59.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.256+0000 7ffa95c16700 1 -- 172.21.15.40:0/1536783687 wait complete. 2023-09-30T22:26:59.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.257+0000 7ffa95c16700 1 Processor -- start 2023-09-30T22:26:59.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.257+0000 7ffa95c16700 1 -- start start 2023-09-30T22:26:59.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.258+0000 7ffa95c16700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa9012d6d0 0x7ffa90125110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.258+0000 7ffa95c16700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa9012e590 0x7ffa90125650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.258+0000 7ffa95c16700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa9012eea0 0x7ffa90125b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.258+0000 7ffa95c16700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa901291f0 con 0x7ffa9012d6d0 2023-09-30T22:26:59.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.258+0000 7ffa95c16700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9009b4b0 con 0x7ffa9012e590 2023-09-30T22:26:59.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.258+0000 7ffa95c16700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa90139fa0 con 0x7ffa9012eea0 2023-09-30T22:26:59.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.258+0000 7ffa8ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa9012eea0 0x7ffa90125b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:59.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.258+0000 7ffa8ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa9012eea0 0x7ffa90125b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51960/0 (socket says 172.21.15.40:51960) 2023-09-30T22:26:59.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.258+0000 7ffa8ffff700 1 -- 172.21.15.40:0/1343522183 learned_addr learned my addr 172.21.15.40:0/1343522183 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:59.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.258+0000 7ffa8effd700 1 --2- 172.21.15.40:0/1343522183 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa9012e590 0x7ffa90125650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:59.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.258+0000 7ffa8ffff700 1 -- 172.21.15.40:0/1343522183 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa9012e590 msgr2=0x7ffa90125650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:59.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.258+0000 7ffa8ffff700 1 --2- 172.21.15.40:0/1343522183 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa9012e590 0x7ffa90125650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.258+0000 7ffa8ffff700 1 -- 172.21.15.40:0/1343522183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa9012d6d0 msgr2=0x7ffa90125110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:59.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.258+0000 7ffa8f7fe700 1 --2- 172.21.15.40:0/1343522183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa9012d6d0 0x7ffa90125110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:59.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.258+0000 7ffa8ffff700 1 --2- 172.21.15.40:0/1343522183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa9012d6d0 0x7ffa90125110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.258+0000 7ffa8ffff700 1 -- 172.21.15.40:0/1343522183 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa840094a0 con 0x7ffa9012eea0 2023-09-30T22:26:59.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.258+0000 7ffa8effd700 1 --2- 172.21.15.40:0/1343522183 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa9012e590 0x7ffa90125650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:59.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.258+0000 7ffa8f7fe700 1 --2- 172.21.15.40:0/1343522183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa9012d6d0 0x7ffa90125110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:26:59.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.259+0000 7ffa8ffff700 1 --2- 172.21.15.40:0/1343522183 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa9012eea0 0x7ffa90125b90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ffa8800c870 tx=0x7ffa8800cc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:59.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.259+0000 7ffa77fff700 1 -- 172.21.15.40:0/1343522183 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa88003e30 con 0x7ffa9012eea0 2023-09-30T22:26:59.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.259+0000 7ffa77fff700 1 -- 172.21.15.40:0/1343522183 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8800ce70 con 0x7ffa9012eea0 2023-09-30T22:26:59.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.259+0000 7ffa95c16700 1 -- 172.21.15.40:0/1343522183 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa80009550 con 0x7ffa9012eea0 2023-09-30T22:26:59.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.259+0000 7ffa77fff700 1 -- 172.21.15.40:0/1343522183 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa88005290 con 0x7ffa9012eea0 2023-09-30T22:26:59.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.259+0000 7ffa95c16700 1 -- 172.21.15.40:0/1343522183 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa9009cdb0 con 0x7ffa9012eea0 2023-09-30T22:26:59.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.260+0000 7ffa77fff700 1 -- 172.21.15.40:0/1343522183 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffa880053f0 con 0x7ffa9012eea0 2023-09-30T22:26:59.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.260+0000 7ffa77fff700 1 -- 172.21.15.40:0/1343522183 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ffa8803eeb0 con 0x7ffa9012eea0 2023-09-30T22:26:59.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.260+0000 7ffa95c16700 1 -- 172.21.15.40:0/1343522183 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa9012ad30 con 0x7ffa9012eea0 2023-09-30T22:26:59.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.270+0000 7ffa77fff700 1 -- 172.21.15.40:0/1343522183 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa88017080 con 0x7ffa9012eea0 2023-09-30T22:26:59.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.292+0000 7f619744d700 1 Processor -- start 2023-09-30T22:26:59.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.292+0000 7ff3048c8700 1 Processor -- start 2023-09-30T22:26:59.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.292+0000 7f619744d700 1 -- start start 2023-09-30T22:26:59.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.292+0000 7f619744d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f619009d920 0x7f619009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.292+0000 7ff3048c8700 1 -- start start 2023-09-30T22:26:59.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.292+0000 7f619744d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f619009f0f0 0x7f619009e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.293+0000 7f619744d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f619009f940 con 0x7f6190133ca0 2023-09-30T22:26:59.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.293+0000 7f619744d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f619006b4c0 con 0x7f619009d920 2023-09-30T22:26:59.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.293+0000 7f619744d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f619009a8f0 con 0x7f619009f0f0 2023-09-30T22:26:59.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.293+0000 7f61949e8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f619009f0f0 0x7f619009e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:59.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.293+0000 7f61949e8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f619009f0f0 0x7f619009e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51976/0 (socket says 172.21.15.40:51976) 2023-09-30T22:26:59.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.293+0000 7f61949e8700 1 -- 172.21.15.40:0/166087418 learned_addr learned my addr 172.21.15.40:0/166087418 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:59.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.293+0000 7ff3048c8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff30009e400 0x7ff300135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.293+0000 7ff3048c8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff30006a6d0 0x7ff30006aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.293+0000 7ff3048c8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff30009adf0 con 0x7ff30009d920 2023-09-30T22:26:59.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.293+0000 7ff3048c8700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff30009e7f0 con 0x7ff30006a6d0 2023-09-30T22:26:59.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.293+0000 7ff3048c8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff30009edf0 con 0x7ff30009e400 2023-09-30T22:26:59.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.293+0000 7ff2fe59c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff30009d920 0x7ff30009dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53224/0 (socket says 172.21.15.40:53224) 2023-09-30T22:26:59.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.293+0000 7ff2fe59c700 1 -- 172.21.15.40:0/325382739 learned_addr learned my addr 172.21.15.40:0/325382739 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:26:59.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.293+0000 7ff2fdd9b700 1 --2- 172.21.15.40:0/325382739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff30009e400 0x7ff300135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:59.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.293+0000 7ff2fdd9b700 1 -- 172.21.15.40:0/325382739 >> v2:172.21.15.40:3300/0 conn(0x7ff30006a6d0 msgr2=0x7ff30006aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:59.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.293+0000 7ff2fdd9b700 1 --2- 172.21.15.40:0/325382739 >> v2:172.21.15.40:3300/0 conn(0x7ff30006a6d0 0x7ff30006aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.293+0000 7ff2fdd9b700 1 -- 172.21.15.40:0/325382739 >> v1:172.21.15.40:6789/0 conn(0x7ff30009d920 legacy=0x7ff30009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:59.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.293+0000 7ff2fdd9b700 1 -- 172.21.15.40:0/325382739 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff30009b660 con 0x7ff30009e400 2023-09-30T22:26:59.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.293+0000 7f61949e8700 1 -- 172.21.15.40:0/166087418 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f619009d920 msgr2=0x7f619009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:59.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.293+0000 7f61949e8700 1 --2- 172.21.15.40:0/166087418 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f619009d920 0x7f619009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.293+0000 7f61949e8700 1 -- 172.21.15.40:0/166087418 >> v1:172.21.15.40:6789/0 conn(0x7f6190133ca0 legacy=0x7f6190134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:59.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.293+0000 7f61949e8700 1 -- 172.21.15.40:0/166087418 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f619009f6e0 con 0x7f619009f0f0 2023-09-30T22:26:59.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.294+0000 7ff2fdd9b700 1 --2- 172.21.15.40:0/325382739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff30009e400 0x7ff300135cf0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4009840 tx=0x7ff2f4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e288f36c902a9d5e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:59.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.294+0000 7f61949e8700 1 --2- 172.21.15.40:0/166087418 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f619009f0f0 0x7f619009e230 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6180009950 tx=0x7f6180009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d64f5ba28ed810ca server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:59.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.294+0000 7f6187fff700 1 -- 172.21.15.40:0/166087418 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6180009ea0 con 0x7f619009f0f0 2023-09-30T22:26:59.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.294+0000 7ff2fd59a700 1 -- 172.21.15.40:0/325382739 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4011830 con 0x7ff30009e400 2023-09-30T22:26:59.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.294+0000 7f6187fff700 1 -- 172.21.15.40:0/166087418 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618000ba20 con 0x7f619009f0f0 2023-09-30T22:26:59.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.294+0000 7f6187fff700 1 -- 172.21.15.40:0/166087418 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618000bd90 con 0x7f619009f0f0 2023-09-30T22:26:59.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.294+0000 7ff2fd59a700 1 -- 172.21.15.40:0/325382739 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f4011990 con 0x7ff30009e400 2023-09-30T22:26:59.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.294+0000 7ff2fd59a700 1 -- 172.21.15.40:0/325382739 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4011d20 con 0x7ff30009e400 2023-09-30T22:26:59.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.295+0000 7f619744d700 1 -- 172.21.15.40:0/166087418 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f619009f0f0 msgr2=0x7f619009e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:59.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.295+0000 7f619744d700 1 --2- 172.21.15.40:0/166087418 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f619009f0f0 0x7f619009e230 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6180009950 tx=0x7f6180009c60 comp rx=0 tx=0).stop 2023-09-30T22:26:59.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.295+0000 7f619744d700 1 -- 172.21.15.40:0/166087418 shutdown_connections 2023-09-30T22:26:59.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.295+0000 7f619744d700 1 --2- 172.21.15.40:0/166087418 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f619009d920 0x7f619009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.295+0000 7f619744d700 1 --2- 172.21.15.40:0/166087418 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f619009f0f0 0x7f619009e230 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.295+0000 7f619744d700 1 -- 172.21.15.40:0/166087418 >> 172.21.15.40:0/166087418 conn(0x7f619009fb20 msgr2=0x7f619009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:59.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.295+0000 7ff3048c8700 1 -- 172.21.15.40:0/325382739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff30009e400 msgr2=0x7ff300135cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:59.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.295+0000 7ff3048c8700 1 --2- 172.21.15.40:0/325382739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff30009e400 0x7ff300135cf0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4009840 tx=0x7ff2f4009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:59.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.295+0000 7ff3048c8700 1 -- 172.21.15.40:0/325382739 shutdown_connections 2023-09-30T22:26:59.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.295+0000 7ff3048c8700 1 --2- 172.21.15.40:0/325382739 >> v2:172.21.15.40:3300/0 conn(0x7ff30006a6d0 0x7ff30006aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.295+0000 7ff3048c8700 1 --2- 172.21.15.40:0/325382739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff30009e400 0x7ff300135cf0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.295+0000 7ff3048c8700 1 -- 172.21.15.40:0/325382739 >> 172.21.15.40:0/325382739 conn(0x7ff30009fb20 msgr2=0x7ff30009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:59.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.295+0000 7f619744d700 1 -- 172.21.15.40:0/166087418 shutdown_connections 2023-09-30T22:26:59.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.295+0000 7f619744d700 1 -- 172.21.15.40:0/166087418 wait complete. 2023-09-30T22:26:59.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.295+0000 7ff3048c8700 1 -- 172.21.15.40:0/325382739 shutdown_connections 2023-09-30T22:26:59.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.296+0000 7f619744d700 1 Processor -- start 2023-09-30T22:26:59.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.296+0000 7f619744d700 1 -- start start 2023-09-30T22:26:59.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.297+0000 7f619744d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f619009d920 0x7f6190123680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.297+0000 7f619744d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6190133ca0 0x7f6190123bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.297+0000 7f619744d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6190126d70 0x7f61901c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.297+0000 7f619744d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6190123300 con 0x7f6190126d70 2023-09-30T22:26:59.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.297+0000 7f619744d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61901255d0 con 0x7f619009d920 2023-09-30T22:26:59.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.297+0000 7f619744d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61901262d0 con 0x7f6190133ca0 2023-09-30T22:26:59.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.297+0000 7f61959ea700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6190126d70 0x7f61901c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:59.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.296+0000 7ff3048c8700 1 -- 172.21.15.40:0/325382739 wait complete. 2023-09-30T22:26:59.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.297+0000 7f61959ea700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6190126d70 0x7f61901c8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36290/0 (socket says 172.21.15.40:36290) 2023-09-30T22:26:59.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.297+0000 7f61959ea700 1 -- 172.21.15.40:0/980968873 learned_addr learned my addr 172.21.15.40:0/980968873 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:59.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.297+0000 7f61949e8700 1 --2- 172.21.15.40:0/980968873 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6190133ca0 0x7f6190123bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:59.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.297+0000 7f61959ea700 1 -- 172.21.15.40:0/980968873 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6190133ca0 msgr2=0x7f6190123bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:59.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.297+0000 7f61959ea700 1 --2- 172.21.15.40:0/980968873 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6190133ca0 0x7f6190123bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.297+0000 7f61959ea700 1 -- 172.21.15.40:0/980968873 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f619009d920 msgr2=0x7f6190123680 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:26:59.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.297+0000 7f61959ea700 1 --2- 172.21.15.40:0/980968873 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f619009d920 0x7f6190123680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.297+0000 7f61959ea700 1 -- 172.21.15.40:0/980968873 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6180009550 con 0x7f6190126d70 2023-09-30T22:26:59.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.298+0000 7ff3048c8700 1 Processor -- start 2023-09-30T22:26:59.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.298+0000 7ff3048c8700 1 -- start start 2023-09-30T22:26:59.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.298+0000 7f61959ea700 1 --2- 172.21.15.40:0/980968873 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6190126d70 0x7f61901c8a60 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f618800cc80 tx=0x7f618800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:59.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.298+0000 7f6185ffb700 1 -- 172.21.15.40:0/980968873 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618800ad40 con 0x7f6190126d70 2023-09-30T22:26:59.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.298+0000 7f6185ffb700 1 -- 172.21.15.40:0/980968873 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618800ce80 con 0x7f6190126d70 2023-09-30T22:26:59.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.298+0000 7f6185ffb700 1 -- 172.21.15.40:0/980968873 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618800aea0 con 0x7f6190126d70 2023-09-30T22:26:59.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.298+0000 7f619744d700 1 -- 172.21.15.40:0/980968873 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61900a2bc0 con 0x7f6190126d70 2023-09-30T22:26:59.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.298+0000 7f619744d700 1 -- 172.21.15.40:0/980968873 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6190124960 con 0x7f6190126d70 2023-09-30T22:26:59.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.298+0000 7ff3048c8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff30006a6d0 0x7ff300123840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.298+0000 7ff3048c8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff30009d920 0x7ff300123d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.298+0000 7ff3048c8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff30009e400 0x7ff3001cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.298+0000 7ff3048c8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff300124ba0 con 0x7ff30009e400 2023-09-30T22:26:59.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.298+0000 7ff3048c8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff30013ad70 con 0x7ff30006a6d0 2023-09-30T22:26:59.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.298+0000 7ff3048c8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff30009cb00 con 0x7ff30009d920 2023-09-30T22:26:59.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.299+0000 7ff2fed9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff30009e400 0x7ff3001cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:59.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.299+0000 7ff2fed9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff30009e400 0x7ff3001cc8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36302/0 (socket says 172.21.15.40:36302) 2023-09-30T22:26:59.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.299+0000 7ff2fed9d700 1 -- 172.21.15.40:0/3255431060 learned_addr learned my addr 172.21.15.40:0/3255431060 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:59.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.299+0000 7ff2fdd9b700 1 --2- 172.21.15.40:0/3255431060 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff30009d920 0x7ff300123d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:59.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.299+0000 7ff2fe59c700 1 --2- 172.21.15.40:0/3255431060 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff30006a6d0 0x7ff300123840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:59.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.299+0000 7ff2fdd9b700 1 -- 172.21.15.40:0/3255431060 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff30006a6d0 msgr2=0x7ff300123840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:59.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.299+0000 7ff2fdd9b700 1 --2- 172.21.15.40:0/3255431060 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff30006a6d0 0x7ff300123840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.299+0000 7ff2fdd9b700 1 -- 172.21.15.40:0/3255431060 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff30009e400 msgr2=0x7ff3001cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:59.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.299+0000 7ff2fdd9b700 1 --2- 172.21.15.40:0/3255431060 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff30009e400 0x7ff3001cc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.299+0000 7ff2fdd9b700 1 -- 172.21.15.40:0/3255431060 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f40094a0 con 0x7ff30009d920 2023-09-30T22:26:59.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.299+0000 7ff2fdd9b700 1 --2- 172.21.15.40:0/3255431060 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff30009d920 0x7ff300123d80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4016000 tx=0x7ff2f4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:59.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.299+0000 7f619744d700 1 -- 172.21.15.40:0/980968873 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f619006ac40 con 0x7f6190126d70 2023-09-30T22:26:59.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.300+0000 7ff2eeffd700 1 -- 172.21.15.40:0/3255431060 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f40036a0 con 0x7ff30009d920 2023-09-30T22:26:59.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.300+0000 7ff2eeffd700 1 -- 172.21.15.40:0/3255431060 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f401f070 con 0x7ff30009d920 2023-09-30T22:26:59.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.300+0000 7ff2eeffd700 1 -- 172.21.15.40:0/3255431060 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4003a80 con 0x7ff30009d920 2023-09-30T22:26:59.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.300+0000 7ff3048c8700 1 -- 172.21.15.40:0/3255431060 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3001242c0 con 0x7ff30009d920 2023-09-30T22:26:59.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.300+0000 7ff3048c8700 1 -- 172.21.15.40:0/3255431060 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3001269a0 con 0x7ff30009d920 2023-09-30T22:26:59.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.300+0000 7f6185ffb700 1 -- 172.21.15.40:0/980968873 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6188003c40 con 0x7f6190126d70 2023-09-30T22:26:59.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.300+0000 7f6185ffb700 1 -- 172.21.15.40:0/980968873 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f618803f770 con 0x7f6190126d70 2023-09-30T22:26:59.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.301+0000 7ff2eeffd700 1 -- 172.21.15.40:0/3255431060 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff2f4003be0 con 0x7ff30009d920 2023-09-30T22:26:59.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.301+0000 7ff3048c8700 1 -- 172.21.15.40:0/3255431060 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff300062380 con 0x7ff30009d920 2023-09-30T22:26:59.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.301+0000 7ff2eeffd700 1 -- 172.21.15.40:0/3255431060 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff2f4021070 con 0x7ff30009d920 2023-09-30T22:26:59.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.305+0000 7f6185ffb700 1 -- 172.21.15.40:0/980968873 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f61880198f0 con 0x7f6190126d70 2023-09-30T22:26:59.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.306+0000 7ff2eeffd700 1 -- 172.21.15.40:0/3255431060 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff2f4015020 con 0x7ff30009d920 2023-09-30T22:26:59.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.342+0000 7fe2669cf700 1 Processor -- start 2023-09-30T22:26:59.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.342+0000 7fe2669cf700 1 -- start start 2023-09-30T22:26:59.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.342+0000 7fe2669cf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe26009d920 0x7fe26009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.342+0000 7fe2669cf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe26009e230 0x7fe2601308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.342+0000 7fe2669cf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe260130de0 0x7fe260131260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.342+0000 7fe2669cf700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe26009edf0 con 0x7fe26009e230 2023-09-30T22:26:59.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.342+0000 7fe2669cf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26009adf0 con 0x7fe260130de0 2023-09-30T22:26:59.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.342+0000 7fe2669cf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe26009b660 con 0x7fe26009d920 2023-09-30T22:26:59.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.343+0000 7fe25ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe26009d920 0x7fe26009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:59.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.343+0000 7fe25ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe26009d920 0x7fe26009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52000/0 (socket says 172.21.15.40:52000) 2023-09-30T22:26:59.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.343+0000 7fe25ffff700 1 -- 172.21.15.40:0/1640140981 learned_addr learned my addr 172.21.15.40:0/1640140981 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:59.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.343+0000 7fe264f6c700 1 --2- 172.21.15.40:0/1640140981 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe260130de0 0x7fe260131260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:59.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.343+0000 7fe25f7fe700 1 --2- 172.21.15.40:0/1640140981 >> v2:172.21.15.40:3300/0 conn(0x7fe26009e230 0x7fe2601308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:59.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.343+0000 7fe25f7fe700 1 -- 172.21.15.40:0/1640140981 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe26009d920 msgr2=0x7fe26009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:59.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.343+0000 7fe25f7fe700 1 --2- 172.21.15.40:0/1640140981 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe26009d920 0x7fe26009dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.343+0000 7fe25f7fe700 1 -- 172.21.15.40:0/1640140981 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe260130de0 msgr2=0x7fe260131260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:59.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.343+0000 7fe25f7fe700 1 --2- 172.21.15.40:0/1640140981 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe260130de0 0x7fe260131260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.343+0000 7fe25f7fe700 1 -- 172.21.15.40:0/1640140981 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26009a6e0 con 0x7fe26009e230 2023-09-30T22:26:59.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.343+0000 7fe264f6c700 1 --2- 172.21.15.40:0/1640140981 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe260130de0 0x7fe260131260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:59.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.343+0000 7fe25f7fe700 1 --2- 172.21.15.40:0/1640140981 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe26009e230 0x7fe2601308a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fe254009840 tx=0x7fe254009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf856aeaa260086 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:59.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.344+0000 7fe25effd700 1 -- 172.21.15.40:0/1640140981 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe254011830 con 0x7fe26009e230 2023-09-30T22:26:59.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.344+0000 7fe25effd700 1 -- 172.21.15.40:0/1640140981 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe254011990 con 0x7fe26009e230 2023-09-30T22:26:59.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.344+0000 7fe25effd700 1 -- 172.21.15.40:0/1640140981 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe254011d20 con 0x7fe26009e230 2023-09-30T22:26:59.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.344+0000 7fe2669cf700 1 -- 172.21.15.40:0/1640140981 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe26009e230 msgr2=0x7fe2601308a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:59.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.344+0000 7fe2669cf700 1 --2- 172.21.15.40:0/1640140981 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe26009e230 0x7fe2601308a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fe254009840 tx=0x7fe254009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:59.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.345+0000 7fe2669cf700 1 -- 172.21.15.40:0/1640140981 shutdown_connections 2023-09-30T22:26:59.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.345+0000 7fe2669cf700 1 --2- 172.21.15.40:0/1640140981 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe26009d920 0x7fe26009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.345+0000 7fe2669cf700 1 --2- 172.21.15.40:0/1640140981 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe260130de0 0x7fe260131260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.345+0000 7fe2669cf700 1 --2- 172.21.15.40:0/1640140981 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe26009e230 0x7fe2601308a0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.345+0000 7fe2669cf700 1 -- 172.21.15.40:0/1640140981 >> 172.21.15.40:0/1640140981 conn(0x7fe26009fb20 msgr2=0x7fe26009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:59.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.345+0000 7fe2669cf700 1 -- 172.21.15.40:0/1640140981 shutdown_connections 2023-09-30T22:26:59.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.345+0000 7fe2669cf700 1 -- 172.21.15.40:0/1640140981 wait complete. 2023-09-30T22:26:59.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.346+0000 7fe2669cf700 1 Processor -- start 2023-09-30T22:26:59.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.346+0000 7fe2669cf700 1 -- start start 2023-09-30T22:26:59.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.347+0000 7fe2669cf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe26009d920 0x7fe26011aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.347+0000 7fe2669cf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe26009e230 0x7fe26011b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.347+0000 7fe2669cf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe260130de0 0x7fe26011ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.347+0000 7fe2669cf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26011e2e0 con 0x7fe26009e230 2023-09-30T22:26:59.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.347+0000 7fe2669cf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26011f430 con 0x7fe26009d920 2023-09-30T22:26:59.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.347+0000 7fe2669cf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe26011cc00 con 0x7fe260130de0 2023-09-30T22:26:59.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.347+0000 7fe25ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe26009d920 0x7fe26011aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:59.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.347+0000 7fe264f6c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe260130de0 0x7fe26011ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:59.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.347+0000 7fe25ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe26009d920 0x7fe26011aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:36320/0 (socket says 172.21.15.40:36320) 2023-09-30T22:26:59.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.347+0000 7fe25ffff700 1 -- 172.21.15.40:0/272659355 learned_addr learned my addr 172.21.15.40:0/272659355 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:26:59.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.347+0000 7fe264f6c700 1 --2- 172.21.15.40:0/272659355 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe260130de0 0x7fe26011ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52010/0 (socket says 172.21.15.40:52010) 2023-09-30T22:26:59.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.347+0000 7fe25f7fe700 1 --2- 172.21.15.40:0/272659355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe26009e230 0x7fe26011b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:59.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.348+0000 7fe264f6c700 1 -- 172.21.15.40:0/272659355 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe26009d920 msgr2=0x7fe26011aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:59.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.348+0000 7fe264f6c700 1 --2- 172.21.15.40:0/272659355 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe26009d920 0x7fe26011aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.348+0000 7fe264f6c700 1 -- 172.21.15.40:0/272659355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe26009e230 msgr2=0x7fe26011b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:59.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.348+0000 7fe264f6c700 1 --2- 172.21.15.40:0/272659355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe26009e230 0x7fe26011b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.348+0000 7fe264f6c700 1 -- 172.21.15.40:0/272659355 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe258009a70 con 0x7fe260130de0 2023-09-30T22:26:59.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.348+0000 7fe264f6c700 1 --2- 172.21.15.40:0/272659355 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe260130de0 0x7fe26011ba70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe25800b360 tx=0x7fe25800b670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:59.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.348+0000 7fe25cff9700 1 -- 172.21.15.40:0/272659355 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe258015070 con 0x7fe260130de0 2023-09-30T22:26:59.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.348+0000 7fe2669cf700 1 -- 172.21.15.40:0/272659355 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2540094a0 con 0x7fe260130de0 2023-09-30T22:26:59.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.348+0000 7fe25cff9700 1 -- 172.21.15.40:0/272659355 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25800be50 con 0x7fe260130de0 2023-09-30T22:26:59.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.348+0000 7fe2669cf700 1 -- 172.21.15.40:0/272659355 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe26009cb00 con 0x7fe260130de0 2023-09-30T22:26:59.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.348+0000 7fe25cff9700 1 -- 172.21.15.40:0/272659355 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe258003c60 con 0x7fe260130de0 2023-09-30T22:26:59.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.349+0000 7fe25cff9700 1 -- 172.21.15.40:0/272659355 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe258019410 con 0x7fe260130de0 2023-09-30T22:26:59.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.349+0000 7fe25cff9700 1 -- 172.21.15.40:0/272659355 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe258043920 con 0x7fe260130de0 2023-09-30T22:26:59.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.349+0000 7fe2669cf700 1 -- 172.21.15.40:0/272659355 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2400052e0 con 0x7fe260130de0 2023-09-30T22:26:59.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.359+0000 7fe25cff9700 1 -- 172.21.15.40:0/272659355 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe258020720 con 0x7fe260130de0 2023-09-30T22:26:59.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.473+0000 7ffa95c16700 1 -- 172.21.15.40:0/1343522183 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffa90062380 con 0x7ffa9012eea0 2023-09-30T22:26:59.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.473+0000 7ffa77fff700 1 -- 172.21.15.40:0/1343522183 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffa88010af0 con 0x7ffa9012eea0 2023-09-30T22:26:59.474 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:26:59.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.475+0000 7ffa95c16700 1 -- 172.21.15.40:0/1343522183 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa9012eea0 msgr2=0x7ffa90125b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:59.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.475+0000 7ffa95c16700 1 --2- 172.21.15.40:0/1343522183 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa9012eea0 0x7ffa90125b90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ffa8800c870 tx=0x7ffa8800cc30 comp rx=0 tx=0).stop 2023-09-30T22:26:59.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.475+0000 7ffa95c16700 1 -- 172.21.15.40:0/1343522183 shutdown_connections 2023-09-30T22:26:59.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.475+0000 7ffa95c16700 1 --2- 172.21.15.40:0/1343522183 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa9012eea0 0x7ffa90125b90 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.475+0000 7ffa95c16700 1 --2- 172.21.15.40:0/1343522183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa9012d6d0 0x7ffa90125110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.475+0000 7ffa95c16700 1 --2- 172.21.15.40:0/1343522183 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa9012e590 0x7ffa90125650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.475+0000 7ffa95c16700 1 -- 172.21.15.40:0/1343522183 >> 172.21.15.40:0/1343522183 conn(0x7ffa900a2a00 msgr2=0x7ffa9009d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:59.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.475+0000 7ffa95c16700 1 -- 172.21.15.40:0/1343522183 shutdown_connections 2023-09-30T22:26:59.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.475+0000 7ffa95c16700 1 -- 172.21.15.40:0/1343522183 wait complete. 2023-09-30T22:26:59.489 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:26:59.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.511+0000 7f619744d700 1 -- 172.21.15.40:0/980968873 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6190062380 con 0x7f6190126d70 2023-09-30T22:26:59.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.511+0000 7f6185ffb700 1 -- 172.21.15.40:0/980968873 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6188011380 con 0x7f6190126d70 2023-09-30T22:26:59.512 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:26:59.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.513+0000 7f619744d700 1 -- 172.21.15.40:0/980968873 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6190126d70 msgr2=0x7f61901c8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:59.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.513+0000 7f619744d700 1 --2- 172.21.15.40:0/980968873 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6190126d70 0x7f61901c8a60 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f618800cc80 tx=0x7f618800a340 comp rx=0 tx=0).stop 2023-09-30T22:26:59.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.513+0000 7f619744d700 1 -- 172.21.15.40:0/980968873 shutdown_connections 2023-09-30T22:26:59.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.513+0000 7f619744d700 1 --2- 172.21.15.40:0/980968873 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6190126d70 0x7f61901c8a60 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.513+0000 7f619744d700 1 --2- 172.21.15.40:0/980968873 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f619009d920 0x7f6190123680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.513+0000 7f619744d700 1 --2- 172.21.15.40:0/980968873 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6190133ca0 0x7f6190123bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.513+0000 7f619744d700 1 -- 172.21.15.40:0/980968873 >> 172.21.15.40:0/980968873 conn(0x7f619009fb20 msgr2=0x7f61900a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:59.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.513+0000 7f619744d700 1 -- 172.21.15.40:0/980968873 shutdown_connections 2023-09-30T22:26:59.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.513+0000 7f619744d700 1 -- 172.21.15.40:0/980968873 wait complete. 2023-09-30T22:26:59.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.518+0000 7ff3048c8700 1 -- 172.21.15.40:0/3255431060 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff300126570 con 0x7ff30009d920 2023-09-30T22:26:59.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.519+0000 7ff2eeffd700 1 -- 172.21.15.40:0/3255431060 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff2f4034070 con 0x7ff30009d920 2023-09-30T22:26:59.519 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:59.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.521+0000 7ff3048c8700 1 -- 172.21.15.40:0/3255431060 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff30009d920 msgr2=0x7ff300123d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:59.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.521+0000 7ff3048c8700 1 --2- 172.21.15.40:0/3255431060 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff30009d920 0x7ff300123d80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4016000 tx=0x7ff2f4004750 comp rx=0 tx=0).stop 2023-09-30T22:26:59.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.521+0000 7ff3048c8700 1 -- 172.21.15.40:0/3255431060 shutdown_connections 2023-09-30T22:26:59.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.521+0000 7ff3048c8700 1 --2- 172.21.15.40:0/3255431060 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff30009e400 0x7ff3001cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.521+0000 7ff3048c8700 1 --2- 172.21.15.40:0/3255431060 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff30006a6d0 0x7ff300123840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.521+0000 7ff3048c8700 1 --2- 172.21.15.40:0/3255431060 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff30009d920 0x7ff300123d80 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.521+0000 7ff3048c8700 1 -- 172.21.15.40:0/3255431060 >> 172.21.15.40:0/3255431060 conn(0x7ff30009fb20 msgr2=0x7ff3000a30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:59.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.521+0000 7ff3048c8700 1 -- 172.21.15.40:0/3255431060 shutdown_connections 2023-09-30T22:26:59.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.521+0000 7ff3048c8700 1 -- 172.21.15.40:0/3255431060 wait complete. 2023-09-30T22:26:59.527 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:26:59.534 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:26:59.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.556+0000 7fe2669cf700 1 -- 172.21.15.40:0/272659355 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe240005590 con 0x7fe260130de0 2023-09-30T22:26:59.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.556+0000 7fe25cff9700 1 -- 172.21.15.40:0/272659355 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe258007330 con 0x7fe260130de0 2023-09-30T22:26:59.557 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:26:59.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.558+0000 7fe2669cf700 1 -- 172.21.15.40:0/272659355 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe260130de0 msgr2=0x7fe26011ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:59.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.558+0000 7fe2669cf700 1 --2- 172.21.15.40:0/272659355 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe260130de0 0x7fe26011ba70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe25800b360 tx=0x7fe25800b670 comp rx=0 tx=0).stop 2023-09-30T22:26:59.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.558+0000 7fe2669cf700 1 -- 172.21.15.40:0/272659355 shutdown_connections 2023-09-30T22:26:59.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.558+0000 7fe2669cf700 1 --2- 172.21.15.40:0/272659355 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe260130de0 0x7fe26011ba70 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.558+0000 7fe2669cf700 1 --2- 172.21.15.40:0/272659355 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe26009d920 0x7fe26011aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.558+0000 7fe2669cf700 1 --2- 172.21.15.40:0/272659355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe26009e230 0x7fe26011b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.558+0000 7fe2669cf700 1 -- 172.21.15.40:0/272659355 >> 172.21.15.40:0/272659355 conn(0x7fe26009fb20 msgr2=0x7fe26012df40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:59.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.559+0000 7fe2669cf700 1 -- 172.21.15.40:0/272659355 shutdown_connections 2023-09-30T22:26:59.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:26:59.559+0000 7fe2669cf700 1 -- 172.21.15.40:0/272659355 wait complete. 2023-09-30T22:26:59.571 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:00.489 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:00.528 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:00.535 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:00.572 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:00.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.640+0000 7f9b8ce34700 1 Processor -- start 2023-09-30T22:27:00.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.640+0000 7f9b8ce34700 1 -- start start 2023-09-30T22:27:00.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.642+0000 7f9b8ce34700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b8812e590 0x7f9b8812e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.642+0000 7f9b8ce34700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b8812eea0 0x7f9b8812d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.642+0000 7f9b8ce34700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b8809ab70 con 0x7f9b8812d6d0 2023-09-30T22:27:00.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.642+0000 7f9b8ce34700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8809b270 con 0x7f9b8812eea0 2023-09-30T22:27:00.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.642+0000 7f9b8ce34700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8809bab0 con 0x7f9b8812e590 2023-09-30T22:27:00.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.642+0000 7f9b8659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b8812e590 0x7f9b8812e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:00.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.642+0000 7f9b8659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b8812e590 0x7f9b8812e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52012/0 (socket says 172.21.15.40:52012) 2023-09-30T22:27:00.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.642+0000 7f9b8659c700 1 -- 172.21.15.40:0/1890091397 learned_addr learned my addr 172.21.15.40:0/1890091397 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:00.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.642+0000 7f9b8659c700 1 -- 172.21.15.40:0/1890091397 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b8812eea0 msgr2=0x7f9b8812d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:00.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.642+0000 7f9b8659c700 1 --2- 172.21.15.40:0/1890091397 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b8812eea0 0x7f9b8812d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.642+0000 7f9b8659c700 1 -- 172.21.15.40:0/1890091397 >> v1:172.21.15.40:6789/0 conn(0x7f9b8812d6d0 legacy=0x7f9b88137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.642+0000 7f9b8659c700 1 -- 172.21.15.40:0/1890091397 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8809bd70 con 0x7f9b8812e590 2023-09-30T22:27:00.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.642+0000 7f9b8559a700 1 -- 172.21.15.40:0/1890091397 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679672224 0 0) 0x7f9b8809ab70 con 0x7f9b8812d6d0 2023-09-30T22:27:00.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.642+0000 7f9b8659c700 1 --2- 172.21.15.40:0/1890091397 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b8812e590 0x7f9b8812e960 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9b80009e80 tx=0x7f9b8000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=678fd75c8aca48b6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:00.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.643+0000 7f9b8559a700 1 -- 172.21.15.40:0/1890091397 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8000e070 con 0x7f9b8812e590 2023-09-30T22:27:00.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.643+0000 7f9b8559a700 1 -- 172.21.15.40:0/1890091397 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8000b9c0 con 0x7f9b8812e590 2023-09-30T22:27:00.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.643+0000 7f9b8559a700 1 -- 172.21.15.40:0/1890091397 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8000bd70 con 0x7f9b8812e590 2023-09-30T22:27:00.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.644+0000 7f9b8ce34700 1 -- 172.21.15.40:0/1890091397 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b8812e590 msgr2=0x7f9b8812e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.644+0000 7f9b8ce34700 1 --2- 172.21.15.40:0/1890091397 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b8812e590 0x7f9b8812e960 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9b80009e80 tx=0x7f9b8000b330 comp rx=0 tx=0).stop 2023-09-30T22:27:00.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.644+0000 7f9b8ce34700 1 -- 172.21.15.40:0/1890091397 shutdown_connections 2023-09-30T22:27:00.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.644+0000 7f9b8ce34700 1 --2- 172.21.15.40:0/1890091397 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b8812e590 0x7f9b8812e960 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.644+0000 7f9b8ce34700 1 --2- 172.21.15.40:0/1890091397 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b8812eea0 0x7f9b8812d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.644+0000 7f9b8ce34700 1 -- 172.21.15.40:0/1890091397 >> 172.21.15.40:0/1890091397 conn(0x7f9b880a2a00 msgr2=0x7f9b880a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:00.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.644+0000 7f9b8ce34700 1 -- 172.21.15.40:0/1890091397 shutdown_connections 2023-09-30T22:27:00.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.644+0000 7f9b8ce34700 1 -- 172.21.15.40:0/1890091397 wait complete. 2023-09-30T22:27:00.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.645+0000 7f9b8ce34700 1 Processor -- start 2023-09-30T22:27:00.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.645+0000 7f9b8ce34700 1 -- start start 2023-09-30T22:27:00.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.646+0000 7f9b8ce34700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b8812d6d0 0x7f9b881c6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.646+0000 7f9b8ce34700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b8812e590 0x7f9b881c6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.646+0000 7f9b8ce34700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b8812eea0 0x7f9b881c6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.646+0000 7f9b8ce34700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8809b4b0 con 0x7f9b8812e590 2023-09-30T22:27:00.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.646+0000 7f9b8ce34700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8809a6a0 con 0x7f9b8812d6d0 2023-09-30T22:27:00.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.646+0000 7f9b8ce34700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b88129d90 con 0x7f9b8812eea0 2023-09-30T22:27:00.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.646+0000 7f9b86d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b8812eea0 0x7f9b881c6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:00.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.646+0000 7f9b86d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b8812eea0 0x7f9b881c6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52028/0 (socket says 172.21.15.40:52028) 2023-09-30T22:27:00.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.646+0000 7f9b86d9d700 1 -- 172.21.15.40:0/1447759663 learned_addr learned my addr 172.21.15.40:0/1447759663 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:00.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.646+0000 7f9b85d9b700 1 --2- 172.21.15.40:0/1447759663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b8812e590 0x7f9b881c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:00.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.647+0000 7f9b86d9d700 1 -- 172.21.15.40:0/1447759663 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b8812d6d0 msgr2=0x7f9b881c6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.647+0000 7f9b86d9d700 1 --2- 172.21.15.40:0/1447759663 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b8812d6d0 0x7f9b881c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.647+0000 7f9b86d9d700 1 -- 172.21.15.40:0/1447759663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b8812e590 msgr2=0x7f9b881c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.647+0000 7f9b86d9d700 1 --2- 172.21.15.40:0/1447759663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b8812e590 0x7f9b881c6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.647+0000 7f9b86d9d700 1 -- 172.21.15.40:0/1447759663 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b80009b30 con 0x7f9b8812eea0 2023-09-30T22:27:00.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.647+0000 7f9b85d9b700 1 --2- 172.21.15.40:0/1447759663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b8812e590 0x7f9b881c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:00.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.647+0000 7f9b86d9d700 1 --2- 172.21.15.40:0/1447759663 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b8812eea0 0x7f9b881c6dd0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9b7000c480 tx=0x7f9b7000c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:00.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.647+0000 7f9b7effd700 1 -- 172.21.15.40:0/1447759663 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b70003680 con 0x7f9b8812eea0 2023-09-30T22:27:00.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.647+0000 7f9b8ce34700 1 -- 172.21.15.40:0/1447759663 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b8809cdb0 con 0x7f9b8812eea0 2023-09-30T22:27:00.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.647+0000 7f9b7effd700 1 -- 172.21.15.40:0/1447759663 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b70003800 con 0x7f9b8812eea0 2023-09-30T22:27:00.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.647+0000 7f9b7effd700 1 -- 172.21.15.40:0/1447759663 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b70003bb0 con 0x7f9b8812eea0 2023-09-30T22:27:00.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.647+0000 7f9b8ce34700 1 -- 172.21.15.40:0/1447759663 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b88070df0 con 0x7f9b8812eea0 2023-09-30T22:27:00.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.648+0000 7f9b7effd700 1 -- 172.21.15.40:0/1447759663 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9b70003d10 con 0x7f9b8812eea0 2023-09-30T22:27:00.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.648+0000 7f9b7effd700 1 -- 172.21.15.40:0/1447759663 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9b7003ec60 con 0x7f9b8812eea0 2023-09-30T22:27:00.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.649+0000 7f9b8ce34700 1 -- 172.21.15.40:0/1447759663 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b88062380 con 0x7f9b8812eea0 2023-09-30T22:27:00.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.658+0000 7f9b7effd700 1 -- 172.21.15.40:0/1447759663 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9b700192c0 con 0x7f9b8812eea0 2023-09-30T22:27:00.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.692+0000 7fa1e5095700 1 Processor -- start 2023-09-30T22:27:00.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.692+0000 7fa1e5095700 1 -- start start 2023-09-30T22:27:00.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.692+0000 7fa1e5095700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa1e009d920 0x7fa1e009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.692+0000 7fa1e5095700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa1e009e230 0x7fa1e01308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.692+0000 7fa1e5095700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa1e0130de0 0x7fa1e0131280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.692+0000 7fa1e5095700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1e009edf0 con 0x7fa1e0130de0 2023-09-30T22:27:00.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.692+0000 7fa1e5095700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e009adf0 con 0x7fa1e009d920 2023-09-30T22:27:00.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.692+0000 7fa1e5095700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e009b660 con 0x7fa1e009e230 2023-09-30T22:27:00.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.693+0000 7fa1df59e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa1e0130de0 0x7fa1e0131280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:00.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.693+0000 7fa1df59e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa1e0130de0 0x7fa1e0131280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36342/0 (socket says 172.21.15.40:36342) 2023-09-30T22:27:00.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.693+0000 7fa1df59e700 1 -- 172.21.15.40:0/2515154606 learned_addr learned my addr 172.21.15.40:0/2515154606 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:00.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.693+0000 7fa1de59c700 1 --2- 172.21.15.40:0/2515154606 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa1e009e230 0x7fa1e01308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:00.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.693+0000 7fa1ded9d700 1 --2- 172.21.15.40:0/2515154606 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa1e009d920 0x7fa1e009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:00.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.693+0000 7fa1df59e700 1 -- 172.21.15.40:0/2515154606 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa1e009e230 msgr2=0x7fa1e01308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:00.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.693+0000 7fa1df59e700 1 --2- 172.21.15.40:0/2515154606 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa1e009e230 0x7fa1e01308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.693+0000 7fa1df59e700 1 -- 172.21.15.40:0/2515154606 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa1e009d920 msgr2=0x7fa1e009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:00.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.693+0000 7fa1df59e700 1 --2- 172.21.15.40:0/2515154606 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa1e009d920 0x7fa1e009dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.693+0000 7fa1df59e700 1 -- 172.21.15.40:0/2515154606 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e009a6e0 con 0x7fa1e0130de0 2023-09-30T22:27:00.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.693+0000 7fa1df59e700 1 --2- 172.21.15.40:0/2515154606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1e0130de0 0x7fa1e0131280 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa1d800bef0 tx=0x7fa1d80093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec46d47d0b3927a1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:00.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.693+0000 7fa1ddd9b700 1 -- 172.21.15.40:0/2515154606 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d800b4e0 con 0x7fa1e0130de0 2023-09-30T22:27:00.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.694+0000 7fa1ddd9b700 1 -- 172.21.15.40:0/2515154606 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d800c950 con 0x7fa1e0130de0 2023-09-30T22:27:00.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.694+0000 7fa1ddd9b700 1 -- 172.21.15.40:0/2515154606 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d800cd00 con 0x7fa1e0130de0 2023-09-30T22:27:00.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.694+0000 7fa1e5095700 1 -- 172.21.15.40:0/2515154606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1e0130de0 msgr2=0x7fa1e0131280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.694+0000 7fa1e5095700 1 --2- 172.21.15.40:0/2515154606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1e0130de0 0x7fa1e0131280 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa1d800bef0 tx=0x7fa1d80093b0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.694+0000 7fa1e5095700 1 -- 172.21.15.40:0/2515154606 shutdown_connections 2023-09-30T22:27:00.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.694+0000 7fa1e5095700 1 --2- 172.21.15.40:0/2515154606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1e0130de0 0x7fa1e0131280 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.694+0000 7fa1e5095700 1 --2- 172.21.15.40:0/2515154606 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa1e009d920 0x7fa1e009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.694+0000 7fa1e5095700 1 --2- 172.21.15.40:0/2515154606 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa1e009e230 0x7fa1e01308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.694+0000 7fa1e5095700 1 -- 172.21.15.40:0/2515154606 >> 172.21.15.40:0/2515154606 conn(0x7fa1e009fb20 msgr2=0x7fa1e009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:00.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.694+0000 7fa1e5095700 1 -- 172.21.15.40:0/2515154606 shutdown_connections 2023-09-30T22:27:00.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.694+0000 7fa1e5095700 1 -- 172.21.15.40:0/2515154606 wait complete. 2023-09-30T22:27:00.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.696+0000 7fa1e5095700 1 Processor -- start 2023-09-30T22:27:00.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.696+0000 7fa1e5095700 1 -- start start 2023-09-30T22:27:00.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.696+0000 7fa1e5095700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1e009d920 0x7fa1e011af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.696+0000 7fa1e5095700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa1e009e230 0x7fa1e011b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.696+0000 7fa1e5095700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa1e0130de0 0x7fa1e011b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.696+0000 7fa1e5095700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e011f380 con 0x7fa1e009d920 2023-09-30T22:27:00.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.696+0000 7fa1e5095700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e011cab0 con 0x7fa1e0130de0 2023-09-30T22:27:00.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.696+0000 7fa1e5095700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e011dd00 con 0x7fa1e009e230 2023-09-30T22:27:00.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.696+0000 7fa1ded9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1e009d920 0x7fa1e011af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:00.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.696+0000 7fa1df59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa1e0130de0 0x7fa1e011b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:00.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.696+0000 7fa1ded9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1e009d920 0x7fa1e011af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36350/0 (socket says 172.21.15.40:36350) 2023-09-30T22:27:00.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.696+0000 7fa1ded9d700 1 -- 172.21.15.40:0/4087348404 learned_addr learned my addr 172.21.15.40:0/4087348404 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:00.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.696+0000 7fa1de59c700 1 --2- 172.21.15.40:0/4087348404 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa1e009e230 0x7fa1e011b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:00.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.697+0000 7fa1df59e700 1 -- 172.21.15.40:0/4087348404 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa1e009e230 msgr2=0x7fa1e011b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.697+0000 7fa1df59e700 1 --2- 172.21.15.40:0/4087348404 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa1e009e230 0x7fa1e011b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.697+0000 7fa1df59e700 1 -- 172.21.15.40:0/4087348404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1e009d920 msgr2=0x7fa1e011af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.697+0000 7fa1df59e700 1 --2- 172.21.15.40:0/4087348404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1e009d920 0x7fa1e011af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.697+0000 7fa1df59e700 1 -- 172.21.15.40:0/4087348404 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d800bb50 con 0x7fa1e0130de0 2023-09-30T22:27:00.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.697+0000 7fa1ded9d700 1 --2- 172.21.15.40:0/4087348404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1e009d920 0x7fa1e011af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:00.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.697+0000 7fa1df59e700 1 --2- 172.21.15.40:0/4087348404 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa1e0130de0 0x7fa1e011b9b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0072240 tx=0x7fa1d8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:00.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.697+0000 7fa1c77fe700 1 -- 172.21.15.40:0/4087348404 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d800add0 con 0x7fa1e0130de0 2023-09-30T22:27:00.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.697+0000 7fa1e5095700 1 -- 172.21.15.40:0/4087348404 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1e011e6e0 con 0x7fa1e0130de0 2023-09-30T22:27:00.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.697+0000 7fa1e5095700 1 -- 172.21.15.40:0/4087348404 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1e011d0c0 con 0x7fa1e0130de0 2023-09-30T22:27:00.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.697+0000 7fa1c77fe700 1 -- 172.21.15.40:0/4087348404 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d801f450 con 0x7fa1e0130de0 2023-09-30T22:27:00.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.697+0000 7fa1c77fe700 1 -- 172.21.15.40:0/4087348404 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d801f7c0 con 0x7fa1e0130de0 2023-09-30T22:27:00.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.698+0000 7fa1c77fe700 1 -- 172.21.15.40:0/4087348404 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa1d801f920 con 0x7fa1e0130de0 2023-09-30T22:27:00.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.699+0000 7fa1c77fe700 1 -- 172.21.15.40:0/4087348404 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa1d8040f50 con 0x7fa1e0130de0 2023-09-30T22:27:00.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.699+0000 7fa1e5095700 1 -- 172.21.15.40:0/4087348404 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1c00052e0 con 0x7fa1e0130de0 2023-09-30T22:27:00.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.708+0000 7fa1c77fe700 1 -- 172.21.15.40:0/4087348404 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa1d801fbd0 con 0x7fa1e0130de0 2023-09-30T22:27:00.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.720+0000 7f0738f6e700 1 Processor -- start 2023-09-30T22:27:00.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.720+0000 7f0738f6e700 1 -- start start 2023-09-30T22:27:00.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.721+0000 7f0738f6e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f073409e400 0x7f0734138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.721+0000 7f0738f6e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0734139420 0x7f073413b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.721+0000 7f0738f6e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f073409f0f0 con 0x7f073409d920 2023-09-30T22:27:00.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.721+0000 7f0738f6e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073409e7f0 con 0x7f0734139420 2023-09-30T22:27:00.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.721+0000 7f0738f6e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f073409a960 con 0x7f073409e400 2023-09-30T22:27:00.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.721+0000 7f0732d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0734139420 0x7f073413b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:00.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.721+0000 7f073259c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f073409d920 0x7f073409dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53242/0 (socket says 172.21.15.40:53242) 2023-09-30T22:27:00.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.721+0000 7f073259c700 1 -- 172.21.15.40:0/1365839487 learned_addr learned my addr 172.21.15.40:0/1365839487 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:27:00.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.721+0000 7f0731d9b700 1 --2- 172.21.15.40:0/1365839487 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f073409e400 0x7f0734138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:00.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.721+0000 7f0732d9d700 1 -- 172.21.15.40:0/1365839487 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f073409e400 msgr2=0x7f0734138ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:00.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.721+0000 7f0732d9d700 1 --2- 172.21.15.40:0/1365839487 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f073409e400 0x7f0734138ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.721+0000 7f0732d9d700 1 -- 172.21.15.40:0/1365839487 >> v1:172.21.15.40:6789/0 conn(0x7f073409d920 legacy=0x7f073409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.721+0000 7f0732d9d700 1 -- 172.21.15.40:0/1365839487 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073409abd0 con 0x7f0734139420 2023-09-30T22:27:00.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.722+0000 7f0732d9d700 1 --2- 172.21.15.40:0/1365839487 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0734139420 0x7f073413b800 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f072c009df0 tx=0x7f072c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3323d06f9c04067c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:00.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.722+0000 7f073159a700 1 -- 172.21.15.40:0/1365839487 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072c00e070 con 0x7f0734139420 2023-09-30T22:27:00.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.722+0000 7f073159a700 1 -- 172.21.15.40:0/1365839487 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072c00bae0 con 0x7f0734139420 2023-09-30T22:27:00.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.722+0000 7f073159a700 1 -- 172.21.15.40:0/1365839487 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072c00be90 con 0x7f0734139420 2023-09-30T22:27:00.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.723+0000 7f0738f6e700 1 -- 172.21.15.40:0/1365839487 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0734139420 msgr2=0x7f073413b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.723+0000 7f0738f6e700 1 --2- 172.21.15.40:0/1365839487 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0734139420 0x7f073413b800 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f072c009df0 tx=0x7f072c00b330 comp rx=0 tx=0).stop 2023-09-30T22:27:00.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.723+0000 7f0738f6e700 1 -- 172.21.15.40:0/1365839487 shutdown_connections 2023-09-30T22:27:00.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.723+0000 7f0738f6e700 1 --2- 172.21.15.40:0/1365839487 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0734139420 0x7f073413b800 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.723+0000 7f0738f6e700 1 --2- 172.21.15.40:0/1365839487 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f073409e400 0x7f0734138ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.723+0000 7f0738f6e700 1 -- 172.21.15.40:0/1365839487 >> 172.21.15.40:0/1365839487 conn(0x7f073409fb20 msgr2=0x7f073409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:00.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.723+0000 7f0738f6e700 1 -- 172.21.15.40:0/1365839487 shutdown_connections 2023-09-30T22:27:00.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.723+0000 7f0738f6e700 1 -- 172.21.15.40:0/1365839487 wait complete. 2023-09-30T22:27:00.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.724+0000 7f0738f6e700 1 Processor -- start 2023-09-30T22:27:00.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.724+0000 7f0738f6e700 1 -- start start 2023-09-30T22:27:00.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.724+0000 7f0738f6e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f073409d920 0x7f07341c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.724+0000 7f0738f6e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f073409e400 0x7f07341c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.725+0000 7f0738f6e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0734139420 0x7f073411ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.725+0000 7f0738f6e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0734122fc0 con 0x7f073409e400 2023-09-30T22:27:00.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.725+0000 7f0738f6e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0734122070 con 0x7f073409d920 2023-09-30T22:27:00.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.725+0000 7f0738f6e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07340a2e20 con 0x7f0734139420 2023-09-30T22:27:00.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.725+0000 7f0732d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0734139420 0x7f073411ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:00.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.725+0000 7f0732d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0734139420 0x7f073411ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52076/0 (socket says 172.21.15.40:52076) 2023-09-30T22:27:00.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.725+0000 7f0732d9d700 1 -- 172.21.15.40:0/3905123227 learned_addr learned my addr 172.21.15.40:0/3905123227 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:00.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.725+0000 7f0731d9b700 1 --2- 172.21.15.40:0/3905123227 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f073409e400 0x7f07341c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:00.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.725+0000 7f0732d9d700 1 -- 172.21.15.40:0/3905123227 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f073409d920 msgr2=0x7f07341c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.725+0000 7f0732d9d700 1 --2- 172.21.15.40:0/3905123227 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f073409d920 0x7f07341c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.725+0000 7f0732d9d700 1 -- 172.21.15.40:0/3905123227 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f073409e400 msgr2=0x7f07341c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.725+0000 7f0732d9d700 1 --2- 172.21.15.40:0/3905123227 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f073409e400 0x7f07341c8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.725+0000 7f0732d9d700 1 -- 172.21.15.40:0/3905123227 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f072c009a70 con 0x7f0734139420 2023-09-30T22:27:00.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.725+0000 7f0731d9b700 1 --2- 172.21.15.40:0/3905123227 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f073409e400 0x7f07341c8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:00.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.725+0000 7f0732d9d700 1 --2- 172.21.15.40:0/3905123227 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0734139420 0x7f073411ed90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f072c014040 tx=0x7f072c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:00.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.725+0000 7f0722ffd700 1 -- 172.21.15.40:0/3905123227 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072c004960 con 0x7f0734139420 2023-09-30T22:27:00.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.725+0000 7f0722ffd700 1 -- 172.21.15.40:0/3905123227 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072c020070 con 0x7f0734139420 2023-09-30T22:27:00.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.725+0000 7f0738f6e700 1 -- 172.21.15.40:0/3905123227 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f073409c9e0 con 0x7f0734139420 2023-09-30T22:27:00.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.726+0000 7f0722ffd700 1 -- 172.21.15.40:0/3905123227 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072c026650 con 0x7f0734139420 2023-09-30T22:27:00.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.726+0000 7f0738f6e700 1 -- 172.21.15.40:0/3905123227 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0734122740 con 0x7f0734139420 2023-09-30T22:27:00.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.727+0000 7f0722ffd700 1 -- 172.21.15.40:0/3905123227 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f072c012430 con 0x7f0734139420 2023-09-30T22:27:00.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.727+0000 7f0722ffd700 1 -- 172.21.15.40:0/3905123227 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f072c022070 con 0x7f0734139420 2023-09-30T22:27:00.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.727+0000 7f0738f6e700 1 -- 172.21.15.40:0/3905123227 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0734062380 con 0x7f0734139420 2023-09-30T22:27:00.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.729+0000 7fb6a8535700 1 Processor -- start 2023-09-30T22:27:00.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.729+0000 7fb6a8535700 1 -- start start 2023-09-30T22:27:00.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.729+0000 7fb6a8535700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb6a012e590 0x7fb6a012e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.729+0000 7fb6a8535700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6a012eea0 0x7fb6a012d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.729+0000 7fb6a8535700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6a009ab70 con 0x7fb6a012d6d0 2023-09-30T22:27:00.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.729+0000 7fb6a8535700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6a009b270 con 0x7fb6a012e590 2023-09-30T22:27:00.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.729+0000 7fb6a8535700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a009bab0 con 0x7fb6a012eea0 2023-09-30T22:27:00.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.730+0000 7fb6a5ad0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6a012eea0 0x7fb6a012d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:00.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.730+0000 7fb6a5ad0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6a012eea0 0x7fb6a012d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:36392/0 (socket says 172.21.15.40:36392) 2023-09-30T22:27:00.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.730+0000 7fb6a5ad0700 1 -- 172.21.15.40:0/476397492 learned_addr learned my addr 172.21.15.40:0/476397492 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:00.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.730+0000 7fb6a5ad0700 1 -- 172.21.15.40:0/476397492 >> v2:172.21.15.40:3300/0 conn(0x7fb6a012e590 msgr2=0x7fb6a012e960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:27:00.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.730+0000 7fb6a5ad0700 1 --2- 172.21.15.40:0/476397492 >> v2:172.21.15.40:3300/0 conn(0x7fb6a012e590 0x7fb6a012e960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.730+0000 7fb6a5ad0700 1 -- 172.21.15.40:0/476397492 >> v1:172.21.15.40:6789/0 conn(0x7fb6a012d6d0 legacy=0x7fb6a0137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.730+0000 7fb6a5ad0700 1 -- 172.21.15.40:0/476397492 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a009bd70 con 0x7fb6a012eea0 2023-09-30T22:27:00.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.730+0000 7fb6a5ad0700 1 --2- 172.21.15.40:0/476397492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6a012eea0 0x7fb6a012d190 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb69000de80 tx=0x7fb69000f330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a25068a610f1cc8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:00.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.730+0000 7fb6a52cf700 1 -- 172.21.15.40:0/476397492 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb690012070 con 0x7fb6a012eea0 2023-09-30T22:27:00.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.730+0000 7fb6a52cf700 1 -- 172.21.15.40:0/476397492 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69000f980 con 0x7fb6a012eea0 2023-09-30T22:27:00.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.730+0000 7fb6a52cf700 1 -- 172.21.15.40:0/476397492 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69000fd30 con 0x7fb6a012eea0 2023-09-30T22:27:00.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.731+0000 7fb6a8535700 1 -- 172.21.15.40:0/476397492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6a012eea0 msgr2=0x7fb6a012d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.731+0000 7fb6a8535700 1 --2- 172.21.15.40:0/476397492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6a012eea0 0x7fb6a012d190 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb69000de80 tx=0x7fb69000f330 comp rx=0 tx=0).stop 2023-09-30T22:27:00.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.731+0000 7fb6a8535700 1 -- 172.21.15.40:0/476397492 shutdown_connections 2023-09-30T22:27:00.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.731+0000 7fb6a8535700 1 --2- 172.21.15.40:0/476397492 >> v2:172.21.15.40:3300/0 conn(0x7fb6a012e590 0x7fb6a012e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.731+0000 7fb6a8535700 1 --2- 172.21.15.40:0/476397492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6a012eea0 0x7fb6a012d190 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.731+0000 7fb6a8535700 1 -- 172.21.15.40:0/476397492 >> 172.21.15.40:0/476397492 conn(0x7fb6a00a2a00 msgr2=0x7fb6a00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:00.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.731+0000 7fb6a8535700 1 -- 172.21.15.40:0/476397492 shutdown_connections 2023-09-30T22:27:00.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.731+0000 7fb6a8535700 1 -- 172.21.15.40:0/476397492 wait complete. 2023-09-30T22:27:00.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.732+0000 7fb6a8535700 1 Processor -- start 2023-09-30T22:27:00.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.732+0000 7fb6a8535700 1 -- start start 2023-09-30T22:27:00.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.733+0000 7fb6a8535700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6a012d6d0 0x7fb6a011abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.733+0000 7fb6a8535700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb6a012e590 0x7fb6a011b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.733+0000 7fb6a8535700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6a012eea0 0x7fb6a011b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.733+0000 7fb6a8535700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a011cd50 con 0x7fb6a012eea0 2023-09-30T22:27:00.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.733+0000 7fb6a8535700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a012ced0 con 0x7fb6a012d6d0 2023-09-30T22:27:00.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.733+0000 7fb6a8535700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a011bfa0 con 0x7fb6a012e590 2023-09-30T22:27:00.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.733+0000 7fb6a6ad2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6a012eea0 0x7fb6a011b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:00.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.733+0000 7fb6a6ad2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6a012eea0 0x7fb6a011b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36380/0 (socket says 172.21.15.40:36380) 2023-09-30T22:27:00.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.733+0000 7fb6a6ad2700 1 -- 172.21.15.40:0/3559538233 learned_addr learned my addr 172.21.15.40:0/3559538233 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:00.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.734+0000 7fb6a6ad2700 1 -- 172.21.15.40:0/3559538233 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb6a012e590 msgr2=0x7fb6a011b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.734+0000 7fb6a6ad2700 1 --2- 172.21.15.40:0/3559538233 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb6a012e590 0x7fb6a011b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.734+0000 7fb6a6ad2700 1 -- 172.21.15.40:0/3559538233 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6a012d6d0 msgr2=0x7fb6a011abb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:27:00.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.734+0000 7fb6a6ad2700 1 --2- 172.21.15.40:0/3559538233 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6a012d6d0 0x7fb6a011abb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.734+0000 7fb6a6ad2700 1 -- 172.21.15.40:0/3559538233 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb69000db30 con 0x7fb6a012eea0 2023-09-30T22:27:00.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.734+0000 7f0722ffd700 1 -- 172.21.15.40:0/3905123227 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f072c00c5f0 con 0x7f0734139420 2023-09-30T22:27:00.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.734+0000 7fb6a6ad2700 1 --2- 172.21.15.40:0/3559538233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6a012eea0 0x7fb6a011b630 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb698002230 tx=0x7fb69800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:00.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.734+0000 7fb696ffd700 1 -- 172.21.15.40:0/3559538233 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb698015e90 con 0x7fb6a012eea0 2023-09-30T22:27:00.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.734+0000 7fb696ffd700 1 -- 172.21.15.40:0/3559538233 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb698003a00 con 0x7fb6a012eea0 2023-09-30T22:27:00.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.734+0000 7fb696ffd700 1 -- 172.21.15.40:0/3559538233 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb698003d90 con 0x7fb6a012eea0 2023-09-30T22:27:00.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.735+0000 7fb6a8535700 1 -- 172.21.15.40:0/3559538233 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6a009b4b0 con 0x7fb6a012eea0 2023-09-30T22:27:00.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.735+0000 7fb6a8535700 1 -- 172.21.15.40:0/3559538233 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6a011d950 con 0x7fb6a012eea0 2023-09-30T22:27:00.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.736+0000 7fb696ffd700 1 -- 172.21.15.40:0/3559538233 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb69800a690 con 0x7fb6a012eea0 2023-09-30T22:27:00.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.736+0000 7fb696ffd700 1 -- 172.21.15.40:0/3559538233 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb698047a80 con 0x7fb6a012eea0 2023-09-30T22:27:00.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.736+0000 7fb6a8535700 1 -- 172.21.15.40:0/3559538233 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6a011e290 con 0x7fb6a012eea0 2023-09-30T22:27:00.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.745+0000 7fb696ffd700 1 -- 172.21.15.40:0/3559538233 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb698024340 con 0x7fb6a012eea0 2023-09-30T22:27:00.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.875+0000 7f9b8ce34700 1 -- 172.21.15.40:0/1447759663 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9b88074330 con 0x7f9b8812eea0 2023-09-30T22:27:00.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.875+0000 7f9b7effd700 1 -- 172.21.15.40:0/1447759663 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9b70010af0 con 0x7f9b8812eea0 2023-09-30T22:27:00.876 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:00.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.877+0000 7f9b8ce34700 1 -- 172.21.15.40:0/1447759663 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b8812eea0 msgr2=0x7f9b881c6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.877+0000 7f9b8ce34700 1 --2- 172.21.15.40:0/1447759663 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b8812eea0 0x7f9b881c6dd0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9b7000c480 tx=0x7f9b7000c840 comp rx=0 tx=0).stop 2023-09-30T22:27:00.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.878+0000 7f9b8ce34700 1 -- 172.21.15.40:0/1447759663 shutdown_connections 2023-09-30T22:27:00.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.878+0000 7f9b8ce34700 1 --2- 172.21.15.40:0/1447759663 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b8812eea0 0x7f9b881c6dd0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.878+0000 7f9b8ce34700 1 --2- 172.21.15.40:0/1447759663 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b8812d6d0 0x7f9b881c6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.878+0000 7f9b8ce34700 1 --2- 172.21.15.40:0/1447759663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b8812e590 0x7f9b881c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.878+0000 7f9b8ce34700 1 -- 172.21.15.40:0/1447759663 >> 172.21.15.40:0/1447759663 conn(0x7f9b880a2a00 msgr2=0x7f9b8809d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:00.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.878+0000 7f9b8ce34700 1 -- 172.21.15.40:0/1447759663 shutdown_connections 2023-09-30T22:27:00.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.878+0000 7f9b8ce34700 1 -- 172.21.15.40:0/1447759663 wait complete. 2023-09-30T22:27:00.891 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:00.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.916+0000 7fa1e5095700 1 -- 172.21.15.40:0/4087348404 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa1c0005590 con 0x7fa1e0130de0 2023-09-30T22:27:00.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.916+0000 7fa1c77fe700 1 -- 172.21.15.40:0/4087348404 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa1d8023030 con 0x7fa1e0130de0 2023-09-30T22:27:00.916 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:00.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.918+0000 7fa1e5095700 1 -- 172.21.15.40:0/4087348404 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa1e0130de0 msgr2=0x7fa1e011b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.918+0000 7fa1e5095700 1 --2- 172.21.15.40:0/4087348404 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa1e0130de0 0x7fa1e011b9b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0072240 tx=0x7fa1d8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.918+0000 7fa1e5095700 1 -- 172.21.15.40:0/4087348404 shutdown_connections 2023-09-30T22:27:00.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.918+0000 7fa1e5095700 1 --2- 172.21.15.40:0/4087348404 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa1e0130de0 0x7fa1e011b9b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.918+0000 7fa1e5095700 1 --2- 172.21.15.40:0/4087348404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1e009d920 0x7fa1e011af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.918+0000 7fa1e5095700 1 --2- 172.21.15.40:0/4087348404 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa1e009e230 0x7fa1e011b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.918+0000 7fa1e5095700 1 -- 172.21.15.40:0/4087348404 >> 172.21.15.40:0/4087348404 conn(0x7fa1e009fb20 msgr2=0x7fa1e012de40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:00.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.918+0000 7fa1e5095700 1 -- 172.21.15.40:0/4087348404 shutdown_connections 2023-09-30T22:27:00.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.918+0000 7fa1e5095700 1 -- 172.21.15.40:0/4087348404 wait complete. 2023-09-30T22:27:00.932 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:00.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.938+0000 7f0738f6e700 1 -- 172.21.15.40:0/3905123227 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0734074720 con 0x7f0734139420 2023-09-30T22:27:00.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.939+0000 7f0722ffd700 1 -- 172.21.15.40:0/3905123227 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f072c034090 con 0x7f0734139420 2023-09-30T22:27:00.939 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:00.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.941+0000 7f0738f6e700 1 -- 172.21.15.40:0/3905123227 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0734139420 msgr2=0x7f073411ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.941+0000 7f0738f6e700 1 --2- 172.21.15.40:0/3905123227 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0734139420 0x7f073411ed90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f072c014040 tx=0x7f072c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.941+0000 7f0738f6e700 1 -- 172.21.15.40:0/3905123227 shutdown_connections 2023-09-30T22:27:00.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.941+0000 7f0738f6e700 1 --2- 172.21.15.40:0/3905123227 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0734139420 0x7f073411ed90 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.941+0000 7f0738f6e700 1 --2- 172.21.15.40:0/3905123227 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f073409d920 0x7f07341c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.941+0000 7f0738f6e700 1 --2- 172.21.15.40:0/3905123227 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f073409e400 0x7f07341c8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.941+0000 7f0738f6e700 1 -- 172.21.15.40:0/3905123227 >> 172.21.15.40:0/3905123227 conn(0x7f073409fb20 msgr2=0x7f07341383b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:00.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.941+0000 7f0738f6e700 1 -- 172.21.15.40:0/3905123227 shutdown_connections 2023-09-30T22:27:00.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.941+0000 7f0738f6e700 1 -- 172.21.15.40:0/3905123227 wait complete. 2023-09-30T22:27:00.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.945+0000 7fb6a8535700 1 -- 172.21.15.40:0/3559538233 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb6a0071980 con 0x7fb6a012eea0 2023-09-30T22:27:00.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.946+0000 7fb696ffd700 1 -- 172.21.15.40:0/3559538233 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb69802e090 con 0x7fb6a012eea0 2023-09-30T22:27:00.946 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:00.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.948+0000 7fb6a8535700 1 -- 172.21.15.40:0/3559538233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6a012eea0 msgr2=0x7fb6a011b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.948+0000 7fb6a8535700 1 --2- 172.21.15.40:0/3559538233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6a012eea0 0x7fb6a011b630 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb698002230 tx=0x7fb69800a060 comp rx=0 tx=0).stop 2023-09-30T22:27:00.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.948+0000 7fb6a8535700 1 -- 172.21.15.40:0/3559538233 shutdown_connections 2023-09-30T22:27:00.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.948+0000 7fb6a8535700 1 --2- 172.21.15.40:0/3559538233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6a012eea0 0x7fb6a011b630 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.948+0000 7fb6a8535700 1 --2- 172.21.15.40:0/3559538233 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6a012d6d0 0x7fb6a011abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.948+0000 7fb6a8535700 1 --2- 172.21.15.40:0/3559538233 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb6a012e590 0x7fb6a011b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.948+0000 7fb6a8535700 1 -- 172.21.15.40:0/3559538233 >> 172.21.15.40:0/3559538233 conn(0x7fb6a00a2a00 msgr2=0x7fb6a009d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:00.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.948+0000 7fb6a8535700 1 -- 172.21.15.40:0/3559538233 shutdown_connections 2023-09-30T22:27:00.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:00.948+0000 7fb6a8535700 1 -- 172.21.15.40:0/3559538233 wait complete. 2023-09-30T22:27:00.955 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:00.962 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:01.892 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:01.933 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:01.956 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:01.963 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:02.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.044+0000 7f9e5cf39700 1 Processor -- start 2023-09-30T22:27:02.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.044+0000 7f9e5cf39700 1 -- start start 2023-09-30T22:27:02.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.045+0000 7f9e5cf39700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9e5809f0f0 0x7f9e58138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:02.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.045+0000 7f9e5cf39700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e5809e400 0x7f9e5813b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:02.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.045+0000 7f9e5cf39700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e5809f940 con 0x7f9e5809d920 2023-09-30T22:27:02.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.045+0000 7f9e5cf39700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e5806b4c0 con 0x7f9e5809f0f0 2023-09-30T22:27:02.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.045+0000 7f9e5cf39700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5809a8f0 con 0x7f9e5809e400 2023-09-30T22:27:02.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.045+0000 7f9e55d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9e5809f0f0 0x7f9e58138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:02.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.045+0000 7f9e56d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e5809e400 0x7f9e5813b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:02.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.045+0000 7f9e5659c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9e5809d920 0x7f9e5809dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53254/0 (socket says 172.21.15.40:53254) 2023-09-30T22:27:02.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.045+0000 7f9e56d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e5809e400 0x7f9e5813b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52102/0 (socket says 172.21.15.40:52102) 2023-09-30T22:27:02.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.045+0000 7f9e5659c700 1 -- 172.21.15.40:0/499341938 learned_addr learned my addr 172.21.15.40:0/499341938 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:27:02.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.045+0000 7f9e55d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9e5809f0f0 0x7f9e58138ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36382/0 (socket says 172.21.15.40:36382) 2023-09-30T22:27:02.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.046+0000 7f9e56d9d700 1 -- 172.21.15.40:0/499341938 >> v2:172.21.15.40:3300/0 conn(0x7f9e5809f0f0 msgr2=0x7f9e58138ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:02.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.046+0000 7f9e56d9d700 1 --2- 172.21.15.40:0/499341938 >> v2:172.21.15.40:3300/0 conn(0x7f9e5809f0f0 0x7f9e58138ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.046+0000 7f9e56d9d700 1 -- 172.21.15.40:0/499341938 >> v1:172.21.15.40:6789/0 conn(0x7f9e5809d920 legacy=0x7f9e5809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:02.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.046+0000 7f9e56d9d700 1 -- 172.21.15.40:0/499341938 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e5809f6e0 con 0x7f9e5809e400 2023-09-30T22:27:02.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.046+0000 7f9e56d9d700 1 --2- 172.21.15.40:0/499341938 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e5809e400 0x7f9e5813b430 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9e50009dc0 tx=0x7f9e5000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48e138b65120d7f6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:02.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.046+0000 7f9e5559a700 1 -- 172.21.15.40:0/499341938 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5000e070 con 0x7f9e5809e400 2023-09-30T22:27:02.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.046+0000 7f9e5559a700 1 -- 172.21.15.40:0/499341938 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e5000bae0 con 0x7f9e5809e400 2023-09-30T22:27:02.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.046+0000 7f9e5559a700 1 -- 172.21.15.40:0/499341938 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5000be90 con 0x7f9e5809e400 2023-09-30T22:27:02.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.047+0000 7f9e5cf39700 1 -- 172.21.15.40:0/499341938 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e5809e400 msgr2=0x7f9e5813b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:02.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.047+0000 7f9e5cf39700 1 --2- 172.21.15.40:0/499341938 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e5809e400 0x7f9e5813b430 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9e50009dc0 tx=0x7f9e5000b330 comp rx=0 tx=0).stop 2023-09-30T22:27:02.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.047+0000 7f9e5cf39700 1 -- 172.21.15.40:0/499341938 shutdown_connections 2023-09-30T22:27:02.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.047+0000 7f9e5cf39700 1 --2- 172.21.15.40:0/499341938 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e5809e400 0x7f9e5813b430 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.047+0000 7f9e5cf39700 1 --2- 172.21.15.40:0/499341938 >> v2:172.21.15.40:3300/0 conn(0x7f9e5809f0f0 0x7f9e58138ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.047+0000 7f9e5cf39700 1 -- 172.21.15.40:0/499341938 >> 172.21.15.40:0/499341938 conn(0x7f9e5809fb20 msgr2=0x7f9e5809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:02.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.047+0000 7f9e5cf39700 1 -- 172.21.15.40:0/499341938 shutdown_connections 2023-09-30T22:27:02.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.047+0000 7f9e5cf39700 1 -- 172.21.15.40:0/499341938 wait complete. 2023-09-30T22:27:02.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.049+0000 7f9e5cf39700 1 Processor -- start 2023-09-30T22:27:02.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.049+0000 7f9e5cf39700 1 -- start start 2023-09-30T22:27:02.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.049+0000 7f9e5cf39700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e5809d920 0x7f9e5811e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:02.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.049+0000 7f9e5cf39700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e5809e400 0x7f9e5811ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:02.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.049+0000 7f9e5cf39700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e5811f1c0 0x7f9e581ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:02.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.049+0000 7f9e5cf39700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e58121f80 con 0x7f9e5809e400 2023-09-30T22:27:02.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.049+0000 7f9e5cf39700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e58122260 con 0x7f9e5811f1c0 2023-09-30T22:27:02.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.050+0000 7f9e5cf39700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e580a31d0 con 0x7f9e5809d920 2023-09-30T22:27:02.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.050+0000 7f9e56d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e5811f1c0 0x7f9e581ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:02.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.050+0000 7f9e56d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e5811f1c0 0x7f9e581ce8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:36402/0 (socket says 172.21.15.40:36402) 2023-09-30T22:27:02.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.050+0000 7f9e56d9d700 1 -- 172.21.15.40:0/268678383 learned_addr learned my addr 172.21.15.40:0/268678383 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:02.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.050+0000 7f9e5659c700 1 --2- 172.21.15.40:0/268678383 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e5809d920 0x7f9e5811e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:02.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.050+0000 7f9e5659c700 1 -- 172.21.15.40:0/268678383 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e5811f1c0 msgr2=0x7f9e581ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:02.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.050+0000 7f9e5659c700 1 --2- 172.21.15.40:0/268678383 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e5811f1c0 0x7f9e581ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.050+0000 7f9e5659c700 1 -- 172.21.15.40:0/268678383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e5809e400 msgr2=0x7f9e5811ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:02.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.050+0000 7f9e5659c700 1 --2- 172.21.15.40:0/268678383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e5809e400 0x7f9e5811ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.050+0000 7f9e5659c700 1 -- 172.21.15.40:0/268678383 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e50009a70 con 0x7f9e5809d920 2023-09-30T22:27:02.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.050+0000 7f9e56d9d700 1 --2- 172.21.15.40:0/268678383 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e5811f1c0 0x7f9e581ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:02.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.050+0000 7f9e5659c700 1 --2- 172.21.15.40:0/268678383 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e5809d920 0x7f9e5811e740 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9e4800c500 tx=0x7f9e4800c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:02.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.051+0000 7f9e46ffd700 1 -- 172.21.15.40:0/268678383 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e480074e0 con 0x7f9e5809d920 2023-09-30T22:27:02.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.051+0000 7f9e46ffd700 1 -- 172.21.15.40:0/268678383 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e48007640 con 0x7f9e5809d920 2023-09-30T22:27:02.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.051+0000 7f9e5cf39700 1 -- 172.21.15.40:0/268678383 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e5809c9e0 con 0x7f9e5809d920 2023-09-30T22:27:02.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.051+0000 7f9e46ffd700 1 -- 172.21.15.40:0/268678383 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e48005a50 con 0x7f9e5809d920 2023-09-30T22:27:02.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.051+0000 7f9e5cf39700 1 -- 172.21.15.40:0/268678383 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e581229f0 con 0x7f9e5809d920 2023-09-30T22:27:02.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.051+0000 7f9e46ffd700 1 -- 172.21.15.40:0/268678383 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9e48005bb0 con 0x7f9e5809d920 2023-09-30T22:27:02.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.052+0000 7f9e46ffd700 1 -- 172.21.15.40:0/268678383 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9e4803eb20 con 0x7f9e5809d920 2023-09-30T22:27:02.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.052+0000 7f9e5cf39700 1 -- 172.21.15.40:0/268678383 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e58121dd0 con 0x7f9e5809d920 2023-09-30T22:27:02.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.057+0000 7f9e46ffd700 1 -- 172.21.15.40:0/268678383 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9e48017020 con 0x7f9e5809d920 2023-09-30T22:27:02.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.080+0000 7f4de4980700 1 Processor -- start 2023-09-30T22:27:02.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.081+0000 7f4de4980700 1 -- start start 2023-09-30T22:27:02.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.081+0000 7f4de4980700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4de0138250 0x7f4de0138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:02.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.081+0000 7f4de4980700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4de009d400 0x7f4de009d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:02.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.081+0000 7f4de4980700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4de009dd50 0x7f4de013f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:02.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.081+0000 7f4de4980700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4de0137e20 con 0x7f4de009dd50 2023-09-30T22:27:02.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.081+0000 7f4de4980700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de0138050 con 0x7f4de009d400 2023-09-30T22:27:02.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.081+0000 7f4de4980700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4de009b010 con 0x7f4de0138250 2023-09-30T22:27:02.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.081+0000 7f4dde59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4de0138250 0x7f4de0138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:02.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.081+0000 7f4dde59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4de0138250 0x7f4de0138620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52120/0 (socket says 172.21.15.40:52120) 2023-09-30T22:27:02.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.082+0000 7f4dde59c700 1 -- 172.21.15.40:0/1336720569 learned_addr learned my addr 172.21.15.40:0/1336720569 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:02.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.082+0000 7f4dddd9b700 1 --2- 172.21.15.40:0/1336720569 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4de009d400 0x7f4de009d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:02.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.082+0000 7f4dde59c700 1 -- 172.21.15.40:0/1336720569 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4de009d400 msgr2=0x7f4de009d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:02.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.082+0000 7f4dde59c700 1 --2- 172.21.15.40:0/1336720569 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4de009d400 0x7f4de009d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.082+0000 7f4dde59c700 1 -- 172.21.15.40:0/1336720569 >> v2:172.21.15.40:3300/0 conn(0x7f4de009dd50 msgr2=0x7f4de013f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:02.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.082+0000 7f4dde59c700 1 --2- 172.21.15.40:0/1336720569 >> v2:172.21.15.40:3300/0 conn(0x7f4de009dd50 0x7f4de013f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.082+0000 7f4dde59c700 1 -- 172.21.15.40:0/1336720569 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de009e1f0 con 0x7f4de0138250 2023-09-30T22:27:02.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.082+0000 7f4dde59c700 1 --2- 172.21.15.40:0/1336720569 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4de0138250 0x7f4de0138620 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4dd00098f0 tx=0x7f4dd0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31759d067b5a6d69 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:02.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.082+0000 7f4ddd59a700 1 -- 172.21.15.40:0/1336720569 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd0011830 con 0x7f4de0138250 2023-09-30T22:27:02.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.082+0000 7f4ddd59a700 1 -- 172.21.15.40:0/1336720569 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd0011990 con 0x7f4de0138250 2023-09-30T22:27:02.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.082+0000 7f4ddd59a700 1 -- 172.21.15.40:0/1336720569 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd0011d20 con 0x7f4de0138250 2023-09-30T22:27:02.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.083+0000 7f4de4980700 1 -- 172.21.15.40:0/1336720569 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4de0138250 msgr2=0x7f4de0138620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:02.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.083+0000 7f4de4980700 1 --2- 172.21.15.40:0/1336720569 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4de0138250 0x7f4de0138620 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4dd00098f0 tx=0x7f4dd0009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:02.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.083+0000 7f4de4980700 1 -- 172.21.15.40:0/1336720569 shutdown_connections 2023-09-30T22:27:02.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.083+0000 7f4de4980700 1 --2- 172.21.15.40:0/1336720569 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4de0138250 0x7f4de0138620 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.083+0000 7f4de4980700 1 --2- 172.21.15.40:0/1336720569 >> v2:172.21.15.40:3300/0 conn(0x7f4de009dd50 0x7f4de013f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.083+0000 7f4de4980700 1 --2- 172.21.15.40:0/1336720569 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4de009d400 0x7f4de009d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.083+0000 7f4de4980700 1 -- 172.21.15.40:0/1336720569 >> 172.21.15.40:0/1336720569 conn(0x7f4de00a2a00 msgr2=0x7f4de00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:02.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.083+0000 7f4de4980700 1 -- 172.21.15.40:0/1336720569 shutdown_connections 2023-09-30T22:27:02.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.083+0000 7f4de4980700 1 -- 172.21.15.40:0/1336720569 wait complete. 2023-09-30T22:27:02.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.084+0000 7f4de4980700 1 Processor -- start 2023-09-30T22:27:02.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.084+0000 7f4de4980700 1 -- start start 2023-09-30T22:27:02.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.085+0000 7f4de4980700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4de009d400 0x7f4de01d53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:02.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.085+0000 7f4de4980700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4de009dd50 0x7f4de01d58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:02.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.085+0000 7f4de4980700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4de0138250 0x7f4de01d5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:02.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.085+0000 7f4de4980700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de013d9f0 con 0x7f4de0138250 2023-09-30T22:27:02.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.085+0000 7f4de4980700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de013d220 con 0x7f4de009d400 2023-09-30T22:27:02.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.085+0000 7f4de4980700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4de013ed40 con 0x7f4de009dd50 2023-09-30T22:27:02.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.085+0000 7f4dde59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4de009d400 0x7f4de01d53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:02.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.085+0000 7f4dde59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4de009d400 0x7f4de01d53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:36406/0 (socket says 172.21.15.40:36406) 2023-09-30T22:27:02.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.085+0000 7f4dde59c700 1 -- 172.21.15.40:0/2447811861 learned_addr learned my addr 172.21.15.40:0/2447811861 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:02.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.085+0000 7f4dddd9b700 1 --2- 172.21.15.40:0/2447811861 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4de009dd50 0x7f4de01d58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:02.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.085+0000 7f4dded9d700 1 --2- 172.21.15.40:0/2447811861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4de0138250 0x7f4de01d5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:02.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.085+0000 7f4dde59c700 1 -- 172.21.15.40:0/2447811861 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4de009dd50 msgr2=0x7f4de01d58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:02.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.085+0000 7f4dde59c700 1 --2- 172.21.15.40:0/2447811861 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4de009dd50 0x7f4de01d58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.085+0000 7f4dde59c700 1 -- 172.21.15.40:0/2447811861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4de0138250 msgr2=0x7f4de01d5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:02.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.085+0000 7f4dde59c700 1 --2- 172.21.15.40:0/2447811861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4de0138250 0x7f4de01d5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.085+0000 7f4dde59c700 1 -- 172.21.15.40:0/2447811861 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd0009550 con 0x7f4de009d400 2023-09-30T22:27:02.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.085+0000 7f4dded9d700 1 --2- 172.21.15.40:0/2447811861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4de0138250 0x7f4de01d5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:02.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.086+0000 7f4dde59c700 1 --2- 172.21.15.40:0/2447811861 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4de009d400 0x7f4de01d53b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0009c40 tx=0x7f4dd0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:02.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.086+0000 7f4dceffd700 1 -- 172.21.15.40:0/2447811861 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd0004590 con 0x7f4de009d400 2023-09-30T22:27:02.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.086+0000 7f4dceffd700 1 -- 172.21.15.40:0/2447811861 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd00036a0 con 0x7f4de009d400 2023-09-30T22:27:02.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.086+0000 7f4de4980700 1 -- 172.21.15.40:0/2447811861 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de0136240 con 0x7f4de009d400 2023-09-30T22:27:02.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.086+0000 7f4dceffd700 1 -- 172.21.15.40:0/2447811861 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd0003a50 con 0x7f4de009d400 2023-09-30T22:27:02.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.086+0000 7f4de4980700 1 -- 172.21.15.40:0/2447811861 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de0119910 con 0x7f4de009d400 2023-09-30T22:27:02.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.087+0000 7f4dceffd700 1 -- 172.21.15.40:0/2447811861 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4dd0003bb0 con 0x7f4de009d400 2023-09-30T22:27:02.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.087+0000 7f4dceffd700 1 -- 172.21.15.40:0/2447811861 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4dd0040b60 con 0x7f4de009d400 2023-09-30T22:27:02.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.087+0000 7f4de4980700 1 -- 172.21.15.40:0/2447811861 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4de013e990 con 0x7f4de009d400 2023-09-30T22:27:02.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.092+0000 7f4dceffd700 1 -- 172.21.15.40:0/2447811861 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4dd0015080 con 0x7f4de009d400 2023-09-30T22:27:02.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.118+0000 7f782e47d700 1 Processor -- start 2023-09-30T22:27:02.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.118+0000 7f782e47d700 1 -- start start 2023-09-30T22:27:02.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.119+0000 7f782e47d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f782809d920 0x7f782809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:02.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.119+0000 7f782e47d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f782809e230 0x7f78281308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:02.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.119+0000 7f782e47d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7828130de0 0x7f7828131260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:02.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.119+0000 7f782e47d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f782809edf0 con 0x7f782809e230 2023-09-30T22:27:02.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.119+0000 7f782e47d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782809adf0 con 0x7f7828130de0 2023-09-30T22:27:02.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.119+0000 7f782e47d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f782809b660 con 0x7f782809d920 2023-09-30T22:27:02.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.119+0000 7f7827fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f782809d920 0x7f782809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:02.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.119+0000 7f7827fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f782809d920 0x7f782809dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52134/0 (socket says 172.21.15.40:52134) 2023-09-30T22:27:02.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.119+0000 7f7827fff700 1 -- 172.21.15.40:0/1583538637 learned_addr learned my addr 172.21.15.40:0/1583538637 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:02.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.119+0000 7f78277fe700 1 --2- 172.21.15.40:0/1583538637 >> v2:172.21.15.40:3300/0 conn(0x7f782809e230 0x7f78281308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:02.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.119+0000 7f782ca1a700 1 --2- 172.21.15.40:0/1583538637 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7828130de0 0x7f7828131260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:02.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.119+0000 7f78277fe700 1 -- 172.21.15.40:0/1583538637 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f782809d920 msgr2=0x7f782809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:02.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.119+0000 7f78277fe700 1 --2- 172.21.15.40:0/1583538637 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f782809d920 0x7f782809dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.119+0000 7f78277fe700 1 -- 172.21.15.40:0/1583538637 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7828130de0 msgr2=0x7f7828131260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:02.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.119+0000 7f78277fe700 1 --2- 172.21.15.40:0/1583538637 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7828130de0 0x7f7828131260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.119+0000 7f78277fe700 1 -- 172.21.15.40:0/1583538637 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782809a6e0 con 0x7f782809e230 2023-09-30T22:27:02.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.119+0000 7f7827fff700 1 --2- 172.21.15.40:0/1583538637 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f782809d920 0x7f782809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:02.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.119+0000 7f782ca1a700 1 --2- 172.21.15.40:0/1583538637 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7828130de0 0x7f7828131260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:02.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.120+0000 7f78277fe700 1 --2- 172.21.15.40:0/1583538637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f782809e230 0x7f78281308a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f781c007c00 tx=0x7f781c00f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85499733afa763a6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:02.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.120+0000 7f7826ffd700 1 -- 172.21.15.40:0/1583538637 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c012070 con 0x7f782809e230 2023-09-30T22:27:02.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.120+0000 7f7826ffd700 1 -- 172.21.15.40:0/1583538637 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781c005d10 con 0x7f782809e230 2023-09-30T22:27:02.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.120+0000 7f7826ffd700 1 -- 172.21.15.40:0/1583538637 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c00fc10 con 0x7f782809e230 2023-09-30T22:27:02.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.121+0000 7f782e47d700 1 -- 172.21.15.40:0/1583538637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f782809e230 msgr2=0x7f78281308a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:02.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.121+0000 7f782e47d700 1 --2- 172.21.15.40:0/1583538637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f782809e230 0x7f78281308a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f781c007c00 tx=0x7f781c00f330 comp rx=0 tx=0).stop 2023-09-30T22:27:02.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.121+0000 7f782e47d700 1 -- 172.21.15.40:0/1583538637 shutdown_connections 2023-09-30T22:27:02.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.121+0000 7f782e47d700 1 --2- 172.21.15.40:0/1583538637 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f782809d920 0x7f782809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.121+0000 7f782e47d700 1 --2- 172.21.15.40:0/1583538637 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7828130de0 0x7f7828131260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.121+0000 7f782e47d700 1 --2- 172.21.15.40:0/1583538637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f782809e230 0x7f78281308a0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.121+0000 7f782e47d700 1 -- 172.21.15.40:0/1583538637 >> 172.21.15.40:0/1583538637 conn(0x7f782809fb20 msgr2=0x7f782809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:02.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.121+0000 7f782e47d700 1 -- 172.21.15.40:0/1583538637 shutdown_connections 2023-09-30T22:27:02.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.121+0000 7f782e47d700 1 -- 172.21.15.40:0/1583538637 wait complete. 2023-09-30T22:27:02.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.122+0000 7f782e47d700 1 Processor -- start 2023-09-30T22:27:02.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.122+0000 7f782e47d700 1 -- start start 2023-09-30T22:27:02.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.123+0000 7f782e47d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f782809d920 0x7f782811afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:02.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.123+0000 7f782e47d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f782809e230 0x7f782811b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:02.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.123+0000 7f782e47d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7828130de0 0x7f782811ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:02.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.123+0000 7f782e47d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782811ead0 con 0x7f7828130de0 2023-09-30T22:27:02.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.123+0000 7f782e47d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782811e260 con 0x7f782809e230 2023-09-30T22:27:02.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.123+0000 7f782e47d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f782806b4a0 con 0x7f782809d920 2023-09-30T22:27:02.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.123+0000 7f7827fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f782809d920 0x7f782811afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:02.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.123+0000 7f7827fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f782809d920 0x7f782811afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52136/0 (socket says 172.21.15.40:52136) 2023-09-30T22:27:02.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.123+0000 7f7827fff700 1 -- 172.21.15.40:0/3140942976 learned_addr learned my addr 172.21.15.40:0/3140942976 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:02.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.123+0000 7f78277fe700 1 --2- 172.21.15.40:0/3140942976 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f782809e230 0x7f782811b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:02.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.123+0000 7f782ca1a700 1 --2- 172.21.15.40:0/3140942976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7828130de0 0x7f782811ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:02.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.123+0000 7f7827fff700 1 -- 172.21.15.40:0/3140942976 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f782809e230 msgr2=0x7f782811b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:02.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.123+0000 7f7827fff700 1 --2- 172.21.15.40:0/3140942976 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f782809e230 0x7f782811b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.123+0000 7f7827fff700 1 -- 172.21.15.40:0/3140942976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7828130de0 msgr2=0x7f782811ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:02.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.123+0000 7f7827fff700 1 --2- 172.21.15.40:0/3140942976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7828130de0 0x7f782811ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.123+0000 7f7827fff700 1 -- 172.21.15.40:0/3140942976 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7818009500 con 0x7f782809d920 2023-09-30T22:27:02.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.123+0000 7f78277fe700 1 --2- 172.21.15.40:0/3140942976 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f782809e230 0x7f782811b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:27:02.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.124+0000 7f7827fff700 1 --2- 172.21.15.40:0/3140942976 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f782809d920 0x7f782811afb0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f781800ebb0 tx=0x7f781800ef70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:02.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.124+0000 7f5f82ba4700 1 Processor -- start 2023-09-30T22:27:02.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.124+0000 7f7824ff9700 1 -- 172.21.15.40:0/3140942976 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7818009830 con 0x7f782809d920 2023-09-30T22:27:02.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.124+0000 7f782e47d700 1 -- 172.21.15.40:0/3140942976 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7820009a70 con 0x7f782809d920 2023-09-30T22:27:02.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.124+0000 7f5f82ba4700 1 -- start start 2023-09-30T22:27:02.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.124+0000 7f782e47d700 1 -- 172.21.15.40:0/3140942976 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f781c00dca0 con 0x7f782809d920 2023-09-30T22:27:02.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.124+0000 7f7824ff9700 1 -- 172.21.15.40:0/3140942976 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7818005a20 con 0x7f782809d920 2023-09-30T22:27:02.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.124+0000 7f7824ff9700 1 -- 172.21.15.40:0/3140942976 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7818005db0 con 0x7f782809d920 2023-09-30T22:27:02.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.124+0000 7f5f82ba4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5f7c136bf0 0x7f5f7c138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:02.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.124+0000 7f5f82ba4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f7c139510 0x7f5f7c13b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:02.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.124+0000 7f5f82ba4700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f7c0a2600 con 0x7f5f7c09c890 2023-09-30T22:27:02.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.124+0000 7f5f82ba4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f7c0a29d0 con 0x7f5f7c136bf0 2023-09-30T22:27:02.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.124+0000 7f5f82ba4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c09fb40 con 0x7f5f7c139510 2023-09-30T22:27:02.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.125+0000 7f5f7bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5f7c136bf0 0x7f5f7c138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:02.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.125+0000 7f5f7bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5f7c136bf0 0x7f5f7c138fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36432/0 (socket says 172.21.15.40:36432) 2023-09-30T22:27:02.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.125+0000 7f5f7bfff700 1 -- 172.21.15.40:0/3855406675 learned_addr learned my addr 172.21.15.40:0/3855406675 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:02.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.125+0000 7f5f81141700 1 --2- 172.21.15.40:0/3855406675 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f7c139510 0x7f5f7c13b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:02.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.125+0000 7f5f7bfff700 1 -- 172.21.15.40:0/3855406675 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f7c139510 msgr2=0x7f5f7c13b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:02.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.125+0000 7f5f7bfff700 1 --2- 172.21.15.40:0/3855406675 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f7c139510 0x7f5f7c13b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.125+0000 7f5f7bfff700 1 -- 172.21.15.40:0/3855406675 >> v1:172.21.15.40:6789/0 conn(0x7f5f7c09c890 legacy=0x7f5f7c09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:02.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.125+0000 7f5f7bfff700 1 -- 172.21.15.40:0/3855406675 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7c09d370 con 0x7f5f7c136bf0 2023-09-30T22:27:02.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.125+0000 7f5f7bfff700 1 --2- 172.21.15.40:0/3855406675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f7c136bf0 0x7f5f7c138fd0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c0098f0 tx=0x7f5f6c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15791e76af9a0b14 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:02.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.125+0000 7f7824ff9700 1 -- 172.21.15.40:0/3140942976 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f781800c850 con 0x7f782809d920 2023-09-30T22:27:02.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.125+0000 7f5f7b7fe700 1 -- 172.21.15.40:0/3855406675 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c011830 con 0x7f5f7c136bf0 2023-09-30T22:27:02.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.125+0000 7f5f7b7fe700 1 -- 172.21.15.40:0/3855406675 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6c011990 con 0x7f5f7c136bf0 2023-09-30T22:27:02.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.125+0000 7f5f7b7fe700 1 -- 172.21.15.40:0/3855406675 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c011d00 con 0x7f5f7c136bf0 2023-09-30T22:27:02.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.126+0000 7f7824ff9700 1 -- 172.21.15.40:0/3140942976 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f781803fb20 con 0x7f782809d920 2023-09-30T22:27:02.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.126+0000 7f782e47d700 1 -- 172.21.15.40:0/3140942976 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78080052e0 con 0x7f782809d920 2023-09-30T22:27:02.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.126+0000 7f5f82ba4700 1 -- 172.21.15.40:0/3855406675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f7c136bf0 msgr2=0x7f5f7c138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:02.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.126+0000 7f5f82ba4700 1 --2- 172.21.15.40:0/3855406675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f7c136bf0 0x7f5f7c138fd0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c0098f0 tx=0x7f5f6c009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:02.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.126+0000 7f5f82ba4700 1 -- 172.21.15.40:0/3855406675 shutdown_connections 2023-09-30T22:27:02.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.126+0000 7f5f82ba4700 1 --2- 172.21.15.40:0/3855406675 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f7c139510 0x7f5f7c13b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.126+0000 7f5f82ba4700 1 --2- 172.21.15.40:0/3855406675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f7c136bf0 0x7f5f7c138fd0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.126+0000 7f5f82ba4700 1 -- 172.21.15.40:0/3855406675 >> 172.21.15.40:0/3855406675 conn(0x7f5f7c0a7080 msgr2=0x7f5f7c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:02.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.127+0000 7f5f82ba4700 1 -- 172.21.15.40:0/3855406675 shutdown_connections 2023-09-30T22:27:02.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.127+0000 7f5f82ba4700 1 -- 172.21.15.40:0/3855406675 wait complete. 2023-09-30T22:27:02.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.128+0000 7f5f82ba4700 1 Processor -- start 2023-09-30T22:27:02.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.128+0000 7f5f82ba4700 1 -- start start 2023-09-30T22:27:02.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.129+0000 7f5f82ba4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f7c09c890 0x7f5f7c06eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:02.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.129+0000 7f5f82ba4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f7c136bf0 0x7f5f7c06f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:02.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.129+0000 7f5f82ba4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f7c139510 0x7f5f7c1c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:02.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.129+0000 7f5f82ba4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c1310f0 con 0x7f5f7c09c890 2023-09-30T22:27:02.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.129+0000 7f5f82ba4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c09ecf0 con 0x7f5f7c139510 2023-09-30T22:27:02.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.129+0000 7f5f82ba4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c06e6f0 con 0x7f5f7c136bf0 2023-09-30T22:27:02.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.129+0000 7f5f7bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f7c136bf0 0x7f5f7c06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:02.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.129+0000 7f5f7bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f7c136bf0 0x7f5f7c06f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52158/0 (socket says 172.21.15.40:52158) 2023-09-30T22:27:02.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.129+0000 7f5f81141700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f7c139510 0x7f5f7c1c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:02.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.129+0000 7f5f7bfff700 1 -- 172.21.15.40:0/3316999411 learned_addr learned my addr 172.21.15.40:0/3316999411 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:02.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.129+0000 7f5f80940700 1 --2- 172.21.15.40:0/3316999411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f7c09c890 0x7f5f7c06eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:02.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.129+0000 7f5f81141700 1 -- 172.21.15.40:0/3316999411 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f7c136bf0 msgr2=0x7f5f7c06f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:02.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.129+0000 7f5f81141700 1 --2- 172.21.15.40:0/3316999411 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f7c136bf0 0x7f5f7c06f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.129+0000 7f5f81141700 1 -- 172.21.15.40:0/3316999411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f7c09c890 msgr2=0x7f5f7c06eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:02.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.129+0000 7f5f81141700 1 --2- 172.21.15.40:0/3316999411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f7c09c890 0x7f5f7c06eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.129+0000 7f5f81141700 1 -- 172.21.15.40:0/3316999411 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6c009550 con 0x7f5f7c139510 2023-09-30T22:27:02.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.129+0000 7f5f80940700 1 --2- 172.21.15.40:0/3316999411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f7c09c890 0x7f5f7c06eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:02.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.130+0000 7f5f81141700 1 --2- 172.21.15.40:0/3316999411 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f7c139510 0x7f5f7c1c8700 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c068500 tx=0x7f5f7000eb30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:02.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.130+0000 7f5f797fa700 1 -- 172.21.15.40:0/3316999411 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f70013680 con 0x7f5f7c139510 2023-09-30T22:27:02.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.130+0000 7f5f797fa700 1 -- 172.21.15.40:0/3316999411 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f700137e0 con 0x7f5f7c139510 2023-09-30T22:27:02.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.130+0000 7f5f82ba4700 1 -- 172.21.15.40:0/3316999411 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f7c139190 con 0x7f5f7c139510 2023-09-30T22:27:02.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.130+0000 7f5f797fa700 1 -- 172.21.15.40:0/3316999411 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f70013b90 con 0x7f5f7c139510 2023-09-30T22:27:02.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.130+0000 7f5f82ba4700 1 -- 172.21.15.40:0/3316999411 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f7c12b890 con 0x7f5f7c139510 2023-09-30T22:27:02.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.131+0000 7f5f82ba4700 1 -- 172.21.15.40:0/3316999411 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f7c062380 con 0x7f5f7c139510 2023-09-30T22:27:02.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.131+0000 7f5f797fa700 1 -- 172.21.15.40:0/3316999411 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5f70013cf0 con 0x7f5f7c139510 2023-09-30T22:27:02.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.131+0000 7f5f797fa700 1 -- 172.21.15.40:0/3316999411 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5f7003fdf0 con 0x7f5f7c139510 2023-09-30T22:27:02.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.135+0000 7f7824ff9700 1 -- 172.21.15.40:0/3140942976 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7818006030 con 0x7f782809d920 2023-09-30T22:27:02.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.136+0000 7f5f797fa700 1 -- 172.21.15.40:0/3316999411 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5f7001ada0 con 0x7f5f7c139510 2023-09-30T22:27:02.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.261+0000 7f9e5cf39700 1 -- 172.21.15.40:0/268678383 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9e58062380 con 0x7f9e5809d920 2023-09-30T22:27:02.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.262+0000 7f9e46ffd700 1 -- 172.21.15.40:0/268678383 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9e48005e60 con 0x7f9e5809d920 2023-09-30T22:27:02.262 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:02.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.265+0000 7f9e5cf39700 1 -- 172.21.15.40:0/268678383 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e5809d920 msgr2=0x7f9e5811e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:02.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.265+0000 7f9e5cf39700 1 --2- 172.21.15.40:0/268678383 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e5809d920 0x7f9e5811e740 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9e4800c500 tx=0x7f9e4800c810 comp rx=0 tx=0).stop 2023-09-30T22:27:02.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.265+0000 7f9e5cf39700 1 -- 172.21.15.40:0/268678383 shutdown_connections 2023-09-30T22:27:02.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.265+0000 7f9e5cf39700 1 --2- 172.21.15.40:0/268678383 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e5809d920 0x7f9e5811e740 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.265+0000 7f9e5cf39700 1 --2- 172.21.15.40:0/268678383 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e5811f1c0 0x7f9e581ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.265+0000 7f9e5cf39700 1 --2- 172.21.15.40:0/268678383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e5809e400 0x7f9e5811ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.265+0000 7f9e5cf39700 1 -- 172.21.15.40:0/268678383 >> 172.21.15.40:0/268678383 conn(0x7f9e5809fb20 msgr2=0x7f9e580a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:02.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.265+0000 7f9e5cf39700 1 -- 172.21.15.40:0/268678383 shutdown_connections 2023-09-30T22:27:02.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.265+0000 7f9e5cf39700 1 -- 172.21.15.40:0/268678383 wait complete. 2023-09-30T22:27:02.278 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:02.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.300+0000 7f4de4980700 1 -- 172.21.15.40:0/2447811861 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4de0062380 con 0x7f4de009d400 2023-09-30T22:27:02.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.300+0000 7f4dceffd700 1 -- 172.21.15.40:0/2447811861 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4dd0003e60 con 0x7f4de009d400 2023-09-30T22:27:02.301 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:02.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.302+0000 7f4de4980700 1 -- 172.21.15.40:0/2447811861 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4de009d400 msgr2=0x7f4de01d53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:02.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.302+0000 7f4de4980700 1 --2- 172.21.15.40:0/2447811861 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4de009d400 0x7f4de01d53b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0009c40 tx=0x7f4dd0004750 comp rx=0 tx=0).stop 2023-09-30T22:27:02.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.302+0000 7f4de4980700 1 -- 172.21.15.40:0/2447811861 shutdown_connections 2023-09-30T22:27:02.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.302+0000 7f4de4980700 1 --2- 172.21.15.40:0/2447811861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4de0138250 0x7f4de01d5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.302+0000 7f4de4980700 1 --2- 172.21.15.40:0/2447811861 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4de009d400 0x7f4de01d53b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.302+0000 7f4de4980700 1 --2- 172.21.15.40:0/2447811861 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4de009dd50 0x7f4de01d58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.302+0000 7f4de4980700 1 -- 172.21.15.40:0/2447811861 >> 172.21.15.40:0/2447811861 conn(0x7f4de00a2a00 msgr2=0x7f4de00a1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:02.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.302+0000 7f4de4980700 1 -- 172.21.15.40:0/2447811861 shutdown_connections 2023-09-30T22:27:02.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.302+0000 7f4de4980700 1 -- 172.21.15.40:0/2447811861 wait complete. 2023-09-30T22:27:02.315 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:02.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.335+0000 7f5f82ba4700 1 -- 172.21.15.40:0/3316999411 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5f7c0a31c0 con 0x7f5f7c139510 2023-09-30T22:27:02.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.335+0000 7f5f797fa700 1 -- 172.21.15.40:0/3316999411 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5f70017070 con 0x7f5f7c139510 2023-09-30T22:27:02.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.335+0000 7f782e47d700 1 -- 172.21.15.40:0/3140942976 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7808005590 con 0x7f782809d920 2023-09-30T22:27:02.336 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:02.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.336+0000 7f7824ff9700 1 -- 172.21.15.40:0/3140942976 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7818029090 con 0x7f782809d920 2023-09-30T22:27:02.337 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:02.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.338+0000 7f5f82ba4700 1 -- 172.21.15.40:0/3316999411 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f7c139510 msgr2=0x7f5f7c1c8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:02.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.338+0000 7f5f82ba4700 1 --2- 172.21.15.40:0/3316999411 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f7c139510 0x7f5f7c1c8700 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c068500 tx=0x7f5f7000eb30 comp rx=0 tx=0).stop 2023-09-30T22:27:02.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.338+0000 7f5f82ba4700 1 -- 172.21.15.40:0/3316999411 shutdown_connections 2023-09-30T22:27:02.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.338+0000 7f5f82ba4700 1 --2- 172.21.15.40:0/3316999411 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f7c139510 0x7f5f7c1c8700 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.338+0000 7f5f82ba4700 1 --2- 172.21.15.40:0/3316999411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f7c09c890 0x7f5f7c06eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.338+0000 7f5f82ba4700 1 --2- 172.21.15.40:0/3316999411 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f7c136bf0 0x7f5f7c06f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.338+0000 7f5f82ba4700 1 -- 172.21.15.40:0/3316999411 >> 172.21.15.40:0/3316999411 conn(0x7f5f7c0a7080 msgr2=0x7f5f7c09b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:02.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.338+0000 7f5f82ba4700 1 -- 172.21.15.40:0/3316999411 shutdown_connections 2023-09-30T22:27:02.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.338+0000 7f5f82ba4700 1 -- 172.21.15.40:0/3316999411 wait complete. 2023-09-30T22:27:02.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.338+0000 7f782e47d700 1 -- 172.21.15.40:0/3140942976 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f782809d920 msgr2=0x7f782811afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:02.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.338+0000 7f782e47d700 1 --2- 172.21.15.40:0/3140942976 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f782809d920 0x7f782811afb0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f781800ebb0 tx=0x7f781800ef70 comp rx=0 tx=0).stop 2023-09-30T22:27:02.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.338+0000 7f782e47d700 1 -- 172.21.15.40:0/3140942976 shutdown_connections 2023-09-30T22:27:02.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.338+0000 7f782e47d700 1 --2- 172.21.15.40:0/3140942976 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f782809d920 0x7f782811afb0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.338+0000 7f782e47d700 1 --2- 172.21.15.40:0/3140942976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7828130de0 0x7f782811ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.338+0000 7f782e47d700 1 --2- 172.21.15.40:0/3140942976 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f782809e230 0x7f782811b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.338+0000 7f782e47d700 1 -- 172.21.15.40:0/3140942976 >> 172.21.15.40:0/3140942976 conn(0x7f782809fb20 msgr2=0x7f782812e060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:02.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.338+0000 7f782e47d700 1 -- 172.21.15.40:0/3140942976 shutdown_connections 2023-09-30T22:27:02.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:02.338+0000 7f782e47d700 1 -- 172.21.15.40:0/3140942976 wait complete. 2023-09-30T22:27:02.352 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:02.352 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:03.279 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:03.316 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:03.353 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:03.353 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:03.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.426+0000 7f9c5fd44700 1 Processor -- start 2023-09-30T22:27:03.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.427+0000 7f9c5fd44700 1 -- start start 2023-09-30T22:27:03.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.427+0000 7f9c5fd44700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c5812e590 0x7f9c5812e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.427+0000 7f9c5fd44700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9c5812d8a0 0x7f9c58138c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.427+0000 7f9c5fd44700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c5809ab70 con 0x7f9c5812eea0 2023-09-30T22:27:03.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.427+0000 7f9c5fd44700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5809b270 con 0x7f9c5812e590 2023-09-30T22:27:03.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.427+0000 7f9c5fd44700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5809bab0 con 0x7f9c5812d8a0 2023-09-30T22:27:03.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.427+0000 7f9c5d2df700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9c5812eea0 0x7f9c5812d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44792/0 (socket says 172.21.15.40:44792) 2023-09-30T22:27:03.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.428+0000 7f9c5d2df700 1 -- 172.21.15.40:0/3237031852 learned_addr learned my addr 172.21.15.40:0/3237031852 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:27:03.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.428+0000 7f9c5dae0700 1 --2- 172.21.15.40:0/3237031852 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c5812e590 0x7f9c5812e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.428+0000 7f9c5e2e1700 1 --2- 172.21.15.40:0/3237031852 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9c5812d8a0 0x7f9c58138c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.428+0000 7f9c5cade700 1 -- 172.21.15.40:0/3237031852 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1337297587 0 0) 0x7f9c5809ab70 con 0x7f9c5812eea0 2023-09-30T22:27:03.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.428+0000 7f9c5cade700 1 -- 172.21.15.40:0/3237031852 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c440035b0 con 0x7f9c5812eea0 2023-09-30T22:27:03.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.428+0000 7f9c5dae0700 1 -- 172.21.15.40:0/3237031852 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9c5812d8a0 msgr2=0x7f9c58138c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:03.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.428+0000 7f9c5dae0700 1 --2- 172.21.15.40:0/3237031852 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9c5812d8a0 0x7f9c58138c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.428+0000 7f9c5dae0700 1 -- 172.21.15.40:0/3237031852 >> v1:172.21.15.40:6789/0 conn(0x7f9c5812eea0 legacy=0x7f9c5812d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:03.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.428+0000 7f9c5dae0700 1 -- 172.21.15.40:0/3237031852 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5809bd70 con 0x7f9c5812e590 2023-09-30T22:27:03.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.428+0000 7f9c5e2e1700 1 --2- 172.21.15.40:0/3237031852 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9c5812d8a0 0x7f9c58138c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:03.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.428+0000 7f9c5dae0700 1 --2- 172.21.15.40:0/3237031852 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c5812e590 0x7f9c5812e960 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9c54009870 tx=0x7f9c54009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=951aaa203ec63362 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:03.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.429+0000 7f9c5cade700 1 -- 172.21.15.40:0/3237031852 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c54011830 con 0x7f9c5812e590 2023-09-30T22:27:03.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.429+0000 7f9c5cade700 1 -- 172.21.15.40:0/3237031852 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c54011990 con 0x7f9c5812e590 2023-09-30T22:27:03.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.429+0000 7f9c5cade700 1 -- 172.21.15.40:0/3237031852 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c54011d20 con 0x7f9c5812e590 2023-09-30T22:27:03.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.430+0000 7f9c5fd44700 1 -- 172.21.15.40:0/3237031852 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c5812e590 msgr2=0x7f9c5812e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:03.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.430+0000 7f9c5fd44700 1 --2- 172.21.15.40:0/3237031852 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c5812e590 0x7f9c5812e960 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9c54009870 tx=0x7f9c54009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:03.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.430+0000 7f9c5fd44700 1 -- 172.21.15.40:0/3237031852 shutdown_connections 2023-09-30T22:27:03.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.430+0000 7f9c5fd44700 1 --2- 172.21.15.40:0/3237031852 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9c5812d8a0 0x7f9c58138c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.430+0000 7f9c5fd44700 1 --2- 172.21.15.40:0/3237031852 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c5812e590 0x7f9c5812e960 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.430+0000 7f9c5fd44700 1 -- 172.21.15.40:0/3237031852 >> 172.21.15.40:0/3237031852 conn(0x7f9c580a2a00 msgr2=0x7f9c580a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:03.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.430+0000 7f9c5fd44700 1 -- 172.21.15.40:0/3237031852 shutdown_connections 2023-09-30T22:27:03.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.430+0000 7f9c5fd44700 1 -- 172.21.15.40:0/3237031852 wait complete. 2023-09-30T22:27:03.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.431+0000 7f9c5fd44700 1 Processor -- start 2023-09-30T22:27:03.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.431+0000 7f9c5fd44700 1 -- start start 2023-09-30T22:27:03.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.431+0000 7f9c5fd44700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c5812d8a0 0x7f9c5812cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.431+0000 7f9c5fd44700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9c5812e590 0x7f9c5812d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.431+0000 7f9c5fd44700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c5812eea0 0x7f9c581c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.431+0000 7f9c5fd44700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c581385b0 con 0x7f9c5812d8a0 2023-09-30T22:27:03.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.431+0000 7f9c5fd44700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c58139190 con 0x7f9c5812eea0 2023-09-30T22:27:03.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.431+0000 7f9c5fd44700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c581198b0 con 0x7f9c5812e590 2023-09-30T22:27:03.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.432+0000 7f9c5e2e1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c5812eea0 0x7f9c581c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.432+0000 7f9c5e2e1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c5812eea0 0x7f9c581c8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:49480/0 (socket says 172.21.15.40:49480) 2023-09-30T22:27:03.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.432+0000 7f9c5e2e1700 1 -- 172.21.15.40:0/2473826611 learned_addr learned my addr 172.21.15.40:0/2473826611 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:03.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.432+0000 7f9c5dae0700 1 --2- 172.21.15.40:0/2473826611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c5812d8a0 0x7f9c5812cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.432+0000 7f9c5d2df700 1 --2- 172.21.15.40:0/2473826611 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9c5812e590 0x7f9c5812d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.432+0000 7f9c5dae0700 1 -- 172.21.15.40:0/2473826611 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9c5812e590 msgr2=0x7f9c5812d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:03.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.432+0000 7f9c5dae0700 1 --2- 172.21.15.40:0/2473826611 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9c5812e590 0x7f9c5812d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.432+0000 7f9c5dae0700 1 -- 172.21.15.40:0/2473826611 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c5812eea0 msgr2=0x7f9c581c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:03.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.432+0000 7f9c5dae0700 1 --2- 172.21.15.40:0/2473826611 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c5812eea0 0x7f9c581c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.432+0000 7f9c5dae0700 1 -- 172.21.15.40:0/2473826611 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c50009a70 con 0x7f9c5812d8a0 2023-09-30T22:27:03.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.432+0000 7f9c5d2df700 1 --2- 172.21.15.40:0/2473826611 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9c5812e590 0x7f9c5812d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:03.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.432+0000 7f9c5e2e1700 1 --2- 172.21.15.40:0/2473826611 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c5812eea0 0x7f9c581c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:03.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.432+0000 7f9c5dae0700 1 --2- 172.21.15.40:0/2473826611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c5812d8a0 0x7f9c5812cad0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f9c54016000 tx=0x7f9c54004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:03.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.433+0000 7f9c4e7fc700 1 -- 172.21.15.40:0/2473826611 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c540042c0 con 0x7f9c5812d8a0 2023-09-30T22:27:03.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.433+0000 7f9c4e7fc700 1 -- 172.21.15.40:0/2473826611 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5401f070 con 0x7f9c5812d8a0 2023-09-30T22:27:03.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.433+0000 7f9c5fd44700 1 -- 172.21.15.40:0/2473826611 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c540094a0 con 0x7f9c5812d8a0 2023-09-30T22:27:03.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.433+0000 7f9c4e7fc700 1 -- 172.21.15.40:0/2473826611 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c540036a0 con 0x7f9c5812d8a0 2023-09-30T22:27:03.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.433+0000 7f9c5fd44700 1 -- 172.21.15.40:0/2473826611 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c5809a5e0 con 0x7f9c5812d8a0 2023-09-30T22:27:03.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.434+0000 7f9c4e7fc700 1 -- 172.21.15.40:0/2473826611 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9c54021030 con 0x7f9c5812d8a0 2023-09-30T22:27:03.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.434+0000 7f9c4e7fc700 1 -- 172.21.15.40:0/2473826611 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9c54040750 con 0x7f9c5812d8a0 2023-09-30T22:27:03.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.434+0000 7f9c5fd44700 1 -- 172.21.15.40:0/2473826611 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c58062380 con 0x7f9c5812d8a0 2023-09-30T22:27:03.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.439+0000 7f9c4e7fc700 1 -- 172.21.15.40:0/2473826611 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9c54015070 con 0x7f9c5812d8a0 2023-09-30T22:27:03.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.471+0000 7f313e15c700 1 Processor -- start 2023-09-30T22:27:03.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.471+0000 7f313e15c700 1 -- start start 2023-09-30T22:27:03.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.471+0000 7f313e15c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3138138250 0x7f3138138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.471+0000 7f313e15c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f313809d400 0x7f313809d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.471+0000 7f313e15c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3138137e20 con 0x7f313809dd50 2023-09-30T22:27:03.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.471+0000 7f313e15c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3138138050 con 0x7f3138138250 2023-09-30T22:27:03.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.471+0000 7f313e15c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f313809b010 con 0x7f313809d400 2023-09-30T22:27:03.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.471+0000 7f3137fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f313809dd50 0x7f313813f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44802/0 (socket says 172.21.15.40:44802) 2023-09-30T22:27:03.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.471+0000 7f3137fff700 1 -- 172.21.15.40:0/4142672998 learned_addr learned my addr 172.21.15.40:0/4142672998 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:27:03.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.471+0000 7f3136ffd700 1 --2- 172.21.15.40:0/4142672998 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f313809d400 0x7f313809d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.472+0000 7f31377fe700 1 --2- 172.21.15.40:0/4142672998 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3138138250 0x7f3138138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.472+0000 7f31377fe700 1 -- 172.21.15.40:0/4142672998 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f313809d400 msgr2=0x7f313809d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:03.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.472+0000 7f31377fe700 1 --2- 172.21.15.40:0/4142672998 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f313809d400 0x7f313809d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.472+0000 7f31377fe700 1 -- 172.21.15.40:0/4142672998 >> v1:172.21.15.40:6789/0 conn(0x7f313809dd50 legacy=0x7f313813f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:03.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.472+0000 7f31367fc700 1 -- 172.21.15.40:0/4142672998 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1405946967 0 0) 0x7f3138137e20 con 0x7f313809dd50 2023-09-30T22:27:03.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.472+0000 7f31377fe700 1 -- 172.21.15.40:0/4142672998 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f313809e1f0 con 0x7f3138138250 2023-09-30T22:27:03.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.472+0000 7f31377fe700 1 --2- 172.21.15.40:0/4142672998 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3138138250 0x7f3138138620 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3128009870 tx=0x7f3128009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40b1f095c18d54ac server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:03.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.472+0000 7f31367fc700 1 -- 172.21.15.40:0/4142672998 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3128011830 con 0x7f3138138250 2023-09-30T22:27:03.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.472+0000 7f31367fc700 1 -- 172.21.15.40:0/4142672998 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3128011990 con 0x7f3138138250 2023-09-30T22:27:03.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.472+0000 7f31367fc700 1 -- 172.21.15.40:0/4142672998 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3128011d20 con 0x7f3138138250 2023-09-30T22:27:03.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.473+0000 7f313e15c700 1 -- 172.21.15.40:0/4142672998 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3138138250 msgr2=0x7f3138138620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:03.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.473+0000 7f313e15c700 1 --2- 172.21.15.40:0/4142672998 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3138138250 0x7f3138138620 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3128009870 tx=0x7f3128009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:03.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.473+0000 7f313e15c700 1 -- 172.21.15.40:0/4142672998 shutdown_connections 2023-09-30T22:27:03.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.473+0000 7f313e15c700 1 --2- 172.21.15.40:0/4142672998 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3138138250 0x7f3138138620 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.473+0000 7f313e15c700 1 --2- 172.21.15.40:0/4142672998 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f313809d400 0x7f313809d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.473+0000 7f313e15c700 1 -- 172.21.15.40:0/4142672998 >> 172.21.15.40:0/4142672998 conn(0x7f31380a2a00 msgr2=0x7f31380a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:03.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.473+0000 7f313e15c700 1 -- 172.21.15.40:0/4142672998 shutdown_connections 2023-09-30T22:27:03.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.473+0000 7f313e15c700 1 -- 172.21.15.40:0/4142672998 wait complete. 2023-09-30T22:27:03.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.475+0000 7f313e15c700 1 Processor -- start 2023-09-30T22:27:03.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.475+0000 7f313e15c700 1 -- start start 2023-09-30T22:27:03.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.476+0000 7f313e15c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f313809d400 0x7f313813f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.476+0000 7f313e15c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f313809dd50 0x7f313813fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.476+0000 7f313e15c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3138138250 0x7f31381400a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.476+0000 7f313e15c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f313813df70 con 0x7f313809d400 2023-09-30T22:27:03.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.476+0000 7f313e15c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f313813e4a0 con 0x7f3138138250 2023-09-30T22:27:03.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.476+0000 7f313e15c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f313813e760 con 0x7f313809dd50 2023-09-30T22:27:03.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.476+0000 7f31377fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f313809d400 0x7f313813f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.476+0000 7f3136ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f313809dd50 0x7f313813fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.476+0000 7f31377fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f313809d400 0x7f313813f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41808/0 (socket says 172.21.15.40:41808) 2023-09-30T22:27:03.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.476+0000 7f31377fe700 1 -- 172.21.15.40:0/291280977 learned_addr learned my addr 172.21.15.40:0/291280977 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:03.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.476+0000 7f3137fff700 1 --2- 172.21.15.40:0/291280977 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3138138250 0x7f31381400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.476+0000 7f3136ffd700 1 -- 172.21.15.40:0/291280977 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3138138250 msgr2=0x7f31381400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:03.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.476+0000 7f3136ffd700 1 --2- 172.21.15.40:0/291280977 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3138138250 0x7f31381400a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.476+0000 7f3136ffd700 1 -- 172.21.15.40:0/291280977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f313809d400 msgr2=0x7f313813f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:03.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.476+0000 7f3136ffd700 1 --2- 172.21.15.40:0/291280977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f313809d400 0x7f313813f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.476+0000 7f3136ffd700 1 -- 172.21.15.40:0/291280977 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31280094a0 con 0x7f313809dd50 2023-09-30T22:27:03.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.476+0000 7f3137fff700 1 --2- 172.21.15.40:0/291280977 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3138138250 0x7f31381400a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:03.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.477+0000 7f3136ffd700 1 --2- 172.21.15.40:0/291280977 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f313809dd50 0x7f313813fb60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f312c00e8d0 tx=0x7f312c00ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:03.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.477+0000 7f311ffff700 1 -- 172.21.15.40:0/291280977 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312c013680 con 0x7f313809dd50 2023-09-30T22:27:03.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.477+0000 7f311ffff700 1 -- 172.21.15.40:0/291280977 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f312c0137e0 con 0x7f313809dd50 2023-09-30T22:27:03.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.477+0000 7f311ffff700 1 -- 172.21.15.40:0/291280977 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312c013b50 con 0x7f313809dd50 2023-09-30T22:27:03.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.478+0000 7f313e15c700 1 -- 172.21.15.40:0/291280977 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f313813e1a0 con 0x7f313809dd50 2023-09-30T22:27:03.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.478+0000 7f313e15c700 1 -- 172.21.15.40:0/291280977 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f313813f1d0 con 0x7f313809dd50 2023-09-30T22:27:03.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.479+0000 7f311ffff700 1 -- 172.21.15.40:0/291280977 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f312c013cb0 con 0x7f313809dd50 2023-09-30T22:27:03.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.479+0000 7f311ffff700 1 -- 172.21.15.40:0/291280977 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f312c03f680 con 0x7f313809dd50 2023-09-30T22:27:03.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.479+0000 7f313e15c700 1 -- 172.21.15.40:0/291280977 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3138062380 con 0x7f313809dd50 2023-09-30T22:27:03.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.484+0000 7f311ffff700 1 -- 172.21.15.40:0/291280977 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f312c01bde0 con 0x7f313809dd50 2023-09-30T22:27:03.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.506+0000 7fb3e2631700 1 Processor -- start 2023-09-30T22:27:03.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.507+0000 7fb3e2631700 1 -- start start 2023-09-30T22:27:03.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.507+0000 7fb3e2631700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb3dc06c990 0x7fb3dc06cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.507+0000 7fb3e2631700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb3dc13dad0 0x7fb3dc13feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.507+0000 7fb3e2631700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3dc06df30 con 0x7fb3dc06d2a0 2023-09-30T22:27:03.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.507+0000 7fb3e2631700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3dc06ec40 con 0x7fb3dc06c990 2023-09-30T22:27:03.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.507+0000 7fb3e2631700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc06ea40 con 0x7fb3dc13dad0 2023-09-30T22:27:03.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.507+0000 7fb3dbfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb3dc06c990 0x7fb3dc06cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.507+0000 7fb3dbfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb3dc06c990 0x7fb3dc06cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41818/0 (socket says 172.21.15.40:41818) 2023-09-30T22:27:03.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.507+0000 7fb3dbfff700 1 -- 172.21.15.40:0/2414449723 learned_addr learned my addr 172.21.15.40:0/2414449723 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:03.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.507+0000 7fb3e0bce700 1 --2- 172.21.15.40:0/2414449723 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb3dc13dad0 0x7fb3dc13feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.508+0000 7fb3dbfff700 1 -- 172.21.15.40:0/2414449723 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb3dc13dad0 msgr2=0x7fb3dc13feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:03.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.508+0000 7fb3dbfff700 1 --2- 172.21.15.40:0/2414449723 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb3dc13dad0 0x7fb3dc13feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.508+0000 7fb3daffd700 1 -- 172.21.15.40:0/2414449723 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4097305897 0 0) 0x7fb3dc06df30 con 0x7fb3dc06d2a0 2023-09-30T22:27:03.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.508+0000 7fb3dbfff700 1 -- 172.21.15.40:0/2414449723 >> v1:172.21.15.40:6789/0 conn(0x7fb3dc06d2a0 legacy=0x7fb3dc13c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:03.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.508+0000 7fb3dbfff700 1 -- 172.21.15.40:0/2414449723 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3dc072050 con 0x7fb3dc06c990 2023-09-30T22:27:03.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.508+0000 7fb3dbfff700 1 --2- 172.21.15.40:0/2414449723 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3dc06c990 0x7fb3dc06cd60 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc0098f0 tx=0x7fb3cc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267bf994908f158 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:03.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.508+0000 7fb3daffd700 1 -- 172.21.15.40:0/2414449723 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc011830 con 0x7fb3dc06c990 2023-09-30T22:27:03.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.508+0000 7fb3daffd700 1 -- 172.21.15.40:0/2414449723 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3cc011990 con 0x7fb3dc06c990 2023-09-30T22:27:03.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.508+0000 7fb3daffd700 1 -- 172.21.15.40:0/2414449723 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc011d20 con 0x7fb3dc06c990 2023-09-30T22:27:03.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.508+0000 7f23d5a2e700 1 Processor -- start 2023-09-30T22:27:03.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.508+0000 7f23d5a2e700 1 -- start start 2023-09-30T22:27:03.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.509+0000 7fb3e2631700 1 -- 172.21.15.40:0/2414449723 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3dc06c990 msgr2=0x7fb3dc06cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:03.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.509+0000 7fb3e2631700 1 --2- 172.21.15.40:0/2414449723 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3dc06c990 0x7fb3dc06cd60 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc0098f0 tx=0x7fb3cc009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:03.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.509+0000 7fb3e2631700 1 -- 172.21.15.40:0/2414449723 shutdown_connections 2023-09-30T22:27:03.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.509+0000 7fb3e2631700 1 --2- 172.21.15.40:0/2414449723 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb3dc13dad0 0x7fb3dc13feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.509+0000 7fb3e2631700 1 --2- 172.21.15.40:0/2414449723 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3dc06c990 0x7fb3dc06cd60 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.509+0000 7fb3e2631700 1 -- 172.21.15.40:0/2414449723 >> 172.21.15.40:0/2414449723 conn(0x7fb3dc0a41a0 msgr2=0x7fb3dc0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:03.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.509+0000 7fb3e2631700 1 -- 172.21.15.40:0/2414449723 shutdown_connections 2023-09-30T22:27:03.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.509+0000 7f23d5a2e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23d009da20 0x7f23d0130160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.509+0000 7f23d5a2e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f23d0131380 0x7f23d0131820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.509+0000 7f23d5a2e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d009a630 con 0x7f23d009ddf0 2023-09-30T22:27:03.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.509+0000 7f23d5a2e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d009a950 con 0x7f23d0131380 2023-09-30T22:27:03.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.509+0000 7f23d5a2e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d009ba50 con 0x7f23d009da20 2023-09-30T22:27:03.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.509+0000 7fb3e2631700 1 -- 172.21.15.40:0/2414449723 wait complete. 2023-09-30T22:27:03.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.509+0000 7f23ceffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23d009da20 0x7f23d0130160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.509+0000 7f23ceffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23d009da20 0x7f23d0130160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:49510/0 (socket says 172.21.15.40:49510) 2023-09-30T22:27:03.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.509+0000 7f23ceffd700 1 -- 172.21.15.40:0/1417718904 learned_addr learned my addr 172.21.15.40:0/1417718904 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:03.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.510+0000 7f23cf7fe700 1 --2- 172.21.15.40:0/1417718904 >> v2:172.21.15.40:3300/0 conn(0x7f23d0131380 0x7f23d0131820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.510+0000 7f23ceffd700 1 -- 172.21.15.40:0/1417718904 >> v2:172.21.15.40:3300/0 conn(0x7f23d0131380 msgr2=0x7f23d0131820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:03.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.510+0000 7f23ceffd700 1 --2- 172.21.15.40:0/1417718904 >> v2:172.21.15.40:3300/0 conn(0x7f23d0131380 0x7f23d0131820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.510+0000 7f23ceffd700 1 -- 172.21.15.40:0/1417718904 >> v1:172.21.15.40:6789/0 conn(0x7f23d009ddf0 legacy=0x7f23d01306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:03.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.510+0000 7f23ceffd700 1 -- 172.21.15.40:0/1417718904 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d009b7a0 con 0x7f23d009da20 2023-09-30T22:27:03.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.510+0000 7f23ceffd700 1 --2- 172.21.15.40:0/1417718904 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23d009da20 0x7f23d0130160 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f23c0009ea0 tx=0x7f23c000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71c1420c46ab3a0b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:03.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.510+0000 7fb3e2631700 1 Processor -- start 2023-09-30T22:27:03.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.510+0000 7f23cdffb700 1 -- 172.21.15.40:0/1417718904 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c000e070 con 0x7f23d009da20 2023-09-30T22:27:03.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.510+0000 7f23cdffb700 1 -- 172.21.15.40:0/1417718904 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c000b9c0 con 0x7f23d009da20 2023-09-30T22:27:03.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.510+0000 7f23cdffb700 1 -- 172.21.15.40:0/1417718904 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c000bd70 con 0x7f23d009da20 2023-09-30T22:27:03.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.511+0000 7fb3e2631700 1 -- start start 2023-09-30T22:27:03.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.511+0000 7fb3e2631700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb3dc06c990 0x7fb3dc138390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.511+0000 7fb3e2631700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb3dc06d2a0 0x7fb3dc1388d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.511+0000 7fb3e2631700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3dc13dad0 0x7fb3dc138e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.511+0000 7fb3e2631700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc08e750 con 0x7fb3dc13dad0 2023-09-30T22:27:03.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.511+0000 7fb3e2631700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc0a0850 con 0x7fb3dc06d2a0 2023-09-30T22:27:03.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.511+0000 7fb3e2631700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc08c9e0 con 0x7fb3dc06c990 2023-09-30T22:27:03.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.511+0000 7f23d5a2e700 1 -- 172.21.15.40:0/1417718904 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23d009da20 msgr2=0x7f23d0130160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:03.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.511+0000 7f23d5a2e700 1 --2- 172.21.15.40:0/1417718904 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23d009da20 0x7f23d0130160 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f23c0009ea0 tx=0x7f23c000b330 comp rx=0 tx=0).stop 2023-09-30T22:27:03.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.511+0000 7fb3db7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb3dc06d2a0 0x7fb3dc1388d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.511+0000 7fb3db7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb3dc06d2a0 0x7fb3dc1388d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:49512/0 (socket says 172.21.15.40:49512) 2023-09-30T22:27:03.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.511+0000 7fb3db7fe700 1 -- 172.21.15.40:0/2872241764 learned_addr learned my addr 172.21.15.40:0/2872241764 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:03.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.511+0000 7fb3e0bce700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3dc13dad0 0x7fb3dc138e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.511+0000 7f23d5a2e700 1 -- 172.21.15.40:0/1417718904 shutdown_connections 2023-09-30T22:27:03.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.511+0000 7f23d5a2e700 1 --2- 172.21.15.40:0/1417718904 >> v2:172.21.15.40:3300/0 conn(0x7f23d0131380 0x7f23d0131820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.511+0000 7f23d5a2e700 1 --2- 172.21.15.40:0/1417718904 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23d009da20 0x7f23d0130160 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.511+0000 7f23d5a2e700 1 -- 172.21.15.40:0/1417718904 >> 172.21.15.40:0/1417718904 conn(0x7f23d009eb10 msgr2=0x7f23d009ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:03.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.511+0000 7fb3dbfff700 1 --2- 172.21.15.40:0/2872241764 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb3dc06c990 0x7fb3dc138390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.512+0000 7f23d5a2e700 1 -- 172.21.15.40:0/1417718904 shutdown_connections 2023-09-30T22:27:03.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.512+0000 7f23d5a2e700 1 -- 172.21.15.40:0/1417718904 wait complete. 2023-09-30T22:27:03.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.512+0000 7fb3db7fe700 1 -- 172.21.15.40:0/2872241764 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb3dc06c990 msgr2=0x7fb3dc138390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:03.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.512+0000 7fb3db7fe700 1 --2- 172.21.15.40:0/2872241764 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb3dc06c990 0x7fb3dc138390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.512+0000 7fb3db7fe700 1 -- 172.21.15.40:0/2872241764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3dc13dad0 msgr2=0x7fb3dc138e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:03.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.512+0000 7fb3db7fe700 1 --2- 172.21.15.40:0/2872241764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3dc13dad0 0x7fb3dc138e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.512+0000 7fb3db7fe700 1 -- 172.21.15.40:0/2872241764 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3cc009550 con 0x7fb3dc06d2a0 2023-09-30T22:27:03.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.512+0000 7fb3e0bce700 1 --2- 172.21.15.40:0/2872241764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3dc13dad0 0x7fb3dc138e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:03.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.512+0000 7fb3db7fe700 1 --2- 172.21.15.40:0/2872241764 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb3dc06d2a0 0x7fb3dc1388d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0001eb0 tx=0x7fb3d000c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:03.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.512+0000 7fb3d8ff9700 1 -- 172.21.15.40:0/2872241764 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d00054e0 con 0x7fb3dc06d2a0 2023-09-30T22:27:03.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.512+0000 7fb3e2631700 1 -- 172.21.15.40:0/2872241764 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3dc06f5a0 con 0x7fb3dc06d2a0 2023-09-30T22:27:03.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.512+0000 7fb3e2631700 1 -- 172.21.15.40:0/2872241764 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3dc08b2c0 con 0x7fb3dc06d2a0 2023-09-30T22:27:03.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.513+0000 7fb3d8ff9700 1 -- 172.21.15.40:0/2872241764 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d0003680 con 0x7fb3dc06d2a0 2023-09-30T22:27:03.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.513+0000 7fb3d8ff9700 1 -- 172.21.15.40:0/2872241764 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d00039f0 con 0x7fb3dc06d2a0 2023-09-30T22:27:03.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.513+0000 7f23d5a2e700 1 Processor -- start 2023-09-30T22:27:03.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.513+0000 7fb3d8ff9700 1 -- 172.21.15.40:0/2872241764 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb3d0003b50 con 0x7fb3dc06d2a0 2023-09-30T22:27:03.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.513+0000 7f23d5a2e700 1 -- start start 2023-09-30T22:27:03.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.514+0000 7fb3e2631700 1 -- 172.21.15.40:0/2872241764 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3bc0052e0 con 0x7fb3dc06d2a0 2023-09-30T22:27:03.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.514+0000 7f23d5a2e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f23d009da20 0x7f23d01344a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.514+0000 7f23d5a2e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23d009ddf0 0x7f23d01349e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.514+0000 7fb3d8ff9700 1 -- 172.21.15.40:0/2872241764 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb3d001ac80 con 0x7fb3dc06d2a0 2023-09-30T22:27:03.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.514+0000 7f23d5a2e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23d0131380 0x7f23d0134f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.514+0000 7f23d5a2e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d0093fe0 con 0x7f23d0131380 2023-09-30T22:27:03.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.514+0000 7f23d5a2e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d0136480 con 0x7f23d009ddf0 2023-09-30T22:27:03.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.514+0000 7f23d5a2e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23d0094a10 con 0x7f23d009da20 2023-09-30T22:27:03.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.514+0000 7f23cf7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23d0131380 0x7f23d0134f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.514+0000 7f23cf7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23d0131380 0x7f23d0134f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41848/0 (socket says 172.21.15.40:41848) 2023-09-30T22:27:03.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.514+0000 7f23cf7fe700 1 -- 172.21.15.40:0/3710204798 learned_addr learned my addr 172.21.15.40:0/3710204798 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:03.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.515+0000 7f23cf7fe700 1 -- 172.21.15.40:0/3710204798 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f23d009da20 msgr2=0x7f23d01344a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:03.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.515+0000 7f23cf7fe700 1 --2- 172.21.15.40:0/3710204798 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f23d009da20 0x7f23d01344a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.515+0000 7f23cf7fe700 1 -- 172.21.15.40:0/3710204798 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23d009ddf0 msgr2=0x7f23d01349e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-30T22:27:03.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.515+0000 7f23cf7fe700 1 --2- 172.21.15.40:0/3710204798 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23d009ddf0 0x7f23d01349e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.515+0000 7f23cf7fe700 1 -- 172.21.15.40:0/3710204798 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c0009b30 con 0x7f23d0131380 2023-09-30T22:27:03.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.515+0000 7f23cf7fe700 1 --2- 172.21.15.40:0/3710204798 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23d0131380 0x7f23d0134f20 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f23c800e810 tx=0x7f23c800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:03.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.515+0000 7f23c7fff700 1 -- 172.21.15.40:0/3710204798 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c8013610 con 0x7f23d0131380 2023-09-30T22:27:03.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.515+0000 7f23c7fff700 1 -- 172.21.15.40:0/3710204798 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c8013770 con 0x7f23d0131380 2023-09-30T22:27:03.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.515+0000 7f23c7fff700 1 -- 172.21.15.40:0/3710204798 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c8013b20 con 0x7f23d0131380 2023-09-30T22:27:03.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.515+0000 7f23d5a2e700 1 -- 172.21.15.40:0/3710204798 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d0135f70 con 0x7f23d0131380 2023-09-30T22:27:03.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.515+0000 7f23d5a2e700 1 -- 172.21.15.40:0/3710204798 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d012fce0 con 0x7f23d0131380 2023-09-30T22:27:03.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.516+0000 7f23c7fff700 1 -- 172.21.15.40:0/3710204798 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f23c8013c80 con 0x7f23d0131380 2023-09-30T22:27:03.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.516+0000 7f23d5a2e700 1 -- 172.21.15.40:0/3710204798 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23b40052e0 con 0x7f23d0131380 2023-09-30T22:27:03.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.517+0000 7f23c7fff700 1 -- 172.21.15.40:0/3710204798 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f23c803f4a0 con 0x7f23d0131380 2023-09-30T22:27:03.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.521+0000 7f23c7fff700 1 -- 172.21.15.40:0/3710204798 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f23c8012370 con 0x7f23d0131380 2023-09-30T22:27:03.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.523+0000 7fb3d8ff9700 1 -- 172.21.15.40:0/2872241764 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb3d0017070 con 0x7fb3dc06d2a0 2023-09-30T22:27:03.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.664+0000 7f9c5fd44700 1 -- 172.21.15.40:0/2473826611 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9c58138850 con 0x7f9c5812d8a0 2023-09-30T22:27:03.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.665+0000 7f9c4e7fc700 1 -- 172.21.15.40:0/2473826611 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9c540239c0 con 0x7f9c5812d8a0 2023-09-30T22:27:03.666 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:03.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.667+0000 7f9c5fd44700 1 -- 172.21.15.40:0/2473826611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c5812d8a0 msgr2=0x7f9c5812cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:03.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.667+0000 7f9c5fd44700 1 --2- 172.21.15.40:0/2473826611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c5812d8a0 0x7f9c5812cad0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f9c54016000 tx=0x7f9c54004750 comp rx=0 tx=0).stop 2023-09-30T22:27:03.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.667+0000 7f9c5fd44700 1 -- 172.21.15.40:0/2473826611 shutdown_connections 2023-09-30T22:27:03.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.667+0000 7f9c5fd44700 1 --2- 172.21.15.40:0/2473826611 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c5812eea0 0x7f9c581c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.667+0000 7f9c5fd44700 1 --2- 172.21.15.40:0/2473826611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c5812d8a0 0x7f9c5812cad0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.667+0000 7f9c5fd44700 1 --2- 172.21.15.40:0/2473826611 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9c5812e590 0x7f9c5812d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.667+0000 7f9c5fd44700 1 -- 172.21.15.40:0/2473826611 >> 172.21.15.40:0/2473826611 conn(0x7f9c580a2a00 msgr2=0x7f9c58130d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:03.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.667+0000 7f9c5fd44700 1 -- 172.21.15.40:0/2473826611 shutdown_connections 2023-09-30T22:27:03.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.667+0000 7f9c5fd44700 1 -- 172.21.15.40:0/2473826611 wait complete. 2023-09-30T22:27:03.680 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:03.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.689+0000 7f313e15c700 1 -- 172.21.15.40:0/291280977 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f313809abb0 con 0x7f313809dd50 2023-09-30T22:27:03.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.690+0000 7f311ffff700 1 -- 172.21.15.40:0/291280977 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f312c01b3b0 con 0x7f313809dd50 2023-09-30T22:27:03.690 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:03.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.691+0000 7f313e15c700 1 -- 172.21.15.40:0/291280977 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f313809dd50 msgr2=0x7f313813fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:03.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.691+0000 7f313e15c700 1 --2- 172.21.15.40:0/291280977 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f313809dd50 0x7f313813fb60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f312c00e8d0 tx=0x7f312c00ebe0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.692+0000 7f313e15c700 1 -- 172.21.15.40:0/291280977 shutdown_connections 2023-09-30T22:27:03.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.692+0000 7f313e15c700 1 --2- 172.21.15.40:0/291280977 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3138138250 0x7f31381400a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.692+0000 7f313e15c700 1 --2- 172.21.15.40:0/291280977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f313809d400 0x7f313813f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.692+0000 7f313e15c700 1 --2- 172.21.15.40:0/291280977 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f313809dd50 0x7f313813fb60 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.692+0000 7f313e15c700 1 -- 172.21.15.40:0/291280977 >> 172.21.15.40:0/291280977 conn(0x7f31380a2a00 msgr2=0x7f313809f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:03.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.692+0000 7f313e15c700 1 -- 172.21.15.40:0/291280977 shutdown_connections 2023-09-30T22:27:03.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.692+0000 7f313e15c700 1 -- 172.21.15.40:0/291280977 wait complete. 2023-09-30T22:27:03.705 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:03.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.732+0000 7fb3e2631700 1 -- 172.21.15.40:0/2872241764 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb3bc005590 con 0x7fb3dc06d2a0 2023-09-30T22:27:03.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.732+0000 7fb3d8ff9700 1 -- 172.21.15.40:0/2872241764 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb3d001b3b0 con 0x7fb3dc06d2a0 2023-09-30T22:27:03.733 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:03.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.734+0000 7fb3e2631700 1 -- 172.21.15.40:0/2872241764 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb3dc06d2a0 msgr2=0x7fb3dc1388d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:03.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.734+0000 7fb3e2631700 1 --2- 172.21.15.40:0/2872241764 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb3dc06d2a0 0x7fb3dc1388d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0001eb0 tx=0x7fb3d000c800 comp rx=0 tx=0).stop 2023-09-30T22:27:03.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.734+0000 7fb3e2631700 1 -- 172.21.15.40:0/2872241764 shutdown_connections 2023-09-30T22:27:03.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.734+0000 7fb3e2631700 1 --2- 172.21.15.40:0/2872241764 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb3dc06c990 0x7fb3dc138390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.734+0000 7fb3e2631700 1 --2- 172.21.15.40:0/2872241764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3dc13dad0 0x7fb3dc138e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.734+0000 7fb3e2631700 1 --2- 172.21.15.40:0/2872241764 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb3dc06d2a0 0x7fb3dc1388d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.734+0000 7fb3e2631700 1 -- 172.21.15.40:0/2872241764 >> 172.21.15.40:0/2872241764 conn(0x7fb3dc0a41a0 msgr2=0x7fb3dc13b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:03.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.735+0000 7fb3e2631700 1 -- 172.21.15.40:0/2872241764 shutdown_connections 2023-09-30T22:27:03.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.735+0000 7fb3e2631700 1 -- 172.21.15.40:0/2872241764 wait complete. 2023-09-30T22:27:03.748 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:03.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.754+0000 7f23d5a2e700 1 -- 172.21.15.40:0/3710204798 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f23b4005150 con 0x7f23d0131380 2023-09-30T22:27:03.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.754+0000 7f23c7fff700 1 -- 172.21.15.40:0/3710204798 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f23c8021070 con 0x7f23d0131380 2023-09-30T22:27:03.755 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:03.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.756+0000 7f23d5a2e700 1 -- 172.21.15.40:0/3710204798 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23d0131380 msgr2=0x7f23d0134f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:03.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.756+0000 7f23d5a2e700 1 --2- 172.21.15.40:0/3710204798 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23d0131380 0x7f23d0134f20 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f23c800e810 tx=0x7f23c800ebd0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.756+0000 7f23d5a2e700 1 -- 172.21.15.40:0/3710204798 shutdown_connections 2023-09-30T22:27:03.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.756+0000 7f23d5a2e700 1 --2- 172.21.15.40:0/3710204798 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f23d009da20 0x7f23d01344a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.756+0000 7f23d5a2e700 1 --2- 172.21.15.40:0/3710204798 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23d0131380 0x7f23d0134f20 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.756+0000 7f23d5a2e700 1 --2- 172.21.15.40:0/3710204798 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23d009ddf0 0x7f23d01349e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.756+0000 7f23d5a2e700 1 -- 172.21.15.40:0/3710204798 >> 172.21.15.40:0/3710204798 conn(0x7f23d009eb10 msgr2=0x7f23d0099410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:03.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.756+0000 7f23d5a2e700 1 -- 172.21.15.40:0/3710204798 shutdown_connections 2023-09-30T22:27:03.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:03.756+0000 7f23d5a2e700 1 -- 172.21.15.40:0/3710204798 wait complete. 2023-09-30T22:27:03.769 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:04.681 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:04.705 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:04.749 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:04.770 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:04.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.831+0000 7f6718292700 1 Processor -- start 2023-09-30T22:27:04.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.831+0000 7f6718292700 1 -- start start 2023-09-30T22:27:04.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.832+0000 7f6718292700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6710133e00 0x7f67101341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.832+0000 7f6718292700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f671009df70 0x7f671013bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.832+0000 7f6718292700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6710133940 con 0x7f671009d400 2023-09-30T22:27:04.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.832+0000 7f6718292700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f671009ab20 con 0x7f6710133e00 2023-09-30T22:27:04.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.832+0000 7f6718292700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f671009f0d0 con 0x7f671009df70 2023-09-30T22:27:04.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.832+0000 7f671602e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6710133e00 0x7f67101341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.832+0000 7f671602e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6710133e00 0x7f67101341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41860/0 (socket says 172.21.15.40:41860) 2023-09-30T22:27:04.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.832+0000 7f671602e700 1 -- 172.21.15.40:0/1980296319 learned_addr learned my addr 172.21.15.40:0/1980296319 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:04.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.832+0000 7f671602e700 1 -- 172.21.15.40:0/1980296319 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f671009df70 msgr2=0x7f671013bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:04.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.832+0000 7f671602e700 1 --2- 172.21.15.40:0/1980296319 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f671009df70 0x7f671013bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.832+0000 7f671602e700 1 -- 172.21.15.40:0/1980296319 >> v1:172.21.15.40:6789/0 conn(0x7f671009d400 legacy=0x7f671009d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:04.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.832+0000 7f671602e700 1 -- 172.21.15.40:0/1980296319 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6710133be0 con 0x7f6710133e00 2023-09-30T22:27:04.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.833+0000 7f671602e700 1 --2- 172.21.15.40:0/1980296319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6710133e00 0x7f67101341d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f670c009e50 tx=0x7f670c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34be384015c5bbe6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:04.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.833+0000 7f671502c700 1 -- 172.21.15.40:0/1980296319 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c00e070 con 0x7f6710133e00 2023-09-30T22:27:04.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.833+0000 7f671502c700 1 -- 172.21.15.40:0/1980296319 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670c00b9c0 con 0x7f6710133e00 2023-09-30T22:27:04.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.833+0000 7f671502c700 1 -- 172.21.15.40:0/1980296319 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c00bd70 con 0x7f6710133e00 2023-09-30T22:27:04.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.833+0000 7f6718292700 1 -- 172.21.15.40:0/1980296319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6710133e00 msgr2=0x7f67101341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:04.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.833+0000 7f6718292700 1 --2- 172.21.15.40:0/1980296319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6710133e00 0x7f67101341d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f670c009e50 tx=0x7f670c00b330 comp rx=0 tx=0).stop 2023-09-30T22:27:04.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.834+0000 7f6718292700 1 -- 172.21.15.40:0/1980296319 shutdown_connections 2023-09-30T22:27:04.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.834+0000 7f6718292700 1 --2- 172.21.15.40:0/1980296319 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f671009df70 0x7f671013bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.834+0000 7f6718292700 1 --2- 172.21.15.40:0/1980296319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6710133e00 0x7f67101341d0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.834+0000 7f6718292700 1 -- 172.21.15.40:0/1980296319 >> 172.21.15.40:0/1980296319 conn(0x7f67100a2a00 msgr2=0x7f67100a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:04.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.834+0000 7f6718292700 1 -- 172.21.15.40:0/1980296319 shutdown_connections 2023-09-30T22:27:04.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.834+0000 7f6718292700 1 -- 172.21.15.40:0/1980296319 wait complete. 2023-09-30T22:27:04.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.835+0000 7f6718292700 1 Processor -- start 2023-09-30T22:27:04.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.835+0000 7f6718292700 1 -- start start 2023-09-30T22:27:04.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.835+0000 7f6718292700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f671009d400 0x7f6710119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.835+0000 7f6718292700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f671009df70 0x7f6710119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.835+0000 7f6718292700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6710133e00 0x7f6710119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.835+0000 7f6718292700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671011a4d0 con 0x7f671009d400 2023-09-30T22:27:04.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.835+0000 7f6718292700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f671011cd80 con 0x7f671009df70 2023-09-30T22:27:04.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.835+0000 7f6718292700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f671011aad0 con 0x7f6710133e00 2023-09-30T22:27:04.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.835+0000 7f671602e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f671009d400 0x7f6710119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.835+0000 7f671602e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f671009d400 0x7f6710119050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41868/0 (socket says 172.21.15.40:41868) 2023-09-30T22:27:04.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.835+0000 7f671602e700 1 -- 172.21.15.40:0/3968495579 learned_addr learned my addr 172.21.15.40:0/3968495579 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:04.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.835+0000 7f671682f700 1 --2- 172.21.15.40:0/3968495579 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6710133e00 0x7f6710119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.835+0000 7f671582d700 1 --2- 172.21.15.40:0/3968495579 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f671009df70 0x7f6710119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.836+0000 7f671602e700 1 -- 172.21.15.40:0/3968495579 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6710133e00 msgr2=0x7f6710119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:04.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.836+0000 7f671602e700 1 --2- 172.21.15.40:0/3968495579 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6710133e00 0x7f6710119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.836+0000 7f671602e700 1 -- 172.21.15.40:0/3968495579 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f671009df70 msgr2=0x7f6710119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:04.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.836+0000 7f671602e700 1 --2- 172.21.15.40:0/3968495579 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f671009df70 0x7f6710119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.836+0000 7f671602e700 1 -- 172.21.15.40:0/3968495579 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670c009b30 con 0x7f671009d400 2023-09-30T22:27:04.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.836+0000 7f671602e700 1 --2- 172.21.15.40:0/3968495579 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f671009d400 0x7f6710119050 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f670c00b730 tx=0x7f670c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:04.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.836+0000 7f6706ffd700 1 -- 172.21.15.40:0/3968495579 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c0048b0 con 0x7f671009d400 2023-09-30T22:27:04.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.836+0000 7f6706ffd700 1 -- 172.21.15.40:0/3968495579 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670c0092e0 con 0x7f671009d400 2023-09-30T22:27:04.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.836+0000 7f6706ffd700 1 -- 172.21.15.40:0/3968495579 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c01c680 con 0x7f671009d400 2023-09-30T22:27:04.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.836+0000 7f6718292700 1 -- 172.21.15.40:0/3968495579 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f671011be20 con 0x7f671009d400 2023-09-30T22:27:04.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.836+0000 7f6718292700 1 -- 172.21.15.40:0/3968495579 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f671011b700 con 0x7f671009d400 2023-09-30T22:27:04.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.837+0000 7f6706ffd700 1 -- 172.21.15.40:0/3968495579 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f670c01c7e0 con 0x7f671009d400 2023-09-30T22:27:04.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.837+0000 7f6706ffd700 1 -- 172.21.15.40:0/3968495579 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f670c041340 con 0x7f671009d400 2023-09-30T22:27:04.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.838+0000 7f6718292700 1 -- 172.21.15.40:0/3968495579 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6710062380 con 0x7f671009d400 2023-09-30T22:27:04.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.844+0000 7f6706ffd700 1 -- 172.21.15.40:0/3968495579 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f670c0257d0 con 0x7f671009d400 2023-09-30T22:27:04.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.867+0000 7fc981a4f700 1 Processor -- start 2023-09-30T22:27:04.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.868+0000 7fc981a4f700 1 -- start start 2023-09-30T22:27:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.868+0000 7fc981a4f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc97c09e400 0x7fc97c135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.868+0000 7fc981a4f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc97c136230 0x7fc97c138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.868+0000 7fc981a4f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc97c09adf0 con 0x7fc97c09d920 2023-09-30T22:27:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.868+0000 7fc981a4f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc97c09e7f0 con 0x7fc97c136230 2023-09-30T22:27:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.868+0000 7fc981a4f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c09edf0 con 0x7fc97c09e400 2023-09-30T22:27:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.868+0000 7fc97affd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc97c09d920 0x7fc97c09dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44858/0 (socket says 172.21.15.40:44858) 2023-09-30T22:27:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.868+0000 7fc97affd700 1 -- 172.21.15.40:0/4171039678 learned_addr learned my addr 172.21.15.40:0/4171039678 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:27:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.868+0000 7fc97a7fc700 1 --2- 172.21.15.40:0/4171039678 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc97c09e400 0x7fc97c135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.868+0000 7fc97b7fe700 1 --2- 172.21.15.40:0/4171039678 >> v2:172.21.15.40:3300/0 conn(0x7fc97c136230 0x7fc97c138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.869+0000 7fc97a7fc700 1 -- 172.21.15.40:0/4171039678 >> v2:172.21.15.40:3300/0 conn(0x7fc97c136230 msgr2=0x7fc97c138610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:04.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.869+0000 7fc97a7fc700 1 --2- 172.21.15.40:0/4171039678 >> v2:172.21.15.40:3300/0 conn(0x7fc97c136230 0x7fc97c138610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.869+0000 7fc97a7fc700 1 -- 172.21.15.40:0/4171039678 >> v1:172.21.15.40:6789/0 conn(0x7fc97c09d920 legacy=0x7fc97c09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:04.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.869+0000 7fc97a7fc700 1 -- 172.21.15.40:0/4171039678 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc97c09b660 con 0x7fc97c09e400 2023-09-30T22:27:04.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.869+0000 7fc97a7fc700 1 --2- 172.21.15.40:0/4171039678 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc97c09e400 0x7fc97c135cf0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc970009840 tx=0x7fc970009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5673551e01e653f2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:04.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.869+0000 7fc979ffb700 1 -- 172.21.15.40:0/4171039678 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc970011830 con 0x7fc97c09e400 2023-09-30T22:27:04.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.869+0000 7fc979ffb700 1 -- 172.21.15.40:0/4171039678 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc970011990 con 0x7fc97c09e400 2023-09-30T22:27:04.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.869+0000 7fc979ffb700 1 -- 172.21.15.40:0/4171039678 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc970011d00 con 0x7fc97c09e400 2023-09-30T22:27:04.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.870+0000 7fc981a4f700 1 -- 172.21.15.40:0/4171039678 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc97c09e400 msgr2=0x7fc97c135cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:04.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.870+0000 7fc981a4f700 1 --2- 172.21.15.40:0/4171039678 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc97c09e400 0x7fc97c135cf0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc970009840 tx=0x7fc970009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:04.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.870+0000 7fc981a4f700 1 -- 172.21.15.40:0/4171039678 shutdown_connections 2023-09-30T22:27:04.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.870+0000 7fc981a4f700 1 --2- 172.21.15.40:0/4171039678 >> v2:172.21.15.40:3300/0 conn(0x7fc97c136230 0x7fc97c138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.870+0000 7fc981a4f700 1 --2- 172.21.15.40:0/4171039678 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc97c09e400 0x7fc97c135cf0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.870+0000 7fc981a4f700 1 -- 172.21.15.40:0/4171039678 >> 172.21.15.40:0/4171039678 conn(0x7fc97c09fb20 msgr2=0x7fc97c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:04.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.870+0000 7fc981a4f700 1 -- 172.21.15.40:0/4171039678 shutdown_connections 2023-09-30T22:27:04.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.870+0000 7fc981a4f700 1 -- 172.21.15.40:0/4171039678 wait complete. 2023-09-30T22:27:04.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.871+0000 7fc981a4f700 1 Processor -- start 2023-09-30T22:27:04.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.871+0000 7fc981a4f700 1 -- start start 2023-09-30T22:27:04.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.872+0000 7fc981a4f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc97c09d920 0x7fc97c1c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.872+0000 7fc981a4f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc97c09e400 0x7fc97c1c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.872+0000 7fc981a4f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc97c136230 0x7fc97c1229c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.872+0000 7fc981a4f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c1247c0 con 0x7fc97c09d920 2023-09-30T22:27:04.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.872+0000 7fc981a4f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c1245d0 con 0x7fc97c09e400 2023-09-30T22:27:04.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.872+0000 7fc981a4f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c135330 con 0x7fc97c136230 2023-09-30T22:27:04.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.872+0000 7fc97affd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc97c09d920 0x7fc97c1c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.872+0000 7fc97affd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc97c09d920 0x7fc97c1c8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41886/0 (socket says 172.21.15.40:41886) 2023-09-30T22:27:04.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.872+0000 7fc97affd700 1 -- 172.21.15.40:0/1109479558 learned_addr learned my addr 172.21.15.40:0/1109479558 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:04.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.872+0000 7fc97a7fc700 1 --2- 172.21.15.40:0/1109479558 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc97c09e400 0x7fc97c1c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.872+0000 7fc97b7fe700 1 --2- 172.21.15.40:0/1109479558 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc97c136230 0x7fc97c1229c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.872+0000 7fc97a7fc700 1 -- 172.21.15.40:0/1109479558 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc97c136230 msgr2=0x7fc97c1229c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:04.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.872+0000 7fc97a7fc700 1 --2- 172.21.15.40:0/1109479558 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc97c136230 0x7fc97c1229c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.872+0000 7fc97a7fc700 1 -- 172.21.15.40:0/1109479558 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc97c09d920 msgr2=0x7fc97c1c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:04.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.872+0000 7fc97a7fc700 1 --2- 172.21.15.40:0/1109479558 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc97c09d920 0x7fc97c1c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.872+0000 7fc97a7fc700 1 -- 172.21.15.40:0/1109479558 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9700094a0 con 0x7fc97c09e400 2023-09-30T22:27:04.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.873+0000 7fc97a7fc700 1 --2- 172.21.15.40:0/1109479558 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc97c09e400 0x7fc97c1c8dc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc970016000 tx=0x7fc970004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:04.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.873+0000 7fc963fff700 1 -- 172.21.15.40:0/1109479558 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9700036a0 con 0x7fc97c09e400 2023-09-30T22:27:04.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.873+0000 7fc963fff700 1 -- 172.21.15.40:0/1109479558 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97001f070 con 0x7fc97c09e400 2023-09-30T22:27:04.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.873+0000 7fc963fff700 1 -- 172.21.15.40:0/1109479558 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc970003a80 con 0x7fc97c09e400 2023-09-30T22:27:04.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.873+0000 7fc981a4f700 1 -- 172.21.15.40:0/1109479558 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc97c0a3e40 con 0x7fc97c09e400 2023-09-30T22:27:04.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.873+0000 7fc981a4f700 1 -- 172.21.15.40:0/1109479558 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc97c09cb00 con 0x7fc97c09e400 2023-09-30T22:27:04.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.874+0000 7fc981a4f700 1 -- 172.21.15.40:0/1109479558 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc97c125ea0 con 0x7fc97c09e400 2023-09-30T22:27:04.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.874+0000 7fc963fff700 1 -- 172.21.15.40:0/1109479558 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc970003be0 con 0x7fc97c09e400 2023-09-30T22:27:04.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.874+0000 7fc963fff700 1 -- 172.21.15.40:0/1109479558 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc970021070 con 0x7fc97c09e400 2023-09-30T22:27:04.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.883+0000 7fc963fff700 1 -- 172.21.15.40:0/1109479558 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc97c125ea0 con 0x7fc97c09e400 2023-09-30T22:27:04.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.919+0000 7fd721ad2700 1 Processor -- start 2023-09-30T22:27:04.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.919+0000 7fd721ad2700 1 -- start start 2023-09-30T22:27:04.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.920+0000 7fd721ad2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd71c06f070 0x7fd71c06f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.920+0000 7fd721ad2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd71c06f980 0x7fd71c097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.920+0000 7fd721ad2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd71c070830 con 0x7fd71c06fdb0 2023-09-30T22:27:04.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.920+0000 7fd721ad2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd71c071af0 con 0x7fd71c06f070 2023-09-30T22:27:04.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.920+0000 7fd721ad2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c070ad0 con 0x7fd71c06f980 2023-09-30T22:27:04.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.920+0000 7fd71b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd71c06f070 0x7fd71c06f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.920+0000 7fd71affd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd71c06f980 0x7fd71c097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.920+0000 7fd71b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd71c06f070 0x7fd71c06f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41902/0 (socket says 172.21.15.40:41902) 2023-09-30T22:27:04.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.920+0000 7fd71affd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd71c06f980 0x7fd71c097090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52694/0 (socket says 172.21.15.40:52694) 2023-09-30T22:27:04.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.920+0000 7fd71b7fe700 1 -- 172.21.15.40:0/3632711814 learned_addr learned my addr 172.21.15.40:0/3632711814 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:04.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.921+0000 7fd71b7fe700 1 -- 172.21.15.40:0/3632711814 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd71c06f980 msgr2=0x7fd71c097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:04.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.921+0000 7fd71a7fc700 1 -- 172.21.15.40:0/3632711814 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1870806122 0 0) 0x7fd71c070830 con 0x7fd71c06fdb0 2023-09-30T22:27:04.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.921+0000 7fd71b7fe700 1 --2- 172.21.15.40:0/3632711814 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd71c06f980 0x7fd71c097090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.921+0000 7fd71b7fe700 1 -- 172.21.15.40:0/3632711814 >> v1:172.21.15.40:6789/0 conn(0x7fd71c06fdb0 legacy=0x7fd71c0975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:04.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.921+0000 7fd71b7fe700 1 -- 172.21.15.40:0/3632711814 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71c070de0 con 0x7fd71c06f070 2023-09-30T22:27:04.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.921+0000 7fd71affd700 1 --2- 172.21.15.40:0/3632711814 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd71c06f980 0x7fd71c097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:04.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.921+0000 7fd71b7fe700 1 --2- 172.21.15.40:0/3632711814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd71c06f070 0x7fd71c06f440 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fd70c0098f0 tx=0x7fd70c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8af7023c91bf31a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:04.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.921+0000 7fd71a7fc700 1 -- 172.21.15.40:0/3632711814 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c011830 con 0x7fd71c06f070 2023-09-30T22:27:04.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.921+0000 7fd71a7fc700 1 -- 172.21.15.40:0/3632711814 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70c011990 con 0x7fd71c06f070 2023-09-30T22:27:04.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.921+0000 7fd71a7fc700 1 -- 172.21.15.40:0/3632711814 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c011d20 con 0x7fd71c06f070 2023-09-30T22:27:04.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.922+0000 7fd721ad2700 1 -- 172.21.15.40:0/3632711814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd71c06f070 msgr2=0x7fd71c06f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:04.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.922+0000 7fd721ad2700 1 --2- 172.21.15.40:0/3632711814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd71c06f070 0x7fd71c06f440 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fd70c0098f0 tx=0x7fd70c009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:04.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.922+0000 7fd721ad2700 1 -- 172.21.15.40:0/3632711814 shutdown_connections 2023-09-30T22:27:04.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.922+0000 7fd721ad2700 1 --2- 172.21.15.40:0/3632711814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd71c06f070 0x7fd71c06f440 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.922+0000 7fd721ad2700 1 --2- 172.21.15.40:0/3632711814 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd71c06f980 0x7fd71c097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.922+0000 7fd721ad2700 1 -- 172.21.15.40:0/3632711814 >> 172.21.15.40:0/3632711814 conn(0x7fd71c0a41a0 msgr2=0x7fd71c0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:04.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.922+0000 7fd721ad2700 1 -- 172.21.15.40:0/3632711814 shutdown_connections 2023-09-30T22:27:04.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.922+0000 7fd721ad2700 1 -- 172.21.15.40:0/3632711814 wait complete. 2023-09-30T22:27:04.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.924+0000 7fd721ad2700 1 Processor -- start 2023-09-30T22:27:04.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.924+0000 7fd721ad2700 1 -- start start 2023-09-30T22:27:04.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.925+0000 7fd721ad2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd71c06f070 0x7fd71c09d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.925+0000 7fd721ad2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd71c06f980 0x7fd71c09de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.925+0000 7fd721ad2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd71c06fdb0 0x7fd71c1c3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.925+0000 7fd721ad2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c09af90 con 0x7fd71c06f070 2023-09-30T22:27:04.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.925+0000 7fd721ad2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c12d7e0 con 0x7fd71c06f980 2023-09-30T22:27:04.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.925+0000 7fd721ad2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c12c2d0 con 0x7fd71c06fdb0 2023-09-30T22:27:04.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.925+0000 7fd71bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd71c06fdb0 0x7fd71c1c3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.925+0000 7fd71bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd71c06fdb0 0x7fd71c1c3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52706/0 (socket says 172.21.15.40:52706) 2023-09-30T22:27:04.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.925+0000 7fd71bfff700 1 -- 172.21.15.40:0/3370450812 learned_addr learned my addr 172.21.15.40:0/3370450812 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:04.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.925+0000 7fd71b7fe700 1 --2- 172.21.15.40:0/3370450812 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd71c06f070 0x7fd71c09d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.925+0000 7fd71affd700 1 --2- 172.21.15.40:0/3370450812 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd71c06f980 0x7fd71c09de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.925+0000 7fd71bfff700 1 -- 172.21.15.40:0/3370450812 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd71c06f980 msgr2=0x7fd71c09de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:04.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.925+0000 7fd71bfff700 1 --2- 172.21.15.40:0/3370450812 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd71c06f980 0x7fd71c09de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.925+0000 7fd71bfff700 1 -- 172.21.15.40:0/3370450812 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd71c06f070 msgr2=0x7fd71c09d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:04.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.925+0000 7fd71bfff700 1 --2- 172.21.15.40:0/3370450812 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd71c06f070 0x7fd71c09d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.925+0000 7fd71bfff700 1 -- 172.21.15.40:0/3370450812 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71000d940 con 0x7fd71c06fdb0 2023-09-30T22:27:04.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.925+0000 7fd71b7fe700 1 --2- 172.21.15.40:0/3370450812 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd71c06f070 0x7fd71c09d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:04.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.925+0000 7fd71bfff700 1 --2- 172.21.15.40:0/3370450812 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd71c06fdb0 0x7fd71c1c3ce0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd714001560 tx=0x7fd71400cb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:04.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.926+0000 7fd703fff700 1 -- 172.21.15.40:0/3370450812 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd714003e30 con 0x7fd71c06fdb0 2023-09-30T22:27:04.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.926+0000 7fd703fff700 1 -- 172.21.15.40:0/3370450812 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd714005070 con 0x7fd71c06fdb0 2023-09-30T22:27:04.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.926+0000 7fd721ad2700 1 -- 172.21.15.40:0/3370450812 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd70c009550 con 0x7fd71c06fdb0 2023-09-30T22:27:04.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.926+0000 7fd703fff700 1 -- 172.21.15.40:0/3370450812 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd714005420 con 0x7fd71c06fdb0 2023-09-30T22:27:04.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.926+0000 7fd721ad2700 1 -- 172.21.15.40:0/3370450812 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd71c12c7b0 con 0x7fd71c06fdb0 2023-09-30T22:27:04.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.927+0000 7fd703fff700 1 -- 172.21.15.40:0/3370450812 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd714005580 con 0x7fd71c06fdb0 2023-09-30T22:27:04.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.927+0000 7fd703fff700 1 -- 172.21.15.40:0/3370450812 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd71403ed50 con 0x7fd71c06fdb0 2023-09-30T22:27:04.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.927+0000 7fd721ad2700 1 -- 172.21.15.40:0/3370450812 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd71c12e190 con 0x7fd71c06fdb0 2023-09-30T22:27:04.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.932+0000 7fd703fff700 1 -- 172.21.15.40:0/3370450812 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd714017020 con 0x7fd71c06fdb0 2023-09-30T22:27:04.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.952+0000 7f6110c49700 1 Processor -- start 2023-09-30T22:27:04.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.952+0000 7f6110c49700 1 -- start start 2023-09-30T22:27:04.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.952+0000 7f6110c49700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f610c06a6d0 0x7f610c09d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.952+0000 7f6110c49700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f610c09de60 0x7f610c09e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.952+0000 7f6110c49700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f610c09e790 con 0x7f610c13c490 2023-09-30T22:27:04.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.952+0000 7f6110c49700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610c06aaa0 con 0x7f610c06a6d0 2023-09-30T22:27:04.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.952+0000 7f6110c49700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f610c11d980 con 0x7f610c09de60 2023-09-30T22:27:04.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.953+0000 7f610ad9d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f610c13c490 0x7f610c13e870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44874/0 (socket says 172.21.15.40:44874) 2023-09-30T22:27:04.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.953+0000 7f610ad9d700 1 -- 172.21.15.40:0/3868045579 learned_addr learned my addr 172.21.15.40:0/3868045579 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:27:04.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.953+0000 7f610a59c700 1 --2- 172.21.15.40:0/3868045579 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f610c06a6d0 0x7f610c09d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.953+0000 7f610959a700 1 -- 172.21.15.40:0/3868045579 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3684286424 0 0) 0x7f6104001490 con 0x7f610c13c490 2023-09-30T22:27:04.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.953+0000 7f610959a700 1 -- 172.21.15.40:0/3868045579 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60f40035b0 con 0x7f610c13c490 2023-09-30T22:27:04.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.953+0000 7f610a59c700 1 -- 172.21.15.40:0/3868045579 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f610c09de60 msgr2=0x7f610c09e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:04.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.953+0000 7f610a59c700 1 --2- 172.21.15.40:0/3868045579 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f610c09de60 0x7f610c09e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.953+0000 7f610a59c700 1 -- 172.21.15.40:0/3868045579 >> v1:172.21.15.40:6789/0 conn(0x7f610c13c490 legacy=0x7f610c13e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:04.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.953+0000 7f610a59c700 1 -- 172.21.15.40:0/3868045579 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610c06b150 con 0x7f610c06a6d0 2023-09-30T22:27:04.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.953+0000 7f610a59c700 1 --2- 172.21.15.40:0/3868045579 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f610c06a6d0 0x7f610c09d920 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f60fc009880 tx=0x7f60fc009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6ab7297493612fb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:04.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.953+0000 7f610959a700 1 -- 172.21.15.40:0/3868045579 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc005e30 con 0x7f610c06a6d0 2023-09-30T22:27:04.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.954+0000 7f610959a700 1 -- 172.21.15.40:0/3868045579 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60fc006030 con 0x7f610c06a6d0 2023-09-30T22:27:04.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.954+0000 7f610959a700 1 -- 172.21.15.40:0/3868045579 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc0063c0 con 0x7f610c06a6d0 2023-09-30T22:27:04.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.954+0000 7f6110c49700 1 -- 172.21.15.40:0/3868045579 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f610c06a6d0 msgr2=0x7f610c09d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:04.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.954+0000 7f6110c49700 1 --2- 172.21.15.40:0/3868045579 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f610c06a6d0 0x7f610c09d920 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f60fc009880 tx=0x7f60fc009b90 comp rx=0 tx=0).stop 2023-09-30T22:27:04.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.954+0000 7f6110c49700 1 -- 172.21.15.40:0/3868045579 shutdown_connections 2023-09-30T22:27:04.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.954+0000 7f6110c49700 1 --2- 172.21.15.40:0/3868045579 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f610c06a6d0 0x7f610c09d920 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.954+0000 7f6110c49700 1 --2- 172.21.15.40:0/3868045579 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f610c09de60 0x7f610c09e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.954+0000 7f6110c49700 1 -- 172.21.15.40:0/3868045579 >> 172.21.15.40:0/3868045579 conn(0x7f610c09fb20 msgr2=0x7f610c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:04.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.954+0000 7f6110c49700 1 -- 172.21.15.40:0/3868045579 shutdown_connections 2023-09-30T22:27:04.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.954+0000 7f6110c49700 1 -- 172.21.15.40:0/3868045579 wait complete. 2023-09-30T22:27:04.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.955+0000 7f6110c49700 1 Processor -- start 2023-09-30T22:27:04.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.956+0000 7f6110c49700 1 -- start start 2023-09-30T22:27:04.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.956+0000 7f6110c49700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f610c06a6d0 0x7f610c127330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.956+0000 7f6110c49700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f610c09de60 0x7f610c127870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.956+0000 7f6110c49700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f610c13c490 0x7f610c1cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.956+0000 7f6110c49700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c13b410 con 0x7f610c09de60 2023-09-30T22:27:04.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.956+0000 7f6110c49700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610c09f5b0 con 0x7f610c06a6d0 2023-09-30T22:27:04.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.956+0000 7f6110c49700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f610c0a2e50 con 0x7f610c13c490 2023-09-30T22:27:04.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.956+0000 7f610a59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f610c06a6d0 0x7f610c127330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.956+0000 7f610a59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f610c06a6d0 0x7f610c127330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:49578/0 (socket says 172.21.15.40:49578) 2023-09-30T22:27:04.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.956+0000 7f610a59c700 1 -- 172.21.15.40:0/3109008602 learned_addr learned my addr 172.21.15.40:0/3109008602 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:04.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.956+0000 7f6109d9b700 1 --2- 172.21.15.40:0/3109008602 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f610c09de60 0x7f610c127870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.957+0000 7f6109d9b700 1 -- 172.21.15.40:0/3109008602 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f610c13c490 msgr2=0x7f610c1cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:04.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.957+0000 7f6109d9b700 1 --2- 172.21.15.40:0/3109008602 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f610c13c490 0x7f610c1cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.957+0000 7f6109d9b700 1 -- 172.21.15.40:0/3109008602 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f610c06a6d0 msgr2=0x7f610c127330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:04.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.957+0000 7f6109d9b700 1 --2- 172.21.15.40:0/3109008602 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f610c06a6d0 0x7f610c127330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.957+0000 7f6109d9b700 1 -- 172.21.15.40:0/3109008602 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60fc009430 con 0x7f610c09de60 2023-09-30T22:27:04.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.957+0000 7f610a59c700 1 --2- 172.21.15.40:0/3109008602 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f610c06a6d0 0x7f610c127330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:04.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.957+0000 7f6109d9b700 1 --2- 172.21.15.40:0/3109008602 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f610c09de60 0x7f610c127870 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f610c072b10 tx=0x7f610000b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:04.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.957+0000 7f60faffd700 1 -- 172.21.15.40:0/3109008602 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6100011830 con 0x7f610c09de60 2023-09-30T22:27:04.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.957+0000 7f60faffd700 1 -- 172.21.15.40:0/3109008602 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6100011990 con 0x7f610c09de60 2023-09-30T22:27:04.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.957+0000 7f6110c49700 1 -- 172.21.15.40:0/3109008602 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f610c128a20 con 0x7f610c09de60 2023-09-30T22:27:04.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.957+0000 7f60faffd700 1 -- 172.21.15.40:0/3109008602 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6100011d40 con 0x7f610c09de60 2023-09-30T22:27:04.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.957+0000 7f6110c49700 1 -- 172.21.15.40:0/3109008602 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f610c128c50 con 0x7f610c09de60 2023-09-30T22:27:04.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.958+0000 7f60faffd700 1 -- 172.21.15.40:0/3109008602 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f610001a400 con 0x7f610c09de60 2023-09-30T22:27:04.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.958+0000 7f6110c49700 1 -- 172.21.15.40:0/3109008602 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f610c062380 con 0x7f610c09de60 2023-09-30T22:27:04.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.958+0000 7f60faffd700 1 -- 172.21.15.40:0/3109008602 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f610003f5f0 con 0x7f610c09de60 2023-09-30T22:27:04.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:04.963+0000 7f60faffd700 1 -- 172.21.15.40:0/3109008602 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f610000f2e0 con 0x7f610c09de60 2023-09-30T22:27:05.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.090+0000 7f6718292700 1 -- 172.21.15.40:0/3968495579 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f671011c1a0 con 0x7f671009d400 2023-09-30T22:27:05.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.091+0000 7f6706ffd700 1 -- 172.21.15.40:0/3968495579 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f670c034090 con 0x7f671009d400 2023-09-30T22:27:05.092 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:05.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.093+0000 7f6718292700 1 -- 172.21.15.40:0/3968495579 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f671009d400 msgr2=0x7f6710119050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:05.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.093+0000 7f6718292700 1 --2- 172.21.15.40:0/3968495579 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f671009d400 0x7f6710119050 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f670c00b730 tx=0x7f670c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:27:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.093+0000 7f6718292700 1 -- 172.21.15.40:0/3968495579 shutdown_connections 2023-09-30T22:27:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.093+0000 7f6718292700 1 --2- 172.21.15.40:0/3968495579 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6710133e00 0x7f6710119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.093+0000 7f6718292700 1 --2- 172.21.15.40:0/3968495579 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f671009d400 0x7f6710119050 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.093+0000 7f6718292700 1 --2- 172.21.15.40:0/3968495579 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f671009df70 0x7f6710119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.093+0000 7f6718292700 1 -- 172.21.15.40:0/3968495579 >> 172.21.15.40:0/3968495579 conn(0x7f67100a2a00 msgr2=0x7f671012d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.093+0000 7f6718292700 1 -- 172.21.15.40:0/3968495579 shutdown_connections 2023-09-30T22:27:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.093+0000 7f6718292700 1 -- 172.21.15.40:0/3968495579 wait complete. 2023-09-30T22:27:05.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.093+0000 7fc981a4f700 1 -- 172.21.15.40:0/1109479558 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc97c126060 con 0x7fc97c09e400 2023-09-30T22:27:05.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.094+0000 7fc963fff700 1 -- 172.21.15.40:0/1109479558 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc97c126060 con 0x7fc97c09e400 2023-09-30T22:27:05.095 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:05.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.096+0000 7fc981a4f700 1 -- 172.21.15.40:0/1109479558 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc97c09e400 msgr2=0x7fc97c1c8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:05.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.096+0000 7fc981a4f700 1 --2- 172.21.15.40:0/1109479558 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc97c09e400 0x7fc97c1c8dc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc970016000 tx=0x7fc970004750 comp rx=0 tx=0).stop 2023-09-30T22:27:05.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.098+0000 7fc981a4f700 1 -- 172.21.15.40:0/1109479558 shutdown_connections 2023-09-30T22:27:05.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.098+0000 7fc981a4f700 1 --2- 172.21.15.40:0/1109479558 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc97c136230 0x7fc97c1229c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:05.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.098+0000 7fc981a4f700 1 --2- 172.21.15.40:0/1109479558 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc97c09d920 0x7fc97c1c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:05.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.098+0000 7fc981a4f700 1 --2- 172.21.15.40:0/1109479558 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc97c09e400 0x7fc97c1c8dc0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:05.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.098+0000 7fc981a4f700 1 -- 172.21.15.40:0/1109479558 >> 172.21.15.40:0/1109479558 conn(0x7fc97c09fb20 msgr2=0x7fc97c070580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.098+0000 7fc981a4f700 1 -- 172.21.15.40:0/1109479558 shutdown_connections 2023-09-30T22:27:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.098+0000 7fc981a4f700 1 -- 172.21.15.40:0/1109479558 wait complete. 2023-09-30T22:27:05.107 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:05.112 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:05.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.161+0000 7f6110c49700 1 -- 172.21.15.40:0/3109008602 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f610c126d50 con 0x7f610c09de60 2023-09-30T22:27:05.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.161+0000 7f60faffd700 1 -- 172.21.15.40:0/3109008602 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6100015020 con 0x7f610c09de60 2023-09-30T22:27:05.162 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:05.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.163+0000 7f6110c49700 1 -- 172.21.15.40:0/3109008602 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f610c09de60 msgr2=0x7f610c127870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:05.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.163+0000 7f6110c49700 1 --2- 172.21.15.40:0/3109008602 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f610c09de60 0x7f610c127870 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f610c072b10 tx=0x7f610000b730 comp rx=0 tx=0).stop 2023-09-30T22:27:05.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.163+0000 7f6110c49700 1 -- 172.21.15.40:0/3109008602 shutdown_connections 2023-09-30T22:27:05.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.163+0000 7f6110c49700 1 --2- 172.21.15.40:0/3109008602 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f610c13c490 0x7f610c1cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:05.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.163+0000 7f6110c49700 1 --2- 172.21.15.40:0/3109008602 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f610c06a6d0 0x7f610c127330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:05.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.163+0000 7f6110c49700 1 --2- 172.21.15.40:0/3109008602 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f610c09de60 0x7f610c127870 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:05.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.163+0000 7f6110c49700 1 -- 172.21.15.40:0/3109008602 >> 172.21.15.40:0/3109008602 conn(0x7f610c09fb20 msgr2=0x7f610c13b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:05.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.163+0000 7f6110c49700 1 -- 172.21.15.40:0/3109008602 shutdown_connections 2023-09-30T22:27:05.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.163+0000 7f6110c49700 1 -- 172.21.15.40:0/3109008602 wait complete. 2023-09-30T22:27:05.176 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:05.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.177+0000 7fd721ad2700 1 -- 172.21.15.40:0/3370450812 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd71c12d3a0 con 0x7fd71c06fdb0 2023-09-30T22:27:05.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.177+0000 7fd703fff700 1 -- 172.21.15.40:0/3370450812 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd714005830 con 0x7fd71c06fdb0 2023-09-30T22:27:05.178 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:05.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.179+0000 7fd721ad2700 1 -- 172.21.15.40:0/3370450812 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd71c06fdb0 msgr2=0x7fd71c1c3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:05.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.179+0000 7fd721ad2700 1 --2- 172.21.15.40:0/3370450812 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd71c06fdb0 0x7fd71c1c3ce0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd714001560 tx=0x7fd71400cb50 comp rx=0 tx=0).stop 2023-09-30T22:27:05.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.180+0000 7fd721ad2700 1 -- 172.21.15.40:0/3370450812 shutdown_connections 2023-09-30T22:27:05.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.180+0000 7fd721ad2700 1 --2- 172.21.15.40:0/3370450812 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd71c06fdb0 0x7fd71c1c3ce0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:05.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.180+0000 7fd721ad2700 1 --2- 172.21.15.40:0/3370450812 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd71c06f070 0x7fd71c09d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:05.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.180+0000 7fd721ad2700 1 --2- 172.21.15.40:0/3370450812 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd71c06f980 0x7fd71c09de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:05.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.180+0000 7fd721ad2700 1 -- 172.21.15.40:0/3370450812 >> 172.21.15.40:0/3370450812 conn(0x7fd71c0a41a0 msgr2=0x7fd71c0972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:05.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.180+0000 7fd721ad2700 1 -- 172.21.15.40:0/3370450812 shutdown_connections 2023-09-30T22:27:05.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:05.180+0000 7fd721ad2700 1 -- 172.21.15.40:0/3370450812 wait complete. 2023-09-30T22:27:05.192 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:06.108 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:06.113 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:06.177 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:06.193 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:06.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.256+0000 7fd6b8db1700 1 Processor -- start 2023-09-30T22:27:06.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.256+0000 7fd6b8db1700 1 -- start start 2023-09-30T22:27:06.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.257+0000 7fd6b8db1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd6b4131d50 0x7fd6b4132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:06.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.257+0000 7fd6b8db1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6b409c7d0 0x7fd6b4139ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:06.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.257+0000 7fd6b8db1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b4132660 con 0x7fd6b409bc50 2023-09-30T22:27:06.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.257+0000 7fd6b8db1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b40719e0 con 0x7fd6b409c7d0 2023-09-30T22:27:06.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.257+0000 7fd6b8db1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b4131900 con 0x7fd6b4131d50 2023-09-30T22:27:06.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.257+0000 7fd6b259c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd6b4131d50 0x7fd6b4132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:06.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.257+0000 7fd6b259c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd6b4131d50 0x7fd6b4132120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52742/0 (socket says 172.21.15.40:52742) 2023-09-30T22:27:06.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.257+0000 7fd6b259c700 1 -- 172.21.15.40:0/493326308 learned_addr learned my addr 172.21.15.40:0/493326308 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:06.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.257+0000 7fd6b2d9d700 1 --2- 172.21.15.40:0/493326308 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6b409c7d0 0x7fd6b4139ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:06.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.257+0000 7fd6b259c700 1 -- 172.21.15.40:0/493326308 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6b409c7d0 msgr2=0x7fd6b4139ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:06.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.257+0000 7fd6b259c700 1 --2- 172.21.15.40:0/493326308 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6b409c7d0 0x7fd6b4139ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.257+0000 7fd6b259c700 1 -- 172.21.15.40:0/493326308 >> v1:172.21.15.40:6789/0 conn(0x7fd6b409bc50 legacy=0x7fd6b409c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:06.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.257+0000 7fd6b259c700 1 -- 172.21.15.40:0/493326308 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b409e820 con 0x7fd6b4131d50 2023-09-30T22:27:06.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.258+0000 7fd6b259c700 1 --2- 172.21.15.40:0/493326308 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd6b4131d50 0x7fd6b4132120 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4009950 tx=0x7fd6a4009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b600a40cf02f9fe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:06.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.258+0000 7fd6b159a700 1 -- 172.21.15.40:0/493326308 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a4009ea0 con 0x7fd6b4131d50 2023-09-30T22:27:06.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.258+0000 7fd6b159a700 1 -- 172.21.15.40:0/493326308 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a400ba20 con 0x7fd6b4131d50 2023-09-30T22:27:06.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.258+0000 7fd6b159a700 1 -- 172.21.15.40:0/493326308 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a400bdb0 con 0x7fd6b4131d50 2023-09-30T22:27:06.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.259+0000 7fd6b8db1700 1 -- 172.21.15.40:0/493326308 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd6b4131d50 msgr2=0x7fd6b4132120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:06.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.259+0000 7fd6b8db1700 1 --2- 172.21.15.40:0/493326308 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd6b4131d50 0x7fd6b4132120 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4009950 tx=0x7fd6a4009c60 comp rx=0 tx=0).stop 2023-09-30T22:27:06.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.259+0000 7fd6b8db1700 1 -- 172.21.15.40:0/493326308 shutdown_connections 2023-09-30T22:27:06.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.259+0000 7fd6b8db1700 1 --2- 172.21.15.40:0/493326308 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6b409c7d0 0x7fd6b4139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.259+0000 7fd6b8db1700 1 --2- 172.21.15.40:0/493326308 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd6b4131d50 0x7fd6b4132120 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.259+0000 7fd6b8db1700 1 -- 172.21.15.40:0/493326308 >> 172.21.15.40:0/493326308 conn(0x7fd6b40a2a00 msgr2=0x7fd6b40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:06.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.259+0000 7fd6b8db1700 1 -- 172.21.15.40:0/493326308 shutdown_connections 2023-09-30T22:27:06.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.259+0000 7fd6b8db1700 1 -- 172.21.15.40:0/493326308 wait complete. 2023-09-30T22:27:06.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.260+0000 7fd6b8db1700 1 Processor -- start 2023-09-30T22:27:06.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.261+0000 7fd6b8db1700 1 -- start start 2023-09-30T22:27:06.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.261+0000 7fd6b8db1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6b409bc50 0x7fd6b411a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:06.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.261+0000 7fd6b8db1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd6b409c7d0 0x7fd6b411ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:06.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.261+0000 7fd6b8db1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6b4131d50 0x7fd6b411b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:06.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.261+0000 7fd6b8db1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b411c5a0 con 0x7fd6b409bc50 2023-09-30T22:27:06.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.261+0000 7fd6b8db1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b411e130 con 0x7fd6b4131d50 2023-09-30T22:27:06.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.261+0000 7fd6b8db1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b411d750 con 0x7fd6b409c7d0 2023-09-30T22:27:06.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.261+0000 7fd6b259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6b409bc50 0x7fd6b411a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:06.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.261+0000 7fd6b259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6b409bc50 0x7fd6b411a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41940/0 (socket says 172.21.15.40:41940) 2023-09-30T22:27:06.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.261+0000 7fd6b259c700 1 -- 172.21.15.40:0/173424359 learned_addr learned my addr 172.21.15.40:0/173424359 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:06.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.261+0000 7fd6b2d9d700 1 --2- 172.21.15.40:0/173424359 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6b4131d50 0x7fd6b411b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:06.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.262+0000 7fd6b1d9b700 1 --2- 172.21.15.40:0/173424359 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd6b409c7d0 0x7fd6b411ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:06.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.262+0000 7fd6b2d9d700 1 -- 172.21.15.40:0/173424359 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd6b409c7d0 msgr2=0x7fd6b411ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:06.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.262+0000 7fd6b2d9d700 1 --2- 172.21.15.40:0/173424359 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd6b409c7d0 0x7fd6b411ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.262+0000 7fd6b2d9d700 1 -- 172.21.15.40:0/173424359 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6b409bc50 msgr2=0x7fd6b411a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:06.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.262+0000 7fd6b2d9d700 1 --2- 172.21.15.40:0/173424359 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6b409bc50 0x7fd6b411a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.262+0000 7fd6b2d9d700 1 -- 172.21.15.40:0/173424359 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a4009550 con 0x7fd6b4131d50 2023-09-30T22:27:06.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.262+0000 7fd6b2d9d700 1 --2- 172.21.15.40:0/173424359 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6b4131d50 0x7fd6b411b370 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac007d90 tx=0x7fd6ac00e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:06.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.262+0000 7fd6a2ffd700 1 -- 172.21.15.40:0/173424359 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac018070 con 0x7fd6b4131d50 2023-09-30T22:27:06.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.262+0000 7fd6a2ffd700 1 -- 172.21.15.40:0/173424359 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ac00eb30 con 0x7fd6b4131d50 2023-09-30T22:27:06.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.262+0000 7fd6a2ffd700 1 -- 172.21.15.40:0/173424359 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac003a20 con 0x7fd6b4131d50 2023-09-30T22:27:06.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.262+0000 7fd6b8db1700 1 -- 172.21.15.40:0/173424359 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b412ecf0 con 0x7fd6b4131d50 2023-09-30T22:27:06.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.262+0000 7fd6b8db1700 1 -- 172.21.15.40:0/173424359 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b411e410 con 0x7fd6b4131d50 2023-09-30T22:27:06.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.264+0000 7fd6a2ffd700 1 -- 172.21.15.40:0/173424359 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd6ac014420 con 0x7fd6b4131d50 2023-09-30T22:27:06.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.264+0000 7fd6b8db1700 1 -- 172.21.15.40:0/173424359 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b406fa30 con 0x7fd6b4131d50 2023-09-30T22:27:06.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.264+0000 7fd6a2ffd700 1 -- 172.21.15.40:0/173424359 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd6ac03f690 con 0x7fd6b4131d50 2023-09-30T22:27:06.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.268+0000 7fd6a2ffd700 1 -- 172.21.15.40:0/173424359 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd6ac0126a0 con 0x7fd6b4131d50 2023-09-30T22:27:06.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.305+0000 7f73c3f55700 1 Processor -- start 2023-09-30T22:27:06.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.305+0000 7f73c3f55700 1 -- start start 2023-09-30T22:27:06.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.305+0000 7f73c3f55700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73bc09d920 0x7f73bc09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:06.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.305+0000 7f73c3f55700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73bc09f0f0 0x7f73bc09e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:06.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.306+0000 7f73c3f55700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73bc09f940 con 0x7f73bc133ca0 2023-09-30T22:27:06.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.306+0000 7f73c3f55700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc06b4c0 con 0x7f73bc09f0f0 2023-09-30T22:27:06.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.306+0000 7f73c3f55700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc09a8f0 con 0x7f73bc09d920 2023-09-30T22:27:06.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.306+0000 7f73c14f0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73bc09f0f0 0x7f73bc09e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:06.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.306+0000 7f73c14f0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73bc09f0f0 0x7f73bc09e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:49610/0 (socket says 172.21.15.40:49610) 2023-09-30T22:27:06.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.306+0000 7f73c14f0700 1 -- 172.21.15.40:0/3034171810 learned_addr learned my addr 172.21.15.40:0/3034171810 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:06.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.306+0000 7f73c1cf1700 1 --2- 172.21.15.40:0/3034171810 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73bc09d920 0x7f73bc09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:06.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.306+0000 7f73c14f0700 1 -- 172.21.15.40:0/3034171810 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73bc09d920 msgr2=0x7f73bc09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:06.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.306+0000 7f73c14f0700 1 --2- 172.21.15.40:0/3034171810 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73bc09d920 0x7f73bc09dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.306+0000 7f73c14f0700 1 -- 172.21.15.40:0/3034171810 >> v1:172.21.15.40:6789/0 conn(0x7f73bc133ca0 legacy=0x7f73bc134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:06.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.306+0000 7f73c14f0700 1 -- 172.21.15.40:0/3034171810 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73bc09f6e0 con 0x7f73bc09f0f0 2023-09-30T22:27:06.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.306+0000 7f73c14f0700 1 --2- 172.21.15.40:0/3034171810 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73bc09f0f0 0x7f73bc09e230 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f73ac009920 tx=0x7f73ac009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a63e6eca00d18c4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:06.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.307+0000 7f73c0cef700 1 -- 172.21.15.40:0/3034171810 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ac011830 con 0x7f73bc09f0f0 2023-09-30T22:27:06.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.307+0000 7f73c0cef700 1 -- 172.21.15.40:0/3034171810 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73ac011990 con 0x7f73bc09f0f0 2023-09-30T22:27:06.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.307+0000 7f73c0cef700 1 -- 172.21.15.40:0/3034171810 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ac011d20 con 0x7f73bc09f0f0 2023-09-30T22:27:06.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.307+0000 7f73c3f55700 1 -- 172.21.15.40:0/3034171810 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73bc09f0f0 msgr2=0x7f73bc09e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:06.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.307+0000 7f73c3f55700 1 --2- 172.21.15.40:0/3034171810 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73bc09f0f0 0x7f73bc09e230 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f73ac009920 tx=0x7f73ac009c30 comp rx=0 tx=0).stop 2023-09-30T22:27:06.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.307+0000 7f73c3f55700 1 -- 172.21.15.40:0/3034171810 shutdown_connections 2023-09-30T22:27:06.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.307+0000 7f73c3f55700 1 --2- 172.21.15.40:0/3034171810 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73bc09d920 0x7f73bc09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.307+0000 7f73c3f55700 1 --2- 172.21.15.40:0/3034171810 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73bc09f0f0 0x7f73bc09e230 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.307+0000 7f73c3f55700 1 -- 172.21.15.40:0/3034171810 >> 172.21.15.40:0/3034171810 conn(0x7f73bc09fb20 msgr2=0x7f73bc09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:06.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.308+0000 7f73c3f55700 1 -- 172.21.15.40:0/3034171810 shutdown_connections 2023-09-30T22:27:06.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.308+0000 7f73c3f55700 1 -- 172.21.15.40:0/3034171810 wait complete. 2023-09-30T22:27:06.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.309+0000 7f73c3f55700 1 Processor -- start 2023-09-30T22:27:06.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.309+0000 7f73c3f55700 1 -- start start 2023-09-30T22:27:06.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.310+0000 7f73c3f55700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73bc09d920 0x7f73bc1ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:06.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.310+0000 7f73c3f55700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73bc133ca0 0x7f73bc1cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:06.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.310+0000 7f73c3f55700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73bc11d690 0x7f73bc126350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:06.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.310+0000 7f73c3f55700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc128cf0 con 0x7f73bc09d920 2023-09-30T22:27:06.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.310+0000 7f73c3f55700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc1cd9a0 con 0x7f73bc133ca0 2023-09-30T22:27:06.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.310+0000 7f73c3f55700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc127d50 con 0x7f73bc11d690 2023-09-30T22:27:06.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.310+0000 7f73c1cf1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73bc09d920 0x7f73bc1ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:06.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.310+0000 7f73c1cf1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73bc09d920 0x7f73bc1ccf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41950/0 (socket says 172.21.15.40:41950) 2023-09-30T22:27:06.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.310+0000 7f73c1cf1700 1 -- 172.21.15.40:0/3791870558 learned_addr learned my addr 172.21.15.40:0/3791870558 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:06.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.310+0000 7f73c24f2700 1 --2- 172.21.15.40:0/3791870558 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73bc11d690 0x7f73bc126350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:06.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.310+0000 7f73c14f0700 1 --2- 172.21.15.40:0/3791870558 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73bc133ca0 0x7f73bc1cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:06.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.310+0000 7f73c1cf1700 1 -- 172.21.15.40:0/3791870558 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73bc11d690 msgr2=0x7f73bc126350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:06.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.310+0000 7f73c1cf1700 1 --2- 172.21.15.40:0/3791870558 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73bc11d690 0x7f73bc126350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.310+0000 7f73c1cf1700 1 -- 172.21.15.40:0/3791870558 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73bc133ca0 msgr2=0x7f73bc1cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:06.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.310+0000 7f73c1cf1700 1 --2- 172.21.15.40:0/3791870558 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73bc133ca0 0x7f73bc1cd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.310+0000 7f73c1cf1700 1 -- 172.21.15.40:0/3791870558 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73ac009550 con 0x7f73bc09d920 2023-09-30T22:27:06.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.310+0000 7f73c1cf1700 1 --2- 172.21.15.40:0/3791870558 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73bc09d920 0x7f73bc1ccf20 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f73b800e930 tx=0x7f73b800ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:06.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.310+0000 7f73b27fc700 1 -- 172.21.15.40:0/3791870558 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b8009650 con 0x7f73bc09d920 2023-09-30T22:27:06.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.311+0000 7f73b27fc700 1 -- 172.21.15.40:0/3791870558 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b800c850 con 0x7f73bc09d920 2023-09-30T22:27:06.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.311+0000 7f73c3f55700 1 -- 172.21.15.40:0/3791870558 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73bc09c9e0 con 0x7f73bc09d920 2023-09-30T22:27:06.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.311+0000 7f73b27fc700 1 -- 172.21.15.40:0/3791870558 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b800cbc0 con 0x7f73bc09d920 2023-09-30T22:27:06.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.311+0000 7f73c3f55700 1 -- 172.21.15.40:0/3791870558 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73bc1298d0 con 0x7f73bc09d920 2023-09-30T22:27:06.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.312+0000 7f73c3f55700 1 -- 172.21.15.40:0/3791870558 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73bc062380 con 0x7f73bc09d920 2023-09-30T22:27:06.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.312+0000 7f73b27fc700 1 -- 172.21.15.40:0/3791870558 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f73b800cd20 con 0x7f73bc09d920 2023-09-30T22:27:06.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.312+0000 7f73b27fc700 1 -- 172.21.15.40:0/3791870558 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f73b803fbf0 con 0x7f73bc09d920 2023-09-30T22:27:06.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.321+0000 7f73b27fc700 1 -- 172.21.15.40:0/3791870558 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f73b801adc0 con 0x7f73bc09d920 2023-09-30T22:27:06.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.335+0000 7f50bc6ec700 1 Processor -- start 2023-09-30T22:27:06.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.336+0000 7f50bc6ec700 1 -- start start 2023-09-30T22:27:06.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.336+0000 7f50bc6ec700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50b406a6d0 0x7f50b406aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:06.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.336+0000 7f50bc6ec700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f50b406afe0 0x7f50b41318b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:06.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.336+0000 7f50bc6ec700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f50b4131df0 0x7f50b4132290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:06.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.336+0000 7f50bc6ec700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50b409eb50 con 0x7f50b4131df0 2023-09-30T22:27:06.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.336+0000 7f50bc6ec700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b409dde0 con 0x7f50b406a6d0 2023-09-30T22:27:06.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.336+0000 7f50bc6ec700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50b409d4a0 con 0x7f50b406afe0 2023-09-30T22:27:06.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.336+0000 7f50ba488700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50b406a6d0 0x7f50b406aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:06.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.336+0000 7f50ba488700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50b406a6d0 0x7f50b406aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:49620/0 (socket says 172.21.15.40:49620) 2023-09-30T22:27:06.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.336+0000 7f50ba488700 1 -- 172.21.15.40:0/1866788764 learned_addr learned my addr 172.21.15.40:0/1866788764 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:06.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.337+0000 7f50b9c87700 1 --2- 172.21.15.40:0/1866788764 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f50b406afe0 0x7f50b41318b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:06.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.337+0000 7f50bac89700 1 --2- 172.21.15.40:0/1866788764 >> v2:172.21.15.40:3300/0 conn(0x7f50b4131df0 0x7f50b4132290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:06.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.337+0000 7f50ba488700 1 -- 172.21.15.40:0/1866788764 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f50b406afe0 msgr2=0x7f50b41318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:06.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.337+0000 7f50ba488700 1 --2- 172.21.15.40:0/1866788764 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f50b406afe0 0x7f50b41318b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.337+0000 7f50ba488700 1 -- 172.21.15.40:0/1866788764 >> v2:172.21.15.40:3300/0 conn(0x7f50b4131df0 msgr2=0x7f50b4132290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:06.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.337+0000 7f50ba488700 1 --2- 172.21.15.40:0/1866788764 >> v2:172.21.15.40:3300/0 conn(0x7f50b4131df0 0x7f50b4132290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.337+0000 7f50ba488700 1 -- 172.21.15.40:0/1866788764 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b409f5f0 con 0x7f50b406a6d0 2023-09-30T22:27:06.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.337+0000 7f50b9c87700 1 --2- 172.21.15.40:0/1866788764 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f50b406afe0 0x7f50b41318b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:06.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.337+0000 7f50ba488700 1 --2- 172.21.15.40:0/1866788764 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50b406a6d0 0x7f50b406aaa0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f50b0006fd0 tx=0x7f50b0009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8da3439bfcccbbec server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:06.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.337+0000 7f50b9486700 1 -- 172.21.15.40:0/1866788764 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b0005e30 con 0x7f50b406a6d0 2023-09-30T22:27:06.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.337+0000 7f50b9486700 1 -- 172.21.15.40:0/1866788764 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b0004030 con 0x7f50b406a6d0 2023-09-30T22:27:06.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.337+0000 7f50b9486700 1 -- 172.21.15.40:0/1866788764 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b00043e0 con 0x7f50b406a6d0 2023-09-30T22:27:06.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.338+0000 7f50bc6ec700 1 -- 172.21.15.40:0/1866788764 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50b406a6d0 msgr2=0x7f50b406aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:06.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.338+0000 7f50bc6ec700 1 --2- 172.21.15.40:0/1866788764 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50b406a6d0 0x7f50b406aaa0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f50b0006fd0 tx=0x7f50b0009bd0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.338+0000 7f50bc6ec700 1 -- 172.21.15.40:0/1866788764 shutdown_connections 2023-09-30T22:27:06.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.338+0000 7f50bc6ec700 1 --2- 172.21.15.40:0/1866788764 >> v2:172.21.15.40:3300/0 conn(0x7f50b4131df0 0x7f50b4132290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.338+0000 7f50bc6ec700 1 --2- 172.21.15.40:0/1866788764 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50b406a6d0 0x7f50b406aaa0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.338+0000 7f50bc6ec700 1 --2- 172.21.15.40:0/1866788764 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f50b406afe0 0x7f50b41318b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.338+0000 7f50bc6ec700 1 -- 172.21.15.40:0/1866788764 >> 172.21.15.40:0/1866788764 conn(0x7f50b409fb20 msgr2=0x7f50b409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:06.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.338+0000 7f50bc6ec700 1 -- 172.21.15.40:0/1866788764 shutdown_connections 2023-09-30T22:27:06.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.338+0000 7f50bc6ec700 1 -- 172.21.15.40:0/1866788764 wait complete. 2023-09-30T22:27:06.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.339+0000 7f50bc6ec700 1 Processor -- start 2023-09-30T22:27:06.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.339+0000 7f50bc6ec700 1 -- start start 2023-09-30T22:27:06.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.339+0000 7f50bc6ec700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50b406a6d0 0x7f50b4126fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:06.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.339+0000 7f50bc6ec700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50b406afe0 0x7f50b41274f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:06.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.339+0000 7f50bc6ec700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f50b4131df0 0x7f50b4127a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:06.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.339+0000 7f50bc6ec700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b412b440 con 0x7f50b406a6d0 2023-09-30T22:27:06.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.339+0000 7f50bc6ec700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b412aa80 con 0x7f50b406afe0 2023-09-30T22:27:06.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.339+0000 7f50bc6ec700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50b412a570 con 0x7f50b4131df0 2023-09-30T22:27:06.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.340+0000 7f50bac89700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f50b4131df0 0x7f50b4127a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:06.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.340+0000 7f50bac89700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f50b4131df0 0x7f50b4127a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52774/0 (socket says 172.21.15.40:52774) 2023-09-30T22:27:06.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.340+0000 7f50bac89700 1 -- 172.21.15.40:0/2010548553 learned_addr learned my addr 172.21.15.40:0/2010548553 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:06.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.340+0000 7f50ba488700 1 --2- 172.21.15.40:0/2010548553 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50b406a6d0 0x7f50b4126fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:06.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.340+0000 7f50b9c87700 1 --2- 172.21.15.40:0/2010548553 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50b406afe0 0x7f50b41274f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:06.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.340+0000 7f50bac89700 1 -- 172.21.15.40:0/2010548553 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50b406afe0 msgr2=0x7f50b41274f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:06.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.340+0000 7f50bac89700 1 --2- 172.21.15.40:0/2010548553 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50b406afe0 0x7f50b41274f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.340+0000 7f50bac89700 1 -- 172.21.15.40:0/2010548553 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50b406a6d0 msgr2=0x7f50b4126fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:06.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.340+0000 7f50bac89700 1 --2- 172.21.15.40:0/2010548553 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50b406a6d0 0x7f50b4126fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.340+0000 7f50bac89700 1 -- 172.21.15.40:0/2010548553 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a40094a0 con 0x7f50b4131df0 2023-09-30T22:27:06.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.340+0000 7f50bac89700 1 --2- 172.21.15.40:0/2010548553 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f50b4131df0 0x7f50b4127a30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f50ac0095e0 tx=0x7f50ac0098f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:06.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.340+0000 7f50aaffd700 1 -- 172.21.15.40:0/2010548553 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac003a20 con 0x7f50b4131df0 2023-09-30T22:27:06.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.340+0000 7f50aaffd700 1 -- 172.21.15.40:0/2010548553 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ac003b80 con 0x7f50b4131df0 2023-09-30T22:27:06.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.340+0000 7f50bc6ec700 1 -- 172.21.15.40:0/2010548553 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50b0009500 con 0x7f50b4131df0 2023-09-30T22:27:06.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.340+0000 7f50aaffd700 1 -- 172.21.15.40:0/2010548553 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac00d110 con 0x7f50b4131df0 2023-09-30T22:27:06.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.341+0000 7f50bc6ec700 1 -- 172.21.15.40:0/2010548553 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50b409a8f0 con 0x7f50b4131df0 2023-09-30T22:27:06.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.342+0000 7f50bc6ec700 1 -- 172.21.15.40:0/2010548553 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50b4062380 con 0x7f50b4131df0 2023-09-30T22:27:06.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.342+0000 7f50aaffd700 1 -- 172.21.15.40:0/2010548553 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f50ac014030 con 0x7f50b4131df0 2023-09-30T22:27:06.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.342+0000 7f50aaffd700 1 -- 172.21.15.40:0/2010548553 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f50ac03f960 con 0x7f50b4131df0 2023-09-30T22:27:06.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.347+0000 7f50aaffd700 1 -- 172.21.15.40:0/2010548553 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f50ac01f580 con 0x7f50b4131df0 2023-09-30T22:27:06.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.358+0000 7f95e7a16700 1 Processor -- start 2023-09-30T22:27:06.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.358+0000 7f95e7a16700 1 -- start start 2023-09-30T22:27:06.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.359+0000 7f95e7a16700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f95e0136c50 0x7f95e0139030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:06.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.359+0000 7f95e7a16700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95e0139570 0x7f95e013b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:06.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.359+0000 7f95e7a16700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95e0133940 con 0x7f95e0133e00 2023-09-30T22:27:06.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.359+0000 7f95e7a16700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e009af70 con 0x7f95e0139570 2023-09-30T22:27:06.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.359+0000 7f95e7a16700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95e009ab20 con 0x7f95e0136c50 2023-09-30T22:27:06.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.359+0000 7f95e57b2700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f95e0133e00 0x7f95e01341d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44900/0 (socket says 172.21.15.40:44900) 2023-09-30T22:27:06.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.359+0000 7f95e5fb3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95e0139570 0x7f95e013b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:06.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.359+0000 7f95e57b2700 1 -- 172.21.15.40:0/2833252393 learned_addr learned my addr 172.21.15.40:0/2833252393 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:27:06.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.359+0000 7f95e4fb1700 1 --2- 172.21.15.40:0/2833252393 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f95e0136c50 0x7f95e0139030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:06.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.360+0000 7f95e5fb3700 1 -- 172.21.15.40:0/2833252393 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f95e0136c50 msgr2=0x7f95e0139030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:06.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.360+0000 7f95e5fb3700 1 --2- 172.21.15.40:0/2833252393 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f95e0136c50 0x7f95e0139030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.360+0000 7f95e5fb3700 1 -- 172.21.15.40:0/2833252393 >> v1:172.21.15.40:6789/0 conn(0x7f95e0133e00 legacy=0x7f95e01341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:06.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.360+0000 7f95e5fb3700 1 -- 172.21.15.40:0/2833252393 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e009f0d0 con 0x7f95e0139570 2023-09-30T22:27:06.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.360+0000 7f95e5fb3700 1 --2- 172.21.15.40:0/2833252393 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95e0139570 0x7f95e013b950 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009dc0 tx=0x7f95d800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4567e8f03c71c38 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:06.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.360+0000 7f95d7fff700 1 -- 172.21.15.40:0/2833252393 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d800e070 con 0x7f95e0139570 2023-09-30T22:27:06.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.360+0000 7f95d7fff700 1 -- 172.21.15.40:0/2833252393 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d800bb20 con 0x7f95e0139570 2023-09-30T22:27:06.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.360+0000 7f95d7fff700 1 -- 172.21.15.40:0/2833252393 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d8012430 con 0x7f95e0139570 2023-09-30T22:27:06.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.361+0000 7f95e7a16700 1 -- 172.21.15.40:0/2833252393 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95e0139570 msgr2=0x7f95e013b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:06.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.361+0000 7f95e7a16700 1 --2- 172.21.15.40:0/2833252393 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95e0139570 0x7f95e013b950 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009dc0 tx=0x7f95d800b330 comp rx=0 tx=0).stop 2023-09-30T22:27:06.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.361+0000 7f95e7a16700 1 -- 172.21.15.40:0/2833252393 shutdown_connections 2023-09-30T22:27:06.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.361+0000 7f95e7a16700 1 --2- 172.21.15.40:0/2833252393 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95e0139570 0x7f95e013b950 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.361+0000 7f95e7a16700 1 --2- 172.21.15.40:0/2833252393 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f95e0136c50 0x7f95e0139030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.361+0000 7f95e7a16700 1 -- 172.21.15.40:0/2833252393 >> 172.21.15.40:0/2833252393 conn(0x7f95e00a2a00 msgr2=0x7f95e00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:06.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.361+0000 7f95e7a16700 1 -- 172.21.15.40:0/2833252393 shutdown_connections 2023-09-30T22:27:06.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.361+0000 7f95e7a16700 1 -- 172.21.15.40:0/2833252393 wait complete. 2023-09-30T22:27:06.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.362+0000 7f95e7a16700 1 Processor -- start 2023-09-30T22:27:06.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.362+0000 7f95e7a16700 1 -- start start 2023-09-30T22:27:06.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.363+0000 7f95e7a16700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f95e0133e00 0x7f95e0119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:06.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.363+0000 7f95e7a16700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95e0136c50 0x7f95e0119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:06.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.363+0000 7f95e7a16700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95e0139570 0x7f95e0119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:06.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.363+0000 7f95e7a16700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e012e110 con 0x7f95e0139570 2023-09-30T22:27:06.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.363+0000 7f95e7a16700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e0138c10 con 0x7f95e0136c50 2023-09-30T22:27:06.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.363+0000 7f95e7a16700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95e012da10 con 0x7f95e0133e00 2023-09-30T22:27:06.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.363+0000 7f95e57b2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f95e0133e00 0x7f95e0119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:06.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.363+0000 7f95e57b2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f95e0133e00 0x7f95e0119050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52782/0 (socket says 172.21.15.40:52782) 2023-09-30T22:27:06.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.363+0000 7f95e57b2700 1 -- 172.21.15.40:0/4162970219 learned_addr learned my addr 172.21.15.40:0/4162970219 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:06.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.363+0000 7f95e4fb1700 1 --2- 172.21.15.40:0/4162970219 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95e0136c50 0x7f95e0119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:06.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.363+0000 7f95e5fb3700 1 --2- 172.21.15.40:0/4162970219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95e0139570 0x7f95e0119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:06.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.363+0000 7f95e57b2700 1 -- 172.21.15.40:0/4162970219 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95e0136c50 msgr2=0x7f95e0119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:06.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.363+0000 7f95e57b2700 1 --2- 172.21.15.40:0/4162970219 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95e0136c50 0x7f95e0119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.363+0000 7f95e57b2700 1 -- 172.21.15.40:0/4162970219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95e0139570 msgr2=0x7f95e0119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:06.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.363+0000 7f95e57b2700 1 --2- 172.21.15.40:0/4162970219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95e0139570 0x7f95e0119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.363+0000 7f95e57b2700 1 -- 172.21.15.40:0/4162970219 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d8009a70 con 0x7f95e0133e00 2023-09-30T22:27:06.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.363+0000 7f95e5fb3700 1 --2- 172.21.15.40:0/4162970219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95e0139570 0x7f95e0119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:06.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.364+0000 7f95e57b2700 1 --2- 172.21.15.40:0/4162970219 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f95e0133e00 0x7f95e0119050 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f95dc00c4b0 tx=0x7f95dc00c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:06.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.364+0000 7f95d5ffb700 1 -- 172.21.15.40:0/4162970219 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc005d70 con 0x7f95e0133e00 2023-09-30T22:27:06.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.364+0000 7f95d5ffb700 1 -- 172.21.15.40:0/4162970219 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95dc0070d0 con 0x7f95e0133e00 2023-09-30T22:27:06.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.364+0000 7f95d5ffb700 1 -- 172.21.15.40:0/4162970219 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc007440 con 0x7f95e0133e00 2023-09-30T22:27:06.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.365+0000 7f95e7a16700 1 -- 172.21.15.40:0/4162970219 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e012ddd0 con 0x7f95e0133e00 2023-09-30T22:27:06.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.365+0000 7f95e7a16700 1 -- 172.21.15.40:0/4162970219 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e011ba70 con 0x7f95e0133e00 2023-09-30T22:27:06.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.366+0000 7f95d5ffb700 1 -- 172.21.15.40:0/4162970219 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f95dc0075a0 con 0x7f95e0133e00 2023-09-30T22:27:06.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.366+0000 7f95e7a16700 1 -- 172.21.15.40:0/4162970219 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e0062380 con 0x7f95e0133e00 2023-09-30T22:27:06.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.366+0000 7f95d5ffb700 1 -- 172.21.15.40:0/4162970219 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f95dc03eb00 con 0x7f95e0133e00 2023-09-30T22:27:06.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.375+0000 7f95d5ffb700 1 -- 172.21.15.40:0/4162970219 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f95dc019b40 con 0x7f95e0133e00 2023-09-30T22:27:06.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.474+0000 7fd6b8db1700 1 -- 172.21.15.40:0/173424359 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd6b411ddd0 con 0x7fd6b4131d50 2023-09-30T22:27:06.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.474+0000 7fd6a2ffd700 1 -- 172.21.15.40:0/173424359 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd6ac0122e0 con 0x7fd6b4131d50 2023-09-30T22:27:06.475 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:06.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.477+0000 7fd6b8db1700 1 -- 172.21.15.40:0/173424359 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6b4131d50 msgr2=0x7fd6b411b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:06.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.477+0000 7fd6b8db1700 1 --2- 172.21.15.40:0/173424359 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6b4131d50 0x7fd6b411b370 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac007d90 tx=0x7fd6ac00e3c0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.478+0000 7fd6b8db1700 1 -- 172.21.15.40:0/173424359 shutdown_connections 2023-09-30T22:27:06.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.478+0000 7fd6b8db1700 1 --2- 172.21.15.40:0/173424359 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6b4131d50 0x7fd6b411b370 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.478+0000 7fd6b8db1700 1 --2- 172.21.15.40:0/173424359 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6b409bc50 0x7fd6b411a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.478+0000 7fd6b8db1700 1 --2- 172.21.15.40:0/173424359 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd6b409c7d0 0x7fd6b411ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.478+0000 7fd6b8db1700 1 -- 172.21.15.40:0/173424359 >> 172.21.15.40:0/173424359 conn(0x7fd6b40a2a00 msgr2=0x7fd6b40a15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:06.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.478+0000 7fd6b8db1700 1 -- 172.21.15.40:0/173424359 shutdown_connections 2023-09-30T22:27:06.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.478+0000 7fd6b8db1700 1 -- 172.21.15.40:0/173424359 wait complete. 2023-09-30T22:27:06.491 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:06.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.547+0000 7f73c3f55700 1 -- 172.21.15.40:0/3791870558 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f73bc074720 con 0x7f73bc09d920 2023-09-30T22:27:06.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.548+0000 7f73b27fc700 1 -- 172.21.15.40:0/3791870558 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f73b8021070 con 0x7f73bc09d920 2023-09-30T22:27:06.549 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:06.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.550+0000 7f73c3f55700 1 -- 172.21.15.40:0/3791870558 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73bc09d920 msgr2=0x7f73bc1ccf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:06.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.550+0000 7f73c3f55700 1 --2- 172.21.15.40:0/3791870558 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73bc09d920 0x7f73bc1ccf20 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f73b800e930 tx=0x7f73b800ecf0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.550+0000 7f73c3f55700 1 -- 172.21.15.40:0/3791870558 shutdown_connections 2023-09-30T22:27:06.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.550+0000 7f73c3f55700 1 --2- 172.21.15.40:0/3791870558 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73bc11d690 0x7f73bc126350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.550+0000 7f73c3f55700 1 --2- 172.21.15.40:0/3791870558 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73bc09d920 0x7f73bc1ccf20 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.550+0000 7f73c3f55700 1 --2- 172.21.15.40:0/3791870558 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73bc133ca0 0x7f73bc1cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.550+0000 7f73c3f55700 1 -- 172.21.15.40:0/3791870558 >> 172.21.15.40:0/3791870558 conn(0x7f73bc09fb20 msgr2=0x7f73bc0a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:06.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.550+0000 7f73c3f55700 1 -- 172.21.15.40:0/3791870558 shutdown_connections 2023-09-30T22:27:06.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.550+0000 7f73c3f55700 1 -- 172.21.15.40:0/3791870558 wait complete. 2023-09-30T22:27:06.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.556+0000 7f50bc6ec700 1 -- 172.21.15.40:0/2010548553 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f50b4074720 con 0x7f50b4131df0 2023-09-30T22:27:06.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.556+0000 7f50aaffd700 1 -- 172.21.15.40:0/2010548553 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f50ac015380 con 0x7f50b4131df0 2023-09-30T22:27:06.557 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:06.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.558+0000 7f50bc6ec700 1 -- 172.21.15.40:0/2010548553 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f50b4131df0 msgr2=0x7f50b4127a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:06.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.558+0000 7f50bc6ec700 1 --2- 172.21.15.40:0/2010548553 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f50b4131df0 0x7f50b4127a30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f50ac0095e0 tx=0x7f50ac0098f0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.558+0000 7f50bc6ec700 1 -- 172.21.15.40:0/2010548553 shutdown_connections 2023-09-30T22:27:06.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.558+0000 7f50bc6ec700 1 --2- 172.21.15.40:0/2010548553 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f50b4131df0 0x7f50b4127a30 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.558+0000 7f50bc6ec700 1 --2- 172.21.15.40:0/2010548553 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50b406a6d0 0x7f50b4126fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.558+0000 7f50bc6ec700 1 --2- 172.21.15.40:0/2010548553 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50b406afe0 0x7f50b41274f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.558+0000 7f50bc6ec700 1 -- 172.21.15.40:0/2010548553 >> 172.21.15.40:0/2010548553 conn(0x7f50b409fb20 msgr2=0x7f50b4070190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:06.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.559+0000 7f50bc6ec700 1 -- 172.21.15.40:0/2010548553 shutdown_connections 2023-09-30T22:27:06.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.559+0000 7f50bc6ec700 1 -- 172.21.15.40:0/2010548553 wait complete. 2023-09-30T22:27:06.569 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:06.572 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:06.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.593+0000 7f95e7a16700 1 -- 172.21.15.40:0/4162970219 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f95e0074330 con 0x7f95e0133e00 2023-09-30T22:27:06.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.594+0000 7f95d5ffb700 1 -- 172.21.15.40:0/4162970219 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f95dc017030 con 0x7f95e0133e00 2023-09-30T22:27:06.594 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:06.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.596+0000 7f95e7a16700 1 -- 172.21.15.40:0/4162970219 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f95e0133e00 msgr2=0x7f95e0119050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:06.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.596+0000 7f95e7a16700 1 --2- 172.21.15.40:0/4162970219 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f95e0133e00 0x7f95e0119050 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f95dc00c4b0 tx=0x7f95dc00c870 comp rx=0 tx=0).stop 2023-09-30T22:27:06.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.596+0000 7f95e7a16700 1 -- 172.21.15.40:0/4162970219 shutdown_connections 2023-09-30T22:27:06.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.596+0000 7f95e7a16700 1 --2- 172.21.15.40:0/4162970219 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f95e0133e00 0x7f95e0119050 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.596+0000 7f95e7a16700 1 --2- 172.21.15.40:0/4162970219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95e0139570 0x7f95e0119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.596+0000 7f95e7a16700 1 --2- 172.21.15.40:0/4162970219 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95e0136c50 0x7f95e0119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.596+0000 7f95e7a16700 1 -- 172.21.15.40:0/4162970219 >> 172.21.15.40:0/4162970219 conn(0x7f95e00a2a00 msgr2=0x7f95e0130420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:06.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.596+0000 7f95e7a16700 1 -- 172.21.15.40:0/4162970219 shutdown_connections 2023-09-30T22:27:06.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:06.596+0000 7f95e7a16700 1 -- 172.21.15.40:0/4162970219 wait complete. 2023-09-30T22:27:06.609 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:07.493 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:07.570 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:07.572 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:07.610 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:07.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.654+0000 7f309c0c6700 1 Processor -- start 2023-09-30T22:27:07.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.654+0000 7f309c0c6700 1 -- start start 2023-09-30T22:27:07.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.655+0000 7f309c0c6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f309409d450 0x7f309409d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.655+0000 7f309c0c6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30941308d0 0x7f3094138420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.655+0000 7f309c0c6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f309409e8b0 con 0x7f309409dd60 2023-09-30T22:27:07.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.655+0000 7f309c0c6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f309409c3b0 con 0x7f309409d450 2023-09-30T22:27:07.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.655+0000 7f309c0c6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f309409a6b0 con 0x7f30941308d0 2023-09-30T22:27:07.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.655+0000 7f3099e62700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f309409d450 0x7f309409d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.655+0000 7f3099e62700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f309409d450 0x7f309409d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41996/0 (socket says 172.21.15.40:41996) 2023-09-30T22:27:07.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.655+0000 7f3099e62700 1 -- 172.21.15.40:0/1446410600 learned_addr learned my addr 172.21.15.40:0/1446410600 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:07.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.655+0000 7f309a663700 1 --2- 172.21.15.40:0/1446410600 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30941308d0 0x7f3094138420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.656+0000 7f3099e62700 1 -- 172.21.15.40:0/1446410600 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30941308d0 msgr2=0x7f3094138420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:07.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.656+0000 7f3099e62700 1 --2- 172.21.15.40:0/1446410600 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30941308d0 0x7f3094138420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.656+0000 7f3098e60700 1 -- 172.21.15.40:0/1446410600 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2328792804 0 0) 0x7f309409e8b0 con 0x7f309409dd60 2023-09-30T22:27:07.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.656+0000 7f3099e62700 1 -- 172.21.15.40:0/1446410600 >> v1:172.21.15.40:6789/0 conn(0x7f309409dd60 legacy=0x7f30941301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.656+0000 7f3099e62700 1 -- 172.21.15.40:0/1446410600 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f309409b4f0 con 0x7f309409d450 2023-09-30T22:27:07.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.656+0000 7f309a663700 1 --2- 172.21.15.40:0/1446410600 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30941308d0 0x7f3094138420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:07.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.656+0000 7f3099e62700 1 --2- 172.21.15.40:0/1446410600 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f309409d450 0x7f309409d820 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f30900098f0 tx=0x7f3090009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ace7c1f495a820 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:07.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.656+0000 7f3098e60700 1 -- 172.21.15.40:0/1446410600 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3090013c90 con 0x7f309409d450 2023-09-30T22:27:07.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.657+0000 7f3098e60700 1 -- 172.21.15.40:0/1446410600 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3090013df0 con 0x7f309409d450 2023-09-30T22:27:07.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.657+0000 7f3098e60700 1 -- 172.21.15.40:0/1446410600 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309000b6b0 con 0x7f309409d450 2023-09-30T22:27:07.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.658+0000 7f309c0c6700 1 -- 172.21.15.40:0/1446410600 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f309409d450 msgr2=0x7f309409d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.658+0000 7f309c0c6700 1 --2- 172.21.15.40:0/1446410600 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f309409d450 0x7f309409d820 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f30900098f0 tx=0x7f3090009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:07.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.658+0000 7f309c0c6700 1 -- 172.21.15.40:0/1446410600 shutdown_connections 2023-09-30T22:27:07.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.658+0000 7f309c0c6700 1 --2- 172.21.15.40:0/1446410600 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30941308d0 0x7f3094138420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.658+0000 7f309c0c6700 1 --2- 172.21.15.40:0/1446410600 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f309409d450 0x7f309409d820 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.658+0000 7f309c0c6700 1 -- 172.21.15.40:0/1446410600 >> 172.21.15.40:0/1446410600 conn(0x7f30940a2a00 msgr2=0x7f30940a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:07.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.658+0000 7f309c0c6700 1 -- 172.21.15.40:0/1446410600 shutdown_connections 2023-09-30T22:27:07.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.658+0000 7f309c0c6700 1 -- 172.21.15.40:0/1446410600 wait complete. 2023-09-30T22:27:07.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.659+0000 7f309c0c6700 1 Processor -- start 2023-09-30T22:27:07.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.659+0000 7f309c0c6700 1 -- start start 2023-09-30T22:27:07.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.659+0000 7f309c0c6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f309409d450 0x7f309411bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.659+0000 7f309c0c6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f309409dd60 0x7f309411c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.659+0000 7f309c0c6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30941308d0 0x7f30941c3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.659+0000 7f309c0c6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309411ebe0 con 0x7f309409d450 2023-09-30T22:27:07.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.659+0000 7f309c0c6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f309411edc0 con 0x7f30941308d0 2023-09-30T22:27:07.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.659+0000 7f309c0c6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f309412fc30 con 0x7f309409dd60 2023-09-30T22:27:07.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.659+0000 7f309a663700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30941308d0 0x7f30941c3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.659+0000 7f309a663700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30941308d0 0x7f30941c3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:49644/0 (socket says 172.21.15.40:49644) 2023-09-30T22:27:07.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.659+0000 7f309a663700 1 -- 172.21.15.40:0/274132265 learned_addr learned my addr 172.21.15.40:0/274132265 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:07.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.659+0000 7f3099e62700 1 --2- 172.21.15.40:0/274132265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f309409d450 0x7f309411bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.660+0000 7f3099661700 1 --2- 172.21.15.40:0/274132265 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f309409dd60 0x7f309411c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.660+0000 7f309a663700 1 -- 172.21.15.40:0/274132265 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f309409dd60 msgr2=0x7f309411c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.660+0000 7f309a663700 1 --2- 172.21.15.40:0/274132265 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f309409dd60 0x7f309411c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.660+0000 7f309a663700 1 -- 172.21.15.40:0/274132265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f309409d450 msgr2=0x7f309411bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.660+0000 7f309a663700 1 --2- 172.21.15.40:0/274132265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f309409d450 0x7f309411bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.660+0000 7f309a663700 1 -- 172.21.15.40:0/274132265 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3090009550 con 0x7f30941308d0 2023-09-30T22:27:07.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.660+0000 7f309a663700 1 --2- 172.21.15.40:0/274132265 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30941308d0 0x7f30941c3f30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f308c009fd0 tx=0x7f308c00d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:07.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.660+0000 7f308a7fc700 1 -- 172.21.15.40:0/274132265 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308c00dde0 con 0x7f30941308d0 2023-09-30T22:27:07.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.660+0000 7f308a7fc700 1 -- 172.21.15.40:0/274132265 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f308c00f040 con 0x7f30941308d0 2023-09-30T22:27:07.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.660+0000 7f308a7fc700 1 -- 172.21.15.40:0/274132265 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308c003c60 con 0x7f30941308d0 2023-09-30T22:27:07.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.661+0000 7f309c0c6700 1 -- 172.21.15.40:0/274132265 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30940a2180 con 0x7f30941308d0 2023-09-30T22:27:07.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.661+0000 7f309c0c6700 1 -- 172.21.15.40:0/274132265 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f309411d6a0 con 0x7f30941308d0 2023-09-30T22:27:07.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.662+0000 7f308a7fc700 1 -- 172.21.15.40:0/274132265 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f308c004030 con 0x7f30941308d0 2023-09-30T22:27:07.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.662+0000 7f309c0c6700 1 -- 172.21.15.40:0/274132265 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3094062380 con 0x7f30941308d0 2023-09-30T22:27:07.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.662+0000 7f308a7fc700 1 -- 172.21.15.40:0/274132265 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f308c03f7a0 con 0x7f30941308d0 2023-09-30T22:27:07.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.671+0000 7f308a7fc700 1 -- 172.21.15.40:0/274132265 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f308c01e3b0 con 0x7f30941308d0 2023-09-30T22:27:07.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.715+0000 7f7fb9343700 1 Processor -- start 2023-09-30T22:27:07.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.715+0000 7f7fb9343700 1 -- start start 2023-09-30T22:27:07.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.716+0000 7f7fb9343700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7fb412e590 0x7f7fb412e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.716+0000 7f7fb9343700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7fb412eea0 0x7f7fb412d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.716+0000 7f7fb9343700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7fb412d6d0 0x7f7fb412db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.716+0000 7f7fb9343700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb409ca30 con 0x7f7fb412d6d0 2023-09-30T22:27:07.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.716+0000 7f7fb9343700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb409ab70 con 0x7f7fb412eea0 2023-09-30T22:27:07.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.716+0000 7f7fb9343700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb409bd70 con 0x7f7fb412e590 2023-09-30T22:27:07.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.716+0000 7f7fb27fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7fb412eea0 0x7f7fb412d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.716+0000 7f7fb27fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7fb412eea0 0x7f7fb412d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:49660/0 (socket says 172.21.15.40:49660) 2023-09-30T22:27:07.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.716+0000 7f7fb27fc700 1 -- 172.21.15.40:0/3087897429 learned_addr learned my addr 172.21.15.40:0/3087897429 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:07.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.716+0000 7f7fb2ffd700 1 --2- 172.21.15.40:0/3087897429 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7fb412e590 0x7f7fb412e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.717+0000 7f7fb27fc700 1 -- 172.21.15.40:0/3087897429 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7fb412e590 msgr2=0x7f7fb412e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:07.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.717+0000 7f7fb27fc700 1 --2- 172.21.15.40:0/3087897429 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7fb412e590 0x7f7fb412e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.717+0000 7f7fb27fc700 1 -- 172.21.15.40:0/3087897429 >> v2:172.21.15.40:3300/0 conn(0x7f7fb412d6d0 msgr2=0x7f7fb412db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:07.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.717+0000 7f7fb27fc700 1 --2- 172.21.15.40:0/3087897429 >> v2:172.21.15.40:3300/0 conn(0x7f7fb412d6d0 0x7f7fb412db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.717+0000 7f7fb27fc700 1 -- 172.21.15.40:0/3087897429 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb409b270 con 0x7f7fb412eea0 2023-09-30T22:27:07.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.717+0000 7f7fb27fc700 1 --2- 172.21.15.40:0/3087897429 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7fb412eea0 0x7f7fb412d190 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800bb90 tx=0x7f7fa800bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d7c40a6fb0281f2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:07.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.717+0000 7f7fb1ffb700 1 -- 172.21.15.40:0/3087897429 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa800dc70 con 0x7f7fb412eea0 2023-09-30T22:27:07.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.717+0000 7f7fb1ffb700 1 -- 172.21.15.40:0/3087897429 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa800ddd0 con 0x7f7fb412eea0 2023-09-30T22:27:07.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.717+0000 7f7fb1ffb700 1 -- 172.21.15.40:0/3087897429 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa8012990 con 0x7f7fb412eea0 2023-09-30T22:27:07.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.718+0000 7f7fb9343700 1 -- 172.21.15.40:0/3087897429 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7fb412eea0 msgr2=0x7f7fb412d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.718+0000 7f7fb9343700 1 --2- 172.21.15.40:0/3087897429 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7fb412eea0 0x7f7fb412d190 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800bb90 tx=0x7f7fa800bea0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.718+0000 7f7fb9343700 1 -- 172.21.15.40:0/3087897429 shutdown_connections 2023-09-30T22:27:07.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.718+0000 7f7fb9343700 1 --2- 172.21.15.40:0/3087897429 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7fb412e590 0x7f7fb412e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.718+0000 7f7fb9343700 1 --2- 172.21.15.40:0/3087897429 >> v2:172.21.15.40:3300/0 conn(0x7f7fb412d6d0 0x7f7fb412db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.718+0000 7f7fb9343700 1 --2- 172.21.15.40:0/3087897429 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7fb412eea0 0x7f7fb412d190 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.718+0000 7f7fb9343700 1 -- 172.21.15.40:0/3087897429 >> 172.21.15.40:0/3087897429 conn(0x7f7fb40a2a00 msgr2=0x7f7fb40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:07.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.718+0000 7f7fb9343700 1 -- 172.21.15.40:0/3087897429 shutdown_connections 2023-09-30T22:27:07.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.718+0000 7f7fb9343700 1 -- 172.21.15.40:0/3087897429 wait complete. 2023-09-30T22:27:07.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.719+0000 7f7fb9343700 1 Processor -- start 2023-09-30T22:27:07.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.719+0000 7f7fb9343700 1 -- start start 2023-09-30T22:27:07.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.719+0000 7f7fb9343700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7fb412d6d0 0x7f7fb411ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.719+0000 7f7fb9343700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fb412e590 0x7f7fb411b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.719+0000 7f7fb9343700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7fb412eea0 0x7f7fb411b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.719+0000 7f7fb9343700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb411ccb0 con 0x7f7fb412e590 2023-09-30T22:27:07.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.719+0000 7f7fb9343700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb412ce50 con 0x7f7fb412d6d0 2023-09-30T22:27:07.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.719+0000 7f7fb9343700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb409b4b0 con 0x7f7fb412eea0 2023-09-30T22:27:07.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.720+0000 7f7fb2ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7fb412d6d0 0x7f7fb411ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.720+0000 7f7fb2ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7fb412d6d0 0x7f7fb411ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:49672/0 (socket says 172.21.15.40:49672) 2023-09-30T22:27:07.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.720+0000 7f7fb2ffd700 1 -- 172.21.15.40:0/1718052070 learned_addr learned my addr 172.21.15.40:0/1718052070 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:07.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.720+0000 7f7fb37fe700 1 --2- 172.21.15.40:0/1718052070 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7fb412eea0 0x7f7fb411b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.720+0000 7f7fb2ffd700 1 -- 172.21.15.40:0/1718052070 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7fb412eea0 msgr2=0x7f7fb411b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.720+0000 7f7fb2ffd700 1 --2- 172.21.15.40:0/1718052070 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7fb412eea0 0x7f7fb411b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.720+0000 7f7fb2ffd700 1 -- 172.21.15.40:0/1718052070 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fb412e590 msgr2=0x7f7fb411b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.720+0000 7f7fb2ffd700 1 --2- 172.21.15.40:0/1718052070 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fb412e590 0x7f7fb411b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.720+0000 7f7fb2ffd700 1 -- 172.21.15.40:0/1718052070 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa800b7f0 con 0x7f7fb412d6d0 2023-09-30T22:27:07.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.720+0000 7f7fb2ffd700 1 --2- 172.21.15.40:0/1718052070 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7fb412d6d0 0x7f7fb411ab80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400e9e0 tx=0x7f7fa400ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:07.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.720+0000 7f7f9b7fe700 1 -- 172.21.15.40:0/1718052070 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4009710 con 0x7f7fb412d6d0 2023-09-30T22:27:07.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.720+0000 7f7fb9343700 1 -- 172.21.15.40:0/1718052070 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb411d8d0 con 0x7f7fb412d6d0 2023-09-30T22:27:07.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.720+0000 7f7f9b7fe700 1 -- 172.21.15.40:0/1718052070 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa400c850 con 0x7f7fb412d6d0 2023-09-30T22:27:07.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.720+0000 7f7f9b7fe700 1 -- 172.21.15.40:0/1718052070 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa400cbc0 con 0x7f7fb412d6d0 2023-09-30T22:27:07.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.720+0000 7f7fb9343700 1 -- 172.21.15.40:0/1718052070 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb411dd20 con 0x7f7fb412d6d0 2023-09-30T22:27:07.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.722+0000 7f7f9b7fe700 1 -- 172.21.15.40:0/1718052070 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7fa400cd20 con 0x7f7fb412d6d0 2023-09-30T22:27:07.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.722+0000 7f7fb9343700 1 -- 172.21.15.40:0/1718052070 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fb4062380 con 0x7f7fb412d6d0 2023-09-30T22:27:07.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.722+0000 7f7f9b7fe700 1 -- 172.21.15.40:0/1718052070 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f7fa4042220 con 0x7f7fb412d6d0 2023-09-30T22:27:07.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.726+0000 7f621c8ca700 1 Processor -- start 2023-09-30T22:27:07.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.726+0000 7f621c8ca700 1 -- start start 2023-09-30T22:27:07.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.726+0000 7f621c8ca700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6218138250 0x7f6218138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.726+0000 7f621c8ca700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f621809df20 0x7f6218140160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.726+0000 7f621c8ca700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6218137e20 con 0x7f621809d400 2023-09-30T22:27:07.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.726+0000 7f621c8ca700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6218138050 con 0x7f621809df20 2023-09-30T22:27:07.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.726+0000 7f621c8ca700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f621809b010 con 0x7f6218138250 2023-09-30T22:27:07.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.726+0000 7f621659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6218138250 0x7f6218138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.727+0000 7f621659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6218138250 0x7f6218138620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:49686/0 (socket says 172.21.15.40:49686) 2023-09-30T22:27:07.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.727+0000 7f621659c700 1 -- 172.21.15.40:0/1760013851 learned_addr learned my addr 172.21.15.40:0/1760013851 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:07.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.727+0000 7f6216d9d700 1 --2- 172.21.15.40:0/1760013851 >> v2:172.21.15.40:3300/0 conn(0x7f621809df20 0x7f6218140160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.727+0000 7f621659c700 1 -- 172.21.15.40:0/1760013851 >> v2:172.21.15.40:3300/0 conn(0x7f621809df20 msgr2=0x7f6218140160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:07.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.727+0000 7f621659c700 1 --2- 172.21.15.40:0/1760013851 >> v2:172.21.15.40:3300/0 conn(0x7f621809df20 0x7f6218140160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.727+0000 7f621659c700 1 -- 172.21.15.40:0/1760013851 >> v1:172.21.15.40:6789/0 conn(0x7f621809d400 legacy=0x7f621809d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.727+0000 7f621659c700 1 -- 172.21.15.40:0/1760013851 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f621809f1f0 con 0x7f6218138250 2023-09-30T22:27:07.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.727+0000 7f621559a700 1 -- 172.21.15.40:0/1760013851 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3080322432 0 0) 0x7f6218137e20 con 0x7f621809d400 2023-09-30T22:27:07.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.727+0000 7f621659c700 1 --2- 172.21.15.40:0/1760013851 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6218138250 0x7f6218138620 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f62080098f0 tx=0x7f6208009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e26e6efb76ba8199 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:07.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.731+0000 7f621559a700 1 -- 172.21.15.40:0/1760013851 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620800b8a0 con 0x7f6218138250 2023-09-30T22:27:07.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.731+0000 7f621559a700 1 -- 172.21.15.40:0/1760013851 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620800ba00 con 0x7f6218138250 2023-09-30T22:27:07.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.731+0000 7f621559a700 1 -- 172.21.15.40:0/1760013851 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620800bd90 con 0x7f6218138250 2023-09-30T22:27:07.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.731+0000 7f7f9b7fe700 1 -- 172.21.15.40:0/1718052070 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7fa401bde0 con 0x7f7fb412d6d0 2023-09-30T22:27:07.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.731+0000 7f621c8ca700 1 -- 172.21.15.40:0/1760013851 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6218138250 msgr2=0x7f6218138620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.731+0000 7f621c8ca700 1 --2- 172.21.15.40:0/1760013851 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6218138250 0x7f6218138620 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f62080098f0 tx=0x7f6208009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:07.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.732+0000 7f621c8ca700 1 -- 172.21.15.40:0/1760013851 shutdown_connections 2023-09-30T22:27:07.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.732+0000 7f621c8ca700 1 --2- 172.21.15.40:0/1760013851 >> v2:172.21.15.40:3300/0 conn(0x7f621809df20 0x7f6218140160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.732+0000 7f621c8ca700 1 --2- 172.21.15.40:0/1760013851 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6218138250 0x7f6218138620 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.732+0000 7f621c8ca700 1 -- 172.21.15.40:0/1760013851 >> 172.21.15.40:0/1760013851 conn(0x7f62180a2a00 msgr2=0x7f62180a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:07.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.732+0000 7f621c8ca700 1 -- 172.21.15.40:0/1760013851 shutdown_connections 2023-09-30T22:27:07.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.732+0000 7f621c8ca700 1 -- 172.21.15.40:0/1760013851 wait complete. 2023-09-30T22:27:07.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.733+0000 7f621c8ca700 1 Processor -- start 2023-09-30T22:27:07.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.733+0000 7f621c8ca700 1 -- start start 2023-09-30T22:27:07.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.733+0000 7f621c8ca700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f621809d400 0x7f62181339c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.733+0000 7f621c8ca700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f621809df20 0x7f6218133f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.733+0000 7f621c8ca700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6218138250 0x7f6218134960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.733+0000 7f621c8ca700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621813ec70 con 0x7f621809df20 2023-09-30T22:27:07.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.733+0000 7f621c8ca700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f621813cfb0 con 0x7f6218138250 2023-09-30T22:27:07.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.733+0000 7f621c8ca700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62180a0c00 con 0x7f621809d400 2023-09-30T22:27:07.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.734+0000 7f6216d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6218138250 0x7f6218134960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.734+0000 7f6216d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6218138250 0x7f6218134960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:49688/0 (socket says 172.21.15.40:49688) 2023-09-30T22:27:07.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.734+0000 7f6216d9d700 1 -- 172.21.15.40:0/374842401 learned_addr learned my addr 172.21.15.40:0/374842401 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:07.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.734+0000 7f621659c700 1 --2- 172.21.15.40:0/374842401 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f621809d400 0x7f62181339c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.734+0000 7f6215d9b700 1 --2- 172.21.15.40:0/374842401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f621809df20 0x7f6218133f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.734+0000 7f6216d9d700 1 -- 172.21.15.40:0/374842401 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f621809d400 msgr2=0x7f62181339c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.734+0000 7f6216d9d700 1 --2- 172.21.15.40:0/374842401 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f621809d400 0x7f62181339c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.734+0000 7f6216d9d700 1 -- 172.21.15.40:0/374842401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f621809df20 msgr2=0x7f6218133f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.734+0000 7f6216d9d700 1 --2- 172.21.15.40:0/374842401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f621809df20 0x7f6218133f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.734+0000 7f6216d9d700 1 -- 172.21.15.40:0/374842401 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6208009550 con 0x7f6218138250 2023-09-30T22:27:07.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.734+0000 7f6215d9b700 1 --2- 172.21.15.40:0/374842401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f621809df20 0x7f6218133f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:07.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.734+0000 7f6216d9d700 1 --2- 172.21.15.40:0/374842401 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6218138250 0x7f6218134960 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6210007e40 tx=0x7f621000e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:07.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.734+0000 7f6206ffd700 1 -- 172.21.15.40:0/374842401 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621000ede0 con 0x7f6218138250 2023-09-30T22:27:07.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.734+0000 7f6206ffd700 1 -- 172.21.15.40:0/374842401 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6210014420 con 0x7f6218138250 2023-09-30T22:27:07.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.735+0000 7f6206ffd700 1 -- 172.21.15.40:0/374842401 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62100147d0 con 0x7f6218138250 2023-09-30T22:27:07.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.735+0000 7f621c8ca700 1 -- 172.21.15.40:0/374842401 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f621809a300 con 0x7f6218138250 2023-09-30T22:27:07.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.735+0000 7f621c8ca700 1 -- 172.21.15.40:0/374842401 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f621813e5c0 con 0x7f6218138250 2023-09-30T22:27:07.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.736+0000 7f6206ffd700 1 -- 172.21.15.40:0/374842401 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6210014930 con 0x7f6218138250 2023-09-30T22:27:07.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.736+0000 7f6206ffd700 1 -- 172.21.15.40:0/374842401 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f621003fe80 con 0x7f6218138250 2023-09-30T22:27:07.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.736+0000 7f621c8ca700 1 -- 172.21.15.40:0/374842401 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f621813c870 con 0x7f6218138250 2023-09-30T22:27:07.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.745+0000 7f6206ffd700 1 -- 172.21.15.40:0/374842401 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f621813c870 con 0x7f6218138250 2023-09-30T22:27:07.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.759+0000 7f1c3585a700 1 Processor -- start 2023-09-30T22:27:07.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.760+0000 7f1c3585a700 1 -- start start 2023-09-30T22:27:07.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.760+0000 7f1c3585a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c3009c890 0x7f1c3009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.760+0000 7f1c3585a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1c3009d920 0x7f1c3009dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.760+0000 7f1c3585a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c3009e2b0 0x7f1c3013ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.760+0000 7f1c3585a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c300a29d0 con 0x7f1c3009d920 2023-09-30T22:27:07.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.760+0000 7f1c3585a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3009fb40 con 0x7f1c3009c890 2023-09-30T22:27:07.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.760+0000 7f1c3585a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c300a2600 con 0x7f1c3009e2b0 2023-09-30T22:27:07.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.761+0000 7f1c2e7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1c3009d920 0x7f1c3009dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.761+0000 7f1c2e7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1c3009d920 0x7f1c3009dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42062/0 (socket says 172.21.15.40:42062) 2023-09-30T22:27:07.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.761+0000 7f1c2e7fc700 1 -- 172.21.15.40:0/2417234654 learned_addr learned my addr 172.21.15.40:0/2417234654 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:07.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.761+0000 7f1c2effd700 1 --2- 172.21.15.40:0/2417234654 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c3009c890 0x7f1c3009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.761+0000 7f1c2f7fe700 1 --2- 172.21.15.40:0/2417234654 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c3009e2b0 0x7f1c3013ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.761+0000 7f1c2e7fc700 1 -- 172.21.15.40:0/2417234654 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c3009e2b0 msgr2=0x7f1c3013ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:07.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.761+0000 7f1c2e7fc700 1 --2- 172.21.15.40:0/2417234654 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c3009e2b0 0x7f1c3013ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.761+0000 7f1c2e7fc700 1 -- 172.21.15.40:0/2417234654 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c3009c890 msgr2=0x7f1c3009cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:07.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.761+0000 7f1c2e7fc700 1 --2- 172.21.15.40:0/2417234654 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c3009c890 0x7f1c3009cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.761+0000 7f1c2e7fc700 1 -- 172.21.15.40:0/2417234654 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c3009e750 con 0x7f1c3009d920 2023-09-30T22:27:07.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.761+0000 7f1c2f7fe700 1 --2- 172.21.15.40:0/2417234654 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c3009e2b0 0x7f1c3013ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:07.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.761+0000 7f1c2e7fc700 1 --2- 172.21.15.40:0/2417234654 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c3009d920 0x7f1c3009dd70 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f1c240098f0 tx=0x7f1c24009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e9d4fe0798543c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:07.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.761+0000 7f1c2dffb700 1 -- 172.21.15.40:0/2417234654 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2400b8a0 con 0x7f1c3009d920 2023-09-30T22:27:07.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.761+0000 7f1c2dffb700 1 -- 172.21.15.40:0/2417234654 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c2400ba00 con 0x7f1c3009d920 2023-09-30T22:27:07.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.761+0000 7f1c2dffb700 1 -- 172.21.15.40:0/2417234654 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2400bd90 con 0x7f1c3009d920 2023-09-30T22:27:07.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.762+0000 7f1c3585a700 1 -- 172.21.15.40:0/2417234654 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c3009d920 msgr2=0x7f1c3009dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.762+0000 7f1c3585a700 1 --2- 172.21.15.40:0/2417234654 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c3009d920 0x7f1c3009dd70 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f1c240098f0 tx=0x7f1c24009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:07.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.762+0000 7f1c3585a700 1 -- 172.21.15.40:0/2417234654 shutdown_connections 2023-09-30T22:27:07.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.762+0000 7f1c3585a700 1 --2- 172.21.15.40:0/2417234654 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c3009e2b0 0x7f1c3013ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.762+0000 7f1c3585a700 1 --2- 172.21.15.40:0/2417234654 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c3009c890 0x7f1c3009cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.762+0000 7f1c3585a700 1 --2- 172.21.15.40:0/2417234654 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c3009d920 0x7f1c3009dd70 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.762+0000 7f1c3585a700 1 -- 172.21.15.40:0/2417234654 >> 172.21.15.40:0/2417234654 conn(0x7f1c300a7080 msgr2=0x7f1c300a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:07.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.762+0000 7f1c3585a700 1 -- 172.21.15.40:0/2417234654 shutdown_connections 2023-09-30T22:27:07.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.762+0000 7f1c3585a700 1 -- 172.21.15.40:0/2417234654 wait complete. 2023-09-30T22:27:07.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.763+0000 7f1c3585a700 1 Processor -- start 2023-09-30T22:27:07.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.764+0000 7f1c3585a700 1 -- start start 2023-09-30T22:27:07.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.764+0000 7f1c3585a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c3009c890 0x7f1c3012d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.764+0000 7f1c3585a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c3009e2b0 0x7f1c3012da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.764+0000 7f1c3585a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c3012dfd0 0x7f1c301cea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.764+0000 7f1c3585a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c300a5ce0 con 0x7f1c3012dfd0 2023-09-30T22:27:07.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.764+0000 7f1c3585a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c301300a0 con 0x7f1c3009c890 2023-09-30T22:27:07.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.764+0000 7f1c3585a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3012fc70 con 0x7f1c3009e2b0 2023-09-30T22:27:07.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.764+0000 7f1c2e7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c3009e2b0 0x7f1c3012da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.764+0000 7f1c2e7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c3009e2b0 0x7f1c3012da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52828/0 (socket says 172.21.15.40:52828) 2023-09-30T22:27:07.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.764+0000 7f1c2e7fc700 1 -- 172.21.15.40:0/2196956803 learned_addr learned my addr 172.21.15.40:0/2196956803 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:07.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.764+0000 7f1c2f7fe700 1 --2- 172.21.15.40:0/2196956803 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c3012dfd0 0x7f1c301cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.765+0000 7f1c2effd700 1 --2- 172.21.15.40:0/2196956803 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c3009c890 0x7f1c3012d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.765+0000 7f1c2e7fc700 1 -- 172.21.15.40:0/2196956803 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c3009c890 msgr2=0x7f1c3012d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.765+0000 7f1c2e7fc700 1 --2- 172.21.15.40:0/2196956803 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c3009c890 0x7f1c3012d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.765+0000 7f1c2e7fc700 1 -- 172.21.15.40:0/2196956803 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c3012dfd0 msgr2=0x7f1c301cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.765+0000 7f1c2e7fc700 1 --2- 172.21.15.40:0/2196956803 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c3012dfd0 0x7f1c301cea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.765+0000 7f1c2e7fc700 1 -- 172.21.15.40:0/2196956803 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c24009550 con 0x7f1c3009e2b0 2023-09-30T22:27:07.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.765+0000 7f1c2e7fc700 1 --2- 172.21.15.40:0/2196956803 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c3009e2b0 0x7f1c3012da90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1c24009c40 tx=0x7f1c24004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:07.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.765+0000 7f1c17fff700 1 -- 172.21.15.40:0/2196956803 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c240044d0 con 0x7f1c3009e2b0 2023-09-30T22:27:07.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.765+0000 7f1c3585a700 1 -- 172.21.15.40:0/2196956803 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c301304f0 con 0x7f1c3009e2b0 2023-09-30T22:27:07.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.765+0000 7f1c17fff700 1 -- 172.21.15.40:0/2196956803 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c240036a0 con 0x7f1c3009e2b0 2023-09-30T22:27:07.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.765+0000 7f1c17fff700 1 -- 172.21.15.40:0/2196956803 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c24003a50 con 0x7f1c3009e2b0 2023-09-30T22:27:07.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.765+0000 7f1c3585a700 1 -- 172.21.15.40:0/2196956803 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c3012e450 con 0x7f1c3009e2b0 2023-09-30T22:27:07.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.766+0000 7f1c3585a700 1 -- 172.21.15.40:0/2196956803 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c3012e6a0 con 0x7f1c3009e2b0 2023-09-30T22:27:07.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.767+0000 7f1c17fff700 1 -- 172.21.15.40:0/2196956803 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1c24021070 con 0x7f1c3009e2b0 2023-09-30T22:27:07.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.767+0000 7f1c17fff700 1 -- 172.21.15.40:0/2196956803 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f1c24040b90 con 0x7f1c3009e2b0 2023-09-30T22:27:07.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.776+0000 7f1c17fff700 1 -- 172.21.15.40:0/2196956803 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1c24019770 con 0x7f1c3009e2b0 2023-09-30T22:27:07.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.886+0000 7f309c0c6700 1 -- 172.21.15.40:0/274132265 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f309411ceb0 con 0x7f30941308d0 2023-09-30T22:27:07.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.886+0000 7f308a7fc700 1 -- 172.21.15.40:0/274132265 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f308c01a020 con 0x7f30941308d0 2023-09-30T22:27:07.887 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:07.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.889+0000 7f309c0c6700 1 -- 172.21.15.40:0/274132265 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30941308d0 msgr2=0x7f30941c3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.889+0000 7f309c0c6700 1 --2- 172.21.15.40:0/274132265 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30941308d0 0x7f30941c3f30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f308c009fd0 tx=0x7f308c00d3b0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.889+0000 7f309c0c6700 1 -- 172.21.15.40:0/274132265 shutdown_connections 2023-09-30T22:27:07.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.889+0000 7f309c0c6700 1 --2- 172.21.15.40:0/274132265 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30941308d0 0x7f30941c3f30 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.889+0000 7f309c0c6700 1 --2- 172.21.15.40:0/274132265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f309409d450 0x7f309411bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.889+0000 7f309c0c6700 1 --2- 172.21.15.40:0/274132265 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f309409dd60 0x7f309411c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.889+0000 7f309c0c6700 1 -- 172.21.15.40:0/274132265 >> 172.21.15.40:0/274132265 conn(0x7f30940a2a00 msgr2=0x7f30941b7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:07.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.890+0000 7f309c0c6700 1 -- 172.21.15.40:0/274132265 shutdown_connections 2023-09-30T22:27:07.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.890+0000 7f309c0c6700 1 -- 172.21.15.40:0/274132265 wait complete. 2023-09-30T22:27:07.907 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:07.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.971+0000 7f1c3585a700 1 -- 172.21.15.40:0/2196956803 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1c30062380 con 0x7f1c3009e2b0 2023-09-30T22:27:07.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.971+0000 7f1c17fff700 1 -- 172.21.15.40:0/2196956803 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1c24015030 con 0x7f1c3009e2b0 2023-09-30T22:27:07.972 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:07.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.973+0000 7f1c3585a700 1 -- 172.21.15.40:0/2196956803 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c3009e2b0 msgr2=0x7f1c3012da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.973+0000 7f1c3585a700 1 --2- 172.21.15.40:0/2196956803 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c3009e2b0 0x7f1c3012da90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1c24009c40 tx=0x7f1c24004750 comp rx=0 tx=0).stop 2023-09-30T22:27:07.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.973+0000 7f1c3585a700 1 -- 172.21.15.40:0/2196956803 shutdown_connections 2023-09-30T22:27:07.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.973+0000 7f1c3585a700 1 --2- 172.21.15.40:0/2196956803 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c3012dfd0 0x7f1c301cea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.973+0000 7f1c3585a700 1 --2- 172.21.15.40:0/2196956803 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c3009c890 0x7f1c3012d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.973+0000 7f1c3585a700 1 --2- 172.21.15.40:0/2196956803 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c3009e2b0 0x7f1c3012da90 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.973+0000 7f1c3585a700 1 -- 172.21.15.40:0/2196956803 >> 172.21.15.40:0/2196956803 conn(0x7f1c300a7080 msgr2=0x7f1c300a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:07.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.973+0000 7f1c3585a700 1 -- 172.21.15.40:0/2196956803 shutdown_connections 2023-09-30T22:27:07.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.974+0000 7f1c3585a700 1 -- 172.21.15.40:0/2196956803 wait complete. 2023-09-30T22:27:07.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.976+0000 7f7fb9343700 1 -- 172.21.15.40:0/1718052070 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7fb4074330 con 0x7f7fb412d6d0 2023-09-30T22:27:07.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.976+0000 7f7f9b7fe700 1 -- 172.21.15.40:0/1718052070 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7fa4017070 con 0x7f7fb412d6d0 2023-09-30T22:27:07.976 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:07.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.979+0000 7f7fb9343700 1 -- 172.21.15.40:0/1718052070 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7fb412d6d0 msgr2=0x7f7fb411ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.979+0000 7f7fb9343700 1 --2- 172.21.15.40:0/1718052070 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7fb412d6d0 0x7f7fb411ab80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400e9e0 tx=0x7f7fa400ecf0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.979+0000 7f7fb9343700 1 -- 172.21.15.40:0/1718052070 shutdown_connections 2023-09-30T22:27:07.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.979+0000 7f7fb9343700 1 --2- 172.21.15.40:0/1718052070 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7fb412eea0 0x7f7fb411b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.979+0000 7f7fb9343700 1 --2- 172.21.15.40:0/1718052070 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7fb412d6d0 0x7f7fb411ab80 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.979+0000 7f7fb9343700 1 --2- 172.21.15.40:0/1718052070 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fb412e590 0x7f7fb411b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.979+0000 7f7fb9343700 1 -- 172.21.15.40:0/1718052070 >> 172.21.15.40:0/1718052070 conn(0x7f7fb40a2a00 msgr2=0x7f7fb409d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:07.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.979+0000 7f7fb9343700 1 -- 172.21.15.40:0/1718052070 shutdown_connections 2023-09-30T22:27:07.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.979+0000 7f7fb9343700 1 -- 172.21.15.40:0/1718052070 wait complete. 2023-09-30T22:27:07.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.981+0000 7f621c8ca700 1 -- 172.21.15.40:0/374842401 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f621813c870 con 0x7f6218138250 2023-09-30T22:27:07.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.981+0000 7f6206ffd700 1 -- 172.21.15.40:0/374842401 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f621813c870 con 0x7f6218138250 2023-09-30T22:27:07.982 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:07.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.985+0000 7f621c8ca700 1 -- 172.21.15.40:0/374842401 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6218138250 msgr2=0x7f6218134960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.985+0000 7f621c8ca700 1 --2- 172.21.15.40:0/374842401 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6218138250 0x7f6218134960 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6210007e40 tx=0x7f621000e3c0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.985+0000 7f621c8ca700 1 -- 172.21.15.40:0/374842401 shutdown_connections 2023-09-30T22:27:07.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.985+0000 7f621c8ca700 1 --2- 172.21.15.40:0/374842401 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f621809d400 0x7f62181339c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.985+0000 7f621c8ca700 1 --2- 172.21.15.40:0/374842401 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6218138250 0x7f6218134960 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.985+0000 7f621c8ca700 1 --2- 172.21.15.40:0/374842401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f621809df20 0x7f6218133f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.985+0000 7f621c8ca700 1 -- 172.21.15.40:0/374842401 >> 172.21.15.40:0/374842401 conn(0x7f62180a2a00 msgr2=0x7f62181373f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:07.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.985+0000 7f621c8ca700 1 -- 172.21.15.40:0/374842401 shutdown_connections 2023-09-30T22:27:07.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:07.985+0000 7f621c8ca700 1 -- 172.21.15.40:0/374842401 wait complete. 2023-09-30T22:27:07.988 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:07.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:08.002 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:08.909 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:08.989 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:09.000 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:09.003 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:09.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.053+0000 7f9f1da4b700 1 Processor -- start 2023-09-30T22:27:09.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.053+0000 7f9f1da4b700 1 -- start start 2023-09-30T22:27:09.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.054+0000 7f9f1da4b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f1806a6d0 0x7f9f1806aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:09.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.054+0000 7f9f1da4b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f18131fc0 0x7f9f18139b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:09.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.054+0000 7f9f1da4b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f1809eb60 con 0x7f9f1806afe0 2023-09-30T22:27:09.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.054+0000 7f9f1da4b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1809db70 con 0x7f9f1806a6d0 2023-09-30T22:27:09.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.054+0000 7f9f1da4b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1809ddf0 con 0x7f9f18131fc0 2023-09-30T22:27:09.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.054+0000 7f9f177fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f18131fc0 0x7f9f18139b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:09.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.054+0000 7f9f177fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f18131fc0 0x7f9f18139b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52842/0 (socket says 172.21.15.40:52842) 2023-09-30T22:27:09.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.054+0000 7f9f177fe700 1 -- 172.21.15.40:0/3902220335 learned_addr learned my addr 172.21.15.40:0/3902220335 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:09.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.055+0000 7f9f177fe700 1 -- 172.21.15.40:0/3902220335 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f1806a6d0 msgr2=0x7f9f1806aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:09.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.055+0000 7f9f177fe700 1 --2- 172.21.15.40:0/3902220335 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f1806a6d0 0x7f9f1806aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.055+0000 7f9f177fe700 1 -- 172.21.15.40:0/3902220335 >> v1:172.21.15.40:6789/0 conn(0x7f9f1806afe0 legacy=0x7f9f181318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:09.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.055+0000 7f9f177fe700 1 -- 172.21.15.40:0/3902220335 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f1809c9a0 con 0x7f9f18131fc0 2023-09-30T22:27:09.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.055+0000 7f9f177fe700 1 --2- 172.21.15.40:0/3902220335 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f18131fc0 0x7f9f18139b80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9f10009e80 tx=0x7f9f1000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfd1640798bbe18 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:09.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.055+0000 7f9f15ffb700 1 -- 172.21.15.40:0/3902220335 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1000e070 con 0x7f9f18131fc0 2023-09-30T22:27:09.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.055+0000 7f9f15ffb700 1 -- 172.21.15.40:0/3902220335 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f10003a20 con 0x7f9f18131fc0 2023-09-30T22:27:09.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.055+0000 7f9f15ffb700 1 -- 172.21.15.40:0/3902220335 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f10003dd0 con 0x7f9f18131fc0 2023-09-30T22:27:09.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.056+0000 7f9f1da4b700 1 -- 172.21.15.40:0/3902220335 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f18131fc0 msgr2=0x7f9f18139b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:09.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.056+0000 7f9f1da4b700 1 --2- 172.21.15.40:0/3902220335 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f18131fc0 0x7f9f18139b80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9f10009e80 tx=0x7f9f1000b330 comp rx=0 tx=0).stop 2023-09-30T22:27:09.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.056+0000 7f9f1da4b700 1 -- 172.21.15.40:0/3902220335 shutdown_connections 2023-09-30T22:27:09.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.056+0000 7f9f1da4b700 1 --2- 172.21.15.40:0/3902220335 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f18131fc0 0x7f9f18139b80 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.056+0000 7f9f1da4b700 1 --2- 172.21.15.40:0/3902220335 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f1806a6d0 0x7f9f1806aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.056+0000 7f9f1da4b700 1 -- 172.21.15.40:0/3902220335 >> 172.21.15.40:0/3902220335 conn(0x7f9f1809fb20 msgr2=0x7f9f1809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:09.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.056+0000 7f9f1da4b700 1 -- 172.21.15.40:0/3902220335 shutdown_connections 2023-09-30T22:27:09.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.056+0000 7f9f1da4b700 1 -- 172.21.15.40:0/3902220335 wait complete. 2023-09-30T22:27:09.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.057+0000 7f9f1da4b700 1 Processor -- start 2023-09-30T22:27:09.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.057+0000 7f9f1da4b700 1 -- start start 2023-09-30T22:27:09.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.058+0000 7f9f1da4b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f1806a6d0 0x7f9f181c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:09.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.058+0000 7f9f1da4b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f1806afe0 0x7f9f181c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:09.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.058+0000 7f9f1da4b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f18131fc0 0x7f9f18130dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:09.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.058+0000 7f9f1da4b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f181c95b0 con 0x7f9f18131fc0 2023-09-30T22:27:09.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.058+0000 7f9f1da4b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1813a080 con 0x7f9f1806a6d0 2023-09-30T22:27:09.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.058+0000 7f9f1da4b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f18138f20 con 0x7f9f1806afe0 2023-09-30T22:27:09.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.058+0000 7f9f16ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f1806a6d0 0x7f9f181c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:09.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.058+0000 7f9f16ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f1806a6d0 0x7f9f181c8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:49724/0 (socket says 172.21.15.40:49724) 2023-09-30T22:27:09.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.058+0000 7f9f16ffd700 1 -- 172.21.15.40:0/937208318 learned_addr learned my addr 172.21.15.40:0/937208318 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:09.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.058+0000 7f9f167fc700 1 --2- 172.21.15.40:0/937208318 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f1806afe0 0x7f9f181c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:09.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.058+0000 7f9f16ffd700 1 -- 172.21.15.40:0/937208318 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f1806afe0 msgr2=0x7f9f181c9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:09.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.058+0000 7f9f16ffd700 1 --2- 172.21.15.40:0/937208318 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f1806afe0 0x7f9f181c9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.058+0000 7f9f16ffd700 1 -- 172.21.15.40:0/937208318 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f18131fc0 msgr2=0x7f9f18130dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:09.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.058+0000 7f9f16ffd700 1 --2- 172.21.15.40:0/937208318 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f18131fc0 0x7f9f18130dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.058+0000 7f9f16ffd700 1 -- 172.21.15.40:0/937208318 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f10009b30 con 0x7f9f1806a6d0 2023-09-30T22:27:09.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.058+0000 7f9f167fc700 1 --2- 172.21.15.40:0/937208318 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f1806afe0 0x7f9f181c9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:09.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.058+0000 7f9f16ffd700 1 --2- 172.21.15.40:0/937208318 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f1806a6d0 0x7f9f181c8b30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9f0800b520 tx=0x7f9f0800b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:09.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.059+0000 7f9efffff700 1 -- 172.21.15.40:0/937208318 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f08005aa0 con 0x7f9f1806a6d0 2023-09-30T22:27:09.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.059+0000 7f9efffff700 1 -- 172.21.15.40:0/937208318 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f08005c00 con 0x7f9f1806a6d0 2023-09-30T22:27:09.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.059+0000 7f9efffff700 1 -- 172.21.15.40:0/937208318 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f08011630 con 0x7f9f1806a6d0 2023-09-30T22:27:09.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.059+0000 7f9f1da4b700 1 -- 172.21.15.40:0/937208318 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f1809e420 con 0x7f9f1806a6d0 2023-09-30T22:27:09.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.059+0000 7f9f1da4b700 1 -- 172.21.15.40:0/937208318 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f18119a90 con 0x7f9f1806a6d0 2023-09-30T22:27:09.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.060+0000 7f9f1da4b700 1 -- 172.21.15.40:0/937208318 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f18062380 con 0x7f9f1806a6d0 2023-09-30T22:27:09.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.060+0000 7f9efffff700 1 -- 172.21.15.40:0/937208318 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9f08011790 con 0x7f9f1806a6d0 2023-09-30T22:27:09.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.061+0000 7f9efffff700 1 -- 172.21.15.40:0/937208318 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9f0803fbb0 con 0x7f9f1806a6d0 2023-09-30T22:27:09.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.066+0000 7f9efffff700 1 -- 172.21.15.40:0/937208318 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9f080233e0 con 0x7f9f1806a6d0 2023-09-30T22:27:09.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.131+0000 7f75ebd84700 1 Processor -- start 2023-09-30T22:27:09.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.132+0000 7f75ebd84700 1 -- start start 2023-09-30T22:27:09.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.132+0000 7f75ebd84700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75e409d920 0x7f75e409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:09.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.132+0000 7f75ebd84700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75e4130fb0 0x7f75e4138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:09.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.132+0000 7f75ebd84700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e409adf0 con 0x7f75e409e230 2023-09-30T22:27:09.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.132+0000 7f75ebd84700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e409edf0 con 0x7f75e4130fb0 2023-09-30T22:27:09.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.132+0000 7f75ebd84700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75e409b660 con 0x7f75e409d920 2023-09-30T22:27:09.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.132+0000 7f75e9b20700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75e409d920 0x7f75e409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:09.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.132+0000 7f75e9b20700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75e409d920 0x7f75e409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52856/0 (socket says 172.21.15.40:52856) 2023-09-30T22:27:09.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.132+0000 7f75e9b20700 1 -- 172.21.15.40:0/3874387348 learned_addr learned my addr 172.21.15.40:0/3874387348 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:09.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.133+0000 7f75ea321700 1 --2- 172.21.15.40:0/3874387348 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75e4130fb0 0x7f75e4138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:09.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.133+0000 7f75e8b1e700 1 -- 172.21.15.40:0/3874387348 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 270401594 0 0) 0x7f75e409adf0 con 0x7f75e409e230 2023-09-30T22:27:09.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.133+0000 7f75e8b1e700 1 -- 172.21.15.40:0/3874387348 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75d00035b0 con 0x7f75e409e230 2023-09-30T22:27:09.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.133+0000 7f75e9b20700 1 -- 172.21.15.40:0/3874387348 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75e4130fb0 msgr2=0x7f75e4138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:09.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.133+0000 7f75e9b20700 1 --2- 172.21.15.40:0/3874387348 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75e4130fb0 0x7f75e4138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.133+0000 7f75e9b20700 1 -- 172.21.15.40:0/3874387348 >> v1:172.21.15.40:6789/0 conn(0x7f75e409e230 legacy=0x7f75e41308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:09.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.133+0000 7f75e9b20700 1 -- 172.21.15.40:0/3874387348 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e409a6e0 con 0x7f75e409d920 2023-09-30T22:27:09.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.133+0000 7f75ea321700 1 --2- 172.21.15.40:0/3874387348 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75e4130fb0 0x7f75e4138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:09.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.133+0000 7f75e9b20700 1 --2- 172.21.15.40:0/3874387348 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75e409d920 0x7f75e409dcf0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f75e000bb90 tx=0x7f75e000bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fee93117838b0ee7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:09.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.133+0000 7f75e8b1e700 1 -- 172.21.15.40:0/3874387348 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e0005e30 con 0x7f75e409d920 2023-09-30T22:27:09.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.134+0000 7f75e8b1e700 1 -- 172.21.15.40:0/3874387348 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e0004030 con 0x7f75e409d920 2023-09-30T22:27:09.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.134+0000 7f75e8b1e700 1 -- 172.21.15.40:0/3874387348 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e00043e0 con 0x7f75e409d920 2023-09-30T22:27:09.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.134+0000 7f75ebd84700 1 -- 172.21.15.40:0/3874387348 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75e409d920 msgr2=0x7f75e409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:09.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.134+0000 7f75ebd84700 1 --2- 172.21.15.40:0/3874387348 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75e409d920 0x7f75e409dcf0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f75e000bb90 tx=0x7f75e000bea0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.135+0000 7f75ebd84700 1 -- 172.21.15.40:0/3874387348 shutdown_connections 2023-09-30T22:27:09.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.135+0000 7f75ebd84700 1 --2- 172.21.15.40:0/3874387348 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75e4130fb0 0x7f75e4138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.135+0000 7f75ebd84700 1 --2- 172.21.15.40:0/3874387348 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75e409d920 0x7f75e409dcf0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.135+0000 7f75ebd84700 1 -- 172.21.15.40:0/3874387348 >> 172.21.15.40:0/3874387348 conn(0x7f75e409fb20 msgr2=0x7f75e409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:09.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.135+0000 7f75ebd84700 1 -- 172.21.15.40:0/3874387348 shutdown_connections 2023-09-30T22:27:09.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.135+0000 7f75ebd84700 1 -- 172.21.15.40:0/3874387348 wait complete. 2023-09-30T22:27:09.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.136+0000 7f75ebd84700 1 Processor -- start 2023-09-30T22:27:09.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.136+0000 7f75ebd84700 1 -- start start 2023-09-30T22:27:09.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.137+0000 7f75ebd84700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75e409d920 0x7f75e411d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:09.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.137+0000 7f75ebd84700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75e409e230 0x7f75e411d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:09.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.137+0000 7f75ebd84700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75e4130fb0 0x7f75e411daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:09.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.137+0000 7f75ebd84700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e411e500 con 0x7f75e409d920 2023-09-30T22:27:09.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.137+0000 7f75ebd84700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e411ec80 con 0x7f75e409e230 2023-09-30T22:27:09.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.137+0000 7f75ebd84700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75e411f2a0 con 0x7f75e4130fb0 2023-09-30T22:27:09.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.137+0000 7f75e931f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75e409e230 0x7f75e411d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:09.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.137+0000 7f75e931f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75e409e230 0x7f75e411d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:49746/0 (socket says 172.21.15.40:49746) 2023-09-30T22:27:09.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.137+0000 7f75e931f700 1 -- 172.21.15.40:0/3946746604 learned_addr learned my addr 172.21.15.40:0/3946746604 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:09.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.137+0000 7f75ea321700 1 --2- 172.21.15.40:0/3946746604 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75e4130fb0 0x7f75e411daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:09.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.137+0000 7f75e9b20700 1 --2- 172.21.15.40:0/3946746604 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75e409d920 0x7f75e411d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:09.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.137+0000 7f75e931f700 1 -- 172.21.15.40:0/3946746604 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75e4130fb0 msgr2=0x7f75e411daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:09.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.137+0000 7f75e931f700 1 --2- 172.21.15.40:0/3946746604 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75e4130fb0 0x7f75e411daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.137+0000 7f75e931f700 1 -- 172.21.15.40:0/3946746604 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75e409d920 msgr2=0x7f75e411d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:09.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.137+0000 7f75e931f700 1 --2- 172.21.15.40:0/3946746604 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75e409d920 0x7f75e411d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.137+0000 7f75e931f700 1 -- 172.21.15.40:0/3946746604 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75dc009a70 con 0x7f75e409e230 2023-09-30T22:27:09.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.137+0000 7f75e931f700 1 --2- 172.21.15.40:0/3946746604 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75e409e230 0x7f75e411d5b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f75d400c550 tx=0x7f75d400c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:09.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.138+0000 7f75da7fc700 1 -- 172.21.15.40:0/3946746604 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d40052d0 con 0x7f75e409e230 2023-09-30T22:27:09.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.138+0000 7f75ebd84700 1 -- 172.21.15.40:0/3946746604 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75e000b7a0 con 0x7f75e409e230 2023-09-30T22:27:09.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.138+0000 7f75da7fc700 1 -- 172.21.15.40:0/3946746604 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d4005430 con 0x7f75e409e230 2023-09-30T22:27:09.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.138+0000 7f75da7fc700 1 -- 172.21.15.40:0/3946746604 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d4003880 con 0x7f75e409e230 2023-09-30T22:27:09.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.138+0000 7f75ebd84700 1 -- 172.21.15.40:0/3946746604 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75e40712b0 con 0x7f75e409e230 2023-09-30T22:27:09.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.139+0000 7f75ebd84700 1 -- 172.21.15.40:0/3946746604 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75e409cb00 con 0x7f75e409e230 2023-09-30T22:27:09.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.139+0000 7f75da7fc700 1 -- 172.21.15.40:0/3946746604 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f75d40039e0 con 0x7f75e409e230 2023-09-30T22:27:09.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.139+0000 7f75da7fc700 1 -- 172.21.15.40:0/3946746604 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f75d403eb20 con 0x7f75e409e230 2023-09-30T22:27:09.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.144+0000 7f75da7fc700 1 -- 172.21.15.40:0/3946746604 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f75d4010b60 con 0x7f75e409e230 2023-09-30T22:27:09.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.169+0000 7f0985df4700 1 Processor -- start 2023-09-30T22:27:09.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.169+0000 7f0985df4700 1 -- start start 2023-09-30T22:27:09.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.170+0000 7f0985df4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f098009d920 0x7f098009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:09.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.170+0000 7f0985df4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f098009f0f0 0x7f098009e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:09.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.170+0000 7f0985df4700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f098009f940 con 0x7f0980133ca0 2023-09-30T22:27:09.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.170+0000 7f0985df4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f098006b4c0 con 0x7f098009f0f0 2023-09-30T22:27:09.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.170+0000 7f0985df4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f098009a8f0 con 0x7f098009d920 2023-09-30T22:27:09.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.170+0000 7f097effd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f098009f0f0 0x7f098009e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:09.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.170+0000 7f097effd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f098009f0f0 0x7f098009e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42082/0 (socket says 172.21.15.40:42082) 2023-09-30T22:27:09.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.170+0000 7f097effd700 1 -- 172.21.15.40:0/4138839587 learned_addr learned my addr 172.21.15.40:0/4138839587 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:09.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.171+0000 7f097f7fe700 1 --2- 172.21.15.40:0/4138839587 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f098009d920 0x7f098009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:09.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.171+0000 7f097effd700 1 -- 172.21.15.40:0/4138839587 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f098009d920 msgr2=0x7f098009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:09.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.171+0000 7f097effd700 1 --2- 172.21.15.40:0/4138839587 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f098009d920 0x7f098009dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.171+0000 7f097effd700 1 -- 172.21.15.40:0/4138839587 >> v1:172.21.15.40:6789/0 conn(0x7f0980133ca0 legacy=0x7f0980134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:09.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.171+0000 7f097effd700 1 -- 172.21.15.40:0/4138839587 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098009f6e0 con 0x7f098009f0f0 2023-09-30T22:27:09.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.171+0000 7f097effd700 1 --2- 172.21.15.40:0/4138839587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f098009f0f0 0x7f098009e230 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f0974009920 tx=0x7f0974009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb46b0804ec393ef server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:09.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.171+0000 7f097e7fc700 1 -- 172.21.15.40:0/4138839587 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0974011830 con 0x7f098009f0f0 2023-09-30T22:27:09.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.171+0000 7f097e7fc700 1 -- 172.21.15.40:0/4138839587 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0974011990 con 0x7f098009f0f0 2023-09-30T22:27:09.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.171+0000 7f097e7fc700 1 -- 172.21.15.40:0/4138839587 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0974011d20 con 0x7f098009f0f0 2023-09-30T22:27:09.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.172+0000 7f0985df4700 1 -- 172.21.15.40:0/4138839587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f098009f0f0 msgr2=0x7f098009e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:09.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.172+0000 7f0985df4700 1 --2- 172.21.15.40:0/4138839587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f098009f0f0 0x7f098009e230 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f0974009920 tx=0x7f0974009c30 comp rx=0 tx=0).stop 2023-09-30T22:27:09.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.172+0000 7f0985df4700 1 -- 172.21.15.40:0/4138839587 shutdown_connections 2023-09-30T22:27:09.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.172+0000 7f0985df4700 1 --2- 172.21.15.40:0/4138839587 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f098009d920 0x7f098009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.172+0000 7f0985df4700 1 --2- 172.21.15.40:0/4138839587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f098009f0f0 0x7f098009e230 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.172+0000 7f0985df4700 1 -- 172.21.15.40:0/4138839587 >> 172.21.15.40:0/4138839587 conn(0x7f098009fb20 msgr2=0x7f098009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:09.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.172+0000 7f0985df4700 1 -- 172.21.15.40:0/4138839587 shutdown_connections 2023-09-30T22:27:09.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.172+0000 7f0985df4700 1 -- 172.21.15.40:0/4138839587 wait complete. 2023-09-30T22:27:09.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.172+0000 7f191e9ac700 1 Processor -- start 2023-09-30T22:27:09.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.172+0000 7f191e9ac700 1 -- start start 2023-09-30T22:27:09.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.173+0000 7f191e9ac700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f191809d920 0x7f191809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:09.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.173+0000 7f191e9ac700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f191809f0f0 0x7f191809e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:09.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.173+0000 7f191e9ac700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1918133ca0 0x7f1918134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:09.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.173+0000 7f191e9ac700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f191806b4c0 con 0x7f191809f0f0 2023-09-30T22:27:09.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.173+0000 7f191e9ac700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f191809a8f0 con 0x7f1918133ca0 2023-09-30T22:27:09.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.173+0000 7f191e9ac700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f191809f940 con 0x7f191809d920 2023-09-30T22:27:09.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.173+0000 7f191cf49700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1918133ca0 0x7f1918134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:09.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.173+0000 7f191cf49700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1918133ca0 0x7f1918134140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:49748/0 (socket says 172.21.15.40:49748) 2023-09-30T22:27:09.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.173+0000 7f191cf49700 1 -- 172.21.15.40:0/3437471120 learned_addr learned my addr 172.21.15.40:0/3437471120 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:09.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.173+0000 7f0985df4700 1 Processor -- start 2023-09-30T22:27:09.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.173+0000 7f19177fe700 1 --2- 172.21.15.40:0/3437471120 >> v2:172.21.15.40:3300/0 conn(0x7f191809f0f0 0x7f191809e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:09.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.173+0000 7f191cf49700 1 -- 172.21.15.40:0/3437471120 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f191809d920 msgr2=0x7f191809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:09.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.173+0000 7f191cf49700 1 --2- 172.21.15.40:0/3437471120 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f191809d920 0x7f191809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.173+0000 7f191cf49700 1 -- 172.21.15.40:0/3437471120 >> v2:172.21.15.40:3300/0 conn(0x7f191809f0f0 msgr2=0x7f191809e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:09.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.173+0000 7f191cf49700 1 --2- 172.21.15.40:0/3437471120 >> v2:172.21.15.40:3300/0 conn(0x7f191809f0f0 0x7f191809e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.174+0000 7f191cf49700 1 -- 172.21.15.40:0/3437471120 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f191809f6e0 con 0x7f1918133ca0 2023-09-30T22:27:09.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.174+0000 7f19177fe700 1 --2- 172.21.15.40:0/3437471120 >> v2:172.21.15.40:3300/0 conn(0x7f191809f0f0 0x7f191809e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:27:09.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.174+0000 7f0985df4700 1 -- start start 2023-09-30T22:27:09.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.174+0000 7f191cf49700 1 --2- 172.21.15.40:0/3437471120 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1918133ca0 0x7f1918134140 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1910009eb0 tx=0x7f191000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c7896610fcfcbf4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:09.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.174+0000 7f1916ffd700 1 -- 172.21.15.40:0/3437471120 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191000e070 con 0x7f1918133ca0 2023-09-30T22:27:09.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.174+0000 7f1916ffd700 1 -- 172.21.15.40:0/3437471120 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191000b940 con 0x7f1918133ca0 2023-09-30T22:27:09.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.174+0000 7f1916ffd700 1 -- 172.21.15.40:0/3437471120 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191000bcf0 con 0x7f1918133ca0 2023-09-30T22:27:09.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.175+0000 7f191e9ac700 1 -- 172.21.15.40:0/3437471120 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1918133ca0 msgr2=0x7f1918134140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:09.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.175+0000 7f191e9ac700 1 --2- 172.21.15.40:0/3437471120 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1918133ca0 0x7f1918134140 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1910009eb0 tx=0x7f191000b330 comp rx=0 tx=0).stop 2023-09-30T22:27:09.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.175+0000 7f0985df4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f098009d920 0x7f09801217e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:09.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.175+0000 7f0985df4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0980133ca0 0x7f0980121d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:09.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.175+0000 7f0985df4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0980122260 0x7f09801c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:09.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.175+0000 7f0985df4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0980122cb0 con 0x7f0980122260 2023-09-30T22:27:09.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.175+0000 7f0985df4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0980125300 con 0x7f0980133ca0 2023-09-30T22:27:09.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.175+0000 7f0985df4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f098009c9e0 con 0x7f098009d920 2023-09-30T22:27:09.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.175+0000 7f191e9ac700 1 -- 172.21.15.40:0/3437471120 shutdown_connections 2023-09-30T22:27:09.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.175+0000 7f191e9ac700 1 --2- 172.21.15.40:0/3437471120 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f191809d920 0x7f191809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.175+0000 7f191e9ac700 1 --2- 172.21.15.40:0/3437471120 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1918133ca0 0x7f1918134140 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.175+0000 7f191e9ac700 1 --2- 172.21.15.40:0/3437471120 >> v2:172.21.15.40:3300/0 conn(0x7f191809f0f0 0x7f191809e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.175+0000 7f191e9ac700 1 -- 172.21.15.40:0/3437471120 >> 172.21.15.40:0/3437471120 conn(0x7f191809fb20 msgr2=0x7f191809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:09.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.175+0000 7f097effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0980133ca0 0x7f0980121d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:09.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.175+0000 7f097effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0980133ca0 0x7f0980121d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:49756/0 (socket says 172.21.15.40:49756) 2023-09-30T22:27:09.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.175+0000 7f097effd700 1 -- 172.21.15.40:0/2705425020 learned_addr learned my addr 172.21.15.40:0/2705425020 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:09.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.175+0000 7f097ffff700 1 --2- 172.21.15.40:0/2705425020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0980122260 0x7f09801c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:09.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.175+0000 7f191e9ac700 1 -- 172.21.15.40:0/3437471120 shutdown_connections 2023-09-30T22:27:09.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.175+0000 7f191e9ac700 1 -- 172.21.15.40:0/3437471120 wait complete. 2023-09-30T22:27:09.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.176+0000 7f191e9ac700 1 Processor -- start 2023-09-30T22:27:09.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.177+0000 7f191e9ac700 1 -- start start 2023-09-30T22:27:09.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.175+0000 7f097effd700 1 -- 172.21.15.40:0/2705425020 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f098009d920 msgr2=0x7f09801217e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:09.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.175+0000 7f097effd700 1 --2- 172.21.15.40:0/2705425020 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f098009d920 0x7f09801217e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.175+0000 7f097effd700 1 -- 172.21.15.40:0/2705425020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0980122260 msgr2=0x7f09801c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:09.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.175+0000 7f097effd700 1 --2- 172.21.15.40:0/2705425020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0980122260 0x7f09801c8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.175+0000 7f097effd700 1 -- 172.21.15.40:0/2705425020 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0974009550 con 0x7f0980133ca0 2023-09-30T22:27:09.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.175+0000 7f097effd700 1 --2- 172.21.15.40:0/2705425020 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0980133ca0 0x7f0980121d20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0974009c70 tx=0x7f0974004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:09.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.176+0000 7f0967fff700 1 -- 172.21.15.40:0/2705425020 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0974004300 con 0x7f0980133ca0 2023-09-30T22:27:09.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.176+0000 7f0967fff700 1 -- 172.21.15.40:0/2705425020 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097401f070 con 0x7f0980133ca0 2023-09-30T22:27:09.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.176+0000 7f0985df4700 1 -- 172.21.15.40:0/2705425020 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09801233f0 con 0x7f0980133ca0 2023-09-30T22:27:09.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.176+0000 7f0967fff700 1 -- 172.21.15.40:0/2705425020 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09740036a0 con 0x7f0980133ca0 2023-09-30T22:27:09.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.176+0000 7f0985df4700 1 -- 172.21.15.40:0/2705425020 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0980132730 con 0x7f0980133ca0 2023-09-30T22:27:09.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.176+0000 7f0967fff700 1 -- 172.21.15.40:0/2705425020 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0974021030 con 0x7f0980133ca0 2023-09-30T22:27:09.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.176+0000 7f0967fff700 1 -- 172.21.15.40:0/2705425020 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f09740408c0 con 0x7f0980133ca0 2023-09-30T22:27:09.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.177+0000 7f0985df4700 1 -- 172.21.15.40:0/2705425020 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0980124cc0 con 0x7f0980133ca0 2023-09-30T22:27:09.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.177+0000 7f191e9ac700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f191809d920 0x7f19181218c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:09.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.177+0000 7f191e9ac700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1918133ca0 0x7f1918121e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:09.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.177+0000 7f191e9ac700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1918122340 0x7f19181c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:09.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.177+0000 7f191e9ac700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191809c9e0 con 0x7f1918122340 2023-09-30T22:27:09.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.177+0000 7f191e9ac700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1918125100 con 0x7f191809d920 2023-09-30T22:27:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.177+0000 7f191e9ac700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19181235e0 con 0x7f1918133ca0 2023-09-30T22:27:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.177+0000 7f191cf49700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1918122340 0x7f19181c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.177+0000 7f191cf49700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1918122340 0x7f19181c87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42108/0 (socket says 172.21.15.40:42108) 2023-09-30T22:27:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.177+0000 7f191cf49700 1 -- 172.21.15.40:0/4025424759 learned_addr learned my addr 172.21.15.40:0/4025424759 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.178+0000 7f19177fe700 1 --2- 172.21.15.40:0/4025424759 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1918133ca0 0x7f1918121e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.178+0000 7f1917fff700 1 --2- 172.21.15.40:0/4025424759 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f191809d920 0x7f19181218c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.178+0000 7f191cf49700 1 -- 172.21.15.40:0/4025424759 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1918133ca0 msgr2=0x7f1918121e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.178+0000 7f191cf49700 1 --2- 172.21.15.40:0/4025424759 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1918133ca0 0x7f1918121e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.178+0000 7f191cf49700 1 -- 172.21.15.40:0/4025424759 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f191809d920 msgr2=0x7f19181218c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.178+0000 7f191cf49700 1 --2- 172.21.15.40:0/4025424759 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f191809d920 0x7f19181218c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.178+0000 7f191cf49700 1 -- 172.21.15.40:0/4025424759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1910009b30 con 0x7f1918122340 2023-09-30T22:27:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.178+0000 7f191cf49700 1 --2- 172.21.15.40:0/4025424759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1918122340 0x7f19181c87b0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f191809b7b0 tx=0x7f1910004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:09.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.178+0000 7f1914ff9700 1 -- 172.21.15.40:0/4025424759 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1910004450 con 0x7f1918122340 2023-09-30T22:27:09.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.178+0000 7f1914ff9700 1 -- 172.21.15.40:0/4025424759 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19100045d0 con 0x7f1918122340 2023-09-30T22:27:09.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.178+0000 7f1914ff9700 1 -- 172.21.15.40:0/4025424759 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1910025460 con 0x7f1918122340 2023-09-30T22:27:09.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.178+0000 7f191e9ac700 1 -- 172.21.15.40:0/4025424759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19180a2bc0 con 0x7f1918122340 2023-09-30T22:27:09.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.178+0000 7f191e9ac700 1 -- 172.21.15.40:0/4025424759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1918125b70 con 0x7f1918122340 2023-09-30T22:27:09.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.179+0000 7f191e9ac700 1 -- 172.21.15.40:0/4025424759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1918062380 con 0x7f1918122340 2023-09-30T22:27:09.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.179+0000 7f1914ff9700 1 -- 172.21.15.40:0/4025424759 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f191001c410 con 0x7f1918122340 2023-09-30T22:27:09.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.180+0000 7f1914ff9700 1 -- 172.21.15.40:0/4025424759 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f1910041110 con 0x7f1918122340 2023-09-30T22:27:09.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.185+0000 7f0967fff700 1 -- 172.21.15.40:0/2705425020 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0980124cc0 con 0x7f0980133ca0 2023-09-30T22:27:09.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.188+0000 7f1914ff9700 1 -- 172.21.15.40:0/4025424759 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1910023770 con 0x7f1918122340 2023-09-30T22:27:09.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.272+0000 7f9f1da4b700 1 -- 172.21.15.40:0/937208318 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9f1809e270 con 0x7f9f1806a6d0 2023-09-30T22:27:09.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.272+0000 7f9efffff700 1 -- 172.21.15.40:0/937208318 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9f080193b0 con 0x7f9f1806a6d0 2023-09-30T22:27:09.273 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:09.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.275+0000 7f9f1da4b700 1 -- 172.21.15.40:0/937208318 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f1806a6d0 msgr2=0x7f9f181c8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:09.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.275+0000 7f9f1da4b700 1 --2- 172.21.15.40:0/937208318 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f1806a6d0 0x7f9f181c8b30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9f0800b520 tx=0x7f9f0800b8e0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.276+0000 7f9f1da4b700 1 -- 172.21.15.40:0/937208318 shutdown_connections 2023-09-30T22:27:09.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.276+0000 7f9f1da4b700 1 --2- 172.21.15.40:0/937208318 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f18131fc0 0x7f9f18130dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.276+0000 7f9f1da4b700 1 --2- 172.21.15.40:0/937208318 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f1806a6d0 0x7f9f181c8b30 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.276+0000 7f9f1da4b700 1 --2- 172.21.15.40:0/937208318 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f1806afe0 0x7f9f181c9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.276+0000 7f9f1da4b700 1 -- 172.21.15.40:0/937208318 >> 172.21.15.40:0/937208318 conn(0x7f9f1809fb20 msgr2=0x7f9f1806e180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:09.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.276+0000 7f9f1da4b700 1 -- 172.21.15.40:0/937208318 shutdown_connections 2023-09-30T22:27:09.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.276+0000 7f9f1da4b700 1 -- 172.21.15.40:0/937208318 wait complete. 2023-09-30T22:27:09.294 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:09.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.353+0000 7f75ebd84700 1 -- 172.21.15.40:0/3946746604 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f75e4062380 con 0x7f75e409e230 2023-09-30T22:27:09.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.353+0000 7f75da7fc700 1 -- 172.21.15.40:0/3946746604 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f75d4017020 con 0x7f75e409e230 2023-09-30T22:27:09.354 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:09.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.355+0000 7f75ebd84700 1 -- 172.21.15.40:0/3946746604 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75e409e230 msgr2=0x7f75e411d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:09.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.355+0000 7f75ebd84700 1 --2- 172.21.15.40:0/3946746604 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75e409e230 0x7f75e411d5b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f75d400c550 tx=0x7f75d400c910 comp rx=0 tx=0).stop 2023-09-30T22:27:09.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.355+0000 7f75ebd84700 1 -- 172.21.15.40:0/3946746604 shutdown_connections 2023-09-30T22:27:09.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.355+0000 7f75ebd84700 1 --2- 172.21.15.40:0/3946746604 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75e4130fb0 0x7f75e411daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.355+0000 7f75ebd84700 1 --2- 172.21.15.40:0/3946746604 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75e409d920 0x7f75e411d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.355+0000 7f75ebd84700 1 --2- 172.21.15.40:0/3946746604 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75e409e230 0x7f75e411d5b0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.355+0000 7f75ebd84700 1 -- 172.21.15.40:0/3946746604 >> 172.21.15.40:0/3946746604 conn(0x7f75e409fb20 msgr2=0x7f75e412fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:09.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.355+0000 7f75ebd84700 1 -- 172.21.15.40:0/3946746604 shutdown_connections 2023-09-30T22:27:09.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.355+0000 7f75ebd84700 1 -- 172.21.15.40:0/3946746604 wait complete. 2023-09-30T22:27:09.369 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:09.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.384+0000 7f0985df4700 1 -- 172.21.15.40:0/2705425020 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0980124cc0 con 0x7f0980133ca0 2023-09-30T22:27:09.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.385+0000 7f0967fff700 1 -- 172.21.15.40:0/2705425020 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0980124cc0 con 0x7f0980133ca0 2023-09-30T22:27:09.385 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:09.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.386+0000 7f191e9ac700 1 -- 172.21.15.40:0/4025424759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1918074720 con 0x7f1918122340 2023-09-30T22:27:09.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.386+0000 7f1914ff9700 1 -- 172.21.15.40:0/4025424759 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f191002a030 con 0x7f1918122340 2023-09-30T22:27:09.387 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:09.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.387+0000 7f0985df4700 1 -- 172.21.15.40:0/2705425020 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0980133ca0 msgr2=0x7f0980121d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:09.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.387+0000 7f0985df4700 1 --2- 172.21.15.40:0/2705425020 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0980133ca0 0x7f0980121d20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0974009c70 tx=0x7f0974004750 comp rx=0 tx=0).stop 2023-09-30T22:27:09.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.387+0000 7f0985df4700 1 -- 172.21.15.40:0/2705425020 shutdown_connections 2023-09-30T22:27:09.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.387+0000 7f0985df4700 1 --2- 172.21.15.40:0/2705425020 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f098009d920 0x7f09801217e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.387+0000 7f0985df4700 1 --2- 172.21.15.40:0/2705425020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0980122260 0x7f09801c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.387+0000 7f0985df4700 1 --2- 172.21.15.40:0/2705425020 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0980133ca0 0x7f0980121d20 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.387+0000 7f0985df4700 1 -- 172.21.15.40:0/2705425020 >> 172.21.15.40:0/2705425020 conn(0x7f098009fb20 msgr2=0x7f09800a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:09.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.387+0000 7f0985df4700 1 -- 172.21.15.40:0/2705425020 shutdown_connections 2023-09-30T22:27:09.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.387+0000 7f0985df4700 1 -- 172.21.15.40:0/2705425020 wait complete. 2023-09-30T22:27:09.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.389+0000 7f191e9ac700 1 -- 172.21.15.40:0/4025424759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1918122340 msgr2=0x7f19181c87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:09.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.389+0000 7f191e9ac700 1 --2- 172.21.15.40:0/4025424759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1918122340 0x7f19181c87b0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f191809b7b0 tx=0x7f1910004ad0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.389+0000 7f191e9ac700 1 -- 172.21.15.40:0/4025424759 shutdown_connections 2023-09-30T22:27:09.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.389+0000 7f191e9ac700 1 --2- 172.21.15.40:0/4025424759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1918122340 0x7f19181c87b0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.389+0000 7f191e9ac700 1 --2- 172.21.15.40:0/4025424759 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f191809d920 0x7f19181218c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.389+0000 7f191e9ac700 1 --2- 172.21.15.40:0/4025424759 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1918133ca0 0x7f1918121e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.389+0000 7f191e9ac700 1 -- 172.21.15.40:0/4025424759 >> 172.21.15.40:0/4025424759 conn(0x7f191809fb20 msgr2=0x7f19180a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:09.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.389+0000 7f191e9ac700 1 -- 172.21.15.40:0/4025424759 shutdown_connections 2023-09-30T22:27:09.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:09.389+0000 7f191e9ac700 1 -- 172.21.15.40:0/4025424759 wait complete. 2023-09-30T22:27:09.401 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:09.402 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:10.294 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:10.370 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:10.403 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:10.403 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:10.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.439+0000 7f01ebd33700 1 Processor -- start 2023-09-30T22:27:10.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.439+0000 7f01ebd33700 1 -- start start 2023-09-30T22:27:10.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.440+0000 7f01ebd33700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f01e406f3a0 0x7f01e406c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.440+0000 7f01ebd33700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f01e4139380 0x7f01e413b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.440+0000 7f01ebd33700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01e40a0780 con 0x7f01e409fbb0 2023-09-30T22:27:10.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.440+0000 7f01ebd33700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01e409ff80 con 0x7f01e4139380 2023-09-30T22:27:10.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.440+0000 7f01ebd33700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01e40a0590 con 0x7f01e406f3a0 2023-09-30T22:27:10.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.440+0000 7f01ea2d0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f01e4139380 0x7f01e413b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:10.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.440+0000 7f01e9acf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f01e406f3a0 0x7f01e406c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:10.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.441+0000 7f01ea2d0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f01e4139380 0x7f01e413b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:49774/0 (socket says 172.21.15.40:49774) 2023-09-30T22:27:10.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.441+0000 7f01e9acf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f01e406f3a0 0x7f01e406c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52912/0 (socket says 172.21.15.40:52912) 2023-09-30T22:27:10.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.441+0000 7f01ea2d0700 1 -- 172.21.15.40:0/2229626551 learned_addr learned my addr 172.21.15.40:0/2229626551 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:10.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.441+0000 7f01ea2d0700 1 -- 172.21.15.40:0/2229626551 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f01e406f3a0 msgr2=0x7f01e406c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:10.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.441+0000 7f01ea2d0700 1 --2- 172.21.15.40:0/2229626551 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f01e406f3a0 0x7f01e406c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.441+0000 7f01ea2d0700 1 -- 172.21.15.40:0/2229626551 >> v1:172.21.15.40:6789/0 conn(0x7f01e409fbb0 legacy=0x7f01e406ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:10.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.441+0000 7f01ea2d0700 1 -- 172.21.15.40:0/2229626551 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e406df90 con 0x7f01e4139380 2023-09-30T22:27:10.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.441+0000 7f01ea2d0700 1 --2- 172.21.15.40:0/2229626551 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f01e4139380 0x7f01e413b760 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f01dc009e80 tx=0x7f01dc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e76d64d3e040c37 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:10.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.441+0000 7f01e8acd700 1 -- 172.21.15.40:0/2229626551 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc00e070 con 0x7f01e4139380 2023-09-30T22:27:10.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.441+0000 7f01e8acd700 1 -- 172.21.15.40:0/2229626551 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01dc00b9c0 con 0x7f01e4139380 2023-09-30T22:27:10.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.441+0000 7f01e8acd700 1 -- 172.21.15.40:0/2229626551 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc00bd70 con 0x7f01e4139380 2023-09-30T22:27:10.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.442+0000 7f01ebd33700 1 -- 172.21.15.40:0/2229626551 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f01e4139380 msgr2=0x7f01e413b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:10.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.442+0000 7f01ebd33700 1 --2- 172.21.15.40:0/2229626551 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f01e4139380 0x7f01e413b760 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f01dc009e80 tx=0x7f01dc00b330 comp rx=0 tx=0).stop 2023-09-30T22:27:10.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.442+0000 7f01ebd33700 1 -- 172.21.15.40:0/2229626551 shutdown_connections 2023-09-30T22:27:10.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.442+0000 7f01ebd33700 1 --2- 172.21.15.40:0/2229626551 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f01e4139380 0x7f01e413b760 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.442+0000 7f01ebd33700 1 --2- 172.21.15.40:0/2229626551 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f01e406f3a0 0x7f01e406c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.442+0000 7f01ebd33700 1 -- 172.21.15.40:0/2229626551 >> 172.21.15.40:0/2229626551 conn(0x7f01e40a41a0 msgr2=0x7f01e40a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:10.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.443+0000 7f01ebd33700 1 -- 172.21.15.40:0/2229626551 shutdown_connections 2023-09-30T22:27:10.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.443+0000 7f01ebd33700 1 -- 172.21.15.40:0/2229626551 wait complete. 2023-09-30T22:27:10.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.444+0000 7f01ebd33700 1 Processor -- start 2023-09-30T22:27:10.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.444+0000 7f01ebd33700 1 -- start start 2023-09-30T22:27:10.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.444+0000 7f01ebd33700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f01e406f3a0 0x7f01e4137ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.445+0000 7f01ebd33700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01e409fbb0 0x7f01e4137ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.445+0000 7f01ebd33700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f01e4139380 0x7f01e41cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.445+0000 7f01ebd33700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e4134b10 con 0x7f01e409fbb0 2023-09-30T22:27:10.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.445+0000 7f01ebd33700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01e4135370 con 0x7f01e406f3a0 2023-09-30T22:27:10.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.445+0000 7f01ebd33700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01e4136a20 con 0x7f01e4139380 2023-09-30T22:27:10.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.445+0000 7f01e92ce700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01e409fbb0 0x7f01e4137ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:10.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.445+0000 7f01e92ce700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01e409fbb0 0x7f01e4137ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42112/0 (socket says 172.21.15.40:42112) 2023-09-30T22:27:10.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.445+0000 7f01e92ce700 1 -- 172.21.15.40:0/2526843974 learned_addr learned my addr 172.21.15.40:0/2526843974 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:10.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.445+0000 7f01ea2d0700 1 --2- 172.21.15.40:0/2526843974 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f01e4139380 0x7f01e41cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:10.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.445+0000 7f01e92ce700 1 -- 172.21.15.40:0/2526843974 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f01e4139380 msgr2=0x7f01e41cc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:10.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.445+0000 7f01e92ce700 1 --2- 172.21.15.40:0/2526843974 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f01e4139380 0x7f01e41cc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.445+0000 7f01e92ce700 1 -- 172.21.15.40:0/2526843974 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f01e406f3a0 msgr2=0x7f01e4137ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:10.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.445+0000 7f01e92ce700 1 --2- 172.21.15.40:0/2526843974 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f01e406f3a0 0x7f01e4137ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.445+0000 7f01e92ce700 1 -- 172.21.15.40:0/2526843974 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01dc009b30 con 0x7f01e409fbb0 2023-09-30T22:27:10.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.445+0000 7f01e92ce700 1 --2- 172.21.15.40:0/2526843974 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01e409fbb0 0x7f01e4137ff0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f01d400c510 tx=0x7f01d400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:10.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.446+0000 7f01da7fc700 1 -- 172.21.15.40:0/2526843974 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d40052d0 con 0x7f01e409fbb0 2023-09-30T22:27:10.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.446+0000 7f01da7fc700 1 -- 172.21.15.40:0/2526843974 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d4005430 con 0x7f01e409fbb0 2023-09-30T22:27:10.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.446+0000 7f01da7fc700 1 -- 172.21.15.40:0/2526843974 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d40038c0 con 0x7f01e409fbb0 2023-09-30T22:27:10.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.446+0000 7f01ebd33700 1 -- 172.21.15.40:0/2526843974 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01e4071eb0 con 0x7f01e409fbb0 2023-09-30T22:27:10.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.446+0000 7f01ebd33700 1 -- 172.21.15.40:0/2526843974 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01e4135080 con 0x7f01e409fbb0 2023-09-30T22:27:10.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.447+0000 7f01ebd33700 1 -- 172.21.15.40:0/2526843974 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01e41365a0 con 0x7f01e409fbb0 2023-09-30T22:27:10.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.447+0000 7f01da7fc700 1 -- 172.21.15.40:0/2526843974 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f01d4003a20 con 0x7f01e409fbb0 2023-09-30T22:27:10.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.448+0000 7f01da7fc700 1 -- 172.21.15.40:0/2526843974 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f01d403ec80 con 0x7f01e409fbb0 2023-09-30T22:27:10.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.453+0000 7f01da7fc700 1 -- 172.21.15.40:0/2526843974 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f01e41365a0 con 0x7f01e409fbb0 2023-09-30T22:27:10.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.513+0000 7f87acfea700 1 Processor -- start 2023-09-30T22:27:10.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.513+0000 7f87acfea700 1 -- start start 2023-09-30T22:27:10.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.513+0000 7f87acfea700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87a8131d50 0x7f87a8132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.513+0000 7f87acfea700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87a809c7d0 0x7f87a8139ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.513+0000 7f87acfea700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a8132660 con 0x7f87a809bc50 2023-09-30T22:27:10.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.513+0000 7f87acfea700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a80719e0 con 0x7f87a809c7d0 2023-09-30T22:27:10.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.513+0000 7f87acfea700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87a8131900 con 0x7f87a8131d50 2023-09-30T22:27:10.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.514+0000 7f87a659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87a8131d50 0x7f87a8132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:10.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.514+0000 7f87a6d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87a809c7d0 0x7f87a8139ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:10.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.514+0000 7f87a659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87a8131d50 0x7f87a8132120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52922/0 (socket says 172.21.15.40:52922) 2023-09-30T22:27:10.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.514+0000 7f87a6d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87a809c7d0 0x7f87a8139ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:49792/0 (socket says 172.21.15.40:49792) 2023-09-30T22:27:10.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.514+0000 7f87a659c700 1 -- 172.21.15.40:0/3388521319 learned_addr learned my addr 172.21.15.40:0/3388521319 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:10.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.514+0000 7f87a659c700 1 -- 172.21.15.40:0/3388521319 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87a809c7d0 msgr2=0x7f87a8139ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:10.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.514+0000 7f87a659c700 1 --2- 172.21.15.40:0/3388521319 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87a809c7d0 0x7f87a8139ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.514+0000 7f87a659c700 1 -- 172.21.15.40:0/3388521319 >> v1:172.21.15.40:6789/0 conn(0x7f87a809bc50 legacy=0x7f87a809c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:10.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.514+0000 7f87a559a700 1 -- 172.21.15.40:0/3388521319 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 815108221 0 0) 0x7f87a8132660 con 0x7f87a809bc50 2023-09-30T22:27:10.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.514+0000 7f87a659c700 1 -- 172.21.15.40:0/3388521319 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a809e820 con 0x7f87a8131d50 2023-09-30T22:27:10.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.514+0000 7f87a659c700 1 --2- 172.21.15.40:0/3388521319 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87a8131d50 0x7f87a8132120 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8798009950 tx=0x7f8798009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4932dc8e2fb8b75 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:10.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.514+0000 7f87a559a700 1 -- 172.21.15.40:0/3388521319 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8798009ea0 con 0x7f87a8131d50 2023-09-30T22:27:10.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.514+0000 7f87a559a700 1 -- 172.21.15.40:0/3388521319 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879800ba20 con 0x7f87a8131d50 2023-09-30T22:27:10.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.514+0000 7f87a559a700 1 -- 172.21.15.40:0/3388521319 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879800bdb0 con 0x7f87a8131d50 2023-09-30T22:27:10.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.515+0000 7f87acfea700 1 -- 172.21.15.40:0/3388521319 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87a8131d50 msgr2=0x7f87a8132120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:10.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.515+0000 7f87acfea700 1 --2- 172.21.15.40:0/3388521319 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87a8131d50 0x7f87a8132120 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8798009950 tx=0x7f8798009c60 comp rx=0 tx=0).stop 2023-09-30T22:27:10.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.515+0000 7f87acfea700 1 -- 172.21.15.40:0/3388521319 shutdown_connections 2023-09-30T22:27:10.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.515+0000 7f87acfea700 1 --2- 172.21.15.40:0/3388521319 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87a809c7d0 0x7f87a8139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.515+0000 7f87acfea700 1 --2- 172.21.15.40:0/3388521319 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87a8131d50 0x7f87a8132120 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.515+0000 7f87acfea700 1 -- 172.21.15.40:0/3388521319 >> 172.21.15.40:0/3388521319 conn(0x7f87a80a2a00 msgr2=0x7f87a80a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:10.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.515+0000 7f87acfea700 1 -- 172.21.15.40:0/3388521319 shutdown_connections 2023-09-30T22:27:10.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.515+0000 7f87acfea700 1 -- 172.21.15.40:0/3388521319 wait complete. 2023-09-30T22:27:10.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.517+0000 7f87acfea700 1 Processor -- start 2023-09-30T22:27:10.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.517+0000 7f87acfea700 1 -- start start 2023-09-30T22:27:10.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.518+0000 7f87acfea700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87a809bc50 0x7f87a81c0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.518+0000 7f87acfea700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87a809c7d0 0x7f87a81c14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.518+0000 7f87acfea700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87a8131d50 0x7f87a81c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.518+0000 7f87acfea700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a812e0b0 con 0x7f87a8131d50 2023-09-30T22:27:10.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.518+0000 7f87acfea700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a811df70 con 0x7f87a809bc50 2023-09-30T22:27:10.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.518+0000 7f87acfea700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87a81c19e0 con 0x7f87a809c7d0 2023-09-30T22:27:10.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.518+0000 7f87a659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87a809bc50 0x7f87a81c0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:10.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.518+0000 7f87a659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87a809bc50 0x7f87a81c0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:49808/0 (socket says 172.21.15.40:49808) 2023-09-30T22:27:10.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.518+0000 7f87a659c700 1 -- 172.21.15.40:0/658201879 learned_addr learned my addr 172.21.15.40:0/658201879 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:10.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.518+0000 7f87a5d9b700 1 --2- 172.21.15.40:0/658201879 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87a809c7d0 0x7f87a81c14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:10.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.518+0000 7f87a6d9d700 1 --2- 172.21.15.40:0/658201879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87a8131d50 0x7f87a81c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:10.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.518+0000 7f87a5d9b700 1 -- 172.21.15.40:0/658201879 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87a809bc50 msgr2=0x7f87a81c0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:10.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.518+0000 7f87a5d9b700 1 --2- 172.21.15.40:0/658201879 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87a809bc50 0x7f87a81c0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.518+0000 7f87a5d9b700 1 -- 172.21.15.40:0/658201879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87a8131d50 msgr2=0x7f87a81c3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:10.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.518+0000 7f87a5d9b700 1 --2- 172.21.15.40:0/658201879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87a8131d50 0x7f87a81c3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.518+0000 7f87a5d9b700 1 -- 172.21.15.40:0/658201879 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8798009550 con 0x7f87a809c7d0 2023-09-30T22:27:10.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.519+0000 7f87a5d9b700 1 --2- 172.21.15.40:0/658201879 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87a809c7d0 0x7f87a81c14a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f879c00c3e0 tx=0x7f879c00c6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:10.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.519+0000 7f8796ffd700 1 -- 172.21.15.40:0/658201879 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c0052d0 con 0x7f87a809c7d0 2023-09-30T22:27:10.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.519+0000 7f8796ffd700 1 -- 172.21.15.40:0/658201879 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879c005430 con 0x7f87a809c7d0 2023-09-30T22:27:10.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.519+0000 7f87acfea700 1 -- 172.21.15.40:0/658201879 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87a809eac0 con 0x7f87a809c7d0 2023-09-30T22:27:10.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.519+0000 7f8796ffd700 1 -- 172.21.15.40:0/658201879 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c0038a0 con 0x7f87a809c7d0 2023-09-30T22:27:10.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.519+0000 7f87acfea700 1 -- 172.21.15.40:0/658201879 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87a811c340 con 0x7f87a809c7d0 2023-09-30T22:27:10.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.520+0000 7f87acfea700 1 -- 172.21.15.40:0/658201879 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87a8062380 con 0x7f87a809c7d0 2023-09-30T22:27:10.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.521+0000 7f8796ffd700 1 -- 172.21.15.40:0/658201879 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f879c003a00 con 0x7f87a809c7d0 2023-09-30T22:27:10.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.521+0000 7f8796ffd700 1 -- 172.21.15.40:0/658201879 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f879c03ee20 con 0x7f87a809c7d0 2023-09-30T22:27:10.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.529+0000 7f8796ffd700 1 -- 172.21.15.40:0/658201879 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f879c019b40 con 0x7f87a809c7d0 2023-09-30T22:27:10.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.553+0000 7f7a29684700 1 Processor -- start 2023-09-30T22:27:10.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.553+0000 7f7a29684700 1 -- start start 2023-09-30T22:27:10.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.554+0000 7f7a29684700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a2406a6d0 0x7f7a2409d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.554+0000 7f7a29684700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7a2409de60 0x7f7a2409e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.554+0000 7f7a29684700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a2413c490 0x7f7a2413e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.554+0000 7f7a29684700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a2406aaa0 con 0x7f7a2409de60 2023-09-30T22:27:10.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.554+0000 7f7a29684700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2409e790 con 0x7f7a2413c490 2023-09-30T22:27:10.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.554+0000 7f7a29684700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2406b150 con 0x7f7a2406a6d0 2023-09-30T22:27:10.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.554+0000 7f7a22ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a2406a6d0 0x7f7a2409d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:10.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.554+0000 7f7a22ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a2406a6d0 0x7f7a2409d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52934/0 (socket says 172.21.15.40:52934) 2023-09-30T22:27:10.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.554+0000 7f7a227fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7a2409de60 0x7f7a2409e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:10.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.554+0000 7f7a22ffd700 1 -- 172.21.15.40:0/2286964462 learned_addr learned my addr 172.21.15.40:0/2286964462 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:10.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.554+0000 7f7a237fe700 1 --2- 172.21.15.40:0/2286964462 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a2413c490 0x7f7a2413e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:10.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.554+0000 7f7a22ffd700 1 -- 172.21.15.40:0/2286964462 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a2413c490 msgr2=0x7f7a2413e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:10.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.554+0000 7f7a22ffd700 1 --2- 172.21.15.40:0/2286964462 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a2413c490 0x7f7a2413e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.554+0000 7f7a22ffd700 1 -- 172.21.15.40:0/2286964462 >> v2:172.21.15.40:3300/0 conn(0x7f7a2409de60 msgr2=0x7f7a2409e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:10.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.554+0000 7f7a22ffd700 1 --2- 172.21.15.40:0/2286964462 >> v2:172.21.15.40:3300/0 conn(0x7f7a2409de60 0x7f7a2409e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.554+0000 7f7a22ffd700 1 -- 172.21.15.40:0/2286964462 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a2409f300 con 0x7f7a2406a6d0 2023-09-30T22:27:10.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.555+0000 7f7a227fc700 1 --2- 172.21.15.40:0/2286964462 >> v2:172.21.15.40:3300/0 conn(0x7f7a2409de60 0x7f7a2409e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:10.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.555+0000 7f7a22ffd700 1 --2- 172.21.15.40:0/2286964462 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a2406a6d0 0x7f7a2409d920 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7a140098f0 tx=0x7f7a14009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=258aee0071f3b774 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:10.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.555+0000 7f7a21ffb700 1 -- 172.21.15.40:0/2286964462 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14005e30 con 0x7f7a2406a6d0 2023-09-30T22:27:10.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.555+0000 7f7a21ffb700 1 -- 172.21.15.40:0/2286964462 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a14004030 con 0x7f7a2406a6d0 2023-09-30T22:27:10.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.555+0000 7f7a21ffb700 1 -- 172.21.15.40:0/2286964462 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a140043e0 con 0x7f7a2406a6d0 2023-09-30T22:27:10.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.556+0000 7f7a29684700 1 -- 172.21.15.40:0/2286964462 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a2406a6d0 msgr2=0x7f7a2409d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:10.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.556+0000 7f7a29684700 1 --2- 172.21.15.40:0/2286964462 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a2406a6d0 0x7f7a2409d920 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7a140098f0 tx=0x7f7a14009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:10.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.556+0000 7f7a29684700 1 -- 172.21.15.40:0/2286964462 shutdown_connections 2023-09-30T22:27:10.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.556+0000 7f7a29684700 1 --2- 172.21.15.40:0/2286964462 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a2406a6d0 0x7f7a2409d920 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.556+0000 7f7a29684700 1 --2- 172.21.15.40:0/2286964462 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a2413c490 0x7f7a2413e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.556+0000 7f7a29684700 1 --2- 172.21.15.40:0/2286964462 >> v2:172.21.15.40:3300/0 conn(0x7f7a2409de60 0x7f7a2409e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.556+0000 7f7a29684700 1 -- 172.21.15.40:0/2286964462 >> 172.21.15.40:0/2286964462 conn(0x7f7a2409fb20 msgr2=0x7f7a2409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:10.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.556+0000 7f7a29684700 1 -- 172.21.15.40:0/2286964462 shutdown_connections 2023-09-30T22:27:10.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.556+0000 7f7a29684700 1 -- 172.21.15.40:0/2286964462 wait complete. 2023-09-30T22:27:10.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.557+0000 7f7a29684700 1 Processor -- start 2023-09-30T22:27:10.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.558+0000 7f7a29684700 1 -- start start 2023-09-30T22:27:10.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.558+0000 7f7a29684700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a2406a6d0 0x7f7a2413adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.558+0000 7f7a29684700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a2409de60 0x7f7a2413b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.558+0000 7f7a29684700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a2413c490 0x7f7a2413b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.558+0000 7f7a29684700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2413c310 con 0x7f7a2406a6d0 2023-09-30T22:27:10.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.558+0000 7f7a29684700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a24120590 con 0x7f7a2413c490 2023-09-30T22:27:10.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.558+0000 7f7a29684700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2409f540 con 0x7f7a2409de60 2023-09-30T22:27:10.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.558+0000 7f7a227fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a2409de60 0x7f7a2413b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:10.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.558+0000 7f7a227fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a2409de60 0x7f7a2413b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52948/0 (socket says 172.21.15.40:52948) 2023-09-30T22:27:10.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.558+0000 7f7a227fc700 1 -- 172.21.15.40:0/1817720955 learned_addr learned my addr 172.21.15.40:0/1817720955 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:10.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.559+0000 7f7a237fe700 1 --2- 172.21.15.40:0/1817720955 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a2413c490 0x7f7a2413b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:10.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.559+0000 7f7a22ffd700 1 --2- 172.21.15.40:0/1817720955 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a2406a6d0 0x7f7a2413adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:10.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.559+0000 7f7a227fc700 1 -- 172.21.15.40:0/1817720955 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a2413c490 msgr2=0x7f7a2413b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:10.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.559+0000 7f7a227fc700 1 --2- 172.21.15.40:0/1817720955 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a2413c490 0x7f7a2413b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.559+0000 7f7a227fc700 1 -- 172.21.15.40:0/1817720955 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a2406a6d0 msgr2=0x7f7a2413adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:10.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.559+0000 7f7a227fc700 1 --2- 172.21.15.40:0/1817720955 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a2406a6d0 0x7f7a2413adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.559+0000 7f7a227fc700 1 -- 172.21.15.40:0/1817720955 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a180094a0 con 0x7f7a2409de60 2023-09-30T22:27:10.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.559+0000 7f7a227fc700 1 --2- 172.21.15.40:0/1817720955 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a2409de60 0x7f7a2413b300 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7a1800ebe0 tx=0x7f7a1800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:10.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.559+0000 7f7a0b7fe700 1 -- 172.21.15.40:0/1817720955 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1800c850 con 0x7f7a2409de60 2023-09-30T22:27:10.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.559+0000 7f7a0b7fe700 1 -- 172.21.15.40:0/1817720955 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1800c9b0 con 0x7f7a2409de60 2023-09-30T22:27:10.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.559+0000 7f7a0b7fe700 1 -- 172.21.15.40:0/1817720955 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1800cd40 con 0x7f7a2409de60 2023-09-30T22:27:10.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.559+0000 7f7a29684700 1 -- 172.21.15.40:0/1817720955 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a14009500 con 0x7f7a2409de60 2023-09-30T22:27:10.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.559+0000 7f7a29684700 1 -- 172.21.15.40:0/1817720955 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a2411fbb0 con 0x7f7a2409de60 2023-09-30T22:27:10.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.560+0000 7f7a0b7fe700 1 -- 172.21.15.40:0/1817720955 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7a18013470 con 0x7f7a2409de60 2023-09-30T22:27:10.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.560+0000 7f7a29684700 1 -- 172.21.15.40:0/1817720955 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a24062380 con 0x7f7a2409de60 2023-09-30T22:27:10.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.561+0000 7f7a0b7fe700 1 -- 172.21.15.40:0/1817720955 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f7a1803f840 con 0x7f7a2409de60 2023-09-30T22:27:10.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.565+0000 7f7a0b7fe700 1 -- 172.21.15.40:0/1817720955 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7a18013720 con 0x7f7a2409de60 2023-09-30T22:27:10.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.569+0000 7fd60c006700 1 Processor -- start 2023-09-30T22:27:10.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.569+0000 7fd60c006700 1 -- start start 2023-09-30T22:27:10.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.570+0000 7fd60c006700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd60409e400 0x7fd604135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.570+0000 7fd60c006700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd604136230 0x7fd604138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.570+0000 7fd60c006700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd60409adf0 con 0x7fd60409d920 2023-09-30T22:27:10.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.570+0000 7fd60c006700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd60409edf0 con 0x7fd60409e400 2023-09-30T22:27:10.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.570+0000 7fd60c006700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd60409b660 con 0x7fd604136230 2023-09-30T22:27:10.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.570+0000 7fd6095a1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd60409e400 0x7fd604135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:10.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.570+0000 7fd6095a1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd60409e400 0x7fd604135cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42142/0 (socket says 172.21.15.40:42142) 2023-09-30T22:27:10.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.570+0000 7fd6095a1700 1 -- 172.21.15.40:0/738708211 learned_addr learned my addr 172.21.15.40:0/738708211 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:10.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.570+0000 7fd60a5a3700 1 --2- 172.21.15.40:0/738708211 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd604136230 0x7fd604138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:10.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.571+0000 7fd60a5a3700 1 -- 172.21.15.40:0/738708211 >> v2:172.21.15.40:3300/0 conn(0x7fd60409e400 msgr2=0x7fd604135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:10.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.571+0000 7fd60a5a3700 1 --2- 172.21.15.40:0/738708211 >> v2:172.21.15.40:3300/0 conn(0x7fd60409e400 0x7fd604135cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.571+0000 7fd60a5a3700 1 -- 172.21.15.40:0/738708211 >> v1:172.21.15.40:6789/0 conn(0x7fd60409d920 legacy=0x7fd60409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:10.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.571+0000 7fd60a5a3700 1 -- 172.21.15.40:0/738708211 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60409a6e0 con 0x7fd604136230 2023-09-30T22:27:10.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.571+0000 7fd60a5a3700 1 --2- 172.21.15.40:0/738708211 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd604136230 0x7fd604138610 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc009d90 tx=0x7fd5fc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cd9faaae24a62dd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:10.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.571+0000 7fd608da0700 1 -- 172.21.15.40:0/738708211 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc00e070 con 0x7fd604136230 2023-09-30T22:27:10.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.571+0000 7fd608da0700 1 -- 172.21.15.40:0/738708211 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5fc00bb20 con 0x7fd604136230 2023-09-30T22:27:10.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.571+0000 7fd608da0700 1 -- 172.21.15.40:0/738708211 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc012430 con 0x7fd604136230 2023-09-30T22:27:10.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.572+0000 7fd60c006700 1 -- 172.21.15.40:0/738708211 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd604136230 msgr2=0x7fd604138610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:10.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.572+0000 7fd60c006700 1 --2- 172.21.15.40:0/738708211 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd604136230 0x7fd604138610 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc009d90 tx=0x7fd5fc00b330 comp rx=0 tx=0).stop 2023-09-30T22:27:10.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.572+0000 7fd60c006700 1 -- 172.21.15.40:0/738708211 shutdown_connections 2023-09-30T22:27:10.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.572+0000 7fd60c006700 1 --2- 172.21.15.40:0/738708211 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd604136230 0x7fd604138610 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.572+0000 7fd60c006700 1 --2- 172.21.15.40:0/738708211 >> v2:172.21.15.40:3300/0 conn(0x7fd60409e400 0x7fd604135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.572+0000 7fd60c006700 1 -- 172.21.15.40:0/738708211 >> 172.21.15.40:0/738708211 conn(0x7fd60409fb20 msgr2=0x7fd60409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:10.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.572+0000 7fd60c006700 1 -- 172.21.15.40:0/738708211 shutdown_connections 2023-09-30T22:27:10.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.572+0000 7fd60c006700 1 -- 172.21.15.40:0/738708211 wait complete. 2023-09-30T22:27:10.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.573+0000 7fd60c006700 1 Processor -- start 2023-09-30T22:27:10.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.573+0000 7fd60c006700 1 -- start start 2023-09-30T22:27:10.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.574+0000 7fd60c006700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd60409d920 0x7fd60411ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.574+0000 7fd60c006700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd60409e400 0x7fd60411ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.574+0000 7fd60c006700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd604136230 0x7fd604139bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.574+0000 7fd60c006700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60411cc10 con 0x7fd60409d920 2023-09-30T22:27:10.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.574+0000 7fd60c006700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd604135ff0 con 0x7fd60409e400 2023-09-30T22:27:10.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.574+0000 7fd60c006700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd60409cb00 con 0x7fd604136230 2023-09-30T22:27:10.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.574+0000 7fd6095a1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd60409e400 0x7fd60411ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:10.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.574+0000 7fd609da2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd60409d920 0x7fd60411ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:10.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.574+0000 7fd6095a1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd60409e400 0x7fd60411ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:49820/0 (socket says 172.21.15.40:49820) 2023-09-30T22:27:10.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.574+0000 7fd609da2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd60409d920 0x7fd60411ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42144/0 (socket says 172.21.15.40:42144) 2023-09-30T22:27:10.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.574+0000 7fd6095a1700 1 -- 172.21.15.40:0/2500357329 learned_addr learned my addr 172.21.15.40:0/2500357329 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:10.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.574+0000 7fd60a5a3700 1 --2- 172.21.15.40:0/2500357329 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd604136230 0x7fd604139bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:10.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.575+0000 7fd609da2700 1 -- 172.21.15.40:0/2500357329 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd604136230 msgr2=0x7fd604139bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:10.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.575+0000 7fd609da2700 1 --2- 172.21.15.40:0/2500357329 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd604136230 0x7fd604139bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.575+0000 7fd609da2700 1 -- 172.21.15.40:0/2500357329 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd60409e400 msgr2=0x7fd60411ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:10.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.575+0000 7fd609da2700 1 --2- 172.21.15.40:0/2500357329 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd60409e400 0x7fd60411ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.575+0000 7fd609da2700 1 -- 172.21.15.40:0/2500357329 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5fc009a70 con 0x7fd60409d920 2023-09-30T22:27:10.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.575+0000 7fd609da2700 1 --2- 172.21.15.40:0/2500357329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd60409d920 0x7fd60411ea10 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd600000fd0 tx=0x7fd60000c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:10.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.575+0000 7fd5fa7fc700 1 -- 172.21.15.40:0/2500357329 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6000052d0 con 0x7fd60409d920 2023-09-30T22:27:10.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.575+0000 7fd5fa7fc700 1 -- 172.21.15.40:0/2500357329 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd600005430 con 0x7fd60409d920 2023-09-30T22:27:10.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.575+0000 7fd60c006700 1 -- 172.21.15.40:0/2500357329 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd604135a80 con 0x7fd60409d920 2023-09-30T22:27:10.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.575+0000 7fd5fa7fc700 1 -- 172.21.15.40:0/2500357329 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6000038a0 con 0x7fd60409d920 2023-09-30T22:27:10.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.575+0000 7fd60c006700 1 -- 172.21.15.40:0/2500357329 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd60411c3a0 con 0x7fd60409d920 2023-09-30T22:27:10.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.576+0000 7fd60c006700 1 -- 172.21.15.40:0/2500357329 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd604062380 con 0x7fd60409d920 2023-09-30T22:27:10.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.576+0000 7fd5fa7fc700 1 -- 172.21.15.40:0/2500357329 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd600003a00 con 0x7fd60409d920 2023-09-30T22:27:10.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.580+0000 7fd5fa7fc700 1 -- 172.21.15.40:0/2500357329 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd600010950 con 0x7fd60409d920 2023-09-30T22:27:10.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.585+0000 7fd5fa7fc700 1 -- 172.21.15.40:0/2500357329 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd600044060 con 0x7fd60409d920 2023-09-30T22:27:10.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.678+0000 7f01ebd33700 1 -- 172.21.15.40:0/2526843974 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f01e41365a0 con 0x7f01e409fbb0 2023-09-30T22:27:10.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.678+0000 7f01da7fc700 1 -- 172.21.15.40:0/2526843974 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f01e41365a0 con 0x7f01e409fbb0 2023-09-30T22:27:10.679 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:10.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.680+0000 7f01ebd33700 1 -- 172.21.15.40:0/2526843974 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01e409fbb0 msgr2=0x7f01e4137ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:10.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.680+0000 7f01ebd33700 1 --2- 172.21.15.40:0/2526843974 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01e409fbb0 0x7f01e4137ff0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f01d400c510 tx=0x7f01d400c820 comp rx=0 tx=0).stop 2023-09-30T22:27:10.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.680+0000 7f01ebd33700 1 -- 172.21.15.40:0/2526843974 shutdown_connections 2023-09-30T22:27:10.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.680+0000 7f01ebd33700 1 --2- 172.21.15.40:0/2526843974 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f01e4139380 0x7f01e41cc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.680+0000 7f01ebd33700 1 --2- 172.21.15.40:0/2526843974 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f01e406f3a0 0x7f01e4137ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.680+0000 7f01ebd33700 1 --2- 172.21.15.40:0/2526843974 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01e409fbb0 0x7f01e4137ff0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.680+0000 7f01ebd33700 1 -- 172.21.15.40:0/2526843974 >> 172.21.15.40:0/2526843974 conn(0x7f01e40a41a0 msgr2=0x7f01e409dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:10.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.680+0000 7f01ebd33700 1 -- 172.21.15.40:0/2526843974 shutdown_connections 2023-09-30T22:27:10.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.680+0000 7f01ebd33700 1 -- 172.21.15.40:0/2526843974 wait complete. 2023-09-30T22:27:10.694 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:10.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.741+0000 7f87acfea700 1 -- 172.21.15.40:0/658201879 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f87a811e0b0 con 0x7f87a809c7d0 2023-09-30T22:27:10.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.741+0000 7f8796ffd700 1 -- 172.21.15.40:0/658201879 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f87a811e0b0 con 0x7f87a809c7d0 2023-09-30T22:27:10.742 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:10.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.743+0000 7f87acfea700 1 -- 172.21.15.40:0/658201879 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87a809c7d0 msgr2=0x7f87a81c14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:10.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.743+0000 7f87acfea700 1 --2- 172.21.15.40:0/658201879 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87a809c7d0 0x7f87a81c14a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f879c00c3e0 tx=0x7f879c00c6f0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.743+0000 7f87acfea700 1 -- 172.21.15.40:0/658201879 shutdown_connections 2023-09-30T22:27:10.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.743+0000 7f87acfea700 1 --2- 172.21.15.40:0/658201879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87a8131d50 0x7f87a81c3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.743+0000 7f87acfea700 1 --2- 172.21.15.40:0/658201879 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87a809bc50 0x7f87a81c0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.743+0000 7f87acfea700 1 --2- 172.21.15.40:0/658201879 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87a809c7d0 0x7f87a81c14a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.743+0000 7f87acfea700 1 -- 172.21.15.40:0/658201879 >> 172.21.15.40:0/658201879 conn(0x7f87a80a2a00 msgr2=0x7f87a8130e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:10.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.744+0000 7f87acfea700 1 -- 172.21.15.40:0/658201879 shutdown_connections 2023-09-30T22:27:10.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.744+0000 7f87acfea700 1 -- 172.21.15.40:0/658201879 wait complete. 2023-09-30T22:27:10.756 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:10.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.765+0000 7f7a29684700 1 -- 172.21.15.40:0/1817720955 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7a2406ae60 con 0x7f7a2409de60 2023-09-30T22:27:10.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.766+0000 7f7a0b7fe700 1 -- 172.21.15.40:0/1817720955 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7a1801bb60 con 0x7f7a2409de60 2023-09-30T22:27:10.766 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:10.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.768+0000 7f7a29684700 1 -- 172.21.15.40:0/1817720955 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a2409de60 msgr2=0x7f7a2413b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:10.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.768+0000 7f7a29684700 1 --2- 172.21.15.40:0/1817720955 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a2409de60 0x7f7a2413b300 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7a1800ebe0 tx=0x7f7a1800eef0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.768+0000 7f7a29684700 1 -- 172.21.15.40:0/1817720955 shutdown_connections 2023-09-30T22:27:10.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.768+0000 7f7a29684700 1 --2- 172.21.15.40:0/1817720955 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a2413c490 0x7f7a2413b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.768+0000 7f7a29684700 1 --2- 172.21.15.40:0/1817720955 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a2406a6d0 0x7f7a2413adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.768+0000 7f7a29684700 1 --2- 172.21.15.40:0/1817720955 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a2409de60 0x7f7a2413b300 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.768+0000 7f7a29684700 1 -- 172.21.15.40:0/1817720955 >> 172.21.15.40:0/1817720955 conn(0x7f7a2409fb20 msgr2=0x7f7a2413d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:10.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.768+0000 7f7a29684700 1 -- 172.21.15.40:0/1817720955 shutdown_connections 2023-09-30T22:27:10.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.768+0000 7f7a29684700 1 -- 172.21.15.40:0/1817720955 wait complete. 2023-09-30T22:27:10.781 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:10.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.788+0000 7fd60c006700 1 -- 172.21.15.40:0/2500357329 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd604074720 con 0x7fd60409d920 2023-09-30T22:27:10.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.789+0000 7fd5fa7fc700 1 -- 172.21.15.40:0/2500357329 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd600044020 con 0x7fd60409d920 2023-09-30T22:27:10.789 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:10.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.791+0000 7fd60c006700 1 -- 172.21.15.40:0/2500357329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd60409d920 msgr2=0x7fd60411ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:10.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.791+0000 7fd60c006700 1 --2- 172.21.15.40:0/2500357329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd60409d920 0x7fd60411ea10 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd600000fd0 tx=0x7fd60000c6e0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.791+0000 7fd60c006700 1 -- 172.21.15.40:0/2500357329 shutdown_connections 2023-09-30T22:27:10.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.791+0000 7fd60c006700 1 --2- 172.21.15.40:0/2500357329 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd604136230 0x7fd604139bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.791+0000 7fd60c006700 1 --2- 172.21.15.40:0/2500357329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd60409d920 0x7fd60411ea10 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.791+0000 7fd60c006700 1 --2- 172.21.15.40:0/2500357329 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd60409e400 0x7fd60411ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.791+0000 7fd60c006700 1 -- 172.21.15.40:0/2500357329 >> 172.21.15.40:0/2500357329 conn(0x7fd60409fb20 msgr2=0x7fd6040a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:10.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.791+0000 7fd60c006700 1 -- 172.21.15.40:0/2500357329 shutdown_connections 2023-09-30T22:27:10.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:10.791+0000 7fd60c006700 1 -- 172.21.15.40:0/2500357329 wait complete. 2023-09-30T22:27:10.804 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:11.695 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:11.757 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:11.782 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:11.805 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:11.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.844+0000 7f605971e700 1 Processor -- start 2023-09-30T22:27:11.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.844+0000 7f605971e700 1 -- start start 2023-09-30T22:27:11.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.844+0000 7f605971e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f605409d920 0x7f605409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.844+0000 7f605971e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f605409e230 0x7f60541343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.844+0000 7f605971e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f605409f940 con 0x7f605409f0f0 2023-09-30T22:27:11.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.844+0000 7f605971e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f605406b4c0 con 0x7f605409e230 2023-09-30T22:27:11.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.844+0000 7f605971e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f605409a8f0 con 0x7f605409d920 2023-09-30T22:27:11.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.844+0000 7f6052ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f605409d920 0x7f605409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.844+0000 7f6052ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f605409d920 0x7f605409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:49836/0 (socket says 172.21.15.40:49836) 2023-09-30T22:27:11.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.844+0000 7f6052ffd700 1 -- 172.21.15.40:0/2193918872 learned_addr learned my addr 172.21.15.40:0/2193918872 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:11.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.844+0000 7f60537fe700 1 --2- 172.21.15.40:0/2193918872 >> v2:172.21.15.40:3300/0 conn(0x7f605409e230 0x7f60541343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.845+0000 7f6052ffd700 1 -- 172.21.15.40:0/2193918872 >> v2:172.21.15.40:3300/0 conn(0x7f605409e230 msgr2=0x7f60541343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:11.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.845+0000 7f6052ffd700 1 --2- 172.21.15.40:0/2193918872 >> v2:172.21.15.40:3300/0 conn(0x7f605409e230 0x7f60541343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.845+0000 7f6052ffd700 1 -- 172.21.15.40:0/2193918872 >> v1:172.21.15.40:6789/0 conn(0x7f605409f0f0 legacy=0x7f6054133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:11.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.845+0000 7f6052ffd700 1 -- 172.21.15.40:0/2193918872 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605409f6e0 con 0x7f605409d920 2023-09-30T22:27:11.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.845+0000 7f6052ffd700 1 --2- 172.21.15.40:0/2193918872 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f605409d920 0x7f605409dcf0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6044006fd0 tx=0x7f6044009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84716585cfbcfc7c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:11.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.845+0000 7f6051ffb700 1 -- 172.21.15.40:0/2193918872 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6044005e30 con 0x7f605409d920 2023-09-30T22:27:11.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.845+0000 7f6051ffb700 1 -- 172.21.15.40:0/2193918872 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6044004030 con 0x7f605409d920 2023-09-30T22:27:11.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.845+0000 7f6051ffb700 1 -- 172.21.15.40:0/2193918872 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60440043e0 con 0x7f605409d920 2023-09-30T22:27:11.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.846+0000 7f605971e700 1 -- 172.21.15.40:0/2193918872 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f605409d920 msgr2=0x7f605409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:11.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.846+0000 7f605971e700 1 --2- 172.21.15.40:0/2193918872 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f605409d920 0x7f605409dcf0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6044006fd0 tx=0x7f6044009bd0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.846+0000 7f605971e700 1 -- 172.21.15.40:0/2193918872 shutdown_connections 2023-09-30T22:27:11.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.846+0000 7f605971e700 1 --2- 172.21.15.40:0/2193918872 >> v2:172.21.15.40:3300/0 conn(0x7f605409e230 0x7f60541343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.846+0000 7f605971e700 1 --2- 172.21.15.40:0/2193918872 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f605409d920 0x7f605409dcf0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.846+0000 7f605971e700 1 -- 172.21.15.40:0/2193918872 >> 172.21.15.40:0/2193918872 conn(0x7f605409fb20 msgr2=0x7f605409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:11.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.846+0000 7f605971e700 1 -- 172.21.15.40:0/2193918872 shutdown_connections 2023-09-30T22:27:11.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.846+0000 7f605971e700 1 -- 172.21.15.40:0/2193918872 wait complete. 2023-09-30T22:27:11.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.848+0000 7f605971e700 1 Processor -- start 2023-09-30T22:27:11.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.848+0000 7f605971e700 1 -- start start 2023-09-30T22:27:11.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.848+0000 7f605971e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f605409d920 0x7f60541a60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.848+0000 7f605971e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f605409e230 0x7f60541a65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.849+0000 7f605971e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60541b94a0 0x7f60541a6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.849+0000 7f605971e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60541aa590 con 0x7f605409d920 2023-09-30T22:27:11.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.849+0000 7f605971e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60541a9bd0 con 0x7f60541b94a0 2023-09-30T22:27:11.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.849+0000 7f605971e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60541a8f10 con 0x7f605409e230 2023-09-30T22:27:11.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.849+0000 7f60537fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60541b94a0 0x7f60541a6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.849+0000 7f60537fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60541b94a0 0x7f60541a6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:49842/0 (socket says 172.21.15.40:49842) 2023-09-30T22:27:11.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.849+0000 7f60537fe700 1 -- 172.21.15.40:0/3990210617 learned_addr learned my addr 172.21.15.40:0/3990210617 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:11.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.849+0000 7f6052ffd700 1 --2- 172.21.15.40:0/3990210617 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f605409d920 0x7f60541a60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.849+0000 7f60537fe700 1 -- 172.21.15.40:0/3990210617 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f605409e230 msgr2=0x7f60541a65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:11.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.849+0000 7f60537fe700 1 --2- 172.21.15.40:0/3990210617 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f605409e230 0x7f60541a65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.849+0000 7f60537fe700 1 -- 172.21.15.40:0/3990210617 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f605409d920 msgr2=0x7f60541a60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:11.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.849+0000 7f60537fe700 1 --2- 172.21.15.40:0/3990210617 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f605409d920 0x7f60541a60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.849+0000 7f60537fe700 1 -- 172.21.15.40:0/3990210617 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6044009500 con 0x7f60541b94a0 2023-09-30T22:27:11.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.849+0000 7f60537fe700 1 --2- 172.21.15.40:0/3990210617 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60541b94a0 0x7f60541a6b30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f604c009dd0 tx=0x7f604c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:11.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.850+0000 7f603b7fe700 1 -- 172.21.15.40:0/3990210617 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c009c40 con 0x7f60541b94a0 2023-09-30T22:27:11.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.850+0000 7f603b7fe700 1 -- 172.21.15.40:0/3990210617 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604c00f040 con 0x7f60541b94a0 2023-09-30T22:27:11.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.850+0000 7f605971e700 1 -- 172.21.15.40:0/3990210617 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60540a3630 con 0x7f60541b94a0 2023-09-30T22:27:11.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.850+0000 7f603b7fe700 1 -- 172.21.15.40:0/3990210617 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c014480 con 0x7f60541b94a0 2023-09-30T22:27:11.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.850+0000 7f605971e700 1 -- 172.21.15.40:0/3990210617 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60541a7cc0 con 0x7f60541b94a0 2023-09-30T22:27:11.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.851+0000 7f603b7fe700 1 -- 172.21.15.40:0/3990210617 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f604c0145e0 con 0x7f60541b94a0 2023-09-30T22:27:11.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.851+0000 7f603b7fe700 1 -- 172.21.15.40:0/3990210617 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f604c0402a0 con 0x7f60541b94a0 2023-09-30T22:27:11.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.851+0000 7f605971e700 1 -- 172.21.15.40:0/3990210617 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60541a9770 con 0x7f60541b94a0 2023-09-30T22:27:11.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.856+0000 7f603b7fe700 1 -- 172.21.15.40:0/3990210617 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f604c007920 con 0x7f60541b94a0 2023-09-30T22:27:11.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.911+0000 7f5c54d23700 1 Processor -- start 2023-09-30T22:27:11.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.911+0000 7f5c54d23700 1 -- start start 2023-09-30T22:27:11.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.912+0000 7f5c54d23700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c50133e00 0x7f5c501341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.912+0000 7f5c54d23700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5c5009d400 0x7f5c5009d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.912+0000 7f5c54d23700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c5009dd70 0x7f5c5013ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.912+0000 7f5c54d23700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c5009ab20 con 0x7f5c5009d400 2023-09-30T22:27:11.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.912+0000 7f5c54d23700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c50133940 con 0x7f5c5009dd70 2023-09-30T22:27:11.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.912+0000 7f5c54d23700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5009f0d0 con 0x7f5c50133e00 2023-09-30T22:27:11.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.912+0000 7f5c4ed9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c5009dd70 0x7f5c5013ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.912+0000 7f5c4e59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c50133e00 0x7f5c501341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.912+0000 7f5c4e59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c50133e00 0x7f5c501341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52982/0 (socket says 172.21.15.40:52982) 2023-09-30T22:27:11.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.912+0000 7f5c4ed9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c5009dd70 0x7f5c5013ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:49858/0 (socket says 172.21.15.40:49858) 2023-09-30T22:27:11.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.912+0000 7f5c4e59c700 1 -- 172.21.15.40:0/3186976957 learned_addr learned my addr 172.21.15.40:0/3186976957 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:11.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.912+0000 7f5c4dd9b700 1 --2- 172.21.15.40:0/3186976957 >> v2:172.21.15.40:3300/0 conn(0x7f5c5009d400 0x7f5c5009d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.913+0000 7f5c4ed9d700 1 -- 172.21.15.40:0/3186976957 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c50133e00 msgr2=0x7f5c501341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:11.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.913+0000 7f5c4ed9d700 1 --2- 172.21.15.40:0/3186976957 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c50133e00 0x7f5c501341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.913+0000 7f5c4ed9d700 1 -- 172.21.15.40:0/3186976957 >> v2:172.21.15.40:3300/0 conn(0x7f5c5009d400 msgr2=0x7f5c5009d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:11.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.913+0000 7f5c4ed9d700 1 --2- 172.21.15.40:0/3186976957 >> v2:172.21.15.40:3300/0 conn(0x7f5c5009d400 0x7f5c5009d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.913+0000 7f5c4ed9d700 1 -- 172.21.15.40:0/3186976957 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c5009e210 con 0x7f5c5009dd70 2023-09-30T22:27:11.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.913+0000 7f5c4e59c700 1 --2- 172.21.15.40:0/3186976957 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c50133e00 0x7f5c501341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:11.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.913+0000 7f5c4ed9d700 1 --2- 172.21.15.40:0/3186976957 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c5009dd70 0x7f5c5013ac70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5c48009d90 tx=0x7f5c4800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7581ce4364462df server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:11.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.913+0000 7f5c4d59a700 1 -- 172.21.15.40:0/3186976957 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4800e070 con 0x7f5c5009dd70 2023-09-30T22:27:11.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.913+0000 7f5c4d59a700 1 -- 172.21.15.40:0/3186976957 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4800bb20 con 0x7f5c5009dd70 2023-09-30T22:27:11.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.913+0000 7f5c4d59a700 1 -- 172.21.15.40:0/3186976957 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c48012430 con 0x7f5c5009dd70 2023-09-30T22:27:11.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.914+0000 7f5c54d23700 1 -- 172.21.15.40:0/3186976957 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c5009dd70 msgr2=0x7f5c5013ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:11.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.914+0000 7f5c54d23700 1 --2- 172.21.15.40:0/3186976957 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c5009dd70 0x7f5c5013ac70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5c48009d90 tx=0x7f5c4800b330 comp rx=0 tx=0).stop 2023-09-30T22:27:11.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.914+0000 7f5c54d23700 1 -- 172.21.15.40:0/3186976957 shutdown_connections 2023-09-30T22:27:11.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.914+0000 7f5c54d23700 1 --2- 172.21.15.40:0/3186976957 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c50133e00 0x7f5c501341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.914+0000 7f5c54d23700 1 --2- 172.21.15.40:0/3186976957 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c5009dd70 0x7f5c5013ac70 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.914+0000 7f5c54d23700 1 --2- 172.21.15.40:0/3186976957 >> v2:172.21.15.40:3300/0 conn(0x7f5c5009d400 0x7f5c5009d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.914+0000 7f5c54d23700 1 -- 172.21.15.40:0/3186976957 >> 172.21.15.40:0/3186976957 conn(0x7f5c500a2a00 msgr2=0x7f5c500a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:11.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.914+0000 7f5c54d23700 1 -- 172.21.15.40:0/3186976957 shutdown_connections 2023-09-30T22:27:11.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.914+0000 7f5c54d23700 1 -- 172.21.15.40:0/3186976957 wait complete. 2023-09-30T22:27:11.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.915+0000 7f5c54d23700 1 Processor -- start 2023-09-30T22:27:11.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.915+0000 7f5c54d23700 1 -- start start 2023-09-30T22:27:11.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.916+0000 7f5c54d23700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c5009d400 0x7f5c5011aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.916+0000 7f5c54d23700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c5009dd70 0x7f5c5011af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.916+0000 7f5c54d23700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c50133e00 0x7f5c5011b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.916+0000 7f5c54d23700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5011cb50 con 0x7f5c5009dd70 2023-09-30T22:27:11.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.916+0000 7f5c54d23700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5011dea0 con 0x7f5c50133e00 2023-09-30T22:27:11.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.916+0000 7f5c54d23700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5011c6b0 con 0x7f5c5009d400 2023-09-30T22:27:11.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.916+0000 7f5c4ed9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c50133e00 0x7f5c5011b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.916+0000 7f5c4ed9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c50133e00 0x7f5c5011b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:49860/0 (socket says 172.21.15.40:49860) 2023-09-30T22:27:11.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.916+0000 7f5c4ed9d700 1 -- 172.21.15.40:0/1811739720 learned_addr learned my addr 172.21.15.40:0/1811739720 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:11.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.916+0000 7f5c4dd9b700 1 --2- 172.21.15.40:0/1811739720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c5009dd70 0x7f5c5011af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.916+0000 7f5c4e59c700 1 --2- 172.21.15.40:0/1811739720 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c5009d400 0x7f5c5011aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.916+0000 7f5c4e59c700 1 -- 172.21.15.40:0/1811739720 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c50133e00 msgr2=0x7f5c5011b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:11.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.916+0000 7f5c4e59c700 1 --2- 172.21.15.40:0/1811739720 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c50133e00 0x7f5c5011b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.916+0000 7f5c4e59c700 1 -- 172.21.15.40:0/1811739720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c5009dd70 msgr2=0x7f5c5011af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:11.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.916+0000 7f5c4e59c700 1 --2- 172.21.15.40:0/1811739720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c5009dd70 0x7f5c5011af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.916+0000 7f5c4e59c700 1 -- 172.21.15.40:0/1811739720 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c40009550 con 0x7f5c5009d400 2023-09-30T22:27:11.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.916+0000 7f5c4ed9d700 1 --2- 172.21.15.40:0/1811739720 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c50133e00 0x7f5c5011b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:11.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.917+0000 7f5c4e59c700 1 --2- 172.21.15.40:0/1811739720 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c5009d400 0x7f5c5011aa50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5c4000e9a0 tx=0x7f5c4000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:11.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.917+0000 7f5c3effd700 1 -- 172.21.15.40:0/1811739720 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c40004030 con 0x7f5c5009d400 2023-09-30T22:27:11.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.917+0000 7f5c3effd700 1 -- 172.21.15.40:0/1811739720 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c40004190 con 0x7f5c5009d400 2023-09-30T22:27:11.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.917+0000 7f5c54d23700 1 -- 172.21.15.40:0/1811739720 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c48009a70 con 0x7f5c5009d400 2023-09-30T22:27:11.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.917+0000 7f5c3effd700 1 -- 172.21.15.40:0/1811739720 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c40004520 con 0x7f5c5009d400 2023-09-30T22:27:11.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.917+0000 7f5c54d23700 1 -- 172.21.15.40:0/1811739720 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c5011e490 con 0x7f5c5009d400 2023-09-30T22:27:11.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.918+0000 7f5c54d23700 1 -- 172.21.15.40:0/1811739720 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c50062380 con 0x7f5c5009d400 2023-09-30T22:27:11.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.919+0000 7f5c3effd700 1 -- 172.21.15.40:0/1811739720 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5c400036a0 con 0x7f5c5009d400 2023-09-30T22:27:11.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.919+0000 7f5c3effd700 1 -- 172.21.15.40:0/1811739720 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5c4003fb00 con 0x7f5c5009d400 2023-09-30T22:27:11.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.927+0000 7f5c3effd700 1 -- 172.21.15.40:0/1811739720 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5c40011350 con 0x7f5c5009d400 2023-09-30T22:27:11.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.940+0000 7f5a39cbd700 1 Processor -- start 2023-09-30T22:27:11.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.940+0000 7f5a39cbd700 1 -- start start 2023-09-30T22:27:11.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.940+0000 7f5a39cbd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a3409d450 0x7f5a3409d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.940+0000 7f5a39cbd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5a3409dd60 0x7f5a341301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.940+0000 7f5a39cbd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a34130700 0x7f5a34130b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.940+0000 7f5a39cbd700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a3409e8b0 con 0x7f5a3409dd60 2023-09-30T22:27:11.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.940+0000 7f5a39cbd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3409c3b0 con 0x7f5a34130700 2023-09-30T22:27:11.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.940+0000 7f5a39cbd700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3409a6b0 con 0x7f5a3409d450 2023-09-30T22:27:11.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.941+0000 7f5a33fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a34130700 0x7f5a34130b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.941+0000 7f5a33fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a34130700 0x7f5a34130b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:49866/0 (socket says 172.21.15.40:49866) 2023-09-30T22:27:11.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.941+0000 7f5a33fff700 1 -- 172.21.15.40:0/3794320209 learned_addr learned my addr 172.21.15.40:0/3794320209 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:11.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.941+0000 7f5a337fe700 1 --2- 172.21.15.40:0/3794320209 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a3409d450 0x7f5a3409d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.941+0000 7f5a32ffd700 1 --2- 172.21.15.40:0/3794320209 >> v2:172.21.15.40:3300/0 conn(0x7f5a3409dd60 0x7f5a341301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.941+0000 7f5a337fe700 1 -- 172.21.15.40:0/3794320209 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a34130700 msgr2=0x7f5a34130b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:11.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.941+0000 7f5a337fe700 1 --2- 172.21.15.40:0/3794320209 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a34130700 0x7f5a34130b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.941+0000 7f5a337fe700 1 -- 172.21.15.40:0/3794320209 >> v2:172.21.15.40:3300/0 conn(0x7f5a3409dd60 msgr2=0x7f5a341301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:11.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.941+0000 7f5a337fe700 1 --2- 172.21.15.40:0/3794320209 >> v2:172.21.15.40:3300/0 conn(0x7f5a3409dd60 0x7f5a341301c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.941+0000 7f5a337fe700 1 -- 172.21.15.40:0/3794320209 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3409b4f0 con 0x7f5a3409d450 2023-09-30T22:27:11.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.941+0000 7f5a32ffd700 1 --2- 172.21.15.40:0/3794320209 >> v2:172.21.15.40:3300/0 conn(0x7f5a3409dd60 0x7f5a341301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:11.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.941+0000 7f5a33fff700 1 --2- 172.21.15.40:0/3794320209 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a34130700 0x7f5a34130b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:11.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.941+0000 7f5a337fe700 1 --2- 172.21.15.40:0/3794320209 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a3409d450 0x7f5a3409d820 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5a2400a9e0 tx=0x7f5a2400acf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=470325c8a33fd4e5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:11.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.941+0000 7f5a327fc700 1 -- 172.21.15.40:0/3794320209 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2400cb70 con 0x7f5a3409d450 2023-09-30T22:27:11.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.942+0000 7f5a327fc700 1 -- 172.21.15.40:0/3794320209 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2400ccd0 con 0x7f5a3409d450 2023-09-30T22:27:11.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.942+0000 7f5a327fc700 1 -- 172.21.15.40:0/3794320209 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a24018620 con 0x7f5a3409d450 2023-09-30T22:27:11.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.942+0000 7f5a39cbd700 1 -- 172.21.15.40:0/3794320209 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a3409d450 msgr2=0x7f5a3409d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:11.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.942+0000 7f5a39cbd700 1 --2- 172.21.15.40:0/3794320209 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a3409d450 0x7f5a3409d820 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5a2400a9e0 tx=0x7f5a2400acf0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.942+0000 7f5a39cbd700 1 -- 172.21.15.40:0/3794320209 shutdown_connections 2023-09-30T22:27:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.942+0000 7f5a39cbd700 1 --2- 172.21.15.40:0/3794320209 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a3409d450 0x7f5a3409d820 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.942+0000 7f5a39cbd700 1 --2- 172.21.15.40:0/3794320209 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a34130700 0x7f5a34130b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.942+0000 7f5a39cbd700 1 --2- 172.21.15.40:0/3794320209 >> v2:172.21.15.40:3300/0 conn(0x7f5a3409dd60 0x7f5a341301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.942+0000 7f5a39cbd700 1 -- 172.21.15.40:0/3794320209 >> 172.21.15.40:0/3794320209 conn(0x7f5a340a2a00 msgr2=0x7f5a340a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.943+0000 7f5a39cbd700 1 -- 172.21.15.40:0/3794320209 shutdown_connections 2023-09-30T22:27:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.943+0000 7f5a39cbd700 1 -- 172.21.15.40:0/3794320209 wait complete. 2023-09-30T22:27:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.944+0000 7f5a39cbd700 1 Processor -- start 2023-09-30T22:27:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.944+0000 7f5a39cbd700 1 -- start start 2023-09-30T22:27:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.945+0000 7f5a39cbd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a3409d450 0x7f5a341c4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.945+0000 7f5a39cbd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a3409dd60 0x7f5a341c4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.945+0000 7f5a39cbd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a34130700 0x7f5a341c4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.945+0000 7f5a39cbd700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3411ea00 con 0x7f5a34130700 2023-09-30T22:27:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.945+0000 7f5a39cbd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3411cdd0 con 0x7f5a3409dd60 2023-09-30T22:27:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.945+0000 7f5a39cbd700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3411d350 con 0x7f5a3409d450 2023-09-30T22:27:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.945+0000 7f5a337fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a3409d450 0x7f5a341c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.945+0000 7f5a337fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a3409d450 0x7f5a341c4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:53002/0 (socket says 172.21.15.40:53002) 2023-09-30T22:27:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.945+0000 7f5a337fe700 1 -- 172.21.15.40:0/1119612452 learned_addr learned my addr 172.21.15.40:0/1119612452 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.945+0000 7f5a32ffd700 1 --2- 172.21.15.40:0/1119612452 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a3409dd60 0x7f5a341c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.945+0000 7f5a33fff700 1 --2- 172.21.15.40:0/1119612452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a34130700 0x7f5a341c4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.945+0000 7f5a32ffd700 1 -- 172.21.15.40:0/1119612452 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a3409d450 msgr2=0x7f5a341c4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:11.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.945+0000 7f5a32ffd700 1 --2- 172.21.15.40:0/1119612452 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a3409d450 0x7f5a341c4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.945+0000 7f5a32ffd700 1 -- 172.21.15.40:0/1119612452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a34130700 msgr2=0x7f5a341c4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:11.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.945+0000 7f5a32ffd700 1 --2- 172.21.15.40:0/1119612452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a34130700 0x7f5a341c4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.945+0000 7f5a32ffd700 1 -- 172.21.15.40:0/1119612452 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2c009b30 con 0x7f5a3409dd60 2023-09-30T22:27:11.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.946+0000 7f5a32ffd700 1 --2- 172.21.15.40:0/1119612452 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a3409dd60 0x7f5a341c4780 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5a2800e7e0 tx=0x7f5a2800eaf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:11.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.946+0000 7f5a1bfff700 1 -- 172.21.15.40:0/1119612452 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2800c070 con 0x7f5a3409dd60 2023-09-30T22:27:11.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.946+0000 7f5a1bfff700 1 -- 172.21.15.40:0/1119612452 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a28013610 con 0x7f5a3409dd60 2023-09-30T22:27:11.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.946+0000 7f5a39cbd700 1 -- 172.21.15.40:0/1119612452 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a2400a640 con 0x7f5a3409dd60 2023-09-30T22:27:11.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.946+0000 7f5a1bfff700 1 -- 172.21.15.40:0/1119612452 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a280139a0 con 0x7f5a3409dd60 2023-09-30T22:27:11.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.946+0000 7f5a39cbd700 1 -- 172.21.15.40:0/1119612452 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a3409b000 con 0x7f5a3409dd60 2023-09-30T22:27:11.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.947+0000 7f5a1bfff700 1 -- 172.21.15.40:0/1119612452 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5a28013b00 con 0x7f5a3409dd60 2023-09-30T22:27:11.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.947+0000 7f5a39cbd700 1 -- 172.21.15.40:0/1119612452 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a34062380 con 0x7f5a3409dd60 2023-09-30T22:27:11.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.947+0000 7f5a1bfff700 1 -- 172.21.15.40:0/1119612452 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5a2803f3e0 con 0x7f5a3409dd60 2023-09-30T22:27:11.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.956+0000 7f5a1bfff700 1 -- 172.21.15.40:0/1119612452 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5a280238f0 con 0x7f5a3409dd60 2023-09-30T22:27:11.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.988+0000 7fd48c5e2700 1 Processor -- start 2023-09-30T22:27:11.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.988+0000 7fd48c5e2700 1 -- start start 2023-09-30T22:27:11.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.989+0000 7fd48c5e2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd48406f070 0x7fd48406f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.989+0000 7fd48c5e2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd48406fdb0 0x7fd4840977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.989+0000 7fd48c5e2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd484070830 con 0x7fd48406f980 2023-09-30T22:27:11.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.989+0000 7fd48c5e2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd484070ad0 con 0x7fd48406f070 2023-09-30T22:27:11.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.989+0000 7fd48c5e2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd484070de0 con 0x7fd48406fdb0 2023-09-30T22:27:11.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.989+0000 7fd48a37e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd48406f070 0x7fd48406f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.989+0000 7fd489b7d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd48406f980 0x7fd484097090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44958/0 (socket says 172.21.15.40:44958) 2023-09-30T22:27:11.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.989+0000 7fd489b7d700 1 -- 172.21.15.40:0/108582017 learned_addr learned my addr 172.21.15.40:0/108582017 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:27:11.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.989+0000 7fd48ab7f700 1 --2- 172.21.15.40:0/108582017 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd48406fdb0 0x7fd4840977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.990+0000 7fd48a37e700 1 -- 172.21.15.40:0/108582017 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd48406fdb0 msgr2=0x7fd4840977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:11.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.990+0000 7fd48a37e700 1 --2- 172.21.15.40:0/108582017 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd48406fdb0 0x7fd4840977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.990+0000 7fd48a37e700 1 -- 172.21.15.40:0/108582017 >> v1:172.21.15.40:6789/0 conn(0x7fd48406f980 legacy=0x7fd484097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:11.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.990+0000 7fd48a37e700 1 -- 172.21.15.40:0/108582017 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48409fe20 con 0x7fd48406f070 2023-09-30T22:27:11.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.990+0000 7fd48ab7f700 1 --2- 172.21.15.40:0/108582017 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd48406fdb0 0x7fd4840977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:11.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.990+0000 7fd48a37e700 1 --2- 172.21.15.40:0/108582017 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd48406f070 0x7fd48406f440 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd480009870 tx=0x7fd480009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebc611c0025a257b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:11.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.990+0000 7fd48937c700 1 -- 172.21.15.40:0/108582017 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd480011830 con 0x7fd48406f070 2023-09-30T22:27:11.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.990+0000 7fd48937c700 1 -- 172.21.15.40:0/108582017 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd480011990 con 0x7fd48406f070 2023-09-30T22:27:11.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.990+0000 7fd48937c700 1 -- 172.21.15.40:0/108582017 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd480011d20 con 0x7fd48406f070 2023-09-30T22:27:11.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.991+0000 7fd48c5e2700 1 -- 172.21.15.40:0/108582017 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd48406f070 msgr2=0x7fd48406f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:11.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.991+0000 7fd48c5e2700 1 --2- 172.21.15.40:0/108582017 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd48406f070 0x7fd48406f440 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd480009870 tx=0x7fd480009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:11.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.991+0000 7fd48c5e2700 1 -- 172.21.15.40:0/108582017 shutdown_connections 2023-09-30T22:27:11.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.991+0000 7fd48c5e2700 1 --2- 172.21.15.40:0/108582017 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd48406fdb0 0x7fd4840977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.991+0000 7fd48c5e2700 1 --2- 172.21.15.40:0/108582017 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd48406f070 0x7fd48406f440 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.991+0000 7fd48c5e2700 1 -- 172.21.15.40:0/108582017 >> 172.21.15.40:0/108582017 conn(0x7fd4840a41a0 msgr2=0x7fd4840a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:11.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.991+0000 7fd48c5e2700 1 -- 172.21.15.40:0/108582017 shutdown_connections 2023-09-30T22:27:11.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.991+0000 7fd48c5e2700 1 -- 172.21.15.40:0/108582017 wait complete. 2023-09-30T22:27:11.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.992+0000 7fd48c5e2700 1 Processor -- start 2023-09-30T22:27:11.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.992+0000 7fd48c5e2700 1 -- start start 2023-09-30T22:27:11.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.993+0000 7fd48c5e2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd48406f070 0x7fd48408afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.993+0000 7fd48c5e2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd48406f980 0x7fd48408b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.993+0000 7fd48c5e2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd48406fdb0 0x7fd48408ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.993+0000 7fd48c5e2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48408db50 con 0x7fd48406fdb0 2023-09-30T22:27:11.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.993+0000 7fd48c5e2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48408e6f0 con 0x7fd48406f980 2023-09-30T22:27:11.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.993+0000 7fd48c5e2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd48408dd30 con 0x7fd48406f070 2023-09-30T22:27:11.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.993+0000 7fd48ab7f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd48406fdb0 0x7fd48408ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.993+0000 7fd48ab7f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd48406fdb0 0x7fd48408ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42204/0 (socket says 172.21.15.40:42204) 2023-09-30T22:27:11.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.993+0000 7fd48ab7f700 1 -- 172.21.15.40:0/2923577939 learned_addr learned my addr 172.21.15.40:0/2923577939 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:11.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.993+0000 7fd48a37e700 1 --2- 172.21.15.40:0/2923577939 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd48406f070 0x7fd48408afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.993+0000 7fd489b7d700 1 --2- 172.21.15.40:0/2923577939 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd48406f980 0x7fd48408b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.993+0000 7fd48ab7f700 1 -- 172.21.15.40:0/2923577939 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd48406f070 msgr2=0x7fd48408afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:11.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.993+0000 7fd48ab7f700 1 --2- 172.21.15.40:0/2923577939 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd48406f070 0x7fd48408afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.993+0000 7fd48ab7f700 1 -- 172.21.15.40:0/2923577939 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd48406f980 msgr2=0x7fd48408b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:11.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.993+0000 7fd48ab7f700 1 --2- 172.21.15.40:0/2923577939 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd48406f980 0x7fd48408b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.993+0000 7fd48ab7f700 1 -- 172.21.15.40:0/2923577939 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd47c009a70 con 0x7fd48406fdb0 2023-09-30T22:27:11.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.994+0000 7fd48ab7f700 1 --2- 172.21.15.40:0/2923577939 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd48406fdb0 0x7fd48408ba50 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fd47c009f00 tx=0x7fd47c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:11.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.994+0000 7fd47affd700 1 -- 172.21.15.40:0/2923577939 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c009d70 con 0x7fd48406fdb0 2023-09-30T22:27:11.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.994+0000 7fd47affd700 1 -- 172.21.15.40:0/2923577939 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47c00f040 con 0x7fd48406fdb0 2023-09-30T22:27:11.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.994+0000 7fd48c5e2700 1 -- 172.21.15.40:0/2923577939 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4800094a0 con 0x7fd48406fdb0 2023-09-30T22:27:11.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.994+0000 7fd47affd700 1 -- 172.21.15.40:0/2923577939 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c00cd70 con 0x7fd48406fdb0 2023-09-30T22:27:11.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.994+0000 7fd48c5e2700 1 -- 172.21.15.40:0/2923577939 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd48408d790 con 0x7fd48406fdb0 2023-09-30T22:27:11.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.995+0000 7fd47affd700 1 -- 172.21.15.40:0/2923577939 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd47c014480 con 0x7fd48406fdb0 2023-09-30T22:27:11.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.995+0000 7fd48c5e2700 1 -- 172.21.15.40:0/2923577939 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd48408d9b0 con 0x7fd48406fdb0 2023-09-30T22:27:11.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:11.995+0000 7fd47affd700 1 -- 172.21.15.40:0/2923577939 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd47c03fdf0 con 0x7fd48406fdb0 2023-09-30T22:27:12.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.000+0000 7fd47affd700 1 -- 172.21.15.40:0/2923577939 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd48408d9b0 con 0x7fd48406fdb0 2023-09-30T22:27:12.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.144+0000 7f605971e700 1 -- 172.21.15.40:0/3990210617 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6054062380 con 0x7f60541b94a0 2023-09-30T22:27:12.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.145+0000 7f603b7fe700 1 -- 172.21.15.40:0/3990210617 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f604c02c090 con 0x7f60541b94a0 2023-09-30T22:27:12.146 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:12.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.148+0000 7f605971e700 1 -- 172.21.15.40:0/3990210617 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60541b94a0 msgr2=0x7f60541a6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:12.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.148+0000 7f605971e700 1 --2- 172.21.15.40:0/3990210617 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60541b94a0 0x7f60541a6b30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f604c009dd0 tx=0x7f604c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.148+0000 7f605971e700 1 -- 172.21.15.40:0/3990210617 shutdown_connections 2023-09-30T22:27:12.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.148+0000 7f605971e700 1 --2- 172.21.15.40:0/3990210617 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60541b94a0 0x7f60541a6b30 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.148+0000 7f605971e700 1 --2- 172.21.15.40:0/3990210617 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f605409d920 0x7f60541a60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.148+0000 7f605971e700 1 --2- 172.21.15.40:0/3990210617 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f605409e230 0x7f60541a65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.148+0000 7f605971e700 1 -- 172.21.15.40:0/3990210617 >> 172.21.15.40:0/3990210617 conn(0x7f605409fb20 msgr2=0x7f60541bb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:12.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.149+0000 7f605971e700 1 -- 172.21.15.40:0/3990210617 shutdown_connections 2023-09-30T22:27:12.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.149+0000 7f605971e700 1 -- 172.21.15.40:0/3990210617 wait complete. 2023-09-30T22:27:12.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.156+0000 7f5a39cbd700 1 -- 172.21.15.40:0/1119612452 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5a34074330 con 0x7f5a3409dd60 2023-09-30T22:27:12.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.157+0000 7f5a1bfff700 1 -- 172.21.15.40:0/1119612452 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5a28023300 con 0x7f5a3409dd60 2023-09-30T22:27:12.158 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:12.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.159+0000 7f5a39cbd700 1 -- 172.21.15.40:0/1119612452 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a3409dd60 msgr2=0x7f5a341c4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:12.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.159+0000 7f5a39cbd700 1 --2- 172.21.15.40:0/1119612452 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a3409dd60 0x7f5a341c4780 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5a2800e7e0 tx=0x7f5a2800eaf0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.159+0000 7f5a39cbd700 1 -- 172.21.15.40:0/1119612452 shutdown_connections 2023-09-30T22:27:12.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.159+0000 7f5a39cbd700 1 --2- 172.21.15.40:0/1119612452 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a3409d450 0x7f5a341c4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.159+0000 7f5a39cbd700 1 --2- 172.21.15.40:0/1119612452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a34130700 0x7f5a341c4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.159+0000 7f5a39cbd700 1 --2- 172.21.15.40:0/1119612452 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a3409dd60 0x7f5a341c4780 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.159+0000 7f5a39cbd700 1 -- 172.21.15.40:0/1119612452 >> 172.21.15.40:0/1119612452 conn(0x7f5a340a2a00 msgr2=0x7f5a340a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:12.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.159+0000 7f5a39cbd700 1 -- 172.21.15.40:0/1119612452 shutdown_connections 2023-09-30T22:27:12.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.159+0000 7f5a39cbd700 1 -- 172.21.15.40:0/1119612452 wait complete. 2023-09-30T22:27:12.167 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:12.172 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:12.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.195+0000 7f5c54d23700 1 -- 172.21.15.40:0/1811739720 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5c5011e490 con 0x7f5c5009d400 2023-09-30T22:27:12.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.195+0000 7f5c3effd700 1 -- 172.21.15.40:0/1811739720 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5c5011e490 con 0x7f5c5009d400 2023-09-30T22:27:12.196 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:12.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.197+0000 7f5c54d23700 1 -- 172.21.15.40:0/1811739720 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c5009d400 msgr2=0x7f5c5011aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:12.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.197+0000 7f5c54d23700 1 --2- 172.21.15.40:0/1811739720 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c5009d400 0x7f5c5011aa50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5c4000e9a0 tx=0x7f5c4000ecb0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.197+0000 7f5c54d23700 1 -- 172.21.15.40:0/1811739720 shutdown_connections 2023-09-30T22:27:12.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.197+0000 7f5c54d23700 1 --2- 172.21.15.40:0/1811739720 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c5009d400 0x7f5c5011aa50 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.197+0000 7f5c54d23700 1 --2- 172.21.15.40:0/1811739720 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c50133e00 0x7f5c5011b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.197+0000 7f5c54d23700 1 --2- 172.21.15.40:0/1811739720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c5009dd70 0x7f5c5011af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.197+0000 7f5c54d23700 1 -- 172.21.15.40:0/1811739720 >> 172.21.15.40:0/1811739720 conn(0x7f5c500a2a00 msgr2=0x7f5c501b9950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:12.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.197+0000 7f5c54d23700 1 -- 172.21.15.40:0/1811739720 shutdown_connections 2023-09-30T22:27:12.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.197+0000 7f5c54d23700 1 -- 172.21.15.40:0/1811739720 wait complete. 2023-09-30T22:27:12.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.206+0000 7fd48c5e2700 1 -- 172.21.15.40:0/2923577939 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd48408d9b0 con 0x7fd48406fdb0 2023-09-30T22:27:12.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.206+0000 7fd47affd700 1 -- 172.21.15.40:0/2923577939 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd48408d9b0 con 0x7fd48406fdb0 2023-09-30T22:27:12.207 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:12.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.208+0000 7fd48c5e2700 1 -- 172.21.15.40:0/2923577939 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd48406fdb0 msgr2=0x7fd48408ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:12.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.208+0000 7fd48c5e2700 1 --2- 172.21.15.40:0/2923577939 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd48406fdb0 0x7fd48408ba50 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fd47c009f00 tx=0x7fd47c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.208+0000 7fd48c5e2700 1 -- 172.21.15.40:0/2923577939 shutdown_connections 2023-09-30T22:27:12.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.208+0000 7fd48c5e2700 1 --2- 172.21.15.40:0/2923577939 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd48406f070 0x7fd48408afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.208+0000 7fd48c5e2700 1 --2- 172.21.15.40:0/2923577939 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd48406fdb0 0x7fd48408ba50 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.208+0000 7fd48c5e2700 1 --2- 172.21.15.40:0/2923577939 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd48406f980 0x7fd48408b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.208+0000 7fd48c5e2700 1 -- 172.21.15.40:0/2923577939 >> 172.21.15.40:0/2923577939 conn(0x7fd4840a41a0 msgr2=0x7fd4840a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:12.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.208+0000 7fd48c5e2700 1 -- 172.21.15.40:0/2923577939 shutdown_connections 2023-09-30T22:27:12.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:12.208+0000 7fd48c5e2700 1 -- 172.21.15.40:0/2923577939 wait complete. 2023-09-30T22:27:12.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:12.221 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:13.168 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:13.173 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:13.211 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:13.221 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:13.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.327+0000 7f936e2d8700 1 Processor -- start 2023-09-30T22:27:13.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.327+0000 7f936e2d8700 1 -- start start 2023-09-30T22:27:13.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.328+0000 7f936e2d8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f936806a6d0 0x7f936809d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:13.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.328+0000 7f936e2d8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f936809de60 0x7f936809e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:13.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.328+0000 7f936e2d8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f936809e790 con 0x7f936813c490 2023-09-30T22:27:13.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.328+0000 7f936e2d8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936806aaa0 con 0x7f936806a6d0 2023-09-30T22:27:13.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.328+0000 7f936e2d8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f936811d980 con 0x7f936809de60 2023-09-30T22:27:13.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.328+0000 7f93677fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f936809de60 0x7f936809e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:13.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.328+0000 7f936c875700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f936813c490 0x7f936813e870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38106/0 (socket says 172.21.15.40:38106) 2023-09-30T22:27:13.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.328+0000 7f936c875700 1 -- 172.21.15.40:0/2924184013 learned_addr learned my addr 172.21.15.40:0/2924184013 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:27:13.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.328+0000 7f9367fff700 1 --2- 172.21.15.40:0/2924184013 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f936806a6d0 0x7f936809d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:13.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.328+0000 7f93677fe700 1 -- 172.21.15.40:0/2924184013 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f936806a6d0 msgr2=0x7f936809d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:13.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.328+0000 7f93677fe700 1 --2- 172.21.15.40:0/2924184013 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f936806a6d0 0x7f936809d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.328+0000 7f9366ffd700 1 -- 172.21.15.40:0/2924184013 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2748675479 0 0) 0x7f9360001490 con 0x7f936813c490 2023-09-30T22:27:13.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.328+0000 7f93677fe700 1 -- 172.21.15.40:0/2924184013 >> v1:172.21.15.40:6789/0 conn(0x7f936813c490 legacy=0x7f936813e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:13.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.328+0000 7f93677fe700 1 -- 172.21.15.40:0/2924184013 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f936811daf0 con 0x7f936809de60 2023-09-30T22:27:13.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.329+0000 7f93677fe700 1 --2- 172.21.15.40:0/2924184013 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f936809de60 0x7f936809e250 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f935c0098a0 tx=0x7f935c009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d79b428745efff51 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:13.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.329+0000 7f9366ffd700 1 -- 172.21.15.40:0/2924184013 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c011830 con 0x7f936809de60 2023-09-30T22:27:13.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.329+0000 7f9366ffd700 1 -- 172.21.15.40:0/2924184013 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935c011990 con 0x7f936809de60 2023-09-30T22:27:13.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.329+0000 7f9366ffd700 1 -- 172.21.15.40:0/2924184013 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c011d20 con 0x7f936809de60 2023-09-30T22:27:13.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.329+0000 7f936e2d8700 1 -- 172.21.15.40:0/2924184013 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f936809de60 msgr2=0x7f936809e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:13.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.329+0000 7f936e2d8700 1 --2- 172.21.15.40:0/2924184013 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f936809de60 0x7f936809e250 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f935c0098a0 tx=0x7f935c009bb0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.330+0000 7f936e2d8700 1 -- 172.21.15.40:0/2924184013 shutdown_connections 2023-09-30T22:27:13.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.330+0000 7f936e2d8700 1 --2- 172.21.15.40:0/2924184013 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f936806a6d0 0x7f936809d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.330+0000 7f936e2d8700 1 --2- 172.21.15.40:0/2924184013 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f936809de60 0x7f936809e250 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.330+0000 7f936e2d8700 1 -- 172.21.15.40:0/2924184013 >> 172.21.15.40:0/2924184013 conn(0x7f936809fb20 msgr2=0x7f936809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:13.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.330+0000 7f936e2d8700 1 -- 172.21.15.40:0/2924184013 shutdown_connections 2023-09-30T22:27:13.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.330+0000 7f936e2d8700 1 -- 172.21.15.40:0/2924184013 wait complete. 2023-09-30T22:27:13.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.331+0000 7f936e2d8700 1 Processor -- start 2023-09-30T22:27:13.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.331+0000 7f936e2d8700 1 -- start start 2023-09-30T22:27:13.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.331+0000 7f936e2d8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f936806a6d0 0x7f936813a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:13.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.331+0000 7f936e2d8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f936809de60 0x7f936813aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:13.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.331+0000 7f936e2d8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f936813c490 0x7f936813b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:13.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.331+0000 7f936e2d8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936813f1c0 con 0x7f936809de60 2023-09-30T22:27:13.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.331+0000 7f936e2d8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936811e460 con 0x7f936813c490 2023-09-30T22:27:13.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.331+0000 7f936e2d8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f936813f770 con 0x7f936806a6d0 2023-09-30T22:27:13.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.331+0000 7f936c875700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f936813c490 0x7f936813b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:13.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.331+0000 7f9367fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f936806a6d0 0x7f936813a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:13.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.332+0000 7f936c875700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f936813c490 0x7f936813b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42136/0 (socket says 172.21.15.40:42136) 2023-09-30T22:27:13.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.332+0000 7f936c875700 1 -- 172.21.15.40:0/3842319818 learned_addr learned my addr 172.21.15.40:0/3842319818 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:13.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.332+0000 7f936c875700 1 -- 172.21.15.40:0/3842319818 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f936806a6d0 msgr2=0x7f936813a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:13.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.332+0000 7f936c875700 1 --2- 172.21.15.40:0/3842319818 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f936806a6d0 0x7f936813a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.332+0000 7f936c875700 1 -- 172.21.15.40:0/3842319818 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f936809de60 msgr2=0x7f936813aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:13.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.332+0000 7f936c875700 1 --2- 172.21.15.40:0/3842319818 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f936809de60 0x7f936813aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.332+0000 7f936c875700 1 -- 172.21.15.40:0/3842319818 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f935c0094a0 con 0x7f936813c490 2023-09-30T22:27:13.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.332+0000 7f936c875700 1 --2- 172.21.15.40:0/3842319818 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f936813c490 0x7f936813b3e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9360002230 tx=0x7f936000cee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:13.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.332+0000 7f9364ff9700 1 -- 172.21.15.40:0/3842319818 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936000ab00 con 0x7f936813c490 2023-09-30T22:27:13.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.332+0000 7f9364ff9700 1 -- 172.21.15.40:0/3842319818 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936000ac60 con 0x7f936813c490 2023-09-30T22:27:13.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.332+0000 7f9364ff9700 1 -- 172.21.15.40:0/3842319818 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93600070d0 con 0x7f936813c490 2023-09-30T22:27:13.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.333+0000 7f936e2d8700 1 -- 172.21.15.40:0/3842319818 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9368140330 con 0x7f936813c490 2023-09-30T22:27:13.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.333+0000 7f936e2d8700 1 -- 172.21.15.40:0/3842319818 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f936813ebf0 con 0x7f936813c490 2023-09-30T22:27:13.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.333+0000 7f9364ff9700 1 -- 172.21.15.40:0/3842319818 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9360007250 con 0x7f936813c490 2023-09-30T22:27:13.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.334+0000 7f9364ff9700 1 -- 172.21.15.40:0/3842319818 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f936003eff0 con 0x7f936813c490 2023-09-30T22:27:13.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.334+0000 7f936e2d8700 1 -- 172.21.15.40:0/3842319818 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f936809e790 con 0x7f936813c490 2023-09-30T22:27:13.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.339+0000 7f9364ff9700 1 -- 172.21.15.40:0/3842319818 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f936809e790 con 0x7f936813c490 2023-09-30T22:27:13.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.364+0000 7f77658c8700 1 Processor -- start 2023-09-30T22:27:13.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.364+0000 7f77658c8700 1 -- start start 2023-09-30T22:27:13.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.364+0000 7f77658c8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f776009e220 0x7f776009e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:13.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.364+0000 7f77658c8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f776009eb30 0x7f7760133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:13.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.364+0000 7f77658c8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77601342e0 0x7f7760134780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:13.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.364+0000 7f77658c8700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f776006b460 con 0x7f776009eb30 2023-09-30T22:27:13.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.364+0000 7f77658c8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f776006b890 con 0x7f77601342e0 2023-09-30T22:27:13.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.364+0000 7f77658c8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f776006b020 con 0x7f776009e220 2023-09-30T22:27:13.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.365+0000 7f775effd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f776009e220 0x7f776009e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:13.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.365+0000 7f775effd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f776009e220 0x7f776009e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55874/0 (socket says 172.21.15.40:55874) 2023-09-30T22:27:13.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.365+0000 7f775effd700 1 -- 172.21.15.40:0/3266020068 learned_addr learned my addr 172.21.15.40:0/3266020068 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:13.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.365+0000 7f775e7fc700 1 --2- 172.21.15.40:0/3266020068 >> v2:172.21.15.40:3300/0 conn(0x7f776009eb30 0x7f7760133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:13.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.365+0000 7f775f7fe700 1 --2- 172.21.15.40:0/3266020068 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77601342e0 0x7f7760134780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:13.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.365+0000 7f775effd700 1 -- 172.21.15.40:0/3266020068 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77601342e0 msgr2=0x7f7760134780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:13.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.365+0000 7f775effd700 1 --2- 172.21.15.40:0/3266020068 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77601342e0 0x7f7760134780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.365+0000 7f775effd700 1 -- 172.21.15.40:0/3266020068 >> v2:172.21.15.40:3300/0 conn(0x7f776009eb30 msgr2=0x7f7760133da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:13.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.365+0000 7f775effd700 1 --2- 172.21.15.40:0/3266020068 >> v2:172.21.15.40:3300/0 conn(0x7f776009eb30 0x7f7760133da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.365+0000 7f775effd700 1 -- 172.21.15.40:0/3266020068 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776006ab90 con 0x7f776009e220 2023-09-30T22:27:13.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.365+0000 7f775effd700 1 --2- 172.21.15.40:0/3266020068 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f776009e220 0x7f776009e5f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f77500098f0 tx=0x7f7750009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be443338e5efc9d5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:13.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.365+0000 7f775dffb700 1 -- 172.21.15.40:0/3266020068 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7750011830 con 0x7f776009e220 2023-09-30T22:27:13.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.365+0000 7f775dffb700 1 -- 172.21.15.40:0/3266020068 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7750011990 con 0x7f776009e220 2023-09-30T22:27:13.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.365+0000 7f775dffb700 1 -- 172.21.15.40:0/3266020068 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7750011d20 con 0x7f776009e220 2023-09-30T22:27:13.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.366+0000 7f77658c8700 1 -- 172.21.15.40:0/3266020068 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f776009e220 msgr2=0x7f776009e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:13.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.366+0000 7f77658c8700 1 --2- 172.21.15.40:0/3266020068 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f776009e220 0x7f776009e5f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f77500098f0 tx=0x7f7750009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:13.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.366+0000 7f77658c8700 1 -- 172.21.15.40:0/3266020068 shutdown_connections 2023-09-30T22:27:13.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.366+0000 7f77658c8700 1 --2- 172.21.15.40:0/3266020068 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f776009e220 0x7f776009e5f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.366+0000 7f77658c8700 1 --2- 172.21.15.40:0/3266020068 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77601342e0 0x7f7760134780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.366+0000 7f77658c8700 1 --2- 172.21.15.40:0/3266020068 >> v2:172.21.15.40:3300/0 conn(0x7f776009eb30 0x7f7760133da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.366+0000 7f77658c8700 1 -- 172.21.15.40:0/3266020068 >> 172.21.15.40:0/3266020068 conn(0x7f77600a3590 msgr2=0x7f77600a3990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:13.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.366+0000 7f77658c8700 1 -- 172.21.15.40:0/3266020068 shutdown_connections 2023-09-30T22:27:13.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.366+0000 7f77658c8700 1 -- 172.21.15.40:0/3266020068 wait complete. 2023-09-30T22:27:13.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.367+0000 7f7217e2b700 1 Processor -- start 2023-09-30T22:27:13.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.367+0000 7f77658c8700 1 Processor -- start 2023-09-30T22:27:13.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.367+0000 7f7217e2b700 1 -- start start 2023-09-30T22:27:13.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.368+0000 7f7217e2b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f721009df30 0x7f7210135400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:13.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.368+0000 7f7217e2b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7210135940 0x7f7210137d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:13.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.368+0000 7f7217e2b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f721009e8b0 con 0x7f721009d450 2023-09-30T22:27:13.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.368+0000 7f7217e2b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f721009c3b0 con 0x7f721009df30 2023-09-30T22:27:13.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.368+0000 7f7217e2b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721009a6b0 con 0x7f7210135940 2023-09-30T22:27:13.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.368+0000 7f72163c8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7210135940 0x7f7210137d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:13.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.368+0000 7f72163c8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7210135940 0x7f7210137d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42164/0 (socket says 172.21.15.40:42164) 2023-09-30T22:27:13.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.368+0000 7f72163c8700 1 -- 172.21.15.40:0/1700801876 learned_addr learned my addr 172.21.15.40:0/1700801876 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:13.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.368+0000 7f72163c8700 1 -- 172.21.15.40:0/1700801876 >> v2:172.21.15.40:3300/0 conn(0x7f721009df30 msgr2=0x7f7210135400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:13.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.368+0000 7f72163c8700 1 --2- 172.21.15.40:0/1700801876 >> v2:172.21.15.40:3300/0 conn(0x7f721009df30 0x7f7210135400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.368+0000 7f72163c8700 1 -- 172.21.15.40:0/1700801876 >> v1:172.21.15.40:6789/0 conn(0x7f721009d450 legacy=0x7f721009d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:13.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.368+0000 7f72163c8700 1 -- 172.21.15.40:0/1700801876 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f721009b4f0 con 0x7f7210135940 2023-09-30T22:27:13.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.368+0000 7f77658c8700 1 -- start start 2023-09-30T22:27:13.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.368+0000 7f77658c8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f776009e220 0x7f776011e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:13.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.368+0000 7f77658c8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f776009eb30 0x7f776011eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:13.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.368+0000 7f77658c8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f77601342e0 0x7f776011eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:13.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.368+0000 7f77658c8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77601209c0 con 0x7f776009e220 2023-09-30T22:27:13.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.368+0000 7f77658c8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f776009cb20 con 0x7f776009eb30 2023-09-30T22:27:13.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.368+0000 7f77658c8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7760133d30 con 0x7f77601342e0 2023-09-30T22:27:13.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.368+0000 7f775e7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f776009eb30 0x7f776011eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:13.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.368+0000 7f775e7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f776009eb30 0x7f776011eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42178/0 (socket says 172.21.15.40:42178) 2023-09-30T22:27:13.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.368+0000 7f775e7fc700 1 -- 172.21.15.40:0/3789152523 learned_addr learned my addr 172.21.15.40:0/3789152523 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:13.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.369+0000 7f72163c8700 1 --2- 172.21.15.40:0/1700801876 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7210135940 0x7f7210137d20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7208009e50 tx=0x7f720800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b396a073fdce76f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:13.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.369+0000 7f775f7fe700 1 --2- 172.21.15.40:0/3789152523 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f77601342e0 0x7f776011eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:13.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.369+0000 7f775e7fc700 1 -- 172.21.15.40:0/3789152523 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f77601342e0 msgr2=0x7f776011eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:13.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.369+0000 7f775e7fc700 1 --2- 172.21.15.40:0/3789152523 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f77601342e0 0x7f776011eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.369+0000 7f775e7fc700 1 -- 172.21.15.40:0/3789152523 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f776009e220 msgr2=0x7f776011e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:13.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.369+0000 7f775e7fc700 1 --2- 172.21.15.40:0/3789152523 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f776009e220 0x7f776011e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.369+0000 7f775e7fc700 1 -- 172.21.15.40:0/3789152523 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7750009550 con 0x7f776009eb30 2023-09-30T22:27:13.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.369+0000 7f7214bc5700 1 -- 172.21.15.40:0/1700801876 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720800e070 con 0x7f7210135940 2023-09-30T22:27:13.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.369+0000 7f7214bc5700 1 -- 172.21.15.40:0/1700801876 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7208003a20 con 0x7f7210135940 2023-09-30T22:27:13.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.369+0000 7f7214bc5700 1 -- 172.21.15.40:0/1700801876 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7208003dd0 con 0x7f7210135940 2023-09-30T22:27:13.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.369+0000 7f775e7fc700 1 --2- 172.21.15.40:0/3789152523 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f776009eb30 0x7f776011eab0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f775400e900 tx=0x7f775400ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:13.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.369+0000 7f7747fff700 1 -- 172.21.15.40:0/3789152523 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775400ee50 con 0x7f776009eb30 2023-09-30T22:27:13.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.369+0000 7f7747fff700 1 -- 172.21.15.40:0/3789152523 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f775400c850 con 0x7f776009eb30 2023-09-30T22:27:13.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.369+0000 7f77658c8700 1 -- 172.21.15.40:0/3789152523 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7760133500 con 0x7f776009eb30 2023-09-30T22:27:13.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.369+0000 7f7747fff700 1 -- 172.21.15.40:0/3789152523 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775400cbe0 con 0x7f776009eb30 2023-09-30T22:27:13.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.370+0000 7f77658c8700 1 -- 172.21.15.40:0/3789152523 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7760122820 con 0x7f776009eb30 2023-09-30T22:27:13.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.370+0000 7f7217e2b700 1 -- 172.21.15.40:0/1700801876 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7210135940 msgr2=0x7f7210137d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:13.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.370+0000 7f7217e2b700 1 --2- 172.21.15.40:0/1700801876 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7210135940 0x7f7210137d20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7208009e50 tx=0x7f720800b330 comp rx=0 tx=0).stop 2023-09-30T22:27:13.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.370+0000 7f7217e2b700 1 -- 172.21.15.40:0/1700801876 shutdown_connections 2023-09-30T22:27:13.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.370+0000 7f7217e2b700 1 --2- 172.21.15.40:0/1700801876 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7210135940 0x7f7210137d20 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.370+0000 7f7217e2b700 1 --2- 172.21.15.40:0/1700801876 >> v2:172.21.15.40:3300/0 conn(0x7f721009df30 0x7f7210135400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.370+0000 7f7217e2b700 1 -- 172.21.15.40:0/1700801876 >> 172.21.15.40:0/1700801876 conn(0x7f72100a2a00 msgr2=0x7f72100a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:13.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.370+0000 7f7217e2b700 1 -- 172.21.15.40:0/1700801876 shutdown_connections 2023-09-30T22:27:13.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.370+0000 7f7217e2b700 1 -- 172.21.15.40:0/1700801876 wait complete. 2023-09-30T22:27:13.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.371+0000 7f77658c8700 1 -- 172.21.15.40:0/3789152523 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7760062380 con 0x7f776009eb30 2023-09-30T22:27:13.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.371+0000 7f7747fff700 1 -- 172.21.15.40:0/3789152523 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f775400cd40 con 0x7f776009eb30 2023-09-30T22:27:13.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.371+0000 7f7747fff700 1 -- 172.21.15.40:0/3789152523 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f775403f8c0 con 0x7f776009eb30 2023-09-30T22:27:13.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.372+0000 7f7217e2b700 1 Processor -- start 2023-09-30T22:27:13.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.372+0000 7f7217e2b700 1 -- start start 2023-09-30T22:27:13.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.372+0000 7f7217e2b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f721009d450 0x7f72101c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:13.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.372+0000 7f7217e2b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f721009df30 0x7f72101c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:13.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.373+0000 7f7217e2b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7210135940 0x7f72101c9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:13.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.373+0000 7f7217e2b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721013bae0 con 0x7f721009d450 2023-09-30T22:27:13.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.373+0000 7f7217e2b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721013a050 con 0x7f721009df30 2023-09-30T22:27:13.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.373+0000 7f7217e2b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7210139e20 con 0x7f7210135940 2023-09-30T22:27:13.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.373+0000 7f7215bc7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f721009d450 0x7f72101c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:13.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.373+0000 7f7215bc7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f721009d450 0x7f72101c87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36816/0 (socket says 172.21.15.40:36816) 2023-09-30T22:27:13.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.373+0000 7f7215bc7700 1 -- 172.21.15.40:0/4281408747 learned_addr learned my addr 172.21.15.40:0/4281408747 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:13.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.373+0000 7f72163c8700 1 --2- 172.21.15.40:0/4281408747 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7210135940 0x7f72101c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:13.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.373+0000 7f7215bc7700 1 -- 172.21.15.40:0/4281408747 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7210135940 msgr2=0x7f72101c9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:13.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.373+0000 7f7215bc7700 1 --2- 172.21.15.40:0/4281408747 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7210135940 0x7f72101c9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.373+0000 7f7215bc7700 1 -- 172.21.15.40:0/4281408747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f721009df30 msgr2=0x7f72101c8d00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:27:13.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.373+0000 7f7215bc7700 1 --2- 172.21.15.40:0/4281408747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f721009df30 0x7f72101c8d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.373+0000 7f7215bc7700 1 -- 172.21.15.40:0/4281408747 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7208009b30 con 0x7f721009d450 2023-09-30T22:27:13.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.373+0000 7f7215bc7700 1 --2- 172.21.15.40:0/4281408747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f721009d450 0x7f72101c87c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f720c00c4d0 tx=0x7f720c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:13.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.373+0000 7f72067fc700 1 -- 172.21.15.40:0/4281408747 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c0054e0 con 0x7f721009d450 2023-09-30T22:27:13.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.373+0000 7f72067fc700 1 -- 172.21.15.40:0/4281408747 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720c003680 con 0x7f721009d450 2023-09-30T22:27:13.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.373+0000 7f72067fc700 1 -- 172.21.15.40:0/4281408747 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c003a30 con 0x7f721009d450 2023-09-30T22:27:13.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.374+0000 7f7217e2b700 1 -- 172.21.15.40:0/4281408747 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72100a1ec0 con 0x7f721009d450 2023-09-30T22:27:13.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.374+0000 7f7217e2b700 1 -- 172.21.15.40:0/4281408747 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f721013aa90 con 0x7f721009d450 2023-09-30T22:27:13.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.375+0000 7f7217e2b700 1 -- 172.21.15.40:0/4281408747 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f721013b940 con 0x7f721009d450 2023-09-30T22:27:13.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.376+0000 7f72067fc700 1 -- 172.21.15.40:0/4281408747 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f720c003b90 con 0x7f721009d450 2023-09-30T22:27:13.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.376+0000 7f72067fc700 1 -- 172.21.15.40:0/4281408747 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f720c03ec80 con 0x7f721009d450 2023-09-30T22:27:13.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.380+0000 7f7747fff700 1 -- 172.21.15.40:0/3789152523 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f775401be10 con 0x7f776009eb30 2023-09-30T22:27:13.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.389+0000 7f72067fc700 1 -- 172.21.15.40:0/4281408747 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f721013b940 con 0x7f721009d450 2023-09-30T22:27:13.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.396+0000 7f02693cd700 1 Processor -- start 2023-09-30T22:27:13.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.396+0000 7f02693cd700 1 -- start start 2023-09-30T22:27:13.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.397+0000 7f02693cd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f026409d920 0x7f026409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:13.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.397+0000 7f02693cd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f026409e230 0x7f02641308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:13.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.397+0000 7f02693cd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0264130de0 0x7f0264131240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:13.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.397+0000 7f02693cd700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f026409edf0 con 0x7f026409d920 2023-09-30T22:27:13.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.397+0000 7f02693cd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026409adf0 con 0x7f0264130de0 2023-09-30T22:27:13.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.397+0000 7f02693cd700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f026409b660 con 0x7f026409e230 2023-09-30T22:27:13.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.397+0000 7f02627fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f026409e230 0x7f02641308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:13.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.397+0000 7f02627fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f026409e230 0x7f02641308a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55890/0 (socket says 172.21.15.40:55890) 2023-09-30T22:27:13.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.397+0000 7f02627fc700 1 -- 172.21.15.40:0/363511072 learned_addr learned my addr 172.21.15.40:0/363511072 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:13.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.397+0000 7f0262ffd700 1 --2- 172.21.15.40:0/363511072 >> v2:172.21.15.40:3300/0 conn(0x7f026409d920 0x7f026409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:13.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.397+0000 7f02637fe700 1 --2- 172.21.15.40:0/363511072 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0264130de0 0x7f0264131240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:13.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.397+0000 7f02627fc700 1 -- 172.21.15.40:0/363511072 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0264130de0 msgr2=0x7f0264131240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:13.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.397+0000 7f02627fc700 1 --2- 172.21.15.40:0/363511072 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0264130de0 0x7f0264131240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.397+0000 7f02627fc700 1 -- 172.21.15.40:0/363511072 >> v2:172.21.15.40:3300/0 conn(0x7f026409d920 msgr2=0x7f026409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:13.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.397+0000 7f02627fc700 1 --2- 172.21.15.40:0/363511072 >> v2:172.21.15.40:3300/0 conn(0x7f026409d920 0x7f026409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.397+0000 7f02627fc700 1 -- 172.21.15.40:0/363511072 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f026409a6e0 con 0x7f026409e230 2023-09-30T22:27:13.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.397+0000 7f02627fc700 1 --2- 172.21.15.40:0/363511072 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f026409e230 0x7f02641308a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f02580098f0 tx=0x7f0258009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35aa0f8309193f36 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:13.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.398+0000 7f0261ffb700 1 -- 172.21.15.40:0/363511072 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0258011830 con 0x7f026409e230 2023-09-30T22:27:13.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.398+0000 7f0261ffb700 1 -- 172.21.15.40:0/363511072 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0258011990 con 0x7f026409e230 2023-09-30T22:27:13.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.398+0000 7f0261ffb700 1 -- 172.21.15.40:0/363511072 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0258011d20 con 0x7f026409e230 2023-09-30T22:27:13.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.398+0000 7f02693cd700 1 -- 172.21.15.40:0/363511072 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f026409e230 msgr2=0x7f02641308a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:13.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.398+0000 7f02693cd700 1 --2- 172.21.15.40:0/363511072 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f026409e230 0x7f02641308a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f02580098f0 tx=0x7f0258009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:13.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.399+0000 7f02693cd700 1 -- 172.21.15.40:0/363511072 shutdown_connections 2023-09-30T22:27:13.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.399+0000 7f02693cd700 1 --2- 172.21.15.40:0/363511072 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0264130de0 0x7f0264131240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.399+0000 7f02693cd700 1 --2- 172.21.15.40:0/363511072 >> v2:172.21.15.40:3300/0 conn(0x7f026409d920 0x7f026409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.399+0000 7f02693cd700 1 --2- 172.21.15.40:0/363511072 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f026409e230 0x7f02641308a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.399+0000 7f02693cd700 1 -- 172.21.15.40:0/363511072 >> 172.21.15.40:0/363511072 conn(0x7f026409fb20 msgr2=0x7f026409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:13.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.399+0000 7f02693cd700 1 -- 172.21.15.40:0/363511072 shutdown_connections 2023-09-30T22:27:13.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.399+0000 7f02693cd700 1 -- 172.21.15.40:0/363511072 wait complete. 2023-09-30T22:27:13.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.400+0000 7f02693cd700 1 Processor -- start 2023-09-30T22:27:13.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.401+0000 7f02693cd700 1 -- start start 2023-09-30T22:27:13.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.401+0000 7f02693cd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f026409d920 0x7f026411b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:13.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.401+0000 7f02693cd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f026409e230 0x7f026411b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:13.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.401+0000 7f02693cd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0264130de0 0x7f026411ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:13.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.401+0000 7f02693cd700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0264126f50 con 0x7f026409e230 2023-09-30T22:27:13.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.401+0000 7f02693cd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026406b280 con 0x7f026409d920 2023-09-30T22:27:13.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.401+0000 7f02693cd700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f026411c3f0 con 0x7f0264130de0 2023-09-30T22:27:13.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.401+0000 7f0262ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f026409d920 0x7f026411b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:13.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.401+0000 7f02637fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0264130de0 0x7f026411ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:13.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.401+0000 7f0262ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f026409d920 0x7f026411b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42190/0 (socket says 172.21.15.40:42190) 2023-09-30T22:27:13.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.401+0000 7f0262ffd700 1 -- 172.21.15.40:0/1840721483 learned_addr learned my addr 172.21.15.40:0/1840721483 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:13.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.402+0000 7f02627fc700 1 --2- 172.21.15.40:0/1840721483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f026409e230 0x7f026411b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:13.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.402+0000 7f02637fe700 1 -- 172.21.15.40:0/1840721483 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f026409d920 msgr2=0x7f026411b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:13.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.402+0000 7f02637fe700 1 --2- 172.21.15.40:0/1840721483 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f026409d920 0x7f026411b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.402+0000 7f02637fe700 1 -- 172.21.15.40:0/1840721483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f026409e230 msgr2=0x7f026411b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:13.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.402+0000 7f02637fe700 1 --2- 172.21.15.40:0/1840721483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f026409e230 0x7f026411b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.402+0000 7f02637fe700 1 -- 172.21.15.40:0/1840721483 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0258009550 con 0x7f0264130de0 2023-09-30T22:27:13.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.402+0000 7f02637fe700 1 --2- 172.21.15.40:0/1840721483 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0264130de0 0x7f026411ba80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f025c00efc0 tx=0x7f025c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:13.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.402+0000 7f024b7fe700 1 -- 172.21.15.40:0/1840721483 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c00cc90 con 0x7f0264130de0 2023-09-30T22:27:13.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.402+0000 7f024b7fe700 1 -- 172.21.15.40:0/1840721483 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025c00f040 con 0x7f0264130de0 2023-09-30T22:27:13.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.402+0000 7f024b7fe700 1 -- 172.21.15.40:0/1840721483 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c0146c0 con 0x7f0264130de0 2023-09-30T22:27:13.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.402+0000 7f02693cd700 1 -- 172.21.15.40:0/1840721483 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f026411d050 con 0x7f0264130de0 2023-09-30T22:27:13.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.403+0000 7f02693cd700 1 -- 172.21.15.40:0/1840721483 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02641279c0 con 0x7f0264130de0 2023-09-30T22:27:13.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.404+0000 7f02693cd700 1 -- 172.21.15.40:0/1840721483 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0264126d90 con 0x7f0264130de0 2023-09-30T22:27:13.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.404+0000 7f024b7fe700 1 -- 172.21.15.40:0/1840721483 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f025c014820 con 0x7f0264130de0 2023-09-30T22:27:13.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.405+0000 7f024b7fe700 1 -- 172.21.15.40:0/1840721483 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f025c040200 con 0x7f0264130de0 2023-09-30T22:27:13.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.409+0000 7f024b7fe700 1 -- 172.21.15.40:0/1840721483 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f025c007900 con 0x7f0264130de0 2023-09-30T22:27:13.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.546+0000 7f936e2d8700 1 -- 172.21.15.40:0/3842319818 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f936809e790 con 0x7f936813c490 2023-09-30T22:27:13.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.546+0000 7f9364ff9700 1 -- 172.21.15.40:0/3842319818 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f936809e790 con 0x7f936813c490 2023-09-30T22:27:13.547 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:13.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.548+0000 7f936e2d8700 1 -- 172.21.15.40:0/3842319818 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f936813c490 msgr2=0x7f936813b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:13.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.548+0000 7f936e2d8700 1 --2- 172.21.15.40:0/3842319818 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f936813c490 0x7f936813b3e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9360002230 tx=0x7f936000cee0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.548+0000 7f936e2d8700 1 -- 172.21.15.40:0/3842319818 shutdown_connections 2023-09-30T22:27:13.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.548+0000 7f936e2d8700 1 --2- 172.21.15.40:0/3842319818 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f936806a6d0 0x7f936813a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.548+0000 7f936e2d8700 1 --2- 172.21.15.40:0/3842319818 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f936813c490 0x7f936813b3e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.548+0000 7f936e2d8700 1 --2- 172.21.15.40:0/3842319818 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f936809de60 0x7f936813aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.548+0000 7f936e2d8700 1 -- 172.21.15.40:0/3842319818 >> 172.21.15.40:0/3842319818 conn(0x7f936809fb20 msgr2=0x7f93680a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:13.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.549+0000 7f936e2d8700 1 -- 172.21.15.40:0/3842319818 shutdown_connections 2023-09-30T22:27:13.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.549+0000 7f936e2d8700 1 -- 172.21.15.40:0/3842319818 wait complete. 2023-09-30T22:27:13.563 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:13.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.584+0000 7f77658c8700 1 -- 172.21.15.40:0/3789152523 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f77600a1ed0 con 0x7f776009eb30 2023-09-30T22:27:13.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.584+0000 7f7747fff700 1 -- 172.21.15.40:0/3789152523 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7754017070 con 0x7f776009eb30 2023-09-30T22:27:13.585 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:13.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.586+0000 7f77658c8700 1 -- 172.21.15.40:0/3789152523 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f776009eb30 msgr2=0x7f776011eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:13.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.586+0000 7f77658c8700 1 --2- 172.21.15.40:0/3789152523 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f776009eb30 0x7f776011eab0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f775400e900 tx=0x7f775400ec10 comp rx=0 tx=0).stop 2023-09-30T22:27:13.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.586+0000 7f77658c8700 1 -- 172.21.15.40:0/3789152523 shutdown_connections 2023-09-30T22:27:13.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.586+0000 7f77658c8700 1 --2- 172.21.15.40:0/3789152523 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f77601342e0 0x7f776011eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.586+0000 7f77658c8700 1 --2- 172.21.15.40:0/3789152523 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f776009e220 0x7f776011e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.586+0000 7f77658c8700 1 --2- 172.21.15.40:0/3789152523 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f776009eb30 0x7f776011eab0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.586+0000 7f77658c8700 1 -- 172.21.15.40:0/3789152523 >> 172.21.15.40:0/3789152523 conn(0x7f77600a3590 msgr2=0x7f7760070650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:13.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.587+0000 7f77658c8700 1 -- 172.21.15.40:0/3789152523 shutdown_connections 2023-09-30T22:27:13.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.587+0000 7f77658c8700 1 -- 172.21.15.40:0/3789152523 wait complete. 2023-09-30T22:27:13.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.592+0000 7f7217e2b700 1 -- 172.21.15.40:0/4281408747 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f721013b6d0 con 0x7f721009d450 2023-09-30T22:27:13.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.593+0000 7f72067fc700 1 -- 172.21.15.40:0/4281408747 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f721013b6d0 con 0x7f721009d450 2023-09-30T22:27:13.593 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:13.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.595+0000 7f7217e2b700 1 -- 172.21.15.40:0/4281408747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f721009d450 msgr2=0x7f72101c87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:13.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.595+0000 7f7217e2b700 1 --2- 172.21.15.40:0/4281408747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f721009d450 0x7f72101c87c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f720c00c4d0 tx=0x7f720c00c7e0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.595+0000 7f7217e2b700 1 -- 172.21.15.40:0/4281408747 shutdown_connections 2023-09-30T22:27:13.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.595+0000 7f7217e2b700 1 --2- 172.21.15.40:0/4281408747 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7210135940 0x7f72101c9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.595+0000 7f7217e2b700 1 --2- 172.21.15.40:0/4281408747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f721009d450 0x7f72101c87c0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.595+0000 7f7217e2b700 1 --2- 172.21.15.40:0/4281408747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f721009df30 0x7f72101c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.595+0000 7f7217e2b700 1 -- 172.21.15.40:0/4281408747 >> 172.21.15.40:0/4281408747 conn(0x7f72100a2a00 msgr2=0x7f721012c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:13.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.595+0000 7f7217e2b700 1 -- 172.21.15.40:0/4281408747 shutdown_connections 2023-09-30T22:27:13.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.595+0000 7f7217e2b700 1 -- 172.21.15.40:0/4281408747 wait complete. 2023-09-30T22:27:13.600 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:13.608 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:13.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.608+0000 7f02693cd700 1 -- 172.21.15.40:0/1840721483 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0264062380 con 0x7f0264130de0 2023-09-30T22:27:13.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.609+0000 7f024b7fe700 1 -- 172.21.15.40:0/1840721483 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f025c018020 con 0x7f0264130de0 2023-09-30T22:27:13.609 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:13.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.611+0000 7f02693cd700 1 -- 172.21.15.40:0/1840721483 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0264130de0 msgr2=0x7f026411ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:13.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.611+0000 7f02693cd700 1 --2- 172.21.15.40:0/1840721483 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0264130de0 0x7f026411ba80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f025c00efc0 tx=0x7f025c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.611+0000 7f02693cd700 1 -- 172.21.15.40:0/1840721483 shutdown_connections 2023-09-30T22:27:13.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.611+0000 7f02693cd700 1 --2- 172.21.15.40:0/1840721483 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0264130de0 0x7f026411ba80 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.611+0000 7f02693cd700 1 --2- 172.21.15.40:0/1840721483 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f026409d920 0x7f026411b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.611+0000 7f02693cd700 1 --2- 172.21.15.40:0/1840721483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f026409e230 0x7f026411b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.611+0000 7f02693cd700 1 -- 172.21.15.40:0/1840721483 >> 172.21.15.40:0/1840721483 conn(0x7f026409fb20 msgr2=0x7f0264130100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:13.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.611+0000 7f02693cd700 1 -- 172.21.15.40:0/1840721483 shutdown_connections 2023-09-30T22:27:13.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:13.611+0000 7f02693cd700 1 -- 172.21.15.40:0/1840721483 wait complete. 2023-09-30T22:27:13.624 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:14.565 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:14.601 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:14.609 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:14.625 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:14.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.714+0000 7f515a6bc700 1 Processor -- start 2023-09-30T22:27:14.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.714+0000 7f515a6bc700 1 -- start start 2023-09-30T22:27:14.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.714+0000 7f515a6bc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f515409e400 0x7f5154135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:14.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.714+0000 7f515a6bc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5154136230 0x7f5154138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:14.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.715+0000 7f515a6bc700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f515409adf0 con 0x7f515409d920 2023-09-30T22:27:14.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.715+0000 7f515a6bc700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f515409e7f0 con 0x7f5154136230 2023-09-30T22:27:14.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.715+0000 7f515a6bc700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f515409edf0 con 0x7f515409e400 2023-09-30T22:27:14.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.715+0000 7f5158c59700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5154136230 0x7f5154138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:14.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.715+0000 7f51537fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f515409e400 0x7f5154135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:14.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.715+0000 7f5158c59700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5154136230 0x7f5154138610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36836/0 (socket says 172.21.15.40:36836) 2023-09-30T22:27:14.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.715+0000 7f5158c59700 1 -- 172.21.15.40:0/1040472314 learned_addr learned my addr 172.21.15.40:0/1040472314 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:14.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.715+0000 7f5158c59700 1 -- 172.21.15.40:0/1040472314 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f515409e400 msgr2=0x7f5154135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:14.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.715+0000 7f5158c59700 1 --2- 172.21.15.40:0/1040472314 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f515409e400 0x7f5154135cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.715+0000 7f5158c59700 1 -- 172.21.15.40:0/1040472314 >> v1:172.21.15.40:6789/0 conn(0x7f515409d920 legacy=0x7f515409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:14.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.715+0000 7f5158c59700 1 -- 172.21.15.40:0/1040472314 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f515409b660 con 0x7f5154136230 2023-09-30T22:27:14.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.715+0000 7f51537fe700 1 --2- 172.21.15.40:0/1040472314 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f515409e400 0x7f5154135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:14.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.715+0000 7f5158c59700 1 --2- 172.21.15.40:0/1040472314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5154136230 0x7f5154138610 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f514c00bef0 tx=0x7f514c009370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc02eaf877187716 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:14.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.716+0000 7f5152ffd700 1 -- 172.21.15.40:0/1040472314 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c00b480 con 0x7f5154136230 2023-09-30T22:27:14.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.716+0000 7f5152ffd700 1 -- 172.21.15.40:0/1040472314 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514c00c950 con 0x7f5154136230 2023-09-30T22:27:14.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.716+0000 7f5152ffd700 1 -- 172.21.15.40:0/1040472314 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c00cd00 con 0x7f5154136230 2023-09-30T22:27:14.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.716+0000 7f515a6bc700 1 -- 172.21.15.40:0/1040472314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5154136230 msgr2=0x7f5154138610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:14.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.716+0000 7f515a6bc700 1 --2- 172.21.15.40:0/1040472314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5154136230 0x7f5154138610 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f514c00bef0 tx=0x7f514c009370 comp rx=0 tx=0).stop 2023-09-30T22:27:14.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.716+0000 7f515a6bc700 1 -- 172.21.15.40:0/1040472314 shutdown_connections 2023-09-30T22:27:14.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.716+0000 7f515a6bc700 1 --2- 172.21.15.40:0/1040472314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5154136230 0x7f5154138610 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.716+0000 7f515a6bc700 1 --2- 172.21.15.40:0/1040472314 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f515409e400 0x7f5154135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.716+0000 7f515a6bc700 1 -- 172.21.15.40:0/1040472314 >> 172.21.15.40:0/1040472314 conn(0x7f515409fb20 msgr2=0x7f515409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:14.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.717+0000 7f515a6bc700 1 -- 172.21.15.40:0/1040472314 shutdown_connections 2023-09-30T22:27:14.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.717+0000 7f515a6bc700 1 -- 172.21.15.40:0/1040472314 wait complete. 2023-09-30T22:27:14.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.718+0000 7f515a6bc700 1 Processor -- start 2023-09-30T22:27:14.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.718+0000 7f515a6bc700 1 -- start start 2023-09-30T22:27:14.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.718+0000 7f515a6bc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f515409d920 0x7f515411e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:14.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.718+0000 7f515a6bc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f515409e400 0x7f515411ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:14.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.718+0000 7f515a6bc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5154136230 0x7f515411f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:14.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.718+0000 7f515a6bc700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51541202c0 con 0x7f515409e400 2023-09-30T22:27:14.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.718+0000 7f515a6bc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5154121c30 con 0x7f5154136230 2023-09-30T22:27:14.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.718+0000 7f515a6bc700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5154135ae0 con 0x7f515409d920 2023-09-30T22:27:14.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.718+0000 7f51537fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f515409e400 0x7f515411ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:14.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.718+0000 7f5158c59700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5154136230 0x7f515411f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:14.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.718+0000 7f51537fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f515409e400 0x7f515411ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36842/0 (socket says 172.21.15.40:36842) 2023-09-30T22:27:14.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.718+0000 7f51537fe700 1 -- 172.21.15.40:0/3218924575 learned_addr learned my addr 172.21.15.40:0/3218924575 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:14.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.719+0000 7f5153fff700 1 --2- 172.21.15.40:0/3218924575 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f515409d920 0x7f515411e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:14.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.719+0000 7f51537fe700 1 -- 172.21.15.40:0/3218924575 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f515409d920 msgr2=0x7f515411e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:14.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.719+0000 7f51537fe700 1 --2- 172.21.15.40:0/3218924575 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f515409d920 0x7f515411e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.719+0000 7f51537fe700 1 -- 172.21.15.40:0/3218924575 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5154136230 msgr2=0x7f515411f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:14.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.719+0000 7f51537fe700 1 --2- 172.21.15.40:0/3218924575 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5154136230 0x7f515411f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.719+0000 7f51537fe700 1 -- 172.21.15.40:0/3218924575 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514800d940 con 0x7f515409e400 2023-09-30T22:27:14.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.719+0000 7f5153fff700 1 --2- 172.21.15.40:0/3218924575 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f515409d920 0x7f515411e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:14.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.719+0000 7f51537fe700 1 --2- 172.21.15.40:0/3218924575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f515409e400 0x7f515411ebf0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f5148012fc0 tx=0x7f51480103a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:14.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.719+0000 7f5150ff9700 1 -- 172.21.15.40:0/3218924575 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5148010bb0 con 0x7f515409e400 2023-09-30T22:27:14.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.719+0000 7f5150ff9700 1 -- 172.21.15.40:0/3218924575 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5148013040 con 0x7f515409e400 2023-09-30T22:27:14.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.719+0000 7f515a6bc700 1 -- 172.21.15.40:0/3218924575 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f514c00bb50 con 0x7f515409e400 2023-09-30T22:27:14.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.719+0000 7f5150ff9700 1 -- 172.21.15.40:0/3218924575 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514800d2e0 con 0x7f515409e400 2023-09-30T22:27:14.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.719+0000 7f515a6bc700 1 -- 172.21.15.40:0/3218924575 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5154120ac0 con 0x7f515409e400 2023-09-30T22:27:14.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.720+0000 7f5150ff9700 1 -- 172.21.15.40:0/3218924575 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5148018480 con 0x7f515409e400 2023-09-30T22:27:14.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.721+0000 7f5150ff9700 1 -- 172.21.15.40:0/3218924575 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5148043780 con 0x7f515409e400 2023-09-30T22:27:14.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.721+0000 7f515a6bc700 1 -- 172.21.15.40:0/3218924575 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5154062380 con 0x7f515409e400 2023-09-30T22:27:14.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.726+0000 7f5150ff9700 1 -- 172.21.15.40:0/3218924575 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5148016910 con 0x7f515409e400 2023-09-30T22:27:14.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.752+0000 7f8277a85700 1 Processor -- start 2023-09-30T22:27:14.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.752+0000 7f0819f70700 1 Processor -- start 2023-09-30T22:27:14.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.752+0000 7f8277a85700 1 -- start start 2023-09-30T22:27:14.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.752+0000 7f0819f70700 1 -- start start 2023-09-30T22:27:14.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.752+0000 7f0819f70700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0814136bf0 0x7f0814138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:14.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.752+0000 7f0819f70700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0814139510 0x7f081413b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:14.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.752+0000 7f0819f70700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08140a2600 con 0x7f081409c890 2023-09-30T22:27:14.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.753+0000 7f0819f70700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08140a29d0 con 0x7f0814139510 2023-09-30T22:27:14.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.753+0000 7f0819f70700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f081409fb40 con 0x7f0814136bf0 2023-09-30T22:27:14.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.753+0000 7f0813fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0814139510 0x7f081413b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:14.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.753+0000 7f0813fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0814139510 0x7f081413b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42194/0 (socket says 172.21.15.40:42194) 2023-09-30T22:27:14.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.753+0000 7f0813fff700 1 -- 172.21.15.40:0/3471792674 learned_addr learned my addr 172.21.15.40:0/3471792674 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:14.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.753+0000 7f0812ffd700 1 --2- 172.21.15.40:0/3471792674 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0814136bf0 0x7f0814138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:14.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.752+0000 7f8277a85700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f827009d920 0x7f827009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:14.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.752+0000 7f8277a85700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f827009f0f0 0x7f827009e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:14.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.752+0000 7f8277a85700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8270133ca0 0x7f8270134110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:14.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.753+0000 7f8277a85700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f827006b4c0 con 0x7f827009d920 2023-09-30T22:27:14.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.753+0000 7f8277a85700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f827009a8f0 con 0x7f8270133ca0 2023-09-30T22:27:14.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.753+0000 7f8277a85700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f827009f940 con 0x7f827009f0f0 2023-09-30T22:27:14.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.753+0000 7f8275821700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f827009d920 0x7f827009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:14.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.753+0000 7f8275821700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f827009d920 0x7f827009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36858/0 (socket says 172.21.15.40:36858) 2023-09-30T22:27:14.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.753+0000 7f8275821700 1 -- 172.21.15.40:0/3081894302 learned_addr learned my addr 172.21.15.40:0/3081894302 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:14.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.753+0000 7f8275020700 1 --2- 172.21.15.40:0/3081894302 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f827009f0f0 0x7f827009e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:14.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.753+0000 7f0813fff700 1 -- 172.21.15.40:0/3471792674 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0814136bf0 msgr2=0x7f0814138fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:14.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.753+0000 7f0813fff700 1 --2- 172.21.15.40:0/3471792674 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0814136bf0 0x7f0814138fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.753+0000 7f0813fff700 1 -- 172.21.15.40:0/3471792674 >> v1:172.21.15.40:6789/0 conn(0x7f081409c890 legacy=0x7f081409cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:14.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.753+0000 7f0813fff700 1 -- 172.21.15.40:0/3471792674 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f081409d370 con 0x7f0814139510 2023-09-30T22:27:14.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.753+0000 7f8276022700 1 --2- 172.21.15.40:0/3081894302 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8270133ca0 0x7f8270134110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:14.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.753+0000 7f8275821700 1 -- 172.21.15.40:0/3081894302 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f827009f0f0 msgr2=0x7f827009e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:14.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.753+0000 7f8275821700 1 --2- 172.21.15.40:0/3081894302 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f827009f0f0 0x7f827009e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.753+0000 7f8275821700 1 -- 172.21.15.40:0/3081894302 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8270133ca0 msgr2=0x7f8270134110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:14.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.753+0000 7f8275821700 1 --2- 172.21.15.40:0/3081894302 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8270133ca0 0x7f8270134110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.753+0000 7f8275821700 1 -- 172.21.15.40:0/3081894302 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f827009f6e0 con 0x7f827009d920 2023-09-30T22:27:14.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.754+0000 7f0813fff700 1 --2- 172.21.15.40:0/3471792674 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0814139510 0x7f081413b8f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f080c009e80 tx=0x7f080c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88a25f1c159d29ca server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:14.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.754+0000 7f8275821700 1 --2- 172.21.15.40:0/3081894302 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f827009d920 0x7f827009dcf0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f826c0098f0 tx=0x7f826c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac29966c8c01bea6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:14.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.754+0000 7f827481f700 1 -- 172.21.15.40:0/3081894302 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c005e30 con 0x7f827009d920 2023-09-30T22:27:14.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.754+0000 7f08127fc700 1 -- 172.21.15.40:0/3471792674 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080c00e070 con 0x7f0814139510 2023-09-30T22:27:14.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.754+0000 7f08127fc700 1 -- 172.21.15.40:0/3471792674 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080c003a20 con 0x7f0814139510 2023-09-30T22:27:14.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.754+0000 7f08127fc700 1 -- 172.21.15.40:0/3471792674 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080c003dd0 con 0x7f0814139510 2023-09-30T22:27:14.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.754+0000 7f827481f700 1 -- 172.21.15.40:0/3081894302 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826c004030 con 0x7f827009d920 2023-09-30T22:27:14.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.754+0000 7f827481f700 1 -- 172.21.15.40:0/3081894302 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c0043e0 con 0x7f827009d920 2023-09-30T22:27:14.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.755+0000 7f0819f70700 1 -- 172.21.15.40:0/3471792674 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0814139510 msgr2=0x7f081413b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:14.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.755+0000 7f0819f70700 1 --2- 172.21.15.40:0/3471792674 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0814139510 0x7f081413b8f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f080c009e80 tx=0x7f080c00b330 comp rx=0 tx=0).stop 2023-09-30T22:27:14.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.755+0000 7f8277a85700 1 -- 172.21.15.40:0/3081894302 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f827009d920 msgr2=0x7f827009dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:14.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.755+0000 7f8277a85700 1 --2- 172.21.15.40:0/3081894302 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f827009d920 0x7f827009dcf0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f826c0098f0 tx=0x7f826c009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:14.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.755+0000 7f0819f70700 1 -- 172.21.15.40:0/3471792674 shutdown_connections 2023-09-30T22:27:14.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.755+0000 7f0819f70700 1 --2- 172.21.15.40:0/3471792674 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0814139510 0x7f081413b8f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.755+0000 7f0819f70700 1 --2- 172.21.15.40:0/3471792674 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0814136bf0 0x7f0814138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.755+0000 7f0819f70700 1 -- 172.21.15.40:0/3471792674 >> 172.21.15.40:0/3471792674 conn(0x7f08140a7080 msgr2=0x7f08140a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:14.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.755+0000 7f0819f70700 1 -- 172.21.15.40:0/3471792674 shutdown_connections 2023-09-30T22:27:14.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.755+0000 7f0819f70700 1 -- 172.21.15.40:0/3471792674 wait complete. 2023-09-30T22:27:14.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.755+0000 7f8277a85700 1 -- 172.21.15.40:0/3081894302 shutdown_connections 2023-09-30T22:27:14.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.755+0000 7f8277a85700 1 --2- 172.21.15.40:0/3081894302 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8270133ca0 0x7f8270134110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.755+0000 7f8277a85700 1 --2- 172.21.15.40:0/3081894302 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f827009d920 0x7f827009dcf0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.755+0000 7f8277a85700 1 --2- 172.21.15.40:0/3081894302 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f827009f0f0 0x7f827009e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.755+0000 7f8277a85700 1 -- 172.21.15.40:0/3081894302 >> 172.21.15.40:0/3081894302 conn(0x7f827009fb20 msgr2=0x7f827009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:14.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.755+0000 7f8277a85700 1 -- 172.21.15.40:0/3081894302 shutdown_connections 2023-09-30T22:27:14.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.755+0000 7f8277a85700 1 -- 172.21.15.40:0/3081894302 wait complete. 2023-09-30T22:27:14.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.756+0000 7f0819f70700 1 Processor -- start 2023-09-30T22:27:14.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.756+0000 7f8277a85700 1 Processor -- start 2023-09-30T22:27:14.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.756+0000 7f0819f70700 1 -- start start 2023-09-30T22:27:14.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.756+0000 7f8277a85700 1 -- start start 2023-09-30T22:27:14.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.757+0000 7f0819f70700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f081409c890 0x7f081406e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:14.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.757+0000 7f0819f70700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0814136bf0 0x7f081406e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:14.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.757+0000 7f0819f70700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0814139510 0x7f081406ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:14.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.757+0000 7f0819f70700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081409ecf0 con 0x7f0814136bf0 2023-09-30T22:27:14.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.757+0000 7f0819f70700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f081412beb0 con 0x7f081409c890 2023-09-30T22:27:14.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.757+0000 7f0819f70700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0814071c70 con 0x7f0814139510 2023-09-30T22:27:14.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.757+0000 7f8277a85700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f827009d920 0x7f8270120500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:14.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.757+0000 7f08137fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f081409c890 0x7f081406e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:14.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.757+0000 7f08137fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f081409c890 0x7f081406e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42204/0 (socket says 172.21.15.40:42204) 2023-09-30T22:27:14.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.757+0000 7f08137fe700 1 -- 172.21.15.40:0/2006497509 learned_addr learned my addr 172.21.15.40:0/2006497509 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:14.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.757+0000 7f0813fff700 1 --2- 172.21.15.40:0/2006497509 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0814139510 0x7f081406ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:14.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.757+0000 7f8275821700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f827009d920 0x7f8270120500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:14.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.757+0000 7f0812ffd700 1 --2- 172.21.15.40:0/2006497509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0814136bf0 0x7f081406e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:14.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.757+0000 7f8275821700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f827009d920 0x7f8270120500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55956/0 (socket says 172.21.15.40:55956) 2023-09-30T22:27:14.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.757+0000 7f8277a85700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8270133ca0 0x7f8270120a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:14.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.757+0000 7f8277a85700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8270120f80 0x7f82701ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:14.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.757+0000 7f8277a85700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82701219d0 con 0x7f8270133ca0 2023-09-30T22:27:14.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.757+0000 7f8277a85700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8270124020 con 0x7f8270120f80 2023-09-30T22:27:14.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.757+0000 7f8277a85700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82701226f0 con 0x7f827009d920 2023-09-30T22:27:14.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.757+0000 7f0813fff700 1 -- 172.21.15.40:0/2006497509 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f081409c890 msgr2=0x7f081406e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:14.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.757+0000 7f0813fff700 1 --2- 172.21.15.40:0/2006497509 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f081409c890 0x7f081406e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.757+0000 7f0813fff700 1 -- 172.21.15.40:0/2006497509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0814136bf0 msgr2=0x7f081406e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:14.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.757+0000 7f0813fff700 1 --2- 172.21.15.40:0/2006497509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0814136bf0 0x7f081406e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.757+0000 7f0813fff700 1 -- 172.21.15.40:0/2006497509 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080c009b30 con 0x7f0814139510 2023-09-30T22:27:14.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.757+0000 7f8276022700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8270120f80 0x7f82701ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:14.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.758+0000 7f8276022700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8270120f80 0x7f82701ceb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42206/0 (socket says 172.21.15.40:42206) 2023-09-30T22:27:14.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.758+0000 7f8276022700 1 -- 172.21.15.40:0/3746306237 learned_addr learned my addr 172.21.15.40:0/3746306237 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:14.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.758+0000 7f8275020700 1 --2- 172.21.15.40:0/3746306237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8270133ca0 0x7f8270120a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:14.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.758+0000 7f0813fff700 1 --2- 172.21.15.40:0/2006497509 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0814139510 0x7f081406ec40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f080c014000 tx=0x7f080c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:14.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.758+0000 7f07fbfff700 1 -- 172.21.15.40:0/2006497509 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080c004440 con 0x7f0814139510 2023-09-30T22:27:14.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.758+0000 7f07fbfff700 1 -- 172.21.15.40:0/2006497509 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080c0045c0 con 0x7f0814139510 2023-09-30T22:27:14.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.758+0000 7f0819f70700 1 -- 172.21.15.40:0/2006497509 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08140a6110 con 0x7f0814139510 2023-09-30T22:27:14.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.758+0000 7f07fbfff700 1 -- 172.21.15.40:0/2006497509 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080c004970 con 0x7f0814139510 2023-09-30T22:27:14.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.758+0000 7f8276022700 1 -- 172.21.15.40:0/3746306237 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f827009d920 msgr2=0x7f8270120500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:14.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.758+0000 7f8276022700 1 --2- 172.21.15.40:0/3746306237 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f827009d920 0x7f8270120500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.758+0000 7f8276022700 1 -- 172.21.15.40:0/3746306237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8270133ca0 msgr2=0x7f8270120a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:14.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.758+0000 7f8276022700 1 --2- 172.21.15.40:0/3746306237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8270133ca0 0x7f8270120a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.758+0000 7f8276022700 1 -- 172.21.15.40:0/3746306237 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f826c009500 con 0x7f8270120f80 2023-09-30T22:27:14.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.758+0000 7f8275821700 1 --2- 172.21.15.40:0/3746306237 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f827009d920 0x7f8270120500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:14.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.759+0000 7f8276022700 1 --2- 172.21.15.40:0/3746306237 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8270120f80 0x7f82701ceb60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8268009dd0 tx=0x7f826800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:14.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.759+0000 7f82667fc700 1 -- 172.21.15.40:0/3746306237 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8268009c40 con 0x7f8270120f80 2023-09-30T22:27:14.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.759+0000 7f82667fc700 1 -- 172.21.15.40:0/3746306237 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826800f040 con 0x7f8270120f80 2023-09-30T22:27:14.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.759+0000 7f8277a85700 1 -- 172.21.15.40:0/3746306237 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82701237b0 con 0x7f8270120f80 2023-09-30T22:27:14.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.759+0000 7f82667fc700 1 -- 172.21.15.40:0/3746306237 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826800ceb0 con 0x7f8270120f80 2023-09-30T22:27:14.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.759+0000 7f0819f70700 1 -- 172.21.15.40:0/2006497509 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f081412b950 con 0x7f0814139510 2023-09-30T22:27:14.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.759+0000 7f07fbfff700 1 -- 172.21.15.40:0/2006497509 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f080c012430 con 0x7f0814139510 2023-09-30T22:27:14.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.760+0000 7f07fbfff700 1 -- 172.21.15.40:0/2006497509 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f080c0092e0 con 0x7f0814139510 2023-09-30T22:27:14.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.759+0000 7f8277a85700 1 -- 172.21.15.40:0/3746306237 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82700a2950 con 0x7f8270120f80 2023-09-30T22:27:14.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.760+0000 7f0819f70700 1 -- 172.21.15.40:0/2006497509 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08140a5c60 con 0x7f0814139510 2023-09-30T22:27:14.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.760+0000 7f8277a85700 1 -- 172.21.15.40:0/3746306237 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8270071700 con 0x7f8270120f80 2023-09-30T22:27:14.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.761+0000 7f82667fc700 1 -- 172.21.15.40:0/3746306237 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8268014480 con 0x7f8270120f80 2023-09-30T22:27:14.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.761+0000 7f82667fc700 1 -- 172.21.15.40:0/3746306237 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f82680406a0 con 0x7f8270120f80 2023-09-30T22:27:14.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.765+0000 7f07fbfff700 1 -- 172.21.15.40:0/2006497509 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f080c017070 con 0x7f0814139510 2023-09-30T22:27:14.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.770+0000 7f82667fc700 1 -- 172.21.15.40:0/3746306237 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8268012930 con 0x7f8270120f80 2023-09-30T22:27:14.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.793+0000 7f44fadc8700 1 Processor -- start 2023-09-30T22:27:14.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.793+0000 7f44fadc8700 1 -- start start 2023-09-30T22:27:14.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.793+0000 7f44fadc8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f44f4136bf0 0x7f44f4138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:14.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.794+0000 7f44fadc8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f44f4139510 0x7f44f413b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:14.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.794+0000 7f44fadc8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44f40a2600 con 0x7f44f409c890 2023-09-30T22:27:14.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.794+0000 7f44fadc8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f40a29d0 con 0x7f44f4136bf0 2023-09-30T22:27:14.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.794+0000 7f44fadc8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44f409fb40 con 0x7f44f4139510 2023-09-30T22:27:14.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.794+0000 7f44f9365700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f44f4139510 0x7f44f413b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:14.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.794+0000 7f44f9365700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f44f4139510 0x7f44f413b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55970/0 (socket says 172.21.15.40:55970) 2023-09-30T22:27:14.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.794+0000 7f44f9365700 1 -- 172.21.15.40:0/3529957099 learned_addr learned my addr 172.21.15.40:0/3529957099 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:14.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.794+0000 7f44f3fff700 1 --2- 172.21.15.40:0/3529957099 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f44f4136bf0 0x7f44f4138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:14.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.794+0000 7f44f9365700 1 -- 172.21.15.40:0/3529957099 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f44f4136bf0 msgr2=0x7f44f4138fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:14.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.794+0000 7f44f9365700 1 --2- 172.21.15.40:0/3529957099 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f44f4136bf0 0x7f44f4138fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.794+0000 7f44f9365700 1 -- 172.21.15.40:0/3529957099 >> v1:172.21.15.40:6789/0 conn(0x7f44f409c890 legacy=0x7f44f409cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:14.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.794+0000 7f44f9365700 1 -- 172.21.15.40:0/3529957099 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f409d370 con 0x7f44f4139510 2023-09-30T22:27:14.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.794+0000 7f44f9365700 1 --2- 172.21.15.40:0/3529957099 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f44f4139510 0x7f44f413b8f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f44ec009e80 tx=0x7f44ec00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=685b59c2e9586ea8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:14.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.795+0000 7f44f37fe700 1 -- 172.21.15.40:0/3529957099 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ec00e070 con 0x7f44f4139510 2023-09-30T22:27:14.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.795+0000 7f44f37fe700 1 -- 172.21.15.40:0/3529957099 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ec00b960 con 0x7f44f4139510 2023-09-30T22:27:14.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.795+0000 7f44f37fe700 1 -- 172.21.15.40:0/3529957099 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ec00bd10 con 0x7f44f4139510 2023-09-30T22:27:14.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.795+0000 7f44fadc8700 1 -- 172.21.15.40:0/3529957099 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f44f4139510 msgr2=0x7f44f413b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:14.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.795+0000 7f44fadc8700 1 --2- 172.21.15.40:0/3529957099 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f44f4139510 0x7f44f413b8f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f44ec009e80 tx=0x7f44ec00b330 comp rx=0 tx=0).stop 2023-09-30T22:27:14.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.795+0000 7f44fadc8700 1 -- 172.21.15.40:0/3529957099 shutdown_connections 2023-09-30T22:27:14.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.795+0000 7f44fadc8700 1 --2- 172.21.15.40:0/3529957099 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f44f4139510 0x7f44f413b8f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.795+0000 7f44fadc8700 1 --2- 172.21.15.40:0/3529957099 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f44f4136bf0 0x7f44f4138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.795+0000 7f44fadc8700 1 -- 172.21.15.40:0/3529957099 >> 172.21.15.40:0/3529957099 conn(0x7f44f40a7080 msgr2=0x7f44f40a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:14.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.795+0000 7f44fadc8700 1 -- 172.21.15.40:0/3529957099 shutdown_connections 2023-09-30T22:27:14.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.795+0000 7f44fadc8700 1 -- 172.21.15.40:0/3529957099 wait complete. 2023-09-30T22:27:14.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.796+0000 7f44fadc8700 1 Processor -- start 2023-09-30T22:27:14.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.796+0000 7f44fadc8700 1 -- start start 2023-09-30T22:27:14.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.797+0000 7f44fadc8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f44f409c890 0x7f44f406ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:14.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.797+0000 7f44fadc8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44f4136bf0 0x7f44f406f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:14.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.797+0000 7f44fadc8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f44f4139510 0x7f44f406f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:14.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.797+0000 7f44fadc8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f40712a0 con 0x7f44f4136bf0 2023-09-30T22:27:14.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.797+0000 7f44fadc8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f40a5ef0 con 0x7f44f4139510 2023-09-30T22:27:14.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.797+0000 7f44fadc8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44f409ecf0 con 0x7f44f409c890 2023-09-30T22:27:14.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.797+0000 7f44f3fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44f4136bf0 0x7f44f406f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:14.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.797+0000 7f44f3fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44f4136bf0 0x7f44f406f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36904/0 (socket says 172.21.15.40:36904) 2023-09-30T22:27:14.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.797+0000 7f44f3fff700 1 -- 172.21.15.40:0/1172666287 learned_addr learned my addr 172.21.15.40:0/1172666287 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:14.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.797+0000 7f44f9365700 1 --2- 172.21.15.40:0/1172666287 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f44f4139510 0x7f44f406f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:14.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.798+0000 7f44f3fff700 1 -- 172.21.15.40:0/1172666287 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f44f409c890 msgr2=0x7f44f406ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:14.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.798+0000 7f44f3fff700 1 --2- 172.21.15.40:0/1172666287 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f44f409c890 0x7f44f406ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.798+0000 7f44f3fff700 1 -- 172.21.15.40:0/1172666287 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f44f4139510 msgr2=0x7f44f406f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:14.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.798+0000 7f44f3fff700 1 --2- 172.21.15.40:0/1172666287 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f44f4139510 0x7f44f406f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.798+0000 7f44f3fff700 1 -- 172.21.15.40:0/1172666287 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ec009b30 con 0x7f44f4136bf0 2023-09-30T22:27:14.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.798+0000 7f44f3fff700 1 --2- 172.21.15.40:0/1172666287 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44f4136bf0 0x7f44f406f370 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f44e000e810 tx=0x7f44e000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:14.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.798+0000 7f44f17fa700 1 -- 172.21.15.40:0/1172666287 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e0013610 con 0x7f44f4136bf0 2023-09-30T22:27:14.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.798+0000 7f44f17fa700 1 -- 172.21.15.40:0/1172666287 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e0013770 con 0x7f44f4136bf0 2023-09-30T22:27:14.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.798+0000 7f44fadc8700 1 -- 172.21.15.40:0/1172666287 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44f4070ff0 con 0x7f44f4136bf0 2023-09-30T22:27:14.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.798+0000 7f44fadc8700 1 -- 172.21.15.40:0/1172666287 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44f412c640 con 0x7f44f4136bf0 2023-09-30T22:27:14.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.798+0000 7f44f17fa700 1 -- 172.21.15.40:0/1172666287 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e0013b20 con 0x7f44f4136bf0 2023-09-30T22:27:14.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.799+0000 7f44f17fa700 1 -- 172.21.15.40:0/1172666287 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f44e0013c80 con 0x7f44f4136bf0 2023-09-30T22:27:14.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.799+0000 7f44fadc8700 1 -- 172.21.15.40:0/1172666287 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44d40052e0 con 0x7f44f4136bf0 2023-09-30T22:27:14.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.799+0000 7f44f17fa700 1 -- 172.21.15.40:0/1172666287 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f44e003f450 con 0x7f44f4136bf0 2023-09-30T22:27:14.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.808+0000 7f44f17fa700 1 -- 172.21.15.40:0/1172666287 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f44e0012370 con 0x7f44f4136bf0 2023-09-30T22:27:14.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.938+0000 7f515a6bc700 1 -- 172.21.15.40:0/3218924575 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f515409cb00 con 0x7f515409e400 2023-09-30T22:27:14.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.938+0000 7f5150ff9700 1 -- 172.21.15.40:0/3218924575 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f514800dca0 con 0x7f515409e400 2023-09-30T22:27:14.939 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:14.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.940+0000 7f515a6bc700 1 -- 172.21.15.40:0/3218924575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f515409e400 msgr2=0x7f515411ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:14.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.940+0000 7f515a6bc700 1 --2- 172.21.15.40:0/3218924575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f515409e400 0x7f515411ebf0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f5148012fc0 tx=0x7f51480103a0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.940+0000 7f515a6bc700 1 -- 172.21.15.40:0/3218924575 shutdown_connections 2023-09-30T22:27:14.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.940+0000 7f515a6bc700 1 --2- 172.21.15.40:0/3218924575 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f515409d920 0x7f515411e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.940+0000 7f515a6bc700 1 --2- 172.21.15.40:0/3218924575 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5154136230 0x7f515411f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.940+0000 7f515a6bc700 1 --2- 172.21.15.40:0/3218924575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f515409e400 0x7f515411ebf0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.940+0000 7f515a6bc700 1 -- 172.21.15.40:0/3218924575 >> 172.21.15.40:0/3218924575 conn(0x7f515409fb20 msgr2=0x7f5154070580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:14.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.940+0000 7f515a6bc700 1 -- 172.21.15.40:0/3218924575 shutdown_connections 2023-09-30T22:27:14.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.940+0000 7f515a6bc700 1 -- 172.21.15.40:0/3218924575 wait complete. 2023-09-30T22:27:14.954 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:14.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.965+0000 7f0819f70700 1 -- 172.21.15.40:0/2006497509 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0814062380 con 0x7f0814139510 2023-09-30T22:27:14.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.965+0000 7f07fbfff700 1 -- 172.21.15.40:0/2006497509 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f080c017020 con 0x7f0814139510 2023-09-30T22:27:14.966 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:14.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.968+0000 7f0819f70700 1 -- 172.21.15.40:0/2006497509 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0814139510 msgr2=0x7f081406ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:14.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.968+0000 7f0819f70700 1 --2- 172.21.15.40:0/2006497509 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0814139510 0x7f081406ec40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f080c014000 tx=0x7f080c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.968+0000 7f0819f70700 1 -- 172.21.15.40:0/2006497509 shutdown_connections 2023-09-30T22:27:14.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.968+0000 7f0819f70700 1 --2- 172.21.15.40:0/2006497509 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0814139510 0x7f081406ec40 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.968+0000 7f0819f70700 1 --2- 172.21.15.40:0/2006497509 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f081409c890 0x7f081406e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.968+0000 7f0819f70700 1 --2- 172.21.15.40:0/2006497509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0814136bf0 0x7f081406e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.968+0000 7f0819f70700 1 -- 172.21.15.40:0/2006497509 >> 172.21.15.40:0/2006497509 conn(0x7f08140a7080 msgr2=0x7f081409b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:14.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.968+0000 7f0819f70700 1 -- 172.21.15.40:0/2006497509 shutdown_connections 2023-09-30T22:27:14.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.968+0000 7f0819f70700 1 -- 172.21.15.40:0/2006497509 wait complete. 2023-09-30T22:27:14.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.971+0000 7f8277a85700 1 -- 172.21.15.40:0/3746306237 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8270062380 con 0x7f8270120f80 2023-09-30T22:27:14.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.971+0000 7f82667fc700 1 -- 172.21.15.40:0/3746306237 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f826802a090 con 0x7f8270120f80 2023-09-30T22:27:14.972 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:14.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.973+0000 7f8277a85700 1 -- 172.21.15.40:0/3746306237 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8270120f80 msgr2=0x7f82701ceb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:14.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.973+0000 7f8277a85700 1 --2- 172.21.15.40:0/3746306237 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8270120f80 0x7f82701ceb60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8268009dd0 tx=0x7f826800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.974+0000 7f8277a85700 1 -- 172.21.15.40:0/3746306237 shutdown_connections 2023-09-30T22:27:14.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.974+0000 7f8277a85700 1 --2- 172.21.15.40:0/3746306237 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f827009d920 0x7f8270120500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.974+0000 7f8277a85700 1 --2- 172.21.15.40:0/3746306237 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8270120f80 0x7f82701ceb60 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.974+0000 7f8277a85700 1 --2- 172.21.15.40:0/3746306237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8270133ca0 0x7f8270120a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.974+0000 7f8277a85700 1 -- 172.21.15.40:0/3746306237 >> 172.21.15.40:0/3746306237 conn(0x7f827009fb20 msgr2=0x7f82701bb060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:14.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.974+0000 7f8277a85700 1 -- 172.21.15.40:0/3746306237 shutdown_connections 2023-09-30T22:27:14.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:14.974+0000 7f8277a85700 1 -- 172.21.15.40:0/3746306237 wait complete. 2023-09-30T22:27:14.982 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:14.987 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:15.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:15.008+0000 7f44fadc8700 1 -- 172.21.15.40:0/1172666287 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f44d4005590 con 0x7f44f4136bf0 2023-09-30T22:27:15.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:15.008+0000 7f44f17fa700 1 -- 172.21.15.40:0/1172666287 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f44e0010350 con 0x7f44f4136bf0 2023-09-30T22:27:15.009 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:15.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:15.010+0000 7f44fadc8700 1 -- 172.21.15.40:0/1172666287 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44f4136bf0 msgr2=0x7f44f406f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:15.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:15.010+0000 7f44fadc8700 1 --2- 172.21.15.40:0/1172666287 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44f4136bf0 0x7f44f406f370 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f44e000e810 tx=0x7f44e000eb20 comp rx=0 tx=0).stop 2023-09-30T22:27:15.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:15.010+0000 7f44fadc8700 1 -- 172.21.15.40:0/1172666287 shutdown_connections 2023-09-30T22:27:15.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:15.010+0000 7f44fadc8700 1 --2- 172.21.15.40:0/1172666287 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f44f409c890 0x7f44f406ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:15.010+0000 7f44fadc8700 1 --2- 172.21.15.40:0/1172666287 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f44f4139510 0x7f44f406f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:15.010+0000 7f44fadc8700 1 --2- 172.21.15.40:0/1172666287 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44f4136bf0 0x7f44f406f370 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:15.010+0000 7f44fadc8700 1 -- 172.21.15.40:0/1172666287 >> 172.21.15.40:0/1172666287 conn(0x7f44f40a7080 msgr2=0x7f44f41349d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:15.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:15.010+0000 7f44fadc8700 1 -- 172.21.15.40:0/1172666287 shutdown_connections 2023-09-30T22:27:15.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:15.010+0000 7f44fadc8700 1 -- 172.21.15.40:0/1172666287 wait complete. 2023-09-30T22:27:15.023 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:15.955 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:15.982 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:15.988 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:16.023 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:16.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.106+0000 7fc7f8ae6700 1 Processor -- start 2023-09-30T22:27:16.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.106+0000 7fc7f8ae6700 1 -- start start 2023-09-30T22:27:16.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.107+0000 7fc7f8ae6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc7f409df30 0x7fc7f4135400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.107+0000 7fc7f8ae6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7f4135940 0x7fc7f4137d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.107+0000 7fc7f8ae6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f409e8b0 con 0x7fc7f409d450 2023-09-30T22:27:16.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.107+0000 7fc7f8ae6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f409c3b0 con 0x7fc7f409df30 2023-09-30T22:27:16.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.107+0000 7fc7f8ae6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f409a6b0 con 0x7fc7f4135940 2023-09-30T22:27:16.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.107+0000 7fc7f2d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7f4135940 0x7fc7f4137d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.107+0000 7fc7f2d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7f4135940 0x7fc7f4137d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42230/0 (socket says 172.21.15.40:42230) 2023-09-30T22:27:16.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.107+0000 7fc7f1d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc7f409df30 0x7fc7f4135400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.107+0000 7fc7f2d9d700 1 -- 172.21.15.40:0/1313494876 learned_addr learned my addr 172.21.15.40:0/1313494876 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:16.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.107+0000 7fc7f259c700 1 --1- 172.21.15.40:0/1313494876 >> v1:172.21.15.40:6789/0 conn(0x7fc7f409d450 0x7fc7f409d820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38154/0 (socket says 172.21.15.40:38154) 2023-09-30T22:27:16.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.107+0000 7fc7f2d9d700 1 -- 172.21.15.40:0/1313494876 >> v2:172.21.15.40:3300/0 conn(0x7fc7f409df30 msgr2=0x7fc7f4135400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.107+0000 7fc7f2d9d700 1 --2- 172.21.15.40:0/1313494876 >> v2:172.21.15.40:3300/0 conn(0x7fc7f409df30 0x7fc7f4135400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.107+0000 7fc7f2d9d700 1 -- 172.21.15.40:0/1313494876 >> v1:172.21.15.40:6789/0 conn(0x7fc7f409d450 legacy=0x7fc7f409d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.108+0000 7fc7f159a700 1 -- 172.21.15.40:0/1313494876 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1770545295 0 0) 0x7fc7f409e8b0 con 0x7fc7f409d450 2023-09-30T22:27:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.108+0000 7fc7f2d9d700 1 -- 172.21.15.40:0/1313494876 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f409b4f0 con 0x7fc7f4135940 2023-09-30T22:27:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.108+0000 7fc7f2d9d700 1 --2- 172.21.15.40:0/1313494876 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7f4135940 0x7fc7f4137d20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec009e50 tx=0x7fc7ec00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dedb4e3b247084c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.108+0000 7fc7f159a700 1 -- 172.21.15.40:0/1313494876 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec00e070 con 0x7fc7f4135940 2023-09-30T22:27:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.108+0000 7fc7f159a700 1 -- 172.21.15.40:0/1313494876 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7ec00b910 con 0x7fc7f4135940 2023-09-30T22:27:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.108+0000 7fc7f159a700 1 -- 172.21.15.40:0/1313494876 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec00bcc0 con 0x7fc7f4135940 2023-09-30T22:27:16.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.109+0000 7fc7f8ae6700 1 -- 172.21.15.40:0/1313494876 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7f4135940 msgr2=0x7fc7f4137d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:16.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.109+0000 7fc7f8ae6700 1 --2- 172.21.15.40:0/1313494876 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7f4135940 0x7fc7f4137d20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec009e50 tx=0x7fc7ec00b330 comp rx=0 tx=0).stop 2023-09-30T22:27:16.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.109+0000 7fc7f8ae6700 1 -- 172.21.15.40:0/1313494876 shutdown_connections 2023-09-30T22:27:16.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.109+0000 7fc7f8ae6700 1 --2- 172.21.15.40:0/1313494876 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7f4135940 0x7fc7f4137d20 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.109+0000 7fc7f8ae6700 1 --2- 172.21.15.40:0/1313494876 >> v2:172.21.15.40:3300/0 conn(0x7fc7f409df30 0x7fc7f4135400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.109+0000 7fc7f8ae6700 1 -- 172.21.15.40:0/1313494876 >> 172.21.15.40:0/1313494876 conn(0x7fc7f40a2a00 msgr2=0x7fc7f40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:16.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.109+0000 7fc7f8ae6700 1 -- 172.21.15.40:0/1313494876 shutdown_connections 2023-09-30T22:27:16.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.109+0000 7fc7f8ae6700 1 -- 172.21.15.40:0/1313494876 wait complete. 2023-09-30T22:27:16.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.110+0000 7fc7f8ae6700 1 Processor -- start 2023-09-30T22:27:16.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.110+0000 7fc7f8ae6700 1 -- start start 2023-09-30T22:27:16.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.111+0000 7fc7f8ae6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc7f409d450 0x7fc7f41306f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.111+0000 7fc7f8ae6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7f409df30 0x7fc7f4130c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.111+0000 7fc7f8ae6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7f4135940 0x7fc7f4131170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.111+0000 7fc7f8ae6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f4071440 con 0x7fc7f409df30 2023-09-30T22:27:16.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.111+0000 7fc7f8ae6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f4133020 con 0x7fc7f4135940 2023-09-30T22:27:16.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.111+0000 7fc7f8ae6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f40a1b80 con 0x7fc7f409d450 2023-09-30T22:27:16.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.111+0000 7fc7f1d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7f409df30 0x7fc7f4130c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.111+0000 7fc7f1d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7f409df30 0x7fc7f4130c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36926/0 (socket says 172.21.15.40:36926) 2023-09-30T22:27:16.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.111+0000 7fc7f1d9b700 1 -- 172.21.15.40:0/3585968437 learned_addr learned my addr 172.21.15.40:0/3585968437 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:16.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.111+0000 7fc7f2d9d700 1 --2- 172.21.15.40:0/3585968437 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7f4135940 0x7fc7f4131170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.111+0000 7fc7f1d9b700 1 -- 172.21.15.40:0/3585968437 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc7f409d450 msgr2=0x7fc7f41306f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:16.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.111+0000 7fc7f1d9b700 1 --2- 172.21.15.40:0/3585968437 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc7f409d450 0x7fc7f41306f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.111+0000 7fc7f1d9b700 1 -- 172.21.15.40:0/3585968437 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7f4135940 msgr2=0x7fc7f4131170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:16.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.111+0000 7fc7f1d9b700 1 --2- 172.21.15.40:0/3585968437 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7f4135940 0x7fc7f4131170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.112+0000 7fc7f1d9b700 1 -- 172.21.15.40:0/3585968437 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7ec009b30 con 0x7fc7f409df30 2023-09-30T22:27:16.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.112+0000 7fc7f2d9d700 1 --2- 172.21.15.40:0/3585968437 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7f4135940 0x7fc7f4131170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:16.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.112+0000 7fc7f1d9b700 1 --2- 172.21.15.40:0/3585968437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7f409df30 0x7fc7f4130c30 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fc7e800e9b0 tx=0x7fc7e800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:16.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.112+0000 7fc7e2ffd700 1 -- 172.21.15.40:0/3585968437 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8009710 con 0x7fc7f409df30 2023-09-30T22:27:16.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.112+0000 7fc7e2ffd700 1 -- 172.21.15.40:0/3585968437 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e800c850 con 0x7fc7f409df30 2023-09-30T22:27:16.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.112+0000 7fc7f8ae6700 1 -- 172.21.15.40:0/3585968437 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f4131be0 con 0x7fc7f409df30 2023-09-30T22:27:16.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.112+0000 7fc7e2ffd700 1 -- 172.21.15.40:0/3585968437 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e800cbc0 con 0x7fc7f409df30 2023-09-30T22:27:16.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.112+0000 7fc7f8ae6700 1 -- 172.21.15.40:0/3585968437 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f4133300 con 0x7fc7f409df30 2023-09-30T22:27:16.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.113+0000 7fc7e2ffd700 1 -- 172.21.15.40:0/3585968437 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc7e800cd20 con 0x7fc7f409df30 2023-09-30T22:27:16.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.113+0000 7fc7f8ae6700 1 -- 172.21.15.40:0/3585968437 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f4132cc0 con 0x7fc7f409df30 2023-09-30T22:27:16.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.113+0000 7fc7e2ffd700 1 -- 172.21.15.40:0/3585968437 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc7e803f7e0 con 0x7fc7f409df30 2023-09-30T22:27:16.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.118+0000 7fc7e2ffd700 1 -- 172.21.15.40:0/3585968437 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc7f4132cc0 con 0x7fc7f409df30 2023-09-30T22:27:16.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.141+0000 7f3cc2d93700 1 Processor -- start 2023-09-30T22:27:16.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.141+0000 7f3cc2d93700 1 -- start start 2023-09-30T22:27:16.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.142+0000 7f3cc2d93700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3cbc09e400 0x7f3cbc135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.142+0000 7f3cc2d93700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3cbc136230 0x7f3cbc138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.142+0000 7f3cc2d93700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cbc09adf0 con 0x7f3cbc09d920 2023-09-30T22:27:16.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.142+0000 7f3cc2d93700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cbc09edf0 con 0x7f3cbc09e400 2023-09-30T22:27:16.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.142+0000 7f3cc2d93700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc09b660 con 0x7f3cbc136230 2023-09-30T22:27:16.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.142+0000 7f3cc1330700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3cbc136230 0x7f3cbc138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.142+0000 7f3cc1330700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3cbc136230 0x7f3cbc138610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42248/0 (socket says 172.21.15.40:42248) 2023-09-30T22:27:16.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.142+0000 7f3cc1330700 1 -- 172.21.15.40:0/152778214 learned_addr learned my addr 172.21.15.40:0/152778214 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:16.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.142+0000 7f3cc1330700 1 -- 172.21.15.40:0/152778214 >> v2:172.21.15.40:3300/0 conn(0x7f3cbc09e400 msgr2=0x7f3cbc135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:16.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.142+0000 7f3cbbfff700 1 --2- 172.21.15.40:0/152778214 >> v2:172.21.15.40:3300/0 conn(0x7f3cbc09e400 0x7f3cbc135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.142+0000 7f3cc1330700 1 --2- 172.21.15.40:0/152778214 >> v2:172.21.15.40:3300/0 conn(0x7f3cbc09e400 0x7f3cbc135cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.142+0000 7f3cc1330700 1 -- 172.21.15.40:0/152778214 >> v1:172.21.15.40:6789/0 conn(0x7f3cbc09d920 legacy=0x7f3cbc09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:16.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.142+0000 7f3cc1330700 1 -- 172.21.15.40:0/152778214 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cbc09a6e0 con 0x7f3cbc136230 2023-09-30T22:27:16.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.142+0000 7f3cbbfff700 1 --2- 172.21.15.40:0/152778214 >> v2:172.21.15.40:3300/0 conn(0x7f3cbc09e400 0x7f3cbc135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:27:16.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.142+0000 7f3cc1330700 1 --2- 172.21.15.40:0/152778214 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3cbc136230 0x7f3cbc138610 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4009e50 tx=0x7f3cb400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a39cdeb29156521 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:16.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.143+0000 7f3cbb7fe700 1 -- 172.21.15.40:0/152778214 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb400e070 con 0x7f3cbc136230 2023-09-30T22:27:16.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.143+0000 7f3cbb7fe700 1 -- 172.21.15.40:0/152778214 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb400b9c0 con 0x7f3cbc136230 2023-09-30T22:27:16.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.143+0000 7f3cbb7fe700 1 -- 172.21.15.40:0/152778214 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb400bd70 con 0x7f3cbc136230 2023-09-30T22:27:16.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.143+0000 7f3cc2d93700 1 -- 172.21.15.40:0/152778214 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3cbc136230 msgr2=0x7f3cbc138610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:16.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.143+0000 7f3cc2d93700 1 --2- 172.21.15.40:0/152778214 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3cbc136230 0x7f3cbc138610 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4009e50 tx=0x7f3cb400b330 comp rx=0 tx=0).stop 2023-09-30T22:27:16.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.143+0000 7f3cc2d93700 1 -- 172.21.15.40:0/152778214 shutdown_connections 2023-09-30T22:27:16.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.143+0000 7f3cc2d93700 1 --2- 172.21.15.40:0/152778214 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3cbc136230 0x7f3cbc138610 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.143+0000 7f3cc2d93700 1 --2- 172.21.15.40:0/152778214 >> v2:172.21.15.40:3300/0 conn(0x7f3cbc09e400 0x7f3cbc135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.143+0000 7f3cc2d93700 1 -- 172.21.15.40:0/152778214 >> 172.21.15.40:0/152778214 conn(0x7f3cbc09fb20 msgr2=0x7f3cbc09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:16.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.143+0000 7f3cc2d93700 1 -- 172.21.15.40:0/152778214 shutdown_connections 2023-09-30T22:27:16.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.143+0000 7f3cc2d93700 1 -- 172.21.15.40:0/152778214 wait complete. 2023-09-30T22:27:16.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.144+0000 7f3cc2d93700 1 Processor -- start 2023-09-30T22:27:16.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.144+0000 7f3cc2d93700 1 -- start start 2023-09-30T22:27:16.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.145+0000 7f3cc2d93700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3cbc09d920 0x7f3cbc120600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.145+0000 7f3cc2d93700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3cbc09e400 0x7f3cbc120b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.145+0000 7f3cc2d93700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cbc136230 0x7f3cbc121080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.145+0000 7f3cc2d93700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc122390 con 0x7f3cbc136230 2023-09-30T22:27:16.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.145+0000 7f3cc2d93700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc135520 con 0x7f3cbc09d920 2023-09-30T22:27:16.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.145+0000 7f3cc2d93700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc071cc0 con 0x7f3cbc09e400 2023-09-30T22:27:16.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.145+0000 7f3cc0b2f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3cbc09d920 0x7f3cbc120600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.145+0000 7f3cc0b2f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3cbc09d920 0x7f3cbc120600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42250/0 (socket says 172.21.15.40:42250) 2023-09-30T22:27:16.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.145+0000 7f3cc0b2f700 1 -- 172.21.15.40:0/3942404439 learned_addr learned my addr 172.21.15.40:0/3942404439 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:16.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.146+0000 7f3cbbfff700 1 --2- 172.21.15.40:0/3942404439 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3cbc09e400 0x7f3cbc120b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.146+0000 7f3cc1330700 1 --2- 172.21.15.40:0/3942404439 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cbc136230 0x7f3cbc121080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.146+0000 7f3cc0b2f700 1 -- 172.21.15.40:0/3942404439 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3cbc09e400 msgr2=0x7f3cbc120b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:16.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.146+0000 7f3cc0b2f700 1 --2- 172.21.15.40:0/3942404439 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3cbc09e400 0x7f3cbc120b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.146+0000 7f3cc0b2f700 1 -- 172.21.15.40:0/3942404439 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cbc136230 msgr2=0x7f3cbc121080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:16.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.146+0000 7f3cc0b2f700 1 --2- 172.21.15.40:0/3942404439 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cbc136230 0x7f3cbc121080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.146+0000 7f3cc0b2f700 1 -- 172.21.15.40:0/3942404439 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb4009b30 con 0x7f3cbc09d920 2023-09-30T22:27:16.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.146+0000 7f3cc1330700 1 --2- 172.21.15.40:0/3942404439 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cbc136230 0x7f3cbc121080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:16.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.146+0000 7f3cc0b2f700 1 --2- 172.21.15.40:0/3942404439 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3cbc09d920 0x7f3cbc120600 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3cb000c430 tx=0x7f3cb000c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:16.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.146+0000 7f3cb97fa700 1 -- 172.21.15.40:0/3942404439 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb00054e0 con 0x7f3cbc09d920 2023-09-30T22:27:16.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.146+0000 7f3cb97fa700 1 -- 172.21.15.40:0/3942404439 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb0003680 con 0x7f3cbc09d920 2023-09-30T22:27:16.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.146+0000 7f3cb97fa700 1 -- 172.21.15.40:0/3942404439 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0003a30 con 0x7f3cbc09d920 2023-09-30T22:27:16.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.146+0000 7f3cc2d93700 1 -- 172.21.15.40:0/3942404439 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cbc1240b0 con 0x7f3cbc09d920 2023-09-30T22:27:16.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.146+0000 7f3cc2d93700 1 -- 172.21.15.40:0/3942404439 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cbc123dd0 con 0x7f3cbc09d920 2023-09-30T22:27:16.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.147+0000 7f3cb97fa700 1 -- 172.21.15.40:0/3942404439 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3cb0003b90 con 0x7f3cbc09d920 2023-09-30T22:27:16.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.147+0000 7f3cc2d93700 1 -- 172.21.15.40:0/3942404439 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cbc062380 con 0x7f3cbc09d920 2023-09-30T22:27:16.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.147+0000 7f3cb97fa700 1 -- 172.21.15.40:0/3942404439 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3cb003eab0 con 0x7f3cbc09d920 2023-09-30T22:27:16.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.150+0000 7ff0d6fe0700 1 Processor -- start 2023-09-30T22:27:16.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.150+0000 7ff0d6fe0700 1 -- start start 2023-09-30T22:27:16.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.150+0000 7ff0d6fe0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff0d006a6d0 0x7ff0d006aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.151+0000 7ff0d6fe0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff0d006afe0 0x7ff0d01318b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.151+0000 7ff0d6fe0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0d0131df0 0x7ff0d0132270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.151+0000 7ff0d6fe0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d009eb60 con 0x7ff0d006afe0 2023-09-30T22:27:16.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.151+0000 7ff0d6fe0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d009db70 con 0x7ff0d0131df0 2023-09-30T22:27:16.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.151+0000 7ff0d6fe0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d009ddf0 con 0x7ff0d006a6d0 2023-09-30T22:27:16.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.151+0000 7ff0d557d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0d0131df0 0x7ff0d0132270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.151+0000 7ff0cffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff0d006afe0 0x7ff0d01318b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.151+0000 7ff0d557d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0d0131df0 0x7ff0d0132270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42252/0 (socket says 172.21.15.40:42252) 2023-09-30T22:27:16.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.151+0000 7ff0d557d700 1 -- 172.21.15.40:0/725949992 learned_addr learned my addr 172.21.15.40:0/725949992 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:16.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.151+0000 7ff0cffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff0d006afe0 0x7ff0d01318b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36950/0 (socket says 172.21.15.40:36950) 2023-09-30T22:27:16.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.151+0000 7ff0d4d7c700 1 --2- 172.21.15.40:0/725949992 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff0d006a6d0 0x7ff0d006aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.151+0000 7ff0d557d700 1 -- 172.21.15.40:0/725949992 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff0d006a6d0 msgr2=0x7ff0d006aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:16.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.151+0000 7ff0d557d700 1 --2- 172.21.15.40:0/725949992 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff0d006a6d0 0x7ff0d006aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.151+0000 7ff0d557d700 1 -- 172.21.15.40:0/725949992 >> v2:172.21.15.40:3300/0 conn(0x7ff0d006afe0 msgr2=0x7ff0d01318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:16.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.151+0000 7ff0d557d700 1 --2- 172.21.15.40:0/725949992 >> v2:172.21.15.40:3300/0 conn(0x7ff0d006afe0 0x7ff0d01318b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.151+0000 7ff0d557d700 1 -- 172.21.15.40:0/725949992 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d009c9a0 con 0x7ff0d0131df0 2023-09-30T22:27:16.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.151+0000 7ff0cffff700 1 --2- 172.21.15.40:0/725949992 >> v2:172.21.15.40:3300/0 conn(0x7ff0d006afe0 0x7ff0d01318b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:16.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.151+0000 7ff0d557d700 1 --2- 172.21.15.40:0/725949992 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0d0131df0 0x7ff0d0132270 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8009e50 tx=0x7ff0c800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54d976cdcea91f2e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:16.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.152+0000 7ff0cf7fe700 1 -- 172.21.15.40:0/725949992 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c800e070 con 0x7ff0d0131df0 2023-09-30T22:27:16.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.152+0000 7ff0cf7fe700 1 -- 172.21.15.40:0/725949992 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c800b910 con 0x7ff0d0131df0 2023-09-30T22:27:16.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.152+0000 7ff0cf7fe700 1 -- 172.21.15.40:0/725949992 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c800bcc0 con 0x7ff0d0131df0 2023-09-30T22:27:16.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.152+0000 7f3cb97fa700 1 -- 172.21.15.40:0/3942404439 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3cb0003e40 con 0x7f3cbc09d920 2023-09-30T22:27:16.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.153+0000 7ff0d6fe0700 1 -- 172.21.15.40:0/725949992 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0d0131df0 msgr2=0x7ff0d0132270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:16.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.153+0000 7ff0d6fe0700 1 --2- 172.21.15.40:0/725949992 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0d0131df0 0x7ff0d0132270 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8009e50 tx=0x7ff0c800b330 comp rx=0 tx=0).stop 2023-09-30T22:27:16.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.153+0000 7ff0d6fe0700 1 -- 172.21.15.40:0/725949992 shutdown_connections 2023-09-30T22:27:16.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.153+0000 7ff0d6fe0700 1 --2- 172.21.15.40:0/725949992 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff0d006a6d0 0x7ff0d006aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.153+0000 7ff0d6fe0700 1 --2- 172.21.15.40:0/725949992 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0d0131df0 0x7ff0d0132270 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.153+0000 7ff0d6fe0700 1 --2- 172.21.15.40:0/725949992 >> v2:172.21.15.40:3300/0 conn(0x7ff0d006afe0 0x7ff0d01318b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.153+0000 7ff0d6fe0700 1 -- 172.21.15.40:0/725949992 >> 172.21.15.40:0/725949992 conn(0x7ff0d009fb20 msgr2=0x7ff0d009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:16.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.153+0000 7ff0d6fe0700 1 -- 172.21.15.40:0/725949992 shutdown_connections 2023-09-30T22:27:16.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.153+0000 7ff0d6fe0700 1 -- 172.21.15.40:0/725949992 wait complete. 2023-09-30T22:27:16.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.155+0000 7ff0d6fe0700 1 Processor -- start 2023-09-30T22:27:16.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.155+0000 7ff0d6fe0700 1 -- start start 2023-09-30T22:27:16.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.156+0000 7ff0d6fe0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0d006a6d0 0x7ff0d011c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.156+0000 7ff0d6fe0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff0d006afe0 0x7ff0d011cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.156+0000 7ff0d6fe0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0d0131df0 0x7ff0d011d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.156+0000 7ff0d6fe0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d0131110 con 0x7ff0d0131df0 2023-09-30T22:27:16.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.156+0000 7ff0d6fe0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d0131800 con 0x7ff0d006a6d0 2023-09-30T22:27:16.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.156+0000 7ff0d6fe0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d011e920 con 0x7ff0d006afe0 2023-09-30T22:27:16.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.156+0000 7ff0d4d7c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0d006a6d0 0x7ff0d011c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.156+0000 7ff0d4d7c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0d006a6d0 0x7ff0d011c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42260/0 (socket says 172.21.15.40:42260) 2023-09-30T22:27:16.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.156+0000 7ff0d4d7c700 1 -- 172.21.15.40:0/2199382507 learned_addr learned my addr 172.21.15.40:0/2199382507 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:16.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.156+0000 7ff0cffff700 1 --2- 172.21.15.40:0/2199382507 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff0d006afe0 0x7ff0d011cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.156+0000 7ff0d557d700 1 --2- 172.21.15.40:0/2199382507 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0d0131df0 0x7ff0d011d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.156+0000 7ff0d4d7c700 1 -- 172.21.15.40:0/2199382507 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff0d006afe0 msgr2=0x7ff0d011cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:16.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.156+0000 7ff0d4d7c700 1 --2- 172.21.15.40:0/2199382507 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff0d006afe0 0x7ff0d011cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.156+0000 7ff0d4d7c700 1 -- 172.21.15.40:0/2199382507 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0d0131df0 msgr2=0x7ff0d011d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:16.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.156+0000 7ff0d4d7c700 1 --2- 172.21.15.40:0/2199382507 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0d0131df0 0x7ff0d011d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.156+0000 7ff0d4d7c700 1 -- 172.21.15.40:0/2199382507 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0bc0094a0 con 0x7ff0d006a6d0 2023-09-30T22:27:16.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.157+0000 7ff0d4d7c700 1 --2- 172.21.15.40:0/2199382507 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0d006a6d0 0x7ff0d011c7f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff0c400e7e0 tx=0x7ff0c400eaf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:16.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.157+0000 7ff0cd7fa700 1 -- 172.21.15.40:0/2199382507 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c400c070 con 0x7ff0d006a6d0 2023-09-30T22:27:16.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.157+0000 7ff0cd7fa700 1 -- 172.21.15.40:0/2199382507 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c4013610 con 0x7ff0d006a6d0 2023-09-30T22:27:16.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.157+0000 7ff0d6fe0700 1 -- 172.21.15.40:0/2199382507 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0c8009b30 con 0x7ff0d006a6d0 2023-09-30T22:27:16.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.157+0000 7ff0cd7fa700 1 -- 172.21.15.40:0/2199382507 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c40139a0 con 0x7ff0d006a6d0 2023-09-30T22:27:16.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.157+0000 7ff0d6fe0700 1 -- 172.21.15.40:0/2199382507 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d009e420 con 0x7ff0d006a6d0 2023-09-30T22:27:16.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.158+0000 7ff0cd7fa700 1 -- 172.21.15.40:0/2199382507 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff0c4013b00 con 0x7ff0d006a6d0 2023-09-30T22:27:16.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.158+0000 7ff0cd7fa700 1 -- 172.21.15.40:0/2199382507 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff0c403f540 con 0x7ff0d006a6d0 2023-09-30T22:27:16.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.158+0000 7ff0d6fe0700 1 -- 172.21.15.40:0/2199382507 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d0062380 con 0x7ff0d006a6d0 2023-09-30T22:27:16.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.168+0000 7ff0cd7fa700 1 -- 172.21.15.40:0/2199382507 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff0c401c400 con 0x7ff0d006a6d0 2023-09-30T22:27:16.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.185+0000 7f115b580700 1 Processor -- start 2023-09-30T22:27:16.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.185+0000 7f115b580700 1 -- start start 2023-09-30T22:27:16.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.185+0000 7f115b580700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f115409e400 0x7f1154135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.186+0000 7f115b580700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1154136230 0x7f1154138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.186+0000 7f115b580700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f115409adf0 con 0x7f115409d920 2023-09-30T22:27:16.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.186+0000 7f115b580700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f115409edf0 con 0x7f115409e400 2023-09-30T22:27:16.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.186+0000 7f115b580700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f115409b660 con 0x7f1154136230 2023-09-30T22:27:16.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.186+0000 7f1158b1b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f115409e400 0x7f1154135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.186+0000 7f1158b1b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f115409e400 0x7f1154135cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36964/0 (socket says 172.21.15.40:36964) 2023-09-30T22:27:16.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.186+0000 7f115931c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f115409d920 0x7f115409dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38180/0 (socket says 172.21.15.40:38180) 2023-09-30T22:27:16.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.186+0000 7f1158b1b700 1 -- 172.21.15.40:0/1502617098 learned_addr learned my addr 172.21.15.40:0/1502617098 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:16.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.186+0000 7f1159b1d700 1 --2- 172.21.15.40:0/1502617098 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1154136230 0x7f1154138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.186+0000 7f1159b1d700 1 -- 172.21.15.40:0/1502617098 >> v2:172.21.15.40:3300/0 conn(0x7f115409e400 msgr2=0x7f1154135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:16.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.186+0000 7f1159b1d700 1 --2- 172.21.15.40:0/1502617098 >> v2:172.21.15.40:3300/0 conn(0x7f115409e400 0x7f1154135cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.186+0000 7f1159b1d700 1 -- 172.21.15.40:0/1502617098 >> v1:172.21.15.40:6789/0 conn(0x7f115409d920 legacy=0x7f115409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:16.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.186+0000 7f1159b1d700 1 -- 172.21.15.40:0/1502617098 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115409a6e0 con 0x7f1154136230 2023-09-30T22:27:16.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.186+0000 7f114bfff700 1 -- 172.21.15.40:0/1502617098 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 619684252 0 0) 0x7f115409adf0 con 0x7f115409d920 2023-09-30T22:27:16.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.186+0000 7f1158b1b700 1 --2- 172.21.15.40:0/1502617098 >> v2:172.21.15.40:3300/0 conn(0x7f115409e400 0x7f1154135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:16.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.186+0000 7f1159b1d700 1 --2- 172.21.15.40:0/1502617098 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1154136230 0x7f1154138610 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f114c009d90 tx=0x7f114c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49339de292b7dca8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:16.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.187+0000 7f114bfff700 1 -- 172.21.15.40:0/1502617098 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c00e070 con 0x7f1154136230 2023-09-30T22:27:16.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.187+0000 7f114bfff700 1 -- 172.21.15.40:0/1502617098 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114c00bb20 con 0x7f1154136230 2023-09-30T22:27:16.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.187+0000 7f114bfff700 1 -- 172.21.15.40:0/1502617098 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c012430 con 0x7f1154136230 2023-09-30T22:27:16.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.187+0000 7f115b580700 1 -- 172.21.15.40:0/1502617098 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1154136230 msgr2=0x7f1154138610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:16.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.187+0000 7f115b580700 1 --2- 172.21.15.40:0/1502617098 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1154136230 0x7f1154138610 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f114c009d90 tx=0x7f114c00b330 comp rx=0 tx=0).stop 2023-09-30T22:27:16.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.187+0000 7f115b580700 1 -- 172.21.15.40:0/1502617098 shutdown_connections 2023-09-30T22:27:16.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.187+0000 7f115b580700 1 --2- 172.21.15.40:0/1502617098 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1154136230 0x7f1154138610 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.187+0000 7f115b580700 1 --2- 172.21.15.40:0/1502617098 >> v2:172.21.15.40:3300/0 conn(0x7f115409e400 0x7f1154135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.187+0000 7f115b580700 1 -- 172.21.15.40:0/1502617098 >> 172.21.15.40:0/1502617098 conn(0x7f115409fb20 msgr2=0x7f115409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:16.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.187+0000 7f115b580700 1 -- 172.21.15.40:0/1502617098 shutdown_connections 2023-09-30T22:27:16.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.188+0000 7f115b580700 1 -- 172.21.15.40:0/1502617098 wait complete. 2023-09-30T22:27:16.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.188+0000 7f115b580700 1 Processor -- start 2023-09-30T22:27:16.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.188+0000 7f115b580700 1 -- start start 2023-09-30T22:27:16.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.189+0000 7f115b580700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f115409d920 0x7f115411f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.189+0000 7f115b580700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f115409e400 0x7f115411fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.189+0000 7f115b580700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1154136230 0x7f1154120040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.189+0000 7f115b580700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115406b190 con 0x7f115409d920 2023-09-30T22:27:16.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.189+0000 7f115b580700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1154120b70 con 0x7f1154136230 2023-09-30T22:27:16.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.189+0000 7f115b580700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1154135790 con 0x7f115409e400 2023-09-30T22:27:16.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.189+0000 7f115931c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f115409d920 0x7f115411f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.189+0000 7f115931c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f115409d920 0x7f115411f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36976/0 (socket says 172.21.15.40:36976) 2023-09-30T22:27:16.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.189+0000 7f115931c700 1 -- 172.21.15.40:0/881471586 learned_addr learned my addr 172.21.15.40:0/881471586 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:16.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.189+0000 7f1159b1d700 1 --2- 172.21.15.40:0/881471586 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1154136230 0x7f1154120040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.189+0000 7f1158b1b700 1 --2- 172.21.15.40:0/881471586 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f115409e400 0x7f115411fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.189+0000 7f115931c700 1 -- 172.21.15.40:0/881471586 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f115409e400 msgr2=0x7f115411fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:16.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.189+0000 7f115931c700 1 --2- 172.21.15.40:0/881471586 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f115409e400 0x7f115411fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.189+0000 7f115931c700 1 -- 172.21.15.40:0/881471586 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1154136230 msgr2=0x7f1154120040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:16.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.189+0000 7f115931c700 1 --2- 172.21.15.40:0/881471586 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1154136230 0x7f1154120040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.189+0000 7f115931c700 1 -- 172.21.15.40:0/881471586 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1144009550 con 0x7f115409d920 2023-09-30T22:27:16.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.190+0000 7f115931c700 1 --2- 172.21.15.40:0/881471586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f115409d920 0x7f115411f5c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f115000c520 tx=0x7f115000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:16.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.190+0000 7f1149ffb700 1 -- 172.21.15.40:0/881471586 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11500074e0 con 0x7f115409d920 2023-09-30T22:27:16.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.190+0000 7f1149ffb700 1 -- 172.21.15.40:0/881471586 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1150007640 con 0x7f115409d920 2023-09-30T22:27:16.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.190+0000 7f115b580700 1 -- 172.21.15.40:0/881471586 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f114c009a70 con 0x7f115409d920 2023-09-30T22:27:16.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.190+0000 7f1149ffb700 1 -- 172.21.15.40:0/881471586 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1150005a70 con 0x7f115409d920 2023-09-30T22:27:16.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.190+0000 7f115b580700 1 -- 172.21.15.40:0/881471586 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1154126160 con 0x7f115409d920 2023-09-30T22:27:16.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.191+0000 7f1149ffb700 1 -- 172.21.15.40:0/881471586 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1150005bd0 con 0x7f115409d920 2023-09-30T22:27:16.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.191+0000 7f1149ffb700 1 -- 172.21.15.40:0/881471586 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f115003ec80 con 0x7f115409d920 2023-09-30T22:27:16.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.191+0000 7f115b580700 1 -- 172.21.15.40:0/881471586 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1154126160 con 0x7f115409d920 2023-09-30T22:27:16.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.196+0000 7f1149ffb700 1 -- 172.21.15.40:0/881471586 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1154126160 con 0x7f115409d920 2023-09-30T22:27:16.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.327+0000 7fc7f8ae6700 1 -- 172.21.15.40:0/3585968437 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc7f4132cc0 con 0x7fc7f409df30 2023-09-30T22:27:16.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.327+0000 7fc7e2ffd700 1 -- 172.21.15.40:0/3585968437 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc7f4132cc0 con 0x7fc7f409df30 2023-09-30T22:27:16.328 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:16.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.329+0000 7fc7f8ae6700 1 -- 172.21.15.40:0/3585968437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7f409df30 msgr2=0x7fc7f4130c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:16.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.329+0000 7fc7f8ae6700 1 --2- 172.21.15.40:0/3585968437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7f409df30 0x7fc7f4130c30 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fc7e800e9b0 tx=0x7fc7e800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.329+0000 7fc7f8ae6700 1 -- 172.21.15.40:0/3585968437 shutdown_connections 2023-09-30T22:27:16.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.329+0000 7fc7f8ae6700 1 --2- 172.21.15.40:0/3585968437 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc7f409d450 0x7fc7f41306f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.329+0000 7fc7f8ae6700 1 --2- 172.21.15.40:0/3585968437 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7f4135940 0x7fc7f4131170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.329+0000 7fc7f8ae6700 1 --2- 172.21.15.40:0/3585968437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7f409df30 0x7fc7f4130c30 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.329+0000 7fc7f8ae6700 1 -- 172.21.15.40:0/3585968437 >> 172.21.15.40:0/3585968437 conn(0x7fc7f40a2a00 msgr2=0x7fc7f41369d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:16.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.329+0000 7fc7f8ae6700 1 -- 172.21.15.40:0/3585968437 shutdown_connections 2023-09-30T22:27:16.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.329+0000 7fc7f8ae6700 1 -- 172.21.15.40:0/3585968437 wait complete. 2023-09-30T22:27:16.342 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:16.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.376+0000 7f3cc2d93700 1 -- 172.21.15.40:0/3942404439 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3cbc074720 con 0x7f3cbc09d920 2023-09-30T22:27:16.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.377+0000 7f3cb97fa700 1 -- 172.21.15.40:0/3942404439 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3cb0017030 con 0x7f3cbc09d920 2023-09-30T22:27:16.378 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:16.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.380+0000 7f3cc2d93700 1 -- 172.21.15.40:0/3942404439 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3cbc09d920 msgr2=0x7f3cbc120600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:16.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.380+0000 7f3cc2d93700 1 --2- 172.21.15.40:0/3942404439 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3cbc09d920 0x7f3cbc120600 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3cb000c430 tx=0x7f3cb000c740 comp rx=0 tx=0).stop 2023-09-30T22:27:16.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.380+0000 7f3cc2d93700 1 -- 172.21.15.40:0/3942404439 shutdown_connections 2023-09-30T22:27:16.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.380+0000 7f3cc2d93700 1 --2- 172.21.15.40:0/3942404439 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cbc136230 0x7f3cbc121080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.380+0000 7f3cc2d93700 1 --2- 172.21.15.40:0/3942404439 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3cbc09d920 0x7f3cbc120600 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.380+0000 7f3cc2d93700 1 --2- 172.21.15.40:0/3942404439 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3cbc09e400 0x7f3cbc120b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.380+0000 7f3cc2d93700 1 -- 172.21.15.40:0/3942404439 >> 172.21.15.40:0/3942404439 conn(0x7f3cbc09fb20 msgr2=0x7f3cbc06af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:16.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.380+0000 7f3cc2d93700 1 -- 172.21.15.40:0/3942404439 shutdown_connections 2023-09-30T22:27:16.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.380+0000 7f3cc2d93700 1 -- 172.21.15.40:0/3942404439 wait complete. 2023-09-30T22:27:16.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.393+0000 7f115b580700 1 -- 172.21.15.40:0/881471586 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1154126160 con 0x7f115409d920 2023-09-30T22:27:16.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.393+0000 7f1149ffb700 1 -- 172.21.15.40:0/881471586 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1154126160 con 0x7f115409d920 2023-09-30T22:27:16.394 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:16.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.395+0000 7f115b580700 1 -- 172.21.15.40:0/881471586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f115409d920 msgr2=0x7f115411f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:16.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.395+0000 7f115b580700 1 --2- 172.21.15.40:0/881471586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f115409d920 0x7f115411f5c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f115000c520 tx=0x7f115000c830 comp rx=0 tx=0).stop 2023-09-30T22:27:16.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.395+0000 7f115b580700 1 -- 172.21.15.40:0/881471586 shutdown_connections 2023-09-30T22:27:16.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.395+0000 7f115b580700 1 --2- 172.21.15.40:0/881471586 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1154136230 0x7f1154120040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.395+0000 7f115b580700 1 --2- 172.21.15.40:0/881471586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f115409d920 0x7f115411f5c0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.395+0000 7f115b580700 1 --2- 172.21.15.40:0/881471586 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f115409e400 0x7f115411fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.395+0000 7f115b580700 1 -- 172.21.15.40:0/881471586 >> 172.21.15.40:0/881471586 conn(0x7f115409fb20 msgr2=0x7f1154119730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:16.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.395+0000 7f115b580700 1 -- 172.21.15.40:0/881471586 shutdown_connections 2023-09-30T22:27:16.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.395+0000 7f115b580700 1 -- 172.21.15.40:0/881471586 wait complete. 2023-09-30T22:27:16.398 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:16.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.397+0000 7ff0d6fe0700 1 -- 172.21.15.40:0/2199382507 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff0d0074720 con 0x7ff0d006a6d0 2023-09-30T22:27:16.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.398+0000 7ff0cd7fa700 1 -- 172.21.15.40:0/2199382507 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff0c4010310 con 0x7ff0d006a6d0 2023-09-30T22:27:16.399 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:16.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.400+0000 7ff0d6fe0700 1 -- 172.21.15.40:0/2199382507 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0d006a6d0 msgr2=0x7ff0d011c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:16.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.400+0000 7ff0d6fe0700 1 --2- 172.21.15.40:0/2199382507 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0d006a6d0 0x7ff0d011c7f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff0c400e7e0 tx=0x7ff0c400eaf0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.400+0000 7ff0d6fe0700 1 -- 172.21.15.40:0/2199382507 shutdown_connections 2023-09-30T22:27:16.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.400+0000 7ff0d6fe0700 1 --2- 172.21.15.40:0/2199382507 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0d0131df0 0x7ff0d011d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.400+0000 7ff0d6fe0700 1 --2- 172.21.15.40:0/2199382507 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0d006a6d0 0x7ff0d011c7f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.400+0000 7ff0d6fe0700 1 --2- 172.21.15.40:0/2199382507 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff0d006afe0 0x7ff0d011cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.400+0000 7ff0d6fe0700 1 -- 172.21.15.40:0/2199382507 >> 172.21.15.40:0/2199382507 conn(0x7ff0d009fb20 msgr2=0x7ff0d006f760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:16.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.400+0000 7ff0d6fe0700 1 -- 172.21.15.40:0/2199382507 shutdown_connections 2023-09-30T22:27:16.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:16.400+0000 7ff0d6fe0700 1 -- 172.21.15.40:0/2199382507 wait complete. 2023-09-30T22:27:16.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:16.413 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:17.344 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:17.398 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:17.411 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:17.414 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:17.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.492+0000 7fd6a72e7700 1 Processor -- start 2023-09-30T22:27:17.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.493+0000 7fd6a72e7700 1 -- start start 2023-09-30T22:27:17.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.493+0000 7fd6a72e7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd6a0134a90 0x7fd6a0136e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:17.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.493+0000 7fd6a72e7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd6a01373b0 0x7fd6a0139790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:17.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.493+0000 7fd6a72e7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6a0131900 con 0x7fd6a0131d50 2023-09-30T22:27:17.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.493+0000 7fd6a72e7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6a00719e0 con 0x7fd6a0134a90 2023-09-30T22:27:17.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.493+0000 7fd6a72e7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a009e820 con 0x7fd6a01373b0 2023-09-30T22:27:17.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.493+0000 7fd6a4882700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd6a0134a90 0x7fd6a0136e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:17.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.493+0000 7fd6a4882700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd6a0134a90 0x7fd6a0136e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36988/0 (socket says 172.21.15.40:36988) 2023-09-30T22:27:17.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.493+0000 7fd6a4882700 1 -- 172.21.15.40:0/3305049324 learned_addr learned my addr 172.21.15.40:0/3305049324 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:17.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.494+0000 7fd6a5884700 1 --2- 172.21.15.40:0/3305049324 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd6a01373b0 0x7fd6a0139790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:17.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.494+0000 7fd6a5884700 1 -- 172.21.15.40:0/3305049324 >> v2:172.21.15.40:3300/0 conn(0x7fd6a0134a90 msgr2=0x7fd6a0136e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:17.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.494+0000 7fd6a5884700 1 --2- 172.21.15.40:0/3305049324 >> v2:172.21.15.40:3300/0 conn(0x7fd6a0134a90 0x7fd6a0136e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.494+0000 7fd6a5884700 1 -- 172.21.15.40:0/3305049324 >> v1:172.21.15.40:6789/0 conn(0x7fd6a0131d50 legacy=0x7fd6a0132120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:17.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.494+0000 7fd6a5884700 1 -- 172.21.15.40:0/3305049324 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a009ef60 con 0x7fd6a01373b0 2023-09-30T22:27:17.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.494+0000 7fd6a4882700 1 --2- 172.21.15.40:0/3305049324 >> v2:172.21.15.40:3300/0 conn(0x7fd6a0134a90 0x7fd6a0136e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:17.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.494+0000 7fd6a5884700 1 --2- 172.21.15.40:0/3305049324 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd6a01373b0 0x7fd6a0139790 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd698009d90 tx=0x7fd69800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11f4ab65646ecfe9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:17.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.495+0000 7fd697fff700 1 -- 172.21.15.40:0/3305049324 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69800e070 con 0x7fd6a01373b0 2023-09-30T22:27:17.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.495+0000 7fd697fff700 1 -- 172.21.15.40:0/3305049324 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69800bb20 con 0x7fd6a01373b0 2023-09-30T22:27:17.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.495+0000 7fd697fff700 1 -- 172.21.15.40:0/3305049324 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd698012430 con 0x7fd6a01373b0 2023-09-30T22:27:17.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.495+0000 7fd6a72e7700 1 -- 172.21.15.40:0/3305049324 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd6a01373b0 msgr2=0x7fd6a0139790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:17.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.495+0000 7fd6a72e7700 1 --2- 172.21.15.40:0/3305049324 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd6a01373b0 0x7fd6a0139790 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd698009d90 tx=0x7fd69800b330 comp rx=0 tx=0).stop 2023-09-30T22:27:17.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.495+0000 7fd6a72e7700 1 -- 172.21.15.40:0/3305049324 shutdown_connections 2023-09-30T22:27:17.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.495+0000 7fd6a72e7700 1 --2- 172.21.15.40:0/3305049324 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd6a01373b0 0x7fd6a0139790 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.495+0000 7fd6a72e7700 1 --2- 172.21.15.40:0/3305049324 >> v2:172.21.15.40:3300/0 conn(0x7fd6a0134a90 0x7fd6a0136e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.495+0000 7fd6a72e7700 1 -- 172.21.15.40:0/3305049324 >> 172.21.15.40:0/3305049324 conn(0x7fd6a00a2a00 msgr2=0x7fd6a00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:17.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.495+0000 7fd6a72e7700 1 -- 172.21.15.40:0/3305049324 shutdown_connections 2023-09-30T22:27:17.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.496+0000 7fd6a72e7700 1 -- 172.21.15.40:0/3305049324 wait complete. 2023-09-30T22:27:17.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.497+0000 7fd6a72e7700 1 Processor -- start 2023-09-30T22:27:17.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.497+0000 7fd6a72e7700 1 -- start start 2023-09-30T22:27:17.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.498+0000 7fd6a72e7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6a0131d50 0x7fd6a0119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:17.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.498+0000 7fd6a72e7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd6a0134a90 0x7fd6a0119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:17.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.498+0000 7fd6a72e7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6a01373b0 0x7fd6a0119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:17.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.498+0000 7fd6a72e7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a011caa0 con 0x7fd6a01373b0 2023-09-30T22:27:17.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.498+0000 7fd6a72e7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a011b420 con 0x7fd6a0131d50 2023-09-30T22:27:17.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.498+0000 7fd6a72e7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a011c250 con 0x7fd6a0134a90 2023-09-30T22:27:17.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.498+0000 7fd6a5884700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6a01373b0 0x7fd6a0119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:17.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.498+0000 7fd6a4882700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd6a0134a90 0x7fd6a0119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:17.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.498+0000 7fd6a5884700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6a01373b0 0x7fd6a0119ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36990/0 (socket says 172.21.15.40:36990) 2023-09-30T22:27:17.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.498+0000 7fd6a5884700 1 -- 172.21.15.40:0/138900956 learned_addr learned my addr 172.21.15.40:0/138900956 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:17.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.498+0000 7fd6a4882700 1 -- 172.21.15.40:0/138900956 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6a0131d50 msgr2=0x7fd6a0119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:17.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.498+0000 7fd6a4882700 1 --2- 172.21.15.40:0/138900956 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6a0131d50 0x7fd6a0119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.498+0000 7fd6a4882700 1 -- 172.21.15.40:0/138900956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6a01373b0 msgr2=0x7fd6a0119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:17.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.498+0000 7fd6a4882700 1 --2- 172.21.15.40:0/138900956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6a01373b0 0x7fd6a0119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.498+0000 7fd6a4882700 1 -- 172.21.15.40:0/138900956 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd690009550 con 0x7fd6a0134a90 2023-09-30T22:27:17.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.498+0000 7fd6a5884700 1 --2- 172.21.15.40:0/138900956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6a01373b0 0x7fd6a0119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:17.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.498+0000 7fd6a4882700 1 --2- 172.21.15.40:0/138900956 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd6a0134a90 0x7fd6a0119590 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd6a006d960 tx=0x7fd69000ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:17.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.499+0000 7fd695ffb700 1 -- 172.21.15.40:0/138900956 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69000eec0 con 0x7fd6a0134a90 2023-09-30T22:27:17.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.499+0000 7fd695ffb700 1 -- 172.21.15.40:0/138900956 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd690004030 con 0x7fd6a0134a90 2023-09-30T22:27:17.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.499+0000 7fd695ffb700 1 -- 172.21.15.40:0/138900956 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6900043a0 con 0x7fd6a0134a90 2023-09-30T22:27:17.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.500+0000 7fd6a72e7700 1 -- 172.21.15.40:0/138900956 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd698009a70 con 0x7fd6a0134a90 2023-09-30T22:27:17.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.500+0000 7fd6a72e7700 1 -- 172.21.15.40:0/138900956 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6a009ea60 con 0x7fd6a0134a90 2023-09-30T22:27:17.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.501+0000 7fd695ffb700 1 -- 172.21.15.40:0/138900956 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd69000c7f0 con 0x7fd6a0134a90 2023-09-30T22:27:17.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.501+0000 7fd695ffb700 1 -- 172.21.15.40:0/138900956 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd69003f670 con 0x7fd6a0134a90 2023-09-30T22:27:17.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.501+0000 7fd6a72e7700 1 -- 172.21.15.40:0/138900956 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6a0062380 con 0x7fd6a0134a90 2023-09-30T22:27:17.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.510+0000 7fd695ffb700 1 -- 172.21.15.40:0/138900956 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd690019d40 con 0x7fd6a0134a90 2023-09-30T22:27:17.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.547+0000 7f038a020700 1 Processor -- start 2023-09-30T22:27:17.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.547+0000 7f038a020700 1 -- start start 2023-09-30T22:27:17.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.547+0000 7f038a020700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f038409d920 0x7f038409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:17.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.547+0000 7f038a020700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f038409e230 0x7f03841308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:17.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.547+0000 7f038a020700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f038409adf0 con 0x7f0384130de0 2023-09-30T22:27:17.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.547+0000 7f038a020700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f038409edf0 con 0x7f038409d920 2023-09-30T22:27:17.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.547+0000 7f038a020700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f038409b660 con 0x7f038409e230 2023-09-30T22:27:17.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.548+0000 7f037bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f038409e230 0x7f03841308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:17.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.548+0000 7f037bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f038409e230 0x7f03841308a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56080/0 (socket says 172.21.15.40:56080) 2023-09-30T22:27:17.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.548+0000 7f037bfff700 1 -- 172.21.15.40:0/1547686503 learned_addr learned my addr 172.21.15.40:0/1547686503 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:17.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.548+0000 7f03837fe700 1 --2- 172.21.15.40:0/1547686503 >> v2:172.21.15.40:3300/0 conn(0x7f038409d920 0x7f038409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:17.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.548+0000 7f037bfff700 1 -- 172.21.15.40:0/1547686503 >> v2:172.21.15.40:3300/0 conn(0x7f038409d920 msgr2=0x7f038409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:17.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.548+0000 7f037bfff700 1 --2- 172.21.15.40:0/1547686503 >> v2:172.21.15.40:3300/0 conn(0x7f038409d920 0x7f038409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.548+0000 7f037bfff700 1 -- 172.21.15.40:0/1547686503 >> v1:172.21.15.40:6789/0 conn(0x7f0384130de0 legacy=0x7f0384137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:17.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.548+0000 7f037bfff700 1 -- 172.21.15.40:0/1547686503 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f038409a6e0 con 0x7f038409e230 2023-09-30T22:27:17.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.548+0000 7f03837fe700 1 --2- 172.21.15.40:0/1547686503 >> v2:172.21.15.40:3300/0 conn(0x7f038409d920 0x7f038409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:17.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.548+0000 7f037bfff700 1 --2- 172.21.15.40:0/1547686503 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f038409e230 0x7f03841308a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f036c0098f0 tx=0x7f036c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b20a401635c48c2c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:17.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.548+0000 7f0382ffd700 1 -- 172.21.15.40:0/1547686503 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c004230 con 0x7f038409e230 2023-09-30T22:27:17.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.549+0000 7f0382ffd700 1 -- 172.21.15.40:0/1547686503 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036c004390 con 0x7f038409e230 2023-09-30T22:27:17.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.549+0000 7f0382ffd700 1 -- 172.21.15.40:0/1547686503 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c0036a0 con 0x7f038409e230 2023-09-30T22:27:17.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.549+0000 7f038a020700 1 -- 172.21.15.40:0/1547686503 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f038409e230 msgr2=0x7f03841308a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:17.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.549+0000 7f038a020700 1 --2- 172.21.15.40:0/1547686503 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f038409e230 0x7f03841308a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f036c0098f0 tx=0x7f036c009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:17.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.549+0000 7f038a020700 1 -- 172.21.15.40:0/1547686503 shutdown_connections 2023-09-30T22:27:17.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.549+0000 7f038a020700 1 --2- 172.21.15.40:0/1547686503 >> v2:172.21.15.40:3300/0 conn(0x7f038409d920 0x7f038409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.549+0000 7f038a020700 1 --2- 172.21.15.40:0/1547686503 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f038409e230 0x7f03841308a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.549+0000 7f038a020700 1 -- 172.21.15.40:0/1547686503 >> 172.21.15.40:0/1547686503 conn(0x7f038409fb20 msgr2=0x7f038409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:17.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.549+0000 7f038a020700 1 -- 172.21.15.40:0/1547686503 shutdown_connections 2023-09-30T22:27:17.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.549+0000 7f038a020700 1 -- 172.21.15.40:0/1547686503 wait complete. 2023-09-30T22:27:17.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.550+0000 7f038a020700 1 Processor -- start 2023-09-30T22:27:17.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.550+0000 7f038a020700 1 -- start start 2023-09-30T22:27:17.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.551+0000 7f038a020700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f038409d920 0x7f038412bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:17.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.551+0000 7f038a020700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f038409e230 0x7f038412c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:17.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.551+0000 7f038a020700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0384130de0 0x7f038412c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:17.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.551+0000 7f038a020700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0384130550 con 0x7f038409d920 2023-09-30T22:27:17.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.551+0000 7f038a020700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f038412df00 con 0x7f038409e230 2023-09-30T22:27:17.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.551+0000 7f038a020700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0384130b60 con 0x7f0384130de0 2023-09-30T22:27:17.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.551+0000 7f0383fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0384130de0 0x7f038412c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:17.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.551+0000 7f0383fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0384130de0 0x7f038412c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56090/0 (socket says 172.21.15.40:56090) 2023-09-30T22:27:17.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.551+0000 7f0383fff700 1 -- 172.21.15.40:0/1002836219 learned_addr learned my addr 172.21.15.40:0/1002836219 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:17.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.551+0000 7f0383fff700 1 -- 172.21.15.40:0/1002836219 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f038409e230 msgr2=0x7f038412c230 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:27:17.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.551+0000 7f0383fff700 1 --2- 172.21.15.40:0/1002836219 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f038409e230 0x7f038412c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.551+0000 7f0383fff700 1 -- 172.21.15.40:0/1002836219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f038409d920 msgr2=0x7f038412bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:17.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.551+0000 7f0383fff700 1 --2- 172.21.15.40:0/1002836219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f038409d920 0x7f038412bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.551+0000 7f0383fff700 1 -- 172.21.15.40:0/1002836219 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f036c009550 con 0x7f0384130de0 2023-09-30T22:27:17.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.552+0000 7f0383fff700 1 --2- 172.21.15.40:0/1002836219 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0384130de0 0x7f038412c770 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f037c00caf0 tx=0x7f037c00ceb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:17.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.552+0000 7f0380ff9700 1 -- 172.21.15.40:0/1002836219 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c003e30 con 0x7f0384130de0 2023-09-30T22:27:17.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.552+0000 7f0380ff9700 1 -- 172.21.15.40:0/1002836219 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037c005070 con 0x7f0384130de0 2023-09-30T22:27:17.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.552+0000 7f038a020700 1 -- 172.21.15.40:0/1002836219 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f038406b2a0 con 0x7f0384130de0 2023-09-30T22:27:17.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.552+0000 7f0380ff9700 1 -- 172.21.15.40:0/1002836219 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c0053e0 con 0x7f0384130de0 2023-09-30T22:27:17.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.552+0000 7f038a020700 1 -- 172.21.15.40:0/1002836219 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f038412f840 con 0x7f0384130de0 2023-09-30T22:27:17.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.553+0000 7f038a020700 1 -- 172.21.15.40:0/1002836219 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f038412f630 con 0x7f0384130de0 2023-09-30T22:27:17.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.554+0000 7f0380ff9700 1 -- 172.21.15.40:0/1002836219 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f037c006bc0 con 0x7f0384130de0 2023-09-30T22:27:17.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.554+0000 7f0380ff9700 1 -- 172.21.15.40:0/1002836219 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f037c03efb0 con 0x7f0384130de0 2023-09-30T22:27:17.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.563+0000 7f0380ff9700 1 -- 172.21.15.40:0/1002836219 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f037c01abe0 con 0x7f0384130de0 2023-09-30T22:27:17.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.584+0000 7f8f0c5d2700 1 Processor -- start 2023-09-30T22:27:17.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.584+0000 7f8f0c5d2700 1 -- start start 2023-09-30T22:27:17.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.584+0000 7f8f0c5d2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8f0406a6d0 0x7f8f0409d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:17.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.584+0000 7f8f0c5d2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f0409de60 0x7f8f0409e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:17.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.584+0000 7f8f0c5d2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f0413c490 0x7f8f0413e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:17.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.584+0000 7f8f0c5d2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f0406aaa0 con 0x7f8f0406a6d0 2023-09-30T22:27:17.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.584+0000 7f8f0c5d2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0409e790 con 0x7f8f0409de60 2023-09-30T22:27:17.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.584+0000 7f8f0c5d2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0411d980 con 0x7f8f0413c490 2023-09-30T22:27:17.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.585+0000 7f8f09b6d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f0409de60 0x7f8f0409e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:17.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.585+0000 7f8f0ab6f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f0413c490 0x7f8f0413e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:17.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.585+0000 7f8f09b6d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f0409de60 0x7f8f0409e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42290/0 (socket says 172.21.15.40:42290) 2023-09-30T22:27:17.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.585+0000 7f8f09b6d700 1 -- 172.21.15.40:0/3061279129 learned_addr learned my addr 172.21.15.40:0/3061279129 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:17.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.585+0000 7f8f0a36e700 1 --2- 172.21.15.40:0/3061279129 >> v2:172.21.15.40:3300/0 conn(0x7f8f0406a6d0 0x7f8f0409d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:17.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.585+0000 7f8f09b6d700 1 -- 172.21.15.40:0/3061279129 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f0413c490 msgr2=0x7f8f0413e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:17.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.585+0000 7f8f09b6d700 1 --2- 172.21.15.40:0/3061279129 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f0413c490 0x7f8f0413e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.585+0000 7f8f09b6d700 1 -- 172.21.15.40:0/3061279129 >> v2:172.21.15.40:3300/0 conn(0x7f8f0406a6d0 msgr2=0x7f8f0409d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:17.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.585+0000 7f8f09b6d700 1 --2- 172.21.15.40:0/3061279129 >> v2:172.21.15.40:3300/0 conn(0x7f8f0406a6d0 0x7f8f0409d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.585+0000 7f8f09b6d700 1 -- 172.21.15.40:0/3061279129 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f0406b150 con 0x7f8f0409de60 2023-09-30T22:27:17.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.585+0000 7f8f09b6d700 1 --2- 172.21.15.40:0/3061279129 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f0409de60 0x7f8f0409e250 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4009920 tx=0x7f8ef4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1b326dccaafba79 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:17.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.585+0000 7f8f0936c700 1 -- 172.21.15.40:0/3061279129 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4011830 con 0x7f8f0409de60 2023-09-30T22:27:17.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.585+0000 7f8f0936c700 1 -- 172.21.15.40:0/3061279129 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef4011990 con 0x7f8f0409de60 2023-09-30T22:27:17.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.585+0000 7f8f0936c700 1 -- 172.21.15.40:0/3061279129 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4011d20 con 0x7f8f0409de60 2023-09-30T22:27:17.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.586+0000 7f8f0c5d2700 1 -- 172.21.15.40:0/3061279129 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f0409de60 msgr2=0x7f8f0409e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:17.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.586+0000 7f8f0c5d2700 1 --2- 172.21.15.40:0/3061279129 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f0409de60 0x7f8f0409e250 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4009920 tx=0x7f8ef4009c30 comp rx=0 tx=0).stop 2023-09-30T22:27:17.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.586+0000 7f8f0c5d2700 1 -- 172.21.15.40:0/3061279129 shutdown_connections 2023-09-30T22:27:17.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.586+0000 7f8f0c5d2700 1 --2- 172.21.15.40:0/3061279129 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f0413c490 0x7f8f0413e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.586+0000 7f8f0c5d2700 1 --2- 172.21.15.40:0/3061279129 >> v2:172.21.15.40:3300/0 conn(0x7f8f0406a6d0 0x7f8f0409d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.586+0000 7f8f0c5d2700 1 --2- 172.21.15.40:0/3061279129 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f0409de60 0x7f8f0409e250 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.586+0000 7f8f0c5d2700 1 -- 172.21.15.40:0/3061279129 >> 172.21.15.40:0/3061279129 conn(0x7f8f0409fb20 msgr2=0x7f8f0409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:17.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.586+0000 7f8f0c5d2700 1 -- 172.21.15.40:0/3061279129 shutdown_connections 2023-09-30T22:27:17.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.586+0000 7f8f0c5d2700 1 -- 172.21.15.40:0/3061279129 wait complete. 2023-09-30T22:27:17.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.588+0000 7f8f0c5d2700 1 Processor -- start 2023-09-30T22:27:17.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.588+0000 7f8f0c5d2700 1 -- start start 2023-09-30T22:27:17.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.588+0000 7f8f0c5d2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f0406a6d0 0x7f8f041cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:17.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.588+0000 7f8f0c5d2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f0409de60 0x7f8f041cce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:17.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.588+0000 7f8f0c5d2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f0413c490 0x7f8f041cd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:17.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.588+0000 7f8f0c5d2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0412a0e0 con 0x7f8f0409de60 2023-09-30T22:27:17.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.588+0000 7f8f0c5d2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f041283d0 con 0x7f8f0406a6d0 2023-09-30T22:27:17.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.588+0000 7f8f0c5d2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f041292c0 con 0x7f8f0413c490 2023-09-30T22:27:17.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.588+0000 7f8f0ab6f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f0413c490 0x7f8f041cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:17.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.589+0000 7f8f0ab6f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f0413c490 0x7f8f041cd390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56108/0 (socket says 172.21.15.40:56108) 2023-09-30T22:27:17.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.589+0000 7f8f0ab6f700 1 -- 172.21.15.40:0/612713905 learned_addr learned my addr 172.21.15.40:0/612713905 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:17.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.589+0000 7f8f09b6d700 1 --2- 172.21.15.40:0/612713905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f0409de60 0x7f8f041cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:17.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.589+0000 7f8f0ab6f700 1 -- 172.21.15.40:0/612713905 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f0406a6d0 msgr2=0x7f8f041cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:17.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.589+0000 7f8f0ab6f700 1 --2- 172.21.15.40:0/612713905 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f0406a6d0 0x7f8f041cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.589+0000 7f8f0ab6f700 1 -- 172.21.15.40:0/612713905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f0409de60 msgr2=0x7f8f041cce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:17.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.589+0000 7f8f0ab6f700 1 --2- 172.21.15.40:0/612713905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f0409de60 0x7f8f041cce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.589+0000 7f8f0ab6f700 1 -- 172.21.15.40:0/612713905 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef4009550 con 0x7f8f0413c490 2023-09-30T22:27:17.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.589+0000 7f8f0ab6f700 1 --2- 172.21.15.40:0/612713905 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f0413c490 0x7f8f041cd390 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8efc00efc0 tx=0x7f8efc00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:17.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.589+0000 7f8efaffd700 1 -- 172.21.15.40:0/612713905 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8efc00cd40 con 0x7f8f0413c490 2023-09-30T22:27:17.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.589+0000 7f8efaffd700 1 -- 172.21.15.40:0/612713905 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8efc00f040 con 0x7f8f0413c490 2023-09-30T22:27:17.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.589+0000 7f8f0c5d2700 1 -- 172.21.15.40:0/612713905 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f04071b80 con 0x7f8f0413c490 2023-09-30T22:27:17.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.589+0000 7f8efaffd700 1 -- 172.21.15.40:0/612713905 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8efc0146c0 con 0x7f8f0413c490 2023-09-30T22:27:17.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.589+0000 7f8f0c5d2700 1 -- 172.21.15.40:0/612713905 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f0413b320 con 0x7f8f0413c490 2023-09-30T22:27:17.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.590+0000 7f8f0c5d2700 1 -- 172.21.15.40:0/612713905 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f04062380 con 0x7f8f0413c490 2023-09-30T22:27:17.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.591+0000 7f4f901b9700 1 Processor -- start 2023-09-30T22:27:17.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.591+0000 7f8efaffd700 1 -- 172.21.15.40:0/612713905 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8efc014820 con 0x7f8f0413c490 2023-09-30T22:27:17.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.591+0000 7f4f901b9700 1 -- start start 2023-09-30T22:27:17.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.591+0000 7f8efaffd700 1 -- 172.21.15.40:0/612713905 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f8efc0409f0 con 0x7f8f0413c490 2023-09-30T22:27:17.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.592+0000 7f4f901b9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f8812e590 0x7f4f8812e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:17.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.592+0000 7f4f901b9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4f8812eea0 0x7f4f8812d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:17.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.592+0000 7f4f901b9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4f8812d6d0 0x7f4f8812db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:17.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.592+0000 7f4f901b9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f8809ca30 con 0x7f4f8812d6d0 2023-09-30T22:27:17.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.592+0000 7f4f901b9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8809ab70 con 0x7f4f8812e590 2023-09-30T22:27:17.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.592+0000 7f4f901b9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8809bd70 con 0x7f4f8812eea0 2023-09-30T22:27:17.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.592+0000 7f4f8e756700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4f8812d6d0 0x7f4f8812db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:17.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.592+0000 7f4f8d754700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4f8812eea0 0x7f4f8812d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:17.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.592+0000 7f4f8d754700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4f8812eea0 0x7f4f8812d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56116/0 (socket says 172.21.15.40:56116) 2023-09-30T22:27:17.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.592+0000 7f4f8e756700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4f8812d6d0 0x7f4f8812db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37026/0 (socket says 172.21.15.40:37026) 2023-09-30T22:27:17.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.592+0000 7f4f8d754700 1 -- 172.21.15.40:0/2393131948 learned_addr learned my addr 172.21.15.40:0/2393131948 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:17.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.592+0000 7f4f8df55700 1 --2- 172.21.15.40:0/2393131948 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f8812e590 0x7f4f8812e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:17.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.592+0000 7f4f8d754700 1 -- 172.21.15.40:0/2393131948 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f8812e590 msgr2=0x7f4f8812e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:17.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.592+0000 7f4f8d754700 1 --2- 172.21.15.40:0/2393131948 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f8812e590 0x7f4f8812e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.592+0000 7f4f8d754700 1 -- 172.21.15.40:0/2393131948 >> v2:172.21.15.40:3300/0 conn(0x7f4f8812d6d0 msgr2=0x7f4f8812db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:17.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.592+0000 7f4f8d754700 1 --2- 172.21.15.40:0/2393131948 >> v2:172.21.15.40:3300/0 conn(0x7f4f8812d6d0 0x7f4f8812db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.592+0000 7f4f8d754700 1 -- 172.21.15.40:0/2393131948 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f8809b270 con 0x7f4f8812eea0 2023-09-30T22:27:17.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.593+0000 7f4f8d754700 1 --2- 172.21.15.40:0/2393131948 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4f8812eea0 0x7f4f8812d190 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4f7800bb90 tx=0x7f4f7800bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=888c57fe499ac107 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:17.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.596+0000 7f4f8cf53700 1 -- 172.21.15.40:0/2393131948 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7800dd30 con 0x7f4f8812eea0 2023-09-30T22:27:17.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.596+0000 7f4f8cf53700 1 -- 172.21.15.40:0/2393131948 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f7800de90 con 0x7f4f8812eea0 2023-09-30T22:27:17.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.596+0000 7f4f8cf53700 1 -- 172.21.15.40:0/2393131948 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f78010690 con 0x7f4f8812eea0 2023-09-30T22:27:17.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.596+0000 7f8efaffd700 1 -- 172.21.15.40:0/612713905 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8efc012da0 con 0x7f8f0413c490 2023-09-30T22:27:17.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.597+0000 7f4f901b9700 1 -- 172.21.15.40:0/2393131948 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4f8812eea0 msgr2=0x7f4f8812d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:17.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.597+0000 7f4f901b9700 1 --2- 172.21.15.40:0/2393131948 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4f8812eea0 0x7f4f8812d190 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4f7800bb90 tx=0x7f4f7800bea0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.597+0000 7f4f901b9700 1 -- 172.21.15.40:0/2393131948 shutdown_connections 2023-09-30T22:27:17.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.597+0000 7f4f901b9700 1 --2- 172.21.15.40:0/2393131948 >> v2:172.21.15.40:3300/0 conn(0x7f4f8812d6d0 0x7f4f8812db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.597+0000 7f4f901b9700 1 --2- 172.21.15.40:0/2393131948 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f8812e590 0x7f4f8812e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.597+0000 7f4f901b9700 1 --2- 172.21.15.40:0/2393131948 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4f8812eea0 0x7f4f8812d190 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.597+0000 7f4f901b9700 1 -- 172.21.15.40:0/2393131948 >> 172.21.15.40:0/2393131948 conn(0x7f4f880a2a00 msgr2=0x7f4f880a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:17.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.597+0000 7f4f901b9700 1 -- 172.21.15.40:0/2393131948 shutdown_connections 2023-09-30T22:27:17.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.597+0000 7f4f901b9700 1 -- 172.21.15.40:0/2393131948 wait complete. 2023-09-30T22:27:17.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.598+0000 7f4f901b9700 1 Processor -- start 2023-09-30T22:27:17.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.599+0000 7f4f901b9700 1 -- start start 2023-09-30T22:27:17.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.599+0000 7f4f901b9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f8812d6d0 0x7f4f881ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:17.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.599+0000 7f4f901b9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f8812e590 0x7f4f881cd020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:17.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.599+0000 7f4f901b9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4f8812eea0 0x7f4f88119a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:17.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.599+0000 7f4f901b9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8811bd80 con 0x7f4f8812d6d0 2023-09-30T22:27:17.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.599+0000 7f4f901b9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8811d6e0 con 0x7f4f8812e590 2023-09-30T22:27:17.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.599+0000 7f4f901b9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8811d1c0 con 0x7f4f8812eea0 2023-09-30T22:27:17.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.599+0000 7f4f8df55700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f8812d6d0 0x7f4f881ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:17.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.599+0000 7f4f8df55700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f8812d6d0 0x7f4f881ccae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37038/0 (socket says 172.21.15.40:37038) 2023-09-30T22:27:17.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.599+0000 7f4f8df55700 1 -- 172.21.15.40:0/2363222647 learned_addr learned my addr 172.21.15.40:0/2363222647 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:17.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.600+0000 7f4f8e756700 1 --2- 172.21.15.40:0/2363222647 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4f8812eea0 0x7f4f88119a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:17.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.600+0000 7f4f8d754700 1 --2- 172.21.15.40:0/2363222647 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f8812e590 0x7f4f881cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:17.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.600+0000 7f4f8e756700 1 -- 172.21.15.40:0/2363222647 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f8812e590 msgr2=0x7f4f881cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:17.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.600+0000 7f4f8e756700 1 --2- 172.21.15.40:0/2363222647 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f8812e590 0x7f4f881cd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.600+0000 7f4f8e756700 1 -- 172.21.15.40:0/2363222647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f8812d6d0 msgr2=0x7f4f881ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:17.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.600+0000 7f4f8e756700 1 --2- 172.21.15.40:0/2363222647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f8812d6d0 0x7f4f881ccae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.600+0000 7f4f8e756700 1 -- 172.21.15.40:0/2363222647 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f7800b7f0 con 0x7f4f8812eea0 2023-09-30T22:27:17.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.600+0000 7f4f8e756700 1 --2- 172.21.15.40:0/2363222647 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4f8812eea0 0x7f4f88119a50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4f8000ef00 tx=0x7f4f8000b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:17.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.600+0000 7f4f7e7fc700 1 -- 172.21.15.40:0/2363222647 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f80010040 con 0x7f4f8812eea0 2023-09-30T22:27:17.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.600+0000 7f4f7e7fc700 1 -- 172.21.15.40:0/2363222647 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8000bb30 con 0x7f4f8812eea0 2023-09-30T22:27:17.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.600+0000 7f4f901b9700 1 -- 172.21.15.40:0/2363222647 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f8811b6a0 con 0x7f4f8812eea0 2023-09-30T22:27:17.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.600+0000 7f4f901b9700 1 -- 172.21.15.40:0/2363222647 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f8811bae0 con 0x7f4f8812eea0 2023-09-30T22:27:17.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.601+0000 7f4f7e7fc700 1 -- 172.21.15.40:0/2363222647 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f80014400 con 0x7f4f8812eea0 2023-09-30T22:27:17.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.602+0000 7f4f7e7fc700 1 -- 172.21.15.40:0/2363222647 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4f800145e0 con 0x7f4f8812eea0 2023-09-30T22:27:17.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.602+0000 7f4f7e7fc700 1 -- 172.21.15.40:0/2363222647 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4f8003ff70 con 0x7f4f8812eea0 2023-09-30T22:27:17.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.602+0000 7f4f901b9700 1 -- 172.21.15.40:0/2363222647 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f88062380 con 0x7f4f8812eea0 2023-09-30T22:27:17.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.607+0000 7f4f7e7fc700 1 -- 172.21.15.40:0/2363222647 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4f800248f0 con 0x7f4f8812eea0 2023-09-30T22:27:17.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.720+0000 7fd6a72e7700 1 -- 172.21.15.40:0/138900956 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd6a0074330 con 0x7fd6a0134a90 2023-09-30T22:27:17.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.720+0000 7fd695ffb700 1 -- 172.21.15.40:0/138900956 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd690019300 con 0x7fd6a0134a90 2023-09-30T22:27:17.721 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:17.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.722+0000 7fd6a72e7700 1 -- 172.21.15.40:0/138900956 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd6a0134a90 msgr2=0x7fd6a0119590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:17.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.722+0000 7fd6a72e7700 1 --2- 172.21.15.40:0/138900956 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd6a0134a90 0x7fd6a0119590 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd6a006d960 tx=0x7fd69000ec80 comp rx=0 tx=0).stop 2023-09-30T22:27:17.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.722+0000 7fd6a72e7700 1 -- 172.21.15.40:0/138900956 shutdown_connections 2023-09-30T22:27:17.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.722+0000 7fd6a72e7700 1 --2- 172.21.15.40:0/138900956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6a01373b0 0x7fd6a0119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.722+0000 7fd6a72e7700 1 --2- 172.21.15.40:0/138900956 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6a0131d50 0x7fd6a0119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.722+0000 7fd6a72e7700 1 --2- 172.21.15.40:0/138900956 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd6a0134a90 0x7fd6a0119590 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.722+0000 7fd6a72e7700 1 -- 172.21.15.40:0/138900956 >> 172.21.15.40:0/138900956 conn(0x7fd6a00a2a00 msgr2=0x7fd6a00a08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:17.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.722+0000 7fd6a72e7700 1 -- 172.21.15.40:0/138900956 shutdown_connections 2023-09-30T22:27:17.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.722+0000 7fd6a72e7700 1 -- 172.21.15.40:0/138900956 wait complete. 2023-09-30T22:27:17.736 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:17.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.768+0000 7f038a020700 1 -- 172.21.15.40:0/1002836219 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f038412f840 con 0x7f0384130de0 2023-09-30T22:27:17.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.768+0000 7f0380ff9700 1 -- 172.21.15.40:0/1002836219 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f038412f840 con 0x7f0384130de0 2023-09-30T22:27:17.769 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:17.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.770+0000 7f038a020700 1 -- 172.21.15.40:0/1002836219 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0384130de0 msgr2=0x7f038412c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:17.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.770+0000 7f038a020700 1 --2- 172.21.15.40:0/1002836219 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0384130de0 0x7f038412c770 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f037c00caf0 tx=0x7f037c00ceb0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.770+0000 7f038a020700 1 -- 172.21.15.40:0/1002836219 shutdown_connections 2023-09-30T22:27:17.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.770+0000 7f038a020700 1 --2- 172.21.15.40:0/1002836219 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0384130de0 0x7f038412c770 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.770+0000 7f038a020700 1 --2- 172.21.15.40:0/1002836219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f038409d920 0x7f038412bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.770+0000 7f038a020700 1 --2- 172.21.15.40:0/1002836219 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f038409e230 0x7f038412c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.770+0000 7f038a020700 1 -- 172.21.15.40:0/1002836219 >> 172.21.15.40:0/1002836219 conn(0x7f038409fb20 msgr2=0x7f0384129920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:17.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.771+0000 7f038a020700 1 -- 172.21.15.40:0/1002836219 shutdown_connections 2023-09-30T22:27:17.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.771+0000 7f038a020700 1 -- 172.21.15.40:0/1002836219 wait complete. 2023-09-30T22:27:17.784 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:17.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.812+0000 7f8f0c5d2700 1 -- 172.21.15.40:0/612713905 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8f04074720 con 0x7f8f0413c490 2023-09-30T22:27:17.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.812+0000 7f8efaffd700 1 -- 172.21.15.40:0/612713905 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8efc02a020 con 0x7f8f0413c490 2023-09-30T22:27:17.813 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:17.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.814+0000 7f8f0c5d2700 1 -- 172.21.15.40:0/612713905 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f0413c490 msgr2=0x7f8f041cd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:17.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.814+0000 7f8f0c5d2700 1 --2- 172.21.15.40:0/612713905 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f0413c490 0x7f8f041cd390 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8efc00efc0 tx=0x7f8efc00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.814+0000 7f8f0c5d2700 1 -- 172.21.15.40:0/612713905 shutdown_connections 2023-09-30T22:27:17.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.814+0000 7f8f0c5d2700 1 --2- 172.21.15.40:0/612713905 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f0413c490 0x7f8f041cd390 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.814+0000 7f8f0c5d2700 1 --2- 172.21.15.40:0/612713905 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f0406a6d0 0x7f8f041cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.814+0000 7f8f0c5d2700 1 --2- 172.21.15.40:0/612713905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f0409de60 0x7f8f041cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.814+0000 7f8f0c5d2700 1 -- 172.21.15.40:0/612713905 >> 172.21.15.40:0/612713905 conn(0x7f8f0409fb20 msgr2=0x7f8f0413b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:17.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.815+0000 7f8f0c5d2700 1 -- 172.21.15.40:0/612713905 shutdown_connections 2023-09-30T22:27:17.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.815+0000 7f8f0c5d2700 1 -- 172.21.15.40:0/612713905 wait complete. 2023-09-30T22:27:17.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.819+0000 7f4f901b9700 1 -- 172.21.15.40:0/2363222647 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4f88074330 con 0x7f4f8812eea0 2023-09-30T22:27:17.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.819+0000 7f4f7e7fc700 1 -- 172.21.15.40:0/2363222647 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4f80024300 con 0x7f4f8812eea0 2023-09-30T22:27:17.820 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.822+0000 7f4f901b9700 1 -- 172.21.15.40:0/2363222647 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4f8812eea0 msgr2=0x7f4f88119a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.822+0000 7f4f901b9700 1 --2- 172.21.15.40:0/2363222647 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4f8812eea0 0x7f4f88119a50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4f8000ef00 tx=0x7f4f8000b390 comp rx=0 tx=0).stop 2023-09-30T22:27:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.822+0000 7f4f901b9700 1 -- 172.21.15.40:0/2363222647 shutdown_connections 2023-09-30T22:27:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.822+0000 7f4f901b9700 1 --2- 172.21.15.40:0/2363222647 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4f8812eea0 0x7f4f88119a50 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.822+0000 7f4f901b9700 1 --2- 172.21.15.40:0/2363222647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f8812d6d0 0x7f4f881ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.822+0000 7f4f901b9700 1 --2- 172.21.15.40:0/2363222647 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f8812e590 0x7f4f881cd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.822+0000 7f4f901b9700 1 -- 172.21.15.40:0/2363222647 >> 172.21.15.40:0/2363222647 conn(0x7f4f880a2a00 msgr2=0x7f4f8812c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.822+0000 7f4f901b9700 1 -- 172.21.15.40:0/2363222647 shutdown_connections 2023-09-30T22:27:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:17.822+0000 7f4f901b9700 1 -- 172.21.15.40:0/2363222647 wait complete. 2023-09-30T22:27:17.828 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:17.835 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:18.737 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:18.784 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:18.829 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:18.835 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:18.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.883+0000 7f5ed0392700 1 Processor -- start 2023-09-30T22:27:18.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.883+0000 7f5ed0392700 1 -- start start 2023-09-30T22:27:18.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.883+0000 7f5ed0392700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ec8133e00 0x7f5ec81341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:18.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.883+0000 7f5ed0392700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5ec809df40 0x7f5ec813bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:18.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.884+0000 7f5ed0392700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ec8133940 con 0x7f5ec809d400 2023-09-30T22:27:18.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.884+0000 7f5ed0392700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ec809f0d0 con 0x7f5ec809df40 2023-09-30T22:27:18.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.884+0000 7f5ed0392700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec8133be0 con 0x7f5ec8133e00 2023-09-30T22:27:18.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.884+0000 7f5ece12e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ec8133e00 0x7f5ec81341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:18.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.884+0000 7f5ece92f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5ec809df40 0x7f5ec813bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:18.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.884+0000 7f5ece12e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ec8133e00 0x7f5ec81341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42334/0 (socket says 172.21.15.40:42334) 2023-09-30T22:27:18.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.884+0000 7f5ece92f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5ec809df40 0x7f5ec813bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37044/0 (socket says 172.21.15.40:37044) 2023-09-30T22:27:18.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.884+0000 7f5ece12e700 1 -- 172.21.15.40:0/3788097861 learned_addr learned my addr 172.21.15.40:0/3788097861 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:18.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.884+0000 7f5ece12e700 1 -- 172.21.15.40:0/3788097861 >> v2:172.21.15.40:3300/0 conn(0x7f5ec809df40 msgr2=0x7f5ec813bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:18.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.884+0000 7f5ece12e700 1 --2- 172.21.15.40:0/3788097861 >> v2:172.21.15.40:3300/0 conn(0x7f5ec809df40 0x7f5ec813bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.884+0000 7f5ece12e700 1 -- 172.21.15.40:0/3788097861 >> v1:172.21.15.40:6789/0 conn(0x7f5ec809d400 legacy=0x7f5ec809d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:18.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.884+0000 7f5ece12e700 1 -- 172.21.15.40:0/3788097861 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec809a860 con 0x7f5ec8133e00 2023-09-30T22:27:18.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.884+0000 7f5ece92f700 1 --2- 172.21.15.40:0/3788097861 >> v2:172.21.15.40:3300/0 conn(0x7f5ec809df40 0x7f5ec813bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:18.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.884+0000 7f5ece12e700 1 --2- 172.21.15.40:0/3788097861 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ec8133e00 0x7f5ec81341d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5ec40098f0 tx=0x7f5ec4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec8b09818611c8b4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:18.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.885+0000 7f5ecd12c700 1 -- 172.21.15.40:0/3788097861 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4011830 con 0x7f5ec8133e00 2023-09-30T22:27:18.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.885+0000 7f5ecd12c700 1 -- 172.21.15.40:0/3788097861 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec4011990 con 0x7f5ec8133e00 2023-09-30T22:27:18.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.885+0000 7f5ecd12c700 1 -- 172.21.15.40:0/3788097861 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4011d20 con 0x7f5ec8133e00 2023-09-30T22:27:18.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.885+0000 7f5ed0392700 1 -- 172.21.15.40:0/3788097861 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ec8133e00 msgr2=0x7f5ec81341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:18.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.885+0000 7f5ed0392700 1 --2- 172.21.15.40:0/3788097861 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ec8133e00 0x7f5ec81341d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5ec40098f0 tx=0x7f5ec4009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:18.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.886+0000 7f5ed0392700 1 -- 172.21.15.40:0/3788097861 shutdown_connections 2023-09-30T22:27:18.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.886+0000 7f5ed0392700 1 --2- 172.21.15.40:0/3788097861 >> v2:172.21.15.40:3300/0 conn(0x7f5ec809df40 0x7f5ec813bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.886+0000 7f5ed0392700 1 --2- 172.21.15.40:0/3788097861 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ec8133e00 0x7f5ec81341d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.886+0000 7f5ed0392700 1 -- 172.21.15.40:0/3788097861 >> 172.21.15.40:0/3788097861 conn(0x7f5ec80a2a00 msgr2=0x7f5ec80a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:18.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.886+0000 7f5ed0392700 1 -- 172.21.15.40:0/3788097861 shutdown_connections 2023-09-30T22:27:18.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.886+0000 7f5ed0392700 1 -- 172.21.15.40:0/3788097861 wait complete. 2023-09-30T22:27:18.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.887+0000 7f5ed0392700 1 Processor -- start 2023-09-30T22:27:18.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.887+0000 7f5ed0392700 1 -- start start 2023-09-30T22:27:18.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.887+0000 7f5ed0392700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ec809d400 0x7f5ec811bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:18.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.887+0000 7f5ed0392700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ec809df40 0x7f5ec811c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:18.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.887+0000 7f5ed0392700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ec8133e00 0x7f5ec811c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:18.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.887+0000 7f5ed0392700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec80a0100 con 0x7f5ec809d400 2023-09-30T22:27:18.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.887+0000 7f5ed0392700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec811dab0 con 0x7f5ec809df40 2023-09-30T22:27:18.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.887+0000 7f5ed0392700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec811e1e0 con 0x7f5ec8133e00 2023-09-30T22:27:18.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.887+0000 7f5ecd92d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ec809df40 0x7f5ec811c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:18.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.887+0000 7f5ecd92d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ec809df40 0x7f5ec811c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42346/0 (socket says 172.21.15.40:42346) 2023-09-30T22:27:18.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.887+0000 7f5ecd92d700 1 -- 172.21.15.40:0/2894789856 learned_addr learned my addr 172.21.15.40:0/2894789856 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:18.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.888+0000 7f5ece92f700 1 --2- 172.21.15.40:0/2894789856 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ec8133e00 0x7f5ec811c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:18.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.888+0000 7f5ece12e700 1 --2- 172.21.15.40:0/2894789856 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ec809d400 0x7f5ec811bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:18.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.888+0000 7f5ecd92d700 1 -- 172.21.15.40:0/2894789856 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ec8133e00 msgr2=0x7f5ec811c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:18.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.888+0000 7f5ecd92d700 1 --2- 172.21.15.40:0/2894789856 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ec8133e00 0x7f5ec811c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.888+0000 7f5ecd92d700 1 -- 172.21.15.40:0/2894789856 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ec809d400 msgr2=0x7f5ec811bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:18.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.888+0000 7f5ecd92d700 1 --2- 172.21.15.40:0/2894789856 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ec809d400 0x7f5ec811bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.888+0000 7f5ecd92d700 1 -- 172.21.15.40:0/2894789856 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec0009a70 con 0x7f5ec809df40 2023-09-30T22:27:18.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.888+0000 7f5ecd92d700 1 --2- 172.21.15.40:0/2894789856 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ec809df40 0x7f5ec811c2d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5eb800c420 tx=0x7f5eb800c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:18.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.888+0000 7f5ebeffd700 1 -- 172.21.15.40:0/2894789856 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb80052d0 con 0x7f5ec809df40 2023-09-30T22:27:18.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.888+0000 7f5ebeffd700 1 -- 172.21.15.40:0/2894789856 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb8005430 con 0x7f5ec809df40 2023-09-30T22:27:18.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.889+0000 7f5ed0392700 1 -- 172.21.15.40:0/2894789856 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ec4009550 con 0x7f5ec809df40 2023-09-30T22:27:18.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.889+0000 7f5ebeffd700 1 -- 172.21.15.40:0/2894789856 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb80038a0 con 0x7f5ec809df40 2023-09-30T22:27:18.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.889+0000 7f5ed0392700 1 -- 172.21.15.40:0/2894789856 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ec812c8b0 con 0x7f5ec809df40 2023-09-30T22:27:18.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.890+0000 7f5ebeffd700 1 -- 172.21.15.40:0/2894789856 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5eb8003a00 con 0x7f5ec809df40 2023-09-30T22:27:18.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.890+0000 7f5ed0392700 1 -- 172.21.15.40:0/2894789856 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ec8062380 con 0x7f5ec809df40 2023-09-30T22:27:18.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.890+0000 7f5ebeffd700 1 -- 172.21.15.40:0/2894789856 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5eb803ea10 con 0x7f5ec809df40 2023-09-30T22:27:18.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.895+0000 7f5ebeffd700 1 -- 172.21.15.40:0/2894789856 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5eb8003cb0 con 0x7f5ec809df40 2023-09-30T22:27:18.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.937+0000 7f4fc229f700 1 Processor -- start 2023-09-30T22:27:18.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.937+0000 7f4fc229f700 1 -- start start 2023-09-30T22:27:18.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.937+0000 7f4fc229f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4fbc09fbb0 0x7f4fbc06c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:18.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.937+0000 7f4fc229f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fbc06d2c0 0x7f4fbc13baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:18.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.937+0000 7f4fc229f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fbc0a0590 con 0x7f4fbc06ced0 2023-09-30T22:27:18.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.937+0000 7f4fc229f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fbc09ff80 con 0x7f4fbc09fbb0 2023-09-30T22:27:18.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.937+0000 7f4fc229f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc06da80 con 0x7f4fbc06d2c0 2023-09-30T22:27:18.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.938+0000 7f4fbbfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4fbc09fbb0 0x7f4fbc06c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:18.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.938+0000 7f4fbbfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4fbc09fbb0 0x7f4fbc06c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37056/0 (socket says 172.21.15.40:37056) 2023-09-30T22:27:18.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.938+0000 7f4fbbfff700 1 -- 172.21.15.40:0/431169106 learned_addr learned my addr 172.21.15.40:0/431169106 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:18.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.938+0000 7f4fc083c700 1 --2- 172.21.15.40:0/431169106 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fbc06d2c0 0x7f4fbc13baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:18.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.938+0000 7f4fbbfff700 1 -- 172.21.15.40:0/431169106 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fbc06d2c0 msgr2=0x7f4fbc13baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:18.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.938+0000 7f4fbbfff700 1 --2- 172.21.15.40:0/431169106 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fbc06d2c0 0x7f4fbc13baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.938+0000 7f4fbbfff700 1 -- 172.21.15.40:0/431169106 >> v1:172.21.15.40:6789/0 conn(0x7f4fbc06ced0 legacy=0x7f4fbc138370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:18.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.938+0000 7f4fbbfff700 1 -- 172.21.15.40:0/431169106 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fbc0a0780 con 0x7f4fbc09fbb0 2023-09-30T22:27:18.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.938+0000 7f4fbbfff700 1 --2- 172.21.15.40:0/431169106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fbc09fbb0 0x7f4fbc06c990 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f4fac0098f0 tx=0x7f4fac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96538274afe7fa90 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:18.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.939+0000 7f4fbaffd700 1 -- 172.21.15.40:0/431169106 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac011830 con 0x7f4fbc09fbb0 2023-09-30T22:27:18.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.939+0000 7f4fbaffd700 1 -- 172.21.15.40:0/431169106 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fac011990 con 0x7f4fbc09fbb0 2023-09-30T22:27:18.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.939+0000 7f4fbaffd700 1 -- 172.21.15.40:0/431169106 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac011d20 con 0x7f4fbc09fbb0 2023-09-30T22:27:18.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.939+0000 7f4fc229f700 1 -- 172.21.15.40:0/431169106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fbc09fbb0 msgr2=0x7f4fbc06c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:18.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.939+0000 7f4fc229f700 1 --2- 172.21.15.40:0/431169106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fbc09fbb0 0x7f4fbc06c990 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f4fac0098f0 tx=0x7f4fac009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:18.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.939+0000 7f4fc229f700 1 -- 172.21.15.40:0/431169106 shutdown_connections 2023-09-30T22:27:18.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.939+0000 7f4fc229f700 1 --2- 172.21.15.40:0/431169106 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fbc06d2c0 0x7f4fbc13baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.939+0000 7f4fc229f700 1 --2- 172.21.15.40:0/431169106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fbc09fbb0 0x7f4fbc06c990 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.939+0000 7f4fc229f700 1 -- 172.21.15.40:0/431169106 >> 172.21.15.40:0/431169106 conn(0x7f4fbc0a41a0 msgr2=0x7f4fbc0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:18.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.939+0000 7f4fc229f700 1 -- 172.21.15.40:0/431169106 shutdown_connections 2023-09-30T22:27:18.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.939+0000 7f4fc229f700 1 -- 172.21.15.40:0/431169106 wait complete. 2023-09-30T22:27:18.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.940+0000 7f4fc229f700 1 Processor -- start 2023-09-30T22:27:18.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.941+0000 7f4fc229f700 1 -- start start 2023-09-30T22:27:18.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.941+0000 7f4fc229f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fbc06ced0 0x7f4fbc08d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:18.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.941+0000 7f4fc229f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fbc06d2c0 0x7f4fbc08d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:18.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.941+0000 7f4fc229f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fbc09fbb0 0x7f4fbc08db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:18.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.941+0000 7f4fc229f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc08e590 con 0x7f4fbc06ced0 2023-09-30T22:27:18.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.941+0000 7f4fc229f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc08ec80 con 0x7f4fbc09fbb0 2023-09-30T22:27:18.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.941+0000 7f4fc229f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc090b90 con 0x7f4fbc06d2c0 2023-09-30T22:27:18.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.941+0000 7f4fc083c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fbc09fbb0 0x7f4fbc08db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:18.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.941+0000 7f4fc083c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fbc09fbb0 0x7f4fbc08db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42368/0 (socket says 172.21.15.40:42368) 2023-09-30T22:27:18.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.941+0000 7f4fc083c700 1 -- 172.21.15.40:0/849459251 learned_addr learned my addr 172.21.15.40:0/849459251 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:18.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.941+0000 7f4fbb7fe700 1 --2- 172.21.15.40:0/849459251 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fbc06d2c0 0x7f4fbc08d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:18.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.942+0000 7f4fc083c700 1 -- 172.21.15.40:0/849459251 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fbc06d2c0 msgr2=0x7f4fbc08d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:18.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.942+0000 7f4fc083c700 1 --2- 172.21.15.40:0/849459251 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fbc06d2c0 0x7f4fbc08d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.942+0000 7f4fc083c700 1 -- 172.21.15.40:0/849459251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fbc06ced0 msgr2=0x7f4fbc08d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:18.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.942+0000 7f4fc083c700 1 --2- 172.21.15.40:0/849459251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fbc06ced0 0x7f4fbc08d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.942+0000 7f4fc083c700 1 -- 172.21.15.40:0/849459251 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fac009550 con 0x7f4fbc09fbb0 2023-09-30T22:27:18.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.942+0000 7f4fbb7fe700 1 --2- 172.21.15.40:0/849459251 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fbc06d2c0 0x7f4fbc08d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:18.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.942+0000 7f4fc083c700 1 --2- 172.21.15.40:0/849459251 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fbc09fbb0 0x7f4fbc08db40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400efc0 tx=0x7f4fb400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:18.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.942+0000 7f4fb8ff9700 1 -- 172.21.15.40:0/849459251 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb4009ea0 con 0x7f4fbc09fbb0 2023-09-30T22:27:18.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.942+0000 7f4fb8ff9700 1 -- 172.21.15.40:0/849459251 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb400f040 con 0x7f4fbc09fbb0 2023-09-30T22:27:18.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.942+0000 7f4fc229f700 1 -- 172.21.15.40:0/849459251 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fbc071760 con 0x7f4fbc09fbb0 2023-09-30T22:27:18.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.942+0000 7f4fb8ff9700 1 -- 172.21.15.40:0/849459251 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb4014480 con 0x7f4fbc09fbb0 2023-09-30T22:27:18.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.942+0000 7f4fc229f700 1 -- 172.21.15.40:0/849459251 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fbc091320 con 0x7f4fbc09fbb0 2023-09-30T22:27:18.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.943+0000 7f4fb8ff9700 1 -- 172.21.15.40:0/849459251 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4fb40145e0 con 0x7f4fbc09fbb0 2023-09-30T22:27:18.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.944+0000 7f4fb8ff9700 1 -- 172.21.15.40:0/849459251 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4fb40400d0 con 0x7f4fbc09fbb0 2023-09-30T22:27:18.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.943+0000 7f4fc229f700 1 -- 172.21.15.40:0/849459251 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fbc062380 con 0x7f4fbc09fbb0 2023-09-30T22:27:18.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.948+0000 7f4fb8ff9700 1 -- 172.21.15.40:0/849459251 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4fb4018030 con 0x7f4fbc09fbb0 2023-09-30T22:27:18.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.969+0000 7f6070c9c700 1 Processor -- start 2023-09-30T22:27:18.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.969+0000 7f6070c9c700 1 -- start start 2023-09-30T22:27:18.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.970+0000 7f6070c9c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f606c09d920 0x7f606c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:18.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.970+0000 7f6070c9c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f606c130fb0 0x7f606c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:18.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.970+0000 7f6070c9c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f606c09adf0 con 0x7f606c09e230 2023-09-30T22:27:18.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.970+0000 7f6070c9c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f606c09edf0 con 0x7f606c09d920 2023-09-30T22:27:18.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.970+0000 7f6070c9c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f606c09b660 con 0x7f606c130fb0 2023-09-30T22:27:18.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.970+0000 7f6069d9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f606c09e230 0x7f606c1308a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38228/0 (socket says 172.21.15.40:38228) 2023-09-30T22:27:18.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.970+0000 7f6069d9b700 1 -- 172.21.15.40:0/2008786885 learned_addr learned my addr 172.21.15.40:0/2008786885 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:27:18.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.970+0000 7f606a59c700 1 --2- 172.21.15.40:0/2008786885 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f606c09d920 0x7f606c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:18.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.970+0000 7f606ad9d700 1 --2- 172.21.15.40:0/2008786885 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f606c130fb0 0x7f606c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:18.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.970+0000 7f606ad9d700 1 -- 172.21.15.40:0/2008786885 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f606c09d920 msgr2=0x7f606c09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:18.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.970+0000 7f606ad9d700 1 --2- 172.21.15.40:0/2008786885 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f606c09d920 0x7f606c09dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.970+0000 7f606ad9d700 1 -- 172.21.15.40:0/2008786885 >> v1:172.21.15.40:6789/0 conn(0x7f606c09e230 legacy=0x7f606c1308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:18.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.971+0000 7f606ad9d700 1 -- 172.21.15.40:0/2008786885 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606c09a6e0 con 0x7f606c130fb0 2023-09-30T22:27:18.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.971+0000 7f606959a700 1 -- 172.21.15.40:0/2008786885 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2861894343 0 0) 0x7f606c09adf0 con 0x7f606c09e230 2023-09-30T22:27:18.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.971+0000 7f606a59c700 1 --2- 172.21.15.40:0/2008786885 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f606c09d920 0x7f606c09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:18.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.971+0000 7f606ad9d700 1 --2- 172.21.15.40:0/2008786885 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f606c130fb0 0x7f606c138d10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f606400bfd0 tx=0x7f606400d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbdaafb73526ce5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:18.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.971+0000 7f606959a700 1 -- 172.21.15.40:0/2008786885 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6064010070 con 0x7f606c130fb0 2023-09-30T22:27:18.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.971+0000 7f606959a700 1 -- 172.21.15.40:0/2008786885 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606400b2e0 con 0x7f606c130fb0 2023-09-30T22:27:18.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.971+0000 7f606959a700 1 -- 172.21.15.40:0/2008786885 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606400dc70 con 0x7f606c130fb0 2023-09-30T22:27:18.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.972+0000 7f6070c9c700 1 -- 172.21.15.40:0/2008786885 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f606c130fb0 msgr2=0x7f606c138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:18.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.972+0000 7f6070c9c700 1 --2- 172.21.15.40:0/2008786885 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f606c130fb0 0x7f606c138d10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f606400bfd0 tx=0x7f606400d330 comp rx=0 tx=0).stop 2023-09-30T22:27:18.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.972+0000 7f6070c9c700 1 -- 172.21.15.40:0/2008786885 shutdown_connections 2023-09-30T22:27:18.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.972+0000 7f6070c9c700 1 --2- 172.21.15.40:0/2008786885 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f606c130fb0 0x7f606c138d10 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.972+0000 7f6070c9c700 1 --2- 172.21.15.40:0/2008786885 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f606c09d920 0x7f606c09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.972+0000 7f6070c9c700 1 -- 172.21.15.40:0/2008786885 >> 172.21.15.40:0/2008786885 conn(0x7f606c09fb20 msgr2=0x7f606c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:18.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.972+0000 7f6070c9c700 1 -- 172.21.15.40:0/2008786885 shutdown_connections 2023-09-30T22:27:18.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.972+0000 7f6070c9c700 1 -- 172.21.15.40:0/2008786885 wait complete. 2023-09-30T22:27:18.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.973+0000 7f6070c9c700 1 Processor -- start 2023-09-30T22:27:18.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.973+0000 7f6070c9c700 1 -- start start 2023-09-30T22:27:18.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.974+0000 7f6070c9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f606c09d920 0x7f606c11f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:18.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.974+0000 7f6070c9c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f606c09e230 0x7f606c11fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:18.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.974+0000 7f6070c9c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f606c130fb0 0x7f606c120010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:18.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.974+0000 7f6070c9c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606c12d930 con 0x7f606c09d920 2023-09-30T22:27:18.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.974+0000 7f6070c9c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f606c122b10 con 0x7f606c09e230 2023-09-30T22:27:18.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.974+0000 7f6070c9c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f606c121a00 con 0x7f606c130fb0 2023-09-30T22:27:18.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.974+0000 7f6069d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f606c09e230 0x7f606c11fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:18.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.974+0000 7f6069d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f606c09e230 0x7f606c11fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42382/0 (socket says 172.21.15.40:42382) 2023-09-30T22:27:18.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.974+0000 7f6069d9b700 1 -- 172.21.15.40:0/4092092234 learned_addr learned my addr 172.21.15.40:0/4092092234 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:18.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.974+0000 7f606a59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f606c09d920 0x7f606c11f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:18.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.974+0000 7f606ad9d700 1 --2- 172.21.15.40:0/4092092234 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f606c130fb0 0x7f606c120010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:18.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.975+0000 7f606ad9d700 1 -- 172.21.15.40:0/4092092234 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f606c09e230 msgr2=0x7f606c11fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:18.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.975+0000 7f606ad9d700 1 --2- 172.21.15.40:0/4092092234 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f606c09e230 0x7f606c11fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.975+0000 7f606ad9d700 1 -- 172.21.15.40:0/4092092234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f606c09d920 msgr2=0x7f606c11f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:18.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.975+0000 7f606ad9d700 1 --2- 172.21.15.40:0/4092092234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f606c09d920 0x7f606c11f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.975+0000 7f606ad9d700 1 -- 172.21.15.40:0/4092092234 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605c009430 con 0x7f606c130fb0 2023-09-30T22:27:18.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.975+0000 7f606a59c700 1 --2- 172.21.15.40:0/4092092234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f606c09d920 0x7f606c11f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:18.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.975+0000 7f606ad9d700 1 --2- 172.21.15.40:0/4092092234 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f606c130fb0 0x7f606c120010 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6064017000 tx=0x7f6064004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:18.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.975+0000 7f605affd700 1 -- 172.21.15.40:0/4092092234 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6064009300 con 0x7f606c130fb0 2023-09-30T22:27:18.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.975+0000 7f605affd700 1 -- 172.21.15.40:0/4092092234 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606400bb00 con 0x7f606c130fb0 2023-09-30T22:27:18.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.975+0000 7f605affd700 1 -- 172.21.15.40:0/4092092234 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60640044b0 con 0x7f606c130fb0 2023-09-30T22:27:18.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.975+0000 7f6070c9c700 1 -- 172.21.15.40:0/4092092234 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f606400bc80 con 0x7f606c130fb0 2023-09-30T22:27:18.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.975+0000 7f6070c9c700 1 -- 172.21.15.40:0/4092092234 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f606c06b530 con 0x7f606c130fb0 2023-09-30T22:27:18.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.976+0000 7f6070c9c700 1 -- 172.21.15.40:0/4092092234 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f606c070e10 con 0x7f606c130fb0 2023-09-30T22:27:18.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.977+0000 7f605affd700 1 -- 172.21.15.40:0/4092092234 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6064009050 con 0x7f606c130fb0 2023-09-30T22:27:18.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.977+0000 7f605affd700 1 -- 172.21.15.40:0/4092092234 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f60640483b0 con 0x7f606c130fb0 2023-09-30T22:27:18.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:18.986+0000 7f605affd700 1 -- 172.21.15.40:0/4092092234 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6064009460 con 0x7f606c130fb0 2023-09-30T22:27:19.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.013+0000 7f3b580fc700 1 Processor -- start 2023-09-30T22:27:19.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.014+0000 7f3b580fc700 1 -- start start 2023-09-30T22:27:19.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.014+0000 7f3b580fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3b5009d920 0x7f3b5009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:19.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.014+0000 7f3b580fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b5009f0f0 0x7f3b5009e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:19.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.014+0000 7f3b580fc700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b5009f940 con 0x7f3b50133ca0 2023-09-30T22:27:19.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.014+0000 7f3b580fc700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b5006b4c0 con 0x7f3b5009d920 2023-09-30T22:27:19.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.014+0000 7f3b580fc700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5009a8f0 con 0x7f3b5009f0f0 2023-09-30T22:27:19.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.014+0000 7f3b55697700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b5009f0f0 0x7f3b5009e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:19.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.014+0000 7f3b55697700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b5009f0f0 0x7f3b5009e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56164/0 (socket says 172.21.15.40:56164) 2023-09-30T22:27:19.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.014+0000 7f3b55697700 1 -- 172.21.15.40:0/103773387 learned_addr learned my addr 172.21.15.40:0/103773387 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:19.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.014+0000 7f3b55e98700 1 --2- 172.21.15.40:0/103773387 >> v2:172.21.15.40:3300/0 conn(0x7f3b5009d920 0x7f3b5009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:19.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.015+0000 7f3b55697700 1 -- 172.21.15.40:0/103773387 >> v2:172.21.15.40:3300/0 conn(0x7f3b5009d920 msgr2=0x7f3b5009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:19.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.015+0000 7f3b55697700 1 --2- 172.21.15.40:0/103773387 >> v2:172.21.15.40:3300/0 conn(0x7f3b5009d920 0x7f3b5009dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.015+0000 7f3b55697700 1 -- 172.21.15.40:0/103773387 >> v1:172.21.15.40:6789/0 conn(0x7f3b50133ca0 legacy=0x7f3b50134120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:19.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.015+0000 7f3b55697700 1 -- 172.21.15.40:0/103773387 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5009f6e0 con 0x7f3b5009f0f0 2023-09-30T22:27:19.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.015+0000 7f3b55697700 1 --2- 172.21.15.40:0/103773387 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b5009f0f0 0x7f3b5009e230 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3b400098f0 tx=0x7f3b40009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b61aab99c9883080 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:19.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.015+0000 7f3b54e96700 1 -- 172.21.15.40:0/103773387 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b40011830 con 0x7f3b5009f0f0 2023-09-30T22:27:19.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.015+0000 7f3b54e96700 1 -- 172.21.15.40:0/103773387 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b40011990 con 0x7f3b5009f0f0 2023-09-30T22:27:19.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.015+0000 7f3b54e96700 1 -- 172.21.15.40:0/103773387 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b40011d20 con 0x7f3b5009f0f0 2023-09-30T22:27:19.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.016+0000 7f3b580fc700 1 -- 172.21.15.40:0/103773387 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b5009f0f0 msgr2=0x7f3b5009e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:19.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.016+0000 7f3b580fc700 1 --2- 172.21.15.40:0/103773387 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b5009f0f0 0x7f3b5009e230 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3b400098f0 tx=0x7f3b40009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:19.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.016+0000 7f3b580fc700 1 -- 172.21.15.40:0/103773387 shutdown_connections 2023-09-30T22:27:19.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.016+0000 7f3b580fc700 1 --2- 172.21.15.40:0/103773387 >> v2:172.21.15.40:3300/0 conn(0x7f3b5009d920 0x7f3b5009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.016+0000 7f3b580fc700 1 --2- 172.21.15.40:0/103773387 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b5009f0f0 0x7f3b5009e230 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.016+0000 7f3b580fc700 1 -- 172.21.15.40:0/103773387 >> 172.21.15.40:0/103773387 conn(0x7f3b5009fb20 msgr2=0x7f3b5009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:19.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.016+0000 7f3b580fc700 1 -- 172.21.15.40:0/103773387 shutdown_connections 2023-09-30T22:27:19.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.016+0000 7f3b580fc700 1 -- 172.21.15.40:0/103773387 wait complete. 2023-09-30T22:27:19.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.017+0000 7f3b580fc700 1 Processor -- start 2023-09-30T22:27:19.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.017+0000 7f3b580fc700 1 -- start start 2023-09-30T22:27:19.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.017+0000 7f3b580fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b5009d920 0x7f3b5011e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:19.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.017+0000 7f3b580fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b50133ca0 0x7f3b5011e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:19.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.017+0000 7f3b580fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b501317c0 0x7f3b5011ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:19.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.017+0000 7f3b580fc700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b501228b0 con 0x7f3b5009d920 2023-09-30T22:27:19.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.017+0000 7f3b580fc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b50121ef0 con 0x7f3b50133ca0 2023-09-30T22:27:19.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.017+0000 7f3b580fc700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b500a28a0 con 0x7f3b501317c0 2023-09-30T22:27:19.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.017+0000 7f3b55e98700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b5009d920 0x7f3b5011e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:19.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.017+0000 7f3b55e98700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b5009d920 0x7f3b5011e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37100/0 (socket says 172.21.15.40:37100) 2023-09-30T22:27:19.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.017+0000 7f3b55e98700 1 -- 172.21.15.40:0/2068781922 learned_addr learned my addr 172.21.15.40:0/2068781922 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:19.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.018+0000 7f3b56699700 1 --2- 172.21.15.40:0/2068781922 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b501317c0 0x7f3b5011ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:19.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.018+0000 7f3b55e98700 1 -- 172.21.15.40:0/2068781922 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b501317c0 msgr2=0x7f3b5011ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:19.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.018+0000 7f3b55e98700 1 --2- 172.21.15.40:0/2068781922 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b501317c0 0x7f3b5011ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.018+0000 7f3b55e98700 1 -- 172.21.15.40:0/2068781922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b50133ca0 msgr2=0x7f3b5011e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:19.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.018+0000 7f3b55e98700 1 --2- 172.21.15.40:0/2068781922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b50133ca0 0x7f3b5011e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.018+0000 7f3b55e98700 1 -- 172.21.15.40:0/2068781922 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b40009550 con 0x7f3b5009d920 2023-09-30T22:27:19.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.018+0000 7f3b55e98700 1 --2- 172.21.15.40:0/2068781922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b5009d920 0x7f3b5011e3d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c00e900 tx=0x7f3b4c00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:19.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.018+0000 7f3b467fc700 1 -- 172.21.15.40:0/2068781922 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c009650 con 0x7f3b5009d920 2023-09-30T22:27:19.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.018+0000 7f3b467fc700 1 -- 172.21.15.40:0/2068781922 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4c00ee50 con 0x7f3b5009d920 2023-09-30T22:27:19.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.018+0000 7f3b580fc700 1 -- 172.21.15.40:0/2068781922 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b50121230 con 0x7f3b5009d920 2023-09-30T22:27:19.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.018+0000 7f3b467fc700 1 -- 172.21.15.40:0/2068781922 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c00ca50 con 0x7f3b5009d920 2023-09-30T22:27:19.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.018+0000 7f3b580fc700 1 -- 172.21.15.40:0/2068781922 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b5011ffe0 con 0x7f3b5009d920 2023-09-30T22:27:19.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.019+0000 7f3b580fc700 1 -- 172.21.15.40:0/2068781922 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b50121a90 con 0x7f3b5009d920 2023-09-30T22:27:19.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.019+0000 7f3b467fc700 1 -- 172.21.15.40:0/2068781922 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3b4c00cbb0 con 0x7f3b5009d920 2023-09-30T22:27:19.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.020+0000 7f3b467fc700 1 -- 172.21.15.40:0/2068781922 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3b4c03faf0 con 0x7f3b5009d920 2023-09-30T22:27:19.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.029+0000 7f3b467fc700 1 -- 172.21.15.40:0/2068781922 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3b4c01b3b0 con 0x7f3b5009d920 2023-09-30T22:27:19.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.113+0000 7f5ed0392700 1 -- 172.21.15.40:0/2894789856 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5ec81200a0 con 0x7f5ec809df40 2023-09-30T22:27:19.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.113+0000 7f5ebeffd700 1 -- 172.21.15.40:0/2894789856 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5eb8017070 con 0x7f5ec809df40 2023-09-30T22:27:19.114 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:19.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.116+0000 7f5ed0392700 1 -- 172.21.15.40:0/2894789856 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ec809df40 msgr2=0x7f5ec811c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:19.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.116+0000 7f5ed0392700 1 --2- 172.21.15.40:0/2894789856 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ec809df40 0x7f5ec811c2d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5eb800c420 tx=0x7f5eb800c730 comp rx=0 tx=0).stop 2023-09-30T22:27:19.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.116+0000 7f5ed0392700 1 -- 172.21.15.40:0/2894789856 shutdown_connections 2023-09-30T22:27:19.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.116+0000 7f5ed0392700 1 --2- 172.21.15.40:0/2894789856 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ec8133e00 0x7f5ec811c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.116+0000 7f5ed0392700 1 --2- 172.21.15.40:0/2894789856 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ec809d400 0x7f5ec811bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.116+0000 7f5ed0392700 1 --2- 172.21.15.40:0/2894789856 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ec809df40 0x7f5ec811c2d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.116+0000 7f5ed0392700 1 -- 172.21.15.40:0/2894789856 >> 172.21.15.40:0/2894789856 conn(0x7f5ec80a2a00 msgr2=0x7f5ec8131840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:19.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.116+0000 7f5ed0392700 1 -- 172.21.15.40:0/2894789856 shutdown_connections 2023-09-30T22:27:19.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.116+0000 7f5ed0392700 1 -- 172.21.15.40:0/2894789856 wait complete. 2023-09-30T22:27:19.134 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:19.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.153+0000 7f4fc229f700 1 -- 172.21.15.40:0/849459251 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4fbc074620 con 0x7f4fbc09fbb0 2023-09-30T22:27:19.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.153+0000 7f4fb8ff9700 1 -- 172.21.15.40:0/849459251 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4fb401a4a0 con 0x7f4fbc09fbb0 2023-09-30T22:27:19.154 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:19.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.155+0000 7f4fc229f700 1 -- 172.21.15.40:0/849459251 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fbc09fbb0 msgr2=0x7f4fbc08db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:19.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.155+0000 7f4fc229f700 1 --2- 172.21.15.40:0/849459251 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fbc09fbb0 0x7f4fbc08db40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400efc0 tx=0x7f4fb400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.155+0000 7f4fc229f700 1 -- 172.21.15.40:0/849459251 shutdown_connections 2023-09-30T22:27:19.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.155+0000 7f4fc229f700 1 --2- 172.21.15.40:0/849459251 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fbc09fbb0 0x7f4fbc08db40 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.155+0000 7f4fc229f700 1 --2- 172.21.15.40:0/849459251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fbc06ced0 0x7f4fbc08d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.155+0000 7f4fc229f700 1 --2- 172.21.15.40:0/849459251 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fbc06d2c0 0x7f4fbc08d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.155+0000 7f4fc229f700 1 -- 172.21.15.40:0/849459251 >> 172.21.15.40:0/849459251 conn(0x7f4fbc0a41a0 msgr2=0x7f4fbc0a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:19.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.155+0000 7f4fc229f700 1 -- 172.21.15.40:0/849459251 shutdown_connections 2023-09-30T22:27:19.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.155+0000 7f4fc229f700 1 -- 172.21.15.40:0/849459251 wait complete. 2023-09-30T22:27:19.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:19.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.193+0000 7f6070c9c700 1 -- 172.21.15.40:0/4092092234 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f606c09cb00 con 0x7f606c130fb0 2023-09-30T22:27:19.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.194+0000 7f605affd700 1 -- 172.21.15.40:0/4092092234 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6064021030 con 0x7f606c130fb0 2023-09-30T22:27:19.194 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:19.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.196+0000 7f6070c9c700 1 -- 172.21.15.40:0/4092092234 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f606c130fb0 msgr2=0x7f606c120010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:19.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.196+0000 7f6070c9c700 1 --2- 172.21.15.40:0/4092092234 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f606c130fb0 0x7f606c120010 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6064017000 tx=0x7f6064004ad0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.196+0000 7f6070c9c700 1 -- 172.21.15.40:0/4092092234 shutdown_connections 2023-09-30T22:27:19.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.196+0000 7f6070c9c700 1 --2- 172.21.15.40:0/4092092234 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f606c130fb0 0x7f606c120010 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.196+0000 7f6070c9c700 1 --2- 172.21.15.40:0/4092092234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f606c09d920 0x7f606c11f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.196+0000 7f6070c9c700 1 --2- 172.21.15.40:0/4092092234 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f606c09e230 0x7f606c11fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.196+0000 7f6070c9c700 1 -- 172.21.15.40:0/4092092234 >> 172.21.15.40:0/4092092234 conn(0x7f606c09fb20 msgr2=0x7f606c06df50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:19.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.196+0000 7f6070c9c700 1 -- 172.21.15.40:0/4092092234 shutdown_connections 2023-09-30T22:27:19.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.196+0000 7f6070c9c700 1 -- 172.21.15.40:0/4092092234 wait complete. 2023-09-30T22:27:19.209 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:19.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.236+0000 7f3b580fc700 1 -- 172.21.15.40:0/2068781922 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3b50062380 con 0x7f3b5009d920 2023-09-30T22:27:19.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.237+0000 7f3b467fc700 1 -- 172.21.15.40:0/2068781922 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3b4c03fe60 con 0x7f3b5009d920 2023-09-30T22:27:19.237 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:19.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.239+0000 7f3b580fc700 1 -- 172.21.15.40:0/2068781922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b5009d920 msgr2=0x7f3b5011e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:19.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.239+0000 7f3b580fc700 1 --2- 172.21.15.40:0/2068781922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b5009d920 0x7f3b5011e3d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c00e900 tx=0x7f3b4c00ec10 comp rx=0 tx=0).stop 2023-09-30T22:27:19.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.239+0000 7f3b580fc700 1 -- 172.21.15.40:0/2068781922 shutdown_connections 2023-09-30T22:27:19.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.239+0000 7f3b580fc700 1 --2- 172.21.15.40:0/2068781922 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b501317c0 0x7f3b5011ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.239+0000 7f3b580fc700 1 --2- 172.21.15.40:0/2068781922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b5009d920 0x7f3b5011e3d0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.239+0000 7f3b580fc700 1 --2- 172.21.15.40:0/2068781922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b50133ca0 0x7f3b5011e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.239+0000 7f3b580fc700 1 -- 172.21.15.40:0/2068781922 >> 172.21.15.40:0/2068781922 conn(0x7f3b5009fb20 msgr2=0x7f3b50133480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:19.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.239+0000 7f3b580fc700 1 -- 172.21.15.40:0/2068781922 shutdown_connections 2023-09-30T22:27:19.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:19.239+0000 7f3b580fc700 1 -- 172.21.15.40:0/2068781922 wait complete. 2023-09-30T22:27:19.251 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:20.134 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:20.169 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:20.210 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:20.252 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:20.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.288+0000 7f11a9730700 1 Processor -- start 2023-09-30T22:27:20.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.288+0000 7f11a9730700 1 -- start start 2023-09-30T22:27:20.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.289+0000 7f11a9730700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f11a4097bf0 0x7f11a4097fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:20.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.289+0000 7f11a9730700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f11a4098500 0x7f11a413c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:20.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.289+0000 7f11a9730700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f11a413c740 0x7f11a413eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:20.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.289+0000 7f11a9730700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11a4099720 con 0x7f11a4097bf0 2023-09-30T22:27:20.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.289+0000 7f11a9730700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a409ac40 con 0x7f11a413c740 2023-09-30T22:27:20.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.289+0000 7f11a9730700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11a406ca30 con 0x7f11a4098500 2023-09-30T22:27:20.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.289+0000 7f11a2ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f11a4097bf0 0x7f11a4097fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:20.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.289+0000 7f11a2ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f11a4097bf0 0x7f11a4097fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37108/0 (socket says 172.21.15.40:37108) 2023-09-30T22:27:20.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.289+0000 7f11a2ffd700 1 -- 172.21.15.40:0/2081265965 learned_addr learned my addr 172.21.15.40:0/2081265965 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:20.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.290+0000 7f11a27fc700 1 --2- 172.21.15.40:0/2081265965 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f11a4098500 0x7f11a413c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:20.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.290+0000 7f11a37fe700 1 --2- 172.21.15.40:0/2081265965 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f11a413c740 0x7f11a413eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:20.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.290+0000 7f11a27fc700 1 -- 172.21.15.40:0/2081265965 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f11a413c740 msgr2=0x7f11a413eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:20.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.290+0000 7f11a27fc700 1 --2- 172.21.15.40:0/2081265965 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f11a413c740 0x7f11a413eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.290+0000 7f11a27fc700 1 -- 172.21.15.40:0/2081265965 >> v2:172.21.15.40:3300/0 conn(0x7f11a4097bf0 msgr2=0x7f11a4097fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:20.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.290+0000 7f11a27fc700 1 --2- 172.21.15.40:0/2081265965 >> v2:172.21.15.40:3300/0 conn(0x7f11a4097bf0 0x7f11a4097fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.290+0000 7f11a27fc700 1 -- 172.21.15.40:0/2081265965 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a4098ec0 con 0x7f11a4098500 2023-09-30T22:27:20.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.290+0000 7f11a27fc700 1 --2- 172.21.15.40:0/2081265965 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f11a4098500 0x7f11a413c200 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1198009870 tx=0x7f1198009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da8ae7f6c0dde30f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:20.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.290+0000 7f11a1ffb700 1 -- 172.21.15.40:0/2081265965 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1198011830 con 0x7f11a4098500 2023-09-30T22:27:20.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.290+0000 7f11a1ffb700 1 -- 172.21.15.40:0/2081265965 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1198011990 con 0x7f11a4098500 2023-09-30T22:27:20.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.290+0000 7f11a1ffb700 1 -- 172.21.15.40:0/2081265965 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1198011d20 con 0x7f11a4098500 2023-09-30T22:27:20.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.291+0000 7f11a9730700 1 -- 172.21.15.40:0/2081265965 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f11a4098500 msgr2=0x7f11a413c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:20.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.291+0000 7f11a9730700 1 --2- 172.21.15.40:0/2081265965 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f11a4098500 0x7f11a413c200 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1198009870 tx=0x7f1198009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:20.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.292+0000 7f11a9730700 1 -- 172.21.15.40:0/2081265965 shutdown_connections 2023-09-30T22:27:20.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.292+0000 7f11a9730700 1 --2- 172.21.15.40:0/2081265965 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f11a413c740 0x7f11a413eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.292+0000 7f11a9730700 1 --2- 172.21.15.40:0/2081265965 >> v2:172.21.15.40:3300/0 conn(0x7f11a4097bf0 0x7f11a4097fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.292+0000 7f11a9730700 1 --2- 172.21.15.40:0/2081265965 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f11a4098500 0x7f11a413c200 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.292+0000 7f11a9730700 1 -- 172.21.15.40:0/2081265965 >> 172.21.15.40:0/2081265965 conn(0x7f11a40a2c70 msgr2=0x7f11a409eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:20.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.292+0000 7f11a9730700 1 -- 172.21.15.40:0/2081265965 shutdown_connections 2023-09-30T22:27:20.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.292+0000 7f11a9730700 1 -- 172.21.15.40:0/2081265965 wait complete. 2023-09-30T22:27:20.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.293+0000 7f11a9730700 1 Processor -- start 2023-09-30T22:27:20.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.293+0000 7f11a9730700 1 -- start start 2023-09-30T22:27:20.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.293+0000 7f11a9730700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f11a4097bf0 0x7f11a406f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:20.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.293+0000 7f11a9730700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f11a4098500 0x7f11a406f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:20.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.293+0000 7f11a9730700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11a413c740 0x7f11a406fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:20.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.293+0000 7f11a9730700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a4127b00 con 0x7f11a413c740 2023-09-30T22:27:20.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.293+0000 7f11a9730700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a4070ec0 con 0x7f11a4098500 2023-09-30T22:27:20.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.293+0000 7f11a9730700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11a4071360 con 0x7f11a4097bf0 2023-09-30T22:27:20.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.294+0000 7f11a27fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f11a4098500 0x7f11a406f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:20.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.294+0000 7f11a27fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f11a4098500 0x7f11a406f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42400/0 (socket says 172.21.15.40:42400) 2023-09-30T22:27:20.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.294+0000 7f11a27fc700 1 -- 172.21.15.40:0/1028445471 learned_addr learned my addr 172.21.15.40:0/1028445471 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:20.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.294+0000 7f11a2ffd700 1 --2- 172.21.15.40:0/1028445471 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f11a4097bf0 0x7f11a406f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:20.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.294+0000 7f11a37fe700 1 --2- 172.21.15.40:0/1028445471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11a413c740 0x7f11a406fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:20.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.294+0000 7f11a37fe700 1 -- 172.21.15.40:0/1028445471 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f11a4097bf0 msgr2=0x7f11a406f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:20.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.294+0000 7f11a37fe700 1 --2- 172.21.15.40:0/1028445471 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f11a4097bf0 0x7f11a406f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.294+0000 7f11a37fe700 1 -- 172.21.15.40:0/1028445471 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f11a4098500 msgr2=0x7f11a406f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:20.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.294+0000 7f11a37fe700 1 --2- 172.21.15.40:0/1028445471 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f11a4098500 0x7f11a406f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.294+0000 7f11a37fe700 1 -- 172.21.15.40:0/1028445471 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11980094a0 con 0x7f11a413c740 2023-09-30T22:27:20.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.294+0000 7f11a27fc700 1 --2- 172.21.15.40:0/1028445471 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f11a4098500 0x7f11a406f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:20.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.295+0000 7f11a37fe700 1 --2- 172.21.15.40:0/1028445471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11a413c740 0x7f11a406fc20 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f119c007d90 tx=0x7f119c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:20.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.295+0000 7f118b7fe700 1 -- 172.21.15.40:0/1028445471 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c018070 con 0x7f11a413c740 2023-09-30T22:27:20.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.295+0000 7f118b7fe700 1 -- 172.21.15.40:0/1028445471 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119c00eb30 con 0x7f11a413c740 2023-09-30T22:27:20.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.295+0000 7f11a9730700 1 -- 172.21.15.40:0/1028445471 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11a40715a0 con 0x7f11a413c740 2023-09-30T22:27:20.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.295+0000 7f118b7fe700 1 -- 172.21.15.40:0/1028445471 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c003a20 con 0x7f11a413c740 2023-09-30T22:27:20.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.295+0000 7f11a9730700 1 -- 172.21.15.40:0/1028445471 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a4127de0 con 0x7f11a413c740 2023-09-30T22:27:20.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.296+0000 7f11a9730700 1 -- 172.21.15.40:0/1028445471 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11a40a03f0 con 0x7f11a413c740 2023-09-30T22:27:20.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.296+0000 7f118b7fe700 1 -- 172.21.15.40:0/1028445471 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f119c014420 con 0x7f11a413c740 2023-09-30T22:27:20.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.297+0000 7f118b7fe700 1 -- 172.21.15.40:0/1028445471 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f119c03f630 con 0x7f11a413c740 2023-09-30T22:27:20.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.305+0000 7f118b7fe700 1 -- 172.21.15.40:0/1028445471 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f119c0146d0 con 0x7f11a413c740 2023-09-30T22:27:20.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.323+0000 7f8cbd56a700 1 Processor -- start 2023-09-30T22:27:20.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.323+0000 7f8cbd56a700 1 -- start start 2023-09-30T22:27:20.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.324+0000 7f8cbd56a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8cb8134a90 0x7f8cb8136e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:20.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.324+0000 7f8cbd56a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8cb81373b0 0x7f8cb8139790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:20.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.324+0000 7f8cbd56a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb8131900 con 0x7f8cb8131d50 2023-09-30T22:27:20.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.324+0000 7f8cbd56a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb80719b0 con 0x7f8cb81373b0 2023-09-30T22:27:20.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.324+0000 7f8cbd56a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb809e820 con 0x7f8cb8134a90 2023-09-30T22:27:20.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.324+0000 7f8cb6ffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8cb8131d50 0x7f8cb8132120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38238/0 (socket says 172.21.15.40:38238) 2023-09-30T22:27:20.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.324+0000 7f8cb6ffd700 1 -- 172.21.15.40:0/4158554135 learned_addr learned my addr 172.21.15.40:0/4158554135 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:27:20.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.324+0000 7f8cb67fc700 1 --2- 172.21.15.40:0/4158554135 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8cb8134a90 0x7f8cb8136e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:20.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.324+0000 7f8cb77fe700 1 --2- 172.21.15.40:0/4158554135 >> v2:172.21.15.40:3300/0 conn(0x7f8cb81373b0 0x7f8cb8139790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:20.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.324+0000 7f8cb67fc700 1 -- 172.21.15.40:0/4158554135 >> v2:172.21.15.40:3300/0 conn(0x7f8cb81373b0 msgr2=0x7f8cb8139790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:20.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.324+0000 7f8cb67fc700 1 --2- 172.21.15.40:0/4158554135 >> v2:172.21.15.40:3300/0 conn(0x7f8cb81373b0 0x7f8cb8139790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.324+0000 7f8cb67fc700 1 -- 172.21.15.40:0/4158554135 >> v1:172.21.15.40:6789/0 conn(0x7f8cb8131d50 legacy=0x7f8cb8132120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:20.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.324+0000 7f8cb67fc700 1 -- 172.21.15.40:0/4158554135 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb809ef60 con 0x7f8cb8134a90 2023-09-30T22:27:20.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.325+0000 7f8cb67fc700 1 --2- 172.21.15.40:0/4158554135 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8cb8134a90 0x7f8cb8136e70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8cac009840 tx=0x7f8cac009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a28426ca9a156fe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:20.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.325+0000 7f8cb5ffb700 1 -- 172.21.15.40:0/4158554135 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac011830 con 0x7f8cb8134a90 2023-09-30T22:27:20.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.325+0000 7f8cb5ffb700 1 -- 172.21.15.40:0/4158554135 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cac011990 con 0x7f8cb8134a90 2023-09-30T22:27:20.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.325+0000 7f8cb5ffb700 1 -- 172.21.15.40:0/4158554135 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac011d20 con 0x7f8cb8134a90 2023-09-30T22:27:20.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.326+0000 7f8cbd56a700 1 -- 172.21.15.40:0/4158554135 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8cb8134a90 msgr2=0x7f8cb8136e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:20.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.326+0000 7f8cbd56a700 1 --2- 172.21.15.40:0/4158554135 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8cb8134a90 0x7f8cb8136e70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8cac009840 tx=0x7f8cac009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:20.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.326+0000 7f8cbd56a700 1 -- 172.21.15.40:0/4158554135 shutdown_connections 2023-09-30T22:27:20.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.326+0000 7f8cbd56a700 1 --2- 172.21.15.40:0/4158554135 >> v2:172.21.15.40:3300/0 conn(0x7f8cb81373b0 0x7f8cb8139790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.326+0000 7f8cbd56a700 1 --2- 172.21.15.40:0/4158554135 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8cb8134a90 0x7f8cb8136e70 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.326+0000 7f8cbd56a700 1 -- 172.21.15.40:0/4158554135 >> 172.21.15.40:0/4158554135 conn(0x7f8cb80a2a00 msgr2=0x7f8cb80a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:20.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.326+0000 7f8cbd56a700 1 -- 172.21.15.40:0/4158554135 shutdown_connections 2023-09-30T22:27:20.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.326+0000 7f8cbd56a700 1 -- 172.21.15.40:0/4158554135 wait complete. 2023-09-30T22:27:20.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.327+0000 7f8cbd56a700 1 Processor -- start 2023-09-30T22:27:20.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.327+0000 7f8cbd56a700 1 -- start start 2023-09-30T22:27:20.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.328+0000 7f8cbd56a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8cb8131d50 0x7f8cb806e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:20.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.328+0000 7f8cbd56a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8cb8134a90 0x7f8cb806e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:20.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.328+0000 7f8cbd56a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8cb81373b0 0x7f8cb806ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:20.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.328+0000 7f8cbd56a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb8119a10 con 0x7f8cb8131d50 2023-09-30T22:27:20.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.328+0000 7f8cbd56a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb806fbc0 con 0x7f8cb8134a90 2023-09-30T22:27:20.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.328+0000 7f8cbd56a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb8119230 con 0x7f8cb81373b0 2023-09-30T22:27:20.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.328+0000 7f8cb6ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8cb8131d50 0x7f8cb806e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:20.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.328+0000 7f8cb6ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8cb8131d50 0x7f8cb806e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37134/0 (socket says 172.21.15.40:37134) 2023-09-30T22:27:20.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.328+0000 7f8cb6ffd700 1 -- 172.21.15.40:0/3295531198 learned_addr learned my addr 172.21.15.40:0/3295531198 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:20.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.328+0000 7f8cb77fe700 1 --2- 172.21.15.40:0/3295531198 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8cb81373b0 0x7f8cb806ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:20.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.328+0000 7f8cb6ffd700 1 -- 172.21.15.40:0/3295531198 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8cb81373b0 msgr2=0x7f8cb806ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:20.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.328+0000 7f8cb6ffd700 1 --2- 172.21.15.40:0/3295531198 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8cb81373b0 0x7f8cb806ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.328+0000 7f8cb6ffd700 1 -- 172.21.15.40:0/3295531198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8cb8134a90 msgr2=0x7f8cb806e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:20.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.328+0000 7f8cb6ffd700 1 --2- 172.21.15.40:0/3295531198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8cb8134a90 0x7f8cb806e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.328+0000 7f8cb6ffd700 1 -- 172.21.15.40:0/3295531198 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac0094a0 con 0x7f8cb8131d50 2023-09-30T22:27:20.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.328+0000 7f8cb6ffd700 1 --2- 172.21.15.40:0/3295531198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8cb8131d50 0x7f8cb806e290 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f8ca800c480 tx=0x7f8ca800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:20.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.329+0000 7f8c9f7fe700 1 -- 172.21.15.40:0/3295531198 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8005d70 con 0x7f8cb8131d50 2023-09-30T22:27:20.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.329+0000 7f8c9f7fe700 1 -- 172.21.15.40:0/3295531198 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca80070d0 con 0x7f8cb8131d50 2023-09-30T22:27:20.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.329+0000 7f8cbd56a700 1 -- 172.21.15.40:0/3295531198 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb8070a60 con 0x7f8cb8131d50 2023-09-30T22:27:20.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.329+0000 7f8c9f7fe700 1 -- 172.21.15.40:0/3295531198 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8007440 con 0x7f8cb8131d50 2023-09-30T22:27:20.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.329+0000 7f8cbd56a700 1 -- 172.21.15.40:0/3295531198 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb811cd90 con 0x7f8cb8131d50 2023-09-30T22:27:20.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.330+0000 7f8c9f7fe700 1 -- 172.21.15.40:0/3295531198 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8ca80075a0 con 0x7f8cb8131d50 2023-09-30T22:27:20.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.330+0000 7f8cbd56a700 1 -- 172.21.15.40:0/3295531198 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb809d400 con 0x7f8cb8131d50 2023-09-30T22:27:20.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.331+0000 7f8c9f7fe700 1 -- 172.21.15.40:0/3295531198 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f8ca8011cf0 con 0x7f8cb8131d50 2023-09-30T22:27:20.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.335+0000 7f8c9f7fe700 1 -- 172.21.15.40:0/3295531198 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ca8017030 con 0x7f8cb8131d50 2023-09-30T22:27:20.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.366+0000 7f865d5ab700 1 Processor -- start 2023-09-30T22:27:20.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.367+0000 7f865d5ab700 1 -- start start 2023-09-30T22:27:20.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.367+0000 7f865d5ab700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f865809d920 0x7f865809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:20.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.367+0000 7f865d5ab700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f86581343b0 0x7f865813bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:20.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.367+0000 7f865d5ab700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f865809f0f0 con 0x7f865809e230 2023-09-30T22:27:20.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.367+0000 7f865d5ab700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f865809a960 con 0x7f86581343b0 2023-09-30T22:27:20.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.367+0000 7f865d5ab700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f865809abd0 con 0x7f865809d920 2023-09-30T22:27:20.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.367+0000 7f8656ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f865809d920 0x7f865809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:20.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.367+0000 7f8656ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f865809d920 0x7f865809dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42412/0 (socket says 172.21.15.40:42412) 2023-09-30T22:27:20.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.367+0000 7f8656ffd700 1 -- 172.21.15.40:0/4031550443 learned_addr learned my addr 172.21.15.40:0/4031550443 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:20.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.367+0000 7f86577fe700 1 --2- 172.21.15.40:0/4031550443 >> v2:172.21.15.40:3300/0 conn(0x7f86581343b0 0x7f865813bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:20.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.368+0000 7f86577fe700 1 -- 172.21.15.40:0/4031550443 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f865809d920 msgr2=0x7f865809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:20.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.368+0000 7f86577fe700 1 --2- 172.21.15.40:0/4031550443 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f865809d920 0x7f865809dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.368+0000 7f86577fe700 1 -- 172.21.15.40:0/4031550443 >> v1:172.21.15.40:6789/0 conn(0x7f865809e230 legacy=0x7f8658133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:20.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.368+0000 7f86577fe700 1 -- 172.21.15.40:0/4031550443 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865806b500 con 0x7f86581343b0 2023-09-30T22:27:20.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.368+0000 7f8655ffb700 1 -- 172.21.15.40:0/4031550443 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1562497832 0 0) 0x7f865809f0f0 con 0x7f865809e230 2023-09-30T22:27:20.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.368+0000 7f86577fe700 1 --2- 172.21.15.40:0/4031550443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86581343b0 0x7f865813bf00 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f8650009d90 tx=0x7f865000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e73740b41f60ea server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:20.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.368+0000 7f8655ffb700 1 -- 172.21.15.40:0/4031550443 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865000e070 con 0x7f86581343b0 2023-09-30T22:27:20.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.368+0000 7f8655ffb700 1 -- 172.21.15.40:0/4031550443 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865000bb20 con 0x7f86581343b0 2023-09-30T22:27:20.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.368+0000 7f8655ffb700 1 -- 172.21.15.40:0/4031550443 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8650012430 con 0x7f86581343b0 2023-09-30T22:27:20.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.369+0000 7f865d5ab700 1 -- 172.21.15.40:0/4031550443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86581343b0 msgr2=0x7f865813bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:20.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.369+0000 7f865d5ab700 1 --2- 172.21.15.40:0/4031550443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86581343b0 0x7f865813bf00 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f8650009d90 tx=0x7f865000b330 comp rx=0 tx=0).stop 2023-09-30T22:27:20.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.369+0000 7f865d5ab700 1 -- 172.21.15.40:0/4031550443 shutdown_connections 2023-09-30T22:27:20.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.369+0000 7f865d5ab700 1 --2- 172.21.15.40:0/4031550443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86581343b0 0x7f865813bf00 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.369+0000 7f865d5ab700 1 --2- 172.21.15.40:0/4031550443 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f865809d920 0x7f865809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.369+0000 7f865d5ab700 1 -- 172.21.15.40:0/4031550443 >> 172.21.15.40:0/4031550443 conn(0x7f865809fb20 msgr2=0x7f865809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:20.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.369+0000 7f865d5ab700 1 -- 172.21.15.40:0/4031550443 shutdown_connections 2023-09-30T22:27:20.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.369+0000 7f865d5ab700 1 -- 172.21.15.40:0/4031550443 wait complete. 2023-09-30T22:27:20.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.370+0000 7f865d5ab700 1 Processor -- start 2023-09-30T22:27:20.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.370+0000 7f865d5ab700 1 -- start start 2023-09-30T22:27:20.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.371+0000 7f865d5ab700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f865809d920 0x7f86581c9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:20.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.371+0000 7f865d5ab700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f865809e230 0x7f86581cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:20.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.371+0000 7f865d5ab700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86581343b0 0x7f86581ce640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:20.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.371+0000 7f865d5ab700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8658125220 con 0x7f86581343b0 2023-09-30T22:27:20.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.371+0000 7f865d5ab700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86581265f0 con 0x7f865809e230 2023-09-30T22:27:20.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.371+0000 7f865d5ab700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8658124930 con 0x7f865809d920 2023-09-30T22:27:20.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.371+0000 7f86567fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f865809e230 0x7f86581cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:20.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.371+0000 7f86567fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f865809e230 0x7f86581cc0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42426/0 (socket says 172.21.15.40:42426) 2023-09-30T22:27:20.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.371+0000 7f86567fc700 1 -- 172.21.15.40:0/1825510204 learned_addr learned my addr 172.21.15.40:0/1825510204 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:20.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.371+0000 7f86577fe700 1 --2- 172.21.15.40:0/1825510204 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86581343b0 0x7f86581ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:20.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.371+0000 7f8656ffd700 1 --2- 172.21.15.40:0/1825510204 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f865809d920 0x7f86581c9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:20.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.372+0000 7f86567fc700 1 -- 172.21.15.40:0/1825510204 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f865809d920 msgr2=0x7f86581c9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:20.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.372+0000 7f86567fc700 1 --2- 172.21.15.40:0/1825510204 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f865809d920 0x7f86581c9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.372+0000 7f86567fc700 1 -- 172.21.15.40:0/1825510204 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86581343b0 msgr2=0x7f86581ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:20.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.372+0000 7f86567fc700 1 --2- 172.21.15.40:0/1825510204 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86581343b0 0x7f86581ce640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.372+0000 7f86567fc700 1 -- 172.21.15.40:0/1825510204 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8650009a70 con 0x7f865809e230 2023-09-30T22:27:20.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.372+0000 7f86567fc700 1 --2- 172.21.15.40:0/1825510204 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f865809e230 0x7f86581cc0f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f864c00c550 tx=0x7f864c00c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:20.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.372+0000 7f863f7fe700 1 -- 172.21.15.40:0/1825510204 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c0054e0 con 0x7f865809e230 2023-09-30T22:27:20.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.372+0000 7f863f7fe700 1 -- 172.21.15.40:0/1825510204 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864c003680 con 0x7f865809e230 2023-09-30T22:27:20.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.372+0000 7f863f7fe700 1 -- 172.21.15.40:0/1825510204 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c003a30 con 0x7f865809e230 2023-09-30T22:27:20.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.372+0000 7f865d5ab700 1 -- 172.21.15.40:0/1825510204 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8658124ee0 con 0x7f865809e230 2023-09-30T22:27:20.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.372+0000 7f865d5ab700 1 -- 172.21.15.40:0/1825510204 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86581255a0 con 0x7f865809e230 2023-09-30T22:27:20.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.373+0000 7f865d5ab700 1 -- 172.21.15.40:0/1825510204 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8658126450 con 0x7f865809e230 2023-09-30T22:27:20.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.373+0000 7f863f7fe700 1 -- 172.21.15.40:0/1825510204 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f864c003b90 con 0x7f865809e230 2023-09-30T22:27:20.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.373+0000 7f863f7fe700 1 -- 172.21.15.40:0/1825510204 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f864c03eb10 con 0x7f865809e230 2023-09-30T22:27:20.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.378+0000 7f863f7fe700 1 -- 172.21.15.40:0/1825510204 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8658126450 con 0x7f865809e230 2023-09-30T22:27:20.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.453+0000 7f4d06894700 1 Processor -- start 2023-09-30T22:27:20.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.453+0000 7f4d06894700 1 -- start start 2023-09-30T22:27:20.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.454+0000 7f4d06894700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4d0009c890 0x7f4d0009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:20.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.454+0000 7f4d06894700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d0009e480 0x7f4d0013bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:20.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.454+0000 7f4d06894700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d000a2600 con 0x7f4d0009d920 2023-09-30T22:27:20.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.454+0000 7f4d06894700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d000a29d0 con 0x7f4d0009e480 2023-09-30T22:27:20.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.454+0000 7f4d06894700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0009fb40 con 0x7f4d0009c890 2023-09-30T22:27:20.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.454+0000 7f4cff7fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f4d0009d920 0x7f4d0009dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38262/0 (socket says 172.21.15.40:38262) 2023-09-30T22:27:20.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.454+0000 7f4cff7fe700 1 -- 172.21.15.40:0/1868447145 learned_addr learned my addr 172.21.15.40:0/1868447145 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:27:20.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.454+0000 7f4d04e31700 1 --2- 172.21.15.40:0/1868447145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d0009e480 0x7f4d0013bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:20.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.454+0000 7f4cfffff700 1 --2- 172.21.15.40:0/1868447145 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4d0009c890 0x7f4d0009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:20.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.454+0000 7f4cfeffd700 1 -- 172.21.15.40:0/1868447145 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3091872924 0 0) 0x7f4d000a2600 con 0x7f4d0009d920 2023-09-30T22:27:20.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.454+0000 7f4cfeffd700 1 -- 172.21.15.40:0/1868447145 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ce80035b0 con 0x7f4d0009d920 2023-09-30T22:27:20.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.454+0000 7f4cfffff700 1 -- 172.21.15.40:0/1868447145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d0009e480 msgr2=0x7f4d0013bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:20.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.454+0000 7f4cfffff700 1 --2- 172.21.15.40:0/1868447145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d0009e480 0x7f4d0013bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.454+0000 7f4cfffff700 1 -- 172.21.15.40:0/1868447145 >> v1:172.21.15.40:6789/0 conn(0x7f4d0009d920 legacy=0x7f4d0009dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:20.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.454+0000 7f4cfffff700 1 -- 172.21.15.40:0/1868447145 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0009fed0 con 0x7f4d0009c890 2023-09-30T22:27:20.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.454+0000 7f4cfffff700 1 --2- 172.21.15.40:0/1868447145 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4d0009c890 0x7f4d0009cc60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0009850 tx=0x7f4cf0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92da0bbb070a773b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:20.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.455+0000 7f4cfeffd700 1 -- 172.21.15.40:0/1868447145 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0005e30 con 0x7f4d0009c890 2023-09-30T22:27:20.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.455+0000 7f4cfeffd700 1 -- 172.21.15.40:0/1868447145 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf0006030 con 0x7f4d0009c890 2023-09-30T22:27:20.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.455+0000 7f4cfeffd700 1 -- 172.21.15.40:0/1868447145 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf00063e0 con 0x7f4d0009c890 2023-09-30T22:27:20.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.455+0000 7f4d06894700 1 -- 172.21.15.40:0/1868447145 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4d0009c890 msgr2=0x7f4d0009cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:20.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.455+0000 7f4d06894700 1 --2- 172.21.15.40:0/1868447145 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4d0009c890 0x7f4d0009cc60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0009850 tx=0x7f4cf0009b60 comp rx=0 tx=0).stop 2023-09-30T22:27:20.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.456+0000 7f4d06894700 1 -- 172.21.15.40:0/1868447145 shutdown_connections 2023-09-30T22:27:20.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.456+0000 7f4d06894700 1 --2- 172.21.15.40:0/1868447145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d0009e480 0x7f4d0013bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.456+0000 7f4d06894700 1 --2- 172.21.15.40:0/1868447145 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4d0009c890 0x7f4d0009cc60 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.456+0000 7f4d06894700 1 -- 172.21.15.40:0/1868447145 >> 172.21.15.40:0/1868447145 conn(0x7f4d000a7080 msgr2=0x7f4d000a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:20.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.456+0000 7f4d06894700 1 -- 172.21.15.40:0/1868447145 shutdown_connections 2023-09-30T22:27:20.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.456+0000 7f4d06894700 1 -- 172.21.15.40:0/1868447145 wait complete. 2023-09-30T22:27:20.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.457+0000 7f4d06894700 1 Processor -- start 2023-09-30T22:27:20.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.457+0000 7f4d06894700 1 -- start start 2023-09-30T22:27:20.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.457+0000 7f4d06894700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d0009c890 0x7f4d0012d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:20.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.457+0000 7f4d06894700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4d0009d920 0x7f4d0012d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:20.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.457+0000 7f4d06894700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d0009e480 0x7f4d0012de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:20.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.457+0000 7f4d06894700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0012e780 con 0x7f4d0009c890 2023-09-30T22:27:20.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.457+0000 7f4d06894700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0012ec30 con 0x7f4d0009e480 2023-09-30T22:27:20.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.457+0000 7f4d06894700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0009ecf0 con 0x7f4d0009d920 2023-09-30T22:27:20.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.457+0000 7f4cff7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4d0009d920 0x7f4d0012d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:20.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.457+0000 7f4cff7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4d0009d920 0x7f4d0012d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56238/0 (socket says 172.21.15.40:56238) 2023-09-30T22:27:20.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.457+0000 7f4cff7fe700 1 -- 172.21.15.40:0/3105393960 learned_addr learned my addr 172.21.15.40:0/3105393960 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:20.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.457+0000 7f4cfffff700 1 --2- 172.21.15.40:0/3105393960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d0009c890 0x7f4d0012d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:20.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.458+0000 7f4d04e31700 1 --2- 172.21.15.40:0/3105393960 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d0009e480 0x7f4d0012de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:20.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.458+0000 7f4cff7fe700 1 -- 172.21.15.40:0/3105393960 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d0009e480 msgr2=0x7f4d0012de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:20.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.458+0000 7f4cff7fe700 1 --2- 172.21.15.40:0/3105393960 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d0009e480 0x7f4d0012de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.458+0000 7f4cff7fe700 1 -- 172.21.15.40:0/3105393960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d0009c890 msgr2=0x7f4d0012d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:20.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.458+0000 7f4cff7fe700 1 --2- 172.21.15.40:0/3105393960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d0009c890 0x7f4d0012d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.458+0000 7f4cff7fe700 1 -- 172.21.15.40:0/3105393960 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf0009430 con 0x7f4d0009d920 2023-09-30T22:27:20.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.458+0000 7f4cff7fe700 1 --2- 172.21.15.40:0/3105393960 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4d0009d920 0x7f4d0012d8f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4005910 tx=0x7f4cf400c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:20.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.458+0000 7f4cfcff9700 1 -- 172.21.15.40:0/3105393960 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4005d70 con 0x7f4d0009d920 2023-09-30T22:27:20.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.458+0000 7f4cfcff9700 1 -- 172.21.15.40:0/3105393960 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf40070d0 con 0x7f4d0009d920 2023-09-30T22:27:20.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.458+0000 7f4cfcff9700 1 -- 172.21.15.40:0/3105393960 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4007440 con 0x7f4d0009d920 2023-09-30T22:27:20.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.458+0000 7f4d06894700 1 -- 172.21.15.40:0/3105393960 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d0012eed0 con 0x7f4d0009d920 2023-09-30T22:27:20.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.458+0000 7f4d06894700 1 -- 172.21.15.40:0/3105393960 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d001307a0 con 0x7f4d0009d920 2023-09-30T22:27:20.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.460+0000 7f4d06894700 1 -- 172.21.15.40:0/3105393960 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d00062380 con 0x7f4d0009d920 2023-09-30T22:27:20.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.460+0000 7f4cfcff9700 1 -- 172.21.15.40:0/3105393960 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4cf40075a0 con 0x7f4d0009d920 2023-09-30T22:27:20.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.460+0000 7f4cfcff9700 1 -- 172.21.15.40:0/3105393960 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4cf403ec60 con 0x7f4d0009d920 2023-09-30T22:27:20.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.469+0000 7f4cfcff9700 1 -- 172.21.15.40:0/3105393960 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4cf4019d20 con 0x7f4d0009d920 2023-09-30T22:27:20.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.542+0000 7f8cbd56a700 1 -- 172.21.15.40:0/3295531198 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8cb8071700 con 0x7f8cb8131d50 2023-09-30T22:27:20.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.542+0000 7f8c9f7fe700 1 -- 172.21.15.40:0/3295531198 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8cb811cd90 con 0x7f8cb8131d50 2023-09-30T22:27:20.543 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:20.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.545+0000 7f8cbd56a700 1 -- 172.21.15.40:0/3295531198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8cb8131d50 msgr2=0x7f8cb806e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:20.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.545+0000 7f8cbd56a700 1 --2- 172.21.15.40:0/3295531198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8cb8131d50 0x7f8cb806e290 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f8ca800c480 tx=0x7f8ca800c790 comp rx=0 tx=0).stop 2023-09-30T22:27:20.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.545+0000 7f8cbd56a700 1 -- 172.21.15.40:0/3295531198 shutdown_connections 2023-09-30T22:27:20.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.545+0000 7f8cbd56a700 1 --2- 172.21.15.40:0/3295531198 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8cb81373b0 0x7f8cb806ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.545+0000 7f8cbd56a700 1 --2- 172.21.15.40:0/3295531198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8cb8131d50 0x7f8cb806e290 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.545+0000 7f8cbd56a700 1 --2- 172.21.15.40:0/3295531198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8cb8134a90 0x7f8cb806e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.545+0000 7f8cbd56a700 1 -- 172.21.15.40:0/3295531198 >> 172.21.15.40:0/3295531198 conn(0x7f8cb80a2a00 msgr2=0x7f8cb809f360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:20.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.546+0000 7f8cbd56a700 1 -- 172.21.15.40:0/3295531198 shutdown_connections 2023-09-30T22:27:20.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.548+0000 7f8cbd56a700 1 -- 172.21.15.40:0/3295531198 wait complete. 2023-09-30T22:27:20.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:20.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.574+0000 7f11a9730700 1 -- 172.21.15.40:0/1028445471 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f11a4062380 con 0x7f11a413c740 2023-09-30T22:27:20.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.575+0000 7f118b7fe700 1 -- 172.21.15.40:0/1028445471 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f119c01c370 con 0x7f11a413c740 2023-09-30T22:27:20.575 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:20.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.577+0000 7f11a9730700 1 -- 172.21.15.40:0/1028445471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11a413c740 msgr2=0x7f11a406fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:20.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.577+0000 7f11a9730700 1 --2- 172.21.15.40:0/1028445471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11a413c740 0x7f11a406fc20 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f119c007d90 tx=0x7f119c00e3c0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.577+0000 7f11a9730700 1 -- 172.21.15.40:0/1028445471 shutdown_connections 2023-09-30T22:27:20.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.577+0000 7f11a9730700 1 --2- 172.21.15.40:0/1028445471 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f11a4097bf0 0x7f11a406f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.577+0000 7f11a9730700 1 --2- 172.21.15.40:0/1028445471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11a413c740 0x7f11a406fc20 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.577+0000 7f11a9730700 1 --2- 172.21.15.40:0/1028445471 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f11a4098500 0x7f11a406f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.577+0000 7f11a9730700 1 -- 172.21.15.40:0/1028445471 >> 172.21.15.40:0/1028445471 conn(0x7f11a40a2c70 msgr2=0x7f11a409c960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:20.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.577+0000 7f11a9730700 1 -- 172.21.15.40:0/1028445471 shutdown_connections 2023-09-30T22:27:20.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.577+0000 7f11a9730700 1 -- 172.21.15.40:0/1028445471 wait complete. 2023-09-30T22:27:20.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.589+0000 7f865d5ab700 1 -- 172.21.15.40:0/1825510204 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8658126450 con 0x7f865809e230 2023-09-30T22:27:20.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.590+0000 7f863f7fe700 1 -- 172.21.15.40:0/1825510204 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8658126450 con 0x7f865809e230 2023-09-30T22:27:20.591 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:20.591 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:20.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.592+0000 7f865d5ab700 1 -- 172.21.15.40:0/1825510204 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f865809e230 msgr2=0x7f86581cc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:20.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.592+0000 7f865d5ab700 1 --2- 172.21.15.40:0/1825510204 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f865809e230 0x7f86581cc0f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f864c00c550 tx=0x7f864c00c860 comp rx=0 tx=0).stop 2023-09-30T22:27:20.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.592+0000 7f865d5ab700 1 -- 172.21.15.40:0/1825510204 shutdown_connections 2023-09-30T22:27:20.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.592+0000 7f865d5ab700 1 --2- 172.21.15.40:0/1825510204 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f865809d920 0x7f86581c9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.592+0000 7f865d5ab700 1 --2- 172.21.15.40:0/1825510204 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86581343b0 0x7f86581ce640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.592+0000 7f865d5ab700 1 --2- 172.21.15.40:0/1825510204 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f865809e230 0x7f86581cc0f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.592+0000 7f865d5ab700 1 -- 172.21.15.40:0/1825510204 >> 172.21.15.40:0/1825510204 conn(0x7f865809fb20 msgr2=0x7f865806e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:20.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.592+0000 7f865d5ab700 1 -- 172.21.15.40:0/1825510204 shutdown_connections 2023-09-30T22:27:20.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.592+0000 7f865d5ab700 1 -- 172.21.15.40:0/1825510204 wait complete. 2023-09-30T22:27:20.604 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:20.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.671+0000 7f4d06894700 1 -- 172.21.15.40:0/3105393960 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4d00074620 con 0x7f4d0009d920 2023-09-30T22:27:20.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.672+0000 7f4cfcff9700 1 -- 172.21.15.40:0/3105393960 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4cf4017020 con 0x7f4d0009d920 2023-09-30T22:27:20.672 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:20.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.674+0000 7f4d06894700 1 -- 172.21.15.40:0/3105393960 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4d0009d920 msgr2=0x7f4d0012d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:20.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.674+0000 7f4d06894700 1 --2- 172.21.15.40:0/3105393960 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4d0009d920 0x7f4d0012d8f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4005910 tx=0x7f4cf400c9e0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.674+0000 7f4d06894700 1 -- 172.21.15.40:0/3105393960 shutdown_connections 2023-09-30T22:27:20.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.674+0000 7f4d06894700 1 --2- 172.21.15.40:0/3105393960 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d0009e480 0x7f4d0012de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.674+0000 7f4d06894700 1 --2- 172.21.15.40:0/3105393960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d0009c890 0x7f4d0012d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.674+0000 7f4d06894700 1 --2- 172.21.15.40:0/3105393960 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4d0009d920 0x7f4d0012d8f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.674+0000 7f4d06894700 1 -- 172.21.15.40:0/3105393960 >> 172.21.15.40:0/3105393960 conn(0x7f4d000a7080 msgr2=0x7f4d000a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:20.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.674+0000 7f4d06894700 1 -- 172.21.15.40:0/3105393960 shutdown_connections 2023-09-30T22:27:20.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:20.674+0000 7f4d06894700 1 -- 172.21.15.40:0/3105393960 wait complete. 2023-09-30T22:27:20.687 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:21.567 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:21.591 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:21.605 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:21.688 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:21.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.714+0000 7f3927b78700 1 Processor -- start 2023-09-30T22:27:21.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.714+0000 7f3927b78700 1 -- start start 2023-09-30T22:27:21.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.715+0000 7f3927b78700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f392012e590 0x7f392012e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.715+0000 7f3927b78700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f392012eea0 0x7f392012d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.715+0000 7f3927b78700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f392009ab70 con 0x7f392012d6d0 2023-09-30T22:27:21.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.715+0000 7f3927b78700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f392009b270 con 0x7f392012e590 2023-09-30T22:27:21.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.715+0000 7f3927b78700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f392009bab0 con 0x7f392012eea0 2023-09-30T22:27:21.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.715+0000 7f3925113700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f392012eea0 0x7f392012d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.715+0000 7f3925113700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f392012eea0 0x7f392012d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42458/0 (socket says 172.21.15.40:42458) 2023-09-30T22:27:21.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.715+0000 7f3925113700 1 -- 172.21.15.40:0/1125502121 learned_addr learned my addr 172.21.15.40:0/1125502121 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:21.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.715+0000 7f3925113700 1 -- 172.21.15.40:0/1125502121 >> v2:172.21.15.40:3300/0 conn(0x7f392012e590 msgr2=0x7f392012e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:21.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.715+0000 7f3925113700 1 --2- 172.21.15.40:0/1125502121 >> v2:172.21.15.40:3300/0 conn(0x7f392012e590 0x7f392012e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.715+0000 7f3925113700 1 -- 172.21.15.40:0/1125502121 >> v1:172.21.15.40:6789/0 conn(0x7f392012d6d0 legacy=0x7f3920137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:21.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.715+0000 7f3925113700 1 -- 172.21.15.40:0/1125502121 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392009bd70 con 0x7f392012eea0 2023-09-30T22:27:21.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.715+0000 7f3925113700 1 --2- 172.21.15.40:0/1125502121 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f392012eea0 0x7f392012d190 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3910009920 tx=0x7f3910009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43c79c8cbcd0723c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:21.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.715+0000 7f3924912700 1 -- 172.21.15.40:0/1125502121 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3910004230 con 0x7f392012eea0 2023-09-30T22:27:21.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.716+0000 7f3924912700 1 -- 172.21.15.40:0/1125502121 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3910004390 con 0x7f392012eea0 2023-09-30T22:27:21.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.716+0000 7f3924912700 1 -- 172.21.15.40:0/1125502121 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3910009e70 con 0x7f392012eea0 2023-09-30T22:27:21.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.716+0000 7f3927b78700 1 -- 172.21.15.40:0/1125502121 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f392012eea0 msgr2=0x7f392012d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:21.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.716+0000 7f3927b78700 1 --2- 172.21.15.40:0/1125502121 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f392012eea0 0x7f392012d190 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3910009920 tx=0x7f3910009c30 comp rx=0 tx=0).stop 2023-09-30T22:27:21.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.716+0000 7f3927b78700 1 -- 172.21.15.40:0/1125502121 shutdown_connections 2023-09-30T22:27:21.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.716+0000 7f3927b78700 1 --2- 172.21.15.40:0/1125502121 >> v2:172.21.15.40:3300/0 conn(0x7f392012e590 0x7f392012e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.716+0000 7f3927b78700 1 --2- 172.21.15.40:0/1125502121 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f392012eea0 0x7f392012d190 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.716+0000 7f3927b78700 1 -- 172.21.15.40:0/1125502121 >> 172.21.15.40:0/1125502121 conn(0x7f39200a2a00 msgr2=0x7f39200a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:21.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.716+0000 7f3927b78700 1 -- 172.21.15.40:0/1125502121 shutdown_connections 2023-09-30T22:27:21.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.717+0000 7f3927b78700 1 -- 172.21.15.40:0/1125502121 wait complete. 2023-09-30T22:27:21.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.717+0000 7f3927b78700 1 Processor -- start 2023-09-30T22:27:21.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.718+0000 7f3927b78700 1 -- start start 2023-09-30T22:27:21.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.718+0000 7f3927b78700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f392012d6d0 0x7f392013b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.718+0000 7f3927b78700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f392012e590 0x7f392013bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.718+0000 7f3927b78700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f392012eea0 0x7f39201c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.718+0000 7f3927b78700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392013a3b0 con 0x7f392012eea0 2023-09-30T22:27:21.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.718+0000 7f3927b78700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f392012d010 con 0x7f392012d6d0 2023-09-30T22:27:21.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.718+0000 7f3927b78700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39200708f0 con 0x7f392012e590 2023-09-30T22:27:21.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.718+0000 7f3926115700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f392012eea0 0x7f39201c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.718+0000 7f3926115700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f392012eea0 0x7f39201c8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37174/0 (socket says 172.21.15.40:37174) 2023-09-30T22:27:21.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.718+0000 7f3926115700 1 -- 172.21.15.40:0/410005659 learned_addr learned my addr 172.21.15.40:0/410005659 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:21.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.718+0000 7f3925113700 1 --2- 172.21.15.40:0/410005659 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f392012e590 0x7f392013bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.719+0000 7f3925914700 1 --2- 172.21.15.40:0/410005659 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f392012d6d0 0x7f392013b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.719+0000 7f3926115700 1 -- 172.21.15.40:0/410005659 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f392012e590 msgr2=0x7f392013bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:21.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.719+0000 7f3926115700 1 --2- 172.21.15.40:0/410005659 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f392012e590 0x7f392013bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.719+0000 7f3926115700 1 -- 172.21.15.40:0/410005659 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f392012d6d0 msgr2=0x7f392013b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:21.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.719+0000 7f3926115700 1 --2- 172.21.15.40:0/410005659 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f392012d6d0 0x7f392013b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.719+0000 7f3926115700 1 -- 172.21.15.40:0/410005659 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3910009550 con 0x7f392012eea0 2023-09-30T22:27:21.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.719+0000 7f3926115700 1 --2- 172.21.15.40:0/410005659 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f392012eea0 0x7f39201c8580 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f391800c7a0 tx=0x7f391800cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:21.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.719+0000 7f39167fc700 1 -- 172.21.15.40:0/410005659 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3918003e10 con 0x7f392012eea0 2023-09-30T22:27:21.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.719+0000 7f39167fc700 1 -- 172.21.15.40:0/410005659 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3918005070 con 0x7f392012eea0 2023-09-30T22:27:21.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.719+0000 7f3927b78700 1 -- 172.21.15.40:0/410005659 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f392006fa90 con 0x7f392012eea0 2023-09-30T22:27:21.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.719+0000 7f3927b78700 1 -- 172.21.15.40:0/410005659 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f392009b4b0 con 0x7f392012eea0 2023-09-30T22:27:21.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.720+0000 7f39167fc700 1 -- 172.21.15.40:0/410005659 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3918005420 con 0x7f392012eea0 2023-09-30T22:27:21.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.720+0000 7f39167fc700 1 -- 172.21.15.40:0/410005659 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3918005580 con 0x7f392012eea0 2023-09-30T22:27:21.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.720+0000 7f39167fc700 1 -- 172.21.15.40:0/410005659 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f391803ee30 con 0x7f392012eea0 2023-09-30T22:27:21.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.721+0000 7f3927b78700 1 -- 172.21.15.40:0/410005659 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39080052e0 con 0x7f392012eea0 2023-09-30T22:27:21.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.730+0000 7f39167fc700 1 -- 172.21.15.40:0/410005659 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3918017080 con 0x7f392012eea0 2023-09-30T22:27:21.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.754+0000 7fbcf353e700 1 Processor -- start 2023-09-30T22:27:21.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.754+0000 7fbcf353e700 1 -- start start 2023-09-30T22:27:21.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.754+0000 7fbcf353e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcec06f070 0x7fbcec06f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.754+0000 7fbcf353e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbcec06f980 0x7fbcec097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.754+0000 7fbcf353e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbcec06fdb0 0x7fbcec0975d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.754+0000 7fbcf353e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcec070830 con 0x7fbcec06f980 2023-09-30T22:27:21.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.754+0000 7fbcf353e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcec070ad0 con 0x7fbcec06f070 2023-09-30T22:27:21.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.754+0000 7fbcf353e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbcec070de0 con 0x7fbcec06fdb0 2023-09-30T22:27:21.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.754+0000 7fbcf0ad9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbcec06f980 0x7fbcec097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.754+0000 7fbcf1adb700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbcec06fdb0 0x7fbcec0975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.754+0000 7fbcf0ad9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbcec06f980 0x7fbcec097090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37188/0 (socket says 172.21.15.40:37188) 2023-09-30T22:27:21.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.755+0000 7fbcf0ad9700 1 -- 172.21.15.40:0/1233806571 learned_addr learned my addr 172.21.15.40:0/1233806571 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:21.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.755+0000 7fbcf0ad9700 1 -- 172.21.15.40:0/1233806571 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbcec06fdb0 msgr2=0x7fbcec0975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:21.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.755+0000 7fbcf0ad9700 1 --2- 172.21.15.40:0/1233806571 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbcec06fdb0 0x7fbcec0975d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.755+0000 7fbcf0ad9700 1 -- 172.21.15.40:0/1233806571 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcec06f070 msgr2=0x7fbcec06f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:21.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.755+0000 7fbcf12da700 1 --2- 172.21.15.40:0/1233806571 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcec06f070 0x7fbcec06f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.755+0000 7fbcf0ad9700 1 --2- 172.21.15.40:0/1233806571 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcec06f070 0x7fbcec06f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.755+0000 7fbcf0ad9700 1 -- 172.21.15.40:0/1233806571 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcec09fe20 con 0x7fbcec06f980 2023-09-30T22:27:21.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.755+0000 7fbcf1adb700 1 --2- 172.21.15.40:0/1233806571 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbcec06fdb0 0x7fbcec0975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:21.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.755+0000 7fbcf12da700 1 --2- 172.21.15.40:0/1233806571 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcec06f070 0x7fbcec06f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:27:21.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.755+0000 7fbcf0ad9700 1 --2- 172.21.15.40:0/1233806571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcec06f980 0x7fbcec097090 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc0098f0 tx=0x7fbcdc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e957e92d6fe3db4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:21.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.755+0000 7fbce3fff700 1 -- 172.21.15.40:0/1233806571 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc011830 con 0x7fbcec06f980 2023-09-30T22:27:21.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.755+0000 7fbce3fff700 1 -- 172.21.15.40:0/1233806571 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcdc011990 con 0x7fbcec06f980 2023-09-30T22:27:21.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.755+0000 7fbce3fff700 1 -- 172.21.15.40:0/1233806571 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc011d20 con 0x7fbcec06f980 2023-09-30T22:27:21.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.756+0000 7fbcf353e700 1 -- 172.21.15.40:0/1233806571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcec06f980 msgr2=0x7fbcec097090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:21.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.756+0000 7fbcf353e700 1 --2- 172.21.15.40:0/1233806571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcec06f980 0x7fbcec097090 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc0098f0 tx=0x7fbcdc009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:21.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.756+0000 7fbcf353e700 1 -- 172.21.15.40:0/1233806571 shutdown_connections 2023-09-30T22:27:21.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.756+0000 7fbcf353e700 1 --2- 172.21.15.40:0/1233806571 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbcec06fdb0 0x7fbcec0975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.756+0000 7fbcf353e700 1 --2- 172.21.15.40:0/1233806571 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcec06f070 0x7fbcec06f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.756+0000 7fbcf353e700 1 --2- 172.21.15.40:0/1233806571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcec06f980 0x7fbcec097090 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.756+0000 7fbcf353e700 1 -- 172.21.15.40:0/1233806571 >> 172.21.15.40:0/1233806571 conn(0x7fbcec0a41a0 msgr2=0x7fbcec0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:21.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.756+0000 7f387dfee700 1 Processor -- start 2023-09-30T22:27:21.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.756+0000 7f387dfee700 1 -- start start 2023-09-30T22:27:21.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.757+0000 7fbcf353e700 1 -- 172.21.15.40:0/1233806571 shutdown_connections 2023-09-30T22:27:21.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.757+0000 7f387dfee700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f387809d450 0x7f387809d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.757+0000 7fbcf353e700 1 -- 172.21.15.40:0/1233806571 wait complete. 2023-09-30T22:27:21.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.757+0000 7f387dfee700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f387809dd60 0x7f38781301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.757+0000 7f387dfee700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f387809c3b0 con 0x7f3878130700 2023-09-30T22:27:21.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.757+0000 7f387dfee700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f387809a6b0 con 0x7f387809dd60 2023-09-30T22:27:21.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.757+0000 7f387dfee700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f387809b4f0 con 0x7f387809d450 2023-09-30T22:27:21.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.758+0000 7fbcf353e700 1 Processor -- start 2023-09-30T22:27:21.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.758+0000 7f38777fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f387809d450 0x7f387809d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.758+0000 7f38777fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f387809d450 0x7f387809d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56270/0 (socket says 172.21.15.40:56270) 2023-09-30T22:27:21.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.758+0000 7f38777fe700 1 -- 172.21.15.40:0/3850135514 learned_addr learned my addr 172.21.15.40:0/3850135514 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:21.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.758+0000 7fbcf353e700 1 -- start start 2023-09-30T22:27:21.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.758+0000 7fbcf353e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbcec06f070 0x7fbcec06c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.758+0000 7fbcf353e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcec06f980 0x7fbcec06ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.758+0000 7fbcf353e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcec06fdb0 0x7fbcec06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.758+0000 7fbcf353e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcec08b410 con 0x7fbcec06fdb0 2023-09-30T22:27:21.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.758+0000 7fbcf353e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcec08b6f0 con 0x7fbcec06f980 2023-09-30T22:27:21.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.758+0000 7fbcf353e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbcec1292a0 con 0x7fbcec06f070 2023-09-30T22:27:21.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.759+0000 7fbcf1adb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcec06fdb0 0x7fbcec06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.759+0000 7fbcf1adb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcec06fdb0 0x7fbcec06d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37220/0 (socket says 172.21.15.40:37220) 2023-09-30T22:27:21.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.759+0000 7fbcf1adb700 1 -- 172.21.15.40:0/1779786200 learned_addr learned my addr 172.21.15.40:0/1779786200 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:21.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.759+0000 7f38777fe700 1 -- 172.21.15.40:0/3850135514 >> v2:172.21.15.40:3300/0 conn(0x7f387809dd60 msgr2=0x7f38781301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:21.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.759+0000 7f38777fe700 1 --2- 172.21.15.40:0/3850135514 >> v2:172.21.15.40:3300/0 conn(0x7f387809dd60 0x7f38781301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.759+0000 7f38777fe700 1 -- 172.21.15.40:0/3850135514 >> v1:172.21.15.40:6789/0 conn(0x7f3878130700 legacy=0x7f3878137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:21.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.759+0000 7f38777fe700 1 -- 172.21.15.40:0/3850135514 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387809af90 con 0x7f387809d450 2023-09-30T22:27:21.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.759+0000 7fbcf0ad9700 1 --2- 172.21.15.40:0/1779786200 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcec06f980 0x7fbcec06ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.759+0000 7fbcf1adb700 1 -- 172.21.15.40:0/1779786200 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbcec06f070 msgr2=0x7fbcec06c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:21.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.759+0000 7fbcf1adb700 1 --2- 172.21.15.40:0/1779786200 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbcec06f070 0x7fbcec06c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.759+0000 7fbcf1adb700 1 -- 172.21.15.40:0/1779786200 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcec06f980 msgr2=0x7fbcec06ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:21.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.759+0000 7fbcf1adb700 1 --2- 172.21.15.40:0/1779786200 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcec06f980 0x7fbcec06ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.759+0000 7fbcf1adb700 1 -- 172.21.15.40:0/1779786200 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce4009a70 con 0x7fbcec06fdb0 2023-09-30T22:27:21.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.759+0000 7fbcf0ad9700 1 --2- 172.21.15.40:0/1779786200 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcec06f980 0x7fbcec06ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:27:21.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.759+0000 7fbcf1adb700 1 --2- 172.21.15.40:0/1779786200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcec06fdb0 0x7fbcec06d410 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fbce400efc0 tx=0x7fbce400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:21.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.759+0000 7f38777fe700 1 --2- 172.21.15.40:0/3850135514 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f387809d450 0x7f387809d820 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f38680098f0 tx=0x7f3868009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c87c8ed5311ba6b5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:21.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.760+0000 7fbce1ffb700 1 -- 172.21.15.40:0/1779786200 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce4009d70 con 0x7fbcec06fdb0 2023-09-30T22:27:21.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.760+0000 7fbce1ffb700 1 -- 172.21.15.40:0/1779786200 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce400f040 con 0x7fbcec06fdb0 2023-09-30T22:27:21.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.760+0000 7fbce1ffb700 1 -- 172.21.15.40:0/1779786200 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce400ce00 con 0x7fbcec06fdb0 2023-09-30T22:27:21.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.760+0000 7fbcf353e700 1 -- 172.21.15.40:0/1779786200 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcdc009550 con 0x7fbcec06fdb0 2023-09-30T22:27:21.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.760+0000 7f38767fc700 1 -- 172.21.15.40:0/3850135514 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3868004230 con 0x7f387809d450 2023-09-30T22:27:21.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.760+0000 7f38767fc700 1 -- 172.21.15.40:0/3850135514 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3868004390 con 0x7f387809d450 2023-09-30T22:27:21.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.760+0000 7f38767fc700 1 -- 172.21.15.40:0/3850135514 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38680036a0 con 0x7f387809d450 2023-09-30T22:27:21.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.760+0000 7fbcf353e700 1 -- 172.21.15.40:0/1779786200 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcec08b150 con 0x7fbcec06fdb0 2023-09-30T22:27:21.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.761+0000 7f387dfee700 1 -- 172.21.15.40:0/3850135514 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f387809d450 msgr2=0x7f387809d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:21.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.761+0000 7f387dfee700 1 --2- 172.21.15.40:0/3850135514 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f387809d450 0x7f387809d820 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f38680098f0 tx=0x7f3868009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:21.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.761+0000 7fbce1ffb700 1 -- 172.21.15.40:0/1779786200 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbce4014480 con 0x7fbcec06fdb0 2023-09-30T22:27:21.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.761+0000 7fbce1ffb700 1 -- 172.21.15.40:0/1779786200 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fbce403fe70 con 0x7fbcec06fdb0 2023-09-30T22:27:21.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.761+0000 7f387dfee700 1 -- 172.21.15.40:0/3850135514 shutdown_connections 2023-09-30T22:27:21.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.761+0000 7f387dfee700 1 --2- 172.21.15.40:0/3850135514 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f387809d450 0x7f387809d820 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.761+0000 7f387dfee700 1 --2- 172.21.15.40:0/3850135514 >> v2:172.21.15.40:3300/0 conn(0x7f387809dd60 0x7f38781301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.762+0000 7f387dfee700 1 -- 172.21.15.40:0/3850135514 >> 172.21.15.40:0/3850135514 conn(0x7f38780a2a00 msgr2=0x7f38780a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:21.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.762+0000 7f387dfee700 1 -- 172.21.15.40:0/3850135514 shutdown_connections 2023-09-30T22:27:21.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.762+0000 7fbcf353e700 1 -- 172.21.15.40:0/1779786200 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcec06dc00 con 0x7fbcec06fdb0 2023-09-30T22:27:21.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.762+0000 7f387dfee700 1 -- 172.21.15.40:0/3850135514 wait complete. 2023-09-30T22:27:21.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.763+0000 7f387dfee700 1 Processor -- start 2023-09-30T22:27:21.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.763+0000 7f387dfee700 1 -- start start 2023-09-30T22:27:21.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.763+0000 7f387dfee700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f387809d450 0x7f387813b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.763+0000 7f387dfee700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f387809dd60 0x7f387813b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.763+0000 7f387dfee700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3878130700 0x7f387813bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.763+0000 7f387dfee700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3878137f50 con 0x7f3878130700 2023-09-30T22:27:21.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.763+0000 7f387dfee700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f387813c220 con 0x7f387809d450 2023-09-30T22:27:21.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.763+0000 7f387dfee700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f387813a240 con 0x7f387809dd60 2023-09-30T22:27:21.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.763+0000 7f38777fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f387809d450 0x7f387813b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.763+0000 7f38777fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f387809d450 0x7f387813b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42492/0 (socket says 172.21.15.40:42492) 2023-09-30T22:27:21.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.763+0000 7f38777fe700 1 -- 172.21.15.40:0/2087430028 learned_addr learned my addr 172.21.15.40:0/2087430028 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:21.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.763+0000 7f3876ffd700 1 --2- 172.21.15.40:0/2087430028 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f387809dd60 0x7f387813b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.764+0000 7f3877fff700 1 --2- 172.21.15.40:0/2087430028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3878130700 0x7f387813bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.764+0000 7f38777fe700 1 -- 172.21.15.40:0/2087430028 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f387809dd60 msgr2=0x7f387813b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:21.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.764+0000 7f38777fe700 1 --2- 172.21.15.40:0/2087430028 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f387809dd60 0x7f387813b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.764+0000 7f38777fe700 1 -- 172.21.15.40:0/2087430028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3878130700 msgr2=0x7f387813bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:21.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.764+0000 7f38777fe700 1 --2- 172.21.15.40:0/2087430028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3878130700 0x7f387813bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.764+0000 7f38777fe700 1 -- 172.21.15.40:0/2087430028 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3868009550 con 0x7f387809d450 2023-09-30T22:27:21.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.764+0000 7f3877fff700 1 --2- 172.21.15.40:0/2087430028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3878130700 0x7f387813bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:21.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.764+0000 7f38777fe700 1 --2- 172.21.15.40:0/2087430028 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f387809d450 0x7f387813b100 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3868009130 tx=0x7f3868004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:21.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.764+0000 7f385ffff700 1 -- 172.21.15.40:0/2087430028 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386800b660 con 0x7f387809d450 2023-09-30T22:27:21.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.764+0000 7f385ffff700 1 -- 172.21.15.40:0/2087430028 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386800b7c0 con 0x7f387809d450 2023-09-30T22:27:21.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.764+0000 7f387dfee700 1 -- 172.21.15.40:0/2087430028 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38780a2460 con 0x7f387809d450 2023-09-30T22:27:21.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.764+0000 7f385ffff700 1 -- 172.21.15.40:0/2087430028 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386800bb70 con 0x7f387809d450 2023-09-30T22:27:21.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.764+0000 7f387dfee700 1 -- 172.21.15.40:0/2087430028 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f387809c620 con 0x7f387809d450 2023-09-30T22:27:21.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.765+0000 7f385ffff700 1 -- 172.21.15.40:0/2087430028 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f386800bcd0 con 0x7f387809d450 2023-09-30T22:27:21.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.765+0000 7f385ffff700 1 -- 172.21.15.40:0/2087430028 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f38680413f0 con 0x7f387809d450 2023-09-30T22:27:21.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.766+0000 7f387dfee700 1 -- 172.21.15.40:0/2087430028 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3878062380 con 0x7f387809d450 2023-09-30T22:27:21.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.768+0000 7fbce1ffb700 1 -- 172.21.15.40:0/1779786200 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbce4012910 con 0x7fbcec06fdb0 2023-09-30T22:27:21.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.775+0000 7f385ffff700 1 -- 172.21.15.40:0/2087430028 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3868010790 con 0x7f387809d450 2023-09-30T22:27:21.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.860+0000 7f0caf46e700 1 Processor -- start 2023-09-30T22:27:21.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.860+0000 7f0caf46e700 1 -- start start 2023-09-30T22:27:21.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.861+0000 7f0caf46e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0ca809f0f0 0x7f0ca8138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.861+0000 7f0caf46e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ca809e400 0x7f0ca813b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.861+0000 7f0caf46e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca809f940 con 0x7f0ca809d920 2023-09-30T22:27:21.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.861+0000 7f0caf46e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca806b4c0 con 0x7f0ca809f0f0 2023-09-30T22:27:21.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.861+0000 7f0caf46e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca809a8f0 con 0x7f0ca809e400 2023-09-30T22:27:21.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.861+0000 7f0cada0b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ca809e400 0x7f0ca813b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.861+0000 7f0cada0b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ca809e400 0x7f0ca813b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42500/0 (socket says 172.21.15.40:42500) 2023-09-30T22:27:21.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.861+0000 7f0cada0b700 1 -- 172.21.15.40:0/93164339 learned_addr learned my addr 172.21.15.40:0/93164339 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:21.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.861+0000 7f0caca09700 1 --2- 172.21.15.40:0/93164339 >> v2:172.21.15.40:3300/0 conn(0x7f0ca809f0f0 0x7f0ca8138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.861+0000 7f0cada0b700 1 -- 172.21.15.40:0/93164339 >> v2:172.21.15.40:3300/0 conn(0x7f0ca809f0f0 msgr2=0x7f0ca8138ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:21.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.862+0000 7f0cada0b700 1 --2- 172.21.15.40:0/93164339 >> v2:172.21.15.40:3300/0 conn(0x7f0ca809f0f0 0x7f0ca8138ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.862+0000 7f0cada0b700 1 -- 172.21.15.40:0/93164339 >> v1:172.21.15.40:6789/0 conn(0x7f0ca809d920 legacy=0x7f0ca809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:21.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.862+0000 7f0cada0b700 1 -- 172.21.15.40:0/93164339 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca809f6e0 con 0x7f0ca809e400 2023-09-30T22:27:21.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.862+0000 7f0caca09700 1 --2- 172.21.15.40:0/93164339 >> v2:172.21.15.40:3300/0 conn(0x7f0ca809f0f0 0x7f0ca8138ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:21.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.862+0000 7f0cada0b700 1 --2- 172.21.15.40:0/93164339 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ca809e400 0x7f0ca813b430 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0009e80 tx=0x7f0ca000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=734af963314b7e1f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:21.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.862+0000 7f0c9ffff700 1 -- 172.21.15.40:0/93164339 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca000e070 con 0x7f0ca809e400 2023-09-30T22:27:21.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.862+0000 7f0c9ffff700 1 -- 172.21.15.40:0/93164339 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca000b8d0 con 0x7f0ca809e400 2023-09-30T22:27:21.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.862+0000 7f0c9ffff700 1 -- 172.21.15.40:0/93164339 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca000bc80 con 0x7f0ca809e400 2023-09-30T22:27:21.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.863+0000 7f0caf46e700 1 -- 172.21.15.40:0/93164339 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ca809e400 msgr2=0x7f0ca813b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:21.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.863+0000 7f0caf46e700 1 --2- 172.21.15.40:0/93164339 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ca809e400 0x7f0ca813b430 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0009e80 tx=0x7f0ca000b330 comp rx=0 tx=0).stop 2023-09-30T22:27:21.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.863+0000 7f0caf46e700 1 -- 172.21.15.40:0/93164339 shutdown_connections 2023-09-30T22:27:21.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.863+0000 7f0caf46e700 1 --2- 172.21.15.40:0/93164339 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ca809e400 0x7f0ca813b430 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.863+0000 7f0caf46e700 1 --2- 172.21.15.40:0/93164339 >> v2:172.21.15.40:3300/0 conn(0x7f0ca809f0f0 0x7f0ca8138ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.863+0000 7f0caf46e700 1 -- 172.21.15.40:0/93164339 >> 172.21.15.40:0/93164339 conn(0x7f0ca809fb20 msgr2=0x7f0ca809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:21.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.863+0000 7f0caf46e700 1 -- 172.21.15.40:0/93164339 shutdown_connections 2023-09-30T22:27:21.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.863+0000 7f0caf46e700 1 -- 172.21.15.40:0/93164339 wait complete. 2023-09-30T22:27:21.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.864+0000 7f0caf46e700 1 Processor -- start 2023-09-30T22:27:21.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.865+0000 7f0caf46e700 1 -- start start 2023-09-30T22:27:21.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.865+0000 7f0caf46e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ca809d920 0x7f0ca811e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.865+0000 7f0caf46e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ca809e400 0x7f0ca811ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.865+0000 7f0caf46e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ca811f180 0x7f0ca81ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.865+0000 7f0caf46e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca8120960 con 0x7f0ca809e400 2023-09-30T22:27:21.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.865+0000 7f0caf46e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca80a32f0 con 0x7f0ca811f180 2023-09-30T22:27:21.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.865+0000 7f0caf46e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca81219b0 con 0x7f0ca809d920 2023-09-30T22:27:21.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.865+0000 7f0caca09700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ca809e400 0x7f0ca811ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.865+0000 7f0caca09700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ca809e400 0x7f0ca811ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37240/0 (socket says 172.21.15.40:37240) 2023-09-30T22:27:21.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.865+0000 7f0caca09700 1 -- 172.21.15.40:0/1260002542 learned_addr learned my addr 172.21.15.40:0/1260002542 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:21.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.865+0000 7f0cada0b700 1 --2- 172.21.15.40:0/1260002542 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ca811f180 0x7f0ca81ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.866+0000 7f0cad20a700 1 --2- 172.21.15.40:0/1260002542 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ca809d920 0x7f0ca811e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.866+0000 7f0cada0b700 1 -- 172.21.15.40:0/1260002542 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ca809d920 msgr2=0x7f0ca811e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:21.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.866+0000 7f0cada0b700 1 --2- 172.21.15.40:0/1260002542 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ca809d920 0x7f0ca811e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.866+0000 7f0cada0b700 1 -- 172.21.15.40:0/1260002542 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ca809e400 msgr2=0x7f0ca811ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:21.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.866+0000 7f0cada0b700 1 --2- 172.21.15.40:0/1260002542 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ca809e400 0x7f0ca811ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.866+0000 7f0cada0b700 1 -- 172.21.15.40:0/1260002542 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c980094a0 con 0x7f0ca811f180 2023-09-30T22:27:21.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.866+0000 7f0caca09700 1 --2- 172.21.15.40:0/1260002542 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ca809e400 0x7f0ca811ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:21.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.866+0000 7f0cada0b700 1 --2- 172.21.15.40:0/1260002542 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ca811f180 0x7f0ca81ce8b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0015000 tx=0x7f0ca0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:21.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.866+0000 7f0c9dffb700 1 -- 172.21.15.40:0/1260002542 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca0004800 con 0x7f0ca811f180 2023-09-30T22:27:21.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.866+0000 7f0caf46e700 1 -- 172.21.15.40:0/1260002542 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca0009b30 con 0x7f0ca811f180 2023-09-30T22:27:21.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.866+0000 7f0c9dffb700 1 -- 172.21.15.40:0/1260002542 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca0004960 con 0x7f0ca811f180 2023-09-30T22:27:21.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.866+0000 7f0c9dffb700 1 -- 172.21.15.40:0/1260002542 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca001c680 con 0x7f0ca811f180 2023-09-30T22:27:21.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.867+0000 7f0caf46e700 1 -- 172.21.15.40:0/1260002542 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca8120b00 con 0x7f0ca811f180 2023-09-30T22:27:21.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.867+0000 7f0c9dffb700 1 -- 172.21.15.40:0/1260002542 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0ca001c7e0 con 0x7f0ca811f180 2023-09-30T22:27:21.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.868+0000 7f0c9dffb700 1 -- 172.21.15.40:0/1260002542 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f0ca0041020 con 0x7f0ca811f180 2023-09-30T22:27:21.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.868+0000 7f0caf46e700 1 -- 172.21.15.40:0/1260002542 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca8121be0 con 0x7f0ca811f180 2023-09-30T22:27:21.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.877+0000 7f0c9dffb700 1 -- 172.21.15.40:0/1260002542 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0ca00123f0 con 0x7f0ca811f180 2023-09-30T22:27:21.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.953+0000 7f3927b78700 1 -- 172.21.15.40:0/410005659 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3908005150 con 0x7f392012eea0 2023-09-30T22:27:21.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.954+0000 7f39167fc700 1 -- 172.21.15.40:0/410005659 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f391800a930 con 0x7f392012eea0 2023-09-30T22:27:21.955 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:21.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.955+0000 7f3927b78700 1 -- 172.21.15.40:0/410005659 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f392012eea0 msgr2=0x7f39201c8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:21.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.955+0000 7f3927b78700 1 --2- 172.21.15.40:0/410005659 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f392012eea0 0x7f39201c8580 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f391800c7a0 tx=0x7f391800cab0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.956+0000 7f3927b78700 1 -- 172.21.15.40:0/410005659 shutdown_connections 2023-09-30T22:27:21.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.956+0000 7f3927b78700 1 --2- 172.21.15.40:0/410005659 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f392012eea0 0x7f39201c8580 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.956+0000 7f3927b78700 1 --2- 172.21.15.40:0/410005659 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f392012d6d0 0x7f392013b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.956+0000 7f3927b78700 1 --2- 172.21.15.40:0/410005659 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f392012e590 0x7f392013bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.956+0000 7f3927b78700 1 -- 172.21.15.40:0/410005659 >> 172.21.15.40:0/410005659 conn(0x7f39200a2a00 msgr2=0x7f392009d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:21.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.956+0000 7f3927b78700 1 -- 172.21.15.40:0/410005659 shutdown_connections 2023-09-30T22:27:21.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.956+0000 7f3927b78700 1 -- 172.21.15.40:0/410005659 wait complete. 2023-09-30T22:27:21.969 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:21.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.973+0000 7fbcf353e700 1 -- 172.21.15.40:0/1779786200 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbcec062380 con 0x7fbcec06fdb0 2023-09-30T22:27:21.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.973+0000 7fbce1ffb700 1 -- 172.21.15.40:0/1779786200 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbce4012340 con 0x7fbcec06fdb0 2023-09-30T22:27:21.974 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:21.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.975+0000 7fbcf353e700 1 -- 172.21.15.40:0/1779786200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcec06fdb0 msgr2=0x7fbcec06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:21.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.975+0000 7fbcf353e700 1 --2- 172.21.15.40:0/1779786200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcec06fdb0 0x7fbcec06d410 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fbce400efc0 tx=0x7fbce400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.975+0000 7fbcf353e700 1 -- 172.21.15.40:0/1779786200 shutdown_connections 2023-09-30T22:27:21.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.975+0000 7fbcf353e700 1 --2- 172.21.15.40:0/1779786200 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbcec06f070 0x7fbcec06c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.975+0000 7fbcf353e700 1 --2- 172.21.15.40:0/1779786200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcec06fdb0 0x7fbcec06d410 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.975+0000 7fbcf353e700 1 --2- 172.21.15.40:0/1779786200 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcec06f980 0x7fbcec06ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.975+0000 7fbcf353e700 1 -- 172.21.15.40:0/1779786200 >> 172.21.15.40:0/1779786200 conn(0x7fbcec0a41a0 msgr2=0x7fbcec097330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:21.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.975+0000 7fbcf353e700 1 -- 172.21.15.40:0/1779786200 shutdown_connections 2023-09-30T22:27:21.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:21.975+0000 7fbcf353e700 1 -- 172.21.15.40:0/1779786200 wait complete. 2023-09-30T22:27:21.988 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:22.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:22.017+0000 7f387dfee700 1 -- 172.21.15.40:0/2087430028 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3878139b90 con 0x7f387809d450 2023-09-30T22:27:22.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:22.018+0000 7f385ffff700 1 -- 172.21.15.40:0/2087430028 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f38680193f0 con 0x7f387809d450 2023-09-30T22:27:22.019 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:22.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:22.020+0000 7f387dfee700 1 -- 172.21.15.40:0/2087430028 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f387809d450 msgr2=0x7f387813b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:22.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:22.020+0000 7f387dfee700 1 --2- 172.21.15.40:0/2087430028 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f387809d450 0x7f387813b100 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3868009130 tx=0x7f3868004750 comp rx=0 tx=0).stop 2023-09-30T22:27:22.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:22.020+0000 7f387dfee700 1 -- 172.21.15.40:0/2087430028 shutdown_connections 2023-09-30T22:27:22.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:22.020+0000 7f387dfee700 1 --2- 172.21.15.40:0/2087430028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3878130700 0x7f387813bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:22.020+0000 7f387dfee700 1 --2- 172.21.15.40:0/2087430028 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f387809d450 0x7f387813b100 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:22.020+0000 7f387dfee700 1 --2- 172.21.15.40:0/2087430028 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f387809dd60 0x7f387813b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:22.020+0000 7f387dfee700 1 -- 172.21.15.40:0/2087430028 >> 172.21.15.40:0/2087430028 conn(0x7f38780a2a00 msgr2=0x7f38780a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:22.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:22.020+0000 7f387dfee700 1 -- 172.21.15.40:0/2087430028 shutdown_connections 2023-09-30T22:27:22.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:22.020+0000 7f387dfee700 1 -- 172.21.15.40:0/2087430028 wait complete. 2023-09-30T22:27:22.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:22.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:22.085+0000 7f0caf46e700 1 -- 172.21.15.40:0/1260002542 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0ca8062380 con 0x7f0ca811f180 2023-09-30T22:27:22.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:22.085+0000 7f0c9dffb700 1 -- 172.21.15.40:0/1260002542 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0ca0034090 con 0x7f0ca811f180 2023-09-30T22:27:22.086 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:22.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:22.087+0000 7f0caf46e700 1 -- 172.21.15.40:0/1260002542 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ca811f180 msgr2=0x7f0ca81ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:22.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:22.087+0000 7f0caf46e700 1 --2- 172.21.15.40:0/1260002542 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ca811f180 0x7f0ca81ce8b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0015000 tx=0x7f0ca0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:22.087+0000 7f0caf46e700 1 -- 172.21.15.40:0/1260002542 shutdown_connections 2023-09-30T22:27:22.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:22.087+0000 7f0caf46e700 1 --2- 172.21.15.40:0/1260002542 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ca809d920 0x7f0ca811e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:22.087+0000 7f0caf46e700 1 --2- 172.21.15.40:0/1260002542 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ca811f180 0x7f0ca81ce8b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:22.087+0000 7f0caf46e700 1 --2- 172.21.15.40:0/1260002542 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ca809e400 0x7f0ca811ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:22.087+0000 7f0caf46e700 1 -- 172.21.15.40:0/1260002542 >> 172.21.15.40:0/1260002542 conn(0x7f0ca809fb20 msgr2=0x7f0ca8070860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:22.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:22.087+0000 7f0caf46e700 1 -- 172.21.15.40:0/1260002542 shutdown_connections 2023-09-30T22:27:22.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:22.087+0000 7f0caf46e700 1 -- 172.21.15.40:0/1260002542 wait complete. 2023-09-30T22:27:22.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:22.969 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:22.989 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:23.034 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:23.101 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:23.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.113+0000 7fdaa4540700 1 Processor -- start 2023-09-30T22:27:23.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.114+0000 7fdaa4540700 1 -- start start 2023-09-30T22:27:23.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.115+0000 7fdaa4540700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fda9c09f0f0 0x7fda9c138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.115+0000 7fdaa4540700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda9c09e400 0x7fda9c13b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.115+0000 7fdaa4540700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9c09f940 con 0x7fda9c09d920 2023-09-30T22:27:23.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.115+0000 7fdaa4540700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda9c06b4c0 con 0x7fda9c09f0f0 2023-09-30T22:27:23.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.115+0000 7fdaa4540700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c09a8f0 con 0x7fda9c09e400 2023-09-30T22:27:23.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.115+0000 7fdaa1adb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fda9c09f0f0 0x7fda9c138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.115+0000 7fdaa1adb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fda9c09f0f0 0x7fda9c138ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37242/0 (socket says 172.21.15.40:37242) 2023-09-30T22:27:23.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.115+0000 7fdaa1adb700 1 -- 172.21.15.40:0/1999341010 learned_addr learned my addr 172.21.15.40:0/1999341010 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:23.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.115+0000 7fdaa2add700 1 --2- 172.21.15.40:0/1999341010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda9c09e400 0x7fda9c13b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.115+0000 7fdaa1adb700 1 -- 172.21.15.40:0/1999341010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda9c09e400 msgr2=0x7fda9c13b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:23.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.115+0000 7fdaa1adb700 1 --2- 172.21.15.40:0/1999341010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda9c09e400 0x7fda9c13b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.115+0000 7fdaa1adb700 1 -- 172.21.15.40:0/1999341010 >> v1:172.21.15.40:6789/0 conn(0x7fda9c09d920 legacy=0x7fda9c09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.115+0000 7fdaa1adb700 1 -- 172.21.15.40:0/1999341010 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c09f6e0 con 0x7fda9c09f0f0 2023-09-30T22:27:23.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.116+0000 7fdaa1adb700 1 --2- 172.21.15.40:0/1999341010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda9c09f0f0 0x7fda9c138ee0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fda8c0098f0 tx=0x7fda8c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5777164fb8d8c371 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:23.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.116+0000 7fdaa12da700 1 -- 172.21.15.40:0/1999341010 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c004230 con 0x7fda9c09f0f0 2023-09-30T22:27:23.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.116+0000 7fdaa12da700 1 -- 172.21.15.40:0/1999341010 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8c004390 con 0x7fda9c09f0f0 2023-09-30T22:27:23.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.116+0000 7fdaa12da700 1 -- 172.21.15.40:0/1999341010 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c0036a0 con 0x7fda9c09f0f0 2023-09-30T22:27:23.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.117+0000 7fdaa4540700 1 -- 172.21.15.40:0/1999341010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda9c09f0f0 msgr2=0x7fda9c138ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.117+0000 7fdaa4540700 1 --2- 172.21.15.40:0/1999341010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda9c09f0f0 0x7fda9c138ee0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fda8c0098f0 tx=0x7fda8c009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:23.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.117+0000 7fdaa4540700 1 -- 172.21.15.40:0/1999341010 shutdown_connections 2023-09-30T22:27:23.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.117+0000 7fdaa4540700 1 --2- 172.21.15.40:0/1999341010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda9c09e400 0x7fda9c13b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.117+0000 7fdaa4540700 1 --2- 172.21.15.40:0/1999341010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda9c09f0f0 0x7fda9c138ee0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.117+0000 7fdaa4540700 1 -- 172.21.15.40:0/1999341010 >> 172.21.15.40:0/1999341010 conn(0x7fda9c09fb20 msgr2=0x7fda9c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:23.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.117+0000 7fdaa4540700 1 -- 172.21.15.40:0/1999341010 shutdown_connections 2023-09-30T22:27:23.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.117+0000 7fdaa4540700 1 -- 172.21.15.40:0/1999341010 wait complete. 2023-09-30T22:27:23.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.118+0000 7fdaa4540700 1 Processor -- start 2023-09-30T22:27:23.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.119+0000 7fdaa4540700 1 -- start start 2023-09-30T22:27:23.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.119+0000 7fdaa4540700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda9c09d920 0x7fda9c11e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.119+0000 7fdaa4540700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda9c09e400 0x7fda9c11ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.119+0000 7fdaa4540700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda9c11f360 0x7fda9c1c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.119+0000 7fdaa4540700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c0a33f0 con 0x7fda9c09e400 2023-09-30T22:27:23.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.119+0000 7fdaa4540700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c09c9e0 con 0x7fda9c11f360 2023-09-30T22:27:23.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.119+0000 7fdaa4540700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c121b00 con 0x7fda9c09d920 2023-09-30T22:27:23.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.119+0000 7fdaa22dc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda9c09d920 0x7fda9c11e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.119+0000 7fdaa1adb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda9c09e400 0x7fda9c11ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.119+0000 7fdaa22dc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda9c09d920 0x7fda9c11e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56310/0 (socket says 172.21.15.40:56310) 2023-09-30T22:27:23.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.119+0000 7fdaa22dc700 1 -- 172.21.15.40:0/1513360337 learned_addr learned my addr 172.21.15.40:0/1513360337 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:23.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.120+0000 7fdaa2add700 1 --2- 172.21.15.40:0/1513360337 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda9c11f360 0x7fda9c1c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.120+0000 7fdaa1adb700 1 -- 172.21.15.40:0/1513360337 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda9c09d920 msgr2=0x7fda9c11e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.120+0000 7fdaa1adb700 1 --2- 172.21.15.40:0/1513360337 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda9c09d920 0x7fda9c11e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.120+0000 7fdaa1adb700 1 -- 172.21.15.40:0/1513360337 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda9c11f360 msgr2=0x7fda9c1c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.120+0000 7fdaa1adb700 1 --2- 172.21.15.40:0/1513360337 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda9c11f360 0x7fda9c1c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.120+0000 7fdaa1adb700 1 -- 172.21.15.40:0/1513360337 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8c009550 con 0x7fda9c09e400 2023-09-30T22:27:23.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.120+0000 7fdaa2add700 1 --2- 172.21.15.40:0/1513360337 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda9c11f360 0x7fda9c1c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:27:23.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.120+0000 7fdaa1adb700 1 --2- 172.21.15.40:0/1513360337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda9c09e400 0x7fda9c11ee20 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fda8c0098f0 tx=0x7fda8c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:23.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.120+0000 7fda92ffd700 1 -- 172.21.15.40:0/1513360337 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c0045d0 con 0x7fda9c09e400 2023-09-30T22:27:23.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.120+0000 7fda92ffd700 1 -- 172.21.15.40:0/1513360337 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8c011630 con 0x7fda9c09e400 2023-09-30T22:27:23.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.120+0000 7fdaa4540700 1 -- 172.21.15.40:0/1513360337 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda9c122090 con 0x7fda9c09e400 2023-09-30T22:27:23.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.120+0000 7fda92ffd700 1 -- 172.21.15.40:0/1513360337 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c0119e0 con 0x7fda9c09e400 2023-09-30T22:27:23.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.120+0000 7fdaa4540700 1 -- 172.21.15.40:0/1513360337 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9c122b00 con 0x7fda9c09e400 2023-09-30T22:27:23.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.121+0000 7fdaa4540700 1 -- 172.21.15.40:0/1513360337 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda9c11f760 con 0x7fda9c09e400 2023-09-30T22:27:23.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.121+0000 7fda92ffd700 1 -- 172.21.15.40:0/1513360337 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fda8c022070 con 0x7fda9c09e400 2023-09-30T22:27:23.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.122+0000 7fda92ffd700 1 -- 172.21.15.40:0/1513360337 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fda8c041100 con 0x7fda9c09e400 2023-09-30T22:27:23.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.126+0000 7fda92ffd700 1 -- 172.21.15.40:0/1513360337 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fda8c011b40 con 0x7fda9c09e400 2023-09-30T22:27:23.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.157+0000 7f699221d700 1 Processor -- start 2023-09-30T22:27:23.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.157+0000 7f699221d700 1 -- start start 2023-09-30T22:27:23.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.157+0000 7f699221d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f698c09d920 0x7f698c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.157+0000 7f699221d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f698c130fb0 0x7f698c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.157+0000 7f699221d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f698c09adf0 con 0x7f698c09e230 2023-09-30T22:27:23.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.157+0000 7f699221d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f698c09edf0 con 0x7f698c09d920 2023-09-30T22:27:23.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.157+0000 7f699221d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f698c09b660 con 0x7f698c130fb0 2023-09-30T22:27:23.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.158+0000 7f698affd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f698c09e230 0x7f698c1308a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38298/0 (socket says 172.21.15.40:38298) 2023-09-30T22:27:23.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.158+0000 7f698affd700 1 -- 172.21.15.40:0/4091876146 learned_addr learned my addr 172.21.15.40:0/4091876146 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:27:23.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.158+0000 7f698b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f698c09d920 0x7f698c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.158+0000 7f698bfff700 1 --2- 172.21.15.40:0/4091876146 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f698c130fb0 0x7f698c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.158+0000 7f698a7fc700 1 -- 172.21.15.40:0/4091876146 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2325293444 0 0) 0x7f698c09adf0 con 0x7f698c09e230 2023-09-30T22:27:23.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.158+0000 7f698a7fc700 1 -- 172.21.15.40:0/4091876146 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69740035b0 con 0x7f698c09e230 2023-09-30T22:27:23.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.158+0000 7f698bfff700 1 -- 172.21.15.40:0/4091876146 >> v2:172.21.15.40:3300/0 conn(0x7f698c09d920 msgr2=0x7f698c09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:23.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.158+0000 7f698bfff700 1 --2- 172.21.15.40:0/4091876146 >> v2:172.21.15.40:3300/0 conn(0x7f698c09d920 0x7f698c09dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.158+0000 7f698bfff700 1 -- 172.21.15.40:0/4091876146 >> v1:172.21.15.40:6789/0 conn(0x7f698c09e230 legacy=0x7f698c1308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.158+0000 7f698bfff700 1 -- 172.21.15.40:0/4091876146 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f698c09a6e0 con 0x7f698c130fb0 2023-09-30T22:27:23.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.158+0000 7f698b7fe700 1 --2- 172.21.15.40:0/4091876146 >> v2:172.21.15.40:3300/0 conn(0x7f698c09d920 0x7f698c09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:23.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.158+0000 7f698bfff700 1 --2- 172.21.15.40:0/4091876146 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f698c130fb0 0x7f698c138d10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f698400bfa0 tx=0x7f698400d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73ae4e1c225ca6ff server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:23.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.158+0000 7f698a7fc700 1 -- 172.21.15.40:0/4091876146 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6984010070 con 0x7f698c130fb0 2023-09-30T22:27:23.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.159+0000 7f698a7fc700 1 -- 172.21.15.40:0/4091876146 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f698400b2e0 con 0x7f698c130fb0 2023-09-30T22:27:23.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.159+0000 7f698a7fc700 1 -- 172.21.15.40:0/4091876146 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698400dc00 con 0x7f698c130fb0 2023-09-30T22:27:23.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.159+0000 7f699221d700 1 -- 172.21.15.40:0/4091876146 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f698c130fb0 msgr2=0x7f698c138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.159+0000 7f699221d700 1 --2- 172.21.15.40:0/4091876146 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f698c130fb0 0x7f698c138d10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f698400bfa0 tx=0x7f698400d330 comp rx=0 tx=0).stop 2023-09-30T22:27:23.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.159+0000 7f699221d700 1 -- 172.21.15.40:0/4091876146 shutdown_connections 2023-09-30T22:27:23.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.159+0000 7f699221d700 1 --2- 172.21.15.40:0/4091876146 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f698c130fb0 0x7f698c138d10 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.159+0000 7f699221d700 1 --2- 172.21.15.40:0/4091876146 >> v2:172.21.15.40:3300/0 conn(0x7f698c09d920 0x7f698c09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.159+0000 7f699221d700 1 -- 172.21.15.40:0/4091876146 >> 172.21.15.40:0/4091876146 conn(0x7f698c09fb20 msgr2=0x7f698c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:23.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.159+0000 7f699221d700 1 -- 172.21.15.40:0/4091876146 shutdown_connections 2023-09-30T22:27:23.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.159+0000 7f699221d700 1 -- 172.21.15.40:0/4091876146 wait complete. 2023-09-30T22:27:23.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.160+0000 7f699221d700 1 Processor -- start 2023-09-30T22:27:23.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.161+0000 7f699221d700 1 -- start start 2023-09-30T22:27:23.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.161+0000 7f699221d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f698c09d920 0x7f698c1c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.161+0000 7f699221d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f698c09e230 0x7f698c1c4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.161+0000 7f699221d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f698c130fb0 0x7f698c1c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.161+0000 7f699221d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698c11eaf0 con 0x7f698c09d920 2023-09-30T22:27:23.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.161+0000 7f699221d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f698c11e310 con 0x7f698c09e230 2023-09-30T22:27:23.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.161+0000 7f699221d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f698c11da40 con 0x7f698c130fb0 2023-09-30T22:27:23.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.161+0000 7f698bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f698c130fb0 0x7f698c1c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.161+0000 7f698bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f698c130fb0 0x7f698c1c47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56330/0 (socket says 172.21.15.40:56330) 2023-09-30T22:27:23.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.161+0000 7f698bfff700 1 -- 172.21.15.40:0/743933424 learned_addr learned my addr 172.21.15.40:0/743933424 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:23.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.162+0000 7f698b7fe700 1 --2- 172.21.15.40:0/743933424 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f698c09d920 0x7f698c1c3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.162+0000 7f698affd700 1 --2- 172.21.15.40:0/743933424 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f698c09e230 0x7f698c1c4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.162+0000 7f698bfff700 1 -- 172.21.15.40:0/743933424 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f698c09e230 msgr2=0x7f698c1c4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.162+0000 7f698bfff700 1 --2- 172.21.15.40:0/743933424 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f698c09e230 0x7f698c1c4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.162+0000 7f698bfff700 1 -- 172.21.15.40:0/743933424 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f698c09d920 msgr2=0x7f698c1c3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.162+0000 7f698bfff700 1 --2- 172.21.15.40:0/743933424 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f698c09d920 0x7f698c1c3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.162+0000 7f698bfff700 1 -- 172.21.15.40:0/743933424 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697c009430 con 0x7f698c130fb0 2023-09-30T22:27:23.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.162+0000 7f698b7fe700 1 --2- 172.21.15.40:0/743933424 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f698c09d920 0x7f698c1c3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:23.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.162+0000 7f698bfff700 1 --2- 172.21.15.40:0/743933424 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f698c130fb0 0x7f698c1c47a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f698c068480 tx=0x7f6984004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:23.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.162+0000 7f6973fff700 1 -- 172.21.15.40:0/743933424 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6984003e10 con 0x7f698c130fb0 2023-09-30T22:27:23.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.162+0000 7f6973fff700 1 -- 172.21.15.40:0/743933424 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6984004250 con 0x7f698c130fb0 2023-09-30T22:27:23.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.162+0000 7f6973fff700 1 -- 172.21.15.40:0/743933424 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6984004600 con 0x7f698c130fb0 2023-09-30T22:27:23.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.162+0000 7f699221d700 1 -- 172.21.15.40:0/743933424 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f698400bc80 con 0x7f698c130fb0 2023-09-30T22:27:23.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.163+0000 7f699221d700 1 -- 172.21.15.40:0/743933424 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f698c11f040 con 0x7f698c130fb0 2023-09-30T22:27:23.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.164+0000 7f6973fff700 1 -- 172.21.15.40:0/743933424 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6984004760 con 0x7f698c130fb0 2023-09-30T22:27:23.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.164+0000 7f699221d700 1 -- 172.21.15.40:0/743933424 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f698c062380 con 0x7f698c130fb0 2023-09-30T22:27:23.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.164+0000 7f6973fff700 1 -- 172.21.15.40:0/743933424 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f69840432c0 con 0x7f698c130fb0 2023-09-30T22:27:23.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.169+0000 7f6973fff700 1 -- 172.21.15.40:0/743933424 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6984009d40 con 0x7f698c130fb0 2023-09-30T22:27:23.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.212+0000 7f8a95c30700 1 Processor -- start 2023-09-30T22:27:23.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.212+0000 7f8a95c30700 1 -- start start 2023-09-30T22:27:23.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.213+0000 7f8a95c30700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8a9009c890 0x7f8a9009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.213+0000 7f8a95c30700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a9009e480 0x7f8a9013bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.213+0000 7f8a95c30700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a900a2600 con 0x7f8a9009d920 2023-09-30T22:27:23.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.213+0000 7f8a95c30700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a900a29d0 con 0x7f8a9009c890 2023-09-30T22:27:23.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.213+0000 7f8a95c30700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9009fb40 con 0x7f8a9009e480 2023-09-30T22:27:23.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.213+0000 7f8a8effd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8a9009d920 0x7f8a9009dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56472/0 (socket says 172.21.15.40:56472) 2023-09-30T22:27:23.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.213+0000 7f8a8effd700 1 -- 172.21.15.40:0/3377809392 learned_addr learned my addr 172.21.15.40:0/3377809392 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:27:23.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.213+0000 7f8a8f7fe700 1 --2- 172.21.15.40:0/3377809392 >> v2:172.21.15.40:3300/0 conn(0x7f8a9009c890 0x7f8a9009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.213+0000 7f8a8e7fc700 1 -- 172.21.15.40:0/3377809392 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2294801874 0 0) 0x7f8a900a2600 con 0x7f8a9009d920 2023-09-30T22:27:23.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.213+0000 7f8a8e7fc700 1 -- 172.21.15.40:0/3377809392 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a780035b0 con 0x7f8a9009d920 2023-09-30T22:27:23.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.214+0000 7f8a8f7fe700 1 -- 172.21.15.40:0/3377809392 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a9009e480 msgr2=0x7f8a9013bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:23.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.214+0000 7f8a8f7fe700 1 --2- 172.21.15.40:0/3377809392 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a9009e480 0x7f8a9013bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.214+0000 7f8a8f7fe700 1 -- 172.21.15.40:0/3377809392 >> v1:172.21.15.40:6789/0 conn(0x7f8a9009d920 legacy=0x7f8a9009dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.214+0000 7f8a8f7fe700 1 -- 172.21.15.40:0/3377809392 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a9009fed0 con 0x7f8a9009c890 2023-09-30T22:27:23.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.214+0000 7f8a8f7fe700 1 --2- 172.21.15.40:0/3377809392 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a9009c890 0x7f8a9009cc60 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f8a80009820 tx=0x7f8a80009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55edd7850c0aba2f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:23.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.214+0000 7f8a8e7fc700 1 -- 172.21.15.40:0/3377809392 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a80005e30 con 0x7f8a9009c890 2023-09-30T22:27:23.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.214+0000 7f8a8e7fc700 1 -- 172.21.15.40:0/3377809392 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a80006030 con 0x7f8a9009c890 2023-09-30T22:27:23.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.214+0000 7f8a8e7fc700 1 -- 172.21.15.40:0/3377809392 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a800063c0 con 0x7f8a9009c890 2023-09-30T22:27:23.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.215+0000 7f8a95c30700 1 -- 172.21.15.40:0/3377809392 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a9009c890 msgr2=0x7f8a9009cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.215+0000 7f8a95c30700 1 --2- 172.21.15.40:0/3377809392 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a9009c890 0x7f8a9009cc60 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f8a80009820 tx=0x7f8a80009b30 comp rx=0 tx=0).stop 2023-09-30T22:27:23.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.215+0000 7f8a95c30700 1 -- 172.21.15.40:0/3377809392 shutdown_connections 2023-09-30T22:27:23.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.215+0000 7f8a95c30700 1 --2- 172.21.15.40:0/3377809392 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a9009e480 0x7f8a9013bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.215+0000 7f8a95c30700 1 --2- 172.21.15.40:0/3377809392 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a9009c890 0x7f8a9009cc60 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.215+0000 7f8a95c30700 1 -- 172.21.15.40:0/3377809392 >> 172.21.15.40:0/3377809392 conn(0x7f8a900a7080 msgr2=0x7f8a900a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:23.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.215+0000 7f8a95c30700 1 -- 172.21.15.40:0/3377809392 shutdown_connections 2023-09-30T22:27:23.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.215+0000 7f8a95c30700 1 -- 172.21.15.40:0/3377809392 wait complete. 2023-09-30T22:27:23.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.216+0000 7f8a95c30700 1 Processor -- start 2023-09-30T22:27:23.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.216+0000 7f8a95c30700 1 -- start start 2023-09-30T22:27:23.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.217+0000 7f8a95c30700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a9009c890 0x7f8a9012d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.217+0000 7f8a95c30700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a9009d920 0x7f8a9012daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.217+0000 7f8a95c30700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a9009e480 0x7f8a9012dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.217+0000 7f8a95c30700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a90130a30 con 0x7f8a9009c890 2023-09-30T22:27:23.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.217+0000 7f8a95c30700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a900a5c60 con 0x7f8a9009e480 2023-09-30T22:27:23.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.217+0000 7f8a95c30700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9009c280 con 0x7f8a9009d920 2023-09-30T22:27:23.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.217+0000 7f8a8f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a9009c890 0x7f8a9012d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.217+0000 7f8a8f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a9009c890 0x7f8a9012d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59608/0 (socket says 172.21.15.40:59608) 2023-09-30T22:27:23.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.217+0000 7f8a8f7fe700 1 -- 172.21.15.40:0/4006955676 learned_addr learned my addr 172.21.15.40:0/4006955676 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:23.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.217+0000 7f8a8effd700 1 --2- 172.21.15.40:0/4006955676 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a9009d920 0x7f8a9012daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.217+0000 7f8a8ffff700 1 --2- 172.21.15.40:0/4006955676 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a9009e480 0x7f8a9012dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.217+0000 7f8a8f7fe700 1 -- 172.21.15.40:0/4006955676 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a9009d920 msgr2=0x7f8a9012daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.217+0000 7f8a8f7fe700 1 --2- 172.21.15.40:0/4006955676 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a9009d920 0x7f8a9012daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.217+0000 7f8a8f7fe700 1 -- 172.21.15.40:0/4006955676 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a9009e480 msgr2=0x7f8a9012dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.217+0000 7f8a8f7fe700 1 --2- 172.21.15.40:0/4006955676 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a9009e480 0x7f8a9012dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.217+0000 7f8a8f7fe700 1 -- 172.21.15.40:0/4006955676 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a80009430 con 0x7f8a9009c890 2023-09-30T22:27:23.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.217+0000 7f8a8effd700 1 --2- 172.21.15.40:0/4006955676 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a9009d920 0x7f8a9012daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:23.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.218+0000 7f8a8f7fe700 1 --2- 172.21.15.40:0/4006955676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a9009c890 0x7f8a9012d560 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f8a80009b70 tx=0x7f8a80004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:23.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.218+0000 7f8a77fff700 1 -- 172.21.15.40:0/4006955676 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a800063a0 con 0x7f8a9009c890 2023-09-30T22:27:23.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.218+0000 7f8a77fff700 1 -- 172.21.15.40:0/4006955676 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a80020070 con 0x7f8a9009c890 2023-09-30T22:27:23.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.218+0000 7f8a77fff700 1 -- 172.21.15.40:0/4006955676 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a80006760 con 0x7f8a9009c890 2023-09-30T22:27:23.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.218+0000 7f8a95c30700 1 -- 172.21.15.40:0/4006955676 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a9012f250 con 0x7f8a9009c890 2023-09-30T22:27:23.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.218+0000 7f8a95c30700 1 -- 172.21.15.40:0/4006955676 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a90130c80 con 0x7f8a9009c890 2023-09-30T22:27:23.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.219+0000 7f8a77fff700 1 -- 172.21.15.40:0/4006955676 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8a80022030 con 0x7f8a9009c890 2023-09-30T22:27:23.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.219+0000 7f8a77fff700 1 -- 172.21.15.40:0/4006955676 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f8a80042510 con 0x7f8a9009c890 2023-09-30T22:27:23.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.224+0000 7f8a95c30700 1 -- 172.21.15.40:0/4006955676 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a9009ecf0 con 0x7f8a9009c890 2023-09-30T22:27:23.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.229+0000 7f8a77fff700 1 -- 172.21.15.40:0/4006955676 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8a800243d0 con 0x7f8a9009c890 2023-09-30T22:27:23.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.239+0000 7f50918f7700 1 Processor -- start 2023-09-30T22:27:23.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.239+0000 7f50918f7700 1 -- start start 2023-09-30T22:27:23.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.239+0000 7f50918f7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f508c09e030 0x7f508c13d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.239+0000 7f50918f7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f508c09e420 0x7f508c13f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.239+0000 7f50918f7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f508c11d980 con 0x7f508c06a6d0 2023-09-30T22:27:23.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.239+0000 7f50918f7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f508c06aaa0 con 0x7f508c09e030 2023-09-30T22:27:23.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.239+0000 7f50918f7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f508c06b150 con 0x7f508c09e420 2023-09-30T22:27:23.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.240+0000 7f508b7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f508c09e420 0x7f508c13f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.240+0000 7f508b7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f508c09e420 0x7f508c13f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55254/0 (socket says 172.21.15.40:55254) 2023-09-30T22:27:23.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.240+0000 7f508b7fe700 1 -- 172.21.15.40:0/742677486 learned_addr learned my addr 172.21.15.40:0/742677486 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:23.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.240+0000 7f508a7fc700 1 --2- 172.21.15.40:0/742677486 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f508c09e030 0x7f508c13d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.240+0000 7f508b7fe700 1 -- 172.21.15.40:0/742677486 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f508c09e030 msgr2=0x7f508c13d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:23.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.240+0000 7f508b7fe700 1 --2- 172.21.15.40:0/742677486 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f508c09e030 0x7f508c13d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.240+0000 7f508b7fe700 1 -- 172.21.15.40:0/742677486 >> v1:172.21.15.40:6789/0 conn(0x7f508c06a6d0 legacy=0x7f508c09d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.240+0000 7f508b7fe700 1 -- 172.21.15.40:0/742677486 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508c09f300 con 0x7f508c09e420 2023-09-30T22:27:23.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.240+0000 7f508b7fe700 1 --2- 172.21.15.40:0/742677486 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f508c09e420 0x7f508c13f9f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5084009e80 tx=0x7f508400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=616a7b6025eb75eb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:23.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.240+0000 7f5089ffb700 1 -- 172.21.15.40:0/742677486 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508400e070 con 0x7f508c09e420 2023-09-30T22:27:23.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.240+0000 7f5089ffb700 1 -- 172.21.15.40:0/742677486 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f508400b9c0 con 0x7f508c09e420 2023-09-30T22:27:23.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.240+0000 7f5089ffb700 1 -- 172.21.15.40:0/742677486 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508400bd70 con 0x7f508c09e420 2023-09-30T22:27:23.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.241+0000 7f50918f7700 1 -- 172.21.15.40:0/742677486 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f508c09e420 msgr2=0x7f508c13f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.241+0000 7f50918f7700 1 --2- 172.21.15.40:0/742677486 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f508c09e420 0x7f508c13f9f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5084009e80 tx=0x7f508400b330 comp rx=0 tx=0).stop 2023-09-30T22:27:23.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.241+0000 7f50918f7700 1 -- 172.21.15.40:0/742677486 shutdown_connections 2023-09-30T22:27:23.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.241+0000 7f50918f7700 1 --2- 172.21.15.40:0/742677486 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f508c09e420 0x7f508c13f9f0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.241+0000 7f50918f7700 1 --2- 172.21.15.40:0/742677486 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f508c09e030 0x7f508c13d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.241+0000 7f50918f7700 1 -- 172.21.15.40:0/742677486 >> 172.21.15.40:0/742677486 conn(0x7f508c09fb20 msgr2=0x7f508c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:23.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.241+0000 7f50918f7700 1 -- 172.21.15.40:0/742677486 shutdown_connections 2023-09-30T22:27:23.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.241+0000 7f50918f7700 1 -- 172.21.15.40:0/742677486 wait complete. 2023-09-30T22:27:23.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.242+0000 7f50918f7700 1 Processor -- start 2023-09-30T22:27:23.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.243+0000 7f50918f7700 1 -- start start 2023-09-30T22:27:23.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.243+0000 7f50918f7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f508c06a6d0 0x7f508c13e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.243+0000 7f50918f7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f508c09e030 0x7f508c13e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.243+0000 7f508a7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f508c09e030 0x7f508c13e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.243+0000 7f508a7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f508c09e030 0x7f508c13e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55260/0 (socket says 172.21.15.40:55260) 2023-09-30T22:27:23.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.243+0000 7f50918f7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f508c09e420 0x7f508c13eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.243+0000 7f508a7fc700 1 -- 172.21.15.40:0/634751893 learned_addr learned my addr 172.21.15.40:0/634751893 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:23.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.243+0000 7f50918f7700 1 -- 172.21.15.40:0/634751893 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c13fc90 con 0x7f508c09e420 2023-09-30T22:27:23.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.243+0000 7f50918f7700 1 -- 172.21.15.40:0/634751893 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f508c11fec0 con 0x7f508c06a6d0 2023-09-30T22:27:23.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.243+0000 7f50918f7700 1 -- 172.21.15.40:0/634751893 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f508c138ba0 con 0x7f508c09e030 2023-09-30T22:27:23.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.244+0000 7f508b7fe700 1 --2- 172.21.15.40:0/634751893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f508c09e420 0x7f508c13eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.243+0000 7f508affd700 1 --2- 172.21.15.40:0/634751893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f508c06a6d0 0x7f508c13e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.244+0000 7f508a7fc700 1 -- 172.21.15.40:0/634751893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f508c06a6d0 msgr2=0x7f508c13e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.244+0000 7f508a7fc700 1 --2- 172.21.15.40:0/634751893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f508c06a6d0 0x7f508c13e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.244+0000 7f508a7fc700 1 -- 172.21.15.40:0/634751893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f508c09e420 msgr2=0x7f508c13eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.244+0000 7f508a7fc700 1 --2- 172.21.15.40:0/634751893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f508c09e420 0x7f508c13eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.244+0000 7f508a7fc700 1 -- 172.21.15.40:0/634751893 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5084009b30 con 0x7f508c09e030 2023-09-30T22:27:23.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.244+0000 7f508a7fc700 1 --2- 172.21.15.40:0/634751893 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f508c09e030 0x7f508c13e980 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f508000e840 tx=0x7f508000ec00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:23.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.244+0000 7f5073fff700 1 -- 172.21.15.40:0/634751893 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5080013610 con 0x7f508c09e030 2023-09-30T22:27:23.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.244+0000 7f50918f7700 1 -- 172.21.15.40:0/634751893 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f508c121dd0 con 0x7f508c09e030 2023-09-30T22:27:23.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.244+0000 7f5073fff700 1 -- 172.21.15.40:0/634751893 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5080013770 con 0x7f508c09e030 2023-09-30T22:27:23.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.244+0000 7f5073fff700 1 -- 172.21.15.40:0/634751893 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5080013b00 con 0x7f508c09e030 2023-09-30T22:27:23.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.244+0000 7f50918f7700 1 -- 172.21.15.40:0/634751893 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f508c121110 con 0x7f508c09e030 2023-09-30T22:27:23.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.245+0000 7f5073fff700 1 -- 172.21.15.40:0/634751893 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5080013c60 con 0x7f508c09e030 2023-09-30T22:27:23.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.245+0000 7f5073fff700 1 -- 172.21.15.40:0/634751893 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f508003f5a0 con 0x7f508c09e030 2023-09-30T22:27:23.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.245+0000 7f50918f7700 1 -- 172.21.15.40:0/634751893 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f508c062380 con 0x7f508c09e030 2023-09-30T22:27:23.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.250+0000 7f5073fff700 1 -- 172.21.15.40:0/634751893 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5080012370 con 0x7f508c09e030 2023-09-30T22:27:23.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.330+0000 7fdaa4540700 1 -- 172.21.15.40:0/1513360337 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fda9c1216b0 con 0x7fda9c09e400 2023-09-30T22:27:23.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.331+0000 7fda92ffd700 1 -- 172.21.15.40:0/1513360337 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fda8c019b60 con 0x7fda9c09e400 2023-09-30T22:27:23.331 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:23.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.333+0000 7fdaa4540700 1 -- 172.21.15.40:0/1513360337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda9c09e400 msgr2=0x7fda9c11ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.333+0000 7fdaa4540700 1 --2- 172.21.15.40:0/1513360337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda9c09e400 0x7fda9c11ee20 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fda8c0098f0 tx=0x7fda8c004750 comp rx=0 tx=0).stop 2023-09-30T22:27:23.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.333+0000 7fdaa4540700 1 -- 172.21.15.40:0/1513360337 shutdown_connections 2023-09-30T22:27:23.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.333+0000 7fdaa4540700 1 --2- 172.21.15.40:0/1513360337 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda9c09d920 0x7fda9c11e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.333+0000 7fdaa4540700 1 --2- 172.21.15.40:0/1513360337 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda9c11f360 0x7fda9c1c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.333+0000 7fdaa4540700 1 --2- 172.21.15.40:0/1513360337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda9c09e400 0x7fda9c11ee20 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.333+0000 7fdaa4540700 1 -- 172.21.15.40:0/1513360337 >> 172.21.15.40:0/1513360337 conn(0x7fda9c09fb20 msgr2=0x7fda9c070950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:23.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.333+0000 7fdaa4540700 1 -- 172.21.15.40:0/1513360337 shutdown_connections 2023-09-30T22:27:23.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.333+0000 7fdaa4540700 1 -- 172.21.15.40:0/1513360337 wait complete. 2023-09-30T22:27:23.346 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:23.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.424+0000 7f699221d700 1 -- 172.21.15.40:0/743933424 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f698c074720 con 0x7f698c130fb0 2023-09-30T22:27:23.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.424+0000 7f6973fff700 1 -- 172.21.15.40:0/743933424 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f698401d3a0 con 0x7f698c130fb0 2023-09-30T22:27:23.443 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:23.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.426+0000 7f699221d700 1 -- 172.21.15.40:0/743933424 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f698c130fb0 msgr2=0x7f698c1c47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.426+0000 7f699221d700 1 --2- 172.21.15.40:0/743933424 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f698c130fb0 0x7f698c1c47a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f698c068480 tx=0x7f6984004ad0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.426+0000 7f699221d700 1 -- 172.21.15.40:0/743933424 shutdown_connections 2023-09-30T22:27:23.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.426+0000 7f699221d700 1 --2- 172.21.15.40:0/743933424 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f698c130fb0 0x7f698c1c47a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.426+0000 7f699221d700 1 --2- 172.21.15.40:0/743933424 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f698c09d920 0x7f698c1c3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.426+0000 7f699221d700 1 --2- 172.21.15.40:0/743933424 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f698c09e230 0x7f698c1c4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.426+0000 7f699221d700 1 -- 172.21.15.40:0/743933424 >> 172.21.15.40:0/743933424 conn(0x7f698c09fb20 msgr2=0x7f698c12dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:23.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.426+0000 7f699221d700 1 -- 172.21.15.40:0/743933424 shutdown_connections 2023-09-30T22:27:23.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.426+0000 7f699221d700 1 -- 172.21.15.40:0/743933424 wait complete. 2023-09-30T22:27:23.445 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:23.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.449+0000 7f50918f7700 1 -- 172.21.15.40:0/634751893 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f508c121b50 con 0x7f508c09e030 2023-09-30T22:27:23.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.450+0000 7f5073fff700 1 -- 172.21.15.40:0/634751893 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f508002b090 con 0x7f508c09e030 2023-09-30T22:27:23.450 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:23.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.452+0000 7f50918f7700 1 -- 172.21.15.40:0/634751893 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f508c09e030 msgr2=0x7f508c13e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.452+0000 7f50918f7700 1 --2- 172.21.15.40:0/634751893 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f508c09e030 0x7f508c13e980 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f508000e840 tx=0x7f508000ec00 comp rx=0 tx=0).stop 2023-09-30T22:27:23.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.452+0000 7f50918f7700 1 -- 172.21.15.40:0/634751893 shutdown_connections 2023-09-30T22:27:23.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.452+0000 7f50918f7700 1 --2- 172.21.15.40:0/634751893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f508c09e420 0x7f508c13eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.452+0000 7f50918f7700 1 --2- 172.21.15.40:0/634751893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f508c06a6d0 0x7f508c13e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.452+0000 7f50918f7700 1 --2- 172.21.15.40:0/634751893 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f508c09e030 0x7f508c13e980 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.452+0000 7f50918f7700 1 -- 172.21.15.40:0/634751893 >> 172.21.15.40:0/634751893 conn(0x7f508c09fb20 msgr2=0x7f508c071730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:23.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.452+0000 7f50918f7700 1 -- 172.21.15.40:0/634751893 shutdown_connections 2023-09-30T22:27:23.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.452+0000 7f50918f7700 1 -- 172.21.15.40:0/634751893 wait complete. 2023-09-30T22:27:23.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.460+0000 7f8a95c30700 1 -- 172.21.15.40:0/4006955676 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8a90062380 con 0x7f8a9009c890 2023-09-30T22:27:23.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.460+0000 7f8a77fff700 1 -- 172.21.15.40:0/4006955676 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8a80032090 con 0x7f8a9009c890 2023-09-30T22:27:23.461 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:23.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.463+0000 7f8a95c30700 1 -- 172.21.15.40:0/4006955676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a9009c890 msgr2=0x7f8a9012d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.463+0000 7f8a95c30700 1 --2- 172.21.15.40:0/4006955676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a9009c890 0x7f8a9012d560 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f8a80009b70 tx=0x7f8a80004750 comp rx=0 tx=0).stop 2023-09-30T22:27:23.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.464+0000 7f8a95c30700 1 -- 172.21.15.40:0/4006955676 shutdown_connections 2023-09-30T22:27:23.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.464+0000 7f8a95c30700 1 --2- 172.21.15.40:0/4006955676 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a9009e480 0x7f8a9012dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.464+0000 7f8a95c30700 1 --2- 172.21.15.40:0/4006955676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a9009c890 0x7f8a9012d560 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.464+0000 7f8a95c30700 1 --2- 172.21.15.40:0/4006955676 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a9009d920 0x7f8a9012daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.464+0000 7f8a95c30700 1 -- 172.21.15.40:0/4006955676 >> 172.21.15.40:0/4006955676 conn(0x7f8a900a7080 msgr2=0x7f8a900a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:23.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.464+0000 7f8a95c30700 1 -- 172.21.15.40:0/4006955676 shutdown_connections 2023-09-30T22:27:23.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:23.464+0000 7f8a95c30700 1 -- 172.21.15.40:0/4006955676 wait complete. 2023-09-30T22:27:23.467 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:23.477 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:24.347 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:24.446 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:24.467 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:24.478 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:24.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.488+0000 7fc753dbf700 1 Processor -- start 2023-09-30T22:27:24.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.489+0000 7fc753dbf700 1 -- start start 2023-09-30T22:27:24.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.489+0000 7fc753dbf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc74c09fbb0 0x7fc74c06c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:24.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.489+0000 7fc753dbf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc74c06d2c0 0x7fc74c13baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:24.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.489+0000 7fc753dbf700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc74c0a0590 con 0x7fc74c06ced0 2023-09-30T22:27:24.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.489+0000 7fc753dbf700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc74c09ff80 con 0x7fc74c06d2c0 2023-09-30T22:27:24.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.489+0000 7fc753dbf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c06da80 con 0x7fc74c09fbb0 2023-09-30T22:27:24.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.489+0000 7fc75235c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc74c06d2c0 0x7fc74c13baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:24.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.489+0000 7fc751b5b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc74c09fbb0 0x7fc74c06c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:24.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.489+0000 7fc75235c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc74c06d2c0 0x7fc74c13baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59624/0 (socket says 172.21.15.40:59624) 2023-09-30T22:27:24.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.489+0000 7fc751b5b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc74c09fbb0 0x7fc74c06c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55274/0 (socket says 172.21.15.40:55274) 2023-09-30T22:27:24.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.489+0000 7fc75235c700 1 -- 172.21.15.40:0/4266896921 learned_addr learned my addr 172.21.15.40:0/4266896921 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:24.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.490+0000 7fc75235c700 1 -- 172.21.15.40:0/4266896921 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc74c09fbb0 msgr2=0x7fc74c06c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:24.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.490+0000 7fc75235c700 1 --2- 172.21.15.40:0/4266896921 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc74c09fbb0 0x7fc74c06c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.490+0000 7fc75235c700 1 -- 172.21.15.40:0/4266896921 >> v1:172.21.15.40:6789/0 conn(0x7fc74c06ced0 legacy=0x7fc74c138370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:24.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.490+0000 7fc75235c700 1 -- 172.21.15.40:0/4266896921 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc74c0a0780 con 0x7fc74c06d2c0 2023-09-30T22:27:24.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.490+0000 7fc750b59700 1 -- 172.21.15.40:0/4266896921 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 391238126 0 0) 0x7fc74c0a0590 con 0x7fc74c06ced0 2023-09-30T22:27:24.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.490+0000 7fc751b5b700 1 --2- 172.21.15.40:0/4266896921 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc74c09fbb0 0x7fc74c06c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:24.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.490+0000 7fc75235c700 1 --2- 172.21.15.40:0/4266896921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc74c06d2c0 0x7fc74c13baa0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fc744009e50 tx=0x7fc74400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e91dacf392231f6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:24.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.490+0000 7fc750b59700 1 -- 172.21.15.40:0/4266896921 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74400e070 con 0x7fc74c06d2c0 2023-09-30T22:27:24.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.490+0000 7fc750b59700 1 -- 172.21.15.40:0/4266896921 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74400b910 con 0x7fc74c06d2c0 2023-09-30T22:27:24.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.490+0000 7fc750b59700 1 -- 172.21.15.40:0/4266896921 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74400bcc0 con 0x7fc74c06d2c0 2023-09-30T22:27:24.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.491+0000 7fc753dbf700 1 -- 172.21.15.40:0/4266896921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc74c06d2c0 msgr2=0x7fc74c13baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:24.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.491+0000 7fc753dbf700 1 --2- 172.21.15.40:0/4266896921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc74c06d2c0 0x7fc74c13baa0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fc744009e50 tx=0x7fc74400b330 comp rx=0 tx=0).stop 2023-09-30T22:27:24.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.491+0000 7fc753dbf700 1 -- 172.21.15.40:0/4266896921 shutdown_connections 2023-09-30T22:27:24.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.491+0000 7fc753dbf700 1 --2- 172.21.15.40:0/4266896921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc74c06d2c0 0x7fc74c13baa0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.491+0000 7fc753dbf700 1 --2- 172.21.15.40:0/4266896921 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc74c09fbb0 0x7fc74c06c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.491+0000 7fc753dbf700 1 -- 172.21.15.40:0/4266896921 >> 172.21.15.40:0/4266896921 conn(0x7fc74c0a41a0 msgr2=0x7fc74c0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:24.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.491+0000 7fc753dbf700 1 -- 172.21.15.40:0/4266896921 shutdown_connections 2023-09-30T22:27:24.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.491+0000 7fc753dbf700 1 -- 172.21.15.40:0/4266896921 wait complete. 2023-09-30T22:27:24.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.492+0000 7fc753dbf700 1 Processor -- start 2023-09-30T22:27:24.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.492+0000 7fc753dbf700 1 -- start start 2023-09-30T22:27:24.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.493+0000 7fc753dbf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc74c06ced0 0x7fc74c1bc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:24.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.493+0000 7fc753dbf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc74c06d2c0 0x7fc74c1bc920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:24.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.493+0000 7fc753dbf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc74c09fbb0 0x7fc74c095b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:24.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.493+0000 7fc753dbf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c094da0 con 0x7fc74c06d2c0 2023-09-30T22:27:24.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.493+0000 7fc753dbf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c0715a0 con 0x7fc74c09fbb0 2023-09-30T22:27:24.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.493+0000 7fc753dbf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c071eb0 con 0x7fc74c06ced0 2023-09-30T22:27:24.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.493+0000 7fc75135a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc74c06d2c0 0x7fc74c1bc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:24.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.493+0000 7fc75135a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc74c06d2c0 0x7fc74c1bc920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59636/0 (socket says 172.21.15.40:59636) 2023-09-30T22:27:24.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.493+0000 7fc75135a700 1 -- 172.21.15.40:0/417235022 learned_addr learned my addr 172.21.15.40:0/417235022 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:24.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.493+0000 7fc751b5b700 1 --2- 172.21.15.40:0/417235022 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc74c06ced0 0x7fc74c1bc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:24.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.493+0000 7fc75235c700 1 --2- 172.21.15.40:0/417235022 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc74c09fbb0 0x7fc74c095b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:24.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.494+0000 7fc75135a700 1 -- 172.21.15.40:0/417235022 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc74c06ced0 msgr2=0x7fc74c1bc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:24.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.494+0000 7fc75135a700 1 --2- 172.21.15.40:0/417235022 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc74c06ced0 0x7fc74c1bc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.494+0000 7fc75135a700 1 -- 172.21.15.40:0/417235022 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc74c09fbb0 msgr2=0x7fc74c095b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:24.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.494+0000 7fc75135a700 1 --2- 172.21.15.40:0/417235022 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc74c09fbb0 0x7fc74c095b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.494+0000 7fc75135a700 1 -- 172.21.15.40:0/417235022 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc73c0094a0 con 0x7fc74c06d2c0 2023-09-30T22:27:24.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.494+0000 7fc75135a700 1 --2- 172.21.15.40:0/417235022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc74c06d2c0 0x7fc74c1bc920 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc74000c550 tx=0x7fc74000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:24.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.494+0000 7fc74a7fc700 1 -- 172.21.15.40:0/417235022 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7400054e0 con 0x7fc74c06d2c0 2023-09-30T22:27:24.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.494+0000 7fc753dbf700 1 -- 172.21.15.40:0/417235022 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc744009b30 con 0x7fc74c06d2c0 2023-09-30T22:27:24.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.494+0000 7fc74a7fc700 1 -- 172.21.15.40:0/417235022 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc740003680 con 0x7fc74c06d2c0 2023-09-30T22:27:24.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.494+0000 7fc74a7fc700 1 -- 172.21.15.40:0/417235022 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc740003a30 con 0x7fc74c06d2c0 2023-09-30T22:27:24.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.494+0000 7fc753dbf700 1 -- 172.21.15.40:0/417235022 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc74c1bce60 con 0x7fc74c06d2c0 2023-09-30T22:27:24.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.495+0000 7fc74a7fc700 1 -- 172.21.15.40:0/417235022 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc740003b90 con 0x7fc74c06d2c0 2023-09-30T22:27:24.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.495+0000 7fc74a7fc700 1 -- 172.21.15.40:0/417235022 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc74003eb00 con 0x7fc74c06d2c0 2023-09-30T22:27:24.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.495+0000 7fc753dbf700 1 -- 172.21.15.40:0/417235022 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc74c062380 con 0x7fc74c06d2c0 2023-09-30T22:27:24.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.504+0000 7fc74a7fc700 1 -- 172.21.15.40:0/417235022 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc740017080 con 0x7fc74c06d2c0 2023-09-30T22:27:24.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.587+0000 7f26c068f700 1 Processor -- start 2023-09-30T22:27:24.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.587+0000 7f26c068f700 1 -- start start 2023-09-30T22:27:24.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.588+0000 7f26c068f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f26b809d920 0x7f26b809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:24.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.588+0000 7f26c068f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26b809f0f0 0x7f26b809e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:24.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.588+0000 7f26c068f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f26b8133ca0 0x7f26b8134110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:24.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.588+0000 7f26c068f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26b806b4c0 con 0x7f26b809d920 2023-09-30T22:27:24.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.588+0000 7f26c068f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b809a8f0 con 0x7f26b809f0f0 2023-09-30T22:27:24.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.588+0000 7f26c068f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26b809f940 con 0x7f26b8133ca0 2023-09-30T22:27:24.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.588+0000 7f26be42b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f26b809d920 0x7f26b809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:24.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.588+0000 7f26be42b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f26b809d920 0x7f26b809dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59646/0 (socket says 172.21.15.40:59646) 2023-09-30T22:27:24.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.588+0000 7f26be42b700 1 -- 172.21.15.40:0/495983879 learned_addr learned my addr 172.21.15.40:0/495983879 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:24.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.588+0000 7f26bdc2a700 1 --2- 172.21.15.40:0/495983879 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26b809f0f0 0x7f26b809e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:24.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.588+0000 7f26bec2c700 1 --2- 172.21.15.40:0/495983879 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f26b8133ca0 0x7f26b8134110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:24.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.588+0000 7f26be42b700 1 -- 172.21.15.40:0/495983879 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f26b8133ca0 msgr2=0x7f26b8134110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:24.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.588+0000 7f26be42b700 1 --2- 172.21.15.40:0/495983879 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f26b8133ca0 0x7f26b8134110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.588+0000 7f26be42b700 1 -- 172.21.15.40:0/495983879 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26b809f0f0 msgr2=0x7f26b809e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:24.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.588+0000 7f26be42b700 1 --2- 172.21.15.40:0/495983879 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26b809f0f0 0x7f26b809e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.588+0000 7f26be42b700 1 -- 172.21.15.40:0/495983879 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b809f6e0 con 0x7f26b809d920 2023-09-30T22:27:24.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.588+0000 7f26bec2c700 1 --2- 172.21.15.40:0/495983879 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f26b8133ca0 0x7f26b8134110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:27:24.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.588+0000 7f26be42b700 1 --2- 172.21.15.40:0/495983879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b809d920 0x7f26b809dcf0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f26b40098f0 tx=0x7f26b4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53cffcf4a89198be server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:24.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.589+0000 7f26bd429700 1 -- 172.21.15.40:0/495983879 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b4005e30 con 0x7f26b809d920 2023-09-30T22:27:24.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.589+0000 7f26bd429700 1 -- 172.21.15.40:0/495983879 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b4004030 con 0x7f26b809d920 2023-09-30T22:27:24.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.589+0000 7f26bd429700 1 -- 172.21.15.40:0/495983879 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b40043e0 con 0x7f26b809d920 2023-09-30T22:27:24.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.589+0000 7f26c068f700 1 -- 172.21.15.40:0/495983879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b809d920 msgr2=0x7f26b809dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:24.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.589+0000 7f26c068f700 1 --2- 172.21.15.40:0/495983879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b809d920 0x7f26b809dcf0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f26b40098f0 tx=0x7f26b4009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:24.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.590+0000 7f26c068f700 1 -- 172.21.15.40:0/495983879 shutdown_connections 2023-09-30T22:27:24.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.590+0000 7f26c068f700 1 --2- 172.21.15.40:0/495983879 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f26b8133ca0 0x7f26b8134110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.590+0000 7f26c068f700 1 --2- 172.21.15.40:0/495983879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b809d920 0x7f26b809dcf0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.590+0000 7f26c068f700 1 --2- 172.21.15.40:0/495983879 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26b809f0f0 0x7f26b809e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.590+0000 7f26c068f700 1 -- 172.21.15.40:0/495983879 >> 172.21.15.40:0/495983879 conn(0x7f26b809fb20 msgr2=0x7f26b809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:24.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.590+0000 7f26c068f700 1 -- 172.21.15.40:0/495983879 shutdown_connections 2023-09-30T22:27:24.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.590+0000 7f26c068f700 1 -- 172.21.15.40:0/495983879 wait complete. 2023-09-30T22:27:24.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.591+0000 7f26c068f700 1 Processor -- start 2023-09-30T22:27:24.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.591+0000 7f26c068f700 1 -- start start 2023-09-30T22:27:24.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.592+0000 7f26c068f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26b809d920 0x7f26b8121890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:24.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.592+0000 7f26c068f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b8133ca0 0x7f26b8121dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:24.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.592+0000 7f26c068f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f26b8122310 0x7f26b81ce800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:24.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.592+0000 7f26c068f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b8123cf0 con 0x7f26b8133ca0 2023-09-30T22:27:24.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.592+0000 7f26c068f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b80a2a30 con 0x7f26b809d920 2023-09-30T22:27:24.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.592+0000 7f26c068f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26b8123530 con 0x7f26b8122310 2023-09-30T22:27:24.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.592+0000 7f26bdc2a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b8133ca0 0x7f26b8121dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:24.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.592+0000 7f26bec2c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f26b8122310 0x7f26b81ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:24.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.592+0000 7f26bdc2a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b8133ca0 0x7f26b8121dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59652/0 (socket says 172.21.15.40:59652) 2023-09-30T22:27:24.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.592+0000 7f26bdc2a700 1 -- 172.21.15.40:0/1921760523 learned_addr learned my addr 172.21.15.40:0/1921760523 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:24.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.592+0000 7f26be42b700 1 --2- 172.21.15.40:0/1921760523 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26b809d920 0x7f26b8121890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:24.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.592+0000 7f26bec2c700 1 -- 172.21.15.40:0/1921760523 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26b809d920 msgr2=0x7f26b8121890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:24.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.592+0000 7f26bec2c700 1 --2- 172.21.15.40:0/1921760523 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26b809d920 0x7f26b8121890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.592+0000 7f26bec2c700 1 -- 172.21.15.40:0/1921760523 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b8133ca0 msgr2=0x7f26b8121dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:24.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.592+0000 7f26bec2c700 1 --2- 172.21.15.40:0/1921760523 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b8133ca0 0x7f26b8121dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.592+0000 7f26bec2c700 1 -- 172.21.15.40:0/1921760523 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b4009500 con 0x7f26b8122310 2023-09-30T22:27:24.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.593+0000 7f26bdc2a700 1 --2- 172.21.15.40:0/1921760523 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b8133ca0 0x7f26b8121dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:24.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.593+0000 7f26bec2c700 1 --2- 172.21.15.40:0/1921760523 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f26b8122310 0x7f26b81ce800 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f26b000cdf0 tx=0x7f26b000ce20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:24.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.593+0000 7f26aeffd700 1 -- 172.21.15.40:0/1921760523 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b000ad40 con 0x7f26b8122310 2023-09-30T22:27:24.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.593+0000 7f26aeffd700 1 -- 172.21.15.40:0/1921760523 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b0015440 con 0x7f26b8122310 2023-09-30T22:27:24.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.593+0000 7f26aeffd700 1 -- 172.21.15.40:0/1921760523 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b000aea0 con 0x7f26b8122310 2023-09-30T22:27:24.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.593+0000 7f26c068f700 1 -- 172.21.15.40:0/1921760523 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26b8125050 con 0x7f26b8122310 2023-09-30T22:27:24.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.593+0000 7f26c068f700 1 -- 172.21.15.40:0/1921760523 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26b8125ac0 con 0x7f26b8122310 2023-09-30T22:27:24.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.594+0000 7f26aeffd700 1 -- 172.21.15.40:0/1921760523 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f26b000d430 con 0x7f26b8122310 2023-09-30T22:27:24.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.594+0000 7f26c068f700 1 -- 172.21.15.40:0/1921760523 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26b8062380 con 0x7f26b8122310 2023-09-30T22:27:24.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.594+0000 7f26aeffd700 1 -- 172.21.15.40:0/1921760523 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f26b003fb90 con 0x7f26b8122310 2023-09-30T22:27:24.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.603+0000 7f26aeffd700 1 -- 172.21.15.40:0/1921760523 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f26b0008910 con 0x7f26b8122310 2023-09-30T22:27:24.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.625+0000 7f73b8093700 1 Processor -- start 2023-09-30T22:27:24.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.626+0000 7f73b8093700 1 -- start start 2023-09-30T22:27:24.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.626+0000 7f73b8093700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73b006f070 0x7f73b006f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:24.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.626+0000 7f73b8093700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73b006f980 0x7f73b0097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:24.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.626+0000 7f73b8093700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73b0070830 con 0x7f73b006fdb0 2023-09-30T22:27:24.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.626+0000 7f73b8093700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b0071af0 con 0x7f73b006f980 2023-09-30T22:27:24.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.626+0000 7f73b8093700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73b0070ad0 con 0x7f73b006f070 2023-09-30T22:27:24.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.626+0000 7f73b6630700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f73b006fdb0 0x7f73b00975d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56508/0 (socket says 172.21.15.40:56508) 2023-09-30T22:27:24.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.626+0000 7f73b6630700 1 -- 172.21.15.40:0/776906210 learned_addr learned my addr 172.21.15.40:0/776906210 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:27:24.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.626+0000 7f73b562e700 1 --2- 172.21.15.40:0/776906210 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73b006f980 0x7f73b0097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:24.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.626+0000 7f73b5e2f700 1 --2- 172.21.15.40:0/776906210 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73b006f070 0x7f73b006f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:24.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.627+0000 7f73b562e700 1 -- 172.21.15.40:0/776906210 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73b006f070 msgr2=0x7f73b006f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:24.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.627+0000 7f73b562e700 1 --2- 172.21.15.40:0/776906210 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73b006f070 0x7f73b006f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.627+0000 7f73b562e700 1 -- 172.21.15.40:0/776906210 >> v1:172.21.15.40:6789/0 conn(0x7f73b006fdb0 legacy=0x7f73b00975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:24.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.627+0000 7f73b562e700 1 -- 172.21.15.40:0/776906210 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b0070de0 con 0x7f73b006f980 2023-09-30T22:27:24.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.627+0000 7f73b5e2f700 1 --2- 172.21.15.40:0/776906210 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73b006f070 0x7f73b006f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:24.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.627+0000 7f73b562e700 1 --2- 172.21.15.40:0/776906210 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73b006f980 0x7f73b0097090 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f73a0009870 tx=0x7f73a0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c40d5ab1014823c1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:24.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.627+0000 7f73b4e2d700 1 -- 172.21.15.40:0/776906210 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a0004230 con 0x7f73b006f980 2023-09-30T22:27:24.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.627+0000 7f73b4e2d700 1 -- 172.21.15.40:0/776906210 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a0004390 con 0x7f73b006f980 2023-09-30T22:27:24.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.627+0000 7f73b4e2d700 1 -- 172.21.15.40:0/776906210 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a00036a0 con 0x7f73b006f980 2023-09-30T22:27:24.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.628+0000 7f73b8093700 1 -- 172.21.15.40:0/776906210 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73b006f980 msgr2=0x7f73b0097090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:24.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.628+0000 7f73b8093700 1 --2- 172.21.15.40:0/776906210 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73b006f980 0x7f73b0097090 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f73a0009870 tx=0x7f73a0009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:24.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.628+0000 7f73b8093700 1 -- 172.21.15.40:0/776906210 shutdown_connections 2023-09-30T22:27:24.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.628+0000 7f73b8093700 1 --2- 172.21.15.40:0/776906210 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73b006f070 0x7f73b006f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.628+0000 7f73b8093700 1 --2- 172.21.15.40:0/776906210 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73b006f980 0x7f73b0097090 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.628+0000 7f73b8093700 1 -- 172.21.15.40:0/776906210 >> 172.21.15.40:0/776906210 conn(0x7f73b00a41a0 msgr2=0x7f73b00a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:24.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.628+0000 7f73b8093700 1 -- 172.21.15.40:0/776906210 shutdown_connections 2023-09-30T22:27:24.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.628+0000 7f73b8093700 1 -- 172.21.15.40:0/776906210 wait complete. 2023-09-30T22:27:24.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.629+0000 7f73b8093700 1 Processor -- start 2023-09-30T22:27:24.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.630+0000 7f73b8093700 1 -- start start 2023-09-30T22:27:24.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.630+0000 7f73b8093700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73b006f070 0x7f73b006c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:24.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.630+0000 7f73b8093700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73b006f980 0x7f73b006ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:24.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.630+0000 7f73b8093700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73b006fdb0 0x7f73b006d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:24.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.630+0000 7f73b8093700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b008b150 con 0x7f73b006f980 2023-09-30T22:27:24.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.630+0000 7f73b8093700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b01296c0 con 0x7f73b006f070 2023-09-30T22:27:24.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.630+0000 7f73b8093700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73b006dbe0 con 0x7f73b006fdb0 2023-09-30T22:27:24.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.631+0000 7f37c710e700 1 Processor -- start 2023-09-30T22:27:24.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.631+0000 7f73b5e2f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73b006f070 0x7f73b006c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:24.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.631+0000 7f73b5e2f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73b006f070 0x7f73b006c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:58082/0 (socket says 172.21.15.40:58082) 2023-09-30T22:27:24.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.631+0000 7f73b5e2f700 1 -- 172.21.15.40:0/1692844860 learned_addr learned my addr 172.21.15.40:0/1692844860 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:24.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.631+0000 7f37c710e700 1 -- start start 2023-09-30T22:27:24.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.631+0000 7f73b5e2f700 1 -- 172.21.15.40:0/1692844860 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73b006fdb0 msgr2=0x7f73b006d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:24.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.631+0000 7f73b5e2f700 1 --2- 172.21.15.40:0/1692844860 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73b006fdb0 0x7f73b006d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.631+0000 7f73b5e2f700 1 -- 172.21.15.40:0/1692844860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73b006f980 msgr2=0x7f73b006ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:24.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.631+0000 7f73b5e2f700 1 --2- 172.21.15.40:0/1692844860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73b006f980 0x7f73b006ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.631+0000 7f73b5e2f700 1 -- 172.21.15.40:0/1692844860 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a00094a0 con 0x7f73b006f070 2023-09-30T22:27:24.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.631+0000 7f73b5e2f700 1 --2- 172.21.15.40:0/1692844860 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73b006f070 0x7f73b006c990 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f73ac00e840 tx=0x7f73ac00ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:24.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.631+0000 7f37c710e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37c009d920 0x7f37c009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:24.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.631+0000 7f37c710e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f37c009e230 0x7f37c01308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:24.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.631+0000 7f37c710e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f37c0130de0 0x7f37c0131260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:24.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.631+0000 7f37c710e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37c009edf0 con 0x7f37c009e230 2023-09-30T22:27:24.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.631+0000 7f37c710e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c009adf0 con 0x7f37c009d920 2023-09-30T22:27:24.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.631+0000 7f37c710e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37c009b660 con 0x7f37c0130de0 2023-09-30T22:27:24.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.632+0000 7f37c4eaa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37c009d920 0x7f37c009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:24.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.632+0000 7f37c4eaa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37c009d920 0x7f37c009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:58090/0 (socket says 172.21.15.40:58090) 2023-09-30T22:27:24.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.632+0000 7f37c4eaa700 1 -- 172.21.15.40:0/3875565198 learned_addr learned my addr 172.21.15.40:0/3875565198 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:24.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.632+0000 7f37c4eaa700 1 -- 172.21.15.40:0/3875565198 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f37c0130de0 msgr2=0x7f37c0131260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:24.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.632+0000 7f37c4eaa700 1 --2- 172.21.15.40:0/3875565198 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f37c0130de0 0x7f37c0131260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.632+0000 7f37c4eaa700 1 -- 172.21.15.40:0/3875565198 >> v2:172.21.15.40:3300/0 conn(0x7f37c009e230 msgr2=0x7f37c01308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:24.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.632+0000 7f37c4eaa700 1 --2- 172.21.15.40:0/3875565198 >> v2:172.21.15.40:3300/0 conn(0x7f37c009e230 0x7f37c01308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.632+0000 7f37c4eaa700 1 -- 172.21.15.40:0/3875565198 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c009a6e0 con 0x7f37c009d920 2023-09-30T22:27:24.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.633+0000 7f37c4eaa700 1 --2- 172.21.15.40:0/3875565198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37c009d920 0x7f37c009dcf0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f37b0006fd0 tx=0x7f37b0009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bed06655ccc3553 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:24.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.632+0000 7f73a67fc700 1 -- 172.21.15.40:0/1692844860 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ac013610 con 0x7f73b006f070 2023-09-30T22:27:24.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.632+0000 7f73a67fc700 1 -- 172.21.15.40:0/1692844860 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73ac013770 con 0x7f73b006f070 2023-09-30T22:27:24.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.632+0000 7f73a67fc700 1 -- 172.21.15.40:0/1692844860 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ac013b20 con 0x7f73b006f070 2023-09-30T22:27:24.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.632+0000 7f73b8093700 1 -- 172.21.15.40:0/1692844860 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73b012c2d0 con 0x7f73b006f070 2023-09-30T22:27:24.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.632+0000 7f73b8093700 1 -- 172.21.15.40:0/1692844860 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73b008bd80 con 0x7f73b006f070 2023-09-30T22:27:24.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.633+0000 7f37bf7fe700 1 -- 172.21.15.40:0/3875565198 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b0005e30 con 0x7f37c009d920 2023-09-30T22:27:24.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.633+0000 7f37bf7fe700 1 -- 172.21.15.40:0/3875565198 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b0004030 con 0x7f37c009d920 2023-09-30T22:27:24.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.633+0000 7f37bf7fe700 1 -- 172.21.15.40:0/3875565198 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b00043e0 con 0x7f37c009d920 2023-09-30T22:27:24.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.633+0000 7f73a67fc700 1 -- 172.21.15.40:0/1692844860 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f73ac013c80 con 0x7f73b006f070 2023-09-30T22:27:24.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.633+0000 7f73a67fc700 1 -- 172.21.15.40:0/1692844860 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f73ac03f4d0 con 0x7f73b006f070 2023-09-30T22:27:24.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.634+0000 7f73b8093700 1 -- 172.21.15.40:0/1692844860 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73b0062380 con 0x7f73b006f070 2023-09-30T22:27:24.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.634+0000 7f37c710e700 1 -- 172.21.15.40:0/3875565198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37c009d920 msgr2=0x7f37c009dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:24.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.634+0000 7f37c710e700 1 --2- 172.21.15.40:0/3875565198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37c009d920 0x7f37c009dcf0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f37b0006fd0 tx=0x7f37b0009bd0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.634+0000 7f37c710e700 1 -- 172.21.15.40:0/3875565198 shutdown_connections 2023-09-30T22:27:24.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.634+0000 7f37c710e700 1 --2- 172.21.15.40:0/3875565198 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f37c0130de0 0x7f37c0131260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.634+0000 7f37c710e700 1 --2- 172.21.15.40:0/3875565198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37c009d920 0x7f37c009dcf0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.634+0000 7f37c710e700 1 --2- 172.21.15.40:0/3875565198 >> v2:172.21.15.40:3300/0 conn(0x7f37c009e230 0x7f37c01308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.634+0000 7f37c710e700 1 -- 172.21.15.40:0/3875565198 >> 172.21.15.40:0/3875565198 conn(0x7f37c009fb20 msgr2=0x7f37c009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:24.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.638+0000 7f37c710e700 1 -- 172.21.15.40:0/3875565198 shutdown_connections 2023-09-30T22:27:24.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.639+0000 7f73a67fc700 1 -- 172.21.15.40:0/1692844860 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f73ac021080 con 0x7f73b006f070 2023-09-30T22:27:24.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.640+0000 7f37c710e700 1 -- 172.21.15.40:0/3875565198 wait complete. 2023-09-30T22:27:24.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.642+0000 7f37c710e700 1 Processor -- start 2023-09-30T22:27:24.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.642+0000 7f37c710e700 1 -- start start 2023-09-30T22:27:24.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.643+0000 7f37c710e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37c009d920 0x7f37c0129f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:24.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.643+0000 7f37c710e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f37c009e230 0x7f37c012a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:24.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.643+0000 7f37c710e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37c0130de0 0x7f37c012aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:24.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.643+0000 7f37c710e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c012d260 con 0x7f37c0130de0 2023-09-30T22:27:24.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.643+0000 7f37c710e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c012c3f0 con 0x7f37c009d920 2023-09-30T22:27:24.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.643+0000 7f37c710e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37c012d070 con 0x7f37c009e230 2023-09-30T22:27:24.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.643+0000 7f37c4eaa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37c009d920 0x7f37c0129f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:24.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.643+0000 7f37c4eaa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37c009d920 0x7f37c0129f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:58096/0 (socket says 172.21.15.40:58096) 2023-09-30T22:27:24.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.643+0000 7f37c4eaa700 1 -- 172.21.15.40:0/215234687 learned_addr learned my addr 172.21.15.40:0/215234687 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:24.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.643+0000 7f37c56ab700 1 --2- 172.21.15.40:0/215234687 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37c0130de0 0x7f37c012aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:24.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.644+0000 7f37c4eaa700 1 -- 172.21.15.40:0/215234687 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f37c009e230 msgr2=0x7f37c012a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:24.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.644+0000 7f37c4eaa700 1 --2- 172.21.15.40:0/215234687 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f37c009e230 0x7f37c012a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.644+0000 7f37c4eaa700 1 -- 172.21.15.40:0/215234687 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37c0130de0 msgr2=0x7f37c012aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:24.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.644+0000 7f37c4eaa700 1 --2- 172.21.15.40:0/215234687 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37c0130de0 0x7f37c012aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.644+0000 7f37c4eaa700 1 -- 172.21.15.40:0/215234687 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b0009500 con 0x7f37c009d920 2023-09-30T22:27:24.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.644+0000 7f37c4eaa700 1 --2- 172.21.15.40:0/215234687 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37c009d920 0x7f37c0129f90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f37b0009c10 tx=0x7f37b0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:24.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.645+0000 7f37bd7fa700 1 -- 172.21.15.40:0/215234687 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b002e640 con 0x7f37c009d920 2023-09-30T22:27:24.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.645+0000 7f37bd7fa700 1 -- 172.21.15.40:0/215234687 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b0006b70 con 0x7f37c009d920 2023-09-30T22:27:24.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.645+0000 7f37bd7fa700 1 -- 172.21.15.40:0/215234687 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b002e9c0 con 0x7f37c009d920 2023-09-30T22:27:24.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.645+0000 7f37c710e700 1 -- 172.21.15.40:0/215234687 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c012d740 con 0x7f37c009d920 2023-09-30T22:27:24.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.645+0000 7f37c710e700 1 -- 172.21.15.40:0/215234687 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c009cb00 con 0x7f37c009d920 2023-09-30T22:27:24.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.646+0000 7f37c56ab700 1 --2- 172.21.15.40:0/215234687 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37c0130de0 0x7f37c012aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:24.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.646+0000 7f37c710e700 1 -- 172.21.15.40:0/215234687 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37c013b6b0 con 0x7f37c009d920 2023-09-30T22:27:24.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.646+0000 7f37bd7fa700 1 -- 172.21.15.40:0/215234687 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f37b002eb20 con 0x7f37c009d920 2023-09-30T22:27:24.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.647+0000 7f37bd7fa700 1 -- 172.21.15.40:0/215234687 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f37b0051e00 con 0x7f37c009d920 2023-09-30T22:27:24.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.655+0000 7f37bd7fa700 1 -- 172.21.15.40:0/215234687 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f37b0003e40 con 0x7f37c009d920 2023-09-30T22:27:24.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.722+0000 7fc753dbf700 1 -- 172.21.15.40:0/417235022 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc74c06df20 con 0x7fc74c06d2c0 2023-09-30T22:27:24.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.722+0000 7fc74a7fc700 1 -- 172.21.15.40:0/417235022 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc740003e40 con 0x7fc74c06d2c0 2023-09-30T22:27:24.723 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:24.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.724+0000 7fc753dbf700 1 -- 172.21.15.40:0/417235022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc74c06d2c0 msgr2=0x7fc74c1bc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:24.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.724+0000 7fc753dbf700 1 --2- 172.21.15.40:0/417235022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc74c06d2c0 0x7fc74c1bc920 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc74000c550 tx=0x7fc74000c860 comp rx=0 tx=0).stop 2023-09-30T22:27:24.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.724+0000 7fc753dbf700 1 -- 172.21.15.40:0/417235022 shutdown_connections 2023-09-30T22:27:24.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.724+0000 7fc753dbf700 1 --2- 172.21.15.40:0/417235022 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc74c06ced0 0x7fc74c1bc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.724+0000 7fc753dbf700 1 --2- 172.21.15.40:0/417235022 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc74c09fbb0 0x7fc74c095b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.724+0000 7fc753dbf700 1 --2- 172.21.15.40:0/417235022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc74c06d2c0 0x7fc74c1bc920 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.724+0000 7fc753dbf700 1 -- 172.21.15.40:0/417235022 >> 172.21.15.40:0/417235022 conn(0x7fc74c0a41a0 msgr2=0x7fc74c0a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:24.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.725+0000 7fc753dbf700 1 -- 172.21.15.40:0/417235022 shutdown_connections 2023-09-30T22:27:24.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.725+0000 7fc753dbf700 1 -- 172.21.15.40:0/417235022 wait complete. 2023-09-30T22:27:24.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:24.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.815+0000 7f26c068f700 1 -- 172.21.15.40:0/1921760523 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f26b8074720 con 0x7f26b8122310 2023-09-30T22:27:24.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.815+0000 7f26aeffd700 1 -- 172.21.15.40:0/1921760523 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f26b001a030 con 0x7f26b8122310 2023-09-30T22:27:24.816 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:24.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.817+0000 7f26c068f700 1 -- 172.21.15.40:0/1921760523 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f26b8122310 msgr2=0x7f26b81ce800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:24.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.817+0000 7f26c068f700 1 --2- 172.21.15.40:0/1921760523 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f26b8122310 0x7f26b81ce800 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f26b000cdf0 tx=0x7f26b000ce20 comp rx=0 tx=0).stop 2023-09-30T22:27:24.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.817+0000 7f26c068f700 1 -- 172.21.15.40:0/1921760523 shutdown_connections 2023-09-30T22:27:24.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.817+0000 7f26c068f700 1 --2- 172.21.15.40:0/1921760523 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f26b8122310 0x7f26b81ce800 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.817+0000 7f26c068f700 1 --2- 172.21.15.40:0/1921760523 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26b809d920 0x7f26b8121890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.817+0000 7f26c068f700 1 --2- 172.21.15.40:0/1921760523 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b8133ca0 0x7f26b8121dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.817+0000 7f26c068f700 1 -- 172.21.15.40:0/1921760523 >> 172.21.15.40:0/1921760523 conn(0x7f26b809fb20 msgr2=0x7f26b80a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:24.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.817+0000 7f26c068f700 1 -- 172.21.15.40:0/1921760523 shutdown_connections 2023-09-30T22:27:24.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.818+0000 7f26c068f700 1 -- 172.21.15.40:0/1921760523 wait complete. 2023-09-30T22:27:24.830 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:24.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.840+0000 7f73b8093700 1 -- 172.21.15.40:0/1692844860 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f73b008b750 con 0x7f73b006f070 2023-09-30T22:27:24.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.841+0000 7f73a67fc700 1 -- 172.21.15.40:0/1692844860 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f73ac00c420 con 0x7f73b006f070 2023-09-30T22:27:24.841 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:24.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.843+0000 7f73b8093700 1 -- 172.21.15.40:0/1692844860 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73b006f070 msgr2=0x7f73b006c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:24.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.843+0000 7f73b8093700 1 --2- 172.21.15.40:0/1692844860 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73b006f070 0x7f73b006c990 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f73ac00e840 tx=0x7f73ac00ec00 comp rx=0 tx=0).stop 2023-09-30T22:27:24.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.843+0000 7f73b8093700 1 -- 172.21.15.40:0/1692844860 shutdown_connections 2023-09-30T22:27:24.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.843+0000 7f73b8093700 1 --2- 172.21.15.40:0/1692844860 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73b006fdb0 0x7f73b006d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.843+0000 7f73b8093700 1 --2- 172.21.15.40:0/1692844860 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f73b006f070 0x7f73b006c990 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.843+0000 7f73b8093700 1 --2- 172.21.15.40:0/1692844860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73b006f980 0x7f73b006ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.843+0000 7f73b8093700 1 -- 172.21.15.40:0/1692844860 >> 172.21.15.40:0/1692844860 conn(0x7f73b00a41a0 msgr2=0x7f73b0097530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:24.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.843+0000 7f73b8093700 1 -- 172.21.15.40:0/1692844860 shutdown_connections 2023-09-30T22:27:24.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.843+0000 7f73b8093700 1 -- 172.21.15.40:0/1692844860 wait complete. 2023-09-30T22:27:24.856 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:24.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.856+0000 7f37c710e700 1 -- 172.21.15.40:0/215234687 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f37c0129220 con 0x7f37c009d920 2023-09-30T22:27:24.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.857+0000 7f37bd7fa700 1 -- 172.21.15.40:0/215234687 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f37b0053020 con 0x7f37c009d920 2023-09-30T22:27:24.857 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:24.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.859+0000 7f37c710e700 1 -- 172.21.15.40:0/215234687 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37c009d920 msgr2=0x7f37c0129f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:24.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.859+0000 7f37c710e700 1 --2- 172.21.15.40:0/215234687 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37c009d920 0x7f37c0129f90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f37b0009c10 tx=0x7f37b0004750 comp rx=0 tx=0).stop 2023-09-30T22:27:24.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.859+0000 7f37c710e700 1 -- 172.21.15.40:0/215234687 shutdown_connections 2023-09-30T22:27:24.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.859+0000 7f37c710e700 1 --2- 172.21.15.40:0/215234687 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37c0130de0 0x7f37c012aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.859+0000 7f37c710e700 1 --2- 172.21.15.40:0/215234687 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37c009d920 0x7f37c0129f90 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.859+0000 7f37c710e700 1 --2- 172.21.15.40:0/215234687 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f37c009e230 0x7f37c012a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.859+0000 7f37c710e700 1 -- 172.21.15.40:0/215234687 >> 172.21.15.40:0/215234687 conn(0x7f37c009fb20 msgr2=0x7f37c0071690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:24.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.859+0000 7f37c710e700 1 -- 172.21.15.40:0/215234687 shutdown_connections 2023-09-30T22:27:24.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:24.859+0000 7f37c710e700 1 -- 172.21.15.40:0/215234687 wait complete. 2023-09-30T22:27:24.871 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:25.739 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:25.831 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:25.857 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:25.873 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:25.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.883+0000 7f0093ac7700 1 Processor -- start 2023-09-30T22:27:25.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.884+0000 7f0093ac7700 1 -- start start 2023-09-30T22:27:25.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.884+0000 7f0093ac7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f008c099510 0x7f008c0998e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:25.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.884+0000 7f0093ac7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f008c099e20 0x7f008c130160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:25.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.884+0000 7f0093ac7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f008c09a630 con 0x7f008c1306a0 2023-09-30T22:27:25.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.884+0000 7f0093ac7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f008c09a950 con 0x7f008c099510 2023-09-30T22:27:25.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.884+0000 7f0093ac7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f008c09ba50 con 0x7f008c099e20 2023-09-30T22:27:25.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.885+0000 7f0091863700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f008c099510 0x7f008c0998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:25.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.885+0000 7f0091863700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f008c099510 0x7f008c0998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59688/0 (socket says 172.21.15.40:59688) 2023-09-30T22:27:25.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.885+0000 7f0091863700 1 -- 172.21.15.40:0/3795884769 learned_addr learned my addr 172.21.15.40:0/3795884769 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:25.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.885+0000 7f0091062700 1 --2- 172.21.15.40:0/3795884769 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f008c099e20 0x7f008c130160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:25.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.885+0000 7f0091863700 1 -- 172.21.15.40:0/3795884769 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f008c099e20 msgr2=0x7f008c130160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:25.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.885+0000 7f0091863700 1 --2- 172.21.15.40:0/3795884769 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f008c099e20 0x7f008c130160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.885+0000 7f0091863700 1 -- 172.21.15.40:0/3795884769 >> v1:172.21.15.40:6789/0 conn(0x7f008c1306a0 legacy=0x7f008c1373b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:25.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.885+0000 7f0091863700 1 -- 172.21.15.40:0/3795884769 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f008c09b7a0 con 0x7f008c099510 2023-09-30T22:27:25.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.885+0000 7f0091863700 1 --2- 172.21.15.40:0/3795884769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f008c099510 0x7f008c0998e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f0084009ea0 tx=0x7f008400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f112981e33d32e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:25.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.885+0000 7f0090861700 1 -- 172.21.15.40:0/3795884769 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008400e070 con 0x7f008c099510 2023-09-30T22:27:25.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.885+0000 7f0090861700 1 -- 172.21.15.40:0/3795884769 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008400b910 con 0x7f008c099510 2023-09-30T22:27:25.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.886+0000 7f0090861700 1 -- 172.21.15.40:0/3795884769 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008400bcc0 con 0x7f008c099510 2023-09-30T22:27:25.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.886+0000 7f0093ac7700 1 -- 172.21.15.40:0/3795884769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f008c099510 msgr2=0x7f008c0998e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:25.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.886+0000 7f0093ac7700 1 --2- 172.21.15.40:0/3795884769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f008c099510 0x7f008c0998e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f0084009ea0 tx=0x7f008400b330 comp rx=0 tx=0).stop 2023-09-30T22:27:25.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.886+0000 7f0093ac7700 1 -- 172.21.15.40:0/3795884769 shutdown_connections 2023-09-30T22:27:25.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.886+0000 7f0093ac7700 1 --2- 172.21.15.40:0/3795884769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f008c099510 0x7f008c0998e0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.886+0000 7f0093ac7700 1 --2- 172.21.15.40:0/3795884769 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f008c099e20 0x7f008c130160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.886+0000 7f0093ac7700 1 -- 172.21.15.40:0/3795884769 >> 172.21.15.40:0/3795884769 conn(0x7f008c09eb10 msgr2=0x7f008c09ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:25.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.887+0000 7f0093ac7700 1 -- 172.21.15.40:0/3795884769 shutdown_connections 2023-09-30T22:27:25.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.887+0000 7f0093ac7700 1 -- 172.21.15.40:0/3795884769 wait complete. 2023-09-30T22:27:25.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.888+0000 7f0093ac7700 1 Processor -- start 2023-09-30T22:27:25.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.888+0000 7f0093ac7700 1 -- start start 2023-09-30T22:27:25.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.888+0000 7f0093ac7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f008c099510 0x7f008c091240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:25.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.888+0000 7f0093ac7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f008c099e20 0x7f008c091780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:25.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.888+0000 7f0093ac7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f008c1306a0 0x7f008c091cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:25.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.888+0000 7f0093ac7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008c090ef0 con 0x7f008c099510 2023-09-30T22:27:25.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.888+0000 7f0093ac7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f008c0924e0 con 0x7f008c1306a0 2023-09-30T22:27:25.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.888+0000 7f0093ac7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f008c0904f0 con 0x7f008c099e20 2023-09-30T22:27:25.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.888+0000 7f0091863700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f008c099510 0x7f008c091240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:25.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.888+0000 7f0091863700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f008c099510 0x7f008c091240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59690/0 (socket says 172.21.15.40:59690) 2023-09-30T22:27:25.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.888+0000 7f0091863700 1 -- 172.21.15.40:0/1874845549 learned_addr learned my addr 172.21.15.40:0/1874845549 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:25.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.888+0000 7f0092064700 1 --2- 172.21.15.40:0/1874845549 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f008c1306a0 0x7f008c091cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:25.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.889+0000 7f0091062700 1 --2- 172.21.15.40:0/1874845549 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f008c099e20 0x7f008c091780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:25.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.889+0000 7f0091863700 1 -- 172.21.15.40:0/1874845549 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f008c099e20 msgr2=0x7f008c091780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:25.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.889+0000 7f0091863700 1 --2- 172.21.15.40:0/1874845549 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f008c099e20 0x7f008c091780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.889+0000 7f0091863700 1 -- 172.21.15.40:0/1874845549 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f008c1306a0 msgr2=0x7f008c091cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:25.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.889+0000 7f0091863700 1 --2- 172.21.15.40:0/1874845549 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f008c1306a0 0x7f008c091cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.889+0000 7f0091863700 1 -- 172.21.15.40:0/1874845549 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0084009b30 con 0x7f008c099510 2023-09-30T22:27:25.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.889+0000 7f0091863700 1 --2- 172.21.15.40:0/1874845549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f008c099510 0x7f008c091240 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f008c09ac50 tx=0x7f0084004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:25.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.889+0000 7f007e7fc700 1 -- 172.21.15.40:0/1874845549 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008401e940 con 0x7f008c099510 2023-09-30T22:27:25.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.889+0000 7f007e7fc700 1 -- 172.21.15.40:0/1874845549 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0084022070 con 0x7f008c099510 2023-09-30T22:27:25.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.889+0000 7f0093ac7700 1 -- 172.21.15.40:0/1874845549 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f008c093640 con 0x7f008c099510 2023-09-30T22:27:25.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.889+0000 7f007e7fc700 1 -- 172.21.15.40:0/1874845549 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008401ece0 con 0x7f008c099510 2023-09-30T22:27:25.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.889+0000 7f0093ac7700 1 -- 172.21.15.40:0/1874845549 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f008c093a60 con 0x7f008c099510 2023-09-30T22:27:25.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.890+0000 7f007e7fc700 1 -- 172.21.15.40:0/1874845549 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0084024030 con 0x7f008c099510 2023-09-30T22:27:25.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.890+0000 7f007e7fc700 1 -- 172.21.15.40:0/1874845549 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f0084044cb0 con 0x7f008c099510 2023-09-30T22:27:25.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.891+0000 7f0093ac7700 1 -- 172.21.15.40:0/1874845549 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00740052e0 con 0x7f008c099510 2023-09-30T22:27:25.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.896+0000 7f007e7fc700 1 -- 172.21.15.40:0/1874845549 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0084030430 con 0x7f008c099510 2023-09-30T22:27:25.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.969+0000 7ff92a692700 1 Processor -- start 2023-09-30T22:27:25.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.969+0000 7ff92a692700 1 -- start start 2023-09-30T22:27:25.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.969+0000 7ff92a692700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff92406a6d0 0x7ff92409d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:25.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.969+0000 7ff92a692700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff92409e280 0x7ff92413fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:25.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.969+0000 7ff92a692700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff92411d980 con 0x7ff92409de60 2023-09-30T22:27:25.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.969+0000 7ff92a692700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff92406aaa0 con 0x7ff92406a6d0 2023-09-30T22:27:25.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.969+0000 7ff92a692700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff92406b150 con 0x7ff92409e280 2023-09-30T22:27:25.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.969+0000 7ff923fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff92406a6d0 0x7ff92409d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:25.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.969+0000 7ff923fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff92406a6d0 0x7ff92409d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59692/0 (socket says 172.21.15.40:59692) 2023-09-30T22:27:25.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.969+0000 7ff928c2f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff92409e280 0x7ff92413fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:25.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.969+0000 7ff923fff700 1 -- 172.21.15.40:0/1641806771 learned_addr learned my addr 172.21.15.40:0/1641806771 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:25.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.970+0000 7ff923fff700 1 -- 172.21.15.40:0/1641806771 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff92409e280 msgr2=0x7ff92413fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:25.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.970+0000 7ff923fff700 1 --2- 172.21.15.40:0/1641806771 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff92409e280 0x7ff92413fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.970+0000 7ff923fff700 1 -- 172.21.15.40:0/1641806771 >> v1:172.21.15.40:6789/0 conn(0x7ff92409de60 legacy=0x7ff92413c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:25.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.970+0000 7ff923fff700 1 -- 172.21.15.40:0/1641806771 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff92409f300 con 0x7ff92406a6d0 2023-09-30T22:27:25.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.970+0000 7ff928c2f700 1 --2- 172.21.15.40:0/1641806771 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff92409e280 0x7ff92413fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:25.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.970+0000 7ff923fff700 1 --2- 172.21.15.40:0/1641806771 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff92406a6d0 0x7ff92409d920 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7ff914006fd0 tx=0x7ff914009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=172f1a864e30d7d0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:25.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.970+0000 7ff922ffd700 1 -- 172.21.15.40:0/1641806771 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff914005e30 con 0x7ff92406a6d0 2023-09-30T22:27:25.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.970+0000 7ff922ffd700 1 -- 172.21.15.40:0/1641806771 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff914004030 con 0x7ff92406a6d0 2023-09-30T22:27:25.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.970+0000 7ff922ffd700 1 -- 172.21.15.40:0/1641806771 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9140043e0 con 0x7ff92406a6d0 2023-09-30T22:27:25.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.971+0000 7ff92a692700 1 -- 172.21.15.40:0/1641806771 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff92406a6d0 msgr2=0x7ff92409d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:25.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.971+0000 7ff92a692700 1 --2- 172.21.15.40:0/1641806771 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff92406a6d0 0x7ff92409d920 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7ff914006fd0 tx=0x7ff914009bd0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.971+0000 7ff92a692700 1 -- 172.21.15.40:0/1641806771 shutdown_connections 2023-09-30T22:27:25.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.971+0000 7ff92a692700 1 --2- 172.21.15.40:0/1641806771 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff92409e280 0x7ff92413fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.971+0000 7ff92a692700 1 --2- 172.21.15.40:0/1641806771 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff92406a6d0 0x7ff92409d920 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.971+0000 7ff92a692700 1 -- 172.21.15.40:0/1641806771 >> 172.21.15.40:0/1641806771 conn(0x7ff92409fb20 msgr2=0x7ff92409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:25.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.971+0000 7ff92a692700 1 -- 172.21.15.40:0/1641806771 shutdown_connections 2023-09-30T22:27:25.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.971+0000 7ff92a692700 1 -- 172.21.15.40:0/1641806771 wait complete. 2023-09-30T22:27:25.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.972+0000 7ff92a692700 1 Processor -- start 2023-09-30T22:27:25.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.972+0000 7ff92a692700 1 -- start start 2023-09-30T22:27:25.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.973+0000 7ff92a692700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff92406a6d0 0x7ff924120310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:25.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.973+0000 7ff92a692700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff92409de60 0x7ff92413f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:25.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.973+0000 7ff92a692700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff92409e280 0x7ff92413f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:25.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.973+0000 7ff92a692700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9240a3340 con 0x7ff92409de60 2023-09-30T22:27:25.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.973+0000 7ff92a692700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff924139ba0 con 0x7ff92406a6d0 2023-09-30T22:27:25.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.973+0000 7ff92a692700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff924122830 con 0x7ff92409e280 2023-09-30T22:27:25.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.973+0000 7ff923fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff92406a6d0 0x7ff924120310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:25.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.973+0000 7ff923fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff92406a6d0 0x7ff924120310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:58124/0 (socket says 172.21.15.40:58124) 2023-09-30T22:27:25.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.973+0000 7ff923fff700 1 -- 172.21.15.40:0/4115923361 learned_addr learned my addr 172.21.15.40:0/4115923361 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:25.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.973+0000 7ff928c2f700 1 --2- 172.21.15.40:0/4115923361 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff92409e280 0x7ff92413f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:25.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.973+0000 7ff9237fe700 1 --2- 172.21.15.40:0/4115923361 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff92409de60 0x7ff92413f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:25.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.973+0000 7ff923fff700 1 -- 172.21.15.40:0/4115923361 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff92409e280 msgr2=0x7ff92413f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:25.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.973+0000 7ff923fff700 1 --2- 172.21.15.40:0/4115923361 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff92409e280 0x7ff92413f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.973+0000 7ff923fff700 1 -- 172.21.15.40:0/4115923361 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff92409de60 msgr2=0x7ff92413f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:25.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.973+0000 7ff923fff700 1 --2- 172.21.15.40:0/4115923361 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff92409de60 0x7ff92413f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.973+0000 7ff923fff700 1 -- 172.21.15.40:0/4115923361 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff91c009a70 con 0x7ff92406a6d0 2023-09-30T22:27:25.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.974+0000 7ff9237fe700 1 --2- 172.21.15.40:0/4115923361 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff92409de60 0x7ff92413f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:25.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.974+0000 7ff923fff700 1 --2- 172.21.15.40:0/4115923361 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff92406a6d0 0x7ff924120310 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff92411db10 tx=0x7ff914004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:25.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.974+0000 7ff920ff9700 1 -- 172.21.15.40:0/4115923361 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff914003c60 con 0x7ff92406a6d0 2023-09-30T22:27:25.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.974+0000 7ff92a692700 1 -- 172.21.15.40:0/4115923361 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff914009500 con 0x7ff92406a6d0 2023-09-30T22:27:25.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.974+0000 7ff92a692700 1 -- 172.21.15.40:0/4115923361 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff92409f540 con 0x7ff92406a6d0 2023-09-30T22:27:25.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.974+0000 7ff920ff9700 1 -- 172.21.15.40:0/4115923361 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff914003dc0 con 0x7ff92406a6d0 2023-09-30T22:27:25.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.974+0000 7ff920ff9700 1 -- 172.21.15.40:0/4115923361 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff914011660 con 0x7ff92406a6d0 2023-09-30T22:27:25.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.975+0000 7ff920ff9700 1 -- 172.21.15.40:0/4115923361 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff914018030 con 0x7ff92406a6d0 2023-09-30T22:27:25.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.975+0000 7ff92a692700 1 -- 172.21.15.40:0/4115923361 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff924122560 con 0x7ff92406a6d0 2023-09-30T22:27:25.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.975+0000 7ff920ff9700 1 -- 172.21.15.40:0/4115923361 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff9140409a0 con 0x7ff92406a6d0 2023-09-30T22:27:25.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:25.984+0000 7ff920ff9700 1 -- 172.21.15.40:0/4115923361 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff9140117c0 con 0x7ff92406a6d0 2023-09-30T22:27:26.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.013+0000 7f05cac62700 1 Processor -- start 2023-09-30T22:27:26.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.013+0000 7f05cac62700 1 -- start start 2023-09-30T22:27:26.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.013+0000 7f05cac62700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05c409d920 0x7f05c409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:26.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.013+0000 7f05cac62700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05c409f0f0 0x7f05c409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:26.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.013+0000 7f05cac62700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f05c4133ca0 0x7f05c4134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:26.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.013+0000 7f05cac62700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c406b4c0 con 0x7f05c4133ca0 2023-09-30T22:27:26.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.013+0000 7f05cac62700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c409a8f0 con 0x7f05c409f0f0 2023-09-30T22:27:26.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.013+0000 7f05cac62700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05c409f940 con 0x7f05c409d920 2023-09-30T22:27:26.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.013+0000 7f05c89fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05c409d920 0x7f05c409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:26.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.013+0000 7f05c91ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f05c4133ca0 0x7f05c4134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:26.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.013+0000 7f05c89fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05c409d920 0x7f05c409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55364/0 (socket says 172.21.15.40:55364) 2023-09-30T22:27:26.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.013+0000 7f05c89fe700 1 -- 172.21.15.40:0/1324296885 learned_addr learned my addr 172.21.15.40:0/1324296885 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:26.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.013+0000 7f05c3fff700 1 --2- 172.21.15.40:0/1324296885 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05c409f0f0 0x7f05c409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:26.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.014+0000 7f05c89fe700 1 -- 172.21.15.40:0/1324296885 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05c409f0f0 msgr2=0x7f05c409e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:26.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.014+0000 7f05c89fe700 1 --2- 172.21.15.40:0/1324296885 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05c409f0f0 0x7f05c409e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.014+0000 7f05c89fe700 1 -- 172.21.15.40:0/1324296885 >> v2:172.21.15.40:3300/0 conn(0x7f05c4133ca0 msgr2=0x7f05c4134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:26.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.014+0000 7f05c89fe700 1 --2- 172.21.15.40:0/1324296885 >> v2:172.21.15.40:3300/0 conn(0x7f05c4133ca0 0x7f05c4134140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.014+0000 7f05c89fe700 1 -- 172.21.15.40:0/1324296885 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c409f6e0 con 0x7f05c409d920 2023-09-30T22:27:26.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.014+0000 7f05c91ff700 1 --2- 172.21.15.40:0/1324296885 >> v2:172.21.15.40:3300/0 conn(0x7f05c4133ca0 0x7f05c4134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:26.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.014+0000 7f05c89fe700 1 --2- 172.21.15.40:0/1324296885 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05c409d920 0x7f05c409dcf0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f05b80098f0 tx=0x7f05b8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=273814c508d77b79 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:26.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.014+0000 7f05c37fe700 1 -- 172.21.15.40:0/1324296885 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b8005e30 con 0x7f05c409d920 2023-09-30T22:27:26.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.014+0000 7f05c37fe700 1 -- 172.21.15.40:0/1324296885 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b8004030 con 0x7f05c409d920 2023-09-30T22:27:26.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.014+0000 7f05c37fe700 1 -- 172.21.15.40:0/1324296885 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b80043e0 con 0x7f05c409d920 2023-09-30T22:27:26.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.015+0000 7f05cac62700 1 -- 172.21.15.40:0/1324296885 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05c409d920 msgr2=0x7f05c409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:26.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.015+0000 7f05cac62700 1 --2- 172.21.15.40:0/1324296885 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05c409d920 0x7f05c409dcf0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f05b80098f0 tx=0x7f05b8009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:26.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.015+0000 7f05cac62700 1 -- 172.21.15.40:0/1324296885 shutdown_connections 2023-09-30T22:27:26.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.015+0000 7f05cac62700 1 --2- 172.21.15.40:0/1324296885 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05c409d920 0x7f05c409dcf0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.015+0000 7f05cac62700 1 --2- 172.21.15.40:0/1324296885 >> v2:172.21.15.40:3300/0 conn(0x7f05c4133ca0 0x7f05c4134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.015+0000 7f05cac62700 1 --2- 172.21.15.40:0/1324296885 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05c409f0f0 0x7f05c409e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.015+0000 7f05cac62700 1 -- 172.21.15.40:0/1324296885 >> 172.21.15.40:0/1324296885 conn(0x7f05c409fb20 msgr2=0x7f05c409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:26.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.015+0000 7f05cac62700 1 -- 172.21.15.40:0/1324296885 shutdown_connections 2023-09-30T22:27:26.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.015+0000 7f05cac62700 1 -- 172.21.15.40:0/1324296885 wait complete. 2023-09-30T22:27:26.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.017+0000 7f05cac62700 1 Processor -- start 2023-09-30T22:27:26.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.017+0000 7f05cac62700 1 -- start start 2023-09-30T22:27:26.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.018+0000 7f05cac62700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05c409d920 0x7f05c411e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:26.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.018+0000 7f05cac62700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05c4133ca0 0x7f05c411e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:26.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.018+0000 7f05cac62700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05c4122470 0x7f05c411eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:26.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.018+0000 7f05cac62700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c4120640 con 0x7f05c4122470 2023-09-30T22:27:26.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.018+0000 7f05cac62700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c4121700 con 0x7f05c4133ca0 2023-09-30T22:27:26.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.018+0000 7f05cac62700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05c409c9e0 con 0x7f05c409d920 2023-09-30T22:27:26.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.018+0000 7f05c89fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05c409d920 0x7f05c411e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:26.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.018+0000 7f05c89fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05c409d920 0x7f05c411e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55380/0 (socket says 172.21.15.40:55380) 2023-09-30T22:27:26.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.018+0000 7f05c89fe700 1 -- 172.21.15.40:0/1919483924 learned_addr learned my addr 172.21.15.40:0/1919483924 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:26.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.018+0000 7f05c3fff700 1 --2- 172.21.15.40:0/1919483924 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05c4133ca0 0x7f05c411e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:26.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.018+0000 7f05c91ff700 1 --2- 172.21.15.40:0/1919483924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05c4122470 0x7f05c411eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:26.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.018+0000 7f05c3fff700 1 -- 172.21.15.40:0/1919483924 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05c409d920 msgr2=0x7f05c411e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:26.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.018+0000 7f05c3fff700 1 --2- 172.21.15.40:0/1919483924 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05c409d920 0x7f05c411e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.018+0000 7f05c3fff700 1 -- 172.21.15.40:0/1919483924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05c4122470 msgr2=0x7f05c411eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:26.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.018+0000 7f05c3fff700 1 --2- 172.21.15.40:0/1919483924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05c4122470 0x7f05c411eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.018+0000 7f05c3fff700 1 -- 172.21.15.40:0/1919483924 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05bc009a70 con 0x7f05c4133ca0 2023-09-30T22:27:26.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.018+0000 7f05c89fe700 1 --2- 172.21.15.40:0/1919483924 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05c409d920 0x7f05c411e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:26.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.018+0000 7f05c3fff700 1 --2- 172.21.15.40:0/1919483924 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05c4133ca0 0x7f05c411e990 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f05c406b7b0 tx=0x7f05b000eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:26.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.019+0000 7f05c17fa700 1 -- 172.21.15.40:0/1919483924 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b0013680 con 0x7f05c4133ca0 2023-09-30T22:27:26.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.019+0000 7f05c17fa700 1 -- 172.21.15.40:0/1919483924 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b00137e0 con 0x7f05c4133ca0 2023-09-30T22:27:26.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.019+0000 7f05cac62700 1 -- 172.21.15.40:0/1919483924 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b8009500 con 0x7f05c4133ca0 2023-09-30T22:27:26.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.019+0000 7f05c17fa700 1 -- 172.21.15.40:0/1919483924 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b0013b70 con 0x7f05c4133ca0 2023-09-30T22:27:26.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.019+0000 7f05cac62700 1 -- 172.21.15.40:0/1919483924 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c4120060 con 0x7f05c4133ca0 2023-09-30T22:27:26.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.020+0000 7f05cac62700 1 -- 172.21.15.40:0/1919483924 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c4121af0 con 0x7f05c4133ca0 2023-09-30T22:27:26.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.020+0000 7f05c17fa700 1 -- 172.21.15.40:0/1919483924 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f05b0013cd0 con 0x7f05c4133ca0 2023-09-30T22:27:26.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.021+0000 7f05c17fa700 1 -- 172.21.15.40:0/1919483924 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f05b0047350 con 0x7f05c4133ca0 2023-09-30T22:27:26.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.022+0000 7f3263441700 1 Processor -- start 2023-09-30T22:27:26.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.022+0000 7f3263441700 1 -- start start 2023-09-30T22:27:26.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.023+0000 7f3263441700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f325c09d920 0x7f325c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:26.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.023+0000 7f3263441700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f325c09f0f0 0x7f325c09e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:26.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.023+0000 7f3263441700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f325c133ca0 0x7f325c134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:26.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.023+0000 7f3263441700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f325c06b4c0 con 0x7f325c133ca0 2023-09-30T22:27:26.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.023+0000 7f3263441700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f325c09a8f0 con 0x7f325c09d920 2023-09-30T22:27:26.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.023+0000 7f3263441700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f325c09f940 con 0x7f325c09f0f0 2023-09-30T22:27:26.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.023+0000 7f32611dd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f325c09d920 0x7f325c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:26.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.023+0000 7f32611dd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f325c09d920 0x7f325c09dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:58164/0 (socket says 172.21.15.40:58164) 2023-09-30T22:27:26.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.023+0000 7f32611dd700 1 -- 172.21.15.40:0/698237892 learned_addr learned my addr 172.21.15.40:0/698237892 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:26.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.023+0000 7f32609dc700 1 --2- 172.21.15.40:0/698237892 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f325c09f0f0 0x7f325c09e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:26.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.023+0000 7f32611dd700 1 -- 172.21.15.40:0/698237892 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f325c09f0f0 msgr2=0x7f325c09e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:26.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.023+0000 7f32611dd700 1 --2- 172.21.15.40:0/698237892 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f325c09f0f0 0x7f325c09e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.023+0000 7f32611dd700 1 -- 172.21.15.40:0/698237892 >> v2:172.21.15.40:3300/0 conn(0x7f325c133ca0 msgr2=0x7f325c134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:26.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.023+0000 7f32611dd700 1 --2- 172.21.15.40:0/698237892 >> v2:172.21.15.40:3300/0 conn(0x7f325c133ca0 0x7f325c134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.023+0000 7f32611dd700 1 -- 172.21.15.40:0/698237892 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f325c09f6e0 con 0x7f325c09d920 2023-09-30T22:27:26.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.024+0000 7f32611dd700 1 --2- 172.21.15.40:0/698237892 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f325c09d920 0x7f325c09dcf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3258009920 tx=0x7f3258009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e17acc8d0453acf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:26.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.026+0000 7f3253fff700 1 -- 172.21.15.40:0/698237892 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3258005e30 con 0x7f325c09d920 2023-09-30T22:27:26.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.026+0000 7f3253fff700 1 -- 172.21.15.40:0/698237892 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3258004030 con 0x7f325c09d920 2023-09-30T22:27:26.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.026+0000 7f3253fff700 1 -- 172.21.15.40:0/698237892 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32580043e0 con 0x7f325c09d920 2023-09-30T22:27:26.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.026+0000 7f05c17fa700 1 -- 172.21.15.40:0/1919483924 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f05c4121af0 con 0x7f05c4133ca0 2023-09-30T22:27:26.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.027+0000 7f3263441700 1 -- 172.21.15.40:0/698237892 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f325c09d920 msgr2=0x7f325c09dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:26.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.027+0000 7f3263441700 1 --2- 172.21.15.40:0/698237892 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f325c09d920 0x7f325c09dcf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3258009920 tx=0x7f3258009c30 comp rx=0 tx=0).stop 2023-09-30T22:27:26.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.027+0000 7f3263441700 1 -- 172.21.15.40:0/698237892 shutdown_connections 2023-09-30T22:27:26.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.027+0000 7f3263441700 1 --2- 172.21.15.40:0/698237892 >> v2:172.21.15.40:3300/0 conn(0x7f325c133ca0 0x7f325c134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.027+0000 7f3263441700 1 --2- 172.21.15.40:0/698237892 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f325c09d920 0x7f325c09dcf0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.027+0000 7f3263441700 1 --2- 172.21.15.40:0/698237892 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f325c09f0f0 0x7f325c09e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.027+0000 7f3263441700 1 -- 172.21.15.40:0/698237892 >> 172.21.15.40:0/698237892 conn(0x7f325c09fb20 msgr2=0x7f325c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:26.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.027+0000 7f3263441700 1 -- 172.21.15.40:0/698237892 shutdown_connections 2023-09-30T22:27:26.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.027+0000 7f3263441700 1 -- 172.21.15.40:0/698237892 wait complete. 2023-09-30T22:27:26.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.028+0000 7f3263441700 1 Processor -- start 2023-09-30T22:27:26.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.028+0000 7f3263441700 1 -- start start 2023-09-30T22:27:26.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.029+0000 7f3263441700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f325c09d920 0x7f325c1218f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:26.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.029+0000 7f3263441700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f325c133ca0 0x7f325c121e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:26.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.029+0000 7f3263441700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f325c122370 0x7f325c1c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:26.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.029+0000 7f3263441700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325c132920 con 0x7f325c09d920 2023-09-30T22:27:26.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.029+0000 7f3263441700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f325c09c9e0 con 0x7f325c133ca0 2023-09-30T22:27:26.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.029+0000 7f3263441700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f325c125130 con 0x7f325c122370 2023-09-30T22:27:26.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.029+0000 7f32611dd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f325c09d920 0x7f325c1218f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:26.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.029+0000 7f32611dd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f325c09d920 0x7f325c1218f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59732/0 (socket says 172.21.15.40:59732) 2023-09-30T22:27:26.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.029+0000 7f32611dd700 1 -- 172.21.15.40:0/3394598598 learned_addr learned my addr 172.21.15.40:0/3394598598 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:26.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.029+0000 7f32619de700 1 --2- 172.21.15.40:0/3394598598 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f325c122370 0x7f325c1c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:26.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.029+0000 7f32611dd700 1 -- 172.21.15.40:0/3394598598 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f325c122370 msgr2=0x7f325c1c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:26.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.029+0000 7f32611dd700 1 --2- 172.21.15.40:0/3394598598 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f325c122370 0x7f325c1c8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.029+0000 7f32611dd700 1 -- 172.21.15.40:0/3394598598 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f325c133ca0 msgr2=0x7f325c121e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:26.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.029+0000 7f32611dd700 1 --2- 172.21.15.40:0/3394598598 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f325c133ca0 0x7f325c121e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.029+0000 7f32611dd700 1 -- 172.21.15.40:0/3394598598 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3258009500 con 0x7f325c09d920 2023-09-30T22:27:26.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.029+0000 7f32611dd700 1 --2- 172.21.15.40:0/3394598598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f325c09d920 0x7f325c1218f0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f3258009c70 tx=0x7f3258004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:26.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.030+0000 7f3251ffb700 1 -- 172.21.15.40:0/3394598598 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3258003d60 con 0x7f325c09d920 2023-09-30T22:27:26.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.030+0000 7f3251ffb700 1 -- 172.21.15.40:0/3394598598 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3258011420 con 0x7f325c09d920 2023-09-30T22:27:26.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.030+0000 7f3251ffb700 1 -- 172.21.15.40:0/3394598598 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32580117d0 con 0x7f325c09d920 2023-09-30T22:27:26.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.030+0000 7f3263441700 1 -- 172.21.15.40:0/3394598598 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f325c123610 con 0x7f325c09d920 2023-09-30T22:27:26.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.030+0000 7f3263441700 1 -- 172.21.15.40:0/3394598598 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f325c132410 con 0x7f325c09d920 2023-09-30T22:27:26.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.031+0000 7f3251ffb700 1 -- 172.21.15.40:0/3394598598 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3258018070 con 0x7f325c09d920 2023-09-30T22:27:26.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.031+0000 7f3263441700 1 -- 172.21.15.40:0/3394598598 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f325c125c60 con 0x7f325c09d920 2023-09-30T22:27:26.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.031+0000 7f3251ffb700 1 -- 172.21.15.40:0/3394598598 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3258040320 con 0x7f325c09d920 2023-09-30T22:27:26.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.041+0000 7f3251ffb700 1 -- 172.21.15.40:0/3394598598 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3258016020 con 0x7f325c09d920 2023-09-30T22:27:26.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.115+0000 7f0093ac7700 1 -- 172.21.15.40:0/1874845549 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0074005590 con 0x7f008c099510 2023-09-30T22:27:26.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.115+0000 7f007e7fc700 1 -- 172.21.15.40:0/1874845549 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0084011390 con 0x7f008c099510 2023-09-30T22:27:26.116 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:26.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.117+0000 7f0093ac7700 1 -- 172.21.15.40:0/1874845549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f008c099510 msgr2=0x7f008c091240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:26.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.117+0000 7f0093ac7700 1 --2- 172.21.15.40:0/1874845549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f008c099510 0x7f008c091240 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f008c09ac50 tx=0x7f0084004ad0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.118+0000 7f0093ac7700 1 -- 172.21.15.40:0/1874845549 shutdown_connections 2023-09-30T22:27:26.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.118+0000 7f0093ac7700 1 --2- 172.21.15.40:0/1874845549 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f008c1306a0 0x7f008c091cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.118+0000 7f0093ac7700 1 --2- 172.21.15.40:0/1874845549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f008c099510 0x7f008c091240 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.118+0000 7f0093ac7700 1 --2- 172.21.15.40:0/1874845549 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f008c099e20 0x7f008c091780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.118+0000 7f0093ac7700 1 -- 172.21.15.40:0/1874845549 >> 172.21.15.40:0/1874845549 conn(0x7f008c09eb10 msgr2=0x7f008c098730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:26.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.118+0000 7f0093ac7700 1 -- 172.21.15.40:0/1874845549 shutdown_connections 2023-09-30T22:27:26.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.118+0000 7f0093ac7700 1 -- 172.21.15.40:0/1874845549 wait complete. 2023-09-30T22:27:26.131 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:26.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.190+0000 7ff92a692700 1 -- 172.21.15.40:0/4115923361 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff924121040 con 0x7ff92406a6d0 2023-09-30T22:27:26.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.191+0000 7ff920ff9700 1 -- 172.21.15.40:0/4115923361 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff914016070 con 0x7ff92406a6d0 2023-09-30T22:27:26.191 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:26.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.193+0000 7ff92a692700 1 -- 172.21.15.40:0/4115923361 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff92406a6d0 msgr2=0x7ff924120310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:26.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.193+0000 7ff92a692700 1 --2- 172.21.15.40:0/4115923361 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff92406a6d0 0x7ff924120310 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff92411db10 tx=0x7ff914004750 comp rx=0 tx=0).stop 2023-09-30T22:27:26.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.193+0000 7ff92a692700 1 -- 172.21.15.40:0/4115923361 shutdown_connections 2023-09-30T22:27:26.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.193+0000 7ff92a692700 1 --2- 172.21.15.40:0/4115923361 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff92409e280 0x7ff92413f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.193+0000 7ff92a692700 1 --2- 172.21.15.40:0/4115923361 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff92406a6d0 0x7ff924120310 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.193+0000 7ff92a692700 1 --2- 172.21.15.40:0/4115923361 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff92409de60 0x7ff92413f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.193+0000 7ff92a692700 1 -- 172.21.15.40:0/4115923361 >> 172.21.15.40:0/4115923361 conn(0x7ff92409fb20 msgr2=0x7ff924071620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:26.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.193+0000 7ff92a692700 1 -- 172.21.15.40:0/4115923361 shutdown_connections 2023-09-30T22:27:26.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.193+0000 7ff92a692700 1 -- 172.21.15.40:0/4115923361 wait complete. 2023-09-30T22:27:26.206 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:26.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.226+0000 7f05cac62700 1 -- 172.21.15.40:0/1919483924 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f05c4121af0 con 0x7f05c4133ca0 2023-09-30T22:27:26.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.226+0000 7f05c17fa700 1 -- 172.21.15.40:0/1919483924 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f05c4121af0 con 0x7f05c4133ca0 2023-09-30T22:27:26.227 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:26.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.228+0000 7f05cac62700 1 -- 172.21.15.40:0/1919483924 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05c4133ca0 msgr2=0x7f05c411e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:26.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.228+0000 7f05cac62700 1 --2- 172.21.15.40:0/1919483924 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05c4133ca0 0x7f05c411e990 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f05c406b7b0 tx=0x7f05b000eb20 comp rx=0 tx=0).stop 2023-09-30T22:27:26.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.228+0000 7f05cac62700 1 -- 172.21.15.40:0/1919483924 shutdown_connections 2023-09-30T22:27:26.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.228+0000 7f05cac62700 1 --2- 172.21.15.40:0/1919483924 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05c409d920 0x7f05c411e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.228+0000 7f05cac62700 1 --2- 172.21.15.40:0/1919483924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05c4122470 0x7f05c411eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.228+0000 7f05cac62700 1 --2- 172.21.15.40:0/1919483924 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05c4133ca0 0x7f05c411e990 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.228+0000 7f05cac62700 1 -- 172.21.15.40:0/1919483924 >> 172.21.15.40:0/1919483924 conn(0x7f05c409fb20 msgr2=0x7f05c41333f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:26.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.228+0000 7f05cac62700 1 -- 172.21.15.40:0/1919483924 shutdown_connections 2023-09-30T22:27:26.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.228+0000 7f05cac62700 1 -- 172.21.15.40:0/1919483924 wait complete. 2023-09-30T22:27:26.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.239+0000 7f3263441700 1 -- 172.21.15.40:0/3394598598 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f325c062380 con 0x7f325c09d920 2023-09-30T22:27:26.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.239+0000 7f3251ffb700 1 -- 172.21.15.40:0/3394598598 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3258033090 con 0x7f325c09d920 2023-09-30T22:27:26.240 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:26.241 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:26.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.242+0000 7f3263441700 1 -- 172.21.15.40:0/3394598598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f325c09d920 msgr2=0x7f325c1218f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:26.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.242+0000 7f3263441700 1 --2- 172.21.15.40:0/3394598598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f325c09d920 0x7f325c1218f0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f3258009c70 tx=0x7f3258004750 comp rx=0 tx=0).stop 2023-09-30T22:27:26.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.242+0000 7f3263441700 1 -- 172.21.15.40:0/3394598598 shutdown_connections 2023-09-30T22:27:26.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.242+0000 7f3263441700 1 --2- 172.21.15.40:0/3394598598 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f325c122370 0x7f325c1c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.242+0000 7f3263441700 1 --2- 172.21.15.40:0/3394598598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f325c09d920 0x7f325c1218f0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.242+0000 7f3263441700 1 --2- 172.21.15.40:0/3394598598 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f325c133ca0 0x7f325c121e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.242+0000 7f3263441700 1 -- 172.21.15.40:0/3394598598 >> 172.21.15.40:0/3394598598 conn(0x7f325c09fb20 msgr2=0x7f325c0a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:26.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.242+0000 7f3263441700 1 -- 172.21.15.40:0/3394598598 shutdown_connections 2023-09-30T22:27:26.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:26.242+0000 7f3263441700 1 -- 172.21.15.40:0/3394598598 wait complete. 2023-09-30T22:27:26.254 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:27.133 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:27.207 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:27.241 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:27.255 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:27.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.277+0000 7f73873a2700 1 Processor -- start 2023-09-30T22:27:27.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.278+0000 7f73873a2700 1 -- start start 2023-09-30T22:27:27.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.279+0000 7f73873a2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7380138250 0x7f7380138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.279+0000 7f73873a2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f738009d400 0x7f738009d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.279+0000 7f73873a2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7380137e20 con 0x7f738009dd50 2023-09-30T22:27:27.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.279+0000 7f73873a2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7380138050 con 0x7f7380138250 2023-09-30T22:27:27.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.279+0000 7f73873a2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f738009b010 con 0x7f738009d400 2023-09-30T22:27:27.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.279+0000 7f738513e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7380138250 0x7f7380138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.279+0000 7f738513e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7380138250 0x7f7380138620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59740/0 (socket says 172.21.15.40:59740) 2023-09-30T22:27:27.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.279+0000 7f738513e700 1 -- 172.21.15.40:0/2830958170 learned_addr learned my addr 172.21.15.40:0/2830958170 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:27.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.279+0000 7f738513e700 1 -- 172.21.15.40:0/2830958170 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f738009d400 msgr2=0x7f738009d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:27.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.279+0000 7f738513e700 1 --2- 172.21.15.40:0/2830958170 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f738009d400 0x7f738009d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.279+0000 7f738513e700 1 -- 172.21.15.40:0/2830958170 >> v1:172.21.15.40:6789/0 conn(0x7f738009dd50 legacy=0x7f738013f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:27.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.279+0000 7f738513e700 1 -- 172.21.15.40:0/2830958170 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f738009f1f0 con 0x7f7380138250 2023-09-30T22:27:27.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.279+0000 7f738513e700 1 --2- 172.21.15.40:0/2830958170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7380138250 0x7f7380138620 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f737c0098f0 tx=0x7f737c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90e563834464ec9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:27.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.280+0000 7f7377fff700 1 -- 172.21.15.40:0/2830958170 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737c00b8a0 con 0x7f7380138250 2023-09-30T22:27:27.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.280+0000 7f7377fff700 1 -- 172.21.15.40:0/2830958170 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737c00ba00 con 0x7f7380138250 2023-09-30T22:27:27.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.280+0000 7f7377fff700 1 -- 172.21.15.40:0/2830958170 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737c00bd90 con 0x7f7380138250 2023-09-30T22:27:27.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.280+0000 7f73873a2700 1 -- 172.21.15.40:0/2830958170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7380138250 msgr2=0x7f7380138620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:27.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.280+0000 7f73873a2700 1 --2- 172.21.15.40:0/2830958170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7380138250 0x7f7380138620 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f737c0098f0 tx=0x7f737c009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:27.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.280+0000 7f73873a2700 1 -- 172.21.15.40:0/2830958170 shutdown_connections 2023-09-30T22:27:27.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.280+0000 7f73873a2700 1 --2- 172.21.15.40:0/2830958170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7380138250 0x7f7380138620 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.280+0000 7f73873a2700 1 --2- 172.21.15.40:0/2830958170 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f738009d400 0x7f738009d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.280+0000 7f73873a2700 1 -- 172.21.15.40:0/2830958170 >> 172.21.15.40:0/2830958170 conn(0x7f73800a2a00 msgr2=0x7f73800a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:27.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.281+0000 7f73873a2700 1 -- 172.21.15.40:0/2830958170 shutdown_connections 2023-09-30T22:27:27.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.281+0000 7f73873a2700 1 -- 172.21.15.40:0/2830958170 wait complete. 2023-09-30T22:27:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.282+0000 7f73873a2700 1 Processor -- start 2023-09-30T22:27:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.282+0000 7f73873a2700 1 -- start start 2023-09-30T22:27:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.283+0000 7f73873a2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f738009d400 0x7f73801228b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.283+0000 7f73873a2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f738009dd50 0x7f7380122df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.283+0000 7f73873a2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7380138250 0x7f7380123330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.283+0000 7f73873a2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7380124580 con 0x7f738009d400 2023-09-30T22:27:27.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.283+0000 7f73873a2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7380135710 con 0x7f738009dd50 2023-09-30T22:27:27.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.283+0000 7f73873a2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f738009a300 con 0x7f7380138250 2023-09-30T22:27:27.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.283+0000 7f738493d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f738009dd50 0x7f7380122df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.283+0000 7f738493d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f738009dd50 0x7f7380122df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:58208/0 (socket says 172.21.15.40:58208) 2023-09-30T22:27:27.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.283+0000 7f738493d700 1 -- 172.21.15.40:0/1352656394 learned_addr learned my addr 172.21.15.40:0/1352656394 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:27.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.284+0000 7f738513e700 1 --2- 172.21.15.40:0/1352656394 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f738009d400 0x7f73801228b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.284+0000 7f738493d700 1 -- 172.21.15.40:0/1352656394 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7380138250 msgr2=0x7f7380123330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:27.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.284+0000 7f738493d700 1 --2- 172.21.15.40:0/1352656394 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7380138250 0x7f7380123330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.284+0000 7f738493d700 1 -- 172.21.15.40:0/1352656394 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f738009d400 msgr2=0x7f73801228b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:27.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.284+0000 7f738493d700 1 --2- 172.21.15.40:0/1352656394 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f738009d400 0x7f73801228b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.284+0000 7f738493d700 1 -- 172.21.15.40:0/1352656394 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737c009550 con 0x7f738009dd50 2023-09-30T22:27:27.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.284+0000 7f738513e700 1 --2- 172.21.15.40:0/1352656394 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f738009d400 0x7f73801228b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:27:27.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.284+0000 7f738493d700 1 --2- 172.21.15.40:0/1352656394 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f738009dd50 0x7f7380122df0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f737000b560 tx=0x7f737000b920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:27.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.284+0000 7f7375ffb700 1 -- 172.21.15.40:0/1352656394 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7370011830 con 0x7f738009dd50 2023-09-30T22:27:27.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.284+0000 7f7375ffb700 1 -- 172.21.15.40:0/1352656394 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7370011990 con 0x7f738009dd50 2023-09-30T22:27:27.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.284+0000 7f73873a2700 1 -- 172.21.15.40:0/1352656394 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73800a1330 con 0x7f738009dd50 2023-09-30T22:27:27.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.284+0000 7f7375ffb700 1 -- 172.21.15.40:0/1352656394 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7370011d40 con 0x7f738009dd50 2023-09-30T22:27:27.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.285+0000 7f73873a2700 1 -- 172.21.15.40:0/1352656394 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73801255d0 con 0x7f738009dd50 2023-09-30T22:27:27.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.285+0000 7f7375ffb700 1 -- 172.21.15.40:0/1352656394 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f737001a400 con 0x7f738009dd50 2023-09-30T22:27:27.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.285+0000 7f73873a2700 1 -- 172.21.15.40:0/1352656394 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7380062380 con 0x7f738009dd50 2023-09-30T22:27:27.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.286+0000 7f7375ffb700 1 -- 172.21.15.40:0/1352656394 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f737003f790 con 0x7f738009dd50 2023-09-30T22:27:27.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.295+0000 7f7375ffb700 1 -- 172.21.15.40:0/1352656394 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7370015070 con 0x7f738009dd50 2023-09-30T22:27:27.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.348+0000 7fe380229700 1 Processor -- start 2023-09-30T22:27:27.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.348+0000 7fe380229700 1 -- start start 2023-09-30T22:27:27.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.349+0000 7fe380229700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe37809d450 0x7fe37809d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.349+0000 7fe380229700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe37809dd60 0x7fe3781301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.349+0000 7fe380229700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe37809c3b0 con 0x7fe378130700 2023-09-30T22:27:27.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.349+0000 7fe380229700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe37809a6b0 con 0x7fe37809dd60 2023-09-30T22:27:27.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.349+0000 7fe380229700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe37809b4f0 con 0x7fe37809d450 2023-09-30T22:27:27.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.349+0000 7fe37d7c4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe37809dd60 0x7fe3781301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.349+0000 7fe37d7c4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe37809dd60 0x7fe3781301c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59762/0 (socket says 172.21.15.40:59762) 2023-09-30T22:27:27.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.349+0000 7fe37d7c4700 1 -- 172.21.15.40:0/910674894 learned_addr learned my addr 172.21.15.40:0/910674894 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:27.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.349+0000 7fe37dfc5700 1 --2- 172.21.15.40:0/910674894 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe37809d450 0x7fe37809d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.350+0000 7fe37d7c4700 1 -- 172.21.15.40:0/910674894 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe37809d450 msgr2=0x7fe37809d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:27.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.350+0000 7fe37d7c4700 1 --2- 172.21.15.40:0/910674894 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe37809d450 0x7fe37809d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.350+0000 7fe37d7c4700 1 -- 172.21.15.40:0/910674894 >> v1:172.21.15.40:6789/0 conn(0x7fe378130700 legacy=0x7fe378137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:27.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.350+0000 7fe37d7c4700 1 -- 172.21.15.40:0/910674894 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37809af90 con 0x7fe37809dd60 2023-09-30T22:27:27.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.350+0000 7fe37dfc5700 1 --2- 172.21.15.40:0/910674894 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe37809d450 0x7fe37809d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:27.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.350+0000 7fe37d7c4700 1 --2- 172.21.15.40:0/910674894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe37809dd60 0x7fe3781301c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fe36800bb90 tx=0x7fe36800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77cb8eb6cae0a906 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:27.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.350+0000 7fe37cfc3700 1 -- 172.21.15.40:0/910674894 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36800dd50 con 0x7fe37809dd60 2023-09-30T22:27:27.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.350+0000 7fe37cfc3700 1 -- 172.21.15.40:0/910674894 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe368010470 con 0x7fe37809dd60 2023-09-30T22:27:27.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.350+0000 7fe37cfc3700 1 -- 172.21.15.40:0/910674894 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe368010800 con 0x7fe37809dd60 2023-09-30T22:27:27.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.351+0000 7fe380229700 1 -- 172.21.15.40:0/910674894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe37809dd60 msgr2=0x7fe3781301c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:27.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.351+0000 7fe380229700 1 --2- 172.21.15.40:0/910674894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe37809dd60 0x7fe3781301c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fe36800bb90 tx=0x7fe36800bea0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.351+0000 7fe380229700 1 -- 172.21.15.40:0/910674894 shutdown_connections 2023-09-30T22:27:27.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.351+0000 7fe380229700 1 --2- 172.21.15.40:0/910674894 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe37809d450 0x7fe37809d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.351+0000 7fe380229700 1 --2- 172.21.15.40:0/910674894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe37809dd60 0x7fe3781301c0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.351+0000 7fe380229700 1 -- 172.21.15.40:0/910674894 >> 172.21.15.40:0/910674894 conn(0x7fe3780a2a00 msgr2=0x7fe3780a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:27.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.351+0000 7fe380229700 1 -- 172.21.15.40:0/910674894 shutdown_connections 2023-09-30T22:27:27.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.351+0000 7fe380229700 1 -- 172.21.15.40:0/910674894 wait complete. 2023-09-30T22:27:27.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.352+0000 7fe380229700 1 Processor -- start 2023-09-30T22:27:27.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.352+0000 7fe380229700 1 -- start start 2023-09-30T22:27:27.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.352+0000 7fe380229700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe37809d450 0x7fe37811d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.352+0000 7fe380229700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe37809dd60 0x7fe37811df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.352+0000 7fe380229700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe378130700 0x7fe37811e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.352+0000 7fe380229700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37811f600 con 0x7fe378130700 2023-09-30T22:27:27.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.352+0000 7fe380229700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe378120f70 con 0x7fe37809d450 2023-09-30T22:27:27.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.352+0000 7fe380229700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe378121230 con 0x7fe37809dd60 2023-09-30T22:27:27.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.353+0000 7fe37e7c6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe378130700 0x7fe37811e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.353+0000 7fe37d7c4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe37809dd60 0x7fe37811df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.353+0000 7fe37e7c6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe378130700 0x7fe37811e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59768/0 (socket says 172.21.15.40:59768) 2023-09-30T22:27:27.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.353+0000 7fe37e7c6700 1 -- 172.21.15.40:0/2972416274 learned_addr learned my addr 172.21.15.40:0/2972416274 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:27.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.353+0000 7fe37d7c4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe37809dd60 0x7fe37811df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55424/0 (socket says 172.21.15.40:55424) 2023-09-30T22:27:27.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.353+0000 7fe37dfc5700 1 --2- 172.21.15.40:0/2972416274 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe37809d450 0x7fe37811d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.353+0000 7fe37e7c6700 1 -- 172.21.15.40:0/2972416274 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe37809dd60 msgr2=0x7fe37811df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:27.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.353+0000 7fe37e7c6700 1 --2- 172.21.15.40:0/2972416274 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe37809dd60 0x7fe37811df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.353+0000 7fe37e7c6700 1 -- 172.21.15.40:0/2972416274 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe37809d450 msgr2=0x7fe37811d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:27.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.353+0000 7fe37e7c6700 1 --2- 172.21.15.40:0/2972416274 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe37809d450 0x7fe37811d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.353+0000 7fe37e7c6700 1 -- 172.21.15.40:0/2972416274 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36800b7f0 con 0x7fe378130700 2023-09-30T22:27:27.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.353+0000 7fe37d7c4700 1 --2- 172.21.15.40:0/2972416274 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe37809dd60 0x7fe37811df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:27.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.353+0000 7fe37e7c6700 1 --2- 172.21.15.40:0/2972416274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe378130700 0x7fe37811e470 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fe37000cc50 tx=0x7fe37000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:27.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.353+0000 7fe36e7fc700 1 -- 172.21.15.40:0/2972416274 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe370003c00 con 0x7fe378130700 2023-09-30T22:27:27.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.354+0000 7fe36e7fc700 1 -- 172.21.15.40:0/2972416274 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe370003d60 con 0x7fe378130700 2023-09-30T22:27:27.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.354+0000 7fe380229700 1 -- 172.21.15.40:0/2972416274 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe378120ca0 con 0x7fe378130700 2023-09-30T22:27:27.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.354+0000 7fe36e7fc700 1 -- 172.21.15.40:0/2972416274 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37000ab60 con 0x7fe378130700 2023-09-30T22:27:27.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.354+0000 7fe380229700 1 -- 172.21.15.40:0/2972416274 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe37809c5d0 con 0x7fe378130700 2023-09-30T22:27:27.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.355+0000 7fe36e7fc700 1 -- 172.21.15.40:0/2972416274 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe37000acc0 con 0x7fe378130700 2023-09-30T22:27:27.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.355+0000 7fe36e7fc700 1 -- 172.21.15.40:0/2972416274 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe37003f750 con 0x7fe378130700 2023-09-30T22:27:27.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.355+0000 7fe380229700 1 -- 172.21.15.40:0/2972416274 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe378062380 con 0x7fe378130700 2023-09-30T22:27:27.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.364+0000 7fe36e7fc700 1 -- 172.21.15.40:0/2972416274 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe3700198f0 con 0x7fe378130700 2023-09-30T22:27:27.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.391+0000 7fb25e71b700 1 Processor -- start 2023-09-30T22:27:27.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.391+0000 7fb25e71b700 1 -- start start 2023-09-30T22:27:27.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.392+0000 7fb25e71b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb25809d920 0x7fb25809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.392+0000 7fb25e71b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb25809e230 0x7fb2581308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.392+0000 7fb25e71b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb258130de0 0x7fb258131260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.392+0000 7fb25e71b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb25809edf0 con 0x7fb25809e230 2023-09-30T22:27:27.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.392+0000 7fb25e71b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb25809adf0 con 0x7fb25809d920 2023-09-30T22:27:27.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.392+0000 7fb25e71b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb25809b660 con 0x7fb258130de0 2023-09-30T22:27:27.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.392+0000 7fb257fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb25809d920 0x7fb25809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.392+0000 7fb257fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb25809d920 0x7fb25809dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:58236/0 (socket says 172.21.15.40:58236) 2023-09-30T22:27:27.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.392+0000 7fb257fff700 1 -- 172.21.15.40:0/3252964756 learned_addr learned my addr 172.21.15.40:0/3252964756 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:27.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.392+0000 7fb2577fe700 1 --2- 172.21.15.40:0/3252964756 >> v2:172.21.15.40:3300/0 conn(0x7fb25809e230 0x7fb2581308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.392+0000 7fb25ccb8700 1 --2- 172.21.15.40:0/3252964756 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb258130de0 0x7fb258131260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.392+0000 7fb257fff700 1 -- 172.21.15.40:0/3252964756 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb258130de0 msgr2=0x7fb258131260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:27.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.392+0000 7fb257fff700 1 --2- 172.21.15.40:0/3252964756 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb258130de0 0x7fb258131260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.392+0000 7fb257fff700 1 -- 172.21.15.40:0/3252964756 >> v2:172.21.15.40:3300/0 conn(0x7fb25809e230 msgr2=0x7fb2581308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:27.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.392+0000 7fb257fff700 1 --2- 172.21.15.40:0/3252964756 >> v2:172.21.15.40:3300/0 conn(0x7fb25809e230 0x7fb2581308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.392+0000 7fb257fff700 1 -- 172.21.15.40:0/3252964756 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb25809a6e0 con 0x7fb25809d920 2023-09-30T22:27:27.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.393+0000 7fb257fff700 1 --2- 172.21.15.40:0/3252964756 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb25809d920 0x7fb25809dcf0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb248006fd0 tx=0x7fb24800be70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e3102b06e8cd1cb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:27.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.393+0000 7fb256ffd700 1 -- 172.21.15.40:0/3252964756 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb248005e30 con 0x7fb25809d920 2023-09-30T22:27:27.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.393+0000 7fb256ffd700 1 -- 172.21.15.40:0/3252964756 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb248004030 con 0x7fb25809d920 2023-09-30T22:27:27.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.393+0000 7fb256ffd700 1 -- 172.21.15.40:0/3252964756 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2480043e0 con 0x7fb25809d920 2023-09-30T22:27:27.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.393+0000 7fb25e71b700 1 -- 172.21.15.40:0/3252964756 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb25809d920 msgr2=0x7fb25809dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:27.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.393+0000 7fb25e71b700 1 --2- 172.21.15.40:0/3252964756 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb25809d920 0x7fb25809dcf0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb248006fd0 tx=0x7fb24800be70 comp rx=0 tx=0).stop 2023-09-30T22:27:27.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.393+0000 7fb25e71b700 1 -- 172.21.15.40:0/3252964756 shutdown_connections 2023-09-30T22:27:27.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.393+0000 7fb25e71b700 1 --2- 172.21.15.40:0/3252964756 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb258130de0 0x7fb258131260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.393+0000 7fb25e71b700 1 --2- 172.21.15.40:0/3252964756 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb25809d920 0x7fb25809dcf0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.393+0000 7fb25e71b700 1 --2- 172.21.15.40:0/3252964756 >> v2:172.21.15.40:3300/0 conn(0x7fb25809e230 0x7fb2581308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.393+0000 7fb25e71b700 1 -- 172.21.15.40:0/3252964756 >> 172.21.15.40:0/3252964756 conn(0x7fb25809fb20 msgr2=0x7fb25809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:27.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.394+0000 7fb25e71b700 1 -- 172.21.15.40:0/3252964756 shutdown_connections 2023-09-30T22:27:27.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.394+0000 7fb25e71b700 1 -- 172.21.15.40:0/3252964756 wait complete. 2023-09-30T22:27:27.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.394+0000 7fb25e71b700 1 Processor -- start 2023-09-30T22:27:27.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.395+0000 7fb25e71b700 1 -- start start 2023-09-30T22:27:27.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.395+0000 7fb25e71b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb25809d920 0x7fb258121380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.395+0000 7fb25e71b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb25809e230 0x7fb2581218c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.395+0000 7fb25e71b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb258130de0 0x7fb258121e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.395+0000 7fb25e71b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb258124ea0 con 0x7fb25809d920 2023-09-30T22:27:27.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.395+0000 7fb25e71b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb25806b100 con 0x7fb258130de0 2023-09-30T22:27:27.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.395+0000 7fb25e71b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb25809cb00 con 0x7fb25809e230 2023-09-30T22:27:27.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.395+0000 7fb257fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb25809d920 0x7fb258121380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.395+0000 7fb257fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb25809d920 0x7fb258121380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59790/0 (socket says 172.21.15.40:59790) 2023-09-30T22:27:27.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.395+0000 7fb257fff700 1 -- 172.21.15.40:0/504248712 learned_addr learned my addr 172.21.15.40:0/504248712 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:27.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.395+0000 7fb2577fe700 1 --2- 172.21.15.40:0/504248712 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb25809e230 0x7fb2581218c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.395+0000 7fb25ccb8700 1 --2- 172.21.15.40:0/504248712 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb258130de0 0x7fb258121e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.396+0000 7fb25ccb8700 1 -- 172.21.15.40:0/504248712 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb25809e230 msgr2=0x7fb2581218c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:27.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.396+0000 7fb25ccb8700 1 --2- 172.21.15.40:0/504248712 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb25809e230 0x7fb2581218c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.396+0000 7fb25ccb8700 1 -- 172.21.15.40:0/504248712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb25809d920 msgr2=0x7fb258121380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:27.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.396+0000 7fb25ccb8700 1 --2- 172.21.15.40:0/504248712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb25809d920 0x7fb258121380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.396+0000 7fb25ccb8700 1 -- 172.21.15.40:0/504248712 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb24800b7a0 con 0x7fb258130de0 2023-09-30T22:27:27.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.396+0000 7fb2577fe700 1 --2- 172.21.15.40:0/504248712 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb25809e230 0x7fb2581218c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:27.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.396+0000 7fb25ccb8700 1 --2- 172.21.15.40:0/504248712 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb258130de0 0x7fb258121e00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb25000efc0 tx=0x7fb25000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:27.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.396+0000 7fb254ff9700 1 -- 172.21.15.40:0/504248712 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25000cc90 con 0x7fb258130de0 2023-09-30T22:27:27.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.396+0000 7fb254ff9700 1 -- 172.21.15.40:0/504248712 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25000f040 con 0x7fb258130de0 2023-09-30T22:27:27.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.396+0000 7fb254ff9700 1 -- 172.21.15.40:0/504248712 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2500146c0 con 0x7fb258130de0 2023-09-30T22:27:27.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.396+0000 7fb25e71b700 1 -- 172.21.15.40:0/504248712 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2581241e0 con 0x7fb258130de0 2023-09-30T22:27:27.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.396+0000 7fb25e71b700 1 -- 172.21.15.40:0/504248712 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb258123780 con 0x7fb258130de0 2023-09-30T22:27:27.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.397+0000 7fb25e71b700 1 -- 172.21.15.40:0/504248712 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb258124810 con 0x7fb258130de0 2023-09-30T22:27:27.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.397+0000 7fb254ff9700 1 -- 172.21.15.40:0/504248712 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb250014820 con 0x7fb258130de0 2023-09-30T22:27:27.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.398+0000 7fb254ff9700 1 -- 172.21.15.40:0/504248712 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb250040200 con 0x7fb258130de0 2023-09-30T22:27:27.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.406+0000 7fb254ff9700 1 -- 172.21.15.40:0/504248712 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb250007900 con 0x7fb258130de0 2023-09-30T22:27:27.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.423+0000 7f4be3a29700 1 Processor -- start 2023-09-30T22:27:27.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.423+0000 7f4be3a29700 1 -- start start 2023-09-30T22:27:27.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.424+0000 7f4be3a29700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4bdc06a6d0 0x7f4bdc06aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.424+0000 7f4be3a29700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4bdc06afe0 0x7f4bdc1318b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.424+0000 7f4be3a29700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4bdc131df0 0x7f4bdc132270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.424+0000 7f4be3a29700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bdc09eb50 con 0x7f4bdc06a6d0 2023-09-30T22:27:27.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.424+0000 7f4be3a29700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc09dde0 con 0x7f4bdc131df0 2023-09-30T22:27:27.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.424+0000 7f4be3a29700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc09d4a0 con 0x7f4bdc06afe0 2023-09-30T22:27:27.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.424+0000 7f4be0fc4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4bdc06afe0 0x7f4bdc1318b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.424+0000 7f4be0fc4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4bdc06afe0 0x7f4bdc1318b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55458/0 (socket says 172.21.15.40:55458) 2023-09-30T22:27:27.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.424+0000 7f4be0fc4700 1 -- 172.21.15.40:0/3436033901 learned_addr learned my addr 172.21.15.40:0/3436033901 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:27.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.424+0000 7f4be17c5700 1 --2- 172.21.15.40:0/3436033901 >> v2:172.21.15.40:3300/0 conn(0x7f4bdc06a6d0 0x7f4bdc06aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.425+0000 7f4be1fc6700 1 --2- 172.21.15.40:0/3436033901 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4bdc131df0 0x7f4bdc132270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.425+0000 7f4be0fc4700 1 -- 172.21.15.40:0/3436033901 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4bdc131df0 msgr2=0x7f4bdc132270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:27.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.425+0000 7f4be0fc4700 1 --2- 172.21.15.40:0/3436033901 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4bdc131df0 0x7f4bdc132270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.425+0000 7f4be0fc4700 1 -- 172.21.15.40:0/3436033901 >> v2:172.21.15.40:3300/0 conn(0x7f4bdc06a6d0 msgr2=0x7f4bdc06aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:27.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.425+0000 7f4be0fc4700 1 --2- 172.21.15.40:0/3436033901 >> v2:172.21.15.40:3300/0 conn(0x7f4bdc06a6d0 0x7f4bdc06aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.425+0000 7f4be0fc4700 1 -- 172.21.15.40:0/3436033901 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bdc09f5f0 con 0x7f4bdc06afe0 2023-09-30T22:27:27.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.425+0000 7f4be17c5700 1 --2- 172.21.15.40:0/3436033901 >> v2:172.21.15.40:3300/0 conn(0x7f4bdc06a6d0 0x7f4bdc06aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:27.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.425+0000 7f4be0fc4700 1 --2- 172.21.15.40:0/3436033901 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4bdc06afe0 0x7f4bdc1318b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc0098f0 tx=0x7f4bcc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1250b246968df051 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:27.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.425+0000 7f4bd3fff700 1 -- 172.21.15.40:0/3436033901 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc011830 con 0x7f4bdc06afe0 2023-09-30T22:27:27.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.425+0000 7f4bd3fff700 1 -- 172.21.15.40:0/3436033901 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bcc011990 con 0x7f4bdc06afe0 2023-09-30T22:27:27.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.425+0000 7f4bd3fff700 1 -- 172.21.15.40:0/3436033901 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc011d20 con 0x7f4bdc06afe0 2023-09-30T22:27:27.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.426+0000 7f4be3a29700 1 -- 172.21.15.40:0/3436033901 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4bdc06afe0 msgr2=0x7f4bdc1318b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:27.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.426+0000 7f4be3a29700 1 --2- 172.21.15.40:0/3436033901 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4bdc06afe0 0x7f4bdc1318b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc0098f0 tx=0x7f4bcc009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:27.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.426+0000 7f4be3a29700 1 -- 172.21.15.40:0/3436033901 shutdown_connections 2023-09-30T22:27:27.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.426+0000 7f4be3a29700 1 --2- 172.21.15.40:0/3436033901 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4bdc131df0 0x7f4bdc132270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.426+0000 7f4be3a29700 1 --2- 172.21.15.40:0/3436033901 >> v2:172.21.15.40:3300/0 conn(0x7f4bdc06a6d0 0x7f4bdc06aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.426+0000 7f4be3a29700 1 --2- 172.21.15.40:0/3436033901 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4bdc06afe0 0x7f4bdc1318b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.426+0000 7f4be3a29700 1 -- 172.21.15.40:0/3436033901 >> 172.21.15.40:0/3436033901 conn(0x7f4bdc09fb20 msgr2=0x7f4bdc09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:27.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.426+0000 7f4be3a29700 1 -- 172.21.15.40:0/3436033901 shutdown_connections 2023-09-30T22:27:27.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.426+0000 7f4be3a29700 1 -- 172.21.15.40:0/3436033901 wait complete. 2023-09-30T22:27:27.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.428+0000 7f4be3a29700 1 Processor -- start 2023-09-30T22:27:27.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.428+0000 7f4be3a29700 1 -- start start 2023-09-30T22:27:27.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.428+0000 7f4be3a29700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4bdc06a6d0 0x7f4bdc1c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.428+0000 7f4be3a29700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4bdc06afe0 0x7f4bdc1c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.429+0000 7f4be3a29700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4bdc131df0 0x7f4bdc1c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.429+0000 7f4be3a29700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc131920 con 0x7f4bdc06afe0 2023-09-30T22:27:27.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.429+0000 7f4be3a29700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc120550 con 0x7f4bdc131df0 2023-09-30T22:27:27.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.429+0000 7f4be3a29700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc09a7d0 con 0x7f4bdc06a6d0 2023-09-30T22:27:27.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.429+0000 7f4be0fc4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4bdc06afe0 0x7f4bdc1c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.429+0000 7f4be0fc4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4bdc06afe0 0x7f4bdc1c89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59806/0 (socket says 172.21.15.40:59806) 2023-09-30T22:27:27.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.429+0000 7f4be0fc4700 1 -- 172.21.15.40:0/2200729388 learned_addr learned my addr 172.21.15.40:0/2200729388 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:27.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.429+0000 7f4be1fc6700 1 --2- 172.21.15.40:0/2200729388 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4bdc131df0 0x7f4bdc1c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.429+0000 7f4be17c5700 1 --2- 172.21.15.40:0/2200729388 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4bdc06a6d0 0x7f4bdc1c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.429+0000 7f4be0fc4700 1 -- 172.21.15.40:0/2200729388 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4bdc06a6d0 msgr2=0x7f4bdc1c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:27.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.429+0000 7f4be0fc4700 1 --2- 172.21.15.40:0/2200729388 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4bdc06a6d0 0x7f4bdc1c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.429+0000 7f4be0fc4700 1 -- 172.21.15.40:0/2200729388 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4bdc131df0 msgr2=0x7f4bdc1c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:27.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.429+0000 7f4be0fc4700 1 --2- 172.21.15.40:0/2200729388 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4bdc131df0 0x7f4bdc1c8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.429+0000 7f4be0fc4700 1 -- 172.21.15.40:0/2200729388 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd8009430 con 0x7f4bdc06afe0 2023-09-30T22:27:27.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.429+0000 7f4be0fc4700 1 --2- 172.21.15.40:0/2200729388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4bdc06afe0 0x7f4bdc1c89a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc009c40 tx=0x7f4bcc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:27.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.430+0000 7f4bd1ffb700 1 -- 172.21.15.40:0/2200729388 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc004300 con 0x7f4bdc06afe0 2023-09-30T22:27:27.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.430+0000 7f4bd1ffb700 1 -- 172.21.15.40:0/2200729388 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bcc01f070 con 0x7f4bdc06afe0 2023-09-30T22:27:27.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.430+0000 7f4bd1ffb700 1 -- 172.21.15.40:0/2200729388 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc0036a0 con 0x7f4bdc06afe0 2023-09-30T22:27:27.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.430+0000 7f4be3a29700 1 -- 172.21.15.40:0/2200729388 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bcc009550 con 0x7f4bdc06afe0 2023-09-30T22:27:27.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.430+0000 7f4be3a29700 1 -- 172.21.15.40:0/2200729388 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bdc11f590 con 0x7f4bdc06afe0 2023-09-30T22:27:27.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.431+0000 7f4be3a29700 1 -- 172.21.15.40:0/2200729388 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bdc062380 con 0x7f4bdc06afe0 2023-09-30T22:27:27.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.432+0000 7f4bd1ffb700 1 -- 172.21.15.40:0/2200729388 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4bcc021030 con 0x7f4bdc06afe0 2023-09-30T22:27:27.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.432+0000 7f4bd1ffb700 1 -- 172.21.15.40:0/2200729388 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4bcc0409c0 con 0x7f4bdc06afe0 2023-09-30T22:27:27.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.436+0000 7f4bd1ffb700 1 -- 172.21.15.40:0/2200729388 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4bcc0199a0 con 0x7f4bdc06afe0 2023-09-30T22:27:27.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.528+0000 7f73873a2700 1 -- 172.21.15.40:0/1352656394 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f73800a0db0 con 0x7f738009dd50 2023-09-30T22:27:27.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.528+0000 7f7375ffb700 1 -- 172.21.15.40:0/1352656394 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7370015020 con 0x7f738009dd50 2023-09-30T22:27:27.528 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:27.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.532+0000 7f73873a2700 1 -- 172.21.15.40:0/1352656394 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f738009dd50 msgr2=0x7f7380122df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:27.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.532+0000 7f73873a2700 1 --2- 172.21.15.40:0/1352656394 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f738009dd50 0x7f7380122df0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f737000b560 tx=0x7f737000b920 comp rx=0 tx=0).stop 2023-09-30T22:27:27.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.532+0000 7f73873a2700 1 -- 172.21.15.40:0/1352656394 shutdown_connections 2023-09-30T22:27:27.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.532+0000 7f73873a2700 1 --2- 172.21.15.40:0/1352656394 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7380138250 0x7f7380123330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.532+0000 7f73873a2700 1 --2- 172.21.15.40:0/1352656394 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f738009d400 0x7f73801228b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.532+0000 7f73873a2700 1 --2- 172.21.15.40:0/1352656394 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f738009dd50 0x7f7380122df0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.532+0000 7f73873a2700 1 -- 172.21.15.40:0/1352656394 >> 172.21.15.40:0/1352656394 conn(0x7f73800a2a00 msgr2=0x7f738009f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:27.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.532+0000 7f73873a2700 1 -- 172.21.15.40:0/1352656394 shutdown_connections 2023-09-30T22:27:27.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.532+0000 7f73873a2700 1 -- 172.21.15.40:0/1352656394 wait complete. 2023-09-30T22:27:27.548 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:27.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.576+0000 7fe380229700 1 -- 172.21.15.40:0/2972416274 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe378074330 con 0x7fe378130700 2023-09-30T22:27:27.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.577+0000 7fe36e7fc700 1 -- 172.21.15.40:0/2972416274 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe370019300 con 0x7fe378130700 2023-09-30T22:27:27.576 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:27.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.579+0000 7fe380229700 1 -- 172.21.15.40:0/2972416274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe378130700 msgr2=0x7fe37811e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:27.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.579+0000 7fe380229700 1 --2- 172.21.15.40:0/2972416274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe378130700 0x7fe37811e470 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fe37000cc50 tx=0x7fe37000cf60 comp rx=0 tx=0).stop 2023-09-30T22:27:27.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.579+0000 7fe380229700 1 -- 172.21.15.40:0/2972416274 shutdown_connections 2023-09-30T22:27:27.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.579+0000 7fe380229700 1 --2- 172.21.15.40:0/2972416274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe378130700 0x7fe37811e470 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.579+0000 7fe380229700 1 --2- 172.21.15.40:0/2972416274 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe37809d450 0x7fe37811d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.579+0000 7fe380229700 1 --2- 172.21.15.40:0/2972416274 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe37809dd60 0x7fe37811df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.579+0000 7fe380229700 1 -- 172.21.15.40:0/2972416274 >> 172.21.15.40:0/2972416274 conn(0x7fe3780a2a00 msgr2=0x7fe37812e640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:27.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.579+0000 7fe380229700 1 -- 172.21.15.40:0/2972416274 shutdown_connections 2023-09-30T22:27:27.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.579+0000 7fe380229700 1 -- 172.21.15.40:0/2972416274 wait complete. 2023-09-30T22:27:27.591 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:27.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.607+0000 7fb25e71b700 1 -- 172.21.15.40:0/504248712 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb258062380 con 0x7fb258130de0 2023-09-30T22:27:27.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.607+0000 7fb254ff9700 1 -- 172.21.15.40:0/504248712 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb250018020 con 0x7fb258130de0 2023-09-30T22:27:27.607 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:27.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.609+0000 7fb25e71b700 1 -- 172.21.15.40:0/504248712 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb258130de0 msgr2=0x7fb258121e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:27.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.609+0000 7fb25e71b700 1 --2- 172.21.15.40:0/504248712 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb258130de0 0x7fb258121e00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb25000efc0 tx=0x7fb25000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.609+0000 7fb25e71b700 1 -- 172.21.15.40:0/504248712 shutdown_connections 2023-09-30T22:27:27.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.609+0000 7fb25e71b700 1 --2- 172.21.15.40:0/504248712 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb258130de0 0x7fb258121e00 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.609+0000 7fb25e71b700 1 --2- 172.21.15.40:0/504248712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb25809d920 0x7fb258121380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.609+0000 7fb25e71b700 1 --2- 172.21.15.40:0/504248712 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb25809e230 0x7fb2581218c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.609+0000 7fb25e71b700 1 -- 172.21.15.40:0/504248712 >> 172.21.15.40:0/504248712 conn(0x7fb25809fb20 msgr2=0x7fb25812fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:27.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.609+0000 7fb25e71b700 1 -- 172.21.15.40:0/504248712 shutdown_connections 2023-09-30T22:27:27.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.609+0000 7fb25e71b700 1 -- 172.21.15.40:0/504248712 wait complete. 2023-09-30T22:27:27.621 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:27.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.654+0000 7f4be3a29700 1 -- 172.21.15.40:0/2200729388 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4bdc120690 con 0x7f4bdc06afe0 2023-09-30T22:27:27.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.655+0000 7f4bd1ffb700 1 -- 172.21.15.40:0/2200729388 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4bcc032020 con 0x7f4bdc06afe0 2023-09-30T22:27:27.654 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:27.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.657+0000 7f4be3a29700 1 -- 172.21.15.40:0/2200729388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4bdc06afe0 msgr2=0x7f4bdc1c89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:27.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.657+0000 7f4be3a29700 1 --2- 172.21.15.40:0/2200729388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4bdc06afe0 0x7f4bdc1c89a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc009c40 tx=0x7f4bcc004750 comp rx=0 tx=0).stop 2023-09-30T22:27:27.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.657+0000 7f4be3a29700 1 -- 172.21.15.40:0/2200729388 shutdown_connections 2023-09-30T22:27:27.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.657+0000 7f4be3a29700 1 --2- 172.21.15.40:0/2200729388 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4bdc06a6d0 0x7f4bdc1c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.657+0000 7f4be3a29700 1 --2- 172.21.15.40:0/2200729388 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4bdc131df0 0x7f4bdc1c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.657+0000 7f4be3a29700 1 --2- 172.21.15.40:0/2200729388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4bdc06afe0 0x7f4bdc1c89a0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.657+0000 7f4be3a29700 1 -- 172.21.15.40:0/2200729388 >> 172.21.15.40:0/2200729388 conn(0x7f4bdc09fb20 msgr2=0x7f4bdc070190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:27.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.657+0000 7f4be3a29700 1 -- 172.21.15.40:0/2200729388 shutdown_connections 2023-09-30T22:27:27.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:27.657+0000 7f4be3a29700 1 -- 172.21.15.40:0/2200729388 wait complete. 2023-09-30T22:27:27.668 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:28.549 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:28.592 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:28.622 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:28.669 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:28.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.690+0000 7fb4048d4700 1 Processor -- start 2023-09-30T22:27:28.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.690+0000 7fb4048d4700 1 -- start start 2023-09-30T22:27:28.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.691+0000 7fb4048d4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb40009d920 0x7fb40009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:28.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.691+0000 7fb4048d4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb40009e230 0x7fb4001308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:28.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.691+0000 7fb4048d4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb400130de0 0x7fb400131280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:28.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.691+0000 7fb4048d4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb40009edf0 con 0x7fb400130de0 2023-09-30T22:27:28.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.691+0000 7fb4048d4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb40009adf0 con 0x7fb40009d920 2023-09-30T22:27:28.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.691+0000 7fb4048d4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb40009b660 con 0x7fb40009e230 2023-09-30T22:27:28.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.691+0000 7fb3fdd9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb40009e230 0x7fb4001308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:28.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.691+0000 7fb3fed9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb400130de0 0x7fb400131280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:28.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.691+0000 7fb3fed9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb400130de0 0x7fb400131280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59820/0 (socket says 172.21.15.40:59820) 2023-09-30T22:27:28.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.691+0000 7fb3fed9d700 1 -- 172.21.15.40:0/2745917744 learned_addr learned my addr 172.21.15.40:0/2745917744 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:28.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.691+0000 7fb3fdd9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb40009e230 0x7fb4001308a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55484/0 (socket says 172.21.15.40:55484) 2023-09-30T22:27:28.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.692+0000 7fb3fdd9b700 1 -- 172.21.15.40:0/2745917744 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb40009d920 msgr2=0x7fb40009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:28.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.692+0000 7fb3fdd9b700 1 --2- 172.21.15.40:0/2745917744 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb40009d920 0x7fb40009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.692+0000 7fb3fdd9b700 1 -- 172.21.15.40:0/2745917744 >> v2:172.21.15.40:3300/0 conn(0x7fb400130de0 msgr2=0x7fb400131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:28.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.692+0000 7fb3fdd9b700 1 --2- 172.21.15.40:0/2745917744 >> v2:172.21.15.40:3300/0 conn(0x7fb400130de0 0x7fb400131280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.692+0000 7fb3fdd9b700 1 -- 172.21.15.40:0/2745917744 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb40009a6e0 con 0x7fb40009e230 2023-09-30T22:27:28.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.692+0000 7fb3fed9d700 1 --2- 172.21.15.40:0/2745917744 >> v2:172.21.15.40:3300/0 conn(0x7fb400130de0 0x7fb400131280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:28.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.692+0000 7fb3fdd9b700 1 --2- 172.21.15.40:0/2745917744 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb40009e230 0x7fb4001308a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4009840 tx=0x7fb3f4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95fcfe8dd166a471 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:28.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.692+0000 7fb3fd59a700 1 -- 172.21.15.40:0/2745917744 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4011830 con 0x7fb40009e230 2023-09-30T22:27:28.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.692+0000 7fb3fd59a700 1 -- 172.21.15.40:0/2745917744 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f4011990 con 0x7fb40009e230 2023-09-30T22:27:28.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.692+0000 7fb3fd59a700 1 -- 172.21.15.40:0/2745917744 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4011d20 con 0x7fb40009e230 2023-09-30T22:27:28.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.693+0000 7fb4048d4700 1 -- 172.21.15.40:0/2745917744 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb40009e230 msgr2=0x7fb4001308a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:28.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.693+0000 7fb4048d4700 1 --2- 172.21.15.40:0/2745917744 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb40009e230 0x7fb4001308a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4009840 tx=0x7fb3f4009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:28.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.693+0000 7fb4048d4700 1 -- 172.21.15.40:0/2745917744 shutdown_connections 2023-09-30T22:27:28.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.693+0000 7fb4048d4700 1 --2- 172.21.15.40:0/2745917744 >> v2:172.21.15.40:3300/0 conn(0x7fb400130de0 0x7fb400131280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.693+0000 7fb4048d4700 1 --2- 172.21.15.40:0/2745917744 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb40009d920 0x7fb40009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.693+0000 7fb4048d4700 1 --2- 172.21.15.40:0/2745917744 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb40009e230 0x7fb4001308a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.693+0000 7fb4048d4700 1 -- 172.21.15.40:0/2745917744 >> 172.21.15.40:0/2745917744 conn(0x7fb40009fb20 msgr2=0x7fb40009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:28.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.693+0000 7fb4048d4700 1 -- 172.21.15.40:0/2745917744 shutdown_connections 2023-09-30T22:27:28.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.693+0000 7fb4048d4700 1 -- 172.21.15.40:0/2745917744 wait complete. 2023-09-30T22:27:28.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.695+0000 7fb4048d4700 1 Processor -- start 2023-09-30T22:27:28.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.695+0000 7fb4048d4700 1 -- start start 2023-09-30T22:27:28.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.696+0000 7fb4048d4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb40009d920 0x7fb4001c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:28.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.696+0000 7fb4048d4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb40009e230 0x7fb4001c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:28.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.696+0000 7fb4048d4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb400130de0 0x7fb4001c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:28.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.696+0000 7fb4048d4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40012fdf0 con 0x7fb40009e230 2023-09-30T22:27:28.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.696+0000 7fb4048d4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb400132260 con 0x7fb400130de0 2023-09-30T22:27:28.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.696+0000 7fb4048d4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb40012fbc0 con 0x7fb40009d920 2023-09-30T22:27:28.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.696+0000 7fb3fe59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb40009d920 0x7fb4001c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:28.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.696+0000 7fb3fe59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb40009d920 0x7fb4001c8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55500/0 (socket says 172.21.15.40:55500) 2023-09-30T22:27:28.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.696+0000 7fb3fe59c700 1 -- 172.21.15.40:0/734651880 learned_addr learned my addr 172.21.15.40:0/734651880 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:28.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.696+0000 7fb3fdd9b700 1 --2- 172.21.15.40:0/734651880 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb40009e230 0x7fb4001c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:28.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.696+0000 7fb3fe59c700 1 -- 172.21.15.40:0/734651880 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb400130de0 msgr2=0x7fb4001c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:28.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.696+0000 7fb3fe59c700 1 --2- 172.21.15.40:0/734651880 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb400130de0 0x7fb4001c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.696+0000 7fb3fe59c700 1 -- 172.21.15.40:0/734651880 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb40009e230 msgr2=0x7fb4001c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:28.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.696+0000 7fb3fe59c700 1 --2- 172.21.15.40:0/734651880 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb40009e230 0x7fb4001c8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.696+0000 7fb3fe59c700 1 -- 172.21.15.40:0/734651880 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f8009b30 con 0x7fb40009d920 2023-09-30T22:27:28.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.696+0000 7fb3fdd9b700 1 --2- 172.21.15.40:0/734651880 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb40009e230 0x7fb4001c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:28.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.697+0000 7fb3fe59c700 1 --2- 172.21.15.40:0/734651880 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb40009d920 0x7fb4001c8400 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb3f000b520 tx=0x7fb3f000b830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:28.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.697+0000 7fb3eeffd700 1 -- 172.21.15.40:0/734651880 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f0005aa0 con 0x7fb40009d920 2023-09-30T22:27:28.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.697+0000 7fb3eeffd700 1 -- 172.21.15.40:0/734651880 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f0005c00 con 0x7fb40009d920 2023-09-30T22:27:28.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.697+0000 7fb3eeffd700 1 -- 172.21.15.40:0/734651880 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f0011630 con 0x7fb40009d920 2023-09-30T22:27:28.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.697+0000 7fb4048d4700 1 -- 172.21.15.40:0/734651880 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3f40094a0 con 0x7fb40009d920 2023-09-30T22:27:28.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.697+0000 7fb4048d4700 1 -- 172.21.15.40:0/734651880 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb40006b1d0 con 0x7fb40009d920 2023-09-30T22:27:28.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.698+0000 7fb4048d4700 1 -- 172.21.15.40:0/734651880 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb400062380 con 0x7fb40009d920 2023-09-30T22:27:28.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.698+0000 7fb3eeffd700 1 -- 172.21.15.40:0/734651880 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb3f0011790 con 0x7fb40009d920 2023-09-30T22:27:28.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.699+0000 7fb3eeffd700 1 -- 172.21.15.40:0/734651880 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb3f0040930 con 0x7fb40009d920 2023-09-30T22:27:28.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.704+0000 7fb3eeffd700 1 -- 172.21.15.40:0/734651880 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb3f0044060 con 0x7fb40009d920 2023-09-30T22:27:28.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.734+0000 7fa70bf7c700 1 Processor -- start 2023-09-30T22:27:28.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.734+0000 7fa70bf7c700 1 -- start start 2023-09-30T22:27:28.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.734+0000 7fa70bf7c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa70412f070 0x7fa704135c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:28.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.734+0000 7fa70bf7c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa704136170 0x7fa704138550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:28.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.734+0000 7fa70bf7c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa70409ab70 con 0x7fa70412e590 2023-09-30T22:27:28.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.734+0000 7fa70bf7c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa70409b270 con 0x7fa704136170 2023-09-30T22:27:28.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.734+0000 7fa70bf7c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa70412f440 con 0x7fa70412f070 2023-09-30T22:27:28.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.734+0000 7fa709517700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa70412f070 0x7fa704135c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:28.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.734+0000 7fa709517700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa70412f070 0x7fa704135c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55508/0 (socket says 172.21.15.40:55508) 2023-09-30T22:27:28.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.734+0000 7fa709517700 1 -- 172.21.15.40:0/3474875625 learned_addr learned my addr 172.21.15.40:0/3474875625 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:28.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.735+0000 7fa70a519700 1 --2- 172.21.15.40:0/3474875625 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa704136170 0x7fa704138550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:28.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.735+0000 7fa709517700 1 -- 172.21.15.40:0/3474875625 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa704136170 msgr2=0x7fa704138550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:28.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.735+0000 7fa709517700 1 --2- 172.21.15.40:0/3474875625 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa704136170 0x7fa704138550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.735+0000 7fa709517700 1 -- 172.21.15.40:0/3474875625 >> v1:172.21.15.40:6789/0 conn(0x7fa70412e590 legacy=0x7fa70412e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:28.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.735+0000 7fa709517700 1 -- 172.21.15.40:0/3474875625 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa70409bd70 con 0x7fa70412f070 2023-09-30T22:27:28.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.735+0000 7fa709517700 1 --2- 172.21.15.40:0/3474875625 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa70412f070 0x7fa704135c30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4009920 tx=0x7fa6f4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6da7f1892326a553 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:28.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.735+0000 7fa708d16700 1 -- 172.21.15.40:0/3474875625 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4011830 con 0x7fa70412f070 2023-09-30T22:27:28.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.735+0000 7fa708d16700 1 -- 172.21.15.40:0/3474875625 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f4011990 con 0x7fa70412f070 2023-09-30T22:27:28.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.735+0000 7fa708d16700 1 -- 172.21.15.40:0/3474875625 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4011d20 con 0x7fa70412f070 2023-09-30T22:27:28.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.736+0000 7fa70bf7c700 1 -- 172.21.15.40:0/3474875625 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa70412f070 msgr2=0x7fa704135c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:28.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.736+0000 7fa70bf7c700 1 --2- 172.21.15.40:0/3474875625 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa70412f070 0x7fa704135c30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4009920 tx=0x7fa6f4009c30 comp rx=0 tx=0).stop 2023-09-30T22:27:28.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.736+0000 7fa70bf7c700 1 -- 172.21.15.40:0/3474875625 shutdown_connections 2023-09-30T22:27:28.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.736+0000 7fa70bf7c700 1 --2- 172.21.15.40:0/3474875625 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa704136170 0x7fa704138550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.736+0000 7fa70bf7c700 1 --2- 172.21.15.40:0/3474875625 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa70412f070 0x7fa704135c30 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.736+0000 7fa70bf7c700 1 -- 172.21.15.40:0/3474875625 >> 172.21.15.40:0/3474875625 conn(0x7fa7040a2a00 msgr2=0x7fa7040a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:28.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.737+0000 7fa70bf7c700 1 -- 172.21.15.40:0/3474875625 shutdown_connections 2023-09-30T22:27:28.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.737+0000 7fa70bf7c700 1 -- 172.21.15.40:0/3474875625 wait complete. 2023-09-30T22:27:28.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.738+0000 7fa70bf7c700 1 Processor -- start 2023-09-30T22:27:28.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.738+0000 7fa70bf7c700 1 -- start start 2023-09-30T22:27:28.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.739+0000 7fa70bf7c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa70412e590 0x7fa704139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:28.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.739+0000 7fa70bf7c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa70412f070 0x7fa704139fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:28.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.739+0000 7fa70bf7c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa704136170 0x7fa70413a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:28.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.739+0000 7fa70bf7c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa704131c70 con 0x7fa704136170 2023-09-30T22:27:28.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.739+0000 7fa70bf7c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa70409b4b0 con 0x7fa70412e590 2023-09-30T22:27:28.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.739+0000 7fa70bf7c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa70413b0a0 con 0x7fa70412f070 2023-09-30T22:27:28.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.739+0000 7fa709517700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa70412f070 0x7fa704139fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:28.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.739+0000 7fa709517700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa70412f070 0x7fa704139fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55522/0 (socket says 172.21.15.40:55522) 2023-09-30T22:27:28.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.739+0000 7fa709517700 1 -- 172.21.15.40:0/3516113522 learned_addr learned my addr 172.21.15.40:0/3516113522 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:28.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.739+0000 7fa709d18700 1 --2- 172.21.15.40:0/3516113522 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa70412e590 0x7fa704139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:28.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.739+0000 7fa70a519700 1 --2- 172.21.15.40:0/3516113522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa704136170 0x7fa70413a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:28.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.739+0000 7fa709517700 1 -- 172.21.15.40:0/3516113522 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa70412e590 msgr2=0x7fa704139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:28.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.739+0000 7fa709517700 1 --2- 172.21.15.40:0/3516113522 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa70412e590 0x7fa704139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.739+0000 7fa709517700 1 -- 172.21.15.40:0/3516113522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa704136170 msgr2=0x7fa70413a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:28.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.739+0000 7fa709517700 1 --2- 172.21.15.40:0/3516113522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa704136170 0x7fa70413a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.739+0000 7fa709517700 1 -- 172.21.15.40:0/3516113522 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f4009550 con 0x7fa70412f070 2023-09-30T22:27:28.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.740+0000 7fa709517700 1 --2- 172.21.15.40:0/3516113522 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa70412f070 0x7fa704139fe0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4000c00 tx=0x7fa6f4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:28.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.740+0000 7fa6fa7fc700 1 -- 172.21.15.40:0/3516113522 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4004450 con 0x7fa70412f070 2023-09-30T22:27:28.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.740+0000 7fa6fa7fc700 1 -- 172.21.15.40:0/3516113522 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f40045b0 con 0x7fa70412f070 2023-09-30T22:27:28.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.740+0000 7fa70bf7c700 1 -- 172.21.15.40:0/3516113522 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7040a23a0 con 0x7fa70412f070 2023-09-30T22:27:28.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.740+0000 7fa6fa7fc700 1 -- 172.21.15.40:0/3516113522 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f40038c0 con 0x7fa70412f070 2023-09-30T22:27:28.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.740+0000 7fa70bf7c700 1 -- 172.21.15.40:0/3516113522 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7040704a0 con 0x7fa70412f070 2023-09-30T22:27:28.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.741+0000 7fa6fa7fc700 1 -- 172.21.15.40:0/3516113522 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa6f4003a20 con 0x7fa70412f070 2023-09-30T22:27:28.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.741+0000 7fa6fa7fc700 1 -- 172.21.15.40:0/3516113522 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa6f4021030 con 0x7fa70412f070 2023-09-30T22:27:28.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.741+0000 7fa70bf7c700 1 -- 172.21.15.40:0/3516113522 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa70409eb00 con 0x7fa70412f070 2023-09-30T22:27:28.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.750+0000 7fa6fa7fc700 1 -- 172.21.15.40:0/3516113522 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa6f401a430 con 0x7fa70412f070 2023-09-30T22:27:28.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.780+0000 7f5a4c4a2700 1 Processor -- start 2023-09-30T22:27:28.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.780+0000 7f5a4c4a2700 1 -- start start 2023-09-30T22:27:28.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.781+0000 7f5a4c4a2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5a44138250 0x7f5a44138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:28.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.781+0000 7f5a4c4a2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a4409d400 0x7f5a4409d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:28.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.781+0000 7f5a4c4a2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a44137e20 con 0x7f5a4409dd50 2023-09-30T22:27:28.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.781+0000 7f5a4c4a2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a44138050 con 0x7f5a44138250 2023-09-30T22:27:28.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.781+0000 7f5a4c4a2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4409b010 con 0x7f5a4409d400 2023-09-30T22:27:28.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.781+0000 7f5a49a3d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a4409d400 0x7f5a4409d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:28.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.781+0000 7f5a4a23e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5a44138250 0x7f5a44138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:28.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.781+0000 7f5a49a3d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a4409d400 0x7f5a4409d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55532/0 (socket says 172.21.15.40:55532) 2023-09-30T22:27:28.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.781+0000 7f5a49a3d700 1 -- 172.21.15.40:0/640331905 learned_addr learned my addr 172.21.15.40:0/640331905 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:28.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.781+0000 7f5a4a23e700 1 -- 172.21.15.40:0/640331905 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a4409d400 msgr2=0x7f5a4409d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:28.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.781+0000 7f5a4a23e700 1 --2- 172.21.15.40:0/640331905 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a4409d400 0x7f5a4409d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.781+0000 7f5a4a23e700 1 -- 172.21.15.40:0/640331905 >> v1:172.21.15.40:6789/0 conn(0x7f5a4409dd50 legacy=0x7f5a4413f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:28.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.781+0000 7f5a4a23e700 1 -- 172.21.15.40:0/640331905 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4409f1f0 con 0x7f5a44138250 2023-09-30T22:27:28.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.781+0000 7f5a49a3d700 1 --2- 172.21.15.40:0/640331905 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a4409d400 0x7f5a4409d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:28.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.781+0000 7f5a4a23e700 1 --2- 172.21.15.40:0/640331905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a44138250 0x7f5a44138620 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c009d90 tx=0x7f5a3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b417d9a0c3451176 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:28.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.782+0000 7f5a4923c700 1 -- 172.21.15.40:0/640331905 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c00e070 con 0x7f5a44138250 2023-09-30T22:27:28.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.782+0000 7f5a4923c700 1 -- 172.21.15.40:0/640331905 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3c00bb20 con 0x7f5a44138250 2023-09-30T22:27:28.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.782+0000 7f5a4923c700 1 -- 172.21.15.40:0/640331905 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c012430 con 0x7f5a44138250 2023-09-30T22:27:28.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.782+0000 7f5a4c4a2700 1 -- 172.21.15.40:0/640331905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a44138250 msgr2=0x7f5a44138620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:28.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.782+0000 7f5a4c4a2700 1 --2- 172.21.15.40:0/640331905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a44138250 0x7f5a44138620 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c009d90 tx=0x7f5a3c00b330 comp rx=0 tx=0).stop 2023-09-30T22:27:28.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.782+0000 7f5a4c4a2700 1 -- 172.21.15.40:0/640331905 shutdown_connections 2023-09-30T22:27:28.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.782+0000 7f5a4c4a2700 1 --2- 172.21.15.40:0/640331905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a44138250 0x7f5a44138620 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.782+0000 7f5a4c4a2700 1 --2- 172.21.15.40:0/640331905 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a4409d400 0x7f5a4409d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.782+0000 7f5a4c4a2700 1 -- 172.21.15.40:0/640331905 >> 172.21.15.40:0/640331905 conn(0x7f5a440a2a00 msgr2=0x7f5a440a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:28.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.782+0000 7f5a4c4a2700 1 -- 172.21.15.40:0/640331905 shutdown_connections 2023-09-30T22:27:28.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.783+0000 7f5a4c4a2700 1 -- 172.21.15.40:0/640331905 wait complete. 2023-09-30T22:27:28.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.784+0000 7f5a4c4a2700 1 Processor -- start 2023-09-30T22:27:28.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.784+0000 7f5a4c4a2700 1 -- start start 2023-09-30T22:27:28.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.784+0000 7f5a4c4a2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a4409d400 0x7f5a441228b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:28.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.784+0000 7f5a4c4a2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a4409dd50 0x7f5a44122df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:28.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.784+0000 7f5a4c4a2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a44138250 0x7f5a44123330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:28.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.784+0000 7f5a4c4a2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a44125480 con 0x7f5a4409dd50 2023-09-30T22:27:28.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.784+0000 7f5a4c4a2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a44136650 con 0x7f5a44138250 2023-09-30T22:27:28.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.784+0000 7f5a4c4a2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4409a300 con 0x7f5a4409d400 2023-09-30T22:27:28.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.785+0000 7f5a4a23e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a4409d400 0x7f5a441228b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:28.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.785+0000 7f5a4a23e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a4409d400 0x7f5a441228b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55542/0 (socket says 172.21.15.40:55542) 2023-09-30T22:27:28.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.785+0000 7f5a4a23e700 1 -- 172.21.15.40:0/1837499708 learned_addr learned my addr 172.21.15.40:0/1837499708 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:28.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.785+0000 7f5a4aa3f700 1 --2- 172.21.15.40:0/1837499708 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a44138250 0x7f5a44123330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:28.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.785+0000 7f5a49a3d700 1 --2- 172.21.15.40:0/1837499708 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a4409dd50 0x7f5a44122df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:28.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.785+0000 7f5a4a23e700 1 -- 172.21.15.40:0/1837499708 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a44138250 msgr2=0x7f5a44123330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:28.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.785+0000 7f5a4a23e700 1 --2- 172.21.15.40:0/1837499708 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a44138250 0x7f5a44123330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.785+0000 7f5a4a23e700 1 -- 172.21.15.40:0/1837499708 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a4409dd50 msgr2=0x7f5a44122df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:28.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.785+0000 7f5a4a23e700 1 --2- 172.21.15.40:0/1837499708 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a4409dd50 0x7f5a44122df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.785+0000 7f5a4a23e700 1 -- 172.21.15.40:0/1837499708 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a40009550 con 0x7f5a4409d400 2023-09-30T22:27:28.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.785+0000 7f5a4a23e700 1 --2- 172.21.15.40:0/1837499708 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a4409d400 0x7f5a441228b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5a44138190 tx=0x7f5a3c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:28.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.785+0000 7f5a3affd700 1 -- 172.21.15.40:0/1837499708 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c012430 con 0x7f5a4409d400 2023-09-30T22:27:28.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.785+0000 7f5a3affd700 1 -- 172.21.15.40:0/1837499708 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3c020070 con 0x7f5a4409d400 2023-09-30T22:27:28.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.785+0000 7f5a3affd700 1 -- 172.21.15.40:0/1837499708 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c004040 con 0x7f5a4409d400 2023-09-30T22:27:28.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.785+0000 7f5a4c4a2700 1 -- 172.21.15.40:0/1837499708 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a3c009a70 con 0x7f5a4409d400 2023-09-30T22:27:28.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.786+0000 7f5a4c4a2700 1 -- 172.21.15.40:0/1837499708 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a44125930 con 0x7f5a4409d400 2023-09-30T22:27:28.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.786+0000 7f5a3affd700 1 -- 172.21.15.40:0/1837499708 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5a3c0041a0 con 0x7f5a4409d400 2023-09-30T22:27:28.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.786+0000 7f5a4c4a2700 1 -- 172.21.15.40:0/1837499708 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a44062380 con 0x7f5a4409d400 2023-09-30T22:27:28.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.787+0000 7f5a3affd700 1 -- 172.21.15.40:0/1837499708 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5a3c022070 con 0x7f5a4409d400 2023-09-30T22:27:28.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.791+0000 7f5a3affd700 1 -- 172.21.15.40:0/1837499708 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5a3c004450 con 0x7f5a4409d400 2023-09-30T22:27:28.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.849+0000 7fcfd3b84700 1 Processor -- start 2023-09-30T22:27:28.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.849+0000 7fcfd3b84700 1 -- start start 2023-09-30T22:27:28.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.849+0000 7fcfd3b84700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfcc131d50 0x7fcfcc132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:28.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.849+0000 7fcfd3b84700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcfcc09bc50 0x7fcfcc09c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:28.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.849+0000 7fcfd3b84700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcfcc09c600 0x7fcfcc138ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:28.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.849+0000 7fcfd3b84700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfcc071920 con 0x7fcfcc09bc50 2023-09-30T22:27:28.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.849+0000 7fcfd3b84700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc132660 con 0x7fcfcc131d50 2023-09-30T22:27:28.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.849+0000 7fcfd3b84700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc131900 con 0x7fcfcc09c600 2023-09-30T22:27:28.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.850+0000 7fcfd1920700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfcc131d50 0x7fcfcc132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:28.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.850+0000 7fcfd1920700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfcc131d50 0x7fcfcc132120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:58314/0 (socket says 172.21.15.40:58314) 2023-09-30T22:27:28.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.850+0000 7fcfd1920700 1 -- 172.21.15.40:0/2436564186 learned_addr learned my addr 172.21.15.40:0/2436564186 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:28.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.850+0000 7fcfd2121700 1 --2- 172.21.15.40:0/2436564186 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcfcc09c600 0x7fcfcc138ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:28.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.850+0000 7fcfd111f700 1 --2- 172.21.15.40:0/2436564186 >> v2:172.21.15.40:3300/0 conn(0x7fcfcc09bc50 0x7fcfcc09c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:28.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.850+0000 7fcfd1920700 1 -- 172.21.15.40:0/2436564186 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcfcc09c600 msgr2=0x7fcfcc138ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:28.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.850+0000 7fcfd1920700 1 --2- 172.21.15.40:0/2436564186 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcfcc09c600 0x7fcfcc138ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.850+0000 7fcfd1920700 1 -- 172.21.15.40:0/2436564186 >> v2:172.21.15.40:3300/0 conn(0x7fcfcc09bc50 msgr2=0x7fcfcc09c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:28.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.850+0000 7fcfd1920700 1 --2- 172.21.15.40:0/2436564186 >> v2:172.21.15.40:3300/0 conn(0x7fcfcc09bc50 0x7fcfcc09c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.850+0000 7fcfd1920700 1 -- 172.21.15.40:0/2436564186 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfcc09e820 con 0x7fcfcc131d50 2023-09-30T22:27:28.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.850+0000 7fcfd1920700 1 --2- 172.21.15.40:0/2436564186 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfcc131d50 0x7fcfcc132120 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fcfc80098f0 tx=0x7fcfc8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51ae4de8ce421abc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:28.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.850+0000 7fcfd091e700 1 -- 172.21.15.40:0/2436564186 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8011830 con 0x7fcfcc131d50 2023-09-30T22:27:28.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.850+0000 7fcfd091e700 1 -- 172.21.15.40:0/2436564186 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc8011990 con 0x7fcfcc131d50 2023-09-30T22:27:28.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.850+0000 7fcfd091e700 1 -- 172.21.15.40:0/2436564186 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8011d20 con 0x7fcfcc131d50 2023-09-30T22:27:28.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.851+0000 7fcfd3b84700 1 -- 172.21.15.40:0/2436564186 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfcc131d50 msgr2=0x7fcfcc132120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:28.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.851+0000 7fcfd3b84700 1 --2- 172.21.15.40:0/2436564186 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfcc131d50 0x7fcfcc132120 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fcfc80098f0 tx=0x7fcfc8009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:28.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.851+0000 7fcfd3b84700 1 -- 172.21.15.40:0/2436564186 shutdown_connections 2023-09-30T22:27:28.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.851+0000 7fcfd3b84700 1 --2- 172.21.15.40:0/2436564186 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcfcc09c600 0x7fcfcc138ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.851+0000 7fcfd3b84700 1 --2- 172.21.15.40:0/2436564186 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfcc131d50 0x7fcfcc132120 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.851+0000 7fcfd3b84700 1 --2- 172.21.15.40:0/2436564186 >> v2:172.21.15.40:3300/0 conn(0x7fcfcc09bc50 0x7fcfcc09c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.851+0000 7fcfd3b84700 1 -- 172.21.15.40:0/2436564186 >> 172.21.15.40:0/2436564186 conn(0x7fcfcc0a2a00 msgr2=0x7fcfcc0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:28.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.851+0000 7fcfd3b84700 1 -- 172.21.15.40:0/2436564186 shutdown_connections 2023-09-30T22:27:28.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.851+0000 7fcfd3b84700 1 -- 172.21.15.40:0/2436564186 wait complete. 2023-09-30T22:27:28.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.852+0000 7fcfd3b84700 1 Processor -- start 2023-09-30T22:27:28.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.852+0000 7fcfd3b84700 1 -- start start 2023-09-30T22:27:28.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.853+0000 7fcfd3b84700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfcc09bc50 0x7fcfcc11bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:28.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.853+0000 7fcfd3b84700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfcc09c600 0x7fcfcc11c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:28.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.853+0000 7fcfd3b84700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcfcc131d50 0x7fcfcc11c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:28.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.853+0000 7fcfd3b84700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc12ca80 con 0x7fcfcc09c600 2023-09-30T22:27:28.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.853+0000 7fcfd3b84700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc11f0a0 con 0x7fcfcc09bc50 2023-09-30T22:27:28.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.853+0000 7fcfd3b84700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc12ecf0 con 0x7fcfcc131d50 2023-09-30T22:27:28.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.853+0000 7fcfd1920700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfcc09bc50 0x7fcfcc11bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:28.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.853+0000 7fcfd1920700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfcc09bc50 0x7fcfcc11bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:58322/0 (socket says 172.21.15.40:58322) 2023-09-30T22:27:28.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.853+0000 7fcfd1920700 1 -- 172.21.15.40:0/3316988009 learned_addr learned my addr 172.21.15.40:0/3316988009 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:28.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.853+0000 7fcfd111f700 1 --2- 172.21.15.40:0/3316988009 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfcc09c600 0x7fcfcc11c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:28.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.853+0000 7fcfd1920700 1 -- 172.21.15.40:0/3316988009 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcfcc131d50 msgr2=0x7fcfcc11c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:28.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.853+0000 7fcfd1920700 1 --2- 172.21.15.40:0/3316988009 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcfcc131d50 0x7fcfcc11c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.853+0000 7fcfd1920700 1 -- 172.21.15.40:0/3316988009 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfcc09c600 msgr2=0x7fcfcc11c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:28.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.853+0000 7fcfd1920700 1 --2- 172.21.15.40:0/3316988009 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfcc09c600 0x7fcfcc11c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.853+0000 7fcfd1920700 1 -- 172.21.15.40:0/3316988009 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc8009550 con 0x7fcfcc09bc50 2023-09-30T22:27:28.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.853+0000 7fcfd111f700 1 --2- 172.21.15.40:0/3316988009 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfcc09c600 0x7fcfcc11c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:28.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.854+0000 7fcfd1920700 1 --2- 172.21.15.40:0/3316988009 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfcc09bc50 0x7fcfcc11bf20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8009c40 tx=0x7fcfc8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:28.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.854+0000 7fcfc27fc700 1 -- 172.21.15.40:0/3316988009 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8004590 con 0x7fcfcc09bc50 2023-09-30T22:27:28.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.854+0000 7fcfc27fc700 1 -- 172.21.15.40:0/3316988009 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc80036a0 con 0x7fcfcc09bc50 2023-09-30T22:27:28.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.854+0000 7fcfc27fc700 1 -- 172.21.15.40:0/3316988009 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8003a50 con 0x7fcfcc09bc50 2023-09-30T22:27:28.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.854+0000 7fcfd3b84700 1 -- 172.21.15.40:0/3316988009 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfcc11f9a0 con 0x7fcfcc09bc50 2023-09-30T22:27:28.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.854+0000 7fcfd3b84700 1 -- 172.21.15.40:0/3316988009 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfcc11f400 con 0x7fcfcc09bc50 2023-09-30T22:27:28.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.855+0000 7fcfd3b84700 1 -- 172.21.15.40:0/3316988009 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfcc062380 con 0x7fcfcc09bc50 2023-09-30T22:27:28.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.855+0000 7fcfc27fc700 1 -- 172.21.15.40:0/3316988009 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcfc8003bb0 con 0x7fcfcc09bc50 2023-09-30T22:27:28.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.855+0000 7fcfc27fc700 1 -- 172.21.15.40:0/3316988009 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fcfc8040800 con 0x7fcfcc09bc50 2023-09-30T22:27:28.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.864+0000 7fcfc27fc700 1 -- 172.21.15.40:0/3316988009 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcfc801a420 con 0x7fcfcc09bc50 2023-09-30T22:27:28.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.909+0000 7fb4048d4700 1 -- 172.21.15.40:0/734651880 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb4001397a0 con 0x7fb40009d920 2023-09-30T22:27:28.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.910+0000 7fb3eeffd700 1 -- 172.21.15.40:0/734651880 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb3f0044030 con 0x7fb40009d920 2023-09-30T22:27:28.910 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:28.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.913+0000 7fb4048d4700 1 -- 172.21.15.40:0/734651880 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb40009d920 msgr2=0x7fb4001c8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:28.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.913+0000 7fb4048d4700 1 --2- 172.21.15.40:0/734651880 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb40009d920 0x7fb4001c8400 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb3f000b520 tx=0x7fb3f000b830 comp rx=0 tx=0).stop 2023-09-30T22:27:28.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.913+0000 7fb4048d4700 1 -- 172.21.15.40:0/734651880 shutdown_connections 2023-09-30T22:27:28.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.913+0000 7fb4048d4700 1 --2- 172.21.15.40:0/734651880 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb40009d920 0x7fb4001c8400 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.913+0000 7fb4048d4700 1 --2- 172.21.15.40:0/734651880 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb400130de0 0x7fb4001c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.913+0000 7fb4048d4700 1 --2- 172.21.15.40:0/734651880 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb40009e230 0x7fb4001c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.913+0000 7fb4048d4700 1 -- 172.21.15.40:0/734651880 >> 172.21.15.40:0/734651880 conn(0x7fb40009fb20 msgr2=0x7fb4000713b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:28.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.913+0000 7fb4048d4700 1 -- 172.21.15.40:0/734651880 shutdown_connections 2023-09-30T22:27:28.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.913+0000 7fb4048d4700 1 -- 172.21.15.40:0/734651880 wait complete. 2023-09-30T22:27:28.931 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:28.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.990+0000 7fa70bf7c700 1 -- 172.21.15.40:0/3516113522 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa70413ba90 con 0x7fa70412f070 2023-09-30T22:27:28.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.991+0000 7fa6fa7fc700 1 -- 172.21.15.40:0/3516113522 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa6f4015020 con 0x7fa70412f070 2023-09-30T22:27:28.991 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:28.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.993+0000 7fa70bf7c700 1 -- 172.21.15.40:0/3516113522 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa70412f070 msgr2=0x7fa704139fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:28.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.993+0000 7fa70bf7c700 1 --2- 172.21.15.40:0/3516113522 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa70412f070 0x7fa704139fe0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4000c00 tx=0x7fa6f4004750 comp rx=0 tx=0).stop 2023-09-30T22:27:28.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.993+0000 7fa70bf7c700 1 -- 172.21.15.40:0/3516113522 shutdown_connections 2023-09-30T22:27:28.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.993+0000 7fa70bf7c700 1 --2- 172.21.15.40:0/3516113522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa704136170 0x7fa70413a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.993+0000 7fa70bf7c700 1 --2- 172.21.15.40:0/3516113522 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa70412e590 0x7fa704139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.993+0000 7fa70bf7c700 1 --2- 172.21.15.40:0/3516113522 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa70412f070 0x7fa704139fe0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.993+0000 7fa70bf7c700 1 -- 172.21.15.40:0/3516113522 >> 172.21.15.40:0/3516113522 conn(0x7fa7040a2a00 msgr2=0x7fa70409d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:28.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.993+0000 7fa70bf7c700 1 -- 172.21.15.40:0/3516113522 shutdown_connections 2023-09-30T22:27:28.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:28.993+0000 7fa70bf7c700 1 -- 172.21.15.40:0/3516113522 wait complete. 2023-09-30T22:27:29.005 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:29.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:29.008+0000 7f5a4c4a2700 1 -- 172.21.15.40:0/1837499708 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5a44074330 con 0x7f5a4409d400 2023-09-30T22:27:29.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:29.008+0000 7f5a3affd700 1 -- 172.21.15.40:0/1837499708 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5a3c02c070 con 0x7f5a4409d400 2023-09-30T22:27:29.008 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:29.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:29.010+0000 7f5a4c4a2700 1 -- 172.21.15.40:0/1837499708 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a4409d400 msgr2=0x7f5a441228b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:29.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:29.010+0000 7f5a4c4a2700 1 --2- 172.21.15.40:0/1837499708 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a4409d400 0x7f5a441228b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5a44138190 tx=0x7f5a3c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:29.010+0000 7f5a4c4a2700 1 -- 172.21.15.40:0/1837499708 shutdown_connections 2023-09-30T22:27:29.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:29.010+0000 7f5a4c4a2700 1 --2- 172.21.15.40:0/1837499708 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a4409d400 0x7f5a441228b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:29.010+0000 7f5a4c4a2700 1 --2- 172.21.15.40:0/1837499708 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a44138250 0x7f5a44123330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:29.010+0000 7f5a4c4a2700 1 --2- 172.21.15.40:0/1837499708 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a4409dd50 0x7f5a44122df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:29.010+0000 7f5a4c4a2700 1 -- 172.21.15.40:0/1837499708 >> 172.21.15.40:0/1837499708 conn(0x7f5a440a2a00 msgr2=0x7f5a441bde30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:29.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:29.010+0000 7f5a4c4a2700 1 -- 172.21.15.40:0/1837499708 shutdown_connections 2023-09-30T22:27:29.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:29.010+0000 7f5a4c4a2700 1 -- 172.21.15.40:0/1837499708 wait complete. 2023-09-30T22:27:29.022 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:29.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:29.062+0000 7fcfd3b84700 1 -- 172.21.15.40:0/3316988009 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcfcc11f780 con 0x7fcfcc09bc50 2023-09-30T22:27:29.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:29.062+0000 7fcfc27fc700 1 -- 172.21.15.40:0/3316988009 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcfc8028020 con 0x7fcfcc09bc50 2023-09-30T22:27:29.062 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:29.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:29.064+0000 7fcfd3b84700 1 -- 172.21.15.40:0/3316988009 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfcc09bc50 msgr2=0x7fcfcc11bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:29.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:29.064+0000 7fcfd3b84700 1 --2- 172.21.15.40:0/3316988009 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfcc09bc50 0x7fcfcc11bf20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8009c40 tx=0x7fcfc8004750 comp rx=0 tx=0).stop 2023-09-30T22:27:29.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:29.064+0000 7fcfd3b84700 1 -- 172.21.15.40:0/3316988009 shutdown_connections 2023-09-30T22:27:29.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:29.064+0000 7fcfd3b84700 1 --2- 172.21.15.40:0/3316988009 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcfcc131d50 0x7fcfcc11c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:29.064+0000 7fcfd3b84700 1 --2- 172.21.15.40:0/3316988009 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfcc09bc50 0x7fcfcc11bf20 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:29.064+0000 7fcfd3b84700 1 --2- 172.21.15.40:0/3316988009 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfcc09c600 0x7fcfcc11c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:29.064+0000 7fcfd3b84700 1 -- 172.21.15.40:0/3316988009 >> 172.21.15.40:0/3316988009 conn(0x7fcfcc0a2a00 msgr2=0x7fcfcc0702a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:29.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:29.064+0000 7fcfd3b84700 1 -- 172.21.15.40:0/3316988009 shutdown_connections 2023-09-30T22:27:29.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:29.064+0000 7fcfd3b84700 1 -- 172.21.15.40:0/3316988009 wait complete. 2023-09-30T22:27:29.076 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:29.933 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:30.006 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:30.022 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:30.077 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:30.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.079+0000 7f6ee2e5e700 1 Processor -- start 2023-09-30T22:27:30.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.080+0000 7f6ee2e5e700 1 -- start start 2023-09-30T22:27:30.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.080+0000 7f6ee2e5e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6edc09c890 0x7f6edc09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:30.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.080+0000 7f6ee2e5e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6edc09d920 0x7f6edc09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:30.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.080+0000 7f6ee2e5e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6edc0a2600 con 0x7f6edc09e2b0 2023-09-30T22:27:30.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.080+0000 7f6ee2e5e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6edc0a29d0 con 0x7f6edc09c890 2023-09-30T22:27:30.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.080+0000 7f6ee2e5e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc09fb40 con 0x7f6edc09d920 2023-09-30T22:27:30.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.080+0000 7f6edbfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6edc09d920 0x7f6edc09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:30.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.080+0000 7f6edbfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6edc09d920 0x7f6edc09dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55564/0 (socket says 172.21.15.40:55564) 2023-09-30T22:27:30.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.080+0000 7f6edbfff700 1 -- 172.21.15.40:0/276719199 learned_addr learned my addr 172.21.15.40:0/276719199 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:30.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.080+0000 7f6ee0bfa700 1 --2- 172.21.15.40:0/276719199 >> v2:172.21.15.40:3300/0 conn(0x7f6edc09c890 0x7f6edc09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:30.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.081+0000 7f6ee0bfa700 1 -- 172.21.15.40:0/276719199 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6edc09d920 msgr2=0x7f6edc09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:30.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.081+0000 7f6ee0bfa700 1 --2- 172.21.15.40:0/276719199 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6edc09d920 0x7f6edc09dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.081+0000 7f6ee0bfa700 1 -- 172.21.15.40:0/276719199 >> v1:172.21.15.40:6789/0 conn(0x7f6edc09e2b0 legacy=0x7f6edc13ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:30.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.081+0000 7f6ee0bfa700 1 -- 172.21.15.40:0/276719199 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6edc09e730 con 0x7f6edc09c890 2023-09-30T22:27:30.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.081+0000 7f6ee0bfa700 1 --2- 172.21.15.40:0/276719199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6edc09c890 0x7f6edc09cc60 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0009820 tx=0x7f6ed0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e5eb7737f42ebc1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:30.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.081+0000 7f6edb7fe700 1 -- 172.21.15.40:0/276719199 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0005e30 con 0x7f6edc09c890 2023-09-30T22:27:30.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.081+0000 7f6edb7fe700 1 -- 172.21.15.40:0/276719199 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed0006030 con 0x7f6edc09c890 2023-09-30T22:27:30.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.081+0000 7f6edb7fe700 1 -- 172.21.15.40:0/276719199 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed00063c0 con 0x7f6edc09c890 2023-09-30T22:27:30.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.082+0000 7f6ee2e5e700 1 -- 172.21.15.40:0/276719199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6edc09c890 msgr2=0x7f6edc09cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:30.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.082+0000 7f6ee2e5e700 1 --2- 172.21.15.40:0/276719199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6edc09c890 0x7f6edc09cc60 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0009820 tx=0x7f6ed0009b30 comp rx=0 tx=0).stop 2023-09-30T22:27:30.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.082+0000 7f6ee2e5e700 1 -- 172.21.15.40:0/276719199 shutdown_connections 2023-09-30T22:27:30.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.082+0000 7f6ee2e5e700 1 --2- 172.21.15.40:0/276719199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6edc09c890 0x7f6edc09cc60 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.082+0000 7f6ee2e5e700 1 --2- 172.21.15.40:0/276719199 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6edc09d920 0x7f6edc09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.082+0000 7f6ee2e5e700 1 -- 172.21.15.40:0/276719199 >> 172.21.15.40:0/276719199 conn(0x7f6edc0a7080 msgr2=0x7f6edc0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:30.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.082+0000 7f6ee2e5e700 1 -- 172.21.15.40:0/276719199 shutdown_connections 2023-09-30T22:27:30.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.082+0000 7f6ee2e5e700 1 -- 172.21.15.40:0/276719199 wait complete. 2023-09-30T22:27:30.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.084+0000 7f6ee2e5e700 1 Processor -- start 2023-09-30T22:27:30.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.084+0000 7f6ee2e5e700 1 -- start start 2023-09-30T22:27:30.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.085+0000 7f6ee2e5e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6edc09c890 0x7f6edc1c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:30.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.085+0000 7f6ee2e5e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6edc09d920 0x7f6edc1c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:30.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.085+0000 7f6ee2e5e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6edc09e2b0 0x7f6edc12d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:30.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.085+0000 7f6ee2e5e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc12f420 con 0x7f6edc09d920 2023-09-30T22:27:30.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.085+0000 7f6ee2e5e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc09baf0 con 0x7f6edc09e2b0 2023-09-30T22:27:30.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.085+0000 7f6ee2e5e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc09ecf0 con 0x7f6edc09c890 2023-09-30T22:27:30.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.085+0000 7f6edbfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6edc09d920 0x7f6edc1c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:30.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.085+0000 7f6edbfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6edc09d920 0x7f6edc1c9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59890/0 (socket says 172.21.15.40:59890) 2023-09-30T22:27:30.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.085+0000 7f6edbfff700 1 -- 172.21.15.40:0/4164984424 learned_addr learned my addr 172.21.15.40:0/4164984424 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:30.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.085+0000 7f6ee13fb700 1 --2- 172.21.15.40:0/4164984424 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6edc09e2b0 0x7f6edc12d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:30.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.085+0000 7f6ee13fb700 1 -- 172.21.15.40:0/4164984424 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6edc09c890 msgr2=0x7f6edc1c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:30.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.085+0000 7f6ee13fb700 1 --2- 172.21.15.40:0/4164984424 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6edc09c890 0x7f6edc1c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.085+0000 7f6ee13fb700 1 -- 172.21.15.40:0/4164984424 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6edc09d920 msgr2=0x7f6edc1c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:30.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.085+0000 7f6ee13fb700 1 --2- 172.21.15.40:0/4164984424 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6edc09d920 0x7f6edc1c9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.085+0000 7f6ee13fb700 1 -- 172.21.15.40:0/4164984424 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed0009430 con 0x7f6edc09e2b0 2023-09-30T22:27:30.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.085+0000 7f6edbfff700 1 --2- 172.21.15.40:0/4164984424 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6edc09d920 0x7f6edc1c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:30.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.085+0000 7f6ee13fb700 1 --2- 172.21.15.40:0/4164984424 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6edc09e2b0 0x7f6edc12d500 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6ed400cb90 tx=0x7f6ed400cea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:30.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.086+0000 7f6ed97fa700 1 -- 172.21.15.40:0/4164984424 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed4003c00 con 0x7f6edc09e2b0 2023-09-30T22:27:30.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.086+0000 7f6ed97fa700 1 -- 172.21.15.40:0/4164984424 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed4003d60 con 0x7f6edc09e2b0 2023-09-30T22:27:30.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.086+0000 7f6ee2e5e700 1 -- 172.21.15.40:0/4164984424 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6edc130840 con 0x7f6edc09e2b0 2023-09-30T22:27:30.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.086+0000 7f6ee2e5e700 1 -- 172.21.15.40:0/4164984424 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6edc08f3e0 con 0x7f6edc09e2b0 2023-09-30T22:27:30.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.087+0000 7f6ed97fa700 1 -- 172.21.15.40:0/4164984424 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed400aaa0 con 0x7f6edc09e2b0 2023-09-30T22:27:30.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.087+0000 7f6ed97fa700 1 -- 172.21.15.40:0/4164984424 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6ed400ac40 con 0x7f6edc09e2b0 2023-09-30T22:27:30.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.088+0000 7f6ed97fa700 1 -- 172.21.15.40:0/4164984424 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6ed403f820 con 0x7f6edc09e2b0 2023-09-30T22:27:30.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.088+0000 7f6ee2e5e700 1 -- 172.21.15.40:0/4164984424 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6edc062380 con 0x7f6edc09e2b0 2023-09-30T22:27:30.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.095+0000 7f6ed97fa700 1 -- 172.21.15.40:0/4164984424 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6ed40050d0 con 0x7f6edc09e2b0 2023-09-30T22:27:30.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.158+0000 7f68679f8700 1 Processor -- start 2023-09-30T22:27:30.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.159+0000 7f68679f8700 1 -- start start 2023-09-30T22:27:30.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.159+0000 7f68679f8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f686006f070 0x7f686006f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:30.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.159+0000 7f68679f8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f686006fdb0 0x7f68600977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:30.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.159+0000 7f68679f8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6860070830 con 0x7f686006f980 2023-09-30T22:27:30.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.159+0000 7f68679f8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6860070ad0 con 0x7f686006fdb0 2023-09-30T22:27:30.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.159+0000 7f68679f8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6860070de0 con 0x7f686006f070 2023-09-30T22:27:30.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.159+0000 7f6865794700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f686006f070 0x7f686006f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:30.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.159+0000 7f6865794700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f686006f070 0x7f686006f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55584/0 (socket says 172.21.15.40:55584) 2023-09-30T22:27:30.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.159+0000 7f6865794700 1 -- 172.21.15.40:0/2839897112 learned_addr learned my addr 172.21.15.40:0/2839897112 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:30.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.160+0000 7f6865f95700 1 --2- 172.21.15.40:0/2839897112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f686006fdb0 0x7f68600977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:30.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.160+0000 7f6865794700 1 -- 172.21.15.40:0/2839897112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f686006fdb0 msgr2=0x7f68600977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:30.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.160+0000 7f6865794700 1 --2- 172.21.15.40:0/2839897112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f686006fdb0 0x7f68600977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.160+0000 7f6865794700 1 -- 172.21.15.40:0/2839897112 >> v1:172.21.15.40:6789/0 conn(0x7f686006f980 legacy=0x7f6860097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:30.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.160+0000 7f6865794700 1 -- 172.21.15.40:0/2839897112 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f686009fe20 con 0x7f686006f070 2023-09-30T22:27:30.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.160+0000 7f6865794700 1 --2- 172.21.15.40:0/2839897112 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f686006f070 0x7f686006f440 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f685c009920 tx=0x7f685c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28e4a958d4c1ea53 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:30.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.160+0000 7f6857fff700 1 -- 172.21.15.40:0/2839897112 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c004230 con 0x7f686006f070 2023-09-30T22:27:30.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.160+0000 7f6857fff700 1 -- 172.21.15.40:0/2839897112 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685c004390 con 0x7f686006f070 2023-09-30T22:27:30.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.160+0000 7f6857fff700 1 -- 172.21.15.40:0/2839897112 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c009e70 con 0x7f686006f070 2023-09-30T22:27:30.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.161+0000 7f68679f8700 1 -- 172.21.15.40:0/2839897112 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f686006f070 msgr2=0x7f686006f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:30.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.161+0000 7f68679f8700 1 --2- 172.21.15.40:0/2839897112 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f686006f070 0x7f686006f440 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f685c009920 tx=0x7f685c009c30 comp rx=0 tx=0).stop 2023-09-30T22:27:30.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.161+0000 7f68679f8700 1 -- 172.21.15.40:0/2839897112 shutdown_connections 2023-09-30T22:27:30.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.161+0000 7f68679f8700 1 --2- 172.21.15.40:0/2839897112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f686006fdb0 0x7f68600977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.161+0000 7f68679f8700 1 --2- 172.21.15.40:0/2839897112 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f686006f070 0x7f686006f440 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.161+0000 7f68679f8700 1 -- 172.21.15.40:0/2839897112 >> 172.21.15.40:0/2839897112 conn(0x7f68600a41a0 msgr2=0x7f68600a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:30.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.161+0000 7f68679f8700 1 -- 172.21.15.40:0/2839897112 shutdown_connections 2023-09-30T22:27:30.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.161+0000 7f68679f8700 1 -- 172.21.15.40:0/2839897112 wait complete. 2023-09-30T22:27:30.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.162+0000 7f68679f8700 1 Processor -- start 2023-09-30T22:27:30.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.162+0000 7f68679f8700 1 -- start start 2023-09-30T22:27:30.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.163+0000 7f68679f8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f686006f070 0x7f686006c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:30.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.163+0000 7f68679f8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f686006f980 0x7f686006ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:30.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.163+0000 7f68679f8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f686006fdb0 0x7f686006d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:30.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.163+0000 7f68679f8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68601322a0 con 0x7f686006fdb0 2023-09-30T22:27:30.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.163+0000 7f68679f8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68601320b0 con 0x7f686006f980 2023-09-30T22:27:30.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.163+0000 7f68679f8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f686006dc90 con 0x7f686006f070 2023-09-30T22:27:30.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.163+0000 7f6865f95700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f686006fdb0 0x7f686006d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:30.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.163+0000 7f6865f95700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f686006fdb0 0x7f686006d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59900/0 (socket says 172.21.15.40:59900) 2023-09-30T22:27:30.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.163+0000 7f6865f95700 1 -- 172.21.15.40:0/4250781823 learned_addr learned my addr 172.21.15.40:0/4250781823 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:30.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.163+0000 7f6864f93700 1 --2- 172.21.15.40:0/4250781823 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f686006f980 0x7f686006ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:30.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.163+0000 7f6865794700 1 --2- 172.21.15.40:0/4250781823 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f686006f070 0x7f686006c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:30.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.163+0000 7f6865f95700 1 -- 172.21.15.40:0/4250781823 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f686006f070 msgr2=0x7f686006c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:30.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.163+0000 7f6865f95700 1 --2- 172.21.15.40:0/4250781823 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f686006f070 0x7f686006c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.163+0000 7f6865f95700 1 -- 172.21.15.40:0/4250781823 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f686006f980 msgr2=0x7f686006ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:30.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.163+0000 7f6865f95700 1 --2- 172.21.15.40:0/4250781823 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f686006f980 0x7f686006ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.163+0000 7f6865f95700 1 -- 172.21.15.40:0/4250781823 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f685c009550 con 0x7f686006fdb0 2023-09-30T22:27:30.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.163+0000 7f6865794700 1 --2- 172.21.15.40:0/4250781823 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f686006f070 0x7f686006c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:27:30.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.163+0000 7f6865f95700 1 --2- 172.21.15.40:0/4250781823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f686006fdb0 0x7f686006d410 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f6858007e70 tx=0x7f685800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:30.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.164+0000 7f6855ffb700 1 -- 172.21.15.40:0/4250781823 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685800ede0 con 0x7f686006fdb0 2023-09-30T22:27:30.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.164+0000 7f6855ffb700 1 -- 172.21.15.40:0/4250781823 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6858014420 con 0x7f686006fdb0 2023-09-30T22:27:30.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.164+0000 7f68679f8700 1 -- 172.21.15.40:0/4250781823 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f686012c2d0 con 0x7f686006fdb0 2023-09-30T22:27:30.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.164+0000 7f68679f8700 1 -- 172.21.15.40:0/4250781823 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6860131770 con 0x7f686006fdb0 2023-09-30T22:27:30.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.164+0000 7f6855ffb700 1 -- 172.21.15.40:0/4250781823 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68580147d0 con 0x7f686006fdb0 2023-09-30T22:27:30.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.165+0000 7f6855ffb700 1 -- 172.21.15.40:0/4250781823 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6858014930 con 0x7f686006fdb0 2023-09-30T22:27:30.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.165+0000 7f6855ffb700 1 -- 172.21.15.40:0/4250781823 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f685803ff50 con 0x7f686006fdb0 2023-09-30T22:27:30.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.166+0000 7f68679f8700 1 -- 172.21.15.40:0/4250781823 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68400052e0 con 0x7f686006fdb0 2023-09-30T22:27:30.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.171+0000 7f6855ffb700 1 -- 172.21.15.40:0/4250781823 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f685801bce0 con 0x7f686006fdb0 2023-09-30T22:27:30.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.187+0000 7fb1c7df2700 1 Processor -- start 2023-09-30T22:27:30.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.187+0000 7fb1c7df2700 1 -- start start 2023-09-30T22:27:30.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.188+0000 7fb1c7df2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1c0133e00 0x7fb1c01341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:30.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.188+0000 7fb1c7df2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb1c009df40 0x7fb1c013bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:30.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.188+0000 7fb1c7df2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c0133940 con 0x7fb1c009d400 2023-09-30T22:27:30.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.188+0000 7fb1c7df2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1c009f0d0 con 0x7fb1c009df40 2023-09-30T22:27:30.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.188+0000 7fb1c7df2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c0133be0 con 0x7fb1c0133e00 2023-09-30T22:27:30.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.188+0000 7fb1c5b8e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1c0133e00 0x7fb1c01341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:30.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.188+0000 7fb1c638f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb1c009df40 0x7fb1c013bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:30.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.188+0000 7fb1c5b8e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1c0133e00 0x7fb1c01341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:58350/0 (socket says 172.21.15.40:58350) 2023-09-30T22:27:30.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.188+0000 7fb1c638f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb1c009df40 0x7fb1c013bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59904/0 (socket says 172.21.15.40:59904) 2023-09-30T22:27:30.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.188+0000 7fb1c5b8e700 1 -- 172.21.15.40:0/3440283023 learned_addr learned my addr 172.21.15.40:0/3440283023 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:30.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.188+0000 7fb1c4b8c700 1 -- 172.21.15.40:0/3440283023 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1585689158 0 0) 0x7fb1c0133940 con 0x7fb1c009d400 2023-09-30T22:27:30.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.188+0000 7fb1c4b8c700 1 -- 172.21.15.40:0/3440283023 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1ac0035b0 con 0x7fb1c009d400 2023-09-30T22:27:30.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.188+0000 7fb1c5b8e700 1 -- 172.21.15.40:0/3440283023 >> v2:172.21.15.40:3300/0 conn(0x7fb1c009df40 msgr2=0x7fb1c013bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:30.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.188+0000 7fb1c5b8e700 1 --2- 172.21.15.40:0/3440283023 >> v2:172.21.15.40:3300/0 conn(0x7fb1c009df40 0x7fb1c013bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.189+0000 7fb1c5b8e700 1 -- 172.21.15.40:0/3440283023 >> v1:172.21.15.40:6789/0 conn(0x7fb1c009d400 legacy=0x7fb1c009d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:30.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.189+0000 7fb1c5b8e700 1 -- 172.21.15.40:0/3440283023 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c009a860 con 0x7fb1c0133e00 2023-09-30T22:27:30.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.189+0000 7fb1c638f700 1 --2- 172.21.15.40:0/3440283023 >> v2:172.21.15.40:3300/0 conn(0x7fb1c009df40 0x7fb1c013bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:30.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.189+0000 7fb1c5b8e700 1 --2- 172.21.15.40:0/3440283023 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1c0133e00 0x7fb1c01341d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc0098f0 tx=0x7fb1bc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f782a3636562f548 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:30.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.189+0000 7fb1c4b8c700 1 -- 172.21.15.40:0/3440283023 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc011830 con 0x7fb1c0133e00 2023-09-30T22:27:30.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.189+0000 7fb1c4b8c700 1 -- 172.21.15.40:0/3440283023 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1bc011990 con 0x7fb1c0133e00 2023-09-30T22:27:30.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.189+0000 7fb1c4b8c700 1 -- 172.21.15.40:0/3440283023 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc011d20 con 0x7fb1c0133e00 2023-09-30T22:27:30.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.190+0000 7fb1c7df2700 1 -- 172.21.15.40:0/3440283023 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1c0133e00 msgr2=0x7fb1c01341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:30.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.190+0000 7fb1c7df2700 1 --2- 172.21.15.40:0/3440283023 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1c0133e00 0x7fb1c01341d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc0098f0 tx=0x7fb1bc009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:30.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.190+0000 7fb1c7df2700 1 -- 172.21.15.40:0/3440283023 shutdown_connections 2023-09-30T22:27:30.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.190+0000 7fb1c7df2700 1 --2- 172.21.15.40:0/3440283023 >> v2:172.21.15.40:3300/0 conn(0x7fb1c009df40 0x7fb1c013bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.190+0000 7fb1c7df2700 1 --2- 172.21.15.40:0/3440283023 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1c0133e00 0x7fb1c01341d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.190+0000 7fb1c7df2700 1 -- 172.21.15.40:0/3440283023 >> 172.21.15.40:0/3440283023 conn(0x7fb1c00a2a00 msgr2=0x7fb1c00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:30.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.190+0000 7fb1c7df2700 1 -- 172.21.15.40:0/3440283023 shutdown_connections 2023-09-30T22:27:30.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.190+0000 7fb1c7df2700 1 -- 172.21.15.40:0/3440283023 wait complete. 2023-09-30T22:27:30.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.191+0000 7fb1c7df2700 1 Processor -- start 2023-09-30T22:27:30.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.191+0000 7fb1c7df2700 1 -- start start 2023-09-30T22:27:30.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.191+0000 7fb1c7df2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1c009d400 0x7fb1c012de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:30.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.191+0000 7fb1c7df2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1c009df40 0x7fb1c011a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:30.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.191+0000 7fb1c7df2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb1c0133e00 0x7fb1c011ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:30.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.191+0000 7fb1c7df2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c011dd50 con 0x7fb1c009d400 2023-09-30T22:27:30.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.191+0000 7fb1c7df2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c011c560 con 0x7fb1c009df40 2023-09-30T22:27:30.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.191+0000 7fb1c7df2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c009ff00 con 0x7fb1c0133e00 2023-09-30T22:27:30.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.191+0000 7fb1c5b8e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1c009d400 0x7fb1c012de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:30.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.191+0000 7fb1c5b8e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1c009d400 0x7fb1c012de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59914/0 (socket says 172.21.15.40:59914) 2023-09-30T22:27:30.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.191+0000 7fb1c5b8e700 1 -- 172.21.15.40:0/2336865219 learned_addr learned my addr 172.21.15.40:0/2336865219 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:30.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.192+0000 7fb1c638f700 1 --2- 172.21.15.40:0/2336865219 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb1c0133e00 0x7fb1c011ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:30.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.192+0000 7fb1c538d700 1 --2- 172.21.15.40:0/2336865219 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1c009df40 0x7fb1c011a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:30.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.192+0000 7fb1c5b8e700 1 -- 172.21.15.40:0/2336865219 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb1c0133e00 msgr2=0x7fb1c011ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:30.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.192+0000 7fb1c5b8e700 1 --2- 172.21.15.40:0/2336865219 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb1c0133e00 0x7fb1c011ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.192+0000 7fb1c5b8e700 1 -- 172.21.15.40:0/2336865219 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1c009df40 msgr2=0x7fb1c011a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:30.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.192+0000 7fb1c5b8e700 1 --2- 172.21.15.40:0/2336865219 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1c009df40 0x7fb1c011a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.192+0000 7fb1c5b8e700 1 -- 172.21.15.40:0/2336865219 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1bc009550 con 0x7fb1c009d400 2023-09-30T22:27:30.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.192+0000 7fb1c5b8e700 1 --2- 172.21.15.40:0/2336865219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1c009d400 0x7fb1c012de60 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc000c00 tx=0x7fb1bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:30.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.192+0000 7fb1b67fc700 1 -- 172.21.15.40:0/2336865219 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc0036a0 con 0x7fb1c009d400 2023-09-30T22:27:30.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.192+0000 7fb1c7df2700 1 -- 172.21.15.40:0/2336865219 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c011e2f0 con 0x7fb1c009d400 2023-09-30T22:27:30.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.192+0000 7fb1c7df2700 1 -- 172.21.15.40:0/2336865219 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c011ea80 con 0x7fb1c009d400 2023-09-30T22:27:30.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.192+0000 7fb1b67fc700 1 -- 172.21.15.40:0/2336865219 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1bc003800 con 0x7fb1c009d400 2023-09-30T22:27:30.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.192+0000 7fb1b67fc700 1 -- 172.21.15.40:0/2336865219 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc003bb0 con 0x7fb1c009d400 2023-09-30T22:27:30.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.193+0000 7fb1b67fc700 1 -- 172.21.15.40:0/2336865219 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb1bc021070 con 0x7fb1c009d400 2023-09-30T22:27:30.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.193+0000 7fb1c7df2700 1 -- 172.21.15.40:0/2336865219 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1a80052e0 con 0x7fb1c009d400 2023-09-30T22:27:30.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.194+0000 7fb1b67fc700 1 -- 172.21.15.40:0/2336865219 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb1bc040ac0 con 0x7fb1c009d400 2023-09-30T22:27:30.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.203+0000 7fb1b67fc700 1 -- 172.21.15.40:0/2336865219 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb1bc00b3e0 con 0x7fb1c009d400 2023-09-30T22:27:30.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.215+0000 7f50c70e4700 1 Processor -- start 2023-09-30T22:27:30.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.215+0000 7f50c70e4700 1 -- start start 2023-09-30T22:27:30.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.216+0000 7f50c70e4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f50c009fcb0 0x7f50c00a0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:30.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.216+0000 7f50c70e4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50c00a05c0 0x7f50c013fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:30.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.216+0000 7f50c70e4700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50c006d1f0 con 0x7f50c0071e20 2023-09-30T22:27:30.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.216+0000 7f50c70e4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c006ea00 con 0x7f50c00a05c0 2023-09-30T22:27:30.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.216+0000 7f50c70e4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50c006f320 con 0x7f50c009fcb0 2023-09-30T22:27:30.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.217+0000 7f50c5681700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50c00a05c0 0x7f50c013fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:30.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.217+0000 7f50c5681700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50c00a05c0 0x7f50c013fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:58362/0 (socket says 172.21.15.40:58362) 2023-09-30T22:27:30.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.217+0000 7f50c5681700 1 -- 172.21.15.40:0/2472242398 learned_addr learned my addr 172.21.15.40:0/2472242398 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:30.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.217+0000 7f50c4e80700 1 --2- 172.21.15.40:0/2472242398 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f50c009fcb0 0x7f50c00a0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:30.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.217+0000 7f50c4e80700 1 -- 172.21.15.40:0/2472242398 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50c00a05c0 msgr2=0x7f50c013fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:30.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.217+0000 7f50c4e80700 1 --2- 172.21.15.40:0/2472242398 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50c00a05c0 0x7f50c013fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.217+0000 7f50c4e80700 1 -- 172.21.15.40:0/2472242398 >> v1:172.21.15.40:6789/0 conn(0x7f50c0071e20 legacy=0x7f50c013c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:30.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.217+0000 7f50c4e80700 1 -- 172.21.15.40:0/2472242398 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c006cff0 con 0x7f50c009fcb0 2023-09-30T22:27:30.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.217+0000 7f50c5681700 1 --2- 172.21.15.40:0/2472242398 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50c00a05c0 0x7f50c013fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:30.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.217+0000 7f50c4e80700 1 --2- 172.21.15.40:0/2472242398 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f50c009fcb0 0x7f50c00a0080 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f50b4009870 tx=0x7f50b4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2079e21bc1f0130f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:30.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.217+0000 7f50bf7fe700 1 -- 172.21.15.40:0/2472242398 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b4004230 con 0x7f50c009fcb0 2023-09-30T22:27:30.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.217+0000 7f50bf7fe700 1 -- 172.21.15.40:0/2472242398 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b4004390 con 0x7f50c009fcb0 2023-09-30T22:27:30.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.217+0000 7f50bf7fe700 1 -- 172.21.15.40:0/2472242398 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b40036a0 con 0x7f50c009fcb0 2023-09-30T22:27:30.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.218+0000 7f50c70e4700 1 -- 172.21.15.40:0/2472242398 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f50c009fcb0 msgr2=0x7f50c00a0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:30.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.218+0000 7f50c70e4700 1 --2- 172.21.15.40:0/2472242398 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f50c009fcb0 0x7f50c00a0080 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f50b4009870 tx=0x7f50b4009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:30.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.218+0000 7f50c70e4700 1 -- 172.21.15.40:0/2472242398 shutdown_connections 2023-09-30T22:27:30.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.218+0000 7f50c70e4700 1 --2- 172.21.15.40:0/2472242398 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50c00a05c0 0x7f50c013fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.218+0000 7f50c70e4700 1 --2- 172.21.15.40:0/2472242398 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f50c009fcb0 0x7f50c00a0080 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.218+0000 7f50c70e4700 1 -- 172.21.15.40:0/2472242398 >> 172.21.15.40:0/2472242398 conn(0x7f50c00a0da0 msgr2=0x7f50c00a11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:30.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.218+0000 7f50c70e4700 1 -- 172.21.15.40:0/2472242398 shutdown_connections 2023-09-30T22:27:30.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.218+0000 7f50c70e4700 1 -- 172.21.15.40:0/2472242398 wait complete. 2023-09-30T22:27:30.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.219+0000 7f50c70e4700 1 Processor -- start 2023-09-30T22:27:30.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.219+0000 7f50c70e4700 1 -- start start 2023-09-30T22:27:30.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.220+0000 7f50c70e4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50c0071e20 0x7f50c008afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:30.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.220+0000 7f50c70e4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f50c009fcb0 0x7f50c008b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:30.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.220+0000 7f50c70e4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50c00a05c0 0x7f50c008ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:30.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.220+0000 7f50c70e4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c006f860 con 0x7f50c00a05c0 2023-09-30T22:27:30.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.220+0000 7f50c70e4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c006dd50 con 0x7f50c0071e20 2023-09-30T22:27:30.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.220+0000 7f50c70e4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50c008c4c0 con 0x7f50c009fcb0 2023-09-30T22:27:30.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.220+0000 7f50c4e80700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50c0071e20 0x7f50c008afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:30.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.220+0000 7f50c4e80700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50c0071e20 0x7f50c008afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:58374/0 (socket says 172.21.15.40:58374) 2023-09-30T22:27:30.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.220+0000 7f50c4e80700 1 -- 172.21.15.40:0/2986074970 learned_addr learned my addr 172.21.15.40:0/2986074970 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:30.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.220+0000 7f50c5681700 1 --2- 172.21.15.40:0/2986074970 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50c00a05c0 0x7f50c008ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:30.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.220+0000 7f50bffff700 1 --2- 172.21.15.40:0/2986074970 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f50c009fcb0 0x7f50c008b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:30.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.221+0000 7f50c4e80700 1 -- 172.21.15.40:0/2986074970 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f50c009fcb0 msgr2=0x7f50c008b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:30.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.221+0000 7f50c4e80700 1 --2- 172.21.15.40:0/2986074970 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f50c009fcb0 0x7f50c008b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.221+0000 7f50c4e80700 1 -- 172.21.15.40:0/2986074970 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50c00a05c0 msgr2=0x7f50c008ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:30.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.221+0000 7f50c4e80700 1 --2- 172.21.15.40:0/2986074970 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50c00a05c0 0x7f50c008ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.221+0000 7f50c4e80700 1 -- 172.21.15.40:0/2986074970 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b8009b30 con 0x7f50c0071e20 2023-09-30T22:27:30.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.221+0000 7f50c5681700 1 --2- 172.21.15.40:0/2986074970 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50c00a05c0 0x7f50c008ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:30.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.221+0000 7f50c4e80700 1 --2- 172.21.15.40:0/2986074970 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50c0071e20 0x7f50c008afd0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f50b4009840 tx=0x7f50b4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:30.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.221+0000 7f50bd7fa700 1 -- 172.21.15.40:0/2986074970 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b4003d70 con 0x7f50c0071e20 2023-09-30T22:27:30.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.221+0000 7f50bd7fa700 1 -- 172.21.15.40:0/2986074970 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b401e070 con 0x7f50c0071e20 2023-09-30T22:27:30.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.221+0000 7f50bd7fa700 1 -- 172.21.15.40:0/2986074970 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b4011870 con 0x7f50c0071e20 2023-09-30T22:27:30.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.222+0000 7f50c70e4700 1 -- 172.21.15.40:0/2986074970 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50b40094a0 con 0x7f50c0071e20 2023-09-30T22:27:30.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.222+0000 7f50c70e4700 1 -- 172.21.15.40:0/2986074970 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c008d890 con 0x7f50c0071e20 2023-09-30T22:27:30.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.223+0000 7f50c70e4700 1 -- 172.21.15.40:0/2986074970 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c0062380 con 0x7f50c0071e20 2023-09-30T22:27:30.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.223+0000 7f50bd7fa700 1 -- 172.21.15.40:0/2986074970 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f50b40119d0 con 0x7f50c0071e20 2023-09-30T22:27:30.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.227+0000 7f50bd7fa700 1 -- 172.21.15.40:0/2986074970 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f50b4020070 con 0x7f50c0071e20 2023-09-30T22:27:30.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.232+0000 7f50bd7fa700 1 -- 172.21.15.40:0/2986074970 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f50b4006bd0 con 0x7f50c0071e20 2023-09-30T22:27:30.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.323+0000 7f6ee2e5e700 1 -- 172.21.15.40:0/4164984424 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6edc1309d0 con 0x7f6edc09e2b0 2023-09-30T22:27:30.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.323+0000 7f6ed97fa700 1 -- 172.21.15.40:0/4164984424 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6ed4011380 con 0x7f6edc09e2b0 2023-09-30T22:27:30.323 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:30.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.325+0000 7f6ee2e5e700 1 -- 172.21.15.40:0/4164984424 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6edc09e2b0 msgr2=0x7f6edc12d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:30.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.325+0000 7f6ee2e5e700 1 --2- 172.21.15.40:0/4164984424 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6edc09e2b0 0x7f6edc12d500 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6ed400cb90 tx=0x7f6ed400cea0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.325+0000 7f6ee2e5e700 1 -- 172.21.15.40:0/4164984424 shutdown_connections 2023-09-30T22:27:30.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.325+0000 7f6ee2e5e700 1 --2- 172.21.15.40:0/4164984424 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6edc09c890 0x7f6edc1c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.325+0000 7f6ee2e5e700 1 --2- 172.21.15.40:0/4164984424 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6edc09e2b0 0x7f6edc12d500 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.325+0000 7f6ee2e5e700 1 --2- 172.21.15.40:0/4164984424 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6edc09d920 0x7f6edc1c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.325+0000 7f6ee2e5e700 1 -- 172.21.15.40:0/4164984424 >> 172.21.15.40:0/4164984424 conn(0x7f6edc0a7080 msgr2=0x7f6edc0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:30.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.325+0000 7f6ee2e5e700 1 -- 172.21.15.40:0/4164984424 shutdown_connections 2023-09-30T22:27:30.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.325+0000 7f6ee2e5e700 1 -- 172.21.15.40:0/4164984424 wait complete. 2023-09-30T22:27:30.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:30.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.376+0000 7f68679f8700 1 -- 172.21.15.40:0/4250781823 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6840005590 con 0x7f686006fdb0 2023-09-30T22:27:30.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.376+0000 7f6855ffb700 1 -- 172.21.15.40:0/4250781823 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f685801bb00 con 0x7f686006fdb0 2023-09-30T22:27:30.376 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:30.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.378+0000 7f68679f8700 1 -- 172.21.15.40:0/4250781823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f686006fdb0 msgr2=0x7f686006d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:30.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.378+0000 7f68679f8700 1 --2- 172.21.15.40:0/4250781823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f686006fdb0 0x7f686006d410 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f6858007e70 tx=0x7f685800e3c0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.378+0000 7f68679f8700 1 -- 172.21.15.40:0/4250781823 shutdown_connections 2023-09-30T22:27:30.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.378+0000 7f68679f8700 1 --2- 172.21.15.40:0/4250781823 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f686006f070 0x7f686006c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.378+0000 7f68679f8700 1 --2- 172.21.15.40:0/4250781823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f686006fdb0 0x7f686006d410 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.378+0000 7f68679f8700 1 --2- 172.21.15.40:0/4250781823 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f686006f980 0x7f686006ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.378+0000 7f68679f8700 1 -- 172.21.15.40:0/4250781823 >> 172.21.15.40:0/4250781823 conn(0x7f68600a41a0 msgr2=0x7f68600975c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:30.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.378+0000 7f68679f8700 1 -- 172.21.15.40:0/4250781823 shutdown_connections 2023-09-30T22:27:30.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.378+0000 7f68679f8700 1 -- 172.21.15.40:0/4250781823 wait complete. 2023-09-30T22:27:30.390 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:30.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.402+0000 7fb1c7df2700 1 -- 172.21.15.40:0/2336865219 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb1a8005590 con 0x7fb1c009d400 2023-09-30T22:27:30.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.402+0000 7fb1b67fc700 1 -- 172.21.15.40:0/2336865219 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb1bc015020 con 0x7fb1c009d400 2023-09-30T22:27:30.402 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:30.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.404+0000 7fb1c7df2700 1 -- 172.21.15.40:0/2336865219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1c009d400 msgr2=0x7fb1c012de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:30.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.404+0000 7fb1c7df2700 1 --2- 172.21.15.40:0/2336865219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1c009d400 0x7fb1c012de60 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc000c00 tx=0x7fb1bc004750 comp rx=0 tx=0).stop 2023-09-30T22:27:30.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.404+0000 7fb1c7df2700 1 -- 172.21.15.40:0/2336865219 shutdown_connections 2023-09-30T22:27:30.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.404+0000 7fb1c7df2700 1 --2- 172.21.15.40:0/2336865219 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb1c0133e00 0x7fb1c011ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.404+0000 7fb1c7df2700 1 --2- 172.21.15.40:0/2336865219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1c009d400 0x7fb1c012de60 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.404+0000 7fb1c7df2700 1 --2- 172.21.15.40:0/2336865219 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1c009df40 0x7fb1c011a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.404+0000 7fb1c7df2700 1 -- 172.21.15.40:0/2336865219 >> 172.21.15.40:0/2336865219 conn(0x7fb1c00a2a00 msgr2=0x7fb1c01bb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:30.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.405+0000 7fb1c7df2700 1 -- 172.21.15.40:0/2336865219 shutdown_connections 2023-09-30T22:27:30.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.405+0000 7fb1c7df2700 1 -- 172.21.15.40:0/2336865219 wait complete. 2023-09-30T22:27:30.416 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:30.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.429+0000 7f50c70e4700 1 -- 172.21.15.40:0/2986074970 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f50c008e070 con 0x7f50c0071e20 2023-09-30T22:27:30.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.429+0000 7f50bd7fa700 1 -- 172.21.15.40:0/2986074970 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f50b4023380 con 0x7f50c0071e20 2023-09-30T22:27:30.429 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:30.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.431+0000 7f50c70e4700 1 -- 172.21.15.40:0/2986074970 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50c0071e20 msgr2=0x7f50c008afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:30.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.431+0000 7f50c70e4700 1 --2- 172.21.15.40:0/2986074970 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50c0071e20 0x7f50c008afd0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f50b4009840 tx=0x7f50b4004750 comp rx=0 tx=0).stop 2023-09-30T22:27:30.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.432+0000 7f50c70e4700 1 -- 172.21.15.40:0/2986074970 shutdown_connections 2023-09-30T22:27:30.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.432+0000 7f50c70e4700 1 --2- 172.21.15.40:0/2986074970 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50c00a05c0 0x7f50c008ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.432+0000 7f50c70e4700 1 --2- 172.21.15.40:0/2986074970 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50c0071e20 0x7f50c008afd0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.432+0000 7f50c70e4700 1 --2- 172.21.15.40:0/2986074970 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f50c009fcb0 0x7f50c008b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.432+0000 7f50c70e4700 1 -- 172.21.15.40:0/2986074970 >> 172.21.15.40:0/2986074970 conn(0x7f50c00a0da0 msgr2=0x7f50c00a3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:30.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.432+0000 7f50c70e4700 1 -- 172.21.15.40:0/2986074970 shutdown_connections 2023-09-30T22:27:30.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:30.432+0000 7f50c70e4700 1 -- 172.21.15.40:0/2986074970 wait complete. 2023-09-30T22:27:30.443 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:31.339 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:31.391 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:31.417 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:31.444 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:31.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.484+0000 7f6ab4830700 1 Processor -- start 2023-09-30T22:27:31.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.484+0000 7f6ab4830700 1 -- start start 2023-09-30T22:27:31.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.484+0000 7f6ab4830700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6ab009d920 0x7f6ab009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:31.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.484+0000 7f6ab4830700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ab009f0f0 0x7f6ab009e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:31.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.485+0000 7f6ab4830700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6ab0133ca0 0x7f6ab0134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:31.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.485+0000 7f6ab4830700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab006b4c0 con 0x7f6ab0133ca0 2023-09-30T22:27:31.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.485+0000 7f6ab4830700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab009a8f0 con 0x7f6ab009f0f0 2023-09-30T22:27:31.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.485+0000 7f6ab4830700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab009f940 con 0x7f6ab009d920 2023-09-30T22:27:31.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.485+0000 7f6aadd9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ab009f0f0 0x7f6ab009e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:31.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.485+0000 7f6aae59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6ab009d920 0x7f6ab009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:31.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.485+0000 7f6aadd9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ab009f0f0 0x7f6ab009e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:58388/0 (socket says 172.21.15.40:58388) 2023-09-30T22:27:31.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.485+0000 7f6aae59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6ab009d920 0x7f6ab009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55636/0 (socket says 172.21.15.40:55636) 2023-09-30T22:27:31.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.485+0000 7f6aadd9b700 1 -- 172.21.15.40:0/4095386867 learned_addr learned my addr 172.21.15.40:0/4095386867 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:31.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.485+0000 7f6aadd9b700 1 -- 172.21.15.40:0/4095386867 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6ab009d920 msgr2=0x7f6ab009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:31.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.485+0000 7f6aadd9b700 1 --2- 172.21.15.40:0/4095386867 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6ab009d920 0x7f6ab009dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.485+0000 7f6aadd9b700 1 -- 172.21.15.40:0/4095386867 >> v2:172.21.15.40:3300/0 conn(0x7f6ab0133ca0 msgr2=0x7f6ab0134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:31.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.485+0000 7f6aadd9b700 1 --2- 172.21.15.40:0/4095386867 >> v2:172.21.15.40:3300/0 conn(0x7f6ab0133ca0 0x7f6ab0134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.485+0000 7f6aadd9b700 1 -- 172.21.15.40:0/4095386867 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab009f6e0 con 0x7f6ab009f0f0 2023-09-30T22:27:31.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.485+0000 7f6aae59c700 1 --2- 172.21.15.40:0/4095386867 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6ab009d920 0x7f6ab009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:31.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.485+0000 7f6aadd9b700 1 --2- 172.21.15.40:0/4095386867 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ab009f0f0 0x7f6ab009e230 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4009950 tx=0x7f6aa4009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e49a68e31852373e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:31.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.486+0000 7f6aad59a700 1 -- 172.21.15.40:0/4095386867 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4011830 con 0x7f6ab009f0f0 2023-09-30T22:27:31.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.486+0000 7f6aad59a700 1 -- 172.21.15.40:0/4095386867 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa4011990 con 0x7f6ab009f0f0 2023-09-30T22:27:31.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.486+0000 7f6aad59a700 1 -- 172.21.15.40:0/4095386867 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4011d40 con 0x7f6ab009f0f0 2023-09-30T22:27:31.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.486+0000 7f6ab4830700 1 -- 172.21.15.40:0/4095386867 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ab009f0f0 msgr2=0x7f6ab009e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:31.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.486+0000 7f6ab4830700 1 --2- 172.21.15.40:0/4095386867 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ab009f0f0 0x7f6ab009e230 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4009950 tx=0x7f6aa4009c60 comp rx=0 tx=0).stop 2023-09-30T22:27:31.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.486+0000 7f6ab4830700 1 -- 172.21.15.40:0/4095386867 shutdown_connections 2023-09-30T22:27:31.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.487+0000 7f6ab4830700 1 --2- 172.21.15.40:0/4095386867 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6ab009d920 0x7f6ab009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.487+0000 7f6ab4830700 1 --2- 172.21.15.40:0/4095386867 >> v2:172.21.15.40:3300/0 conn(0x7f6ab0133ca0 0x7f6ab0134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.487+0000 7f6ab4830700 1 --2- 172.21.15.40:0/4095386867 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ab009f0f0 0x7f6ab009e230 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.487+0000 7f6ab4830700 1 -- 172.21.15.40:0/4095386867 >> 172.21.15.40:0/4095386867 conn(0x7f6ab009fb20 msgr2=0x7f6ab009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:31.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.487+0000 7f6ab4830700 1 -- 172.21.15.40:0/4095386867 shutdown_connections 2023-09-30T22:27:31.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.487+0000 7f6ab4830700 1 -- 172.21.15.40:0/4095386867 wait complete. 2023-09-30T22:27:31.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.488+0000 7f6ab4830700 1 Processor -- start 2023-09-30T22:27:31.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.488+0000 7f6ab4830700 1 -- start start 2023-09-30T22:27:31.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.488+0000 7f6ab4830700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ab009d920 0x7f6ab0122970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:31.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.488+0000 7f6ab4830700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ab0133ca0 0x7f6ab0122eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:31.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.488+0000 7f6ab4830700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6ab01233f0 0x7f6ab01c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:31.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.488+0000 7f6ab4830700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab0124580 con 0x7f6ab009d920 2023-09-30T22:27:31.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.488+0000 7f6ab4830700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab0123830 con 0x7f6ab0133ca0 2023-09-30T22:27:31.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.488+0000 7f6ab4830700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab0133540 con 0x7f6ab01233f0 2023-09-30T22:27:31.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.488+0000 7f6aadd9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ab0133ca0 0x7f6ab0122eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:31.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.488+0000 7f6aadd9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ab0133ca0 0x7f6ab0122eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:58394/0 (socket says 172.21.15.40:58394) 2023-09-30T22:27:31.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.489+0000 7f6aadd9b700 1 -- 172.21.15.40:0/2283113430 learned_addr learned my addr 172.21.15.40:0/2283113430 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:31.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.489+0000 7f6aae59c700 1 --2- 172.21.15.40:0/2283113430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ab009d920 0x7f6ab0122970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:31.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.489+0000 7f6aadd9b700 1 -- 172.21.15.40:0/2283113430 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6ab01233f0 msgr2=0x7f6ab01c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:31.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.489+0000 7f6aadd9b700 1 --2- 172.21.15.40:0/2283113430 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6ab01233f0 0x7f6ab01c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.489+0000 7f6aadd9b700 1 -- 172.21.15.40:0/2283113430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ab009d920 msgr2=0x7f6ab0122970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:31.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.489+0000 7f6aadd9b700 1 --2- 172.21.15.40:0/2283113430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ab009d920 0x7f6ab0122970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.489+0000 7f6aadd9b700 1 -- 172.21.15.40:0/2283113430 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa0009430 con 0x7f6ab0133ca0 2023-09-30T22:27:31.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.489+0000 7f6aae59c700 1 --2- 172.21.15.40:0/2283113430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ab009d920 0x7f6ab0122970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:31.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.489+0000 7f6aadd9b700 1 --2- 172.21.15.40:0/2283113430 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ab0133ca0 0x7f6ab0122eb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4009fb0 tx=0x7f6aa4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:31.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.489+0000 7f6a9effd700 1 -- 172.21.15.40:0/2283113430 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4004300 con 0x7f6ab0133ca0 2023-09-30T22:27:31.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.489+0000 7f6a9effd700 1 -- 172.21.15.40:0/2283113430 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa401f070 con 0x7f6ab0133ca0 2023-09-30T22:27:31.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.489+0000 7f6a9effd700 1 -- 172.21.15.40:0/2283113430 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa40036a0 con 0x7f6ab0133ca0 2023-09-30T22:27:31.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.490+0000 7f6ab4830700 1 -- 172.21.15.40:0/2283113430 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aa4009550 con 0x7f6ab0133ca0 2023-09-30T22:27:31.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.490+0000 7f6ab4830700 1 -- 172.21.15.40:0/2283113430 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab009c9e0 con 0x7f6ab0133ca0 2023-09-30T22:27:31.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.490+0000 7f6a9effd700 1 -- 172.21.15.40:0/2283113430 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6aa4021030 con 0x7f6ab0133ca0 2023-09-30T22:27:31.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.491+0000 7f6a9effd700 1 -- 172.21.15.40:0/2283113430 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6aa4040980 con 0x7f6ab0133ca0 2023-09-30T22:27:31.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.491+0000 7f6ab4830700 1 -- 172.21.15.40:0/2283113430 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab0062380 con 0x7f6ab0133ca0 2023-09-30T22:27:31.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.497+0000 7f6a9effd700 1 -- 172.21.15.40:0/2283113430 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6aa4015020 con 0x7f6ab0133ca0 2023-09-30T22:27:31.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.534+0000 7f4444569700 1 Processor -- start 2023-09-30T22:27:31.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.534+0000 7f4444569700 1 -- start start 2023-09-30T22:27:31.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.535+0000 7f4444569700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f443c09d450 0x7f443c09d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:31.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.535+0000 7f4444569700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c09dd60 0x7f443c1301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:31.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.535+0000 7f4444569700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f443c130700 0x7f443c130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:31.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.535+0000 7f4444569700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f443c09e8b0 con 0x7f443c130700 2023-09-30T22:27:31.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.535+0000 7f4444569700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f443c09c3b0 con 0x7f443c09dd60 2023-09-30T22:27:31.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.535+0000 7f4444569700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f443c09a6b0 con 0x7f443c09d450 2023-09-30T22:27:31.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.535+0000 7f4441b04700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c09dd60 0x7f443c1301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:31.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.535+0000 7f4441b04700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c09dd60 0x7f443c1301c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:58404/0 (socket says 172.21.15.40:58404) 2023-09-30T22:27:31.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.535+0000 7f4441b04700 1 -- 172.21.15.40:0/3035661393 learned_addr learned my addr 172.21.15.40:0/3035661393 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:31.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.535+0000 7f4442305700 1 --2- 172.21.15.40:0/3035661393 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f443c09d450 0x7f443c09d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:31.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.535+0000 7f4442b06700 1 --2- 172.21.15.40:0/3035661393 >> v2:172.21.15.40:3300/0 conn(0x7f443c130700 0x7f443c130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:31.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.535+0000 7f4441b04700 1 -- 172.21.15.40:0/3035661393 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f443c09d450 msgr2=0x7f443c09d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:31.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.535+0000 7f4441b04700 1 --2- 172.21.15.40:0/3035661393 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f443c09d450 0x7f443c09d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.535+0000 7f4441b04700 1 -- 172.21.15.40:0/3035661393 >> v2:172.21.15.40:3300/0 conn(0x7f443c130700 msgr2=0x7f443c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:31.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.535+0000 7f4441b04700 1 --2- 172.21.15.40:0/3035661393 >> v2:172.21.15.40:3300/0 conn(0x7f443c130700 0x7f443c130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.535+0000 7f4441b04700 1 -- 172.21.15.40:0/3035661393 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443c09b4f0 con 0x7f443c09dd60 2023-09-30T22:27:31.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.536+0000 7f4442305700 1 --2- 172.21.15.40:0/3035661393 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f443c09d450 0x7f443c09d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:31.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.536+0000 7f4441b04700 1 --2- 172.21.15.40:0/3035661393 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c09dd60 0x7f443c1301c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f442c00bb90 tx=0x7f442c00bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d18e37d859c5075 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:31.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.536+0000 7f4441303700 1 -- 172.21.15.40:0/3035661393 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c00dd30 con 0x7f443c09dd60 2023-09-30T22:27:31.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.536+0000 7f4441303700 1 -- 172.21.15.40:0/3035661393 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442c00de90 con 0x7f443c09dd60 2023-09-30T22:27:31.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.536+0000 7f4441303700 1 -- 172.21.15.40:0/3035661393 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c010690 con 0x7f443c09dd60 2023-09-30T22:27:31.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.537+0000 7f4444569700 1 -- 172.21.15.40:0/3035661393 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c09dd60 msgr2=0x7f443c1301c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:31.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.537+0000 7f4444569700 1 --2- 172.21.15.40:0/3035661393 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c09dd60 0x7f443c1301c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f442c00bb90 tx=0x7f442c00bea0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.537+0000 7f4444569700 1 -- 172.21.15.40:0/3035661393 shutdown_connections 2023-09-30T22:27:31.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.537+0000 7f4444569700 1 --2- 172.21.15.40:0/3035661393 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f443c09d450 0x7f443c09d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.537+0000 7f4444569700 1 --2- 172.21.15.40:0/3035661393 >> v2:172.21.15.40:3300/0 conn(0x7f443c130700 0x7f443c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.537+0000 7f4444569700 1 --2- 172.21.15.40:0/3035661393 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c09dd60 0x7f443c1301c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.537+0000 7f4444569700 1 -- 172.21.15.40:0/3035661393 >> 172.21.15.40:0/3035661393 conn(0x7f443c0a2a00 msgr2=0x7f443c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:31.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.537+0000 7f4444569700 1 -- 172.21.15.40:0/3035661393 shutdown_connections 2023-09-30T22:27:31.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.537+0000 7f4444569700 1 -- 172.21.15.40:0/3035661393 wait complete. 2023-09-30T22:27:31.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.538+0000 7f4444569700 1 Processor -- start 2023-09-30T22:27:31.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.538+0000 7f4444569700 1 -- start start 2023-09-30T22:27:31.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.538+0000 7f4444569700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f443c09d450 0x7f443c11b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:31.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.538+0000 7f4444569700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c09dd60 0x7f443c11b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:31.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.538+0000 7f4444569700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f443c130700 0x7f443c11bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:31.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.538+0000 7f4444569700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443c11e530 con 0x7f443c130700 2023-09-30T22:27:31.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.538+0000 7f4444569700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f443c11cbf0 con 0x7f443c09dd60 2023-09-30T22:27:31.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.538+0000 7f4444569700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f443c070fb0 con 0x7f443c09d450 2023-09-30T22:27:31.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.538+0000 7f4441b04700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c09dd60 0x7f443c11b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:31.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.539+0000 7f4441b04700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c09dd60 0x7f443c11b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:58408/0 (socket says 172.21.15.40:58408) 2023-09-30T22:27:31.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.538+0000 7f4442305700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f443c09d450 0x7f443c11b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:31.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.539+0000 7f4441b04700 1 -- 172.21.15.40:0/1285716833 learned_addr learned my addr 172.21.15.40:0/1285716833 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:31.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.539+0000 7f4442b06700 1 --2- 172.21.15.40:0/1285716833 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f443c130700 0x7f443c11bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:31.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.539+0000 7f4441b04700 1 -- 172.21.15.40:0/1285716833 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f443c09d450 msgr2=0x7f443c11b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:31.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.539+0000 7f4441b04700 1 --2- 172.21.15.40:0/1285716833 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f443c09d450 0x7f443c11b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.539+0000 7f4441b04700 1 -- 172.21.15.40:0/1285716833 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f443c130700 msgr2=0x7f443c11bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:31.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.539+0000 7f4441b04700 1 --2- 172.21.15.40:0/1285716833 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f443c130700 0x7f443c11bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.539+0000 7f4441b04700 1 -- 172.21.15.40:0/1285716833 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44380094a0 con 0x7f443c09dd60 2023-09-30T22:27:31.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.539+0000 7f4441b04700 1 --2- 172.21.15.40:0/1285716833 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c09dd60 0x7f443c11b580 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f442c000c00 tx=0x7f442c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:31.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.539+0000 7f4432ffd700 1 -- 172.21.15.40:0/1285716833 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c01f070 con 0x7f443c09dd60 2023-09-30T22:27:31.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.539+0000 7f4444569700 1 -- 172.21.15.40:0/1285716833 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f442c00b7f0 con 0x7f443c09dd60 2023-09-30T22:27:31.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.539+0000 7f4432ffd700 1 -- 172.21.15.40:0/1285716833 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442c003970 con 0x7f443c09dd60 2023-09-30T22:27:31.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.539+0000 7f4432ffd700 1 -- 172.21.15.40:0/1285716833 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c003d20 con 0x7f443c09dd60 2023-09-30T22:27:31.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.539+0000 7f4444569700 1 -- 172.21.15.40:0/1285716833 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f443c11d340 con 0x7f443c09dd60 2023-09-30T22:27:31.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.540+0000 7f4432ffd700 1 -- 172.21.15.40:0/1285716833 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f442c019400 con 0x7f443c09dd60 2023-09-30T22:27:31.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.541+0000 7f4444569700 1 -- 172.21.15.40:0/1285716833 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f443c12ff60 con 0x7f443c09dd60 2023-09-30T22:27:31.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.541+0000 7f4432ffd700 1 -- 172.21.15.40:0/1285716833 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f442c040930 con 0x7f443c09dd60 2023-09-30T22:27:31.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.549+0000 7f4432ffd700 1 -- 172.21.15.40:0/1285716833 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f442c00e950 con 0x7f443c09dd60 2023-09-30T22:27:31.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.580+0000 7fbf17fed700 1 Processor -- start 2023-09-30T22:27:31.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.580+0000 7fbf17fed700 1 -- start start 2023-09-30T22:27:31.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.581+0000 7fbf17fed700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbf10138250 0x7fbf10138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:31.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.581+0000 7fbf17fed700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf1009d400 0x7fbf1009d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:31.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.581+0000 7fbf17fed700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf1009dd50 0x7fbf1013f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:31.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.581+0000 7fbf17fed700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf10137e20 con 0x7fbf10138250 2023-09-30T22:27:31.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.581+0000 7fbf17fed700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf10138050 con 0x7fbf1009d400 2023-09-30T22:27:31.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.581+0000 7fbf17fed700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1009b010 con 0x7fbf1009dd50 2023-09-30T22:27:31.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.581+0000 7fbf15d89700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbf10138250 0x7fbf10138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:31.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.581+0000 7fbf15d89700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbf10138250 0x7fbf10138620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59956/0 (socket says 172.21.15.40:59956) 2023-09-30T22:27:31.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.581+0000 7fbf15d89700 1 -- 172.21.15.40:0/2495179824 learned_addr learned my addr 172.21.15.40:0/2495179824 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:31.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.581+0000 7fbf15588700 1 --2- 172.21.15.40:0/2495179824 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf1009d400 0x7fbf1009d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:31.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.581+0000 7fbf1658a700 1 --2- 172.21.15.40:0/2495179824 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf1009dd50 0x7fbf1013f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:31.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.582+0000 7fbf15588700 1 -- 172.21.15.40:0/2495179824 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf1009dd50 msgr2=0x7fbf1013f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:31.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.582+0000 7fbf15588700 1 --2- 172.21.15.40:0/2495179824 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf1009dd50 0x7fbf1013f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.582+0000 7fbf15588700 1 -- 172.21.15.40:0/2495179824 >> v2:172.21.15.40:3300/0 conn(0x7fbf10138250 msgr2=0x7fbf10138620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:31.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.582+0000 7fbf15588700 1 --2- 172.21.15.40:0/2495179824 >> v2:172.21.15.40:3300/0 conn(0x7fbf10138250 0x7fbf10138620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.582+0000 7fbf15588700 1 -- 172.21.15.40:0/2495179824 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1009f1f0 con 0x7fbf1009d400 2023-09-30T22:27:31.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.582+0000 7fbf15d89700 1 --2- 172.21.15.40:0/2495179824 >> v2:172.21.15.40:3300/0 conn(0x7fbf10138250 0x7fbf10138620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:31.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.582+0000 7fbf15588700 1 --2- 172.21.15.40:0/2495179824 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf1009d400 0x7fbf1009d810 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbf00009840 tx=0x7fbf00009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72163ce1db96fc99 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:31.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.582+0000 7fbf14d87700 1 -- 172.21.15.40:0/2495179824 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf00011830 con 0x7fbf1009d400 2023-09-30T22:27:31.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.582+0000 7fbf14d87700 1 -- 172.21.15.40:0/2495179824 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf00011990 con 0x7fbf1009d400 2023-09-30T22:27:31.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.582+0000 7fbf14d87700 1 -- 172.21.15.40:0/2495179824 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf00011d20 con 0x7fbf1009d400 2023-09-30T22:27:31.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.583+0000 7fbf17fed700 1 -- 172.21.15.40:0/2495179824 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf1009d400 msgr2=0x7fbf1009d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:31.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.583+0000 7fbf17fed700 1 --2- 172.21.15.40:0/2495179824 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf1009d400 0x7fbf1009d810 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbf00009840 tx=0x7fbf00009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:31.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.583+0000 7fbf17fed700 1 -- 172.21.15.40:0/2495179824 shutdown_connections 2023-09-30T22:27:31.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.583+0000 7fbf17fed700 1 --2- 172.21.15.40:0/2495179824 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf1009dd50 0x7fbf1013f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.583+0000 7fbf17fed700 1 --2- 172.21.15.40:0/2495179824 >> v2:172.21.15.40:3300/0 conn(0x7fbf10138250 0x7fbf10138620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.583+0000 7fbf17fed700 1 --2- 172.21.15.40:0/2495179824 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf1009d400 0x7fbf1009d810 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.583+0000 7fbf17fed700 1 -- 172.21.15.40:0/2495179824 >> 172.21.15.40:0/2495179824 conn(0x7fbf100a2a00 msgr2=0x7fbf100a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:31.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.583+0000 7fbf17fed700 1 -- 172.21.15.40:0/2495179824 shutdown_connections 2023-09-30T22:27:31.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.583+0000 7fbf17fed700 1 -- 172.21.15.40:0/2495179824 wait complete. 2023-09-30T22:27:31.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.584+0000 7fbf17fed700 1 Processor -- start 2023-09-30T22:27:31.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.584+0000 7fbf17fed700 1 -- start start 2023-09-30T22:27:31.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.584+0000 7fbf17fed700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf1009d400 0x7fbf10132650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:31.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.585+0000 7fbf17fed700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf1009dd50 0x7fbf10132b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:31.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.585+0000 7fbf17fed700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf10138250 0x7fbf101d53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:31.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.585+0000 7fbf17fed700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1013c990 con 0x7fbf1009d400 2023-09-30T22:27:31.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.585+0000 7fbf17fed700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1013def0 con 0x7fbf10138250 2023-09-30T22:27:31.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.585+0000 7fbf17fed700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf10131fe0 con 0x7fbf1009dd50 2023-09-30T22:27:31.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.585+0000 7fbf15588700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf1009dd50 0x7fbf10132b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:31.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.585+0000 7fbf15588700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf1009dd50 0x7fbf10132b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55688/0 (socket says 172.21.15.40:55688) 2023-09-30T22:27:31.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.585+0000 7fbf15588700 1 -- 172.21.15.40:0/3347559888 learned_addr learned my addr 172.21.15.40:0/3347559888 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:31.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.585+0000 7fbf15d89700 1 --2- 172.21.15.40:0/3347559888 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf1009d400 0x7fbf10132650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:31.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.585+0000 7fbf1658a700 1 --2- 172.21.15.40:0/3347559888 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf10138250 0x7fbf101d53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:31.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.585+0000 7fbf15588700 1 -- 172.21.15.40:0/3347559888 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf10138250 msgr2=0x7fbf101d53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:31.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.585+0000 7fbf15588700 1 --2- 172.21.15.40:0/3347559888 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf10138250 0x7fbf101d53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.585+0000 7fbf15588700 1 -- 172.21.15.40:0/3347559888 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf1009d400 msgr2=0x7fbf10132650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:31.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.585+0000 7fbf15588700 1 --2- 172.21.15.40:0/3347559888 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf1009d400 0x7fbf10132650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.585+0000 7fbf15588700 1 -- 172.21.15.40:0/3347559888 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf0c009550 con 0x7fbf1009dd50 2023-09-30T22:27:31.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.585+0000 7fbf15588700 1 --2- 172.21.15.40:0/3347559888 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf1009dd50 0x7fbf10132b90 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fbf00000c00 tx=0x7fbf00004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:31.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.585+0000 7fbf067fc700 1 -- 172.21.15.40:0/3347559888 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf00004380 con 0x7fbf1009dd50 2023-09-30T22:27:31.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.586+0000 7fbf067fc700 1 -- 172.21.15.40:0/3347559888 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0001f070 con 0x7fbf1009dd50 2023-09-30T22:27:31.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.586+0000 7fbf17fed700 1 -- 172.21.15.40:0/3347559888 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf000094a0 con 0x7fbf1009dd50 2023-09-30T22:27:31.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.586+0000 7fbf067fc700 1 -- 172.21.15.40:0/3347559888 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf000036a0 con 0x7fbf1009dd50 2023-09-30T22:27:31.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.586+0000 7fbf17fed700 1 -- 172.21.15.40:0/3347559888 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf10135f90 con 0x7fbf1009dd50 2023-09-30T22:27:31.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.587+0000 7fbf067fc700 1 -- 172.21.15.40:0/3347559888 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbf00021030 con 0x7fbf1009dd50 2023-09-30T22:27:31.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.587+0000 7fbf17fed700 1 -- 172.21.15.40:0/3347559888 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf10119050 con 0x7fbf1009dd50 2023-09-30T22:27:31.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.587+0000 7fbf067fc700 1 -- 172.21.15.40:0/3347559888 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fbf00040750 con 0x7fbf1009dd50 2023-09-30T22:27:31.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.596+0000 7fbf067fc700 1 -- 172.21.15.40:0/3347559888 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbf10119050 con 0x7fbf1009dd50 2023-09-30T22:27:31.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.620+0000 7f1e4088e700 1 Processor -- start 2023-09-30T22:27:31.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.621+0000 7f1e4088e700 1 -- start start 2023-09-30T22:27:31.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.621+0000 7f1e4088e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e3c06f070 0x7f1e3c06f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:31.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.621+0000 7f1e4088e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1e3c06f980 0x7f1e3c097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:31.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.621+0000 7f1e4088e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e3c070830 con 0x7f1e3c06fdb0 2023-09-30T22:27:31.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.621+0000 7f1e4088e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e3c071af0 con 0x7f1e3c06f980 2023-09-30T22:27:31.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.621+0000 7f1e4088e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c070ad0 con 0x7f1e3c06f070 2023-09-30T22:27:31.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.622+0000 7f1e39d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1e3c06f980 0x7f1e3c097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:31.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.622+0000 7f1e39d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1e3c06f980 0x7f1e3c097090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59982/0 (socket says 172.21.15.40:59982) 2023-09-30T22:27:31.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.622+0000 7f1e39d9b700 1 -- 172.21.15.40:0/4030503994 learned_addr learned my addr 172.21.15.40:0/4030503994 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:31.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.622+0000 7f1e3a59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e3c06f070 0x7f1e3c06f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:31.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.622+0000 7f1e3a59c700 1 -- 172.21.15.40:0/4030503994 >> v2:172.21.15.40:3300/0 conn(0x7f1e3c06f980 msgr2=0x7f1e3c097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:31.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.622+0000 7f1e3a59c700 1 --2- 172.21.15.40:0/4030503994 >> v2:172.21.15.40:3300/0 conn(0x7f1e3c06f980 0x7f1e3c097090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.622+0000 7f1e3a59c700 1 -- 172.21.15.40:0/4030503994 >> v1:172.21.15.40:6789/0 conn(0x7f1e3c06fdb0 legacy=0x7f1e3c0975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:31.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.622+0000 7f1e3a59c700 1 -- 172.21.15.40:0/4030503994 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3c070de0 con 0x7f1e3c06f070 2023-09-30T22:27:31.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.622+0000 7f1e39d9b700 1 --2- 172.21.15.40:0/4030503994 >> v2:172.21.15.40:3300/0 conn(0x7f1e3c06f980 0x7f1e3c097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:31.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.622+0000 7f1e3a59c700 1 --2- 172.21.15.40:0/4030503994 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e3c06f070 0x7f1e3c06f440 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0098a0 tx=0x7f1e2c009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2318caaed4e2893d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:31.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.622+0000 7f1e3959a700 1 -- 172.21.15.40:0/4030503994 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c011830 con 0x7f1e3c06f070 2023-09-30T22:27:31.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.623+0000 7f1e3959a700 1 -- 172.21.15.40:0/4030503994 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2c011990 con 0x7f1e3c06f070 2023-09-30T22:27:31.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.623+0000 7f1e3959a700 1 -- 172.21.15.40:0/4030503994 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c011d20 con 0x7f1e3c06f070 2023-09-30T22:27:31.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.623+0000 7f1e4088e700 1 -- 172.21.15.40:0/4030503994 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e3c06f070 msgr2=0x7f1e3c06f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:31.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.623+0000 7f1e4088e700 1 --2- 172.21.15.40:0/4030503994 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e3c06f070 0x7f1e3c06f440 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0098a0 tx=0x7f1e2c009bb0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.624+0000 7f1e4088e700 1 -- 172.21.15.40:0/4030503994 shutdown_connections 2023-09-30T22:27:31.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.624+0000 7f1e4088e700 1 --2- 172.21.15.40:0/4030503994 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e3c06f070 0x7f1e3c06f440 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.624+0000 7f1e4088e700 1 --2- 172.21.15.40:0/4030503994 >> v2:172.21.15.40:3300/0 conn(0x7f1e3c06f980 0x7f1e3c097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.624+0000 7f1e4088e700 1 -- 172.21.15.40:0/4030503994 >> 172.21.15.40:0/4030503994 conn(0x7f1e3c0a41a0 msgr2=0x7f1e3c0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:31.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.624+0000 7f1e4088e700 1 -- 172.21.15.40:0/4030503994 shutdown_connections 2023-09-30T22:27:31.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.624+0000 7f1e4088e700 1 -- 172.21.15.40:0/4030503994 wait complete. 2023-09-30T22:27:31.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.625+0000 7f1e4088e700 1 Processor -- start 2023-09-30T22:27:31.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.625+0000 7f1e4088e700 1 -- start start 2023-09-30T22:27:31.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.625+0000 7f1e4088e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1e3c06f070 0x7f1e3c12d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:31.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.625+0000 7f1e4088e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e3c06f980 0x7f1e3c12d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:31.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.625+0000 7f1e4088e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e3c06fdb0 0x7f1e3c12dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:31.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.625+0000 7f1e4088e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c12f360 con 0x7f1e3c06fdb0 2023-09-30T22:27:31.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.625+0000 7f1e4088e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c1322e0 con 0x7f1e3c06f980 2023-09-30T22:27:31.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.625+0000 7f1e4088e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c1304d0 con 0x7f1e3c06f070 2023-09-30T22:27:31.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.625+0000 7f1e3a59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1e3c06f070 0x7f1e3c12d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:31.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.625+0000 7f1e3a59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1e3c06f070 0x7f1e3c12d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55702/0 (socket says 172.21.15.40:55702) 2023-09-30T22:27:31.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.625+0000 7f1e3a59c700 1 -- 172.21.15.40:0/3614386188 learned_addr learned my addr 172.21.15.40:0/3614386188 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:31.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.626+0000 7f1e39d9b700 1 --2- 172.21.15.40:0/3614386188 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e3c06f980 0x7f1e3c12d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:31.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.626+0000 7f1e3ad9d700 1 --2- 172.21.15.40:0/3614386188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e3c06fdb0 0x7f1e3c12dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:31.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.626+0000 7f1e3a59c700 1 -- 172.21.15.40:0/3614386188 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e3c06f980 msgr2=0x7f1e3c12d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:31.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.626+0000 7f1e3a59c700 1 --2- 172.21.15.40:0/3614386188 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e3c06f980 0x7f1e3c12d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.626+0000 7f1e3a59c700 1 -- 172.21.15.40:0/3614386188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e3c06fdb0 msgr2=0x7f1e3c12dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:31.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.626+0000 7f1e3a59c700 1 --2- 172.21.15.40:0/3614386188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e3c06fdb0 0x7f1e3c12dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.626+0000 7f1e3a59c700 1 -- 172.21.15.40:0/3614386188 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e30009550 con 0x7f1e3c06f070 2023-09-30T22:27:31.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.626+0000 7f1e3a59c700 1 --2- 172.21.15.40:0/3614386188 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1e3c06f070 0x7f1e3c12d160 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c000c00 tx=0x7f1e2c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:31.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.626+0000 7f1e2affd700 1 -- 172.21.15.40:0/3614386188 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c004400 con 0x7f1e3c06f070 2023-09-30T22:27:31.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.626+0000 7f1e2affd700 1 -- 172.21.15.40:0/3614386188 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2c01f070 con 0x7f1e3c06f070 2023-09-30T22:27:31.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.626+0000 7f1e4088e700 1 -- 172.21.15.40:0/3614386188 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e2c0094a0 con 0x7f1e3c06f070 2023-09-30T22:27:31.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.626+0000 7f1e2affd700 1 -- 172.21.15.40:0/3614386188 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c0038e0 con 0x7f1e3c06f070 2023-09-30T22:27:31.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.626+0000 7f1e4088e700 1 -- 172.21.15.40:0/3614386188 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e3c131650 con 0x7f1e3c06f070 2023-09-30T22:27:31.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.627+0000 7f1e4088e700 1 -- 172.21.15.40:0/3614386188 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e3c062380 con 0x7f1e3c06f070 2023-09-30T22:27:31.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.628+0000 7f1e2affd700 1 -- 172.21.15.40:0/3614386188 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e2c021030 con 0x7f1e3c06f070 2023-09-30T22:27:31.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.628+0000 7f1e2affd700 1 -- 172.21.15.40:0/3614386188 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f1e2c040e40 con 0x7f1e3c06f070 2023-09-30T22:27:31.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.636+0000 7f1e2affd700 1 -- 172.21.15.40:0/3614386188 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e2c0199a0 con 0x7f1e3c06f070 2023-09-30T22:27:31.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.715+0000 7f6ab4830700 1 -- 172.21.15.40:0/2283113430 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6ab0074720 con 0x7f6ab0133ca0 2023-09-30T22:27:31.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.715+0000 7f6a9effd700 1 -- 172.21.15.40:0/2283113430 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6aa40239c0 con 0x7f6ab0133ca0 2023-09-30T22:27:31.715 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:31.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.718+0000 7f6ab4830700 1 -- 172.21.15.40:0/2283113430 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ab0133ca0 msgr2=0x7f6ab0122eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:31.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.718+0000 7f6ab4830700 1 --2- 172.21.15.40:0/2283113430 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ab0133ca0 0x7f6ab0122eb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4009fb0 tx=0x7f6aa4004750 comp rx=0 tx=0).stop 2023-09-30T22:27:31.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.718+0000 7f6ab4830700 1 -- 172.21.15.40:0/2283113430 shutdown_connections 2023-09-30T22:27:31.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.718+0000 7f6ab4830700 1 --2- 172.21.15.40:0/2283113430 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6ab01233f0 0x7f6ab01c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.718+0000 7f6ab4830700 1 --2- 172.21.15.40:0/2283113430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ab009d920 0x7f6ab0122970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.718+0000 7f6ab4830700 1 --2- 172.21.15.40:0/2283113430 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ab0133ca0 0x7f6ab0122eb0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.718+0000 7f6ab4830700 1 -- 172.21.15.40:0/2283113430 >> 172.21.15.40:0/2283113430 conn(0x7f6ab009fb20 msgr2=0x7f6ab00a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:31.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.719+0000 7f6ab4830700 1 -- 172.21.15.40:0/2283113430 shutdown_connections 2023-09-30T22:27:31.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.719+0000 7f6ab4830700 1 -- 172.21.15.40:0/2283113430 wait complete. 2023-09-30T22:27:31.732 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:31.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.757+0000 7f4444569700 1 -- 172.21.15.40:0/1285716833 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f443c09c5d0 con 0x7f443c09dd60 2023-09-30T22:27:31.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.757+0000 7f4432ffd700 1 -- 172.21.15.40:0/1285716833 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f442c022370 con 0x7f443c09dd60 2023-09-30T22:27:31.757 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:31.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.759+0000 7f4444569700 1 -- 172.21.15.40:0/1285716833 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c09dd60 msgr2=0x7f443c11b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:31.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.759+0000 7f4444569700 1 --2- 172.21.15.40:0/1285716833 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c09dd60 0x7f443c11b580 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f442c000c00 tx=0x7f442c004750 comp rx=0 tx=0).stop 2023-09-30T22:27:31.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.759+0000 7f4444569700 1 -- 172.21.15.40:0/1285716833 shutdown_connections 2023-09-30T22:27:31.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.759+0000 7f4444569700 1 --2- 172.21.15.40:0/1285716833 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f443c09d450 0x7f443c11b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.759+0000 7f4444569700 1 --2- 172.21.15.40:0/1285716833 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f443c130700 0x7f443c11bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.759+0000 7f4444569700 1 --2- 172.21.15.40:0/1285716833 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f443c09dd60 0x7f443c11b580 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.759+0000 7f4444569700 1 -- 172.21.15.40:0/1285716833 >> 172.21.15.40:0/1285716833 conn(0x7f443c0a2a00 msgr2=0x7f443c1b7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:31.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.759+0000 7f4444569700 1 -- 172.21.15.40:0/1285716833 shutdown_connections 2023-09-30T22:27:31.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.760+0000 7f4444569700 1 -- 172.21.15.40:0/1285716833 wait complete. 2023-09-30T22:27:31.772 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:31.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.834+0000 7fbf17fed700 1 -- 172.21.15.40:0/3347559888 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbf10119050 con 0x7fbf1009dd50 2023-09-30T22:27:31.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.834+0000 7fbf067fc700 1 -- 172.21.15.40:0/3347559888 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbf10119050 con 0x7fbf1009dd50 2023-09-30T22:27:31.834 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:31.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.836+0000 7fbf17fed700 1 -- 172.21.15.40:0/3347559888 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf1009dd50 msgr2=0x7fbf10132b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:31.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.836+0000 7fbf17fed700 1 --2- 172.21.15.40:0/3347559888 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf1009dd50 0x7fbf10132b90 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fbf00000c00 tx=0x7fbf00004750 comp rx=0 tx=0).stop 2023-09-30T22:27:31.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.836+0000 7fbf17fed700 1 -- 172.21.15.40:0/3347559888 shutdown_connections 2023-09-30T22:27:31.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.836+0000 7fbf17fed700 1 --2- 172.21.15.40:0/3347559888 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf10138250 0x7fbf101d53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.836+0000 7fbf17fed700 1 --2- 172.21.15.40:0/3347559888 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf1009d400 0x7fbf10132650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.836+0000 7fbf17fed700 1 --2- 172.21.15.40:0/3347559888 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf1009dd50 0x7fbf10132b90 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.836+0000 7fbf17fed700 1 -- 172.21.15.40:0/3347559888 >> 172.21.15.40:0/3347559888 conn(0x7fbf100a2a00 msgr2=0x7fbf100a1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:31.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.836+0000 7fbf17fed700 1 -- 172.21.15.40:0/3347559888 shutdown_connections 2023-09-30T22:27:31.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.836+0000 7fbf17fed700 1 -- 172.21.15.40:0/3347559888 wait complete. 2023-09-30T22:27:31.848 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:31.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.868+0000 7f1e4088e700 1 -- 172.21.15.40:0/3614386188 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1e3c074620 con 0x7f1e3c06f070 2023-09-30T22:27:31.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.868+0000 7f1e2affd700 1 -- 172.21.15.40:0/3614386188 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e2c015020 con 0x7f1e3c06f070 2023-09-30T22:27:31.868 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:31.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.870+0000 7f1e4088e700 1 -- 172.21.15.40:0/3614386188 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1e3c06f070 msgr2=0x7f1e3c12d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:31.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.870+0000 7f1e4088e700 1 --2- 172.21.15.40:0/3614386188 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1e3c06f070 0x7f1e3c12d160 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c000c00 tx=0x7f1e2c004750 comp rx=0 tx=0).stop 2023-09-30T22:27:31.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.870+0000 7f1e4088e700 1 -- 172.21.15.40:0/3614386188 shutdown_connections 2023-09-30T22:27:31.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.870+0000 7f1e4088e700 1 --2- 172.21.15.40:0/3614386188 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1e3c06f070 0x7f1e3c12d160 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.870+0000 7f1e4088e700 1 --2- 172.21.15.40:0/3614386188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e3c06fdb0 0x7f1e3c12dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.870+0000 7f1e4088e700 1 --2- 172.21.15.40:0/3614386188 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e3c06f980 0x7f1e3c12d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.870+0000 7f1e4088e700 1 -- 172.21.15.40:0/3614386188 >> 172.21.15.40:0/3614386188 conn(0x7f1e3c0a41a0 msgr2=0x7f1e3c0974a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:31.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.870+0000 7f1e4088e700 1 -- 172.21.15.40:0/3614386188 shutdown_connections 2023-09-30T22:27:31.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:31.870+0000 7f1e4088e700 1 -- 172.21.15.40:0/3614386188 wait complete. 2023-09-30T22:27:31.882 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:32.733 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:32.773 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:32.849 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:32.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.879+0000 7fbf1e4aa700 1 Processor -- start 2023-09-30T22:27:32.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.879+0000 7fbf1e4aa700 1 -- start start 2023-09-30T22:27:32.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.880+0000 7fbf1e4aa700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf1806a6d0 0x7fbf1806aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:32.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.880+0000 7fbf1e4aa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf18131fc0 0x7fbf18139b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:32.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.880+0000 7fbf1e4aa700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf1809eb60 con 0x7fbf1806afe0 2023-09-30T22:27:32.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.880+0000 7fbf1e4aa700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1809db70 con 0x7fbf18131fc0 2023-09-30T22:27:32.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.880+0000 7fbf1e4aa700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1809ddf0 con 0x7fbf1806a6d0 2023-09-30T22:27:32.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.880+0000 7fbf177fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbf1806afe0 0x7fbf181318b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56618/0 (socket says 172.21.15.40:56618) 2023-09-30T22:27:32.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.880+0000 7fbf177fe700 1 -- 172.21.15.40:0/4138722196 learned_addr learned my addr 172.21.15.40:0/4138722196 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:27:32.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.880+0000 7fbf16ffd700 1 -- 172.21.15.40:0/4138722196 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 775580022 0 0) 0x7fbf1809eb60 con 0x7fbf1806afe0 2023-09-30T22:27:32.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.880+0000 7fbf16ffd700 1 -- 172.21.15.40:0/4138722196 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf000035b0 con 0x7fbf1806afe0 2023-09-30T22:27:32.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.880+0000 7fbf17fff700 1 --2- 172.21.15.40:0/4138722196 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf1806a6d0 0x7fbf1806aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:32.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.880+0000 7fbf16ffd700 1 -- 172.21.15.40:0/4138722196 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3728659591 0 0) 0x7fbf000035b0 con 0x7fbf1806afe0 2023-09-30T22:27:32.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.880+0000 7fbf16ffd700 1 -- 172.21.15.40:0/4138722196 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf1806a6d0 msgr2=0x7fbf1806aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:32.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.880+0000 7fbf16ffd700 1 --2- 172.21.15.40:0/4138722196 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf1806a6d0 0x7fbf1806aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.880+0000 7fbf16ffd700 1 -- 172.21.15.40:0/4138722196 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf18131fc0 msgr2=0x7fbf18139b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:32.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.880+0000 7fbf16ffd700 1 --2- 172.21.15.40:0/4138722196 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf18131fc0 0x7fbf18139b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.880+0000 7fbf16ffd700 1 -- 172.21.15.40:0/4138722196 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1809c9a0 con 0x7fbf1806afe0 2023-09-30T22:27:32.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.880+0000 7fbf16ffd700 1 -- 172.21.15.40:0/4138722196 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4231795173 0 0) 0x7fbf0c001670 con 0x7fbf1806afe0 2023-09-30T22:27:32.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.880+0000 7fbf17fff700 1 --2- 172.21.15.40:0/4138722196 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf1806a6d0 0x7fbf1806aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:32.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.880+0000 7fbf16ffd700 1 -- 172.21.15.40:0/4138722196 >> v1:172.21.15.40:6789/0 conn(0x7fbf1806afe0 legacy=0x7fbf181318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:32.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.881+0000 7fbf16ffd700 1 --2- 172.21.15.40:0/4138722196 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf1806a6d0 0x7fbf00003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:32.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.881+0000 7fbf16ffd700 1 --2- 172.21.15.40:0/4138722196 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf00003ff0 0x7fbf00004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:32.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.881+0000 7fbf16ffd700 1 --2- 172.21.15.40:0/4138722196 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf18131fc0 0x7fbf00004d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:32.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.881+0000 7fbf16ffd700 1 -- 172.21.15.40:0/4138722196 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1809db70 con 0x7fbf00003ff0 2023-09-30T22:27:32.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.881+0000 7fbf16ffd700 1 -- 172.21.15.40:0/4138722196 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1809ddf0 con 0x7fbf18131fc0 2023-09-30T22:27:32.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.881+0000 7fbf16ffd700 1 -- 172.21.15.40:0/4138722196 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf00005430 con 0x7fbf1806a6d0 2023-09-30T22:27:32.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.881+0000 7fbf1ca47700 1 --2- 172.21.15.40:0/4138722196 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf18131fc0 0x7fbf00004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:32.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.881+0000 7fbf177fe700 1 --2- 172.21.15.40:0/4138722196 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf00003ff0 0x7fbf00004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:32.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.881+0000 7fbf17fff700 1 --2- 172.21.15.40:0/4138722196 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf1806a6d0 0x7fbf00003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:32.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.881+0000 7fbf1ca47700 1 -- 172.21.15.40:0/4138722196 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf1806a6d0 msgr2=0x7fbf00003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:32.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.881+0000 7fbf1ca47700 1 --2- 172.21.15.40:0/4138722196 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf1806a6d0 0x7fbf00003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.881+0000 7fbf1ca47700 1 -- 172.21.15.40:0/4138722196 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf00003ff0 msgr2=0x7fbf00004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:32.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.881+0000 7fbf1ca47700 1 --2- 172.21.15.40:0/4138722196 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf00003ff0 0x7fbf00004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.881+0000 7fbf1ca47700 1 -- 172.21.15.40:0/4138722196 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf000035b0 con 0x7fbf18131fc0 2023-09-30T22:27:32.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.881+0000 7fbf177fe700 1 --2- 172.21.15.40:0/4138722196 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf00003ff0 0x7fbf00004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:32.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.881+0000 7fbf1ca47700 1 --2- 172.21.15.40:0/4138722196 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf18131fc0 0x7fbf00004d90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fbf10009e40 tx=0x7fbf00005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=171cbef4e406eb2e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:32.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.881+0000 7fbf16ffd700 1 -- 172.21.15.40:0/4138722196 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf100098b0 con 0x7fbf18131fc0 2023-09-30T22:27:32.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.882+0000 7fbf16ffd700 1 -- 172.21.15.40:0/4138722196 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1000baa0 con 0x7fbf18131fc0 2023-09-30T22:27:32.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.882+0000 7fbf16ffd700 1 -- 172.21.15.40:0/4138722196 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1000be50 con 0x7fbf18131fc0 2023-09-30T22:27:32.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.882+0000 7fbf1e4aa700 1 -- 172.21.15.40:0/4138722196 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf18131fc0 msgr2=0x7fbf00004d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:32.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.882+0000 7fbf1e4aa700 1 --2- 172.21.15.40:0/4138722196 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf18131fc0 0x7fbf00004d90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fbf10009e40 tx=0x7fbf00005880 comp rx=0 tx=0).stop 2023-09-30T22:27:32.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.883+0000 7fbf1e4aa700 1 -- 172.21.15.40:0/4138722196 shutdown_connections 2023-09-30T22:27:32.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.883+0000 7fbf1e4aa700 1 --2- 172.21.15.40:0/4138722196 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf1806a6d0 0x7fbf00003a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.883+0000 7fbf1e4aa700 1 --2- 172.21.15.40:0/4138722196 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf18131fc0 0x7fbf00004d90 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.883+0000 7fbf1e4aa700 1 --2- 172.21.15.40:0/4138722196 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf00003ff0 0x7fbf00004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.883+0000 7fbf1e4aa700 1 -- 172.21.15.40:0/4138722196 >> 172.21.15.40:0/4138722196 conn(0x7fbf1809fb20 msgr2=0x7fbf1809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:32.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.883+0000 7fbf1e4aa700 1 -- 172.21.15.40:0/4138722196 shutdown_connections 2023-09-30T22:27:32.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.883+0000 7fbf1e4aa700 1 -- 172.21.15.40:0/4138722196 wait complete. 2023-09-30T22:27:32.887 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:32.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.884+0000 7fbf1e4aa700 1 Processor -- start 2023-09-30T22:27:32.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.884+0000 7fbf1e4aa700 1 -- start start 2023-09-30T22:27:32.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.884+0000 7fbf1e4aa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf00003ff0 0x7fbf1811c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:32.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.884+0000 7fbf1e4aa700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf1806a6d0 0x7fbf1811c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:32.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.884+0000 7fbf1e4aa700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf1806afe0 0x7fbf1811cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:32.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.884+0000 7fbf1e4aa700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1811f3a0 con 0x7fbf1806a6d0 2023-09-30T22:27:32.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.884+0000 7fbf1e4aa700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf180715d0 con 0x7fbf00003ff0 2023-09-30T22:27:32.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.884+0000 7fbf1e4aa700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1809c3d0 con 0x7fbf1806afe0 2023-09-30T22:27:32.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.885+0000 7fbf1ca47700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf1806afe0 0x7fbf1811cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:32.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.885+0000 7fbf1ca47700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf1806afe0 0x7fbf1811cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55738/0 (socket says 172.21.15.40:55738) 2023-09-30T22:27:32.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.885+0000 7fbf1ca47700 1 -- 172.21.15.40:0/729012462 learned_addr learned my addr 172.21.15.40:0/729012462 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:32.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.885+0000 7fbf177fe700 1 --2- 172.21.15.40:0/729012462 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf1806a6d0 0x7fbf1811c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:32.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.885+0000 7fbf17fff700 1 --2- 172.21.15.40:0/729012462 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf00003ff0 0x7fbf1811c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:32.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.885+0000 7fbf177fe700 1 -- 172.21.15.40:0/729012462 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf1806afe0 msgr2=0x7fbf1811cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:32.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.885+0000 7fbf177fe700 1 --2- 172.21.15.40:0/729012462 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf1806afe0 0x7fbf1811cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.885+0000 7fbf177fe700 1 -- 172.21.15.40:0/729012462 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf00003ff0 msgr2=0x7fbf1811c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:32.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.885+0000 7fbf177fe700 1 --2- 172.21.15.40:0/729012462 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf00003ff0 0x7fbf1811c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.885+0000 7fbf177fe700 1 -- 172.21.15.40:0/729012462 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1809e420 con 0x7fbf1806a6d0 2023-09-30T22:27:32.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.885+0000 7fbf1ca47700 1 --2- 172.21.15.40:0/729012462 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf1806afe0 0x7fbf1811cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:32.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.885+0000 7fbf177fe700 1 --2- 172.21.15.40:0/729012462 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf1806a6d0 0x7fbf1811c630 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fbf1809e970 tx=0x7fbf0c0075f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:32.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.885+0000 7fbf14ff9700 1 -- 172.21.15.40:0/729012462 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c00f720 con 0x7fbf1806a6d0 2023-09-30T22:27:32.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.885+0000 7fbf14ff9700 1 -- 172.21.15.40:0/729012462 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0c00f880 con 0x7fbf1806a6d0 2023-09-30T22:27:32.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.885+0000 7fbf1e4aa700 1 -- 172.21.15.40:0/729012462 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf1811dd00 con 0x7fbf1806a6d0 2023-09-30T22:27:32.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.885+0000 7fbf14ff9700 1 -- 172.21.15.40:0/729012462 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c00fbf0 con 0x7fbf1806a6d0 2023-09-30T22:27:32.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.886+0000 7fbf1e4aa700 1 -- 172.21.15.40:0/729012462 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf18120110 con 0x7fbf1806a6d0 2023-09-30T22:27:32.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.886+0000 7fbf14ff9700 1 -- 172.21.15.40:0/729012462 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbf0c00fd50 con 0x7fbf1806a6d0 2023-09-30T22:27:32.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.886+0000 7fbf14ff9700 1 -- 172.21.15.40:0/729012462 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fbf0c03f720 con 0x7fbf1806a6d0 2023-09-30T22:27:32.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.886+0000 7fbefe7fc700 1 -- 172.21.15.40:0/729012462 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf1811f5d0 con 0x7fbf1806a6d0 2023-09-30T22:27:32.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.891+0000 7fbf14ff9700 1 -- 172.21.15.40:0/729012462 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbf1811f5d0 con 0x7fbf1806a6d0 2023-09-30T22:27:32.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.922+0000 7f91748a4700 1 Processor -- start 2023-09-30T22:27:32.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.923+0000 7f91748a4700 1 -- start start 2023-09-30T22:27:32.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.923+0000 7f91748a4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f917009d920 0x7f917009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:32.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.923+0000 7f91748a4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f917009e230 0x7f91701343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:32.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.923+0000 7f91748a4700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f917009f940 con 0x7f917009f0f0 2023-09-30T22:27:32.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.923+0000 7f91748a4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f917006b4c0 con 0x7f917009d920 2023-09-30T22:27:32.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.923+0000 7f91748a4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f917009a8f0 con 0x7f917009e230 2023-09-30T22:27:32.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.924+0000 7f916e59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f917009d920 0x7f917009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:32.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.924+0000 7f916e59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f917009d920 0x7f917009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60032/0 (socket says 172.21.15.40:60032) 2023-09-30T22:27:32.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.924+0000 7f916e59c700 1 -- 172.21.15.40:0/4080064140 learned_addr learned my addr 172.21.15.40:0/4080064140 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:32.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.924+0000 7f916ed9d700 1 --2- 172.21.15.40:0/4080064140 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f917009e230 0x7f91701343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:32.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.924+0000 7f916e59c700 1 -- 172.21.15.40:0/4080064140 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f917009e230 msgr2=0x7f91701343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:32.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.924+0000 7f916e59c700 1 --2- 172.21.15.40:0/4080064140 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f917009e230 0x7f91701343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.924+0000 7f916e59c700 1 -- 172.21.15.40:0/4080064140 >> v1:172.21.15.40:6789/0 conn(0x7f917009f0f0 legacy=0x7f9170133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:32.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.924+0000 7f916e59c700 1 -- 172.21.15.40:0/4080064140 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f917009f6e0 con 0x7f917009d920 2023-09-30T22:27:32.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.924+0000 7f916e59c700 1 --2- 172.21.15.40:0/4080064140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f917009d920 0x7f917009dcf0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f9160006fd0 tx=0x7f9160009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3bbde1af6f8b9f2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:32.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.924+0000 7f916d59a700 1 -- 172.21.15.40:0/4080064140 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9160005e30 con 0x7f917009d920 2023-09-30T22:27:32.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.924+0000 7f916d59a700 1 -- 172.21.15.40:0/4080064140 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9160004030 con 0x7f917009d920 2023-09-30T22:27:32.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.924+0000 7f916d59a700 1 -- 172.21.15.40:0/4080064140 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91600043e0 con 0x7f917009d920 2023-09-30T22:27:32.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.925+0000 7f91748a4700 1 -- 172.21.15.40:0/4080064140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f917009d920 msgr2=0x7f917009dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:32.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.925+0000 7f91748a4700 1 --2- 172.21.15.40:0/4080064140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f917009d920 0x7f917009dcf0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f9160006fd0 tx=0x7f9160009bd0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.925+0000 7f91748a4700 1 -- 172.21.15.40:0/4080064140 shutdown_connections 2023-09-30T22:27:32.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.925+0000 7f91748a4700 1 --2- 172.21.15.40:0/4080064140 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f917009e230 0x7f91701343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.925+0000 7f91748a4700 1 --2- 172.21.15.40:0/4080064140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f917009d920 0x7f917009dcf0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.925+0000 7f91748a4700 1 -- 172.21.15.40:0/4080064140 >> 172.21.15.40:0/4080064140 conn(0x7f917009fb20 msgr2=0x7f917009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:32.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.925+0000 7f91748a4700 1 -- 172.21.15.40:0/4080064140 shutdown_connections 2023-09-30T22:27:32.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.925+0000 7f91748a4700 1 -- 172.21.15.40:0/4080064140 wait complete. 2023-09-30T22:27:32.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.927+0000 7f91748a4700 1 Processor -- start 2023-09-30T22:27:32.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.927+0000 7f91748a4700 1 -- start start 2023-09-30T22:27:32.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.927+0000 7f91748a4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f917009d920 0x7f91701a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:32.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.927+0000 7f91748a4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f917009e230 0x7f91701a6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:32.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.927+0000 7f91748a4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91701b9540 0x7f91701a6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:32.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.927+0000 7f91748a4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91701a7610 con 0x7f91701b9540 2023-09-30T22:27:32.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.927+0000 7f91748a4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91701a94e0 con 0x7f917009e230 2023-09-30T22:27:32.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.927+0000 7f91748a4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91701aa630 con 0x7f917009d920 2023-09-30T22:27:32.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.927+0000 7f916ed9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91701b9540 0x7f91701a6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:32.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.927+0000 7f916ed9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91701b9540 0x7f91701a6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60042/0 (socket says 172.21.15.40:60042) 2023-09-30T22:27:32.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.927+0000 7f916ed9d700 1 -- 172.21.15.40:0/3799849089 learned_addr learned my addr 172.21.15.40:0/3799849089 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:32.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.927+0000 7f916dd9b700 1 --2- 172.21.15.40:0/3799849089 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f917009e230 0x7f91701a6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:32.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.927+0000 7f916e59c700 1 --2- 172.21.15.40:0/3799849089 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f917009d920 0x7f91701a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:32.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.928+0000 7f916ed9d700 1 -- 172.21.15.40:0/3799849089 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f917009d920 msgr2=0x7f91701a61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:32.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.928+0000 7f916ed9d700 1 --2- 172.21.15.40:0/3799849089 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f917009d920 0x7f91701a61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.928+0000 7f916ed9d700 1 -- 172.21.15.40:0/3799849089 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f917009e230 msgr2=0x7f91701a6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:32.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.928+0000 7f916ed9d700 1 --2- 172.21.15.40:0/3799849089 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f917009e230 0x7f91701a6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.928+0000 7f916ed9d700 1 -- 172.21.15.40:0/3799849089 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9160009500 con 0x7f91701b9540 2023-09-30T22:27:32.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.928+0000 7f916e59c700 1 --2- 172.21.15.40:0/3799849089 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f917009d920 0x7f91701a61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:32.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.928+0000 7f916ed9d700 1 --2- 172.21.15.40:0/3799849089 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91701b9540 0x7f91701a6c50 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f916800efc0 tx=0x7f916800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:32.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.928+0000 7f915effd700 1 -- 172.21.15.40:0/3799849089 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9168009ea0 con 0x7f91701b9540 2023-09-30T22:27:32.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.928+0000 7f91748a4700 1 -- 172.21.15.40:0/3799849089 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91701a7e00 con 0x7f91701b9540 2023-09-30T22:27:32.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.928+0000 7f915effd700 1 -- 172.21.15.40:0/3799849089 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916800f040 con 0x7f91701b9540 2023-09-30T22:27:32.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.928+0000 7f915effd700 1 -- 172.21.15.40:0/3799849089 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916800ced0 con 0x7f91701b9540 2023-09-30T22:27:32.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.928+0000 7f91748a4700 1 -- 172.21.15.40:0/3799849089 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f917009c9e0 con 0x7f91701b9540 2023-09-30T22:27:32.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.929+0000 7f91748a4700 1 -- 172.21.15.40:0/3799849089 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9170062380 con 0x7f91701b9540 2023-09-30T22:27:32.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.929+0000 7f915effd700 1 -- 172.21.15.40:0/3799849089 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9168014480 con 0x7f91701b9540 2023-09-30T22:27:32.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.930+0000 7f915effd700 1 -- 172.21.15.40:0/3799849089 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f91680402f0 con 0x7f91701b9540 2023-09-30T22:27:32.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.938+0000 7f915effd700 1 -- 172.21.15.40:0/3799849089 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9168007920 con 0x7f91701b9540 2023-09-30T22:27:32.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.989+0000 7f6ba1baf700 1 Processor -- start 2023-09-30T22:27:32.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.989+0000 7f6ba1baf700 1 -- start start 2023-09-30T22:27:32.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.989+0000 7f6ba1baf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b9c13b130 0x7f6b9c13d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:32.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.989+0000 7f6ba1baf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6b9c13da50 0x7f6b9c13fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:32.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.989+0000 7f6ba1baf700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b9c137e20 con 0x7f6b9c138250 2023-09-30T22:27:32.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.989+0000 7f6ba1baf700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b9c138d30 con 0x7f6b9c13da50 2023-09-30T22:27:32.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.989+0000 7f6ba1baf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9c138050 con 0x7f6b9c13b130 2023-09-30T22:27:32.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.990+0000 7f6b9affd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b9c13b130 0x7f6b9c13d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:32.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.990+0000 7f6b9affd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b9c13b130 0x7f6b9c13d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55754/0 (socket says 172.21.15.40:55754) 2023-09-30T22:27:32.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.990+0000 7f6b9affd700 1 -- 172.21.15.40:0/64009776 learned_addr learned my addr 172.21.15.40:0/64009776 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:32.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.990+0000 7f6b9bfff700 1 --2- 172.21.15.40:0/64009776 >> v2:172.21.15.40:3300/0 conn(0x7f6b9c13da50 0x7f6b9c13fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:32.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.990+0000 7f6b9affd700 1 -- 172.21.15.40:0/64009776 >> v2:172.21.15.40:3300/0 conn(0x7f6b9c13da50 msgr2=0x7f6b9c13fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:32.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.990+0000 7f6b9affd700 1 --2- 172.21.15.40:0/64009776 >> v2:172.21.15.40:3300/0 conn(0x7f6b9c13da50 0x7f6b9c13fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.990+0000 7f6b9affd700 1 -- 172.21.15.40:0/64009776 >> v1:172.21.15.40:6789/0 conn(0x7f6b9c138250 legacy=0x7f6b9c138620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:32.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.990+0000 7f6b9affd700 1 -- 172.21.15.40:0/64009776 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9c09b010 con 0x7f6b9c13b130 2023-09-30T22:27:32.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.990+0000 7f6b9affd700 1 --2- 172.21.15.40:0/64009776 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b9c13b130 0x7f6b9c13d510 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009920 tx=0x7f6b90009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8fe21d984cbe6e9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:32.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.990+0000 7f6b9a7fc700 1 -- 172.21.15.40:0/64009776 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b90011830 con 0x7f6b9c13b130 2023-09-30T22:27:32.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.990+0000 7f6b9a7fc700 1 -- 172.21.15.40:0/64009776 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b90011990 con 0x7f6b9c13b130 2023-09-30T22:27:32.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.990+0000 7f6b9a7fc700 1 -- 172.21.15.40:0/64009776 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b90011d20 con 0x7f6b9c13b130 2023-09-30T22:27:32.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.991+0000 7f6ba1baf700 1 -- 172.21.15.40:0/64009776 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b9c13b130 msgr2=0x7f6b9c13d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:32.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.991+0000 7f6ba1baf700 1 --2- 172.21.15.40:0/64009776 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b9c13b130 0x7f6b9c13d510 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009920 tx=0x7f6b90009c30 comp rx=0 tx=0).stop 2023-09-30T22:27:32.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.991+0000 7f6ba1baf700 1 -- 172.21.15.40:0/64009776 shutdown_connections 2023-09-30T22:27:32.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.991+0000 7f6ba1baf700 1 --2- 172.21.15.40:0/64009776 >> v2:172.21.15.40:3300/0 conn(0x7f6b9c13da50 0x7f6b9c13fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.991+0000 7f6ba1baf700 1 --2- 172.21.15.40:0/64009776 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b9c13b130 0x7f6b9c13d510 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.991+0000 7f6ba1baf700 1 -- 172.21.15.40:0/64009776 >> 172.21.15.40:0/64009776 conn(0x7f6b9c0a2a00 msgr2=0x7f6b9c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:32.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.991+0000 7f6ba1baf700 1 -- 172.21.15.40:0/64009776 shutdown_connections 2023-09-30T22:27:32.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.991+0000 7f6ba1baf700 1 -- 172.21.15.40:0/64009776 wait complete. 2023-09-30T22:27:32.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.993+0000 7f6ba1baf700 1 Processor -- start 2023-09-30T22:27:32.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.993+0000 7f6ba1baf700 1 -- start start 2023-09-30T22:27:32.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.993+0000 7f6ba1baf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b9c138250 0x7f6b9c06d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:32.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.993+0000 7f6ba1baf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b9c13b130 0x7f6b9c06db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:32.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.993+0000 7f6ba1baf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b9c13da50 0x7f6b9c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:32.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.993+0000 7f6ba1baf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9c070650 con 0x7f6b9c138250 2023-09-30T22:27:32.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.993+0000 7f6ba1baf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9c06f990 con 0x7f6b9c13b130 2023-09-30T22:27:32.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.993+0000 7f6ba1baf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9c06fc70 con 0x7f6b9c13da50 2023-09-30T22:27:32.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.993+0000 7f6b9b7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b9c138250 0x7f6b9c06d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:32.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.993+0000 7f6b9b7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b9c138250 0x7f6b9c06d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60058/0 (socket says 172.21.15.40:60058) 2023-09-30T22:27:32.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.993+0000 7f6b9b7fe700 1 -- 172.21.15.40:0/3522056360 learned_addr learned my addr 172.21.15.40:0/3522056360 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:32.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.993+0000 7f6b9bfff700 1 --2- 172.21.15.40:0/3522056360 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b9c13da50 0x7f6b9c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:32.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.994+0000 7f6b9affd700 1 --2- 172.21.15.40:0/3522056360 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b9c13b130 0x7f6b9c06db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:32.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.994+0000 7f6b9bfff700 1 -- 172.21.15.40:0/3522056360 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b9c13b130 msgr2=0x7f6b9c06db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:32.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.994+0000 7f6b9bfff700 1 --2- 172.21.15.40:0/3522056360 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b9c13b130 0x7f6b9c06db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.994+0000 7f6b9bfff700 1 -- 172.21.15.40:0/3522056360 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b9c138250 msgr2=0x7f6b9c06d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:32.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.994+0000 7f6b9bfff700 1 --2- 172.21.15.40:0/3522056360 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b9c138250 0x7f6b9c06d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.994+0000 7f6b9bfff700 1 -- 172.21.15.40:0/3522056360 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b90009550 con 0x7f6b9c13da50 2023-09-30T22:27:32.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.994+0000 7f6b9b7fe700 1 --2- 172.21.15.40:0/3522056360 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b9c138250 0x7f6b9c06d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:32.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.994+0000 7f6b9bfff700 1 --2- 172.21.15.40:0/3522056360 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b9c13da50 0x7f6b9c06e090 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6b9400efc0 tx=0x7f6b9400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:32.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.994+0000 7f6b83fff700 1 -- 172.21.15.40:0/3522056360 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9400cc90 con 0x7f6b9c13da50 2023-09-30T22:27:32.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.994+0000 7f6b83fff700 1 -- 172.21.15.40:0/3522056360 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9400f040 con 0x7f6b9c13da50 2023-09-30T22:27:32.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.994+0000 7f6b83fff700 1 -- 172.21.15.40:0/3522056360 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b94009e60 con 0x7f6b9c13da50 2023-09-30T22:27:32.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.994+0000 7f6ba1baf700 1 -- 172.21.15.40:0/3522056360 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b9c09a300 con 0x7f6b9c13da50 2023-09-30T22:27:32.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.994+0000 7f6ba1baf700 1 -- 172.21.15.40:0/3522056360 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b9c06f6d0 con 0x7f6b9c13da50 2023-09-30T22:27:32.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.995+0000 7f6ba1baf700 1 -- 172.21.15.40:0/3522056360 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b9c062380 con 0x7f6b9c13da50 2023-09-30T22:27:32.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.996+0000 7f6b83fff700 1 -- 172.21.15.40:0/3522056360 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6b94014480 con 0x7f6b9c13da50 2023-09-30T22:27:32.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:32.996+0000 7f6b83fff700 1 -- 172.21.15.40:0/3522056360 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6b940407b0 con 0x7f6b9c13da50 2023-09-30T22:27:33.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.005+0000 7f6b83fff700 1 -- 172.21.15.40:0/3522056360 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6b94012930 con 0x7f6b9c13da50 2023-09-30T22:27:33.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.030+0000 7febb341e700 1 Processor -- start 2023-09-30T22:27:33.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.030+0000 7febb341e700 1 -- start start 2023-09-30T22:27:33.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.030+0000 7febb341e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febac09d920 0x7febac09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:33.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.030+0000 7febb341e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febac09f0f0 0x7febac09e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:33.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.030+0000 7febb341e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febac09f940 con 0x7febac133ca0 2023-09-30T22:27:33.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.030+0000 7febb341e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febac06b4c0 con 0x7febac09d920 2023-09-30T22:27:33.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.030+0000 7febb341e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febac09a8f0 con 0x7febac09f0f0 2023-09-30T22:27:33.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.031+0000 7febb09b9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febac09f0f0 0x7febac09e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:33.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.031+0000 7febb09b9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febac09f0f0 0x7febac09e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55774/0 (socket says 172.21.15.40:55774) 2023-09-30T22:27:33.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.031+0000 7febb09b9700 1 -- 172.21.15.40:0/519699626 learned_addr learned my addr 172.21.15.40:0/519699626 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:33.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.031+0000 7febb19bb700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7febac133ca0 0x7febac134140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56652/0 (socket says 172.21.15.40:56652) 2023-09-30T22:27:33.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.031+0000 7febb11ba700 1 --2- 172.21.15.40:0/519699626 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febac09d920 0x7febac09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:33.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.031+0000 7febb09b9700 1 -- 172.21.15.40:0/519699626 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febac09d920 msgr2=0x7febac09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:33.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.031+0000 7febb09b9700 1 --2- 172.21.15.40:0/519699626 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febac09d920 0x7febac09dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.031+0000 7febb09b9700 1 -- 172.21.15.40:0/519699626 >> v1:172.21.15.40:6789/0 conn(0x7febac133ca0 legacy=0x7febac134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:33.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.031+0000 7febb09b9700 1 -- 172.21.15.40:0/519699626 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febac09f6e0 con 0x7febac09f0f0 2023-09-30T22:27:33.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.031+0000 7febb09b9700 1 --2- 172.21.15.40:0/519699626 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febac09f0f0 0x7febac09e230 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7feb9c009950 tx=0x7feb9c009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6e01a598a477b7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:33.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.031+0000 7feba3fff700 1 -- 172.21.15.40:0/519699626 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c011830 con 0x7febac09f0f0 2023-09-30T22:27:33.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.031+0000 7feba3fff700 1 -- 172.21.15.40:0/519699626 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9c011990 con 0x7febac09f0f0 2023-09-30T22:27:33.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.031+0000 7feba3fff700 1 -- 172.21.15.40:0/519699626 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c011d40 con 0x7febac09f0f0 2023-09-30T22:27:33.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.032+0000 7febb341e700 1 -- 172.21.15.40:0/519699626 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febac09f0f0 msgr2=0x7febac09e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:33.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.032+0000 7febb341e700 1 --2- 172.21.15.40:0/519699626 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febac09f0f0 0x7febac09e230 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7feb9c009950 tx=0x7feb9c009c60 comp rx=0 tx=0).stop 2023-09-30T22:27:33.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.032+0000 7febb341e700 1 -- 172.21.15.40:0/519699626 shutdown_connections 2023-09-30T22:27:33.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.032+0000 7febb341e700 1 --2- 172.21.15.40:0/519699626 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febac09d920 0x7febac09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.032+0000 7febb341e700 1 --2- 172.21.15.40:0/519699626 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febac09f0f0 0x7febac09e230 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.032+0000 7febb341e700 1 -- 172.21.15.40:0/519699626 >> 172.21.15.40:0/519699626 conn(0x7febac09fb20 msgr2=0x7febac09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:33.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.032+0000 7febb341e700 1 -- 172.21.15.40:0/519699626 shutdown_connections 2023-09-30T22:27:33.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.032+0000 7febb341e700 1 -- 172.21.15.40:0/519699626 wait complete. 2023-09-30T22:27:33.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.034+0000 7febb341e700 1 Processor -- start 2023-09-30T22:27:33.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.034+0000 7febb341e700 1 -- start start 2023-09-30T22:27:33.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.034+0000 7febb341e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febac09d920 0x7febac1204b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:33.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.035+0000 7febb341e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febac133ca0 0x7febac1209f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:33.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.035+0000 7febb341e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febac124410 0x7febac120f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:33.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.035+0000 7febb341e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac122000 con 0x7febac124410 2023-09-30T22:27:33.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.035+0000 7febb341e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febac09c9e0 con 0x7febac133ca0 2023-09-30T22:27:33.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.035+0000 7febb341e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febac123c30 con 0x7febac09d920 2023-09-30T22:27:33.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.035+0000 7febb11ba700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febac09d920 0x7febac1204b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:33.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.035+0000 7febb11ba700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febac09d920 0x7febac1204b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55786/0 (socket says 172.21.15.40:55786) 2023-09-30T22:27:33.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.035+0000 7febb11ba700 1 -- 172.21.15.40:0/2178167841 learned_addr learned my addr 172.21.15.40:0/2178167841 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:33.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.035+0000 7febb19bb700 1 --2- 172.21.15.40:0/2178167841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febac124410 0x7febac120f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:33.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.035+0000 7febb09b9700 1 --2- 172.21.15.40:0/2178167841 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febac133ca0 0x7febac1209f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:33.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.035+0000 7febb11ba700 1 -- 172.21.15.40:0/2178167841 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febac133ca0 msgr2=0x7febac1209f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:33.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.035+0000 7febb11ba700 1 --2- 172.21.15.40:0/2178167841 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febac133ca0 0x7febac1209f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.035+0000 7febb11ba700 1 -- 172.21.15.40:0/2178167841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febac124410 msgr2=0x7febac120f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:33.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.035+0000 7febb11ba700 1 --2- 172.21.15.40:0/2178167841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febac124410 0x7febac120f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.035+0000 7febb11ba700 1 -- 172.21.15.40:0/2178167841 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9c009550 con 0x7febac09d920 2023-09-30T22:27:33.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.035+0000 7febb19bb700 1 --2- 172.21.15.40:0/2178167841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febac124410 0x7febac120f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:33.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.035+0000 7febb11ba700 1 --2- 172.21.15.40:0/2178167841 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febac09d920 0x7febac1204b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7feba800e900 tx=0x7feba800ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:33.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.036+0000 7feba1ffb700 1 -- 172.21.15.40:0/2178167841 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba8009650 con 0x7febac09d920 2023-09-30T22:27:33.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.036+0000 7feba1ffb700 1 -- 172.21.15.40:0/2178167841 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba800c850 con 0x7febac09d920 2023-09-30T22:27:33.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.036+0000 7febb341e700 1 -- 172.21.15.40:0/2178167841 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febac0a2880 con 0x7febac09d920 2023-09-30T22:27:33.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.036+0000 7febb341e700 1 -- 172.21.15.40:0/2178167841 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febac1236a0 con 0x7febac09d920 2023-09-30T22:27:33.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.036+0000 7feba1ffb700 1 -- 172.21.15.40:0/2178167841 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba800cbc0 con 0x7febac09d920 2023-09-30T22:27:33.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.037+0000 7febb341e700 1 -- 172.21.15.40:0/2178167841 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb8c0052e0 con 0x7febac09d920 2023-09-30T22:27:33.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.037+0000 7feba1ffb700 1 -- 172.21.15.40:0/2178167841 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feba800cd20 con 0x7febac09d920 2023-09-30T22:27:33.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.037+0000 7feba1ffb700 1 -- 172.21.15.40:0/2178167841 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7feba803fc20 con 0x7febac09d920 2023-09-30T22:27:33.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.046+0000 7feba1ffb700 1 -- 172.21.15.40:0/2178167841 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feba801b3b0 con 0x7febac09d920 2023-09-30T22:27:33.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.100+0000 7fbefe7fc700 1 -- 172.21.15.40:0/729012462 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbf1811f5d0 con 0x7fbf1806a6d0 2023-09-30T22:27:33.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.101+0000 7fbf14ff9700 1 -- 172.21.15.40:0/729012462 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbf1811f5d0 con 0x7fbf1806a6d0 2023-09-30T22:27:33.101 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:33.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.103+0000 7fbefe7fc700 1 -- 172.21.15.40:0/729012462 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf1806a6d0 msgr2=0x7fbf1811c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:33.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.103+0000 7fbefe7fc700 1 --2- 172.21.15.40:0/729012462 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf1806a6d0 0x7fbf1811c630 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fbf1809e970 tx=0x7fbf0c0075f0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.103+0000 7fbefe7fc700 1 -- 172.21.15.40:0/729012462 shutdown_connections 2023-09-30T22:27:33.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.103+0000 7fbefe7fc700 1 --2- 172.21.15.40:0/729012462 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf1806afe0 0x7fbf1811cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.103+0000 7fbefe7fc700 1 --2- 172.21.15.40:0/729012462 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf00003ff0 0x7fbf1811c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.103+0000 7fbefe7fc700 1 --2- 172.21.15.40:0/729012462 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf1806a6d0 0x7fbf1811c630 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.103+0000 7fbefe7fc700 1 -- 172.21.15.40:0/729012462 >> 172.21.15.40:0/729012462 conn(0x7fbf1809fb20 msgr2=0x7fbf18131120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:33.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.104+0000 7fbefe7fc700 1 -- 172.21.15.40:0/729012462 shutdown_connections 2023-09-30T22:27:33.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.104+0000 7fbefe7fc700 1 -- 172.21.15.40:0/729012462 wait complete. 2023-09-30T22:27:33.116 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:33.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.148+0000 7f91748a4700 1 -- 172.21.15.40:0/3799849089 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9170074720 con 0x7f91701b9540 2023-09-30T22:27:33.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.149+0000 7f915effd700 1 -- 172.21.15.40:0/3799849089 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9168018020 con 0x7f91701b9540 2023-09-30T22:27:33.149 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:33.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.151+0000 7f91748a4700 1 -- 172.21.15.40:0/3799849089 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91701b9540 msgr2=0x7f91701a6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:33.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.151+0000 7f91748a4700 1 --2- 172.21.15.40:0/3799849089 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91701b9540 0x7f91701a6c50 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f916800efc0 tx=0x7f916800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.151+0000 7f91748a4700 1 -- 172.21.15.40:0/3799849089 shutdown_connections 2023-09-30T22:27:33.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.151+0000 7f91748a4700 1 --2- 172.21.15.40:0/3799849089 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f917009d920 0x7f91701a61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.151+0000 7f91748a4700 1 --2- 172.21.15.40:0/3799849089 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91701b9540 0x7f91701a6c50 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.151+0000 7f91748a4700 1 --2- 172.21.15.40:0/3799849089 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f917009e230 0x7f91701a6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.151+0000 7f91748a4700 1 -- 172.21.15.40:0/3799849089 >> 172.21.15.40:0/3799849089 conn(0x7f917009fb20 msgr2=0x7f91701bb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:33.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.151+0000 7f91748a4700 1 -- 172.21.15.40:0/3799849089 shutdown_connections 2023-09-30T22:27:33.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.151+0000 7f91748a4700 1 -- 172.21.15.40:0/3799849089 wait complete. 2023-09-30T22:27:33.163 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:33.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.205+0000 7f6ba1baf700 1 -- 172.21.15.40:0/3522056360 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6b9c06fad0 con 0x7f6b9c13da50 2023-09-30T22:27:33.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.206+0000 7f6b83fff700 1 -- 172.21.15.40:0/3522056360 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6b9c06fad0 con 0x7f6b9c13da50 2023-09-30T22:27:33.206 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:33.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.208+0000 7f6ba1baf700 1 -- 172.21.15.40:0/3522056360 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b9c13da50 msgr2=0x7f6b9c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:33.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.208+0000 7f6ba1baf700 1 --2- 172.21.15.40:0/3522056360 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b9c13da50 0x7f6b9c06e090 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6b9400efc0 tx=0x7f6b9400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.208+0000 7f6ba1baf700 1 -- 172.21.15.40:0/3522056360 shutdown_connections 2023-09-30T22:27:33.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.208+0000 7f6ba1baf700 1 --2- 172.21.15.40:0/3522056360 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b9c13da50 0x7f6b9c06e090 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.208+0000 7f6ba1baf700 1 --2- 172.21.15.40:0/3522056360 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b9c138250 0x7f6b9c06d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.208+0000 7f6ba1baf700 1 --2- 172.21.15.40:0/3522056360 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b9c13b130 0x7f6b9c06db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.208+0000 7f6ba1baf700 1 -- 172.21.15.40:0/3522056360 >> 172.21.15.40:0/3522056360 conn(0x7f6b9c0a2a00 msgr2=0x7f6b9c09d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:33.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.208+0000 7f6ba1baf700 1 -- 172.21.15.40:0/3522056360 shutdown_connections 2023-09-30T22:27:33.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.208+0000 7f6ba1baf700 1 -- 172.21.15.40:0/3522056360 wait complete. 2023-09-30T22:27:33.220 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:33.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.245+0000 7febb341e700 1 -- 172.21.15.40:0/2178167841 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7feb8c005590 con 0x7febac09d920 2023-09-30T22:27:33.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.245+0000 7feba1ffb700 1 -- 172.21.15.40:0/2178167841 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feba8021020 con 0x7febac09d920 2023-09-30T22:27:33.245 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:33.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.247+0000 7febb341e700 1 -- 172.21.15.40:0/2178167841 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febac09d920 msgr2=0x7febac1204b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:33.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.247+0000 7febb341e700 1 --2- 172.21.15.40:0/2178167841 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febac09d920 0x7febac1204b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7feba800e900 tx=0x7feba800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.247+0000 7febb341e700 1 -- 172.21.15.40:0/2178167841 shutdown_connections 2023-09-30T22:27:33.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.247+0000 7febb341e700 1 --2- 172.21.15.40:0/2178167841 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febac09d920 0x7febac1204b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.247+0000 7febb341e700 1 --2- 172.21.15.40:0/2178167841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febac124410 0x7febac120f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.247+0000 7febb341e700 1 --2- 172.21.15.40:0/2178167841 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febac133ca0 0x7febac1209f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.247+0000 7febb341e700 1 -- 172.21.15.40:0/2178167841 >> 172.21.15.40:0/2178167841 conn(0x7febac09fb20 msgr2=0x7febac1bb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:33.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.247+0000 7febb341e700 1 -- 172.21.15.40:0/2178167841 shutdown_connections 2023-09-30T22:27:33.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:33.247+0000 7febb341e700 1 -- 172.21.15.40:0/2178167841 wait complete. 2023-09-30T22:27:33.259 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:34.118 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:34.164 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:34.222 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:34.260 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:34.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.262+0000 7f8c55416700 1 Processor -- start 2023-09-30T22:27:34.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.262+0000 7f8c55416700 1 -- start start 2023-09-30T22:27:34.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.263+0000 7f8c55416700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c5009d920 0x7f8c5009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.263+0000 7f8c55416700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c5009e230 0x7f8c501308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.263+0000 7f8c55416700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8c50130de0 0x7f8c50131280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.263+0000 7f8c55416700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c5009edf0 con 0x7f8c50130de0 2023-09-30T22:27:34.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.263+0000 7f8c55416700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5009adf0 con 0x7f8c5009e230 2023-09-30T22:27:34.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.263+0000 7f8c55416700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5009b660 con 0x7f8c5009d920 2023-09-30T22:27:34.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.263+0000 7f8c4e7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c5009e230 0x7f8c501308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:34.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.263+0000 7f8c4e7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c5009e230 0x7f8c501308a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48118/0 (socket says 172.21.15.40:48118) 2023-09-30T22:27:34.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.263+0000 7f8c4e7fc700 1 -- 172.21.15.40:0/336887185 learned_addr learned my addr 172.21.15.40:0/336887185 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:34.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.263+0000 7f8c4effd700 1 --2- 172.21.15.40:0/336887185 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c5009d920 0x7f8c5009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:34.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.263+0000 7f8c4f7fe700 1 --2- 172.21.15.40:0/336887185 >> v2:172.21.15.40:3300/0 conn(0x7f8c50130de0 0x7f8c50131280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:34.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.263+0000 7f8c4e7fc700 1 -- 172.21.15.40:0/336887185 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c5009d920 msgr2=0x7f8c5009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:34.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.263+0000 7f8c4e7fc700 1 --2- 172.21.15.40:0/336887185 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c5009d920 0x7f8c5009dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.263+0000 7f8c4e7fc700 1 -- 172.21.15.40:0/336887185 >> v2:172.21.15.40:3300/0 conn(0x7f8c50130de0 msgr2=0x7f8c50131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:34.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.263+0000 7f8c4e7fc700 1 --2- 172.21.15.40:0/336887185 >> v2:172.21.15.40:3300/0 conn(0x7f8c50130de0 0x7f8c50131280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.263+0000 7f8c4e7fc700 1 -- 172.21.15.40:0/336887185 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5009a6e0 con 0x7f8c5009e230 2023-09-30T22:27:34.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.263+0000 7f8c4e7fc700 1 --2- 172.21.15.40:0/336887185 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c5009e230 0x7f8c501308a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8c4400b9a0 tx=0x7f8c4400bcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2585b14c429ddcb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:34.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.264+0000 7f8c4dffb700 1 -- 172.21.15.40:0/336887185 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4400caa0 con 0x7f8c5009e230 2023-09-30T22:27:34.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.264+0000 7f8c4dffb700 1 -- 172.21.15.40:0/336887185 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c4400cc00 con 0x7f8c5009e230 2023-09-30T22:27:34.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.264+0000 7f8c4dffb700 1 -- 172.21.15.40:0/336887185 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4400f460 con 0x7f8c5009e230 2023-09-30T22:27:34.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.265+0000 7f8c55416700 1 -- 172.21.15.40:0/336887185 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c5009e230 msgr2=0x7f8c501308a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:34.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.265+0000 7f8c55416700 1 --2- 172.21.15.40:0/336887185 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c5009e230 0x7f8c501308a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8c4400b9a0 tx=0x7f8c4400bcb0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.265+0000 7f8c55416700 1 -- 172.21.15.40:0/336887185 shutdown_connections 2023-09-30T22:27:34.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.265+0000 7f8c55416700 1 --2- 172.21.15.40:0/336887185 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c5009d920 0x7f8c5009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.265+0000 7f8c55416700 1 --2- 172.21.15.40:0/336887185 >> v2:172.21.15.40:3300/0 conn(0x7f8c50130de0 0x7f8c50131280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.265+0000 7f8c55416700 1 --2- 172.21.15.40:0/336887185 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c5009e230 0x7f8c501308a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.265+0000 7f8c55416700 1 -- 172.21.15.40:0/336887185 >> 172.21.15.40:0/336887185 conn(0x7f8c5009fb20 msgr2=0x7f8c5009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:34.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.265+0000 7f8c55416700 1 -- 172.21.15.40:0/336887185 shutdown_connections 2023-09-30T22:27:34.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.265+0000 7f8c55416700 1 -- 172.21.15.40:0/336887185 wait complete. 2023-09-30T22:27:34.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.266+0000 7f8c55416700 1 Processor -- start 2023-09-30T22:27:34.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.266+0000 7f8c55416700 1 -- start start 2023-09-30T22:27:34.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.267+0000 7f8c55416700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c5009d920 0x7f8c501c4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.267+0000 7f8c55416700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c5009e230 0x7f8c501c4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.267+0000 7f8c55416700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c50130de0 0x7f8c50119730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.267+0000 7f8c55416700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5011ca90 con 0x7f8c5009e230 2023-09-30T22:27:34.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.267+0000 7f8c55416700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c501c3fd0 con 0x7f8c50130de0 2023-09-30T22:27:34.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.267+0000 7f8c55416700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c501c4ec0 con 0x7f8c5009d920 2023-09-30T22:27:34.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.267+0000 7f8c4f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c50130de0 0x7f8c50119730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:34.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.267+0000 7f8c4f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c50130de0 0x7f8c50119730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48128/0 (socket says 172.21.15.40:48128) 2023-09-30T22:27:34.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.267+0000 7f8c4f7fe700 1 -- 172.21.15.40:0/2501506786 learned_addr learned my addr 172.21.15.40:0/2501506786 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:34.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.268+0000 7f8c4e7fc700 1 --2- 172.21.15.40:0/2501506786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c5009e230 0x7f8c501c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:34.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.268+0000 7f8c4effd700 1 --2- 172.21.15.40:0/2501506786 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c5009d920 0x7f8c501c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:34.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.268+0000 7f8c4f7fe700 1 -- 172.21.15.40:0/2501506786 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c5009d920 msgr2=0x7f8c501c4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:34.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.268+0000 7f8c4f7fe700 1 --2- 172.21.15.40:0/2501506786 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c5009d920 0x7f8c501c4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.268+0000 7f8c4f7fe700 1 -- 172.21.15.40:0/2501506786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c5009e230 msgr2=0x7f8c501c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:34.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.268+0000 7f8c4f7fe700 1 --2- 172.21.15.40:0/2501506786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c5009e230 0x7f8c501c4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.268+0000 7f8c4f7fe700 1 -- 172.21.15.40:0/2501506786 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c4400b600 con 0x7f8c50130de0 2023-09-30T22:27:34.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.268+0000 7f8c4f7fe700 1 --2- 172.21.15.40:0/2501506786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c50130de0 0x7f8c50119730 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8c480117b0 tx=0x7f8c48011ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:34.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.268+0000 7f8c377fe700 1 -- 172.21.15.40:0/2501506786 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c48013020 con 0x7f8c50130de0 2023-09-30T22:27:34.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.268+0000 7f8c377fe700 1 -- 172.21.15.40:0/2501506786 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c48013180 con 0x7f8c50130de0 2023-09-30T22:27:34.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.268+0000 7f8c55416700 1 -- 172.21.15.40:0/2501506786 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c5009cb60 con 0x7f8c50130de0 2023-09-30T22:27:34.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.268+0000 7f8c377fe700 1 -- 172.21.15.40:0/2501506786 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c480108a0 con 0x7f8c50130de0 2023-09-30T22:27:34.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.268+0000 7f8c55416700 1 -- 172.21.15.40:0/2501506786 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c5011b540 con 0x7f8c50130de0 2023-09-30T22:27:34.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.270+0000 7f8c55416700 1 -- 172.21.15.40:0/2501506786 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c5011c210 con 0x7f8c50130de0 2023-09-30T22:27:34.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.270+0000 7f8c377fe700 1 -- 172.21.15.40:0/2501506786 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8c48010a00 con 0x7f8c50130de0 2023-09-30T22:27:34.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.271+0000 7f8c377fe700 1 -- 172.21.15.40:0/2501506786 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f8c48044c30 con 0x7f8c50130de0 2023-09-30T22:27:34.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.276+0000 7f8c377fe700 1 -- 172.21.15.40:0/2501506786 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c48010cb0 con 0x7f8c50130de0 2023-09-30T22:27:34.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.305+0000 7fe13ae2e700 1 Processor -- start 2023-09-30T22:27:34.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.305+0000 7fe13ae2e700 1 -- start start 2023-09-30T22:27:34.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.306+0000 7fe13ae2e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe13409d920 0x7fe13409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.306+0000 7fe13ae2e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe13409f0f0 0x7fe13409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.306+0000 7fe13ae2e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe13409f940 con 0x7fe134133ca0 2023-09-30T22:27:34.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.306+0000 7fe13ae2e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe13406b4c0 con 0x7fe13409f0f0 2023-09-30T22:27:34.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.306+0000 7fe13ae2e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe13409a8f0 con 0x7fe13409d920 2023-09-30T22:27:34.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.306+0000 7fe133fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe13409f0f0 0x7fe13409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:34.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.306+0000 7fe133fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe13409f0f0 0x7fe13409e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56224/0 (socket says 172.21.15.40:56224) 2023-09-30T22:27:34.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.306+0000 7fe133fff700 1 -- 172.21.15.40:0/3546994127 learned_addr learned my addr 172.21.15.40:0/3546994127 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:34.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.306+0000 7fe138bca700 1 --2- 172.21.15.40:0/3546994127 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe13409d920 0x7fe13409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:34.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.307+0000 7fe138bca700 1 -- 172.21.15.40:0/3546994127 >> v2:172.21.15.40:3300/0 conn(0x7fe13409f0f0 msgr2=0x7fe13409e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:34.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.307+0000 7fe138bca700 1 --2- 172.21.15.40:0/3546994127 >> v2:172.21.15.40:3300/0 conn(0x7fe13409f0f0 0x7fe13409e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.307+0000 7fe138bca700 1 -- 172.21.15.40:0/3546994127 >> v1:172.21.15.40:6789/0 conn(0x7fe134133ca0 legacy=0x7fe134134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:34.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.307+0000 7fe138bca700 1 -- 172.21.15.40:0/3546994127 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe13409f6e0 con 0x7fe13409d920 2023-09-30T22:27:34.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.307+0000 7fe1337fe700 1 -- 172.21.15.40:0/3546994127 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 447535610 0 0) 0x7fe13409f940 con 0x7fe134133ca0 2023-09-30T22:27:34.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.307+0000 7fe133fff700 1 --2- 172.21.15.40:0/3546994127 >> v2:172.21.15.40:3300/0 conn(0x7fe13409f0f0 0x7fe13409e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:34.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.307+0000 7fe138bca700 1 --2- 172.21.15.40:0/3546994127 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe13409d920 0x7fe13409dcf0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe128009820 tx=0x7fe128009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1e456800447e8c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:34.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.307+0000 7fe1337fe700 1 -- 172.21.15.40:0/3546994127 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe128005e30 con 0x7fe13409d920 2023-09-30T22:27:34.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.307+0000 7fe1337fe700 1 -- 172.21.15.40:0/3546994127 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe128006030 con 0x7fe13409d920 2023-09-30T22:27:34.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.307+0000 7fe1337fe700 1 -- 172.21.15.40:0/3546994127 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1280063c0 con 0x7fe13409d920 2023-09-30T22:27:34.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.308+0000 7fe13ae2e700 1 -- 172.21.15.40:0/3546994127 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe13409d920 msgr2=0x7fe13409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:34.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.308+0000 7fe13ae2e700 1 --2- 172.21.15.40:0/3546994127 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe13409d920 0x7fe13409dcf0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe128009820 tx=0x7fe128009b30 comp rx=0 tx=0).stop 2023-09-30T22:27:34.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.308+0000 7fe13ae2e700 1 -- 172.21.15.40:0/3546994127 shutdown_connections 2023-09-30T22:27:34.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.308+0000 7fe13ae2e700 1 --2- 172.21.15.40:0/3546994127 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe13409d920 0x7fe13409dcf0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.308+0000 7fe13ae2e700 1 --2- 172.21.15.40:0/3546994127 >> v2:172.21.15.40:3300/0 conn(0x7fe13409f0f0 0x7fe13409e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.308+0000 7fe13ae2e700 1 -- 172.21.15.40:0/3546994127 >> 172.21.15.40:0/3546994127 conn(0x7fe13409fb20 msgr2=0x7fe13409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:34.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.308+0000 7fe13ae2e700 1 -- 172.21.15.40:0/3546994127 shutdown_connections 2023-09-30T22:27:34.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.308+0000 7fe13ae2e700 1 -- 172.21.15.40:0/3546994127 wait complete. 2023-09-30T22:27:34.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.310+0000 7fe13ae2e700 1 Processor -- start 2023-09-30T22:27:34.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.310+0000 7fe13ae2e700 1 -- start start 2023-09-30T22:27:34.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.311+0000 7fe13ae2e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe13409d920 0x7fe13411e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.311+0000 7fe13ae2e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe134133ca0 0x7fe13411ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.311+0000 7fe13ae2e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe1341223f0 0x7fe13411ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.311+0000 7fe13ae2e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe134120d40 con 0x7fe13409d920 2023-09-30T22:27:34.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.311+0000 7fe13ae2e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe134131b60 con 0x7fe134133ca0 2023-09-30T22:27:34.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.311+0000 7fe13ae2e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe134121ef0 con 0x7fe1341223f0 2023-09-30T22:27:34.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.311+0000 7fe133fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe134133ca0 0x7fe13411ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:34.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.311+0000 7fe133fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe134133ca0 0x7fe13411ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48138/0 (socket says 172.21.15.40:48138) 2023-09-30T22:27:34.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.311+0000 7fe133fff700 1 -- 172.21.15.40:0/4056402576 learned_addr learned my addr 172.21.15.40:0/4056402576 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:34.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.311+0000 7fe1393cb700 1 --2- 172.21.15.40:0/4056402576 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe1341223f0 0x7fe13411ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:34.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.311+0000 7fe138bca700 1 --2- 172.21.15.40:0/4056402576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe13409d920 0x7fe13411e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:34.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.311+0000 7fe133fff700 1 -- 172.21.15.40:0/4056402576 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe1341223f0 msgr2=0x7fe13411ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:34.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.311+0000 7fe133fff700 1 --2- 172.21.15.40:0/4056402576 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe1341223f0 0x7fe13411ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.311+0000 7fe133fff700 1 -- 172.21.15.40:0/4056402576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe13409d920 msgr2=0x7fe13411e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:34.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.311+0000 7fe133fff700 1 --2- 172.21.15.40:0/4056402576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe13409d920 0x7fe13411e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.311+0000 7fe133fff700 1 -- 172.21.15.40:0/4056402576 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe120009550 con 0x7fe134133ca0 2023-09-30T22:27:34.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.311+0000 7fe133fff700 1 --2- 172.21.15.40:0/4056402576 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe134133ca0 0x7fe13411ea30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe12000ebe0 tx=0x7fe12000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:34.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.312+0000 7fe1317fa700 1 -- 172.21.15.40:0/4056402576 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12000c850 con 0x7fe134133ca0 2023-09-30T22:27:34.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.312+0000 7fe1317fa700 1 -- 172.21.15.40:0/4056402576 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe12000c9b0 con 0x7fe134133ca0 2023-09-30T22:27:34.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.312+0000 7fe13ae2e700 1 -- 172.21.15.40:0/4056402576 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe128009430 con 0x7fe134133ca0 2023-09-30T22:27:34.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.312+0000 7fe1317fa700 1 -- 172.21.15.40:0/4056402576 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12000cd20 con 0x7fe134133ca0 2023-09-30T22:27:34.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.312+0000 7fe13ae2e700 1 -- 172.21.15.40:0/4056402576 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe13411ff70 con 0x7fe134133ca0 2023-09-30T22:27:34.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.313+0000 7fe13ae2e700 1 -- 172.21.15.40:0/4056402576 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe134121a70 con 0x7fe134133ca0 2023-09-30T22:27:34.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.314+0000 7fe1317fa700 1 -- 172.21.15.40:0/4056402576 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe120013470 con 0x7fe134133ca0 2023-09-30T22:27:34.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.314+0000 7fe1317fa700 1 -- 172.21.15.40:0/4056402576 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe12003fd90 con 0x7fe134133ca0 2023-09-30T22:27:34.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.318+0000 7fe1317fa700 1 -- 172.21.15.40:0/4056402576 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe12000ce80 con 0x7fe134133ca0 2023-09-30T22:27:34.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.360+0000 7f1f9e5d3700 1 Processor -- start 2023-09-30T22:27:34.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.361+0000 7f1f9e5d3700 1 -- start start 2023-09-30T22:27:34.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.361+0000 7f1f9e5d3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f9809c890 0x7f1f9809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.361+0000 7f1f9e5d3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1f9809e480 0x7f1f9813bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.361+0000 7f1f9e5d3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f980a2600 con 0x7f1f9809d920 2023-09-30T22:27:34.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.361+0000 7f1f9e5d3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f980a29d0 con 0x7f1f9809e480 2023-09-30T22:27:34.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.361+0000 7f1f9e5d3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9809fb40 con 0x7f1f9809c890 2023-09-30T22:27:34.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.361+0000 7f1f97fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f9809c890 0x7f1f9809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:34.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.362+0000 7f1f97fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f9809c890 0x7f1f9809cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48146/0 (socket says 172.21.15.40:48146) 2023-09-30T22:27:34.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.362+0000 7f1f97fff700 1 -- 172.21.15.40:0/674379873 learned_addr learned my addr 172.21.15.40:0/674379873 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:34.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.362+0000 7f1f9cb70700 1 --2- 172.21.15.40:0/674379873 >> v2:172.21.15.40:3300/0 conn(0x7f1f9809e480 0x7f1f9813bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:34.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.362+0000 7f1f97fff700 1 -- 172.21.15.40:0/674379873 >> v2:172.21.15.40:3300/0 conn(0x7f1f9809e480 msgr2=0x7f1f9813bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:34.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.362+0000 7f1f97fff700 1 --2- 172.21.15.40:0/674379873 >> v2:172.21.15.40:3300/0 conn(0x7f1f9809e480 0x7f1f9813bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.362+0000 7f1f97fff700 1 -- 172.21.15.40:0/674379873 >> v1:172.21.15.40:6789/0 conn(0x7f1f9809d920 legacy=0x7f1f9809dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:34.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.362+0000 7f1f97fff700 1 -- 172.21.15.40:0/674379873 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f9809fed0 con 0x7f1f9809c890 2023-09-30T22:27:34.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.362+0000 7f1f97fff700 1 --2- 172.21.15.40:0/674379873 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f9809c890 0x7f1f9809cc60 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1f88006fd0 tx=0x7f1f88009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5898f7ac62f63ed7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:34.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.362+0000 7f1f96ffd700 1 -- 172.21.15.40:0/674379873 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f88005e30 con 0x7f1f9809c890 2023-09-30T22:27:34.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.362+0000 7f1f96ffd700 1 -- 172.21.15.40:0/674379873 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f88004030 con 0x7f1f9809c890 2023-09-30T22:27:34.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.362+0000 7f1f96ffd700 1 -- 172.21.15.40:0/674379873 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f880043e0 con 0x7f1f9809c890 2023-09-30T22:27:34.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.363+0000 7f1f9e5d3700 1 -- 172.21.15.40:0/674379873 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f9809c890 msgr2=0x7f1f9809cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:34.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.363+0000 7f1f9e5d3700 1 --2- 172.21.15.40:0/674379873 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f9809c890 0x7f1f9809cc60 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1f88006fd0 tx=0x7f1f88009bd0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.363+0000 7f1f9e5d3700 1 -- 172.21.15.40:0/674379873 shutdown_connections 2023-09-30T22:27:34.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.363+0000 7f1f9e5d3700 1 --2- 172.21.15.40:0/674379873 >> v2:172.21.15.40:3300/0 conn(0x7f1f9809e480 0x7f1f9813bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.363+0000 7f1f9e5d3700 1 --2- 172.21.15.40:0/674379873 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f9809c890 0x7f1f9809cc60 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.363+0000 7f1f9e5d3700 1 -- 172.21.15.40:0/674379873 >> 172.21.15.40:0/674379873 conn(0x7f1f980a7080 msgr2=0x7f1f980a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:34.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.363+0000 7f1f9e5d3700 1 -- 172.21.15.40:0/674379873 shutdown_connections 2023-09-30T22:27:34.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.363+0000 7f1f9e5d3700 1 -- 172.21.15.40:0/674379873 wait complete. 2023-09-30T22:27:34.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.364+0000 7f1f9e5d3700 1 Processor -- start 2023-09-30T22:27:34.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.365+0000 7f1f9e5d3700 1 -- start start 2023-09-30T22:27:34.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.365+0000 7f1f9e5d3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f9809c890 0x7f1f981c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.365+0000 7f1f9e5d3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f9809d920 0x7f1f981c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.365+0000 7f1f9e5d3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f9809e480 0x7f1f981c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.365+0000 7f1f9e5d3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9812edc0 con 0x7f1f9809d920 2023-09-30T22:27:34.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.365+0000 7f1f9e5d3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f98130690 con 0x7f1f9809c890 2023-09-30T22:27:34.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.365+0000 7f1f9e5d3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9808f3e0 con 0x7f1f9809e480 2023-09-30T22:27:34.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.365+0000 7f1f977fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f9809d920 0x7f1f981c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:34.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.365+0000 7f1f977fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f9809d920 0x7f1f981c8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56258/0 (socket says 172.21.15.40:56258) 2023-09-30T22:27:34.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.365+0000 7f1f977fe700 1 -- 172.21.15.40:0/901004024 learned_addr learned my addr 172.21.15.40:0/901004024 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:34.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.365+0000 7f1f97fff700 1 --2- 172.21.15.40:0/901004024 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f9809c890 0x7f1f981c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:34.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.365+0000 7f1f9cb70700 1 --2- 172.21.15.40:0/901004024 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f9809e480 0x7f1f981c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:34.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.365+0000 7f1f977fe700 1 -- 172.21.15.40:0/901004024 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f9809e480 msgr2=0x7f1f981c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:34.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.366+0000 7f1f977fe700 1 --2- 172.21.15.40:0/901004024 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f9809e480 0x7f1f981c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.366+0000 7f1f977fe700 1 -- 172.21.15.40:0/901004024 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f9809c890 msgr2=0x7f1f981c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:34.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.366+0000 7f1f977fe700 1 --2- 172.21.15.40:0/901004024 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f9809c890 0x7f1f981c89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.366+0000 7f1f977fe700 1 -- 172.21.15.40:0/901004024 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f88009500 con 0x7f1f9809d920 2023-09-30T22:27:34.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.366+0000 7f1f977fe700 1 --2- 172.21.15.40:0/901004024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f9809d920 0x7f1f981c8f20 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c00c4b0 tx=0x7f1f8c00c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:34.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.366+0000 7f1f94ff9700 1 -- 172.21.15.40:0/901004024 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c0052d0 con 0x7f1f9809d920 2023-09-30T22:27:34.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.366+0000 7f1f94ff9700 1 -- 172.21.15.40:0/901004024 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8c005430 con 0x7f1f9809d920 2023-09-30T22:27:34.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.366+0000 7f1f9e5d3700 1 -- 172.21.15.40:0/901004024 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f9809ecf0 con 0x7f1f9809d920 2023-09-30T22:27:34.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.366+0000 7f1f94ff9700 1 -- 172.21.15.40:0/901004024 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c0038c0 con 0x7f1f9809d920 2023-09-30T22:27:34.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.366+0000 7f1f9e5d3700 1 -- 172.21.15.40:0/901004024 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f9809bf50 con 0x7f1f9809d920 2023-09-30T22:27:34.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.367+0000 7f1f94ff9700 1 -- 172.21.15.40:0/901004024 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1f8c003a20 con 0x7f1f9809d920 2023-09-30T22:27:34.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.367+0000 7f1f9e5d3700 1 -- 172.21.15.40:0/901004024 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f98062380 con 0x7f1f9809d920 2023-09-30T22:27:34.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.367+0000 7f1f94ff9700 1 -- 172.21.15.40:0/901004024 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f1f8c03ea30 con 0x7f1f9809d920 2023-09-30T22:27:34.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.377+0000 7f1f94ff9700 1 -- 172.21.15.40:0/901004024 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f8c019e60 con 0x7f1f9809d920 2023-09-30T22:27:34.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.401+0000 7f2977183700 1 Processor -- start 2023-09-30T22:27:34.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.401+0000 7f2977183700 1 -- start start 2023-09-30T22:27:34.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.402+0000 7f2977183700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f297006c990 0x7f297006cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.402+0000 7f2977183700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f297006d2a0 0x7f297013c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.402+0000 7f2977183700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f297006df30 con 0x7f297013c8f0 2023-09-30T22:27:34.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.402+0000 7f2977183700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f297006ec40 con 0x7f297006d2a0 2023-09-30T22:27:34.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.402+0000 7f2977183700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f297006ea40 con 0x7f297006c990 2023-09-30T22:27:34.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.402+0000 7f296ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f297006d2a0 0x7f297013c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:34.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.402+0000 7f2975720700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f297013c8f0 0x7f297013ecd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41552/0 (socket says 172.21.15.40:41552) 2023-09-30T22:27:34.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.402+0000 7f2974f1f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f297006c990 0x7f297006cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:34.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.402+0000 7f296ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f297006d2a0 0x7f297013c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48174/0 (socket says 172.21.15.40:48174) 2023-09-30T22:27:34.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.402+0000 7f2975720700 1 -- 172.21.15.40:0/2468718581 learned_addr learned my addr 172.21.15.40:0/2468718581 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:27:34.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.403+0000 7f296ffff700 1 -- 172.21.15.40:0/2468718581 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f297006c990 msgr2=0x7f297006cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:34.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.403+0000 7f296ffff700 1 --2- 172.21.15.40:0/2468718581 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f297006c990 0x7f297006cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.403+0000 7f296ffff700 1 -- 172.21.15.40:0/2468718581 >> v1:172.21.15.40:6789/0 conn(0x7f297013c8f0 legacy=0x7f297013ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:34.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.403+0000 7f296ffff700 1 -- 172.21.15.40:0/2468718581 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2970072050 con 0x7f297006d2a0 2023-09-30T22:27:34.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.403+0000 7f296ffff700 1 --2- 172.21.15.40:0/2468718581 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f297006d2a0 0x7f297013c3b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f295c009870 tx=0x7f295c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1786820ea16f5d79 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:34.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.403+0000 7f296f7fe700 1 -- 172.21.15.40:0/2468718581 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c011830 con 0x7f297006d2a0 2023-09-30T22:27:34.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.403+0000 7f296f7fe700 1 -- 172.21.15.40:0/2468718581 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295c011990 con 0x7f297006d2a0 2023-09-30T22:27:34.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.403+0000 7f296f7fe700 1 -- 172.21.15.40:0/2468718581 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c011d20 con 0x7f297006d2a0 2023-09-30T22:27:34.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.404+0000 7f2977183700 1 -- 172.21.15.40:0/2468718581 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f297006d2a0 msgr2=0x7f297013c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:34.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.404+0000 7f2977183700 1 --2- 172.21.15.40:0/2468718581 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f297006d2a0 0x7f297013c3b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f295c009870 tx=0x7f295c009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:34.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.404+0000 7f2977183700 1 -- 172.21.15.40:0/2468718581 shutdown_connections 2023-09-30T22:27:34.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.404+0000 7f2977183700 1 --2- 172.21.15.40:0/2468718581 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f297006c990 0x7f297006cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.404+0000 7f2977183700 1 --2- 172.21.15.40:0/2468718581 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f297006d2a0 0x7f297013c3b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.404+0000 7f2977183700 1 -- 172.21.15.40:0/2468718581 >> 172.21.15.40:0/2468718581 conn(0x7f29700a41a0 msgr2=0x7f29700a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:34.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.404+0000 7f2977183700 1 -- 172.21.15.40:0/2468718581 shutdown_connections 2023-09-30T22:27:34.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.404+0000 7f2977183700 1 -- 172.21.15.40:0/2468718581 wait complete. 2023-09-30T22:27:34.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.405+0000 7f2977183700 1 Processor -- start 2023-09-30T22:27:34.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.405+0000 7f2977183700 1 -- start start 2023-09-30T22:27:34.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.405+0000 7f2977183700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f297006c990 0x7f2970138770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.405+0000 7f2977183700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f297006d2a0 0x7f2970138cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.405+0000 7f2977183700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f297013c8f0 0x7f297008afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.405+0000 7f2977183700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297006f830 con 0x7f297006c990 2023-09-30T22:27:34.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.405+0000 7f2977183700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f297008daa0 con 0x7f297013c8f0 2023-09-30T22:27:34.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.405+0000 7f2977183700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f297008c260 con 0x7f297006d2a0 2023-09-30T22:27:34.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.405+0000 7f296ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f297006d2a0 0x7f2970138cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:34.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.405+0000 7f2975720700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f297013c8f0 0x7f297008afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:34.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.405+0000 7f296ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f297006d2a0 0x7f2970138cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56342/0 (socket says 172.21.15.40:56342) 2023-09-30T22:27:34.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.406+0000 7f296ffff700 1 -- 172.21.15.40:0/3304020136 learned_addr learned my addr 172.21.15.40:0/3304020136 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:34.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.406+0000 7f2974f1f700 1 --2- 172.21.15.40:0/3304020136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f297006c990 0x7f2970138770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:34.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.406+0000 7f296ffff700 1 -- 172.21.15.40:0/3304020136 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f297013c8f0 msgr2=0x7f297008afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:34.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.406+0000 7f296ffff700 1 --2- 172.21.15.40:0/3304020136 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f297013c8f0 0x7f297008afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.406+0000 7f296ffff700 1 -- 172.21.15.40:0/3304020136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f297006c990 msgr2=0x7f2970138770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:34.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.406+0000 7f296ffff700 1 --2- 172.21.15.40:0/3304020136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f297006c990 0x7f2970138770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.406+0000 7f296ffff700 1 -- 172.21.15.40:0/3304020136 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f295c0094a0 con 0x7f297006d2a0 2023-09-30T22:27:34.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.406+0000 7f296ffff700 1 --2- 172.21.15.40:0/3304020136 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f297006d2a0 0x7f2970138cb0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f295c0090b0 tx=0x7f295c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:34.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.406+0000 7f296d7fa700 1 -- 172.21.15.40:0/3304020136 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c004300 con 0x7f297006d2a0 2023-09-30T22:27:34.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.406+0000 7f296d7fa700 1 -- 172.21.15.40:0/3304020136 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295c01f070 con 0x7f297006d2a0 2023-09-30T22:27:34.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.406+0000 7f2977183700 1 -- 172.21.15.40:0/3304020136 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f297008d1a0 con 0x7f297006d2a0 2023-09-30T22:27:34.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.406+0000 7f296d7fa700 1 -- 172.21.15.40:0/3304020136 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c0036a0 con 0x7f297006d2a0 2023-09-30T22:27:34.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.406+0000 7f2977183700 1 -- 172.21.15.40:0/3304020136 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f297008d740 con 0x7f297006d2a0 2023-09-30T22:27:34.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.408+0000 7f2977183700 1 -- 172.21.15.40:0/3304020136 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2970062380 con 0x7f297006d2a0 2023-09-30T22:27:34.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.408+0000 7f296d7fa700 1 -- 172.21.15.40:0/3304020136 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f295c021030 con 0x7f297006d2a0 2023-09-30T22:27:34.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.409+0000 7f296d7fa700 1 -- 172.21.15.40:0/3304020136 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f295c040820 con 0x7f297006d2a0 2023-09-30T22:27:34.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.413+0000 7f296d7fa700 1 -- 172.21.15.40:0/3304020136 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f295c0193b0 con 0x7f297006d2a0 2023-09-30T22:27:34.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.500+0000 7f8c55416700 1 -- 172.21.15.40:0/2501506786 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8c5012e890 con 0x7f8c50130de0 2023-09-30T22:27:34.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.501+0000 7f8c377fe700 1 -- 172.21.15.40:0/2501506786 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8c48019310 con 0x7f8c50130de0 2023-09-30T22:27:34.502 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:34.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.503+0000 7f8c55416700 1 -- 172.21.15.40:0/2501506786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c50130de0 msgr2=0x7f8c50119730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:34.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.503+0000 7f8c55416700 1 --2- 172.21.15.40:0/2501506786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c50130de0 0x7f8c50119730 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8c480117b0 tx=0x7f8c48011ac0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.503+0000 7f8c55416700 1 -- 172.21.15.40:0/2501506786 shutdown_connections 2023-09-30T22:27:34.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.503+0000 7f8c55416700 1 --2- 172.21.15.40:0/2501506786 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c5009d920 0x7f8c501c4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.503+0000 7f8c55416700 1 --2- 172.21.15.40:0/2501506786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c50130de0 0x7f8c50119730 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.503+0000 7f8c55416700 1 --2- 172.21.15.40:0/2501506786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c5009e230 0x7f8c501c4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.503+0000 7f8c55416700 1 -- 172.21.15.40:0/2501506786 >> 172.21.15.40:0/2501506786 conn(0x7f8c5009fb20 msgr2=0x7f8c5012dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:34.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.503+0000 7f8c55416700 1 -- 172.21.15.40:0/2501506786 shutdown_connections 2023-09-30T22:27:34.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.503+0000 7f8c55416700 1 -- 172.21.15.40:0/2501506786 wait complete. 2023-09-30T22:27:34.517 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:34.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.528+0000 7fe13ae2e700 1 -- 172.21.15.40:0/4056402576 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe134121a70 con 0x7fe134133ca0 2023-09-30T22:27:34.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.528+0000 7fe1317fa700 1 -- 172.21.15.40:0/4056402576 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe134121a70 con 0x7fe134133ca0 2023-09-30T22:27:34.529 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:34.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.530+0000 7fe13ae2e700 1 -- 172.21.15.40:0/4056402576 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe134133ca0 msgr2=0x7fe13411ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:34.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.530+0000 7fe13ae2e700 1 --2- 172.21.15.40:0/4056402576 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe134133ca0 0x7fe13411ea30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe12000ebe0 tx=0x7fe12000eef0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.530+0000 7fe13ae2e700 1 -- 172.21.15.40:0/4056402576 shutdown_connections 2023-09-30T22:27:34.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.530+0000 7fe13ae2e700 1 --2- 172.21.15.40:0/4056402576 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe1341223f0 0x7fe13411ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.530+0000 7fe13ae2e700 1 --2- 172.21.15.40:0/4056402576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe13409d920 0x7fe13411e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.530+0000 7fe13ae2e700 1 --2- 172.21.15.40:0/4056402576 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe134133ca0 0x7fe13411ea30 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.530+0000 7fe13ae2e700 1 -- 172.21.15.40:0/4056402576 >> 172.21.15.40:0/4056402576 conn(0x7fe13409fb20 msgr2=0x7fe134133480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:34.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.530+0000 7fe13ae2e700 1 -- 172.21.15.40:0/4056402576 shutdown_connections 2023-09-30T22:27:34.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.530+0000 7fe13ae2e700 1 -- 172.21.15.40:0/4056402576 wait complete. 2023-09-30T22:27:34.543 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:34.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.593+0000 7f1f9e5d3700 1 -- 172.21.15.40:0/901004024 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1f981308b0 con 0x7f1f9809d920 2023-09-30T22:27:34.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.593+0000 7f1f94ff9700 1 -- 172.21.15.40:0/901004024 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1f981308b0 con 0x7f1f9809d920 2023-09-30T22:27:34.594 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:34.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.595+0000 7f1f9e5d3700 1 -- 172.21.15.40:0/901004024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f9809d920 msgr2=0x7f1f981c8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:34.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.595+0000 7f1f9e5d3700 1 --2- 172.21.15.40:0/901004024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f9809d920 0x7f1f981c8f20 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c00c4b0 tx=0x7f1f8c00c7c0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.595+0000 7f1f9e5d3700 1 -- 172.21.15.40:0/901004024 shutdown_connections 2023-09-30T22:27:34.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.595+0000 7f1f9e5d3700 1 --2- 172.21.15.40:0/901004024 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f9809e480 0x7f1f981c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.595+0000 7f1f9e5d3700 1 --2- 172.21.15.40:0/901004024 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f9809c890 0x7f1f981c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.595+0000 7f1f9e5d3700 1 --2- 172.21.15.40:0/901004024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f9809d920 0x7f1f981c8f20 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.595+0000 7f1f9e5d3700 1 -- 172.21.15.40:0/901004024 >> 172.21.15.40:0/901004024 conn(0x7f1f980a7080 msgr2=0x7f1f980a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:34.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.595+0000 7f1f9e5d3700 1 -- 172.21.15.40:0/901004024 shutdown_connections 2023-09-30T22:27:34.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.595+0000 7f1f9e5d3700 1 -- 172.21.15.40:0/901004024 wait complete. 2023-09-30T22:27:34.608 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:34.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.612+0000 7f2977183700 1 -- 172.21.15.40:0/3304020136 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2970072050 con 0x7f297006d2a0 2023-09-30T22:27:34.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.613+0000 7f296d7fa700 1 -- 172.21.15.40:0/3304020136 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2970072050 con 0x7f297006d2a0 2023-09-30T22:27:34.613 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:34.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.615+0000 7f2977183700 1 -- 172.21.15.40:0/3304020136 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f297006d2a0 msgr2=0x7f2970138cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:34.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.615+0000 7f2977183700 1 --2- 172.21.15.40:0/3304020136 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f297006d2a0 0x7f2970138cb0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f295c0090b0 tx=0x7f295c004750 comp rx=0 tx=0).stop 2023-09-30T22:27:34.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.615+0000 7f2977183700 1 -- 172.21.15.40:0/3304020136 shutdown_connections 2023-09-30T22:27:34.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.615+0000 7f2977183700 1 --2- 172.21.15.40:0/3304020136 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f297013c8f0 0x7f297008afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.615+0000 7f2977183700 1 --2- 172.21.15.40:0/3304020136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f297006c990 0x7f2970138770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.615+0000 7f2977183700 1 --2- 172.21.15.40:0/3304020136 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f297006d2a0 0x7f2970138cb0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.615+0000 7f2977183700 1 -- 172.21.15.40:0/3304020136 >> 172.21.15.40:0/3304020136 conn(0x7f29700a41a0 msgr2=0x7f297013bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:34.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.615+0000 7f2977183700 1 -- 172.21.15.40:0/3304020136 shutdown_connections 2023-09-30T22:27:34.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:34.615+0000 7f2977183700 1 -- 172.21.15.40:0/3304020136 wait complete. 2023-09-30T22:27:34.628 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:35.518 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:35.544 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:35.608 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:35.629 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:35.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.662+0000 7ffa8af86700 1 Processor -- start 2023-09-30T22:27:35.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.663+0000 7ffa8af86700 1 -- start start 2023-09-30T22:27:35.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.663+0000 7ffa8af86700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffa8409c890 0x7ffa8409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:35.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.663+0000 7ffa8af86700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa8409d920 0x7ffa8409dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:35.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.663+0000 7ffa8af86700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa8409e2b0 0x7ffa8413ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:35.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.663+0000 7ffa8af86700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa840a29d0 con 0x7ffa8409c890 2023-09-30T22:27:35.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.663+0000 7ffa8af86700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8409fb40 con 0x7ffa8409e2b0 2023-09-30T22:27:35.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.663+0000 7ffa8af86700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa840a2600 con 0x7ffa8409d920 2023-09-30T22:27:35.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.664+0000 7ffa83fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa8409d920 0x7ffa8409dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:35.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.664+0000 7ffa88d22700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffa8409c890 0x7ffa8409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:35.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.664+0000 7ffa83fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa8409d920 0x7ffa8409dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56344/0 (socket says 172.21.15.40:56344) 2023-09-30T22:27:35.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.664+0000 7ffa83fff700 1 -- 172.21.15.40:0/346949356 learned_addr learned my addr 172.21.15.40:0/346949356 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:35.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.664+0000 7ffa88d22700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffa8409c890 0x7ffa8409cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56278/0 (socket says 172.21.15.40:56278) 2023-09-30T22:27:35.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.664+0000 7ffa89523700 1 --2- 172.21.15.40:0/346949356 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa8409e2b0 0x7ffa8413ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:35.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.664+0000 7ffa83fff700 1 -- 172.21.15.40:0/346949356 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa8409e2b0 msgr2=0x7ffa8413ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:35.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.664+0000 7ffa83fff700 1 --2- 172.21.15.40:0/346949356 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa8409e2b0 0x7ffa8413ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.664+0000 7ffa83fff700 1 -- 172.21.15.40:0/346949356 >> v2:172.21.15.40:3300/0 conn(0x7ffa8409c890 msgr2=0x7ffa8409cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:35.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.664+0000 7ffa83fff700 1 --2- 172.21.15.40:0/346949356 >> v2:172.21.15.40:3300/0 conn(0x7ffa8409c890 0x7ffa8409cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.664+0000 7ffa83fff700 1 -- 172.21.15.40:0/346949356 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa8409fed0 con 0x7ffa8409d920 2023-09-30T22:27:35.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.664+0000 7ffa83fff700 1 --2- 172.21.15.40:0/346949356 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa8409d920 0x7ffa8409dd70 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ffa700098f0 tx=0x7ffa70009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c564ccfba41b761 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:35.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.665+0000 7ffa837fe700 1 -- 172.21.15.40:0/346949356 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa70011830 con 0x7ffa8409d920 2023-09-30T22:27:35.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.665+0000 7ffa837fe700 1 -- 172.21.15.40:0/346949356 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa70011990 con 0x7ffa8409d920 2023-09-30T22:27:35.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.665+0000 7ffa837fe700 1 -- 172.21.15.40:0/346949356 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa70011d20 con 0x7ffa8409d920 2023-09-30T22:27:35.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.666+0000 7ffa8af86700 1 -- 172.21.15.40:0/346949356 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa8409d920 msgr2=0x7ffa8409dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:35.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.666+0000 7ffa8af86700 1 --2- 172.21.15.40:0/346949356 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa8409d920 0x7ffa8409dd70 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ffa700098f0 tx=0x7ffa70009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:35.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.666+0000 7ffa8af86700 1 -- 172.21.15.40:0/346949356 shutdown_connections 2023-09-30T22:27:35.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.666+0000 7ffa8af86700 1 --2- 172.21.15.40:0/346949356 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa8409e2b0 0x7ffa8413ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.666+0000 7ffa8af86700 1 --2- 172.21.15.40:0/346949356 >> v2:172.21.15.40:3300/0 conn(0x7ffa8409c890 0x7ffa8409cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.666+0000 7ffa8af86700 1 --2- 172.21.15.40:0/346949356 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa8409d920 0x7ffa8409dd70 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.666+0000 7ffa8af86700 1 -- 172.21.15.40:0/346949356 >> 172.21.15.40:0/346949356 conn(0x7ffa840a7080 msgr2=0x7ffa840a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:35.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.666+0000 7ffa8af86700 1 -- 172.21.15.40:0/346949356 shutdown_connections 2023-09-30T22:27:35.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.666+0000 7ffa8af86700 1 -- 172.21.15.40:0/346949356 wait complete. 2023-09-30T22:27:35.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.667+0000 7ffa8af86700 1 Processor -- start 2023-09-30T22:27:35.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.667+0000 7ffa8af86700 1 -- start start 2023-09-30T22:27:35.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.668+0000 7ffa8af86700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa8409c890 0x7ffa8412d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:35.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.668+0000 7ffa8af86700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa8409d920 0x7ffa8412d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:35.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.668+0000 7ffa8af86700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa8409e2b0 0x7ffa8412dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:35.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.668+0000 7ffa8af86700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa840a5d60 con 0x7ffa8409d920 2023-09-30T22:27:35.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.668+0000 7ffa8af86700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa84130560 con 0x7ffa8409c890 2023-09-30T22:27:35.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.668+0000 7ffa8af86700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8409c310 con 0x7ffa8409e2b0 2023-09-30T22:27:35.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.668+0000 7ffa88d22700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa8409c890 0x7ffa8412d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:35.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.668+0000 7ffa88d22700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa8409c890 0x7ffa8412d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48188/0 (socket says 172.21.15.40:48188) 2023-09-30T22:27:35.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.668+0000 7ffa88d22700 1 -- 172.21.15.40:0/2989527787 learned_addr learned my addr 172.21.15.40:0/2989527787 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:35.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.668+0000 7ffa89523700 1 --2- 172.21.15.40:0/2989527787 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa8409e2b0 0x7ffa8412dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:35.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.669+0000 7ffa88d22700 1 -- 172.21.15.40:0/2989527787 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa8409e2b0 msgr2=0x7ffa8412dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:35.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.669+0000 7ffa88d22700 1 --2- 172.21.15.40:0/2989527787 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa8409e2b0 0x7ffa8412dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.669+0000 7ffa88d22700 1 -- 172.21.15.40:0/2989527787 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa8409d920 msgr2=0x7ffa8412d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:35.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.669+0000 7ffa88d22700 1 --2- 172.21.15.40:0/2989527787 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa8409d920 0x7ffa8412d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.669+0000 7ffa88d22700 1 -- 172.21.15.40:0/2989527787 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa70009550 con 0x7ffa8409c890 2023-09-30T22:27:35.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.669+0000 7ffa89523700 1 --2- 172.21.15.40:0/2989527787 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa8409e2b0 0x7ffa8412dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:35.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.669+0000 7ffa88d22700 1 --2- 172.21.15.40:0/2989527787 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa8409c890 0x7ffa8412d210 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ffa7800e870 tx=0x7ffa7800eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:35.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.669+0000 7ffa817fa700 1 -- 172.21.15.40:0/2989527787 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa78005a20 con 0x7ffa8409c890 2023-09-30T22:27:35.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.669+0000 7ffa817fa700 1 -- 172.21.15.40:0/2989527787 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa78005b80 con 0x7ffa8409c890 2023-09-30T22:27:35.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.669+0000 7ffa817fa700 1 -- 172.21.15.40:0/2989527787 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa78013680 con 0x7ffa8409c890 2023-09-30T22:27:35.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.669+0000 7ffa8af86700 1 -- 172.21.15.40:0/2989527787 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa84130070 con 0x7ffa8409c890 2023-09-30T22:27:35.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.669+0000 7ffa8af86700 1 -- 172.21.15.40:0/2989527787 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa8412e1d0 con 0x7ffa8409c890 2023-09-30T22:27:35.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.670+0000 7ffa8af86700 1 -- 172.21.15.40:0/2989527787 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa84062380 con 0x7ffa8409c890 2023-09-30T22:27:35.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.670+0000 7ffa817fa700 1 -- 172.21.15.40:0/2989527787 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffa780137e0 con 0x7ffa8409c890 2023-09-30T22:27:35.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.671+0000 7ffa817fa700 1 -- 172.21.15.40:0/2989527787 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ffa7803f8f0 con 0x7ffa8409c890 2023-09-30T22:27:35.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.676+0000 7ffa817fa700 1 -- 172.21.15.40:0/2989527787 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa78006030 con 0x7ffa8409c890 2023-09-30T22:27:35.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.704+0000 7f2c2afe1700 1 Processor -- start 2023-09-30T22:27:35.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.705+0000 7f2c2afe1700 1 -- start start 2023-09-30T22:27:35.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.705+0000 7f2c2afe1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c2409d920 0x7f2c2409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:35.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.705+0000 7f2c2afe1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2c24130fb0 0x7f2c24138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:35.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.705+0000 7f2c2afe1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c2409adf0 con 0x7f2c2409e230 2023-09-30T22:27:35.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.705+0000 7f2c2afe1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c2409edf0 con 0x7f2c24130fb0 2023-09-30T22:27:35.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.705+0000 7f2c2afe1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2409b660 con 0x7f2c2409d920 2023-09-30T22:27:35.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.705+0000 7f2c28d7d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c2409d920 0x7f2c2409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:35.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.705+0000 7f2c2957e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2c24130fb0 0x7f2c24138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:35.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.705+0000 7f2c28d7d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c2409d920 0x7f2c2409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56358/0 (socket says 172.21.15.40:56358) 2023-09-30T22:27:35.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.705+0000 7f2c2957e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2c24130fb0 0x7f2c24138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56296/0 (socket says 172.21.15.40:56296) 2023-09-30T22:27:35.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.705+0000 7f2c28d7d700 1 -- 172.21.15.40:0/357704564 learned_addr learned my addr 172.21.15.40:0/357704564 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:35.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.706+0000 7f2c2957e700 1 -- 172.21.15.40:0/357704564 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c2409d920 msgr2=0x7f2c2409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:35.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.706+0000 7f2c2957e700 1 --2- 172.21.15.40:0/357704564 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c2409d920 0x7f2c2409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.706+0000 7f2c2957e700 1 -- 172.21.15.40:0/357704564 >> v1:172.21.15.40:6789/0 conn(0x7f2c2409e230 legacy=0x7f2c241308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:35.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.706+0000 7f2c2957e700 1 -- 172.21.15.40:0/357704564 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c2409a6e0 con 0x7f2c24130fb0 2023-09-30T22:27:35.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.706+0000 7f2c28d7d700 1 --2- 172.21.15.40:0/357704564 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c2409d920 0x7f2c2409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:35.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.706+0000 7f2c2957e700 1 --2- 172.21.15.40:0/357704564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c24130fb0 0x7f2c24138d10 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c00f370 tx=0x7f2c1c00f680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce7c7807616cbf2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:35.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.706+0000 7f2c237fe700 1 -- 172.21.15.40:0/357704564 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c012070 con 0x7f2c24130fb0 2023-09-30T22:27:35.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.706+0000 7f2c237fe700 1 -- 172.21.15.40:0/357704564 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1c00fe70 con 0x7f2c24130fb0 2023-09-30T22:27:35.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.706+0000 7f2c237fe700 1 -- 172.21.15.40:0/357704564 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c00d2f0 con 0x7f2c24130fb0 2023-09-30T22:27:35.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.707+0000 7f2c2afe1700 1 -- 172.21.15.40:0/357704564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c24130fb0 msgr2=0x7f2c24138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:35.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.707+0000 7f2c2afe1700 1 --2- 172.21.15.40:0/357704564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c24130fb0 0x7f2c24138d10 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c00f370 tx=0x7f2c1c00f680 comp rx=0 tx=0).stop 2023-09-30T22:27:35.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.707+0000 7f2c2afe1700 1 -- 172.21.15.40:0/357704564 shutdown_connections 2023-09-30T22:27:35.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.707+0000 7f2c2afe1700 1 --2- 172.21.15.40:0/357704564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c24130fb0 0x7f2c24138d10 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.707+0000 7f2c2afe1700 1 --2- 172.21.15.40:0/357704564 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c2409d920 0x7f2c2409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.707+0000 7f2c2afe1700 1 -- 172.21.15.40:0/357704564 >> 172.21.15.40:0/357704564 conn(0x7f2c2409fb20 msgr2=0x7f2c2409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:35.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.707+0000 7f2c2afe1700 1 -- 172.21.15.40:0/357704564 shutdown_connections 2023-09-30T22:27:35.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.707+0000 7f2c2afe1700 1 -- 172.21.15.40:0/357704564 wait complete. 2023-09-30T22:27:35.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.708+0000 7f2c2afe1700 1 Processor -- start 2023-09-30T22:27:35.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.708+0000 7f2c2afe1700 1 -- start start 2023-09-30T22:27:35.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.709+0000 7f2c2afe1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c2409d920 0x7f2c2411cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:35.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.709+0000 7f2c2afe1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c2409e230 0x7f2c2411d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:35.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.709+0000 7f2c2afe1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c24130fb0 0x7f2c2411d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:35.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.709+0000 7f2c2afe1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c24121400 con 0x7f2c24130fb0 2023-09-30T22:27:35.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.709+0000 7f2c2afe1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2411eb30 con 0x7f2c2409d920 2023-09-30T22:27:35.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.709+0000 7f2c2afe1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2411f150 con 0x7f2c2409e230 2023-09-30T22:27:35.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.710+0000 7f2c23fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c2409e230 0x7f2c2411d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:35.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.710+0000 7f2c23fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c2409e230 0x7f2c2411d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56362/0 (socket says 172.21.15.40:56362) 2023-09-30T22:27:35.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.710+0000 7f2c23fff700 1 -- 172.21.15.40:0/1093036311 learned_addr learned my addr 172.21.15.40:0/1093036311 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:35.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.710+0000 7f2c28d7d700 1 --2- 172.21.15.40:0/1093036311 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c2409d920 0x7f2c2411cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:35.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.710+0000 7f2c2957e700 1 --2- 172.21.15.40:0/1093036311 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c24130fb0 0x7f2c2411d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:35.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.710+0000 7f2c23fff700 1 -- 172.21.15.40:0/1093036311 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c2409d920 msgr2=0x7f2c2411cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:35.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.710+0000 7f2c23fff700 1 --2- 172.21.15.40:0/1093036311 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c2409d920 0x7f2c2411cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.710+0000 7f2c23fff700 1 -- 172.21.15.40:0/1093036311 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c24130fb0 msgr2=0x7f2c2411d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:35.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.710+0000 7f2c23fff700 1 --2- 172.21.15.40:0/1093036311 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c24130fb0 0x7f2c2411d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.710+0000 7f2c23fff700 1 -- 172.21.15.40:0/1093036311 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1800b5b0 con 0x7f2c2409e230 2023-09-30T22:27:35.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.710+0000 7f2c2957e700 1 --2- 172.21.15.40:0/1093036311 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c24130fb0 0x7f2c2411d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:35.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.710+0000 7f2c23fff700 1 --2- 172.21.15.40:0/1093036311 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c2409e230 0x7f2c2411d4b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2c1000c4e0 tx=0x7f2c1000c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:35.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.710+0000 7f2c217fa700 1 -- 172.21.15.40:0/1093036311 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c100052d0 con 0x7f2c2409e230 2023-09-30T22:27:35.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.711+0000 7f2c2afe1700 1 -- 172.21.15.40:0/1093036311 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c1c00f050 con 0x7f2c2409e230 2023-09-30T22:27:35.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.711+0000 7f2c217fa700 1 -- 172.21.15.40:0/1093036311 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c10005430 con 0x7f2c2409e230 2023-09-30T22:27:35.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.711+0000 7f2c217fa700 1 -- 172.21.15.40:0/1093036311 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c100038c0 con 0x7f2c2409e230 2023-09-30T22:27:35.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.711+0000 7f2c2afe1700 1 -- 172.21.15.40:0/1093036311 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c2406b260 con 0x7f2c2409e230 2023-09-30T22:27:35.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.712+0000 7f2c217fa700 1 -- 172.21.15.40:0/1093036311 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2c10003a20 con 0x7f2c2409e230 2023-09-30T22:27:35.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.712+0000 7f2c217fa700 1 -- 172.21.15.40:0/1093036311 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f2c1003ea90 con 0x7f2c2409e230 2023-09-30T22:27:35.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.712+0000 7f2c2afe1700 1 -- 172.21.15.40:0/1093036311 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c2409cb00 con 0x7f2c2409e230 2023-09-30T22:27:35.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.717+0000 7f2c217fa700 1 -- 172.21.15.40:0/1093036311 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2c10017020 con 0x7f2c2409e230 2023-09-30T22:27:35.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.748+0000 7f060bb2f700 1 Processor -- start 2023-09-30T22:27:35.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.748+0000 7f060bb2f700 1 -- start start 2023-09-30T22:27:35.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.748+0000 7f060bb2f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f060409d920 0x7f060409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:35.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.748+0000 7f060bb2f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0604130fb0 0x7f0604138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:35.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.748+0000 7f060bb2f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f060409adf0 con 0x7f060409e230 2023-09-30T22:27:35.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.748+0000 7f060bb2f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f060409edf0 con 0x7f060409d920 2023-09-30T22:27:35.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.748+0000 7f060bb2f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f060409b660 con 0x7f0604130fb0 2023-09-30T22:27:35.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.749+0000 7f06098cb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f060409d920 0x7f060409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:35.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.749+0000 7f06098cb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f060409d920 0x7f060409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56314/0 (socket says 172.21.15.40:56314) 2023-09-30T22:27:35.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.749+0000 7f06098cb700 1 -- 172.21.15.40:0/2350384692 learned_addr learned my addr 172.21.15.40:0/2350384692 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:35.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.749+0000 7f060a0cc700 1 --2- 172.21.15.40:0/2350384692 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0604130fb0 0x7f0604138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:35.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.749+0000 7f060a0cc700 1 -- 172.21.15.40:0/2350384692 >> v2:172.21.15.40:3300/0 conn(0x7f060409d920 msgr2=0x7f060409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:35.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.749+0000 7f060a0cc700 1 --2- 172.21.15.40:0/2350384692 >> v2:172.21.15.40:3300/0 conn(0x7f060409d920 0x7f060409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.749+0000 7f060a0cc700 1 -- 172.21.15.40:0/2350384692 >> v1:172.21.15.40:6789/0 conn(0x7f060409e230 legacy=0x7f06041308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:35.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.749+0000 7f06088c9700 1 -- 172.21.15.40:0/2350384692 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1732220263 0 0) 0x7f060409adf0 con 0x7f060409e230 2023-09-30T22:27:35.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.749+0000 7f060a0cc700 1 -- 172.21.15.40:0/2350384692 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f060409a6e0 con 0x7f0604130fb0 2023-09-30T22:27:35.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.749+0000 7f060a0cc700 1 --2- 172.21.15.40:0/2350384692 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0604130fb0 0x7f0604138d10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f05fc009d90 tx=0x7f05fc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3b0ca00087bbd38 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:35.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.750+0000 7f06088c9700 1 -- 172.21.15.40:0/2350384692 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05fc00e070 con 0x7f0604130fb0 2023-09-30T22:27:35.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.750+0000 7f06088c9700 1 -- 172.21.15.40:0/2350384692 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05fc00bb20 con 0x7f0604130fb0 2023-09-30T22:27:35.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.750+0000 7f06088c9700 1 -- 172.21.15.40:0/2350384692 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05fc012430 con 0x7f0604130fb0 2023-09-30T22:27:35.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.750+0000 7f060bb2f700 1 -- 172.21.15.40:0/2350384692 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0604130fb0 msgr2=0x7f0604138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:35.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.750+0000 7f060bb2f700 1 --2- 172.21.15.40:0/2350384692 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0604130fb0 0x7f0604138d10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f05fc009d90 tx=0x7f05fc00b330 comp rx=0 tx=0).stop 2023-09-30T22:27:35.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.751+0000 7f060bb2f700 1 -- 172.21.15.40:0/2350384692 shutdown_connections 2023-09-30T22:27:35.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.751+0000 7f060bb2f700 1 --2- 172.21.15.40:0/2350384692 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0604130fb0 0x7f0604138d10 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.751+0000 7f060bb2f700 1 --2- 172.21.15.40:0/2350384692 >> v2:172.21.15.40:3300/0 conn(0x7f060409d920 0x7f060409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.751+0000 7f060bb2f700 1 -- 172.21.15.40:0/2350384692 >> 172.21.15.40:0/2350384692 conn(0x7f060409fb20 msgr2=0x7f060409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:35.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.751+0000 7f060bb2f700 1 -- 172.21.15.40:0/2350384692 shutdown_connections 2023-09-30T22:27:35.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.751+0000 7f060bb2f700 1 -- 172.21.15.40:0/2350384692 wait complete. 2023-09-30T22:27:35.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.752+0000 7f060bb2f700 1 Processor -- start 2023-09-30T22:27:35.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.752+0000 7f060bb2f700 1 -- start start 2023-09-30T22:27:35.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.753+0000 7f060bb2f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f060409d920 0x7f060411d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:35.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.753+0000 7f060bb2f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f060409e230 0x7f060411dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:35.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.753+0000 7f060bb2f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0604130fb0 0x7f06041c3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:35.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.753+0000 7f060bb2f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060412f6c0 con 0x7f060409d920 2023-09-30T22:27:35.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.753+0000 7f060bb2f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f060411fa70 con 0x7f0604130fb0 2023-09-30T22:27:35.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.753+0000 7f060bb2f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06041202d0 con 0x7f060409e230 2023-09-30T22:27:35.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.753+0000 7f06098cb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f060409d920 0x7f060411d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:35.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.753+0000 7f06098cb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f060409d920 0x7f060411d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56320/0 (socket says 172.21.15.40:56320) 2023-09-30T22:27:35.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.753+0000 7f06098cb700 1 -- 172.21.15.40:0/2607298499 learned_addr learned my addr 172.21.15.40:0/2607298499 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:35.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.753+0000 7f06090ca700 1 --2- 172.21.15.40:0/2607298499 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f060409e230 0x7f060411dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:35.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.753+0000 7f060a0cc700 1 --2- 172.21.15.40:0/2607298499 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0604130fb0 0x7f06041c3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:35.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.754+0000 7f06090ca700 1 -- 172.21.15.40:0/2607298499 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0604130fb0 msgr2=0x7f06041c3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:35.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.754+0000 7f06090ca700 1 --2- 172.21.15.40:0/2607298499 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0604130fb0 0x7f06041c3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.754+0000 7f06090ca700 1 -- 172.21.15.40:0/2607298499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f060409d920 msgr2=0x7f060411d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:35.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.754+0000 7f06090ca700 1 --2- 172.21.15.40:0/2607298499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f060409d920 0x7f060411d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.754+0000 7f06090ca700 1 -- 172.21.15.40:0/2607298499 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05fc009a70 con 0x7f060409e230 2023-09-30T22:27:35.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.754+0000 7f06090ca700 1 --2- 172.21.15.40:0/2607298499 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f060409e230 0x7f060411dc80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f05f400c430 tx=0x7f05f400c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:35.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.754+0000 7f05fa7fc700 1 -- 172.21.15.40:0/2607298499 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f40054e0 con 0x7f060409e230 2023-09-30T22:27:35.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.754+0000 7f05fa7fc700 1 -- 172.21.15.40:0/2607298499 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f400ce40 con 0x7f060409e230 2023-09-30T22:27:35.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.754+0000 7f05fa7fc700 1 -- 172.21.15.40:0/2607298499 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f40038c0 con 0x7f060409e230 2023-09-30T22:27:35.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.754+0000 7f060bb2f700 1 -- 172.21.15.40:0/2607298499 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f060411ea00 con 0x7f060409e230 2023-09-30T22:27:35.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.754+0000 7f060bb2f700 1 -- 172.21.15.40:0/2607298499 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f060411d210 con 0x7f060409e230 2023-09-30T22:27:35.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.755+0000 7f060bb2f700 1 -- 172.21.15.40:0/2607298499 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0604062380 con 0x7f060409e230 2023-09-30T22:27:35.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.755+0000 7f05fa7fc700 1 -- 172.21.15.40:0/2607298499 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f05f4003a20 con 0x7f060409e230 2023-09-30T22:27:35.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.756+0000 7f05fa7fc700 1 -- 172.21.15.40:0/2607298499 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f05f403eaa0 con 0x7f060409e230 2023-09-30T22:27:35.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.760+0000 7f05fa7fc700 1 -- 172.21.15.40:0/2607298499 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f05f4019b40 con 0x7f060409e230 2023-09-30T22:27:35.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.804+0000 7f8a65336700 1 Processor -- start 2023-09-30T22:27:35.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.804+0000 7f8a65336700 1 -- start start 2023-09-30T22:27:35.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.805+0000 7f8a65336700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a6009d920 0x7f8a6009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:35.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.805+0000 7f8a65336700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8a6009f0f0 0x7f8a6009e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:35.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.805+0000 7f8a65336700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a60133ca0 0x7f8a60134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:35.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.805+0000 7f8a65336700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a6006b4c0 con 0x7f8a6009f0f0 2023-09-30T22:27:35.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.805+0000 7f8a65336700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6009a8f0 con 0x7f8a60133ca0 2023-09-30T22:27:35.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.805+0000 7f8a65336700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6009f940 con 0x7f8a6009d920 2023-09-30T22:27:35.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.805+0000 7f8a5effd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a6009d920 0x7f8a6009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:35.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.805+0000 7f8a5effd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a6009d920 0x7f8a6009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56400/0 (socket says 172.21.15.40:56400) 2023-09-30T22:27:35.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.805+0000 7f8a5e7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8a6009f0f0 0x7f8a6009e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:35.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.805+0000 7f8a5effd700 1 -- 172.21.15.40:0/4131466935 learned_addr learned my addr 172.21.15.40:0/4131466935 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:35.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.805+0000 7f8a5f7fe700 1 --2- 172.21.15.40:0/4131466935 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a60133ca0 0x7f8a60134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:35.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.805+0000 7f8a5e7fc700 1 -- 172.21.15.40:0/4131466935 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a6009d920 msgr2=0x7f8a6009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:35.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.805+0000 7f8a5e7fc700 1 --2- 172.21.15.40:0/4131466935 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a6009d920 0x7f8a6009dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.805+0000 7f8a5e7fc700 1 -- 172.21.15.40:0/4131466935 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a60133ca0 msgr2=0x7f8a60134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:35.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.805+0000 7f8a5e7fc700 1 --2- 172.21.15.40:0/4131466935 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a60133ca0 0x7f8a60134140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.805+0000 7f8a5e7fc700 1 -- 172.21.15.40:0/4131466935 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6009f6e0 con 0x7f8a6009f0f0 2023-09-30T22:27:35.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.805+0000 7f8a5e7fc700 1 --2- 172.21.15.40:0/4131466935 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a6009f0f0 0x7f8a6009e230 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f8a54009870 tx=0x7f8a54009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=759a726e87356051 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:35.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.806+0000 7f8a5dffb700 1 -- 172.21.15.40:0/4131466935 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a54011830 con 0x7f8a6009f0f0 2023-09-30T22:27:35.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.806+0000 7f8a5dffb700 1 -- 172.21.15.40:0/4131466935 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a54011990 con 0x7f8a6009f0f0 2023-09-30T22:27:35.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.806+0000 7f8a5dffb700 1 -- 172.21.15.40:0/4131466935 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a54011d20 con 0x7f8a6009f0f0 2023-09-30T22:27:35.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.806+0000 7f8a65336700 1 -- 172.21.15.40:0/4131466935 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a6009f0f0 msgr2=0x7f8a6009e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:35.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.806+0000 7f8a65336700 1 --2- 172.21.15.40:0/4131466935 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a6009f0f0 0x7f8a6009e230 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f8a54009870 tx=0x7f8a54009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:35.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.806+0000 7f8a65336700 1 -- 172.21.15.40:0/4131466935 shutdown_connections 2023-09-30T22:27:35.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.806+0000 7f8a65336700 1 --2- 172.21.15.40:0/4131466935 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a6009d920 0x7f8a6009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.806+0000 7f8a65336700 1 --2- 172.21.15.40:0/4131466935 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a60133ca0 0x7f8a60134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.806+0000 7f8a65336700 1 --2- 172.21.15.40:0/4131466935 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a6009f0f0 0x7f8a6009e230 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.806+0000 7f8a65336700 1 -- 172.21.15.40:0/4131466935 >> 172.21.15.40:0/4131466935 conn(0x7f8a6009fb20 msgr2=0x7f8a6009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:35.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.806+0000 7f8a65336700 1 -- 172.21.15.40:0/4131466935 shutdown_connections 2023-09-30T22:27:35.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.806+0000 7f8a65336700 1 -- 172.21.15.40:0/4131466935 wait complete. 2023-09-30T22:27:35.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.808+0000 7f8a65336700 1 Processor -- start 2023-09-30T22:27:35.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.808+0000 7f8a65336700 1 -- start start 2023-09-30T22:27:35.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.808+0000 7f8a65336700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a6009d920 0x7f8a601219e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:35.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.808+0000 7f8a65336700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a60133ca0 0x7f8a60121f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:35.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.808+0000 7f8a65336700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a60122460 0x7f8a601c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:35.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.808+0000 7f8a65336700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a60124b70 con 0x7f8a6009d920 2023-09-30T22:27:35.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.808+0000 7f8a65336700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a60123560 con 0x7f8a60133ca0 2023-09-30T22:27:35.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.808+0000 7f8a65336700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a60132500 con 0x7f8a60122460 2023-09-30T22:27:35.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.808+0000 7f8a5f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a60122460 0x7f8a601c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:35.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.808+0000 7f8a5f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a60122460 0x7f8a601c87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56404/0 (socket says 172.21.15.40:56404) 2023-09-30T22:27:35.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.808+0000 7f8a5f7fe700 1 -- 172.21.15.40:0/1151867527 learned_addr learned my addr 172.21.15.40:0/1151867527 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:35.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.808+0000 7f8a5effd700 1 --2- 172.21.15.40:0/1151867527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a6009d920 0x7f8a601219e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:35.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.809+0000 7f8a5e7fc700 1 --2- 172.21.15.40:0/1151867527 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a60133ca0 0x7f8a60121f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:35.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.809+0000 7f8a5f7fe700 1 -- 172.21.15.40:0/1151867527 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a60133ca0 msgr2=0x7f8a60121f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:35.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.809+0000 7f8a5f7fe700 1 --2- 172.21.15.40:0/1151867527 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a60133ca0 0x7f8a60121f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.809+0000 7f8a5f7fe700 1 -- 172.21.15.40:0/1151867527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a6009d920 msgr2=0x7f8a601219e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:35.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.809+0000 7f8a5f7fe700 1 --2- 172.21.15.40:0/1151867527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a6009d920 0x7f8a601219e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.809+0000 7f8a5f7fe700 1 -- 172.21.15.40:0/1151867527 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a540094a0 con 0x7f8a60122460 2023-09-30T22:27:35.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.809+0000 7f8a5effd700 1 --2- 172.21.15.40:0/1151867527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a6009d920 0x7f8a601219e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:35.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.809+0000 7f8a5e7fc700 1 --2- 172.21.15.40:0/1151867527 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a60133ca0 0x7f8a60121f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:27:35.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.809+0000 7f8a5f7fe700 1 --2- 172.21.15.40:0/1151867527 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a60122460 0x7f8a601c87b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800efc0 tx=0x7f8a5800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:35.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.809+0000 7f8a477fe700 1 -- 172.21.15.40:0/1151867527 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5800cd40 con 0x7f8a60122460 2023-09-30T22:27:35.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.809+0000 7f8a477fe700 1 -- 172.21.15.40:0/1151867527 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5800f040 con 0x7f8a60122460 2023-09-30T22:27:35.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.809+0000 7f8a477fe700 1 -- 172.21.15.40:0/1151867527 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a580146c0 con 0x7f8a60122460 2023-09-30T22:27:35.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.810+0000 7f8a65336700 1 -- 172.21.15.40:0/1151867527 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a60124f60 con 0x7f8a60122460 2023-09-30T22:27:35.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.810+0000 7f8a65336700 1 -- 172.21.15.40:0/1151867527 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a6009c9e0 con 0x7f8a60122460 2023-09-30T22:27:35.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.810+0000 7f8a477fe700 1 -- 172.21.15.40:0/1151867527 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8a58014820 con 0x7f8a60122460 2023-09-30T22:27:35.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.810+0000 7f8a477fe700 1 -- 172.21.15.40:0/1151867527 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f8a58040010 con 0x7f8a60122460 2023-09-30T22:27:35.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.811+0000 7f8a65336700 1 -- 172.21.15.40:0/1151867527 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a60062380 con 0x7f8a60122460 2023-09-30T22:27:35.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.816+0000 7f8a477fe700 1 -- 172.21.15.40:0/1151867527 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8a58018020 con 0x7f8a60122460 2023-09-30T22:27:35.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.915+0000 7ffa8af86700 1 -- 172.21.15.40:0/2989527787 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ffa841306a0 con 0x7ffa8409c890 2023-09-30T22:27:35.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.916+0000 7ffa817fa700 1 -- 172.21.15.40:0/2989527787 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffa78020030 con 0x7ffa8409c890 2023-09-30T22:27:35.917 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:35.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.918+0000 7ffa8af86700 1 -- 172.21.15.40:0/2989527787 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa8409c890 msgr2=0x7ffa8412d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:35.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.918+0000 7ffa8af86700 1 --2- 172.21.15.40:0/2989527787 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa8409c890 0x7ffa8412d210 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ffa7800e870 tx=0x7ffa7800eb80 comp rx=0 tx=0).stop 2023-09-30T22:27:35.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.918+0000 7ffa8af86700 1 -- 172.21.15.40:0/2989527787 shutdown_connections 2023-09-30T22:27:35.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.918+0000 7ffa8af86700 1 --2- 172.21.15.40:0/2989527787 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa8409e2b0 0x7ffa8412dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.918+0000 7ffa8af86700 1 --2- 172.21.15.40:0/2989527787 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa8409c890 0x7ffa8412d210 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.918+0000 7ffa8af86700 1 --2- 172.21.15.40:0/2989527787 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa8409d920 0x7ffa8412d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.918+0000 7ffa8af86700 1 -- 172.21.15.40:0/2989527787 >> 172.21.15.40:0/2989527787 conn(0x7ffa840a7080 msgr2=0x7ffa840a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:35.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.918+0000 7ffa8af86700 1 -- 172.21.15.40:0/2989527787 shutdown_connections 2023-09-30T22:27:35.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.918+0000 7ffa8af86700 1 -- 172.21.15.40:0/2989527787 wait complete. 2023-09-30T22:27:35.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.919+0000 7f2c2afe1700 1 -- 172.21.15.40:0/1093036311 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2c24062380 con 0x7f2c2409e230 2023-09-30T22:27:35.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.919+0000 7f2c217fa700 1 -- 172.21.15.40:0/1093036311 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2c10018260 con 0x7f2c2409e230 2023-09-30T22:27:35.920 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:35.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.922+0000 7f2c2afe1700 1 -- 172.21.15.40:0/1093036311 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c2409e230 msgr2=0x7f2c2411d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:35.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.922+0000 7f2c2afe1700 1 --2- 172.21.15.40:0/1093036311 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c2409e230 0x7f2c2411d4b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2c1000c4e0 tx=0x7f2c1000c7f0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.923+0000 7f2c2afe1700 1 -- 172.21.15.40:0/1093036311 shutdown_connections 2023-09-30T22:27:35.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.923+0000 7f2c2afe1700 1 --2- 172.21.15.40:0/1093036311 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c24130fb0 0x7f2c2411d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.923+0000 7f2c2afe1700 1 --2- 172.21.15.40:0/1093036311 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c2409d920 0x7f2c2411cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.923+0000 7f2c2afe1700 1 --2- 172.21.15.40:0/1093036311 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c2409e230 0x7f2c2411d4b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.923+0000 7f2c2afe1700 1 -- 172.21.15.40:0/1093036311 >> 172.21.15.40:0/1093036311 conn(0x7f2c2409fb20 msgr2=0x7f2c2412fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:35.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.923+0000 7f2c2afe1700 1 -- 172.21.15.40:0/1093036311 shutdown_connections 2023-09-30T22:27:35.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.923+0000 7f2c2afe1700 1 -- 172.21.15.40:0/1093036311 wait complete. 2023-09-30T22:27:35.936 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:35.937 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:35.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.964+0000 7f060bb2f700 1 -- 172.21.15.40:0/2607298499 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f06040008d0 con 0x7f060409e230 2023-09-30T22:27:35.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.964+0000 7f05fa7fc700 1 -- 172.21.15.40:0/2607298499 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f05f4017030 con 0x7f060409e230 2023-09-30T22:27:35.965 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:35.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.966+0000 7f060bb2f700 1 -- 172.21.15.40:0/2607298499 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f060409e230 msgr2=0x7f060411dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:35.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.966+0000 7f060bb2f700 1 --2- 172.21.15.40:0/2607298499 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f060409e230 0x7f060411dc80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f05f400c430 tx=0x7f05f400c740 comp rx=0 tx=0).stop 2023-09-30T22:27:35.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.967+0000 7f060bb2f700 1 -- 172.21.15.40:0/2607298499 shutdown_connections 2023-09-30T22:27:35.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.967+0000 7f060bb2f700 1 --2- 172.21.15.40:0/2607298499 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0604130fb0 0x7f06041c3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.967+0000 7f060bb2f700 1 --2- 172.21.15.40:0/2607298499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f060409d920 0x7f060411d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.967+0000 7f060bb2f700 1 --2- 172.21.15.40:0/2607298499 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f060409e230 0x7f060411dc80 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.967+0000 7f060bb2f700 1 -- 172.21.15.40:0/2607298499 >> 172.21.15.40:0/2607298499 conn(0x7f060409fb20 msgr2=0x7f060412fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:35.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.967+0000 7f060bb2f700 1 -- 172.21.15.40:0/2607298499 shutdown_connections 2023-09-30T22:27:35.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:35.967+0000 7f060bb2f700 1 -- 172.21.15.40:0/2607298499 wait complete. 2023-09-30T22:27:35.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:36.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:36.044+0000 7f8a65336700 1 -- 172.21.15.40:0/1151867527 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8a60074720 con 0x7f8a60122460 2023-09-30T22:27:36.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:36.044+0000 7f8a477fe700 1 -- 172.21.15.40:0/1151867527 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8a5801a680 con 0x7f8a60122460 2023-09-30T22:27:36.045 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:36.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:36.046+0000 7f8a65336700 1 -- 172.21.15.40:0/1151867527 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a60122460 msgr2=0x7f8a601c87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:36.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:36.046+0000 7f8a65336700 1 --2- 172.21.15.40:0/1151867527 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a60122460 0x7f8a601c87b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800efc0 tx=0x7f8a5800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:36.046+0000 7f8a65336700 1 -- 172.21.15.40:0/1151867527 shutdown_connections 2023-09-30T22:27:36.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:36.046+0000 7f8a65336700 1 --2- 172.21.15.40:0/1151867527 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8a60122460 0x7f8a601c87b0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:36.046+0000 7f8a65336700 1 --2- 172.21.15.40:0/1151867527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a6009d920 0x7f8a601219e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:36.046+0000 7f8a65336700 1 --2- 172.21.15.40:0/1151867527 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8a60133ca0 0x7f8a60121f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:36.046+0000 7f8a65336700 1 -- 172.21.15.40:0/1151867527 >> 172.21.15.40:0/1151867527 conn(0x7f8a6009fb20 msgr2=0x7f8a600a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:36.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:36.047+0000 7f8a65336700 1 -- 172.21.15.40:0/1151867527 shutdown_connections 2023-09-30T22:27:36.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:36.047+0000 7f8a65336700 1 -- 172.21.15.40:0/1151867527 wait complete. 2023-09-30T22:27:36.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:36.937 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:36.938 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:36.981 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:37.060 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:37.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.084+0000 7fad135f3700 1 Processor -- start 2023-09-30T22:27:37.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.084+0000 7fcd00650700 1 Processor -- start 2023-09-30T22:27:37.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.084+0000 7fcd00650700 1 -- start start 2023-09-30T22:27:37.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.084+0000 7fad135f3700 1 -- start start 2023-09-30T22:27:37.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.085+0000 7fad135f3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fad0c09f0f0 0x7fad0c138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.085+0000 7fad135f3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fad0c09e400 0x7fad0c13b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.085+0000 7fad135f3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad0c09f940 con 0x7fad0c09d920 2023-09-30T22:27:37.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.085+0000 7fad135f3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad0c06b4c0 con 0x7fad0c09e400 2023-09-30T22:27:37.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.085+0000 7fad135f3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c09a8f0 con 0x7fad0c09f0f0 2023-09-30T22:27:37.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.085+0000 7fcd00650700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fccf809c890 0x7fccf809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.085+0000 7fcd00650700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fccf809e480 0x7fccf813bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.085+0000 7fcd00650700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccf80a2600 con 0x7fccf809d920 2023-09-30T22:27:37.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.085+0000 7fcd00650700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccf80a29d0 con 0x7fccf809e480 2023-09-30T22:27:37.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.085+0000 7fcd00650700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf809fb40 con 0x7fccf809c890 2023-09-30T22:27:37.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.085+0000 7fad10b8e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fad0c09f0f0 0x7fad0c138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.085+0000 7fccfe3ec700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fccf809c890 0x7fccf809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.086+0000 7fccfe3ec700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fccf809c890 0x7fccf809cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48222/0 (socket says 172.21.15.40:48222) 2023-09-30T22:27:37.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.086+0000 7fccfe3ec700 1 -- 172.21.15.40:0/1774828313 learned_addr learned my addr 172.21.15.40:0/1774828313 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:37.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.086+0000 7fad10b8e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fad0c09f0f0 0x7fad0c138ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56418/0 (socket says 172.21.15.40:56418) 2023-09-30T22:27:37.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.086+0000 7fad10b8e700 1 -- 172.21.15.40:0/1126137534 learned_addr learned my addr 172.21.15.40:0/1126137534 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:37.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.086+0000 7fad10b8e700 1 -- 172.21.15.40:0/1126137534 >> v2:172.21.15.40:3300/0 conn(0x7fad0c09e400 msgr2=0x7fad0c13b430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:27:37.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.086+0000 7fad10b8e700 1 --2- 172.21.15.40:0/1126137534 >> v2:172.21.15.40:3300/0 conn(0x7fad0c09e400 0x7fad0c13b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.086+0000 7fad10b8e700 1 -- 172.21.15.40:0/1126137534 >> v1:172.21.15.40:6789/0 conn(0x7fad0c09d920 legacy=0x7fad0c09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:37.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.086+0000 7fad10b8e700 1 -- 172.21.15.40:0/1126137534 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0c09f6e0 con 0x7fad0c09f0f0 2023-09-30T22:27:37.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.086+0000 7fccfe3ec700 1 -- 172.21.15.40:0/1774828313 >> v2:172.21.15.40:3300/0 conn(0x7fccf809e480 msgr2=0x7fccf813bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:37.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.086+0000 7fccfe3ec700 1 --2- 172.21.15.40:0/1774828313 >> v2:172.21.15.40:3300/0 conn(0x7fccf809e480 0x7fccf813bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.086+0000 7fccfe3ec700 1 -- 172.21.15.40:0/1774828313 >> v1:172.21.15.40:6789/0 conn(0x7fccf809d920 legacy=0x7fccf809dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:37.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.086+0000 7fccfe3ec700 1 -- 172.21.15.40:0/1774828313 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf809fed0 con 0x7fccf809c890 2023-09-30T22:27:37.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.086+0000 7fad10b8e700 1 --2- 172.21.15.40:0/1126137534 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fad0c09f0f0 0x7fad0c138ee0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7facfc0098f0 tx=0x7facfc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5dc6c453d215244 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:37.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.086+0000 7fccfe3ec700 1 --2- 172.21.15.40:0/1774828313 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fccf809c890 0x7fccf809cc60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fcce8006fd0 tx=0x7fcce8009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ecf215545efbaa7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:37.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.086+0000 7fad03fff700 1 -- 172.21.15.40:0/1126137534 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc004230 con 0x7fad0c09f0f0 2023-09-30T22:27:37.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.086+0000 7fad03fff700 1 -- 172.21.15.40:0/1126137534 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facfc004390 con 0x7fad0c09f0f0 2023-09-30T22:27:37.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.086+0000 7fad03fff700 1 -- 172.21.15.40:0/1126137534 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc0036a0 con 0x7fad0c09f0f0 2023-09-30T22:27:37.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.087+0000 7fccfd3ea700 1 -- 172.21.15.40:0/1774828313 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce8005e30 con 0x7fccf809c890 2023-09-30T22:27:37.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.087+0000 7fccfd3ea700 1 -- 172.21.15.40:0/1774828313 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce8006030 con 0x7fccf809c890 2023-09-30T22:27:37.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.087+0000 7fccfd3ea700 1 -- 172.21.15.40:0/1774828313 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce80063c0 con 0x7fccf809c890 2023-09-30T22:27:37.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.087+0000 7fad135f3700 1 -- 172.21.15.40:0/1126137534 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fad0c09f0f0 msgr2=0x7fad0c138ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:37.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.087+0000 7fad135f3700 1 --2- 172.21.15.40:0/1126137534 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fad0c09f0f0 0x7fad0c138ee0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7facfc0098f0 tx=0x7facfc009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:37.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.087+0000 7fad135f3700 1 -- 172.21.15.40:0/1126137534 shutdown_connections 2023-09-30T22:27:37.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.087+0000 7fad135f3700 1 --2- 172.21.15.40:0/1126137534 >> v2:172.21.15.40:3300/0 conn(0x7fad0c09e400 0x7fad0c13b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.087+0000 7fad135f3700 1 --2- 172.21.15.40:0/1126137534 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fad0c09f0f0 0x7fad0c138ee0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.087+0000 7fad135f3700 1 -- 172.21.15.40:0/1126137534 >> 172.21.15.40:0/1126137534 conn(0x7fad0c09fb20 msgr2=0x7fad0c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:37.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.087+0000 7fad135f3700 1 -- 172.21.15.40:0/1126137534 shutdown_connections 2023-09-30T22:27:37.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.088+0000 7fad135f3700 1 -- 172.21.15.40:0/1126137534 wait complete. 2023-09-30T22:27:37.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.088+0000 7fcd00650700 1 -- 172.21.15.40:0/1774828313 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fccf809c890 msgr2=0x7fccf809cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:37.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.088+0000 7fcd00650700 1 --2- 172.21.15.40:0/1774828313 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fccf809c890 0x7fccf809cc60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fcce8006fd0 tx=0x7fcce8009bd0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.088+0000 7fcd00650700 1 -- 172.21.15.40:0/1774828313 shutdown_connections 2023-09-30T22:27:37.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.088+0000 7fcd00650700 1 --2- 172.21.15.40:0/1774828313 >> v2:172.21.15.40:3300/0 conn(0x7fccf809e480 0x7fccf813bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.088+0000 7fcd00650700 1 --2- 172.21.15.40:0/1774828313 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fccf809c890 0x7fccf809cc60 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.088+0000 7fcd00650700 1 -- 172.21.15.40:0/1774828313 >> 172.21.15.40:0/1774828313 conn(0x7fccf80a7080 msgr2=0x7fccf80a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:37.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.088+0000 7fcd00650700 1 -- 172.21.15.40:0/1774828313 shutdown_connections 2023-09-30T22:27:37.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.088+0000 7fcd00650700 1 -- 172.21.15.40:0/1774828313 wait complete. 2023-09-30T22:27:37.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.089+0000 7fad135f3700 1 Processor -- start 2023-09-30T22:27:37.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.090+0000 7fcd00650700 1 Processor -- start 2023-09-30T22:27:37.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.090+0000 7fcd00650700 1 -- start start 2023-09-30T22:27:37.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.090+0000 7fcd00650700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccf809c890 0x7fccf81c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.090+0000 7fcd00650700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fccf809d920 0x7fccf81c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.091+0000 7fcd00650700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fccf809e480 0x7fccf812d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.091+0000 7fcd00650700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf812eed0 con 0x7fccf809c890 2023-09-30T22:27:37.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.091+0000 7fcd00650700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf809ecf0 con 0x7fccf809e480 2023-09-30T22:27:37.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.091+0000 7fcd00650700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fccf8130e50 con 0x7fccf809d920 2023-09-30T22:27:37.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.091+0000 7fccfe3ec700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccf809c890 0x7fccf81c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.091+0000 7fccfebed700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fccf809e480 0x7fccf812d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.091+0000 7fccfe3ec700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccf809c890 0x7fccf81c8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56354/0 (socket says 172.21.15.40:56354) 2023-09-30T22:27:37.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.091+0000 7fccfe3ec700 1 -- 172.21.15.40:0/2138883030 learned_addr learned my addr 172.21.15.40:0/2138883030 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:37.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.091+0000 7fccfdbeb700 1 --2- 172.21.15.40:0/2138883030 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fccf809d920 0x7fccf81c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.091+0000 7fad135f3700 1 -- start start 2023-09-30T22:27:37.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.091+0000 7fccfebed700 1 -- 172.21.15.40:0/2138883030 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fccf809d920 msgr2=0x7fccf81c9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:37.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.091+0000 7fccfebed700 1 --2- 172.21.15.40:0/2138883030 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fccf809d920 0x7fccf81c9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.091+0000 7fccfebed700 1 -- 172.21.15.40:0/2138883030 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccf809c890 msgr2=0x7fccf81c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:37.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.091+0000 7fccfebed700 1 --2- 172.21.15.40:0/2138883030 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccf809c890 0x7fccf81c8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.091+0000 7fccfebed700 1 -- 172.21.15.40:0/2138883030 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce8009500 con 0x7fccf809e480 2023-09-30T22:27:37.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.091+0000 7fccfebed700 1 --2- 172.21.15.40:0/2138883030 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fccf809e480 0x7fccf812d4d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fccf000bdf0 tx=0x7fccf0009ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:37.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.092+0000 7fad135f3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad0c09d920 0x7fad0c1cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.092+0000 7fad135f3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad0c09e400 0x7fad0c1cce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.092+0000 7fad135f3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fad0c1cd3b0 0x7fad0c134f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.092+0000 7fad135f3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c1397d0 con 0x7fad0c09e400 2023-09-30T22:27:37.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.092+0000 7fad135f3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c1395e0 con 0x7fad0c09d920 2023-09-30T22:27:37.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.092+0000 7fad135f3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c13a2c0 con 0x7fad0c1cd3b0 2023-09-30T22:27:37.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.092+0000 7fad11b90700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fad0c1cd3b0 0x7fad0c134f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.092+0000 7fad11b90700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fad0c1cd3b0 0x7fad0c134f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56434/0 (socket says 172.21.15.40:56434) 2023-09-30T22:27:37.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.092+0000 7fad11b90700 1 -- 172.21.15.40:0/3560392524 learned_addr learned my addr 172.21.15.40:0/3560392524 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:37.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.092+0000 7fcceeffd700 1 -- 172.21.15.40:0/2138883030 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf000cc10 con 0x7fccf809e480 2023-09-30T22:27:37.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.092+0000 7fcceeffd700 1 -- 172.21.15.40:0/2138883030 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf000cd90 con 0x7fccf809e480 2023-09-30T22:27:37.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.092+0000 7fcceeffd700 1 -- 172.21.15.40:0/2138883030 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf0014680 con 0x7fccf809e480 2023-09-30T22:27:37.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.092+0000 7fad11b90700 1 -- 172.21.15.40:0/3560392524 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad0c09d920 msgr2=0x7fad0c1cc930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:27:37.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.092+0000 7fad11b90700 1 --2- 172.21.15.40:0/3560392524 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad0c09d920 0x7fad0c1cc930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.092+0000 7fad11b90700 1 -- 172.21.15.40:0/3560392524 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad0c09e400 msgr2=0x7fad0c1cce70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:27:37.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.092+0000 7fad11b90700 1 --2- 172.21.15.40:0/3560392524 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad0c09e400 0x7fad0c1cce70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.092+0000 7fad11b90700 1 -- 172.21.15.40:0/3560392524 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facfc009550 con 0x7fad0c1cd3b0 2023-09-30T22:27:37.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.092+0000 7fcd00650700 1 -- 172.21.15.40:0/2138883030 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccf812f7a0 con 0x7fccf809e480 2023-09-30T22:27:37.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.092+0000 7fcd00650700 1 -- 172.21.15.40:0/2138883030 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf812f440 con 0x7fccf809e480 2023-09-30T22:27:37.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.093+0000 7fad11b90700 1 --2- 172.21.15.40:0/3560392524 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fad0c1cd3b0 0x7fad0c134f20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fad0400b970 tx=0x7fad0400bd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:37.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.093+0000 7fad01ffb700 1 -- 172.21.15.40:0/3560392524 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0400c9b0 con 0x7fad0c1cd3b0 2023-09-30T22:27:37.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.093+0000 7fcd00650700 1 -- 172.21.15.40:0/2138883030 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccf81309d0 con 0x7fccf809e480 2023-09-30T22:27:37.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.094+0000 7fcceeffd700 1 -- 172.21.15.40:0/2138883030 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fccf001c360 con 0x7fccf809e480 2023-09-30T22:27:37.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.093+0000 7fad01ffb700 1 -- 172.21.15.40:0/3560392524 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0400cb10 con 0x7fad0c1cd3b0 2023-09-30T22:27:37.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.093+0000 7fad135f3700 1 -- 172.21.15.40:0/3560392524 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad0c09c9e0 con 0x7fad0c1cd3b0 2023-09-30T22:27:37.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.093+0000 7fad01ffb700 1 -- 172.21.15.40:0/3560392524 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad04014440 con 0x7fad0c1cd3b0 2023-09-30T22:27:37.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.093+0000 7fad135f3700 1 -- 172.21.15.40:0/3560392524 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad0c0a3480 con 0x7fad0c1cd3b0 2023-09-30T22:27:37.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.094+0000 7fcceeffd700 1 -- 172.21.15.40:0/2138883030 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fccf0006e40 con 0x7fccf809e480 2023-09-30T22:27:37.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.094+0000 7fad135f3700 1 -- 172.21.15.40:0/3560392524 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad0c062380 con 0x7fad0c1cd3b0 2023-09-30T22:27:37.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.095+0000 7fad01ffb700 1 -- 172.21.15.40:0/3560392524 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fad0401d3b0 con 0x7fad0c1cd3b0 2023-09-30T22:27:37.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.095+0000 7fad01ffb700 1 -- 172.21.15.40:0/3560392524 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fad0403f640 con 0x7fad0c1cd3b0 2023-09-30T22:27:37.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.100+0000 7fad01ffb700 1 -- 172.21.15.40:0/3560392524 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fad0401c360 con 0x7fad0c1cd3b0 2023-09-30T22:27:37.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.102+0000 7fcceeffd700 1 -- 172.21.15.40:0/2138883030 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fccf001be40 con 0x7fccf809e480 2023-09-30T22:27:37.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.138+0000 7f3e74919700 1 Processor -- start 2023-09-30T22:27:37.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.138+0000 7f3e74919700 1 -- start start 2023-09-30T22:27:37.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.139+0000 7f3e74919700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3e7009c890 0x7f3e7009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.139+0000 7f3e74919700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e7009d920 0x7f3e7009dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.139+0000 7f3e74919700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e700a2600 con 0x7f3e7009e2b0 2023-09-30T22:27:37.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.139+0000 7f3e74919700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e700a29d0 con 0x7f3e7009c890 2023-09-30T22:27:37.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.139+0000 7f3e74919700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7009fb40 con 0x7f3e7009d920 2023-09-30T22:27:37.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.139+0000 7f3e6dd9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e7009d920 0x7f3e7009dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.139+0000 7f3e6dd9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e7009d920 0x7f3e7009dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56450/0 (socket says 172.21.15.40:56450) 2023-09-30T22:27:37.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.139+0000 7f3e6dd9b700 1 -- 172.21.15.40:0/1950740469 learned_addr learned my addr 172.21.15.40:0/1950740469 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:37.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.140+0000 7f3e6e59c700 1 --2- 172.21.15.40:0/1950740469 >> v2:172.21.15.40:3300/0 conn(0x7f3e7009c890 0x7f3e7009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.140+0000 7f3e6dd9b700 1 -- 172.21.15.40:0/1950740469 >> v2:172.21.15.40:3300/0 conn(0x7f3e7009c890 msgr2=0x7f3e7009cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:37.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.140+0000 7f3e6dd9b700 1 --2- 172.21.15.40:0/1950740469 >> v2:172.21.15.40:3300/0 conn(0x7f3e7009c890 0x7f3e7009cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.140+0000 7f3e6dd9b700 1 -- 172.21.15.40:0/1950740469 >> v1:172.21.15.40:6789/0 conn(0x7f3e7009e2b0 legacy=0x7f3e7013ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:37.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.140+0000 7f3e6dd9b700 1 -- 172.21.15.40:0/1950740469 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7009e730 con 0x7f3e7009d920 2023-09-30T22:27:37.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.140+0000 7f3e6dd9b700 1 --2- 172.21.15.40:0/1950740469 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e7009d920 0x7f3e7009dd70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3e640098f0 tx=0x7f3e64009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3964ea5c3b19d269 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:37.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.140+0000 7f3e6d59a700 1 -- 172.21.15.40:0/1950740469 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e64011830 con 0x7f3e7009d920 2023-09-30T22:27:37.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.140+0000 7f3e6d59a700 1 -- 172.21.15.40:0/1950740469 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e64011990 con 0x7f3e7009d920 2023-09-30T22:27:37.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.140+0000 7f3e6d59a700 1 -- 172.21.15.40:0/1950740469 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e64011d20 con 0x7f3e7009d920 2023-09-30T22:27:37.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.141+0000 7f3e74919700 1 -- 172.21.15.40:0/1950740469 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e7009d920 msgr2=0x7f3e7009dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:37.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.141+0000 7f3e74919700 1 --2- 172.21.15.40:0/1950740469 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e7009d920 0x7f3e7009dd70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3e640098f0 tx=0x7f3e64009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:37.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.141+0000 7f3e74919700 1 -- 172.21.15.40:0/1950740469 shutdown_connections 2023-09-30T22:27:37.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.141+0000 7f3e74919700 1 --2- 172.21.15.40:0/1950740469 >> v2:172.21.15.40:3300/0 conn(0x7f3e7009c890 0x7f3e7009cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.141+0000 7f3e74919700 1 --2- 172.21.15.40:0/1950740469 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e7009d920 0x7f3e7009dd70 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.141+0000 7f3e74919700 1 -- 172.21.15.40:0/1950740469 >> 172.21.15.40:0/1950740469 conn(0x7f3e700a7080 msgr2=0x7f3e700a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:37.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.141+0000 7f3e74919700 1 -- 172.21.15.40:0/1950740469 shutdown_connections 2023-09-30T22:27:37.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.141+0000 7f3e74919700 1 -- 172.21.15.40:0/1950740469 wait complete. 2023-09-30T22:27:37.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.143+0000 7f3e74919700 1 Processor -- start 2023-09-30T22:27:37.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.143+0000 7f3e74919700 1 -- start start 2023-09-30T22:27:37.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.144+0000 7f3e74919700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e7009c890 0x7f3e7012d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.144+0000 7f3e74919700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e7009d920 0x7f3e7012d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.144+0000 7f3e74919700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e7009e2b0 0x7f3e7012deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.144+0000 7f3e74919700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7012fb20 con 0x7f3e7009e2b0 2023-09-30T22:27:37.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.144+0000 7f3e74919700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e70130b80 con 0x7f3e7009c890 2023-09-30T22:27:37.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.144+0000 7f3e74919700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e700a5ce0 con 0x7f3e7009d920 2023-09-30T22:27:37.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.144+0000 7f3e6dd9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e7009d920 0x7f3e7012d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.144+0000 7f3e6dd9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e7009d920 0x7f3e7012d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56460/0 (socket says 172.21.15.40:56460) 2023-09-30T22:27:37.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.144+0000 7f3e6dd9b700 1 -- 172.21.15.40:0/2236780325 learned_addr learned my addr 172.21.15.40:0/2236780325 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:37.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.144+0000 7f3e6e59c700 1 --2- 172.21.15.40:0/2236780325 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e7009c890 0x7f3e7012d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.144+0000 7f3e6ed9d700 1 --2- 172.21.15.40:0/2236780325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e7009e2b0 0x7f3e7012deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.144+0000 7f3e6dd9b700 1 -- 172.21.15.40:0/2236780325 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e7009c890 msgr2=0x7f3e7012d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:37.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.144+0000 7f3e6dd9b700 1 --2- 172.21.15.40:0/2236780325 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e7009c890 0x7f3e7012d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.144+0000 7f3e6dd9b700 1 -- 172.21.15.40:0/2236780325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e7009e2b0 msgr2=0x7f3e7012deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:37.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.144+0000 7f3e6dd9b700 1 --2- 172.21.15.40:0/2236780325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e7009e2b0 0x7f3e7012deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.144+0000 7f3e6dd9b700 1 -- 172.21.15.40:0/2236780325 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e64009550 con 0x7f3e7009d920 2023-09-30T22:27:37.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.144+0000 7f3e6ed9d700 1 --2- 172.21.15.40:0/2236780325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e7009e2b0 0x7f3e7012deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:37.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.144+0000 7f3e6dd9b700 1 --2- 172.21.15.40:0/2236780325 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e7009d920 0x7f3e7012d970 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3e64000c00 tx=0x7f3e64004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:37.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.145+0000 7f3e5effd700 1 -- 172.21.15.40:0/2236780325 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e640036a0 con 0x7f3e7009d920 2023-09-30T22:27:37.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.145+0000 7f3e5effd700 1 -- 172.21.15.40:0/2236780325 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e64003800 con 0x7f3e7009d920 2023-09-30T22:27:37.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.145+0000 7f3e5effd700 1 -- 172.21.15.40:0/2236780325 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e64003b70 con 0x7f3e7009d920 2023-09-30T22:27:37.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.145+0000 7f3e74919700 1 -- 172.21.15.40:0/2236780325 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e7009ecf0 con 0x7f3e7009d920 2023-09-30T22:27:37.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.145+0000 7f3e74919700 1 -- 172.21.15.40:0/2236780325 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e70130640 con 0x7f3e7009d920 2023-09-30T22:27:37.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.146+0000 7f3e74919700 1 -- 172.21.15.40:0/2236780325 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e7009c340 con 0x7f3e7009d920 2023-09-30T22:27:37.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.147+0000 7f3e5effd700 1 -- 172.21.15.40:0/2236780325 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3e64021070 con 0x7f3e7009d920 2023-09-30T22:27:37.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.147+0000 7f3e5effd700 1 -- 172.21.15.40:0/2236780325 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3e64040fe0 con 0x7f3e7009d920 2023-09-30T22:27:37.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.151+0000 7f3e5effd700 1 -- 172.21.15.40:0/2236780325 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3e6401a450 con 0x7f3e7009d920 2023-09-30T22:27:37.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.202+0000 7f769ba27700 1 Processor -- start 2023-09-30T22:27:37.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.202+0000 7f769ba27700 1 -- start start 2023-09-30T22:27:37.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.203+0000 7f769ba27700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f769409d920 0x7f769409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.203+0000 7f769ba27700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f769409f0f0 0x7f769409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.203+0000 7f769ba27700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f769409f940 con 0x7f7694133ca0 2023-09-30T22:27:37.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.203+0000 7f769ba27700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f769406b4c0 con 0x7f769409f0f0 2023-09-30T22:27:37.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.203+0000 7f769ba27700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f769409a8f0 con 0x7f769409d920 2023-09-30T22:27:37.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.203+0000 7f76997c3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f769409d920 0x7f769409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.203+0000 7f76997c3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f769409d920 0x7f769409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56464/0 (socket says 172.21.15.40:56464) 2023-09-30T22:27:37.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.203+0000 7f76997c3700 1 -- 172.21.15.40:0/3096069751 learned_addr learned my addr 172.21.15.40:0/3096069751 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:37.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.203+0000 7f7699fc4700 1 --1- 172.21.15.40:0/3096069751 >> v1:172.21.15.40:6789/0 conn(0x7f7694133ca0 0x7f7694134140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41598/0 (socket says 172.21.15.40:41598) 2023-09-30T22:27:37.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.203+0000 7f7698fc2700 1 --2- 172.21.15.40:0/3096069751 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f769409f0f0 0x7f769409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.203+0000 7f76997c3700 1 -- 172.21.15.40:0/3096069751 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f769409f0f0 msgr2=0x7f769409e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:37.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.203+0000 7f76997c3700 1 --2- 172.21.15.40:0/3096069751 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f769409f0f0 0x7f769409e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.204+0000 7f76997c3700 1 -- 172.21.15.40:0/3096069751 >> v1:172.21.15.40:6789/0 conn(0x7f7694133ca0 legacy=0x7f7694134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:37.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.204+0000 7f768bfff700 1 -- 172.21.15.40:0/3096069751 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1133801866 0 0) 0x7f769409f940 con 0x7f7694133ca0 2023-09-30T22:27:37.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.204+0000 7f76997c3700 1 -- 172.21.15.40:0/3096069751 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f769409f6e0 con 0x7f769409d920 2023-09-30T22:27:37.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.204+0000 7f76997c3700 1 --2- 172.21.15.40:0/3096069751 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f769409d920 0x7f769409dcf0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7690009920 tx=0x7f7690009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cff306b978bb307 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:37.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.204+0000 7f768bfff700 1 -- 172.21.15.40:0/3096069751 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7690005e30 con 0x7f769409d920 2023-09-30T22:27:37.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.204+0000 7f768bfff700 1 -- 172.21.15.40:0/3096069751 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7690009e70 con 0x7f769409d920 2023-09-30T22:27:37.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.204+0000 7f768bfff700 1 -- 172.21.15.40:0/3096069751 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7690004250 con 0x7f769409d920 2023-09-30T22:27:37.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.205+0000 7f769ba27700 1 -- 172.21.15.40:0/3096069751 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f769409d920 msgr2=0x7f769409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:37.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.205+0000 7f769ba27700 1 --2- 172.21.15.40:0/3096069751 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f769409d920 0x7f769409dcf0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7690009920 tx=0x7f7690009c30 comp rx=0 tx=0).stop 2023-09-30T22:27:37.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.205+0000 7f769ba27700 1 -- 172.21.15.40:0/3096069751 shutdown_connections 2023-09-30T22:27:37.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.205+0000 7f769ba27700 1 --2- 172.21.15.40:0/3096069751 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f769409d920 0x7f769409dcf0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.205+0000 7f769ba27700 1 --2- 172.21.15.40:0/3096069751 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f769409f0f0 0x7f769409e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.205+0000 7f769ba27700 1 -- 172.21.15.40:0/3096069751 >> 172.21.15.40:0/3096069751 conn(0x7f769409fb20 msgr2=0x7f769409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:37.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.205+0000 7f769ba27700 1 -- 172.21.15.40:0/3096069751 shutdown_connections 2023-09-30T22:27:37.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.205+0000 7f769ba27700 1 -- 172.21.15.40:0/3096069751 wait complete. 2023-09-30T22:27:37.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.206+0000 7f769ba27700 1 Processor -- start 2023-09-30T22:27:37.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.206+0000 7f769ba27700 1 -- start start 2023-09-30T22:27:37.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.207+0000 7f769ba27700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f769409d920 0x7f76941203c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.207+0000 7f769ba27700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7694133ca0 0x7f7694120900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.207+0000 7f769ba27700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f76941243e0 0x7f7694120e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.207+0000 7f769ba27700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7694123ee0 con 0x7f769409d920 2023-09-30T22:27:37.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.207+0000 7f769ba27700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76941225f0 con 0x7f7694133ca0 2023-09-30T22:27:37.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.207+0000 7f769ba27700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76941232b0 con 0x7f76941243e0 2023-09-30T22:27:37.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.207+0000 7f7699fc4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f76941243e0 0x7f7694120e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.207+0000 7f7698fc2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7694133ca0 0x7f7694120900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.207+0000 7f7699fc4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f76941243e0 0x7f7694120e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56480/0 (socket says 172.21.15.40:56480) 2023-09-30T22:27:37.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.207+0000 7f7698fc2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7694133ca0 0x7f7694120900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48256/0 (socket says 172.21.15.40:48256) 2023-09-30T22:27:37.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.207+0000 7f7699fc4700 1 -- 172.21.15.40:0/3472290620 learned_addr learned my addr 172.21.15.40:0/3472290620 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:37.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.207+0000 7f76997c3700 1 --2- 172.21.15.40:0/3472290620 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f769409d920 0x7f76941203c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.208+0000 7f7699fc4700 1 -- 172.21.15.40:0/3472290620 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7694133ca0 msgr2=0x7f7694120900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:37.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.208+0000 7f7699fc4700 1 --2- 172.21.15.40:0/3472290620 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7694133ca0 0x7f7694120900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.208+0000 7f7699fc4700 1 -- 172.21.15.40:0/3472290620 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f769409d920 msgr2=0x7f76941203c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:37.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.208+0000 7f7699fc4700 1 --2- 172.21.15.40:0/3472290620 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f769409d920 0x7f76941203c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.208+0000 7f7699fc4700 1 -- 172.21.15.40:0/3472290620 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7690009500 con 0x7f76941243e0 2023-09-30T22:27:37.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.208+0000 7f7698fc2700 1 --2- 172.21.15.40:0/3472290620 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7694133ca0 0x7f7694120900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:37.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.208+0000 7f7699fc4700 1 --2- 172.21.15.40:0/3472290620 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f76941243e0 0x7f7694120e40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f768c00cc70 tx=0x7f768c00cf80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:37.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.208+0000 7f7689ffb700 1 -- 172.21.15.40:0/3472290620 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c00aac0 con 0x7f76941243e0 2023-09-30T22:27:37.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.208+0000 7f7689ffb700 1 -- 172.21.15.40:0/3472290620 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f768c00ac40 con 0x7f76941243e0 2023-09-30T22:27:37.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.208+0000 7f769ba27700 1 -- 172.21.15.40:0/3472290620 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76940a2590 con 0x7f76941243e0 2023-09-30T22:27:37.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.208+0000 7f7689ffb700 1 -- 172.21.15.40:0/3472290620 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c0070d0 con 0x7f76941243e0 2023-09-30T22:27:37.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.208+0000 7f769ba27700 1 -- 172.21.15.40:0/3472290620 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76941236c0 con 0x7f76941243e0 2023-09-30T22:27:37.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.209+0000 7f7689ffb700 1 -- 172.21.15.40:0/3472290620 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f768c007250 con 0x7f76941243e0 2023-09-30T22:27:37.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.209+0000 7f7689ffb700 1 -- 172.21.15.40:0/3472290620 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f768c03f540 con 0x7f76941243e0 2023-09-30T22:27:37.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.209+0000 7f769ba27700 1 -- 172.21.15.40:0/3472290620 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7694123a60 con 0x7f76941243e0 2023-09-30T22:27:37.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.214+0000 7f7689ffb700 1 -- 172.21.15.40:0/3472290620 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7694123a60 con 0x7f76941243e0 2023-09-30T22:27:37.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.324+0000 7fcd00650700 1 -- 172.21.15.40:0/2138883030 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fccf81309d0 con 0x7fccf809e480 2023-09-30T22:27:37.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.325+0000 7fcceeffd700 1 -- 172.21.15.40:0/2138883030 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fccf81309d0 con 0x7fccf809e480 2023-09-30T22:27:37.325 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:37.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.327+0000 7fcd00650700 1 -- 172.21.15.40:0/2138883030 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fccf809e480 msgr2=0x7fccf812d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:37.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.327+0000 7fcd00650700 1 --2- 172.21.15.40:0/2138883030 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fccf809e480 0x7fccf812d4d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fccf000bdf0 tx=0x7fccf0009ed0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.327+0000 7fcd00650700 1 -- 172.21.15.40:0/2138883030 shutdown_connections 2023-09-30T22:27:37.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.327+0000 7fcd00650700 1 --2- 172.21.15.40:0/2138883030 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fccf809e480 0x7fccf812d4d0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.327+0000 7fcd00650700 1 --2- 172.21.15.40:0/2138883030 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccf809c890 0x7fccf81c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.327+0000 7fcd00650700 1 --2- 172.21.15.40:0/2138883030 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fccf809d920 0x7fccf81c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.327+0000 7fcd00650700 1 -- 172.21.15.40:0/2138883030 >> 172.21.15.40:0/2138883030 conn(0x7fccf80a7080 msgr2=0x7fccf80a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:37.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.328+0000 7fcd00650700 1 -- 172.21.15.40:0/2138883030 shutdown_connections 2023-09-30T22:27:37.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.331+0000 7fcd00650700 1 -- 172.21.15.40:0/2138883030 wait complete. 2023-09-30T22:27:37.344 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:37.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.357+0000 7fad135f3700 1 -- 172.21.15.40:0/3560392524 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fad0c074720 con 0x7fad0c1cd3b0 2023-09-30T22:27:37.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.358+0000 7fad01ffb700 1 -- 172.21.15.40:0/3560392524 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fad04019070 con 0x7fad0c1cd3b0 2023-09-30T22:27:37.359 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:37.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.360+0000 7fad135f3700 1 -- 172.21.15.40:0/3560392524 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fad0c1cd3b0 msgr2=0x7fad0c134f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:37.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.360+0000 7fad135f3700 1 --2- 172.21.15.40:0/3560392524 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fad0c1cd3b0 0x7fad0c134f20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fad0400b970 tx=0x7fad0400bd30 comp rx=0 tx=0).stop 2023-09-30T22:27:37.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.360+0000 7fad135f3700 1 -- 172.21.15.40:0/3560392524 shutdown_connections 2023-09-30T22:27:37.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.360+0000 7fad135f3700 1 --2- 172.21.15.40:0/3560392524 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fad0c1cd3b0 0x7fad0c134f20 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.360+0000 7fad135f3700 1 --2- 172.21.15.40:0/3560392524 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad0c09d920 0x7fad0c1cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.360+0000 7fad135f3700 1 --2- 172.21.15.40:0/3560392524 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad0c09e400 0x7fad0c1cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.360+0000 7fad135f3700 1 -- 172.21.15.40:0/3560392524 >> 172.21.15.40:0/3560392524 conn(0x7fad0c09fb20 msgr2=0x7fad0c070960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:37.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.360+0000 7fad135f3700 1 -- 172.21.15.40:0/3560392524 shutdown_connections 2023-09-30T22:27:37.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.360+0000 7fad135f3700 1 -- 172.21.15.40:0/3560392524 wait complete. 2023-09-30T22:27:37.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:37.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.394+0000 7f3e74919700 1 -- 172.21.15.40:0/2236780325 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3e70062380 con 0x7f3e7009d920 2023-09-30T22:27:37.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.394+0000 7f3e5effd700 1 -- 172.21.15.40:0/2236780325 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3e64015030 con 0x7f3e7009d920 2023-09-30T22:27:37.395 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:37.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.396+0000 7f3e74919700 1 -- 172.21.15.40:0/2236780325 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e7009d920 msgr2=0x7f3e7012d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:37.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.396+0000 7f3e74919700 1 --2- 172.21.15.40:0/2236780325 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e7009d920 0x7f3e7012d970 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3e64000c00 tx=0x7f3e64004750 comp rx=0 tx=0).stop 2023-09-30T22:27:37.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.396+0000 7f3e74919700 1 -- 172.21.15.40:0/2236780325 shutdown_connections 2023-09-30T22:27:37.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.396+0000 7f3e74919700 1 --2- 172.21.15.40:0/2236780325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e7009e2b0 0x7f3e7012deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.396+0000 7f3e74919700 1 --2- 172.21.15.40:0/2236780325 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e7009c890 0x7f3e7012d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.396+0000 7f3e74919700 1 --2- 172.21.15.40:0/2236780325 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e7009d920 0x7f3e7012d970 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.396+0000 7f3e74919700 1 -- 172.21.15.40:0/2236780325 >> 172.21.15.40:0/2236780325 conn(0x7f3e700a7080 msgr2=0x7f3e700a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:37.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.397+0000 7f3e74919700 1 -- 172.21.15.40:0/2236780325 shutdown_connections 2023-09-30T22:27:37.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.397+0000 7f3e74919700 1 -- 172.21.15.40:0/2236780325 wait complete. 2023-09-30T22:27:37.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:37.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.411+0000 7f769ba27700 1 -- 172.21.15.40:0/3472290620 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7694123a60 con 0x7f76941243e0 2023-09-30T22:27:37.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.412+0000 7f7689ffb700 1 -- 172.21.15.40:0/3472290620 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7694123a60 con 0x7f76941243e0 2023-09-30T22:27:37.412 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:37.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.414+0000 7f769ba27700 1 -- 172.21.15.40:0/3472290620 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f76941243e0 msgr2=0x7f7694120e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:37.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.414+0000 7f769ba27700 1 --2- 172.21.15.40:0/3472290620 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f76941243e0 0x7f7694120e40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f768c00cc70 tx=0x7f768c00cf80 comp rx=0 tx=0).stop 2023-09-30T22:27:37.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.414+0000 7f769ba27700 1 -- 172.21.15.40:0/3472290620 shutdown_connections 2023-09-30T22:27:37.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.414+0000 7f769ba27700 1 --2- 172.21.15.40:0/3472290620 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f76941243e0 0x7f7694120e40 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.414+0000 7f769ba27700 1 --2- 172.21.15.40:0/3472290620 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f769409d920 0x7f76941203c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.414+0000 7f769ba27700 1 --2- 172.21.15.40:0/3472290620 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7694133ca0 0x7f7694120900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.414+0000 7f769ba27700 1 -- 172.21.15.40:0/3472290620 >> 172.21.15.40:0/3472290620 conn(0x7f769409fb20 msgr2=0x7f76941bafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:37.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.414+0000 7f769ba27700 1 -- 172.21.15.40:0/3472290620 shutdown_connections 2023-09-30T22:27:37.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:37.414+0000 7f769ba27700 1 -- 172.21.15.40:0/3472290620 wait complete. 2023-09-30T22:27:37.427 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:38.345 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:38.373 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:38.410 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:38.428 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:38.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.492+0000 7fefb0679700 1 Processor -- start 2023-09-30T22:27:38.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.492+0000 7fefb0679700 1 -- start start 2023-09-30T22:27:38.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.493+0000 7fefb0679700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefa809d920 0x7fefa809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:38.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.493+0000 7fefb0679700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefa809e230 0x7fefa81308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:38.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.493+0000 7fefb0679700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefa809adf0 con 0x7fefa8130de0 2023-09-30T22:27:38.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.493+0000 7fefb0679700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa809edf0 con 0x7fefa809d920 2023-09-30T22:27:38.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.493+0000 7fefb0679700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fefa809b660 con 0x7fefa809e230 2023-09-30T22:27:38.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.493+0000 7fefadc14700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefa809e230 0x7fefa81308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:38.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.493+0000 7fefadc14700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefa809e230 0x7fefa81308a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56490/0 (socket says 172.21.15.40:56490) 2023-09-30T22:27:38.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.493+0000 7fefadc14700 1 -- 172.21.15.40:0/573512805 learned_addr learned my addr 172.21.15.40:0/573512805 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:38.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.494+0000 7fefae415700 1 --2- 172.21.15.40:0/573512805 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefa809d920 0x7fefa809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:38.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.494+0000 7fefad413700 1 -- 172.21.15.40:0/573512805 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2477989444 0 0) 0x7fefa809adf0 con 0x7fefa8130de0 2023-09-30T22:27:38.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.494+0000 7fefad413700 1 -- 172.21.15.40:0/573512805 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef940035b0 con 0x7fefa8130de0 2023-09-30T22:27:38.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.494+0000 7fefadc14700 1 -- 172.21.15.40:0/573512805 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefa809d920 msgr2=0x7fefa809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:38.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.494+0000 7fefadc14700 1 --2- 172.21.15.40:0/573512805 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefa809d920 0x7fefa809dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.494+0000 7fefadc14700 1 -- 172.21.15.40:0/573512805 >> v1:172.21.15.40:6789/0 conn(0x7fefa8130de0 legacy=0x7fefa8137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:38.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.494+0000 7fefadc14700 1 -- 172.21.15.40:0/573512805 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa809a6e0 con 0x7fefa809e230 2023-09-30T22:27:38.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.494+0000 7fefadc14700 1 --2- 172.21.15.40:0/573512805 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefa809e230 0x7fefa81308a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fef9800bbc0 tx=0x7fef9800bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c4230dfaa263665 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:38.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.494+0000 7fefad413700 1 -- 172.21.15.40:0/573512805 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9800dd30 con 0x7fefa809e230 2023-09-30T22:27:38.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.494+0000 7fefad413700 1 -- 172.21.15.40:0/573512805 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9800de90 con 0x7fefa809e230 2023-09-30T22:27:38.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.494+0000 7fefad413700 1 -- 172.21.15.40:0/573512805 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef98010670 con 0x7fefa809e230 2023-09-30T22:27:38.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.495+0000 7fefb0679700 1 -- 172.21.15.40:0/573512805 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefa809e230 msgr2=0x7fefa81308a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:38.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.495+0000 7fefb0679700 1 --2- 172.21.15.40:0/573512805 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefa809e230 0x7fefa81308a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fef9800bbc0 tx=0x7fef9800bed0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.495+0000 7fefb0679700 1 -- 172.21.15.40:0/573512805 shutdown_connections 2023-09-30T22:27:38.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.495+0000 7fefb0679700 1 --2- 172.21.15.40:0/573512805 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefa809d920 0x7fefa809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.495+0000 7fefb0679700 1 --2- 172.21.15.40:0/573512805 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefa809e230 0x7fefa81308a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.495+0000 7fefb0679700 1 -- 172.21.15.40:0/573512805 >> 172.21.15.40:0/573512805 conn(0x7fefa809fb20 msgr2=0x7fefa809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:38.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.496+0000 7fefb0679700 1 -- 172.21.15.40:0/573512805 shutdown_connections 2023-09-30T22:27:38.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.496+0000 7fefb0679700 1 -- 172.21.15.40:0/573512805 wait complete. 2023-09-30T22:27:38.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.497+0000 7fefb0679700 1 Processor -- start 2023-09-30T22:27:38.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.497+0000 7fefb0679700 1 -- start start 2023-09-30T22:27:38.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.498+0000 7fefb0679700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefa809d920 0x7fefa811b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:38.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.498+0000 7fefb0679700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefa809e230 0x7fefa811bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:38.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.498+0000 7fefb0679700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefa8130de0 0x7fefa81c3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:38.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.498+0000 7fefb0679700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa811e5d0 con 0x7fefa8130de0 2023-09-30T22:27:38.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.498+0000 7fefb0679700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa811dab0 con 0x7fefa809d920 2023-09-30T22:27:38.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.498+0000 7fefb0679700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fefa811e310 con 0x7fefa809e230 2023-09-30T22:27:38.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.498+0000 7fefadc14700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefa809e230 0x7fefa811bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:38.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.498+0000 7fefadc14700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefa809e230 0x7fefa811bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56494/0 (socket says 172.21.15.40:56494) 2023-09-30T22:27:38.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.498+0000 7fefadc14700 1 -- 172.21.15.40:0/2109114732 learned_addr learned my addr 172.21.15.40:0/2109114732 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:38.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.498+0000 7fefaec16700 1 --2- 172.21.15.40:0/2109114732 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefa8130de0 0x7fefa81c3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:38.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.498+0000 7fefae415700 1 --2- 172.21.15.40:0/2109114732 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefa809d920 0x7fefa811b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:38.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.498+0000 7fefadc14700 1 -- 172.21.15.40:0/2109114732 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefa809d920 msgr2=0x7fefa811b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:38.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.498+0000 7fefadc14700 1 --2- 172.21.15.40:0/2109114732 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefa809d920 0x7fefa811b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.498+0000 7fefadc14700 1 -- 172.21.15.40:0/2109114732 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefa8130de0 msgr2=0x7fefa81c3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:38.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.498+0000 7fefadc14700 1 --2- 172.21.15.40:0/2109114732 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefa8130de0 0x7fefa81c3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.498+0000 7fefadc14700 1 -- 172.21.15.40:0/2109114732 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9800b7f0 con 0x7fefa809e230 2023-09-30T22:27:38.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.499+0000 7fefadc14700 1 --2- 172.21.15.40:0/2109114732 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefa809e230 0x7fefa811bc40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fef98015000 tx=0x7fef98004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:38.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.499+0000 7fef9effd700 1 -- 172.21.15.40:0/2109114732 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9801f070 con 0x7fefa809e230 2023-09-30T22:27:38.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.499+0000 7fef9effd700 1 -- 172.21.15.40:0/2109114732 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef98006bd0 con 0x7fefa809e230 2023-09-30T22:27:38.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.499+0000 7fefb0679700 1 -- 172.21.15.40:0/2109114732 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefa811b2a0 con 0x7fefa809e230 2023-09-30T22:27:38.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.499+0000 7fef9effd700 1 -- 172.21.15.40:0/2109114732 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef98003af0 con 0x7fefa809e230 2023-09-30T22:27:38.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.499+0000 7fefb0679700 1 -- 172.21.15.40:0/2109114732 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa811c180 con 0x7fefa809e230 2023-09-30T22:27:38.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.500+0000 7fef9effd700 1 -- 172.21.15.40:0/2109114732 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fef98003c50 con 0x7fefa809e230 2023-09-30T22:27:38.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.500+0000 7fefb0679700 1 -- 172.21.15.40:0/2109114732 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefa811e020 con 0x7fefa809e230 2023-09-30T22:27:38.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.500+0000 7fef9effd700 1 -- 172.21.15.40:0/2109114732 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fef980425a0 con 0x7fefa809e230 2023-09-30T22:27:38.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.505+0000 7fef9effd700 1 -- 172.21.15.40:0/2109114732 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef98019400 con 0x7fefa809e230 2023-09-30T22:27:38.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.542+0000 7f28b43ee700 1 Processor -- start 2023-09-30T22:27:38.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.542+0000 7f28b43ee700 1 -- start start 2023-09-30T22:27:38.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.543+0000 7f28b43ee700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f28ac09d450 0x7f28ac09d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:38.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.543+0000 7f28b43ee700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f28ac09dd60 0x7f28ac1301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:38.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.543+0000 7f28b43ee700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28ac09c3b0 con 0x7f28ac130700 2023-09-30T22:27:38.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.543+0000 7f28b43ee700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28ac09a6b0 con 0x7f28ac09d450 2023-09-30T22:27:38.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.543+0000 7f28b43ee700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac09b4f0 con 0x7f28ac09dd60 2023-09-30T22:27:38.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.544+0000 7f28b1989700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f28ac09dd60 0x7f28ac1301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:38.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.544+0000 7f28b1989700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f28ac09dd60 0x7f28ac1301c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48278/0 (socket says 172.21.15.40:48278) 2023-09-30T22:27:38.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.544+0000 7f28b1989700 1 -- 172.21.15.40:0/772529095 learned_addr learned my addr 172.21.15.40:0/772529095 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:38.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.544+0000 7f28b218a700 1 --2- 172.21.15.40:0/772529095 >> v2:172.21.15.40:3300/0 conn(0x7f28ac09d450 0x7f28ac09d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:38.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.544+0000 7f28b1989700 1 -- 172.21.15.40:0/772529095 >> v2:172.21.15.40:3300/0 conn(0x7f28ac09d450 msgr2=0x7f28ac09d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:38.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.544+0000 7f28b1989700 1 --2- 172.21.15.40:0/772529095 >> v2:172.21.15.40:3300/0 conn(0x7f28ac09d450 0x7f28ac09d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.544+0000 7f28b1989700 1 -- 172.21.15.40:0/772529095 >> v1:172.21.15.40:6789/0 conn(0x7f28ac130700 legacy=0x7f28ac137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:38.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.544+0000 7f28b1989700 1 -- 172.21.15.40:0/772529095 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ac09af90 con 0x7f28ac09dd60 2023-09-30T22:27:38.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.544+0000 7f28b218a700 1 --2- 172.21.15.40:0/772529095 >> v2:172.21.15.40:3300/0 conn(0x7f28ac09d450 0x7f28ac09d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:38.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.544+0000 7f28b1989700 1 --2- 172.21.15.40:0/772529095 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f28ac09dd60 0x7f28ac1301c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f289c0098f0 tx=0x7f289c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f994ea1ad8db4ef3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:38.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.544+0000 7f28b1188700 1 -- 172.21.15.40:0/772529095 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289c011830 con 0x7f28ac09dd60 2023-09-30T22:27:38.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.544+0000 7f28b1188700 1 -- 172.21.15.40:0/772529095 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289c011990 con 0x7f28ac09dd60 2023-09-30T22:27:38.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.544+0000 7f28b1188700 1 -- 172.21.15.40:0/772529095 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289c011d20 con 0x7f28ac09dd60 2023-09-30T22:27:38.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.545+0000 7f28b43ee700 1 -- 172.21.15.40:0/772529095 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f28ac09dd60 msgr2=0x7f28ac1301c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:38.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.545+0000 7f28b43ee700 1 --2- 172.21.15.40:0/772529095 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f28ac09dd60 0x7f28ac1301c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f289c0098f0 tx=0x7f289c009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:38.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.545+0000 7f28b43ee700 1 -- 172.21.15.40:0/772529095 shutdown_connections 2023-09-30T22:27:38.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.545+0000 7f28b43ee700 1 --2- 172.21.15.40:0/772529095 >> v2:172.21.15.40:3300/0 conn(0x7f28ac09d450 0x7f28ac09d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.545+0000 7f28b43ee700 1 --2- 172.21.15.40:0/772529095 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f28ac09dd60 0x7f28ac1301c0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.545+0000 7f28b43ee700 1 -- 172.21.15.40:0/772529095 >> 172.21.15.40:0/772529095 conn(0x7f28ac0a2a00 msgr2=0x7f28ac0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:38.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.545+0000 7f28b43ee700 1 -- 172.21.15.40:0/772529095 shutdown_connections 2023-09-30T22:27:38.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.545+0000 7f28b43ee700 1 -- 172.21.15.40:0/772529095 wait complete. 2023-09-30T22:27:38.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.547+0000 7f28b43ee700 1 Processor -- start 2023-09-30T22:27:38.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.547+0000 7f28b43ee700 1 -- start start 2023-09-30T22:27:38.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.547+0000 7f28b43ee700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f28ac09d450 0x7f28ac11b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:38.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.547+0000 7f28b43ee700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f28ac09dd60 0x7f28ac11b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:38.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.547+0000 7f28b43ee700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28ac130700 0x7f28ac11bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:38.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.547+0000 7f28b43ee700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac11cfa0 con 0x7f28ac130700 2023-09-30T22:27:38.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.547+0000 7f28b43ee700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac11cdb0 con 0x7f28ac09dd60 2023-09-30T22:27:38.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.547+0000 7f28b43ee700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac0a23f0 con 0x7f28ac09d450 2023-09-30T22:27:38.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.548+0000 7f28b218a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f28ac09d450 0x7f28ac11b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:38.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.548+0000 7f28b218a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f28ac09d450 0x7f28ac11b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56496/0 (socket says 172.21.15.40:56496) 2023-09-30T22:27:38.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.548+0000 7f28b218a700 1 -- 172.21.15.40:0/3003111150 learned_addr learned my addr 172.21.15.40:0/3003111150 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:38.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.548+0000 7f28b298b700 1 --2- 172.21.15.40:0/3003111150 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28ac130700 0x7f28ac11bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:38.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.548+0000 7f28b218a700 1 -- 172.21.15.40:0/3003111150 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f28ac09dd60 msgr2=0x7f28ac11b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:38.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.548+0000 7f28b218a700 1 --2- 172.21.15.40:0/3003111150 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f28ac09dd60 0x7f28ac11b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.548+0000 7f28b218a700 1 -- 172.21.15.40:0/3003111150 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28ac130700 msgr2=0x7f28ac11bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:38.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.548+0000 7f28b218a700 1 --2- 172.21.15.40:0/3003111150 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28ac130700 0x7f28ac11bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.548+0000 7f28b218a700 1 -- 172.21.15.40:0/3003111150 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a800d940 con 0x7f28ac09d450 2023-09-30T22:27:38.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.548+0000 7f28b218a700 1 --2- 172.21.15.40:0/3003111150 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f28ac09d450 0x7f28ac11b1f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f28a8012fc0 tx=0x7f28a80103a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:38.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.548+0000 7f28a2ffd700 1 -- 172.21.15.40:0/3003111150 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a8010bb0 con 0x7f28ac09d450 2023-09-30T22:27:38.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.548+0000 7f28a2ffd700 1 -- 172.21.15.40:0/3003111150 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a8013040 con 0x7f28ac09d450 2023-09-30T22:27:38.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.548+0000 7f28a2ffd700 1 -- 172.21.15.40:0/3003111150 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a800d2e0 con 0x7f28ac09d450 2023-09-30T22:27:38.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.548+0000 7f28b43ee700 1 -- 172.21.15.40:0/3003111150 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f289c009550 con 0x7f28ac09d450 2023-09-30T22:27:38.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.549+0000 7f28b43ee700 1 -- 172.21.15.40:0/3003111150 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28ac11ed20 con 0x7f28ac09d450 2023-09-30T22:27:38.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.550+0000 7f28a2ffd700 1 -- 172.21.15.40:0/3003111150 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f28a8018480 con 0x7f28ac09d450 2023-09-30T22:27:38.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.550+0000 7f28a2ffd700 1 -- 172.21.15.40:0/3003111150 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f28a8043bb0 con 0x7f28ac09d450 2023-09-30T22:27:38.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.550+0000 7f28b43ee700 1 -- 172.21.15.40:0/3003111150 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28ac062380 con 0x7f28ac09d450 2023-09-30T22:27:38.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.559+0000 7f28a2ffd700 1 -- 172.21.15.40:0/3003111150 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f28a8020950 con 0x7f28ac09d450 2023-09-30T22:27:38.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.573+0000 7fc34315e700 1 Processor -- start 2023-09-30T22:27:38.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.573+0000 7fc34315e700 1 -- start start 2023-09-30T22:27:38.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.574+0000 7fc34315e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc33c09c890 0x7fc33c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:38.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.574+0000 7fc34315e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc33c09d920 0x7fc33c09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:38.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.574+0000 7fc34315e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc33c0a2600 con 0x7fc33c09e2b0 2023-09-30T22:27:38.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.574+0000 7fc34315e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c0a29d0 con 0x7fc33c09c890 2023-09-30T22:27:38.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.574+0000 7fc34315e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c09fb40 con 0x7fc33c09d920 2023-09-30T22:27:38.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.574+0000 7fc33bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc33c09d920 0x7fc33c09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:38.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.574+0000 7fc33bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc33c09d920 0x7fc33c09dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56500/0 (socket says 172.21.15.40:56500) 2023-09-30T22:27:38.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.574+0000 7fc33bfff700 1 -- 172.21.15.40:0/3726552676 learned_addr learned my addr 172.21.15.40:0/3726552676 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:38.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.574+0000 7fc340efa700 1 --2- 172.21.15.40:0/3726552676 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc33c09c890 0x7fc33c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:38.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.574+0000 7fc340efa700 1 -- 172.21.15.40:0/3726552676 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc33c09d920 msgr2=0x7fc33c09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:38.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.574+0000 7fc340efa700 1 --2- 172.21.15.40:0/3726552676 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc33c09d920 0x7fc33c09dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.574+0000 7fc340efa700 1 -- 172.21.15.40:0/3726552676 >> v1:172.21.15.40:6789/0 conn(0x7fc33c09e2b0 legacy=0x7fc33c13ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:38.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.574+0000 7fc340efa700 1 -- 172.21.15.40:0/3726552676 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc33c09e720 con 0x7fc33c09c890 2023-09-30T22:27:38.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.575+0000 7fc340efa700 1 --2- 172.21.15.40:0/3726552676 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc33c09c890 0x7fc33c09cc60 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc328009850 tx=0x7fc328009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44cb4b166a314385 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:38.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.575+0000 7fc33b7fe700 1 -- 172.21.15.40:0/3726552676 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc328005e30 con 0x7fc33c09c890 2023-09-30T22:27:38.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.575+0000 7fc33b7fe700 1 -- 172.21.15.40:0/3726552676 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc328006030 con 0x7fc33c09c890 2023-09-30T22:27:38.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.575+0000 7fc33b7fe700 1 -- 172.21.15.40:0/3726552676 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3280063e0 con 0x7fc33c09c890 2023-09-30T22:27:38.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.576+0000 7fc34315e700 1 -- 172.21.15.40:0/3726552676 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc33c09c890 msgr2=0x7fc33c09cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:38.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.576+0000 7fc34315e700 1 --2- 172.21.15.40:0/3726552676 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc33c09c890 0x7fc33c09cc60 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc328009850 tx=0x7fc328009b60 comp rx=0 tx=0).stop 2023-09-30T22:27:38.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.576+0000 7fc34315e700 1 -- 172.21.15.40:0/3726552676 shutdown_connections 2023-09-30T22:27:38.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.576+0000 7fc34315e700 1 --2- 172.21.15.40:0/3726552676 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc33c09c890 0x7fc33c09cc60 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.576+0000 7fc34315e700 1 --2- 172.21.15.40:0/3726552676 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc33c09d920 0x7fc33c09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.576+0000 7fc34315e700 1 -- 172.21.15.40:0/3726552676 >> 172.21.15.40:0/3726552676 conn(0x7fc33c0a7080 msgr2=0x7fc33c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:38.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.576+0000 7fc34315e700 1 -- 172.21.15.40:0/3726552676 shutdown_connections 2023-09-30T22:27:38.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.576+0000 7fc34315e700 1 -- 172.21.15.40:0/3726552676 wait complete. 2023-09-30T22:27:38.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.577+0000 7fc34315e700 1 Processor -- start 2023-09-30T22:27:38.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.577+0000 7fc34315e700 1 -- start start 2023-09-30T22:27:38.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.578+0000 7fc34315e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc33c09c890 0x7fc33c12d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:38.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.578+0000 7fc34315e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc33c09d920 0x7fc33c12d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:38.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.578+0000 7fc34315e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc33c09e2b0 0x7fc33c12dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:38.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.578+0000 7fc34315e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c0a5d60 con 0x7fc33c09c890 2023-09-30T22:27:38.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.578+0000 7fc34315e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c12ff40 con 0x7fc33c09e2b0 2023-09-30T22:27:38.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.578+0000 7fc34315e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c12fb10 con 0x7fc33c09d920 2023-09-30T22:27:38.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.578+0000 7fc33bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc33c09d920 0x7fc33c12d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:38.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.578+0000 7fc33bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc33c09d920 0x7fc33c12d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56504/0 (socket says 172.21.15.40:56504) 2023-09-30T22:27:38.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.578+0000 7fc33bfff700 1 -- 172.21.15.40:0/3013611011 learned_addr learned my addr 172.21.15.40:0/3013611011 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:38.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.578+0000 7fc340efa700 1 --2- 172.21.15.40:0/3013611011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc33c09c890 0x7fc33c12d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:38.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.578+0000 7fc3416fb700 1 --2- 172.21.15.40:0/3013611011 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc33c09e2b0 0x7fc33c12dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:38.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.578+0000 7fc33bfff700 1 -- 172.21.15.40:0/3013611011 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc33c09e2b0 msgr2=0x7fc33c12dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:38.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.578+0000 7fc33bfff700 1 --2- 172.21.15.40:0/3013611011 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc33c09e2b0 0x7fc33c12dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.578+0000 7fc33bfff700 1 -- 172.21.15.40:0/3013611011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc33c09c890 msgr2=0x7fc33c12d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:38.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.578+0000 7fc33bfff700 1 --2- 172.21.15.40:0/3013611011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc33c09c890 0x7fc33c12d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.578+0000 7fc33bfff700 1 -- 172.21.15.40:0/3013611011 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc328009430 con 0x7fc33c09d920 2023-09-30T22:27:38.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.578+0000 7fc33bfff700 1 --2- 172.21.15.40:0/3013611011 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc33c09d920 0x7fc33c12d8a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc334009d70 tx=0x7fc33400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:38.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.579+0000 7fc3397fa700 1 -- 172.21.15.40:0/3013611011 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33400cbb0 con 0x7fc33c09d920 2023-09-30T22:27:38.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.579+0000 7fc3397fa700 1 -- 172.21.15.40:0/3013611011 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33400f040 con 0x7fc33c09d920 2023-09-30T22:27:38.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.579+0000 7fc34315e700 1 -- 172.21.15.40:0/3013611011 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc33c130390 con 0x7fc33c09d920 2023-09-30T22:27:38.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.579+0000 7fc3397fa700 1 -- 172.21.15.40:0/3013611011 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3340092e0 con 0x7fc33c09d920 2023-09-30T22:27:38.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.579+0000 7fc34315e700 1 -- 172.21.15.40:0/3013611011 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc33c12e320 con 0x7fc33c09d920 2023-09-30T22:27:38.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.580+0000 7fc3397fa700 1 -- 172.21.15.40:0/3013611011 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc334014480 con 0x7fc33c09d920 2023-09-30T22:27:38.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.580+0000 7fc3397fa700 1 -- 172.21.15.40:0/3013611011 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc33403fc20 con 0x7fc33c09d920 2023-09-30T22:27:38.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.580+0000 7fc34315e700 1 -- 172.21.15.40:0/3013611011 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc33c130a30 con 0x7fc33c09d920 2023-09-30T22:27:38.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.588+0000 7fc3397fa700 1 -- 172.21.15.40:0/3013611011 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc334012930 con 0x7fc33c09d920 2023-09-30T22:27:38.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.593+0000 7ffa141c1700 1 Processor -- start 2023-09-30T22:27:38.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.593+0000 7ffa141c1700 1 -- start start 2023-09-30T22:27:38.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.594+0000 7ffa141c1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa0c09d450 0x7ffa0c09d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:38.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.594+0000 7ffa141c1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffa0c09dd60 0x7ffa0c1301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:38.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.594+0000 7ffa141c1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa0c09c3b0 con 0x7ffa0c130700 2023-09-30T22:27:38.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.594+0000 7ffa141c1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa0c09a6b0 con 0x7ffa0c09dd60 2023-09-30T22:27:38.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.594+0000 7ffa141c1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c09b4f0 con 0x7ffa0c09d450 2023-09-30T22:27:38.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.594+0000 7ffa11f5d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa0c09d450 0x7ffa0c09d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:38.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.594+0000 7ffa11f5d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa0c09d450 0x7ffa0c09d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48300/0 (socket says 172.21.15.40:48300) 2023-09-30T22:27:38.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.594+0000 7ffa11f5d700 1 -- 172.21.15.40:0/37883240 learned_addr learned my addr 172.21.15.40:0/37883240 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:38.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.594+0000 7ffa11f5d700 1 -- 172.21.15.40:0/37883240 >> v2:172.21.15.40:3300/0 conn(0x7ffa0c09dd60 msgr2=0x7ffa0c1301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:38.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.594+0000 7ffa11f5d700 1 --2- 172.21.15.40:0/37883240 >> v2:172.21.15.40:3300/0 conn(0x7ffa0c09dd60 0x7ffa0c1301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.594+0000 7ffa11f5d700 1 -- 172.21.15.40:0/37883240 >> v1:172.21.15.40:6789/0 conn(0x7ffa0c130700 legacy=0x7ffa0c137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:38.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.594+0000 7ffa11f5d700 1 -- 172.21.15.40:0/37883240 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0c09af90 con 0x7ffa0c09d450 2023-09-30T22:27:38.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.595+0000 7ffa11f5d700 1 --2- 172.21.15.40:0/37883240 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa0c09d450 0x7ffa0c09d820 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800bb90 tx=0x7ffa0800bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2518e689772ba999 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:38.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.595+0000 7ffa10f5b700 1 -- 172.21.15.40:0/37883240 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0800dc00 con 0x7ffa0c09d450 2023-09-30T22:27:38.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.595+0000 7ffa10f5b700 1 -- 172.21.15.40:0/37883240 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0800dd60 con 0x7ffa0c09d450 2023-09-30T22:27:38.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.595+0000 7ffa10f5b700 1 -- 172.21.15.40:0/37883240 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa08004270 con 0x7ffa0c09d450 2023-09-30T22:27:38.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.595+0000 7ffa141c1700 1 -- 172.21.15.40:0/37883240 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa0c09d450 msgr2=0x7ffa0c09d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:38.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.595+0000 7ffa141c1700 1 --2- 172.21.15.40:0/37883240 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa0c09d450 0x7ffa0c09d820 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800bb90 tx=0x7ffa0800bea0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.596+0000 7ffa141c1700 1 -- 172.21.15.40:0/37883240 shutdown_connections 2023-09-30T22:27:38.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.596+0000 7ffa141c1700 1 --2- 172.21.15.40:0/37883240 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa0c09d450 0x7ffa0c09d820 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.596+0000 7ffa141c1700 1 --2- 172.21.15.40:0/37883240 >> v2:172.21.15.40:3300/0 conn(0x7ffa0c09dd60 0x7ffa0c1301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.596+0000 7ffa141c1700 1 -- 172.21.15.40:0/37883240 >> 172.21.15.40:0/37883240 conn(0x7ffa0c0a2a00 msgr2=0x7ffa0c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:38.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.596+0000 7ffa141c1700 1 -- 172.21.15.40:0/37883240 shutdown_connections 2023-09-30T22:27:38.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.596+0000 7ffa141c1700 1 -- 172.21.15.40:0/37883240 wait complete. 2023-09-30T22:27:38.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.597+0000 7ffa141c1700 1 Processor -- start 2023-09-30T22:27:38.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.597+0000 7ffa141c1700 1 -- start start 2023-09-30T22:27:38.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.597+0000 7ffa141c1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa0c09d450 0x7ffa0c11dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:38.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.597+0000 7ffa141c1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa0c09dd60 0x7ffa0c11dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:38.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.597+0000 7ffa141c1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa0c130700 0x7ffa0c11e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:38.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.597+0000 7ffa141c1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c121270 con 0x7ffa0c09d450 2023-09-30T22:27:38.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.597+0000 7ffa141c1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c1301c0 con 0x7ffa0c09dd60 2023-09-30T22:27:38.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.597+0000 7ffa141c1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c11f750 con 0x7ffa0c130700 2023-09-30T22:27:38.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.597+0000 7ffa11f5d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa0c09d450 0x7ffa0c11dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:38.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.597+0000 7ffa11f5d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa0c09d450 0x7ffa0c11dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56442/0 (socket says 172.21.15.40:56442) 2023-09-30T22:27:38.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.597+0000 7ffa11f5d700 1 -- 172.21.15.40:0/22304737 learned_addr learned my addr 172.21.15.40:0/22304737 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:38.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.598+0000 7ffa1175c700 1 --2- 172.21.15.40:0/22304737 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa0c09dd60 0x7ffa0c11dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:38.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.598+0000 7ffa1275e700 1 --2- 172.21.15.40:0/22304737 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa0c130700 0x7ffa0c11e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:38.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.598+0000 7ffa1175c700 1 -- 172.21.15.40:0/22304737 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa0c130700 msgr2=0x7ffa0c11e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:38.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.598+0000 7ffa1175c700 1 --2- 172.21.15.40:0/22304737 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa0c130700 0x7ffa0c11e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.598+0000 7ffa1175c700 1 -- 172.21.15.40:0/22304737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa0c09d450 msgr2=0x7ffa0c11dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:38.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.598+0000 7ffa1175c700 1 --2- 172.21.15.40:0/22304737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa0c09d450 0x7ffa0c11dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.598+0000 7ffa1175c700 1 -- 172.21.15.40:0/22304737 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0800b7f0 con 0x7ffa0c09dd60 2023-09-30T22:27:38.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.598+0000 7ffa1175c700 1 --2- 172.21.15.40:0/22304737 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa0c09dd60 0x7ffa0c11dff0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c09f460 tx=0x7ff9fc00b730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:38.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.598+0000 7ffa027fc700 1 -- 172.21.15.40:0/22304737 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc011830 con 0x7ffa0c09dd60 2023-09-30T22:27:38.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.598+0000 7ffa027fc700 1 -- 172.21.15.40:0/22304737 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9fc011990 con 0x7ffa0c09dd60 2023-09-30T22:27:38.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.598+0000 7ffa027fc700 1 -- 172.21.15.40:0/22304737 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc011d40 con 0x7ffa0c09dd60 2023-09-30T22:27:38.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.599+0000 7ffa141c1700 1 -- 172.21.15.40:0/22304737 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa0c09c5d0 con 0x7ffa0c09dd60 2023-09-30T22:27:38.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.599+0000 7ffa141c1700 1 -- 172.21.15.40:0/22304737 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa0c121ce0 con 0x7ffa0c09dd60 2023-09-30T22:27:38.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.600+0000 7ffa027fc700 1 -- 172.21.15.40:0/22304737 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff9fc01a400 con 0x7ffa0c09dd60 2023-09-30T22:27:38.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.600+0000 7ffa027fc700 1 -- 172.21.15.40:0/22304737 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff9fc03f790 con 0x7ffa0c09dd60 2023-09-30T22:27:38.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.600+0000 7ffa141c1700 1 -- 172.21.15.40:0/22304737 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa0c11a7f0 con 0x7ffa0c09dd60 2023-09-30T22:27:38.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.605+0000 7ffa027fc700 1 -- 172.21.15.40:0/22304737 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff9fc015070 con 0x7ffa0c09dd60 2023-09-30T22:27:38.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.717+0000 7fefb0679700 1 -- 172.21.15.40:0/2109114732 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fefa8062380 con 0x7fefa809e230 2023-09-30T22:27:38.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.718+0000 7fef9effd700 1 -- 172.21.15.40:0/2109114732 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fef98028070 con 0x7fefa809e230 2023-09-30T22:27:38.718 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:38.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.720+0000 7fefb0679700 1 -- 172.21.15.40:0/2109114732 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefa809e230 msgr2=0x7fefa811bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:38.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.720+0000 7fefb0679700 1 --2- 172.21.15.40:0/2109114732 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefa809e230 0x7fefa811bc40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fef98015000 tx=0x7fef98004750 comp rx=0 tx=0).stop 2023-09-30T22:27:38.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.720+0000 7fefb0679700 1 -- 172.21.15.40:0/2109114732 shutdown_connections 2023-09-30T22:27:38.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.720+0000 7fefb0679700 1 --2- 172.21.15.40:0/2109114732 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefa8130de0 0x7fefa81c3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.720+0000 7fefb0679700 1 --2- 172.21.15.40:0/2109114732 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefa809d920 0x7fefa811b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.720+0000 7fefb0679700 1 --2- 172.21.15.40:0/2109114732 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefa809e230 0x7fefa811bc40 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.720+0000 7fefb0679700 1 -- 172.21.15.40:0/2109114732 >> 172.21.15.40:0/2109114732 conn(0x7fefa809fb20 msgr2=0x7fefa812dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:38.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.720+0000 7fefb0679700 1 -- 172.21.15.40:0/2109114732 shutdown_connections 2023-09-30T22:27:38.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.720+0000 7fefb0679700 1 -- 172.21.15.40:0/2109114732 wait complete. 2023-09-30T22:27:38.733 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:38.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.763+0000 7f28b43ee700 1 -- 172.21.15.40:0/3003111150 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f28ac11d5a0 con 0x7f28ac09d450 2023-09-30T22:27:38.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.764+0000 7f28a2ffd700 1 -- 172.21.15.40:0/3003111150 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f28a800dca0 con 0x7f28ac09d450 2023-09-30T22:27:38.875 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:38.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.767+0000 7f28b43ee700 1 -- 172.21.15.40:0/3003111150 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f28ac09d450 msgr2=0x7f28ac11b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:38.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.767+0000 7f28b43ee700 1 --2- 172.21.15.40:0/3003111150 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f28ac09d450 0x7f28ac11b1f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f28a8012fc0 tx=0x7f28a80103a0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.767+0000 7f28b43ee700 1 -- 172.21.15.40:0/3003111150 shutdown_connections 2023-09-30T22:27:38.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.767+0000 7f28b43ee700 1 --2- 172.21.15.40:0/3003111150 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f28ac09d450 0x7f28ac11b1f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.767+0000 7f28b43ee700 1 --2- 172.21.15.40:0/3003111150 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28ac130700 0x7f28ac11bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.767+0000 7f28b43ee700 1 --2- 172.21.15.40:0/3003111150 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f28ac09dd60 0x7f28ac11b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.767+0000 7f28b43ee700 1 -- 172.21.15.40:0/3003111150 >> 172.21.15.40:0/3003111150 conn(0x7f28ac0a2a00 msgr2=0x7f28ac1b7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:38.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.767+0000 7f28b43ee700 1 -- 172.21.15.40:0/3003111150 shutdown_connections 2023-09-30T22:27:38.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.767+0000 7f28b43ee700 1 -- 172.21.15.40:0/3003111150 wait complete. 2023-09-30T22:27:38.878 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:38.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.789+0000 7fc34315e700 1 -- 172.21.15.40:0/3013611011 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc33c062380 con 0x7fc33c09d920 2023-09-30T22:27:38.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.789+0000 7fc3397fa700 1 -- 172.21.15.40:0/3013611011 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc33402c090 con 0x7fc33c09d920 2023-09-30T22:27:38.878 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:38.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.791+0000 7fc34315e700 1 -- 172.21.15.40:0/3013611011 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc33c09d920 msgr2=0x7fc33c12d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:38.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.791+0000 7fc34315e700 1 --2- 172.21.15.40:0/3013611011 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc33c09d920 0x7fc33c12d8a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc334009d70 tx=0x7fc33400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.792+0000 7fc34315e700 1 -- 172.21.15.40:0/3013611011 shutdown_connections 2023-09-30T22:27:38.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.792+0000 7fc34315e700 1 --2- 172.21.15.40:0/3013611011 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc33c09e2b0 0x7fc33c12dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.792+0000 7fc34315e700 1 --2- 172.21.15.40:0/3013611011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc33c09c890 0x7fc33c12d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.792+0000 7fc34315e700 1 --2- 172.21.15.40:0/3013611011 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc33c09d920 0x7fc33c12d8a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.792+0000 7fc34315e700 1 -- 172.21.15.40:0/3013611011 >> 172.21.15.40:0/3013611011 conn(0x7fc33c0a7080 msgr2=0x7fc33c0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:38.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.792+0000 7fc34315e700 1 -- 172.21.15.40:0/3013611011 shutdown_connections 2023-09-30T22:27:38.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.792+0000 7fc34315e700 1 -- 172.21.15.40:0/3013611011 wait complete. 2023-09-30T22:27:38.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:38.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.813+0000 7ffa141c1700 1 -- 172.21.15.40:0/22304737 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ffa0c120de0 con 0x7ffa0c09dd60 2023-09-30T22:27:38.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.814+0000 7ffa027fc700 1 -- 172.21.15.40:0/22304737 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff9fc009280 con 0x7ffa0c09dd60 2023-09-30T22:27:38.881 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:38.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.816+0000 7ffa141c1700 1 -- 172.21.15.40:0/22304737 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa0c09dd60 msgr2=0x7ffa0c11dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:38.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.816+0000 7ffa141c1700 1 --2- 172.21.15.40:0/22304737 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa0c09dd60 0x7ffa0c11dff0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c09f460 tx=0x7ff9fc00b730 comp rx=0 tx=0).stop 2023-09-30T22:27:38.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.816+0000 7ffa141c1700 1 -- 172.21.15.40:0/22304737 shutdown_connections 2023-09-30T22:27:38.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.816+0000 7ffa141c1700 1 --2- 172.21.15.40:0/22304737 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa0c130700 0x7ffa0c11e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.816+0000 7ffa141c1700 1 --2- 172.21.15.40:0/22304737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa0c09d450 0x7ffa0c11dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.816+0000 7ffa141c1700 1 --2- 172.21.15.40:0/22304737 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa0c09dd60 0x7ffa0c11dff0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.816+0000 7ffa141c1700 1 -- 172.21.15.40:0/22304737 >> 172.21.15.40:0/22304737 conn(0x7ffa0c0a2a00 msgr2=0x7ffa0c12faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:38.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.816+0000 7ffa141c1700 1 -- 172.21.15.40:0/22304737 shutdown_connections 2023-09-30T22:27:38.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:38.816+0000 7ffa141c1700 1 -- 172.21.15.40:0/22304737 wait complete. 2023-09-30T22:27:38.884 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:39.734 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:39.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.874+0000 7f9cb87c7700 1 Processor -- start 2023-09-30T22:27:39.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.874+0000 7f9cb87c7700 1 -- start start 2023-09-30T22:27:39.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.875+0000 7f9cb87c7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9cb009c890 0x7f9cb009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:39.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.875+0000 7f9cb87c7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9cb009d920 0x7f9cb009dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:39.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.875+0000 7f9cb87c7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cb00a2600 con 0x7f9cb009e2b0 2023-09-30T22:27:39.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.875+0000 7f9cb87c7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb00a29d0 con 0x7f9cb009d920 2023-09-30T22:27:39.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.875+0000 7f9cb87c7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb009fb40 con 0x7f9cb009c890 2023-09-30T22:27:39.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.875+0000 7f9cb6563700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9cb009c890 0x7f9cb009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:39.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.875+0000 7f9cb5d62700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9cb009d920 0x7f9cb009dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:39.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.875+0000 7f9cb6563700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9cb009c890 0x7f9cb009cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48312/0 (socket says 172.21.15.40:48312) 2023-09-30T22:27:39.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.875+0000 7f9cb6563700 1 -- 172.21.15.40:0/388464096 learned_addr learned my addr 172.21.15.40:0/388464096 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:39.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.875+0000 7f9cb6563700 1 -- 172.21.15.40:0/388464096 >> v2:172.21.15.40:3300/0 conn(0x7f9cb009d920 msgr2=0x7f9cb009dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:39.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.875+0000 7f9cb6563700 1 --2- 172.21.15.40:0/388464096 >> v2:172.21.15.40:3300/0 conn(0x7f9cb009d920 0x7f9cb009dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:39.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.875+0000 7f9cb6563700 1 -- 172.21.15.40:0/388464096 >> v1:172.21.15.40:6789/0 conn(0x7f9cb009e2b0 legacy=0x7f9cb013ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:39.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.875+0000 7f9cb6563700 1 -- 172.21.15.40:0/388464096 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb009e750 con 0x7f9cb009c890 2023-09-30T22:27:39.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.875+0000 7f9cb5d62700 1 --2- 172.21.15.40:0/388464096 >> v2:172.21.15.40:3300/0 conn(0x7f9cb009d920 0x7f9cb009dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:39.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.876+0000 7f9cb6563700 1 --2- 172.21.15.40:0/388464096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9cb009c890 0x7f9cb009cc60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0006fd0 tx=0x7f9ca0009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c19087f1e95b3758 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:39.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.876+0000 7f9cb5561700 1 -- 172.21.15.40:0/388464096 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0005e30 con 0x7f9cb009c890 2023-09-30T22:27:39.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.876+0000 7f9cb5561700 1 -- 172.21.15.40:0/388464096 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca0004030 con 0x7f9cb009c890 2023-09-30T22:27:39.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.876+0000 7f9cb5561700 1 -- 172.21.15.40:0/388464096 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca00043e0 con 0x7f9cb009c890 2023-09-30T22:27:39.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.876+0000 7f9cb87c7700 1 -- 172.21.15.40:0/388464096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9cb009c890 msgr2=0x7f9cb009cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:39.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.876+0000 7f9cb87c7700 1 --2- 172.21.15.40:0/388464096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9cb009c890 0x7f9cb009cc60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0006fd0 tx=0x7f9ca0009bd0 comp rx=0 tx=0).stop 2023-09-30T22:27:39.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.876+0000 7f9cb87c7700 1 -- 172.21.15.40:0/388464096 shutdown_connections 2023-09-30T22:27:39.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.876+0000 7f9cb87c7700 1 --2- 172.21.15.40:0/388464096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9cb009c890 0x7f9cb009cc60 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:39.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.876+0000 7f9cb87c7700 1 --2- 172.21.15.40:0/388464096 >> v2:172.21.15.40:3300/0 conn(0x7f9cb009d920 0x7f9cb009dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:39.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.876+0000 7f9cb87c7700 1 -- 172.21.15.40:0/388464096 >> 172.21.15.40:0/388464096 conn(0x7f9cb00a7080 msgr2=0x7f9cb00a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:39.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.876+0000 7f9cb87c7700 1 -- 172.21.15.40:0/388464096 shutdown_connections 2023-09-30T22:27:39.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.876+0000 7f9cb87c7700 1 -- 172.21.15.40:0/388464096 wait complete. 2023-09-30T22:27:39.880 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:39.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.877+0000 7f9cb87c7700 1 Processor -- start 2023-09-30T22:27:39.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.877+0000 7f9cb87c7700 1 -- start start 2023-09-30T22:27:39.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.878+0000 7f9cb87c7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9cb009c890 0x7f9cb01c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:39.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.878+0000 7f9cb87c7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9cb009d920 0x7f9cb01c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:39.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.878+0000 7f9cb87c7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9cb009e2b0 0x7f9cb01c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:39.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.878+0000 7f9cb87c7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb012faf0 con 0x7f9cb009e2b0 2023-09-30T22:27:39.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.878+0000 7f9cb87c7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb012f580 con 0x7f9cb009d920 2023-09-30T22:27:39.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.878+0000 7f9cb87c7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb00a5d00 con 0x7f9cb009c890 2023-09-30T22:27:39.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.878+0000 7f9cb6563700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9cb009c890 0x7f9cb01c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:39.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.878+0000 7f9cb6d64700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9cb009e2b0 0x7f9cb01c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:39.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.878+0000 7f9cb6563700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9cb009c890 0x7f9cb01c89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56512/0 (socket says 172.21.15.40:56512) 2023-09-30T22:27:39.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.878+0000 7f9cb6563700 1 -- 172.21.15.40:0/1397588094 learned_addr learned my addr 172.21.15.40:0/1397588094 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:39.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.878+0000 7f9cb5d62700 1 --2- 172.21.15.40:0/1397588094 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9cb009d920 0x7f9cb01c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:39.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.878+0000 7f9cb6563700 1 -- 172.21.15.40:0/1397588094 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9cb009d920 msgr2=0x7f9cb01c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:39.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.878+0000 7f9cb6563700 1 --2- 172.21.15.40:0/1397588094 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9cb009d920 0x7f9cb01c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:39.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.878+0000 7f9cb6563700 1 -- 172.21.15.40:0/1397588094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9cb009e2b0 msgr2=0x7f9cb01c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:39.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.878+0000 7f9cb6563700 1 --2- 172.21.15.40:0/1397588094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9cb009e2b0 0x7f9cb01c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:39.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.878+0000 7f9cb6563700 1 -- 172.21.15.40:0/1397588094 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cac0094a0 con 0x7f9cb009c890 2023-09-30T22:27:39.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.878+0000 7f9cb6d64700 1 --2- 172.21.15.40:0/1397588094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9cb009e2b0 0x7f9cb01c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:39.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.878+0000 7f9cb5d62700 1 --2- 172.21.15.40:0/1397588094 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9cb009d920 0x7f9cb01c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:39.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.879+0000 7f9cb6563700 1 --2- 172.21.15.40:0/1397588094 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9cb009c890 0x7f9cb01c89e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0009c10 tx=0x7f9ca0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:39.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.879+0000 7f9ca6ffd700 1 -- 172.21.15.40:0/1397588094 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca001c420 con 0x7f9cb009c890 2023-09-30T22:27:39.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.879+0000 7f9ca6ffd700 1 -- 172.21.15.40:0/1397588094 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca001c5a0 con 0x7f9cb009c890 2023-09-30T22:27:39.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.879+0000 7f9cb87c7700 1 -- 172.21.15.40:0/1397588094 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca0009500 con 0x7f9cb009c890 2023-09-30T22:27:39.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.879+0000 7f9ca6ffd700 1 -- 172.21.15.40:0/1397588094 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca001c950 con 0x7f9cb009c890 2023-09-30T22:27:39.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.879+0000 7f9cb87c7700 1 -- 172.21.15.40:0/1397588094 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb0130d80 con 0x7f9cb009c890 2023-09-30T22:27:39.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.879+0000 7f9ca6ffd700 1 -- 172.21.15.40:0/1397588094 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9ca001cab0 con 0x7f9cb009c890 2023-09-30T22:27:39.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.880+0000 7f9ca6ffd700 1 -- 172.21.15.40:0/1397588094 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9ca00407a0 con 0x7f9cb009c890 2023-09-30T22:27:39.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.880+0000 7f9cb87c7700 1 -- 172.21.15.40:0/1397588094 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb009ecf0 con 0x7f9cb009c890 2023-09-30T22:27:39.885 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:39.885 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:39.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:39.885+0000 7f9ca6ffd700 1 -- 172.21.15.40:0/1397588094 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9cb009ecf0 con 0x7f9cb009c890 2023-09-30T22:27:40.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.016+0000 7fae8f0f9700 1 Processor -- start 2023-09-30T22:27:40.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.016+0000 7fae8f0f9700 1 -- start start 2023-09-30T22:27:40.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.016+0000 7fae8f0f9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fae8809d450 0x7fae8809d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:40.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.016+0000 7fae8f0f9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae8809dd60 0x7fae881301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:40.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.016+0000 7fae8f0f9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae8809c3b0 con 0x7fae88130700 2023-09-30T22:27:40.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.016+0000 7fae8f0f9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae8809a6b0 con 0x7fae8809d450 2023-09-30T22:27:40.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.016+0000 7fae8f0f9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8809b4f0 con 0x7fae8809dd60 2023-09-30T22:27:40.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.017+0000 7fae8d696700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fae88130700 0x7fae88137410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41636/0 (socket says 172.21.15.40:41636) 2023-09-30T22:27:40.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.017+0000 7fae8d696700 1 -- 172.21.15.40:0/190217669 learned_addr learned my addr 172.21.15.40:0/190217669 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:27:40.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.017+0000 7fae8ce95700 1 --2- 172.21.15.40:0/190217669 >> v2:172.21.15.40:3300/0 conn(0x7fae8809d450 0x7fae8809d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:40.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.017+0000 7fae87fff700 1 --2- 172.21.15.40:0/190217669 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae8809dd60 0x7fae881301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:40.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.017+0000 7fae8ce95700 1 -- 172.21.15.40:0/190217669 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae8809dd60 msgr2=0x7fae881301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:40.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.017+0000 7fae8ce95700 1 --2- 172.21.15.40:0/190217669 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae8809dd60 0x7fae881301c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.017+0000 7fae8ce95700 1 -- 172.21.15.40:0/190217669 >> v1:172.21.15.40:6789/0 conn(0x7fae88130700 legacy=0x7fae88137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:40.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.017+0000 7fae877fe700 1 -- 172.21.15.40:0/190217669 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1513886286 0 0) 0x7fae8809c3b0 con 0x7fae88130700 2023-09-30T22:27:40.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.017+0000 7fae8ce95700 1 -- 172.21.15.40:0/190217669 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8809af90 con 0x7fae8809d450 2023-09-30T22:27:40.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.017+0000 7fae8ce95700 1 --2- 172.21.15.40:0/190217669 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae8809d450 0x7fae8809d820 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fae7c009840 tx=0x7fae7c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=519a6fd39ddee7f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:40.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.018+0000 7fae877fe700 1 -- 172.21.15.40:0/190217669 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c011830 con 0x7fae8809d450 2023-09-30T22:27:40.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.018+0000 7fae877fe700 1 -- 172.21.15.40:0/190217669 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7c011990 con 0x7fae8809d450 2023-09-30T22:27:40.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.018+0000 7fae877fe700 1 -- 172.21.15.40:0/190217669 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c011d20 con 0x7fae8809d450 2023-09-30T22:27:40.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.019+0000 7fae8f0f9700 1 -- 172.21.15.40:0/190217669 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae8809d450 msgr2=0x7fae8809d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:40.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.019+0000 7fae8f0f9700 1 --2- 172.21.15.40:0/190217669 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae8809d450 0x7fae8809d820 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fae7c009840 tx=0x7fae7c009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:40.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.019+0000 7fae8f0f9700 1 -- 172.21.15.40:0/190217669 shutdown_connections 2023-09-30T22:27:40.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.019+0000 7fae8f0f9700 1 --2- 172.21.15.40:0/190217669 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae8809d450 0x7fae8809d820 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.019+0000 7fae8f0f9700 1 --2- 172.21.15.40:0/190217669 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae8809dd60 0x7fae881301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.019+0000 7fae8f0f9700 1 -- 172.21.15.40:0/190217669 >> 172.21.15.40:0/190217669 conn(0x7fae880a2a00 msgr2=0x7fae880a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:40.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.019+0000 7fae8f0f9700 1 -- 172.21.15.40:0/190217669 shutdown_connections 2023-09-30T22:27:40.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.019+0000 7fae8f0f9700 1 -- 172.21.15.40:0/190217669 wait complete. 2023-09-30T22:27:40.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.020+0000 7fae8f0f9700 1 Processor -- start 2023-09-30T22:27:40.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.020+0000 7fae8f0f9700 1 -- start start 2023-09-30T22:27:40.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.020+0000 7fae8f0f9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae8809d450 0x7fae88126330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:40.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.020+0000 7fae8f0f9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae8809dd60 0x7fae88126870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:40.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.020+0000 7fae8f0f9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae88130700 0x7fae881c6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:40.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.020+0000 7fae8f0f9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae88119360 con 0x7fae8809d450 2023-09-30T22:27:40.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.020+0000 7fae8f0f9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae88119b50 con 0x7fae88130700 2023-09-30T22:27:40.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.020+0000 7fae8f0f9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae8809c5d0 con 0x7fae8809dd60 2023-09-30T22:27:40.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.021+0000 7fae8ce95700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae8809d450 0x7fae88126330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:40.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.021+0000 7fae8ce95700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae8809d450 0x7fae88126330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56476/0 (socket says 172.21.15.40:56476) 2023-09-30T22:27:40.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.021+0000 7fae8ce95700 1 -- 172.21.15.40:0/2778643220 learned_addr learned my addr 172.21.15.40:0/2778643220 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:40.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.021+0000 7fae8d696700 1 --2- 172.21.15.40:0/2778643220 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae88130700 0x7fae881c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:40.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.021+0000 7fae8ce95700 1 -- 172.21.15.40:0/2778643220 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae8809dd60 msgr2=0x7fae88126870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:40.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.021+0000 7fae8ce95700 1 --2- 172.21.15.40:0/2778643220 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae8809dd60 0x7fae88126870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.021+0000 7fae8ce95700 1 -- 172.21.15.40:0/2778643220 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae88130700 msgr2=0x7fae881c6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:40.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.021+0000 7fae8ce95700 1 --2- 172.21.15.40:0/2778643220 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae88130700 0x7fae881c6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.021+0000 7fae8ce95700 1 -- 172.21.15.40:0/2778643220 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7c0094a0 con 0x7fae8809d450 2023-09-30T22:27:40.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.021+0000 7fae8d696700 1 --2- 172.21.15.40:0/2778643220 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae88130700 0x7fae881c6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:40.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.021+0000 7fae8ce95700 1 --2- 172.21.15.40:0/2778643220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae8809d450 0x7fae88126330 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fae7c009b90 tx=0x7fae7c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:40.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.021+0000 7fae857fa700 1 -- 172.21.15.40:0/2778643220 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c0043c0 con 0x7fae8809d450 2023-09-30T22:27:40.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.021+0000 7fae857fa700 1 -- 172.21.15.40:0/2778643220 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7c01f070 con 0x7fae8809d450 2023-09-30T22:27:40.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.021+0000 7fae857fa700 1 -- 172.21.15.40:0/2778643220 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c0036a0 con 0x7fae8809d450 2023-09-30T22:27:40.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.021+0000 7fae8f0f9700 1 -- 172.21.15.40:0/2778643220 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae88125ee0 con 0x7fae8809d450 2023-09-30T22:27:40.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.022+0000 7fae8f0f9700 1 -- 172.21.15.40:0/2778643220 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae88126db0 con 0x7fae8809d450 2023-09-30T22:27:40.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.023+0000 7fae857fa700 1 -- 172.21.15.40:0/2778643220 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fae7c021030 con 0x7fae8809d450 2023-09-30T22:27:40.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.023+0000 7fae857fa700 1 -- 172.21.15.40:0/2778643220 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fae7c0409c0 con 0x7fae8809d450 2023-09-30T22:27:40.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.023+0000 7fae8f0f9700 1 -- 172.21.15.40:0/2778643220 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae88119d70 con 0x7fae8809d450 2023-09-30T22:27:40.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.032+0000 7fae857fa700 1 -- 172.21.15.40:0/2778643220 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fae7c0197c0 con 0x7fae8809d450 2023-09-30T22:27:40.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.058+0000 7f04bcaa0700 1 Processor -- start 2023-09-30T22:27:40.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.058+0000 7f04bcaa0700 1 -- start start 2023-09-30T22:27:40.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.059+0000 7f04bcaa0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f04b809d920 0x7f04b809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:40.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.059+0000 7f04bcaa0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f04b8130fb0 0x7f04b8138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:40.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.059+0000 7f04bcaa0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04b809adf0 con 0x7f04b809e230 2023-09-30T22:27:40.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.059+0000 7f04bcaa0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04b809edf0 con 0x7f04b8130fb0 2023-09-30T22:27:40.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.059+0000 7f04bcaa0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04b809b660 con 0x7f04b809d920 2023-09-30T22:27:40.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.059+0000 7f04b5d9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f04b809e230 0x7f04b81308a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41640/0 (socket says 172.21.15.40:41640) 2023-09-30T22:27:40.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.059+0000 7f04b5d9b700 1 -- 172.21.15.40:0/1664838607 learned_addr learned my addr 172.21.15.40:0/1664838607 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:27:40.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.059+0000 7f04b659c700 1 --2- 172.21.15.40:0/1664838607 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f04b809d920 0x7f04b809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:40.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.059+0000 7f04b6d9d700 1 --2- 172.21.15.40:0/1664838607 >> v2:172.21.15.40:3300/0 conn(0x7f04b8130fb0 0x7f04b8138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:40.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.059+0000 7f04b559a700 1 -- 172.21.15.40:0/1664838607 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2391723661 0 0) 0x7f04b809adf0 con 0x7f04b809e230 2023-09-30T22:27:40.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.059+0000 7f04b559a700 1 -- 172.21.15.40:0/1664838607 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04a00035b0 con 0x7f04b809e230 2023-09-30T22:27:40.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.059+0000 7f04b659c700 1 -- 172.21.15.40:0/1664838607 >> v2:172.21.15.40:3300/0 conn(0x7f04b8130fb0 msgr2=0x7f04b8138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:40.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.059+0000 7f04b659c700 1 --2- 172.21.15.40:0/1664838607 >> v2:172.21.15.40:3300/0 conn(0x7f04b8130fb0 0x7f04b8138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.059+0000 7f04b659c700 1 -- 172.21.15.40:0/1664838607 >> v1:172.21.15.40:6789/0 conn(0x7f04b809e230 legacy=0x7f04b81308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:40.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.059+0000 7f04b659c700 1 -- 172.21.15.40:0/1664838607 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b809a6e0 con 0x7f04b809d920 2023-09-30T22:27:40.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.059+0000 7f04b6d9d700 1 --2- 172.21.15.40:0/1664838607 >> v2:172.21.15.40:3300/0 conn(0x7f04b8130fb0 0x7f04b8138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:40.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.060+0000 7f04b659c700 1 --2- 172.21.15.40:0/1664838607 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f04b809d920 0x7f04b809dcf0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f04a8009820 tx=0x7f04a8009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e413b9de85d451e7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:40.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.060+0000 7f04b559a700 1 -- 172.21.15.40:0/1664838607 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a8005e30 con 0x7f04b809d920 2023-09-30T22:27:40.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.060+0000 7f04b559a700 1 -- 172.21.15.40:0/1664838607 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a8006030 con 0x7f04b809d920 2023-09-30T22:27:40.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.060+0000 7f04b559a700 1 -- 172.21.15.40:0/1664838607 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a80063c0 con 0x7f04b809d920 2023-09-30T22:27:40.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.060+0000 7f04bcaa0700 1 -- 172.21.15.40:0/1664838607 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f04b809d920 msgr2=0x7f04b809dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:40.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.060+0000 7f04bcaa0700 1 --2- 172.21.15.40:0/1664838607 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f04b809d920 0x7f04b809dcf0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f04a8009820 tx=0x7f04a8009b30 comp rx=0 tx=0).stop 2023-09-30T22:27:40.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.061+0000 7f04bcaa0700 1 -- 172.21.15.40:0/1664838607 shutdown_connections 2023-09-30T22:27:40.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.061+0000 7f04bcaa0700 1 --2- 172.21.15.40:0/1664838607 >> v2:172.21.15.40:3300/0 conn(0x7f04b8130fb0 0x7f04b8138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.061+0000 7f04bcaa0700 1 --2- 172.21.15.40:0/1664838607 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f04b809d920 0x7f04b809dcf0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.061+0000 7f04bcaa0700 1 -- 172.21.15.40:0/1664838607 >> 172.21.15.40:0/1664838607 conn(0x7f04b809fb20 msgr2=0x7f04b809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:40.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.061+0000 7f04bcaa0700 1 -- 172.21.15.40:0/1664838607 shutdown_connections 2023-09-30T22:27:40.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.061+0000 7f04bcaa0700 1 -- 172.21.15.40:0/1664838607 wait complete. 2023-09-30T22:27:40.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.062+0000 7f04bcaa0700 1 Processor -- start 2023-09-30T22:27:40.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.062+0000 7fe3b996f700 1 Processor -- start 2023-09-30T22:27:40.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.062+0000 7f04bcaa0700 1 -- start start 2023-09-30T22:27:40.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.062+0000 7fe3b996f700 1 -- start start 2023-09-30T22:27:40.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.062+0000 7f04bcaa0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04b809d920 0x7f04b81c6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:40.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.062+0000 7f04bcaa0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04b809e230 0x7f04b81c65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:40.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.062+0000 7f04bcaa0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f04b8130fb0 0x7f04b81c6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:40.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.062+0000 7f04bcaa0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b811da00 con 0x7f04b809e230 2023-09-30T22:27:40.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.062+0000 7f04bcaa0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b80a2d90 con 0x7f04b809d920 2023-09-30T22:27:40.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.062+0000 7f04bcaa0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04b811d560 con 0x7f04b8130fb0 2023-09-30T22:27:40.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.063+0000 7f04b659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04b809d920 0x7f04b81c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:40.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.063+0000 7f04b659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04b809d920 0x7f04b81c6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48348/0 (socket says 172.21.15.40:48348) 2023-09-30T22:27:40.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.063+0000 7f04b659c700 1 -- 172.21.15.40:0/476947777 learned_addr learned my addr 172.21.15.40:0/476947777 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:40.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.063+0000 7f04b6d9d700 1 --2- 172.21.15.40:0/476947777 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f04b8130fb0 0x7f04b81c6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:40.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.063+0000 7f04b5d9b700 1 --2- 172.21.15.40:0/476947777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04b809e230 0x7f04b81c65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:40.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.063+0000 7f04b659c700 1 -- 172.21.15.40:0/476947777 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f04b8130fb0 msgr2=0x7f04b81c6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:40.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.063+0000 7f04b659c700 1 --2- 172.21.15.40:0/476947777 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f04b8130fb0 0x7f04b81c6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.063+0000 7f04b659c700 1 -- 172.21.15.40:0/476947777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04b809e230 msgr2=0x7f04b81c65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:40.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.063+0000 7f04b659c700 1 --2- 172.21.15.40:0/476947777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04b809e230 0x7f04b81c65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.063+0000 7f04b659c700 1 -- 172.21.15.40:0/476947777 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b0009a70 con 0x7f04b809d920 2023-09-30T22:27:40.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.063+0000 7f04b659c700 1 --2- 172.21.15.40:0/476947777 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04b809d920 0x7f04b81c6080 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f04a8000c00 tx=0x7f04a8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:40.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.063+0000 7f04a6ffd700 1 -- 172.21.15.40:0/476947777 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a8004040 con 0x7f04b809d920 2023-09-30T22:27:40.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.063+0000 7f04a6ffd700 1 -- 172.21.15.40:0/476947777 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a80041a0 con 0x7f04b809d920 2023-09-30T22:27:40.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.063+0000 7f04a6ffd700 1 -- 172.21.15.40:0/476947777 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a8004550 con 0x7f04b809d920 2023-09-30T22:27:40.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.063+0000 7f04bcaa0700 1 -- 172.21.15.40:0/476947777 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04a8009430 con 0x7f04b809d920 2023-09-30T22:27:40.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.063+0000 7f04bcaa0700 1 -- 172.21.15.40:0/476947777 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b811f080 con 0x7f04b809d920 2023-09-30T22:27:40.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.064+0000 7f04a6ffd700 1 -- 172.21.15.40:0/476947777 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f04a8026070 con 0x7f04b809d920 2023-09-30T22:27:40.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.064+0000 7f04a6ffd700 1 -- 172.21.15.40:0/476947777 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f04a8045060 con 0x7f04b809d920 2023-09-30T22:27:40.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.062+0000 7fe3b996f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe3b4131d50 0x7fe3b4132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:40.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.062+0000 7fe3b996f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe3b409bc50 0x7fe3b409c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:40.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.065+0000 7fe3b996f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b4071920 con 0x7fe3b409c600 2023-09-30T22:27:40.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.065+0000 7fe3b996f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b4132660 con 0x7fe3b409bc50 2023-09-30T22:27:40.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.065+0000 7fe3b996f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b4131900 con 0x7fe3b4131d50 2023-09-30T22:27:40.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.065+0000 7fe3b27fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe3b409bc50 0x7fe3b409c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:40.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.065+0000 7fe3b2ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe3b4131d50 0x7fe3b4132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:40.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.065+0000 7fe3b27fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe3b409bc50 0x7fe3b409c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56496/0 (socket says 172.21.15.40:56496) 2023-09-30T22:27:40.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.065+0000 7fe3b27fc700 1 -- 172.21.15.40:0/689850059 learned_addr learned my addr 172.21.15.40:0/689850059 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:40.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.065+0000 7fe3b27fc700 1 -- 172.21.15.40:0/689850059 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe3b4131d50 msgr2=0x7fe3b4132120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:40.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.065+0000 7fe3b27fc700 1 --2- 172.21.15.40:0/689850059 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe3b4131d50 0x7fe3b4132120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.065+0000 7fe3b27fc700 1 -- 172.21.15.40:0/689850059 >> v1:172.21.15.40:6789/0 conn(0x7fe3b409c600 legacy=0x7fe3b4138ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:40.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.065+0000 7fe3b27fc700 1 -- 172.21.15.40:0/689850059 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b409e820 con 0x7fe3b409bc50 2023-09-30T22:27:40.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.065+0000 7f04bcaa0700 1 -- 172.21.15.40:0/476947777 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04b811ed20 con 0x7f04b809d920 2023-09-30T22:27:40.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.065+0000 7fe3b27fc700 1 --2- 172.21.15.40:0/689850059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3b409bc50 0x7fe3b409c0c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80098f0 tx=0x7fe3a8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb557888e36e780 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:40.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.065+0000 7fe3b1ffb700 1 -- 172.21.15.40:0/689850059 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a8004230 con 0x7fe3b409bc50 2023-09-30T22:27:40.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.065+0000 7fe3b1ffb700 1 -- 172.21.15.40:0/689850059 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a8004390 con 0x7fe3b409bc50 2023-09-30T22:27:40.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.065+0000 7fe3b1ffb700 1 -- 172.21.15.40:0/689850059 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a80036a0 con 0x7fe3b409bc50 2023-09-30T22:27:40.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.066+0000 7fe3b996f700 1 -- 172.21.15.40:0/689850059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3b409bc50 msgr2=0x7fe3b409c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:40.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.066+0000 7fe3b996f700 1 --2- 172.21.15.40:0/689850059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3b409bc50 0x7fe3b409c0c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80098f0 tx=0x7fe3a8009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:40.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.067+0000 7fe3b996f700 1 -- 172.21.15.40:0/689850059 shutdown_connections 2023-09-30T22:27:40.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.067+0000 7fe3b996f700 1 --2- 172.21.15.40:0/689850059 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe3b4131d50 0x7fe3b4132120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.067+0000 7fe3b996f700 1 --2- 172.21.15.40:0/689850059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3b409bc50 0x7fe3b409c0c0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.067+0000 7fe3b996f700 1 -- 172.21.15.40:0/689850059 >> 172.21.15.40:0/689850059 conn(0x7fe3b40a2a00 msgr2=0x7fe3b40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:40.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.067+0000 7fe3b996f700 1 -- 172.21.15.40:0/689850059 shutdown_connections 2023-09-30T22:27:40.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.067+0000 7fe3b996f700 1 -- 172.21.15.40:0/689850059 wait complete. 2023-09-30T22:27:40.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.068+0000 7fe3b996f700 1 Processor -- start 2023-09-30T22:27:40.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.068+0000 7fe3b996f700 1 -- start start 2023-09-30T22:27:40.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.069+0000 7fe3b996f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3b409bc50 0x7fe3b4134790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:40.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.069+0000 7fe3b996f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe3b409c600 0x7fe3b4134cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:40.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.069+0000 7fe3b996f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe3b4131d50 0x7fe3b41c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:40.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.069+0000 7fe3b996f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b41379e0 con 0x7fe3b409bc50 2023-09-30T22:27:40.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.069+0000 7fe3b996f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b413ad90 con 0x7fe3b409c600 2023-09-30T22:27:40.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.069+0000 7fe3b996f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b409ea60 con 0x7fe3b4131d50 2023-09-30T22:27:40.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.069+0000 7fe3b2ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3b409bc50 0x7fe3b4134790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:40.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.069+0000 7fe3b2ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3b409bc50 0x7fe3b4134790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56500/0 (socket says 172.21.15.40:56500) 2023-09-30T22:27:40.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.069+0000 7fe3b2ffd700 1 -- 172.21.15.40:0/1782715772 learned_addr learned my addr 172.21.15.40:0/1782715772 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:40.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.069+0000 7fe3b37fe700 1 --2- 172.21.15.40:0/1782715772 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe3b4131d50 0x7fe3b41c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:40.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.069+0000 7fe3b27fc700 1 --2- 172.21.15.40:0/1782715772 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe3b409c600 0x7fe3b4134cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:40.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.069+0000 7fe3b2ffd700 1 -- 172.21.15.40:0/1782715772 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe3b4131d50 msgr2=0x7fe3b41c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:40.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.069+0000 7fe3b2ffd700 1 --2- 172.21.15.40:0/1782715772 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe3b4131d50 0x7fe3b41c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.069+0000 7fe3b2ffd700 1 -- 172.21.15.40:0/1782715772 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe3b409c600 msgr2=0x7fe3b4134cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:40.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.069+0000 7fe3b2ffd700 1 --2- 172.21.15.40:0/1782715772 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe3b409c600 0x7fe3b4134cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.070+0000 7fe3b2ffd700 1 -- 172.21.15.40:0/1782715772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a8009550 con 0x7fe3b409bc50 2023-09-30T22:27:40.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.070+0000 7fe3b27fc700 1 --2- 172.21.15.40:0/1782715772 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe3b409c600 0x7fe3b4134cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:40.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.070+0000 7fe3b2ffd700 1 --2- 172.21.15.40:0/1782715772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3b409bc50 0x7fe3b4134790 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fe3a400c7f0 tx=0x7fe3a400cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:40.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.070+0000 7fe39bfff700 1 -- 172.21.15.40:0/1782715772 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a4004220 con 0x7fe3b409bc50 2023-09-30T22:27:40.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.070+0000 7fe39bfff700 1 -- 172.21.15.40:0/1782715772 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a4004380 con 0x7fe3b409bc50 2023-09-30T22:27:40.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.070+0000 7fe39bfff700 1 -- 172.21.15.40:0/1782715772 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a40036a0 con 0x7fe3b409bc50 2023-09-30T22:27:40.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.071+0000 7fe3b996f700 1 -- 172.21.15.40:0/1782715772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3b4135ad0 con 0x7fe3b409bc50 2023-09-30T22:27:40.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.071+0000 7fe3b996f700 1 -- 172.21.15.40:0/1782715772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b4138170 con 0x7fe3b409bc50 2023-09-30T22:27:40.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.072+0000 7fe3b996f700 1 -- 172.21.15.40:0/1782715772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3b4062380 con 0x7fe3b409bc50 2023-09-30T22:27:40.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.072+0000 7fe39bfff700 1 -- 172.21.15.40:0/1782715772 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe3a4003800 con 0x7fe3b409bc50 2023-09-30T22:27:40.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.073+0000 7fe39bfff700 1 -- 172.21.15.40:0/1782715772 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe3a403f800 con 0x7fe3b409bc50 2023-09-30T22:27:40.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.074+0000 7f04a6ffd700 1 -- 172.21.15.40:0/476947777 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f04a802e070 con 0x7f04b809d920 2023-09-30T22:27:40.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.079+0000 7fe39bfff700 1 -- 172.21.15.40:0/1782715772 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe3a4010530 con 0x7fe3b409bc50 2023-09-30T22:27:40.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.102+0000 7f9cb87c7700 1 -- 172.21.15.40:0/1397588094 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9cb009ecf0 con 0x7f9cb009c890 2023-09-30T22:27:40.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.102+0000 7f9ca6ffd700 1 -- 172.21.15.40:0/1397588094 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9cb009ecf0 con 0x7f9cb009c890 2023-09-30T22:27:40.103 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:40.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.105+0000 7f9cb87c7700 1 -- 172.21.15.40:0/1397588094 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9cb009c890 msgr2=0x7f9cb01c89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:40.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.105+0000 7f9cb87c7700 1 --2- 172.21.15.40:0/1397588094 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9cb009c890 0x7f9cb01c89e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0009c10 tx=0x7f9ca0004750 comp rx=0 tx=0).stop 2023-09-30T22:27:40.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.105+0000 7f9cb87c7700 1 -- 172.21.15.40:0/1397588094 shutdown_connections 2023-09-30T22:27:40.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.105+0000 7f9cb87c7700 1 --2- 172.21.15.40:0/1397588094 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9cb009c890 0x7f9cb01c89e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.105+0000 7f9cb87c7700 1 --2- 172.21.15.40:0/1397588094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9cb009e2b0 0x7f9cb01c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.105+0000 7f9cb87c7700 1 --2- 172.21.15.40:0/1397588094 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9cb009d920 0x7f9cb01c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.105+0000 7f9cb87c7700 1 -- 172.21.15.40:0/1397588094 >> 172.21.15.40:0/1397588094 conn(0x7f9cb00a7080 msgr2=0x7f9cb00a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:40.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.106+0000 7f9cb87c7700 1 -- 172.21.15.40:0/1397588094 shutdown_connections 2023-09-30T22:27:40.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.106+0000 7f9cb87c7700 1 -- 172.21.15.40:0/1397588094 wait complete. 2023-09-30T22:27:40.124 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:40.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.244+0000 7fae8f0f9700 1 -- 172.21.15.40:0/2778643220 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fae88062380 con 0x7fae8809d450 2023-09-30T22:27:40.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.244+0000 7fae857fa700 1 -- 172.21.15.40:0/2778643220 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fae7c015020 con 0x7fae8809d450 2023-09-30T22:27:40.245 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:40.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.247+0000 7fae8f0f9700 1 -- 172.21.15.40:0/2778643220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae8809d450 msgr2=0x7fae88126330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:40.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.247+0000 7fae8f0f9700 1 --2- 172.21.15.40:0/2778643220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae8809d450 0x7fae88126330 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fae7c009b90 tx=0x7fae7c004750 comp rx=0 tx=0).stop 2023-09-30T22:27:40.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.247+0000 7fae8f0f9700 1 -- 172.21.15.40:0/2778643220 shutdown_connections 2023-09-30T22:27:40.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.247+0000 7fae8f0f9700 1 --2- 172.21.15.40:0/2778643220 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae88130700 0x7fae881c6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.247+0000 7fae8f0f9700 1 --2- 172.21.15.40:0/2778643220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae8809d450 0x7fae88126330 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.247+0000 7fae8f0f9700 1 --2- 172.21.15.40:0/2778643220 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae8809dd60 0x7fae88126870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.247+0000 7fae8f0f9700 1 -- 172.21.15.40:0/2778643220 >> 172.21.15.40:0/2778643220 conn(0x7fae880a2a00 msgr2=0x7fae8806e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:40.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.247+0000 7fae8f0f9700 1 -- 172.21.15.40:0/2778643220 shutdown_connections 2023-09-30T22:27:40.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.247+0000 7fae8f0f9700 1 -- 172.21.15.40:0/2778643220 wait complete. 2023-09-30T22:27:40.260 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:40.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.274+0000 7f04bcaa0700 1 -- 172.21.15.40:0/476947777 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f04b8062380 con 0x7f04b809d920 2023-09-30T22:27:40.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.274+0000 7f04a6ffd700 1 -- 172.21.15.40:0/476947777 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f04a80323a0 con 0x7f04b809d920 2023-09-30T22:27:40.275 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:40.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.275+0000 7fe3b996f700 1 -- 172.21.15.40:0/1782715772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe3b4137640 con 0x7fe3b409bc50 2023-09-30T22:27:40.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.276+0000 7fe39bfff700 1 -- 172.21.15.40:0/1782715772 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe3b4137640 con 0x7fe3b409bc50 2023-09-30T22:27:40.276 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:40.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.277+0000 7f04bcaa0700 1 -- 172.21.15.40:0/476947777 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04b809d920 msgr2=0x7f04b81c6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:40.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.277+0000 7f04bcaa0700 1 --2- 172.21.15.40:0/476947777 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04b809d920 0x7f04b81c6080 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f04a8000c00 tx=0x7f04a8004750 comp rx=0 tx=0).stop 2023-09-30T22:27:40.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.277+0000 7f04bcaa0700 1 -- 172.21.15.40:0/476947777 shutdown_connections 2023-09-30T22:27:40.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.277+0000 7f04bcaa0700 1 --2- 172.21.15.40:0/476947777 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f04b8130fb0 0x7f04b81c6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.277+0000 7f04bcaa0700 1 --2- 172.21.15.40:0/476947777 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04b809d920 0x7f04b81c6080 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.277+0000 7f04bcaa0700 1 --2- 172.21.15.40:0/476947777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04b809e230 0x7f04b81c65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.277+0000 7f04bcaa0700 1 -- 172.21.15.40:0/476947777 >> 172.21.15.40:0/476947777 conn(0x7f04b809fb20 msgr2=0x7f04b81b67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:40.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.277+0000 7f04bcaa0700 1 -- 172.21.15.40:0/476947777 shutdown_connections 2023-09-30T22:27:40.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.277+0000 7f04bcaa0700 1 -- 172.21.15.40:0/476947777 wait complete. 2023-09-30T22:27:40.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.278+0000 7fe3b996f700 1 -- 172.21.15.40:0/1782715772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3b409bc50 msgr2=0x7fe3b4134790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:40.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.278+0000 7fe3b996f700 1 --2- 172.21.15.40:0/1782715772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3b409bc50 0x7fe3b4134790 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fe3a400c7f0 tx=0x7fe3a400cb00 comp rx=0 tx=0).stop 2023-09-30T22:27:40.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.278+0000 7fe3b996f700 1 -- 172.21.15.40:0/1782715772 shutdown_connections 2023-09-30T22:27:40.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.278+0000 7fe3b996f700 1 --2- 172.21.15.40:0/1782715772 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe3b4131d50 0x7fe3b41c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.278+0000 7fe3b996f700 1 --2- 172.21.15.40:0/1782715772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3b409bc50 0x7fe3b4134790 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.278+0000 7fe3b996f700 1 --2- 172.21.15.40:0/1782715772 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe3b409c600 0x7fe3b4134cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.278+0000 7fe3b996f700 1 -- 172.21.15.40:0/1782715772 >> 172.21.15.40:0/1782715772 conn(0x7fe3b40a2a00 msgr2=0x7fe3b40a1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:40.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.278+0000 7fe3b996f700 1 -- 172.21.15.40:0/1782715772 shutdown_connections 2023-09-30T22:27:40.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:40.278+0000 7fe3b996f700 1 -- 172.21.15.40:0/1782715772 wait complete. 2023-09-30T22:27:40.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:40.291 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:41.125 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:41.260 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:41.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.266+0000 7f25dfc23700 1 Processor -- start 2023-09-30T22:27:41.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.266+0000 7f25dfc23700 1 -- start start 2023-09-30T22:27:41.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.267+0000 7f25dfc23700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f25d806f070 0x7f25d806f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.267+0000 7f25dfc23700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f25d806f980 0x7f25d8097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.267+0000 7f25dfc23700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25d8070830 con 0x7f25d806fdb0 2023-09-30T22:27:41.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.267+0000 7f25dfc23700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d8071af0 con 0x7f25d806f070 2023-09-30T22:27:41.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.267+0000 7f25dfc23700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25d8070ad0 con 0x7f25d806f980 2023-09-30T22:27:41.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.267+0000 7f25dd1be700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f25d806f980 0x7f25d8097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.267+0000 7f25dd1be700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f25d806f980 0x7f25d8097090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56556/0 (socket says 172.21.15.40:56556) 2023-09-30T22:27:41.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.267+0000 7f25dd1be700 1 -- 172.21.15.40:0/2474737197 learned_addr learned my addr 172.21.15.40:0/2474737197 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:41.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.267+0000 7f25dd9bf700 1 --2- 172.21.15.40:0/2474737197 >> v2:172.21.15.40:3300/0 conn(0x7f25d806f070 0x7f25d806f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.267+0000 7f25dd1be700 1 -- 172.21.15.40:0/2474737197 >> v2:172.21.15.40:3300/0 conn(0x7f25d806f070 msgr2=0x7f25d806f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:41.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.267+0000 7f25dd1be700 1 --2- 172.21.15.40:0/2474737197 >> v2:172.21.15.40:3300/0 conn(0x7f25d806f070 0x7f25d806f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.267+0000 7f25dd1be700 1 -- 172.21.15.40:0/2474737197 >> v1:172.21.15.40:6789/0 conn(0x7f25d806fdb0 legacy=0x7f25d80975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.267+0000 7f25dd1be700 1 -- 172.21.15.40:0/2474737197 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d8070de0 con 0x7f25d806f980 2023-09-30T22:27:41.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.268+0000 7f25dd1be700 1 --2- 172.21.15.40:0/2474737197 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f25d806f980 0x7f25d8097090 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f25c8009920 tx=0x7f25c8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9a0c1880b83e89f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:41.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.268+0000 7f25dc9bd700 1 -- 172.21.15.40:0/2474737197 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c8011830 con 0x7f25d806f980 2023-09-30T22:27:41.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.268+0000 7f25dc9bd700 1 -- 172.21.15.40:0/2474737197 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c8011990 con 0x7f25d806f980 2023-09-30T22:27:41.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.268+0000 7f25dc9bd700 1 -- 172.21.15.40:0/2474737197 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c8011d20 con 0x7f25d806f980 2023-09-30T22:27:41.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.269+0000 7f25dfc23700 1 -- 172.21.15.40:0/2474737197 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f25d806f980 msgr2=0x7f25d8097090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.269+0000 7f25dfc23700 1 --2- 172.21.15.40:0/2474737197 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f25d806f980 0x7f25d8097090 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f25c8009920 tx=0x7f25c8009c30 comp rx=0 tx=0).stop 2023-09-30T22:27:41.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.269+0000 7f25dfc23700 1 -- 172.21.15.40:0/2474737197 shutdown_connections 2023-09-30T22:27:41.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.269+0000 7f25dfc23700 1 --2- 172.21.15.40:0/2474737197 >> v2:172.21.15.40:3300/0 conn(0x7f25d806f070 0x7f25d806f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.269+0000 7f25dfc23700 1 --2- 172.21.15.40:0/2474737197 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f25d806f980 0x7f25d8097090 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.269+0000 7f25dfc23700 1 -- 172.21.15.40:0/2474737197 >> 172.21.15.40:0/2474737197 conn(0x7f25d80a41a0 msgr2=0x7f25d80a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:41.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.269+0000 7f25dfc23700 1 -- 172.21.15.40:0/2474737197 shutdown_connections 2023-09-30T22:27:41.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.269+0000 7f25dfc23700 1 -- 172.21.15.40:0/2474737197 wait complete. 2023-09-30T22:27:41.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.270+0000 7f25dfc23700 1 Processor -- start 2023-09-30T22:27:41.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.270+0000 7f25dfc23700 1 -- start start 2023-09-30T22:27:41.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.270+0000 7f25dfc23700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25d806f070 0x7f25d812d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.270+0000 7f25dfc23700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f25d806f980 0x7f25d812da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.270+0000 7f25dfc23700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f25d806fdb0 0x7f25d812dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.270+0000 7f25dfc23700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d8130840 con 0x7f25d806f070 2023-09-30T22:27:41.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.270+0000 7f25dfc23700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d812c2d0 con 0x7f25d806f980 2023-09-30T22:27:41.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.270+0000 7f25dfc23700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25d812fa10 con 0x7f25d806fdb0 2023-09-30T22:27:41.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.270+0000 7f25dd1be700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f25d806f980 0x7f25d812da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.270+0000 7f25de1c0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f25d806fdb0 0x7f25d812dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.270+0000 7f25dd1be700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f25d806f980 0x7f25d812da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48368/0 (socket says 172.21.15.40:48368) 2023-09-30T22:27:41.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.271+0000 7f25dd1be700 1 -- 172.21.15.40:0/1140668573 learned_addr learned my addr 172.21.15.40:0/1140668573 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:41.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.271+0000 7f25dd9bf700 1 --2- 172.21.15.40:0/1140668573 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25d806f070 0x7f25d812d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.271+0000 7f25dd1be700 1 -- 172.21.15.40:0/1140668573 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f25d806fdb0 msgr2=0x7f25d812dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.271+0000 7f25dd1be700 1 --2- 172.21.15.40:0/1140668573 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f25d806fdb0 0x7f25d812dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.271+0000 7f25dd1be700 1 -- 172.21.15.40:0/1140668573 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25d806f070 msgr2=0x7f25d812d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.271+0000 7f25dd1be700 1 --2- 172.21.15.40:0/1140668573 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25d806f070 0x7f25d812d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.271+0000 7f25dd1be700 1 -- 172.21.15.40:0/1140668573 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c8009550 con 0x7f25d806f980 2023-09-30T22:27:41.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.271+0000 7f25dd1be700 1 --2- 172.21.15.40:0/1140668573 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f25d806f980 0x7f25d812da70 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f25c8009c70 tx=0x7f25c8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:41.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.271+0000 7f25ce7fc700 1 -- 172.21.15.40:0/1140668573 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c8004240 con 0x7f25d806f980 2023-09-30T22:27:41.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.271+0000 7f25ce7fc700 1 -- 172.21.15.40:0/1140668573 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c801f070 con 0x7f25d806f980 2023-09-30T22:27:41.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.271+0000 7f25ce7fc700 1 -- 172.21.15.40:0/1140668573 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c80036a0 con 0x7f25d806f980 2023-09-30T22:27:41.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.271+0000 7f25dfc23700 1 -- 172.21.15.40:0/1140668573 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d8130b20 con 0x7f25d806f980 2023-09-30T22:27:41.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.271+0000 7f25dfc23700 1 -- 172.21.15.40:0/1140668573 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d8131700 con 0x7f25d806f980 2023-09-30T22:27:41.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.272+0000 7f25ce7fc700 1 -- 172.21.15.40:0/1140668573 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f25c8021030 con 0x7f25d806f980 2023-09-30T22:27:41.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.272+0000 7f25ce7fc700 1 -- 172.21.15.40:0/1140668573 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f25c8040920 con 0x7f25d806f980 2023-09-30T22:27:41.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.273+0000 7f25dfc23700 1 -- 172.21.15.40:0/1140668573 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d8062380 con 0x7f25d806f980 2023-09-30T22:27:41.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.277+0000 7f25ce7fc700 1 -- 172.21.15.40:0/1140668573 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25c8015080 con 0x7f25d806f980 2023-09-30T22:27:41.291 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:41.291 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:41.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.396+0000 7f66c4508700 1 Processor -- start 2023-09-30T22:27:41.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.396+0000 7f66c4508700 1 -- start start 2023-09-30T22:27:41.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.397+0000 7f66c4508700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66bc09d920 0x7f66bc09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.397+0000 7f66c4508700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f66bc130fb0 0x7f66bc138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.397+0000 7f66c4508700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66bc09adf0 con 0x7f66bc09e230 2023-09-30T22:27:41.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.397+0000 7f66c4508700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66bc09edf0 con 0x7f66bc130fb0 2023-09-30T22:27:41.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.397+0000 7f66c4508700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc09b660 con 0x7f66bc09d920 2023-09-30T22:27:41.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.397+0000 7f66c1aa3700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f66bc09e230 0x7f66bc1308a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41658/0 (socket says 172.21.15.40:41658) 2023-09-30T22:27:41.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.397+0000 7f66c1aa3700 1 -- 172.21.15.40:0/2635266201 learned_addr learned my addr 172.21.15.40:0/2635266201 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:27:41.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.397+0000 7f66c22a4700 1 --2- 172.21.15.40:0/2635266201 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66bc09d920 0x7f66bc09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.398+0000 7f66c2aa5700 1 --2- 172.21.15.40:0/2635266201 >> v2:172.21.15.40:3300/0 conn(0x7f66bc130fb0 0x7f66bc138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.398+0000 7f66c22a4700 1 -- 172.21.15.40:0/2635266201 >> v2:172.21.15.40:3300/0 conn(0x7f66bc130fb0 msgr2=0x7f66bc138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:41.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.398+0000 7f66c22a4700 1 --2- 172.21.15.40:0/2635266201 >> v2:172.21.15.40:3300/0 conn(0x7f66bc130fb0 0x7f66bc138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.398+0000 7f66c22a4700 1 -- 172.21.15.40:0/2635266201 >> v1:172.21.15.40:6789/0 conn(0x7f66bc09e230 legacy=0x7f66bc1308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.398+0000 7f66c22a4700 1 -- 172.21.15.40:0/2635266201 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66bc09a6e0 con 0x7f66bc09d920 2023-09-30T22:27:41.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.398+0000 7f66c22a4700 1 --2- 172.21.15.40:0/2635266201 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66bc09d920 0x7f66bc09dcf0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f66b800bac0 tx=0x7f66b800bdd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e40fd65007429f32 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:41.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.398+0000 7f66c12a2700 1 -- 172.21.15.40:0/2635266201 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b8005e30 con 0x7f66bc09d920 2023-09-30T22:27:41.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.398+0000 7f66c12a2700 1 -- 172.21.15.40:0/2635266201 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b800d860 con 0x7f66bc09d920 2023-09-30T22:27:41.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.398+0000 7f66c12a2700 1 -- 172.21.15.40:0/2635266201 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b800dbf0 con 0x7f66bc09d920 2023-09-30T22:27:41.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.399+0000 7f66c4508700 1 -- 172.21.15.40:0/2635266201 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66bc09d920 msgr2=0x7f66bc09dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.399+0000 7f66c4508700 1 --2- 172.21.15.40:0/2635266201 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66bc09d920 0x7f66bc09dcf0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f66b800bac0 tx=0x7f66b800bdd0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.399+0000 7f66c4508700 1 -- 172.21.15.40:0/2635266201 shutdown_connections 2023-09-30T22:27:41.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.399+0000 7f66c4508700 1 --2- 172.21.15.40:0/2635266201 >> v2:172.21.15.40:3300/0 conn(0x7f66bc130fb0 0x7f66bc138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.399+0000 7f66c4508700 1 --2- 172.21.15.40:0/2635266201 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66bc09d920 0x7f66bc09dcf0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.399+0000 7f66c4508700 1 -- 172.21.15.40:0/2635266201 >> 172.21.15.40:0/2635266201 conn(0x7f66bc09fb20 msgr2=0x7f66bc09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:41.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.399+0000 7f66c4508700 1 -- 172.21.15.40:0/2635266201 shutdown_connections 2023-09-30T22:27:41.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.399+0000 7f66c4508700 1 -- 172.21.15.40:0/2635266201 wait complete. 2023-09-30T22:27:41.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.401+0000 7f66c4508700 1 Processor -- start 2023-09-30T22:27:41.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.401+0000 7f66c4508700 1 -- start start 2023-09-30T22:27:41.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.402+0000 7f66c4508700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66bc09d920 0x7f66bc11d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.402+0000 7f66c4508700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66bc09e230 0x7f66bc11d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.402+0000 7f66c4508700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66bc130fb0 0x7f66bc11dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.402+0000 7f66c4508700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc120ab0 con 0x7f66bc09e230 2023-09-30T22:27:41.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.402+0000 7f66c4508700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc11f4a0 con 0x7f66bc09d920 2023-09-30T22:27:41.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.402+0000 7f66c4508700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc120520 con 0x7f66bc130fb0 2023-09-30T22:27:41.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.402+0000 7f66c2aa5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66bc130fb0 0x7f66bc11dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.402+0000 7f66c2aa5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66bc130fb0 0x7f66bc11dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56572/0 (socket says 172.21.15.40:56572) 2023-09-30T22:27:41.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.402+0000 7f66c2aa5700 1 -- 172.21.15.40:0/1164379303 learned_addr learned my addr 172.21.15.40:0/1164379303 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:41.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.402+0000 7f66c22a4700 1 --2- 172.21.15.40:0/1164379303 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66bc09d920 0x7f66bc11d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.402+0000 7f66c1aa3700 1 --2- 172.21.15.40:0/1164379303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66bc09e230 0x7f66bc11d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.402+0000 7f66c22a4700 1 -- 172.21.15.40:0/1164379303 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66bc130fb0 msgr2=0x7f66bc11dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.402+0000 7f66c22a4700 1 --2- 172.21.15.40:0/1164379303 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66bc130fb0 0x7f66bc11dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.402+0000 7f66c22a4700 1 -- 172.21.15.40:0/1164379303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66bc09e230 msgr2=0x7f66bc11d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.402+0000 7f66c22a4700 1 --2- 172.21.15.40:0/1164379303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66bc09e230 0x7f66bc11d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.402+0000 7f66c22a4700 1 -- 172.21.15.40:0/1164379303 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b800b6d0 con 0x7f66bc09d920 2023-09-30T22:27:41.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.403+0000 7f66c22a4700 1 --2- 172.21.15.40:0/1164379303 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66bc09d920 0x7f66bc11d2c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f66b8017000 tx=0x7f66b8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:41.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.403+0000 7f66c2aa5700 1 --2- 172.21.15.40:0/1164379303 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66bc130fb0 0x7f66bc11dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:41.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.403+0000 7f66b2ffd700 1 -- 172.21.15.40:0/1164379303 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b8004520 con 0x7f66bc09d920 2023-09-30T22:27:41.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.403+0000 7f66b2ffd700 1 -- 172.21.15.40:0/1164379303 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b80108a0 con 0x7f66bc09d920 2023-09-30T22:27:41.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.403+0000 7f66c4508700 1 -- 172.21.15.40:0/1164379303 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66bc09cb00 con 0x7f66bc09d920 2023-09-30T22:27:41.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.403+0000 7f66b2ffd700 1 -- 172.21.15.40:0/1164379303 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b8010c50 con 0x7f66bc09d920 2023-09-30T22:27:41.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.403+0000 7f66c4508700 1 -- 172.21.15.40:0/1164379303 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66bc1200d0 con 0x7f66bc09d920 2023-09-30T22:27:41.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.404+0000 7f66b2ffd700 1 -- 172.21.15.40:0/1164379303 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f66b80036a0 con 0x7f66bc09d920 2023-09-30T22:27:41.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.404+0000 7f66c4508700 1 -- 172.21.15.40:0/1164379303 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66bc062380 con 0x7f66bc09d920 2023-09-30T22:27:41.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.404+0000 7f66b2ffd700 1 -- 172.21.15.40:0/1164379303 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f66b8042e70 con 0x7f66bc09d920 2023-09-30T22:27:41.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.412+0000 7f66b2ffd700 1 -- 172.21.15.40:0/1164379303 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f66b80199a0 con 0x7f66bc09d920 2023-09-30T22:27:41.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.430+0000 7f5f3a5f9700 1 Processor -- start 2023-09-30T22:27:41.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.430+0000 7f5f3a5f9700 1 -- start start 2023-09-30T22:27:41.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.430+0000 7f5f3a5f9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f3409e030 0x7f5f3413d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.430+0000 7f5f3a5f9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5f3409e420 0x7f5f3413f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.430+0000 7f5f3a5f9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f3411d980 con 0x7f5f3406a6d0 2023-09-30T22:27:41.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.430+0000 7f5f3a5f9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f3406aaa0 con 0x7f5f3409e420 2023-09-30T22:27:41.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.430+0000 7f5f3a5f9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3406b150 con 0x7f5f3409e030 2023-09-30T22:27:41.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.431+0000 7f5f337fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f3409e030 0x7f5f3413d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.431+0000 7f5f337fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f3409e030 0x7f5f3413d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48382/0 (socket says 172.21.15.40:48382) 2023-09-30T22:27:41.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.431+0000 7f5f337fe700 1 -- 172.21.15.40:0/3919037888 learned_addr learned my addr 172.21.15.40:0/3919037888 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:41.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.431+0000 7f5f337fe700 1 -- 172.21.15.40:0/3919037888 >> v2:172.21.15.40:3300/0 conn(0x7f5f3409e420 msgr2=0x7f5f3413f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:41.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.431+0000 7f5f337fe700 1 --2- 172.21.15.40:0/3919037888 >> v2:172.21.15.40:3300/0 conn(0x7f5f3409e420 0x7f5f3413f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.431+0000 7f5f337fe700 1 -- 172.21.15.40:0/3919037888 >> v1:172.21.15.40:6789/0 conn(0x7f5f3406a6d0 legacy=0x7f5f3409d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:41.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.431+0000 7f5f337fe700 1 -- 172.21.15.40:0/3919037888 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3409f300 con 0x7f5f3409e030 2023-09-30T22:27:41.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.431+0000 7f5f337fe700 1 --2- 172.21.15.40:0/3919037888 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f3409e030 0x7f5f3413d4a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5f280098f0 tx=0x7f5f28009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=557341f52e130fb7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:41.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.431+0000 7f5f32ffd700 1 -- 172.21.15.40:0/3919037888 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f28004230 con 0x7f5f3409e030 2023-09-30T22:27:41.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.431+0000 7f5f32ffd700 1 -- 172.21.15.40:0/3919037888 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f28004390 con 0x7f5f3409e030 2023-09-30T22:27:41.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.431+0000 7f5f32ffd700 1 -- 172.21.15.40:0/3919037888 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f280036a0 con 0x7f5f3409e030 2023-09-30T22:27:41.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.432+0000 7f5f3a5f9700 1 -- 172.21.15.40:0/3919037888 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f3409e030 msgr2=0x7f5f3413d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.432+0000 7f5f3a5f9700 1 --2- 172.21.15.40:0/3919037888 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f3409e030 0x7f5f3413d4a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5f280098f0 tx=0x7f5f28009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:41.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.432+0000 7f5f3a5f9700 1 -- 172.21.15.40:0/3919037888 shutdown_connections 2023-09-30T22:27:41.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.432+0000 7f5f3a5f9700 1 --2- 172.21.15.40:0/3919037888 >> v2:172.21.15.40:3300/0 conn(0x7f5f3409e420 0x7f5f3413f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.432+0000 7f5f3a5f9700 1 --2- 172.21.15.40:0/3919037888 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f3409e030 0x7f5f3413d4a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.432+0000 7f5f3a5f9700 1 -- 172.21.15.40:0/3919037888 >> 172.21.15.40:0/3919037888 conn(0x7f5f3409fb20 msgr2=0x7f5f3409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:41.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.432+0000 7f5f3a5f9700 1 -- 172.21.15.40:0/3919037888 shutdown_connections 2023-09-30T22:27:41.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.432+0000 7f5f3a5f9700 1 -- 172.21.15.40:0/3919037888 wait complete. 2023-09-30T22:27:41.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.433+0000 7f5f3a5f9700 1 Processor -- start 2023-09-30T22:27:41.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.433+0000 7f5f3a5f9700 1 -- start start 2023-09-30T22:27:41.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.434+0000 7f5f3a5f9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f3406a6d0 0x7f5f3406e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.434+0000 7f5f3a5f9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f3409e030 0x7f5f3406e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.434+0000 7f5f3a5f9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f3409e420 0x7f5f3406ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.434+0000 7f5f3a5f9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3406fba0 con 0x7f5f3409e030 2023-09-30T22:27:41.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.434+0000 7f5f3a5f9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f340714f0 con 0x7f5f3406a6d0 2023-09-30T22:27:41.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.434+0000 7f5f3a5f9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3413fd90 con 0x7f5f3409e420 2023-09-30T22:27:41.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.434+0000 7f5f337fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f3409e030 0x7f5f3406e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.434+0000 7f5f337fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f3409e030 0x7f5f3406e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56556/0 (socket says 172.21.15.40:56556) 2023-09-30T22:27:41.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.434+0000 7f5f337fe700 1 -- 172.21.15.40:0/25640882 learned_addr learned my addr 172.21.15.40:0/25640882 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:41.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.434+0000 7f5f337fe700 1 -- 172.21.15.40:0/25640882 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f3409e420 msgr2=0x7f5f3406ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.434+0000 7f5f337fe700 1 --2- 172.21.15.40:0/25640882 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f3409e420 0x7f5f3406ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.434+0000 7f5f337fe700 1 -- 172.21.15.40:0/25640882 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f3406a6d0 msgr2=0x7f5f3406e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.434+0000 7f5f337fe700 1 --2- 172.21.15.40:0/25640882 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f3406a6d0 0x7f5f3406e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.434+0000 7f5f337fe700 1 -- 172.21.15.40:0/25640882 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f28009550 con 0x7f5f3409e030 2023-09-30T22:27:41.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.435+0000 7f5f337fe700 1 --2- 172.21.15.40:0/25640882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f3409e030 0x7f5f3406e6f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f5f3406b290 tx=0x7f5f28004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:41.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.435+0000 7f62aca0a700 1 Processor -- start 2023-09-30T22:27:41.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.435+0000 7f5f30ff9700 1 -- 172.21.15.40:0/25640882 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f28003e70 con 0x7f5f3409e030 2023-09-30T22:27:41.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.435+0000 7f62aca0a700 1 -- start start 2023-09-30T22:27:41.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.435+0000 7f5f30ff9700 1 -- 172.21.15.40:0/25640882 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2801f070 con 0x7f5f3409e030 2023-09-30T22:27:41.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.435+0000 7f5f3a5f9700 1 -- 172.21.15.40:0/25640882 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f3409f540 con 0x7f5f3409e030 2023-09-30T22:27:41.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.435+0000 7f5f30ff9700 1 -- 172.21.15.40:0/25640882 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2800b8a0 con 0x7f5f3409e030 2023-09-30T22:27:41.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.435+0000 7f5f3a5f9700 1 -- 172.21.15.40:0/25640882 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3406f660 con 0x7f5f3409e030 2023-09-30T22:27:41.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.436+0000 7f5f30ff9700 1 -- 172.21.15.40:0/25640882 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5f28021030 con 0x7f5f3409e030 2023-09-30T22:27:41.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.436+0000 7f62aca0a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f62a812f070 0x7f62a8135c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.436+0000 7f62aca0a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62a8136170 0x7f62a8138550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.436+0000 7f62aca0a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62a809ab70 con 0x7f62a812e590 2023-09-30T22:27:41.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.436+0000 7f62aca0a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62a812f470 con 0x7f62a812f070 2023-09-30T22:27:41.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.436+0000 7f62aca0a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62a809b270 con 0x7f62a8136170 2023-09-30T22:27:41.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.436+0000 7f62a659c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f62a812e590 0x7f62a812e960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41670/0 (socket says 172.21.15.40:41670) 2023-09-30T22:27:41.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.436+0000 7f62a659c700 1 -- 172.21.15.40:0/3953086701 learned_addr learned my addr 172.21.15.40:0/3953086701 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:27:41.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.436+0000 7f5f30ff9700 1 -- 172.21.15.40:0/25640882 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5f28040ee0 con 0x7f5f3409e030 2023-09-30T22:27:41.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.436+0000 7f62a5d9b700 1 --2- 172.21.15.40:0/3953086701 >> v2:172.21.15.40:3300/0 conn(0x7f62a812f070 0x7f62a8135c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.436+0000 7f62a559a700 1 -- 172.21.15.40:0/3953086701 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2063555459 0 0) 0x7f62a809ab70 con 0x7f62a812e590 2023-09-30T22:27:41.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.437+0000 7f62a559a700 1 -- 172.21.15.40:0/3953086701 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62900035b0 con 0x7f62a812e590 2023-09-30T22:27:41.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.437+0000 7f62a5d9b700 1 -- 172.21.15.40:0/3953086701 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62a8136170 msgr2=0x7f62a8138550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:41.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.437+0000 7f62a5d9b700 1 --2- 172.21.15.40:0/3953086701 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62a8136170 0x7f62a8138550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.437+0000 7f62a5d9b700 1 -- 172.21.15.40:0/3953086701 >> v1:172.21.15.40:6789/0 conn(0x7f62a812e590 legacy=0x7f62a812e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.437+0000 7f62a5d9b700 1 -- 172.21.15.40:0/3953086701 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a809bd70 con 0x7f62a812f070 2023-09-30T22:27:41.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.437+0000 7f62a5d9b700 1 --2- 172.21.15.40:0/3953086701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62a812f070 0x7f62a8135c30 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f629c009840 tx=0x7f629c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb99e3e45a1d915b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:41.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.437+0000 7f62a559a700 1 -- 172.21.15.40:0/3953086701 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c011830 con 0x7f62a812f070 2023-09-30T22:27:41.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.437+0000 7f62a559a700 1 -- 172.21.15.40:0/3953086701 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629c011990 con 0x7f62a812f070 2023-09-30T22:27:41.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.437+0000 7f62a559a700 1 -- 172.21.15.40:0/3953086701 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c011d20 con 0x7f62a812f070 2023-09-30T22:27:41.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.438+0000 7f62aca0a700 1 -- 172.21.15.40:0/3953086701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62a812f070 msgr2=0x7f62a8135c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.438+0000 7f62aca0a700 1 --2- 172.21.15.40:0/3953086701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62a812f070 0x7f62a8135c30 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f629c009840 tx=0x7f629c009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:41.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.438+0000 7f62aca0a700 1 -- 172.21.15.40:0/3953086701 shutdown_connections 2023-09-30T22:27:41.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.438+0000 7f62aca0a700 1 --2- 172.21.15.40:0/3953086701 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62a8136170 0x7f62a8138550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.438+0000 7f62aca0a700 1 --2- 172.21.15.40:0/3953086701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62a812f070 0x7f62a8135c30 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.438+0000 7f62aca0a700 1 -- 172.21.15.40:0/3953086701 >> 172.21.15.40:0/3953086701 conn(0x7f62a80a2a00 msgr2=0x7f62a80a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:41.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.438+0000 7f62aca0a700 1 -- 172.21.15.40:0/3953086701 shutdown_connections 2023-09-30T22:27:41.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.438+0000 7f62aca0a700 1 -- 172.21.15.40:0/3953086701 wait complete. 2023-09-30T22:27:41.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.439+0000 7f5f3a5f9700 1 -- 172.21.15.40:0/25640882 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f34062380 con 0x7f5f3409e030 2023-09-30T22:27:41.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.439+0000 7f62aca0a700 1 Processor -- start 2023-09-30T22:27:41.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.439+0000 7f62aca0a700 1 -- start start 2023-09-30T22:27:41.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.440+0000 7f62aca0a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62a812e590 0x7f62a81190a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.440+0000 7f62aca0a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62a812f070 0x7f62a81195e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.440+0000 7f62aca0a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62a8136170 0x7f62a8119b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.440+0000 7f62aca0a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a811c850 con 0x7f62a812e590 2023-09-30T22:27:41.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.440+0000 7f62aca0a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a811ad30 con 0x7f62a812f070 2023-09-30T22:27:41.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.440+0000 7f62aca0a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62a812dfa0 con 0x7f62a8136170 2023-09-30T22:27:41.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.440+0000 7f62a659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62a812e590 0x7f62a81190a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.440+0000 7f62a6d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62a8136170 0x7f62a8119b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.440+0000 7f62a659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62a812e590 0x7f62a81190a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56586/0 (socket says 172.21.15.40:56586) 2023-09-30T22:27:41.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.440+0000 7f62a659c700 1 -- 172.21.15.40:0/2329523096 learned_addr learned my addr 172.21.15.40:0/2329523096 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:41.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.440+0000 7f62a5d9b700 1 --2- 172.21.15.40:0/2329523096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62a812f070 0x7f62a81195e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.440+0000 7f62a5d9b700 1 -- 172.21.15.40:0/2329523096 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62a8136170 msgr2=0x7f62a8119b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.441+0000 7f62a5d9b700 1 --2- 172.21.15.40:0/2329523096 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62a8136170 0x7f62a8119b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.441+0000 7f62a5d9b700 1 -- 172.21.15.40:0/2329523096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62a812e590 msgr2=0x7f62a81190a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.441+0000 7f62a5d9b700 1 --2- 172.21.15.40:0/2329523096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62a812e590 0x7f62a81190a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.441+0000 7f62a5d9b700 1 -- 172.21.15.40:0/2329523096 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629c0094a0 con 0x7f62a812f070 2023-09-30T22:27:41.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.441+0000 7f62a659c700 1 --2- 172.21.15.40:0/2329523096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62a812e590 0x7f62a81190a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:41.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.441+0000 7f62a5d9b700 1 --2- 172.21.15.40:0/2329523096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62a812f070 0x7f62a81195e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f629c016000 tx=0x7f629c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:41.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.441+0000 7f6296ffd700 1 -- 172.21.15.40:0/2329523096 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c0036a0 con 0x7f62a812f070 2023-09-30T22:27:41.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.441+0000 7f6296ffd700 1 -- 172.21.15.40:0/2329523096 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629c01f070 con 0x7f62a812f070 2023-09-30T22:27:41.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.441+0000 7f6296ffd700 1 -- 172.21.15.40:0/2329523096 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c003a60 con 0x7f62a812f070 2023-09-30T22:27:41.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.441+0000 7f62aca0a700 1 -- 172.21.15.40:0/2329523096 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a811c590 con 0x7f62a812f070 2023-09-30T22:27:41.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.441+0000 7f62aca0a700 1 -- 172.21.15.40:0/2329523096 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a811b170 con 0x7f62a812f070 2023-09-30T22:27:41.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.442+0000 7f6296ffd700 1 -- 172.21.15.40:0/2329523096 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f629c003bc0 con 0x7f62a812f070 2023-09-30T22:27:41.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.442+0000 7f6294ff9700 1 -- 172.21.15.40:0/2329523096 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62800052e0 con 0x7f62a812f070 2023-09-30T22:27:41.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.443+0000 7f6296ffd700 1 -- 172.21.15.40:0/2329523096 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f629c021070 con 0x7f62a812f070 2023-09-30T22:27:41.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.446+0000 7f5f30ff9700 1 -- 172.21.15.40:0/25640882 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5f2801a440 con 0x7f5f3409e030 2023-09-30T22:27:41.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.449+0000 7f6296ffd700 1 -- 172.21.15.40:0/2329523096 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f629c02f3a0 con 0x7f62a812f070 2023-09-30T22:27:41.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.501+0000 7f25dfc23700 1 -- 172.21.15.40:0/1140668573 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f25d8074620 con 0x7f25d806f980 2023-09-30T22:27:41.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.502+0000 7f25ce7fc700 1 -- 172.21.15.40:0/1140668573 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f25c80199a0 con 0x7f25d806f980 2023-09-30T22:27:41.502 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:41.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.505+0000 7f25dfc23700 1 -- 172.21.15.40:0/1140668573 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f25d806f980 msgr2=0x7f25d812da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.505+0000 7f25dfc23700 1 --2- 172.21.15.40:0/1140668573 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f25d806f980 0x7f25d812da70 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f25c8009c70 tx=0x7f25c8004750 comp rx=0 tx=0).stop 2023-09-30T22:27:41.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.505+0000 7f25dfc23700 1 -- 172.21.15.40:0/1140668573 shutdown_connections 2023-09-30T22:27:41.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.505+0000 7f25dfc23700 1 --2- 172.21.15.40:0/1140668573 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f25d806fdb0 0x7f25d812dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.505+0000 7f25dfc23700 1 --2- 172.21.15.40:0/1140668573 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25d806f070 0x7f25d812d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.505+0000 7f25dfc23700 1 --2- 172.21.15.40:0/1140668573 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f25d806f980 0x7f25d812da70 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.505+0000 7f25dfc23700 1 -- 172.21.15.40:0/1140668573 >> 172.21.15.40:0/1140668573 conn(0x7f25d80a41a0 msgr2=0x7f25d80a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:41.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.506+0000 7f25dfc23700 1 -- 172.21.15.40:0/1140668573 shutdown_connections 2023-09-30T22:27:41.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.506+0000 7f25dfc23700 1 -- 172.21.15.40:0/1140668573 wait complete. 2023-09-30T22:27:41.524 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:41.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.616+0000 7f66c4508700 1 -- 172.21.15.40:0/1164379303 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f66bc120bf0 con 0x7f66bc09d920 2023-09-30T22:27:41.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.616+0000 7f66b2ffd700 1 -- 172.21.15.40:0/1164379303 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f66bc120bf0 con 0x7f66bc09d920 2023-09-30T22:27:41.617 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:41.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.618+0000 7f66c4508700 1 -- 172.21.15.40:0/1164379303 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66bc09d920 msgr2=0x7f66bc11d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.618+0000 7f66c4508700 1 --2- 172.21.15.40:0/1164379303 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66bc09d920 0x7f66bc11d2c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f66b8017000 tx=0x7f66b8004750 comp rx=0 tx=0).stop 2023-09-30T22:27:41.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.618+0000 7f66c4508700 1 -- 172.21.15.40:0/1164379303 shutdown_connections 2023-09-30T22:27:41.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.618+0000 7f66c4508700 1 --2- 172.21.15.40:0/1164379303 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66bc130fb0 0x7f66bc11dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.618+0000 7f66c4508700 1 --2- 172.21.15.40:0/1164379303 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66bc09d920 0x7f66bc11d2c0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.618+0000 7f66c4508700 1 --2- 172.21.15.40:0/1164379303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66bc09e230 0x7f66bc11d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.618+0000 7f66c4508700 1 -- 172.21.15.40:0/1164379303 >> 172.21.15.40:0/1164379303 conn(0x7f66bc09fb20 msgr2=0x7f66bc12ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:41.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.618+0000 7f66c4508700 1 -- 172.21.15.40:0/1164379303 shutdown_connections 2023-09-30T22:27:41.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.618+0000 7f66c4508700 1 -- 172.21.15.40:0/1164379303 wait complete. 2023-09-30T22:27:41.631 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:41.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.649+0000 7f5f3a5f9700 1 -- 172.21.15.40:0/25640882 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5f34062380 con 0x7f5f3409e030 2023-09-30T22:27:41.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.650+0000 7f5f30ff9700 1 -- 172.21.15.40:0/25640882 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5f28023bc0 con 0x7f5f3409e030 2023-09-30T22:27:41.650 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:41.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.652+0000 7f5f3a5f9700 1 -- 172.21.15.40:0/25640882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f3409e030 msgr2=0x7f5f3406e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.652+0000 7f5f3a5f9700 1 --2- 172.21.15.40:0/25640882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f3409e030 0x7f5f3406e6f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f5f3406b290 tx=0x7f5f28004750 comp rx=0 tx=0).stop 2023-09-30T22:27:41.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.652+0000 7f5f3a5f9700 1 -- 172.21.15.40:0/25640882 shutdown_connections 2023-09-30T22:27:41.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.652+0000 7f5f3a5f9700 1 --2- 172.21.15.40:0/25640882 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f3409e420 0x7f5f3406ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.652+0000 7f5f3a5f9700 1 --2- 172.21.15.40:0/25640882 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f3406a6d0 0x7f5f3406e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.652+0000 7f5f3a5f9700 1 --2- 172.21.15.40:0/25640882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f3409e030 0x7f5f3406e6f0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.652+0000 7f5f3a5f9700 1 -- 172.21.15.40:0/25640882 >> 172.21.15.40:0/25640882 conn(0x7f5f3409fb20 msgr2=0x7f5f341322a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:41.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.652+0000 7f5f3a5f9700 1 -- 172.21.15.40:0/25640882 shutdown_connections 2023-09-30T22:27:41.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.652+0000 7f5f3a5f9700 1 -- 172.21.15.40:0/25640882 wait complete. 2023-09-30T22:27:41.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.659+0000 7f6294ff9700 1 -- 172.21.15.40:0/2329523096 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6280005590 con 0x7f62a812f070 2023-09-30T22:27:41.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.660+0000 7f6296ffd700 1 -- 172.21.15.40:0/2329523096 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f629c02b030 con 0x7f62a812f070 2023-09-30T22:27:41.660 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:41.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.662+0000 7f6294ff9700 1 -- 172.21.15.40:0/2329523096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62a812f070 msgr2=0x7f62a81195e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.662+0000 7f6294ff9700 1 --2- 172.21.15.40:0/2329523096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62a812f070 0x7f62a81195e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f629c016000 tx=0x7f629c004750 comp rx=0 tx=0).stop 2023-09-30T22:27:41.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.662+0000 7f6294ff9700 1 -- 172.21.15.40:0/2329523096 shutdown_connections 2023-09-30T22:27:41.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.662+0000 7f6294ff9700 1 --2- 172.21.15.40:0/2329523096 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62a8136170 0x7f62a8119b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.662+0000 7f6294ff9700 1 --2- 172.21.15.40:0/2329523096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62a812e590 0x7f62a81190a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.662+0000 7f6294ff9700 1 --2- 172.21.15.40:0/2329523096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62a812f070 0x7f62a81195e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.662+0000 7f6294ff9700 1 -- 172.21.15.40:0/2329523096 >> 172.21.15.40:0/2329523096 conn(0x7f62a80a2a00 msgr2=0x7f62a809d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:41.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.662+0000 7f6294ff9700 1 -- 172.21.15.40:0/2329523096 shutdown_connections 2023-09-30T22:27:41.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:41.662+0000 7f6294ff9700 1 -- 172.21.15.40:0/2329523096 wait complete. 2023-09-30T22:27:41.665 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:41.675 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:42.525 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:42.632 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:42.666 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:42.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.669+0000 7f0faa378700 1 Processor -- start 2023-09-30T22:27:42.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.669+0000 7f0faa378700 1 -- start start 2023-09-30T22:27:42.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.669+0000 7f0faa378700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0fa409d920 0x7f0fa409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:42.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.669+0000 7f0faa378700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fa4130fb0 0x7f0fa4138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:42.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.669+0000 7f0faa378700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fa409adf0 con 0x7f0fa409e230 2023-09-30T22:27:42.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.669+0000 7f0faa378700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa409edf0 con 0x7f0fa409d920 2023-09-30T22:27:42.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.669+0000 7f0faa378700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa409b660 con 0x7f0fa4130fb0 2023-09-30T22:27:42.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.669+0000 7f0fa8915700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fa4130fb0 0x7f0fa4138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:42.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.669+0000 7f0fa3fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0fa409d920 0x7f0fa409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:42.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.669+0000 7f0fa8915700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fa4130fb0 0x7f0fa4138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48406/0 (socket says 172.21.15.40:48406) 2023-09-30T22:27:42.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.669+0000 7f0fa8915700 1 -- 172.21.15.40:0/1137702928 learned_addr learned my addr 172.21.15.40:0/1137702928 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:42.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.670+0000 7f0fa3fff700 1 -- 172.21.15.40:0/1137702928 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fa4130fb0 msgr2=0x7f0fa4138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:42.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.670+0000 7f0fa3fff700 1 --2- 172.21.15.40:0/1137702928 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fa4130fb0 0x7f0fa4138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.670+0000 7f0fa3fff700 1 -- 172.21.15.40:0/1137702928 >> v1:172.21.15.40:6789/0 conn(0x7f0fa409e230 legacy=0x7f0fa41308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:42.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.670+0000 7f0fa3fff700 1 -- 172.21.15.40:0/1137702928 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa409a6e0 con 0x7f0fa409d920 2023-09-30T22:27:42.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.670+0000 7f0fa8915700 1 --2- 172.21.15.40:0/1137702928 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fa4130fb0 0x7f0fa4138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:42.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.670+0000 7f0fa3fff700 1 --2- 172.21.15.40:0/1137702928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fa409d920 0x7f0fa409dcf0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f0f94009820 tx=0x7f0f94009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74344a0158fde860 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:42.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.670+0000 7f0fa2ffd700 1 -- 172.21.15.40:0/1137702928 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f94005e30 con 0x7f0fa409d920 2023-09-30T22:27:42.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.670+0000 7f0fa2ffd700 1 -- 172.21.15.40:0/1137702928 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f94006030 con 0x7f0fa409d920 2023-09-30T22:27:42.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.670+0000 7f0fa2ffd700 1 -- 172.21.15.40:0/1137702928 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f940063c0 con 0x7f0fa409d920 2023-09-30T22:27:42.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.671+0000 7f0faa378700 1 -- 172.21.15.40:0/1137702928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fa409d920 msgr2=0x7f0fa409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:42.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.671+0000 7f0faa378700 1 --2- 172.21.15.40:0/1137702928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fa409d920 0x7f0fa409dcf0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f0f94009820 tx=0x7f0f94009b30 comp rx=0 tx=0).stop 2023-09-30T22:27:42.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.671+0000 7f0faa378700 1 -- 172.21.15.40:0/1137702928 shutdown_connections 2023-09-30T22:27:42.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.671+0000 7f0faa378700 1 --2- 172.21.15.40:0/1137702928 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fa4130fb0 0x7f0fa4138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.671+0000 7f0faa378700 1 --2- 172.21.15.40:0/1137702928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fa409d920 0x7f0fa409dcf0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.671+0000 7f0faa378700 1 -- 172.21.15.40:0/1137702928 >> 172.21.15.40:0/1137702928 conn(0x7f0fa409fb20 msgr2=0x7f0fa409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:42.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.671+0000 7f0faa378700 1 -- 172.21.15.40:0/1137702928 shutdown_connections 2023-09-30T22:27:42.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.671+0000 7f0faa378700 1 -- 172.21.15.40:0/1137702928 wait complete. 2023-09-30T22:27:42.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.672+0000 7f0faa378700 1 Processor -- start 2023-09-30T22:27:42.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.672+0000 7f0faa378700 1 -- start start 2023-09-30T22:27:42.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.673+0000 7f0faa378700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fa409d920 0x7f0fa4120170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:42.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.673+0000 7f0faa378700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0fa409e230 0x7f0fa41206b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:42.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.673+0000 7f0faa378700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fa4130fb0 0x7f0fa4120bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:42.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.673+0000 7f0faa378700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa4130530 con 0x7f0fa4130fb0 2023-09-30T22:27:42.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.673+0000 7f0faa378700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa41236f0 con 0x7f0fa409d920 2023-09-30T22:27:42.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.673+0000 7f0faa378700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa41225e0 con 0x7f0fa409e230 2023-09-30T22:27:42.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.673+0000 7f0fa8915700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fa4130fb0 0x7f0fa4120bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:42.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.673+0000 7f0fa37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0fa409e230 0x7f0fa41206b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:42.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.673+0000 7f0fa8915700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fa4130fb0 0x7f0fa4120bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56616/0 (socket says 172.21.15.40:56616) 2023-09-30T22:27:42.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.673+0000 7f0fa37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0fa409e230 0x7f0fa41206b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56600/0 (socket says 172.21.15.40:56600) 2023-09-30T22:27:42.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.673+0000 7f0fa8915700 1 -- 172.21.15.40:0/1970572811 learned_addr learned my addr 172.21.15.40:0/1970572811 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:42.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.673+0000 7f0fa3fff700 1 --2- 172.21.15.40:0/1970572811 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fa409d920 0x7f0fa4120170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:42.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.673+0000 7f0fa8915700 1 -- 172.21.15.40:0/1970572811 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0fa409e230 msgr2=0x7f0fa41206b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:42.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.673+0000 7f0fa8915700 1 --2- 172.21.15.40:0/1970572811 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0fa409e230 0x7f0fa41206b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.673+0000 7f0fa8915700 1 -- 172.21.15.40:0/1970572811 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fa409d920 msgr2=0x7f0fa4120170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:42.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.673+0000 7f0fa8915700 1 --2- 172.21.15.40:0/1970572811 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fa409d920 0x7f0fa4120170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.673+0000 7f0fa8915700 1 -- 172.21.15.40:0/1970572811 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9c009b30 con 0x7f0fa4130fb0 2023-09-30T22:27:42.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.673+0000 7f0fa8915700 1 --2- 172.21.15.40:0/1970572811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fa4130fb0 0x7f0fa4120bf0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c009f10 tx=0x7f0f9c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:42.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.674+0000 7f0fa0ff9700 1 -- 172.21.15.40:0/1970572811 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c018070 con 0x7f0fa4130fb0 2023-09-30T22:27:42.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.674+0000 7f0fa0ff9700 1 -- 172.21.15.40:0/1970572811 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9c00f040 con 0x7f0fa4130fb0 2023-09-30T22:27:42.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.674+0000 7f0faa378700 1 -- 172.21.15.40:0/1970572811 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f94009430 con 0x7f0fa4130fb0 2023-09-30T22:27:42.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.674+0000 7f0fa0ff9700 1 -- 172.21.15.40:0/1970572811 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c003c40 con 0x7f0fa4130fb0 2023-09-30T22:27:42.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.674+0000 7f0faa378700 1 -- 172.21.15.40:0/1970572811 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa40a2eb0 con 0x7f0fa4130fb0 2023-09-30T22:27:42.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.675+0000 7f0faa378700 1 -- 172.21.15.40:0/1970572811 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa409cb60 con 0x7f0fa4130fb0 2023-09-30T22:27:42.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.675+0000 7f0fa0ff9700 1 -- 172.21.15.40:0/1970572811 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0f9c00c940 con 0x7f0fa4130fb0 2023-09-30T22:27:42.678 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:42.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.675+0000 7f0fa0ff9700 1 -- 172.21.15.40:0/1970572811 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f0f9c040720 con 0x7f0fa4130fb0 2023-09-30T22:27:42.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.680+0000 7f0fa0ff9700 1 -- 172.21.15.40:0/1970572811 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f9c013bd0 con 0x7f0fa4130fb0 2023-09-30T22:27:42.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.772+0000 7fd246797700 1 Processor -- start 2023-09-30T22:27:42.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.772+0000 7fd246797700 1 -- start start 2023-09-30T22:27:42.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.773+0000 7fd246797700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd24009df30 0x7fd240135400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:42.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.773+0000 7fd246797700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd240135940 0x7fd240137d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:42.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.773+0000 7fd246797700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd24009e8b0 con 0x7fd24009d450 2023-09-30T22:27:42.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.773+0000 7fd246797700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd24009c3b0 con 0x7fd24009df30 2023-09-30T22:27:42.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.773+0000 7fd246797700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd24009a6b0 con 0x7fd240135940 2023-09-30T22:27:42.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.773+0000 7fd23f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd24009df30 0x7fd240135400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:42.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.773+0000 7fd23f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd24009df30 0x7fd240135400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56626/0 (socket says 172.21.15.40:56626) 2023-09-30T22:27:42.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.773+0000 7fd23f7fe700 1 -- 172.21.15.40:0/1611611040 learned_addr learned my addr 172.21.15.40:0/1611611040 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:42.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.773+0000 7fd244d34700 1 --2- 172.21.15.40:0/1611611040 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd240135940 0x7fd240137d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:42.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.773+0000 7fd23f7fe700 1 -- 172.21.15.40:0/1611611040 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd240135940 msgr2=0x7fd240137d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:42.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.773+0000 7fd23f7fe700 1 --2- 172.21.15.40:0/1611611040 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd240135940 0x7fd240137d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.773+0000 7fd23f7fe700 1 -- 172.21.15.40:0/1611611040 >> v1:172.21.15.40:6789/0 conn(0x7fd24009d450 legacy=0x7fd24009d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:42.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.773+0000 7fd23f7fe700 1 -- 172.21.15.40:0/1611611040 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24009b4f0 con 0x7fd24009df30 2023-09-30T22:27:42.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.774+0000 7fd23f7fe700 1 --2- 172.21.15.40:0/1611611040 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd24009df30 0x7fd240135400 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fd2340098f0 tx=0x7fd234009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46dfc3617daaadfb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:42.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.774+0000 7fd23effd700 1 -- 172.21.15.40:0/1611611040 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd234011830 con 0x7fd24009df30 2023-09-30T22:27:42.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.774+0000 7fd23effd700 1 -- 172.21.15.40:0/1611611040 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd234011990 con 0x7fd24009df30 2023-09-30T22:27:42.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.774+0000 7fd23effd700 1 -- 172.21.15.40:0/1611611040 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd234011d20 con 0x7fd24009df30 2023-09-30T22:27:42.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.775+0000 7fd246797700 1 -- 172.21.15.40:0/1611611040 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd24009df30 msgr2=0x7fd240135400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:42.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.775+0000 7fd246797700 1 --2- 172.21.15.40:0/1611611040 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd24009df30 0x7fd240135400 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fd2340098f0 tx=0x7fd234009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:42.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.775+0000 7fd246797700 1 -- 172.21.15.40:0/1611611040 shutdown_connections 2023-09-30T22:27:42.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.775+0000 7fd246797700 1 --2- 172.21.15.40:0/1611611040 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd240135940 0x7fd240137d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.775+0000 7fd246797700 1 --2- 172.21.15.40:0/1611611040 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd24009df30 0x7fd240135400 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.775+0000 7fd246797700 1 -- 172.21.15.40:0/1611611040 >> 172.21.15.40:0/1611611040 conn(0x7fd2400a2a00 msgr2=0x7fd2400a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:42.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.775+0000 7fd246797700 1 -- 172.21.15.40:0/1611611040 shutdown_connections 2023-09-30T22:27:42.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.775+0000 7fd246797700 1 -- 172.21.15.40:0/1611611040 wait complete. 2023-09-30T22:27:42.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.776+0000 7fd246797700 1 Processor -- start 2023-09-30T22:27:42.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.777+0000 7fd246797700 1 -- start start 2023-09-30T22:27:42.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.777+0000 7fd246797700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd24009d450 0x7fd2401c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:42.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.777+0000 7fd246797700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd24009df30 0x7fd2401c4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:42.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.777+0000 7fd246797700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd240135940 0x7fd240119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:42.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.777+0000 7fd246797700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24011c050 con 0x7fd240135940 2023-09-30T22:27:42.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.777+0000 7fd246797700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd24011c230 con 0x7fd24009df30 2023-09-30T22:27:42.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.777+0000 7fd246797700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2401c40f0 con 0x7fd24009d450 2023-09-30T22:27:42.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.777+0000 7fd23f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd24009df30 0x7fd2401c4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:42.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.777+0000 7fd23ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd24009d450 0x7fd2401c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:42.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.777+0000 7fd23f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd24009df30 0x7fd2401c4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48436/0 (socket says 172.21.15.40:48436) 2023-09-30T22:27:42.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.777+0000 7fd23ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd24009d450 0x7fd2401c45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56626/0 (socket says 172.21.15.40:56626) 2023-09-30T22:27:42.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.778+0000 7fd23f7fe700 1 -- 172.21.15.40:0/3481204005 learned_addr learned my addr 172.21.15.40:0/3481204005 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:42.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.778+0000 7fd244d34700 1 --2- 172.21.15.40:0/3481204005 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd240135940 0x7fd240119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:42.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.778+0000 7fd244d34700 1 -- 172.21.15.40:0/3481204005 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd24009d450 msgr2=0x7fd2401c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:42.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.778+0000 7fd244d34700 1 --2- 172.21.15.40:0/3481204005 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd24009d450 0x7fd2401c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.778+0000 7fd244d34700 1 -- 172.21.15.40:0/3481204005 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd24009df30 msgr2=0x7fd2401c4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:42.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.778+0000 7fd244d34700 1 --2- 172.21.15.40:0/3481204005 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd24009df30 0x7fd2401c4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.778+0000 7fd244d34700 1 -- 172.21.15.40:0/3481204005 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd234009550 con 0x7fd240135940 2023-09-30T22:27:42.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.778+0000 7fd244d34700 1 --2- 172.21.15.40:0/3481204005 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd240135940 0x7fd240119050 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fd2380049d0 tx=0x7fd238010420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:42.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.778+0000 7fd23cff9700 1 -- 172.21.15.40:0/3481204005 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd238010d50 con 0x7fd240135940 2023-09-30T22:27:42.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.778+0000 7fd23cff9700 1 -- 172.21.15.40:0/3481204005 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd238011040 con 0x7fd240135940 2023-09-30T22:27:42.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.778+0000 7fd23cff9700 1 -- 172.21.15.40:0/3481204005 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd238017650 con 0x7fd240135940 2023-09-30T22:27:42.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.778+0000 7fd246797700 1 -- 172.21.15.40:0/3481204005 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2401c5030 con 0x7fd240135940 2023-09-30T22:27:42.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.779+0000 7fd246797700 1 -- 172.21.15.40:0/3481204005 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd24009c5d0 con 0x7fd240135940 2023-09-30T22:27:42.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.780+0000 7fd23cff9700 1 -- 172.21.15.40:0/3481204005 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd2380177b0 con 0x7fd240135940 2023-09-30T22:27:42.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.780+0000 7fd246797700 1 -- 172.21.15.40:0/3481204005 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd24011b9c0 con 0x7fd240135940 2023-09-30T22:27:42.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.780+0000 7fd23cff9700 1 -- 172.21.15.40:0/3481204005 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd238041f80 con 0x7fd240135940 2023-09-30T22:27:42.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.789+0000 7fd23cff9700 1 -- 172.21.15.40:0/3481204005 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd23801e310 con 0x7fd240135940 2023-09-30T22:27:42.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.810+0000 7f1cfafb1700 1 Processor -- start 2023-09-30T22:27:42.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.811+0000 7f1cfafb1700 1 -- start start 2023-09-30T22:27:42.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.811+0000 7f1cfafb1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1cf409d920 0x7f1cf409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:42.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.811+0000 7f1cfafb1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1cf4130fb0 0x7f1cf4138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:42.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.811+0000 7f1cfafb1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cf409adf0 con 0x7f1cf409e230 2023-09-30T22:27:42.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.811+0000 7f1cfafb1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf409edf0 con 0x7f1cf409d920 2023-09-30T22:27:42.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.811+0000 7f1cfafb1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf409b660 con 0x7f1cf4130fb0 2023-09-30T22:27:42.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.811+0000 7f1cf3fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1cf409e230 0x7f1cf41308a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41690/0 (socket says 172.21.15.40:41690) 2023-09-30T22:27:42.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.811+0000 7f1cf3fff700 1 -- 172.21.15.40:0/1436013641 learned_addr learned my addr 172.21.15.40:0/1436013641 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:27:42.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.811+0000 7f1cf8d4d700 1 --2- 172.21.15.40:0/1436013641 >> v2:172.21.15.40:3300/0 conn(0x7f1cf409d920 0x7f1cf409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:42.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.811+0000 7f1cf954e700 1 --2- 172.21.15.40:0/1436013641 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1cf4130fb0 0x7f1cf4138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:42.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.812+0000 7f1cf954e700 1 -- 172.21.15.40:0/1436013641 >> v2:172.21.15.40:3300/0 conn(0x7f1cf409d920 msgr2=0x7f1cf409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:42.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.812+0000 7f1cf954e700 1 --2- 172.21.15.40:0/1436013641 >> v2:172.21.15.40:3300/0 conn(0x7f1cf409d920 0x7f1cf409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.812+0000 7f1cf954e700 1 -- 172.21.15.40:0/1436013641 >> v1:172.21.15.40:6789/0 conn(0x7f1cf409e230 legacy=0x7f1cf41308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:42.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.812+0000 7f1cf37fe700 1 -- 172.21.15.40:0/1436013641 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 838908513 0 0) 0x7f1cf409adf0 con 0x7f1cf409e230 2023-09-30T22:27:42.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.812+0000 7f1cf954e700 1 -- 172.21.15.40:0/1436013641 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf409a6e0 con 0x7f1cf4130fb0 2023-09-30T22:27:42.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.812+0000 7f1cf8d4d700 1 --2- 172.21.15.40:0/1436013641 >> v2:172.21.15.40:3300/0 conn(0x7f1cf409d920 0x7f1cf409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:42.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.812+0000 7f1cf954e700 1 --2- 172.21.15.40:0/1436013641 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1cf4130fb0 0x7f1cf4138d10 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1cec009d90 tx=0x7f1cec00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ece5aa09006986bc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:42.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.812+0000 7f1cf37fe700 1 -- 172.21.15.40:0/1436013641 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cec00e070 con 0x7f1cf4130fb0 2023-09-30T22:27:42.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.812+0000 7f1cf37fe700 1 -- 172.21.15.40:0/1436013641 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cec00bb20 con 0x7f1cf4130fb0 2023-09-30T22:27:42.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.812+0000 7f1cf37fe700 1 -- 172.21.15.40:0/1436013641 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cec012430 con 0x7f1cf4130fb0 2023-09-30T22:27:42.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.813+0000 7f1cfafb1700 1 -- 172.21.15.40:0/1436013641 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1cf4130fb0 msgr2=0x7f1cf4138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:42.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.813+0000 7f1cfafb1700 1 --2- 172.21.15.40:0/1436013641 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1cf4130fb0 0x7f1cf4138d10 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1cec009d90 tx=0x7f1cec00b330 comp rx=0 tx=0).stop 2023-09-30T22:27:42.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.813+0000 7f1cfafb1700 1 -- 172.21.15.40:0/1436013641 shutdown_connections 2023-09-30T22:27:42.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.813+0000 7f1cfafb1700 1 --2- 172.21.15.40:0/1436013641 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1cf4130fb0 0x7f1cf4138d10 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.813+0000 7f1cfafb1700 1 --2- 172.21.15.40:0/1436013641 >> v2:172.21.15.40:3300/0 conn(0x7f1cf409d920 0x7f1cf409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.813+0000 7f1cfafb1700 1 -- 172.21.15.40:0/1436013641 >> 172.21.15.40:0/1436013641 conn(0x7f1cf409fb20 msgr2=0x7f1cf409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:42.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.813+0000 7f1cfafb1700 1 -- 172.21.15.40:0/1436013641 shutdown_connections 2023-09-30T22:27:42.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.813+0000 7f1cfafb1700 1 -- 172.21.15.40:0/1436013641 wait complete. 2023-09-30T22:27:42.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.813+0000 7f12ebf9a700 1 Processor -- start 2023-09-30T22:27:42.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.813+0000 7f12ebf9a700 1 -- start start 2023-09-30T22:27:42.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.814+0000 7f1cfafb1700 1 Processor -- start 2023-09-30T22:27:42.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.814+0000 7f1cfafb1700 1 -- start start 2023-09-30T22:27:42.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.814+0000 7f12ebf9a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12e406a6d0 0x7f12e409d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:42.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.814+0000 7f12ebf9a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f12e409de60 0x7f12e409e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:42.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.814+0000 7f12ebf9a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12e409e790 con 0x7f12e413c490 2023-09-30T22:27:42.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.814+0000 7f12ebf9a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e406aaa0 con 0x7f12e406a6d0 2023-09-30T22:27:42.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.814+0000 7f12ebf9a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12e411d980 con 0x7f12e409de60 2023-09-30T22:27:42.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.814+0000 7f12ea537700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f12e413c490 0x7f12e413e870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41692/0 (socket says 172.21.15.40:41692) 2023-09-30T22:27:42.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.814+0000 7f12ea537700 1 -- 172.21.15.40:0/1568297738 learned_addr learned my addr 172.21.15.40:0/1568297738 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:27:42.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.814+0000 7f12e9535700 1 --2- 172.21.15.40:0/1568297738 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f12e409de60 0x7f12e409e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:42.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.814+0000 7f12e8d34700 1 -- 172.21.15.40:0/1568297738 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1007306096 0 0) 0x7f12dc001490 con 0x7f12e413c490 2023-09-30T22:27:42.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.814+0000 7f12e8d34700 1 -- 172.21.15.40:0/1568297738 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12d00035b0 con 0x7f12e413c490 2023-09-30T22:27:42.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.815+0000 7f1cfafb1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cf409d920 0x7f1cf41c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:42.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.815+0000 7f1cfafb1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1cf409e230 0x7f1cf41c4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:42.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.815+0000 7f1cfafb1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1cf4130fb0 0x7f1cf41c4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:42.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.815+0000 7f1cfafb1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf411d680 con 0x7f1cf409d920 2023-09-30T22:27:42.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.815+0000 7f1cfafb1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf411dcd0 con 0x7f1cf409e230 2023-09-30T22:27:42.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.815+0000 7f1cfafb1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf411f590 con 0x7f1cf4130fb0 2023-09-30T22:27:42.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.815+0000 7f12e9535700 1 -- 172.21.15.40:0/1568297738 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12e406a6d0 msgr2=0x7f12e409d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:42.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.815+0000 7f12e9535700 1 --2- 172.21.15.40:0/1568297738 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12e406a6d0 0x7f12e409d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.815+0000 7f12e9535700 1 -- 172.21.15.40:0/1568297738 >> v1:172.21.15.40:6789/0 conn(0x7f12e413c490 legacy=0x7f12e413e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:42.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.815+0000 7f12e9535700 1 -- 172.21.15.40:0/1568297738 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e406b150 con 0x7f12e409de60 2023-09-30T22:27:42.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.815+0000 7f12e9535700 1 --2- 172.21.15.40:0/1568297738 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f12e409de60 0x7f12e409e250 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f12d40098a0 tx=0x7f12d4009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ed5d4c555b1f977 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:42.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.815+0000 7f1cf3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1cf409e230 0x7f1cf41c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:42.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.815+0000 7f1cf3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1cf409e230 0x7f1cf41c4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48468/0 (socket says 172.21.15.40:48468) 2023-09-30T22:27:42.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.815+0000 7f1cf3fff700 1 -- 172.21.15.40:0/2804169692 learned_addr learned my addr 172.21.15.40:0/2804169692 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:42.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.815+0000 7f1cf8d4d700 1 --2- 172.21.15.40:0/2804169692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cf409d920 0x7f1cf41c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:42.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.815+0000 7f1cf3fff700 1 -- 172.21.15.40:0/2804169692 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1cf4130fb0 msgr2=0x7f1cf41c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:42.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.815+0000 7f1cf3fff700 1 --2- 172.21.15.40:0/2804169692 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1cf4130fb0 0x7f1cf41c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.815+0000 7f1cf3fff700 1 -- 172.21.15.40:0/2804169692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cf409d920 msgr2=0x7f1cf41c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:42.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.815+0000 7f1cf3fff700 1 --2- 172.21.15.40:0/2804169692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cf409d920 0x7f1cf41c3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.815+0000 7f1cf3fff700 1 -- 172.21.15.40:0/2804169692 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce800b6d0 con 0x7f1cf409e230 2023-09-30T22:27:42.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.815+0000 7f1cf3fff700 1 --2- 172.21.15.40:0/2804169692 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1cf409e230 0x7f1cf41c4430 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1ce00011e0 tx=0x7f1ce000cae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:42.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.815+0000 7f1cf17fa700 1 -- 172.21.15.40:0/2804169692 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0004c80 con 0x7f1cf409e230 2023-09-30T22:27:42.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.816+0000 7f1cfafb1700 1 -- 172.21.15.40:0/2804169692 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cec009a70 con 0x7f1cf409e230 2023-09-30T22:27:42.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.816+0000 7f1cfafb1700 1 -- 172.21.15.40:0/2804169692 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf411f2b0 con 0x7f1cf409e230 2023-09-30T22:27:42.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.816+0000 7f12e8d34700 1 -- 172.21.15.40:0/1568297738 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d4011830 con 0x7f12e409de60 2023-09-30T22:27:42.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.816+0000 7f12e8d34700 1 -- 172.21.15.40:0/1568297738 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d4011990 con 0x7f12e409de60 2023-09-30T22:27:42.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.816+0000 7f12e8d34700 1 -- 172.21.15.40:0/1568297738 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d4011d00 con 0x7f12e409de60 2023-09-30T22:27:42.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.816+0000 7f1cfafb1700 1 -- 172.21.15.40:0/2804169692 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf411ef50 con 0x7f1cf409e230 2023-09-30T22:27:42.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.816+0000 7f1cf17fa700 1 -- 172.21.15.40:0/2804169692 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce0004e00 con 0x7f1cf409e230 2023-09-30T22:27:42.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.816+0000 7f1cf17fa700 1 -- 172.21.15.40:0/2804169692 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0007310 con 0x7f1cf409e230 2023-09-30T22:27:42.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.817+0000 7f12ebf9a700 1 -- 172.21.15.40:0/1568297738 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f12e409de60 msgr2=0x7f12e409e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:42.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.817+0000 7f12ebf9a700 1 --2- 172.21.15.40:0/1568297738 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f12e409de60 0x7f12e409e250 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f12d40098a0 tx=0x7f12d4009bb0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.817+0000 7f12ebf9a700 1 -- 172.21.15.40:0/1568297738 shutdown_connections 2023-09-30T22:27:42.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.817+0000 7f12ebf9a700 1 --2- 172.21.15.40:0/1568297738 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12e406a6d0 0x7f12e409d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.817+0000 7f12ebf9a700 1 --2- 172.21.15.40:0/1568297738 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f12e409de60 0x7f12e409e250 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.817+0000 7f12ebf9a700 1 -- 172.21.15.40:0/1568297738 >> 172.21.15.40:0/1568297738 conn(0x7f12e409fb20 msgr2=0x7f12e409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:42.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.817+0000 7f12ebf9a700 1 -- 172.21.15.40:0/1568297738 shutdown_connections 2023-09-30T22:27:42.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.821+0000 7f12ebf9a700 1 -- 172.21.15.40:0/1568297738 wait complete. 2023-09-30T22:27:42.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.818+0000 7f1cf17fa700 1 -- 172.21.15.40:0/2804169692 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1ce0007470 con 0x7f1cf409e230 2023-09-30T22:27:42.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.818+0000 7f1cf17fa700 1 -- 172.21.15.40:0/2804169692 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f1ce003fa80 con 0x7f1cf409e230 2023-09-30T22:27:42.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.821+0000 7f12ebf9a700 1 Processor -- start 2023-09-30T22:27:42.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.822+0000 7f12ebf9a700 1 -- start start 2023-09-30T22:27:42.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.822+0000 7f12ebf9a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f12e406a6d0 0x7f12e4127190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:42.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.822+0000 7f12ebf9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12e409de60 0x7f12e41276d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:42.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.822+0000 7f12ebf9a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12e413c490 0x7f12e41cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:42.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.822+0000 7f12ebf9a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e413b3a0 con 0x7f12e409de60 2023-09-30T22:27:42.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.822+0000 7f12ebf9a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e4128380 con 0x7f12e413c490 2023-09-30T22:27:42.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.822+0000 7f12ebf9a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12e409f540 con 0x7f12e406a6d0 2023-09-30T22:27:42.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.822+0000 7f12e9535700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12e409de60 0x7f12e41276d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:42.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.822+0000 7f12e9535700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12e409de60 0x7f12e41276d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56680/0 (socket says 172.21.15.40:56680) 2023-09-30T22:27:42.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.822+0000 7f12e9535700 1 -- 172.21.15.40:0/418628725 learned_addr learned my addr 172.21.15.40:0/418628725 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:42.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.822+0000 7f12ea537700 1 --2- 172.21.15.40:0/418628725 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12e413c490 0x7f12e41cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:42.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.822+0000 7f12e9d36700 1 --2- 172.21.15.40:0/418628725 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f12e406a6d0 0x7f12e4127190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:42.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.823+0000 7f12e9535700 1 -- 172.21.15.40:0/418628725 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f12e406a6d0 msgr2=0x7f12e4127190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:42.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.823+0000 7f12e9535700 1 --2- 172.21.15.40:0/418628725 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f12e406a6d0 0x7f12e4127190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.823+0000 7f12e9535700 1 -- 172.21.15.40:0/418628725 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12e413c490 msgr2=0x7f12e41cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:42.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.823+0000 7f12e9535700 1 --2- 172.21.15.40:0/418628725 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12e413c490 0x7f12e41cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.823+0000 7f12e9535700 1 -- 172.21.15.40:0/418628725 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d40094a0 con 0x7f12e409de60 2023-09-30T22:27:42.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.823+0000 7f12e9535700 1 --2- 172.21.15.40:0/418628725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12e409de60 0x7f12e41276d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f12d4000c00 tx=0x7f12d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:42.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.823+0000 7f12da7fc700 1 -- 172.21.15.40:0/418628725 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d4004540 con 0x7f12e409de60 2023-09-30T22:27:42.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.823+0000 7f12da7fc700 1 -- 172.21.15.40:0/418628725 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d401f070 con 0x7f12e409de60 2023-09-30T22:27:42.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.823+0000 7f12ebf9a700 1 -- 172.21.15.40:0/418628725 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e4129d60 con 0x7f12e409de60 2023-09-30T22:27:42.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.823+0000 7f12da7fc700 1 -- 172.21.15.40:0/418628725 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d40038e0 con 0x7f12e409de60 2023-09-30T22:27:42.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.823+0000 7f12ebf9a700 1 -- 172.21.15.40:0/418628725 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e4127c10 con 0x7f12e409de60 2023-09-30T22:27:42.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.824+0000 7f12da7fc700 1 -- 172.21.15.40:0/418628725 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f12d4021030 con 0x7f12e409de60 2023-09-30T22:27:42.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.824+0000 7f12da7fc700 1 -- 172.21.15.40:0/418628725 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f12d4040c70 con 0x7f12e409de60 2023-09-30T22:27:42.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.824+0000 7f12ebf9a700 1 -- 172.21.15.40:0/418628725 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12e4062380 con 0x7f12e409de60 2023-09-30T22:27:42.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.826+0000 7f1cf17fa700 1 -- 172.21.15.40:0/2804169692 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1ce001a2b0 con 0x7f1cf409e230 2023-09-30T22:27:42.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.833+0000 7f12da7fc700 1 -- 172.21.15.40:0/418628725 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f12d4015020 con 0x7f12e409de60 2023-09-30T22:27:42.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.893+0000 7f0faa378700 1 -- 172.21.15.40:0/1970572811 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0fa4062380 con 0x7f0fa4130fb0 2023-09-30T22:27:42.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.893+0000 7f0fa0ff9700 1 -- 172.21.15.40:0/1970572811 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0f9c02c090 con 0x7f0fa4130fb0 2023-09-30T22:27:42.894 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:42.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.896+0000 7f0faa378700 1 -- 172.21.15.40:0/1970572811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fa4130fb0 msgr2=0x7f0fa4120bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:42.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.896+0000 7f0faa378700 1 --2- 172.21.15.40:0/1970572811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fa4130fb0 0x7f0fa4120bf0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c009f10 tx=0x7f0f9c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.896+0000 7f0faa378700 1 -- 172.21.15.40:0/1970572811 shutdown_connections 2023-09-30T22:27:42.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.896+0000 7f0faa378700 1 --2- 172.21.15.40:0/1970572811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fa4130fb0 0x7f0fa4120bf0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.896+0000 7f0faa378700 1 --2- 172.21.15.40:0/1970572811 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fa409d920 0x7f0fa4120170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.896+0000 7f0faa378700 1 --2- 172.21.15.40:0/1970572811 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0fa409e230 0x7f0fa41206b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.896+0000 7f0faa378700 1 -- 172.21.15.40:0/1970572811 >> 172.21.15.40:0/1970572811 conn(0x7f0fa409fb20 msgr2=0x7f0fa40702e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:42.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.896+0000 7f0faa378700 1 -- 172.21.15.40:0/1970572811 shutdown_connections 2023-09-30T22:27:42.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:42.896+0000 7f0faa378700 1 -- 172.21.15.40:0/1970572811 wait complete. 2023-09-30T22:27:42.910 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:43.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:43.015+0000 7fd246797700 1 -- 172.21.15.40:0/3481204005 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd240062380 con 0x7fd240135940 2023-09-30T22:27:43.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:43.016+0000 7fd23cff9700 1 -- 172.21.15.40:0/3481204005 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd238014b10 con 0x7fd240135940 2023-09-30T22:27:43.017 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:43.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:43.018+0000 7fd246797700 1 -- 172.21.15.40:0/3481204005 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd240135940 msgr2=0x7fd240119050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:43.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:43.018+0000 7fd246797700 1 --2- 172.21.15.40:0/3481204005 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd240135940 0x7fd240119050 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fd2380049d0 tx=0x7fd238010420 comp rx=0 tx=0).stop 2023-09-30T22:27:43.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:43.018+0000 7fd246797700 1 -- 172.21.15.40:0/3481204005 shutdown_connections 2023-09-30T22:27:43.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:43.018+0000 7fd246797700 1 --2- 172.21.15.40:0/3481204005 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd24009d450 0x7fd2401c45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:43.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:43.018+0000 7fd246797700 1 --2- 172.21.15.40:0/3481204005 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd240135940 0x7fd240119050 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:43.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:43.018+0000 7fd246797700 1 --2- 172.21.15.40:0/3481204005 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd24009df30 0x7fd2401c4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:43.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:43.018+0000 7fd246797700 1 -- 172.21.15.40:0/3481204005 >> 172.21.15.40:0/3481204005 conn(0x7fd2400a2a00 msgr2=0x7fd240130800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:43.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:43.018+0000 7fd246797700 1 -- 172.21.15.40:0/3481204005 shutdown_connections 2023-09-30T22:27:43.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:43.018+0000 7fd246797700 1 -- 172.21.15.40:0/3481204005 wait complete. 2023-09-30T22:27:43.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:43.026+0000 7f1cfafb1700 1 -- 172.21.15.40:0/2804169692 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1cf411ef50 con 0x7f1cf409e230 2023-09-30T22:27:43.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:43.026+0000 7f1cf17fa700 1 -- 172.21.15.40:0/2804169692 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1cf411ef50 con 0x7f1cf409e230 2023-09-30T22:27:43.027 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:43.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:43.029+0000 7f1cfafb1700 1 -- 172.21.15.40:0/2804169692 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1cf409e230 msgr2=0x7f1cf41c4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:43.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:43.029+0000 7f1cfafb1700 1 --2- 172.21.15.40:0/2804169692 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1cf409e230 0x7f1cf41c4430 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1ce00011e0 tx=0x7f1ce000cae0 comp rx=0 tx=0).stop 2023-09-30T22:27:43.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:43.029+0000 7f1cfafb1700 1 -- 172.21.15.40:0/2804169692 shutdown_connections 2023-09-30T22:27:43.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:43.029+0000 7f1cfafb1700 1 --2- 172.21.15.40:0/2804169692 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1cf4130fb0 0x7f1cf41c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:43.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:43.029+0000 7f1cfafb1700 1 --2- 172.21.15.40:0/2804169692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cf409d920 0x7f1cf41c3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:43.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:43.029+0000 7f1cfafb1700 1 --2- 172.21.15.40:0/2804169692 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1cf409e230 0x7f1cf41c4430 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:43.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:43.029+0000 7f1cfafb1700 1 -- 172.21.15.40:0/2804169692 >> 172.21.15.40:0/2804169692 conn(0x7f1cf409fb20 msgr2=0x7f1cf41b67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:43.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:43.029+0000 7f1cfafb1700 1 -- 172.21.15.40:0/2804169692 shutdown_connections 2023-09-30T22:27:43.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:43.029+0000 7f1cfafb1700 1 -- 172.21.15.40:0/2804169692 wait complete. 2023-09-30T22:27:43.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:43.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:43.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:43.044+0000 7f12ebf9a700 1 -- 172.21.15.40:0/418628725 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f12e4074720 con 0x7f12e409de60 2023-09-30T22:27:43.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:43.045+0000 7f12da7fc700 1 -- 172.21.15.40:0/418628725 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f12d401a7d0 con 0x7f12e409de60 2023-09-30T22:27:43.045 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:43.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:43.047+0000 7f12ebf9a700 1 -- 172.21.15.40:0/418628725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12e409de60 msgr2=0x7f12e41276d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:43.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:43.047+0000 7f12ebf9a700 1 --2- 172.21.15.40:0/418628725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12e409de60 0x7f12e41276d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f12d4000c00 tx=0x7f12d4004750 comp rx=0 tx=0).stop 2023-09-30T22:27:43.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:43.047+0000 7f12ebf9a700 1 -- 172.21.15.40:0/418628725 shutdown_connections 2023-09-30T22:27:43.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:43.047+0000 7f12ebf9a700 1 --2- 172.21.15.40:0/418628725 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f12e406a6d0 0x7f12e4127190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:43.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:43.047+0000 7f12ebf9a700 1 --2- 172.21.15.40:0/418628725 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12e413c490 0x7f12e41cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:43.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:43.047+0000 7f12ebf9a700 1 --2- 172.21.15.40:0/418628725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12e409de60 0x7f12e41276d0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:43.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:43.047+0000 7f12ebf9a700 1 -- 172.21.15.40:0/418628725 >> 172.21.15.40:0/418628725 conn(0x7f12e409fb20 msgr2=0x7f12e413b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:43.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:43.047+0000 7f12ebf9a700 1 -- 172.21.15.40:0/418628725 shutdown_connections 2023-09-30T22:27:43.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:43.047+0000 7f12ebf9a700 1 -- 172.21.15.40:0/418628725 wait complete. 2023-09-30T22:27:43.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:43.911 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:44.032 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:44.042 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:44.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.053+0000 7fa4e7c35700 1 Processor -- start 2023-09-30T22:27:44.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.054+0000 7fa4e7c35700 1 -- start start 2023-09-30T22:27:44.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.054+0000 7fa4e7c35700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4e009d920 0x7fa4e009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.054+0000 7fa4e7c35700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4e009e230 0x7fa4e01343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.054+0000 7fa4e7c35700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4e009f940 con 0x7fa4e009f0f0 2023-09-30T22:27:44.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.054+0000 7fa4e7c35700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e006b4c0 con 0x7fa4e009e230 2023-09-30T22:27:44.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.054+0000 7fa4e7c35700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e009a8f0 con 0x7fa4e009d920 2023-09-30T22:27:44.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.054+0000 7fa4e59d1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4e009d920 0x7fa4e009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.054+0000 7fa4e59d1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4e009d920 0x7fa4e009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:34800/0 (socket says 172.21.15.40:34800) 2023-09-30T22:27:44.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.054+0000 7fa4e59d1700 1 -- 172.21.15.40:0/3856288364 learned_addr learned my addr 172.21.15.40:0/3856288364 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:44.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.054+0000 7fa4e61d2700 1 --2- 172.21.15.40:0/3856288364 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4e009e230 0x7fa4e01343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.055+0000 7fa4e61d2700 1 -- 172.21.15.40:0/3856288364 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4e009d920 msgr2=0x7fa4e009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:44.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.055+0000 7fa4e61d2700 1 --2- 172.21.15.40:0/3856288364 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4e009d920 0x7fa4e009dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.055+0000 7fa4e61d2700 1 -- 172.21.15.40:0/3856288364 >> v1:172.21.15.40:6789/0 conn(0x7fa4e009f0f0 legacy=0x7fa4e0133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.055+0000 7fa4e61d2700 1 -- 172.21.15.40:0/3856288364 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e009f6e0 con 0x7fa4e009e230 2023-09-30T22:27:44.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.055+0000 7fa4e59d1700 1 --2- 172.21.15.40:0/3856288364 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4e009d920 0x7fa4e009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:44.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.055+0000 7fa4e61d2700 1 --2- 172.21.15.40:0/3856288364 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4e009e230 0x7fa4e01343b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009dc0 tx=0x7fa4d800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0cb6a02d20f4278 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:44.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.055+0000 7fa4e49cf700 1 -- 172.21.15.40:0/3856288364 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d800e070 con 0x7fa4e009e230 2023-09-30T22:27:44.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.055+0000 7fa4e49cf700 1 -- 172.21.15.40:0/3856288364 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d800bb20 con 0x7fa4e009e230 2023-09-30T22:27:44.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.055+0000 7fa4e49cf700 1 -- 172.21.15.40:0/3856288364 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d8012430 con 0x7fa4e009e230 2023-09-30T22:27:44.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.056+0000 7fa4e7c35700 1 -- 172.21.15.40:0/3856288364 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4e009e230 msgr2=0x7fa4e01343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.056+0000 7fa4e7c35700 1 --2- 172.21.15.40:0/3856288364 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4e009e230 0x7fa4e01343b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009dc0 tx=0x7fa4d800b330 comp rx=0 tx=0).stop 2023-09-30T22:27:44.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.056+0000 7fa4e7c35700 1 -- 172.21.15.40:0/3856288364 shutdown_connections 2023-09-30T22:27:44.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.056+0000 7fa4e7c35700 1 --2- 172.21.15.40:0/3856288364 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4e009e230 0x7fa4e01343b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.056+0000 7fa4e7c35700 1 --2- 172.21.15.40:0/3856288364 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4e009d920 0x7fa4e009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.056+0000 7fa4e7c35700 1 -- 172.21.15.40:0/3856288364 >> 172.21.15.40:0/3856288364 conn(0x7fa4e009fb20 msgr2=0x7fa4e009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:44.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.056+0000 7fa4e7c35700 1 -- 172.21.15.40:0/3856288364 shutdown_connections 2023-09-30T22:27:44.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.056+0000 7fa4e7c35700 1 -- 172.21.15.40:0/3856288364 wait complete. 2023-09-30T22:27:44.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.057+0000 7fa4e7c35700 1 Processor -- start 2023-09-30T22:27:44.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.057+0000 7fa4e7c35700 1 -- start start 2023-09-30T22:27:44.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.057+0000 7fa4e7c35700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4e009d920 0x7fa4e01227b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.057+0000 7fa4e7c35700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4e009e230 0x7fa4e0122cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.058+0000 7fa4e7c35700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4e01267d0 0x7fa4e0123230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.058+0000 7fa4e7c35700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e0125a60 con 0x7fa4e009d920 2023-09-30T22:27:44.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.058+0000 7fa4e7c35700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e00a3260 con 0x7fa4e009e230 2023-09-30T22:27:44.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.058+0000 7fa4e7c35700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e01251e0 con 0x7fa4e01267d0 2023-09-30T22:27:44.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.058+0000 7fa4e59d1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4e009d920 0x7fa4e01227b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.058+0000 7fa4e61d2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4e01267d0 0x7fa4e0123230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.058+0000 7fa4e59d1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4e009d920 0x7fa4e01227b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51354/0 (socket says 172.21.15.40:51354) 2023-09-30T22:27:44.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.058+0000 7fa4e61d2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4e01267d0 0x7fa4e0123230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:34804/0 (socket says 172.21.15.40:34804) 2023-09-30T22:27:44.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.058+0000 7fa4e59d1700 1 -- 172.21.15.40:0/1004894188 learned_addr learned my addr 172.21.15.40:0/1004894188 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:44.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.058+0000 7fa4e51d0700 1 --2- 172.21.15.40:0/1004894188 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4e009e230 0x7fa4e0122cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.058+0000 7fa4e59d1700 1 -- 172.21.15.40:0/1004894188 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4e01267d0 msgr2=0x7fa4e0123230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.058+0000 7fa4e59d1700 1 --2- 172.21.15.40:0/1004894188 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4e01267d0 0x7fa4e0123230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.058+0000 7fa4e59d1700 1 -- 172.21.15.40:0/1004894188 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4e009e230 msgr2=0x7fa4e0122cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.058+0000 7fa4e59d1700 1 --2- 172.21.15.40:0/1004894188 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4e009e230 0x7fa4e0122cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.058+0000 7fa4e59d1700 1 -- 172.21.15.40:0/1004894188 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d0009500 con 0x7fa4e009d920 2023-09-30T22:27:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.058+0000 7fa4e61d2700 1 --2- 172.21.15.40:0/1004894188 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4e01267d0 0x7fa4e0123230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.058+0000 7fa4e59d1700 1 --2- 172.21.15.40:0/1004894188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4e009d920 0x7fa4e01227b0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fa4d000e9a0 tx=0x7fa4d000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.059+0000 7fa4d67fc700 1 -- 172.21.15.40:0/1004894188 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0005a20 con 0x7fa4e009d920 2023-09-30T22:27:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.059+0000 7fa4e7c35700 1 -- 172.21.15.40:0/1004894188 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d8009a70 con 0x7fa4e009d920 2023-09-30T22:27:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.059+0000 7fa4d67fc700 1 -- 172.21.15.40:0/1004894188 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d0005b80 con 0x7fa4e009d920 2023-09-30T22:27:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.059+0000 7fa4d67fc700 1 -- 172.21.15.40:0/1004894188 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d000c850 con 0x7fa4e009d920 2023-09-30T22:27:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.059+0000 7fa4e7c35700 1 -- 172.21.15.40:0/1004894188 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e01c8990 con 0x7fa4e009d920 2023-09-30T22:27:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.059+0000 7fa4d67fc700 1 -- 172.21.15.40:0/1004894188 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa4d000c9b0 con 0x7fa4e009d920 2023-09-30T22:27:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.059+0000 7fa4d67fc700 1 -- 172.21.15.40:0/1004894188 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa4d003faf0 con 0x7fa4e009d920 2023-09-30T22:27:44.063 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:44.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.061+0000 7fa4e7c35700 1 -- 172.21.15.40:0/1004894188 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4e0062380 con 0x7fa4e009d920 2023-09-30T22:27:44.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.066+0000 7fa4d67fc700 1 -- 172.21.15.40:0/1004894188 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa4d0020020 con 0x7fa4e009d920 2023-09-30T22:27:44.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.178+0000 7fb27d5b6700 1 Processor -- start 2023-09-30T22:27:44.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.179+0000 7fb27d5b6700 1 -- start start 2023-09-30T22:27:44.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.179+0000 7fb27d5b6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb27809f0f0 0x7fb278138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.179+0000 7fb27d5b6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb27809e400 0x7fb27813b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.179+0000 7fb27d5b6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb27809f940 con 0x7fb27809d920 2023-09-30T22:27:44.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.180+0000 7fb27d5b6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb27806b4c0 con 0x7fb27809e400 2023-09-30T22:27:44.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.180+0000 7fb27d5b6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb27809a8f0 con 0x7fb27809f0f0 2023-09-30T22:27:44.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.180+0000 7fb2767fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb27809f0f0 0x7fb278138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.180+0000 7fb2767fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb27809f0f0 0x7fb278138ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:34806/0 (socket says 172.21.15.40:34806) 2023-09-30T22:27:44.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.180+0000 7fb2767fc700 1 -- 172.21.15.40:0/2645876664 learned_addr learned my addr 172.21.15.40:0/2645876664 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:44.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.180+0000 7fb2777fe700 1 --2- 172.21.15.40:0/2645876664 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb27809e400 0x7fb27813b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.180+0000 7fb2767fc700 1 -- 172.21.15.40:0/2645876664 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb27809e400 msgr2=0x7fb27813b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:44.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.180+0000 7fb2767fc700 1 --2- 172.21.15.40:0/2645876664 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb27809e400 0x7fb27813b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.180+0000 7fb2767fc700 1 -- 172.21.15.40:0/2645876664 >> v1:172.21.15.40:6789/0 conn(0x7fb27809d920 legacy=0x7fb27809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.180+0000 7fb2767fc700 1 -- 172.21.15.40:0/2645876664 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27809f6e0 con 0x7fb27809f0f0 2023-09-30T22:27:44.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.180+0000 7fb2777fe700 1 --2- 172.21.15.40:0/2645876664 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb27809e400 0x7fb27813b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:44.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.180+0000 7fb2767fc700 1 --2- 172.21.15.40:0/2645876664 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb27809f0f0 0x7fb278138ee0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb26c009950 tx=0x7fb26c009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c06bf69ede7e739 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:44.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.180+0000 7fb275ffb700 1 -- 172.21.15.40:0/2645876664 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c011830 con 0x7fb27809f0f0 2023-09-30T22:27:44.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.181+0000 7fb275ffb700 1 -- 172.21.15.40:0/2645876664 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26c011990 con 0x7fb27809f0f0 2023-09-30T22:27:44.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.181+0000 7fb275ffb700 1 -- 172.21.15.40:0/2645876664 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c011d40 con 0x7fb27809f0f0 2023-09-30T22:27:44.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.181+0000 7fb27d5b6700 1 -- 172.21.15.40:0/2645876664 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb27809f0f0 msgr2=0x7fb278138ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.181+0000 7fb27d5b6700 1 --2- 172.21.15.40:0/2645876664 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb27809f0f0 0x7fb278138ee0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb26c009950 tx=0x7fb26c009c60 comp rx=0 tx=0).stop 2023-09-30T22:27:44.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.181+0000 7fb27d5b6700 1 -- 172.21.15.40:0/2645876664 shutdown_connections 2023-09-30T22:27:44.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.181+0000 7fb27d5b6700 1 --2- 172.21.15.40:0/2645876664 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb27809e400 0x7fb27813b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.181+0000 7fb27d5b6700 1 --2- 172.21.15.40:0/2645876664 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb27809f0f0 0x7fb278138ee0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.181+0000 7fb27d5b6700 1 -- 172.21.15.40:0/2645876664 >> 172.21.15.40:0/2645876664 conn(0x7fb27809fb20 msgr2=0x7fb27809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:44.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.181+0000 7fb27d5b6700 1 -- 172.21.15.40:0/2645876664 shutdown_connections 2023-09-30T22:27:44.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.181+0000 7fb27d5b6700 1 -- 172.21.15.40:0/2645876664 wait complete. 2023-09-30T22:27:44.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.183+0000 7fb27d5b6700 1 Processor -- start 2023-09-30T22:27:44.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.183+0000 7fb27d5b6700 1 -- start start 2023-09-30T22:27:44.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.183+0000 7fb27d5b6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb27809d920 0x7fb27811e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.183+0000 7fb27d5b6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb27809e400 0x7fb27811eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.183+0000 7fb27d5b6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb27811f400 0x7fb2781350c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.184+0000 7fb27d5b6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb278136160 con 0x7fb27809d920 2023-09-30T22:27:44.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.184+0000 7fb27d5b6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb278120ad0 con 0x7fb27809e400 2023-09-30T22:27:44.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.184+0000 7fb27d5b6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb27809c9e0 con 0x7fb27811f400 2023-09-30T22:27:44.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.184+0000 7fb2767fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb27809e400 0x7fb27811eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.184+0000 7fb2767fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb27809e400 0x7fb27811eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41164/0 (socket says 172.21.15.40:41164) 2023-09-30T22:27:44.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.184+0000 7fb2767fc700 1 -- 172.21.15.40:0/3188871313 learned_addr learned my addr 172.21.15.40:0/3188871313 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:44.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.184+0000 7fb276ffd700 1 --2- 172.21.15.40:0/3188871313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb27809d920 0x7fb27811e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.184+0000 7fb2777fe700 1 --2- 172.21.15.40:0/3188871313 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb27811f400 0x7fb2781350c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.184+0000 7fb2767fc700 1 -- 172.21.15.40:0/3188871313 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb27811f400 msgr2=0x7fb2781350c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.184+0000 7fb2767fc700 1 --2- 172.21.15.40:0/3188871313 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb27811f400 0x7fb2781350c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.184+0000 7fb2767fc700 1 -- 172.21.15.40:0/3188871313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb27809d920 msgr2=0x7fb27811e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.184+0000 7fb2767fc700 1 --2- 172.21.15.40:0/3188871313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb27809d920 0x7fb27811e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.184+0000 7fb2767fc700 1 -- 172.21.15.40:0/3188871313 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb270009a70 con 0x7fb27809e400 2023-09-30T22:27:44.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.184+0000 7fb276ffd700 1 --2- 172.21.15.40:0/3188871313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb27809d920 0x7fb27811e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:44.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.184+0000 7fb2767fc700 1 --2- 172.21.15.40:0/3188871313 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb27809e400 0x7fb27811eec0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb26c009ca0 tx=0x7fb26c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:44.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.185+0000 7fb25f7fe700 1 -- 172.21.15.40:0/3188871313 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c004450 con 0x7fb27809e400 2023-09-30T22:27:44.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.185+0000 7fb25f7fe700 1 -- 172.21.15.40:0/3188871313 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26c0045d0 con 0x7fb27809e400 2023-09-30T22:27:44.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.185+0000 7fb25f7fe700 1 -- 172.21.15.40:0/3188871313 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c0038e0 con 0x7fb27809e400 2023-09-30T22:27:44.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.185+0000 7fb27d5b6700 1 -- 172.21.15.40:0/3188871313 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb26c009550 con 0x7fb27809e400 2023-09-30T22:27:44.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.185+0000 7fb27d5b6700 1 -- 172.21.15.40:0/3188871313 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb278121e20 con 0x7fb27809e400 2023-09-30T22:27:44.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.186+0000 7fb27d5b6700 1 -- 172.21.15.40:0/3188871313 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb27811f800 con 0x7fb27809e400 2023-09-30T22:27:44.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.187+0000 7fb25f7fe700 1 -- 172.21.15.40:0/3188871313 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb26c003a40 con 0x7fb27809e400 2023-09-30T22:27:44.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.187+0000 7fb25f7fe700 1 -- 172.21.15.40:0/3188871313 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb26c0408d0 con 0x7fb27809e400 2023-09-30T22:27:44.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.188+0000 7f6fbc7f4700 1 Processor -- start 2023-09-30T22:27:44.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.188+0000 7f6fbc7f4700 1 -- start start 2023-09-30T22:27:44.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.189+0000 7f6fbc7f4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6fb409fbb0 0x7f6fb406c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.189+0000 7f6fbc7f4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6fb406ced0 0x7f6fb406d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.189+0000 7f6fbc7f4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6fb4138370 0x7f6fb413a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.189+0000 7f6fbc7f4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb409ff80 con 0x7f6fb4138370 2023-09-30T22:27:44.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.189+0000 7f6fbc7f4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb406ec40 con 0x7f6fb409fbb0 2023-09-30T22:27:44.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.189+0000 7f6fbc7f4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb406f510 con 0x7f6fb406ced0 2023-09-30T22:27:44.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.189+0000 7f6fba590700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6fb409fbb0 0x7f6fb406c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.189+0000 7f6fba590700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6fb409fbb0 0x7f6fb406c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41180/0 (socket says 172.21.15.40:41180) 2023-09-30T22:27:44.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.189+0000 7f6fba590700 1 -- 172.21.15.40:0/1370447433 learned_addr learned my addr 172.21.15.40:0/1370447433 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:44.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.189+0000 7f6fb9d8f700 1 --2- 172.21.15.40:0/1370447433 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6fb406ced0 0x7f6fb406d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.189+0000 7f6fba590700 1 -- 172.21.15.40:0/1370447433 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6fb406ced0 msgr2=0x7f6fb406d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:44.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.189+0000 7f6fba590700 1 --2- 172.21.15.40:0/1370447433 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6fb406ced0 0x7f6fb406d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.189+0000 7f6fba590700 1 -- 172.21.15.40:0/1370447433 >> v2:172.21.15.40:3300/0 conn(0x7f6fb4138370 msgr2=0x7f6fb413a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:44.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.189+0000 7f6fba590700 1 --2- 172.21.15.40:0/1370447433 >> v2:172.21.15.40:3300/0 conn(0x7f6fb4138370 0x7f6fb413a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.189+0000 7f6fba590700 1 -- 172.21.15.40:0/1370447433 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb406e3f0 con 0x7f6fb409fbb0 2023-09-30T22:27:44.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.190+0000 7f6fba590700 1 --2- 172.21.15.40:0/1370447433 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6fb409fbb0 0x7f6fb406c990 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0009920 tx=0x7f6fb0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee7cb58b40f661f1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:44.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.195+0000 7f6fb958e700 1 -- 172.21.15.40:0/1370447433 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0011830 con 0x7f6fb409fbb0 2023-09-30T22:27:44.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.195+0000 7f6fb958e700 1 -- 172.21.15.40:0/1370447433 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb0011990 con 0x7f6fb409fbb0 2023-09-30T22:27:44.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.195+0000 7f6fb958e700 1 -- 172.21.15.40:0/1370447433 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0011d20 con 0x7f6fb409fbb0 2023-09-30T22:27:44.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.195+0000 7fb25f7fe700 1 -- 172.21.15.40:0/3188871313 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb26c01a420 con 0x7fb27809e400 2023-09-30T22:27:44.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.196+0000 7f6fbc7f4700 1 -- 172.21.15.40:0/1370447433 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6fb409fbb0 msgr2=0x7f6fb406c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.196+0000 7f6fbc7f4700 1 --2- 172.21.15.40:0/1370447433 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6fb409fbb0 0x7f6fb406c990 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0009920 tx=0x7f6fb0009c30 comp rx=0 tx=0).stop 2023-09-30T22:27:44.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.196+0000 7f6fbc7f4700 1 -- 172.21.15.40:0/1370447433 shutdown_connections 2023-09-30T22:27:44.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.196+0000 7f6fbc7f4700 1 --2- 172.21.15.40:0/1370447433 >> v2:172.21.15.40:3300/0 conn(0x7f6fb4138370 0x7f6fb413a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.196+0000 7f6fbc7f4700 1 --2- 172.21.15.40:0/1370447433 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6fb409fbb0 0x7f6fb406c990 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.196+0000 7f6fbc7f4700 1 --2- 172.21.15.40:0/1370447433 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6fb406ced0 0x7f6fb406d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.196+0000 7f6fbc7f4700 1 -- 172.21.15.40:0/1370447433 >> 172.21.15.40:0/1370447433 conn(0x7f6fb40a41a0 msgr2=0x7f6fb40a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:44.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.196+0000 7f6fbc7f4700 1 -- 172.21.15.40:0/1370447433 shutdown_connections 2023-09-30T22:27:44.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.196+0000 7f6fbc7f4700 1 -- 172.21.15.40:0/1370447433 wait complete. 2023-09-30T22:27:44.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.197+0000 7f6fbc7f4700 1 Processor -- start 2023-09-30T22:27:44.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.197+0000 7f6fbc7f4700 1 -- start start 2023-09-30T22:27:44.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.197+0000 7f6fbc7f4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fb406ced0 0x7f6fb4137830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.197+0000 7f6fbc7f4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6fb409fbb0 0x7f6fb4137d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.197+0000 7f6fbc7f4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6fb4138370 0x7f6fb4095b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.197+0000 7f6fbc7f4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb4095980 con 0x7f6fb406ced0 2023-09-30T22:27:44.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.197+0000 7f6fbc7f4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb4096d10 con 0x7f6fb409fbb0 2023-09-30T22:27:44.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.197+0000 7f6fbc7f4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb4071db0 con 0x7f6fb4138370 2023-09-30T22:27:44.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.198+0000 7f6fba590700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fb406ced0 0x7f6fb4137830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.198+0000 7f6fba590700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fb406ced0 0x7f6fb4137830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51374/0 (socket says 172.21.15.40:51374) 2023-09-30T22:27:44.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.198+0000 7f6fba590700 1 -- 172.21.15.40:0/3451581726 learned_addr learned my addr 172.21.15.40:0/3451581726 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:44.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.198+0000 7f6fb9d8f700 1 --2- 172.21.15.40:0/3451581726 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6fb409fbb0 0x7f6fb4137d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.198+0000 7f6fbad91700 1 --2- 172.21.15.40:0/3451581726 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6fb4138370 0x7f6fb4095b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.198+0000 7f6fba590700 1 -- 172.21.15.40:0/3451581726 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6fb4138370 msgr2=0x7f6fb4095b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.198+0000 7f6fba590700 1 --2- 172.21.15.40:0/3451581726 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6fb4138370 0x7f6fb4095b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.198+0000 7f6fba590700 1 -- 172.21.15.40:0/3451581726 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6fb409fbb0 msgr2=0x7f6fb4137d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.198+0000 7f6fba590700 1 --2- 172.21.15.40:0/3451581726 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6fb409fbb0 0x7f6fb4137d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.198+0000 7f6fba590700 1 -- 172.21.15.40:0/3451581726 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb0009550 con 0x7f6fb406ced0 2023-09-30T22:27:44.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.198+0000 7f6fba590700 1 --2- 172.21.15.40:0/3451581726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fb406ced0 0x7f6fb4137830 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f6fb000a010 tx=0x7f6fb0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:44.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.198+0000 7f6faaffd700 1 -- 172.21.15.40:0/3451581726 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0004300 con 0x7f6fb406ced0 2023-09-30T22:27:44.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.199+0000 7f6faaffd700 1 -- 172.21.15.40:0/3451581726 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb001f070 con 0x7f6fb406ced0 2023-09-30T22:27:44.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.199+0000 7f6faaffd700 1 -- 172.21.15.40:0/3451581726 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb00036a0 con 0x7f6fb406ced0 2023-09-30T22:27:44.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.199+0000 7f6fbc7f4700 1 -- 172.21.15.40:0/3451581726 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb4094fa0 con 0x7f6fb406ced0 2023-09-30T22:27:44.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.199+0000 7f6fbc7f4700 1 -- 172.21.15.40:0/3451581726 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb4097320 con 0x7f6fb406ced0 2023-09-30T22:27:44.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.199+0000 7f6faaffd700 1 -- 172.21.15.40:0/3451581726 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6fb0021030 con 0x7f6fb406ced0 2023-09-30T22:27:44.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.199+0000 7f6faaffd700 1 -- 172.21.15.40:0/3451581726 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6fb0040850 con 0x7f6fb406ced0 2023-09-30T22:27:44.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.200+0000 7f6fbc7f4700 1 -- 172.21.15.40:0/3451581726 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb4062380 con 0x7f6fb406ced0 2023-09-30T22:27:44.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.205+0000 7f6faaffd700 1 -- 172.21.15.40:0/3451581726 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6fb0015080 con 0x7f6fb406ced0 2023-09-30T22:27:44.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.212+0000 7f6769bdf700 1 Processor -- start 2023-09-30T22:27:44.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.212+0000 7f6769bdf700 1 -- start start 2023-09-30T22:27:44.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.213+0000 7f6769bdf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6764131d50 0x7f6764132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.213+0000 7f6769bdf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f676409bc50 0x7f676409c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.213+0000 7f6769bdf700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6764071920 con 0x7f676409c600 2023-09-30T22:27:44.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.213+0000 7f6769bdf700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6764132660 con 0x7f676409bc50 2023-09-30T22:27:44.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.213+0000 7f6769bdf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6764131900 con 0x7f6764131d50 2023-09-30T22:27:44.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.213+0000 7f67637fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6764131d50 0x7f6764132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.213+0000 7f6762ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f676409bc50 0x7f676409c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.213+0000 7f6763fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f676409c600 0x7f6764138ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57142/0 (socket says 172.21.15.40:57142) 2023-09-30T22:27:44.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.213+0000 7f6763fff700 1 -- 172.21.15.40:0/2110690672 learned_addr learned my addr 172.21.15.40:0/2110690672 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:27:44.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.213+0000 7f6762ffd700 1 -- 172.21.15.40:0/2110690672 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6764131d50 msgr2=0x7f6764132120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:44.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.213+0000 7f6762ffd700 1 --2- 172.21.15.40:0/2110690672 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6764131d50 0x7f6764132120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.213+0000 7f6762ffd700 1 -- 172.21.15.40:0/2110690672 >> v1:172.21.15.40:6789/0 conn(0x7f676409c600 legacy=0x7f6764138ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.213+0000 7f6762ffd700 1 -- 172.21.15.40:0/2110690672 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f676409e820 con 0x7f676409bc50 2023-09-30T22:27:44.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.213+0000 7f67637fe700 1 --2- 172.21.15.40:0/2110690672 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6764131d50 0x7f6764132120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:44.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.214+0000 7f6762ffd700 1 --2- 172.21.15.40:0/2110690672 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f676409bc50 0x7f676409c0c0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f6758009840 tx=0x7f6758009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db50ed064eb248d5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:44.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.214+0000 7f67627fc700 1 -- 172.21.15.40:0/2110690672 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6758004230 con 0x7f676409bc50 2023-09-30T22:27:44.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.214+0000 7f67627fc700 1 -- 172.21.15.40:0/2110690672 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6758004390 con 0x7f676409bc50 2023-09-30T22:27:44.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.214+0000 7f67627fc700 1 -- 172.21.15.40:0/2110690672 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67580036a0 con 0x7f676409bc50 2023-09-30T22:27:44.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.214+0000 7f6769bdf700 1 -- 172.21.15.40:0/2110690672 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f676409bc50 msgr2=0x7f676409c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.214+0000 7f6769bdf700 1 --2- 172.21.15.40:0/2110690672 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f676409bc50 0x7f676409c0c0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f6758009840 tx=0x7f6758009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:44.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.215+0000 7f6769bdf700 1 -- 172.21.15.40:0/2110690672 shutdown_connections 2023-09-30T22:27:44.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.215+0000 7f6769bdf700 1 --2- 172.21.15.40:0/2110690672 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6764131d50 0x7f6764132120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.215+0000 7f6769bdf700 1 --2- 172.21.15.40:0/2110690672 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f676409bc50 0x7f676409c0c0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.215+0000 7f6769bdf700 1 -- 172.21.15.40:0/2110690672 >> 172.21.15.40:0/2110690672 conn(0x7f67640a2a00 msgr2=0x7f67640a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:44.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.215+0000 7f6769bdf700 1 -- 172.21.15.40:0/2110690672 shutdown_connections 2023-09-30T22:27:44.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.215+0000 7f6769bdf700 1 -- 172.21.15.40:0/2110690672 wait complete. 2023-09-30T22:27:44.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.215+0000 7f6769bdf700 1 Processor -- start 2023-09-30T22:27:44.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.216+0000 7f6769bdf700 1 -- start start 2023-09-30T22:27:44.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.216+0000 7f6769bdf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f676409bc50 0x7f676411f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.216+0000 7f6769bdf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f676409c600 0x7f676411e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.216+0000 7f6769bdf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6764131d50 0x7f676411e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.216+0000 7f6769bdf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676412cfc0 con 0x7f676409c600 2023-09-30T22:27:44.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.216+0000 7f6769bdf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f676409ffb0 con 0x7f676409bc50 2023-09-30T22:27:44.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.216+0000 7f6769bdf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f676409ea60 con 0x7f6764131d50 2023-09-30T22:27:44.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.216+0000 7f6762ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f676409c600 0x7f676411e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.216+0000 7f6763fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6764131d50 0x7f676411e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.216+0000 7f6762ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f676409c600 0x7f676411e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51394/0 (socket says 172.21.15.40:51394) 2023-09-30T22:27:44.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.216+0000 7f6762ffd700 1 -- 172.21.15.40:0/1582650921 learned_addr learned my addr 172.21.15.40:0/1582650921 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:44.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.217+0000 7f67637fe700 1 --2- 172.21.15.40:0/1582650921 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f676409bc50 0x7f676411f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.217+0000 7f6762ffd700 1 -- 172.21.15.40:0/1582650921 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6764131d50 msgr2=0x7f676411e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.217+0000 7f6762ffd700 1 --2- 172.21.15.40:0/1582650921 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6764131d50 0x7f676411e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.217+0000 7f6762ffd700 1 -- 172.21.15.40:0/1582650921 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f676409bc50 msgr2=0x7f676411f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.217+0000 7f6762ffd700 1 --2- 172.21.15.40:0/1582650921 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f676409bc50 0x7f676411f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.217+0000 7f6762ffd700 1 -- 172.21.15.40:0/1582650921 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67540094a0 con 0x7f676409c600 2023-09-30T22:27:44.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.217+0000 7f6762ffd700 1 --2- 172.21.15.40:0/1582650921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f676409c600 0x7f676411e1a0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f6758000c00 tx=0x7f6758004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:44.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.217+0000 7f674bfff700 1 -- 172.21.15.40:0/1582650921 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6758003d80 con 0x7f676409c600 2023-09-30T22:27:44.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.217+0000 7f674bfff700 1 -- 172.21.15.40:0/1582650921 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6758011630 con 0x7f676409c600 2023-09-30T22:27:44.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.217+0000 7f674bfff700 1 -- 172.21.15.40:0/1582650921 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67580119e0 con 0x7f676409c600 2023-09-30T22:27:44.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.217+0000 7f6769bdf700 1 -- 172.21.15.40:0/1582650921 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67580094a0 con 0x7f676409c600 2023-09-30T22:27:44.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.217+0000 7f6769bdf700 1 -- 172.21.15.40:0/1582650921 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f676411d2e0 con 0x7f676409c600 2023-09-30T22:27:44.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.218+0000 7f674bfff700 1 -- 172.21.15.40:0/1582650921 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6758021070 con 0x7f676409c600 2023-09-30T22:27:44.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.219+0000 7f674bfff700 1 -- 172.21.15.40:0/1582650921 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f67580431c0 con 0x7f676409c600 2023-09-30T22:27:44.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.219+0000 7f6769bdf700 1 -- 172.21.15.40:0/1582650921 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f676411d080 con 0x7f676409c600 2023-09-30T22:27:44.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.224+0000 7f674bfff700 1 -- 172.21.15.40:0/1582650921 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f676411d080 con 0x7f676409c600 2023-09-30T22:27:44.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.272+0000 7fa4e7c35700 1 -- 172.21.15.40:0/1004894188 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa4e009c9e0 con 0x7fa4e009d920 2023-09-30T22:27:44.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.273+0000 7fa4d67fc700 1 -- 172.21.15.40:0/1004894188 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa4d002a090 con 0x7fa4e009d920 2023-09-30T22:27:44.274 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:44.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.276+0000 7fa4e7c35700 1 -- 172.21.15.40:0/1004894188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4e009d920 msgr2=0x7fa4e01227b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.276+0000 7fa4e7c35700 1 --2- 172.21.15.40:0/1004894188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4e009d920 0x7fa4e01227b0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fa4d000e9a0 tx=0x7fa4d000ecb0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.276+0000 7fa4e7c35700 1 -- 172.21.15.40:0/1004894188 shutdown_connections 2023-09-30T22:27:44.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.276+0000 7fa4e7c35700 1 --2- 172.21.15.40:0/1004894188 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4e01267d0 0x7fa4e0123230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.276+0000 7fa4e7c35700 1 --2- 172.21.15.40:0/1004894188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4e009d920 0x7fa4e01227b0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.276+0000 7fa4e7c35700 1 --2- 172.21.15.40:0/1004894188 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4e009e230 0x7fa4e0122cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.276+0000 7fa4e7c35700 1 -- 172.21.15.40:0/1004894188 >> 172.21.15.40:0/1004894188 conn(0x7fa4e009fb20 msgr2=0x7fa4e00a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:44.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.276+0000 7fa4e7c35700 1 -- 172.21.15.40:0/1004894188 shutdown_connections 2023-09-30T22:27:44.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.276+0000 7fa4e7c35700 1 -- 172.21.15.40:0/1004894188 wait complete. 2023-09-30T22:27:44.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:44.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.399+0000 7fb27d5b6700 1 -- 172.21.15.40:0/3188871313 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb278062380 con 0x7fb27809e400 2023-09-30T22:27:44.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.399+0000 7fb25f7fe700 1 -- 172.21.15.40:0/3188871313 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb26c02b360 con 0x7fb27809e400 2023-09-30T22:27:44.400 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:44.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.402+0000 7fb27d5b6700 1 -- 172.21.15.40:0/3188871313 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb27809e400 msgr2=0x7fb27811eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.402+0000 7fb27d5b6700 1 --2- 172.21.15.40:0/3188871313 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb27809e400 0x7fb27811eec0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb26c009ca0 tx=0x7fb26c004750 comp rx=0 tx=0).stop 2023-09-30T22:27:44.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.402+0000 7fb27d5b6700 1 -- 172.21.15.40:0/3188871313 shutdown_connections 2023-09-30T22:27:44.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.402+0000 7fb27d5b6700 1 --2- 172.21.15.40:0/3188871313 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb27811f400 0x7fb2781350c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.402+0000 7fb27d5b6700 1 --2- 172.21.15.40:0/3188871313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb27809d920 0x7fb27811e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.402+0000 7fb27d5b6700 1 --2- 172.21.15.40:0/3188871313 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb27809e400 0x7fb27811eec0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.402+0000 7fb27d5b6700 1 -- 172.21.15.40:0/3188871313 >> 172.21.15.40:0/3188871313 conn(0x7fb27809fb20 msgr2=0x7fb278070930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:44.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.402+0000 7fb27d5b6700 1 -- 172.21.15.40:0/3188871313 shutdown_connections 2023-09-30T22:27:44.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.402+0000 7fb27d5b6700 1 -- 172.21.15.40:0/3188871313 wait complete. 2023-09-30T22:27:44.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.405+0000 7f6fbc7f4700 1 -- 172.21.15.40:0/3451581726 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6fb40a04e0 con 0x7f6fb406ced0 2023-09-30T22:27:44.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.405+0000 7f6faaffd700 1 -- 172.21.15.40:0/3451581726 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6fb00199a0 con 0x7f6fb406ced0 2023-09-30T22:27:44.406 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:44.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.408+0000 7f6fbc7f4700 1 -- 172.21.15.40:0/3451581726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fb406ced0 msgr2=0x7f6fb4137830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.408+0000 7f6fbc7f4700 1 --2- 172.21.15.40:0/3451581726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fb406ced0 0x7f6fb4137830 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f6fb000a010 tx=0x7f6fb0004750 comp rx=0 tx=0).stop 2023-09-30T22:27:44.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.408+0000 7f6fbc7f4700 1 -- 172.21.15.40:0/3451581726 shutdown_connections 2023-09-30T22:27:44.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.408+0000 7f6fbc7f4700 1 --2- 172.21.15.40:0/3451581726 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6fb4138370 0x7f6fb4095b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.408+0000 7f6fbc7f4700 1 --2- 172.21.15.40:0/3451581726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fb406ced0 0x7f6fb4137830 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.408+0000 7f6fbc7f4700 1 --2- 172.21.15.40:0/3451581726 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6fb409fbb0 0x7f6fb4137d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.408+0000 7f6fbc7f4700 1 -- 172.21.15.40:0/3451581726 >> 172.21.15.40:0/3451581726 conn(0x7f6fb40a41a0 msgr2=0x7f6fb409a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:44.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.408+0000 7f6fbc7f4700 1 -- 172.21.15.40:0/3451581726 shutdown_connections 2023-09-30T22:27:44.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.408+0000 7f6fbc7f4700 1 -- 172.21.15.40:0/3451581726 wait complete. 2023-09-30T22:27:44.417 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:44.422 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:44.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.426+0000 7f6769bdf700 1 -- 172.21.15.40:0/1582650921 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f676411d080 con 0x7f676409c600 2023-09-30T22:27:44.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.426+0000 7f674bfff700 1 -- 172.21.15.40:0/1582650921 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f676411d080 con 0x7f676409c600 2023-09-30T22:27:44.427 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:44.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.428+0000 7f6769bdf700 1 -- 172.21.15.40:0/1582650921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f676409c600 msgr2=0x7f676411e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.428+0000 7f6769bdf700 1 --2- 172.21.15.40:0/1582650921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f676409c600 0x7f676411e1a0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f6758000c00 tx=0x7f6758004750 comp rx=0 tx=0).stop 2023-09-30T22:27:44.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.428+0000 7f6769bdf700 1 -- 172.21.15.40:0/1582650921 shutdown_connections 2023-09-30T22:27:44.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.428+0000 7f6769bdf700 1 --2- 172.21.15.40:0/1582650921 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6764131d50 0x7f676411e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.428+0000 7f6769bdf700 1 --2- 172.21.15.40:0/1582650921 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f676409bc50 0x7f676411f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.428+0000 7f6769bdf700 1 --2- 172.21.15.40:0/1582650921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f676409c600 0x7f676411e1a0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.428+0000 7f6769bdf700 1 -- 172.21.15.40:0/1582650921 >> 172.21.15.40:0/1582650921 conn(0x7f67640a2a00 msgr2=0x7f676412f680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:44.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.428+0000 7f6769bdf700 1 -- 172.21.15.40:0/1582650921 shutdown_connections 2023-09-30T22:27:44.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:44.428+0000 7f6769bdf700 1 -- 172.21.15.40:0/1582650921 wait complete. 2023-09-30T22:27:44.441 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:45.291 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:45.417 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:45.422 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:45.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.432+0000 7f508b1a9700 1 Processor -- start 2023-09-30T22:27:45.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.432+0000 7f508b1a9700 1 -- start start 2023-09-30T22:27:45.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.433+0000 7f508b1a9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f508409d920 0x7f508409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.433+0000 7f508b1a9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f508409f0f0 0x7f508409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.433+0000 7f508b1a9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f508409f940 con 0x7f5084133ca0 2023-09-30T22:27:45.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.433+0000 7f508b1a9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f508406b4c0 con 0x7f508409d920 2023-09-30T22:27:45.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.433+0000 7f508b1a9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f508409a8f0 con 0x7f508409f0f0 2023-09-30T22:27:45.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.433+0000 7f5083fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f508409f0f0 0x7f508409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:45.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.433+0000 7f5088f45700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f508409d920 0x7f508409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:45.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.433+0000 7f5083fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f508409f0f0 0x7f508409e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:34862/0 (socket says 172.21.15.40:34862) 2023-09-30T22:27:45.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.433+0000 7f5088f45700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f508409d920 0x7f508409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51406/0 (socket says 172.21.15.40:51406) 2023-09-30T22:27:45.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.433+0000 7f5083fff700 1 -- 172.21.15.40:0/3386040059 learned_addr learned my addr 172.21.15.40:0/3386040059 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:45.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.433+0000 7f5083fff700 1 -- 172.21.15.40:0/3386040059 >> v2:172.21.15.40:3300/0 conn(0x7f508409d920 msgr2=0x7f508409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:45.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.433+0000 7f5083fff700 1 --2- 172.21.15.40:0/3386040059 >> v2:172.21.15.40:3300/0 conn(0x7f508409d920 0x7f508409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.433+0000 7f5083fff700 1 -- 172.21.15.40:0/3386040059 >> v1:172.21.15.40:6789/0 conn(0x7f5084133ca0 legacy=0x7f5084134120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:45.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.434+0000 7f5083fff700 1 -- 172.21.15.40:0/3386040059 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508409f6e0 con 0x7f508409f0f0 2023-09-30T22:27:45.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.434+0000 7f5083fff700 1 --2- 172.21.15.40:0/3386040059 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f508409f0f0 0x7f508409e230 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f50700098f0 tx=0x7f5070009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a36a26908e709e4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:45.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.434+0000 7f50837fe700 1 -- 172.21.15.40:0/3386040059 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5070011830 con 0x7f508409f0f0 2023-09-30T22:27:45.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.434+0000 7f50837fe700 1 -- 172.21.15.40:0/3386040059 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5070011990 con 0x7f508409f0f0 2023-09-30T22:27:45.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.434+0000 7f50837fe700 1 -- 172.21.15.40:0/3386040059 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5070011d20 con 0x7f508409f0f0 2023-09-30T22:27:45.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.435+0000 7f508b1a9700 1 -- 172.21.15.40:0/3386040059 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f508409f0f0 msgr2=0x7f508409e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:45.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.435+0000 7f508b1a9700 1 --2- 172.21.15.40:0/3386040059 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f508409f0f0 0x7f508409e230 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f50700098f0 tx=0x7f5070009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:45.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.435+0000 7f508b1a9700 1 -- 172.21.15.40:0/3386040059 shutdown_connections 2023-09-30T22:27:45.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.435+0000 7f508b1a9700 1 --2- 172.21.15.40:0/3386040059 >> v2:172.21.15.40:3300/0 conn(0x7f508409d920 0x7f508409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.435+0000 7f508b1a9700 1 --2- 172.21.15.40:0/3386040059 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f508409f0f0 0x7f508409e230 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.435+0000 7f508b1a9700 1 -- 172.21.15.40:0/3386040059 >> 172.21.15.40:0/3386040059 conn(0x7f508409fb20 msgr2=0x7f508409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:45.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.435+0000 7f508b1a9700 1 -- 172.21.15.40:0/3386040059 shutdown_connections 2023-09-30T22:27:45.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.435+0000 7f508b1a9700 1 -- 172.21.15.40:0/3386040059 wait complete. 2023-09-30T22:27:45.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.436+0000 7f508b1a9700 1 Processor -- start 2023-09-30T22:27:45.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.436+0000 7f508b1a9700 1 -- start start 2023-09-30T22:27:45.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.436+0000 7f508b1a9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f508409d920 0x7f508411e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.437+0000 7f508b1a9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5084133ca0 0x7f508411e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.437+0000 7f508b1a9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5084131710 0x7f508411eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.437+0000 7f508b1a9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5084120560 con 0x7f5084131710 2023-09-30T22:27:45.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.437+0000 7f508b1a9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50841227e0 con 0x7f508409d920 2023-09-30T22:27:45.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.437+0000 7f508b1a9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f508409c9e0 con 0x7f5084133ca0 2023-09-30T22:27:45.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.437+0000 7f5083fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5084133ca0 0x7f508411e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:45.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.437+0000 7f5083fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5084133ca0 0x7f508411e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:34866/0 (socket says 172.21.15.40:34866) 2023-09-30T22:27:45.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.437+0000 7f5083fff700 1 -- 172.21.15.40:0/884558156 learned_addr learned my addr 172.21.15.40:0/884558156 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:45.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.437+0000 7f5088f45700 1 --2- 172.21.15.40:0/884558156 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f508409d920 0x7f508411e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:45.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.437+0000 7f5089746700 1 --2- 172.21.15.40:0/884558156 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5084131710 0x7f508411eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:45.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.437+0000 7f5083fff700 1 -- 172.21.15.40:0/884558156 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f508409d920 msgr2=0x7f508411e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:45.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.437+0000 7f5083fff700 1 --2- 172.21.15.40:0/884558156 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f508409d920 0x7f508411e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.437+0000 7f5083fff700 1 -- 172.21.15.40:0/884558156 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5084131710 msgr2=0x7f508411eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:45.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.437+0000 7f5083fff700 1 --2- 172.21.15.40:0/884558156 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5084131710 0x7f508411eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.437+0000 7f5083fff700 1 -- 172.21.15.40:0/884558156 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5070009550 con 0x7f5084133ca0 2023-09-30T22:27:45.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.437+0000 7f5083fff700 1 --2- 172.21.15.40:0/884558156 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5084133ca0 0x7f508411e860 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5070011db0 tx=0x7f5070004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:45.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.438+0000 7f50817fa700 1 -- 172.21.15.40:0/884558156 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5070004400 con 0x7f5084133ca0 2023-09-30T22:27:45.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.438+0000 7f50817fa700 1 -- 172.21.15.40:0/884558156 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f507001f070 con 0x7f5084133ca0 2023-09-30T22:27:45.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.438+0000 7f508b1a9700 1 -- 172.21.15.40:0/884558156 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f508411ffd0 con 0x7f5084133ca0 2023-09-30T22:27:45.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.438+0000 7f50817fa700 1 -- 172.21.15.40:0/884558156 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50700038c0 con 0x7f5084133ca0 2023-09-30T22:27:45.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.438+0000 7f508b1a9700 1 -- 172.21.15.40:0/884558156 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50840a2910 con 0x7f5084133ca0 2023-09-30T22:27:45.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.438+0000 7f50817fa700 1 -- 172.21.15.40:0/884558156 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5070021030 con 0x7f5084133ca0 2023-09-30T22:27:45.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.439+0000 7f50817fa700 1 -- 172.21.15.40:0/884558156 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5070040a60 con 0x7f5084133ca0 2023-09-30T22:27:45.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.439+0000 7f508b1a9700 1 -- 172.21.15.40:0/884558156 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5084062380 con 0x7f5084133ca0 2023-09-30T22:27:45.443 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:45.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.445+0000 7f50817fa700 1 -- 172.21.15.40:0/884558156 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5070015080 con 0x7f5084133ca0 2023-09-30T22:27:45.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.559+0000 7f884ca4e700 1 Processor -- start 2023-09-30T22:27:45.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.559+0000 7f884ca4e700 1 -- start start 2023-09-30T22:27:45.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.560+0000 7f884ca4e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8848138250 0x7f8848138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.560+0000 7f884ca4e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f884809d400 0x7f884809d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.560+0000 7f884ca4e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8848137e20 con 0x7f884809dd50 2023-09-30T22:27:45.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.560+0000 7f884ca4e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8848138050 con 0x7f884809d400 2023-09-30T22:27:45.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.560+0000 7f884ca4e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f884809b010 con 0x7f8848138250 2023-09-30T22:27:45.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.560+0000 7f884659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8848138250 0x7f8848138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:45.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.560+0000 7f884659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8848138250 0x7f8848138620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:34874/0 (socket says 172.21.15.40:34874) 2023-09-30T22:27:45.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.560+0000 7f884659c700 1 -- 172.21.15.40:0/690236659 learned_addr learned my addr 172.21.15.40:0/690236659 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:45.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.560+0000 7f8845d9b700 1 --2- 172.21.15.40:0/690236659 >> v2:172.21.15.40:3300/0 conn(0x7f884809d400 0x7f884809d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:45.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.560+0000 7f884659c700 1 -- 172.21.15.40:0/690236659 >> v2:172.21.15.40:3300/0 conn(0x7f884809d400 msgr2=0x7f884809d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:45.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.560+0000 7f884659c700 1 --2- 172.21.15.40:0/690236659 >> v2:172.21.15.40:3300/0 conn(0x7f884809d400 0x7f884809d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.560+0000 7f884659c700 1 -- 172.21.15.40:0/690236659 >> v1:172.21.15.40:6789/0 conn(0x7f884809dd50 legacy=0x7f884813f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:45.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.560+0000 7f884659c700 1 -- 172.21.15.40:0/690236659 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884809e1f0 con 0x7f8848138250 2023-09-30T22:27:45.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.561+0000 7f884659c700 1 --2- 172.21.15.40:0/690236659 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8848138250 0x7f8848138620 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f88380098f0 tx=0x7f8838009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db839619c9dc232c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:45.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.564+0000 7f884559a700 1 -- 172.21.15.40:0/690236659 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8838011830 con 0x7f8848138250 2023-09-30T22:27:45.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.564+0000 7f884559a700 1 -- 172.21.15.40:0/690236659 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8838011990 con 0x7f8848138250 2023-09-30T22:27:45.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.564+0000 7f884559a700 1 -- 172.21.15.40:0/690236659 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8838011d20 con 0x7f8848138250 2023-09-30T22:27:45.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.564+0000 7f884ca4e700 1 -- 172.21.15.40:0/690236659 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8848138250 msgr2=0x7f8848138620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:45.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.564+0000 7f884ca4e700 1 --2- 172.21.15.40:0/690236659 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8848138250 0x7f8848138620 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f88380098f0 tx=0x7f8838009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:45.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.564+0000 7f884ca4e700 1 -- 172.21.15.40:0/690236659 shutdown_connections 2023-09-30T22:27:45.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.564+0000 7f884ca4e700 1 --2- 172.21.15.40:0/690236659 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8848138250 0x7f8848138620 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.564+0000 7f884ca4e700 1 --2- 172.21.15.40:0/690236659 >> v2:172.21.15.40:3300/0 conn(0x7f884809d400 0x7f884809d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.564+0000 7f884ca4e700 1 -- 172.21.15.40:0/690236659 >> 172.21.15.40:0/690236659 conn(0x7f88480a2a00 msgr2=0x7f88480a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:45.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.567+0000 7f884ca4e700 1 -- 172.21.15.40:0/690236659 shutdown_connections 2023-09-30T22:27:45.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.567+0000 7f884ca4e700 1 -- 172.21.15.40:0/690236659 wait complete. 2023-09-30T22:27:45.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.568+0000 7f884ca4e700 1 Processor -- start 2023-09-30T22:27:45.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.568+0000 7f884ca4e700 1 -- start start 2023-09-30T22:27:45.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.569+0000 7f884ca4e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f884809d400 0x7f88481228b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.569+0000 7f884ca4e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f884809dd50 0x7f8848122df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.569+0000 7f884ca4e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8848138250 0x7f8848123330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.569+0000 7f884ca4e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88481265f0 con 0x7f8848138250 2023-09-30T22:27:45.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.569+0000 7f884ca4e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8848124a80 con 0x7f884809dd50 2023-09-30T22:27:45.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.569+0000 7f884ca4e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8848125c30 con 0x7f884809d400 2023-09-30T22:27:45.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.569+0000 7f8846d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8848138250 0x7f8848123330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:45.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.569+0000 7f8846d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8848138250 0x7f8848123330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51448/0 (socket says 172.21.15.40:51448) 2023-09-30T22:27:45.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.569+0000 7f8846d9d700 1 -- 172.21.15.40:0/1151145246 learned_addr learned my addr 172.21.15.40:0/1151145246 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:45.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.569+0000 7f884659c700 1 --2- 172.21.15.40:0/1151145246 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f884809d400 0x7f88481228b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:45.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.569+0000 7f6fcfd11700 1 Processor -- start 2023-09-30T22:27:45.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.570+0000 7f8845d9b700 1 --2- 172.21.15.40:0/1151145246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f884809dd50 0x7f8848122df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:45.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.570+0000 7f884659c700 1 -- 172.21.15.40:0/1151145246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f884809dd50 msgr2=0x7f8848122df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:45.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.570+0000 7f884659c700 1 --2- 172.21.15.40:0/1151145246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f884809dd50 0x7f8848122df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.570+0000 7f884659c700 1 -- 172.21.15.40:0/1151145246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8848138250 msgr2=0x7f8848123330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:45.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.570+0000 7f884659c700 1 --2- 172.21.15.40:0/1151145246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8848138250 0x7f8848123330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.570+0000 7f884659c700 1 -- 172.21.15.40:0/1151145246 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8838009550 con 0x7f884809d400 2023-09-30T22:27:45.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.570+0000 7f884659c700 1 --2- 172.21.15.40:0/1151145246 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f884809d400 0x7f88481228b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f884809f4d0 tx=0x7f8838004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:45.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.570+0000 7f6fcfd11700 1 -- start start 2023-09-30T22:27:45.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.570+0000 7f6fcfd11700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6fc813b130 0x7f6fc813d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.570+0000 7f6fcfd11700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6fc813da50 0x7f6fc813fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.570+0000 7f8836ffd700 1 -- 172.21.15.40:0/1151145246 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8838004450 con 0x7f884809d400 2023-09-30T22:27:45.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.570+0000 7f8836ffd700 1 -- 172.21.15.40:0/1151145246 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88380036a0 con 0x7f884809d400 2023-09-30T22:27:45.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.570+0000 7f8836ffd700 1 -- 172.21.15.40:0/1151145246 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88380045f0 con 0x7f884809d400 2023-09-30T22:27:45.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.571+0000 7f884ca4e700 1 -- 172.21.15.40:0/1151145246 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88480a11c0 con 0x7f884809d400 2023-09-30T22:27:45.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.571+0000 7f884ca4e700 1 -- 172.21.15.40:0/1151145246 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8848125950 con 0x7f884809d400 2023-09-30T22:27:45.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.571+0000 7f6fcfd11700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fc8137e20 con 0x7f6fc8138250 2023-09-30T22:27:45.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.571+0000 7f6fcfd11700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc8138d30 con 0x7f6fc813da50 2023-09-30T22:27:45.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.571+0000 7f6fcfd11700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc8138050 con 0x7f6fc813b130 2023-09-30T22:27:45.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.571+0000 7f6fcdaad700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6fc8138250 0x7f6fc8138620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57188/0 (socket says 172.21.15.40:57188) 2023-09-30T22:27:45.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.571+0000 7f6fcdaad700 1 -- 172.21.15.40:0/2402347206 learned_addr learned my addr 172.21.15.40:0/2402347206 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:27:45.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.571+0000 7f6fce2ae700 1 --2- 172.21.15.40:0/2402347206 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6fc813da50 0x7f6fc813fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:45.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.571+0000 7f6fcd2ac700 1 --2- 172.21.15.40:0/2402347206 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6fc813b130 0x7f6fc813d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:45.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.571+0000 7f6fce2ae700 1 -- 172.21.15.40:0/2402347206 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6fc813b130 msgr2=0x7f6fc813d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:45.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.571+0000 7f6fce2ae700 1 --2- 172.21.15.40:0/2402347206 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6fc813b130 0x7f6fc813d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.571+0000 7f6fce2ae700 1 -- 172.21.15.40:0/2402347206 >> v1:172.21.15.40:6789/0 conn(0x7f6fc8138250 legacy=0x7f6fc8138620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:45.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.571+0000 7f6fce2ae700 1 -- 172.21.15.40:0/2402347206 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc809b010 con 0x7f6fc813da50 2023-09-30T22:27:45.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.572+0000 7f8836ffd700 1 -- 172.21.15.40:0/1151145246 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8838003a50 con 0x7f884809d400 2023-09-30T22:27:45.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.572+0000 7f6fce2ae700 1 --2- 172.21.15.40:0/2402347206 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6fc813da50 0x7f6fc813fe30 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0009dc0 tx=0x7f6fc000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=660663d7c2f1d3b0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:45.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.572+0000 7f884ca4e700 1 -- 172.21.15.40:0/1151145246 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f882c0052e0 con 0x7f884809d400 2023-09-30T22:27:45.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.572+0000 7f8836ffd700 1 -- 172.21.15.40:0/1151145246 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f8838040e00 con 0x7f884809d400 2023-09-30T22:27:45.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.572+0000 7f6fccaab700 1 -- 172.21.15.40:0/2402347206 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc000e070 con 0x7f6fc813da50 2023-09-30T22:27:45.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.572+0000 7f6fccaab700 1 -- 172.21.15.40:0/2402347206 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc000bad0 con 0x7f6fc813da50 2023-09-30T22:27:45.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.572+0000 7f6fccaab700 1 -- 172.21.15.40:0/2402347206 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc000be80 con 0x7f6fc813da50 2023-09-30T22:27:45.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.573+0000 7f6fcfd11700 1 -- 172.21.15.40:0/2402347206 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6fc813da50 msgr2=0x7f6fc813fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:45.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.573+0000 7f6fcfd11700 1 --2- 172.21.15.40:0/2402347206 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6fc813da50 0x7f6fc813fe30 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0009dc0 tx=0x7f6fc000b330 comp rx=0 tx=0).stop 2023-09-30T22:27:45.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.574+0000 7f6fcfd11700 1 -- 172.21.15.40:0/2402347206 shutdown_connections 2023-09-30T22:27:45.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.574+0000 7f6fcfd11700 1 --2- 172.21.15.40:0/2402347206 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6fc813da50 0x7f6fc813fe30 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.574+0000 7f6fcfd11700 1 --2- 172.21.15.40:0/2402347206 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6fc813b130 0x7f6fc813d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.574+0000 7f6fcfd11700 1 -- 172.21.15.40:0/2402347206 >> 172.21.15.40:0/2402347206 conn(0x7f6fc80a2a00 msgr2=0x7f6fc80a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:45.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.574+0000 7f6fcfd11700 1 -- 172.21.15.40:0/2402347206 shutdown_connections 2023-09-30T22:27:45.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.574+0000 7f6fcfd11700 1 -- 172.21.15.40:0/2402347206 wait complete. 2023-09-30T22:27:45.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.575+0000 7f6fcfd11700 1 Processor -- start 2023-09-30T22:27:45.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.575+0000 7f6fcfd11700 1 -- start start 2023-09-30T22:27:45.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.575+0000 7f6fcfd11700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fc8138250 0x7f6fc806f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.575+0000 7f6fcfd11700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6fc813b130 0x7f6fc806fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.575+0000 7f6fcfd11700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6fc813da50 0x7f6fc8070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.575+0000 7f6fcfd11700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc8122980 con 0x7f6fc8138250 2023-09-30T22:27:45.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.575+0000 7f6fcfd11700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc809a300 con 0x7f6fc813da50 2023-09-30T22:27:45.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.575+0000 7f6fcfd11700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc8122ea0 con 0x7f6fc813b130 2023-09-30T22:27:45.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.575+0000 7f6fcd2ac700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6fc813b130 0x7f6fc806fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:45.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.575+0000 7f6fcd2ac700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6fc813b130 0x7f6fc806fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:34898/0 (socket says 172.21.15.40:34898) 2023-09-30T22:27:45.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.575+0000 7f6fcd2ac700 1 -- 172.21.15.40:0/3417820252 learned_addr learned my addr 172.21.15.40:0/3417820252 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:45.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.576+0000 7f6fcdaad700 1 --2- 172.21.15.40:0/3417820252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fc8138250 0x7f6fc806f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:45.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.576+0000 7f6fcd2ac700 1 -- 172.21.15.40:0/3417820252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6fc813da50 msgr2=0x7f6fc8070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:45.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.576+0000 7f6fcd2ac700 1 --2- 172.21.15.40:0/3417820252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6fc813da50 0x7f6fc8070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.576+0000 7f6fcd2ac700 1 -- 172.21.15.40:0/3417820252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fc8138250 msgr2=0x7f6fc806f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:45.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.576+0000 7f6fcd2ac700 1 --2- 172.21.15.40:0/3417820252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fc8138250 0x7f6fc806f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.576+0000 7f6fcd2ac700 1 -- 172.21.15.40:0/3417820252 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc0009a70 con 0x7f6fc813b130 2023-09-30T22:27:45.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.576+0000 7f6fcdaad700 1 --2- 172.21.15.40:0/3417820252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fc8138250 0x7f6fc806f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:27:45.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.576+0000 7f6fcd2ac700 1 --2- 172.21.15.40:0/3417820252 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6fc813b130 0x7f6fc806fb40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6fb800e810 tx=0x7f6fb800ebd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:45.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.577+0000 7f6fbe7fc700 1 -- 172.21.15.40:0/3417820252 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb8013610 con 0x7f6fc813b130 2023-09-30T22:27:45.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.577+0000 7f6fbe7fc700 1 -- 172.21.15.40:0/3417820252 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb8013770 con 0x7f6fc813b130 2023-09-30T22:27:45.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.577+0000 7f6fbe7fc700 1 -- 172.21.15.40:0/3417820252 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb8013b20 con 0x7f6fc813b130 2023-09-30T22:27:45.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.577+0000 7f8836ffd700 1 -- 172.21.15.40:0/1151145246 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8838015070 con 0x7f884809d400 2023-09-30T22:27:45.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.578+0000 7f6fcfd11700 1 -- 172.21.15.40:0/3417820252 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc809c680 con 0x7f6fc813b130 2023-09-30T22:27:45.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.578+0000 7f6fcfd11700 1 -- 172.21.15.40:0/3417820252 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc8123910 con 0x7f6fc813b130 2023-09-30T22:27:45.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.579+0000 7f6fcfd11700 1 -- 172.21.15.40:0/3417820252 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fc8062380 con 0x7f6fc813b130 2023-09-30T22:27:45.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.581+0000 7f6fbe7fc700 1 -- 172.21.15.40:0/3417820252 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6fb8013c80 con 0x7f6fc813b130 2023-09-30T22:27:45.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.581+0000 7f6fbe7fc700 1 -- 172.21.15.40:0/3417820252 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6fb803f900 con 0x7f6fc813b130 2023-09-30T22:27:45.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.585+0000 7f6fbe7fc700 1 -- 172.21.15.40:0/3417820252 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6fb8026430 con 0x7f6fc813b130 2023-09-30T22:27:45.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.606+0000 7effa2bca700 1 Processor -- start 2023-09-30T22:27:45.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.606+0000 7effa2bca700 1 -- start start 2023-09-30T22:27:45.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.606+0000 7effa2bca700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7eff9c06f070 0x7eff9c06f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.606+0000 7effa2bca700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7eff9c06f980 0x7eff9c097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.606+0000 7effa2bca700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff9c06fdb0 0x7eff9c0975d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.606+0000 7effa2bca700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff9c070830 con 0x7eff9c06f070 2023-09-30T22:27:45.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.606+0000 7effa2bca700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c070ad0 con 0x7eff9c06f980 2023-09-30T22:27:45.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.606+0000 7effa2bca700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c070de0 con 0x7eff9c06fdb0 2023-09-30T22:27:45.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.606+0000 7effa0966700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7eff9c06f070 0x7eff9c06f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:45.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.607+0000 7effa0966700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7eff9c06f070 0x7eff9c06f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51462/0 (socket says 172.21.15.40:51462) 2023-09-30T22:27:45.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.607+0000 7effa0966700 1 -- 172.21.15.40:0/3128396694 learned_addr learned my addr 172.21.15.40:0/3128396694 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:45.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.607+0000 7eff9bfff700 1 --2- 172.21.15.40:0/3128396694 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7eff9c06f980 0x7eff9c097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:45.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.607+0000 7effa0966700 1 -- 172.21.15.40:0/3128396694 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff9c06fdb0 msgr2=0x7eff9c0975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:45.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.607+0000 7effa0966700 1 --2- 172.21.15.40:0/3128396694 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff9c06fdb0 0x7eff9c0975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.607+0000 7effa0966700 1 -- 172.21.15.40:0/3128396694 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7eff9c06f980 msgr2=0x7eff9c097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:45.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.607+0000 7effa0966700 1 --2- 172.21.15.40:0/3128396694 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7eff9c06f980 0x7eff9c097090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.607+0000 7effa0966700 1 -- 172.21.15.40:0/3128396694 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9c09fe20 con 0x7eff9c06f070 2023-09-30T22:27:45.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.607+0000 7effa0966700 1 --2- 172.21.15.40:0/3128396694 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff9c06f070 0x7eff9c06f440 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7eff900098f0 tx=0x7eff90009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abbaf6e25063c0ab server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:45.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.607+0000 7eff9b7fe700 1 -- 172.21.15.40:0/3128396694 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9000b8a0 con 0x7eff9c06f070 2023-09-30T22:27:45.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.607+0000 7eff9b7fe700 1 -- 172.21.15.40:0/3128396694 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9000ba00 con 0x7eff9c06f070 2023-09-30T22:27:45.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.607+0000 7eff9b7fe700 1 -- 172.21.15.40:0/3128396694 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9000bd90 con 0x7eff9c06f070 2023-09-30T22:27:45.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.608+0000 7effa2bca700 1 -- 172.21.15.40:0/3128396694 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff9c06f070 msgr2=0x7eff9c06f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:45.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.608+0000 7effa2bca700 1 --2- 172.21.15.40:0/3128396694 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff9c06f070 0x7eff9c06f440 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7eff900098f0 tx=0x7eff90009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:45.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.608+0000 7effa2bca700 1 -- 172.21.15.40:0/3128396694 shutdown_connections 2023-09-30T22:27:45.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.608+0000 7effa2bca700 1 --2- 172.21.15.40:0/3128396694 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff9c06fdb0 0x7eff9c0975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.608+0000 7effa2bca700 1 --2- 172.21.15.40:0/3128396694 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff9c06f070 0x7eff9c06f440 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.608+0000 7effa2bca700 1 --2- 172.21.15.40:0/3128396694 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7eff9c06f980 0x7eff9c097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.608+0000 7effa2bca700 1 -- 172.21.15.40:0/3128396694 >> 172.21.15.40:0/3128396694 conn(0x7eff9c0a41a0 msgr2=0x7eff9c0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:45.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.608+0000 7effa2bca700 1 -- 172.21.15.40:0/3128396694 shutdown_connections 2023-09-30T22:27:45.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.608+0000 7effa2bca700 1 -- 172.21.15.40:0/3128396694 wait complete. 2023-09-30T22:27:45.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.609+0000 7effa2bca700 1 Processor -- start 2023-09-30T22:27:45.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.609+0000 7effa2bca700 1 -- start start 2023-09-30T22:27:45.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.610+0000 7effa2bca700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff9c06f070 0x7eff9c06c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.610+0000 7effa2bca700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff9c06f980 0x7eff9c06ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.610+0000 7effa2bca700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7eff9c06fdb0 0x7eff9c06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.610+0000 7effa2bca700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c1320b0 con 0x7eff9c06f070 2023-09-30T22:27:45.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.610+0000 7effa2bca700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c06e2f0 con 0x7eff9c06fdb0 2023-09-30T22:27:45.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.610+0000 7effa2bca700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c06e040 con 0x7eff9c06f980 2023-09-30T22:27:45.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.610+0000 7eff9bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff9c06f980 0x7eff9c06ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:45.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.610+0000 7effa0966700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff9c06f070 0x7eff9c06c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:45.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.610+0000 7eff9bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff9c06f980 0x7eff9c06ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:34910/0 (socket says 172.21.15.40:34910) 2023-09-30T22:27:45.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.610+0000 7eff9bfff700 1 -- 172.21.15.40:0/1887432388 learned_addr learned my addr 172.21.15.40:0/1887432388 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:45.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.610+0000 7effa1167700 1 --2- 172.21.15.40:0/1887432388 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7eff9c06fdb0 0x7eff9c06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:45.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.611+0000 7effa0966700 1 -- 172.21.15.40:0/1887432388 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff9c06f980 msgr2=0x7eff9c06ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:45.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.611+0000 7effa0966700 1 --2- 172.21.15.40:0/1887432388 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff9c06f980 0x7eff9c06ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.611+0000 7effa0966700 1 -- 172.21.15.40:0/1887432388 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7eff9c06fdb0 msgr2=0x7eff9c06d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:45.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.611+0000 7effa0966700 1 --2- 172.21.15.40:0/1887432388 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7eff9c06fdb0 0x7eff9c06d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.611+0000 7effa0966700 1 -- 172.21.15.40:0/1887432388 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff90009550 con 0x7eff9c06f070 2023-09-30T22:27:45.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.611+0000 7effa0966700 1 --2- 172.21.15.40:0/1887432388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff9c06f070 0x7eff9c06c990 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7eff90016000 tx=0x7eff90004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:45.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.611+0000 7eff997fa700 1 -- 172.21.15.40:0/1887432388 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff900044d0 con 0x7eff9c06f070 2023-09-30T22:27:45.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.611+0000 7eff997fa700 1 -- 172.21.15.40:0/1887432388 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9001f070 con 0x7eff9c06f070 2023-09-30T22:27:45.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.611+0000 7effa2bca700 1 -- 172.21.15.40:0/1887432388 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff9c08b430 con 0x7eff9c06f070 2023-09-30T22:27:45.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.611+0000 7eff997fa700 1 -- 172.21.15.40:0/1887432388 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff900038e0 con 0x7eff9c06f070 2023-09-30T22:27:45.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.611+0000 7effa2bca700 1 -- 172.21.15.40:0/1887432388 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff9c12c2d0 con 0x7eff9c06f070 2023-09-30T22:27:45.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.612+0000 7eff997fa700 1 -- 172.21.15.40:0/1887432388 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7eff90003a40 con 0x7eff9c06f070 2023-09-30T22:27:45.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.612+0000 7eff997fa700 1 -- 172.21.15.40:0/1887432388 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7eff90021070 con 0x7eff9c06f070 2023-09-30T22:27:45.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.612+0000 7effa2bca700 1 -- 172.21.15.40:0/1887432388 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff9c06e6b0 con 0x7eff9c06f070 2023-09-30T22:27:45.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.619+0000 7eff997fa700 1 -- 172.21.15.40:0/1887432388 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7eff90015020 con 0x7eff9c06f070 2023-09-30T22:27:45.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.654+0000 7f508b1a9700 1 -- 172.21.15.40:0/884558156 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5084074720 con 0x7f5084133ca0 2023-09-30T22:27:45.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.655+0000 7f50817fa700 1 -- 172.21.15.40:0/884558156 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f50700199a0 con 0x7f5084133ca0 2023-09-30T22:27:45.656 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:45.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.657+0000 7f508b1a9700 1 -- 172.21.15.40:0/884558156 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5084133ca0 msgr2=0x7f508411e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:45.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.657+0000 7f508b1a9700 1 --2- 172.21.15.40:0/884558156 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5084133ca0 0x7f508411e860 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5070011db0 tx=0x7f5070004750 comp rx=0 tx=0).stop 2023-09-30T22:27:45.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.657+0000 7f508b1a9700 1 -- 172.21.15.40:0/884558156 shutdown_connections 2023-09-30T22:27:45.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.657+0000 7f508b1a9700 1 --2- 172.21.15.40:0/884558156 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5084131710 0x7f508411eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.657+0000 7f508b1a9700 1 --2- 172.21.15.40:0/884558156 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f508409d920 0x7f508411e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.657+0000 7f508b1a9700 1 --2- 172.21.15.40:0/884558156 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5084133ca0 0x7f508411e860 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.657+0000 7f508b1a9700 1 -- 172.21.15.40:0/884558156 >> 172.21.15.40:0/884558156 conn(0x7f508409fb20 msgr2=0x7f50841333d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:45.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.657+0000 7f508b1a9700 1 -- 172.21.15.40:0/884558156 shutdown_connections 2023-09-30T22:27:45.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.657+0000 7f508b1a9700 1 -- 172.21.15.40:0/884558156 wait complete. 2023-09-30T22:27:45.671 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:45.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.821+0000 7effa2bca700 1 -- 172.21.15.40:0/1887432388 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7eff9c06dba0 con 0x7eff9c06f070 2023-09-30T22:27:45.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.821+0000 7eff997fa700 1 -- 172.21.15.40:0/1887432388 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7eff90026480 con 0x7eff9c06f070 2023-09-30T22:27:45.822 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:45.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.823+0000 7f884ca4e700 1 -- 172.21.15.40:0/1151145246 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f882c005590 con 0x7f884809d400 2023-09-30T22:27:45.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.823+0000 7f8836ffd700 1 -- 172.21.15.40:0/1151145246 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8838003d00 con 0x7f884809d400 2023-09-30T22:27:45.824 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:45.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.824+0000 7effa2bca700 1 -- 172.21.15.40:0/1887432388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff9c06f070 msgr2=0x7eff9c06c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:45.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.824+0000 7effa2bca700 1 --2- 172.21.15.40:0/1887432388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff9c06f070 0x7eff9c06c990 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7eff90016000 tx=0x7eff90004750 comp rx=0 tx=0).stop 2023-09-30T22:27:45.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.824+0000 7effa2bca700 1 -- 172.21.15.40:0/1887432388 shutdown_connections 2023-09-30T22:27:45.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.824+0000 7effa2bca700 1 --2- 172.21.15.40:0/1887432388 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7eff9c06fdb0 0x7eff9c06d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.824+0000 7effa2bca700 1 --2- 172.21.15.40:0/1887432388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff9c06f070 0x7eff9c06c990 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.824+0000 7effa2bca700 1 --2- 172.21.15.40:0/1887432388 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff9c06f980 0x7eff9c06ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.824+0000 7effa2bca700 1 -- 172.21.15.40:0/1887432388 >> 172.21.15.40:0/1887432388 conn(0x7eff9c0a41a0 msgr2=0x7eff9c097310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:45.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.824+0000 7effa2bca700 1 -- 172.21.15.40:0/1887432388 shutdown_connections 2023-09-30T22:27:45.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.824+0000 7effa2bca700 1 -- 172.21.15.40:0/1887432388 wait complete. 2023-09-30T22:27:45.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.826+0000 7f884ca4e700 1 -- 172.21.15.40:0/1151145246 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f884809d400 msgr2=0x7f88481228b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:45.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.826+0000 7f884ca4e700 1 --2- 172.21.15.40:0/1151145246 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f884809d400 0x7f88481228b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f884809f4d0 tx=0x7f8838004750 comp rx=0 tx=0).stop 2023-09-30T22:27:45.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.826+0000 7f884ca4e700 1 -- 172.21.15.40:0/1151145246 shutdown_connections 2023-09-30T22:27:45.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.826+0000 7f884ca4e700 1 --2- 172.21.15.40:0/1151145246 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f884809d400 0x7f88481228b0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.826+0000 7f884ca4e700 1 --2- 172.21.15.40:0/1151145246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8848138250 0x7f8848123330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.826+0000 7f884ca4e700 1 --2- 172.21.15.40:0/1151145246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f884809dd50 0x7f8848122df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.826+0000 7f884ca4e700 1 -- 172.21.15.40:0/1151145246 >> 172.21.15.40:0/1151145246 conn(0x7f88480a2a00 msgr2=0x7f88481bf750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:45.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.826+0000 7f884ca4e700 1 -- 172.21.15.40:0/1151145246 shutdown_connections 2023-09-30T22:27:45.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.826+0000 7f884ca4e700 1 -- 172.21.15.40:0/1151145246 wait complete. 2023-09-30T22:27:45.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.830+0000 7f6fcfd11700 1 -- 172.21.15.40:0/3417820252 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6fc8122af0 con 0x7f6fc813b130 2023-09-30T22:27:45.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.830+0000 7f6fbe7fc700 1 -- 172.21.15.40:0/3417820252 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6fb8021070 con 0x7f6fc813b130 2023-09-30T22:27:45.831 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:45.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.833+0000 7f6fcfd11700 1 -- 172.21.15.40:0/3417820252 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6fc813b130 msgr2=0x7f6fc806fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:45.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.833+0000 7f6fcfd11700 1 --2- 172.21.15.40:0/3417820252 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6fc813b130 0x7f6fc806fb40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6fb800e810 tx=0x7f6fb800ebd0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.833+0000 7f6fcfd11700 1 -- 172.21.15.40:0/3417820252 shutdown_connections 2023-09-30T22:27:45.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.833+0000 7f6fcfd11700 1 --2- 172.21.15.40:0/3417820252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6fc813da50 0x7f6fc8070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.833+0000 7f6fcfd11700 1 --2- 172.21.15.40:0/3417820252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fc8138250 0x7f6fc806f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.833+0000 7f6fcfd11700 1 --2- 172.21.15.40:0/3417820252 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6fc813b130 0x7f6fc806fb40 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.833+0000 7f6fcfd11700 1 -- 172.21.15.40:0/3417820252 >> 172.21.15.40:0/3417820252 conn(0x7f6fc80a2a00 msgr2=0x7f6fc809d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:45.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.833+0000 7f6fcfd11700 1 -- 172.21.15.40:0/3417820252 shutdown_connections 2023-09-30T22:27:45.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:45.833+0000 7f6fcfd11700 1 -- 172.21.15.40:0/3417820252 wait complete. 2023-09-30T22:27:45.844 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:45.846 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:45.847 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:46.671 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:46.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.812+0000 7fdefcfb3700 1 Processor -- start 2023-09-30T22:27:46.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.812+0000 7fdefcfb3700 1 -- start start 2023-09-30T22:27:46.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.812+0000 7fdefcfb3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdef8130c00 0x7fdef8130fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:46.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.812+0000 7fdefcfb3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdef8130570 0x7fdef809a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:46.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.813+0000 7fdefcfb3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdef809ba60 con 0x7fdef809ab60 2023-09-30T22:27:46.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.813+0000 7fdefcfb3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef809df10 con 0x7fdef8130c00 2023-09-30T22:27:46.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.813+0000 7fdefcfb3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdef8131510 con 0x7fdef8130570 2023-09-30T22:27:46.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.813+0000 7fdef659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdef8130c00 0x7fdef8130fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:46.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.813+0000 7fdef5d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdef8130570 0x7fdef809a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:46.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.813+0000 7fdef6d9d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fdef809ab60 0x7fdef8137900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57204/0 (socket says 172.21.15.40:57204) 2023-09-30T22:27:46.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.813+0000 7fdef6d9d700 1 -- 172.21.15.40:0/3848878862 learned_addr learned my addr 172.21.15.40:0/3848878862 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:27:46.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.813+0000 7fdef659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdef8130c00 0x7fdef8130fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41262/0 (socket says 172.21.15.40:41262) 2023-09-30T22:27:46.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.813+0000 7fdef5d9b700 1 -- 172.21.15.40:0/3848878862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdef8130c00 msgr2=0x7fdef8130fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:46.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.813+0000 7fdef5d9b700 1 --2- 172.21.15.40:0/3848878862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdef8130c00 0x7fdef8130fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:46.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.813+0000 7fdef559a700 1 -- 172.21.15.40:0/3848878862 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 702860813 0 0) 0x7fdef809ba60 con 0x7fdef809ab60 2023-09-30T22:27:46.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.813+0000 7fdef5d9b700 1 -- 172.21.15.40:0/3848878862 >> v1:172.21.15.40:6789/0 conn(0x7fdef809ab60 legacy=0x7fdef8137900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:46.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.813+0000 7fdef5d9b700 1 -- 172.21.15.40:0/3848878862 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef8130a00 con 0x7fdef8130570 2023-09-30T22:27:46.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.813+0000 7fdef659c700 1 --2- 172.21.15.40:0/3848878862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdef8130c00 0x7fdef8130fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:46.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.813+0000 7fdef5d9b700 1 --2- 172.21.15.40:0/3848878862 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdef8130570 0x7fdef809a620 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fdee8009870 tx=0x7fdee8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9006ed67ad7ef5b2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:46.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.813+0000 7fdef559a700 1 -- 172.21.15.40:0/3848878862 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee8011830 con 0x7fdef8130570 2023-09-30T22:27:46.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.813+0000 7fdef559a700 1 -- 172.21.15.40:0/3848878862 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee8011990 con 0x7fdef8130570 2023-09-30T22:27:46.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.813+0000 7fdef559a700 1 -- 172.21.15.40:0/3848878862 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee8011d20 con 0x7fdef8130570 2023-09-30T22:27:46.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.814+0000 7fdefcfb3700 1 -- 172.21.15.40:0/3848878862 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdef8130570 msgr2=0x7fdef809a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:46.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.814+0000 7fdefcfb3700 1 --2- 172.21.15.40:0/3848878862 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdef8130570 0x7fdef809a620 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fdee8009870 tx=0x7fdee8009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:46.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.814+0000 7fdefcfb3700 1 -- 172.21.15.40:0/3848878862 shutdown_connections 2023-09-30T22:27:46.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.814+0000 7fdefcfb3700 1 --2- 172.21.15.40:0/3848878862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdef8130c00 0x7fdef8130fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:46.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.814+0000 7fdefcfb3700 1 --2- 172.21.15.40:0/3848878862 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdef8130570 0x7fdef809a620 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:46.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.814+0000 7fdefcfb3700 1 -- 172.21.15.40:0/3848878862 >> 172.21.15.40:0/3848878862 conn(0x7fdef809eb10 msgr2=0x7fdef809ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:46.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.814+0000 7fdefcfb3700 1 -- 172.21.15.40:0/3848878862 shutdown_connections 2023-09-30T22:27:46.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.814+0000 7fdefcfb3700 1 -- 172.21.15.40:0/3848878862 wait complete. 2023-09-30T22:27:46.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.815+0000 7fdefcfb3700 1 Processor -- start 2023-09-30T22:27:46.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.815+0000 7fdefcfb3700 1 -- start start 2023-09-30T22:27:46.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.816+0000 7fdefcfb3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdef809ab60 0x7fdef808afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:46.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.816+0000 7fdefcfb3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdef8130570 0x7fdef808b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:46.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.816+0000 7fdefcfb3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdef8130c00 0x7fdef808ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:46.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.816+0000 7fdefcfb3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef812e070 con 0x7fdef8130570 2023-09-30T22:27:46.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.816+0000 7fdefcfb3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef809d630 con 0x7fdef809ab60 2023-09-30T22:27:46.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.816+0000 7fdefcfb3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdef808e690 con 0x7fdef8130c00 2023-09-30T22:27:46.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.816+0000 7fdef659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdef809ab60 0x7fdef808afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:46.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.816+0000 7fdef659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdef809ab60 0x7fdef808afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41270/0 (socket says 172.21.15.40:41270) 2023-09-30T22:27:46.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.816+0000 7fdef659c700 1 -- 172.21.15.40:0/691329908 learned_addr learned my addr 172.21.15.40:0/691329908 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:46.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.816+0000 7fdef6d9d700 1 --2- 172.21.15.40:0/691329908 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdef8130c00 0x7fdef808ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:46.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.816+0000 7fdef5d9b700 1 --2- 172.21.15.40:0/691329908 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdef8130570 0x7fdef808b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:46.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.816+0000 7fdef659c700 1 -- 172.21.15.40:0/691329908 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdef8130c00 msgr2=0x7fdef808ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:46.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.816+0000 7fdef659c700 1 --2- 172.21.15.40:0/691329908 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdef8130c00 0x7fdef808ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:46.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.816+0000 7fdef659c700 1 -- 172.21.15.40:0/691329908 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdef8130570 msgr2=0x7fdef808b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:46.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.816+0000 7fdef659c700 1 --2- 172.21.15.40:0/691329908 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdef8130570 0x7fdef808b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:46.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.816+0000 7fdef659c700 1 -- 172.21.15.40:0/691329908 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee000b6d0 con 0x7fdef809ab60 2023-09-30T22:27:46.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.816+0000 7fdef659c700 1 --2- 172.21.15.40:0/691329908 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdef809ab60 0x7fdef808afd0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fdee000ec90 tx=0x7fdee000d350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:46.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.816+0000 7fdeeeffd700 1 -- 172.21.15.40:0/691329908 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee000dd80 con 0x7fdef809ab60 2023-09-30T22:27:46.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.816+0000 7fdeeeffd700 1 -- 172.21.15.40:0/691329908 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee0005a20 con 0x7fdef809ab60 2023-09-30T22:27:46.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.816+0000 7fdefcfb3700 1 -- 172.21.15.40:0/691329908 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdee80094a0 con 0x7fdef809ab60 2023-09-30T22:27:46.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.816+0000 7fdeeeffd700 1 -- 172.21.15.40:0/691329908 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee0005d90 con 0x7fdef809ab60 2023-09-30T22:27:46.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.817+0000 7fdefcfb3700 1 -- 172.21.15.40:0/691329908 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdef809bc10 con 0x7fdef809ab60 2023-09-30T22:27:46.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.817+0000 7fdeeeffd700 1 -- 172.21.15.40:0/691329908 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdee0006030 con 0x7fdef809ab60 2023-09-30T22:27:46.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.817+0000 7fdeeeffd700 1 -- 172.21.15.40:0/691329908 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fdee003fc40 con 0x7fdef809ab60 2023-09-30T22:27:46.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.818+0000 7fdefcfb3700 1 -- 172.21.15.40:0/691329908 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdef8098c80 con 0x7fdef809ab60 2023-09-30T22:27:46.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.822+0000 7fdeeeffd700 1 -- 172.21.15.40:0/691329908 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdee001f8f0 con 0x7fdef809ab60 2023-09-30T22:27:46.845 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:46.846 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:46.847 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:46.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.980+0000 7f4466c10700 1 Processor -- start 2023-09-30T22:27:46.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.980+0000 7f4466c10700 1 -- start start 2023-09-30T22:27:46.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.981+0000 7f4466c10700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f446009c890 0x7f446009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:46.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.981+0000 7f4466c10700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f446009d920 0x7f446009dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:46.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.981+0000 7f4466c10700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44600a2600 con 0x7f446009e2b0 2023-09-30T22:27:46.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.981+0000 7f4466c10700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44600a29d0 con 0x7f446009c890 2023-09-30T22:27:46.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.981+0000 7f4466c10700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446009fb40 con 0x7f446009d920 2023-09-30T22:27:46.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.981+0000 7f44649ac700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f446009c890 0x7f446009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:46.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.981+0000 7f44649ac700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f446009c890 0x7f446009cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51494/0 (socket says 172.21.15.40:51494) 2023-09-30T22:27:46.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.981+0000 7f44649ac700 1 -- 172.21.15.40:0/2150724144 learned_addr learned my addr 172.21.15.40:0/2150724144 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:46.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.981+0000 7f445ffff700 1 --2- 172.21.15.40:0/2150724144 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f446009d920 0x7f446009dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:46.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.981+0000 7f445ffff700 1 -- 172.21.15.40:0/2150724144 >> v2:172.21.15.40:3300/0 conn(0x7f446009c890 msgr2=0x7f446009cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:46.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.981+0000 7f445ffff700 1 --2- 172.21.15.40:0/2150724144 >> v2:172.21.15.40:3300/0 conn(0x7f446009c890 0x7f446009cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:46.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.981+0000 7f445ffff700 1 -- 172.21.15.40:0/2150724144 >> v1:172.21.15.40:6789/0 conn(0x7f446009e2b0 legacy=0x7f446013ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:46.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.981+0000 7f445ffff700 1 -- 172.21.15.40:0/2150724144 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446009e730 con 0x7f446009d920 2023-09-30T22:27:46.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.981+0000 7f445ffff700 1 --2- 172.21.15.40:0/2150724144 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f446009d920 0x7f446009dd70 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f444c009840 tx=0x7f444c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e506ccb42ebb0517 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:46.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.982+0000 7f445f7fe700 1 -- 172.21.15.40:0/2150724144 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c011830 con 0x7f446009d920 2023-09-30T22:27:46.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.982+0000 7f445f7fe700 1 -- 172.21.15.40:0/2150724144 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444c011990 con 0x7f446009d920 2023-09-30T22:27:46.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.982+0000 7f445f7fe700 1 -- 172.21.15.40:0/2150724144 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c011d20 con 0x7f446009d920 2023-09-30T22:27:46.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.982+0000 7f4466c10700 1 -- 172.21.15.40:0/2150724144 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f446009d920 msgr2=0x7f446009dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:46.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.982+0000 7f4466c10700 1 --2- 172.21.15.40:0/2150724144 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f446009d920 0x7f446009dd70 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f444c009840 tx=0x7f444c009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:46.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.982+0000 7f4466c10700 1 -- 172.21.15.40:0/2150724144 shutdown_connections 2023-09-30T22:27:46.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.982+0000 7f4466c10700 1 --2- 172.21.15.40:0/2150724144 >> v2:172.21.15.40:3300/0 conn(0x7f446009c890 0x7f446009cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:46.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.982+0000 7f4466c10700 1 --2- 172.21.15.40:0/2150724144 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f446009d920 0x7f446009dd70 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:46.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.982+0000 7f4466c10700 1 -- 172.21.15.40:0/2150724144 >> 172.21.15.40:0/2150724144 conn(0x7f44600a7080 msgr2=0x7f44600a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:46.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.983+0000 7f4466c10700 1 -- 172.21.15.40:0/2150724144 shutdown_connections 2023-09-30T22:27:46.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.983+0000 7f4466c10700 1 -- 172.21.15.40:0/2150724144 wait complete. 2023-09-30T22:27:46.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.984+0000 7f4466c10700 1 Processor -- start 2023-09-30T22:27:46.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.984+0000 7f4466c10700 1 -- start start 2023-09-30T22:27:46.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.985+0000 7f4466c10700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f446009c890 0x7f446012d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:46.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.985+0000 7f4466c10700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f446009d920 0x7f446012db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:46.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.985+0000 7f4466c10700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f446009e2b0 0x7f446012e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:46.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.985+0000 7f4466c10700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4460130c00 con 0x7f446009d920 2023-09-30T22:27:46.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.985+0000 7f4466c10700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446009c460 con 0x7f446009c890 2023-09-30T22:27:46.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.985+0000 7f4466c10700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44600a5d00 con 0x7f446009e2b0 2023-09-30T22:27:46.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.985+0000 7f445ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f446009d920 0x7f446012db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:46.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.985+0000 7f445ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f446009d920 0x7f446012db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51500/0 (socket says 172.21.15.40:51500) 2023-09-30T22:27:46.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.985+0000 7f445ffff700 1 -- 172.21.15.40:0/957084517 learned_addr learned my addr 172.21.15.40:0/957084517 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:46.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.985+0000 7f44649ac700 1 --2- 172.21.15.40:0/957084517 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f446009c890 0x7f446012d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:46.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.985+0000 7f44651ad700 1 --2- 172.21.15.40:0/957084517 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f446009e2b0 0x7f446012e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:46.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.985+0000 7f445ffff700 1 -- 172.21.15.40:0/957084517 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f446009e2b0 msgr2=0x7f446012e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:46.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.985+0000 7f445ffff700 1 --2- 172.21.15.40:0/957084517 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f446009e2b0 0x7f446012e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:46.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.985+0000 7f445ffff700 1 -- 172.21.15.40:0/957084517 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f446009c890 msgr2=0x7f446012d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:46.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.985+0000 7f445ffff700 1 --2- 172.21.15.40:0/957084517 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f446009c890 0x7f446012d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:46.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.985+0000 7f445ffff700 1 -- 172.21.15.40:0/957084517 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444c0094a0 con 0x7f446009d920 2023-09-30T22:27:46.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.986+0000 7f445ffff700 1 --2- 172.21.15.40:0/957084517 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f446009d920 0x7f446012db60 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f444c009fd0 tx=0x7f444c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:46.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.986+0000 7f445d7fa700 1 -- 172.21.15.40:0/957084517 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c004400 con 0x7f446009d920 2023-09-30T22:27:46.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.986+0000 7f445d7fa700 1 -- 172.21.15.40:0/957084517 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444c027070 con 0x7f446009d920 2023-09-30T22:27:46.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.986+0000 7f4466c10700 1 -- 172.21.15.40:0/957084517 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f446009ecf0 con 0x7f446009d920 2023-09-30T22:27:46.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.986+0000 7f445d7fa700 1 -- 172.21.15.40:0/957084517 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c0038c0 con 0x7f446009d920 2023-09-30T22:27:46.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.986+0000 7f4466c10700 1 -- 172.21.15.40:0/957084517 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f446012e5e0 con 0x7f446009d920 2023-09-30T22:27:46.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.987+0000 7f445d7fa700 1 -- 172.21.15.40:0/957084517 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f444c029030 con 0x7f446009d920 2023-09-30T22:27:46.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.987+0000 7f4466c10700 1 -- 172.21.15.40:0/957084517 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4460130180 con 0x7f446009d920 2023-09-30T22:27:46.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.987+0000 7f445d7fa700 1 -- 172.21.15.40:0/957084517 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f444c049680 con 0x7f446009d920 2023-09-30T22:27:46.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.989+0000 7f5e3b982700 1 Processor -- start 2023-09-30T22:27:46.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.990+0000 7f5e3b982700 1 -- start start 2023-09-30T22:27:46.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.990+0000 7f5e3b982700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e3412f070 0x7f5e34135c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:46.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.990+0000 7f5e3b982700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e34136170 0x7f5e34138550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:46.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.990+0000 7f5e3b982700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e3409ab70 con 0x7f5e3412e590 2023-09-30T22:27:46.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.990+0000 7f5e3b982700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3409b270 con 0x7f5e34136170 2023-09-30T22:27:46.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.990+0000 7f5e3b982700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3412f440 con 0x7f5e3412f070 2023-09-30T22:27:46.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.991+0000 7f5e39f1f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e34136170 0x7f5e34138550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:46.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.991+0000 7f5e39f1f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e34136170 0x7f5e34138550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41302/0 (socket says 172.21.15.40:41302) 2023-09-30T22:27:46.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.991+0000 7f5e39f1f700 1 -- 172.21.15.40:0/26100512 learned_addr learned my addr 172.21.15.40:0/26100512 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:46.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.991+0000 7f5e38f1d700 1 --2- 172.21.15.40:0/26100512 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e3412f070 0x7f5e34135c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:46.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.991+0000 7f5e38f1d700 1 -- 172.21.15.40:0/26100512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e34136170 msgr2=0x7f5e34138550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:46.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.991+0000 7f5e38f1d700 1 --2- 172.21.15.40:0/26100512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e34136170 0x7f5e34138550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:46.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.991+0000 7f5e38f1d700 1 -- 172.21.15.40:0/26100512 >> v1:172.21.15.40:6789/0 conn(0x7f5e3412e590 legacy=0x7f5e3412e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:46.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.991+0000 7f5e38f1d700 1 -- 172.21.15.40:0/26100512 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3409bd70 con 0x7f5e3412f070 2023-09-30T22:27:46.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.992+0000 7f5e38f1d700 1 --2- 172.21.15.40:0/26100512 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e3412f070 0x7f5e34135c30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5e24009870 tx=0x7f5e24009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f32ff5f3d6d28c4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:46.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.992+0000 7f5e2bfff700 1 -- 172.21.15.40:0/26100512 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e24004230 con 0x7f5e3412f070 2023-09-30T22:27:46.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.992+0000 7f5e2bfff700 1 -- 172.21.15.40:0/26100512 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e24004390 con 0x7f5e3412f070 2023-09-30T22:27:46.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.992+0000 7f5e2bfff700 1 -- 172.21.15.40:0/26100512 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e240036a0 con 0x7f5e3412f070 2023-09-30T22:27:46.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.992+0000 7f5e3b982700 1 -- 172.21.15.40:0/26100512 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e3412f070 msgr2=0x7f5e34135c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:46.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.992+0000 7f5e3b982700 1 --2- 172.21.15.40:0/26100512 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e3412f070 0x7f5e34135c30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5e24009870 tx=0x7f5e24009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:46.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.992+0000 7f5e3b982700 1 -- 172.21.15.40:0/26100512 shutdown_connections 2023-09-30T22:27:46.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.992+0000 7f5e3b982700 1 --2- 172.21.15.40:0/26100512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e34136170 0x7f5e34138550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:46.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.992+0000 7f5e3b982700 1 --2- 172.21.15.40:0/26100512 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e3412f070 0x7f5e34135c30 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:46.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.993+0000 7f5e3b982700 1 -- 172.21.15.40:0/26100512 >> 172.21.15.40:0/26100512 conn(0x7f5e340a2a00 msgr2=0x7f5e340a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:46.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.993+0000 7f5e3b982700 1 -- 172.21.15.40:0/26100512 shutdown_connections 2023-09-30T22:27:46.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.993+0000 7f5e3b982700 1 -- 172.21.15.40:0/26100512 wait complete. 2023-09-30T22:27:46.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.994+0000 7f5e3b982700 1 Processor -- start 2023-09-30T22:27:46.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.994+0000 7f5e3b982700 1 -- start start 2023-09-30T22:27:46.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.995+0000 7f5e3b982700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e3412e590 0x7f5e340704f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:46.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.995+0000 7f5e3b982700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e3412f070 0x7f5e3411b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:46.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.995+0000 7f5e3b982700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e34136170 0x7f5e3411bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:46.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.995+0000 7f5e3b982700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3412df10 con 0x7f5e34136170 2023-09-30T22:27:46.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.995+0000 7f5e3b982700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3411a990 con 0x7f5e3412e590 2023-09-30T22:27:46.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.995+0000 7f5e3b982700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e340a2710 con 0x7f5e3412f070 2023-09-30T22:27:46.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.995+0000 7f5e3971e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e3412e590 0x7f5e340704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:47.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.995+0000 7f5e3971e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e3412e590 0x7f5e340704f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41314/0 (socket says 172.21.15.40:41314) 2023-09-30T22:27:47.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.995+0000 7f5e3971e700 1 -- 172.21.15.40:0/50702113 learned_addr learned my addr 172.21.15.40:0/50702113 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:47.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.995+0000 7f5e39f1f700 1 --2- 172.21.15.40:0/50702113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e34136170 0x7f5e3411bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:47.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.995+0000 7f5e3971e700 1 -- 172.21.15.40:0/50702113 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e3412f070 msgr2=0x7f5e3411b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:47.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.995+0000 7f5e3971e700 1 --2- 172.21.15.40:0/50702113 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e3412f070 0x7f5e3411b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.995+0000 7f5e3971e700 1 -- 172.21.15.40:0/50702113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e34136170 msgr2=0x7f5e3411bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:47.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.995+0000 7f5e3971e700 1 --2- 172.21.15.40:0/50702113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e34136170 0x7f5e3411bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.995+0000 7f5e3971e700 1 -- 172.21.15.40:0/50702113 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e240094a0 con 0x7f5e3412e590 2023-09-30T22:27:47.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.996+0000 7f5e3971e700 1 --2- 172.21.15.40:0/50702113 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e3412e590 0x7f5e340704f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5e3000c4a0 tx=0x7f5e3000c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:47.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.996+0000 7f445d7fa700 1 -- 172.21.15.40:0/957084517 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f444c010740 con 0x7f446009d920 2023-09-30T22:27:47.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.996+0000 7f5e29ffb700 1 -- 172.21.15.40:0/50702113 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e300054e0 con 0x7f5e3412e590 2023-09-30T22:27:47.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.996+0000 7f5e29ffb700 1 -- 172.21.15.40:0/50702113 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e30003680 con 0x7f5e3412e590 2023-09-30T22:27:47.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.996+0000 7f5e3b982700 1 -- 172.21.15.40:0/50702113 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e3411d180 con 0x7f5e3412e590 2023-09-30T22:27:47.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.996+0000 7f5e29ffb700 1 -- 172.21.15.40:0/50702113 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e30003a30 con 0x7f5e3412e590 2023-09-30T22:27:47.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.996+0000 7f5e3b982700 1 -- 172.21.15.40:0/50702113 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e3411b120 con 0x7f5e3412e590 2023-09-30T22:27:47.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.997+0000 7f5e29ffb700 1 -- 172.21.15.40:0/50702113 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5e30003b90 con 0x7f5e3412e590 2023-09-30T22:27:47.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.997+0000 7f5e29ffb700 1 -- 172.21.15.40:0/50702113 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5e3003ec10 con 0x7f5e3412e590 2023-09-30T22:27:47.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:46.998+0000 7f5e3b982700 1 -- 172.21.15.40:0/50702113 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e140052e0 con 0x7f5e3412e590 2023-09-30T22:27:47.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.007+0000 7f5e29ffb700 1 -- 172.21.15.40:0/50702113 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5e30017080 con 0x7f5e3412e590 2023-09-30T22:27:47.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.028+0000 7fdefcfb3700 1 -- 172.21.15.40:0/691329908 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdef808f150 con 0x7fdef809ab60 2023-09-30T22:27:47.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.028+0000 7fdeeeffd700 1 -- 172.21.15.40:0/691329908 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdee0027090 con 0x7fdef809ab60 2023-09-30T22:27:47.029 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:47.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.030+0000 7fdefcfb3700 1 -- 172.21.15.40:0/691329908 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdef809ab60 msgr2=0x7fdef808afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:47.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.030+0000 7fdefcfb3700 1 --2- 172.21.15.40:0/691329908 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdef809ab60 0x7fdef808afd0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fdee000ec90 tx=0x7fdee000d350 comp rx=0 tx=0).stop 2023-09-30T22:27:47.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.030+0000 7fdefcfb3700 1 -- 172.21.15.40:0/691329908 shutdown_connections 2023-09-30T22:27:47.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.030+0000 7fdefcfb3700 1 --2- 172.21.15.40:0/691329908 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdef8130c00 0x7fdef808ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.030+0000 7fdefcfb3700 1 --2- 172.21.15.40:0/691329908 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdef809ab60 0x7fdef808afd0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.030+0000 7fdefcfb3700 1 --2- 172.21.15.40:0/691329908 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdef8130570 0x7fdef808b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.031+0000 7fdefcfb3700 1 -- 172.21.15.40:0/691329908 >> 172.21.15.40:0/691329908 conn(0x7fdef809eb10 msgr2=0x7fdef812f330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:47.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.031+0000 7fdefcfb3700 1 -- 172.21.15.40:0/691329908 shutdown_connections 2023-09-30T22:27:47.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.031+0000 7fdefcfb3700 1 -- 172.21.15.40:0/691329908 wait complete. 2023-09-30T22:27:47.044 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:47.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.049+0000 7f233986d700 1 Processor -- start 2023-09-30T22:27:47.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.049+0000 7f233986d700 1 -- start start 2023-09-30T22:27:47.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.049+0000 7f233986d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2334136bf0 0x7f2334138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:47.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.049+0000 7f233986d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2334139510 0x7f233413b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:47.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.049+0000 7f233986d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23340a2600 con 0x7f233409c890 2023-09-30T22:27:47.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.049+0000 7f233986d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23340a29d0 con 0x7f2334136bf0 2023-09-30T22:27:47.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.049+0000 7f233986d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f233409fb40 con 0x7f2334139510 2023-09-30T22:27:47.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.049+0000 7f23327fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2334136bf0 0x7f2334138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:47.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.049+0000 7f23337fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2334139510 0x7f233413b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:47.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.049+0000 7f23327fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2334136bf0 0x7f2334138fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41320/0 (socket says 172.21.15.40:41320) 2023-09-30T22:27:47.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.049+0000 7f23337fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2334139510 0x7f233413b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:34968/0 (socket says 172.21.15.40:34968) 2023-09-30T22:27:47.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.049+0000 7f23327fc700 1 -- 172.21.15.40:0/2739254892 learned_addr learned my addr 172.21.15.40:0/2739254892 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:47.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.050+0000 7f23327fc700 1 -- 172.21.15.40:0/2739254892 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2334139510 msgr2=0x7f233413b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:47.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.050+0000 7f23327fc700 1 --2- 172.21.15.40:0/2739254892 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2334139510 0x7f233413b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.050+0000 7f23327fc700 1 -- 172.21.15.40:0/2739254892 >> v1:172.21.15.40:6789/0 conn(0x7f233409c890 legacy=0x7f233409cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:47.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.050+0000 7f23327fc700 1 -- 172.21.15.40:0/2739254892 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233409d370 con 0x7f2334136bf0 2023-09-30T22:27:47.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.050+0000 7f2331ffb700 1 -- 172.21.15.40:0/2739254892 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1704712823 0 0) 0x7f23340a2600 con 0x7f233409c890 2023-09-30T22:27:47.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.050+0000 7f23337fe700 1 --2- 172.21.15.40:0/2739254892 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2334139510 0x7f233413b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:47.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.050+0000 7f23327fc700 1 --2- 172.21.15.40:0/2739254892 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2334136bf0 0x7f2334138fd0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2328009920 tx=0x7f2328009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5584844a080179b5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:47.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.050+0000 7f2331ffb700 1 -- 172.21.15.40:0/2739254892 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2328011830 con 0x7f2334136bf0 2023-09-30T22:27:47.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.050+0000 7f2331ffb700 1 -- 172.21.15.40:0/2739254892 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2328011990 con 0x7f2334136bf0 2023-09-30T22:27:47.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.050+0000 7f2331ffb700 1 -- 172.21.15.40:0/2739254892 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2328011d20 con 0x7f2334136bf0 2023-09-30T22:27:47.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.051+0000 7f233986d700 1 -- 172.21.15.40:0/2739254892 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2334136bf0 msgr2=0x7f2334138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:47.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.051+0000 7f233986d700 1 --2- 172.21.15.40:0/2739254892 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2334136bf0 0x7f2334138fd0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2328009920 tx=0x7f2328009c30 comp rx=0 tx=0).stop 2023-09-30T22:27:47.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.051+0000 7f233986d700 1 -- 172.21.15.40:0/2739254892 shutdown_connections 2023-09-30T22:27:47.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.051+0000 7f233986d700 1 --2- 172.21.15.40:0/2739254892 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2334139510 0x7f233413b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.051+0000 7f233986d700 1 --2- 172.21.15.40:0/2739254892 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2334136bf0 0x7f2334138fd0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.051+0000 7f233986d700 1 -- 172.21.15.40:0/2739254892 >> 172.21.15.40:0/2739254892 conn(0x7f23340a7080 msgr2=0x7f23340a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:47.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.051+0000 7f233986d700 1 -- 172.21.15.40:0/2739254892 shutdown_connections 2023-09-30T22:27:47.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.051+0000 7f233986d700 1 -- 172.21.15.40:0/2739254892 wait complete. 2023-09-30T22:27:47.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.052+0000 7f233986d700 1 Processor -- start 2023-09-30T22:27:47.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.052+0000 7f233986d700 1 -- start start 2023-09-30T22:27:47.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.052+0000 7f233986d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f233409c890 0x7f233406f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:47.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.052+0000 7f233986d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2334136bf0 0x7f233406f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:47.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.052+0000 7f233986d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2334139510 0x7f233406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:47.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.052+0000 7f233986d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233412be50 con 0x7f2334136bf0 2023-09-30T22:27:47.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.052+0000 7f233986d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2334070910 con 0x7f233409c890 2023-09-30T22:27:47.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.052+0000 7f233986d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f233409ecf0 con 0x7f2334139510 2023-09-30T22:27:47.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.053+0000 7f23337fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2334139510 0x7f233406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:47.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.053+0000 7f23337fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2334139510 0x7f233406fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:34974/0 (socket says 172.21.15.40:34974) 2023-09-30T22:27:47.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.053+0000 7f23337fe700 1 -- 172.21.15.40:0/4101481414 learned_addr learned my addr 172.21.15.40:0/4101481414 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:47.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.053+0000 7f23327fc700 1 --2- 172.21.15.40:0/4101481414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2334136bf0 0x7f233406f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:47.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.053+0000 7f2332ffd700 1 --2- 172.21.15.40:0/4101481414 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f233409c890 0x7f233406f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:47.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.053+0000 7f23337fe700 1 -- 172.21.15.40:0/4101481414 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f233409c890 msgr2=0x7f233406f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:47.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.053+0000 7f23337fe700 1 --2- 172.21.15.40:0/4101481414 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f233409c890 0x7f233406f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.053+0000 7f23337fe700 1 -- 172.21.15.40:0/4101481414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2334136bf0 msgr2=0x7f233406f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:47.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.053+0000 7f23337fe700 1 --2- 172.21.15.40:0/4101481414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2334136bf0 0x7f233406f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.053+0000 7f23337fe700 1 -- 172.21.15.40:0/4101481414 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232c009a70 con 0x7f2334139510 2023-09-30T22:27:47.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.053+0000 7f23327fc700 1 --2- 172.21.15.40:0/4101481414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2334136bf0 0x7f233406f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:47.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.053+0000 7f23337fe700 1 --2- 172.21.15.40:0/4101481414 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2334139510 0x7f233406fca0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f232c00efb0 tx=0x7f232c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:47.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.053+0000 7f231bfff700 1 -- 172.21.15.40:0/4101481414 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c00cc90 con 0x7f2334139510 2023-09-30T22:27:47.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.053+0000 7f231bfff700 1 -- 172.21.15.40:0/4101481414 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232c00f040 con 0x7f2334139510 2023-09-30T22:27:47.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.053+0000 7f233986d700 1 -- 172.21.15.40:0/4101481414 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2328009550 con 0x7f2334139510 2023-09-30T22:27:47.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.053+0000 7f231bfff700 1 -- 172.21.15.40:0/4101481414 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c003a20 con 0x7f2334139510 2023-09-30T22:27:47.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.053+0000 7f233986d700 1 -- 172.21.15.40:0/4101481414 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f233412b4e0 con 0x7f2334139510 2023-09-30T22:27:47.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.054+0000 7f231bfff700 1 -- 172.21.15.40:0/4101481414 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f232c003b80 con 0x7f2334139510 2023-09-30T22:27:47.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.054+0000 7f231bfff700 1 -- 172.21.15.40:0/4101481414 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f232c0403f0 con 0x7f2334139510 2023-09-30T22:27:47.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.055+0000 7f233986d700 1 -- 172.21.15.40:0/4101481414 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2334062380 con 0x7f2334139510 2023-09-30T22:27:47.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.060+0000 7f231bfff700 1 -- 172.21.15.40:0/4101481414 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f232c003e30 con 0x7f2334139510 2023-09-30T22:27:47.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.199+0000 7f4466c10700 1 -- 172.21.15.40:0/957084517 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4460062380 con 0x7f446009d920 2023-09-30T22:27:47.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.200+0000 7f445d7fa700 1 -- 172.21.15.40:0/957084517 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f444c015070 con 0x7f446009d920 2023-09-30T22:27:47.201 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:47.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.203+0000 7f4466c10700 1 -- 172.21.15.40:0/957084517 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f446009d920 msgr2=0x7f446012db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:47.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.203+0000 7f4466c10700 1 --2- 172.21.15.40:0/957084517 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f446009d920 0x7f446012db60 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f444c009fd0 tx=0x7f444c004750 comp rx=0 tx=0).stop 2023-09-30T22:27:47.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.203+0000 7f4466c10700 1 -- 172.21.15.40:0/957084517 shutdown_connections 2023-09-30T22:27:47.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.203+0000 7f4466c10700 1 --2- 172.21.15.40:0/957084517 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f446009e2b0 0x7f446012e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.203+0000 7f4466c10700 1 --2- 172.21.15.40:0/957084517 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f446009c890 0x7f446012d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.203+0000 7f4466c10700 1 --2- 172.21.15.40:0/957084517 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f446009d920 0x7f446012db60 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.203+0000 7f4466c10700 1 -- 172.21.15.40:0/957084517 >> 172.21.15.40:0/957084517 conn(0x7f44600a7080 msgr2=0x7f44600a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:47.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.203+0000 7f4466c10700 1 -- 172.21.15.40:0/957084517 shutdown_connections 2023-09-30T22:27:47.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.203+0000 7f4466c10700 1 -- 172.21.15.40:0/957084517 wait complete. 2023-09-30T22:27:47.221 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:47.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.262+0000 7f5e3b982700 1 -- 172.21.15.40:0/50702113 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5e14005590 con 0x7f5e3412e590 2023-09-30T22:27:47.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.262+0000 7f5e29ffb700 1 -- 172.21.15.40:0/50702113 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5e30012400 con 0x7f5e3412e590 2023-09-30T22:27:47.263 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:47.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.264+0000 7f5e3b982700 1 -- 172.21.15.40:0/50702113 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e3412e590 msgr2=0x7f5e340704f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:47.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.264+0000 7f5e3b982700 1 --2- 172.21.15.40:0/50702113 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e3412e590 0x7f5e340704f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5e3000c4a0 tx=0x7f5e3000c860 comp rx=0 tx=0).stop 2023-09-30T22:27:47.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.265+0000 7f5e3b982700 1 -- 172.21.15.40:0/50702113 shutdown_connections 2023-09-30T22:27:47.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.265+0000 7f5e3b982700 1 --2- 172.21.15.40:0/50702113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e34136170 0x7f5e3411bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.265+0000 7f5e3b982700 1 --2- 172.21.15.40:0/50702113 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e3412e590 0x7f5e340704f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.265+0000 7f5e3b982700 1 --2- 172.21.15.40:0/50702113 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e3412f070 0x7f5e3411b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.265+0000 7f5e3b982700 1 -- 172.21.15.40:0/50702113 >> 172.21.15.40:0/50702113 conn(0x7f5e340a2a00 msgr2=0x7f5e3409d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:47.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.265+0000 7f5e3b982700 1 -- 172.21.15.40:0/50702113 shutdown_connections 2023-09-30T22:27:47.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.265+0000 7f5e3b982700 1 -- 172.21.15.40:0/50702113 wait complete. 2023-09-30T22:27:47.277 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:47.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.287+0000 7f233986d700 1 -- 172.21.15.40:0/4101481414 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2334131390 con 0x7f2334139510 2023-09-30T22:27:47.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.288+0000 7f231bfff700 1 -- 172.21.15.40:0/4101481414 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f232c02c090 con 0x7f2334139510 2023-09-30T22:27:47.288 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:47.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.290+0000 7f233986d700 1 -- 172.21.15.40:0/4101481414 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2334139510 msgr2=0x7f233406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:47.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.290+0000 7f233986d700 1 --2- 172.21.15.40:0/4101481414 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2334139510 0x7f233406fca0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f232c00efb0 tx=0x7f232c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.290+0000 7f233986d700 1 -- 172.21.15.40:0/4101481414 shutdown_connections 2023-09-30T22:27:47.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.290+0000 7f233986d700 1 --2- 172.21.15.40:0/4101481414 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2334139510 0x7f233406fca0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.290+0000 7f233986d700 1 --2- 172.21.15.40:0/4101481414 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f233409c890 0x7f233406f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.290+0000 7f233986d700 1 --2- 172.21.15.40:0/4101481414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2334136bf0 0x7f233406f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.290+0000 7f233986d700 1 -- 172.21.15.40:0/4101481414 >> 172.21.15.40:0/4101481414 conn(0x7f23340a7080 msgr2=0x7f2334136fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:47.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.290+0000 7f233986d700 1 -- 172.21.15.40:0/4101481414 shutdown_connections 2023-09-30T22:27:47.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:47.290+0000 7f233986d700 1 -- 172.21.15.40:0/4101481414 wait complete. 2023-09-30T22:27:47.303 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:48.045 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:48.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.185+0000 7f3eefd7c700 1 Processor -- start 2023-09-30T22:27:48.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.185+0000 7f3eefd7c700 1 -- start start 2023-09-30T22:27:48.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.186+0000 7f3eefd7c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ee809c890 0x7f3ee809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.186+0000 7f3eefd7c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3ee809e480 0x7f3ee813bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.186+0000 7f3eefd7c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ee80a2600 con 0x7f3ee809d920 2023-09-30T22:27:48.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.186+0000 7f3eefd7c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ee80a29d0 con 0x7f3ee809e480 2023-09-30T22:27:48.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.186+0000 7f3eefd7c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee809fb40 con 0x7f3ee809c890 2023-09-30T22:27:48.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.186+0000 7f3eee319700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3ee809e480 0x7f3ee813bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.186+0000 7f3eedb18700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ee809c890 0x7f3ee809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.186+0000 7f3eedb18700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ee809c890 0x7f3ee809cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:34982/0 (socket says 172.21.15.40:34982) 2023-09-30T22:27:48.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.186+0000 7f3eee319700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3ee809e480 0x7f3ee813bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51516/0 (socket says 172.21.15.40:51516) 2023-09-30T22:27:48.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.186+0000 7f3eedb18700 1 -- 172.21.15.40:0/3401448220 learned_addr learned my addr 172.21.15.40:0/3401448220 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:48.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.186+0000 7f3eee319700 1 -- 172.21.15.40:0/3401448220 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ee809c890 msgr2=0x7f3ee809cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:48.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.186+0000 7f3eee319700 1 --2- 172.21.15.40:0/3401448220 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ee809c890 0x7f3ee809cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.186+0000 7f3eee319700 1 -- 172.21.15.40:0/3401448220 >> v1:172.21.15.40:6789/0 conn(0x7f3ee809d920 legacy=0x7f3ee809dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.186+0000 7f3eee319700 1 -- 172.21.15.40:0/3401448220 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee809fed0 con 0x7f3ee809e480 2023-09-30T22:27:48.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.186+0000 7f3eecb16700 1 -- 172.21.15.40:0/3401448220 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1779110075 0 0) 0x7f3ee80a2600 con 0x7f3ee809d920 2023-09-30T22:27:48.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.186+0000 7f3eedb18700 1 --2- 172.21.15.40:0/3401448220 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ee809c890 0x7f3ee809cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:48.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.186+0000 7f3eee319700 1 --2- 172.21.15.40:0/3401448220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ee809e480 0x7f3ee813bc20 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0009840 tx=0x7f3ee0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=968c53fa538bdbe1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:48.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.187+0000 7f3eecb16700 1 -- 172.21.15.40:0/3401448220 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee0011830 con 0x7f3ee809e480 2023-09-30T22:27:48.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.187+0000 7f3eecb16700 1 -- 172.21.15.40:0/3401448220 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee0011990 con 0x7f3ee809e480 2023-09-30T22:27:48.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.187+0000 7f3eecb16700 1 -- 172.21.15.40:0/3401448220 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee0011d20 con 0x7f3ee809e480 2023-09-30T22:27:48.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.187+0000 7f3eefd7c700 1 -- 172.21.15.40:0/3401448220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ee809e480 msgr2=0x7f3ee813bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.187+0000 7f3eefd7c700 1 --2- 172.21.15.40:0/3401448220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ee809e480 0x7f3ee813bc20 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0009840 tx=0x7f3ee0009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:48.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.187+0000 7f3eefd7c700 1 -- 172.21.15.40:0/3401448220 shutdown_connections 2023-09-30T22:27:48.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.187+0000 7f3eefd7c700 1 --2- 172.21.15.40:0/3401448220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ee809e480 0x7f3ee813bc20 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.187+0000 7f3eefd7c700 1 --2- 172.21.15.40:0/3401448220 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ee809c890 0x7f3ee809cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.187+0000 7f3eefd7c700 1 -- 172.21.15.40:0/3401448220 >> 172.21.15.40:0/3401448220 conn(0x7f3ee80a7080 msgr2=0x7f3ee80a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:48.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.187+0000 7f3eefd7c700 1 -- 172.21.15.40:0/3401448220 shutdown_connections 2023-09-30T22:27:48.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.187+0000 7f3eefd7c700 1 -- 172.21.15.40:0/3401448220 wait complete. 2023-09-30T22:27:48.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.188+0000 7f3eefd7c700 1 Processor -- start 2023-09-30T22:27:48.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.188+0000 7f3eefd7c700 1 -- start start 2023-09-30T22:27:48.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.189+0000 7f3eefd7c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ee809c890 0x7f3ee812d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.189+0000 7f3eefd7c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ee809d920 0x7f3ee812d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.189+0000 7f3eefd7c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ee809e480 0x7f3ee812db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.189+0000 7f3eefd7c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee812ed70 con 0x7f3ee809c890 2023-09-30T22:27:48.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.189+0000 7f3eefd7c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee812fa80 con 0x7f3ee809e480 2023-09-30T22:27:48.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.189+0000 7f3eefd7c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee80a5c70 con 0x7f3ee809d920 2023-09-30T22:27:48.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.189+0000 7f3eedb18700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ee809c890 0x7f3ee812d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.189+0000 7f3eedb18700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ee809c890 0x7f3ee812d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51528/0 (socket says 172.21.15.40:51528) 2023-09-30T22:27:48.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.189+0000 7f3eed317700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ee809d920 0x7f3ee812d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.189+0000 7f3eedb18700 1 -- 172.21.15.40:0/387408144 learned_addr learned my addr 172.21.15.40:0/387408144 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:48.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.189+0000 7f3eee319700 1 --2- 172.21.15.40:0/387408144 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ee809e480 0x7f3ee812db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.189+0000 7f3eedb18700 1 -- 172.21.15.40:0/387408144 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ee809d920 msgr2=0x7f3ee812d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.189+0000 7f3eedb18700 1 --2- 172.21.15.40:0/387408144 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ee809d920 0x7f3ee812d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.189+0000 7f3eedb18700 1 -- 172.21.15.40:0/387408144 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ee809e480 msgr2=0x7f3ee812db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.189+0000 7f3eedb18700 1 --2- 172.21.15.40:0/387408144 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ee809e480 0x7f3ee812db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.189+0000 7f3eedb18700 1 -- 172.21.15.40:0/387408144 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee4009b30 con 0x7f3ee809c890 2023-09-30T22:27:48.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.189+0000 7f3eedb18700 1 --2- 172.21.15.40:0/387408144 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ee809c890 0x7f3ee812d0e0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f3ee400efc0 tx=0x7f3ee400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:48.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.189+0000 7f3ede7fc700 1 -- 172.21.15.40:0/387408144 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee400cb00 con 0x7f3ee809c890 2023-09-30T22:27:48.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.190+0000 7f3ede7fc700 1 -- 172.21.15.40:0/387408144 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee400f040 con 0x7f3ee809c890 2023-09-30T22:27:48.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.190+0000 7f3eefd7c700 1 -- 172.21.15.40:0/387408144 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ee00094a0 con 0x7f3ee809c890 2023-09-30T22:27:48.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.190+0000 7f3ede7fc700 1 -- 172.21.15.40:0/387408144 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee400ce80 con 0x7f3ee809c890 2023-09-30T22:27:48.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.190+0000 7f3eefd7c700 1 -- 172.21.15.40:0/387408144 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee8130890 con 0x7f3ee809c890 2023-09-30T22:27:48.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.190+0000 7f3ede7fc700 1 -- 172.21.15.40:0/387408144 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3ee4014480 con 0x7f3ee809c890 2023-09-30T22:27:48.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.190+0000 7f3eefd7c700 1 -- 172.21.15.40:0/387408144 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ee8062380 con 0x7f3ee809c890 2023-09-30T22:27:48.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.191+0000 7f3ede7fc700 1 -- 172.21.15.40:0/387408144 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3ee403fe20 con 0x7f3ee809c890 2023-09-30T22:27:48.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.195+0000 7f3ede7fc700 1 -- 172.21.15.40:0/387408144 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3ee401c950 con 0x7f3ee809c890 2023-09-30T22:27:48.222 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:48.278 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:48.304 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:48.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.351+0000 7fa674c12700 1 Processor -- start 2023-09-30T22:27:48.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.351+0000 7fa674c12700 1 -- start start 2023-09-30T22:27:48.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.351+0000 7fa674c12700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa67012e590 0x7fa67012e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.351+0000 7fa674c12700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa67012eea0 0x7fa67012d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.351+0000 7fa674c12700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa67009ab70 con 0x7fa67012d6d0 2023-09-30T22:27:48.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.351+0000 7fa674c12700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa67009b270 con 0x7fa67012e590 2023-09-30T22:27:48.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.351+0000 7fa674c12700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa67009bab0 con 0x7fa67012eea0 2023-09-30T22:27:48.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.352+0000 7fa66ed9d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa67012d6d0 0x7fa670137c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57240/0 (socket says 172.21.15.40:57240) 2023-09-30T22:27:48.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.352+0000 7fa66ed9d700 1 -- 172.21.15.40:0/1097316977 learned_addr learned my addr 172.21.15.40:0/1097316977 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:27:48.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.352+0000 7fa66dd9b700 1 --2- 172.21.15.40:0/1097316977 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa67012eea0 0x7fa67012d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.352+0000 7fa66e59c700 1 --2- 172.21.15.40:0/1097316977 >> v2:172.21.15.40:3300/0 conn(0x7fa67012e590 0x7fa67012e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.352+0000 7fa66d59a700 1 -- 172.21.15.40:0/1097316977 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2634073974 0 0) 0x7fa67009ab70 con 0x7fa67012d6d0 2023-09-30T22:27:48.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.352+0000 7fa66d59a700 1 -- 172.21.15.40:0/1097316977 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6580035b0 con 0x7fa67012d6d0 2023-09-30T22:27:48.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.352+0000 7fa66dd9b700 1 -- 172.21.15.40:0/1097316977 >> v2:172.21.15.40:3300/0 conn(0x7fa67012e590 msgr2=0x7fa67012e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:48.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.352+0000 7fa66dd9b700 1 --2- 172.21.15.40:0/1097316977 >> v2:172.21.15.40:3300/0 conn(0x7fa67012e590 0x7fa67012e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.352+0000 7fa66dd9b700 1 -- 172.21.15.40:0/1097316977 >> v1:172.21.15.40:6789/0 conn(0x7fa67012d6d0 legacy=0x7fa670137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.352+0000 7fa66dd9b700 1 -- 172.21.15.40:0/1097316977 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa67009bd70 con 0x7fa67012eea0 2023-09-30T22:27:48.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.352+0000 7fa66dd9b700 1 --2- 172.21.15.40:0/1097316977 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa67012eea0 0x7fa67012d190 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa664009870 tx=0x7fa664009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=399b3f4398409266 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:48.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.352+0000 7fa66d59a700 1 -- 172.21.15.40:0/1097316977 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa664011830 con 0x7fa67012eea0 2023-09-30T22:27:48.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.353+0000 7fa66d59a700 1 -- 172.21.15.40:0/1097316977 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa664011990 con 0x7fa67012eea0 2023-09-30T22:27:48.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.353+0000 7fa66d59a700 1 -- 172.21.15.40:0/1097316977 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa664011d20 con 0x7fa67012eea0 2023-09-30T22:27:48.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.353+0000 7fa674c12700 1 -- 172.21.15.40:0/1097316977 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa67012eea0 msgr2=0x7fa67012d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.353+0000 7fa674c12700 1 --2- 172.21.15.40:0/1097316977 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa67012eea0 0x7fa67012d190 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa664009870 tx=0x7fa664009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:48.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.353+0000 7fa674c12700 1 -- 172.21.15.40:0/1097316977 shutdown_connections 2023-09-30T22:27:48.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.353+0000 7fa674c12700 1 --2- 172.21.15.40:0/1097316977 >> v2:172.21.15.40:3300/0 conn(0x7fa67012e590 0x7fa67012e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.353+0000 7fa674c12700 1 --2- 172.21.15.40:0/1097316977 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa67012eea0 0x7fa67012d190 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.353+0000 7fa674c12700 1 -- 172.21.15.40:0/1097316977 >> 172.21.15.40:0/1097316977 conn(0x7fa6700a2a00 msgr2=0x7fa6700a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:48.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.353+0000 7fa674c12700 1 -- 172.21.15.40:0/1097316977 shutdown_connections 2023-09-30T22:27:48.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.353+0000 7fa674c12700 1 -- 172.21.15.40:0/1097316977 wait complete. 2023-09-30T22:27:48.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.355+0000 7fa674c12700 1 Processor -- start 2023-09-30T22:27:48.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.355+0000 7fa674c12700 1 -- start start 2023-09-30T22:27:48.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.356+0000 7fa674c12700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa67012d6d0 0x7fa6701287f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.356+0000 7fa674c12700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa67012e590 0x7fa670128d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.356+0000 7fa674c12700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa67012eea0 0x7fa670129270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.356+0000 7fa674c12700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67012cef0 con 0x7fa67012eea0 2023-09-30T22:27:48.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.356+0000 7fa674c12700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa67012d0d0 con 0x7fa67012d6d0 2023-09-30T22:27:48.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.356+0000 7fa674c12700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa670139e50 con 0x7fa67012e590 2023-09-30T22:27:48.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.356+0000 7fa66e59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa67012d6d0 0x7fa6701287f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.356+0000 7fa66e59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa67012d6d0 0x7fa6701287f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41356/0 (socket says 172.21.15.40:41356) 2023-09-30T22:27:48.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.356+0000 7fa66e59c700 1 -- 172.21.15.40:0/3103015564 learned_addr learned my addr 172.21.15.40:0/3103015564 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:48.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.356+0000 7fa66dd9b700 1 --2- 172.21.15.40:0/3103015564 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa67012e590 0x7fa670128d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.356+0000 7fa66e59c700 1 -- 172.21.15.40:0/3103015564 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa67012e590 msgr2=0x7fa670128d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.356+0000 7fa66e59c700 1 --2- 172.21.15.40:0/3103015564 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa67012e590 0x7fa670128d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.356+0000 7fa66e59c700 1 -- 172.21.15.40:0/3103015564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa67012eea0 msgr2=0x7fa670129270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:27:48.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.356+0000 7fa66e59c700 1 --2- 172.21.15.40:0/3103015564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa67012eea0 0x7fa670129270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.356+0000 7fa66e59c700 1 -- 172.21.15.40:0/3103015564 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6640094a0 con 0x7fa67012d6d0 2023-09-30T22:27:48.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.356+0000 7fa66dd9b700 1 --2- 172.21.15.40:0/3103015564 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa67012e590 0x7fa670128d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:48.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.357+0000 7fa66e59c700 1 --2- 172.21.15.40:0/3103015564 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa67012d6d0 0x7fa6701287f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa66000e9e0 tx=0x7fa66000ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:48.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.357+0000 7fa65effd700 1 -- 172.21.15.40:0/3103015564 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa660009710 con 0x7fa67012d6d0 2023-09-30T22:27:48.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.357+0000 7fa65effd700 1 -- 172.21.15.40:0/3103015564 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66000c850 con 0x7fa67012d6d0 2023-09-30T22:27:48.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.357+0000 7fa65effd700 1 -- 172.21.15.40:0/3103015564 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66000cbc0 con 0x7fa67012d6d0 2023-09-30T22:27:48.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.358+0000 7fa674c12700 1 -- 172.21.15.40:0/3103015564 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa67009b4b0 con 0x7fa67012d6d0 2023-09-30T22:27:48.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.358+0000 7fa674c12700 1 -- 172.21.15.40:0/3103015564 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa67012c900 con 0x7fa67012d6d0 2023-09-30T22:27:48.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.359+0000 7fa65effd700 1 -- 172.21.15.40:0/3103015564 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa66000cd20 con 0x7fa67012d6d0 2023-09-30T22:27:48.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.359+0000 7fa674c12700 1 -- 172.21.15.40:0/3103015564 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa670062380 con 0x7fa67012d6d0 2023-09-30T22:27:48.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.359+0000 7fa65effd700 1 -- 172.21.15.40:0/3103015564 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa66003f890 con 0x7fa67012d6d0 2023-09-30T22:27:48.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.368+0000 7fa65effd700 1 -- 172.21.15.40:0/3103015564 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa66001bbe0 con 0x7fa67012d6d0 2023-09-30T22:27:48.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.413+0000 7f0ccc9df700 1 Processor -- start 2023-09-30T22:27:48.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.413+0000 7f0ccc9df700 1 -- start start 2023-09-30T22:27:48.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.414+0000 7f0ccc9df700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0cc806d470 0x7f0cc813d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.414+0000 7f0ccc9df700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0cc813d900 0x7f0cc813fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.414+0000 7f0ccc9df700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc806df30 con 0x7f0cc806c990 2023-09-30T22:27:48.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.414+0000 7f0ccc9df700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc806ec40 con 0x7f0cc813d900 2023-09-30T22:27:48.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.414+0000 7f0ccc9df700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc806ea40 con 0x7f0cc806d470 2023-09-30T22:27:48.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.414+0000 7f0cc5d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0cc806d470 0x7f0cc813d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.414+0000 7f0cc5d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0cc806d470 0x7f0cc813d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:35012/0 (socket says 172.21.15.40:35012) 2023-09-30T22:27:48.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.414+0000 7f0cc5d9b700 1 -- 172.21.15.40:0/100771822 learned_addr learned my addr 172.21.15.40:0/100771822 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:48.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.414+0000 7f0cc6d9d700 1 --2- 172.21.15.40:0/100771822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0cc813d900 0x7f0cc813fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.414+0000 7f0cc5d9b700 1 -- 172.21.15.40:0/100771822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0cc813d900 msgr2=0x7f0cc813fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:48.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.414+0000 7f0cc5d9b700 1 --2- 172.21.15.40:0/100771822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0cc813d900 0x7f0cc813fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.414+0000 7f0cc5d9b700 1 -- 172.21.15.40:0/100771822 >> v1:172.21.15.40:6789/0 conn(0x7f0cc806c990 legacy=0x7f0cc806cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.414+0000 7f0cc559a700 1 -- 172.21.15.40:0/100771822 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4172800471 0 0) 0x7f0cc806df30 con 0x7f0cc806c990 2023-09-30T22:27:48.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.414+0000 7f0cc5d9b700 1 -- 172.21.15.40:0/100771822 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc8072050 con 0x7f0cc806d470 2023-09-30T22:27:48.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.415+0000 7f0cc5d9b700 1 --2- 172.21.15.40:0/100771822 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0cc806d470 0x7f0cc813d3c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc009920 tx=0x7f0cbc009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e34e42e4c0e2194 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:48.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.415+0000 7f0cc559a700 1 -- 172.21.15.40:0/100771822 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc011830 con 0x7f0cc806d470 2023-09-30T22:27:48.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.415+0000 7f0cc559a700 1 -- 172.21.15.40:0/100771822 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cbc011990 con 0x7f0cc806d470 2023-09-30T22:27:48.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.415+0000 7f0cc559a700 1 -- 172.21.15.40:0/100771822 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc011d20 con 0x7f0cc806d470 2023-09-30T22:27:48.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.415+0000 7f0ccc9df700 1 -- 172.21.15.40:0/100771822 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0cc806d470 msgr2=0x7f0cc813d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.415+0000 7f0ccc9df700 1 --2- 172.21.15.40:0/100771822 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0cc806d470 0x7f0cc813d3c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc009920 tx=0x7f0cbc009c30 comp rx=0 tx=0).stop 2023-09-30T22:27:48.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.416+0000 7f0ccc9df700 1 -- 172.21.15.40:0/100771822 shutdown_connections 2023-09-30T22:27:48.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.416+0000 7f0ccc9df700 1 --2- 172.21.15.40:0/100771822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0cc813d900 0x7f0cc813fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.416+0000 7f0ccc9df700 1 --2- 172.21.15.40:0/100771822 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0cc806d470 0x7f0cc813d3c0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.416+0000 7f0ccc9df700 1 -- 172.21.15.40:0/100771822 >> 172.21.15.40:0/100771822 conn(0x7f0cc80a41a0 msgr2=0x7f0cc80a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:48.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.416+0000 7f0ccc9df700 1 -- 172.21.15.40:0/100771822 shutdown_connections 2023-09-30T22:27:48.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.416+0000 7f0ccc9df700 1 -- 172.21.15.40:0/100771822 wait complete. 2023-09-30T22:27:48.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.416+0000 7f3eefd7c700 1 -- 172.21.15.40:0/387408144 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3ee8074620 con 0x7f3ee809c890 2023-09-30T22:27:48.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.416+0000 7f3ede7fc700 1 -- 172.21.15.40:0/387408144 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3ee4032e60 con 0x7f3ee809c890 2023-09-30T22:27:48.419 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:48.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.417+0000 7f0ccc9df700 1 Processor -- start 2023-09-30T22:27:48.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.417+0000 7f0ccc9df700 1 -- start start 2023-09-30T22:27:48.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.418+0000 7f0ccc9df700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cc806c990 0x7f0cc808e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.418+0000 7f0ccc9df700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0cc806d470 0x7f0cc813f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.418+0000 7f0ccc9df700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0cc813d900 0x7f0cc813fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.418+0000 7f0ccc9df700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc808cdd0 con 0x7f0cc806c990 2023-09-30T22:27:48.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.418+0000 7f0ccc9df700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc806f380 con 0x7f0cc813d900 2023-09-30T22:27:48.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.418+0000 7f0ccc9df700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc80a0850 con 0x7f0cc806d470 2023-09-30T22:27:48.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.418+0000 7f0cc659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cc806c990 0x7f0cc808e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.418+0000 7f0cc659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cc806c990 0x7f0cc808e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51536/0 (socket says 172.21.15.40:51536) 2023-09-30T22:27:48.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.418+0000 7f0cc659c700 1 -- 172.21.15.40:0/1066995734 learned_addr learned my addr 172.21.15.40:0/1066995734 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:48.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.418+0000 7f0cc5d9b700 1 --2- 172.21.15.40:0/1066995734 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0cc806d470 0x7f0cc813f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.418+0000 7f0cc6d9d700 1 --2- 172.21.15.40:0/1066995734 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0cc813d900 0x7f0cc813fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.418+0000 7f0cc659c700 1 -- 172.21.15.40:0/1066995734 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0cc806d470 msgr2=0x7f0cc813f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.418+0000 7f0cc659c700 1 --2- 172.21.15.40:0/1066995734 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0cc806d470 0x7f0cc813f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.418+0000 7f0cc659c700 1 -- 172.21.15.40:0/1066995734 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0cc813d900 msgr2=0x7f0cc813fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.418+0000 7f0cc659c700 1 --2- 172.21.15.40:0/1066995734 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0cc813d900 0x7f0cc813fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.418+0000 7f0cc659c700 1 -- 172.21.15.40:0/1066995734 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cbc009550 con 0x7f0cc806c990 2023-09-30T22:27:48.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.419+0000 7f0cc659c700 1 --2- 172.21.15.40:0/1066995734 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cc806c990 0x7f0cc808e850 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8001eb0 tx=0x7f0cb800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:48.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.419+0000 7f0cb6ffd700 1 -- 172.21.15.40:0/1066995734 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb800cea0 con 0x7f0cc806c990 2023-09-30T22:27:48.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.419+0000 7f0cb6ffd700 1 -- 172.21.15.40:0/1066995734 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb80054e0 con 0x7f0cc806c990 2023-09-30T22:27:48.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.419+0000 7f0ccc9df700 1 -- 172.21.15.40:0/1066995734 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc808df50 con 0x7f0cc806c990 2023-09-30T22:27:48.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.419+0000 7f0cb6ffd700 1 -- 172.21.15.40:0/1066995734 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb8003880 con 0x7f0cc806c990 2023-09-30T22:27:48.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.419+0000 7f0ccc9df700 1 -- 172.21.15.40:0/1066995734 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc808db00 con 0x7f0cc806c990 2023-09-30T22:27:48.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.419+0000 7f3eefd7c700 1 -- 172.21.15.40:0/387408144 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ee809c890 msgr2=0x7f3ee812d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.419+0000 7f3eefd7c700 1 --2- 172.21.15.40:0/387408144 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ee809c890 0x7f3ee812d0e0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f3ee400efc0 tx=0x7f3ee400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.420+0000 7f0cb6ffd700 1 -- 172.21.15.40:0/1066995734 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0cb80039e0 con 0x7f0cc806c990 2023-09-30T22:27:48.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.420+0000 7f3eefd7c700 1 -- 172.21.15.40:0/387408144 shutdown_connections 2023-09-30T22:27:48.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.420+0000 7f3eefd7c700 1 --2- 172.21.15.40:0/387408144 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ee809e480 0x7f3ee812db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.420+0000 7f3eefd7c700 1 --2- 172.21.15.40:0/387408144 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ee809c890 0x7f3ee812d0e0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.420+0000 7f3eefd7c700 1 --2- 172.21.15.40:0/387408144 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ee809d920 0x7f3ee812d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.420+0000 7f3eefd7c700 1 -- 172.21.15.40:0/387408144 >> 172.21.15.40:0/387408144 conn(0x7f3ee80a7080 msgr2=0x7f3ee80a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:48.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.420+0000 7f0ccc9df700 1 -- 172.21.15.40:0/1066995734 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc8062380 con 0x7f0cc806c990 2023-09-30T22:27:48.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.420+0000 7f0cb6ffd700 1 -- 172.21.15.40:0/1066995734 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f0cb803ea80 con 0x7f0cc806c990 2023-09-30T22:27:48.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.421+0000 7f3eefd7c700 1 -- 172.21.15.40:0/387408144 shutdown_connections 2023-09-30T22:27:48.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.425+0000 7f3eefd7c700 1 -- 172.21.15.40:0/387408144 wait complete. 2023-09-30T22:27:48.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.425+0000 7f0cb6ffd700 1 -- 172.21.15.40:0/1066995734 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0cb80196d0 con 0x7f0cc806c990 2023-09-30T22:27:48.438 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:48.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.477+0000 7fd89bed1700 1 Processor -- start 2023-09-30T22:27:48.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.477+0000 7fd89bed1700 1 -- start start 2023-09-30T22:27:48.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.478+0000 7fd89bed1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd89409c890 0x7fd89409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.478+0000 7fd89bed1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd89409d920 0x7fd89409dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.478+0000 7fd89bed1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd89409e2b0 0x7fd89413ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.478+0000 7fd89bed1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8940a29d0 con 0x7fd89409e2b0 2023-09-30T22:27:48.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.478+0000 7fd89bed1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd89409fb40 con 0x7fd89409c890 2023-09-30T22:27:48.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.478+0000 7fd89bed1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8940a2600 con 0x7fd89409d920 2023-09-30T22:27:48.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.478+0000 7fd899c6d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd89409c890 0x7fd89409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.478+0000 7fd89946c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd89409d920 0x7fd89409dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.478+0000 7fd899c6d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd89409c890 0x7fd89409cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41390/0 (socket says 172.21.15.40:41390) 2023-09-30T22:27:48.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.478+0000 7fd89946c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd89409d920 0x7fd89409dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:35038/0 (socket says 172.21.15.40:35038) 2023-09-30T22:27:48.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.478+0000 7fd899c6d700 1 -- 172.21.15.40:0/413255379 learned_addr learned my addr 172.21.15.40:0/413255379 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:48.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.478+0000 7fd89a46e700 1 --2- 172.21.15.40:0/413255379 >> v2:172.21.15.40:3300/0 conn(0x7fd89409e2b0 0x7fd89413ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.479+0000 7fd899c6d700 1 -- 172.21.15.40:0/413255379 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd89409d920 msgr2=0x7fd89409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:48.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.479+0000 7fd899c6d700 1 --2- 172.21.15.40:0/413255379 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd89409d920 0x7fd89409dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.479+0000 7fd899c6d700 1 -- 172.21.15.40:0/413255379 >> v2:172.21.15.40:3300/0 conn(0x7fd89409e2b0 msgr2=0x7fd89413ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:48.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.479+0000 7fd899c6d700 1 --2- 172.21.15.40:0/413255379 >> v2:172.21.15.40:3300/0 conn(0x7fd89409e2b0 0x7fd89413ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.479+0000 7fd899c6d700 1 -- 172.21.15.40:0/413255379 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89409e720 con 0x7fd89409c890 2023-09-30T22:27:48.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.479+0000 7fd89946c700 1 --2- 172.21.15.40:0/413255379 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd89409d920 0x7fd89409dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:48.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.479+0000 7fd89a46e700 1 --2- 172.21.15.40:0/413255379 >> v2:172.21.15.40:3300/0 conn(0x7fd89409e2b0 0x7fd89413ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:48.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.479+0000 7fd899c6d700 1 --2- 172.21.15.40:0/413255379 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd89409c890 0x7fd89409cc60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd8900098f0 tx=0x7fd890009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a4d288f76118163 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:48.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.479+0000 7fd898c6b700 1 -- 172.21.15.40:0/413255379 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd890005e30 con 0x7fd89409c890 2023-09-30T22:27:48.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.479+0000 7fd898c6b700 1 -- 172.21.15.40:0/413255379 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd890004030 con 0x7fd89409c890 2023-09-30T22:27:48.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.479+0000 7fd898c6b700 1 -- 172.21.15.40:0/413255379 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8900043e0 con 0x7fd89409c890 2023-09-30T22:27:48.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.480+0000 7fd89bed1700 1 -- 172.21.15.40:0/413255379 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd89409c890 msgr2=0x7fd89409cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.480+0000 7fd89bed1700 1 --2- 172.21.15.40:0/413255379 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd89409c890 0x7fd89409cc60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd8900098f0 tx=0x7fd890009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:48.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.480+0000 7fd89bed1700 1 -- 172.21.15.40:0/413255379 shutdown_connections 2023-09-30T22:27:48.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.480+0000 7fd89bed1700 1 --2- 172.21.15.40:0/413255379 >> v2:172.21.15.40:3300/0 conn(0x7fd89409e2b0 0x7fd89413ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.480+0000 7fd89bed1700 1 --2- 172.21.15.40:0/413255379 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd89409c890 0x7fd89409cc60 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.480+0000 7fd89bed1700 1 --2- 172.21.15.40:0/413255379 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd89409d920 0x7fd89409dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.480+0000 7fd89bed1700 1 -- 172.21.15.40:0/413255379 >> 172.21.15.40:0/413255379 conn(0x7fd8940a7080 msgr2=0x7fd8940a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:48.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.480+0000 7fd89bed1700 1 -- 172.21.15.40:0/413255379 shutdown_connections 2023-09-30T22:27:48.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.480+0000 7fd89bed1700 1 -- 172.21.15.40:0/413255379 wait complete. 2023-09-30T22:27:48.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.481+0000 7fd89bed1700 1 Processor -- start 2023-09-30T22:27:48.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.481+0000 7fd89bed1700 1 -- start start 2023-09-30T22:27:48.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.482+0000 7fd89bed1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd89409c890 0x7fd89412d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.482+0000 7fd89bed1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd89409d920 0x7fd89412da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.482+0000 7fd89bed1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd89409e2b0 0x7fd89412df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.482+0000 7fd89bed1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8941307a0 con 0x7fd89409d920 2023-09-30T22:27:48.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.482+0000 7fd89bed1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd894130d40 con 0x7fd89409e2b0 2023-09-30T22:27:48.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.482+0000 7fd89bed1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8940a5da0 con 0x7fd89409c890 2023-09-30T22:27:48.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.482+0000 7fd899c6d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd89409c890 0x7fd89412d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.482+0000 7fd899c6d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd89409c890 0x7fd89412d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:35052/0 (socket says 172.21.15.40:35052) 2023-09-30T22:27:48.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.482+0000 7fd899c6d700 1 -- 172.21.15.40:0/2190645831 learned_addr learned my addr 172.21.15.40:0/2190645831 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:48.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.482+0000 7fd89a46e700 1 --2- 172.21.15.40:0/2190645831 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd89409e2b0 0x7fd89412df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.482+0000 7fd89946c700 1 --2- 172.21.15.40:0/2190645831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd89409d920 0x7fd89412da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.482+0000 7fd899c6d700 1 -- 172.21.15.40:0/2190645831 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd89409e2b0 msgr2=0x7fd89412df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.482+0000 7fd899c6d700 1 --2- 172.21.15.40:0/2190645831 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd89409e2b0 0x7fd89412df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.482+0000 7fd899c6d700 1 -- 172.21.15.40:0/2190645831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd89409d920 msgr2=0x7fd89412da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.482+0000 7fd899c6d700 1 --2- 172.21.15.40:0/2190645831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd89409d920 0x7fd89412da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.482+0000 7fd899c6d700 1 -- 172.21.15.40:0/2190645831 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8840094a0 con 0x7fd89409c890 2023-09-30T22:27:48.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.482+0000 7fd89a46e700 1 --2- 172.21.15.40:0/2190645831 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd89409e2b0 0x7fd89412df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:48.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.482+0000 7fd899c6d700 1 --2- 172.21.15.40:0/2190645831 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd89409c890 0x7fd89412d510 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd890009c40 tx=0x7fd890004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:48.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.483+0000 7fd88a7fc700 1 -- 172.21.15.40:0/2190645831 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd890006b70 con 0x7fd89409c890 2023-09-30T22:27:48.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.483+0000 7fd88a7fc700 1 -- 172.21.15.40:0/2190645831 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8900043f0 con 0x7fd89409c890 2023-09-30T22:27:48.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.483+0000 7fd88a7fc700 1 -- 172.21.15.40:0/2190645831 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd890011640 con 0x7fd89409c890 2023-09-30T22:27:48.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.483+0000 7fd89bed1700 1 -- 172.21.15.40:0/2190645831 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd88c009a70 con 0x7fd89409c890 2023-09-30T22:27:48.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.483+0000 7fd89bed1700 1 -- 172.21.15.40:0/2190645831 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd890009500 con 0x7fd89409c890 2023-09-30T22:27:48.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.484+0000 7fd89bed1700 1 -- 172.21.15.40:0/2190645831 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd894062380 con 0x7fd89409c890 2023-09-30T22:27:48.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.484+0000 7fd88a7fc700 1 -- 172.21.15.40:0/2190645831 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd890018070 con 0x7fd89409c890 2023-09-30T22:27:48.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.484+0000 7fd88a7fc700 1 -- 172.21.15.40:0/2190645831 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd8900417c0 con 0x7fd89409c890 2023-09-30T22:27:48.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.489+0000 7fd88a7fc700 1 -- 172.21.15.40:0/2190645831 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd890045060 con 0x7fd89409c890 2023-09-30T22:27:48.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.589+0000 7fa674c12700 1 -- 172.21.15.40:0/3103015564 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa670071980 con 0x7fa67012d6d0 2023-09-30T22:27:48.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.589+0000 7fa65effd700 1 -- 172.21.15.40:0/3103015564 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa66001b3b0 con 0x7fa67012d6d0 2023-09-30T22:27:48.590 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:48.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.591+0000 7fa674c12700 1 -- 172.21.15.40:0/3103015564 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa67012d6d0 msgr2=0x7fa6701287f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.591+0000 7fa674c12700 1 --2- 172.21.15.40:0/3103015564 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa67012d6d0 0x7fa6701287f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa66000e9e0 tx=0x7fa66000ecf0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.591+0000 7fa674c12700 1 -- 172.21.15.40:0/3103015564 shutdown_connections 2023-09-30T22:27:48.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.591+0000 7fa674c12700 1 --2- 172.21.15.40:0/3103015564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa67012eea0 0x7fa670129270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.591+0000 7fa674c12700 1 --2- 172.21.15.40:0/3103015564 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa67012d6d0 0x7fa6701287f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.591+0000 7fa674c12700 1 --2- 172.21.15.40:0/3103015564 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa67012e590 0x7fa670128d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.591+0000 7fa674c12700 1 -- 172.21.15.40:0/3103015564 >> 172.21.15.40:0/3103015564 conn(0x7fa6700a2a00 msgr2=0x7fa670099a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:48.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.592+0000 7fa674c12700 1 -- 172.21.15.40:0/3103015564 shutdown_connections 2023-09-30T22:27:48.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.592+0000 7fa674c12700 1 -- 172.21.15.40:0/3103015564 wait complete. 2023-09-30T22:27:48.604 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:48.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.649+0000 7f0ccc9df700 1 -- 172.21.15.40:0/1066995734 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0cc80713c0 con 0x7f0cc806c990 2023-09-30T22:27:48.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.649+0000 7f0cb6ffd700 1 -- 172.21.15.40:0/1066995734 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0cb8017070 con 0x7f0cc806c990 2023-09-30T22:27:48.650 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:48.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.651+0000 7f0ccc9df700 1 -- 172.21.15.40:0/1066995734 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cc806c990 msgr2=0x7f0cc808e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.651+0000 7f0ccc9df700 1 --2- 172.21.15.40:0/1066995734 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cc806c990 0x7f0cc808e850 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8001eb0 tx=0x7f0cb800c800 comp rx=0 tx=0).stop 2023-09-30T22:27:48.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.652+0000 7f0ccc9df700 1 -- 172.21.15.40:0/1066995734 shutdown_connections 2023-09-30T22:27:48.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.652+0000 7f0ccc9df700 1 --2- 172.21.15.40:0/1066995734 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0cc813d900 0x7f0cc813fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.652+0000 7f0ccc9df700 1 --2- 172.21.15.40:0/1066995734 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cc806c990 0x7f0cc808e850 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.652+0000 7f0ccc9df700 1 --2- 172.21.15.40:0/1066995734 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0cc806d470 0x7f0cc813f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.652+0000 7f0ccc9df700 1 -- 172.21.15.40:0/1066995734 >> 172.21.15.40:0/1066995734 conn(0x7f0cc80a41a0 msgr2=0x7f0cc8097670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:48.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.652+0000 7f0ccc9df700 1 -- 172.21.15.40:0/1066995734 shutdown_connections 2023-09-30T22:27:48.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.652+0000 7f0ccc9df700 1 -- 172.21.15.40:0/1066995734 wait complete. 2023-09-30T22:27:48.664 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:48.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.690+0000 7fd89bed1700 1 -- 172.21.15.40:0/2190645831 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd89412f310 con 0x7fd89409c890 2023-09-30T22:27:48.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.691+0000 7fd88a7fc700 1 -- 172.21.15.40:0/2190645831 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd890045020 con 0x7fd89409c890 2023-09-30T22:27:48.691 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:48.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.693+0000 7fd89bed1700 1 -- 172.21.15.40:0/2190645831 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd89409c890 msgr2=0x7fd89412d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.693+0000 7fd89bed1700 1 --2- 172.21.15.40:0/2190645831 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd89409c890 0x7fd89412d510 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd890009c40 tx=0x7fd890004750 comp rx=0 tx=0).stop 2023-09-30T22:27:48.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.693+0000 7fd89bed1700 1 -- 172.21.15.40:0/2190645831 shutdown_connections 2023-09-30T22:27:48.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.693+0000 7fd89bed1700 1 --2- 172.21.15.40:0/2190645831 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd89409c890 0x7fd89412d510 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.693+0000 7fd89bed1700 1 --2- 172.21.15.40:0/2190645831 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd89409e2b0 0x7fd89412df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.693+0000 7fd89bed1700 1 --2- 172.21.15.40:0/2190645831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd89409d920 0x7fd89412da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.693+0000 7fd89bed1700 1 -- 172.21.15.40:0/2190645831 >> 172.21.15.40:0/2190645831 conn(0x7fd8940a7080 msgr2=0x7fd8940a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:48.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.693+0000 7fd89bed1700 1 -- 172.21.15.40:0/2190645831 shutdown_connections 2023-09-30T22:27:48.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:48.693+0000 7fd89bed1700 1 -- 172.21.15.40:0/2190645831 wait complete. 2023-09-30T22:27:48.705 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:49.439 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:49.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.580+0000 7f68c4f00700 1 Processor -- start 2023-09-30T22:27:49.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.580+0000 7f68c4f00700 1 -- start start 2023-09-30T22:27:49.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.581+0000 7f68c4f00700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f68c009c890 0x7f68c009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.581+0000 7f68c4f00700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f68c009d920 0x7f68c009dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.581+0000 7f68c4f00700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f68c009e2b0 0x7f68c013ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.581+0000 7f68c4f00700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c00a29d0 con 0x7f68c009c890 2023-09-30T22:27:49.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.581+0000 7f68c4f00700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c009fb40 con 0x7f68c009d920 2023-09-30T22:27:49.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.581+0000 7f68c4f00700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68c00a2600 con 0x7f68c009e2b0 2023-09-30T22:27:49.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.581+0000 7f68bdd9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f68c009d920 0x7f68c009dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:49.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.581+0000 7f68be59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f68c009c890 0x7f68c009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:49.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.581+0000 7f68bed9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f68c009e2b0 0x7f68c013ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:49.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.581+0000 7f68bdd9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f68c009d920 0x7f68c009dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41410/0 (socket says 172.21.15.40:41410) 2023-09-30T22:27:49.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.581+0000 7f68bed9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f68c009e2b0 0x7f68c013ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:35064/0 (socket says 172.21.15.40:35064) 2023-09-30T22:27:49.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.581+0000 7f68bdd9b700 1 -- 172.21.15.40:0/2763612336 learned_addr learned my addr 172.21.15.40:0/2763612336 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:49.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.581+0000 7f68be59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f68c009c890 0x7f68c009cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51566/0 (socket says 172.21.15.40:51566) 2023-09-30T22:27:49.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.581+0000 7f68bed9d700 1 -- 172.21.15.40:0/2763612336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f68c009d920 msgr2=0x7f68c009dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:49.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.581+0000 7f68bed9d700 1 --2- 172.21.15.40:0/2763612336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f68c009d920 0x7f68c009dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.581+0000 7f68bed9d700 1 -- 172.21.15.40:0/2763612336 >> v2:172.21.15.40:3300/0 conn(0x7f68c009c890 msgr2=0x7f68c009cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:49.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.581+0000 7f68bed9d700 1 --2- 172.21.15.40:0/2763612336 >> v2:172.21.15.40:3300/0 conn(0x7f68c009c890 0x7f68c009cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.581+0000 7f68bed9d700 1 -- 172.21.15.40:0/2763612336 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c009fed0 con 0x7f68c009e2b0 2023-09-30T22:27:49.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.581+0000 7f68be59c700 1 --2- 172.21.15.40:0/2763612336 >> v2:172.21.15.40:3300/0 conn(0x7f68c009c890 0x7f68c009cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:49.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.581+0000 7f68bdd9b700 1 --2- 172.21.15.40:0/2763612336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f68c009d920 0x7f68c009dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:49.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.581+0000 7f68bed9d700 1 --2- 172.21.15.40:0/2763612336 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f68c009e2b0 0x7f68c013ac10 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f68b8009d90 tx=0x7f68b800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65ca89d811171118 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:49.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.581+0000 7f68bd59a700 1 -- 172.21.15.40:0/2763612336 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b800e070 con 0x7f68c009e2b0 2023-09-30T22:27:49.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.582+0000 7f68bd59a700 1 -- 172.21.15.40:0/2763612336 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b800bb20 con 0x7f68c009e2b0 2023-09-30T22:27:49.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.582+0000 7f68bd59a700 1 -- 172.21.15.40:0/2763612336 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b8012430 con 0x7f68c009e2b0 2023-09-30T22:27:49.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.582+0000 7f68c4f00700 1 -- 172.21.15.40:0/2763612336 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f68c009e2b0 msgr2=0x7f68c013ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:49.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.582+0000 7f68c4f00700 1 --2- 172.21.15.40:0/2763612336 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f68c009e2b0 0x7f68c013ac10 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f68b8009d90 tx=0x7f68b800b330 comp rx=0 tx=0).stop 2023-09-30T22:27:49.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.582+0000 7f68c4f00700 1 -- 172.21.15.40:0/2763612336 shutdown_connections 2023-09-30T22:27:49.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.582+0000 7f68c4f00700 1 --2- 172.21.15.40:0/2763612336 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f68c009e2b0 0x7f68c013ac10 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.582+0000 7f68c4f00700 1 --2- 172.21.15.40:0/2763612336 >> v2:172.21.15.40:3300/0 conn(0x7f68c009c890 0x7f68c009cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.582+0000 7f68c4f00700 1 --2- 172.21.15.40:0/2763612336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f68c009d920 0x7f68c009dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.582+0000 7f68c4f00700 1 -- 172.21.15.40:0/2763612336 >> 172.21.15.40:0/2763612336 conn(0x7f68c00a7080 msgr2=0x7f68c00a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:49.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.582+0000 7f68c4f00700 1 -- 172.21.15.40:0/2763612336 shutdown_connections 2023-09-30T22:27:49.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.582+0000 7f68c4f00700 1 -- 172.21.15.40:0/2763612336 wait complete. 2023-09-30T22:27:49.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.583+0000 7f68c4f00700 1 Processor -- start 2023-09-30T22:27:49.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.583+0000 7f68c4f00700 1 -- start start 2023-09-30T22:27:49.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.584+0000 7f68c4f00700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68c009c890 0x7f68c012d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.584+0000 7f68c4f00700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f68c009d920 0x7f68c012d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.584+0000 7f68c4f00700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f68c009e2b0 0x7f68c012ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.584+0000 7f68c4f00700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c009ecf0 con 0x7f68c009c890 2023-09-30T22:27:49.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.584+0000 7f68c4f00700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c012efd0 con 0x7f68c009d920 2023-09-30T22:27:49.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.584+0000 7f68c4f00700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68c0130570 con 0x7f68c009e2b0 2023-09-30T22:27:49.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.584+0000 7f68be59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68c009c890 0x7f68c012d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:49.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.584+0000 7f68bed9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f68c009e2b0 0x7f68c012ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:49.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.584+0000 7f68be59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68c009c890 0x7f68c012d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51576/0 (socket says 172.21.15.40:51576) 2023-09-30T22:27:49.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.584+0000 7f68be59c700 1 -- 172.21.15.40:0/116474759 learned_addr learned my addr 172.21.15.40:0/116474759 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:49.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.584+0000 7f68bdd9b700 1 --2- 172.21.15.40:0/116474759 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f68c009d920 0x7f68c012d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:49.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.584+0000 7f68be59c700 1 -- 172.21.15.40:0/116474759 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f68c009e2b0 msgr2=0x7f68c012ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:49.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.584+0000 7f68be59c700 1 --2- 172.21.15.40:0/116474759 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f68c009e2b0 0x7f68c012ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.584+0000 7f68be59c700 1 -- 172.21.15.40:0/116474759 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f68c009d920 msgr2=0x7f68c012d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:49.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.584+0000 7f68be59c700 1 --2- 172.21.15.40:0/116474759 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f68c009d920 0x7f68c012d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.584+0000 7f68be59c700 1 -- 172.21.15.40:0/116474759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b4009430 con 0x7f68c009c890 2023-09-30T22:27:49.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.584+0000 7f68bed9d700 1 --2- 172.21.15.40:0/116474759 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f68c009e2b0 0x7f68c012ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:49.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.584+0000 7f68bdd9b700 1 --2- 172.21.15.40:0/116474759 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f68c009d920 0x7f68c012d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:49.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.584+0000 7f68be59c700 1 --2- 172.21.15.40:0/116474759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68c009c890 0x7f68c012d340 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f68b400e960 tx=0x7f68b400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:49.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.585+0000 7f68aeffd700 1 -- 172.21.15.40:0/116474759 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b40096c0 con 0x7f68c009c890 2023-09-30T22:27:49.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.585+0000 7f68aeffd700 1 -- 172.21.15.40:0/116474759 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b4005a20 con 0x7f68c009c890 2023-09-30T22:27:49.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.585+0000 7f68c4f00700 1 -- 172.21.15.40:0/116474759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b0009550 con 0x7f68c009c890 2023-09-30T22:27:49.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.585+0000 7f68aeffd700 1 -- 172.21.15.40:0/116474759 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b4005db0 con 0x7f68c009c890 2023-09-30T22:27:49.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.585+0000 7f68c4f00700 1 -- 172.21.15.40:0/116474759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b8009a70 con 0x7f68c009c890 2023-09-30T22:27:49.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.585+0000 7f68aeffd700 1 -- 172.21.15.40:0/116474759 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f68b4013680 con 0x7f68c009c890 2023-09-30T22:27:49.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.586+0000 7f68aeffd700 1 -- 172.21.15.40:0/116474759 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f68b403f860 con 0x7f68c009c890 2023-09-30T22:27:49.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.586+0000 7f68c4f00700 1 -- 172.21.15.40:0/116474759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68c0062380 con 0x7f68c009c890 2023-09-30T22:27:49.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.590+0000 7f68aeffd700 1 -- 172.21.15.40:0/116474759 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f68b4020080 con 0x7f68c009c890 2023-09-30T22:27:49.605 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:49.665 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:49.706 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:49.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.739+0000 7f1655d16700 1 Processor -- start 2023-09-30T22:27:49.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.739+0000 7f1655d16700 1 -- start start 2023-09-30T22:27:49.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.739+0000 7f1655d16700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f165009d450 0x7f165009d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.739+0000 7f1655d16700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f16501308d0 0x7f1650138420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.739+0000 7f1655d16700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f165009c3b0 con 0x7f165009dd60 2023-09-30T22:27:49.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.739+0000 7f1655d16700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f165009a6b0 con 0x7f16501308d0 2023-09-30T22:27:49.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.739+0000 7f1655d16700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f165009b4f0 con 0x7f165009d450 2023-09-30T22:27:49.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.740+0000 7f164effd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f165009dd60 0x7f16501301c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57262/0 (socket says 172.21.15.40:57262) 2023-09-30T22:27:49.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.740+0000 7f164effd700 1 -- 172.21.15.40:0/4060127813 learned_addr learned my addr 172.21.15.40:0/4060127813 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:27:49.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.740+0000 7f164ffff700 1 --2- 172.21.15.40:0/4060127813 >> v2:172.21.15.40:3300/0 conn(0x7f16501308d0 0x7f1650138420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:49.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.740+0000 7f164f7fe700 1 --2- 172.21.15.40:0/4060127813 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f165009d450 0x7f165009d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:49.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.740+0000 7f164ffff700 1 -- 172.21.15.40:0/4060127813 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f165009d450 msgr2=0x7f165009d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:49.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.740+0000 7f164ffff700 1 --2- 172.21.15.40:0/4060127813 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f165009d450 0x7f165009d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.740+0000 7f164ffff700 1 -- 172.21.15.40:0/4060127813 >> v1:172.21.15.40:6789/0 conn(0x7f165009dd60 legacy=0x7f16501301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:49.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.740+0000 7f164ffff700 1 -- 172.21.15.40:0/4060127813 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165009af90 con 0x7f16501308d0 2023-09-30T22:27:49.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.740+0000 7f164e7fc700 1 -- 172.21.15.40:0/4060127813 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1306307310 0 0) 0x7f165009c3b0 con 0x7f165009dd60 2023-09-30T22:27:49.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.740+0000 7f164f7fe700 1 --2- 172.21.15.40:0/4060127813 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f165009d450 0x7f165009d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:49.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.740+0000 7f164ffff700 1 --2- 172.21.15.40:0/4060127813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16501308d0 0x7f1650138420 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f1648009c80 tx=0x7f1648009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66e029f27244e95e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:49.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.740+0000 7f164e7fc700 1 -- 172.21.15.40:0/4060127813 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164800ca00 con 0x7f16501308d0 2023-09-30T22:27:49.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.741+0000 7f164e7fc700 1 -- 172.21.15.40:0/4060127813 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164800cb60 con 0x7f16501308d0 2023-09-30T22:27:49.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.741+0000 7f164e7fc700 1 -- 172.21.15.40:0/4060127813 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1648011400 con 0x7f16501308d0 2023-09-30T22:27:49.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.741+0000 7f1655d16700 1 -- 172.21.15.40:0/4060127813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16501308d0 msgr2=0x7f1650138420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:49.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.741+0000 7f1655d16700 1 --2- 172.21.15.40:0/4060127813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16501308d0 0x7f1650138420 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f1648009c80 tx=0x7f1648009f90 comp rx=0 tx=0).stop 2023-09-30T22:27:49.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.742+0000 7f1655d16700 1 -- 172.21.15.40:0/4060127813 shutdown_connections 2023-09-30T22:27:49.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.742+0000 7f1655d16700 1 --2- 172.21.15.40:0/4060127813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16501308d0 0x7f1650138420 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.742+0000 7f1655d16700 1 --2- 172.21.15.40:0/4060127813 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f165009d450 0x7f165009d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.742+0000 7f1655d16700 1 -- 172.21.15.40:0/4060127813 >> 172.21.15.40:0/4060127813 conn(0x7f16500a2a00 msgr2=0x7f16500a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:49.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.742+0000 7f1655d16700 1 -- 172.21.15.40:0/4060127813 shutdown_connections 2023-09-30T22:27:49.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.742+0000 7f1655d16700 1 -- 172.21.15.40:0/4060127813 wait complete. 2023-09-30T22:27:49.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.743+0000 7f1655d16700 1 Processor -- start 2023-09-30T22:27:49.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.743+0000 7f1655d16700 1 -- start start 2023-09-30T22:27:49.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.743+0000 7f1655d16700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f165009d450 0x7f16501c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.743+0000 7f1655d16700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f165009dd60 0x7f16501c8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.743+0000 7f1655d16700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f16501308d0 0x7f16501c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.743+0000 7f1655d16700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1650121790 con 0x7f165009dd60 2023-09-30T22:27:49.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.743+0000 7f1655d16700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1650122150 con 0x7f16501308d0 2023-09-30T22:27:49.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.743+0000 7f1655d16700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f165011f9d0 con 0x7f165009d450 2023-09-30T22:27:49.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.743+0000 7f164ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f16501308d0 0x7f16501c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:49.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.743+0000 7f164ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f16501308d0 0x7f16501c8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41438/0 (socket says 172.21.15.40:41438) 2023-09-30T22:27:49.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.743+0000 7f164ffff700 1 -- 172.21.15.40:0/2111453335 learned_addr learned my addr 172.21.15.40:0/2111453335 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:49.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.744+0000 7f164ffff700 1 -- 172.21.15.40:0/2111453335 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f165009d450 msgr2=0x7f16501c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:49.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.744+0000 7f164ffff700 1 --2- 172.21.15.40:0/2111453335 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f165009d450 0x7f16501c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.744+0000 7f164ffff700 1 -- 172.21.15.40:0/2111453335 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f165009dd60 msgr2=0x7f16501c8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:49.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.744+0000 7f164ffff700 1 --2- 172.21.15.40:0/2111453335 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f165009dd60 0x7f16501c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.744+0000 7f164ffff700 1 -- 172.21.15.40:0/2111453335 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16400094a0 con 0x7f16501308d0 2023-09-30T22:27:49.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.744+0000 7f164ffff700 1 --2- 172.21.15.40:0/2111453335 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f16501308d0 0x7f16501c8dd0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f165009c540 tx=0x7f1648004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:49.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.744+0000 7f1637fff700 1 -- 172.21.15.40:0/2111453335 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164801f070 con 0x7f16501308d0 2023-09-30T22:27:49.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.744+0000 7f1637fff700 1 -- 172.21.15.40:0/2111453335 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1648009410 con 0x7f16501308d0 2023-09-30T22:27:49.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.744+0000 7f1655d16700 1 -- 172.21.15.40:0/2111453335 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f164800d040 con 0x7f16501308d0 2023-09-30T22:27:49.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.744+0000 7f1637fff700 1 -- 172.21.15.40:0/2111453335 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164800cee0 con 0x7f16501308d0 2023-09-30T22:27:49.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.744+0000 7f1655d16700 1 -- 172.21.15.40:0/2111453335 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f165009c5d0 con 0x7f16501308d0 2023-09-30T22:27:49.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.745+0000 7f1637fff700 1 -- 172.21.15.40:0/2111453335 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1648003a20 con 0x7f16501308d0 2023-09-30T22:27:49.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.745+0000 7f1637fff700 1 -- 172.21.15.40:0/2111453335 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f1648040d20 con 0x7f16501308d0 2023-09-30T22:27:49.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.745+0000 7f1655d16700 1 -- 172.21.15.40:0/2111453335 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1650062380 con 0x7f16501308d0 2023-09-30T22:27:49.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.754+0000 7f1637fff700 1 -- 172.21.15.40:0/2111453335 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1648003cd0 con 0x7f16501308d0 2023-09-30T22:27:49.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.793+0000 7f68c4f00700 1 -- 172.21.15.40:0/116474759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f68c012ecc0 con 0x7f68c009c890 2023-09-30T22:27:49.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.794+0000 7f68aeffd700 1 -- 172.21.15.40:0/116474759 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f68b4013930 con 0x7f68c009c890 2023-09-30T22:27:49.794 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:49.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.796+0000 7f68c4f00700 1 -- 172.21.15.40:0/116474759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68c009c890 msgr2=0x7f68c012d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:49.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.796+0000 7f68c4f00700 1 --2- 172.21.15.40:0/116474759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68c009c890 0x7f68c012d340 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f68b400e960 tx=0x7f68b400ec70 comp rx=0 tx=0).stop 2023-09-30T22:27:49.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.796+0000 7f68c4f00700 1 -- 172.21.15.40:0/116474759 shutdown_connections 2023-09-30T22:27:49.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.796+0000 7f68c4f00700 1 --2- 172.21.15.40:0/116474759 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f68c009e2b0 0x7f68c012ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.796+0000 7f68c4f00700 1 --2- 172.21.15.40:0/116474759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68c009c890 0x7f68c012d340 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.796+0000 7f68c4f00700 1 --2- 172.21.15.40:0/116474759 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f68c009d920 0x7f68c012d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.796+0000 7f68c4f00700 1 -- 172.21.15.40:0/116474759 >> 172.21.15.40:0/116474759 conn(0x7f68c00a7080 msgr2=0x7f68c00a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:49.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.798+0000 7f68c4f00700 1 -- 172.21.15.40:0/116474759 shutdown_connections 2023-09-30T22:27:49.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.798+0000 7f68c4f00700 1 -- 172.21.15.40:0/116474759 wait complete. 2023-09-30T22:27:49.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.802+0000 7f6761ab7700 1 Processor -- start 2023-09-30T22:27:49.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.803+0000 7f6761ab7700 1 -- start start 2023-09-30T22:27:49.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.803+0000 7f6761ab7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f675c12e590 0x7f675c12e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.803+0000 7f6761ab7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f675c12eea0 0x7f675c12d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.803+0000 7f6761ab7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f675c12d6d0 0x7f675c12db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.803+0000 7f6761ab7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f675c09ca30 con 0x7f675c12e590 2023-09-30T22:27:49.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.803+0000 7f6761ab7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f675c09ab70 con 0x7f675c12eea0 2023-09-30T22:27:49.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.803+0000 7f6761ab7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f675c09bd70 con 0x7f675c12d6d0 2023-09-30T22:27:49.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.803+0000 7f675b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f675c12e590 0x7f675c12e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:49.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.803+0000 7f675b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f675c12e590 0x7f675c12e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51596/0 (socket says 172.21.15.40:51596) 2023-09-30T22:27:49.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.803+0000 7f675b7fe700 1 -- 172.21.15.40:0/1760140808 learned_addr learned my addr 172.21.15.40:0/1760140808 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:49.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.803+0000 7f675bfff700 1 --2- 172.21.15.40:0/1760140808 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f675c12d6d0 0x7f675c12db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:49.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.803+0000 7f675affd700 1 --2- 172.21.15.40:0/1760140808 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f675c12eea0 0x7f675c12d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:49.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.804+0000 7f675b7fe700 1 -- 172.21.15.40:0/1760140808 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f675c12d6d0 msgr2=0x7f675c12db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:49.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.804+0000 7f675b7fe700 1 --2- 172.21.15.40:0/1760140808 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f675c12d6d0 0x7f675c12db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.804+0000 7f675b7fe700 1 -- 172.21.15.40:0/1760140808 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f675c12eea0 msgr2=0x7f675c12d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:49.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.804+0000 7f675b7fe700 1 --2- 172.21.15.40:0/1760140808 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f675c12eea0 0x7f675c12d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.804+0000 7f675b7fe700 1 -- 172.21.15.40:0/1760140808 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f675c09b270 con 0x7f675c12e590 2023-09-30T22:27:49.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.804+0000 7f675b7fe700 1 --2- 172.21.15.40:0/1760140808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f675c12e590 0x7f675c12e960 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f674c0098f0 tx=0x7f674c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5b5c80d0bf221b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:49.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.804+0000 7f675a7fc700 1 -- 172.21.15.40:0/1760140808 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c010a90 con 0x7f675c12e590 2023-09-30T22:27:49.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.804+0000 7f675a7fc700 1 -- 172.21.15.40:0/1760140808 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674c010bf0 con 0x7f675c12e590 2023-09-30T22:27:49.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.804+0000 7f675a7fc700 1 -- 172.21.15.40:0/1760140808 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c018440 con 0x7f675c12e590 2023-09-30T22:27:49.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.805+0000 7f6761ab7700 1 -- 172.21.15.40:0/1760140808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f675c12e590 msgr2=0x7f675c12e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:49.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.805+0000 7f6761ab7700 1 --2- 172.21.15.40:0/1760140808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f675c12e590 0x7f675c12e960 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f674c0098f0 tx=0x7f674c009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:49.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.805+0000 7f6761ab7700 1 -- 172.21.15.40:0/1760140808 shutdown_connections 2023-09-30T22:27:49.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.805+0000 7f6761ab7700 1 --2- 172.21.15.40:0/1760140808 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f675c12d6d0 0x7f675c12db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.805+0000 7f6761ab7700 1 --2- 172.21.15.40:0/1760140808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f675c12e590 0x7f675c12e960 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.805+0000 7f6761ab7700 1 --2- 172.21.15.40:0/1760140808 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f675c12eea0 0x7f675c12d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.805+0000 7f6761ab7700 1 -- 172.21.15.40:0/1760140808 >> 172.21.15.40:0/1760140808 conn(0x7f675c0a2a00 msgr2=0x7f675c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:49.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.805+0000 7f6761ab7700 1 -- 172.21.15.40:0/1760140808 shutdown_connections 2023-09-30T22:27:49.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.805+0000 7f6761ab7700 1 -- 172.21.15.40:0/1760140808 wait complete. 2023-09-30T22:27:49.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.806+0000 7f6761ab7700 1 Processor -- start 2023-09-30T22:27:49.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.806+0000 7f6761ab7700 1 -- start start 2023-09-30T22:27:49.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.806+0000 7f6761ab7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f675c12d6d0 0x7f675c11a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.807+0000 7f6761ab7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f675c12e590 0x7f675c11af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.807+0000 7f6761ab7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f675c12eea0 0x7f675c11b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.807+0000 7f6761ab7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675c11be60 con 0x7f675c12d6d0 2023-09-30T22:27:49.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.807+0000 7f6761ab7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f675c11c550 con 0x7f675c12eea0 2023-09-30T22:27:49.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.807+0000 7f6761ab7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f675c11cb70 con 0x7f675c12e590 2023-09-30T22:27:49.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.807+0000 7f675b7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f675c12d6d0 0x7f675c11a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:49.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.807+0000 7f675b7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f675c12d6d0 0x7f675c11a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51612/0 (socket says 172.21.15.40:51612) 2023-09-30T22:27:49.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.807+0000 7f675b7fe700 1 -- 172.21.15.40:0/3300721500 learned_addr learned my addr 172.21.15.40:0/3300721500 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:49.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.807+0000 7f675bfff700 1 --2- 172.21.15.40:0/3300721500 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f675c12eea0 0x7f675c11b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:49.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.807+0000 7f675affd700 1 --2- 172.21.15.40:0/3300721500 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f675c12e590 0x7f675c11af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:49.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.807+0000 7f675affd700 1 -- 172.21.15.40:0/3300721500 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f675c12eea0 msgr2=0x7f675c11b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:49.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.807+0000 7f675affd700 1 --2- 172.21.15.40:0/3300721500 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f675c12eea0 0x7f675c11b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.807+0000 7f675affd700 1 -- 172.21.15.40:0/3300721500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f675c12d6d0 msgr2=0x7f675c11a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:49.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.807+0000 7f675affd700 1 --2- 172.21.15.40:0/3300721500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f675c12d6d0 0x7f675c11a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.807+0000 7f675affd700 1 -- 172.21.15.40:0/3300721500 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f674c009550 con 0x7f675c12e590 2023-09-30T22:27:49.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.807+0000 7f675bfff700 1 --2- 172.21.15.40:0/3300721500 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f675c12eea0 0x7f675c11b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:49.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.807+0000 7f675affd700 1 --2- 172.21.15.40:0/3300721500 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f675c12e590 0x7f675c11af10 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f675000e810 tx=0x7f675000eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:49.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.808+0000 7f6743fff700 1 -- 172.21.15.40:0/3300721500 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675000c070 con 0x7f675c12e590 2023-09-30T22:27:49.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.808+0000 7f6743fff700 1 -- 172.21.15.40:0/3300721500 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6750013610 con 0x7f675c12e590 2023-09-30T22:27:49.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.808+0000 7f6761ab7700 1 -- 172.21.15.40:0/3300721500 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f675c11e180 con 0x7f675c12e590 2023-09-30T22:27:49.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.808+0000 7f6743fff700 1 -- 172.21.15.40:0/3300721500 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67500139a0 con 0x7f675c12e590 2023-09-30T22:27:49.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.808+0000 7f6761ab7700 1 -- 172.21.15.40:0/3300721500 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f675c09b4b0 con 0x7f675c12e590 2023-09-30T22:27:49.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.809+0000 7f6743fff700 1 -- 172.21.15.40:0/3300721500 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6750013b00 con 0x7f675c12e590 2023-09-30T22:27:49.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.809+0000 7f6743fff700 1 -- 172.21.15.40:0/3300721500 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f675003f470 con 0x7f675c12e590 2023-09-30T22:27:49.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.809+0000 7f6761ab7700 1 -- 172.21.15.40:0/3300721500 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f675c062380 con 0x7f675c12e590 2023-09-30T22:27:49.814 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:49.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.814+0000 7f6743fff700 1 -- 172.21.15.40:0/3300721500 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f675001c400 con 0x7f675c12e590 2023-09-30T22:27:49.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.884+0000 7f9d7c621700 1 Processor -- start 2023-09-30T22:27:49.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.884+0000 7f9d7c621700 1 -- start start 2023-09-30T22:27:49.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.884+0000 7f9d7c621700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d7406fb50 0x7f9d74136c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.884+0000 7f9d7c621700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d741371b0 0x7f9d74139590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.884+0000 7f9d7c621700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d74070830 con 0x7f9d7406f070 2023-09-30T22:27:49.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.884+0000 7f9d7c621700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d74070ad0 con 0x7f9d7406fb50 2023-09-30T22:27:49.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.884+0000 7f9d7c621700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d74070de0 con 0x7f9d741371b0 2023-09-30T22:27:49.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.885+0000 7f9d79bbc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d7406fb50 0x7f9d74136c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:49.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.885+0000 7f9d7a3bd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9d7406f070 0x7f9d7406f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57278/0 (socket says 172.21.15.40:57278) 2023-09-30T22:27:49.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.885+0000 7f9d79bbc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d7406fb50 0x7f9d74136c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41466/0 (socket says 172.21.15.40:41466) 2023-09-30T22:27:49.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.885+0000 7f9d7a3bd700 1 -- 172.21.15.40:0/4049701155 learned_addr learned my addr 172.21.15.40:0/4049701155 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:27:49.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.885+0000 7f9d7abbe700 1 --2- 172.21.15.40:0/4049701155 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d741371b0 0x7f9d74139590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:49.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.885+0000 7f9d793bb700 1 -- 172.21.15.40:0/4049701155 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 715067891 0 0) 0x7f9d74070830 con 0x7f9d7406f070 2023-09-30T22:27:49.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.885+0000 7f9d793bb700 1 -- 172.21.15.40:0/4049701155 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d600035b0 con 0x7f9d7406f070 2023-09-30T22:27:49.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.885+0000 7f9d79bbc700 1 -- 172.21.15.40:0/4049701155 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d741371b0 msgr2=0x7f9d74139590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:49.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.885+0000 7f9d79bbc700 1 --2- 172.21.15.40:0/4049701155 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d741371b0 0x7f9d74139590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.885+0000 7f9d79bbc700 1 -- 172.21.15.40:0/4049701155 >> v1:172.21.15.40:6789/0 conn(0x7f9d7406f070 legacy=0x7f9d7406f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:49.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.885+0000 7f9d79bbc700 1 -- 172.21.15.40:0/4049701155 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7409fe20 con 0x7f9d7406fb50 2023-09-30T22:27:49.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.885+0000 7f9d7abbe700 1 --2- 172.21.15.40:0/4049701155 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d741371b0 0x7f9d74139590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:49.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.885+0000 7f9d79bbc700 1 --2- 172.21.15.40:0/4049701155 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d7406fb50 0x7f9d74136c70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9d64009870 tx=0x7f9d64009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b01c8d5384955679 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:49.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.885+0000 7f9d793bb700 1 -- 172.21.15.40:0/4049701155 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d64011830 con 0x7f9d7406fb50 2023-09-30T22:27:49.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.885+0000 7f9d793bb700 1 -- 172.21.15.40:0/4049701155 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d64011990 con 0x7f9d7406fb50 2023-09-30T22:27:49.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.885+0000 7f9d793bb700 1 -- 172.21.15.40:0/4049701155 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d64011d20 con 0x7f9d7406fb50 2023-09-30T22:27:49.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.886+0000 7f9d7c621700 1 -- 172.21.15.40:0/4049701155 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d7406fb50 msgr2=0x7f9d74136c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:49.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.886+0000 7f9d7c621700 1 --2- 172.21.15.40:0/4049701155 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d7406fb50 0x7f9d74136c70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9d64009870 tx=0x7f9d64009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:49.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.886+0000 7f9d7c621700 1 -- 172.21.15.40:0/4049701155 shutdown_connections 2023-09-30T22:27:49.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.886+0000 7f9d7c621700 1 --2- 172.21.15.40:0/4049701155 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d741371b0 0x7f9d74139590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.886+0000 7f9d7c621700 1 --2- 172.21.15.40:0/4049701155 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d7406fb50 0x7f9d74136c70 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.886+0000 7f9d7c621700 1 -- 172.21.15.40:0/4049701155 >> 172.21.15.40:0/4049701155 conn(0x7f9d740a41a0 msgr2=0x7f9d740a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:49.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.886+0000 7f9d7c621700 1 -- 172.21.15.40:0/4049701155 shutdown_connections 2023-09-30T22:27:49.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.886+0000 7f9d7c621700 1 -- 172.21.15.40:0/4049701155 wait complete. 2023-09-30T22:27:49.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.887+0000 7f9d7c621700 1 Processor -- start 2023-09-30T22:27:49.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.887+0000 7f9d7c621700 1 -- start start 2023-09-30T22:27:49.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.888+0000 7f9d7c621700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d7406f070 0x7f9d740990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.888+0000 7f9d7c621700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d7406fb50 0x7f9d740995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.888+0000 7f9d7c621700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d741371b0 0x7f9d74099b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.888+0000 7f9d7c621700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d74132350 con 0x7f9d7406fb50 2023-09-30T22:27:49.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.888+0000 7f9d7c621700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7412f0a0 con 0x7f9d7406f070 2023-09-30T22:27:49.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.888+0000 7f9d7c621700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d74136d10 con 0x7f9d741371b0 2023-09-30T22:27:49.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.888+0000 7f9d7a3bd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d7406f070 0x7f9d740990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:49.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.888+0000 7f9d7a3bd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d7406f070 0x7f9d740990b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41480/0 (socket says 172.21.15.40:41480) 2023-09-30T22:27:49.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.888+0000 7f9d7a3bd700 1 -- 172.21.15.40:0/364954344 learned_addr learned my addr 172.21.15.40:0/364954344 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:49.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.888+0000 7f9d79bbc700 1 --2- 172.21.15.40:0/364954344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d7406fb50 0x7f9d740995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:49.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.888+0000 7f9d7abbe700 1 --2- 172.21.15.40:0/364954344 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d741371b0 0x7f9d74099b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:49.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.888+0000 7f9d7a3bd700 1 -- 172.21.15.40:0/364954344 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d741371b0 msgr2=0x7f9d74099b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:49.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.888+0000 7f9d7a3bd700 1 --2- 172.21.15.40:0/364954344 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d741371b0 0x7f9d74099b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.888+0000 7f9d7a3bd700 1 -- 172.21.15.40:0/364954344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d7406fb50 msgr2=0x7f9d740995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:49.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.888+0000 7f9d7a3bd700 1 --2- 172.21.15.40:0/364954344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d7406fb50 0x7f9d740995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.888+0000 7f9d7a3bd700 1 -- 172.21.15.40:0/364954344 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d6c009a70 con 0x7f9d7406f070 2023-09-30T22:27:49.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.888+0000 7f9d7a3bd700 1 --2- 172.21.15.40:0/364954344 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d7406f070 0x7f9d740990b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9d7000c700 tx=0x7f9d7000ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:49.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.888+0000 7f9d6affd700 1 -- 172.21.15.40:0/364954344 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d70005d70 con 0x7f9d7406f070 2023-09-30T22:27:49.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.888+0000 7f9d6affd700 1 -- 172.21.15.40:0/364954344 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d700070d0 con 0x7f9d7406f070 2023-09-30T22:27:49.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.888+0000 7f9d7c621700 1 -- 172.21.15.40:0/364954344 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d640094a0 con 0x7f9d7406f070 2023-09-30T22:27:49.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.888+0000 7f9d6affd700 1 -- 172.21.15.40:0/364954344 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d70007440 con 0x7f9d7406f070 2023-09-30T22:27:49.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.889+0000 7f9d7c621700 1 -- 172.21.15.40:0/364954344 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d7412e710 con 0x7f9d7406f070 2023-09-30T22:27:49.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.889+0000 7f9d6affd700 1 -- 172.21.15.40:0/364954344 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d700075a0 con 0x7f9d7406f070 2023-09-30T22:27:49.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.889+0000 7f9d7c621700 1 -- 172.21.15.40:0/364954344 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d74062380 con 0x7f9d7406f070 2023-09-30T22:27:49.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.889+0000 7f9d6affd700 1 -- 172.21.15.40:0/364954344 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9d7003eba0 con 0x7f9d7406f070 2023-09-30T22:27:49.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:49.894+0000 7f9d6affd700 1 -- 172.21.15.40:0/364954344 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d70017020 con 0x7f9d7406f070 2023-09-30T22:27:50.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.005+0000 7f1655d16700 1 -- 172.21.15.40:0/2111453335 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1650074330 con 0x7f16501308d0 2023-09-30T22:27:50.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.006+0000 7f1637fff700 1 -- 172.21.15.40:0/2111453335 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1648015030 con 0x7f16501308d0 2023-09-30T22:27:50.006 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:50.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.008+0000 7f1655d16700 1 -- 172.21.15.40:0/2111453335 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f16501308d0 msgr2=0x7f16501c8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:50.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.008+0000 7f1655d16700 1 --2- 172.21.15.40:0/2111453335 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f16501308d0 0x7f16501c8dd0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f165009c540 tx=0x7f1648004ad0 comp rx=0 tx=0).stop 2023-09-30T22:27:50.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.008+0000 7f1655d16700 1 -- 172.21.15.40:0/2111453335 shutdown_connections 2023-09-30T22:27:50.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.008+0000 7f1655d16700 1 --2- 172.21.15.40:0/2111453335 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f165009d450 0x7f16501c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:50.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.008+0000 7f1655d16700 1 --2- 172.21.15.40:0/2111453335 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f16501308d0 0x7f16501c8dd0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:50.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.008+0000 7f1655d16700 1 --2- 172.21.15.40:0/2111453335 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f165009dd60 0x7f16501c8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:50.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.008+0000 7f1655d16700 1 -- 172.21.15.40:0/2111453335 >> 172.21.15.40:0/2111453335 conn(0x7f16500a2a00 msgr2=0x7f16500703b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:50.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.009+0000 7f1655d16700 1 -- 172.21.15.40:0/2111453335 shutdown_connections 2023-09-30T22:27:50.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.012+0000 7f1655d16700 1 -- 172.21.15.40:0/2111453335 wait complete. 2023-09-30T22:27:50.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.017+0000 7f6761ab7700 1 -- 172.21.15.40:0/3300721500 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f675c11df50 con 0x7f675c12e590 2023-09-30T22:27:50.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.017+0000 7f6743fff700 1 -- 172.21.15.40:0/3300721500 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6750010310 con 0x7f675c12e590 2023-09-30T22:27:50.018 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:50.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.020+0000 7f6761ab7700 1 -- 172.21.15.40:0/3300721500 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f675c12e590 msgr2=0x7f675c11af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:50.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.020+0000 7f6761ab7700 1 --2- 172.21.15.40:0/3300721500 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f675c12e590 0x7f675c11af10 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f675000e810 tx=0x7f675000eb20 comp rx=0 tx=0).stop 2023-09-30T22:27:50.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.021+0000 7f6761ab7700 1 -- 172.21.15.40:0/3300721500 shutdown_connections 2023-09-30T22:27:50.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.021+0000 7f6761ab7700 1 --2- 172.21.15.40:0/3300721500 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f675c12eea0 0x7f675c11b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:50.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.021+0000 7f6761ab7700 1 --2- 172.21.15.40:0/3300721500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f675c12d6d0 0x7f675c11a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:50.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.021+0000 7f6761ab7700 1 --2- 172.21.15.40:0/3300721500 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f675c12e590 0x7f675c11af10 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:50.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.021+0000 7f6761ab7700 1 -- 172.21.15.40:0/3300721500 >> 172.21.15.40:0/3300721500 conn(0x7f675c0a2a00 msgr2=0x7f675c09d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:50.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.021+0000 7f6761ab7700 1 -- 172.21.15.40:0/3300721500 shutdown_connections 2023-09-30T22:27:50.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.021+0000 7f6761ab7700 1 -- 172.21.15.40:0/3300721500 wait complete. 2023-09-30T22:27:50.025 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:50.034 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:50.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.091+0000 7f9d7c621700 1 -- 172.21.15.40:0/364954344 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9d740a04e0 con 0x7f9d7406f070 2023-09-30T22:27:50.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.091+0000 7f9d6affd700 1 -- 172.21.15.40:0/364954344 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9d70019b40 con 0x7f9d7406f070 2023-09-30T22:27:50.093 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:50.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.094+0000 7f9d7c621700 1 -- 172.21.15.40:0/364954344 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d7406f070 msgr2=0x7f9d740990b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:50.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.094+0000 7f9d7c621700 1 --2- 172.21.15.40:0/364954344 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d7406f070 0x7f9d740990b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9d7000c700 tx=0x7f9d7000ca10 comp rx=0 tx=0).stop 2023-09-30T22:27:50.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.094+0000 7f9d7c621700 1 -- 172.21.15.40:0/364954344 shutdown_connections 2023-09-30T22:27:50.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.094+0000 7f9d7c621700 1 --2- 172.21.15.40:0/364954344 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d741371b0 0x7f9d74099b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:50.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.094+0000 7f9d7c621700 1 --2- 172.21.15.40:0/364954344 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d7406f070 0x7f9d740990b0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:50.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.094+0000 7f9d7c621700 1 --2- 172.21.15.40:0/364954344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d7406fb50 0x7f9d740995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:50.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.094+0000 7f9d7c621700 1 -- 172.21.15.40:0/364954344 >> 172.21.15.40:0/364954344 conn(0x7f9d740a41a0 msgr2=0x7f9d740a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:50.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.094+0000 7f9d7c621700 1 -- 172.21.15.40:0/364954344 shutdown_connections 2023-09-30T22:27:50.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.094+0000 7f9d7c621700 1 -- 172.21.15.40:0/364954344 wait complete. 2023-09-30T22:27:50.106 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:50.815 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:50.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.956+0000 7fcd1db65700 1 Processor -- start 2023-09-30T22:27:50.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.956+0000 7fcd1db65700 1 -- start start 2023-09-30T22:27:50.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.957+0000 7fcd1db65700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcd1809c890 0x7fcd1809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:50.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.957+0000 7fcd1db65700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd1809d920 0x7fcd1809dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:50.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.957+0000 7fcd1db65700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd180a2600 con 0x7fcd1809e2b0 2023-09-30T22:27:50.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.957+0000 7fcd1db65700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd180a29d0 con 0x7fcd1809d920 2023-09-30T22:27:50.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.957+0000 7fcd1db65700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1809fb40 con 0x7fcd1809c890 2023-09-30T22:27:50.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.957+0000 7fcd177fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcd1809c890 0x7fcd1809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:50.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.957+0000 7fcd16ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd1809d920 0x7fcd1809dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:50.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.957+0000 7fcd177fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcd1809c890 0x7fcd1809cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:35120/0 (socket says 172.21.15.40:35120) 2023-09-30T22:27:50.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.957+0000 7fcd17fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fcd1809e2b0 0x7fcd1813ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57280/0 (socket says 172.21.15.40:57280) 2023-09-30T22:27:50.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.957+0000 7fcd177fe700 1 -- 172.21.15.40:0/2038557508 learned_addr learned my addr 172.21.15.40:0/2038557508 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:50.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.957+0000 7fcd16ffd700 1 -- 172.21.15.40:0/2038557508 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcd1809c890 msgr2=0x7fcd1809cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:50.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.957+0000 7fcd16ffd700 1 --2- 172.21.15.40:0/2038557508 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcd1809c890 0x7fcd1809cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:50.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.957+0000 7fcd16ffd700 1 -- 172.21.15.40:0/2038557508 >> v1:172.21.15.40:6789/0 conn(0x7fcd1809e2b0 legacy=0x7fcd1813ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:50.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.957+0000 7fcd167fc700 1 -- 172.21.15.40:0/2038557508 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3980412386 0 0) 0x7fcd180a2600 con 0x7fcd1809e2b0 2023-09-30T22:27:50.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.957+0000 7fcd16ffd700 1 -- 172.21.15.40:0/2038557508 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1809e720 con 0x7fcd1809d920 2023-09-30T22:27:50.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.957+0000 7fcd177fe700 1 --2- 172.21.15.40:0/2038557508 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcd1809c890 0x7fcd1809cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:50.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.957+0000 7fcd16ffd700 1 --2- 172.21.15.40:0/2038557508 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd1809d920 0x7fcd1809dd70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fcd00009870 tx=0x7fcd00009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6282ef91fa72a37f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:50.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.958+0000 7fcd167fc700 1 -- 172.21.15.40:0/2038557508 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd00011830 con 0x7fcd1809d920 2023-09-30T22:27:50.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.958+0000 7fcd167fc700 1 -- 172.21.15.40:0/2038557508 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd00011990 con 0x7fcd1809d920 2023-09-30T22:27:50.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.958+0000 7fcd167fc700 1 -- 172.21.15.40:0/2038557508 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd00011d20 con 0x7fcd1809d920 2023-09-30T22:27:50.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.958+0000 7fcd1db65700 1 -- 172.21.15.40:0/2038557508 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd1809d920 msgr2=0x7fcd1809dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:50.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.958+0000 7fcd1db65700 1 --2- 172.21.15.40:0/2038557508 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd1809d920 0x7fcd1809dd70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fcd00009870 tx=0x7fcd00009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:50.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.958+0000 7fcd1db65700 1 -- 172.21.15.40:0/2038557508 shutdown_connections 2023-09-30T22:27:50.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.958+0000 7fcd1db65700 1 --2- 172.21.15.40:0/2038557508 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcd1809c890 0x7fcd1809cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:50.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.958+0000 7fcd1db65700 1 --2- 172.21.15.40:0/2038557508 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd1809d920 0x7fcd1809dd70 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:50.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.958+0000 7fcd1db65700 1 -- 172.21.15.40:0/2038557508 >> 172.21.15.40:0/2038557508 conn(0x7fcd180a7080 msgr2=0x7fcd180a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:50.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.958+0000 7fcd1db65700 1 -- 172.21.15.40:0/2038557508 shutdown_connections 2023-09-30T22:27:50.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.958+0000 7fcd1db65700 1 -- 172.21.15.40:0/2038557508 wait complete. 2023-09-30T22:27:50.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.959+0000 7fcd1db65700 1 Processor -- start 2023-09-30T22:27:50.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.959+0000 7fcd1db65700 1 -- start start 2023-09-30T22:27:50.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.960+0000 7fcd1db65700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcd1809c890 0x7fcd1812b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:50.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.960+0000 7fcd1db65700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd1809d920 0x7fcd1812ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:50.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.960+0000 7fcd1db65700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd1809e2b0 0x7fcd1812bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:50.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.960+0000 7fcd1db65700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1812e5d0 con 0x7fcd1809e2b0 2023-09-30T22:27:50.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.960+0000 7fcd1db65700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd180a59b0 con 0x7fcd1809d920 2023-09-30T22:27:50.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.960+0000 7fcd1db65700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1809ecf0 con 0x7fcd1809c890 2023-09-30T22:27:50.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.960+0000 7fcd177fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcd1809c890 0x7fcd1812b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:50.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.960+0000 7fcd16ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd1809d920 0x7fcd1812ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:50.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.960+0000 7fcd16ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd1809d920 0x7fcd1812ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41496/0 (socket says 172.21.15.40:41496) 2023-09-30T22:27:50.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.960+0000 7fcd177fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcd1809c890 0x7fcd1812b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:35126/0 (socket says 172.21.15.40:35126) 2023-09-30T22:27:50.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.960+0000 7fcd16ffd700 1 -- 172.21.15.40:0/764948227 learned_addr learned my addr 172.21.15.40:0/764948227 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:50.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.960+0000 7fcd17fff700 1 --2- 172.21.15.40:0/764948227 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd1809e2b0 0x7fcd1812bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:50.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.960+0000 7fcd16ffd700 1 -- 172.21.15.40:0/764948227 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcd1809c890 msgr2=0x7fcd1812b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:50.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.960+0000 7fcd16ffd700 1 --2- 172.21.15.40:0/764948227 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcd1809c890 0x7fcd1812b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:50.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.960+0000 7fcd16ffd700 1 -- 172.21.15.40:0/764948227 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd1809e2b0 msgr2=0x7fcd1812bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:50.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.960+0000 7fcd16ffd700 1 --2- 172.21.15.40:0/764948227 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd1809e2b0 0x7fcd1812bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:50.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.960+0000 7fcd16ffd700 1 -- 172.21.15.40:0/764948227 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd08009500 con 0x7fcd1809d920 2023-09-30T22:27:50.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.960+0000 7fcd177fe700 1 --2- 172.21.15.40:0/764948227 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcd1809c890 0x7fcd1812b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:50.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.960+0000 7fcd16ffd700 1 --2- 172.21.15.40:0/764948227 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd1809d920 0x7fcd1812ba20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fcd000090b0 tx=0x7fcd00004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:50.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.961+0000 7fcd0ffff700 1 -- 172.21.15.40:0/764948227 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd00004300 con 0x7fcd1809d920 2023-09-30T22:27:50.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.961+0000 7fcd0ffff700 1 -- 172.21.15.40:0/764948227 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0001f070 con 0x7fcd1809d920 2023-09-30T22:27:50.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.961+0000 7fcd1db65700 1 -- 172.21.15.40:0/764948227 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd000094a0 con 0x7fcd1809d920 2023-09-30T22:27:50.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.961+0000 7fcd0ffff700 1 -- 172.21.15.40:0/764948227 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd000036a0 con 0x7fcd1809d920 2023-09-30T22:27:50.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.961+0000 7fcd1db65700 1 -- 172.21.15.40:0/764948227 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd1812ef90 con 0x7fcd1809d920 2023-09-30T22:27:50.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.961+0000 7fcd0ffff700 1 -- 172.21.15.40:0/764948227 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcd00021030 con 0x7fcd1809d920 2023-09-30T22:27:50.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.962+0000 7fcd1db65700 1 -- 172.21.15.40:0/764948227 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd1806e600 con 0x7fcd1809d920 2023-09-30T22:27:50.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.962+0000 7fcd0ffff700 1 -- 172.21.15.40:0/764948227 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fcd00040720 con 0x7fcd1809d920 2023-09-30T22:27:50.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:50.966+0000 7fcd0ffff700 1 -- 172.21.15.40:0/764948227 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcd00003800 con 0x7fcd1809d920 2023-09-30T22:27:51.026 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:51.036 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:51.107 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:51.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.160+0000 7fb847d6e700 1 Processor -- start 2023-09-30T22:27:51.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.161+0000 7fb847d6e700 1 -- start start 2023-09-30T22:27:51.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.161+0000 7fb847d6e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb84009d920 0x7fb84009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:51.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.161+0000 7fb847d6e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb840130fb0 0x7fb840138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:51.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.161+0000 7fb847d6e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb84009adf0 con 0x7fb84009e230 2023-09-30T22:27:51.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.161+0000 7fb847d6e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb84009edf0 con 0x7fb840130fb0 2023-09-30T22:27:51.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.161+0000 7fb847d6e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb84009b660 con 0x7fb84009d920 2023-09-30T22:27:51.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.162+0000 7fb84630b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb840130fb0 0x7fb840138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:51.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.162+0000 7fb845b0a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb84009d920 0x7fb84009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:51.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.162+0000 7fb84630b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb840130fb0 0x7fb840138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41498/0 (socket says 172.21.15.40:41498) 2023-09-30T22:27:51.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.162+0000 7fb84630b700 1 -- 172.21.15.40:0/2251623706 learned_addr learned my addr 172.21.15.40:0/2251623706 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:51.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.162+0000 7fb84630b700 1 -- 172.21.15.40:0/2251623706 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb84009d920 msgr2=0x7fb84009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:51.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.162+0000 7fb84630b700 1 --2- 172.21.15.40:0/2251623706 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb84009d920 0x7fb84009dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.162+0000 7fb84630b700 1 -- 172.21.15.40:0/2251623706 >> v1:172.21.15.40:6789/0 conn(0x7fb84009e230 legacy=0x7fb8401308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:51.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.162+0000 7fb84630b700 1 -- 172.21.15.40:0/2251623706 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84009a6e0 con 0x7fb840130fb0 2023-09-30T22:27:51.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.162+0000 7fb844b08700 1 -- 172.21.15.40:0/2251623706 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2310910738 0 0) 0x7fb84009adf0 con 0x7fb84009e230 2023-09-30T22:27:51.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.162+0000 7fb845b0a700 1 --2- 172.21.15.40:0/2251623706 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb84009d920 0x7fb84009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:51.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.162+0000 7fb84630b700 1 --2- 172.21.15.40:0/2251623706 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb840130fb0 0x7fb840138d10 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb838009e80 tx=0x7fb83800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf2c0005c6bde505 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:51.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.162+0000 7fb844b08700 1 -- 172.21.15.40:0/2251623706 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83800e070 con 0x7fb840130fb0 2023-09-30T22:27:51.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.162+0000 7fb844b08700 1 -- 172.21.15.40:0/2251623706 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83800b8b0 con 0x7fb840130fb0 2023-09-30T22:27:51.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.162+0000 7fb844b08700 1 -- 172.21.15.40:0/2251623706 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83800bc60 con 0x7fb840130fb0 2023-09-30T22:27:51.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.163+0000 7fb847d6e700 1 -- 172.21.15.40:0/2251623706 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb840130fb0 msgr2=0x7fb840138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:51.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.163+0000 7fb847d6e700 1 --2- 172.21.15.40:0/2251623706 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb840130fb0 0x7fb840138d10 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb838009e80 tx=0x7fb83800b330 comp rx=0 tx=0).stop 2023-09-30T22:27:51.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.163+0000 7fb847d6e700 1 -- 172.21.15.40:0/2251623706 shutdown_connections 2023-09-30T22:27:51.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.163+0000 7fb847d6e700 1 --2- 172.21.15.40:0/2251623706 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb840130fb0 0x7fb840138d10 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.163+0000 7fb847d6e700 1 --2- 172.21.15.40:0/2251623706 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb84009d920 0x7fb84009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.163+0000 7fb847d6e700 1 -- 172.21.15.40:0/2251623706 >> 172.21.15.40:0/2251623706 conn(0x7fb84009fb20 msgr2=0x7fb84009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:51.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.163+0000 7fb847d6e700 1 -- 172.21.15.40:0/2251623706 shutdown_connections 2023-09-30T22:27:51.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.163+0000 7fb847d6e700 1 -- 172.21.15.40:0/2251623706 wait complete. 2023-09-30T22:27:51.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.164+0000 7fb847d6e700 1 Processor -- start 2023-09-30T22:27:51.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.164+0000 7fb847d6e700 1 -- start start 2023-09-30T22:27:51.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.165+0000 7fb847d6e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb84009d920 0x7fb840138780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:51.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.165+0000 7fb847d6e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb84009e230 0x7fb840138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:51.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.165+0000 7fb847d6e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb840130fb0 0x7fb8401c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:51.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.165+0000 7fb847d6e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb840139c00 con 0x7fb84009d920 2023-09-30T22:27:51.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.165+0000 7fb847d6e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb84009cb00 con 0x7fb84009e230 2023-09-30T22:27:51.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.165+0000 7fb847d6e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb840137050 con 0x7fb840130fb0 2023-09-30T22:27:51.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.165+0000 7fb845b0a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb84009d920 0x7fb840138780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:51.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.165+0000 7fb845b0a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb84009d920 0x7fb840138780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51636/0 (socket says 172.21.15.40:51636) 2023-09-30T22:27:51.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.165+0000 7fb845b0a700 1 -- 172.21.15.40:0/2744594810 learned_addr learned my addr 172.21.15.40:0/2744594810 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:51.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.165+0000 7fb845309700 1 --2- 172.21.15.40:0/2744594810 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb84009e230 0x7fb840138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:51.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.165+0000 7fb845309700 1 -- 172.21.15.40:0/2744594810 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb840130fb0 msgr2=0x7fb8401c8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:51.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.165+0000 7fb845309700 1 --2- 172.21.15.40:0/2744594810 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb840130fb0 0x7fb8401c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.165+0000 7fb845309700 1 -- 172.21.15.40:0/2744594810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb84009d920 msgr2=0x7fb840138780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:51.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.165+0000 7fb845309700 1 --2- 172.21.15.40:0/2744594810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb84009d920 0x7fb840138780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.165+0000 7fb845309700 1 -- 172.21.15.40:0/2744594810 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83c009430 con 0x7fb84009e230 2023-09-30T22:27:51.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.165+0000 7fb845b0a700 1 --2- 172.21.15.40:0/2744594810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb84009d920 0x7fb840138780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:51.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.166+0000 7fb845309700 1 --2- 172.21.15.40:0/2744594810 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb84009e230 0x7fb840138cc0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb83000c520 tx=0x7fb83000c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:51.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.166+0000 7fb8367fc700 1 -- 172.21.15.40:0/2744594810 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8300054e0 con 0x7fb84009e230 2023-09-30T22:27:51.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.166+0000 7fb8367fc700 1 -- 172.21.15.40:0/2744594810 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb830003680 con 0x7fb84009e230 2023-09-30T22:27:51.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.166+0000 7fb847d6e700 1 -- 172.21.15.40:0/2744594810 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb838009b30 con 0x7fb84009e230 2023-09-30T22:27:51.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.166+0000 7fb8367fc700 1 -- 172.21.15.40:0/2744594810 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb830003a30 con 0x7fb84009e230 2023-09-30T22:27:51.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.166+0000 7fb847d6e700 1 -- 172.21.15.40:0/2744594810 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb84013bfd0 con 0x7fb84009e230 2023-09-30T22:27:51.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.167+0000 7fb847d6e700 1 -- 172.21.15.40:0/2744594810 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb840137270 con 0x7fb84009e230 2023-09-30T22:27:51.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.168+0000 7fb8367fc700 1 -- 172.21.15.40:0/2744594810 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb830003b90 con 0x7fb84009e230 2023-09-30T22:27:51.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.168+0000 7fb8367fc700 1 -- 172.21.15.40:0/2744594810 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb83003f3d0 con 0x7fb84009e230 2023-09-30T22:27:51.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.174+0000 7fcd1db65700 1 -- 172.21.15.40:0/764948227 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcd18062380 con 0x7fcd1809d920 2023-09-30T22:27:51.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.175+0000 7fcd0ffff700 1 -- 172.21.15.40:0/764948227 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcd00015020 con 0x7fcd1809d920 2023-09-30T22:27:51.176 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:51.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.176+0000 7fb8367fc700 1 -- 172.21.15.40:0/2744594810 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb830012400 con 0x7fb84009e230 2023-09-30T22:27:51.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.178+0000 7fcd1db65700 1 -- 172.21.15.40:0/764948227 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd1809d920 msgr2=0x7fcd1812ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:51.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.178+0000 7fcd1db65700 1 --2- 172.21.15.40:0/764948227 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd1809d920 0x7fcd1812ba20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fcd000090b0 tx=0x7fcd00004750 comp rx=0 tx=0).stop 2023-09-30T22:27:51.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.178+0000 7fcd1db65700 1 -- 172.21.15.40:0/764948227 shutdown_connections 2023-09-30T22:27:51.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.178+0000 7fcd1db65700 1 --2- 172.21.15.40:0/764948227 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcd1809c890 0x7fcd1812b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.178+0000 7fcd1db65700 1 --2- 172.21.15.40:0/764948227 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd1809e2b0 0x7fcd1812bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.178+0000 7fcd1db65700 1 --2- 172.21.15.40:0/764948227 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd1809d920 0x7fcd1812ba20 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.178+0000 7fcd1db65700 1 -- 172.21.15.40:0/764948227 >> 172.21.15.40:0/764948227 conn(0x7fcd180a7080 msgr2=0x7fcd181baee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:51.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.178+0000 7fcd1db65700 1 -- 172.21.15.40:0/764948227 shutdown_connections 2023-09-30T22:27:51.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.178+0000 7fcd1db65700 1 -- 172.21.15.40:0/764948227 wait complete. 2023-09-30T22:27:51.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:51.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.203+0000 7fcb3caa9700 1 Processor -- start 2023-09-30T22:27:51.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.203+0000 7fcb3caa9700 1 -- start start 2023-09-30T22:27:51.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.204+0000 7fcb3caa9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcb380973f0 0x7fcb38133ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:51.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.204+0000 7fcb3caa9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb38134220 0x7fcb3809dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:51.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.204+0000 7fcb3caa9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb3809e260 0x7fcb3809e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:51.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.204+0000 7fcb3caa9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb3809ebf0 con 0x7fcb380973f0 2023-09-30T22:27:51.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.204+0000 7fcb3caa9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb38096bf0 con 0x7fcb3809e260 2023-09-30T22:27:51.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.204+0000 7fcb3caa9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb38096540 con 0x7fcb38134220 2023-09-30T22:27:51.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.204+0000 7fcb35d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb38134220 0x7fcb3809dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:51.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.204+0000 7fcb3659c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcb380973f0 0x7fcb38133ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:51.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.204+0000 7fcb35d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb38134220 0x7fcb3809dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:35138/0 (socket says 172.21.15.40:35138) 2023-09-30T22:27:51.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.204+0000 7fcb3659c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcb380973f0 0x7fcb38133ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51650/0 (socket says 172.21.15.40:51650) 2023-09-30T22:27:51.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.204+0000 7fcb35d9b700 1 -- 172.21.15.40:0/2773664943 learned_addr learned my addr 172.21.15.40:0/2773664943 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:51.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.204+0000 7fcb36d9d700 1 --2- 172.21.15.40:0/2773664943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb3809e260 0x7fcb3809e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:51.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.204+0000 7fcb36d9d700 1 -- 172.21.15.40:0/2773664943 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb38134220 msgr2=0x7fcb3809dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:51.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.204+0000 7fcb36d9d700 1 --2- 172.21.15.40:0/2773664943 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb38134220 0x7fcb3809dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.204+0000 7fcb36d9d700 1 -- 172.21.15.40:0/2773664943 >> v2:172.21.15.40:3300/0 conn(0x7fcb380973f0 msgr2=0x7fcb38133ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:51.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.204+0000 7fcb36d9d700 1 --2- 172.21.15.40:0/2773664943 >> v2:172.21.15.40:3300/0 conn(0x7fcb380973f0 0x7fcb38133ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.204+0000 7fcb36d9d700 1 -- 172.21.15.40:0/2773664943 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb38096180 con 0x7fcb3809e260 2023-09-30T22:27:51.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.204+0000 7fcb35d9b700 1 --2- 172.21.15.40:0/2773664943 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb38134220 0x7fcb3809dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:51.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.204+0000 7fcb3659c700 1 --2- 172.21.15.40:0/2773664943 >> v2:172.21.15.40:3300/0 conn(0x7fcb380973f0 0x7fcb38133ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:51.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.204+0000 7fcb36d9d700 1 --2- 172.21.15.40:0/2773664943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb3809e260 0x7fcb3809e6b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fcb30009dc0 tx=0x7fcb3000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=757cb286c56870c8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:51.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.205+0000 7fcb3559a700 1 -- 172.21.15.40:0/2773664943 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3000e070 con 0x7fcb3809e260 2023-09-30T22:27:51.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.205+0000 7fcb3559a700 1 -- 172.21.15.40:0/2773664943 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3000bae0 con 0x7fcb3809e260 2023-09-30T22:27:51.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.205+0000 7fcb3559a700 1 -- 172.21.15.40:0/2773664943 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3000be90 con 0x7fcb3809e260 2023-09-30T22:27:51.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.205+0000 7fcb3caa9700 1 -- 172.21.15.40:0/2773664943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb3809e260 msgr2=0x7fcb3809e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:51.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.205+0000 7fcb3caa9700 1 --2- 172.21.15.40:0/2773664943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb3809e260 0x7fcb3809e6b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fcb30009dc0 tx=0x7fcb3000b330 comp rx=0 tx=0).stop 2023-09-30T22:27:51.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.205+0000 7fcb3caa9700 1 -- 172.21.15.40:0/2773664943 shutdown_connections 2023-09-30T22:27:51.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.205+0000 7fcb3caa9700 1 --2- 172.21.15.40:0/2773664943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb3809e260 0x7fcb3809e6b0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.205+0000 7fcb3caa9700 1 --2- 172.21.15.40:0/2773664943 >> v2:172.21.15.40:3300/0 conn(0x7fcb380973f0 0x7fcb38133ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.205+0000 7fcb3caa9700 1 --2- 172.21.15.40:0/2773664943 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb38134220 0x7fcb3809dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.205+0000 7fcb3caa9700 1 -- 172.21.15.40:0/2773664943 >> 172.21.15.40:0/2773664943 conn(0x7fcb380a2ff0 msgr2=0x7fcb3809ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:51.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.205+0000 7fcb3caa9700 1 -- 172.21.15.40:0/2773664943 shutdown_connections 2023-09-30T22:27:51.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.205+0000 7fcb3caa9700 1 -- 172.21.15.40:0/2773664943 wait complete. 2023-09-30T22:27:51.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.206+0000 7fcb3caa9700 1 Processor -- start 2023-09-30T22:27:51.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.207+0000 7fcb3caa9700 1 -- start start 2023-09-30T22:27:51.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.207+0000 7fcb3caa9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb380973f0 0x7fcb38091270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:51.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.207+0000 7fcb3caa9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb3809e260 0x7fcb380917b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:51.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.207+0000 7fcb3caa9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb38134220 0x7fcb38091cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:51.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.207+0000 7fcb3caa9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb380947b0 con 0x7fcb380973f0 2023-09-30T22:27:51.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.207+0000 7fcb3caa9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb38092db0 con 0x7fcb38134220 2023-09-30T22:27:51.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.207+0000 7fcb3caa9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb380949e0 con 0x7fcb3809e260 2023-09-30T22:27:51.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.207+0000 7fcb3659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb380973f0 0x7fcb38091270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:51.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.207+0000 7fcb3659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb380973f0 0x7fcb38091270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51662/0 (socket says 172.21.15.40:51662) 2023-09-30T22:27:51.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.207+0000 7fcb3659c700 1 -- 172.21.15.40:0/1299066403 learned_addr learned my addr 172.21.15.40:0/1299066403 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:51.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.207+0000 7fcb36d9d700 1 --2- 172.21.15.40:0/1299066403 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb38134220 0x7fcb38091cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:51.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.207+0000 7fcb35d9b700 1 --2- 172.21.15.40:0/1299066403 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb3809e260 0x7fcb380917b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:51.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.208+0000 7fcb3659c700 1 -- 172.21.15.40:0/1299066403 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb3809e260 msgr2=0x7fcb380917b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:51.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.208+0000 7fcb3659c700 1 --2- 172.21.15.40:0/1299066403 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb3809e260 0x7fcb380917b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.208+0000 7fcb3659c700 1 -- 172.21.15.40:0/1299066403 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb38134220 msgr2=0x7fcb38091cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:51.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.208+0000 7fcb3659c700 1 --2- 172.21.15.40:0/1299066403 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb38134220 0x7fcb38091cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.208+0000 7fcb3659c700 1 -- 172.21.15.40:0/1299066403 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb280094a0 con 0x7fcb380973f0 2023-09-30T22:27:51.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.208+0000 7fcb3659c700 1 --2- 172.21.15.40:0/1299066403 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb380973f0 0x7fcb38091270 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fcb2800ebe0 tx=0x7fcb2800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:51.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.208+0000 7fcb26ffd700 1 -- 172.21.15.40:0/1299066403 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb28009760 con 0x7fcb380973f0 2023-09-30T22:27:51.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.208+0000 7fcb26ffd700 1 -- 172.21.15.40:0/1299066403 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb2800c850 con 0x7fcb380973f0 2023-09-30T22:27:51.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.208+0000 7fcb26ffd700 1 -- 172.21.15.40:0/1299066403 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2800cbc0 con 0x7fcb380973f0 2023-09-30T22:27:51.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.209+0000 7fcb3caa9700 1 -- 172.21.15.40:0/1299066403 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb2c009550 con 0x7fcb380973f0 2023-09-30T22:27:51.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.209+0000 7fcb3caa9700 1 -- 172.21.15.40:0/1299066403 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb30009a70 con 0x7fcb380973f0 2023-09-30T22:27:51.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.209+0000 7fcb26ffd700 1 -- 172.21.15.40:0/1299066403 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcb2800cd20 con 0x7fcb380973f0 2023-09-30T22:27:51.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.209+0000 7fcb26ffd700 1 -- 172.21.15.40:0/1299066403 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fcb2803fb10 con 0x7fcb380973f0 2023-09-30T22:27:51.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.210+0000 7fcb3caa9700 1 -- 172.21.15.40:0/1299066403 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb38072880 con 0x7fcb380973f0 2023-09-30T22:27:51.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.214+0000 7fcb26ffd700 1 -- 172.21.15.40:0/1299066403 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcb2801b3b0 con 0x7fcb380973f0 2023-09-30T22:27:51.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.250+0000 7f4231716700 1 Processor -- start 2023-09-30T22:27:51.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.250+0000 7f4231716700 1 -- start start 2023-09-30T22:27:51.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.251+0000 7f4231716700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f422c09d920 0x7f422c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:51.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.251+0000 7f4231716700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f422c09f0f0 0x7f422c09e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:51.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.251+0000 7f4231716700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f422c133ca0 0x7f422c134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:51.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.251+0000 7f4231716700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f422c06b4c0 con 0x7f422c133ca0 2023-09-30T22:27:51.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.251+0000 7f4231716700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f422c09a8f0 con 0x7f422c09f0f0 2023-09-30T22:27:51.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.251+0000 7f4231716700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f422c09f940 con 0x7f422c09d920 2023-09-30T22:27:51.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.251+0000 7f422b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f422c133ca0 0x7f422c134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:51.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.251+0000 7f422a7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f422c09f0f0 0x7f422c09e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:51.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.251+0000 7f422affd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f422c09d920 0x7f422c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:51.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.251+0000 7f422b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f422c133ca0 0x7f422c134140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51666/0 (socket says 172.21.15.40:51666) 2023-09-30T22:27:51.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.251+0000 7f422a7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f422c09f0f0 0x7f422c09e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41526/0 (socket says 172.21.15.40:41526) 2023-09-30T22:27:51.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.251+0000 7f422b7fe700 1 -- 172.21.15.40:0/786027177 learned_addr learned my addr 172.21.15.40:0/786027177 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:51.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.252+0000 7f422b7fe700 1 -- 172.21.15.40:0/786027177 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f422c09d920 msgr2=0x7f422c09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:51.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.252+0000 7f422b7fe700 1 --2- 172.21.15.40:0/786027177 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f422c09d920 0x7f422c09dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.252+0000 7f422b7fe700 1 -- 172.21.15.40:0/786027177 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f422c09f0f0 msgr2=0x7f422c09e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:51.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.252+0000 7f422b7fe700 1 --2- 172.21.15.40:0/786027177 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f422c09f0f0 0x7f422c09e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.252+0000 7f422b7fe700 1 -- 172.21.15.40:0/786027177 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422c09f6e0 con 0x7f422c133ca0 2023-09-30T22:27:51.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.252+0000 7f422affd700 1 --2- 172.21.15.40:0/786027177 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f422c09d920 0x7f422c09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:51.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.252+0000 7f422a7fc700 1 --2- 172.21.15.40:0/786027177 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f422c09f0f0 0x7f422c09e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:51.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.252+0000 7f422b7fe700 1 --2- 172.21.15.40:0/786027177 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f422c133ca0 0x7f422c134140 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f4224009e80 tx=0x7f422400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=635ddb9c4083fd43 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:51.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.252+0000 7f4229ffb700 1 -- 172.21.15.40:0/786027177 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422400e070 con 0x7f422c133ca0 2023-09-30T22:27:51.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.252+0000 7f4229ffb700 1 -- 172.21.15.40:0/786027177 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422400b8d0 con 0x7f422c133ca0 2023-09-30T22:27:51.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.252+0000 7f4229ffb700 1 -- 172.21.15.40:0/786027177 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422400bc80 con 0x7f422c133ca0 2023-09-30T22:27:51.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.253+0000 7f4231716700 1 -- 172.21.15.40:0/786027177 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f422c133ca0 msgr2=0x7f422c134140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:51.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.253+0000 7f4231716700 1 --2- 172.21.15.40:0/786027177 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f422c133ca0 0x7f422c134140 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f4224009e80 tx=0x7f422400b330 comp rx=0 tx=0).stop 2023-09-30T22:27:51.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.253+0000 7f4231716700 1 -- 172.21.15.40:0/786027177 shutdown_connections 2023-09-30T22:27:51.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.253+0000 7f4231716700 1 --2- 172.21.15.40:0/786027177 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f422c09d920 0x7f422c09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.253+0000 7f4231716700 1 --2- 172.21.15.40:0/786027177 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f422c133ca0 0x7f422c134140 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.253+0000 7f4231716700 1 --2- 172.21.15.40:0/786027177 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f422c09f0f0 0x7f422c09e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.253+0000 7f4231716700 1 -- 172.21.15.40:0/786027177 >> 172.21.15.40:0/786027177 conn(0x7f422c09fb20 msgr2=0x7f422c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:51.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.253+0000 7f4231716700 1 -- 172.21.15.40:0/786027177 shutdown_connections 2023-09-30T22:27:51.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.253+0000 7f4231716700 1 -- 172.21.15.40:0/786027177 wait complete. 2023-09-30T22:27:51.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.254+0000 7f4231716700 1 Processor -- start 2023-09-30T22:27:51.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.254+0000 7f4231716700 1 -- start start 2023-09-30T22:27:51.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.254+0000 7f4231716700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f422c09d920 0x7f422c121860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:51.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.254+0000 7f4231716700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f422c133ca0 0x7f422c121da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:51.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.254+0000 7f4231716700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f422c1222e0 0x7f422c1c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:51.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.254+0000 7f4231716700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422c125380 con 0x7f422c133ca0 2023-09-30T22:27:51.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.254+0000 7f4231716700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f422c123d00 con 0x7f422c09d920 2023-09-30T22:27:51.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.254+0000 7f4231716700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f422c123470 con 0x7f422c1222e0 2023-09-30T22:27:51.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.254+0000 7f422a7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f422c133ca0 0x7f422c121da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:51.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.254+0000 7f422a7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f422c133ca0 0x7f422c121da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51682/0 (socket says 172.21.15.40:51682) 2023-09-30T22:27:51.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.254+0000 7f422a7fc700 1 -- 172.21.15.40:0/1616331280 learned_addr learned my addr 172.21.15.40:0/1616331280 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:51.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.254+0000 7f422affd700 1 --2- 172.21.15.40:0/1616331280 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f422c09d920 0x7f422c121860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:51.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.255+0000 7f422b7fe700 1 --2- 172.21.15.40:0/1616331280 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f422c1222e0 0x7f422c1c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:51.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.255+0000 7f422a7fc700 1 -- 172.21.15.40:0/1616331280 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f422c1222e0 msgr2=0x7f422c1c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:51.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.255+0000 7f422a7fc700 1 --2- 172.21.15.40:0/1616331280 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f422c1222e0 0x7f422c1c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.255+0000 7f422a7fc700 1 -- 172.21.15.40:0/1616331280 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f422c09d920 msgr2=0x7f422c121860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:51.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.255+0000 7f422a7fc700 1 --2- 172.21.15.40:0/1616331280 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f422c09d920 0x7f422c121860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.255+0000 7f422a7fc700 1 -- 172.21.15.40:0/1616331280 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421c009430 con 0x7f422c133ca0 2023-09-30T22:27:51.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.255+0000 7f422affd700 1 --2- 172.21.15.40:0/1616331280 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f422c09d920 0x7f422c121860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:51.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.255+0000 7f422a7fc700 1 --2- 172.21.15.40:0/1616331280 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f422c133ca0 0x7f422c121da0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f422000ebe0 tx=0x7f422000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:51.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.255+0000 7f42137fe700 1 -- 172.21.15.40:0/1616331280 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422000c7f0 con 0x7f422c133ca0 2023-09-30T22:27:51.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.255+0000 7f42137fe700 1 -- 172.21.15.40:0/1616331280 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422000c950 con 0x7f422c133ca0 2023-09-30T22:27:51.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.255+0000 7f42137fe700 1 -- 172.21.15.40:0/1616331280 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422000ccc0 con 0x7f422c133ca0 2023-09-30T22:27:51.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.256+0000 7f4231716700 1 -- 172.21.15.40:0/1616331280 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42200094a0 con 0x7f422c133ca0 2023-09-30T22:27:51.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.256+0000 7f4231716700 1 -- 172.21.15.40:0/1616331280 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4224009b30 con 0x7f422c133ca0 2023-09-30T22:27:51.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.256+0000 7f42137fe700 1 -- 172.21.15.40:0/1616331280 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4220013470 con 0x7f422c133ca0 2023-09-30T22:27:51.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.257+0000 7f42137fe700 1 -- 172.21.15.40:0/1616331280 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f422003f7c0 con 0x7f422c133ca0 2023-09-30T22:27:51.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.257+0000 7f4231716700 1 -- 172.21.15.40:0/1616331280 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f422c124f00 con 0x7f422c133ca0 2023-09-30T22:27:51.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.262+0000 7f42137fe700 1 -- 172.21.15.40:0/1616331280 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f422c124f00 con 0x7f422c133ca0 2023-09-30T22:27:51.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.375+0000 7fb847d6e700 1 -- 172.21.15.40:0/2744594810 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb840062380 con 0x7fb84009e230 2023-09-30T22:27:51.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.375+0000 7fb8367fc700 1 -- 172.21.15.40:0/2744594810 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb830017020 con 0x7fb84009e230 2023-09-30T22:27:51.376 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:51.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.377+0000 7fb847d6e700 1 -- 172.21.15.40:0/2744594810 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb84009e230 msgr2=0x7fb840138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:51.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.377+0000 7fb847d6e700 1 --2- 172.21.15.40:0/2744594810 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb84009e230 0x7fb840138cc0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb83000c520 tx=0x7fb83000c830 comp rx=0 tx=0).stop 2023-09-30T22:27:51.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.377+0000 7fb847d6e700 1 -- 172.21.15.40:0/2744594810 shutdown_connections 2023-09-30T22:27:51.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.377+0000 7fb847d6e700 1 --2- 172.21.15.40:0/2744594810 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb840130fb0 0x7fb8401c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.377+0000 7fb847d6e700 1 --2- 172.21.15.40:0/2744594810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb84009d920 0x7fb840138780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.377+0000 7fb847d6e700 1 --2- 172.21.15.40:0/2744594810 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb84009e230 0x7fb840138cc0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.377+0000 7fb847d6e700 1 -- 172.21.15.40:0/2744594810 >> 172.21.15.40:0/2744594810 conn(0x7fb84009fb20 msgr2=0x7fb840071830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:51.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.377+0000 7fb847d6e700 1 -- 172.21.15.40:0/2744594810 shutdown_connections 2023-09-30T22:27:51.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.377+0000 7fb847d6e700 1 -- 172.21.15.40:0/2744594810 wait complete. 2023-09-30T22:27:51.390 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:51.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.413+0000 7fcb3caa9700 1 -- 172.21.15.40:0/1299066403 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcb38071f70 con 0x7fcb380973f0 2023-09-30T22:27:51.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.413+0000 7fcb26ffd700 1 -- 172.21.15.40:0/1299066403 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcb28021020 con 0x7fcb380973f0 2023-09-30T22:27:51.414 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:51.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.415+0000 7fcb3caa9700 1 -- 172.21.15.40:0/1299066403 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb380973f0 msgr2=0x7fcb38091270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:51.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.415+0000 7fcb3caa9700 1 --2- 172.21.15.40:0/1299066403 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb380973f0 0x7fcb38091270 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fcb2800ebe0 tx=0x7fcb2800eef0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.415+0000 7fcb3caa9700 1 -- 172.21.15.40:0/1299066403 shutdown_connections 2023-09-30T22:27:51.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.415+0000 7fcb3caa9700 1 --2- 172.21.15.40:0/1299066403 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb38134220 0x7fcb38091cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.415+0000 7fcb3caa9700 1 --2- 172.21.15.40:0/1299066403 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb380973f0 0x7fcb38091270 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.415+0000 7fcb3caa9700 1 --2- 172.21.15.40:0/1299066403 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb3809e260 0x7fcb380917b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.415+0000 7fcb3caa9700 1 -- 172.21.15.40:0/1299066403 >> 172.21.15.40:0/1299066403 conn(0x7fcb380a2ff0 msgr2=0x7fcb3809a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:51.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.415+0000 7fcb3caa9700 1 -- 172.21.15.40:0/1299066403 shutdown_connections 2023-09-30T22:27:51.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.415+0000 7fcb3caa9700 1 -- 172.21.15.40:0/1299066403 wait complete. 2023-09-30T22:27:51.428 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:51.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.458+0000 7f4231716700 1 -- 172.21.15.40:0/1616331280 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f422c124f00 con 0x7f422c133ca0 2023-09-30T22:27:51.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.459+0000 7f42137fe700 1 -- 172.21.15.40:0/1616331280 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f422c124f00 con 0x7f422c133ca0 2023-09-30T22:27:51.460 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:51.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.461+0000 7f4231716700 1 -- 172.21.15.40:0/1616331280 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f422c133ca0 msgr2=0x7f422c121da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:51.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.461+0000 7f4231716700 1 --2- 172.21.15.40:0/1616331280 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f422c133ca0 0x7f422c121da0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f422000ebe0 tx=0x7f422000eef0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.461+0000 7f4231716700 1 -- 172.21.15.40:0/1616331280 shutdown_connections 2023-09-30T22:27:51.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.461+0000 7f4231716700 1 --2- 172.21.15.40:0/1616331280 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f422c1222e0 0x7f422c1c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.461+0000 7f4231716700 1 --2- 172.21.15.40:0/1616331280 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f422c09d920 0x7f422c121860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.461+0000 7f4231716700 1 --2- 172.21.15.40:0/1616331280 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f422c133ca0 0x7f422c121da0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.461+0000 7f4231716700 1 -- 172.21.15.40:0/1616331280 >> 172.21.15.40:0/1616331280 conn(0x7f422c09fb20 msgr2=0x7f422c0a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:51.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.461+0000 7f4231716700 1 -- 172.21.15.40:0/1616331280 shutdown_connections 2023-09-30T22:27:51.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:51.461+0000 7f4231716700 1 -- 172.21.15.40:0/1616331280 wait complete. 2023-09-30T22:27:51.473 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:52.194 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:52.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.335+0000 7fa5ea7ad700 1 Processor -- start 2023-09-30T22:27:52.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.335+0000 7fa5ea7ad700 1 -- start start 2023-09-30T22:27:52.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.335+0000 7fa5ea7ad700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa5e409c890 0x7fa5e409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.335+0000 7fa5ea7ad700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5e409e480 0x7fa5e413bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.335+0000 7fa5ea7ad700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5e40a2600 con 0x7fa5e409d920 2023-09-30T22:27:52.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.335+0000 7fa5ea7ad700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e40a29d0 con 0x7fa5e409c890 2023-09-30T22:27:52.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.335+0000 7fa5ea7ad700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e409fb40 con 0x7fa5e409e480 2023-09-30T22:27:52.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.335+0000 7fa5e3fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa5e409c890 0x7fa5e409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.335+0000 7fa5e8d4a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5e409e480 0x7fa5e413bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.335+0000 7fa5e8d4a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5e409e480 0x7fa5e413bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41546/0 (socket says 172.21.15.40:41546) 2023-09-30T22:27:52.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.335+0000 7fa5e3fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa5e409c890 0x7fa5e409cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51698/0 (socket says 172.21.15.40:51698) 2023-09-30T22:27:52.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.335+0000 7fa5e8d4a700 1 -- 172.21.15.40:0/315374924 learned_addr learned my addr 172.21.15.40:0/315374924 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:52.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.336+0000 7fa5e8d4a700 1 -- 172.21.15.40:0/315374924 >> v2:172.21.15.40:3300/0 conn(0x7fa5e409c890 msgr2=0x7fa5e409cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:52.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.336+0000 7fa5e8d4a700 1 --2- 172.21.15.40:0/315374924 >> v2:172.21.15.40:3300/0 conn(0x7fa5e409c890 0x7fa5e409cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.336+0000 7fa5e8d4a700 1 -- 172.21.15.40:0/315374924 >> v1:172.21.15.40:6789/0 conn(0x7fa5e409d920 legacy=0x7fa5e409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.336+0000 7fa5e8d4a700 1 -- 172.21.15.40:0/315374924 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e409fed0 con 0x7fa5e409e480 2023-09-30T22:27:52.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.336+0000 7fa5e3fff700 1 --2- 172.21.15.40:0/315374924 >> v2:172.21.15.40:3300/0 conn(0x7fa5e409c890 0x7fa5e409cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:52.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.336+0000 7fa5e8d4a700 1 --2- 172.21.15.40:0/315374924 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5e409e480 0x7fa5e413bc20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc009e50 tx=0x7fa5dc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=806d514590325dde server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:52.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.336+0000 7fa5e2ffd700 1 -- 172.21.15.40:0/315374924 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc00e070 con 0x7fa5e409e480 2023-09-30T22:27:52.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.336+0000 7fa5e2ffd700 1 -- 172.21.15.40:0/315374924 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5dc00b910 con 0x7fa5e409e480 2023-09-30T22:27:52.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.336+0000 7fa5e2ffd700 1 -- 172.21.15.40:0/315374924 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc00bcc0 con 0x7fa5e409e480 2023-09-30T22:27:52.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.337+0000 7fa5ea7ad700 1 -- 172.21.15.40:0/315374924 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5e409e480 msgr2=0x7fa5e413bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.337+0000 7fa5ea7ad700 1 --2- 172.21.15.40:0/315374924 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5e409e480 0x7fa5e413bc20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc009e50 tx=0x7fa5dc00b330 comp rx=0 tx=0).stop 2023-09-30T22:27:52.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.337+0000 7fa5ea7ad700 1 -- 172.21.15.40:0/315374924 shutdown_connections 2023-09-30T22:27:52.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.337+0000 7fa5ea7ad700 1 --2- 172.21.15.40:0/315374924 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5e409e480 0x7fa5e413bc20 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.337+0000 7fa5ea7ad700 1 --2- 172.21.15.40:0/315374924 >> v2:172.21.15.40:3300/0 conn(0x7fa5e409c890 0x7fa5e409cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.337+0000 7fa5ea7ad700 1 -- 172.21.15.40:0/315374924 >> 172.21.15.40:0/315374924 conn(0x7fa5e40a7080 msgr2=0x7fa5e40a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:52.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.337+0000 7fa5ea7ad700 1 -- 172.21.15.40:0/315374924 shutdown_connections 2023-09-30T22:27:52.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.337+0000 7fa5ea7ad700 1 -- 172.21.15.40:0/315374924 wait complete. 2023-09-30T22:27:52.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.338+0000 7fa5ea7ad700 1 Processor -- start 2023-09-30T22:27:52.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.338+0000 7fa5ea7ad700 1 -- start start 2023-09-30T22:27:52.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.338+0000 7fa5ea7ad700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5e409c890 0x7fa5e412d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.338+0000 7fa5ea7ad700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5e409d920 0x7fa5e412d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.338+0000 7fa5ea7ad700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa5e409e480 0x7fa5e412de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.338+0000 7fa5ea7ad700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e412ee40 con 0x7fa5e409c890 2023-09-30T22:27:52.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.338+0000 7fa5ea7ad700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e412ec50 con 0x7fa5e409d920 2023-09-30T22:27:52.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.338+0000 7fa5ea7ad700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e412f520 con 0x7fa5e409e480 2023-09-30T22:27:52.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.338+0000 7fa5e3fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5e409c890 0x7fa5e412d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.338+0000 7fa5e3fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5e409c890 0x7fa5e412d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51714/0 (socket says 172.21.15.40:51714) 2023-09-30T22:27:52.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.338+0000 7fa5e3fff700 1 -- 172.21.15.40:0/1084910663 learned_addr learned my addr 172.21.15.40:0/1084910663 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:52.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.338+0000 7fa5e37fe700 1 --2- 172.21.15.40:0/1084910663 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5e409d920 0x7fa5e412d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.339+0000 7fa5e8d4a700 1 --2- 172.21.15.40:0/1084910663 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa5e409e480 0x7fa5e412de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.339+0000 7fa5e3fff700 1 -- 172.21.15.40:0/1084910663 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa5e409e480 msgr2=0x7fa5e412de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.339+0000 7fa5e3fff700 1 --2- 172.21.15.40:0/1084910663 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa5e409e480 0x7fa5e412de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.339+0000 7fa5e3fff700 1 -- 172.21.15.40:0/1084910663 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5e409d920 msgr2=0x7fa5e412d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.339+0000 7fa5e3fff700 1 --2- 172.21.15.40:0/1084910663 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5e409d920 0x7fa5e412d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.339+0000 7fa5e3fff700 1 -- 172.21.15.40:0/1084910663 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d4009430 con 0x7fa5e409c890 2023-09-30T22:27:52.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.339+0000 7fa5e3fff700 1 --2- 172.21.15.40:0/1084910663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5e409c890 0x7fa5e412d3d0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fa5d400ebe0 tx=0x7fa5d400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:52.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.339+0000 7fa5e0ff9700 1 -- 172.21.15.40:0/1084910663 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d4009740 con 0x7fa5e409c890 2023-09-30T22:27:52.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.339+0000 7fa5e0ff9700 1 -- 172.21.15.40:0/1084910663 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d4005a20 con 0x7fa5e409c890 2023-09-30T22:27:52.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.339+0000 7fa5ea7ad700 1 -- 172.21.15.40:0/1084910663 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5dc009b30 con 0x7fa5e409c890 2023-09-30T22:27:52.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.339+0000 7fa5e0ff9700 1 -- 172.21.15.40:0/1084910663 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d4005db0 con 0x7fa5e409c890 2023-09-30T22:27:52.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.339+0000 7fa5ea7ad700 1 -- 172.21.15.40:0/1084910663 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e41305c0 con 0x7fa5e409c890 2023-09-30T22:27:52.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.340+0000 7fa5e0ff9700 1 -- 172.21.15.40:0/1084910663 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa5d400c850 con 0x7fa5e409c890 2023-09-30T22:27:52.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.340+0000 7fa5ea7ad700 1 -- 172.21.15.40:0/1084910663 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5e4070610 con 0x7fa5e409c890 2023-09-30T22:27:52.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.340+0000 7fa5e0ff9700 1 -- 172.21.15.40:0/1084910663 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa5d403f900 con 0x7fa5e409c890 2023-09-30T22:27:52.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.345+0000 7fa5e0ff9700 1 -- 172.21.15.40:0/1084910663 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa5d4006030 con 0x7fa5e409c890 2023-09-30T22:27:52.391 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:52.429 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:52.474 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:52.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.524+0000 7fb7e5304700 1 Processor -- start 2023-09-30T22:27:52.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.524+0000 7fb7e5304700 1 -- start start 2023-09-30T22:27:52.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.524+0000 7fb7e5304700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb7e0134a90 0x7fb7e0136e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.524+0000 7fb7e5304700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb7e01373b0 0x7fb7e0139790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.524+0000 7fb7e5304700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e0131900 con 0x7fb7e0131d50 2023-09-30T22:27:52.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.524+0000 7fb7e5304700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e00719e0 con 0x7fb7e0134a90 2023-09-30T22:27:52.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.524+0000 7fb7e5304700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e009e820 con 0x7fb7e01373b0 2023-09-30T22:27:52.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.524+0000 7fb7deffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb7e0131d50 0x7fb7e0132120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57326/0 (socket says 172.21.15.40:57326) 2023-09-30T22:27:52.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.524+0000 7fb7deffd700 1 -- 172.21.15.40:0/1994695065 learned_addr learned my addr 172.21.15.40:0/1994695065 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:27:52.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.524+0000 7fb7de7fc700 1 --2- 172.21.15.40:0/1994695065 >> v2:172.21.15.40:3300/0 conn(0x7fb7e0134a90 0x7fb7e0136e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.525+0000 7fb7de7fc700 1 -- 172.21.15.40:0/1994695065 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb7e01373b0 msgr2=0x7fb7e0139790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:52.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.525+0000 7fb7de7fc700 1 --2- 172.21.15.40:0/1994695065 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb7e01373b0 0x7fb7e0139790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.525+0000 7fb7de7fc700 1 -- 172.21.15.40:0/1994695065 >> v1:172.21.15.40:6789/0 conn(0x7fb7e0131d50 legacy=0x7fb7e0132120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.525+0000 7fb7de7fc700 1 -- 172.21.15.40:0/1994695065 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e009ef60 con 0x7fb7e0134a90 2023-09-30T22:27:52.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.525+0000 7fb7de7fc700 1 --2- 172.21.15.40:0/1994695065 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7e0134a90 0x7fb7e0136e70 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009840 tx=0x7fb7d4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bdab4f2f7d10577 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:52.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.525+0000 7fb7ddffb700 1 -- 172.21.15.40:0/1994695065 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d4011830 con 0x7fb7e0134a90 2023-09-30T22:27:52.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.525+0000 7fb7ddffb700 1 -- 172.21.15.40:0/1994695065 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d4011990 con 0x7fb7e0134a90 2023-09-30T22:27:52.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.525+0000 7fb7ddffb700 1 -- 172.21.15.40:0/1994695065 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d4011d00 con 0x7fb7e0134a90 2023-09-30T22:27:52.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.526+0000 7fb7e5304700 1 -- 172.21.15.40:0/1994695065 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7e0134a90 msgr2=0x7fb7e0136e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.526+0000 7fb7e5304700 1 --2- 172.21.15.40:0/1994695065 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7e0134a90 0x7fb7e0136e70 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009840 tx=0x7fb7d4009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:52.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.526+0000 7fb7e5304700 1 -- 172.21.15.40:0/1994695065 shutdown_connections 2023-09-30T22:27:52.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.526+0000 7fb7e5304700 1 --2- 172.21.15.40:0/1994695065 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb7e01373b0 0x7fb7e0139790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.526+0000 7fb7e5304700 1 --2- 172.21.15.40:0/1994695065 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7e0134a90 0x7fb7e0136e70 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.526+0000 7fb7e5304700 1 -- 172.21.15.40:0/1994695065 >> 172.21.15.40:0/1994695065 conn(0x7fb7e00a2a00 msgr2=0x7fb7e00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:52.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.527+0000 7fb7e5304700 1 -- 172.21.15.40:0/1994695065 shutdown_connections 2023-09-30T22:27:52.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.527+0000 7fb7e5304700 1 -- 172.21.15.40:0/1994695065 wait complete. 2023-09-30T22:27:52.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.528+0000 7fb7e5304700 1 Processor -- start 2023-09-30T22:27:52.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.528+0000 7fb7e5304700 1 -- start start 2023-09-30T22:27:52.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.528+0000 7fb7e5304700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb7e0131d50 0x7fb7e012b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.528+0000 7fb7e5304700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7e0134a90 0x7fb7e012ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.528+0000 7fb7e5304700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb7e01373b0 0x7fb7e01d5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.528+0000 7fb7e5304700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e009ea60 con 0x7fb7e0134a90 2023-09-30T22:27:52.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.528+0000 7fb7e5304700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e006e2d0 con 0x7fb7e0131d50 2023-09-30T22:27:52.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.528+0000 7fb7e5304700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e006fcb0 con 0x7fb7e01373b0 2023-09-30T22:27:52.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.529+0000 7fb7de7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7e0134a90 0x7fb7e012ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.529+0000 7fb7deffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb7e0131d50 0x7fb7e012b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.529+0000 7fb7df7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb7e01373b0 0x7fb7e01d5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.529+0000 7fb7de7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7e0134a90 0x7fb7e012ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51730/0 (socket says 172.21.15.40:51730) 2023-09-30T22:27:52.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.529+0000 7fb7de7fc700 1 -- 172.21.15.40:0/2010233499 learned_addr learned my addr 172.21.15.40:0/2010233499 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:52.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.529+0000 7fb7df7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb7e01373b0 0x7fb7e01d5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:35200/0 (socket says 172.21.15.40:35200) 2023-09-30T22:27:52.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.529+0000 7fb7df7fe700 1 -- 172.21.15.40:0/2010233499 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb7e0131d50 msgr2=0x7fb7e012b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.529+0000 7fb7df7fe700 1 --2- 172.21.15.40:0/2010233499 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb7e0131d50 0x7fb7e012b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.529+0000 7fb7df7fe700 1 -- 172.21.15.40:0/2010233499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7e0134a90 msgr2=0x7fb7e012ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.529+0000 7fb7df7fe700 1 --2- 172.21.15.40:0/2010233499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7e0134a90 0x7fb7e012ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.529+0000 7fb7df7fe700 1 -- 172.21.15.40:0/2010233499 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d40094a0 con 0x7fb7e01373b0 2023-09-30T22:27:52.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.529+0000 7fb7de7fc700 1 --2- 172.21.15.40:0/2010233499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7e0134a90 0x7fb7e012ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:52.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.529+0000 7fb7df7fe700 1 --2- 172.21.15.40:0/2010233499 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb7e01373b0 0x7fb7e01d5690 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb7d800bdf0 tx=0x7fb7d8009ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:52.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.529+0000 7fb7c77fe700 1 -- 172.21.15.40:0/2010233499 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d800cc10 con 0x7fb7e01373b0 2023-09-30T22:27:52.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.529+0000 7fb7e5304700 1 -- 172.21.15.40:0/2010233499 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e012bfd0 con 0x7fb7e01373b0 2023-09-30T22:27:52.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.529+0000 7fb7c77fe700 1 -- 172.21.15.40:0/2010233499 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d800cd70 con 0x7fb7e01373b0 2023-09-30T22:27:52.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.529+0000 7fb7e5304700 1 -- 172.21.15.40:0/2010233499 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e00709e0 con 0x7fb7e01373b0 2023-09-30T22:27:52.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.530+0000 7fb7c77fe700 1 -- 172.21.15.40:0/2010233499 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8014640 con 0x7fb7e01373b0 2023-09-30T22:27:52.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.530+0000 7fb7c77fe700 1 -- 172.21.15.40:0/2010233499 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb7d801d3b0 con 0x7fb7e01373b0 2023-09-30T22:27:52.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.531+0000 7fb7c77fe700 1 -- 172.21.15.40:0/2010233499 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb7d8006e40 con 0x7fb7e01373b0 2023-09-30T22:27:52.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.531+0000 7fb7e5304700 1 -- 172.21.15.40:0/2010233499 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e009d400 con 0x7fb7e01373b0 2023-09-30T22:27:52.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.540+0000 7fb7c77fe700 1 -- 172.21.15.40:0/2010233499 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb7d8007e60 con 0x7fb7e01373b0 2023-09-30T22:27:52.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.544+0000 7fa5ea7ad700 1 -- 172.21.15.40:0/1084910663 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa5e4062380 con 0x7fa5e409c890 2023-09-30T22:27:52.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.544+0000 7fa5e0ff9700 1 -- 172.21.15.40:0/1084910663 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa5d4020020 con 0x7fa5e409c890 2023-09-30T22:27:52.545 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:52.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.548+0000 7fa5ea7ad700 1 -- 172.21.15.40:0/1084910663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5e409c890 msgr2=0x7fa5e412d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.548+0000 7fa5ea7ad700 1 --2- 172.21.15.40:0/1084910663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5e409c890 0x7fa5e412d3d0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fa5d400ebe0 tx=0x7fa5d400eef0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.548+0000 7fa5ea7ad700 1 -- 172.21.15.40:0/1084910663 shutdown_connections 2023-09-30T22:27:52.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.548+0000 7fa5ea7ad700 1 --2- 172.21.15.40:0/1084910663 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa5e409e480 0x7fa5e412de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.548+0000 7fa5ea7ad700 1 --2- 172.21.15.40:0/1084910663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5e409c890 0x7fa5e412d3d0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.548+0000 7fa5ea7ad700 1 --2- 172.21.15.40:0/1084910663 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5e409d920 0x7fa5e412d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.548+0000 7fa5ea7ad700 1 -- 172.21.15.40:0/1084910663 >> 172.21.15.40:0/1084910663 conn(0x7fa5e40a7080 msgr2=0x7fa5e41333e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:52.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.548+0000 7fa5ea7ad700 1 -- 172.21.15.40:0/1084910663 shutdown_connections 2023-09-30T22:27:52.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.548+0000 7fa5ea7ad700 1 -- 172.21.15.40:0/1084910663 wait complete. 2023-09-30T22:27:52.563 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:52.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.570+0000 7f3a5370d700 1 Processor -- start 2023-09-30T22:27:52.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.570+0000 7f3a5370d700 1 -- start start 2023-09-30T22:27:52.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.570+0000 7f3a5370d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3a4c09d920 0x7f3a4c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.570+0000 7f3a5370d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a4c09f0f0 0x7f3a4c09e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.570+0000 7f3a5370d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a4c09f940 con 0x7f3a4c133ca0 2023-09-30T22:27:52.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.570+0000 7f3a5370d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a4c06b4c0 con 0x7f3a4c09d920 2023-09-30T22:27:52.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.570+0000 7f3a5370d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c09a8f0 con 0x7f3a4c09f0f0 2023-09-30T22:27:52.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.571+0000 7f3a514a9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3a4c09d920 0x7f3a4c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.571+0000 7f3a50ca8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a4c09f0f0 0x7f3a4c09e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.571+0000 7f3a50ca8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a4c09f0f0 0x7f3a4c09e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:35214/0 (socket says 172.21.15.40:35214) 2023-09-30T22:27:52.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.571+0000 7f3a514a9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3a4c09d920 0x7f3a4c09dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51734/0 (socket says 172.21.15.40:51734) 2023-09-30T22:27:52.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.571+0000 7f3a50ca8700 1 -- 172.21.15.40:0/3078963757 learned_addr learned my addr 172.21.15.40:0/3078963757 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:52.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.571+0000 7f3a50ca8700 1 -- 172.21.15.40:0/3078963757 >> v2:172.21.15.40:3300/0 conn(0x7f3a4c09d920 msgr2=0x7f3a4c09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:52.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.571+0000 7f3a50ca8700 1 --2- 172.21.15.40:0/3078963757 >> v2:172.21.15.40:3300/0 conn(0x7f3a4c09d920 0x7f3a4c09dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.571+0000 7f3a50ca8700 1 -- 172.21.15.40:0/3078963757 >> v1:172.21.15.40:6789/0 conn(0x7f3a4c133ca0 legacy=0x7f3a4c134120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.571+0000 7f3a50ca8700 1 -- 172.21.15.40:0/3078963757 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4c09f6e0 con 0x7f3a4c09f0f0 2023-09-30T22:27:52.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.571+0000 7f3a50ca8700 1 --2- 172.21.15.40:0/3078963757 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a4c09f0f0 0x7f3a4c09e230 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c0098f0 tx=0x7f3a3c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a60cf77ca27d467 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:52.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.571+0000 7f3a43fff700 1 -- 172.21.15.40:0/3078963757 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c011830 con 0x7f3a4c09f0f0 2023-09-30T22:27:52.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.571+0000 7f3a43fff700 1 -- 172.21.15.40:0/3078963757 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3c011990 con 0x7f3a4c09f0f0 2023-09-30T22:27:52.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.571+0000 7f3a43fff700 1 -- 172.21.15.40:0/3078963757 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c011d20 con 0x7f3a4c09f0f0 2023-09-30T22:27:52.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.572+0000 7f3a5370d700 1 -- 172.21.15.40:0/3078963757 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a4c09f0f0 msgr2=0x7f3a4c09e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.572+0000 7f3a5370d700 1 --2- 172.21.15.40:0/3078963757 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a4c09f0f0 0x7f3a4c09e230 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c0098f0 tx=0x7f3a3c009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:52.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.572+0000 7f3a5370d700 1 -- 172.21.15.40:0/3078963757 shutdown_connections 2023-09-30T22:27:52.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.572+0000 7f3a5370d700 1 --2- 172.21.15.40:0/3078963757 >> v2:172.21.15.40:3300/0 conn(0x7f3a4c09d920 0x7f3a4c09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.572+0000 7f3a5370d700 1 --2- 172.21.15.40:0/3078963757 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a4c09f0f0 0x7f3a4c09e230 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.572+0000 7f3a5370d700 1 -- 172.21.15.40:0/3078963757 >> 172.21.15.40:0/3078963757 conn(0x7f3a4c09fb20 msgr2=0x7f3a4c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:52.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.572+0000 7f3a5370d700 1 -- 172.21.15.40:0/3078963757 shutdown_connections 2023-09-30T22:27:52.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.572+0000 7f3a5370d700 1 -- 172.21.15.40:0/3078963757 wait complete. 2023-09-30T22:27:52.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.573+0000 7f3a5370d700 1 Processor -- start 2023-09-30T22:27:52.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.573+0000 7f3a5370d700 1 -- start start 2023-09-30T22:27:52.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.574+0000 7f3a5370d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a4c09d920 0x7f3a4c11e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.574+0000 7f3a5370d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a4c133ca0 0x7f3a4c11e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.574+0000 7f3a5370d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a4c1317a0 0x7f3a4c11eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.574+0000 7f3a5370d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c122890 con 0x7f3a4c09d920 2023-09-30T22:27:52.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.574+0000 7f3a5370d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c121ed0 con 0x7f3a4c1317a0 2023-09-30T22:27:52.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.574+0000 7f3a5370d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c0a2980 con 0x7f3a4c133ca0 2023-09-30T22:27:52.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.574+0000 7f3a50ca8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a4c133ca0 0x7f3a4c11e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.574+0000 7f3a50ca8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a4c133ca0 0x7f3a4c11e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:35216/0 (socket says 172.21.15.40:35216) 2023-09-30T22:27:52.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.574+0000 7f3a50ca8700 1 -- 172.21.15.40:0/790271898 learned_addr learned my addr 172.21.15.40:0/790271898 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:52.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.574+0000 7f3a514a9700 1 --2- 172.21.15.40:0/790271898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a4c09d920 0x7f3a4c11e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.574+0000 7f3a51caa700 1 --2- 172.21.15.40:0/790271898 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a4c1317a0 0x7f3a4c11eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.574+0000 7f3a50ca8700 1 -- 172.21.15.40:0/790271898 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a4c1317a0 msgr2=0x7f3a4c11eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.574+0000 7f3a50ca8700 1 --2- 172.21.15.40:0/790271898 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a4c1317a0 0x7f3a4c11eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.574+0000 7f3a50ca8700 1 -- 172.21.15.40:0/790271898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a4c09d920 msgr2=0x7f3a4c11e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.574+0000 7f3a50ca8700 1 --2- 172.21.15.40:0/790271898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a4c09d920 0x7f3a4c11e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.574+0000 7f3a50ca8700 1 -- 172.21.15.40:0/790271898 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a3c009550 con 0x7f3a4c133ca0 2023-09-30T22:27:52.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.574+0000 7f3a50ca8700 1 --2- 172.21.15.40:0/790271898 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a4c133ca0 0x7f3a4c11e990 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c009f50 tx=0x7f3a3c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:52.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.574+0000 7f3a41ffb700 1 -- 172.21.15.40:0/790271898 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c004300 con 0x7f3a4c133ca0 2023-09-30T22:27:52.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.575+0000 7f3a41ffb700 1 -- 172.21.15.40:0/790271898 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3c01f070 con 0x7f3a4c133ca0 2023-09-30T22:27:52.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.575+0000 7f3a41ffb700 1 -- 172.21.15.40:0/790271898 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c0036a0 con 0x7f3a4c133ca0 2023-09-30T22:27:52.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.575+0000 7f3a5370d700 1 -- 172.21.15.40:0/790271898 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a4c121210 con 0x7f3a4c133ca0 2023-09-30T22:27:52.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.575+0000 7f3a5370d700 1 -- 172.21.15.40:0/790271898 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a4c11ffc0 con 0x7f3a4c133ca0 2023-09-30T22:27:52.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.576+0000 7f3a41ffb700 1 -- 172.21.15.40:0/790271898 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3a3c021030 con 0x7f3a4c133ca0 2023-09-30T22:27:52.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.576+0000 7f3a41ffb700 1 -- 172.21.15.40:0/790271898 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3a3c0409b0 con 0x7f3a4c133ca0 2023-09-30T22:27:52.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.576+0000 7f3a5370d700 1 -- 172.21.15.40:0/790271898 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a4c121a70 con 0x7f3a4c133ca0 2023-09-30T22:27:52.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.581+0000 7f3a41ffb700 1 -- 172.21.15.40:0/790271898 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3a3c015080 con 0x7f3a4c133ca0 2023-09-30T22:27:52.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.617+0000 7f5d74f9f700 1 Processor -- start 2023-09-30T22:27:52.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.617+0000 7f5d74f9f700 1 -- start start 2023-09-30T22:27:52.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.618+0000 7f5d74f9f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5d701308b0 0x7f5d70130c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.618+0000 7f5d74f9f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d70133800 0x7f5d70133c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.618+0000 7f5d74f9f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d70134170 0x7f5d7013ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.618+0000 7f5d74f9f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d700a24a0 con 0x7f5d701308b0 2023-09-30T22:27:52.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.618+0000 7f5d74f9f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7009f710 con 0x7f5d70134170 2023-09-30T22:27:52.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.618+0000 7f5d74f9f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d70130480 con 0x7f5d70133800 2023-09-30T22:27:52.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.618+0000 7f5d6f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5d701308b0 0x7f5d70130c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.618+0000 7f5d6effd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d70133800 0x7f5d70133c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.618+0000 7f5d6f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5d701308b0 0x7f5d70130c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51752/0 (socket says 172.21.15.40:51752) 2023-09-30T22:27:52.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.618+0000 7f5d6ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d70134170 0x7f5d7013ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.618+0000 7f5d6f7fe700 1 -- 172.21.15.40:0/8952650 learned_addr learned my addr 172.21.15.40:0/8952650 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:52.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.618+0000 7f5d6ffff700 1 -- 172.21.15.40:0/8952650 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d70133800 msgr2=0x7f5d70133c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:52.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.618+0000 7f5d6ffff700 1 --2- 172.21.15.40:0/8952650 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d70133800 0x7f5d70133c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.618+0000 7f5d6ffff700 1 -- 172.21.15.40:0/8952650 >> v2:172.21.15.40:3300/0 conn(0x7f5d701308b0 msgr2=0x7f5d70130c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:52.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.618+0000 7f5d6ffff700 1 --2- 172.21.15.40:0/8952650 >> v2:172.21.15.40:3300/0 conn(0x7f5d701308b0 0x7f5d70130c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.618+0000 7f5d6ffff700 1 -- 172.21.15.40:0/8952650 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d700a2890 con 0x7f5d70134170 2023-09-30T22:27:52.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.618+0000 7f5d6f7fe700 1 --2- 172.21.15.40:0/8952650 >> v2:172.21.15.40:3300/0 conn(0x7f5d701308b0 0x7f5d70130c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:52.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.618+0000 7f5d6ffff700 1 --2- 172.21.15.40:0/8952650 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d70134170 0x7f5d7013ab30 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009d90 tx=0x7f5d6800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=240c5dcb3f92a5f4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:52.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.619+0000 7f5d6e7fc700 1 -- 172.21.15.40:0/8952650 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6800e070 con 0x7f5d70134170 2023-09-30T22:27:52.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.619+0000 7f5d6e7fc700 1 -- 172.21.15.40:0/8952650 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6800bb20 con 0x7f5d70134170 2023-09-30T22:27:52.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.619+0000 7f5d6e7fc700 1 -- 172.21.15.40:0/8952650 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d68012430 con 0x7f5d70134170 2023-09-30T22:27:52.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.619+0000 7f5d74f9f700 1 -- 172.21.15.40:0/8952650 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d70134170 msgr2=0x7f5d7013ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.619+0000 7f5d74f9f700 1 --2- 172.21.15.40:0/8952650 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d70134170 0x7f5d7013ab30 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009d90 tx=0x7f5d6800b330 comp rx=0 tx=0).stop 2023-09-30T22:27:52.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.619+0000 7f5d74f9f700 1 -- 172.21.15.40:0/8952650 shutdown_connections 2023-09-30T22:27:52.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.619+0000 7f5d74f9f700 1 --2- 172.21.15.40:0/8952650 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d70134170 0x7f5d7013ab30 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.619+0000 7f5d74f9f700 1 --2- 172.21.15.40:0/8952650 >> v2:172.21.15.40:3300/0 conn(0x7f5d701308b0 0x7f5d70130c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.619+0000 7f5d74f9f700 1 --2- 172.21.15.40:0/8952650 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d70133800 0x7f5d70133c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.619+0000 7f5d74f9f700 1 -- 172.21.15.40:0/8952650 >> 172.21.15.40:0/8952650 conn(0x7f5d700a6df0 msgr2=0x7f5d700a2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:52.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.619+0000 7f5d74f9f700 1 -- 172.21.15.40:0/8952650 shutdown_connections 2023-09-30T22:27:52.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.619+0000 7f5d74f9f700 1 -- 172.21.15.40:0/8952650 wait complete. 2023-09-30T22:27:52.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.621+0000 7f5d74f9f700 1 Processor -- start 2023-09-30T22:27:52.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.621+0000 7f5d74f9f700 1 -- start start 2023-09-30T22:27:52.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.621+0000 7f5d74f9f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d701308b0 0x7f5d7006cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.621+0000 7f5d74f9f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d70133800 0x7f5d7006d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.621+0000 7f5d74f9f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d70134170 0x7f5d7006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.621+0000 7f5d74f9f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d70070e00 con 0x7f5d70133800 2023-09-30T22:27:52.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.621+0000 7f5d74f9f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7006e2a0 con 0x7f5d701308b0 2023-09-30T22:27:52.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.621+0000 7f5d74f9f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7006e880 con 0x7f5d70134170 2023-09-30T22:27:52.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.621+0000 7f5d6f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d701308b0 0x7f5d7006cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.621+0000 7f5d6ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d70134170 0x7f5d7006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.621+0000 7f5d6effd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d70133800 0x7f5d7006d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.621+0000 7f5d6ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d70134170 0x7f5d7006d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:35232/0 (socket says 172.21.15.40:35232) 2023-09-30T22:27:52.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.621+0000 7f5d6ffff700 1 -- 172.21.15.40:0/2501561135 learned_addr learned my addr 172.21.15.40:0/2501561135 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:52.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.621+0000 7f5d6f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d701308b0 0x7f5d7006cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41576/0 (socket says 172.21.15.40:41576) 2023-09-30T22:27:52.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.622+0000 7f5d6effd700 1 -- 172.21.15.40:0/2501561135 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d70134170 msgr2=0x7f5d7006d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.622+0000 7f5d6effd700 1 --2- 172.21.15.40:0/2501561135 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d70134170 0x7f5d7006d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.622+0000 7f5d6effd700 1 -- 172.21.15.40:0/2501561135 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d701308b0 msgr2=0x7f5d7006cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.622+0000 7f5d6effd700 1 --2- 172.21.15.40:0/2501561135 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d701308b0 0x7f5d7006cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.622+0000 7f5d6effd700 1 -- 172.21.15.40:0/2501561135 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d60009500 con 0x7f5d70133800 2023-09-30T22:27:52.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.622+0000 7f5d6ffff700 1 --2- 172.21.15.40:0/2501561135 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d70134170 0x7f5d7006d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:52.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.622+0000 7f5d6f7fe700 1 --2- 172.21.15.40:0/2501561135 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d701308b0 0x7f5d7006cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:52.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.622+0000 7f5d6effd700 1 --2- 172.21.15.40:0/2501561135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d70133800 0x7f5d7006d170 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f5d640140f0 tx=0x7f5d64014400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:52.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.622+0000 7f5d57fff700 1 -- 172.21.15.40:0/2501561135 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d64020070 con 0x7f5d70133800 2023-09-30T22:27:52.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.622+0000 7f5d57fff700 1 -- 172.21.15.40:0/2501561135 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d64017040 con 0x7f5d70133800 2023-09-30T22:27:52.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.622+0000 7f5d74f9f700 1 -- 172.21.15.40:0/2501561135 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d68009a70 con 0x7f5d70133800 2023-09-30T22:27:52.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.622+0000 7f5d57fff700 1 -- 172.21.15.40:0/2501561135 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d64016020 con 0x7f5d70133800 2023-09-30T22:27:52.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.622+0000 7f5d74f9f700 1 -- 172.21.15.40:0/2501561135 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d7009ee60 con 0x7f5d70133800 2023-09-30T22:27:52.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.623+0000 7f5d57fff700 1 -- 172.21.15.40:0/2501561135 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5d640110d0 con 0x7f5d70133800 2023-09-30T22:27:52.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.623+0000 7f5d57fff700 1 -- 172.21.15.40:0/2501561135 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5d64047790 con 0x7f5d70133800 2023-09-30T22:27:52.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.623+0000 7f5d74f9f700 1 -- 172.21.15.40:0/2501561135 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d7012c9e0 con 0x7f5d70133800 2023-09-30T22:27:52.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.628+0000 7f5d57fff700 1 -- 172.21.15.40:0/2501561135 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5d6401c480 con 0x7f5d70133800 2023-09-30T22:27:52.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.777+0000 7fb7e5304700 1 -- 172.21.15.40:0/2010233499 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb7e0071700 con 0x7fb7e01373b0 2023-09-30T22:27:52.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.778+0000 7fb7c77fe700 1 -- 172.21.15.40:0/2010233499 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb7d8019020 con 0x7fb7e01373b0 2023-09-30T22:27:52.779 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:52.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.780+0000 7fb7e5304700 1 -- 172.21.15.40:0/2010233499 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb7e01373b0 msgr2=0x7fb7e01d5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.780+0000 7fb7e5304700 1 --2- 172.21.15.40:0/2010233499 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb7e01373b0 0x7fb7e01d5690 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb7d800bdf0 tx=0x7fb7d8009ed0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.780+0000 7fb7e5304700 1 -- 172.21.15.40:0/2010233499 shutdown_connections 2023-09-30T22:27:52.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.780+0000 7fb7e5304700 1 --2- 172.21.15.40:0/2010233499 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb7e01373b0 0x7fb7e01d5690 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.780+0000 7fb7e5304700 1 --2- 172.21.15.40:0/2010233499 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb7e0131d50 0x7fb7e012b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.780+0000 7fb7e5304700 1 --2- 172.21.15.40:0/2010233499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7e0134a90 0x7fb7e012ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.780+0000 7fb7e5304700 1 -- 172.21.15.40:0/2010233499 >> 172.21.15.40:0/2010233499 conn(0x7fb7e00a2a00 msgr2=0x7fb7e0099a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:52.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.780+0000 7fb7e5304700 1 -- 172.21.15.40:0/2010233499 shutdown_connections 2023-09-30T22:27:52.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.780+0000 7fb7e5304700 1 -- 172.21.15.40:0/2010233499 wait complete. 2023-09-30T22:27:52.793 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:52.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.817+0000 7f3a5370d700 1 -- 172.21.15.40:0/790271898 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3a4c062380 con 0x7f3a4c133ca0 2023-09-30T22:27:52.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.817+0000 7f3a41ffb700 1 -- 172.21.15.40:0/790271898 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3a3c0199a0 con 0x7f3a4c133ca0 2023-09-30T22:27:52.818 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:52.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.819+0000 7f3a5370d700 1 -- 172.21.15.40:0/790271898 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a4c133ca0 msgr2=0x7f3a4c11e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.819+0000 7f3a5370d700 1 --2- 172.21.15.40:0/790271898 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a4c133ca0 0x7f3a4c11e990 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c009f50 tx=0x7f3a3c004750 comp rx=0 tx=0).stop 2023-09-30T22:27:52.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.819+0000 7f3a5370d700 1 -- 172.21.15.40:0/790271898 shutdown_connections 2023-09-30T22:27:52.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.819+0000 7f3a5370d700 1 --2- 172.21.15.40:0/790271898 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a4c1317a0 0x7f3a4c11eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.819+0000 7f3a5370d700 1 --2- 172.21.15.40:0/790271898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a4c09d920 0x7f3a4c11e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.819+0000 7f3a5370d700 1 --2- 172.21.15.40:0/790271898 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a4c133ca0 0x7f3a4c11e990 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.819+0000 7f3a5370d700 1 -- 172.21.15.40:0/790271898 >> 172.21.15.40:0/790271898 conn(0x7f3a4c09fb20 msgr2=0x7f3a4c133480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:52.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.820+0000 7f3a5370d700 1 -- 172.21.15.40:0/790271898 shutdown_connections 2023-09-30T22:27:52.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.820+0000 7f3a5370d700 1 -- 172.21.15.40:0/790271898 wait complete. 2023-09-30T22:27:52.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.828+0000 7f5d74f9f700 1 -- 172.21.15.40:0/2501561135 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5d7006fea0 con 0x7f5d70133800 2023-09-30T22:27:52.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.828+0000 7f5d57fff700 1 -- 172.21.15.40:0/2501561135 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5d6401a340 con 0x7f5d70133800 2023-09-30T22:27:52.829 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:52.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.831+0000 7f5d74f9f700 1 -- 172.21.15.40:0/2501561135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d70133800 msgr2=0x7f5d7006d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.831+0000 7f5d74f9f700 1 --2- 172.21.15.40:0/2501561135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d70133800 0x7f5d7006d170 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f5d640140f0 tx=0x7f5d64014400 comp rx=0 tx=0).stop 2023-09-30T22:27:52.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.831+0000 7f5d74f9f700 1 -- 172.21.15.40:0/2501561135 shutdown_connections 2023-09-30T22:27:52.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.831+0000 7f5d74f9f700 1 --2- 172.21.15.40:0/2501561135 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d70134170 0x7f5d7006d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.831+0000 7f5d74f9f700 1 --2- 172.21.15.40:0/2501561135 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d701308b0 0x7f5d7006cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.831+0000 7f5d74f9f700 1 --2- 172.21.15.40:0/2501561135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d70133800 0x7f5d7006d170 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.831+0000 7f5d74f9f700 1 -- 172.21.15.40:0/2501561135 >> 172.21.15.40:0/2501561135 conn(0x7f5d700a6df0 msgr2=0x7f5d70132f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:52.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.831+0000 7f5d74f9f700 1 -- 172.21.15.40:0/2501561135 shutdown_connections 2023-09-30T22:27:52.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:52.831+0000 7f5d74f9f700 1 -- 172.21.15.40:0/2501561135 wait complete. 2023-09-30T22:27:52.834 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:52.844 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:53.563 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:53.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.704+0000 7fa15723e700 1 Processor -- start 2023-09-30T22:27:53.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.704+0000 7fa15723e700 1 -- start start 2023-09-30T22:27:53.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.704+0000 7fa15723e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa15006f070 0x7fa15006f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.705+0000 7fa15723e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa15006f980 0x7fa150097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.705+0000 7fa15723e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa15006fdb0 0x7fa1500975d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.705+0000 7fa15723e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa150071af0 con 0x7fa15006fdb0 2023-09-30T22:27:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.705+0000 7fa15723e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa150070830 con 0x7fa15006f980 2023-09-30T22:27:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.705+0000 7fa15723e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa150070ad0 con 0x7fa15006f070 2023-09-30T22:27:53.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.705+0000 7fa1557db700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa15006fdb0 0x7fa1500975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:53.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.705+0000 7fa154fda700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa15006f070 0x7fa15006f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:53.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.705+0000 7fa147fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa15006f980 0x7fa150097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:53.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.705+0000 7fa1557db700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa15006fdb0 0x7fa1500975d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40914/0 (socket says 172.21.15.40:40914) 2023-09-30T22:27:53.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.705+0000 7fa154fda700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa15006f070 0x7fa15006f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:45488/0 (socket says 172.21.15.40:45488) 2023-09-30T22:27:53.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.705+0000 7fa1557db700 1 -- 172.21.15.40:0/1979004841 learned_addr learned my addr 172.21.15.40:0/1979004841 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:53.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.705+0000 7fa147fff700 1 -- 172.21.15.40:0/1979004841 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa15006f070 msgr2=0x7fa15006f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:53.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.705+0000 7fa147fff700 1 --2- 172.21.15.40:0/1979004841 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa15006f070 0x7fa15006f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.705+0000 7fa147fff700 1 -- 172.21.15.40:0/1979004841 >> v2:172.21.15.40:3300/0 conn(0x7fa15006fdb0 msgr2=0x7fa1500975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:53.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.705+0000 7fa147fff700 1 --2- 172.21.15.40:0/1979004841 >> v2:172.21.15.40:3300/0 conn(0x7fa15006fdb0 0x7fa1500975d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.705+0000 7fa147fff700 1 -- 172.21.15.40:0/1979004841 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa150070de0 con 0x7fa15006f980 2023-09-30T22:27:53.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.705+0000 7fa1557db700 1 --2- 172.21.15.40:0/1979004841 >> v2:172.21.15.40:3300/0 conn(0x7fa15006fdb0 0x7fa1500975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:53.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.705+0000 7fa154fda700 1 --2- 172.21.15.40:0/1979004841 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa15006f070 0x7fa15006f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:53.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.705+0000 7fa147fff700 1 --2- 172.21.15.40:0/1979004841 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa15006f980 0x7fa150097090 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fa140009870 tx=0x7fa140009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c402e82625a8771 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:53.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.705+0000 7fa1477fe700 1 -- 172.21.15.40:0/1979004841 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa140011830 con 0x7fa15006f980 2023-09-30T22:27:53.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.705+0000 7fa1477fe700 1 -- 172.21.15.40:0/1979004841 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa140011990 con 0x7fa15006f980 2023-09-30T22:27:53.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.706+0000 7fa1477fe700 1 -- 172.21.15.40:0/1979004841 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa140011d20 con 0x7fa15006f980 2023-09-30T22:27:53.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.706+0000 7fa15723e700 1 -- 172.21.15.40:0/1979004841 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa15006f980 msgr2=0x7fa150097090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:53.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.706+0000 7fa15723e700 1 --2- 172.21.15.40:0/1979004841 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa15006f980 0x7fa150097090 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fa140009870 tx=0x7fa140009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:53.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.706+0000 7fa15723e700 1 -- 172.21.15.40:0/1979004841 shutdown_connections 2023-09-30T22:27:53.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.706+0000 7fa15723e700 1 --2- 172.21.15.40:0/1979004841 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa15006f070 0x7fa15006f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.706+0000 7fa15723e700 1 --2- 172.21.15.40:0/1979004841 >> v2:172.21.15.40:3300/0 conn(0x7fa15006fdb0 0x7fa1500975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.706+0000 7fa15723e700 1 --2- 172.21.15.40:0/1979004841 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa15006f980 0x7fa150097090 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.706+0000 7fa15723e700 1 -- 172.21.15.40:0/1979004841 >> 172.21.15.40:0/1979004841 conn(0x7fa1500a41a0 msgr2=0x7fa1500a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:53.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.706+0000 7fa15723e700 1 -- 172.21.15.40:0/1979004841 shutdown_connections 2023-09-30T22:27:53.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.706+0000 7fa15723e700 1 -- 172.21.15.40:0/1979004841 wait complete. 2023-09-30T22:27:53.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.707+0000 7fa15723e700 1 Processor -- start 2023-09-30T22:27:53.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.708+0000 7fa15723e700 1 -- start start 2023-09-30T22:27:53.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.708+0000 7fa15723e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa15006f070 0x7fa15012d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:53.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.708+0000 7fa15723e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa15006f980 0x7fa15012d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:53.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.708+0000 7fa15723e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa15006fdb0 0x7fa15012da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:53.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.708+0000 7fa15723e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1501308a0 con 0x7fa15006f070 2023-09-30T22:27:53.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.708+0000 7fa15723e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1501322d0 con 0x7fa15006f980 2023-09-30T22:27:53.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.708+0000 7fa15723e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa150130540 con 0x7fa15006fdb0 2023-09-30T22:27:53.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.708+0000 7fa154fda700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa15006f070 0x7fa15012d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:53.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.708+0000 7fa1557db700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa15006fdb0 0x7fa15012da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:53.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.708+0000 7fa154fda700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa15006f070 0x7fa15012d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40924/0 (socket says 172.21.15.40:40924) 2023-09-30T22:27:53.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.708+0000 7fa154fda700 1 -- 172.21.15.40:0/294991049 learned_addr learned my addr 172.21.15.40:0/294991049 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:53.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.708+0000 7fa147fff700 1 --2- 172.21.15.40:0/294991049 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa15006f980 0x7fa15012d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:53.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.709+0000 7fa154fda700 1 -- 172.21.15.40:0/294991049 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa15006fdb0 msgr2=0x7fa15012da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:53.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.709+0000 7fa154fda700 1 --2- 172.21.15.40:0/294991049 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa15006fdb0 0x7fa15012da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.709+0000 7fa154fda700 1 -- 172.21.15.40:0/294991049 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa15006f980 msgr2=0x7fa15012d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:53.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.709+0000 7fa154fda700 1 --2- 172.21.15.40:0/294991049 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa15006f980 0x7fa15012d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.709+0000 7fa154fda700 1 -- 172.21.15.40:0/294991049 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa14c0094a0 con 0x7fa15006f070 2023-09-30T22:27:53.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.709+0000 7fa1557db700 1 --2- 172.21.15.40:0/294991049 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa15006fdb0 0x7fa15012da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:53.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.709+0000 7fa147fff700 1 --2- 172.21.15.40:0/294991049 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa15006f980 0x7fa15012d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:53.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.709+0000 7fa154fda700 1 --2- 172.21.15.40:0/294991049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa15006f070 0x7fa15012d010 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fa14c00ec10 tx=0x7fa14c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:53.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.709+0000 7fa1457fa700 1 -- 172.21.15.40:0/294991049 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c00c850 con 0x7fa15006f070 2023-09-30T22:27:53.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.709+0000 7fa1457fa700 1 -- 172.21.15.40:0/294991049 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14c00c9b0 con 0x7fa15006f070 2023-09-30T22:27:53.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.709+0000 7fa15723e700 1 -- 172.21.15.40:0/294991049 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa148009b30 con 0x7fa15006f070 2023-09-30T22:27:53.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.709+0000 7fa1457fa700 1 -- 172.21.15.40:0/294991049 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c00cd40 con 0x7fa15006f070 2023-09-30T22:27:53.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.709+0000 7fa15723e700 1 -- 172.21.15.40:0/294991049 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1400094a0 con 0x7fa15006f070 2023-09-30T22:27:53.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.710+0000 7fa1457fa700 1 -- 172.21.15.40:0/294991049 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa14c013470 con 0x7fa15006f070 2023-09-30T22:27:53.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.710+0000 7fa1457fa700 1 -- 172.21.15.40:0/294991049 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa14c03f7b0 con 0x7fa15006f070 2023-09-30T22:27:53.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.710+0000 7fa15723e700 1 -- 172.21.15.40:0/294991049 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa15012fa60 con 0x7fa15006f070 2023-09-30T22:27:53.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.715+0000 7fa1457fa700 1 -- 172.21.15.40:0/294991049 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa14c013720 con 0x7fa15006f070 2023-09-30T22:27:53.795 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:53.834 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:53.845 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:53.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.912+0000 7fa15723e700 1 -- 172.21.15.40:0/294991049 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa150062380 con 0x7fa15006f070 2023-09-30T22:27:53.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.912+0000 7fa1457fa700 1 -- 172.21.15.40:0/294991049 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa14c01bb60 con 0x7fa15006f070 2023-09-30T22:27:53.913 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:53.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.914+0000 7fa15723e700 1 -- 172.21.15.40:0/294991049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa15006f070 msgr2=0x7fa15012d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:53.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.914+0000 7fa15723e700 1 --2- 172.21.15.40:0/294991049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa15006f070 0x7fa15012d010 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fa14c00ec10 tx=0x7fa14c00ef20 comp rx=0 tx=0).stop 2023-09-30T22:27:53.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.915+0000 7fa15723e700 1 -- 172.21.15.40:0/294991049 shutdown_connections 2023-09-30T22:27:53.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.915+0000 7fa15723e700 1 --2- 172.21.15.40:0/294991049 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa15006fdb0 0x7fa15012da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.915+0000 7fa15723e700 1 --2- 172.21.15.40:0/294991049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa15006f070 0x7fa15012d010 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.915+0000 7fa15723e700 1 --2- 172.21.15.40:0/294991049 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa15006f980 0x7fa15012d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.915+0000 7fa15723e700 1 -- 172.21.15.40:0/294991049 >> 172.21.15.40:0/294991049 conn(0x7fa1500a41a0 msgr2=0x7fa15012bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:53.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.915+0000 7fa15723e700 1 -- 172.21.15.40:0/294991049 shutdown_connections 2023-09-30T22:27:53.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.915+0000 7fa15723e700 1 -- 172.21.15.40:0/294991049 wait complete. 2023-09-30T22:27:53.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.926+0000 7fa6d75ec700 1 Processor -- start 2023-09-30T22:27:53.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.927+0000 7fa6d75ec700 1 -- start start 2023-09-30T22:27:53.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.927+0000 7fa6d75ec700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6d0133e00 0x7fa6d01341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:53.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.927+0000 7fa6d75ec700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa6d009df40 0x7fa6d013bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:53.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.927+0000 7fa6d75ec700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6d0133940 con 0x7fa6d009d400 2023-09-30T22:27:53.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.927+0000 7fa6d75ec700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d009f0d0 con 0x7fa6d009df40 2023-09-30T22:27:53.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.927+0000 7fa6d75ec700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d0133be0 con 0x7fa6d0133e00 2023-09-30T22:27:53.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.927+0000 7fa6d5388700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6d0133e00 0x7fa6d01341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:53.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.927+0000 7fa6d5388700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6d0133e00 0x7fa6d01341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39446/0 (socket says 172.21.15.40:39446) 2023-09-30T22:27:53.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.927+0000 7fa6d5388700 1 -- 172.21.15.40:0/2454878963 learned_addr learned my addr 172.21.15.40:0/2454878963 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:53.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.927+0000 7fa6d5b89700 1 --2- 172.21.15.40:0/2454878963 >> v2:172.21.15.40:3300/0 conn(0x7fa6d009df40 0x7fa6d013bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:53.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.928+0000 7fa6d5388700 1 -- 172.21.15.40:0/2454878963 >> v2:172.21.15.40:3300/0 conn(0x7fa6d009df40 msgr2=0x7fa6d013bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:53.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.928+0000 7fa6d5388700 1 --2- 172.21.15.40:0/2454878963 >> v2:172.21.15.40:3300/0 conn(0x7fa6d009df40 0x7fa6d013bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.928+0000 7fa6d5388700 1 -- 172.21.15.40:0/2454878963 >> v1:172.21.15.40:6789/0 conn(0x7fa6d009d400 legacy=0x7fa6d009d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:53.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.928+0000 7fa6d5388700 1 -- 172.21.15.40:0/2454878963 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d009a860 con 0x7fa6d0133e00 2023-09-30T22:27:53.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.928+0000 7fa6d5388700 1 --2- 172.21.15.40:0/2454878963 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6d0133e00 0x7fa6d01341d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc0098f0 tx=0x7fa6cc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30c64d7692f6bd15 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:53.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.928+0000 7fa6c7fff700 1 -- 172.21.15.40:0/2454878963 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc011830 con 0x7fa6d0133e00 2023-09-30T22:27:53.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.928+0000 7fa6c7fff700 1 -- 172.21.15.40:0/2454878963 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6cc011990 con 0x7fa6d0133e00 2023-09-30T22:27:53.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.928+0000 7fa6c7fff700 1 -- 172.21.15.40:0/2454878963 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc011d20 con 0x7fa6d0133e00 2023-09-30T22:27:53.931 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:53.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.929+0000 7fa6d75ec700 1 -- 172.21.15.40:0/2454878963 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6d0133e00 msgr2=0x7fa6d01341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:53.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.929+0000 7fa6d75ec700 1 --2- 172.21.15.40:0/2454878963 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6d0133e00 0x7fa6d01341d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc0098f0 tx=0x7fa6cc009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:53.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.929+0000 7fa6d75ec700 1 -- 172.21.15.40:0/2454878963 shutdown_connections 2023-09-30T22:27:53.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.929+0000 7fa6d75ec700 1 --2- 172.21.15.40:0/2454878963 >> v2:172.21.15.40:3300/0 conn(0x7fa6d009df40 0x7fa6d013bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.929+0000 7fa6d75ec700 1 --2- 172.21.15.40:0/2454878963 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6d0133e00 0x7fa6d01341d0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.929+0000 7fa6d75ec700 1 -- 172.21.15.40:0/2454878963 >> 172.21.15.40:0/2454878963 conn(0x7fa6d00a2a00 msgr2=0x7fa6d00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:53.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.929+0000 7fa6d75ec700 1 -- 172.21.15.40:0/2454878963 shutdown_connections 2023-09-30T22:27:53.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.929+0000 7fa6d75ec700 1 -- 172.21.15.40:0/2454878963 wait complete. 2023-09-30T22:27:53.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.930+0000 7fa6d75ec700 1 Processor -- start 2023-09-30T22:27:53.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.930+0000 7fa6d75ec700 1 -- start start 2023-09-30T22:27:53.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.931+0000 7fa6d75ec700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa6d009d400 0x7fa6d011bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:53.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.931+0000 7fa6d75ec700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6d009df40 0x7fa6d011c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:53.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.931+0000 7fa6d75ec700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6d0133e00 0x7fa6d011c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:53.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.931+0000 7fa6d75ec700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d00a0100 con 0x7fa6d009df40 2023-09-30T22:27:53.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.931+0000 7fa6d75ec700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d011dab0 con 0x7fa6d0133e00 2023-09-30T22:27:53.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.931+0000 7fa6d75ec700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d011e1e0 con 0x7fa6d009d400 2023-09-30T22:27:53.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.931+0000 7fa6d4b87700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6d009df40 0x7fa6d011c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:53.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.931+0000 7fa6d5b89700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6d0133e00 0x7fa6d011c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:53.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.931+0000 7fa6d4b87700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6d009df40 0x7fa6d011c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40932/0 (socket says 172.21.15.40:40932) 2023-09-30T22:27:53.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.931+0000 7fa6d4b87700 1 -- 172.21.15.40:0/2368277808 learned_addr learned my addr 172.21.15.40:0/2368277808 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:53.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.931+0000 7fa6d5388700 1 --2- 172.21.15.40:0/2368277808 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa6d009d400 0x7fa6d011bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:53.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.931+0000 7fa6d5b89700 1 -- 172.21.15.40:0/2368277808 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa6d009d400 msgr2=0x7fa6d011bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:53.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.931+0000 7fa6d5b89700 1 --2- 172.21.15.40:0/2368277808 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa6d009d400 0x7fa6d011bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.931+0000 7fa6d5b89700 1 -- 172.21.15.40:0/2368277808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6d009df40 msgr2=0x7fa6d011c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:53.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.931+0000 7fa6d5b89700 1 --2- 172.21.15.40:0/2368277808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6d009df40 0x7fa6d011c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.931+0000 7fa6d5b89700 1 -- 172.21.15.40:0/2368277808 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6cc009550 con 0x7fa6d0133e00 2023-09-30T22:27:53.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.931+0000 7fa6d5b89700 1 --2- 172.21.15.40:0/2368277808 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6d0133e00 0x7fa6d011c810 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800ef90 tx=0x7fa6c800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:53.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.932+0000 7fa6c5ffb700 1 -- 172.21.15.40:0/2368277808 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c800cc90 con 0x7fa6d0133e00 2023-09-30T22:27:53.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.932+0000 7fa6c5ffb700 1 -- 172.21.15.40:0/2368277808 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c800f040 con 0x7fa6d0133e00 2023-09-30T22:27:53.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.932+0000 7fa6d75ec700 1 -- 172.21.15.40:0/2368277808 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d012e1a0 con 0x7fa6d0133e00 2023-09-30T22:27:53.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.932+0000 7fa6c5ffb700 1 -- 172.21.15.40:0/2368277808 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c80146c0 con 0x7fa6d0133e00 2023-09-30T22:27:53.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.932+0000 7fa6d75ec700 1 -- 172.21.15.40:0/2368277808 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d0120040 con 0x7fa6d0133e00 2023-09-30T22:27:53.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.933+0000 7fa6d75ec700 1 -- 172.21.15.40:0/2368277808 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d0062380 con 0x7fa6d0133e00 2023-09-30T22:27:53.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.933+0000 7fa6c5ffb700 1 -- 172.21.15.40:0/2368277808 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa6c8014820 con 0x7fa6d0133e00 2023-09-30T22:27:53.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.933+0000 7fa6c5ffb700 1 -- 172.21.15.40:0/2368277808 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa6c8040740 con 0x7fa6d0133e00 2023-09-30T22:27:53.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.938+0000 7fa6c5ffb700 1 -- 172.21.15.40:0/2368277808 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa6c8014ad0 con 0x7fa6d0133e00 2023-09-30T22:27:53.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.981+0000 7f48bd022700 1 Processor -- start 2023-09-30T22:27:53.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.981+0000 7f48bd022700 1 -- start start 2023-09-30T22:27:53.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.981+0000 7f48bd022700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f48b809d920 0x7f48b809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:53.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.981+0000 7f48bd022700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48b809e230 0x7f48b81308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:53.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.982+0000 7f48bd022700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f48b8130de0 0x7f48b8131280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:53.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.982+0000 7f48bd022700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b809edf0 con 0x7f48b8130de0 2023-09-30T22:27:53.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.982+0000 7f48bd022700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b809adf0 con 0x7f48b809e230 2023-09-30T22:27:53.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.982+0000 7f48bd022700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48b809b660 con 0x7f48b809d920 2023-09-30T22:27:53.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.982+0000 7f48b659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48b809e230 0x7f48b81308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:53.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.982+0000 7f48b659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48b809e230 0x7f48b81308a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39464/0 (socket says 172.21.15.40:39464) 2023-09-30T22:27:53.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.982+0000 7f48b759e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f48b8130de0 0x7f48b8131280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:53.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.982+0000 7f48b659c700 1 -- 172.21.15.40:0/939907546 learned_addr learned my addr 172.21.15.40:0/939907546 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:53.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.982+0000 7f48b6d9d700 1 --2- 172.21.15.40:0/939907546 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f48b809d920 0x7f48b809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:53.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.982+0000 7f48b659c700 1 -- 172.21.15.40:0/939907546 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f48b809d920 msgr2=0x7f48b809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:53.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.982+0000 7f48b659c700 1 --2- 172.21.15.40:0/939907546 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f48b809d920 0x7f48b809dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.982+0000 7f48b659c700 1 -- 172.21.15.40:0/939907546 >> v2:172.21.15.40:3300/0 conn(0x7f48b8130de0 msgr2=0x7f48b8131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:53.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.982+0000 7f48b659c700 1 --2- 172.21.15.40:0/939907546 >> v2:172.21.15.40:3300/0 conn(0x7f48b8130de0 0x7f48b8131280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.982+0000 7f48b659c700 1 -- 172.21.15.40:0/939907546 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b809a6e0 con 0x7f48b809e230 2023-09-30T22:27:53.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.982+0000 7f48b759e700 1 --2- 172.21.15.40:0/939907546 >> v2:172.21.15.40:3300/0 conn(0x7f48b8130de0 0x7f48b8131280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:53.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.982+0000 7f48b659c700 1 --2- 172.21.15.40:0/939907546 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48b809e230 0x7f48b81308a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f48ac0098f0 tx=0x7f48ac009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f2d06508d3fa80c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:53.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.982+0000 7f48b5d9b700 1 -- 172.21.15.40:0/939907546 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac011830 con 0x7f48b809e230 2023-09-30T22:27:53.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.983+0000 7f48b5d9b700 1 -- 172.21.15.40:0/939907546 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ac011990 con 0x7f48b809e230 2023-09-30T22:27:53.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.983+0000 7f48b5d9b700 1 -- 172.21.15.40:0/939907546 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac011d20 con 0x7f48b809e230 2023-09-30T22:27:53.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.983+0000 7f48bd022700 1 -- 172.21.15.40:0/939907546 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48b809e230 msgr2=0x7f48b81308a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:53.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.983+0000 7f48bd022700 1 --2- 172.21.15.40:0/939907546 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48b809e230 0x7f48b81308a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f48ac0098f0 tx=0x7f48ac009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:53.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.983+0000 7f48bd022700 1 -- 172.21.15.40:0/939907546 shutdown_connections 2023-09-30T22:27:53.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.983+0000 7f48bd022700 1 --2- 172.21.15.40:0/939907546 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f48b809d920 0x7f48b809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.983+0000 7f48bd022700 1 --2- 172.21.15.40:0/939907546 >> v2:172.21.15.40:3300/0 conn(0x7f48b8130de0 0x7f48b8131280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.983+0000 7f48bd022700 1 --2- 172.21.15.40:0/939907546 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48b809e230 0x7f48b81308a0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.983+0000 7f48bd022700 1 -- 172.21.15.40:0/939907546 >> 172.21.15.40:0/939907546 conn(0x7f48b809fb20 msgr2=0x7f48b809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:53.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.983+0000 7f48bd022700 1 -- 172.21.15.40:0/939907546 shutdown_connections 2023-09-30T22:27:53.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.983+0000 7f48bd022700 1 -- 172.21.15.40:0/939907546 wait complete. 2023-09-30T22:27:53.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.985+0000 7f48bd022700 1 Processor -- start 2023-09-30T22:27:53.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.985+0000 7f48bd022700 1 -- start start 2023-09-30T22:27:53.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.985+0000 7f48bd022700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48b809d920 0x7f48b8135980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:53.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.985+0000 7f48bd022700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f48b809e230 0x7f48b8135ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:53.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.985+0000 7f48bd022700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48b8130de0 0x7f48b8136400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:53.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.986+0000 7f48bd022700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b81334c0 con 0x7f48b809d920 2023-09-30T22:27:53.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.986+0000 7f48bd022700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b8134890 con 0x7f48b8130de0 2023-09-30T22:27:53.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.986+0000 7f48bd022700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48b8134550 con 0x7f48b809e230 2023-09-30T22:27:53.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.986+0000 7f48b6d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48b809d920 0x7f48b8135980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:53.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.986+0000 7f48b6d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48b809d920 0x7f48b8135980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40956/0 (socket says 172.21.15.40:40956) 2023-09-30T22:27:53.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.986+0000 7f48b759e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48b8130de0 0x7f48b8136400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:53.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.986+0000 7f48b6d9d700 1 -- 172.21.15.40:0/3998737067 learned_addr learned my addr 172.21.15.40:0/3998737067 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:53.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.986+0000 7f48b659c700 1 --2- 172.21.15.40:0/3998737067 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f48b809e230 0x7f48b8135ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:53.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.986+0000 7f48b6d9d700 1 -- 172.21.15.40:0/3998737067 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f48b809e230 msgr2=0x7f48b8135ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:53.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.986+0000 7f48b6d9d700 1 --2- 172.21.15.40:0/3998737067 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f48b809e230 0x7f48b8135ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.986+0000 7f48b6d9d700 1 -- 172.21.15.40:0/3998737067 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48b8130de0 msgr2=0x7f48b8136400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:53.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.986+0000 7f48b6d9d700 1 --2- 172.21.15.40:0/3998737067 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48b8130de0 0x7f48b8136400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.986+0000 7f48b6d9d700 1 -- 172.21.15.40:0/3998737067 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b0009a70 con 0x7f48b809d920 2023-09-30T22:27:53.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.986+0000 7f48b659c700 1 --2- 172.21.15.40:0/3998737067 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f48b809e230 0x7f48b8135ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:53.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.986+0000 7f48b759e700 1 --2- 172.21.15.40:0/3998737067 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48b8130de0 0x7f48b8136400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:53.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.986+0000 7f48b6d9d700 1 --2- 172.21.15.40:0/3998737067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48b809d920 0x7f48b8135980 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f48a800e870 tx=0x7f48a800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:53.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.986+0000 7f489f7fe700 1 -- 172.21.15.40:0/3998737067 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a8005a20 con 0x7f48b809d920 2023-09-30T22:27:53.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.986+0000 7f489f7fe700 1 -- 172.21.15.40:0/3998737067 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a8005b80 con 0x7f48b809d920 2023-09-30T22:27:53.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.986+0000 7f48bd022700 1 -- 172.21.15.40:0/3998737067 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48ac009550 con 0x7f48b809d920 2023-09-30T22:27:53.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.986+0000 7f489f7fe700 1 -- 172.21.15.40:0/3998737067 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a8013680 con 0x7f48b809d920 2023-09-30T22:27:53.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.987+0000 7f48bd022700 1 -- 172.21.15.40:0/3998737067 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b8134ac0 con 0x7f48b809d920 2023-09-30T22:27:53.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.988+0000 7f48bd022700 1 -- 172.21.15.40:0/3998737067 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b812d320 con 0x7f48b809d920 2023-09-30T22:27:53.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.988+0000 7f489f7fe700 1 -- 172.21.15.40:0/3998737067 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f48a80137e0 con 0x7f48b809d920 2023-09-30T22:27:53.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.988+0000 7f489f7fe700 1 -- 172.21.15.40:0/3998737067 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f48a803fc30 con 0x7f48b809d920 2023-09-30T22:27:53.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:53.993+0000 7f489f7fe700 1 -- 172.21.15.40:0/3998737067 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f48a8006030 con 0x7f48b809d920 2023-09-30T22:27:54.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.042+0000 7f76a4770700 1 Processor -- start 2023-09-30T22:27:54.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.042+0000 7f76a4770700 1 -- start start 2023-09-30T22:27:54.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.043+0000 7f76a4770700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f769c09f0f0 0x7f769c138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:54.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.043+0000 7f76a4770700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f769c09e400 0x7f769c13b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:54.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.043+0000 7f76a4770700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f769c09f940 con 0x7f769c09d920 2023-09-30T22:27:54.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.043+0000 7f76a4770700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f769c06b4c0 con 0x7f769c09f0f0 2023-09-30T22:27:54.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.043+0000 7f76a4770700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f769c09a8f0 con 0x7f769c09e400 2023-09-30T22:27:54.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.043+0000 7f76a1d0b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f769c09f0f0 0x7f769c138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:54.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.043+0000 7f76a1d0b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f769c09f0f0 0x7f769c138ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40970/0 (socket says 172.21.15.40:40970) 2023-09-30T22:27:54.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.043+0000 7f76a2d0d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f769c09e400 0x7f769c13b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:54.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.043+0000 7f76a1d0b700 1 -- 172.21.15.40:0/1472382548 learned_addr learned my addr 172.21.15.40:0/1472382548 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:54.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.043+0000 7f76a2d0d700 1 -- 172.21.15.40:0/1472382548 >> v2:172.21.15.40:3300/0 conn(0x7f769c09f0f0 msgr2=0x7f769c138ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:54.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.043+0000 7f76a2d0d700 1 --2- 172.21.15.40:0/1472382548 >> v2:172.21.15.40:3300/0 conn(0x7f769c09f0f0 0x7f769c138ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:54.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.043+0000 7f76a2d0d700 1 -- 172.21.15.40:0/1472382548 >> v1:172.21.15.40:6789/0 conn(0x7f769c09d920 legacy=0x7f769c09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:54.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.043+0000 7f76a2d0d700 1 -- 172.21.15.40:0/1472382548 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f769c09f6e0 con 0x7f769c09e400 2023-09-30T22:27:54.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.043+0000 7f76a2d0d700 1 --2- 172.21.15.40:0/1472382548 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f769c09e400 0x7f769c13b430 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7694009dc0 tx=0x7f769400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4898f879439a0a3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:54.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.044+0000 7f76a150a700 1 -- 172.21.15.40:0/1472382548 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769400e070 con 0x7f769c09e400 2023-09-30T22:27:54.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.044+0000 7f76a150a700 1 -- 172.21.15.40:0/1472382548 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769400bae0 con 0x7f769c09e400 2023-09-30T22:27:54.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.044+0000 7f76a150a700 1 -- 172.21.15.40:0/1472382548 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769400be90 con 0x7f769c09e400 2023-09-30T22:27:54.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.044+0000 7f76a4770700 1 -- 172.21.15.40:0/1472382548 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f769c09e400 msgr2=0x7f769c13b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:54.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.044+0000 7f76a4770700 1 --2- 172.21.15.40:0/1472382548 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f769c09e400 0x7f769c13b430 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7694009dc0 tx=0x7f769400b330 comp rx=0 tx=0).stop 2023-09-30T22:27:54.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.045+0000 7f76a4770700 1 -- 172.21.15.40:0/1472382548 shutdown_connections 2023-09-30T22:27:54.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.045+0000 7f76a4770700 1 --2- 172.21.15.40:0/1472382548 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f769c09e400 0x7f769c13b430 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:54.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.045+0000 7f76a4770700 1 --2- 172.21.15.40:0/1472382548 >> v2:172.21.15.40:3300/0 conn(0x7f769c09f0f0 0x7f769c138ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:54.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.045+0000 7f76a4770700 1 -- 172.21.15.40:0/1472382548 >> 172.21.15.40:0/1472382548 conn(0x7f769c09fb20 msgr2=0x7f769c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:54.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.045+0000 7f76a4770700 1 -- 172.21.15.40:0/1472382548 shutdown_connections 2023-09-30T22:27:54.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.045+0000 7f76a4770700 1 -- 172.21.15.40:0/1472382548 wait complete. 2023-09-30T22:27:54.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.046+0000 7f76a4770700 1 Processor -- start 2023-09-30T22:27:54.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.046+0000 7f76a4770700 1 -- start start 2023-09-30T22:27:54.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.046+0000 7f76a4770700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f769c09d920 0x7f769c11e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:54.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.046+0000 7f76a4770700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f769c09e400 0x7f769c11eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:54.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.046+0000 7f76a4770700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f769c11f400 0x7f769c1c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:54.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.046+0000 7f76a4770700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769c11f830 con 0x7f769c09e400 2023-09-30T22:27:54.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.046+0000 7f76a4770700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f769c121670 con 0x7f769c09d920 2023-09-30T22:27:54.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.046+0000 7f76a4770700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f769c09c9e0 con 0x7f769c11f400 2023-09-30T22:27:54.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.046+0000 7f76a250c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f769c09d920 0x7f769c11e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:54.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.046+0000 7f76a250c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f769c09d920 0x7f769c11e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39502/0 (socket says 172.21.15.40:39502) 2023-09-30T22:27:54.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.046+0000 7f76a250c700 1 -- 172.21.15.40:0/2824471904 learned_addr learned my addr 172.21.15.40:0/2824471904 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:54.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.046+0000 7f76a1d0b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f769c09e400 0x7f769c11eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:54.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.046+0000 7f76a2d0d700 1 --2- 172.21.15.40:0/2824471904 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f769c11f400 0x7f769c1c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:54.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.046+0000 7f76a1d0b700 1 -- 172.21.15.40:0/2824471904 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f769c11f400 msgr2=0x7f769c1c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:54.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.046+0000 7f76a1d0b700 1 --2- 172.21.15.40:0/2824471904 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f769c11f400 0x7f769c1c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:54.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.047+0000 7f76a1d0b700 1 -- 172.21.15.40:0/2824471904 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f769c09d920 msgr2=0x7f769c11e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:54.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.047+0000 7f76a1d0b700 1 --2- 172.21.15.40:0/2824471904 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f769c09d920 0x7f769c11e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:54.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.047+0000 7f76a1d0b700 1 -- 172.21.15.40:0/2824471904 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7694009a70 con 0x7f769c09e400 2023-09-30T22:27:54.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.047+0000 7f76a1d0b700 1 --2- 172.21.15.40:0/2824471904 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f769c09e400 0x7f769c11eec0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f768c00e8e0 tx=0x7f768c00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:54.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.047+0000 7f7692ffd700 1 -- 172.21.15.40:0/2824471904 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c013680 con 0x7f769c09e400 2023-09-30T22:27:54.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.047+0000 7f7692ffd700 1 -- 172.21.15.40:0/2824471904 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f768c0137e0 con 0x7f769c09e400 2023-09-30T22:27:54.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.047+0000 7f7692ffd700 1 -- 172.21.15.40:0/2824471904 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c013b70 con 0x7f769c09e400 2023-09-30T22:27:54.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.047+0000 7f76a4770700 1 -- 172.21.15.40:0/2824471904 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f769c120c80 con 0x7f769c09e400 2023-09-30T22:27:54.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.047+0000 7f76a4770700 1 -- 172.21.15.40:0/2824471904 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f769c121ac0 con 0x7f769c09e400 2023-09-30T22:27:54.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.048+0000 7f7692ffd700 1 -- 172.21.15.40:0/2824471904 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f768c013cd0 con 0x7f769c09e400 2023-09-30T22:27:54.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.048+0000 7f7692ffd700 1 -- 172.21.15.40:0/2824471904 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f768c03f640 con 0x7f769c09e400 2023-09-30T22:27:54.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.051+0000 7f76a4770700 1 -- 172.21.15.40:0/2824471904 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f769c062380 con 0x7f769c09e400 2023-09-30T22:27:54.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.055+0000 7f7692ffd700 1 -- 172.21.15.40:0/2824471904 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f768c017080 con 0x7f769c09e400 2023-09-30T22:27:54.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.136+0000 7fa6d75ec700 1 -- 172.21.15.40:0/2368277808 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa6d0074330 con 0x7fa6d0133e00 2023-09-30T22:27:54.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.136+0000 7fa6c5ffb700 1 -- 172.21.15.40:0/2368277808 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa6c802a030 con 0x7fa6d0133e00 2023-09-30T22:27:54.137 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:54.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.139+0000 7fa6d75ec700 1 -- 172.21.15.40:0/2368277808 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6d0133e00 msgr2=0x7fa6d011c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:54.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.139+0000 7fa6d75ec700 1 --2- 172.21.15.40:0/2368277808 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6d0133e00 0x7fa6d011c810 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800ef90 tx=0x7fa6c800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:27:54.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.140+0000 7fa6d75ec700 1 -- 172.21.15.40:0/2368277808 shutdown_connections 2023-09-30T22:27:54.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.140+0000 7fa6d75ec700 1 --2- 172.21.15.40:0/2368277808 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa6d009d400 0x7fa6d011bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:54.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.140+0000 7fa6d75ec700 1 --2- 172.21.15.40:0/2368277808 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6d0133e00 0x7fa6d011c810 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:54.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.140+0000 7fa6d75ec700 1 --2- 172.21.15.40:0/2368277808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6d009df40 0x7fa6d011c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:54.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.140+0000 7fa6d75ec700 1 -- 172.21.15.40:0/2368277808 >> 172.21.15.40:0/2368277808 conn(0x7fa6d00a2a00 msgr2=0x7fa6d0131840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:54.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.140+0000 7fa6d75ec700 1 -- 172.21.15.40:0/2368277808 shutdown_connections 2023-09-30T22:27:54.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.140+0000 7fa6d75ec700 1 -- 172.21.15.40:0/2368277808 wait complete. 2023-09-30T22:27:54.157 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:54.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.223+0000 7f48bd022700 1 -- 172.21.15.40:0/3998737067 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f48b8062380 con 0x7f48b809d920 2023-09-30T22:27:54.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.223+0000 7f489f7fe700 1 -- 172.21.15.40:0/3998737067 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f48a8020070 con 0x7f48b809d920 2023-09-30T22:27:54.224 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:54.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.225+0000 7f48bd022700 1 -- 172.21.15.40:0/3998737067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48b809d920 msgr2=0x7f48b8135980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:54.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.225+0000 7f48bd022700 1 --2- 172.21.15.40:0/3998737067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48b809d920 0x7f48b8135980 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f48a800e870 tx=0x7f48a800eb80 comp rx=0 tx=0).stop 2023-09-30T22:27:54.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.225+0000 7f48bd022700 1 -- 172.21.15.40:0/3998737067 shutdown_connections 2023-09-30T22:27:54.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.225+0000 7f48bd022700 1 --2- 172.21.15.40:0/3998737067 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48b8130de0 0x7f48b8136400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:54.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.225+0000 7f48bd022700 1 --2- 172.21.15.40:0/3998737067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48b809d920 0x7f48b8135980 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:54.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.225+0000 7f48bd022700 1 --2- 172.21.15.40:0/3998737067 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f48b809e230 0x7f48b8135ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:54.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.225+0000 7f48bd022700 1 -- 172.21.15.40:0/3998737067 >> 172.21.15.40:0/3998737067 conn(0x7f48b809fb20 msgr2=0x7f48b80718f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:54.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.225+0000 7f48bd022700 1 -- 172.21.15.40:0/3998737067 shutdown_connections 2023-09-30T22:27:54.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.225+0000 7f48bd022700 1 -- 172.21.15.40:0/3998737067 wait complete. 2023-09-30T22:27:54.238 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:54.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.250+0000 7f76a4770700 1 -- 172.21.15.40:0/2824471904 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f769c121cb0 con 0x7f769c09e400 2023-09-30T22:27:54.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.251+0000 7f7692ffd700 1 -- 172.21.15.40:0/2824471904 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f768c021020 con 0x7f769c09e400 2023-09-30T22:27:54.252 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:54.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.253+0000 7f76a4770700 1 -- 172.21.15.40:0/2824471904 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f769c09e400 msgr2=0x7f769c11eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:54.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.253+0000 7f76a4770700 1 --2- 172.21.15.40:0/2824471904 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f769c09e400 0x7f769c11eec0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f768c00e8e0 tx=0x7f768c00ebf0 comp rx=0 tx=0).stop 2023-09-30T22:27:54.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.253+0000 7f76a4770700 1 -- 172.21.15.40:0/2824471904 shutdown_connections 2023-09-30T22:27:54.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.253+0000 7f76a4770700 1 --2- 172.21.15.40:0/2824471904 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f769c11f400 0x7f769c1c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:54.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.253+0000 7f76a4770700 1 --2- 172.21.15.40:0/2824471904 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f769c09d920 0x7f769c11e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:54.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.253+0000 7f76a4770700 1 --2- 172.21.15.40:0/2824471904 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f769c09e400 0x7f769c11eec0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:54.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.253+0000 7f76a4770700 1 -- 172.21.15.40:0/2824471904 >> 172.21.15.40:0/2824471904 conn(0x7f769c09fb20 msgr2=0x7f769c0a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:54.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.253+0000 7f76a4770700 1 -- 172.21.15.40:0/2824471904 shutdown_connections 2023-09-30T22:27:54.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:54.253+0000 7f76a4770700 1 -- 172.21.15.40:0/2824471904 wait complete. 2023-09-30T22:27:54.266 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:54.932 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:55.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.067+0000 7f640dec6700 1 Processor -- start 2023-09-30T22:27:55.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.067+0000 7f640dec6700 1 -- start start 2023-09-30T22:27:55.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.068+0000 7f640dec6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f640806f070 0x7f640806f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.068+0000 7f640dec6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f640806f980 0x7f6408097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.068+0000 7f640dec6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6408070830 con 0x7f640806fdb0 2023-09-30T22:27:55.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.068+0000 7f640dec6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6408071af0 con 0x7f640806f980 2023-09-30T22:27:55.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.068+0000 7f640dec6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6408070ad0 con 0x7f640806f070 2023-09-30T22:27:55.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.068+0000 7f63feffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f640806f980 0x7f6408097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.068+0000 7f64077fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f640806f070 0x7f640806f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.068+0000 7f63feffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f640806f980 0x7f6408097090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40984/0 (socket says 172.21.15.40:40984) 2023-09-30T22:27:55.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.068+0000 7f63feffd700 1 -- 172.21.15.40:0/2933390893 learned_addr learned my addr 172.21.15.40:0/2933390893 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:55.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.068+0000 7f64077fe700 1 --2- 172.21.15.40:0/2933390893 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f640806f070 0x7f640806f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:45550/0 (socket says 172.21.15.40:45550) 2023-09-30T22:27:55.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.068+0000 7f64077fe700 1 -- 172.21.15.40:0/2933390893 >> v2:172.21.15.40:3300/0 conn(0x7f640806f980 msgr2=0x7f6408097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:55.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.068+0000 7f64077fe700 1 --2- 172.21.15.40:0/2933390893 >> v2:172.21.15.40:3300/0 conn(0x7f640806f980 0x7f6408097090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.068+0000 7f64077fe700 1 -- 172.21.15.40:0/2933390893 >> v1:172.21.15.40:6789/0 conn(0x7f640806fdb0 legacy=0x7f64080975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.068+0000 7f64077fe700 1 -- 172.21.15.40:0/2933390893 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6408070de0 con 0x7f640806f070 2023-09-30T22:27:55.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.068+0000 7f63feffd700 1 --2- 172.21.15.40:0/2933390893 >> v2:172.21.15.40:3300/0 conn(0x7f640806f980 0x7f6408097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:55.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.068+0000 7f64077fe700 1 --2- 172.21.15.40:0/2933390893 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f640806f070 0x7f640806f440 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f63f80098a0 tx=0x7f63f8009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c7cc3c2143d7c99 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:55.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.069+0000 7f6406ffd700 1 -- 172.21.15.40:0/2933390893 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f8011830 con 0x7f640806f070 2023-09-30T22:27:55.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.069+0000 7f6406ffd700 1 -- 172.21.15.40:0/2933390893 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f8011990 con 0x7f640806f070 2023-09-30T22:27:55.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.069+0000 7f6406ffd700 1 -- 172.21.15.40:0/2933390893 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f8011d20 con 0x7f640806f070 2023-09-30T22:27:55.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.069+0000 7f640dec6700 1 -- 172.21.15.40:0/2933390893 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f640806f070 msgr2=0x7f640806f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.069+0000 7f640dec6700 1 --2- 172.21.15.40:0/2933390893 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f640806f070 0x7f640806f440 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f63f80098a0 tx=0x7f63f8009bb0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.069+0000 7f640dec6700 1 -- 172.21.15.40:0/2933390893 shutdown_connections 2023-09-30T22:27:55.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.069+0000 7f640dec6700 1 --2- 172.21.15.40:0/2933390893 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f640806f070 0x7f640806f440 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.069+0000 7f640dec6700 1 --2- 172.21.15.40:0/2933390893 >> v2:172.21.15.40:3300/0 conn(0x7f640806f980 0x7f6408097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.069+0000 7f640dec6700 1 -- 172.21.15.40:0/2933390893 >> 172.21.15.40:0/2933390893 conn(0x7f64080a41a0 msgr2=0x7f64080a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:55.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.069+0000 7f640dec6700 1 -- 172.21.15.40:0/2933390893 shutdown_connections 2023-09-30T22:27:55.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.069+0000 7f640dec6700 1 -- 172.21.15.40:0/2933390893 wait complete. 2023-09-30T22:27:55.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.070+0000 7f640dec6700 1 Processor -- start 2023-09-30T22:27:55.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.071+0000 7f640dec6700 1 -- start start 2023-09-30T22:27:55.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.071+0000 7f640dec6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f640806f070 0x7f640812d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.071+0000 7f640dec6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f640806f980 0x7f640812d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.071+0000 7f640dec6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f640806fdb0 0x7f640812dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.071+0000 7f640dec6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6408132370 con 0x7f640806fdb0 2023-09-30T22:27:55.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.071+0000 7f640dec6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6408132110 con 0x7f640806f070 2023-09-30T22:27:55.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.071+0000 7f640dec6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f640812c2d0 con 0x7f640806f980 2023-09-30T22:27:55.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.071+0000 7f64077fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f640806f070 0x7f640812d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.071+0000 7f63feffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f640806f980 0x7f640812d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.071+0000 7f64077fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f640806f070 0x7f640812d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39506/0 (socket says 172.21.15.40:39506) 2023-09-30T22:27:55.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.071+0000 7f63feffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f640806f980 0x7f640812d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:45552/0 (socket says 172.21.15.40:45552) 2023-09-30T22:27:55.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.071+0000 7f64077fe700 1 -- 172.21.15.40:0/2782299811 learned_addr learned my addr 172.21.15.40:0/2782299811 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:55.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.071+0000 7f6407fff700 1 --2- 172.21.15.40:0/2782299811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f640806fdb0 0x7f640812dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.072+0000 7f63feffd700 1 -- 172.21.15.40:0/2782299811 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f640806f070 msgr2=0x7f640812d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.072+0000 7f63feffd700 1 --2- 172.21.15.40:0/2782299811 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f640806f070 0x7f640812d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.072+0000 7f63feffd700 1 -- 172.21.15.40:0/2782299811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f640806fdb0 msgr2=0x7f640812dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.072+0000 7f63feffd700 1 --2- 172.21.15.40:0/2782299811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f640806fdb0 0x7f640812dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.072+0000 7f63feffd700 1 -- 172.21.15.40:0/2782299811 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f0009550 con 0x7f640806f980 2023-09-30T22:27:55.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.072+0000 7f64077fe700 1 --2- 172.21.15.40:0/2782299811 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f640806f070 0x7f640812d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:55.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.072+0000 7f6407fff700 1 --2- 172.21.15.40:0/2782299811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f640806fdb0 0x7f640812dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:55.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.072+0000 7f63feffd700 1 --2- 172.21.15.40:0/2782299811 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f640806f980 0x7f640812d6a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6408067db0 tx=0x7f63f000ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:55.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.072+0000 7f6404ff9700 1 -- 172.21.15.40:0/2782299811 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f0004240 con 0x7f640806f980 2023-09-30T22:27:55.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.072+0000 7f6404ff9700 1 -- 172.21.15.40:0/2782299811 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f00043a0 con 0x7f640806f980 2023-09-30T22:27:55.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.072+0000 7f640dec6700 1 -- 172.21.15.40:0/2782299811 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63f80094a0 con 0x7f640806f980 2023-09-30T22:27:55.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.072+0000 7f6404ff9700 1 -- 172.21.15.40:0/2782299811 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f00036a0 con 0x7f640806f980 2023-09-30T22:27:55.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.072+0000 7f640dec6700 1 -- 172.21.15.40:0/2782299811 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64081315e0 con 0x7f640806f980 2023-09-30T22:27:55.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.073+0000 7f6404ff9700 1 -- 172.21.15.40:0/2782299811 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f63f0003800 con 0x7f640806f980 2023-09-30T22:27:55.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.073+0000 7f6404ff9700 1 -- 172.21.15.40:0/2782299811 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f63f003fc00 con 0x7f640806f980 2023-09-30T22:27:55.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.073+0000 7f640dec6700 1 -- 172.21.15.40:0/2782299811 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6408062380 con 0x7f640806f980 2023-09-30T22:27:55.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.078+0000 7f6404ff9700 1 -- 172.21.15.40:0/2782299811 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f63f0013470 con 0x7f640806f980 2023-09-30T22:27:55.158 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:55.239 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:55.267 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:55.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.280+0000 7f640dec6700 1 -- 172.21.15.40:0/2782299811 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6408074620 con 0x7f640806f980 2023-09-30T22:27:55.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.280+0000 7f6404ff9700 1 -- 172.21.15.40:0/2782299811 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f63f002a070 con 0x7f640806f980 2023-09-30T22:27:55.282 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:55.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.283+0000 7f640dec6700 1 -- 172.21.15.40:0/2782299811 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f640806f980 msgr2=0x7f640812d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.283+0000 7f640dec6700 1 --2- 172.21.15.40:0/2782299811 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f640806f980 0x7f640812d6a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6408067db0 tx=0x7f63f000ec80 comp rx=0 tx=0).stop 2023-09-30T22:27:55.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.283+0000 7f640dec6700 1 -- 172.21.15.40:0/2782299811 shutdown_connections 2023-09-30T22:27:55.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.283+0000 7f640dec6700 1 --2- 172.21.15.40:0/2782299811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f640806fdb0 0x7f640812dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.283+0000 7f640dec6700 1 --2- 172.21.15.40:0/2782299811 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f640806f070 0x7f640812d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.283+0000 7f640dec6700 1 --2- 172.21.15.40:0/2782299811 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f640806f980 0x7f640812d6a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.283+0000 7f640dec6700 1 -- 172.21.15.40:0/2782299811 >> 172.21.15.40:0/2782299811 conn(0x7f64080a41a0 msgr2=0x7f64080974a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:55.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.284+0000 7f640dec6700 1 -- 172.21.15.40:0/2782299811 shutdown_connections 2023-09-30T22:27:55.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.284+0000 7f640dec6700 1 -- 172.21.15.40:0/2782299811 wait complete. 2023-09-30T22:27:55.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.290+0000 7f66579b7700 1 Processor -- start 2023-09-30T22:27:55.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.290+0000 7f66579b7700 1 -- start start 2023-09-30T22:27:55.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.291+0000 7f66579b7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6650099c20 0x7f665009a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.291+0000 7f66579b7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66501391d0 0x7f665013b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.291+0000 7f66579b7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f665009a950 con 0x7f665009dca0 2023-09-30T22:27:55.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.291+0000 7f66579b7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665009e070 con 0x7f66501391d0 2023-09-30T22:27:55.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.291+0000 7f66579b7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f665009b710 con 0x7f6650099c20 2023-09-30T22:27:55.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.291+0000 7f6654f52700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6650099c20 0x7f665009a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.292+0000 7f6654f52700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6650099c20 0x7f665009a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:45556/0 (socket says 172.21.15.40:45556) 2023-09-30T22:27:55.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.292+0000 7f6654f52700 1 -- 172.21.15.40:0/2655484133 learned_addr learned my addr 172.21.15.40:0/2655484133 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:55.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.292+0000 7f6655f54700 1 --2- 172.21.15.40:0/2655484133 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66501391d0 0x7f665013b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.292+0000 7f6654f52700 1 -- 172.21.15.40:0/2655484133 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66501391d0 msgr2=0x7f665013b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:55.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.292+0000 7f6654f52700 1 --2- 172.21.15.40:0/2655484133 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66501391d0 0x7f665013b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.292+0000 7f6654f52700 1 -- 172.21.15.40:0/2655484133 >> v1:172.21.15.40:6789/0 conn(0x7f665009dca0 legacy=0x7f6650099510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.292+0000 7f6654f52700 1 -- 172.21.15.40:0/2655484133 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f665009a5b0 con 0x7f6650099c20 2023-09-30T22:27:55.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.292+0000 7f6654f52700 1 --2- 172.21.15.40:0/2655484133 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6650099c20 0x7f665009a070 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6644009920 tx=0x7f6644009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab9e544fa0ebcab5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:55.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.292+0000 7f664ffff700 1 -- 172.21.15.40:0/2655484133 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6644011830 con 0x7f6650099c20 2023-09-30T22:27:55.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.292+0000 7f664ffff700 1 -- 172.21.15.40:0/2655484133 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6644011990 con 0x7f6650099c20 2023-09-30T22:27:55.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.292+0000 7f664ffff700 1 -- 172.21.15.40:0/2655484133 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6644011d20 con 0x7f6650099c20 2023-09-30T22:27:55.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.293+0000 7f66579b7700 1 -- 172.21.15.40:0/2655484133 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6650099c20 msgr2=0x7f665009a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.293+0000 7f66579b7700 1 --2- 172.21.15.40:0/2655484133 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6650099c20 0x7f665009a070 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6644009920 tx=0x7f6644009c30 comp rx=0 tx=0).stop 2023-09-30T22:27:55.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.294+0000 7f66579b7700 1 -- 172.21.15.40:0/2655484133 shutdown_connections 2023-09-30T22:27:55.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.294+0000 7f66579b7700 1 --2- 172.21.15.40:0/2655484133 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66501391d0 0x7f665013b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.294+0000 7f66579b7700 1 --2- 172.21.15.40:0/2655484133 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6650099c20 0x7f665009a070 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.294+0000 7f66579b7700 1 -- 172.21.15.40:0/2655484133 >> 172.21.15.40:0/2655484133 conn(0x7f66500a2c70 msgr2=0x7f665009eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:55.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.294+0000 7f66579b7700 1 -- 172.21.15.40:0/2655484133 shutdown_connections 2023-09-30T22:27:55.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.294+0000 7f66579b7700 1 -- 172.21.15.40:0/2655484133 wait complete. 2023-09-30T22:27:55.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.295+0000 7f66579b7700 1 Processor -- start 2023-09-30T22:27:55.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.295+0000 7f66579b7700 1 -- start start 2023-09-30T22:27:55.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.296+0000 7f66579b7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6650099c20 0x7f66501381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.296+0000 7f66579b7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f665009dca0 0x7f6650138720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.296+0000 7f66579b7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66501391d0 0x7f6650138c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.296+0000 7f66579b7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66500a10e0 con 0x7f6650099c20 2023-09-30T22:27:55.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.296+0000 7f66579b7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665009ab90 con 0x7f66501391d0 2023-09-30T22:27:55.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.296+0000 7f66579b7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66500952e0 con 0x7f665009dca0 2023-09-30T22:27:55.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.296+0000 7f6654f52700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f665009dca0 0x7f6650138720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.296+0000 7f6654f52700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f665009dca0 0x7f6650138720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:45568/0 (socket says 172.21.15.40:45568) 2023-09-30T22:27:55.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.296+0000 7f6655753700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6650099c20 0x7f66501381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.296+0000 7f6654f52700 1 -- 172.21.15.40:0/3361206273 learned_addr learned my addr 172.21.15.40:0/3361206273 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:55.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.296+0000 7f6655f54700 1 --2- 172.21.15.40:0/3361206273 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66501391d0 0x7f6650138c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.296+0000 7f6654f52700 1 -- 172.21.15.40:0/3361206273 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66501391d0 msgr2=0x7f6650138c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.296+0000 7f6654f52700 1 --2- 172.21.15.40:0/3361206273 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66501391d0 0x7f6650138c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.296+0000 7f6654f52700 1 -- 172.21.15.40:0/3361206273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6650099c20 msgr2=0x7f66501381e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.296+0000 7f6654f52700 1 --2- 172.21.15.40:0/3361206273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6650099c20 0x7f66501381e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.296+0000 7f6654f52700 1 -- 172.21.15.40:0/3361206273 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6644009550 con 0x7f665009dca0 2023-09-30T22:27:55.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.296+0000 7f6655f54700 1 --2- 172.21.15.40:0/3361206273 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66501391d0 0x7f6650138c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:55.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.296+0000 7f6655753700 1 --2- 172.21.15.40:0/3361206273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6650099c20 0x7f66501381e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:55.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.297+0000 7f6654f52700 1 --2- 172.21.15.40:0/3361206273 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f665009dca0 0x7f6650138720 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6644000c00 tx=0x7f6644004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:55.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.297+0000 7f664dffb700 1 -- 172.21.15.40:0/3361206273 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6644004450 con 0x7f665009dca0 2023-09-30T22:27:55.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.297+0000 7f664dffb700 1 -- 172.21.15.40:0/3361206273 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664401e070 con 0x7f665009dca0 2023-09-30T22:27:55.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.297+0000 7f66579b7700 1 -- 172.21.15.40:0/3361206273 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6650094430 con 0x7f665009dca0 2023-09-30T22:27:55.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.297+0000 7f664dffb700 1 -- 172.21.15.40:0/3361206273 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66440038e0 con 0x7f665009dca0 2023-09-30T22:27:55.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.297+0000 7f66579b7700 1 -- 172.21.15.40:0/3361206273 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6650096730 con 0x7f665009dca0 2023-09-30T22:27:55.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.298+0000 7f66579b7700 1 -- 172.21.15.40:0/3361206273 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66500956b0 con 0x7f665009dca0 2023-09-30T22:27:55.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.299+0000 7f664dffb700 1 -- 172.21.15.40:0/3361206273 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6644003a40 con 0x7f665009dca0 2023-09-30T22:27:55.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.299+0000 7f664dffb700 1 -- 172.21.15.40:0/3361206273 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6644019770 con 0x7f665009dca0 2023-09-30T22:27:55.304 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:55.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.304+0000 7f664dffb700 1 -- 172.21.15.40:0/3361206273 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f664401a420 con 0x7f665009dca0 2023-09-30T22:27:55.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.376+0000 7fb080853700 1 Processor -- start 2023-09-30T22:27:55.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.376+0000 7fb080853700 1 -- start start 2023-09-30T22:27:55.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.376+0000 7fb080853700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb07c09c890 0x7fb07c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.376+0000 7fb080853700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb07c09d920 0x7fb07c09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.376+0000 7fb080853700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb07c09e2b0 0x7fb07c13ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.376+0000 7fb080853700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb07c0a29d0 con 0x7fb07c09d920 2023-09-30T22:27:55.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.376+0000 7fb080853700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c09fb40 con 0x7fb07c09c890 2023-09-30T22:27:55.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.376+0000 7fb080853700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c0a2600 con 0x7fb07c09e2b0 2023-09-30T22:27:55.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.377+0000 7fb079d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb07c09d920 0x7fb07c09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.377+0000 7fb07a59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb07c09c890 0x7fb07c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.377+0000 7fb079d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb07c09d920 0x7fb07c09dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41018/0 (socket says 172.21.15.40:41018) 2023-09-30T22:27:55.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.377+0000 7fb079d9b700 1 -- 172.21.15.40:0/3571656427 learned_addr learned my addr 172.21.15.40:0/3571656427 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:55.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.377+0000 7fb07ad9d700 1 --2- 172.21.15.40:0/3571656427 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb07c09e2b0 0x7fb07c13ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.377+0000 7fb07a59c700 1 -- 172.21.15.40:0/3571656427 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb07c09e2b0 msgr2=0x7fb07c13ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:55.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.377+0000 7fb07a59c700 1 --2- 172.21.15.40:0/3571656427 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb07c09e2b0 0x7fb07c13ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.377+0000 7fb07a59c700 1 -- 172.21.15.40:0/3571656427 >> v2:172.21.15.40:3300/0 conn(0x7fb07c09d920 msgr2=0x7fb07c09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:55.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.377+0000 7fb07a59c700 1 --2- 172.21.15.40:0/3571656427 >> v2:172.21.15.40:3300/0 conn(0x7fb07c09d920 0x7fb07c09dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.377+0000 7fb07a59c700 1 -- 172.21.15.40:0/3571656427 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07c09e750 con 0x7fb07c09c890 2023-09-30T22:27:55.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.377+0000 7fb079d9b700 1 --2- 172.21.15.40:0/3571656427 >> v2:172.21.15.40:3300/0 conn(0x7fb07c09d920 0x7fb07c09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:55.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.377+0000 7fb07a59c700 1 --2- 172.21.15.40:0/3571656427 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb07c09c890 0x7fb07c09cc60 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb06c009820 tx=0x7fb06c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d4ff1d181dbd36e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:55.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.377+0000 7fb07959a700 1 -- 172.21.15.40:0/3571656427 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c005e30 con 0x7fb07c09c890 2023-09-30T22:27:55.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.377+0000 7fb07959a700 1 -- 172.21.15.40:0/3571656427 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06c006030 con 0x7fb07c09c890 2023-09-30T22:27:55.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.377+0000 7fb07959a700 1 -- 172.21.15.40:0/3571656427 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c0063c0 con 0x7fb07c09c890 2023-09-30T22:27:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.378+0000 7fb080853700 1 -- 172.21.15.40:0/3571656427 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb07c09c890 msgr2=0x7fb07c09cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.378+0000 7fb080853700 1 --2- 172.21.15.40:0/3571656427 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb07c09c890 0x7fb07c09cc60 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb06c009820 tx=0x7fb06c009b30 comp rx=0 tx=0).stop 2023-09-30T22:27:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.378+0000 7fb080853700 1 -- 172.21.15.40:0/3571656427 shutdown_connections 2023-09-30T22:27:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.378+0000 7fb080853700 1 --2- 172.21.15.40:0/3571656427 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb07c09e2b0 0x7fb07c13ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.378+0000 7fb080853700 1 --2- 172.21.15.40:0/3571656427 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb07c09c890 0x7fb07c09cc60 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.378+0000 7fb080853700 1 --2- 172.21.15.40:0/3571656427 >> v2:172.21.15.40:3300/0 conn(0x7fb07c09d920 0x7fb07c09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.378+0000 7fb080853700 1 -- 172.21.15.40:0/3571656427 >> 172.21.15.40:0/3571656427 conn(0x7fb07c0a7080 msgr2=0x7fb07c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.378+0000 7fb080853700 1 -- 172.21.15.40:0/3571656427 shutdown_connections 2023-09-30T22:27:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.378+0000 7fb080853700 1 -- 172.21.15.40:0/3571656427 wait complete. 2023-09-30T22:27:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.379+0000 7fb080853700 1 Processor -- start 2023-09-30T22:27:55.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.379+0000 7fb080853700 1 -- start start 2023-09-30T22:27:55.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.380+0000 7fb080853700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb07c09c890 0x7fb07c12d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.380+0000 7fb080853700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb07c09d920 0x7fb07c12d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.380+0000 7fb080853700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb07c09e2b0 0x7fb07c12dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.380+0000 7fb080853700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c0a5cd0 con 0x7fb07c09c890 2023-09-30T22:27:55.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.380+0000 7fb080853700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c12fee0 con 0x7fb07c09e2b0 2023-09-30T22:27:55.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.380+0000 7fb080853700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c12fab0 con 0x7fb07c09d920 2023-09-30T22:27:55.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.380+0000 7fb07a59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb07c09c890 0x7fb07c12d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.380+0000 7fb07a59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb07c09c890 0x7fb07c12d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41030/0 (socket says 172.21.15.40:41030) 2023-09-30T22:27:55.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.380+0000 7fb07a59c700 1 -- 172.21.15.40:0/4207385063 learned_addr learned my addr 172.21.15.40:0/4207385063 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:55.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.380+0000 7fb079d9b700 1 --2- 172.21.15.40:0/4207385063 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb07c09d920 0x7fb07c12d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.380+0000 7fb07a59c700 1 -- 172.21.15.40:0/4207385063 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb07c09d920 msgr2=0x7fb07c12d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.380+0000 7fb07a59c700 1 --2- 172.21.15.40:0/4207385063 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb07c09d920 0x7fb07c12d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.380+0000 7fb07a59c700 1 -- 172.21.15.40:0/4207385063 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb07c09e2b0 msgr2=0x7fb07c12dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.380+0000 7fb07a59c700 1 --2- 172.21.15.40:0/4207385063 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb07c09e2b0 0x7fb07c12dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.380+0000 7fb07a59c700 1 -- 172.21.15.40:0/4207385063 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb070009550 con 0x7fb07c09c890 2023-09-30T22:27:55.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.380+0000 7fb079d9b700 1 --2- 172.21.15.40:0/4207385063 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb07c09d920 0x7fb07c12d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:55.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.381+0000 7fb07a59c700 1 --2- 172.21.15.40:0/4207385063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb07c09c890 0x7fb07c12d2f0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb06c009fd0 tx=0x7fb06c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:55.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.381+0000 7fb06affd700 1 -- 172.21.15.40:0/4207385063 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c0036a0 con 0x7fb07c09c890 2023-09-30T22:27:55.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.381+0000 7fb06affd700 1 -- 172.21.15.40:0/4207385063 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06c020070 con 0x7fb07c09c890 2023-09-30T22:27:55.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.381+0000 7fb080853700 1 -- 172.21.15.40:0/4207385063 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb06c009430 con 0x7fb07c09c890 2023-09-30T22:27:55.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.381+0000 7fb06affd700 1 -- 172.21.15.40:0/4207385063 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c003a40 con 0x7fb07c09c890 2023-09-30T22:27:55.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.381+0000 7fb080853700 1 -- 172.21.15.40:0/4207385063 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07c12f480 con 0x7fb07c09c890 2023-09-30T22:27:55.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.382+0000 7fb080853700 1 -- 172.21.15.40:0/4207385063 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb07c1309d0 con 0x7fb07c09c890 2023-09-30T22:27:55.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.382+0000 7fb06affd700 1 -- 172.21.15.40:0/4207385063 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb06c022030 con 0x7fb07c09c890 2023-09-30T22:27:55.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.383+0000 7fb06affd700 1 -- 172.21.15.40:0/4207385063 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb06c040f20 con 0x7fb07c09c890 2023-09-30T22:27:55.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.387+0000 7fb06affd700 1 -- 172.21.15.40:0/4207385063 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb06c01cde0 con 0x7fb07c09c890 2023-09-30T22:27:55.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.417+0000 7f130f7ad700 1 Processor -- start 2023-09-30T22:27:55.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.417+0000 7f130f7ad700 1 -- start start 2023-09-30T22:27:55.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.418+0000 7f130f7ad700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1308136bf0 0x7f1308138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.418+0000 7f130f7ad700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1308139510 0x7f130813b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.418+0000 7f130f7ad700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13080a2600 con 0x7f130809c890 2023-09-30T22:27:55.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.418+0000 7f130f7ad700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13080a29d0 con 0x7f1308139510 2023-09-30T22:27:55.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.418+0000 7f130f7ad700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f130809fb40 con 0x7f1308136bf0 2023-09-30T22:27:55.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.418+0000 7f130d549700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f130809c890 0x7f130809cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60344/0 (socket says 172.21.15.40:60344) 2023-09-30T22:27:55.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.418+0000 7f130cd48700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1308136bf0 0x7f1308138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.418+0000 7f130d549700 1 -- 172.21.15.40:0/2209735207 learned_addr learned my addr 172.21.15.40:0/2209735207 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:27:55.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.418+0000 7f130dd4a700 1 --2- 172.21.15.40:0/2209735207 >> v2:172.21.15.40:3300/0 conn(0x7f1308139510 0x7f130813b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.418+0000 7f130cd48700 1 -- 172.21.15.40:0/2209735207 >> v2:172.21.15.40:3300/0 conn(0x7f1308139510 msgr2=0x7f130813b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:55.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.418+0000 7f130cd48700 1 --2- 172.21.15.40:0/2209735207 >> v2:172.21.15.40:3300/0 conn(0x7f1308139510 0x7f130813b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.418+0000 7f130cd48700 1 -- 172.21.15.40:0/2209735207 >> v1:172.21.15.40:6789/0 conn(0x7f130809c890 legacy=0x7f130809cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.418+0000 7f130cd48700 1 -- 172.21.15.40:0/2209735207 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130809d370 con 0x7f1308136bf0 2023-09-30T22:27:55.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.418+0000 7f130dd4a700 1 --2- 172.21.15.40:0/2209735207 >> v2:172.21.15.40:3300/0 conn(0x7f1308139510 0x7f130813b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:55.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.418+0000 7f130cd48700 1 --2- 172.21.15.40:0/2209735207 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1308136bf0 0x7f1308138fd0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f12f8009840 tx=0x7f12f8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b86fc51e825405e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:55.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.419+0000 7f12fffff700 1 -- 172.21.15.40:0/2209735207 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f8011830 con 0x7f1308136bf0 2023-09-30T22:27:55.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.419+0000 7f12fffff700 1 -- 172.21.15.40:0/2209735207 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f8011990 con 0x7f1308136bf0 2023-09-30T22:27:55.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.419+0000 7f12fffff700 1 -- 172.21.15.40:0/2209735207 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f8011d20 con 0x7f1308136bf0 2023-09-30T22:27:55.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.419+0000 7f130f7ad700 1 -- 172.21.15.40:0/2209735207 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1308136bf0 msgr2=0x7f1308138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.419+0000 7f130f7ad700 1 --2- 172.21.15.40:0/2209735207 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1308136bf0 0x7f1308138fd0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f12f8009840 tx=0x7f12f8009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:55.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.419+0000 7f130f7ad700 1 -- 172.21.15.40:0/2209735207 shutdown_connections 2023-09-30T22:27:55.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.419+0000 7f130f7ad700 1 --2- 172.21.15.40:0/2209735207 >> v2:172.21.15.40:3300/0 conn(0x7f1308139510 0x7f130813b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.419+0000 7f130f7ad700 1 --2- 172.21.15.40:0/2209735207 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1308136bf0 0x7f1308138fd0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.419+0000 7f130f7ad700 1 -- 172.21.15.40:0/2209735207 >> 172.21.15.40:0/2209735207 conn(0x7f13080a7080 msgr2=0x7f13080a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:55.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.419+0000 7f130f7ad700 1 -- 172.21.15.40:0/2209735207 shutdown_connections 2023-09-30T22:27:55.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.419+0000 7f130f7ad700 1 -- 172.21.15.40:0/2209735207 wait complete. 2023-09-30T22:27:55.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.420+0000 7f130f7ad700 1 Processor -- start 2023-09-30T22:27:55.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.420+0000 7f130f7ad700 1 -- start start 2023-09-30T22:27:55.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.421+0000 7f130f7ad700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f130809c890 0x7f13081c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.421+0000 7f130f7ad700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1308136bf0 0x7f13081c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.421+0000 7f130f7ad700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1308139510 0x7f13081c9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.421+0000 7f130f7ad700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1308070dc0 con 0x7f130809c890 2023-09-30T22:27:55.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.421+0000 7f130f7ad700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13080a61a0 con 0x7f1308136bf0 2023-09-30T22:27:55.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.421+0000 7f130f7ad700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f130812bf10 con 0x7f1308139510 2023-09-30T22:27:55.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.421+0000 7f130cd48700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1308136bf0 0x7f13081c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.421+0000 7f130cd48700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1308136bf0 0x7f13081c8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39536/0 (socket says 172.21.15.40:39536) 2023-09-30T22:27:55.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.421+0000 7f130cd48700 1 -- 172.21.15.40:0/2830653021 learned_addr learned my addr 172.21.15.40:0/2830653021 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:55.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.421+0000 7f130dd4a700 1 --2- 172.21.15.40:0/2830653021 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1308139510 0x7f13081c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.421+0000 7f130d549700 1 --2- 172.21.15.40:0/2830653021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f130809c890 0x7f13081c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.421+0000 7f130dd4a700 1 -- 172.21.15.40:0/2830653021 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1308136bf0 msgr2=0x7f13081c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.421+0000 7f130dd4a700 1 --2- 172.21.15.40:0/2830653021 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1308136bf0 0x7f13081c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.421+0000 7f130dd4a700 1 -- 172.21.15.40:0/2830653021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f130809c890 msgr2=0x7f13081c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.421+0000 7f130dd4a700 1 --2- 172.21.15.40:0/2830653021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f130809c890 0x7f13081c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.421+0000 7f130dd4a700 1 -- 172.21.15.40:0/2830653021 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1300009a70 con 0x7f1308139510 2023-09-30T22:27:55.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.421+0000 7f130cd48700 1 --2- 172.21.15.40:0/2830653021 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1308136bf0 0x7f13081c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:55.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.421+0000 7f130dd4a700 1 --2- 172.21.15.40:0/2830653021 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1308139510 0x7f13081c9180 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f13080a0df0 tx=0x7f130000ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:55.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.422+0000 7f12fdffb700 1 -- 172.21.15.40:0/2830653021 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1300003a20 con 0x7f1308139510 2023-09-30T22:27:55.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.422+0000 7f12fdffb700 1 -- 172.21.15.40:0/2830653021 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130000f040 con 0x7f1308139510 2023-09-30T22:27:55.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.422+0000 7f130f7ad700 1 -- 172.21.15.40:0/2830653021 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f80094a0 con 0x7f1308139510 2023-09-30T22:27:55.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.422+0000 7f12fdffb700 1 -- 172.21.15.40:0/2830653021 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1300003dc0 con 0x7f1308139510 2023-09-30T22:27:55.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.422+0000 7f130f7ad700 1 -- 172.21.15.40:0/2830653021 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f130812c910 con 0x7f1308139510 2023-09-30T22:27:55.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.422+0000 7f12fdffb700 1 -- 172.21.15.40:0/2830653021 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f130000ca20 con 0x7f1308139510 2023-09-30T22:27:55.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.423+0000 7f12fdffb700 1 -- 172.21.15.40:0/2830653021 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f130003ffb0 con 0x7f1308139510 2023-09-30T22:27:55.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.423+0000 7f130f7ad700 1 -- 172.21.15.40:0/2830653021 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1308062380 con 0x7f1308139510 2023-09-30T22:27:55.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.428+0000 7f12fdffb700 1 -- 172.21.15.40:0/2830653021 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f130001b360 con 0x7f1308139510 2023-09-30T22:27:55.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.507+0000 7f66579b7700 1 -- 172.21.15.40:0/3361206273 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f66500954b0 con 0x7f665009dca0 2023-09-30T22:27:55.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.508+0000 7f664dffb700 1 -- 172.21.15.40:0/3361206273 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6644015070 con 0x7f665009dca0 2023-09-30T22:27:55.508 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:55.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.510+0000 7f66579b7700 1 -- 172.21.15.40:0/3361206273 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f665009dca0 msgr2=0x7f6650138720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.510+0000 7f66579b7700 1 --2- 172.21.15.40:0/3361206273 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f665009dca0 0x7f6650138720 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6644000c00 tx=0x7f6644004750 comp rx=0 tx=0).stop 2023-09-30T22:27:55.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.510+0000 7f66579b7700 1 -- 172.21.15.40:0/3361206273 shutdown_connections 2023-09-30T22:27:55.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.510+0000 7f66579b7700 1 --2- 172.21.15.40:0/3361206273 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66501391d0 0x7f6650138c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.510+0000 7f66579b7700 1 --2- 172.21.15.40:0/3361206273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6650099c20 0x7f66501381e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.510+0000 7f66579b7700 1 --2- 172.21.15.40:0/3361206273 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f665009dca0 0x7f6650138720 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.510+0000 7f66579b7700 1 -- 172.21.15.40:0/3361206273 >> 172.21.15.40:0/3361206273 conn(0x7f66500a2c70 msgr2=0x7f665009ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:55.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.510+0000 7f66579b7700 1 -- 172.21.15.40:0/3361206273 shutdown_connections 2023-09-30T22:27:55.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.510+0000 7f66579b7700 1 -- 172.21.15.40:0/3361206273 wait complete. 2023-09-30T22:27:55.523 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:55.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.585+0000 7fb080853700 1 -- 172.21.15.40:0/4207385063 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb07c062380 con 0x7fb07c09c890 2023-09-30T22:27:55.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.585+0000 7fb06affd700 1 -- 172.21.15.40:0/4207385063 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb06c01cc00 con 0x7fb07c09c890 2023-09-30T22:27:55.586 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:55.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.587+0000 7fb080853700 1 -- 172.21.15.40:0/4207385063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb07c09c890 msgr2=0x7fb07c12d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.587+0000 7fb080853700 1 --2- 172.21.15.40:0/4207385063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb07c09c890 0x7fb07c12d2f0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb06c009fd0 tx=0x7fb06c004750 comp rx=0 tx=0).stop 2023-09-30T22:27:55.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.587+0000 7fb080853700 1 -- 172.21.15.40:0/4207385063 shutdown_connections 2023-09-30T22:27:55.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.587+0000 7fb080853700 1 --2- 172.21.15.40:0/4207385063 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb07c09e2b0 0x7fb07c12dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.587+0000 7fb080853700 1 --2- 172.21.15.40:0/4207385063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb07c09c890 0x7fb07c12d2f0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.587+0000 7fb080853700 1 --2- 172.21.15.40:0/4207385063 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb07c09d920 0x7fb07c12d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.587+0000 7fb080853700 1 -- 172.21.15.40:0/4207385063 >> 172.21.15.40:0/4207385063 conn(0x7fb07c0a7080 msgr2=0x7fb07c0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:55.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.587+0000 7fb080853700 1 -- 172.21.15.40:0/4207385063 shutdown_connections 2023-09-30T22:27:55.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.587+0000 7fb080853700 1 -- 172.21.15.40:0/4207385063 wait complete. 2023-09-30T22:27:55.600 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:55.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.627+0000 7f130f7ad700 1 -- 172.21.15.40:0/2830653021 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f130809ef90 con 0x7f1308139510 2023-09-30T22:27:55.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.627+0000 7f12fdffb700 1 -- 172.21.15.40:0/2830653021 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f130001cba0 con 0x7f1308139510 2023-09-30T22:27:55.628 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:55.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.629+0000 7f130f7ad700 1 -- 172.21.15.40:0/2830653021 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1308139510 msgr2=0x7f13081c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.629+0000 7f130f7ad700 1 --2- 172.21.15.40:0/2830653021 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1308139510 0x7f13081c9180 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f13080a0df0 tx=0x7f130000ef90 comp rx=0 tx=0).stop 2023-09-30T22:27:55.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.630+0000 7f130f7ad700 1 -- 172.21.15.40:0/2830653021 shutdown_connections 2023-09-30T22:27:55.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.630+0000 7f130f7ad700 1 --2- 172.21.15.40:0/2830653021 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1308139510 0x7f13081c9180 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.630+0000 7f130f7ad700 1 --2- 172.21.15.40:0/2830653021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f130809c890 0x7f13081c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.630+0000 7f130f7ad700 1 --2- 172.21.15.40:0/2830653021 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1308136bf0 0x7f13081c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.630+0000 7f130f7ad700 1 -- 172.21.15.40:0/2830653021 >> 172.21.15.40:0/2830653021 conn(0x7f13080a7080 msgr2=0x7f1308136fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:55.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.630+0000 7f130f7ad700 1 -- 172.21.15.40:0/2830653021 shutdown_connections 2023-09-30T22:27:55.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:55.630+0000 7f130f7ad700 1 -- 172.21.15.40:0/2830653021 wait complete. 2023-09-30T22:27:55.643 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:56.305 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:56.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.445+0000 7f94afbd8700 1 Processor -- start 2023-09-30T22:27:56.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.445+0000 7f94afbd8700 1 -- start start 2023-09-30T22:27:56.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.446+0000 7f94afbd8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f94a809c890 0x7f94a809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.446+0000 7f94afbd8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f94a809e480 0x7f94a813bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.446+0000 7f94afbd8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94a80a2600 con 0x7f94a809d920 2023-09-30T22:27:56.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.446+0000 7f94afbd8700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a80a29d0 con 0x7f94a809c890 2023-09-30T22:27:56.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.446+0000 7f94afbd8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f94a809fb40 con 0x7f94a809e480 2023-09-30T22:27:56.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.446+0000 7f94ae175700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f94a809e480 0x7f94a813bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.446+0000 7f94ad974700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f94a809c890 0x7f94a809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.446+0000 7f94ad974700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f94a809c890 0x7f94a809cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41058/0 (socket says 172.21.15.40:41058) 2023-09-30T22:27:56.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.446+0000 7f94ae175700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f94a809e480 0x7f94a813bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:45604/0 (socket says 172.21.15.40:45604) 2023-09-30T22:27:56.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.446+0000 7f94ad974700 1 -- 172.21.15.40:0/712866099 learned_addr learned my addr 172.21.15.40:0/712866099 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:56.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.446+0000 7f94ad173700 1 --1- 172.21.15.40:0/712866099 >> v1:172.21.15.40:6789/0 conn(0x7f94a809d920 0x7f94a809dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60356/0 (socket says 172.21.15.40:60356) 2023-09-30T22:27:56.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.446+0000 7f94ad974700 1 -- 172.21.15.40:0/712866099 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f94a809e480 msgr2=0x7f94a813bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:56.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.446+0000 7f94ad974700 1 --2- 172.21.15.40:0/712866099 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f94a809e480 0x7f94a813bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.446+0000 7f94ad974700 1 -- 172.21.15.40:0/712866099 >> v1:172.21.15.40:6789/0 conn(0x7f94a809d920 legacy=0x7f94a809dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.446+0000 7f94ad974700 1 -- 172.21.15.40:0/712866099 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a809fed0 con 0x7f94a809c890 2023-09-30T22:27:56.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.446+0000 7f94ac972700 1 -- 172.21.15.40:0/712866099 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3593141306 0 0) 0x7f94a80a2600 con 0x7f94a809d920 2023-09-30T22:27:56.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.446+0000 7f94ae175700 1 --2- 172.21.15.40:0/712866099 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f94a809e480 0x7f94a813bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:56.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.446+0000 7f94ad974700 1 --2- 172.21.15.40:0/712866099 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94a809c890 0x7f94a809cc60 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f9498006fd0 tx=0x7f9498009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d8e0401b71c9bbc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:56.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.446+0000 7f94ac972700 1 -- 172.21.15.40:0/712866099 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9498005e30 con 0x7f94a809c890 2023-09-30T22:27:56.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.447+0000 7f94ac972700 1 -- 172.21.15.40:0/712866099 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9498004030 con 0x7f94a809c890 2023-09-30T22:27:56.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.447+0000 7f94ac972700 1 -- 172.21.15.40:0/712866099 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94980043e0 con 0x7f94a809c890 2023-09-30T22:27:56.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.447+0000 7f94afbd8700 1 -- 172.21.15.40:0/712866099 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94a809c890 msgr2=0x7f94a809cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.447+0000 7f94afbd8700 1 --2- 172.21.15.40:0/712866099 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94a809c890 0x7f94a809cc60 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f9498006fd0 tx=0x7f9498009bd0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.447+0000 7f94afbd8700 1 -- 172.21.15.40:0/712866099 shutdown_connections 2023-09-30T22:27:56.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.447+0000 7f94afbd8700 1 --2- 172.21.15.40:0/712866099 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f94a809e480 0x7f94a813bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.447+0000 7f94afbd8700 1 --2- 172.21.15.40:0/712866099 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94a809c890 0x7f94a809cc60 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.447+0000 7f94afbd8700 1 -- 172.21.15.40:0/712866099 >> 172.21.15.40:0/712866099 conn(0x7f94a80a7080 msgr2=0x7f94a80a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:56.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.447+0000 7f94afbd8700 1 -- 172.21.15.40:0/712866099 shutdown_connections 2023-09-30T22:27:56.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.447+0000 7f94afbd8700 1 -- 172.21.15.40:0/712866099 wait complete. 2023-09-30T22:27:56.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.448+0000 7f94afbd8700 1 Processor -- start 2023-09-30T22:27:56.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.448+0000 7f94afbd8700 1 -- start start 2023-09-30T22:27:56.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.449+0000 7f94afbd8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94a809c890 0x7f94a81c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.449+0000 7f94afbd8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f94a809d920 0x7f94a81c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.449+0000 7f94afbd8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94a809e480 0x7f94a812d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.449+0000 7f94afbd8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a812f7c0 con 0x7f94a809e480 2023-09-30T22:27:56.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.449+0000 7f94afbd8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a8130e00 con 0x7f94a809c890 2023-09-30T22:27:56.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.449+0000 7f94afbd8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f94a812ef20 con 0x7f94a809d920 2023-09-30T22:27:56.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.449+0000 7f94ad974700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94a809c890 0x7f94a81c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.449+0000 7f94ae175700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94a809e480 0x7f94a812d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.449+0000 7f94ad974700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94a809c890 0x7f94a81c8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39552/0 (socket says 172.21.15.40:39552) 2023-09-30T22:27:56.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.449+0000 7f94ad974700 1 -- 172.21.15.40:0/4092246583 learned_addr learned my addr 172.21.15.40:0/4092246583 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:56.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.449+0000 7f94ad173700 1 --2- 172.21.15.40:0/4092246583 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f94a809d920 0x7f94a81c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.449+0000 7f94ae175700 1 -- 172.21.15.40:0/4092246583 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f94a809d920 msgr2=0x7f94a81c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.449+0000 7f94ae175700 1 --2- 172.21.15.40:0/4092246583 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f94a809d920 0x7f94a81c9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.449+0000 7f94ae175700 1 -- 172.21.15.40:0/4092246583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94a809c890 msgr2=0x7f94a81c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.449+0000 7f94ae175700 1 --2- 172.21.15.40:0/4092246583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94a809c890 0x7f94a81c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.449+0000 7f94ae175700 1 -- 172.21.15.40:0/4092246583 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a0009a70 con 0x7f94a809e480 2023-09-30T22:27:56.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.449+0000 7f94ad974700 1 --2- 172.21.15.40:0/4092246583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94a809c890 0x7f94a81c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:56.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.449+0000 7f94ae175700 1 --2- 172.21.15.40:0/4092246583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94a809e480 0x7f94a812d370 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f94a0009e50 tx=0x7f94a000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:56.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.449+0000 7f949e7fc700 1 -- 172.21.15.40:0/4092246583 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a000cb40 con 0x7f94a809e480 2023-09-30T22:27:56.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.449+0000 7f949e7fc700 1 -- 172.21.15.40:0/4092246583 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a000f040 con 0x7f94a809e480 2023-09-30T22:27:56.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.449+0000 7f94afbd8700 1 -- 172.21.15.40:0/4092246583 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9498009500 con 0x7f94a809e480 2023-09-30T22:27:56.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.449+0000 7f949e7fc700 1 -- 172.21.15.40:0/4092246583 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a0003a20 con 0x7f94a809e480 2023-09-30T22:27:56.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.449+0000 7f94afbd8700 1 -- 172.21.15.40:0/4092246583 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a809ed40 con 0x7f94a809e480 2023-09-30T22:27:56.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.450+0000 7f949e7fc700 1 -- 172.21.15.40:0/4092246583 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f94a0014480 con 0x7f94a809e480 2023-09-30T22:27:56.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.450+0000 7f94afbd8700 1 -- 172.21.15.40:0/4092246583 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94a809de80 con 0x7f94a809e480 2023-09-30T22:27:56.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.450+0000 7f949e7fc700 1 -- 172.21.15.40:0/4092246583 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f94a003ffe0 con 0x7f94a809e480 2023-09-30T22:27:56.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.455+0000 7f949e7fc700 1 -- 172.21.15.40:0/4092246583 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f94a0012520 con 0x7f94a809e480 2023-09-30T22:27:56.524 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:56.601 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:56.644 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:56.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.660+0000 7ffa4f211700 1 Processor -- start 2023-09-30T22:27:56.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.660+0000 7ffa4f211700 1 -- start start 2023-09-30T22:27:56.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.661+0000 7ffa4f211700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffa4806a6d0 0x7ffa4806aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.661+0000 7ffa4f211700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa4806afe0 0x7ffa481318b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.661+0000 7ffa4f211700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa4809eb60 con 0x7ffa48131df0 2023-09-30T22:27:56.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.661+0000 7ffa4f211700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa4809db70 con 0x7ffa4806a6d0 2023-09-30T22:27:56.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.661+0000 7ffa4f211700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4809ddf0 con 0x7ffa4806afe0 2023-09-30T22:27:56.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.661+0000 7ffa4cfad700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffa4806a6d0 0x7ffa4806aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.661+0000 7ffa4cfad700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffa4806a6d0 0x7ffa4806aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41078/0 (socket says 172.21.15.40:41078) 2023-09-30T22:27:56.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.661+0000 7ffa4cfad700 1 -- 172.21.15.40:0/3016332112 learned_addr learned my addr 172.21.15.40:0/3016332112 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:56.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.661+0000 7ffa47fff700 1 --2- 172.21.15.40:0/3016332112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa4806afe0 0x7ffa481318b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.661+0000 7ffa4cfad700 1 -- 172.21.15.40:0/3016332112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa4806afe0 msgr2=0x7ffa481318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:56.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.661+0000 7ffa4cfad700 1 --2- 172.21.15.40:0/3016332112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa4806afe0 0x7ffa481318b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.661+0000 7ffa4cfad700 1 -- 172.21.15.40:0/3016332112 >> v1:172.21.15.40:6789/0 conn(0x7ffa48131df0 legacy=0x7ffa48138b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.661+0000 7ffa4cfad700 1 -- 172.21.15.40:0/3016332112 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa4809c9a0 con 0x7ffa4806a6d0 2023-09-30T22:27:56.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.662+0000 7ffa4cfad700 1 --2- 172.21.15.40:0/3016332112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa4806a6d0 0x7ffa4806aaa0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c006fd0 tx=0x7ffa3c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e69e36031f62e48f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:56.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.662+0000 7ffa477fe700 1 -- 172.21.15.40:0/3016332112 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c005e30 con 0x7ffa4806a6d0 2023-09-30T22:27:56.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.662+0000 7ffa477fe700 1 -- 172.21.15.40:0/3016332112 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3c004030 con 0x7ffa4806a6d0 2023-09-30T22:27:56.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.662+0000 7ffa477fe700 1 -- 172.21.15.40:0/3016332112 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c0043e0 con 0x7ffa4806a6d0 2023-09-30T22:27:56.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.662+0000 7ffa4f211700 1 -- 172.21.15.40:0/3016332112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa4806a6d0 msgr2=0x7ffa4806aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.662+0000 7ffa4f211700 1 --2- 172.21.15.40:0/3016332112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa4806a6d0 0x7ffa4806aaa0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c006fd0 tx=0x7ffa3c009bd0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.663+0000 7ffa4f211700 1 -- 172.21.15.40:0/3016332112 shutdown_connections 2023-09-30T22:27:56.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.663+0000 7ffa4f211700 1 --2- 172.21.15.40:0/3016332112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa4806a6d0 0x7ffa4806aaa0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.663+0000 7ffa4f211700 1 --2- 172.21.15.40:0/3016332112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa4806afe0 0x7ffa481318b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.663+0000 7ffa4f211700 1 -- 172.21.15.40:0/3016332112 >> 172.21.15.40:0/3016332112 conn(0x7ffa4809fb20 msgr2=0x7ffa4809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:56.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.663+0000 7ffa4f211700 1 -- 172.21.15.40:0/3016332112 shutdown_connections 2023-09-30T22:27:56.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.663+0000 7ffa4f211700 1 -- 172.21.15.40:0/3016332112 wait complete. 2023-09-30T22:27:56.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.664+0000 7ffa4f211700 1 Processor -- start 2023-09-30T22:27:56.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.664+0000 7ffa4f211700 1 -- start start 2023-09-30T22:27:56.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.664+0000 7ffa4f211700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa4806a6d0 0x7ffa4811e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.664+0000 7ffa4f211700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa4806afe0 0x7ffa4811e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.664+0000 7ffa4f211700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa48131df0 0x7ffa481c4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.664+0000 7ffa4f211700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa48120210 con 0x7ffa48131df0 2023-09-30T22:27:56.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.664+0000 7ffa4f211700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa481304a0 con 0x7ffa4806afe0 2023-09-30T22:27:56.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.664+0000 7ffa4f211700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa480715d0 con 0x7ffa4806a6d0 2023-09-30T22:27:56.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.664+0000 7ffa4d7ae700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa48131df0 0x7ffa481c4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.664+0000 7ffa4cfad700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa4806a6d0 0x7ffa4811e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.664+0000 7ffa4d7ae700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa48131df0 0x7ffa481c4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41092/0 (socket says 172.21.15.40:41092) 2023-09-30T22:27:56.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.664+0000 7ffa4d7ae700 1 -- 172.21.15.40:0/98242643 learned_addr learned my addr 172.21.15.40:0/98242643 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:56.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.665+0000 7ffa47fff700 1 --2- 172.21.15.40:0/98242643 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa4806afe0 0x7ffa4811e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.665+0000 7ffa4d7ae700 1 -- 172.21.15.40:0/98242643 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa4806a6d0 msgr2=0x7ffa4811e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.665+0000 7ffa4d7ae700 1 --2- 172.21.15.40:0/98242643 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa4806a6d0 0x7ffa4811e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.665+0000 7ffa4d7ae700 1 -- 172.21.15.40:0/98242643 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa4806afe0 msgr2=0x7ffa4811e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.665+0000 7ffa4d7ae700 1 --2- 172.21.15.40:0/98242643 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa4806afe0 0x7ffa4811e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.665+0000 7ffa4d7ae700 1 -- 172.21.15.40:0/98242643 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa3c009500 con 0x7ffa48131df0 2023-09-30T22:27:56.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.665+0000 7ffa47fff700 1 --2- 172.21.15.40:0/98242643 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa4806afe0 0x7ffa4811e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:56.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.665+0000 7ffa4cfad700 1 --2- 172.21.15.40:0/98242643 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa4806a6d0 0x7ffa4811e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:56.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.665+0000 7ffa4d7ae700 1 --2- 172.21.15.40:0/98242643 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa48131df0 0x7ffa481c4080 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7ffa4000cc50 tx=0x7ffa4000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:56.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.665+0000 7ffa457fa700 1 -- 172.21.15.40:0/98242643 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa40003c00 con 0x7ffa48131df0 2023-09-30T22:27:56.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.665+0000 7ffa457fa700 1 -- 172.21.15.40:0/98242643 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa40003d60 con 0x7ffa48131df0 2023-09-30T22:27:56.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.665+0000 7ffa4f211700 1 -- 172.21.15.40:0/98242643 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa4809e420 con 0x7ffa48131df0 2023-09-30T22:27:56.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.665+0000 7ffa457fa700 1 -- 172.21.15.40:0/98242643 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4000aab0 con 0x7ffa48131df0 2023-09-30T22:27:56.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.665+0000 7ffa4f211700 1 -- 172.21.15.40:0/98242643 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa48120e80 con 0x7ffa48131df0 2023-09-30T22:27:56.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.666+0000 7ffa457fa700 1 -- 172.21.15.40:0/98242643 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffa4000ac10 con 0x7ffa48131df0 2023-09-30T22:27:56.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.666+0000 7ffa457fa700 1 -- 172.21.15.40:0/98242643 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ffa4003f650 con 0x7ffa48131df0 2023-09-30T22:27:56.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.667+0000 7ffa4f211700 1 -- 172.21.15.40:0/98242643 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa48062380 con 0x7ffa48131df0 2023-09-30T22:27:56.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.671+0000 7ffa457fa700 1 -- 172.21.15.40:0/98242643 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa400198f0 con 0x7ffa48131df0 2023-09-30T22:27:56.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.677+0000 7f94afbd8700 1 -- 172.21.15.40:0/4092246583 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f94a809efb0 con 0x7f94a809e480 2023-09-30T22:27:56.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.677+0000 7f949e7fc700 1 -- 172.21.15.40:0/4092246583 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f94a0012340 con 0x7f94a809e480 2023-09-30T22:27:56.678 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:56.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.681+0000 7f94afbd8700 1 -- 172.21.15.40:0/4092246583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94a809e480 msgr2=0x7f94a812d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.681+0000 7f94afbd8700 1 --2- 172.21.15.40:0/4092246583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94a809e480 0x7f94a812d370 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f94a0009e50 tx=0x7f94a000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.681+0000 7f94afbd8700 1 -- 172.21.15.40:0/4092246583 shutdown_connections 2023-09-30T22:27:56.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.681+0000 7f94afbd8700 1 --2- 172.21.15.40:0/4092246583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94a809e480 0x7f94a812d370 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.681+0000 7f94afbd8700 1 --2- 172.21.15.40:0/4092246583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94a809c890 0x7f94a81c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.681+0000 7f94afbd8700 1 --2- 172.21.15.40:0/4092246583 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f94a809d920 0x7f94a81c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.681+0000 7f94afbd8700 1 -- 172.21.15.40:0/4092246583 >> 172.21.15.40:0/4092246583 conn(0x7f94a80a7080 msgr2=0x7f94a80a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:56.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.681+0000 7f94afbd8700 1 -- 172.21.15.40:0/4092246583 shutdown_connections 2023-09-30T22:27:56.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.681+0000 7f94afbd8700 1 -- 172.21.15.40:0/4092246583 wait complete. 2023-09-30T22:27:56.695 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:56.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.751+0000 7f60860a9700 1 Processor -- start 2023-09-30T22:27:56.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.751+0000 7f60860a9700 1 -- start start 2023-09-30T22:27:56.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.752+0000 7f60860a9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f608006a6d0 0x7f608006aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.752+0000 7f60860a9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f608006afe0 0x7f60801318b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.752+0000 7f60860a9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f608009eb50 con 0x7f6080131df0 2023-09-30T22:27:56.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.752+0000 7f60860a9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608009dde0 con 0x7f608006afe0 2023-09-30T22:27:56.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.752+0000 7f60860a9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f608009d4a0 con 0x7f608006a6d0 2023-09-30T22:27:56.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.752+0000 7f607f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f608006a6d0 0x7f608006aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.752+0000 7f607effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f608006afe0 0x7f60801318b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.752+0000 7f607f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f608006a6d0 0x7f608006aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:45638/0 (socket says 172.21.15.40:45638) 2023-09-30T22:27:56.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.752+0000 7f607effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f608006afe0 0x7f60801318b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39586/0 (socket says 172.21.15.40:39586) 2023-09-30T22:27:56.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.752+0000 7f607f7fe700 1 -- 172.21.15.40:0/657955899 learned_addr learned my addr 172.21.15.40:0/657955899 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:56.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.752+0000 7f607effd700 1 -- 172.21.15.40:0/657955899 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f608006a6d0 msgr2=0x7f608006aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:56.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.752+0000 7f607effd700 1 --2- 172.21.15.40:0/657955899 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f608006a6d0 0x7f608006aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.752+0000 7f607effd700 1 -- 172.21.15.40:0/657955899 >> v1:172.21.15.40:6789/0 conn(0x7f6080131df0 legacy=0x7f6080138b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.752+0000 7f607effd700 1 -- 172.21.15.40:0/657955899 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608009f5f0 con 0x7f608006afe0 2023-09-30T22:27:56.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.752+0000 7f607e7fc700 1 -- 172.21.15.40:0/657955899 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2155721635 0 0) 0x7f608009eb50 con 0x7f6080131df0 2023-09-30T22:27:56.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.752+0000 7f607f7fe700 1 --2- 172.21.15.40:0/657955899 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f608006a6d0 0x7f608006aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:56.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.753+0000 7f607effd700 1 --2- 172.21.15.40:0/657955899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f608006afe0 0x7f60801318b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6074009870 tx=0x7f6074009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fdc6f9982d472da server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:56.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.753+0000 7f607e7fc700 1 -- 172.21.15.40:0/657955899 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6074011830 con 0x7f608006afe0 2023-09-30T22:27:56.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.753+0000 7f607e7fc700 1 -- 172.21.15.40:0/657955899 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6074011990 con 0x7f608006afe0 2023-09-30T22:27:56.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.753+0000 7f607e7fc700 1 -- 172.21.15.40:0/657955899 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6074011d20 con 0x7f608006afe0 2023-09-30T22:27:56.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.754+0000 7f60860a9700 1 -- 172.21.15.40:0/657955899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f608006afe0 msgr2=0x7f60801318b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.754+0000 7f60860a9700 1 --2- 172.21.15.40:0/657955899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f608006afe0 0x7f60801318b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6074009870 tx=0x7f6074009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:56.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.754+0000 7f60860a9700 1 -- 172.21.15.40:0/657955899 shutdown_connections 2023-09-30T22:27:56.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.754+0000 7f60860a9700 1 --2- 172.21.15.40:0/657955899 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f608006a6d0 0x7f608006aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.754+0000 7f60860a9700 1 --2- 172.21.15.40:0/657955899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f608006afe0 0x7f60801318b0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.754+0000 7f60860a9700 1 -- 172.21.15.40:0/657955899 >> 172.21.15.40:0/657955899 conn(0x7f608009fb20 msgr2=0x7f608009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:56.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.754+0000 7f60860a9700 1 -- 172.21.15.40:0/657955899 shutdown_connections 2023-09-30T22:27:56.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.754+0000 7f60860a9700 1 -- 172.21.15.40:0/657955899 wait complete. 2023-09-30T22:27:56.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.755+0000 7f60860a9700 1 Processor -- start 2023-09-30T22:27:56.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.755+0000 7f60860a9700 1 -- start start 2023-09-30T22:27:56.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.756+0000 7f60860a9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f608006a6d0 0x7f608011e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.756+0000 7f60860a9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f608006afe0 0x7f608011eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.756+0000 7f60860a9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6080131df0 0x7f608011f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.756+0000 7f60860a9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60801201d0 con 0x7f608006afe0 2023-09-30T22:27:56.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.756+0000 7f60860a9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60801207f0 con 0x7f6080131df0 2023-09-30T22:27:56.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.756+0000 7f60860a9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6080131530 con 0x7f608006a6d0 2023-09-30T22:27:56.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.756+0000 7f607f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f608006a6d0 0x7f608011e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.756+0000 7f607f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f608006a6d0 0x7f608011e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:45654/0 (socket says 172.21.15.40:45654) 2023-09-30T22:27:56.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.756+0000 7f607f7fe700 1 -- 172.21.15.40:0/1694000874 learned_addr learned my addr 172.21.15.40:0/1694000874 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:56.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.756+0000 7f607effd700 1 --2- 172.21.15.40:0/1694000874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f608006afe0 0x7f608011eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.756+0000 7f607ffff700 1 --2- 172.21.15.40:0/1694000874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6080131df0 0x7f608011f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.757+0000 7f607f7fe700 1 -- 172.21.15.40:0/1694000874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6080131df0 msgr2=0x7f608011f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.757+0000 7f607f7fe700 1 --2- 172.21.15.40:0/1694000874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6080131df0 0x7f608011f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.757+0000 7f607f7fe700 1 -- 172.21.15.40:0/1694000874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f608006afe0 msgr2=0x7f608011eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.757+0000 7f607f7fe700 1 --2- 172.21.15.40:0/1694000874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f608006afe0 0x7f608011eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.757+0000 7f607f7fe700 1 -- 172.21.15.40:0/1694000874 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607000db30 con 0x7f608006a6d0 2023-09-30T22:27:56.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.757+0000 7f607effd700 1 --2- 172.21.15.40:0/1694000874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f608006afe0 0x7f608011eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:56.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.757+0000 7f607f7fe700 1 --2- 172.21.15.40:0/1694000874 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f608006a6d0 0x7f608011e5c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f607000df70 tx=0x7f60700103a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:56.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.757+0000 7f6067fff700 1 -- 172.21.15.40:0/1694000874 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6070010c70 con 0x7f608006a6d0 2023-09-30T22:27:56.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.757+0000 7f6067fff700 1 -- 172.21.15.40:0/1694000874 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6070013040 con 0x7f608006a6d0 2023-09-30T22:27:56.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.757+0000 7f60860a9700 1 -- 172.21.15.40:0/1694000874 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60740094a0 con 0x7f608006a6d0 2023-09-30T22:27:56.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.757+0000 7f6067fff700 1 -- 172.21.15.40:0/1694000874 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6070018480 con 0x7f608006a6d0 2023-09-30T22:27:56.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.757+0000 7f60860a9700 1 -- 172.21.15.40:0/1694000874 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6080071560 con 0x7f608006a6d0 2023-09-30T22:27:56.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.758+0000 7f60860a9700 1 -- 172.21.15.40:0/1694000874 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60800a3ef0 con 0x7f608006a6d0 2023-09-30T22:27:56.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.759+0000 7f6067fff700 1 -- 172.21.15.40:0/1694000874 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f60700185e0 con 0x7f608006a6d0 2023-09-30T22:27:56.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.759+0000 7f6067fff700 1 -- 172.21.15.40:0/1694000874 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6070044850 con 0x7f608006a6d0 2023-09-30T22:27:56.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.763+0000 7f6067fff700 1 -- 172.21.15.40:0/1694000874 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f60700179d0 con 0x7f608006a6d0 2023-09-30T22:27:56.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.779+0000 7fa24c39b700 1 Processor -- start 2023-09-30T22:27:56.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.779+0000 7fa24c39b700 1 -- start start 2023-09-30T22:27:56.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.779+0000 7fa24c39b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa24409c890 0x7fa24409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.779+0000 7fa24c39b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa24409e480 0x7fa24413bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.779+0000 7fa24c39b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2440a2600 con 0x7fa24409d920 2023-09-30T22:27:56.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.779+0000 7fa24c39b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2440a29d0 con 0x7fa24409e480 2023-09-30T22:27:56.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.779+0000 7fa24c39b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa24409fb40 con 0x7fa24409c890 2023-09-30T22:27:56.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.780+0000 7fa249936700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa24409d920 0x7fa24409dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60380/0 (socket says 172.21.15.40:60380) 2023-09-30T22:27:56.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.780+0000 7fa249936700 1 -- 172.21.15.40:0/1750049254 learned_addr learned my addr 172.21.15.40:0/1750049254 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:27:56.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.780+0000 7fa24a137700 1 --2- 172.21.15.40:0/1750049254 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa24409c890 0x7fa24409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.780+0000 7fa24a938700 1 --2- 172.21.15.40:0/1750049254 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa24409e480 0x7fa24413bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.780+0000 7fa24a137700 1 -- 172.21.15.40:0/1750049254 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa24409e480 msgr2=0x7fa24413bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:56.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.780+0000 7fa24a137700 1 --2- 172.21.15.40:0/1750049254 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa24409e480 0x7fa24413bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.780+0000 7fa24a137700 1 -- 172.21.15.40:0/1750049254 >> v1:172.21.15.40:6789/0 conn(0x7fa24409d920 legacy=0x7fa24409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.780+0000 7fa24a137700 1 -- 172.21.15.40:0/1750049254 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24409fed0 con 0x7fa24409c890 2023-09-30T22:27:56.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.780+0000 7fa24a938700 1 --2- 172.21.15.40:0/1750049254 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa24409e480 0x7fa24413bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:56.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.780+0000 7fa249135700 1 -- 172.21.15.40:0/1750049254 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 643977659 0 0) 0x7fa2440a2600 con 0x7fa24409d920 2023-09-30T22:27:56.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.780+0000 7fa24a137700 1 --2- 172.21.15.40:0/1750049254 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa24409c890 0x7fa24409cc60 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa240009850 tx=0x7fa240009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=358402478553f95c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:56.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.780+0000 7fa249135700 1 -- 172.21.15.40:0/1750049254 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa240005e30 con 0x7fa24409c890 2023-09-30T22:27:56.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.780+0000 7fa249135700 1 -- 172.21.15.40:0/1750049254 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa240006030 con 0x7fa24409c890 2023-09-30T22:27:56.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.780+0000 7fa249135700 1 -- 172.21.15.40:0/1750049254 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2400063e0 con 0x7fa24409c890 2023-09-30T22:27:56.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.781+0000 7fa24c39b700 1 -- 172.21.15.40:0/1750049254 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa24409c890 msgr2=0x7fa24409cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.781+0000 7fa24c39b700 1 --2- 172.21.15.40:0/1750049254 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa24409c890 0x7fa24409cc60 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa240009850 tx=0x7fa240009b60 comp rx=0 tx=0).stop 2023-09-30T22:27:56.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.781+0000 7fa24c39b700 1 -- 172.21.15.40:0/1750049254 shutdown_connections 2023-09-30T22:27:56.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.781+0000 7fa24c39b700 1 --2- 172.21.15.40:0/1750049254 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa24409e480 0x7fa24413bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.781+0000 7fa24c39b700 1 --2- 172.21.15.40:0/1750049254 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa24409c890 0x7fa24409cc60 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.781+0000 7fa24c39b700 1 -- 172.21.15.40:0/1750049254 >> 172.21.15.40:0/1750049254 conn(0x7fa2440a7080 msgr2=0x7fa2440a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:56.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.781+0000 7fa24c39b700 1 -- 172.21.15.40:0/1750049254 shutdown_connections 2023-09-30T22:27:56.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.781+0000 7fa24c39b700 1 -- 172.21.15.40:0/1750049254 wait complete. 2023-09-30T22:27:56.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.782+0000 7fa24c39b700 1 Processor -- start 2023-09-30T22:27:56.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.782+0000 7fa24c39b700 1 -- start start 2023-09-30T22:27:56.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.783+0000 7fa24c39b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa24409c890 0x7fa24412d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.783+0000 7fa24c39b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa24409d920 0x7fa24412d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.783+0000 7fa24c39b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa24409e480 0x7fa24412df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.783+0000 7fa24c39b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24409c050 con 0x7fa24409e480 2023-09-30T22:27:56.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.783+0000 7fa24c39b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24408f4f0 con 0x7fa24409c890 2023-09-30T22:27:56.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.783+0000 7fa24c39b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2441309c0 con 0x7fa24409d920 2023-09-30T22:27:56.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.783+0000 7fa24a137700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa24409c890 0x7fa24412d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.783+0000 7fa24a137700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa24409c890 0x7fa24412d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39618/0 (socket says 172.21.15.40:39618) 2023-09-30T22:27:56.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.783+0000 7fa24a137700 1 -- 172.21.15.40:0/1439334217 learned_addr learned my addr 172.21.15.40:0/1439334217 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:56.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.783+0000 7fa249936700 1 --2- 172.21.15.40:0/1439334217 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa24409d920 0x7fa24412d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.783+0000 7fa24a938700 1 --2- 172.21.15.40:0/1439334217 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa24409e480 0x7fa24412df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.783+0000 7fa249936700 1 -- 172.21.15.40:0/1439334217 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa24409c890 msgr2=0x7fa24412d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.783+0000 7fa249936700 1 --2- 172.21.15.40:0/1439334217 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa24409c890 0x7fa24412d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.783+0000 7fa249936700 1 -- 172.21.15.40:0/1439334217 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa24409e480 msgr2=0x7fa24412df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.783+0000 7fa249936700 1 --2- 172.21.15.40:0/1439334217 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa24409e480 0x7fa24412df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.783+0000 7fa249936700 1 -- 172.21.15.40:0/1439334217 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23c009a70 con 0x7fa24409d920 2023-09-30T22:27:56.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.783+0000 7fa24a938700 1 --2- 172.21.15.40:0/1439334217 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa24409e480 0x7fa24412df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:56.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.783+0000 7fa249936700 1 --2- 172.21.15.40:0/1439334217 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa24409d920 0x7fa24412d9f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa2440a0ae0 tx=0x7fa23400c750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:56.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.783+0000 7fa23affd700 1 -- 172.21.15.40:0/1439334217 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa234004c80 con 0x7fa24409d920 2023-09-30T22:27:56.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.783+0000 7fa23affd700 1 -- 172.21.15.40:0/1439334217 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa234004de0 con 0x7fa24409d920 2023-09-30T22:27:56.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.784+0000 7fa24c39b700 1 -- 172.21.15.40:0/1439334217 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa240009430 con 0x7fa24409d920 2023-09-30T22:27:56.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.784+0000 7fa23affd700 1 -- 172.21.15.40:0/1439334217 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa234007310 con 0x7fa24409d920 2023-09-30T22:27:56.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.784+0000 7fa24c39b700 1 -- 172.21.15.40:0/1439334217 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa244130ca0 con 0x7fa24409d920 2023-09-30T22:27:56.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.784+0000 7fa23affd700 1 -- 172.21.15.40:0/1439334217 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa234007470 con 0x7fa24409d920 2023-09-30T22:27:56.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.785+0000 7fa23affd700 1 -- 172.21.15.40:0/1439334217 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa23403f1c0 con 0x7fa24409d920 2023-09-30T22:27:56.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.785+0000 7fa24c39b700 1 -- 172.21.15.40:0/1439334217 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa244130b00 con 0x7fa24409d920 2023-09-30T22:27:56.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.790+0000 7fa23affd700 1 -- 172.21.15.40:0/1439334217 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa244130b00 con 0x7fa24409d920 2023-09-30T22:27:56.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.873+0000 7ffa4f211700 1 -- 172.21.15.40:0/98242643 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffa481211a0 con 0x7ffa48131df0 2023-09-30T22:27:56.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.874+0000 7ffa457fa700 1 -- 172.21.15.40:0/98242643 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffa40019300 con 0x7ffa48131df0 2023-09-30T22:27:56.874 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:56.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.875+0000 7ffa4f211700 1 -- 172.21.15.40:0/98242643 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa48131df0 msgr2=0x7ffa481c4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.875+0000 7ffa4f211700 1 --2- 172.21.15.40:0/98242643 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa48131df0 0x7ffa481c4080 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7ffa4000cc50 tx=0x7ffa4000cf60 comp rx=0 tx=0).stop 2023-09-30T22:27:56.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.876+0000 7ffa4f211700 1 -- 172.21.15.40:0/98242643 shutdown_connections 2023-09-30T22:27:56.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.876+0000 7ffa4f211700 1 --2- 172.21.15.40:0/98242643 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa4806a6d0 0x7ffa4811e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.876+0000 7ffa4f211700 1 --2- 172.21.15.40:0/98242643 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa48131df0 0x7ffa481c4080 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.876+0000 7ffa4f211700 1 --2- 172.21.15.40:0/98242643 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa4806afe0 0x7ffa4811e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.876+0000 7ffa4f211700 1 -- 172.21.15.40:0/98242643 >> 172.21.15.40:0/98242643 conn(0x7ffa4809fb20 msgr2=0x7ffa481309a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:56.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.876+0000 7ffa4f211700 1 -- 172.21.15.40:0/98242643 shutdown_connections 2023-09-30T22:27:56.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.876+0000 7ffa4f211700 1 -- 172.21.15.40:0/98242643 wait complete. 2023-09-30T22:27:56.889 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:56.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.962+0000 7f60860a9700 1 -- 172.21.15.40:0/1694000874 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6080062380 con 0x7f608006a6d0 2023-09-30T22:27:56.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.962+0000 7f6067fff700 1 -- 172.21.15.40:0/1694000874 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6070030090 con 0x7f608006a6d0 2023-09-30T22:27:56.963 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:56.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.964+0000 7f60860a9700 1 -- 172.21.15.40:0/1694000874 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f608006a6d0 msgr2=0x7f608011e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.964+0000 7f60860a9700 1 --2- 172.21.15.40:0/1694000874 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f608006a6d0 0x7f608011e5c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f607000df70 tx=0x7f60700103a0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.964+0000 7f60860a9700 1 -- 172.21.15.40:0/1694000874 shutdown_connections 2023-09-30T22:27:56.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.964+0000 7f60860a9700 1 --2- 172.21.15.40:0/1694000874 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f608006a6d0 0x7f608011e5c0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.964+0000 7f60860a9700 1 --2- 172.21.15.40:0/1694000874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6080131df0 0x7f608011f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.964+0000 7f60860a9700 1 --2- 172.21.15.40:0/1694000874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f608006afe0 0x7f608011eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.964+0000 7f60860a9700 1 -- 172.21.15.40:0/1694000874 >> 172.21.15.40:0/1694000874 conn(0x7f608009fb20 msgr2=0x7f60800a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:56.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.964+0000 7f60860a9700 1 -- 172.21.15.40:0/1694000874 shutdown_connections 2023-09-30T22:27:56.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.965+0000 7f60860a9700 1 -- 172.21.15.40:0/1694000874 wait complete. 2023-09-30T22:27:56.977 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:56.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.986+0000 7fa24c39b700 1 -- 172.21.15.40:0/1439334217 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa244130b00 con 0x7fa24409d920 2023-09-30T22:27:56.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.987+0000 7fa23affd700 1 -- 172.21.15.40:0/1439334217 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa244130b00 con 0x7fa24409d920 2023-09-30T22:27:56.988 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:56.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.989+0000 7fa24c39b700 1 -- 172.21.15.40:0/1439334217 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa24409d920 msgr2=0x7fa24412d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.989+0000 7fa24c39b700 1 --2- 172.21.15.40:0/1439334217 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa24409d920 0x7fa24412d9f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa2440a0ae0 tx=0x7fa23400c750 comp rx=0 tx=0).stop 2023-09-30T22:27:56.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.989+0000 7fa24c39b700 1 -- 172.21.15.40:0/1439334217 shutdown_connections 2023-09-30T22:27:56.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.989+0000 7fa24c39b700 1 --2- 172.21.15.40:0/1439334217 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa24409e480 0x7fa24412df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.989+0000 7fa24c39b700 1 --2- 172.21.15.40:0/1439334217 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa24409c890 0x7fa24412d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.989+0000 7fa24c39b700 1 --2- 172.21.15.40:0/1439334217 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa24409d920 0x7fa24412d9f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.989+0000 7fa24c39b700 1 -- 172.21.15.40:0/1439334217 >> 172.21.15.40:0/1439334217 conn(0x7fa2440a7080 msgr2=0x7fa2441332c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:56.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.989+0000 7fa24c39b700 1 -- 172.21.15.40:0/1439334217 shutdown_connections 2023-09-30T22:27:56.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:56.989+0000 7fa24c39b700 1 -- 172.21.15.40:0/1439334217 wait complete. 2023-09-30T22:27:57.002 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:57.696 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:57.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.837+0000 7f7d53d50700 1 Processor -- start 2023-09-30T22:27:57.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.838+0000 7f7d53d50700 1 -- start start 2023-09-30T22:27:57.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.838+0000 7f7d53d50700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7d4c09c890 0x7f7d4c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:57.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.838+0000 7f7d53d50700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7d4c09d920 0x7f7d4c09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:57.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.838+0000 7f7d53d50700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d4c0a2600 con 0x7f7d4c09e2b0 2023-09-30T22:27:57.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.838+0000 7f7d53d50700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d4c0a29d0 con 0x7f7d4c09d920 2023-09-30T22:27:57.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.838+0000 7f7d53d50700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c09fb40 con 0x7f7d4c09c890 2023-09-30T22:27:57.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.838+0000 7f7d51aec700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7d4c09c890 0x7f7d4c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:57.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.838+0000 7f7d512eb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7d4c09d920 0x7f7d4c09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:57.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.838+0000 7f7d51aec700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7d4c09c890 0x7f7d4c09cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:45690/0 (socket says 172.21.15.40:45690) 2023-09-30T22:27:57.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.838+0000 7f7d512eb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7d4c09d920 0x7f7d4c09dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41118/0 (socket says 172.21.15.40:41118) 2023-09-30T22:27:57.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.838+0000 7f7d51aec700 1 -- 172.21.15.40:0/2116429311 learned_addr learned my addr 172.21.15.40:0/2116429311 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:57.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.839+0000 7f7d51aec700 1 -- 172.21.15.40:0/2116429311 >> v2:172.21.15.40:3300/0 conn(0x7f7d4c09d920 msgr2=0x7f7d4c09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:57.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.839+0000 7f7d51aec700 1 --2- 172.21.15.40:0/2116429311 >> v2:172.21.15.40:3300/0 conn(0x7f7d4c09d920 0x7f7d4c09dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:57.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.839+0000 7f7d51aec700 1 -- 172.21.15.40:0/2116429311 >> v1:172.21.15.40:6789/0 conn(0x7f7d4c09e2b0 legacy=0x7f7d4c13ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:57.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.839+0000 7f7d51aec700 1 -- 172.21.15.40:0/2116429311 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c09e750 con 0x7f7d4c09c890 2023-09-30T22:27:57.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.839+0000 7f7d512eb700 1 --2- 172.21.15.40:0/2116429311 >> v2:172.21.15.40:3300/0 conn(0x7f7d4c09d920 0x7f7d4c09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:57.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.839+0000 7f7d51aec700 1 --2- 172.21.15.40:0/2116429311 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7d4c09c890 0x7f7d4c09cc60 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7d48006fd0 tx=0x7f7d48009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cde92801d4e1fa48 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:57.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.839+0000 7f7d50aea700 1 -- 172.21.15.40:0/2116429311 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d48005e30 con 0x7f7d4c09c890 2023-09-30T22:27:57.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.839+0000 7f7d50aea700 1 -- 172.21.15.40:0/2116429311 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d48004030 con 0x7f7d4c09c890 2023-09-30T22:27:57.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.839+0000 7f7d50aea700 1 -- 172.21.15.40:0/2116429311 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d480043e0 con 0x7f7d4c09c890 2023-09-30T22:27:57.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.839+0000 7f7d53d50700 1 -- 172.21.15.40:0/2116429311 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7d4c09c890 msgr2=0x7f7d4c09cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:57.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.839+0000 7f7d53d50700 1 --2- 172.21.15.40:0/2116429311 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7d4c09c890 0x7f7d4c09cc60 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7d48006fd0 tx=0x7f7d48009bd0 comp rx=0 tx=0).stop 2023-09-30T22:27:57.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.839+0000 7f7d53d50700 1 -- 172.21.15.40:0/2116429311 shutdown_connections 2023-09-30T22:27:57.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.839+0000 7f7d53d50700 1 --2- 172.21.15.40:0/2116429311 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7d4c09c890 0x7f7d4c09cc60 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:57.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.839+0000 7f7d53d50700 1 --2- 172.21.15.40:0/2116429311 >> v2:172.21.15.40:3300/0 conn(0x7f7d4c09d920 0x7f7d4c09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:57.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.839+0000 7f7d53d50700 1 -- 172.21.15.40:0/2116429311 >> 172.21.15.40:0/2116429311 conn(0x7f7d4c0a7080 msgr2=0x7f7d4c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:57.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.840+0000 7f7d53d50700 1 -- 172.21.15.40:0/2116429311 shutdown_connections 2023-09-30T22:27:57.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.840+0000 7f7d53d50700 1 -- 172.21.15.40:0/2116429311 wait complete. 2023-09-30T22:27:57.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.840+0000 7f7d53d50700 1 Processor -- start 2023-09-30T22:27:57.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.840+0000 7f7d53d50700 1 -- start start 2023-09-30T22:27:57.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.841+0000 7f7d53d50700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d4c09c890 0x7f7d4c1c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:57.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.841+0000 7f7d53d50700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d4c09d920 0x7f7d4c1c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:57.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.841+0000 7f7d53d50700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7d4c09e2b0 0x7f7d4c1c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:57.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.841+0000 7f7d53d50700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c12faf0 con 0x7f7d4c09c890 2023-09-30T22:27:57.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.841+0000 7f7d53d50700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c12f580 con 0x7f7d4c09d920 2023-09-30T22:27:57.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.841+0000 7f7d53d50700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c0a5d00 con 0x7f7d4c09e2b0 2023-09-30T22:27:57.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.841+0000 7f7d51aec700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d4c09c890 0x7f7d4c1c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:57.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.841+0000 7f7d51aec700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d4c09c890 0x7f7d4c1c89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41128/0 (socket says 172.21.15.40:41128) 2023-09-30T22:27:57.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.841+0000 7f7d51aec700 1 -- 172.21.15.40:0/2521900030 learned_addr learned my addr 172.21.15.40:0/2521900030 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:57.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.841+0000 7f7d512eb700 1 --2- 172.21.15.40:0/2521900030 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d4c09d920 0x7f7d4c1c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:57.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.841+0000 7f7d522ed700 1 --2- 172.21.15.40:0/2521900030 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7d4c09e2b0 0x7f7d4c1c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:57.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.841+0000 7f7d51aec700 1 -- 172.21.15.40:0/2521900030 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7d4c09e2b0 msgr2=0x7f7d4c1c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:57.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.841+0000 7f7d51aec700 1 --2- 172.21.15.40:0/2521900030 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7d4c09e2b0 0x7f7d4c1c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:57.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.841+0000 7f7d51aec700 1 -- 172.21.15.40:0/2521900030 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d4c09d920 msgr2=0x7f7d4c1c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:57.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.841+0000 7f7d51aec700 1 --2- 172.21.15.40:0/2521900030 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d4c09d920 0x7f7d4c1c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:57.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.841+0000 7f7d51aec700 1 -- 172.21.15.40:0/2521900030 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d3c0094a0 con 0x7f7d4c09c890 2023-09-30T22:27:57.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.842+0000 7f7d51aec700 1 --2- 172.21.15.40:0/2521900030 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d4c09c890 0x7f7d4c1c89e0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f7d48009c10 tx=0x7f7d48004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:57.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.842+0000 7f7d427fc700 1 -- 172.21.15.40:0/2521900030 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4801c420 con 0x7f7d4c09c890 2023-09-30T22:27:57.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.842+0000 7f7d427fc700 1 -- 172.21.15.40:0/2521900030 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4801c5a0 con 0x7f7d4c09c890 2023-09-30T22:27:57.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.842+0000 7f7d53d50700 1 -- 172.21.15.40:0/2521900030 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d48009500 con 0x7f7d4c09c890 2023-09-30T22:27:57.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.842+0000 7f7d427fc700 1 -- 172.21.15.40:0/2521900030 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4801c950 con 0x7f7d4c09c890 2023-09-30T22:27:57.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.842+0000 7f7d53d50700 1 -- 172.21.15.40:0/2521900030 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4c130d80 con 0x7f7d4c09c890 2023-09-30T22:27:57.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.842+0000 7f7d427fc700 1 -- 172.21.15.40:0/2521900030 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7d4801cab0 con 0x7f7d4c09c890 2023-09-30T22:27:57.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.843+0000 7f7d427fc700 1 -- 172.21.15.40:0/2521900030 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f7d480408b0 con 0x7f7d4c09c890 2023-09-30T22:27:57.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.843+0000 7f7d53d50700 1 -- 172.21.15.40:0/2521900030 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d4c09ecf0 con 0x7f7d4c09c890 2023-09-30T22:27:57.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:57.848+0000 7f7d427fc700 1 -- 172.21.15.40:0/2521900030 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d4c09ecf0 con 0x7f7d4c09c890 2023-09-30T22:27:57.890 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:57.978 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:58.003 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:58.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.018+0000 7f13a1cf3700 1 Processor -- start 2023-09-30T22:27:58.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.018+0000 7f13a1cf3700 1 -- start start 2023-09-30T22:27:58.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.019+0000 7f13a1cf3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f139c136bf0 0x7f139c138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:58.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.019+0000 7f13a1cf3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f139c139510 0x7f139c13b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:58.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.019+0000 7f13a1cf3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f139c0a2600 con 0x7f139c09c890 2023-09-30T22:27:58.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.019+0000 7f13a1cf3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f139c0a29d0 con 0x7f139c139510 2023-09-30T22:27:58.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.019+0000 7f13a1cf3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f139c09fb40 con 0x7f139c136bf0 2023-09-30T22:27:58.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.019+0000 7f139bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f139c139510 0x7f139c13b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:58.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.019+0000 7f139b7fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f139c09c890 0x7f139c09cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60406/0 (socket says 172.21.15.40:60406) 2023-09-30T22:27:58.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.019+0000 7f139affd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f139c136bf0 0x7f139c138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:58.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.019+0000 7f139b7fe700 1 -- 172.21.15.40:0/257379976 learned_addr learned my addr 172.21.15.40:0/257379976 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:27:58.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.019+0000 7f139a7fc700 1 -- 172.21.15.40:0/257379976 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524285113 0 0) 0x7f139c0a2600 con 0x7f139c09c890 2023-09-30T22:27:58.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.019+0000 7f139bfff700 1 -- 172.21.15.40:0/257379976 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f139c136bf0 msgr2=0x7f139c138fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:58.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.019+0000 7f139bfff700 1 --2- 172.21.15.40:0/257379976 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f139c136bf0 0x7f139c138fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.019+0000 7f139bfff700 1 -- 172.21.15.40:0/257379976 >> v1:172.21.15.40:6789/0 conn(0x7f139c09c890 legacy=0x7f139c09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:58.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.019+0000 7f139bfff700 1 -- 172.21.15.40:0/257379976 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f139c09d370 con 0x7f139c139510 2023-09-30T22:27:58.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.019+0000 7f139bfff700 1 --2- 172.21.15.40:0/257379976 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f139c139510 0x7f139c13b8f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1394009dc0 tx=0x7f139400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf7fd6e6c5ef2565 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:58.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.020+0000 7f139a7fc700 1 -- 172.21.15.40:0/257379976 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139400e070 con 0x7f139c139510 2023-09-30T22:27:58.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.020+0000 7f139a7fc700 1 -- 172.21.15.40:0/257379976 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139400bb20 con 0x7f139c139510 2023-09-30T22:27:58.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.020+0000 7f139a7fc700 1 -- 172.21.15.40:0/257379976 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1394012430 con 0x7f139c139510 2023-09-30T22:27:58.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.020+0000 7f13a1cf3700 1 -- 172.21.15.40:0/257379976 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f139c139510 msgr2=0x7f139c13b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:58.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.020+0000 7f13a1cf3700 1 --2- 172.21.15.40:0/257379976 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f139c139510 0x7f139c13b8f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1394009dc0 tx=0x7f139400b330 comp rx=0 tx=0).stop 2023-09-30T22:27:58.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.020+0000 7f13a1cf3700 1 -- 172.21.15.40:0/257379976 shutdown_connections 2023-09-30T22:27:58.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.020+0000 7f13a1cf3700 1 --2- 172.21.15.40:0/257379976 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f139c139510 0x7f139c13b8f0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.020+0000 7f13a1cf3700 1 --2- 172.21.15.40:0/257379976 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f139c136bf0 0x7f139c138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.020+0000 7f13a1cf3700 1 -- 172.21.15.40:0/257379976 >> 172.21.15.40:0/257379976 conn(0x7f139c0a7080 msgr2=0x7f139c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:58.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.020+0000 7f13a1cf3700 1 -- 172.21.15.40:0/257379976 shutdown_connections 2023-09-30T22:27:58.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.020+0000 7f13a1cf3700 1 -- 172.21.15.40:0/257379976 wait complete. 2023-09-30T22:27:58.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.021+0000 7f13a1cf3700 1 Processor -- start 2023-09-30T22:27:58.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.022+0000 7f13a1cf3700 1 -- start start 2023-09-30T22:27:58.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.022+0000 7f13a1cf3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f139c09c890 0x7f139c06ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:58.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.022+0000 7f13a1cf3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f139c136bf0 0x7f139c06f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:58.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.022+0000 7f13a1cf3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f139c139510 0x7f139c06f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:58.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.022+0000 7f13a1cf3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139c09ecf0 con 0x7f139c136bf0 2023-09-30T22:27:58.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.022+0000 7f13a1cf3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f139c12b4e0 con 0x7f139c139510 2023-09-30T22:27:58.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.022+0000 7f13a1cf3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f139c070960 con 0x7f139c09c890 2023-09-30T22:27:58.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.022+0000 7f139bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f139c139510 0x7f139c06f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:58.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.022+0000 7f139bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f139c139510 0x7f139c06f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39624/0 (socket says 172.21.15.40:39624) 2023-09-30T22:27:58.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.022+0000 7f139bfff700 1 -- 172.21.15.40:0/4013992118 learned_addr learned my addr 172.21.15.40:0/4013992118 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:58.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.022+0000 7f139affd700 1 --2- 172.21.15.40:0/4013992118 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f139c136bf0 0x7f139c06f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:58.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.022+0000 7f139b7fe700 1 --2- 172.21.15.40:0/4013992118 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f139c09c890 0x7f139c06ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:58.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.023+0000 7f139bfff700 1 -- 172.21.15.40:0/4013992118 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f139c09c890 msgr2=0x7f139c06ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:58.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.023+0000 7f139bfff700 1 --2- 172.21.15.40:0/4013992118 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f139c09c890 0x7f139c06ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.023+0000 7f139bfff700 1 -- 172.21.15.40:0/4013992118 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f139c136bf0 msgr2=0x7f139c06f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:58.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.023+0000 7f139bfff700 1 --2- 172.21.15.40:0/4013992118 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f139c136bf0 0x7f139c06f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.023+0000 7f139bfff700 1 -- 172.21.15.40:0/4013992118 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1394009a70 con 0x7f139c139510 2023-09-30T22:27:58.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.023+0000 7f139b7fe700 1 --2- 172.21.15.40:0/4013992118 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f139c09c890 0x7f139c06ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:58.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.023+0000 7f139bfff700 1 --2- 172.21.15.40:0/4013992118 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f139c139510 0x7f139c06f9d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1394013000 tx=0x7f1394004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:58.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.023+0000 7f1383fff700 1 -- 172.21.15.40:0/4013992118 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1394012430 con 0x7f139c139510 2023-09-30T22:27:58.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.023+0000 7f1383fff700 1 -- 172.21.15.40:0/4013992118 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1394020070 con 0x7f139c139510 2023-09-30T22:27:58.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.023+0000 7f13a1cf3700 1 -- 172.21.15.40:0/4013992118 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f139c12c000 con 0x7f139c139510 2023-09-30T22:27:58.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.023+0000 7f1383fff700 1 -- 172.21.15.40:0/4013992118 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1394004280 con 0x7f139c139510 2023-09-30T22:27:58.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.023+0000 7f13a1cf3700 1 -- 172.21.15.40:0/4013992118 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f139c0715d0 con 0x7f139c139510 2023-09-30T22:27:58.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.024+0000 7f1383fff700 1 -- 172.21.15.40:0/4013992118 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f13940043e0 con 0x7f139c139510 2023-09-30T22:27:58.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.024+0000 7f1383fff700 1 -- 172.21.15.40:0/4013992118 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f1394022070 con 0x7f139c139510 2023-09-30T22:27:58.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.025+0000 7f13a1cf3700 1 -- 172.21.15.40:0/4013992118 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f139c062380 con 0x7f139c139510 2023-09-30T22:27:58.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.030+0000 7f1383fff700 1 -- 172.21.15.40:0/4013992118 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1394025380 con 0x7f139c139510 2023-09-30T22:27:58.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.057+0000 7f7d53d50700 1 -- 172.21.15.40:0/2521900030 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7d4c09ecf0 con 0x7f7d4c09c890 2023-09-30T22:27:58.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.057+0000 7f7d427fc700 1 -- 172.21.15.40:0/2521900030 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7d4c09ecf0 con 0x7f7d4c09c890 2023-09-30T22:27:58.058 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:58.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.059+0000 7f7d53d50700 1 -- 172.21.15.40:0/2521900030 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d4c09c890 msgr2=0x7f7d4c1c89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:58.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.059+0000 7f7d53d50700 1 --2- 172.21.15.40:0/2521900030 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d4c09c890 0x7f7d4c1c89e0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f7d48009c10 tx=0x7f7d48004750 comp rx=0 tx=0).stop 2023-09-30T22:27:58.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.059+0000 7f7d53d50700 1 -- 172.21.15.40:0/2521900030 shutdown_connections 2023-09-30T22:27:58.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.059+0000 7f7d53d50700 1 --2- 172.21.15.40:0/2521900030 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7d4c09e2b0 0x7f7d4c1c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.059+0000 7f7d53d50700 1 --2- 172.21.15.40:0/2521900030 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d4c09c890 0x7f7d4c1c89e0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.059+0000 7f7d53d50700 1 --2- 172.21.15.40:0/2521900030 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d4c09d920 0x7f7d4c1c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.059+0000 7f7d53d50700 1 -- 172.21.15.40:0/2521900030 >> 172.21.15.40:0/2521900030 conn(0x7f7d4c0a7080 msgr2=0x7f7d4c0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:58.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.060+0000 7f7d53d50700 1 -- 172.21.15.40:0/2521900030 shutdown_connections 2023-09-30T22:27:58.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.060+0000 7f7d53d50700 1 -- 172.21.15.40:0/2521900030 wait complete. 2023-09-30T22:27:58.074 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:58.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.111+0000 7f3ae240d700 1 Processor -- start 2023-09-30T22:27:58.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.111+0000 7f3ae240d700 1 -- start start 2023-09-30T22:27:58.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.112+0000 7f3ae240d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3adc136bf0 0x7f3adc138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:58.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.112+0000 7f3ae240d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3adc139510 0x7f3adc13b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:58.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.112+0000 7f3ae240d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3adc0a2600 con 0x7f3adc09c890 2023-09-30T22:27:58.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.112+0000 7f3ae240d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc0a29d0 con 0x7f3adc136bf0 2023-09-30T22:27:58.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.112+0000 7f3ae240d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc09fb40 con 0x7f3adc139510 2023-09-30T22:27:58.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.112+0000 7f3adbfff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3adc09c890 0x7f3adc09cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60410/0 (socket says 172.21.15.40:60410) 2023-09-30T22:27:58.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.112+0000 7f3adb7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3adc136bf0 0x7f3adc138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:58.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.112+0000 7f3adbfff700 1 -- 172.21.15.40:0/469186577 learned_addr learned my addr 172.21.15.40:0/469186577 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:27:58.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.112+0000 7f3ae09aa700 1 --2- 172.21.15.40:0/469186577 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3adc139510 0x7f3adc13b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:58.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.112+0000 7f3adaffd700 1 -- 172.21.15.40:0/469186577 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3137942652 0 0) 0x7f3adc0a2600 con 0x7f3adc09c890 2023-09-30T22:27:58.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.112+0000 7f3adaffd700 1 -- 172.21.15.40:0/469186577 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ac40035b0 con 0x7f3adc09c890 2023-09-30T22:27:58.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.113+0000 7f3ae09aa700 1 -- 172.21.15.40:0/469186577 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3adc136bf0 msgr2=0x7f3adc138fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:58.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.113+0000 7f3ae09aa700 1 --2- 172.21.15.40:0/469186577 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3adc136bf0 0x7f3adc138fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.113+0000 7f3ae09aa700 1 -- 172.21.15.40:0/469186577 >> v1:172.21.15.40:6789/0 conn(0x7f3adc09c890 legacy=0x7f3adc09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:58.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.113+0000 7f3ae09aa700 1 -- 172.21.15.40:0/469186577 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3adc09d370 con 0x7f3adc139510 2023-09-30T22:27:58.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.113+0000 7f3adb7fe700 1 --2- 172.21.15.40:0/469186577 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3adc136bf0 0x7f3adc138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:58.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.113+0000 7f3ae09aa700 1 --2- 172.21.15.40:0/469186577 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3adc139510 0x7f3adc13b8f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4009dc0 tx=0x7f3ad400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aab49ff44612d4d2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:58.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.113+0000 7f3adaffd700 1 -- 172.21.15.40:0/469186577 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad400e070 con 0x7f3adc139510 2023-09-30T22:27:58.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.113+0000 7f3adaffd700 1 -- 172.21.15.40:0/469186577 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad400bac0 con 0x7f3adc139510 2023-09-30T22:27:58.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.113+0000 7f3adaffd700 1 -- 172.21.15.40:0/469186577 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad400be70 con 0x7f3adc139510 2023-09-30T22:27:58.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.114+0000 7f3ae240d700 1 -- 172.21.15.40:0/469186577 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3adc139510 msgr2=0x7f3adc13b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:58.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.114+0000 7f3ae240d700 1 --2- 172.21.15.40:0/469186577 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3adc139510 0x7f3adc13b8f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4009dc0 tx=0x7f3ad400b330 comp rx=0 tx=0).stop 2023-09-30T22:27:58.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.114+0000 7f3ae240d700 1 -- 172.21.15.40:0/469186577 shutdown_connections 2023-09-30T22:27:58.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.114+0000 7f3ae240d700 1 --2- 172.21.15.40:0/469186577 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3adc139510 0x7f3adc13b8f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.114+0000 7f3ae240d700 1 --2- 172.21.15.40:0/469186577 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3adc136bf0 0x7f3adc138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.114+0000 7f3ae240d700 1 -- 172.21.15.40:0/469186577 >> 172.21.15.40:0/469186577 conn(0x7f3adc0a7080 msgr2=0x7f3adc0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:58.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.114+0000 7f3ae240d700 1 -- 172.21.15.40:0/469186577 shutdown_connections 2023-09-30T22:27:58.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.114+0000 7f3ae240d700 1 -- 172.21.15.40:0/469186577 wait complete. 2023-09-30T22:27:58.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.115+0000 7f3ae240d700 1 Processor -- start 2023-09-30T22:27:58.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.115+0000 7f3ae240d700 1 -- start start 2023-09-30T22:27:58.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.116+0000 7f3ae240d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3adc09c890 0x7f3adc06efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:58.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.116+0000 7f3ae240d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3adc136bf0 0x7f3adc06f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:58.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.116+0000 7f3ae240d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3adc139510 0x7f3adc06fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:58.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.116+0000 7f3ae240d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc071ba0 con 0x7f3adc136bf0 2023-09-30T22:27:58.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.116+0000 7f3ae240d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc12b710 con 0x7f3adc09c890 2023-09-30T22:27:58.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.116+0000 7f3ae240d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc12ba90 con 0x7f3adc139510 2023-09-30T22:27:58.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.116+0000 7f3adbfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3adc09c890 0x7f3adc06efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:58.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.116+0000 7f3adbfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3adc09c890 0x7f3adc06efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39648/0 (socket says 172.21.15.40:39648) 2023-09-30T22:27:58.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.116+0000 7f3adbfff700 1 -- 172.21.15.40:0/225905104 learned_addr learned my addr 172.21.15.40:0/225905104 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:58.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.116+0000 7f3ae09aa700 1 --2- 172.21.15.40:0/225905104 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3adc139510 0x7f3adc06fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:58.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.116+0000 7f3adb7fe700 1 --2- 172.21.15.40:0/225905104 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3adc136bf0 0x7f3adc06f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:58.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.117+0000 7f3ae09aa700 1 -- 172.21.15.40:0/225905104 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3adc09c890 msgr2=0x7f3adc06efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:58.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.117+0000 7f3ae09aa700 1 --2- 172.21.15.40:0/225905104 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3adc09c890 0x7f3adc06efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.117+0000 7f3ae09aa700 1 -- 172.21.15.40:0/225905104 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3adc136bf0 msgr2=0x7f3adc06f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:58.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.117+0000 7f3ae09aa700 1 --2- 172.21.15.40:0/225905104 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3adc136bf0 0x7f3adc06f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.117+0000 7f3ae09aa700 1 -- 172.21.15.40:0/225905104 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad00094a0 con 0x7f3adc139510 2023-09-30T22:27:58.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.117+0000 7f3adbfff700 1 --2- 172.21.15.40:0/225905104 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3adc09c890 0x7f3adc06efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:58.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.117+0000 7f3adb7fe700 1 --2- 172.21.15.40:0/225905104 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3adc136bf0 0x7f3adc06f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:58.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.117+0000 7f3ae09aa700 1 --2- 172.21.15.40:0/225905104 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3adc139510 0x7f3adc06fa60 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4016000 tx=0x7f3ad4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:58.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.117+0000 7f3ad8ff9700 1 -- 172.21.15.40:0/225905104 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad40044d0 con 0x7f3adc139510 2023-09-30T22:27:58.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.117+0000 7f3ad8ff9700 1 -- 172.21.15.40:0/225905104 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad4020070 con 0x7f3adc139510 2023-09-30T22:27:58.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.117+0000 7f3ad8ff9700 1 -- 172.21.15.40:0/225905104 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad40048b0 con 0x7f3adc139510 2023-09-30T22:27:58.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.117+0000 7f3ae240d700 1 -- 172.21.15.40:0/225905104 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ad4009a70 con 0x7f3adc139510 2023-09-30T22:27:58.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.117+0000 7f3ae240d700 1 -- 172.21.15.40:0/225905104 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3adc12c500 con 0x7f3adc139510 2023-09-30T22:27:58.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.118+0000 7f3ad8ff9700 1 -- 172.21.15.40:0/225905104 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3ad4027480 con 0x7f3adc139510 2023-09-30T22:27:58.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.118+0000 7f3ad8ff9700 1 -- 172.21.15.40:0/225905104 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3ad4022070 con 0x7f3adc139510 2023-09-30T22:27:58.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.118+0000 7f3ae240d700 1 -- 172.21.15.40:0/225905104 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3adc062380 con 0x7f3adc139510 2023-09-30T22:27:58.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.123+0000 7f3ad8ff9700 1 -- 172.21.15.40:0/225905104 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3ad402c080 con 0x7f3adc139510 2023-09-30T22:27:58.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.159+0000 7fa506f94700 1 Processor -- start 2023-09-30T22:27:58.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.159+0000 7fa506f94700 1 -- start start 2023-09-30T22:27:58.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.160+0000 7fa506f94700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa50009d920 0x7fa50009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:58.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.160+0000 7fa506f94700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa50009f0f0 0x7fa50009e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:58.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.160+0000 7fa506f94700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa50009f940 con 0x7fa500133ca0 2023-09-30T22:27:58.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.160+0000 7fa506f94700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa50006b4c0 con 0x7fa50009d920 2023-09-30T22:27:58.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.160+0000 7fa506f94700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50009a8f0 con 0x7fa50009f0f0 2023-09-30T22:27:58.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.160+0000 7fa504d30700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa50009d920 0x7fa50009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:58.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.160+0000 7fa504d30700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa50009d920 0x7fa50009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41164/0 (socket says 172.21.15.40:41164) 2023-09-30T22:27:58.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.160+0000 7fa504d30700 1 -- 172.21.15.40:0/2132348190 learned_addr learned my addr 172.21.15.40:0/2132348190 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:58.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.160+0000 7fa4fffff700 1 --2- 172.21.15.40:0/2132348190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa50009f0f0 0x7fa50009e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:58.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.161+0000 7fa504d30700 1 -- 172.21.15.40:0/2132348190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa50009f0f0 msgr2=0x7fa50009e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:58.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.161+0000 7fa504d30700 1 --2- 172.21.15.40:0/2132348190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa50009f0f0 0x7fa50009e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.161+0000 7fa4ff7fe700 1 -- 172.21.15.40:0/2132348190 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 220252447 0 0) 0x7fa50009f940 con 0x7fa500133ca0 2023-09-30T22:27:58.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.161+0000 7fa504d30700 1 -- 172.21.15.40:0/2132348190 >> v1:172.21.15.40:6789/0 conn(0x7fa500133ca0 legacy=0x7fa500134120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:58.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.161+0000 7fa504d30700 1 -- 172.21.15.40:0/2132348190 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50009f6e0 con 0x7fa50009d920 2023-09-30T22:27:58.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.161+0000 7fa4fffff700 1 --2- 172.21.15.40:0/2132348190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa50009f0f0 0x7fa50009e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:58.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.161+0000 7fa504d30700 1 --2- 172.21.15.40:0/2132348190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa50009d920 0x7fa50009dcf0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fa4f40098f0 tx=0x7fa4f4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f2103aa24a0a4d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:58.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.161+0000 7fa4ff7fe700 1 -- 172.21.15.40:0/2132348190 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4005e30 con 0x7fa50009d920 2023-09-30T22:27:58.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.161+0000 7fa4ff7fe700 1 -- 172.21.15.40:0/2132348190 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f4004030 con 0x7fa50009d920 2023-09-30T22:27:58.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.161+0000 7fa4ff7fe700 1 -- 172.21.15.40:0/2132348190 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f40043e0 con 0x7fa50009d920 2023-09-30T22:27:58.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.162+0000 7fa506f94700 1 -- 172.21.15.40:0/2132348190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa50009d920 msgr2=0x7fa50009dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:58.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.162+0000 7fa506f94700 1 --2- 172.21.15.40:0/2132348190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa50009d920 0x7fa50009dcf0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fa4f40098f0 tx=0x7fa4f4009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:58.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.162+0000 7fa506f94700 1 -- 172.21.15.40:0/2132348190 shutdown_connections 2023-09-30T22:27:58.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.162+0000 7fa506f94700 1 --2- 172.21.15.40:0/2132348190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa50009d920 0x7fa50009dcf0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.162+0000 7fa506f94700 1 --2- 172.21.15.40:0/2132348190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa50009f0f0 0x7fa50009e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.162+0000 7fa506f94700 1 -- 172.21.15.40:0/2132348190 >> 172.21.15.40:0/2132348190 conn(0x7fa50009fb20 msgr2=0x7fa50009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:58.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.162+0000 7fa506f94700 1 -- 172.21.15.40:0/2132348190 shutdown_connections 2023-09-30T22:27:58.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.162+0000 7fa506f94700 1 -- 172.21.15.40:0/2132348190 wait complete. 2023-09-30T22:27:58.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.163+0000 7fa506f94700 1 Processor -- start 2023-09-30T22:27:58.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.163+0000 7fa506f94700 1 -- start start 2023-09-30T22:27:58.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.164+0000 7fa506f94700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa50009d920 0x7fa50011e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:58.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.164+0000 7fa506f94700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa500133ca0 0x7fa50011eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:58.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.164+0000 7fa506f94700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa50011f030 0x7fa5001ceb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:58.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.164+0000 7fa506f94700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa500122080 con 0x7fa500133ca0 2023-09-30T22:27:58.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.164+0000 7fa506f94700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa500120790 con 0x7fa50009d920 2023-09-30T22:27:58.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.164+0000 7fa506f94700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa500121810 con 0x7fa50011f030 2023-09-30T22:27:58.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.164+0000 7fa504d30700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa50009d920 0x7fa50011e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:58.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.164+0000 7fa504d30700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa50009d920 0x7fa50011e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39668/0 (socket says 172.21.15.40:39668) 2023-09-30T22:27:58.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.164+0000 7fa504d30700 1 -- 172.21.15.40:0/1412547450 learned_addr learned my addr 172.21.15.40:0/1412547450 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:58.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.164+0000 7fa505531700 1 --2- 172.21.15.40:0/1412547450 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa50011f030 0x7fa5001ceb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:58.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.165+0000 7fa4fffff700 1 --2- 172.21.15.40:0/1412547450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa500133ca0 0x7fa50011eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:58.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.165+0000 7fa504d30700 1 -- 172.21.15.40:0/1412547450 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa50011f030 msgr2=0x7fa5001ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:58.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.165+0000 7fa504d30700 1 --2- 172.21.15.40:0/1412547450 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa50011f030 0x7fa5001ceb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.165+0000 7fa504d30700 1 -- 172.21.15.40:0/1412547450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa500133ca0 msgr2=0x7fa50011eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:58.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.165+0000 7fa504d30700 1 --2- 172.21.15.40:0/1412547450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa500133ca0 0x7fa50011eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.165+0000 7fa504d30700 1 -- 172.21.15.40:0/1412547450 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ec0094a0 con 0x7fa50009d920 2023-09-30T22:27:58.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.165+0000 7fa505531700 1 --2- 172.21.15.40:0/1412547450 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa50011f030 0x7fa5001ceb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:58.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.165+0000 7fa504d30700 1 --2- 172.21.15.40:0/1412547450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa50009d920 0x7fa50011e5b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4000c00 tx=0x7fa4f4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:58.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.165+0000 7fa4fd7fa700 1 -- 172.21.15.40:0/1412547450 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f401c420 con 0x7fa50009d920 2023-09-30T22:27:58.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.165+0000 7fa4fd7fa700 1 -- 172.21.15.40:0/1412547450 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f401c5a0 con 0x7fa50009d920 2023-09-30T22:27:58.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.165+0000 7fa506f94700 1 -- 172.21.15.40:0/1412547450 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4f4009500 con 0x7fa50009d920 2023-09-30T22:27:58.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.165+0000 7fa4fd7fa700 1 -- 172.21.15.40:0/1412547450 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f401c950 con 0x7fa50009d920 2023-09-30T22:27:58.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.165+0000 7fa506f94700 1 -- 172.21.15.40:0/1412547450 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5000a2460 con 0x7fa50009d920 2023-09-30T22:27:58.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.166+0000 7fa4fd7fa700 1 -- 172.21.15.40:0/1412547450 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa4f401cab0 con 0x7fa50009d920 2023-09-30T22:27:58.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.166+0000 7fa4fd7fa700 1 -- 172.21.15.40:0/1412547450 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa4f4040750 con 0x7fa50009d920 2023-09-30T22:27:58.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.167+0000 7fa506f94700 1 -- 172.21.15.40:0/1412547450 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa50006f6f0 con 0x7fa50009d920 2023-09-30T22:27:58.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.172+0000 7fa4fd7fa700 1 -- 172.21.15.40:0/1412547450 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa4f4016080 con 0x7fa50009d920 2023-09-30T22:27:58.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.255+0000 7f13a1cf3700 1 -- 172.21.15.40:0/4013992118 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f139c074620 con 0x7f139c139510 2023-09-30T22:27:58.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.255+0000 7f1383fff700 1 -- 172.21.15.40:0/4013992118 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1394035090 con 0x7f139c139510 2023-09-30T22:27:58.256 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:58.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.258+0000 7f13a1cf3700 1 -- 172.21.15.40:0/4013992118 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f139c139510 msgr2=0x7f139c06f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:58.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.258+0000 7f13a1cf3700 1 --2- 172.21.15.40:0/4013992118 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f139c139510 0x7f139c06f9d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1394013000 tx=0x7f1394004ad0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.258+0000 7f13a1cf3700 1 -- 172.21.15.40:0/4013992118 shutdown_connections 2023-09-30T22:27:58.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.258+0000 7f13a1cf3700 1 --2- 172.21.15.40:0/4013992118 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f139c09c890 0x7f139c06ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.258+0000 7f13a1cf3700 1 --2- 172.21.15.40:0/4013992118 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f139c139510 0x7f139c06f9d0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.258+0000 7f13a1cf3700 1 --2- 172.21.15.40:0/4013992118 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f139c136bf0 0x7f139c06f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.258+0000 7f13a1cf3700 1 -- 172.21.15.40:0/4013992118 >> 172.21.15.40:0/4013992118 conn(0x7f139c0a7080 msgr2=0x7f139c1349d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:58.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.258+0000 7f13a1cf3700 1 -- 172.21.15.40:0/4013992118 shutdown_connections 2023-09-30T22:27:58.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.258+0000 7f13a1cf3700 1 -- 172.21.15.40:0/4013992118 wait complete. 2023-09-30T22:27:58.271 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:58.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.331+0000 7f3ae240d700 1 -- 172.21.15.40:0/225905104 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3adc131390 con 0x7f3adc139510 2023-09-30T22:27:58.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.332+0000 7f3ad8ff9700 1 -- 172.21.15.40:0/225905104 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3ad4011980 con 0x7f3adc139510 2023-09-30T22:27:58.332 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:58.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.334+0000 7f3ae240d700 1 -- 172.21.15.40:0/225905104 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3adc139510 msgr2=0x7f3adc06fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:58.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.334+0000 7f3ae240d700 1 --2- 172.21.15.40:0/225905104 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3adc139510 0x7f3adc06fa60 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4016000 tx=0x7f3ad4004ad0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.334+0000 7f3ae240d700 1 -- 172.21.15.40:0/225905104 shutdown_connections 2023-09-30T22:27:58.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.334+0000 7f3ae240d700 1 --2- 172.21.15.40:0/225905104 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3adc139510 0x7f3adc06fa60 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.334+0000 7f3ae240d700 1 --2- 172.21.15.40:0/225905104 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3adc09c890 0x7f3adc06efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.334+0000 7f3ae240d700 1 --2- 172.21.15.40:0/225905104 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3adc136bf0 0x7f3adc06f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.334+0000 7f3ae240d700 1 -- 172.21.15.40:0/225905104 >> 172.21.15.40:0/225905104 conn(0x7f3adc0a7080 msgr2=0x7f3adc1349d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:58.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.334+0000 7f3ae240d700 1 -- 172.21.15.40:0/225905104 shutdown_connections 2023-09-30T22:27:58.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.334+0000 7f3ae240d700 1 -- 172.21.15.40:0/225905104 wait complete. 2023-09-30T22:27:58.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:58.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.386+0000 7fa506f94700 1 -- 172.21.15.40:0/1412547450 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa500121a40 con 0x7fa50009d920 2023-09-30T22:27:58.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.386+0000 7fa4fd7fa700 1 -- 172.21.15.40:0/1412547450 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa500121a40 con 0x7fa50009d920 2023-09-30T22:27:58.387 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:58.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.388+0000 7fa506f94700 1 -- 172.21.15.40:0/1412547450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa50009d920 msgr2=0x7fa50011e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:58.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.388+0000 7fa506f94700 1 --2- 172.21.15.40:0/1412547450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa50009d920 0x7fa50011e5b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4000c00 tx=0x7fa4f4004750 comp rx=0 tx=0).stop 2023-09-30T22:27:58.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.389+0000 7fa506f94700 1 -- 172.21.15.40:0/1412547450 shutdown_connections 2023-09-30T22:27:58.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.389+0000 7fa506f94700 1 --2- 172.21.15.40:0/1412547450 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa50011f030 0x7fa5001ceb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.389+0000 7fa506f94700 1 --2- 172.21.15.40:0/1412547450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa50009d920 0x7fa50011e5b0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.389+0000 7fa506f94700 1 --2- 172.21.15.40:0/1412547450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa500133ca0 0x7fa50011eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.389+0000 7fa506f94700 1 -- 172.21.15.40:0/1412547450 >> 172.21.15.40:0/1412547450 conn(0x7fa50009fb20 msgr2=0x7fa5001331a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:58.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.389+0000 7fa506f94700 1 -- 172.21.15.40:0/1412547450 shutdown_connections 2023-09-30T22:27:58.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:58.389+0000 7fa506f94700 1 -- 172.21.15.40:0/1412547450 wait complete. 2023-09-30T22:27:58.401 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:27:59.075 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:59.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.215+0000 7fb683161700 1 Processor -- start 2023-09-30T22:27:59.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.215+0000 7fb683161700 1 -- start start 2023-09-30T22:27:59.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.216+0000 7fb683161700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb67c09d920 0x7fb67c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.216+0000 7fb683161700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb67c130fb0 0x7fb67c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.216+0000 7fb683161700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb67c09adf0 con 0x7fb67c09e230 2023-09-30T22:27:59.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.216+0000 7fb683161700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c09edf0 con 0x7fb67c130fb0 2023-09-30T22:27:59.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.216+0000 7fb683161700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c09b660 con 0x7fb67c09d920 2023-09-30T22:27:59.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.216+0000 7fb67bfff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb67c09e230 0x7fb67c1308a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60432/0 (socket says 172.21.15.40:60432) 2023-09-30T22:27:59.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.216+0000 7fb67bfff700 1 -- 172.21.15.40:0/1378638539 learned_addr learned my addr 172.21.15.40:0/1378638539 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:27:59.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.216+0000 7fb6816fe700 1 --2- 172.21.15.40:0/1378638539 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb67c130fb0 0x7fb67c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.216+0000 7fb680efd700 1 --2- 172.21.15.40:0/1378638539 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb67c09d920 0x7fb67c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.216+0000 7fb680efd700 1 -- 172.21.15.40:0/1378638539 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb67c130fb0 msgr2=0x7fb67c138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:59.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.217+0000 7fb680efd700 1 --2- 172.21.15.40:0/1378638539 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb67c130fb0 0x7fb67c138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.217+0000 7fb680efd700 1 -- 172.21.15.40:0/1378638539 >> v1:172.21.15.40:6789/0 conn(0x7fb67c09e230 legacy=0x7fb67c1308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.217+0000 7fb680efd700 1 -- 172.21.15.40:0/1378638539 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb67c09a6e0 con 0x7fb67c09d920 2023-09-30T22:27:59.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.217+0000 7fb67b7fe700 1 -- 172.21.15.40:0/1378638539 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374059084 0 0) 0x7fb67c09adf0 con 0x7fb67c09e230 2023-09-30T22:27:59.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.217+0000 7fb6816fe700 1 --2- 172.21.15.40:0/1378638539 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb67c130fb0 0x7fb67c138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:59.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.217+0000 7fb680efd700 1 --2- 172.21.15.40:0/1378638539 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb67c09d920 0x7fb67c09dcf0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb670009850 tx=0x7fb670009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10377f919652a6d8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:59.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.217+0000 7fb67b7fe700 1 -- 172.21.15.40:0/1378638539 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb670005e30 con 0x7fb67c09d920 2023-09-30T22:27:59.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.217+0000 7fb67b7fe700 1 -- 172.21.15.40:0/1378638539 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb670006030 con 0x7fb67c09d920 2023-09-30T22:27:59.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.217+0000 7fb67b7fe700 1 -- 172.21.15.40:0/1378638539 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6700063e0 con 0x7fb67c09d920 2023-09-30T22:27:59.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.217+0000 7fb683161700 1 -- 172.21.15.40:0/1378638539 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb67c09d920 msgr2=0x7fb67c09dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.217+0000 7fb683161700 1 --2- 172.21.15.40:0/1378638539 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb67c09d920 0x7fb67c09dcf0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb670009850 tx=0x7fb670009b60 comp rx=0 tx=0).stop 2023-09-30T22:27:59.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.217+0000 7fb683161700 1 -- 172.21.15.40:0/1378638539 shutdown_connections 2023-09-30T22:27:59.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.217+0000 7fb683161700 1 --2- 172.21.15.40:0/1378638539 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb67c130fb0 0x7fb67c138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.217+0000 7fb683161700 1 --2- 172.21.15.40:0/1378638539 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb67c09d920 0x7fb67c09dcf0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.217+0000 7fb683161700 1 -- 172.21.15.40:0/1378638539 >> 172.21.15.40:0/1378638539 conn(0x7fb67c09fb20 msgr2=0x7fb67c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:59.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.218+0000 7fb683161700 1 -- 172.21.15.40:0/1378638539 shutdown_connections 2023-09-30T22:27:59.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.218+0000 7fb683161700 1 -- 172.21.15.40:0/1378638539 wait complete. 2023-09-30T22:27:59.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.218+0000 7fb683161700 1 Processor -- start 2023-09-30T22:27:59.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.218+0000 7fb683161700 1 -- start start 2023-09-30T22:27:59.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.219+0000 7fb683161700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb67c09d920 0x7fb67c120290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.219+0000 7fb683161700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb67c09e230 0x7fb67c1207d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.219+0000 7fb683161700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb67c130fb0 0x7fb67c120d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.219+0000 7fb683161700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c121760 con 0x7fb67c130fb0 2023-09-30T22:27:59.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.219+0000 7fb683161700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c0a2fb0 con 0x7fb67c09d920 2023-09-30T22:27:59.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.219+0000 7fb683161700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c09cb00 con 0x7fb67c09e230 2023-09-30T22:27:59.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.219+0000 7fb67bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb67c09e230 0x7fb67c1207d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.219+0000 7fb6816fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb67c130fb0 0x7fb67c120d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.219+0000 7fb680efd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb67c09d920 0x7fb67c120290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.219+0000 7fb67bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb67c09e230 0x7fb67c1207d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:45784/0 (socket says 172.21.15.40:45784) 2023-09-30T22:27:59.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.219+0000 7fb67bfff700 1 -- 172.21.15.40:0/2496122526 learned_addr learned my addr 172.21.15.40:0/2496122526 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:59.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.220+0000 7fb67bfff700 1 -- 172.21.15.40:0/2496122526 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb67c09d920 msgr2=0x7fb67c120290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.220+0000 7fb67bfff700 1 --2- 172.21.15.40:0/2496122526 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb67c09d920 0x7fb67c120290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.220+0000 7fb67bfff700 1 -- 172.21.15.40:0/2496122526 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb67c130fb0 msgr2=0x7fb67c120d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.220+0000 7fb67bfff700 1 --2- 172.21.15.40:0/2496122526 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb67c130fb0 0x7fb67c120d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.220+0000 7fb67bfff700 1 -- 172.21.15.40:0/2496122526 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb674009a70 con 0x7fb67c09e230 2023-09-30T22:27:59.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.220+0000 7fb6816fe700 1 --2- 172.21.15.40:0/2496122526 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb67c130fb0 0x7fb67c120d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:59.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.220+0000 7fb680efd700 1 --2- 172.21.15.40:0/2496122526 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb67c09d920 0x7fb67c120290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:59.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.220+0000 7fb67bfff700 1 --2- 172.21.15.40:0/2496122526 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb67c09e230 0x7fb67c1207d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb6680018d0 tx=0x7fb668001be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:59.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.220+0000 7fb6797fa700 1 -- 172.21.15.40:0/2496122526 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb668013070 con 0x7fb67c09e230 2023-09-30T22:27:59.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.220+0000 7fb6797fa700 1 -- 172.21.15.40:0/2496122526 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb668001d00 con 0x7fb67c09e230 2023-09-30T22:27:59.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.220+0000 7fb683161700 1 -- 172.21.15.40:0/2496122526 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb670009430 con 0x7fb67c09e230 2023-09-30T22:27:59.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.220+0000 7fb6797fa700 1 -- 172.21.15.40:0/2496122526 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb668004a90 con 0x7fb67c09e230 2023-09-30T22:27:59.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.220+0000 7fb683161700 1 -- 172.21.15.40:0/2496122526 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb67c123a60 con 0x7fb67c09e230 2023-09-30T22:27:59.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.221+0000 7fb6797fa700 1 -- 172.21.15.40:0/2496122526 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb66800e320 con 0x7fb67c09e230 2023-09-30T22:27:59.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.221+0000 7fb6797fa700 1 -- 172.21.15.40:0/2496122526 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb668042de0 con 0x7fb67c09e230 2023-09-30T22:27:59.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.221+0000 7fb683161700 1 -- 172.21.15.40:0/2496122526 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb67c11cee0 con 0x7fb67c09e230 2023-09-30T22:27:59.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.226+0000 7fb6797fa700 1 -- 172.21.15.40:0/2496122526 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb668017920 con 0x7fb67c09e230 2023-09-30T22:27:59.272 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:59.347 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:59.402 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:59.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.402+0000 7fef82fd6700 1 Processor -- start 2023-09-30T22:27:59.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.402+0000 7fef82fd6700 1 -- start start 2023-09-30T22:27:59.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.403+0000 7fef82fd6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef7c09c890 0x7fef7c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.403+0000 7fef82fd6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef7c09e480 0x7fef7c13bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.403+0000 7fef82fd6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef7c0a2600 con 0x7fef7c09d920 2023-09-30T22:27:59.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.403+0000 7fef82fd6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef7c0a29d0 con 0x7fef7c09c890 2023-09-30T22:27:59.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.403+0000 7fef82fd6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c09fb40 con 0x7fef7c09e480 2023-09-30T22:27:59.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.403+0000 7fef81573700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef7c09e480 0x7fef7c13bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.403+0000 7fef80d72700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef7c09c890 0x7fef7c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.403+0000 7fef81573700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef7c09e480 0x7fef7c13bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39702/0 (socket says 172.21.15.40:39702) 2023-09-30T22:27:59.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.403+0000 7fef81573700 1 -- 172.21.15.40:0/1668642402 learned_addr learned my addr 172.21.15.40:0/1668642402 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:59.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.403+0000 7fef80d72700 1 -- 172.21.15.40:0/1668642402 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef7c09e480 msgr2=0x7fef7c13bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:59.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.403+0000 7fef80d72700 1 --2- 172.21.15.40:0/1668642402 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef7c09e480 0x7fef7c13bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.403+0000 7fef80d72700 1 -- 172.21.15.40:0/1668642402 >> v1:172.21.15.40:6789/0 conn(0x7fef7c09d920 legacy=0x7fef7c09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.403+0000 7fef80d72700 1 -- 172.21.15.40:0/1668642402 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef7c09fed0 con 0x7fef7c09c890 2023-09-30T22:27:59.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.403+0000 7fef81573700 1 --2- 172.21.15.40:0/1668642402 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef7c09e480 0x7fef7c13bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:59.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.403+0000 7fef80d72700 1 --2- 172.21.15.40:0/1668642402 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef7c09c890 0x7fef7c09cc60 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fef70009820 tx=0x7fef70009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a513f24eed3581 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:59.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.404+0000 7fef7b7fe700 1 -- 172.21.15.40:0/1668642402 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef70005e30 con 0x7fef7c09c890 2023-09-30T22:27:59.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.404+0000 7fef7b7fe700 1 -- 172.21.15.40:0/1668642402 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef70006030 con 0x7fef7c09c890 2023-09-30T22:27:59.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.404+0000 7fef7b7fe700 1 -- 172.21.15.40:0/1668642402 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef700063c0 con 0x7fef7c09c890 2023-09-30T22:27:59.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.404+0000 7fef82fd6700 1 -- 172.21.15.40:0/1668642402 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef7c09c890 msgr2=0x7fef7c09cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.404+0000 7fef82fd6700 1 --2- 172.21.15.40:0/1668642402 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef7c09c890 0x7fef7c09cc60 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fef70009820 tx=0x7fef70009b30 comp rx=0 tx=0).stop 2023-09-30T22:27:59.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.404+0000 7fef82fd6700 1 -- 172.21.15.40:0/1668642402 shutdown_connections 2023-09-30T22:27:59.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.404+0000 7fef82fd6700 1 --2- 172.21.15.40:0/1668642402 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef7c09e480 0x7fef7c13bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.404+0000 7fef82fd6700 1 --2- 172.21.15.40:0/1668642402 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef7c09c890 0x7fef7c09cc60 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.404+0000 7fef82fd6700 1 -- 172.21.15.40:0/1668642402 >> 172.21.15.40:0/1668642402 conn(0x7fef7c0a7080 msgr2=0x7fef7c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:59.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.404+0000 7fef82fd6700 1 -- 172.21.15.40:0/1668642402 shutdown_connections 2023-09-30T22:27:59.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.404+0000 7fef82fd6700 1 -- 172.21.15.40:0/1668642402 wait complete. 2023-09-30T22:27:59.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.405+0000 7fef82fd6700 1 Processor -- start 2023-09-30T22:27:59.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.405+0000 7fef82fd6700 1 -- start start 2023-09-30T22:27:59.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.406+0000 7fef82fd6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef7c09c890 0x7fef7c1c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.406+0000 7fef82fd6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef7c09d920 0x7fef7c1c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.406+0000 7fef82fd6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef7c09e480 0x7fef7c12d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.406+0000 7fef82fd6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c12f580 con 0x7fef7c09c890 2023-09-30T22:27:59.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.406+0000 7fef82fd6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c08f560 con 0x7fef7c09e480 2023-09-30T22:27:59.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.406+0000 7fef82fd6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c130880 con 0x7fef7c09d920 2023-09-30T22:27:59.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.406+0000 7fef81573700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef7c09e480 0x7fef7c12d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.406+0000 7fef81573700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef7c09e480 0x7fef7c12d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39708/0 (socket says 172.21.15.40:39708) 2023-09-30T22:27:59.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.406+0000 7fef81573700 1 -- 172.21.15.40:0/673492533 learned_addr learned my addr 172.21.15.40:0/673492533 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:59.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.407+0000 7fef81573700 1 -- 172.21.15.40:0/673492533 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef7c09d920 msgr2=0x7fef7c1c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.407+0000 7fef81573700 1 --2- 172.21.15.40:0/673492533 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef7c09d920 0x7fef7c1c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.407+0000 7fef81573700 1 -- 172.21.15.40:0/673492533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef7c09c890 msgr2=0x7fef7c1c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.407+0000 7fef81573700 1 --2- 172.21.15.40:0/673492533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef7c09c890 0x7fef7c1c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.407+0000 7fef81573700 1 -- 172.21.15.40:0/673492533 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef74009b30 con 0x7fef7c09e480 2023-09-30T22:27:59.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.407+0000 7fef81573700 1 --2- 172.21.15.40:0/673492533 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef7c09e480 0x7fef7c12d3d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fef7400efc0 tx=0x7fef74009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:59.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.407+0000 7fef797fa700 1 -- 172.21.15.40:0/673492533 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef74018070 con 0x7fef7c09e480 2023-09-30T22:27:59.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.407+0000 7fef797fa700 1 -- 172.21.15.40:0/673492533 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7400f040 con 0x7fef7c09e480 2023-09-30T22:27:59.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.407+0000 7fef82fd6700 1 -- 172.21.15.40:0/673492533 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef70009430 con 0x7fef7c09e480 2023-09-30T22:27:59.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.407+0000 7fef797fa700 1 -- 172.21.15.40:0/673492533 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef74003c40 con 0x7fef7c09e480 2023-09-30T22:27:59.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.407+0000 7fef82fd6700 1 -- 172.21.15.40:0/673492533 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef7c0a5df0 con 0x7fef7c09e480 2023-09-30T22:27:59.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.408+0000 7fef797fa700 1 -- 172.21.15.40:0/673492533 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fef7400c9e0 con 0x7fef7c09e480 2023-09-30T22:27:59.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.408+0000 7fef797fa700 1 -- 172.21.15.40:0/673492533 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fef7403f960 con 0x7fef7c09e480 2023-09-30T22:27:59.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.409+0000 7fef82fd6700 1 -- 172.21.15.40:0/673492533 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef7c09ecf0 con 0x7fef7c09e480 2023-09-30T22:27:59.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.418+0000 7fef797fa700 1 -- 172.21.15.40:0/673492533 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef74012340 con 0x7fef7c09e480 2023-09-30T22:27:59.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.427+0000 7fb683161700 1 -- 172.21.15.40:0/2496122526 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb67c062380 con 0x7fb67c09e230 2023-09-30T22:27:59.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.428+0000 7fb6797fa700 1 -- 172.21.15.40:0/2496122526 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb668017330 con 0x7fb67c09e230 2023-09-30T22:27:59.428 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:59.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.430+0000 7fb683161700 1 -- 172.21.15.40:0/2496122526 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb67c09e230 msgr2=0x7fb67c1207d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.430+0000 7fb683161700 1 --2- 172.21.15.40:0/2496122526 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb67c09e230 0x7fb67c1207d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb6680018d0 tx=0x7fb668001be0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.430+0000 7fb683161700 1 -- 172.21.15.40:0/2496122526 shutdown_connections 2023-09-30T22:27:59.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.430+0000 7fb683161700 1 --2- 172.21.15.40:0/2496122526 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb67c130fb0 0x7fb67c120d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.431+0000 7fb683161700 1 --2- 172.21.15.40:0/2496122526 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb67c09d920 0x7fb67c120290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.431+0000 7fb683161700 1 --2- 172.21.15.40:0/2496122526 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb67c09e230 0x7fb67c1207d0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.431+0000 7fb683161700 1 -- 172.21.15.40:0/2496122526 >> 172.21.15.40:0/2496122526 conn(0x7fb67c09fb20 msgr2=0x7fb67c071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:59.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.431+0000 7fb683161700 1 -- 172.21.15.40:0/2496122526 shutdown_connections 2023-09-30T22:27:59.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.431+0000 7fb683161700 1 -- 172.21.15.40:0/2496122526 wait complete. 2023-09-30T22:27:59.447 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:27:59.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.483+0000 7f36cf3dd700 1 Processor -- start 2023-09-30T22:27:59.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.483+0000 7f36cf3dd700 1 -- start start 2023-09-30T22:27:59.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.483+0000 7f36cf3dd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36c809c890 0x7f36c809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.483+0000 7f36cf3dd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f36c809d920 0x7f36c809dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.483+0000 7f36cf3dd700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36c80a2600 con 0x7f36c809e2b0 2023-09-30T22:27:59.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.483+0000 7f36cf3dd700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36c80a29d0 con 0x7f36c809d920 2023-09-30T22:27:59.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.483+0000 7f36cf3dd700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36c809fb40 con 0x7f36c809c890 2023-09-30T22:27:59.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.483+0000 7f36cc978700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f36c809d920 0x7f36c809dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.483+0000 7f36cd179700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36c809c890 0x7f36c809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.483+0000 7f36cc978700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f36c809d920 0x7f36c809dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41202/0 (socket says 172.21.15.40:41202) 2023-09-30T22:27:59.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.483+0000 7f36cc978700 1 -- 172.21.15.40:0/2779976650 learned_addr learned my addr 172.21.15.40:0/2779976650 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:59.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.484+0000 7f36cc978700 1 -- 172.21.15.40:0/2779976650 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36c809c890 msgr2=0x7f36c809cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:59.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.484+0000 7f36cc978700 1 --2- 172.21.15.40:0/2779976650 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36c809c890 0x7f36c809cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.484+0000 7f36cc978700 1 -- 172.21.15.40:0/2779976650 >> v1:172.21.15.40:6789/0 conn(0x7f36c809e2b0 legacy=0x7f36c813ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.484+0000 7f36cc978700 1 -- 172.21.15.40:0/2779976650 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c809e750 con 0x7f36c809d920 2023-09-30T22:27:59.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.484+0000 7f36cd179700 1 --2- 172.21.15.40:0/2779976650 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36c809c890 0x7f36c809cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:59.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.484+0000 7f36cc978700 1 --2- 172.21.15.40:0/2779976650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36c809d920 0x7f36c809dd70 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f36b80098f0 tx=0x7f36b8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4369b8a6160d9dbb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:59.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.484+0000 7f36bffff700 1 -- 172.21.15.40:0/2779976650 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b8011830 con 0x7f36c809d920 2023-09-30T22:27:59.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.484+0000 7f36bffff700 1 -- 172.21.15.40:0/2779976650 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b8011990 con 0x7f36c809d920 2023-09-30T22:27:59.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.484+0000 7f36bffff700 1 -- 172.21.15.40:0/2779976650 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b8011d20 con 0x7f36c809d920 2023-09-30T22:27:59.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.485+0000 7f36cf3dd700 1 -- 172.21.15.40:0/2779976650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36c809d920 msgr2=0x7f36c809dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.485+0000 7f36cf3dd700 1 --2- 172.21.15.40:0/2779976650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36c809d920 0x7f36c809dd70 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f36b80098f0 tx=0x7f36b8009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:59.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.485+0000 7f36cf3dd700 1 -- 172.21.15.40:0/2779976650 shutdown_connections 2023-09-30T22:27:59.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.485+0000 7f36cf3dd700 1 --2- 172.21.15.40:0/2779976650 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36c809c890 0x7f36c809cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.485+0000 7f36cf3dd700 1 --2- 172.21.15.40:0/2779976650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36c809d920 0x7f36c809dd70 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.485+0000 7f36cf3dd700 1 -- 172.21.15.40:0/2779976650 >> 172.21.15.40:0/2779976650 conn(0x7f36c80a7080 msgr2=0x7f36c80a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:59.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.485+0000 7f36cf3dd700 1 -- 172.21.15.40:0/2779976650 shutdown_connections 2023-09-30T22:27:59.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.485+0000 7f36cf3dd700 1 -- 172.21.15.40:0/2779976650 wait complete. 2023-09-30T22:27:59.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.486+0000 7f36cf3dd700 1 Processor -- start 2023-09-30T22:27:59.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.486+0000 7f36cf3dd700 1 -- start start 2023-09-30T22:27:59.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.487+0000 7f36cf3dd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36c809c890 0x7f36c812d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.487+0000 7f36cf3dd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36c809d920 0x7f36c812d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.487+0000 7f36cf3dd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36c809e2b0 0x7f36c812ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.487+0000 7f36cf3dd700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c812f730 con 0x7f36c809c890 2023-09-30T22:27:59.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.487+0000 7f36cf3dd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c8130ba0 con 0x7f36c809e2b0 2023-09-30T22:27:59.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.487+0000 7f36cf3dd700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36c809ecf0 con 0x7f36c809d920 2023-09-30T22:27:59.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.487+0000 7f36cc978700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36c809d920 0x7f36c812d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.487+0000 7f36cd179700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36c809c890 0x7f36c812d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.487+0000 7f36cc978700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36c809d920 0x7f36c812d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:45820/0 (socket says 172.21.15.40:45820) 2023-09-30T22:27:59.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.487+0000 7f36cc978700 1 -- 172.21.15.40:0/2112778789 learned_addr learned my addr 172.21.15.40:0/2112778789 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:59.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.487+0000 7f36cd97a700 1 --2- 172.21.15.40:0/2112778789 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36c809e2b0 0x7f36c812ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.487+0000 7f36cd179700 1 -- 172.21.15.40:0/2112778789 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36c809d920 msgr2=0x7f36c812d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.487+0000 7f36cd179700 1 --2- 172.21.15.40:0/2112778789 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36c809d920 0x7f36c812d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.487+0000 7f36cd179700 1 -- 172.21.15.40:0/2112778789 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36c809e2b0 msgr2=0x7f36c812ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.487+0000 7f36cd179700 1 --2- 172.21.15.40:0/2112778789 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36c809e2b0 0x7f36c812ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.487+0000 7f36cd179700 1 -- 172.21.15.40:0/2112778789 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c4009430 con 0x7f36c809c890 2023-09-30T22:27:59.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.487+0000 7f36cc978700 1 --2- 172.21.15.40:0/2112778789 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36c809d920 0x7f36c812d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:59.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.487+0000 7f36cd179700 1 --2- 172.21.15.40:0/2112778789 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36c809c890 0x7f36c812d340 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f36c400e980 tx=0x7f36c400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:59.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.487+0000 7f36bdffb700 1 -- 172.21.15.40:0/2112778789 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c4005a20 con 0x7f36c809c890 2023-09-30T22:27:59.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.488+0000 7f36bdffb700 1 -- 172.21.15.40:0/2112778789 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c4005b80 con 0x7f36c809c890 2023-09-30T22:27:59.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.488+0000 7f36cf3dd700 1 -- 172.21.15.40:0/2112778789 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b8009550 con 0x7f36c809c890 2023-09-30T22:27:59.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.488+0000 7f36bdffb700 1 -- 172.21.15.40:0/2112778789 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c400c690 con 0x7f36c809c890 2023-09-30T22:27:59.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.488+0000 7f36cf3dd700 1 -- 172.21.15.40:0/2112778789 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36c812fab0 con 0x7f36c809c890 2023-09-30T22:27:59.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.489+0000 7f36bdffb700 1 -- 172.21.15.40:0/2112778789 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f36c400c7f0 con 0x7f36c809c890 2023-09-30T22:27:59.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.489+0000 7f36bdffb700 1 -- 172.21.15.40:0/2112778789 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f36c403f950 con 0x7f36c809c890 2023-09-30T22:27:59.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.489+0000 7f36cf3dd700 1 -- 172.21.15.40:0/2112778789 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36c8062380 con 0x7f36c809c890 2023-09-30T22:27:59.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.494+0000 7f36bdffb700 1 -- 172.21.15.40:0/2112778789 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f36c4020070 con 0x7f36c809c890 2023-09-30T22:27:59.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.537+0000 7f81371a1700 1 Processor -- start 2023-09-30T22:27:59.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.537+0000 7f81371a1700 1 -- start start 2023-09-30T22:27:59.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.538+0000 7f81371a1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f813009c890 0x7f813009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.538+0000 7f81371a1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f813009e480 0x7f813013bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.538+0000 7f81371a1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81300a2600 con 0x7f813009d920 2023-09-30T22:27:59.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.538+0000 7f81371a1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81300a29d0 con 0x7f813009c890 2023-09-30T22:27:59.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.538+0000 7f81371a1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813009fb40 con 0x7f813009e480 2023-09-30T22:27:59.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.538+0000 7f813573e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f813009e480 0x7f813013bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.538+0000 7f813573e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f813009e480 0x7f813013bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39730/0 (socket says 172.21.15.40:39730) 2023-09-30T22:27:59.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.538+0000 7f8134f3d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f813009c890 0x7f813009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.538+0000 7f813573e700 1 -- 172.21.15.40:0/2662910880 learned_addr learned my addr 172.21.15.40:0/2662910880 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:59.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.538+0000 7f8134f3d700 1 -- 172.21.15.40:0/2662910880 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f813009e480 msgr2=0x7f813013bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:59.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.538+0000 7f8134f3d700 1 --2- 172.21.15.40:0/2662910880 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f813009e480 0x7f813013bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.538+0000 7f8134f3d700 1 -- 172.21.15.40:0/2662910880 >> v1:172.21.15.40:6789/0 conn(0x7f813009d920 legacy=0x7f813009dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.538+0000 7f8134f3d700 1 -- 172.21.15.40:0/2662910880 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813009fed0 con 0x7f813009c890 2023-09-30T22:27:59.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.538+0000 7f8134f3d700 1 --2- 172.21.15.40:0/2662910880 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f813009c890 0x7f813009cc60 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f8124009820 tx=0x7f8124009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19d78abdc44db115 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:59.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.539+0000 7f812f7fe700 1 -- 172.21.15.40:0/2662910880 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8124005e30 con 0x7f813009c890 2023-09-30T22:27:59.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.539+0000 7f812f7fe700 1 -- 172.21.15.40:0/2662910880 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8124006030 con 0x7f813009c890 2023-09-30T22:27:59.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.539+0000 7f812f7fe700 1 -- 172.21.15.40:0/2662910880 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81240063c0 con 0x7f813009c890 2023-09-30T22:27:59.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.539+0000 7f81371a1700 1 -- 172.21.15.40:0/2662910880 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f813009c890 msgr2=0x7f813009cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.539+0000 7f81371a1700 1 --2- 172.21.15.40:0/2662910880 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f813009c890 0x7f813009cc60 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f8124009820 tx=0x7f8124009b30 comp rx=0 tx=0).stop 2023-09-30T22:27:59.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.539+0000 7f81371a1700 1 -- 172.21.15.40:0/2662910880 shutdown_connections 2023-09-30T22:27:59.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.539+0000 7f81371a1700 1 --2- 172.21.15.40:0/2662910880 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f813009e480 0x7f813013bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.539+0000 7f81371a1700 1 --2- 172.21.15.40:0/2662910880 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f813009c890 0x7f813009cc60 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.539+0000 7f81371a1700 1 -- 172.21.15.40:0/2662910880 >> 172.21.15.40:0/2662910880 conn(0x7f81300a7080 msgr2=0x7f81300a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:59.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.539+0000 7f81371a1700 1 -- 172.21.15.40:0/2662910880 shutdown_connections 2023-09-30T22:27:59.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.539+0000 7f81371a1700 1 -- 172.21.15.40:0/2662910880 wait complete. 2023-09-30T22:27:59.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.540+0000 7f81371a1700 1 Processor -- start 2023-09-30T22:27:59.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.540+0000 7f81371a1700 1 -- start start 2023-09-30T22:27:59.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.541+0000 7f81371a1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f813009c890 0x7f813012d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.541+0000 7f81371a1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f813009d920 0x7f813012daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.541+0000 7f81371a1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f813009e480 0x7f813012e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.541+0000 7f81371a1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813009c1a0 con 0x7f813009e480 2023-09-30T22:27:59.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.541+0000 7f81371a1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81301313c0 con 0x7f813009d920 2023-09-30T22:27:59.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.541+0000 7f81371a1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8130130ab0 con 0x7f813009c890 2023-09-30T22:27:59.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.541+0000 7f8134f3d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f813009c890 0x7f813012d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.541+0000 7f812ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f813009d920 0x7f813012daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.541+0000 7f8134f3d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f813009c890 0x7f813012d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:45832/0 (socket says 172.21.15.40:45832) 2023-09-30T22:27:59.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.541+0000 7f8134f3d700 1 -- 172.21.15.40:0/2512174070 learned_addr learned my addr 172.21.15.40:0/2512174070 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:27:59.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.541+0000 7f813573e700 1 --2- 172.21.15.40:0/2512174070 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f813009e480 0x7f813012e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.541+0000 7f8134f3d700 1 -- 172.21.15.40:0/2512174070 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f813009d920 msgr2=0x7f813012daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.541+0000 7f8134f3d700 1 --2- 172.21.15.40:0/2512174070 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f813009d920 0x7f813012daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.541+0000 7f8134f3d700 1 -- 172.21.15.40:0/2512174070 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f813009e480 msgr2=0x7f813012e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.541+0000 7f8134f3d700 1 --2- 172.21.15.40:0/2512174070 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f813009e480 0x7f813012e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.541+0000 7f8134f3d700 1 -- 172.21.15.40:0/2512174070 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8124009430 con 0x7f813009c890 2023-09-30T22:27:59.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.542+0000 7f812ffff700 1 --2- 172.21.15.40:0/2512174070 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f813009d920 0x7f813012daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:59.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.542+0000 7f8134f3d700 1 --2- 172.21.15.40:0/2512174070 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f813009c890 0x7f813012d5b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8124000c00 tx=0x7f8124004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:59.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.542+0000 7f812d7fa700 1 -- 172.21.15.40:0/2512174070 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81240061a0 con 0x7f813009c890 2023-09-30T22:27:59.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.542+0000 7f812d7fa700 1 -- 172.21.15.40:0/2512174070 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8124020070 con 0x7f813009c890 2023-09-30T22:27:59.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.542+0000 7f812d7fa700 1 -- 172.21.15.40:0/2512174070 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8124006540 con 0x7f813009c890 2023-09-30T22:27:59.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.543+0000 7f81371a1700 1 -- 172.21.15.40:0/2512174070 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81300a5dd0 con 0x7f813009c890 2023-09-30T22:27:59.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.543+0000 7f81371a1700 1 -- 172.21.15.40:0/2512174070 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8130130d90 con 0x7f813009c890 2023-09-30T22:27:59.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.544+0000 7f812d7fa700 1 -- 172.21.15.40:0/2512174070 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8124022030 con 0x7f813009c890 2023-09-30T22:27:59.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.544+0000 7f812d7fa700 1 -- 172.21.15.40:0/2512174070 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f8124040ab0 con 0x7f813009c890 2023-09-30T22:27:59.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.544+0000 7f81371a1700 1 -- 172.21.15.40:0/2512174070 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8130062380 con 0x7f813009c890 2023-09-30T22:27:59.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.549+0000 7f812d7fa700 1 -- 172.21.15.40:0/2512174070 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f81240247e0 con 0x7f813009c890 2023-09-30T22:27:59.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.622+0000 7fef82fd6700 1 -- 172.21.15.40:0/673492533 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fef7c062380 con 0x7fef7c09e480 2023-09-30T22:27:59.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.623+0000 7fef797fa700 1 -- 172.21.15.40:0/673492533 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fef7401cbb0 con 0x7fef7c09e480 2023-09-30T22:27:59.624 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:27:59.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.626+0000 7fef82fd6700 1 -- 172.21.15.40:0/673492533 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef7c09e480 msgr2=0x7fef7c12d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.626+0000 7fef82fd6700 1 --2- 172.21.15.40:0/673492533 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef7c09e480 0x7fef7c12d3d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fef7400efc0 tx=0x7fef74009f90 comp rx=0 tx=0).stop 2023-09-30T22:27:59.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.626+0000 7fef82fd6700 1 -- 172.21.15.40:0/673492533 shutdown_connections 2023-09-30T22:27:59.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.626+0000 7fef82fd6700 1 --2- 172.21.15.40:0/673492533 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef7c09e480 0x7fef7c12d3d0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.626+0000 7fef82fd6700 1 --2- 172.21.15.40:0/673492533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef7c09c890 0x7fef7c1c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.626+0000 7fef82fd6700 1 --2- 172.21.15.40:0/673492533 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef7c09d920 0x7fef7c1c9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.626+0000 7fef82fd6700 1 -- 172.21.15.40:0/673492533 >> 172.21.15.40:0/673492533 conn(0x7fef7c0a7080 msgr2=0x7fef7c0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:59.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.626+0000 7fef82fd6700 1 -- 172.21.15.40:0/673492533 shutdown_connections 2023-09-30T22:27:59.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.626+0000 7fef82fd6700 1 -- 172.21.15.40:0/673492533 wait complete. 2023-09-30T22:27:59.644 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:27:59.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.697+0000 7f36cf3dd700 1 -- 172.21.15.40:0/2112778789 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f36c8130690 con 0x7f36c809c890 2023-09-30T22:27:59.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.697+0000 7f36bdffb700 1 -- 172.21.15.40:0/2112778789 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f36c4029090 con 0x7f36c809c890 2023-09-30T22:27:59.699 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:27:59.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.699+0000 7f36cf3dd700 1 -- 172.21.15.40:0/2112778789 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36c809c890 msgr2=0x7f36c812d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.699+0000 7f36cf3dd700 1 --2- 172.21.15.40:0/2112778789 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36c809c890 0x7f36c812d340 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f36c400e980 tx=0x7f36c400ec90 comp rx=0 tx=0).stop 2023-09-30T22:27:59.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.699+0000 7f36cf3dd700 1 -- 172.21.15.40:0/2112778789 shutdown_connections 2023-09-30T22:27:59.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.699+0000 7f36cf3dd700 1 --2- 172.21.15.40:0/2112778789 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36c809e2b0 0x7f36c812ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.699+0000 7f36cf3dd700 1 --2- 172.21.15.40:0/2112778789 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36c809c890 0x7f36c812d340 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.699+0000 7f36cf3dd700 1 --2- 172.21.15.40:0/2112778789 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36c809d920 0x7f36c812d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.699+0000 7f36cf3dd700 1 -- 172.21.15.40:0/2112778789 >> 172.21.15.40:0/2112778789 conn(0x7f36c80a7080 msgr2=0x7f36c80a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:59.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.699+0000 7f36cf3dd700 1 -- 172.21.15.40:0/2112778789 shutdown_connections 2023-09-30T22:27:59.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.699+0000 7f36cf3dd700 1 -- 172.21.15.40:0/2112778789 wait complete. 2023-09-30T22:27:59.712 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:27:59.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.757+0000 7f81371a1700 1 -- 172.21.15.40:0/2512174070 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8130074620 con 0x7f813009c890 2023-09-30T22:27:59.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.757+0000 7f812d7fa700 1 -- 172.21.15.40:0/2512174070 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f812401b410 con 0x7f813009c890 2023-09-30T22:27:59.758 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:27:59.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.759+0000 7f81371a1700 1 -- 172.21.15.40:0/2512174070 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f813009c890 msgr2=0x7f813012d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.759+0000 7f81371a1700 1 --2- 172.21.15.40:0/2512174070 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f813009c890 0x7f813012d5b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8124000c00 tx=0x7f8124004750 comp rx=0 tx=0).stop 2023-09-30T22:27:59.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.760+0000 7f81371a1700 1 -- 172.21.15.40:0/2512174070 shutdown_connections 2023-09-30T22:27:59.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.760+0000 7f81371a1700 1 --2- 172.21.15.40:0/2512174070 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f813009c890 0x7f813012d5b0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.760+0000 7f81371a1700 1 --2- 172.21.15.40:0/2512174070 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f813009e480 0x7f813012e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.760+0000 7f81371a1700 1 --2- 172.21.15.40:0/2512174070 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f813009d920 0x7f813012daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.760+0000 7f81371a1700 1 -- 172.21.15.40:0/2512174070 >> 172.21.15.40:0/2512174070 conn(0x7f81300a7080 msgr2=0x7f81300a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:59.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.760+0000 7f81371a1700 1 -- 172.21.15.40:0/2512174070 shutdown_connections 2023-09-30T22:27:59.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:27:59.760+0000 7f81371a1700 1 -- 172.21.15.40:0/2512174070 wait complete. 2023-09-30T22:27:59.772 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:00.448 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:00.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.590+0000 7f6b54b0d700 1 Processor -- start 2023-09-30T22:28:00.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.590+0000 7f6b54b0d700 1 -- start start 2023-09-30T22:28:00.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.591+0000 7f6b54b0d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6b50133e00 0x7f6b501341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.591+0000 7f6b54b0d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b5009d400 0x7f6b5009d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.591+0000 7f6b54b0d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b50133940 con 0x7f6b5009dd70 2023-09-30T22:28:00.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.591+0000 7f6b54b0d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b5009f0d0 con 0x7f6b50133e00 2023-09-30T22:28:00.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.591+0000 7f6b54b0d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b50133be0 con 0x7f6b5009d400 2023-09-30T22:28:00.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.591+0000 7f6b4e59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6b50133e00 0x7f6b501341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.591+0000 7f6b4dd9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b5009d400 0x7f6b5009d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.591+0000 7f6b4e59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6b50133e00 0x7f6b501341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41230/0 (socket says 172.21.15.40:41230) 2023-09-30T22:28:00.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.591+0000 7f6b4dd9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b5009d400 0x7f6b5009d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39746/0 (socket says 172.21.15.40:39746) 2023-09-30T22:28:00.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.591+0000 7f6b4e59c700 1 -- 172.21.15.40:0/2574235039 learned_addr learned my addr 172.21.15.40:0/2574235039 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:00.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.591+0000 7f6b4dd9b700 1 -- 172.21.15.40:0/2574235039 >> v2:172.21.15.40:3300/0 conn(0x7f6b50133e00 msgr2=0x7f6b501341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:00.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.591+0000 7f6b4dd9b700 1 --2- 172.21.15.40:0/2574235039 >> v2:172.21.15.40:3300/0 conn(0x7f6b50133e00 0x7f6b501341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.591+0000 7f6b4dd9b700 1 -- 172.21.15.40:0/2574235039 >> v1:172.21.15.40:6789/0 conn(0x7f6b5009dd70 legacy=0x7f6b5013ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:00.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.591+0000 7f6b4dd9b700 1 -- 172.21.15.40:0/2574235039 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b5009a860 con 0x7f6b5009d400 2023-09-30T22:28:00.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.591+0000 7f6b4e59c700 1 --2- 172.21.15.40:0/2574235039 >> v2:172.21.15.40:3300/0 conn(0x7f6b50133e00 0x7f6b501341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:00.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.591+0000 7f6b4dd9b700 1 --2- 172.21.15.40:0/2574235039 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b5009d400 0x7f6b5009d830 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f6b40009840 tx=0x7f6b40009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e75009c7522767ed server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:00.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.592+0000 7f6b4d59a700 1 -- 172.21.15.40:0/2574235039 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b40011830 con 0x7f6b5009d400 2023-09-30T22:28:00.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.592+0000 7f6b4d59a700 1 -- 172.21.15.40:0/2574235039 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b40011990 con 0x7f6b5009d400 2023-09-30T22:28:00.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.592+0000 7f6b4d59a700 1 -- 172.21.15.40:0/2574235039 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b40011d20 con 0x7f6b5009d400 2023-09-30T22:28:00.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.592+0000 7f6b54b0d700 1 -- 172.21.15.40:0/2574235039 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b5009d400 msgr2=0x7f6b5009d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:00.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.592+0000 7f6b54b0d700 1 --2- 172.21.15.40:0/2574235039 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b5009d400 0x7f6b5009d830 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f6b40009840 tx=0x7f6b40009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:00.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.592+0000 7f6b54b0d700 1 -- 172.21.15.40:0/2574235039 shutdown_connections 2023-09-30T22:28:00.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.592+0000 7f6b54b0d700 1 --2- 172.21.15.40:0/2574235039 >> v2:172.21.15.40:3300/0 conn(0x7f6b50133e00 0x7f6b501341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.592+0000 7f6b54b0d700 1 --2- 172.21.15.40:0/2574235039 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b5009d400 0x7f6b5009d830 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.592+0000 7f6b54b0d700 1 -- 172.21.15.40:0/2574235039 >> 172.21.15.40:0/2574235039 conn(0x7f6b500a2a00 msgr2=0x7f6b500a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:00.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.592+0000 7f6b54b0d700 1 -- 172.21.15.40:0/2574235039 shutdown_connections 2023-09-30T22:28:00.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.592+0000 7f6b54b0d700 1 -- 172.21.15.40:0/2574235039 wait complete. 2023-09-30T22:28:00.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.593+0000 7f6b54b0d700 1 Processor -- start 2023-09-30T22:28:00.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.594+0000 7f6b54b0d700 1 -- start start 2023-09-30T22:28:00.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.594+0000 7f6b54b0d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b5009d400 0x7f6b5011caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.594+0000 7f6b54b0d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b5009dd70 0x7f6b5011d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.594+0000 7f6b54b0d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b50133e00 0x7f6b501c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.594+0000 7f6b54b0d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5011e690 con 0x7f6b5009d400 2023-09-30T22:28:00.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.594+0000 7f6b54b0d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5011fcb0 con 0x7f6b50133e00 2023-09-30T22:28:00.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.594+0000 7f6b54b0d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5011c700 con 0x7f6b5009dd70 2023-09-30T22:28:00.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.594+0000 7f6b4dd9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b5009dd70 0x7f6b5011d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.594+0000 7f6b4e59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b5009d400 0x7f6b5011caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.594+0000 7f6b4ed9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b50133e00 0x7f6b501c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.594+0000 7f6b4dd9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b5009dd70 0x7f6b5011d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:45838/0 (socket says 172.21.15.40:45838) 2023-09-30T22:28:00.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.594+0000 7f6b4dd9b700 1 -- 172.21.15.40:0/3391598198 learned_addr learned my addr 172.21.15.40:0/3391598198 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:00.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.594+0000 7f6b4ed9d700 1 -- 172.21.15.40:0/3391598198 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b5009dd70 msgr2=0x7f6b5011d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:00.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.594+0000 7f6b4ed9d700 1 --2- 172.21.15.40:0/3391598198 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b5009dd70 0x7f6b5011d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.594+0000 7f6b4ed9d700 1 -- 172.21.15.40:0/3391598198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b5009d400 msgr2=0x7f6b5011caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:00.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.594+0000 7f6b4ed9d700 1 --2- 172.21.15.40:0/3391598198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b5009d400 0x7f6b5011caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.594+0000 7f6b4ed9d700 1 -- 172.21.15.40:0/3391598198 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b44009550 con 0x7f6b50133e00 2023-09-30T22:28:00.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.595+0000 7f6b4ed9d700 1 --2- 172.21.15.40:0/3391598198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b50133e00 0x7f6b501c8ab0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6b4800cae0 tx=0x7f6b4800cdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:00.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.595+0000 7f6b3effd700 1 -- 172.21.15.40:0/3391598198 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b48003c00 con 0x7f6b50133e00 2023-09-30T22:28:00.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.595+0000 7f6b3effd700 1 -- 172.21.15.40:0/3391598198 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b48003d60 con 0x7f6b50133e00 2023-09-30T22:28:00.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.595+0000 7f6b54b0d700 1 -- 172.21.15.40:0/3391598198 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b400094a0 con 0x7f6b50133e00 2023-09-30T22:28:00.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.595+0000 7f6b3effd700 1 -- 172.21.15.40:0/3391598198 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4800aa20 con 0x7f6b50133e00 2023-09-30T22:28:00.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.595+0000 7f6b54b0d700 1 -- 172.21.15.40:0/3391598198 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b5011e2f0 con 0x7f6b50133e00 2023-09-30T22:28:00.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.595+0000 7f6b3effd700 1 -- 172.21.15.40:0/3391598198 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6b4800ab80 con 0x7f6b50133e00 2023-09-30T22:28:00.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.596+0000 7f6b3effd700 1 -- 172.21.15.40:0/3391598198 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6b4803f550 con 0x7f6b50133e00 2023-09-30T22:28:00.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.596+0000 7f6b54b0d700 1 -- 172.21.15.40:0/3391598198 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b50062380 con 0x7f6b50133e00 2023-09-30T22:28:00.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.601+0000 7f6b3effd700 1 -- 172.21.15.40:0/3391598198 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6b48012420 con 0x7f6b50133e00 2023-09-30T22:28:00.645 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:00.713 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:00.773 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:00.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.776+0000 7f3dc3bea700 1 Processor -- start 2023-09-30T22:28:00.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.776+0000 7f3dc3bea700 1 -- start start 2023-09-30T22:28:00.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.777+0000 7f3dc3bea700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3dbc06a6d0 0x7f3dbc09d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.777+0000 7f3dc3bea700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3dbc09de60 0x7f3dbc09e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.777+0000 7f3dc3bea700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3dbc13c490 0x7f3dbc13e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.777+0000 7f3dc3bea700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dbc06aaa0 con 0x7f3dbc06a6d0 2023-09-30T22:28:00.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.777+0000 7f3dc3bea700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc09e790 con 0x7f3dbc13c490 2023-09-30T22:28:00.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.777+0000 7f3dc3bea700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc11d980 con 0x7f3dbc09de60 2023-09-30T22:28:00.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.777+0000 7f3dc1185700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3dbc09de60 0x7f3dbc09e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.777+0000 7f3dc1185700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3dbc09de60 0x7f3dbc09e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:45844/0 (socket says 172.21.15.40:45844) 2023-09-30T22:28:00.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.777+0000 7f3dc1185700 1 -- 172.21.15.40:0/1899101002 learned_addr learned my addr 172.21.15.40:0/1899101002 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:00.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.777+0000 7f3dc2187700 1 --2- 172.21.15.40:0/1899101002 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3dbc13c490 0x7f3dbc13e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.777+0000 7f3dc1986700 1 --2- 172.21.15.40:0/1899101002 >> v2:172.21.15.40:3300/0 conn(0x7f3dbc06a6d0 0x7f3dbc09d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.777+0000 7f3dc1185700 1 -- 172.21.15.40:0/1899101002 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3dbc13c490 msgr2=0x7f3dbc13e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:00.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.777+0000 7f3dc1185700 1 --2- 172.21.15.40:0/1899101002 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3dbc13c490 0x7f3dbc13e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.777+0000 7f3dc1185700 1 -- 172.21.15.40:0/1899101002 >> v2:172.21.15.40:3300/0 conn(0x7f3dbc06a6d0 msgr2=0x7f3dbc09d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:00.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.777+0000 7f3dc1185700 1 --2- 172.21.15.40:0/1899101002 >> v2:172.21.15.40:3300/0 conn(0x7f3dbc06a6d0 0x7f3dbc09d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.777+0000 7f3dc1185700 1 -- 172.21.15.40:0/1899101002 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dbc06b150 con 0x7f3dbc09de60 2023-09-30T22:28:00.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.778+0000 7f3dc1185700 1 --2- 172.21.15.40:0/1899101002 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3dbc09de60 0x7f3dbc09e250 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f3dac009920 tx=0x7f3dac009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81363d509b103ada server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:00.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.778+0000 7f3dc0984700 1 -- 172.21.15.40:0/1899101002 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac00b9c0 con 0x7f3dbc09de60 2023-09-30T22:28:00.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.778+0000 7f3dc0984700 1 -- 172.21.15.40:0/1899101002 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dac00bb20 con 0x7f3dbc09de60 2023-09-30T22:28:00.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.778+0000 7f3dc0984700 1 -- 172.21.15.40:0/1899101002 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac009e70 con 0x7f3dbc09de60 2023-09-30T22:28:00.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.778+0000 7f3dc3bea700 1 -- 172.21.15.40:0/1899101002 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3dbc09de60 msgr2=0x7f3dbc09e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:00.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.778+0000 7f3dc3bea700 1 --2- 172.21.15.40:0/1899101002 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3dbc09de60 0x7f3dbc09e250 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f3dac009920 tx=0x7f3dac009c30 comp rx=0 tx=0).stop 2023-09-30T22:28:00.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.779+0000 7f3dc3bea700 1 -- 172.21.15.40:0/1899101002 shutdown_connections 2023-09-30T22:28:00.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.779+0000 7f3dc3bea700 1 --2- 172.21.15.40:0/1899101002 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3dbc13c490 0x7f3dbc13e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.779+0000 7f3dc3bea700 1 --2- 172.21.15.40:0/1899101002 >> v2:172.21.15.40:3300/0 conn(0x7f3dbc06a6d0 0x7f3dbc09d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.779+0000 7f3dc3bea700 1 --2- 172.21.15.40:0/1899101002 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3dbc09de60 0x7f3dbc09e250 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.779+0000 7f3dc3bea700 1 -- 172.21.15.40:0/1899101002 >> 172.21.15.40:0/1899101002 conn(0x7f3dbc09fb20 msgr2=0x7f3dbc09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:00.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.779+0000 7f3dc3bea700 1 -- 172.21.15.40:0/1899101002 shutdown_connections 2023-09-30T22:28:00.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.779+0000 7f3dc3bea700 1 -- 172.21.15.40:0/1899101002 wait complete. 2023-09-30T22:28:00.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.780+0000 7f3dc3bea700 1 Processor -- start 2023-09-30T22:28:00.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.780+0000 7f3dc3bea700 1 -- start start 2023-09-30T22:28:00.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.780+0000 7f3dc3bea700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3dbc06a6d0 0x7f3dbc127130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.780+0000 7f3dc3bea700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3dbc09de60 0x7f3dbc127670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.780+0000 7f3dc3bea700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3dbc13c490 0x7f3dbc1cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.781+0000 7f3dc3bea700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc12a1f0 con 0x7f3dbc06a6d0 2023-09-30T22:28:00.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.781+0000 7f3dc3bea700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc13b060 con 0x7f3dbc13c490 2023-09-30T22:28:00.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.781+0000 7f3dc3bea700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc126cb0 con 0x7f3dbc09de60 2023-09-30T22:28:00.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.781+0000 7f3dc1185700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3dbc09de60 0x7f3dbc127670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.781+0000 7f3dc1185700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3dbc09de60 0x7f3dbc127670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:45854/0 (socket says 172.21.15.40:45854) 2023-09-30T22:28:00.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.781+0000 7f3dc1185700 1 -- 172.21.15.40:0/350127042 learned_addr learned my addr 172.21.15.40:0/350127042 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:00.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.781+0000 7f3dc1986700 1 --2- 172.21.15.40:0/350127042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3dbc06a6d0 0x7f3dbc127130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.781+0000 7f3dc1986700 1 -- 172.21.15.40:0/350127042 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3dbc09de60 msgr2=0x7f3dbc127670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:00.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.781+0000 7f3dc1986700 1 --2- 172.21.15.40:0/350127042 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3dbc09de60 0x7f3dbc127670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.781+0000 7f3dc1986700 1 -- 172.21.15.40:0/350127042 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3dbc13c490 msgr2=0x7f3dbc1cc910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:28:00.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.781+0000 7f3dc1986700 1 --2- 172.21.15.40:0/350127042 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3dbc13c490 0x7f3dbc1cc910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.781+0000 7f3dc1986700 1 -- 172.21.15.40:0/350127042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dac009550 con 0x7f3dbc06a6d0 2023-09-30T22:28:00.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.781+0000 7f3dc1185700 1 --2- 172.21.15.40:0/350127042 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3dbc09de60 0x7f3dbc127670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:00.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.781+0000 7f3dc1986700 1 --2- 172.21.15.40:0/350127042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3dbc06a6d0 0x7f3dbc127130 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f3db800e7e0 tx=0x7f3db800eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:00.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.781+0000 7f3db27fc700 1 -- 172.21.15.40:0/350127042 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db800c070 con 0x7f3dbc06a6d0 2023-09-30T22:28:00.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.781+0000 7f3db27fc700 1 -- 172.21.15.40:0/350127042 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db8013610 con 0x7f3dbc06a6d0 2023-09-30T22:28:00.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.781+0000 7f3db27fc700 1 -- 172.21.15.40:0/350127042 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db8013980 con 0x7f3dbc06a6d0 2023-09-30T22:28:00.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.782+0000 7f3dc3bea700 1 -- 172.21.15.40:0/350127042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dbc0a31d0 con 0x7f3dbc06a6d0 2023-09-30T22:28:00.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.782+0000 7f3dc3bea700 1 -- 172.21.15.40:0/350127042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dbc1282e0 con 0x7f3dbc06a6d0 2023-09-30T22:28:00.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.783+0000 7f3db27fc700 1 -- 172.21.15.40:0/350127042 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3db8013ae0 con 0x7f3dbc06a6d0 2023-09-30T22:28:00.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.783+0000 7f3db27fc700 1 -- 172.21.15.40:0/350127042 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3db803f440 con 0x7f3dbc06a6d0 2023-09-30T22:28:00.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.784+0000 7f3dc3bea700 1 -- 172.21.15.40:0/350127042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dbc062380 con 0x7f3dbc06a6d0 2023-09-30T22:28:00.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.789+0000 7f3db27fc700 1 -- 172.21.15.40:0/350127042 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3db8010900 con 0x7f3dbc06a6d0 2023-09-30T22:28:00.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.818+0000 7f6b54b0d700 1 -- 172.21.15.40:0/3391598198 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6b500a34b0 con 0x7f6b50133e00 2023-09-30T22:28:00.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.819+0000 7f6b3effd700 1 -- 172.21.15.40:0/3391598198 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6b48011380 con 0x7f6b50133e00 2023-09-30T22:28:00.820 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:00.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.822+0000 7f6b54b0d700 1 -- 172.21.15.40:0/3391598198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b50133e00 msgr2=0x7f6b501c8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:00.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.822+0000 7f6b54b0d700 1 --2- 172.21.15.40:0/3391598198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b50133e00 0x7f6b501c8ab0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6b4800cae0 tx=0x7f6b4800cdf0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.822+0000 7f6b54b0d700 1 -- 172.21.15.40:0/3391598198 shutdown_connections 2023-09-30T22:28:00.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.822+0000 7f6b54b0d700 1 --2- 172.21.15.40:0/3391598198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b50133e00 0x7f6b501c8ab0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.822+0000 7f6b54b0d700 1 --2- 172.21.15.40:0/3391598198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b5009d400 0x7f6b5011caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.822+0000 7f6b54b0d700 1 --2- 172.21.15.40:0/3391598198 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b5009dd70 0x7f6b5011d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.822+0000 7f6b54b0d700 1 -- 172.21.15.40:0/3391598198 >> 172.21.15.40:0/3391598198 conn(0x7f6b500a2a00 msgr2=0x7f6b501303c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:00.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.822+0000 7f6b54b0d700 1 -- 172.21.15.40:0/3391598198 shutdown_connections 2023-09-30T22:28:00.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.822+0000 7f6b54b0d700 1 -- 172.21.15.40:0/3391598198 wait complete. 2023-09-30T22:28:00.842 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:00.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.850+0000 7f4b194d4700 1 Processor -- start 2023-09-30T22:28:00.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.850+0000 7f4b194d4700 1 -- start start 2023-09-30T22:28:00.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.851+0000 7f4b194d4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4b1409c890 0x7f4b1409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.851+0000 7f4b194d4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4b1409d920 0x7f4b1409dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.851+0000 7f4b194d4700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b140a2600 con 0x7f4b1409e2b0 2023-09-30T22:28:00.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.851+0000 7f4b194d4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b140a29d0 con 0x7f4b1409d920 2023-09-30T22:28:00.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.851+0000 7f4b194d4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1409fb40 con 0x7f4b1409c890 2023-09-30T22:28:00.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.851+0000 7f4b127fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4b1409d920 0x7f4b1409dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.851+0000 7f4b12ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4b1409c890 0x7f4b1409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.851+0000 7f4b127fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4b1409d920 0x7f4b1409dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41266/0 (socket says 172.21.15.40:41266) 2023-09-30T22:28:00.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.851+0000 7f4b127fc700 1 -- 172.21.15.40:0/2423578116 learned_addr learned my addr 172.21.15.40:0/2423578116 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:00.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.851+0000 7f4b12ffd700 1 -- 172.21.15.40:0/2423578116 >> v2:172.21.15.40:3300/0 conn(0x7f4b1409d920 msgr2=0x7f4b1409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:00.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.851+0000 7f4b12ffd700 1 --2- 172.21.15.40:0/2423578116 >> v2:172.21.15.40:3300/0 conn(0x7f4b1409d920 0x7f4b1409dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.851+0000 7f4b12ffd700 1 -- 172.21.15.40:0/2423578116 >> v1:172.21.15.40:6789/0 conn(0x7f4b1409e2b0 legacy=0x7f4b1413ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:00.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.851+0000 7f4b12ffd700 1 -- 172.21.15.40:0/2423578116 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b1409e750 con 0x7f4b1409c890 2023-09-30T22:28:00.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.851+0000 7f4b12ffd700 1 --2- 172.21.15.40:0/2423578116 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4b1409c890 0x7f4b1409cc60 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f4b04009820 tx=0x7f4b04009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3422a9c9cee82b2b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:00.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.852+0000 7f4b11ffb700 1 -- 172.21.15.40:0/2423578116 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b04005e30 con 0x7f4b1409c890 2023-09-30T22:28:00.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.852+0000 7f4b11ffb700 1 -- 172.21.15.40:0/2423578116 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b04006030 con 0x7f4b1409c890 2023-09-30T22:28:00.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.852+0000 7f4b11ffb700 1 -- 172.21.15.40:0/2423578116 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b040063c0 con 0x7f4b1409c890 2023-09-30T22:28:00.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.852+0000 7f4b194d4700 1 -- 172.21.15.40:0/2423578116 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4b1409c890 msgr2=0x7f4b1409cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:00.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.852+0000 7f4b194d4700 1 --2- 172.21.15.40:0/2423578116 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4b1409c890 0x7f4b1409cc60 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f4b04009820 tx=0x7f4b04009b30 comp rx=0 tx=0).stop 2023-09-30T22:28:00.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.852+0000 7f4b194d4700 1 -- 172.21.15.40:0/2423578116 shutdown_connections 2023-09-30T22:28:00.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.852+0000 7f4b194d4700 1 --2- 172.21.15.40:0/2423578116 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4b1409c890 0x7f4b1409cc60 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.852+0000 7f4b194d4700 1 --2- 172.21.15.40:0/2423578116 >> v2:172.21.15.40:3300/0 conn(0x7f4b1409d920 0x7f4b1409dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.852+0000 7f4b194d4700 1 -- 172.21.15.40:0/2423578116 >> 172.21.15.40:0/2423578116 conn(0x7f4b140a7080 msgr2=0x7f4b140a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:00.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.852+0000 7f4b194d4700 1 -- 172.21.15.40:0/2423578116 shutdown_connections 2023-09-30T22:28:00.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.852+0000 7f4b194d4700 1 -- 172.21.15.40:0/2423578116 wait complete. 2023-09-30T22:28:00.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.854+0000 7f4b194d4700 1 Processor -- start 2023-09-30T22:28:00.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.854+0000 7f4b194d4700 1 -- start start 2023-09-30T22:28:00.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.854+0000 7f4b194d4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b1409c890 0x7f4b1412d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.854+0000 7f4b194d4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4b1409d920 0x7f4b1412da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.854+0000 7f4b194d4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4b1409e2b0 0x7f4b1412dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.854+0000 7f4b194d4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1412e950 con 0x7f4b1409c890 2023-09-30T22:28:00.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.854+0000 7f4b194d4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b14130fc0 con 0x7f4b1409d920 2023-09-30T22:28:00.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.854+0000 7f4b194d4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b140a5d00 con 0x7f4b1409e2b0 2023-09-30T22:28:00.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.855+0000 7f4b127fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4b1409d920 0x7f4b1412da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.855+0000 7f4b127fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4b1409d920 0x7f4b1412da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39790/0 (socket says 172.21.15.40:39790) 2023-09-30T22:28:00.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.855+0000 7f4b127fc700 1 -- 172.21.15.40:0/1441776886 learned_addr learned my addr 172.21.15.40:0/1441776886 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:00.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.855+0000 7f4b137fe700 1 --2- 172.21.15.40:0/1441776886 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4b1409e2b0 0x7f4b1412dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.855+0000 7f4b12ffd700 1 --2- 172.21.15.40:0/1441776886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b1409c890 0x7f4b1412d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.855+0000 7f4b127fc700 1 -- 172.21.15.40:0/1441776886 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4b1409e2b0 msgr2=0x7f4b1412dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:00.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.855+0000 7f4b127fc700 1 --2- 172.21.15.40:0/1441776886 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4b1409e2b0 0x7f4b1412dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.855+0000 7f4b127fc700 1 -- 172.21.15.40:0/1441776886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b1409c890 msgr2=0x7f4b1412d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:00.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.855+0000 7f4b127fc700 1 --2- 172.21.15.40:0/1441776886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b1409c890 0x7f4b1412d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.855+0000 7f4b127fc700 1 -- 172.21.15.40:0/1441776886 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b04009430 con 0x7f4b1409d920 2023-09-30T22:28:00.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.855+0000 7f4b127fc700 1 --2- 172.21.15.40:0/1441776886 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4b1409d920 0x7f4b1412da70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f4b08009ed0 tx=0x7f4b080173b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:00.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.855+0000 7f4afb7fe700 1 -- 172.21.15.40:0/1441776886 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b08017de0 con 0x7f4b1409d920 2023-09-30T22:28:00.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.855+0000 7f4afb7fe700 1 -- 172.21.15.40:0/1441776886 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b08019040 con 0x7f4b1409d920 2023-09-30T22:28:00.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.855+0000 7f4b194d4700 1 -- 172.21.15.40:0/1441776886 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b1409ecf0 con 0x7f4b1409d920 2023-09-30T22:28:00.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.855+0000 7f4afb7fe700 1 -- 172.21.15.40:0/1441776886 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0801f600 con 0x7f4b1409d920 2023-09-30T22:28:00.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.855+0000 7f4b194d4700 1 -- 172.21.15.40:0/1441776886 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b14130750 con 0x7f4b1409d920 2023-09-30T22:28:00.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.856+0000 7f4afb7fe700 1 -- 172.21.15.40:0/1441776886 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4b0801f760 con 0x7f4b1409d920 2023-09-30T22:28:00.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.856+0000 7f4afb7fe700 1 -- 172.21.15.40:0/1441776886 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4b080477b0 con 0x7f4b1409d920 2023-09-30T22:28:00.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.857+0000 7f4b194d4700 1 -- 172.21.15.40:0/1441776886 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b14062380 con 0x7f4b1409d920 2023-09-30T22:28:00.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.861+0000 7f4afb7fe700 1 -- 172.21.15.40:0/1441776886 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b08024020 con 0x7f4b1409d920 2023-09-30T22:28:00.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.911+0000 7f6f2596f700 1 Processor -- start 2023-09-30T22:28:00.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.911+0000 7f6f2596f700 1 -- start start 2023-09-30T22:28:00.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.911+0000 7f6f2596f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6f20136bf0 0x7f6f20138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.911+0000 7f6f2596f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6f20139510 0x7f6f2013b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.911+0000 7f6f2596f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f200a2600 con 0x7f6f2009c890 2023-09-30T22:28:00.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.911+0000 7f6f2596f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f200a29d0 con 0x7f6f20136bf0 2023-09-30T22:28:00.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.911+0000 7f6f2596f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2009fb40 con 0x7f6f20139510 2023-09-30T22:28:00.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.911+0000 7f6f1e7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6f20136bf0 0x7f6f20138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.911+0000 7f6f1e7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6f20136bf0 0x7f6f20138fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41278/0 (socket says 172.21.15.40:41278) 2023-09-30T22:28:00.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.911+0000 7f6f1e7fc700 1 -- 172.21.15.40:0/3278418789 learned_addr learned my addr 172.21.15.40:0/3278418789 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:00.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.911+0000 7f6f1f7fe700 1 --2- 172.21.15.40:0/3278418789 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6f20139510 0x7f6f2013b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.912+0000 7f6f1e7fc700 1 -- 172.21.15.40:0/3278418789 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6f20139510 msgr2=0x7f6f2013b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:00.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.912+0000 7f6f1e7fc700 1 --2- 172.21.15.40:0/3278418789 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6f20139510 0x7f6f2013b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.912+0000 7f6f1e7fc700 1 -- 172.21.15.40:0/3278418789 >> v1:172.21.15.40:6789/0 conn(0x7f6f2009c890 legacy=0x7f6f2009cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:00.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.912+0000 7f6f1e7fc700 1 -- 172.21.15.40:0/3278418789 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f2009d370 con 0x7f6f20136bf0 2023-09-30T22:28:00.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.912+0000 7f6f1f7fe700 1 --2- 172.21.15.40:0/3278418789 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6f20139510 0x7f6f2013b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:00.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.912+0000 7f6f1e7fc700 1 --2- 172.21.15.40:0/3278418789 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f20136bf0 0x7f6f20138fd0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f6f140098f0 tx=0x7f6f14009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b730eb957cb462d0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:00.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.912+0000 7f6f1dffb700 1 -- 172.21.15.40:0/3278418789 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f14011830 con 0x7f6f20136bf0 2023-09-30T22:28:00.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.912+0000 7f6f1dffb700 1 -- 172.21.15.40:0/3278418789 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f14011990 con 0x7f6f20136bf0 2023-09-30T22:28:00.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.912+0000 7f6f1dffb700 1 -- 172.21.15.40:0/3278418789 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f14011d20 con 0x7f6f20136bf0 2023-09-30T22:28:00.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.913+0000 7f6f2596f700 1 -- 172.21.15.40:0/3278418789 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f20136bf0 msgr2=0x7f6f20138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:00.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.913+0000 7f6f2596f700 1 --2- 172.21.15.40:0/3278418789 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f20136bf0 0x7f6f20138fd0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f6f140098f0 tx=0x7f6f14009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:00.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.913+0000 7f6f2596f700 1 -- 172.21.15.40:0/3278418789 shutdown_connections 2023-09-30T22:28:00.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.913+0000 7f6f2596f700 1 --2- 172.21.15.40:0/3278418789 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6f20139510 0x7f6f2013b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.913+0000 7f6f2596f700 1 --2- 172.21.15.40:0/3278418789 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f20136bf0 0x7f6f20138fd0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.913+0000 7f6f2596f700 1 -- 172.21.15.40:0/3278418789 >> 172.21.15.40:0/3278418789 conn(0x7f6f200a7080 msgr2=0x7f6f200a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:00.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.913+0000 7f6f2596f700 1 -- 172.21.15.40:0/3278418789 shutdown_connections 2023-09-30T22:28:00.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.913+0000 7f6f2596f700 1 -- 172.21.15.40:0/3278418789 wait complete. 2023-09-30T22:28:00.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.914+0000 7f6f2596f700 1 Processor -- start 2023-09-30T22:28:00.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.914+0000 7f6f2596f700 1 -- start start 2023-09-30T22:28:00.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.914+0000 7f6f2596f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f2009c890 0x7f6f2006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.914+0000 7f6f2596f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f20136bf0 0x7f6f2006f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.914+0000 7f6f2596f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6f20139510 0x7f6f2006fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.914+0000 7f6f2596f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f200717d0 con 0x7f6f2009c890 2023-09-30T22:28:00.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.914+0000 7f6f2596f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f201390e0 con 0x7f6f20136bf0 2023-09-30T22:28:00.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.914+0000 7f6f2596f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2012c1a0 con 0x7f6f20139510 2023-09-30T22:28:00.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.914+0000 7f6f1effd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f2009c890 0x7f6f2006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.914+0000 7f6f1e7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f20136bf0 0x7f6f2006f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.914+0000 7f6f1effd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f2009c890 0x7f6f2006f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41280/0 (socket says 172.21.15.40:41280) 2023-09-30T22:28:00.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.914+0000 7f6f1effd700 1 -- 172.21.15.40:0/1710561854 learned_addr learned my addr 172.21.15.40:0/1710561854 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:00.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.914+0000 7f6f1f7fe700 1 --2- 172.21.15.40:0/1710561854 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6f20139510 0x7f6f2006fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.915+0000 7f6f1effd700 1 -- 172.21.15.40:0/1710561854 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6f20139510 msgr2=0x7f6f2006fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:00.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.915+0000 7f6f1effd700 1 --2- 172.21.15.40:0/1710561854 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6f20139510 0x7f6f2006fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.915+0000 7f6f1effd700 1 -- 172.21.15.40:0/1710561854 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f20136bf0 msgr2=0x7f6f2006f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:00.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.915+0000 7f6f1effd700 1 --2- 172.21.15.40:0/1710561854 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f20136bf0 0x7f6f2006f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.915+0000 7f6f1effd700 1 -- 172.21.15.40:0/1710561854 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f18009a70 con 0x7f6f2009c890 2023-09-30T22:28:00.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.915+0000 7f6f1e7fc700 1 --2- 172.21.15.40:0/1710561854 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f20136bf0 0x7f6f2006f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:00.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.915+0000 7f6f1effd700 1 --2- 172.21.15.40:0/1710561854 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f2009c890 0x7f6f2006f0b0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f6f1000c4d0 tx=0x7f6f1000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:00.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.915+0000 7f6f07fff700 1 -- 172.21.15.40:0/1710561854 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f100054e0 con 0x7f6f2009c890 2023-09-30T22:28:00.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.915+0000 7f6f07fff700 1 -- 172.21.15.40:0/1710561854 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f10003680 con 0x7f6f2009c890 2023-09-30T22:28:00.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.915+0000 7f6f2596f700 1 -- 172.21.15.40:0/1710561854 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f14009550 con 0x7f6f2009c890 2023-09-30T22:28:00.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.915+0000 7f6f07fff700 1 -- 172.21.15.40:0/1710561854 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f10003a30 con 0x7f6f2009c890 2023-09-30T22:28:00.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.915+0000 7f6f2596f700 1 -- 172.21.15.40:0/1710561854 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f20070b60 con 0x7f6f2009c890 2023-09-30T22:28:00.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.916+0000 7f6f07fff700 1 -- 172.21.15.40:0/1710561854 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6f10003b90 con 0x7f6f2009c890 2023-09-30T22:28:00.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.916+0000 7f6f07fff700 1 -- 172.21.15.40:0/1710561854 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6f1003eba0 con 0x7f6f2009c890 2023-09-30T22:28:00.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.916+0000 7f6f2596f700 1 -- 172.21.15.40:0/1710561854 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f20062380 con 0x7f6f2009c890 2023-09-30T22:28:00.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:00.921+0000 7f6f07fff700 1 -- 172.21.15.40:0/1710561854 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6f10017020 con 0x7f6f2009c890 2023-09-30T22:28:01.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.013+0000 7f3dc3bea700 1 -- 172.21.15.40:0/350127042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3dbc127bb0 con 0x7f3dbc06a6d0 2023-09-30T22:28:01.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.013+0000 7f3db27fc700 1 -- 172.21.15.40:0/350127042 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3db8010310 con 0x7f3dbc06a6d0 2023-09-30T22:28:01.014 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:01.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.016+0000 7f3dc3bea700 1 -- 172.21.15.40:0/350127042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3dbc06a6d0 msgr2=0x7f3dbc127130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:01.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.016+0000 7f3dc3bea700 1 --2- 172.21.15.40:0/350127042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3dbc06a6d0 0x7f3dbc127130 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f3db800e7e0 tx=0x7f3db800eaf0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.016+0000 7f3dc3bea700 1 -- 172.21.15.40:0/350127042 shutdown_connections 2023-09-30T22:28:01.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.016+0000 7f3dc3bea700 1 --2- 172.21.15.40:0/350127042 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3dbc13c490 0x7f3dbc1cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.016+0000 7f3dc3bea700 1 --2- 172.21.15.40:0/350127042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3dbc06a6d0 0x7f3dbc127130 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.016+0000 7f3dc3bea700 1 --2- 172.21.15.40:0/350127042 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3dbc09de60 0x7f3dbc127670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.016+0000 7f3dc3bea700 1 -- 172.21.15.40:0/350127042 >> 172.21.15.40:0/350127042 conn(0x7f3dbc09fb20 msgr2=0x7f3dbc13b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:01.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.016+0000 7f3dc3bea700 1 -- 172.21.15.40:0/350127042 shutdown_connections 2023-09-30T22:28:01.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.017+0000 7f3dc3bea700 1 -- 172.21.15.40:0/350127042 wait complete. 2023-09-30T22:28:01.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:01.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.069+0000 7f4b194d4700 1 -- 172.21.15.40:0/1441776886 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4b1412f8a0 con 0x7f4b1409d920 2023-09-30T22:28:01.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.070+0000 7f4afb7fe700 1 -- 172.21.15.40:0/1441776886 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4b0801d8f0 con 0x7f4b1409d920 2023-09-30T22:28:01.070 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:01.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.072+0000 7f4b194d4700 1 -- 172.21.15.40:0/1441776886 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4b1409d920 msgr2=0x7f4b1412da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:01.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.072+0000 7f4b194d4700 1 --2- 172.21.15.40:0/1441776886 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4b1409d920 0x7f4b1412da70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f4b08009ed0 tx=0x7f4b080173b0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.072+0000 7f4b194d4700 1 -- 172.21.15.40:0/1441776886 shutdown_connections 2023-09-30T22:28:01.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.072+0000 7f4b194d4700 1 --2- 172.21.15.40:0/1441776886 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4b1409e2b0 0x7f4b1412dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.072+0000 7f4b194d4700 1 --2- 172.21.15.40:0/1441776886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b1409c890 0x7f4b1412d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.072+0000 7f4b194d4700 1 --2- 172.21.15.40:0/1441776886 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4b1409d920 0x7f4b1412da70 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.072+0000 7f4b194d4700 1 -- 172.21.15.40:0/1441776886 >> 172.21.15.40:0/1441776886 conn(0x7f4b140a7080 msgr2=0x7f4b140a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:01.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.072+0000 7f4b194d4700 1 -- 172.21.15.40:0/1441776886 shutdown_connections 2023-09-30T22:28:01.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.072+0000 7f4b194d4700 1 -- 172.21.15.40:0/1441776886 wait complete. 2023-09-30T22:28:01.085 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:01.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.118+0000 7f6f2596f700 1 -- 172.21.15.40:0/1710561854 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6f2012bf50 con 0x7f6f2009c890 2023-09-30T22:28:01.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.118+0000 7f6f07fff700 1 -- 172.21.15.40:0/1710561854 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6f10003e40 con 0x7f6f2009c890 2023-09-30T22:28:01.119 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:01.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.120+0000 7f6f2596f700 1 -- 172.21.15.40:0/1710561854 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f2009c890 msgr2=0x7f6f2006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:01.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.120+0000 7f6f2596f700 1 --2- 172.21.15.40:0/1710561854 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f2009c890 0x7f6f2006f0b0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f6f1000c4d0 tx=0x7f6f1000c7e0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.120+0000 7f6f2596f700 1 -- 172.21.15.40:0/1710561854 shutdown_connections 2023-09-30T22:28:01.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.120+0000 7f6f2596f700 1 --2- 172.21.15.40:0/1710561854 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6f20139510 0x7f6f2006fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.120+0000 7f6f2596f700 1 --2- 172.21.15.40:0/1710561854 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f2009c890 0x7f6f2006f0b0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.120+0000 7f6f2596f700 1 --2- 172.21.15.40:0/1710561854 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f20136bf0 0x7f6f2006f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.120+0000 7f6f2596f700 1 -- 172.21.15.40:0/1710561854 >> 172.21.15.40:0/1710561854 conn(0x7f6f200a7080 msgr2=0x7f6f20136fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:01.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.121+0000 7f6f2596f700 1 -- 172.21.15.40:0/1710561854 shutdown_connections 2023-09-30T22:28:01.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.121+0000 7f6f2596f700 1 -- 172.21.15.40:0/1710561854 wait complete. 2023-09-30T22:28:01.133 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:01.843 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:01.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.984+0000 7f23989cf700 1 Processor -- start 2023-09-30T22:28:01.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.984+0000 7f23989cf700 1 -- start start 2023-09-30T22:28:01.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.985+0000 7f23989cf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f239409d920 0x7f239409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:01.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.985+0000 7f23989cf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f239409f0f0 0x7f239409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:01.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.985+0000 7f23989cf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2394133ca0 0x7f2394134110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:01.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.985+0000 7f23989cf700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f239406b4c0 con 0x7f239409d920 2023-09-30T22:28:01.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.985+0000 7f23989cf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f239409a8f0 con 0x7f2394133ca0 2023-09-30T22:28:01.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.985+0000 7f23989cf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f239409f940 con 0x7f239409f0f0 2023-09-30T22:28:01.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.985+0000 7f238bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f239409f0f0 0x7f239409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:01.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.985+0000 7f239259c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f239409d920 0x7f239409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:01.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.985+0000 7f2392d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2394133ca0 0x7f2394134110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:01.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.985+0000 7f238bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f239409f0f0 0x7f239409e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:45904/0 (socket says 172.21.15.40:45904) 2023-09-30T22:28:01.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.985+0000 7f239259c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f239409d920 0x7f239409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41290/0 (socket says 172.21.15.40:41290) 2023-09-30T22:28:01.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.985+0000 7f2392d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2394133ca0 0x7f2394134110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39806/0 (socket says 172.21.15.40:39806) 2023-09-30T22:28:01.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.985+0000 7f238bfff700 1 -- 172.21.15.40:0/2322912348 learned_addr learned my addr 172.21.15.40:0/2322912348 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:01.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.985+0000 7f238bfff700 1 -- 172.21.15.40:0/2322912348 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2394133ca0 msgr2=0x7f2394134110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:01.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.985+0000 7f238bfff700 1 --2- 172.21.15.40:0/2322912348 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2394133ca0 0x7f2394134110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.985+0000 7f238bfff700 1 -- 172.21.15.40:0/2322912348 >> v2:172.21.15.40:3300/0 conn(0x7f239409d920 msgr2=0x7f239409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:01.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.985+0000 7f238bfff700 1 --2- 172.21.15.40:0/2322912348 >> v2:172.21.15.40:3300/0 conn(0x7f239409d920 0x7f239409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.986+0000 7f238bfff700 1 -- 172.21.15.40:0/2322912348 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f239409f6e0 con 0x7f239409f0f0 2023-09-30T22:28:01.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.986+0000 7f2392d9d700 1 --2- 172.21.15.40:0/2322912348 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2394133ca0 0x7f2394134110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:01.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.986+0000 7f239259c700 1 --2- 172.21.15.40:0/2322912348 >> v2:172.21.15.40:3300/0 conn(0x7f239409d920 0x7f239409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:01.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.986+0000 7f238bfff700 1 --2- 172.21.15.40:0/2322912348 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f239409f0f0 0x7f239409e230 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f237c009920 tx=0x7f237c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8208ef02291d134 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:01.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.986+0000 7f2391d9b700 1 -- 172.21.15.40:0/2322912348 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c011830 con 0x7f239409f0f0 2023-09-30T22:28:01.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.986+0000 7f2391d9b700 1 -- 172.21.15.40:0/2322912348 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237c011990 con 0x7f239409f0f0 2023-09-30T22:28:01.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.986+0000 7f2391d9b700 1 -- 172.21.15.40:0/2322912348 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c011d20 con 0x7f239409f0f0 2023-09-30T22:28:01.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.986+0000 7f23989cf700 1 -- 172.21.15.40:0/2322912348 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f239409f0f0 msgr2=0x7f239409e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:01.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.986+0000 7f23989cf700 1 --2- 172.21.15.40:0/2322912348 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f239409f0f0 0x7f239409e230 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f237c009920 tx=0x7f237c009c30 comp rx=0 tx=0).stop 2023-09-30T22:28:01.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.986+0000 7f23989cf700 1 -- 172.21.15.40:0/2322912348 shutdown_connections 2023-09-30T22:28:01.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.986+0000 7f23989cf700 1 --2- 172.21.15.40:0/2322912348 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2394133ca0 0x7f2394134110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.986+0000 7f23989cf700 1 --2- 172.21.15.40:0/2322912348 >> v2:172.21.15.40:3300/0 conn(0x7f239409d920 0x7f239409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.986+0000 7f23989cf700 1 --2- 172.21.15.40:0/2322912348 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f239409f0f0 0x7f239409e230 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.986+0000 7f23989cf700 1 -- 172.21.15.40:0/2322912348 >> 172.21.15.40:0/2322912348 conn(0x7f239409fb20 msgr2=0x7f239409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:01.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.986+0000 7f23989cf700 1 -- 172.21.15.40:0/2322912348 shutdown_connections 2023-09-30T22:28:01.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.987+0000 7f23989cf700 1 -- 172.21.15.40:0/2322912348 wait complete. 2023-09-30T22:28:01.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.988+0000 7f23989cf700 1 Processor -- start 2023-09-30T22:28:01.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.988+0000 7f23989cf700 1 -- start start 2023-09-30T22:28:01.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.989+0000 7f23989cf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f239409d920 0x7f2394122b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:01.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.989+0000 7f23989cf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2394133ca0 0x7f23941230b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:01.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.989+0000 7f23989cf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23941235f0 0x7f23941c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:01.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.989+0000 7f23989cf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2394124040 con 0x7f239409d920 2023-09-30T22:28:01.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.989+0000 7f23989cf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23941263b0 con 0x7f23941235f0 2023-09-30T22:28:01.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.989+0000 7f23989cf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2394124890 con 0x7f2394133ca0 2023-09-30T22:28:01.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.989+0000 7f239259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f239409d920 0x7f2394122b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:01.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.989+0000 7f2392d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23941235f0 0x7f23941c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:01.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.989+0000 7f239259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f239409d920 0x7f2394122b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41300/0 (socket says 172.21.15.40:41300) 2023-09-30T22:28:01.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.989+0000 7f239259c700 1 -- 172.21.15.40:0/1305088553 learned_addr learned my addr 172.21.15.40:0/1305088553 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:01.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.989+0000 7f238bfff700 1 --2- 172.21.15.40:0/1305088553 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2394133ca0 0x7f23941230b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:01.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.989+0000 7f2392d9d700 1 -- 172.21.15.40:0/1305088553 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2394133ca0 msgr2=0x7f23941230b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:01.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.989+0000 7f2392d9d700 1 --2- 172.21.15.40:0/1305088553 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2394133ca0 0x7f23941230b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.989+0000 7f2392d9d700 1 -- 172.21.15.40:0/1305088553 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f239409d920 msgr2=0x7f2394122b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:01.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.989+0000 7f2392d9d700 1 --2- 172.21.15.40:0/1305088553 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f239409d920 0x7f2394122b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.989+0000 7f2392d9d700 1 -- 172.21.15.40:0/1305088553 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2384009430 con 0x7f23941235f0 2023-09-30T22:28:01.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.989+0000 7f239259c700 1 --2- 172.21.15.40:0/1305088553 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f239409d920 0x7f2394122b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:01.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.989+0000 7f2392d9d700 1 --2- 172.21.15.40:0/1305088553 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23941235f0 0x7f23941c84e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f238c00efc0 tx=0x7f238c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:01.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.989+0000 7f238affd700 1 -- 172.21.15.40:0/1305088553 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c00ca90 con 0x7f23941235f0 2023-09-30T22:28:01.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.990+0000 7f238affd700 1 -- 172.21.15.40:0/1305088553 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238c00f040 con 0x7f23941235f0 2023-09-30T22:28:01.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.990+0000 7f23989cf700 1 -- 172.21.15.40:0/1305088553 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f238c009a70 con 0x7f23941235f0 2023-09-30T22:28:01.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.990+0000 7f238affd700 1 -- 172.21.15.40:0/1305088553 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c00ce30 con 0x7f23941235f0 2023-09-30T22:28:01.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.990+0000 7f23989cf700 1 -- 172.21.15.40:0/1305088553 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f237c009550 con 0x7f23941235f0 2023-09-30T22:28:01.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.990+0000 7f238affd700 1 -- 172.21.15.40:0/1305088553 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f238c014480 con 0x7f23941235f0 2023-09-30T22:28:01.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.990+0000 7f23989cf700 1 -- 172.21.15.40:0/1305088553 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23941336f0 con 0x7f23941235f0 2023-09-30T22:28:01.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.991+0000 7f238affd700 1 -- 172.21.15.40:0/1305088553 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f238c03fe10 con 0x7f23941235f0 2023-09-30T22:28:01.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:01.995+0000 7f238affd700 1 -- 172.21.15.40:0/1305088553 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f23941336f0 con 0x7f23941235f0 2023-09-30T22:28:02.034 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:02.085 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:02.134 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:02.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.165+0000 7fcdc0306700 1 Processor -- start 2023-09-30T22:28:02.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.165+0000 7fcdc0306700 1 -- start start 2023-09-30T22:28:02.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.165+0000 7fcdc0306700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcdb8133e00 0x7fcdb81341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.165+0000 7fcdc0306700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdb809d400 0x7fcdb809d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.165+0000 7fcdc0306700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdb8133940 con 0x7fcdb809dd70 2023-09-30T22:28:02.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.165+0000 7fcdc0306700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdb809f0d0 con 0x7fcdb8133e00 2023-09-30T22:28:02.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.165+0000 7fcdc0306700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb8133be0 con 0x7fcdb809d400 2023-09-30T22:28:02.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.165+0000 7fcdbd8a1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdb809d400 0x7fcdb809d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.166+0000 7fcdbd8a1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdb809d400 0x7fcdb809d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39824/0 (socket says 172.21.15.40:39824) 2023-09-30T22:28:02.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.166+0000 7fcdbd8a1700 1 -- 172.21.15.40:0/1896964603 learned_addr learned my addr 172.21.15.40:0/1896964603 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:02.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.166+0000 7fcdbe0a2700 1 --2- 172.21.15.40:0/1896964603 >> v2:172.21.15.40:3300/0 conn(0x7fcdb8133e00 0x7fcdb81341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.166+0000 7fcdbd8a1700 1 -- 172.21.15.40:0/1896964603 >> v2:172.21.15.40:3300/0 conn(0x7fcdb8133e00 msgr2=0x7fcdb81341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:02.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.166+0000 7fcdbd8a1700 1 --2- 172.21.15.40:0/1896964603 >> v2:172.21.15.40:3300/0 conn(0x7fcdb8133e00 0x7fcdb81341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.166+0000 7fcdbd8a1700 1 -- 172.21.15.40:0/1896964603 >> v1:172.21.15.40:6789/0 conn(0x7fcdb809dd70 legacy=0x7fcdb813ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:02.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.166+0000 7fcdbd8a1700 1 -- 172.21.15.40:0/1896964603 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb809a860 con 0x7fcdb809d400 2023-09-30T22:28:02.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.166+0000 7fcdbd8a1700 1 --2- 172.21.15.40:0/1896964603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdb809d400 0x7fcdb809d830 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fcda80098f0 tx=0x7fcda8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c09f398d2896c4b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:02.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.166+0000 7fcdbd0a0700 1 -- 172.21.15.40:0/1896964603 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda8011830 con 0x7fcdb809d400 2023-09-30T22:28:02.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.166+0000 7fcdbd0a0700 1 -- 172.21.15.40:0/1896964603 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda8011990 con 0x7fcdb809d400 2023-09-30T22:28:02.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.166+0000 7fcdbd0a0700 1 -- 172.21.15.40:0/1896964603 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda8011d20 con 0x7fcdb809d400 2023-09-30T22:28:02.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.167+0000 7fcdc0306700 1 -- 172.21.15.40:0/1896964603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdb809d400 msgr2=0x7fcdb809d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:02.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.167+0000 7fcdc0306700 1 --2- 172.21.15.40:0/1896964603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdb809d400 0x7fcdb809d830 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fcda80098f0 tx=0x7fcda8009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:02.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.167+0000 7fcdc0306700 1 -- 172.21.15.40:0/1896964603 shutdown_connections 2023-09-30T22:28:02.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.167+0000 7fcdc0306700 1 --2- 172.21.15.40:0/1896964603 >> v2:172.21.15.40:3300/0 conn(0x7fcdb8133e00 0x7fcdb81341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.167+0000 7fcdc0306700 1 --2- 172.21.15.40:0/1896964603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdb809d400 0x7fcdb809d830 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.167+0000 7fcdc0306700 1 -- 172.21.15.40:0/1896964603 >> 172.21.15.40:0/1896964603 conn(0x7fcdb80a2a00 msgr2=0x7fcdb80a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:02.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.167+0000 7fcdc0306700 1 -- 172.21.15.40:0/1896964603 shutdown_connections 2023-09-30T22:28:02.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.167+0000 7fcdc0306700 1 -- 172.21.15.40:0/1896964603 wait complete. 2023-09-30T22:28:02.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.168+0000 7fcdc0306700 1 Processor -- start 2023-09-30T22:28:02.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.168+0000 7fcdc0306700 1 -- start start 2023-09-30T22:28:02.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.169+0000 7fcdc0306700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdb809d400 0x7fcdb811caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.169+0000 7fcdc0306700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdb809dd70 0x7fcdb811d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.169+0000 7fcdc0306700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdb8133e00 0x7fcdb81c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.169+0000 7fcdc0306700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb811e690 con 0x7fcdb8133e00 2023-09-30T22:28:02.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.169+0000 7fcdc0306700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb811fcb0 con 0x7fcdb809d400 2023-09-30T22:28:02.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.169+0000 7fcdc0306700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb811c700 con 0x7fcdb809dd70 2023-09-30T22:28:02.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.169+0000 7fcdbd8a1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdb809dd70 0x7fcdb811d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.169+0000 7fcdbd8a1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdb809dd70 0x7fcdb811d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:45916/0 (socket says 172.21.15.40:45916) 2023-09-30T22:28:02.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.169+0000 7fcdbd8a1700 1 -- 172.21.15.40:0/4173522505 learned_addr learned my addr 172.21.15.40:0/4173522505 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:02.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.169+0000 7fcdbe0a2700 1 --2- 172.21.15.40:0/4173522505 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdb809d400 0x7fcdb811caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.169+0000 7fcdbe8a3700 1 --2- 172.21.15.40:0/4173522505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdb8133e00 0x7fcdb81c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.169+0000 7fcdbe8a3700 1 -- 172.21.15.40:0/4173522505 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdb809dd70 msgr2=0x7fcdb811d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:02.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.169+0000 7fcdbe8a3700 1 --2- 172.21.15.40:0/4173522505 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdb809dd70 0x7fcdb811d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.169+0000 7fcdbe8a3700 1 -- 172.21.15.40:0/4173522505 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdb809d400 msgr2=0x7fcdb811caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:02.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.169+0000 7fcdbe8a3700 1 --2- 172.21.15.40:0/4173522505 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdb809d400 0x7fcdb811caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.169+0000 7fcdbe8a3700 1 -- 172.21.15.40:0/4173522505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda8009550 con 0x7fcdb8133e00 2023-09-30T22:28:02.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.170+0000 7fcdbe8a3700 1 --2- 172.21.15.40:0/4173522505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdb8133e00 0x7fcdb81c8ab0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fcdb000cae0 tx=0x7fcdb000cdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:02.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.170+0000 7fcdaeffd700 1 -- 172.21.15.40:0/4173522505 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb0003c00 con 0x7fcdb8133e00 2023-09-30T22:28:02.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.170+0000 7fcdaeffd700 1 -- 172.21.15.40:0/4173522505 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb0003d60 con 0x7fcdb8133e00 2023-09-30T22:28:02.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.170+0000 7fcdaeffd700 1 -- 172.21.15.40:0/4173522505 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb000aa20 con 0x7fcdb8133e00 2023-09-30T22:28:02.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.170+0000 7fcdc0306700 1 -- 172.21.15.40:0/4173522505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb80a01b0 con 0x7fcdb8133e00 2023-09-30T22:28:02.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.170+0000 7fcdc0306700 1 -- 172.21.15.40:0/4173522505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb811dda0 con 0x7fcdb8133e00 2023-09-30T22:28:02.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.171+0000 7fcdc0306700 1 -- 172.21.15.40:0/4173522505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb8062380 con 0x7fcdb8133e00 2023-09-30T22:28:02.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.172+0000 7fcdaeffd700 1 -- 172.21.15.40:0/4173522505 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcdb000ab80 con 0x7fcdb8133e00 2023-09-30T22:28:02.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.172+0000 7fcdaeffd700 1 -- 172.21.15.40:0/4173522505 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fcdb0040080 con 0x7fcdb8133e00 2023-09-30T22:28:02.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.176+0000 7fcdaeffd700 1 -- 172.21.15.40:0/4173522505 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcdb000ae30 con 0x7fcdb8133e00 2023-09-30T22:28:02.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.192+0000 7f23989cf700 1 -- 172.21.15.40:0/1305088553 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f23941336f0 con 0x7f23941235f0 2023-09-30T22:28:02.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.193+0000 7f238affd700 1 -- 172.21.15.40:0/1305088553 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f23941336f0 con 0x7f23941235f0 2023-09-30T22:28:02.194 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:02.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.195+0000 7f23989cf700 1 -- 172.21.15.40:0/1305088553 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23941235f0 msgr2=0x7f23941c84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:02.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.195+0000 7f23989cf700 1 --2- 172.21.15.40:0/1305088553 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23941235f0 0x7f23941c84e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f238c00efc0 tx=0x7f238c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.195+0000 7f23989cf700 1 -- 172.21.15.40:0/1305088553 shutdown_connections 2023-09-30T22:28:02.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.195+0000 7f23989cf700 1 --2- 172.21.15.40:0/1305088553 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23941235f0 0x7f23941c84e0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.195+0000 7f23989cf700 1 --2- 172.21.15.40:0/1305088553 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f239409d920 0x7f2394122b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.195+0000 7f23989cf700 1 --2- 172.21.15.40:0/1305088553 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2394133ca0 0x7f23941230b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.195+0000 7f23989cf700 1 -- 172.21.15.40:0/1305088553 >> 172.21.15.40:0/1305088553 conn(0x7f239409fb20 msgr2=0x7f23940a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:02.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.195+0000 7f23989cf700 1 -- 172.21.15.40:0/1305088553 shutdown_connections 2023-09-30T22:28:02.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.195+0000 7f23989cf700 1 -- 172.21.15.40:0/1305088553 wait complete. 2023-09-30T22:28:02.209 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:02.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.222+0000 7fc2cfe0c700 1 Processor -- start 2023-09-30T22:28:02.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.222+0000 7fc2cfe0c700 1 -- start start 2023-09-30T22:28:02.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.222+0000 7fc2cfe0c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc2c809c890 0x7fc2c809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.222+0000 7fc2cfe0c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2c809d920 0x7fc2c809dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.223+0000 7fc2cfe0c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2c80a2600 con 0x7fc2c809e2b0 2023-09-30T22:28:02.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.223+0000 7fc2cfe0c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2c80a29d0 con 0x7fc2c809c890 2023-09-30T22:28:02.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.223+0000 7fc2cfe0c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c809fb40 con 0x7fc2c809d920 2023-09-30T22:28:02.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.223+0000 7fc2cdba8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc2c809c890 0x7fc2c809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.223+0000 7fc2cdba8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc2c809c890 0x7fc2c809cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41328/0 (socket says 172.21.15.40:41328) 2023-09-30T22:28:02.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.223+0000 7fc2cdba8700 1 -- 172.21.15.40:0/1448251748 learned_addr learned my addr 172.21.15.40:0/1448251748 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:02.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.223+0000 7fc2cd3a7700 1 --2- 172.21.15.40:0/1448251748 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2c809d920 0x7fc2c809dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.223+0000 7fc2cdba8700 1 -- 172.21.15.40:0/1448251748 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2c809d920 msgr2=0x7fc2c809dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:02.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.223+0000 7fc2cdba8700 1 --2- 172.21.15.40:0/1448251748 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2c809d920 0x7fc2c809dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.223+0000 7fc2cdba8700 1 -- 172.21.15.40:0/1448251748 >> v1:172.21.15.40:6789/0 conn(0x7fc2c809e2b0 legacy=0x7fc2c813ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:02.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.223+0000 7fc2cdba8700 1 -- 172.21.15.40:0/1448251748 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c809e730 con 0x7fc2c809c890 2023-09-30T22:28:02.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.223+0000 7fc2cdba8700 1 --2- 172.21.15.40:0/1448251748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2c809c890 0x7fc2c809cc60 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4006fd0 tx=0x7fc2c4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=899ca2046e317b80 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:02.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.223+0000 7fc2ccba6700 1 -- 172.21.15.40:0/1448251748 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4005e30 con 0x7fc2c809c890 2023-09-30T22:28:02.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.223+0000 7fc2ccba6700 1 -- 172.21.15.40:0/1448251748 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c4004030 con 0x7fc2c809c890 2023-09-30T22:28:02.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.223+0000 7fc2ccba6700 1 -- 172.21.15.40:0/1448251748 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c40043e0 con 0x7fc2c809c890 2023-09-30T22:28:02.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.224+0000 7fc2cfe0c700 1 -- 172.21.15.40:0/1448251748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2c809c890 msgr2=0x7fc2c809cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:02.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.224+0000 7fc2cfe0c700 1 --2- 172.21.15.40:0/1448251748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2c809c890 0x7fc2c809cc60 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4006fd0 tx=0x7fc2c4009bd0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.224+0000 7fc2cfe0c700 1 -- 172.21.15.40:0/1448251748 shutdown_connections 2023-09-30T22:28:02.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.224+0000 7fc2cfe0c700 1 --2- 172.21.15.40:0/1448251748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2c809c890 0x7fc2c809cc60 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.224+0000 7fc2cfe0c700 1 --2- 172.21.15.40:0/1448251748 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2c809d920 0x7fc2c809dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.224+0000 7fc2cfe0c700 1 -- 172.21.15.40:0/1448251748 >> 172.21.15.40:0/1448251748 conn(0x7fc2c80a7080 msgr2=0x7fc2c80a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:02.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.224+0000 7fc2cfe0c700 1 -- 172.21.15.40:0/1448251748 shutdown_connections 2023-09-30T22:28:02.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.224+0000 7fc2cfe0c700 1 -- 172.21.15.40:0/1448251748 wait complete. 2023-09-30T22:28:02.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.225+0000 7fc2cfe0c700 1 Processor -- start 2023-09-30T22:28:02.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.225+0000 7fc2cfe0c700 1 -- start start 2023-09-30T22:28:02.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.226+0000 7fc2cfe0c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc2c809c890 0x7fc2c812d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.226+0000 7fc2cfe0c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2c809d920 0x7fc2c812db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.226+0000 7fc2cfe0c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2c809e2b0 0x7fc2c812e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.226+0000 7fc2cfe0c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c8130eb0 con 0x7fc2c809e2b0 2023-09-30T22:28:02.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.226+0000 7fc2cfe0c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c8131090 con 0x7fc2c809d920 2023-09-30T22:28:02.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.226+0000 7fc2cfe0c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c808fa30 con 0x7fc2c809c890 2023-09-30T22:28:02.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.226+0000 7fc2ce3a9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2c809e2b0 0x7fc2c812e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.226+0000 7fc2cdba8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc2c809c890 0x7fc2c812d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.226+0000 7fc2cd3a7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2c809d920 0x7fc2c812db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.226+0000 7fc2ce3a9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2c809e2b0 0x7fc2c812e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41342/0 (socket says 172.21.15.40:41342) 2023-09-30T22:28:02.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.226+0000 7fc2cdba8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc2c809c890 0x7fc2c812d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:45918/0 (socket says 172.21.15.40:45918) 2023-09-30T22:28:02.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.226+0000 7fc2ce3a9700 1 -- 172.21.15.40:0/763218971 learned_addr learned my addr 172.21.15.40:0/763218971 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:02.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.226+0000 7fc2cd3a7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2c809d920 0x7fc2c812db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:39850/0 (socket says 172.21.15.40:39850) 2023-09-30T22:28:02.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.226+0000 7fc2ce3a9700 1 -- 172.21.15.40:0/763218971 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc2c809c890 msgr2=0x7fc2c812d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:02.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.226+0000 7fc2ce3a9700 1 --2- 172.21.15.40:0/763218971 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc2c809c890 0x7fc2c812d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.226+0000 7fc2ce3a9700 1 -- 172.21.15.40:0/763218971 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2c809d920 msgr2=0x7fc2c812db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:02.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.226+0000 7fc2ce3a9700 1 --2- 172.21.15.40:0/763218971 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2c809d920 0x7fc2c812db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.226+0000 7fc2ce3a9700 1 -- 172.21.15.40:0/763218971 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c4009500 con 0x7fc2c809e2b0 2023-09-30T22:28:02.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.226+0000 7fc2cdba8700 1 --2- 172.21.15.40:0/763218971 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc2c809c890 0x7fc2c812d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:02.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.226+0000 7fc2cd3a7700 1 --2- 172.21.15.40:0/763218971 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2c809d920 0x7fc2c812db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:02.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.226+0000 7fc2ce3a9700 1 --2- 172.21.15.40:0/763218971 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2c809e2b0 0x7fc2c812e080 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fc2c000cc80 tx=0x7fc2c000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:02.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.226+0000 7fc2be7fc700 1 -- 172.21.15.40:0/763218971 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c0003c00 con 0x7fc2c809e2b0 2023-09-30T22:28:02.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.226+0000 7fc2be7fc700 1 -- 172.21.15.40:0/763218971 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c0003d60 con 0x7fc2c809e2b0 2023-09-30T22:28:02.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.227+0000 7fc2cfe0c700 1 -- 172.21.15.40:0/763218971 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2c80a5d60 con 0x7fc2c809e2b0 2023-09-30T22:28:02.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.227+0000 7fc2be7fc700 1 -- 172.21.15.40:0/763218971 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c000aaa0 con 0x7fc2c809e2b0 2023-09-30T22:28:02.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.227+0000 7fc2cfe0c700 1 -- 172.21.15.40:0/763218971 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2c812f180 con 0x7fc2c809e2b0 2023-09-30T22:28:02.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.228+0000 7fc2be7fc700 1 -- 172.21.15.40:0/763218971 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc2c000ac00 con 0x7fc2c809e2b0 2023-09-30T22:28:02.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.228+0000 7fc2cfe0c700 1 -- 172.21.15.40:0/763218971 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2c8130cd0 con 0x7fc2c809e2b0 2023-09-30T22:28:02.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.228+0000 7fc2be7fc700 1 -- 172.21.15.40:0/763218971 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc2c003f670 con 0x7fc2c809e2b0 2023-09-30T22:28:02.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.232+0000 7fc2be7fc700 1 -- 172.21.15.40:0/763218971 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc2c00198f0 con 0x7fc2c809e2b0 2023-09-30T22:28:02.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.298+0000 7fd4ddd9d700 1 Processor -- start 2023-09-30T22:28:02.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.298+0000 7fd4ddd9d700 1 -- start start 2023-09-30T22:28:02.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.299+0000 7fd4ddd9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd4d809c890 0x7fd4d809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.299+0000 7fd4ddd9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd4d809d920 0x7fd4d809dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.299+0000 7fd4ddd9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd4d809e2b0 0x7fd4d813ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.299+0000 7fd4ddd9d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4d80a29d0 con 0x7fd4d809c890 2023-09-30T22:28:02.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.299+0000 7fd4ddd9d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d809fb40 con 0x7fd4d809e2b0 2023-09-30T22:28:02.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.299+0000 7fd4ddd9d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d80a2600 con 0x7fd4d809d920 2023-09-30T22:28:02.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.299+0000 7fd4d6ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd4d809d920 0x7fd4d809dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.299+0000 7fd4d6ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd4d809d920 0x7fd4d809dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:45924/0 (socket says 172.21.15.40:45924) 2023-09-30T22:28:02.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.299+0000 7fd4d6ffd700 1 -- 172.21.15.40:0/2189401955 learned_addr learned my addr 172.21.15.40:0/2189401955 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:02.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.299+0000 7fd4d77fe700 1 --2- 172.21.15.40:0/2189401955 >> v2:172.21.15.40:3300/0 conn(0x7fd4d809c890 0x7fd4d809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.299+0000 7fd4d7fff700 1 --2- 172.21.15.40:0/2189401955 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd4d809e2b0 0x7fd4d813ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.299+0000 7fd4d6ffd700 1 -- 172.21.15.40:0/2189401955 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd4d809e2b0 msgr2=0x7fd4d813ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:02.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.299+0000 7fd4d6ffd700 1 --2- 172.21.15.40:0/2189401955 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd4d809e2b0 0x7fd4d813ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.299+0000 7fd4d6ffd700 1 -- 172.21.15.40:0/2189401955 >> v2:172.21.15.40:3300/0 conn(0x7fd4d809c890 msgr2=0x7fd4d809cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:02.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.299+0000 7fd4d6ffd700 1 --2- 172.21.15.40:0/2189401955 >> v2:172.21.15.40:3300/0 conn(0x7fd4d809c890 0x7fd4d809cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.299+0000 7fd4d6ffd700 1 -- 172.21.15.40:0/2189401955 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d809fed0 con 0x7fd4d809d920 2023-09-30T22:28:02.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.299+0000 7fd4d6ffd700 1 --2- 172.21.15.40:0/2189401955 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd4d809d920 0x7fd4d809dd70 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc0098f0 tx=0x7fd4cc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3abf2d20cf8ffe7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:02.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.299+0000 7fd4d67fc700 1 -- 172.21.15.40:0/2189401955 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc011830 con 0x7fd4d809d920 2023-09-30T22:28:02.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.300+0000 7fd4d67fc700 1 -- 172.21.15.40:0/2189401955 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4cc011990 con 0x7fd4d809d920 2023-09-30T22:28:02.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.300+0000 7fd4d67fc700 1 -- 172.21.15.40:0/2189401955 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc011d20 con 0x7fd4d809d920 2023-09-30T22:28:02.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.300+0000 7fd4ddd9d700 1 -- 172.21.15.40:0/2189401955 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd4d809d920 msgr2=0x7fd4d809dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:02.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.300+0000 7fd4ddd9d700 1 --2- 172.21.15.40:0/2189401955 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd4d809d920 0x7fd4d809dd70 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc0098f0 tx=0x7fd4cc009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:02.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.300+0000 7fd4ddd9d700 1 -- 172.21.15.40:0/2189401955 shutdown_connections 2023-09-30T22:28:02.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.300+0000 7fd4ddd9d700 1 --2- 172.21.15.40:0/2189401955 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd4d809e2b0 0x7fd4d813ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.300+0000 7fd4ddd9d700 1 --2- 172.21.15.40:0/2189401955 >> v2:172.21.15.40:3300/0 conn(0x7fd4d809c890 0x7fd4d809cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.300+0000 7fd4ddd9d700 1 --2- 172.21.15.40:0/2189401955 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd4d809d920 0x7fd4d809dd70 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.300+0000 7fd4ddd9d700 1 -- 172.21.15.40:0/2189401955 >> 172.21.15.40:0/2189401955 conn(0x7fd4d80a7080 msgr2=0x7fd4d80a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:02.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.300+0000 7fd4ddd9d700 1 -- 172.21.15.40:0/2189401955 shutdown_connections 2023-09-30T22:28:02.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.300+0000 7fd4ddd9d700 1 -- 172.21.15.40:0/2189401955 wait complete. 2023-09-30T22:28:02.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.301+0000 7fd4ddd9d700 1 Processor -- start 2023-09-30T22:28:02.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.301+0000 7fd4ddd9d700 1 -- start start 2023-09-30T22:28:02.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.302+0000 7fd4ddd9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4d809c890 0x7fd4d812d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.302+0000 7fd4ddd9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd4d809d920 0x7fd4d812da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.302+0000 7fd4ddd9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd4d809e2b0 0x7fd4d812df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.302+0000 7fd4ddd9d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d80a5c70 con 0x7fd4d809c890 2023-09-30T22:28:02.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.302+0000 7fd4ddd9d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d81300f0 con 0x7fd4d809e2b0 2023-09-30T22:28:02.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.302+0000 7fd4ddd9d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d812fcc0 con 0x7fd4d809d920 2023-09-30T22:28:02.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.302+0000 7fd4d77fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4d809c890 0x7fd4d812d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.302+0000 7fd4d77fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4d809c890 0x7fd4d812d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41348/0 (socket says 172.21.15.40:41348) 2023-09-30T22:28:02.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.302+0000 7fd4d77fe700 1 -- 172.21.15.40:0/2289555626 learned_addr learned my addr 172.21.15.40:0/2289555626 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:02.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.302+0000 7fd4d6ffd700 1 --2- 172.21.15.40:0/2289555626 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd4d809d920 0x7fd4d812da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.302+0000 7fd4d7fff700 1 --2- 172.21.15.40:0/2289555626 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd4d809e2b0 0x7fd4d812df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.302+0000 7fd4d6ffd700 1 -- 172.21.15.40:0/2289555626 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd4d809e2b0 msgr2=0x7fd4d812df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:02.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.302+0000 7fd4d6ffd700 1 --2- 172.21.15.40:0/2289555626 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd4d809e2b0 0x7fd4d812df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.302+0000 7fd4d6ffd700 1 -- 172.21.15.40:0/2289555626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4d809c890 msgr2=0x7fd4d812d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:02.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.302+0000 7fd4d6ffd700 1 --2- 172.21.15.40:0/2289555626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4d809c890 0x7fd4d812d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.302+0000 7fd4d6ffd700 1 -- 172.21.15.40:0/2289555626 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4cc009550 con 0x7fd4d809d920 2023-09-30T22:28:02.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.302+0000 7fd4d6ffd700 1 --2- 172.21.15.40:0/2289555626 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd4d809d920 0x7fd4d812da40 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc016000 tx=0x7fd4cc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:02.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.302+0000 7fd4bffff700 1 -- 172.21.15.40:0/2289555626 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc004450 con 0x7fd4d809d920 2023-09-30T22:28:02.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.302+0000 7fd4bffff700 1 -- 172.21.15.40:0/2289555626 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4cc0045b0 con 0x7fd4d809d920 2023-09-30T22:28:02.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.303+0000 7fd4ddd9d700 1 -- 172.21.15.40:0/2289555626 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4d8130540 con 0x7fd4d809d920 2023-09-30T22:28:02.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.303+0000 7fd4bffff700 1 -- 172.21.15.40:0/2289555626 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc0038a0 con 0x7fd4d809d920 2023-09-30T22:28:02.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.303+0000 7fd4ddd9d700 1 -- 172.21.15.40:0/2289555626 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d812e4c0 con 0x7fd4d809d920 2023-09-30T22:28:02.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.303+0000 7fd4bffff700 1 -- 172.21.15.40:0/2289555626 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd4cc021020 con 0x7fd4d809d920 2023-09-30T22:28:02.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.304+0000 7fd4bffff700 1 -- 172.21.15.40:0/2289555626 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd4cc040ad0 con 0x7fd4d809d920 2023-09-30T22:28:02.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.304+0000 7fd4ddd9d700 1 -- 172.21.15.40:0/2289555626 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d8130be0 con 0x7fd4d809d920 2023-09-30T22:28:02.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.313+0000 7fd4bffff700 1 -- 172.21.15.40:0/2289555626 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd4cc029020 con 0x7fd4d809d920 2023-09-30T22:28:02.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.418+0000 7fcdc0306700 1 -- 172.21.15.40:0/4173522505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcdb80a34b0 con 0x7fcdb8133e00 2023-09-30T22:28:02.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.418+0000 7fcdaeffd700 1 -- 172.21.15.40:0/4173522505 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcdb001b400 con 0x7fcdb8133e00 2023-09-30T22:28:02.419 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:02.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.421+0000 7fcdc0306700 1 -- 172.21.15.40:0/4173522505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdb8133e00 msgr2=0x7fcdb81c8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:02.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.421+0000 7fcdc0306700 1 --2- 172.21.15.40:0/4173522505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdb8133e00 0x7fcdb81c8ab0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fcdb000cae0 tx=0x7fcdb000cdf0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.421+0000 7fcdc0306700 1 -- 172.21.15.40:0/4173522505 shutdown_connections 2023-09-30T22:28:02.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.421+0000 7fcdc0306700 1 --2- 172.21.15.40:0/4173522505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdb8133e00 0x7fcdb81c8ab0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.421+0000 7fcdc0306700 1 --2- 172.21.15.40:0/4173522505 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdb809d400 0x7fcdb811caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.421+0000 7fcdc0306700 1 --2- 172.21.15.40:0/4173522505 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdb809dd70 0x7fcdb811d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.421+0000 7fcdc0306700 1 -- 172.21.15.40:0/4173522505 >> 172.21.15.40:0/4173522505 conn(0x7fcdb80a2a00 msgr2=0x7fcdb81303c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:02.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.421+0000 7fcdc0306700 1 -- 172.21.15.40:0/4173522505 shutdown_connections 2023-09-30T22:28:02.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.421+0000 7fcdc0306700 1 -- 172.21.15.40:0/4173522505 wait complete. 2023-09-30T22:28:02.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.432+0000 7fc2cfe0c700 1 -- 172.21.15.40:0/763218971 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc2c8132240 con 0x7fc2c809e2b0 2023-09-30T22:28:02.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.432+0000 7fc2be7fc700 1 -- 172.21.15.40:0/763218971 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc2c0011380 con 0x7fc2c809e2b0 2023-09-30T22:28:02.433 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:02.433 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:02.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.434+0000 7fc2cfe0c700 1 -- 172.21.15.40:0/763218971 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2c809e2b0 msgr2=0x7fc2c812e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:02.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.434+0000 7fc2cfe0c700 1 --2- 172.21.15.40:0/763218971 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2c809e2b0 0x7fc2c812e080 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fc2c000cc80 tx=0x7fc2c000cf90 comp rx=0 tx=0).stop 2023-09-30T22:28:02.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.434+0000 7fc2cfe0c700 1 -- 172.21.15.40:0/763218971 shutdown_connections 2023-09-30T22:28:02.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.434+0000 7fc2cfe0c700 1 --2- 172.21.15.40:0/763218971 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc2c809c890 0x7fc2c812d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.434+0000 7fc2cfe0c700 1 --2- 172.21.15.40:0/763218971 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2c809e2b0 0x7fc2c812e080 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.434+0000 7fc2cfe0c700 1 --2- 172.21.15.40:0/763218971 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2c809d920 0x7fc2c812db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.434+0000 7fc2cfe0c700 1 -- 172.21.15.40:0/763218971 >> 172.21.15.40:0/763218971 conn(0x7fc2c80a7080 msgr2=0x7fc2c80a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:02.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.434+0000 7fc2cfe0c700 1 -- 172.21.15.40:0/763218971 shutdown_connections 2023-09-30T22:28:02.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.434+0000 7fc2cfe0c700 1 -- 172.21.15.40:0/763218971 wait complete. 2023-09-30T22:28:02.447 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:02.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.508+0000 7fd4ddd9d700 1 -- 172.21.15.40:0/2289555626 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd4d8062380 con 0x7fd4d809d920 2023-09-30T22:28:02.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.509+0000 7fd4bffff700 1 -- 172.21.15.40:0/2289555626 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd4cc015070 con 0x7fd4d809d920 2023-09-30T22:28:02.509 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:02.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.511+0000 7fd4ddd9d700 1 -- 172.21.15.40:0/2289555626 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd4d809d920 msgr2=0x7fd4d812da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:02.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.511+0000 7fd4ddd9d700 1 --2- 172.21.15.40:0/2289555626 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd4d809d920 0x7fd4d812da40 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc016000 tx=0x7fd4cc004750 comp rx=0 tx=0).stop 2023-09-30T22:28:02.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.511+0000 7fd4ddd9d700 1 -- 172.21.15.40:0/2289555626 shutdown_connections 2023-09-30T22:28:02.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.511+0000 7fd4ddd9d700 1 --2- 172.21.15.40:0/2289555626 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd4d809e2b0 0x7fd4d812df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.511+0000 7fd4ddd9d700 1 --2- 172.21.15.40:0/2289555626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4d809c890 0x7fd4d812d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.511+0000 7fd4ddd9d700 1 --2- 172.21.15.40:0/2289555626 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd4d809d920 0x7fd4d812da40 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.511+0000 7fd4ddd9d700 1 -- 172.21.15.40:0/2289555626 >> 172.21.15.40:0/2289555626 conn(0x7fd4d80a7080 msgr2=0x7fd4d80a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:02.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.511+0000 7fd4ddd9d700 1 -- 172.21.15.40:0/2289555626 shutdown_connections 2023-09-30T22:28:02.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:02.511+0000 7fd4ddd9d700 1 -- 172.21.15.40:0/2289555626 wait complete. 2023-09-30T22:28:02.523 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:03.210 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:03.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.350+0000 7f85971c5700 1 Processor -- start 2023-09-30T22:28:03.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.350+0000 7f85971c5700 1 -- start start 2023-09-30T22:28:03.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.351+0000 7f85971c5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8590131d50 0x7f8590132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.351+0000 7f85971c5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f859009bc50 0x7f859009c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.351+0000 7f85971c5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8590071920 con 0x7f859009c600 2023-09-30T22:28:03.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.351+0000 7f85971c5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f859009cb00 con 0x7f8590131d50 2023-09-30T22:28:03.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.351+0000 7f85971c5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8590132660 con 0x7f859009bc50 2023-09-30T22:28:03.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.351+0000 7f8594f61700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8590131d50 0x7f8590132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.351+0000 7f8587fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f859009bc50 0x7f859009c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.351+0000 7f8594f61700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8590131d50 0x7f8590132120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52618/0 (socket says 172.21.15.40:52618) 2023-09-30T22:28:03.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.351+0000 7f8594f61700 1 -- 172.21.15.40:0/174926060 learned_addr learned my addr 172.21.15.40:0/174926060 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:03.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.352+0000 7f8594f61700 1 -- 172.21.15.40:0/174926060 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f859009bc50 msgr2=0x7f859009c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:03.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.352+0000 7f8594f61700 1 --2- 172.21.15.40:0/174926060 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f859009bc50 0x7f859009c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.352+0000 7f8594f61700 1 -- 172.21.15.40:0/174926060 >> v1:172.21.15.40:6789/0 conn(0x7f859009c600 legacy=0x7f8590138ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.352+0000 7f8594f61700 1 -- 172.21.15.40:0/174926060 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8590131900 con 0x7f8590131d50 2023-09-30T22:28:03.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.352+0000 7f85877fe700 1 -- 172.21.15.40:0/174926060 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 665713586 0 0) 0x7f8590071920 con 0x7f859009c600 2023-09-30T22:28:03.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.352+0000 7f8587fff700 1 --2- 172.21.15.40:0/174926060 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f859009bc50 0x7f859009c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:03.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.352+0000 7f8594f61700 1 --2- 172.21.15.40:0/174926060 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8590131d50 0x7f8590132120 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f858c009920 tx=0x7f858c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f64a6987c586e815 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:03.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.352+0000 7f85877fe700 1 -- 172.21.15.40:0/174926060 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858c011830 con 0x7f8590131d50 2023-09-30T22:28:03.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.352+0000 7f85877fe700 1 -- 172.21.15.40:0/174926060 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f858c011990 con 0x7f8590131d50 2023-09-30T22:28:03.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.352+0000 7f85877fe700 1 -- 172.21.15.40:0/174926060 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858c011d20 con 0x7f8590131d50 2023-09-30T22:28:03.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.352+0000 7f85971c5700 1 -- 172.21.15.40:0/174926060 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8590131d50 msgr2=0x7f8590132120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.352+0000 7f85971c5700 1 --2- 172.21.15.40:0/174926060 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8590131d50 0x7f8590132120 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f858c009920 tx=0x7f858c009c30 comp rx=0 tx=0).stop 2023-09-30T22:28:03.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.353+0000 7f85971c5700 1 -- 172.21.15.40:0/174926060 shutdown_connections 2023-09-30T22:28:03.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.353+0000 7f85971c5700 1 --2- 172.21.15.40:0/174926060 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8590131d50 0x7f8590132120 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.353+0000 7f85971c5700 1 --2- 172.21.15.40:0/174926060 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f859009bc50 0x7f859009c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.353+0000 7f85971c5700 1 -- 172.21.15.40:0/174926060 >> 172.21.15.40:0/174926060 conn(0x7f85900a2a00 msgr2=0x7f85900a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:03.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.353+0000 7f85971c5700 1 -- 172.21.15.40:0/174926060 shutdown_connections 2023-09-30T22:28:03.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.353+0000 7f85971c5700 1 -- 172.21.15.40:0/174926060 wait complete. 2023-09-30T22:28:03.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.353+0000 7f85971c5700 1 Processor -- start 2023-09-30T22:28:03.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.354+0000 7f85971c5700 1 -- start start 2023-09-30T22:28:03.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.354+0000 7f85971c5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f859009bc50 0x7f859011e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.354+0000 7f85971c5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f859009c600 0x7f859011e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.354+0000 7f85971c5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8590131d50 0x7f859011eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.354+0000 7f85971c5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85900a2e40 con 0x7f859009bc50 2023-09-30T22:28:03.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.354+0000 7f85971c5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85901212e0 con 0x7f859009c600 2023-09-30T22:28:03.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.354+0000 7f85971c5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8590121bf0 con 0x7f8590131d50 2023-09-30T22:28:03.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.354+0000 7f8587fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f859009c600 0x7f859011e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.354+0000 7f8594f61700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f859009bc50 0x7f859011e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.354+0000 7f8595762700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8590131d50 0x7f859011eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.354+0000 7f8587fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f859009c600 0x7f859011e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52620/0 (socket says 172.21.15.40:52620) 2023-09-30T22:28:03.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.354+0000 7f8587fff700 1 -- 172.21.15.40:0/2418409796 learned_addr learned my addr 172.21.15.40:0/2418409796 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:03.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.355+0000 7f8594f61700 1 -- 172.21.15.40:0/2418409796 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8590131d50 msgr2=0x7f859011eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.355+0000 7f8594f61700 1 --2- 172.21.15.40:0/2418409796 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8590131d50 0x7f859011eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.355+0000 7f8594f61700 1 -- 172.21.15.40:0/2418409796 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f859009c600 msgr2=0x7f859011e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.355+0000 7f8594f61700 1 --2- 172.21.15.40:0/2418409796 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f859009c600 0x7f859011e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.355+0000 7f8594f61700 1 -- 172.21.15.40:0/2418409796 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85800094a0 con 0x7f859009bc50 2023-09-30T22:28:03.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.355+0000 7f8587fff700 1 --2- 172.21.15.40:0/2418409796 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f859009c600 0x7f859011e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:03.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.355+0000 7f8595762700 1 --2- 172.21.15.40:0/2418409796 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8590131d50 0x7f859011eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:03.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.355+0000 7f8594f61700 1 --2- 172.21.15.40:0/2418409796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f859009bc50 0x7f859011e030 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f858c016000 tx=0x7f858c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:03.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.355+0000 7f85857fa700 1 -- 172.21.15.40:0/2418409796 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858c004450 con 0x7f859009bc50 2023-09-30T22:28:03.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.355+0000 7f85857fa700 1 -- 172.21.15.40:0/2418409796 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f858c0045b0 con 0x7f859009bc50 2023-09-30T22:28:03.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.355+0000 7f85971c5700 1 -- 172.21.15.40:0/2418409796 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f858c009550 con 0x7f859009bc50 2023-09-30T22:28:03.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.355+0000 7f85857fa700 1 -- 172.21.15.40:0/2418409796 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858c0038c0 con 0x7f859009bc50 2023-09-30T22:28:03.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.355+0000 7f85971c5700 1 -- 172.21.15.40:0/2418409796 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8590121870 con 0x7f859009bc50 2023-09-30T22:28:03.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.356+0000 7f85857fa700 1 -- 172.21.15.40:0/2418409796 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f858c003a20 con 0x7f859009bc50 2023-09-30T22:28:03.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.356+0000 7f85857fa700 1 -- 172.21.15.40:0/2418409796 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f858c040ad0 con 0x7f859009bc50 2023-09-30T22:28:03.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.356+0000 7f85971c5700 1 -- 172.21.15.40:0/2418409796 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8590062380 con 0x7f859009bc50 2023-09-30T22:28:03.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.361+0000 7f85857fa700 1 -- 172.21.15.40:0/2418409796 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f858c015020 con 0x7f859009bc50 2023-09-30T22:28:03.434 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:03.447 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:03.525 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:03.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.567+0000 7f68cb0ad700 1 Processor -- start 2023-09-30T22:28:03.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.567+0000 7f68cb0ad700 1 -- start start 2023-09-30T22:28:03.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.568+0000 7f68cb0ad700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f68c409d450 0x7f68c409d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.568+0000 7f68cb0ad700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f68c409dd60 0x7f68c41301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.568+0000 7f68cb0ad700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f68c4130700 0x7f68c4130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.568+0000 7f68cb0ad700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c409e8b0 con 0x7f68c4130700 2023-09-30T22:28:03.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.568+0000 7f68cb0ad700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c409c3b0 con 0x7f68c409dd60 2023-09-30T22:28:03.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.568+0000 7f68cb0ad700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68c409a6b0 con 0x7f68c409d450 2023-09-30T22:28:03.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.568+0000 7f68c964a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f68c4130700 0x7f68c4130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.568+0000 7f68c8e49700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f68c409d450 0x7f68c409d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.568+0000 7f68c964a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f68c4130700 0x7f68c4130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39222/0 (socket says 172.21.15.40:39222) 2023-09-30T22:28:03.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.568+0000 7f68c964a700 1 -- 172.21.15.40:0/2571015147 learned_addr learned my addr 172.21.15.40:0/2571015147 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:03.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.568+0000 7f68c964a700 1 -- 172.21.15.40:0/2571015147 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f68c409d450 msgr2=0x7f68c409d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:03.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.568+0000 7f68c964a700 1 --2- 172.21.15.40:0/2571015147 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f68c409d450 0x7f68c409d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.568+0000 7f68c964a700 1 -- 172.21.15.40:0/2571015147 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f68c409dd60 msgr2=0x7f68c41301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:03.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.568+0000 7f68c964a700 1 --2- 172.21.15.40:0/2571015147 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f68c409dd60 0x7f68c41301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.568+0000 7f68c964a700 1 -- 172.21.15.40:0/2571015147 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c409b4f0 con 0x7f68c4130700 2023-09-30T22:28:03.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.568+0000 7f68c8e49700 1 --2- 172.21.15.40:0/2571015147 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f68c409d450 0x7f68c409d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:03.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.569+0000 7f68c964a700 1 --2- 172.21.15.40:0/2571015147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68c4130700 0x7f68c4130ba0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009e50 tx=0x7f68bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d71cd5c86fbed299 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:03.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.569+0000 7f68c37fe700 1 -- 172.21.15.40:0/2571015147 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68bc00e070 con 0x7f68c4130700 2023-09-30T22:28:03.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.569+0000 7f68c37fe700 1 -- 172.21.15.40:0/2571015147 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68bc00b910 con 0x7f68c4130700 2023-09-30T22:28:03.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.569+0000 7f68c37fe700 1 -- 172.21.15.40:0/2571015147 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68bc00bcc0 con 0x7f68c4130700 2023-09-30T22:28:03.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.569+0000 7f85971c5700 1 -- 172.21.15.40:0/2418409796 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8590074330 con 0x7f859009bc50 2023-09-30T22:28:03.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.570+0000 7f68cb0ad700 1 -- 172.21.15.40:0/2571015147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68c4130700 msgr2=0x7f68c4130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.570+0000 7f68cb0ad700 1 --2- 172.21.15.40:0/2571015147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68c4130700 0x7f68c4130ba0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009e50 tx=0x7f68bc00b330 comp rx=0 tx=0).stop 2023-09-30T22:28:03.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.570+0000 7f85857fa700 1 -- 172.21.15.40:0/2418409796 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f858c022390 con 0x7f859009bc50 2023-09-30T22:28:03.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.570+0000 7f68cb0ad700 1 -- 172.21.15.40:0/2571015147 shutdown_connections 2023-09-30T22:28:03.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.570+0000 7f68cb0ad700 1 --2- 172.21.15.40:0/2571015147 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f68c409d450 0x7f68c409d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.570+0000 7f68cb0ad700 1 --2- 172.21.15.40:0/2571015147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68c4130700 0x7f68c4130ba0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.570+0000 7f68cb0ad700 1 --2- 172.21.15.40:0/2571015147 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f68c409dd60 0x7f68c41301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.570+0000 7f68cb0ad700 1 -- 172.21.15.40:0/2571015147 >> 172.21.15.40:0/2571015147 conn(0x7f68c40a2a00 msgr2=0x7f68c40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:03.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.570+0000 7f68cb0ad700 1 -- 172.21.15.40:0/2571015147 shutdown_connections 2023-09-30T22:28:03.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.570+0000 7f68cb0ad700 1 -- 172.21.15.40:0/2571015147 wait complete. 2023-09-30T22:28:03.574 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:03.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.571+0000 7f68cb0ad700 1 Processor -- start 2023-09-30T22:28:03.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.571+0000 7f68cb0ad700 1 -- start start 2023-09-30T22:28:03.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.572+0000 7f68cb0ad700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f68c409d450 0x7f68c4136570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.572+0000 7f68cb0ad700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68c409dd60 0x7f68c4136ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.572+0000 7f68cb0ad700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f68c4130700 0x7f68c4136ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.572+0000 7f68cb0ad700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c409c5d0 con 0x7f68c409dd60 2023-09-30T22:28:03.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.572+0000 7f68cb0ad700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c41379d0 con 0x7f68c409d450 2023-09-30T22:28:03.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.572+0000 7f68cb0ad700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68c4139db0 con 0x7f68c4130700 2023-09-30T22:28:03.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.572+0000 7f68c964a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f68c4130700 0x7f68c4136ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.572+0000 7f68c964a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f68c4130700 0x7f68c4136ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52458/0 (socket says 172.21.15.40:52458) 2023-09-30T22:28:03.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.572+0000 7f68c964a700 1 -- 172.21.15.40:0/2621054450 learned_addr learned my addr 172.21.15.40:0/2621054450 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:03.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.572+0000 7f68c8e49700 1 --2- 172.21.15.40:0/2621054450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f68c409d450 0x7f68c4136570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.573+0000 7f68c964a700 1 -- 172.21.15.40:0/2621054450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f68c409d450 msgr2=0x7f68c4136570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.573+0000 7f68c964a700 1 --2- 172.21.15.40:0/2621054450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f68c409d450 0x7f68c4136570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.573+0000 7f68c964a700 1 -- 172.21.15.40:0/2621054450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68c409dd60 msgr2=0x7f68c4136ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.573+0000 7f68c964a700 1 --2- 172.21.15.40:0/2621054450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68c409dd60 0x7f68c4136ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.573+0000 7f68c964a700 1 -- 172.21.15.40:0/2621054450 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b80094a0 con 0x7f68c4130700 2023-09-30T22:28:03.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.573+0000 7f68c964a700 1 --2- 172.21.15.40:0/2621054450 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f68c4130700 0x7f68c4136ff0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f68bc00b680 tx=0x7f68bc004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:03.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.573+0000 7f68c17fa700 1 -- 172.21.15.40:0/2621054450 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68bc004040 con 0x7f68c4130700 2023-09-30T22:28:03.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.574+0000 7f85971c5700 1 -- 172.21.15.40:0/2418409796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f859009bc50 msgr2=0x7f859011e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.574+0000 7f85971c5700 1 --2- 172.21.15.40:0/2418409796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f859009bc50 0x7f859011e030 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f858c016000 tx=0x7f858c004750 comp rx=0 tx=0).stop 2023-09-30T22:28:03.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.574+0000 7f85971c5700 1 -- 172.21.15.40:0/2418409796 shutdown_connections 2023-09-30T22:28:03.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.574+0000 7f85971c5700 1 --2- 172.21.15.40:0/2418409796 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8590131d50 0x7f859011eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.574+0000 7f85971c5700 1 --2- 172.21.15.40:0/2418409796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f859009bc50 0x7f859011e030 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.574+0000 7f85971c5700 1 --2- 172.21.15.40:0/2418409796 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f859009c600 0x7f859011e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.574+0000 7f85971c5700 1 -- 172.21.15.40:0/2418409796 >> 172.21.15.40:0/2418409796 conn(0x7f85900a2a00 msgr2=0x7f85900a0900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:03.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.573+0000 7f68c17fa700 1 -- 172.21.15.40:0/2621054450 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68bc0041e0 con 0x7f68c4130700 2023-09-30T22:28:03.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.573+0000 7f68cb0ad700 1 -- 172.21.15.40:0/2621054450 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68bc009b30 con 0x7f68c4130700 2023-09-30T22:28:03.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.573+0000 7f68c17fa700 1 -- 172.21.15.40:0/2621054450 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68bc004590 con 0x7f68c4130700 2023-09-30T22:28:03.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.573+0000 7f68cb0ad700 1 -- 172.21.15.40:0/2621054450 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c4138b30 con 0x7f68c4130700 2023-09-30T22:28:03.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.574+0000 7f85971c5700 1 -- 172.21.15.40:0/2418409796 shutdown_connections 2023-09-30T22:28:03.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.574+0000 7f85971c5700 1 -- 172.21.15.40:0/2418409796 wait complete. 2023-09-30T22:28:03.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.574+0000 7f68cb0ad700 1 -- 172.21.15.40:0/2621054450 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68c4062380 con 0x7f68c4130700 2023-09-30T22:28:03.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.575+0000 7f68c17fa700 1 -- 172.21.15.40:0/2621054450 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f68bc0046f0 con 0x7f68c4130700 2023-09-30T22:28:03.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.575+0000 7f68c17fa700 1 -- 172.21.15.40:0/2621054450 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f68bc040b50 con 0x7f68c4130700 2023-09-30T22:28:03.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.580+0000 7f68c17fa700 1 -- 172.21.15.40:0/2621054450 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f68bc01a740 con 0x7f68c4130700 2023-09-30T22:28:03.593 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:03.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.612+0000 7fcef624a700 1 Processor -- start 2023-09-30T22:28:03.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.612+0000 7fcef624a700 1 -- start start 2023-09-30T22:28:03.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.613+0000 7fcef624a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcef009d920 0x7fcef009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.613+0000 7fcef624a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcef009f0f0 0x7fcef009e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.613+0000 7fcef624a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcef0133ca0 0x7fcef0134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.613+0000 7fcef624a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef006b4c0 con 0x7fcef009f0f0 2023-09-30T22:28:03.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.613+0000 7fcef624a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef009a8f0 con 0x7fcef009d920 2023-09-30T22:28:03.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.613+0000 7fcef624a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcef009f940 con 0x7fcef0133ca0 2023-09-30T22:28:03.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.613+0000 7fceeeffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcef009f0f0 0x7fcef009e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.613+0000 7fceef7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcef009d920 0x7fcef009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.613+0000 7fceeeffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcef009f0f0 0x7fcef009e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39244/0 (socket says 172.21.15.40:39244) 2023-09-30T22:28:03.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.613+0000 7fceef7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcef009d920 0x7fcef009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52642/0 (socket says 172.21.15.40:52642) 2023-09-30T22:28:03.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.613+0000 7fceeeffd700 1 -- 172.21.15.40:0/883339831 learned_addr learned my addr 172.21.15.40:0/883339831 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:03.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.613+0000 7fceeffff700 1 --2- 172.21.15.40:0/883339831 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcef0133ca0 0x7fcef0134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.613+0000 7fceeeffd700 1 -- 172.21.15.40:0/883339831 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcef0133ca0 msgr2=0x7fcef0134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:03.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.614+0000 7fceeeffd700 1 --2- 172.21.15.40:0/883339831 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcef0133ca0 0x7fcef0134140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.614+0000 7fceeeffd700 1 -- 172.21.15.40:0/883339831 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcef009d920 msgr2=0x7fcef009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:03.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.614+0000 7fceeeffd700 1 --2- 172.21.15.40:0/883339831 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcef009d920 0x7fcef009dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.614+0000 7fceeeffd700 1 -- 172.21.15.40:0/883339831 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef009f6e0 con 0x7fcef009f0f0 2023-09-30T22:28:03.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.614+0000 7fceeffff700 1 --2- 172.21.15.40:0/883339831 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcef0133ca0 0x7fcef0134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:03.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.614+0000 7fceef7fe700 1 --2- 172.21.15.40:0/883339831 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcef009d920 0x7fcef009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:03.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.614+0000 7fceeeffd700 1 --2- 172.21.15.40:0/883339831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcef009f0f0 0x7fcef009e230 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fcee4009920 tx=0x7fcee4009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=760c673278666d6e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:03.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.614+0000 7fceee7fc700 1 -- 172.21.15.40:0/883339831 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee4011830 con 0x7fcef009f0f0 2023-09-30T22:28:03.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.614+0000 7fceee7fc700 1 -- 172.21.15.40:0/883339831 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee4011990 con 0x7fcef009f0f0 2023-09-30T22:28:03.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.614+0000 7fceee7fc700 1 -- 172.21.15.40:0/883339831 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee4011d20 con 0x7fcef009f0f0 2023-09-30T22:28:03.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.615+0000 7fcef624a700 1 -- 172.21.15.40:0/883339831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcef009f0f0 msgr2=0x7fcef009e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.615+0000 7fcef624a700 1 --2- 172.21.15.40:0/883339831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcef009f0f0 0x7fcef009e230 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fcee4009920 tx=0x7fcee4009c30 comp rx=0 tx=0).stop 2023-09-30T22:28:03.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.615+0000 7fcef624a700 1 -- 172.21.15.40:0/883339831 shutdown_connections 2023-09-30T22:28:03.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.615+0000 7fcef624a700 1 --2- 172.21.15.40:0/883339831 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcef0133ca0 0x7fcef0134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.615+0000 7fcef624a700 1 --2- 172.21.15.40:0/883339831 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcef009d920 0x7fcef009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.615+0000 7fcef624a700 1 --2- 172.21.15.40:0/883339831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcef009f0f0 0x7fcef009e230 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.615+0000 7fcef624a700 1 -- 172.21.15.40:0/883339831 >> 172.21.15.40:0/883339831 conn(0x7fcef009fb20 msgr2=0x7fcef009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:03.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.615+0000 7fcef624a700 1 -- 172.21.15.40:0/883339831 shutdown_connections 2023-09-30T22:28:03.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.615+0000 7fcef624a700 1 -- 172.21.15.40:0/883339831 wait complete. 2023-09-30T22:28:03.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.616+0000 7fcef624a700 1 Processor -- start 2023-09-30T22:28:03.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.616+0000 7fcef624a700 1 -- start start 2023-09-30T22:28:03.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.617+0000 7fcef624a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcef009d920 0x7fcef01229d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.617+0000 7fcef624a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcef0133ca0 0x7fcef0122f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.617+0000 7fcef624a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcef0123450 0x7fcef01c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.617+0000 7fcef624a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef01262d0 con 0x7fcef0123450 2023-09-30T22:28:03.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.617+0000 7fcef624a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef01264b0 con 0x7fcef0133ca0 2023-09-30T22:28:03.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.617+0000 7fcef624a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcef00a2b60 con 0x7fcef009d920 2023-09-30T22:28:03.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.617+0000 7fceef7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcef009d920 0x7fcef01229d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.617+0000 7fceef7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcef009d920 0x7fcef01229d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52478/0 (socket says 172.21.15.40:52478) 2023-09-30T22:28:03.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.617+0000 7fceef7fe700 1 -- 172.21.15.40:0/3935123324 learned_addr learned my addr 172.21.15.40:0/3935123324 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:03.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.617+0000 7fceeffff700 1 --2- 172.21.15.40:0/3935123324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcef0123450 0x7fcef01c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.617+0000 7fceeeffd700 1 --2- 172.21.15.40:0/3935123324 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcef0133ca0 0x7fcef0122f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.618+0000 7fceef7fe700 1 -- 172.21.15.40:0/3935123324 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcef0133ca0 msgr2=0x7fcef0122f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.618+0000 7fceef7fe700 1 --2- 172.21.15.40:0/3935123324 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcef0133ca0 0x7fcef0122f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.618+0000 7fceef7fe700 1 -- 172.21.15.40:0/3935123324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcef0123450 msgr2=0x7fcef01c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.618+0000 7fceef7fe700 1 --2- 172.21.15.40:0/3935123324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcef0123450 0x7fcef01c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.618+0000 7fceef7fe700 1 -- 172.21.15.40:0/3935123324 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee0009430 con 0x7fcef009d920 2023-09-30T22:28:03.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.618+0000 7fceeffff700 1 --2- 172.21.15.40:0/3935123324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcef0123450 0x7fcef01c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:03.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.618+0000 7fceef7fe700 1 --2- 172.21.15.40:0/3935123324 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcef009d920 0x7fcef01229d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fcee000e960 tx=0x7fcee000ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:03.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.618+0000 7fced7fff700 1 -- 172.21.15.40:0/3935123324 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee00096c0 con 0x7fcef009d920 2023-09-30T22:28:03.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.618+0000 7fced7fff700 1 -- 172.21.15.40:0/3935123324 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee0005a20 con 0x7fcef009d920 2023-09-30T22:28:03.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.618+0000 7fced7fff700 1 -- 172.21.15.40:0/3935123324 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee0005db0 con 0x7fcef009d920 2023-09-30T22:28:03.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.618+0000 7fcef624a700 1 -- 172.21.15.40:0/3935123324 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee8009a70 con 0x7fcef009d920 2023-09-30T22:28:03.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.618+0000 7fcef624a700 1 -- 172.21.15.40:0/3935123324 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee4009550 con 0x7fcef009d920 2023-09-30T22:28:03.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.619+0000 7fced7fff700 1 -- 172.21.15.40:0/3935123324 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcee000c640 con 0x7fcef009d920 2023-09-30T22:28:03.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.619+0000 7fced7fff700 1 -- 172.21.15.40:0/3935123324 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fcee003f860 con 0x7fcef009d920 2023-09-30T22:28:03.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.620+0000 7fcef624a700 1 -- 172.21.15.40:0/3935123324 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcef0062380 con 0x7fcef009d920 2023-09-30T22:28:03.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.624+0000 7fced7fff700 1 -- 172.21.15.40:0/3935123324 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcee0020080 con 0x7fcef009d920 2023-09-30T22:28:03.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.670+0000 7fd719691700 1 Processor -- start 2023-09-30T22:28:03.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.670+0000 7fd719691700 1 -- start start 2023-09-30T22:28:03.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.670+0000 7fd719691700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd71412e590 0x7fd71412e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.670+0000 7fd719691700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd71412eea0 0x7fd71412d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.670+0000 7fd719691700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd71412d6d0 0x7fd71412db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.670+0000 7fd719691700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd71409ca30 con 0x7fd71412d6d0 2023-09-30T22:28:03.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.670+0000 7fd719691700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71409ab70 con 0x7fd71412eea0 2023-09-30T22:28:03.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.670+0000 7fd719691700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd71409bd70 con 0x7fd71412e590 2023-09-30T22:28:03.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.670+0000 7fd7137fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd71412d6d0 0x7fd71412db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.670+0000 7fd712ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd71412e590 0x7fd71412e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.671+0000 7fd7137fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd71412d6d0 0x7fd71412db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39262/0 (socket says 172.21.15.40:39262) 2023-09-30T22:28:03.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.671+0000 7fd7137fe700 1 -- 172.21.15.40:0/2762322296 learned_addr learned my addr 172.21.15.40:0/2762322296 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:03.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.671+0000 7fd7127fc700 1 --2- 172.21.15.40:0/2762322296 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd71412eea0 0x7fd71412d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.671+0000 7fd712ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd71412e590 0x7fd71412e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52486/0 (socket says 172.21.15.40:52486) 2023-09-30T22:28:03.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.671+0000 7fd7137fe700 1 -- 172.21.15.40:0/2762322296 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd71412e590 msgr2=0x7fd71412e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:03.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.671+0000 7fd7137fe700 1 --2- 172.21.15.40:0/2762322296 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd71412e590 0x7fd71412e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.671+0000 7fd7137fe700 1 -- 172.21.15.40:0/2762322296 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd71412eea0 msgr2=0x7fd71412d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:03.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.671+0000 7fd7137fe700 1 --2- 172.21.15.40:0/2762322296 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd71412eea0 0x7fd71412d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.671+0000 7fd7137fe700 1 -- 172.21.15.40:0/2762322296 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71409b270 con 0x7fd71412d6d0 2023-09-30T22:28:03.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.671+0000 7fd7127fc700 1 --2- 172.21.15.40:0/2762322296 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd71412eea0 0x7fd71412d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:03.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.671+0000 7fd712ffd700 1 --2- 172.21.15.40:0/2762322296 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd71412e590 0x7fd71412e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:03.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.671+0000 7fd7137fe700 1 --2- 172.21.15.40:0/2762322296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd71412d6d0 0x7fd71412db70 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fd70c009e50 tx=0x7fd70c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b6968933d15241 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:03.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.671+0000 7fd711ffb700 1 -- 172.21.15.40:0/2762322296 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c00e070 con 0x7fd71412d6d0 2023-09-30T22:28:03.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.671+0000 7fd711ffb700 1 -- 172.21.15.40:0/2762322296 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70c00b910 con 0x7fd71412d6d0 2023-09-30T22:28:03.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.671+0000 7fd711ffb700 1 -- 172.21.15.40:0/2762322296 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c00bcc0 con 0x7fd71412d6d0 2023-09-30T22:28:03.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.672+0000 7fd719691700 1 -- 172.21.15.40:0/2762322296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd71412d6d0 msgr2=0x7fd71412db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.672+0000 7fd719691700 1 --2- 172.21.15.40:0/2762322296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd71412d6d0 0x7fd71412db70 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fd70c009e50 tx=0x7fd70c00b330 comp rx=0 tx=0).stop 2023-09-30T22:28:03.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.672+0000 7fd719691700 1 -- 172.21.15.40:0/2762322296 shutdown_connections 2023-09-30T22:28:03.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.672+0000 7fd719691700 1 --2- 172.21.15.40:0/2762322296 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd71412e590 0x7fd71412e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.672+0000 7fd719691700 1 --2- 172.21.15.40:0/2762322296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd71412d6d0 0x7fd71412db70 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.672+0000 7fd719691700 1 --2- 172.21.15.40:0/2762322296 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd71412eea0 0x7fd71412d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.672+0000 7fd719691700 1 -- 172.21.15.40:0/2762322296 >> 172.21.15.40:0/2762322296 conn(0x7fd7140a2a00 msgr2=0x7fd7140a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:03.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.672+0000 7fd719691700 1 -- 172.21.15.40:0/2762322296 shutdown_connections 2023-09-30T22:28:03.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.672+0000 7fd719691700 1 -- 172.21.15.40:0/2762322296 wait complete. 2023-09-30T22:28:03.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.673+0000 7fd719691700 1 Processor -- start 2023-09-30T22:28:03.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.673+0000 7fd719691700 1 -- start start 2023-09-30T22:28:03.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.674+0000 7fd719691700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd71412d6d0 0x7fd714139180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.674+0000 7fd719691700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd71412e590 0x7fd714137860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.674+0000 7fd719691700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd71412eea0 0x7fd714137da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.674+0000 7fd719691700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7140a0be0 con 0x7fd71412e590 2023-09-30T22:28:03.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.674+0000 7fd719691700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71409b520 con 0x7fd71412eea0 2023-09-30T22:28:03.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.674+0000 7fd719691700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7141396c0 con 0x7fd71412d6d0 2023-09-30T22:28:03.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.674+0000 7fd712ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd71412d6d0 0x7fd714139180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.674+0000 7fd7137fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd71412eea0 0x7fd714137da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.674+0000 7fd7137fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd71412eea0 0x7fd714137da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52674/0 (socket says 172.21.15.40:52674) 2023-09-30T22:28:03.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.674+0000 7fd712ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd71412d6d0 0x7fd714139180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52502/0 (socket says 172.21.15.40:52502) 2023-09-30T22:28:03.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.674+0000 7fd7137fe700 1 -- 172.21.15.40:0/2071018854 learned_addr learned my addr 172.21.15.40:0/2071018854 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:03.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.674+0000 7fd7137fe700 1 -- 172.21.15.40:0/2071018854 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd71412d6d0 msgr2=0x7fd714139180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.674+0000 7fd7137fe700 1 --2- 172.21.15.40:0/2071018854 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd71412d6d0 0x7fd714139180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.674+0000 7fd7137fe700 1 -- 172.21.15.40:0/2071018854 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd71412e590 msgr2=0x7fd714137860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.674+0000 7fd7137fe700 1 --2- 172.21.15.40:0/2071018854 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd71412e590 0x7fd714137860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.674+0000 7fd7137fe700 1 -- 172.21.15.40:0/2071018854 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7040094a0 con 0x7fd71412eea0 2023-09-30T22:28:03.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.674+0000 7fd7137fe700 1 --2- 172.21.15.40:0/2071018854 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd71412eea0 0x7fd714137da0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd71412e140 tx=0x7fd70c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:03.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.675+0000 7fd6fb7fe700 1 -- 172.21.15.40:0/2071018854 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c00ce80 con 0x7fd71412eea0 2023-09-30T22:28:03.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.675+0000 7fd6fb7fe700 1 -- 172.21.15.40:0/2071018854 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70c004250 con 0x7fd71412eea0 2023-09-30T22:28:03.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.675+0000 7fd719691700 1 -- 172.21.15.40:0/2071018854 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7080094a0 con 0x7fd71412eea0 2023-09-30T22:28:03.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.675+0000 7fd6fb7fe700 1 -- 172.21.15.40:0/2071018854 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c004600 con 0x7fd71412eea0 2023-09-30T22:28:03.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.675+0000 7fd719691700 1 -- 172.21.15.40:0/2071018854 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd70c009b30 con 0x7fd71412eea0 2023-09-30T22:28:03.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.676+0000 7fd6fb7fe700 1 -- 172.21.15.40:0/2071018854 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd70c004760 con 0x7fd71412eea0 2023-09-30T22:28:03.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.676+0000 7fd6fb7fe700 1 -- 172.21.15.40:0/2071018854 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd70c040da0 con 0x7fd71412eea0 2023-09-30T22:28:03.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.676+0000 7fd719691700 1 -- 172.21.15.40:0/2071018854 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd714062380 con 0x7fd71412eea0 2023-09-30T22:28:03.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.681+0000 7fd6fb7fe700 1 -- 172.21.15.40:0/2071018854 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd70c0117a0 con 0x7fd71412eea0 2023-09-30T22:28:03.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.828+0000 7fcef624a700 1 -- 172.21.15.40:0/3935123324 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcef0124640 con 0x7fcef009d920 2023-09-30T22:28:03.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.828+0000 7fced7fff700 1 -- 172.21.15.40:0/3935123324 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcee00117c0 con 0x7fcef009d920 2023-09-30T22:28:03.829 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:03.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.830+0000 7fcef624a700 1 -- 172.21.15.40:0/3935123324 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcef009d920 msgr2=0x7fcef01229d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.830+0000 7fcef624a700 1 --2- 172.21.15.40:0/3935123324 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcef009d920 0x7fcef01229d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fcee000e960 tx=0x7fcee000ec70 comp rx=0 tx=0).stop 2023-09-30T22:28:03.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.830+0000 7fcef624a700 1 -- 172.21.15.40:0/3935123324 shutdown_connections 2023-09-30T22:28:03.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.830+0000 7fcef624a700 1 --2- 172.21.15.40:0/3935123324 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcef009d920 0x7fcef01229d0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.830+0000 7fcef624a700 1 --2- 172.21.15.40:0/3935123324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcef0123450 0x7fcef01c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.830+0000 7fcef624a700 1 --2- 172.21.15.40:0/3935123324 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcef0133ca0 0x7fcef0122f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.830+0000 7fcef624a700 1 -- 172.21.15.40:0/3935123324 >> 172.21.15.40:0/3935123324 conn(0x7fcef009fb20 msgr2=0x7fcef00a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:03.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.830+0000 7fcef624a700 1 -- 172.21.15.40:0/3935123324 shutdown_connections 2023-09-30T22:28:03.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.831+0000 7fcef624a700 1 -- 172.21.15.40:0/3935123324 wait complete. 2023-09-30T22:28:03.844 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:03.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.845+0000 7f68cb0ad700 1 -- 172.21.15.40:0/2621054450 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f68c4119600 con 0x7f68c4130700 2023-09-30T22:28:03.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.845+0000 7f68c17fa700 1 -- 172.21.15.40:0/2621054450 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f68bc013e20 con 0x7f68c4130700 2023-09-30T22:28:03.846 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:03.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.847+0000 7f68cb0ad700 1 -- 172.21.15.40:0/2621054450 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f68c4130700 msgr2=0x7f68c4136ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.847+0000 7f68cb0ad700 1 --2- 172.21.15.40:0/2621054450 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f68c4130700 0x7f68c4136ff0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f68bc00b680 tx=0x7f68bc004ad0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.847+0000 7f68cb0ad700 1 -- 172.21.15.40:0/2621054450 shutdown_connections 2023-09-30T22:28:03.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.847+0000 7f68cb0ad700 1 --2- 172.21.15.40:0/2621054450 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f68c4130700 0x7f68c4136ff0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.847+0000 7f68cb0ad700 1 --2- 172.21.15.40:0/2621054450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f68c409d450 0x7f68c4136570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.847+0000 7f68cb0ad700 1 --2- 172.21.15.40:0/2621054450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68c409dd60 0x7f68c4136ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.847+0000 7f68cb0ad700 1 -- 172.21.15.40:0/2621054450 >> 172.21.15.40:0/2621054450 conn(0x7f68c40a2a00 msgr2=0x7f68c40a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:03.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.847+0000 7f68cb0ad700 1 -- 172.21.15.40:0/2621054450 shutdown_connections 2023-09-30T22:28:03.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.847+0000 7f68cb0ad700 1 -- 172.21.15.40:0/2621054450 wait complete. 2023-09-30T22:28:03.860 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:03.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.929+0000 7fd719691700 1 -- 172.21.15.40:0/2071018854 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd714074330 con 0x7fd71412eea0 2023-09-30T22:28:03.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.929+0000 7fd6fb7fe700 1 -- 172.21.15.40:0/2071018854 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd70c011390 con 0x7fd71412eea0 2023-09-30T22:28:03.930 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:03.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.931+0000 7fd719691700 1 -- 172.21.15.40:0/2071018854 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd71412eea0 msgr2=0x7fd714137da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.931+0000 7fd719691700 1 --2- 172.21.15.40:0/2071018854 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd71412eea0 0x7fd714137da0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd71412e140 tx=0x7fd70c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.932+0000 7fd719691700 1 -- 172.21.15.40:0/2071018854 shutdown_connections 2023-09-30T22:28:03.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.932+0000 7fd719691700 1 --2- 172.21.15.40:0/2071018854 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd71412d6d0 0x7fd714139180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.932+0000 7fd719691700 1 --2- 172.21.15.40:0/2071018854 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd71412eea0 0x7fd714137da0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.932+0000 7fd719691700 1 --2- 172.21.15.40:0/2071018854 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd71412e590 0x7fd714137860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.932+0000 7fd719691700 1 -- 172.21.15.40:0/2071018854 >> 172.21.15.40:0/2071018854 conn(0x7fd7140a2a00 msgr2=0x7fd714130ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:03.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.932+0000 7fd719691700 1 -- 172.21.15.40:0/2071018854 shutdown_connections 2023-09-30T22:28:03.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:03.932+0000 7fd719691700 1 -- 172.21.15.40:0/2071018854 wait complete. 2023-09-30T22:28:03.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:04.593 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:04.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.736+0000 7fc82a42c700 1 Processor -- start 2023-09-30T22:28:04.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.736+0000 7fc82a42c700 1 -- start start 2023-09-30T22:28:04.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.737+0000 7fc82a42c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc82409d450 0x7fc82409d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.737+0000 7fc82a42c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc8241308d0 0x7fc824138420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.737+0000 7fc82a42c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc82409e8b0 con 0x7fc82409dd60 2023-09-30T22:28:04.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.737+0000 7fc82a42c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82409c3b0 con 0x7fc8241308d0 2023-09-30T22:28:04.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.737+0000 7fc82a42c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc82409a6b0 con 0x7fc82409d450 2023-09-30T22:28:04.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.737+0000 7fc8289c9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc8241308d0 0x7fc824138420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.737+0000 7fc8237fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc82409dd60 0x7fc8241301c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43586/0 (socket says 172.21.15.40:43586) 2023-09-30T22:28:04.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.737+0000 7fc8237fe700 1 -- 172.21.15.40:0/3925699788 learned_addr learned my addr 172.21.15.40:0/3925699788 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:04.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.737+0000 7fc823fff700 1 --2- 172.21.15.40:0/3925699788 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc82409d450 0x7fc82409d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.738+0000 7fc822ffd700 1 -- 172.21.15.40:0/3925699788 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3529902111 0 0) 0x7fc82409e8b0 con 0x7fc82409dd60 2023-09-30T22:28:04.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.738+0000 7fc822ffd700 1 -- 172.21.15.40:0/3925699788 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc80c0035b0 con 0x7fc82409dd60 2023-09-30T22:28:04.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.738+0000 7fc8289c9700 1 -- 172.21.15.40:0/3925699788 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc82409d450 msgr2=0x7fc82409d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:04.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.738+0000 7fc8289c9700 1 --2- 172.21.15.40:0/3925699788 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc82409d450 0x7fc82409d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.738+0000 7fc8289c9700 1 -- 172.21.15.40:0/3925699788 >> v1:172.21.15.40:6789/0 conn(0x7fc82409dd60 legacy=0x7fc8241301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.738+0000 7fc8289c9700 1 -- 172.21.15.40:0/3925699788 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc82409b4f0 con 0x7fc8241308d0 2023-09-30T22:28:04.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.738+0000 7fc823fff700 1 --2- 172.21.15.40:0/3925699788 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc82409d450 0x7fc82409d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:04.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.738+0000 7fc8289c9700 1 --2- 172.21.15.40:0/3925699788 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc8241308d0 0x7fc824138420 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc81c009dc0 tx=0x7fc81c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31304bbc6eb80fbe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:04.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.738+0000 7fc822ffd700 1 -- 172.21.15.40:0/3925699788 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c00e070 con 0x7fc8241308d0 2023-09-30T22:28:04.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.738+0000 7fc822ffd700 1 -- 172.21.15.40:0/3925699788 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81c00bb20 con 0x7fc8241308d0 2023-09-30T22:28:04.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.738+0000 7fc822ffd700 1 -- 172.21.15.40:0/3925699788 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c012430 con 0x7fc8241308d0 2023-09-30T22:28:04.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.739+0000 7fc82a42c700 1 -- 172.21.15.40:0/3925699788 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc8241308d0 msgr2=0x7fc824138420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.739+0000 7fc82a42c700 1 --2- 172.21.15.40:0/3925699788 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc8241308d0 0x7fc824138420 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc81c009dc0 tx=0x7fc81c00b330 comp rx=0 tx=0).stop 2023-09-30T22:28:04.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.739+0000 7fc82a42c700 1 -- 172.21.15.40:0/3925699788 shutdown_connections 2023-09-30T22:28:04.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.739+0000 7fc82a42c700 1 --2- 172.21.15.40:0/3925699788 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc8241308d0 0x7fc824138420 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.739+0000 7fc82a42c700 1 --2- 172.21.15.40:0/3925699788 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc82409d450 0x7fc82409d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.739+0000 7fc82a42c700 1 -- 172.21.15.40:0/3925699788 >> 172.21.15.40:0/3925699788 conn(0x7fc8240a2a00 msgr2=0x7fc8240a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:04.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.739+0000 7fc82a42c700 1 -- 172.21.15.40:0/3925699788 shutdown_connections 2023-09-30T22:28:04.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.739+0000 7fc82a42c700 1 -- 172.21.15.40:0/3925699788 wait complete. 2023-09-30T22:28:04.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.740+0000 7fc82a42c700 1 Processor -- start 2023-09-30T22:28:04.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.740+0000 7fc82a42c700 1 -- start start 2023-09-30T22:28:04.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.741+0000 7fc82a42c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc82409d450 0x7fc82411bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.741+0000 7fc82a42c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc82409dd60 0x7fc82411c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.741+0000 7fc82a42c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8241308d0 0x7fc8241c3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.741+0000 7fc82a42c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82411c6d0 con 0x7fc8241308d0 2023-09-30T22:28:04.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.741+0000 7fc82a42c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82411ee10 con 0x7fc82409dd60 2023-09-30T22:28:04.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.741+0000 7fc82a42c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc82411b740 con 0x7fc82409d450 2023-09-30T22:28:04.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.741+0000 7fc823fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc82409d450 0x7fc82411bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.741+0000 7fc8289c9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8241308d0 0x7fc8241c3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.741+0000 7fc8237fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc82409dd60 0x7fc82411c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.741+0000 7fc823fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc82409d450 0x7fc82411bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52520/0 (socket says 172.21.15.40:52520) 2023-09-30T22:28:04.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.741+0000 7fc823fff700 1 -- 172.21.15.40:0/4049934417 learned_addr learned my addr 172.21.15.40:0/4049934417 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:04.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.741+0000 7fc8289c9700 1 -- 172.21.15.40:0/4049934417 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc82409d450 msgr2=0x7fc82411bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.741+0000 7fc8289c9700 1 --2- 172.21.15.40:0/4049934417 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc82409d450 0x7fc82411bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.741+0000 7fc8289c9700 1 -- 172.21.15.40:0/4049934417 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc82409dd60 msgr2=0x7fc82411c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.741+0000 7fc8289c9700 1 --2- 172.21.15.40:0/4049934417 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc82409dd60 0x7fc82411c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.741+0000 7fc8289c9700 1 -- 172.21.15.40:0/4049934417 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81400a5b0 con 0x7fc8241308d0 2023-09-30T22:28:04.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.741+0000 7fc8237fe700 1 --2- 172.21.15.40:0/4049934417 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc82409dd60 0x7fc82411c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:04.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.741+0000 7fc8289c9700 1 --2- 172.21.15.40:0/4049934417 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8241308d0 0x7fc8241c3f00 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fc81c016000 tx=0x7fc81c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:04.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.742+0000 7fc820ff9700 1 -- 172.21.15.40:0/4049934417 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c020070 con 0x7fc8241308d0 2023-09-30T22:28:04.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.742+0000 7fc820ff9700 1 -- 172.21.15.40:0/4049934417 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81c003e30 con 0x7fc8241308d0 2023-09-30T22:28:04.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.742+0000 7fc82a42c700 1 -- 172.21.15.40:0/4049934417 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc81c009a70 con 0x7fc8241308d0 2023-09-30T22:28:04.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.742+0000 7fc820ff9700 1 -- 172.21.15.40:0/4049934417 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c012430 con 0x7fc8241308d0 2023-09-30T22:28:04.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.742+0000 7fc82a42c700 1 -- 172.21.15.40:0/4049934417 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc82409c5d0 con 0x7fc8241308d0 2023-09-30T22:28:04.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.742+0000 7fc820ff9700 1 -- 172.21.15.40:0/4049934417 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc81c024070 con 0x7fc8241308d0 2023-09-30T22:28:04.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.743+0000 7fc820ff9700 1 -- 172.21.15.40:0/4049934417 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc81c042550 con 0x7fc8241308d0 2023-09-30T22:28:04.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.743+0000 7fc82a42c700 1 -- 172.21.15.40:0/4049934417 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc82411ec50 con 0x7fc8241308d0 2023-09-30T22:28:04.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.748+0000 7fc820ff9700 1 -- 172.21.15.40:0/4049934417 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc82411ec50 con 0x7fc8241308d0 2023-09-30T22:28:04.844 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:04.862 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:04.945 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:04.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.945+0000 7fc82a42c700 1 -- 172.21.15.40:0/4049934417 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc82411ec50 con 0x7fc8241308d0 2023-09-30T22:28:04.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.946+0000 7fc820ff9700 1 -- 172.21.15.40:0/4049934417 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc82411ec50 con 0x7fc8241308d0 2023-09-30T22:28:04.947 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:04.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.948+0000 7fc82a42c700 1 -- 172.21.15.40:0/4049934417 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8241308d0 msgr2=0x7fc8241c3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.948+0000 7fc82a42c700 1 --2- 172.21.15.40:0/4049934417 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8241308d0 0x7fc8241c3f00 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fc81c016000 tx=0x7fc81c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.948+0000 7fc82a42c700 1 -- 172.21.15.40:0/4049934417 shutdown_connections 2023-09-30T22:28:04.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.948+0000 7fc82a42c700 1 --2- 172.21.15.40:0/4049934417 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc82409d450 0x7fc82411bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.948+0000 7fc82a42c700 1 --2- 172.21.15.40:0/4049934417 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8241308d0 0x7fc8241c3f00 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.948+0000 7fc82a42c700 1 --2- 172.21.15.40:0/4049934417 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc82409dd60 0x7fc82411c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.948+0000 7fc82a42c700 1 -- 172.21.15.40:0/4049934417 >> 172.21.15.40:0/4049934417 conn(0x7fc8240a2a00 msgr2=0x7fc8241b7a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:04.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.948+0000 7fc82a42c700 1 -- 172.21.15.40:0/4049934417 shutdown_connections 2023-09-30T22:28:04.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.948+0000 7fc82a42c700 1 -- 172.21.15.40:0/4049934417 wait complete. 2023-09-30T22:28:04.963 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:04.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.977+0000 7fb443d17700 1 Processor -- start 2023-09-30T22:28:04.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.977+0000 7fb443d17700 1 -- start start 2023-09-30T22:28:04.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.978+0000 7fb443d17700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb43c133e00 0x7fb43c1341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.978+0000 7fb443d17700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb43c09df40 0x7fb43c13bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.978+0000 7fb443d17700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb43c133940 con 0x7fb43c09d400 2023-09-30T22:28:04.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.978+0000 7fb443d17700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb43c09f0d0 con 0x7fb43c09df40 2023-09-30T22:28:04.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.978+0000 7fb443d17700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c133be0 con 0x7fb43c133e00 2023-09-30T22:28:04.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.978+0000 7fb441ab3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb43c133e00 0x7fb43c1341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.978+0000 7fb4412b2700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb43c09d400 0x7fb43c09d830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43590/0 (socket says 172.21.15.40:43590) 2023-09-30T22:28:04.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.978+0000 7fb4412b2700 1 -- 172.21.15.40:0/2628833292 learned_addr learned my addr 172.21.15.40:0/2628833292 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:04.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.978+0000 7fb4422b4700 1 --2- 172.21.15.40:0/2628833292 >> v2:172.21.15.40:3300/0 conn(0x7fb43c09df40 0x7fb43c13bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.978+0000 7fb4422b4700 1 -- 172.21.15.40:0/2628833292 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb43c133e00 msgr2=0x7fb43c1341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:04.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.978+0000 7fb4422b4700 1 --2- 172.21.15.40:0/2628833292 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb43c133e00 0x7fb43c1341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.978+0000 7fb4422b4700 1 -- 172.21.15.40:0/2628833292 >> v1:172.21.15.40:6789/0 conn(0x7fb43c09d400 legacy=0x7fb43c09d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.978+0000 7fb440ab1700 1 -- 172.21.15.40:0/2628833292 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 380868564 0 0) 0x7fb43c133940 con 0x7fb43c09d400 2023-09-30T22:28:04.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.978+0000 7fb4422b4700 1 -- 172.21.15.40:0/2628833292 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43c09a860 con 0x7fb43c09df40 2023-09-30T22:28:04.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.978+0000 7fb441ab3700 1 --2- 172.21.15.40:0/2628833292 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb43c133e00 0x7fb43c1341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:04.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.978+0000 7fb4422b4700 1 --2- 172.21.15.40:0/2628833292 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb43c09df40 0x7fb43c13bc80 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fb434009d90 tx=0x7fb43400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d56bf73ff0d6bee server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:04.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.979+0000 7fb440ab1700 1 -- 172.21.15.40:0/2628833292 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43400e070 con 0x7fb43c09df40 2023-09-30T22:28:04.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.979+0000 7fb440ab1700 1 -- 172.21.15.40:0/2628833292 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43400bb20 con 0x7fb43c09df40 2023-09-30T22:28:04.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.979+0000 7fb440ab1700 1 -- 172.21.15.40:0/2628833292 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb434012430 con 0x7fb43c09df40 2023-09-30T22:28:04.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.979+0000 7fb443d17700 1 -- 172.21.15.40:0/2628833292 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb43c09df40 msgr2=0x7fb43c13bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.979+0000 7fb443d17700 1 --2- 172.21.15.40:0/2628833292 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb43c09df40 0x7fb43c13bc80 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fb434009d90 tx=0x7fb43400b330 comp rx=0 tx=0).stop 2023-09-30T22:28:04.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.979+0000 7fb443d17700 1 -- 172.21.15.40:0/2628833292 shutdown_connections 2023-09-30T22:28:04.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.979+0000 7fb443d17700 1 --2- 172.21.15.40:0/2628833292 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb43c09df40 0x7fb43c13bc80 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.979+0000 7fb443d17700 1 --2- 172.21.15.40:0/2628833292 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb43c133e00 0x7fb43c1341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.979+0000 7fb443d17700 1 -- 172.21.15.40:0/2628833292 >> 172.21.15.40:0/2628833292 conn(0x7fb43c0a2a00 msgr2=0x7fb43c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:04.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.980+0000 7fb443d17700 1 -- 172.21.15.40:0/2628833292 shutdown_connections 2023-09-30T22:28:04.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.980+0000 7fb443d17700 1 -- 172.21.15.40:0/2628833292 wait complete. 2023-09-30T22:28:04.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.981+0000 7fb443d17700 1 Processor -- start 2023-09-30T22:28:04.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.981+0000 7fb443d17700 1 -- start start 2023-09-30T22:28:04.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.982+0000 7fb443d17700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb43c09d400 0x7fb43c11aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.982+0000 7fb443d17700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb43c09df40 0x7fb43c11af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.982+0000 7fb443d17700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb43c133e00 0x7fb43c11b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.982+0000 7fb443d17700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c11cb50 con 0x7fb43c09d400 2023-09-30T22:28:04.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.982+0000 7fb443d17700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c11dea0 con 0x7fb43c09df40 2023-09-30T22:28:04.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.982+0000 7fb443d17700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c11c6b0 con 0x7fb43c133e00 2023-09-30T22:28:04.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.982+0000 7fb441ab3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb43c09d400 0x7fb43c11aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.982+0000 7fb441ab3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb43c09d400 0x7fb43c11aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39302/0 (socket says 172.21.15.40:39302) 2023-09-30T22:28:04.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.982+0000 7fb441ab3700 1 -- 172.21.15.40:0/2763878729 learned_addr learned my addr 172.21.15.40:0/2763878729 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:04.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.982+0000 7fb4412b2700 1 --2- 172.21.15.40:0/2763878729 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb43c09df40 0x7fb43c11af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.982+0000 7fb4422b4700 1 --2- 172.21.15.40:0/2763878729 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb43c133e00 0x7fb43c11b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.982+0000 7fb441ab3700 1 -- 172.21.15.40:0/2763878729 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb43c133e00 msgr2=0x7fb43c11b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.982+0000 7fb441ab3700 1 --2- 172.21.15.40:0/2763878729 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb43c133e00 0x7fb43c11b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.982+0000 7fb441ab3700 1 -- 172.21.15.40:0/2763878729 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb43c09df40 msgr2=0x7fb43c11af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.982+0000 7fb441ab3700 1 --2- 172.21.15.40:0/2763878729 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb43c09df40 0x7fb43c11af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.982+0000 7fb441ab3700 1 -- 172.21.15.40:0/2763878729 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4380094a0 con 0x7fb43c09d400 2023-09-30T22:28:04.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.982+0000 7fb4412b2700 1 --2- 172.21.15.40:0/2763878729 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb43c09df40 0x7fb43c11af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:04.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.982+0000 7fb441ab3700 1 --2- 172.21.15.40:0/2763878729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb43c09d400 0x7fb43c11aa50 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fb43800ec10 tx=0x7fb43800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:04.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.983+0000 7fb4327fc700 1 -- 172.21.15.40:0/2763878729 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43800c850 con 0x7fb43c09d400 2023-09-30T22:28:04.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.983+0000 7fb4327fc700 1 -- 172.21.15.40:0/2763878729 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43800c9b0 con 0x7fb43c09d400 2023-09-30T22:28:04.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.983+0000 7fb4327fc700 1 -- 172.21.15.40:0/2763878729 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43800cd20 con 0x7fb43c09d400 2023-09-30T22:28:04.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.983+0000 7fb443d17700 1 -- 172.21.15.40:0/2763878729 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb434009a70 con 0x7fb43c09d400 2023-09-30T22:28:04.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.983+0000 7fb443d17700 1 -- 172.21.15.40:0/2763878729 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb43c11d780 con 0x7fb43c09d400 2023-09-30T22:28:04.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.984+0000 7fb4327fc700 1 -- 172.21.15.40:0/2763878729 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb438013470 con 0x7fb43c09d400 2023-09-30T22:28:04.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.984+0000 7fb4327fc700 1 -- 172.21.15.40:0/2763878729 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb43803fb80 con 0x7fb43c09d400 2023-09-30T22:28:04.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.984+0000 7fb443d17700 1 -- 172.21.15.40:0/2763878729 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb43c11dbd0 con 0x7fb43c09d400 2023-09-30T22:28:04.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:04.989+0000 7fb4327fc700 1 -- 172.21.15.40:0/2763878729 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb43803fe60 con 0x7fb43c09d400 2023-09-30T22:28:05.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.022+0000 7f5442c8e700 1 Processor -- start 2023-09-30T22:28:05.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.022+0000 7f5442c8e700 1 -- start start 2023-09-30T22:28:05.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.023+0000 7f5442c8e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f543c09d920 0x7f543c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.023+0000 7f5442c8e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f543c130fb0 0x7f543c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.023+0000 7f5442c8e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f543c09adf0 con 0x7f543c09e230 2023-09-30T22:28:05.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.023+0000 7f5442c8e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f543c09edf0 con 0x7f543c09d920 2023-09-30T22:28:05.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.023+0000 7f5442c8e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f543c09b660 con 0x7f543c130fb0 2023-09-30T22:28:05.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.023+0000 7f544122b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f543c130fb0 0x7f543c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.023+0000 7f544122b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f543c130fb0 0x7f543c138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52538/0 (socket says 172.21.15.40:52538) 2023-09-30T22:28:05.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.023+0000 7f544122b700 1 -- 172.21.15.40:0/880408867 learned_addr learned my addr 172.21.15.40:0/880408867 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:05.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.023+0000 7f5440a2a700 1 --2- 172.21.15.40:0/880408867 >> v2:172.21.15.40:3300/0 conn(0x7f543c09d920 0x7f543c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.024+0000 7f544122b700 1 -- 172.21.15.40:0/880408867 >> v2:172.21.15.40:3300/0 conn(0x7f543c09d920 msgr2=0x7f543c09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:05.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.024+0000 7f544122b700 1 --2- 172.21.15.40:0/880408867 >> v2:172.21.15.40:3300/0 conn(0x7f543c09d920 0x7f543c09dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.024+0000 7f544122b700 1 -- 172.21.15.40:0/880408867 >> v1:172.21.15.40:6789/0 conn(0x7f543c09e230 legacy=0x7f543c1308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:05.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.024+0000 7f543b7fe700 1 -- 172.21.15.40:0/880408867 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 733134442 0 0) 0x7f543c09adf0 con 0x7f543c09e230 2023-09-30T22:28:05.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.024+0000 7f544122b700 1 -- 172.21.15.40:0/880408867 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543c09a6e0 con 0x7f543c130fb0 2023-09-30T22:28:05.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.024+0000 7f5440a2a700 1 --2- 172.21.15.40:0/880408867 >> v2:172.21.15.40:3300/0 conn(0x7f543c09d920 0x7f543c09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:05.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.024+0000 7f544122b700 1 --2- 172.21.15.40:0/880408867 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f543c130fb0 0x7f543c138d10 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f543400d150 tx=0x7f543400d460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a660a9458e96928 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:05.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.024+0000 7f543b7fe700 1 -- 172.21.15.40:0/880408867 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5434010070 con 0x7f543c130fb0 2023-09-30T22:28:05.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.024+0000 7f543b7fe700 1 -- 172.21.15.40:0/880408867 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543400dd10 con 0x7f543c130fb0 2023-09-30T22:28:05.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.024+0000 7f543b7fe700 1 -- 172.21.15.40:0/880408867 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543400b310 con 0x7f543c130fb0 2023-09-30T22:28:05.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.025+0000 7f5442c8e700 1 -- 172.21.15.40:0/880408867 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f543c130fb0 msgr2=0x7f543c138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:05.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.025+0000 7f5442c8e700 1 --2- 172.21.15.40:0/880408867 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f543c130fb0 0x7f543c138d10 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f543400d150 tx=0x7f543400d460 comp rx=0 tx=0).stop 2023-09-30T22:28:05.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.025+0000 7f5442c8e700 1 -- 172.21.15.40:0/880408867 shutdown_connections 2023-09-30T22:28:05.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.025+0000 7f5442c8e700 1 --2- 172.21.15.40:0/880408867 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f543c130fb0 0x7f543c138d10 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.025+0000 7f5442c8e700 1 --2- 172.21.15.40:0/880408867 >> v2:172.21.15.40:3300/0 conn(0x7f543c09d920 0x7f543c09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.025+0000 7f5442c8e700 1 -- 172.21.15.40:0/880408867 >> 172.21.15.40:0/880408867 conn(0x7f543c09fb20 msgr2=0x7f543c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:05.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.025+0000 7f5442c8e700 1 -- 172.21.15.40:0/880408867 shutdown_connections 2023-09-30T22:28:05.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.025+0000 7f5442c8e700 1 -- 172.21.15.40:0/880408867 wait complete. 2023-09-30T22:28:05.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.026+0000 7f5442c8e700 1 Processor -- start 2023-09-30T22:28:05.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.026+0000 7f5442c8e700 1 -- start start 2023-09-30T22:28:05.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.027+0000 7f5442c8e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f543c09d920 0x7f543c11d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.027+0000 7f5442c8e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f543c09e230 0x7f543c11dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.027+0000 7f5442c8e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f543c130fb0 0x7f543c1c3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.027+0000 7f5442c8e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543c120630 con 0x7f543c130fb0 2023-09-30T22:28:05.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.027+0000 7f5442c8e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f543c12f6d0 con 0x7f543c09e230 2023-09-30T22:28:05.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.027+0000 7f5442c8e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f543c11e1c0 con 0x7f543c09d920 2023-09-30T22:28:05.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.027+0000 7f543bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f543c09e230 0x7f543c11dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.027+0000 7f543bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f543c09e230 0x7f543c11dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52704/0 (socket says 172.21.15.40:52704) 2023-09-30T22:28:05.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.027+0000 7f544122b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f543c130fb0 0x7f543c1c3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.027+0000 7f543bfff700 1 -- 172.21.15.40:0/73926370 learned_addr learned my addr 172.21.15.40:0/73926370 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:05.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.027+0000 7f5440a2a700 1 --2- 172.21.15.40:0/73926370 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f543c09d920 0x7f543c11d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.028+0000 7f544122b700 1 -- 172.21.15.40:0/73926370 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f543c09d920 msgr2=0x7f543c11d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:05.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.028+0000 7f544122b700 1 --2- 172.21.15.40:0/73926370 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f543c09d920 0x7f543c11d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.028+0000 7f544122b700 1 -- 172.21.15.40:0/73926370 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f543c09e230 msgr2=0x7f543c11dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:05.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.028+0000 7f544122b700 1 --2- 172.21.15.40:0/73926370 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f543c09e230 0x7f543c11dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.028+0000 7f544122b700 1 -- 172.21.15.40:0/73926370 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5430009430 con 0x7f543c130fb0 2023-09-30T22:28:05.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.028+0000 7f543bfff700 1 --2- 172.21.15.40:0/73926370 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f543c09e230 0x7f543c11dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:05.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.028+0000 7f544122b700 1 --2- 172.21.15.40:0/73926370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f543c130fb0 0x7f543c1c3d70 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f5434017000 tx=0x7f5434004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:05.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.028+0000 7f54397fa700 1 -- 172.21.15.40:0/73926370 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543400b4c0 con 0x7f543c130fb0 2023-09-30T22:28:05.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.028+0000 7f54397fa700 1 -- 172.21.15.40:0/73926370 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543400aa00 con 0x7f543c130fb0 2023-09-30T22:28:05.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.028+0000 7f54397fa700 1 -- 172.21.15.40:0/73926370 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543400adb0 con 0x7f543c130fb0 2023-09-30T22:28:05.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.029+0000 7f5442c8e700 1 -- 172.21.15.40:0/73926370 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f543400bd40 con 0x7f543c130fb0 2023-09-30T22:28:05.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.029+0000 7f5442c8e700 1 -- 172.21.15.40:0/73926370 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f543c1202e0 con 0x7f543c130fb0 2023-09-30T22:28:05.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.030+0000 7f54397fa700 1 -- 172.21.15.40:0/73926370 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5434004040 con 0x7f543c130fb0 2023-09-30T22:28:05.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.030+0000 7f54397fa700 1 -- 172.21.15.40:0/73926370 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5434042c20 con 0x7f543c130fb0 2023-09-30T22:28:05.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.030+0000 7f5442c8e700 1 -- 172.21.15.40:0/73926370 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f543c062380 con 0x7f543c130fb0 2023-09-30T22:28:05.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.035+0000 7f54397fa700 1 -- 172.21.15.40:0/73926370 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5434013980 con 0x7f543c130fb0 2023-09-30T22:28:05.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.091+0000 7fda9aa06700 1 Processor -- start 2023-09-30T22:28:05.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.092+0000 7fda9aa06700 1 -- start start 2023-09-30T22:28:05.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.092+0000 7fda9aa06700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda9409c890 0x7fda9409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.092+0000 7fda9aa06700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda9409d920 0x7fda9409dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.092+0000 7fda9aa06700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda940a2600 con 0x7fda9409e2b0 2023-09-30T22:28:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.092+0000 7fda9aa06700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda940a29d0 con 0x7fda9409c890 2023-09-30T22:28:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.092+0000 7fda9aa06700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda9409fb40 con 0x7fda9409d920 2023-09-30T22:28:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.092+0000 7fda93fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda9409c890 0x7fda9409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.092+0000 7fda93fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda9409c890 0x7fda9409cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52708/0 (socket says 172.21.15.40:52708) 2023-09-30T22:28:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.092+0000 7fda93fff700 1 -- 172.21.15.40:0/2860009474 learned_addr learned my addr 172.21.15.40:0/2860009474 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.093+0000 7fda937fe700 1 --2- 172.21.15.40:0/2860009474 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda9409d920 0x7fda9409dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.093+0000 7fda93fff700 1 -- 172.21.15.40:0/2860009474 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda9409d920 msgr2=0x7fda9409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.093+0000 7fda93fff700 1 --2- 172.21.15.40:0/2860009474 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda9409d920 0x7fda9409dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.093+0000 7fda92ffd700 1 -- 172.21.15.40:0/2860009474 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2345969415 0 0) 0x7fda940a2600 con 0x7fda9409e2b0 2023-09-30T22:28:05.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.093+0000 7fda93fff700 1 -- 172.21.15.40:0/2860009474 >> v1:172.21.15.40:6789/0 conn(0x7fda9409e2b0 legacy=0x7fda9413ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:05.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.093+0000 7fda93fff700 1 -- 172.21.15.40:0/2860009474 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9409e720 con 0x7fda9409c890 2023-09-30T22:28:05.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.093+0000 7fda937fe700 1 --2- 172.21.15.40:0/2860009474 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda9409d920 0x7fda9409dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:05.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.093+0000 7fda93fff700 1 --2- 172.21.15.40:0/2860009474 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda9409c890 0x7fda9409cc60 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fda840098f0 tx=0x7fda84009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9eb2b7f3d3cd76dc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:05.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.093+0000 7fda92ffd700 1 -- 172.21.15.40:0/2860009474 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda84005e30 con 0x7fda9409c890 2023-09-30T22:28:05.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.093+0000 7fda92ffd700 1 -- 172.21.15.40:0/2860009474 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda84004030 con 0x7fda9409c890 2023-09-30T22:28:05.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.093+0000 7fda92ffd700 1 -- 172.21.15.40:0/2860009474 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda840043e0 con 0x7fda9409c890 2023-09-30T22:28:05.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.094+0000 7fda9aa06700 1 -- 172.21.15.40:0/2860009474 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda9409c890 msgr2=0x7fda9409cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:05.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.094+0000 7fda9aa06700 1 --2- 172.21.15.40:0/2860009474 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda9409c890 0x7fda9409cc60 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fda840098f0 tx=0x7fda84009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:05.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.094+0000 7fda9aa06700 1 -- 172.21.15.40:0/2860009474 shutdown_connections 2023-09-30T22:28:05.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.094+0000 7fda9aa06700 1 --2- 172.21.15.40:0/2860009474 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda9409c890 0x7fda9409cc60 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.094+0000 7fda9aa06700 1 --2- 172.21.15.40:0/2860009474 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda9409d920 0x7fda9409dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.094+0000 7fda9aa06700 1 -- 172.21.15.40:0/2860009474 >> 172.21.15.40:0/2860009474 conn(0x7fda940a7080 msgr2=0x7fda940a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:05.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.094+0000 7fda9aa06700 1 -- 172.21.15.40:0/2860009474 shutdown_connections 2023-09-30T22:28:05.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.094+0000 7fda9aa06700 1 -- 172.21.15.40:0/2860009474 wait complete. 2023-09-30T22:28:05.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.095+0000 7fda9aa06700 1 Processor -- start 2023-09-30T22:28:05.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.095+0000 7fda9aa06700 1 -- start start 2023-09-30T22:28:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.096+0000 7fda9aa06700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda9409c890 0x7fda9412f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.096+0000 7fda9aa06700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda9409d920 0x7fda9412fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.096+0000 7fda9aa06700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda9409e2b0 0x7fda9412ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.096+0000 7fda9aa06700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9412d270 con 0x7fda9409d920 2023-09-30T22:28:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.096+0000 7fda9aa06700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda941313c0 con 0x7fda9409c890 2023-09-30T22:28:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.096+0000 7fda9aa06700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda9409ecf0 con 0x7fda9409e2b0 2023-09-30T22:28:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.096+0000 7fda93fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda9409c890 0x7fda9412f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.096+0000 7fda98fa3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda9409e2b0 0x7fda9412ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.096+0000 7fda93fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda9409c890 0x7fda9412f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52722/0 (socket says 172.21.15.40:52722) 2023-09-30T22:28:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.096+0000 7fda93fff700 1 -- 172.21.15.40:0/1751920465 learned_addr learned my addr 172.21.15.40:0/1751920465 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:05.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.096+0000 7fda937fe700 1 --2- 172.21.15.40:0/1751920465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda9409d920 0x7fda9412fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.097+0000 7fda98fa3700 1 -- 172.21.15.40:0/1751920465 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda9409c890 msgr2=0x7fda9412f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:05.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.097+0000 7fda98fa3700 1 --2- 172.21.15.40:0/1751920465 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda9409c890 0x7fda9412f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.097+0000 7fda98fa3700 1 -- 172.21.15.40:0/1751920465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda9409d920 msgr2=0x7fda9412fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:05.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.097+0000 7fda98fa3700 1 --2- 172.21.15.40:0/1751920465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda9409d920 0x7fda9412fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.097+0000 7fda98fa3700 1 -- 172.21.15.40:0/1751920465 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda880094a0 con 0x7fda9409e2b0 2023-09-30T22:28:05.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.097+0000 7fda93fff700 1 --2- 172.21.15.40:0/1751920465 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda9409c890 0x7fda9412f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:05.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.097+0000 7fda98fa3700 1 --2- 172.21.15.40:0/1751920465 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda9409e2b0 0x7fda9412ff40 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00c7c0 tx=0x7fda8c00cad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:05.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.097+0000 7fda90ff9700 1 -- 172.21.15.40:0/1751920465 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c003e30 con 0x7fda9409e2b0 2023-09-30T22:28:05.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.097+0000 7fda90ff9700 1 -- 172.21.15.40:0/1751920465 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8c005070 con 0x7fda9409e2b0 2023-09-30T22:28:05.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.097+0000 7fda9aa06700 1 -- 172.21.15.40:0/1751920465 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda84009500 con 0x7fda9409e2b0 2023-09-30T22:28:05.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.097+0000 7fda90ff9700 1 -- 172.21.15.40:0/1751920465 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c005420 con 0x7fda9409e2b0 2023-09-30T22:28:05.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.097+0000 7fda9aa06700 1 -- 172.21.15.40:0/1751920465 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9412e3a0 con 0x7fda9409e2b0 2023-09-30T22:28:05.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.098+0000 7fda9aa06700 1 -- 172.21.15.40:0/1751920465 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda9406e600 con 0x7fda9409e2b0 2023-09-30T22:28:05.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.098+0000 7fda90ff9700 1 -- 172.21.15.40:0/1751920465 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fda8c005580 con 0x7fda9409e2b0 2023-09-30T22:28:05.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.098+0000 7fda90ff9700 1 -- 172.21.15.40:0/1751920465 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fda8c03ecb0 con 0x7fda9409e2b0 2023-09-30T22:28:05.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.103+0000 7fda90ff9700 1 -- 172.21.15.40:0/1751920465 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fda8c010b80 con 0x7fda9409e2b0 2023-09-30T22:28:05.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.197+0000 7fb443d17700 1 -- 172.21.15.40:0/2763878729 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb43c062380 con 0x7fb43c09d400 2023-09-30T22:28:05.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.197+0000 7fb4327fc700 1 -- 172.21.15.40:0/2763878729 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb438021080 con 0x7fb43c09d400 2023-09-30T22:28:05.198 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:05.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.200+0000 7fb443d17700 1 -- 172.21.15.40:0/2763878729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb43c09d400 msgr2=0x7fb43c11aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:05.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.200+0000 7fb443d17700 1 --2- 172.21.15.40:0/2763878729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb43c09d400 0x7fb43c11aa50 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fb43800ec10 tx=0x7fb43800ef20 comp rx=0 tx=0).stop 2023-09-30T22:28:05.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.200+0000 7fb443d17700 1 -- 172.21.15.40:0/2763878729 shutdown_connections 2023-09-30T22:28:05.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.200+0000 7fb443d17700 1 --2- 172.21.15.40:0/2763878729 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb43c133e00 0x7fb43c11b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.200+0000 7fb443d17700 1 --2- 172.21.15.40:0/2763878729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb43c09d400 0x7fb43c11aa50 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.200+0000 7fb443d17700 1 --2- 172.21.15.40:0/2763878729 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb43c09df40 0x7fb43c11af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.200+0000 7fb443d17700 1 -- 172.21.15.40:0/2763878729 >> 172.21.15.40:0/2763878729 conn(0x7fb43c0a2a00 msgr2=0x7fb43c1b9950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:05.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.200+0000 7fb443d17700 1 -- 172.21.15.40:0/2763878729 shutdown_connections 2023-09-30T22:28:05.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.200+0000 7fb443d17700 1 -- 172.21.15.40:0/2763878729 wait complete. 2023-09-30T22:28:05.213 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:05.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.240+0000 7f5442c8e700 1 -- 172.21.15.40:0/73926370 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f543c11f5e0 con 0x7f543c130fb0 2023-09-30T22:28:05.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.240+0000 7f54397fa700 1 -- 172.21.15.40:0/73926370 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5434013390 con 0x7f543c130fb0 2023-09-30T22:28:05.241 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:05.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.242+0000 7f5442c8e700 1 -- 172.21.15.40:0/73926370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f543c130fb0 msgr2=0x7f543c1c3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:05.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.243+0000 7f5442c8e700 1 --2- 172.21.15.40:0/73926370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f543c130fb0 0x7f543c1c3d70 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f5434017000 tx=0x7f5434004ad0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.243+0000 7f5442c8e700 1 -- 172.21.15.40:0/73926370 shutdown_connections 2023-09-30T22:28:05.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.243+0000 7f5442c8e700 1 --2- 172.21.15.40:0/73926370 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f543c09d920 0x7f543c11d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.243+0000 7f5442c8e700 1 --2- 172.21.15.40:0/73926370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f543c130fb0 0x7f543c1c3d70 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.243+0000 7f5442c8e700 1 --2- 172.21.15.40:0/73926370 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f543c09e230 0x7f543c11dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.243+0000 7f5442c8e700 1 -- 172.21.15.40:0/73926370 >> 172.21.15.40:0/73926370 conn(0x7f543c09fb20 msgr2=0x7f543c12fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:05.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.243+0000 7f5442c8e700 1 -- 172.21.15.40:0/73926370 shutdown_connections 2023-09-30T22:28:05.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.243+0000 7f5442c8e700 1 -- 172.21.15.40:0/73926370 wait complete. 2023-09-30T22:28:05.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:05.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.302+0000 7fda9aa06700 1 -- 172.21.15.40:0/1751920465 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fda94062380 con 0x7fda9409e2b0 2023-09-30T22:28:05.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.302+0000 7fda90ff9700 1 -- 172.21.15.40:0/1751920465 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fda8c017020 con 0x7fda9409e2b0 2023-09-30T22:28:05.303 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:05.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.304+0000 7fda9aa06700 1 -- 172.21.15.40:0/1751920465 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda9409e2b0 msgr2=0x7fda9412ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:05.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.304+0000 7fda9aa06700 1 --2- 172.21.15.40:0/1751920465 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda9409e2b0 0x7fda9412ff40 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00c7c0 tx=0x7fda8c00cad0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.304+0000 7fda9aa06700 1 -- 172.21.15.40:0/1751920465 shutdown_connections 2023-09-30T22:28:05.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.304+0000 7fda9aa06700 1 --2- 172.21.15.40:0/1751920465 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda9409e2b0 0x7fda9412ff40 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.304+0000 7fda9aa06700 1 --2- 172.21.15.40:0/1751920465 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda9409c890 0x7fda9412f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.304+0000 7fda9aa06700 1 --2- 172.21.15.40:0/1751920465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda9409d920 0x7fda9412fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.304+0000 7fda9aa06700 1 -- 172.21.15.40:0/1751920465 >> 172.21.15.40:0/1751920465 conn(0x7fda940a7080 msgr2=0x7fda941bb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:05.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.304+0000 7fda9aa06700 1 -- 172.21.15.40:0/1751920465 shutdown_connections 2023-09-30T22:28:05.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:05.304+0000 7fda9aa06700 1 -- 172.21.15.40:0/1751920465 wait complete. 2023-09-30T22:28:05.317 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:05.964 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:06.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.103+0000 7fbe44da2700 1 Processor -- start 2023-09-30T22:28:06.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.103+0000 7fbe44da2700 1 -- start start 2023-09-30T22:28:06.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.103+0000 7fbe44da2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe401308b0 0x7fbe40130c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:06.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.103+0000 7fbe44da2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe40133800 0x7fbe40133c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:06.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.103+0000 7fbe44da2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe400a24a0 con 0x7fbe40134170 2023-09-30T22:28:06.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.103+0000 7fbe44da2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4009f710 con 0x7fbe401308b0 2023-09-30T22:28:06.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.103+0000 7fbe44da2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe40130480 con 0x7fbe40133800 2023-09-30T22:28:06.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.104+0000 7fbe3effd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe40133800 0x7fbe40133c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:06.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.104+0000 7fbe3f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe401308b0 0x7fbe40130c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:06.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.104+0000 7fbe3effd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe40133800 0x7fbe40133c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52578/0 (socket says 172.21.15.40:52578) 2023-09-30T22:28:06.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.104+0000 7fbe3f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe401308b0 0x7fbe40130c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52736/0 (socket says 172.21.15.40:52736) 2023-09-30T22:28:06.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.104+0000 7fbe3effd700 1 -- 172.21.15.40:0/3951845534 learned_addr learned my addr 172.21.15.40:0/3951845534 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:06.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.104+0000 7fbe3ffff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbe40134170 0x7fbe4013ab30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43610/0 (socket says 172.21.15.40:43610) 2023-09-30T22:28:06.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.104+0000 7fbe3f7fe700 1 -- 172.21.15.40:0/3951845534 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe40133800 msgr2=0x7fbe40133c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:06.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.104+0000 7fbe3f7fe700 1 --2- 172.21.15.40:0/3951845534 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe40133800 0x7fbe40133c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.104+0000 7fbe3f7fe700 1 -- 172.21.15.40:0/3951845534 >> v1:172.21.15.40:6789/0 conn(0x7fbe40134170 legacy=0x7fbe4013ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.104+0000 7fbe3e7fc700 1 -- 172.21.15.40:0/3951845534 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1651406805 0 0) 0x7fbe400a24a0 con 0x7fbe40134170 2023-09-30T22:28:06.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.104+0000 7fbe3f7fe700 1 -- 172.21.15.40:0/3951845534 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe400a2890 con 0x7fbe401308b0 2023-09-30T22:28:06.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.104+0000 7fbe3effd700 1 --2- 172.21.15.40:0/3951845534 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe40133800 0x7fbe40133c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:06.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.104+0000 7fbe3f7fe700 1 --2- 172.21.15.40:0/3951845534 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe401308b0 0x7fbe40130c80 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fbe28009850 tx=0x7fbe28009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=332966eb79a2fa5a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:06.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.104+0000 7fbe3e7fc700 1 -- 172.21.15.40:0/3951845534 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe28005e30 con 0x7fbe401308b0 2023-09-30T22:28:06.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.104+0000 7fbe3e7fc700 1 -- 172.21.15.40:0/3951845534 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe28006030 con 0x7fbe401308b0 2023-09-30T22:28:06.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.104+0000 7fbe3e7fc700 1 -- 172.21.15.40:0/3951845534 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe280063e0 con 0x7fbe401308b0 2023-09-30T22:28:06.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.105+0000 7fbe44da2700 1 -- 172.21.15.40:0/3951845534 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe401308b0 msgr2=0x7fbe40130c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.105+0000 7fbe44da2700 1 --2- 172.21.15.40:0/3951845534 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe401308b0 0x7fbe40130c80 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fbe28009850 tx=0x7fbe28009b60 comp rx=0 tx=0).stop 2023-09-30T22:28:06.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.105+0000 7fbe44da2700 1 -- 172.21.15.40:0/3951845534 shutdown_connections 2023-09-30T22:28:06.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.105+0000 7fbe44da2700 1 --2- 172.21.15.40:0/3951845534 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe401308b0 0x7fbe40130c80 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.105+0000 7fbe44da2700 1 --2- 172.21.15.40:0/3951845534 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe40133800 0x7fbe40133c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.105+0000 7fbe44da2700 1 -- 172.21.15.40:0/3951845534 >> 172.21.15.40:0/3951845534 conn(0x7fbe400a6df0 msgr2=0x7fbe400a2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:06.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.105+0000 7fbe44da2700 1 -- 172.21.15.40:0/3951845534 shutdown_connections 2023-09-30T22:28:06.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.105+0000 7fbe44da2700 1 -- 172.21.15.40:0/3951845534 wait complete. 2023-09-30T22:28:06.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.106+0000 7fbe44da2700 1 Processor -- start 2023-09-30T22:28:06.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.106+0000 7fbe44da2700 1 -- start start 2023-09-30T22:28:06.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.106+0000 7fbe44da2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe401308b0 0x7fbe4012de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:06.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.106+0000 7fbe44da2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe40133800 0x7fbe4012e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:06.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.106+0000 7fbe44da2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe40134170 0x7fbe4012e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:06.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.106+0000 7fbe44da2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe40071c00 con 0x7fbe401308b0 2023-09-30T22:28:06.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.106+0000 7fbe44da2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4006cf30 con 0x7fbe40134170 2023-09-30T22:28:06.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.106+0000 7fbe44da2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4006d2d0 con 0x7fbe40133800 2023-09-30T22:28:06.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.107+0000 7fbe3f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe401308b0 0x7fbe4012de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:06.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.107+0000 7fbe3ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe40134170 0x7fbe4012e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:06.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.107+0000 7fbe3f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe401308b0 0x7fbe4012de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39330/0 (socket says 172.21.15.40:39330) 2023-09-30T22:28:06.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.107+0000 7fbe3f7fe700 1 -- 172.21.15.40:0/4114169080 learned_addr learned my addr 172.21.15.40:0/4114169080 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:06.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.107+0000 7fbe3effd700 1 --2- 172.21.15.40:0/4114169080 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe40133800 0x7fbe4012e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:06.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.107+0000 7fbe3effd700 1 -- 172.21.15.40:0/4114169080 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe40134170 msgr2=0x7fbe4012e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.107+0000 7fbe3effd700 1 --2- 172.21.15.40:0/4114169080 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe40134170 0x7fbe4012e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.107+0000 7fbe3effd700 1 -- 172.21.15.40:0/4114169080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe401308b0 msgr2=0x7fbe4012de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.107+0000 7fbe3effd700 1 --2- 172.21.15.40:0/4114169080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe401308b0 0x7fbe4012de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.107+0000 7fbe3effd700 1 -- 172.21.15.40:0/4114169080 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe30009500 con 0x7fbe40133800 2023-09-30T22:28:06.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.107+0000 7fbe3f7fe700 1 --2- 172.21.15.40:0/4114169080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe401308b0 0x7fbe4012de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:06.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.107+0000 7fbe3ffff700 1 --2- 172.21.15.40:0/4114169080 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe40134170 0x7fbe4012e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:06.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.107+0000 7fbe3effd700 1 --2- 172.21.15.40:0/4114169080 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe40133800 0x7fbe4012e360 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fbe3000ebb0 tx=0x7fbe3000eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:06.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.107+0000 7fbe37fff700 1 -- 172.21.15.40:0/4114169080 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe30005a20 con 0x7fbe40133800 2023-09-30T22:28:06.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.107+0000 7fbe37fff700 1 -- 172.21.15.40:0/4114169080 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe30005b80 con 0x7fbe40133800 2023-09-30T22:28:06.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.107+0000 7fbe44da2700 1 -- 172.21.15.40:0/4114169080 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe28009430 con 0x7fbe40133800 2023-09-30T22:28:06.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.107+0000 7fbe37fff700 1 -- 172.21.15.40:0/4114169080 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3000c850 con 0x7fbe40133800 2023-09-30T22:28:06.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.107+0000 7fbe44da2700 1 -- 172.21.15.40:0/4114169080 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe4006ddf0 con 0x7fbe40133800 2023-09-30T22:28:06.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.108+0000 7fbe37fff700 1 -- 172.21.15.40:0/4114169080 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbe3000c9b0 con 0x7fbe40133800 2023-09-30T22:28:06.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.108+0000 7fbe37fff700 1 -- 172.21.15.40:0/4114169080 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fbe3003f940 con 0x7fbe40133800 2023-09-30T22:28:06.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.108+0000 7fbe44da2700 1 -- 172.21.15.40:0/4114169080 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe40062380 con 0x7fbe40133800 2023-09-30T22:28:06.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.113+0000 7fbe37fff700 1 -- 172.21.15.40:0/4114169080 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe30020080 con 0x7fbe40133800 2023-09-30T22:28:06.214 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:06.256 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:06.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.316+0000 7fbe44da2700 1 -- 172.21.15.40:0/4114169080 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbe400a3b30 con 0x7fbe40133800 2023-09-30T22:28:06.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.317+0000 7fbe37fff700 1 -- 172.21.15.40:0/4114169080 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbe30022300 con 0x7fbe40133800 2023-09-30T22:28:06.317 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:06.318 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:06.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.319+0000 7fbe44da2700 1 -- 172.21.15.40:0/4114169080 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe40133800 msgr2=0x7fbe4012e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.319+0000 7fbe44da2700 1 --2- 172.21.15.40:0/4114169080 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe40133800 0x7fbe4012e360 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fbe3000ebb0 tx=0x7fbe3000eec0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.319+0000 7fbe44da2700 1 -- 172.21.15.40:0/4114169080 shutdown_connections 2023-09-30T22:28:06.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.319+0000 7fbe44da2700 1 --2- 172.21.15.40:0/4114169080 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe40134170 0x7fbe4012e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.319+0000 7fbe44da2700 1 --2- 172.21.15.40:0/4114169080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe401308b0 0x7fbe4012de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.319+0000 7fbe44da2700 1 --2- 172.21.15.40:0/4114169080 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe40133800 0x7fbe4012e360 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.319+0000 7fbe44da2700 1 -- 172.21.15.40:0/4114169080 >> 172.21.15.40:0/4114169080 conn(0x7fbe400a6df0 msgr2=0x7fbe4009cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:06.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.319+0000 7fbe44da2700 1 -- 172.21.15.40:0/4114169080 shutdown_connections 2023-09-30T22:28:06.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.319+0000 7fbe44da2700 1 -- 172.21.15.40:0/4114169080 wait complete. 2023-09-30T22:28:06.340 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:06.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.352+0000 7f3913b86700 1 Processor -- start 2023-09-30T22:28:06.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.352+0000 7f3913b86700 1 -- start start 2023-09-30T22:28:06.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.353+0000 7f3913b86700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f390c09c890 0x7f390c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:06.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.353+0000 7f3913b86700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f390c09e480 0x7f390c13bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:06.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.353+0000 7f3913b86700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f390c0a2600 con 0x7f390c09d920 2023-09-30T22:28:06.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.353+0000 7f3913b86700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f390c0a29d0 con 0x7f390c09e480 2023-09-30T22:28:06.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.353+0000 7f3913b86700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390c09fb40 con 0x7f390c09c890 2023-09-30T22:28:06.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.353+0000 7f3911922700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f390c09c890 0x7f390c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:06.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.353+0000 7f3911922700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f390c09c890 0x7f390c09cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52748/0 (socket says 172.21.15.40:52748) 2023-09-30T22:28:06.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.353+0000 7f3911922700 1 -- 172.21.15.40:0/3026344288 learned_addr learned my addr 172.21.15.40:0/3026344288 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:06.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.353+0000 7f3912123700 1 --2- 172.21.15.40:0/3026344288 >> v2:172.21.15.40:3300/0 conn(0x7f390c09e480 0x7f390c13bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:06.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.353+0000 7f3911922700 1 -- 172.21.15.40:0/3026344288 >> v2:172.21.15.40:3300/0 conn(0x7f390c09e480 msgr2=0x7f390c13bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:06.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.353+0000 7f3911922700 1 --2- 172.21.15.40:0/3026344288 >> v2:172.21.15.40:3300/0 conn(0x7f390c09e480 0x7f390c13bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.353+0000 7f3911922700 1 -- 172.21.15.40:0/3026344288 >> v1:172.21.15.40:6789/0 conn(0x7f390c09d920 legacy=0x7f390c09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.353+0000 7f3911922700 1 -- 172.21.15.40:0/3026344288 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390c09fed0 con 0x7f390c09c890 2023-09-30T22:28:06.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.353+0000 7f3912123700 1 --2- 172.21.15.40:0/3026344288 >> v2:172.21.15.40:3300/0 conn(0x7f390c09e480 0x7f390c13bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:06.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.354+0000 7f3911922700 1 --2- 172.21.15.40:0/3026344288 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f390c09c890 0x7f390c09cc60 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3908006fd0 tx=0x7f3908009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=443a7e96a7b0e796 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:06.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.354+0000 7f3910920700 1 -- 172.21.15.40:0/3026344288 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3908005e30 con 0x7f390c09c890 2023-09-30T22:28:06.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.354+0000 7f3910920700 1 -- 172.21.15.40:0/3026344288 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3908004030 con 0x7f390c09c890 2023-09-30T22:28:06.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.354+0000 7f3910920700 1 -- 172.21.15.40:0/3026344288 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39080043e0 con 0x7f390c09c890 2023-09-30T22:28:06.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.354+0000 7f3913b86700 1 -- 172.21.15.40:0/3026344288 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f390c09c890 msgr2=0x7f390c09cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.354+0000 7f3913b86700 1 --2- 172.21.15.40:0/3026344288 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f390c09c890 0x7f390c09cc60 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3908006fd0 tx=0x7f3908009bd0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.355+0000 7f3913b86700 1 -- 172.21.15.40:0/3026344288 shutdown_connections 2023-09-30T22:28:06.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.355+0000 7f3913b86700 1 --2- 172.21.15.40:0/3026344288 >> v2:172.21.15.40:3300/0 conn(0x7f390c09e480 0x7f390c13bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.355+0000 7f3913b86700 1 --2- 172.21.15.40:0/3026344288 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f390c09c890 0x7f390c09cc60 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.355+0000 7f3913b86700 1 -- 172.21.15.40:0/3026344288 >> 172.21.15.40:0/3026344288 conn(0x7f390c0a7080 msgr2=0x7f390c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:06.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.355+0000 7f3913b86700 1 -- 172.21.15.40:0/3026344288 shutdown_connections 2023-09-30T22:28:06.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.355+0000 7f3913b86700 1 -- 172.21.15.40:0/3026344288 wait complete. 2023-09-30T22:28:06.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.356+0000 7f3913b86700 1 Processor -- start 2023-09-30T22:28:06.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.356+0000 7f3913b86700 1 -- start start 2023-09-30T22:28:06.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.356+0000 7f3913b86700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f390c09c890 0x7f390c12d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:06.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.356+0000 7f3913b86700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f390c09d920 0x7f390c12da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:06.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.356+0000 7f3913b86700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f390c09e480 0x7f390c12dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:06.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.356+0000 7f3913b86700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c08f4f0 con 0x7f390c09d920 2023-09-30T22:28:06.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.356+0000 7f3913b86700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390c130af0 con 0x7f390c09c890 2023-09-30T22:28:06.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.356+0000 7f3913b86700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f390c0a5da0 con 0x7f390c09e480 2023-09-30T22:28:06.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.356+0000 7f3911121700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f390c09d920 0x7f390c12da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:06.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.356+0000 7f3911922700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f390c09c890 0x7f390c12d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:06.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.356+0000 7f3911121700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f390c09d920 0x7f390c12da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39348/0 (socket says 172.21.15.40:39348) 2023-09-30T22:28:06.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.356+0000 7f3911121700 1 -- 172.21.15.40:0/1243940208 learned_addr learned my addr 172.21.15.40:0/1243940208 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:06.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.356+0000 7f3912123700 1 --2- 172.21.15.40:0/1243940208 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f390c09e480 0x7f390c12dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:06.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.357+0000 7f3911922700 1 -- 172.21.15.40:0/1243940208 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f390c09e480 msgr2=0x7f390c12dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.357+0000 7f3911922700 1 --2- 172.21.15.40:0/1243940208 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f390c09e480 0x7f390c12dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.357+0000 7f3911922700 1 -- 172.21.15.40:0/1243940208 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f390c09d920 msgr2=0x7f390c12da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.357+0000 7f3911922700 1 --2- 172.21.15.40:0/1243940208 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f390c09d920 0x7f390c12da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.357+0000 7f3911922700 1 -- 172.21.15.40:0/1243940208 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3908009500 con 0x7f390c09c890 2023-09-30T22:28:06.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.357+0000 7f3911922700 1 --2- 172.21.15.40:0/1243940208 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f390c09c890 0x7f390c12d520 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3908013000 tx=0x7f3908004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:06.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.357+0000 7f39027fc700 1 -- 172.21.15.40:0/1243940208 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3908003da0 con 0x7f390c09c890 2023-09-30T22:28:06.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.357+0000 7f39027fc700 1 -- 172.21.15.40:0/1243940208 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3908011420 con 0x7f390c09c890 2023-09-30T22:28:06.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.357+0000 7f39027fc700 1 -- 172.21.15.40:0/1243940208 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39080117b0 con 0x7f390c09c890 2023-09-30T22:28:06.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.358+0000 7f3913b86700 1 -- 172.21.15.40:0/1243940208 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f390c09ecf0 con 0x7f390c09c890 2023-09-30T22:28:06.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.358+0000 7f3913b86700 1 -- 172.21.15.40:0/1243940208 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f390c130dd0 con 0x7f390c09c890 2023-09-30T22:28:06.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.358+0000 7f39027fc700 1 -- 172.21.15.40:0/1243940208 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3908011910 con 0x7f390c09c890 2023-09-30T22:28:06.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.359+0000 7f39027fc700 1 -- 172.21.15.40:0/1243940208 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3908040840 con 0x7f390c09c890 2023-09-30T22:28:06.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.359+0000 7f3913b86700 1 -- 172.21.15.40:0/1243940208 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f390c062380 con 0x7f390c09c890 2023-09-30T22:28:06.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.364+0000 7f39027fc700 1 -- 172.21.15.40:0/1243940208 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3908016080 con 0x7f390c09c890 2023-09-30T22:28:06.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.397+0000 7f75c470c700 1 Processor -- start 2023-09-30T22:28:06.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.397+0000 7f75c470c700 1 -- start start 2023-09-30T22:28:06.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.398+0000 7f75c470c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75bc06b1b0 0x7f75bc136af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:06.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.398+0000 7f75c470c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f75bc137030 0x7f75bc139410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:06.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.398+0000 7f75c470c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75bc09eb50 con 0x7f75bc06a6d0 2023-09-30T22:28:06.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.398+0000 7f75c470c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75bc06b580 con 0x7f75bc137030 2023-09-30T22:28:06.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.398+0000 7f75c470c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc09dde0 con 0x7f75bc06b1b0 2023-09-30T22:28:06.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.398+0000 7f75c24a8700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f75bc06a6d0 0x7f75bc06aaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43638/0 (socket says 172.21.15.40:43638) 2023-09-30T22:28:06.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.398+0000 7f75c24a8700 1 -- 172.21.15.40:0/3117069786 learned_addr learned my addr 172.21.15.40:0/3117069786 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:06.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.398+0000 7f75c2ca9700 1 --2- 172.21.15.40:0/3117069786 >> v2:172.21.15.40:3300/0 conn(0x7f75bc137030 0x7f75bc139410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:06.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.398+0000 7f75c1ca7700 1 --2- 172.21.15.40:0/3117069786 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75bc06b1b0 0x7f75bc136af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:06.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.399+0000 7f75c2ca9700 1 -- 172.21.15.40:0/3117069786 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75bc06b1b0 msgr2=0x7f75bc136af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:06.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.399+0000 7f75c2ca9700 1 --2- 172.21.15.40:0/3117069786 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75bc06b1b0 0x7f75bc136af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.399+0000 7f75c2ca9700 1 -- 172.21.15.40:0/3117069786 >> v1:172.21.15.40:6789/0 conn(0x7f75bc06a6d0 legacy=0x7f75bc06aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.399+0000 7f75c14a6700 1 -- 172.21.15.40:0/3117069786 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3217363543 0 0) 0x7f75bc09eb50 con 0x7f75bc06a6d0 2023-09-30T22:28:06.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.399+0000 7f75c2ca9700 1 -- 172.21.15.40:0/3117069786 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75bc09d4a0 con 0x7f75bc137030 2023-09-30T22:28:06.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.399+0000 7f75c2ca9700 1 --2- 172.21.15.40:0/3117069786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75bc137030 0x7f75bc139410 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009d90 tx=0x7f75b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a262d74984c5f4c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:06.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.399+0000 7f75c14a6700 1 -- 172.21.15.40:0/3117069786 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b400e070 con 0x7f75bc137030 2023-09-30T22:28:06.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.399+0000 7f75c14a6700 1 -- 172.21.15.40:0/3117069786 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b400bb20 con 0x7f75bc137030 2023-09-30T22:28:06.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.399+0000 7f75c14a6700 1 -- 172.21.15.40:0/3117069786 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b4012430 con 0x7f75bc137030 2023-09-30T22:28:06.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.400+0000 7f75c470c700 1 -- 172.21.15.40:0/3117069786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75bc137030 msgr2=0x7f75bc139410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.400+0000 7f75c470c700 1 --2- 172.21.15.40:0/3117069786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75bc137030 0x7f75bc139410 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009d90 tx=0x7f75b400b330 comp rx=0 tx=0).stop 2023-09-30T22:28:06.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.400+0000 7f75c470c700 1 -- 172.21.15.40:0/3117069786 shutdown_connections 2023-09-30T22:28:06.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.400+0000 7f75c470c700 1 --2- 172.21.15.40:0/3117069786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75bc137030 0x7f75bc139410 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.400+0000 7f75c470c700 1 --2- 172.21.15.40:0/3117069786 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75bc06b1b0 0x7f75bc136af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.400+0000 7f75c470c700 1 -- 172.21.15.40:0/3117069786 >> 172.21.15.40:0/3117069786 conn(0x7f75bc09fb20 msgr2=0x7f75bc09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:06.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.400+0000 7f75c470c700 1 -- 172.21.15.40:0/3117069786 shutdown_connections 2023-09-30T22:28:06.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.400+0000 7f75c470c700 1 -- 172.21.15.40:0/3117069786 wait complete. 2023-09-30T22:28:06.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.401+0000 7f75c470c700 1 Processor -- start 2023-09-30T22:28:06.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.401+0000 7f75c470c700 1 -- start start 2023-09-30T22:28:06.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.401+0000 7f75c470c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75bc06a6d0 0x7f75bc09af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:06.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.401+0000 7f75c470c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75bc06b1b0 0x7f75bc09b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:06.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.401+0000 7f75c470c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75bc137030 0x7f75bc1c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:06.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.401+0000 7f75c470c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc09b9c0 con 0x7f75bc06b1b0 2023-09-30T22:28:06.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.401+0000 7f75c470c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc122360 con 0x7f75bc06a6d0 2023-09-30T22:28:06.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.401+0000 7f75c470c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc1324a0 con 0x7f75bc137030 2023-09-30T22:28:06.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.401+0000 7f75c1ca7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75bc06b1b0 0x7f75bc09b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:06.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.401+0000 7f75c1ca7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75bc06b1b0 0x7f75bc09b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39356/0 (socket says 172.21.15.40:39356) 2023-09-30T22:28:06.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.401+0000 7f75c1ca7700 1 -- 172.21.15.40:0/1333272616 learned_addr learned my addr 172.21.15.40:0/1333272616 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:06.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.401+0000 7f75c24a8700 1 --2- 172.21.15.40:0/1333272616 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75bc06a6d0 0x7f75bc09af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:06.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.401+0000 7f75c2ca9700 1 --2- 172.21.15.40:0/1333272616 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75bc137030 0x7f75bc1c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:06.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.402+0000 7f75c1ca7700 1 -- 172.21.15.40:0/1333272616 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75bc137030 msgr2=0x7f75bc1c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.402+0000 7f75c1ca7700 1 --2- 172.21.15.40:0/1333272616 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75bc137030 0x7f75bc1c84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.402+0000 7f75c1ca7700 1 -- 172.21.15.40:0/1333272616 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75bc06a6d0 msgr2=0x7f75bc09af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.402+0000 7f75c1ca7700 1 --2- 172.21.15.40:0/1333272616 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75bc06a6d0 0x7f75bc09af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.402+0000 7f75c1ca7700 1 -- 172.21.15.40:0/1333272616 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b4009a70 con 0x7f75bc06b1b0 2023-09-30T22:28:06.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.402+0000 7f75c1ca7700 1 --2- 172.21.15.40:0/1333272616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75bc06b1b0 0x7f75bc09b480 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f75ac00e9e0 tx=0x7f75ac00ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:06.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.402+0000 7f75b2ffd700 1 -- 172.21.15.40:0/1333272616 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac009710 con 0x7f75bc06b1b0 2023-09-30T22:28:06.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.402+0000 7f75b2ffd700 1 -- 172.21.15.40:0/1333272616 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ac00ee80 con 0x7f75bc06b1b0 2023-09-30T22:28:06.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.402+0000 7f75b2ffd700 1 -- 172.21.15.40:0/1333272616 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac00ca50 con 0x7f75bc06b1b0 2023-09-30T22:28:06.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.402+0000 7f75c470c700 1 -- 172.21.15.40:0/1333272616 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75bc09a9a0 con 0x7f75bc06b1b0 2023-09-30T22:28:06.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.402+0000 7f75c470c700 1 -- 172.21.15.40:0/1333272616 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75bc09c110 con 0x7f75bc06b1b0 2023-09-30T22:28:06.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.403+0000 7f75b2ffd700 1 -- 172.21.15.40:0/1333272616 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f75ac00cbb0 con 0x7f75bc06b1b0 2023-09-30T22:28:06.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.403+0000 7f75b2ffd700 1 -- 172.21.15.40:0/1333272616 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f75ac03f6d0 con 0x7f75bc06b1b0 2023-09-30T22:28:06.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.403+0000 7f75c470c700 1 -- 172.21.15.40:0/1333272616 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75bc1224a0 con 0x7f75bc06b1b0 2023-09-30T22:28:06.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.408+0000 7f75b2ffd700 1 -- 172.21.15.40:0/1333272616 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f75bc1224a0 con 0x7f75bc06b1b0 2023-09-30T22:28:06.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.476+0000 7f59ff5c1700 1 Processor -- start 2023-09-30T22:28:06.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.476+0000 7f59ff5c1700 1 -- start start 2023-09-30T22:28:06.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.476+0000 7f59ff5c1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59f809c890 0x7f59f809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:06.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.476+0000 7f59ff5c1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f59f809d920 0x7f59f809dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:06.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.476+0000 7f59ff5c1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59f80a2600 con 0x7f59f809e2b0 2023-09-30T22:28:06.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.477+0000 7f59ff5c1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59f80a29d0 con 0x7f59f809d920 2023-09-30T22:28:06.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.477+0000 7f59ff5c1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f809fb40 con 0x7f59f809c890 2023-09-30T22:28:06.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.477+0000 7f59fcb5c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f59f809d920 0x7f59f809dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:06.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.477+0000 7f59fcb5c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f59f809d920 0x7f59f809dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39364/0 (socket says 172.21.15.40:39364) 2023-09-30T22:28:06.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.477+0000 7f59fd35d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59f809c890 0x7f59f809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:06.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.477+0000 7f59fcb5c700 1 -- 172.21.15.40:0/514957211 learned_addr learned my addr 172.21.15.40:0/514957211 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:06.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.477+0000 7f59fcb5c700 1 -- 172.21.15.40:0/514957211 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59f809c890 msgr2=0x7f59f809cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:06.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.477+0000 7f59fcb5c700 1 --2- 172.21.15.40:0/514957211 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59f809c890 0x7f59f809cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.477+0000 7f59fcb5c700 1 -- 172.21.15.40:0/514957211 >> v1:172.21.15.40:6789/0 conn(0x7f59f809e2b0 legacy=0x7f59f813ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.477+0000 7f59fcb5c700 1 -- 172.21.15.40:0/514957211 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f809e750 con 0x7f59f809d920 2023-09-30T22:28:06.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.477+0000 7f59effff700 1 -- 172.21.15.40:0/514957211 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 199609768 0 0) 0x7f59f80a2600 con 0x7f59f809e2b0 2023-09-30T22:28:06.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.477+0000 7f59fcb5c700 1 --2- 172.21.15.40:0/514957211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59f809d920 0x7f59f809dd70 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f59e80098f0 tx=0x7f59e8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37ca7f44bfa9d579 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:06.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.477+0000 7f59effff700 1 -- 172.21.15.40:0/514957211 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e8011830 con 0x7f59f809d920 2023-09-30T22:28:06.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.477+0000 7f59effff700 1 -- 172.21.15.40:0/514957211 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e8011990 con 0x7f59f809d920 2023-09-30T22:28:06.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.477+0000 7f59effff700 1 -- 172.21.15.40:0/514957211 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e8011d20 con 0x7f59f809d920 2023-09-30T22:28:06.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.478+0000 7f59ff5c1700 1 -- 172.21.15.40:0/514957211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59f809d920 msgr2=0x7f59f809dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.478+0000 7f59ff5c1700 1 --2- 172.21.15.40:0/514957211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59f809d920 0x7f59f809dd70 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f59e80098f0 tx=0x7f59e8009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:06.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.478+0000 7f59ff5c1700 1 -- 172.21.15.40:0/514957211 shutdown_connections 2023-09-30T22:28:06.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.478+0000 7f59ff5c1700 1 --2- 172.21.15.40:0/514957211 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59f809c890 0x7f59f809cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.478+0000 7f59ff5c1700 1 --2- 172.21.15.40:0/514957211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59f809d920 0x7f59f809dd70 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.478+0000 7f59ff5c1700 1 -- 172.21.15.40:0/514957211 >> 172.21.15.40:0/514957211 conn(0x7f59f80a7080 msgr2=0x7f59f80a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:06.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.478+0000 7f59ff5c1700 1 -- 172.21.15.40:0/514957211 shutdown_connections 2023-09-30T22:28:06.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.478+0000 7f59ff5c1700 1 -- 172.21.15.40:0/514957211 wait complete. 2023-09-30T22:28:06.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.479+0000 7f59ff5c1700 1 Processor -- start 2023-09-30T22:28:06.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.480+0000 7f59ff5c1700 1 -- start start 2023-09-30T22:28:06.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.480+0000 7f59ff5c1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59f809c890 0x7f59f812b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:06.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.480+0000 7f59ff5c1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59f809d920 0x7f59f812ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:06.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.480+0000 7f59ff5c1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f59f809e2b0 0x7f59f812bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:06.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.480+0000 7f59ff5c1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f8131460 con 0x7f59f809c890 2023-09-30T22:28:06.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.480+0000 7f59ff5c1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f812c910 con 0x7f59f809d920 2023-09-30T22:28:06.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.480+0000 7f59ff5c1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59f812e5e0 con 0x7f59f809e2b0 2023-09-30T22:28:06.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.480+0000 7f59fcb5c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59f809d920 0x7f59f812ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:06.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.480+0000 7f59fcb5c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59f809d920 0x7f59f812ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52778/0 (socket says 172.21.15.40:52778) 2023-09-30T22:28:06.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.480+0000 7f59fcb5c700 1 -- 172.21.15.40:0/3293945315 learned_addr learned my addr 172.21.15.40:0/3293945315 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:06.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.480+0000 7f59fdb5e700 1 --2- 172.21.15.40:0/3293945315 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f59f809e2b0 0x7f59f812bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:06.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.480+0000 7f59fd35d700 1 --2- 172.21.15.40:0/3293945315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59f809c890 0x7f59f812b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:06.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.481+0000 7f59fcb5c700 1 -- 172.21.15.40:0/3293945315 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f59f809e2b0 msgr2=0x7f59f812bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.481+0000 7f59fcb5c700 1 --2- 172.21.15.40:0/3293945315 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f59f809e2b0 0x7f59f812bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.481+0000 7f59fcb5c700 1 -- 172.21.15.40:0/3293945315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59f809c890 msgr2=0x7f59f812b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.481+0000 7f59fcb5c700 1 --2- 172.21.15.40:0/3293945315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59f809c890 0x7f59f812b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.481+0000 7f59fcb5c700 1 -- 172.21.15.40:0/3293945315 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e8009550 con 0x7f59f809d920 2023-09-30T22:28:06.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.481+0000 7f59fcb5c700 1 --2- 172.21.15.40:0/3293945315 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59f809d920 0x7f59f812ba20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f59e8013000 tx=0x7f59e8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:06.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.481+0000 7f59edffb700 1 -- 172.21.15.40:0/3293945315 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e8004550 con 0x7f59f809d920 2023-09-30T22:28:06.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.481+0000 7f59edffb700 1 -- 172.21.15.40:0/3293945315 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e80036a0 con 0x7f59f809d920 2023-09-30T22:28:06.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.481+0000 7f59ff5c1700 1 -- 172.21.15.40:0/3293945315 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59f80a5a00 con 0x7f59f809d920 2023-09-30T22:28:06.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.481+0000 7f59edffb700 1 -- 172.21.15.40:0/3293945315 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e8003a30 con 0x7f59f809d920 2023-09-30T22:28:06.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.482+0000 7f59ff5c1700 1 -- 172.21.15.40:0/3293945315 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59f812d640 con 0x7f59f809d920 2023-09-30T22:28:06.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.482+0000 7f59edffb700 1 -- 172.21.15.40:0/3293945315 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f59e8021070 con 0x7f59f809d920 2023-09-30T22:28:06.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.482+0000 7f59ff5c1700 1 -- 172.21.15.40:0/3293945315 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59f806e600 con 0x7f59f809d920 2023-09-30T22:28:06.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.483+0000 7f59edffb700 1 -- 172.21.15.40:0/3293945315 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f59e8040b90 con 0x7f59f809d920 2023-09-30T22:28:06.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.491+0000 7f59edffb700 1 -- 172.21.15.40:0/3293945315 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f59e801b430 con 0x7f59f809d920 2023-09-30T22:28:06.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.599+0000 7f3913b86700 1 -- 172.21.15.40:0/1243940208 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f390c130790 con 0x7f390c09c890 2023-09-30T22:28:06.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.599+0000 7f39027fc700 1 -- 172.21.15.40:0/1243940208 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f390802a020 con 0x7f390c09c890 2023-09-30T22:28:06.601 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:06.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.601+0000 7f3913b86700 1 -- 172.21.15.40:0/1243940208 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f390c09c890 msgr2=0x7f390c12d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.601+0000 7f3913b86700 1 --2- 172.21.15.40:0/1243940208 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f390c09c890 0x7f390c12d520 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3908013000 tx=0x7f3908004750 comp rx=0 tx=0).stop 2023-09-30T22:28:06.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.601+0000 7f3913b86700 1 -- 172.21.15.40:0/1243940208 shutdown_connections 2023-09-30T22:28:06.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.601+0000 7f3913b86700 1 --2- 172.21.15.40:0/1243940208 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f390c09e480 0x7f390c12dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.601+0000 7f3913b86700 1 --2- 172.21.15.40:0/1243940208 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f390c09c890 0x7f390c12d520 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.601+0000 7f3913b86700 1 --2- 172.21.15.40:0/1243940208 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f390c09d920 0x7f390c12da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.601+0000 7f3913b86700 1 -- 172.21.15.40:0/1243940208 >> 172.21.15.40:0/1243940208 conn(0x7f390c0a7080 msgr2=0x7f390c0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:06.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.602+0000 7f3913b86700 1 -- 172.21.15.40:0/1243940208 shutdown_connections 2023-09-30T22:28:06.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.602+0000 7f3913b86700 1 -- 172.21.15.40:0/1243940208 wait complete. 2023-09-30T22:28:06.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.609+0000 7f75c470c700 1 -- 172.21.15.40:0/1333272616 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f75bc1224a0 con 0x7f75bc06b1b0 2023-09-30T22:28:06.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.610+0000 7f75b2ffd700 1 -- 172.21.15.40:0/1333272616 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f75bc1224a0 con 0x7f75bc06b1b0 2023-09-30T22:28:06.610 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:06.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.612+0000 7f75c470c700 1 -- 172.21.15.40:0/1333272616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75bc06b1b0 msgr2=0x7f75bc09b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.612+0000 7f75c470c700 1 --2- 172.21.15.40:0/1333272616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75bc06b1b0 0x7f75bc09b480 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f75ac00e9e0 tx=0x7f75ac00ecf0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.612+0000 7f75c470c700 1 -- 172.21.15.40:0/1333272616 shutdown_connections 2023-09-30T22:28:06.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.612+0000 7f75c470c700 1 --2- 172.21.15.40:0/1333272616 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f75bc137030 0x7f75bc1c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.612+0000 7f75c470c700 1 --2- 172.21.15.40:0/1333272616 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75bc06a6d0 0x7f75bc09af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.612+0000 7f75c470c700 1 --2- 172.21.15.40:0/1333272616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75bc06b1b0 0x7f75bc09b480 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.612+0000 7f75c470c700 1 -- 172.21.15.40:0/1333272616 >> 172.21.15.40:0/1333272616 conn(0x7f75bc09fb20 msgr2=0x7f75bc134b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:06.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.612+0000 7f75c470c700 1 -- 172.21.15.40:0/1333272616 shutdown_connections 2023-09-30T22:28:06.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.612+0000 7f75c470c700 1 -- 172.21.15.40:0/1333272616 wait complete. 2023-09-30T22:28:06.615 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:06.629 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:06.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.697+0000 7f59ff5c1700 1 -- 172.21.15.40:0/3293945315 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f59f8062380 con 0x7f59f809d920 2023-09-30T22:28:06.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.697+0000 7f59edffb700 1 -- 172.21.15.40:0/3293945315 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f59e8015020 con 0x7f59f809d920 2023-09-30T22:28:06.698 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:06.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.699+0000 7f59ff5c1700 1 -- 172.21.15.40:0/3293945315 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59f809d920 msgr2=0x7f59f812ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.699+0000 7f59ff5c1700 1 --2- 172.21.15.40:0/3293945315 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59f809d920 0x7f59f812ba20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f59e8013000 tx=0x7f59e8004750 comp rx=0 tx=0).stop 2023-09-30T22:28:06.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.699+0000 7f59ff5c1700 1 -- 172.21.15.40:0/3293945315 shutdown_connections 2023-09-30T22:28:06.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.699+0000 7f59ff5c1700 1 --2- 172.21.15.40:0/3293945315 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f59f809e2b0 0x7f59f812bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.699+0000 7f59ff5c1700 1 --2- 172.21.15.40:0/3293945315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59f809c890 0x7f59f812b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.699+0000 7f59ff5c1700 1 --2- 172.21.15.40:0/3293945315 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59f809d920 0x7f59f812ba20 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.699+0000 7f59ff5c1700 1 -- 172.21.15.40:0/3293945315 >> 172.21.15.40:0/3293945315 conn(0x7f59f80a7080 msgr2=0x7f59f81bb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:06.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.699+0000 7f59ff5c1700 1 -- 172.21.15.40:0/3293945315 shutdown_connections 2023-09-30T22:28:06.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:06.699+0000 7f59ff5c1700 1 -- 172.21.15.40:0/3293945315 wait complete. 2023-09-30T22:28:06.712 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:07.341 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:07.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.481+0000 7f31fb8f9700 1 Processor -- start 2023-09-30T22:28:07.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.482+0000 7f31fb8f9700 1 -- start start 2023-09-30T22:28:07.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.482+0000 7f31fb8f9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31f4133e00 0x7f31f41341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.482+0000 7f31fb8f9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f31f409d400 0x7f31f409d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.482+0000 7f31fb8f9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f4133940 con 0x7f31f409dd70 2023-09-30T22:28:07.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.482+0000 7f31fb8f9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31f409f0d0 con 0x7f31f409d400 2023-09-30T22:28:07.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.482+0000 7f31fb8f9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f409e210 con 0x7f31f4133e00 2023-09-30T22:28:07.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.482+0000 7f31f8e94700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f31f409d400 0x7f31f409d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.482+0000 7f31f9695700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31f4133e00 0x7f31f41341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.482+0000 7f31f9695700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31f4133e00 0x7f31f41341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52784/0 (socket says 172.21.15.40:52784) 2023-09-30T22:28:07.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.482+0000 7f31f8e94700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f31f409d400 0x7f31f409d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39390/0 (socket says 172.21.15.40:39390) 2023-09-30T22:28:07.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.482+0000 7f31f9695700 1 -- 172.21.15.40:0/1262049410 learned_addr learned my addr 172.21.15.40:0/1262049410 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:07.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.483+0000 7f31f9695700 1 -- 172.21.15.40:0/1262049410 >> v2:172.21.15.40:3300/0 conn(0x7f31f409d400 msgr2=0x7f31f409d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:07.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.483+0000 7f31f9695700 1 --2- 172.21.15.40:0/1262049410 >> v2:172.21.15.40:3300/0 conn(0x7f31f409d400 0x7f31f409d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.483+0000 7f31f9695700 1 -- 172.21.15.40:0/1262049410 >> v1:172.21.15.40:6789/0 conn(0x7f31f409dd70 legacy=0x7f31f413ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.483+0000 7f31f9695700 1 -- 172.21.15.40:0/1262049410 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f4133be0 con 0x7f31f4133e00 2023-09-30T22:28:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.483+0000 7f31f8e94700 1 --2- 172.21.15.40:0/1262049410 >> v2:172.21.15.40:3300/0 conn(0x7f31f409d400 0x7f31f409d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.483+0000 7f31f9695700 1 --2- 172.21.15.40:0/1262049410 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31f4133e00 0x7f31f41341d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f31f00098f0 tx=0x7f31f0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3423aea554afe51f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.483+0000 7f31ebfff700 1 -- 172.21.15.40:0/1262049410 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f0011830 con 0x7f31f4133e00 2023-09-30T22:28:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.483+0000 7f31ebfff700 1 -- 172.21.15.40:0/1262049410 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f0011990 con 0x7f31f4133e00 2023-09-30T22:28:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.483+0000 7f31ebfff700 1 -- 172.21.15.40:0/1262049410 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f0011d20 con 0x7f31f4133e00 2023-09-30T22:28:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.484+0000 7f31fb8f9700 1 -- 172.21.15.40:0/1262049410 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31f4133e00 msgr2=0x7f31f41341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.484+0000 7f31fb8f9700 1 --2- 172.21.15.40:0/1262049410 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31f4133e00 0x7f31f41341d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f31f00098f0 tx=0x7f31f0009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.484+0000 7f31fb8f9700 1 -- 172.21.15.40:0/1262049410 shutdown_connections 2023-09-30T22:28:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.484+0000 7f31fb8f9700 1 --2- 172.21.15.40:0/1262049410 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31f4133e00 0x7f31f41341d0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.484+0000 7f31fb8f9700 1 --2- 172.21.15.40:0/1262049410 >> v2:172.21.15.40:3300/0 conn(0x7f31f409d400 0x7f31f409d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.484+0000 7f31fb8f9700 1 -- 172.21.15.40:0/1262049410 >> 172.21.15.40:0/1262049410 conn(0x7f31f40a2a00 msgr2=0x7f31f40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:07.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.484+0000 7f31fb8f9700 1 -- 172.21.15.40:0/1262049410 shutdown_connections 2023-09-30T22:28:07.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.484+0000 7f31fb8f9700 1 -- 172.21.15.40:0/1262049410 wait complete. 2023-09-30T22:28:07.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.485+0000 7f31fb8f9700 1 Processor -- start 2023-09-30T22:28:07.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.485+0000 7f31fb8f9700 1 -- start start 2023-09-30T22:28:07.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.486+0000 7f31fb8f9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f31f409d400 0x7f31f411ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.486+0000 7f31fb8f9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31f409dd70 0x7f31f411b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.486+0000 7f31fb8f9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31f4133e00 0x7f31f411b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.486+0000 7f31fb8f9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f411c6a0 con 0x7f31f409dd70 2023-09-30T22:28:07.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.486+0000 7f31fb8f9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f411cc80 con 0x7f31f4133e00 2023-09-30T22:28:07.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.486+0000 7f31fb8f9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31f409ff50 con 0x7f31f409d400 2023-09-30T22:28:07.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.486+0000 7f31f9695700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f31f409d400 0x7f31f411ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.486+0000 7f31f9e96700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31f4133e00 0x7f31f411b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.486+0000 7f31f9695700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f31f409d400 0x7f31f411ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52644/0 (socket says 172.21.15.40:52644) 2023-09-30T22:28:07.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.486+0000 7f31f8e94700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31f409dd70 0x7f31f411b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.486+0000 7f31f9695700 1 -- 172.21.15.40:0/959398348 learned_addr learned my addr 172.21.15.40:0/959398348 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:07.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.486+0000 7f31f9e96700 1 -- 172.21.15.40:0/959398348 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f31f409d400 msgr2=0x7f31f411ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:07.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.486+0000 7f31f9e96700 1 --2- 172.21.15.40:0/959398348 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f31f409d400 0x7f31f411ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.486+0000 7f31f9e96700 1 -- 172.21.15.40:0/959398348 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31f409dd70 msgr2=0x7f31f411b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:07.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.486+0000 7f31f9e96700 1 --2- 172.21.15.40:0/959398348 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31f409dd70 0x7f31f411b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.486+0000 7f31f9e96700 1 -- 172.21.15.40:0/959398348 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e40094a0 con 0x7f31f4133e00 2023-09-30T22:28:07.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.486+0000 7f31f9695700 1 --2- 172.21.15.40:0/959398348 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f31f409d400 0x7f31f411ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:07.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.486+0000 7f31f9e96700 1 --2- 172.21.15.40:0/959398348 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31f4133e00 0x7f31f411b5d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f31ec00cbc0 tx=0x7f31ec00ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:07.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.487+0000 7f31e9ffb700 1 -- 172.21.15.40:0/959398348 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec003c00 con 0x7f31f4133e00 2023-09-30T22:28:07.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.487+0000 7f31e9ffb700 1 -- 172.21.15.40:0/959398348 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ec003d60 con 0x7f31f4133e00 2023-09-30T22:28:07.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.487+0000 7f31fb8f9700 1 -- 172.21.15.40:0/959398348 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f0009550 con 0x7f31f4133e00 2023-09-30T22:28:07.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.487+0000 7f31e9ffb700 1 -- 172.21.15.40:0/959398348 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec00aa40 con 0x7f31f4133e00 2023-09-30T22:28:07.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.487+0000 7f31fb8f9700 1 -- 172.21.15.40:0/959398348 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f411e260 con 0x7f31f4133e00 2023-09-30T22:28:07.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.487+0000 7f31e9ffb700 1 -- 172.21.15.40:0/959398348 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f31ec00aba0 con 0x7f31f4133e00 2023-09-30T22:28:07.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.488+0000 7f31e9ffb700 1 -- 172.21.15.40:0/959398348 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f31ec03f5c0 con 0x7f31f4133e00 2023-09-30T22:28:07.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.488+0000 7f31fb8f9700 1 -- 172.21.15.40:0/959398348 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31f412fb50 con 0x7f31f4133e00 2023-09-30T22:28:07.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.492+0000 7f31e9ffb700 1 -- 172.21.15.40:0/959398348 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f31ec012420 con 0x7f31f4133e00 2023-09-30T22:28:07.616 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:07.630 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:07.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.694+0000 7f31fb8f9700 1 -- 172.21.15.40:0/959398348 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f31f4062380 con 0x7f31f4133e00 2023-09-30T22:28:07.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.695+0000 7f31e9ffb700 1 -- 172.21.15.40:0/959398348 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f31ec01a360 con 0x7f31f4133e00 2023-09-30T22:28:07.695 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:07.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.697+0000 7f31fb8f9700 1 -- 172.21.15.40:0/959398348 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31f4133e00 msgr2=0x7f31f411b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:07.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.697+0000 7f31fb8f9700 1 --2- 172.21.15.40:0/959398348 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31f4133e00 0x7f31f411b5d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f31ec00cbc0 tx=0x7f31ec00ced0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.697+0000 7f31fb8f9700 1 -- 172.21.15.40:0/959398348 shutdown_connections 2023-09-30T22:28:07.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.697+0000 7f31fb8f9700 1 --2- 172.21.15.40:0/959398348 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f31f409d400 0x7f31f411ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.697+0000 7f31fb8f9700 1 --2- 172.21.15.40:0/959398348 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31f4133e00 0x7f31f411b5d0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.697+0000 7f31fb8f9700 1 --2- 172.21.15.40:0/959398348 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31f409dd70 0x7f31f411b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.697+0000 7f31fb8f9700 1 -- 172.21.15.40:0/959398348 >> 172.21.15.40:0/959398348 conn(0x7f31f40a2a00 msgr2=0x7f31f41325e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:07.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.697+0000 7f31fb8f9700 1 -- 172.21.15.40:0/959398348 shutdown_connections 2023-09-30T22:28:07.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.697+0000 7f31fb8f9700 1 -- 172.21.15.40:0/959398348 wait complete. 2023-09-30T22:28:07.711 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:07.712 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:07.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.744+0000 7fe88c822700 1 Processor -- start 2023-09-30T22:28:07.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.744+0000 7fe88c822700 1 -- start start 2023-09-30T22:28:07.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.745+0000 7fe88c822700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe88809d920 0x7fe88809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.745+0000 7fe88c822700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe88809f0f0 0x7fe88809e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.745+0000 7fe88c822700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe888133ca0 0x7fe888134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.745+0000 7fe88c822700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe88806b4c0 con 0x7fe888133ca0 2023-09-30T22:28:07.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.745+0000 7fe88c822700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe88809a8f0 con 0x7fe88809f0f0 2023-09-30T22:28:07.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.745+0000 7fe88c822700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe88809f940 con 0x7fe88809d920 2023-09-30T22:28:07.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.745+0000 7fe885d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe88809f0f0 0x7fe88809e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.745+0000 7fe88659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe88809d920 0x7fe88809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.745+0000 7fe886d9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe888133ca0 0x7fe888134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.745+0000 7fe885d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe88809f0f0 0x7fe88809e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52802/0 (socket says 172.21.15.40:52802) 2023-09-30T22:28:07.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.745+0000 7fe88659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe88809d920 0x7fe88809dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52660/0 (socket says 172.21.15.40:52660) 2023-09-30T22:28:07.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.745+0000 7fe886d9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe888133ca0 0x7fe888134140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39396/0 (socket says 172.21.15.40:39396) 2023-09-30T22:28:07.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.745+0000 7fe885d9b700 1 -- 172.21.15.40:0/1922064318 learned_addr learned my addr 172.21.15.40:0/1922064318 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:07.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.745+0000 7fe885d9b700 1 -- 172.21.15.40:0/1922064318 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe88809d920 msgr2=0x7fe88809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:07.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.745+0000 7fe885d9b700 1 --2- 172.21.15.40:0/1922064318 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe88809d920 0x7fe88809dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.746+0000 7fe885d9b700 1 -- 172.21.15.40:0/1922064318 >> v2:172.21.15.40:3300/0 conn(0x7fe888133ca0 msgr2=0x7fe888134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:07.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.746+0000 7fe885d9b700 1 --2- 172.21.15.40:0/1922064318 >> v2:172.21.15.40:3300/0 conn(0x7fe888133ca0 0x7fe888134140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.746+0000 7fe885d9b700 1 -- 172.21.15.40:0/1922064318 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe88809f6e0 con 0x7fe88809f0f0 2023-09-30T22:28:07.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.746+0000 7fe88659c700 1 --2- 172.21.15.40:0/1922064318 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe88809d920 0x7fe88809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:07.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.746+0000 7fe885d9b700 1 --2- 172.21.15.40:0/1922064318 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe88809f0f0 0x7fe88809e230 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe87c009950 tx=0x7fe87c009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e95a14788c8755d4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:07.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.746+0000 7fe88559a700 1 -- 172.21.15.40:0/1922064318 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c011830 con 0x7fe88809f0f0 2023-09-30T22:28:07.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.746+0000 7fe88559a700 1 -- 172.21.15.40:0/1922064318 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87c011990 con 0x7fe88809f0f0 2023-09-30T22:28:07.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.746+0000 7fe88559a700 1 -- 172.21.15.40:0/1922064318 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c011d40 con 0x7fe88809f0f0 2023-09-30T22:28:07.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.747+0000 7fe88c822700 1 -- 172.21.15.40:0/1922064318 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe88809f0f0 msgr2=0x7fe88809e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:07.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.747+0000 7fe88c822700 1 --2- 172.21.15.40:0/1922064318 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe88809f0f0 0x7fe88809e230 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe87c009950 tx=0x7fe87c009c60 comp rx=0 tx=0).stop 2023-09-30T22:28:07.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.747+0000 7fe88c822700 1 -- 172.21.15.40:0/1922064318 shutdown_connections 2023-09-30T22:28:07.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.747+0000 7fe88c822700 1 --2- 172.21.15.40:0/1922064318 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe88809d920 0x7fe88809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.747+0000 7fe88c822700 1 --2- 172.21.15.40:0/1922064318 >> v2:172.21.15.40:3300/0 conn(0x7fe888133ca0 0x7fe888134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.747+0000 7fe88c822700 1 --2- 172.21.15.40:0/1922064318 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe88809f0f0 0x7fe88809e230 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.747+0000 7fe88c822700 1 -- 172.21.15.40:0/1922064318 >> 172.21.15.40:0/1922064318 conn(0x7fe88809fb20 msgr2=0x7fe88809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:07.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.747+0000 7fe88c822700 1 -- 172.21.15.40:0/1922064318 shutdown_connections 2023-09-30T22:28:07.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.747+0000 7fe88c822700 1 -- 172.21.15.40:0/1922064318 wait complete. 2023-09-30T22:28:07.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.748+0000 7fe88c822700 1 Processor -- start 2023-09-30T22:28:07.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.748+0000 7fe88c822700 1 -- start start 2023-09-30T22:28:07.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.748+0000 7fe88c822700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe88809d920 0x7fe8881c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.748+0000 7fe88c822700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe888133ca0 0x7fe8881c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.748+0000 7fe88c822700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe888122b10 0x7fe88811edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.748+0000 7fe88c822700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe888122330 con 0x7fe888133ca0 2023-09-30T22:28:07.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.748+0000 7fe88c822700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe888122760 con 0x7fe888122b10 2023-09-30T22:28:07.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.748+0000 7fe88c822700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8881336b0 con 0x7fe88809d920 2023-09-30T22:28:07.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.748+0000 7fe885d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe888133ca0 0x7fe8881c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.749+0000 7fe886d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe888122b10 0x7fe88811edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.748+0000 7fe88659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe88809d920 0x7fe8881c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.749+0000 7fe886d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe888122b10 0x7fe88811edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52812/0 (socket says 172.21.15.40:52812) 2023-09-30T22:28:07.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.749+0000 7fe886d9d700 1 -- 172.21.15.40:0/1558887550 learned_addr learned my addr 172.21.15.40:0/1558887550 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:07.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.749+0000 7fe885d9b700 1 -- 172.21.15.40:0/1558887550 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe88809d920 msgr2=0x7fe8881c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:07.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.749+0000 7fe885d9b700 1 --2- 172.21.15.40:0/1558887550 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe88809d920 0x7fe8881c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.749+0000 7fe885d9b700 1 -- 172.21.15.40:0/1558887550 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe888122b10 msgr2=0x7fe88811edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:07.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.749+0000 7fe885d9b700 1 --2- 172.21.15.40:0/1558887550 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe888122b10 0x7fe88811edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.749+0000 7fe885d9b700 1 -- 172.21.15.40:0/1558887550 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe878009430 con 0x7fe888133ca0 2023-09-30T22:28:07.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.749+0000 7fe88659c700 1 --2- 172.21.15.40:0/1558887550 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe88809d920 0x7fe8881c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:07.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.749+0000 7fe886d9d700 1 --2- 172.21.15.40:0/1558887550 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe888122b10 0x7fe88811edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:07.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.749+0000 7fe885d9b700 1 --2- 172.21.15.40:0/1558887550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe888133ca0 0x7fe8881c8ef0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fe87c016000 tx=0x7fe87c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:07.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.749+0000 7fe876ffd700 1 -- 172.21.15.40:0/1558887550 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c004450 con 0x7fe888133ca0 2023-09-30T22:28:07.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.749+0000 7fe876ffd700 1 -- 172.21.15.40:0/1558887550 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87c01f070 con 0x7fe888133ca0 2023-09-30T22:28:07.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.749+0000 7fe88c822700 1 -- 172.21.15.40:0/1558887550 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe87c009550 con 0x7fe888133ca0 2023-09-30T22:28:07.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.749+0000 7fe876ffd700 1 -- 172.21.15.40:0/1558887550 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c0038e0 con 0x7fe888133ca0 2023-09-30T22:28:07.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.749+0000 7fe88c822700 1 -- 172.21.15.40:0/1558887550 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe88809c9e0 con 0x7fe888133ca0 2023-09-30T22:28:07.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.750+0000 7fe876ffd700 1 -- 172.21.15.40:0/1558887550 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe87c003a40 con 0x7fe888133ca0 2023-09-30T22:28:07.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.750+0000 7fe876ffd700 1 -- 172.21.15.40:0/1558887550 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe87c021070 con 0x7fe888133ca0 2023-09-30T22:28:07.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.751+0000 7fe88c822700 1 -- 172.21.15.40:0/1558887550 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe88806ae10 con 0x7fe888133ca0 2023-09-30T22:28:07.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.756+0000 7fe876ffd700 1 -- 172.21.15.40:0/1558887550 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe87c015080 con 0x7fe888133ca0 2023-09-30T22:28:07.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.791+0000 7efd6c010700 1 Processor -- start 2023-09-30T22:28:07.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.791+0000 7efd6c010700 1 -- start start 2023-09-30T22:28:07.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.792+0000 7efd6c010700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efd6409d920 0x7efd6409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.792+0000 7efd6c010700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd6409f0f0 0x7efd6409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.792+0000 7efd6c010700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd64133ca0 0x7efd64134110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.792+0000 7efd6c010700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd6406b4c0 con 0x7efd6409d920 2023-09-30T22:28:07.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.792+0000 7efd6c010700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6409a8f0 con 0x7efd6409f0f0 2023-09-30T22:28:07.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.792+0000 7efd6c010700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd6409f940 con 0x7efd64133ca0 2023-09-30T22:28:07.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.792+0000 7efd69dac700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efd6409d920 0x7efd6409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.792+0000 7efd69dac700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efd6409d920 0x7efd6409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39408/0 (socket says 172.21.15.40:39408) 2023-09-30T22:28:07.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.792+0000 7efd69dac700 1 -- 172.21.15.40:0/1876485379 learned_addr learned my addr 172.21.15.40:0/1876485379 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:07.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.792+0000 7efd6a5ad700 1 --2- 172.21.15.40:0/1876485379 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd64133ca0 0x7efd64134110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.792+0000 7efd695ab700 1 --2- 172.21.15.40:0/1876485379 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd6409f0f0 0x7efd6409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.793+0000 7efd69dac700 1 -- 172.21.15.40:0/1876485379 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd64133ca0 msgr2=0x7efd64134110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:07.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.793+0000 7efd69dac700 1 --2- 172.21.15.40:0/1876485379 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd64133ca0 0x7efd64134110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.793+0000 7efd69dac700 1 -- 172.21.15.40:0/1876485379 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd6409f0f0 msgr2=0x7efd6409e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:07.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.793+0000 7efd69dac700 1 --2- 172.21.15.40:0/1876485379 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd6409f0f0 0x7efd6409e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.793+0000 7efd69dac700 1 -- 172.21.15.40:0/1876485379 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6409f6e0 con 0x7efd6409d920 2023-09-30T22:28:07.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.793+0000 7efd69dac700 1 --2- 172.21.15.40:0/1876485379 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd6409d920 0x7efd6409dcf0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7efd600098f0 tx=0x7efd60009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d29133dd2b99fab server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:07.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.793+0000 7efd68daa700 1 -- 172.21.15.40:0/1876485379 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd60005e30 con 0x7efd6409d920 2023-09-30T22:28:07.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.793+0000 7efd68daa700 1 -- 172.21.15.40:0/1876485379 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd60004030 con 0x7efd6409d920 2023-09-30T22:28:07.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.793+0000 7efd68daa700 1 -- 172.21.15.40:0/1876485379 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd600043e0 con 0x7efd6409d920 2023-09-30T22:28:07.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.794+0000 7efd6c010700 1 -- 172.21.15.40:0/1876485379 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd6409d920 msgr2=0x7efd6409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:07.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.794+0000 7efd6c010700 1 --2- 172.21.15.40:0/1876485379 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd6409d920 0x7efd6409dcf0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7efd600098f0 tx=0x7efd60009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:07.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.794+0000 7efd6c010700 1 -- 172.21.15.40:0/1876485379 shutdown_connections 2023-09-30T22:28:07.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.794+0000 7efd6c010700 1 --2- 172.21.15.40:0/1876485379 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd64133ca0 0x7efd64134110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.794+0000 7efd6c010700 1 --2- 172.21.15.40:0/1876485379 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd6409d920 0x7efd6409dcf0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.794+0000 7efd6c010700 1 --2- 172.21.15.40:0/1876485379 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd6409f0f0 0x7efd6409e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.794+0000 7efd6c010700 1 -- 172.21.15.40:0/1876485379 >> 172.21.15.40:0/1876485379 conn(0x7efd6409fb20 msgr2=0x7efd6409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:07.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.794+0000 7efd6c010700 1 -- 172.21.15.40:0/1876485379 shutdown_connections 2023-09-30T22:28:07.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.794+0000 7efd6c010700 1 -- 172.21.15.40:0/1876485379 wait complete. 2023-09-30T22:28:07.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.795+0000 7efd6c010700 1 Processor -- start 2023-09-30T22:28:07.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.795+0000 7efd6c010700 1 -- start start 2023-09-30T22:28:07.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.795+0000 7efd6c010700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd6409d920 0x7efd64121a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.795+0000 7efd6c010700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd64133ca0 0x7efd64121fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.795+0000 7efd6c010700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd641224f0 0x7efd641c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.795+0000 7efd6c010700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd64132a30 con 0x7efd64133ca0 2023-09-30T22:28:07.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.795+0000 7efd6c010700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd64123720 con 0x7efd6409d920 2023-09-30T22:28:07.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.795+0000 7efd6c010700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd641252b0 con 0x7efd641224f0 2023-09-30T22:28:07.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.795+0000 7efd6a5ad700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd641224f0 0x7efd641c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.795+0000 7efd69dac700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd6409d920 0x7efd64121a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.796+0000 7efd6a5ad700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd641224f0 0x7efd641c87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52690/0 (socket says 172.21.15.40:52690) 2023-09-30T22:28:07.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.796+0000 7efd6a5ad700 1 -- 172.21.15.40:0/1846690133 learned_addr learned my addr 172.21.15.40:0/1846690133 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:07.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.796+0000 7efd69dac700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd6409d920 0x7efd64121a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52834/0 (socket says 172.21.15.40:52834) 2023-09-30T22:28:07.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.796+0000 7efd695ab700 1 --2- 172.21.15.40:0/1846690133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd64133ca0 0x7efd64121fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.796+0000 7efd69dac700 1 -- 172.21.15.40:0/1846690133 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd641224f0 msgr2=0x7efd641c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:07.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.796+0000 7efd69dac700 1 --2- 172.21.15.40:0/1846690133 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd641224f0 0x7efd641c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.796+0000 7efd69dac700 1 -- 172.21.15.40:0/1846690133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd64133ca0 msgr2=0x7efd64121fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:07.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.796+0000 7efd69dac700 1 --2- 172.21.15.40:0/1846690133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd64133ca0 0x7efd64121fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.796+0000 7efd69dac700 1 -- 172.21.15.40:0/1846690133 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd60009500 con 0x7efd6409d920 2023-09-30T22:28:07.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.796+0000 7efd6a5ad700 1 --2- 172.21.15.40:0/1846690133 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd641224f0 0x7efd641c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:07.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.796+0000 7efd69dac700 1 --2- 172.21.15.40:0/1846690133 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd6409d920 0x7efd64121a70 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7efd600098f0 tx=0x7efd60004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:07.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.796+0000 7efd5a7fc700 1 -- 172.21.15.40:0/1846690133 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd60003bb0 con 0x7efd6409d920 2023-09-30T22:28:07.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.796+0000 7efd5a7fc700 1 -- 172.21.15.40:0/1846690133 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd60003d10 con 0x7efd6409d920 2023-09-30T22:28:07.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.796+0000 7efd6c010700 1 -- 172.21.15.40:0/1846690133 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd640a2a90 con 0x7efd6409d920 2023-09-30T22:28:07.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.796+0000 7efd5a7fc700 1 -- 172.21.15.40:0/1846690133 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6001c660 con 0x7efd6409d920 2023-09-30T22:28:07.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.796+0000 7efd6c010700 1 -- 172.21.15.40:0/1846690133 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd64132590 con 0x7efd6409d920 2023-09-30T22:28:07.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.797+0000 7efd5a7fc700 1 -- 172.21.15.40:0/1846690133 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efd6001c7c0 con 0x7efd6409d920 2023-09-30T22:28:07.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.797+0000 7efd5a7fc700 1 -- 172.21.15.40:0/1846690133 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7efd60040380 con 0x7efd6409d920 2023-09-30T22:28:07.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.798+0000 7efd6c010700 1 -- 172.21.15.40:0/1846690133 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd64062380 con 0x7efd6409d920 2023-09-30T22:28:07.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.803+0000 7efd5a7fc700 1 -- 172.21.15.40:0/1846690133 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efd60016080 con 0x7efd6409d920 2023-09-30T22:28:07.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.876+0000 7fa6a45bc700 1 Processor -- start 2023-09-30T22:28:07.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.876+0000 7fa6a45bc700 1 -- start start 2023-09-30T22:28:07.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.877+0000 7fa6a45bc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa69c06f070 0x7fa69c06f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.877+0000 7fa6a45bc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa69c06f980 0x7fa69c097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.877+0000 7fa6a45bc700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa69c070830 con 0x7fa69c06fdb0 2023-09-30T22:28:07.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.877+0000 7fa6a45bc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c071af0 con 0x7fa69c06f070 2023-09-30T22:28:07.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.877+0000 7fa6a45bc700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c070ad0 con 0x7fa69c06f980 2023-09-30T22:28:07.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.877+0000 7fa6a2b59700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa69c06fdb0 0x7fa69c0975d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43668/0 (socket says 172.21.15.40:43668) 2023-09-30T22:28:07.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.877+0000 7fa6a2358700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa69c06f070 0x7fa69c06f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.877+0000 7fa6a2b59700 1 -- 172.21.15.40:0/3597913683 learned_addr learned my addr 172.21.15.40:0/3597913683 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:07.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.877+0000 7fa6a1b57700 1 --2- 172.21.15.40:0/3597913683 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa69c06f980 0x7fa69c097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.877+0000 7fa6a2358700 1 -- 172.21.15.40:0/3597913683 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa69c06f980 msgr2=0x7fa69c097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:07.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.877+0000 7fa6a2358700 1 --2- 172.21.15.40:0/3597913683 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa69c06f980 0x7fa69c097090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.877+0000 7fa6a2358700 1 -- 172.21.15.40:0/3597913683 >> v1:172.21.15.40:6789/0 conn(0x7fa69c06fdb0 legacy=0x7fa69c0975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:07.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.877+0000 7fa6a1356700 1 -- 172.21.15.40:0/3597913683 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2348775794 0 0) 0x7fa69c070830 con 0x7fa69c06fdb0 2023-09-30T22:28:07.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.877+0000 7fa6a2358700 1 -- 172.21.15.40:0/3597913683 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69c070de0 con 0x7fa69c06f070 2023-09-30T22:28:07.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.877+0000 7fa6a1b57700 1 --2- 172.21.15.40:0/3597913683 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa69c06f980 0x7fa69c097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:07.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.878+0000 7fa6a2358700 1 --2- 172.21.15.40:0/3597913683 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa69c06f070 0x7fa69c06f440 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa694009dc0 tx=0x7fa69400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd6a048bc0fc6813 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:07.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.878+0000 7fa6a1356700 1 -- 172.21.15.40:0/3597913683 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69400bd20 con 0x7fa69c06f070 2023-09-30T22:28:07.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.878+0000 7fa6a1356700 1 -- 172.21.15.40:0/3597913683 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa69400be80 con 0x7fa69c06f070 2023-09-30T22:28:07.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.878+0000 7fa6a1356700 1 -- 172.21.15.40:0/3597913683 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa694010710 con 0x7fa69c06f070 2023-09-30T22:28:07.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.878+0000 7fa6a45bc700 1 -- 172.21.15.40:0/3597913683 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa69c06f070 msgr2=0x7fa69c06f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:07.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.878+0000 7fa6a45bc700 1 --2- 172.21.15.40:0/3597913683 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa69c06f070 0x7fa69c06f440 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa694009dc0 tx=0x7fa69400b330 comp rx=0 tx=0).stop 2023-09-30T22:28:07.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.878+0000 7fa6a45bc700 1 -- 172.21.15.40:0/3597913683 shutdown_connections 2023-09-30T22:28:07.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.878+0000 7fa6a45bc700 1 --2- 172.21.15.40:0/3597913683 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa69c06f070 0x7fa69c06f440 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.878+0000 7fa6a45bc700 1 --2- 172.21.15.40:0/3597913683 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa69c06f980 0x7fa69c097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.878+0000 7fa6a45bc700 1 -- 172.21.15.40:0/3597913683 >> 172.21.15.40:0/3597913683 conn(0x7fa69c0a41a0 msgr2=0x7fa69c0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:07.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.879+0000 7fa6a45bc700 1 -- 172.21.15.40:0/3597913683 shutdown_connections 2023-09-30T22:28:07.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.879+0000 7fa6a45bc700 1 -- 172.21.15.40:0/3597913683 wait complete. 2023-09-30T22:28:07.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.879+0000 7fa6a45bc700 1 Processor -- start 2023-09-30T22:28:07.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.880+0000 7fa6a45bc700 1 -- start start 2023-09-30T22:28:07.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.880+0000 7fa6a45bc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa69c06f070 0x7fa69c12c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.880+0000 7fa6a45bc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa69c06f980 0x7fa69c12c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.880+0000 7fa6a45bc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa69c06fdb0 0x7fa69c12cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.880+0000 7fa6a45bc700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c09e5c0 con 0x7fa69c06fdb0 2023-09-30T22:28:07.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.880+0000 7fa6a45bc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c12e530 con 0x7fa69c06f980 2023-09-30T22:28:07.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.880+0000 7fa6a45bc700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c12ea60 con 0x7fa69c06f070 2023-09-30T22:28:07.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.880+0000 7fa6a1b57700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa69c06f980 0x7fa69c12c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.880+0000 7fa6a1b57700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa69c06f980 0x7fa69c12c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52842/0 (socket says 172.21.15.40:52842) 2023-09-30T22:28:07.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.880+0000 7fa6a1b57700 1 -- 172.21.15.40:0/3020044215 learned_addr learned my addr 172.21.15.40:0/3020044215 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:07.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.880+0000 7fa6a2358700 1 --2- 172.21.15.40:0/3020044215 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa69c06f070 0x7fa69c12c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.880+0000 7fa6a2b59700 1 --2- 172.21.15.40:0/3020044215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa69c06fdb0 0x7fa69c12cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.880+0000 7fa6a1b57700 1 -- 172.21.15.40:0/3020044215 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa69c06f070 msgr2=0x7fa69c12c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:07.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.880+0000 7fa6a1b57700 1 --2- 172.21.15.40:0/3020044215 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa69c06f070 0x7fa69c12c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.880+0000 7fa6a1b57700 1 -- 172.21.15.40:0/3020044215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa69c06fdb0 msgr2=0x7fa69c12cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:07.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.880+0000 7fa6a1b57700 1 --2- 172.21.15.40:0/3020044215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa69c06fdb0 0x7fa69c12cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.881+0000 7fa6a1b57700 1 -- 172.21.15.40:0/3020044215 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6900094a0 con 0x7fa69c06f980 2023-09-30T22:28:07.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.881+0000 7fa6a2358700 1 --2- 172.21.15.40:0/3020044215 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa69c06f070 0x7fa69c12c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:07.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.881+0000 7fa6a1b57700 1 --2- 172.21.15.40:0/3020044215 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa69c06f980 0x7fa69c12c810 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa69000ebe0 tx=0x7fa69000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:07.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.881+0000 7fa69affd700 1 -- 172.21.15.40:0/3020044215 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69000c850 con 0x7fa69c06f980 2023-09-30T22:28:07.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.881+0000 7fa69affd700 1 -- 172.21.15.40:0/3020044215 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa69000c9b0 con 0x7fa69c06f980 2023-09-30T22:28:07.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.881+0000 7fa6a45bc700 1 -- 172.21.15.40:0/3020044215 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa694009a70 con 0x7fa69c06f980 2023-09-30T22:28:07.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.881+0000 7fa69affd700 1 -- 172.21.15.40:0/3020044215 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69000cd40 con 0x7fa69c06f980 2023-09-30T22:28:07.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.881+0000 7fa6a45bc700 1 -- 172.21.15.40:0/3020044215 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa69c09d3e0 con 0x7fa69c06f980 2023-09-30T22:28:07.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.882+0000 7fa69affd700 1 -- 172.21.15.40:0/3020044215 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa690013470 con 0x7fa69c06f980 2023-09-30T22:28:07.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.882+0000 7fa69affd700 1 -- 172.21.15.40:0/3020044215 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa69003fb00 con 0x7fa69c06f980 2023-09-30T22:28:07.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.882+0000 7fa6a45bc700 1 -- 172.21.15.40:0/3020044215 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa69c0996d0 con 0x7fa69c06f980 2023-09-30T22:28:07.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.891+0000 7fa69affd700 1 -- 172.21.15.40:0/3020044215 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa690021080 con 0x7fa69c06f980 2023-09-30T22:28:07.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.956+0000 7fe88c822700 1 -- 172.21.15.40:0/1558887550 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe888122570 con 0x7fe888133ca0 2023-09-30T22:28:07.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.956+0000 7fe876ffd700 1 -- 172.21.15.40:0/1558887550 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe87c02b020 con 0x7fe888133ca0 2023-09-30T22:28:07.957 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:07.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.958+0000 7fe88c822700 1 -- 172.21.15.40:0/1558887550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe888133ca0 msgr2=0x7fe8881c8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:07.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.958+0000 7fe88c822700 1 --2- 172.21.15.40:0/1558887550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe888133ca0 0x7fe8881c8ef0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fe87c016000 tx=0x7fe87c004750 comp rx=0 tx=0).stop 2023-09-30T22:28:07.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.958+0000 7fe88c822700 1 -- 172.21.15.40:0/1558887550 shutdown_connections 2023-09-30T22:28:07.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.958+0000 7fe88c822700 1 --2- 172.21.15.40:0/1558887550 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe88809d920 0x7fe8881c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.958+0000 7fe88c822700 1 --2- 172.21.15.40:0/1558887550 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe888122b10 0x7fe88811edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.958+0000 7fe88c822700 1 --2- 172.21.15.40:0/1558887550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe888133ca0 0x7fe8881c8ef0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.958+0000 7fe88c822700 1 -- 172.21.15.40:0/1558887550 >> 172.21.15.40:0/1558887550 conn(0x7fe88809fb20 msgr2=0x7fe8880a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:07.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.958+0000 7fe88c822700 1 -- 172.21.15.40:0/1558887550 shutdown_connections 2023-09-30T22:28:07.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:07.958+0000 7fe88c822700 1 -- 172.21.15.40:0/1558887550 wait complete. 2023-09-30T22:28:07.971 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:08.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.006+0000 7efd6c010700 1 -- 172.21.15.40:0/1846690133 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efd640a2510 con 0x7efd6409d920 2023-09-30T22:28:08.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.007+0000 7efd5a7fc700 1 -- 172.21.15.40:0/1846690133 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efd60020020 con 0x7efd6409d920 2023-09-30T22:28:08.008 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:08.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.009+0000 7efd6c010700 1 -- 172.21.15.40:0/1846690133 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd6409d920 msgr2=0x7efd64121a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:08.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.009+0000 7efd6c010700 1 --2- 172.21.15.40:0/1846690133 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd6409d920 0x7efd64121a70 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7efd600098f0 tx=0x7efd60004750 comp rx=0 tx=0).stop 2023-09-30T22:28:08.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.009+0000 7efd6c010700 1 -- 172.21.15.40:0/1846690133 shutdown_connections 2023-09-30T22:28:08.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.009+0000 7efd6c010700 1 --2- 172.21.15.40:0/1846690133 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd641224f0 0x7efd641c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.009+0000 7efd6c010700 1 --2- 172.21.15.40:0/1846690133 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd6409d920 0x7efd64121a70 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.009+0000 7efd6c010700 1 --2- 172.21.15.40:0/1846690133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd64133ca0 0x7efd64121fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.009+0000 7efd6c010700 1 -- 172.21.15.40:0/1846690133 >> 172.21.15.40:0/1846690133 conn(0x7efd6409fb20 msgr2=0x7efd640a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:08.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.009+0000 7efd6c010700 1 -- 172.21.15.40:0/1846690133 shutdown_connections 2023-09-30T22:28:08.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.009+0000 7efd6c010700 1 -- 172.21.15.40:0/1846690133 wait complete. 2023-09-30T22:28:08.022 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:08.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.086+0000 7fa6a45bc700 1 -- 172.21.15.40:0/3020044215 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa69c062380 con 0x7fa69c06f980 2023-09-30T22:28:08.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.086+0000 7fa69affd700 1 -- 172.21.15.40:0/3020044215 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa690017020 con 0x7fa69c06f980 2023-09-30T22:28:08.087 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:08.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.088+0000 7fa6a45bc700 1 -- 172.21.15.40:0/3020044215 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa69c06f980 msgr2=0x7fa69c12c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:08.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.088+0000 7fa6a45bc700 1 --2- 172.21.15.40:0/3020044215 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa69c06f980 0x7fa69c12c810 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa69000ebe0 tx=0x7fa69000eef0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.088+0000 7fa6a45bc700 1 -- 172.21.15.40:0/3020044215 shutdown_connections 2023-09-30T22:28:08.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.088+0000 7fa6a45bc700 1 --2- 172.21.15.40:0/3020044215 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa69c06f070 0x7fa69c12c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.088+0000 7fa6a45bc700 1 --2- 172.21.15.40:0/3020044215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa69c06fdb0 0x7fa69c12cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.088+0000 7fa6a45bc700 1 --2- 172.21.15.40:0/3020044215 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa69c06f980 0x7fa69c12c810 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.089+0000 7fa6a45bc700 1 -- 172.21.15.40:0/3020044215 >> 172.21.15.40:0/3020044215 conn(0x7fa69c0a41a0 msgr2=0x7fa69c097330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:08.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.089+0000 7fa6a45bc700 1 -- 172.21.15.40:0/3020044215 shutdown_connections 2023-09-30T22:28:08.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.089+0000 7fa6a45bc700 1 -- 172.21.15.40:0/3020044215 wait complete. 2023-09-30T22:28:08.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:08.712 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:08.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.852+0000 7f77eb6a4700 1 Processor -- start 2023-09-30T22:28:08.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.853+0000 7f77eb6a4700 1 -- start start 2023-09-30T22:28:08.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.854+0000 7f77eb6a4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77e412e590 0x7f77e412e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:08.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.854+0000 7f77eb6a4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f77e412eea0 0x7f77e412d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:08.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.854+0000 7f77eb6a4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f77e412d6d0 0x7f77e412db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:08.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.854+0000 7f77eb6a4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e409ca30 con 0x7f77e412d6d0 2023-09-30T22:28:08.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.854+0000 7f77eb6a4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e409ab70 con 0x7f77e412e590 2023-09-30T22:28:08.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.854+0000 7f77eb6a4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77e409bd70 con 0x7f77e412eea0 2023-09-30T22:28:08.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.854+0000 7f77e9440700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77e412e590 0x7f77e412e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:08.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.854+0000 7f77e9c41700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f77e412d6d0 0x7f77e412db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:08.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.854+0000 7f77e9440700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77e412e590 0x7f77e412e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52854/0 (socket says 172.21.15.40:52854) 2023-09-30T22:28:08.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.854+0000 7f77e9440700 1 -- 172.21.15.40:0/1998640009 learned_addr learned my addr 172.21.15.40:0/1998640009 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:08.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.854+0000 7f77e8c3f700 1 --2- 172.21.15.40:0/1998640009 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f77e412eea0 0x7f77e412d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:08.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.854+0000 7f77e9c41700 1 -- 172.21.15.40:0/1998640009 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f77e412eea0 msgr2=0x7f77e412d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:08.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.854+0000 7f77e9c41700 1 --2- 172.21.15.40:0/1998640009 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f77e412eea0 0x7f77e412d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.854+0000 7f77e9c41700 1 -- 172.21.15.40:0/1998640009 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77e412e590 msgr2=0x7f77e412e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:08.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.854+0000 7f77e9c41700 1 --2- 172.21.15.40:0/1998640009 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77e412e590 0x7f77e412e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.854+0000 7f77e9c41700 1 -- 172.21.15.40:0/1998640009 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e409b270 con 0x7f77e412d6d0 2023-09-30T22:28:08.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.854+0000 7f77e9440700 1 --2- 172.21.15.40:0/1998640009 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77e412e590 0x7f77e412e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:08.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.854+0000 7f77e9c41700 1 --2- 172.21.15.40:0/1998640009 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77e412d6d0 0x7f77e412db70 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f77dc00bfa0 tx=0x7f77dc00d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54fc66abb9810f7e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:08.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.854+0000 7f77dbfff700 1 -- 172.21.15.40:0/1998640009 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc010070 con 0x7f77e412d6d0 2023-09-30T22:28:08.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.854+0000 7f77dbfff700 1 -- 172.21.15.40:0/1998640009 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77dc00b2e0 con 0x7f77e412d6d0 2023-09-30T22:28:08.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.855+0000 7f77dbfff700 1 -- 172.21.15.40:0/1998640009 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc00dc40 con 0x7f77e412d6d0 2023-09-30T22:28:08.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.855+0000 7f77eb6a4700 1 -- 172.21.15.40:0/1998640009 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77e412d6d0 msgr2=0x7f77e412db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:08.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.855+0000 7f77eb6a4700 1 --2- 172.21.15.40:0/1998640009 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77e412d6d0 0x7f77e412db70 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f77dc00bfa0 tx=0x7f77dc00d330 comp rx=0 tx=0).stop 2023-09-30T22:28:08.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.855+0000 7f77eb6a4700 1 -- 172.21.15.40:0/1998640009 shutdown_connections 2023-09-30T22:28:08.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.855+0000 7f77eb6a4700 1 --2- 172.21.15.40:0/1998640009 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77e412d6d0 0x7f77e412db70 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.855+0000 7f77eb6a4700 1 --2- 172.21.15.40:0/1998640009 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77e412e590 0x7f77e412e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.855+0000 7f77eb6a4700 1 --2- 172.21.15.40:0/1998640009 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f77e412eea0 0x7f77e412d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.855+0000 7f77eb6a4700 1 -- 172.21.15.40:0/1998640009 >> 172.21.15.40:0/1998640009 conn(0x7f77e40a2a00 msgr2=0x7f77e40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:08.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.855+0000 7f77eb6a4700 1 -- 172.21.15.40:0/1998640009 shutdown_connections 2023-09-30T22:28:08.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.855+0000 7f77eb6a4700 1 -- 172.21.15.40:0/1998640009 wait complete. 2023-09-30T22:28:08.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.856+0000 7f77eb6a4700 1 Processor -- start 2023-09-30T22:28:08.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.857+0000 7f77eb6a4700 1 -- start start 2023-09-30T22:28:08.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.857+0000 7f77eb6a4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77e412d6d0 0x7f77e4119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:08.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.857+0000 7f77eb6a4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f77e412e590 0x7f77e4119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:08.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.857+0000 7f77eb6a4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77e412eea0 0x7f77e4119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:08.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.857+0000 7f77eb6a4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e411bbc0 con 0x7f77e412eea0 2023-09-30T22:28:08.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.857+0000 7f77eb6a4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e411b690 con 0x7f77e412d6d0 2023-09-30T22:28:08.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.857+0000 7f77eb6a4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77e411a4e0 con 0x7f77e412e590 2023-09-30T22:28:08.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.857+0000 7f77e9440700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77e412d6d0 0x7f77e4119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:08.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.857+0000 7f77e9440700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77e412d6d0 0x7f77e4119050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52856/0 (socket says 172.21.15.40:52856) 2023-09-30T22:28:08.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.857+0000 7f77e9440700 1 -- 172.21.15.40:0/238002507 learned_addr learned my addr 172.21.15.40:0/238002507 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:08.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.857+0000 7f77e8c3f700 1 --2- 172.21.15.40:0/238002507 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f77e412e590 0x7f77e4119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:08.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.857+0000 7f77e9c41700 1 --2- 172.21.15.40:0/238002507 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77e412eea0 0x7f77e4119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:08.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.858+0000 7f77e9440700 1 -- 172.21.15.40:0/238002507 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f77e412e590 msgr2=0x7f77e4119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:08.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.858+0000 7f77e9440700 1 --2- 172.21.15.40:0/238002507 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f77e412e590 0x7f77e4119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.858+0000 7f77e9440700 1 -- 172.21.15.40:0/238002507 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77e412eea0 msgr2=0x7f77e4119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:08.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.858+0000 7f77e9440700 1 --2- 172.21.15.40:0/238002507 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77e412eea0 0x7f77e4119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.858+0000 7f77e9440700 1 -- 172.21.15.40:0/238002507 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e0009550 con 0x7f77e412d6d0 2023-09-30T22:28:08.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.858+0000 7f77e8c3f700 1 --2- 172.21.15.40:0/238002507 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f77e412e590 0x7f77e4119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:08.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.858+0000 7f77e9440700 1 --2- 172.21.15.40:0/238002507 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77e412d6d0 0x7f77e4119050 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f77e000ebe0 tx=0x7f77e000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:08.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.858+0000 7f77d9ffb700 1 -- 172.21.15.40:0/238002507 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e0004030 con 0x7f77e412d6d0 2023-09-30T22:28:08.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.858+0000 7f77d9ffb700 1 -- 172.21.15.40:0/238002507 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e0004190 con 0x7f77e412d6d0 2023-09-30T22:28:08.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.858+0000 7f77eb6a4700 1 -- 172.21.15.40:0/238002507 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77dc00bc80 con 0x7f77e412d6d0 2023-09-30T22:28:08.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.858+0000 7f77d9ffb700 1 -- 172.21.15.40:0/238002507 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e0004520 con 0x7f77e412d6d0 2023-09-30T22:28:08.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.858+0000 7f77eb6a4700 1 -- 172.21.15.40:0/238002507 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e411c0c0 con 0x7f77e412d6d0 2023-09-30T22:28:08.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.859+0000 7f77d9ffb700 1 -- 172.21.15.40:0/238002507 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f77e000c850 con 0x7f77e412d6d0 2023-09-30T22:28:08.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.859+0000 7f77d9ffb700 1 -- 172.21.15.40:0/238002507 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f77e003f740 con 0x7f77e412d6d0 2023-09-30T22:28:08.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.859+0000 7f77eb6a4700 1 -- 172.21.15.40:0/238002507 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e411c0c0 con 0x7f77e412d6d0 2023-09-30T22:28:08.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:08.864+0000 7f77d9ffb700 1 -- 172.21.15.40:0/238002507 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f77e411c0c0 con 0x7f77e412d6d0 2023-09-30T22:28:08.972 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:09.023 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:09.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.066+0000 7f77eb6a4700 1 -- 172.21.15.40:0/238002507 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f77e411c0c0 con 0x7f77e412d6d0 2023-09-30T22:28:09.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.066+0000 7f77d9ffb700 1 -- 172.21.15.40:0/238002507 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f77e411c0c0 con 0x7f77e412d6d0 2023-09-30T22:28:09.067 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:09.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.068+0000 7f77eb6a4700 1 -- 172.21.15.40:0/238002507 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77e412d6d0 msgr2=0x7f77e4119050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:09.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.068+0000 7f77eb6a4700 1 --2- 172.21.15.40:0/238002507 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77e412d6d0 0x7f77e4119050 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f77e000ebe0 tx=0x7f77e000eef0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.068+0000 7f77eb6a4700 1 -- 172.21.15.40:0/238002507 shutdown_connections 2023-09-30T22:28:09.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.068+0000 7f77eb6a4700 1 --2- 172.21.15.40:0/238002507 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77e412eea0 0x7f77e4119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.068+0000 7f77eb6a4700 1 --2- 172.21.15.40:0/238002507 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77e412d6d0 0x7f77e4119050 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.068+0000 7f77eb6a4700 1 --2- 172.21.15.40:0/238002507 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f77e412e590 0x7f77e4119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.068+0000 7f77eb6a4700 1 -- 172.21.15.40:0/238002507 >> 172.21.15.40:0/238002507 conn(0x7f77e40a2a00 msgr2=0x7f77e412ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:09.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.068+0000 7f77eb6a4700 1 -- 172.21.15.40:0/238002507 shutdown_connections 2023-09-30T22:28:09.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.068+0000 7f77eb6a4700 1 -- 172.21.15.40:0/238002507 wait complete. 2023-09-30T22:28:09.082 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:09.102 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:09.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.102+0000 7f8015ded700 1 Processor -- start 2023-09-30T22:28:09.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.102+0000 7f8015ded700 1 -- start start 2023-09-30T22:28:09.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.103+0000 7f8015ded700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f801009c890 0x7f801009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:09.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.103+0000 7f8015ded700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f801009d920 0x7f801009dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:09.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.103+0000 7f8015ded700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f801009e2b0 0x7f801013ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:09.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.103+0000 7f8015ded700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80100a29d0 con 0x7f801009d920 2023-09-30T22:28:09.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.103+0000 7f8015ded700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801009fb40 con 0x7f801009e2b0 2023-09-30T22:28:09.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.103+0000 7f8015ded700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80100a2600 con 0x7f801009c890 2023-09-30T22:28:09.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.103+0000 7f800ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f801009e2b0 0x7f801013ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:09.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.103+0000 7f800effd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f801009d920 0x7f801009dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:09.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.103+0000 7f800f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f801009c890 0x7f801009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:09.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.103+0000 7f800ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f801009e2b0 0x7f801013ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52858/0 (socket says 172.21.15.40:52858) 2023-09-30T22:28:09.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.103+0000 7f800effd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f801009d920 0x7f801009dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39438/0 (socket says 172.21.15.40:39438) 2023-09-30T22:28:09.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.103+0000 7f800ffff700 1 -- 172.21.15.40:0/2174082804 learned_addr learned my addr 172.21.15.40:0/2174082804 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:09.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.103+0000 7f800ffff700 1 -- 172.21.15.40:0/2174082804 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f801009c890 msgr2=0x7f801009cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:09.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.103+0000 7f800ffff700 1 --2- 172.21.15.40:0/2174082804 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f801009c890 0x7f801009cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.103+0000 7f800ffff700 1 -- 172.21.15.40:0/2174082804 >> v2:172.21.15.40:3300/0 conn(0x7f801009d920 msgr2=0x7f801009dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:09.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.103+0000 7f800ffff700 1 --2- 172.21.15.40:0/2174082804 >> v2:172.21.15.40:3300/0 conn(0x7f801009d920 0x7f801009dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.104+0000 7f800ffff700 1 -- 172.21.15.40:0/2174082804 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f801009e750 con 0x7f801009e2b0 2023-09-30T22:28:09.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.104+0000 7f800effd700 1 --2- 172.21.15.40:0/2174082804 >> v2:172.21.15.40:3300/0 conn(0x7f801009d920 0x7f801009dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:09.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.104+0000 7f800ffff700 1 --2- 172.21.15.40:0/2174082804 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f801009e2b0 0x7f801013ac10 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8008009e50 tx=0x7f800800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59d1a2e5bcf62b37 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:09.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.104+0000 7f800e7fc700 1 -- 172.21.15.40:0/2174082804 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800800e070 con 0x7f801009e2b0 2023-09-30T22:28:09.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.104+0000 7f800e7fc700 1 -- 172.21.15.40:0/2174082804 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800800b910 con 0x7f801009e2b0 2023-09-30T22:28:09.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.104+0000 7f800e7fc700 1 -- 172.21.15.40:0/2174082804 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800800bcc0 con 0x7f801009e2b0 2023-09-30T22:28:09.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.104+0000 7f8015ded700 1 -- 172.21.15.40:0/2174082804 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f801009e2b0 msgr2=0x7f801013ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:09.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.104+0000 7f8015ded700 1 --2- 172.21.15.40:0/2174082804 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f801009e2b0 0x7f801013ac10 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8008009e50 tx=0x7f800800b330 comp rx=0 tx=0).stop 2023-09-30T22:28:09.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.105+0000 7f8015ded700 1 -- 172.21.15.40:0/2174082804 shutdown_connections 2023-09-30T22:28:09.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.105+0000 7f8015ded700 1 --2- 172.21.15.40:0/2174082804 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f801009c890 0x7f801009cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.105+0000 7f8015ded700 1 --2- 172.21.15.40:0/2174082804 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f801009e2b0 0x7f801013ac10 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.105+0000 7f8015ded700 1 --2- 172.21.15.40:0/2174082804 >> v2:172.21.15.40:3300/0 conn(0x7f801009d920 0x7f801009dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.105+0000 7f8015ded700 1 -- 172.21.15.40:0/2174082804 >> 172.21.15.40:0/2174082804 conn(0x7f80100a7080 msgr2=0x7f80100a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:09.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.105+0000 7f8015ded700 1 -- 172.21.15.40:0/2174082804 shutdown_connections 2023-09-30T22:28:09.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.105+0000 7f8015ded700 1 -- 172.21.15.40:0/2174082804 wait complete. 2023-09-30T22:28:09.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.106+0000 7f8015ded700 1 Processor -- start 2023-09-30T22:28:09.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.106+0000 7f8015ded700 1 -- start start 2023-09-30T22:28:09.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.107+0000 7f8015ded700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f801009c890 0x7f80101c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:09.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.107+0000 7f8015ded700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f801009d920 0x7f80101c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:09.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.107+0000 7f8015ded700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f801009e2b0 0x7f801012d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:09.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.107+0000 7f8015ded700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80101315d0 con 0x7f801009c890 2023-09-30T22:28:09.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.107+0000 7f8015ded700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8010130780 con 0x7f801009d920 2023-09-30T22:28:09.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.107+0000 7f8015ded700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8010130a30 con 0x7f801009e2b0 2023-09-30T22:28:09.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.107+0000 7f800effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f801009d920 0x7f80101c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:09.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.107+0000 7f800effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f801009d920 0x7f80101c9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52864/0 (socket says 172.21.15.40:52864) 2023-09-30T22:28:09.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.107+0000 7f800effd700 1 -- 172.21.15.40:0/2327637415 learned_addr learned my addr 172.21.15.40:0/2327637415 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:09.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.107+0000 7f800ffff700 1 --2- 172.21.15.40:0/2327637415 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f801009e2b0 0x7f801012d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:09.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.107+0000 7f800f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f801009c890 0x7f80101c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:09.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.108+0000 7f800effd700 1 -- 172.21.15.40:0/2327637415 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f801009e2b0 msgr2=0x7f801012d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:09.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.108+0000 7f800effd700 1 --2- 172.21.15.40:0/2327637415 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f801009e2b0 0x7f801012d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.108+0000 7f800effd700 1 -- 172.21.15.40:0/2327637415 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f801009c890 msgr2=0x7f80101c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:09.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.108+0000 7f800effd700 1 --2- 172.21.15.40:0/2327637415 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f801009c890 0x7f80101c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.108+0000 7f800effd700 1 -- 172.21.15.40:0/2327637415 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff80094a0 con 0x7f801009d920 2023-09-30T22:28:09.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.108+0000 7f800ffff700 1 --2- 172.21.15.40:0/2327637415 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f801009e2b0 0x7f801012d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:09.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.108+0000 7f800effd700 1 --2- 172.21.15.40:0/2327637415 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f801009d920 0x7f80101c9190 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7ff800ebe0 tx=0x7f7ff800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:09.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.108+0000 7f8007fff700 1 -- 172.21.15.40:0/2327637415 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff800c850 con 0x7f801009d920 2023-09-30T22:28:09.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.108+0000 7f8007fff700 1 -- 172.21.15.40:0/2327637415 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff800c9b0 con 0x7f801009d920 2023-09-30T22:28:09.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.108+0000 7f8015ded700 1 -- 172.21.15.40:0/2327637415 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8008009b30 con 0x7f801009d920 2023-09-30T22:28:09.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.108+0000 7f8007fff700 1 -- 172.21.15.40:0/2327637415 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff800cd40 con 0x7f801009d920 2023-09-30T22:28:09.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.109+0000 7f8015ded700 1 -- 172.21.15.40:0/2327637415 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8010130cf0 con 0x7f801009d920 2023-09-30T22:28:09.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.109+0000 7f8007fff700 1 -- 172.21.15.40:0/2327637415 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7ff8013470 con 0x7f801009d920 2023-09-30T22:28:09.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.109+0000 7f8007fff700 1 -- 172.21.15.40:0/2327637415 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f7ff803f810 con 0x7f801009d920 2023-09-30T22:28:09.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.109+0000 7f8015ded700 1 -- 172.21.15.40:0/2327637415 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8010062380 con 0x7f801009d920 2023-09-30T22:28:09.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.114+0000 7f8007fff700 1 -- 172.21.15.40:0/2327637415 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7ff8021080 con 0x7f801009d920 2023-09-30T22:28:09.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.164+0000 7f2b34155700 1 Processor -- start 2023-09-30T22:28:09.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.164+0000 7f2b34155700 1 -- start start 2023-09-30T22:28:09.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.164+0000 7f2b34155700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b2c09d920 0x7f2b2c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:09.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.164+0000 7f2b34155700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2b2c09e230 0x7f2b2c1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:09.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.165+0000 7f2b34155700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b2c09f940 con 0x7f2b2c09f0f0 2023-09-30T22:28:09.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.165+0000 7f2b34155700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c06b4c0 con 0x7f2b2c09d920 2023-09-30T22:28:09.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.165+0000 7f2b34155700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c09a8f0 con 0x7f2b2c09e230 2023-09-30T22:28:09.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.165+0000 7f2b31ef1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b2c09d920 0x7f2b2c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:09.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.165+0000 7f2b31ef1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b2c09d920 0x7f2b2c09dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52874/0 (socket says 172.21.15.40:52874) 2023-09-30T22:28:09.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.165+0000 7f2b326f2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2b2c09e230 0x7f2b2c1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:09.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.165+0000 7f2b31ef1700 1 -- 172.21.15.40:0/1079060680 learned_addr learned my addr 172.21.15.40:0/1079060680 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:09.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.165+0000 7f2b30eef700 1 -- 172.21.15.40:0/1079060680 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4085963609 0 0) 0x7f2b2c09f940 con 0x7f2b2c09f0f0 2023-09-30T22:28:09.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.165+0000 7f2b30eef700 1 -- 172.21.15.40:0/1079060680 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b180035b0 con 0x7f2b2c09f0f0 2023-09-30T22:28:09.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.165+0000 7f2b31ef1700 1 -- 172.21.15.40:0/1079060680 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2b2c09e230 msgr2=0x7f2b2c1343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:09.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.165+0000 7f2b31ef1700 1 --2- 172.21.15.40:0/1079060680 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2b2c09e230 0x7f2b2c1343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.165+0000 7f2b31ef1700 1 -- 172.21.15.40:0/1079060680 >> v1:172.21.15.40:6789/0 conn(0x7f2b2c09f0f0 legacy=0x7f2b2c133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:09.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.165+0000 7f2b31ef1700 1 -- 172.21.15.40:0/1079060680 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b2c09f6e0 con 0x7f2b2c09d920 2023-09-30T22:28:09.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.165+0000 7f2b31ef1700 1 --2- 172.21.15.40:0/1079060680 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b2c09d920 0x7f2b2c09dcf0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2b280098f0 tx=0x7f2b28009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df4857ac8fca5488 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:09.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.165+0000 7f2b30eef700 1 -- 172.21.15.40:0/1079060680 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b28005e30 con 0x7f2b2c09d920 2023-09-30T22:28:09.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.165+0000 7f2b30eef700 1 -- 172.21.15.40:0/1079060680 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b28004030 con 0x7f2b2c09d920 2023-09-30T22:28:09.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.165+0000 7f2b30eef700 1 -- 172.21.15.40:0/1079060680 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b280043e0 con 0x7f2b2c09d920 2023-09-30T22:28:09.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.166+0000 7f2b34155700 1 -- 172.21.15.40:0/1079060680 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b2c09d920 msgr2=0x7f2b2c09dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:09.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.166+0000 7f2b34155700 1 --2- 172.21.15.40:0/1079060680 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b2c09d920 0x7f2b2c09dcf0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2b280098f0 tx=0x7f2b28009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:09.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.166+0000 7f2b34155700 1 -- 172.21.15.40:0/1079060680 shutdown_connections 2023-09-30T22:28:09.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.166+0000 7f2b34155700 1 --2- 172.21.15.40:0/1079060680 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2b2c09e230 0x7f2b2c1343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.166+0000 7f2b34155700 1 --2- 172.21.15.40:0/1079060680 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b2c09d920 0x7f2b2c09dcf0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.166+0000 7f2b34155700 1 -- 172.21.15.40:0/1079060680 >> 172.21.15.40:0/1079060680 conn(0x7f2b2c09fb20 msgr2=0x7f2b2c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:09.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.166+0000 7f2b34155700 1 -- 172.21.15.40:0/1079060680 shutdown_connections 2023-09-30T22:28:09.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.166+0000 7f2b34155700 1 -- 172.21.15.40:0/1079060680 wait complete. 2023-09-30T22:28:09.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.167+0000 7f2b34155700 1 Processor -- start 2023-09-30T22:28:09.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.167+0000 7f2b34155700 1 -- start start 2023-09-30T22:28:09.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.168+0000 7f2b34155700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b2c09d920 0x7f2b2c1226a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:09.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.168+0000 7f2b34155700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b2c09e230 0x7f2b2c122be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:09.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.168+0000 7f2b34155700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2b2c123120 0x7f2b2c1ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:09.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.168+0000 7f2b34155700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c123b70 con 0x7f2b2c09e230 2023-09-30T22:28:09.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.168+0000 7f2b34155700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c1339e0 con 0x7f2b2c09d920 2023-09-30T22:28:09.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.168+0000 7f2b34155700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c1250b0 con 0x7f2b2c123120 2023-09-30T22:28:09.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.168+0000 7f2b316f0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b2c09e230 0x7f2b2c122be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:09.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.168+0000 7f2b31ef1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b2c09d920 0x7f2b2c1226a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:09.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.168+0000 7f2b316f0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b2c09e230 0x7f2b2c122be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39450/0 (socket says 172.21.15.40:39450) 2023-09-30T22:28:09.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.168+0000 7f2b316f0700 1 -- 172.21.15.40:0/3151932847 learned_addr learned my addr 172.21.15.40:0/3151932847 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:09.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.168+0000 7f2b326f2700 1 --2- 172.21.15.40:0/3151932847 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2b2c123120 0x7f2b2c1ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:09.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.168+0000 7f2b31ef1700 1 -- 172.21.15.40:0/3151932847 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2b2c123120 msgr2=0x7f2b2c1ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:09.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.168+0000 7f2b31ef1700 1 --2- 172.21.15.40:0/3151932847 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2b2c123120 0x7f2b2c1ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.169+0000 7f2b31ef1700 1 -- 172.21.15.40:0/3151932847 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b2c09e230 msgr2=0x7f2b2c122be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:09.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.169+0000 7f2b31ef1700 1 --2- 172.21.15.40:0/3151932847 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b2c09e230 0x7f2b2c122be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.169+0000 7f2b31ef1700 1 -- 172.21.15.40:0/3151932847 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b28009500 con 0x7f2b2c09d920 2023-09-30T22:28:09.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.169+0000 7f2b326f2700 1 --2- 172.21.15.40:0/3151932847 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2b2c123120 0x7f2b2c1ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:09.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.169+0000 7f2b31ef1700 1 --2- 172.21.15.40:0/3151932847 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b2c09d920 0x7f2b2c1226a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2b28013000 tx=0x7f2b28004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:09.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.169+0000 7f2b227fc700 1 -- 172.21.15.40:0/3151932847 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b28003c30 con 0x7f2b2c09d920 2023-09-30T22:28:09.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.169+0000 7f2b227fc700 1 -- 172.21.15.40:0/3151932847 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b28003d90 con 0x7f2b2c09d920 2023-09-30T22:28:09.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.169+0000 7f2b34155700 1 -- 172.21.15.40:0/3151932847 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b2c125b90 con 0x7f2b2c09d920 2023-09-30T22:28:09.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.169+0000 7f2b227fc700 1 -- 172.21.15.40:0/3151932847 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2801c640 con 0x7f2b2c09d920 2023-09-30T22:28:09.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.169+0000 7f2b34155700 1 -- 172.21.15.40:0/3151932847 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b2c1258c0 con 0x7f2b2c09d920 2023-09-30T22:28:09.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.170+0000 7f2b227fc700 1 -- 172.21.15.40:0/3151932847 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2b2801c7a0 con 0x7f2b2c09d920 2023-09-30T22:28:09.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.170+0000 7f2b227fc700 1 -- 172.21.15.40:0/3151932847 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f2b28040730 con 0x7f2b2c09d920 2023-09-30T22:28:09.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.170+0000 7f2b34155700 1 -- 172.21.15.40:0/3151932847 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b2c125470 con 0x7f2b2c09d920 2023-09-30T22:28:09.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.175+0000 7f2b227fc700 1 -- 172.21.15.40:0/3151932847 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2b2802a080 con 0x7f2b2c09d920 2023-09-30T22:28:09.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.243+0000 7f3b3798c700 1 Processor -- start 2023-09-30T22:28:09.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.243+0000 7f3b3798c700 1 -- start start 2023-09-30T22:28:09.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.243+0000 7f3b3798c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b3006b1b0 0x7f3b30136af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:09.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.243+0000 7f3b3798c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b30137030 0x7f3b30139410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:09.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.243+0000 7f3b3798c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b3009eb50 con 0x7f3b3006a6d0 2023-09-30T22:28:09.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.243+0000 7f3b3798c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3006b580 con 0x7f3b3006b1b0 2023-09-30T22:28:09.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.243+0000 7f3b3798c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3009dde0 con 0x7f3b30137030 2023-09-30T22:28:09.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.244+0000 7f3b34f27700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b3006b1b0 0x7f3b30136af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:09.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.244+0000 7f3b35f29700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b30137030 0x7f3b30139410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:09.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.244+0000 7f3b35728700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3b3006a6d0 0x7f3b3006aaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43698/0 (socket says 172.21.15.40:43698) 2023-09-30T22:28:09.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.244+0000 7f3b35f29700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b30137030 0x7f3b30139410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52740/0 (socket says 172.21.15.40:52740) 2023-09-30T22:28:09.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.244+0000 7f3b35728700 1 -- 172.21.15.40:0/1143963547 learned_addr learned my addr 172.21.15.40:0/1143963547 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:09.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.244+0000 7f3b34f27700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b3006b1b0 0x7f3b30136af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52884/0 (socket says 172.21.15.40:52884) 2023-09-30T22:28:09.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.244+0000 7f3b34f27700 1 -- 172.21.15.40:0/1143963547 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b30137030 msgr2=0x7f3b30139410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:09.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.244+0000 7f3b34f27700 1 --2- 172.21.15.40:0/1143963547 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b30137030 0x7f3b30139410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.244+0000 7f3b34f27700 1 -- 172.21.15.40:0/1143963547 >> v1:172.21.15.40:6789/0 conn(0x7f3b3006a6d0 legacy=0x7f3b3006aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:09.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.244+0000 7f3b27fff700 1 -- 172.21.15.40:0/1143963547 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3789220231 0 0) 0x7f3b3009eb50 con 0x7f3b3006a6d0 2023-09-30T22:28:09.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.244+0000 7f3b34f27700 1 -- 172.21.15.40:0/1143963547 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3009d4a0 con 0x7f3b3006b1b0 2023-09-30T22:28:09.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.244+0000 7f3b34f27700 1 --2- 172.21.15.40:0/1143963547 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b3006b1b0 0x7f3b30136af0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3b20009870 tx=0x7f3b20009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2135e14babdd67b0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:09.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.244+0000 7f3b27fff700 1 -- 172.21.15.40:0/1143963547 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b20011830 con 0x7f3b3006b1b0 2023-09-30T22:28:09.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.244+0000 7f3b27fff700 1 -- 172.21.15.40:0/1143963547 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b20011990 con 0x7f3b3006b1b0 2023-09-30T22:28:09.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.244+0000 7f3b27fff700 1 -- 172.21.15.40:0/1143963547 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b20011d20 con 0x7f3b3006b1b0 2023-09-30T22:28:09.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.245+0000 7f3b3798c700 1 -- 172.21.15.40:0/1143963547 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b3006b1b0 msgr2=0x7f3b30136af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:09.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.245+0000 7f3b3798c700 1 --2- 172.21.15.40:0/1143963547 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b3006b1b0 0x7f3b30136af0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3b20009870 tx=0x7f3b20009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:09.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.245+0000 7f3b3798c700 1 -- 172.21.15.40:0/1143963547 shutdown_connections 2023-09-30T22:28:09.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.245+0000 7f3b3798c700 1 --2- 172.21.15.40:0/1143963547 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b30137030 0x7f3b30139410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.245+0000 7f3b3798c700 1 --2- 172.21.15.40:0/1143963547 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b3006b1b0 0x7f3b30136af0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.245+0000 7f3b3798c700 1 -- 172.21.15.40:0/1143963547 >> 172.21.15.40:0/1143963547 conn(0x7f3b3009fb20 msgr2=0x7f3b3009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:09.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.245+0000 7f3b3798c700 1 -- 172.21.15.40:0/1143963547 shutdown_connections 2023-09-30T22:28:09.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.245+0000 7f3b3798c700 1 -- 172.21.15.40:0/1143963547 wait complete. 2023-09-30T22:28:09.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.246+0000 7f3b3798c700 1 Processor -- start 2023-09-30T22:28:09.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.246+0000 7f3b3798c700 1 -- start start 2023-09-30T22:28:09.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.246+0000 7f3b3798c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b3006a6d0 0x7f3b301318e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:09.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.246+0000 7f3b3798c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b3006b1b0 0x7f3b30131e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:09.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.246+0000 7f3b3798c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b30137030 0x7f3b301c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:09.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.246+0000 7f3b3798c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3009c160 con 0x7f3b3006a6d0 2023-09-30T22:28:09.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.246+0000 7f3b3798c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b30132360 con 0x7f3b30137030 2023-09-30T22:28:09.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.246+0000 7f3b3798c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b301222a0 con 0x7f3b3006b1b0 2023-09-30T22:28:09.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.247+0000 7f3b34f27700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b3006b1b0 0x7f3b30131e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:09.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.247+0000 7f3b34f27700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b3006b1b0 0x7f3b30131e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52744/0 (socket says 172.21.15.40:52744) 2023-09-30T22:28:09.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.247+0000 7f3b34f27700 1 -- 172.21.15.40:0/1572562388 learned_addr learned my addr 172.21.15.40:0/1572562388 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:09.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.247+0000 7f3b35728700 1 --2- 172.21.15.40:0/1572562388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b3006a6d0 0x7f3b301318e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:09.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.247+0000 7f3b35f29700 1 --2- 172.21.15.40:0/1572562388 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b30137030 0x7f3b301c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:09.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.247+0000 7f3b34f27700 1 -- 172.21.15.40:0/1572562388 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b30137030 msgr2=0x7f3b301c83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:09.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.247+0000 7f3b34f27700 1 --2- 172.21.15.40:0/1572562388 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b30137030 0x7f3b301c83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.247+0000 7f3b34f27700 1 -- 172.21.15.40:0/1572562388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b3006a6d0 msgr2=0x7f3b301318e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:09.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.247+0000 7f3b34f27700 1 --2- 172.21.15.40:0/1572562388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b3006a6d0 0x7f3b301318e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.247+0000 7f3b34f27700 1 -- 172.21.15.40:0/1572562388 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b200094a0 con 0x7f3b3006b1b0 2023-09-30T22:28:09.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.247+0000 7f3b34f27700 1 --2- 172.21.15.40:0/1572562388 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b3006b1b0 0x7f3b30131e20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3b20009840 tx=0x7f3b20004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:09.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.247+0000 7f3b25ffb700 1 -- 172.21.15.40:0/1572562388 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b20004510 con 0x7f3b3006b1b0 2023-09-30T22:28:09.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.247+0000 7f3b3798c700 1 -- 172.21.15.40:0/1572562388 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b30122510 con 0x7f3b3006b1b0 2023-09-30T22:28:09.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.247+0000 7f3b25ffb700 1 -- 172.21.15.40:0/1572562388 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2001f070 con 0x7f3b3006b1b0 2023-09-30T22:28:09.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.247+0000 7f3b25ffb700 1 -- 172.21.15.40:0/1572562388 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b200038e0 con 0x7f3b3006b1b0 2023-09-30T22:28:09.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.248+0000 7f3b3798c700 1 -- 172.21.15.40:0/1572562388 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b30071560 con 0x7f3b3006b1b0 2023-09-30T22:28:09.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.248+0000 7f3b25ffb700 1 -- 172.21.15.40:0/1572562388 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3b20003a40 con 0x7f3b3006b1b0 2023-09-30T22:28:09.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.248+0000 7f3b25ffb700 1 -- 172.21.15.40:0/1572562388 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3b20021070 con 0x7f3b3006b1b0 2023-09-30T22:28:09.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.249+0000 7f3b3798c700 1 -- 172.21.15.40:0/1572562388 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b30121fe0 con 0x7f3b3006b1b0 2023-09-30T22:28:09.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.258+0000 7f3b25ffb700 1 -- 172.21.15.40:0/1572562388 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3b2001a430 con 0x7f3b3006b1b0 2023-09-30T22:28:09.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.345+0000 7f8015ded700 1 -- 172.21.15.40:0/2327637415 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f80100726e0 con 0x7f801009d920 2023-09-30T22:28:09.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.345+0000 7f8007fff700 1 -- 172.21.15.40:0/2327637415 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7ff800cea0 con 0x7f801009d920 2023-09-30T22:28:09.347 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:09.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.348+0000 7f8015ded700 1 -- 172.21.15.40:0/2327637415 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f801009d920 msgr2=0x7f80101c9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:09.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.348+0000 7f8015ded700 1 --2- 172.21.15.40:0/2327637415 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f801009d920 0x7f80101c9190 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7ff800ebe0 tx=0x7f7ff800eef0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.348+0000 7f8015ded700 1 -- 172.21.15.40:0/2327637415 shutdown_connections 2023-09-30T22:28:09.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.348+0000 7f8015ded700 1 --2- 172.21.15.40:0/2327637415 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f801009e2b0 0x7f801012d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.348+0000 7f8015ded700 1 --2- 172.21.15.40:0/2327637415 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f801009c890 0x7f80101c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.348+0000 7f8015ded700 1 --2- 172.21.15.40:0/2327637415 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f801009d920 0x7f80101c9190 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.348+0000 7f8015ded700 1 -- 172.21.15.40:0/2327637415 >> 172.21.15.40:0/2327637415 conn(0x7f80100a7080 msgr2=0x7f80100a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:09.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.348+0000 7f8015ded700 1 -- 172.21.15.40:0/2327637415 shutdown_connections 2023-09-30T22:28:09.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.348+0000 7f8015ded700 1 -- 172.21.15.40:0/2327637415 wait complete. 2023-09-30T22:28:09.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:09.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.433+0000 7f2b34155700 1 -- 172.21.15.40:0/3151932847 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2b2c0a2f40 con 0x7f2b2c09d920 2023-09-30T22:28:09.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.433+0000 7f2b227fc700 1 -- 172.21.15.40:0/3151932847 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2b28016020 con 0x7f2b2c09d920 2023-09-30T22:28:09.434 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:09.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.435+0000 7f2b34155700 1 -- 172.21.15.40:0/3151932847 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b2c09d920 msgr2=0x7f2b2c1226a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:09.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.435+0000 7f2b34155700 1 --2- 172.21.15.40:0/3151932847 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b2c09d920 0x7f2b2c1226a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2b28013000 tx=0x7f2b28004750 comp rx=0 tx=0).stop 2023-09-30T22:28:09.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.435+0000 7f2b34155700 1 -- 172.21.15.40:0/3151932847 shutdown_connections 2023-09-30T22:28:09.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.435+0000 7f2b34155700 1 --2- 172.21.15.40:0/3151932847 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2b2c123120 0x7f2b2c1ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.435+0000 7f2b34155700 1 --2- 172.21.15.40:0/3151932847 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b2c09d920 0x7f2b2c1226a0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.435+0000 7f2b34155700 1 --2- 172.21.15.40:0/3151932847 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b2c09e230 0x7f2b2c122be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.435+0000 7f2b34155700 1 -- 172.21.15.40:0/3151932847 >> 172.21.15.40:0/3151932847 conn(0x7f2b2c09fb20 msgr2=0x7f2b2c070720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:09.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.435+0000 7f2b34155700 1 -- 172.21.15.40:0/3151932847 shutdown_connections 2023-09-30T22:28:09.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.435+0000 7f2b34155700 1 -- 172.21.15.40:0/3151932847 wait complete. 2023-09-30T22:28:09.448 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:09.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.488+0000 7f3b3798c700 1 -- 172.21.15.40:0/1572562388 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3b30062380 con 0x7f3b3006b1b0 2023-09-30T22:28:09.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.488+0000 7f3b25ffb700 1 -- 172.21.15.40:0/1572562388 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3b2002b030 con 0x7f3b3006b1b0 2023-09-30T22:28:09.489 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:09.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.490+0000 7f3b3798c700 1 -- 172.21.15.40:0/1572562388 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b3006b1b0 msgr2=0x7f3b30131e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:09.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.490+0000 7f3b3798c700 1 --2- 172.21.15.40:0/1572562388 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b3006b1b0 0x7f3b30131e20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3b20009840 tx=0x7f3b20004750 comp rx=0 tx=0).stop 2023-09-30T22:28:09.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.490+0000 7f3b3798c700 1 -- 172.21.15.40:0/1572562388 shutdown_connections 2023-09-30T22:28:09.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.490+0000 7f3b3798c700 1 --2- 172.21.15.40:0/1572562388 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b30137030 0x7f3b301c83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.490+0000 7f3b3798c700 1 --2- 172.21.15.40:0/1572562388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b3006a6d0 0x7f3b301318e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.490+0000 7f3b3798c700 1 --2- 172.21.15.40:0/1572562388 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3b3006b1b0 0x7f3b30131e20 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.490+0000 7f3b3798c700 1 -- 172.21.15.40:0/1572562388 >> 172.21.15.40:0/1572562388 conn(0x7f3b3009fb20 msgr2=0x7f3b300a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:09.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.490+0000 7f3b3798c700 1 -- 172.21.15.40:0/1572562388 shutdown_connections 2023-09-30T22:28:09.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:09.490+0000 7f3b3798c700 1 -- 172.21.15.40:0/1572562388 wait complete. 2023-09-30T22:28:09.503 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:10.083 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:10.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.223+0000 7fe2c93e8700 1 Processor -- start 2023-09-30T22:28:10.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.223+0000 7fe2c93e8700 1 -- start start 2023-09-30T22:28:10.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.223+0000 7fe2c93e8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe2c409c890 0x7fe2c409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.223+0000 7fe2c93e8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2c409e480 0x7fe2c413bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.223+0000 7fe2c93e8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c40a2600 con 0x7fe2c409d920 2023-09-30T22:28:10.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.223+0000 7fe2c93e8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c40a29d0 con 0x7fe2c409e480 2023-09-30T22:28:10.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.223+0000 7fe2c93e8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c409fb40 con 0x7fe2c409c890 2023-09-30T22:28:10.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.223+0000 7fe2c2ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe2c409c890 0x7fe2c409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.223+0000 7fe2c37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2c409e480 0x7fe2c413bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.223+0000 7fe2c27fc700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe2c409d920 0x7fe2c409dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43706/0 (socket says 172.21.15.40:43706) 2023-09-30T22:28:10.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.223+0000 7fe2c27fc700 1 -- 172.21.15.40:0/815805669 learned_addr learned my addr 172.21.15.40:0/815805669 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:10.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.224+0000 7fe2c2ffd700 1 -- 172.21.15.40:0/815805669 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2c409e480 msgr2=0x7fe2c413bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:10.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.224+0000 7fe2c2ffd700 1 --2- 172.21.15.40:0/815805669 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2c409e480 0x7fe2c413bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.224+0000 7fe2c2ffd700 1 -- 172.21.15.40:0/815805669 >> v1:172.21.15.40:6789/0 conn(0x7fe2c409d920 legacy=0x7fe2c409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.224+0000 7fe2c2ffd700 1 -- 172.21.15.40:0/815805669 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c409fed0 con 0x7fe2c409c890 2023-09-30T22:28:10.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.224+0000 7fe2c1ffb700 1 -- 172.21.15.40:0/815805669 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3415532807 0 0) 0x7fe2c40a2600 con 0x7fe2c409d920 2023-09-30T22:28:10.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.224+0000 7fe2c37fe700 1 --2- 172.21.15.40:0/815805669 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2c409e480 0x7fe2c413bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:10.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.224+0000 7fe2c2ffd700 1 --2- 172.21.15.40:0/815805669 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe2c409c890 0x7fe2c409cc60 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4009850 tx=0x7fe2b4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31236706d1f512ba server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:10.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.224+0000 7fe2c1ffb700 1 -- 172.21.15.40:0/815805669 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b4005e30 con 0x7fe2c409c890 2023-09-30T22:28:10.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.224+0000 7fe2c1ffb700 1 -- 172.21.15.40:0/815805669 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b4006030 con 0x7fe2c409c890 2023-09-30T22:28:10.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.224+0000 7fe2c1ffb700 1 -- 172.21.15.40:0/815805669 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b40063e0 con 0x7fe2c409c890 2023-09-30T22:28:10.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.225+0000 7fe2c93e8700 1 -- 172.21.15.40:0/815805669 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe2c409c890 msgr2=0x7fe2c409cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.225+0000 7fe2c93e8700 1 --2- 172.21.15.40:0/815805669 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe2c409c890 0x7fe2c409cc60 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4009850 tx=0x7fe2b4009b60 comp rx=0 tx=0).stop 2023-09-30T22:28:10.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.225+0000 7fe2c93e8700 1 -- 172.21.15.40:0/815805669 shutdown_connections 2023-09-30T22:28:10.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.225+0000 7fe2c93e8700 1 --2- 172.21.15.40:0/815805669 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2c409e480 0x7fe2c413bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.225+0000 7fe2c93e8700 1 --2- 172.21.15.40:0/815805669 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe2c409c890 0x7fe2c409cc60 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.225+0000 7fe2c93e8700 1 -- 172.21.15.40:0/815805669 >> 172.21.15.40:0/815805669 conn(0x7fe2c40a7080 msgr2=0x7fe2c40a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:10.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.225+0000 7fe2c93e8700 1 -- 172.21.15.40:0/815805669 shutdown_connections 2023-09-30T22:28:10.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.225+0000 7fe2c93e8700 1 -- 172.21.15.40:0/815805669 wait complete. 2023-09-30T22:28:10.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.226+0000 7fe2c93e8700 1 Processor -- start 2023-09-30T22:28:10.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.226+0000 7fe2c93e8700 1 -- start start 2023-09-30T22:28:10.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.226+0000 7fe2c93e8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe2c409c890 0x7fe2c412d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.226+0000 7fe2c93e8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2c409d920 0x7fe2c412d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.226+0000 7fe2c93e8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2c409e480 0x7fe2c412df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.226+0000 7fe2c93e8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c409c050 con 0x7fe2c409d920 2023-09-30T22:28:10.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.226+0000 7fe2c93e8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c408f4f0 con 0x7fe2c409e480 2023-09-30T22:28:10.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.226+0000 7fe2c93e8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c41309c0 con 0x7fe2c409c890 2023-09-30T22:28:10.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.226+0000 7fe2c27fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2c409d920 0x7fe2c412d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.226+0000 7fe2c2ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe2c409c890 0x7fe2c412d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.226+0000 7fe2c2ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe2c409c890 0x7fe2c412d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52758/0 (socket says 172.21.15.40:52758) 2023-09-30T22:28:10.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.226+0000 7fe2c2ffd700 1 -- 172.21.15.40:0/1754980359 learned_addr learned my addr 172.21.15.40:0/1754980359 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:10.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.226+0000 7fe2c27fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2c409d920 0x7fe2c412d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39462/0 (socket says 172.21.15.40:39462) 2023-09-30T22:28:10.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.226+0000 7fe2c37fe700 1 --2- 172.21.15.40:0/1754980359 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2c409e480 0x7fe2c412df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.227+0000 7fe2c2ffd700 1 -- 172.21.15.40:0/1754980359 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2c409e480 msgr2=0x7fe2c412df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.227+0000 7fe2c2ffd700 1 --2- 172.21.15.40:0/1754980359 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2c409e480 0x7fe2c412df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.227+0000 7fe2c2ffd700 1 -- 172.21.15.40:0/1754980359 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2c409d920 msgr2=0x7fe2c412d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.227+0000 7fe2c2ffd700 1 --2- 172.21.15.40:0/1754980359 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2c409d920 0x7fe2c412d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.227+0000 7fe2c2ffd700 1 -- 172.21.15.40:0/1754980359 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2bc009a70 con 0x7fe2c409c890 2023-09-30T22:28:10.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.227+0000 7fe2c2ffd700 1 --2- 172.21.15.40:0/1754980359 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe2c409c890 0x7fe2c412d4b0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4013040 tx=0x7fe2b4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:10.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.227+0000 7fe2ab7fe700 1 -- 172.21.15.40:0/1754980359 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b4025670 con 0x7fe2c409c890 2023-09-30T22:28:10.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.227+0000 7fe2ab7fe700 1 -- 172.21.15.40:0/1754980359 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b40257d0 con 0x7fe2c409c890 2023-09-30T22:28:10.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.227+0000 7fe2c93e8700 1 -- 172.21.15.40:0/1754980359 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b4009430 con 0x7fe2c409c890 2023-09-30T22:28:10.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.227+0000 7fe2ab7fe700 1 -- 172.21.15.40:0/1754980359 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b4025b60 con 0x7fe2c409c890 2023-09-30T22:28:10.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.227+0000 7fe2c93e8700 1 -- 172.21.15.40:0/1754980359 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c4130ca0 con 0x7fe2c409c890 2023-09-30T22:28:10.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.228+0000 7fe2ab7fe700 1 -- 172.21.15.40:0/1754980359 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe2b4022070 con 0x7fe2c409c890 2023-09-30T22:28:10.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.228+0000 7fe2ab7fe700 1 -- 172.21.15.40:0/1754980359 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe2b4040f20 con 0x7fe2c409c890 2023-09-30T22:28:10.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.228+0000 7fe2c93e8700 1 -- 172.21.15.40:0/1754980359 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2c4130b00 con 0x7fe2c409c890 2023-09-30T22:28:10.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.233+0000 7fe2ab7fe700 1 -- 172.21.15.40:0/1754980359 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe2c4130b00 con 0x7fe2c409c890 2023-09-30T22:28:10.361 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:10.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.429+0000 7fe2c93e8700 1 -- 172.21.15.40:0/1754980359 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe2c4130b00 con 0x7fe2c409c890 2023-09-30T22:28:10.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.429+0000 7fe2ab7fe700 1 -- 172.21.15.40:0/1754980359 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe2c4130b00 con 0x7fe2c409c890 2023-09-30T22:28:10.430 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:10.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.431+0000 7fe2c93e8700 1 -- 172.21.15.40:0/1754980359 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe2c409c890 msgr2=0x7fe2c412d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.431+0000 7fe2c93e8700 1 --2- 172.21.15.40:0/1754980359 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe2c409c890 0x7fe2c412d4b0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4013040 tx=0x7fe2b4004750 comp rx=0 tx=0).stop 2023-09-30T22:28:10.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.431+0000 7fe2c93e8700 1 -- 172.21.15.40:0/1754980359 shutdown_connections 2023-09-30T22:28:10.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.431+0000 7fe2c93e8700 1 --2- 172.21.15.40:0/1754980359 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe2c409c890 0x7fe2c412d4b0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.431+0000 7fe2c93e8700 1 --2- 172.21.15.40:0/1754980359 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2c409e480 0x7fe2c412df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.431+0000 7fe2c93e8700 1 --2- 172.21.15.40:0/1754980359 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2c409d920 0x7fe2c412d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.431+0000 7fe2c93e8700 1 -- 172.21.15.40:0/1754980359 >> 172.21.15.40:0/1754980359 conn(0x7fe2c40a7080 msgr2=0x7fe2c41332c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:10.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.431+0000 7fe2c93e8700 1 -- 172.21.15.40:0/1754980359 shutdown_connections 2023-09-30T22:28:10.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.431+0000 7fe2c93e8700 1 -- 172.21.15.40:0/1754980359 wait complete. 2023-09-30T22:28:10.444 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:10.449 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:10.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.494+0000 7f5efe5f8700 1 Processor -- start 2023-09-30T22:28:10.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.494+0000 7f5efe5f8700 1 -- start start 2023-09-30T22:28:10.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.494+0000 7f5efe5f8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ef809c890 0x7f5ef809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.494+0000 7f5efe5f8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ef809e480 0x7f5ef813bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.494+0000 7f5efe5f8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ef80a2600 con 0x7f5ef809d920 2023-09-30T22:28:10.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.494+0000 7f5efe5f8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef80a29d0 con 0x7f5ef809c890 2023-09-30T22:28:10.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.494+0000 7f5efe5f8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef809fb40 con 0x7f5ef809e480 2023-09-30T22:28:10.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.494+0000 7f5efcb95700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ef809e480 0x7f5ef813bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.494+0000 7f5ef7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ef809c890 0x7f5ef809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.494+0000 7f5ef7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ef809c890 0x7f5ef809cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52914/0 (socket says 172.21.15.40:52914) 2023-09-30T22:28:10.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.494+0000 7f5efcb95700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ef809e480 0x7f5ef813bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52772/0 (socket says 172.21.15.40:52772) 2023-09-30T22:28:10.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.494+0000 7f5ef7fff700 1 -- 172.21.15.40:0/3947265957 learned_addr learned my addr 172.21.15.40:0/3947265957 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:10.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.495+0000 7f5efcb95700 1 -- 172.21.15.40:0/3947265957 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ef809c890 msgr2=0x7f5ef809cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:10.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.495+0000 7f5efcb95700 1 --2- 172.21.15.40:0/3947265957 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ef809c890 0x7f5ef809cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.495+0000 7f5efcb95700 1 -- 172.21.15.40:0/3947265957 >> v1:172.21.15.40:6789/0 conn(0x7f5ef809d920 legacy=0x7f5ef809dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.495+0000 7f5ef6ffd700 1 -- 172.21.15.40:0/3947265957 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2183958904 0 0) 0x7f5ef80a2600 con 0x7f5ef809d920 2023-09-30T22:28:10.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.495+0000 7f5efcb95700 1 -- 172.21.15.40:0/3947265957 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef809fed0 con 0x7f5ef809e480 2023-09-30T22:28:10.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.495+0000 7f5ef7fff700 1 --2- 172.21.15.40:0/3947265957 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ef809c890 0x7f5ef809cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:10.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.495+0000 7f5efcb95700 1 --2- 172.21.15.40:0/3947265957 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ef809e480 0x7f5ef813bc20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0009dc0 tx=0x7f5ef000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34aefe51c6ba330b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:10.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.495+0000 7f5ef6ffd700 1 -- 172.21.15.40:0/3947265957 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef000e070 con 0x7f5ef809e480 2023-09-30T22:28:10.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.495+0000 7f5ef6ffd700 1 -- 172.21.15.40:0/3947265957 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef000bb20 con 0x7f5ef809e480 2023-09-30T22:28:10.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.495+0000 7f5ef6ffd700 1 -- 172.21.15.40:0/3947265957 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0012430 con 0x7f5ef809e480 2023-09-30T22:28:10.504 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:10.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.496+0000 7f5efe5f8700 1 -- 172.21.15.40:0/3947265957 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ef809e480 msgr2=0x7f5ef813bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.496+0000 7f5efe5f8700 1 --2- 172.21.15.40:0/3947265957 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ef809e480 0x7f5ef813bc20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0009dc0 tx=0x7f5ef000b330 comp rx=0 tx=0).stop 2023-09-30T22:28:10.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.496+0000 7f5efe5f8700 1 -- 172.21.15.40:0/3947265957 shutdown_connections 2023-09-30T22:28:10.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.496+0000 7f5efe5f8700 1 --2- 172.21.15.40:0/3947265957 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ef809e480 0x7f5ef813bc20 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.496+0000 7f5efe5f8700 1 --2- 172.21.15.40:0/3947265957 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ef809c890 0x7f5ef809cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.496+0000 7f5efe5f8700 1 -- 172.21.15.40:0/3947265957 >> 172.21.15.40:0/3947265957 conn(0x7f5ef80a7080 msgr2=0x7f5ef80a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:10.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.496+0000 7f5efe5f8700 1 -- 172.21.15.40:0/3947265957 shutdown_connections 2023-09-30T22:28:10.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.496+0000 7f5efe5f8700 1 -- 172.21.15.40:0/3947265957 wait complete. 2023-09-30T22:28:10.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.497+0000 7f5efe5f8700 1 Processor -- start 2023-09-30T22:28:10.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.497+0000 7f5efe5f8700 1 -- start start 2023-09-30T22:28:10.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.497+0000 7f5efe5f8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ef809c890 0x7f5ef812d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.497+0000 7f5efe5f8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ef809d920 0x7f5ef812d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.497+0000 7f5efe5f8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ef809e480 0x7f5ef812ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.497+0000 7f5efe5f8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef8130a20 con 0x7f5ef809d920 2023-09-30T22:28:10.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.497+0000 7f5efe5f8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef8130c00 con 0x7f5ef809e480 2023-09-30T22:28:10.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.497+0000 7f5efe5f8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef80a5b40 con 0x7f5ef809c890 2023-09-30T22:28:10.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.497+0000 7f5ef77fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ef809d920 0x7f5ef812d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.497+0000 7f5ef7fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ef809c890 0x7f5ef812d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.497+0000 7f5efcb95700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ef809e480 0x7f5ef812ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.497+0000 7f5ef77fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ef809d920 0x7f5ef812d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39472/0 (socket says 172.21.15.40:39472) 2023-09-30T22:28:10.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.497+0000 7f5ef7fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ef809c890 0x7f5ef812d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52784/0 (socket says 172.21.15.40:52784) 2023-09-30T22:28:10.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.498+0000 7f5ef77fe700 1 -- 172.21.15.40:0/1920690778 learned_addr learned my addr 172.21.15.40:0/1920690778 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:10.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.498+0000 7f5efcb95700 1 -- 172.21.15.40:0/1920690778 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ef809c890 msgr2=0x7f5ef812d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.498+0000 7f5efcb95700 1 --2- 172.21.15.40:0/1920690778 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ef809c890 0x7f5ef812d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.498+0000 7f5efcb95700 1 -- 172.21.15.40:0/1920690778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ef809d920 msgr2=0x7f5ef812d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.498+0000 7f5efcb95700 1 --2- 172.21.15.40:0/1920690778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ef809d920 0x7f5ef812d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.498+0000 7f5efcb95700 1 -- 172.21.15.40:0/1920690778 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee8009500 con 0x7f5ef809e480 2023-09-30T22:28:10.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.498+0000 7f5ef77fe700 1 --2- 172.21.15.40:0/1920690778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ef809d920 0x7f5ef812d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:10.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.498+0000 7f5ef7fff700 1 --2- 172.21.15.40:0/1920690778 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ef809c890 0x7f5ef812d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:10.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.498+0000 7f5efcb95700 1 --2- 172.21.15.40:0/1920690778 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ef809e480 0x7f5ef812ddc0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0016000 tx=0x7f5ef0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:10.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.498+0000 7f5ef4ff9700 1 -- 172.21.15.40:0/1920690778 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0012430 con 0x7f5ef809e480 2023-09-30T22:28:10.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.498+0000 7f5ef4ff9700 1 -- 172.21.15.40:0/1920690778 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef0020070 con 0x7f5ef809e480 2023-09-30T22:28:10.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.498+0000 7f5efe5f8700 1 -- 172.21.15.40:0/1920690778 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef0009a70 con 0x7f5ef809e480 2023-09-30T22:28:10.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.498+0000 7f5ef4ff9700 1 -- 172.21.15.40:0/1920690778 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0004280 con 0x7f5ef809e480 2023-09-30T22:28:10.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.498+0000 7f5efe5f8700 1 -- 172.21.15.40:0/1920690778 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef812e730 con 0x7f5ef809e480 2023-09-30T22:28:10.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.499+0000 7f5ef4ff9700 1 -- 172.21.15.40:0/1920690778 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5ef00043e0 con 0x7f5ef809e480 2023-09-30T22:28:10.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.499+0000 7f5efe5f8700 1 -- 172.21.15.40:0/1920690778 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ef8070610 con 0x7f5ef809e480 2023-09-30T22:28:10.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.499+0000 7f5ef4ff9700 1 -- 172.21.15.40:0/1920690778 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5ef0022070 con 0x7f5ef809e480 2023-09-30T22:28:10.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.504+0000 7f5ef4ff9700 1 -- 172.21.15.40:0/1920690778 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5ef002fce0 con 0x7f5ef809e480 2023-09-30T22:28:10.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.582+0000 7f34b0b42700 1 Processor -- start 2023-09-30T22:28:10.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.582+0000 7f34b0b42700 1 -- start start 2023-09-30T22:28:10.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.583+0000 7f34b0b42700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f34ac136bf0 0x7f34ac138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.583+0000 7f34b0b42700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f34ac139510 0x7f34ac13b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.583+0000 7f34b0b42700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34ac0a2600 con 0x7f34ac09c890 2023-09-30T22:28:10.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.583+0000 7f34b0b42700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34ac0a29d0 con 0x7f34ac139510 2023-09-30T22:28:10.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.583+0000 7f34b0b42700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac09fb40 con 0x7f34ac136bf0 2023-09-30T22:28:10.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.583+0000 7f34a9d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f34ac136bf0 0x7f34ac138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.583+0000 7f34aad9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f34ac139510 0x7f34ac13b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.583+0000 7f34aad9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f34ac139510 0x7f34ac13b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39478/0 (socket says 172.21.15.40:39478) 2023-09-30T22:28:10.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.583+0000 7f34a9d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f34ac136bf0 0x7f34ac138fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52790/0 (socket says 172.21.15.40:52790) 2023-09-30T22:28:10.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.583+0000 7f34aad9d700 1 -- 172.21.15.40:0/2765676887 learned_addr learned my addr 172.21.15.40:0/2765676887 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:10.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.583+0000 7f34aad9d700 1 -- 172.21.15.40:0/2765676887 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f34ac136bf0 msgr2=0x7f34ac138fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:10.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.583+0000 7f34aad9d700 1 --2- 172.21.15.40:0/2765676887 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f34ac136bf0 0x7f34ac138fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.583+0000 7f34aad9d700 1 -- 172.21.15.40:0/2765676887 >> v1:172.21.15.40:6789/0 conn(0x7f34ac09c890 legacy=0x7f34ac09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.583+0000 7f34aad9d700 1 -- 172.21.15.40:0/2765676887 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ac09d370 con 0x7f34ac139510 2023-09-30T22:28:10.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.583+0000 7f34aad9d700 1 --2- 172.21.15.40:0/2765676887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34ac139510 0x7f34ac13b8f0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f34a4009e50 tx=0x7f34a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18466f760f65f4a9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:10.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.584+0000 7f34a959a700 1 -- 172.21.15.40:0/2765676887 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a400e070 con 0x7f34ac139510 2023-09-30T22:28:10.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.584+0000 7f34a959a700 1 -- 172.21.15.40:0/2765676887 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a400b910 con 0x7f34ac139510 2023-09-30T22:28:10.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.584+0000 7f34a959a700 1 -- 172.21.15.40:0/2765676887 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a400bcc0 con 0x7f34ac139510 2023-09-30T22:28:10.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.584+0000 7f34b0b42700 1 -- 172.21.15.40:0/2765676887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34ac139510 msgr2=0x7f34ac13b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.584+0000 7f34b0b42700 1 --2- 172.21.15.40:0/2765676887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34ac139510 0x7f34ac13b8f0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f34a4009e50 tx=0x7f34a400b330 comp rx=0 tx=0).stop 2023-09-30T22:28:10.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.584+0000 7f34b0b42700 1 -- 172.21.15.40:0/2765676887 shutdown_connections 2023-09-30T22:28:10.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.584+0000 7f34b0b42700 1 --2- 172.21.15.40:0/2765676887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34ac139510 0x7f34ac13b8f0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.584+0000 7f34b0b42700 1 --2- 172.21.15.40:0/2765676887 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f34ac136bf0 0x7f34ac138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.584+0000 7f34b0b42700 1 -- 172.21.15.40:0/2765676887 >> 172.21.15.40:0/2765676887 conn(0x7f34ac0a7080 msgr2=0x7f34ac0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:10.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.584+0000 7f34b0b42700 1 -- 172.21.15.40:0/2765676887 shutdown_connections 2023-09-30T22:28:10.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.584+0000 7f34b0b42700 1 -- 172.21.15.40:0/2765676887 wait complete. 2023-09-30T22:28:10.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.585+0000 7f34b0b42700 1 Processor -- start 2023-09-30T22:28:10.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.586+0000 7f34b0b42700 1 -- start start 2023-09-30T22:28:10.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.586+0000 7f34b0b42700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34ac09c890 0x7f34ac06f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.586+0000 7f34b0b42700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34ac136bf0 0x7f34ac06f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.586+0000 7f34b0b42700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f34ac139510 0x7f34ac06fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.586+0000 7f34b0b42700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac0a5eb0 con 0x7f34ac09c890 2023-09-30T22:28:10.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.586+0000 7f34b0b42700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac12c2e0 con 0x7f34ac136bf0 2023-09-30T22:28:10.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.586+0000 7f34b0b42700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac070df0 con 0x7f34ac139510 2023-09-30T22:28:10.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.586+0000 7f34aa59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34ac09c890 0x7f34ac06f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.586+0000 7f34aa59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34ac09c890 0x7f34ac06f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39480/0 (socket says 172.21.15.40:39480) 2023-09-30T22:28:10.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.586+0000 7f34aa59c700 1 -- 172.21.15.40:0/3586661796 learned_addr learned my addr 172.21.15.40:0/3586661796 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:10.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.586+0000 7f34a9d9b700 1 --2- 172.21.15.40:0/3586661796 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34ac136bf0 0x7f34ac06f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.586+0000 7f34aad9d700 1 --2- 172.21.15.40:0/3586661796 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f34ac139510 0x7f34ac06fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.586+0000 7f34aa59c700 1 -- 172.21.15.40:0/3586661796 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f34ac139510 msgr2=0x7f34ac06fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.586+0000 7f34aa59c700 1 --2- 172.21.15.40:0/3586661796 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f34ac139510 0x7f34ac06fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.586+0000 7f34aa59c700 1 -- 172.21.15.40:0/3586661796 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34ac136bf0 msgr2=0x7f34ac06f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.586+0000 7f34aa59c700 1 --2- 172.21.15.40:0/3586661796 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34ac136bf0 0x7f34ac06f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.586+0000 7f34aa59c700 1 -- 172.21.15.40:0/3586661796 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a4009b30 con 0x7f34ac09c890 2023-09-30T22:28:10.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.586+0000 7f34aad9d700 1 --2- 172.21.15.40:0/3586661796 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f34ac139510 0x7f34ac06fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:10.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.587+0000 7f34a9d9b700 1 --2- 172.21.15.40:0/3586661796 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34ac136bf0 0x7f34ac06f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:10.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.587+0000 7f34aa59c700 1 --2- 172.21.15.40:0/3586661796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34ac09c890 0x7f34ac06f120 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f349c00c4d0 tx=0x7f349c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:10.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.587+0000 7f349affd700 1 -- 172.21.15.40:0/3586661796 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c0054e0 con 0x7f34ac09c890 2023-09-30T22:28:10.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.587+0000 7f349affd700 1 -- 172.21.15.40:0/3586661796 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349c003680 con 0x7f34ac09c890 2023-09-30T22:28:10.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.587+0000 7f34b0b42700 1 -- 172.21.15.40:0/3586661796 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34ac12bb60 con 0x7f34ac09c890 2023-09-30T22:28:10.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.587+0000 7f349affd700 1 -- 172.21.15.40:0/3586661796 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c003a30 con 0x7f34ac09c890 2023-09-30T22:28:10.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.587+0000 7f34b0b42700 1 -- 172.21.15.40:0/3586661796 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34ac0714d0 con 0x7f34ac09c890 2023-09-30T22:28:10.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.588+0000 7f349affd700 1 -- 172.21.15.40:0/3586661796 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f349c003b90 con 0x7f34ac09c890 2023-09-30T22:28:10.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.588+0000 7f349affd700 1 -- 172.21.15.40:0/3586661796 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f349c03eab0 con 0x7f34ac09c890 2023-09-30T22:28:10.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.588+0000 7f34b0b42700 1 -- 172.21.15.40:0/3586661796 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34ac062380 con 0x7f34ac09c890 2023-09-30T22:28:10.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.593+0000 7f349affd700 1 -- 172.21.15.40:0/3586661796 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f349c017070 con 0x7f34ac09c890 2023-09-30T22:28:10.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.637+0000 7f871b380700 1 Processor -- start 2023-09-30T22:28:10.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.637+0000 7f871b380700 1 -- start start 2023-09-30T22:28:10.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.638+0000 7f871b380700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f871409c890 0x7f871409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.638+0000 7f871b380700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f871409e480 0x7f871413bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.638+0000 7f871b380700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87140a2600 con 0x7f871409d920 2023-09-30T22:28:10.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.638+0000 7f871b380700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87140a29d0 con 0x7f871409c890 2023-09-30T22:28:10.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.638+0000 7f871b380700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871409fb40 con 0x7f871409e480 2023-09-30T22:28:10.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.638+0000 7f871991d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f871409e480 0x7f871413bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.638+0000 7f871911c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f871409c890 0x7f871409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.638+0000 7f871911c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f871409c890 0x7f871409cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39482/0 (socket says 172.21.15.40:39482) 2023-09-30T22:28:10.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.638+0000 7f871991d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f871409e480 0x7f871413bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52958/0 (socket says 172.21.15.40:52958) 2023-09-30T22:28:10.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.638+0000 7f871911c700 1 -- 172.21.15.40:0/1235721956 learned_addr learned my addr 172.21.15.40:0/1235721956 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:10.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.638+0000 7f871891b700 1 --1- 172.21.15.40:0/1235721956 >> v1:172.21.15.40:6789/0 conn(0x7f871409d920 0x7f871409dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43728/0 (socket says 172.21.15.40:43728) 2023-09-30T22:28:10.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.639+0000 7f871991d700 1 -- 172.21.15.40:0/1235721956 >> v2:172.21.15.40:3300/0 conn(0x7f871409c890 msgr2=0x7f871409cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:10.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.639+0000 7f871991d700 1 --2- 172.21.15.40:0/1235721956 >> v2:172.21.15.40:3300/0 conn(0x7f871409c890 0x7f871409cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.639+0000 7f871991d700 1 -- 172.21.15.40:0/1235721956 >> v1:172.21.15.40:6789/0 conn(0x7f871409d920 legacy=0x7f871409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.639+0000 7f870bfff700 1 -- 172.21.15.40:0/1235721956 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3258695382 0 0) 0x7f87140a2600 con 0x7f871409d920 2023-09-30T22:28:10.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.639+0000 7f871991d700 1 -- 172.21.15.40:0/1235721956 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f871409fed0 con 0x7f871409e480 2023-09-30T22:28:10.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.639+0000 7f871911c700 1 --2- 172.21.15.40:0/1235721956 >> v2:172.21.15.40:3300/0 conn(0x7f871409c890 0x7f871409cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:10.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.639+0000 7f871991d700 1 --2- 172.21.15.40:0/1235721956 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f871409e480 0x7f871413bc20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f870c009d90 tx=0x7f870c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=139ee7397c4198e6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:10.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.639+0000 7f870bfff700 1 -- 172.21.15.40:0/1235721956 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c00e070 con 0x7f871409e480 2023-09-30T22:28:10.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.639+0000 7f870bfff700 1 -- 172.21.15.40:0/1235721956 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870c00bb20 con 0x7f871409e480 2023-09-30T22:28:10.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.639+0000 7f870bfff700 1 -- 172.21.15.40:0/1235721956 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c012430 con 0x7f871409e480 2023-09-30T22:28:10.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.640+0000 7f871b380700 1 -- 172.21.15.40:0/1235721956 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f871409e480 msgr2=0x7f871413bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.640+0000 7f871b380700 1 --2- 172.21.15.40:0/1235721956 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f871409e480 0x7f871413bc20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f870c009d90 tx=0x7f870c00b330 comp rx=0 tx=0).stop 2023-09-30T22:28:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.640+0000 7f871b380700 1 -- 172.21.15.40:0/1235721956 shutdown_connections 2023-09-30T22:28:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.640+0000 7f871b380700 1 --2- 172.21.15.40:0/1235721956 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f871409e480 0x7f871413bc20 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.640+0000 7f871b380700 1 --2- 172.21.15.40:0/1235721956 >> v2:172.21.15.40:3300/0 conn(0x7f871409c890 0x7f871409cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.640+0000 7f871b380700 1 -- 172.21.15.40:0/1235721956 >> 172.21.15.40:0/1235721956 conn(0x7f87140a7080 msgr2=0x7f87140a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.640+0000 7f871b380700 1 -- 172.21.15.40:0/1235721956 shutdown_connections 2023-09-30T22:28:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.640+0000 7f871b380700 1 -- 172.21.15.40:0/1235721956 wait complete. 2023-09-30T22:28:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.641+0000 7f871b380700 1 Processor -- start 2023-09-30T22:28:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.641+0000 7f871b380700 1 -- start start 2023-09-30T22:28:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.642+0000 7f871b380700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f871409c890 0x7f8714131070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.642+0000 7f871b380700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f871409d920 0x7f871412b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.642+0000 7f871b380700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f871409e480 0x7f871412ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.642+0000 7f871b380700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871412dbe0 con 0x7f871409e480 2023-09-30T22:28:10.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.642+0000 7f871b380700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871412f310 con 0x7f871409d920 2023-09-30T22:28:10.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.642+0000 7f871b380700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f871409ecf0 con 0x7f871409c890 2023-09-30T22:28:10.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.642+0000 7f871911c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f871409c890 0x7f8714131070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.642+0000 7f871891b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f871409d920 0x7f871412b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.642+0000 7f871911c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f871409c890 0x7f8714131070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52806/0 (socket says 172.21.15.40:52806) 2023-09-30T22:28:10.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.642+0000 7f871911c700 1 -- 172.21.15.40:0/2471331598 learned_addr learned my addr 172.21.15.40:0/2471331598 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:10.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.642+0000 7f871991d700 1 --2- 172.21.15.40:0/2471331598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f871409e480 0x7f871412ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.643+0000 7f871911c700 1 -- 172.21.15.40:0/2471331598 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f871409d920 msgr2=0x7f871412b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.643+0000 7f871911c700 1 --2- 172.21.15.40:0/2471331598 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f871409d920 0x7f871412b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.643+0000 7f871911c700 1 -- 172.21.15.40:0/2471331598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f871409e480 msgr2=0x7f871412ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.643+0000 7f871911c700 1 --2- 172.21.15.40:0/2471331598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f871409e480 0x7f871412ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.643+0000 7f871911c700 1 -- 172.21.15.40:0/2471331598 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8710009500 con 0x7f871409c890 2023-09-30T22:28:10.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.643+0000 7f871991d700 1 --2- 172.21.15.40:0/2471331598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f871409e480 0x7f871412ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:10.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.643+0000 7f871911c700 1 --2- 172.21.15.40:0/2471331598 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f871409c890 0x7f8714131070 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f871000e9d0 tx=0x7f871000ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:10.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.643+0000 7f8709ffb700 1 -- 172.21.15.40:0/2471331598 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871000ee70 con 0x7f871409c890 2023-09-30T22:28:10.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.643+0000 7f8709ffb700 1 -- 172.21.15.40:0/2471331598 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8710005a20 con 0x7f871409c890 2023-09-30T22:28:10.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.643+0000 7f871b380700 1 -- 172.21.15.40:0/2471331598 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f870c009a70 con 0x7f871409c890 2023-09-30T22:28:10.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.643+0000 7f8709ffb700 1 -- 172.21.15.40:0/2471331598 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8710005db0 con 0x7f871409c890 2023-09-30T22:28:10.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.643+0000 7f871b380700 1 -- 172.21.15.40:0/2471331598 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f871412e9a0 con 0x7f871409c890 2023-09-30T22:28:10.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.644+0000 7f8709ffb700 1 -- 172.21.15.40:0/2471331598 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f871000c850 con 0x7f871409c890 2023-09-30T22:28:10.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.644+0000 7f8709ffb700 1 -- 172.21.15.40:0/2471331598 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f871003f7d0 con 0x7f871409c890 2023-09-30T22:28:10.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.645+0000 7f871b380700 1 -- 172.21.15.40:0/2471331598 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f871412e9a0 con 0x7f871409c890 2023-09-30T22:28:10.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.650+0000 7f8709ffb700 1 -- 172.21.15.40:0/2471331598 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f871412e9a0 con 0x7f871409c890 2023-09-30T22:28:10.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.707+0000 7f5efe5f8700 1 -- 172.21.15.40:0/1920690778 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5ef8062380 con 0x7f5ef809e480 2023-09-30T22:28:10.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.707+0000 7f5ef4ff9700 1 -- 172.21.15.40:0/1920690778 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5ef002fce0 con 0x7f5ef809e480 2023-09-30T22:28:10.708 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:10.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.709+0000 7f5efe5f8700 1 -- 172.21.15.40:0/1920690778 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ef809e480 msgr2=0x7f5ef812ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.709+0000 7f5efe5f8700 1 --2- 172.21.15.40:0/1920690778 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ef809e480 0x7f5ef812ddc0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0016000 tx=0x7f5ef0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.709+0000 7f5efe5f8700 1 -- 172.21.15.40:0/1920690778 shutdown_connections 2023-09-30T22:28:10.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.709+0000 7f5efe5f8700 1 --2- 172.21.15.40:0/1920690778 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ef809c890 0x7f5ef812d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.709+0000 7f5efe5f8700 1 --2- 172.21.15.40:0/1920690778 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ef809e480 0x7f5ef812ddc0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.709+0000 7f5efe5f8700 1 --2- 172.21.15.40:0/1920690778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ef809d920 0x7f5ef812d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.709+0000 7f5efe5f8700 1 -- 172.21.15.40:0/1920690778 >> 172.21.15.40:0/1920690778 conn(0x7f5ef80a7080 msgr2=0x7f5ef8133290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:10.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.709+0000 7f5efe5f8700 1 -- 172.21.15.40:0/1920690778 shutdown_connections 2023-09-30T22:28:10.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.710+0000 7f5efe5f8700 1 -- 172.21.15.40:0/1920690778 wait complete. 2023-09-30T22:28:10.722 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:10.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.792+0000 7f34b0b42700 1 -- 172.21.15.40:0/3586661796 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f34ac074620 con 0x7f34ac09c890 2023-09-30T22:28:10.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.793+0000 7f349affd700 1 -- 172.21.15.40:0/3586661796 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f349c003e40 con 0x7f34ac09c890 2023-09-30T22:28:10.794 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:10.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.794+0000 7f34b0b42700 1 -- 172.21.15.40:0/3586661796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34ac09c890 msgr2=0x7f34ac06f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.794+0000 7f34b0b42700 1 --2- 172.21.15.40:0/3586661796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34ac09c890 0x7f34ac06f120 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f349c00c4d0 tx=0x7f349c00c7e0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.794+0000 7f34b0b42700 1 -- 172.21.15.40:0/3586661796 shutdown_connections 2023-09-30T22:28:10.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.794+0000 7f34b0b42700 1 --2- 172.21.15.40:0/3586661796 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f34ac139510 0x7f34ac06fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.794+0000 7f34b0b42700 1 --2- 172.21.15.40:0/3586661796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34ac09c890 0x7f34ac06f120 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.794+0000 7f34b0b42700 1 --2- 172.21.15.40:0/3586661796 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34ac136bf0 0x7f34ac06f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.794+0000 7f34b0b42700 1 -- 172.21.15.40:0/3586661796 >> 172.21.15.40:0/3586661796 conn(0x7f34ac0a7080 msgr2=0x7f34ac135ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:10.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.795+0000 7f34b0b42700 1 -- 172.21.15.40:0/3586661796 shutdown_connections 2023-09-30T22:28:10.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.795+0000 7f34b0b42700 1 -- 172.21.15.40:0/3586661796 wait complete. 2023-09-30T22:28:10.807 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:10.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.847+0000 7f871b380700 1 -- 172.21.15.40:0/2471331598 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f871412e9a0 con 0x7f871409c890 2023-09-30T22:28:10.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.847+0000 7f8709ffb700 1 -- 172.21.15.40:0/2471331598 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f871412e9a0 con 0x7f871409c890 2023-09-30T22:28:10.848 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:10.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.849+0000 7f871b380700 1 -- 172.21.15.40:0/2471331598 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f871409c890 msgr2=0x7f8714131070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.849+0000 7f871b380700 1 --2- 172.21.15.40:0/2471331598 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f871409c890 0x7f8714131070 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f871000e9d0 tx=0x7f871000ece0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.849+0000 7f871b380700 1 -- 172.21.15.40:0/2471331598 shutdown_connections 2023-09-30T22:28:10.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.849+0000 7f871b380700 1 --2- 172.21.15.40:0/2471331598 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f871409c890 0x7f8714131070 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.849+0000 7f871b380700 1 --2- 172.21.15.40:0/2471331598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f871409e480 0x7f871412ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.849+0000 7f871b380700 1 --2- 172.21.15.40:0/2471331598 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f871409d920 0x7f871412b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.849+0000 7f871b380700 1 -- 172.21.15.40:0/2471331598 >> 172.21.15.40:0/2471331598 conn(0x7f87140a7080 msgr2=0x7f87141baf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:10.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.850+0000 7f871b380700 1 -- 172.21.15.40:0/2471331598 shutdown_connections 2023-09-30T22:28:10.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:10.850+0000 7f871b380700 1 -- 172.21.15.40:0/2471331598 wait complete. 2023-09-30T22:28:10.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:11.445 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:11.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.586+0000 7f303d5d0700 1 Processor -- start 2023-09-30T22:28:11.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.587+0000 7f303d5d0700 1 -- start start 2023-09-30T22:28:11.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.587+0000 7f303d5d0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f303809c890 0x7f303809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.587+0000 7f303d5d0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f303809e480 0x7f303813bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.587+0000 7f303d5d0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30380a2600 con 0x7f303809d920 2023-09-30T22:28:11.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.587+0000 7f303d5d0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30380a29d0 con 0x7f303809e480 2023-09-30T22:28:11.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.587+0000 7f303d5d0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f303809fb40 con 0x7f303809c890 2023-09-30T22:28:11.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.587+0000 7f3036ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f303809c890 0x7f303809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.587+0000 7f30377fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f303809e480 0x7f303813bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.587+0000 7f3036ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f303809c890 0x7f303809cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52980/0 (socket says 172.21.15.40:52980) 2023-09-30T22:28:11.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.587+0000 7f3036ffd700 1 -- 172.21.15.40:0/3990299538 learned_addr learned my addr 172.21.15.40:0/3990299538 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:11.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.587+0000 7f3036ffd700 1 -- 172.21.15.40:0/3990299538 >> v2:172.21.15.40:3300/0 conn(0x7f303809e480 msgr2=0x7f303813bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:11.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.587+0000 7f3036ffd700 1 --2- 172.21.15.40:0/3990299538 >> v2:172.21.15.40:3300/0 conn(0x7f303809e480 0x7f303813bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.587+0000 7f3036ffd700 1 -- 172.21.15.40:0/3990299538 >> v1:172.21.15.40:6789/0 conn(0x7f303809d920 legacy=0x7f303809dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:11.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.587+0000 7f3036ffd700 1 -- 172.21.15.40:0/3990299538 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303809fed0 con 0x7f303809c890 2023-09-30T22:28:11.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.588+0000 7f3036ffd700 1 --2- 172.21.15.40:0/3990299538 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f303809c890 0x7f303809cc60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3028006fd0 tx=0x7f3028009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8abdf24f4deba3e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:11.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.588+0000 7f3035ffb700 1 -- 172.21.15.40:0/3990299538 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3028005e30 con 0x7f303809c890 2023-09-30T22:28:11.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.588+0000 7f3035ffb700 1 -- 172.21.15.40:0/3990299538 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3028004030 con 0x7f303809c890 2023-09-30T22:28:11.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.588+0000 7f3035ffb700 1 -- 172.21.15.40:0/3990299538 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30280043e0 con 0x7f303809c890 2023-09-30T22:28:11.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.588+0000 7f303d5d0700 1 -- 172.21.15.40:0/3990299538 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f303809c890 msgr2=0x7f303809cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:11.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.588+0000 7f303d5d0700 1 --2- 172.21.15.40:0/3990299538 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f303809c890 0x7f303809cc60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3028006fd0 tx=0x7f3028009bd0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.588+0000 7f303d5d0700 1 -- 172.21.15.40:0/3990299538 shutdown_connections 2023-09-30T22:28:11.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.588+0000 7f303d5d0700 1 --2- 172.21.15.40:0/3990299538 >> v2:172.21.15.40:3300/0 conn(0x7f303809e480 0x7f303813bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.588+0000 7f303d5d0700 1 --2- 172.21.15.40:0/3990299538 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f303809c890 0x7f303809cc60 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.588+0000 7f303d5d0700 1 -- 172.21.15.40:0/3990299538 >> 172.21.15.40:0/3990299538 conn(0x7f30380a7080 msgr2=0x7f30380a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:11.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.588+0000 7f303d5d0700 1 -- 172.21.15.40:0/3990299538 shutdown_connections 2023-09-30T22:28:11.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.588+0000 7f303d5d0700 1 -- 172.21.15.40:0/3990299538 wait complete. 2023-09-30T22:28:11.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.589+0000 7f303d5d0700 1 Processor -- start 2023-09-30T22:28:11.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.590+0000 7f303d5d0700 1 -- start start 2023-09-30T22:28:11.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.590+0000 7f303d5d0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f303809c890 0x7f30381c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.590+0000 7f303d5d0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f303809d920 0x7f30381c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.590+0000 7f303d5d0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f303809e480 0x7f303812d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.590+0000 7f303d5d0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303812fc00 con 0x7f303809e480 2023-09-30T22:28:11.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.590+0000 7f303d5d0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f303808f3e0 con 0x7f303809d920 2023-09-30T22:28:11.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.590+0000 7f303d5d0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f303812efe0 con 0x7f303809c890 2023-09-30T22:28:11.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.590+0000 7f30367fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f303809d920 0x7f30381c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.590+0000 7f3036ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f303809c890 0x7f30381c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.590+0000 7f3036ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f303809c890 0x7f30381c8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52820/0 (socket says 172.21.15.40:52820) 2023-09-30T22:28:11.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.590+0000 7f30367fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f303809d920 0x7f30381c9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52984/0 (socket says 172.21.15.40:52984) 2023-09-30T22:28:11.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.590+0000 7f3036ffd700 1 -- 172.21.15.40:0/1618179812 learned_addr learned my addr 172.21.15.40:0/1618179812 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:11.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.590+0000 7f30377fe700 1 --2- 172.21.15.40:0/1618179812 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f303809e480 0x7f303812d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.590+0000 7f3036ffd700 1 -- 172.21.15.40:0/1618179812 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f303809d920 msgr2=0x7f30381c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:11.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.590+0000 7f3036ffd700 1 --2- 172.21.15.40:0/1618179812 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f303809d920 0x7f30381c9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.590+0000 7f3036ffd700 1 -- 172.21.15.40:0/1618179812 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f303809e480 msgr2=0x7f303812d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:11.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.590+0000 7f3036ffd700 1 --2- 172.21.15.40:0/1618179812 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f303809e480 0x7f303812d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.590+0000 7f3036ffd700 1 -- 172.21.15.40:0/1618179812 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3028009500 con 0x7f303809c890 2023-09-30T22:28:11.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.590+0000 7f30367fc700 1 --2- 172.21.15.40:0/1618179812 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f303809d920 0x7f30381c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:11.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.590+0000 7f30377fe700 1 --2- 172.21.15.40:0/1618179812 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f303809e480 0x7f303812d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:11.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.591+0000 7f3036ffd700 1 --2- 172.21.15.40:0/1618179812 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f303809c890 0x7f30381c8c50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3028004000 tx=0x7f3028004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:11.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.591+0000 7f301f7fe700 1 -- 172.21.15.40:0/1618179812 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3028003c30 con 0x7f303809c890 2023-09-30T22:28:11.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.591+0000 7f301f7fe700 1 -- 172.21.15.40:0/1618179812 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3028003d90 con 0x7f303809c890 2023-09-30T22:28:11.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.591+0000 7f301f7fe700 1 -- 172.21.15.40:0/1618179812 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302801c640 con 0x7f303809c890 2023-09-30T22:28:11.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.591+0000 7f303d5d0700 1 -- 172.21.15.40:0/1618179812 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3038130980 con 0x7f303809c890 2023-09-30T22:28:11.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.591+0000 7f303d5d0700 1 -- 172.21.15.40:0/1618179812 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30381306c0 con 0x7f303809c890 2023-09-30T22:28:11.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.592+0000 7f301f7fe700 1 -- 172.21.15.40:0/1618179812 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f302801c7a0 con 0x7f303809c890 2023-09-30T22:28:11.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.592+0000 7f301f7fe700 1 -- 172.21.15.40:0/1618179812 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f30280407a0 con 0x7f303809c890 2023-09-30T22:28:11.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.592+0000 7f303d5d0700 1 -- 172.21.15.40:0/1618179812 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f303809ecf0 con 0x7f303809c890 2023-09-30T22:28:11.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.597+0000 7f301f7fe700 1 -- 172.21.15.40:0/1618179812 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f302802a020 con 0x7f303809c890 2023-09-30T22:28:11.723 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:11.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.794+0000 7f303d5d0700 1 -- 172.21.15.40:0/1618179812 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3038062380 con 0x7f303809c890 2023-09-30T22:28:11.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.794+0000 7f301f7fe700 1 -- 172.21.15.40:0/1618179812 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3028016070 con 0x7f303809c890 2023-09-30T22:28:11.795 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:11.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.797+0000 7f303d5d0700 1 -- 172.21.15.40:0/1618179812 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f303809c890 msgr2=0x7f30381c8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:11.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.797+0000 7f303d5d0700 1 --2- 172.21.15.40:0/1618179812 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f303809c890 0x7f30381c8c50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3028004000 tx=0x7f3028004750 comp rx=0 tx=0).stop 2023-09-30T22:28:11.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.798+0000 7f303d5d0700 1 -- 172.21.15.40:0/1618179812 shutdown_connections 2023-09-30T22:28:11.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.798+0000 7f303d5d0700 1 --2- 172.21.15.40:0/1618179812 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f303809c890 0x7f30381c8c50 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.798+0000 7f303d5d0700 1 --2- 172.21.15.40:0/1618179812 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f303809e480 0x7f303812d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.798+0000 7f303d5d0700 1 --2- 172.21.15.40:0/1618179812 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f303809d920 0x7f30381c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.798+0000 7f303d5d0700 1 -- 172.21.15.40:0/1618179812 >> 172.21.15.40:0/1618179812 conn(0x7f30380a7080 msgr2=0x7f30380a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:11.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.798+0000 7f303d5d0700 1 -- 172.21.15.40:0/1618179812 shutdown_connections 2023-09-30T22:28:11.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.798+0000 7f303d5d0700 1 -- 172.21.15.40:0/1618179812 wait complete. 2023-09-30T22:28:11.809 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:11.812 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:11.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.854+0000 7faabc9ca700 1 Processor -- start 2023-09-30T22:28:11.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.854+0000 7faabc9ca700 1 -- start start 2023-09-30T22:28:11.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.855+0000 7faabc9ca700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faab809d920 0x7faab809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.855+0000 7faabc9ca700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faab8130fb0 0x7faab8138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.855+0000 7faabc9ca700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faab809adf0 con 0x7faab809e230 2023-09-30T22:28:11.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.855+0000 7faabc9ca700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faab809edf0 con 0x7faab809d920 2023-09-30T22:28:11.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.855+0000 7faabc9ca700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab809b660 con 0x7faab8130fb0 2023-09-30T22:28:11.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.855+0000 7faab6d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faab8130fb0 0x7faab8138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.856+0000 7faab659c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faab809d920 0x7faab809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.856+0000 7faab6d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faab8130fb0 0x7faab8138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:52994/0 (socket says 172.21.15.40:52994) 2023-09-30T22:28:11.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.856+0000 7faab6d9d700 1 -- 172.21.15.40:0/940373777 learned_addr learned my addr 172.21.15.40:0/940373777 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:11.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.856+0000 7faab659c700 1 -- 172.21.15.40:0/940373777 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faab8130fb0 msgr2=0x7faab8138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:11.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.856+0000 7faab659c700 1 --2- 172.21.15.40:0/940373777 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faab8130fb0 0x7faab8138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.856+0000 7faab659c700 1 -- 172.21.15.40:0/940373777 >> v1:172.21.15.40:6789/0 conn(0x7faab809e230 legacy=0x7faab81308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:11.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.856+0000 7faab659c700 1 -- 172.21.15.40:0/940373777 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab809a6e0 con 0x7faab809d920 2023-09-30T22:28:11.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.856+0000 7faab6d9d700 1 --2- 172.21.15.40:0/940373777 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faab8130fb0 0x7faab8138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:11.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.856+0000 7faab659c700 1 --2- 172.21.15.40:0/940373777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faab809d920 0x7faab809dcf0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7faaa8009820 tx=0x7faaa8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a8b6c3ac4e8e5c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:11.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.856+0000 7faab559a700 1 -- 172.21.15.40:0/940373777 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa8005e30 con 0x7faab809d920 2023-09-30T22:28:11.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.856+0000 7faab559a700 1 -- 172.21.15.40:0/940373777 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa8006030 con 0x7faab809d920 2023-09-30T22:28:11.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.856+0000 7faab559a700 1 -- 172.21.15.40:0/940373777 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa80063c0 con 0x7faab809d920 2023-09-30T22:28:11.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.857+0000 7faabc9ca700 1 -- 172.21.15.40:0/940373777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faab809d920 msgr2=0x7faab809dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:11.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.857+0000 7faabc9ca700 1 --2- 172.21.15.40:0/940373777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faab809d920 0x7faab809dcf0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7faaa8009820 tx=0x7faaa8009b30 comp rx=0 tx=0).stop 2023-09-30T22:28:11.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.857+0000 7faabc9ca700 1 -- 172.21.15.40:0/940373777 shutdown_connections 2023-09-30T22:28:11.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.857+0000 7faabc9ca700 1 --2- 172.21.15.40:0/940373777 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faab8130fb0 0x7faab8138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.857+0000 7faabc9ca700 1 --2- 172.21.15.40:0/940373777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faab809d920 0x7faab809dcf0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.857+0000 7faabc9ca700 1 -- 172.21.15.40:0/940373777 >> 172.21.15.40:0/940373777 conn(0x7faab809fb20 msgr2=0x7faab809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:11.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.857+0000 7faabc9ca700 1 -- 172.21.15.40:0/940373777 shutdown_connections 2023-09-30T22:28:11.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.857+0000 7faabc9ca700 1 -- 172.21.15.40:0/940373777 wait complete. 2023-09-30T22:28:11.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.858+0000 7faabc9ca700 1 Processor -- start 2023-09-30T22:28:11.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.858+0000 7faabc9ca700 1 -- start start 2023-09-30T22:28:11.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.859+0000 7faabc9ca700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faab809d920 0x7faab811d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.859+0000 7faabc9ca700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faab809e230 0x7faab811d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.859+0000 7faabc9ca700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faab8130fb0 0x7faab811db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.859+0000 7faabc9ca700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab811ed00 con 0x7faab809e230 2023-09-30T22:28:11.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.859+0000 7faabc9ca700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab811f320 con 0x7faab8130fb0 2023-09-30T22:28:11.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.859+0000 7faabc9ca700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faab811ff50 con 0x7faab809d920 2023-09-30T22:28:11.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.859+0000 7faab6d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faab8130fb0 0x7faab811db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.859+0000 7faab659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faab809d920 0x7faab811d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.859+0000 7faab5d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faab809e230 0x7faab811d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.859+0000 7faab6d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faab8130fb0 0x7faab811db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53004/0 (socket says 172.21.15.40:53004) 2023-09-30T22:28:11.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.859+0000 7faab6d9d700 1 -- 172.21.15.40:0/1999256046 learned_addr learned my addr 172.21.15.40:0/1999256046 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:11.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.859+0000 7faab5d9b700 1 -- 172.21.15.40:0/1999256046 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faab809d920 msgr2=0x7faab811d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:11.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.859+0000 7faab5d9b700 1 --2- 172.21.15.40:0/1999256046 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faab809d920 0x7faab811d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.859+0000 7faab5d9b700 1 -- 172.21.15.40:0/1999256046 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faab8130fb0 msgr2=0x7faab811db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:11.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.859+0000 7faab5d9b700 1 --2- 172.21.15.40:0/1999256046 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faab8130fb0 0x7faab811db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.859+0000 7faab5d9b700 1 -- 172.21.15.40:0/1999256046 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab000bd40 con 0x7faab809e230 2023-09-30T22:28:11.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.859+0000 7faab6d9d700 1 --2- 172.21.15.40:0/1999256046 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faab8130fb0 0x7faab811db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:11.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.859+0000 7faab5d9b700 1 --2- 172.21.15.40:0/1999256046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faab809e230 0x7faab811d630 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7faaac00c450 tx=0x7faaac00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:11.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.859+0000 7faaa6ffd700 1 -- 172.21.15.40:0/1999256046 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac0052d0 con 0x7faab809e230 2023-09-30T22:28:11.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.859+0000 7faaa6ffd700 1 -- 172.21.15.40:0/1999256046 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaac005430 con 0x7faab809e230 2023-09-30T22:28:11.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.859+0000 7faabc9ca700 1 -- 172.21.15.40:0/1999256046 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa8009430 con 0x7faab809e230 2023-09-30T22:28:11.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.859+0000 7faaa6ffd700 1 -- 172.21.15.40:0/1999256046 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac0038c0 con 0x7faab809e230 2023-09-30T22:28:11.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.860+0000 7faabc9ca700 1 -- 172.21.15.40:0/1999256046 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faab8120990 con 0x7faab809e230 2023-09-30T22:28:11.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.860+0000 7faaa6ffd700 1 -- 172.21.15.40:0/1999256046 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faaac003a20 con 0x7faab809e230 2023-09-30T22:28:11.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.860+0000 7faabc9ca700 1 -- 172.21.15.40:0/1999256046 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faab809cb00 con 0x7faab809e230 2023-09-30T22:28:11.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.861+0000 7faaa6ffd700 1 -- 172.21.15.40:0/1999256046 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7faaac03ea00 con 0x7faab809e230 2023-09-30T22:28:11.864 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:11.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.865+0000 7faaa6ffd700 1 -- 172.21.15.40:0/1999256046 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faaac011590 con 0x7faab809e230 2023-09-30T22:28:11.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.940+0000 7fcfdaef9700 1 Processor -- start 2023-09-30T22:28:11.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.940+0000 7fcfdaef9700 1 -- start start 2023-09-30T22:28:11.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.940+0000 7fcfdaef9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcfd409c890 0x7fcfd409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.941+0000 7fcfdaef9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcfd409e480 0x7fcfd413bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.941+0000 7fcfdaef9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd40a2600 con 0x7fcfd409d920 2023-09-30T22:28:11.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.941+0000 7fcfdaef9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd40a29d0 con 0x7fcfd409e480 2023-09-30T22:28:11.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.941+0000 7fcfdaef9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd409fb40 con 0x7fcfd409c890 2023-09-30T22:28:11.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.941+0000 7fcfd8c95700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcfd409c890 0x7fcfd409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.941+0000 7fcfd3fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fcfd409d920 0x7fcfd409dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43744/0 (socket says 172.21.15.40:43744) 2023-09-30T22:28:11.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.941+0000 7fcfd3fff700 1 -- 172.21.15.40:0/2942759107 learned_addr learned my addr 172.21.15.40:0/2942759107 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:11.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.941+0000 7fcfd9496700 1 --2- 172.21.15.40:0/2942759107 >> v2:172.21.15.40:3300/0 conn(0x7fcfd409e480 0x7fcfd413bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.941+0000 7fcfd9496700 1 -- 172.21.15.40:0/2942759107 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcfd409c890 msgr2=0x7fcfd409cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:11.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.941+0000 7fcfd9496700 1 --2- 172.21.15.40:0/2942759107 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcfd409c890 0x7fcfd409cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.941+0000 7fcfd9496700 1 -- 172.21.15.40:0/2942759107 >> v1:172.21.15.40:6789/0 conn(0x7fcfd409d920 legacy=0x7fcfd409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:11.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.941+0000 7fcfd37fe700 1 -- 172.21.15.40:0/2942759107 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2392063535 0 0) 0x7fcfd40a2600 con 0x7fcfd409d920 2023-09-30T22:28:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.941+0000 7fcfd9496700 1 -- 172.21.15.40:0/2942759107 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd409fed0 con 0x7fcfd409e480 2023-09-30T22:28:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.941+0000 7fcfd9496700 1 --2- 172.21.15.40:0/2942759107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfd409e480 0x7fcfd413bc20 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc009d90 tx=0x7fcfcc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a67fd5778b329305 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.941+0000 7fcfd37fe700 1 -- 172.21.15.40:0/2942759107 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc00e070 con 0x7fcfd409e480 2023-09-30T22:28:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.941+0000 7fcfd37fe700 1 -- 172.21.15.40:0/2942759107 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfcc00bb20 con 0x7fcfd409e480 2023-09-30T22:28:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.941+0000 7fcfd37fe700 1 -- 172.21.15.40:0/2942759107 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc012430 con 0x7fcfd409e480 2023-09-30T22:28:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.942+0000 7fcfdaef9700 1 -- 172.21.15.40:0/2942759107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfd409e480 msgr2=0x7fcfd413bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.942+0000 7fcfdaef9700 1 --2- 172.21.15.40:0/2942759107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfd409e480 0x7fcfd413bc20 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc009d90 tx=0x7fcfcc00b330 comp rx=0 tx=0).stop 2023-09-30T22:28:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.942+0000 7fcfdaef9700 1 -- 172.21.15.40:0/2942759107 shutdown_connections 2023-09-30T22:28:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.942+0000 7fcfdaef9700 1 --2- 172.21.15.40:0/2942759107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfd409e480 0x7fcfd413bc20 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.942+0000 7fcfdaef9700 1 --2- 172.21.15.40:0/2942759107 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcfd409c890 0x7fcfd409cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.942+0000 7fcfdaef9700 1 -- 172.21.15.40:0/2942759107 >> 172.21.15.40:0/2942759107 conn(0x7fcfd40a7080 msgr2=0x7fcfd40a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.942+0000 7fcfdaef9700 1 -- 172.21.15.40:0/2942759107 shutdown_connections 2023-09-30T22:28:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.942+0000 7fcfdaef9700 1 -- 172.21.15.40:0/2942759107 wait complete. 2023-09-30T22:28:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.943+0000 7fcfdaef9700 1 Processor -- start 2023-09-30T22:28:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.943+0000 7fcfdaef9700 1 -- start start 2023-09-30T22:28:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.944+0000 7fcfdaef9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfd409c890 0x7fcfd412d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.944+0000 7fcfdaef9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcfd409d920 0x7fcfd412daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.944+0000 7fcfdaef9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfd409e480 0x7fcfd412e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.944+0000 7fcfdaef9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd4130550 con 0x7fcfd409e480 2023-09-30T22:28:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.944+0000 7fcfdaef9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd40a5c30 con 0x7fcfd409c890 2023-09-30T22:28:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.944+0000 7fcfdaef9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd409ecf0 con 0x7fcfd409d920 2023-09-30T22:28:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.944+0000 7fcfd3fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcfd409d920 0x7fcfd412daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.944+0000 7fcfd8c95700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfd409c890 0x7fcfd412d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.944+0000 7fcfd8c95700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfd409c890 0x7fcfd412d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53010/0 (socket says 172.21.15.40:53010) 2023-09-30T22:28:11.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.944+0000 7fcfd3fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcfd409d920 0x7fcfd412daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:52848/0 (socket says 172.21.15.40:52848) 2023-09-30T22:28:11.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.944+0000 7fcfd8c95700 1 -- 172.21.15.40:0/2351128822 learned_addr learned my addr 172.21.15.40:0/2351128822 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:11.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.944+0000 7fcfd9496700 1 --2- 172.21.15.40:0/2351128822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfd409e480 0x7fcfd412e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.944+0000 7fcfd9496700 1 -- 172.21.15.40:0/2351128822 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcfd409d920 msgr2=0x7fcfd412daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:11.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.944+0000 7fcfd9496700 1 --2- 172.21.15.40:0/2351128822 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcfd409d920 0x7fcfd412daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.944+0000 7fcfd9496700 1 -- 172.21.15.40:0/2351128822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfd409c890 msgr2=0x7fcfd412d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:11.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.944+0000 7fcfd9496700 1 --2- 172.21.15.40:0/2351128822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfd409c890 0x7fcfd412d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.944+0000 7fcfd9496700 1 -- 172.21.15.40:0/2351128822 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfcc009a70 con 0x7fcfd409e480 2023-09-30T22:28:11.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.944+0000 7fcfd8c95700 1 --2- 172.21.15.40:0/2351128822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfd409c890 0x7fcfd412d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:11.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.944+0000 7fcfd3fff700 1 --2- 172.21.15.40:0/2351128822 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcfd409d920 0x7fcfd412daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:11.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.944+0000 7fcfd9496700 1 --2- 172.21.15.40:0/2351128822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfd409e480 0x7fcfd412e030 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc016000 tx=0x7fcfcc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:11.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.945+0000 7fcfd17fa700 1 -- 172.21.15.40:0/2351128822 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc012430 con 0x7fcfd409e480 2023-09-30T22:28:11.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.945+0000 7fcfd17fa700 1 -- 172.21.15.40:0/2351128822 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfcc020070 con 0x7fcfd409e480 2023-09-30T22:28:11.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.945+0000 7fcfdaef9700 1 -- 172.21.15.40:0/2351128822 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd409c310 con 0x7fcfd409e480 2023-09-30T22:28:11.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.945+0000 7fcfd17fa700 1 -- 172.21.15.40:0/2351128822 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc004040 con 0x7fcfd409e480 2023-09-30T22:28:11.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.945+0000 7fcfdaef9700 1 -- 172.21.15.40:0/2351128822 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd4130d30 con 0x7fcfd409e480 2023-09-30T22:28:11.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.946+0000 7fcfd17fa700 1 -- 172.21.15.40:0/2351128822 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcfcc0041a0 con 0x7fcfd409e480 2023-09-30T22:28:11.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.946+0000 7fcfdaef9700 1 -- 172.21.15.40:0/2351128822 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfd4070610 con 0x7fcfd409e480 2023-09-30T22:28:11.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.946+0000 7fcfd17fa700 1 -- 172.21.15.40:0/2351128822 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fcfcc022070 con 0x7fcfd409e480 2023-09-30T22:28:11.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.951+0000 7fcfd17fa700 1 -- 172.21.15.40:0/2351128822 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcfcc011bd0 con 0x7fcfd409e480 2023-09-30T22:28:11.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.996+0000 7fcb559ec700 1 Processor -- start 2023-09-30T22:28:11.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.996+0000 7fcb559ec700 1 -- start start 2023-09-30T22:28:11.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.996+0000 7fcb559ec700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb50133e00 0x7fcb501341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.996+0000 7fcb559ec700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb5009d400 0x7fcb5009d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.996+0000 7fcb559ec700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcb5009dd70 0x7fcb5013ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.996+0000 7fcb559ec700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb5009ab20 con 0x7fcb5009dd70 2023-09-30T22:28:11.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.996+0000 7fcb559ec700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb50133940 con 0x7fcb50133e00 2023-09-30T22:28:11.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.996+0000 7fcb559ec700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5009f0d0 con 0x7fcb5009d400 2023-09-30T22:28:11.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.997+0000 7fcb4f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcb5009dd70 0x7fcb5013ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.997+0000 7fcb4effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb50133e00 0x7fcb501341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.997+0000 7fcb4effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb50133e00 0x7fcb501341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53022/0 (socket says 172.21.15.40:53022) 2023-09-30T22:28:11.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.997+0000 7fcb4f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcb5009dd70 0x7fcb5013ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39572/0 (socket says 172.21.15.40:39572) 2023-09-30T22:28:11.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.997+0000 7fcb4effd700 1 -- 172.21.15.40:0/1639260708 learned_addr learned my addr 172.21.15.40:0/1639260708 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:11.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.997+0000 7fcb4e7fc700 1 --2- 172.21.15.40:0/1639260708 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb5009d400 0x7fcb5009d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.997+0000 7fcb4f7fe700 1 -- 172.21.15.40:0/1639260708 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb5009d400 msgr2=0x7fcb5009d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:11.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.997+0000 7fcb4f7fe700 1 --2- 172.21.15.40:0/1639260708 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb5009d400 0x7fcb5009d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.997+0000 7fcb4f7fe700 1 -- 172.21.15.40:0/1639260708 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb50133e00 msgr2=0x7fcb501341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:11.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.997+0000 7fcb4f7fe700 1 --2- 172.21.15.40:0/1639260708 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb50133e00 0x7fcb501341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.997+0000 7fcb4f7fe700 1 -- 172.21.15.40:0/1639260708 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb5009e210 con 0x7fcb5009dd70 2023-09-30T22:28:12.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.997+0000 7fcb4effd700 1 --2- 172.21.15.40:0/1639260708 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb50133e00 0x7fcb501341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:12.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.997+0000 7fcb4e7fc700 1 --2- 172.21.15.40:0/1639260708 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb5009d400 0x7fcb5009d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:12.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.997+0000 7fcb4f7fe700 1 --2- 172.21.15.40:0/1639260708 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb5009dd70 0x7fcb5013ac70 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fcb48009d90 tx=0x7fcb4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee0ea1d04d22cf3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:12.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.997+0000 7fcb4dffb700 1 -- 172.21.15.40:0/1639260708 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4800e070 con 0x7fcb5009dd70 2023-09-30T22:28:12.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.998+0000 7fcb4dffb700 1 -- 172.21.15.40:0/1639260708 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4800bb20 con 0x7fcb5009dd70 2023-09-30T22:28:12.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.998+0000 7fcb4dffb700 1 -- 172.21.15.40:0/1639260708 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb48012430 con 0x7fcb5009dd70 2023-09-30T22:28:12.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.998+0000 7fcb559ec700 1 -- 172.21.15.40:0/1639260708 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb5009dd70 msgr2=0x7fcb5013ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:12.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.998+0000 7fcb559ec700 1 --2- 172.21.15.40:0/1639260708 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb5009dd70 0x7fcb5013ac70 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fcb48009d90 tx=0x7fcb4800b330 comp rx=0 tx=0).stop 2023-09-30T22:28:12.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.998+0000 7fcb559ec700 1 -- 172.21.15.40:0/1639260708 shutdown_connections 2023-09-30T22:28:12.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.998+0000 7fcb559ec700 1 --2- 172.21.15.40:0/1639260708 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb5009dd70 0x7fcb5013ac70 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:12.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.998+0000 7fcb559ec700 1 --2- 172.21.15.40:0/1639260708 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb50133e00 0x7fcb501341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:12.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.998+0000 7fcb559ec700 1 --2- 172.21.15.40:0/1639260708 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb5009d400 0x7fcb5009d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:12.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.998+0000 7fcb559ec700 1 -- 172.21.15.40:0/1639260708 >> 172.21.15.40:0/1639260708 conn(0x7fcb500a2a00 msgr2=0x7fcb500a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:12.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.998+0000 7fcb559ec700 1 -- 172.21.15.40:0/1639260708 shutdown_connections 2023-09-30T22:28:12.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.998+0000 7fcb559ec700 1 -- 172.21.15.40:0/1639260708 wait complete. 2023-09-30T22:28:12.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:11.999+0000 7fcb559ec700 1 Processor -- start 2023-09-30T22:28:12.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.000+0000 7fcb559ec700 1 -- start start 2023-09-30T22:28:12.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.000+0000 7fcb559ec700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb5009d400 0x7fcb501c5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:12.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.000+0000 7fcb559ec700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb5009dd70 0x7fcb501c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:12.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.000+0000 7fcb559ec700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb50133e00 0x7fcb50119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:12.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.000+0000 7fcb559ec700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5011a570 con 0x7fcb50133e00 2023-09-30T22:28:12.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.000+0000 7fcb559ec700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5011a380 con 0x7fcb5009d400 2023-09-30T22:28:12.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.000+0000 7fcb559ec700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb501c4c80 con 0x7fcb5009dd70 2023-09-30T22:28:12.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.000+0000 7fcb4effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb5009d400 0x7fcb501c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:12.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.000+0000 7fcb4e7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb5009dd70 0x7fcb501c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:12.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.000+0000 7fcb4effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb5009d400 0x7fcb501c5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:53026/0 (socket says 172.21.15.40:53026) 2023-09-30T22:28:12.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.000+0000 7fcb4effd700 1 -- 172.21.15.40:0/3442143952 learned_addr learned my addr 172.21.15.40:0/3442143952 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:12.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.000+0000 7fcb4f7fe700 1 --2- 172.21.15.40:0/3442143952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb50133e00 0x7fcb50119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:12.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.001+0000 7fcb4e7fc700 1 -- 172.21.15.40:0/3442143952 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb5009d400 msgr2=0x7fcb501c5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:12.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.001+0000 7fcb4e7fc700 1 --2- 172.21.15.40:0/3442143952 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb5009d400 0x7fcb501c5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:12.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.001+0000 7fcb4e7fc700 1 -- 172.21.15.40:0/3442143952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb50133e00 msgr2=0x7fcb50119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:12.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.001+0000 7fcb4e7fc700 1 --2- 172.21.15.40:0/3442143952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb50133e00 0x7fcb50119050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:12.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.001+0000 7fcb4e7fc700 1 -- 172.21.15.40:0/3442143952 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb440094a0 con 0x7fcb5009dd70 2023-09-30T22:28:12.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.001+0000 7fcb4e7fc700 1 --2- 172.21.15.40:0/3442143952 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb5009dd70 0x7fcb501c55d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400e980 tx=0x7fcb4400ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:12.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.001+0000 7fcb37fff700 1 -- 172.21.15.40:0/3442143952 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4400eed0 con 0x7fcb5009dd70 2023-09-30T22:28:12.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.001+0000 7fcb37fff700 1 -- 172.21.15.40:0/3442143952 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4400c850 con 0x7fcb5009dd70 2023-09-30T22:28:12.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.001+0000 7fcb559ec700 1 -- 172.21.15.40:0/3442143952 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb40009550 con 0x7fcb5009dd70 2023-09-30T22:28:12.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.001+0000 7fcb37fff700 1 -- 172.21.15.40:0/3442143952 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4400cbe0 con 0x7fcb5009dd70 2023-09-30T22:28:12.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.001+0000 7fcb559ec700 1 -- 172.21.15.40:0/3442143952 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb48009a70 con 0x7fcb5009dd70 2023-09-30T22:28:12.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.002+0000 7fcb37fff700 1 -- 172.21.15.40:0/3442143952 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcb4400cd40 con 0x7fcb5009dd70 2023-09-30T22:28:12.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.002+0000 7fcb37fff700 1 -- 172.21.15.40:0/3442143952 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fcb4403f7d0 con 0x7fcb5009dd70 2023-09-30T22:28:12.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.002+0000 7fcb559ec700 1 -- 172.21.15.40:0/3442143952 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb5012e1a0 con 0x7fcb5009dd70 2023-09-30T22:28:12.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.007+0000 7fcb37fff700 1 -- 172.21.15.40:0/3442143952 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcb44021080 con 0x7fcb5009dd70 2023-09-30T22:28:12.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.093+0000 7faabc9ca700 1 -- 172.21.15.40:0/1999256046 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faab8062380 con 0x7faab809e230 2023-09-30T22:28:12.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.093+0000 7faaa6ffd700 1 -- 172.21.15.40:0/1999256046 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faaac017030 con 0x7faab809e230 2023-09-30T22:28:12.094 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:12.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.096+0000 7faabc9ca700 1 -- 172.21.15.40:0/1999256046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faab809e230 msgr2=0x7faab811d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:12.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.096+0000 7faabc9ca700 1 --2- 172.21.15.40:0/1999256046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faab809e230 0x7faab811d630 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7faaac00c450 tx=0x7faaac00c760 comp rx=0 tx=0).stop 2023-09-30T22:28:12.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.096+0000 7faabc9ca700 1 -- 172.21.15.40:0/1999256046 shutdown_connections 2023-09-30T22:28:12.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.096+0000 7faabc9ca700 1 --2- 172.21.15.40:0/1999256046 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faab809d920 0x7faab811d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:12.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.096+0000 7faabc9ca700 1 --2- 172.21.15.40:0/1999256046 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faab8130fb0 0x7faab811db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:12.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.096+0000 7faabc9ca700 1 --2- 172.21.15.40:0/1999256046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faab809e230 0x7faab811d630 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:12.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.096+0000 7faabc9ca700 1 -- 172.21.15.40:0/1999256046 >> 172.21.15.40:0/1999256046 conn(0x7faab809fb20 msgr2=0x7faab8130110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:12.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.096+0000 7faabc9ca700 1 -- 172.21.15.40:0/1999256046 shutdown_connections 2023-09-30T22:28:12.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.096+0000 7faabc9ca700 1 -- 172.21.15.40:0/1999256046 wait complete. 2023-09-30T22:28:12.109 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:12.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.148+0000 7fcfdaef9700 1 -- 172.21.15.40:0/2351128822 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcfd4062380 con 0x7fcfd409e480 2023-09-30T22:28:12.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.148+0000 7fcfd17fa700 1 -- 172.21.15.40:0/2351128822 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcfcc011e00 con 0x7fcfd409e480 2023-09-30T22:28:12.149 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:12.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.150+0000 7fcfdaef9700 1 -- 172.21.15.40:0/2351128822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfd409e480 msgr2=0x7fcfd412e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:12.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.150+0000 7fcfdaef9700 1 --2- 172.21.15.40:0/2351128822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfd409e480 0x7fcfd412e030 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc016000 tx=0x7fcfcc004ad0 comp rx=0 tx=0).stop 2023-09-30T22:28:12.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.151+0000 7fcfdaef9700 1 -- 172.21.15.40:0/2351128822 shutdown_connections 2023-09-30T22:28:12.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.151+0000 7fcfdaef9700 1 --2- 172.21.15.40:0/2351128822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfd409e480 0x7fcfd412e030 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:12.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.151+0000 7fcfdaef9700 1 --2- 172.21.15.40:0/2351128822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfd409c890 0x7fcfd412d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:12.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.151+0000 7fcfdaef9700 1 --2- 172.21.15.40:0/2351128822 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcfd409d920 0x7fcfd412daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:12.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.151+0000 7fcfdaef9700 1 -- 172.21.15.40:0/2351128822 >> 172.21.15.40:0/2351128822 conn(0x7fcfd40a7080 msgr2=0x7fcfd41332c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:12.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.151+0000 7fcfdaef9700 1 -- 172.21.15.40:0/2351128822 shutdown_connections 2023-09-30T22:28:12.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.151+0000 7fcfdaef9700 1 -- 172.21.15.40:0/2351128822 wait complete. 2023-09-30T22:28:12.163 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:12.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.234+0000 7fcb559ec700 1 -- 172.21.15.40:0/3442143952 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcb50062380 con 0x7fcb5009dd70 2023-09-30T22:28:12.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.234+0000 7fcb37fff700 1 -- 172.21.15.40:0/3442143952 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcb44017020 con 0x7fcb5009dd70 2023-09-30T22:28:12.235 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:12.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.236+0000 7fcb559ec700 1 -- 172.21.15.40:0/3442143952 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb5009dd70 msgr2=0x7fcb501c55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:12.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.236+0000 7fcb559ec700 1 --2- 172.21.15.40:0/3442143952 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb5009dd70 0x7fcb501c55d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400e980 tx=0x7fcb4400ec90 comp rx=0 tx=0).stop 2023-09-30T22:28:12.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.237+0000 7fcb559ec700 1 -- 172.21.15.40:0/3442143952 shutdown_connections 2023-09-30T22:28:12.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.237+0000 7fcb559ec700 1 --2- 172.21.15.40:0/3442143952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb50133e00 0x7fcb50119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:12.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.237+0000 7fcb559ec700 1 --2- 172.21.15.40:0/3442143952 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb5009d400 0x7fcb501c5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:12.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.237+0000 7fcb559ec700 1 --2- 172.21.15.40:0/3442143952 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb5009dd70 0x7fcb501c55d0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:12.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.237+0000 7fcb559ec700 1 -- 172.21.15.40:0/3442143952 >> 172.21.15.40:0/3442143952 conn(0x7fcb500a2a00 msgr2=0x7fcb5012d980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:12.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.237+0000 7fcb559ec700 1 -- 172.21.15.40:0/3442143952 shutdown_connections 2023-09-30T22:28:12.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.237+0000 7fcb559ec700 1 -- 172.21.15.40:0/3442143952 wait complete. 2023-09-30T22:28:12.249 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:12.813 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:12.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.953+0000 7fd568b44700 1 Processor -- start 2023-09-30T22:28:12.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.953+0000 7fd568b44700 1 -- start start 2023-09-30T22:28:12.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.954+0000 7fd568b44700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd564136c50 0x7fd564139030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:12.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.954+0000 7fd568b44700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd564139570 0x7fd56413b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:12.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.954+0000 7fd568b44700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd564133940 con 0x7fd564133e00 2023-09-30T22:28:12.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.954+0000 7fd568b44700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd56409af70 con 0x7fd564136c50 2023-09-30T22:28:12.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.954+0000 7fd568b44700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd56409ab20 con 0x7fd564139570 2023-09-30T22:28:12.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.954+0000 7fd56259c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd564133e00 0x7fd5641341d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43760/0 (socket says 172.21.15.40:43760) 2023-09-30T22:28:12.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.954+0000 7fd56259c700 1 -- 172.21.15.40:0/2975132427 learned_addr learned my addr 172.21.15.40:0/2975132427 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:12.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.954+0000 7fd562d9d700 1 --2- 172.21.15.40:0/2975132427 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd564139570 0x7fd56413b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:12.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.954+0000 7fd561d9b700 1 --2- 172.21.15.40:0/2975132427 >> v2:172.21.15.40:3300/0 conn(0x7fd564136c50 0x7fd564139030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:12.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.954+0000 7fd561d9b700 1 -- 172.21.15.40:0/2975132427 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd564139570 msgr2=0x7fd56413b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:12.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.954+0000 7fd561d9b700 1 --2- 172.21.15.40:0/2975132427 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd564139570 0x7fd56413b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:12.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.954+0000 7fd561d9b700 1 -- 172.21.15.40:0/2975132427 >> v1:172.21.15.40:6789/0 conn(0x7fd564133e00 legacy=0x7fd5641341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:12.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.954+0000 7fd561d9b700 1 -- 172.21.15.40:0/2975132427 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd56409f0d0 con 0x7fd564136c50 2023-09-30T22:28:12.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.954+0000 7fd561d9b700 1 --2- 172.21.15.40:0/2975132427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd564136c50 0x7fd564139030 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fd558009840 tx=0x7fd558009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17e1b3576635348 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:12.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.954+0000 7fd56159a700 1 -- 172.21.15.40:0/2975132427 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd558011830 con 0x7fd564136c50 2023-09-30T22:28:12.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.955+0000 7fd56159a700 1 -- 172.21.15.40:0/2975132427 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd558011990 con 0x7fd564136c50 2023-09-30T22:28:12.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.955+0000 7fd56159a700 1 -- 172.21.15.40:0/2975132427 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd558011d20 con 0x7fd564136c50 2023-09-30T22:28:12.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.955+0000 7fd568b44700 1 -- 172.21.15.40:0/2975132427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd564136c50 msgr2=0x7fd564139030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:12.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.955+0000 7fd568b44700 1 --2- 172.21.15.40:0/2975132427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd564136c50 0x7fd564139030 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fd558009840 tx=0x7fd558009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:12.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.955+0000 7fd568b44700 1 -- 172.21.15.40:0/2975132427 shutdown_connections 2023-09-30T22:28:12.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.955+0000 7fd568b44700 1 --2- 172.21.15.40:0/2975132427 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd564139570 0x7fd56413b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:12.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.955+0000 7fd568b44700 1 --2- 172.21.15.40:0/2975132427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd564136c50 0x7fd564139030 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:12.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.955+0000 7fd568b44700 1 -- 172.21.15.40:0/2975132427 >> 172.21.15.40:0/2975132427 conn(0x7fd5640a2a00 msgr2=0x7fd5640a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:12.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.955+0000 7fd568b44700 1 -- 172.21.15.40:0/2975132427 shutdown_connections 2023-09-30T22:28:12.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.955+0000 7fd568b44700 1 -- 172.21.15.40:0/2975132427 wait complete. 2023-09-30T22:28:12.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.957+0000 7fd568b44700 1 Processor -- start 2023-09-30T22:28:12.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.957+0000 7fd568b44700 1 -- start start 2023-09-30T22:28:12.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.957+0000 7fd568b44700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd564133e00 0x7fd564119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:12.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.957+0000 7fd568b44700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd564136c50 0x7fd564119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:12.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.957+0000 7fd568b44700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd564139570 0x7fd564119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:12.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.957+0000 7fd568b44700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56411b460 con 0x7fd564136c50 2023-09-30T22:28:12.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.957+0000 7fd568b44700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd56411ba00 con 0x7fd564133e00 2023-09-30T22:28:12.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.957+0000 7fd568b44700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd56412ddd0 con 0x7fd564139570 2023-09-30T22:28:12.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.957+0000 7fd561d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd564136c50 0x7fd564119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:12.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.957+0000 7fd562d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd564139570 0x7fd564119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:12.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.957+0000 7fd561d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd564136c50 0x7fd564119590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39610/0 (socket says 172.21.15.40:39610) 2023-09-30T22:28:12.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.957+0000 7fd561d9b700 1 -- 172.21.15.40:0/2263028762 learned_addr learned my addr 172.21.15.40:0/2263028762 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:12.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.957+0000 7fd56259c700 1 --2- 172.21.15.40:0/2263028762 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd564133e00 0x7fd564119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:12.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.958+0000 7fd561d9b700 1 -- 172.21.15.40:0/2263028762 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd564139570 msgr2=0x7fd564119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:12.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.958+0000 7fd561d9b700 1 --2- 172.21.15.40:0/2263028762 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd564139570 0x7fd564119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:12.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.958+0000 7fd561d9b700 1 -- 172.21.15.40:0/2263028762 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd564133e00 msgr2=0x7fd564119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:12.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.958+0000 7fd561d9b700 1 --2- 172.21.15.40:0/2263028762 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd564133e00 0x7fd564119050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:12.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.958+0000 7fd561d9b700 1 -- 172.21.15.40:0/2263028762 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5580094a0 con 0x7fd564136c50 2023-09-30T22:28:12.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.958+0000 7fd561d9b700 1 --2- 172.21.15.40:0/2263028762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd564136c50 0x7fd564119590 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fd558009fd0 tx=0x7fd558004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:12.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.958+0000 7fd552ffd700 1 -- 172.21.15.40:0/2263028762 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5580036a0 con 0x7fd564136c50 2023-09-30T22:28:12.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.958+0000 7fd552ffd700 1 -- 172.21.15.40:0/2263028762 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd55801f070 con 0x7fd564136c50 2023-09-30T22:28:12.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.958+0000 7fd568b44700 1 -- 172.21.15.40:0/2263028762 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd56411a310 con 0x7fd564136c50 2023-09-30T22:28:12.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.958+0000 7fd552ffd700 1 -- 172.21.15.40:0/2263028762 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd558003a60 con 0x7fd564136c50 2023-09-30T22:28:12.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.958+0000 7fd568b44700 1 -- 172.21.15.40:0/2263028762 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd56411b720 con 0x7fd564136c50 2023-09-30T22:28:12.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.959+0000 7fd552ffd700 1 -- 172.21.15.40:0/2263028762 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd558003bc0 con 0x7fd564136c50 2023-09-30T22:28:12.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.959+0000 7fd552ffd700 1 -- 172.21.15.40:0/2263028762 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd558021070 con 0x7fd564136c50 2023-09-30T22:28:12.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.959+0000 7fd568b44700 1 -- 172.21.15.40:0/2263028762 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd564062380 con 0x7fd564136c50 2023-09-30T22:28:12.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:12.964+0000 7fd552ffd700 1 -- 172.21.15.40:0/2263028762 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd55802b080 con 0x7fd564136c50 2023-09-30T22:28:13.110 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:13.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.160+0000 7fd568b44700 1 -- 172.21.15.40:0/2263028762 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd564074330 con 0x7fd564136c50 2023-09-30T22:28:13.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.160+0000 7fd552ffd700 1 -- 172.21.15.40:0/2263028762 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd558015020 con 0x7fd564136c50 2023-09-30T22:28:13.161 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:13.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.162+0000 7fd568b44700 1 -- 172.21.15.40:0/2263028762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd564136c50 msgr2=0x7fd564119590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:13.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.162+0000 7fd568b44700 1 --2- 172.21.15.40:0/2263028762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd564136c50 0x7fd564119590 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fd558009fd0 tx=0x7fd558004750 comp rx=0 tx=0).stop 2023-09-30T22:28:13.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.162+0000 7fd568b44700 1 -- 172.21.15.40:0/2263028762 shutdown_connections 2023-09-30T22:28:13.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.162+0000 7fd568b44700 1 --2- 172.21.15.40:0/2263028762 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd564139570 0x7fd564119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.162+0000 7fd568b44700 1 --2- 172.21.15.40:0/2263028762 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd564133e00 0x7fd564119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.162+0000 7fd568b44700 1 --2- 172.21.15.40:0/2263028762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd564136c50 0x7fd564119590 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.162+0000 7fd568b44700 1 -- 172.21.15.40:0/2263028762 >> 172.21.15.40:0/2263028762 conn(0x7fd5640a2a00 msgr2=0x7fd56409b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:13.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.163+0000 7fd568b44700 1 -- 172.21.15.40:0/2263028762 shutdown_connections 2023-09-30T22:28:13.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.163+0000 7fd568b44700 1 -- 172.21.15.40:0/2263028762 wait complete. 2023-09-30T22:28:13.164 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:13.176 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:13.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.241+0000 7fc52fc49700 1 Processor -- start 2023-09-30T22:28:13.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.241+0000 7fc52fc49700 1 -- start start 2023-09-30T22:28:13.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.242+0000 7fc52fc49700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc52806a6d0 0x7fc52806aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:13.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.242+0000 7fc52fc49700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc52806afe0 0x7fc5281318b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:13.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.242+0000 7fc52fc49700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc52809eb50 con 0x7fc528131df0 2023-09-30T22:28:13.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.242+0000 7fc52fc49700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc52809dde0 con 0x7fc52806afe0 2023-09-30T22:28:13.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.242+0000 7fc52fc49700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc52809d4a0 con 0x7fc52806a6d0 2023-09-30T22:28:13.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.242+0000 7fc52d9e5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc52806a6d0 0x7fc52806aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:13.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.242+0000 7fc52d9e5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc52806a6d0 0x7fc52806aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:40790/0 (socket says 172.21.15.40:40790) 2023-09-30T22:28:13.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.242+0000 7fc52d9e5700 1 -- 172.21.15.40:0/146230111 learned_addr learned my addr 172.21.15.40:0/146230111 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:13.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.242+0000 7fc52d1e4700 1 --2- 172.21.15.40:0/146230111 >> v2:172.21.15.40:3300/0 conn(0x7fc52806afe0 0x7fc5281318b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:13.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.242+0000 7fc52d9e5700 1 -- 172.21.15.40:0/146230111 >> v2:172.21.15.40:3300/0 conn(0x7fc52806afe0 msgr2=0x7fc5281318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:13.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.242+0000 7fc52d9e5700 1 --2- 172.21.15.40:0/146230111 >> v2:172.21.15.40:3300/0 conn(0x7fc52806afe0 0x7fc5281318b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.242+0000 7fc52d9e5700 1 -- 172.21.15.40:0/146230111 >> v1:172.21.15.40:6789/0 conn(0x7fc528131df0 legacy=0x7fc528138b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:13.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.242+0000 7fc52d9e5700 1 -- 172.21.15.40:0/146230111 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc52809f5f0 con 0x7fc52806a6d0 2023-09-30T22:28:13.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.242+0000 7fc52d1e4700 1 --2- 172.21.15.40:0/146230111 >> v2:172.21.15.40:3300/0 conn(0x7fc52806afe0 0x7fc5281318b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:13.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.242+0000 7fc52d9e5700 1 --2- 172.21.15.40:0/146230111 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc52806a6d0 0x7fc52806aaa0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc524006fd0 tx=0x7fc52400f050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b3388953bca5945 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:13.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.243+0000 7fc52c9e3700 1 -- 172.21.15.40:0/146230111 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc524012070 con 0x7fc52806a6d0 2023-09-30T22:28:13.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.243+0000 7fc52c9e3700 1 -- 172.21.15.40:0/146230111 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc524005a20 con 0x7fc52806a6d0 2023-09-30T22:28:13.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.243+0000 7fc52c9e3700 1 -- 172.21.15.40:0/146230111 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc524005dd0 con 0x7fc52806a6d0 2023-09-30T22:28:13.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.243+0000 7fc52fc49700 1 -- 172.21.15.40:0/146230111 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc52806a6d0 msgr2=0x7fc52806aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:13.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.243+0000 7fc52fc49700 1 --2- 172.21.15.40:0/146230111 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc52806a6d0 0x7fc52806aaa0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc524006fd0 tx=0x7fc52400f050 comp rx=0 tx=0).stop 2023-09-30T22:28:13.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.243+0000 7fc52fc49700 1 -- 172.21.15.40:0/146230111 shutdown_connections 2023-09-30T22:28:13.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.243+0000 7fc52fc49700 1 --2- 172.21.15.40:0/146230111 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc52806a6d0 0x7fc52806aaa0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.243+0000 7fc52fc49700 1 --2- 172.21.15.40:0/146230111 >> v2:172.21.15.40:3300/0 conn(0x7fc52806afe0 0x7fc5281318b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.243+0000 7fc52fc49700 1 -- 172.21.15.40:0/146230111 >> 172.21.15.40:0/146230111 conn(0x7fc52809fb20 msgr2=0x7fc52809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:13.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.244+0000 7fc52fc49700 1 -- 172.21.15.40:0/146230111 shutdown_connections 2023-09-30T22:28:13.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.244+0000 7fc52fc49700 1 -- 172.21.15.40:0/146230111 wait complete. 2023-09-30T22:28:13.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.244+0000 7fc52fc49700 1 Processor -- start 2023-09-30T22:28:13.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.244+0000 7fc52fc49700 1 -- start start 2023-09-30T22:28:13.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.245+0000 7fc52fc49700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc52806a6d0 0x7fc5281c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:13.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.245+0000 7fc52fc49700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc52806afe0 0x7fc5281c4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:13.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.245+0000 7fc52fc49700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc528131df0 0x7fc5281c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:13.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.245+0000 7fc52fc49700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5281206d0 con 0x7fc52806afe0 2023-09-30T22:28:13.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.245+0000 7fc52fc49700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc528120f80 con 0x7fc528131df0 2023-09-30T22:28:13.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.245+0000 7fc52fc49700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5281225e0 con 0x7fc52806a6d0 2023-09-30T22:28:13.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.245+0000 7fc52d9e5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc52806a6d0 0x7fc5281c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:13.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.245+0000 7fc52e1e6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc528131df0 0x7fc5281c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:13.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.245+0000 7fc52d1e4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc52806afe0 0x7fc5281c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:13.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.245+0000 7fc52d9e5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc52806a6d0 0x7fc5281c41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:40798/0 (socket says 172.21.15.40:40798) 2023-09-30T22:28:13.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.245+0000 7fc52d9e5700 1 -- 172.21.15.40:0/818545937 learned_addr learned my addr 172.21.15.40:0/818545937 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:13.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.245+0000 7fc52e1e6700 1 -- 172.21.15.40:0/818545937 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc52806a6d0 msgr2=0x7fc5281c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:13.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.245+0000 7fc52e1e6700 1 --2- 172.21.15.40:0/818545937 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc52806a6d0 0x7fc5281c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.245+0000 7fc52e1e6700 1 -- 172.21.15.40:0/818545937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc52806afe0 msgr2=0x7fc5281c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:13.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.245+0000 7fc52e1e6700 1 --2- 172.21.15.40:0/818545937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc52806afe0 0x7fc5281c4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.245+0000 7fc52e1e6700 1 -- 172.21.15.40:0/818545937 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5180094a0 con 0x7fc528131df0 2023-09-30T22:28:13.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.245+0000 7fc52d1e4700 1 --2- 172.21.15.40:0/818545937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc52806afe0 0x7fc5281c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:13.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.245+0000 7fc52d9e5700 1 --2- 172.21.15.40:0/818545937 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc52806a6d0 0x7fc5281c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:13.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.246+0000 7fc52e1e6700 1 --2- 172.21.15.40:0/818545937 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc528131df0 0x7fc5281c4c40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc52000cb90 tx=0x7fc52000cea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:13.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.246+0000 7fc51e7fc700 1 -- 172.21.15.40:0/818545937 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc520003c00 con 0x7fc528131df0 2023-09-30T22:28:13.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.246+0000 7fc51e7fc700 1 -- 172.21.15.40:0/818545937 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc520003d60 con 0x7fc528131df0 2023-09-30T22:28:13.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.246+0000 7fc52fc49700 1 -- 172.21.15.40:0/818545937 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc52400d9a0 con 0x7fc528131df0 2023-09-30T22:28:13.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.246+0000 7fc51e7fc700 1 -- 172.21.15.40:0/818545937 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52000aa80 con 0x7fc528131df0 2023-09-30T22:28:13.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.246+0000 7fc52fc49700 1 -- 172.21.15.40:0/818545937 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5280715b0 con 0x7fc528131df0 2023-09-30T22:28:13.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.246+0000 7fc51e7fc700 1 -- 172.21.15.40:0/818545937 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc52000abe0 con 0x7fc528131df0 2023-09-30T22:28:13.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.247+0000 7fc51e7fc700 1 -- 172.21.15.40:0/818545937 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc52003f530 con 0x7fc528131df0 2023-09-30T22:28:13.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.247+0000 7fc52fc49700 1 -- 172.21.15.40:0/818545937 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc528121fa0 con 0x7fc528131df0 2023-09-30T22:28:13.251 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:13.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.251+0000 7fc51e7fc700 1 -- 172.21.15.40:0/818545937 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc528121fa0 con 0x7fc528131df0 2023-09-30T22:28:13.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.295+0000 7f339ce7b700 1 Processor -- start 2023-09-30T22:28:13.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.295+0000 7f339ce7b700 1 -- start start 2023-09-30T22:28:13.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.295+0000 7f339ce7b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f339806b1b0 0x7f3398136af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:13.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.295+0000 7f339ce7b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3398137030 0x7f3398139410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:13.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.295+0000 7f339ce7b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f339809eb50 con 0x7f339806a6d0 2023-09-30T22:28:13.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.295+0000 7f339ce7b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f339809dde0 con 0x7f339806b1b0 2023-09-30T22:28:13.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.295+0000 7f339ce7b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339809d4a0 con 0x7f3398137030 2023-09-30T22:28:13.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.295+0000 7f3395d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f339806b1b0 0x7f3398136af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:13.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.295+0000 7f3396d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3398137030 0x7f3398139410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:13.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.295+0000 7f3395d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f339806b1b0 0x7f3398136af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41134/0 (socket says 172.21.15.40:41134) 2023-09-30T22:28:13.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.296+0000 7f3396d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3398137030 0x7f3398139410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60094/0 (socket says 172.21.15.40:60094) 2023-09-30T22:28:13.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.296+0000 7f3395d9b700 1 -- 172.21.15.40:0/2561654781 learned_addr learned my addr 172.21.15.40:0/2561654781 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:13.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.296+0000 7f3396d9d700 1 -- 172.21.15.40:0/2561654781 >> v2:172.21.15.40:3300/0 conn(0x7f339806b1b0 msgr2=0x7f3398136af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:13.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.296+0000 7f3396d9d700 1 --2- 172.21.15.40:0/2561654781 >> v2:172.21.15.40:3300/0 conn(0x7f339806b1b0 0x7f3398136af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.296+0000 7f3396d9d700 1 -- 172.21.15.40:0/2561654781 >> v1:172.21.15.40:6789/0 conn(0x7f339806a6d0 legacy=0x7f339806aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:13.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.296+0000 7f3396d9d700 1 -- 172.21.15.40:0/2561654781 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f339809f5f0 con 0x7f3398137030 2023-09-30T22:28:13.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.296+0000 7f3395d9b700 1 --2- 172.21.15.40:0/2561654781 >> v2:172.21.15.40:3300/0 conn(0x7f339806b1b0 0x7f3398136af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:13.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.296+0000 7f3396d9d700 1 --2- 172.21.15.40:0/2561654781 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3398137030 0x7f3398139410 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3390009d90 tx=0x7f339000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1074bc94fe3f149a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:13.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.296+0000 7f339559a700 1 -- 172.21.15.40:0/2561654781 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339000e070 con 0x7f3398137030 2023-09-30T22:28:13.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.296+0000 7f339559a700 1 -- 172.21.15.40:0/2561654781 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f339000bb20 con 0x7f3398137030 2023-09-30T22:28:13.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.296+0000 7f339559a700 1 -- 172.21.15.40:0/2561654781 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3390012430 con 0x7f3398137030 2023-09-30T22:28:13.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.297+0000 7f339ce7b700 1 -- 172.21.15.40:0/2561654781 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3398137030 msgr2=0x7f3398139410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:13.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.297+0000 7f339ce7b700 1 --2- 172.21.15.40:0/2561654781 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3398137030 0x7f3398139410 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3390009d90 tx=0x7f339000b330 comp rx=0 tx=0).stop 2023-09-30T22:28:13.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.297+0000 7f339ce7b700 1 -- 172.21.15.40:0/2561654781 shutdown_connections 2023-09-30T22:28:13.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.297+0000 7f339ce7b700 1 --2- 172.21.15.40:0/2561654781 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3398137030 0x7f3398139410 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.297+0000 7f339ce7b700 1 --2- 172.21.15.40:0/2561654781 >> v2:172.21.15.40:3300/0 conn(0x7f339806b1b0 0x7f3398136af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.297+0000 7f339ce7b700 1 -- 172.21.15.40:0/2561654781 >> 172.21.15.40:0/2561654781 conn(0x7f339809fb20 msgr2=0x7f339809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:13.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.297+0000 7f339ce7b700 1 -- 172.21.15.40:0/2561654781 shutdown_connections 2023-09-30T22:28:13.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.297+0000 7f339ce7b700 1 -- 172.21.15.40:0/2561654781 wait complete. 2023-09-30T22:28:13.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.298+0000 7f339ce7b700 1 Processor -- start 2023-09-30T22:28:13.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.298+0000 7f339ce7b700 1 -- start start 2023-09-30T22:28:13.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.299+0000 7f339ce7b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f339806a6d0 0x7f339811e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:13.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.299+0000 7f339ce7b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f339806b1b0 0x7f339811eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:13.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.299+0000 7f339ce7b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3398137030 0x7f339811f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:13.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.299+0000 7f339ce7b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339811fe70 con 0x7f339806b1b0 2023-09-30T22:28:13.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.299+0000 7f339ce7b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3398136d90 con 0x7f3398137030 2023-09-30T22:28:13.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.299+0000 7f339ce7b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33981217b0 con 0x7f339806a6d0 2023-09-30T22:28:13.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.299+0000 7f3395d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f339806b1b0 0x7f339811eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:13.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.299+0000 7f3395d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f339806b1b0 0x7f339811eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41138/0 (socket says 172.21.15.40:41138) 2023-09-30T22:28:13.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.299+0000 7f3395d9b700 1 -- 172.21.15.40:0/3995855096 learned_addr learned my addr 172.21.15.40:0/3995855096 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:13.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.299+0000 7f3396d9d700 1 --2- 172.21.15.40:0/3995855096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3398137030 0x7f339811f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:13.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.299+0000 7f339659c700 1 --2- 172.21.15.40:0/3995855096 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f339806a6d0 0x7f339811e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:13.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.299+0000 7f3395d9b700 1 -- 172.21.15.40:0/3995855096 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f339806a6d0 msgr2=0x7f339811e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:13.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.299+0000 7f3395d9b700 1 --2- 172.21.15.40:0/3995855096 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f339806a6d0 0x7f339811e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.299+0000 7f3395d9b700 1 -- 172.21.15.40:0/3995855096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3398137030 msgr2=0x7f339811f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:13.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.299+0000 7f3395d9b700 1 --2- 172.21.15.40:0/3995855096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3398137030 0x7f339811f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.299+0000 7f3395d9b700 1 -- 172.21.15.40:0/3995855096 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f338c009550 con 0x7f339806b1b0 2023-09-30T22:28:13.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.299+0000 7f3395d9b700 1 --2- 172.21.15.40:0/3995855096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f339806b1b0 0x7f339811eee0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f338c00ebe0 tx=0x7f338c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:13.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.299+0000 7f3386ffd700 1 -- 172.21.15.40:0/3995855096 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c00c850 con 0x7f339806b1b0 2023-09-30T22:28:13.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.299+0000 7f3386ffd700 1 -- 172.21.15.40:0/3995855096 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338c00c9b0 con 0x7f339806b1b0 2023-09-30T22:28:13.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.299+0000 7f3386ffd700 1 -- 172.21.15.40:0/3995855096 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c00cd40 con 0x7f339806b1b0 2023-09-30T22:28:13.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.299+0000 7f339ce7b700 1 -- 172.21.15.40:0/3995855096 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3390009a70 con 0x7f339806b1b0 2023-09-30T22:28:13.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.300+0000 7f339ce7b700 1 -- 172.21.15.40:0/3995855096 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3398121c00 con 0x7f339806b1b0 2023-09-30T22:28:13.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.301+0000 7f339ce7b700 1 -- 172.21.15.40:0/3995855096 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33981377f0 con 0x7f339806b1b0 2023-09-30T22:28:13.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.301+0000 7f3386ffd700 1 -- 172.21.15.40:0/3995855096 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f338c013470 con 0x7f339806b1b0 2023-09-30T22:28:13.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.301+0000 7f3386ffd700 1 -- 172.21.15.40:0/3995855096 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f338c03f8b0 con 0x7f339806b1b0 2023-09-30T22:28:13.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.306+0000 7f3386ffd700 1 -- 172.21.15.40:0/3995855096 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f338c0232f0 con 0x7f339806b1b0 2023-09-30T22:28:13.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.394+0000 7f8667cb9700 1 Processor -- start 2023-09-30T22:28:13.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.394+0000 7f8667cb9700 1 -- start start 2023-09-30T22:28:13.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.395+0000 7f8667cb9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8660136bf0 0x7f8660138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:13.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.395+0000 7f8667cb9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8660139510 0x7f866013b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:13.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.395+0000 7f8667cb9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86600a2600 con 0x7f866009c890 2023-09-30T22:28:13.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.395+0000 7f8667cb9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86600a29d0 con 0x7f8660136bf0 2023-09-30T22:28:13.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.395+0000 7f8667cb9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866009fb40 con 0x7f8660139510 2023-09-30T22:28:13.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.395+0000 7f8665254700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8660136bf0 0x7f8660138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:13.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.395+0000 7f8666256700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8660139510 0x7f866013b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:13.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.395+0000 7f8665254700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8660136bf0 0x7f8660138fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41140/0 (socket says 172.21.15.40:41140) 2023-09-30T22:28:13.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.395+0000 7f8665254700 1 -- 172.21.15.40:0/3727451206 learned_addr learned my addr 172.21.15.40:0/3727451206 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:13.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.395+0000 7f8666256700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8660139510 0x7f866013b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60104/0 (socket says 172.21.15.40:60104) 2023-09-30T22:28:13.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.395+0000 7f8666256700 1 -- 172.21.15.40:0/3727451206 >> v2:172.21.15.40:3300/0 conn(0x7f8660136bf0 msgr2=0x7f8660138fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:13.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.395+0000 7f8666256700 1 --2- 172.21.15.40:0/3727451206 >> v2:172.21.15.40:3300/0 conn(0x7f8660136bf0 0x7f8660138fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.395+0000 7f8666256700 1 -- 172.21.15.40:0/3727451206 >> v1:172.21.15.40:6789/0 conn(0x7f866009c890 legacy=0x7f866009cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:13.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.395+0000 7f8666256700 1 -- 172.21.15.40:0/3727451206 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866009d370 con 0x7f8660139510 2023-09-30T22:28:13.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.395+0000 7f8664a53700 1 -- 172.21.15.40:0/3727451206 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3272802014 0 0) 0x7f86600a2600 con 0x7f866009c890 2023-09-30T22:28:13.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.395+0000 7f8665254700 1 --2- 172.21.15.40:0/3727451206 >> v2:172.21.15.40:3300/0 conn(0x7f8660136bf0 0x7f8660138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:13.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.396+0000 7f8666256700 1 --2- 172.21.15.40:0/3727451206 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8660139510 0x7f866013b8f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8658009d90 tx=0x7f865800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65606fcaa716a044 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:13.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.396+0000 7f8664a53700 1 -- 172.21.15.40:0/3727451206 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865800e070 con 0x7f8660139510 2023-09-30T22:28:13.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.396+0000 7f8664a53700 1 -- 172.21.15.40:0/3727451206 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865800bb20 con 0x7f8660139510 2023-09-30T22:28:13.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.396+0000 7f8664a53700 1 -- 172.21.15.40:0/3727451206 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8658012430 con 0x7f8660139510 2023-09-30T22:28:13.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.396+0000 7f8667cb9700 1 -- 172.21.15.40:0/3727451206 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8660139510 msgr2=0x7f866013b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:13.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.396+0000 7f8667cb9700 1 --2- 172.21.15.40:0/3727451206 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8660139510 0x7f866013b8f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8658009d90 tx=0x7f865800b330 comp rx=0 tx=0).stop 2023-09-30T22:28:13.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.396+0000 7f8667cb9700 1 -- 172.21.15.40:0/3727451206 shutdown_connections 2023-09-30T22:28:13.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.396+0000 7f8667cb9700 1 --2- 172.21.15.40:0/3727451206 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8660139510 0x7f866013b8f0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.396+0000 7f8667cb9700 1 --2- 172.21.15.40:0/3727451206 >> v2:172.21.15.40:3300/0 conn(0x7f8660136bf0 0x7f8660138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.396+0000 7f8667cb9700 1 -- 172.21.15.40:0/3727451206 >> 172.21.15.40:0/3727451206 conn(0x7f86600a7080 msgr2=0x7f86600a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:13.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.396+0000 7f8667cb9700 1 -- 172.21.15.40:0/3727451206 shutdown_connections 2023-09-30T22:28:13.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.397+0000 7f8667cb9700 1 -- 172.21.15.40:0/3727451206 wait complete. 2023-09-30T22:28:13.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.397+0000 7f8667cb9700 1 Processor -- start 2023-09-30T22:28:13.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.397+0000 7f8667cb9700 1 -- start start 2023-09-30T22:28:13.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.398+0000 7f8667cb9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f866009c890 0x7f866006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:13.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.398+0000 7f8667cb9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8660136bf0 0x7f866006f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:13.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.398+0000 7f8667cb9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8660139510 0x7f866006fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:13.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.398+0000 7f8667cb9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866012b5f0 con 0x7f8660139510 2023-09-30T22:28:13.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.398+0000 7f8667cb9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866012ba90 con 0x7f866009c890 2023-09-30T22:28:13.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.398+0000 7f8667cb9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f866012c110 con 0x7f8660136bf0 2023-09-30T22:28:13.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.398+0000 7f8665254700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8660136bf0 0x7f866006f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:13.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.398+0000 7f8665a55700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f866009c890 0x7f866006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:13.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.398+0000 7f8665254700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8660136bf0 0x7f866006f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:40814/0 (socket says 172.21.15.40:40814) 2023-09-30T22:28:13.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.398+0000 7f8665254700 1 -- 172.21.15.40:0/2452029779 learned_addr learned my addr 172.21.15.40:0/2452029779 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:13.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.398+0000 7f8666256700 1 --2- 172.21.15.40:0/2452029779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8660139510 0x7f866006fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:13.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.398+0000 7f8665a55700 1 -- 172.21.15.40:0/2452029779 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8660136bf0 msgr2=0x7f866006f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:13.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.398+0000 7f8665a55700 1 --2- 172.21.15.40:0/2452029779 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8660136bf0 0x7f866006f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.398+0000 7f8665a55700 1 -- 172.21.15.40:0/2452029779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8660139510 msgr2=0x7f866006fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:13.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.398+0000 7f8665a55700 1 --2- 172.21.15.40:0/2452029779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8660139510 0x7f866006fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.398+0000 7f8665a55700 1 -- 172.21.15.40:0/2452029779 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8650009550 con 0x7f866009c890 2023-09-30T22:28:13.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.398+0000 7f8665254700 1 --2- 172.21.15.40:0/2452029779 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8660136bf0 0x7f866006f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:13.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.399+0000 7f8665a55700 1 --2- 172.21.15.40:0/2452029779 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f866009c890 0x7f866006f080 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f865c00c430 tx=0x7f865c00c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:13.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.399+0000 7f86567fc700 1 -- 172.21.15.40:0/2452029779 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c0054e0 con 0x7f866009c890 2023-09-30T22:28:13.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.399+0000 7f86567fc700 1 -- 172.21.15.40:0/2452029779 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865c00ce40 con 0x7f866009c890 2023-09-30T22:28:13.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.399+0000 7f86567fc700 1 -- 172.21.15.40:0/2452029779 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c0038c0 con 0x7f866009c890 2023-09-30T22:28:13.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.399+0000 7f8667cb9700 1 -- 172.21.15.40:0/2452029779 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8658009a70 con 0x7f866009c890 2023-09-30T22:28:13.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.399+0000 7f8667cb9700 1 -- 172.21.15.40:0/2452029779 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f866009ed40 con 0x7f866009c890 2023-09-30T22:28:13.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.400+0000 7f86567fc700 1 -- 172.21.15.40:0/2452029779 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f865c003a20 con 0x7f866009c890 2023-09-30T22:28:13.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.400+0000 7f86567fc700 1 -- 172.21.15.40:0/2452029779 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f865c03ea80 con 0x7f866009c890 2023-09-30T22:28:13.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.400+0000 7f8667cb9700 1 -- 172.21.15.40:0/2452029779 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8660136690 con 0x7f866009c890 2023-09-30T22:28:13.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.409+0000 7f86567fc700 1 -- 172.21.15.40:0/2452029779 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f865c017030 con 0x7f866009c890 2023-09-30T22:28:13.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.459+0000 7fc52fc49700 1 -- 172.21.15.40:0/818545937 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc528121fa0 con 0x7fc528131df0 2023-09-30T22:28:13.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.459+0000 7fc51e7fc700 1 -- 172.21.15.40:0/818545937 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc528121fa0 con 0x7fc528131df0 2023-09-30T22:28:13.460 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:13.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.461+0000 7fc52fc49700 1 -- 172.21.15.40:0/818545937 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc528131df0 msgr2=0x7fc5281c4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:13.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.461+0000 7fc52fc49700 1 --2- 172.21.15.40:0/818545937 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc528131df0 0x7fc5281c4c40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc52000cb90 tx=0x7fc52000cea0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.461+0000 7fc52fc49700 1 -- 172.21.15.40:0/818545937 shutdown_connections 2023-09-30T22:28:13.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.461+0000 7fc52fc49700 1 --2- 172.21.15.40:0/818545937 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc52806a6d0 0x7fc5281c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.461+0000 7fc52fc49700 1 --2- 172.21.15.40:0/818545937 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc528131df0 0x7fc5281c4c40 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.461+0000 7fc52fc49700 1 --2- 172.21.15.40:0/818545937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc52806afe0 0x7fc5281c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.461+0000 7fc52fc49700 1 -- 172.21.15.40:0/818545937 >> 172.21.15.40:0/818545937 conn(0x7fc52809fb20 msgr2=0x7fc528070190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:13.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.462+0000 7fc52fc49700 1 -- 172.21.15.40:0/818545937 shutdown_connections 2023-09-30T22:28:13.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.462+0000 7fc52fc49700 1 -- 172.21.15.40:0/818545937 wait complete. 2023-09-30T22:28:13.475 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:13.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.520+0000 7f339ce7b700 1 -- 172.21.15.40:0/3995855096 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3398071560 con 0x7f339806b1b0 2023-09-30T22:28:13.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.520+0000 7f3386ffd700 1 -- 172.21.15.40:0/3995855096 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f338c021070 con 0x7f339806b1b0 2023-09-30T22:28:13.521 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:13.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.522+0000 7f339ce7b700 1 -- 172.21.15.40:0/3995855096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f339806b1b0 msgr2=0x7f339811eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:13.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.522+0000 7f339ce7b700 1 --2- 172.21.15.40:0/3995855096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f339806b1b0 0x7f339811eee0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f338c00ebe0 tx=0x7f338c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.522+0000 7f339ce7b700 1 -- 172.21.15.40:0/3995855096 shutdown_connections 2023-09-30T22:28:13.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.522+0000 7f339ce7b700 1 --2- 172.21.15.40:0/3995855096 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f339806a6d0 0x7f339811e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.522+0000 7f339ce7b700 1 --2- 172.21.15.40:0/3995855096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3398137030 0x7f339811f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.522+0000 7f339ce7b700 1 --2- 172.21.15.40:0/3995855096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f339806b1b0 0x7f339811eee0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.522+0000 7f339ce7b700 1 -- 172.21.15.40:0/3995855096 >> 172.21.15.40:0/3995855096 conn(0x7f339809fb20 msgr2=0x7f3398070190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:13.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.522+0000 7f339ce7b700 1 -- 172.21.15.40:0/3995855096 shutdown_connections 2023-09-30T22:28:13.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.522+0000 7f339ce7b700 1 -- 172.21.15.40:0/3995855096 wait complete. 2023-09-30T22:28:13.535 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:13.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.608+0000 7f8667cb9700 1 -- 172.21.15.40:0/2452029779 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8660062380 con 0x7f866009c890 2023-09-30T22:28:13.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.608+0000 7f86567fc700 1 -- 172.21.15.40:0/2452029779 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f865c019cd0 con 0x7f866009c890 2023-09-30T22:28:13.609 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:13.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.610+0000 7f8667cb9700 1 -- 172.21.15.40:0/2452029779 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f866009c890 msgr2=0x7f866006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:13.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.610+0000 7f8667cb9700 1 --2- 172.21.15.40:0/2452029779 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f866009c890 0x7f866006f080 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f865c00c430 tx=0x7f865c00c740 comp rx=0 tx=0).stop 2023-09-30T22:28:13.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.610+0000 7f8667cb9700 1 -- 172.21.15.40:0/2452029779 shutdown_connections 2023-09-30T22:28:13.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.610+0000 7f8667cb9700 1 --2- 172.21.15.40:0/2452029779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8660139510 0x7f866006fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.610+0000 7f8667cb9700 1 --2- 172.21.15.40:0/2452029779 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f866009c890 0x7f866006f080 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.610+0000 7f8667cb9700 1 --2- 172.21.15.40:0/2452029779 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8660136bf0 0x7f866006f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.610+0000 7f8667cb9700 1 -- 172.21.15.40:0/2452029779 >> 172.21.15.40:0/2452029779 conn(0x7f86600a7080 msgr2=0x7f86601349d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:13.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.610+0000 7f8667cb9700 1 -- 172.21.15.40:0/2452029779 shutdown_connections 2023-09-30T22:28:13.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:13.610+0000 7f8667cb9700 1 -- 172.21.15.40:0/2452029779 wait complete. 2023-09-30T22:28:13.622 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:14.177 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:14.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.312+0000 7f87136fb700 1 Processor -- start 2023-09-30T22:28:14.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.312+0000 7f87136fb700 1 -- start start 2023-09-30T22:28:14.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.313+0000 7f87136fb700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f870c12f070 0x7f870c135c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.313+0000 7f87136fb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f870c136170 0x7f870c138550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.313+0000 7f87136fb700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f870c09ab70 con 0x7f870c12e590 2023-09-30T22:28:14.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.313+0000 7f87136fb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f870c09b270 con 0x7f870c136170 2023-09-30T22:28:14.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.313+0000 7f87136fb700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f870c12f440 con 0x7f870c12f070 2023-09-30T22:28:14.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.313+0000 7f8711497700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f870c12e590 0x7f870c12e960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39456/0 (socket says 172.21.15.40:39456) 2023-09-30T22:28:14.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.313+0000 7f8711497700 1 -- 172.21.15.40:0/3972022676 learned_addr learned my addr 172.21.15.40:0/3972022676 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:14.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.313+0000 7f8710c96700 1 --2- 172.21.15.40:0/3972022676 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f870c12f070 0x7f870c135c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.313+0000 7f8711c98700 1 --2- 172.21.15.40:0/3972022676 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f870c136170 0x7f870c138550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.313+0000 7f8703fff700 1 -- 172.21.15.40:0/3972022676 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610132608 0 0) 0x7f870c09ab70 con 0x7f870c12e590 2023-09-30T22:28:14.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.313+0000 7f8703fff700 1 -- 172.21.15.40:0/3972022676 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86f80035b0 con 0x7f870c12e590 2023-09-30T22:28:14.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.313+0000 7f8710c96700 1 -- 172.21.15.40:0/3972022676 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f870c136170 msgr2=0x7f870c138550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:14.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.313+0000 7f8710c96700 1 --2- 172.21.15.40:0/3972022676 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f870c136170 0x7f870c138550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.313+0000 7f8710c96700 1 -- 172.21.15.40:0/3972022676 >> v1:172.21.15.40:6789/0 conn(0x7f870c12e590 legacy=0x7f870c12e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.313+0000 7f8710c96700 1 -- 172.21.15.40:0/3972022676 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870c09bd70 con 0x7f870c12f070 2023-09-30T22:28:14.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.313+0000 7f8711c98700 1 --2- 172.21.15.40:0/3972022676 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f870c136170 0x7f870c138550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:14.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.314+0000 7f8710c96700 1 --2- 172.21.15.40:0/3972022676 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f870c12f070 0x7f870c135c30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f86fc009870 tx=0x7f86fc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2464905d7af23c28 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:14.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.314+0000 7f8703fff700 1 -- 172.21.15.40:0/3972022676 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc011830 con 0x7f870c12f070 2023-09-30T22:28:14.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.314+0000 7f8703fff700 1 -- 172.21.15.40:0/3972022676 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86fc011990 con 0x7f870c12f070 2023-09-30T22:28:14.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.314+0000 7f8703fff700 1 -- 172.21.15.40:0/3972022676 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc011d20 con 0x7f870c12f070 2023-09-30T22:28:14.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.314+0000 7f87136fb700 1 -- 172.21.15.40:0/3972022676 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f870c12f070 msgr2=0x7f870c135c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.314+0000 7f87136fb700 1 --2- 172.21.15.40:0/3972022676 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f870c12f070 0x7f870c135c30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f86fc009870 tx=0x7f86fc009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:14.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.314+0000 7f87136fb700 1 -- 172.21.15.40:0/3972022676 shutdown_connections 2023-09-30T22:28:14.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.314+0000 7f87136fb700 1 --2- 172.21.15.40:0/3972022676 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f870c136170 0x7f870c138550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.314+0000 7f87136fb700 1 --2- 172.21.15.40:0/3972022676 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f870c12f070 0x7f870c135c30 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.314+0000 7f87136fb700 1 -- 172.21.15.40:0/3972022676 >> 172.21.15.40:0/3972022676 conn(0x7f870c0a2a00 msgr2=0x7f870c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:14.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.314+0000 7f87136fb700 1 -- 172.21.15.40:0/3972022676 shutdown_connections 2023-09-30T22:28:14.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.314+0000 7f87136fb700 1 -- 172.21.15.40:0/3972022676 wait complete. 2023-09-30T22:28:14.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.315+0000 7f87136fb700 1 Processor -- start 2023-09-30T22:28:14.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.315+0000 7f87136fb700 1 -- start start 2023-09-30T22:28:14.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.316+0000 7f87136fb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f870c12e590 0x7f870c133f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.316+0000 7f87136fb700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f870c12f070 0x7f870c134440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.316+0000 7f87136fb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f870c136170 0x7f870c134980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.316+0000 7f87136fb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870c13acd0 con 0x7f870c136170 2023-09-30T22:28:14.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.316+0000 7f87136fb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f870c12de70 con 0x7f870c12e590 2023-09-30T22:28:14.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.316+0000 7f87136fb700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f870c13b090 con 0x7f870c12f070 2023-09-30T22:28:14.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.316+0000 7f8711497700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f870c12e590 0x7f870c133f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.316+0000 7f8711c98700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f870c136170 0x7f870c134980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.316+0000 7f8711497700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f870c12e590 0x7f870c133f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60130/0 (socket says 172.21.15.40:60130) 2023-09-30T22:28:14.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.316+0000 7f8710c96700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f870c12f070 0x7f870c134440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.316+0000 7f8711c98700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f870c136170 0x7f870c134980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41146/0 (socket says 172.21.15.40:41146) 2023-09-30T22:28:14.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.316+0000 7f8711497700 1 -- 172.21.15.40:0/3812369563 learned_addr learned my addr 172.21.15.40:0/3812369563 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:14.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.316+0000 7f8711497700 1 -- 172.21.15.40:0/3812369563 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f870c12f070 msgr2=0x7f870c134440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.316+0000 7f8711497700 1 --2- 172.21.15.40:0/3812369563 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f870c12f070 0x7f870c134440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.316+0000 7f8711497700 1 -- 172.21.15.40:0/3812369563 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f870c136170 msgr2=0x7f870c134980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.316+0000 7f8711497700 1 --2- 172.21.15.40:0/3812369563 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f870c136170 0x7f870c134980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.316+0000 7f8711497700 1 -- 172.21.15.40:0/3812369563 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8704009a70 con 0x7f870c12e590 2023-09-30T22:28:14.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.316+0000 7f8710c96700 1 --2- 172.21.15.40:0/3812369563 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f870c12f070 0x7f870c134440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:14.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.316+0000 7f8711497700 1 --2- 172.21.15.40:0/3812369563 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f870c12e590 0x7f870c133f00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f870800c700 tx=0x7f870800ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:14.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.317+0000 7f8701ffb700 1 -- 172.21.15.40:0/3812369563 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8708005d70 con 0x7f870c12e590 2023-09-30T22:28:14.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.317+0000 7f8701ffb700 1 -- 172.21.15.40:0/3812369563 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87080070d0 con 0x7f870c12e590 2023-09-30T22:28:14.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.317+0000 7f87136fb700 1 -- 172.21.15.40:0/3812369563 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86fc0094a0 con 0x7f870c12e590 2023-09-30T22:28:14.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.317+0000 7f8701ffb700 1 -- 172.21.15.40:0/3812369563 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8708007460 con 0x7f870c12e590 2023-09-30T22:28:14.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.317+0000 7f87136fb700 1 -- 172.21.15.40:0/3812369563 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f870c13a8c0 con 0x7f870c12e590 2023-09-30T22:28:14.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.317+0000 7f8701ffb700 1 -- 172.21.15.40:0/3812369563 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f87080075c0 con 0x7f870c12e590 2023-09-30T22:28:14.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.317+0000 7f8701ffb700 1 -- 172.21.15.40:0/3812369563 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f870803eb80 con 0x7f870c12e590 2023-09-30T22:28:14.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.318+0000 7f87136fb700 1 -- 172.21.15.40:0/3812369563 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f870c09b4b0 con 0x7f870c12e590 2023-09-30T22:28:14.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.323+0000 7f8701ffb700 1 -- 172.21.15.40:0/3812369563 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f870803ee60 con 0x7f870c12e590 2023-09-30T22:28:14.476 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:14.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.516+0000 7f87136fb700 1 -- 172.21.15.40:0/3812369563 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f870c06d840 con 0x7f870c12e590 2023-09-30T22:28:14.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.516+0000 7f8701ffb700 1 -- 172.21.15.40:0/3812369563 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8708017020 con 0x7f870c12e590 2023-09-30T22:28:14.517 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:14.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.518+0000 7f87136fb700 1 -- 172.21.15.40:0/3812369563 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f870c12e590 msgr2=0x7f870c133f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.518+0000 7f87136fb700 1 --2- 172.21.15.40:0/3812369563 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f870c12e590 0x7f870c133f00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f870800c700 tx=0x7f870800ca10 comp rx=0 tx=0).stop 2023-09-30T22:28:14.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.518+0000 7f87136fb700 1 -- 172.21.15.40:0/3812369563 shutdown_connections 2023-09-30T22:28:14.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.518+0000 7f87136fb700 1 --2- 172.21.15.40:0/3812369563 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f870c136170 0x7f870c134980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.518+0000 7f87136fb700 1 --2- 172.21.15.40:0/3812369563 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f870c12e590 0x7f870c133f00 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.518+0000 7f87136fb700 1 --2- 172.21.15.40:0/3812369563 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f870c12f070 0x7f870c134440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.518+0000 7f87136fb700 1 -- 172.21.15.40:0/3812369563 >> 172.21.15.40:0/3812369563 conn(0x7f870c0a2a00 msgr2=0x7f870c1358d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:14.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.518+0000 7f87136fb700 1 -- 172.21.15.40:0/3812369563 shutdown_connections 2023-09-30T22:28:14.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.518+0000 7f87136fb700 1 -- 172.21.15.40:0/3812369563 wait complete. 2023-09-30T22:28:14.531 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:14.536 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:14.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.606+0000 7fbe04802700 1 Processor -- start 2023-09-30T22:28:14.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.606+0000 7fbe04802700 1 -- start start 2023-09-30T22:28:14.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.606+0000 7fbe04802700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe0009e850 0x7fbe0009ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.607+0000 7fbe04802700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbe0009f160 0x7fbe00131730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.607+0000 7fbe04802700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe0009f550 0x7fbe00131c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.607+0000 7fbe04802700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe000a0180 con 0x7fbe0009f160 2023-09-30T22:28:14.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.607+0000 7fbe04802700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0009ac70 con 0x7fbe0009f550 2023-09-30T22:28:14.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.607+0000 7fbe04802700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0009bc20 con 0x7fbe0009e850 2023-09-30T22:28:14.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.607+0000 7fbdfed9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe0009e850 0x7fbe0009ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.607+0000 7fbdff59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe0009f550 0x7fbe00131c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.607+0000 7fbdfed9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe0009e850 0x7fbe0009ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:40838/0 (socket says 172.21.15.40:40838) 2023-09-30T22:28:14.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.607+0000 7fbdff59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe0009f550 0x7fbe00131c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60138/0 (socket says 172.21.15.40:60138) 2023-09-30T22:28:14.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.607+0000 7fbdfed9d700 1 -- 172.21.15.40:0/790255630 learned_addr learned my addr 172.21.15.40:0/790255630 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:14.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.607+0000 7fbdfe59c700 1 --2- 172.21.15.40:0/790255630 >> v2:172.21.15.40:3300/0 conn(0x7fbe0009f160 0x7fbe00131730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.607+0000 7fbdfed9d700 1 -- 172.21.15.40:0/790255630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe0009f550 msgr2=0x7fbe00131c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:14.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.607+0000 7fbdfed9d700 1 --2- 172.21.15.40:0/790255630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe0009f550 0x7fbe00131c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.607+0000 7fbdfed9d700 1 -- 172.21.15.40:0/790255630 >> v2:172.21.15.40:3300/0 conn(0x7fbe0009f160 msgr2=0x7fbe00131730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:14.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.607+0000 7fbdfed9d700 1 --2- 172.21.15.40:0/790255630 >> v2:172.21.15.40:3300/0 conn(0x7fbe0009f160 0x7fbe00131730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.607+0000 7fbdfed9d700 1 -- 172.21.15.40:0/790255630 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0009b680 con 0x7fbe0009e850 2023-09-30T22:28:14.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.607+0000 7fbdff59e700 1 --2- 172.21.15.40:0/790255630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe0009f550 0x7fbe00131c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:14.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.607+0000 7fbdfe59c700 1 --2- 172.21.15.40:0/790255630 >> v2:172.21.15.40:3300/0 conn(0x7fbe0009f160 0x7fbe00131730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:14.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.607+0000 7fbdfed9d700 1 --2- 172.21.15.40:0/790255630 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe0009e850 0x7fbe0009ec20 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0009920 tx=0x7fbdf0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bab6316733fe882 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:14.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.607+0000 7fbdfdd9b700 1 -- 172.21.15.40:0/790255630 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0011830 con 0x7fbe0009e850 2023-09-30T22:28:14.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.607+0000 7fbdfdd9b700 1 -- 172.21.15.40:0/790255630 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf0011990 con 0x7fbe0009e850 2023-09-30T22:28:14.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.607+0000 7fbdfdd9b700 1 -- 172.21.15.40:0/790255630 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0011d20 con 0x7fbe0009e850 2023-09-30T22:28:14.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.608+0000 7fbe04802700 1 -- 172.21.15.40:0/790255630 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe0009e850 msgr2=0x7fbe0009ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.608+0000 7fbe04802700 1 --2- 172.21.15.40:0/790255630 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe0009e850 0x7fbe0009ec20 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0009920 tx=0x7fbdf0009c30 comp rx=0 tx=0).stop 2023-09-30T22:28:14.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.608+0000 7fbe04802700 1 -- 172.21.15.40:0/790255630 shutdown_connections 2023-09-30T22:28:14.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.608+0000 7fbe04802700 1 --2- 172.21.15.40:0/790255630 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe0009e850 0x7fbe0009ec20 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.608+0000 7fbe04802700 1 --2- 172.21.15.40:0/790255630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe0009f550 0x7fbe00131c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.608+0000 7fbe04802700 1 --2- 172.21.15.40:0/790255630 >> v2:172.21.15.40:3300/0 conn(0x7fbe0009f160 0x7fbe00131730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.608+0000 7fbe04802700 1 -- 172.21.15.40:0/790255630 >> 172.21.15.40:0/790255630 conn(0x7fbe000a4130 msgr2=0x7fbe000a4500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:14.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.608+0000 7fbe04802700 1 -- 172.21.15.40:0/790255630 shutdown_connections 2023-09-30T22:28:14.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.608+0000 7fbe04802700 1 -- 172.21.15.40:0/790255630 wait complete. 2023-09-30T22:28:14.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.610+0000 7fbe04802700 1 Processor -- start 2023-09-30T22:28:14.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.610+0000 7fbe04802700 1 -- start start 2023-09-30T22:28:14.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.611+0000 7fbe04802700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe0009e850 0x7fbe001210b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.611+0000 7fbe04802700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe0009f160 0x7fbe001215f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.611+0000 7fbe04802700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe0009f550 0x7fbe00121b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.611+0000 7fbe04802700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe00122580 con 0x7fbe0009e850 2023-09-30T22:28:14.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.611+0000 7fbe04802700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe00123b00 con 0x7fbe0009f160 2023-09-30T22:28:14.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.611+0000 7fbe04802700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe00124b40 con 0x7fbe0009f550 2023-09-30T22:28:14.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.611+0000 7fbdfed9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe0009e850 0x7fbe001210b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.611+0000 7fbdff59e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe0009f550 0x7fbe00121b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.611+0000 7fbdfed9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe0009e850 0x7fbe001210b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41158/0 (socket says 172.21.15.40:41158) 2023-09-30T22:28:14.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.611+0000 7fbdff59e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe0009f550 0x7fbe00121b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:40844/0 (socket says 172.21.15.40:40844) 2023-09-30T22:28:14.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.611+0000 7fbdfed9d700 1 -- 172.21.15.40:0/262295952 learned_addr learned my addr 172.21.15.40:0/262295952 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:14.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.611+0000 7fbdfe59c700 1 --2- 172.21.15.40:0/262295952 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe0009f160 0x7fbe001215f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.611+0000 7fbdff59e700 1 -- 172.21.15.40:0/262295952 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe0009f160 msgr2=0x7fbe001215f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.611+0000 7fbdff59e700 1 --2- 172.21.15.40:0/262295952 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe0009f160 0x7fbe001215f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.611+0000 7fbdff59e700 1 -- 172.21.15.40:0/262295952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe0009e850 msgr2=0x7fbe001210b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.611+0000 7fbdff59e700 1 --2- 172.21.15.40:0/262295952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe0009e850 0x7fbe001210b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.611+0000 7fbdff59e700 1 -- 172.21.15.40:0/262295952 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf40094a0 con 0x7fbe0009f550 2023-09-30T22:28:14.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.611+0000 7fbdfed9d700 1 --2- 172.21.15.40:0/262295952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe0009e850 0x7fbe001210b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:14.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.611+0000 7fbdfe59c700 1 --2- 172.21.15.40:0/262295952 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe0009f160 0x7fbe001215f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:14.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.612+0000 7fbdff59e700 1 --2- 172.21.15.40:0/262295952 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe0009f550 0x7fbe00121b30 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fbdf800efc0 tx=0x7fbdf800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:14.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.612+0000 7fbde77fe700 1 -- 172.21.15.40:0/262295952 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf800ca90 con 0x7fbe0009f550 2023-09-30T22:28:14.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.612+0000 7fbde77fe700 1 -- 172.21.15.40:0/262295952 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf800f040 con 0x7fbe0009f550 2023-09-30T22:28:14.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.612+0000 7fbe04802700 1 -- 172.21.15.40:0/262295952 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf8009a70 con 0x7fbe0009f550 2023-09-30T22:28:14.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.612+0000 7fbde77fe700 1 -- 172.21.15.40:0/262295952 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf800ce30 con 0x7fbe0009f550 2023-09-30T22:28:14.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.612+0000 7fbe04802700 1 -- 172.21.15.40:0/262295952 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf0009550 con 0x7fbe0009f550 2023-09-30T22:28:14.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.612+0000 7fbde77fe700 1 -- 172.21.15.40:0/262295952 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbdf8014480 con 0x7fbe0009f550 2023-09-30T22:28:14.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.613+0000 7fbde77fe700 1 -- 172.21.15.40:0/262295952 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fbdf803fc70 con 0x7fbe0009f550 2023-09-30T22:28:14.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.613+0000 7fbe04802700 1 -- 172.21.15.40:0/262295952 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe0011dd70 con 0x7fbe0009f550 2023-09-30T22:28:14.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.618+0000 7fbde77fe700 1 -- 172.21.15.40:0/262295952 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbdf8012930 con 0x7fbe0009f550 2023-09-30T22:28:14.623 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:14.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.711+0000 7f7eadfe0700 1 Processor -- start 2023-09-30T22:28:14.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.711+0000 7f7eadfe0700 1 -- start start 2023-09-30T22:28:14.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.712+0000 7f7eadfe0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ea809d450 0x7f7ea809d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.712+0000 7f7eadfe0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7ea809dd60 0x7f7ea81301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.712+0000 7f7eadfe0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ea809c3b0 con 0x7f7ea8130700 2023-09-30T22:28:14.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.712+0000 7f7eadfe0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ea809a6b0 con 0x7f7ea809dd60 2023-09-30T22:28:14.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.712+0000 7f7eadfe0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea809b4f0 con 0x7f7ea809d450 2023-09-30T22:28:14.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.712+0000 7f7ea6ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7ea809dd60 0x7f7ea81301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.712+0000 7f7ea77fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ea809d450 0x7f7ea809d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.712+0000 7f7ea7fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7ea8130700 0x7f7ea8137410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39468/0 (socket says 172.21.15.40:39468) 2023-09-30T22:28:14.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.712+0000 7f7ea7fff700 1 -- 172.21.15.40:0/1084112494 learned_addr learned my addr 172.21.15.40:0/1084112494 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:14.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.713+0000 7f7ea6ffd700 1 -- 172.21.15.40:0/1084112494 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ea809d450 msgr2=0x7f7ea809d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:14.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.713+0000 7f7ea6ffd700 1 --2- 172.21.15.40:0/1084112494 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ea809d450 0x7f7ea809d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.713+0000 7f7ea6ffd700 1 -- 172.21.15.40:0/1084112494 >> v1:172.21.15.40:6789/0 conn(0x7f7ea8130700 legacy=0x7f7ea8137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.713+0000 7f7ea6ffd700 1 -- 172.21.15.40:0/1084112494 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea809af90 con 0x7f7ea809dd60 2023-09-30T22:28:14.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.713+0000 7f7ea6ffd700 1 --2- 172.21.15.40:0/1084112494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ea809dd60 0x7f7ea81301c0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c009840 tx=0x7f7e9c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27eb1b4158e8d008 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:14.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.713+0000 7f7ea67fc700 1 -- 172.21.15.40:0/1084112494 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c011830 con 0x7f7ea809dd60 2023-09-30T22:28:14.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.713+0000 7f7ea67fc700 1 -- 172.21.15.40:0/1084112494 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9c011990 con 0x7f7ea809dd60 2023-09-30T22:28:14.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.713+0000 7f7ea67fc700 1 -- 172.21.15.40:0/1084112494 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c011d20 con 0x7f7ea809dd60 2023-09-30T22:28:14.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.714+0000 7f7eadfe0700 1 -- 172.21.15.40:0/1084112494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ea809dd60 msgr2=0x7f7ea81301c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.714+0000 7f7eadfe0700 1 --2- 172.21.15.40:0/1084112494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ea809dd60 0x7f7ea81301c0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c009840 tx=0x7f7e9c009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:14.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.714+0000 7f7eadfe0700 1 -- 172.21.15.40:0/1084112494 shutdown_connections 2023-09-30T22:28:14.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.714+0000 7f7eadfe0700 1 --2- 172.21.15.40:0/1084112494 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ea809d450 0x7f7ea809d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.714+0000 7f7eadfe0700 1 --2- 172.21.15.40:0/1084112494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ea809dd60 0x7f7ea81301c0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.714+0000 7f7eadfe0700 1 -- 172.21.15.40:0/1084112494 >> 172.21.15.40:0/1084112494 conn(0x7f7ea80a2a00 msgr2=0x7f7ea80a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:14.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.714+0000 7f7eadfe0700 1 -- 172.21.15.40:0/1084112494 shutdown_connections 2023-09-30T22:28:14.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.714+0000 7f7eadfe0700 1 -- 172.21.15.40:0/1084112494 wait complete. 2023-09-30T22:28:14.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.715+0000 7f7eadfe0700 1 Processor -- start 2023-09-30T22:28:14.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.715+0000 7f7eadfe0700 1 -- start start 2023-09-30T22:28:14.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.716+0000 7f7eadfe0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ea809d450 0x7f7ea812b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.716+0000 7f7eadfe0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ea809dd60 0x7f7ea812b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.716+0000 7f7eadfe0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7ea8130700 0x7f7ea812bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.716+0000 7f7eadfe0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea812d2e0 con 0x7f7ea809dd60 2023-09-30T22:28:14.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.716+0000 7f7eadfe0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea812ec10 con 0x7f7ea809d450 2023-09-30T22:28:14.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.716+0000 7f7eadfe0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea809c5d0 con 0x7f7ea8130700 2023-09-30T22:28:14.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.716+0000 7f7ea6ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ea809dd60 0x7f7ea812b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.716+0000 7f7ea77fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ea809d450 0x7f7ea812b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.716+0000 7f7ea6ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ea809dd60 0x7f7ea812b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41166/0 (socket says 172.21.15.40:41166) 2023-09-30T22:28:14.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.716+0000 7f7ea6ffd700 1 -- 172.21.15.40:0/3369242308 learned_addr learned my addr 172.21.15.40:0/3369242308 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:14.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.716+0000 7f7ea6ffd700 1 -- 172.21.15.40:0/3369242308 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7ea8130700 msgr2=0x7f7ea812bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.716+0000 7f7ea6ffd700 1 --2- 172.21.15.40:0/3369242308 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7ea8130700 0x7f7ea812bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.716+0000 7f7ea6ffd700 1 -- 172.21.15.40:0/3369242308 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ea809d450 msgr2=0x7f7ea812b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.716+0000 7f7ea6ffd700 1 --2- 172.21.15.40:0/3369242308 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ea809d450 0x7f7ea812b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.716+0000 7f7ea6ffd700 1 -- 172.21.15.40:0/3369242308 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9c0094a0 con 0x7f7ea809dd60 2023-09-30T22:28:14.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.716+0000 7f7ea77fe700 1 --2- 172.21.15.40:0/3369242308 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ea809d450 0x7f7ea812b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:14.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.716+0000 7f7ea6ffd700 1 --2- 172.21.15.40:0/3369242308 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ea809dd60 0x7f7ea812b630 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c0090b0 tx=0x7f7e9c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:14.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.717+0000 7f7e8ffff700 1 -- 172.21.15.40:0/3369242308 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c0036a0 con 0x7f7ea809dd60 2023-09-30T22:28:14.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.717+0000 7f7e8ffff700 1 -- 172.21.15.40:0/3369242308 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9c01f070 con 0x7f7ea809dd60 2023-09-30T22:28:14.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.717+0000 7f7eadfe0700 1 -- 172.21.15.40:0/3369242308 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ea80a2510 con 0x7f7ea809dd60 2023-09-30T22:28:14.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.717+0000 7f7e8ffff700 1 -- 172.21.15.40:0/3369242308 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c003a60 con 0x7f7ea809dd60 2023-09-30T22:28:14.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.717+0000 7f7eadfe0700 1 -- 172.21.15.40:0/3369242308 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ea812df50 con 0x7f7ea809dd60 2023-09-30T22:28:14.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.717+0000 7f7e8ffff700 1 -- 172.21.15.40:0/3369242308 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7e9c003bc0 con 0x7f7ea809dd60 2023-09-30T22:28:14.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.718+0000 7f7e8ffff700 1 -- 172.21.15.40:0/3369242308 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f7e9c021070 con 0x7f7ea809dd60 2023-09-30T22:28:14.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.718+0000 7f7eadfe0700 1 -- 172.21.15.40:0/3369242308 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ea8062380 con 0x7f7ea809dd60 2023-09-30T22:28:14.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.723+0000 7f7e8ffff700 1 -- 172.21.15.40:0/3369242308 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e9c015020 con 0x7f7ea809dd60 2023-09-30T22:28:14.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.754+0000 7fb21c211700 1 Processor -- start 2023-09-30T22:28:14.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.754+0000 7fb21c211700 1 -- start start 2023-09-30T22:28:14.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.755+0000 7fb21c211700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb21409c890 0x7fb21409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.755+0000 7fb21c211700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb21409d920 0x7fb21409dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.755+0000 7fb21c211700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2140a2600 con 0x7fb21409e2b0 2023-09-30T22:28:14.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.755+0000 7fb21c211700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2140a29d0 con 0x7fb21409c890 2023-09-30T22:28:14.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.755+0000 7fb21c211700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb21409fb40 con 0x7fb21409d920 2023-09-30T22:28:14.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.755+0000 7fb219fad700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb21409c890 0x7fb21409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.755+0000 7fb2197ac700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb21409d920 0x7fb21409dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.755+0000 7fb219fad700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb21409c890 0x7fb21409cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41168/0 (socket says 172.21.15.40:41168) 2023-09-30T22:28:14.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.755+0000 7fb2197ac700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb21409d920 0x7fb21409dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60184/0 (socket says 172.21.15.40:60184) 2023-09-30T22:28:14.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.755+0000 7fb219fad700 1 -- 172.21.15.40:0/2831100208 learned_addr learned my addr 172.21.15.40:0/2831100208 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:14.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.755+0000 7fb2197ac700 1 -- 172.21.15.40:0/2831100208 >> v2:172.21.15.40:3300/0 conn(0x7fb21409c890 msgr2=0x7fb21409cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:14.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.755+0000 7fb2197ac700 1 --2- 172.21.15.40:0/2831100208 >> v2:172.21.15.40:3300/0 conn(0x7fb21409c890 0x7fb21409cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.755+0000 7fb2197ac700 1 -- 172.21.15.40:0/2831100208 >> v1:172.21.15.40:6789/0 conn(0x7fb21409e2b0 legacy=0x7fb21413ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.755+0000 7fb2197ac700 1 -- 172.21.15.40:0/2831100208 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb21409e730 con 0x7fb21409d920 2023-09-30T22:28:14.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.756+0000 7fb2197ac700 1 --2- 172.21.15.40:0/2831100208 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb21409d920 0x7fb21409dd70 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb204009840 tx=0x7fb204009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48a668aa27ac9d8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:14.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.756+0000 7fb218fab700 1 -- 172.21.15.40:0/2831100208 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb204011830 con 0x7fb21409d920 2023-09-30T22:28:14.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.756+0000 7fb218fab700 1 -- 172.21.15.40:0/2831100208 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb204011990 con 0x7fb21409d920 2023-09-30T22:28:14.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.756+0000 7fb218fab700 1 -- 172.21.15.40:0/2831100208 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb204011d20 con 0x7fb21409d920 2023-09-30T22:28:14.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.756+0000 7fb21c211700 1 -- 172.21.15.40:0/2831100208 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb21409d920 msgr2=0x7fb21409dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.756+0000 7fb21c211700 1 --2- 172.21.15.40:0/2831100208 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb21409d920 0x7fb21409dd70 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb204009840 tx=0x7fb204009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:14.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.756+0000 7fb21c211700 1 -- 172.21.15.40:0/2831100208 shutdown_connections 2023-09-30T22:28:14.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.756+0000 7fb21c211700 1 --2- 172.21.15.40:0/2831100208 >> v2:172.21.15.40:3300/0 conn(0x7fb21409c890 0x7fb21409cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.756+0000 7fb21c211700 1 --2- 172.21.15.40:0/2831100208 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb21409d920 0x7fb21409dd70 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.756+0000 7fb21c211700 1 -- 172.21.15.40:0/2831100208 >> 172.21.15.40:0/2831100208 conn(0x7fb2140a7080 msgr2=0x7fb2140a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:14.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.757+0000 7fb21c211700 1 -- 172.21.15.40:0/2831100208 shutdown_connections 2023-09-30T22:28:14.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.757+0000 7fb21c211700 1 -- 172.21.15.40:0/2831100208 wait complete. 2023-09-30T22:28:14.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.757+0000 7fb21c211700 1 Processor -- start 2023-09-30T22:28:14.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.758+0000 7fb21c211700 1 -- start start 2023-09-30T22:28:14.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.758+0000 7fb21c211700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb21409c890 0x7fb21412d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.758+0000 7fb21c211700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb21409d920 0x7fb21412daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.758+0000 7fb21c211700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb21409e2b0 0x7fb21412e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.758+0000 7fb21c211700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21409bbb0 con 0x7fb21409e2b0 2023-09-30T22:28:14.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.758+0000 7fb21c211700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb21409ecf0 con 0x7fb21409d920 2023-09-30T22:28:14.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.758+0000 7fb21c211700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2141306b0 con 0x7fb21409c890 2023-09-30T22:28:14.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.758+0000 7fb2197ac700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb21409d920 0x7fb21412daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.758+0000 7fb2197ac700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb21409d920 0x7fb21412daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60192/0 (socket says 172.21.15.40:60192) 2023-09-30T22:28:14.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.758+0000 7fb2197ac700 1 -- 172.21.15.40:0/593161541 learned_addr learned my addr 172.21.15.40:0/593161541 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:14.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.758+0000 7fb21a7ae700 1 --2- 172.21.15.40:0/593161541 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb21409e2b0 0x7fb21412e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.758+0000 7fb2197ac700 1 -- 172.21.15.40:0/593161541 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb21409c890 msgr2=0x7fb21412d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.758+0000 7fb2197ac700 1 --2- 172.21.15.40:0/593161541 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb21409c890 0x7fb21412d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.758+0000 7fb2197ac700 1 -- 172.21.15.40:0/593161541 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb21409e2b0 msgr2=0x7fb21412e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.758+0000 7fb2197ac700 1 --2- 172.21.15.40:0/593161541 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb21409e2b0 0x7fb21412e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.758+0000 7fb2197ac700 1 -- 172.21.15.40:0/593161541 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2040094a0 con 0x7fb21409d920 2023-09-30T22:28:14.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.759+0000 7fb2197ac700 1 --2- 172.21.15.40:0/593161541 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb21409d920 0x7fb21412daf0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb2040090b0 tx=0x7fb204004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:14.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.759+0000 7fb20a7fc700 1 -- 172.21.15.40:0/593161541 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb204004480 con 0x7fb21409d920 2023-09-30T22:28:14.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.759+0000 7fb20a7fc700 1 -- 172.21.15.40:0/593161541 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb20401f070 con 0x7fb21409d920 2023-09-30T22:28:14.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.759+0000 7fb21c211700 1 -- 172.21.15.40:0/593161541 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb214130cc0 con 0x7fb21409d920 2023-09-30T22:28:14.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.759+0000 7fb20a7fc700 1 -- 172.21.15.40:0/593161541 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2040038e0 con 0x7fb21409d920 2023-09-30T22:28:14.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.759+0000 7fb21c211700 1 -- 172.21.15.40:0/593161541 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb21412e570 con 0x7fb21409d920 2023-09-30T22:28:14.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.759+0000 7fb20a7fc700 1 -- 172.21.15.40:0/593161541 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb204021030 con 0x7fb21409d920 2023-09-30T22:28:14.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.760+0000 7fb20a7fc700 1 -- 172.21.15.40:0/593161541 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb204040a20 con 0x7fb21409d920 2023-09-30T22:28:14.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.760+0000 7fb21c211700 1 -- 172.21.15.40:0/593161541 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb214062380 con 0x7fb21409d920 2023-09-30T22:28:14.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.764+0000 7fb20a7fc700 1 -- 172.21.15.40:0/593161541 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb20401a7d0 con 0x7fb21409d920 2023-09-30T22:28:14.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.869+0000 7fbe04802700 1 -- 172.21.15.40:0/262295952 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbe000a26e0 con 0x7fbe0009f550 2023-09-30T22:28:14.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.869+0000 7fbde77fe700 1 -- 172.21.15.40:0/262295952 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbdf8012340 con 0x7fbe0009f550 2023-09-30T22:28:14.870 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:14.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.871+0000 7fbe04802700 1 -- 172.21.15.40:0/262295952 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe0009f550 msgr2=0x7fbe00121b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.871+0000 7fbe04802700 1 --2- 172.21.15.40:0/262295952 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe0009f550 0x7fbe00121b30 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fbdf800efc0 tx=0x7fbdf800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.871+0000 7fbe04802700 1 -- 172.21.15.40:0/262295952 shutdown_connections 2023-09-30T22:28:14.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.871+0000 7fbe04802700 1 --2- 172.21.15.40:0/262295952 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe0009f550 0x7fbe00121b30 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.871+0000 7fbe04802700 1 --2- 172.21.15.40:0/262295952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe0009e850 0x7fbe001210b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.871+0000 7fbe04802700 1 --2- 172.21.15.40:0/262295952 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe0009f160 0x7fbe001215f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.871+0000 7fbe04802700 1 -- 172.21.15.40:0/262295952 >> 172.21.15.40:0/262295952 conn(0x7fbe000a4130 msgr2=0x7fbe00071130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:14.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.872+0000 7fbe04802700 1 -- 172.21.15.40:0/262295952 shutdown_connections 2023-09-30T22:28:14.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.872+0000 7fbe04802700 1 -- 172.21.15.40:0/262295952 wait complete. 2023-09-30T22:28:14.885 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:14.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.959+0000 7fb21c211700 1 -- 172.21.15.40:0/593161541 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb214074620 con 0x7fb21409d920 2023-09-30T22:28:14.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.959+0000 7fb20a7fc700 1 -- 172.21.15.40:0/593161541 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb204015020 con 0x7fb21409d920 2023-09-30T22:28:14.960 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:14.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.960+0000 7f7eadfe0700 1 -- 172.21.15.40:0/3369242308 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7ea8072430 con 0x7f7ea809dd60 2023-09-30T22:28:14.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.960+0000 7f7e8ffff700 1 -- 172.21.15.40:0/3369242308 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7e9c0257f0 con 0x7f7ea809dd60 2023-09-30T22:28:14.961 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:14.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.961+0000 7fb21c211700 1 -- 172.21.15.40:0/593161541 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb21409d920 msgr2=0x7fb21412daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.961+0000 7fb21c211700 1 --2- 172.21.15.40:0/593161541 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb21409d920 0x7fb21412daf0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb2040090b0 tx=0x7fb204004750 comp rx=0 tx=0).stop 2023-09-30T22:28:14.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.961+0000 7fb21c211700 1 -- 172.21.15.40:0/593161541 shutdown_connections 2023-09-30T22:28:14.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.961+0000 7fb21c211700 1 --2- 172.21.15.40:0/593161541 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb21409c890 0x7fb21412d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.961+0000 7fb21c211700 1 --2- 172.21.15.40:0/593161541 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb21409e2b0 0x7fb21412e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.961+0000 7fb21c211700 1 --2- 172.21.15.40:0/593161541 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb21409d920 0x7fb21412daf0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.961+0000 7fb21c211700 1 -- 172.21.15.40:0/593161541 >> 172.21.15.40:0/593161541 conn(0x7fb2140a7080 msgr2=0x7fb2140a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:14.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.962+0000 7fb21c211700 1 -- 172.21.15.40:0/593161541 shutdown_connections 2023-09-30T22:28:14.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.962+0000 7fb21c211700 1 -- 172.21.15.40:0/593161541 wait complete. 2023-09-30T22:28:14.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.962+0000 7f7eadfe0700 1 -- 172.21.15.40:0/3369242308 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ea809dd60 msgr2=0x7f7ea812b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.962+0000 7f7eadfe0700 1 --2- 172.21.15.40:0/3369242308 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ea809dd60 0x7f7ea812b630 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c0090b0 tx=0x7f7e9c004750 comp rx=0 tx=0).stop 2023-09-30T22:28:14.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.962+0000 7f7eadfe0700 1 -- 172.21.15.40:0/3369242308 shutdown_connections 2023-09-30T22:28:14.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.962+0000 7f7eadfe0700 1 --2- 172.21.15.40:0/3369242308 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7ea8130700 0x7f7ea812bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.962+0000 7f7eadfe0700 1 --2- 172.21.15.40:0/3369242308 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7ea809d450 0x7f7ea812b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.962+0000 7f7eadfe0700 1 --2- 172.21.15.40:0/3369242308 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ea809dd60 0x7f7ea812b630 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.962+0000 7f7eadfe0700 1 -- 172.21.15.40:0/3369242308 >> 172.21.15.40:0/3369242308 conn(0x7f7ea80a2a00 msgr2=0x7f7ea81267c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:14.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.963+0000 7f7eadfe0700 1 -- 172.21.15.40:0/3369242308 shutdown_connections 2023-09-30T22:28:14.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:14.963+0000 7f7eadfe0700 1 -- 172.21.15.40:0/3369242308 wait complete. 2023-09-30T22:28:14.976 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:14.976 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:15.533 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:15.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.673+0000 7fb9529cf700 1 Processor -- start 2023-09-30T22:28:15.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.673+0000 7fb9529cf700 1 -- start start 2023-09-30T22:28:15.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.673+0000 7fb9529cf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb94c131d50 0x7fb94c132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:15.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.673+0000 7fb9529cf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb94c09bc50 0x7fb94c09c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:15.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.673+0000 7fb9529cf700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb94c071920 con 0x7fb94c09c600 2023-09-30T22:28:15.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.673+0000 7fb9529cf700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb94c132660 con 0x7fb94c09bc50 2023-09-30T22:28:15.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.673+0000 7fb9529cf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c131900 con 0x7fb94c131d50 2023-09-30T22:28:15.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.673+0000 7fb94b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb94c09bc50 0x7fb94c09c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:15.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.673+0000 7fb94bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb94c131d50 0x7fb94c132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:15.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.673+0000 7fb94b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb94c09bc50 0x7fb94c09c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41182/0 (socket says 172.21.15.40:41182) 2023-09-30T22:28:15.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.673+0000 7fb94b7fe700 1 -- 172.21.15.40:0/2408225581 learned_addr learned my addr 172.21.15.40:0/2408225581 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:15.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.674+0000 7fb94bfff700 1 -- 172.21.15.40:0/2408225581 >> v2:172.21.15.40:3300/0 conn(0x7fb94c09bc50 msgr2=0x7fb94c09c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:15.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.674+0000 7fb94bfff700 1 --2- 172.21.15.40:0/2408225581 >> v2:172.21.15.40:3300/0 conn(0x7fb94c09bc50 0x7fb94c09c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.674+0000 7fb94bfff700 1 -- 172.21.15.40:0/2408225581 >> v1:172.21.15.40:6789/0 conn(0x7fb94c09c600 legacy=0x7fb94c138ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:15.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.674+0000 7fb94bfff700 1 -- 172.21.15.40:0/2408225581 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb94c09e820 con 0x7fb94c131d50 2023-09-30T22:28:15.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.674+0000 7fb94b7fe700 1 --2- 172.21.15.40:0/2408225581 >> v2:172.21.15.40:3300/0 conn(0x7fb94c09bc50 0x7fb94c09c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:15.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.674+0000 7fb94bfff700 1 --2- 172.21.15.40:0/2408225581 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb94c131d50 0x7fb94c132120 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb93c009840 tx=0x7fb93c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f81bc90feff16e2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:15.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.674+0000 7fb94affd700 1 -- 172.21.15.40:0/2408225581 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93c011830 con 0x7fb94c131d50 2023-09-30T22:28:15.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.674+0000 7fb94affd700 1 -- 172.21.15.40:0/2408225581 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb93c011990 con 0x7fb94c131d50 2023-09-30T22:28:15.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.674+0000 7fb94affd700 1 -- 172.21.15.40:0/2408225581 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93c011d20 con 0x7fb94c131d50 2023-09-30T22:28:15.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.675+0000 7fb9529cf700 1 -- 172.21.15.40:0/2408225581 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb94c131d50 msgr2=0x7fb94c132120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:15.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.675+0000 7fb9529cf700 1 --2- 172.21.15.40:0/2408225581 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb94c131d50 0x7fb94c132120 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb93c009840 tx=0x7fb93c009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:15.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.675+0000 7fb9529cf700 1 -- 172.21.15.40:0/2408225581 shutdown_connections 2023-09-30T22:28:15.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.675+0000 7fb9529cf700 1 --2- 172.21.15.40:0/2408225581 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb94c131d50 0x7fb94c132120 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.675+0000 7fb9529cf700 1 --2- 172.21.15.40:0/2408225581 >> v2:172.21.15.40:3300/0 conn(0x7fb94c09bc50 0x7fb94c09c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.675+0000 7fb9529cf700 1 -- 172.21.15.40:0/2408225581 >> 172.21.15.40:0/2408225581 conn(0x7fb94c0a2a00 msgr2=0x7fb94c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:15.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.675+0000 7fb9529cf700 1 -- 172.21.15.40:0/2408225581 shutdown_connections 2023-09-30T22:28:15.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.675+0000 7fb9529cf700 1 -- 172.21.15.40:0/2408225581 wait complete. 2023-09-30T22:28:15.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.676+0000 7fb9529cf700 1 Processor -- start 2023-09-30T22:28:15.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.676+0000 7fb9529cf700 1 -- start start 2023-09-30T22:28:15.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.676+0000 7fb9529cf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb94c09bc50 0x7fb94c099a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:15.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.676+0000 7fb9529cf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb94c09c600 0x7fb94c099fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:15.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.676+0000 7fb9529cf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb94c131d50 0x7fb94c09a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:15.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.676+0000 7fb9529cf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c120740 con 0x7fb94c09bc50 2023-09-30T22:28:15.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.676+0000 7fb9529cf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c12dff0 con 0x7fb94c131d50 2023-09-30T22:28:15.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.676+0000 7fb9529cf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c11f6c0 con 0x7fb94c09c600 2023-09-30T22:28:15.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.676+0000 7fb94bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb94c09bc50 0x7fb94c099a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:15.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.676+0000 7fb94bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb94c09bc50 0x7fb94c099a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41192/0 (socket says 172.21.15.40:41192) 2023-09-30T22:28:15.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.676+0000 7fb950f6c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb94c131d50 0x7fb94c09a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:15.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.676+0000 7fb94bfff700 1 -- 172.21.15.40:0/1537053382 learned_addr learned my addr 172.21.15.40:0/1537053382 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:15.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.676+0000 7fb94b7fe700 1 --2- 172.21.15.40:0/1537053382 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb94c09c600 0x7fb94c099fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:15.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.677+0000 7fb94bfff700 1 -- 172.21.15.40:0/1537053382 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb94c09c600 msgr2=0x7fb94c099fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:15.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.677+0000 7fb94bfff700 1 --2- 172.21.15.40:0/1537053382 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb94c09c600 0x7fb94c099fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.677+0000 7fb94bfff700 1 -- 172.21.15.40:0/1537053382 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb94c131d50 msgr2=0x7fb94c09a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:15.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.677+0000 7fb94bfff700 1 --2- 172.21.15.40:0/1537053382 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb94c131d50 0x7fb94c09a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.677+0000 7fb94bfff700 1 -- 172.21.15.40:0/1537053382 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb940009550 con 0x7fb94c09bc50 2023-09-30T22:28:15.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.677+0000 7fb950f6c700 1 --2- 172.21.15.40:0/1537053382 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb94c131d50 0x7fb94c09a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:15.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.677+0000 7fb94bfff700 1 --2- 172.21.15.40:0/1537053382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb94c09bc50 0x7fb94c099a70 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fb93c009fd0 tx=0x7fb93c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:15.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.677+0000 7fb948ff9700 1 -- 172.21.15.40:0/1537053382 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93c0036a0 con 0x7fb94c09bc50 2023-09-30T22:28:15.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.677+0000 7fb948ff9700 1 -- 172.21.15.40:0/1537053382 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb93c01e070 con 0x7fb94c09bc50 2023-09-30T22:28:15.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.677+0000 7fb9529cf700 1 -- 172.21.15.40:0/1537053382 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb93c0094a0 con 0x7fb94c09bc50 2023-09-30T22:28:15.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.677+0000 7fb948ff9700 1 -- 172.21.15.40:0/1537053382 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93c003a40 con 0x7fb94c09bc50 2023-09-30T22:28:15.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.677+0000 7fb9529cf700 1 -- 172.21.15.40:0/1537053382 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb94c09ea60 con 0x7fb94c09bc50 2023-09-30T22:28:15.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.678+0000 7fb948ff9700 1 -- 172.21.15.40:0/1537053382 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb93c003ba0 con 0x7fb94c09bc50 2023-09-30T22:28:15.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.678+0000 7fb948ff9700 1 -- 172.21.15.40:0/1537053382 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb93c0405d0 con 0x7fb94c09bc50 2023-09-30T22:28:15.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.678+0000 7fb9529cf700 1 -- 172.21.15.40:0/1537053382 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb94c06fa30 con 0x7fb94c09bc50 2023-09-30T22:28:15.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.683+0000 7fb948ff9700 1 -- 172.21.15.40:0/1537053382 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb93c015020 con 0x7fb94c09bc50 2023-09-30T22:28:15.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.880+0000 7fb9529cf700 1 -- 172.21.15.40:0/1537053382 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb94c062380 con 0x7fb94c09bc50 2023-09-30T22:28:15.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.880+0000 7fb948ff9700 1 -- 172.21.15.40:0/1537053382 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb93c02d7d0 con 0x7fb94c09bc50 2023-09-30T22:28:15.881 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:15.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.882+0000 7fb9529cf700 1 -- 172.21.15.40:0/1537053382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb94c09bc50 msgr2=0x7fb94c099a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:15.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.882+0000 7fb9529cf700 1 --2- 172.21.15.40:0/1537053382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb94c09bc50 0x7fb94c099a70 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fb93c009fd0 tx=0x7fb93c004750 comp rx=0 tx=0).stop 2023-09-30T22:28:15.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.882+0000 7fb9529cf700 1 -- 172.21.15.40:0/1537053382 shutdown_connections 2023-09-30T22:28:15.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.882+0000 7fb9529cf700 1 --2- 172.21.15.40:0/1537053382 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb94c131d50 0x7fb94c09a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.882+0000 7fb9529cf700 1 --2- 172.21.15.40:0/1537053382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb94c09bc50 0x7fb94c099a70 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.882+0000 7fb9529cf700 1 --2- 172.21.15.40:0/1537053382 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb94c09c600 0x7fb94c099fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.882+0000 7fb9529cf700 1 -- 172.21.15.40:0/1537053382 >> 172.21.15.40:0/1537053382 conn(0x7fb94c0a2a00 msgr2=0x7fb94c1305b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:15.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.882+0000 7fb9529cf700 1 -- 172.21.15.40:0/1537053382 shutdown_connections 2023-09-30T22:28:15.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:15.882+0000 7fb9529cf700 1 -- 172.21.15.40:0/1537053382 wait complete. 2023-09-30T22:28:15.886 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:15.896 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:15.977 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:15.977 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:16.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.018+0000 7fa5344be700 1 Processor -- start 2023-09-30T22:28:16.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.018+0000 7fa5344be700 1 -- start start 2023-09-30T22:28:16.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.019+0000 7fa5344be700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa52c09d920 0x7fa52c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:16.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.019+0000 7fa5344be700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa52c130fb0 0x7fa52c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:16.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.019+0000 7fa5344be700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa52c09adf0 con 0x7fa52c09e230 2023-09-30T22:28:16.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.019+0000 7fa5344be700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa52c09edf0 con 0x7fa52c09d920 2023-09-30T22:28:16.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.019+0000 7fa5344be700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa52c09b660 con 0x7fa52c130fb0 2023-09-30T22:28:16.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.019+0000 7fa53225a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa52c09d920 0x7fa52c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:16.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.019+0000 7fa53225a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa52c09d920 0x7fa52c09dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60216/0 (socket says 172.21.15.40:60216) 2023-09-30T22:28:16.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.019+0000 7fa53225a700 1 -- 172.21.15.40:0/2451374837 learned_addr learned my addr 172.21.15.40:0/2451374837 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:16.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.019+0000 7fa532a5b700 1 --2- 172.21.15.40:0/2451374837 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa52c130fb0 0x7fa52c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:16.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.020+0000 7fa53225a700 1 -- 172.21.15.40:0/2451374837 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa52c130fb0 msgr2=0x7fa52c138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:16.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.020+0000 7fa53225a700 1 --2- 172.21.15.40:0/2451374837 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa52c130fb0 0x7fa52c138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:16.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.020+0000 7fa53225a700 1 -- 172.21.15.40:0/2451374837 >> v1:172.21.15.40:6789/0 conn(0x7fa52c09e230 legacy=0x7fa52c1308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:16.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.020+0000 7fa53225a700 1 -- 172.21.15.40:0/2451374837 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa52c09a6e0 con 0x7fa52c09d920 2023-09-30T22:28:16.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.020+0000 7fa532a5b700 1 --2- 172.21.15.40:0/2451374837 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa52c130fb0 0x7fa52c138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:16.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.020+0000 7fa53225a700 1 --2- 172.21.15.40:0/2451374837 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa52c09d920 0x7fa52c09dcf0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fa5280098f0 tx=0x7fa528009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff77be619f0d0683 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:16.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.020+0000 7fa531258700 1 -- 172.21.15.40:0/2451374837 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa528005e30 con 0x7fa52c09d920 2023-09-30T22:28:16.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.020+0000 7fa531258700 1 -- 172.21.15.40:0/2451374837 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa528004030 con 0x7fa52c09d920 2023-09-30T22:28:16.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.020+0000 7fa531258700 1 -- 172.21.15.40:0/2451374837 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5280043e0 con 0x7fa52c09d920 2023-09-30T22:28:16.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.021+0000 7fa5344be700 1 -- 172.21.15.40:0/2451374837 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa52c09d920 msgr2=0x7fa52c09dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:16.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.021+0000 7fa5344be700 1 --2- 172.21.15.40:0/2451374837 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa52c09d920 0x7fa52c09dcf0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fa5280098f0 tx=0x7fa528009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:16.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.021+0000 7fa5344be700 1 -- 172.21.15.40:0/2451374837 shutdown_connections 2023-09-30T22:28:16.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.021+0000 7fa5344be700 1 --2- 172.21.15.40:0/2451374837 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa52c130fb0 0x7fa52c138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:16.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.021+0000 7fa5344be700 1 --2- 172.21.15.40:0/2451374837 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa52c09d920 0x7fa52c09dcf0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:16.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.021+0000 7fa5344be700 1 -- 172.21.15.40:0/2451374837 >> 172.21.15.40:0/2451374837 conn(0x7fa52c09fb20 msgr2=0x7fa52c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:16.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.021+0000 7fa5344be700 1 -- 172.21.15.40:0/2451374837 shutdown_connections 2023-09-30T22:28:16.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.021+0000 7fa5344be700 1 -- 172.21.15.40:0/2451374837 wait complete. 2023-09-30T22:28:16.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.022+0000 7fa5344be700 1 Processor -- start 2023-09-30T22:28:16.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.022+0000 7fa5344be700 1 -- start start 2023-09-30T22:28:16.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.023+0000 7fa5344be700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa52c09d920 0x7fa52c11f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:16.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.023+0000 7fa5344be700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa52c09e230 0x7fa52c11f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:16.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.023+0000 7fa5344be700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa52c130fb0 0x7fa52c11fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:16.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.023+0000 7fa5344be700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52c126020 con 0x7fa52c130fb0 2023-09-30T22:28:16.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.023+0000 7fa5344be700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa52c09cb00 con 0x7fa52c09d920 2023-09-30T22:28:16.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.023+0000 7fa5344be700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa52c06b230 con 0x7fa52c09e230 2023-09-30T22:28:16.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.023+0000 7fa531a59700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa52c09e230 0x7fa52c11f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:16.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.023+0000 7fa53225a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa52c09d920 0x7fa52c11f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:16.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.023+0000 7fa53225a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa52c09d920 0x7fa52c11f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60228/0 (socket says 172.21.15.40:60228) 2023-09-30T22:28:16.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.023+0000 7fa531a59700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa52c09e230 0x7fa52c11f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:40904/0 (socket says 172.21.15.40:40904) 2023-09-30T22:28:16.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.023+0000 7fa53225a700 1 -- 172.21.15.40:0/2192519432 learned_addr learned my addr 172.21.15.40:0/2192519432 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:16.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.023+0000 7fa531a59700 1 -- 172.21.15.40:0/2192519432 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa52c09d920 msgr2=0x7fa52c11f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:16.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.023+0000 7fa531a59700 1 --2- 172.21.15.40:0/2192519432 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa52c09d920 0x7fa52c11f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:16.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.023+0000 7fa531a59700 1 -- 172.21.15.40:0/2192519432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa52c130fb0 msgr2=0x7fa52c11fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:16.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.023+0000 7fa531a59700 1 --2- 172.21.15.40:0/2192519432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa52c130fb0 0x7fa52c11fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:16.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.023+0000 7fa531a59700 1 -- 172.21.15.40:0/2192519432 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa524009a70 con 0x7fa52c09e230 2023-09-30T22:28:16.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.023+0000 7fa53225a700 1 --2- 172.21.15.40:0/2192519432 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa52c09d920 0x7fa52c11f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:16.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.024+0000 7fa531a59700 1 --2- 172.21.15.40:0/2192519432 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa52c09e230 0x7fa52c11f730 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa51c000f60 tx=0x7fa51c00c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:16.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.024+0000 7fa522ffd700 1 -- 172.21.15.40:0/2192519432 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c0052d0 con 0x7fa52c09e230 2023-09-30T22:28:16.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.024+0000 7fa522ffd700 1 -- 172.21.15.40:0/2192519432 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51c005430 con 0x7fa52c09e230 2023-09-30T22:28:16.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.024+0000 7fa5344be700 1 -- 172.21.15.40:0/2192519432 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa528009500 con 0x7fa52c09e230 2023-09-30T22:28:16.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.024+0000 7fa522ffd700 1 -- 172.21.15.40:0/2192519432 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c0038c0 con 0x7fa52c09e230 2023-09-30T22:28:16.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.024+0000 7fa5344be700 1 -- 172.21.15.40:0/2192519432 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa52c1307c0 con 0x7fa52c09e230 2023-09-30T22:28:16.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.025+0000 7fa522ffd700 1 -- 172.21.15.40:0/2192519432 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa51c003a20 con 0x7fa52c09e230 2023-09-30T22:28:16.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.025+0000 7fa522ffd700 1 -- 172.21.15.40:0/2192519432 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa51c03e9e0 con 0x7fa52c09e230 2023-09-30T22:28:16.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.025+0000 7fa5344be700 1 -- 172.21.15.40:0/2192519432 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa52c11c5f0 con 0x7fa52c09e230 2023-09-30T22:28:16.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.030+0000 7fa522ffd700 1 -- 172.21.15.40:0/2192519432 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa51c017080 con 0x7fa52c09e230 2023-09-30T22:28:16.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.109+0000 7f56b627b700 1 Processor -- start 2023-09-30T22:28:16.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.109+0000 7f56b627b700 1 -- start start 2023-09-30T22:28:16.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.110+0000 7f56b627b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f56b009d920 0x7f56b009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:16.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.110+0000 7f56b627b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56b0130fb0 0x7f56b0138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:16.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.110+0000 7f56b627b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b009adf0 con 0x7f56b009e230 2023-09-30T22:28:16.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.110+0000 7f56b627b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56b009edf0 con 0x7f56b009d920 2023-09-30T22:28:16.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.110+0000 7f56b627b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b009b660 con 0x7f56b0130fb0 2023-09-30T22:28:16.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.110+0000 7f56affff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f56b009d920 0x7f56b009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:16.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.110+0000 7f56affff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f56b009d920 0x7f56b009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41214/0 (socket says 172.21.15.40:41214) 2023-09-30T22:28:16.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.110+0000 7f56affff700 1 -- 172.21.15.40:0/63875095 learned_addr learned my addr 172.21.15.40:0/63875095 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:16.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.110+0000 7f56b4818700 1 --2- 172.21.15.40:0/63875095 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56b0130fb0 0x7f56b0138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:16.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.110+0000 7f56b4818700 1 -- 172.21.15.40:0/63875095 >> v2:172.21.15.40:3300/0 conn(0x7f56b009d920 msgr2=0x7f56b009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:16.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.110+0000 7f56b4818700 1 --2- 172.21.15.40:0/63875095 >> v2:172.21.15.40:3300/0 conn(0x7f56b009d920 0x7f56b009dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:16.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.110+0000 7f56b4818700 1 -- 172.21.15.40:0/63875095 >> v1:172.21.15.40:6789/0 conn(0x7f56b009e230 legacy=0x7f56b01308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:16.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.110+0000 7f56b4818700 1 -- 172.21.15.40:0/63875095 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b009a6e0 con 0x7f56b0130fb0 2023-09-30T22:28:16.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.110+0000 7f56affff700 1 --2- 172.21.15.40:0/63875095 >> v2:172.21.15.40:3300/0 conn(0x7f56b009d920 0x7f56b009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:16.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.111+0000 7f56b4818700 1 --2- 172.21.15.40:0/63875095 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56b0130fb0 0x7f56b0138d10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f56a8009d90 tx=0x7f56a800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e74d4f9f6c1cebf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:16.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.111+0000 7f56aeffd700 1 -- 172.21.15.40:0/63875095 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a800e070 con 0x7f56b0130fb0 2023-09-30T22:28:16.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.111+0000 7f56aeffd700 1 -- 172.21.15.40:0/63875095 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a800bb20 con 0x7f56b0130fb0 2023-09-30T22:28:16.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.111+0000 7f56aeffd700 1 -- 172.21.15.40:0/63875095 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a8012430 con 0x7f56b0130fb0 2023-09-30T22:28:16.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.111+0000 7f56b627b700 1 -- 172.21.15.40:0/63875095 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56b0130fb0 msgr2=0x7f56b0138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:16.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.111+0000 7f56b627b700 1 --2- 172.21.15.40:0/63875095 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56b0130fb0 0x7f56b0138d10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f56a8009d90 tx=0x7f56a800b330 comp rx=0 tx=0).stop 2023-09-30T22:28:16.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.111+0000 7f56b627b700 1 -- 172.21.15.40:0/63875095 shutdown_connections 2023-09-30T22:28:16.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.111+0000 7f56b627b700 1 --2- 172.21.15.40:0/63875095 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56b0130fb0 0x7f56b0138d10 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:16.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.111+0000 7f56b627b700 1 --2- 172.21.15.40:0/63875095 >> v2:172.21.15.40:3300/0 conn(0x7f56b009d920 0x7f56b009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:16.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.111+0000 7f56b627b700 1 -- 172.21.15.40:0/63875095 >> 172.21.15.40:0/63875095 conn(0x7f56b009fb20 msgr2=0x7f56b009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:16.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.112+0000 7f56b627b700 1 -- 172.21.15.40:0/63875095 shutdown_connections 2023-09-30T22:28:16.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.112+0000 7f56b627b700 1 -- 172.21.15.40:0/63875095 wait complete. 2023-09-30T22:28:16.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.112+0000 7f56b627b700 1 Processor -- start 2023-09-30T22:28:16.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.113+0000 7f56b627b700 1 -- start start 2023-09-30T22:28:16.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.113+0000 7f56b627b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56b009d920 0x7f56b01213e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:16.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.113+0000 7f56b627b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56b009e230 0x7f56b0121920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:16.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.113+0000 7f56b627b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56b0130fb0 0x7f56b0121e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:16.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.113+0000 7f56b627b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b0124eb0 con 0x7f56b009d920 2023-09-30T22:28:16.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.113+0000 7f56b627b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b0071220 con 0x7f56b009e230 2023-09-30T22:28:16.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.113+0000 7f56b627b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56b009cb00 con 0x7f56b0130fb0 2023-09-30T22:28:16.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.113+0000 7f56affff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56b009d920 0x7f56b01213e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:16.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.113+0000 7f56af7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56b009e230 0x7f56b0121920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:16.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.113+0000 7f56affff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56b009d920 0x7f56b01213e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41230/0 (socket says 172.21.15.40:41230) 2023-09-30T22:28:16.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.113+0000 7f56affff700 1 -- 172.21.15.40:0/1964612903 learned_addr learned my addr 172.21.15.40:0/1964612903 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:16.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.113+0000 7f56af7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56b009e230 0x7f56b0121920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60252/0 (socket says 172.21.15.40:60252) 2023-09-30T22:28:16.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.113+0000 7f56b4818700 1 --2- 172.21.15.40:0/1964612903 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56b0130fb0 0x7f56b0121e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:16.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.114+0000 7f56affff700 1 -- 172.21.15.40:0/1964612903 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56b0130fb0 msgr2=0x7f56b0121e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:16.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.114+0000 7f56affff700 1 --2- 172.21.15.40:0/1964612903 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56b0130fb0 0x7f56b0121e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:16.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.114+0000 7f56affff700 1 -- 172.21.15.40:0/1964612903 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56b009e230 msgr2=0x7f56b0121920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:16.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.114+0000 7f56affff700 1 --2- 172.21.15.40:0/1964612903 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56b009e230 0x7f56b0121920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:16.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.114+0000 7f56affff700 1 -- 172.21.15.40:0/1964612903 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a000b7a0 con 0x7f56b009d920 2023-09-30T22:28:16.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.114+0000 7f56af7fe700 1 --2- 172.21.15.40:0/1964612903 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56b009e230 0x7f56b0121920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:16.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.114+0000 7f56affff700 1 --2- 172.21.15.40:0/1964612903 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56b009d920 0x7f56b01213e0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f56a000ed40 tx=0x7f56a000d630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:16.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.114+0000 7f56acff9700 1 -- 172.21.15.40:0/1964612903 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a000dd30 con 0x7f56b009d920 2023-09-30T22:28:16.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.114+0000 7f56acff9700 1 -- 172.21.15.40:0/1964612903 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a000de90 con 0x7f56b009d920 2023-09-30T22:28:16.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.114+0000 7f56acff9700 1 -- 172.21.15.40:0/1964612903 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a0005c60 con 0x7f56b009d920 2023-09-30T22:28:16.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.114+0000 7f56b627b700 1 -- 172.21.15.40:0/1964612903 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56a8009a70 con 0x7f56b009d920 2023-09-30T22:28:16.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.114+0000 7f56b627b700 1 -- 172.21.15.40:0/1964612903 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b0124640 con 0x7f56b009d920 2023-09-30T22:28:16.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.115+0000 7f56acff9700 1 -- 172.21.15.40:0/1964612903 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f56a0006030 con 0x7f56b009d920 2023-09-30T22:28:16.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.115+0000 7f56b627b700 1 -- 172.21.15.40:0/1964612903 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b0124a30 con 0x7f56b009d920 2023-09-30T22:28:16.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.115+0000 7f56acff9700 1 -- 172.21.15.40:0/1964612903 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f56a003fc80 con 0x7f56b009d920 2023-09-30T22:28:16.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.120+0000 7f56acff9700 1 -- 172.21.15.40:0/1964612903 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f56b0124a30 con 0x7f56b009d920 2023-09-30T22:28:16.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.128+0000 7f5f227a2700 1 Processor -- start 2023-09-30T22:28:16.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.128+0000 7f5f227a2700 1 -- start start 2023-09-30T22:28:16.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.128+0000 7f5f227a2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f1c09c890 0x7f5f1c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:16.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.128+0000 7f5f227a2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5f1c09d920 0x7f5f1c09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:16.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.128+0000 7f5f227a2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f1c0a2600 con 0x7f5f1c09e2b0 2023-09-30T22:28:16.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.128+0000 7f5f227a2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f1c0a29d0 con 0x7f5f1c09d920 2023-09-30T22:28:16.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.128+0000 7f5f227a2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c09fb40 con 0x7f5f1c09c890 2023-09-30T22:28:16.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.128+0000 7f5f1b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5f1c09d920 0x7f5f1c09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:16.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.128+0000 7f5f1bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f1c09c890 0x7f5f1c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:16.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.128+0000 7f5f1b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5f1c09d920 0x7f5f1c09dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41244/0 (socket says 172.21.15.40:41244) 2023-09-30T22:28:16.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.128+0000 7f5f1b7fe700 1 -- 172.21.15.40:0/2476536436 learned_addr learned my addr 172.21.15.40:0/2476536436 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:16.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.129+0000 7f5f1b7fe700 1 -- 172.21.15.40:0/2476536436 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f1c09c890 msgr2=0x7f5f1c09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:16.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.129+0000 7f5f1b7fe700 1 --2- 172.21.15.40:0/2476536436 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f1c09c890 0x7f5f1c09cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:16.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.129+0000 7f5f1b7fe700 1 -- 172.21.15.40:0/2476536436 >> v1:172.21.15.40:6789/0 conn(0x7f5f1c09e2b0 legacy=0x7f5f1c13ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:16.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.129+0000 7f5f1b7fe700 1 -- 172.21.15.40:0/2476536436 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f1c09e750 con 0x7f5f1c09d920 2023-09-30T22:28:16.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.129+0000 7f5f1bfff700 1 --2- 172.21.15.40:0/2476536436 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f1c09c890 0x7f5f1c09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:16.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.129+0000 7f5f1b7fe700 1 --2- 172.21.15.40:0/2476536436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f1c09d920 0x7f5f1c09dd70 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f5f100098f0 tx=0x7f5f10009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c38d6b37e4db20d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:16.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.129+0000 7f5f1affd700 1 -- 172.21.15.40:0/2476536436 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f10011830 con 0x7f5f1c09d920 2023-09-30T22:28:16.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.129+0000 7f5f1affd700 1 -- 172.21.15.40:0/2476536436 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f10011990 con 0x7f5f1c09d920 2023-09-30T22:28:16.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.129+0000 7f5f1affd700 1 -- 172.21.15.40:0/2476536436 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f10011d20 con 0x7f5f1c09d920 2023-09-30T22:28:16.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.130+0000 7f5f227a2700 1 -- 172.21.15.40:0/2476536436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f1c09d920 msgr2=0x7f5f1c09dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:16.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.130+0000 7f5f227a2700 1 --2- 172.21.15.40:0/2476536436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f1c09d920 0x7f5f1c09dd70 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f5f100098f0 tx=0x7f5f10009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:16.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.130+0000 7f5f227a2700 1 -- 172.21.15.40:0/2476536436 shutdown_connections 2023-09-30T22:28:16.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.130+0000 7f5f227a2700 1 --2- 172.21.15.40:0/2476536436 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f1c09c890 0x7f5f1c09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:16.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.130+0000 7f5f227a2700 1 --2- 172.21.15.40:0/2476536436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f1c09d920 0x7f5f1c09dd70 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:16.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.130+0000 7f5f227a2700 1 -- 172.21.15.40:0/2476536436 >> 172.21.15.40:0/2476536436 conn(0x7f5f1c0a7080 msgr2=0x7f5f1c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:16.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.130+0000 7f5f227a2700 1 -- 172.21.15.40:0/2476536436 shutdown_connections 2023-09-30T22:28:16.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.130+0000 7f5f227a2700 1 -- 172.21.15.40:0/2476536436 wait complete. 2023-09-30T22:28:16.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.131+0000 7f5f227a2700 1 Processor -- start 2023-09-30T22:28:16.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.131+0000 7f5f227a2700 1 -- start start 2023-09-30T22:28:16.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.131+0000 7f5f227a2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f1c09c890 0x7f5f1c1c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:16.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.131+0000 7f5f227a2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f1c09d920 0x7f5f1c1c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:16.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.132+0000 7f5f227a2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f1c09e2b0 0x7f5f1c12d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:16.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.132+0000 7f5f227a2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c08f560 con 0x7f5f1c09c890 2023-09-30T22:28:16.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.132+0000 7f5f227a2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c09ecf0 con 0x7f5f1c09e2b0 2023-09-30T22:28:16.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.132+0000 7f5f227a2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c1308e0 con 0x7f5f1c09d920 2023-09-30T22:28:16.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.132+0000 7f5f1bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f1c09c890 0x7f5f1c1c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:16.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.132+0000 7f5f1bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f1c09c890 0x7f5f1c1c8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41252/0 (socket says 172.21.15.40:41252) 2023-09-30T22:28:16.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.132+0000 7f5f1bfff700 1 -- 172.21.15.40:0/681696039 learned_addr learned my addr 172.21.15.40:0/681696039 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:16.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.132+0000 7f5f1b7fe700 1 --2- 172.21.15.40:0/681696039 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f1c09d920 0x7f5f1c1c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:16.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.132+0000 7f5f1bfff700 1 -- 172.21.15.40:0/681696039 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f1c09d920 msgr2=0x7f5f1c1c9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:16.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.132+0000 7f5f1bfff700 1 --2- 172.21.15.40:0/681696039 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f1c09d920 0x7f5f1c1c9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:16.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.132+0000 7f5f1bfff700 1 -- 172.21.15.40:0/681696039 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f1c09e2b0 msgr2=0x7f5f1c12d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:16.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.132+0000 7f5f1bfff700 1 --2- 172.21.15.40:0/681696039 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f1c09e2b0 0x7f5f1c12d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:16.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.132+0000 7f5f1bfff700 1 -- 172.21.15.40:0/681696039 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0c009430 con 0x7f5f1c09c890 2023-09-30T22:28:16.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.132+0000 7f5f1bfff700 1 --2- 172.21.15.40:0/681696039 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f1c09c890 0x7f5f1c1c8cc0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c00ebe0 tx=0x7f5f0c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:16.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.132+0000 7f5f18ff9700 1 -- 172.21.15.40:0/681696039 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c005a20 con 0x7f5f1c09c890 2023-09-30T22:28:16.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.132+0000 7f5f18ff9700 1 -- 172.21.15.40:0/681696039 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0c005b80 con 0x7f5f1c09c890 2023-09-30T22:28:16.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.132+0000 7f5f227a2700 1 -- 172.21.15.40:0/681696039 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f10009550 con 0x7f5f1c09c890 2023-09-30T22:28:16.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.132+0000 7f5f18ff9700 1 -- 172.21.15.40:0/681696039 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c00c910 con 0x7f5f1c09c890 2023-09-30T22:28:16.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.132+0000 7f5f227a2700 1 -- 172.21.15.40:0/681696039 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f1c130e80 con 0x7f5f1c09c890 2023-09-30T22:28:16.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.133+0000 7f5f227a2700 1 -- 172.21.15.40:0/681696039 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f1c131d20 con 0x7f5f1c09c890 2023-09-30T22:28:16.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.134+0000 7f5f18ff9700 1 -- 172.21.15.40:0/681696039 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5f0c00ca70 con 0x7f5f1c09c890 2023-09-30T22:28:16.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.134+0000 7f5f18ff9700 1 -- 172.21.15.40:0/681696039 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5f0c03faa0 con 0x7f5f1c09c890 2023-09-30T22:28:16.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.139+0000 7f5f18ff9700 1 -- 172.21.15.40:0/681696039 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5f0c022300 con 0x7f5f1c09c890 2023-09-30T22:28:16.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.250+0000 7fa5344be700 1 -- 172.21.15.40:0/2192519432 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa52c062380 con 0x7fa52c09e230 2023-09-30T22:28:16.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.250+0000 7fa522ffd700 1 -- 172.21.15.40:0/2192519432 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa51c011590 con 0x7fa52c09e230 2023-09-30T22:28:16.251 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:16.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.252+0000 7fa5344be700 1 -- 172.21.15.40:0/2192519432 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa52c09e230 msgr2=0x7fa52c11f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:16.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.252+0000 7fa5344be700 1 --2- 172.21.15.40:0/2192519432 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa52c09e230 0x7fa52c11f730 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa51c000f60 tx=0x7fa51c00c730 comp rx=0 tx=0).stop 2023-09-30T22:28:16.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.253+0000 7fa5344be700 1 -- 172.21.15.40:0/2192519432 shutdown_connections 2023-09-30T22:28:16.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.253+0000 7fa5344be700 1 --2- 172.21.15.40:0/2192519432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa52c130fb0 0x7fa52c11fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:16.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.253+0000 7fa5344be700 1 --2- 172.21.15.40:0/2192519432 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa52c09d920 0x7fa52c11f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:16.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.253+0000 7fa5344be700 1 --2- 172.21.15.40:0/2192519432 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa52c09e230 0x7fa52c11f730 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:16.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.253+0000 7fa5344be700 1 -- 172.21.15.40:0/2192519432 >> 172.21.15.40:0/2192519432 conn(0x7fa52c09fb20 msgr2=0x7fa52c119730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:16.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.253+0000 7fa5344be700 1 -- 172.21.15.40:0/2192519432 shutdown_connections 2023-09-30T22:28:16.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.253+0000 7fa5344be700 1 -- 172.21.15.40:0/2192519432 wait complete. 2023-09-30T22:28:16.266 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:16.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.316+0000 7f56b627b700 1 -- 172.21.15.40:0/1964612903 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f56b0124a30 con 0x7f56b009d920 2023-09-30T22:28:16.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.317+0000 7f56acff9700 1 -- 172.21.15.40:0/1964612903 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f56b0124a30 con 0x7f56b009d920 2023-09-30T22:28:16.318 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:16.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.319+0000 7f56b627b700 1 -- 172.21.15.40:0/1964612903 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56b009d920 msgr2=0x7f56b01213e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:16.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.319+0000 7f56b627b700 1 --2- 172.21.15.40:0/1964612903 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56b009d920 0x7f56b01213e0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f56a000ed40 tx=0x7f56a000d630 comp rx=0 tx=0).stop 2023-09-30T22:28:16.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.319+0000 7f56b627b700 1 -- 172.21.15.40:0/1964612903 shutdown_connections 2023-09-30T22:28:16.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.319+0000 7f56b627b700 1 --2- 172.21.15.40:0/1964612903 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56b0130fb0 0x7f56b0121e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:16.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.319+0000 7f56b627b700 1 --2- 172.21.15.40:0/1964612903 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56b009d920 0x7f56b01213e0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:16.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.319+0000 7f56b627b700 1 --2- 172.21.15.40:0/1964612903 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56b009e230 0x7f56b0121920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:16.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.319+0000 7f56b627b700 1 -- 172.21.15.40:0/1964612903 >> 172.21.15.40:0/1964612903 conn(0x7f56b009fb20 msgr2=0x7f56b012fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:16.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.319+0000 7f56b627b700 1 -- 172.21.15.40:0/1964612903 shutdown_connections 2023-09-30T22:28:16.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.319+0000 7f56b627b700 1 -- 172.21.15.40:0/1964612903 wait complete. 2023-09-30T22:28:16.332 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:16.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.335+0000 7f5f227a2700 1 -- 172.21.15.40:0/681696039 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5f1c062380 con 0x7f5f1c09c890 2023-09-30T22:28:16.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.336+0000 7f5f18ff9700 1 -- 172.21.15.40:0/681696039 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5f0c011b40 con 0x7f5f1c09c890 2023-09-30T22:28:16.336 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:16.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.338+0000 7f5f227a2700 1 -- 172.21.15.40:0/681696039 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f1c09c890 msgr2=0x7f5f1c1c8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:16.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.338+0000 7f5f227a2700 1 --2- 172.21.15.40:0/681696039 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f1c09c890 0x7f5f1c1c8cc0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c00ebe0 tx=0x7f5f0c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:28:16.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.338+0000 7f5f227a2700 1 -- 172.21.15.40:0/681696039 shutdown_connections 2023-09-30T22:28:16.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.338+0000 7f5f227a2700 1 --2- 172.21.15.40:0/681696039 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f1c09e2b0 0x7f5f1c12d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:16.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.338+0000 7f5f227a2700 1 --2- 172.21.15.40:0/681696039 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f1c09c890 0x7f5f1c1c8cc0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:16.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.338+0000 7f5f227a2700 1 --2- 172.21.15.40:0/681696039 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f1c09d920 0x7f5f1c1c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:16.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.338+0000 7f5f227a2700 1 -- 172.21.15.40:0/681696039 >> 172.21.15.40:0/681696039 conn(0x7f5f1c0a7080 msgr2=0x7f5f1c132800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:16.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.338+0000 7f5f227a2700 1 -- 172.21.15.40:0/681696039 shutdown_connections 2023-09-30T22:28:16.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:16.338+0000 7f5f227a2700 1 -- 172.21.15.40:0/681696039 wait complete. 2023-09-30T22:28:16.351 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:16.897 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:17.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.029+0000 7f2c8f308700 1 Processor -- start 2023-09-30T22:28:17.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.030+0000 7f2c8f308700 1 -- start start 2023-09-30T22:28:17.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.030+0000 7f2c8f308700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c8809c890 0x7f2c8809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.030+0000 7f2c8f308700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c8809e480 0x7f2c8813bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.030+0000 7f2c8f308700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c880a2600 con 0x7f2c8809d920 2023-09-30T22:28:17.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.030+0000 7f2c8f308700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c880a29d0 con 0x7f2c8809e480 2023-09-30T22:28:17.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.030+0000 7f2c8f308700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8809fb40 con 0x7f2c8809c890 2023-09-30T22:28:17.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.030+0000 7f2c8c8a3700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2c8809d920 0x7f2c8809dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39526/0 (socket says 172.21.15.40:39526) 2023-09-30T22:28:17.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.030+0000 7f2c8d8a5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c8809e480 0x7f2c8813bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.030+0000 7f2c8d0a4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c8809c890 0x7f2c8809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.030+0000 7f2c8c8a3700 1 -- 172.21.15.40:0/2552556365 learned_addr learned my addr 172.21.15.40:0/2552556365 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:17.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.031+0000 7f2c7bfff700 1 -- 172.21.15.40:0/2552556365 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1747339308 0 0) 0x7f2c880a2600 con 0x7f2c8809d920 2023-09-30T22:28:17.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.031+0000 7f2c8d0a4700 1 -- 172.21.15.40:0/2552556365 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c8809e480 msgr2=0x7f2c8813bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:17.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.031+0000 7f2c8d0a4700 1 --2- 172.21.15.40:0/2552556365 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c8809e480 0x7f2c8813bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.031+0000 7f2c8d0a4700 1 -- 172.21.15.40:0/2552556365 >> v1:172.21.15.40:6789/0 conn(0x7f2c8809d920 legacy=0x7f2c8809dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.031+0000 7f2c8d0a4700 1 -- 172.21.15.40:0/2552556365 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c8809fed0 con 0x7f2c8809c890 2023-09-30T22:28:17.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.031+0000 7f2c8d8a5700 1 --2- 172.21.15.40:0/2552556365 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c8809e480 0x7f2c8813bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:17.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.031+0000 7f2c8d0a4700 1 --2- 172.21.15.40:0/2552556365 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c8809c890 0x7f2c8809cc60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2c84009850 tx=0x7f2c84009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c12149245c0fe6ff server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:17.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.031+0000 7f2c7bfff700 1 -- 172.21.15.40:0/2552556365 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c84005e30 con 0x7f2c8809c890 2023-09-30T22:28:17.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.031+0000 7f2c7bfff700 1 -- 172.21.15.40:0/2552556365 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c84006030 con 0x7f2c8809c890 2023-09-30T22:28:17.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.031+0000 7f2c7bfff700 1 -- 172.21.15.40:0/2552556365 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c840063e0 con 0x7f2c8809c890 2023-09-30T22:28:17.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.031+0000 7f2c8f308700 1 -- 172.21.15.40:0/2552556365 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c8809c890 msgr2=0x7f2c8809cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.032+0000 7f2c8f308700 1 --2- 172.21.15.40:0/2552556365 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c8809c890 0x7f2c8809cc60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2c84009850 tx=0x7f2c84009b60 comp rx=0 tx=0).stop 2023-09-30T22:28:17.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.032+0000 7f2c8f308700 1 -- 172.21.15.40:0/2552556365 shutdown_connections 2023-09-30T22:28:17.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.032+0000 7f2c8f308700 1 --2- 172.21.15.40:0/2552556365 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c8809e480 0x7f2c8813bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.032+0000 7f2c8f308700 1 --2- 172.21.15.40:0/2552556365 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c8809c890 0x7f2c8809cc60 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.032+0000 7f2c8f308700 1 -- 172.21.15.40:0/2552556365 >> 172.21.15.40:0/2552556365 conn(0x7f2c880a7080 msgr2=0x7f2c880a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:17.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.032+0000 7f2c8f308700 1 -- 172.21.15.40:0/2552556365 shutdown_connections 2023-09-30T22:28:17.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.032+0000 7f2c8f308700 1 -- 172.21.15.40:0/2552556365 wait complete. 2023-09-30T22:28:17.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.032+0000 7f2c8f308700 1 Processor -- start 2023-09-30T22:28:17.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.033+0000 7f2c8f308700 1 -- start start 2023-09-30T22:28:17.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.033+0000 7f2c8f308700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c8809c890 0x7f2c8812d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.033+0000 7f2c8f308700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c8809d920 0x7f2c8812d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.033+0000 7f2c8f308700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c8809e480 0x7f2c8812df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.033+0000 7f2c8f308700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8809c050 con 0x7f2c8809c890 2023-09-30T22:28:17.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.033+0000 7f2c8f308700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8808f4f0 con 0x7f2c8809d920 2023-09-30T22:28:17.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.033+0000 7f2c8f308700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c881309c0 con 0x7f2c8809e480 2023-09-30T22:28:17.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.033+0000 7f2c8d0a4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c8809c890 0x7f2c8812d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.033+0000 7f2c8c8a3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c8809d920 0x7f2c8812d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.033+0000 7f2c8d0a4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c8809c890 0x7f2c8812d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41258/0 (socket says 172.21.15.40:41258) 2023-09-30T22:28:17.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.033+0000 7f2c8d0a4700 1 -- 172.21.15.40:0/2807986454 learned_addr learned my addr 172.21.15.40:0/2807986454 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:17.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.033+0000 7f2c8d8a5700 1 --2- 172.21.15.40:0/2807986454 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c8809e480 0x7f2c8812df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.033+0000 7f2c8d0a4700 1 -- 172.21.15.40:0/2807986454 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c8809e480 msgr2=0x7f2c8812df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.033+0000 7f2c8d0a4700 1 --2- 172.21.15.40:0/2807986454 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c8809e480 0x7f2c8812df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.033+0000 7f2c8d0a4700 1 -- 172.21.15.40:0/2807986454 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c8809d920 msgr2=0x7f2c8812d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.033+0000 7f2c8d0a4700 1 --2- 172.21.15.40:0/2807986454 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c8809d920 0x7f2c8812d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.033+0000 7f2c8d0a4700 1 -- 172.21.15.40:0/2807986454 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c80009a70 con 0x7f2c8809c890 2023-09-30T22:28:17.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.033+0000 7f2c8c8a3700 1 --2- 172.21.15.40:0/2807986454 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c8809d920 0x7f2c8812d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:17.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.033+0000 7f2c8d8a5700 1 --2- 172.21.15.40:0/2807986454 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c8809e480 0x7f2c8812df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:17.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.034+0000 7f2c8d0a4700 1 --2- 172.21.15.40:0/2807986454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c8809c890 0x7f2c8812d4b0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f2c84012000 tx=0x7f2c84004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:17.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.034+0000 7f2c79ffb700 1 -- 172.21.15.40:0/2807986454 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c84025470 con 0x7f2c8809c890 2023-09-30T22:28:17.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.034+0000 7f2c79ffb700 1 -- 172.21.15.40:0/2807986454 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c840255d0 con 0x7f2c8809c890 2023-09-30T22:28:17.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.034+0000 7f2c8f308700 1 -- 172.21.15.40:0/2807986454 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c84009430 con 0x7f2c8809c890 2023-09-30T22:28:17.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.034+0000 7f2c79ffb700 1 -- 172.21.15.40:0/2807986454 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c84025940 con 0x7f2c8809c890 2023-09-30T22:28:17.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.034+0000 7f2c8f308700 1 -- 172.21.15.40:0/2807986454 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c88130ca0 con 0x7f2c8809c890 2023-09-30T22:28:17.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.035+0000 7f2c79ffb700 1 -- 172.21.15.40:0/2807986454 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2c84022070 con 0x7f2c8809c890 2023-09-30T22:28:17.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.035+0000 7f2c79ffb700 1 -- 172.21.15.40:0/2807986454 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f2c84040c20 con 0x7f2c8809c890 2023-09-30T22:28:17.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.035+0000 7f2c8f308700 1 -- 172.21.15.40:0/2807986454 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c88130b00 con 0x7f2c8809c890 2023-09-30T22:28:17.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.040+0000 7f2c79ffb700 1 -- 172.21.15.40:0/2807986454 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2c88130b00 con 0x7f2c8809c890 2023-09-30T22:28:17.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.232+0000 7f2c8f308700 1 -- 172.21.15.40:0/2807986454 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2c88130b00 con 0x7f2c8809c890 2023-09-30T22:28:17.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.232+0000 7f2c79ffb700 1 -- 172.21.15.40:0/2807986454 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2c88130b00 con 0x7f2c8809c890 2023-09-30T22:28:17.233 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:17.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.234+0000 7f2c8f308700 1 -- 172.21.15.40:0/2807986454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c8809c890 msgr2=0x7f2c8812d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.234+0000 7f2c8f308700 1 --2- 172.21.15.40:0/2807986454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c8809c890 0x7f2c8812d4b0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f2c84012000 tx=0x7f2c84004750 comp rx=0 tx=0).stop 2023-09-30T22:28:17.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.234+0000 7f2c8f308700 1 -- 172.21.15.40:0/2807986454 shutdown_connections 2023-09-30T22:28:17.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.234+0000 7f2c8f308700 1 --2- 172.21.15.40:0/2807986454 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c8809e480 0x7f2c8812df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.234+0000 7f2c8f308700 1 --2- 172.21.15.40:0/2807986454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c8809c890 0x7f2c8812d4b0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.234+0000 7f2c8f308700 1 --2- 172.21.15.40:0/2807986454 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c8809d920 0x7f2c8812d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.234+0000 7f2c8f308700 1 -- 172.21.15.40:0/2807986454 >> 172.21.15.40:0/2807986454 conn(0x7f2c880a7080 msgr2=0x7f2c881332c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:17.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.234+0000 7f2c8f308700 1 -- 172.21.15.40:0/2807986454 shutdown_connections 2023-09-30T22:28:17.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.234+0000 7f2c8f308700 1 -- 172.21.15.40:0/2807986454 wait complete. 2023-09-30T22:28:17.247 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:17.267 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:17.333 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:17.351 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:17.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.402+0000 7f9afc385700 1 Processor -- start 2023-09-30T22:28:17.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.402+0000 7f9afc385700 1 -- start start 2023-09-30T22:28:17.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.403+0000 7f9afc385700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9af409d920 0x7f9af409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.403+0000 7f9afc385700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9af4130fb0 0x7f9af4138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.403+0000 7f9afc385700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af409adf0 con 0x7f9af409e230 2023-09-30T22:28:17.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.403+0000 7f9afc385700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af409edf0 con 0x7f9af409d920 2023-09-30T22:28:17.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.403+0000 7f9afc385700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9af409b660 con 0x7f9af4130fb0 2023-09-30T22:28:17.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.403+0000 7f9afa121700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9af409d920 0x7f9af409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.403+0000 7f9afa121700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9af409d920 0x7f9af409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60292/0 (socket says 172.21.15.40:60292) 2023-09-30T22:28:17.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.403+0000 7f9afa121700 1 -- 172.21.15.40:0/3703300518 learned_addr learned my addr 172.21.15.40:0/3703300518 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:17.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.403+0000 7f9afa121700 1 -- 172.21.15.40:0/3703300518 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9af4130fb0 msgr2=0x7f9af4138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:17.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.403+0000 7f9afa121700 1 --2- 172.21.15.40:0/3703300518 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9af4130fb0 0x7f9af4138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.403+0000 7f9afa121700 1 -- 172.21.15.40:0/3703300518 >> v1:172.21.15.40:6789/0 conn(0x7f9af409e230 legacy=0x7f9af41308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.403+0000 7f9af911f700 1 -- 172.21.15.40:0/3703300518 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1919108582 0 0) 0x7f9af409adf0 con 0x7f9af409e230 2023-09-30T22:28:17.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.404+0000 7f9afa121700 1 -- 172.21.15.40:0/3703300518 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af409a6e0 con 0x7f9af409d920 2023-09-30T22:28:17.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.404+0000 7f9afa121700 1 --2- 172.21.15.40:0/3703300518 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9af409d920 0x7f9af409dcf0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f9af000f9e0 tx=0x7f9af000fcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d667e1e322a1e108 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:17.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.404+0000 7f9af911f700 1 -- 172.21.15.40:0/3703300518 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af0005a20 con 0x7f9af409d920 2023-09-30T22:28:17.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.404+0000 7f9af911f700 1 -- 172.21.15.40:0/3703300518 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af000c070 con 0x7f9af409d920 2023-09-30T22:28:17.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.404+0000 7f9af911f700 1 -- 172.21.15.40:0/3703300518 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af0005dc0 con 0x7f9af409d920 2023-09-30T22:28:17.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.405+0000 7f9afc385700 1 -- 172.21.15.40:0/3703300518 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9af409d920 msgr2=0x7f9af409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.405+0000 7f9afc385700 1 --2- 172.21.15.40:0/3703300518 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9af409d920 0x7f9af409dcf0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f9af000f9e0 tx=0x7f9af000fcf0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.405+0000 7f9afc385700 1 -- 172.21.15.40:0/3703300518 shutdown_connections 2023-09-30T22:28:17.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.405+0000 7f9afc385700 1 --2- 172.21.15.40:0/3703300518 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9af4130fb0 0x7f9af4138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.405+0000 7f9afc385700 1 --2- 172.21.15.40:0/3703300518 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9af409d920 0x7f9af409dcf0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.405+0000 7f9afc385700 1 -- 172.21.15.40:0/3703300518 >> 172.21.15.40:0/3703300518 conn(0x7f9af409fb20 msgr2=0x7f9af409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:17.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.405+0000 7f9afc385700 1 -- 172.21.15.40:0/3703300518 shutdown_connections 2023-09-30T22:28:17.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.405+0000 7f9afc385700 1 -- 172.21.15.40:0/3703300518 wait complete. 2023-09-30T22:28:17.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.406+0000 7f9afc385700 1 Processor -- start 2023-09-30T22:28:17.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.406+0000 7f9afc385700 1 -- start start 2023-09-30T22:28:17.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.407+0000 7f9afc385700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9af409d920 0x7f9af411cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.407+0000 7f9afc385700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9af409e230 0x7f9af411d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.407+0000 7f9afc385700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9af4130fb0 0x7f9af411d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.407+0000 7f9afc385700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af411e440 con 0x7f9af4130fb0 2023-09-30T22:28:17.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.407+0000 7f9afc385700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af41213b0 con 0x7f9af409d920 2023-09-30T22:28:17.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.407+0000 7f9afc385700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9af41209f0 con 0x7f9af409e230 2023-09-30T22:28:17.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.407+0000 7f9af9920700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9af409e230 0x7f9af411d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.407+0000 7f9afa121700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9af409d920 0x7f9af411cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.407+0000 7f9afa121700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9af409d920 0x7f9af411cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60298/0 (socket says 172.21.15.40:60298) 2023-09-30T22:28:17.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.407+0000 7f9afa121700 1 -- 172.21.15.40:0/93589211 learned_addr learned my addr 172.21.15.40:0/93589211 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:17.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.407+0000 7f9af9920700 1 --2- 172.21.15.40:0/93589211 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9af409e230 0x7f9af411d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:40964/0 (socket says 172.21.15.40:40964) 2023-09-30T22:28:17.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.407+0000 7f9afa922700 1 --2- 172.21.15.40:0/93589211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9af4130fb0 0x7f9af411d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.407+0000 7f9afa121700 1 -- 172.21.15.40:0/93589211 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9af409e230 msgr2=0x7f9af411d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.407+0000 7f9afa121700 1 --2- 172.21.15.40:0/93589211 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9af409e230 0x7f9af411d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.407+0000 7f9afa121700 1 -- 172.21.15.40:0/93589211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9af4130fb0 msgr2=0x7f9af411d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.407+0000 7f9afa121700 1 --2- 172.21.15.40:0/93589211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9af4130fb0 0x7f9af411d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.407+0000 7f9afa121700 1 -- 172.21.15.40:0/93589211 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af000f5f0 con 0x7f9af409d920 2023-09-30T22:28:17.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.408+0000 7f9afa121700 1 --2- 172.21.15.40:0/93589211 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9af409d920 0x7f9af411cf70 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f9af0009130 tx=0x7f9af0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:17.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.408+0000 7f9aeaffd700 1 -- 172.21.15.40:0/93589211 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af0015070 con 0x7f9af409d920 2023-09-30T22:28:17.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.408+0000 7f9aeaffd700 1 -- 172.21.15.40:0/93589211 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af0004240 con 0x7f9af409d920 2023-09-30T22:28:17.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.408+0000 7f9afc385700 1 -- 172.21.15.40:0/93589211 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af409cb00 con 0x7f9af409d920 2023-09-30T22:28:17.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.408+0000 7f9aeaffd700 1 -- 172.21.15.40:0/93589211 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af000f3c0 con 0x7f9af409d920 2023-09-30T22:28:17.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.408+0000 7f9afc385700 1 -- 172.21.15.40:0/93589211 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af411fda0 con 0x7f9af409d920 2023-09-30T22:28:17.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.409+0000 7f9aeaffd700 1 -- 172.21.15.40:0/93589211 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9af00036a0 con 0x7f9af409d920 2023-09-30T22:28:17.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.409+0000 7f9aeaffd700 1 -- 172.21.15.40:0/93589211 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9af003fb50 con 0x7f9af409d920 2023-09-30T22:28:17.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.409+0000 7f9afc385700 1 -- 172.21.15.40:0/93589211 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9af4062380 con 0x7f9af409d920 2023-09-30T22:28:17.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.414+0000 7f9aeaffd700 1 -- 172.21.15.40:0/93589211 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9af001e020 con 0x7f9af409d920 2023-09-30T22:28:17.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.472+0000 7f9b1f8ad700 1 Processor -- start 2023-09-30T22:28:17.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.473+0000 7f9b1f8ad700 1 -- start start 2023-09-30T22:28:17.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.473+0000 7f9b1f8ad700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9b1809d920 0x7f9b1809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.473+0000 7f9b1f8ad700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b1809e230 0x7f9b181308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.473+0000 7f9b1f8ad700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b18130de0 0x7f9b18131240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.473+0000 7f9b1f8ad700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b1809edf0 con 0x7f9b1809d920 2023-09-30T22:28:17.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.473+0000 7f9b1f8ad700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1809adf0 con 0x7f9b1809e230 2023-09-30T22:28:17.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.473+0000 7f9b1f8ad700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1809b660 con 0x7f9b18130de0 2023-09-30T22:28:17.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.473+0000 7f9b1ce48700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b1809e230 0x7f9b181308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.473+0000 7f9b1ce48700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b1809e230 0x7f9b181308a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60314/0 (socket says 172.21.15.40:60314) 2023-09-30T22:28:17.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.473+0000 7f9b1ce48700 1 -- 172.21.15.40:0/3756134822 learned_addr learned my addr 172.21.15.40:0/3756134822 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:17.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.473+0000 7f9b1d649700 1 --2- 172.21.15.40:0/3756134822 >> v2:172.21.15.40:3300/0 conn(0x7f9b1809d920 0x7f9b1809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.473+0000 7f9b1de4a700 1 --2- 172.21.15.40:0/3756134822 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b18130de0 0x7f9b18131240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.474+0000 7f9b1ce48700 1 -- 172.21.15.40:0/3756134822 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b18130de0 msgr2=0x7f9b18131240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:17.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.474+0000 7f9b1ce48700 1 --2- 172.21.15.40:0/3756134822 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b18130de0 0x7f9b18131240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.474+0000 7f9b1ce48700 1 -- 172.21.15.40:0/3756134822 >> v2:172.21.15.40:3300/0 conn(0x7f9b1809d920 msgr2=0x7f9b1809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:17.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.474+0000 7f9b1ce48700 1 --2- 172.21.15.40:0/3756134822 >> v2:172.21.15.40:3300/0 conn(0x7f9b1809d920 0x7f9b1809dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.474+0000 7f9b1ce48700 1 -- 172.21.15.40:0/3756134822 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b1809a6e0 con 0x7f9b1809e230 2023-09-30T22:28:17.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.474+0000 7f9b1d649700 1 --2- 172.21.15.40:0/3756134822 >> v2:172.21.15.40:3300/0 conn(0x7f9b1809d920 0x7f9b1809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:17.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.474+0000 7f9b1ce48700 1 --2- 172.21.15.40:0/3756134822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b1809e230 0x7f9b181308a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800bb90 tx=0x7f9b0800bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfb11596c73ff897 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:17.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.474+0000 7f9b0ffff700 1 -- 172.21.15.40:0/3756134822 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0800dd30 con 0x7f9b1809e230 2023-09-30T22:28:17.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.474+0000 7f9b0ffff700 1 -- 172.21.15.40:0/3756134822 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0800de90 con 0x7f9b1809e230 2023-09-30T22:28:17.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.474+0000 7f9b0ffff700 1 -- 172.21.15.40:0/3756134822 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b08010690 con 0x7f9b1809e230 2023-09-30T22:28:17.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.475+0000 7f9b1f8ad700 1 -- 172.21.15.40:0/3756134822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b1809e230 msgr2=0x7f9b181308a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.475+0000 7f9b1f8ad700 1 --2- 172.21.15.40:0/3756134822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b1809e230 0x7f9b181308a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800bb90 tx=0x7f9b0800bea0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.475+0000 7f9b1f8ad700 1 -- 172.21.15.40:0/3756134822 shutdown_connections 2023-09-30T22:28:17.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.475+0000 7f9b1f8ad700 1 --2- 172.21.15.40:0/3756134822 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b18130de0 0x7f9b18131240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.475+0000 7f9b1f8ad700 1 --2- 172.21.15.40:0/3756134822 >> v2:172.21.15.40:3300/0 conn(0x7f9b1809d920 0x7f9b1809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.475+0000 7f9b1f8ad700 1 --2- 172.21.15.40:0/3756134822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b1809e230 0x7f9b181308a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.475+0000 7f9b1f8ad700 1 -- 172.21.15.40:0/3756134822 >> 172.21.15.40:0/3756134822 conn(0x7f9b1809fb20 msgr2=0x7f9b1809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:17.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.475+0000 7f9b1f8ad700 1 -- 172.21.15.40:0/3756134822 shutdown_connections 2023-09-30T22:28:17.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.475+0000 7f9b1f8ad700 1 -- 172.21.15.40:0/3756134822 wait complete. 2023-09-30T22:28:17.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.476+0000 7f9b1f8ad700 1 Processor -- start 2023-09-30T22:28:17.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.476+0000 7f9b1f8ad700 1 -- start start 2023-09-30T22:28:17.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.476+0000 7f9b1f8ad700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b1809d920 0x7f9b181c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.476+0000 7f9b1f8ad700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b1809e230 0x7f9b181c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.476+0000 7f9b1f8ad700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b18130de0 0x7f9b18119730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.476+0000 7f9b1f8ad700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1811b6b0 con 0x7f9b18130de0 2023-09-30T22:28:17.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.476+0000 7f9b1f8ad700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1811ca90 con 0x7f9b1809d920 2023-09-30T22:28:17.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.476+0000 7f9b1f8ad700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1809cb70 con 0x7f9b1809e230 2023-09-30T22:28:17.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.477+0000 7f9b1ce48700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b1809e230 0x7f9b181c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.477+0000 7f9b1ce48700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b1809e230 0x7f9b181c4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:40976/0 (socket says 172.21.15.40:40976) 2023-09-30T22:28:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.477+0000 7f9b1ce48700 1 -- 172.21.15.40:0/2257464764 learned_addr learned my addr 172.21.15.40:0/2257464764 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.477+0000 7f9b1de4a700 1 --2- 172.21.15.40:0/2257464764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b18130de0 0x7f9b18119730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.477+0000 7f9b1d649700 1 --2- 172.21.15.40:0/2257464764 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b1809d920 0x7f9b181c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.477+0000 7f9b1ce48700 1 -- 172.21.15.40:0/2257464764 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b1809d920 msgr2=0x7f9b181c44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.477+0000 7f9b1ce48700 1 --2- 172.21.15.40:0/2257464764 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b1809d920 0x7f9b181c44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.477+0000 7f9b1ce48700 1 -- 172.21.15.40:0/2257464764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b18130de0 msgr2=0x7f9b18119730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.477+0000 7f9b1ce48700 1 --2- 172.21.15.40:0/2257464764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b18130de0 0x7f9b18119730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.477+0000 7f9b1ce48700 1 -- 172.21.15.40:0/2257464764 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b14009430 con 0x7f9b1809e230 2023-09-30T22:28:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.477+0000 7f9b1ce48700 1 --2- 172.21.15.40:0/2257464764 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b1809e230 0x7f9b181c4a20 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9b08000c00 tx=0x7f9b08004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.477+0000 7f9b0dffb700 1 -- 172.21.15.40:0/2257464764 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0801f070 con 0x7f9b1809e230 2023-09-30T22:28:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.477+0000 7f9b0dffb700 1 -- 172.21.15.40:0/2257464764 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b08003970 con 0x7f9b1809e230 2023-09-30T22:28:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.477+0000 7f9b1f8ad700 1 -- 172.21.15.40:0/2257464764 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b0800b7f0 con 0x7f9b1809e230 2023-09-30T22:28:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.477+0000 7f9b0dffb700 1 -- 172.21.15.40:0/2257464764 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b08003d00 con 0x7f9b1809e230 2023-09-30T22:28:17.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.478+0000 7f9b1f8ad700 1 -- 172.21.15.40:0/2257464764 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b1811c2b0 con 0x7f9b1809e230 2023-09-30T22:28:17.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.478+0000 7f9b1f8ad700 1 -- 172.21.15.40:0/2257464764 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b1811c0b0 con 0x7f9b1809e230 2023-09-30T22:28:17.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.479+0000 7f9b0dffb700 1 -- 172.21.15.40:0/2257464764 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9b08019400 con 0x7f9b1809e230 2023-09-30T22:28:17.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.479+0000 7f9b0dffb700 1 -- 172.21.15.40:0/2257464764 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9b08042b50 con 0x7f9b1809e230 2023-09-30T22:28:17.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.484+0000 7f9b0dffb700 1 -- 172.21.15.40:0/2257464764 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9b08003e60 con 0x7f9b1809e230 2023-09-30T22:28:17.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.507+0000 7f3e648f0700 1 Processor -- start 2023-09-30T22:28:17.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.507+0000 7f3e648f0700 1 -- start start 2023-09-30T22:28:17.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.508+0000 7f3e648f0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e6009c890 0x7f3e6009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.508+0000 7f3e648f0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3e6009d920 0x7f3e6009dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.508+0000 7f3e648f0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e6009e2b0 0x7f3e6013ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.508+0000 7f3e648f0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e600a29d0 con 0x7f3e6009d920 2023-09-30T22:28:17.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.508+0000 7f3e648f0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6009fb40 con 0x7f3e6009c890 2023-09-30T22:28:17.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.508+0000 7f3e648f0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e600a2600 con 0x7f3e6009e2b0 2023-09-30T22:28:17.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.508+0000 7f3e5e59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e6009c890 0x7f3e6009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.508+0000 7f3e5e59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e6009c890 0x7f3e6009cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60342/0 (socket says 172.21.15.40:60342) 2023-09-30T22:28:17.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.508+0000 7f3e5e59c700 1 -- 172.21.15.40:0/4059473507 learned_addr learned my addr 172.21.15.40:0/4059473507 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:17.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.508+0000 7f3e5ed9d700 1 --2- 172.21.15.40:0/4059473507 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e6009e2b0 0x7f3e6013ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.508+0000 7f3e5dd9b700 1 --2- 172.21.15.40:0/4059473507 >> v2:172.21.15.40:3300/0 conn(0x7f3e6009d920 0x7f3e6009dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.508+0000 7f3e5e59c700 1 -- 172.21.15.40:0/4059473507 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e6009e2b0 msgr2=0x7f3e6013ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:17.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.508+0000 7f3e5e59c700 1 --2- 172.21.15.40:0/4059473507 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e6009e2b0 0x7f3e6013ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.508+0000 7f3e5e59c700 1 -- 172.21.15.40:0/4059473507 >> v2:172.21.15.40:3300/0 conn(0x7f3e6009d920 msgr2=0x7f3e6009dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:17.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.508+0000 7f3e5e59c700 1 --2- 172.21.15.40:0/4059473507 >> v2:172.21.15.40:3300/0 conn(0x7f3e6009d920 0x7f3e6009dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.508+0000 7f3e5e59c700 1 -- 172.21.15.40:0/4059473507 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e6009e750 con 0x7f3e6009c890 2023-09-30T22:28:17.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.509+0000 7f3e5e59c700 1 --2- 172.21.15.40:0/4059473507 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e6009c890 0x7f3e6009cc60 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3e50006fd0 tx=0x7f3e50009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18f1bf186aab21d2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:17.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.509+0000 7f3e5d59a700 1 -- 172.21.15.40:0/4059473507 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e50005e30 con 0x7f3e6009c890 2023-09-30T22:28:17.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.509+0000 7f3e5d59a700 1 -- 172.21.15.40:0/4059473507 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e50004030 con 0x7f3e6009c890 2023-09-30T22:28:17.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.509+0000 7f3e5d59a700 1 -- 172.21.15.40:0/4059473507 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e500043e0 con 0x7f3e6009c890 2023-09-30T22:28:17.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.510+0000 7f3e648f0700 1 -- 172.21.15.40:0/4059473507 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e6009c890 msgr2=0x7f3e6009cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.510+0000 7f3e648f0700 1 --2- 172.21.15.40:0/4059473507 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e6009c890 0x7f3e6009cc60 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3e50006fd0 tx=0x7f3e50009bd0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.510+0000 7f3e648f0700 1 -- 172.21.15.40:0/4059473507 shutdown_connections 2023-09-30T22:28:17.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.510+0000 7f3e648f0700 1 --2- 172.21.15.40:0/4059473507 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e6009e2b0 0x7f3e6013ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.510+0000 7f3e648f0700 1 --2- 172.21.15.40:0/4059473507 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e6009c890 0x7f3e6009cc60 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.510+0000 7f3e648f0700 1 --2- 172.21.15.40:0/4059473507 >> v2:172.21.15.40:3300/0 conn(0x7f3e6009d920 0x7f3e6009dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.510+0000 7f3e648f0700 1 -- 172.21.15.40:0/4059473507 >> 172.21.15.40:0/4059473507 conn(0x7f3e600a7080 msgr2=0x7f3e600a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:17.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.510+0000 7f3e648f0700 1 -- 172.21.15.40:0/4059473507 shutdown_connections 2023-09-30T22:28:17.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.510+0000 7f3e648f0700 1 -- 172.21.15.40:0/4059473507 wait complete. 2023-09-30T22:28:17.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.511+0000 7f3e648f0700 1 Processor -- start 2023-09-30T22:28:17.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.511+0000 7f3e648f0700 1 -- start start 2023-09-30T22:28:17.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.512+0000 7f3e648f0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e6009c890 0x7f3e6012d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.512+0000 7f3e648f0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e6009d920 0x7f3e6012d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.512+0000 7f3e648f0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e6009e2b0 0x7f3e6012dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.512+0000 7f3e648f0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e600a5cd0 con 0x7f3e6009e2b0 2023-09-30T22:28:17.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.512+0000 7f3e648f0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6012fee0 con 0x7f3e6009d920 2023-09-30T22:28:17.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.512+0000 7f3e648f0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6012fab0 con 0x7f3e6009c890 2023-09-30T22:28:17.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.512+0000 7f3e5dd9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e6009d920 0x7f3e6012d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.512+0000 7f3e5ed9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e6009e2b0 0x7f3e6012dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.512+0000 7f3e5dd9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e6009d920 0x7f3e6012d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60350/0 (socket says 172.21.15.40:60350) 2023-09-30T22:28:17.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.512+0000 7f3e5dd9b700 1 -- 172.21.15.40:0/4052898496 learned_addr learned my addr 172.21.15.40:0/4052898496 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:17.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.512+0000 7f3e5e59c700 1 --2- 172.21.15.40:0/4052898496 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e6009c890 0x7f3e6012d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.513+0000 7f3e5dd9b700 1 -- 172.21.15.40:0/4052898496 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e6009c890 msgr2=0x7f3e6012d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.513+0000 7f3e5dd9b700 1 --2- 172.21.15.40:0/4052898496 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e6009c890 0x7f3e6012d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.513+0000 7f3e5dd9b700 1 -- 172.21.15.40:0/4052898496 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e6009e2b0 msgr2=0x7f3e6012dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.513+0000 7f3e5dd9b700 1 --2- 172.21.15.40:0/4052898496 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e6009e2b0 0x7f3e6012dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.513+0000 7f3e5dd9b700 1 -- 172.21.15.40:0/4052898496 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e50009500 con 0x7f3e6009d920 2023-09-30T22:28:17.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.513+0000 7f3e5ed9d700 1 --2- 172.21.15.40:0/4052898496 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e6009e2b0 0x7f3e6012dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:17.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.513+0000 7f3e5dd9b700 1 --2- 172.21.15.40:0/4052898496 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e6009d920 0x7f3e6012d830 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f3e5400e900 tx=0x7f3e5400ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:17.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.513+0000 7f3e4effd700 1 -- 172.21.15.40:0/4052898496 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e54013680 con 0x7f3e6009d920 2023-09-30T22:28:17.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.513+0000 7f3e4effd700 1 -- 172.21.15.40:0/4052898496 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e540137e0 con 0x7f3e6009d920 2023-09-30T22:28:17.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.513+0000 7f3e648f0700 1 -- 172.21.15.40:0/4052898496 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e60130330 con 0x7f3e6009d920 2023-09-30T22:28:17.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.513+0000 7f3e4effd700 1 -- 172.21.15.40:0/4052898496 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e54013b70 con 0x7f3e6009d920 2023-09-30T22:28:17.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.514+0000 7f3e648f0700 1 -- 172.21.15.40:0/4052898496 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e6012e2b0 con 0x7f3e6009d920 2023-09-30T22:28:17.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.515+0000 7f3e4effd700 1 -- 172.21.15.40:0/4052898496 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3e54013cd0 con 0x7f3e6009d920 2023-09-30T22:28:17.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.515+0000 7f3e648f0700 1 -- 172.21.15.40:0/4052898496 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e6009ed40 con 0x7f3e6009d920 2023-09-30T22:28:17.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.515+0000 7f3e4effd700 1 -- 172.21.15.40:0/4052898496 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3e5403f330 con 0x7f3e6009d920 2023-09-30T22:28:17.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.519+0000 7f3e4effd700 1 -- 172.21.15.40:0/4052898496 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3e5401ba00 con 0x7f3e6009d920 2023-09-30T22:28:17.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.620+0000 7f9afc385700 1 -- 172.21.15.40:0/93589211 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9af4074720 con 0x7f9af409d920 2023-09-30T22:28:17.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.620+0000 7f9aeaffd700 1 -- 172.21.15.40:0/93589211 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9af0027070 con 0x7f9af409d920 2023-09-30T22:28:17.621 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:17.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.623+0000 7f9afc385700 1 -- 172.21.15.40:0/93589211 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9af409d920 msgr2=0x7f9af411cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.623+0000 7f9afc385700 1 --2- 172.21.15.40:0/93589211 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9af409d920 0x7f9af411cf70 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f9af0009130 tx=0x7f9af0004750 comp rx=0 tx=0).stop 2023-09-30T22:28:17.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.624+0000 7f9afc385700 1 -- 172.21.15.40:0/93589211 shutdown_connections 2023-09-30T22:28:17.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.624+0000 7f9afc385700 1 --2- 172.21.15.40:0/93589211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9af4130fb0 0x7f9af411d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.624+0000 7f9afc385700 1 --2- 172.21.15.40:0/93589211 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9af409d920 0x7f9af411cf70 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.624+0000 7f9afc385700 1 --2- 172.21.15.40:0/93589211 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9af409e230 0x7f9af411d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.624+0000 7f9afc385700 1 -- 172.21.15.40:0/93589211 >> 172.21.15.40:0/93589211 conn(0x7f9af409fb20 msgr2=0x7f9af412fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:17.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.624+0000 7f9afc385700 1 -- 172.21.15.40:0/93589211 shutdown_connections 2023-09-30T22:28:17.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.624+0000 7f9afc385700 1 -- 172.21.15.40:0/93589211 wait complete. 2023-09-30T22:28:17.637 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:17.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.687+0000 7f9b1f8ad700 1 -- 172.21.15.40:0/2257464764 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9b18062380 con 0x7f9b1809e230 2023-09-30T22:28:17.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.687+0000 7f9b0dffb700 1 -- 172.21.15.40:0/2257464764 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9b08028030 con 0x7f9b1809e230 2023-09-30T22:28:17.688 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:17.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.689+0000 7f9b1f8ad700 1 -- 172.21.15.40:0/2257464764 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b1809e230 msgr2=0x7f9b181c4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.689+0000 7f9b1f8ad700 1 --2- 172.21.15.40:0/2257464764 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b1809e230 0x7f9b181c4a20 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9b08000c00 tx=0x7f9b08004750 comp rx=0 tx=0).stop 2023-09-30T22:28:17.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.689+0000 7f9b1f8ad700 1 -- 172.21.15.40:0/2257464764 shutdown_connections 2023-09-30T22:28:17.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.689+0000 7f9b1f8ad700 1 --2- 172.21.15.40:0/2257464764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b18130de0 0x7f9b18119730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.689+0000 7f9b1f8ad700 1 --2- 172.21.15.40:0/2257464764 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b1809d920 0x7f9b181c44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.689+0000 7f9b1f8ad700 1 --2- 172.21.15.40:0/2257464764 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b1809e230 0x7f9b181c4a20 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.689+0000 7f9b1f8ad700 1 -- 172.21.15.40:0/2257464764 >> 172.21.15.40:0/2257464764 conn(0x7f9b1809fb20 msgr2=0x7f9b1812de40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:17.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.690+0000 7f9b1f8ad700 1 -- 172.21.15.40:0/2257464764 shutdown_connections 2023-09-30T22:28:17.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.690+0000 7f9b1f8ad700 1 -- 172.21.15.40:0/2257464764 wait complete. 2023-09-30T22:28:17.702 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:17.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.718+0000 7f3e648f0700 1 -- 172.21.15.40:0/4052898496 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3e601309d0 con 0x7f3e6009d920 2023-09-30T22:28:17.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.718+0000 7f3e4effd700 1 -- 172.21.15.40:0/4052898496 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3e54017030 con 0x7f3e6009d920 2023-09-30T22:28:17.719 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:17.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.720+0000 7f3e648f0700 1 -- 172.21.15.40:0/4052898496 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e6009d920 msgr2=0x7f3e6012d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.720+0000 7f3e648f0700 1 --2- 172.21.15.40:0/4052898496 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e6009d920 0x7f3e6012d830 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f3e5400e900 tx=0x7f3e5400ec10 comp rx=0 tx=0).stop 2023-09-30T22:28:17.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.720+0000 7f3e648f0700 1 -- 172.21.15.40:0/4052898496 shutdown_connections 2023-09-30T22:28:17.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.720+0000 7f3e648f0700 1 --2- 172.21.15.40:0/4052898496 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e6009c890 0x7f3e6012d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.720+0000 7f3e648f0700 1 --2- 172.21.15.40:0/4052898496 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e6009e2b0 0x7f3e6012dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.720+0000 7f3e648f0700 1 --2- 172.21.15.40:0/4052898496 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e6009d920 0x7f3e6012d830 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.720+0000 7f3e648f0700 1 -- 172.21.15.40:0/4052898496 >> 172.21.15.40:0/4052898496 conn(0x7f3e600a7080 msgr2=0x7f3e600a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:17.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.720+0000 7f3e648f0700 1 -- 172.21.15.40:0/4052898496 shutdown_connections 2023-09-30T22:28:17.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:17.720+0000 7f3e648f0700 1 -- 172.21.15.40:0/4052898496 wait complete. 2023-09-30T22:28:17.733 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:18.248 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:18.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.379+0000 7f0e2f1cd700 1 Processor -- start 2023-09-30T22:28:18.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.379+0000 7f0e2f1cd700 1 -- start start 2023-09-30T22:28:18.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.380+0000 7f0e2f1cd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e28131d50 0x7f0e28132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.380+0000 7f0e2f1cd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0e2809c7d0 0x7f0e28139ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.380+0000 7f0e2f1cd700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e28132660 con 0x7f0e2809bc50 2023-09-30T22:28:18.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.380+0000 7f0e2f1cd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e280719e0 con 0x7f0e28131d50 2023-09-30T22:28:18.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.380+0000 7f0e2f1cd700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e28131900 con 0x7f0e2809c7d0 2023-09-30T22:28:18.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.380+0000 7f0e2d76a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0e2809c7d0 0x7f0e28139ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.380+0000 7f0e2cf69700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e28131d50 0x7f0e28132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.380+0000 7f0e2d76a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0e2809c7d0 0x7f0e28139ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41004/0 (socket says 172.21.15.40:41004) 2023-09-30T22:28:18.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.380+0000 7f0e2d76a700 1 -- 172.21.15.40:0/3559285443 learned_addr learned my addr 172.21.15.40:0/3559285443 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:18.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.380+0000 7f0e27fff700 1 --1- 172.21.15.40:0/3559285443 >> v1:172.21.15.40:6789/0 conn(0x7f0e2809bc50 0x7f0e2809c0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39552/0 (socket says 172.21.15.40:39552) 2023-09-30T22:28:18.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.380+0000 7f0e2d76a700 1 -- 172.21.15.40:0/3559285443 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e28131d50 msgr2=0x7f0e28132120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:18.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.381+0000 7f0e2d76a700 1 --2- 172.21.15.40:0/3559285443 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e28131d50 0x7f0e28132120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.381+0000 7f0e2d76a700 1 -- 172.21.15.40:0/3559285443 >> v1:172.21.15.40:6789/0 conn(0x7f0e2809bc50 legacy=0x7f0e2809c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:18.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.381+0000 7f0e277fe700 1 -- 172.21.15.40:0/3559285443 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3957351606 0 0) 0x7f0e28132660 con 0x7f0e2809bc50 2023-09-30T22:28:18.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.381+0000 7f0e2d76a700 1 -- 172.21.15.40:0/3559285443 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e2809e820 con 0x7f0e2809c7d0 2023-09-30T22:28:18.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.381+0000 7f0e2cf69700 1 --2- 172.21.15.40:0/3559285443 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e28131d50 0x7f0e28132120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:18.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.381+0000 7f0e2d76a700 1 --2- 172.21.15.40:0/3559285443 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0e2809c7d0 0x7f0e28139ac0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0e20009eb0 tx=0x7f0e2000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58439a6b1b90c510 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:18.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.381+0000 7f0e277fe700 1 -- 172.21.15.40:0/3559285443 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2000e070 con 0x7f0e2809c7d0 2023-09-30T22:28:18.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.381+0000 7f0e277fe700 1 -- 172.21.15.40:0/3559285443 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2000b8d0 con 0x7f0e2809c7d0 2023-09-30T22:28:18.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.381+0000 7f0e277fe700 1 -- 172.21.15.40:0/3559285443 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2000bc80 con 0x7f0e2809c7d0 2023-09-30T22:28:18.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.381+0000 7f0e2f1cd700 1 -- 172.21.15.40:0/3559285443 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0e2809c7d0 msgr2=0x7f0e28139ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:18.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.381+0000 7f0e2f1cd700 1 --2- 172.21.15.40:0/3559285443 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0e2809c7d0 0x7f0e28139ac0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0e20009eb0 tx=0x7f0e2000b330 comp rx=0 tx=0).stop 2023-09-30T22:28:18.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.381+0000 7f0e2f1cd700 1 -- 172.21.15.40:0/3559285443 shutdown_connections 2023-09-30T22:28:18.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.381+0000 7f0e2f1cd700 1 --2- 172.21.15.40:0/3559285443 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0e2809c7d0 0x7f0e28139ac0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.381+0000 7f0e2f1cd700 1 --2- 172.21.15.40:0/3559285443 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e28131d50 0x7f0e28132120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.381+0000 7f0e2f1cd700 1 -- 172.21.15.40:0/3559285443 >> 172.21.15.40:0/3559285443 conn(0x7f0e280a2a00 msgr2=0x7f0e280a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:18.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.382+0000 7f0e2f1cd700 1 -- 172.21.15.40:0/3559285443 shutdown_connections 2023-09-30T22:28:18.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.382+0000 7f0e2f1cd700 1 -- 172.21.15.40:0/3559285443 wait complete. 2023-09-30T22:28:18.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.383+0000 7f0e2f1cd700 1 Processor -- start 2023-09-30T22:28:18.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.383+0000 7f0e2f1cd700 1 -- start start 2023-09-30T22:28:18.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.384+0000 7f0e2f1cd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e2809bc50 0x7f0e2811aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.384+0000 7f0e2f1cd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e2809c7d0 0x7f0e2811afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.384+0000 7f0e2f1cd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0e28131d50 0x7f0e2811b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.384+0000 7f0e2f1cd700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2811c5b0 con 0x7f0e2809c7d0 2023-09-30T22:28:18.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.384+0000 7f0e2f1cd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2811be90 con 0x7f0e2809bc50 2023-09-30T22:28:18.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.384+0000 7f0e2f1cd700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2809ea60 con 0x7f0e28131d50 2023-09-30T22:28:18.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.384+0000 7f0e2cf69700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e2809bc50 0x7f0e2811aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.384+0000 7f0e2d76a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0e28131d50 0x7f0e2811b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.384+0000 7f0e2cf69700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e2809bc50 0x7f0e2811aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60358/0 (socket says 172.21.15.40:60358) 2023-09-30T22:28:18.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.384+0000 7f0e2cf69700 1 -- 172.21.15.40:0/1975009121 learned_addr learned my addr 172.21.15.40:0/1975009121 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:18.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.384+0000 7f0e27fff700 1 --2- 172.21.15.40:0/1975009121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e2809c7d0 0x7f0e2811afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.384+0000 7f0e2d76a700 1 -- 172.21.15.40:0/1975009121 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e2809bc50 msgr2=0x7f0e2811aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:18.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.384+0000 7f0e2d76a700 1 --2- 172.21.15.40:0/1975009121 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e2809bc50 0x7f0e2811aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.384+0000 7f0e2d76a700 1 -- 172.21.15.40:0/1975009121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e2809c7d0 msgr2=0x7f0e2811afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:18.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.384+0000 7f0e2d76a700 1 --2- 172.21.15.40:0/1975009121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e2809c7d0 0x7f0e2811afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.384+0000 7f0e2d76a700 1 -- 172.21.15.40:0/1975009121 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e1c0094a0 con 0x7f0e28131d50 2023-09-30T22:28:18.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.384+0000 7f0e2d76a700 1 --2- 172.21.15.40:0/1975009121 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0e28131d50 0x7f0e2811b4f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f0e20015000 tx=0x7f0e20004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:18.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.384+0000 7f0e257fa700 1 -- 172.21.15.40:0/1975009121 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e200099b0 con 0x7f0e28131d50 2023-09-30T22:28:18.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.384+0000 7f0e257fa700 1 -- 172.21.15.40:0/1975009121 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e200092e0 con 0x7f0e28131d50 2023-09-30T22:28:18.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.384+0000 7f0e2f1cd700 1 -- 172.21.15.40:0/1975009121 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e20009b30 con 0x7f0e28131d50 2023-09-30T22:28:18.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.384+0000 7f0e257fa700 1 -- 172.21.15.40:0/1975009121 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e20004450 con 0x7f0e28131d50 2023-09-30T22:28:18.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.384+0000 7f0e2f1cd700 1 -- 172.21.15.40:0/1975009121 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e280a0e40 con 0x7f0e28131d50 2023-09-30T22:28:18.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.385+0000 7f0e257fa700 1 -- 172.21.15.40:0/1975009121 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0e200045b0 con 0x7f0e28131d50 2023-09-30T22:28:18.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.385+0000 7f0e257fa700 1 -- 172.21.15.40:0/1975009121 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f0e20040ac0 con 0x7f0e28131d50 2023-09-30T22:28:18.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.385+0000 7f0e2f1cd700 1 -- 172.21.15.40:0/1975009121 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e28062380 con 0x7f0e28131d50 2023-09-30T22:28:18.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.390+0000 7f0e257fa700 1 -- 172.21.15.40:0/1975009121 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0e20020070 con 0x7f0e28131d50 2023-09-30T22:28:18.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.584+0000 7f0e2f1cd700 1 -- 172.21.15.40:0/1975009121 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0e2811d800 con 0x7f0e28131d50 2023-09-30T22:28:18.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.584+0000 7f0e257fa700 1 -- 172.21.15.40:0/1975009121 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0e20020030 con 0x7f0e28131d50 2023-09-30T22:28:18.585 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:18.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.586+0000 7f0e2f1cd700 1 -- 172.21.15.40:0/1975009121 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0e28131d50 msgr2=0x7f0e2811b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:18.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.586+0000 7f0e2f1cd700 1 --2- 172.21.15.40:0/1975009121 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0e28131d50 0x7f0e2811b4f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f0e20015000 tx=0x7f0e20004ad0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.586+0000 7f0e2f1cd700 1 -- 172.21.15.40:0/1975009121 shutdown_connections 2023-09-30T22:28:18.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.586+0000 7f0e2f1cd700 1 --2- 172.21.15.40:0/1975009121 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0e28131d50 0x7f0e2811b4f0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.586+0000 7f0e2f1cd700 1 --2- 172.21.15.40:0/1975009121 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e2809bc50 0x7f0e2811aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.586+0000 7f0e2f1cd700 1 --2- 172.21.15.40:0/1975009121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e2809c7d0 0x7f0e2811afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.586+0000 7f0e2f1cd700 1 -- 172.21.15.40:0/1975009121 >> 172.21.15.40:0/1975009121 conn(0x7f0e280a2a00 msgr2=0x7f0e281b7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:18.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.586+0000 7f0e2f1cd700 1 -- 172.21.15.40:0/1975009121 shutdown_connections 2023-09-30T22:28:18.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.586+0000 7f0e2f1cd700 1 -- 172.21.15.40:0/1975009121 wait complete. 2023-09-30T22:28:18.599 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:18.638 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:18.703 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:18.734 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:18.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.766+0000 7efcd1931700 1 Processor -- start 2023-09-30T22:28:18.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.766+0000 7efcd1931700 1 -- start start 2023-09-30T22:28:18.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.767+0000 7efcd1931700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efccc09d920 0x7efccc09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.767+0000 7efcd1931700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efccc09e230 0x7efccc1308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.767+0000 7efcd1931700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efccc130de0 0x7efccc131260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.767+0000 7efcd1931700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efccc09edf0 con 0x7efccc09e230 2023-09-30T22:28:18.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.767+0000 7efcd1931700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efccc09adf0 con 0x7efccc130de0 2023-09-30T22:28:18.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.767+0000 7efcd1931700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efccc09b660 con 0x7efccc09d920 2023-09-30T22:28:18.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.767+0000 7efccaffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efccc09d920 0x7efccc09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.767+0000 7efcca7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efccc09e230 0x7efccc1308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.767+0000 7efccaffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efccc09d920 0x7efccc09dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41034/0 (socket says 172.21.15.40:41034) 2023-09-30T22:28:18.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.767+0000 7efcca7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efccc09e230 0x7efccc1308a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41326/0 (socket says 172.21.15.40:41326) 2023-09-30T22:28:18.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.767+0000 7efccaffd700 1 -- 172.21.15.40:0/2897346323 learned_addr learned my addr 172.21.15.40:0/2897346323 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:18.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.767+0000 7efccb7fe700 1 --2- 172.21.15.40:0/2897346323 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efccc130de0 0x7efccc131260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.767+0000 7efccb7fe700 1 -- 172.21.15.40:0/2897346323 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efccc09d920 msgr2=0x7efccc09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:18.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.767+0000 7efccb7fe700 1 --2- 172.21.15.40:0/2897346323 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efccc09d920 0x7efccc09dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.767+0000 7efccb7fe700 1 -- 172.21.15.40:0/2897346323 >> v2:172.21.15.40:3300/0 conn(0x7efccc09e230 msgr2=0x7efccc1308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:18.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.767+0000 7efccb7fe700 1 --2- 172.21.15.40:0/2897346323 >> v2:172.21.15.40:3300/0 conn(0x7efccc09e230 0x7efccc1308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.767+0000 7efccb7fe700 1 -- 172.21.15.40:0/2897346323 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efccc09a6e0 con 0x7efccc130de0 2023-09-30T22:28:18.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.767+0000 7efcca7fc700 1 --2- 172.21.15.40:0/2897346323 >> v2:172.21.15.40:3300/0 conn(0x7efccc09e230 0x7efccc1308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:18.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.768+0000 7efccb7fe700 1 --2- 172.21.15.40:0/2897346323 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efccc130de0 0x7efccc131260 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7efcc4009d90 tx=0x7efcc400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=670e30738ce6cdd7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:18.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.768+0000 7efcc9ffb700 1 -- 172.21.15.40:0/2897346323 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc400e070 con 0x7efccc130de0 2023-09-30T22:28:18.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.768+0000 7efcc9ffb700 1 -- 172.21.15.40:0/2897346323 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc400bb20 con 0x7efccc130de0 2023-09-30T22:28:18.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.768+0000 7efcc9ffb700 1 -- 172.21.15.40:0/2897346323 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc4012430 con 0x7efccc130de0 2023-09-30T22:28:18.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.768+0000 7efcd1931700 1 -- 172.21.15.40:0/2897346323 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efccc130de0 msgr2=0x7efccc131260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:18.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.768+0000 7efcd1931700 1 --2- 172.21.15.40:0/2897346323 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efccc130de0 0x7efccc131260 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7efcc4009d90 tx=0x7efcc400b330 comp rx=0 tx=0).stop 2023-09-30T22:28:18.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.768+0000 7efcd1931700 1 -- 172.21.15.40:0/2897346323 shutdown_connections 2023-09-30T22:28:18.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.768+0000 7efcd1931700 1 --2- 172.21.15.40:0/2897346323 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efccc09d920 0x7efccc09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.768+0000 7efcd1931700 1 --2- 172.21.15.40:0/2897346323 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efccc130de0 0x7efccc131260 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.768+0000 7efcd1931700 1 --2- 172.21.15.40:0/2897346323 >> v2:172.21.15.40:3300/0 conn(0x7efccc09e230 0x7efccc1308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.768+0000 7efcd1931700 1 -- 172.21.15.40:0/2897346323 >> 172.21.15.40:0/2897346323 conn(0x7efccc09fb20 msgr2=0x7efccc09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:18.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.769+0000 7efcd1931700 1 -- 172.21.15.40:0/2897346323 shutdown_connections 2023-09-30T22:28:18.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.769+0000 7efcd1931700 1 -- 172.21.15.40:0/2897346323 wait complete. 2023-09-30T22:28:18.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.769+0000 7efcd1931700 1 Processor -- start 2023-09-30T22:28:18.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.770+0000 7efcd1931700 1 -- start start 2023-09-30T22:28:18.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.770+0000 7efcd1931700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efccc09d920 0x7efccc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.770+0000 7efcd1931700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efccc09e230 0x7efccc06f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.770+0000 7efcd1931700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efccc130de0 0x7efccc06f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.770+0000 7efcd1931700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efccc070b70 con 0x7efccc09e230 2023-09-30T22:28:18.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.770+0000 7efcd1931700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efccc121640 con 0x7efccc09d920 2023-09-30T22:28:18.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.770+0000 7efcd1931700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efccc0703c0 con 0x7efccc130de0 2023-09-30T22:28:18.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.770+0000 7efccaffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efccc09d920 0x7efccc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.770+0000 7efccaffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efccc09d920 0x7efccc06ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60378/0 (socket says 172.21.15.40:60378) 2023-09-30T22:28:18.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.770+0000 7efccaffd700 1 -- 172.21.15.40:0/3720976744 learned_addr learned my addr 172.21.15.40:0/3720976744 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:18.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.770+0000 7efccb7fe700 1 --2- 172.21.15.40:0/3720976744 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efccc130de0 0x7efccc06f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.770+0000 7efcca7fc700 1 --2- 172.21.15.40:0/3720976744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efccc09e230 0x7efccc06f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.771+0000 7efccaffd700 1 -- 172.21.15.40:0/3720976744 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efccc130de0 msgr2=0x7efccc06f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:18.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.771+0000 7efccaffd700 1 --2- 172.21.15.40:0/3720976744 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efccc130de0 0x7efccc06f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.771+0000 7efccaffd700 1 -- 172.21.15.40:0/3720976744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efccc09e230 msgr2=0x7efccc06f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:18.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.771+0000 7efccaffd700 1 --2- 172.21.15.40:0/3720976744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efccc09e230 0x7efccc06f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.771+0000 7efccaffd700 1 -- 172.21.15.40:0/3720976744 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc00094a0 con 0x7efccc09d920 2023-09-30T22:28:18.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.771+0000 7efccaffd700 1 --2- 172.21.15.40:0/3720976744 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efccc09d920 0x7efccc06ef60 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00e870 tx=0x7efcbc00eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:18.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.771+0000 7efcb3fff700 1 -- 172.21.15.40:0/3720976744 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcbc013680 con 0x7efccc09d920 2023-09-30T22:28:18.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.771+0000 7efcb3fff700 1 -- 172.21.15.40:0/3720976744 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcbc0137e0 con 0x7efccc09d920 2023-09-30T22:28:18.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.771+0000 7efcd1931700 1 -- 172.21.15.40:0/3720976744 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcc4009a70 con 0x7efccc09d920 2023-09-30T22:28:18.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.771+0000 7efcb3fff700 1 -- 172.21.15.40:0/3720976744 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcbc013b50 con 0x7efccc09d920 2023-09-30T22:28:18.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.771+0000 7efcd1931700 1 -- 172.21.15.40:0/3720976744 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efccc121370 con 0x7efccc09d920 2023-09-30T22:28:18.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.772+0000 7efcb3fff700 1 -- 172.21.15.40:0/3720976744 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efcbc013cb0 con 0x7efccc09d920 2023-09-30T22:28:18.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.772+0000 7efcd1931700 1 -- 172.21.15.40:0/3720976744 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efccc12f890 con 0x7efccc09d920 2023-09-30T22:28:18.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.773+0000 7efcb3fff700 1 -- 172.21.15.40:0/3720976744 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7efcbc03f970 con 0x7efccc09d920 2023-09-30T22:28:18.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.778+0000 7efcb3fff700 1 -- 172.21.15.40:0/3720976744 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efcbc01abe0 con 0x7efccc09d920 2023-09-30T22:28:18.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.854+0000 7fd22cdc0700 1 Processor -- start 2023-09-30T22:28:18.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.854+0000 7fd22cdc0700 1 -- start start 2023-09-30T22:28:18.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.855+0000 7fd22cdc0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd228136bf0 0x7fd228138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.855+0000 7fd22cdc0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd228139510 0x7fd22813b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.855+0000 7fd22cdc0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2280a2600 con 0x7fd22809c890 2023-09-30T22:28:18.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.855+0000 7fd22cdc0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2280a29d0 con 0x7fd228136bf0 2023-09-30T22:28:18.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.855+0000 7fd22cdc0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd22809fb40 con 0x7fd228139510 2023-09-30T22:28:18.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.855+0000 7fd226d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd228139510 0x7fd22813b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.855+0000 7fd226d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd228139510 0x7fd22813b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41048/0 (socket says 172.21.15.40:41048) 2023-09-30T22:28:18.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.855+0000 7fd22659c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd22809c890 0x7fd22809cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39568/0 (socket says 172.21.15.40:39568) 2023-09-30T22:28:18.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.855+0000 7fd226d9d700 1 -- 172.21.15.40:0/753753166 learned_addr learned my addr 172.21.15.40:0/753753166 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:18.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.855+0000 7fd225d9b700 1 --2- 172.21.15.40:0/753753166 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd228136bf0 0x7fd228138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.855+0000 7fd225d9b700 1 -- 172.21.15.40:0/753753166 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd228139510 msgr2=0x7fd22813b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:18.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.855+0000 7fd225d9b700 1 --2- 172.21.15.40:0/753753166 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd228139510 0x7fd22813b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.855+0000 7fd225d9b700 1 -- 172.21.15.40:0/753753166 >> v1:172.21.15.40:6789/0 conn(0x7fd22809c890 legacy=0x7fd22809cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:18.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.855+0000 7fd22559a700 1 -- 172.21.15.40:0/753753166 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2588302930 0 0) 0x7fd2280a2600 con 0x7fd22809c890 2023-09-30T22:28:18.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.855+0000 7fd225d9b700 1 -- 172.21.15.40:0/753753166 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22809d370 con 0x7fd228136bf0 2023-09-30T22:28:18.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.855+0000 7fd226d9d700 1 --2- 172.21.15.40:0/753753166 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd228139510 0x7fd22813b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:18.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.856+0000 7fd225d9b700 1 --2- 172.21.15.40:0/753753166 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd228136bf0 0x7fd228138fd0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009870 tx=0x7fd21c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=877bb1537581d68 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:18.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.856+0000 7fd22559a700 1 -- 172.21.15.40:0/753753166 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c011830 con 0x7fd228136bf0 2023-09-30T22:28:18.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.856+0000 7fd22559a700 1 -- 172.21.15.40:0/753753166 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21c011990 con 0x7fd228136bf0 2023-09-30T22:28:18.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.856+0000 7fd22559a700 1 -- 172.21.15.40:0/753753166 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c011d20 con 0x7fd228136bf0 2023-09-30T22:28:18.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.857+0000 7fd22cdc0700 1 -- 172.21.15.40:0/753753166 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd228136bf0 msgr2=0x7fd228138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:18.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.857+0000 7fd22cdc0700 1 --2- 172.21.15.40:0/753753166 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd228136bf0 0x7fd228138fd0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009870 tx=0x7fd21c009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:18.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.857+0000 7fd22cdc0700 1 -- 172.21.15.40:0/753753166 shutdown_connections 2023-09-30T22:28:18.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.857+0000 7fd22cdc0700 1 --2- 172.21.15.40:0/753753166 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd228139510 0x7fd22813b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.857+0000 7fd22cdc0700 1 --2- 172.21.15.40:0/753753166 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd228136bf0 0x7fd228138fd0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.857+0000 7fd22cdc0700 1 -- 172.21.15.40:0/753753166 >> 172.21.15.40:0/753753166 conn(0x7fd2280a7080 msgr2=0x7fd2280a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:18.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.857+0000 7fd22cdc0700 1 -- 172.21.15.40:0/753753166 shutdown_connections 2023-09-30T22:28:18.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.857+0000 7fd22cdc0700 1 -- 172.21.15.40:0/753753166 wait complete. 2023-09-30T22:28:18.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.858+0000 7fd22cdc0700 1 Processor -- start 2023-09-30T22:28:18.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.858+0000 7fd22cdc0700 1 -- start start 2023-09-30T22:28:18.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.858+0000 7fd22cdc0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd22809c890 0x7fd22809b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.858+0000 7fd22cdc0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd228136bf0 0x7fd22809bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.858+0000 7fd22cdc0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd228139510 0x7fd22806f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.858+0000 7fd22cdc0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd228139100 con 0x7fd228136bf0 2023-09-30T22:28:18.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.858+0000 7fd22cdc0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd228070d50 con 0x7fd228139510 2023-09-30T22:28:18.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.858+0000 7fd22cdc0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd22809ecf0 con 0x7fd22809c890 2023-09-30T22:28:18.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.859+0000 7fd22659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd22809c890 0x7fd22809b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.859+0000 7fd22659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd22809c890 0x7fd22809b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41050/0 (socket says 172.21.15.40:41050) 2023-09-30T22:28:18.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.859+0000 7fd225d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd228136bf0 0x7fd22809bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.859+0000 7fd22659c700 1 -- 172.21.15.40:0/1158133263 learned_addr learned my addr 172.21.15.40:0/1158133263 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:18.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.859+0000 7fd226d9d700 1 --2- 172.21.15.40:0/1158133263 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd228139510 0x7fd22806f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.859+0000 7fd225d9b700 1 -- 172.21.15.40:0/1158133263 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd22809c890 msgr2=0x7fd22809b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:18.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.859+0000 7fd225d9b700 1 --2- 172.21.15.40:0/1158133263 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd22809c890 0x7fd22809b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.859+0000 7fd225d9b700 1 -- 172.21.15.40:0/1158133263 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd228139510 msgr2=0x7fd22806f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:18.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.859+0000 7fd225d9b700 1 --2- 172.21.15.40:0/1158133263 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd228139510 0x7fd22806f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.859+0000 7fd225d9b700 1 -- 172.21.15.40:0/1158133263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd220009b30 con 0x7fd228136bf0 2023-09-30T22:28:18.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.859+0000 7fd22659c700 1 --2- 172.21.15.40:0/1158133263 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd22809c890 0x7fd22809b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:18.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.859+0000 7fd226d9d700 1 --2- 172.21.15.40:0/1158133263 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd228139510 0x7fd22806f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:18.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.859+0000 7fd225d9b700 1 --2- 172.21.15.40:0/1158133263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd228136bf0 0x7fd22809bd30 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fd21c016000 tx=0x7fd21c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:18.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.859+0000 7fd216ffd700 1 -- 172.21.15.40:0/1158133263 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c0036a0 con 0x7fd228136bf0 2023-09-30T22:28:18.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.859+0000 7fd216ffd700 1 -- 172.21.15.40:0/1158133263 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21c01e070 con 0x7fd228136bf0 2023-09-30T22:28:18.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.859+0000 7fd22cdc0700 1 -- 172.21.15.40:0/1158133263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd21c0094a0 con 0x7fd228136bf0 2023-09-30T22:28:18.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.859+0000 7fd216ffd700 1 -- 172.21.15.40:0/1158133263 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c003a20 con 0x7fd228136bf0 2023-09-30T22:28:18.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.859+0000 7fd22cdc0700 1 -- 172.21.15.40:0/1158133263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd22812c810 con 0x7fd228136bf0 2023-09-30T22:28:18.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.860+0000 7fd216ffd700 1 -- 172.21.15.40:0/1158133263 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd21c003b80 con 0x7fd228136bf0 2023-09-30T22:28:18.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.860+0000 7fd216ffd700 1 -- 172.21.15.40:0/1158133263 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd21c020070 con 0x7fd228136bf0 2023-09-30T22:28:18.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.861+0000 7fd22cdc0700 1 -- 172.21.15.40:0/1158133263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd228062380 con 0x7fd228136bf0 2023-09-30T22:28:18.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.866+0000 7fd216ffd700 1 -- 172.21.15.40:0/1158133263 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd21c015080 con 0x7fd228136bf0 2023-09-30T22:28:18.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.878+0000 7f1a4da4e700 1 Processor -- start 2023-09-30T22:28:18.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.878+0000 7f1a4da4e700 1 -- start start 2023-09-30T22:28:18.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.878+0000 7f1a4da4e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1a48134a90 0x7f1a48136e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.878+0000 7f1a4da4e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a481373b0 0x7f1a48139790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.878+0000 7f1a4da4e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a48131900 con 0x7f1a48131d50 2023-09-30T22:28:18.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.878+0000 7f1a4da4e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a480719e0 con 0x7f1a48134a90 2023-09-30T22:28:18.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.878+0000 7f1a4da4e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4809e820 con 0x7f1a481373b0 2023-09-30T22:28:18.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.879+0000 7f1a467fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1a48134a90 0x7f1a48136e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.879+0000 7f1a477fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a481373b0 0x7f1a48139790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.879+0000 7f1a467fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1a48134a90 0x7f1a48136e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41338/0 (socket says 172.21.15.40:41338) 2023-09-30T22:28:18.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.879+0000 7f1a467fc700 1 -- 172.21.15.40:0/758651983 learned_addr learned my addr 172.21.15.40:0/758651983 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:18.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.879+0000 7f1a477fe700 1 -- 172.21.15.40:0/758651983 >> v2:172.21.15.40:3300/0 conn(0x7f1a48134a90 msgr2=0x7f1a48136e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:18.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.879+0000 7f1a477fe700 1 --2- 172.21.15.40:0/758651983 >> v2:172.21.15.40:3300/0 conn(0x7f1a48134a90 0x7f1a48136e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.879+0000 7f1a477fe700 1 -- 172.21.15.40:0/758651983 >> v1:172.21.15.40:6789/0 conn(0x7f1a48131d50 legacy=0x7f1a48132120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:18.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.879+0000 7f1a477fe700 1 -- 172.21.15.40:0/758651983 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4809ef60 con 0x7f1a481373b0 2023-09-30T22:28:18.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.879+0000 7f1a467fc700 1 --2- 172.21.15.40:0/758651983 >> v2:172.21.15.40:3300/0 conn(0x7f1a48134a90 0x7f1a48136e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:18.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.879+0000 7f1a477fe700 1 --2- 172.21.15.40:0/758651983 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a481373b0 0x7f1a48139790 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f1a40009d90 tx=0x7f1a4000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65c31f814387ceea server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:18.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.879+0000 7f1a45ffb700 1 -- 172.21.15.40:0/758651983 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4000e070 con 0x7f1a481373b0 2023-09-30T22:28:18.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.879+0000 7f1a45ffb700 1 -- 172.21.15.40:0/758651983 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4000bb20 con 0x7f1a481373b0 2023-09-30T22:28:18.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.879+0000 7f1a45ffb700 1 -- 172.21.15.40:0/758651983 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a40012430 con 0x7f1a481373b0 2023-09-30T22:28:18.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.880+0000 7f1a4da4e700 1 -- 172.21.15.40:0/758651983 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a481373b0 msgr2=0x7f1a48139790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:18.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.880+0000 7f1a4da4e700 1 --2- 172.21.15.40:0/758651983 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a481373b0 0x7f1a48139790 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f1a40009d90 tx=0x7f1a4000b330 comp rx=0 tx=0).stop 2023-09-30T22:28:18.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.880+0000 7f1a4da4e700 1 -- 172.21.15.40:0/758651983 shutdown_connections 2023-09-30T22:28:18.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.880+0000 7f1a4da4e700 1 --2- 172.21.15.40:0/758651983 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a481373b0 0x7f1a48139790 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.880+0000 7f1a4da4e700 1 --2- 172.21.15.40:0/758651983 >> v2:172.21.15.40:3300/0 conn(0x7f1a48134a90 0x7f1a48136e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.880+0000 7f1a4da4e700 1 -- 172.21.15.40:0/758651983 >> 172.21.15.40:0/758651983 conn(0x7f1a480a2a00 msgr2=0x7f1a480a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:18.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.880+0000 7f1a4da4e700 1 -- 172.21.15.40:0/758651983 shutdown_connections 2023-09-30T22:28:18.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.880+0000 7f1a4da4e700 1 -- 172.21.15.40:0/758651983 wait complete. 2023-09-30T22:28:18.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.881+0000 7f1a4da4e700 1 Processor -- start 2023-09-30T22:28:18.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.881+0000 7f1a4da4e700 1 -- start start 2023-09-30T22:28:18.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.882+0000 7f1a4da4e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a48131d50 0x7f1a4809a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.882+0000 7f1a4da4e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1a48134a90 0x7f1a4809a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.882+0000 7f1a4da4e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a481373b0 0x7f1a481c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.882+0000 7f1a4da4e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a481370d0 con 0x7f1a48131d50 2023-09-30T22:28:18.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.882+0000 7f1a4da4e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4809ea60 con 0x7f1a481373b0 2023-09-30T22:28:18.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.882+0000 7f1a4da4e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4809ad80 con 0x7f1a48134a90 2023-09-30T22:28:18.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.882+0000 7f1a46ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a48131d50 0x7f1a4809a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.882+0000 7f1a477fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a481373b0 0x7f1a481c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.882+0000 7f1a46ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a48131d50 0x7f1a4809a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41344/0 (socket says 172.21.15.40:41344) 2023-09-30T22:28:18.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.882+0000 7f1a46ffd700 1 -- 172.21.15.40:0/4000983389 learned_addr learned my addr 172.21.15.40:0/4000983389 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:18.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.882+0000 7f1a467fc700 1 --2- 172.21.15.40:0/4000983389 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1a48134a90 0x7f1a4809a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.882+0000 7f1a46ffd700 1 -- 172.21.15.40:0/4000983389 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1a48134a90 msgr2=0x7f1a4809a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:18.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.882+0000 7f1a46ffd700 1 --2- 172.21.15.40:0/4000983389 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1a48134a90 0x7f1a4809a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.882+0000 7f1a46ffd700 1 -- 172.21.15.40:0/4000983389 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a481373b0 msgr2=0x7f1a481c85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:18.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.882+0000 7f1a46ffd700 1 --2- 172.21.15.40:0/4000983389 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a481373b0 0x7f1a481c85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.882+0000 7f1a46ffd700 1 -- 172.21.15.40:0/4000983389 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a3c009550 con 0x7f1a48131d50 2023-09-30T22:28:18.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.882+0000 7f1a477fe700 1 --2- 172.21.15.40:0/4000983389 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a481373b0 0x7f1a481c85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:18.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.883+0000 7f1a46ffd700 1 --2- 172.21.15.40:0/4000983389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a48131d50 0x7f1a4809a300 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f1a3800c450 tx=0x7f1a3800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:18.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.883+0000 7f1a2ffff700 1 -- 172.21.15.40:0/4000983389 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a380052d0 con 0x7f1a48131d50 2023-09-30T22:28:18.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.883+0000 7f1a2ffff700 1 -- 172.21.15.40:0/4000983389 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a38005430 con 0x7f1a48131d50 2023-09-30T22:28:18.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.883+0000 7f1a4da4e700 1 -- 172.21.15.40:0/4000983389 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a40009a70 con 0x7f1a48131d50 2023-09-30T22:28:18.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.883+0000 7f1a2ffff700 1 -- 172.21.15.40:0/4000983389 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a380038c0 con 0x7f1a48131d50 2023-09-30T22:28:18.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.883+0000 7f1a4da4e700 1 -- 172.21.15.40:0/4000983389 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a4811e9c0 con 0x7f1a48131d50 2023-09-30T22:28:18.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.884+0000 7f1a4da4e700 1 -- 172.21.15.40:0/4000983389 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a48062380 con 0x7f1a48131d50 2023-09-30T22:28:18.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.884+0000 7f1a2ffff700 1 -- 172.21.15.40:0/4000983389 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1a38003a20 con 0x7f1a48131d50 2023-09-30T22:28:18.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.884+0000 7f1a2ffff700 1 -- 172.21.15.40:0/4000983389 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f1a3803ee60 con 0x7f1a48131d50 2023-09-30T22:28:18.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:18.893+0000 7f1a2ffff700 1 -- 172.21.15.40:0/4000983389 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1a38011590 con 0x7f1a48131d50 2023-09-30T22:28:19.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.008+0000 7efcd1931700 1 -- 172.21.15.40:0/3720976744 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efccc09cb00 con 0x7efccc09d920 2023-09-30T22:28:19.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.008+0000 7efcb3fff700 1 -- 172.21.15.40:0/3720976744 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efcbc017030 con 0x7efccc09d920 2023-09-30T22:28:19.009 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:19.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.011+0000 7efcd1931700 1 -- 172.21.15.40:0/3720976744 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efccc09d920 msgr2=0x7efccc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:19.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.011+0000 7efcd1931700 1 --2- 172.21.15.40:0/3720976744 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efccc09d920 0x7efccc06ef60 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00e870 tx=0x7efcbc00eb80 comp rx=0 tx=0).stop 2023-09-30T22:28:19.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.011+0000 7efcd1931700 1 -- 172.21.15.40:0/3720976744 shutdown_connections 2023-09-30T22:28:19.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.011+0000 7efcd1931700 1 --2- 172.21.15.40:0/3720976744 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efccc130de0 0x7efccc06f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.011+0000 7efcd1931700 1 --2- 172.21.15.40:0/3720976744 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efccc09d920 0x7efccc06ef60 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.011+0000 7efcd1931700 1 --2- 172.21.15.40:0/3720976744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efccc09e230 0x7efccc06f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.011+0000 7efcd1931700 1 -- 172.21.15.40:0/3720976744 >> 172.21.15.40:0/3720976744 conn(0x7efccc09fb20 msgr2=0x7efccc12eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:19.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.011+0000 7efcd1931700 1 -- 172.21.15.40:0/3720976744 shutdown_connections 2023-09-30T22:28:19.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.011+0000 7efcd1931700 1 -- 172.21.15.40:0/3720976744 wait complete. 2023-09-30T22:28:19.024 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:19.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.066+0000 7fd22cdc0700 1 -- 172.21.15.40:0/1158133263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd228074620 con 0x7fd228136bf0 2023-09-30T22:28:19.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.066+0000 7fd216ffd700 1 -- 172.21.15.40:0/1158133263 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd21c0243e0 con 0x7fd228136bf0 2023-09-30T22:28:19.067 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:19.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.068+0000 7fd22cdc0700 1 -- 172.21.15.40:0/1158133263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd228136bf0 msgr2=0x7fd22809bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:19.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.068+0000 7fd22cdc0700 1 --2- 172.21.15.40:0/1158133263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd228136bf0 0x7fd22809bd30 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fd21c016000 tx=0x7fd21c004750 comp rx=0 tx=0).stop 2023-09-30T22:28:19.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.068+0000 7fd22cdc0700 1 -- 172.21.15.40:0/1158133263 shutdown_connections 2023-09-30T22:28:19.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.068+0000 7fd22cdc0700 1 --2- 172.21.15.40:0/1158133263 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd22809c890 0x7fd22809b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.068+0000 7fd22cdc0700 1 --2- 172.21.15.40:0/1158133263 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd228139510 0x7fd22806f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.068+0000 7fd22cdc0700 1 --2- 172.21.15.40:0/1158133263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd228136bf0 0x7fd22809bd30 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.068+0000 7fd22cdc0700 1 -- 172.21.15.40:0/1158133263 >> 172.21.15.40:0/1158133263 conn(0x7fd2280a7080 msgr2=0x7fd228136fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:19.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.069+0000 7fd22cdc0700 1 -- 172.21.15.40:0/1158133263 shutdown_connections 2023-09-30T22:28:19.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.069+0000 7fd22cdc0700 1 -- 172.21.15.40:0/1158133263 wait complete. 2023-09-30T22:28:19.081 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:19.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.091+0000 7f1a4da4e700 1 -- 172.21.15.40:0/4000983389 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1a48099f20 con 0x7f1a48131d50 2023-09-30T22:28:19.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.091+0000 7f1a2ffff700 1 -- 172.21.15.40:0/4000983389 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1a38017030 con 0x7f1a48131d50 2023-09-30T22:28:19.092 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:19.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.093+0000 7f1a4da4e700 1 -- 172.21.15.40:0/4000983389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a48131d50 msgr2=0x7f1a4809a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:19.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.093+0000 7f1a4da4e700 1 --2- 172.21.15.40:0/4000983389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a48131d50 0x7f1a4809a300 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f1a3800c450 tx=0x7f1a3800c760 comp rx=0 tx=0).stop 2023-09-30T22:28:19.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.093+0000 7f1a4da4e700 1 -- 172.21.15.40:0/4000983389 shutdown_connections 2023-09-30T22:28:19.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.093+0000 7f1a4da4e700 1 --2- 172.21.15.40:0/4000983389 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a481373b0 0x7f1a481c85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.093+0000 7f1a4da4e700 1 --2- 172.21.15.40:0/4000983389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a48131d50 0x7f1a4809a300 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.093+0000 7f1a4da4e700 1 --2- 172.21.15.40:0/4000983389 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1a48134a90 0x7f1a4809a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.093+0000 7f1a4da4e700 1 -- 172.21.15.40:0/4000983389 >> 172.21.15.40:0/4000983389 conn(0x7f1a480a2a00 msgr2=0x7f1a48134e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:19.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.093+0000 7f1a4da4e700 1 -- 172.21.15.40:0/4000983389 shutdown_connections 2023-09-30T22:28:19.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.093+0000 7f1a4da4e700 1 -- 172.21.15.40:0/4000983389 wait complete. 2023-09-30T22:28:19.106 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:19.600 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:19.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.737+0000 7f6f8d0aa700 1 Processor -- start 2023-09-30T22:28:19.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.737+0000 7f6f8d0aa700 1 -- start start 2023-09-30T22:28:19.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.738+0000 7f6f8d0aa700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6f8809d450 0x7f6f8809d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:19.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.738+0000 7f6f8d0aa700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6f8809dd60 0x7f6f881301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:19.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.738+0000 7f6f8d0aa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f88130700 0x7f6f88130b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:19.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.738+0000 7f6f8d0aa700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f8809e8b0 con 0x7f6f8809d450 2023-09-30T22:28:19.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.738+0000 7f6f8d0aa700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8809c3b0 con 0x7f6f88130700 2023-09-30T22:28:19.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.738+0000 7f6f8d0aa700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8809a6b0 con 0x7f6f8809dd60 2023-09-30T22:28:19.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.738+0000 7f6f8659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6f8809dd60 0x7f6f881301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:19.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.738+0000 7f6f86d9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6f8809d450 0x7f6f8809d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:19.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.738+0000 7f6f8759e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f88130700 0x7f6f88130b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:19.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.738+0000 7f6f86d9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6f8809d450 0x7f6f8809d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41346/0 (socket says 172.21.15.40:41346) 2023-09-30T22:28:19.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.738+0000 7f6f8659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6f8809dd60 0x7f6f881301c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41070/0 (socket says 172.21.15.40:41070) 2023-09-30T22:28:19.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.738+0000 7f6f86d9d700 1 -- 172.21.15.40:0/3958740911 learned_addr learned my addr 172.21.15.40:0/3958740911 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:19.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.738+0000 7f6f8759e700 1 -- 172.21.15.40:0/3958740911 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6f8809dd60 msgr2=0x7f6f881301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:19.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.738+0000 7f6f8759e700 1 --2- 172.21.15.40:0/3958740911 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6f8809dd60 0x7f6f881301c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.738+0000 7f6f8759e700 1 -- 172.21.15.40:0/3958740911 >> v2:172.21.15.40:3300/0 conn(0x7f6f8809d450 msgr2=0x7f6f8809d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:19.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.738+0000 7f6f8759e700 1 --2- 172.21.15.40:0/3958740911 >> v2:172.21.15.40:3300/0 conn(0x7f6f8809d450 0x7f6f8809d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.738+0000 7f6f8759e700 1 -- 172.21.15.40:0/3958740911 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f8809b4f0 con 0x7f6f88130700 2023-09-30T22:28:19.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.738+0000 7f6f86d9d700 1 --2- 172.21.15.40:0/3958740911 >> v2:172.21.15.40:3300/0 conn(0x7f6f8809d450 0x7f6f8809d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:19.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.738+0000 7f6f8659c700 1 --2- 172.21.15.40:0/3958740911 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6f8809dd60 0x7f6f881301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:19.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.738+0000 7f6f8759e700 1 --2- 172.21.15.40:0/3958740911 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f88130700 0x7f6f88130b80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000aea0 tx=0x7f6f8000c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7384f6946edc0b8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:19.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.739+0000 7f6f85d9b700 1 -- 172.21.15.40:0/3958740911 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8000f070 con 0x7f6f88130700 2023-09-30T22:28:19.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.739+0000 7f6f85d9b700 1 -- 172.21.15.40:0/3958740911 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8000a2e0 con 0x7f6f88130700 2023-09-30T22:28:19.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.739+0000 7f6f85d9b700 1 -- 172.21.15.40:0/3958740911 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8000cb50 con 0x7f6f88130700 2023-09-30T22:28:19.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.739+0000 7f6f8d0aa700 1 -- 172.21.15.40:0/3958740911 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f88130700 msgr2=0x7f6f88130b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:19.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.739+0000 7f6f8d0aa700 1 --2- 172.21.15.40:0/3958740911 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f88130700 0x7f6f88130b80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000aea0 tx=0x7f6f8000c330 comp rx=0 tx=0).stop 2023-09-30T22:28:19.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.739+0000 7f6f8d0aa700 1 -- 172.21.15.40:0/3958740911 shutdown_connections 2023-09-30T22:28:19.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.739+0000 7f6f8d0aa700 1 --2- 172.21.15.40:0/3958740911 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f88130700 0x7f6f88130b80 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.739+0000 7f6f8d0aa700 1 --2- 172.21.15.40:0/3958740911 >> v2:172.21.15.40:3300/0 conn(0x7f6f8809d450 0x7f6f8809d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.739+0000 7f6f8d0aa700 1 --2- 172.21.15.40:0/3958740911 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6f8809dd60 0x7f6f881301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.739+0000 7f6f8d0aa700 1 -- 172.21.15.40:0/3958740911 >> 172.21.15.40:0/3958740911 conn(0x7f6f880a2a00 msgr2=0x7f6f880a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:19.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.739+0000 7f6f8d0aa700 1 -- 172.21.15.40:0/3958740911 shutdown_connections 2023-09-30T22:28:19.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.739+0000 7f6f8d0aa700 1 -- 172.21.15.40:0/3958740911 wait complete. 2023-09-30T22:28:19.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.740+0000 7f6f8d0aa700 1 Processor -- start 2023-09-30T22:28:19.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.740+0000 7f6f8d0aa700 1 -- start start 2023-09-30T22:28:19.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.741+0000 7f6f8d0aa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f8809d450 0x7f6f8806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:19.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.741+0000 7f6f8d0aa700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f8809dd60 0x7f6f8806e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:19.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.741+0000 7f6f8d0aa700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6f88130700 0x7f6f881c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:19.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.741+0000 7f6f8d0aa700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8806f1b0 con 0x7f6f8809dd60 2023-09-30T22:28:19.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.741+0000 7f6f8d0aa700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f88120df0 con 0x7f6f8809d450 2023-09-30T22:28:19.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.741+0000 7f6f8d0aa700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f88120160 con 0x7f6f88130700 2023-09-30T22:28:19.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.741+0000 7f6f86d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f8809d450 0x7f6f8806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:19.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.741+0000 7f6f8659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f8809dd60 0x7f6f8806e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:19.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.741+0000 7f6f86d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f8809d450 0x7f6f8806dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60422/0 (socket says 172.21.15.40:60422) 2023-09-30T22:28:19.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.741+0000 7f6f86d9d700 1 -- 172.21.15.40:0/973087554 learned_addr learned my addr 172.21.15.40:0/973087554 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:19.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.741+0000 7f6f8759e700 1 --2- 172.21.15.40:0/973087554 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6f88130700 0x7f6f881c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:19.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.741+0000 7f6f86d9d700 1 -- 172.21.15.40:0/973087554 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6f88130700 msgr2=0x7f6f881c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:19.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.741+0000 7f6f86d9d700 1 --2- 172.21.15.40:0/973087554 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6f88130700 0x7f6f881c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.741+0000 7f6f86d9d700 1 -- 172.21.15.40:0/973087554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f8809dd60 msgr2=0x7f6f8806e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:19.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.741+0000 7f6f86d9d700 1 --2- 172.21.15.40:0/973087554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f8809dd60 0x7f6f8806e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.741+0000 7f6f86d9d700 1 -- 172.21.15.40:0/973087554 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f78009550 con 0x7f6f8809d450 2023-09-30T22:28:19.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.741+0000 7f6f8659c700 1 --2- 172.21.15.40:0/973087554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f8809dd60 0x7f6f8806e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:19.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.741+0000 7f6f86d9d700 1 --2- 172.21.15.40:0/973087554 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f8809d450 0x7f6f8806dd00 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6f7800e9b0 tx=0x7f6f7800ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:19.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.742+0000 7f6f6f7fe700 1 -- 172.21.15.40:0/973087554 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7800ee50 con 0x7f6f8809d450 2023-09-30T22:28:19.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.742+0000 7f6f6f7fe700 1 -- 172.21.15.40:0/973087554 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7800c850 con 0x7f6f8809d450 2023-09-30T22:28:19.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.742+0000 7f6f8d0aa700 1 -- 172.21.15.40:0/973087554 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f7c0094a0 con 0x7f6f8809d450 2023-09-30T22:28:19.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.742+0000 7f6f6f7fe700 1 -- 172.21.15.40:0/973087554 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7800cbc0 con 0x7f6f8809d450 2023-09-30T22:28:19.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.742+0000 7f6f8d0aa700 1 -- 172.21.15.40:0/973087554 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f8000ab80 con 0x7f6f8809d450 2023-09-30T22:28:19.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.742+0000 7f6f6f7fe700 1 -- 172.21.15.40:0/973087554 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6f7800cd20 con 0x7f6f8809d450 2023-09-30T22:28:19.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.743+0000 7f6f8d0aa700 1 -- 172.21.15.40:0/973087554 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f88062380 con 0x7f6f8809d450 2023-09-30T22:28:19.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.743+0000 7f6f6f7fe700 1 -- 172.21.15.40:0/973087554 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6f7803f700 con 0x7f6f8809d450 2023-09-30T22:28:19.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.747+0000 7f6f6f7fe700 1 -- 172.21.15.40:0/973087554 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6f78017070 con 0x7f6f8809d450 2023-09-30T22:28:19.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.942+0000 7f6f8d0aa700 1 -- 172.21.15.40:0/973087554 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6f880a0ea0 con 0x7f6f8809d450 2023-09-30T22:28:19.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.942+0000 7f6f6f7fe700 1 -- 172.21.15.40:0/973087554 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6f780232f0 con 0x7f6f8809d450 2023-09-30T22:28:19.943 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:19.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.944+0000 7f6f8d0aa700 1 -- 172.21.15.40:0/973087554 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f8809d450 msgr2=0x7f6f8806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:19.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.944+0000 7f6f8d0aa700 1 --2- 172.21.15.40:0/973087554 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f8809d450 0x7f6f8806dd00 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6f7800e9b0 tx=0x7f6f7800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.944+0000 7f6f8d0aa700 1 -- 172.21.15.40:0/973087554 shutdown_connections 2023-09-30T22:28:19.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.944+0000 7f6f8d0aa700 1 --2- 172.21.15.40:0/973087554 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6f88130700 0x7f6f881c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.944+0000 7f6f8d0aa700 1 --2- 172.21.15.40:0/973087554 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6f8809d450 0x7f6f8806dd00 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.944+0000 7f6f8d0aa700 1 --2- 172.21.15.40:0/973087554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f8809dd60 0x7f6f8806e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.944+0000 7f6f8d0aa700 1 -- 172.21.15.40:0/973087554 >> 172.21.15.40:0/973087554 conn(0x7f6f880a2a00 msgr2=0x7f6f880a11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:19.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.944+0000 7f6f8d0aa700 1 -- 172.21.15.40:0/973087554 shutdown_connections 2023-09-30T22:28:19.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:19.944+0000 7f6f8d0aa700 1 -- 172.21.15.40:0/973087554 wait complete. 2023-09-30T22:28:19.957 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:20.025 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:20.082 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:20.107 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:20.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.154+0000 7fc187fd9700 1 Processor -- start 2023-09-30T22:28:20.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.154+0000 7fc187fd9700 1 -- start start 2023-09-30T22:28:20.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.155+0000 7fc187fd9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc180131d50 0x7fc180132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:20.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.155+0000 7fc187fd9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc18009c7d0 0x7fc180139ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:20.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.155+0000 7fc187fd9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc180132660 con 0x7fc18009bc50 2023-09-30T22:28:20.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.155+0000 7fc187fd9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1800719e0 con 0x7fc180131d50 2023-09-30T22:28:20.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.155+0000 7fc187fd9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc180131900 con 0x7fc18009c7d0 2023-09-30T22:28:20.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.155+0000 7fc185d75700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc180131d50 0x7fc180132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:20.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.155+0000 7fc185574700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc18009bc50 0x7fc18009c0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39580/0 (socket says 172.21.15.40:39580) 2023-09-30T22:28:20.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.155+0000 7fc185574700 1 -- 172.21.15.40:0/2558416438 learned_addr learned my addr 172.21.15.40:0/2558416438 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:20.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.155+0000 7fc186576700 1 --2- 172.21.15.40:0/2558416438 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc18009c7d0 0x7fc180139ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:20.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.155+0000 7fc185d75700 1 -- 172.21.15.40:0/2558416438 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc18009c7d0 msgr2=0x7fc180139ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:20.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.155+0000 7fc185d75700 1 --2- 172.21.15.40:0/2558416438 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc18009c7d0 0x7fc180139ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.155+0000 7fc185d75700 1 -- 172.21.15.40:0/2558416438 >> v1:172.21.15.40:6789/0 conn(0x7fc18009bc50 legacy=0x7fc18009c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:20.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.155+0000 7fc184d73700 1 -- 172.21.15.40:0/2558416438 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2827863120 0 0) 0x7fc180132660 con 0x7fc18009bc50 2023-09-30T22:28:20.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.155+0000 7fc185d75700 1 -- 172.21.15.40:0/2558416438 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18009e820 con 0x7fc180131d50 2023-09-30T22:28:20.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.156+0000 7fc185d75700 1 --2- 172.21.15.40:0/2558416438 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc180131d50 0x7fc180132120 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc17c009870 tx=0x7fc17c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c424fc0a1fad5293 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:20.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.156+0000 7fc184d73700 1 -- 172.21.15.40:0/2558416438 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c011830 con 0x7fc180131d50 2023-09-30T22:28:20.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.156+0000 7fc184d73700 1 -- 172.21.15.40:0/2558416438 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17c011990 con 0x7fc180131d50 2023-09-30T22:28:20.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.156+0000 7fc184d73700 1 -- 172.21.15.40:0/2558416438 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c011d20 con 0x7fc180131d50 2023-09-30T22:28:20.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.157+0000 7fc187fd9700 1 -- 172.21.15.40:0/2558416438 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc180131d50 msgr2=0x7fc180132120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:20.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.157+0000 7fc187fd9700 1 --2- 172.21.15.40:0/2558416438 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc180131d50 0x7fc180132120 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc17c009870 tx=0x7fc17c009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:20.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.157+0000 7fc187fd9700 1 -- 172.21.15.40:0/2558416438 shutdown_connections 2023-09-30T22:28:20.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.157+0000 7fc187fd9700 1 --2- 172.21.15.40:0/2558416438 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc18009c7d0 0x7fc180139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.157+0000 7fc187fd9700 1 --2- 172.21.15.40:0/2558416438 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc180131d50 0x7fc180132120 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.157+0000 7fc187fd9700 1 -- 172.21.15.40:0/2558416438 >> 172.21.15.40:0/2558416438 conn(0x7fc1800a2a00 msgr2=0x7fc1800a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:20.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.157+0000 7fc187fd9700 1 -- 172.21.15.40:0/2558416438 shutdown_connections 2023-09-30T22:28:20.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.157+0000 7fc187fd9700 1 -- 172.21.15.40:0/2558416438 wait complete. 2023-09-30T22:28:20.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.158+0000 7fc187fd9700 1 Processor -- start 2023-09-30T22:28:20.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.158+0000 7fc187fd9700 1 -- start start 2023-09-30T22:28:20.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.159+0000 7fc187fd9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc18009bc50 0x7fc180119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:20.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.159+0000 7fc187fd9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc18009c7d0 0x7fc180119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:20.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.159+0000 7fc187fd9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc180131d50 0x7fc180119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:20.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.159+0000 7fc187fd9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18011a4d0 con 0x7fc18009bc50 2023-09-30T22:28:20.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.159+0000 7fc187fd9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc18011b700 con 0x7fc18009c7d0 2023-09-30T22:28:20.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.159+0000 7fc187fd9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc18011cd30 con 0x7fc180131d50 2023-09-30T22:28:20.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.159+0000 7fc185d75700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc18009bc50 0x7fc180119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:20.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.159+0000 7fc185d75700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc18009bc50 0x7fc180119050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41372/0 (socket says 172.21.15.40:41372) 2023-09-30T22:28:20.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.159+0000 7fc185d75700 1 -- 172.21.15.40:0/2980720263 learned_addr learned my addr 172.21.15.40:0/2980720263 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:20.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.159+0000 7fc186576700 1 --2- 172.21.15.40:0/2980720263 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc180131d50 0x7fc180119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:20.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.159+0000 7fc185574700 1 --2- 172.21.15.40:0/2980720263 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc18009c7d0 0x7fc180119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:20.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.159+0000 7fc185d75700 1 -- 172.21.15.40:0/2980720263 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc180131d50 msgr2=0x7fc180119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:20.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.159+0000 7fc185d75700 1 --2- 172.21.15.40:0/2980720263 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc180131d50 0x7fc180119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.159+0000 7fc185d75700 1 -- 172.21.15.40:0/2980720263 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc18009c7d0 msgr2=0x7fc180119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:20.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.159+0000 7fc185d75700 1 --2- 172.21.15.40:0/2980720263 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc18009c7d0 0x7fc180119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.159+0000 7fc185d75700 1 -- 172.21.15.40:0/2980720263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17c0094a0 con 0x7fc18009bc50 2023-09-30T22:28:20.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.159+0000 7fc185574700 1 --2- 172.21.15.40:0/2980720263 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc18009c7d0 0x7fc180119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:20.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.160+0000 7fc185d75700 1 --2- 172.21.15.40:0/2980720263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc18009bc50 0x7fc180119050 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fc17c009840 tx=0x7fc17c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:20.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.160+0000 7fc1767fc700 1 -- 172.21.15.40:0/2980720263 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c01a830 con 0x7fc18009bc50 2023-09-30T22:28:20.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.160+0000 7fc1767fc700 1 -- 172.21.15.40:0/2980720263 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17c01a990 con 0x7fc18009bc50 2023-09-30T22:28:20.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.160+0000 7fc187fd9700 1 -- 172.21.15.40:0/2980720263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc18011aa90 con 0x7fc18009bc50 2023-09-30T22:28:20.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.160+0000 7fc1767fc700 1 -- 172.21.15.40:0/2980720263 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c01ad40 con 0x7fc18009bc50 2023-09-30T22:28:20.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.160+0000 7fc187fd9700 1 -- 172.21.15.40:0/2980720263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc18012e960 con 0x7fc18009bc50 2023-09-30T22:28:20.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.161+0000 7fc1767fc700 1 -- 172.21.15.40:0/2980720263 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc17c0253f0 con 0x7fc18009bc50 2023-09-30T22:28:20.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.161+0000 7fc1767fc700 1 -- 172.21.15.40:0/2980720263 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc17c040a80 con 0x7fc18009bc50 2023-09-30T22:28:20.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.161+0000 7fc187fd9700 1 -- 172.21.15.40:0/2980720263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc18009b1e0 con 0x7fc18009bc50 2023-09-30T22:28:20.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.170+0000 7fc1767fc700 1 -- 172.21.15.40:0/2980720263 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc17c015080 con 0x7fc18009bc50 2023-09-30T22:28:20.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.217+0000 7fdda7661700 1 Processor -- start 2023-09-30T22:28:20.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.217+0000 7fdda7661700 1 -- start start 2023-09-30T22:28:20.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.218+0000 7fdda7661700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdda0134a90 0x7fdda0136e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:20.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.218+0000 7fdda7661700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdda01373b0 0x7fdda0139790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:20.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.218+0000 7fdda7661700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda0131900 con 0x7fdda0131d50 2023-09-30T22:28:20.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.218+0000 7fdda7661700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda00719e0 con 0x7fdda01373b0 2023-09-30T22:28:20.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.218+0000 7fdda7661700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdda009e820 con 0x7fdda0134a90 2023-09-30T22:28:20.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.218+0000 7fdda4bfc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdda0134a90 0x7fdda0136e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:20.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.218+0000 7fdda53fd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fdda0131d50 0x7fdda0132120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39592/0 (socket says 172.21.15.40:39592) 2023-09-30T22:28:20.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.218+0000 7fdda53fd700 1 -- 172.21.15.40:0/4097712824 learned_addr learned my addr 172.21.15.40:0/4097712824 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:20.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.218+0000 7fdda5bfe700 1 --2- 172.21.15.40:0/4097712824 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdda01373b0 0x7fdda0139790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:20.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.219+0000 7fdda4bfc700 1 -- 172.21.15.40:0/4097712824 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdda01373b0 msgr2=0x7fdda0139790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:20.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.219+0000 7fdda4bfc700 1 --2- 172.21.15.40:0/4097712824 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdda01373b0 0x7fdda0139790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.219+0000 7fdda4bfc700 1 -- 172.21.15.40:0/4097712824 >> v1:172.21.15.40:6789/0 conn(0x7fdda0131d50 legacy=0x7fdda0132120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:20.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.219+0000 7fdd97fff700 1 -- 172.21.15.40:0/4097712824 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3523726434 0 0) 0x7fdda0131900 con 0x7fdda0131d50 2023-09-30T22:28:20.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.219+0000 7fdda4bfc700 1 -- 172.21.15.40:0/4097712824 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda009ef60 con 0x7fdda0134a90 2023-09-30T22:28:20.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.219+0000 7fdda4bfc700 1 --2- 172.21.15.40:0/4097712824 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdda0134a90 0x7fdda0136e70 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fdd90009870 tx=0x7fdd90009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13423d0af6629b96 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:20.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.219+0000 7fdd97fff700 1 -- 172.21.15.40:0/4097712824 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd90011830 con 0x7fdda0134a90 2023-09-30T22:28:20.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.219+0000 7fdd97fff700 1 -- 172.21.15.40:0/4097712824 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd90011990 con 0x7fdda0134a90 2023-09-30T22:28:20.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.219+0000 7fdd97fff700 1 -- 172.21.15.40:0/4097712824 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd90011d20 con 0x7fdda0134a90 2023-09-30T22:28:20.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.220+0000 7fdda7661700 1 -- 172.21.15.40:0/4097712824 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdda0134a90 msgr2=0x7fdda0136e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:20.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.220+0000 7fdda7661700 1 --2- 172.21.15.40:0/4097712824 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdda0134a90 0x7fdda0136e70 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fdd90009870 tx=0x7fdd90009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:20.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.220+0000 7fdda7661700 1 -- 172.21.15.40:0/4097712824 shutdown_connections 2023-09-30T22:28:20.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.220+0000 7fdda7661700 1 --2- 172.21.15.40:0/4097712824 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdda01373b0 0x7fdda0139790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.220+0000 7fdda7661700 1 --2- 172.21.15.40:0/4097712824 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdda0134a90 0x7fdda0136e70 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.220+0000 7fdda7661700 1 -- 172.21.15.40:0/4097712824 >> 172.21.15.40:0/4097712824 conn(0x7fdda00a2a00 msgr2=0x7fdda00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:20.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.220+0000 7fdda7661700 1 -- 172.21.15.40:0/4097712824 shutdown_connections 2023-09-30T22:28:20.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.220+0000 7fdda7661700 1 -- 172.21.15.40:0/4097712824 wait complete. 2023-09-30T22:28:20.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.221+0000 7fdda7661700 1 Processor -- start 2023-09-30T22:28:20.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.221+0000 7fdda7661700 1 -- start start 2023-09-30T22:28:20.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.222+0000 7fdda7661700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdda0131d50 0x7fdda0119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:20.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.222+0000 7fdda7661700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdda0134a90 0x7fdda0119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:20.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.222+0000 7fdda7661700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdda01373b0 0x7fdda0119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:20.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.222+0000 7fdda7661700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda011c200 con 0x7fdda01373b0 2023-09-30T22:28:20.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.222+0000 7fdda7661700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda012eda0 con 0x7fdda0134a90 2023-09-30T22:28:20.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.222+0000 7fdda7661700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdda0137080 con 0x7fdda0131d50 2023-09-30T22:28:20.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.222+0000 7fdda4bfc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdda0134a90 0x7fdda0119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:20.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.222+0000 7fdda4bfc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdda0134a90 0x7fdda0119590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60448/0 (socket says 172.21.15.40:60448) 2023-09-30T22:28:20.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.222+0000 7fdda4bfc700 1 -- 172.21.15.40:0/3331937552 learned_addr learned my addr 172.21.15.40:0/3331937552 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:20.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.222+0000 7fdda53fd700 1 --2- 172.21.15.40:0/3331937552 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdda0131d50 0x7fdda0119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:20.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.222+0000 7fdda5bfe700 1 --2- 172.21.15.40:0/3331937552 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdda01373b0 0x7fdda0119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:20.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.222+0000 7fdda4bfc700 1 -- 172.21.15.40:0/3331937552 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdda0131d50 msgr2=0x7fdda0119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:20.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.222+0000 7fdda4bfc700 1 --2- 172.21.15.40:0/3331937552 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdda0131d50 0x7fdda0119050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.222+0000 7fdda4bfc700 1 -- 172.21.15.40:0/3331937552 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdda01373b0 msgr2=0x7fdda0119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:20.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.222+0000 7fdda4bfc700 1 --2- 172.21.15.40:0/3331937552 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdda01373b0 0x7fdda0119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.222+0000 7fdda4bfc700 1 -- 172.21.15.40:0/3331937552 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd900094a0 con 0x7fdda0134a90 2023-09-30T22:28:20.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.222+0000 7fdda5bfe700 1 --2- 172.21.15.40:0/3331937552 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdda01373b0 0x7fdda0119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:20.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.223+0000 7fdda4bfc700 1 --2- 172.21.15.40:0/3331937552 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdda0134a90 0x7fdda0119590 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fdd900090b0 tx=0x7fdd90004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:20.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.223+0000 7fdd95ffb700 1 -- 172.21.15.40:0/3331937552 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd90004590 con 0x7fdda0134a90 2023-09-30T22:28:20.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.223+0000 7fdd95ffb700 1 -- 172.21.15.40:0/3331937552 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9001f070 con 0x7fdda0134a90 2023-09-30T22:28:20.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.223+0000 7fdda7661700 1 -- 172.21.15.40:0/3331937552 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdda009ea60 con 0x7fdda0134a90 2023-09-30T22:28:20.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.223+0000 7fdd95ffb700 1 -- 172.21.15.40:0/3331937552 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd900038c0 con 0x7fdda0134a90 2023-09-30T22:28:20.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.223+0000 7fdda7661700 1 -- 172.21.15.40:0/3331937552 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda011c6f0 con 0x7fdda0134a90 2023-09-30T22:28:20.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.224+0000 7fdd8b7fe700 1 -- 172.21.15.40:0/3331937552 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd780052e0 con 0x7fdda0134a90 2023-09-30T22:28:20.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.224+0000 7fdd95ffb700 1 -- 172.21.15.40:0/3331937552 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdd90003a20 con 0x7fdda0134a90 2023-09-30T22:28:20.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.225+0000 7fdd95ffb700 1 -- 172.21.15.40:0/3331937552 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fdd90021070 con 0x7fdda0134a90 2023-09-30T22:28:20.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.229+0000 7fdd95ffb700 1 -- 172.21.15.40:0/3331937552 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdd9001a430 con 0x7fdda0134a90 2023-09-30T22:28:20.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.276+0000 7f943c351700 1 Processor -- start 2023-09-30T22:28:20.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.276+0000 7f943c351700 1 -- start start 2023-09-30T22:28:20.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.277+0000 7f943c351700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f943406f070 0x7f943406f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:20.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.277+0000 7f943c351700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f943406f980 0x7f9434097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:20.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.277+0000 7f943c351700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f943406fdb0 0x7f94340975d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:20.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.277+0000 7f943c351700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9434070830 con 0x7f943406f980 2023-09-30T22:28:20.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.277+0000 7f943c351700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9434070ad0 con 0x7f943406f070 2023-09-30T22:28:20.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.277+0000 7f943c351700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9434070de0 con 0x7f943406fdb0 2023-09-30T22:28:20.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.277+0000 7f94398ec700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f943406f980 0x7f9434097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:20.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.277+0000 7f943a0ed700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f943406f070 0x7f943406f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:20.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.277+0000 7f94398ec700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f943406f980 0x7f9434097090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41394/0 (socket says 172.21.15.40:41394) 2023-09-30T22:28:20.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.277+0000 7f94398ec700 1 -- 172.21.15.40:0/3228047534 learned_addr learned my addr 172.21.15.40:0/3228047534 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:20.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.277+0000 7f943a0ed700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f943406f070 0x7f943406f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60464/0 (socket says 172.21.15.40:60464) 2023-09-30T22:28:20.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.277+0000 7f943a8ee700 1 --2- 172.21.15.40:0/3228047534 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f943406fdb0 0x7f94340975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:20.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.278+0000 7f943a0ed700 1 -- 172.21.15.40:0/3228047534 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f943406fdb0 msgr2=0x7f94340975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:20.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.278+0000 7f943a0ed700 1 --2- 172.21.15.40:0/3228047534 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f943406fdb0 0x7f94340975d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.278+0000 7f943a0ed700 1 -- 172.21.15.40:0/3228047534 >> v2:172.21.15.40:3300/0 conn(0x7f943406f980 msgr2=0x7f9434097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:20.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.278+0000 7f943a0ed700 1 --2- 172.21.15.40:0/3228047534 >> v2:172.21.15.40:3300/0 conn(0x7f943406f980 0x7f9434097090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.278+0000 7f943a0ed700 1 -- 172.21.15.40:0/3228047534 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943409fe20 con 0x7f943406f070 2023-09-30T22:28:20.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.278+0000 7f943a8ee700 1 --2- 172.21.15.40:0/3228047534 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f943406fdb0 0x7f94340975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:20.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.278+0000 7f943a0ed700 1 --2- 172.21.15.40:0/3228047534 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f943406f070 0x7f943406f440 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f9430009840 tx=0x7f9430009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1dc6ba77ccddaee2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:20.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.278+0000 7f94390eb700 1 -- 172.21.15.40:0/3228047534 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9430011830 con 0x7f943406f070 2023-09-30T22:28:20.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.278+0000 7f94390eb700 1 -- 172.21.15.40:0/3228047534 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9430011990 con 0x7f943406f070 2023-09-30T22:28:20.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.278+0000 7f94390eb700 1 -- 172.21.15.40:0/3228047534 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9430011d20 con 0x7f943406f070 2023-09-30T22:28:20.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.279+0000 7f943c351700 1 -- 172.21.15.40:0/3228047534 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f943406f070 msgr2=0x7f943406f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:20.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.279+0000 7f943c351700 1 --2- 172.21.15.40:0/3228047534 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f943406f070 0x7f943406f440 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f9430009840 tx=0x7f9430009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:20.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.279+0000 7f943c351700 1 -- 172.21.15.40:0/3228047534 shutdown_connections 2023-09-30T22:28:20.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.279+0000 7f943c351700 1 --2- 172.21.15.40:0/3228047534 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f943406fdb0 0x7f94340975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.279+0000 7f943c351700 1 --2- 172.21.15.40:0/3228047534 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f943406f070 0x7f943406f440 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.279+0000 7f943c351700 1 --2- 172.21.15.40:0/3228047534 >> v2:172.21.15.40:3300/0 conn(0x7f943406f980 0x7f9434097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.279+0000 7f943c351700 1 -- 172.21.15.40:0/3228047534 >> 172.21.15.40:0/3228047534 conn(0x7f94340a41a0 msgr2=0x7f94340a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:20.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.279+0000 7f943c351700 1 -- 172.21.15.40:0/3228047534 shutdown_connections 2023-09-30T22:28:20.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.279+0000 7f943c351700 1 -- 172.21.15.40:0/3228047534 wait complete. 2023-09-30T22:28:20.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.280+0000 7f943c351700 1 Processor -- start 2023-09-30T22:28:20.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.281+0000 7f943c351700 1 -- start start 2023-09-30T22:28:20.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.281+0000 7f943c351700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f943406f070 0x7f943412c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:20.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.281+0000 7f943c351700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f943406f980 0x7f943412c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:20.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.281+0000 7f943c351700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f943406fdb0 0x7f943412cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:20.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.281+0000 7f943c351700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943409b120 con 0x7f943406fdb0 2023-09-30T22:28:20.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.281+0000 7f943c351700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943412fe80 con 0x7f943406f070 2023-09-30T22:28:20.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.281+0000 7f943c351700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f943412f6d0 con 0x7f943406f980 2023-09-30T22:28:20.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.281+0000 7f943a0ed700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f943406f070 0x7f943412c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:20.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.281+0000 7f943a0ed700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f943406f070 0x7f943412c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60466/0 (socket says 172.21.15.40:60466) 2023-09-30T22:28:20.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.281+0000 7f943a0ed700 1 -- 172.21.15.40:0/2075609921 learned_addr learned my addr 172.21.15.40:0/2075609921 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:20.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.281+0000 7f94398ec700 1 --2- 172.21.15.40:0/2075609921 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f943406f980 0x7f943412c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:20.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.281+0000 7f943a8ee700 1 --2- 172.21.15.40:0/2075609921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f943406fdb0 0x7f943412cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:20.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.282+0000 7f943a0ed700 1 -- 172.21.15.40:0/2075609921 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f943406f980 msgr2=0x7f943412c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:20.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.282+0000 7f943a0ed700 1 --2- 172.21.15.40:0/2075609921 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f943406f980 0x7f943412c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.282+0000 7f943a0ed700 1 -- 172.21.15.40:0/2075609921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f943406fdb0 msgr2=0x7f943412cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:20.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.282+0000 7f943a0ed700 1 --2- 172.21.15.40:0/2075609921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f943406fdb0 0x7f943412cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.282+0000 7f943a0ed700 1 -- 172.21.15.40:0/2075609921 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f942c009a70 con 0x7f943406f070 2023-09-30T22:28:20.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.282+0000 7f943a8ee700 1 --2- 172.21.15.40:0/2075609921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f943406fdb0 0x7f943412cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:20.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.282+0000 7f94398ec700 1 --2- 172.21.15.40:0/2075609921 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f943406f980 0x7f943412c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:20.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.282+0000 7f943a0ed700 1 --2- 172.21.15.40:0/2075609921 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f943406f070 0x7f943412c2d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f94300090b0 tx=0x7f9430004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:20.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.282+0000 7f942affd700 1 -- 172.21.15.40:0/2075609921 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9430004240 con 0x7f943406f070 2023-09-30T22:28:20.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.282+0000 7f942affd700 1 -- 172.21.15.40:0/2075609921 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943001f070 con 0x7f943406f070 2023-09-30T22:28:20.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.282+0000 7f943c351700 1 -- 172.21.15.40:0/2075609921 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94300094a0 con 0x7f943406f070 2023-09-30T22:28:20.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.282+0000 7f942affd700 1 -- 172.21.15.40:0/2075609921 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94300036a0 con 0x7f943406f070 2023-09-30T22:28:20.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.282+0000 7f943c351700 1 -- 172.21.15.40:0/2075609921 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f943412f1b0 con 0x7f943406f070 2023-09-30T22:28:20.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.283+0000 7f942affd700 1 -- 172.21.15.40:0/2075609921 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9430021030 con 0x7f943406f070 2023-09-30T22:28:20.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.283+0000 7f943c351700 1 -- 172.21.15.40:0/2075609921 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9434062380 con 0x7f943406f070 2023-09-30T22:28:20.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.283+0000 7f942affd700 1 -- 172.21.15.40:0/2075609921 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9430040650 con 0x7f943406f070 2023-09-30T22:28:20.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.288+0000 7f942affd700 1 -- 172.21.15.40:0/2075609921 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f94300239c0 con 0x7f943406f070 2023-09-30T22:28:20.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.384+0000 7fc187fd9700 1 -- 172.21.15.40:0/2980720263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc18009ea60 con 0x7fc18009bc50 2023-09-30T22:28:20.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.384+0000 7fc1767fc700 1 -- 172.21.15.40:0/2980720263 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc17c00b360 con 0x7fc18009bc50 2023-09-30T22:28:20.385 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:20.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.387+0000 7fc187fd9700 1 -- 172.21.15.40:0/2980720263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc18009bc50 msgr2=0x7fc180119050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:20.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.387+0000 7fc187fd9700 1 --2- 172.21.15.40:0/2980720263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc18009bc50 0x7fc180119050 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fc17c009840 tx=0x7fc17c004750 comp rx=0 tx=0).stop 2023-09-30T22:28:20.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.387+0000 7fc187fd9700 1 -- 172.21.15.40:0/2980720263 shutdown_connections 2023-09-30T22:28:20.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.387+0000 7fc187fd9700 1 --2- 172.21.15.40:0/2980720263 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc180131d50 0x7fc180119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.387+0000 7fc187fd9700 1 --2- 172.21.15.40:0/2980720263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc18009bc50 0x7fc180119050 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.387+0000 7fc187fd9700 1 --2- 172.21.15.40:0/2980720263 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc18009c7d0 0x7fc180119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.387+0000 7fc187fd9700 1 -- 172.21.15.40:0/2980720263 >> 172.21.15.40:0/2980720263 conn(0x7fc1800a2a00 msgr2=0x7fc18012d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:20.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.387+0000 7fc187fd9700 1 -- 172.21.15.40:0/2980720263 shutdown_connections 2023-09-30T22:28:20.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.388+0000 7fc187fd9700 1 -- 172.21.15.40:0/2980720263 wait complete. 2023-09-30T22:28:20.405 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:20.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.447+0000 7fdd8b7fe700 1 -- 172.21.15.40:0/3331937552 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdd78005860 con 0x7fdda0134a90 2023-09-30T22:28:20.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.448+0000 7fdd95ffb700 1 -- 172.21.15.40:0/3331937552 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdd9002b020 con 0x7fdda0134a90 2023-09-30T22:28:20.448 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:20.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.450+0000 7fdd8b7fe700 1 -- 172.21.15.40:0/3331937552 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdda0134a90 msgr2=0x7fdda0119590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:20.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.450+0000 7fdd8b7fe700 1 --2- 172.21.15.40:0/3331937552 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdda0134a90 0x7fdda0119590 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fdd900090b0 tx=0x7fdd90004750 comp rx=0 tx=0).stop 2023-09-30T22:28:20.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.450+0000 7fdd8b7fe700 1 -- 172.21.15.40:0/3331937552 shutdown_connections 2023-09-30T22:28:20.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.450+0000 7fdd8b7fe700 1 --2- 172.21.15.40:0/3331937552 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdda0131d50 0x7fdda0119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.450+0000 7fdd8b7fe700 1 --2- 172.21.15.40:0/3331937552 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdda01373b0 0x7fdda0119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.450+0000 7fdd8b7fe700 1 --2- 172.21.15.40:0/3331937552 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdda0134a90 0x7fdda0119590 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.450+0000 7fdd8b7fe700 1 -- 172.21.15.40:0/3331937552 >> 172.21.15.40:0/3331937552 conn(0x7fdda00a2a00 msgr2=0x7fdda0134e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:20.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.450+0000 7fdd8b7fe700 1 -- 172.21.15.40:0/3331937552 shutdown_connections 2023-09-30T22:28:20.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.450+0000 7fdd8b7fe700 1 -- 172.21.15.40:0/3331937552 wait complete. 2023-09-30T22:28:20.462 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:20.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.486+0000 7f943c351700 1 -- 172.21.15.40:0/2075609921 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f943412dd70 con 0x7f943406f070 2023-09-30T22:28:20.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.486+0000 7f942affd700 1 -- 172.21.15.40:0/2075609921 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f94300233d0 con 0x7f943406f070 2023-09-30T22:28:20.487 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:20.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.488+0000 7f943c351700 1 -- 172.21.15.40:0/2075609921 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f943406f070 msgr2=0x7f943412c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:20.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.488+0000 7f943c351700 1 --2- 172.21.15.40:0/2075609921 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f943406f070 0x7f943412c2d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f94300090b0 tx=0x7f9430004750 comp rx=0 tx=0).stop 2023-09-30T22:28:20.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.488+0000 7f943c351700 1 -- 172.21.15.40:0/2075609921 shutdown_connections 2023-09-30T22:28:20.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.488+0000 7f943c351700 1 --2- 172.21.15.40:0/2075609921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f943406fdb0 0x7f943412cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.488+0000 7f943c351700 1 --2- 172.21.15.40:0/2075609921 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f943406f070 0x7f943412c2d0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.488+0000 7f943c351700 1 --2- 172.21.15.40:0/2075609921 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f943406f980 0x7f943412c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.488+0000 7f943c351700 1 -- 172.21.15.40:0/2075609921 >> 172.21.15.40:0/2075609921 conn(0x7f94340a41a0 msgr2=0x7f94340a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:20.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.488+0000 7f943c351700 1 -- 172.21.15.40:0/2075609921 shutdown_connections 2023-09-30T22:28:20.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:20.489+0000 7f943c351700 1 -- 172.21.15.40:0/2075609921 wait complete. 2023-09-30T22:28:20.501 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:20.958 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:21.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.087+0000 7f374c559700 1 Processor -- start 2023-09-30T22:28:21.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.087+0000 7f374c559700 1 -- start start 2023-09-30T22:28:21.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.088+0000 7f374c559700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3744131d50 0x7f3744132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.088+0000 7f374c559700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f374409c7d0 0x7f3744139ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.088+0000 7f374c559700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3744132660 con 0x7f374409bc50 2023-09-30T22:28:21.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.088+0000 7f374c559700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37440719e0 con 0x7f3744131d50 2023-09-30T22:28:21.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.088+0000 7f374c559700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3744131900 con 0x7f374409c7d0 2023-09-30T22:28:21.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.088+0000 7f374a2f5700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3744131d50 0x7f3744132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.088+0000 7f374a2f5700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3744131d50 0x7f3744132120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41422/0 (socket says 172.21.15.40:41422) 2023-09-30T22:28:21.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.088+0000 7f374a2f5700 1 -- 172.21.15.40:0/1558889073 learned_addr learned my addr 172.21.15.40:0/1558889073 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:21.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.088+0000 7f374aaf6700 1 --2- 172.21.15.40:0/1558889073 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f374409c7d0 0x7f3744139ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.089+0000 7f374a2f5700 1 -- 172.21.15.40:0/1558889073 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f374409c7d0 msgr2=0x7f3744139ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:21.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.089+0000 7f374a2f5700 1 --2- 172.21.15.40:0/1558889073 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f374409c7d0 0x7f3744139ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.089+0000 7f374a2f5700 1 -- 172.21.15.40:0/1558889073 >> v1:172.21.15.40:6789/0 conn(0x7f374409bc50 legacy=0x7f374409c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.089+0000 7f374a2f5700 1 -- 172.21.15.40:0/1558889073 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374409e820 con 0x7f3744131d50 2023-09-30T22:28:21.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.089+0000 7f374aaf6700 1 --2- 172.21.15.40:0/1558889073 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f374409c7d0 0x7f3744139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:21.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.089+0000 7f374a2f5700 1 --2- 172.21.15.40:0/1558889073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3744131d50 0x7f3744132120 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f37400098f0 tx=0x7f3740009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac1dcd8700f0a5e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:21.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.089+0000 7f37492f3700 1 -- 172.21.15.40:0/1558889073 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3740011830 con 0x7f3744131d50 2023-09-30T22:28:21.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.089+0000 7f37492f3700 1 -- 172.21.15.40:0/1558889073 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3740011990 con 0x7f3744131d50 2023-09-30T22:28:21.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.089+0000 7f37492f3700 1 -- 172.21.15.40:0/1558889073 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3740011d20 con 0x7f3744131d50 2023-09-30T22:28:21.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.089+0000 7f374c559700 1 -- 172.21.15.40:0/1558889073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3744131d50 msgr2=0x7f3744132120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.089+0000 7f374c559700 1 --2- 172.21.15.40:0/1558889073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3744131d50 0x7f3744132120 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f37400098f0 tx=0x7f3740009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:21.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.090+0000 7f374c559700 1 -- 172.21.15.40:0/1558889073 shutdown_connections 2023-09-30T22:28:21.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.090+0000 7f374c559700 1 --2- 172.21.15.40:0/1558889073 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f374409c7d0 0x7f3744139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.090+0000 7f374c559700 1 --2- 172.21.15.40:0/1558889073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3744131d50 0x7f3744132120 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.090+0000 7f374c559700 1 -- 172.21.15.40:0/1558889073 >> 172.21.15.40:0/1558889073 conn(0x7f37440a2a00 msgr2=0x7f37440a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:21.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.090+0000 7f374c559700 1 -- 172.21.15.40:0/1558889073 shutdown_connections 2023-09-30T22:28:21.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.090+0000 7f374c559700 1 -- 172.21.15.40:0/1558889073 wait complete. 2023-09-30T22:28:21.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.091+0000 7f374c559700 1 Processor -- start 2023-09-30T22:28:21.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.091+0000 7f374c559700 1 -- start start 2023-09-30T22:28:21.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.091+0000 7f374c559700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f374409bc50 0x7f374411bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.091+0000 7f374c559700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f374409c7d0 0x7f374411c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.092+0000 7f374c559700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3744131d50 0x7f374411c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.092+0000 7f374c559700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374409ea60 con 0x7f374409c7d0 2023-09-30T22:28:21.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.092+0000 7f374c559700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f374411e1c0 con 0x7f3744131d50 2023-09-30T22:28:21.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.092+0000 7f374c559700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f374411da60 con 0x7f374409bc50 2023-09-30T22:28:21.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.092+0000 7f374a2f5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f374409bc50 0x7f374411bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.092+0000 7f3749af4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f374409c7d0 0x7f374411c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.092+0000 7f374a2f5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f374409bc50 0x7f374411bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41146/0 (socket says 172.21.15.40:41146) 2023-09-30T22:28:21.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.092+0000 7f374a2f5700 1 -- 172.21.15.40:0/2059056999 learned_addr learned my addr 172.21.15.40:0/2059056999 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:21.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.092+0000 7f374aaf6700 1 --2- 172.21.15.40:0/2059056999 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3744131d50 0x7f374411c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.092+0000 7f374a2f5700 1 -- 172.21.15.40:0/2059056999 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3744131d50 msgr2=0x7f374411c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.092+0000 7f374a2f5700 1 --2- 172.21.15.40:0/2059056999 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3744131d50 0x7f374411c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.092+0000 7f374a2f5700 1 -- 172.21.15.40:0/2059056999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f374409c7d0 msgr2=0x7f374411c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.092+0000 7f374a2f5700 1 --2- 172.21.15.40:0/2059056999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f374409c7d0 0x7f374411c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.092+0000 7f374a2f5700 1 -- 172.21.15.40:0/2059056999 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f373c009a70 con 0x7f374409bc50 2023-09-30T22:28:21.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.092+0000 7f3749af4700 1 --2- 172.21.15.40:0/2059056999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f374409c7d0 0x7f374411c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:21.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.092+0000 7f374a2f5700 1 --2- 172.21.15.40:0/2059056999 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f374409bc50 0x7f374411bd40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3740009c40 tx=0x7f3740004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:21.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.092+0000 7f373affd700 1 -- 172.21.15.40:0/2059056999 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3740004550 con 0x7f374409bc50 2023-09-30T22:28:21.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.092+0000 7f373affd700 1 -- 172.21.15.40:0/2059056999 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37400036a0 con 0x7f374409bc50 2023-09-30T22:28:21.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.092+0000 7f374c559700 1 -- 172.21.15.40:0/2059056999 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3740009550 con 0x7f374409bc50 2023-09-30T22:28:21.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.092+0000 7f373affd700 1 -- 172.21.15.40:0/2059056999 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3740003a30 con 0x7f374409bc50 2023-09-30T22:28:21.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.092+0000 7f374c559700 1 -- 172.21.15.40:0/2059056999 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f374412ee30 con 0x7f374409bc50 2023-09-30T22:28:21.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.093+0000 7f373affd700 1 -- 172.21.15.40:0/2059056999 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3740021070 con 0x7f374409bc50 2023-09-30T22:28:21.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.093+0000 7f373affd700 1 -- 172.21.15.40:0/2059056999 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3740040ad0 con 0x7f374409bc50 2023-09-30T22:28:21.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.093+0000 7f374c559700 1 -- 172.21.15.40:0/2059056999 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f374412c8c0 con 0x7f374409bc50 2023-09-30T22:28:21.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.098+0000 7f373affd700 1 -- 172.21.15.40:0/2059056999 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3740015070 con 0x7f374409bc50 2023-09-30T22:28:21.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.290+0000 7f374c559700 1 -- 172.21.15.40:0/2059056999 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3744062380 con 0x7f374409bc50 2023-09-30T22:28:21.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.290+0000 7f373affd700 1 -- 172.21.15.40:0/2059056999 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f374001b430 con 0x7f374409bc50 2023-09-30T22:28:21.291 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:21.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.292+0000 7f374c559700 1 -- 172.21.15.40:0/2059056999 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f374409bc50 msgr2=0x7f374411bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.292+0000 7f374c559700 1 --2- 172.21.15.40:0/2059056999 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f374409bc50 0x7f374411bd40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3740009c40 tx=0x7f3740004750 comp rx=0 tx=0).stop 2023-09-30T22:28:21.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.292+0000 7f374c559700 1 -- 172.21.15.40:0/2059056999 shutdown_connections 2023-09-30T22:28:21.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.292+0000 7f374c559700 1 --2- 172.21.15.40:0/2059056999 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f374409bc50 0x7f374411bd40 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.292+0000 7f374c559700 1 --2- 172.21.15.40:0/2059056999 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3744131d50 0x7f374411c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.292+0000 7f374c559700 1 --2- 172.21.15.40:0/2059056999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f374409c7d0 0x7f374411c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.292+0000 7f374c559700 1 -- 172.21.15.40:0/2059056999 >> 172.21.15.40:0/2059056999 conn(0x7f37440a2a00 msgr2=0x7f374412f680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:21.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.292+0000 7f374c559700 1 -- 172.21.15.40:0/2059056999 shutdown_connections 2023-09-30T22:28:21.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.292+0000 7f374c559700 1 -- 172.21.15.40:0/2059056999 wait complete. 2023-09-30T22:28:21.305 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:21.406 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:21.464 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:21.502 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:21.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.538+0000 7efe61dfd700 1 Processor -- start 2023-09-30T22:28:21.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.538+0000 7efe61dfd700 1 -- start start 2023-09-30T22:28:21.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.539+0000 7efe61dfd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efe5c09d920 0x7efe5c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.539+0000 7efe61dfd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe5c09f0f0 0x7efe5c09e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.539+0000 7efe61dfd700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe5c09f940 con 0x7efe5c133ca0 2023-09-30T22:28:21.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.539+0000 7efe61dfd700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe5c06b4c0 con 0x7efe5c09d920 2023-09-30T22:28:21.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.539+0000 7efe61dfd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c09a8f0 con 0x7efe5c09f0f0 2023-09-30T22:28:21.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.539+0000 7efe5b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efe5c09d920 0x7efe5c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.539+0000 7efe5b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efe5c09d920 0x7efe5c09dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41450/0 (socket says 172.21.15.40:41450) 2023-09-30T22:28:21.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.539+0000 7efe5b7fe700 1 -- 172.21.15.40:0/1600849887 learned_addr learned my addr 172.21.15.40:0/1600849887 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:21.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.539+0000 7efe5b7fe700 1 -- 172.21.15.40:0/1600849887 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe5c09f0f0 msgr2=0x7efe5c09e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:21.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.539+0000 7efe5b7fe700 1 --2- 172.21.15.40:0/1600849887 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe5c09f0f0 0x7efe5c09e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.539+0000 7efe5b7fe700 1 -- 172.21.15.40:0/1600849887 >> v1:172.21.15.40:6789/0 conn(0x7efe5c133ca0 legacy=0x7efe5c134120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.539+0000 7efe5b7fe700 1 -- 172.21.15.40:0/1600849887 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe5c09f6e0 con 0x7efe5c09d920 2023-09-30T22:28:21.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.539+0000 7efe5b7fe700 1 --2- 172.21.15.40:0/1600849887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe5c09d920 0x7efe5c09dcf0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7efe4c0098f0 tx=0x7efe4c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae16a5f6e97c1e29 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:21.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.539+0000 7efe5a7fc700 1 -- 172.21.15.40:0/1600849887 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4c005e30 con 0x7efe5c09d920 2023-09-30T22:28:21.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.539+0000 7efe5a7fc700 1 -- 172.21.15.40:0/1600849887 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4c004030 con 0x7efe5c09d920 2023-09-30T22:28:21.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.540+0000 7efe5a7fc700 1 -- 172.21.15.40:0/1600849887 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4c0043e0 con 0x7efe5c09d920 2023-09-30T22:28:21.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.540+0000 7efe61dfd700 1 -- 172.21.15.40:0/1600849887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe5c09d920 msgr2=0x7efe5c09dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.540+0000 7efe61dfd700 1 --2- 172.21.15.40:0/1600849887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe5c09d920 0x7efe5c09dcf0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7efe4c0098f0 tx=0x7efe4c009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:21.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.540+0000 7efe61dfd700 1 -- 172.21.15.40:0/1600849887 shutdown_connections 2023-09-30T22:28:21.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.540+0000 7efe61dfd700 1 --2- 172.21.15.40:0/1600849887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe5c09d920 0x7efe5c09dcf0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.540+0000 7efe61dfd700 1 --2- 172.21.15.40:0/1600849887 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe5c09f0f0 0x7efe5c09e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.540+0000 7efe61dfd700 1 -- 172.21.15.40:0/1600849887 >> 172.21.15.40:0/1600849887 conn(0x7efe5c09fb20 msgr2=0x7efe5c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:21.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.540+0000 7efe61dfd700 1 -- 172.21.15.40:0/1600849887 shutdown_connections 2023-09-30T22:28:21.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.540+0000 7efe61dfd700 1 -- 172.21.15.40:0/1600849887 wait complete. 2023-09-30T22:28:21.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.541+0000 7efe61dfd700 1 Processor -- start 2023-09-30T22:28:21.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.541+0000 7efe61dfd700 1 -- start start 2023-09-30T22:28:21.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.542+0000 7efe61dfd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe5c09d920 0x7efe5c11e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.542+0000 7efe61dfd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe5c133ca0 0x7efe5c11e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.542+0000 7efe61dfd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efe5c122440 0x7efe5c11eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.542+0000 7efe61dfd700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c11f8b0 con 0x7efe5c133ca0 2023-09-30T22:28:21.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.542+0000 7efe61dfd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c120030 con 0x7efe5c09d920 2023-09-30T22:28:21.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.542+0000 7efe61dfd700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c120650 con 0x7efe5c122440 2023-09-30T22:28:21.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.542+0000 7efe5affd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe5c133ca0 0x7efe5c11e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.542+0000 7efe5b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe5c09d920 0x7efe5c11e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.542+0000 7efe5affd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe5c133ca0 0x7efe5c11e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41452/0 (socket says 172.21.15.40:41452) 2023-09-30T22:28:21.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.542+0000 7efe5b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe5c09d920 0x7efe5c11e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60480/0 (socket says 172.21.15.40:60480) 2023-09-30T22:28:21.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.542+0000 7efe5affd700 1 -- 172.21.15.40:0/2831323405 learned_addr learned my addr 172.21.15.40:0/2831323405 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:21.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.542+0000 7efe5b7fe700 1 -- 172.21.15.40:0/2831323405 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efe5c122440 msgr2=0x7efe5c11eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.542+0000 7efe5b7fe700 1 --2- 172.21.15.40:0/2831323405 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efe5c122440 0x7efe5c11eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.542+0000 7efe5b7fe700 1 -- 172.21.15.40:0/2831323405 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe5c133ca0 msgr2=0x7efe5c11e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.542+0000 7efe5b7fe700 1 --2- 172.21.15.40:0/2831323405 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe5c133ca0 0x7efe5c11e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.542+0000 7efe5b7fe700 1 -- 172.21.15.40:0/2831323405 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe4c009500 con 0x7efe5c09d920 2023-09-30T22:28:21.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.542+0000 7efe5affd700 1 --2- 172.21.15.40:0/2831323405 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe5c133ca0 0x7efe5c11e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:21.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.543+0000 7efe5b7fe700 1 --2- 172.21.15.40:0/2831323405 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe5c09d920 0x7efe5c11e420 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7efe5c09ce10 tx=0x7efe4c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:21.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.543+0000 7efe43fff700 1 -- 172.21.15.40:0/2831323405 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4c0045e0 con 0x7efe5c09d920 2023-09-30T22:28:21.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.543+0000 7efe43fff700 1 -- 172.21.15.40:0/2831323405 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4c003d90 con 0x7efe5c09d920 2023-09-30T22:28:21.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.543+0000 7efe61dfd700 1 -- 172.21.15.40:0/2831323405 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe5c121280 con 0x7efe5c09d920 2023-09-30T22:28:21.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.543+0000 7efe43fff700 1 -- 172.21.15.40:0/2831323405 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4c011640 con 0x7efe5c09d920 2023-09-30T22:28:21.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.543+0000 7efe61dfd700 1 -- 172.21.15.40:0/2831323405 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe5c0a29a0 con 0x7efe5c09d920 2023-09-30T22:28:21.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.543+0000 7efe43fff700 1 -- 172.21.15.40:0/2831323405 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efe4c018070 con 0x7efe5c09d920 2023-09-30T22:28:21.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.544+0000 7efe43fff700 1 -- 172.21.15.40:0/2831323405 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7efe4c040140 con 0x7efe5c09d920 2023-09-30T22:28:21.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.544+0000 7efe61dfd700 1 -- 172.21.15.40:0/2831323405 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe5c09c9e0 con 0x7efe5c09d920 2023-09-30T22:28:21.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.549+0000 7efe43fff700 1 -- 172.21.15.40:0/2831323405 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efe4c016080 con 0x7efe5c09d920 2023-09-30T22:28:21.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.600+0000 7fe898c1a700 1 Processor -- start 2023-09-30T22:28:21.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.600+0000 7fe898c1a700 1 -- start start 2023-09-30T22:28:21.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.600+0000 7fe898c1a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe89409c890 0x7fe89409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.600+0000 7fe898c1a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe89409d920 0x7fe89409dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.600+0000 7fe898c1a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe89409e2b0 0x7fe89413ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.600+0000 7fe898c1a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8940a29d0 con 0x7fe89409e2b0 2023-09-30T22:28:21.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.600+0000 7fe898c1a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89409fb40 con 0x7fe89409c890 2023-09-30T22:28:21.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.600+0000 7fe898c1a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8940a2600 con 0x7fe89409d920 2023-09-30T22:28:21.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.600+0000 7fe891d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe89409d920 0x7fe89409dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.600+0000 7fe891d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe89409d920 0x7fe89409dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41162/0 (socket says 172.21.15.40:41162) 2023-09-30T22:28:21.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.600+0000 7fe891d9b700 1 -- 172.21.15.40:0/3860988298 learned_addr learned my addr 172.21.15.40:0/3860988298 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:21.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.601+0000 7fe892d9d700 1 --2- 172.21.15.40:0/3860988298 >> v2:172.21.15.40:3300/0 conn(0x7fe89409e2b0 0x7fe89413ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.601+0000 7fe89259c700 1 --2- 172.21.15.40:0/3860988298 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe89409c890 0x7fe89409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.601+0000 7fe891d9b700 1 -- 172.21.15.40:0/3860988298 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe89409c890 msgr2=0x7fe89409cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:21.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.601+0000 7fe891d9b700 1 --2- 172.21.15.40:0/3860988298 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe89409c890 0x7fe89409cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.601+0000 7fe891d9b700 1 -- 172.21.15.40:0/3860988298 >> v2:172.21.15.40:3300/0 conn(0x7fe89409e2b0 msgr2=0x7fe89413ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:21.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.601+0000 7fe891d9b700 1 --2- 172.21.15.40:0/3860988298 >> v2:172.21.15.40:3300/0 conn(0x7fe89409e2b0 0x7fe89413ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.601+0000 7fe891d9b700 1 -- 172.21.15.40:0/3860988298 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89409e720 con 0x7fe89409d920 2023-09-30T22:28:21.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.601+0000 7fe891d9b700 1 --2- 172.21.15.40:0/3860988298 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe89409d920 0x7fe89409dd70 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe8880098f0 tx=0x7fe888009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55b216eae737c96 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:21.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.601+0000 7fe89159a700 1 -- 172.21.15.40:0/3860988298 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe888011830 con 0x7fe89409d920 2023-09-30T22:28:21.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.601+0000 7fe89159a700 1 -- 172.21.15.40:0/3860988298 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe888011990 con 0x7fe89409d920 2023-09-30T22:28:21.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.601+0000 7fe89159a700 1 -- 172.21.15.40:0/3860988298 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe888011d20 con 0x7fe89409d920 2023-09-30T22:28:21.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.602+0000 7fe898c1a700 1 -- 172.21.15.40:0/3860988298 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe89409d920 msgr2=0x7fe89409dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.602+0000 7fe898c1a700 1 --2- 172.21.15.40:0/3860988298 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe89409d920 0x7fe89409dd70 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe8880098f0 tx=0x7fe888009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:21.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.602+0000 7fe898c1a700 1 -- 172.21.15.40:0/3860988298 shutdown_connections 2023-09-30T22:28:21.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.602+0000 7fe898c1a700 1 --2- 172.21.15.40:0/3860988298 >> v2:172.21.15.40:3300/0 conn(0x7fe89409e2b0 0x7fe89413ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.602+0000 7fe898c1a700 1 --2- 172.21.15.40:0/3860988298 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe89409c890 0x7fe89409cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.602+0000 7fe898c1a700 1 --2- 172.21.15.40:0/3860988298 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe89409d920 0x7fe89409dd70 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.602+0000 7fe898c1a700 1 -- 172.21.15.40:0/3860988298 >> 172.21.15.40:0/3860988298 conn(0x7fe8940a7080 msgr2=0x7fe8940a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:21.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.602+0000 7fe898c1a700 1 -- 172.21.15.40:0/3860988298 shutdown_connections 2023-09-30T22:28:21.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.602+0000 7fe898c1a700 1 -- 172.21.15.40:0/3860988298 wait complete. 2023-09-30T22:28:21.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.603+0000 7fe898c1a700 1 Processor -- start 2023-09-30T22:28:21.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.604+0000 7fe898c1a700 1 -- start start 2023-09-30T22:28:21.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.604+0000 7fe898c1a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe89409c890 0x7fe89412d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.604+0000 7fe898c1a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe89409d920 0x7fe89412d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.604+0000 7fe898c1a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe89409e2b0 0x7fe89412dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.604+0000 7fe898c1a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89412fab0 con 0x7fe89409c890 2023-09-30T22:28:21.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.604+0000 7fe898c1a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89409c270 con 0x7fe89409d920 2023-09-30T22:28:21.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.604+0000 7fe898c1a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8940a5c40 con 0x7fe89409e2b0 2023-09-30T22:28:21.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.604+0000 7fe892d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe89409e2b0 0x7fe89412dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.604+0000 7fe892d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe89409e2b0 0x7fe89412dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41166/0 (socket says 172.21.15.40:41166) 2023-09-30T22:28:21.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.604+0000 7fe89259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe89409c890 0x7fe89412d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.604+0000 7fe891d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe89409d920 0x7fe89412d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.604+0000 7fe892d9d700 1 -- 172.21.15.40:0/3510549504 learned_addr learned my addr 172.21.15.40:0/3510549504 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:21.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.605+0000 7fe892d9d700 1 -- 172.21.15.40:0/3510549504 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe89409d920 msgr2=0x7fe89412d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.605+0000 7fe892d9d700 1 --2- 172.21.15.40:0/3510549504 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe89409d920 0x7fe89412d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.605+0000 7fe892d9d700 1 -- 172.21.15.40:0/3510549504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe89409c890 msgr2=0x7fe89412d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.605+0000 7fe892d9d700 1 --2- 172.21.15.40:0/3510549504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe89409c890 0x7fe89412d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.605+0000 7fe892d9d700 1 -- 172.21.15.40:0/3510549504 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe888009550 con 0x7fe89409e2b0 2023-09-30T22:28:21.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.605+0000 7fe89259c700 1 --2- 172.21.15.40:0/3510549504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe89409c890 0x7fe89412d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:21.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.605+0000 7fe891d9b700 1 --2- 172.21.15.40:0/3510549504 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe89409d920 0x7fe89412d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:21.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.605+0000 7fe892d9d700 1 --2- 172.21.15.40:0/3510549504 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe89409e2b0 0x7fe89412dab0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe88c00efc0 tx=0x7fe88c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:21.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.605+0000 7fe882ffd700 1 -- 172.21.15.40:0/3510549504 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c009ea0 con 0x7fe89409e2b0 2023-09-30T22:28:21.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.605+0000 7fe882ffd700 1 -- 172.21.15.40:0/3510549504 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88c00f040 con 0x7fe89409e2b0 2023-09-30T22:28:21.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.605+0000 7fe882ffd700 1 -- 172.21.15.40:0/3510549504 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c00ced0 con 0x7fe89409e2b0 2023-09-30T22:28:21.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.605+0000 7fe898c1a700 1 -- 172.21.15.40:0/3510549504 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe89409ecf0 con 0x7fe89409e2b0 2023-09-30T22:28:21.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.605+0000 7fe898c1a700 1 -- 172.21.15.40:0/3510549504 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8941302a0 con 0x7fe89409e2b0 2023-09-30T22:28:21.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.606+0000 7fe882ffd700 1 -- 172.21.15.40:0/3510549504 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe88c014480 con 0x7fe89409e2b0 2023-09-30T22:28:21.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.606+0000 7fe898c1a700 1 -- 172.21.15.40:0/3510549504 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe894070610 con 0x7fe89409e2b0 2023-09-30T22:28:21.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.607+0000 7fe882ffd700 1 -- 172.21.15.40:0/3510549504 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe88c03fe80 con 0x7fe89409e2b0 2023-09-30T22:28:21.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.611+0000 7fe882ffd700 1 -- 172.21.15.40:0/3510549504 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe88c018080 con 0x7fe89409e2b0 2023-09-30T22:28:21.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.641+0000 7f9c97bbc700 1 Processor -- start 2023-09-30T22:28:21.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.641+0000 7f9c97bbc700 1 -- start start 2023-09-30T22:28:21.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.641+0000 7f9c97bbc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9c9009fbb0 0x7f9c9006c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.641+0000 7f9c97bbc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c9006ced0 0x7f9c9006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.641+0000 7f9c97bbc700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c9006d800 con 0x7f9c90138370 2023-09-30T22:28:21.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.641+0000 7f9c97bbc700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c9009ff80 con 0x7f9c9009fbb0 2023-09-30T22:28:21.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.641+0000 7f9c97bbc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9006da80 con 0x7f9c9006ced0 2023-09-30T22:28:21.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.641+0000 7f9c95958700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9c9009fbb0 0x7f9c9006c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.642+0000 7f9c95157700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c9006ced0 0x7f9c9006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.642+0000 7f9c95157700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c9006ced0 0x7f9c9006d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60508/0 (socket says 172.21.15.40:60508) 2023-09-30T22:28:21.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.642+0000 7f9c95958700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9c9009fbb0 0x7f9c9006c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41492/0 (socket says 172.21.15.40:41492) 2023-09-30T22:28:21.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.642+0000 7f9c95157700 1 -- 172.21.15.40:0/3383832833 learned_addr learned my addr 172.21.15.40:0/3383832833 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:21.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.642+0000 7f9c95157700 1 -- 172.21.15.40:0/3383832833 >> v2:172.21.15.40:3300/0 conn(0x7f9c9009fbb0 msgr2=0x7f9c9006c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:21.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.642+0000 7f9c95157700 1 --2- 172.21.15.40:0/3383832833 >> v2:172.21.15.40:3300/0 conn(0x7f9c9009fbb0 0x7f9c9006c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.642+0000 7f9c95157700 1 -- 172.21.15.40:0/3383832833 >> v1:172.21.15.40:6789/0 conn(0x7f9c90138370 legacy=0x7f9c9013a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.642+0000 7f9c94956700 1 -- 172.21.15.40:0/3383832833 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 884617343 0 0) 0x7f9c88001490 con 0x7f9c90138370 2023-09-30T22:28:21.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.642+0000 7f9c95157700 1 -- 172.21.15.40:0/3383832833 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c900a0590 con 0x7f9c9006ced0 2023-09-30T22:28:21.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.642+0000 7f9c95958700 1 --2- 172.21.15.40:0/3383832833 >> v2:172.21.15.40:3300/0 conn(0x7f9c9009fbb0 0x7f9c9006c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:21.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.642+0000 7f9c95157700 1 --2- 172.21.15.40:0/3383832833 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c9006ced0 0x7f9c9006d2c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f9c840098f0 tx=0x7f9c84009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2576d68ca451f7a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:21.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.642+0000 7f9c94956700 1 -- 172.21.15.40:0/3383832833 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c84011830 con 0x7f9c9006ced0 2023-09-30T22:28:21.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.642+0000 7f9c94956700 1 -- 172.21.15.40:0/3383832833 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c84011990 con 0x7f9c9006ced0 2023-09-30T22:28:21.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.642+0000 7f9c94956700 1 -- 172.21.15.40:0/3383832833 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c84011d20 con 0x7f9c9006ced0 2023-09-30T22:28:21.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.643+0000 7f9c97bbc700 1 -- 172.21.15.40:0/3383832833 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c9006ced0 msgr2=0x7f9c9006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.643+0000 7f9c97bbc700 1 --2- 172.21.15.40:0/3383832833 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c9006ced0 0x7f9c9006d2c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f9c840098f0 tx=0x7f9c84009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:21.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.643+0000 7f9c97bbc700 1 -- 172.21.15.40:0/3383832833 shutdown_connections 2023-09-30T22:28:21.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.643+0000 7f9c97bbc700 1 --2- 172.21.15.40:0/3383832833 >> v2:172.21.15.40:3300/0 conn(0x7f9c9009fbb0 0x7f9c9006c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.643+0000 7f9c97bbc700 1 --2- 172.21.15.40:0/3383832833 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c9006ced0 0x7f9c9006d2c0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.643+0000 7f9c97bbc700 1 -- 172.21.15.40:0/3383832833 >> 172.21.15.40:0/3383832833 conn(0x7f9c900a41a0 msgr2=0x7f9c900a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:21.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.643+0000 7f9c97bbc700 1 -- 172.21.15.40:0/3383832833 shutdown_connections 2023-09-30T22:28:21.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.643+0000 7f9c97bbc700 1 -- 172.21.15.40:0/3383832833 wait complete. 2023-09-30T22:28:21.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.644+0000 7f9c97bbc700 1 Processor -- start 2023-09-30T22:28:21.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.644+0000 7f9c97bbc700 1 -- start start 2023-09-30T22:28:21.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.644+0000 7f9c97bbc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c9006ced0 0x7f9c900908a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.644+0000 7f9c97bbc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c9009fbb0 0x7f9c90090de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.644+0000 7f9c97bbc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9c90138370 0x7f9c90091320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.644+0000 7f9c97bbc700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c90092eb0 con 0x7f9c9006ced0 2023-09-30T22:28:21.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.644+0000 7f9c97bbc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c90071f20 con 0x7f9c9009fbb0 2023-09-30T22:28:21.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.644+0000 7f9c97bbc700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c90094dd0 con 0x7f9c90138370 2023-09-30T22:28:21.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.645+0000 7f9c95157700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c9009fbb0 0x7f9c90090de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.645+0000 7f9c95157700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c9009fbb0 0x7f9c90090de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60512/0 (socket says 172.21.15.40:60512) 2023-09-30T22:28:21.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.645+0000 7f9c95157700 1 -- 172.21.15.40:0/4269744006 learned_addr learned my addr 172.21.15.40:0/4269744006 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:21.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.645+0000 7f9c95958700 1 --2- 172.21.15.40:0/4269744006 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c9006ced0 0x7f9c900908a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.645+0000 7f9c96159700 1 --2- 172.21.15.40:0/4269744006 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9c90138370 0x7f9c90091320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.645+0000 7f9c95958700 1 -- 172.21.15.40:0/4269744006 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9c90138370 msgr2=0x7f9c90091320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.645+0000 7f9c95958700 1 --2- 172.21.15.40:0/4269744006 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9c90138370 0x7f9c90091320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.645+0000 7f9c95958700 1 -- 172.21.15.40:0/4269744006 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c9009fbb0 msgr2=0x7f9c90090de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.645+0000 7f9c95958700 1 --2- 172.21.15.40:0/4269744006 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c9009fbb0 0x7f9c90090de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.645+0000 7f9c95958700 1 -- 172.21.15.40:0/4269744006 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c800094a0 con 0x7f9c9006ced0 2023-09-30T22:28:21.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.645+0000 7f9c95958700 1 --2- 172.21.15.40:0/4269744006 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c9006ced0 0x7f9c900908a0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f9c8000e9b0 tx=0x7f9c8000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:21.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.645+0000 7f9c8e7fc700 1 -- 172.21.15.40:0/4269744006 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8000c850 con 0x7f9c9006ced0 2023-09-30T22:28:21.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.645+0000 7f9c8e7fc700 1 -- 172.21.15.40:0/4269744006 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8000c9b0 con 0x7f9c9006ced0 2023-09-30T22:28:21.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.645+0000 7f9c97bbc700 1 -- 172.21.15.40:0/4269744006 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c84009550 con 0x7f9c9006ced0 2023-09-30T22:28:21.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.645+0000 7f9c8e7fc700 1 -- 172.21.15.40:0/4269744006 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8000cd60 con 0x7f9c9006ced0 2023-09-30T22:28:21.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.645+0000 7f9c97bbc700 1 -- 172.21.15.40:0/4269744006 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c900947e0 con 0x7f9c9006ced0 2023-09-30T22:28:21.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.646+0000 7f9c8e7fc700 1 -- 172.21.15.40:0/4269744006 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9c80013470 con 0x7f9c9006ced0 2023-09-30T22:28:21.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.646+0000 7f9c97bbc700 1 -- 172.21.15.40:0/4269744006 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c90093c50 con 0x7f9c9006ced0 2023-09-30T22:28:21.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.647+0000 7f9c8e7fc700 1 -- 172.21.15.40:0/4269744006 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9c8003fc90 con 0x7f9c9006ced0 2023-09-30T22:28:21.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.651+0000 7f9c8e7fc700 1 -- 172.21.15.40:0/4269744006 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9c8001b3b0 con 0x7f9c9006ced0 2023-09-30T22:28:21.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.765+0000 7efe61dfd700 1 -- 172.21.15.40:0/2831323405 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efe5c062380 con 0x7efe5c09d920 2023-09-30T22:28:21.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.765+0000 7efe43fff700 1 -- 172.21.15.40:0/2831323405 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efe4c029020 con 0x7efe5c09d920 2023-09-30T22:28:21.766 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:21.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.767+0000 7efe61dfd700 1 -- 172.21.15.40:0/2831323405 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe5c09d920 msgr2=0x7efe5c11e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.767+0000 7efe61dfd700 1 --2- 172.21.15.40:0/2831323405 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe5c09d920 0x7efe5c11e420 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7efe5c09ce10 tx=0x7efe4c004750 comp rx=0 tx=0).stop 2023-09-30T22:28:21.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.768+0000 7efe61dfd700 1 -- 172.21.15.40:0/2831323405 shutdown_connections 2023-09-30T22:28:21.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.768+0000 7efe61dfd700 1 --2- 172.21.15.40:0/2831323405 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efe5c122440 0x7efe5c11eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.768+0000 7efe61dfd700 1 --2- 172.21.15.40:0/2831323405 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe5c09d920 0x7efe5c11e420 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.768+0000 7efe61dfd700 1 --2- 172.21.15.40:0/2831323405 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe5c133ca0 0x7efe5c11e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.768+0000 7efe61dfd700 1 -- 172.21.15.40:0/2831323405 >> 172.21.15.40:0/2831323405 conn(0x7efe5c09fb20 msgr2=0x7efe5c133360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:21.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.768+0000 7efe61dfd700 1 -- 172.21.15.40:0/2831323405 shutdown_connections 2023-09-30T22:28:21.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.768+0000 7efe61dfd700 1 -- 172.21.15.40:0/2831323405 wait complete. 2023-09-30T22:28:21.781 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:21.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.811+0000 7fe898c1a700 1 -- 172.21.15.40:0/3510549504 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe894062380 con 0x7fe89409e2b0 2023-09-30T22:28:21.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.812+0000 7fe882ffd700 1 -- 172.21.15.40:0/3510549504 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe88c01a680 con 0x7fe89409e2b0 2023-09-30T22:28:21.812 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:21.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.814+0000 7fe898c1a700 1 -- 172.21.15.40:0/3510549504 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe89409e2b0 msgr2=0x7fe89412dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.814+0000 7fe898c1a700 1 --2- 172.21.15.40:0/3510549504 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe89409e2b0 0x7fe89412dab0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe88c00efc0 tx=0x7fe88c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.814+0000 7fe898c1a700 1 -- 172.21.15.40:0/3510549504 shutdown_connections 2023-09-30T22:28:21.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.814+0000 7fe898c1a700 1 --2- 172.21.15.40:0/3510549504 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe89409e2b0 0x7fe89412dab0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.814+0000 7fe898c1a700 1 --2- 172.21.15.40:0/3510549504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe89409c890 0x7fe89412d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.814+0000 7fe898c1a700 1 --2- 172.21.15.40:0/3510549504 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe89409d920 0x7fe89412d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.814+0000 7fe898c1a700 1 -- 172.21.15.40:0/3510549504 >> 172.21.15.40:0/3510549504 conn(0x7fe8940a7080 msgr2=0x7fe894133320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:21.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.814+0000 7fe898c1a700 1 -- 172.21.15.40:0/3510549504 shutdown_connections 2023-09-30T22:28:21.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.814+0000 7fe898c1a700 1 -- 172.21.15.40:0/3510549504 wait complete. 2023-09-30T22:28:21.826 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:21.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.865+0000 7f9c97bbc700 1 -- 172.21.15.40:0/4269744006 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9c900a0780 con 0x7f9c9006ced0 2023-09-30T22:28:21.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.865+0000 7f9c8e7fc700 1 -- 172.21.15.40:0/4269744006 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9c80021070 con 0x7f9c9006ced0 2023-09-30T22:28:21.866 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:21.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.867+0000 7f9c97bbc700 1 -- 172.21.15.40:0/4269744006 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c9006ced0 msgr2=0x7f9c900908a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.867+0000 7f9c97bbc700 1 --2- 172.21.15.40:0/4269744006 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c9006ced0 0x7f9c900908a0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f9c8000e9b0 tx=0x7f9c8000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.867+0000 7f9c97bbc700 1 -- 172.21.15.40:0/4269744006 shutdown_connections 2023-09-30T22:28:21.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.867+0000 7f9c97bbc700 1 --2- 172.21.15.40:0/4269744006 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9c90138370 0x7f9c90091320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.867+0000 7f9c97bbc700 1 --2- 172.21.15.40:0/4269744006 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c9006ced0 0x7f9c900908a0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.867+0000 7f9c97bbc700 1 --2- 172.21.15.40:0/4269744006 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c9009fbb0 0x7f9c90090de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.867+0000 7f9c97bbc700 1 -- 172.21.15.40:0/4269744006 >> 172.21.15.40:0/4269744006 conn(0x7f9c900a41a0 msgr2=0x7f9c90137590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:21.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.867+0000 7f9c97bbc700 1 -- 172.21.15.40:0/4269744006 shutdown_connections 2023-09-30T22:28:21.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:21.868+0000 7f9c97bbc700 1 -- 172.21.15.40:0/4269744006 wait complete. 2023-09-30T22:28:21.880 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:22.306 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:22.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.437+0000 7f4fb7c36700 1 Processor -- start 2023-09-30T22:28:22.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.437+0000 7f4fb7c36700 1 -- start start 2023-09-30T22:28:22.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.438+0000 7f4fb7c36700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fb009c890 0x7f4fb009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.438+0000 7f4fb7c36700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fb009d920 0x7f4fb009dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.438+0000 7f4fb7c36700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4fb009e2b0 0x7f4fb013ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.438+0000 7f4fb7c36700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb00a29d0 con 0x7f4fb009e2b0 2023-09-30T22:28:22.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.438+0000 7f4fb7c36700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb009fb40 con 0x7f4fb009d920 2023-09-30T22:28:22.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.438+0000 7f4fb7c36700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb00a2600 con 0x7f4fb009c890 2023-09-30T22:28:22.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.438+0000 7f4fb59d2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fb009c890 0x7f4fb009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:22.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.438+0000 7f4fb61d3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4fb009e2b0 0x7f4fb013ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:22.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.438+0000 7f4fb51d1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fb009d920 0x7f4fb009dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:22.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.438+0000 7f4fb51d1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fb009d920 0x7f4fb009dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60520/0 (socket says 172.21.15.40:60520) 2023-09-30T22:28:22.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.438+0000 7f4fb59d2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fb009c890 0x7f4fb009cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41180/0 (socket says 172.21.15.40:41180) 2023-09-30T22:28:22.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.438+0000 7f4fb61d3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4fb009e2b0 0x7f4fb013ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41508/0 (socket says 172.21.15.40:41508) 2023-09-30T22:28:22.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.438+0000 7f4fb59d2700 1 -- 172.21.15.40:0/1664644316 learned_addr learned my addr 172.21.15.40:0/1664644316 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:22.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.438+0000 7f4fb51d1700 1 -- 172.21.15.40:0/1664644316 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fb009c890 msgr2=0x7f4fb009cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:22.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.438+0000 7f4fb51d1700 1 --2- 172.21.15.40:0/1664644316 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fb009c890 0x7f4fb009cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.438+0000 7f4fb51d1700 1 -- 172.21.15.40:0/1664644316 >> v2:172.21.15.40:3300/0 conn(0x7f4fb009e2b0 msgr2=0x7f4fb013ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:22.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.438+0000 7f4fb51d1700 1 --2- 172.21.15.40:0/1664644316 >> v2:172.21.15.40:3300/0 conn(0x7f4fb009e2b0 0x7f4fb013ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.438+0000 7f4fb51d1700 1 -- 172.21.15.40:0/1664644316 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb009e720 con 0x7f4fb009d920 2023-09-30T22:28:22.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.438+0000 7f4fb61d3700 1 --2- 172.21.15.40:0/1664644316 >> v2:172.21.15.40:3300/0 conn(0x7f4fb009e2b0 0x7f4fb013ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:22.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.438+0000 7f4fb59d2700 1 --2- 172.21.15.40:0/1664644316 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fb009c890 0x7f4fb009cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:22.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.439+0000 7f4fb51d1700 1 --2- 172.21.15.40:0/1664644316 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fb009d920 0x7f4fb009dd70 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4009870 tx=0x7f4fa4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ac58ce5d435d031 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:22.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.439+0000 7f4fb49d0700 1 -- 172.21.15.40:0/1664644316 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4011830 con 0x7f4fb009d920 2023-09-30T22:28:22.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.439+0000 7f4fb49d0700 1 -- 172.21.15.40:0/1664644316 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa4011990 con 0x7f4fb009d920 2023-09-30T22:28:22.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.439+0000 7f4fb49d0700 1 -- 172.21.15.40:0/1664644316 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4011d20 con 0x7f4fb009d920 2023-09-30T22:28:22.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.439+0000 7f4fb7c36700 1 -- 172.21.15.40:0/1664644316 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fb009d920 msgr2=0x7f4fb009dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:22.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.439+0000 7f4fb7c36700 1 --2- 172.21.15.40:0/1664644316 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fb009d920 0x7f4fb009dd70 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4009870 tx=0x7f4fa4009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:22.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.439+0000 7f4fb7c36700 1 -- 172.21.15.40:0/1664644316 shutdown_connections 2023-09-30T22:28:22.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.439+0000 7f4fb7c36700 1 --2- 172.21.15.40:0/1664644316 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fb009c890 0x7f4fb009cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.439+0000 7f4fb7c36700 1 --2- 172.21.15.40:0/1664644316 >> v2:172.21.15.40:3300/0 conn(0x7f4fb009e2b0 0x7f4fb013ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.439+0000 7f4fb7c36700 1 --2- 172.21.15.40:0/1664644316 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fb009d920 0x7f4fb009dd70 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.439+0000 7f4fb7c36700 1 -- 172.21.15.40:0/1664644316 >> 172.21.15.40:0/1664644316 conn(0x7f4fb00a7080 msgr2=0x7f4fb00a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:22.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.439+0000 7f4fb7c36700 1 -- 172.21.15.40:0/1664644316 shutdown_connections 2023-09-30T22:28:22.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.439+0000 7f4fb7c36700 1 -- 172.21.15.40:0/1664644316 wait complete. 2023-09-30T22:28:22.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.440+0000 7f4fb7c36700 1 Processor -- start 2023-09-30T22:28:22.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.440+0000 7f4fb7c36700 1 -- start start 2023-09-30T22:28:22.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.441+0000 7f4fb7c36700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fb009c890 0x7f4fb012d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.441+0000 7f4fb7c36700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fb009d920 0x7f4fb012d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.441+0000 7f4fb7c36700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fb009e2b0 0x7f4fb012de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.441+0000 7f4fb7c36700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb012fb00 con 0x7f4fb009d920 2023-09-30T22:28:22.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.441+0000 7f4fb7c36700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb0130650 con 0x7f4fb009e2b0 2023-09-30T22:28:22.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.441+0000 7f4fb7c36700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb012f240 con 0x7f4fb009c890 2023-09-30T22:28:22.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.441+0000 7f4fb59d2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fb009c890 0x7f4fb012d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:22.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.441+0000 7f4fb51d1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fb009d920 0x7f4fb012d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:22.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.441+0000 7f4fb59d2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fb009c890 0x7f4fb012d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41194/0 (socket says 172.21.15.40:41194) 2023-09-30T22:28:22.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.441+0000 7f4fb59d2700 1 -- 172.21.15.40:0/376362592 learned_addr learned my addr 172.21.15.40:0/376362592 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:22.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.441+0000 7f4fb61d3700 1 --2- 172.21.15.40:0/376362592 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fb009e2b0 0x7f4fb012de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:22.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.441+0000 7f4fb59d2700 1 -- 172.21.15.40:0/376362592 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fb009e2b0 msgr2=0x7f4fb012de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:22.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.441+0000 7f4fb59d2700 1 --2- 172.21.15.40:0/376362592 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fb009e2b0 0x7f4fb012de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.441+0000 7f4fb59d2700 1 -- 172.21.15.40:0/376362592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fb009d920 msgr2=0x7f4fb012d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:22.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.441+0000 7f4fb59d2700 1 --2- 172.21.15.40:0/376362592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fb009d920 0x7f4fb012d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.441+0000 7f4fb59d2700 1 -- 172.21.15.40:0/376362592 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa0009500 con 0x7f4fb009c890 2023-09-30T22:28:22.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.441+0000 7f4fb51d1700 1 --2- 172.21.15.40:0/376362592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fb009d920 0x7f4fb012d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:22.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.441+0000 7f4fb59d2700 1 --2- 172.21.15.40:0/376362592 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fb009c890 0x7f4fb012d410 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000ebb0 tx=0x7f4fa000eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:22.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.442+0000 7f4fae7fc700 1 -- 172.21.15.40:0/376362592 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0009830 con 0x7f4fb009c890 2023-09-30T22:28:22.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.442+0000 7f4fae7fc700 1 -- 172.21.15.40:0/376362592 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa0005a20 con 0x7f4fb009c890 2023-09-30T22:28:22.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.442+0000 7f4fae7fc700 1 -- 172.21.15.40:0/376362592 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0005db0 con 0x7f4fb009c890 2023-09-30T22:28:22.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.442+0000 7f4fb7c36700 1 -- 172.21.15.40:0/376362592 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa8009a70 con 0x7f4fb009c890 2023-09-30T22:28:22.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.442+0000 7f4fb7c36700 1 -- 172.21.15.40:0/376362592 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa40094a0 con 0x7f4fb009c890 2023-09-30T22:28:22.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.442+0000 7f4fae7fc700 1 -- 172.21.15.40:0/376362592 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4fa000c850 con 0x7f4fb009c890 2023-09-30T22:28:22.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.442+0000 7f4fae7fc700 1 -- 172.21.15.40:0/376362592 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4fa003f9e0 con 0x7f4fb009c890 2023-09-30T22:28:22.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.443+0000 7f4fb7c36700 1 -- 172.21.15.40:0/376362592 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb009ed50 con 0x7f4fb009c890 2023-09-30T22:28:22.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.447+0000 7f4fae7fc700 1 -- 172.21.15.40:0/376362592 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4fa0020020 con 0x7f4fb009c890 2023-09-30T22:28:22.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.645+0000 7f4fb7c36700 1 -- 172.21.15.40:0/376362592 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4fb0062380 con 0x7f4fb009c890 2023-09-30T22:28:22.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.646+0000 7f4fae7fc700 1 -- 172.21.15.40:0/376362592 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4fa0006030 con 0x7f4fb009c890 2023-09-30T22:28:22.647 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:22.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.648+0000 7f4fb7c36700 1 -- 172.21.15.40:0/376362592 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fb009c890 msgr2=0x7f4fb012d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:22.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.648+0000 7f4fb7c36700 1 --2- 172.21.15.40:0/376362592 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fb009c890 0x7f4fb012d410 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000ebb0 tx=0x7f4fa000eec0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.648+0000 7f4fb7c36700 1 -- 172.21.15.40:0/376362592 shutdown_connections 2023-09-30T22:28:22.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.648+0000 7f4fb7c36700 1 --2- 172.21.15.40:0/376362592 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fb009c890 0x7f4fb012d410 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.648+0000 7f4fb7c36700 1 --2- 172.21.15.40:0/376362592 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fb009e2b0 0x7f4fb012de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.648+0000 7f4fb7c36700 1 --2- 172.21.15.40:0/376362592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fb009d920 0x7f4fb012d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.648+0000 7f4fb7c36700 1 -- 172.21.15.40:0/376362592 >> 172.21.15.40:0/376362592 conn(0x7f4fb00a7080 msgr2=0x7f4fb00a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:22.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.648+0000 7f4fb7c36700 1 -- 172.21.15.40:0/376362592 shutdown_connections 2023-09-30T22:28:22.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.648+0000 7f4fb7c36700 1 -- 172.21.15.40:0/376362592 wait complete. 2023-09-30T22:28:22.661 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:22.781 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:22.827 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:22.881 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:22.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.914+0000 7f4c1848d700 1 Processor -- start 2023-09-30T22:28:22.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.914+0000 7f4c1848d700 1 -- start start 2023-09-30T22:28:22.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.915+0000 7f4c1848d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c1009d920 0x7f4c1009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.915+0000 7f4c1848d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c1009e230 0x7f4c101308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.915+0000 7f4c1848d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c1009adf0 con 0x7f4c10130de0 2023-09-30T22:28:22.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.915+0000 7f4c1848d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1009edf0 con 0x7f4c1009e230 2023-09-30T22:28:22.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.915+0000 7f4c1848d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1009b660 con 0x7f4c1009d920 2023-09-30T22:28:22.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.915+0000 7f4c16a2a700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f4c10130de0 0x7f4c10137d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39632/0 (socket says 172.21.15.40:39632) 2023-09-30T22:28:22.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.915+0000 7f4c16a2a700 1 -- 172.21.15.40:0/1998521539 learned_addr learned my addr 172.21.15.40:0/1998521539 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:22.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.915+0000 7f4c15a28700 1 --2- 172.21.15.40:0/1998521539 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c1009e230 0x7f4c101308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:22.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.915+0000 7f4c16229700 1 --2- 172.21.15.40:0/1998521539 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c1009d920 0x7f4c1009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:22.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.916+0000 7f4c15227700 1 -- 172.21.15.40:0/1998521539 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3199647266 0 0) 0x7f4c1009adf0 con 0x7f4c10130de0 2023-09-30T22:28:22.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.916+0000 7f4c16229700 1 -- 172.21.15.40:0/1998521539 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c1009e230 msgr2=0x7f4c101308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:22.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.916+0000 7f4c16229700 1 --2- 172.21.15.40:0/1998521539 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c1009e230 0x7f4c101308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.916+0000 7f4c16229700 1 -- 172.21.15.40:0/1998521539 >> v1:172.21.15.40:6789/0 conn(0x7f4c10130de0 legacy=0x7f4c10137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:22.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.916+0000 7f4c16229700 1 -- 172.21.15.40:0/1998521539 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1009a6e0 con 0x7f4c1009d920 2023-09-30T22:28:22.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.916+0000 7f4c16229700 1 --2- 172.21.15.40:0/1998521539 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c1009d920 0x7f4c1009dcf0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c009850 tx=0x7f4c0c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25e5848ae72bd9b4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:22.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.916+0000 7f4c15227700 1 -- 172.21.15.40:0/1998521539 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c005e30 con 0x7f4c1009d920 2023-09-30T22:28:22.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.916+0000 7f4c15227700 1 -- 172.21.15.40:0/1998521539 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0c006030 con 0x7f4c1009d920 2023-09-30T22:28:22.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.916+0000 7f4c15227700 1 -- 172.21.15.40:0/1998521539 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c0063e0 con 0x7f4c1009d920 2023-09-30T22:28:22.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.917+0000 7f4c1848d700 1 -- 172.21.15.40:0/1998521539 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c1009d920 msgr2=0x7f4c1009dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:22.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.917+0000 7f4c1848d700 1 --2- 172.21.15.40:0/1998521539 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c1009d920 0x7f4c1009dcf0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c009850 tx=0x7f4c0c009b60 comp rx=0 tx=0).stop 2023-09-30T22:28:22.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.917+0000 7f4c1848d700 1 -- 172.21.15.40:0/1998521539 shutdown_connections 2023-09-30T22:28:22.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.917+0000 7f4c1848d700 1 --2- 172.21.15.40:0/1998521539 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c1009d920 0x7f4c1009dcf0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.917+0000 7f4c1848d700 1 --2- 172.21.15.40:0/1998521539 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c1009e230 0x7f4c101308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.917+0000 7f4c1848d700 1 -- 172.21.15.40:0/1998521539 >> 172.21.15.40:0/1998521539 conn(0x7f4c1009fb20 msgr2=0x7f4c1009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:22.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.917+0000 7f4c1848d700 1 -- 172.21.15.40:0/1998521539 shutdown_connections 2023-09-30T22:28:22.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.917+0000 7f4c1848d700 1 -- 172.21.15.40:0/1998521539 wait complete. 2023-09-30T22:28:22.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.918+0000 7f4c1848d700 1 Processor -- start 2023-09-30T22:28:22.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.918+0000 7f4c1848d700 1 -- start start 2023-09-30T22:28:22.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.918+0000 7f4c1848d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c1009d920 0x7f4c10135ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.918+0000 7f4c1848d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c1009e230 0x7f4c101363e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.918+0000 7f4c1848d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c10130de0 0x7f4c10136920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.918+0000 7f4c1848d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c101382e0 con 0x7f4c1009d920 2023-09-30T22:28:22.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.918+0000 7f4c1848d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c10130500 con 0x7f4c10130de0 2023-09-30T22:28:22.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.918+0000 7f4c1848d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c10119730 con 0x7f4c1009e230 2023-09-30T22:28:22.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.919+0000 7f4c16229700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c1009d920 0x7f4c10135ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:22.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.919+0000 7f4c15a28700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c1009e230 0x7f4c101363e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:22.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.919+0000 7f4c16229700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c1009d920 0x7f4c10135ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41518/0 (socket says 172.21.15.40:41518) 2023-09-30T22:28:22.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.919+0000 7f4c16229700 1 -- 172.21.15.40:0/3889810484 learned_addr learned my addr 172.21.15.40:0/3889810484 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:22.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.919+0000 7f4c16a2a700 1 --2- 172.21.15.40:0/3889810484 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c10130de0 0x7f4c10136920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:22.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.919+0000 7f4c15a28700 1 -- 172.21.15.40:0/3889810484 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c10130de0 msgr2=0x7f4c10136920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:22.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.919+0000 7f4c15a28700 1 --2- 172.21.15.40:0/3889810484 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c10130de0 0x7f4c10136920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.919+0000 7f4c15a28700 1 -- 172.21.15.40:0/3889810484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c1009d920 msgr2=0x7f4c10135ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:22.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.919+0000 7f4c15a28700 1 --2- 172.21.15.40:0/3889810484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c1009d920 0x7f4c10135ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.919+0000 7f4c15a28700 1 -- 172.21.15.40:0/3889810484 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0c009430 con 0x7f4c1009e230 2023-09-30T22:28:22.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.919+0000 7f4c16229700 1 --2- 172.21.15.40:0/3889810484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c1009d920 0x7f4c10135ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:22.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.919+0000 7f4c15a28700 1 --2- 172.21.15.40:0/3889810484 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c1009e230 0x7f4c101363e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4c0000e8d0 tx=0x7f4c0000ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:22.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.919+0000 7f4c06ffd700 1 -- 172.21.15.40:0/3889810484 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c00013680 con 0x7f4c1009e230 2023-09-30T22:28:22.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.919+0000 7f4c1848d700 1 -- 172.21.15.40:0/3889810484 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c1013a130 con 0x7f4c1009e230 2023-09-30T22:28:22.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.919+0000 7f4c1848d700 1 -- 172.21.15.40:0/3889810484 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c10138660 con 0x7f4c1009e230 2023-09-30T22:28:22.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.919+0000 7f4c06ffd700 1 -- 172.21.15.40:0/3889810484 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c00004020 con 0x7f4c1009e230 2023-09-30T22:28:22.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.919+0000 7f4c06ffd700 1 -- 172.21.15.40:0/3889810484 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c00004390 con 0x7f4c1009e230 2023-09-30T22:28:22.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.921+0000 7f4c1848d700 1 -- 172.21.15.40:0/3889810484 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf80052e0 con 0x7f4c1009e230 2023-09-30T22:28:22.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.921+0000 7f4c06ffd700 1 -- 172.21.15.40:0/3889810484 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4c000137e0 con 0x7f4c1009e230 2023-09-30T22:28:22.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.921+0000 7f4c06ffd700 1 -- 172.21.15.40:0/3889810484 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4c0003f8c0 con 0x7f4c1009e230 2023-09-30T22:28:22.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.926+0000 7f4c06ffd700 1 -- 172.21.15.40:0/3889810484 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4c0001b3b0 con 0x7f4c1009e230 2023-09-30T22:28:22.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.960+0000 7fe20b094700 1 Processor -- start 2023-09-30T22:28:22.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.960+0000 7fe20b094700 1 -- start start 2023-09-30T22:28:22.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.960+0000 7fe20b094700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe204136bf0 0x7fe204138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.960+0000 7fe20b094700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe204139510 0x7fe20413b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.960+0000 7fe20b094700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2040a2600 con 0x7fe20409c890 2023-09-30T22:28:22.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.960+0000 7fe20b094700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2040a29d0 con 0x7fe204139510 2023-09-30T22:28:22.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.960+0000 7fe20b094700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe20409fb40 con 0x7fe204136bf0 2023-09-30T22:28:22.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.961+0000 7fe203fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe204136bf0 0x7fe204138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:22.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.961+0000 7fe208e30700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe20409c890 0x7fe20409cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39646/0 (socket says 172.21.15.40:39646) 2023-09-30T22:28:22.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.961+0000 7fe203fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe204136bf0 0x7fe204138fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41214/0 (socket says 172.21.15.40:41214) 2023-09-30T22:28:22.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.961+0000 7fe208e30700 1 -- 172.21.15.40:0/381325576 learned_addr learned my addr 172.21.15.40:0/381325576 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:22.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.961+0000 7fe209631700 1 --2- 172.21.15.40:0/381325576 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe204139510 0x7fe20413b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:22.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.961+0000 7fe203fff700 1 -- 172.21.15.40:0/381325576 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe204139510 msgr2=0x7fe20413b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:22.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.961+0000 7fe203fff700 1 --2- 172.21.15.40:0/381325576 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe204139510 0x7fe20413b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.961+0000 7fe203fff700 1 -- 172.21.15.40:0/381325576 >> v1:172.21.15.40:6789/0 conn(0x7fe20409c890 legacy=0x7fe20409cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:22.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.961+0000 7fe2037fe700 1 -- 172.21.15.40:0/381325576 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1331129970 0 0) 0x7fe2040a2600 con 0x7fe20409c890 2023-09-30T22:28:22.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.961+0000 7fe203fff700 1 -- 172.21.15.40:0/381325576 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe20409d370 con 0x7fe204136bf0 2023-09-30T22:28:22.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.961+0000 7fe203fff700 1 --2- 172.21.15.40:0/381325576 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe204136bf0 0x7fe204138fd0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0009870 tx=0x7fe1f0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b8049f998f1b4b9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:22.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.961+0000 7fe2037fe700 1 -- 172.21.15.40:0/381325576 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f0011830 con 0x7fe204136bf0 2023-09-30T22:28:22.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.961+0000 7fe2037fe700 1 -- 172.21.15.40:0/381325576 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f0011990 con 0x7fe204136bf0 2023-09-30T22:28:22.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.961+0000 7fe2037fe700 1 -- 172.21.15.40:0/381325576 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f0011d20 con 0x7fe204136bf0 2023-09-30T22:28:22.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.962+0000 7fe20b094700 1 -- 172.21.15.40:0/381325576 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe204136bf0 msgr2=0x7fe204138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:22.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.962+0000 7fe20b094700 1 --2- 172.21.15.40:0/381325576 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe204136bf0 0x7fe204138fd0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0009870 tx=0x7fe1f0009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:22.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.962+0000 7fe20b094700 1 -- 172.21.15.40:0/381325576 shutdown_connections 2023-09-30T22:28:22.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.962+0000 7fe20b094700 1 --2- 172.21.15.40:0/381325576 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe204139510 0x7fe20413b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.962+0000 7fe20b094700 1 --2- 172.21.15.40:0/381325576 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe204136bf0 0x7fe204138fd0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.962+0000 7fe20b094700 1 -- 172.21.15.40:0/381325576 >> 172.21.15.40:0/381325576 conn(0x7fe2040a7080 msgr2=0x7fe2040a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:22.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.962+0000 7fe20b094700 1 -- 172.21.15.40:0/381325576 shutdown_connections 2023-09-30T22:28:22.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.962+0000 7fe20b094700 1 -- 172.21.15.40:0/381325576 wait complete. 2023-09-30T22:28:22.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.963+0000 7fe20b094700 1 Processor -- start 2023-09-30T22:28:22.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.963+0000 7fe20b094700 1 -- start start 2023-09-30T22:28:22.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.964+0000 7fe20b094700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe20409c890 0x7fe20406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.964+0000 7fe20b094700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe204136bf0 0x7fe20406f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.964+0000 7fe20b094700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe204139510 0x7fe20406f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.964+0000 7fe20b094700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe204070330 con 0x7fe204136bf0 2023-09-30T22:28:22.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.964+0000 7fe20b094700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe204139170 con 0x7fe20409c890 2023-09-30T22:28:22.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.964+0000 7fe20b094700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe20409ecf0 con 0x7fe204139510 2023-09-30T22:28:22.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.964+0000 7fe208e30700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe20409c890 0x7fe20406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:22.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.964+0000 7fe208e30700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe20409c890 0x7fe20406ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60566/0 (socket says 172.21.15.40:60566) 2023-09-30T22:28:22.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.964+0000 7fe208e30700 1 -- 172.21.15.40:0/2536295649 learned_addr learned my addr 172.21.15.40:0/2536295649 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:22.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.964+0000 7fe203fff700 1 --2- 172.21.15.40:0/2536295649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe204136bf0 0x7fe20406f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:22.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.964+0000 7fe209631700 1 --2- 172.21.15.40:0/2536295649 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe204139510 0x7fe20406f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:22.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.965+0000 7fe203fff700 1 -- 172.21.15.40:0/2536295649 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe204139510 msgr2=0x7fe20406f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:22.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.965+0000 7fe203fff700 1 --2- 172.21.15.40:0/2536295649 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe204139510 0x7fe20406f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.965+0000 7fe203fff700 1 -- 172.21.15.40:0/2536295649 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe20409c890 msgr2=0x7fe20406ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:22.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.965+0000 7fe203fff700 1 --2- 172.21.15.40:0/2536295649 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe20409c890 0x7fe20406ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.965+0000 7fe203fff700 1 -- 172.21.15.40:0/2536295649 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f00094a0 con 0x7fe204136bf0 2023-09-30T22:28:22.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.965+0000 7fe203fff700 1 --2- 172.21.15.40:0/2536295649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe204136bf0 0x7fe20406f4a0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0016000 tx=0x7fe1f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:22.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.965+0000 7fe2017fa700 1 -- 172.21.15.40:0/2536295649 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f00036a0 con 0x7fe204136bf0 2023-09-30T22:28:22.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.965+0000 7fe2017fa700 1 -- 172.21.15.40:0/2536295649 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f001f070 con 0x7fe204136bf0 2023-09-30T22:28:22.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.965+0000 7fe20b094700 1 -- 172.21.15.40:0/2536295649 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe204070ac0 con 0x7fe204136bf0 2023-09-30T22:28:22.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.965+0000 7fe2017fa700 1 -- 172.21.15.40:0/2536295649 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f0003a60 con 0x7fe204136bf0 2023-09-30T22:28:22.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.965+0000 7fe20b094700 1 -- 172.21.15.40:0/2536295649 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe204071390 con 0x7fe204136bf0 2023-09-30T22:28:22.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.966+0000 7fe2017fa700 1 -- 172.21.15.40:0/2536295649 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe1f0003bc0 con 0x7fe204136bf0 2023-09-30T22:28:22.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.966+0000 7fe2017fa700 1 -- 172.21.15.40:0/2536295649 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe1f0021070 con 0x7fe204136bf0 2023-09-30T22:28:22.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.966+0000 7fe20b094700 1 -- 172.21.15.40:0/2536295649 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe20412bca0 con 0x7fe204136bf0 2023-09-30T22:28:22.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:22.971+0000 7fe2017fa700 1 -- 172.21.15.40:0/2536295649 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe20412bca0 con 0x7fe204136bf0 2023-09-30T22:28:23.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.038+0000 7fc1335cf700 1 Processor -- start 2023-09-30T22:28:23.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.039+0000 7fc1335cf700 1 -- start start 2023-09-30T22:28:23.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.039+0000 7fc1335cf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc12c09c890 0x7fc12c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:23.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.039+0000 7fc1335cf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc12c09d920 0x7fc12c09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:23.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.039+0000 7fc1335cf700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc12c0a2600 con 0x7fc12c09e2b0 2023-09-30T22:28:23.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.039+0000 7fc1335cf700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc12c0a29d0 con 0x7fc12c09c890 2023-09-30T22:28:23.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.039+0000 7fc1335cf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c09fb40 con 0x7fc12c09d920 2023-09-30T22:28:23.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.039+0000 7fc13136b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc12c09c890 0x7fc12c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:23.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.039+0000 7fc13136b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc12c09c890 0x7fc12c09cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41524/0 (socket says 172.21.15.40:41524) 2023-09-30T22:28:23.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.039+0000 7fc13136b700 1 -- 172.21.15.40:0/3436390734 learned_addr learned my addr 172.21.15.40:0/3436390734 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:23.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.039+0000 7fc130b6a700 1 --2- 172.21.15.40:0/3436390734 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc12c09d920 0x7fc12c09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:23.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.040+0000 7fc13136b700 1 -- 172.21.15.40:0/3436390734 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc12c09d920 msgr2=0x7fc12c09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:23.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.040+0000 7fc13136b700 1 --2- 172.21.15.40:0/3436390734 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc12c09d920 0x7fc12c09dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:23.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.040+0000 7fc13136b700 1 -- 172.21.15.40:0/3436390734 >> v1:172.21.15.40:6789/0 conn(0x7fc12c09e2b0 legacy=0x7fc12c13ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:23.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.040+0000 7fc13136b700 1 -- 172.21.15.40:0/3436390734 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc12c09e730 con 0x7fc12c09c890 2023-09-30T22:28:23.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.040+0000 7fc13136b700 1 --2- 172.21.15.40:0/3436390734 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc12c09c890 0x7fc12c09cc60 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fc128006fd0 tx=0x7fc128009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c174dc9eb8c2f0a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:23.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.040+0000 7fc123fff700 1 -- 172.21.15.40:0/3436390734 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc128005e30 con 0x7fc12c09c890 2023-09-30T22:28:23.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.040+0000 7fc123fff700 1 -- 172.21.15.40:0/3436390734 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc128006030 con 0x7fc12c09c890 2023-09-30T22:28:23.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.040+0000 7fc123fff700 1 -- 172.21.15.40:0/3436390734 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1280063c0 con 0x7fc12c09c890 2023-09-30T22:28:23.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.040+0000 7fc1335cf700 1 -- 172.21.15.40:0/3436390734 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc12c09c890 msgr2=0x7fc12c09cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:23.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.040+0000 7fc1335cf700 1 --2- 172.21.15.40:0/3436390734 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc12c09c890 0x7fc12c09cc60 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fc128006fd0 tx=0x7fc128009bd0 comp rx=0 tx=0).stop 2023-09-30T22:28:23.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.041+0000 7fc1335cf700 1 -- 172.21.15.40:0/3436390734 shutdown_connections 2023-09-30T22:28:23.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.041+0000 7fc1335cf700 1 --2- 172.21.15.40:0/3436390734 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc12c09c890 0x7fc12c09cc60 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:23.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.041+0000 7fc1335cf700 1 --2- 172.21.15.40:0/3436390734 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc12c09d920 0x7fc12c09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:23.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.041+0000 7fc1335cf700 1 -- 172.21.15.40:0/3436390734 >> 172.21.15.40:0/3436390734 conn(0x7fc12c0a7080 msgr2=0x7fc12c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:23.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.041+0000 7fc1335cf700 1 -- 172.21.15.40:0/3436390734 shutdown_connections 2023-09-30T22:28:23.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.041+0000 7fc1335cf700 1 -- 172.21.15.40:0/3436390734 wait complete. 2023-09-30T22:28:23.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.042+0000 7fc1335cf700 1 Processor -- start 2023-09-30T22:28:23.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.042+0000 7fc1335cf700 1 -- start start 2023-09-30T22:28:23.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.042+0000 7fc1335cf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc12c09c890 0x7fc12c1c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:23.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.042+0000 7fc1335cf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc12c09d920 0x7fc12c1c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:23.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.042+0000 7fc1335cf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc12c09e2b0 0x7fc12c12d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:23.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.042+0000 7fc1335cf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c1315b0 con 0x7fc12c09e2b0 2023-09-30T22:28:23.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.042+0000 7fc1335cf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c130a80 con 0x7fc12c09d920 2023-09-30T22:28:23.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.042+0000 7fc1335cf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c0a5d70 con 0x7fc12c09c890 2023-09-30T22:28:23.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.042+0000 7fc130b6a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc12c09d920 0x7fc12c1c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:23.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.042+0000 7fc130b6a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc12c09d920 0x7fc12c1c9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60582/0 (socket says 172.21.15.40:60582) 2023-09-30T22:28:23.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.042+0000 7fc130b6a700 1 -- 172.21.15.40:0/421000226 learned_addr learned my addr 172.21.15.40:0/421000226 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:23.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.042+0000 7fc131b6c700 1 --2- 172.21.15.40:0/421000226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc12c09e2b0 0x7fc12c12d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:23.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.042+0000 7fc13136b700 1 --2- 172.21.15.40:0/421000226 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc12c09c890 0x7fc12c1c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:23.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.043+0000 7fc130b6a700 1 -- 172.21.15.40:0/421000226 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc12c09c890 msgr2=0x7fc12c1c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:23.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.043+0000 7fc130b6a700 1 --2- 172.21.15.40:0/421000226 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc12c09c890 0x7fc12c1c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:23.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.043+0000 7fc130b6a700 1 -- 172.21.15.40:0/421000226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc12c09e2b0 msgr2=0x7fc12c12d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:23.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.043+0000 7fc130b6a700 1 --2- 172.21.15.40:0/421000226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc12c09e2b0 0x7fc12c12d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:23.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.043+0000 7fc130b6a700 1 -- 172.21.15.40:0/421000226 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc128009500 con 0x7fc12c09d920 2023-09-30T22:28:23.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.043+0000 7fc130b6a700 1 --2- 172.21.15.40:0/421000226 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc12c09d920 0x7fc12c1c9190 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc11c00e9b0 tx=0x7fc11c00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:23.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.043+0000 7fc121ffb700 1 -- 172.21.15.40:0/421000226 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11c009710 con 0x7fc12c09d920 2023-09-30T22:28:23.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.043+0000 7fc121ffb700 1 -- 172.21.15.40:0/421000226 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11c00ee50 con 0x7fc12c09d920 2023-09-30T22:28:23.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.043+0000 7fc1335cf700 1 -- 172.21.15.40:0/421000226 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc12c09ecf0 con 0x7fc12c09d920 2023-09-30T22:28:23.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.043+0000 7fc121ffb700 1 -- 172.21.15.40:0/421000226 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11c00ca50 con 0x7fc12c09d920 2023-09-30T22:28:23.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.043+0000 7fc1335cf700 1 -- 172.21.15.40:0/421000226 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc12c130d40 con 0x7fc12c09d920 2023-09-30T22:28:23.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.044+0000 7fc121ffb700 1 -- 172.21.15.40:0/421000226 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc11c00cbb0 con 0x7fc12c09d920 2023-09-30T22:28:23.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.044+0000 7fc121ffb700 1 -- 172.21.15.40:0/421000226 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc11c03f6e0 con 0x7fc12c09d920 2023-09-30T22:28:23.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.044+0000 7fc1335cf700 1 -- 172.21.15.40:0/421000226 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc12c062380 con 0x7fc12c09d920 2023-09-30T22:28:23.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.049+0000 7fc121ffb700 1 -- 172.21.15.40:0/421000226 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc11c0232f0 con 0x7fc12c09d920 2023-09-30T22:28:23.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.157+0000 7f4c1848d700 1 -- 172.21.15.40:0/3889810484 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4bf8005590 con 0x7f4c1009e230 2023-09-30T22:28:23.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.157+0000 7f4c06ffd700 1 -- 172.21.15.40:0/3889810484 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4c00017020 con 0x7f4c1009e230 2023-09-30T22:28:23.158 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:23.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.159+0000 7f4c1848d700 1 -- 172.21.15.40:0/3889810484 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c1009e230 msgr2=0x7f4c101363e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:23.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.159+0000 7f4c1848d700 1 --2- 172.21.15.40:0/3889810484 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c1009e230 0x7f4c101363e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4c0000e8d0 tx=0x7f4c0000ebe0 comp rx=0 tx=0).stop 2023-09-30T22:28:23.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.159+0000 7f4c1848d700 1 -- 172.21.15.40:0/3889810484 shutdown_connections 2023-09-30T22:28:23.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.159+0000 7f4c1848d700 1 --2- 172.21.15.40:0/3889810484 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c10130de0 0x7f4c10136920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:23.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.159+0000 7f4c1848d700 1 --2- 172.21.15.40:0/3889810484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c1009d920 0x7f4c10135ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:23.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.159+0000 7f4c1848d700 1 --2- 172.21.15.40:0/3889810484 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c1009e230 0x7f4c101363e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:23.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.159+0000 7f4c1848d700 1 -- 172.21.15.40:0/3889810484 >> 172.21.15.40:0/3889810484 conn(0x7f4c1009fb20 msgr2=0x7f4c1006ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:23.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.159+0000 7f4c1848d700 1 -- 172.21.15.40:0/3889810484 shutdown_connections 2023-09-30T22:28:23.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.159+0000 7f4c1848d700 1 -- 172.21.15.40:0/3889810484 wait complete. 2023-09-30T22:28:23.172 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:23.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.172+0000 7fe20b094700 1 -- 172.21.15.40:0/2536295649 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe20412be60 con 0x7fe204136bf0 2023-09-30T22:28:23.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.172+0000 7fe2017fa700 1 -- 172.21.15.40:0/2536295649 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe20412be60 con 0x7fe204136bf0 2023-09-30T22:28:23.173 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:23.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.174+0000 7fe20b094700 1 -- 172.21.15.40:0/2536295649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe204136bf0 msgr2=0x7fe20406f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:23.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.174+0000 7fe20b094700 1 --2- 172.21.15.40:0/2536295649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe204136bf0 0x7fe20406f4a0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0016000 tx=0x7fe1f0004750 comp rx=0 tx=0).stop 2023-09-30T22:28:23.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.175+0000 7fe20b094700 1 -- 172.21.15.40:0/2536295649 shutdown_connections 2023-09-30T22:28:23.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.175+0000 7fe20b094700 1 --2- 172.21.15.40:0/2536295649 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe204139510 0x7fe20406f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:23.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.175+0000 7fe20b094700 1 --2- 172.21.15.40:0/2536295649 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe20409c890 0x7fe20406ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:23.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.175+0000 7fe20b094700 1 --2- 172.21.15.40:0/2536295649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe204136bf0 0x7fe20406f4a0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:23.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.175+0000 7fe20b094700 1 -- 172.21.15.40:0/2536295649 >> 172.21.15.40:0/2536295649 conn(0x7fe2040a7080 msgr2=0x7fe204136fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:23.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.175+0000 7fe20b094700 1 -- 172.21.15.40:0/2536295649 shutdown_connections 2023-09-30T22:28:23.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.175+0000 7fe20b094700 1 -- 172.21.15.40:0/2536295649 wait complete. 2023-09-30T22:28:23.187 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:23.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.246+0000 7fc1335cf700 1 -- 172.21.15.40:0/421000226 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc12c0a5b50 con 0x7fc12c09d920 2023-09-30T22:28:23.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.247+0000 7fc121ffb700 1 -- 172.21.15.40:0/421000226 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc11c021030 con 0x7fc12c09d920 2023-09-30T22:28:23.247 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:23.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.249+0000 7fc1335cf700 1 -- 172.21.15.40:0/421000226 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc12c09d920 msgr2=0x7fc12c1c9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:23.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.249+0000 7fc1335cf700 1 --2- 172.21.15.40:0/421000226 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc12c09d920 0x7fc12c1c9190 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc11c00e9b0 tx=0x7fc11c00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:28:23.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.249+0000 7fc1335cf700 1 -- 172.21.15.40:0/421000226 shutdown_connections 2023-09-30T22:28:23.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.249+0000 7fc1335cf700 1 --2- 172.21.15.40:0/421000226 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc12c09c890 0x7fc12c1c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:23.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.249+0000 7fc1335cf700 1 --2- 172.21.15.40:0/421000226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc12c09e2b0 0x7fc12c12d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:23.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.249+0000 7fc1335cf700 1 --2- 172.21.15.40:0/421000226 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc12c09d920 0x7fc12c1c9190 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:23.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.249+0000 7fc1335cf700 1 -- 172.21.15.40:0/421000226 >> 172.21.15.40:0/421000226 conn(0x7fc12c0a7080 msgr2=0x7fc12c0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:23.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.249+0000 7fc1335cf700 1 -- 172.21.15.40:0/421000226 shutdown_connections 2023-09-30T22:28:23.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.249+0000 7fc1335cf700 1 -- 172.21.15.40:0/421000226 wait complete. 2023-09-30T22:28:23.262 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:23.662 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:23.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.793+0000 7f5073e74700 1 Processor -- start 2023-09-30T22:28:23.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.794+0000 7f5073e74700 1 -- start start 2023-09-30T22:28:23.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.794+0000 7f5073e74700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f506c136bf0 0x7f506c138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:23.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.794+0000 7f5073e74700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f506c139510 0x7f506c13b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:23.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.794+0000 7f5073e74700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f506c0a2600 con 0x7f506c09c890 2023-09-30T22:28:23.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.794+0000 7f5073e74700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f506c0a29d0 con 0x7f506c136bf0 2023-09-30T22:28:23.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.794+0000 7f5073e74700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506c09fb40 con 0x7f506c139510 2023-09-30T22:28:23.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.794+0000 7f507140f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f506c136bf0 0x7f506c138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:23.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.794+0000 7f507140f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f506c136bf0 0x7f506c138fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35702/0 (socket says 172.21.15.40:35702) 2023-09-30T22:28:23.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.794+0000 7f507140f700 1 -- 172.21.15.40:0/3975064967 learned_addr learned my addr 172.21.15.40:0/3975064967 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:23.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.794+0000 7f5072411700 1 --2- 172.21.15.40:0/3975064967 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f506c139510 0x7f506c13b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:23.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.794+0000 7f507140f700 1 -- 172.21.15.40:0/3975064967 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f506c139510 msgr2=0x7f506c13b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:23.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.795+0000 7f507140f700 1 --2- 172.21.15.40:0/3975064967 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f506c139510 0x7f506c13b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:23.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.795+0000 7f507140f700 1 -- 172.21.15.40:0/3975064967 >> v1:172.21.15.40:6789/0 conn(0x7f506c09c890 legacy=0x7f506c09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:23.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.795+0000 7f507140f700 1 -- 172.21.15.40:0/3975064967 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506c09d370 con 0x7f506c136bf0 2023-09-30T22:28:23.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.795+0000 7f5072411700 1 --2- 172.21.15.40:0/3975064967 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f506c139510 0x7f506c13b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:23.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.795+0000 7f507140f700 1 --2- 172.21.15.40:0/3975064967 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f506c136bf0 0x7f506c138fd0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f50600098f0 tx=0x7f5060009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3acafffadfac2f29 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:23.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.795+0000 7f5070c0e700 1 -- 172.21.15.40:0/3975064967 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5060011830 con 0x7f506c136bf0 2023-09-30T22:28:23.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.795+0000 7f5070c0e700 1 -- 172.21.15.40:0/3975064967 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5060011990 con 0x7f506c136bf0 2023-09-30T22:28:23.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.795+0000 7f5070c0e700 1 -- 172.21.15.40:0/3975064967 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5060011d20 con 0x7f506c136bf0 2023-09-30T22:28:23.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.795+0000 7f5073e74700 1 -- 172.21.15.40:0/3975064967 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f506c136bf0 msgr2=0x7f506c138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:23.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.795+0000 7f5073e74700 1 --2- 172.21.15.40:0/3975064967 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f506c136bf0 0x7f506c138fd0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f50600098f0 tx=0x7f5060009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:23.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.795+0000 7f5073e74700 1 -- 172.21.15.40:0/3975064967 shutdown_connections 2023-09-30T22:28:23.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.795+0000 7f5073e74700 1 --2- 172.21.15.40:0/3975064967 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f506c139510 0x7f506c13b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:23.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.795+0000 7f5073e74700 1 --2- 172.21.15.40:0/3975064967 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f506c136bf0 0x7f506c138fd0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:23.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.795+0000 7f5073e74700 1 -- 172.21.15.40:0/3975064967 >> 172.21.15.40:0/3975064967 conn(0x7f506c0a7080 msgr2=0x7f506c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:23.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.796+0000 7f5073e74700 1 -- 172.21.15.40:0/3975064967 shutdown_connections 2023-09-30T22:28:23.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.796+0000 7f5073e74700 1 -- 172.21.15.40:0/3975064967 wait complete. 2023-09-30T22:28:23.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.796+0000 7f5073e74700 1 Processor -- start 2023-09-30T22:28:23.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.796+0000 7f5073e74700 1 -- start start 2023-09-30T22:28:23.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.797+0000 7f5073e74700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f506c09c890 0x7f506c06ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:23.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.797+0000 7f5073e74700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f506c136bf0 0x7f506c06f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:23.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.797+0000 7f5073e74700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f506c139510 0x7f506c06f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:23.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.797+0000 7f5073e74700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c12be30 con 0x7f506c09c890 2023-09-30T22:28:23.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.797+0000 7f5073e74700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506c12b5f0 con 0x7f506c136bf0 2023-09-30T22:28:23.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.797+0000 7f5073e74700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f506c0a6110 con 0x7f506c139510 2023-09-30T22:28:23.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.797+0000 7f5071c10700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f506c09c890 0x7f506c06ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:23.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.797+0000 7f507140f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f506c136bf0 0x7f506c06f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:23.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.797+0000 7f507140f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f506c136bf0 0x7f506c06f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54030/0 (socket says 172.21.15.40:54030) 2023-09-30T22:28:23.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.797+0000 7f5071c10700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f506c09c890 0x7f506c06ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35708/0 (socket says 172.21.15.40:35708) 2023-09-30T22:28:23.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.797+0000 7f507140f700 1 -- 172.21.15.40:0/196240388 learned_addr learned my addr 172.21.15.40:0/196240388 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:23.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.797+0000 7f5072411700 1 --2- 172.21.15.40:0/196240388 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f506c139510 0x7f506c06f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:23.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.797+0000 7f507140f700 1 -- 172.21.15.40:0/196240388 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f506c139510 msgr2=0x7f506c06f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:23.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.797+0000 7f507140f700 1 --2- 172.21.15.40:0/196240388 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f506c139510 0x7f506c06f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:23.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.797+0000 7f507140f700 1 -- 172.21.15.40:0/196240388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f506c09c890 msgr2=0x7f506c06ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:23.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.797+0000 7f507140f700 1 --2- 172.21.15.40:0/196240388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f506c09c890 0x7f506c06ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:23.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.797+0000 7f507140f700 1 -- 172.21.15.40:0/196240388 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5064009a70 con 0x7f506c136bf0 2023-09-30T22:28:23.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.797+0000 7f5072411700 1 --2- 172.21.15.40:0/196240388 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f506c139510 0x7f506c06f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:23.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.798+0000 7f507140f700 1 --2- 172.21.15.40:0/196240388 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f506c136bf0 0x7f506c06f450 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5060009c40 tx=0x7f5060004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:23.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.798+0000 7f505e7fc700 1 -- 172.21.15.40:0/196240388 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50600043c0 con 0x7f506c136bf0 2023-09-30T22:28:23.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.798+0000 7f505e7fc700 1 -- 172.21.15.40:0/196240388 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506001f070 con 0x7f506c136bf0 2023-09-30T22:28:23.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.798+0000 7f5073e74700 1 -- 172.21.15.40:0/196240388 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5060009550 con 0x7f506c136bf0 2023-09-30T22:28:23.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.798+0000 7f505e7fc700 1 -- 172.21.15.40:0/196240388 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50600036a0 con 0x7f506c136bf0 2023-09-30T22:28:23.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.798+0000 7f5073e74700 1 -- 172.21.15.40:0/196240388 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f506c12c7c0 con 0x7f506c136bf0 2023-09-30T22:28:23.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.798+0000 7f505e7fc700 1 -- 172.21.15.40:0/196240388 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5060021030 con 0x7f506c136bf0 2023-09-30T22:28:23.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.799+0000 7f505e7fc700 1 -- 172.21.15.40:0/196240388 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5060040af0 con 0x7f506c136bf0 2023-09-30T22:28:23.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.799+0000 7f5073e74700 1 -- 172.21.15.40:0/196240388 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f506c062380 con 0x7f506c136bf0 2023-09-30T22:28:23.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.803+0000 7f505e7fc700 1 -- 172.21.15.40:0/196240388 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f50600199a0 con 0x7f506c136bf0 2023-09-30T22:28:24.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.999+0000 7f5073e74700 1 -- 172.21.15.40:0/196240388 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f506c074620 con 0x7f506c136bf0 2023-09-30T22:28:24.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:23.999+0000 7f505e7fc700 1 -- 172.21.15.40:0/196240388 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f50600193b0 con 0x7f506c136bf0 2023-09-30T22:28:24.001 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:24.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.001+0000 7f5073e74700 1 -- 172.21.15.40:0/196240388 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f506c136bf0 msgr2=0x7f506c06f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:24.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.001+0000 7f5073e74700 1 --2- 172.21.15.40:0/196240388 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f506c136bf0 0x7f506c06f450 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5060009c40 tx=0x7f5060004750 comp rx=0 tx=0).stop 2023-09-30T22:28:24.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.001+0000 7f5073e74700 1 -- 172.21.15.40:0/196240388 shutdown_connections 2023-09-30T22:28:24.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.001+0000 7f5073e74700 1 --2- 172.21.15.40:0/196240388 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f506c139510 0x7f506c06f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.001+0000 7f5073e74700 1 --2- 172.21.15.40:0/196240388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f506c09c890 0x7f506c06ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.002+0000 7f5073e74700 1 --2- 172.21.15.40:0/196240388 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f506c136bf0 0x7f506c06f450 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.002+0000 7f5073e74700 1 -- 172.21.15.40:0/196240388 >> 172.21.15.40:0/196240388 conn(0x7f506c0a7080 msgr2=0x7f506c136fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:24.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.002+0000 7f5073e74700 1 -- 172.21.15.40:0/196240388 shutdown_connections 2023-09-30T22:28:24.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.002+0000 7f5073e74700 1 -- 172.21.15.40:0/196240388 wait complete. 2023-09-30T22:28:24.016 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:24.173 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:24.189 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:24.263 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:24.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.304+0000 7f10aa80a700 1 Processor -- start 2023-09-30T22:28:24.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.304+0000 7f10aa80a700 1 -- start start 2023-09-30T22:28:24.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.304+0000 7f10aa80a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10a4136bf0 0x7f10a4138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:24.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.304+0000 7f10aa80a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f10a4139510 0x7f10a413b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:24.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.304+0000 7f10aa80a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10a40a2600 con 0x7f10a409c890 2023-09-30T22:28:24.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.304+0000 7f10aa80a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10a40a29d0 con 0x7f10a4139510 2023-09-30T22:28:24.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.304+0000 7f10aa80a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10a409fb40 con 0x7f10a4136bf0 2023-09-30T22:28:24.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.304+0000 7f10a37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10a4136bf0 0x7f10a4138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:24.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.304+0000 7f10a3fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f10a409c890 0x7f10a409cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46344/0 (socket says 172.21.15.40:46344) 2023-09-30T22:28:24.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.304+0000 7f10a3fff700 1 -- 172.21.15.40:0/3568759923 learned_addr learned my addr 172.21.15.40:0/3568759923 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:24.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.304+0000 7f10a37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10a4136bf0 0x7f10a4138fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55530/0 (socket says 172.21.15.40:55530) 2023-09-30T22:28:24.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.304+0000 7f10a8da7700 1 --2- 172.21.15.40:0/3568759923 >> v2:172.21.15.40:3300/0 conn(0x7f10a4139510 0x7f10a413b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:24.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.305+0000 7f10a37fe700 1 -- 172.21.15.40:0/3568759923 >> v2:172.21.15.40:3300/0 conn(0x7f10a4139510 msgr2=0x7f10a413b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:24.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.305+0000 7f10a37fe700 1 --2- 172.21.15.40:0/3568759923 >> v2:172.21.15.40:3300/0 conn(0x7f10a4139510 0x7f10a413b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.305+0000 7f10a37fe700 1 -- 172.21.15.40:0/3568759923 >> v1:172.21.15.40:6789/0 conn(0x7f10a409c890 legacy=0x7f10a409cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:24.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.305+0000 7f10a37fe700 1 -- 172.21.15.40:0/3568759923 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a409d370 con 0x7f10a4136bf0 2023-09-30T22:28:24.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.305+0000 7f10a37fe700 1 --2- 172.21.15.40:0/3568759923 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10a4136bf0 0x7f10a4138fd0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1098009840 tx=0x7f1098009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd2f17226876ba6e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:24.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.305+0000 7f10a2ffd700 1 -- 172.21.15.40:0/3568759923 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1098011830 con 0x7f10a4136bf0 2023-09-30T22:28:24.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.305+0000 7f10a2ffd700 1 -- 172.21.15.40:0/3568759923 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1098011990 con 0x7f10a4136bf0 2023-09-30T22:28:24.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.305+0000 7f10a2ffd700 1 -- 172.21.15.40:0/3568759923 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1098011d20 con 0x7f10a4136bf0 2023-09-30T22:28:24.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.306+0000 7f10aa80a700 1 -- 172.21.15.40:0/3568759923 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10a4136bf0 msgr2=0x7f10a4138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:24.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.306+0000 7f10aa80a700 1 --2- 172.21.15.40:0/3568759923 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10a4136bf0 0x7f10a4138fd0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1098009840 tx=0x7f1098009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:24.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.306+0000 7f10aa80a700 1 -- 172.21.15.40:0/3568759923 shutdown_connections 2023-09-30T22:28:24.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.306+0000 7f10aa80a700 1 --2- 172.21.15.40:0/3568759923 >> v2:172.21.15.40:3300/0 conn(0x7f10a4139510 0x7f10a413b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.306+0000 7f10aa80a700 1 --2- 172.21.15.40:0/3568759923 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10a4136bf0 0x7f10a4138fd0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.306+0000 7f10aa80a700 1 -- 172.21.15.40:0/3568759923 >> 172.21.15.40:0/3568759923 conn(0x7f10a40a7080 msgr2=0x7f10a40a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:24.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.306+0000 7f10aa80a700 1 -- 172.21.15.40:0/3568759923 shutdown_connections 2023-09-30T22:28:24.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.306+0000 7f10aa80a700 1 -- 172.21.15.40:0/3568759923 wait complete. 2023-09-30T22:28:24.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.307+0000 7f10aa80a700 1 Processor -- start 2023-09-30T22:28:24.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.307+0000 7f10aa80a700 1 -- start start 2023-09-30T22:28:24.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.308+0000 7f10aa80a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10a409c890 0x7f10a406f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:24.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.308+0000 7f10aa80a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10a4136bf0 0x7f10a406f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:24.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.308+0000 7f10aa80a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10a4139510 0x7f10a406fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:24.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.308+0000 7f10aa80a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a4139050 con 0x7f10a4139510 2023-09-30T22:28:24.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.308+0000 7f10aa80a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a412be30 con 0x7f10a409c890 2023-09-30T22:28:24.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.308+0000 7f10aa80a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10a412b710 con 0x7f10a4136bf0 2023-09-30T22:28:24.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.308+0000 7f10a37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10a4136bf0 0x7f10a406f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:24.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.308+0000 7f10a37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10a4136bf0 0x7f10a406f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55536/0 (socket says 172.21.15.40:55536) 2023-09-30T22:28:24.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.308+0000 7f10a37fe700 1 -- 172.21.15.40:0/933307315 learned_addr learned my addr 172.21.15.40:0/933307315 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:24.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.308+0000 7f10a8da7700 1 --2- 172.21.15.40:0/933307315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10a4139510 0x7f10a406fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:24.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.308+0000 7f10a37fe700 1 -- 172.21.15.40:0/933307315 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10a409c890 msgr2=0x7f10a406f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:24.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.308+0000 7f10a37fe700 1 --2- 172.21.15.40:0/933307315 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10a409c890 0x7f10a406f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.308+0000 7f10a37fe700 1 -- 172.21.15.40:0/933307315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10a4139510 msgr2=0x7f10a406fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:24.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.308+0000 7f10a37fe700 1 --2- 172.21.15.40:0/933307315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10a4139510 0x7f10a406fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.308+0000 7f10a37fe700 1 -- 172.21.15.40:0/933307315 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10980094a0 con 0x7f10a4136bf0 2023-09-30T22:28:24.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.308+0000 7f10a37fe700 1 --2- 172.21.15.40:0/933307315 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10a4136bf0 0x7f10a406f620 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1098009fd0 tx=0x7f1098004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:24.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.308+0000 7f10a0ff9700 1 -- 172.21.15.40:0/933307315 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1098004480 con 0x7f10a4136bf0 2023-09-30T22:28:24.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.309+0000 7f10a0ff9700 1 -- 172.21.15.40:0/933307315 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109801f070 con 0x7f10a4136bf0 2023-09-30T22:28:24.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.309+0000 7f10aa80a700 1 -- 172.21.15.40:0/933307315 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a409ecf0 con 0x7f10a4136bf0 2023-09-30T22:28:24.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.309+0000 7f10a0ff9700 1 -- 172.21.15.40:0/933307315 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10980038e0 con 0x7f10a4136bf0 2023-09-30T22:28:24.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.309+0000 7f10aa80a700 1 -- 172.21.15.40:0/933307315 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a412c8a0 con 0x7f10a4136bf0 2023-09-30T22:28:24.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.310+0000 7f10aa80a700 1 -- 172.21.15.40:0/933307315 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10a4062380 con 0x7f10a4136bf0 2023-09-30T22:28:24.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.310+0000 7f10a0ff9700 1 -- 172.21.15.40:0/933307315 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1098021030 con 0x7f10a4136bf0 2023-09-30T22:28:24.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.310+0000 7f10a0ff9700 1 -- 172.21.15.40:0/933307315 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f10980410c0 con 0x7f10a4136bf0 2023-09-30T22:28:24.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.319+0000 7f10a0ff9700 1 -- 172.21.15.40:0/933307315 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f109801a450 con 0x7f10a4136bf0 2023-09-30T22:28:24.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.357+0000 7f7523f9a700 1 Processor -- start 2023-09-30T22:28:24.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.358+0000 7f7523f9a700 1 -- start start 2023-09-30T22:28:24.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.358+0000 7f7523f9a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f751c09c890 0x7f751c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:24.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.358+0000 7f7523f9a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f751c09d920 0x7f751c09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:24.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.358+0000 7f7523f9a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f751c0a2600 con 0x7f751c09e2b0 2023-09-30T22:28:24.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.358+0000 7f7523f9a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751c0a29d0 con 0x7f751c09d920 2023-09-30T22:28:24.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.358+0000 7f7523f9a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f751c09fb40 con 0x7f751c09c890 2023-09-30T22:28:24.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.358+0000 7f7521535700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f751c09d920 0x7f751c09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:24.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.358+0000 7f7522537700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f751c09e2b0 0x7f751c13ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46348/0 (socket says 172.21.15.40:46348) 2023-09-30T22:28:24.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.358+0000 7f7522537700 1 -- 172.21.15.40:0/898878055 learned_addr learned my addr 172.21.15.40:0/898878055 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:24.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.358+0000 7f7521d36700 1 --2- 172.21.15.40:0/898878055 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f751c09c890 0x7f751c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:24.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.359+0000 7f7521535700 1 -- 172.21.15.40:0/898878055 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f751c09c890 msgr2=0x7f751c09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:24.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.359+0000 7f7521535700 1 --2- 172.21.15.40:0/898878055 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f751c09c890 0x7f751c09cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.359+0000 7f7521535700 1 -- 172.21.15.40:0/898878055 >> v1:172.21.15.40:6789/0 conn(0x7f751c09e2b0 legacy=0x7f751c13ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:24.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.359+0000 7f7521535700 1 -- 172.21.15.40:0/898878055 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751c09e720 con 0x7f751c09d920 2023-09-30T22:28:24.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.359+0000 7f7520d34700 1 -- 172.21.15.40:0/898878055 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3104608428 0 0) 0x7f751c0a2600 con 0x7f751c09e2b0 2023-09-30T22:28:24.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.359+0000 7f7521d36700 1 --2- 172.21.15.40:0/898878055 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f751c09c890 0x7f751c09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:24.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.359+0000 7f7521535700 1 --2- 172.21.15.40:0/898878055 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f751c09d920 0x7f751c09dd70 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f750c009870 tx=0x7f750c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5775d944163ff9f7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:24.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.359+0000 7f7520d34700 1 -- 172.21.15.40:0/898878055 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c011830 con 0x7f751c09d920 2023-09-30T22:28:24.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.359+0000 7f7520d34700 1 -- 172.21.15.40:0/898878055 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750c011990 con 0x7f751c09d920 2023-09-30T22:28:24.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.359+0000 7f7520d34700 1 -- 172.21.15.40:0/898878055 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c011d20 con 0x7f751c09d920 2023-09-30T22:28:24.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.360+0000 7f7523f9a700 1 -- 172.21.15.40:0/898878055 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f751c09d920 msgr2=0x7f751c09dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:24.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.360+0000 7f7523f9a700 1 --2- 172.21.15.40:0/898878055 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f751c09d920 0x7f751c09dd70 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f750c009870 tx=0x7f750c009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:24.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.360+0000 7f7523f9a700 1 -- 172.21.15.40:0/898878055 shutdown_connections 2023-09-30T22:28:24.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.360+0000 7f7523f9a700 1 --2- 172.21.15.40:0/898878055 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f751c09c890 0x7f751c09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.360+0000 7f7523f9a700 1 --2- 172.21.15.40:0/898878055 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f751c09d920 0x7f751c09dd70 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.360+0000 7f7523f9a700 1 -- 172.21.15.40:0/898878055 >> 172.21.15.40:0/898878055 conn(0x7f751c0a7080 msgr2=0x7f751c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:24.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.360+0000 7f7523f9a700 1 -- 172.21.15.40:0/898878055 shutdown_connections 2023-09-30T22:28:24.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.360+0000 7f7523f9a700 1 -- 172.21.15.40:0/898878055 wait complete. 2023-09-30T22:28:24.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.361+0000 7f7523f9a700 1 Processor -- start 2023-09-30T22:28:24.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.362+0000 7f7523f9a700 1 -- start start 2023-09-30T22:28:24.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.362+0000 7f7523f9a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f751c09c890 0x7f751c12b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:24.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.362+0000 7f7523f9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f751c09d920 0x7f751c12ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:24.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.362+0000 7f7523f9a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f751c09e2b0 0x7f751c12bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:24.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.362+0000 7f7523f9a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751c0a5a60 con 0x7f751c09d920 2023-09-30T22:28:24.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.362+0000 7f7523f9a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751c09ecf0 con 0x7f751c09e2b0 2023-09-30T22:28:24.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.362+0000 7f7523f9a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f751c12e960 con 0x7f751c09c890 2023-09-30T22:28:24.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.362+0000 7f7521d36700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f751c09c890 0x7f751c12b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:24.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.362+0000 7f7521d36700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f751c09c890 0x7f751c12b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55552/0 (socket says 172.21.15.40:55552) 2023-09-30T22:28:24.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.362+0000 7f7521535700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f751c09d920 0x7f751c12ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:24.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.362+0000 7f7521d36700 1 -- 172.21.15.40:0/3878927938 learned_addr learned my addr 172.21.15.40:0/3878927938 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:24.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.363+0000 7f7522537700 1 --2- 172.21.15.40:0/3878927938 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f751c09e2b0 0x7f751c12bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:24.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.363+0000 7f7521d36700 1 -- 172.21.15.40:0/3878927938 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f751c09e2b0 msgr2=0x7f751c12bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:24.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.363+0000 7f7521d36700 1 --2- 172.21.15.40:0/3878927938 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f751c09e2b0 0x7f751c12bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.363+0000 7f7521d36700 1 -- 172.21.15.40:0/3878927938 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f751c09d920 msgr2=0x7f751c12ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:24.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.363+0000 7f7521d36700 1 --2- 172.21.15.40:0/3878927938 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f751c09d920 0x7f751c12ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.363+0000 7f7521d36700 1 -- 172.21.15.40:0/3878927938 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750c0094a0 con 0x7f751c09c890 2023-09-30T22:28:24.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.363+0000 7f7521535700 1 --2- 172.21.15.40:0/3878927938 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f751c09d920 0x7f751c12ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:24.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.363+0000 7f7521d36700 1 --2- 172.21.15.40:0/3878927938 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f751c09c890 0x7f751c12b4e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f751800e810 tx=0x7f751800eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:24.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.363+0000 7f75127fc700 1 -- 172.21.15.40:0/3878927938 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751800c070 con 0x7f751c09c890 2023-09-30T22:28:24.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.363+0000 7f75127fc700 1 -- 172.21.15.40:0/3878927938 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7518005c20 con 0x7f751c09c890 2023-09-30T22:28:24.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.363+0000 7f7523f9a700 1 -- 172.21.15.40:0/3878927938 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f751c12d010 con 0x7f751c09c890 2023-09-30T22:28:24.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.363+0000 7f75127fc700 1 -- 172.21.15.40:0/3878927938 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7518006030 con 0x7f751c09c890 2023-09-30T22:28:24.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.363+0000 7f7523f9a700 1 -- 172.21.15.40:0/3878927938 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f751c12e680 con 0x7f751c09c890 2023-09-30T22:28:24.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.364+0000 7f7523f9a700 1 -- 172.21.15.40:0/3878927938 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f751c06e600 con 0x7f751c09c890 2023-09-30T22:28:24.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.365+0000 7f75127fc700 1 -- 172.21.15.40:0/3878927938 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7518006190 con 0x7f751c09c890 2023-09-30T22:28:24.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.365+0000 7f75127fc700 1 -- 172.21.15.40:0/3878927938 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f751803fba0 con 0x7f751c09c890 2023-09-30T22:28:24.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.373+0000 7f75127fc700 1 -- 172.21.15.40:0/3878927938 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f751800f040 con 0x7f751c09c890 2023-09-30T22:28:24.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.400+0000 7f22b7a81700 1 Processor -- start 2023-09-30T22:28:24.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.400+0000 7f22b7a81700 1 -- start start 2023-09-30T22:28:24.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.401+0000 7f22b7a81700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22b009c890 0x7f22b009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:24.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.401+0000 7f22b7a81700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22b009e480 0x7f22b013bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:24.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.401+0000 7f22b7a81700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b00a2600 con 0x7f22b009d920 2023-09-30T22:28:24.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.401+0000 7f22b7a81700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b00a29d0 con 0x7f22b009e480 2023-09-30T22:28:24.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.401+0000 7f22b7a81700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22b009fb40 con 0x7f22b009c890 2023-09-30T22:28:24.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.401+0000 7f22b501c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f22b009d920 0x7f22b009dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46356/0 (socket says 172.21.15.40:46356) 2023-09-30T22:28:24.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.401+0000 7f22b501c700 1 -- 172.21.15.40:0/2764581821 learned_addr learned my addr 172.21.15.40:0/2764581821 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:24.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.401+0000 7f22b601e700 1 --2- 172.21.15.40:0/2764581821 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22b009e480 0x7f22b013bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:24.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.401+0000 7f22b581d700 1 --2- 172.21.15.40:0/2764581821 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22b009c890 0x7f22b009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:24.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.401+0000 7f22b481b700 1 -- 172.21.15.40:0/2764581821 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1324525270 0 0) 0x7f22b00a2600 con 0x7f22b009d920 2023-09-30T22:28:24.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.401+0000 7f22b481b700 1 -- 172.21.15.40:0/2764581821 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f229c0035b0 con 0x7f22b009d920 2023-09-30T22:28:24.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.401+0000 7f22b601e700 1 -- 172.21.15.40:0/2764581821 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22b009c890 msgr2=0x7f22b009cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:24.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.401+0000 7f22b601e700 1 --2- 172.21.15.40:0/2764581821 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22b009c890 0x7f22b009cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.401+0000 7f22b601e700 1 -- 172.21.15.40:0/2764581821 >> v1:172.21.15.40:6789/0 conn(0x7f22b009d920 legacy=0x7f22b009dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:24.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.401+0000 7f22b601e700 1 -- 172.21.15.40:0/2764581821 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b009fed0 con 0x7f22b009e480 2023-09-30T22:28:24.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.401+0000 7f22b581d700 1 --2- 172.21.15.40:0/2764581821 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22b009c890 0x7f22b009cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:24.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.402+0000 7f22b601e700 1 --2- 172.21.15.40:0/2764581821 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22b009e480 0x7f22b013bc20 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f22a8014a30 tx=0x7f22a8014d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b03f031b30f1cf2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:24.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.402+0000 7f22b481b700 1 -- 172.21.15.40:0/2764581821 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a800fd50 con 0x7f22b009e480 2023-09-30T22:28:24.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.402+0000 7f22b481b700 1 -- 172.21.15.40:0/2764581821 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a80138e0 con 0x7f22b009e480 2023-09-30T22:28:24.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.402+0000 7f22b481b700 1 -- 172.21.15.40:0/2764581821 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a8013c90 con 0x7f22b009e480 2023-09-30T22:28:24.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.402+0000 7f22b7a81700 1 -- 172.21.15.40:0/2764581821 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22b009e480 msgr2=0x7f22b013bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:24.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.402+0000 7f22b7a81700 1 --2- 172.21.15.40:0/2764581821 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22b009e480 0x7f22b013bc20 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f22a8014a30 tx=0x7f22a8014d40 comp rx=0 tx=0).stop 2023-09-30T22:28:24.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.402+0000 7f22b7a81700 1 -- 172.21.15.40:0/2764581821 shutdown_connections 2023-09-30T22:28:24.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.402+0000 7f22b7a81700 1 --2- 172.21.15.40:0/2764581821 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22b009e480 0x7f22b013bc20 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.402+0000 7f22b7a81700 1 --2- 172.21.15.40:0/2764581821 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22b009c890 0x7f22b009cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.402+0000 7f22b7a81700 1 -- 172.21.15.40:0/2764581821 >> 172.21.15.40:0/2764581821 conn(0x7f22b00a7080 msgr2=0x7f22b00a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:24.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.403+0000 7f22b7a81700 1 -- 172.21.15.40:0/2764581821 shutdown_connections 2023-09-30T22:28:24.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.403+0000 7f22b7a81700 1 -- 172.21.15.40:0/2764581821 wait complete. 2023-09-30T22:28:24.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.404+0000 7f22b7a81700 1 Processor -- start 2023-09-30T22:28:24.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.404+0000 7f22b7a81700 1 -- start start 2023-09-30T22:28:24.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.405+0000 7f22b7a81700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22b009c890 0x7f22b012b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:24.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.405+0000 7f22b7a81700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22b009d920 0x7f22b012ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:24.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.405+0000 7f22b7a81700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22b009e480 0x7f22b012bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:24.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.405+0000 7f22b7a81700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b012d1f0 con 0x7f22b009d920 2023-09-30T22:28:24.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.405+0000 7f22b7a81700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b012d600 con 0x7f22b009c890 2023-09-30T22:28:24.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.405+0000 7f22b7a81700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22b00a5a40 con 0x7f22b009e480 2023-09-30T22:28:24.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.405+0000 7f22b501c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22b009d920 0x7f22b012ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:24.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.405+0000 7f22b501c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22b009d920 0x7f22b012ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35752/0 (socket says 172.21.15.40:35752) 2023-09-30T22:28:24.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.405+0000 7f22b501c700 1 -- 172.21.15.40:0/3531973777 learned_addr learned my addr 172.21.15.40:0/3531973777 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:24.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.405+0000 7f22b601e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22b009e480 0x7f22b012bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:24.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.405+0000 7f22b581d700 1 --2- 172.21.15.40:0/3531973777 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22b009c890 0x7f22b012b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:24.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.405+0000 7f22b501c700 1 -- 172.21.15.40:0/3531973777 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22b009e480 msgr2=0x7f22b012bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:24.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.405+0000 7f22b501c700 1 --2- 172.21.15.40:0/3531973777 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22b009e480 0x7f22b012bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.405+0000 7f22b501c700 1 -- 172.21.15.40:0/3531973777 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22b009c890 msgr2=0x7f22b012b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:24.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.405+0000 7f22b501c700 1 --2- 172.21.15.40:0/3531973777 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22b009c890 0x7f22b012b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.405+0000 7f22b501c700 1 -- 172.21.15.40:0/3531973777 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ac009430 con 0x7f22b009d920 2023-09-30T22:28:24.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.405+0000 7f22b601e700 1 --2- 172.21.15.40:0/3531973777 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22b009e480 0x7f22b012bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:24.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.405+0000 7f22b501c700 1 --2- 172.21.15.40:0/3531973777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22b009d920 0x7f22b012ba20 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f22a0005910 tx=0x7f22a000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:24.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.405+0000 7f22a67fc700 1 -- 172.21.15.40:0/3531973777 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a0005d70 con 0x7f22b009d920 2023-09-30T22:28:24.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.405+0000 7f22a67fc700 1 -- 172.21.15.40:0/3531973777 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a00070d0 con 0x7f22b009d920 2023-09-30T22:28:24.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.405+0000 7f22b7a81700 1 -- 172.21.15.40:0/3531973777 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a8014660 con 0x7f22b009d920 2023-09-30T22:28:24.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.406+0000 7f22a67fc700 1 -- 172.21.15.40:0/3531973777 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a0007460 con 0x7f22b009d920 2023-09-30T22:28:24.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.406+0000 7f22b7a81700 1 -- 172.21.15.40:0/3531973777 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b012e4a0 con 0x7f22b009d920 2023-09-30T22:28:24.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.406+0000 7f22a67fc700 1 -- 172.21.15.40:0/3531973777 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f22a00075c0 con 0x7f22b009d920 2023-09-30T22:28:24.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.406+0000 7f22a67fc700 1 -- 172.21.15.40:0/3531973777 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f22a003eb00 con 0x7f22b009d920 2023-09-30T22:28:24.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.407+0000 7f22b7a81700 1 -- 172.21.15.40:0/3531973777 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b012e270 con 0x7f22b009d920 2023-09-30T22:28:24.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.411+0000 7f22a67fc700 1 -- 172.21.15.40:0/3531973777 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f22a0017080 con 0x7f22b009d920 2023-09-30T22:28:24.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.531+0000 7f10aa80a700 1 -- 172.21.15.40:0/933307315 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f10a4074620 con 0x7f10a4136bf0 2023-09-30T22:28:24.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.531+0000 7f10a0ff9700 1 -- 172.21.15.40:0/933307315 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1098015030 con 0x7f10a4136bf0 2023-09-30T22:28:24.532 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:24.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.533+0000 7f10aa80a700 1 -- 172.21.15.40:0/933307315 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10a4136bf0 msgr2=0x7f10a406f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:24.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.533+0000 7f10aa80a700 1 --2- 172.21.15.40:0/933307315 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10a4136bf0 0x7f10a406f620 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1098009fd0 tx=0x7f1098004750 comp rx=0 tx=0).stop 2023-09-30T22:28:24.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.533+0000 7f10aa80a700 1 -- 172.21.15.40:0/933307315 shutdown_connections 2023-09-30T22:28:24.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.533+0000 7f10aa80a700 1 --2- 172.21.15.40:0/933307315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10a4139510 0x7f10a406fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.533+0000 7f10aa80a700 1 --2- 172.21.15.40:0/933307315 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10a409c890 0x7f10a406f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.533+0000 7f10aa80a700 1 --2- 172.21.15.40:0/933307315 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10a4136bf0 0x7f10a406f620 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.533+0000 7f10aa80a700 1 -- 172.21.15.40:0/933307315 >> 172.21.15.40:0/933307315 conn(0x7f10a40a7080 msgr2=0x7f10a41349d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:24.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.533+0000 7f10aa80a700 1 -- 172.21.15.40:0/933307315 shutdown_connections 2023-09-30T22:28:24.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.533+0000 7f10aa80a700 1 -- 172.21.15.40:0/933307315 wait complete. 2023-09-30T22:28:24.546 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:24.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.571+0000 7f7523f9a700 1 -- 172.21.15.40:0/3878927938 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f751c12e320 con 0x7f751c09c890 2023-09-30T22:28:24.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.571+0000 7f75127fc700 1 -- 172.21.15.40:0/3878927938 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f75180253e0 con 0x7f751c09c890 2023-09-30T22:28:24.572 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:24.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.573+0000 7f7523f9a700 1 -- 172.21.15.40:0/3878927938 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f751c09c890 msgr2=0x7f751c12b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:24.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.573+0000 7f7523f9a700 1 --2- 172.21.15.40:0/3878927938 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f751c09c890 0x7f751c12b4e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f751800e810 tx=0x7f751800eb20 comp rx=0 tx=0).stop 2023-09-30T22:28:24.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.573+0000 7f7523f9a700 1 -- 172.21.15.40:0/3878927938 shutdown_connections 2023-09-30T22:28:24.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.573+0000 7f7523f9a700 1 --2- 172.21.15.40:0/3878927938 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f751c09c890 0x7f751c12b4e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.573+0000 7f7523f9a700 1 --2- 172.21.15.40:0/3878927938 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f751c09e2b0 0x7f751c12bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.573+0000 7f7523f9a700 1 --2- 172.21.15.40:0/3878927938 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f751c09d920 0x7f751c12ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.573+0000 7f7523f9a700 1 -- 172.21.15.40:0/3878927938 >> 172.21.15.40:0/3878927938 conn(0x7f751c0a7080 msgr2=0x7f751c1bb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:24.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.574+0000 7f7523f9a700 1 -- 172.21.15.40:0/3878927938 shutdown_connections 2023-09-30T22:28:24.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.574+0000 7f7523f9a700 1 -- 172.21.15.40:0/3878927938 wait complete. 2023-09-30T22:28:24.586 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:24.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.609+0000 7f22b7a81700 1 -- 172.21.15.40:0/3531973777 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f22b0062380 con 0x7f22b009d920 2023-09-30T22:28:24.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.610+0000 7f22a67fc700 1 -- 172.21.15.40:0/3531973777 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f22a000f260 con 0x7f22b009d920 2023-09-30T22:28:24.610 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:24.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.612+0000 7f22b7a81700 1 -- 172.21.15.40:0/3531973777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22b009d920 msgr2=0x7f22b012ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:24.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.612+0000 7f22b7a81700 1 --2- 172.21.15.40:0/3531973777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22b009d920 0x7f22b012ba20 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f22a0005910 tx=0x7f22a000c9e0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.612+0000 7f22b7a81700 1 -- 172.21.15.40:0/3531973777 shutdown_connections 2023-09-30T22:28:24.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.612+0000 7f22b7a81700 1 --2- 172.21.15.40:0/3531973777 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22b009e480 0x7f22b012bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.612+0000 7f22b7a81700 1 --2- 172.21.15.40:0/3531973777 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22b009c890 0x7f22b012b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.612+0000 7f22b7a81700 1 --2- 172.21.15.40:0/3531973777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22b009d920 0x7f22b012ba20 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.612+0000 7f22b7a81700 1 -- 172.21.15.40:0/3531973777 >> 172.21.15.40:0/3531973777 conn(0x7f22b00a7080 msgr2=0x7f22b009bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:24.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.612+0000 7f22b7a81700 1 -- 172.21.15.40:0/3531973777 shutdown_connections 2023-09-30T22:28:24.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:24.612+0000 7f22b7a81700 1 -- 172.21.15.40:0/3531973777 wait complete. 2023-09-30T22:28:24.624 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:25.017 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:25.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.148+0000 7ffbecaf9700 1 Processor -- start 2023-09-30T22:28:25.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.148+0000 7ffbecaf9700 1 -- start start 2023-09-30T22:28:25.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.148+0000 7ffbecaf9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbe806b1b0 0x7ffbe8136b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.148+0000 7ffbecaf9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffbe81370a0 0x7ffbe8139480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.148+0000 7ffbecaf9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbe809eb60 con 0x7ffbe806a6d0 2023-09-30T22:28:25.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.148+0000 7ffbecaf9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe809db70 con 0x7ffbe806b1b0 2023-09-30T22:28:25.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.148+0000 7ffbecaf9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe809ddf0 con 0x7ffbe81370a0 2023-09-30T22:28:25.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.149+0000 7ffbe5d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbe806b1b0 0x7ffbe8136b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.149+0000 7ffbe659c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ffbe806a6d0 0x7ffbe806aaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46370/0 (socket says 172.21.15.40:46370) 2023-09-30T22:28:25.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.149+0000 7ffbe6d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffbe81370a0 0x7ffbe8139480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.149+0000 7ffbe659c700 1 -- 172.21.15.40:0/1999175570 learned_addr learned my addr 172.21.15.40:0/1999175570 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:25.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.149+0000 7ffbe5d9b700 1 -- 172.21.15.40:0/1999175570 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffbe81370a0 msgr2=0x7ffbe8139480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:25.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.149+0000 7ffbe5d9b700 1 --2- 172.21.15.40:0/1999175570 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffbe81370a0 0x7ffbe8139480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.149+0000 7ffbe5d9b700 1 -- 172.21.15.40:0/1999175570 >> v1:172.21.15.40:6789/0 conn(0x7ffbe806a6d0 legacy=0x7ffbe806aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.149+0000 7ffbe5d9b700 1 -- 172.21.15.40:0/1999175570 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe809c9a0 con 0x7ffbe806b1b0 2023-09-30T22:28:25.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.149+0000 7ffbe559a700 1 -- 172.21.15.40:0/1999175570 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2191752051 0 0) 0x7ffbe809eb60 con 0x7ffbe806a6d0 2023-09-30T22:28:25.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.149+0000 7ffbe6d9d700 1 --2- 172.21.15.40:0/1999175570 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffbe81370a0 0x7ffbe8139480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:25.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.149+0000 7ffbe5d9b700 1 --2- 172.21.15.40:0/1999175570 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbe806b1b0 0x7ffbe8136b60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc009870 tx=0x7ffbdc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92ef0628c941251d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:25.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.149+0000 7ffbe559a700 1 -- 172.21.15.40:0/1999175570 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc011830 con 0x7ffbe806b1b0 2023-09-30T22:28:25.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.149+0000 7ffbe559a700 1 -- 172.21.15.40:0/1999175570 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbdc011990 con 0x7ffbe806b1b0 2023-09-30T22:28:25.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.149+0000 7ffbe559a700 1 -- 172.21.15.40:0/1999175570 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc011d20 con 0x7ffbe806b1b0 2023-09-30T22:28:25.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.150+0000 7ffbecaf9700 1 -- 172.21.15.40:0/1999175570 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbe806b1b0 msgr2=0x7ffbe8136b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.150+0000 7ffbecaf9700 1 --2- 172.21.15.40:0/1999175570 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbe806b1b0 0x7ffbe8136b60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc009870 tx=0x7ffbdc009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:25.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.150+0000 7ffbecaf9700 1 -- 172.21.15.40:0/1999175570 shutdown_connections 2023-09-30T22:28:25.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.150+0000 7ffbecaf9700 1 --2- 172.21.15.40:0/1999175570 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffbe81370a0 0x7ffbe8139480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.150+0000 7ffbecaf9700 1 --2- 172.21.15.40:0/1999175570 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbe806b1b0 0x7ffbe8136b60 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.150+0000 7ffbecaf9700 1 -- 172.21.15.40:0/1999175570 >> 172.21.15.40:0/1999175570 conn(0x7ffbe809fb20 msgr2=0x7ffbe809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:25.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.150+0000 7ffbecaf9700 1 -- 172.21.15.40:0/1999175570 shutdown_connections 2023-09-30T22:28:25.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.150+0000 7ffbecaf9700 1 -- 172.21.15.40:0/1999175570 wait complete. 2023-09-30T22:28:25.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.151+0000 7ffbecaf9700 1 Processor -- start 2023-09-30T22:28:25.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.151+0000 7ffbecaf9700 1 -- start start 2023-09-30T22:28:25.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.151+0000 7ffbecaf9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffbe806a6d0 0x7ffbe811ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.151+0000 7ffbecaf9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbe806b1b0 0x7ffbe811f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.151+0000 7ffbecaf9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbe81370a0 0x7ffbe811f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.151+0000 7ffbecaf9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe8122810 con 0x7ffbe806b1b0 2023-09-30T22:28:25.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.151+0000 7ffbecaf9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe8139360 con 0x7ffbe81370a0 2023-09-30T22:28:25.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.151+0000 7ffbecaf9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe80715d0 con 0x7ffbe806a6d0 2023-09-30T22:28:25.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.152+0000 7ffbe659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffbe806a6d0 0x7ffbe811ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.152+0000 7ffbe6d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbe81370a0 0x7ffbe811f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.152+0000 7ffbe659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffbe806a6d0 0x7ffbe811ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55608/0 (socket says 172.21.15.40:55608) 2023-09-30T22:28:25.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.152+0000 7ffbe659c700 1 -- 172.21.15.40:0/2583694182 learned_addr learned my addr 172.21.15.40:0/2583694182 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:25.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.152+0000 7ffbe6d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbe81370a0 0x7ffbe811f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54086/0 (socket says 172.21.15.40:54086) 2023-09-30T22:28:25.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.152+0000 7ffbe5d9b700 1 --2- 172.21.15.40:0/2583694182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbe806b1b0 0x7ffbe811f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.152+0000 7ffbe659c700 1 -- 172.21.15.40:0/2583694182 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbe81370a0 msgr2=0x7ffbe811f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.152+0000 7ffbe659c700 1 --2- 172.21.15.40:0/2583694182 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbe81370a0 0x7ffbe811f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.152+0000 7ffbe659c700 1 -- 172.21.15.40:0/2583694182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbe806b1b0 msgr2=0x7ffbe811f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.152+0000 7ffbe659c700 1 --2- 172.21.15.40:0/2583694182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbe806b1b0 0x7ffbe811f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.152+0000 7ffbe659c700 1 -- 172.21.15.40:0/2583694182 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe0009a70 con 0x7ffbe806a6d0 2023-09-30T22:28:25.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.152+0000 7ffbe6d9d700 1 --2- 172.21.15.40:0/2583694182 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbe81370a0 0x7ffbe811f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:25.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.152+0000 7ffbe659c700 1 --2- 172.21.15.40:0/2583694182 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffbe806a6d0 0x7ffbe811ed80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ffbd800c6d0 tx=0x7ffbd800c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:25.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.152+0000 7ffbd6ffd700 1 -- 172.21.15.40:0/2583694182 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd80074e0 con 0x7ffbe806a6d0 2023-09-30T22:28:25.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.152+0000 7ffbd6ffd700 1 -- 172.21.15.40:0/2583694182 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd8007660 con 0x7ffbe806a6d0 2023-09-30T22:28:25.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.152+0000 7ffbecaf9700 1 -- 172.21.15.40:0/2583694182 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbdc0094a0 con 0x7ffbe806a6d0 2023-09-30T22:28:25.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.152+0000 7ffbd6ffd700 1 -- 172.21.15.40:0/2583694182 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd8005a70 con 0x7ffbe806a6d0 2023-09-30T22:28:25.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.152+0000 7ffbecaf9700 1 -- 172.21.15.40:0/2583694182 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe809e420 con 0x7ffbe806a6d0 2023-09-30T22:28:25.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.153+0000 7ffbd6ffd700 1 -- 172.21.15.40:0/2583694182 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffbd8005bd0 con 0x7ffbe806a6d0 2023-09-30T22:28:25.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.153+0000 7ffbd6ffd700 1 -- 172.21.15.40:0/2583694182 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ffbd803ec40 con 0x7ffbe806a6d0 2023-09-30T22:28:25.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.153+0000 7ffbecaf9700 1 -- 172.21.15.40:0/2583694182 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbe8062380 con 0x7ffbe806a6d0 2023-09-30T22:28:25.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.158+0000 7ffbd6ffd700 1 -- 172.21.15.40:0/2583694182 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffbd8018260 con 0x7ffbe806a6d0 2023-09-30T22:28:25.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.352+0000 7ffbecaf9700 1 -- 172.21.15.40:0/2583694182 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ffbe8070430 con 0x7ffbe806a6d0 2023-09-30T22:28:25.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.352+0000 7ffbd6ffd700 1 -- 172.21.15.40:0/2583694182 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffbd8017020 con 0x7ffbe806a6d0 2023-09-30T22:28:25.353 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:25.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.354+0000 7ffbecaf9700 1 -- 172.21.15.40:0/2583694182 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffbe806a6d0 msgr2=0x7ffbe811ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.354+0000 7ffbecaf9700 1 --2- 172.21.15.40:0/2583694182 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffbe806a6d0 0x7ffbe811ed80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ffbd800c6d0 tx=0x7ffbd800c9e0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.354+0000 7ffbecaf9700 1 -- 172.21.15.40:0/2583694182 shutdown_connections 2023-09-30T22:28:25.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.354+0000 7ffbecaf9700 1 --2- 172.21.15.40:0/2583694182 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffbe806a6d0 0x7ffbe811ed80 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.354+0000 7ffbecaf9700 1 --2- 172.21.15.40:0/2583694182 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbe81370a0 0x7ffbe811f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.354+0000 7ffbecaf9700 1 --2- 172.21.15.40:0/2583694182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbe806b1b0 0x7ffbe811f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.354+0000 7ffbecaf9700 1 -- 172.21.15.40:0/2583694182 >> 172.21.15.40:0/2583694182 conn(0x7ffbe809fb20 msgr2=0x7ffbe80a2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:25.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.354+0000 7ffbecaf9700 1 -- 172.21.15.40:0/2583694182 shutdown_connections 2023-09-30T22:28:25.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.354+0000 7ffbecaf9700 1 -- 172.21.15.40:0/2583694182 wait complete. 2023-09-30T22:28:25.367 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:25.547 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:25.587 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:25.625 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:25.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.679+0000 7fdf930b0700 1 Processor -- start 2023-09-30T22:28:25.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.679+0000 7fdf930b0700 1 -- start start 2023-09-30T22:28:25.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.679+0000 7fdf930b0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdf8c09e030 0x7fdf8c13d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.679+0000 7fdf930b0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf8c09e450 0x7fdf8c13f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.679+0000 7fdf930b0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf8c11d980 con 0x7fdf8c06a6d0 2023-09-30T22:28:25.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.679+0000 7fdf930b0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf8c06aaa0 con 0x7fdf8c09e030 2023-09-30T22:28:25.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.679+0000 7fdf930b0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c06b150 con 0x7fdf8c09e450 2023-09-30T22:28:25.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.679+0000 7fdf9164d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf8c09e450 0x7fdf8c13f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.679+0000 7fdf9164d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf8c09e450 0x7fdf8c13f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54102/0 (socket says 172.21.15.40:54102) 2023-09-30T22:28:25.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.679+0000 7fdf9164d700 1 -- 172.21.15.40:0/3875986666 learned_addr learned my addr 172.21.15.40:0/3875986666 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:25.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.679+0000 7fdf8bfff700 1 --2- 172.21.15.40:0/3875986666 >> v2:172.21.15.40:3300/0 conn(0x7fdf8c09e030 0x7fdf8c13d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.680+0000 7fdf9164d700 1 -- 172.21.15.40:0/3875986666 >> v2:172.21.15.40:3300/0 conn(0x7fdf8c09e030 msgr2=0x7fdf8c13d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:25.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.680+0000 7fdf9164d700 1 --2- 172.21.15.40:0/3875986666 >> v2:172.21.15.40:3300/0 conn(0x7fdf8c09e030 0x7fdf8c13d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.680+0000 7fdf9164d700 1 -- 172.21.15.40:0/3875986666 >> v1:172.21.15.40:6789/0 conn(0x7fdf8c06a6d0 legacy=0x7fdf8c09d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.680+0000 7fdf9164d700 1 -- 172.21.15.40:0/3875986666 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf8c09f300 con 0x7fdf8c09e450 2023-09-30T22:28:25.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.680+0000 7fdf9164d700 1 --2- 172.21.15.40:0/3875986666 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf8c09e450 0x7fdf8c13f9f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fdf84009e50 tx=0x7fdf8400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9732017d4b3a0d69 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:25.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.680+0000 7fdf8b7fe700 1 -- 172.21.15.40:0/3875986666 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8400e070 con 0x7fdf8c09e450 2023-09-30T22:28:25.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.680+0000 7fdf8b7fe700 1 -- 172.21.15.40:0/3875986666 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8400b910 con 0x7fdf8c09e450 2023-09-30T22:28:25.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.680+0000 7fdf8b7fe700 1 -- 172.21.15.40:0/3875986666 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8400bcc0 con 0x7fdf8c09e450 2023-09-30T22:28:25.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.681+0000 7fdf930b0700 1 -- 172.21.15.40:0/3875986666 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf8c09e450 msgr2=0x7fdf8c13f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.681+0000 7fdf930b0700 1 --2- 172.21.15.40:0/3875986666 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf8c09e450 0x7fdf8c13f9f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fdf84009e50 tx=0x7fdf8400b330 comp rx=0 tx=0).stop 2023-09-30T22:28:25.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.681+0000 7fdf930b0700 1 -- 172.21.15.40:0/3875986666 shutdown_connections 2023-09-30T22:28:25.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.681+0000 7fdf930b0700 1 --2- 172.21.15.40:0/3875986666 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf8c09e450 0x7fdf8c13f9f0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.681+0000 7fdf930b0700 1 --2- 172.21.15.40:0/3875986666 >> v2:172.21.15.40:3300/0 conn(0x7fdf8c09e030 0x7fdf8c13d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.681+0000 7fdf930b0700 1 -- 172.21.15.40:0/3875986666 >> 172.21.15.40:0/3875986666 conn(0x7fdf8c09fb20 msgr2=0x7fdf8c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:25.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.681+0000 7fdf930b0700 1 -- 172.21.15.40:0/3875986666 shutdown_connections 2023-09-30T22:28:25.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.681+0000 7fdf930b0700 1 -- 172.21.15.40:0/3875986666 wait complete. 2023-09-30T22:28:25.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.682+0000 7fdf930b0700 1 Processor -- start 2023-09-30T22:28:25.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.682+0000 7fdf930b0700 1 -- start start 2023-09-30T22:28:25.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.683+0000 7fdf930b0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf8c06a6d0 0x7fdf8c1ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.683+0000 7fdf930b0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf8c09e030 0x7fdf8c1cd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.683+0000 7fdf930b0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf8c09e450 0x7fdf8c1cd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.683+0000 7fdf930b0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c11bed0 con 0x7fdf8c09e450 2023-09-30T22:28:25.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.683+0000 7fdf930b0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c11b310 con 0x7fdf8c09e030 2023-09-30T22:28:25.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.683+0000 7fdf930b0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c0a20b0 con 0x7fdf8c06a6d0 2023-09-30T22:28:25.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.683+0000 7fdf9164d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf8c09e450 0x7fdf8c1cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.683+0000 7fdf90e4c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf8c06a6d0 0x7fdf8c1ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.683+0000 7fdf90e4c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf8c06a6d0 0x7fdf8c1ccde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55614/0 (socket says 172.21.15.40:55614) 2023-09-30T22:28:25.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.683+0000 7fdf9164d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf8c09e450 0x7fdf8c1cd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35778/0 (socket says 172.21.15.40:35778) 2023-09-30T22:28:25.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.683+0000 7fdf90e4c700 1 -- 172.21.15.40:0/1115228584 learned_addr learned my addr 172.21.15.40:0/1115228584 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:25.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.683+0000 7fdf8bfff700 1 --2- 172.21.15.40:0/1115228584 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf8c09e030 0x7fdf8c1cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.683+0000 7fdf8bfff700 1 -- 172.21.15.40:0/1115228584 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf8c06a6d0 msgr2=0x7fdf8c1ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.683+0000 7fdf8bfff700 1 --2- 172.21.15.40:0/1115228584 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf8c06a6d0 0x7fdf8c1ccde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.683+0000 7fdf8bfff700 1 -- 172.21.15.40:0/1115228584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf8c09e450 msgr2=0x7fdf8c1cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.683+0000 7fdf8bfff700 1 --2- 172.21.15.40:0/1115228584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf8c09e450 0x7fdf8c1cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.683+0000 7fdf8bfff700 1 -- 172.21.15.40:0/1115228584 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf84009b30 con 0x7fdf8c09e030 2023-09-30T22:28:25.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.683+0000 7fdf90e4c700 1 --2- 172.21.15.40:0/1115228584 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf8c06a6d0 0x7fdf8c1ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:25.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.683+0000 7fdf8bfff700 1 --2- 172.21.15.40:0/1115228584 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf8c09e030 0x7fdf8c1cd320 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fdf7800e900 tx=0x7fdf7800ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:25.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.684+0000 7fdf897fa700 1 -- 172.21.15.40:0/1115228584 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf78013680 con 0x7fdf8c09e030 2023-09-30T22:28:25.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.684+0000 7fdf897fa700 1 -- 172.21.15.40:0/1115228584 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf780137e0 con 0x7fdf8c09e030 2023-09-30T22:28:25.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.684+0000 7fdf930b0700 1 -- 172.21.15.40:0/1115228584 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf8c11c840 con 0x7fdf8c09e030 2023-09-30T22:28:25.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.684+0000 7fdf897fa700 1 -- 172.21.15.40:0/1115228584 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf78013b50 con 0x7fdf8c09e030 2023-09-30T22:28:25.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.684+0000 7fdf930b0700 1 -- 172.21.15.40:0/1115228584 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf8c09f590 con 0x7fdf8c09e030 2023-09-30T22:28:25.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.685+0000 7fdf897fa700 1 -- 172.21.15.40:0/1115228584 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdf78013cb0 con 0x7fdf8c09e030 2023-09-30T22:28:25.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.685+0000 7fdf930b0700 1 -- 172.21.15.40:0/1115228584 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf8c062380 con 0x7fdf8c09e030 2023-09-30T22:28:25.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.685+0000 7fdf897fa700 1 -- 172.21.15.40:0/1115228584 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fdf7803f8e0 con 0x7fdf8c09e030 2023-09-30T22:28:25.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.689+0000 7fdf897fa700 1 -- 172.21.15.40:0/1115228584 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdf78017080 con 0x7fdf8c09e030 2023-09-30T22:28:25.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.720+0000 7fdc1224c700 1 Processor -- start 2023-09-30T22:28:25.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.720+0000 7fdc1224c700 1 -- start start 2023-09-30T22:28:25.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.721+0000 7fdc1224c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdc0c09fbb0 0x7fdc0c06c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.721+0000 7fdc1224c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc0c06d2c0 0x7fdc0c13baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.721+0000 7fdc1224c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc0c0a0590 con 0x7fdc0c06ced0 2023-09-30T22:28:25.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.721+0000 7fdc1224c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c09ff80 con 0x7fdc0c06d2c0 2023-09-30T22:28:25.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.721+0000 7fdc1224c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c06da80 con 0x7fdc0c09fbb0 2023-09-30T22:28:25.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.721+0000 7fdc0bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc0c06d2c0 0x7fdc0c13baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.721+0000 7fdc0affd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fdc0c06ced0 0x7fdc0c138370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46378/0 (socket says 172.21.15.40:46378) 2023-09-30T22:28:25.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.721+0000 7fdc0affd700 1 -- 172.21.15.40:0/737964395 learned_addr learned my addr 172.21.15.40:0/737964395 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:25.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.721+0000 7fdc0b7fe700 1 --2- 172.21.15.40:0/737964395 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdc0c09fbb0 0x7fdc0c06c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.721+0000 7fdc0a7fc700 1 -- 172.21.15.40:0/737964395 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 998951550 0 0) 0x7fdc0c0a0590 con 0x7fdc0c06ced0 2023-09-30T22:28:25.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.722+0000 7fdc0a7fc700 1 -- 172.21.15.40:0/737964395 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbf40035b0 con 0x7fdc0c06ced0 2023-09-30T22:28:25.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.722+0000 7fdc0b7fe700 1 -- 172.21.15.40:0/737964395 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc0c06d2c0 msgr2=0x7fdc0c13baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:25.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.722+0000 7fdc0b7fe700 1 --2- 172.21.15.40:0/737964395 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc0c06d2c0 0x7fdc0c13baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.722+0000 7fdc0b7fe700 1 -- 172.21.15.40:0/737964395 >> v1:172.21.15.40:6789/0 conn(0x7fdc0c06ced0 legacy=0x7fdc0c138370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.722+0000 7fdc0b7fe700 1 -- 172.21.15.40:0/737964395 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0c0a0780 con 0x7fdc0c09fbb0 2023-09-30T22:28:25.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.722+0000 7fdc0b7fe700 1 --2- 172.21.15.40:0/737964395 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdc0c09fbb0 0x7fdc0c06c990 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc009870 tx=0x7fdbfc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a711b85edc7a5f60 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:25.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.722+0000 7fdc0a7fc700 1 -- 172.21.15.40:0/737964395 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc011830 con 0x7fdc0c09fbb0 2023-09-30T22:28:25.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.722+0000 7fdc0a7fc700 1 -- 172.21.15.40:0/737964395 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbfc011990 con 0x7fdc0c09fbb0 2023-09-30T22:28:25.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.722+0000 7fdc0a7fc700 1 -- 172.21.15.40:0/737964395 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc011d20 con 0x7fdc0c09fbb0 2023-09-30T22:28:25.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.723+0000 7fdc1224c700 1 -- 172.21.15.40:0/737964395 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdc0c09fbb0 msgr2=0x7fdc0c06c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.723+0000 7fdc1224c700 1 --2- 172.21.15.40:0/737964395 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdc0c09fbb0 0x7fdc0c06c990 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc009870 tx=0x7fdbfc009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:25.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.723+0000 7fdc1224c700 1 -- 172.21.15.40:0/737964395 shutdown_connections 2023-09-30T22:28:25.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.723+0000 7fdc1224c700 1 --2- 172.21.15.40:0/737964395 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc0c06d2c0 0x7fdc0c13baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.723+0000 7fdc1224c700 1 --2- 172.21.15.40:0/737964395 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdc0c09fbb0 0x7fdc0c06c990 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.723+0000 7fdc1224c700 1 -- 172.21.15.40:0/737964395 >> 172.21.15.40:0/737964395 conn(0x7fdc0c0a41a0 msgr2=0x7fdc0c0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:25.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.723+0000 7fdc1224c700 1 -- 172.21.15.40:0/737964395 shutdown_connections 2023-09-30T22:28:25.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.723+0000 7fdc1224c700 1 -- 172.21.15.40:0/737964395 wait complete. 2023-09-30T22:28:25.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.724+0000 7fdc1224c700 1 Processor -- start 2023-09-30T22:28:25.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.724+0000 7fdc1224c700 1 -- start start 2023-09-30T22:28:25.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.724+0000 7fdc1224c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdc0c06ced0 0x7fdc0c095c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.724+0000 7fdc1224c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc0c06d2c0 0x7fdc0c0961b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.724+0000 7fdc1224c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc0c09fbb0 0x7fdc0c0966f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.724+0000 7fdc1224c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c071eb0 con 0x7fdc0c06d2c0 2023-09-30T22:28:25.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.724+0000 7fdc1224c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c091820 con 0x7fdc0c09fbb0 2023-09-30T22:28:25.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.724+0000 7fdc1224c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c094af0 con 0x7fdc0c06ced0 2023-09-30T22:28:25.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.724+0000 7fdc0b7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdc0c06ced0 0x7fdc0c095c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.724+0000 7fdc0b7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdc0c06ced0 0x7fdc0c095c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55630/0 (socket says 172.21.15.40:55630) 2023-09-30T22:28:25.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.724+0000 7fdc0b7fe700 1 -- 172.21.15.40:0/1448286933 learned_addr learned my addr 172.21.15.40:0/1448286933 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:25.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.725+0000 7fdc0bfff700 1 --2- 172.21.15.40:0/1448286933 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc0c09fbb0 0x7fdc0c0966f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.725+0000 7fdc0affd700 1 --2- 172.21.15.40:0/1448286933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc0c06d2c0 0x7fdc0c0961b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.725+0000 7fdc0bfff700 1 -- 172.21.15.40:0/1448286933 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdc0c06ced0 msgr2=0x7fdc0c095c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.725+0000 7fdc0bfff700 1 --2- 172.21.15.40:0/1448286933 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdc0c06ced0 0x7fdc0c095c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.725+0000 7fdc0bfff700 1 -- 172.21.15.40:0/1448286933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc0c06d2c0 msgr2=0x7fdc0c0961b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.725+0000 7fdc0bfff700 1 --2- 172.21.15.40:0/1448286933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc0c06d2c0 0x7fdc0c0961b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.725+0000 7fdc0bfff700 1 -- 172.21.15.40:0/1448286933 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbfc0094a0 con 0x7fdc0c09fbb0 2023-09-30T22:28:25.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.725+0000 7fdc0bfff700 1 --2- 172.21.15.40:0/1448286933 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc0c09fbb0 0x7fdc0c0966f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fdc0400efc0 tx=0x7fdc0400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:25.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.725+0000 7fdbf3fff700 1 -- 172.21.15.40:0/1448286933 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0400cc90 con 0x7fdc0c09fbb0 2023-09-30T22:28:25.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.725+0000 7fdbf3fff700 1 -- 172.21.15.40:0/1448286933 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0400f040 con 0x7fdc0c09fbb0 2023-09-30T22:28:25.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.725+0000 7fdc1224c700 1 -- 172.21.15.40:0/1448286933 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc0c06df90 con 0x7fdc0c09fbb0 2023-09-30T22:28:25.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.725+0000 7fdbf3fff700 1 -- 172.21.15.40:0/1448286933 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc040146c0 con 0x7fdc0c09fbb0 2023-09-30T22:28:25.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.725+0000 7fdc1224c700 1 -- 172.21.15.40:0/1448286933 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc0c095820 con 0x7fdc0c09fbb0 2023-09-30T22:28:25.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.726+0000 7fdbf3fff700 1 -- 172.21.15.40:0/1448286933 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdc04014820 con 0x7fdc0c09fbb0 2023-09-30T22:28:25.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.726+0000 7fdbf3fff700 1 -- 172.21.15.40:0/1448286933 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fdc04040530 con 0x7fdc0c09fbb0 2023-09-30T22:28:25.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.727+0000 7fdc1224c700 1 -- 172.21.15.40:0/1448286933 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc0c094cb0 con 0x7fdc0c09fbb0 2023-09-30T22:28:25.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.731+0000 7fdbf3fff700 1 -- 172.21.15.40:0/1448286933 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdc04009e60 con 0x7fdc0c09fbb0 2023-09-30T22:28:25.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.766+0000 7f5c2d2e7700 1 Processor -- start 2023-09-30T22:28:25.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.766+0000 7f5c2d2e7700 1 -- start start 2023-09-30T22:28:25.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.767+0000 7f5c2d2e7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c2812e590 0x7f5c2812e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.767+0000 7f5c2d2e7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c2812eea0 0x7f5c2812d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.767+0000 7f5c2d2e7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5c2812d6d0 0x7f5c2812db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.767+0000 7f5c2d2e7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c2809ca30 con 0x7f5c2812d6d0 2023-09-30T22:28:25.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.767+0000 7f5c2d2e7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2809ab70 con 0x7f5c2812e590 2023-09-30T22:28:25.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.767+0000 7f5c2d2e7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2809bd70 con 0x7f5c2812eea0 2023-09-30T22:28:25.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.767+0000 7f5c277fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5c2812d6d0 0x7f5c2812db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.767+0000 7f5c277fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5c2812d6d0 0x7f5c2812db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35798/0 (socket says 172.21.15.40:35798) 2023-09-30T22:28:25.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.767+0000 7f5c277fe700 1 -- 172.21.15.40:0/2579037808 learned_addr learned my addr 172.21.15.40:0/2579037808 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:25.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.767+0000 7f5c26ffd700 1 --2- 172.21.15.40:0/2579037808 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c2812e590 0x7f5c2812e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.767+0000 7f5c267fc700 1 --2- 172.21.15.40:0/2579037808 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c2812eea0 0x7f5c2812d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.767+0000 7f5c277fe700 1 -- 172.21.15.40:0/2579037808 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c2812eea0 msgr2=0x7f5c2812d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:25.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.767+0000 7f5c277fe700 1 --2- 172.21.15.40:0/2579037808 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c2812eea0 0x7f5c2812d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.767+0000 7f5c277fe700 1 -- 172.21.15.40:0/2579037808 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c2812e590 msgr2=0x7f5c2812e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:25.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.767+0000 7f5c277fe700 1 --2- 172.21.15.40:0/2579037808 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c2812e590 0x7f5c2812e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.767+0000 7f5c277fe700 1 -- 172.21.15.40:0/2579037808 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c2809b270 con 0x7f5c2812d6d0 2023-09-30T22:28:25.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.767+0000 7f5c267fc700 1 --2- 172.21.15.40:0/2579037808 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c2812eea0 0x7f5c2812d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:25.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.767+0000 7f5c277fe700 1 --2- 172.21.15.40:0/2579037808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c2812d6d0 0x7f5c2812db70 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f5c20009e50 tx=0x7f5c2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15dd46390ce5cf8e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:25.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.768+0000 7f5c25ffb700 1 -- 172.21.15.40:0/2579037808 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2000e070 con 0x7f5c2812d6d0 2023-09-30T22:28:25.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.768+0000 7f5c25ffb700 1 -- 172.21.15.40:0/2579037808 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2000b910 con 0x7f5c2812d6d0 2023-09-30T22:28:25.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.768+0000 7f5c25ffb700 1 -- 172.21.15.40:0/2579037808 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2000bcc0 con 0x7f5c2812d6d0 2023-09-30T22:28:25.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.768+0000 7f5c2d2e7700 1 -- 172.21.15.40:0/2579037808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c2812d6d0 msgr2=0x7f5c2812db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.768+0000 7f5c2d2e7700 1 --2- 172.21.15.40:0/2579037808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c2812d6d0 0x7f5c2812db70 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f5c20009e50 tx=0x7f5c2000b330 comp rx=0 tx=0).stop 2023-09-30T22:28:25.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.768+0000 7f5c2d2e7700 1 -- 172.21.15.40:0/2579037808 shutdown_connections 2023-09-30T22:28:25.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.768+0000 7f5c2d2e7700 1 --2- 172.21.15.40:0/2579037808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c2812d6d0 0x7f5c2812db70 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.768+0000 7f5c2d2e7700 1 --2- 172.21.15.40:0/2579037808 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c2812e590 0x7f5c2812e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.768+0000 7f5c2d2e7700 1 --2- 172.21.15.40:0/2579037808 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c2812eea0 0x7f5c2812d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.768+0000 7f5c2d2e7700 1 -- 172.21.15.40:0/2579037808 >> 172.21.15.40:0/2579037808 conn(0x7f5c280a2a00 msgr2=0x7f5c280a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:25.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.768+0000 7f5c2d2e7700 1 -- 172.21.15.40:0/2579037808 shutdown_connections 2023-09-30T22:28:25.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.768+0000 7f5c2d2e7700 1 -- 172.21.15.40:0/2579037808 wait complete. 2023-09-30T22:28:25.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.769+0000 7f5c2d2e7700 1 Processor -- start 2023-09-30T22:28:25.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.769+0000 7f5c2d2e7700 1 -- start start 2023-09-30T22:28:25.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.770+0000 7f5c2d2e7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c2812d6d0 0x7f5c28119990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.770+0000 7f5c2d2e7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c2812e590 0x7f5c28119ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.770+0000 7f5c2d2e7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c2812eea0 0x7f5c2811a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.770+0000 7f5c2d2e7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2811d140 con 0x7f5c2812e590 2023-09-30T22:28:25.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.770+0000 7f5c2d2e7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2811b620 con 0x7f5c2812d6d0 2023-09-30T22:28:25.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.770+0000 7f5c2d2e7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2809fc70 con 0x7f5c2812eea0 2023-09-30T22:28:25.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.770+0000 7f5c267fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c2812e590 0x7f5c28119ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.770+0000 7f5c26ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c2812d6d0 0x7f5c28119990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.770+0000 7f5c267fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c2812e590 0x7f5c28119ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35802/0 (socket says 172.21.15.40:35802) 2023-09-30T22:28:25.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.770+0000 7f5c267fc700 1 -- 172.21.15.40:0/3340096648 learned_addr learned my addr 172.21.15.40:0/3340096648 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:25.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.770+0000 7f5c277fe700 1 --2- 172.21.15.40:0/3340096648 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c2812eea0 0x7f5c2811a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.770+0000 7f5c26ffd700 1 -- 172.21.15.40:0/3340096648 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c2812eea0 msgr2=0x7f5c2811a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.770+0000 7f5c26ffd700 1 --2- 172.21.15.40:0/3340096648 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c2812eea0 0x7f5c2811a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.770+0000 7f5c26ffd700 1 -- 172.21.15.40:0/3340096648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c2812e590 msgr2=0x7f5c28119ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.770+0000 7f5c26ffd700 1 --2- 172.21.15.40:0/3340096648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c2812e590 0x7f5c28119ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.770+0000 7f5c26ffd700 1 -- 172.21.15.40:0/3340096648 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c1c00da70 con 0x7f5c2812d6d0 2023-09-30T22:28:25.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.770+0000 7f5c277fe700 1 --2- 172.21.15.40:0/3340096648 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c2812eea0 0x7f5c2811a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:25.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.770+0000 7f5c267fc700 1 --2- 172.21.15.40:0/3340096648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c2812e590 0x7f5c28119ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:25.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.771+0000 7f5c26ffd700 1 --2- 172.21.15.40:0/3340096648 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c2812d6d0 0x7f5c28119990 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5c180084b0 tx=0x7f5c180087c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:25.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.771+0000 7f5c0f7fe700 1 -- 172.21.15.40:0/3340096648 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c18013850 con 0x7f5c2812d6d0 2023-09-30T22:28:25.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.771+0000 7f5c0f7fe700 1 -- 172.21.15.40:0/3340096648 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c180139b0 con 0x7f5c2812d6d0 2023-09-30T22:28:25.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.771+0000 7f5c2d2e7700 1 -- 172.21.15.40:0/3340096648 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c20009b30 con 0x7f5c2812d6d0 2023-09-30T22:28:25.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.771+0000 7f5c0f7fe700 1 -- 172.21.15.40:0/3340096648 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c18013d40 con 0x7f5c2812d6d0 2023-09-30T22:28:25.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.771+0000 7f5c2d2e7700 1 -- 172.21.15.40:0/3340096648 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c2811c760 con 0x7f5c2812d6d0 2023-09-30T22:28:25.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.772+0000 7f5c2d2e7700 1 -- 172.21.15.40:0/3340096648 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c2811d280 con 0x7f5c2812d6d0 2023-09-30T22:28:25.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.773+0000 7f5c0f7fe700 1 -- 172.21.15.40:0/3340096648 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5c18025480 con 0x7f5c2812d6d0 2023-09-30T22:28:25.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.773+0000 7f5c0f7fe700 1 -- 172.21.15.40:0/3340096648 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5c1803ff00 con 0x7f5c2812d6d0 2023-09-30T22:28:25.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.777+0000 7f5c0f7fe700 1 -- 172.21.15.40:0/3340096648 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5c18023350 con 0x7f5c2812d6d0 2023-09-30T22:28:25.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.889+0000 7fdf930b0700 1 -- 172.21.15.40:0/1115228584 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdf8c13ef10 con 0x7fdf8c09e030 2023-09-30T22:28:25.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.890+0000 7fdf897fa700 1 -- 172.21.15.40:0/1115228584 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdf7801b590 con 0x7fdf8c09e030 2023-09-30T22:28:25.891 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:25.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.892+0000 7fdf930b0700 1 -- 172.21.15.40:0/1115228584 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf8c09e030 msgr2=0x7fdf8c1cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.892+0000 7fdf930b0700 1 --2- 172.21.15.40:0/1115228584 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf8c09e030 0x7fdf8c1cd320 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fdf7800e900 tx=0x7fdf7800ec10 comp rx=0 tx=0).stop 2023-09-30T22:28:25.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.892+0000 7fdf930b0700 1 -- 172.21.15.40:0/1115228584 shutdown_connections 2023-09-30T22:28:25.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.892+0000 7fdf930b0700 1 --2- 172.21.15.40:0/1115228584 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf8c06a6d0 0x7fdf8c1ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.892+0000 7fdf930b0700 1 --2- 172.21.15.40:0/1115228584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf8c09e450 0x7fdf8c1cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.892+0000 7fdf930b0700 1 --2- 172.21.15.40:0/1115228584 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf8c09e030 0x7fdf8c1cd320 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.892+0000 7fdf930b0700 1 -- 172.21.15.40:0/1115228584 >> 172.21.15.40:0/1115228584 conn(0x7fdf8c09fb20 msgr2=0x7fdf8c06e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:25.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.892+0000 7fdf930b0700 1 -- 172.21.15.40:0/1115228584 shutdown_connections 2023-09-30T22:28:25.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.892+0000 7fdf930b0700 1 -- 172.21.15.40:0/1115228584 wait complete. 2023-09-30T22:28:25.905 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:25.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.932+0000 7fdc1224c700 1 -- 172.21.15.40:0/1448286933 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdc0c062380 con 0x7fdc0c09fbb0 2023-09-30T22:28:25.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.933+0000 7fdbf3fff700 1 -- 172.21.15.40:0/1448286933 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdc0402c090 con 0x7fdc0c09fbb0 2023-09-30T22:28:25.933 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:25.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.935+0000 7fdc1224c700 1 -- 172.21.15.40:0/1448286933 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc0c09fbb0 msgr2=0x7fdc0c0966f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.935+0000 7fdc1224c700 1 --2- 172.21.15.40:0/1448286933 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc0c09fbb0 0x7fdc0c0966f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fdc0400efc0 tx=0x7fdc0400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.935+0000 7fdc1224c700 1 -- 172.21.15.40:0/1448286933 shutdown_connections 2023-09-30T22:28:25.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.935+0000 7fdc1224c700 1 --2- 172.21.15.40:0/1448286933 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdc0c06ced0 0x7fdc0c095c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.935+0000 7fdc1224c700 1 --2- 172.21.15.40:0/1448286933 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc0c09fbb0 0x7fdc0c0966f0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.935+0000 7fdc1224c700 1 --2- 172.21.15.40:0/1448286933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc0c06d2c0 0x7fdc0c0961b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.935+0000 7fdc1224c700 1 -- 172.21.15.40:0/1448286933 >> 172.21.15.40:0/1448286933 conn(0x7fdc0c0a41a0 msgr2=0x7fdc0c0a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:25.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.935+0000 7fdc1224c700 1 -- 172.21.15.40:0/1448286933 shutdown_connections 2023-09-30T22:28:25.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.935+0000 7fdc1224c700 1 -- 172.21.15.40:0/1448286933 wait complete. 2023-09-30T22:28:25.948 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:25.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.974+0000 7f5c2d2e7700 1 -- 172.21.15.40:0/3340096648 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5c2811d280 con 0x7f5c2812d6d0 2023-09-30T22:28:25.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.974+0000 7f5c0f7fe700 1 -- 172.21.15.40:0/3340096648 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5c2811d280 con 0x7f5c2812d6d0 2023-09-30T22:28:25.975 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:25.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.977+0000 7f5c2d2e7700 1 -- 172.21.15.40:0/3340096648 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c2812d6d0 msgr2=0x7f5c28119990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.977+0000 7f5c2d2e7700 1 --2- 172.21.15.40:0/3340096648 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c2812d6d0 0x7f5c28119990 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5c180084b0 tx=0x7f5c180087c0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.977+0000 7f5c2d2e7700 1 -- 172.21.15.40:0/3340096648 shutdown_connections 2023-09-30T22:28:25.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.977+0000 7f5c2d2e7700 1 --2- 172.21.15.40:0/3340096648 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c2812eea0 0x7f5c2811a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.977+0000 7f5c2d2e7700 1 --2- 172.21.15.40:0/3340096648 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c2812d6d0 0x7f5c28119990 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.977+0000 7f5c2d2e7700 1 --2- 172.21.15.40:0/3340096648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c2812e590 0x7f5c28119ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.977+0000 7f5c2d2e7700 1 -- 172.21.15.40:0/3340096648 >> 172.21.15.40:0/3340096648 conn(0x7f5c280a2a00 msgr2=0x7f5c2812c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:25.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.977+0000 7f5c2d2e7700 1 -- 172.21.15.40:0/3340096648 shutdown_connections 2023-09-30T22:28:25.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:25.977+0000 7f5c2d2e7700 1 -- 172.21.15.40:0/3340096648 wait complete. 2023-09-30T22:28:25.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:26.368 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:26.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.504+0000 7f671561b700 1 Processor -- start 2023-09-30T22:28:26.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.504+0000 7f671561b700 1 -- start start 2023-09-30T22:28:26.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.504+0000 7f671561b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6710136bf0 0x7f6710138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:26.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.504+0000 7f671561b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6710139510 0x7f671013b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:26.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.504+0000 7f671561b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67100a2600 con 0x7f671009c890 2023-09-30T22:28:26.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.504+0000 7f671561b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67100a29d0 con 0x7f6710136bf0 2023-09-30T22:28:26.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.504+0000 7f671561b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f671009fb40 con 0x7f6710139510 2023-09-30T22:28:26.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.504+0000 7f670e7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6710136bf0 0x7f6710138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:26.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.504+0000 7f670f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6710139510 0x7f671013b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:26.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.504+0000 7f670f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6710139510 0x7f671013b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54176/0 (socket says 172.21.15.40:54176) 2023-09-30T22:28:26.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.504+0000 7f670e7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6710136bf0 0x7f6710138fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35806/0 (socket says 172.21.15.40:35806) 2023-09-30T22:28:26.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.504+0000 7f670f7fe700 1 -- 172.21.15.40:0/2547469069 learned_addr learned my addr 172.21.15.40:0/2547469069 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:26.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.505+0000 7f670e7fc700 1 -- 172.21.15.40:0/2547469069 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6710139510 msgr2=0x7f671013b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:26.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.505+0000 7f670e7fc700 1 --2- 172.21.15.40:0/2547469069 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6710139510 0x7f671013b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:26.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.505+0000 7f670e7fc700 1 -- 172.21.15.40:0/2547469069 >> v1:172.21.15.40:6789/0 conn(0x7f671009c890 legacy=0x7f671009cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:26.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.505+0000 7f670e7fc700 1 -- 172.21.15.40:0/2547469069 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f671009d370 con 0x7f6710136bf0 2023-09-30T22:28:26.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.505+0000 7f670f7fe700 1 --2- 172.21.15.40:0/2547469069 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6710139510 0x7f671013b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:26.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.505+0000 7f670e7fc700 1 --2- 172.21.15.40:0/2547469069 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6710136bf0 0x7f6710138fd0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f6704009840 tx=0x7f6704009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43ec727ba0ef9678 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:26.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.505+0000 7f670dffb700 1 -- 172.21.15.40:0/2547469069 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6704011830 con 0x7f6710136bf0 2023-09-30T22:28:26.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.505+0000 7f670dffb700 1 -- 172.21.15.40:0/2547469069 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6704011990 con 0x7f6710136bf0 2023-09-30T22:28:26.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.505+0000 7f670dffb700 1 -- 172.21.15.40:0/2547469069 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6704011d20 con 0x7f6710136bf0 2023-09-30T22:28:26.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.505+0000 7f671561b700 1 -- 172.21.15.40:0/2547469069 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6710136bf0 msgr2=0x7f6710138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:26.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.505+0000 7f671561b700 1 --2- 172.21.15.40:0/2547469069 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6710136bf0 0x7f6710138fd0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f6704009840 tx=0x7f6704009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:26.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.505+0000 7f671561b700 1 -- 172.21.15.40:0/2547469069 shutdown_connections 2023-09-30T22:28:26.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.505+0000 7f671561b700 1 --2- 172.21.15.40:0/2547469069 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6710139510 0x7f671013b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:26.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.505+0000 7f671561b700 1 --2- 172.21.15.40:0/2547469069 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6710136bf0 0x7f6710138fd0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:26.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.505+0000 7f671561b700 1 -- 172.21.15.40:0/2547469069 >> 172.21.15.40:0/2547469069 conn(0x7f67100a7080 msgr2=0x7f67100a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:26.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.506+0000 7f671561b700 1 -- 172.21.15.40:0/2547469069 shutdown_connections 2023-09-30T22:28:26.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.506+0000 7f671561b700 1 -- 172.21.15.40:0/2547469069 wait complete. 2023-09-30T22:28:26.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.507+0000 7f671561b700 1 Processor -- start 2023-09-30T22:28:26.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.507+0000 7f671561b700 1 -- start start 2023-09-30T22:28:26.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.507+0000 7f671561b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f671009c890 0x7f671006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:26.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.507+0000 7f671561b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6710136bf0 0x7f671006f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:26.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.507+0000 7f671561b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6710139510 0x7f671006fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:26.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.507+0000 7f671561b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67100717d0 con 0x7f6710136bf0 2023-09-30T22:28:26.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.507+0000 7f671561b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67101390e0 con 0x7f6710139510 2023-09-30T22:28:26.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.507+0000 7f671561b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f671012c1a0 con 0x7f671009c890 2023-09-30T22:28:26.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.507+0000 7f670f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6710139510 0x7f671006fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:26.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.507+0000 7f670effd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f671009c890 0x7f671006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:26.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.507+0000 7f670f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6710139510 0x7f671006fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54186/0 (socket says 172.21.15.40:54186) 2023-09-30T22:28:26.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.507+0000 7f670f7fe700 1 -- 172.21.15.40:0/2951478072 learned_addr learned my addr 172.21.15.40:0/2951478072 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:26.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.507+0000 7f670e7fc700 1 --2- 172.21.15.40:0/2951478072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6710136bf0 0x7f671006f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:26.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.507+0000 7f670effd700 1 -- 172.21.15.40:0/2951478072 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6710139510 msgr2=0x7f671006fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:26.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.507+0000 7f670effd700 1 --2- 172.21.15.40:0/2951478072 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6710139510 0x7f671006fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:26.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.507+0000 7f670effd700 1 -- 172.21.15.40:0/2951478072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6710136bf0 msgr2=0x7f671006f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:26.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.507+0000 7f670effd700 1 --2- 172.21.15.40:0/2951478072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6710136bf0 0x7f671006f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:26.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.507+0000 7f670effd700 1 -- 172.21.15.40:0/2951478072 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6708009b30 con 0x7f671009c890 2023-09-30T22:28:26.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.507+0000 7f670f7fe700 1 --2- 172.21.15.40:0/2951478072 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6710139510 0x7f671006fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:26.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.507+0000 7f670e7fc700 1 --2- 172.21.15.40:0/2951478072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6710136bf0 0x7f671006f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:26.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.508+0000 7f670effd700 1 --2- 172.21.15.40:0/2951478072 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f671009c890 0x7f671006f0b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6700000fd0 tx=0x7f670000c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:26.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.508+0000 7f66f77fe700 1 -- 172.21.15.40:0/2951478072 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67000054e0 con 0x7f671009c890 2023-09-30T22:28:26.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.508+0000 7f66f77fe700 1 -- 172.21.15.40:0/2951478072 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670000ce50 con 0x7f671009c890 2023-09-30T22:28:26.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.508+0000 7f671561b700 1 -- 172.21.15.40:0/2951478072 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67040094a0 con 0x7f671009c890 2023-09-30T22:28:26.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.508+0000 7f66f77fe700 1 -- 172.21.15.40:0/2951478072 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67000038a0 con 0x7f671009c890 2023-09-30T22:28:26.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.508+0000 7f671561b700 1 -- 172.21.15.40:0/2951478072 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6710070b60 con 0x7f671009c890 2023-09-30T22:28:26.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.508+0000 7f66f77fe700 1 -- 172.21.15.40:0/2951478072 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6700003a00 con 0x7f671009c890 2023-09-30T22:28:26.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.509+0000 7f66f77fe700 1 -- 172.21.15.40:0/2951478072 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f670003ea40 con 0x7f671009c890 2023-09-30T22:28:26.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.509+0000 7f671561b700 1 -- 172.21.15.40:0/2951478072 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6710062380 con 0x7f671009c890 2023-09-30T22:28:26.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.514+0000 7f66f77fe700 1 -- 172.21.15.40:0/2951478072 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6700017080 con 0x7f671009c890 2023-09-30T22:28:26.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.712+0000 7f671561b700 1 -- 172.21.15.40:0/2951478072 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f671012bf50 con 0x7f671009c890 2023-09-30T22:28:26.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.713+0000 7f66f77fe700 1 -- 172.21.15.40:0/2951478072 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6700019b40 con 0x7f671009c890 2023-09-30T22:28:26.713 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:26.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.715+0000 7f671561b700 1 -- 172.21.15.40:0/2951478072 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f671009c890 msgr2=0x7f671006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:26.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.715+0000 7f671561b700 1 --2- 172.21.15.40:0/2951478072 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f671009c890 0x7f671006f0b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6700000fd0 tx=0x7f670000c7b0 comp rx=0 tx=0).stop 2023-09-30T22:28:26.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.715+0000 7f671561b700 1 -- 172.21.15.40:0/2951478072 shutdown_connections 2023-09-30T22:28:26.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.715+0000 7f671561b700 1 --2- 172.21.15.40:0/2951478072 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f671009c890 0x7f671006f0b0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:26.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.715+0000 7f671561b700 1 --2- 172.21.15.40:0/2951478072 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6710139510 0x7f671006fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:26.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.715+0000 7f671561b700 1 --2- 172.21.15.40:0/2951478072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6710136bf0 0x7f671006f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:26.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.715+0000 7f671561b700 1 -- 172.21.15.40:0/2951478072 >> 172.21.15.40:0/2951478072 conn(0x7f67100a7080 msgr2=0x7f6710136fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:26.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.715+0000 7f671561b700 1 -- 172.21.15.40:0/2951478072 shutdown_connections 2023-09-30T22:28:26.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:26.715+0000 7f671561b700 1 -- 172.21.15.40:0/2951478072 wait complete. 2023-09-30T22:28:26.727 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:26.906 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:26.950 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:26.990 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:27.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.037+0000 7fc1782bc700 1 Processor -- start 2023-09-30T22:28:27.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.037+0000 7fc1782bc700 1 -- start start 2023-09-30T22:28:27.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.038+0000 7fc1782bc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc17009d920 0x7fc17009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:27.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.038+0000 7fc1782bc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc17009e230 0x7fc1701343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:27.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.038+0000 7fc1782bc700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17009f940 con 0x7fc17009f0f0 2023-09-30T22:28:27.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.038+0000 7fc1782bc700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc17006b4c0 con 0x7fc17009d920 2023-09-30T22:28:27.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.038+0000 7fc1782bc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17009a8f0 con 0x7fc17009e230 2023-09-30T22:28:27.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.038+0000 7fc176859700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc17009e230 0x7fc1701343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:27.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.038+0000 7fc176058700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc17009d920 0x7fc17009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:27.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.038+0000 7fc176859700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc17009e230 0x7fc1701343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54192/0 (socket says 172.21.15.40:54192) 2023-09-30T22:28:27.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.038+0000 7fc176859700 1 -- 172.21.15.40:0/41235760 learned_addr learned my addr 172.21.15.40:0/41235760 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:27.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.038+0000 7fc176058700 1 -- 172.21.15.40:0/41235760 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc17009e230 msgr2=0x7fc1701343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:27.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.038+0000 7fc176058700 1 --2- 172.21.15.40:0/41235760 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc17009e230 0x7fc1701343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.038+0000 7fc176058700 1 -- 172.21.15.40:0/41235760 >> v1:172.21.15.40:6789/0 conn(0x7fc17009f0f0 legacy=0x7fc170133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:27.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.038+0000 7fc176058700 1 -- 172.21.15.40:0/41235760 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17009f6e0 con 0x7fc17009d920 2023-09-30T22:28:27.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.038+0000 7fc176859700 1 --2- 172.21.15.40:0/41235760 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc17009e230 0x7fc1701343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:27.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.038+0000 7fc176058700 1 --2- 172.21.15.40:0/41235760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc17009d920 0x7fc17009dcf0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fc16c009820 tx=0x7fc16c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef1e93a5446825c1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:27.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.039+0000 7fc175056700 1 -- 172.21.15.40:0/41235760 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c005e30 con 0x7fc17009d920 2023-09-30T22:28:27.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.039+0000 7fc175056700 1 -- 172.21.15.40:0/41235760 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16c006030 con 0x7fc17009d920 2023-09-30T22:28:27.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.039+0000 7fc175056700 1 -- 172.21.15.40:0/41235760 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c0063c0 con 0x7fc17009d920 2023-09-30T22:28:27.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.039+0000 7fc1782bc700 1 -- 172.21.15.40:0/41235760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc17009d920 msgr2=0x7fc17009dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:27.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.039+0000 7fc1782bc700 1 --2- 172.21.15.40:0/41235760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc17009d920 0x7fc17009dcf0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fc16c009820 tx=0x7fc16c009b30 comp rx=0 tx=0).stop 2023-09-30T22:28:27.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.039+0000 7fc1782bc700 1 -- 172.21.15.40:0/41235760 shutdown_connections 2023-09-30T22:28:27.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.039+0000 7fc1782bc700 1 --2- 172.21.15.40:0/41235760 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc17009e230 0x7fc1701343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.039+0000 7fc1782bc700 1 --2- 172.21.15.40:0/41235760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc17009d920 0x7fc17009dcf0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.039+0000 7fc1782bc700 1 -- 172.21.15.40:0/41235760 >> 172.21.15.40:0/41235760 conn(0x7fc17009fb20 msgr2=0x7fc17009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:27.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.040+0000 7fc1782bc700 1 -- 172.21.15.40:0/41235760 shutdown_connections 2023-09-30T22:28:27.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.040+0000 7fc1782bc700 1 -- 172.21.15.40:0/41235760 wait complete. 2023-09-30T22:28:27.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.041+0000 7fc1782bc700 1 Processor -- start 2023-09-30T22:28:27.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.041+0000 7fc1782bc700 1 -- start start 2023-09-30T22:28:27.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.041+0000 7fc1782bc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc17009d920 0x7fc1701a6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:27.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.041+0000 7fc1782bc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc17009e230 0x7fc1701a65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:27.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.041+0000 7fc1782bc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1701b9450 0x7fc1701a6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:27.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.041+0000 7fc1782bc700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1701a9b80 con 0x7fc1701b9450 2023-09-30T22:28:27.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.041+0000 7fc1782bc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1701a9310 con 0x7fc17009d920 2023-09-30T22:28:27.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.041+0000 7fc1782bc700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1700a35c0 con 0x7fc17009e230 2023-09-30T22:28:27.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.041+0000 7fc176058700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc17009d920 0x7fc1701a6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:27.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.041+0000 7fc175857700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc17009e230 0x7fc1701a65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:27.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.041+0000 7fc176058700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc17009d920 0x7fc1701a6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54208/0 (socket says 172.21.15.40:54208) 2023-09-30T22:28:27.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.041+0000 7fc176058700 1 -- 172.21.15.40:0/2453033116 learned_addr learned my addr 172.21.15.40:0/2453033116 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:27.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.041+0000 7fc176859700 1 --2- 172.21.15.40:0/2453033116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1701b9450 0x7fc1701a6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:27.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.042+0000 7fc175857700 1 -- 172.21.15.40:0/2453033116 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc17009d920 msgr2=0x7fc1701a6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:27.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.042+0000 7fc175857700 1 --2- 172.21.15.40:0/2453033116 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc17009d920 0x7fc1701a6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.042+0000 7fc175857700 1 -- 172.21.15.40:0/2453033116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1701b9450 msgr2=0x7fc1701a6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:27.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.042+0000 7fc175857700 1 --2- 172.21.15.40:0/2453033116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1701b9450 0x7fc1701a6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.042+0000 7fc175857700 1 -- 172.21.15.40:0/2453033116 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc168009b30 con 0x7fc17009e230 2023-09-30T22:28:27.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.042+0000 7fc176859700 1 --2- 172.21.15.40:0/2453033116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1701b9450 0x7fc1701a6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:27.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.042+0000 7fc175857700 1 --2- 172.21.15.40:0/2453033116 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc17009e230 0x7fc1701a65a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc160000f60 tx=0x7fc16000c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:27.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.042+0000 7fc166ffd700 1 -- 172.21.15.40:0/2453033116 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1600052d0 con 0x7fc17009e230 2023-09-30T22:28:27.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.042+0000 7fc166ffd700 1 -- 172.21.15.40:0/2453033116 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc160005430 con 0x7fc17009e230 2023-09-30T22:28:27.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.042+0000 7fc1782bc700 1 -- 172.21.15.40:0/2453033116 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc16c009430 con 0x7fc17009e230 2023-09-30T22:28:27.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.042+0000 7fc166ffd700 1 -- 172.21.15.40:0/2453033116 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1600038c0 con 0x7fc17009e230 2023-09-30T22:28:27.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.042+0000 7fc1782bc700 1 -- 172.21.15.40:0/2453033116 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1701a7c70 con 0x7fc17009e230 2023-09-30T22:28:27.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.043+0000 7fc166ffd700 1 -- 172.21.15.40:0/2453033116 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc160003a20 con 0x7fc17009e230 2023-09-30T22:28:27.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.043+0000 7fc166ffd700 1 -- 172.21.15.40:0/2453033116 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc16003e9e0 con 0x7fc17009e230 2023-09-30T22:28:27.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.043+0000 7fc1782bc700 1 -- 172.21.15.40:0/2453033116 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1701a9720 con 0x7fc17009e230 2023-09-30T22:28:27.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.048+0000 7fc166ffd700 1 -- 172.21.15.40:0/2453033116 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc160017070 con 0x7fc17009e230 2023-09-30T22:28:27.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.081+0000 7faf5acca700 1 Processor -- start 2023-09-30T22:28:27.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.081+0000 7faf5acca700 1 -- start start 2023-09-30T22:28:27.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.081+0000 7faf5acca700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf5409c890 0x7faf5409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:27.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.081+0000 7faf5acca700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faf5409d920 0x7faf5409dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:27.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.081+0000 7faf5acca700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faf5409e2b0 0x7faf5413ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:27.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.081+0000 7faf5acca700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf540a29d0 con 0x7faf5409d920 2023-09-30T22:28:27.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.081+0000 7faf5acca700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5409fb40 con 0x7faf5409c890 2023-09-30T22:28:27.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.081+0000 7faf5acca700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf540a2600 con 0x7faf5409e2b0 2023-09-30T22:28:27.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.081+0000 7faf53fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faf5409d920 0x7faf5409dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:27.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.082+0000 7faf58a66700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf5409c890 0x7faf5409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:27.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.082+0000 7faf53fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faf5409d920 0x7faf5409dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35840/0 (socket says 172.21.15.40:35840) 2023-09-30T22:28:27.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.082+0000 7faf53fff700 1 -- 172.21.15.40:0/2185889840 learned_addr learned my addr 172.21.15.40:0/2185889840 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:27.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.082+0000 7faf59267700 1 --2- 172.21.15.40:0/2185889840 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faf5409e2b0 0x7faf5413ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:27.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.082+0000 7faf58a66700 1 -- 172.21.15.40:0/2185889840 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faf5409e2b0 msgr2=0x7faf5413ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:27.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.082+0000 7faf58a66700 1 --2- 172.21.15.40:0/2185889840 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faf5409e2b0 0x7faf5413ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.082+0000 7faf58a66700 1 -- 172.21.15.40:0/2185889840 >> v2:172.21.15.40:3300/0 conn(0x7faf5409d920 msgr2=0x7faf5409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:27.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.082+0000 7faf58a66700 1 --2- 172.21.15.40:0/2185889840 >> v2:172.21.15.40:3300/0 conn(0x7faf5409d920 0x7faf5409dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.082+0000 7faf58a66700 1 -- 172.21.15.40:0/2185889840 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5409e750 con 0x7faf5409c890 2023-09-30T22:28:27.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.082+0000 7faf53fff700 1 --2- 172.21.15.40:0/2185889840 >> v2:172.21.15.40:3300/0 conn(0x7faf5409d920 0x7faf5409dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:27.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.082+0000 7faf58a66700 1 --2- 172.21.15.40:0/2185889840 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf5409c890 0x7faf5409cc60 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7faf48009820 tx=0x7faf48009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36501decb279a885 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:27.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.082+0000 7faf537fe700 1 -- 172.21.15.40:0/2185889840 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf48005e30 con 0x7faf5409c890 2023-09-30T22:28:27.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.082+0000 7faf537fe700 1 -- 172.21.15.40:0/2185889840 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf48006030 con 0x7faf5409c890 2023-09-30T22:28:27.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.082+0000 7faf537fe700 1 -- 172.21.15.40:0/2185889840 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf480063c0 con 0x7faf5409c890 2023-09-30T22:28:27.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.083+0000 7faf5acca700 1 -- 172.21.15.40:0/2185889840 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf5409c890 msgr2=0x7faf5409cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:27.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.083+0000 7faf5acca700 1 --2- 172.21.15.40:0/2185889840 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf5409c890 0x7faf5409cc60 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7faf48009820 tx=0x7faf48009b30 comp rx=0 tx=0).stop 2023-09-30T22:28:27.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.083+0000 7faf5acca700 1 -- 172.21.15.40:0/2185889840 shutdown_connections 2023-09-30T22:28:27.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.083+0000 7faf5acca700 1 --2- 172.21.15.40:0/2185889840 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faf5409e2b0 0x7faf5413ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.083+0000 7faf5acca700 1 --2- 172.21.15.40:0/2185889840 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf5409c890 0x7faf5409cc60 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.083+0000 7faf5acca700 1 --2- 172.21.15.40:0/2185889840 >> v2:172.21.15.40:3300/0 conn(0x7faf5409d920 0x7faf5409dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.083+0000 7faf5acca700 1 -- 172.21.15.40:0/2185889840 >> 172.21.15.40:0/2185889840 conn(0x7faf540a7080 msgr2=0x7faf540a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:27.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.083+0000 7faf5acca700 1 -- 172.21.15.40:0/2185889840 shutdown_connections 2023-09-30T22:28:27.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.083+0000 7faf5acca700 1 -- 172.21.15.40:0/2185889840 wait complete. 2023-09-30T22:28:27.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.084+0000 7faf5acca700 1 Processor -- start 2023-09-30T22:28:27.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.084+0000 7faf5acca700 1 -- start start 2023-09-30T22:28:27.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.085+0000 7faf5acca700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf5409c890 0x7faf5412cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:27.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.085+0000 7faf5acca700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faf5409d920 0x7faf5412d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:27.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.085+0000 7faf5acca700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf5409e2b0 0x7faf5412d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:27.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.085+0000 7faf5acca700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf541311d0 con 0x7faf5409c890 2023-09-30T22:28:27.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.085+0000 7faf5acca700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf540a5d40 con 0x7faf5409e2b0 2023-09-30T22:28:27.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.085+0000 7faf5acca700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf5409ecf0 con 0x7faf5409d920 2023-09-30T22:28:27.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.085+0000 7faf58a66700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf5409c890 0x7faf5412cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:27.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.085+0000 7faf58a66700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf5409c890 0x7faf5412cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35848/0 (socket says 172.21.15.40:35848) 2023-09-30T22:28:27.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.085+0000 7faf58a66700 1 -- 172.21.15.40:0/1222419990 learned_addr learned my addr 172.21.15.40:0/1222419990 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:27.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.085+0000 7faf53fff700 1 --2- 172.21.15.40:0/1222419990 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faf5409d920 0x7faf5412d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:27.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.085+0000 7faf59267700 1 --2- 172.21.15.40:0/1222419990 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf5409e2b0 0x7faf5412d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:27.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.085+0000 7faf53fff700 1 -- 172.21.15.40:0/1222419990 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf5409e2b0 msgr2=0x7faf5412d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:27.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.085+0000 7faf53fff700 1 --2- 172.21.15.40:0/1222419990 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf5409e2b0 0x7faf5412d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.085+0000 7faf53fff700 1 -- 172.21.15.40:0/1222419990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf5409c890 msgr2=0x7faf5412cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:27.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.085+0000 7faf53fff700 1 --2- 172.21.15.40:0/1222419990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf5409c890 0x7faf5412cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.085+0000 7faf53fff700 1 -- 172.21.15.40:0/1222419990 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf40009550 con 0x7faf5409d920 2023-09-30T22:28:27.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.085+0000 7faf58a66700 1 --2- 172.21.15.40:0/1222419990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf5409c890 0x7faf5412cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:27.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.085+0000 7faf59267700 1 --2- 172.21.15.40:0/1222419990 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf5409e2b0 0x7faf5412d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:27.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.085+0000 7faf53fff700 1 --2- 172.21.15.40:0/1222419990 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faf5409d920 0x7faf5412d2c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7faf4000e910 tx=0x7faf4000ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:27.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.086+0000 7faf517fa700 1 -- 172.21.15.40:0/1222419990 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf40004240 con 0x7faf5409d920 2023-09-30T22:28:27.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.086+0000 7faf517fa700 1 -- 172.21.15.40:0/1222419990 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf400043a0 con 0x7faf5409d920 2023-09-30T22:28:27.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.086+0000 7faf5acca700 1 -- 172.21.15.40:0/1222419990 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf48009430 con 0x7faf5409d920 2023-09-30T22:28:27.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.086+0000 7faf517fa700 1 -- 172.21.15.40:0/1222419990 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf400036a0 con 0x7faf5409d920 2023-09-30T22:28:27.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.086+0000 7faf5acca700 1 -- 172.21.15.40:0/1222419990 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf54130530 con 0x7faf5409d920 2023-09-30T22:28:27.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.087+0000 7faf5acca700 1 -- 172.21.15.40:0/1222419990 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf54062380 con 0x7faf5409d920 2023-09-30T22:28:27.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.087+0000 7faf517fa700 1 -- 172.21.15.40:0/1222419990 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faf40003800 con 0x7faf5409d920 2023-09-30T22:28:27.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.087+0000 7faf517fa700 1 -- 172.21.15.40:0/1222419990 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7faf4003f860 con 0x7faf5409d920 2023-09-30T22:28:27.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.096+0000 7faf517fa700 1 -- 172.21.15.40:0/1222419990 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faf4001bba0 con 0x7faf5409d920 2023-09-30T22:28:27.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.124+0000 7f6fd8ff9700 1 Processor -- start 2023-09-30T22:28:27.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.124+0000 7f6fd8ff9700 1 -- start start 2023-09-30T22:28:27.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.125+0000 7f6fd8ff9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6fd409fbb0 0x7f6fd406c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:27.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.125+0000 7f6fd8ff9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6fd406d2c0 0x7f6fd413baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:27.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.125+0000 7f6fd8ff9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd40a0590 con 0x7f6fd406ced0 2023-09-30T22:28:27.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.125+0000 7f6fd8ff9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd409ff80 con 0x7f6fd409fbb0 2023-09-30T22:28:27.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.125+0000 7f6fd8ff9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd406da80 con 0x7f6fd406d2c0 2023-09-30T22:28:27.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.125+0000 7f6fd259c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6fd409fbb0 0x7f6fd406c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:27.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.125+0000 7f6fd259c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6fd409fbb0 0x7f6fd406c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35858/0 (socket says 172.21.15.40:35858) 2023-09-30T22:28:27.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.125+0000 7f6fd259c700 1 -- 172.21.15.40:0/467128141 learned_addr learned my addr 172.21.15.40:0/467128141 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:27.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.125+0000 7f6fd1d9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6fd406ced0 0x7f6fd4138370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46392/0 (socket says 172.21.15.40:46392) 2023-09-30T22:28:27.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.125+0000 7f6fd2d9d700 1 --2- 172.21.15.40:0/467128141 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6fd406d2c0 0x7f6fd413baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:27.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.126+0000 7f6fd2d9d700 1 -- 172.21.15.40:0/467128141 >> v2:172.21.15.40:3300/0 conn(0x7f6fd409fbb0 msgr2=0x7f6fd406c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:27.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.126+0000 7f6fd2d9d700 1 --2- 172.21.15.40:0/467128141 >> v2:172.21.15.40:3300/0 conn(0x7f6fd409fbb0 0x7f6fd406c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.126+0000 7f6fd2d9d700 1 -- 172.21.15.40:0/467128141 >> v1:172.21.15.40:6789/0 conn(0x7f6fd406ced0 legacy=0x7f6fd4138370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:27.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.126+0000 7f6fd2d9d700 1 -- 172.21.15.40:0/467128141 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd40a0780 con 0x7f6fd406d2c0 2023-09-30T22:28:27.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.126+0000 7f6fd2d9d700 1 --2- 172.21.15.40:0/467128141 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6fd406d2c0 0x7f6fd413baa0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc009d90 tx=0x7f6fcc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=394ac8b454531fbe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:27.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.126+0000 7f6fd159a700 1 -- 172.21.15.40:0/467128141 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc00e070 con 0x7f6fd406d2c0 2023-09-30T22:28:27.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.126+0000 7f6fd159a700 1 -- 172.21.15.40:0/467128141 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fcc00bb20 con 0x7f6fd406d2c0 2023-09-30T22:28:27.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.126+0000 7f6fd159a700 1 -- 172.21.15.40:0/467128141 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc012430 con 0x7f6fd406d2c0 2023-09-30T22:28:27.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.126+0000 7f6fd8ff9700 1 -- 172.21.15.40:0/467128141 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6fd406d2c0 msgr2=0x7f6fd413baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:27.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.126+0000 7f6fd8ff9700 1 --2- 172.21.15.40:0/467128141 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6fd406d2c0 0x7f6fd413baa0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc009d90 tx=0x7f6fcc00b330 comp rx=0 tx=0).stop 2023-09-30T22:28:27.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.127+0000 7f6fd8ff9700 1 -- 172.21.15.40:0/467128141 shutdown_connections 2023-09-30T22:28:27.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.127+0000 7f6fd8ff9700 1 --2- 172.21.15.40:0/467128141 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6fd406d2c0 0x7f6fd413baa0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.127+0000 7f6fd8ff9700 1 --2- 172.21.15.40:0/467128141 >> v2:172.21.15.40:3300/0 conn(0x7f6fd409fbb0 0x7f6fd406c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.127+0000 7f6fd8ff9700 1 -- 172.21.15.40:0/467128141 >> 172.21.15.40:0/467128141 conn(0x7f6fd40a41a0 msgr2=0x7f6fd40a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:27.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.127+0000 7f6fd8ff9700 1 -- 172.21.15.40:0/467128141 shutdown_connections 2023-09-30T22:28:27.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.127+0000 7f6fd8ff9700 1 -- 172.21.15.40:0/467128141 wait complete. 2023-09-30T22:28:27.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.128+0000 7f6fd8ff9700 1 Processor -- start 2023-09-30T22:28:27.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.128+0000 7f6fd8ff9700 1 -- start start 2023-09-30T22:28:27.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.128+0000 7f6fd8ff9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6fd406ced0 0x7f6fd40906d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:27.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.128+0000 7f6fd8ff9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fd406d2c0 0x7f6fd4090c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:27.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.128+0000 7f6fd8ff9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6fd409fbb0 0x7f6fd4091150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:27.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.128+0000 7f6fd8ff9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd4092250 con 0x7f6fd406d2c0 2023-09-30T22:28:27.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.128+0000 7f6fd8ff9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd4092060 con 0x7f6fd406ced0 2023-09-30T22:28:27.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.128+0000 7f6fd8ff9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd4093f70 con 0x7f6fd409fbb0 2023-09-30T22:28:27.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.128+0000 7f6fd2d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6fd409fbb0 0x7f6fd4091150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:27.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.128+0000 7f6fd1d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fd406d2c0 0x7f6fd4090c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:27.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.128+0000 7f6fd2d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6fd409fbb0 0x7f6fd4091150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55692/0 (socket says 172.21.15.40:55692) 2023-09-30T22:28:27.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.128+0000 7f6fd2d9d700 1 -- 172.21.15.40:0/2094787128 learned_addr learned my addr 172.21.15.40:0/2094787128 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:27.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.129+0000 7f6fd1d9b700 1 -- 172.21.15.40:0/2094787128 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6fd409fbb0 msgr2=0x7f6fd4091150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:27.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.129+0000 7f6fd1d9b700 1 --2- 172.21.15.40:0/2094787128 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6fd409fbb0 0x7f6fd4091150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.129+0000 7f6fd1d9b700 1 -- 172.21.15.40:0/2094787128 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6fd406ced0 msgr2=0x7f6fd40906d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:27.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.129+0000 7f6fd1d9b700 1 --2- 172.21.15.40:0/2094787128 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6fd406ced0 0x7f6fd40906d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.129+0000 7f6fd1d9b700 1 -- 172.21.15.40:0/2094787128 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fcc009a70 con 0x7f6fd406d2c0 2023-09-30T22:28:27.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.129+0000 7f6fd2d9d700 1 --2- 172.21.15.40:0/2094787128 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6fd409fbb0 0x7f6fd4091150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:27.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.129+0000 7f6fd1d9b700 1 --2- 172.21.15.40:0/2094787128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fd406d2c0 0x7f6fd4090c10 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f6fc800c480 tx=0x7f6fc800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:27.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.129+0000 7f6fc2ffd700 1 -- 172.21.15.40:0/2094787128 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8005cb0 con 0x7f6fd406d2c0 2023-09-30T22:28:27.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.129+0000 7f6fc2ffd700 1 -- 172.21.15.40:0/2094787128 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc8005e10 con 0x7f6fd406d2c0 2023-09-30T22:28:27.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.129+0000 7f6fd8ff9700 1 -- 172.21.15.40:0/2094787128 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fd4096e20 con 0x7f6fd406d2c0 2023-09-30T22:28:27.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.129+0000 7f6fd8ff9700 1 -- 172.21.15.40:0/2094787128 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd4093c90 con 0x7f6fd406d2c0 2023-09-30T22:28:27.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.129+0000 7f6fc2ffd700 1 -- 172.21.15.40:0/2094787128 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc80072d0 con 0x7f6fd406d2c0 2023-09-30T22:28:27.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.130+0000 7f6fc2ffd700 1 -- 172.21.15.40:0/2094787128 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6fc8007430 con 0x7f6fd406d2c0 2023-09-30T22:28:27.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.130+0000 7f6fc2ffd700 1 -- 172.21.15.40:0/2094787128 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6fc803ea10 con 0x7f6fd406d2c0 2023-09-30T22:28:27.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.130+0000 7f6fd8ff9700 1 -- 172.21.15.40:0/2094787128 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb80052e0 con 0x7f6fd406d2c0 2023-09-30T22:28:27.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.135+0000 7f6fc2ffd700 1 -- 172.21.15.40:0/2094787128 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6fc8017080 con 0x7f6fd406d2c0 2023-09-30T22:28:27.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.255+0000 7fc1782bc700 1 -- 172.21.15.40:0/2453033116 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc170062380 con 0x7fc17009e230 2023-09-30T22:28:27.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.256+0000 7fc166ffd700 1 -- 172.21.15.40:0/2453033116 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc160011590 con 0x7fc17009e230 2023-09-30T22:28:27.256 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:27.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.258+0000 7fc1782bc700 1 -- 172.21.15.40:0/2453033116 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc17009e230 msgr2=0x7fc1701a65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:27.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.258+0000 7fc1782bc700 1 --2- 172.21.15.40:0/2453033116 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc17009e230 0x7fc1701a65a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc160000f60 tx=0x7fc16000c730 comp rx=0 tx=0).stop 2023-09-30T22:28:27.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.258+0000 7fc1782bc700 1 -- 172.21.15.40:0/2453033116 shutdown_connections 2023-09-30T22:28:27.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.258+0000 7fc1782bc700 1 --2- 172.21.15.40:0/2453033116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1701b9450 0x7fc1701a6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.258+0000 7fc1782bc700 1 --2- 172.21.15.40:0/2453033116 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc17009d920 0x7fc1701a6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.258+0000 7fc1782bc700 1 --2- 172.21.15.40:0/2453033116 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc17009e230 0x7fc1701a65a0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.258+0000 7fc1782bc700 1 -- 172.21.15.40:0/2453033116 >> 172.21.15.40:0/2453033116 conn(0x7fc17009fb20 msgr2=0x7fc1701bb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:27.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.258+0000 7fc1782bc700 1 -- 172.21.15.40:0/2453033116 shutdown_connections 2023-09-30T22:28:27.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.258+0000 7fc1782bc700 1 -- 172.21.15.40:0/2453033116 wait complete. 2023-09-30T22:28:27.271 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:27.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.304+0000 7faf5acca700 1 -- 172.21.15.40:0/1222419990 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faf5412fb50 con 0x7faf5409d920 2023-09-30T22:28:27.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.305+0000 7faf517fa700 1 -- 172.21.15.40:0/1222419990 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faf4001bba0 con 0x7faf5409d920 2023-09-30T22:28:27.306 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:27.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.307+0000 7faf5acca700 1 -- 172.21.15.40:0/1222419990 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faf5409d920 msgr2=0x7faf5412d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:27.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.307+0000 7faf5acca700 1 --2- 172.21.15.40:0/1222419990 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faf5409d920 0x7faf5412d2c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7faf4000e910 tx=0x7faf4000ec20 comp rx=0 tx=0).stop 2023-09-30T22:28:27.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.307+0000 7faf5acca700 1 -- 172.21.15.40:0/1222419990 shutdown_connections 2023-09-30T22:28:27.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.307+0000 7faf5acca700 1 --2- 172.21.15.40:0/1222419990 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf5409e2b0 0x7faf5412d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.307+0000 7faf5acca700 1 --2- 172.21.15.40:0/1222419990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf5409c890 0x7faf5412cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.307+0000 7faf5acca700 1 --2- 172.21.15.40:0/1222419990 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faf5409d920 0x7faf5412d2c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.307+0000 7faf5acca700 1 -- 172.21.15.40:0/1222419990 >> 172.21.15.40:0/1222419990 conn(0x7faf540a7080 msgr2=0x7faf540a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:27.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.307+0000 7faf5acca700 1 -- 172.21.15.40:0/1222419990 shutdown_connections 2023-09-30T22:28:27.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.307+0000 7faf5acca700 1 -- 172.21.15.40:0/1222419990 wait complete. 2023-09-30T22:28:27.320 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:27.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.342+0000 7f6fd8ff9700 1 -- 172.21.15.40:0/2094787128 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6fb8005590 con 0x7f6fd406d2c0 2023-09-30T22:28:27.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.343+0000 7f6fc2ffd700 1 -- 172.21.15.40:0/2094787128 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6fc801b3b0 con 0x7f6fd406d2c0 2023-09-30T22:28:27.343 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:27.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.345+0000 7f6fd8ff9700 1 -- 172.21.15.40:0/2094787128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fd406d2c0 msgr2=0x7f6fd4090c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:27.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.345+0000 7f6fd8ff9700 1 --2- 172.21.15.40:0/2094787128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fd406d2c0 0x7f6fd4090c10 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f6fc800c480 tx=0x7f6fc800c790 comp rx=0 tx=0).stop 2023-09-30T22:28:27.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.345+0000 7f6fd8ff9700 1 -- 172.21.15.40:0/2094787128 shutdown_connections 2023-09-30T22:28:27.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.345+0000 7f6fd8ff9700 1 --2- 172.21.15.40:0/2094787128 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6fd409fbb0 0x7f6fd4091150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.345+0000 7f6fd8ff9700 1 --2- 172.21.15.40:0/2094787128 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6fd406ced0 0x7f6fd40906d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.345+0000 7f6fd8ff9700 1 --2- 172.21.15.40:0/2094787128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fd406d2c0 0x7f6fd4090c10 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.345+0000 7f6fd8ff9700 1 -- 172.21.15.40:0/2094787128 >> 172.21.15.40:0/2094787128 conn(0x7f6fd40a41a0 msgr2=0x7f6fd40a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:27.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.345+0000 7f6fd8ff9700 1 -- 172.21.15.40:0/2094787128 shutdown_connections 2023-09-30T22:28:27.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.345+0000 7f6fd8ff9700 1 -- 172.21.15.40:0/2094787128 wait complete. 2023-09-30T22:28:27.357 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:27.729 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:27.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.856+0000 7f22bff38700 1 Processor -- start 2023-09-30T22:28:27.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.857+0000 7f22bff38700 1 -- start start 2023-09-30T22:28:27.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.857+0000 7f22bff38700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22b812e590 0x7f22b812e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:27.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.857+0000 7f22bff38700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f22b812eea0 0x7f22b812d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:27.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.857+0000 7f22bff38700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22b812d6d0 0x7f22b812db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:27.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.857+0000 7f22bff38700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b809ca30 con 0x7f22b812eea0 2023-09-30T22:28:27.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.857+0000 7f22bff38700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b809ab70 con 0x7f22b812d6d0 2023-09-30T22:28:27.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.857+0000 7f22bff38700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22b809bd70 con 0x7f22b812e590 2023-09-30T22:28:27.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.858+0000 7f22bdcd4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22b812e590 0x7f22b812e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:27.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.858+0000 7f22be4d5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22b812d6d0 0x7f22b812db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:27.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.858+0000 7f22bd4d3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f22b812eea0 0x7f22b812d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:27.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.858+0000 7f22be4d5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22b812d6d0 0x7f22b812db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54242/0 (socket says 172.21.15.40:54242) 2023-09-30T22:28:27.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.858+0000 7f22bdcd4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22b812e590 0x7f22b812e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55704/0 (socket says 172.21.15.40:55704) 2023-09-30T22:28:27.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.858+0000 7f22be4d5700 1 -- 172.21.15.40:0/3255290988 learned_addr learned my addr 172.21.15.40:0/3255290988 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:27.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.858+0000 7f22bdcd4700 1 -- 172.21.15.40:0/3255290988 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22b812d6d0 msgr2=0x7f22b812db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:27.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.858+0000 7f22bdcd4700 1 --2- 172.21.15.40:0/3255290988 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22b812d6d0 0x7f22b812db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.858+0000 7f22bdcd4700 1 -- 172.21.15.40:0/3255290988 >> v2:172.21.15.40:3300/0 conn(0x7f22b812eea0 msgr2=0x7f22b812d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:27.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.858+0000 7f22bdcd4700 1 --2- 172.21.15.40:0/3255290988 >> v2:172.21.15.40:3300/0 conn(0x7f22b812eea0 0x7f22b812d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.858+0000 7f22bdcd4700 1 -- 172.21.15.40:0/3255290988 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b809b270 con 0x7f22b812e590 2023-09-30T22:28:27.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.858+0000 7f22be4d5700 1 --2- 172.21.15.40:0/3255290988 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22b812d6d0 0x7f22b812db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:27.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.858+0000 7f22bd4d3700 1 --2- 172.21.15.40:0/3255290988 >> v2:172.21.15.40:3300/0 conn(0x7f22b812eea0 0x7f22b812d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:27.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.858+0000 7f22bdcd4700 1 --2- 172.21.15.40:0/3255290988 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22b812e590 0x7f22b812e960 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f22b4009840 tx=0x7f22b4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0fc03055e6ae92 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:27.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.858+0000 7f22bccd2700 1 -- 172.21.15.40:0/3255290988 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b4011830 con 0x7f22b812e590 2023-09-30T22:28:27.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.858+0000 7f22bccd2700 1 -- 172.21.15.40:0/3255290988 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b4011990 con 0x7f22b812e590 2023-09-30T22:28:27.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.858+0000 7f22bccd2700 1 -- 172.21.15.40:0/3255290988 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b4011d20 con 0x7f22b812e590 2023-09-30T22:28:27.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.859+0000 7f22bff38700 1 -- 172.21.15.40:0/3255290988 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22b812e590 msgr2=0x7f22b812e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:27.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.859+0000 7f22bff38700 1 --2- 172.21.15.40:0/3255290988 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22b812e590 0x7f22b812e960 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f22b4009840 tx=0x7f22b4009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:27.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.859+0000 7f22bff38700 1 -- 172.21.15.40:0/3255290988 shutdown_connections 2023-09-30T22:28:27.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.859+0000 7f22bff38700 1 --2- 172.21.15.40:0/3255290988 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22b812e590 0x7f22b812e960 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.859+0000 7f22bff38700 1 --2- 172.21.15.40:0/3255290988 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22b812d6d0 0x7f22b812db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.859+0000 7f22bff38700 1 --2- 172.21.15.40:0/3255290988 >> v2:172.21.15.40:3300/0 conn(0x7f22b812eea0 0x7f22b812d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.859+0000 7f22bff38700 1 -- 172.21.15.40:0/3255290988 >> 172.21.15.40:0/3255290988 conn(0x7f22b80a2a00 msgr2=0x7f22b80a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:27.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.859+0000 7f22bff38700 1 -- 172.21.15.40:0/3255290988 shutdown_connections 2023-09-30T22:28:27.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.859+0000 7f22bff38700 1 -- 172.21.15.40:0/3255290988 wait complete. 2023-09-30T22:28:27.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.860+0000 7f22bff38700 1 Processor -- start 2023-09-30T22:28:27.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.860+0000 7f22bff38700 1 -- start start 2023-09-30T22:28:27.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.861+0000 7f22bff38700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22b812d6d0 0x7f22b8119ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:27.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.861+0000 7f22bff38700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22b812e590 0x7f22b811a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:27.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.861+0000 7f22bff38700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22b812eea0 0x7f22b811a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:27.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.861+0000 7f22bff38700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b811af00 con 0x7f22b812eea0 2023-09-30T22:28:27.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.861+0000 7f22bff38700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b811bc20 con 0x7f22b812e590 2023-09-30T22:28:27.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.861+0000 7f22bff38700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22b811cce0 con 0x7f22b812d6d0 2023-09-30T22:28:27.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.861+0000 7f22bd4d3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22b812e590 0x7f22b811a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:27.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.861+0000 7f22bdcd4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22b812d6d0 0x7f22b8119ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:27.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.861+0000 7f22bd4d3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22b812e590 0x7f22b811a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54250/0 (socket says 172.21.15.40:54250) 2023-09-30T22:28:27.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.861+0000 7f22be4d5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22b812eea0 0x7f22b811a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:27.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.861+0000 7f22bdcd4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22b812d6d0 0x7f22b8119ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55714/0 (socket says 172.21.15.40:55714) 2023-09-30T22:28:27.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.861+0000 7f22bd4d3700 1 -- 172.21.15.40:0/498155479 learned_addr learned my addr 172.21.15.40:0/498155479 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:27.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.861+0000 7f22bd4d3700 1 -- 172.21.15.40:0/498155479 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22b812d6d0 msgr2=0x7f22b8119ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:27.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.861+0000 7f22bd4d3700 1 --2- 172.21.15.40:0/498155479 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22b812d6d0 0x7f22b8119ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.861+0000 7f22bd4d3700 1 -- 172.21.15.40:0/498155479 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22b812eea0 msgr2=0x7f22b811a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:27.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.861+0000 7f22bd4d3700 1 --2- 172.21.15.40:0/498155479 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22b812eea0 0x7f22b811a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.861+0000 7f22bd4d3700 1 -- 172.21.15.40:0/498155479 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b0009b30 con 0x7f22b812e590 2023-09-30T22:28:27.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.861+0000 7f22be4d5700 1 --2- 172.21.15.40:0/498155479 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22b812eea0 0x7f22b811a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:27.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.862+0000 7f22bd4d3700 1 --2- 172.21.15.40:0/498155479 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22b812e590 0x7f22b811a000 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f22a8010f00 tx=0x7f22a800e640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:27.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.862+0000 7f22ae7fc700 1 -- 172.21.15.40:0/498155479 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a8011650 con 0x7f22b812e590 2023-09-30T22:28:27.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.862+0000 7f22ae7fc700 1 -- 172.21.15.40:0/498155479 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a80117b0 con 0x7f22b812e590 2023-09-30T22:28:27.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.862+0000 7f22ae7fc700 1 -- 172.21.15.40:0/498155479 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a8011b40 con 0x7f22b812e590 2023-09-30T22:28:27.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.862+0000 7f22bff38700 1 -- 172.21.15.40:0/498155479 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a800b740 con 0x7f22b812e590 2023-09-30T22:28:27.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.862+0000 7f22bff38700 1 -- 172.21.15.40:0/498155479 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b40094a0 con 0x7f22b812e590 2023-09-30T22:28:27.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.862+0000 7f22ae7fc700 1 -- 172.21.15.40:0/498155479 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f22a8011ca0 con 0x7f22b812e590 2023-09-30T22:28:27.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.863+0000 7f22ae7fc700 1 -- 172.21.15.40:0/498155479 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f22a8042370 con 0x7f22b812e590 2023-09-30T22:28:27.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.863+0000 7f22bff38700 1 -- 172.21.15.40:0/498155479 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b806edb0 con 0x7f22b812e590 2023-09-30T22:28:27.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:27.867+0000 7f22ae7fc700 1 -- 172.21.15.40:0/498155479 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f22a8017340 con 0x7f22b812e590 2023-09-30T22:28:28.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.061+0000 7f22bff38700 1 -- 172.21.15.40:0/498155479 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f22b811cf10 con 0x7f22b812e590 2023-09-30T22:28:28.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.061+0000 7f22ae7fc700 1 -- 172.21.15.40:0/498155479 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f22b811cf10 con 0x7f22b812e590 2023-09-30T22:28:28.062 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:28.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.063+0000 7f22bff38700 1 -- 172.21.15.40:0/498155479 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22b812e590 msgr2=0x7f22b811a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:28.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.063+0000 7f22bff38700 1 --2- 172.21.15.40:0/498155479 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22b812e590 0x7f22b811a000 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f22a8010f00 tx=0x7f22a800e640 comp rx=0 tx=0).stop 2023-09-30T22:28:28.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.063+0000 7f22bff38700 1 -- 172.21.15.40:0/498155479 shutdown_connections 2023-09-30T22:28:28.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.063+0000 7f22bff38700 1 --2- 172.21.15.40:0/498155479 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22b812d6d0 0x7f22b8119ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.063+0000 7f22bff38700 1 --2- 172.21.15.40:0/498155479 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22b812eea0 0x7f22b811a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.063+0000 7f22bff38700 1 --2- 172.21.15.40:0/498155479 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22b812e590 0x7f22b811a000 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.063+0000 7f22bff38700 1 -- 172.21.15.40:0/498155479 >> 172.21.15.40:0/498155479 conn(0x7f22b80a2a00 msgr2=0x7f22b812c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:28.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.063+0000 7f22bff38700 1 -- 172.21.15.40:0/498155479 shutdown_connections 2023-09-30T22:28:28.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.063+0000 7f22bff38700 1 -- 172.21.15.40:0/498155479 wait complete. 2023-09-30T22:28:28.076 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:28.272 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:28.321 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:28.358 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:28.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.405+0000 7fae0ec62700 1 Processor -- start 2023-09-30T22:28:28.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.405+0000 7fae0ec62700 1 -- start start 2023-09-30T22:28:28.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.406+0000 7fae0ec62700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae0806f070 0x7fae0806f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.406+0000 7fae0ec62700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fae0806f980 0x7fae08097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.406+0000 7fae0ec62700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae0806fdb0 0x7fae080975d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.406+0000 7fae0ec62700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae08070830 con 0x7fae0806f980 2023-09-30T22:28:28.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.406+0000 7fae0ec62700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae08070ad0 con 0x7fae0806fdb0 2023-09-30T22:28:28.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.406+0000 7fae0ec62700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae08070de0 con 0x7fae0806f070 2023-09-30T22:28:28.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.406+0000 7fae0c9fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae0806f070 0x7fae0806f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.406+0000 7fae0c9fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae0806f070 0x7fae0806f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55728/0 (socket says 172.21.15.40:55728) 2023-09-30T22:28:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.406+0000 7fae0c9fe700 1 -- 172.21.15.40:0/3726875069 learned_addr learned my addr 172.21.15.40:0/3726875069 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.406+0000 7fae0d1ff700 1 --2- 172.21.15.40:0/3726875069 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae0806fdb0 0x7fae080975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.406+0000 7fae07fff700 1 --2- 172.21.15.40:0/3726875069 >> v2:172.21.15.40:3300/0 conn(0x7fae0806f980 0x7fae08097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.407+0000 7fae0d1ff700 1 -- 172.21.15.40:0/3726875069 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae0806f070 msgr2=0x7fae0806f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.407+0000 7fae0d1ff700 1 --2- 172.21.15.40:0/3726875069 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae0806f070 0x7fae0806f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.407+0000 7fae0d1ff700 1 -- 172.21.15.40:0/3726875069 >> v2:172.21.15.40:3300/0 conn(0x7fae0806f980 msgr2=0x7fae08097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.407+0000 7fae0d1ff700 1 --2- 172.21.15.40:0/3726875069 >> v2:172.21.15.40:3300/0 conn(0x7fae0806f980 0x7fae08097090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.407+0000 7fae0d1ff700 1 -- 172.21.15.40:0/3726875069 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0809fe20 con 0x7fae0806fdb0 2023-09-30T22:28:28.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.407+0000 7fae0d1ff700 1 --2- 172.21.15.40:0/3726875069 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae0806fdb0 0x7fae080975d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fae00009d90 tx=0x7fae0000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=739a517d6250859a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:28.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.407+0000 7fae077fe700 1 -- 172.21.15.40:0/3726875069 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0000e070 con 0x7fae0806fdb0 2023-09-30T22:28:28.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.407+0000 7fae077fe700 1 -- 172.21.15.40:0/3726875069 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0000bb20 con 0x7fae0806fdb0 2023-09-30T22:28:28.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.407+0000 7fae077fe700 1 -- 172.21.15.40:0/3726875069 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae00012430 con 0x7fae0806fdb0 2023-09-30T22:28:28.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.408+0000 7fae0ec62700 1 -- 172.21.15.40:0/3726875069 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae0806fdb0 msgr2=0x7fae080975d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:28.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.408+0000 7fae0ec62700 1 --2- 172.21.15.40:0/3726875069 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae0806fdb0 0x7fae080975d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fae00009d90 tx=0x7fae0000b330 comp rx=0 tx=0).stop 2023-09-30T22:28:28.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.408+0000 7fae0ec62700 1 -- 172.21.15.40:0/3726875069 shutdown_connections 2023-09-30T22:28:28.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.408+0000 7fae0ec62700 1 --2- 172.21.15.40:0/3726875069 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae0806f070 0x7fae0806f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.408+0000 7fae0ec62700 1 --2- 172.21.15.40:0/3726875069 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae0806fdb0 0x7fae080975d0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.408+0000 7fae0ec62700 1 --2- 172.21.15.40:0/3726875069 >> v2:172.21.15.40:3300/0 conn(0x7fae0806f980 0x7fae08097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.408+0000 7fae0ec62700 1 -- 172.21.15.40:0/3726875069 >> 172.21.15.40:0/3726875069 conn(0x7fae080a41a0 msgr2=0x7fae080a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:28.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.408+0000 7fae0ec62700 1 -- 172.21.15.40:0/3726875069 shutdown_connections 2023-09-30T22:28:28.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.408+0000 7fae0ec62700 1 -- 172.21.15.40:0/3726875069 wait complete. 2023-09-30T22:28:28.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.409+0000 7fae0ec62700 1 Processor -- start 2023-09-30T22:28:28.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.409+0000 7fae0ec62700 1 -- start start 2023-09-30T22:28:28.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.410+0000 7fae0ec62700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae0806f070 0x7fae0806c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.410+0000 7fae0ec62700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae0806f980 0x7fae0806ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.410+0000 7fae0ec62700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae0806fdb0 0x7fae0806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.410+0000 7fae0ec62700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0812c2d0 con 0x7fae0806f070 2023-09-30T22:28:28.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.410+0000 7fae0ec62700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae0808bc40 con 0x7fae0806f980 2023-09-30T22:28:28.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.410+0000 7fae0ec62700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae0808b0e0 con 0x7fae0806fdb0 2023-09-30T22:28:28.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.410+0000 7fae07fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae0806f980 0x7fae0806ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:28.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.410+0000 7fae0d1ff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae0806fdb0 0x7fae0806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:28.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.410+0000 7fae07fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae0806f980 0x7fae0806ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54280/0 (socket says 172.21.15.40:54280) 2023-09-30T22:28:28.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.410+0000 7fae07fff700 1 -- 172.21.15.40:0/4253570580 learned_addr learned my addr 172.21.15.40:0/4253570580 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:28.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.410+0000 7fae0c9fe700 1 --2- 172.21.15.40:0/4253570580 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae0806f070 0x7fae0806c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:28.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.410+0000 7fae0d1ff700 1 -- 172.21.15.40:0/4253570580 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae0806f980 msgr2=0x7fae0806ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:28.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.410+0000 7fae0d1ff700 1 --2- 172.21.15.40:0/4253570580 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae0806f980 0x7fae0806ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.410+0000 7fae0d1ff700 1 -- 172.21.15.40:0/4253570580 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae0806f070 msgr2=0x7fae0806c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:28.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.411+0000 7fae0d1ff700 1 --2- 172.21.15.40:0/4253570580 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae0806f070 0x7fae0806c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.411+0000 7fae0d1ff700 1 -- 172.21.15.40:0/4253570580 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae00009a70 con 0x7fae0806fdb0 2023-09-30T22:28:28.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.411+0000 7fae0d1ff700 1 --2- 172.21.15.40:0/4253570580 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae0806fdb0 0x7fae0806d410 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fae00016000 tx=0x7fae00004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:28.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.411+0000 7fae057fa700 1 -- 172.21.15.40:0/4253570580 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae00012430 con 0x7fae0806fdb0 2023-09-30T22:28:28.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.411+0000 7fae057fa700 1 -- 172.21.15.40:0/4253570580 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae00020070 con 0x7fae0806fdb0 2023-09-30T22:28:28.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.411+0000 7fae0ec62700 1 -- 172.21.15.40:0/4253570580 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae0806e470 con 0x7fae0806fdb0 2023-09-30T22:28:28.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.411+0000 7fae057fa700 1 -- 172.21.15.40:0/4253570580 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae00012e40 con 0x7fae0806fdb0 2023-09-30T22:28:28.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.411+0000 7fae0ec62700 1 -- 172.21.15.40:0/4253570580 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae08131a00 con 0x7fae0806fdb0 2023-09-30T22:28:28.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.412+0000 7fae057fa700 1 -- 172.21.15.40:0/4253570580 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fae00004040 con 0x7fae0806fdb0 2023-09-30T22:28:28.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.412+0000 7fae0ec62700 1 -- 172.21.15.40:0/4253570580 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae08062380 con 0x7fae0806fdb0 2023-09-30T22:28:28.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.412+0000 7fae057fa700 1 -- 172.21.15.40:0/4253570580 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fae00022070 con 0x7fae0806fdb0 2023-09-30T22:28:28.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.417+0000 7fae057fa700 1 -- 172.21.15.40:0/4253570580 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fae00003e30 con 0x7fae0806fdb0 2023-09-30T22:28:28.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.453+0000 7f0ace68e700 1 Processor -- start 2023-09-30T22:28:28.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.453+0000 7f0ace68e700 1 -- start start 2023-09-30T22:28:28.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.453+0000 7f0ace68e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ac806fb50 0x7f0ac8136c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.453+0000 7f0ace68e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac81371b0 0x7f0ac8139590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.453+0000 7f0ace68e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac8070830 con 0x7f0ac806f070 2023-09-30T22:28:28.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.453+0000 7f0ace68e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac8070ad0 con 0x7f0ac81371b0 2023-09-30T22:28:28.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.453+0000 7f0ace68e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac8070de0 con 0x7f0ac806fb50 2023-09-30T22:28:28.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.454+0000 7f0ac7fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f0ac806f070 0x7f0ac806f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46394/0 (socket says 172.21.15.40:46394) 2023-09-30T22:28:28.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.454+0000 7f0ac7fff700 1 -- 172.21.15.40:0/387508126 learned_addr learned my addr 172.21.15.40:0/387508126 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:28.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.454+0000 7f0accc2b700 1 --2- 172.21.15.40:0/387508126 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac81371b0 0x7f0ac8139590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:28.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.454+0000 7f0ac77fe700 1 --2- 172.21.15.40:0/387508126 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ac806fb50 0x7f0ac8136c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:28.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.454+0000 7f0ac6ffd700 1 -- 172.21.15.40:0/387508126 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3582703569 0 0) 0x7f0ac8070830 con 0x7f0ac806f070 2023-09-30T22:28:28.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.454+0000 7f0ac6ffd700 1 -- 172.21.15.40:0/387508126 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ab00035b0 con 0x7f0ac806f070 2023-09-30T22:28:28.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.454+0000 7f0ac77fe700 1 -- 172.21.15.40:0/387508126 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac81371b0 msgr2=0x7f0ac8139590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:28.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.454+0000 7f0ac77fe700 1 --2- 172.21.15.40:0/387508126 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac81371b0 0x7f0ac8139590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.454+0000 7f0ac77fe700 1 -- 172.21.15.40:0/387508126 >> v1:172.21.15.40:6789/0 conn(0x7f0ac806f070 legacy=0x7f0ac806f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:28.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.454+0000 7f0ac77fe700 1 -- 172.21.15.40:0/387508126 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac809fe20 con 0x7f0ac806fb50 2023-09-30T22:28:28.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.454+0000 7f0accc2b700 1 --2- 172.21.15.40:0/387508126 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac81371b0 0x7f0ac8139590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:28.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.454+0000 7f0ac77fe700 1 --2- 172.21.15.40:0/387508126 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ac806fb50 0x7f0ac8136c70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f0abc009870 tx=0x7f0abc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98ab8775e7e8f241 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:28.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.454+0000 7f0ac6ffd700 1 -- 172.21.15.40:0/387508126 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc011830 con 0x7f0ac806fb50 2023-09-30T22:28:28.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.454+0000 7f0ac6ffd700 1 -- 172.21.15.40:0/387508126 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0abc011990 con 0x7f0ac806fb50 2023-09-30T22:28:28.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.454+0000 7f0ac6ffd700 1 -- 172.21.15.40:0/387508126 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc011d20 con 0x7f0ac806fb50 2023-09-30T22:28:28.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.455+0000 7f0ace68e700 1 -- 172.21.15.40:0/387508126 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ac806fb50 msgr2=0x7f0ac8136c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:28.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.455+0000 7f0ace68e700 1 --2- 172.21.15.40:0/387508126 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ac806fb50 0x7f0ac8136c70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f0abc009870 tx=0x7f0abc009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:28.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.455+0000 7f0ace68e700 1 -- 172.21.15.40:0/387508126 shutdown_connections 2023-09-30T22:28:28.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.455+0000 7f0ace68e700 1 --2- 172.21.15.40:0/387508126 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac81371b0 0x7f0ac8139590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.455+0000 7f0ace68e700 1 --2- 172.21.15.40:0/387508126 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ac806fb50 0x7f0ac8136c70 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.455+0000 7f0ace68e700 1 -- 172.21.15.40:0/387508126 >> 172.21.15.40:0/387508126 conn(0x7f0ac80a41a0 msgr2=0x7f0ac80a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:28.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.455+0000 7f0ace68e700 1 -- 172.21.15.40:0/387508126 shutdown_connections 2023-09-30T22:28:28.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.455+0000 7f0ace68e700 1 -- 172.21.15.40:0/387508126 wait complete. 2023-09-30T22:28:28.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.456+0000 7f0ace68e700 1 Processor -- start 2023-09-30T22:28:28.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.456+0000 7f0ace68e700 1 -- start start 2023-09-30T22:28:28.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.457+0000 7f0ace68e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ac806f070 0x7f0ac81c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.457+0000 7f0ace68e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ac806fb50 0x7f0ac81c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.457+0000 7f0ace68e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac81371b0 0x7f0ac81309a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.457+0000 7f0ace68e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac812c3d0 con 0x7f0ac806fb50 2023-09-30T22:28:28.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.457+0000 7f0ace68e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac808afd0 con 0x7f0ac81371b0 2023-09-30T22:28:28.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.457+0000 7f0ace68e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac806cba0 con 0x7f0ac806f070 2023-09-30T22:28:28.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.457+0000 7f0ac7fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ac806f070 0x7f0ac81c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:28.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.457+0000 7f0accc2b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac81371b0 0x7f0ac81309a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:28.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.457+0000 7f0ac77fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ac806fb50 0x7f0ac81c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:28.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.457+0000 7f0ac7fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ac806f070 0x7f0ac81c8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55766/0 (socket says 172.21.15.40:55766) 2023-09-30T22:28:28.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.457+0000 7f0ac7fff700 1 -- 172.21.15.40:0/1907422658 learned_addr learned my addr 172.21.15.40:0/1907422658 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:28.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.457+0000 7f0ac77fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ac806fb50 0x7f0ac81c8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35912/0 (socket says 172.21.15.40:35912) 2023-09-30T22:28:28.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.457+0000 7f0accc2b700 1 -- 172.21.15.40:0/1907422658 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ac806f070 msgr2=0x7f0ac81c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:28.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.457+0000 7f0accc2b700 1 --2- 172.21.15.40:0/1907422658 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ac806f070 0x7f0ac81c8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.457+0000 7f0accc2b700 1 -- 172.21.15.40:0/1907422658 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ac806fb50 msgr2=0x7f0ac81c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:28.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.457+0000 7f0accc2b700 1 --2- 172.21.15.40:0/1907422658 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ac806fb50 0x7f0ac81c8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.457+0000 7f0accc2b700 1 -- 172.21.15.40:0/1907422658 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac0009a70 con 0x7f0ac81371b0 2023-09-30T22:28:28.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.457+0000 7f0accc2b700 1 --2- 172.21.15.40:0/1907422658 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac81371b0 0x7f0ac81309a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0ac000ef90 tx=0x7f0ac000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:28.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.458+0000 7f0ac4ff9700 1 -- 172.21.15.40:0/1907422658 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac000ca90 con 0x7f0ac81371b0 2023-09-30T22:28:28.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.458+0000 7f0ac4ff9700 1 -- 172.21.15.40:0/1907422658 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac000f040 con 0x7f0ac81371b0 2023-09-30T22:28:28.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.458+0000 7f0ace68e700 1 -- 172.21.15.40:0/1907422658 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0abc0094a0 con 0x7f0ac81371b0 2023-09-30T22:28:28.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.458+0000 7f0ac4ff9700 1 -- 172.21.15.40:0/1907422658 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac000ce30 con 0x7f0ac81371b0 2023-09-30T22:28:28.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.458+0000 7f0ace68e700 1 -- 172.21.15.40:0/1907422658 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac8136df0 con 0x7f0ac81371b0 2023-09-30T22:28:28.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.458+0000 7f0ac4ff9700 1 -- 172.21.15.40:0/1907422658 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0ac0014480 con 0x7f0ac81371b0 2023-09-30T22:28:28.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.458+0000 7f0ac4ff9700 1 -- 172.21.15.40:0/1907422658 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f0ac003fd50 con 0x7f0ac81371b0 2023-09-30T22:28:28.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.459+0000 7f0ace68e700 1 -- 172.21.15.40:0/1907422658 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac806e490 con 0x7f0ac81371b0 2023-09-30T22:28:28.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.463+0000 7f0ac4ff9700 1 -- 172.21.15.40:0/1907422658 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0ac806e490 con 0x7f0ac81371b0 2023-09-30T22:28:28.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.497+0000 7f528d7e1700 1 Processor -- start 2023-09-30T22:28:28.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.497+0000 7f528d7e1700 1 -- start start 2023-09-30T22:28:28.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.498+0000 7f528d7e1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f528809fbb0 0x7f528806c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.498+0000 7f528d7e1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f528806ced0 0x7f528806d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.498+0000 7f528d7e1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f528806e3f0 con 0x7f5288138370 2023-09-30T22:28:28.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.498+0000 7f528d7e1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f528809ff80 con 0x7f528809fbb0 2023-09-30T22:28:28.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.498+0000 7f528d7e1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f528806ec40 con 0x7f528806ced0 2023-09-30T22:28:28.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.498+0000 7f52867fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f528806ced0 0x7f528806d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:28.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.498+0000 7f5286ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f528809fbb0 0x7f528806c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:28.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.498+0000 7f52867fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f528806ced0 0x7f528806d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54310/0 (socket says 172.21.15.40:54310) 2023-09-30T22:28:28.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.498+0000 7f52867fc700 1 -- 172.21.15.40:0/446661524 learned_addr learned my addr 172.21.15.40:0/446661524 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:28.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.498+0000 7f52867fc700 1 -- 172.21.15.40:0/446661524 >> v2:172.21.15.40:3300/0 conn(0x7f528809fbb0 msgr2=0x7f528806c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:28.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.498+0000 7f52867fc700 1 --2- 172.21.15.40:0/446661524 >> v2:172.21.15.40:3300/0 conn(0x7f528809fbb0 0x7f528806c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.498+0000 7f52867fc700 1 -- 172.21.15.40:0/446661524 >> v1:172.21.15.40:6789/0 conn(0x7f5288138370 legacy=0x7f528813a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:28.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.498+0000 7f52867fc700 1 -- 172.21.15.40:0/446661524 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5288097ed0 con 0x7f528806ced0 2023-09-30T22:28:28.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.498+0000 7f5286ffd700 1 --2- 172.21.15.40:0/446661524 >> v2:172.21.15.40:3300/0 conn(0x7f528809fbb0 0x7f528806c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:28.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.499+0000 7f52867fc700 1 --2- 172.21.15.40:0/446661524 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f528806ced0 0x7f528806d2e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f527c0098f0 tx=0x7f527c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2a9f5ec9dfce6e9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:28.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.499+0000 7f5285ffb700 1 -- 172.21.15.40:0/446661524 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527c011830 con 0x7f528806ced0 2023-09-30T22:28:28.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.499+0000 7f5285ffb700 1 -- 172.21.15.40:0/446661524 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527c011990 con 0x7f528806ced0 2023-09-30T22:28:28.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.499+0000 7f5285ffb700 1 -- 172.21.15.40:0/446661524 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527c011d20 con 0x7f528806ced0 2023-09-30T22:28:28.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.499+0000 7f528d7e1700 1 -- 172.21.15.40:0/446661524 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f528806ced0 msgr2=0x7f528806d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:28.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.499+0000 7f528d7e1700 1 --2- 172.21.15.40:0/446661524 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f528806ced0 0x7f528806d2e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f527c0098f0 tx=0x7f527c009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:28.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.499+0000 7f528d7e1700 1 -- 172.21.15.40:0/446661524 shutdown_connections 2023-09-30T22:28:28.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.499+0000 7f528d7e1700 1 --2- 172.21.15.40:0/446661524 >> v2:172.21.15.40:3300/0 conn(0x7f528809fbb0 0x7f528806c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.499+0000 7f528d7e1700 1 --2- 172.21.15.40:0/446661524 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f528806ced0 0x7f528806d2e0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.499+0000 7f528d7e1700 1 -- 172.21.15.40:0/446661524 >> 172.21.15.40:0/446661524 conn(0x7f52880a41a0 msgr2=0x7f52880a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:28.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.499+0000 7f528d7e1700 1 -- 172.21.15.40:0/446661524 shutdown_connections 2023-09-30T22:28:28.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.499+0000 7f528d7e1700 1 -- 172.21.15.40:0/446661524 wait complete. 2023-09-30T22:28:28.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.500+0000 7f528d7e1700 1 Processor -- start 2023-09-30T22:28:28.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.500+0000 7f528d7e1700 1 -- start start 2023-09-30T22:28:28.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.501+0000 7f528d7e1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f528806ced0 0x7f52881377c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.501+0000 7f528d7e1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f528809fbb0 0x7f5288137d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.501+0000 7f528d7e1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5288138370 0x7f5288095b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.501+0000 7f528d7e1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52880972c0 con 0x7f528806ced0 2023-09-30T22:28:28.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.501+0000 7f528d7e1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f528809f460 con 0x7f5288138370 2023-09-30T22:28:28.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.501+0000 7f528d7e1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5288096cb0 con 0x7f528809fbb0 2023-09-30T22:28:28.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.501+0000 7f52877fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5288138370 0x7f5288095b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:28.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.501+0000 7f52877fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5288138370 0x7f5288095b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54326/0 (socket says 172.21.15.40:54326) 2023-09-30T22:28:28.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.501+0000 7f52867fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f528809fbb0 0x7f5288137d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:28.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.501+0000 7f5286ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f528806ced0 0x7f52881377c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:28.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.501+0000 7f52877fe700 1 -- 172.21.15.40:0/4147382303 learned_addr learned my addr 172.21.15.40:0/4147382303 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:28.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.501+0000 7f5286ffd700 1 -- 172.21.15.40:0/4147382303 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f528809fbb0 msgr2=0x7f5288137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:28.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.501+0000 7f5286ffd700 1 --2- 172.21.15.40:0/4147382303 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f528809fbb0 0x7f5288137d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.501+0000 7f5286ffd700 1 -- 172.21.15.40:0/4147382303 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5288138370 msgr2=0x7f5288095b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:28.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.501+0000 7f5286ffd700 1 --2- 172.21.15.40:0/4147382303 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5288138370 0x7f5288095b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.501+0000 7f5286ffd700 1 -- 172.21.15.40:0/4147382303 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52780094a0 con 0x7f528806ced0 2023-09-30T22:28:28.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.501+0000 7f52877fe700 1 --2- 172.21.15.40:0/4147382303 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5288138370 0x7f5288095b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:28.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.501+0000 7f52867fc700 1 --2- 172.21.15.40:0/4147382303 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f528809fbb0 0x7f5288137d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:28.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.502+0000 7f5286ffd700 1 --2- 172.21.15.40:0/4147382303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f528806ced0 0x7f52881377c0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f527800e9b0 tx=0x7f527800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:28.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.502+0000 7f526f7fe700 1 -- 172.21.15.40:0/4147382303 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527800ee50 con 0x7f528806ced0 2023-09-30T22:28:28.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.502+0000 7f526f7fe700 1 -- 172.21.15.40:0/4147382303 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527800c850 con 0x7f528806ced0 2023-09-30T22:28:28.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.502+0000 7f528d7e1700 1 -- 172.21.15.40:0/4147382303 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f527c009550 con 0x7f528806ced0 2023-09-30T22:28:28.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.502+0000 7f526f7fe700 1 -- 172.21.15.40:0/4147382303 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527800cc00 con 0x7f528806ced0 2023-09-30T22:28:28.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.502+0000 7f528d7e1700 1 -- 172.21.15.40:0/4147382303 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5288094f40 con 0x7f528806ced0 2023-09-30T22:28:28.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.503+0000 7f526f7fe700 1 -- 172.21.15.40:0/4147382303 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5278013470 con 0x7f528806ced0 2023-09-30T22:28:28.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.503+0000 7f526f7fe700 1 -- 172.21.15.40:0/4147382303 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f527803fab0 con 0x7f528806ced0 2023-09-30T22:28:28.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.504+0000 7f528d7e1700 1 -- 172.21.15.40:0/4147382303 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5288062380 con 0x7f528806ced0 2023-09-30T22:28:28.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.508+0000 7f526f7fe700 1 -- 172.21.15.40:0/4147382303 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5278013720 con 0x7f528806ced0 2023-09-30T22:28:28.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.621+0000 7fae0ec62700 1 -- 172.21.15.40:0/4253570580 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fae08074620 con 0x7fae0806fdb0 2023-09-30T22:28:28.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.622+0000 7fae057fa700 1 -- 172.21.15.40:0/4253570580 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fae0002f390 con 0x7fae0806fdb0 2023-09-30T22:28:28.622 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:28.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.624+0000 7fae0ec62700 1 -- 172.21.15.40:0/4253570580 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae0806fdb0 msgr2=0x7fae0806d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:28.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.624+0000 7fae0ec62700 1 --2- 172.21.15.40:0/4253570580 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae0806fdb0 0x7fae0806d410 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fae00016000 tx=0x7fae00004ad0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.625+0000 7fae0ec62700 1 -- 172.21.15.40:0/4253570580 shutdown_connections 2023-09-30T22:28:28.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.625+0000 7fae0ec62700 1 --2- 172.21.15.40:0/4253570580 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae0806fdb0 0x7fae0806d410 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.625+0000 7fae0ec62700 1 --2- 172.21.15.40:0/4253570580 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae0806f070 0x7fae0806c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.625+0000 7fae0ec62700 1 --2- 172.21.15.40:0/4253570580 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae0806f980 0x7fae0806ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.625+0000 7fae0ec62700 1 -- 172.21.15.40:0/4253570580 >> 172.21.15.40:0/4253570580 conn(0x7fae080a41a0 msgr2=0x7fae08097330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:28.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.625+0000 7fae0ec62700 1 -- 172.21.15.40:0/4253570580 shutdown_connections 2023-09-30T22:28:28.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.625+0000 7fae0ec62700 1 -- 172.21.15.40:0/4253570580 wait complete. 2023-09-30T22:28:28.642 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:28.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.678+0000 7f0ace68e700 1 -- 172.21.15.40:0/1907422658 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0ac806e490 con 0x7f0ac81371b0 2023-09-30T22:28:28.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.679+0000 7f0ac4ff9700 1 -- 172.21.15.40:0/1907422658 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0ac806e490 con 0x7f0ac81371b0 2023-09-30T22:28:28.679 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:28.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.681+0000 7f0ace68e700 1 -- 172.21.15.40:0/1907422658 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac81371b0 msgr2=0x7f0ac81309a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:28.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.681+0000 7f0ace68e700 1 --2- 172.21.15.40:0/1907422658 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac81371b0 0x7f0ac81309a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0ac000ef90 tx=0x7f0ac000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.681+0000 7f0ace68e700 1 -- 172.21.15.40:0/1907422658 shutdown_connections 2023-09-30T22:28:28.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.681+0000 7f0ace68e700 1 --2- 172.21.15.40:0/1907422658 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ac806f070 0x7f0ac81c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.681+0000 7f0ace68e700 1 --2- 172.21.15.40:0/1907422658 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac81371b0 0x7f0ac81309a0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.681+0000 7f0ace68e700 1 --2- 172.21.15.40:0/1907422658 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ac806fb50 0x7f0ac81c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.681+0000 7f0ace68e700 1 -- 172.21.15.40:0/1907422658 >> 172.21.15.40:0/1907422658 conn(0x7f0ac80a41a0 msgr2=0x7f0ac80a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:28.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.681+0000 7f0ace68e700 1 -- 172.21.15.40:0/1907422658 shutdown_connections 2023-09-30T22:28:28.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.681+0000 7f0ace68e700 1 -- 172.21.15.40:0/1907422658 wait complete. 2023-09-30T22:28:28.694 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:28.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.713+0000 7f528d7e1700 1 -- 172.21.15.40:0/4147382303 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f52880a04e0 con 0x7f528806ced0 2023-09-30T22:28:28.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.713+0000 7f526f7fe700 1 -- 172.21.15.40:0/4147382303 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f527802b090 con 0x7f528806ced0 2023-09-30T22:28:28.714 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:28.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.715+0000 7f528d7e1700 1 -- 172.21.15.40:0/4147382303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f528806ced0 msgr2=0x7f52881377c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:28.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.715+0000 7f528d7e1700 1 --2- 172.21.15.40:0/4147382303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f528806ced0 0x7f52881377c0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f527800e9b0 tx=0x7f527800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.715+0000 7f528d7e1700 1 -- 172.21.15.40:0/4147382303 shutdown_connections 2023-09-30T22:28:28.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.715+0000 7f528d7e1700 1 --2- 172.21.15.40:0/4147382303 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5288138370 0x7f5288095b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.715+0000 7f528d7e1700 1 --2- 172.21.15.40:0/4147382303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f528806ced0 0x7f52881377c0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.715+0000 7f528d7e1700 1 --2- 172.21.15.40:0/4147382303 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f528809fbb0 0x7f5288137d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.715+0000 7f528d7e1700 1 -- 172.21.15.40:0/4147382303 >> 172.21.15.40:0/4147382303 conn(0x7f52880a41a0 msgr2=0x7f52880a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:28.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.715+0000 7f528d7e1700 1 -- 172.21.15.40:0/4147382303 shutdown_connections 2023-09-30T22:28:28.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:28.715+0000 7f528d7e1700 1 -- 172.21.15.40:0/4147382303 wait complete. 2023-09-30T22:28:28.728 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:29.077 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:29.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.207+0000 7fece7718700 1 Processor -- start 2023-09-30T22:28:29.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.207+0000 7fece7718700 1 -- start start 2023-09-30T22:28:29.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.208+0000 7fece7718700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fece009d920 0x7fece009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.208+0000 7fece7718700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fece009f0f0 0x7fece009e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.208+0000 7fece7718700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fece009f940 con 0x7fece0133ca0 2023-09-30T22:28:29.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.208+0000 7fece7718700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece006b4c0 con 0x7fece009f0f0 2023-09-30T22:28:29.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.208+0000 7fece7718700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fece009a8f0 con 0x7fece009d920 2023-09-30T22:28:29.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.208+0000 7fece54b4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fece009d920 0x7fece009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.208+0000 7fece4cb3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fece009f0f0 0x7fece009e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.208+0000 7fece5cb5700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fece0133ca0 0x7fece0134140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46414/0 (socket says 172.21.15.40:46414) 2023-09-30T22:28:29.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.208+0000 7fece5cb5700 1 -- 172.21.15.40:0/2760391892 learned_addr learned my addr 172.21.15.40:0/2760391892 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:29.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.208+0000 7fece54b4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fece009d920 0x7fece009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55788/0 (socket says 172.21.15.40:55788) 2023-09-30T22:28:29.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.208+0000 7fecd7fff700 1 -- 172.21.15.40:0/2760391892 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987158075 0 0) 0x7fece009f940 con 0x7fece0133ca0 2023-09-30T22:28:29.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.208+0000 7fece54b4700 1 -- 172.21.15.40:0/2760391892 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fece009f0f0 msgr2=0x7fece009e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:29.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.208+0000 7fece54b4700 1 --2- 172.21.15.40:0/2760391892 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fece009f0f0 0x7fece009e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.208+0000 7fece54b4700 1 -- 172.21.15.40:0/2760391892 >> v1:172.21.15.40:6789/0 conn(0x7fece0133ca0 legacy=0x7fece0134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:29.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.208+0000 7fece54b4700 1 -- 172.21.15.40:0/2760391892 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece009f6e0 con 0x7fece009d920 2023-09-30T22:28:29.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.208+0000 7fece4cb3700 1 --2- 172.21.15.40:0/2760391892 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fece009f0f0 0x7fece009e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:29.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.209+0000 7fece54b4700 1 --2- 172.21.15.40:0/2760391892 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fece009d920 0x7fece009dcf0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009880 tx=0x7fecdc009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=800f8183f3c40969 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:29.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.209+0000 7fecd7fff700 1 -- 172.21.15.40:0/2760391892 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc005e30 con 0x7fece009d920 2023-09-30T22:28:29.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.209+0000 7fecd7fff700 1 -- 172.21.15.40:0/2760391892 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecdc006030 con 0x7fece009d920 2023-09-30T22:28:29.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.209+0000 7fecd7fff700 1 -- 172.21.15.40:0/2760391892 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc0063c0 con 0x7fece009d920 2023-09-30T22:28:29.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.209+0000 7fece7718700 1 -- 172.21.15.40:0/2760391892 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fece009d920 msgr2=0x7fece009dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:29.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.209+0000 7fece7718700 1 --2- 172.21.15.40:0/2760391892 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fece009d920 0x7fece009dcf0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009880 tx=0x7fecdc009b90 comp rx=0 tx=0).stop 2023-09-30T22:28:29.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.209+0000 7fece7718700 1 -- 172.21.15.40:0/2760391892 shutdown_connections 2023-09-30T22:28:29.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.209+0000 7fece7718700 1 --2- 172.21.15.40:0/2760391892 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fece009d920 0x7fece009dcf0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.209+0000 7fece7718700 1 --2- 172.21.15.40:0/2760391892 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fece009f0f0 0x7fece009e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.209+0000 7fece7718700 1 -- 172.21.15.40:0/2760391892 >> 172.21.15.40:0/2760391892 conn(0x7fece009fb20 msgr2=0x7fece009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:29.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.209+0000 7fece7718700 1 -- 172.21.15.40:0/2760391892 shutdown_connections 2023-09-30T22:28:29.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.209+0000 7fece7718700 1 -- 172.21.15.40:0/2760391892 wait complete. 2023-09-30T22:28:29.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.211+0000 7fece7718700 1 Processor -- start 2023-09-30T22:28:29.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.211+0000 7fece7718700 1 -- start start 2023-09-30T22:28:29.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.211+0000 7fece7718700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fece009d920 0x7fece011e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.211+0000 7fece7718700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fece0133ca0 0x7fece011e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.211+0000 7fece7718700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fece01317c0 0x7fece011eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.211+0000 7fece7718700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece0121c10 con 0x7fece01317c0 2023-09-30T22:28:29.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.211+0000 7fece7718700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece01200f0 con 0x7fece009d920 2023-09-30T22:28:29.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.211+0000 7fece7718700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fece00a25a0 con 0x7fece0133ca0 2023-09-30T22:28:29.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.211+0000 7fece54b4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fece009d920 0x7fece011e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.211+0000 7fece54b4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fece009d920 0x7fece011e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54346/0 (socket says 172.21.15.40:54346) 2023-09-30T22:28:29.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.211+0000 7fece54b4700 1 -- 172.21.15.40:0/3187472233 learned_addr learned my addr 172.21.15.40:0/3187472233 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:29.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.212+0000 7fece5cb5700 1 --2- 172.21.15.40:0/3187472233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fece01317c0 0x7fece011eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.212+0000 7fece4cb3700 1 --2- 172.21.15.40:0/3187472233 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fece0133ca0 0x7fece011e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.212+0000 7fece54b4700 1 -- 172.21.15.40:0/3187472233 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fece0133ca0 msgr2=0x7fece011e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:29.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.212+0000 7fece54b4700 1 --2- 172.21.15.40:0/3187472233 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fece0133ca0 0x7fece011e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.212+0000 7fece54b4700 1 -- 172.21.15.40:0/3187472233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fece01317c0 msgr2=0x7fece011eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:29.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.212+0000 7fece54b4700 1 --2- 172.21.15.40:0/3187472233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fece01317c0 0x7fece011eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.212+0000 7fece54b4700 1 -- 172.21.15.40:0/3187472233 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd00094a0 con 0x7fece009d920 2023-09-30T22:28:29.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.212+0000 7fece54b4700 1 --2- 172.21.15.40:0/3187472233 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fece009d920 0x7fece011e460 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fecdc000c00 tx=0x7fecdc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:29.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.212+0000 7fecd5ffb700 1 -- 172.21.15.40:0/3187472233 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc0063a0 con 0x7fece009d920 2023-09-30T22:28:29.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.212+0000 7fecd5ffb700 1 -- 172.21.15.40:0/3187472233 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecdc006500 con 0x7fece009d920 2023-09-30T22:28:29.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.212+0000 7fece7718700 1 -- 172.21.15.40:0/3187472233 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecdc009430 con 0x7fece009d920 2023-09-30T22:28:29.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.212+0000 7fecd5ffb700 1 -- 172.21.15.40:0/3187472233 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc0068b0 con 0x7fece009d920 2023-09-30T22:28:29.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.212+0000 7fece7718700 1 -- 172.21.15.40:0/3187472233 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece0121230 con 0x7fece009d920 2023-09-30T22:28:29.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.213+0000 7fecd5ffb700 1 -- 172.21.15.40:0/3187472233 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fecdc022070 con 0x7fece009d920 2023-09-30T22:28:29.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.213+0000 7fece7718700 1 -- 172.21.15.40:0/3187472233 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece006f6f0 con 0x7fece009d920 2023-09-30T22:28:29.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.213+0000 7fecd5ffb700 1 -- 172.21.15.40:0/3187472233 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fecdc040d20 con 0x7fece009d920 2023-09-30T22:28:29.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.218+0000 7fecd5ffb700 1 -- 172.21.15.40:0/3187472233 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fecdc003880 con 0x7fece009d920 2023-09-30T22:28:29.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.411+0000 7fece7718700 1 -- 172.21.15.40:0/3187472233 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fece0062380 con 0x7fece009d920 2023-09-30T22:28:29.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.412+0000 7fecd5ffb700 1 -- 172.21.15.40:0/3187472233 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fecdc01b430 con 0x7fece009d920 2023-09-30T22:28:29.412 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:29.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.414+0000 7fece7718700 1 -- 172.21.15.40:0/3187472233 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fece009d920 msgr2=0x7fece011e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:29.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.414+0000 7fece7718700 1 --2- 172.21.15.40:0/3187472233 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fece009d920 0x7fece011e460 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fecdc000c00 tx=0x7fecdc004750 comp rx=0 tx=0).stop 2023-09-30T22:28:29.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.414+0000 7fece7718700 1 -- 172.21.15.40:0/3187472233 shutdown_connections 2023-09-30T22:28:29.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.414+0000 7fece7718700 1 --2- 172.21.15.40:0/3187472233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fece01317c0 0x7fece011eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.414+0000 7fece7718700 1 --2- 172.21.15.40:0/3187472233 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fece009d920 0x7fece011e460 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.414+0000 7fece7718700 1 --2- 172.21.15.40:0/3187472233 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fece0133ca0 0x7fece011e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.414+0000 7fece7718700 1 -- 172.21.15.40:0/3187472233 >> 172.21.15.40:0/3187472233 conn(0x7fece009fb20 msgr2=0x7fece0133480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:29.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.414+0000 7fece7718700 1 -- 172.21.15.40:0/3187472233 shutdown_connections 2023-09-30T22:28:29.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.414+0000 7fece7718700 1 -- 172.21.15.40:0/3187472233 wait complete. 2023-09-30T22:28:29.427 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:29.643 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:29.694 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:29.729 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:29.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.772+0000 7fb6e2fc1700 1 Processor -- start 2023-09-30T22:28:29.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.773+0000 7fb6e2fc1700 1 -- start start 2023-09-30T22:28:29.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.773+0000 7fb6e2fc1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb6dc09e400 0x7fb6dc135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.773+0000 7fb6e2fc1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb6dc136230 0x7fb6dc138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.773+0000 7fb6e2fc1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6dc09adf0 con 0x7fb6dc09d920 2023-09-30T22:28:29.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.773+0000 7fb6e2fc1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6dc09e7f0 con 0x7fb6dc136230 2023-09-30T22:28:29.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.773+0000 7fb6e2fc1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc09edf0 con 0x7fb6dc09e400 2023-09-30T22:28:29.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.773+0000 7fb6dbfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb6dc09e400 0x7fb6dc135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.773+0000 7fb6e0d5d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb6dc09d920 0x7fb6dc09dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46422/0 (socket says 172.21.15.40:46422) 2023-09-30T22:28:29.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.773+0000 7fb6e0d5d700 1 -- 172.21.15.40:0/1042700169 learned_addr learned my addr 172.21.15.40:0/1042700169 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:29.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.773+0000 7fb6e155e700 1 --2- 172.21.15.40:0/1042700169 >> v2:172.21.15.40:3300/0 conn(0x7fb6dc136230 0x7fb6dc138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.774+0000 7fb6dbfff700 1 -- 172.21.15.40:0/1042700169 >> v2:172.21.15.40:3300/0 conn(0x7fb6dc136230 msgr2=0x7fb6dc138610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:29.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.774+0000 7fb6dbfff700 1 --2- 172.21.15.40:0/1042700169 >> v2:172.21.15.40:3300/0 conn(0x7fb6dc136230 0x7fb6dc138610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.774+0000 7fb6dbfff700 1 -- 172.21.15.40:0/1042700169 >> v1:172.21.15.40:6789/0 conn(0x7fb6dc09d920 legacy=0x7fb6dc09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:29.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.774+0000 7fb6dbfff700 1 -- 172.21.15.40:0/1042700169 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6dc09b660 con 0x7fb6dc09e400 2023-09-30T22:28:29.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.774+0000 7fb6e155e700 1 --2- 172.21.15.40:0/1042700169 >> v2:172.21.15.40:3300/0 conn(0x7fb6dc136230 0x7fb6dc138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:29.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.774+0000 7fb6dbfff700 1 --2- 172.21.15.40:0/1042700169 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb6dc09e400 0x7fb6dc135cf0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8009840 tx=0x7fb6c8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf8b9151e9b85d15 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:29.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.774+0000 7fb6db7fe700 1 -- 172.21.15.40:0/1042700169 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c8011830 con 0x7fb6dc09e400 2023-09-30T22:28:29.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.774+0000 7fb6db7fe700 1 -- 172.21.15.40:0/1042700169 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c8011990 con 0x7fb6dc09e400 2023-09-30T22:28:29.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.774+0000 7fb6db7fe700 1 -- 172.21.15.40:0/1042700169 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c8011d20 con 0x7fb6dc09e400 2023-09-30T22:28:29.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.775+0000 7fb6e2fc1700 1 -- 172.21.15.40:0/1042700169 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb6dc09e400 msgr2=0x7fb6dc135cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:29.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.775+0000 7fb6e2fc1700 1 --2- 172.21.15.40:0/1042700169 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb6dc09e400 0x7fb6dc135cf0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8009840 tx=0x7fb6c8009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:29.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.775+0000 7fb6e2fc1700 1 -- 172.21.15.40:0/1042700169 shutdown_connections 2023-09-30T22:28:29.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.775+0000 7fb6e2fc1700 1 --2- 172.21.15.40:0/1042700169 >> v2:172.21.15.40:3300/0 conn(0x7fb6dc136230 0x7fb6dc138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.775+0000 7fb6e2fc1700 1 --2- 172.21.15.40:0/1042700169 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb6dc09e400 0x7fb6dc135cf0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.775+0000 7fb6e2fc1700 1 -- 172.21.15.40:0/1042700169 >> 172.21.15.40:0/1042700169 conn(0x7fb6dc09fb20 msgr2=0x7fb6dc09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:29.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.775+0000 7fb6e2fc1700 1 -- 172.21.15.40:0/1042700169 shutdown_connections 2023-09-30T22:28:29.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.775+0000 7fb6e2fc1700 1 -- 172.21.15.40:0/1042700169 wait complete. 2023-09-30T22:28:29.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.776+0000 7fb6e2fc1700 1 Processor -- start 2023-09-30T22:28:29.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.776+0000 7fb6e2fc1700 1 -- start start 2023-09-30T22:28:29.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.776+0000 7fb6e2fc1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb6dc09d920 0x7fb6dc11f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.776+0000 7fb6e2fc1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6dc09e400 0x7fb6dc11fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.776+0000 7fb6e2fc1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6dc136230 0x7fb6dc1201c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.776+0000 7fb6e2fc1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc09cb00 con 0x7fb6dc09e400 2023-09-30T22:28:29.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.776+0000 7fb6e2fc1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc122a60 con 0x7fb6dc136230 2023-09-30T22:28:29.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.776+0000 7fb6e2fc1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc135b20 con 0x7fb6dc09d920 2023-09-30T22:28:29.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.776+0000 7fb6dbfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6dc09e400 0x7fb6dc11fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.776+0000 7fb6dbfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6dc09e400 0x7fb6dc11fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35956/0 (socket says 172.21.15.40:35956) 2023-09-30T22:28:29.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.776+0000 7fb6dbfff700 1 -- 172.21.15.40:0/1275621134 learned_addr learned my addr 172.21.15.40:0/1275621134 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:29.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.776+0000 7fb6e155e700 1 --2- 172.21.15.40:0/1275621134 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6dc136230 0x7fb6dc1201c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.777+0000 7fb6e0d5d700 1 --2- 172.21.15.40:0/1275621134 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb6dc09d920 0x7fb6dc11f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.777+0000 7fb6dbfff700 1 -- 172.21.15.40:0/1275621134 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb6dc09d920 msgr2=0x7fb6dc11f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:29.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.777+0000 7fb6dbfff700 1 --2- 172.21.15.40:0/1275621134 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb6dc09d920 0x7fb6dc11f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.777+0000 7fb6dbfff700 1 -- 172.21.15.40:0/1275621134 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6dc136230 msgr2=0x7fb6dc1201c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:29.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.777+0000 7fb6dbfff700 1 --2- 172.21.15.40:0/1275621134 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6dc136230 0x7fb6dc1201c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.777+0000 7fb6dbfff700 1 -- 172.21.15.40:0/1275621134 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d4009a70 con 0x7fb6dc09e400 2023-09-30T22:28:29.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.777+0000 7fb6dbfff700 1 --2- 172.21.15.40:0/1275621134 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6dc09e400 0x7fb6dc11fc80 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8009fd0 tx=0x7fb6c8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:29.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.777+0000 7fb6d97fa700 1 -- 172.21.15.40:0/1275621134 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c80043c0 con 0x7fb6dc09e400 2023-09-30T22:28:29.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.777+0000 7fb6d97fa700 1 -- 172.21.15.40:0/1275621134 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c801f070 con 0x7fb6dc09e400 2023-09-30T22:28:29.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.777+0000 7fb6e2fc1700 1 -- 172.21.15.40:0/1275621134 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6c80094a0 con 0x7fb6dc09e400 2023-09-30T22:28:29.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.777+0000 7fb6d97fa700 1 -- 172.21.15.40:0/1275621134 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c80036a0 con 0x7fb6dc09e400 2023-09-30T22:28:29.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.777+0000 7fb6e2fc1700 1 -- 172.21.15.40:0/1275621134 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6dc123260 con 0x7fb6dc09e400 2023-09-30T22:28:29.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.778+0000 7fb6d97fa700 1 -- 172.21.15.40:0/1275621134 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb6c8021030 con 0x7fb6dc09e400 2023-09-30T22:28:29.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.778+0000 7fb6d97fa700 1 -- 172.21.15.40:0/1275621134 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb6c80407e0 con 0x7fb6dc09e400 2023-09-30T22:28:29.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.779+0000 7fb6e2fc1700 1 -- 172.21.15.40:0/1275621134 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6dc062380 con 0x7fb6dc09e400 2023-09-30T22:28:29.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.783+0000 7fb6d97fa700 1 -- 172.21.15.40:0/1275621134 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb6c8023790 con 0x7fb6dc09e400 2023-09-30T22:28:29.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.825+0000 7f4ba73a5700 1 Processor -- start 2023-09-30T22:28:29.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.825+0000 7f4ba73a5700 1 -- start start 2023-09-30T22:28:29.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.825+0000 7f4ba73a5700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4ba009c890 0x7f4ba009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.825+0000 7f4ba73a5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ba009d920 0x7f4ba009dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.825+0000 7f4ba73a5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ba009e2b0 0x7f4ba013ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.825+0000 7f4ba73a5700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ba00a29d0 con 0x7f4ba009c890 2023-09-30T22:28:29.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.825+0000 7f4ba73a5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba009fb40 con 0x7f4ba009d920 2023-09-30T22:28:29.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.825+0000 7f4ba73a5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba00a2600 con 0x7f4ba009e2b0 2023-09-30T22:28:29.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.826+0000 7f4ba5141700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4ba009c890 0x7f4ba009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.826+0000 7f4ba5942700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ba009e2b0 0x7f4ba013ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.826+0000 7f4ba5141700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4ba009c890 0x7f4ba009cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35972/0 (socket says 172.21.15.40:35972) 2023-09-30T22:28:29.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.826+0000 7f4ba5141700 1 -- 172.21.15.40:0/552850459 learned_addr learned my addr 172.21.15.40:0/552850459 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:29.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.826+0000 7f4ba4940700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ba009d920 0x7f4ba009dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.826+0000 7f4ba5942700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ba009e2b0 0x7f4ba013ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55832/0 (socket says 172.21.15.40:55832) 2023-09-30T22:28:29.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.826+0000 7f4ba5141700 1 -- 172.21.15.40:0/552850459 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ba009e2b0 msgr2=0x7f4ba013ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:29.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.826+0000 7f4ba5141700 1 --2- 172.21.15.40:0/552850459 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ba009e2b0 0x7f4ba013ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.826+0000 7f4ba5141700 1 -- 172.21.15.40:0/552850459 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ba009d920 msgr2=0x7f4ba009dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:29.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.826+0000 7f4ba5141700 1 --2- 172.21.15.40:0/552850459 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ba009d920 0x7f4ba009dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.826+0000 7f4ba5141700 1 -- 172.21.15.40:0/552850459 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba009fed0 con 0x7f4ba009c890 2023-09-30T22:28:29.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.826+0000 7f4ba4940700 1 --2- 172.21.15.40:0/552850459 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ba009d920 0x7f4ba009dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:29.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.826+0000 7f4ba5141700 1 --2- 172.21.15.40:0/552850459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ba009c890 0x7f4ba009cc60 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c006fd0 tx=0x7f4b9c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22acc6fe6fc62649 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:29.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.826+0000 7f4b97fff700 1 -- 172.21.15.40:0/552850459 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c005e30 con 0x7f4ba009c890 2023-09-30T22:28:29.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.826+0000 7f4b97fff700 1 -- 172.21.15.40:0/552850459 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9c004030 con 0x7f4ba009c890 2023-09-30T22:28:29.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.826+0000 7f4b97fff700 1 -- 172.21.15.40:0/552850459 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c0043e0 con 0x7f4ba009c890 2023-09-30T22:28:29.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.827+0000 7f4ba73a5700 1 -- 172.21.15.40:0/552850459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ba009c890 msgr2=0x7f4ba009cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:29.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.827+0000 7f4ba73a5700 1 --2- 172.21.15.40:0/552850459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ba009c890 0x7f4ba009cc60 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c006fd0 tx=0x7f4b9c009bd0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.827+0000 7f4ba73a5700 1 -- 172.21.15.40:0/552850459 shutdown_connections 2023-09-30T22:28:29.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.827+0000 7f4ba73a5700 1 --2- 172.21.15.40:0/552850459 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ba009e2b0 0x7f4ba013ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.827+0000 7f4ba73a5700 1 --2- 172.21.15.40:0/552850459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ba009c890 0x7f4ba009cc60 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.827+0000 7f4ba73a5700 1 --2- 172.21.15.40:0/552850459 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ba009d920 0x7f4ba009dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.827+0000 7f4ba73a5700 1 -- 172.21.15.40:0/552850459 >> 172.21.15.40:0/552850459 conn(0x7f4ba00a7080 msgr2=0x7f4ba00a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:29.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.827+0000 7f4ba73a5700 1 -- 172.21.15.40:0/552850459 shutdown_connections 2023-09-30T22:28:29.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.827+0000 7f4ba73a5700 1 -- 172.21.15.40:0/552850459 wait complete. 2023-09-30T22:28:29.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.828+0000 7f4ba73a5700 1 Processor -- start 2023-09-30T22:28:29.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.828+0000 7f4ba73a5700 1 -- start start 2023-09-30T22:28:29.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.829+0000 7f4ba73a5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ba009c890 0x7f4ba012d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.829+0000 7f4ba73a5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ba009d920 0x7f4ba012db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.829+0000 7f4ba73a5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ba009e2b0 0x7f4ba012e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.829+0000 7f4ba73a5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba0130a30 con 0x7f4ba009e2b0 2023-09-30T22:28:29.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.829+0000 7f4ba73a5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba00a5ec0 con 0x7f4ba009d920 2023-09-30T22:28:29.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.829+0000 7f4ba73a5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba009ecf0 con 0x7f4ba009c890 2023-09-30T22:28:29.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.829+0000 7f4ba4940700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ba009d920 0x7f4ba012db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.829+0000 7f4ba4940700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ba009d920 0x7f4ba012db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54378/0 (socket says 172.21.15.40:54378) 2023-09-30T22:28:29.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.829+0000 7f4ba4940700 1 -- 172.21.15.40:0/3002008426 learned_addr learned my addr 172.21.15.40:0/3002008426 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:29.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.829+0000 7f4ba5942700 1 --2- 172.21.15.40:0/3002008426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ba009e2b0 0x7f4ba012e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.829+0000 7f4ba5141700 1 --2- 172.21.15.40:0/3002008426 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ba009c890 0x7f4ba012d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.829+0000 7f4ba4940700 1 -- 172.21.15.40:0/3002008426 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ba009c890 msgr2=0x7f4ba012d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:29.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.829+0000 7f4ba4940700 1 --2- 172.21.15.40:0/3002008426 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ba009c890 0x7f4ba012d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.829+0000 7f4ba4940700 1 -- 172.21.15.40:0/3002008426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ba009e2b0 msgr2=0x7f4ba012e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:29.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.829+0000 7f4ba4940700 1 --2- 172.21.15.40:0/3002008426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ba009e2b0 0x7f4ba012e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.829+0000 7f4ba4940700 1 -- 172.21.15.40:0/3002008426 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b900094a0 con 0x7f4ba009d920 2023-09-30T22:28:29.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.829+0000 7f4ba5942700 1 --2- 172.21.15.40:0/3002008426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ba009e2b0 0x7f4ba012e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:29.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.829+0000 7f4ba5141700 1 --2- 172.21.15.40:0/3002008426 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ba009c890 0x7f4ba012d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:28:29.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.829+0000 7f4ba4940700 1 --2- 172.21.15.40:0/3002008426 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ba009d920 0x7f4ba012db30 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f4b9000ebe0 tx=0x7f4b9000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:29.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.829+0000 7f4b95ffb700 1 -- 172.21.15.40:0/3002008426 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b90009780 con 0x7f4ba009d920 2023-09-30T22:28:29.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.829+0000 7f4b95ffb700 1 -- 172.21.15.40:0/3002008426 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9000c850 con 0x7f4ba009d920 2023-09-30T22:28:29.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.829+0000 7f4b95ffb700 1 -- 172.21.15.40:0/3002008426 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9000cbe0 con 0x7f4ba009d920 2023-09-30T22:28:29.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.829+0000 7f4ba73a5700 1 -- 172.21.15.40:0/3002008426 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b9c009500 con 0x7f4ba009d920 2023-09-30T22:28:29.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.830+0000 7f4ba73a5700 1 -- 172.21.15.40:0/3002008426 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ba0130d10 con 0x7f4ba009d920 2023-09-30T22:28:29.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.831+0000 7f4b95ffb700 1 -- 172.21.15.40:0/3002008426 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4b9000cd40 con 0x7f4ba009d920 2023-09-30T22:28:29.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.831+0000 7f4b95ffb700 1 -- 172.21.15.40:0/3002008426 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4b9003f850 con 0x7f4ba009d920 2023-09-30T22:28:29.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.831+0000 7f4ba73a5700 1 -- 172.21.15.40:0/3002008426 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ba0062380 con 0x7f4ba009d920 2023-09-30T22:28:29.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.839+0000 7f4b95ffb700 1 -- 172.21.15.40:0/3002008426 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b90021080 con 0x7f4ba009d920 2023-09-30T22:28:29.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.879+0000 7fcf89806700 1 Processor -- start 2023-09-30T22:28:29.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.879+0000 7fcf89806700 1 -- start start 2023-09-30T22:28:29.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.879+0000 7fcf89806700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcf8409c890 0x7fcf8409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.880+0000 7fcf89806700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcf8409e480 0x7fcf8413bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.880+0000 7fcf89806700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf840a2600 con 0x7fcf8409d920 2023-09-30T22:28:29.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.880+0000 7fcf89806700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf840a29d0 con 0x7fcf8409e480 2023-09-30T22:28:29.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.880+0000 7fcf89806700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8409fb40 con 0x7fcf8409c890 2023-09-30T22:28:29.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.880+0000 7fcf837fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcf8409e480 0x7fcf8413bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.880+0000 7fcf82ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcf8409c890 0x7fcf8409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.880+0000 7fcf837fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcf8409e480 0x7fcf8413bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35988/0 (socket says 172.21.15.40:35988) 2023-09-30T22:28:29.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.880+0000 7fcf837fe700 1 -- 172.21.15.40:0/1890807588 learned_addr learned my addr 172.21.15.40:0/1890807588 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:29.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.880+0000 7fcf837fe700 1 -- 172.21.15.40:0/1890807588 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcf8409c890 msgr2=0x7fcf8409cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:29.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.880+0000 7fcf837fe700 1 --2- 172.21.15.40:0/1890807588 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcf8409c890 0x7fcf8409cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.880+0000 7fcf837fe700 1 -- 172.21.15.40:0/1890807588 >> v1:172.21.15.40:6789/0 conn(0x7fcf8409d920 legacy=0x7fcf8409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:29.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.880+0000 7fcf837fe700 1 -- 172.21.15.40:0/1890807588 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf8409fed0 con 0x7fcf8409e480 2023-09-30T22:28:29.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.880+0000 7fcf82ffd700 1 --2- 172.21.15.40:0/1890807588 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcf8409c890 0x7fcf8409cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:29.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.880+0000 7fcf837fe700 1 --2- 172.21.15.40:0/1890807588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf8409e480 0x7fcf8413bc20 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c009e50 tx=0x7fcf7c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adced13f92deba54 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:29.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.880+0000 7fcf81ffb700 1 -- 172.21.15.40:0/1890807588 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c00e070 con 0x7fcf8409e480 2023-09-30T22:28:29.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.881+0000 7fcf81ffb700 1 -- 172.21.15.40:0/1890807588 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7c00b910 con 0x7fcf8409e480 2023-09-30T22:28:29.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.881+0000 7fcf81ffb700 1 -- 172.21.15.40:0/1890807588 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c00bcc0 con 0x7fcf8409e480 2023-09-30T22:28:29.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.881+0000 7fcf89806700 1 -- 172.21.15.40:0/1890807588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf8409e480 msgr2=0x7fcf8413bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:29.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.881+0000 7fcf89806700 1 --2- 172.21.15.40:0/1890807588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf8409e480 0x7fcf8413bc20 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c009e50 tx=0x7fcf7c00b330 comp rx=0 tx=0).stop 2023-09-30T22:28:29.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.881+0000 7fcf89806700 1 -- 172.21.15.40:0/1890807588 shutdown_connections 2023-09-30T22:28:29.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.881+0000 7fcf89806700 1 --2- 172.21.15.40:0/1890807588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf8409e480 0x7fcf8413bc20 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.881+0000 7fcf89806700 1 --2- 172.21.15.40:0/1890807588 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcf8409c890 0x7fcf8409cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.881+0000 7fcf89806700 1 -- 172.21.15.40:0/1890807588 >> 172.21.15.40:0/1890807588 conn(0x7fcf840a7080 msgr2=0x7fcf840a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:29.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.881+0000 7fcf89806700 1 -- 172.21.15.40:0/1890807588 shutdown_connections 2023-09-30T22:28:29.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.881+0000 7fcf89806700 1 -- 172.21.15.40:0/1890807588 wait complete. 2023-09-30T22:28:29.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.883+0000 7fcf89806700 1 Processor -- start 2023-09-30T22:28:29.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.883+0000 7fcf89806700 1 -- start start 2023-09-30T22:28:29.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.884+0000 7fcf89806700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcf8409c890 0x7fcf8412d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.884+0000 7fcf89806700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcf8409d920 0x7fcf8412db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.884+0000 7fcf89806700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf8409e480 0x7fcf8412e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.884+0000 7fcf89806700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf840a5de0 con 0x7fcf8409e480 2023-09-30T22:28:29.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.884+0000 7fcf89806700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf84130150 con 0x7fcf8409d920 2023-09-30T22:28:29.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.884+0000 7fcf89806700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8412fd20 con 0x7fcf8409c890 2023-09-30T22:28:29.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.884+0000 7fcf82ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcf8409c890 0x7fcf8412d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.884+0000 7fcf82ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcf8409c890 0x7fcf8412d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55870/0 (socket says 172.21.15.40:55870) 2023-09-30T22:28:29.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.884+0000 7fcf82ffd700 1 -- 172.21.15.40:0/3162680081 learned_addr learned my addr 172.21.15.40:0/3162680081 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:29.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.884+0000 7fcf837fe700 1 --2- 172.21.15.40:0/3162680081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf8409e480 0x7fcf8412e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.884+0000 7fcf827fc700 1 --2- 172.21.15.40:0/3162680081 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcf8409d920 0x7fcf8412db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.884+0000 7fcf82ffd700 1 -- 172.21.15.40:0/3162680081 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcf8409d920 msgr2=0x7fcf8412db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:29.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.884+0000 7fcf82ffd700 1 --2- 172.21.15.40:0/3162680081 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcf8409d920 0x7fcf8412db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.884+0000 7fcf82ffd700 1 -- 172.21.15.40:0/3162680081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf8409e480 msgr2=0x7fcf8412e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:29.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.884+0000 7fcf82ffd700 1 --2- 172.21.15.40:0/3162680081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf8409e480 0x7fcf8412e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.884+0000 7fcf82ffd700 1 -- 172.21.15.40:0/3162680081 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf74009430 con 0x7fcf8409c890 2023-09-30T22:28:29.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.884+0000 7fcf82ffd700 1 --2- 172.21.15.40:0/3162680081 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcf8409c890 0x7fcf8412d640 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fcf7400ebe0 tx=0x7fcf7400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:29.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.884+0000 7fcf6bfff700 1 -- 172.21.15.40:0/3162680081 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf74009740 con 0x7fcf8409c890 2023-09-30T22:28:29.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.884+0000 7fcf6bfff700 1 -- 172.21.15.40:0/3162680081 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf74005a20 con 0x7fcf8409c890 2023-09-30T22:28:29.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.884+0000 7fcf6bfff700 1 -- 172.21.15.40:0/3162680081 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf74005db0 con 0x7fcf8409c890 2023-09-30T22:28:29.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.884+0000 7fcf89806700 1 -- 172.21.15.40:0/3162680081 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf7c009b30 con 0x7fcf8409c890 2023-09-30T22:28:29.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.885+0000 7fcf89806700 1 -- 172.21.15.40:0/3162680081 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf8412f6f0 con 0x7fcf8409c890 2023-09-30T22:28:29.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.885+0000 7fcf6bfff700 1 -- 172.21.15.40:0/3162680081 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcf7400c850 con 0x7fcf8409c890 2023-09-30T22:28:29.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.886+0000 7fcf6bfff700 1 -- 172.21.15.40:0/3162680081 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fcf7403f8e0 con 0x7fcf8409c890 2023-09-30T22:28:29.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.886+0000 7fcf89806700 1 -- 172.21.15.40:0/3162680081 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf84130c40 con 0x7fcf8409c890 2023-09-30T22:28:29.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.891+0000 7fcf6bfff700 1 -- 172.21.15.40:0/3162680081 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcf74020080 con 0x7fcf8409c890 2023-09-30T22:28:29.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.990+0000 7fb6e2fc1700 1 -- 172.21.15.40:0/1275621134 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb6dc074720 con 0x7fb6dc09e400 2023-09-30T22:28:30.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.991+0000 7fb6d97fa700 1 -- 172.21.15.40:0/1275621134 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb6c80233d0 con 0x7fb6dc09e400 2023-09-30T22:28:30.016 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:30.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.993+0000 7fb6e2fc1700 1 -- 172.21.15.40:0/1275621134 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6dc09e400 msgr2=0x7fb6dc11fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:30.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.993+0000 7fb6e2fc1700 1 --2- 172.21.15.40:0/1275621134 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6dc09e400 0x7fb6dc11fc80 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8009fd0 tx=0x7fb6c8004750 comp rx=0 tx=0).stop 2023-09-30T22:28:30.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.993+0000 7fb6e2fc1700 1 -- 172.21.15.40:0/1275621134 shutdown_connections 2023-09-30T22:28:30.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.993+0000 7fb6e2fc1700 1 --2- 172.21.15.40:0/1275621134 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb6dc09d920 0x7fb6dc11f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:30.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.993+0000 7fb6e2fc1700 1 --2- 172.21.15.40:0/1275621134 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6dc136230 0x7fb6dc1201c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:30.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.993+0000 7fb6e2fc1700 1 --2- 172.21.15.40:0/1275621134 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6dc09e400 0x7fb6dc11fc80 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:30.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.993+0000 7fb6e2fc1700 1 -- 172.21.15.40:0/1275621134 >> 172.21.15.40:0/1275621134 conn(0x7fb6dc09fb20 msgr2=0x7fb6dc119730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:30.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.993+0000 7fb6e2fc1700 1 -- 172.21.15.40:0/1275621134 shutdown_connections 2023-09-30T22:28:30.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:29.993+0000 7fb6e2fc1700 1 -- 172.21.15.40:0/1275621134 wait complete. 2023-09-30T22:28:30.019 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:30.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.046+0000 7f4ba73a5700 1 -- 172.21.15.40:0/3002008426 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4ba0074620 con 0x7f4ba009d920 2023-09-30T22:28:30.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.047+0000 7f4b95ffb700 1 -- 172.21.15.40:0/3002008426 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4b90017020 con 0x7f4ba009d920 2023-09-30T22:28:30.047 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:30.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.049+0000 7f4ba73a5700 1 -- 172.21.15.40:0/3002008426 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ba009d920 msgr2=0x7f4ba012db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:30.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.049+0000 7f4ba73a5700 1 --2- 172.21.15.40:0/3002008426 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ba009d920 0x7f4ba012db30 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f4b9000ebe0 tx=0x7f4b9000eef0 comp rx=0 tx=0).stop 2023-09-30T22:28:30.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.049+0000 7f4ba73a5700 1 -- 172.21.15.40:0/3002008426 shutdown_connections 2023-09-30T22:28:30.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.049+0000 7f4ba73a5700 1 --2- 172.21.15.40:0/3002008426 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4ba009c890 0x7f4ba012d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:30.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.049+0000 7f4ba73a5700 1 --2- 172.21.15.40:0/3002008426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ba009e2b0 0x7f4ba012e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:30.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.049+0000 7f4ba73a5700 1 --2- 172.21.15.40:0/3002008426 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ba009d920 0x7f4ba012db30 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:30.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.049+0000 7f4ba73a5700 1 -- 172.21.15.40:0/3002008426 >> 172.21.15.40:0/3002008426 conn(0x7f4ba00a7080 msgr2=0x7f4ba00a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:30.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.049+0000 7f4ba73a5700 1 -- 172.21.15.40:0/3002008426 shutdown_connections 2023-09-30T22:28:30.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.049+0000 7f4ba73a5700 1 -- 172.21.15.40:0/3002008426 wait complete. 2023-09-30T22:28:30.062 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:30.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.089+0000 7fcf89806700 1 -- 172.21.15.40:0/3162680081 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcf84062380 con 0x7fcf8409c890 2023-09-30T22:28:30.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.089+0000 7fcf6bfff700 1 -- 172.21.15.40:0/3162680081 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcf74006030 con 0x7fcf8409c890 2023-09-30T22:28:30.090 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:30.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.091+0000 7fcf89806700 1 -- 172.21.15.40:0/3162680081 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcf8409c890 msgr2=0x7fcf8412d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:30.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.091+0000 7fcf89806700 1 --2- 172.21.15.40:0/3162680081 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcf8409c890 0x7fcf8412d640 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fcf7400ebe0 tx=0x7fcf7400eef0 comp rx=0 tx=0).stop 2023-09-30T22:28:30.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.091+0000 7fcf89806700 1 -- 172.21.15.40:0/3162680081 shutdown_connections 2023-09-30T22:28:30.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.091+0000 7fcf89806700 1 --2- 172.21.15.40:0/3162680081 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcf8409c890 0x7fcf8412d640 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:30.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.091+0000 7fcf89806700 1 --2- 172.21.15.40:0/3162680081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcf8409e480 0x7fcf8412e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:30.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.091+0000 7fcf89806700 1 --2- 172.21.15.40:0/3162680081 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcf8409d920 0x7fcf8412db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:30.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.091+0000 7fcf89806700 1 -- 172.21.15.40:0/3162680081 >> 172.21.15.40:0/3162680081 conn(0x7fcf840a7080 msgr2=0x7fcf840a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:30.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.092+0000 7fcf89806700 1 -- 172.21.15.40:0/3162680081 shutdown_connections 2023-09-30T22:28:30.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.092+0000 7fcf89806700 1 -- 172.21.15.40:0/3162680081 wait complete. 2023-09-30T22:28:30.104 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:30.427 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:30.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.560+0000 7fc644b3f700 1 Processor -- start 2023-09-30T22:28:30.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.560+0000 7fc644b3f700 1 -- start start 2023-09-30T22:28:30.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.561+0000 7fc644b3f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc64009d920 0x7fc64009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:30.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.561+0000 7fc644b3f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc64009e230 0x7fc6401343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:30.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.561+0000 7fc644b3f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc64009f940 con 0x7fc64009f0f0 2023-09-30T22:28:30.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.561+0000 7fc644b3f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc64006b4c0 con 0x7fc64009d920 2023-09-30T22:28:30.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.561+0000 7fc644b3f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc64009a8f0 con 0x7fc64009e230 2023-09-30T22:28:30.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.561+0000 7fc63e59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc64009d920 0x7fc64009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:30.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.561+0000 7fc63ed9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc64009e230 0x7fc6401343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:30.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.561+0000 7fc63dd9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc64009f0f0 0x7fc640133ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46434/0 (socket says 172.21.15.40:46434) 2023-09-30T22:28:30.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.561+0000 7fc63dd9b700 1 -- 172.21.15.40:0/1364581818 learned_addr learned my addr 172.21.15.40:0/1364581818 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:30.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.561+0000 7fc63ed9d700 1 -- 172.21.15.40:0/1364581818 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc64009d920 msgr2=0x7fc64009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:30.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.561+0000 7fc63d59a700 1 -- 172.21.15.40:0/1364581818 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 864019972 0 0) 0x7fc64009f940 con 0x7fc64009f0f0 2023-09-30T22:28:30.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.561+0000 7fc63ed9d700 1 --2- 172.21.15.40:0/1364581818 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc64009d920 0x7fc64009dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:30.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.561+0000 7fc63ed9d700 1 -- 172.21.15.40:0/1364581818 >> v1:172.21.15.40:6789/0 conn(0x7fc64009f0f0 legacy=0x7fc640133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:30.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.561+0000 7fc63ed9d700 1 -- 172.21.15.40:0/1364581818 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64009f6e0 con 0x7fc64009e230 2023-09-30T22:28:30.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.561+0000 7fc63e59c700 1 --2- 172.21.15.40:0/1364581818 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc64009d920 0x7fc64009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:30.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.562+0000 7fc63ed9d700 1 --2- 172.21.15.40:0/1364581818 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc64009e230 0x7fc6401343b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc638009df0 tx=0x7fc63800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7034c65b70f6277 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:30.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.562+0000 7fc63d59a700 1 -- 172.21.15.40:0/1364581818 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63800e070 con 0x7fc64009e230 2023-09-30T22:28:30.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.562+0000 7fc63d59a700 1 -- 172.21.15.40:0/1364581818 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63800bae0 con 0x7fc64009e230 2023-09-30T22:28:30.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.562+0000 7fc63d59a700 1 -- 172.21.15.40:0/1364581818 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63800be90 con 0x7fc64009e230 2023-09-30T22:28:30.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.562+0000 7fc644b3f700 1 -- 172.21.15.40:0/1364581818 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc64009e230 msgr2=0x7fc6401343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:30.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.562+0000 7fc644b3f700 1 --2- 172.21.15.40:0/1364581818 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc64009e230 0x7fc6401343b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc638009df0 tx=0x7fc63800b330 comp rx=0 tx=0).stop 2023-09-30T22:28:30.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.562+0000 7fc644b3f700 1 -- 172.21.15.40:0/1364581818 shutdown_connections 2023-09-30T22:28:30.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.562+0000 7fc644b3f700 1 --2- 172.21.15.40:0/1364581818 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc64009e230 0x7fc6401343b0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:30.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.562+0000 7fc644b3f700 1 --2- 172.21.15.40:0/1364581818 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc64009d920 0x7fc64009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:30.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.562+0000 7fc644b3f700 1 -- 172.21.15.40:0/1364581818 >> 172.21.15.40:0/1364581818 conn(0x7fc64009fb20 msgr2=0x7fc64009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:30.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.562+0000 7fc644b3f700 1 -- 172.21.15.40:0/1364581818 shutdown_connections 2023-09-30T22:28:30.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.563+0000 7fc644b3f700 1 -- 172.21.15.40:0/1364581818 wait complete. 2023-09-30T22:28:30.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.564+0000 7fc644b3f700 1 Processor -- start 2023-09-30T22:28:30.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.564+0000 7fc644b3f700 1 -- start start 2023-09-30T22:28:30.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.564+0000 7fc644b3f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc64009d920 0x7fc6401226b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:30.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.564+0000 7fc644b3f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc64009e230 0x7fc640122bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:30.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.564+0000 7fc644b3f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc640123130 0x7fc6401ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:30.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.564+0000 7fc644b3f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc640125ef0 con 0x7fc640123130 2023-09-30T22:28:30.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.564+0000 7fc644b3f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc640133b10 con 0x7fc64009e230 2023-09-30T22:28:30.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.564+0000 7fc644b3f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc640125150 con 0x7fc64009d920 2023-09-30T22:28:30.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.564+0000 7fc63e59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc64009d920 0x7fc6401226b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:30.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.564+0000 7fc63dd9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc64009e230 0x7fc640122bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:30.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.564+0000 7fc63e59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc64009d920 0x7fc6401226b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55888/0 (socket says 172.21.15.40:55888) 2023-09-30T22:28:30.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.564+0000 7fc63e59c700 1 -- 172.21.15.40:0/715543745 learned_addr learned my addr 172.21.15.40:0/715543745 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:30.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.564+0000 7fc63ed9d700 1 --2- 172.21.15.40:0/715543745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc640123130 0x7fc6401ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:30.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.564+0000 7fc63dd9b700 1 -- 172.21.15.40:0/715543745 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc64009d920 msgr2=0x7fc6401226b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:30.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.564+0000 7fc63dd9b700 1 --2- 172.21.15.40:0/715543745 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc64009d920 0x7fc6401226b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:30.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.564+0000 7fc63dd9b700 1 -- 172.21.15.40:0/715543745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc640123130 msgr2=0x7fc6401ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:30.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.564+0000 7fc63dd9b700 1 --2- 172.21.15.40:0/715543745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc640123130 0x7fc6401ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:30.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.565+0000 7fc63dd9b700 1 -- 172.21.15.40:0/715543745 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc630009430 con 0x7fc64009e230 2023-09-30T22:28:30.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.565+0000 7fc63e59c700 1 --2- 172.21.15.40:0/715543745 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc64009d920 0x7fc6401226b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:30.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.565+0000 7fc63dd9b700 1 --2- 172.21.15.40:0/715543745 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc64009e230 0x7fc640122bf0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fc64006b7b0 tx=0x7fc63400c750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:30.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.565+0000 7fc62effd700 1 -- 172.21.15.40:0/715543745 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc634004c80 con 0x7fc64009e230 2023-09-30T22:28:30.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.565+0000 7fc62effd700 1 -- 172.21.15.40:0/715543745 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc634004de0 con 0x7fc64009e230 2023-09-30T22:28:30.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.565+0000 7fc644b3f700 1 -- 172.21.15.40:0/715543745 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc638009a70 con 0x7fc64009e230 2023-09-30T22:28:30.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.565+0000 7fc62effd700 1 -- 172.21.15.40:0/715543745 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc634007310 con 0x7fc64009e230 2023-09-30T22:28:30.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.565+0000 7fc644b3f700 1 -- 172.21.15.40:0/715543745 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6400a3040 con 0x7fc64009e230 2023-09-30T22:28:30.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.566+0000 7fc62effd700 1 -- 172.21.15.40:0/715543745 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc634007470 con 0x7fc64009e230 2023-09-30T22:28:30.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.566+0000 7fc644b3f700 1 -- 172.21.15.40:0/715543745 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc640125d50 con 0x7fc64009e230 2023-09-30T22:28:30.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.566+0000 7fc62effd700 1 -- 172.21.15.40:0/715543745 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc63403f210 con 0x7fc64009e230 2023-09-30T22:28:30.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.570+0000 7fc62effd700 1 -- 172.21.15.40:0/715543745 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc640125d50 con 0x7fc64009e230 2023-09-30T22:28:30.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.766+0000 7fc644b3f700 1 -- 172.21.15.40:0/715543745 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc640125d50 con 0x7fc64009e230 2023-09-30T22:28:30.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.766+0000 7fc62effd700 1 -- 172.21.15.40:0/715543745 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc640125d50 con 0x7fc64009e230 2023-09-30T22:28:30.767 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:30.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.769+0000 7fc644b3f700 1 -- 172.21.15.40:0/715543745 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc64009e230 msgr2=0x7fc640122bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:30.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.769+0000 7fc644b3f700 1 --2- 172.21.15.40:0/715543745 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc64009e230 0x7fc640122bf0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fc64006b7b0 tx=0x7fc63400c750 comp rx=0 tx=0).stop 2023-09-30T22:28:30.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.769+0000 7fc644b3f700 1 -- 172.21.15.40:0/715543745 shutdown_connections 2023-09-30T22:28:30.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.769+0000 7fc644b3f700 1 --2- 172.21.15.40:0/715543745 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc64009d920 0x7fc6401226b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:30.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.769+0000 7fc644b3f700 1 --2- 172.21.15.40:0/715543745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc640123130 0x7fc6401ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:30.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.769+0000 7fc644b3f700 1 --2- 172.21.15.40:0/715543745 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc64009e230 0x7fc640122bf0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:30.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.769+0000 7fc644b3f700 1 -- 172.21.15.40:0/715543745 >> 172.21.15.40:0/715543745 conn(0x7fc64009fb20 msgr2=0x7fc6400707d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:30.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.769+0000 7fc644b3f700 1 -- 172.21.15.40:0/715543745 shutdown_connections 2023-09-30T22:28:30.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:30.769+0000 7fc644b3f700 1 -- 172.21.15.40:0/715543745 wait complete. 2023-09-30T22:28:30.782 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:31.020 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:31.062 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:31.105 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:31.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.155+0000 7f7350735700 1 Processor -- start 2023-09-30T22:28:31.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.155+0000 7f7350735700 1 -- start start 2023-09-30T22:28:31.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.156+0000 7f7350735700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f734809d920 0x7f734809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:31.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.156+0000 7f7350735700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f734809f0f0 0x7f734809e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:31.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.156+0000 7f7350735700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f734809f940 con 0x7f7348133ca0 2023-09-30T22:28:31.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.156+0000 7f7350735700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f734806b4c0 con 0x7f734809d920 2023-09-30T22:28:31.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.156+0000 7f7350735700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734809a8f0 con 0x7f734809f0f0 2023-09-30T22:28:31.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.156+0000 7f734e4d1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f734809d920 0x7f734809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:31.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.156+0000 7f734dcd0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f734809f0f0 0x7f734809e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:31.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.156+0000 7f734e4d1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f734809d920 0x7f734809dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36030/0 (socket says 172.21.15.40:36030) 2023-09-30T22:28:31.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.156+0000 7f734e4d1700 1 -- 172.21.15.40:0/866511635 learned_addr learned my addr 172.21.15.40:0/866511635 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:31.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.156+0000 7f734dcd0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f734809f0f0 0x7f734809e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54416/0 (socket says 172.21.15.40:54416) 2023-09-30T22:28:31.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.156+0000 7f734dcd0700 1 -- 172.21.15.40:0/866511635 >> v2:172.21.15.40:3300/0 conn(0x7f734809d920 msgr2=0x7f734809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:31.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.156+0000 7f734dcd0700 1 --2- 172.21.15.40:0/866511635 >> v2:172.21.15.40:3300/0 conn(0x7f734809d920 0x7f734809dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.156+0000 7f734dcd0700 1 -- 172.21.15.40:0/866511635 >> v1:172.21.15.40:6789/0 conn(0x7f7348133ca0 legacy=0x7f7348134120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:31.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.156+0000 7f734dcd0700 1 -- 172.21.15.40:0/866511635 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734809f6e0 con 0x7f734809f0f0 2023-09-30T22:28:31.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.156+0000 7f734d4cf700 1 -- 172.21.15.40:0/866511635 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 487619218 0 0) 0x7f734809f940 con 0x7f7348133ca0 2023-09-30T22:28:31.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.156+0000 7f734e4d1700 1 --2- 172.21.15.40:0/866511635 >> v2:172.21.15.40:3300/0 conn(0x7f734809d920 0x7f734809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:31.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.157+0000 7f734dcd0700 1 --2- 172.21.15.40:0/866511635 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f734809f0f0 0x7f734809e230 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f7338009840 tx=0x7f7338009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30a18f0c3ae732a6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:31.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.157+0000 7f734d4cf700 1 -- 172.21.15.40:0/866511635 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7338011830 con 0x7f734809f0f0 2023-09-30T22:28:31.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.157+0000 7f734d4cf700 1 -- 172.21.15.40:0/866511635 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7338011990 con 0x7f734809f0f0 2023-09-30T22:28:31.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.157+0000 7f734d4cf700 1 -- 172.21.15.40:0/866511635 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7338011d20 con 0x7f734809f0f0 2023-09-30T22:28:31.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.157+0000 7f7350735700 1 -- 172.21.15.40:0/866511635 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f734809f0f0 msgr2=0x7f734809e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:31.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.157+0000 7f7350735700 1 --2- 172.21.15.40:0/866511635 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f734809f0f0 0x7f734809e230 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f7338009840 tx=0x7f7338009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:31.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.158+0000 7f7350735700 1 -- 172.21.15.40:0/866511635 shutdown_connections 2023-09-30T22:28:31.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.158+0000 7f7350735700 1 --2- 172.21.15.40:0/866511635 >> v2:172.21.15.40:3300/0 conn(0x7f734809d920 0x7f734809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.158+0000 7f7350735700 1 --2- 172.21.15.40:0/866511635 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f734809f0f0 0x7f734809e230 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.158+0000 7f7350735700 1 -- 172.21.15.40:0/866511635 >> 172.21.15.40:0/866511635 conn(0x7f734809fb20 msgr2=0x7f734809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:31.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.158+0000 7f7350735700 1 -- 172.21.15.40:0/866511635 shutdown_connections 2023-09-30T22:28:31.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.158+0000 7f7350735700 1 -- 172.21.15.40:0/866511635 wait complete. 2023-09-30T22:28:31.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.159+0000 7f7350735700 1 Processor -- start 2023-09-30T22:28:31.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.159+0000 7f7350735700 1 -- start start 2023-09-30T22:28:31.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.160+0000 7f7350735700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f734809d920 0x7f734811e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:31.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.160+0000 7f7350735700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7348133ca0 0x7f734811e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:31.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.160+0000 7f7350735700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7348131810 0x7f734811eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:31.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.160+0000 7f7350735700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7348121c60 con 0x7f7348131810 2023-09-30T22:28:31.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.160+0000 7f7350735700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73480a2560 con 0x7f7348133ca0 2023-09-30T22:28:31.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.160+0000 7f7350735700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7348120140 con 0x7f734809d920 2023-09-30T22:28:31.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.160+0000 7f734dcd0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7348133ca0 0x7f734811e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:31.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.160+0000 7f734dcd0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7348133ca0 0x7f734811e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54432/0 (socket says 172.21.15.40:54432) 2023-09-30T22:28:31.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.160+0000 7f734dcd0700 1 -- 172.21.15.40:0/1323468613 learned_addr learned my addr 172.21.15.40:0/1323468613 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:31.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.160+0000 7f734ecd2700 1 --2- 172.21.15.40:0/1323468613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7348131810 0x7f734811eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:31.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.160+0000 7f734e4d1700 1 --2- 172.21.15.40:0/1323468613 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f734809d920 0x7f734811e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:31.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.160+0000 7f734e4d1700 1 -- 172.21.15.40:0/1323468613 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7348133ca0 msgr2=0x7f734811e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:31.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.160+0000 7f734e4d1700 1 --2- 172.21.15.40:0/1323468613 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7348133ca0 0x7f734811e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.160+0000 7f734e4d1700 1 -- 172.21.15.40:0/1323468613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7348131810 msgr2=0x7f734811eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:31.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.160+0000 7f734e4d1700 1 --2- 172.21.15.40:0/1323468613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7348131810 0x7f734811eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.160+0000 7f734e4d1700 1 -- 172.21.15.40:0/1323468613 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7344009500 con 0x7f734809d920 2023-09-30T22:28:31.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.160+0000 7f734dcd0700 1 --2- 172.21.15.40:0/1323468613 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7348133ca0 0x7f734811e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:31.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.160+0000 7f734ecd2700 1 --2- 172.21.15.40:0/1323468613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7348131810 0x7f734811eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:31.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.160+0000 7f734e4d1700 1 --2- 172.21.15.40:0/1323468613 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f734809d920 0x7f734811e420 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f734400ebe0 tx=0x7f734400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:31.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.161+0000 7f733effd700 1 -- 172.21.15.40:0/1323468613 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7344005a20 con 0x7f734809d920 2023-09-30T22:28:31.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.161+0000 7f733effd700 1 -- 172.21.15.40:0/1323468613 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7344005b80 con 0x7f734809d920 2023-09-30T22:28:31.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.161+0000 7f7350735700 1 -- 172.21.15.40:0/1323468613 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73380094a0 con 0x7f734809d920 2023-09-30T22:28:31.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.161+0000 7f733effd700 1 -- 172.21.15.40:0/1323468613 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734400c850 con 0x7f734809d920 2023-09-30T22:28:31.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.161+0000 7f7350735700 1 -- 172.21.15.40:0/1323468613 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7348121280 con 0x7f734809d920 2023-09-30T22:28:31.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.162+0000 7f733effd700 1 -- 172.21.15.40:0/1323468613 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f734400c9b0 con 0x7f734809d920 2023-09-30T22:28:31.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.162+0000 7f733effd700 1 -- 172.21.15.40:0/1323468613 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f734403f930 con 0x7f734809d920 2023-09-30T22:28:31.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.162+0000 7f7350735700 1 -- 172.21.15.40:0/1323468613 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f734806f6f0 con 0x7f734809d920 2023-09-30T22:28:31.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.167+0000 7f733effd700 1 -- 172.21.15.40:0/1323468613 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7344022300 con 0x7f734809d920 2023-09-30T22:28:31.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.196+0000 7fcacbf66700 1 Processor -- start 2023-09-30T22:28:31.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.197+0000 7fcacbf66700 1 -- start start 2023-09-30T22:28:31.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.197+0000 7fcacbf66700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcac4131d50 0x7fcac4132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:31.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.197+0000 7fcacbf66700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcac409c7d0 0x7fcac4139ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:31.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.197+0000 7fcacbf66700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcac4132660 con 0x7fcac409bc50 2023-09-30T22:28:31.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.197+0000 7fcacbf66700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac40719b0 con 0x7fcac409c7d0 2023-09-30T22:28:31.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.197+0000 7fcacbf66700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcac4131900 con 0x7fcac4131d50 2023-09-30T22:28:31.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.197+0000 7fcaca503700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcac409c7d0 0x7fcac4139ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:31.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.197+0000 7fcac9d02700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcac4131d50 0x7fcac4132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:31.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.197+0000 7fcaca503700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcac409c7d0 0x7fcac4139ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36046/0 (socket says 172.21.15.40:36046) 2023-09-30T22:28:31.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.197+0000 7fcaca503700 1 -- 172.21.15.40:0/1557302410 learned_addr learned my addr 172.21.15.40:0/1557302410 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:31.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.197+0000 7fcac9d02700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcac4131d50 0x7fcac4132120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55892/0 (socket says 172.21.15.40:55892) 2023-09-30T22:28:31.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.198+0000 7fcaca503700 1 -- 172.21.15.40:0/1557302410 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcac4131d50 msgr2=0x7fcac4132120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:31.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.198+0000 7fcaca503700 1 --2- 172.21.15.40:0/1557302410 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcac4131d50 0x7fcac4132120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.198+0000 7fcaca503700 1 -- 172.21.15.40:0/1557302410 >> v1:172.21.15.40:6789/0 conn(0x7fcac409bc50 legacy=0x7fcac409c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:31.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.198+0000 7fcaca503700 1 -- 172.21.15.40:0/1557302410 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac409e820 con 0x7fcac409c7d0 2023-09-30T22:28:31.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.198+0000 7fcaca503700 1 --2- 172.21.15.40:0/1557302410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcac409c7d0 0x7fcac4139ac0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fcabc009e50 tx=0x7fcabc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f46befc1e67eb7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:31.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.198+0000 7fcac8d00700 1 -- 172.21.15.40:0/1557302410 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc00e070 con 0x7fcac409c7d0 2023-09-30T22:28:31.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.198+0000 7fcac8d00700 1 -- 172.21.15.40:0/1557302410 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcabc00b910 con 0x7fcac409c7d0 2023-09-30T22:28:31.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.198+0000 7fcac8d00700 1 -- 172.21.15.40:0/1557302410 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc00bcc0 con 0x7fcac409c7d0 2023-09-30T22:28:31.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.199+0000 7fcacbf66700 1 -- 172.21.15.40:0/1557302410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcac409c7d0 msgr2=0x7fcac4139ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:31.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.199+0000 7fcacbf66700 1 --2- 172.21.15.40:0/1557302410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcac409c7d0 0x7fcac4139ac0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fcabc009e50 tx=0x7fcabc00b330 comp rx=0 tx=0).stop 2023-09-30T22:28:31.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.199+0000 7fcacbf66700 1 -- 172.21.15.40:0/1557302410 shutdown_connections 2023-09-30T22:28:31.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.199+0000 7fcacbf66700 1 --2- 172.21.15.40:0/1557302410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcac409c7d0 0x7fcac4139ac0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.199+0000 7fcacbf66700 1 --2- 172.21.15.40:0/1557302410 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcac4131d50 0x7fcac4132120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.199+0000 7fcacbf66700 1 -- 172.21.15.40:0/1557302410 >> 172.21.15.40:0/1557302410 conn(0x7fcac40a2a00 msgr2=0x7fcac40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:31.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.199+0000 7fcacbf66700 1 -- 172.21.15.40:0/1557302410 shutdown_connections 2023-09-30T22:28:31.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.199+0000 7fcacbf66700 1 -- 172.21.15.40:0/1557302410 wait complete. 2023-09-30T22:28:31.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.200+0000 7fcacbf66700 1 Processor -- start 2023-09-30T22:28:31.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.200+0000 7fcacbf66700 1 -- start start 2023-09-30T22:28:31.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.201+0000 7fcacbf66700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcac409bc50 0x7fcac411aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:31.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.201+0000 7fcacbf66700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcac409c7d0 0x7fcac411af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:31.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.201+0000 7fcacbf66700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcac4131d50 0x7fcac411b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:31.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.201+0000 7fcacbf66700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac411bf00 con 0x7fcac409bc50 2023-09-30T22:28:31.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.201+0000 7fcacbf66700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac411c5d0 con 0x7fcac409c7d0 2023-09-30T22:28:31.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.201+0000 7fcacbf66700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcac411d820 con 0x7fcac4131d50 2023-09-30T22:28:31.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.201+0000 7fcaca503700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcac4131d50 0x7fcac411b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:31.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.201+0000 7fcac9d02700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcac409bc50 0x7fcac411aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:31.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.201+0000 7fcaca503700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcac4131d50 0x7fcac411b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55900/0 (socket says 172.21.15.40:55900) 2023-09-30T22:28:31.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.201+0000 7fcaca503700 1 -- 172.21.15.40:0/1614781197 learned_addr learned my addr 172.21.15.40:0/1614781197 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:31.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.201+0000 7fcac9501700 1 --2- 172.21.15.40:0/1614781197 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcac409c7d0 0x7fcac411af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:31.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.201+0000 7fcac9d02700 1 -- 172.21.15.40:0/1614781197 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcac4131d50 msgr2=0x7fcac411b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:31.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.201+0000 7fcac9d02700 1 --2- 172.21.15.40:0/1614781197 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcac4131d50 0x7fcac411b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.201+0000 7fcac9d02700 1 -- 172.21.15.40:0/1614781197 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcac409c7d0 msgr2=0x7fcac411af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:31.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.201+0000 7fcac9d02700 1 --2- 172.21.15.40:0/1614781197 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcac409c7d0 0x7fcac411af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.202+0000 7fcac9d02700 1 -- 172.21.15.40:0/1614781197 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcabc009b30 con 0x7fcac409bc50 2023-09-30T22:28:31.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.202+0000 7fcaca503700 1 --2- 172.21.15.40:0/1614781197 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcac4131d50 0x7fcac411b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:31.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.202+0000 7fcac9d02700 1 --2- 172.21.15.40:0/1614781197 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcac409bc50 0x7fcac411aa50 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fcac0012c40 tx=0x7fcac0012f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:31.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.202+0000 7fcaba7fc700 1 -- 172.21.15.40:0/1614781197 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac00108d0 con 0x7fcac409bc50 2023-09-30T22:28:31.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.202+0000 7fcaba7fc700 1 -- 172.21.15.40:0/1614781197 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac0013040 con 0x7fcac409bc50 2023-09-30T22:28:31.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.202+0000 7fcacbf66700 1 -- 172.21.15.40:0/1614781197 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac411e200 con 0x7fcac409bc50 2023-09-30T22:28:31.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.202+0000 7fcaba7fc700 1 -- 172.21.15.40:0/1614781197 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac0010c30 con 0x7fcac409bc50 2023-09-30T22:28:31.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.202+0000 7fcacbf66700 1 -- 172.21.15.40:0/1614781197 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac409ea60 con 0x7fcac409bc50 2023-09-30T22:28:31.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.203+0000 7fcaba7fc700 1 -- 172.21.15.40:0/1614781197 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcac0010d90 con 0x7fcac409bc50 2023-09-30T22:28:31.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.203+0000 7fcaba7fc700 1 -- 172.21.15.40:0/1614781197 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fcac0043520 con 0x7fcac409bc50 2023-09-30T22:28:31.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.204+0000 7fcacbf66700 1 -- 172.21.15.40:0/1614781197 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac406fa30 con 0x7fcac409bc50 2023-09-30T22:28:31.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.208+0000 7fcaba7fc700 1 -- 172.21.15.40:0/1614781197 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcac000b450 con 0x7fcac409bc50 2023-09-30T22:28:31.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.239+0000 7f9d8c9e4700 1 Processor -- start 2023-09-30T22:28:31.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.240+0000 7f9d8c9e4700 1 -- start start 2023-09-30T22:28:31.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.240+0000 7f9d8c9e4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d8809fbb0 0x7f9d8806d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:31.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.240+0000 7f9d8c9e4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d88139380 0x7f9d8813b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:31.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.240+0000 7f9d8c9e4700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d880a0780 con 0x7f9d8806f3a0 2023-09-30T22:28:31.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.240+0000 7f9d8c9e4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8809ff80 con 0x7f9d88139380 2023-09-30T22:28:31.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.241+0000 7f9d8c9e4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d880a0590 con 0x7f9d8809fbb0 2023-09-30T22:28:31.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.241+0000 7f9d8659c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9d8806f3a0 0x7f9d8806c990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46468/0 (socket says 172.21.15.40:46468) 2023-09-30T22:28:31.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.241+0000 7f9d8659c700 1 -- 172.21.15.40:0/1423049870 learned_addr learned my addr 172.21.15.40:0/1423049870 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:31.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.241+0000 7f9d85d9b700 1 --2- 172.21.15.40:0/1423049870 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d8809fbb0 0x7f9d8806d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:31.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.241+0000 7f9d86d9d700 1 --2- 172.21.15.40:0/1423049870 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d88139380 0x7f9d8813b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:31.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.241+0000 7f9d85d9b700 1 -- 172.21.15.40:0/1423049870 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d88139380 msgr2=0x7f9d8813b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:31.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.241+0000 7f9d85d9b700 1 --2- 172.21.15.40:0/1423049870 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d88139380 0x7f9d8813b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.241+0000 7f9d85d9b700 1 -- 172.21.15.40:0/1423049870 >> v1:172.21.15.40:6789/0 conn(0x7f9d8806f3a0 legacy=0x7f9d8806c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:31.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.241+0000 7f9d85d9b700 1 -- 172.21.15.40:0/1423049870 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8806df90 con 0x7f9d8809fbb0 2023-09-30T22:28:31.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.241+0000 7f9d86d9d700 1 --2- 172.21.15.40:0/1423049870 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d88139380 0x7f9d8813b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:31.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.241+0000 7f9d85d9b700 1 --2- 172.21.15.40:0/1423049870 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d8809fbb0 0x7f9d8806d0a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c0098a0 tx=0x7f9d7c009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=247bf5a37a88547c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:31.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.241+0000 7f9d8559a700 1 -- 172.21.15.40:0/1423049870 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c011830 con 0x7f9d8809fbb0 2023-09-30T22:28:31.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.241+0000 7f9d8559a700 1 -- 172.21.15.40:0/1423049870 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7c011990 con 0x7f9d8809fbb0 2023-09-30T22:28:31.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.242+0000 7f9d8559a700 1 -- 172.21.15.40:0/1423049870 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c011d20 con 0x7f9d8809fbb0 2023-09-30T22:28:31.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.242+0000 7f9d8c9e4700 1 -- 172.21.15.40:0/1423049870 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d8809fbb0 msgr2=0x7f9d8806d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:31.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.242+0000 7f9d8c9e4700 1 --2- 172.21.15.40:0/1423049870 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d8809fbb0 0x7f9d8806d0a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c0098a0 tx=0x7f9d7c009bb0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.242+0000 7f9d8c9e4700 1 -- 172.21.15.40:0/1423049870 shutdown_connections 2023-09-30T22:28:31.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.242+0000 7f9d8c9e4700 1 --2- 172.21.15.40:0/1423049870 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d88139380 0x7f9d8813b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.242+0000 7f9d8c9e4700 1 --2- 172.21.15.40:0/1423049870 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d8809fbb0 0x7f9d8806d0a0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.242+0000 7f9d8c9e4700 1 -- 172.21.15.40:0/1423049870 >> 172.21.15.40:0/1423049870 conn(0x7f9d880a41a0 msgr2=0x7f9d880a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:31.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.242+0000 7f9d8c9e4700 1 -- 172.21.15.40:0/1423049870 shutdown_connections 2023-09-30T22:28:31.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.242+0000 7f9d8c9e4700 1 -- 172.21.15.40:0/1423049870 wait complete. 2023-09-30T22:28:31.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.243+0000 7f9d8c9e4700 1 Processor -- start 2023-09-30T22:28:31.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.243+0000 7f9d8c9e4700 1 -- start start 2023-09-30T22:28:31.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.244+0000 7f9d8c9e4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d8806f3a0 0x7f9d88138860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:31.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.244+0000 7f9d8c9e4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d8809fbb0 0x7f9d88138da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:31.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.244+0000 7f9d8c9e4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d88139380 0x7f9d88095d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:31.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.244+0000 7f9d8c9e4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d88093b60 con 0x7f9d8809fbb0 2023-09-30T22:28:31.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.244+0000 7f9d8c9e4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d880951a0 con 0x7f9d8806f3a0 2023-09-30T22:28:31.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.244+0000 7f9d8c9e4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d88093840 con 0x7f9d88139380 2023-09-30T22:28:31.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.244+0000 7f9d8659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d8806f3a0 0x7f9d88138860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:31.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.244+0000 7f9d8659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d8806f3a0 0x7f9d88138860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54458/0 (socket says 172.21.15.40:54458) 2023-09-30T22:28:31.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.244+0000 7f9d8659c700 1 -- 172.21.15.40:0/20915435 learned_addr learned my addr 172.21.15.40:0/20915435 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:31.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.244+0000 7f9d86d9d700 1 --2- 172.21.15.40:0/20915435 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d88139380 0x7f9d88095d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:31.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.244+0000 7f9d85d9b700 1 --2- 172.21.15.40:0/20915435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d8809fbb0 0x7f9d88138da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:31.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.244+0000 7f9d8659c700 1 -- 172.21.15.40:0/20915435 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d88139380 msgr2=0x7f9d88095d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:31.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.244+0000 7f9d8659c700 1 --2- 172.21.15.40:0/20915435 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d88139380 0x7f9d88095d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.244+0000 7f9d8659c700 1 -- 172.21.15.40:0/20915435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d8809fbb0 msgr2=0x7f9d88138da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:31.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.244+0000 7f9d8659c700 1 --2- 172.21.15.40:0/20915435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d8809fbb0 0x7f9d88138da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.244+0000 7f9d8659c700 1 -- 172.21.15.40:0/20915435 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d80009a70 con 0x7f9d8806f3a0 2023-09-30T22:28:31.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.244+0000 7f9d86d9d700 1 --2- 172.21.15.40:0/20915435 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d88139380 0x7f9d88095d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:31.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.244+0000 7f9d85d9b700 1 --2- 172.21.15.40:0/20915435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d8809fbb0 0x7f9d88138da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:31.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.244+0000 7f9d8659c700 1 --2- 172.21.15.40:0/20915435 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d8806f3a0 0x7f9d88138860 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9d7800c480 tx=0x7f9d7800c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:31.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.245+0000 7f9d76ffd700 1 -- 172.21.15.40:0/20915435 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d78005d70 con 0x7f9d8806f3a0 2023-09-30T22:28:31.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.245+0000 7f9d76ffd700 1 -- 172.21.15.40:0/20915435 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d780070d0 con 0x7f9d8806f3a0 2023-09-30T22:28:31.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.245+0000 7f9d8c9e4700 1 -- 172.21.15.40:0/20915435 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d7c0094a0 con 0x7f9d8806f3a0 2023-09-30T22:28:31.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.245+0000 7f9d76ffd700 1 -- 172.21.15.40:0/20915435 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d78007440 con 0x7f9d8806f3a0 2023-09-30T22:28:31.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.245+0000 7f9d8c9e4700 1 -- 172.21.15.40:0/20915435 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d88071eb0 con 0x7f9d8806f3a0 2023-09-30T22:28:31.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.246+0000 7f9d8c9e4700 1 -- 172.21.15.40:0/20915435 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d88094d20 con 0x7f9d8806f3a0 2023-09-30T22:28:31.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.246+0000 7f9d76ffd700 1 -- 172.21.15.40:0/20915435 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d780075a0 con 0x7f9d8806f3a0 2023-09-30T22:28:31.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.247+0000 7f9d76ffd700 1 -- 172.21.15.40:0/20915435 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9d7803eb80 con 0x7f9d8806f3a0 2023-09-30T22:28:31.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.251+0000 7f9d76ffd700 1 -- 172.21.15.40:0/20915435 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d88094d20 con 0x7f9d8806f3a0 2023-09-30T22:28:31.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.369+0000 7f7350735700 1 -- 172.21.15.40:0/1323468613 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7348062380 con 0x7f734809d920 2023-09-30T22:28:31.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.369+0000 7f733effd700 1 -- 172.21.15.40:0/1323468613 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f734402a090 con 0x7f734809d920 2023-09-30T22:28:31.370 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:31.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.371+0000 7f7350735700 1 -- 172.21.15.40:0/1323468613 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f734809d920 msgr2=0x7f734811e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:31.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.371+0000 7f7350735700 1 --2- 172.21.15.40:0/1323468613 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f734809d920 0x7f734811e420 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f734400ebe0 tx=0x7f734400eef0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.371+0000 7f7350735700 1 -- 172.21.15.40:0/1323468613 shutdown_connections 2023-09-30T22:28:31.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.371+0000 7f7350735700 1 --2- 172.21.15.40:0/1323468613 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f734809d920 0x7f734811e420 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.371+0000 7f7350735700 1 --2- 172.21.15.40:0/1323468613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7348131810 0x7f734811eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.371+0000 7f7350735700 1 --2- 172.21.15.40:0/1323468613 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7348133ca0 0x7f734811e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.371+0000 7f7350735700 1 -- 172.21.15.40:0/1323468613 >> 172.21.15.40:0/1323468613 conn(0x7f734809fb20 msgr2=0x7f7348133510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:31.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.371+0000 7f7350735700 1 -- 172.21.15.40:0/1323468613 shutdown_connections 2023-09-30T22:28:31.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.371+0000 7f7350735700 1 -- 172.21.15.40:0/1323468613 wait complete. 2023-09-30T22:28:31.384 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:31.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.406+0000 7fcacbf66700 1 -- 172.21.15.40:0/1614781197 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcac4062380 con 0x7fcac409bc50 2023-09-30T22:28:31.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.406+0000 7fcaba7fc700 1 -- 172.21.15.40:0/1614781197 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcac0016340 con 0x7fcac409bc50 2023-09-30T22:28:31.407 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:31.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.408+0000 7fcacbf66700 1 -- 172.21.15.40:0/1614781197 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcac409bc50 msgr2=0x7fcac411aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:31.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.408+0000 7fcacbf66700 1 --2- 172.21.15.40:0/1614781197 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcac409bc50 0x7fcac411aa50 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fcac0012c40 tx=0x7fcac0012f50 comp rx=0 tx=0).stop 2023-09-30T22:28:31.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.409+0000 7fcacbf66700 1 -- 172.21.15.40:0/1614781197 shutdown_connections 2023-09-30T22:28:31.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.409+0000 7fcacbf66700 1 --2- 172.21.15.40:0/1614781197 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcac4131d50 0x7fcac411b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.409+0000 7fcacbf66700 1 --2- 172.21.15.40:0/1614781197 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcac409bc50 0x7fcac411aa50 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.409+0000 7fcacbf66700 1 --2- 172.21.15.40:0/1614781197 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcac409c7d0 0x7fcac411af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.409+0000 7fcacbf66700 1 -- 172.21.15.40:0/1614781197 >> 172.21.15.40:0/1614781197 conn(0x7fcac40a2a00 msgr2=0x7fcac40a2230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:31.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.409+0000 7fcacbf66700 1 -- 172.21.15.40:0/1614781197 shutdown_connections 2023-09-30T22:28:31.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.409+0000 7fcacbf66700 1 -- 172.21.15.40:0/1614781197 wait complete. 2023-09-30T22:28:31.421 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:31.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.446+0000 7f9d8c9e4700 1 -- 172.21.15.40:0/20915435 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9d88094d20 con 0x7f9d8806f3a0 2023-09-30T22:28:31.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.446+0000 7f9d76ffd700 1 -- 172.21.15.40:0/20915435 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9d88094d20 con 0x7f9d8806f3a0 2023-09-30T22:28:31.447 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:31.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.449+0000 7f9d8c9e4700 1 -- 172.21.15.40:0/20915435 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d8806f3a0 msgr2=0x7f9d88138860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:31.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.449+0000 7f9d8c9e4700 1 --2- 172.21.15.40:0/20915435 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d8806f3a0 0x7f9d88138860 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9d7800c480 tx=0x7f9d7800c790 comp rx=0 tx=0).stop 2023-09-30T22:28:31.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.449+0000 7f9d8c9e4700 1 -- 172.21.15.40:0/20915435 shutdown_connections 2023-09-30T22:28:31.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.449+0000 7f9d8c9e4700 1 --2- 172.21.15.40:0/20915435 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d88139380 0x7f9d88095d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.449+0000 7f9d8c9e4700 1 --2- 172.21.15.40:0/20915435 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d8806f3a0 0x7f9d88138860 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.449+0000 7f9d8c9e4700 1 --2- 172.21.15.40:0/20915435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d8809fbb0 0x7f9d88138da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.449+0000 7f9d8c9e4700 1 -- 172.21.15.40:0/20915435 >> 172.21.15.40:0/20915435 conn(0x7f9d880a41a0 msgr2=0x7f9d8809a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:31.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.449+0000 7f9d8c9e4700 1 -- 172.21.15.40:0/20915435 shutdown_connections 2023-09-30T22:28:31.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.449+0000 7f9d8c9e4700 1 -- 172.21.15.40:0/20915435 wait complete. 2023-09-30T22:28:31.461 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:31.783 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:31.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.912+0000 7f5db7667700 1 Processor -- start 2023-09-30T22:28:31.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.912+0000 7f5db7667700 1 -- start start 2023-09-30T22:28:31.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.913+0000 7f5db7667700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5db009c890 0x7f5db009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:31.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.913+0000 7f5db7667700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5db009d920 0x7f5db009dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:31.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.913+0000 7f5db7667700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5db00a2600 con 0x7f5db009e2b0 2023-09-30T22:28:31.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.913+0000 7f5db7667700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5db00a29d0 con 0x7f5db009d920 2023-09-30T22:28:31.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.913+0000 7f5db7667700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db009fb40 con 0x7f5db009c890 2023-09-30T22:28:31.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.913+0000 7f5db5c04700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5db009e2b0 0x7f5db013ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46476/0 (socket says 172.21.15.40:46476) 2023-09-30T22:28:31.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.913+0000 7f5db5c04700 1 -- 172.21.15.40:0/1245927246 learned_addr learned my addr 172.21.15.40:0/1245927246 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:31.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.913+0000 7f5db4c02700 1 --2- 172.21.15.40:0/1245927246 >> v2:172.21.15.40:3300/0 conn(0x7f5db009d920 0x7f5db009dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:31.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.913+0000 7f5db5403700 1 --2- 172.21.15.40:0/1245927246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5db009c890 0x7f5db009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:31.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.913+0000 7f5da7fff700 1 -- 172.21.15.40:0/1245927246 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1770998833 0 0) 0x7f5db00a2600 con 0x7f5db009e2b0 2023-09-30T22:28:31.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.913+0000 7f5da7fff700 1 -- 172.21.15.40:0/1245927246 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d9c0035b0 con 0x7f5db009e2b0 2023-09-30T22:28:31.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.913+0000 7f5db4c02700 1 -- 172.21.15.40:0/1245927246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5db009c890 msgr2=0x7f5db009cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:31.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.913+0000 7f5db4c02700 1 --2- 172.21.15.40:0/1245927246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5db009c890 0x7f5db009cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.913+0000 7f5db4c02700 1 -- 172.21.15.40:0/1245927246 >> v1:172.21.15.40:6789/0 conn(0x7f5db009e2b0 legacy=0x7f5db013ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:31.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.913+0000 7f5db4c02700 1 -- 172.21.15.40:0/1245927246 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db009e750 con 0x7f5db009d920 2023-09-30T22:28:31.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.913+0000 7f5db5403700 1 --2- 172.21.15.40:0/1245927246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5db009c890 0x7f5db009cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:31.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.914+0000 7f5db4c02700 1 --2- 172.21.15.40:0/1245927246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5db009d920 0x7f5db009dd70 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f5da0009840 tx=0x7f5da0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=398e83d710a9df7c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:31.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.914+0000 7f5da7fff700 1 -- 172.21.15.40:0/1245927246 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da0011830 con 0x7f5db009d920 2023-09-30T22:28:31.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.914+0000 7f5da7fff700 1 -- 172.21.15.40:0/1245927246 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da0011990 con 0x7f5db009d920 2023-09-30T22:28:31.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.914+0000 7f5da7fff700 1 -- 172.21.15.40:0/1245927246 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da0011d20 con 0x7f5db009d920 2023-09-30T22:28:31.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.914+0000 7f5db7667700 1 -- 172.21.15.40:0/1245927246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5db009d920 msgr2=0x7f5db009dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:31.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.914+0000 7f5db7667700 1 --2- 172.21.15.40:0/1245927246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5db009d920 0x7f5db009dd70 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f5da0009840 tx=0x7f5da0009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:31.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.914+0000 7f5db7667700 1 -- 172.21.15.40:0/1245927246 shutdown_connections 2023-09-30T22:28:31.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.914+0000 7f5db7667700 1 --2- 172.21.15.40:0/1245927246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5db009c890 0x7f5db009cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.914+0000 7f5db7667700 1 --2- 172.21.15.40:0/1245927246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5db009d920 0x7f5db009dd70 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.914+0000 7f5db7667700 1 -- 172.21.15.40:0/1245927246 >> 172.21.15.40:0/1245927246 conn(0x7f5db00a7080 msgr2=0x7f5db00a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:31.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.915+0000 7f5db7667700 1 -- 172.21.15.40:0/1245927246 shutdown_connections 2023-09-30T22:28:31.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.915+0000 7f5db7667700 1 -- 172.21.15.40:0/1245927246 wait complete. 2023-09-30T22:28:31.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.915+0000 7f5db7667700 1 Processor -- start 2023-09-30T22:28:31.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.916+0000 7f5db7667700 1 -- start start 2023-09-30T22:28:31.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.916+0000 7f5db7667700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5db009c890 0x7f5db012b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:31.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.916+0000 7f5db7667700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5db009d920 0x7f5db012ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:31.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.916+0000 7f5db7667700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5db009e2b0 0x7f5db012bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:31.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.916+0000 7f5db7667700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db012e3f0 con 0x7f5db009e2b0 2023-09-30T22:28:31.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.916+0000 7f5db7667700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db012e5d0 con 0x7f5db009d920 2023-09-30T22:28:31.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.916+0000 7f5db7667700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5db009ecf0 con 0x7f5db009c890 2023-09-30T22:28:31.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.916+0000 7f5db4c02700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5db009d920 0x7f5db012ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:31.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.916+0000 7f5db5c04700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5db009e2b0 0x7f5db012bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:31.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.916+0000 7f5db4c02700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5db009d920 0x7f5db012ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54486/0 (socket says 172.21.15.40:54486) 2023-09-30T22:28:31.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.916+0000 7f5db4c02700 1 -- 172.21.15.40:0/1217464136 learned_addr learned my addr 172.21.15.40:0/1217464136 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:31.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.916+0000 7f5db5403700 1 --2- 172.21.15.40:0/1217464136 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5db009c890 0x7f5db012b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:31.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.916+0000 7f5db4c02700 1 -- 172.21.15.40:0/1217464136 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5db009c890 msgr2=0x7f5db012b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:31.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.916+0000 7f5db4c02700 1 --2- 172.21.15.40:0/1217464136 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5db009c890 0x7f5db012b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.916+0000 7f5db4c02700 1 -- 172.21.15.40:0/1217464136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5db009e2b0 msgr2=0x7f5db012bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:31.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.916+0000 7f5db4c02700 1 --2- 172.21.15.40:0/1217464136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5db009e2b0 0x7f5db012bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.916+0000 7f5db4c02700 1 -- 172.21.15.40:0/1217464136 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dac009440 con 0x7f5db009d920 2023-09-30T22:28:31.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.916+0000 7f5db5c04700 1 --2- 172.21.15.40:0/1217464136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5db009e2b0 0x7f5db012bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:31.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.917+0000 7f5db4c02700 1 --2- 172.21.15.40:0/1217464136 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5db009d920 0x7f5db012ba20 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5da00090b0 tx=0x7f5da0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:31.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.917+0000 7f5da5ffb700 1 -- 172.21.15.40:0/1217464136 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da0004380 con 0x7f5db009d920 2023-09-30T22:28:31.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.917+0000 7f5da5ffb700 1 -- 172.21.15.40:0/1217464136 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da001f070 con 0x7f5db009d920 2023-09-30T22:28:31.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.917+0000 7f5db7667700 1 -- 172.21.15.40:0/1217464136 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da00094a0 con 0x7f5db009d920 2023-09-30T22:28:31.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.917+0000 7f5da5ffb700 1 -- 172.21.15.40:0/1217464136 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da00036a0 con 0x7f5db009d920 2023-09-30T22:28:31.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.917+0000 7f5db7667700 1 -- 172.21.15.40:0/1217464136 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5db012f230 con 0x7f5db009d920 2023-09-30T22:28:31.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.918+0000 7f5da5ffb700 1 -- 172.21.15.40:0/1217464136 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5da0021030 con 0x7f5db009d920 2023-09-30T22:28:31.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.918+0000 7f5da5ffb700 1 -- 172.21.15.40:0/1217464136 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5da0040870 con 0x7f5db009d920 2023-09-30T22:28:31.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.918+0000 7f5db7667700 1 -- 172.21.15.40:0/1217464136 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5db006e600 con 0x7f5db009d920 2023-09-30T22:28:31.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:31.923+0000 7f5da5ffb700 1 -- 172.21.15.40:0/1217464136 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5da00239c0 con 0x7f5db009d920 2023-09-30T22:28:32.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.115+0000 7f5db7667700 1 -- 172.21.15.40:0/1217464136 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5db012db70 con 0x7f5db009d920 2023-09-30T22:28:32.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.115+0000 7f5da5ffb700 1 -- 172.21.15.40:0/1217464136 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5da0015030 con 0x7f5db009d920 2023-09-30T22:28:32.116 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:32.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.117+0000 7f5db7667700 1 -- 172.21.15.40:0/1217464136 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5db009d920 msgr2=0x7f5db012ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:32.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.117+0000 7f5db7667700 1 --2- 172.21.15.40:0/1217464136 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5db009d920 0x7f5db012ba20 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5da00090b0 tx=0x7f5da0004750 comp rx=0 tx=0).stop 2023-09-30T22:28:32.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.118+0000 7f5db7667700 1 -- 172.21.15.40:0/1217464136 shutdown_connections 2023-09-30T22:28:32.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.118+0000 7f5db7667700 1 --2- 172.21.15.40:0/1217464136 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5db009c890 0x7f5db012b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.118+0000 7f5db7667700 1 --2- 172.21.15.40:0/1217464136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5db009e2b0 0x7f5db012bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.118+0000 7f5db7667700 1 --2- 172.21.15.40:0/1217464136 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5db009d920 0x7f5db012ba20 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.118+0000 7f5db7667700 1 -- 172.21.15.40:0/1217464136 >> 172.21.15.40:0/1217464136 conn(0x7f5db00a7080 msgr2=0x7f5db01bafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:32.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.118+0000 7f5db7667700 1 -- 172.21.15.40:0/1217464136 shutdown_connections 2023-09-30T22:28:32.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.118+0000 7f5db7667700 1 -- 172.21.15.40:0/1217464136 wait complete. 2023-09-30T22:28:32.131 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:32.385 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:32.422 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:32.462 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:32.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.518+0000 7f62d9b74700 1 Processor -- start 2023-09-30T22:28:32.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.518+0000 7f62d9b74700 1 -- start start 2023-09-30T22:28:32.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.518+0000 7f62d9b74700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62d409d920 0x7f62d409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.518+0000 7f62d9b74700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f62d409f0f0 0x7f62d409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.518+0000 7f62d9b74700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62d4133ca0 0x7f62d4134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.518+0000 7f62d9b74700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62d406b4c0 con 0x7f62d409f0f0 2023-09-30T22:28:32.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.518+0000 7f62d9b74700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d409a8f0 con 0x7f62d4133ca0 2023-09-30T22:28:32.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.518+0000 7f62d9b74700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62d409f940 con 0x7f62d409d920 2023-09-30T22:28:32.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.519+0000 7f62d2ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f62d409f0f0 0x7f62d409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.519+0000 7f62d37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62d409d920 0x7f62d409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.519+0000 7f62d2ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f62d409f0f0 0x7f62d409e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36068/0 (socket says 172.21.15.40:36068) 2023-09-30T22:28:32.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.519+0000 7f62d37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62d409d920 0x7f62d409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55920/0 (socket says 172.21.15.40:55920) 2023-09-30T22:28:32.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.519+0000 7f62d2ffd700 1 -- 172.21.15.40:0/1348861063 learned_addr learned my addr 172.21.15.40:0/1348861063 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:32.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.519+0000 7f62d3fff700 1 --2- 172.21.15.40:0/1348861063 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62d4133ca0 0x7f62d4134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.519+0000 7f62d3fff700 1 -- 172.21.15.40:0/1348861063 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62d409d920 msgr2=0x7f62d409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:32.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.519+0000 7f62d3fff700 1 --2- 172.21.15.40:0/1348861063 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62d409d920 0x7f62d409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.519+0000 7f62d3fff700 1 -- 172.21.15.40:0/1348861063 >> v2:172.21.15.40:3300/0 conn(0x7f62d409f0f0 msgr2=0x7f62d409e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:32.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.519+0000 7f62d3fff700 1 --2- 172.21.15.40:0/1348861063 >> v2:172.21.15.40:3300/0 conn(0x7f62d409f0f0 0x7f62d409e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.519+0000 7f62d3fff700 1 -- 172.21.15.40:0/1348861063 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d409f6e0 con 0x7f62d4133ca0 2023-09-30T22:28:32.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.519+0000 7f62d2ffd700 1 --2- 172.21.15.40:0/1348861063 >> v2:172.21.15.40:3300/0 conn(0x7f62d409f0f0 0x7f62d409e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:32.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.519+0000 7f62d37fe700 1 --2- 172.21.15.40:0/1348861063 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62d409d920 0x7f62d409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:32.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.519+0000 7f62d3fff700 1 --2- 172.21.15.40:0/1348861063 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62d4133ca0 0x7f62d4134140 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f62cc009df0 tx=0x7f62cc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2a10f658d732eda server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:32.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.519+0000 7f62d27fc700 1 -- 172.21.15.40:0/1348861063 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62cc00e070 con 0x7f62d4133ca0 2023-09-30T22:28:32.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.519+0000 7f62d27fc700 1 -- 172.21.15.40:0/1348861063 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62cc00baa0 con 0x7f62d4133ca0 2023-09-30T22:28:32.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.519+0000 7f62d27fc700 1 -- 172.21.15.40:0/1348861063 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62cc00be50 con 0x7f62d4133ca0 2023-09-30T22:28:32.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.520+0000 7f62d9b74700 1 -- 172.21.15.40:0/1348861063 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62d4133ca0 msgr2=0x7f62d4134140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:32.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.520+0000 7f62d9b74700 1 --2- 172.21.15.40:0/1348861063 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62d4133ca0 0x7f62d4134140 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f62cc009df0 tx=0x7f62cc00b330 comp rx=0 tx=0).stop 2023-09-30T22:28:32.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.520+0000 7f62d9b74700 1 -- 172.21.15.40:0/1348861063 shutdown_connections 2023-09-30T22:28:32.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.520+0000 7f62d9b74700 1 --2- 172.21.15.40:0/1348861063 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62d409d920 0x7f62d409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.520+0000 7f62d9b74700 1 --2- 172.21.15.40:0/1348861063 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62d4133ca0 0x7f62d4134140 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.520+0000 7f62d9b74700 1 --2- 172.21.15.40:0/1348861063 >> v2:172.21.15.40:3300/0 conn(0x7f62d409f0f0 0x7f62d409e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.520+0000 7f62d9b74700 1 -- 172.21.15.40:0/1348861063 >> 172.21.15.40:0/1348861063 conn(0x7f62d409fb20 msgr2=0x7f62d409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:32.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.520+0000 7f62d9b74700 1 -- 172.21.15.40:0/1348861063 shutdown_connections 2023-09-30T22:28:32.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.520+0000 7f62d9b74700 1 -- 172.21.15.40:0/1348861063 wait complete. 2023-09-30T22:28:32.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.521+0000 7f62d9b74700 1 Processor -- start 2023-09-30T22:28:32.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.521+0000 7f62d9b74700 1 -- start start 2023-09-30T22:28:32.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.522+0000 7f62d9b74700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62d409d920 0x7f62d41218e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.522+0000 7f62d9b74700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62d4133ca0 0x7f62d4121e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.522+0000 7f62d9b74700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62d4122360 0x7f62d41c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.522+0000 7f62d9b74700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d4124e10 con 0x7f62d4133ca0 2023-09-30T22:28:32.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.522+0000 7f62d9b74700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d41251b0 con 0x7f62d4122360 2023-09-30T22:28:32.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.522+0000 7f62d9b74700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62d4123540 con 0x7f62d409d920 2023-09-30T22:28:32.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.522+0000 7f62d2ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62d4133ca0 0x7f62d4121e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.522+0000 7f62d2ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62d4133ca0 0x7f62d4121e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36084/0 (socket says 172.21.15.40:36084) 2023-09-30T22:28:32.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.522+0000 7f62d2ffd700 1 -- 172.21.15.40:0/1750656066 learned_addr learned my addr 172.21.15.40:0/1750656066 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:32.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.522+0000 7f62d37fe700 1 --2- 172.21.15.40:0/1750656066 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62d409d920 0x7f62d41218e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.522+0000 7f62d3fff700 1 --2- 172.21.15.40:0/1750656066 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62d4122360 0x7f62d41c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.522+0000 7f62d2ffd700 1 -- 172.21.15.40:0/1750656066 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62d409d920 msgr2=0x7f62d41218e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:32.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.522+0000 7f62d2ffd700 1 --2- 172.21.15.40:0/1750656066 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62d409d920 0x7f62d41218e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.522+0000 7f62d2ffd700 1 -- 172.21.15.40:0/1750656066 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62d4122360 msgr2=0x7f62d41c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:32.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.522+0000 7f62d2ffd700 1 --2- 172.21.15.40:0/1750656066 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62d4122360 0x7f62d41c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.522+0000 7f62d2ffd700 1 -- 172.21.15.40:0/1750656066 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c4009430 con 0x7f62d4133ca0 2023-09-30T22:28:32.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.522+0000 7f62d2ffd700 1 --2- 172.21.15.40:0/1750656066 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62d4133ca0 0x7f62d4121e20 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f62c800ebb0 tx=0x7f62c800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:32.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.523+0000 7f62bbfff700 1 -- 172.21.15.40:0/1750656066 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c800c850 con 0x7f62d4133ca0 2023-09-30T22:28:32.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.523+0000 7f62bbfff700 1 -- 172.21.15.40:0/1750656066 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c800c9b0 con 0x7f62d4133ca0 2023-09-30T22:28:32.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.523+0000 7f62d9b74700 1 -- 172.21.15.40:0/1750656066 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c8009550 con 0x7f62d4133ca0 2023-09-30T22:28:32.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.523+0000 7f62bbfff700 1 -- 172.21.15.40:0/1750656066 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c800cd60 con 0x7f62d4133ca0 2023-09-30T22:28:32.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.523+0000 7f62d9b74700 1 -- 172.21.15.40:0/1750656066 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62cc009a70 con 0x7f62d4133ca0 2023-09-30T22:28:32.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.523+0000 7f62bbfff700 1 -- 172.21.15.40:0/1750656066 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f62c8013470 con 0x7f62d4133ca0 2023-09-30T22:28:32.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.524+0000 7f62bbfff700 1 -- 172.21.15.40:0/1750656066 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f62c803f860 con 0x7f62d4133ca0 2023-09-30T22:28:32.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.524+0000 7f62d9b74700 1 -- 172.21.15.40:0/1750656066 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62d409ca40 con 0x7f62d4133ca0 2023-09-30T22:28:32.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.529+0000 7f62bbfff700 1 -- 172.21.15.40:0/1750656066 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f62c80232f0 con 0x7f62d4133ca0 2023-09-30T22:28:32.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.580+0000 7fd552ca2700 1 Processor -- start 2023-09-30T22:28:32.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.580+0000 7fd552ca2700 1 -- start start 2023-09-30T22:28:32.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.580+0000 7fd552ca2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd54c09fbb0 0x7fd54c06c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.580+0000 7fd552ca2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd54c06ced0 0x7fd54c06d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.580+0000 7fd552ca2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd54c06e3f0 con 0x7fd54c138370 2023-09-30T22:28:32.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.580+0000 7fd552ca2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd54c09ff80 con 0x7fd54c09fbb0 2023-09-30T22:28:32.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.580+0000 7fd552ca2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c06ec40 con 0x7fd54c06ced0 2023-09-30T22:28:32.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.580+0000 7fd54bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd54c06ced0 0x7fd54c06d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.580+0000 7fd54bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd54c06ced0 0x7fd54c06d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54504/0 (socket says 172.21.15.40:54504) 2023-09-30T22:28:32.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.580+0000 7fd54bfff700 1 -- 172.21.15.40:0/3562976030 learned_addr learned my addr 172.21.15.40:0/3562976030 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:32.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.580+0000 7fd550a3e700 1 --2- 172.21.15.40:0/3562976030 >> v2:172.21.15.40:3300/0 conn(0x7fd54c09fbb0 0x7fd54c06c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.581+0000 7fd54bfff700 1 -- 172.21.15.40:0/3562976030 >> v2:172.21.15.40:3300/0 conn(0x7fd54c09fbb0 msgr2=0x7fd54c06c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:32.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.581+0000 7fd54bfff700 1 --2- 172.21.15.40:0/3562976030 >> v2:172.21.15.40:3300/0 conn(0x7fd54c09fbb0 0x7fd54c06c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.581+0000 7fd54bfff700 1 -- 172.21.15.40:0/3562976030 >> v1:172.21.15.40:6789/0 conn(0x7fd54c138370 legacy=0x7fd54c13a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:32.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.581+0000 7fd54bfff700 1 -- 172.21.15.40:0/3562976030 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54c097ed0 con 0x7fd54c06ced0 2023-09-30T22:28:32.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.581+0000 7fd54bfff700 1 --2- 172.21.15.40:0/3562976030 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd54c06ced0 0x7fd54c06d2e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd5380098f0 tx=0x7fd538009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb9f88175ec53188 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:32.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.581+0000 7fd54b7fe700 1 -- 172.21.15.40:0/3562976030 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53800b8a0 con 0x7fd54c06ced0 2023-09-30T22:28:32.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.581+0000 7fd54b7fe700 1 -- 172.21.15.40:0/3562976030 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53800ba00 con 0x7fd54c06ced0 2023-09-30T22:28:32.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.581+0000 7fd54b7fe700 1 -- 172.21.15.40:0/3562976030 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53800bd90 con 0x7fd54c06ced0 2023-09-30T22:28:32.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.582+0000 7fd552ca2700 1 -- 172.21.15.40:0/3562976030 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd54c06ced0 msgr2=0x7fd54c06d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:32.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.582+0000 7fd552ca2700 1 --2- 172.21.15.40:0/3562976030 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd54c06ced0 0x7fd54c06d2e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd5380098f0 tx=0x7fd538009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:32.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.582+0000 7fd552ca2700 1 -- 172.21.15.40:0/3562976030 shutdown_connections 2023-09-30T22:28:32.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.582+0000 7fd552ca2700 1 --2- 172.21.15.40:0/3562976030 >> v2:172.21.15.40:3300/0 conn(0x7fd54c09fbb0 0x7fd54c06c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.582+0000 7fd552ca2700 1 --2- 172.21.15.40:0/3562976030 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd54c06ced0 0x7fd54c06d2e0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.582+0000 7fd552ca2700 1 -- 172.21.15.40:0/3562976030 >> 172.21.15.40:0/3562976030 conn(0x7fd54c0a41a0 msgr2=0x7fd54c0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:32.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.582+0000 7fd552ca2700 1 -- 172.21.15.40:0/3562976030 shutdown_connections 2023-09-30T22:28:32.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.582+0000 7fd552ca2700 1 -- 172.21.15.40:0/3562976030 wait complete. 2023-09-30T22:28:32.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.583+0000 7fd552ca2700 1 Processor -- start 2023-09-30T22:28:32.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.583+0000 7fd552ca2700 1 -- start start 2023-09-30T22:28:32.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.584+0000 7fd552ca2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd54c06ced0 0x7fd54c1378e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.584+0000 7fd552ca2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd54c09fbb0 0x7fd54c137e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.584+0000 7fd552ca2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd54c138370 0x7fd54c095cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.584+0000 7fd552ca2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c096df0 con 0x7fd54c06ced0 2023-09-30T22:28:32.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.584+0000 7fd552ca2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c09f410 con 0x7fd54c138370 2023-09-30T22:28:32.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.584+0000 7fd552ca2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c071db0 con 0x7fd54c09fbb0 2023-09-30T22:28:32.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.584+0000 7fd55123f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd54c138370 0x7fd54c095cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.584+0000 7fd550a3e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd54c06ced0 0x7fd54c1378e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.584+0000 7fd55123f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd54c138370 0x7fd54c095cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54516/0 (socket says 172.21.15.40:54516) 2023-09-30T22:28:32.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.584+0000 7fd55123f700 1 -- 172.21.15.40:0/3886240676 learned_addr learned my addr 172.21.15.40:0/3886240676 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:32.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.584+0000 7fd54bfff700 1 --2- 172.21.15.40:0/3886240676 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd54c09fbb0 0x7fd54c137e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.585+0000 7fd550a3e700 1 -- 172.21.15.40:0/3886240676 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd54c09fbb0 msgr2=0x7fd54c137e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:32.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.585+0000 7fd550a3e700 1 --2- 172.21.15.40:0/3886240676 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd54c09fbb0 0x7fd54c137e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.585+0000 7fd550a3e700 1 -- 172.21.15.40:0/3886240676 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd54c138370 msgr2=0x7fd54c095cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:32.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.585+0000 7fd550a3e700 1 --2- 172.21.15.40:0/3886240676 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd54c138370 0x7fd54c095cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.585+0000 7fd550a3e700 1 -- 172.21.15.40:0/3886240676 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd538009550 con 0x7fd54c06ced0 2023-09-30T22:28:32.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.585+0000 7fd55123f700 1 --2- 172.21.15.40:0/3886240676 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd54c138370 0x7fd54c095cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:32.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.585+0000 7fd550a3e700 1 --2- 172.21.15.40:0/3886240676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd54c06ced0 0x7fd54c1378e0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fd54000e7e0 tx=0x7fd54000eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:32.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.585+0000 7fd5497fa700 1 -- 172.21.15.40:0/3886240676 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54000c070 con 0x7fd54c06ced0 2023-09-30T22:28:32.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.585+0000 7fd5497fa700 1 -- 172.21.15.40:0/3886240676 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd540013610 con 0x7fd54c06ced0 2023-09-30T22:28:32.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.585+0000 7fd552ca2700 1 -- 172.21.15.40:0/3886240676 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd54c094b30 con 0x7fd54c06ced0 2023-09-30T22:28:32.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.585+0000 7fd5497fa700 1 -- 172.21.15.40:0/3886240676 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5400139a0 con 0x7fd54c06ced0 2023-09-30T22:28:32.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.585+0000 7fd552ca2700 1 -- 172.21.15.40:0/3886240676 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd54c0950d0 con 0x7fd54c06ced0 2023-09-30T22:28:32.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.586+0000 7fd552ca2700 1 -- 172.21.15.40:0/3886240676 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd54c062380 con 0x7fd54c06ced0 2023-09-30T22:28:32.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.586+0000 7fd5497fa700 1 -- 172.21.15.40:0/3886240676 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd540013b00 con 0x7fd54c06ced0 2023-09-30T22:28:32.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.586+0000 7fd5497fa700 1 -- 172.21.15.40:0/3886240676 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd54003f4c0 con 0x7fd54c06ced0 2023-09-30T22:28:32.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.591+0000 7fd5497fa700 1 -- 172.21.15.40:0/3886240676 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd540010900 con 0x7fd54c06ced0 2023-09-30T22:28:32.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.613+0000 7f5e13890700 1 Processor -- start 2023-09-30T22:28:32.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.613+0000 7f5e13890700 1 -- start start 2023-09-30T22:28:32.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.614+0000 7f5e13890700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e0c09c890 0x7f5e0c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.614+0000 7f5e13890700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e0c09d920 0x7f5e0c09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.614+0000 7f5e13890700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e0c0a2600 con 0x7f5e0c09e2b0 2023-09-30T22:28:32.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.614+0000 7f5e13890700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c0a29d0 con 0x7f5e0c09c890 2023-09-30T22:28:32.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.614+0000 7f5e13890700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c09fb40 con 0x7f5e0c09d920 2023-09-30T22:28:32.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.614+0000 7f5e10e2b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e0c09d920 0x7f5e0c09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.614+0000 7f5e11e2d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5e0c09e2b0 0x7f5e0c13ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46490/0 (socket says 172.21.15.40:46490) 2023-09-30T22:28:32.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.614+0000 7f5e10e2b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e0c09d920 0x7f5e0c09dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55958/0 (socket says 172.21.15.40:55958) 2023-09-30T22:28:32.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.614+0000 7f5e11e2d700 1 -- 172.21.15.40:0/3445681290 learned_addr learned my addr 172.21.15.40:0/3445681290 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:32.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.614+0000 7f5e1162c700 1 --2- 172.21.15.40:0/3445681290 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e0c09c890 0x7f5e0c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.614+0000 7f5e10e2b700 1 -- 172.21.15.40:0/3445681290 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e0c09c890 msgr2=0x7f5e0c09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:32.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.614+0000 7f5e10e2b700 1 --2- 172.21.15.40:0/3445681290 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e0c09c890 0x7f5e0c09cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.614+0000 7f5e10e2b700 1 -- 172.21.15.40:0/3445681290 >> v1:172.21.15.40:6789/0 conn(0x7f5e0c09e2b0 legacy=0x7f5e0c13ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:32.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.614+0000 7f5e03fff700 1 -- 172.21.15.40:0/3445681290 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2760012371 0 0) 0x7f5e0c0a2600 con 0x7f5e0c09e2b0 2023-09-30T22:28:32.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.614+0000 7f5e10e2b700 1 -- 172.21.15.40:0/3445681290 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e0c09e720 con 0x7f5e0c09d920 2023-09-30T22:28:32.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.614+0000 7f5e1162c700 1 --2- 172.21.15.40:0/3445681290 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e0c09c890 0x7f5e0c09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:32.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.615+0000 7f5e10e2b700 1 --2- 172.21.15.40:0/3445681290 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e0c09d920 0x7f5e0c09dd70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc009870 tx=0x7f5dfc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=985ead15fdf2b232 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:32.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.615+0000 7f5e03fff700 1 -- 172.21.15.40:0/3445681290 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc011830 con 0x7f5e0c09d920 2023-09-30T22:28:32.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.615+0000 7f5e03fff700 1 -- 172.21.15.40:0/3445681290 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dfc011990 con 0x7f5e0c09d920 2023-09-30T22:28:32.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.615+0000 7f5e03fff700 1 -- 172.21.15.40:0/3445681290 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc011d20 con 0x7f5e0c09d920 2023-09-30T22:28:32.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.615+0000 7f5e13890700 1 -- 172.21.15.40:0/3445681290 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e0c09d920 msgr2=0x7f5e0c09dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:32.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.615+0000 7f5e13890700 1 --2- 172.21.15.40:0/3445681290 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e0c09d920 0x7f5e0c09dd70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc009870 tx=0x7f5dfc009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:32.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.615+0000 7f5e13890700 1 -- 172.21.15.40:0/3445681290 shutdown_connections 2023-09-30T22:28:32.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.615+0000 7f5e13890700 1 --2- 172.21.15.40:0/3445681290 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e0c09c890 0x7f5e0c09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.615+0000 7f5e13890700 1 --2- 172.21.15.40:0/3445681290 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e0c09d920 0x7f5e0c09dd70 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.615+0000 7f5e13890700 1 -- 172.21.15.40:0/3445681290 >> 172.21.15.40:0/3445681290 conn(0x7f5e0c0a7080 msgr2=0x7f5e0c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:32.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.616+0000 7f5e13890700 1 -- 172.21.15.40:0/3445681290 shutdown_connections 2023-09-30T22:28:32.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.616+0000 7f5e13890700 1 -- 172.21.15.40:0/3445681290 wait complete. 2023-09-30T22:28:32.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.617+0000 7f5e13890700 1 Processor -- start 2023-09-30T22:28:32.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.617+0000 7f5e13890700 1 -- start start 2023-09-30T22:28:32.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.618+0000 7f5e13890700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e0c09c890 0x7f5e0c12d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.618+0000 7f5e13890700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e0c09d920 0x7f5e0c12d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.618+0000 7f5e13890700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e0c09e2b0 0x7f5e0c12dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.618+0000 7f5e13890700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c12fb40 con 0x7f5e0c09c890 2023-09-30T22:28:32.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.618+0000 7f5e13890700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c0a5b20 con 0x7f5e0c09e2b0 2023-09-30T22:28:32.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.618+0000 7f5e13890700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c130330 con 0x7f5e0c09d920 2023-09-30T22:28:32.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.618+0000 7f5e1162c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e0c09c890 0x7f5e0c12d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.618+0000 7f5e1162c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e0c09c890 0x7f5e0c12d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36114/0 (socket says 172.21.15.40:36114) 2023-09-30T22:28:32.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.618+0000 7f5e1162c700 1 -- 172.21.15.40:0/2769022193 learned_addr learned my addr 172.21.15.40:0/2769022193 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:32.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.618+0000 7f5e10e2b700 1 --2- 172.21.15.40:0/2769022193 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e0c09d920 0x7f5e0c12d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.618+0000 7f5e11e2d700 1 --2- 172.21.15.40:0/2769022193 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e0c09e2b0 0x7f5e0c12dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.618+0000 7f5e10e2b700 1 -- 172.21.15.40:0/2769022193 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e0c09e2b0 msgr2=0x7f5e0c12dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:32.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.618+0000 7f5e10e2b700 1 --2- 172.21.15.40:0/2769022193 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e0c09e2b0 0x7f5e0c12dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.618+0000 7f5e10e2b700 1 -- 172.21.15.40:0/2769022193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e0c09c890 msgr2=0x7f5e0c12d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:32.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.618+0000 7f5e10e2b700 1 --2- 172.21.15.40:0/2769022193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e0c09c890 0x7f5e0c12d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.618+0000 7f5e10e2b700 1 -- 172.21.15.40:0/2769022193 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e08009430 con 0x7f5e0c09d920 2023-09-30T22:28:32.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.618+0000 7f5e1162c700 1 --2- 172.21.15.40:0/2769022193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e0c09c890 0x7f5e0c12d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:32.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.618+0000 7f5e10e2b700 1 --2- 172.21.15.40:0/2769022193 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e0c09d920 0x7f5e0c12d6f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc016000 tx=0x7f5dfc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:32.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.619+0000 7f5e01ffb700 1 -- 172.21.15.40:0/2769022193 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc004510 con 0x7f5e0c09d920 2023-09-30T22:28:32.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.619+0000 7f5e01ffb700 1 -- 172.21.15.40:0/2769022193 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dfc01f070 con 0x7f5e0c09d920 2023-09-30T22:28:32.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.619+0000 7f5e13890700 1 -- 172.21.15.40:0/2769022193 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dfc0094a0 con 0x7f5e0c09d920 2023-09-30T22:28:32.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.619+0000 7f5e01ffb700 1 -- 172.21.15.40:0/2769022193 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc0038e0 con 0x7f5e0c09d920 2023-09-30T22:28:32.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.619+0000 7f5e13890700 1 -- 172.21.15.40:0/2769022193 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e0c09c1c0 con 0x7f5e0c09d920 2023-09-30T22:28:32.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.620+0000 7f5e01ffb700 1 -- 172.21.15.40:0/2769022193 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5dfc003a40 con 0x7f5e0c09d920 2023-09-30T22:28:32.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.620+0000 7f5e01ffb700 1 -- 172.21.15.40:0/2769022193 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5dfc021070 con 0x7f5e0c09d920 2023-09-30T22:28:32.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.620+0000 7f5e13890700 1 -- 172.21.15.40:0/2769022193 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e0c070610 con 0x7f5e0c09d920 2023-09-30T22:28:32.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.625+0000 7f5e01ffb700 1 -- 172.21.15.40:0/2769022193 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5dfc015070 con 0x7f5e0c09d920 2023-09-30T22:28:32.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.769+0000 7f62d9b74700 1 -- 172.21.15.40:0/1750656066 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f62d409e730 con 0x7f62d4133ca0 2023-09-30T22:28:32.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.769+0000 7f62bbfff700 1 -- 172.21.15.40:0/1750656066 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f62c8021020 con 0x7f62d4133ca0 2023-09-30T22:28:32.770 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:32.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.772+0000 7f62d9b74700 1 -- 172.21.15.40:0/1750656066 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62d4133ca0 msgr2=0x7f62d4121e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:32.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.772+0000 7f62d9b74700 1 --2- 172.21.15.40:0/1750656066 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62d4133ca0 0x7f62d4121e20 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f62c800ebb0 tx=0x7f62c800eec0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.772+0000 7f62d9b74700 1 -- 172.21.15.40:0/1750656066 shutdown_connections 2023-09-30T22:28:32.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.772+0000 7f62d9b74700 1 --2- 172.21.15.40:0/1750656066 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62d409d920 0x7f62d41218e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.772+0000 7f62d9b74700 1 --2- 172.21.15.40:0/1750656066 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62d4122360 0x7f62d41c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.772+0000 7f62d9b74700 1 --2- 172.21.15.40:0/1750656066 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62d4133ca0 0x7f62d4121e20 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.772+0000 7f62d9b74700 1 -- 172.21.15.40:0/1750656066 >> 172.21.15.40:0/1750656066 conn(0x7f62d409fb20 msgr2=0x7f62d40a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:32.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.772+0000 7f62d9b74700 1 -- 172.21.15.40:0/1750656066 shutdown_connections 2023-09-30T22:28:32.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.772+0000 7f62d9b74700 1 -- 172.21.15.40:0/1750656066 wait complete. 2023-09-30T22:28:32.790 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:32.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.801+0000 7fd552ca2700 1 -- 172.21.15.40:0/3886240676 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd54c070bc0 con 0x7fd54c06ced0 2023-09-30T22:28:32.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.801+0000 7fd5497fa700 1 -- 172.21.15.40:0/3886240676 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd540010310 con 0x7fd54c06ced0 2023-09-30T22:28:32.802 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:32.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.803+0000 7fd552ca2700 1 -- 172.21.15.40:0/3886240676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd54c06ced0 msgr2=0x7fd54c1378e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:32.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.803+0000 7fd552ca2700 1 --2- 172.21.15.40:0/3886240676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd54c06ced0 0x7fd54c1378e0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fd54000e7e0 tx=0x7fd54000eaf0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.803+0000 7fd552ca2700 1 -- 172.21.15.40:0/3886240676 shutdown_connections 2023-09-30T22:28:32.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.803+0000 7fd552ca2700 1 --2- 172.21.15.40:0/3886240676 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd54c138370 0x7fd54c095cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.803+0000 7fd552ca2700 1 --2- 172.21.15.40:0/3886240676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd54c06ced0 0x7fd54c1378e0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.803+0000 7fd552ca2700 1 --2- 172.21.15.40:0/3886240676 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd54c09fbb0 0x7fd54c137e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.803+0000 7fd552ca2700 1 -- 172.21.15.40:0/3886240676 >> 172.21.15.40:0/3886240676 conn(0x7fd54c0a41a0 msgr2=0x7fd54c09a070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:32.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.803+0000 7fd552ca2700 1 -- 172.21.15.40:0/3886240676 shutdown_connections 2023-09-30T22:28:32.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.803+0000 7fd552ca2700 1 -- 172.21.15.40:0/3886240676 wait complete. 2023-09-30T22:28:32.816 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:32.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.850+0000 7f5e13890700 1 -- 172.21.15.40:0/2769022193 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5e0c062380 con 0x7f5e0c09d920 2023-09-30T22:28:32.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.850+0000 7f5e01ffb700 1 -- 172.21.15.40:0/2769022193 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5dfc02b020 con 0x7f5e0c09d920 2023-09-30T22:28:32.851 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:32.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.852+0000 7f5e13890700 1 -- 172.21.15.40:0/2769022193 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e0c09d920 msgr2=0x7f5e0c12d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:32.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.852+0000 7f5e13890700 1 --2- 172.21.15.40:0/2769022193 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e0c09d920 0x7f5e0c12d6f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc016000 tx=0x7f5dfc004750 comp rx=0 tx=0).stop 2023-09-30T22:28:32.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.852+0000 7f5e13890700 1 -- 172.21.15.40:0/2769022193 shutdown_connections 2023-09-30T22:28:32.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.852+0000 7f5e13890700 1 --2- 172.21.15.40:0/2769022193 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e0c09e2b0 0x7f5e0c12dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.852+0000 7f5e13890700 1 --2- 172.21.15.40:0/2769022193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e0c09c890 0x7f5e0c12d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.852+0000 7f5e13890700 1 --2- 172.21.15.40:0/2769022193 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e0c09d920 0x7f5e0c12d6f0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.852+0000 7f5e13890700 1 -- 172.21.15.40:0/2769022193 >> 172.21.15.40:0/2769022193 conn(0x7f5e0c0a7080 msgr2=0x7f5e0c133280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:32.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.852+0000 7f5e13890700 1 -- 172.21.15.40:0/2769022193 shutdown_connections 2023-09-30T22:28:32.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:32.852+0000 7f5e13890700 1 -- 172.21.15.40:0/2769022193 wait complete. 2023-09-30T22:28:32.865 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:33.131 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:33.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.257+0000 7f2601f5c700 1 Processor -- start 2023-09-30T22:28:33.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.257+0000 7f2601f5c700 1 -- start start 2023-09-30T22:28:33.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.258+0000 7f2601f5c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f25fc09c890 0x7f25fc09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.258+0000 7f2601f5c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f25fc09e480 0x7f25fc13bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.258+0000 7f2601f5c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25fc0a2600 con 0x7f25fc09d920 2023-09-30T22:28:33.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.258+0000 7f2601f5c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25fc0a29d0 con 0x7f25fc09c890 2023-09-30T22:28:33.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.258+0000 7f2601f5c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25fc09fb40 con 0x7f25fc09e480 2023-09-30T22:28:33.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.258+0000 7f25fb7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f25fc09c890 0x7f25fc09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.258+0000 7f25fbfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f25fc09e480 0x7f25fc13bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.258+0000 7f25faffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f25fc09d920 0x7f25fc09dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38796/0 (socket says 172.21.15.40:38796) 2023-09-30T22:28:33.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.258+0000 7f25faffd700 1 -- 172.21.15.40:0/48146894 learned_addr learned my addr 172.21.15.40:0/48146894 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:33.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.258+0000 7f25fb7fe700 1 -- 172.21.15.40:0/48146894 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f25fc09e480 msgr2=0x7f25fc13bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:33.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.258+0000 7f25fb7fe700 1 --2- 172.21.15.40:0/48146894 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f25fc09e480 0x7f25fc13bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.258+0000 7f25fb7fe700 1 -- 172.21.15.40:0/48146894 >> v1:172.21.15.40:6789/0 conn(0x7f25fc09d920 legacy=0x7f25fc09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:33.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.258+0000 7f25fa7fc700 1 -- 172.21.15.40:0/48146894 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3995625970 0 0) 0x7f25fc0a2600 con 0x7f25fc09d920 2023-09-30T22:28:33.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.258+0000 7f25fb7fe700 1 -- 172.21.15.40:0/48146894 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25fc09fed0 con 0x7f25fc09c890 2023-09-30T22:28:33.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.258+0000 7f25fbfff700 1 --2- 172.21.15.40:0/48146894 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f25fc09e480 0x7f25fc13bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:33.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.258+0000 7f25fb7fe700 1 --2- 172.21.15.40:0/48146894 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f25fc09c890 0x7f25fc09cc60 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f25ec009850 tx=0x7f25ec009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=487b602a15e09b16 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:33.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.258+0000 7f25fa7fc700 1 -- 172.21.15.40:0/48146894 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ec005e30 con 0x7f25fc09c890 2023-09-30T22:28:33.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.258+0000 7f25fa7fc700 1 -- 172.21.15.40:0/48146894 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ec006030 con 0x7f25fc09c890 2023-09-30T22:28:33.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.259+0000 7f25fa7fc700 1 -- 172.21.15.40:0/48146894 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ec0063e0 con 0x7f25fc09c890 2023-09-30T22:28:33.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.259+0000 7f2601f5c700 1 -- 172.21.15.40:0/48146894 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f25fc09c890 msgr2=0x7f25fc09cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:33.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.259+0000 7f2601f5c700 1 --2- 172.21.15.40:0/48146894 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f25fc09c890 0x7f25fc09cc60 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f25ec009850 tx=0x7f25ec009b60 comp rx=0 tx=0).stop 2023-09-30T22:28:33.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.259+0000 7f2601f5c700 1 -- 172.21.15.40:0/48146894 shutdown_connections 2023-09-30T22:28:33.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.259+0000 7f2601f5c700 1 --2- 172.21.15.40:0/48146894 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f25fc09e480 0x7f25fc13bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.259+0000 7f2601f5c700 1 --2- 172.21.15.40:0/48146894 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f25fc09c890 0x7f25fc09cc60 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.259+0000 7f2601f5c700 1 -- 172.21.15.40:0/48146894 >> 172.21.15.40:0/48146894 conn(0x7f25fc0a7080 msgr2=0x7f25fc0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:33.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.259+0000 7f2601f5c700 1 -- 172.21.15.40:0/48146894 shutdown_connections 2023-09-30T22:28:33.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.259+0000 7f2601f5c700 1 -- 172.21.15.40:0/48146894 wait complete. 2023-09-30T22:28:33.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.260+0000 7f2601f5c700 1 Processor -- start 2023-09-30T22:28:33.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.260+0000 7f2601f5c700 1 -- start start 2023-09-30T22:28:33.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.260+0000 7f2601f5c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f25fc09c890 0x7f25fc1ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.260+0000 7f2601f5c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25fc09d920 0x7f25fc1cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.261+0000 7f2601f5c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f25fc09e480 0x7f25fc08afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.261+0000 7f2601f5c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25fc08e2b0 con 0x7f25fc09d920 2023-09-30T22:28:33.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.261+0000 7f2601f5c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25fc08d5c0 con 0x7f25fc09c890 2023-09-30T22:28:33.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.261+0000 7f2601f5c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25fc08e490 con 0x7f25fc09e480 2023-09-30T22:28:33.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.261+0000 7f25fb7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f25fc09c890 0x7f25fc1ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.261+0000 7f25fbfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f25fc09e480 0x7f25fc08afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.261+0000 7f25fb7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f25fc09c890 0x7f25fc1ccc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:46780/0 (socket says 172.21.15.40:46780) 2023-09-30T22:28:33.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.261+0000 7f25fb7fe700 1 -- 172.21.15.40:0/3908266006 learned_addr learned my addr 172.21.15.40:0/3908266006 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:33.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.261+0000 7f25faffd700 1 --2- 172.21.15.40:0/3908266006 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25fc09d920 0x7f25fc1cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.261+0000 7f25fb7fe700 1 -- 172.21.15.40:0/3908266006 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f25fc09e480 msgr2=0x7f25fc08afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:33.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.261+0000 7f25fb7fe700 1 --2- 172.21.15.40:0/3908266006 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f25fc09e480 0x7f25fc08afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.261+0000 7f25fb7fe700 1 -- 172.21.15.40:0/3908266006 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25fc09d920 msgr2=0x7f25fc1cd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:33.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.261+0000 7f25fb7fe700 1 --2- 172.21.15.40:0/3908266006 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25fc09d920 0x7f25fc1cd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.261+0000 7f25fb7fe700 1 -- 172.21.15.40:0/3908266006 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f4009a70 con 0x7f25fc09c890 2023-09-30T22:28:33.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.261+0000 7f25fb7fe700 1 --2- 172.21.15.40:0/3908266006 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f25fc09c890 0x7f25fc1ccc90 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f25ec013040 tx=0x7f25ec004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:33.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.261+0000 7f25f3fff700 1 -- 172.21.15.40:0/3908266006 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ec004040 con 0x7f25fc09c890 2023-09-30T22:28:33.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.261+0000 7f25f3fff700 1 -- 172.21.15.40:0/3908266006 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ec0041c0 con 0x7f25fc09c890 2023-09-30T22:28:33.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.261+0000 7f2601f5c700 1 -- 172.21.15.40:0/3908266006 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25ec009430 con 0x7f25fc09c890 2023-09-30T22:28:33.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.261+0000 7f25f3fff700 1 -- 172.21.15.40:0/3908266006 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ec004570 con 0x7f25fc09c890 2023-09-30T22:28:33.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.261+0000 7f2601f5c700 1 -- 172.21.15.40:0/3908266006 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25fc09ecf0 con 0x7f25fc09c890 2023-09-30T22:28:33.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.262+0000 7f25f3fff700 1 -- 172.21.15.40:0/3908266006 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f25ec022070 con 0x7f25fc09c890 2023-09-30T22:28:33.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.262+0000 7f25f3fff700 1 -- 172.21.15.40:0/3908266006 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f25ec040dc0 con 0x7f25fc09c890 2023-09-30T22:28:33.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.262+0000 7f2601f5c700 1 -- 172.21.15.40:0/3908266006 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25fc09c0f0 con 0x7f25fc09c890 2023-09-30T22:28:33.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.267+0000 7f25f3fff700 1 -- 172.21.15.40:0/3908266006 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25ec0199a0 con 0x7f25fc09c890 2023-09-30T22:28:33.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.465+0000 7f2601f5c700 1 -- 172.21.15.40:0/3908266006 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f25fc062380 con 0x7f25fc09c890 2023-09-30T22:28:33.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.466+0000 7f25f3fff700 1 -- 172.21.15.40:0/3908266006 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f25ec0193b0 con 0x7f25fc09c890 2023-09-30T22:28:33.467 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:33.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.468+0000 7f2601f5c700 1 -- 172.21.15.40:0/3908266006 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f25fc09c890 msgr2=0x7f25fc1ccc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:33.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.468+0000 7f2601f5c700 1 --2- 172.21.15.40:0/3908266006 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f25fc09c890 0x7f25fc1ccc90 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f25ec013040 tx=0x7f25ec004750 comp rx=0 tx=0).stop 2023-09-30T22:28:33.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.468+0000 7f2601f5c700 1 -- 172.21.15.40:0/3908266006 shutdown_connections 2023-09-30T22:28:33.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.468+0000 7f2601f5c700 1 --2- 172.21.15.40:0/3908266006 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f25fc09e480 0x7f25fc08afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.468+0000 7f2601f5c700 1 --2- 172.21.15.40:0/3908266006 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f25fc09c890 0x7f25fc1ccc90 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.468+0000 7f2601f5c700 1 --2- 172.21.15.40:0/3908266006 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25fc09d920 0x7f25fc1cd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.468+0000 7f2601f5c700 1 -- 172.21.15.40:0/3908266006 >> 172.21.15.40:0/3908266006 conn(0x7f25fc0a7080 msgr2=0x7f25fc0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:33.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.468+0000 7f2601f5c700 1 -- 172.21.15.40:0/3908266006 shutdown_connections 2023-09-30T22:28:33.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.468+0000 7f2601f5c700 1 -- 172.21.15.40:0/3908266006 wait complete. 2023-09-30T22:28:33.481 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:33.791 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:33.818 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:33.866 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:33.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.922+0000 7fafaca5c700 1 Processor -- start 2023-09-30T22:28:33.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.922+0000 7fafaca5c700 1 -- start start 2023-09-30T22:28:33.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.923+0000 7fafaca5c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fafa806f070 0x7fafa806f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.923+0000 7fafaca5c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafa806f980 0x7fafa8097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.923+0000 7fafaca5c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafa806fdb0 0x7fafa80975d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.923+0000 7fafaca5c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa8070830 con 0x7fafa806f070 2023-09-30T22:28:33.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.923+0000 7fafaca5c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa8070ad0 con 0x7fafa806f980 2023-09-30T22:28:33.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.923+0000 7fafaca5c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fafa8070de0 con 0x7fafa806fdb0 2023-09-30T22:28:33.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.923+0000 7fafa659c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fafa806f070 0x7fafa806f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.923+0000 7fafa6d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafa806fdb0 0x7fafa80975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.923+0000 7fafa659c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fafa806f070 0x7fafa806f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40296/0 (socket says 172.21.15.40:40296) 2023-09-30T22:28:33.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.923+0000 7fafa659c700 1 -- 172.21.15.40:0/2056929383 learned_addr learned my addr 172.21.15.40:0/2056929383 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:33.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.923+0000 7fafa5d9b700 1 --2- 172.21.15.40:0/2056929383 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafa806f980 0x7fafa8097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.923+0000 7fafa659c700 1 -- 172.21.15.40:0/2056929383 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafa806fdb0 msgr2=0x7fafa80975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:33.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.923+0000 7fafa659c700 1 --2- 172.21.15.40:0/2056929383 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafa806fdb0 0x7fafa80975d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.923+0000 7fafa659c700 1 -- 172.21.15.40:0/2056929383 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafa806f980 msgr2=0x7fafa8097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:33.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.923+0000 7fafa659c700 1 --2- 172.21.15.40:0/2056929383 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafa806f980 0x7fafa8097090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.924+0000 7fafa659c700 1 -- 172.21.15.40:0/2056929383 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa809fe20 con 0x7fafa806f070 2023-09-30T22:28:33.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.924+0000 7fafa6d9d700 1 --2- 172.21.15.40:0/2056929383 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafa806fdb0 0x7fafa80975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:33.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.924+0000 7fafa659c700 1 --2- 172.21.15.40:0/2056929383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafa806f070 0x7fafa806f440 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7faf980098f0 tx=0x7faf98009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f1063485dc1083 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:33.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.924+0000 7fafa559a700 1 -- 172.21.15.40:0/2056929383 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf98011830 con 0x7fafa806f070 2023-09-30T22:28:33.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.924+0000 7fafa559a700 1 -- 172.21.15.40:0/2056929383 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf98011990 con 0x7fafa806f070 2023-09-30T22:28:33.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.924+0000 7fafa559a700 1 -- 172.21.15.40:0/2056929383 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf98011d20 con 0x7fafa806f070 2023-09-30T22:28:33.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.925+0000 7fafaca5c700 1 -- 172.21.15.40:0/2056929383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafa806f070 msgr2=0x7fafa806f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:33.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.925+0000 7fafaca5c700 1 --2- 172.21.15.40:0/2056929383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafa806f070 0x7fafa806f440 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7faf980098f0 tx=0x7faf98009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:33.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.925+0000 7fafaca5c700 1 -- 172.21.15.40:0/2056929383 shutdown_connections 2023-09-30T22:28:33.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.925+0000 7fafaca5c700 1 --2- 172.21.15.40:0/2056929383 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafa806fdb0 0x7fafa80975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.925+0000 7fafaca5c700 1 --2- 172.21.15.40:0/2056929383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafa806f070 0x7fafa806f440 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.925+0000 7fafaca5c700 1 --2- 172.21.15.40:0/2056929383 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafa806f980 0x7fafa8097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.925+0000 7fafaca5c700 1 -- 172.21.15.40:0/2056929383 >> 172.21.15.40:0/2056929383 conn(0x7fafa80a41a0 msgr2=0x7fafa80a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:33.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.925+0000 7fafaca5c700 1 -- 172.21.15.40:0/2056929383 shutdown_connections 2023-09-30T22:28:33.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.925+0000 7fafaca5c700 1 -- 172.21.15.40:0/2056929383 wait complete. 2023-09-30T22:28:33.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.926+0000 7fafaca5c700 1 Processor -- start 2023-09-30T22:28:33.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.926+0000 7fafaca5c700 1 -- start start 2023-09-30T22:28:33.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.927+0000 7fafaca5c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafa806f070 0x7fafa812d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.927+0000 7fafaca5c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafa806f980 0x7fafa812d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.927+0000 7fafaca5c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafa806fdb0 0x7fafa812dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.927+0000 7fafaca5c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa81323d0 con 0x7fafa806f070 2023-09-30T22:28:33.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.927+0000 7fafaca5c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa81308f0 con 0x7fafa806fdb0 2023-09-30T22:28:33.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.927+0000 7fafaca5c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fafa81292a0 con 0x7fafa806f980 2023-09-30T22:28:33.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.927+0000 7fafa659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafa806f070 0x7fafa812d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.927+0000 7fafa659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafa806f070 0x7fafa812d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40312/0 (socket says 172.21.15.40:40312) 2023-09-30T22:28:33.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.927+0000 7fafa659c700 1 -- 172.21.15.40:0/1327343932 learned_addr learned my addr 172.21.15.40:0/1327343932 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:33.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.927+0000 7fafa5d9b700 1 --2- 172.21.15.40:0/1327343932 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafa806f980 0x7fafa812d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.927+0000 7fafa6d9d700 1 --2- 172.21.15.40:0/1327343932 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafa806fdb0 0x7fafa812dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.928+0000 7fafa659c700 1 -- 172.21.15.40:0/1327343932 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafa806f980 msgr2=0x7fafa812d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:33.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.928+0000 7fafa659c700 1 --2- 172.21.15.40:0/1327343932 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafa806f980 0x7fafa812d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.928+0000 7fafa659c700 1 -- 172.21.15.40:0/1327343932 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafa806fdb0 msgr2=0x7fafa812dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:33.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.928+0000 7fafa659c700 1 --2- 172.21.15.40:0/1327343932 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafa806fdb0 0x7fafa812dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.928+0000 7fafa659c700 1 -- 172.21.15.40:0/1327343932 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa0009a70 con 0x7fafa806f070 2023-09-30T22:28:33.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.928+0000 7fafa659c700 1 --2- 172.21.15.40:0/1327343932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafa806f070 0x7fafa812d190 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7faf98000c00 tx=0x7faf98004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:33.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.928+0000 7faf96ffd700 1 -- 172.21.15.40:0/1327343932 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf98004240 con 0x7fafa806f070 2023-09-30T22:28:33.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.928+0000 7faf96ffd700 1 -- 172.21.15.40:0/1327343932 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9801f070 con 0x7fafa806f070 2023-09-30T22:28:33.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.928+0000 7faf96ffd700 1 -- 172.21.15.40:0/1327343932 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf980045e0 con 0x7fafa806f070 2023-09-30T22:28:33.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.928+0000 7fafaca5c700 1 -- 172.21.15.40:0/1327343932 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf98009550 con 0x7fafa806f070 2023-09-30T22:28:33.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.928+0000 7fafaca5c700 1 -- 172.21.15.40:0/1327343932 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa81317b0 con 0x7fafa806f070 2023-09-30T22:28:33.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.929+0000 7faf96ffd700 1 -- 172.21.15.40:0/1327343932 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faf98021030 con 0x7fafa806f070 2023-09-30T22:28:33.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.929+0000 7faf96ffd700 1 -- 172.21.15.40:0/1327343932 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7faf98040a00 con 0x7fafa806f070 2023-09-30T22:28:33.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.929+0000 7fafaca5c700 1 -- 172.21.15.40:0/1327343932 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafa8062380 con 0x7fafa806f070 2023-09-30T22:28:33.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.934+0000 7faf96ffd700 1 -- 172.21.15.40:0/1327343932 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faf9801a450 con 0x7fafa806f070 2023-09-30T22:28:33.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.974+0000 7f8367ee1700 1 Processor -- start 2023-09-30T22:28:33.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.974+0000 7f8367ee1700 1 -- start start 2023-09-30T22:28:33.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.974+0000 7f8367ee1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f836006a6d0 0x7f836006aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.974+0000 7f8367ee1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f836006afe0 0x7f83601318b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.974+0000 7f8367ee1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f836009eb50 con 0x7f8360131df0 2023-09-30T22:28:33.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.974+0000 7f8367ee1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836009dde0 con 0x7f836006a6d0 2023-09-30T22:28:33.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.974+0000 7f8367ee1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f836009d4a0 con 0x7f836006afe0 2023-09-30T22:28:33.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.975+0000 7f836647e700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8360131df0 0x7f8360138b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38798/0 (socket says 172.21.15.40:38798) 2023-09-30T22:28:33.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.975+0000 7f836547c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f836006afe0 0x7f83601318b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.975+0000 7f8365c7d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f836006a6d0 0x7f836006aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.975+0000 7f836647e700 1 -- 172.21.15.40:0/1359849390 learned_addr learned my addr 172.21.15.40:0/1359849390 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:33.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.975+0000 7f8364c7b700 1 -- 172.21.15.40:0/1359849390 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1002233059 0 0) 0x7f836009eb50 con 0x7f8360131df0 2023-09-30T22:28:33.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.975+0000 7f8365c7d700 1 -- 172.21.15.40:0/1359849390 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f836006afe0 msgr2=0x7f83601318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:33.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.975+0000 7f8365c7d700 1 --2- 172.21.15.40:0/1359849390 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f836006afe0 0x7f83601318b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.975+0000 7f8365c7d700 1 -- 172.21.15.40:0/1359849390 >> v1:172.21.15.40:6789/0 conn(0x7f8360131df0 legacy=0x7f8360138b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:33.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.975+0000 7f8365c7d700 1 -- 172.21.15.40:0/1359849390 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836009f5f0 con 0x7f836006a6d0 2023-09-30T22:28:33.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.975+0000 7f8365c7d700 1 --2- 172.21.15.40:0/1359849390 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f836006a6d0 0x7f836006aaa0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f835c009850 tx=0x7f835c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=436331d4bd2d70a5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:33.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.975+0000 7f8364c7b700 1 -- 172.21.15.40:0/1359849390 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c005e30 con 0x7f836006a6d0 2023-09-30T22:28:33.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.975+0000 7f8364c7b700 1 -- 172.21.15.40:0/1359849390 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835c006030 con 0x7f836006a6d0 2023-09-30T22:28:33.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.975+0000 7f8364c7b700 1 -- 172.21.15.40:0/1359849390 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c0063c0 con 0x7f836006a6d0 2023-09-30T22:28:33.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.976+0000 7f8367ee1700 1 -- 172.21.15.40:0/1359849390 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f836006a6d0 msgr2=0x7f836006aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:33.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.976+0000 7f8367ee1700 1 --2- 172.21.15.40:0/1359849390 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f836006a6d0 0x7f836006aaa0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f835c009850 tx=0x7f835c009b60 comp rx=0 tx=0).stop 2023-09-30T22:28:33.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.976+0000 7f8367ee1700 1 -- 172.21.15.40:0/1359849390 shutdown_connections 2023-09-30T22:28:33.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.976+0000 7f8367ee1700 1 --2- 172.21.15.40:0/1359849390 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f836006a6d0 0x7f836006aaa0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.976+0000 7f8367ee1700 1 --2- 172.21.15.40:0/1359849390 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f836006afe0 0x7f83601318b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.976+0000 7f8367ee1700 1 -- 172.21.15.40:0/1359849390 >> 172.21.15.40:0/1359849390 conn(0x7f836009fb20 msgr2=0x7f836009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:33.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.976+0000 7f8367ee1700 1 -- 172.21.15.40:0/1359849390 shutdown_connections 2023-09-30T22:28:33.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.976+0000 7f8367ee1700 1 -- 172.21.15.40:0/1359849390 wait complete. 2023-09-30T22:28:33.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.977+0000 7f8367ee1700 1 Processor -- start 2023-09-30T22:28:33.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.977+0000 7f8367ee1700 1 -- start start 2023-09-30T22:28:33.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.978+0000 7f8367ee1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f836006a6d0 0x7f83601211d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.978+0000 7f8367ee1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f836006afe0 0x7f8360121710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.978+0000 7f8367ee1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8360131df0 0x7f83601c6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.978+0000 7f8367ee1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8360124280 con 0x7f836006a6d0 2023-09-30T22:28:33.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.978+0000 7f8367ee1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8360123ec0 con 0x7f836006afe0 2023-09-30T22:28:33.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.978+0000 7f8367ee1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8360120e00 con 0x7f8360131df0 2023-09-30T22:28:33.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.978+0000 7f836547c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f836006afe0 0x7f8360121710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.978+0000 7f836547c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f836006afe0 0x7f8360121710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:46810/0 (socket says 172.21.15.40:46810) 2023-09-30T22:28:33.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.978+0000 7f836547c700 1 -- 172.21.15.40:0/3739604456 learned_addr learned my addr 172.21.15.40:0/3739604456 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:33.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.978+0000 7f8365c7d700 1 --2- 172.21.15.40:0/3739604456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f836006a6d0 0x7f83601211d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.978+0000 7f836647e700 1 --2- 172.21.15.40:0/3739604456 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8360131df0 0x7f83601c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.979+0000 7f836547c700 1 -- 172.21.15.40:0/3739604456 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8360131df0 msgr2=0x7f83601c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:33.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.979+0000 7f836547c700 1 --2- 172.21.15.40:0/3739604456 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8360131df0 0x7f83601c6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.979+0000 7f836547c700 1 -- 172.21.15.40:0/3739604456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f836006a6d0 msgr2=0x7f83601211d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:33.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.979+0000 7f836547c700 1 --2- 172.21.15.40:0/3739604456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f836006a6d0 0x7f83601211d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.979+0000 7f836547c700 1 -- 172.21.15.40:0/3739604456 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835c009430 con 0x7f836006afe0 2023-09-30T22:28:33.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.979+0000 7f8365c7d700 1 --2- 172.21.15.40:0/3739604456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f836006a6d0 0x7f83601211d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:33.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.979+0000 7f836547c700 1 --2- 172.21.15.40:0/3739604456 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f836006afe0 0x7f8360121710 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f835000e840 tx=0x7f835000eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:33.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.979+0000 7f83567fc700 1 -- 172.21.15.40:0/3739604456 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835000c070 con 0x7f836006afe0 2023-09-30T22:28:33.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.979+0000 7f83567fc700 1 -- 172.21.15.40:0/3739604456 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8350013610 con 0x7f836006afe0 2023-09-30T22:28:33.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.979+0000 7f8367ee1700 1 -- 172.21.15.40:0/3739604456 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8360122b00 con 0x7f836006afe0 2023-09-30T22:28:33.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.979+0000 7f83567fc700 1 -- 172.21.15.40:0/3739604456 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83500139c0 con 0x7f836006afe0 2023-09-30T22:28:33.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.979+0000 7f8367ee1700 1 -- 172.21.15.40:0/3739604456 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83601231c0 con 0x7f836006afe0 2023-09-30T22:28:33.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.980+0000 7f83567fc700 1 -- 172.21.15.40:0/3739604456 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8350013b20 con 0x7f836006afe0 2023-09-30T22:28:33.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.980+0000 7f8367ee1700 1 -- 172.21.15.40:0/3739604456 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83601240c0 con 0x7f836006afe0 2023-09-30T22:28:33.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.980+0000 7f83567fc700 1 -- 172.21.15.40:0/3739604456 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f835003f540 con 0x7f836006afe0 2023-09-30T22:28:33.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:33.987+0000 7f83567fc700 1 -- 172.21.15.40:0/3739604456 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f83601240c0 con 0x7f836006afe0 2023-09-30T22:28:34.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.020+0000 7fefcefd3700 1 Processor -- start 2023-09-30T22:28:34.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.020+0000 7fefcefd3700 1 -- start start 2023-09-30T22:28:34.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.020+0000 7fefcefd3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefc806f070 0x7fefc806f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:34.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.020+0000 7fefcefd3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefc806f980 0x7fefc8097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:34.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.020+0000 7fefcefd3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fefc806fdb0 0x7fefc80975d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:34.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.020+0000 7fefcefd3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefc8071af0 con 0x7fefc806fdb0 2023-09-30T22:28:34.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.020+0000 7fefcefd3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefc8070830 con 0x7fefc806f070 2023-09-30T22:28:34.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.020+0000 7fefcefd3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fefc8070ad0 con 0x7fefc806f980 2023-09-30T22:28:34.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.020+0000 7fefccd6f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefc806f070 0x7fefc806f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:34.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.020+0000 7fefccd6f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefc806f070 0x7fefc806f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:46826/0 (socket says 172.21.15.40:46826) 2023-09-30T22:28:34.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.020+0000 7fefccd6f700 1 -- 172.21.15.40:0/935420841 learned_addr learned my addr 172.21.15.40:0/935420841 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:34.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.020+0000 7fefc7fff700 1 --2- 172.21.15.40:0/935420841 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefc806f980 0x7fefc8097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:34.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.021+0000 7fefcd570700 1 --2- 172.21.15.40:0/935420841 >> v2:172.21.15.40:3300/0 conn(0x7fefc806fdb0 0x7fefc80975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:34.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.021+0000 7fefccd6f700 1 -- 172.21.15.40:0/935420841 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefc806f980 msgr2=0x7fefc8097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:34.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.021+0000 7fefccd6f700 1 --2- 172.21.15.40:0/935420841 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefc806f980 0x7fefc8097090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:34.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.021+0000 7fefccd6f700 1 -- 172.21.15.40:0/935420841 >> v2:172.21.15.40:3300/0 conn(0x7fefc806fdb0 msgr2=0x7fefc80975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:34.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.021+0000 7fefccd6f700 1 --2- 172.21.15.40:0/935420841 >> v2:172.21.15.40:3300/0 conn(0x7fefc806fdb0 0x7fefc80975d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:34.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.021+0000 7fefccd6f700 1 -- 172.21.15.40:0/935420841 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc8070de0 con 0x7fefc806f070 2023-09-30T22:28:34.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.021+0000 7fefccd6f700 1 --2- 172.21.15.40:0/935420841 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefc806f070 0x7fefc806f440 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fefb8009920 tx=0x7fefb8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a62864a6b354a87 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:34.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.021+0000 7fefc77fe700 1 -- 172.21.15.40:0/935420841 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb8011830 con 0x7fefc806f070 2023-09-30T22:28:34.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.021+0000 7fefc77fe700 1 -- 172.21.15.40:0/935420841 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb8011990 con 0x7fefc806f070 2023-09-30T22:28:34.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.021+0000 7fefc77fe700 1 -- 172.21.15.40:0/935420841 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb8011d20 con 0x7fefc806f070 2023-09-30T22:28:34.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.022+0000 7fefcefd3700 1 -- 172.21.15.40:0/935420841 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefc806f070 msgr2=0x7fefc806f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:34.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.022+0000 7fefcefd3700 1 --2- 172.21.15.40:0/935420841 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefc806f070 0x7fefc806f440 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fefb8009920 tx=0x7fefb8009c30 comp rx=0 tx=0).stop 2023-09-30T22:28:34.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.022+0000 7fefcefd3700 1 -- 172.21.15.40:0/935420841 shutdown_connections 2023-09-30T22:28:34.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.022+0000 7fefcefd3700 1 --2- 172.21.15.40:0/935420841 >> v2:172.21.15.40:3300/0 conn(0x7fefc806fdb0 0x7fefc80975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:34.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.022+0000 7fefcefd3700 1 --2- 172.21.15.40:0/935420841 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefc806f070 0x7fefc806f440 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:34.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.022+0000 7fefcefd3700 1 --2- 172.21.15.40:0/935420841 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefc806f980 0x7fefc8097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:34.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.022+0000 7fefcefd3700 1 -- 172.21.15.40:0/935420841 >> 172.21.15.40:0/935420841 conn(0x7fefc80a41a0 msgr2=0x7fefc80a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:34.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.022+0000 7fefcefd3700 1 -- 172.21.15.40:0/935420841 shutdown_connections 2023-09-30T22:28:34.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.022+0000 7fefcefd3700 1 -- 172.21.15.40:0/935420841 wait complete. 2023-09-30T22:28:34.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.023+0000 7fefcefd3700 1 Processor -- start 2023-09-30T22:28:34.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.023+0000 7fefcefd3700 1 -- start start 2023-09-30T22:28:34.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.023+0000 7fefcefd3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefc806f070 0x7fefc812d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:34.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.023+0000 7fefcefd3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefc806f980 0x7fefc812da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:34.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.023+0000 7fefcefd3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefc806fdb0 0x7fefc812dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:34.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.023+0000 7fefcefd3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc81305b0 con 0x7fefc806fdb0 2023-09-30T22:28:34.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.023+0000 7fefcefd3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefc8130950 con 0x7fefc806f070 2023-09-30T22:28:34.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.023+0000 7fefcefd3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fefc812e900 con 0x7fefc806f980 2023-09-30T22:28:34.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.024+0000 7fefc7fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefc806f980 0x7fefc812da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:34.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.024+0000 7fefc7fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefc806f980 0x7fefc812da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:36176/0 (socket says 172.21.15.40:36176) 2023-09-30T22:28:34.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.024+0000 7fefc7fff700 1 -- 172.21.15.40:0/3093543196 learned_addr learned my addr 172.21.15.40:0/3093543196 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:34.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.024+0000 7fefccd6f700 1 --2- 172.21.15.40:0/3093543196 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefc806f070 0x7fefc812d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:34.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.024+0000 7fefcd570700 1 --2- 172.21.15.40:0/3093543196 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefc806fdb0 0x7fefc812dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:34.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.024+0000 7fefc7fff700 1 -- 172.21.15.40:0/3093543196 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefc806f070 msgr2=0x7fefc812d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:34.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.024+0000 7fefc7fff700 1 --2- 172.21.15.40:0/3093543196 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefc806f070 0x7fefc812d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:34.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.024+0000 7fefc7fff700 1 -- 172.21.15.40:0/3093543196 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefc806fdb0 msgr2=0x7fefc812dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:34.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.024+0000 7fefc7fff700 1 --2- 172.21.15.40:0/3093543196 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefc806fdb0 0x7fefc812dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:34.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.024+0000 7fefc7fff700 1 -- 172.21.15.40:0/3093543196 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb8009550 con 0x7fefc806f980 2023-09-30T22:28:34.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.024+0000 7fefccd6f700 1 --2- 172.21.15.40:0/3093543196 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefc806f070 0x7fefc812d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:34.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.024+0000 7fefc7fff700 1 --2- 172.21.15.40:0/3093543196 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefc806f980 0x7fefc812da70 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fefbc00e9e0 tx=0x7fefbc00ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:34.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.024+0000 7fefc57fa700 1 -- 172.21.15.40:0/3093543196 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefbc009710 con 0x7fefc806f980 2023-09-30T22:28:34.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.024+0000 7fefc57fa700 1 -- 172.21.15.40:0/3093543196 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefbc00ee80 con 0x7fefc806f980 2023-09-30T22:28:34.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.024+0000 7fefc57fa700 1 -- 172.21.15.40:0/3093543196 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefbc00c9f0 con 0x7fefc806f980 2023-09-30T22:28:34.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.025+0000 7fefcefd3700 1 -- 172.21.15.40:0/3093543196 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefc8130b50 con 0x7fefc806f980 2023-09-30T22:28:34.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.025+0000 7fefcefd3700 1 -- 172.21.15.40:0/3093543196 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefc812ece0 con 0x7fefc806f980 2023-09-30T22:28:34.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.026+0000 7fefc57fa700 1 -- 172.21.15.40:0/3093543196 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fefbc00cb50 con 0x7fefc806f980 2023-09-30T22:28:34.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.026+0000 7fefc57fa700 1 -- 172.21.15.40:0/3093543196 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fefbc03fb10 con 0x7fefc806f980 2023-09-30T22:28:34.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.026+0000 7fefcefd3700 1 -- 172.21.15.40:0/3093543196 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefc8131730 con 0x7fefc806f980 2023-09-30T22:28:34.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.031+0000 7fefc57fa700 1 -- 172.21.15.40:0/3093543196 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fefbc01b3b0 con 0x7fefc806f980 2023-09-30T22:28:34.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.135+0000 7fafaca5c700 1 -- 172.21.15.40:0/1327343932 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fafa8132540 con 0x7fafa806f070 2023-09-30T22:28:34.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.136+0000 7faf96ffd700 1 -- 172.21.15.40:0/1327343932 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faf9801b430 con 0x7fafa806f070 2023-09-30T22:28:34.137 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:34.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.139+0000 7fafaca5c700 1 -- 172.21.15.40:0/1327343932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafa806f070 msgr2=0x7fafa812d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:34.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.139+0000 7fafaca5c700 1 --2- 172.21.15.40:0/1327343932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafa806f070 0x7fafa812d190 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7faf98000c00 tx=0x7faf98004750 comp rx=0 tx=0).stop 2023-09-30T22:28:34.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.139+0000 7fafaca5c700 1 -- 172.21.15.40:0/1327343932 shutdown_connections 2023-09-30T22:28:34.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.139+0000 7fafaca5c700 1 --2- 172.21.15.40:0/1327343932 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafa806fdb0 0x7fafa812dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:34.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.139+0000 7fafaca5c700 1 --2- 172.21.15.40:0/1327343932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafa806f070 0x7fafa812d190 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:34.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.139+0000 7fafaca5c700 1 --2- 172.21.15.40:0/1327343932 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafa806f980 0x7fafa812d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:34.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.139+0000 7fafaca5c700 1 -- 172.21.15.40:0/1327343932 >> 172.21.15.40:0/1327343932 conn(0x7fafa80a41a0 msgr2=0x7fafa8097330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:34.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.139+0000 7fafaca5c700 1 -- 172.21.15.40:0/1327343932 shutdown_connections 2023-09-30T22:28:34.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.139+0000 7fafaca5c700 1 -- 172.21.15.40:0/1327343932 wait complete. 2023-09-30T22:28:34.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:34.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.187+0000 7f8367ee1700 1 -- 172.21.15.40:0/3739604456 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f83601240c0 con 0x7f836006afe0 2023-09-30T22:28:34.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.187+0000 7f83567fc700 1 -- 172.21.15.40:0/3739604456 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f83500108d0 con 0x7f836006afe0 2023-09-30T22:28:34.189 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:34.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.189+0000 7f8367ee1700 1 -- 172.21.15.40:0/3739604456 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f836006afe0 msgr2=0x7f8360121710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:34.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.189+0000 7f8367ee1700 1 --2- 172.21.15.40:0/3739604456 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f836006afe0 0x7f8360121710 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f835000e840 tx=0x7f835000eb50 comp rx=0 tx=0).stop 2023-09-30T22:28:34.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.189+0000 7f8367ee1700 1 -- 172.21.15.40:0/3739604456 shutdown_connections 2023-09-30T22:28:34.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.189+0000 7f8367ee1700 1 --2- 172.21.15.40:0/3739604456 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8360131df0 0x7f83601c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:34.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.189+0000 7f8367ee1700 1 --2- 172.21.15.40:0/3739604456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f836006a6d0 0x7f83601211d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:34.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.189+0000 7f8367ee1700 1 --2- 172.21.15.40:0/3739604456 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f836006afe0 0x7f8360121710 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:34.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.189+0000 7f8367ee1700 1 -- 172.21.15.40:0/3739604456 >> 172.21.15.40:0/3739604456 conn(0x7f836009fb20 msgr2=0x7f836006f770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:34.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.189+0000 7f8367ee1700 1 -- 172.21.15.40:0/3739604456 shutdown_connections 2023-09-30T22:28:34.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.189+0000 7f8367ee1700 1 -- 172.21.15.40:0/3739604456 wait complete. 2023-09-30T22:28:34.206 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:34.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.244+0000 7fefcefd3700 1 -- 172.21.15.40:0/3093543196 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fefc812c2d0 con 0x7fefc806f980 2023-09-30T22:28:34.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.244+0000 7fefc57fa700 1 -- 172.21.15.40:0/3093543196 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fefbc017030 con 0x7fefc806f980 2023-09-30T22:28:34.245 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:34.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.247+0000 7fefcefd3700 1 -- 172.21.15.40:0/3093543196 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefc806f980 msgr2=0x7fefc812da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:34.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.247+0000 7fefcefd3700 1 --2- 172.21.15.40:0/3093543196 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefc806f980 0x7fefc812da70 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fefbc00e9e0 tx=0x7fefbc00ecf0 comp rx=0 tx=0).stop 2023-09-30T22:28:34.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.247+0000 7fefcefd3700 1 -- 172.21.15.40:0/3093543196 shutdown_connections 2023-09-30T22:28:34.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.247+0000 7fefcefd3700 1 --2- 172.21.15.40:0/3093543196 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefc806fdb0 0x7fefc812dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:34.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.247+0000 7fefcefd3700 1 --2- 172.21.15.40:0/3093543196 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefc806f070 0x7fefc812d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:34.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.247+0000 7fefcefd3700 1 --2- 172.21.15.40:0/3093543196 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefc806f980 0x7fefc812da70 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:34.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.247+0000 7fefcefd3700 1 -- 172.21.15.40:0/3093543196 >> 172.21.15.40:0/3093543196 conn(0x7fefc80a41a0 msgr2=0x7fefc812bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:34.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.247+0000 7fefcefd3700 1 -- 172.21.15.40:0/3093543196 shutdown_connections 2023-09-30T22:28:34.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.247+0000 7fefcefd3700 1 -- 172.21.15.40:0/3093543196 wait complete. 2023-09-30T22:28:34.259 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:34.481 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:34.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.611+0000 7f43164f1700 1 Processor -- start 2023-09-30T22:28:34.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.611+0000 7f43164f1700 1 -- start start 2023-09-30T22:28:34.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.611+0000 7f43164f1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f431009d920 0x7f431009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:34.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.612+0000 7f43164f1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f431009f0f0 0x7f431009e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:34.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.612+0000 7f43164f1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4310133ca0 0x7f4310134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:34.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.612+0000 7f43164f1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f431006b4c0 con 0x7f431009f0f0 2023-09-30T22:28:34.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.612+0000 7f43164f1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f431009a8f0 con 0x7f431009d920 2023-09-30T22:28:34.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.612+0000 7f43164f1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f431009f940 con 0x7f4310133ca0 2023-09-30T22:28:34.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.612+0000 7f430ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f431009d920 0x7f431009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:34.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.612+0000 7f430f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f431009f0f0 0x7f431009e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:34.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.612+0000 7f430ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f431009d920 0x7f431009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:46848/0 (socket says 172.21.15.40:46848) 2023-09-30T22:28:34.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.612+0000 7f430f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f431009f0f0 0x7f431009e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40360/0 (socket says 172.21.15.40:40360) 2023-09-30T22:28:34.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.612+0000 7f430ffff700 1 -- 172.21.15.40:0/2155691678 learned_addr learned my addr 172.21.15.40:0/2155691678 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:34.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.612+0000 7f4314a8e700 1 --2- 172.21.15.40:0/2155691678 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4310133ca0 0x7f4310134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:34.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.612+0000 7f430ffff700 1 -- 172.21.15.40:0/2155691678 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4310133ca0 msgr2=0x7f4310134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:34.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.612+0000 7f430ffff700 1 --2- 172.21.15.40:0/2155691678 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4310133ca0 0x7f4310134140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:34.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.612+0000 7f430ffff700 1 -- 172.21.15.40:0/2155691678 >> v2:172.21.15.40:3300/0 conn(0x7f431009f0f0 msgr2=0x7f431009e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:34.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.612+0000 7f430ffff700 1 --2- 172.21.15.40:0/2155691678 >> v2:172.21.15.40:3300/0 conn(0x7f431009f0f0 0x7f431009e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:34.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.612+0000 7f430ffff700 1 -- 172.21.15.40:0/2155691678 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f431009f6e0 con 0x7f431009d920 2023-09-30T22:28:34.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.612+0000 7f430f7fe700 1 --2- 172.21.15.40:0/2155691678 >> v2:172.21.15.40:3300/0 conn(0x7f431009f0f0 0x7f431009e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:34.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.612+0000 7f430ffff700 1 --2- 172.21.15.40:0/2155691678 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f431009d920 0x7f431009dcf0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4300009920 tx=0x7f4300009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad426d3493182d96 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:34.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.612+0000 7f430effd700 1 -- 172.21.15.40:0/2155691678 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4300005e30 con 0x7f431009d920 2023-09-30T22:28:34.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.612+0000 7f430effd700 1 -- 172.21.15.40:0/2155691678 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4300004030 con 0x7f431009d920 2023-09-30T22:28:34.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.612+0000 7f430effd700 1 -- 172.21.15.40:0/2155691678 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43000043e0 con 0x7f431009d920 2023-09-30T22:28:34.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.613+0000 7f43164f1700 1 -- 172.21.15.40:0/2155691678 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f431009d920 msgr2=0x7f431009dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:34.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.613+0000 7f43164f1700 1 --2- 172.21.15.40:0/2155691678 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f431009d920 0x7f431009dcf0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4300009920 tx=0x7f4300009c30 comp rx=0 tx=0).stop 2023-09-30T22:28:34.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.613+0000 7f43164f1700 1 -- 172.21.15.40:0/2155691678 shutdown_connections 2023-09-30T22:28:34.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.613+0000 7f43164f1700 1 --2- 172.21.15.40:0/2155691678 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4310133ca0 0x7f4310134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:34.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.613+0000 7f43164f1700 1 --2- 172.21.15.40:0/2155691678 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f431009d920 0x7f431009dcf0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:34.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.613+0000 7f43164f1700 1 --2- 172.21.15.40:0/2155691678 >> v2:172.21.15.40:3300/0 conn(0x7f431009f0f0 0x7f431009e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:34.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.613+0000 7f43164f1700 1 -- 172.21.15.40:0/2155691678 >> 172.21.15.40:0/2155691678 conn(0x7f431009fb20 msgr2=0x7f431009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:34.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.613+0000 7f43164f1700 1 -- 172.21.15.40:0/2155691678 shutdown_connections 2023-09-30T22:28:34.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.613+0000 7f43164f1700 1 -- 172.21.15.40:0/2155691678 wait complete. 2023-09-30T22:28:34.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.614+0000 7f43164f1700 1 Processor -- start 2023-09-30T22:28:34.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.614+0000 7f43164f1700 1 -- start start 2023-09-30T22:28:34.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.614+0000 7f43164f1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f431009d920 0x7f43101218e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:34.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.614+0000 7f43164f1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4310133ca0 0x7f4310121e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:34.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.614+0000 7f43164f1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4310122360 0x7f43101c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:34.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.614+0000 7f43164f1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4310125200 con 0x7f4310133ca0 2023-09-30T22:28:34.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.614+0000 7f43164f1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43101234f0 con 0x7f4310122360 2023-09-30T22:28:34.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.614+0000 7f43164f1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f431009c9e0 con 0x7f431009d920 2023-09-30T22:28:34.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.615+0000 7f430ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f431009d920 0x7f43101218e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:34.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.615+0000 7f430f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4310133ca0 0x7f4310121e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:34.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.615+0000 7f430ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f431009d920 0x7f43101218e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:36192/0 (socket says 172.21.15.40:36192) 2023-09-30T22:28:34.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.615+0000 7f430f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4310133ca0 0x7f4310121e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40376/0 (socket says 172.21.15.40:40376) 2023-09-30T22:28:34.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.615+0000 7f430ffff700 1 -- 172.21.15.40:0/3477000580 learned_addr learned my addr 172.21.15.40:0/3477000580 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:34.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.615+0000 7f4314a8e700 1 --2- 172.21.15.40:0/3477000580 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4310122360 0x7f43101c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:34.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.615+0000 7f430f7fe700 1 -- 172.21.15.40:0/3477000580 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f431009d920 msgr2=0x7f43101218e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:34.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.615+0000 7f430f7fe700 1 --2- 172.21.15.40:0/3477000580 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f431009d920 0x7f43101218e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:34.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.615+0000 7f430f7fe700 1 -- 172.21.15.40:0/3477000580 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4310122360 msgr2=0x7f43101c88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:34.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.615+0000 7f430f7fe700 1 --2- 172.21.15.40:0/3477000580 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4310122360 0x7f43101c88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:34.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.615+0000 7f430f7fe700 1 -- 172.21.15.40:0/3477000580 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f80094a0 con 0x7f4310133ca0 2023-09-30T22:28:34.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.615+0000 7f430ffff700 1 --2- 172.21.15.40:0/3477000580 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f431009d920 0x7f43101218e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:34.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.615+0000 7f4314a8e700 1 --2- 172.21.15.40:0/3477000580 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4310122360 0x7f43101c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:34.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.615+0000 7f430f7fe700 1 --2- 172.21.15.40:0/3477000580 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4310133ca0 0x7f4310121e20 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f43100682d0 tx=0x7f42f800ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:34.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.615+0000 7f430cff9700 1 -- 172.21.15.40:0/3477000580 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f8004240 con 0x7f4310133ca0 2023-09-30T22:28:34.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.615+0000 7f430cff9700 1 -- 172.21.15.40:0/3477000580 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f80043a0 con 0x7f4310133ca0 2023-09-30T22:28:34.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.615+0000 7f43164f1700 1 -- 172.21.15.40:0/3477000580 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4300009500 con 0x7f4310133ca0 2023-09-30T22:28:34.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.615+0000 7f430cff9700 1 -- 172.21.15.40:0/3477000580 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f80036a0 con 0x7f4310133ca0 2023-09-30T22:28:34.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.615+0000 7f43164f1700 1 -- 172.21.15.40:0/3477000580 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4310124e60 con 0x7f4310133ca0 2023-09-30T22:28:34.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.616+0000 7f430cff9700 1 -- 172.21.15.40:0/3477000580 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f42f8003800 con 0x7f4310133ca0 2023-09-30T22:28:34.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.616+0000 7f43164f1700 1 -- 172.21.15.40:0/3477000580 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4310132830 con 0x7f4310133ca0 2023-09-30T22:28:34.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.616+0000 7f430cff9700 1 -- 172.21.15.40:0/3477000580 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f42f803f740 con 0x7f4310133ca0 2023-09-30T22:28:34.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.621+0000 7f430cff9700 1 -- 172.21.15.40:0/3477000580 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f42f8013470 con 0x7f4310133ca0 2023-09-30T22:28:34.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.815+0000 7f43164f1700 1 -- 172.21.15.40:0/3477000580 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4310062380 con 0x7f4310133ca0 2023-09-30T22:28:34.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.815+0000 7f430cff9700 1 -- 172.21.15.40:0/3477000580 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f42f801bba0 con 0x7f4310133ca0 2023-09-30T22:28:34.816 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:34.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.817+0000 7f43164f1700 1 -- 172.21.15.40:0/3477000580 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4310133ca0 msgr2=0x7f4310121e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.817+0000 7f43164f1700 1 --2- 172.21.15.40:0/3477000580 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4310133ca0 0x7f4310121e20 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f43100682d0 tx=0x7f42f800ec60 comp rx=0 tx=0).stop 2023-09-30T22:28:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.817+0000 7f43164f1700 1 -- 172.21.15.40:0/3477000580 shutdown_connections 2023-09-30T22:28:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.817+0000 7f43164f1700 1 --2- 172.21.15.40:0/3477000580 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f431009d920 0x7f43101218e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.817+0000 7f43164f1700 1 --2- 172.21.15.40:0/3477000580 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4310122360 0x7f43101c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.817+0000 7f43164f1700 1 --2- 172.21.15.40:0/3477000580 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4310133ca0 0x7f4310121e20 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.817+0000 7f43164f1700 1 -- 172.21.15.40:0/3477000580 >> 172.21.15.40:0/3477000580 conn(0x7f431009fb20 msgr2=0x7f43100a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.817+0000 7f43164f1700 1 -- 172.21.15.40:0/3477000580 shutdown_connections 2023-09-30T22:28:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:34.817+0000 7f43164f1700 1 -- 172.21.15.40:0/3477000580 wait complete. 2023-09-30T22:28:34.830 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:35.157 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:35.208 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:35.260 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:35.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.292+0000 7f8740ec6700 1 Processor -- start 2023-09-30T22:28:35.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.292+0000 7f8740ec6700 1 -- start start 2023-09-30T22:28:35.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.293+0000 7f8740ec6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f873c12e590 0x7f873c12e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.293+0000 7f8740ec6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f873c12eea0 0x7f873c12d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.293+0000 7f8740ec6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f873c12d6d0 0x7f873c12db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.293+0000 7f8740ec6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f873c09ca30 con 0x7f873c12d6d0 2023-09-30T22:28:35.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.293+0000 7f8740ec6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f873c09ab70 con 0x7f873c12eea0 2023-09-30T22:28:35.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.293+0000 7f8740ec6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f873c09bd70 con 0x7f873c12e590 2023-09-30T22:28:35.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.293+0000 7f873a59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f873c12e590 0x7f873c12e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.293+0000 7f8739d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f873c12eea0 0x7f873c12d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.293+0000 7f873a59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f873c12e590 0x7f873c12e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:36194/0 (socket says 172.21.15.40:36194) 2023-09-30T22:28:35.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.293+0000 7f873a59c700 1 -- 172.21.15.40:0/439346819 learned_addr learned my addr 172.21.15.40:0/439346819 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:35.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.293+0000 7f873ad9d700 1 --2- 172.21.15.40:0/439346819 >> v2:172.21.15.40:3300/0 conn(0x7f873c12d6d0 0x7f873c12db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.293+0000 7f873a59c700 1 -- 172.21.15.40:0/439346819 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f873c12eea0 msgr2=0x7f873c12d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:35.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.293+0000 7f873a59c700 1 --2- 172.21.15.40:0/439346819 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f873c12eea0 0x7f873c12d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.293+0000 7f873a59c700 1 -- 172.21.15.40:0/439346819 >> v2:172.21.15.40:3300/0 conn(0x7f873c12d6d0 msgr2=0x7f873c12db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:35.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.293+0000 7f873a59c700 1 --2- 172.21.15.40:0/439346819 >> v2:172.21.15.40:3300/0 conn(0x7f873c12d6d0 0x7f873c12db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.293+0000 7f873a59c700 1 -- 172.21.15.40:0/439346819 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873c09b270 con 0x7f873c12e590 2023-09-30T22:28:35.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.293+0000 7f8739d9b700 1 --2- 172.21.15.40:0/439346819 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f873c12eea0 0x7f873c12d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:35.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.294+0000 7f873a59c700 1 --2- 172.21.15.40:0/439346819 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f873c12e590 0x7f873c12e960 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f872c0098f0 tx=0x7f872c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58441c455e291dba server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:35.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.294+0000 7f873959a700 1 -- 172.21.15.40:0/439346819 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c011830 con 0x7f873c12e590 2023-09-30T22:28:35.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.294+0000 7f873959a700 1 -- 172.21.15.40:0/439346819 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872c011990 con 0x7f873c12e590 2023-09-30T22:28:35.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.294+0000 7f873959a700 1 -- 172.21.15.40:0/439346819 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c011d20 con 0x7f873c12e590 2023-09-30T22:28:35.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.294+0000 7f8740ec6700 1 -- 172.21.15.40:0/439346819 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f873c12e590 msgr2=0x7f873c12e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:35.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.294+0000 7f8740ec6700 1 --2- 172.21.15.40:0/439346819 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f873c12e590 0x7f873c12e960 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f872c0098f0 tx=0x7f872c009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:35.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.295+0000 7f8740ec6700 1 -- 172.21.15.40:0/439346819 shutdown_connections 2023-09-30T22:28:35.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.295+0000 7f8740ec6700 1 --2- 172.21.15.40:0/439346819 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f873c12e590 0x7f873c12e960 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.295+0000 7f8740ec6700 1 --2- 172.21.15.40:0/439346819 >> v2:172.21.15.40:3300/0 conn(0x7f873c12d6d0 0x7f873c12db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.295+0000 7f8740ec6700 1 --2- 172.21.15.40:0/439346819 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f873c12eea0 0x7f873c12d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.295+0000 7f8740ec6700 1 -- 172.21.15.40:0/439346819 >> 172.21.15.40:0/439346819 conn(0x7f873c0a2a00 msgr2=0x7f873c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:35.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.295+0000 7f8740ec6700 1 -- 172.21.15.40:0/439346819 shutdown_connections 2023-09-30T22:28:35.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.295+0000 7f8740ec6700 1 -- 172.21.15.40:0/439346819 wait complete. 2023-09-30T22:28:35.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.296+0000 7f8740ec6700 1 Processor -- start 2023-09-30T22:28:35.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.296+0000 7f8740ec6700 1 -- start start 2023-09-30T22:28:35.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.297+0000 7f8740ec6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f873c12d6d0 0x7f873c11dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.297+0000 7f8740ec6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f873c12e590 0x7f873c11e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.297+0000 7f8740ec6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f873c12eea0 0x7f873c11e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.297+0000 7f8740ec6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873c11fea0 con 0x7f873c12d6d0 2023-09-30T22:28:35.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.297+0000 7f8740ec6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f873c09fcc0 con 0x7f873c12e590 2023-09-30T22:28:35.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.297+0000 7f8740ec6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f873c09b4b0 con 0x7f873c12eea0 2023-09-30T22:28:35.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.297+0000 7f873a59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f873c12d6d0 0x7f873c11dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.297+0000 7f873a59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f873c12d6d0 0x7f873c11dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40382/0 (socket says 172.21.15.40:40382) 2023-09-30T22:28:35.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.297+0000 7f873a59c700 1 -- 172.21.15.40:0/364652873 learned_addr learned my addr 172.21.15.40:0/364652873 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:35.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.297+0000 7f8739d9b700 1 --2- 172.21.15.40:0/364652873 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f873c12e590 0x7f873c11e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.297+0000 7f873ad9d700 1 --2- 172.21.15.40:0/364652873 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f873c12eea0 0x7f873c11e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.297+0000 7f873a59c700 1 -- 172.21.15.40:0/364652873 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f873c12eea0 msgr2=0x7f873c11e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:35.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.297+0000 7f873a59c700 1 --2- 172.21.15.40:0/364652873 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f873c12eea0 0x7f873c11e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.297+0000 7f873a59c700 1 -- 172.21.15.40:0/364652873 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f873c12e590 msgr2=0x7f873c11e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:35.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.297+0000 7f873a59c700 1 --2- 172.21.15.40:0/364652873 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f873c12e590 0x7f873c11e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.297+0000 7f873a59c700 1 -- 172.21.15.40:0/364652873 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87300094a0 con 0x7f873c12d6d0 2023-09-30T22:28:35.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.298+0000 7f8739d9b700 1 --2- 172.21.15.40:0/364652873 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f873c12e590 0x7f873c11e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:35.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.298+0000 7f873a59c700 1 --2- 172.21.15.40:0/364652873 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f873c12d6d0 0x7f873c11dd90 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f872c000c00 tx=0x7f872c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:35.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.298+0000 7f872affd700 1 -- 172.21.15.40:0/364652873 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c004240 con 0x7f873c12d6d0 2023-09-30T22:28:35.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.298+0000 7f872affd700 1 -- 172.21.15.40:0/364652873 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872c01f070 con 0x7f873c12d6d0 2023-09-30T22:28:35.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.298+0000 7f8740ec6700 1 -- 172.21.15.40:0/364652873 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f872c009550 con 0x7f873c12d6d0 2023-09-30T22:28:35.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.298+0000 7f872affd700 1 -- 172.21.15.40:0/364652873 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c0045e0 con 0x7f873c12d6d0 2023-09-30T22:28:35.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.298+0000 7f8740ec6700 1 -- 172.21.15.40:0/364652873 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f873c1218b0 con 0x7f873c12d6d0 2023-09-30T22:28:35.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.299+0000 7f872affd700 1 -- 172.21.15.40:0/364652873 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f872c021030 con 0x7f873c12d6d0 2023-09-30T22:28:35.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.299+0000 7f872affd700 1 -- 172.21.15.40:0/364652873 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f872c040860 con 0x7f873c12d6d0 2023-09-30T22:28:35.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.299+0000 7f8740ec6700 1 -- 172.21.15.40:0/364652873 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f873c062380 con 0x7f873c12d6d0 2023-09-30T22:28:35.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.304+0000 7f872affd700 1 -- 172.21.15.40:0/364652873 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f872c01a450 con 0x7f873c12d6d0 2023-09-30T22:28:35.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.339+0000 7f1fa2ca2700 1 Processor -- start 2023-09-30T22:28:35.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.339+0000 7f1fa2ca2700 1 -- start start 2023-09-30T22:28:35.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.340+0000 7f1fa2ca2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f9c06f070 0x7f1f9c06f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.340+0000 7f1fa2ca2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1f9c06f980 0x7f1f9c097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.340+0000 7f1fa2ca2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f9c06fdb0 0x7f1f9c0975d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.340+0000 7f1fa2ca2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f9c070830 con 0x7f1f9c06f980 2023-09-30T22:28:35.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.340+0000 7f1fa2ca2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9c070ad0 con 0x7f1f9c06fdb0 2023-09-30T22:28:35.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.340+0000 7f1fa2ca2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9c070de0 con 0x7f1f9c06f070 2023-09-30T22:28:35.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.340+0000 7f1f93fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1f9c06f980 0x7f1f9c097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.340+0000 7f1f93fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1f9c06f980 0x7f1f9c097090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40384/0 (socket says 172.21.15.40:40384) 2023-09-30T22:28:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.340+0000 7f1f93fff700 1 -- 172.21.15.40:0/2814076366 learned_addr learned my addr 172.21.15.40:0/2814076366 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.340+0000 7f1fa0a3e700 1 --2- 172.21.15.40:0/2814076366 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f9c06f070 0x7f1f9c06f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.340+0000 7f1fa123f700 1 --2- 172.21.15.40:0/2814076366 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f9c06fdb0 0x7f1f9c0975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.340+0000 7f1fa0a3e700 1 -- 172.21.15.40:0/2814076366 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f9c06fdb0 msgr2=0x7f1f9c0975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.340+0000 7f1fa0a3e700 1 --2- 172.21.15.40:0/2814076366 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f9c06fdb0 0x7f1f9c0975d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.340+0000 7f1fa0a3e700 1 -- 172.21.15.40:0/2814076366 >> v2:172.21.15.40:3300/0 conn(0x7f1f9c06f980 msgr2=0x7f1f9c097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.340+0000 7f1fa0a3e700 1 --2- 172.21.15.40:0/2814076366 >> v2:172.21.15.40:3300/0 conn(0x7f1f9c06f980 0x7f1f9c097090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.340+0000 7f1fa0a3e700 1 -- 172.21.15.40:0/2814076366 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f9c09fe20 con 0x7f1f9c06f070 2023-09-30T22:28:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.340+0000 7f1fa123f700 1 --2- 172.21.15.40:0/2814076366 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f9c06fdb0 0x7f1f9c0975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.340+0000 7f1f93fff700 1 --2- 172.21.15.40:0/2814076366 >> v2:172.21.15.40:3300/0 conn(0x7f1f9c06f980 0x7f1f9c097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.340+0000 7f1fa0a3e700 1 --2- 172.21.15.40:0/2814076366 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f9c06f070 0x7f1f9c06f440 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f1f98009840 tx=0x7f1f98009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=565baa0bde84aaa6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:35.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.341+0000 7f1f937fe700 1 -- 172.21.15.40:0/2814076366 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f98011830 con 0x7f1f9c06f070 2023-09-30T22:28:35.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.341+0000 7f1f937fe700 1 -- 172.21.15.40:0/2814076366 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f98011990 con 0x7f1f9c06f070 2023-09-30T22:28:35.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.341+0000 7f1f937fe700 1 -- 172.21.15.40:0/2814076366 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f98011d20 con 0x7f1f9c06f070 2023-09-30T22:28:35.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.341+0000 7f1fa2ca2700 1 -- 172.21.15.40:0/2814076366 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f9c06f070 msgr2=0x7f1f9c06f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:35.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.341+0000 7f1fa2ca2700 1 --2- 172.21.15.40:0/2814076366 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f9c06f070 0x7f1f9c06f440 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f1f98009840 tx=0x7f1f98009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:35.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.341+0000 7f1fa2ca2700 1 -- 172.21.15.40:0/2814076366 shutdown_connections 2023-09-30T22:28:35.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.341+0000 7f1fa2ca2700 1 --2- 172.21.15.40:0/2814076366 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f9c06f070 0x7f1f9c06f440 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.341+0000 7f1fa2ca2700 1 --2- 172.21.15.40:0/2814076366 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f9c06fdb0 0x7f1f9c0975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.341+0000 7f1fa2ca2700 1 --2- 172.21.15.40:0/2814076366 >> v2:172.21.15.40:3300/0 conn(0x7f1f9c06f980 0x7f1f9c097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.341+0000 7f1fa2ca2700 1 -- 172.21.15.40:0/2814076366 >> 172.21.15.40:0/2814076366 conn(0x7f1f9c0a41a0 msgr2=0x7f1f9c0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:35.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.341+0000 7f1fa2ca2700 1 -- 172.21.15.40:0/2814076366 shutdown_connections 2023-09-30T22:28:35.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.341+0000 7f1fa2ca2700 1 -- 172.21.15.40:0/2814076366 wait complete. 2023-09-30T22:28:35.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.343+0000 7f1fa2ca2700 1 Processor -- start 2023-09-30T22:28:35.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.343+0000 7f1fa2ca2700 1 -- start start 2023-09-30T22:28:35.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.343+0000 7f1fa2ca2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f9c06f070 0x7f1f9c12d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.343+0000 7f1fa2ca2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f9c06f980 0x7f1f9c12da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.343+0000 7f1fa2ca2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f9c06fdb0 0x7f1f9c12dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.343+0000 7f1fa2ca2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9c131680 con 0x7f1f9c06f980 2023-09-30T22:28:35.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.343+0000 7f1fa2ca2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9c12ecb0 con 0x7f1f9c06fdb0 2023-09-30T22:28:35.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.343+0000 7f1fa2ca2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9c130730 con 0x7f1f9c06f070 2023-09-30T22:28:35.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.344+0000 7f1f93fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f9c06f980 0x7f1f9c12da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.344+0000 7f1f93fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f9c06f980 0x7f1f9c12da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40398/0 (socket says 172.21.15.40:40398) 2023-09-30T22:28:35.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.344+0000 7f1f93fff700 1 -- 172.21.15.40:0/2556443912 learned_addr learned my addr 172.21.15.40:0/2556443912 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:35.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.344+0000 7f1fa123f700 1 --2- 172.21.15.40:0/2556443912 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f9c06fdb0 0x7f1f9c12dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.344+0000 7f1fa0a3e700 1 --2- 172.21.15.40:0/2556443912 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f9c06f070 0x7f1f9c12d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.344+0000 7f1f93fff700 1 -- 172.21.15.40:0/2556443912 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f9c06f070 msgr2=0x7f1f9c12d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:35.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.344+0000 7f1f93fff700 1 --2- 172.21.15.40:0/2556443912 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f9c06f070 0x7f1f9c12d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.344+0000 7f1f93fff700 1 -- 172.21.15.40:0/2556443912 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f9c06fdb0 msgr2=0x7f1f9c12dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:35.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.344+0000 7f1f93fff700 1 --2- 172.21.15.40:0/2556443912 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f9c06fdb0 0x7f1f9c12dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.344+0000 7f1f93fff700 1 -- 172.21.15.40:0/2556443912 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8c009550 con 0x7f1f9c06f980 2023-09-30T22:28:35.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.344+0000 7f1fa123f700 1 --2- 172.21.15.40:0/2556443912 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f9c06fdb0 0x7f1f9c12dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:35.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.344+0000 7f1f93fff700 1 --2- 172.21.15.40:0/2556443912 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f9c06f980 0x7f1f9c12da70 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c00ebe0 tx=0x7f1f8c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:35.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.344+0000 7f1f917fa700 1 -- 172.21.15.40:0/2556443912 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c00c850 con 0x7f1f9c06f980 2023-09-30T22:28:35.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.344+0000 7f1f917fa700 1 -- 172.21.15.40:0/2556443912 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8c00c9b0 con 0x7f1f9c06f980 2023-09-30T22:28:35.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.344+0000 7f1fa2ca2700 1 -- 172.21.15.40:0/2556443912 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f94009a70 con 0x7f1f9c06f980 2023-09-30T22:28:35.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.344+0000 7f1f917fa700 1 -- 172.21.15.40:0/2556443912 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c00cd60 con 0x7f1f9c06f980 2023-09-30T22:28:35.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.344+0000 7f1fa2ca2700 1 -- 172.21.15.40:0/2556443912 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f980094a0 con 0x7f1f9c06f980 2023-09-30T22:28:35.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.345+0000 7f1f917fa700 1 -- 172.21.15.40:0/2556443912 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1f8c013470 con 0x7f1f9c06f980 2023-09-30T22:28:35.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.345+0000 7f1f917fa700 1 -- 172.21.15.40:0/2556443912 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f1f8c03fbe0 con 0x7f1f9c06f980 2023-09-30T22:28:35.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.346+0000 7f1fa2ca2700 1 -- 172.21.15.40:0/2556443912 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f9c062380 con 0x7f1f9c06f980 2023-09-30T22:28:35.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.350+0000 7f1f917fa700 1 -- 172.21.15.40:0/2556443912 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f8c01b3b0 con 0x7f1f9c06f980 2023-09-30T22:28:35.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.399+0000 7f3eaa2c4700 1 Processor -- start 2023-09-30T22:28:35.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.399+0000 7f3eaa2c4700 1 -- start start 2023-09-30T22:28:35.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.400+0000 7f3eaa2c4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ea409c890 0x7f3ea409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.400+0000 7f3eaa2c4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3ea409e480 0x7f3ea413bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.400+0000 7f3eaa2c4700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ea40a2600 con 0x7f3ea409d920 2023-09-30T22:28:35.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.400+0000 7f3eaa2c4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ea40a29d0 con 0x7f3ea409e480 2023-09-30T22:28:35.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.400+0000 7f3eaa2c4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea409fb40 con 0x7f3ea409c890 2023-09-30T22:28:35.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.400+0000 7f3ea3fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ea409c890 0x7f3ea409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.400+0000 7f3ea3fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ea409c890 0x7f3ea409cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:36240/0 (socket says 172.21.15.40:36240) 2023-09-30T22:28:35.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.400+0000 7f3ea3fff700 1 -- 172.21.15.40:0/4078314024 learned_addr learned my addr 172.21.15.40:0/4078314024 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:35.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.400+0000 7f3ea3fff700 1 -- 172.21.15.40:0/4078314024 >> v2:172.21.15.40:3300/0 conn(0x7f3ea409e480 msgr2=0x7f3ea413bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:35.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.400+0000 7f3ea3fff700 1 --2- 172.21.15.40:0/4078314024 >> v2:172.21.15.40:3300/0 conn(0x7f3ea409e480 0x7f3ea413bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.400+0000 7f3ea3fff700 1 -- 172.21.15.40:0/4078314024 >> v1:172.21.15.40:6789/0 conn(0x7f3ea409d920 legacy=0x7f3ea409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:35.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.400+0000 7f3ea3fff700 1 -- 172.21.15.40:0/4078314024 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea409fed0 con 0x7f3ea409c890 2023-09-30T22:28:35.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.401+0000 7f3ea3fff700 1 --2- 172.21.15.40:0/4078314024 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ea409c890 0x7f3ea409cc60 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f3e94006fd0 tx=0x7f3e94009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cee15bb31f19a07 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:35.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.401+0000 7f3ea2ffd700 1 -- 172.21.15.40:0/4078314024 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e94005e30 con 0x7f3ea409c890 2023-09-30T22:28:35.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.401+0000 7f3ea2ffd700 1 -- 172.21.15.40:0/4078314024 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e94004030 con 0x7f3ea409c890 2023-09-30T22:28:35.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.401+0000 7f3ea2ffd700 1 -- 172.21.15.40:0/4078314024 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e940043e0 con 0x7f3ea409c890 2023-09-30T22:28:35.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.401+0000 7f3eaa2c4700 1 -- 172.21.15.40:0/4078314024 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ea409c890 msgr2=0x7f3ea409cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:35.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.401+0000 7f3eaa2c4700 1 --2- 172.21.15.40:0/4078314024 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ea409c890 0x7f3ea409cc60 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f3e94006fd0 tx=0x7f3e94009bd0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.401+0000 7f3eaa2c4700 1 -- 172.21.15.40:0/4078314024 shutdown_connections 2023-09-30T22:28:35.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.401+0000 7f3eaa2c4700 1 --2- 172.21.15.40:0/4078314024 >> v2:172.21.15.40:3300/0 conn(0x7f3ea409e480 0x7f3ea413bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.401+0000 7f3eaa2c4700 1 --2- 172.21.15.40:0/4078314024 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ea409c890 0x7f3ea409cc60 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.401+0000 7f3eaa2c4700 1 -- 172.21.15.40:0/4078314024 >> 172.21.15.40:0/4078314024 conn(0x7f3ea40a7080 msgr2=0x7f3ea40a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:35.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.401+0000 7f3eaa2c4700 1 -- 172.21.15.40:0/4078314024 shutdown_connections 2023-09-30T22:28:35.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.402+0000 7f3eaa2c4700 1 -- 172.21.15.40:0/4078314024 wait complete. 2023-09-30T22:28:35.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.403+0000 7f3eaa2c4700 1 Processor -- start 2023-09-30T22:28:35.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.403+0000 7f3eaa2c4700 1 -- start start 2023-09-30T22:28:35.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.403+0000 7f3eaa2c4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ea409c890 0x7f3ea41c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.404+0000 7f3eaa2c4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ea409d920 0x7f3ea41c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.404+0000 7f3eaa2c4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ea409e480 0x7f3ea41c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.404+0000 7f3eaa2c4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea408f4f0 con 0x7f3ea409e480 2023-09-30T22:28:35.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.404+0000 7f3eaa2c4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea40a5e20 con 0x7f3ea409d920 2023-09-30T22:28:35.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.404+0000 7f3eaa2c4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea409ecf0 con 0x7f3ea409c890 2023-09-30T22:28:35.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.404+0000 7f3ea3fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ea409c890 0x7f3ea41c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.404+0000 7f3ea3fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ea409c890 0x7f3ea41c89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:36256/0 (socket says 172.21.15.40:36256) 2023-09-30T22:28:35.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.404+0000 7f3ea3fff700 1 -- 172.21.15.40:0/2302531754 learned_addr learned my addr 172.21.15.40:0/2302531754 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:35.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.404+0000 7f3ea8861700 1 --2- 172.21.15.40:0/2302531754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ea409e480 0x7f3ea41c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.404+0000 7f3ea3fff700 1 -- 172.21.15.40:0/2302531754 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ea409d920 msgr2=0x7f3ea41c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:35.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.404+0000 7f3ea3fff700 1 --2- 172.21.15.40:0/2302531754 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ea409d920 0x7f3ea41c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.404+0000 7f3ea3fff700 1 -- 172.21.15.40:0/2302531754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ea409e480 msgr2=0x7f3ea41c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:35.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.404+0000 7f3ea3fff700 1 --2- 172.21.15.40:0/2302531754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ea409e480 0x7f3ea41c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.404+0000 7f3ea3fff700 1 -- 172.21.15.40:0/2302531754 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e94009500 con 0x7f3ea409c890 2023-09-30T22:28:35.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.404+0000 7f3ea3fff700 1 --2- 172.21.15.40:0/2302531754 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ea409c890 0x7f3ea41c89e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f3e94009c10 tx=0x7f3e94004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:35.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.404+0000 7f3ea0ff9700 1 -- 172.21.15.40:0/2302531754 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9400b460 con 0x7f3ea409c890 2023-09-30T22:28:35.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.404+0000 7f3ea0ff9700 1 -- 172.21.15.40:0/2302531754 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e9400b5e0 con 0x7f3ea409c890 2023-09-30T22:28:35.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.404+0000 7f3ea0ff9700 1 -- 172.21.15.40:0/2302531754 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9400b990 con 0x7f3ea409c890 2023-09-30T22:28:35.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.405+0000 7f3eaa2c4700 1 -- 172.21.15.40:0/2302531754 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ea409bbb0 con 0x7f3ea409c890 2023-09-30T22:28:35.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.405+0000 7f3eaa2c4700 1 -- 172.21.15.40:0/2302531754 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea412d450 con 0x7f3ea409c890 2023-09-30T22:28:35.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.406+0000 7f3eaa2c4700 1 -- 172.21.15.40:0/2302531754 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ea4062380 con 0x7f3ea409c890 2023-09-30T22:28:35.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.406+0000 7f3ea0ff9700 1 -- 172.21.15.40:0/2302531754 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3e94018030 con 0x7f3ea409c890 2023-09-30T22:28:35.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.407+0000 7f3ea0ff9700 1 -- 172.21.15.40:0/2302531754 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3e94040a90 con 0x7f3ea409c890 2023-09-30T22:28:35.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.411+0000 7f3ea0ff9700 1 -- 172.21.15.40:0/2302531754 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3e94011420 con 0x7f3ea409c890 2023-09-30T22:28:35.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.514+0000 7f8740ec6700 1 -- 172.21.15.40:0/364652873 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f873c074330 con 0x7f873c12d6d0 2023-09-30T22:28:35.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.515+0000 7f872affd700 1 -- 172.21.15.40:0/364652873 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f872c0233d0 con 0x7f873c12d6d0 2023-09-30T22:28:35.516 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:35.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.517+0000 7f8740ec6700 1 -- 172.21.15.40:0/364652873 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f873c12d6d0 msgr2=0x7f873c11dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:35.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.517+0000 7f8740ec6700 1 --2- 172.21.15.40:0/364652873 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f873c12d6d0 0x7f873c11dd90 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f872c000c00 tx=0x7f872c004750 comp rx=0 tx=0).stop 2023-09-30T22:28:35.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.517+0000 7f8740ec6700 1 -- 172.21.15.40:0/364652873 shutdown_connections 2023-09-30T22:28:35.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.517+0000 7f8740ec6700 1 --2- 172.21.15.40:0/364652873 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f873c12eea0 0x7f873c11e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.517+0000 7f8740ec6700 1 --2- 172.21.15.40:0/364652873 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f873c12d6d0 0x7f873c11dd90 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.517+0000 7f8740ec6700 1 --2- 172.21.15.40:0/364652873 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f873c12e590 0x7f873c11e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.517+0000 7f8740ec6700 1 -- 172.21.15.40:0/364652873 >> 172.21.15.40:0/364652873 conn(0x7f873c0a2a00 msgr2=0x7f873c12c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:35.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.517+0000 7f8740ec6700 1 -- 172.21.15.40:0/364652873 shutdown_connections 2023-09-30T22:28:35.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.517+0000 7f8740ec6700 1 -- 172.21.15.40:0/364652873 wait complete. 2023-09-30T22:28:35.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:35.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.550+0000 7f1fa2ca2700 1 -- 172.21.15.40:0/2556443912 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1f9c074620 con 0x7f1f9c06f980 2023-09-30T22:28:35.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.551+0000 7f1f917fa700 1 -- 172.21.15.40:0/2556443912 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1f8c017070 con 0x7f1f9c06f980 2023-09-30T22:28:35.552 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:35.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.553+0000 7f1fa2ca2700 1 -- 172.21.15.40:0/2556443912 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f9c06f980 msgr2=0x7f1f9c12da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:35.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.553+0000 7f1fa2ca2700 1 --2- 172.21.15.40:0/2556443912 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f9c06f980 0x7f1f9c12da70 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c00ebe0 tx=0x7f1f8c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.553+0000 7f1fa2ca2700 1 -- 172.21.15.40:0/2556443912 shutdown_connections 2023-09-30T22:28:35.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.553+0000 7f1fa2ca2700 1 --2- 172.21.15.40:0/2556443912 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f9c06f070 0x7f1f9c12d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.553+0000 7f1fa2ca2700 1 --2- 172.21.15.40:0/2556443912 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f9c06fdb0 0x7f1f9c12dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.553+0000 7f1fa2ca2700 1 --2- 172.21.15.40:0/2556443912 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f9c06f980 0x7f1f9c12da70 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.553+0000 7f1fa2ca2700 1 -- 172.21.15.40:0/2556443912 >> 172.21.15.40:0/2556443912 conn(0x7f1f9c0a41a0 msgr2=0x7f1f9c0a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:35.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.553+0000 7f1fa2ca2700 1 -- 172.21.15.40:0/2556443912 shutdown_connections 2023-09-30T22:28:35.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.553+0000 7f1fa2ca2700 1 -- 172.21.15.40:0/2556443912 wait complete. 2023-09-30T22:28:35.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:35.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.610+0000 7f3eaa2c4700 1 -- 172.21.15.40:0/2302531754 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3ea4130c20 con 0x7f3ea409c890 2023-09-30T22:28:35.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.610+0000 7f3ea0ff9700 1 -- 172.21.15.40:0/2302531754 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3e9402b070 con 0x7f3ea409c890 2023-09-30T22:28:35.611 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:35.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.612+0000 7f3eaa2c4700 1 -- 172.21.15.40:0/2302531754 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ea409c890 msgr2=0x7f3ea41c89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:35.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.612+0000 7f3eaa2c4700 1 --2- 172.21.15.40:0/2302531754 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ea409c890 0x7f3ea41c89e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f3e94009c10 tx=0x7f3e94004750 comp rx=0 tx=0).stop 2023-09-30T22:28:35.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.612+0000 7f3eaa2c4700 1 -- 172.21.15.40:0/2302531754 shutdown_connections 2023-09-30T22:28:35.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.612+0000 7f3eaa2c4700 1 --2- 172.21.15.40:0/2302531754 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ea409c890 0x7f3ea41c89e0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.612+0000 7f3eaa2c4700 1 --2- 172.21.15.40:0/2302531754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ea409e480 0x7f3ea41c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.612+0000 7f3eaa2c4700 1 --2- 172.21.15.40:0/2302531754 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ea409d920 0x7f3ea41c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.612+0000 7f3eaa2c4700 1 -- 172.21.15.40:0/2302531754 >> 172.21.15.40:0/2302531754 conn(0x7f3ea40a7080 msgr2=0x7f3ea40a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:35.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.612+0000 7f3eaa2c4700 1 -- 172.21.15.40:0/2302531754 shutdown_connections 2023-09-30T22:28:35.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.612+0000 7f3eaa2c4700 1 -- 172.21.15.40:0/2302531754 wait complete. 2023-09-30T22:28:35.625 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:35.830 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:35.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.957+0000 7fd9353a9700 1 Processor -- start 2023-09-30T22:28:35.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.957+0000 7fd9353a9700 1 -- start start 2023-09-30T22:28:35.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.958+0000 7fd9353a9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd930131d50 0x7fd930132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.958+0000 7fd9353a9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd93009c7d0 0x7fd930139ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.958+0000 7fd9353a9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd930132660 con 0x7fd93009bc50 2023-09-30T22:28:35.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.958+0000 7fd9353a9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9300719e0 con 0x7fd930131d50 2023-09-30T22:28:35.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.958+0000 7fd9353a9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd930131900 con 0x7fd93009c7d0 2023-09-30T22:28:35.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.958+0000 7fd92effd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd930131d50 0x7fd930132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.958+0000 7fd92f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd93009c7d0 0x7fd930139ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.958+0000 7fd92effd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd930131d50 0x7fd930132120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40412/0 (socket says 172.21.15.40:40412) 2023-09-30T22:28:35.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.958+0000 7fd92effd700 1 -- 172.21.15.40:0/871797772 learned_addr learned my addr 172.21.15.40:0/871797772 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:35.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.958+0000 7fd92effd700 1 -- 172.21.15.40:0/871797772 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd93009c7d0 msgr2=0x7fd930139ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:35.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.958+0000 7fd92effd700 1 --2- 172.21.15.40:0/871797772 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd93009c7d0 0x7fd930139ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.958+0000 7fd92effd700 1 -- 172.21.15.40:0/871797772 >> v1:172.21.15.40:6789/0 conn(0x7fd93009bc50 legacy=0x7fd93009c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:35.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.958+0000 7fd92effd700 1 -- 172.21.15.40:0/871797772 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd93009e820 con 0x7fd930131d50 2023-09-30T22:28:35.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.958+0000 7fd92f7fe700 1 --2- 172.21.15.40:0/871797772 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd93009c7d0 0x7fd930139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:35.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.958+0000 7fd92effd700 1 --2- 172.21.15.40:0/871797772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd930131d50 0x7fd930132120 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fd9200098f0 tx=0x7fd920009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2fcf99d10de32c2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:35.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.959+0000 7fd92e7fc700 1 -- 172.21.15.40:0/871797772 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd920011830 con 0x7fd930131d50 2023-09-30T22:28:35.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.959+0000 7fd92e7fc700 1 -- 172.21.15.40:0/871797772 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd920011990 con 0x7fd930131d50 2023-09-30T22:28:35.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.959+0000 7fd92e7fc700 1 -- 172.21.15.40:0/871797772 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd920011d20 con 0x7fd930131d50 2023-09-30T22:28:35.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.959+0000 7fd9353a9700 1 -- 172.21.15.40:0/871797772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd930131d50 msgr2=0x7fd930132120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:35.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.959+0000 7fd9353a9700 1 --2- 172.21.15.40:0/871797772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd930131d50 0x7fd930132120 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fd9200098f0 tx=0x7fd920009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:35.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.959+0000 7fd9353a9700 1 -- 172.21.15.40:0/871797772 shutdown_connections 2023-09-30T22:28:35.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.959+0000 7fd9353a9700 1 --2- 172.21.15.40:0/871797772 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd93009c7d0 0x7fd930139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.959+0000 7fd9353a9700 1 --2- 172.21.15.40:0/871797772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd930131d50 0x7fd930132120 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.959+0000 7fd9353a9700 1 -- 172.21.15.40:0/871797772 >> 172.21.15.40:0/871797772 conn(0x7fd9300a2a00 msgr2=0x7fd9300a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:35.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.959+0000 7fd9353a9700 1 -- 172.21.15.40:0/871797772 shutdown_connections 2023-09-30T22:28:35.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.959+0000 7fd9353a9700 1 -- 172.21.15.40:0/871797772 wait complete. 2023-09-30T22:28:35.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.960+0000 7fd9353a9700 1 Processor -- start 2023-09-30T22:28:35.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.960+0000 7fd9353a9700 1 -- start start 2023-09-30T22:28:35.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.961+0000 7fd9353a9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd93009bc50 0x7fd930099a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.961+0000 7fd9353a9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd93009c7d0 0x7fd930099fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.961+0000 7fd9353a9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd930131d50 0x7fd93009a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.961+0000 7fd9353a9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93011f2f0 con 0x7fd93009bc50 2023-09-30T22:28:35.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.961+0000 7fd9353a9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd93012ed80 con 0x7fd93009c7d0 2023-09-30T22:28:35.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.961+0000 7fd9353a9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd930120760 con 0x7fd930131d50 2023-09-30T22:28:35.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.961+0000 7fd92effd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd93009bc50 0x7fd930099a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.961+0000 7fd92f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd930131d50 0x7fd93009a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.961+0000 7fd92effd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd93009bc50 0x7fd930099a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40426/0 (socket says 172.21.15.40:40426) 2023-09-30T22:28:35.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.961+0000 7fd92f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd930131d50 0x7fd93009a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:36280/0 (socket says 172.21.15.40:36280) 2023-09-30T22:28:35.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.961+0000 7fd92effd700 1 -- 172.21.15.40:0/1766300173 learned_addr learned my addr 172.21.15.40:0/1766300173 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:35.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.961+0000 7fd9267fc700 1 --2- 172.21.15.40:0/1766300173 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd93009c7d0 0x7fd930099fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.961+0000 7fd92effd700 1 -- 172.21.15.40:0/1766300173 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd930131d50 msgr2=0x7fd93009a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:35.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.961+0000 7fd92effd700 1 --2- 172.21.15.40:0/1766300173 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd930131d50 0x7fd93009a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.961+0000 7fd92effd700 1 -- 172.21.15.40:0/1766300173 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd93009c7d0 msgr2=0x7fd930099fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:35.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.961+0000 7fd92effd700 1 --2- 172.21.15.40:0/1766300173 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd93009c7d0 0x7fd930099fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.961+0000 7fd92effd700 1 -- 172.21.15.40:0/1766300173 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd928009a70 con 0x7fd93009bc50 2023-09-30T22:28:35.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.961+0000 7fd92f7fe700 1 --2- 172.21.15.40:0/1766300173 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd930131d50 0x7fd93009a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:35.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.961+0000 7fd9267fc700 1 --2- 172.21.15.40:0/1766300173 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd93009c7d0 0x7fd930099fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:35.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.961+0000 7fd92effd700 1 --2- 172.21.15.40:0/1766300173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd93009bc50 0x7fd930099a70 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fd920000c00 tx=0x7fd920004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:35.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.961+0000 7fd927fff700 1 -- 172.21.15.40:0/1766300173 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9200036a0 con 0x7fd93009bc50 2023-09-30T22:28:35.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.962+0000 7fd927fff700 1 -- 172.21.15.40:0/1766300173 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd920003800 con 0x7fd93009bc50 2023-09-30T22:28:35.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.962+0000 7fd9353a9700 1 -- 172.21.15.40:0/1766300173 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd920009550 con 0x7fd93009bc50 2023-09-30T22:28:35.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.962+0000 7fd927fff700 1 -- 172.21.15.40:0/1766300173 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd920003bb0 con 0x7fd93009bc50 2023-09-30T22:28:35.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.962+0000 7fd9353a9700 1 -- 172.21.15.40:0/1766300173 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd93011f670 con 0x7fd93009bc50 2023-09-30T22:28:35.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.962+0000 7fd927fff700 1 -- 172.21.15.40:0/1766300173 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd920021070 con 0x7fd93009bc50 2023-09-30T22:28:35.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.962+0000 7fd927fff700 1 -- 172.21.15.40:0/1766300173 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd920040c30 con 0x7fd93009bc50 2023-09-30T22:28:35.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.962+0000 7fd9353a9700 1 -- 172.21.15.40:0/1766300173 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9301202e0 con 0x7fd93009bc50 2023-09-30T22:28:35.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:35.967+0000 7fd927fff700 1 -- 172.21.15.40:0/1766300173 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd9301202e0 con 0x7fd93009bc50 2023-09-30T22:28:36.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.164+0000 7fd9353a9700 1 -- 172.21.15.40:0/1766300173 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd9301202e0 con 0x7fd93009bc50 2023-09-30T22:28:36.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.165+0000 7fd927fff700 1 -- 172.21.15.40:0/1766300173 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd9301202e0 con 0x7fd93009bc50 2023-09-30T22:28:36.165 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:36.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.166+0000 7fd9353a9700 1 -- 172.21.15.40:0/1766300173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd93009bc50 msgr2=0x7fd930099a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:36.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.166+0000 7fd9353a9700 1 --2- 172.21.15.40:0/1766300173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd93009bc50 0x7fd930099a70 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fd920000c00 tx=0x7fd920004750 comp rx=0 tx=0).stop 2023-09-30T22:28:36.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.166+0000 7fd9353a9700 1 -- 172.21.15.40:0/1766300173 shutdown_connections 2023-09-30T22:28:36.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.166+0000 7fd9353a9700 1 --2- 172.21.15.40:0/1766300173 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd930131d50 0x7fd93009a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.166+0000 7fd9353a9700 1 --2- 172.21.15.40:0/1766300173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd93009bc50 0x7fd930099a70 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.166+0000 7fd9353a9700 1 --2- 172.21.15.40:0/1766300173 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd93009c7d0 0x7fd930099fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.167+0000 7fd9353a9700 1 -- 172.21.15.40:0/1766300173 >> 172.21.15.40:0/1766300173 conn(0x7fd9300a2a00 msgr2=0x7fd9301b8810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:36.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.167+0000 7fd9353a9700 1 -- 172.21.15.40:0/1766300173 shutdown_connections 2023-09-30T22:28:36.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.167+0000 7fd9353a9700 1 -- 172.21.15.40:0/1766300173 wait complete. 2023-09-30T22:28:36.179 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:36.531 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:36.568 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:36.626 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:36.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.668+0000 7fce7f45b700 1 Processor -- start 2023-09-30T22:28:36.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.668+0000 7fce7f45b700 1 -- start start 2023-09-30T22:28:36.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.669+0000 7fce7f45b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce78136bf0 0x7fce78138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:36.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.669+0000 7fce7f45b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fce78139510 0x7fce7813b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:36.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.669+0000 7fce7f45b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce780a2600 con 0x7fce7809c890 2023-09-30T22:28:36.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.669+0000 7fce7f45b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce780a29d0 con 0x7fce78139510 2023-09-30T22:28:36.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.669+0000 7fce7f45b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7809fb40 con 0x7fce78136bf0 2023-09-30T22:28:36.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.669+0000 7fce7c9f6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce78136bf0 0x7fce78138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:36.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.669+0000 7fce7c9f6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce78136bf0 0x7fce78138fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:46928/0 (socket says 172.21.15.40:46928) 2023-09-30T22:28:36.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.669+0000 7fce7c9f6700 1 -- 172.21.15.40:0/1354507611 learned_addr learned my addr 172.21.15.40:0/1354507611 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:36.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.669+0000 7fce7d9f8700 1 --2- 172.21.15.40:0/1354507611 >> v2:172.21.15.40:3300/0 conn(0x7fce78139510 0x7fce7813b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:36.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.669+0000 7fce7d9f8700 1 -- 172.21.15.40:0/1354507611 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce78136bf0 msgr2=0x7fce78138fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:36.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.669+0000 7fce7d9f8700 1 --2- 172.21.15.40:0/1354507611 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce78136bf0 0x7fce78138fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.669+0000 7fce7d9f8700 1 -- 172.21.15.40:0/1354507611 >> v1:172.21.15.40:6789/0 conn(0x7fce7809c890 legacy=0x7fce7809cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:36.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.669+0000 7fce7d9f8700 1 -- 172.21.15.40:0/1354507611 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7809d370 con 0x7fce78139510 2023-09-30T22:28:36.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.669+0000 7fce6ffff700 1 -- 172.21.15.40:0/1354507611 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1697296156 0 0) 0x7fce780a2600 con 0x7fce7809c890 2023-09-30T22:28:36.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.669+0000 7fce7c9f6700 1 --2- 172.21.15.40:0/1354507611 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce78136bf0 0x7fce78138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:36.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.669+0000 7fce7d9f8700 1 --2- 172.21.15.40:0/1354507611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce78139510 0x7fce7813b8f0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fce70009d90 tx=0x7fce7000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d564f3ec5819bf6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:36.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.670+0000 7fce6ffff700 1 -- 172.21.15.40:0/1354507611 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7000e070 con 0x7fce78139510 2023-09-30T22:28:36.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.670+0000 7fce6ffff700 1 -- 172.21.15.40:0/1354507611 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7000bb20 con 0x7fce78139510 2023-09-30T22:28:36.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.670+0000 7fce6ffff700 1 -- 172.21.15.40:0/1354507611 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce70012430 con 0x7fce78139510 2023-09-30T22:28:36.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.670+0000 7fce7f45b700 1 -- 172.21.15.40:0/1354507611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce78139510 msgr2=0x7fce7813b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:36.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.670+0000 7fce7f45b700 1 --2- 172.21.15.40:0/1354507611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce78139510 0x7fce7813b8f0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fce70009d90 tx=0x7fce7000b330 comp rx=0 tx=0).stop 2023-09-30T22:28:36.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.670+0000 7fce7f45b700 1 -- 172.21.15.40:0/1354507611 shutdown_connections 2023-09-30T22:28:36.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.670+0000 7fce7f45b700 1 --2- 172.21.15.40:0/1354507611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce78139510 0x7fce7813b8f0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.670+0000 7fce7f45b700 1 --2- 172.21.15.40:0/1354507611 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce78136bf0 0x7fce78138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.670+0000 7fce7f45b700 1 -- 172.21.15.40:0/1354507611 >> 172.21.15.40:0/1354507611 conn(0x7fce780a7080 msgr2=0x7fce780a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:36.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.670+0000 7fce7f45b700 1 -- 172.21.15.40:0/1354507611 shutdown_connections 2023-09-30T22:28:36.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.671+0000 7fce7f45b700 1 -- 172.21.15.40:0/1354507611 wait complete. 2023-09-30T22:28:36.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.671+0000 7fce7f45b700 1 Processor -- start 2023-09-30T22:28:36.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.671+0000 7fce7f45b700 1 -- start start 2023-09-30T22:28:36.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.672+0000 7fce7f45b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fce7809c890 0x7fce7806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:36.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.672+0000 7fce7f45b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce78136bf0 0x7fce7806f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:36.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.672+0000 7fce7f45b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce78139510 0x7fce7806f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:36.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.672+0000 7fce7f45b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce78070970 con 0x7fce78136bf0 2023-09-30T22:28:36.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.672+0000 7fce7f45b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce78138fe0 con 0x7fce78139510 2023-09-30T22:28:36.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.672+0000 7fce7f45b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce7809ecf0 con 0x7fce7809c890 2023-09-30T22:28:36.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.672+0000 7fce7c9f6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce78136bf0 0x7fce7806f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:36.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.672+0000 7fce7c9f6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce78136bf0 0x7fce7806f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40440/0 (socket says 172.21.15.40:40440) 2023-09-30T22:28:36.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.672+0000 7fce7c9f6700 1 -- 172.21.15.40:0/578159534 learned_addr learned my addr 172.21.15.40:0/578159534 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:36.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.672+0000 7fce7d1f7700 1 --2- 172.21.15.40:0/578159534 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fce7809c890 0x7fce7806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:36.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.672+0000 7fce7d9f8700 1 --2- 172.21.15.40:0/578159534 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce78139510 0x7fce7806f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:36.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.672+0000 7fce7d1f7700 1 -- 172.21.15.40:0/578159534 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce78139510 msgr2=0x7fce7806f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:36.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.672+0000 7fce7d1f7700 1 --2- 172.21.15.40:0/578159534 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce78139510 0x7fce7806f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.672+0000 7fce7d1f7700 1 -- 172.21.15.40:0/578159534 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce78136bf0 msgr2=0x7fce7806f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:36.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.672+0000 7fce7d1f7700 1 --2- 172.21.15.40:0/578159534 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce78136bf0 0x7fce7806f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.672+0000 7fce7d1f7700 1 -- 172.21.15.40:0/578159534 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce68009550 con 0x7fce7809c890 2023-09-30T22:28:36.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.672+0000 7fce7c9f6700 1 --2- 172.21.15.40:0/578159534 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce78136bf0 0x7fce7806f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:36.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.673+0000 7fce7d1f7700 1 --2- 172.21.15.40:0/578159534 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fce7809c890 0x7fce7806ee80 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fce7400c430 tx=0x7fce7400c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:36.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.673+0000 7fce6dffb700 1 -- 172.21.15.40:0/578159534 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce740054e0 con 0x7fce7809c890 2023-09-30T22:28:36.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.673+0000 7fce6dffb700 1 -- 172.21.15.40:0/578159534 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7400ce40 con 0x7fce7809c890 2023-09-30T22:28:36.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.673+0000 7fce7f45b700 1 -- 172.21.15.40:0/578159534 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce70009a70 con 0x7fce7809c890 2023-09-30T22:28:36.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.673+0000 7fce6dffb700 1 -- 172.21.15.40:0/578159534 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce740038c0 con 0x7fce7809c890 2023-09-30T22:28:36.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.673+0000 7fce7f45b700 1 -- 172.21.15.40:0/578159534 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce7812c590 con 0x7fce7809c890 2023-09-30T22:28:36.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.674+0000 7fce6dffb700 1 -- 172.21.15.40:0/578159534 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fce74003a20 con 0x7fce7809c890 2023-09-30T22:28:36.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.674+0000 7fce6dffb700 1 -- 172.21.15.40:0/578159534 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fce74040a60 con 0x7fce7809c890 2023-09-30T22:28:36.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.674+0000 7fce7f45b700 1 -- 172.21.15.40:0/578159534 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce78062380 con 0x7fce7809c890 2023-09-30T22:28:36.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.683+0000 7fce6dffb700 1 -- 172.21.15.40:0/578159534 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fce74044060 con 0x7fce7809c890 2023-09-30T22:28:36.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.714+0000 7fc2bb9a5700 1 Processor -- start 2023-09-30T22:28:36.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.714+0000 7fc2bb9a5700 1 -- start start 2023-09-30T22:28:36.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.715+0000 7fc2bb9a5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2b409f0f0 0x7fc2b4138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:36.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.715+0000 7fc2bb9a5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc2b409e400 0x7fc2b413b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:36.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.715+0000 7fc2bb9a5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b409f940 con 0x7fc2b409d920 2023-09-30T22:28:36.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.715+0000 7fc2bb9a5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b406b4c0 con 0x7fc2b409f0f0 2023-09-30T22:28:36.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.715+0000 7fc2bb9a5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b409a8f0 con 0x7fc2b409e400 2023-09-30T22:28:36.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.715+0000 7fc2b9741700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc2b409d920 0x7fc2b409dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38858/0 (socket says 172.21.15.40:38858) 2023-09-30T22:28:36.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.715+0000 7fc2b9741700 1 -- 172.21.15.40:0/1352631174 learned_addr learned my addr 172.21.15.40:0/1352631174 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:36.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.715+0000 7fc2b9f42700 1 --2- 172.21.15.40:0/1352631174 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc2b409e400 0x7fc2b413b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:36.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.715+0000 7fc2b8f40700 1 --2- 172.21.15.40:0/1352631174 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2b409f0f0 0x7fc2b4138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:36.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.716+0000 7fc2abfff700 1 -- 172.21.15.40:0/1352631174 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3324696425 0 0) 0x7fc2b409f940 con 0x7fc2b409d920 2023-09-30T22:28:36.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.716+0000 7fc2abfff700 1 -- 172.21.15.40:0/1352631174 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2a00035b0 con 0x7fc2b409d920 2023-09-30T22:28:36.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.716+0000 7fc2b9f42700 1 -- 172.21.15.40:0/1352631174 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2b409f0f0 msgr2=0x7fc2b4138ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:36.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.716+0000 7fc2b9f42700 1 --2- 172.21.15.40:0/1352631174 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2b409f0f0 0x7fc2b4138ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.716+0000 7fc2b9f42700 1 -- 172.21.15.40:0/1352631174 >> v1:172.21.15.40:6789/0 conn(0x7fc2b409d920 legacy=0x7fc2b409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:36.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.716+0000 7fc2b9f42700 1 -- 172.21.15.40:0/1352631174 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b409f6e0 con 0x7fc2b409e400 2023-09-30T22:28:36.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.716+0000 7fc2b9f42700 1 --2- 172.21.15.40:0/1352631174 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc2b409e400 0x7fc2b413b430 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac009df0 tx=0x7fc2ac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d41ab679fb1c9752 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:36.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.716+0000 7fc2abfff700 1 -- 172.21.15.40:0/1352631174 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac00e070 con 0x7fc2b409e400 2023-09-30T22:28:36.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.716+0000 7fc2abfff700 1 -- 172.21.15.40:0/1352631174 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ac00bae0 con 0x7fc2b409e400 2023-09-30T22:28:36.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.716+0000 7fc2abfff700 1 -- 172.21.15.40:0/1352631174 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac00be90 con 0x7fc2b409e400 2023-09-30T22:28:36.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.717+0000 7fc2bb9a5700 1 -- 172.21.15.40:0/1352631174 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc2b409e400 msgr2=0x7fc2b413b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:36.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.717+0000 7fc2bb9a5700 1 --2- 172.21.15.40:0/1352631174 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc2b409e400 0x7fc2b413b430 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac009df0 tx=0x7fc2ac00b330 comp rx=0 tx=0).stop 2023-09-30T22:28:36.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.717+0000 7fc2bb9a5700 1 -- 172.21.15.40:0/1352631174 shutdown_connections 2023-09-30T22:28:36.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.717+0000 7fc2bb9a5700 1 --2- 172.21.15.40:0/1352631174 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc2b409e400 0x7fc2b413b430 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.717+0000 7fc2bb9a5700 1 --2- 172.21.15.40:0/1352631174 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2b409f0f0 0x7fc2b4138ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.717+0000 7fc2bb9a5700 1 -- 172.21.15.40:0/1352631174 >> 172.21.15.40:0/1352631174 conn(0x7fc2b409fb20 msgr2=0x7fc2b409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:36.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.717+0000 7fc2bb9a5700 1 -- 172.21.15.40:0/1352631174 shutdown_connections 2023-09-30T22:28:36.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.717+0000 7fc2bb9a5700 1 -- 172.21.15.40:0/1352631174 wait complete. 2023-09-30T22:28:36.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.718+0000 7fc2bb9a5700 1 Processor -- start 2023-09-30T22:28:36.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.718+0000 7fc2bb9a5700 1 -- start start 2023-09-30T22:28:36.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.718+0000 7fc2bb9a5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2b409d920 0x7fc2b411db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:36.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.718+0000 7fc2bb9a5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2b409e400 0x7fc2b411e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:36.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.718+0000 7fc2bb9a5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc2b411e5c0 0x7fc2b41ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:36.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.718+0000 7fc2bb9a5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b4120b30 con 0x7fc2b409d920 2023-09-30T22:28:36.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.718+0000 7fc2bb9a5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b411ece0 con 0x7fc2b409e400 2023-09-30T22:28:36.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.718+0000 7fc2bb9a5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b4120130 con 0x7fc2b411e5c0 2023-09-30T22:28:36.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.719+0000 7fc2b8f40700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2b409e400 0x7fc2b411e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:36.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.719+0000 7fc2b8f40700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2b409e400 0x7fc2b411e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:46938/0 (socket says 172.21.15.40:46938) 2023-09-30T22:28:36.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.719+0000 7fc2b8f40700 1 -- 172.21.15.40:0/3141428289 learned_addr learned my addr 172.21.15.40:0/3141428289 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:36.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.719+0000 7fc2b9f42700 1 --2- 172.21.15.40:0/3141428289 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc2b411e5c0 0x7fc2b41ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:36.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.719+0000 7fc2b9741700 1 --2- 172.21.15.40:0/3141428289 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2b409d920 0x7fc2b411db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:36.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.719+0000 7fc2b8f40700 1 -- 172.21.15.40:0/3141428289 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc2b411e5c0 msgr2=0x7fc2b41ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:36.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.719+0000 7fc2b8f40700 1 --2- 172.21.15.40:0/3141428289 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc2b411e5c0 0x7fc2b41ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.719+0000 7fc2b8f40700 1 -- 172.21.15.40:0/3141428289 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2b409d920 msgr2=0x7fc2b411db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:36.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.719+0000 7fc2b8f40700 1 --2- 172.21.15.40:0/3141428289 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2b409d920 0x7fc2b411db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.719+0000 7fc2b8f40700 1 -- 172.21.15.40:0/3141428289 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ac009a70 con 0x7fc2b409e400 2023-09-30T22:28:36.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.719+0000 7fc2b9f42700 1 --2- 172.21.15.40:0/3141428289 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc2b411e5c0 0x7fc2b41ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:36.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.719+0000 7fc2b9741700 1 --2- 172.21.15.40:0/3141428289 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2b409d920 0x7fc2b411db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:36.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.719+0000 7fc2b8f40700 1 --2- 172.21.15.40:0/3141428289 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2b409e400 0x7fc2b411e080 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc2a400e9e0 tx=0x7fc2a400ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:36.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.719+0000 7fc2a9ffb700 1 -- 172.21.15.40:0/3141428289 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4009710 con 0x7fc2b409e400 2023-09-30T22:28:36.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.719+0000 7fc2a9ffb700 1 -- 172.21.15.40:0/3141428289 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a400c850 con 0x7fc2b409e400 2023-09-30T22:28:36.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.719+0000 7fc2bb9a5700 1 -- 172.21.15.40:0/3141428289 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b409ca50 con 0x7fc2b409e400 2023-09-30T22:28:36.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.719+0000 7fc2a9ffb700 1 -- 172.21.15.40:0/3141428289 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a400cbc0 con 0x7fc2b409e400 2023-09-30T22:28:36.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.720+0000 7fc2bb9a5700 1 -- 172.21.15.40:0/3141428289 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b411ee90 con 0x7fc2b409e400 2023-09-30T22:28:36.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.720+0000 7fc2a9ffb700 1 -- 172.21.15.40:0/3141428289 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc2a400cd20 con 0x7fc2b409e400 2023-09-30T22:28:36.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.720+0000 7fc2a9ffb700 1 -- 172.21.15.40:0/3141428289 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc2a403f9f0 con 0x7fc2b409e400 2023-09-30T22:28:36.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.721+0000 7fc2bb9a5700 1 -- 172.21.15.40:0/3141428289 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2b4062380 con 0x7fc2b409e400 2023-09-30T22:28:36.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.726+0000 7fc2a9ffb700 1 -- 172.21.15.40:0/3141428289 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc2a4013470 con 0x7fc2b409e400 2023-09-30T22:28:36.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.765+0000 7ff085695700 1 Processor -- start 2023-09-30T22:28:36.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.765+0000 7ff085695700 1 -- start start 2023-09-30T22:28:36.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.765+0000 7ff085695700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff08009d920 0x7ff08009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:36.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.766+0000 7ff085695700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff080130fb0 0x7ff080138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:36.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.766+0000 7ff085695700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff08009adf0 con 0x7ff08009e230 2023-09-30T22:28:36.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.766+0000 7ff085695700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff08009edf0 con 0x7ff08009d920 2023-09-30T22:28:36.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.766+0000 7ff085695700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff08009b660 con 0x7ff080130fb0 2023-09-30T22:28:36.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.766+0000 7ff07effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff08009d920 0x7ff08009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:36.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.766+0000 7ff07effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff08009d920 0x7ff08009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:46944/0 (socket says 172.21.15.40:46944) 2023-09-30T22:28:36.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.766+0000 7ff07effd700 1 -- 172.21.15.40:0/1227983734 learned_addr learned my addr 172.21.15.40:0/1227983734 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:36.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.766+0000 7ff07f7fe700 1 --2- 172.21.15.40:0/1227983734 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff080130fb0 0x7ff080138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:36.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.766+0000 7ff07dffb700 1 -- 172.21.15.40:0/1227983734 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1906124166 0 0) 0x7ff08009adf0 con 0x7ff08009e230 2023-09-30T22:28:36.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.766+0000 7ff07effd700 1 -- 172.21.15.40:0/1227983734 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff080130fb0 msgr2=0x7ff080138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:36.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.766+0000 7ff07effd700 1 --2- 172.21.15.40:0/1227983734 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff080130fb0 0x7ff080138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.766+0000 7ff07effd700 1 -- 172.21.15.40:0/1227983734 >> v1:172.21.15.40:6789/0 conn(0x7ff08009e230 legacy=0x7ff0801308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:36.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.766+0000 7ff07effd700 1 -- 172.21.15.40:0/1227983734 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08009a6e0 con 0x7ff08009d920 2023-09-30T22:28:36.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.766+0000 7ff07effd700 1 --2- 172.21.15.40:0/1227983734 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff08009d920 0x7ff08009dcf0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff0700098f0 tx=0x7ff070009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=576fb8e071e7b2ae server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:36.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.767+0000 7ff07dffb700 1 -- 172.21.15.40:0/1227983734 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff070005e30 con 0x7ff08009d920 2023-09-30T22:28:36.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.767+0000 7ff07dffb700 1 -- 172.21.15.40:0/1227983734 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff070004030 con 0x7ff08009d920 2023-09-30T22:28:36.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.767+0000 7ff07dffb700 1 -- 172.21.15.40:0/1227983734 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0700043e0 con 0x7ff08009d920 2023-09-30T22:28:36.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.767+0000 7ff085695700 1 -- 172.21.15.40:0/1227983734 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff08009d920 msgr2=0x7ff08009dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:36.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.767+0000 7ff085695700 1 --2- 172.21.15.40:0/1227983734 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff08009d920 0x7ff08009dcf0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff0700098f0 tx=0x7ff070009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:36.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.767+0000 7ff085695700 1 -- 172.21.15.40:0/1227983734 shutdown_connections 2023-09-30T22:28:36.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.767+0000 7ff085695700 1 --2- 172.21.15.40:0/1227983734 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff080130fb0 0x7ff080138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.767+0000 7ff085695700 1 --2- 172.21.15.40:0/1227983734 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff08009d920 0x7ff08009dcf0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.767+0000 7ff085695700 1 -- 172.21.15.40:0/1227983734 >> 172.21.15.40:0/1227983734 conn(0x7ff08009fb20 msgr2=0x7ff08009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:36.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.767+0000 7ff085695700 1 -- 172.21.15.40:0/1227983734 shutdown_connections 2023-09-30T22:28:36.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.767+0000 7ff085695700 1 -- 172.21.15.40:0/1227983734 wait complete. 2023-09-30T22:28:36.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.768+0000 7ff085695700 1 Processor -- start 2023-09-30T22:28:36.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.768+0000 7ff085695700 1 -- start start 2023-09-30T22:28:36.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.769+0000 7ff085695700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff08009d920 0x7ff0801c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:36.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.769+0000 7ff085695700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff08009e230 0x7ff0801c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:36.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.769+0000 7ff085695700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff080130fb0 0x7ff0801c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:36.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.769+0000 7ff085695700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff080131ca0 con 0x7ff08009e230 2023-09-30T22:28:36.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.769+0000 7ff085695700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff08013a260 con 0x7ff080130fb0 2023-09-30T22:28:36.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.769+0000 7ff085695700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff08013b720 con 0x7ff08009d920 2023-09-30T22:28:36.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.769+0000 7ff07e7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff08009e230 0x7ff0801c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:36.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.769+0000 7ff07effd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff08009d920 0x7ff0801c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:36.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.769+0000 7ff07e7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff08009e230 0x7ff0801c88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40468/0 (socket says 172.21.15.40:40468) 2023-09-30T22:28:36.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.769+0000 7ff07effd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff08009d920 0x7ff0801c8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:36312/0 (socket says 172.21.15.40:36312) 2023-09-30T22:28:36.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.769+0000 7ff07e7fc700 1 -- 172.21.15.40:0/478003409 learned_addr learned my addr 172.21.15.40:0/478003409 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:36.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.769+0000 7ff07f7fe700 1 --2- 172.21.15.40:0/478003409 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff080130fb0 0x7ff0801c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:36.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.769+0000 7ff07f7fe700 1 -- 172.21.15.40:0/478003409 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff08009d920 msgr2=0x7ff0801c8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:36.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.769+0000 7ff07f7fe700 1 --2- 172.21.15.40:0/478003409 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff08009d920 0x7ff0801c8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.769+0000 7ff07f7fe700 1 -- 172.21.15.40:0/478003409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff08009e230 msgr2=0x7ff0801c88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:36.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.769+0000 7ff07f7fe700 1 --2- 172.21.15.40:0/478003409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff08009e230 0x7ff0801c88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.769+0000 7ff07f7fe700 1 -- 172.21.15.40:0/478003409 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff070009500 con 0x7ff080130fb0 2023-09-30T22:28:36.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.769+0000 7ff07f7fe700 1 --2- 172.21.15.40:0/478003409 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff080130fb0 0x7ff0801c8de0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff078009d90 tx=0x7ff07800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:36.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.770+0000 7ff0677fe700 1 -- 172.21.15.40:0/478003409 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff078009c00 con 0x7ff080130fb0 2023-09-30T22:28:36.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.770+0000 7ff0677fe700 1 -- 172.21.15.40:0/478003409 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07800f040 con 0x7ff080130fb0 2023-09-30T22:28:36.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.770+0000 7ff0677fe700 1 -- 172.21.15.40:0/478003409 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff078014480 con 0x7ff080130fb0 2023-09-30T22:28:36.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.770+0000 7ff085695700 1 -- 172.21.15.40:0/478003409 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff08009cb60 con 0x7ff080130fb0 2023-09-30T22:28:36.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.770+0000 7ff085695700 1 -- 172.21.15.40:0/478003409 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff08013b960 con 0x7ff080130fb0 2023-09-30T22:28:36.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.771+0000 7ff0677fe700 1 -- 172.21.15.40:0/478003409 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff0780145e0 con 0x7ff080130fb0 2023-09-30T22:28:36.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.771+0000 7ff0677fe700 1 -- 172.21.15.40:0/478003409 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff078040270 con 0x7ff080130fb0 2023-09-30T22:28:36.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.771+0000 7ff085695700 1 -- 172.21.15.40:0/478003409 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff080131ea0 con 0x7ff080130fb0 2023-09-30T22:28:36.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.780+0000 7ff0677fe700 1 -- 172.21.15.40:0/478003409 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff078007900 con 0x7ff080130fb0 2023-09-30T22:28:36.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.894+0000 7fce7f45b700 1 -- 172.21.15.40:0/578159534 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fce78074620 con 0x7fce7809c890 2023-09-30T22:28:36.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.894+0000 7fce6dffb700 1 -- 172.21.15.40:0/578159534 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fce74017070 con 0x7fce7809c890 2023-09-30T22:28:36.895 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:36.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.896+0000 7fce7f45b700 1 -- 172.21.15.40:0/578159534 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fce7809c890 msgr2=0x7fce7806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:36.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.896+0000 7fce7f45b700 1 --2- 172.21.15.40:0/578159534 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fce7809c890 0x7fce7806ee80 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fce7400c430 tx=0x7fce7400c740 comp rx=0 tx=0).stop 2023-09-30T22:28:36.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.896+0000 7fce7f45b700 1 -- 172.21.15.40:0/578159534 shutdown_connections 2023-09-30T22:28:36.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.896+0000 7fce7f45b700 1 --2- 172.21.15.40:0/578159534 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fce7809c890 0x7fce7806ee80 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.896+0000 7fce7f45b700 1 --2- 172.21.15.40:0/578159534 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce78139510 0x7fce7806f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.896+0000 7fce7f45b700 1 --2- 172.21.15.40:0/578159534 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce78136bf0 0x7fce7806f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.896+0000 7fce7f45b700 1 -- 172.21.15.40:0/578159534 >> 172.21.15.40:0/578159534 conn(0x7fce780a7080 msgr2=0x7fce781349d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:36.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.897+0000 7fce7f45b700 1 -- 172.21.15.40:0/578159534 shutdown_connections 2023-09-30T22:28:36.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.897+0000 7fce7f45b700 1 -- 172.21.15.40:0/578159534 wait complete. 2023-09-30T22:28:36.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:36.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.924+0000 7fc2bb9a5700 1 -- 172.21.15.40:0/3141428289 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc2b409c9e0 con 0x7fc2b409e400 2023-09-30T22:28:36.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.925+0000 7fc2a9ffb700 1 -- 172.21.15.40:0/3141428289 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc2a4017020 con 0x7fc2b409e400 2023-09-30T22:28:36.926 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:36.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.927+0000 7fc2bb9a5700 1 -- 172.21.15.40:0/3141428289 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2b409e400 msgr2=0x7fc2b411e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:36.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.927+0000 7fc2bb9a5700 1 --2- 172.21.15.40:0/3141428289 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2b409e400 0x7fc2b411e080 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc2a400e9e0 tx=0x7fc2a400ecf0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.927+0000 7fc2bb9a5700 1 -- 172.21.15.40:0/3141428289 shutdown_connections 2023-09-30T22:28:36.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.927+0000 7fc2bb9a5700 1 --2- 172.21.15.40:0/3141428289 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc2b411e5c0 0x7fc2b41ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.927+0000 7fc2bb9a5700 1 --2- 172.21.15.40:0/3141428289 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2b409d920 0x7fc2b411db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.927+0000 7fc2bb9a5700 1 --2- 172.21.15.40:0/3141428289 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2b409e400 0x7fc2b411e080 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.927+0000 7fc2bb9a5700 1 -- 172.21.15.40:0/3141428289 >> 172.21.15.40:0/3141428289 conn(0x7fc2b409fb20 msgr2=0x7fc2b4136f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:36.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.927+0000 7fc2bb9a5700 1 -- 172.21.15.40:0/3141428289 shutdown_connections 2023-09-30T22:28:36.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.927+0000 7fc2bb9a5700 1 -- 172.21.15.40:0/3141428289 wait complete. 2023-09-30T22:28:36.940 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:36.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.978+0000 7ff085695700 1 -- 172.21.15.40:0/478003409 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff080062380 con 0x7ff080130fb0 2023-09-30T22:28:36.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.978+0000 7ff0677fe700 1 -- 172.21.15.40:0/478003409 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff07802c090 con 0x7ff080130fb0 2023-09-30T22:28:36.979 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:36.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.980+0000 7ff085695700 1 -- 172.21.15.40:0/478003409 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff080130fb0 msgr2=0x7ff0801c8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:36.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.980+0000 7ff085695700 1 --2- 172.21.15.40:0/478003409 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff080130fb0 0x7ff0801c8de0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff078009d90 tx=0x7ff07800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.980+0000 7ff085695700 1 -- 172.21.15.40:0/478003409 shutdown_connections 2023-09-30T22:28:36.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.980+0000 7ff085695700 1 --2- 172.21.15.40:0/478003409 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff08009d920 0x7ff0801c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.980+0000 7ff085695700 1 --2- 172.21.15.40:0/478003409 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff080130fb0 0x7ff0801c8de0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.980+0000 7ff085695700 1 --2- 172.21.15.40:0/478003409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff08009e230 0x7ff0801c88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.980+0000 7ff085695700 1 -- 172.21.15.40:0/478003409 >> 172.21.15.40:0/478003409 conn(0x7ff08009fb20 msgr2=0x7ff080129ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:36.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.980+0000 7ff085695700 1 -- 172.21.15.40:0/478003409 shutdown_connections 2023-09-30T22:28:36.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:36.980+0000 7ff085695700 1 -- 172.21.15.40:0/478003409 wait complete. 2023-09-30T22:28:36.993 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:37.180 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:37.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.308+0000 7fc262f88700 1 Processor -- start 2023-09-30T22:28:37.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.308+0000 7fc262f88700 1 -- start start 2023-09-30T22:28:37.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.308+0000 7fc262f88700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc25c09c890 0x7fc25c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:37.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.308+0000 7fc262f88700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc25c09e480 0x7fc25c13bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:37.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.308+0000 7fc262f88700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc25c0a2600 con 0x7fc25c09d920 2023-09-30T22:28:37.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.308+0000 7fc262f88700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc25c0a29d0 con 0x7fc25c09c890 2023-09-30T22:28:37.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.308+0000 7fc262f88700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc25c09fb40 con 0x7fc25c09e480 2023-09-30T22:28:37.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.308+0000 7fc261525700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc25c09e480 0x7fc25c13bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:37.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.308+0000 7fc25bfff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc25c09d920 0x7fc25c09dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38876/0 (socket says 172.21.15.40:38876) 2023-09-30T22:28:37.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.308+0000 7fc25bfff700 1 -- 172.21.15.40:0/556583931 learned_addr learned my addr 172.21.15.40:0/556583931 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:37.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.308+0000 7fc260d24700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc25c09c890 0x7fc25c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:37.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.308+0000 7fc25b7fe700 1 -- 172.21.15.40:0/556583931 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 908393715 0 0) 0x7fc25c0a2600 con 0x7fc25c09d920 2023-09-30T22:28:37.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.309+0000 7fc261525700 1 -- 172.21.15.40:0/556583931 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc25c09c890 msgr2=0x7fc25c09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:37.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.309+0000 7fc261525700 1 --2- 172.21.15.40:0/556583931 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc25c09c890 0x7fc25c09cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:37.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.309+0000 7fc261525700 1 -- 172.21.15.40:0/556583931 >> v1:172.21.15.40:6789/0 conn(0x7fc25c09d920 legacy=0x7fc25c09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:37.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.309+0000 7fc261525700 1 -- 172.21.15.40:0/556583931 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc25c09fed0 con 0x7fc25c09e480 2023-09-30T22:28:37.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.309+0000 7fc261525700 1 --2- 172.21.15.40:0/556583931 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc25c09e480 0x7fc25c13bc20 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc254009dc0 tx=0x7fc25400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=681cb0cc46c53201 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:37.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.309+0000 7fc25b7fe700 1 -- 172.21.15.40:0/556583931 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25400e070 con 0x7fc25c09e480 2023-09-30T22:28:37.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.309+0000 7fc25b7fe700 1 -- 172.21.15.40:0/556583931 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc25400bb20 con 0x7fc25c09e480 2023-09-30T22:28:37.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.309+0000 7fc25b7fe700 1 -- 172.21.15.40:0/556583931 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc254012430 con 0x7fc25c09e480 2023-09-30T22:28:37.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.309+0000 7fc262f88700 1 -- 172.21.15.40:0/556583931 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc25c09e480 msgr2=0x7fc25c13bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:37.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.309+0000 7fc262f88700 1 --2- 172.21.15.40:0/556583931 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc25c09e480 0x7fc25c13bc20 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc254009dc0 tx=0x7fc25400b330 comp rx=0 tx=0).stop 2023-09-30T22:28:37.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.309+0000 7fc262f88700 1 -- 172.21.15.40:0/556583931 shutdown_connections 2023-09-30T22:28:37.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.309+0000 7fc262f88700 1 --2- 172.21.15.40:0/556583931 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc25c09e480 0x7fc25c13bc20 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:37.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.309+0000 7fc262f88700 1 --2- 172.21.15.40:0/556583931 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc25c09c890 0x7fc25c09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:37.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.309+0000 7fc262f88700 1 -- 172.21.15.40:0/556583931 >> 172.21.15.40:0/556583931 conn(0x7fc25c0a7080 msgr2=0x7fc25c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:37.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.309+0000 7fc262f88700 1 -- 172.21.15.40:0/556583931 shutdown_connections 2023-09-30T22:28:37.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.310+0000 7fc262f88700 1 -- 172.21.15.40:0/556583931 wait complete. 2023-09-30T22:28:37.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.311+0000 7fc262f88700 1 Processor -- start 2023-09-30T22:28:37.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.311+0000 7fc262f88700 1 -- start start 2023-09-30T22:28:37.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.312+0000 7fc262f88700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc25c09c890 0x7fc25c12d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:37.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.312+0000 7fc262f88700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc25c09d920 0x7fc25c12d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:37.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.312+0000 7fc262f88700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc25c09e480 0x7fc25c12ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:37.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.312+0000 7fc262f88700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc25c130a20 con 0x7fc25c09c890 2023-09-30T22:28:37.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.312+0000 7fc262f88700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc25c130c00 con 0x7fc25c09e480 2023-09-30T22:28:37.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.312+0000 7fc262f88700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc25c0a5b40 con 0x7fc25c09d920 2023-09-30T22:28:37.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.312+0000 7fc260d24700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc25c09c890 0x7fc25c12d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:37.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.312+0000 7fc25bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc25c09d920 0x7fc25c12d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:37.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.312+0000 7fc260d24700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc25c09c890 0x7fc25c12d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40476/0 (socket says 172.21.15.40:40476) 2023-09-30T22:28:37.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.312+0000 7fc260d24700 1 -- 172.21.15.40:0/1336814 learned_addr learned my addr 172.21.15.40:0/1336814 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:37.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.312+0000 7fc261525700 1 --2- 172.21.15.40:0/1336814 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc25c09e480 0x7fc25c12ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:37.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.312+0000 7fc25bfff700 1 -- 172.21.15.40:0/1336814 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc25c09e480 msgr2=0x7fc25c12ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:37.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.312+0000 7fc25bfff700 1 --2- 172.21.15.40:0/1336814 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc25c09e480 0x7fc25c12ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:37.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.312+0000 7fc25bfff700 1 -- 172.21.15.40:0/1336814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc25c09c890 msgr2=0x7fc25c12d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:37.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.312+0000 7fc25bfff700 1 --2- 172.21.15.40:0/1336814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc25c09c890 0x7fc25c12d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:37.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.312+0000 7fc25bfff700 1 -- 172.21.15.40:0/1336814 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc254009a70 con 0x7fc25c09d920 2023-09-30T22:28:37.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.312+0000 7fc260d24700 1 --2- 172.21.15.40:0/1336814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc25c09c890 0x7fc25c12d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:37.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.312+0000 7fc25bfff700 1 --2- 172.21.15.40:0/1336814 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc25c09d920 0x7fc25c12d880 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc25000c470 tx=0x7fc25000c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:37.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.312+0000 7fc2597fa700 1 -- 172.21.15.40:0/1336814 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc250004c80 con 0x7fc25c09d920 2023-09-30T22:28:37.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.312+0000 7fc2597fa700 1 -- 172.21.15.40:0/1336814 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc250004de0 con 0x7fc25c09d920 2023-09-30T22:28:37.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.312+0000 7fc262f88700 1 -- 172.21.15.40:0/1336814 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc25c09ecf0 con 0x7fc25c09d920 2023-09-30T22:28:37.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.312+0000 7fc2597fa700 1 -- 172.21.15.40:0/1336814 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc250007310 con 0x7fc25c09d920 2023-09-30T22:28:37.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.312+0000 7fc262f88700 1 -- 172.21.15.40:0/1336814 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc25c12f200 con 0x7fc25c09d920 2023-09-30T22:28:37.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.313+0000 7fc2597fa700 1 -- 172.21.15.40:0/1336814 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc250007470 con 0x7fc25c09d920 2023-09-30T22:28:37.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.313+0000 7fc262f88700 1 -- 172.21.15.40:0/1336814 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc25c070610 con 0x7fc25c09d920 2023-09-30T22:28:37.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.313+0000 7fc2597fa700 1 -- 172.21.15.40:0/1336814 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc25003f380 con 0x7fc25c09d920 2023-09-30T22:28:37.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.318+0000 7fc2597fa700 1 -- 172.21.15.40:0/1336814 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc250007720 con 0x7fc25c09d920 2023-09-30T22:28:37.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.515+0000 7fc262f88700 1 -- 172.21.15.40:0/1336814 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc25c12fae0 con 0x7fc25c09d920 2023-09-30T22:28:37.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.515+0000 7fc2597fa700 1 -- 172.21.15.40:0/1336814 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc25001b7b0 con 0x7fc25c09d920 2023-09-30T22:28:37.516 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:37.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.517+0000 7fc262f88700 1 -- 172.21.15.40:0/1336814 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc25c09d920 msgr2=0x7fc25c12d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:37.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.517+0000 7fc262f88700 1 --2- 172.21.15.40:0/1336814 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc25c09d920 0x7fc25c12d880 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc25000c470 tx=0x7fc25000c780 comp rx=0 tx=0).stop 2023-09-30T22:28:37.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.517+0000 7fc262f88700 1 -- 172.21.15.40:0/1336814 shutdown_connections 2023-09-30T22:28:37.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.517+0000 7fc262f88700 1 --2- 172.21.15.40:0/1336814 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc25c09e480 0x7fc25c12ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:37.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.517+0000 7fc262f88700 1 --2- 172.21.15.40:0/1336814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc25c09c890 0x7fc25c12d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:37.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.517+0000 7fc262f88700 1 --2- 172.21.15.40:0/1336814 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc25c09d920 0x7fc25c12d880 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:37.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.517+0000 7fc262f88700 1 -- 172.21.15.40:0/1336814 >> 172.21.15.40:0/1336814 conn(0x7fc25c0a7080 msgr2=0x7fc25c133290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:37.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.517+0000 7fc262f88700 1 -- 172.21.15.40:0/1336814 shutdown_connections 2023-09-30T22:28:37.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:37.517+0000 7fc262f88700 1 -- 172.21.15.40:0/1336814 wait complete. 2023-09-30T22:28:37.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:37.910 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:37.941 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:37.994 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:38.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.043+0000 7f8505477700 1 Processor -- start 2023-09-30T22:28:38.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.043+0000 7f8505477700 1 -- start start 2023-09-30T22:28:38.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.043+0000 7f8505477700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f850006fb50 0x7f8500136c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:38.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.043+0000 7f8505477700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f85001371b0 0x7f8500139590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:38.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.043+0000 7f8505477700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8500070830 con 0x7f850006f070 2023-09-30T22:28:38.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.043+0000 7f8505477700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8500070ad0 con 0x7f850006fb50 2023-09-30T22:28:38.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.043+0000 7f8505477700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8500070de0 con 0x7f85001371b0 2023-09-30T22:28:38.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.044+0000 7f84feffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f850006f070 0x7f850006f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38882/0 (socket says 172.21.15.40:38882) 2023-09-30T22:28:38.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.044+0000 7f84feffd700 1 -- 172.21.15.40:0/2567436155 learned_addr learned my addr 172.21.15.40:0/2567436155 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:38.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.044+0000 7f84fe7fc700 1 --2- 172.21.15.40:0/2567436155 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f850006fb50 0x7f8500136c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:38.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.044+0000 7f84ff7fe700 1 --2- 172.21.15.40:0/2567436155 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f85001371b0 0x7f8500139590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:38.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.044+0000 7f84ff7fe700 1 -- 172.21.15.40:0/2567436155 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f850006fb50 msgr2=0x7f8500136c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:38.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.044+0000 7f84ff7fe700 1 --2- 172.21.15.40:0/2567436155 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f850006fb50 0x7f8500136c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.044+0000 7f84ff7fe700 1 -- 172.21.15.40:0/2567436155 >> v1:172.21.15.40:6789/0 conn(0x7f850006f070 legacy=0x7f850006f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:38.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.044+0000 7f84ff7fe700 1 -- 172.21.15.40:0/2567436155 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850009fe20 con 0x7f85001371b0 2023-09-30T22:28:38.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.044+0000 7f84fe7fc700 1 --2- 172.21.15.40:0/2567436155 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f850006fb50 0x7f8500136c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:38.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.044+0000 7f84ff7fe700 1 --2- 172.21.15.40:0/2567436155 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f85001371b0 0x7f8500139590 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f84f8009dc0 tx=0x7f84f800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d29e1acfc9774a2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:38.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.044+0000 7f84fdffb700 1 -- 172.21.15.40:0/2567436155 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f800e070 con 0x7f85001371b0 2023-09-30T22:28:38.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.044+0000 7f84fdffb700 1 -- 172.21.15.40:0/2567436155 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f800bb20 con 0x7f85001371b0 2023-09-30T22:28:38.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.044+0000 7f84fdffb700 1 -- 172.21.15.40:0/2567436155 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f8012430 con 0x7f85001371b0 2023-09-30T22:28:38.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.045+0000 7f8505477700 1 -- 172.21.15.40:0/2567436155 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f85001371b0 msgr2=0x7f8500139590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:38.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.045+0000 7f8505477700 1 --2- 172.21.15.40:0/2567436155 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f85001371b0 0x7f8500139590 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f84f8009dc0 tx=0x7f84f800b330 comp rx=0 tx=0).stop 2023-09-30T22:28:38.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.045+0000 7f8505477700 1 -- 172.21.15.40:0/2567436155 shutdown_connections 2023-09-30T22:28:38.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.045+0000 7f8505477700 1 --2- 172.21.15.40:0/2567436155 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f85001371b0 0x7f8500139590 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.045+0000 7f8505477700 1 --2- 172.21.15.40:0/2567436155 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f850006fb50 0x7f8500136c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.045+0000 7f8505477700 1 -- 172.21.15.40:0/2567436155 >> 172.21.15.40:0/2567436155 conn(0x7f85000a41a0 msgr2=0x7f85000a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:38.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.045+0000 7f8505477700 1 -- 172.21.15.40:0/2567436155 shutdown_connections 2023-09-30T22:28:38.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.045+0000 7f8505477700 1 -- 172.21.15.40:0/2567436155 wait complete. 2023-09-30T22:28:38.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.046+0000 7f8505477700 1 Processor -- start 2023-09-30T22:28:38.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.046+0000 7f8505477700 1 -- start start 2023-09-30T22:28:38.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.047+0000 7f8505477700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f850006f070 0x7f85001c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:38.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.047+0000 7f8505477700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f850006fb50 0x7f85001c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:38.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.047+0000 7f8505477700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85001371b0 0x7f850012e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:38.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.047+0000 7f8505477700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850012c2d0 con 0x7f850006fb50 2023-09-30T22:28:38.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.047+0000 7f8505477700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850009ac40 con 0x7f85001371b0 2023-09-30T22:28:38.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.047+0000 7f8505477700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85001bc3a0 con 0x7f850006f070 2023-09-30T22:28:38.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.047+0000 7f84feffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f850006f070 0x7f85001c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:38.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.047+0000 7f84feffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f850006f070 0x7f85001c8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:36346/0 (socket says 172.21.15.40:36346) 2023-09-30T22:28:38.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.047+0000 7f84feffd700 1 -- 172.21.15.40:0/3822246957 learned_addr learned my addr 172.21.15.40:0/3822246957 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:38.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.047+0000 7f84ff7fe700 1 --2- 172.21.15.40:0/3822246957 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85001371b0 0x7f850012e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:38.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.047+0000 7f84fe7fc700 1 --2- 172.21.15.40:0/3822246957 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f850006fb50 0x7f85001c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:38.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.047+0000 7f84ff7fe700 1 -- 172.21.15.40:0/3822246957 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f850006f070 msgr2=0x7f85001c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:38.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.047+0000 7f84ff7fe700 1 --2- 172.21.15.40:0/3822246957 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f850006f070 0x7f85001c8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.047+0000 7f84ff7fe700 1 -- 172.21.15.40:0/3822246957 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f850006fb50 msgr2=0x7f85001c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:38.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.047+0000 7f84ff7fe700 1 --2- 172.21.15.40:0/3822246957 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f850006fb50 0x7f85001c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.047+0000 7f84ff7fe700 1 -- 172.21.15.40:0/3822246957 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f40094a0 con 0x7f85001371b0 2023-09-30T22:28:38.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.047+0000 7f84feffd700 1 --2- 172.21.15.40:0/3822246957 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f850006f070 0x7f85001c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:38.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.047+0000 7f84ff7fe700 1 --2- 172.21.15.40:0/3822246957 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85001371b0 0x7f850012e740 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8500068500 tx=0x7f84f8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:38.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.048+0000 7f84e77fe700 1 -- 172.21.15.40:0/3822246957 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f8012430 con 0x7f85001371b0 2023-09-30T22:28:38.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.048+0000 7f84e77fe700 1 -- 172.21.15.40:0/3822246957 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f8020070 con 0x7f85001371b0 2023-09-30T22:28:38.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.048+0000 7f84e77fe700 1 -- 172.21.15.40:0/3822246957 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f8004280 con 0x7f85001371b0 2023-09-30T22:28:38.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.048+0000 7f8505477700 1 -- 172.21.15.40:0/3822246957 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84f8009a70 con 0x7f85001371b0 2023-09-30T22:28:38.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.048+0000 7f8505477700 1 -- 172.21.15.40:0/3822246957 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f850006e670 con 0x7f85001371b0 2023-09-30T22:28:38.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.048+0000 7f84e77fe700 1 -- 172.21.15.40:0/3822246957 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f84f80043e0 con 0x7f85001371b0 2023-09-30T22:28:38.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.049+0000 7f84e77fe700 1 -- 172.21.15.40:0/3822246957 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f84f8022070 con 0x7f85001371b0 2023-09-30T22:28:38.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.049+0000 7f8505477700 1 -- 172.21.15.40:0/3822246957 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8500131d90 con 0x7f85001371b0 2023-09-30T22:28:38.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.054+0000 7f84e77fe700 1 -- 172.21.15.40:0/3822246957 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8500131d90 con 0x7f85001371b0 2023-09-30T22:28:38.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.086+0000 7f26d6d30700 1 Processor -- start 2023-09-30T22:28:38.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.086+0000 7f26d6d30700 1 -- start start 2023-09-30T22:28:38.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.086+0000 7f26d6d30700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f26d00a0590 0x7f26d006d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:38.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.086+0000 7f26d6d30700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26d0139380 0x7f26d013b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:38.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.086+0000 7f26d6d30700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26d00a0a20 con 0x7f26d009fbb0 2023-09-30T22:28:38.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.086+0000 7f26d6d30700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26d009ff80 con 0x7f26d00a0590 2023-09-30T22:28:38.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.086+0000 7f26d6d30700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26d006da80 con 0x7f26d0139380 2023-09-30T22:28:38.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.087+0000 7f26cffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f26d00a0590 0x7f26d006d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:38.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.087+0000 7f26cffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f26d00a0590 0x7f26d006d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40508/0 (socket says 172.21.15.40:40508) 2023-09-30T22:28:38.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.087+0000 7f26cffff700 1 -- 172.21.15.40:0/1521840852 learned_addr learned my addr 172.21.15.40:0/1521840852 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:38.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.087+0000 7f26d52cd700 1 --2- 172.21.15.40:0/1521840852 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26d0139380 0x7f26d013b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:38.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.087+0000 7f26cffff700 1 -- 172.21.15.40:0/1521840852 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26d0139380 msgr2=0x7f26d013b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:38.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.087+0000 7f26cffff700 1 --2- 172.21.15.40:0/1521840852 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26d0139380 0x7f26d013b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.087+0000 7f26cffff700 1 -- 172.21.15.40:0/1521840852 >> v1:172.21.15.40:6789/0 conn(0x7f26d009fbb0 legacy=0x7f26d006c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:38.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.087+0000 7f26cffff700 1 -- 172.21.15.40:0/1521840852 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d009b1d0 con 0x7f26d00a0590 2023-09-30T22:28:38.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.087+0000 7f26cffff700 1 --2- 172.21.15.40:0/1521840852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26d00a0590 0x7f26d006d0a0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f26bc0098f0 tx=0x7f26bc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46b43ec7ac3b8b4a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:38.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.087+0000 7f26cf7fe700 1 -- 172.21.15.40:0/1521840852 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc011830 con 0x7f26d00a0590 2023-09-30T22:28:38.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.087+0000 7f26cf7fe700 1 -- 172.21.15.40:0/1521840852 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26bc011990 con 0x7f26d00a0590 2023-09-30T22:28:38.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.087+0000 7f26cf7fe700 1 -- 172.21.15.40:0/1521840852 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc011d20 con 0x7f26d00a0590 2023-09-30T22:28:38.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.088+0000 7f26d6d30700 1 -- 172.21.15.40:0/1521840852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26d00a0590 msgr2=0x7f26d006d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:38.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.088+0000 7f26d6d30700 1 --2- 172.21.15.40:0/1521840852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26d00a0590 0x7f26d006d0a0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f26bc0098f0 tx=0x7f26bc009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:38.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.088+0000 7f26d6d30700 1 -- 172.21.15.40:0/1521840852 shutdown_connections 2023-09-30T22:28:38.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.088+0000 7f26d6d30700 1 --2- 172.21.15.40:0/1521840852 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26d0139380 0x7f26d013b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.088+0000 7f26d6d30700 1 --2- 172.21.15.40:0/1521840852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26d00a0590 0x7f26d006d0a0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.088+0000 7f26d6d30700 1 -- 172.21.15.40:0/1521840852 >> 172.21.15.40:0/1521840852 conn(0x7f26d00a41a0 msgr2=0x7f26d00a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:38.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.088+0000 7f26d6d30700 1 -- 172.21.15.40:0/1521840852 shutdown_connections 2023-09-30T22:28:38.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.088+0000 7f26d6d30700 1 -- 172.21.15.40:0/1521840852 wait complete. 2023-09-30T22:28:38.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.089+0000 7f26d6d30700 1 Processor -- start 2023-09-30T22:28:38.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.089+0000 7f26d6d30700 1 -- start start 2023-09-30T22:28:38.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.090+0000 7f26d6d30700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26d009fbb0 0x7f26d0138980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:38.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.090+0000 7f26d6d30700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26d00a0590 0x7f26d0095c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:38.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.090+0000 7f26d6d30700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f26d0139380 0x7f26d0096140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:38.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.090+0000 7f26d6d30700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d0093110 con 0x7f26d009fbb0 2023-09-30T22:28:38.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.090+0000 7f26d6d30700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26d0094db0 con 0x7f26d00a0590 2023-09-30T22:28:38.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.090+0000 7f26d6d30700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26d00936c0 con 0x7f26d0139380 2023-09-30T22:28:38.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.091+0000 7f26cffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26d00a0590 0x7f26d0095c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:38.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.091+0000 7f26cffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26d00a0590 0x7f26d0095c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:46996/0 (socket says 172.21.15.40:46996) 2023-09-30T22:28:38.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.091+0000 7f26cffff700 1 -- 172.21.15.40:0/4280719470 learned_addr learned my addr 172.21.15.40:0/4280719470 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:38.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.091+0000 7f26d52cd700 1 --2- 172.21.15.40:0/4280719470 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f26d0139380 0x7f26d0096140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:38.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.091+0000 7f26d4acc700 1 --2- 172.21.15.40:0/4280719470 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26d009fbb0 0x7f26d0138980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:38.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.091+0000 7f26cffff700 1 -- 172.21.15.40:0/4280719470 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f26d0139380 msgr2=0x7f26d0096140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:38.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.091+0000 7f26cffff700 1 --2- 172.21.15.40:0/4280719470 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f26d0139380 0x7f26d0096140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.091+0000 7f26cffff700 1 -- 172.21.15.40:0/4280719470 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26d009fbb0 msgr2=0x7f26d0138980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:38.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.091+0000 7f26cffff700 1 --2- 172.21.15.40:0/4280719470 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26d009fbb0 0x7f26d0138980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.091+0000 7f26cffff700 1 -- 172.21.15.40:0/4280719470 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26bc009550 con 0x7f26d00a0590 2023-09-30T22:28:38.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.091+0000 7f26cffff700 1 --2- 172.21.15.40:0/4280719470 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26d00a0590 0x7f26d0095c00 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f26bc009c40 tx=0x7f26bc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:38.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.091+0000 7f26d4acc700 1 --2- 172.21.15.40:0/4280719470 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26d009fbb0 0x7f26d0138980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:38.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.091+0000 7f26cd7fa700 1 -- 172.21.15.40:0/4280719470 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc004400 con 0x7f26d00a0590 2023-09-30T22:28:38.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.091+0000 7f26cd7fa700 1 -- 172.21.15.40:0/4280719470 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26bc01f070 con 0x7f26d00a0590 2023-09-30T22:28:38.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.091+0000 7f26d6d30700 1 -- 172.21.15.40:0/4280719470 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26d0071100 con 0x7f26d00a0590 2023-09-30T22:28:38.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.091+0000 7f26cd7fa700 1 -- 172.21.15.40:0/4280719470 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc0038a0 con 0x7f26d00a0590 2023-09-30T22:28:38.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.091+0000 7f26d6d30700 1 -- 172.21.15.40:0/4280719470 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26d0095020 con 0x7f26d00a0590 2023-09-30T22:28:38.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.092+0000 7f26cd7fa700 1 -- 172.21.15.40:0/4280719470 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f26bc021030 con 0x7f26d00a0590 2023-09-30T22:28:38.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.092+0000 7f26cd7fa700 1 -- 172.21.15.40:0/4280719470 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f26bc040a70 con 0x7f26d00a0590 2023-09-30T22:28:38.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.093+0000 7f26d6d30700 1 -- 172.21.15.40:0/4280719470 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26d0062380 con 0x7f26d00a0590 2023-09-30T22:28:38.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.097+0000 7f26cd7fa700 1 -- 172.21.15.40:0/4280719470 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f26bc015080 con 0x7f26d00a0590 2023-09-30T22:28:38.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.130+0000 7f4e2e5a3700 1 Processor -- start 2023-09-30T22:28:38.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.130+0000 7f4e2e5a3700 1 -- start start 2023-09-30T22:28:38.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.130+0000 7f4e2e5a3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e2809d920 0x7f4e2809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:38.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.131+0000 7f4e2e5a3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4e2809e230 0x7f4e281343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:38.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.131+0000 7f4e2e5a3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e2809f940 con 0x7f4e2809f0f0 2023-09-30T22:28:38.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.131+0000 7f4e2e5a3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e2806b4c0 con 0x7f4e2809e230 2023-09-30T22:28:38.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.131+0000 7f4e2e5a3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2809a8f0 con 0x7f4e2809d920 2023-09-30T22:28:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.131+0000 7f4e27fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e2809d920 0x7f4e2809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.131+0000 7f4e2cb40700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4e2809e230 0x7f4e281343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.131+0000 7f4e2cb40700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4e2809e230 0x7f4e281343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40532/0 (socket says 172.21.15.40:40532) 2023-09-30T22:28:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.131+0000 7f4e27fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e2809d920 0x7f4e2809dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:36364/0 (socket says 172.21.15.40:36364) 2023-09-30T22:28:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.131+0000 7f4e2cb40700 1 -- 172.21.15.40:0/294469917 learned_addr learned my addr 172.21.15.40:0/294469917 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.131+0000 7f4e2cb40700 1 -- 172.21.15.40:0/294469917 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e2809d920 msgr2=0x7f4e2809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.131+0000 7f4e2cb40700 1 --2- 172.21.15.40:0/294469917 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e2809d920 0x7f4e2809dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.131+0000 7f4e2cb40700 1 -- 172.21.15.40:0/294469917 >> v1:172.21.15.40:6789/0 conn(0x7f4e2809f0f0 legacy=0x7f4e28133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.131+0000 7f4e2cb40700 1 -- 172.21.15.40:0/294469917 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e2809f6e0 con 0x7f4e2809e230 2023-09-30T22:28:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.131+0000 7f4e26ffd700 1 -- 172.21.15.40:0/294469917 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 19078249 0 0) 0x7f4e2809f940 con 0x7f4e2809f0f0 2023-09-30T22:28:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.131+0000 7f4e27fff700 1 --2- 172.21.15.40:0/294469917 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e2809d920 0x7f4e2809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.131+0000 7f4e2cb40700 1 --2- 172.21.15.40:0/294469917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e2809e230 0x7f4e281343b0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f4e20009e80 tx=0x7f4e2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3392270eb263aa2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.131+0000 7f4e26ffd700 1 -- 172.21.15.40:0/294469917 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2000e070 con 0x7f4e2809e230 2023-09-30T22:28:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.131+0000 7f4e26ffd700 1 -- 172.21.15.40:0/294469917 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2000b8d0 con 0x7f4e2809e230 2023-09-30T22:28:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.131+0000 7f4e26ffd700 1 -- 172.21.15.40:0/294469917 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2000bc80 con 0x7f4e2809e230 2023-09-30T22:28:38.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.132+0000 7f4e2e5a3700 1 -- 172.21.15.40:0/294469917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e2809e230 msgr2=0x7f4e281343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.132+0000 7f4e2e5a3700 1 --2- 172.21.15.40:0/294469917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e2809e230 0x7f4e281343b0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f4e20009e80 tx=0x7f4e2000b330 comp rx=0 tx=0).stop 2023-09-30T22:28:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.132+0000 7f4e2e5a3700 1 -- 172.21.15.40:0/294469917 shutdown_connections 2023-09-30T22:28:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.132+0000 7f4e2e5a3700 1 --2- 172.21.15.40:0/294469917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e2809e230 0x7f4e281343b0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.132+0000 7f4e2e5a3700 1 --2- 172.21.15.40:0/294469917 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e2809d920 0x7f4e2809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.132+0000 7f4e2e5a3700 1 -- 172.21.15.40:0/294469917 >> 172.21.15.40:0/294469917 conn(0x7f4e2809fb20 msgr2=0x7f4e2809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.132+0000 7f4e2e5a3700 1 -- 172.21.15.40:0/294469917 shutdown_connections 2023-09-30T22:28:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.132+0000 7f4e2e5a3700 1 -- 172.21.15.40:0/294469917 wait complete. 2023-09-30T22:28:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.133+0000 7f4e2e5a3700 1 Processor -- start 2023-09-30T22:28:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.134+0000 7f4e2e5a3700 1 -- start start 2023-09-30T22:28:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.134+0000 7f4e2e5a3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e2809d920 0x7f4e281a61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.134+0000 7f4e2e5a3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e2809e230 0x7f4e281a66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.134+0000 7f4e2e5a3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e281aa180 0x7f4e281a6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.134+0000 7f4e2e5a3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e281a7d70 con 0x7f4e281aa180 2023-09-30T22:28:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.134+0000 7f4e2e5a3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e281a75c0 con 0x7f4e2809e230 2023-09-30T22:28:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.134+0000 7f4e2e5a3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2809c9e0 con 0x7f4e2809d920 2023-09-30T22:28:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.134+0000 7f4e27fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e2809d920 0x7f4e281a61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.134+0000 7f4e27fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e2809d920 0x7f4e281a61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:36370/0 (socket says 172.21.15.40:36370) 2023-09-30T22:28:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.134+0000 7f4e27fff700 1 -- 172.21.15.40:0/3722669526 learned_addr learned my addr 172.21.15.40:0/3722669526 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.134+0000 7f4e2cb40700 1 --2- 172.21.15.40:0/3722669526 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e281aa180 0x7f4e281a6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.135+0000 7f4e277fe700 1 --2- 172.21.15.40:0/3722669526 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e2809e230 0x7f4e281a66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.135+0000 7f4e27fff700 1 -- 172.21.15.40:0/3722669526 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e2809e230 msgr2=0x7f4e281a66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.135+0000 7f4e27fff700 1 --2- 172.21.15.40:0/3722669526 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e2809e230 0x7f4e281a66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.135+0000 7f4e27fff700 1 -- 172.21.15.40:0/3722669526 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e281aa180 msgr2=0x7f4e281a6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.135+0000 7f4e27fff700 1 --2- 172.21.15.40:0/3722669526 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e281aa180 0x7f4e281a6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.135+0000 7f4e27fff700 1 -- 172.21.15.40:0/3722669526 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e18009430 con 0x7f4e2809d920 2023-09-30T22:28:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.135+0000 7f4e27fff700 1 --2- 172.21.15.40:0/3722669526 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e2809d920 0x7f4e281a61a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4e1800ec10 tx=0x7f4e1800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.135+0000 7f4e24ff9700 1 -- 172.21.15.40:0/3722669526 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e18009740 con 0x7f4e2809d920 2023-09-30T22:28:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.135+0000 7f4e24ff9700 1 -- 172.21.15.40:0/3722669526 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e18005a20 con 0x7f4e2809d920 2023-09-30T22:28:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.135+0000 7f4e2e5a3700 1 -- 172.21.15.40:0/3722669526 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e20009b30 con 0x7f4e2809d920 2023-09-30T22:28:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.135+0000 7f4e24ff9700 1 -- 172.21.15.40:0/3722669526 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e18005d90 con 0x7f4e2809d920 2023-09-30T22:28:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.135+0000 7f4e2e5a3700 1 -- 172.21.15.40:0/3722669526 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e280a3330 con 0x7f4e2809d920 2023-09-30T22:28:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.136+0000 7f4e24ff9700 1 -- 172.21.15.40:0/3722669526 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4e1800c850 con 0x7f4e2809d920 2023-09-30T22:28:38.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.136+0000 7f4e24ff9700 1 -- 172.21.15.40:0/3722669526 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4e1803f900 con 0x7f4e2809d920 2023-09-30T22:28:38.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.136+0000 7f4e2e5a3700 1 -- 172.21.15.40:0/3722669526 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e281a9020 con 0x7f4e2809d920 2023-09-30T22:28:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.141+0000 7f4e24ff9700 1 -- 172.21.15.40:0/3722669526 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4e18020070 con 0x7f4e2809d920 2023-09-30T22:28:38.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.271+0000 7f8505477700 1 -- 172.21.15.40:0/3822246957 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8500131d90 con 0x7f85001371b0 2023-09-30T22:28:38.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.271+0000 7f84e77fe700 1 -- 172.21.15.40:0/3822246957 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8500131d90 con 0x7f85001371b0 2023-09-30T22:28:38.272 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.274+0000 7f8505477700 1 -- 172.21.15.40:0/3822246957 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85001371b0 msgr2=0x7f850012e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.274+0000 7f8505477700 1 --2- 172.21.15.40:0/3822246957 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85001371b0 0x7f850012e740 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8500068500 tx=0x7f84f8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.274+0000 7f8505477700 1 -- 172.21.15.40:0/3822246957 shutdown_connections 2023-09-30T22:28:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.274+0000 7f8505477700 1 --2- 172.21.15.40:0/3822246957 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f850006f070 0x7f85001c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.274+0000 7f8505477700 1 --2- 172.21.15.40:0/3822246957 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85001371b0 0x7f850012e740 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.274+0000 7f8505477700 1 --2- 172.21.15.40:0/3822246957 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f850006fb50 0x7f85001c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.274+0000 7f8505477700 1 -- 172.21.15.40:0/3822246957 >> 172.21.15.40:0/3822246957 conn(0x7f85000a41a0 msgr2=0x7f85000a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.274+0000 7f8505477700 1 -- 172.21.15.40:0/3822246957 shutdown_connections 2023-09-30T22:28:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.274+0000 7f8505477700 1 -- 172.21.15.40:0/3822246957 wait complete. 2023-09-30T22:28:38.287 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:38.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.315+0000 7f26d6d30700 1 -- 172.21.15.40:0/4280719470 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f26d0074620 con 0x7f26d00a0590 2023-09-30T22:28:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.315+0000 7f26cd7fa700 1 -- 172.21.15.40:0/4280719470 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f26bc004560 con 0x7f26d00a0590 2023-09-30T22:28:38.316 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:38.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.317+0000 7f26d6d30700 1 -- 172.21.15.40:0/4280719470 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26d00a0590 msgr2=0x7f26d0095c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:38.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.317+0000 7f26d6d30700 1 --2- 172.21.15.40:0/4280719470 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26d00a0590 0x7f26d0095c00 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f26bc009c40 tx=0x7f26bc004750 comp rx=0 tx=0).stop 2023-09-30T22:28:38.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.317+0000 7f26d6d30700 1 -- 172.21.15.40:0/4280719470 shutdown_connections 2023-09-30T22:28:38.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.317+0000 7f26d6d30700 1 --2- 172.21.15.40:0/4280719470 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f26d0139380 0x7f26d0096140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.317+0000 7f26d6d30700 1 --2- 172.21.15.40:0/4280719470 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26d009fbb0 0x7f26d0138980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.317+0000 7f26d6d30700 1 --2- 172.21.15.40:0/4280719470 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26d00a0590 0x7f26d0095c00 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.317+0000 7f26d6d30700 1 -- 172.21.15.40:0/4280719470 >> 172.21.15.40:0/4280719470 conn(0x7f26d00a41a0 msgr2=0x7f26d006f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:38.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.317+0000 7f26d6d30700 1 -- 172.21.15.40:0/4280719470 shutdown_connections 2023-09-30T22:28:38.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.317+0000 7f26d6d30700 1 -- 172.21.15.40:0/4280719470 wait complete. 2023-09-30T22:28:38.330 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:38.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.338+0000 7f4e2e5a3700 1 -- 172.21.15.40:0/3722669526 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4e280a3010 con 0x7f4e2809d920 2023-09-30T22:28:38.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.338+0000 7f4e24ff9700 1 -- 172.21.15.40:0/3722669526 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4e18029090 con 0x7f4e2809d920 2023-09-30T22:28:38.339 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:38.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.340+0000 7f4e2e5a3700 1 -- 172.21.15.40:0/3722669526 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e2809d920 msgr2=0x7f4e281a61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:38.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.340+0000 7f4e2e5a3700 1 --2- 172.21.15.40:0/3722669526 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e2809d920 0x7f4e281a61a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4e1800ec10 tx=0x7f4e1800ef20 comp rx=0 tx=0).stop 2023-09-30T22:28:38.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.340+0000 7f4e2e5a3700 1 -- 172.21.15.40:0/3722669526 shutdown_connections 2023-09-30T22:28:38.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.340+0000 7f4e2e5a3700 1 --2- 172.21.15.40:0/3722669526 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4e2809d920 0x7f4e281a61a0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.340+0000 7f4e2e5a3700 1 --2- 172.21.15.40:0/3722669526 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e281aa180 0x7f4e281a6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.340+0000 7f4e2e5a3700 1 --2- 172.21.15.40:0/3722669526 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4e2809e230 0x7f4e281a66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.340+0000 7f4e2e5a3700 1 -- 172.21.15.40:0/3722669526 >> 172.21.15.40:0/3722669526 conn(0x7f4e2809fb20 msgr2=0x7f4e281bb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:38.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.340+0000 7f4e2e5a3700 1 -- 172.21.15.40:0/3722669526 shutdown_connections 2023-09-30T22:28:38.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.340+0000 7f4e2e5a3700 1 -- 172.21.15.40:0/3722669526 wait complete. 2023-09-30T22:28:38.353 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:38.531 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:38.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.662+0000 7f12df3e9700 1 Processor -- start 2023-09-30T22:28:38.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.662+0000 7f12df3e9700 1 -- start start 2023-09-30T22:28:38.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.663+0000 7f12df3e9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f12d809d920 0x7f12d809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:38.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.663+0000 7f12df3e9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12d809e230 0x7f12d81308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:38.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.663+0000 7f12df3e9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f12d8130de0 0x7f12d8131240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:38.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.663+0000 7f12df3e9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12d809edf0 con 0x7f12d809d920 2023-09-30T22:28:38.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.663+0000 7f12df3e9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d809adf0 con 0x7f12d809e230 2023-09-30T22:28:38.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.663+0000 7f12df3e9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12d809b660 con 0x7f12d8130de0 2023-09-30T22:28:38.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.663+0000 7f12dc984700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12d809e230 0x7f12d81308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:38.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.663+0000 7f12dd185700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f12d809d920 0x7f12d809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:38.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.663+0000 7f12dd986700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f12d8130de0 0x7f12d8131240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:38.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.663+0000 7f12dd185700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f12d809d920 0x7f12d809dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40560/0 (socket says 172.21.15.40:40560) 2023-09-30T22:28:38.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.663+0000 7f12dd185700 1 -- 172.21.15.40:0/3556077541 learned_addr learned my addr 172.21.15.40:0/3556077541 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:38.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.663+0000 7f12dc984700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12d809e230 0x7f12d81308a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:47010/0 (socket says 172.21.15.40:47010) 2023-09-30T22:28:38.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.664+0000 7f12dd185700 1 -- 172.21.15.40:0/3556077541 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f12d8130de0 msgr2=0x7f12d8131240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:38.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.664+0000 7f12dd185700 1 --2- 172.21.15.40:0/3556077541 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f12d8130de0 0x7f12d8131240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.664+0000 7f12dd185700 1 -- 172.21.15.40:0/3556077541 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12d809e230 msgr2=0x7f12d81308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:38.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.664+0000 7f12dd185700 1 --2- 172.21.15.40:0/3556077541 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12d809e230 0x7f12d81308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.664+0000 7f12dd185700 1 -- 172.21.15.40:0/3556077541 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d809a6e0 con 0x7f12d809d920 2023-09-30T22:28:38.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.664+0000 7f12dd986700 1 --2- 172.21.15.40:0/3556077541 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f12d8130de0 0x7f12d8131240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:38.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.664+0000 7f12dc984700 1 --2- 172.21.15.40:0/3556077541 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12d809e230 0x7f12d81308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:38.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.664+0000 7f12dd185700 1 --2- 172.21.15.40:0/3556077541 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12d809d920 0x7f12d809dcf0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f12d4006fd0 tx=0x7f12d4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e5838834a6cf779 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:38.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.664+0000 7f12cffff700 1 -- 172.21.15.40:0/3556077541 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d4005e30 con 0x7f12d809d920 2023-09-30T22:28:38.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.664+0000 7f12cffff700 1 -- 172.21.15.40:0/3556077541 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d4004030 con 0x7f12d809d920 2023-09-30T22:28:38.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.664+0000 7f12cffff700 1 -- 172.21.15.40:0/3556077541 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d40043e0 con 0x7f12d809d920 2023-09-30T22:28:38.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.664+0000 7f12df3e9700 1 -- 172.21.15.40:0/3556077541 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12d809d920 msgr2=0x7f12d809dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:38.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.664+0000 7f12df3e9700 1 --2- 172.21.15.40:0/3556077541 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12d809d920 0x7f12d809dcf0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f12d4006fd0 tx=0x7f12d4009bd0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.664+0000 7f12df3e9700 1 -- 172.21.15.40:0/3556077541 shutdown_connections 2023-09-30T22:28:38.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.664+0000 7f12df3e9700 1 --2- 172.21.15.40:0/3556077541 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f12d8130de0 0x7f12d8131240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.664+0000 7f12df3e9700 1 --2- 172.21.15.40:0/3556077541 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12d809d920 0x7f12d809dcf0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.664+0000 7f12df3e9700 1 --2- 172.21.15.40:0/3556077541 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12d809e230 0x7f12d81308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.664+0000 7f12df3e9700 1 -- 172.21.15.40:0/3556077541 >> 172.21.15.40:0/3556077541 conn(0x7f12d809fb20 msgr2=0x7f12d809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:38.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.664+0000 7f12df3e9700 1 -- 172.21.15.40:0/3556077541 shutdown_connections 2023-09-30T22:28:38.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.665+0000 7f12df3e9700 1 -- 172.21.15.40:0/3556077541 wait complete. 2023-09-30T22:28:38.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.665+0000 7f12df3e9700 1 Processor -- start 2023-09-30T22:28:38.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.665+0000 7f12df3e9700 1 -- start start 2023-09-30T22:28:38.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.666+0000 7f12df3e9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12d809d920 0x7f12d81201d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:38.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.666+0000 7f12df3e9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12d809e230 0x7f12d8120710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:38.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.666+0000 7f12df3e9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f12d8130de0 0x7f12d8120c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:38.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.666+0000 7f12df3e9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d8121fd0 con 0x7f12d809e230 2023-09-30T22:28:38.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.666+0000 7f12df3e9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d8121de0 con 0x7f12d809d920 2023-09-30T22:28:38.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.666+0000 7f12df3e9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12d81226b0 con 0x7f12d8130de0 2023-09-30T22:28:38.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.666+0000 7f12dc984700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12d809e230 0x7f12d8120710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:38.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.666+0000 7f12dc984700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12d809e230 0x7f12d8120710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40570/0 (socket says 172.21.15.40:40570) 2023-09-30T22:28:38.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.666+0000 7f12dc984700 1 -- 172.21.15.40:0/1731232475 learned_addr learned my addr 172.21.15.40:0/1731232475 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:38.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.666+0000 7f12dd185700 1 --2- 172.21.15.40:0/1731232475 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12d809d920 0x7f12d81201d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:38.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.666+0000 7f12dd986700 1 --2- 172.21.15.40:0/1731232475 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f12d8130de0 0x7f12d8120c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:38.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.666+0000 7f12dc984700 1 -- 172.21.15.40:0/1731232475 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f12d8130de0 msgr2=0x7f12d8120c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:38.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.666+0000 7f12dc984700 1 --2- 172.21.15.40:0/1731232475 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f12d8130de0 0x7f12d8120c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.666+0000 7f12dc984700 1 -- 172.21.15.40:0/1731232475 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12d809d920 msgr2=0x7f12d81201d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:38.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.666+0000 7f12dc984700 1 --2- 172.21.15.40:0/1731232475 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12d809d920 0x7f12d81201d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.666+0000 7f12dc984700 1 -- 172.21.15.40:0/1731232475 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c80094a0 con 0x7f12d809e230 2023-09-30T22:28:38.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.666+0000 7f12dd185700 1 --2- 172.21.15.40:0/1731232475 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12d809d920 0x7f12d81201d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:38.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.666+0000 7f12dd986700 1 --2- 172.21.15.40:0/1731232475 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f12d8130de0 0x7f12d8120c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:38.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.666+0000 7f12dc984700 1 --2- 172.21.15.40:0/1731232475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12d809e230 0x7f12d8120710 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f12c800ec10 tx=0x7f12c800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:38.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.667+0000 7f12cdffb700 1 -- 172.21.15.40:0/1731232475 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c800c850 con 0x7f12d809e230 2023-09-30T22:28:38.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.667+0000 7f12cdffb700 1 -- 172.21.15.40:0/1731232475 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c800c9b0 con 0x7f12d809e230 2023-09-30T22:28:38.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.667+0000 7f12df3e9700 1 -- 172.21.15.40:0/1731232475 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12d0009a70 con 0x7f12d809e230 2023-09-30T22:28:38.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.667+0000 7f12cdffb700 1 -- 172.21.15.40:0/1731232475 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c800cd40 con 0x7f12d809e230 2023-09-30T22:28:38.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.667+0000 7f12df3e9700 1 -- 172.21.15.40:0/1731232475 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d4009500 con 0x7f12d809e230 2023-09-30T22:28:38.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.668+0000 7f12cdffb700 1 -- 172.21.15.40:0/1731232475 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f12c8013470 con 0x7f12d809e230 2023-09-30T22:28:38.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.668+0000 7f12cdffb700 1 -- 172.21.15.40:0/1731232475 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f12c803f840 con 0x7f12d809e230 2023-09-30T22:28:38.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.668+0000 7f12df3e9700 1 -- 172.21.15.40:0/1731232475 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12d8062380 con 0x7f12d809e230 2023-09-30T22:28:38.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.673+0000 7f12cdffb700 1 -- 172.21.15.40:0/1731232475 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f12c8017070 con 0x7f12d809e230 2023-09-30T22:28:38.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.866+0000 7f12df3e9700 1 -- 172.21.15.40:0/1731232475 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f12d8074720 con 0x7f12d809e230 2023-09-30T22:28:38.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.867+0000 7f12cdffb700 1 -- 172.21.15.40:0/1731232475 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f12c8013720 con 0x7f12d809e230 2023-09-30T22:28:38.868 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:38.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.869+0000 7f12df3e9700 1 -- 172.21.15.40:0/1731232475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12d809e230 msgr2=0x7f12d8120710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:38.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.869+0000 7f12df3e9700 1 --2- 172.21.15.40:0/1731232475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12d809e230 0x7f12d8120710 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f12c800ec10 tx=0x7f12c800ef20 comp rx=0 tx=0).stop 2023-09-30T22:28:38.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.869+0000 7f12df3e9700 1 -- 172.21.15.40:0/1731232475 shutdown_connections 2023-09-30T22:28:38.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.869+0000 7f12df3e9700 1 --2- 172.21.15.40:0/1731232475 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f12d8130de0 0x7f12d8120c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.869+0000 7f12df3e9700 1 --2- 172.21.15.40:0/1731232475 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12d809d920 0x7f12d81201d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.869+0000 7f12df3e9700 1 --2- 172.21.15.40:0/1731232475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12d809e230 0x7f12d8120710 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.869+0000 7f12df3e9700 1 -- 172.21.15.40:0/1731232475 >> 172.21.15.40:0/1731232475 conn(0x7f12d809fb20 msgr2=0x7f12d806a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:38.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.869+0000 7f12df3e9700 1 -- 172.21.15.40:0/1731232475 shutdown_connections 2023-09-30T22:28:38.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:38.869+0000 7f12df3e9700 1 -- 172.21.15.40:0/1731232475 wait complete. 2023-09-30T22:28:38.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:39.288 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:39.331 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:39.354 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:39.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.424+0000 7efe1b06f700 1 Processor -- start 2023-09-30T22:28:39.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.424+0000 7efe1b06f700 1 -- start start 2023-09-30T22:28:39.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.425+0000 7efe1b06f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efe1406a6d0 0x7efe1409d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:39.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.425+0000 7efe1b06f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe1409de60 0x7efe1409e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:39.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.425+0000 7efe1b06f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efe1413c490 0x7efe1413e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:39.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.425+0000 7efe1b06f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe1406aaa0 con 0x7efe1413c490 2023-09-30T22:28:39.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.425+0000 7efe1b06f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe1409e790 con 0x7efe1409de60 2023-09-30T22:28:39.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.425+0000 7efe1b06f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe1411d980 con 0x7efe1406a6d0 2023-09-30T22:28:39.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.425+0000 7efe1960c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efe1413c490 0x7efe1413e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:39.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.425+0000 7efe13fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe1409de60 0x7efe1409e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:39.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.425+0000 7efe18e0b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efe1406a6d0 0x7efe1409d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:39.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.425+0000 7efe1960c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efe1413c490 0x7efe1413e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40578/0 (socket says 172.21.15.40:40578) 2023-09-30T22:28:39.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.425+0000 7efe13fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe1409de60 0x7efe1409e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:47028/0 (socket says 172.21.15.40:47028) 2023-09-30T22:28:39.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.425+0000 7efe1960c700 1 -- 172.21.15.40:0/4224248483 learned_addr learned my addr 172.21.15.40:0/4224248483 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:39.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.425+0000 7efe13fff700 1 -- 172.21.15.40:0/4224248483 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efe1406a6d0 msgr2=0x7efe1409d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:39.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.425+0000 7efe13fff700 1 --2- 172.21.15.40:0/4224248483 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efe1406a6d0 0x7efe1409d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.425+0000 7efe13fff700 1 -- 172.21.15.40:0/4224248483 >> v2:172.21.15.40:3300/0 conn(0x7efe1413c490 msgr2=0x7efe1413e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.425+0000 7efe13fff700 1 --2- 172.21.15.40:0/4224248483 >> v2:172.21.15.40:3300/0 conn(0x7efe1413c490 0x7efe1413e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.425+0000 7efe13fff700 1 -- 172.21.15.40:0/4224248483 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe1406b150 con 0x7efe1409de60 2023-09-30T22:28:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.425+0000 7efe1960c700 1 --2- 172.21.15.40:0/4224248483 >> v2:172.21.15.40:3300/0 conn(0x7efe1413c490 0x7efe1413e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.425+0000 7efe18e0b700 1 --2- 172.21.15.40:0/4224248483 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efe1406a6d0 0x7efe1409d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.425+0000 7efe13fff700 1 --2- 172.21.15.40:0/4224248483 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe1409de60 0x7efe1409e250 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7efe00009870 tx=0x7efe00009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c50993c5db662230 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.426+0000 7efe137fe700 1 -- 172.21.15.40:0/4224248483 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe00011830 con 0x7efe1409de60 2023-09-30T22:28:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.426+0000 7efe137fe700 1 -- 172.21.15.40:0/4224248483 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe00011990 con 0x7efe1409de60 2023-09-30T22:28:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.426+0000 7efe137fe700 1 -- 172.21.15.40:0/4224248483 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe00011d20 con 0x7efe1409de60 2023-09-30T22:28:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.426+0000 7efe1b06f700 1 -- 172.21.15.40:0/4224248483 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe1409de60 msgr2=0x7efe1409e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.426+0000 7efe1b06f700 1 --2- 172.21.15.40:0/4224248483 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe1409de60 0x7efe1409e250 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7efe00009870 tx=0x7efe00009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.426+0000 7efe1b06f700 1 -- 172.21.15.40:0/4224248483 shutdown_connections 2023-09-30T22:28:39.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.426+0000 7efe1b06f700 1 --2- 172.21.15.40:0/4224248483 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efe1406a6d0 0x7efe1409d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.426+0000 7efe1b06f700 1 --2- 172.21.15.40:0/4224248483 >> v2:172.21.15.40:3300/0 conn(0x7efe1413c490 0x7efe1413e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.426+0000 7efe1b06f700 1 --2- 172.21.15.40:0/4224248483 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe1409de60 0x7efe1409e250 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.426+0000 7efe1b06f700 1 -- 172.21.15.40:0/4224248483 >> 172.21.15.40:0/4224248483 conn(0x7efe1409fb20 msgr2=0x7efe1409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:39.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.426+0000 7efe1b06f700 1 -- 172.21.15.40:0/4224248483 shutdown_connections 2023-09-30T22:28:39.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.427+0000 7efe1b06f700 1 -- 172.21.15.40:0/4224248483 wait complete. 2023-09-30T22:28:39.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.427+0000 7efe1b06f700 1 Processor -- start 2023-09-30T22:28:39.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.427+0000 7efe1b06f700 1 -- start start 2023-09-30T22:28:39.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.428+0000 7efe1b06f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efe1406a6d0 0x7efe141cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:39.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.428+0000 7efe1b06f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe1409de60 0x7efe141cce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:39.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.428+0000 7efe1b06f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe1413c490 0x7efe141cd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:39.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.428+0000 7efe1b06f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe14128570 con 0x7efe1409de60 2023-09-30T22:28:39.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.428+0000 7efe1b06f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe14128380 con 0x7efe1413c490 2023-09-30T22:28:39.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.428+0000 7efe1b06f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe14128c50 con 0x7efe1406a6d0 2023-09-30T22:28:39.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.428+0000 7efe1960c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe1413c490 0x7efe141cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:39.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.428+0000 7efe1960c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe1413c490 0x7efe141cd390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:47044/0 (socket says 172.21.15.40:47044) 2023-09-30T22:28:39.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.428+0000 7efe18e0b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efe1406a6d0 0x7efe141cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:39.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.428+0000 7efe1960c700 1 -- 172.21.15.40:0/1636982502 learned_addr learned my addr 172.21.15.40:0/1636982502 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:39.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.428+0000 7efe13fff700 1 --2- 172.21.15.40:0/1636982502 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe1409de60 0x7efe141cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:39.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.429+0000 7efe1960c700 1 -- 172.21.15.40:0/1636982502 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efe1406a6d0 msgr2=0x7efe141cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:39.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.429+0000 7efe1960c700 1 --2- 172.21.15.40:0/1636982502 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efe1406a6d0 0x7efe141cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.429+0000 7efe1960c700 1 -- 172.21.15.40:0/1636982502 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe1409de60 msgr2=0x7efe141cce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:39.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.429+0000 7efe1960c700 1 --2- 172.21.15.40:0/1636982502 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe1409de60 0x7efe141cce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.429+0000 7efe1960c700 1 -- 172.21.15.40:0/1636982502 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe08009430 con 0x7efe1413c490 2023-09-30T22:28:39.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.429+0000 7efe18e0b700 1 --2- 172.21.15.40:0/1636982502 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efe1406a6d0 0x7efe141cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:39.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.429+0000 7efe13fff700 1 --2- 172.21.15.40:0/1636982502 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe1409de60 0x7efe141cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:39.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.429+0000 7efe1960c700 1 --2- 172.21.15.40:0/1636982502 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe1413c490 0x7efe141cd390 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7efe0c00efc0 tx=0x7efe0c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:39.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.429+0000 7efe117fa700 1 -- 172.21.15.40:0/1636982502 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c00ca80 con 0x7efe1413c490 2023-09-30T22:28:39.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.429+0000 7efe117fa700 1 -- 172.21.15.40:0/1636982502 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0c00f040 con 0x7efe1413c490 2023-09-30T22:28:39.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.429+0000 7efe1b06f700 1 -- 172.21.15.40:0/1636982502 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe0c009b30 con 0x7efe1413c490 2023-09-30T22:28:39.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.429+0000 7efe117fa700 1 -- 172.21.15.40:0/1636982502 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c00ce20 con 0x7efe1413c490 2023-09-30T22:28:39.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.429+0000 7efe1b06f700 1 -- 172.21.15.40:0/1636982502 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe000094a0 con 0x7efe1413c490 2023-09-30T22:28:39.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.430+0000 7efe117fa700 1 -- 172.21.15.40:0/1636982502 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efe0c014480 con 0x7efe1413c490 2023-09-30T22:28:39.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.430+0000 7efe117fa700 1 -- 172.21.15.40:0/1636982502 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7efe0c03fbf0 con 0x7efe1413c490 2023-09-30T22:28:39.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.430+0000 7efe1b06f700 1 -- 172.21.15.40:0/1636982502 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe14129c50 con 0x7efe1413c490 2023-09-30T22:28:39.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.435+0000 7efe117fa700 1 -- 172.21.15.40:0/1636982502 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efe14129c50 con 0x7efe1413c490 2023-09-30T22:28:39.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.465+0000 7f92d5bdf700 1 Processor -- start 2023-09-30T22:28:39.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.465+0000 7f92d5bdf700 1 -- start start 2023-09-30T22:28:39.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.466+0000 7f92d5bdf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92d006f070 0x7f92d006f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:39.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.466+0000 7f92d5bdf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f92d006f980 0x7f92d0097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:39.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.466+0000 7f92d5bdf700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d0070830 con 0x7f92d006fdb0 2023-09-30T22:28:39.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.466+0000 7f92d5bdf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d0071af0 con 0x7f92d006f070 2023-09-30T22:28:39.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.466+0000 7f92d5bdf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92d0070ad0 con 0x7f92d006f980 2023-09-30T22:28:39.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.466+0000 7f92cffff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f92d006fdb0 0x7f92d00975d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38916/0 (socket says 172.21.15.40:38916) 2023-09-30T22:28:39.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.466+0000 7f92cffff700 1 -- 172.21.15.40:0/941592966 learned_addr learned my addr 172.21.15.40:0/941592966 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:39.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.466+0000 7f92c6ffd700 1 --2- 172.21.15.40:0/941592966 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f92d006f980 0x7f92d0097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:39.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.466+0000 7f92cf7fe700 1 --2- 172.21.15.40:0/941592966 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92d006f070 0x7f92d006f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:39.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.466+0000 7f92c6ffd700 1 -- 172.21.15.40:0/941592966 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92d006f070 msgr2=0x7f92d006f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:39.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.466+0000 7f92c6ffd700 1 --2- 172.21.15.40:0/941592966 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92d006f070 0x7f92d006f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.466+0000 7f92c6ffd700 1 -- 172.21.15.40:0/941592966 >> v1:172.21.15.40:6789/0 conn(0x7f92d006fdb0 legacy=0x7f92d00975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:39.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.466+0000 7f92c6ffd700 1 -- 172.21.15.40:0/941592966 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d0070de0 con 0x7f92d006f980 2023-09-30T22:28:39.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.466+0000 7f92c6ffd700 1 --2- 172.21.15.40:0/941592966 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f92d006f980 0x7f92d0097090 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f92b80098a0 tx=0x7f92b8009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f581ccac634e78b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:39.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.466+0000 7f92ceffd700 1 -- 172.21.15.40:0/941592966 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b8011830 con 0x7f92d006f980 2023-09-30T22:28:39.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.467+0000 7f92ceffd700 1 -- 172.21.15.40:0/941592966 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b8011990 con 0x7f92d006f980 2023-09-30T22:28:39.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.467+0000 7f92ceffd700 1 -- 172.21.15.40:0/941592966 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b8011d20 con 0x7f92d006f980 2023-09-30T22:28:39.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.467+0000 7f92d5bdf700 1 -- 172.21.15.40:0/941592966 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f92d006f980 msgr2=0x7f92d0097090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:39.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.467+0000 7f92d5bdf700 1 --2- 172.21.15.40:0/941592966 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f92d006f980 0x7f92d0097090 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f92b80098a0 tx=0x7f92b8009bb0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.467+0000 7f92d5bdf700 1 -- 172.21.15.40:0/941592966 shutdown_connections 2023-09-30T22:28:39.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.467+0000 7f92d5bdf700 1 --2- 172.21.15.40:0/941592966 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92d006f070 0x7f92d006f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.467+0000 7f92d5bdf700 1 --2- 172.21.15.40:0/941592966 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f92d006f980 0x7f92d0097090 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.467+0000 7f92d5bdf700 1 -- 172.21.15.40:0/941592966 >> 172.21.15.40:0/941592966 conn(0x7f92d00a41a0 msgr2=0x7f92d00a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:39.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.467+0000 7f92d5bdf700 1 -- 172.21.15.40:0/941592966 shutdown_connections 2023-09-30T22:28:39.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.467+0000 7f92d5bdf700 1 -- 172.21.15.40:0/941592966 wait complete. 2023-09-30T22:28:39.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.469+0000 7f92d5bdf700 1 Processor -- start 2023-09-30T22:28:39.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.469+0000 7f92d5bdf700 1 -- start start 2023-09-30T22:28:39.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.469+0000 7f92d5bdf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f92d006f070 0x7f92d01c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:39.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.469+0000 7f92d5bdf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92d006f980 0x7f92d01c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:39.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.469+0000 7f92d5bdf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d006fdb0 0x7f92d01c9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:39.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.469+0000 7f92d5bdf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d008b0f0 con 0x7f92d006fdb0 2023-09-30T22:28:39.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.469+0000 7f92d5bdf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d006dc70 con 0x7f92d006f980 2023-09-30T22:28:39.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.469+0000 7f92d5bdf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92d006c990 con 0x7f92d006f070 2023-09-30T22:28:39.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.469+0000 7f92c6ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92d006f980 0x7f92d01c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:39.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.470+0000 7f92c6ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92d006f980 0x7f92d01c8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:47068/0 (socket says 172.21.15.40:47068) 2023-09-30T22:28:39.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.470+0000 7f92c6ffd700 1 -- 172.21.15.40:0/4165680893 learned_addr learned my addr 172.21.15.40:0/4165680893 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:39.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.470+0000 7f92cf7fe700 1 --2- 172.21.15.40:0/4165680893 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f92d006f070 0x7f92d01c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:39.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.470+0000 7f92cffff700 1 --2- 172.21.15.40:0/4165680893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d006fdb0 0x7f92d01c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:39.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.470+0000 7f92c6ffd700 1 -- 172.21.15.40:0/4165680893 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f92d006f070 msgr2=0x7f92d01c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:39.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.470+0000 7f92c6ffd700 1 --2- 172.21.15.40:0/4165680893 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f92d006f070 0x7f92d01c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.470+0000 7f92c6ffd700 1 -- 172.21.15.40:0/4165680893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d006fdb0 msgr2=0x7f92d01c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:39.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.470+0000 7f92c6ffd700 1 --2- 172.21.15.40:0/4165680893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d006fdb0 0x7f92d01c9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.470+0000 7f92c6ffd700 1 -- 172.21.15.40:0/4165680893 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b80094a0 con 0x7f92d006f980 2023-09-30T22:28:39.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.470+0000 7f92c6ffd700 1 --2- 172.21.15.40:0/4165680893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92d006f980 0x7f92d01c8e10 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f92b8013000 tx=0x7f92b8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:39.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.470+0000 7f92ccff9700 1 -- 172.21.15.40:0/4165680893 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b8004240 con 0x7f92d006f980 2023-09-30T22:28:39.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.470+0000 7f92ccff9700 1 -- 172.21.15.40:0/4165680893 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b801f070 con 0x7f92d006f980 2023-09-30T22:28:39.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.470+0000 7f92d5bdf700 1 -- 172.21.15.40:0/4165680893 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92d01295e0 con 0x7f92d006f980 2023-09-30T22:28:39.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.470+0000 7f92ccff9700 1 -- 172.21.15.40:0/4165680893 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b80045e0 con 0x7f92d006f980 2023-09-30T22:28:39.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.470+0000 7f92d5bdf700 1 -- 172.21.15.40:0/4165680893 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d008b9d0 con 0x7f92d006f980 2023-09-30T22:28:39.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.471+0000 7f92d5bdf700 1 -- 172.21.15.40:0/4165680893 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92b40052e0 con 0x7f92d006f980 2023-09-30T22:28:39.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.472+0000 7f92ccff9700 1 -- 172.21.15.40:0/4165680893 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f92b8021030 con 0x7f92d006f980 2023-09-30T22:28:39.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.472+0000 7f92ccff9700 1 -- 172.21.15.40:0/4165680893 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f92b801b430 con 0x7f92d006f980 2023-09-30T22:28:39.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.476+0000 7f92ccff9700 1 -- 172.21.15.40:0/4165680893 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f92b8045060 con 0x7f92d006f980 2023-09-30T22:28:39.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.516+0000 7f1a32812700 1 Processor -- start 2023-09-30T22:28:39.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.516+0000 7f1a32812700 1 -- start start 2023-09-30T22:28:39.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.517+0000 7f1a32812700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1a2c09c890 0x7f1a2c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:39.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.517+0000 7f1a32812700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a2c09d920 0x7f1a2c09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:39.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.517+0000 7f1a32812700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a2c0a2600 con 0x7f1a2c09e2b0 2023-09-30T22:28:39.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.517+0000 7f1a32812700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a2c0a29d0 con 0x7f1a2c09c890 2023-09-30T22:28:39.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.517+0000 7f1a32812700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c09fb40 con 0x7f1a2c09d920 2023-09-30T22:28:39.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.517+0000 7f1a2bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1a2c09c890 0x7f1a2c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:39.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.517+0000 7f1a2b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a2c09d920 0x7f1a2c09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:39.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.517+0000 7f1a2bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1a2c09c890 0x7f1a2c09cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40616/0 (socket says 172.21.15.40:40616) 2023-09-30T22:28:39.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.517+0000 7f1a2bfff700 1 -- 172.21.15.40:0/1078820094 learned_addr learned my addr 172.21.15.40:0/1078820094 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:39.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.517+0000 7f1a2b7fe700 1 -- 172.21.15.40:0/1078820094 >> v2:172.21.15.40:3300/0 conn(0x7f1a2c09c890 msgr2=0x7f1a2c09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:39.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.517+0000 7f1a2b7fe700 1 --2- 172.21.15.40:0/1078820094 >> v2:172.21.15.40:3300/0 conn(0x7f1a2c09c890 0x7f1a2c09cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.517+0000 7f1a2b7fe700 1 -- 172.21.15.40:0/1078820094 >> v1:172.21.15.40:6789/0 conn(0x7f1a2c09e2b0 legacy=0x7f1a2c13ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:39.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.518+0000 7f1a2b7fe700 1 -- 172.21.15.40:0/1078820094 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2c09e730 con 0x7f1a2c09d920 2023-09-30T22:28:39.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.518+0000 7f1a2bfff700 1 --2- 172.21.15.40:0/1078820094 >> v2:172.21.15.40:3300/0 conn(0x7f1a2c09c890 0x7f1a2c09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:39.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.518+0000 7f1a2b7fe700 1 --2- 172.21.15.40:0/1078820094 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a2c09d920 0x7f1a2c09dd70 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009840 tx=0x7f1a20009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f7fa63f8cf940e0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:39.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.518+0000 7f1a2affd700 1 -- 172.21.15.40:0/1078820094 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a20011830 con 0x7f1a2c09d920 2023-09-30T22:28:39.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.518+0000 7f1a2affd700 1 -- 172.21.15.40:0/1078820094 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a20011990 con 0x7f1a2c09d920 2023-09-30T22:28:39.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.518+0000 7f1a2affd700 1 -- 172.21.15.40:0/1078820094 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a20011d20 con 0x7f1a2c09d920 2023-09-30T22:28:39.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.518+0000 7f1a32812700 1 -- 172.21.15.40:0/1078820094 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a2c09d920 msgr2=0x7f1a2c09dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:39.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.518+0000 7f1a32812700 1 --2- 172.21.15.40:0/1078820094 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a2c09d920 0x7f1a2c09dd70 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009840 tx=0x7f1a20009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:39.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.518+0000 7f1a32812700 1 -- 172.21.15.40:0/1078820094 shutdown_connections 2023-09-30T22:28:39.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.518+0000 7f1a32812700 1 --2- 172.21.15.40:0/1078820094 >> v2:172.21.15.40:3300/0 conn(0x7f1a2c09c890 0x7f1a2c09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.518+0000 7f1a32812700 1 --2- 172.21.15.40:0/1078820094 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a2c09d920 0x7f1a2c09dd70 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.518+0000 7f1a32812700 1 -- 172.21.15.40:0/1078820094 >> 172.21.15.40:0/1078820094 conn(0x7f1a2c0a7080 msgr2=0x7f1a2c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:39.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.519+0000 7f1a32812700 1 -- 172.21.15.40:0/1078820094 shutdown_connections 2023-09-30T22:28:39.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.519+0000 7f1a32812700 1 -- 172.21.15.40:0/1078820094 wait complete. 2023-09-30T22:28:39.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.520+0000 7f1a32812700 1 Processor -- start 2023-09-30T22:28:39.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.520+0000 7f1a32812700 1 -- start start 2023-09-30T22:28:39.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.521+0000 7f1a32812700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1a2c09c890 0x7f1a2c12d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:39.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.521+0000 7f1a32812700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a2c09d920 0x7f1a2c12da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:39.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.521+0000 7f1a32812700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a2c09e2b0 0x7f1a2c12dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:39.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.521+0000 7f1a32812700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c08f480 con 0x7f1a2c09e2b0 2023-09-30T22:28:39.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.521+0000 7f1a32812700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c130a10 con 0x7f1a2c09d920 2023-09-30T22:28:39.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.521+0000 7f1a32812700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c0a5da0 con 0x7f1a2c09c890 2023-09-30T22:28:39.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.521+0000 7f1a2bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1a2c09c890 0x7f1a2c12d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:39.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.521+0000 7f1a2b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a2c09d920 0x7f1a2c12da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:39.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.521+0000 7f1a2bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1a2c09c890 0x7f1a2c12d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:36452/0 (socket says 172.21.15.40:36452) 2023-09-30T22:28:39.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.521+0000 7f1a2b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a2c09d920 0x7f1a2c12da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:47096/0 (socket says 172.21.15.40:47096) 2023-09-30T22:28:39.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.521+0000 7f1a2bfff700 1 -- 172.21.15.40:0/394523033 learned_addr learned my addr 172.21.15.40:0/394523033 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:39.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.521+0000 7f1a30daf700 1 --2- 172.21.15.40:0/394523033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a2c09e2b0 0x7f1a2c12dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:39.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.521+0000 7f1a2b7fe700 1 -- 172.21.15.40:0/394523033 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1a2c09c890 msgr2=0x7f1a2c12d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:39.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.521+0000 7f1a2b7fe700 1 --2- 172.21.15.40:0/394523033 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1a2c09c890 0x7f1a2c12d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.521+0000 7f1a2b7fe700 1 -- 172.21.15.40:0/394523033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a2c09e2b0 msgr2=0x7f1a2c12dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:39.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.521+0000 7f1a2b7fe700 1 --2- 172.21.15.40:0/394523033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a2c09e2b0 0x7f1a2c12dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.521+0000 7f1a2b7fe700 1 -- 172.21.15.40:0/394523033 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a1c009500 con 0x7f1a2c09d920 2023-09-30T22:28:39.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.522+0000 7f1a2b7fe700 1 --2- 172.21.15.40:0/394523033 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a2c09d920 0x7f1a2c12da80 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f1a20016000 tx=0x7f1a20004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:39.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.522+0000 7f1a28ff9700 1 -- 172.21.15.40:0/394523033 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a20004400 con 0x7f1a2c09d920 2023-09-30T22:28:39.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.522+0000 7f1a28ff9700 1 -- 172.21.15.40:0/394523033 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2001f070 con 0x7f1a2c09d920 2023-09-30T22:28:39.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.522+0000 7f1a32812700 1 -- 172.21.15.40:0/394523033 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a200094a0 con 0x7f1a2c09d920 2023-09-30T22:28:39.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.522+0000 7f1a28ff9700 1 -- 172.21.15.40:0/394523033 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a200038e0 con 0x7f1a2c09d920 2023-09-30T22:28:39.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.522+0000 7f1a32812700 1 -- 172.21.15.40:0/394523033 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a2c09ed40 con 0x7f1a2c09d920 2023-09-30T22:28:39.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.523+0000 7f1a28ff9700 1 -- 172.21.15.40:0/394523033 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1a20021030 con 0x7f1a2c09d920 2023-09-30T22:28:39.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.523+0000 7f1a28ff9700 1 -- 172.21.15.40:0/394523033 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f1a20040910 con 0x7f1a2c09d920 2023-09-30T22:28:39.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.523+0000 7f1a32812700 1 -- 172.21.15.40:0/394523033 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a2c130e10 con 0x7f1a2c09d920 2023-09-30T22:28:39.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.530+0000 7f1a28ff9700 1 -- 172.21.15.40:0/394523033 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1a200239c0 con 0x7f1a2c09d920 2023-09-30T22:28:39.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.648+0000 7efe1b06f700 1 -- 172.21.15.40:0/1636982502 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efe14129c50 con 0x7efe1413c490 2023-09-30T22:28:39.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.648+0000 7efe117fa700 1 -- 172.21.15.40:0/1636982502 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efe14129c50 con 0x7efe1413c490 2023-09-30T22:28:39.649 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:39.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.651+0000 7efe1b06f700 1 -- 172.21.15.40:0/1636982502 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe1413c490 msgr2=0x7efe141cd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:39.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.651+0000 7efe1b06f700 1 --2- 172.21.15.40:0/1636982502 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe1413c490 0x7efe141cd390 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7efe0c00efc0 tx=0x7efe0c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.651+0000 7efe1b06f700 1 -- 172.21.15.40:0/1636982502 shutdown_connections 2023-09-30T22:28:39.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.651+0000 7efe1b06f700 1 --2- 172.21.15.40:0/1636982502 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efe1406a6d0 0x7efe141cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.651+0000 7efe1b06f700 1 --2- 172.21.15.40:0/1636982502 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe1413c490 0x7efe141cd390 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.651+0000 7efe1b06f700 1 --2- 172.21.15.40:0/1636982502 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe1409de60 0x7efe141cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.651+0000 7efe1b06f700 1 -- 172.21.15.40:0/1636982502 >> 172.21.15.40:0/1636982502 conn(0x7efe1409fb20 msgr2=0x7efe1413b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:39.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.651+0000 7efe1b06f700 1 -- 172.21.15.40:0/1636982502 shutdown_connections 2023-09-30T22:28:39.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.651+0000 7efe1b06f700 1 -- 172.21.15.40:0/1636982502 wait complete. 2023-09-30T22:28:39.664 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:39.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.680+0000 7f92d5bdf700 1 -- 172.21.15.40:0/4165680893 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f92b4005590 con 0x7f92d006f980 2023-09-30T22:28:39.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.681+0000 7f92ccff9700 1 -- 172.21.15.40:0/4165680893 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f92b8015020 con 0x7f92d006f980 2023-09-30T22:28:39.682 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:39.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.683+0000 7f92d5bdf700 1 -- 172.21.15.40:0/4165680893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92d006f980 msgr2=0x7f92d01c8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:39.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.683+0000 7f92d5bdf700 1 --2- 172.21.15.40:0/4165680893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92d006f980 0x7f92d01c8e10 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f92b8013000 tx=0x7f92b8004750 comp rx=0 tx=0).stop 2023-09-30T22:28:39.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.683+0000 7f92d5bdf700 1 -- 172.21.15.40:0/4165680893 shutdown_connections 2023-09-30T22:28:39.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.683+0000 7f92d5bdf700 1 --2- 172.21.15.40:0/4165680893 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f92d006f070 0x7f92d01c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.683+0000 7f92d5bdf700 1 --2- 172.21.15.40:0/4165680893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d006fdb0 0x7f92d01c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.683+0000 7f92d5bdf700 1 --2- 172.21.15.40:0/4165680893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92d006f980 0x7f92d01c8e10 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.683+0000 7f92d5bdf700 1 -- 172.21.15.40:0/4165680893 >> 172.21.15.40:0/4165680893 conn(0x7f92d00a41a0 msgr2=0x7f92d00973c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:39.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.683+0000 7f92d5bdf700 1 -- 172.21.15.40:0/4165680893 shutdown_connections 2023-09-30T22:28:39.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.683+0000 7f92d5bdf700 1 -- 172.21.15.40:0/4165680893 wait complete. 2023-09-30T22:28:39.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:39.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.728+0000 7f1a32812700 1 -- 172.21.15.40:0/394523033 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1a2c062380 con 0x7f1a2c09d920 2023-09-30T22:28:39.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.729+0000 7f1a28ff9700 1 -- 172.21.15.40:0/394523033 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1a2001b430 con 0x7f1a2c09d920 2023-09-30T22:28:39.729 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:39.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.731+0000 7f1a32812700 1 -- 172.21.15.40:0/394523033 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a2c09d920 msgr2=0x7f1a2c12da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:39.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.731+0000 7f1a32812700 1 --2- 172.21.15.40:0/394523033 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a2c09d920 0x7f1a2c12da80 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f1a20016000 tx=0x7f1a20004750 comp rx=0 tx=0).stop 2023-09-30T22:28:39.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.731+0000 7f1a32812700 1 -- 172.21.15.40:0/394523033 shutdown_connections 2023-09-30T22:28:39.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.731+0000 7f1a32812700 1 --2- 172.21.15.40:0/394523033 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1a2c09c890 0x7f1a2c12d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.731+0000 7f1a32812700 1 --2- 172.21.15.40:0/394523033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a2c09e2b0 0x7f1a2c12dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.731+0000 7f1a32812700 1 --2- 172.21.15.40:0/394523033 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a2c09d920 0x7f1a2c12da80 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.731+0000 7f1a32812700 1 -- 172.21.15.40:0/394523033 >> 172.21.15.40:0/394523033 conn(0x7f1a2c0a7080 msgr2=0x7f1a2c0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:39.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.731+0000 7f1a32812700 1 -- 172.21.15.40:0/394523033 shutdown_connections 2023-09-30T22:28:39.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:39.731+0000 7f1a32812700 1 -- 172.21.15.40:0/394523033 wait complete. 2023-09-30T22:28:39.744 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:39.883 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:40.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.010+0000 7ff743b0d700 1 Processor -- start 2023-09-30T22:28:40.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.010+0000 7ff743b0d700 1 -- start start 2023-09-30T22:28:40.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.010+0000 7ff743b0d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff73c09c890 0x7ff73c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.011+0000 7ff743b0d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff73c09d920 0x7ff73c09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.011+0000 7ff743b0d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff73c0a2600 con 0x7ff73c09e2b0 2023-09-30T22:28:40.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.011+0000 7ff743b0d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c0a29d0 con 0x7ff73c09d920 2023-09-30T22:28:40.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.011+0000 7ff743b0d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c09fb40 con 0x7ff73c09c890 2023-09-30T22:28:40.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.011+0000 7ff7420aa700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff73c09e2b0 0x7ff73c13ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38938/0 (socket says 172.21.15.40:38938) 2023-09-30T22:28:40.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.011+0000 7ff7420aa700 1 -- 172.21.15.40:0/122399489 learned_addr learned my addr 172.21.15.40:0/122399489 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:40.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.011+0000 7ff7418a9700 1 --2- 172.21.15.40:0/122399489 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff73c09c890 0x7ff73c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.011+0000 7ff7410a8700 1 --2- 172.21.15.40:0/122399489 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff73c09d920 0x7ff73c09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.011+0000 7ff7408a7700 1 -- 172.21.15.40:0/122399489 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 573881784 0 0) 0x7ff73c0a2600 con 0x7ff73c09e2b0 2023-09-30T22:28:40.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.011+0000 7ff7418a9700 1 -- 172.21.15.40:0/122399489 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff73c09d920 msgr2=0x7ff73c09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:40.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.011+0000 7ff7418a9700 1 --2- 172.21.15.40:0/122399489 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff73c09d920 0x7ff73c09dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.011+0000 7ff7418a9700 1 -- 172.21.15.40:0/122399489 >> v1:172.21.15.40:6789/0 conn(0x7ff73c09e2b0 legacy=0x7ff73c13ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:40.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.011+0000 7ff7418a9700 1 -- 172.21.15.40:0/122399489 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff73c09e720 con 0x7ff73c09c890 2023-09-30T22:28:40.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.011+0000 7ff7418a9700 1 --2- 172.21.15.40:0/122399489 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff73c09c890 0x7ff73c09cc60 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff72c009850 tx=0x7ff72c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc3965536774669c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:40.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.011+0000 7ff7408a7700 1 -- 172.21.15.40:0/122399489 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72c005e30 con 0x7ff73c09c890 2023-09-30T22:28:40.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.011+0000 7ff7408a7700 1 -- 172.21.15.40:0/122399489 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff72c006030 con 0x7ff73c09c890 2023-09-30T22:28:40.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.011+0000 7ff7408a7700 1 -- 172.21.15.40:0/122399489 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72c0063e0 con 0x7ff73c09c890 2023-09-30T22:28:40.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.012+0000 7ff743b0d700 1 -- 172.21.15.40:0/122399489 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff73c09c890 msgr2=0x7ff73c09cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:40.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.012+0000 7ff743b0d700 1 --2- 172.21.15.40:0/122399489 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff73c09c890 0x7ff73c09cc60 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff72c009850 tx=0x7ff72c009b60 comp rx=0 tx=0).stop 2023-09-30T22:28:40.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.012+0000 7ff743b0d700 1 -- 172.21.15.40:0/122399489 shutdown_connections 2023-09-30T22:28:40.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.012+0000 7ff743b0d700 1 --2- 172.21.15.40:0/122399489 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff73c09c890 0x7ff73c09cc60 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.012+0000 7ff743b0d700 1 --2- 172.21.15.40:0/122399489 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff73c09d920 0x7ff73c09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.012+0000 7ff743b0d700 1 -- 172.21.15.40:0/122399489 >> 172.21.15.40:0/122399489 conn(0x7ff73c0a7080 msgr2=0x7ff73c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:40.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.012+0000 7ff743b0d700 1 -- 172.21.15.40:0/122399489 shutdown_connections 2023-09-30T22:28:40.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.012+0000 7ff743b0d700 1 -- 172.21.15.40:0/122399489 wait complete. 2023-09-30T22:28:40.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.013+0000 7ff743b0d700 1 Processor -- start 2023-09-30T22:28:40.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.013+0000 7ff743b0d700 1 -- start start 2023-09-30T22:28:40.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.013+0000 7ff743b0d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff73c09c890 0x7ff73c12f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.013+0000 7ff743b0d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff73c09d920 0x7ff73c12fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.013+0000 7ff743b0d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff73c09e2b0 0x7ff73c1300a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.013+0000 7ff743b0d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c12cac0 con 0x7ff73c09d920 2023-09-30T22:28:40.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.013+0000 7ff743b0d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c12d340 con 0x7ff73c09e2b0 2023-09-30T22:28:40.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.013+0000 7ff743b0d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c1305e0 con 0x7ff73c09c890 2023-09-30T22:28:40.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.013+0000 7ff7418a9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff73c09c890 0x7ff73c12f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.013+0000 7ff7420aa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff73c09e2b0 0x7ff73c1300a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.013+0000 7ff7418a9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff73c09c890 0x7ff73c12f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:36476/0 (socket says 172.21.15.40:36476) 2023-09-30T22:28:40.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.013+0000 7ff7418a9700 1 -- 172.21.15.40:0/335973550 learned_addr learned my addr 172.21.15.40:0/335973550 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:40.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.013+0000 7ff7410a8700 1 --2- 172.21.15.40:0/335973550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff73c09d920 0x7ff73c12fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.014+0000 7ff7418a9700 1 -- 172.21.15.40:0/335973550 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff73c09e2b0 msgr2=0x7ff73c1300a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:40.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.014+0000 7ff7418a9700 1 --2- 172.21.15.40:0/335973550 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff73c09e2b0 0x7ff73c1300a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.014+0000 7ff7418a9700 1 -- 172.21.15.40:0/335973550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff73c09d920 msgr2=0x7ff73c12fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:40.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.014+0000 7ff7418a9700 1 --2- 172.21.15.40:0/335973550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff73c09d920 0x7ff73c12fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.014+0000 7ff7418a9700 1 -- 172.21.15.40:0/335973550 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff72c009430 con 0x7ff73c09c890 2023-09-30T22:28:40.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.014+0000 7ff7418a9700 1 --2- 172.21.15.40:0/335973550 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff73c09c890 0x7ff73c12f620 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff72c013040 tx=0x7ff72c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:40.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.014+0000 7ff7327fc700 1 -- 172.21.15.40:0/335973550 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72c006920 con 0x7ff73c09c890 2023-09-30T22:28:40.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.014+0000 7ff7327fc700 1 -- 172.21.15.40:0/335973550 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff72c020070 con 0x7ff73c09c890 2023-09-30T22:28:40.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.014+0000 7ff743b0d700 1 -- 172.21.15.40:0/335973550 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff73c12e4a0 con 0x7ff73c09c890 2023-09-30T22:28:40.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.014+0000 7ff7327fc700 1 -- 172.21.15.40:0/335973550 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72c025670 con 0x7ff73c09c890 2023-09-30T22:28:40.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.014+0000 7ff743b0d700 1 -- 172.21.15.40:0/335973550 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff73c12d810 con 0x7ff73c09c890 2023-09-30T22:28:40.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.015+0000 7ff7327fc700 1 -- 172.21.15.40:0/335973550 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff72c022030 con 0x7ff73c09c890 2023-09-30T22:28:40.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.015+0000 7ff7327fc700 1 -- 172.21.15.40:0/335973550 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff72c040aa0 con 0x7ff73c09c890 2023-09-30T22:28:40.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.015+0000 7ff743b0d700 1 -- 172.21.15.40:0/335973550 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff73c06e600 con 0x7ff73c09c890 2023-09-30T22:28:40.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.020+0000 7ff7327fc700 1 -- 172.21.15.40:0/335973550 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff72c011420 con 0x7ff73c09c890 2023-09-30T22:28:40.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.215+0000 7ff743b0d700 1 -- 172.21.15.40:0/335973550 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff73c12e6c0 con 0x7ff73c09c890 2023-09-30T22:28:40.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.215+0000 7ff7327fc700 1 -- 172.21.15.40:0/335973550 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff72c0193b0 con 0x7ff73c09c890 2023-09-30T22:28:40.216 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:40.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.217+0000 7ff743b0d700 1 -- 172.21.15.40:0/335973550 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff73c09c890 msgr2=0x7ff73c12f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:40.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.217+0000 7ff743b0d700 1 --2- 172.21.15.40:0/335973550 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff73c09c890 0x7ff73c12f620 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff72c013040 tx=0x7ff72c004750 comp rx=0 tx=0).stop 2023-09-30T22:28:40.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.218+0000 7ff743b0d700 1 -- 172.21.15.40:0/335973550 shutdown_connections 2023-09-30T22:28:40.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.218+0000 7ff743b0d700 1 --2- 172.21.15.40:0/335973550 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff73c09c890 0x7ff73c12f620 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.218+0000 7ff743b0d700 1 --2- 172.21.15.40:0/335973550 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff73c09e2b0 0x7ff73c1300a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.218+0000 7ff743b0d700 1 --2- 172.21.15.40:0/335973550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff73c09d920 0x7ff73c12fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.218+0000 7ff743b0d700 1 -- 172.21.15.40:0/335973550 >> 172.21.15.40:0/335973550 conn(0x7ff73c0a7080 msgr2=0x7ff73c1baeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:40.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.218+0000 7ff743b0d700 1 -- 172.21.15.40:0/335973550 shutdown_connections 2023-09-30T22:28:40.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.218+0000 7ff743b0d700 1 -- 172.21.15.40:0/335973550 wait complete. 2023-09-30T22:28:40.231 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:40.665 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:40.696 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:40.745 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:40.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.803+0000 7fa0892b1700 1 Processor -- start 2023-09-30T22:28:40.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.803+0000 7fa0892b1700 1 -- start start 2023-09-30T22:28:40.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.804+0000 7fa0892b1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa084133e00 0x7fa0841341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.804+0000 7fa0892b1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa08409d400 0x7fa08409d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.804+0000 7fa0892b1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa08409dd70 0x7fa08413ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.804+0000 7fa0892b1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa08409ab20 con 0x7fa08409dd70 2023-09-30T22:28:40.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.804+0000 7fa0892b1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa084133940 con 0x7fa084133e00 2023-09-30T22:28:40.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.804+0000 7fa0892b1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa08409f0d0 con 0x7fa08409d400 2023-09-30T22:28:40.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.804+0000 7fa082ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa084133e00 0x7fa0841341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.804+0000 7fa0827fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa08409d400 0x7fa08409d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.804+0000 7fa082ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa084133e00 0x7fa0841341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:47128/0 (socket says 172.21.15.40:47128) 2023-09-30T22:28:40.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.804+0000 7fa0827fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa08409d400 0x7fa08409d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:36478/0 (socket says 172.21.15.40:36478) 2023-09-30T22:28:40.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.804+0000 7fa082ffd700 1 -- 172.21.15.40:0/3851155900 learned_addr learned my addr 172.21.15.40:0/3851155900 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:40.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.804+0000 7fa0837fe700 1 --2- 172.21.15.40:0/3851155900 >> v2:172.21.15.40:3300/0 conn(0x7fa08409dd70 0x7fa08413ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.804+0000 7fa0827fc700 1 -- 172.21.15.40:0/3851155900 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa084133e00 msgr2=0x7fa0841341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:40.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.804+0000 7fa0827fc700 1 --2- 172.21.15.40:0/3851155900 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa084133e00 0x7fa0841341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.804+0000 7fa0827fc700 1 -- 172.21.15.40:0/3851155900 >> v2:172.21.15.40:3300/0 conn(0x7fa08409dd70 msgr2=0x7fa08413ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:40.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.804+0000 7fa0827fc700 1 --2- 172.21.15.40:0/3851155900 >> v2:172.21.15.40:3300/0 conn(0x7fa08409dd70 0x7fa08413ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.804+0000 7fa0827fc700 1 -- 172.21.15.40:0/3851155900 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa08409e210 con 0x7fa08409d400 2023-09-30T22:28:40.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.804+0000 7fa0827fc700 1 --2- 172.21.15.40:0/3851155900 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa08409d400 0x7fa08409d830 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa078009840 tx=0x7fa078009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=652b5bcbee839cfd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:40.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.805+0000 7fa081ffb700 1 -- 172.21.15.40:0/3851155900 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa078011830 con 0x7fa08409d400 2023-09-30T22:28:40.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.805+0000 7fa081ffb700 1 -- 172.21.15.40:0/3851155900 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa078011990 con 0x7fa08409d400 2023-09-30T22:28:40.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.805+0000 7fa081ffb700 1 -- 172.21.15.40:0/3851155900 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa078011d20 con 0x7fa08409d400 2023-09-30T22:28:40.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.805+0000 7fa0892b1700 1 -- 172.21.15.40:0/3851155900 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa08409d400 msgr2=0x7fa08409d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:40.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.805+0000 7fa0892b1700 1 --2- 172.21.15.40:0/3851155900 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa08409d400 0x7fa08409d830 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa078009840 tx=0x7fa078009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:40.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.805+0000 7fa0892b1700 1 -- 172.21.15.40:0/3851155900 shutdown_connections 2023-09-30T22:28:40.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.805+0000 7fa0892b1700 1 --2- 172.21.15.40:0/3851155900 >> v2:172.21.15.40:3300/0 conn(0x7fa08409dd70 0x7fa08413ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.805+0000 7fa0892b1700 1 --2- 172.21.15.40:0/3851155900 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa084133e00 0x7fa0841341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.805+0000 7fa0892b1700 1 --2- 172.21.15.40:0/3851155900 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa08409d400 0x7fa08409d830 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.805+0000 7fa0892b1700 1 -- 172.21.15.40:0/3851155900 >> 172.21.15.40:0/3851155900 conn(0x7fa0840a2a00 msgr2=0x7fa0840a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:40.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.805+0000 7fa0892b1700 1 -- 172.21.15.40:0/3851155900 shutdown_connections 2023-09-30T22:28:40.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.806+0000 7fa0892b1700 1 -- 172.21.15.40:0/3851155900 wait complete. 2023-09-30T22:28:40.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.807+0000 7fa0892b1700 1 Processor -- start 2023-09-30T22:28:40.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.807+0000 7fa0892b1700 1 -- start start 2023-09-30T22:28:40.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.807+0000 7fa0892b1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa08409d400 0x7fa084119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.807+0000 7fa0892b1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa08409dd70 0x7fa084119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.807+0000 7fa0892b1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa084133e00 0x7fa084119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.807+0000 7fa0892b1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08411cce0 con 0x7fa084133e00 2023-09-30T22:28:40.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.807+0000 7fa0892b1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa08412e1a0 con 0x7fa08409dd70 2023-09-30T22:28:40.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.807+0000 7fa0892b1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa08411a4d0 con 0x7fa08409d400 2023-09-30T22:28:40.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.807+0000 7fa0827fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa08409dd70 0x7fa084119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.807+0000 7fa0827fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa08409dd70 0x7fa084119590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:47140/0 (socket says 172.21.15.40:47140) 2023-09-30T22:28:40.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.807+0000 7fa0827fc700 1 -- 172.21.15.40:0/662978310 learned_addr learned my addr 172.21.15.40:0/662978310 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:40.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.807+0000 7fa082ffd700 1 --2- 172.21.15.40:0/662978310 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa08409d400 0x7fa084119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.807+0000 7fa0837fe700 1 --2- 172.21.15.40:0/662978310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa084133e00 0x7fa084119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.808+0000 7fa0827fc700 1 -- 172.21.15.40:0/662978310 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa08409d400 msgr2=0x7fa084119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:40.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.808+0000 7fa0827fc700 1 --2- 172.21.15.40:0/662978310 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa08409d400 0x7fa084119050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.808+0000 7fa0827fc700 1 -- 172.21.15.40:0/662978310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa084133e00 msgr2=0x7fa084119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:40.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.808+0000 7fa0827fc700 1 --2- 172.21.15.40:0/662978310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa084133e00 0x7fa084119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.808+0000 7fa0827fc700 1 -- 172.21.15.40:0/662978310 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0780094a0 con 0x7fa08409dd70 2023-09-30T22:28:40.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.808+0000 7fa082ffd700 1 --2- 172.21.15.40:0/662978310 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa08409d400 0x7fa084119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:40.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.808+0000 7fa0827fc700 1 --2- 172.21.15.40:0/662978310 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa08409dd70 0x7fa084119590 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa0780090b0 tx=0x7fa078004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:40.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.808+0000 7fa06b7fe700 1 -- 172.21.15.40:0/662978310 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa078004240 con 0x7fa08409dd70 2023-09-30T22:28:40.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.808+0000 7fa06b7fe700 1 -- 172.21.15.40:0/662978310 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07801f070 con 0x7fa08409dd70 2023-09-30T22:28:40.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.808+0000 7fa0892b1700 1 -- 172.21.15.40:0/662978310 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa08411c060 con 0x7fa08409dd70 2023-09-30T22:28:40.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.808+0000 7fa06b7fe700 1 -- 172.21.15.40:0/662978310 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0780036a0 con 0x7fa08409dd70 2023-09-30T22:28:40.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.808+0000 7fa0892b1700 1 -- 172.21.15.40:0/662978310 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0840a0e90 con 0x7fa08409dd70 2023-09-30T22:28:40.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.809+0000 7fa06b7fe700 1 -- 172.21.15.40:0/662978310 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa078021030 con 0x7fa08409dd70 2023-09-30T22:28:40.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.809+0000 7fa0892b1700 1 -- 172.21.15.40:0/662978310 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa084132fe0 con 0x7fa08409dd70 2023-09-30T22:28:40.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.810+0000 7fa06b7fe700 1 -- 172.21.15.40:0/662978310 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa078040570 con 0x7fa08409dd70 2023-09-30T22:28:40.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.818+0000 7fa06b7fe700 1 -- 172.21.15.40:0/662978310 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa0780239c0 con 0x7fa08409dd70 2023-09-30T22:28:40.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.849+0000 7f6b9b5af700 1 Processor -- start 2023-09-30T22:28:40.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.849+0000 7f6b9b5af700 1 -- start start 2023-09-30T22:28:40.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.850+0000 7f6b9b5af700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6b94134a90 0x7f6b94136e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.850+0000 7f6b9b5af700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b941373b0 0x7f6b94139790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.850+0000 7f6b9b5af700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b94131900 con 0x7f6b94131d50 2023-09-30T22:28:40.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.850+0000 7f6b9b5af700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b940719e0 con 0x7f6b94134a90 2023-09-30T22:28:40.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.850+0000 7f6b9b5af700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9409e820 con 0x7f6b941373b0 2023-09-30T22:28:40.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.850+0000 7f6b98b4a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6b94134a90 0x7f6b94136e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.850+0000 7f6b98b4a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6b94134a90 0x7f6b94136e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40670/0 (socket says 172.21.15.40:40670) 2023-09-30T22:28:40.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.850+0000 7f6b98b4a700 1 -- 172.21.15.40:0/2527372724 learned_addr learned my addr 172.21.15.40:0/2527372724 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:40.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.850+0000 7f6b99b4c700 1 --2- 172.21.15.40:0/2527372724 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b941373b0 0x7f6b94139790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.850+0000 7f6b98b4a700 1 -- 172.21.15.40:0/2527372724 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b941373b0 msgr2=0x7f6b94139790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:40.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.850+0000 7f6b98b4a700 1 --2- 172.21.15.40:0/2527372724 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b941373b0 0x7f6b94139790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.850+0000 7f6b98b4a700 1 -- 172.21.15.40:0/2527372724 >> v1:172.21.15.40:6789/0 conn(0x7f6b94131d50 legacy=0x7f6b94132120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:40.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.850+0000 7f6b98b4a700 1 -- 172.21.15.40:0/2527372724 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9409ef60 con 0x7f6b94134a90 2023-09-30T22:28:40.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.850+0000 7f6b99b4c700 1 --2- 172.21.15.40:0/2527372724 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b941373b0 0x7f6b94139790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:40.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.850+0000 7f6b98b4a700 1 --2- 172.21.15.40:0/2527372724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b94134a90 0x7f6b94136e70 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f6b840098f0 tx=0x7f6b84009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da691f98ed9e2ce server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:40.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.851+0000 7f6b8bfff700 1 -- 172.21.15.40:0/2527372724 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b84011830 con 0x7f6b94134a90 2023-09-30T22:28:40.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.851+0000 7f6b8bfff700 1 -- 172.21.15.40:0/2527372724 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b84011990 con 0x7f6b94134a90 2023-09-30T22:28:40.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.851+0000 7f6b8bfff700 1 -- 172.21.15.40:0/2527372724 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b84011d00 con 0x7f6b94134a90 2023-09-30T22:28:40.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.851+0000 7f6b9b5af700 1 -- 172.21.15.40:0/2527372724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b94134a90 msgr2=0x7f6b94136e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:40.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.851+0000 7f6b9b5af700 1 --2- 172.21.15.40:0/2527372724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b94134a90 0x7f6b94136e70 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f6b840098f0 tx=0x7f6b84009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:40.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.851+0000 7f6b9b5af700 1 -- 172.21.15.40:0/2527372724 shutdown_connections 2023-09-30T22:28:40.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.851+0000 7f6b9b5af700 1 --2- 172.21.15.40:0/2527372724 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b941373b0 0x7f6b94139790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.851+0000 7f6b9b5af700 1 --2- 172.21.15.40:0/2527372724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b94134a90 0x7f6b94136e70 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.851+0000 7f6b9b5af700 1 -- 172.21.15.40:0/2527372724 >> 172.21.15.40:0/2527372724 conn(0x7f6b940a2a00 msgr2=0x7f6b940a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:40.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.852+0000 7f6b9b5af700 1 -- 172.21.15.40:0/2527372724 shutdown_connections 2023-09-30T22:28:40.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.852+0000 7f6b9b5af700 1 -- 172.21.15.40:0/2527372724 wait complete. 2023-09-30T22:28:40.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.853+0000 7f6b9b5af700 1 Processor -- start 2023-09-30T22:28:40.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.853+0000 7f6b9b5af700 1 -- start start 2023-09-30T22:28:40.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.854+0000 7f6b9b5af700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b94131d50 0x7f6b9406ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.854+0000 7f6b9b5af700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b94134a90 0x7f6b94070510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.854+0000 7f6b9b5af700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b941373b0 0x7f6b941c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.854+0000 7f6b9b5af700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9412cf30 con 0x7f6b941373b0 2023-09-30T22:28:40.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.854+0000 7f6b9b5af700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b94099fe0 con 0x7f6b94134a90 2023-09-30T22:28:40.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.854+0000 7f6b9b5af700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b94099d30 con 0x7f6b94131d50 2023-09-30T22:28:40.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.854+0000 7f6b9934b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b94131d50 0x7f6b9406ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.854+0000 7f6b9934b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b94131d50 0x7f6b9406ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:36512/0 (socket says 172.21.15.40:36512) 2023-09-30T22:28:40.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.854+0000 7f6b9934b700 1 -- 172.21.15.40:0/2438943431 learned_addr learned my addr 172.21.15.40:0/2438943431 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:40.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.854+0000 7f6b99b4c700 1 --2- 172.21.15.40:0/2438943431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b941373b0 0x7f6b941c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.854+0000 7f6b98b4a700 1 --2- 172.21.15.40:0/2438943431 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b94134a90 0x7f6b94070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.854+0000 7f6b9934b700 1 -- 172.21.15.40:0/2438943431 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b94134a90 msgr2=0x7f6b94070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:40.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.854+0000 7f6b9934b700 1 --2- 172.21.15.40:0/2438943431 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b94134a90 0x7f6b94070510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.854+0000 7f6b9934b700 1 -- 172.21.15.40:0/2438943431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b941373b0 msgr2=0x7f6b941c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:40.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.854+0000 7f6b9934b700 1 --2- 172.21.15.40:0/2438943431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b941373b0 0x7f6b941c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.854+0000 7f6b9934b700 1 -- 172.21.15.40:0/2438943431 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b8c009a70 con 0x7f6b94131d50 2023-09-30T22:28:40.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.854+0000 7f6b9934b700 1 --2- 172.21.15.40:0/2438943431 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b94131d50 0x7f6b9406ffd0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f6b9000c450 tx=0x7f6b9000c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:40.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.855+0000 7f6b89ffb700 1 -- 172.21.15.40:0/2438943431 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b900052d0 con 0x7f6b94131d50 2023-09-30T22:28:40.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.855+0000 7f6b89ffb700 1 -- 172.21.15.40:0/2438943431 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b90005430 con 0x7f6b94131d50 2023-09-30T22:28:40.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.855+0000 7f6b89ffb700 1 -- 172.21.15.40:0/2438943431 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b900038c0 con 0x7f6b94131d50 2023-09-30T22:28:40.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.855+0000 7f6b9b5af700 1 -- 172.21.15.40:0/2438943431 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b84009550 con 0x7f6b94131d50 2023-09-30T22:28:40.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.855+0000 7f6b9b5af700 1 -- 172.21.15.40:0/2438943431 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b9409eac0 con 0x7f6b94131d50 2023-09-30T22:28:40.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.856+0000 7f6b89ffb700 1 -- 172.21.15.40:0/2438943431 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6b90003a20 con 0x7f6b94131d50 2023-09-30T22:28:40.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.856+0000 7f6b89ffb700 1 -- 172.21.15.40:0/2438943431 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6b9003ea30 con 0x7f6b94131d50 2023-09-30T22:28:40.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.856+0000 7f6b9b5af700 1 -- 172.21.15.40:0/2438943431 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b9409b050 con 0x7f6b94131d50 2023-09-30T22:28:40.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.861+0000 7f6b89ffb700 1 -- 172.21.15.40:0/2438943431 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6b9409b050 con 0x7f6b94131d50 2023-09-30T22:28:40.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.887+0000 7f9f50ab2700 1 Processor -- start 2023-09-30T22:28:40.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.887+0000 7f9f50ab2700 1 -- start start 2023-09-30T22:28:40.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.888+0000 7f9f50ab2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f4c09c890 0x7f9f4c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.888+0000 7f9f50ab2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9f4c09d920 0x7f9f4c09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.888+0000 7f9f50ab2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f4c09e2b0 0x7f9f4c13ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.888+0000 7f9f50ab2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f4c0a29d0 con 0x7f9f4c09d920 2023-09-30T22:28:40.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.888+0000 7f9f50ab2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c09fb40 con 0x7f9f4c09c890 2023-09-30T22:28:40.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.888+0000 7f9f50ab2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c0a2600 con 0x7f9f4c09e2b0 2023-09-30T22:28:40.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.888+0000 7f9f49d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9f4c09d920 0x7f9f4c09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.888+0000 7f9f4ad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f4c09e2b0 0x7f9f4c13ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.888+0000 7f9f4ad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f4c09e2b0 0x7f9f4c13ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:36526/0 (socket says 172.21.15.40:36526) 2023-09-30T22:28:40.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.888+0000 7f9f4a59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f4c09c890 0x7f9f4c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.888+0000 7f9f4ad9d700 1 -- 172.21.15.40:0/3360371167 learned_addr learned my addr 172.21.15.40:0/3360371167 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:40.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.888+0000 7f9f49d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9f4c09d920 0x7f9f4c09dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40682/0 (socket says 172.21.15.40:40682) 2023-09-30T22:28:40.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.889+0000 7f9f4a59c700 1 -- 172.21.15.40:0/3360371167 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f4c09e2b0 msgr2=0x7f9f4c13ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:40.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.889+0000 7f9f4a59c700 1 --2- 172.21.15.40:0/3360371167 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f4c09e2b0 0x7f9f4c13ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.889+0000 7f9f4a59c700 1 -- 172.21.15.40:0/3360371167 >> v2:172.21.15.40:3300/0 conn(0x7f9f4c09d920 msgr2=0x7f9f4c09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:40.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.889+0000 7f9f4a59c700 1 --2- 172.21.15.40:0/3360371167 >> v2:172.21.15.40:3300/0 conn(0x7f9f4c09d920 0x7f9f4c09dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.889+0000 7f9f4a59c700 1 -- 172.21.15.40:0/3360371167 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4c09e750 con 0x7f9f4c09c890 2023-09-30T22:28:40.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.889+0000 7f9f4ad9d700 1 --2- 172.21.15.40:0/3360371167 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f4c09e2b0 0x7f9f4c13ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:40.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.889+0000 7f9f4a59c700 1 --2- 172.21.15.40:0/3360371167 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f4c09c890 0x7f9f4c09cc60 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c009820 tx=0x7f9f3c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99dfa6cfed051181 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:40.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.889+0000 7f9f4959a700 1 -- 172.21.15.40:0/3360371167 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c005e30 con 0x7f9f4c09c890 2023-09-30T22:28:40.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.889+0000 7f9f4959a700 1 -- 172.21.15.40:0/3360371167 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3c006030 con 0x7f9f4c09c890 2023-09-30T22:28:40.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.889+0000 7f9f4959a700 1 -- 172.21.15.40:0/3360371167 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c0063c0 con 0x7f9f4c09c890 2023-09-30T22:28:40.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.890+0000 7f9f50ab2700 1 -- 172.21.15.40:0/3360371167 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f4c09c890 msgr2=0x7f9f4c09cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:40.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.890+0000 7f9f50ab2700 1 --2- 172.21.15.40:0/3360371167 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f4c09c890 0x7f9f4c09cc60 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c009820 tx=0x7f9f3c009b30 comp rx=0 tx=0).stop 2023-09-30T22:28:40.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.890+0000 7f9f50ab2700 1 -- 172.21.15.40:0/3360371167 shutdown_connections 2023-09-30T22:28:40.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.890+0000 7f9f50ab2700 1 --2- 172.21.15.40:0/3360371167 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f4c09e2b0 0x7f9f4c13ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.890+0000 7f9f50ab2700 1 --2- 172.21.15.40:0/3360371167 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f4c09c890 0x7f9f4c09cc60 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.890+0000 7f9f50ab2700 1 --2- 172.21.15.40:0/3360371167 >> v2:172.21.15.40:3300/0 conn(0x7f9f4c09d920 0x7f9f4c09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.890+0000 7f9f50ab2700 1 -- 172.21.15.40:0/3360371167 >> 172.21.15.40:0/3360371167 conn(0x7f9f4c0a7080 msgr2=0x7f9f4c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:40.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.890+0000 7f9f50ab2700 1 -- 172.21.15.40:0/3360371167 shutdown_connections 2023-09-30T22:28:40.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.890+0000 7f9f50ab2700 1 -- 172.21.15.40:0/3360371167 wait complete. 2023-09-30T22:28:40.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.891+0000 7f9f50ab2700 1 Processor -- start 2023-09-30T22:28:40.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.891+0000 7f9f50ab2700 1 -- start start 2023-09-30T22:28:40.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.891+0000 7f9f50ab2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f4c09c890 0x7f9f4c1c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.891+0000 7f9f50ab2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f4c09d920 0x7f9f4c1c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.891+0000 7f9f50ab2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f4c09e2b0 0x7f9f4c12d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.891+0000 7f9f50ab2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c130680 con 0x7f9f4c09d920 2023-09-30T22:28:40.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.891+0000 7f9f50ab2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c12fb10 con 0x7f9f4c09c890 2023-09-30T22:28:40.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.891+0000 7f9f50ab2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c0a5e10 con 0x7f9f4c09e2b0 2023-09-30T22:28:40.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.892+0000 7f9f4ad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f4c09e2b0 0x7f9f4c12d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.892+0000 7f9f4ad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f4c09e2b0 0x7f9f4c12d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:36536/0 (socket says 172.21.15.40:36536) 2023-09-30T22:28:40.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.892+0000 7f9f4ad9d700 1 -- 172.21.15.40:0/148431586 learned_addr learned my addr 172.21.15.40:0/148431586 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:40.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.892+0000 7f9f49d9b700 1 --2- 172.21.15.40:0/148431586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f4c09d920 0x7f9f4c1c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.892+0000 7f9f4a59c700 1 --2- 172.21.15.40:0/148431586 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f4c09c890 0x7f9f4c1c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.892+0000 7f9f4ad9d700 1 -- 172.21.15.40:0/148431586 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f4c09c890 msgr2=0x7f9f4c1c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:40.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.892+0000 7f9f4ad9d700 1 --2- 172.21.15.40:0/148431586 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f4c09c890 0x7f9f4c1c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.892+0000 7f9f4ad9d700 1 -- 172.21.15.40:0/148431586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f4c09d920 msgr2=0x7f9f4c1c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:40.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.892+0000 7f9f4ad9d700 1 --2- 172.21.15.40:0/148431586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f4c09d920 0x7f9f4c1c9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.892+0000 7f9f4ad9d700 1 -- 172.21.15.40:0/148431586 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f44009b30 con 0x7f9f4c09e2b0 2023-09-30T22:28:40.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.892+0000 7f9f49d9b700 1 --2- 172.21.15.40:0/148431586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f4c09d920 0x7f9f4c1c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:40.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.892+0000 7f9f4ad9d700 1 --2- 172.21.15.40:0/148431586 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f4c09e2b0 0x7f9f4c12d100 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9f4400efc0 tx=0x7f9f4400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:40.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.892+0000 7f9f3affd700 1 -- 172.21.15.40:0/148431586 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f44018070 con 0x7f9f4c09e2b0 2023-09-30T22:28:40.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.892+0000 7f9f3affd700 1 -- 172.21.15.40:0/148431586 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4400f040 con 0x7f9f4c09e2b0 2023-09-30T22:28:40.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.892+0000 7f9f3affd700 1 -- 172.21.15.40:0/148431586 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f44003c20 con 0x7f9f4c09e2b0 2023-09-30T22:28:40.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.892+0000 7f9f50ab2700 1 -- 172.21.15.40:0/148431586 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f3c009430 con 0x7f9f4c09e2b0 2023-09-30T22:28:40.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.892+0000 7f9f50ab2700 1 -- 172.21.15.40:0/148431586 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f4c09ecf0 con 0x7f9f4c09e2b0 2023-09-30T22:28:40.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.893+0000 7f9f3affd700 1 -- 172.21.15.40:0/148431586 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9f4400c880 con 0x7f9f4c09e2b0 2023-09-30T22:28:40.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.894+0000 7f9f50ab2700 1 -- 172.21.15.40:0/148431586 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f4c062380 con 0x7f9f4c09e2b0 2023-09-30T22:28:40.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.894+0000 7f9f3affd700 1 -- 172.21.15.40:0/148431586 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9f4403f820 con 0x7f9f4c09e2b0 2023-09-30T22:28:40.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:40.899+0000 7f9f3affd700 1 -- 172.21.15.40:0/148431586 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9f44014480 con 0x7f9f4c09e2b0 2023-09-30T22:28:41.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.019+0000 7fa0892b1700 1 -- 172.21.15.40:0/662978310 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa084062380 con 0x7fa08409dd70 2023-09-30T22:28:41.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.020+0000 7fa06b7fe700 1 -- 172.21.15.40:0/662978310 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa0780233d0 con 0x7fa08409dd70 2023-09-30T22:28:41.020 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:41.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.022+0000 7fa0892b1700 1 -- 172.21.15.40:0/662978310 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa08409dd70 msgr2=0x7fa084119590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:41.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.022+0000 7fa0892b1700 1 --2- 172.21.15.40:0/662978310 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa08409dd70 0x7fa084119590 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa0780090b0 tx=0x7fa078004750 comp rx=0 tx=0).stop 2023-09-30T22:28:41.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.022+0000 7fa0892b1700 1 -- 172.21.15.40:0/662978310 shutdown_connections 2023-09-30T22:28:41.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.022+0000 7fa0892b1700 1 --2- 172.21.15.40:0/662978310 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa08409d400 0x7fa084119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:41.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.022+0000 7fa0892b1700 1 --2- 172.21.15.40:0/662978310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa084133e00 0x7fa084119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:41.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.022+0000 7fa0892b1700 1 --2- 172.21.15.40:0/662978310 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa08409dd70 0x7fa084119590 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:41.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.022+0000 7fa0892b1700 1 -- 172.21.15.40:0/662978310 >> 172.21.15.40:0/662978310 conn(0x7fa0840a2a00 msgr2=0x7fa08412d760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:41.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.022+0000 7fa0892b1700 1 -- 172.21.15.40:0/662978310 shutdown_connections 2023-09-30T22:28:41.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.022+0000 7fa0892b1700 1 -- 172.21.15.40:0/662978310 wait complete. 2023-09-30T22:28:41.035 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:41.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.060+0000 7f6b9b5af700 1 -- 172.21.15.40:0/2438943431 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6b9409b050 con 0x7f6b94131d50 2023-09-30T22:28:41.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.060+0000 7f6b89ffb700 1 -- 172.21.15.40:0/2438943431 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6b9409b050 con 0x7f6b94131d50 2023-09-30T22:28:41.061 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:41.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.062+0000 7f6b9b5af700 1 -- 172.21.15.40:0/2438943431 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b94131d50 msgr2=0x7f6b9406ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:41.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.062+0000 7f6b9b5af700 1 --2- 172.21.15.40:0/2438943431 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b94131d50 0x7f6b9406ffd0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f6b9000c450 tx=0x7f6b9000c760 comp rx=0 tx=0).stop 2023-09-30T22:28:41.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.062+0000 7f6b9b5af700 1 -- 172.21.15.40:0/2438943431 shutdown_connections 2023-09-30T22:28:41.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.062+0000 7f6b9b5af700 1 --2- 172.21.15.40:0/2438943431 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6b94131d50 0x7f6b9406ffd0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:41.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.062+0000 7f6b9b5af700 1 --2- 172.21.15.40:0/2438943431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b941373b0 0x7f6b941c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:41.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.062+0000 7f6b9b5af700 1 --2- 172.21.15.40:0/2438943431 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b94134a90 0x7f6b94070510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:41.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.062+0000 7f6b9b5af700 1 -- 172.21.15.40:0/2438943431 >> 172.21.15.40:0/2438943431 conn(0x7f6b940a2a00 msgr2=0x7f6b9412d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:41.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.062+0000 7f6b9b5af700 1 -- 172.21.15.40:0/2438943431 shutdown_connections 2023-09-30T22:28:41.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.062+0000 7f6b9b5af700 1 -- 172.21.15.40:0/2438943431 wait complete. 2023-09-30T22:28:41.075 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:41.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.096+0000 7f9f50ab2700 1 -- 172.21.15.40:0/148431586 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9f4c12f460 con 0x7f9f4c09e2b0 2023-09-30T22:28:41.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.096+0000 7f9f3affd700 1 -- 172.21.15.40:0/148431586 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9f4401cbb0 con 0x7f9f4c09e2b0 2023-09-30T22:28:41.097 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:41.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.098+0000 7f9f50ab2700 1 -- 172.21.15.40:0/148431586 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f4c09e2b0 msgr2=0x7f9f4c12d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:41.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.098+0000 7f9f50ab2700 1 --2- 172.21.15.40:0/148431586 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f4c09e2b0 0x7f9f4c12d100 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9f4400efc0 tx=0x7f9f4400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:28:41.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.098+0000 7f9f50ab2700 1 -- 172.21.15.40:0/148431586 shutdown_connections 2023-09-30T22:28:41.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.098+0000 7f9f50ab2700 1 --2- 172.21.15.40:0/148431586 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f4c09e2b0 0x7f9f4c12d100 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:41.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.098+0000 7f9f50ab2700 1 --2- 172.21.15.40:0/148431586 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f4c09c890 0x7f9f4c1c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:41.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.098+0000 7f9f50ab2700 1 --2- 172.21.15.40:0/148431586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f4c09d920 0x7f9f4c1c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:41.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.098+0000 7f9f50ab2700 1 -- 172.21.15.40:0/148431586 >> 172.21.15.40:0/148431586 conn(0x7f9f4c0a7080 msgr2=0x7f9f4c0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:41.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.098+0000 7f9f50ab2700 1 -- 172.21.15.40:0/148431586 shutdown_connections 2023-09-30T22:28:41.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.098+0000 7f9f50ab2700 1 -- 172.21.15.40:0/148431586 wait complete. 2023-09-30T22:28:41.111 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:41.232 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:41.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.358+0000 7f59bb041700 1 Processor -- start 2023-09-30T22:28:41.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.358+0000 7f59bb041700 1 -- start start 2023-09-30T22:28:41.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.359+0000 7f59bb041700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f59b409c890 0x7f59b409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:41.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.359+0000 7f59bb041700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f59b409d920 0x7f59b409dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:41.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.359+0000 7f59bb041700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b40a2600 con 0x7f59b409e2b0 2023-09-30T22:28:41.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.359+0000 7f59bb041700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59b40a29d0 con 0x7f59b409d920 2023-09-30T22:28:41.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.359+0000 7f59bb041700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59b409fb40 con 0x7f59b409c890 2023-09-30T22:28:41.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.359+0000 7f59b8ddd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f59b409c890 0x7f59b409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:41.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.359+0000 7f59b3fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f59b409d920 0x7f59b409dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:41.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.359+0000 7f59b8ddd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f59b409c890 0x7f59b409cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:36548/0 (socket says 172.21.15.40:36548) 2023-09-30T22:28:41.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.359+0000 7f59b8ddd700 1 -- 172.21.15.40:0/3684250579 learned_addr learned my addr 172.21.15.40:0/3684250579 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:41.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.360+0000 7f59b8ddd700 1 -- 172.21.15.40:0/3684250579 >> v2:172.21.15.40:3300/0 conn(0x7f59b409d920 msgr2=0x7f59b409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:41.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.360+0000 7f59b8ddd700 1 --2- 172.21.15.40:0/3684250579 >> v2:172.21.15.40:3300/0 conn(0x7f59b409d920 0x7f59b409dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:41.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.360+0000 7f59b8ddd700 1 -- 172.21.15.40:0/3684250579 >> v1:172.21.15.40:6789/0 conn(0x7f59b409e2b0 legacy=0x7f59b413ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:41.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.360+0000 7f59b8ddd700 1 -- 172.21.15.40:0/3684250579 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b409e750 con 0x7f59b409c890 2023-09-30T22:28:41.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.360+0000 7f59b3fff700 1 --2- 172.21.15.40:0/3684250579 >> v2:172.21.15.40:3300/0 conn(0x7f59b409d920 0x7f59b409dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:41.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.360+0000 7f59b8ddd700 1 --2- 172.21.15.40:0/3684250579 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f59b409c890 0x7f59b409cc60 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f59a4006fd0 tx=0x7f59a4009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e351ae5a01d82f53 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:41.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.360+0000 7f59b37fe700 1 -- 172.21.15.40:0/3684250579 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a4005e30 con 0x7f59b409c890 2023-09-30T22:28:41.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.360+0000 7f59b37fe700 1 -- 172.21.15.40:0/3684250579 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a4004030 con 0x7f59b409c890 2023-09-30T22:28:41.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.360+0000 7f59b37fe700 1 -- 172.21.15.40:0/3684250579 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a40043e0 con 0x7f59b409c890 2023-09-30T22:28:41.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.360+0000 7f59bb041700 1 -- 172.21.15.40:0/3684250579 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f59b409c890 msgr2=0x7f59b409cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:41.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.360+0000 7f59bb041700 1 --2- 172.21.15.40:0/3684250579 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f59b409c890 0x7f59b409cc60 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f59a4006fd0 tx=0x7f59a4009bd0 comp rx=0 tx=0).stop 2023-09-30T22:28:41.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.361+0000 7f59bb041700 1 -- 172.21.15.40:0/3684250579 shutdown_connections 2023-09-30T22:28:41.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.361+0000 7f59bb041700 1 --2- 172.21.15.40:0/3684250579 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f59b409c890 0x7f59b409cc60 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:41.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.361+0000 7f59bb041700 1 --2- 172.21.15.40:0/3684250579 >> v2:172.21.15.40:3300/0 conn(0x7f59b409d920 0x7f59b409dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:41.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.361+0000 7f59bb041700 1 -- 172.21.15.40:0/3684250579 >> 172.21.15.40:0/3684250579 conn(0x7f59b40a7080 msgr2=0x7f59b40a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:41.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.361+0000 7f59bb041700 1 -- 172.21.15.40:0/3684250579 shutdown_connections 2023-09-30T22:28:41.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.361+0000 7f59bb041700 1 -- 172.21.15.40:0/3684250579 wait complete. 2023-09-30T22:28:41.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.361+0000 7f59bb041700 1 Processor -- start 2023-09-30T22:28:41.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.362+0000 7f59bb041700 1 -- start start 2023-09-30T22:28:41.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.362+0000 7f59bb041700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f59b409c890 0x7f59b41c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:41.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.362+0000 7f59bb041700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59b409d920 0x7f59b41c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:41.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.362+0000 7f59bb041700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59b409e2b0 0x7f59b41c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:41.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.362+0000 7f59bb041700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b412faf0 con 0x7f59b409d920 2023-09-30T22:28:41.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.362+0000 7f59bb041700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b412f580 con 0x7f59b409e2b0 2023-09-30T22:28:41.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.362+0000 7f59bb041700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59b40a5d00 con 0x7f59b409c890 2023-09-30T22:28:41.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.362+0000 7f59b8ddd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f59b409c890 0x7f59b41c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:41.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.362+0000 7f59b3fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59b409d920 0x7f59b41c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:41.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.362+0000 7f59b8ddd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f59b409c890 0x7f59b41c89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:36554/0 (socket says 172.21.15.40:36554) 2023-09-30T22:28:41.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.362+0000 7f59b8ddd700 1 -- 172.21.15.40:0/1080818790 learned_addr learned my addr 172.21.15.40:0/1080818790 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:41.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.362+0000 7f59b95de700 1 --2- 172.21.15.40:0/1080818790 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59b409e2b0 0x7f59b41c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:41.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.362+0000 7f59b3fff700 1 -- 172.21.15.40:0/1080818790 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f59b409c890 msgr2=0x7f59b41c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:41.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.362+0000 7f59b3fff700 1 --2- 172.21.15.40:0/1080818790 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f59b409c890 0x7f59b41c89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:41.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.362+0000 7f59b3fff700 1 -- 172.21.15.40:0/1080818790 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59b409e2b0 msgr2=0x7f59b41c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:41.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.362+0000 7f59b3fff700 1 --2- 172.21.15.40:0/1080818790 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59b409e2b0 0x7f59b41c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:41.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.362+0000 7f59b3fff700 1 -- 172.21.15.40:0/1080818790 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f599c0094a0 con 0x7f59b409d920 2023-09-30T22:28:41.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.362+0000 7f59b8ddd700 1 --2- 172.21.15.40:0/1080818790 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f59b409c890 0x7f59b41c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:41.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.363+0000 7f59b3fff700 1 --2- 172.21.15.40:0/1080818790 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59b409d920 0x7f59b41c8f20 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f599c00e9b0 tx=0x7f599c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:41.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.363+0000 7f59b17fa700 1 -- 172.21.15.40:0/1080818790 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599c00ee50 con 0x7f59b409d920 2023-09-30T22:28:41.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.363+0000 7f59b17fa700 1 -- 172.21.15.40:0/1080818790 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599c00c7f0 con 0x7f59b409d920 2023-09-30T22:28:41.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.363+0000 7f59bb041700 1 -- 172.21.15.40:0/1080818790 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59a4009500 con 0x7f59b409d920 2023-09-30T22:28:41.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.363+0000 7f59b17fa700 1 -- 172.21.15.40:0/1080818790 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599c00cb80 con 0x7f59b409d920 2023-09-30T22:28:41.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.363+0000 7f59bb041700 1 -- 172.21.15.40:0/1080818790 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b409c1c0 con 0x7f59b409d920 2023-09-30T22:28:41.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.364+0000 7f59b17fa700 1 -- 172.21.15.40:0/1080818790 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f599c00cce0 con 0x7f59b409d920 2023-09-30T22:28:41.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.364+0000 7f59b17fa700 1 -- 172.21.15.40:0/1080818790 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f599c03fab0 con 0x7f59b409d920 2023-09-30T22:28:41.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.364+0000 7f59bb041700 1 -- 172.21.15.40:0/1080818790 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b4062380 con 0x7f59b409d920 2023-09-30T22:28:41.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.368+0000 7f59b17fa700 1 -- 172.21.15.40:0/1080818790 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f599c01b3b0 con 0x7f59b409d920 2023-09-30T22:28:41.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.563+0000 7f59bb041700 1 -- 172.21.15.40:0/1080818790 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f59b4074620 con 0x7f59b409d920 2023-09-30T22:28:41.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.563+0000 7f59b17fa700 1 -- 172.21.15.40:0/1080818790 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f599c017020 con 0x7f59b409d920 2023-09-30T22:28:41.564 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:41.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.565+0000 7f59bb041700 1 -- 172.21.15.40:0/1080818790 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59b409d920 msgr2=0x7f59b41c8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:41.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.565+0000 7f59bb041700 1 --2- 172.21.15.40:0/1080818790 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59b409d920 0x7f59b41c8f20 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f599c00e9b0 tx=0x7f599c00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:28:41.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.565+0000 7f59bb041700 1 -- 172.21.15.40:0/1080818790 shutdown_connections 2023-09-30T22:28:41.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.565+0000 7f59bb041700 1 --2- 172.21.15.40:0/1080818790 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f59b409c890 0x7f59b41c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:41.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.565+0000 7f59bb041700 1 --2- 172.21.15.40:0/1080818790 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59b409e2b0 0x7f59b41c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:41.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.565+0000 7f59bb041700 1 --2- 172.21.15.40:0/1080818790 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59b409d920 0x7f59b41c8f20 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:41.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.565+0000 7f59bb041700 1 -- 172.21.15.40:0/1080818790 >> 172.21.15.40:0/1080818790 conn(0x7f59b40a7080 msgr2=0x7f59b40a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:41.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.565+0000 7f59bb041700 1 -- 172.21.15.40:0/1080818790 shutdown_connections 2023-09-30T22:28:41.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:41.565+0000 7f59bb041700 1 -- 172.21.15.40:0/1080818790 wait complete. 2023-09-30T22:28:41.578 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:42.036 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:42.076 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:42.112 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:42.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.179+0000 7f3f7b27e700 1 Processor -- start 2023-09-30T22:28:42.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.179+0000 7f3f7b27e700 1 -- start start 2023-09-30T22:28:42.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.180+0000 7f3f7b27e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3f7409f0f0 0x7f3f74138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.180+0000 7f3f7b27e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3f7409e400 0x7f3f7413b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.180+0000 7f3f7b27e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f7409f940 con 0x7f3f7409d920 2023-09-30T22:28:42.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.180+0000 7f3f7b27e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f7406b4c0 con 0x7f3f7409f0f0 2023-09-30T22:28:42.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.180+0000 7f3f7b27e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7409a8f0 con 0x7f3f7409e400 2023-09-30T22:28:42.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.180+0000 7f3f78819700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3f7409f0f0 0x7f3f74138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:42.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.180+0000 7f3f78819700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3f7409f0f0 0x7f3f74138ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40714/0 (socket says 172.21.15.40:40714) 2023-09-30T22:28:42.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.180+0000 7f3f78819700 1 -- 172.21.15.40:0/3631748061 learned_addr learned my addr 172.21.15.40:0/3631748061 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:42.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.180+0000 7f3f7981b700 1 --2- 172.21.15.40:0/3631748061 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3f7409e400 0x7f3f7413b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:42.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.180+0000 7f3f7981b700 1 -- 172.21.15.40:0/3631748061 >> v2:172.21.15.40:3300/0 conn(0x7f3f7409f0f0 msgr2=0x7f3f74138ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:42.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.180+0000 7f3f7981b700 1 --2- 172.21.15.40:0/3631748061 >> v2:172.21.15.40:3300/0 conn(0x7f3f7409f0f0 0x7f3f74138ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.180+0000 7f3f7981b700 1 -- 172.21.15.40:0/3631748061 >> v1:172.21.15.40:6789/0 conn(0x7f3f7409d920 legacy=0x7f3f7409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.180+0000 7f3f7981b700 1 -- 172.21.15.40:0/3631748061 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f7409f6e0 con 0x7f3f7409e400 2023-09-30T22:28:42.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.180+0000 7f3f78819700 1 --2- 172.21.15.40:0/3631748061 >> v2:172.21.15.40:3300/0 conn(0x7f3f7409f0f0 0x7f3f74138ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:42.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.181+0000 7f3f7981b700 1 --2- 172.21.15.40:0/3631748061 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3f7409e400 0x7f3f7413b430 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009dc0 tx=0x7f3f6c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1de4542bfb133908 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:42.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.181+0000 7f3f6bfff700 1 -- 172.21.15.40:0/3631748061 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c00e070 con 0x7f3f7409e400 2023-09-30T22:28:42.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.181+0000 7f3f6bfff700 1 -- 172.21.15.40:0/3631748061 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f6c00bae0 con 0x7f3f7409e400 2023-09-30T22:28:42.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.181+0000 7f3f6bfff700 1 -- 172.21.15.40:0/3631748061 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c00be90 con 0x7f3f7409e400 2023-09-30T22:28:42.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.182+0000 7f3f7b27e700 1 -- 172.21.15.40:0/3631748061 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3f7409e400 msgr2=0x7f3f7413b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.182+0000 7f3f7b27e700 1 --2- 172.21.15.40:0/3631748061 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3f7409e400 0x7f3f7413b430 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009dc0 tx=0x7f3f6c00b330 comp rx=0 tx=0).stop 2023-09-30T22:28:42.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.182+0000 7f3f7b27e700 1 -- 172.21.15.40:0/3631748061 shutdown_connections 2023-09-30T22:28:42.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.182+0000 7f3f7b27e700 1 --2- 172.21.15.40:0/3631748061 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3f7409e400 0x7f3f7413b430 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.182+0000 7f3f7b27e700 1 --2- 172.21.15.40:0/3631748061 >> v2:172.21.15.40:3300/0 conn(0x7f3f7409f0f0 0x7f3f74138ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.182+0000 7f3f7b27e700 1 -- 172.21.15.40:0/3631748061 >> 172.21.15.40:0/3631748061 conn(0x7f3f7409fb20 msgr2=0x7f3f7409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:42.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.182+0000 7f3f7b27e700 1 -- 172.21.15.40:0/3631748061 shutdown_connections 2023-09-30T22:28:42.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.182+0000 7f3f7b27e700 1 -- 172.21.15.40:0/3631748061 wait complete. 2023-09-30T22:28:42.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.183+0000 7f3f7b27e700 1 Processor -- start 2023-09-30T22:28:42.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.183+0000 7f3f7b27e700 1 -- start start 2023-09-30T22:28:42.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.183+0000 7f3f7b27e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f7409d920 0x7f3f7411db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.183+0000 7f3f7b27e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3f7409e400 0x7f3f7411e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.183+0000 7f3f7b27e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f7411e5c0 0x7f3f741c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.183+0000 7f3f7b27e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7411ea10 con 0x7f3f7411e5c0 2023-09-30T22:28:42.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.183+0000 7f3f7b27e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7411ff50 con 0x7f3f7409d920 2023-09-30T22:28:42.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.183+0000 7f3f7b27e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f74120230 con 0x7f3f7409e400 2023-09-30T22:28:42.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.183+0000 7f3f78819700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3f7409e400 0x7f3f7411e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:42.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.183+0000 7f3f78819700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3f7409e400 0x7f3f7411e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:36570/0 (socket says 172.21.15.40:36570) 2023-09-30T22:28:42.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.183+0000 7f3f78819700 1 -- 172.21.15.40:0/3738062304 learned_addr learned my addr 172.21.15.40:0/3738062304 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:42.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.183+0000 7f3f7981b700 1 --2- 172.21.15.40:0/3738062304 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f7411e5c0 0x7f3f741c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:42.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.184+0000 7f3f7901a700 1 --2- 172.21.15.40:0/3738062304 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f7409d920 0x7f3f7411db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:42.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.184+0000 7f3f78819700 1 -- 172.21.15.40:0/3738062304 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f7409d920 msgr2=0x7f3f7411db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.184+0000 7f3f78819700 1 --2- 172.21.15.40:0/3738062304 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f7409d920 0x7f3f7411db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.184+0000 7f3f78819700 1 -- 172.21.15.40:0/3738062304 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f7411e5c0 msgr2=0x7f3f741c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.184+0000 7f3f78819700 1 --2- 172.21.15.40:0/3738062304 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f7411e5c0 0x7f3f741c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.184+0000 7f3f78819700 1 -- 172.21.15.40:0/3738062304 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f64009550 con 0x7f3f7409e400 2023-09-30T22:28:42.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.184+0000 7f3f7901a700 1 --2- 172.21.15.40:0/3738062304 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f7409d920 0x7f3f7411db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:42.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.184+0000 7f3f78819700 1 --2- 172.21.15.40:0/3738062304 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3f7409e400 0x7f3f7411e080 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3f6400ec10 tx=0x7f3f6400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:42.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.184+0000 7f3f69ffb700 1 -- 172.21.15.40:0/3738062304 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6400c850 con 0x7f3f7409e400 2023-09-30T22:28:42.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.184+0000 7f3f69ffb700 1 -- 172.21.15.40:0/3738062304 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f6400c9b0 con 0x7f3f7409e400 2023-09-30T22:28:42.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.184+0000 7f3f7b27e700 1 -- 172.21.15.40:0/3738062304 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f6c009a70 con 0x7f3f7409e400 2023-09-30T22:28:42.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.184+0000 7f3f69ffb700 1 -- 172.21.15.40:0/3738062304 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6400cd20 con 0x7f3f7409e400 2023-09-30T22:28:42.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.184+0000 7f3f7b27e700 1 -- 172.21.15.40:0/3738062304 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f740a3200 con 0x7f3f7409e400 2023-09-30T22:28:42.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.185+0000 7f3f69ffb700 1 -- 172.21.15.40:0/3738062304 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f64013470 con 0x7f3f7409e400 2023-09-30T22:28:42.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.185+0000 7f3f69ffb700 1 -- 172.21.15.40:0/3738062304 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3f6403fbe0 con 0x7f3f7409e400 2023-09-30T22:28:42.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.186+0000 7f3f7b27e700 1 -- 172.21.15.40:0/3738062304 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f7411fdb0 con 0x7f3f7409e400 2023-09-30T22:28:42.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.194+0000 7f3f69ffb700 1 -- 172.21.15.40:0/3738062304 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f7411fdb0 con 0x7f3f7409e400 2023-09-30T22:28:42.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.219+0000 7f10e0cc9700 1 Processor -- start 2023-09-30T22:28:42.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.220+0000 7f10e0cc9700 1 -- start start 2023-09-30T22:28:42.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.220+0000 7f10e0cc9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10dc06fb50 0x7f10dc136c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.220+0000 7f10e0cc9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f10dc1371b0 0x7f10dc139590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.220+0000 7f10e0cc9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10dc070830 con 0x7f10dc06f070 2023-09-30T22:28:42.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.220+0000 7f10e0cc9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10dc071af0 con 0x7f10dc1371b0 2023-09-30T22:28:42.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.220+0000 7f10e0cc9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc070ad0 con 0x7f10dc06fb50 2023-09-30T22:28:42.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.220+0000 7f10d9d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10dc06fb50 0x7f10dc136c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:42.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.220+0000 7f10dad9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f10dc1371b0 0x7f10dc139590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:42.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.220+0000 7f10da59c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f10dc06f070 0x7f10dc06f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38968/0 (socket says 172.21.15.40:38968) 2023-09-30T22:28:42.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.220+0000 7f10d9d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10dc06fb50 0x7f10dc136c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:36572/0 (socket says 172.21.15.40:36572) 2023-09-30T22:28:42.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.220+0000 7f10da59c700 1 -- 172.21.15.40:0/2356896447 learned_addr learned my addr 172.21.15.40:0/2356896447 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:42.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.221+0000 7f10d959a700 1 -- 172.21.15.40:0/2356896447 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3907023829 0 0) 0x7f10dc070830 con 0x7f10dc06f070 2023-09-30T22:28:42.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.221+0000 7f10d959a700 1 -- 172.21.15.40:0/2356896447 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10c40035b0 con 0x7f10dc06f070 2023-09-30T22:28:42.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.221+0000 7f10d9d9b700 1 -- 172.21.15.40:0/2356896447 >> v2:172.21.15.40:3300/0 conn(0x7f10dc1371b0 msgr2=0x7f10dc139590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:42.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.221+0000 7f10d9d9b700 1 --2- 172.21.15.40:0/2356896447 >> v2:172.21.15.40:3300/0 conn(0x7f10dc1371b0 0x7f10dc139590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.221+0000 7f10d9d9b700 1 -- 172.21.15.40:0/2356896447 >> v1:172.21.15.40:6789/0 conn(0x7f10dc06f070 legacy=0x7f10dc06f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.221+0000 7f10d9d9b700 1 -- 172.21.15.40:0/2356896447 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10dc070de0 con 0x7f10dc06fb50 2023-09-30T22:28:42.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.221+0000 7f10d9d9b700 1 --2- 172.21.15.40:0/2356896447 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10dc06fb50 0x7f10dc136c70 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f10d0009840 tx=0x7f10d0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1aff5e4d7b13483f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:42.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.221+0000 7f10d959a700 1 -- 172.21.15.40:0/2356896447 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d0011830 con 0x7f10dc06fb50 2023-09-30T22:28:42.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.221+0000 7f10d959a700 1 -- 172.21.15.40:0/2356896447 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d0011990 con 0x7f10dc06fb50 2023-09-30T22:28:42.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.221+0000 7f10d959a700 1 -- 172.21.15.40:0/2356896447 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d0011d20 con 0x7f10dc06fb50 2023-09-30T22:28:42.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.222+0000 7f10e0cc9700 1 -- 172.21.15.40:0/2356896447 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10dc06fb50 msgr2=0x7f10dc136c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.222+0000 7f10e0cc9700 1 --2- 172.21.15.40:0/2356896447 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10dc06fb50 0x7f10dc136c70 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f10d0009840 tx=0x7f10d0009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:42.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.222+0000 7f10e0cc9700 1 -- 172.21.15.40:0/2356896447 shutdown_connections 2023-09-30T22:28:42.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.222+0000 7f10e0cc9700 1 --2- 172.21.15.40:0/2356896447 >> v2:172.21.15.40:3300/0 conn(0x7f10dc1371b0 0x7f10dc139590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.222+0000 7f10e0cc9700 1 --2- 172.21.15.40:0/2356896447 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10dc06fb50 0x7f10dc136c70 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.222+0000 7f10e0cc9700 1 -- 172.21.15.40:0/2356896447 >> 172.21.15.40:0/2356896447 conn(0x7f10dc0a41a0 msgr2=0x7f10dc0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:42.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.222+0000 7f10e0cc9700 1 -- 172.21.15.40:0/2356896447 shutdown_connections 2023-09-30T22:28:42.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.222+0000 7f10e0cc9700 1 -- 172.21.15.40:0/2356896447 wait complete. 2023-09-30T22:28:42.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.223+0000 7f10e0cc9700 1 Processor -- start 2023-09-30T22:28:42.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.224+0000 7f10e0cc9700 1 -- start start 2023-09-30T22:28:42.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.224+0000 7f10e0cc9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10dc06f070 0x7f10dc130d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.224+0000 7f10e0cc9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10dc06fb50 0x7f10dc131280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.224+0000 7f10e0cc9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10dc1371b0 0x7f10dc1317c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.224+0000 7f10e0cc9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc132330 con 0x7f10dc1371b0 2023-09-30T22:28:42.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.224+0000 7f10e0cc9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc12fe80 con 0x7f10dc06f070 2023-09-30T22:28:42.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.224+0000 7f10e0cc9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc12fbc0 con 0x7f10dc06fb50 2023-09-30T22:28:42.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.224+0000 7f10da59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10dc06f070 0x7f10dc130d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:42.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.224+0000 7f10da59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10dc06f070 0x7f10dc130d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:47194/0 (socket says 172.21.15.40:47194) 2023-09-30T22:28:42.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.224+0000 7f10da59c700 1 -- 172.21.15.40:0/4137184800 learned_addr learned my addr 172.21.15.40:0/4137184800 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:42.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.224+0000 7f10dad9d700 1 --2- 172.21.15.40:0/4137184800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10dc1371b0 0x7f10dc1317c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:42.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.224+0000 7f10d9d9b700 1 --2- 172.21.15.40:0/4137184800 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10dc06fb50 0x7f10dc131280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:42.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.225+0000 7f10d9d9b700 1 -- 172.21.15.40:0/4137184800 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10dc06f070 msgr2=0x7f10dc130d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.225+0000 7f10d9d9b700 1 --2- 172.21.15.40:0/4137184800 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10dc06f070 0x7f10dc130d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.225+0000 7f10d9d9b700 1 -- 172.21.15.40:0/4137184800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10dc1371b0 msgr2=0x7f10dc1317c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.225+0000 7f10d9d9b700 1 --2- 172.21.15.40:0/4137184800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10dc1371b0 0x7f10dc1317c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.225+0000 7f10d9d9b700 1 -- 172.21.15.40:0/4137184800 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d00094a0 con 0x7f10dc06fb50 2023-09-30T22:28:42.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.225+0000 7f10da59c700 1 --2- 172.21.15.40:0/4137184800 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10dc06f070 0x7f10dc130d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:42.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.225+0000 7f10dad9d700 1 --2- 172.21.15.40:0/4137184800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10dc1371b0 0x7f10dc1317c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:42.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.225+0000 7f10d9d9b700 1 --2- 172.21.15.40:0/4137184800 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10dc06fb50 0x7f10dc131280 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f10d0016000 tx=0x7f10d0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:42.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.225+0000 7f10caffd700 1 -- 172.21.15.40:0/4137184800 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d0004380 con 0x7f10dc06fb50 2023-09-30T22:28:42.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.225+0000 7f10caffd700 1 -- 172.21.15.40:0/4137184800 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d001f070 con 0x7f10dc06fb50 2023-09-30T22:28:42.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.225+0000 7f10e0cc9700 1 -- 172.21.15.40:0/4137184800 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10dc136c70 con 0x7f10dc06fb50 2023-09-30T22:28:42.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.225+0000 7f10caffd700 1 -- 172.21.15.40:0/4137184800 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d00036a0 con 0x7f10dc06fb50 2023-09-30T22:28:42.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.225+0000 7f10e0cc9700 1 -- 172.21.15.40:0/4137184800 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10dc12f860 con 0x7f10dc06fb50 2023-09-30T22:28:42.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.226+0000 7f10caffd700 1 -- 172.21.15.40:0/4137184800 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f10d0021030 con 0x7f10dc06fb50 2023-09-30T22:28:42.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.226+0000 7f10caffd700 1 -- 172.21.15.40:0/4137184800 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f10d0040a00 con 0x7f10dc06fb50 2023-09-30T22:28:42.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.226+0000 7f10e0cc9700 1 -- 172.21.15.40:0/4137184800 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10dc062380 con 0x7f10dc06fb50 2023-09-30T22:28:42.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.235+0000 7f10caffd700 1 -- 172.21.15.40:0/4137184800 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f10d00239c0 con 0x7f10dc06fb50 2023-09-30T22:28:42.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.264+0000 7f5be8dd2700 1 Processor -- start 2023-09-30T22:28:42.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.264+0000 7f5be8dd2700 1 -- start start 2023-09-30T22:28:42.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.265+0000 7f5be8dd2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5be4136c50 0x7f5be4139030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.265+0000 7f5be8dd2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5be4139570 0x7f5be413b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.265+0000 7f5be8dd2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be4133940 con 0x7f5be4133e00 2023-09-30T22:28:42.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.265+0000 7f5be8dd2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be409af70 con 0x7f5be4139570 2023-09-30T22:28:42.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.265+0000 7f5be8dd2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5be409ab20 con 0x7f5be4136c50 2023-09-30T22:28:42.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.266+0000 7f5be259c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5be4133e00 0x7f5be41341d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38980/0 (socket says 172.21.15.40:38980) 2023-09-30T22:28:42.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.266+0000 7f5be259c700 1 -- 172.21.15.40:0/1972827258 learned_addr learned my addr 172.21.15.40:0/1972827258 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:42.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.266+0000 7f5be1d9b700 1 --2- 172.21.15.40:0/1972827258 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5be4136c50 0x7f5be4139030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:42.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.266+0000 7f5be2d9d700 1 --2- 172.21.15.40:0/1972827258 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5be4139570 0x7f5be413b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:42.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.266+0000 7f5be159a700 1 -- 172.21.15.40:0/1972827258 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1708043394 0 0) 0x7f5be4133940 con 0x7f5be4133e00 2023-09-30T22:28:42.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.266+0000 7f5be159a700 1 -- 172.21.15.40:0/1972827258 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bcc0035b0 con 0x7f5be4133e00 2023-09-30T22:28:42.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.266+0000 7f5be1d9b700 1 -- 172.21.15.40:0/1972827258 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5be4139570 msgr2=0x7f5be413b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:42.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.266+0000 7f5be1d9b700 1 --2- 172.21.15.40:0/1972827258 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5be4139570 0x7f5be413b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.266+0000 7f5be1d9b700 1 -- 172.21.15.40:0/1972827258 >> v1:172.21.15.40:6789/0 conn(0x7f5be4133e00 legacy=0x7f5be41341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.266+0000 7f5be1d9b700 1 -- 172.21.15.40:0/1972827258 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be409f0d0 con 0x7f5be4136c50 2023-09-30T22:28:42.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.266+0000 7f5be1d9b700 1 --2- 172.21.15.40:0/1972827258 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5be4136c50 0x7f5be4139030 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8009870 tx=0x7f5bd8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcd0d3b4f0b5a030 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:42.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.266+0000 7f5be159a700 1 -- 172.21.15.40:0/1972827258 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8011830 con 0x7f5be4136c50 2023-09-30T22:28:42.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.266+0000 7f5be159a700 1 -- 172.21.15.40:0/1972827258 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd8011990 con 0x7f5be4136c50 2023-09-30T22:28:42.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.266+0000 7f5be159a700 1 -- 172.21.15.40:0/1972827258 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8011d20 con 0x7f5be4136c50 2023-09-30T22:28:42.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.267+0000 7f5be8dd2700 1 -- 172.21.15.40:0/1972827258 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5be4136c50 msgr2=0x7f5be4139030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.267+0000 7f5be8dd2700 1 --2- 172.21.15.40:0/1972827258 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5be4136c50 0x7f5be4139030 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8009870 tx=0x7f5bd8009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:42.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.267+0000 7f5be8dd2700 1 -- 172.21.15.40:0/1972827258 shutdown_connections 2023-09-30T22:28:42.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.267+0000 7f5be8dd2700 1 --2- 172.21.15.40:0/1972827258 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5be4139570 0x7f5be413b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.267+0000 7f5be8dd2700 1 --2- 172.21.15.40:0/1972827258 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5be4136c50 0x7f5be4139030 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.267+0000 7f5be8dd2700 1 -- 172.21.15.40:0/1972827258 >> 172.21.15.40:0/1972827258 conn(0x7f5be40a2a00 msgr2=0x7f5be40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:42.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.267+0000 7f5be8dd2700 1 -- 172.21.15.40:0/1972827258 shutdown_connections 2023-09-30T22:28:42.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.267+0000 7f5be8dd2700 1 -- 172.21.15.40:0/1972827258 wait complete. 2023-09-30T22:28:42.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.269+0000 7f5be8dd2700 1 Processor -- start 2023-09-30T22:28:42.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.269+0000 7f5be8dd2700 1 -- start start 2023-09-30T22:28:42.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.269+0000 7f5be8dd2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5be4133e00 0x7f5be4119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.269+0000 7f5be8dd2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5be4136c50 0x7f5be4119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.269+0000 7f5be8dd2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5be4139570 0x7f5be4119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.269+0000 7f5be8dd2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be411ba20 con 0x7f5be4133e00 2023-09-30T22:28:42.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.269+0000 7f5be8dd2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be412dd50 con 0x7f5be4139570 2023-09-30T22:28:42.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.269+0000 7f5be8dd2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5be411a2a0 con 0x7f5be4136c50 2023-09-30T22:28:42.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.269+0000 7f5be1d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5be4136c50 0x7f5be4119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:42.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.270+0000 7f5be1d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5be4136c50 0x7f5be4119590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:36598/0 (socket says 172.21.15.40:36598) 2023-09-30T22:28:42.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.270+0000 7f5be1d9b700 1 -- 172.21.15.40:0/3493948795 learned_addr learned my addr 172.21.15.40:0/3493948795 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:42.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.270+0000 7f5be259c700 1 --2- 172.21.15.40:0/3493948795 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5be4133e00 0x7f5be4119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:42.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.270+0000 7f5be2d9d700 1 --2- 172.21.15.40:0/3493948795 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5be4139570 0x7f5be4119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:42.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.270+0000 7f5be2d9d700 1 -- 172.21.15.40:0/3493948795 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5be4136c50 msgr2=0x7f5be4119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.270+0000 7f5be2d9d700 1 --2- 172.21.15.40:0/3493948795 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5be4136c50 0x7f5be4119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.270+0000 7f5be2d9d700 1 -- 172.21.15.40:0/3493948795 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5be4133e00 msgr2=0x7f5be4119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.270+0000 7f5be2d9d700 1 --2- 172.21.15.40:0/3493948795 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5be4133e00 0x7f5be4119050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.270+0000 7f5be2d9d700 1 -- 172.21.15.40:0/3493948795 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd80094a0 con 0x7f5be4139570 2023-09-30T22:28:42.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.270+0000 7f5be2d9d700 1 --2- 172.21.15.40:0/3493948795 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5be4139570 0x7f5be4119ad0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5be4099a60 tx=0x7f5bdc00ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:42.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.270+0000 7f5bd2ffd700 1 -- 172.21.15.40:0/3493948795 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc00cbf0 con 0x7f5be4139570 2023-09-30T22:28:42.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.270+0000 7f5bd2ffd700 1 -- 172.21.15.40:0/3493948795 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bdc00f040 con 0x7f5be4139570 2023-09-30T22:28:42.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.270+0000 7f5be8dd2700 1 -- 172.21.15.40:0/3493948795 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be4139360 con 0x7f5be4139570 2023-09-30T22:28:42.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.270+0000 7f5bd2ffd700 1 -- 172.21.15.40:0/3493948795 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc009e60 con 0x7f5be4139570 2023-09-30T22:28:42.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.270+0000 7f5be8dd2700 1 -- 172.21.15.40:0/3493948795 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be411b6a0 con 0x7f5be4139570 2023-09-30T22:28:42.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.271+0000 7f5be8dd2700 1 -- 172.21.15.40:0/3493948795 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be4062380 con 0x7f5be4139570 2023-09-30T22:28:42.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.272+0000 7f5bd2ffd700 1 -- 172.21.15.40:0/3493948795 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5bdc014480 con 0x7f5be4139570 2023-09-30T22:28:42.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.272+0000 7f5bd2ffd700 1 -- 172.21.15.40:0/3493948795 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5bdc0406f0 con 0x7f5be4139570 2023-09-30T22:28:42.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.276+0000 7f5bd2ffd700 1 -- 172.21.15.40:0/3493948795 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5bdc012930 con 0x7f5be4139570 2023-09-30T22:28:42.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.394+0000 7f3f7b27e700 1 -- 172.21.15.40:0/3738062304 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3f74120090 con 0x7f3f7409e400 2023-09-30T22:28:42.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.395+0000 7f3f69ffb700 1 -- 172.21.15.40:0/3738062304 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f74120090 con 0x7f3f7409e400 2023-09-30T22:28:42.395 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:42.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.398+0000 7f3f7b27e700 1 -- 172.21.15.40:0/3738062304 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3f7409e400 msgr2=0x7f3f7411e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.398+0000 7f3f7b27e700 1 --2- 172.21.15.40:0/3738062304 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3f7409e400 0x7f3f7411e080 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3f6400ec10 tx=0x7f3f6400ef20 comp rx=0 tx=0).stop 2023-09-30T22:28:42.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.398+0000 7f3f7b27e700 1 -- 172.21.15.40:0/3738062304 shutdown_connections 2023-09-30T22:28:42.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.398+0000 7f3f7b27e700 1 --2- 172.21.15.40:0/3738062304 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f7411e5c0 0x7f3f741c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.398+0000 7f3f7b27e700 1 --2- 172.21.15.40:0/3738062304 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f7409d920 0x7f3f7411db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.398+0000 7f3f7b27e700 1 --2- 172.21.15.40:0/3738062304 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3f7409e400 0x7f3f7411e080 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.398+0000 7f3f7b27e700 1 -- 172.21.15.40:0/3738062304 >> 172.21.15.40:0/3738062304 conn(0x7f3f7409fb20 msgr2=0x7f3f74137100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:42.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.398+0000 7f3f7b27e700 1 -- 172.21.15.40:0/3738062304 shutdown_connections 2023-09-30T22:28:42.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.398+0000 7f3f7b27e700 1 -- 172.21.15.40:0/3738062304 wait complete. 2023-09-30T22:28:42.411 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:42.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.432+0000 7f10e0cc9700 1 -- 172.21.15.40:0/4137184800 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f10dc0a04e0 con 0x7f10dc06fb50 2023-09-30T22:28:42.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.432+0000 7f10caffd700 1 -- 172.21.15.40:0/4137184800 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f10d001b430 con 0x7f10dc06fb50 2023-09-30T22:28:42.433 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:42.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.434+0000 7f10e0cc9700 1 -- 172.21.15.40:0/4137184800 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10dc06fb50 msgr2=0x7f10dc131280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.434+0000 7f10e0cc9700 1 --2- 172.21.15.40:0/4137184800 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10dc06fb50 0x7f10dc131280 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f10d0016000 tx=0x7f10d0004750 comp rx=0 tx=0).stop 2023-09-30T22:28:42.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.434+0000 7f10e0cc9700 1 -- 172.21.15.40:0/4137184800 shutdown_connections 2023-09-30T22:28:42.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.434+0000 7f10e0cc9700 1 --2- 172.21.15.40:0/4137184800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10dc1371b0 0x7f10dc1317c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.434+0000 7f10e0cc9700 1 --2- 172.21.15.40:0/4137184800 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10dc06f070 0x7f10dc130d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.434+0000 7f10e0cc9700 1 --2- 172.21.15.40:0/4137184800 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10dc06fb50 0x7f10dc131280 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.434+0000 7f10e0cc9700 1 -- 172.21.15.40:0/4137184800 >> 172.21.15.40:0/4137184800 conn(0x7f10dc0a41a0 msgr2=0x7f10dc0a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:42.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.434+0000 7f10e0cc9700 1 -- 172.21.15.40:0/4137184800 shutdown_connections 2023-09-30T22:28:42.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.434+0000 7f10e0cc9700 1 -- 172.21.15.40:0/4137184800 wait complete. 2023-09-30T22:28:42.447 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:42.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.473+0000 7f5be8dd2700 1 -- 172.21.15.40:0/3493948795 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5be4074330 con 0x7f5be4139570 2023-09-30T22:28:42.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.473+0000 7f5bd2ffd700 1 -- 172.21.15.40:0/3493948795 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5bdc02a020 con 0x7f5be4139570 2023-09-30T22:28:42.474 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:42.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.476+0000 7f5be8dd2700 1 -- 172.21.15.40:0/3493948795 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5be4139570 msgr2=0x7f5be4119ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.476+0000 7f5be8dd2700 1 --2- 172.21.15.40:0/3493948795 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5be4139570 0x7f5be4119ad0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5be4099a60 tx=0x7f5bdc00ef90 comp rx=0 tx=0).stop 2023-09-30T22:28:42.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.476+0000 7f5be8dd2700 1 -- 172.21.15.40:0/3493948795 shutdown_connections 2023-09-30T22:28:42.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.476+0000 7f5be8dd2700 1 --2- 172.21.15.40:0/3493948795 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5be4139570 0x7f5be4119ad0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.476+0000 7f5be8dd2700 1 --2- 172.21.15.40:0/3493948795 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5be4133e00 0x7f5be4119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.476+0000 7f5be8dd2700 1 --2- 172.21.15.40:0/3493948795 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5be4136c50 0x7f5be4119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.476+0000 7f5be8dd2700 1 -- 172.21.15.40:0/3493948795 >> 172.21.15.40:0/3493948795 conn(0x7f5be40a2a00 msgr2=0x7f5be409b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:42.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.476+0000 7f5be8dd2700 1 -- 172.21.15.40:0/3493948795 shutdown_connections 2023-09-30T22:28:42.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.476+0000 7f5be8dd2700 1 -- 172.21.15.40:0/3493948795 wait complete. 2023-09-30T22:28:42.488 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:42.579 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:42.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.706+0000 7f6179892700 1 Processor -- start 2023-09-30T22:28:42.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.706+0000 7f6179892700 1 -- start start 2023-09-30T22:28:42.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.707+0000 7f6179892700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f617409d920 0x7f617409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.707+0000 7f6179892700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f617409e230 0x7f61741308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.707+0000 7f6179892700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6174130de0 0x7f6174131280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.707+0000 7f6179892700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f617409edf0 con 0x7f6174130de0 2023-09-30T22:28:42.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.707+0000 7f6179892700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f617409adf0 con 0x7f617409d920 2023-09-30T22:28:42.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.707+0000 7f6179892700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f617409b660 con 0x7f617409e230 2023-09-30T22:28:42.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.707+0000 7f6172ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f617409d920 0x7f617409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:42.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.707+0000 7f616a7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f617409e230 0x7f61741308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:42.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.707+0000 7f61737fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6174130de0 0x7f6174131280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:42.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.707+0000 7f616a7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f617409e230 0x7f61741308a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:36600/0 (socket says 172.21.15.40:36600) 2023-09-30T22:28:42.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.707+0000 7f61737fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6174130de0 0x7f6174131280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40758/0 (socket says 172.21.15.40:40758) 2023-09-30T22:28:42.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.707+0000 7f616a7fc700 1 -- 172.21.15.40:0/713968759 learned_addr learned my addr 172.21.15.40:0/713968759 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:42.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.707+0000 7f6172ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f617409d920 0x7f617409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:47220/0 (socket says 172.21.15.40:47220) 2023-09-30T22:28:42.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.707+0000 7f6172ffd700 1 -- 172.21.15.40:0/713968759 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f617409e230 msgr2=0x7f61741308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:42.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.707+0000 7f6172ffd700 1 --2- 172.21.15.40:0/713968759 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f617409e230 0x7f61741308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.708+0000 7f6172ffd700 1 -- 172.21.15.40:0/713968759 >> v2:172.21.15.40:3300/0 conn(0x7f6174130de0 msgr2=0x7f6174131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:42.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.708+0000 7f6172ffd700 1 --2- 172.21.15.40:0/713968759 >> v2:172.21.15.40:3300/0 conn(0x7f6174130de0 0x7f6174131280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.708+0000 7f6172ffd700 1 -- 172.21.15.40:0/713968759 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f617409a6e0 con 0x7f617409d920 2023-09-30T22:28:42.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.708+0000 7f61737fe700 1 --2- 172.21.15.40:0/713968759 >> v2:172.21.15.40:3300/0 conn(0x7f6174130de0 0x7f6174131280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:42.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.708+0000 7f616a7fc700 1 --2- 172.21.15.40:0/713968759 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f617409e230 0x7f61741308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:42.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.708+0000 7f6172ffd700 1 --2- 172.21.15.40:0/713968759 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f617409d920 0x7f617409dcf0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6164009820 tx=0x7f6164009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf4019ec95ce96e0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:42.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.708+0000 7f61727fc700 1 -- 172.21.15.40:0/713968759 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6164005e30 con 0x7f617409d920 2023-09-30T22:28:42.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.708+0000 7f61727fc700 1 -- 172.21.15.40:0/713968759 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6164006030 con 0x7f617409d920 2023-09-30T22:28:42.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.708+0000 7f61727fc700 1 -- 172.21.15.40:0/713968759 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61640063c0 con 0x7f617409d920 2023-09-30T22:28:42.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.708+0000 7f6179892700 1 -- 172.21.15.40:0/713968759 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f617409d920 msgr2=0x7f617409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.708+0000 7f6179892700 1 --2- 172.21.15.40:0/713968759 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f617409d920 0x7f617409dcf0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6164009820 tx=0x7f6164009b30 comp rx=0 tx=0).stop 2023-09-30T22:28:42.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.708+0000 7f6179892700 1 -- 172.21.15.40:0/713968759 shutdown_connections 2023-09-30T22:28:42.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.708+0000 7f6179892700 1 --2- 172.21.15.40:0/713968759 >> v2:172.21.15.40:3300/0 conn(0x7f6174130de0 0x7f6174131280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.708+0000 7f6179892700 1 --2- 172.21.15.40:0/713968759 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f617409d920 0x7f617409dcf0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.708+0000 7f6179892700 1 --2- 172.21.15.40:0/713968759 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f617409e230 0x7f61741308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.708+0000 7f6179892700 1 -- 172.21.15.40:0/713968759 >> 172.21.15.40:0/713968759 conn(0x7f617409fb20 msgr2=0x7f617409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:42.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.708+0000 7f6179892700 1 -- 172.21.15.40:0/713968759 shutdown_connections 2023-09-30T22:28:42.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.708+0000 7f6179892700 1 -- 172.21.15.40:0/713968759 wait complete. 2023-09-30T22:28:42.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.710+0000 7f6179892700 1 Processor -- start 2023-09-30T22:28:42.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.710+0000 7f6179892700 1 -- start start 2023-09-30T22:28:42.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.710+0000 7f6179892700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f617409d920 0x7f6174120520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.710+0000 7f6179892700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f617409e230 0x7f6174120a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.711+0000 7f6179892700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6174130de0 0x7f6174120fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.711+0000 7f6179892700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617412e7e0 con 0x7f617409d920 2023-09-30T22:28:42.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.711+0000 7f6179892700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6174123b70 con 0x7f617409e230 2023-09-30T22:28:42.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.711+0000 7f6179892700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f617406b120 con 0x7f6174130de0 2023-09-30T22:28:42.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.711+0000 7f6172ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f617409d920 0x7f6174120520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:42.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.711+0000 7f6172ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f617409d920 0x7f6174120520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40766/0 (socket says 172.21.15.40:40766) 2023-09-30T22:28:42.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.711+0000 7f61737fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6174130de0 0x7f6174120fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:42.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.711+0000 7f6172ffd700 1 -- 172.21.15.40:0/4015202758 learned_addr learned my addr 172.21.15.40:0/4015202758 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:42.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.711+0000 7f616a7fc700 1 --2- 172.21.15.40:0/4015202758 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f617409e230 0x7f6174120a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:42.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.711+0000 7f616a7fc700 1 -- 172.21.15.40:0/4015202758 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6174130de0 msgr2=0x7f6174120fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.711+0000 7f616a7fc700 1 --2- 172.21.15.40:0/4015202758 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6174130de0 0x7f6174120fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.711+0000 7f616a7fc700 1 -- 172.21.15.40:0/4015202758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f617409d920 msgr2=0x7f6174120520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.711+0000 7f616a7fc700 1 --2- 172.21.15.40:0/4015202758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f617409d920 0x7f6174120520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.711+0000 7f616a7fc700 1 -- 172.21.15.40:0/4015202758 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615c00b7f0 con 0x7f617409e230 2023-09-30T22:28:42.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.711+0000 7f6172ffd700 1 --2- 172.21.15.40:0/4015202758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f617409d920 0x7f6174120520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:42.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.711+0000 7f61737fe700 1 --2- 172.21.15.40:0/4015202758 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6174130de0 0x7f6174120fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:42.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.711+0000 7f616a7fc700 1 --2- 172.21.15.40:0/4015202758 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f617409e230 0x7f6174120a60 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f61740679b0 tx=0x7f615c00d630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:42.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.711+0000 7f6170ff9700 1 -- 172.21.15.40:0/4015202758 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615c00de40 con 0x7f617409e230 2023-09-30T22:28:42.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.711+0000 7f6170ff9700 1 -- 172.21.15.40:0/4015202758 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615c004030 con 0x7f617409e230 2023-09-30T22:28:42.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.711+0000 7f6170ff9700 1 -- 172.21.15.40:0/4015202758 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615c0043c0 con 0x7f617409e230 2023-09-30T22:28:42.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.711+0000 7f6179892700 1 -- 172.21.15.40:0/4015202758 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f616c009a70 con 0x7f617409e230 2023-09-30T22:28:42.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.711+0000 7f6179892700 1 -- 172.21.15.40:0/4015202758 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6164009430 con 0x7f617409e230 2023-09-30T22:28:42.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.712+0000 7f6170ff9700 1 -- 172.21.15.40:0/4015202758 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f615c0036a0 con 0x7f617409e230 2023-09-30T22:28:42.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.712+0000 7f6170ff9700 1 -- 172.21.15.40:0/4015202758 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f615c03fbf0 con 0x7f617409e230 2023-09-30T22:28:42.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.712+0000 7f6179892700 1 -- 172.21.15.40:0/4015202758 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6174062380 con 0x7f617409e230 2023-09-30T22:28:42.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.717+0000 7f6170ff9700 1 -- 172.21.15.40:0/4015202758 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f615c01e020 con 0x7f617409e230 2023-09-30T22:28:42.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.912+0000 7f6179892700 1 -- 172.21.15.40:0/4015202758 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6174074720 con 0x7f617409e230 2023-09-30T22:28:42.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.912+0000 7f6170ff9700 1 -- 172.21.15.40:0/4015202758 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f615c014070 con 0x7f617409e230 2023-09-30T22:28:42.913 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:42.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.914+0000 7f6179892700 1 -- 172.21.15.40:0/4015202758 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f617409e230 msgr2=0x7f6174120a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.914+0000 7f6179892700 1 --2- 172.21.15.40:0/4015202758 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f617409e230 0x7f6174120a60 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f61740679b0 tx=0x7f615c00d630 comp rx=0 tx=0).stop 2023-09-30T22:28:42.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.914+0000 7f6179892700 1 -- 172.21.15.40:0/4015202758 shutdown_connections 2023-09-30T22:28:42.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.914+0000 7f6179892700 1 --2- 172.21.15.40:0/4015202758 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6174130de0 0x7f6174120fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.914+0000 7f6179892700 1 --2- 172.21.15.40:0/4015202758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f617409d920 0x7f6174120520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.914+0000 7f6179892700 1 --2- 172.21.15.40:0/4015202758 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f617409e230 0x7f6174120a60 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.914+0000 7f6179892700 1 -- 172.21.15.40:0/4015202758 >> 172.21.15.40:0/4015202758 conn(0x7f617409fb20 msgr2=0x7f617412e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:42.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.914+0000 7f6179892700 1 -- 172.21.15.40:0/4015202758 shutdown_connections 2023-09-30T22:28:42.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:42.914+0000 7f6179892700 1 -- 172.21.15.40:0/4015202758 wait complete. 2023-09-30T22:28:42.927 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:43.412 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:43.448 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:43.489 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:43.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.550+0000 7f07599f0700 1 Processor -- start 2023-09-30T22:28:43.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.550+0000 7f07599f0700 1 -- start start 2023-09-30T22:28:43.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.551+0000 7f07599f0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f075406f070 0x7f075406f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.551+0000 7f07599f0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f075406f980 0x7f0754097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.551+0000 7f07599f0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0754070830 con 0x7f075406fdb0 2023-09-30T22:28:43.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.551+0000 7f07599f0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0754071af0 con 0x7f075406f980 2023-09-30T22:28:43.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.551+0000 7f07599f0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0754070ad0 con 0x7f075406f070 2023-09-30T22:28:43.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.551+0000 7f07527fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f075406f980 0x7f0754097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:43.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.551+0000 7f07527fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f075406f980 0x7f0754097090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:43032/0 (socket says 172.21.15.40:43032) 2023-09-30T22:28:43.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.551+0000 7f07527fc700 1 -- 172.21.15.40:0/2035827352 learned_addr learned my addr 172.21.15.40:0/2035827352 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:43.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.551+0000 7f0752ffd700 1 --2- 172.21.15.40:0/2035827352 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f075406f070 0x7f075406f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:43.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.551+0000 7f07527fc700 1 -- 172.21.15.40:0/2035827352 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f075406f070 msgr2=0x7f075406f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:43.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.551+0000 7f07527fc700 1 --2- 172.21.15.40:0/2035827352 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f075406f070 0x7f075406f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.551+0000 7f07527fc700 1 -- 172.21.15.40:0/2035827352 >> v1:172.21.15.40:6789/0 conn(0x7f075406fdb0 legacy=0x7f07540975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:43.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.551+0000 7f07527fc700 1 -- 172.21.15.40:0/2035827352 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0754070de0 con 0x7f075406f980 2023-09-30T22:28:43.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.551+0000 7f07527fc700 1 --2- 172.21.15.40:0/2035827352 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f075406f980 0x7f0754097090 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0748009920 tx=0x7f0748009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=351c430cd07cc93 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:43.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.552+0000 7f0751ffb700 1 -- 172.21.15.40:0/2035827352 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0748011830 con 0x7f075406f980 2023-09-30T22:28:43.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.552+0000 7f0751ffb700 1 -- 172.21.15.40:0/2035827352 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0748011990 con 0x7f075406f980 2023-09-30T22:28:43.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.552+0000 7f0751ffb700 1 -- 172.21.15.40:0/2035827352 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0748011d20 con 0x7f075406f980 2023-09-30T22:28:43.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.552+0000 7f07599f0700 1 -- 172.21.15.40:0/2035827352 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f075406f980 msgr2=0x7f0754097090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:43.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.552+0000 7f07599f0700 1 --2- 172.21.15.40:0/2035827352 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f075406f980 0x7f0754097090 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0748009920 tx=0x7f0748009c30 comp rx=0 tx=0).stop 2023-09-30T22:28:43.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.552+0000 7f07599f0700 1 -- 172.21.15.40:0/2035827352 shutdown_connections 2023-09-30T22:28:43.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.552+0000 7f07599f0700 1 --2- 172.21.15.40:0/2035827352 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f075406f070 0x7f075406f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.552+0000 7f07599f0700 1 --2- 172.21.15.40:0/2035827352 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f075406f980 0x7f0754097090 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.552+0000 7f07599f0700 1 -- 172.21.15.40:0/2035827352 >> 172.21.15.40:0/2035827352 conn(0x7f07540a41a0 msgr2=0x7f07540a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:43.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.552+0000 7f07599f0700 1 -- 172.21.15.40:0/2035827352 shutdown_connections 2023-09-30T22:28:43.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.553+0000 7f07599f0700 1 -- 172.21.15.40:0/2035827352 wait complete. 2023-09-30T22:28:43.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.554+0000 7f07599f0700 1 Processor -- start 2023-09-30T22:28:43.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.554+0000 7f07599f0700 1 -- start start 2023-09-30T22:28:43.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.555+0000 7f07599f0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f075406f070 0x7f075412d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.555+0000 7f07599f0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f075406f980 0x7f075412da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.555+0000 7f07599f0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f075406fdb0 0x7f075412dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.555+0000 7f07599f0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075412f1b0 con 0x7f075406fdb0 2023-09-30T22:28:43.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.555+0000 7f07599f0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0754130580 con 0x7f075406f980 2023-09-30T22:28:43.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.555+0000 7f07599f0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07541296a0 con 0x7f075406f070 2023-09-30T22:28:43.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.555+0000 7f07527fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f075406f980 0x7f075412da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:43.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.555+0000 7f07527fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f075406f980 0x7f075412da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:43040/0 (socket says 172.21.15.40:43040) 2023-09-30T22:28:43.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.555+0000 7f07527fc700 1 -- 172.21.15.40:0/1423667451 learned_addr learned my addr 172.21.15.40:0/1423667451 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:43.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.555+0000 7f07537fe700 1 --2- 172.21.15.40:0/1423667451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f075406fdb0 0x7f075412dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:43.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.555+0000 7f0752ffd700 1 --2- 172.21.15.40:0/1423667451 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f075406f070 0x7f075412d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:43.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.555+0000 7f07527fc700 1 -- 172.21.15.40:0/1423667451 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f075406f070 msgr2=0x7f075412d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:43.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.555+0000 7f07527fc700 1 --2- 172.21.15.40:0/1423667451 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f075406f070 0x7f075412d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.555+0000 7f07527fc700 1 -- 172.21.15.40:0/1423667451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f075406fdb0 msgr2=0x7f075412dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:43.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.555+0000 7f07527fc700 1 --2- 172.21.15.40:0/1423667451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f075406fdb0 0x7f075412dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.555+0000 7f07527fc700 1 -- 172.21.15.40:0/1423667451 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0748009550 con 0x7f075406f980 2023-09-30T22:28:43.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.555+0000 7f07527fc700 1 --2- 172.21.15.40:0/1423667451 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f075406f980 0x7f075412da70 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f0748013000 tx=0x7f0748004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:43.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.556+0000 7f073bfff700 1 -- 172.21.15.40:0/1423667451 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0748004510 con 0x7f075406f980 2023-09-30T22:28:43.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.556+0000 7f073bfff700 1 -- 172.21.15.40:0/1423667451 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07480036a0 con 0x7f075406f980 2023-09-30T22:28:43.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.556+0000 7f07599f0700 1 -- 172.21.15.40:0/1423667451 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f075412c2d0 con 0x7f075406f980 2023-09-30T22:28:43.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.556+0000 7f073bfff700 1 -- 172.21.15.40:0/1423667451 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0748003a30 con 0x7f075406f980 2023-09-30T22:28:43.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.556+0000 7f07599f0700 1 -- 172.21.15.40:0/1423667451 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0754131700 con 0x7f075406f980 2023-09-30T22:28:43.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.557+0000 7f073bfff700 1 -- 172.21.15.40:0/1423667451 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0748003b90 con 0x7f075406f980 2023-09-30T22:28:43.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.557+0000 7f07599f0700 1 -- 172.21.15.40:0/1423667451 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f075412fed0 con 0x7f075406f980 2023-09-30T22:28:43.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.557+0000 7f073bfff700 1 -- 172.21.15.40:0/1423667451 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f0748021030 con 0x7f075406f980 2023-09-30T22:28:43.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.561+0000 7f073bfff700 1 -- 172.21.15.40:0/1423667451 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0748003e40 con 0x7f075406f980 2023-09-30T22:28:43.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.592+0000 7f4a13f96700 1 Processor -- start 2023-09-30T22:28:43.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.593+0000 7f4a13f96700 1 -- start start 2023-09-30T22:28:43.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.593+0000 7f4a13f96700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a0c09c890 0x7f4a0c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.593+0000 7f4a13f96700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4a0c09d920 0x7f4a0c09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.593+0000 7f4a13f96700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4a0c09e2b0 0x7f4a0c13ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.593+0000 7f4a13f96700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a0c0a29d0 con 0x7f4a0c09e2b0 2023-09-30T22:28:43.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.593+0000 7f4a13f96700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0c09fb40 con 0x7f4a0c09c890 2023-09-30T22:28:43.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.593+0000 7f4a13f96700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0c0a2600 con 0x7f4a0c09d920 2023-09-30T22:28:43.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.594+0000 7f4a11531700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4a0c09d920 0x7f4a0c09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:43.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.594+0000 7f4a11531700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4a0c09d920 0x7f4a0c09dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:44098/0 (socket says 172.21.15.40:44098) 2023-09-30T22:28:43.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.594+0000 7f4a11531700 1 -- 172.21.15.40:0/4252514211 learned_addr learned my addr 172.21.15.40:0/4252514211 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:43.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.594+0000 7f4a11d32700 1 --2- 172.21.15.40:0/4252514211 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a0c09c890 0x7f4a0c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:43.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.594+0000 7f4a12533700 1 --2- 172.21.15.40:0/4252514211 >> v2:172.21.15.40:3300/0 conn(0x7f4a0c09e2b0 0x7f4a0c13ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:43.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.594+0000 7f4a11531700 1 -- 172.21.15.40:0/4252514211 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a0c09c890 msgr2=0x7f4a0c09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:43.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.594+0000 7f4a11531700 1 --2- 172.21.15.40:0/4252514211 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a0c09c890 0x7f4a0c09cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.594+0000 7f4a11531700 1 -- 172.21.15.40:0/4252514211 >> v2:172.21.15.40:3300/0 conn(0x7f4a0c09e2b0 msgr2=0x7f4a0c13ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:43.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.594+0000 7f4a11531700 1 --2- 172.21.15.40:0/4252514211 >> v2:172.21.15.40:3300/0 conn(0x7f4a0c09e2b0 0x7f4a0c13ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.594+0000 7f4a11531700 1 -- 172.21.15.40:0/4252514211 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a0c09e720 con 0x7f4a0c09d920 2023-09-30T22:28:43.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.594+0000 7f4a11d32700 1 --2- 172.21.15.40:0/4252514211 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a0c09c890 0x7f4a0c09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:43.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.594+0000 7f4a12533700 1 --2- 172.21.15.40:0/4252514211 >> v2:172.21.15.40:3300/0 conn(0x7f4a0c09e2b0 0x7f4a0c13ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:43.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.594+0000 7f4a11531700 1 --2- 172.21.15.40:0/4252514211 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4a0c09d920 0x7f4a0c09dd70 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f49fc0098f0 tx=0x7f49fc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91e3cc9dbd9060dd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:43.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.594+0000 7f4a10d30700 1 -- 172.21.15.40:0/4252514211 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc011830 con 0x7f4a0c09d920 2023-09-30T22:28:43.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.594+0000 7f4a10d30700 1 -- 172.21.15.40:0/4252514211 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49fc011990 con 0x7f4a0c09d920 2023-09-30T22:28:43.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.594+0000 7f4a10d30700 1 -- 172.21.15.40:0/4252514211 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc011d20 con 0x7f4a0c09d920 2023-09-30T22:28:43.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.595+0000 7f4a13f96700 1 -- 172.21.15.40:0/4252514211 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4a0c09d920 msgr2=0x7f4a0c09dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:43.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.595+0000 7f4a13f96700 1 --2- 172.21.15.40:0/4252514211 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4a0c09d920 0x7f4a0c09dd70 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f49fc0098f0 tx=0x7f49fc009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:43.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.595+0000 7f4a13f96700 1 -- 172.21.15.40:0/4252514211 shutdown_connections 2023-09-30T22:28:43.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.595+0000 7f4a13f96700 1 --2- 172.21.15.40:0/4252514211 >> v2:172.21.15.40:3300/0 conn(0x7f4a0c09e2b0 0x7f4a0c13ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.595+0000 7f4a13f96700 1 --2- 172.21.15.40:0/4252514211 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a0c09c890 0x7f4a0c09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.595+0000 7f4a13f96700 1 --2- 172.21.15.40:0/4252514211 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4a0c09d920 0x7f4a0c09dd70 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.595+0000 7f4a13f96700 1 -- 172.21.15.40:0/4252514211 >> 172.21.15.40:0/4252514211 conn(0x7f4a0c0a7080 msgr2=0x7f4a0c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:43.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.596+0000 7f4a13f96700 1 -- 172.21.15.40:0/4252514211 shutdown_connections 2023-09-30T22:28:43.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.596+0000 7f4a13f96700 1 -- 172.21.15.40:0/4252514211 wait complete. 2023-09-30T22:28:43.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.597+0000 7f4a13f96700 1 Processor -- start 2023-09-30T22:28:43.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.597+0000 7f4a13f96700 1 -- start start 2023-09-30T22:28:43.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.598+0000 7f4a13f96700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a0c09c890 0x7f4a0c12d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.598+0000 7f4a13f96700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a0c09d920 0x7f4a0c12d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.598+0000 7f4a13f96700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4a0c09e2b0 0x7f4a0c12db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.598+0000 7f4a13f96700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0c130870 con 0x7f4a0c09d920 2023-09-30T22:28:43.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.598+0000 7f4a13f96700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0c0a5bd0 con 0x7f4a0c09c890 2023-09-30T22:28:43.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.598+0000 7f4a13f96700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0c09c340 con 0x7f4a0c09e2b0 2023-09-30T22:28:43.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.598+0000 7f4a11531700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a0c09d920 0x7f4a0c12d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:43.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.598+0000 7f4a11d32700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a0c09c890 0x7f4a0c12d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:43.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.598+0000 7f4a11531700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a0c09d920 0x7f4a0c12d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35478/0 (socket says 172.21.15.40:35478) 2023-09-30T22:28:43.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.598+0000 7f4a11531700 1 -- 172.21.15.40:0/1750123616 learned_addr learned my addr 172.21.15.40:0/1750123616 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:43.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.598+0000 7f4a12533700 1 --2- 172.21.15.40:0/1750123616 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4a0c09e2b0 0x7f4a0c12db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:43.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.598+0000 7f4a11d32700 1 -- 172.21.15.40:0/1750123616 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4a0c09e2b0 msgr2=0x7f4a0c12db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:43.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.598+0000 7f4a11d32700 1 --2- 172.21.15.40:0/1750123616 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4a0c09e2b0 0x7f4a0c12db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.598+0000 7f4a11d32700 1 -- 172.21.15.40:0/1750123616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a0c09d920 msgr2=0x7f4a0c12d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:43.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.598+0000 7f4a11d32700 1 --2- 172.21.15.40:0/1750123616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a0c09d920 0x7f4a0c12d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.598+0000 7f4a11d32700 1 -- 172.21.15.40:0/1750123616 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a08009430 con 0x7f4a0c09c890 2023-09-30T22:28:43.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.598+0000 7f4a11d32700 1 --2- 172.21.15.40:0/1750123616 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a0c09c890 0x7f4a0c12d0c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4a0800e930 tx=0x7f4a0800ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:43.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.599+0000 7f4a027fc700 1 -- 172.21.15.40:0/1750123616 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a08005a20 con 0x7f4a0c09c890 2023-09-30T22:28:43.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.599+0000 7f4a027fc700 1 -- 172.21.15.40:0/1750123616 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a08005b80 con 0x7f4a0c09c890 2023-09-30T22:28:43.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.599+0000 7f4a027fc700 1 -- 172.21.15.40:0/1750123616 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a08004030 con 0x7f4a0c09c890 2023-09-30T22:28:43.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.599+0000 7f4a13f96700 1 -- 172.21.15.40:0/1750123616 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a04009a70 con 0x7f4a0c09c890 2023-09-30T22:28:43.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.599+0000 7f4a13f96700 1 -- 172.21.15.40:0/1750123616 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49fc009550 con 0x7f4a0c09c890 2023-09-30T22:28:43.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.600+0000 7f4a027fc700 1 -- 172.21.15.40:0/1750123616 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4a08004190 con 0x7f4a0c09c890 2023-09-30T22:28:43.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.600+0000 7f4a027fc700 1 -- 172.21.15.40:0/1750123616 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4a0803fcb0 con 0x7f4a0c09c890 2023-09-30T22:28:43.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.601+0000 7f4a13f96700 1 -- 172.21.15.40:0/1750123616 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a0c09ecf0 con 0x7f4a0c09c890 2023-09-30T22:28:43.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.610+0000 7f4a027fc700 1 -- 172.21.15.40:0/1750123616 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4a08004440 con 0x7f4a0c09c890 2023-09-30T22:28:43.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.644+0000 7f9480fee700 1 Processor -- start 2023-09-30T22:28:43.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.644+0000 7f9480fee700 1 -- start start 2023-09-30T22:28:43.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.645+0000 7f9480fee700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f947c133e00 0x7f947c1341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.645+0000 7f9480fee700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f947c09d400 0x7f947c09d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.645+0000 7f9480fee700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f947c09dd70 0x7f947c13ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.645+0000 7f9480fee700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f947c09ab20 con 0x7f947c133e00 2023-09-30T22:28:43.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.645+0000 7f9480fee700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f947c133940 con 0x7f947c09d400 2023-09-30T22:28:43.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.645+0000 7f9480fee700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f947c09f0d0 con 0x7f947c09dd70 2023-09-30T22:28:43.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.645+0000 7f947a59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f947c133e00 0x7f947c1341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:43.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.645+0000 7f947a59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f947c133e00 0x7f947c1341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35484/0 (socket says 172.21.15.40:35484) 2023-09-30T22:28:43.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.645+0000 7f947a59c700 1 -- 172.21.15.40:0/2896990186 learned_addr learned my addr 172.21.15.40:0/2896990186 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:43.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.646+0000 7f947a59c700 1 -- 172.21.15.40:0/2896990186 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f947c09dd70 msgr2=0x7f947c13ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:43.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.646+0000 7f947a59c700 1 --2- 172.21.15.40:0/2896990186 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f947c09dd70 0x7f947c13ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.646+0000 7f947a59c700 1 -- 172.21.15.40:0/2896990186 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f947c09d400 msgr2=0x7f947c09d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:43.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.646+0000 7f947a59c700 1 --2- 172.21.15.40:0/2896990186 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f947c09d400 0x7f947c09d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.646+0000 7f947a59c700 1 -- 172.21.15.40:0/2896990186 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947c133be0 con 0x7f947c133e00 2023-09-30T22:28:43.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.646+0000 7f947a59c700 1 --2- 172.21.15.40:0/2896990186 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f947c133e00 0x7f947c1341d0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f946c0098f0 tx=0x7f946c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10b0f1d75ee78191 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:43.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.646+0000 7f947959a700 1 -- 172.21.15.40:0/2896990186 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946c00b8a0 con 0x7f947c133e00 2023-09-30T22:28:43.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.646+0000 7f947959a700 1 -- 172.21.15.40:0/2896990186 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946c00ba00 con 0x7f947c133e00 2023-09-30T22:28:43.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.646+0000 7f947959a700 1 -- 172.21.15.40:0/2896990186 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946c00bd70 con 0x7f947c133e00 2023-09-30T22:28:43.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.647+0000 7f9480fee700 1 -- 172.21.15.40:0/2896990186 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f947c133e00 msgr2=0x7f947c1341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:43.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.647+0000 7f9480fee700 1 --2- 172.21.15.40:0/2896990186 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f947c133e00 0x7f947c1341d0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f946c0098f0 tx=0x7f946c009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:43.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.647+0000 7f9480fee700 1 -- 172.21.15.40:0/2896990186 shutdown_connections 2023-09-30T22:28:43.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.647+0000 7f9480fee700 1 --2- 172.21.15.40:0/2896990186 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f947c09dd70 0x7f947c13ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.647+0000 7f9480fee700 1 --2- 172.21.15.40:0/2896990186 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f947c133e00 0x7f947c1341d0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.647+0000 7f9480fee700 1 --2- 172.21.15.40:0/2896990186 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f947c09d400 0x7f947c09d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.647+0000 7f9480fee700 1 -- 172.21.15.40:0/2896990186 >> 172.21.15.40:0/2896990186 conn(0x7f947c0a2a00 msgr2=0x7f947c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:43.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.647+0000 7f9480fee700 1 -- 172.21.15.40:0/2896990186 shutdown_connections 2023-09-30T22:28:43.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.647+0000 7f9480fee700 1 -- 172.21.15.40:0/2896990186 wait complete. 2023-09-30T22:28:43.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.648+0000 7f9480fee700 1 Processor -- start 2023-09-30T22:28:43.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.649+0000 7f9480fee700 1 -- start start 2023-09-30T22:28:43.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.649+0000 7f9480fee700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f947c09d400 0x7f947c11a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.649+0000 7f9480fee700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f947c09dd70 0x7f947c11aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.649+0000 7f9480fee700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f947c133e00 0x7f947c11b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.649+0000 7f9480fee700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947c11cbd0 con 0x7f947c09dd70 2023-09-30T22:28:43.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.649+0000 7f9480fee700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f947c11df20 con 0x7f947c09d400 2023-09-30T22:28:43.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.649+0000 7f9480fee700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f947c11c730 con 0x7f947c133e00 2023-09-30T22:28:43.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.649+0000 7f9479d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f947c09dd70 0x7f947c11aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:43.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.649+0000 7f947a59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f947c09d400 0x7f947c11a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:43.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.649+0000 7f9479d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f947c09dd70 0x7f947c11aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35496/0 (socket says 172.21.15.40:35496) 2023-09-30T22:28:43.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.649+0000 7f947a59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f947c09d400 0x7f947c11a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:43098/0 (socket says 172.21.15.40:43098) 2023-09-30T22:28:43.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.649+0000 7f9479d9b700 1 -- 172.21.15.40:0/1303704161 learned_addr learned my addr 172.21.15.40:0/1303704161 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:43.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.649+0000 7f947ad9d700 1 --2- 172.21.15.40:0/1303704161 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f947c133e00 0x7f947c11b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:43.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.650+0000 7f9479d9b700 1 -- 172.21.15.40:0/1303704161 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f947c133e00 msgr2=0x7f947c11b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:43.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.650+0000 7f9479d9b700 1 --2- 172.21.15.40:0/1303704161 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f947c133e00 0x7f947c11b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.650+0000 7f9479d9b700 1 -- 172.21.15.40:0/1303704161 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f947c09d400 msgr2=0x7f947c11a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:43.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.650+0000 7f9479d9b700 1 --2- 172.21.15.40:0/1303704161 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f947c09d400 0x7f947c11a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.650+0000 7f9479d9b700 1 -- 172.21.15.40:0/1303704161 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f946c009550 con 0x7f947c09dd70 2023-09-30T22:28:43.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.650+0000 7f947a59c700 1 --2- 172.21.15.40:0/1303704161 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f947c09d400 0x7f947c11a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:43.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.650+0000 7f9479d9b700 1 --2- 172.21.15.40:0/1303704161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f947c09dd70 0x7f947c11aee0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f947000b4d0 tx=0x7f947000b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:43.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.650+0000 7f946affd700 1 -- 172.21.15.40:0/1303704161 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947000bea0 con 0x7f947c09dd70 2023-09-30T22:28:43.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.650+0000 7f946affd700 1 -- 172.21.15.40:0/1303704161 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9470011830 con 0x7f947c09dd70 2023-09-30T22:28:43.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.650+0000 7f946affd700 1 -- 172.21.15.40:0/1303704161 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9470011be0 con 0x7f947c09dd70 2023-09-30T22:28:43.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.651+0000 7f9480fee700 1 -- 172.21.15.40:0/1303704161 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f947c0a1310 con 0x7f947c09dd70 2023-09-30T22:28:43.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.651+0000 7f9480fee700 1 -- 172.21.15.40:0/1303704161 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f947c11e1e0 con 0x7f947c09dd70 2023-09-30T22:28:43.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.651+0000 7f946affd700 1 -- 172.21.15.40:0/1303704161 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9470011d40 con 0x7f947c09dd70 2023-09-30T22:28:43.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.652+0000 7f946affd700 1 -- 172.21.15.40:0/1303704161 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f947003f720 con 0x7f947c09dd70 2023-09-30T22:28:43.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.652+0000 7f9480fee700 1 -- 172.21.15.40:0/1303704161 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f947c062380 con 0x7f947c09dd70 2023-09-30T22:28:43.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.661+0000 7f946affd700 1 -- 172.21.15.40:0/1303704161 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9470015020 con 0x7f947c09dd70 2023-09-30T22:28:43.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.770+0000 7f07599f0700 1 -- 172.21.15.40:0/1423667451 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0754062380 con 0x7f075406f980 2023-09-30T22:28:43.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.770+0000 7f073bfff700 1 -- 172.21.15.40:0/1423667451 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0748015020 con 0x7f075406f980 2023-09-30T22:28:43.771 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:43.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.772+0000 7f07599f0700 1 -- 172.21.15.40:0/1423667451 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f075406f980 msgr2=0x7f075412da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:43.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.772+0000 7f07599f0700 1 --2- 172.21.15.40:0/1423667451 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f075406f980 0x7f075412da70 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f0748013000 tx=0x7f0748004750 comp rx=0 tx=0).stop 2023-09-30T22:28:43.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.772+0000 7f07599f0700 1 -- 172.21.15.40:0/1423667451 shutdown_connections 2023-09-30T22:28:43.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.772+0000 7f07599f0700 1 --2- 172.21.15.40:0/1423667451 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f075406f070 0x7f075412d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.772+0000 7f07599f0700 1 --2- 172.21.15.40:0/1423667451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f075406fdb0 0x7f075412dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.772+0000 7f07599f0700 1 --2- 172.21.15.40:0/1423667451 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f075406f980 0x7f075412da70 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.772+0000 7f07599f0700 1 -- 172.21.15.40:0/1423667451 >> 172.21.15.40:0/1423667451 conn(0x7f07540a41a0 msgr2=0x7f0754097530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:43.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.772+0000 7f07599f0700 1 -- 172.21.15.40:0/1423667451 shutdown_connections 2023-09-30T22:28:43.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.772+0000 7f07599f0700 1 -- 172.21.15.40:0/1423667451 wait complete. 2023-09-30T22:28:43.785 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:43.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.843+0000 7f4a13f96700 1 -- 172.21.15.40:0/1750123616 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4a0c062380 con 0x7f4a0c09c890 2023-09-30T22:28:43.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.844+0000 7f4a027fc700 1 -- 172.21.15.40:0/1750123616 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4a08029020 con 0x7f4a0c09c890 2023-09-30T22:28:43.844 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:43.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.845+0000 7f4a13f96700 1 -- 172.21.15.40:0/1750123616 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a0c09c890 msgr2=0x7f4a0c12d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:43.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.845+0000 7f4a13f96700 1 --2- 172.21.15.40:0/1750123616 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a0c09c890 0x7f4a0c12d0c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4a0800e930 tx=0x7f4a0800ec40 comp rx=0 tx=0).stop 2023-09-30T22:28:43.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.846+0000 7f4a13f96700 1 -- 172.21.15.40:0/1750123616 shutdown_connections 2023-09-30T22:28:43.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.846+0000 7f4a13f96700 1 --2- 172.21.15.40:0/1750123616 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4a0c09e2b0 0x7f4a0c12db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.846+0000 7f4a13f96700 1 --2- 172.21.15.40:0/1750123616 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a0c09c890 0x7f4a0c12d0c0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.846+0000 7f4a13f96700 1 --2- 172.21.15.40:0/1750123616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a0c09d920 0x7f4a0c12d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.846+0000 7f4a13f96700 1 -- 172.21.15.40:0/1750123616 >> 172.21.15.40:0/1750123616 conn(0x7f4a0c0a7080 msgr2=0x7f4a0c132900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:43.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.846+0000 7f4a13f96700 1 -- 172.21.15.40:0/1750123616 shutdown_connections 2023-09-30T22:28:43.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.846+0000 7f4a13f96700 1 -- 172.21.15.40:0/1750123616 wait complete. 2023-09-30T22:28:43.858 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:43.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.871+0000 7f9480fee700 1 -- 172.21.15.40:0/1303704161 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f947c12faf0 con 0x7f947c09dd70 2023-09-30T22:28:43.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.872+0000 7f946affd700 1 -- 172.21.15.40:0/1303704161 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9470029090 con 0x7f947c09dd70 2023-09-30T22:28:43.872 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:43.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.874+0000 7f9480fee700 1 -- 172.21.15.40:0/1303704161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f947c09dd70 msgr2=0x7f947c11aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:43.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.874+0000 7f9480fee700 1 --2- 172.21.15.40:0/1303704161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f947c09dd70 0x7f947c11aee0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f947000b4d0 tx=0x7f947000b7e0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.874+0000 7f9480fee700 1 -- 172.21.15.40:0/1303704161 shutdown_connections 2023-09-30T22:28:43.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.874+0000 7f9480fee700 1 --2- 172.21.15.40:0/1303704161 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f947c133e00 0x7f947c11b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.874+0000 7f9480fee700 1 --2- 172.21.15.40:0/1303704161 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f947c09d400 0x7f947c11a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.874+0000 7f9480fee700 1 --2- 172.21.15.40:0/1303704161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f947c09dd70 0x7f947c11aee0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.874+0000 7f9480fee700 1 -- 172.21.15.40:0/1303704161 >> 172.21.15.40:0/1303704161 conn(0x7f947c0a2a00 msgr2=0x7f947c1bb230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:43.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.874+0000 7f9480fee700 1 -- 172.21.15.40:0/1303704161 shutdown_connections 2023-09-30T22:28:43.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:43.874+0000 7f9480fee700 1 -- 172.21.15.40:0/1303704161 wait complete. 2023-09-30T22:28:43.886 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:43.927 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:44.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.053+0000 7f690c6e6700 1 Processor -- start 2023-09-30T22:28:44.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.053+0000 7f690c6e6700 1 -- start start 2023-09-30T22:28:44.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.054+0000 7f690c6e6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f690406b1b0 0x7f6904136b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:44.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.054+0000 7f690c6e6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f69041370a0 0x7f6904139480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:44.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.054+0000 7f690c6e6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f690409eb60 con 0x7f690406a6d0 2023-09-30T22:28:44.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.054+0000 7f690c6e6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690409db70 con 0x7f690406b1b0 2023-09-30T22:28:44.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.054+0000 7f690c6e6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f690409ddf0 con 0x7f69041370a0 2023-09-30T22:28:44.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.055+0000 7f6909c81700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f690406b1b0 0x7f6904136b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:44.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.055+0000 7f690a482700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f690406a6d0 0x7f690406aaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55724/0 (socket says 172.21.15.40:55724) 2023-09-30T22:28:44.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.055+0000 7f690a482700 1 -- 172.21.15.40:0/2657504005 learned_addr learned my addr 172.21.15.40:0/2657504005 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:44.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.055+0000 7f690ac83700 1 --2- 172.21.15.40:0/2657504005 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f69041370a0 0x7f6904139480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:44.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.055+0000 7f6909480700 1 -- 172.21.15.40:0/2657504005 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014602661 0 0) 0x7f690409eb60 con 0x7f690406a6d0 2023-09-30T22:28:44.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.055+0000 7f6909c81700 1 -- 172.21.15.40:0/2657504005 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f69041370a0 msgr2=0x7f6904139480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:44.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.055+0000 7f6909c81700 1 --2- 172.21.15.40:0/2657504005 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f69041370a0 0x7f6904139480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.055+0000 7f6909c81700 1 -- 172.21.15.40:0/2657504005 >> v1:172.21.15.40:6789/0 conn(0x7f690406a6d0 legacy=0x7f690406aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:44.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.055+0000 7f6909c81700 1 -- 172.21.15.40:0/2657504005 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f690409c9a0 con 0x7f690406b1b0 2023-09-30T22:28:44.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.055+0000 7f6909c81700 1 --2- 172.21.15.40:0/2657504005 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f690406b1b0 0x7f6904136b60 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f68f4009870 tx=0x7f68f4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d7462ca3233a4e8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:44.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.055+0000 7f6909480700 1 -- 172.21.15.40:0/2657504005 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f4011830 con 0x7f690406b1b0 2023-09-30T22:28:44.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.055+0000 7f6909480700 1 -- 172.21.15.40:0/2657504005 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f4011990 con 0x7f690406b1b0 2023-09-30T22:28:44.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.055+0000 7f6909480700 1 -- 172.21.15.40:0/2657504005 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f4011d20 con 0x7f690406b1b0 2023-09-30T22:28:44.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.056+0000 7f690c6e6700 1 -- 172.21.15.40:0/2657504005 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f690406b1b0 msgr2=0x7f6904136b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:44.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.056+0000 7f690c6e6700 1 --2- 172.21.15.40:0/2657504005 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f690406b1b0 0x7f6904136b60 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f68f4009870 tx=0x7f68f4009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:44.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.056+0000 7f690c6e6700 1 -- 172.21.15.40:0/2657504005 shutdown_connections 2023-09-30T22:28:44.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.056+0000 7f690c6e6700 1 --2- 172.21.15.40:0/2657504005 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f69041370a0 0x7f6904139480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.056+0000 7f690c6e6700 1 --2- 172.21.15.40:0/2657504005 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f690406b1b0 0x7f6904136b60 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.056+0000 7f690c6e6700 1 -- 172.21.15.40:0/2657504005 >> 172.21.15.40:0/2657504005 conn(0x7f690409fb20 msgr2=0x7f690409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:44.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.056+0000 7f690c6e6700 1 -- 172.21.15.40:0/2657504005 shutdown_connections 2023-09-30T22:28:44.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.056+0000 7f690c6e6700 1 -- 172.21.15.40:0/2657504005 wait complete. 2023-09-30T22:28:44.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.057+0000 7f690c6e6700 1 Processor -- start 2023-09-30T22:28:44.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.057+0000 7f690c6e6700 1 -- start start 2023-09-30T22:28:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.057+0000 7f690c6e6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f690406a6d0 0x7f690411ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.057+0000 7f690c6e6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f690406b1b0 0x7f690411f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.057+0000 7f690c6e6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69041370a0 0x7f690411f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.057+0000 7f690c6e6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6904122810 con 0x7f69041370a0 2023-09-30T22:28:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.057+0000 7f690c6e6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6904139360 con 0x7f690406b1b0 2023-09-30T22:28:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.057+0000 7f690c6e6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69040715d0 con 0x7f690406a6d0 2023-09-30T22:28:44.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.057+0000 7f6909c81700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f690406b1b0 0x7f690411f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:44.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.057+0000 7f690ac83700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69041370a0 0x7f690411f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:44.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.057+0000 7f6909c81700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f690406b1b0 0x7f690411f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:43118/0 (socket says 172.21.15.40:43118) 2023-09-30T22:28:44.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.057+0000 7f690ac83700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69041370a0 0x7f690411f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35506/0 (socket says 172.21.15.40:35506) 2023-09-30T22:28:44.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.057+0000 7f6909c81700 1 -- 172.21.15.40:0/3004295833 learned_addr learned my addr 172.21.15.40:0/3004295833 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:44.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.057+0000 7f690a482700 1 --2- 172.21.15.40:0/3004295833 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f690406a6d0 0x7f690411ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:44.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.058+0000 7f6909c81700 1 -- 172.21.15.40:0/3004295833 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f690406a6d0 msgr2=0x7f690411ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:44.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.058+0000 7f6909c81700 1 --2- 172.21.15.40:0/3004295833 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f690406a6d0 0x7f690411ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.058+0000 7f6909c81700 1 -- 172.21.15.40:0/3004295833 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69041370a0 msgr2=0x7f690411f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:44.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.058+0000 7f6909c81700 1 --2- 172.21.15.40:0/3004295833 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69041370a0 0x7f690411f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.058+0000 7f6909c81700 1 -- 172.21.15.40:0/3004295833 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f40094a0 con 0x7f690406b1b0 2023-09-30T22:28:44.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.058+0000 7f690ac83700 1 --2- 172.21.15.40:0/3004295833 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69041370a0 0x7f690411f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:44.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.058+0000 7f6909c81700 1 --2- 172.21.15.40:0/3004295833 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f690406b1b0 0x7f690411f2c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f68f4009840 tx=0x7f68f4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:44.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.058+0000 7f68faffd700 1 -- 172.21.15.40:0/3004295833 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f4004450 con 0x7f690406b1b0 2023-09-30T22:28:44.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.058+0000 7f68faffd700 1 -- 172.21.15.40:0/3004295833 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f4023070 con 0x7f690406b1b0 2023-09-30T22:28:44.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.058+0000 7f690c6e6700 1 -- 172.21.15.40:0/3004295833 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f690409e420 con 0x7f690406b1b0 2023-09-30T22:28:44.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.058+0000 7f68faffd700 1 -- 172.21.15.40:0/3004295833 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f401fa80 con 0x7f690406b1b0 2023-09-30T22:28:44.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.058+0000 7f690c6e6700 1 -- 172.21.15.40:0/3004295833 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6904121fa0 con 0x7f690406b1b0 2023-09-30T22:28:44.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.059+0000 7f68faffd700 1 -- 172.21.15.40:0/3004295833 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f68f401fbe0 con 0x7f690406b1b0 2023-09-30T22:28:44.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.059+0000 7f68faffd700 1 -- 172.21.15.40:0/3004295833 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f68f4025070 con 0x7f690406b1b0 2023-09-30T22:28:44.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.059+0000 7f690c6e6700 1 -- 172.21.15.40:0/3004295833 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6904123060 con 0x7f690406b1b0 2023-09-30T22:28:44.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.064+0000 7f68faffd700 1 -- 172.21.15.40:0/3004295833 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f68f4015080 con 0x7f690406b1b0 2023-09-30T22:28:44.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.258+0000 7f690c6e6700 1 -- 172.21.15.40:0/3004295833 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6904062380 con 0x7f690406b1b0 2023-09-30T22:28:44.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.259+0000 7f68faffd700 1 -- 172.21.15.40:0/3004295833 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f68f402f020 con 0x7f690406b1b0 2023-09-30T22:28:44.259 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:44.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.261+0000 7f690c6e6700 1 -- 172.21.15.40:0/3004295833 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f690406b1b0 msgr2=0x7f690411f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:44.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.261+0000 7f690c6e6700 1 --2- 172.21.15.40:0/3004295833 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f690406b1b0 0x7f690411f2c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f68f4009840 tx=0x7f68f4004750 comp rx=0 tx=0).stop 2023-09-30T22:28:44.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.261+0000 7f690c6e6700 1 -- 172.21.15.40:0/3004295833 shutdown_connections 2023-09-30T22:28:44.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.261+0000 7f690c6e6700 1 --2- 172.21.15.40:0/3004295833 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f690406a6d0 0x7f690411ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.261+0000 7f690c6e6700 1 --2- 172.21.15.40:0/3004295833 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69041370a0 0x7f690411f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.261+0000 7f690c6e6700 1 --2- 172.21.15.40:0/3004295833 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f690406b1b0 0x7f690411f2c0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.261+0000 7f690c6e6700 1 -- 172.21.15.40:0/3004295833 >> 172.21.15.40:0/3004295833 conn(0x7f690409fb20 msgr2=0x7f69040a2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:44.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.261+0000 7f690c6e6700 1 -- 172.21.15.40:0/3004295833 shutdown_connections 2023-09-30T22:28:44.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.261+0000 7f690c6e6700 1 -- 172.21.15.40:0/3004295833 wait complete. 2023-09-30T22:28:44.273 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:44.786 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:44.859 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:44.888 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:44.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.920+0000 7f4dbc69b700 1 Processor -- start 2023-09-30T22:28:44.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.920+0000 7f4dbc69b700 1 -- start start 2023-09-30T22:28:44.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.920+0000 7f4dbc69b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4db409e400 0x7f4db4135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:44.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.920+0000 7f4dbc69b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4db4136230 0x7f4db4138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:44.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.920+0000 7f4dbc69b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db409adf0 con 0x7f4db409d920 2023-09-30T22:28:44.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.920+0000 7f4dbc69b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db409e7f0 con 0x7f4db409e400 2023-09-30T22:28:44.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.920+0000 7f4dbc69b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4db409edf0 con 0x7f4db4136230 2023-09-30T22:28:44.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.921+0000 7f4db9c36700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4db409e400 0x7f4db4135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:44.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.921+0000 7f4db9c36700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4db409e400 0x7f4db4135cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:43128/0 (socket says 172.21.15.40:43128) 2023-09-30T22:28:44.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.921+0000 7f4db9c36700 1 -- 172.21.15.40:0/1463635873 learned_addr learned my addr 172.21.15.40:0/1463635873 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:44.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.921+0000 7f4dbac38700 1 --2- 172.21.15.40:0/1463635873 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4db4136230 0x7f4db4138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:44.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.921+0000 7f4db9c36700 1 -- 172.21.15.40:0/1463635873 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4db4136230 msgr2=0x7f4db4138610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:44.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.921+0000 7f4db9c36700 1 --2- 172.21.15.40:0/1463635873 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4db4136230 0x7f4db4138610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.921+0000 7f4db9c36700 1 -- 172.21.15.40:0/1463635873 >> v1:172.21.15.40:6789/0 conn(0x7f4db409d920 legacy=0x7f4db409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:44.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.921+0000 7f4db9435700 1 -- 172.21.15.40:0/1463635873 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1276713022 0 0) 0x7f4db409adf0 con 0x7f4db409d920 2023-09-30T22:28:44.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.921+0000 7f4db9c36700 1 -- 172.21.15.40:0/1463635873 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db409b660 con 0x7f4db409e400 2023-09-30T22:28:44.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.921+0000 7f4db9c36700 1 --2- 172.21.15.40:0/1463635873 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4db409e400 0x7f4db4135cf0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4da4009950 tx=0x7f4da4009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=118a46d5d4384f81 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:44.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.921+0000 7f4db9435700 1 -- 172.21.15.40:0/1463635873 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da4011830 con 0x7f4db409e400 2023-09-30T22:28:44.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.921+0000 7f4db9435700 1 -- 172.21.15.40:0/1463635873 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da4011990 con 0x7f4db409e400 2023-09-30T22:28:44.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.921+0000 7f4db9435700 1 -- 172.21.15.40:0/1463635873 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da4011d40 con 0x7f4db409e400 2023-09-30T22:28:44.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.922+0000 7f4dbc69b700 1 -- 172.21.15.40:0/1463635873 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4db409e400 msgr2=0x7f4db4135cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:44.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.922+0000 7f4dbc69b700 1 --2- 172.21.15.40:0/1463635873 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4db409e400 0x7f4db4135cf0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4da4009950 tx=0x7f4da4009c60 comp rx=0 tx=0).stop 2023-09-30T22:28:44.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.922+0000 7f4dbc69b700 1 -- 172.21.15.40:0/1463635873 shutdown_connections 2023-09-30T22:28:44.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.922+0000 7f4dbc69b700 1 --2- 172.21.15.40:0/1463635873 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4db4136230 0x7f4db4138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.922+0000 7f4dbc69b700 1 --2- 172.21.15.40:0/1463635873 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4db409e400 0x7f4db4135cf0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.922+0000 7f4dbc69b700 1 -- 172.21.15.40:0/1463635873 >> 172.21.15.40:0/1463635873 conn(0x7f4db409fb20 msgr2=0x7f4db409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:44.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.922+0000 7f4dbc69b700 1 -- 172.21.15.40:0/1463635873 shutdown_connections 2023-09-30T22:28:44.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.922+0000 7f4dbc69b700 1 -- 172.21.15.40:0/1463635873 wait complete. 2023-09-30T22:28:44.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.923+0000 7f4dbc69b700 1 Processor -- start 2023-09-30T22:28:44.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.923+0000 7f4dbc69b700 1 -- start start 2023-09-30T22:28:44.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.924+0000 7f4dbc69b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4db409d920 0x7f4db4134330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:44.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.924+0000 7f4dbc69b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4db409e400 0x7f4db4134870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:44.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.924+0000 7f4dbc69b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4db4136230 0x7f4db4134db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:44.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.924+0000 7f4dbc69b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db4071290 con 0x7f4db409e400 2023-09-30T22:28:44.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.924+0000 7f4dbc69b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db4139da0 con 0x7f4db4136230 2023-09-30T22:28:44.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.924+0000 7f4dbc69b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4db40a3c60 con 0x7f4db409d920 2023-09-30T22:28:44.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.924+0000 7f4dbac38700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4db4136230 0x7f4db4134db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:44.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.924+0000 7f4dba437700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4db409d920 0x7f4db4134330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:44.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.924+0000 7f4dbac38700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4db4136230 0x7f4db4134db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:43130/0 (socket says 172.21.15.40:43130) 2023-09-30T22:28:44.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.924+0000 7f4dbac38700 1 -- 172.21.15.40:0/1800279597 learned_addr learned my addr 172.21.15.40:0/1800279597 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:44.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.924+0000 7f4db9c36700 1 --2- 172.21.15.40:0/1800279597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4db409e400 0x7f4db4134870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:44.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.924+0000 7f4dbac38700 1 -- 172.21.15.40:0/1800279597 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4db409d920 msgr2=0x7f4db4134330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:44.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.924+0000 7f4dbac38700 1 --2- 172.21.15.40:0/1800279597 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4db409d920 0x7f4db4134330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.924+0000 7f4dbac38700 1 -- 172.21.15.40:0/1800279597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4db409e400 msgr2=0x7f4db4134870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:44.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.924+0000 7f4dbac38700 1 --2- 172.21.15.40:0/1800279597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4db409e400 0x7f4db4134870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.924+0000 7f4dbac38700 1 -- 172.21.15.40:0/1800279597 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da4009550 con 0x7f4db4136230 2023-09-30T22:28:44.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.924+0000 7f4dba437700 1 --2- 172.21.15.40:0/1800279597 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4db409d920 0x7f4db4134330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:44.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.924+0000 7f4dbac38700 1 --2- 172.21.15.40:0/1800279597 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4db4136230 0x7f4db4134db0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4dac00efc0 tx=0x7f4dac00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:44.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.925+0000 7f4daaffd700 1 -- 172.21.15.40:0/1800279597 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac00cc90 con 0x7f4db4136230 2023-09-30T22:28:44.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.925+0000 7f4daaffd700 1 -- 172.21.15.40:0/1800279597 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dac00f040 con 0x7f4db4136230 2023-09-30T22:28:44.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.925+0000 7f4daaffd700 1 -- 172.21.15.40:0/1800279597 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac0146c0 con 0x7f4db4136230 2023-09-30T22:28:44.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.925+0000 7f4dbc69b700 1 -- 172.21.15.40:0/1800279597 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db413a0f0 con 0x7f4db4136230 2023-09-30T22:28:44.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.925+0000 7f4dbc69b700 1 -- 172.21.15.40:0/1800279597 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db413abc0 con 0x7f4db4136230 2023-09-30T22:28:44.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.926+0000 7f4dbc69b700 1 -- 172.21.15.40:0/1800279597 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4db4071820 con 0x7f4db4136230 2023-09-30T22:28:44.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.926+0000 7f4daaffd700 1 -- 172.21.15.40:0/1800279597 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4dac014820 con 0x7f4db4136230 2023-09-30T22:28:44.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.926+0000 7f4daaffd700 1 -- 172.21.15.40:0/1800279597 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4dac040410 con 0x7f4db4136230 2023-09-30T22:28:44.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.935+0000 7f4daaffd700 1 -- 172.21.15.40:0/1800279597 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4dac012520 con 0x7f4db4136230 2023-09-30T22:28:44.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.994+0000 7ff4ff4bb700 1 Processor -- start 2023-09-30T22:28:44.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.994+0000 7ff4ff4bb700 1 -- start start 2023-09-30T22:28:44.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.995+0000 7ff4ff4bb700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff4f8136bf0 0x7ff4f8138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:44.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.995+0000 7ff4ff4bb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4f8139510 0x7ff4f813b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:44.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.995+0000 7ff4ff4bb700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f80a2600 con 0x7ff4f809c890 2023-09-30T22:28:44.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.995+0000 7ff4ff4bb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f80a29d0 con 0x7ff4f8139510 2023-09-30T22:28:44.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.995+0000 7ff4ff4bb700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f809fb40 con 0x7ff4f8136bf0 2023-09-30T22:28:44.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.995+0000 7ff4fca56700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff4f8136bf0 0x7ff4f8138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:44.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.995+0000 7ff4fd257700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff4f809c890 0x7ff4f809cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55748/0 (socket says 172.21.15.40:55748) 2023-09-30T22:28:44.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.995+0000 7ff4fd257700 1 -- 172.21.15.40:0/3849229833 learned_addr learned my addr 172.21.15.40:0/3849229833 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:44.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.995+0000 7ff4fda58700 1 --2- 172.21.15.40:0/3849229833 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4f8139510 0x7ff4f813b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:44.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.995+0000 7ff4effff700 1 -- 172.21.15.40:0/3849229833 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4043547160 0 0) 0x7ff4f80a2600 con 0x7ff4f809c890 2023-09-30T22:28:44.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.995+0000 7ff4fca56700 1 -- 172.21.15.40:0/3849229833 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4f8139510 msgr2=0x7ff4f813b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:44.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.995+0000 7ff4fca56700 1 --2- 172.21.15.40:0/3849229833 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4f8139510 0x7ff4f813b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.995+0000 7ff4fca56700 1 -- 172.21.15.40:0/3849229833 >> v1:172.21.15.40:6789/0 conn(0x7ff4f809c890 legacy=0x7ff4f809cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:44.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.996+0000 7ff4fca56700 1 -- 172.21.15.40:0/3849229833 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f809d370 con 0x7ff4f8136bf0 2023-09-30T22:28:44.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.996+0000 7ff4fda58700 1 --2- 172.21.15.40:0/3849229833 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4f8139510 0x7ff4f813b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:44.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.996+0000 7ff4fca56700 1 --2- 172.21.15.40:0/3849229833 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff4f8136bf0 0x7ff4f8138fd0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009870 tx=0x7ff4e8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d07fc8c2a8aef614 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:44.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.996+0000 7ff4effff700 1 -- 172.21.15.40:0/3849229833 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8011830 con 0x7ff4f8136bf0 2023-09-30T22:28:44.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.996+0000 7ff4effff700 1 -- 172.21.15.40:0/3849229833 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e8011990 con 0x7ff4f8136bf0 2023-09-30T22:28:44.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.996+0000 7ff4effff700 1 -- 172.21.15.40:0/3849229833 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8011d20 con 0x7ff4f8136bf0 2023-09-30T22:28:45.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.997+0000 7ff4ff4bb700 1 -- 172.21.15.40:0/3849229833 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff4f8136bf0 msgr2=0x7ff4f8138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:45.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.997+0000 7ff4ff4bb700 1 --2- 172.21.15.40:0/3849229833 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff4f8136bf0 0x7ff4f8138fd0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009870 tx=0x7ff4e8009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:45.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.997+0000 7ff4ff4bb700 1 -- 172.21.15.40:0/3849229833 shutdown_connections 2023-09-30T22:28:45.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.997+0000 7ff4ff4bb700 1 --2- 172.21.15.40:0/3849229833 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4f8139510 0x7ff4f813b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.997+0000 7ff4ff4bb700 1 --2- 172.21.15.40:0/3849229833 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff4f8136bf0 0x7ff4f8138fd0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.997+0000 7ff4ff4bb700 1 -- 172.21.15.40:0/3849229833 >> 172.21.15.40:0/3849229833 conn(0x7ff4f80a7080 msgr2=0x7ff4f80a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:45.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.997+0000 7ff4ff4bb700 1 -- 172.21.15.40:0/3849229833 shutdown_connections 2023-09-30T22:28:45.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.997+0000 7ff4ff4bb700 1 -- 172.21.15.40:0/3849229833 wait complete. 2023-09-30T22:28:45.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.998+0000 7ff4ff4bb700 1 Processor -- start 2023-09-30T22:28:45.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.998+0000 7ff4ff4bb700 1 -- start start 2023-09-30T22:28:45.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.998+0000 7ff4ff4bb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4f809c890 0x7ff4f806ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:45.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.998+0000 7ff4ff4bb700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff4f8136bf0 0x7ff4f806f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:45.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.998+0000 7ff4ff4bb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4f8139510 0x7ff4f806f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:45.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.998+0000 7ff4ff4bb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f8070bf0 con 0x7ff4f809c890 2023-09-30T22:28:45.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.998+0000 7ff4ff4bb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f812b550 con 0x7ff4f8139510 2023-09-30T22:28:45.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.998+0000 7ff4ff4bb700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f8138fe0 con 0x7ff4f8136bf0 2023-09-30T22:28:45.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.999+0000 7ff4fca56700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff4f8136bf0 0x7ff4f806f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:45.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.999+0000 7ff4fd257700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4f809c890 0x7ff4f806ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:45.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.999+0000 7ff4fca56700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff4f8136bf0 0x7ff4f806f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:44182/0 (socket says 172.21.15.40:44182) 2023-09-30T22:28:45.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.999+0000 7ff4fca56700 1 -- 172.21.15.40:0/3983668927 learned_addr learned my addr 172.21.15.40:0/3983668927 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:45.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.999+0000 7ff4fda58700 1 --2- 172.21.15.40:0/3983668927 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4f8139510 0x7ff4f806f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:45.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.999+0000 7ff4fca56700 1 -- 172.21.15.40:0/3983668927 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4f8139510 msgr2=0x7ff4f806f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:45.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.999+0000 7ff4fca56700 1 --2- 172.21.15.40:0/3983668927 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4f8139510 0x7ff4f806f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.999+0000 7ff4fca56700 1 -- 172.21.15.40:0/3983668927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4f809c890 msgr2=0x7ff4f806ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:45.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.999+0000 7ff4fca56700 1 --2- 172.21.15.40:0/3983668927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4f809c890 0x7ff4f806ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.999+0000 7ff4fca56700 1 -- 172.21.15.40:0/3983668927 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f0009a70 con 0x7ff4f8136bf0 2023-09-30T22:28:45.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.999+0000 7ff4fd257700 1 --2- 172.21.15.40:0/3983668927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4f809c890 0x7ff4f806ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:45.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.999+0000 7ff4fca56700 1 --2- 172.21.15.40:0/3983668927 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff4f8136bf0 0x7ff4f806f440 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009840 tx=0x7ff4e8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:45.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.999+0000 7ff4edffb700 1 -- 172.21.15.40:0/3983668927 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e80045d0 con 0x7ff4f8136bf0 2023-09-30T22:28:45.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.999+0000 7ff4edffb700 1 -- 172.21.15.40:0/3983668927 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e801f070 con 0x7ff4f8136bf0 2023-09-30T22:28:45.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.999+0000 7ff4ff4bb700 1 -- 172.21.15.40:0/3983668927 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4e80094a0 con 0x7ff4f8136bf0 2023-09-30T22:28:45.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:44.999+0000 7ff4edffb700 1 -- 172.21.15.40:0/3983668927 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e80038c0 con 0x7ff4f8136bf0 2023-09-30T22:28:45.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.000+0000 7ff4ff4bb700 1 -- 172.21.15.40:0/3983668927 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f812bd50 con 0x7ff4f8136bf0 2023-09-30T22:28:45.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.000+0000 7ff4edffb700 1 -- 172.21.15.40:0/3983668927 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff4e8003a20 con 0x7ff4f8136bf0 2023-09-30T22:28:45.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.001+0000 7ff4edffb700 1 -- 172.21.15.40:0/3983668927 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff4e8021070 con 0x7ff4f8136bf0 2023-09-30T22:28:45.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.001+0000 7ff4ff4bb700 1 -- 172.21.15.40:0/3983668927 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f80712c0 con 0x7ff4f8136bf0 2023-09-30T22:28:45.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.006+0000 7ff4edffb700 1 -- 172.21.15.40:0/3983668927 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff4e8024380 con 0x7ff4f8136bf0 2023-09-30T22:28:45.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.043+0000 7f5220549700 1 Processor -- start 2023-09-30T22:28:45.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.043+0000 7f5220549700 1 -- start start 2023-09-30T22:28:45.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.044+0000 7f5220549700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f521809d920 0x7f521809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:45.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.044+0000 7f5220549700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f521809f0f0 0x7f521809e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:45.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.044+0000 7f5220549700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5218133ca0 0x7f5218134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:45.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.044+0000 7f5220549700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f521806b4c0 con 0x7f5218133ca0 2023-09-30T22:28:45.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.044+0000 7f5220549700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f521809a8f0 con 0x7f521809f0f0 2023-09-30T22:28:45.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.044+0000 7f5220549700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f521809f940 con 0x7f521809d920 2023-09-30T22:28:45.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.044+0000 7f521e2e5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f521809d920 0x7f521809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:45.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.044+0000 7f521e2e5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f521809d920 0x7f521809dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:44194/0 (socket says 172.21.15.40:44194) 2023-09-30T22:28:45.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.044+0000 7f521e2e5700 1 -- 172.21.15.40:0/2096936645 learned_addr learned my addr 172.21.15.40:0/2096936645 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:45.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.044+0000 7f521dae4700 1 --2- 172.21.15.40:0/2096936645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f521809f0f0 0x7f521809e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:45.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.044+0000 7f521eae6700 1 --2- 172.21.15.40:0/2096936645 >> v2:172.21.15.40:3300/0 conn(0x7f5218133ca0 0x7f5218134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:45.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.045+0000 7f521e2e5700 1 -- 172.21.15.40:0/2096936645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f521809f0f0 msgr2=0x7f521809e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:45.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.045+0000 7f521e2e5700 1 --2- 172.21.15.40:0/2096936645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f521809f0f0 0x7f521809e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.045+0000 7f521e2e5700 1 -- 172.21.15.40:0/2096936645 >> v2:172.21.15.40:3300/0 conn(0x7f5218133ca0 msgr2=0x7f5218134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:45.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.045+0000 7f521e2e5700 1 --2- 172.21.15.40:0/2096936645 >> v2:172.21.15.40:3300/0 conn(0x7f5218133ca0 0x7f5218134140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.045+0000 7f521e2e5700 1 -- 172.21.15.40:0/2096936645 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521809f6e0 con 0x7f521809d920 2023-09-30T22:28:45.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.045+0000 7f521e2e5700 1 --2- 172.21.15.40:0/2096936645 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f521809d920 0x7f521809dcf0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f52140098f0 tx=0x7f5214009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a067bc237344fcd7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:45.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.045+0000 7f521d2e3700 1 -- 172.21.15.40:0/2096936645 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5214005e30 con 0x7f521809d920 2023-09-30T22:28:45.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.045+0000 7f521d2e3700 1 -- 172.21.15.40:0/2096936645 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5214004030 con 0x7f521809d920 2023-09-30T22:28:45.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.045+0000 7f521d2e3700 1 -- 172.21.15.40:0/2096936645 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52140043e0 con 0x7f521809d920 2023-09-30T22:28:45.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.046+0000 7f5220549700 1 -- 172.21.15.40:0/2096936645 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f521809d920 msgr2=0x7f521809dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:45.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.046+0000 7f5220549700 1 --2- 172.21.15.40:0/2096936645 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f521809d920 0x7f521809dcf0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f52140098f0 tx=0x7f5214009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:45.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.046+0000 7f5220549700 1 -- 172.21.15.40:0/2096936645 shutdown_connections 2023-09-30T22:28:45.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.046+0000 7f5220549700 1 --2- 172.21.15.40:0/2096936645 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f521809d920 0x7f521809dcf0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.046+0000 7f5220549700 1 --2- 172.21.15.40:0/2096936645 >> v2:172.21.15.40:3300/0 conn(0x7f5218133ca0 0x7f5218134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.046+0000 7f5220549700 1 --2- 172.21.15.40:0/2096936645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f521809f0f0 0x7f521809e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.046+0000 7f5220549700 1 -- 172.21.15.40:0/2096936645 >> 172.21.15.40:0/2096936645 conn(0x7f521809fb20 msgr2=0x7f521809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:45.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.046+0000 7f5220549700 1 -- 172.21.15.40:0/2096936645 shutdown_connections 2023-09-30T22:28:45.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.046+0000 7f5220549700 1 -- 172.21.15.40:0/2096936645 wait complete. 2023-09-30T22:28:45.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.047+0000 7f5220549700 1 Processor -- start 2023-09-30T22:28:45.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.047+0000 7f5220549700 1 -- start start 2023-09-30T22:28:45.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.048+0000 7f5220549700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f521809d920 0x7f5218121880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:45.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.048+0000 7f5220549700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5218133ca0 0x7f5218121dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:45.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.048+0000 7f5220549700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5218122300 0x7f52181ce830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:45.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.048+0000 7f5220549700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5218125100 con 0x7f5218122300 2023-09-30T22:28:45.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.048+0000 7f5220549700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5218125350 con 0x7f521809d920 2023-09-30T22:28:45.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.048+0000 7f5220549700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5218132bd0 con 0x7f5218133ca0 2023-09-30T22:28:45.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.048+0000 7f521e2e5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f521809d920 0x7f5218121880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:45.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.048+0000 7f521dae4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5218133ca0 0x7f5218121dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:45.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.048+0000 7f521e2e5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f521809d920 0x7f5218121880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:43174/0 (socket says 172.21.15.40:43174) 2023-09-30T22:28:45.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.048+0000 7f521e2e5700 1 -- 172.21.15.40:0/3675941807 learned_addr learned my addr 172.21.15.40:0/3675941807 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:45.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.048+0000 7f521eae6700 1 --2- 172.21.15.40:0/3675941807 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5218122300 0x7f52181ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:45.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.049+0000 7f521dae4700 1 -- 172.21.15.40:0/3675941807 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f521809d920 msgr2=0x7f5218121880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:45.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.049+0000 7f521dae4700 1 --2- 172.21.15.40:0/3675941807 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f521809d920 0x7f5218121880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.049+0000 7f521dae4700 1 -- 172.21.15.40:0/3675941807 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5218122300 msgr2=0x7f52181ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:45.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.049+0000 7f521dae4700 1 --2- 172.21.15.40:0/3675941807 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5218122300 0x7f52181ce830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.049+0000 7f521dae4700 1 -- 172.21.15.40:0/3675941807 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5214009500 con 0x7f5218133ca0 2023-09-30T22:28:45.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.049+0000 7f521dae4700 1 --2- 172.21.15.40:0/3675941807 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5218133ca0 0x7f5218121dc0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f520800e840 tx=0x7f520800eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:45.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.049+0000 7f520effd700 1 -- 172.21.15.40:0/3675941807 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5208013680 con 0x7f5218133ca0 2023-09-30T22:28:45.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.049+0000 7f520effd700 1 -- 172.21.15.40:0/3675941807 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52080137e0 con 0x7f5218133ca0 2023-09-30T22:28:45.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.049+0000 7f5220549700 1 -- 172.21.15.40:0/3675941807 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5218123440 con 0x7f5218133ca0 2023-09-30T22:28:45.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.049+0000 7f520effd700 1 -- 172.21.15.40:0/3675941807 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5208013b70 con 0x7f5218133ca0 2023-09-30T22:28:45.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.049+0000 7f5220549700 1 -- 172.21.15.40:0/3675941807 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5218124db0 con 0x7f5218133ca0 2023-09-30T22:28:45.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.050+0000 7f520effd700 1 -- 172.21.15.40:0/3675941807 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5208013cd0 con 0x7f5218133ca0 2023-09-30T22:28:45.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.050+0000 7f520effd700 1 -- 172.21.15.40:0/3675941807 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f520803f920 con 0x7f5218133ca0 2023-09-30T22:28:45.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.050+0000 7f5220549700 1 -- 172.21.15.40:0/3675941807 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5218062380 con 0x7f5218133ca0 2023-09-30T22:28:45.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.055+0000 7f520effd700 1 -- 172.21.15.40:0/3675941807 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f52080117c0 con 0x7f5218133ca0 2023-09-30T22:28:45.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.136+0000 7f4dbc69b700 1 -- 172.21.15.40:0/1800279597 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4db409a660 con 0x7f4db4136230 2023-09-30T22:28:45.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.136+0000 7f4daaffd700 1 -- 172.21.15.40:0/1800279597 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4dac012340 con 0x7f4db4136230 2023-09-30T22:28:45.137 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:45.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.138+0000 7f4dbc69b700 1 -- 172.21.15.40:0/1800279597 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4db4136230 msgr2=0x7f4db4134db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:45.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.138+0000 7f4dbc69b700 1 --2- 172.21.15.40:0/1800279597 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4db4136230 0x7f4db4134db0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4dac00efc0 tx=0x7f4dac00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.139+0000 7f4dbc69b700 1 -- 172.21.15.40:0/1800279597 shutdown_connections 2023-09-30T22:28:45.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.139+0000 7f4dbc69b700 1 --2- 172.21.15.40:0/1800279597 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4db409d920 0x7f4db4134330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.139+0000 7f4dbc69b700 1 --2- 172.21.15.40:0/1800279597 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4db4136230 0x7f4db4134db0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.139+0000 7f4dbc69b700 1 --2- 172.21.15.40:0/1800279597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4db409e400 0x7f4db4134870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.139+0000 7f4dbc69b700 1 -- 172.21.15.40:0/1800279597 >> 172.21.15.40:0/1800279597 conn(0x7f4db409fb20 msgr2=0x7f4db412eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:45.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.139+0000 7f4dbc69b700 1 -- 172.21.15.40:0/1800279597 shutdown_connections 2023-09-30T22:28:45.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.139+0000 7f4dbc69b700 1 -- 172.21.15.40:0/1800279597 wait complete. 2023-09-30T22:28:45.152 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:45.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.242+0000 7ff4ff4bb700 1 -- 172.21.15.40:0/3983668927 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff4f8062380 con 0x7ff4f8136bf0 2023-09-30T22:28:45.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.242+0000 7ff4edffb700 1 -- 172.21.15.40:0/3983668927 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff4e8019ba0 con 0x7ff4f8136bf0 2023-09-30T22:28:45.243 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:45.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.244+0000 7ff4ff4bb700 1 -- 172.21.15.40:0/3983668927 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff4f8136bf0 msgr2=0x7ff4f806f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:45.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.244+0000 7ff4ff4bb700 1 --2- 172.21.15.40:0/3983668927 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff4f8136bf0 0x7ff4f806f440 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009840 tx=0x7ff4e8004750 comp rx=0 tx=0).stop 2023-09-30T22:28:45.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.244+0000 7ff4ff4bb700 1 -- 172.21.15.40:0/3983668927 shutdown_connections 2023-09-30T22:28:45.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.244+0000 7ff4ff4bb700 1 --2- 172.21.15.40:0/3983668927 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4f8139510 0x7ff4f806f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.244+0000 7ff4ff4bb700 1 --2- 172.21.15.40:0/3983668927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4f809c890 0x7ff4f806ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.244+0000 7ff4ff4bb700 1 --2- 172.21.15.40:0/3983668927 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff4f8136bf0 0x7ff4f806f440 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.244+0000 7ff4ff4bb700 1 -- 172.21.15.40:0/3983668927 >> 172.21.15.40:0/3983668927 conn(0x7ff4f80a7080 msgr2=0x7ff4f8136fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:45.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.245+0000 7ff4ff4bb700 1 -- 172.21.15.40:0/3983668927 shutdown_connections 2023-09-30T22:28:45.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.245+0000 7ff4ff4bb700 1 -- 172.21.15.40:0/3983668927 wait complete. 2023-09-30T22:28:45.257 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:45.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.273+0000 7f5220549700 1 -- 172.21.15.40:0/3675941807 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5218074720 con 0x7f5218133ca0 2023-09-30T22:28:45.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.273+0000 7f520effd700 1 -- 172.21.15.40:0/3675941807 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5208017020 con 0x7f5218133ca0 2023-09-30T22:28:45.274 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:45.274 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:45.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.275+0000 7f5220549700 1 -- 172.21.15.40:0/3675941807 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5218133ca0 msgr2=0x7f5218121dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:45.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.275+0000 7f5220549700 1 --2- 172.21.15.40:0/3675941807 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5218133ca0 0x7f5218121dc0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f520800e840 tx=0x7f520800eb50 comp rx=0 tx=0).stop 2023-09-30T22:28:45.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.275+0000 7f5220549700 1 -- 172.21.15.40:0/3675941807 shutdown_connections 2023-09-30T22:28:45.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.275+0000 7f5220549700 1 --2- 172.21.15.40:0/3675941807 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5218122300 0x7f52181ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.275+0000 7f5220549700 1 --2- 172.21.15.40:0/3675941807 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f521809d920 0x7f5218121880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.275+0000 7f5220549700 1 --2- 172.21.15.40:0/3675941807 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5218133ca0 0x7f5218121dc0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.275+0000 7f5220549700 1 -- 172.21.15.40:0/3675941807 >> 172.21.15.40:0/3675941807 conn(0x7f521809fb20 msgr2=0x7f52180a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:45.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.275+0000 7f5220549700 1 -- 172.21.15.40:0/3675941807 shutdown_connections 2023-09-30T22:28:45.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.275+0000 7f5220549700 1 -- 172.21.15.40:0/3675941807 wait complete. 2023-09-30T22:28:45.288 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:45.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.400+0000 7f03d1716700 1 Processor -- start 2023-09-30T22:28:45.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.400+0000 7f03d1716700 1 -- start start 2023-09-30T22:28:45.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.400+0000 7f03d1716700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f03cc09c890 0x7f03cc09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:45.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.400+0000 7f03d1716700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f03cc09d920 0x7f03cc09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:45.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.400+0000 7f03d1716700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03cc0a2600 con 0x7f03cc09e2b0 2023-09-30T22:28:45.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.400+0000 7f03d1716700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03cc0a29d0 con 0x7f03cc09c890 2023-09-30T22:28:45.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.400+0000 7f03d1716700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc09fb40 con 0x7f03cc09d920 2023-09-30T22:28:45.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.401+0000 7f03ca7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f03cc09d920 0x7f03cc09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:45.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.401+0000 7f03caffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f03cc09c890 0x7f03cc09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:45.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.401+0000 7f03ca7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f03cc09d920 0x7f03cc09dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:44216/0 (socket says 172.21.15.40:44216) 2023-09-30T22:28:45.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.401+0000 7f03ca7fc700 1 -- 172.21.15.40:0/3550326209 learned_addr learned my addr 172.21.15.40:0/3550326209 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:45.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.401+0000 7f03ca7fc700 1 -- 172.21.15.40:0/3550326209 >> v2:172.21.15.40:3300/0 conn(0x7f03cc09c890 msgr2=0x7f03cc09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:45.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.401+0000 7f03ca7fc700 1 --2- 172.21.15.40:0/3550326209 >> v2:172.21.15.40:3300/0 conn(0x7f03cc09c890 0x7f03cc09cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.401+0000 7f03ca7fc700 1 -- 172.21.15.40:0/3550326209 >> v1:172.21.15.40:6789/0 conn(0x7f03cc09e2b0 legacy=0x7f03cc13ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:45.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.401+0000 7f03ca7fc700 1 -- 172.21.15.40:0/3550326209 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03cc09e730 con 0x7f03cc09d920 2023-09-30T22:28:45.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.401+0000 7f03caffd700 1 --2- 172.21.15.40:0/3550326209 >> v2:172.21.15.40:3300/0 conn(0x7f03cc09c890 0x7f03cc09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:45.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.401+0000 7f03ca7fc700 1 --2- 172.21.15.40:0/3550326209 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f03cc09d920 0x7f03cc09dd70 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f03bc0098f0 tx=0x7f03bc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef4543fd1bd3e5b3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:45.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.401+0000 7f03c9ffb700 1 -- 172.21.15.40:0/3550326209 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc011830 con 0x7f03cc09d920 2023-09-30T22:28:45.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.401+0000 7f03c9ffb700 1 -- 172.21.15.40:0/3550326209 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03bc011990 con 0x7f03cc09d920 2023-09-30T22:28:45.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.401+0000 7f03c9ffb700 1 -- 172.21.15.40:0/3550326209 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc011d20 con 0x7f03cc09d920 2023-09-30T22:28:45.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.402+0000 7f03d1716700 1 -- 172.21.15.40:0/3550326209 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f03cc09d920 msgr2=0x7f03cc09dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:45.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.402+0000 7f03d1716700 1 --2- 172.21.15.40:0/3550326209 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f03cc09d920 0x7f03cc09dd70 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f03bc0098f0 tx=0x7f03bc009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:45.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.402+0000 7f03d1716700 1 -- 172.21.15.40:0/3550326209 shutdown_connections 2023-09-30T22:28:45.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.402+0000 7f03d1716700 1 --2- 172.21.15.40:0/3550326209 >> v2:172.21.15.40:3300/0 conn(0x7f03cc09c890 0x7f03cc09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.402+0000 7f03d1716700 1 --2- 172.21.15.40:0/3550326209 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f03cc09d920 0x7f03cc09dd70 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.402+0000 7f03d1716700 1 -- 172.21.15.40:0/3550326209 >> 172.21.15.40:0/3550326209 conn(0x7f03cc0a7080 msgr2=0x7f03cc0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:45.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.402+0000 7f03d1716700 1 -- 172.21.15.40:0/3550326209 shutdown_connections 2023-09-30T22:28:45.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.402+0000 7f03d1716700 1 -- 172.21.15.40:0/3550326209 wait complete. 2023-09-30T22:28:45.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.403+0000 7f03d1716700 1 Processor -- start 2023-09-30T22:28:45.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.403+0000 7f03d1716700 1 -- start start 2023-09-30T22:28:45.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.404+0000 7f03d1716700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03cc09c890 0x7f03cc1c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:45.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.404+0000 7f03d1716700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f03cc09d920 0x7f03cc1c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:45.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.404+0000 7f03d1716700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03cc09e2b0 0x7f03cc12d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:45.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.404+0000 7f03d1716700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc08f3e0 con 0x7f03cc09c890 2023-09-30T22:28:45.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.404+0000 7f03d1716700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc130940 con 0x7f03cc09e2b0 2023-09-30T22:28:45.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.404+0000 7f03d1716700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc12fe60 con 0x7f03cc09d920 2023-09-30T22:28:45.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.404+0000 7f03caffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03cc09c890 0x7f03cc1c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:45.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.404+0000 7f03ca7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f03cc09d920 0x7f03cc1c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:45.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.404+0000 7f03caffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03cc09c890 0x7f03cc1c8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35576/0 (socket says 172.21.15.40:35576) 2023-09-30T22:28:45.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.404+0000 7f03caffd700 1 -- 172.21.15.40:0/3302196842 learned_addr learned my addr 172.21.15.40:0/3302196842 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:45.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.404+0000 7f03cb7fe700 1 --2- 172.21.15.40:0/3302196842 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03cc09e2b0 0x7f03cc12d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:45.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.404+0000 7f03ca7fc700 1 -- 172.21.15.40:0/3302196842 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03cc09e2b0 msgr2=0x7f03cc12d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:45.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.404+0000 7f03ca7fc700 1 --2- 172.21.15.40:0/3302196842 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03cc09e2b0 0x7f03cc12d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.404+0000 7f03ca7fc700 1 -- 172.21.15.40:0/3302196842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03cc09c890 msgr2=0x7f03cc1c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:45.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.404+0000 7f03ca7fc700 1 --2- 172.21.15.40:0/3302196842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03cc09c890 0x7f03cc1c8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.404+0000 7f03ca7fc700 1 -- 172.21.15.40:0/3302196842 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c0009430 con 0x7f03cc09d920 2023-09-30T22:28:45.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.404+0000 7f03caffd700 1 --2- 172.21.15.40:0/3302196842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03cc09c890 0x7f03cc1c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:45.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.405+0000 7f03ca7fc700 1 --2- 172.21.15.40:0/3302196842 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f03cc09d920 0x7f03cc1c9100 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f03bc016000 tx=0x7f03bc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:45.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.405+0000 7f03b37fe700 1 -- 172.21.15.40:0/3302196842 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc0036a0 con 0x7f03cc09d920 2023-09-30T22:28:45.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.405+0000 7f03b37fe700 1 -- 172.21.15.40:0/3302196842 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03bc003800 con 0x7f03cc09d920 2023-09-30T22:28:45.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.405+0000 7f03d1716700 1 -- 172.21.15.40:0/3302196842 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03bc009550 con 0x7f03cc09d920 2023-09-30T22:28:45.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.405+0000 7f03b37fe700 1 -- 172.21.15.40:0/3302196842 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc003b90 con 0x7f03cc09d920 2023-09-30T22:28:45.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.405+0000 7f03d1716700 1 -- 172.21.15.40:0/3302196842 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03cc130670 con 0x7f03cc09d920 2023-09-30T22:28:45.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.405+0000 7f03b37fe700 1 -- 172.21.15.40:0/3302196842 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f03bc021070 con 0x7f03cc09d920 2023-09-30T22:28:45.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.406+0000 7f03b37fe700 1 -- 172.21.15.40:0/3302196842 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f03bc040bf0 con 0x7f03cc09d920 2023-09-30T22:28:45.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.406+0000 7f03d1716700 1 -- 172.21.15.40:0/3302196842 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03cc0a5e20 con 0x7f03cc09d920 2023-09-30T22:28:45.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.411+0000 7f03b37fe700 1 -- 172.21.15.40:0/3302196842 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f03bc015080 con 0x7f03cc09d920 2023-09-30T22:28:45.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.606+0000 7f03d1716700 1 -- 172.21.15.40:0/3302196842 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f03cc09ecf0 con 0x7f03cc09d920 2023-09-30T22:28:45.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.606+0000 7f03b37fe700 1 -- 172.21.15.40:0/3302196842 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f03bc029030 con 0x7f03cc09d920 2023-09-30T22:28:45.607 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:45.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.608+0000 7f03d1716700 1 -- 172.21.15.40:0/3302196842 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f03cc09d920 msgr2=0x7f03cc1c9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:45.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.608+0000 7f03d1716700 1 --2- 172.21.15.40:0/3302196842 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f03cc09d920 0x7f03cc1c9100 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f03bc016000 tx=0x7f03bc004750 comp rx=0 tx=0).stop 2023-09-30T22:28:45.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.608+0000 7f03d1716700 1 -- 172.21.15.40:0/3302196842 shutdown_connections 2023-09-30T22:28:45.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.608+0000 7f03d1716700 1 --2- 172.21.15.40:0/3302196842 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03cc09e2b0 0x7f03cc12d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.608+0000 7f03d1716700 1 --2- 172.21.15.40:0/3302196842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03cc09c890 0x7f03cc1c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.608+0000 7f03d1716700 1 --2- 172.21.15.40:0/3302196842 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f03cc09d920 0x7f03cc1c9100 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.608+0000 7f03d1716700 1 -- 172.21.15.40:0/3302196842 >> 172.21.15.40:0/3302196842 conn(0x7f03cc0a7080 msgr2=0x7f03cc0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:45.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.608+0000 7f03d1716700 1 -- 172.21.15.40:0/3302196842 shutdown_connections 2023-09-30T22:28:45.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:45.608+0000 7f03d1716700 1 -- 172.21.15.40:0/3302196842 wait complete. 2023-09-30T22:28:45.622 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:46.152 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:46.258 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:46.290 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:46.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.292+0000 7f47a5b5d700 1 Processor -- start 2023-09-30T22:28:46.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.292+0000 7f47a5b5d700 1 -- start start 2023-09-30T22:28:46.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.292+0000 7f47a5b5d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f47a009f0f0 0x7f47a0138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.292+0000 7f47a5b5d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f47a009e400 0x7f47a013b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.292+0000 7f47a5b5d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a009f940 con 0x7f47a009d920 2023-09-30T22:28:46.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.292+0000 7f47a5b5d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a006b4c0 con 0x7f47a009f0f0 2023-09-30T22:28:46.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.292+0000 7f47a5b5d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47a009a8f0 con 0x7f47a009e400 2023-09-30T22:28:46.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.293+0000 7f479effd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f47a009f0f0 0x7f47a0138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.293+0000 7f479ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f47a009e400 0x7f47a013b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.293+0000 7f479effd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f47a009f0f0 0x7f47a0138ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35590/0 (socket says 172.21.15.40:35590) 2023-09-30T22:28:46.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.293+0000 7f479effd700 1 -- 172.21.15.40:0/3154307249 learned_addr learned my addr 172.21.15.40:0/3154307249 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:46.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.293+0000 7f479ffff700 1 -- 172.21.15.40:0/3154307249 >> v2:172.21.15.40:3300/0 conn(0x7f47a009f0f0 msgr2=0x7f47a0138ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:46.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.293+0000 7f479ffff700 1 --2- 172.21.15.40:0/3154307249 >> v2:172.21.15.40:3300/0 conn(0x7f47a009f0f0 0x7f47a0138ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.293+0000 7f479ffff700 1 -- 172.21.15.40:0/3154307249 >> v1:172.21.15.40:6789/0 conn(0x7f47a009d920 legacy=0x7f47a009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.293+0000 7f479ffff700 1 -- 172.21.15.40:0/3154307249 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a009f6e0 con 0x7f47a009e400 2023-09-30T22:28:46.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.293+0000 7f479effd700 1 --2- 172.21.15.40:0/3154307249 >> v2:172.21.15.40:3300/0 conn(0x7f47a009f0f0 0x7f47a0138ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:46.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.293+0000 7f479ffff700 1 --2- 172.21.15.40:0/3154307249 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f47a009e400 0x7f47a013b430 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f4798009dc0 tx=0x7f479800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=906821af0758a941 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:46.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.293+0000 7f479e7fc700 1 -- 172.21.15.40:0/3154307249 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479800e070 con 0x7f47a009e400 2023-09-30T22:28:46.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.293+0000 7f479e7fc700 1 -- 172.21.15.40:0/3154307249 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479800bae0 con 0x7f47a009e400 2023-09-30T22:28:46.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.293+0000 7f479e7fc700 1 -- 172.21.15.40:0/3154307249 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479800be90 con 0x7f47a009e400 2023-09-30T22:28:46.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.294+0000 7f47a5b5d700 1 -- 172.21.15.40:0/3154307249 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f47a009e400 msgr2=0x7f47a013b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.294+0000 7f47a5b5d700 1 --2- 172.21.15.40:0/3154307249 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f47a009e400 0x7f47a013b430 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f4798009dc0 tx=0x7f479800b330 comp rx=0 tx=0).stop 2023-09-30T22:28:46.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.294+0000 7f47a5b5d700 1 -- 172.21.15.40:0/3154307249 shutdown_connections 2023-09-30T22:28:46.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.294+0000 7f47a5b5d700 1 --2- 172.21.15.40:0/3154307249 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f47a009e400 0x7f47a013b430 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.294+0000 7f47a5b5d700 1 --2- 172.21.15.40:0/3154307249 >> v2:172.21.15.40:3300/0 conn(0x7f47a009f0f0 0x7f47a0138ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.294+0000 7f47a5b5d700 1 -- 172.21.15.40:0/3154307249 >> 172.21.15.40:0/3154307249 conn(0x7f47a009fb20 msgr2=0x7f47a009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:46.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.294+0000 7f47a5b5d700 1 -- 172.21.15.40:0/3154307249 shutdown_connections 2023-09-30T22:28:46.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.294+0000 7f47a5b5d700 1 -- 172.21.15.40:0/3154307249 wait complete. 2023-09-30T22:28:46.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.295+0000 7f47a5b5d700 1 Processor -- start 2023-09-30T22:28:46.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.295+0000 7f47a5b5d700 1 -- start start 2023-09-30T22:28:46.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.296+0000 7f47a5b5d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47a009d920 0x7f47a011db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.296+0000 7f47a5b5d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f47a009e400 0x7f47a011e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.296+0000 7f47a5b5d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f47a011e5c0 0x7f47a01c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.296+0000 7f47a5b5d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a011ea10 con 0x7f47a009d920 2023-09-30T22:28:46.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.296+0000 7f47a5b5d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a011ff50 con 0x7f47a009e400 2023-09-30T22:28:46.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.296+0000 7f47a5b5d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47a0120230 con 0x7f47a011e5c0 2023-09-30T22:28:46.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.296+0000 7f479f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47a009d920 0x7f47a011db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.296+0000 7f479f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47a009d920 0x7f47a011db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35594/0 (socket says 172.21.15.40:35594) 2023-09-30T22:28:46.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.296+0000 7f479f7fe700 1 -- 172.21.15.40:0/1345872423 learned_addr learned my addr 172.21.15.40:0/1345872423 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:46.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.296+0000 7f479effd700 1 --2- 172.21.15.40:0/1345872423 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f47a009e400 0x7f47a011e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.296+0000 7f479ffff700 1 --2- 172.21.15.40:0/1345872423 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f47a011e5c0 0x7f47a01c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.296+0000 7f479f7fe700 1 -- 172.21.15.40:0/1345872423 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f47a011e5c0 msgr2=0x7f47a01c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.296+0000 7f479f7fe700 1 --2- 172.21.15.40:0/1345872423 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f47a011e5c0 0x7f47a01c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.296+0000 7f479f7fe700 1 -- 172.21.15.40:0/1345872423 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f47a009e400 msgr2=0x7f47a011e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.296+0000 7f479f7fe700 1 --2- 172.21.15.40:0/1345872423 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f47a009e400 0x7f47a011e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.296+0000 7f479f7fe700 1 -- 172.21.15.40:0/1345872423 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4794009550 con 0x7f47a009d920 2023-09-30T22:28:46.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.296+0000 7f479effd700 1 --2- 172.21.15.40:0/1345872423 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f47a009e400 0x7f47a011e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:46.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.296+0000 7f479f7fe700 1 --2- 172.21.15.40:0/1345872423 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47a009d920 0x7f47a011db40 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f479000c500 tx=0x7f479000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:46.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.297+0000 7f4787fff700 1 -- 172.21.15.40:0/1345872423 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47900054e0 con 0x7f47a009d920 2023-09-30T22:28:46.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.297+0000 7f4787fff700 1 -- 172.21.15.40:0/1345872423 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4790003680 con 0x7f47a009d920 2023-09-30T22:28:46.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.297+0000 7f47a5b5d700 1 -- 172.21.15.40:0/1345872423 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4798009a70 con 0x7f47a009d920 2023-09-30T22:28:46.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.297+0000 7f4787fff700 1 -- 172.21.15.40:0/1345872423 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4790003a30 con 0x7f47a009d920 2023-09-30T22:28:46.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.297+0000 7f47a5b5d700 1 -- 172.21.15.40:0/1345872423 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a00a3200 con 0x7f47a009d920 2023-09-30T22:28:46.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.298+0000 7f47a5b5d700 1 -- 172.21.15.40:0/1345872423 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a011fdb0 con 0x7f47a009d920 2023-09-30T22:28:46.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.298+0000 7f4787fff700 1 -- 172.21.15.40:0/1345872423 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4790003b90 con 0x7f47a009d920 2023-09-30T22:28:46.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.299+0000 7f4787fff700 1 -- 172.21.15.40:0/1345872423 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f479003ea90 con 0x7f47a009d920 2023-09-30T22:28:46.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.304+0000 7f4787fff700 1 -- 172.21.15.40:0/1345872423 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f47a011fdb0 con 0x7f47a009d920 2023-09-30T22:28:46.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.402+0000 7f5cfb0ef700 1 Processor -- start 2023-09-30T22:28:46.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.402+0000 7f5cfb0ef700 1 -- start start 2023-09-30T22:28:46.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.402+0000 7f5cfb0ef700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5cf406f070 0x7f5cf406f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.402+0000 7f5cfb0ef700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5cf406fdb0 0x7f5cf40977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.402+0000 7f5cfb0ef700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf4070830 con 0x7f5cf406f980 2023-09-30T22:28:46.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.402+0000 7f5cfb0ef700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf4070ad0 con 0x7f5cf406f070 2023-09-30T22:28:46.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.402+0000 7f5cfb0ef700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf4070de0 con 0x7f5cf406fdb0 2023-09-30T22:28:46.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.403+0000 7f5cf8e8b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5cf406f070 0x7f5cf406f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.403+0000 7f5cf968c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5cf406fdb0 0x7f5cf40977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.403+0000 7f5cf8e8b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5cf406f070 0x7f5cf406f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35608/0 (socket says 172.21.15.40:35608) 2023-09-30T22:28:46.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.403+0000 7f5cf968c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5cf406fdb0 0x7f5cf40977a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:44260/0 (socket says 172.21.15.40:44260) 2023-09-30T22:28:46.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.403+0000 7f5cf8e8b700 1 -- 172.21.15.40:0/3917896342 learned_addr learned my addr 172.21.15.40:0/3917896342 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:46.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.403+0000 7f5cf968c700 1 -- 172.21.15.40:0/3917896342 >> v2:172.21.15.40:3300/0 conn(0x7f5cf406f070 msgr2=0x7f5cf406f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:46.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.403+0000 7f5cf968c700 1 --2- 172.21.15.40:0/3917896342 >> v2:172.21.15.40:3300/0 conn(0x7f5cf406f070 0x7f5cf406f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.403+0000 7f5cf968c700 1 -- 172.21.15.40:0/3917896342 >> v1:172.21.15.40:6789/0 conn(0x7f5cf406f980 legacy=0x7f5cf4097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.403+0000 7f5cf968c700 1 -- 172.21.15.40:0/3917896342 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf409fe20 con 0x7f5cf406fdb0 2023-09-30T22:28:46.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.403+0000 7f5cf968c700 1 --2- 172.21.15.40:0/3917896342 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5cf406fdb0 0x7f5cf40977a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f5cec009d90 tx=0x7f5cec00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce49d8276af81602 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:46.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.403+0000 7f5cf37fe700 1 -- 172.21.15.40:0/3917896342 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec00e070 con 0x7f5cf406fdb0 2023-09-30T22:28:46.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.403+0000 7f5cf37fe700 1 -- 172.21.15.40:0/3917896342 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cec00bb20 con 0x7f5cf406fdb0 2023-09-30T22:28:46.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.403+0000 7f5cf37fe700 1 -- 172.21.15.40:0/3917896342 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec012430 con 0x7f5cf406fdb0 2023-09-30T22:28:46.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.404+0000 7f5cfb0ef700 1 -- 172.21.15.40:0/3917896342 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5cf406fdb0 msgr2=0x7f5cf40977a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.404+0000 7f5cfb0ef700 1 --2- 172.21.15.40:0/3917896342 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5cf406fdb0 0x7f5cf40977a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f5cec009d90 tx=0x7f5cec00b330 comp rx=0 tx=0).stop 2023-09-30T22:28:46.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.404+0000 7f5cfb0ef700 1 -- 172.21.15.40:0/3917896342 shutdown_connections 2023-09-30T22:28:46.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.404+0000 7f5cfb0ef700 1 --2- 172.21.15.40:0/3917896342 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5cf406fdb0 0x7f5cf40977a0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.404+0000 7f5cfb0ef700 1 --2- 172.21.15.40:0/3917896342 >> v2:172.21.15.40:3300/0 conn(0x7f5cf406f070 0x7f5cf406f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.404+0000 7f5cfb0ef700 1 -- 172.21.15.40:0/3917896342 >> 172.21.15.40:0/3917896342 conn(0x7f5cf40a41a0 msgr2=0x7f5cf40a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:46.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.404+0000 7f5cfb0ef700 1 -- 172.21.15.40:0/3917896342 shutdown_connections 2023-09-30T22:28:46.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.404+0000 7f5cfb0ef700 1 -- 172.21.15.40:0/3917896342 wait complete. 2023-09-30T22:28:46.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.405+0000 7f5cfb0ef700 1 Processor -- start 2023-09-30T22:28:46.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.405+0000 7f5cfb0ef700 1 -- start start 2023-09-30T22:28:46.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.406+0000 7f5cfb0ef700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5cf406f070 0x7f5cf412d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.406+0000 7f5cfb0ef700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5cf406f980 0x7f5cf412d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.406+0000 7f5cfb0ef700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5cf406fdb0 0x7f5cf412dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.406+0000 7f5cfb0ef700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf4130a10 con 0x7f5cf406f070 2023-09-30T22:28:46.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.406+0000 7f5cfb0ef700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf412fb60 con 0x7f5cf406f980 2023-09-30T22:28:46.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.406+0000 7f5cfb0ef700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf4129310 con 0x7f5cf406fdb0 2023-09-30T22:28:46.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.406+0000 7f5cf8e8b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5cf406f070 0x7f5cf412d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.406+0000 7f5cf8e8b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5cf406f070 0x7f5cf412d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35612/0 (socket says 172.21.15.40:35612) 2023-09-30T22:28:46.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.406+0000 7f5cf8e8b700 1 -- 172.21.15.40:0/1195796482 learned_addr learned my addr 172.21.15.40:0/1195796482 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:46.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.406+0000 7f5cf968c700 1 --2- 172.21.15.40:0/1195796482 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5cf406fdb0 0x7f5cf412dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.406+0000 7f5cf3fff700 1 --2- 172.21.15.40:0/1195796482 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5cf406f980 0x7f5cf412d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.406+0000 7f5cf8e8b700 1 -- 172.21.15.40:0/1195796482 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5cf406fdb0 msgr2=0x7f5cf412dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.406+0000 7f5cf8e8b700 1 --2- 172.21.15.40:0/1195796482 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5cf406fdb0 0x7f5cf412dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.406+0000 7f5cf8e8b700 1 -- 172.21.15.40:0/1195796482 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5cf406f980 msgr2=0x7f5cf412d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.406+0000 7f5cf8e8b700 1 --2- 172.21.15.40:0/1195796482 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5cf406f980 0x7f5cf412d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.406+0000 7f5cf8e8b700 1 -- 172.21.15.40:0/1195796482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cec009a70 con 0x7f5cf406f070 2023-09-30T22:28:46.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.406+0000 7f5cf8e8b700 1 --2- 172.21.15.40:0/1195796482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5cf406f070 0x7f5cf412d1d0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f5ce800e910 tx=0x7f5ce800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:46.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.407+0000 7f5cf17fa700 1 -- 172.21.15.40:0/1195796482 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce80096a0 con 0x7f5cf406f070 2023-09-30T22:28:46.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.407+0000 7f5cf17fa700 1 -- 172.21.15.40:0/1195796482 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce8013980 con 0x7f5cf406f070 2023-09-30T22:28:46.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.407+0000 7f5cf17fa700 1 -- 172.21.15.40:0/1195796482 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8013d30 con 0x7f5cf406f070 2023-09-30T22:28:46.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.407+0000 7f5cfb0ef700 1 -- 172.21.15.40:0/1195796482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf412c2d0 con 0x7f5cf406f070 2023-09-30T22:28:46.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.407+0000 7f5cfb0ef700 1 -- 172.21.15.40:0/1195796482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf4131480 con 0x7f5cf406f070 2023-09-30T22:28:46.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.408+0000 7f5cfb0ef700 1 -- 172.21.15.40:0/1195796482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cf4062380 con 0x7f5cf406f070 2023-09-30T22:28:46.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.408+0000 7f5cf17fa700 1 -- 172.21.15.40:0/1195796482 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5ce801b440 con 0x7f5cf406f070 2023-09-30T22:28:46.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.408+0000 7f5cf17fa700 1 -- 172.21.15.40:0/1195796482 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5ce8043460 con 0x7f5cf406f070 2023-09-30T22:28:46.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.417+0000 7f5cf17fa700 1 -- 172.21.15.40:0/1195796482 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5ce80243b0 con 0x7f5cf406f070 2023-09-30T22:28:46.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.423+0000 7fb2d8c24700 1 Processor -- start 2023-09-30T22:28:46.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.423+0000 7fb2d8c24700 1 -- start start 2023-09-30T22:28:46.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.424+0000 7fb2d8c24700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb2d409c890 0x7fb2d409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.424+0000 7fb2d8c24700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2d409e480 0x7fb2d413bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.424+0000 7fb2d8c24700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d40a2600 con 0x7fb2d409d920 2023-09-30T22:28:46.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.424+0000 7fb2d8c24700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d40a29d0 con 0x7fb2d409c890 2023-09-30T22:28:46.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.424+0000 7fb2d8c24700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d409fb40 con 0x7fb2d409e480 2023-09-30T22:28:46.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.424+0000 7fb2d1d9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb2d409d920 0x7fb2d409dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55794/0 (socket says 172.21.15.40:55794) 2023-09-30T22:28:46.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.424+0000 7fb2d1d9b700 1 -- 172.21.15.40:0/3014031907 learned_addr learned my addr 172.21.15.40:0/3014031907 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:46.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.424+0000 7fb2d259c700 1 --2- 172.21.15.40:0/3014031907 >> v2:172.21.15.40:3300/0 conn(0x7fb2d409c890 0x7fb2d409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.424+0000 7fb2d2d9d700 1 --2- 172.21.15.40:0/3014031907 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2d409e480 0x7fb2d413bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.425+0000 7fb2d259c700 1 -- 172.21.15.40:0/3014031907 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2d409e480 msgr2=0x7fb2d413bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:46.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.425+0000 7fb2d259c700 1 --2- 172.21.15.40:0/3014031907 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2d409e480 0x7fb2d413bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.425+0000 7fb2d259c700 1 -- 172.21.15.40:0/3014031907 >> v1:172.21.15.40:6789/0 conn(0x7fb2d409d920 legacy=0x7fb2d409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.425+0000 7fb2d259c700 1 -- 172.21.15.40:0/3014031907 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d409fed0 con 0x7fb2d409c890 2023-09-30T22:28:46.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.425+0000 7fb2d259c700 1 --2- 172.21.15.40:0/3014031907 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2d409c890 0x7fb2d409cc60 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fb2c4009820 tx=0x7fb2c4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5776316543729827 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:46.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.425+0000 7fb2d159a700 1 -- 172.21.15.40:0/3014031907 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c4005e30 con 0x7fb2d409c890 2023-09-30T22:28:46.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.425+0000 7fb2d159a700 1 -- 172.21.15.40:0/3014031907 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c4006030 con 0x7fb2d409c890 2023-09-30T22:28:46.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.425+0000 7fb2d159a700 1 -- 172.21.15.40:0/3014031907 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c40063c0 con 0x7fb2d409c890 2023-09-30T22:28:46.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.426+0000 7fb2d8c24700 1 -- 172.21.15.40:0/3014031907 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2d409c890 msgr2=0x7fb2d409cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.426+0000 7fb2d8c24700 1 --2- 172.21.15.40:0/3014031907 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2d409c890 0x7fb2d409cc60 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fb2c4009820 tx=0x7fb2c4009b30 comp rx=0 tx=0).stop 2023-09-30T22:28:46.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.426+0000 7fb2d8c24700 1 -- 172.21.15.40:0/3014031907 shutdown_connections 2023-09-30T22:28:46.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.426+0000 7fb2d8c24700 1 --2- 172.21.15.40:0/3014031907 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2d409e480 0x7fb2d413bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.426+0000 7fb2d8c24700 1 --2- 172.21.15.40:0/3014031907 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2d409c890 0x7fb2d409cc60 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.426+0000 7fb2d8c24700 1 -- 172.21.15.40:0/3014031907 >> 172.21.15.40:0/3014031907 conn(0x7fb2d40a7080 msgr2=0x7fb2d40a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:46.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.426+0000 7fb2d8c24700 1 -- 172.21.15.40:0/3014031907 shutdown_connections 2023-09-30T22:28:46.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.426+0000 7fb2d8c24700 1 -- 172.21.15.40:0/3014031907 wait complete. 2023-09-30T22:28:46.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.427+0000 7fb2d8c24700 1 Processor -- start 2023-09-30T22:28:46.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.427+0000 7fb2d8c24700 1 -- start start 2023-09-30T22:28:46.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.427+0000 7fb2d8c24700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2d409c890 0x7fb2d41c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.427+0000 7fb2d8c24700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2d409d920 0x7fb2d41c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.427+0000 7fb2d8c24700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb2d409e480 0x7fb2d412d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.427+0000 7fb2d8c24700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d4130fa0 con 0x7fb2d409d920 2023-09-30T22:28:46.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.427+0000 7fb2d8c24700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d412f910 con 0x7fb2d409c890 2023-09-30T22:28:46.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.427+0000 7fb2d8c24700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d409ecf0 con 0x7fb2d409e480 2023-09-30T22:28:46.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.427+0000 7fb2d1d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2d409d920 0x7fb2d41c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.427+0000 7fb2d2d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb2d409e480 0x7fb2d412d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.427+0000 7fb2d1d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2d409d920 0x7fb2d41c9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35630/0 (socket says 172.21.15.40:35630) 2023-09-30T22:28:46.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.427+0000 7fb2d2d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb2d409e480 0x7fb2d412d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:44274/0 (socket says 172.21.15.40:44274) 2023-09-30T22:28:46.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.428+0000 7fb2d1d9b700 1 -- 172.21.15.40:0/4140411738 learned_addr learned my addr 172.21.15.40:0/4140411738 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:46.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.428+0000 7fb2d259c700 1 --2- 172.21.15.40:0/4140411738 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2d409c890 0x7fb2d41c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.428+0000 7fb2d1d9b700 1 -- 172.21.15.40:0/4140411738 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb2d409e480 msgr2=0x7fb2d412d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.428+0000 7fb2d1d9b700 1 --2- 172.21.15.40:0/4140411738 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb2d409e480 0x7fb2d412d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.428+0000 7fb2d1d9b700 1 -- 172.21.15.40:0/4140411738 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2d409c890 msgr2=0x7fb2d41c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.428+0000 7fb2d1d9b700 1 --2- 172.21.15.40:0/4140411738 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2d409c890 0x7fb2d41c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.428+0000 7fb2d1d9b700 1 -- 172.21.15.40:0/4140411738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c4009430 con 0x7fb2d409d920 2023-09-30T22:28:46.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.428+0000 7fb2d259c700 1 --2- 172.21.15.40:0/4140411738 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2d409c890 0x7fb2d41c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:46.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.428+0000 7fb2d1d9b700 1 --2- 172.21.15.40:0/4140411738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2d409d920 0x7fb2d41c9190 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fb2c800c520 tx=0x7fb2c800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:46.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.428+0000 7fb2c2ffd700 1 -- 172.21.15.40:0/4140411738 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c8005d70 con 0x7fb2d409d920 2023-09-30T22:28:46.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.428+0000 7fb2c2ffd700 1 -- 172.21.15.40:0/4140411738 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c80070d0 con 0x7fb2d409d920 2023-09-30T22:28:46.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.428+0000 7fb2d8c24700 1 -- 172.21.15.40:0/4140411738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d41307a0 con 0x7fb2d409d920 2023-09-30T22:28:46.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.428+0000 7fb2c2ffd700 1 -- 172.21.15.40:0/4140411738 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c8007440 con 0x7fb2d409d920 2023-09-30T22:28:46.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.428+0000 7fb2d8c24700 1 -- 172.21.15.40:0/4140411738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d41314a0 con 0x7fb2d409d920 2023-09-30T22:28:46.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.429+0000 7fb2c2ffd700 1 -- 172.21.15.40:0/4140411738 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb2c80075a0 con 0x7fb2d409d920 2023-09-30T22:28:46.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.430+0000 7fb2c2ffd700 1 -- 172.21.15.40:0/4140411738 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb2c803e8a0 con 0x7fb2d409d920 2023-09-30T22:28:46.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.430+0000 7fb2d8c24700 1 -- 172.21.15.40:0/4140411738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d4130be0 con 0x7fb2d409d920 2023-09-30T22:28:46.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.434+0000 7fb2c2ffd700 1 -- 172.21.15.40:0/4140411738 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb2c801b3b0 con 0x7fb2d409d920 2023-09-30T22:28:46.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.526+0000 7f47a5b5d700 1 -- 172.21.15.40:0/1345872423 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f47a011fdb0 con 0x7f47a009d920 2023-09-30T22:28:46.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.526+0000 7f4787fff700 1 -- 172.21.15.40:0/1345872423 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f47a011fdb0 con 0x7f47a009d920 2023-09-30T22:28:46.527 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:46.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.528+0000 7f47a5b5d700 1 -- 172.21.15.40:0/1345872423 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47a009d920 msgr2=0x7f47a011db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.528+0000 7f47a5b5d700 1 --2- 172.21.15.40:0/1345872423 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47a009d920 0x7f47a011db40 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f479000c500 tx=0x7f479000c810 comp rx=0 tx=0).stop 2023-09-30T22:28:46.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.529+0000 7f47a5b5d700 1 -- 172.21.15.40:0/1345872423 shutdown_connections 2023-09-30T22:28:46.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.529+0000 7f47a5b5d700 1 --2- 172.21.15.40:0/1345872423 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f47a011e5c0 0x7f47a01c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.529+0000 7f47a5b5d700 1 --2- 172.21.15.40:0/1345872423 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47a009d920 0x7f47a011db40 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.529+0000 7f47a5b5d700 1 --2- 172.21.15.40:0/1345872423 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f47a009e400 0x7f47a011e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.529+0000 7f47a5b5d700 1 -- 172.21.15.40:0/1345872423 >> 172.21.15.40:0/1345872423 conn(0x7f47a009fb20 msgr2=0x7f47a0137100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:46.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.529+0000 7f47a5b5d700 1 -- 172.21.15.40:0/1345872423 shutdown_connections 2023-09-30T22:28:46.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.529+0000 7f47a5b5d700 1 -- 172.21.15.40:0/1345872423 wait complete. 2023-09-30T22:28:46.542 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:46.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.616+0000 7f5cfb0ef700 1 -- 172.21.15.40:0/1195796482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5cf4130830 con 0x7f5cf406f070 2023-09-30T22:28:46.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.616+0000 7f5cf17fa700 1 -- 172.21.15.40:0/1195796482 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5ce8020070 con 0x7f5cf406f070 2023-09-30T22:28:46.619 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:46.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.618+0000 7f5cfb0ef700 1 -- 172.21.15.40:0/1195796482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5cf406f070 msgr2=0x7f5cf412d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.618+0000 7f5cfb0ef700 1 --2- 172.21.15.40:0/1195796482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5cf406f070 0x7f5cf412d1d0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f5ce800e910 tx=0x7f5ce800ec20 comp rx=0 tx=0).stop 2023-09-30T22:28:46.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.619+0000 7f5cfb0ef700 1 -- 172.21.15.40:0/1195796482 shutdown_connections 2023-09-30T22:28:46.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.619+0000 7f5cfb0ef700 1 --2- 172.21.15.40:0/1195796482 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5cf406fdb0 0x7f5cf412dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.619+0000 7f5cfb0ef700 1 --2- 172.21.15.40:0/1195796482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5cf406f070 0x7f5cf412d1d0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.619+0000 7f5cfb0ef700 1 --2- 172.21.15.40:0/1195796482 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5cf406f980 0x7f5cf412d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.619+0000 7f5cfb0ef700 1 -- 172.21.15.40:0/1195796482 >> 172.21.15.40:0/1195796482 conn(0x7f5cf40a41a0 msgr2=0x7f5cf40974a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:46.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.619+0000 7f5cfb0ef700 1 -- 172.21.15.40:0/1195796482 shutdown_connections 2023-09-30T22:28:46.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.619+0000 7f5cfb0ef700 1 -- 172.21.15.40:0/1195796482 wait complete. 2023-09-30T22:28:46.623 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:46.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.631+0000 7fb2d8c24700 1 -- 172.21.15.40:0/4140411738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb2d4130740 con 0x7fb2d409d920 2023-09-30T22:28:46.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.631+0000 7fb2c2ffd700 1 -- 172.21.15.40:0/4140411738 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb2c8017020 con 0x7fb2d409d920 2023-09-30T22:28:46.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:46.632 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:46.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.633+0000 7fb2d8c24700 1 -- 172.21.15.40:0/4140411738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2d409d920 msgr2=0x7fb2d41c9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.633+0000 7fb2d8c24700 1 --2- 172.21.15.40:0/4140411738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2d409d920 0x7fb2d41c9190 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fb2c800c520 tx=0x7fb2c800c830 comp rx=0 tx=0).stop 2023-09-30T22:28:46.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.633+0000 7fb2d8c24700 1 -- 172.21.15.40:0/4140411738 shutdown_connections 2023-09-30T22:28:46.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.633+0000 7fb2d8c24700 1 --2- 172.21.15.40:0/4140411738 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb2d409e480 0x7fb2d412d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.633+0000 7fb2d8c24700 1 --2- 172.21.15.40:0/4140411738 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb2d409c890 0x7fb2d41c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.633+0000 7fb2d8c24700 1 --2- 172.21.15.40:0/4140411738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb2d409d920 0x7fb2d41c9190 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.633+0000 7fb2d8c24700 1 -- 172.21.15.40:0/4140411738 >> 172.21.15.40:0/4140411738 conn(0x7fb2d40a7080 msgr2=0x7fb2d40a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:46.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.633+0000 7fb2d8c24700 1 -- 172.21.15.40:0/4140411738 shutdown_connections 2023-09-30T22:28:46.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.633+0000 7fb2d8c24700 1 -- 172.21.15.40:0/4140411738 wait complete. 2023-09-30T22:28:46.646 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:46.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.750+0000 7fbfee5e1700 1 Processor -- start 2023-09-30T22:28:46.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.750+0000 7fbfee5e1700 1 -- start start 2023-09-30T22:28:46.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.751+0000 7fbfee5e1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfe809c890 0x7fbfe809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.751+0000 7fbfee5e1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbfe809d920 0x7fbfe809dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.751+0000 7fbfee5e1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe80a2600 con 0x7fbfe809e2b0 2023-09-30T22:28:46.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.751+0000 7fbfee5e1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe80a29d0 con 0x7fbfe809d920 2023-09-30T22:28:46.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.751+0000 7fbfee5e1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe809fb40 con 0x7fbfe809c890 2023-09-30T22:28:46.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.751+0000 7fbfdffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbfe809d920 0x7fbfe809dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.751+0000 7fbfdffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbfe809d920 0x7fbfe809dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35634/0 (socket says 172.21.15.40:35634) 2023-09-30T22:28:46.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.751+0000 7fbfdffff700 1 -- 172.21.15.40:0/1640429927 learned_addr learned my addr 172.21.15.40:0/1640429927 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:46.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.751+0000 7fbfe7fff700 1 --2- 172.21.15.40:0/1640429927 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfe809c890 0x7fbfe809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.751+0000 7fbfdffff700 1 -- 172.21.15.40:0/1640429927 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfe809c890 msgr2=0x7fbfe809cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:46.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.751+0000 7fbfdffff700 1 --2- 172.21.15.40:0/1640429927 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfe809c890 0x7fbfe809cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.751+0000 7fbfdffff700 1 -- 172.21.15.40:0/1640429927 >> v1:172.21.15.40:6789/0 conn(0x7fbfe809e2b0 legacy=0x7fbfe813ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.751+0000 7fbfdffff700 1 -- 172.21.15.40:0/1640429927 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe809e750 con 0x7fbfe809d920 2023-09-30T22:28:46.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.751+0000 7fbfe7fff700 1 --2- 172.21.15.40:0/1640429927 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfe809c890 0x7fbfe809cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:46.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.751+0000 7fbfdffff700 1 --2- 172.21.15.40:0/1640429927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfe809d920 0x7fbfe809dd70 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fbfd00098f0 tx=0x7fbfd0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=454284558ef34edb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:46.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.751+0000 7fbfe77fe700 1 -- 172.21.15.40:0/1640429927 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd0011830 con 0x7fbfe809d920 2023-09-30T22:28:46.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.751+0000 7fbfe77fe700 1 -- 172.21.15.40:0/1640429927 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd0011990 con 0x7fbfe809d920 2023-09-30T22:28:46.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.751+0000 7fbfe77fe700 1 -- 172.21.15.40:0/1640429927 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd0011d20 con 0x7fbfe809d920 2023-09-30T22:28:46.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.752+0000 7fbfee5e1700 1 -- 172.21.15.40:0/1640429927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfe809d920 msgr2=0x7fbfe809dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.752+0000 7fbfee5e1700 1 --2- 172.21.15.40:0/1640429927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfe809d920 0x7fbfe809dd70 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fbfd00098f0 tx=0x7fbfd0009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:46.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.752+0000 7fbfee5e1700 1 -- 172.21.15.40:0/1640429927 shutdown_connections 2023-09-30T22:28:46.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.752+0000 7fbfee5e1700 1 --2- 172.21.15.40:0/1640429927 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfe809c890 0x7fbfe809cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.752+0000 7fbfee5e1700 1 --2- 172.21.15.40:0/1640429927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfe809d920 0x7fbfe809dd70 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.752+0000 7fbfee5e1700 1 -- 172.21.15.40:0/1640429927 >> 172.21.15.40:0/1640429927 conn(0x7fbfe80a7080 msgr2=0x7fbfe80a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:46.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.752+0000 7fbfee5e1700 1 -- 172.21.15.40:0/1640429927 shutdown_connections 2023-09-30T22:28:46.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.752+0000 7fbfee5e1700 1 -- 172.21.15.40:0/1640429927 wait complete. 2023-09-30T22:28:46.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.753+0000 7fbfee5e1700 1 Processor -- start 2023-09-30T22:28:46.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.753+0000 7fbfee5e1700 1 -- start start 2023-09-30T22:28:46.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.753+0000 7fbfee5e1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbfe809c890 0x7fbfe81c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.753+0000 7fbfee5e1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfe809d920 0x7fbfe81c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.753+0000 7fbfee5e1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfe809e2b0 0x7fbfe812d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.753+0000 7fbfee5e1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe8130850 con 0x7fbfe809e2b0 2023-09-30T22:28:46.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.753+0000 7fbfee5e1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe812fce0 con 0x7fbfe809d920 2023-09-30T22:28:46.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.753+0000 7fbfee5e1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe80a5c80 con 0x7fbfe809c890 2023-09-30T22:28:46.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.754+0000 7fbfdffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfe809d920 0x7fbfe81c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.754+0000 7fbfecb7e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfe809e2b0 0x7fbfe812d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.754+0000 7fbfe7fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbfe809c890 0x7fbfe81c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.754+0000 7fbfdffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfe809d920 0x7fbfe81c9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:43248/0 (socket says 172.21.15.40:43248) 2023-09-30T22:28:46.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.754+0000 7fbfe7fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbfe809c890 0x7fbfe81c8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:44286/0 (socket says 172.21.15.40:44286) 2023-09-30T22:28:46.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.754+0000 7fbfdffff700 1 -- 172.21.15.40:0/1670172581 learned_addr learned my addr 172.21.15.40:0/1670172581 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:46.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.754+0000 7fbfecb7e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfe809e2b0 0x7fbfe812d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35650/0 (socket says 172.21.15.40:35650) 2023-09-30T22:28:46.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.754+0000 7fbfdffff700 1 -- 172.21.15.40:0/1670172581 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbfe809c890 msgr2=0x7fbfe81c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.754+0000 7fbfdffff700 1 --2- 172.21.15.40:0/1670172581 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbfe809c890 0x7fbfe81c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.754+0000 7fbfdffff700 1 -- 172.21.15.40:0/1670172581 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfe809e2b0 msgr2=0x7fbfe812d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.754+0000 7fbfdffff700 1 --2- 172.21.15.40:0/1670172581 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfe809e2b0 0x7fbfe812d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.754+0000 7fbfdffff700 1 -- 172.21.15.40:0/1670172581 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd8009430 con 0x7fbfe809d920 2023-09-30T22:28:46.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.754+0000 7fbfecb7e700 1 --2- 172.21.15.40:0/1670172581 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfe809e2b0 0x7fbfe812d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:46.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.754+0000 7fbfe7fff700 1 --2- 172.21.15.40:0/1670172581 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbfe809c890 0x7fbfe81c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:46.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.754+0000 7fbfdffff700 1 --2- 172.21.15.40:0/1670172581 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfe809d920 0x7fbfe81c9190 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fbfd0000c00 tx=0x7fbfd0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:46.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.754+0000 7fbfe57fa700 1 -- 172.21.15.40:0/1670172581 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd00036a0 con 0x7fbfe809d920 2023-09-30T22:28:46.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.754+0000 7fbfe57fa700 1 -- 172.21.15.40:0/1670172581 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd0003800 con 0x7fbfe809d920 2023-09-30T22:28:46.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.754+0000 7fbfee5e1700 1 -- 172.21.15.40:0/1670172581 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd0009550 con 0x7fbfe809d920 2023-09-30T22:28:46.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.754+0000 7fbfe57fa700 1 -- 172.21.15.40:0/1670172581 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd0003bb0 con 0x7fbfe809d920 2023-09-30T22:28:46.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.754+0000 7fbfee5e1700 1 -- 172.21.15.40:0/1670172581 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe809ecf0 con 0x7fbfe809d920 2023-09-30T22:28:46.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.755+0000 7fbfe57fa700 1 -- 172.21.15.40:0/1670172581 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbfd0021070 con 0x7fbfe809d920 2023-09-30T22:28:46.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.755+0000 7fbfe57fa700 1 -- 172.21.15.40:0/1670172581 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fbfd0040bc0 con 0x7fbfe809d920 2023-09-30T22:28:46.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.755+0000 7fbfde7fc700 1 -- 172.21.15.40:0/1670172581 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfc00052e0 con 0x7fbfe809d920 2023-09-30T22:28:46.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.761+0000 7fbfe57fa700 1 -- 172.21.15.40:0/1670172581 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbfd0029080 con 0x7fbfe809d920 2023-09-30T22:28:46.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.956+0000 7fbfde7fc700 1 -- 172.21.15.40:0/1670172581 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbfc0005590 con 0x7fbfe809d920 2023-09-30T22:28:46.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.956+0000 7fbfe57fa700 1 -- 172.21.15.40:0/1670172581 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbfd0015020 con 0x7fbfe809d920 2023-09-30T22:28:46.957 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:46.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.958+0000 7fbfde7fc700 1 -- 172.21.15.40:0/1670172581 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfe809d920 msgr2=0x7fbfe81c9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.958+0000 7fbfde7fc700 1 --2- 172.21.15.40:0/1670172581 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfe809d920 0x7fbfe81c9190 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fbfd0000c00 tx=0x7fbfd0004750 comp rx=0 tx=0).stop 2023-09-30T22:28:46.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.958+0000 7fbfde7fc700 1 -- 172.21.15.40:0/1670172581 shutdown_connections 2023-09-30T22:28:46.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.958+0000 7fbfde7fc700 1 --2- 172.21.15.40:0/1670172581 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbfe809c890 0x7fbfe81c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.958+0000 7fbfde7fc700 1 --2- 172.21.15.40:0/1670172581 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfe809e2b0 0x7fbfe812d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.958+0000 7fbfde7fc700 1 --2- 172.21.15.40:0/1670172581 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfe809d920 0x7fbfe81c9190 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.958+0000 7fbfde7fc700 1 -- 172.21.15.40:0/1670172581 >> 172.21.15.40:0/1670172581 conn(0x7fbfe80a7080 msgr2=0x7fbfe80a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:46.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.958+0000 7fbfde7fc700 1 -- 172.21.15.40:0/1670172581 shutdown_connections 2023-09-30T22:28:46.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:46.958+0000 7fbfde7fc700 1 -- 172.21.15.40:0/1670172581 wait complete. 2023-09-30T22:28:46.971 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:47.542 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:47.633 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:47.646 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:47.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.683+0000 7fc1c9e21700 1 Processor -- start 2023-09-30T22:28:47.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.683+0000 7fc1c9e21700 1 -- start start 2023-09-30T22:28:47.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.683+0000 7fc1c9e21700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1c409c890 0x7fc1c409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.683+0000 7fc1c9e21700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc1c409d920 0x7fc1c409dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.683+0000 7fc1c9e21700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc1c409e2b0 0x7fc1c413ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.683+0000 7fc1c9e21700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1c40a29d0 con 0x7fc1c409e2b0 2023-09-30T22:28:47.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.683+0000 7fc1c9e21700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c409fb40 con 0x7fc1c409c890 2023-09-30T22:28:47.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.683+0000 7fc1c9e21700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c40a2600 con 0x7fc1c409d920 2023-09-30T22:28:47.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.683+0000 7fc1c37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1c409c890 0x7fc1c409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.683+0000 7fc1c2ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc1c409d920 0x7fc1c409dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.683+0000 7fc1c2ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc1c409d920 0x7fc1c409dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:44300/0 (socket says 172.21.15.40:44300) 2023-09-30T22:28:47.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.683+0000 7fc1c37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1c409c890 0x7fc1c409cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:43252/0 (socket says 172.21.15.40:43252) 2023-09-30T22:28:47.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.683+0000 7fc1c2ffd700 1 -- 172.21.15.40:0/571377466 learned_addr learned my addr 172.21.15.40:0/571377466 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:47.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.683+0000 7fc1c3fff700 1 --2- 172.21.15.40:0/571377466 >> v2:172.21.15.40:3300/0 conn(0x7fc1c409e2b0 0x7fc1c413ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.684+0000 7fc1c2ffd700 1 -- 172.21.15.40:0/571377466 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1c409c890 msgr2=0x7fc1c409cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:47.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.684+0000 7fc1c2ffd700 1 --2- 172.21.15.40:0/571377466 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1c409c890 0x7fc1c409cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.684+0000 7fc1c2ffd700 1 -- 172.21.15.40:0/571377466 >> v2:172.21.15.40:3300/0 conn(0x7fc1c409e2b0 msgr2=0x7fc1c413ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:47.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.684+0000 7fc1c2ffd700 1 --2- 172.21.15.40:0/571377466 >> v2:172.21.15.40:3300/0 conn(0x7fc1c409e2b0 0x7fc1c413ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.684+0000 7fc1c2ffd700 1 -- 172.21.15.40:0/571377466 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c409e720 con 0x7fc1c409d920 2023-09-30T22:28:47.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.684+0000 7fc1c37fe700 1 --2- 172.21.15.40:0/571377466 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1c409c890 0x7fc1c409cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:47.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.684+0000 7fc1c3fff700 1 --2- 172.21.15.40:0/571377466 >> v2:172.21.15.40:3300/0 conn(0x7fc1c409e2b0 0x7fc1c413ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:47.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.684+0000 7fc1c2ffd700 1 --2- 172.21.15.40:0/571377466 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc1c409d920 0x7fc1c409dd70 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80098f0 tx=0x7fc1b8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5b6dfb3db5931bd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:47.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.684+0000 7fc1c27fc700 1 -- 172.21.15.40:0/571377466 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b8011830 con 0x7fc1c409d920 2023-09-30T22:28:47.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.684+0000 7fc1c27fc700 1 -- 172.21.15.40:0/571377466 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b8011990 con 0x7fc1c409d920 2023-09-30T22:28:47.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.684+0000 7fc1c27fc700 1 -- 172.21.15.40:0/571377466 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b8011d20 con 0x7fc1c409d920 2023-09-30T22:28:47.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.685+0000 7fc1c9e21700 1 -- 172.21.15.40:0/571377466 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc1c409d920 msgr2=0x7fc1c409dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:47.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.685+0000 7fc1c9e21700 1 --2- 172.21.15.40:0/571377466 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc1c409d920 0x7fc1c409dd70 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80098f0 tx=0x7fc1b8009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:47.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.685+0000 7fc1c9e21700 1 -- 172.21.15.40:0/571377466 shutdown_connections 2023-09-30T22:28:47.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.685+0000 7fc1c9e21700 1 --2- 172.21.15.40:0/571377466 >> v2:172.21.15.40:3300/0 conn(0x7fc1c409e2b0 0x7fc1c413ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.685+0000 7fc1c9e21700 1 --2- 172.21.15.40:0/571377466 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1c409c890 0x7fc1c409cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.685+0000 7fc1c9e21700 1 --2- 172.21.15.40:0/571377466 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc1c409d920 0x7fc1c409dd70 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.685+0000 7fc1c9e21700 1 -- 172.21.15.40:0/571377466 >> 172.21.15.40:0/571377466 conn(0x7fc1c40a7080 msgr2=0x7fc1c40a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:47.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.685+0000 7fc1c9e21700 1 -- 172.21.15.40:0/571377466 shutdown_connections 2023-09-30T22:28:47.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.685+0000 7fc1c9e21700 1 -- 172.21.15.40:0/571377466 wait complete. 2023-09-30T22:28:47.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.686+0000 7fc1c9e21700 1 Processor -- start 2023-09-30T22:28:47.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.686+0000 7fc1c9e21700 1 -- start start 2023-09-30T22:28:47.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.687+0000 7fc1c9e21700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc1c409c890 0x7fc1c412d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.687+0000 7fc1c9e21700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1c409d920 0x7fc1c412d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.687+0000 7fc1c9e21700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1c409e2b0 0x7fc1c412ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.687+0000 7fc1c9e21700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c4130be0 con 0x7fc1c409e2b0 2023-09-30T22:28:47.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.687+0000 7fc1c9e21700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c40a5cd0 con 0x7fc1c409d920 2023-09-30T22:28:47.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.687+0000 7fc1c9e21700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c412f530 con 0x7fc1c409c890 2023-09-30T22:28:47.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.687+0000 7fc1c3fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1c409e2b0 0x7fc1c412ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.687+0000 7fc1c37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc1c409c890 0x7fc1c412d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.687+0000 7fc1c3fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1c409e2b0 0x7fc1c412ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35672/0 (socket says 172.21.15.40:35672) 2023-09-30T22:28:47.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.687+0000 7fc1c3fff700 1 -- 172.21.15.40:0/1580243937 learned_addr learned my addr 172.21.15.40:0/1580243937 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:47.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.687+0000 7fc1c2ffd700 1 --2- 172.21.15.40:0/1580243937 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1c409d920 0x7fc1c412d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.688+0000 7fc1c37fe700 1 -- 172.21.15.40:0/1580243937 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1c409d920 msgr2=0x7fc1c412d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:47.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.688+0000 7fc1c37fe700 1 --2- 172.21.15.40:0/1580243937 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1c409d920 0x7fc1c412d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.688+0000 7fc1c37fe700 1 -- 172.21.15.40:0/1580243937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1c409e2b0 msgr2=0x7fc1c412ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:47.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.688+0000 7fc1c37fe700 1 --2- 172.21.15.40:0/1580243937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1c409e2b0 0x7fc1c412ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.688+0000 7fc1c37fe700 1 -- 172.21.15.40:0/1580243937 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b4009430 con 0x7fc1c409c890 2023-09-30T22:28:47.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.688+0000 7fc1c3fff700 1 --2- 172.21.15.40:0/1580243937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1c409e2b0 0x7fc1c412ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:47.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.688+0000 7fc1c37fe700 1 --2- 172.21.15.40:0/1580243937 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc1c409c890 0x7fc1c412d350 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc1b400e930 tx=0x7fc1b400ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:47.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.688+0000 7fc1abfff700 1 -- 172.21.15.40:0/1580243937 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b400ee80 con 0x7fc1c409c890 2023-09-30T22:28:47.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.688+0000 7fc1abfff700 1 -- 172.21.15.40:0/1580243937 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b4005a20 con 0x7fc1c409c890 2023-09-30T22:28:47.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.688+0000 7fc1c9e21700 1 -- 172.21.15.40:0/1580243937 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1bc009a70 con 0x7fc1c409c890 2023-09-30T22:28:47.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.688+0000 7fc1abfff700 1 -- 172.21.15.40:0/1580243937 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b4005dd0 con 0x7fc1c409c890 2023-09-30T22:28:47.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.688+0000 7fc1c9e21700 1 -- 172.21.15.40:0/1580243937 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b8009550 con 0x7fc1c409c890 2023-09-30T22:28:47.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.689+0000 7fc1abfff700 1 -- 172.21.15.40:0/1580243937 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc1b4004030 con 0x7fc1c409c890 2023-09-30T22:28:47.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.689+0000 7fc1abfff700 1 -- 172.21.15.40:0/1580243937 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc1b403fc90 con 0x7fc1c409c890 2023-09-30T22:28:47.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.689+0000 7fc1c9e21700 1 -- 172.21.15.40:0/1580243937 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1c4062380 con 0x7fc1c409c890 2023-09-30T22:28:47.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.696+0000 7fc1abfff700 1 -- 172.21.15.40:0/1580243937 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc1b40036a0 con 0x7fc1c409c890 2023-09-30T22:28:47.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.767+0000 7fadcbb3c700 1 Processor -- start 2023-09-30T22:28:47.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.768+0000 7fadcbb3c700 1 -- start start 2023-09-30T22:28:47.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.768+0000 7fadcbb3c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadc409d860 0x7fadc409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.768+0000 7fadcbb3c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadc4133730 0x7fadc4133b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.768+0000 7fadcbb3c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc409ac00 con 0x7fadc41340c0 2023-09-30T22:28:47.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.768+0000 7fadcbb3c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc409f350 con 0x7fadc409d860 2023-09-30T22:28:47.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.768+0000 7fadcbb3c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fadc409a660 con 0x7fadc4133730 2023-09-30T22:28:47.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.768+0000 7fadca0d9700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fadc41340c0 0x7fadc413aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55820/0 (socket says 172.21.15.40:55820) 2023-09-30T22:28:47.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.768+0000 7fadca0d9700 1 -- 172.21.15.40:0/2993597277 learned_addr learned my addr 172.21.15.40:0/2993597277 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:47.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.768+0000 7fadc90d7700 1 --2- 172.21.15.40:0/2993597277 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadc4133730 0x7fadc4133b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.768+0000 7fadc98d8700 1 --2- 172.21.15.40:0/2993597277 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadc409d860 0x7fadc409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.769+0000 7fadc88d6700 1 -- 172.21.15.40:0/2993597277 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 510543603 0 0) 0x7fadc409ac00 con 0x7fadc41340c0 2023-09-30T22:28:47.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.769+0000 7fadc88d6700 1 -- 172.21.15.40:0/2993597277 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadb00035b0 con 0x7fadc41340c0 2023-09-30T22:28:47.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.769+0000 7fadc90d7700 1 -- 172.21.15.40:0/2993597277 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadc409d860 msgr2=0x7fadc409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:47.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.769+0000 7fadc90d7700 1 --2- 172.21.15.40:0/2993597277 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadc409d860 0x7fadc409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.769+0000 7fadc90d7700 1 -- 172.21.15.40:0/2993597277 >> v1:172.21.15.40:6789/0 conn(0x7fadc41340c0 legacy=0x7fadc413aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:47.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.769+0000 7fadc90d7700 1 -- 172.21.15.40:0/2993597277 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc4134530 con 0x7fadc4133730 2023-09-30T22:28:47.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.769+0000 7fadc98d8700 1 --2- 172.21.15.40:0/2993597277 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadc409d860 0x7fadc409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:47.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.769+0000 7fadc90d7700 1 --2- 172.21.15.40:0/2993597277 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadc4133730 0x7fadc4133b80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fadb4009870 tx=0x7fadb4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7914a6a6917d25d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:47.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.769+0000 7fadc88d6700 1 -- 172.21.15.40:0/2993597277 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb4011830 con 0x7fadc4133730 2023-09-30T22:28:47.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.769+0000 7fadc88d6700 1 -- 172.21.15.40:0/2993597277 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb4011990 con 0x7fadc4133730 2023-09-30T22:28:47.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.769+0000 7fadc88d6700 1 -- 172.21.15.40:0/2993597277 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb4011d20 con 0x7fadc4133730 2023-09-30T22:28:47.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.770+0000 7fadcbb3c700 1 -- 172.21.15.40:0/2993597277 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadc4133730 msgr2=0x7fadc4133b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:47.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.770+0000 7fadcbb3c700 1 --2- 172.21.15.40:0/2993597277 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadc4133730 0x7fadc4133b80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fadb4009870 tx=0x7fadb4009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:47.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.770+0000 7fadcbb3c700 1 -- 172.21.15.40:0/2993597277 shutdown_connections 2023-09-30T22:28:47.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.770+0000 7fadcbb3c700 1 --2- 172.21.15.40:0/2993597277 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadc409d860 0x7fadc409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.770+0000 7fadcbb3c700 1 --2- 172.21.15.40:0/2993597277 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadc4133730 0x7fadc4133b80 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.770+0000 7fadcbb3c700 1 -- 172.21.15.40:0/2993597277 >> 172.21.15.40:0/2993597277 conn(0x7fadc406a6d0 msgr2=0x7fadc406aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:47.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.770+0000 7fadcbb3c700 1 -- 172.21.15.40:0/2993597277 shutdown_connections 2023-09-30T22:28:47.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.770+0000 7fadcbb3c700 1 -- 172.21.15.40:0/2993597277 wait complete. 2023-09-30T22:28:47.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.771+0000 7fadcbb3c700 1 Processor -- start 2023-09-30T22:28:47.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.771+0000 7fadcbb3c700 1 -- start start 2023-09-30T22:28:47.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.771+0000 7fadcbb3c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadc409d860 0x7fadc411b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.771+0000 7fadcbb3c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadc4133730 0x7fadc411be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.771+0000 7fadcbb3c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadc41340c0 0x7fadc411c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.771+0000 7fadcbb3c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc411f190 con 0x7fadc41340c0 2023-09-30T22:28:47.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.771+0000 7fadcbb3c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc40a0db0 con 0x7fadc4133730 2023-09-30T22:28:47.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.771+0000 7fadcbb3c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fadc411d670 con 0x7fadc409d860 2023-09-30T22:28:47.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.772+0000 7fadc90d7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadc4133730 0x7fadc411be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.772+0000 7fadc90d7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadc4133730 0x7fadc411be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:43292/0 (socket says 172.21.15.40:43292) 2023-09-30T22:28:47.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.772+0000 7fadc90d7700 1 -- 172.21.15.40:0/3742941953 learned_addr learned my addr 172.21.15.40:0/3742941953 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:47.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.772+0000 7fadc98d8700 1 --2- 172.21.15.40:0/3742941953 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadc409d860 0x7fadc411b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.772+0000 7fadca0d9700 1 --2- 172.21.15.40:0/3742941953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadc41340c0 0x7fadc411c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.772+0000 7fadc90d7700 1 -- 172.21.15.40:0/3742941953 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadc409d860 msgr2=0x7fadc411b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:47.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.772+0000 7fadc90d7700 1 --2- 172.21.15.40:0/3742941953 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadc409d860 0x7fadc411b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.772+0000 7fadc90d7700 1 -- 172.21.15.40:0/3742941953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadc41340c0 msgr2=0x7fadc411c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:47.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.772+0000 7fadc90d7700 1 --2- 172.21.15.40:0/3742941953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadc41340c0 0x7fadc411c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.772+0000 7fadc90d7700 1 -- 172.21.15.40:0/3742941953 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc00094a0 con 0x7fadc4133730 2023-09-30T22:28:47.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.772+0000 7fadc98d8700 1 --2- 172.21.15.40:0/3742941953 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadc409d860 0x7fadc411b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:47.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.772+0000 7fadc90d7700 1 --2- 172.21.15.40:0/3742941953 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadc4133730 0x7fadc411be90 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fadb40090b0 tx=0x7fadb4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:47.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.772+0000 7fadba7fc700 1 -- 172.21.15.40:0/3742941953 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb4004510 con 0x7fadc4133730 2023-09-30T22:28:47.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.772+0000 7fadba7fc700 1 -- 172.21.15.40:0/3742941953 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb401f070 con 0x7fadc4133730 2023-09-30T22:28:47.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.772+0000 7fadcbb3c700 1 -- 172.21.15.40:0/3742941953 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadb40094a0 con 0x7fadc4133730 2023-09-30T22:28:47.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.772+0000 7fadba7fc700 1 -- 172.21.15.40:0/3742941953 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb40038e0 con 0x7fadc4133730 2023-09-30T22:28:47.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.772+0000 7fadcbb3c700 1 -- 172.21.15.40:0/3742941953 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc411e7b0 con 0x7fadc4133730 2023-09-30T22:28:47.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.773+0000 7fadba7fc700 1 -- 172.21.15.40:0/3742941953 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fadb4003a40 con 0x7fadc4133730 2023-09-30T22:28:47.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.773+0000 7fadba7fc700 1 -- 172.21.15.40:0/3742941953 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fadb4021070 con 0x7fadc4133730 2023-09-30T22:28:47.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.773+0000 7fadcbb3c700 1 -- 172.21.15.40:0/3742941953 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc4132dd0 con 0x7fadc4133730 2023-09-30T22:28:47.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.778+0000 7fadba7fc700 1 -- 172.21.15.40:0/3742941953 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fadb401a430 con 0x7fadc4133730 2023-09-30T22:28:47.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.808+0000 7f9a4e6f9700 1 Processor -- start 2023-09-30T22:28:47.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.808+0000 7f9a4e6f9700 1 -- start start 2023-09-30T22:28:47.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.808+0000 7f9a4e6f9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9a4809c890 0x7f9a4809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.808+0000 7f9a4e6f9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a4809d920 0x7f9a4809dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.808+0000 7f9a4e6f9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9a4809e2b0 0x7f9a4813ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.808+0000 7f9a4e6f9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a480a29d0 con 0x7f9a4809e2b0 2023-09-30T22:28:47.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.808+0000 7f9a4e6f9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4809fb40 con 0x7f9a4809d920 2023-09-30T22:28:47.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.808+0000 7f9a4e6f9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a480a2600 con 0x7f9a4809c890 2023-09-30T22:28:47.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.809+0000 7f9a47fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9a4809c890 0x7f9a4809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.809+0000 7f9a4cc96700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9a4809e2b0 0x7f9a4813ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.809+0000 7f9a47fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9a4809c890 0x7f9a4809cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:44352/0 (socket says 172.21.15.40:44352) 2023-09-30T22:28:47.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.809+0000 7f9a477fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a4809d920 0x7f9a4809dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.809+0000 7f9a47fff700 1 -- 172.21.15.40:0/1728922515 learned_addr learned my addr 172.21.15.40:0/1728922515 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:47.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.809+0000 7f9a4cc96700 1 -- 172.21.15.40:0/1728922515 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9a4809c890 msgr2=0x7f9a4809cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:47.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.809+0000 7f9a4cc96700 1 --2- 172.21.15.40:0/1728922515 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9a4809c890 0x7f9a4809cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.809+0000 7f9a4cc96700 1 -- 172.21.15.40:0/1728922515 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a4809d920 msgr2=0x7f9a4809dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:47.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.809+0000 7f9a4cc96700 1 --2- 172.21.15.40:0/1728922515 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a4809d920 0x7f9a4809dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.809+0000 7f9a4cc96700 1 -- 172.21.15.40:0/1728922515 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a4809e720 con 0x7f9a4809e2b0 2023-09-30T22:28:47.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.809+0000 7f9a47fff700 1 --2- 172.21.15.40:0/1728922515 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9a4809c890 0x7f9a4809cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:47.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.809+0000 7f9a4cc96700 1 --2- 172.21.15.40:0/1728922515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a4809e2b0 0x7f9a4813ac10 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f9a40009dc0 tx=0x7f9a4000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7040cbc91b047e7d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:47.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.809+0000 7f9a46ffd700 1 -- 172.21.15.40:0/1728922515 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4000e070 con 0x7f9a4809e2b0 2023-09-30T22:28:47.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.809+0000 7f9a46ffd700 1 -- 172.21.15.40:0/1728922515 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4000bae0 con 0x7f9a4809e2b0 2023-09-30T22:28:47.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.809+0000 7f9a46ffd700 1 -- 172.21.15.40:0/1728922515 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4000be90 con 0x7f9a4809e2b0 2023-09-30T22:28:47.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.810+0000 7f9a4e6f9700 1 -- 172.21.15.40:0/1728922515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a4809e2b0 msgr2=0x7f9a4813ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:47.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.810+0000 7f9a4e6f9700 1 --2- 172.21.15.40:0/1728922515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a4809e2b0 0x7f9a4813ac10 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f9a40009dc0 tx=0x7f9a4000b330 comp rx=0 tx=0).stop 2023-09-30T22:28:47.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.810+0000 7f9a4e6f9700 1 -- 172.21.15.40:0/1728922515 shutdown_connections 2023-09-30T22:28:47.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.810+0000 7f9a4e6f9700 1 --2- 172.21.15.40:0/1728922515 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9a4809c890 0x7f9a4809cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.810+0000 7f9a4e6f9700 1 --2- 172.21.15.40:0/1728922515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a4809e2b0 0x7f9a4813ac10 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.810+0000 7f9a4e6f9700 1 --2- 172.21.15.40:0/1728922515 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a4809d920 0x7f9a4809dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.810+0000 7f9a4e6f9700 1 -- 172.21.15.40:0/1728922515 >> 172.21.15.40:0/1728922515 conn(0x7f9a480a7080 msgr2=0x7f9a480a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:47.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.810+0000 7f9a4e6f9700 1 -- 172.21.15.40:0/1728922515 shutdown_connections 2023-09-30T22:28:47.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.810+0000 7f9a4e6f9700 1 -- 172.21.15.40:0/1728922515 wait complete. 2023-09-30T22:28:47.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.811+0000 7f9a4e6f9700 1 Processor -- start 2023-09-30T22:28:47.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.812+0000 7f9a4e6f9700 1 -- start start 2023-09-30T22:28:47.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.812+0000 7f9a4e6f9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a4809c890 0x7f9a4812b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.812+0000 7f9a4e6f9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9a4809d920 0x7f9a4812ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.812+0000 7f9a4e6f9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a4809e2b0 0x7f9a4812bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.812+0000 7f9a4e6f9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4812caf0 con 0x7f9a4809c890 2023-09-30T22:28:47.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.812+0000 7f9a4e6f9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4812d1e0 con 0x7f9a4809e2b0 2023-09-30T22:28:47.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.812+0000 7f9a4e6f9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4809ecf0 con 0x7f9a4809d920 2023-09-30T22:28:47.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.812+0000 7f9a477fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9a4809d920 0x7f9a4812ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.812+0000 7f9a477fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9a4809d920 0x7f9a4812ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:44368/0 (socket says 172.21.15.40:44368) 2023-09-30T22:28:47.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.812+0000 7f9a477fe700 1 -- 172.21.15.40:0/1519527043 learned_addr learned my addr 172.21.15.40:0/1519527043 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:47.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.812+0000 7f9a47fff700 1 --2- 172.21.15.40:0/1519527043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a4809c890 0x7f9a4812b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.812+0000 7f9a4cc96700 1 --2- 172.21.15.40:0/1519527043 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a4809e2b0 0x7f9a4812bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.813+0000 7f9a47fff700 1 -- 172.21.15.40:0/1519527043 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9a4809d920 msgr2=0x7f9a4812ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:47.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.813+0000 7f9a47fff700 1 --2- 172.21.15.40:0/1519527043 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9a4809d920 0x7f9a4812ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.813+0000 7f9a47fff700 1 -- 172.21.15.40:0/1519527043 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a4809e2b0 msgr2=0x7f9a4812bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:47.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.813+0000 7f9a47fff700 1 --2- 172.21.15.40:0/1519527043 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a4809e2b0 0x7f9a4812bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.813+0000 7f9a47fff700 1 -- 172.21.15.40:0/1519527043 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a38009500 con 0x7f9a4809c890 2023-09-30T22:28:47.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.813+0000 7f9a4cc96700 1 --2- 172.21.15.40:0/1519527043 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a4809e2b0 0x7f9a4812bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:47.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.813+0000 7f9a47fff700 1 --2- 172.21.15.40:0/1519527043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a4809c890 0x7f9a4812b4e0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f9a3800ebb0 tx=0x7f9a3800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:47.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.813+0000 7f9a44ff9700 1 -- 172.21.15.40:0/1519527043 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a38009780 con 0x7f9a4809c890 2023-09-30T22:28:47.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.813+0000 7f9a44ff9700 1 -- 172.21.15.40:0/1519527043 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a38005a20 con 0x7f9a4809c890 2023-09-30T22:28:47.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.813+0000 7f9a4e6f9700 1 -- 172.21.15.40:0/1519527043 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a40009a70 con 0x7f9a4809c890 2023-09-30T22:28:47.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.813+0000 7f9a44ff9700 1 -- 172.21.15.40:0/1519527043 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a38005db0 con 0x7f9a4809c890 2023-09-30T22:28:47.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.813+0000 7f9a4e6f9700 1 -- 172.21.15.40:0/1519527043 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a4812e350 con 0x7f9a4809c890 2023-09-30T22:28:47.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.814+0000 7f9a44ff9700 1 -- 172.21.15.40:0/1519527043 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9a3800c850 con 0x7f9a4809c890 2023-09-30T22:28:47.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.814+0000 7f9a4e6f9700 1 -- 172.21.15.40:0/1519527043 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a4806e600 con 0x7f9a4809c890 2023-09-30T22:28:47.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.815+0000 7f9a44ff9700 1 -- 172.21.15.40:0/1519527043 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9a3803f960 con 0x7f9a4809c890 2023-09-30T22:28:47.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.819+0000 7f9a44ff9700 1 -- 172.21.15.40:0/1519527043 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9a38006030 con 0x7f9a4809c890 2023-09-30T22:28:47.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.896+0000 7fc1c9e21700 1 -- 172.21.15.40:0/1580243937 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc1c4074620 con 0x7fc1c409c890 2023-09-30T22:28:47.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.897+0000 7fc1abfff700 1 -- 172.21.15.40:0/1580243937 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc1b4023350 con 0x7fc1c409c890 2023-09-30T22:28:47.897 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:47.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.899+0000 7fc1c9e21700 1 -- 172.21.15.40:0/1580243937 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc1c409c890 msgr2=0x7fc1c412d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:47.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.899+0000 7fc1c9e21700 1 --2- 172.21.15.40:0/1580243937 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc1c409c890 0x7fc1c412d350 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc1b400e930 tx=0x7fc1b400ec40 comp rx=0 tx=0).stop 2023-09-30T22:28:47.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.899+0000 7fc1c9e21700 1 -- 172.21.15.40:0/1580243937 shutdown_connections 2023-09-30T22:28:47.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.899+0000 7fc1c9e21700 1 --2- 172.21.15.40:0/1580243937 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc1c409c890 0x7fc1c412d350 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.899+0000 7fc1c9e21700 1 --2- 172.21.15.40:0/1580243937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1c409e2b0 0x7fc1c412ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.899+0000 7fc1c9e21700 1 --2- 172.21.15.40:0/1580243937 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1c409d920 0x7fc1c412d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.899+0000 7fc1c9e21700 1 -- 172.21.15.40:0/1580243937 >> 172.21.15.40:0/1580243937 conn(0x7fc1c40a7080 msgr2=0x7fc1c40a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:47.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.899+0000 7fc1c9e21700 1 -- 172.21.15.40:0/1580243937 shutdown_connections 2023-09-30T22:28:47.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.899+0000 7fc1c9e21700 1 -- 172.21.15.40:0/1580243937 wait complete. 2023-09-30T22:28:47.912 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:47.972 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:47.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.976+0000 7fadcbb3c700 1 -- 172.21.15.40:0/3742941953 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fadc4062380 con 0x7fadc4133730 2023-09-30T22:28:47.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.977+0000 7fadba7fc700 1 -- 172.21.15.40:0/3742941953 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fadb4015030 con 0x7fadc4133730 2023-09-30T22:28:47.977 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:47.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.979+0000 7fadcbb3c700 1 -- 172.21.15.40:0/3742941953 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadc4133730 msgr2=0x7fadc411be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:47.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.979+0000 7fadcbb3c700 1 --2- 172.21.15.40:0/3742941953 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadc4133730 0x7fadc411be90 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fadb40090b0 tx=0x7fadb4004750 comp rx=0 tx=0).stop 2023-09-30T22:28:47.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.979+0000 7fadcbb3c700 1 -- 172.21.15.40:0/3742941953 shutdown_connections 2023-09-30T22:28:47.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.979+0000 7fadcbb3c700 1 --2- 172.21.15.40:0/3742941953 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadc409d860 0x7fadc411b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.979+0000 7fadcbb3c700 1 --2- 172.21.15.40:0/3742941953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadc41340c0 0x7fadc411c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.979+0000 7fadcbb3c700 1 --2- 172.21.15.40:0/3742941953 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadc4133730 0x7fadc411be90 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.979+0000 7fadcbb3c700 1 -- 172.21.15.40:0/3742941953 >> 172.21.15.40:0/3742941953 conn(0x7fadc406a6d0 msgr2=0x7fadc4130a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:47.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.979+0000 7fadcbb3c700 1 -- 172.21.15.40:0/3742941953 shutdown_connections 2023-09-30T22:28:47.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:47.979+0000 7fadcbb3c700 1 -- 172.21.15.40:0/3742941953 wait complete. 2023-09-30T22:28:47.992 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:48.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.019+0000 7f9a4e6f9700 1 -- 172.21.15.40:0/1519527043 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9a4812e510 con 0x7f9a4809c890 2023-09-30T22:28:48.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.020+0000 7f9a44ff9700 1 -- 172.21.15.40:0/1519527043 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9a38020020 con 0x7f9a4809c890 2023-09-30T22:28:48.021 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:48.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.023+0000 7f9a4e6f9700 1 -- 172.21.15.40:0/1519527043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a4809c890 msgr2=0x7f9a4812b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:48.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.023+0000 7f9a4e6f9700 1 --2- 172.21.15.40:0/1519527043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a4809c890 0x7f9a4812b4e0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f9a3800ebb0 tx=0x7f9a3800eec0 comp rx=0 tx=0).stop 2023-09-30T22:28:48.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.023+0000 7f9a4e6f9700 1 -- 172.21.15.40:0/1519527043 shutdown_connections 2023-09-30T22:28:48.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.023+0000 7f9a4e6f9700 1 --2- 172.21.15.40:0/1519527043 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9a4809e2b0 0x7f9a4812bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:48.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.023+0000 7f9a4e6f9700 1 --2- 172.21.15.40:0/1519527043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a4809c890 0x7f9a4812b4e0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:48.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.023+0000 7f9a4e6f9700 1 --2- 172.21.15.40:0/1519527043 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9a4809d920 0x7f9a4812ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:48.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.023+0000 7f9a4e6f9700 1 -- 172.21.15.40:0/1519527043 >> 172.21.15.40:0/1519527043 conn(0x7f9a480a7080 msgr2=0x7f9a481baff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:48.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.023+0000 7f9a4e6f9700 1 -- 172.21.15.40:0/1519527043 shutdown_connections 2023-09-30T22:28:48.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.023+0000 7f9a4e6f9700 1 -- 172.21.15.40:0/1519527043 wait complete. 2023-09-30T22:28:48.035 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:48.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.100+0000 7f77ebf93700 1 Processor -- start 2023-09-30T22:28:48.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.100+0000 7f77ebf93700 1 -- start start 2023-09-30T22:28:48.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.102+0000 7f77ebf93700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f77e4133e00 0x7f77e41341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:48.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.102+0000 7f77ebf93700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f77e409df70 0x7f77e413bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:48.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.102+0000 7f77ebf93700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77e4133940 con 0x7f77e409d400 2023-09-30T22:28:48.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.102+0000 7f77ebf93700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e409ab20 con 0x7f77e4133e00 2023-09-30T22:28:48.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.102+0000 7f77ebf93700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77e409f0d0 con 0x7f77e409df70 2023-09-30T22:28:48.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.102+0000 7f77e9d2f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f77e4133e00 0x7f77e41341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:48.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.102+0000 7f77ea530700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f77e409df70 0x7f77e413bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:48.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.102+0000 7f77e9d2f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f77e4133e00 0x7f77e41341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35694/0 (socket says 172.21.15.40:35694) 2023-09-30T22:28:48.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.102+0000 7f77ea530700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f77e409df70 0x7f77e413bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:44382/0 (socket says 172.21.15.40:44382) 2023-09-30T22:28:48.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.102+0000 7f77e9d2f700 1 -- 172.21.15.40:0/2157540949 learned_addr learned my addr 172.21.15.40:0/2157540949 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:48.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.102+0000 7f77e952e700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f77e409d400 0x7f77e409d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55832/0 (socket says 172.21.15.40:55832) 2023-09-30T22:28:48.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.102+0000 7f77ea530700 1 -- 172.21.15.40:0/2157540949 >> v2:172.21.15.40:3300/0 conn(0x7f77e4133e00 msgr2=0x7f77e41341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:48.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.102+0000 7f77ea530700 1 --2- 172.21.15.40:0/2157540949 >> v2:172.21.15.40:3300/0 conn(0x7f77e4133e00 0x7f77e41341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:48.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.102+0000 7f77ea530700 1 -- 172.21.15.40:0/2157540949 >> v1:172.21.15.40:6789/0 conn(0x7f77e409d400 legacy=0x7f77e409d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:48.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.102+0000 7f77ea530700 1 -- 172.21.15.40:0/2157540949 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e4133be0 con 0x7f77e409df70 2023-09-30T22:28:48.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.102+0000 7f77e9d2f700 1 --2- 172.21.15.40:0/2157540949 >> v2:172.21.15.40:3300/0 conn(0x7f77e4133e00 0x7f77e41341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:48.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.102+0000 7f77ea530700 1 --2- 172.21.15.40:0/2157540949 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f77e409df70 0x7f77e413bc80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f77dc009d90 tx=0x7f77dc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72410ef55177b0e8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:48.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.102+0000 7f77e8d2d700 1 -- 172.21.15.40:0/2157540949 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc00e070 con 0x7f77e409df70 2023-09-30T22:28:48.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.102+0000 7f77e8d2d700 1 -- 172.21.15.40:0/2157540949 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77dc00bb20 con 0x7f77e409df70 2023-09-30T22:28:48.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.102+0000 7f77e8d2d700 1 -- 172.21.15.40:0/2157540949 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc012430 con 0x7f77e409df70 2023-09-30T22:28:48.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.102+0000 7f77ebf93700 1 -- 172.21.15.40:0/2157540949 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f77e409df70 msgr2=0x7f77e413bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:48.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.102+0000 7f77ebf93700 1 --2- 172.21.15.40:0/2157540949 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f77e409df70 0x7f77e413bc80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f77dc009d90 tx=0x7f77dc00b330 comp rx=0 tx=0).stop 2023-09-30T22:28:48.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.102+0000 7f77ebf93700 1 -- 172.21.15.40:0/2157540949 shutdown_connections 2023-09-30T22:28:48.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.102+0000 7f77ebf93700 1 --2- 172.21.15.40:0/2157540949 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f77e409df70 0x7f77e413bc80 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:48.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.102+0000 7f77ebf93700 1 --2- 172.21.15.40:0/2157540949 >> v2:172.21.15.40:3300/0 conn(0x7f77e4133e00 0x7f77e41341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:48.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.102+0000 7f77ebf93700 1 -- 172.21.15.40:0/2157540949 >> 172.21.15.40:0/2157540949 conn(0x7f77e40a2a00 msgr2=0x7f77e40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:48.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.102+0000 7f77ebf93700 1 -- 172.21.15.40:0/2157540949 shutdown_connections 2023-09-30T22:28:48.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.102+0000 7f77ebf93700 1 -- 172.21.15.40:0/2157540949 wait complete. 2023-09-30T22:28:48.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.103+0000 7f77ebf93700 1 Processor -- start 2023-09-30T22:28:48.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.103+0000 7f77ebf93700 1 -- start start 2023-09-30T22:28:48.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.103+0000 7f77ebf93700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77e409d400 0x7f77e4119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:48.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.103+0000 7f77ebf93700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f77e409df70 0x7f77e4119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:48.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.103+0000 7f77ebf93700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77e4133e00 0x7f77e4119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:48.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.103+0000 7f77ebf93700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e411c100 con 0x7f77e409d400 2023-09-30T22:28:48.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.103+0000 7f77ebf93700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e412c000 con 0x7f77e4133e00 2023-09-30T22:28:48.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.103+0000 7f77ebf93700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77e411a420 con 0x7f77e409df70 2023-09-30T22:28:48.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.103+0000 7f77e952e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f77e409df70 0x7f77e4119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:48.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.105+0000 7f77e952e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f77e409df70 0x7f77e4119590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:44384/0 (socket says 172.21.15.40:44384) 2023-09-30T22:28:48.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.105+0000 7f77e952e700 1 -- 172.21.15.40:0/1254222627 learned_addr learned my addr 172.21.15.40:0/1254222627 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:48.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.105+0000 7f77e9d2f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77e409d400 0x7f77e4119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:48.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.105+0000 7f77ea530700 1 --2- 172.21.15.40:0/1254222627 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77e4133e00 0x7f77e4119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:48.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.105+0000 7f77e9d2f700 1 -- 172.21.15.40:0/1254222627 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f77e409df70 msgr2=0x7f77e4119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:48.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.105+0000 7f77e9d2f700 1 --2- 172.21.15.40:0/1254222627 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f77e409df70 0x7f77e4119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:48.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.105+0000 7f77e9d2f700 1 -- 172.21.15.40:0/1254222627 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77e4133e00 msgr2=0x7f77e4119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:48.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.105+0000 7f77e9d2f700 1 --2- 172.21.15.40:0/1254222627 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77e4133e00 0x7f77e4119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:48.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.105+0000 7f77e9d2f700 1 -- 172.21.15.40:0/1254222627 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d8009550 con 0x7f77e409d400 2023-09-30T22:28:48.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.105+0000 7f77e952e700 1 --2- 172.21.15.40:0/1254222627 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f77e409df70 0x7f77e4119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:48.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.105+0000 7f77e9d2f700 1 --2- 172.21.15.40:0/1254222627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77e409d400 0x7f77e4119050 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f77d800e9a0 tx=0x7f77d800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:48.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.105+0000 7f77d67fc700 1 -- 172.21.15.40:0/1254222627 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d8004030 con 0x7f77e409d400 2023-09-30T22:28:48.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.105+0000 7f77d67fc700 1 -- 172.21.15.40:0/1254222627 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d8004190 con 0x7f77e409d400 2023-09-30T22:28:48.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.105+0000 7f77ebf93700 1 -- 172.21.15.40:0/1254222627 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77dc009a70 con 0x7f77e409d400 2023-09-30T22:28:48.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.105+0000 7f77d67fc700 1 -- 172.21.15.40:0/1254222627 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d8004520 con 0x7f77e409d400 2023-09-30T22:28:48.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.105+0000 7f77ebf93700 1 -- 172.21.15.40:0/1254222627 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e409ff80 con 0x7f77e409d400 2023-09-30T22:28:48.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.106+0000 7f77d67fc700 1 -- 172.21.15.40:0/1254222627 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f77d800c850 con 0x7f77e409d400 2023-09-30T22:28:48.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.106+0000 7f77d67fc700 1 -- 172.21.15.40:0/1254222627 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f77d803f5a0 con 0x7f77e409d400 2023-09-30T22:28:48.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.106+0000 7f77ebf93700 1 -- 172.21.15.40:0/1254222627 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e411abf0 con 0x7f77e409d400 2023-09-30T22:28:48.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.111+0000 7f77d67fc700 1 -- 172.21.15.40:0/1254222627 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f77d80036a0 con 0x7f77e409d400 2023-09-30T22:28:48.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.306+0000 7f77ebf93700 1 -- 172.21.15.40:0/1254222627 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f77e4062380 con 0x7f77e409d400 2023-09-30T22:28:48.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.306+0000 7f77d67fc700 1 -- 172.21.15.40:0/1254222627 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f77d8020030 con 0x7f77e409d400 2023-09-30T22:28:48.306 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:48.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.308+0000 7f77ebf93700 1 -- 172.21.15.40:0/1254222627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77e409d400 msgr2=0x7f77e4119050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:48.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.308+0000 7f77ebf93700 1 --2- 172.21.15.40:0/1254222627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77e409d400 0x7f77e4119050 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f77d800e9a0 tx=0x7f77d800ecb0 comp rx=0 tx=0).stop 2023-09-30T22:28:48.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.308+0000 7f77ebf93700 1 -- 172.21.15.40:0/1254222627 shutdown_connections 2023-09-30T22:28:48.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.308+0000 7f77ebf93700 1 --2- 172.21.15.40:0/1254222627 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77e4133e00 0x7f77e4119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:48.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.308+0000 7f77ebf93700 1 --2- 172.21.15.40:0/1254222627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77e409d400 0x7f77e4119050 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:48.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.308+0000 7f77ebf93700 1 --2- 172.21.15.40:0/1254222627 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f77e409df70 0x7f77e4119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:48.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.308+0000 7f77ebf93700 1 -- 172.21.15.40:0/1254222627 >> 172.21.15.40:0/1254222627 conn(0x7f77e40a2a00 msgr2=0x7f77e412d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:48.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.308+0000 7f77ebf93700 1 -- 172.21.15.40:0/1254222627 shutdown_connections 2023-09-30T22:28:48.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:48.308+0000 7f77ebf93700 1 -- 172.21.15.40:0/1254222627 wait complete. 2023-09-30T22:28:48.320 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:48.913 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:48.994 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:49.036 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:49.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.055+0000 7f10ce061700 1 Processor -- start 2023-09-30T22:28:49.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.055+0000 7f10ce061700 1 -- start start 2023-09-30T22:28:49.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.056+0000 7f10ce061700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10c809e400 0x7f10c8135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:49.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.056+0000 7f10ce061700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f10c8136230 0x7f10c8138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:49.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.056+0000 7f10ce061700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10c809adf0 con 0x7f10c809d920 2023-09-30T22:28:49.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.056+0000 7f10ce061700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10c809e7f0 con 0x7f10c8136230 2023-09-30T22:28:49.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.056+0000 7f10ce061700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10c809edf0 con 0x7f10c809e400 2023-09-30T22:28:49.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.056+0000 7f10c77fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f10c809d920 0x7f10c809dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55834/0 (socket says 172.21.15.40:55834) 2023-09-30T22:28:49.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.056+0000 7f10c7fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f10c8136230 0x7f10c8138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:49.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.056+0000 7f10c77fe700 1 -- 172.21.15.40:0/1548599397 learned_addr learned my addr 172.21.15.40:0/1548599397 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:49.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.056+0000 7f10c6ffd700 1 --2- 172.21.15.40:0/1548599397 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10c809e400 0x7f10c8135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:49.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.056+0000 7f10c7fff700 1 -- 172.21.15.40:0/1548599397 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10c809e400 msgr2=0x7f10c8135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:49.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.056+0000 7f10c7fff700 1 --2- 172.21.15.40:0/1548599397 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10c809e400 0x7f10c8135cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.056+0000 7f10c7fff700 1 -- 172.21.15.40:0/1548599397 >> v1:172.21.15.40:6789/0 conn(0x7f10c809d920 legacy=0x7f10c809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:49.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.056+0000 7f10c7fff700 1 -- 172.21.15.40:0/1548599397 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c809b660 con 0x7f10c8136230 2023-09-30T22:28:49.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.056+0000 7f10c67fc700 1 -- 172.21.15.40:0/1548599397 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 971512288 0 0) 0x7f10c809adf0 con 0x7f10c809d920 2023-09-30T22:28:49.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.056+0000 7f10c6ffd700 1 --2- 172.21.15.40:0/1548599397 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10c809e400 0x7f10c8135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:49.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.057+0000 7f10c7fff700 1 --2- 172.21.15.40:0/1548599397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10c8136230 0x7f10c8138610 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f10c0009d90 tx=0x7f10c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67f008a9e00c61a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:49.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.057+0000 7f10c67fc700 1 -- 172.21.15.40:0/1548599397 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c000e070 con 0x7f10c8136230 2023-09-30T22:28:49.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.057+0000 7f10c67fc700 1 -- 172.21.15.40:0/1548599397 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c000bb20 con 0x7f10c8136230 2023-09-30T22:28:49.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.057+0000 7f10c67fc700 1 -- 172.21.15.40:0/1548599397 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c0012430 con 0x7f10c8136230 2023-09-30T22:28:49.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.057+0000 7f10ce061700 1 -- 172.21.15.40:0/1548599397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10c8136230 msgr2=0x7f10c8138610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:49.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.057+0000 7f10ce061700 1 --2- 172.21.15.40:0/1548599397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10c8136230 0x7f10c8138610 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f10c0009d90 tx=0x7f10c000b330 comp rx=0 tx=0).stop 2023-09-30T22:28:49.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.057+0000 7f10ce061700 1 -- 172.21.15.40:0/1548599397 shutdown_connections 2023-09-30T22:28:49.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.057+0000 7f10ce061700 1 --2- 172.21.15.40:0/1548599397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10c8136230 0x7f10c8138610 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.058+0000 7f10ce061700 1 --2- 172.21.15.40:0/1548599397 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10c809e400 0x7f10c8135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.058+0000 7f10ce061700 1 -- 172.21.15.40:0/1548599397 >> 172.21.15.40:0/1548599397 conn(0x7f10c809fb20 msgr2=0x7f10c809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:49.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.058+0000 7f10ce061700 1 -- 172.21.15.40:0/1548599397 shutdown_connections 2023-09-30T22:28:49.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.058+0000 7f10ce061700 1 -- 172.21.15.40:0/1548599397 wait complete. 2023-09-30T22:28:49.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.059+0000 7f10ce061700 1 Processor -- start 2023-09-30T22:28:49.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.059+0000 7f10ce061700 1 -- start start 2023-09-30T22:28:49.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.060+0000 7f10ce061700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10c809d920 0x7f10c8122980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:49.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.060+0000 7f10ce061700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10c809e400 0x7f10c8122ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:49.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.060+0000 7f10ce061700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10c8136230 0x7f10c8123400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:49.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.060+0000 7f10ce061700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c81263a0 con 0x7f10c8136230 2023-09-30T22:28:49.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.060+0000 7f10ce061700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c8125e00 con 0x7f10c809d920 2023-09-30T22:28:49.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.060+0000 7f10ce061700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10c8124490 con 0x7f10c809e400 2023-09-30T22:28:49.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.060+0000 7f10c6ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10c809e400 0x7f10c8122ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:49.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.060+0000 7f10c6ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10c809e400 0x7f10c8122ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:44392/0 (socket says 172.21.15.40:44392) 2023-09-30T22:28:49.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.060+0000 7f10c6ffd700 1 -- 172.21.15.40:0/3449572856 learned_addr learned my addr 172.21.15.40:0/3449572856 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:49.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.060+0000 7f10c7fff700 1 --2- 172.21.15.40:0/3449572856 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10c8136230 0x7f10c8123400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:49.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.060+0000 7f10c77fe700 1 --2- 172.21.15.40:0/3449572856 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10c809d920 0x7f10c8122980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:49.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.060+0000 7f10c6ffd700 1 -- 172.21.15.40:0/3449572856 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10c809d920 msgr2=0x7f10c8122980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:49.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.060+0000 7f10c6ffd700 1 --2- 172.21.15.40:0/3449572856 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10c809d920 0x7f10c8122980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.060+0000 7f10c6ffd700 1 -- 172.21.15.40:0/3449572856 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10c8136230 msgr2=0x7f10c8123400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:49.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.060+0000 7f10c6ffd700 1 --2- 172.21.15.40:0/3449572856 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10c8136230 0x7f10c8123400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.060+0000 7f10c6ffd700 1 -- 172.21.15.40:0/3449572856 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10bc00b740 con 0x7f10c809e400 2023-09-30T22:28:49.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.061+0000 7f10c6ffd700 1 --2- 172.21.15.40:0/3449572856 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10c809e400 0x7f10c8122ec0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f10bc00ed40 tx=0x7f10bc00d630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:49.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.061+0000 7f10affff700 1 -- 172.21.15.40:0/3449572856 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc00dd90 con 0x7f10c809e400 2023-09-30T22:28:49.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.061+0000 7f10affff700 1 -- 172.21.15.40:0/3449572856 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10bc010440 con 0x7f10c809e400 2023-09-30T22:28:49.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.061+0000 7f10affff700 1 -- 172.21.15.40:0/3449572856 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc0107b0 con 0x7f10c809e400 2023-09-30T22:28:49.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.061+0000 7f10ce061700 1 -- 172.21.15.40:0/3449572856 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10c0009a70 con 0x7f10c809e400 2023-09-30T22:28:49.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.061+0000 7f10ce061700 1 -- 172.21.15.40:0/3449572856 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c8124aa0 con 0x7f10c809e400 2023-09-30T22:28:49.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.062+0000 7f10affff700 1 -- 172.21.15.40:0/3449572856 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f10bc010910 con 0x7f10c809e400 2023-09-30T22:28:49.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.062+0000 7f10affff700 1 -- 172.21.15.40:0/3449572856 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f10bc03fdc0 con 0x7f10c809e400 2023-09-30T22:28:49.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.062+0000 7f10ce061700 1 -- 172.21.15.40:0/3449572856 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10c8124a40 con 0x7f10c809e400 2023-09-30T22:28:49.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.068+0000 7f10affff700 1 -- 172.21.15.40:0/3449572856 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f10bc01d080 con 0x7f10c809e400 2023-09-30T22:28:49.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.131+0000 7f8df708f700 1 Processor -- start 2023-09-30T22:28:49.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.131+0000 7f8df708f700 1 -- start start 2023-09-30T22:28:49.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.132+0000 7f8df708f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8df0131d50 0x7f8df0132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:49.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.132+0000 7f8df708f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8df009bc50 0x7f8df009c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:49.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.132+0000 7f8df708f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8df0071920 con 0x7f8df009c600 2023-09-30T22:28:49.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.132+0000 7f8df708f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8df009cb10 con 0x7f8df0131d50 2023-09-30T22:28:49.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.132+0000 7f8df708f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df0132660 con 0x7f8df009bc50 2023-09-30T22:28:49.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.132+0000 7f8df4e2b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8df0131d50 0x7f8df0132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:49.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.132+0000 7f8deffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8df009bc50 0x7f8df009c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:49.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.132+0000 7f8df4e2b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8df0131d50 0x7f8df0132120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35736/0 (socket says 172.21.15.40:35736) 2023-09-30T22:28:49.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.132+0000 7f8deffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8df009bc50 0x7f8df009c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:43314/0 (socket says 172.21.15.40:43314) 2023-09-30T22:28:49.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.132+0000 7f8df4e2b700 1 -- 172.21.15.40:0/2043343102 learned_addr learned my addr 172.21.15.40:0/2043343102 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:49.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.132+0000 7f8deffff700 1 -- 172.21.15.40:0/2043343102 >> v2:172.21.15.40:3300/0 conn(0x7f8df0131d50 msgr2=0x7f8df0132120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:49.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.132+0000 7f8deffff700 1 --2- 172.21.15.40:0/2043343102 >> v2:172.21.15.40:3300/0 conn(0x7f8df0131d50 0x7f8df0132120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.132+0000 7f8deffff700 1 -- 172.21.15.40:0/2043343102 >> v1:172.21.15.40:6789/0 conn(0x7f8df009c600 legacy=0x7f8df0138ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:49.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.132+0000 7f8deffff700 1 -- 172.21.15.40:0/2043343102 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df0131900 con 0x7f8df009bc50 2023-09-30T22:28:49.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.132+0000 7f8df4e2b700 1 --2- 172.21.15.40:0/2043343102 >> v2:172.21.15.40:3300/0 conn(0x7f8df0131d50 0x7f8df0132120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:49.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.132+0000 7f8deffff700 1 --2- 172.21.15.40:0/2043343102 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8df009bc50 0x7f8df009c0c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc009840 tx=0x7f8ddc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=509c801c62ccf706 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:49.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.132+0000 7f8def7fe700 1 -- 172.21.15.40:0/2043343102 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc011830 con 0x7f8df009bc50 2023-09-30T22:28:49.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.133+0000 7f8def7fe700 1 -- 172.21.15.40:0/2043343102 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ddc011990 con 0x7f8df009bc50 2023-09-30T22:28:49.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.133+0000 7f8def7fe700 1 -- 172.21.15.40:0/2043343102 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc011d20 con 0x7f8df009bc50 2023-09-30T22:28:49.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.133+0000 7f8df708f700 1 -- 172.21.15.40:0/2043343102 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8df009bc50 msgr2=0x7f8df009c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:49.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.133+0000 7f8df708f700 1 --2- 172.21.15.40:0/2043343102 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8df009bc50 0x7f8df009c0c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc009840 tx=0x7f8ddc009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:49.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.133+0000 7f8df708f700 1 -- 172.21.15.40:0/2043343102 shutdown_connections 2023-09-30T22:28:49.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.133+0000 7f8df708f700 1 --2- 172.21.15.40:0/2043343102 >> v2:172.21.15.40:3300/0 conn(0x7f8df0131d50 0x7f8df0132120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.133+0000 7f8df708f700 1 --2- 172.21.15.40:0/2043343102 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8df009bc50 0x7f8df009c0c0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.133+0000 7f8df708f700 1 -- 172.21.15.40:0/2043343102 >> 172.21.15.40:0/2043343102 conn(0x7f8df00a2a00 msgr2=0x7f8df00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:49.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.133+0000 7f8df708f700 1 -- 172.21.15.40:0/2043343102 shutdown_connections 2023-09-30T22:28:49.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.133+0000 7f8df708f700 1 -- 172.21.15.40:0/2043343102 wait complete. 2023-09-30T22:28:49.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.134+0000 7f8df708f700 1 Processor -- start 2023-09-30T22:28:49.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.134+0000 7f8df708f700 1 -- start start 2023-09-30T22:28:49.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.135+0000 7f8df708f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8df009bc50 0x7f8df011bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:49.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.135+0000 7f8df708f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8df009c600 0x7f8df011c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:49.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.135+0000 7f8df708f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8df0131d50 0x7f8df011c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:49.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.135+0000 7f8df708f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df011f850 con 0x7f8df009bc50 2023-09-30T22:28:49.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.135+0000 7f8df708f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df011db40 con 0x7f8df0131d50 2023-09-30T22:28:49.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.135+0000 7f8df708f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8df011fa50 con 0x7f8df009c600 2023-09-30T22:28:49.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.135+0000 7f8df4e2b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8df009bc50 0x7f8df011bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:49.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.135+0000 7f8df4e2b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8df009bc50 0x7f8df011bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35744/0 (socket says 172.21.15.40:35744) 2023-09-30T22:28:49.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.135+0000 7f8df4e2b700 1 -- 172.21.15.40:0/4164938450 learned_addr learned my addr 172.21.15.40:0/4164938450 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:49.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.135+0000 7f8df562c700 1 --2- 172.21.15.40:0/4164938450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8df0131d50 0x7f8df011c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:49.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.135+0000 7f8deffff700 1 --2- 172.21.15.40:0/4164938450 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8df009c600 0x7f8df011c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:49.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.136+0000 7f8deffff700 1 -- 172.21.15.40:0/4164938450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8df0131d50 msgr2=0x7f8df011c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:49.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.136+0000 7f8deffff700 1 --2- 172.21.15.40:0/4164938450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8df0131d50 0x7f8df011c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.136+0000 7f8deffff700 1 -- 172.21.15.40:0/4164938450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8df009bc50 msgr2=0x7f8df011bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:49.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.136+0000 7f8deffff700 1 --2- 172.21.15.40:0/4164938450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8df009bc50 0x7f8df011bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.136+0000 7f8deffff700 1 -- 172.21.15.40:0/4164938450 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de4009550 con 0x7f8df009c600 2023-09-30T22:28:49.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.136+0000 7f8df562c700 1 --2- 172.21.15.40:0/4164938450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8df0131d50 0x7f8df011c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:49.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.136+0000 7f8df4e2b700 1 --2- 172.21.15.40:0/4164938450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8df009bc50 0x7f8df011bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:49.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.136+0000 7f8deffff700 1 --2- 172.21.15.40:0/4164938450 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8df009c600 0x7f8df011c470 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc016000 tx=0x7f8ddc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:49.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.136+0000 7f8ded7fa700 1 -- 172.21.15.40:0/4164938450 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc004400 con 0x7f8df009c600 2023-09-30T22:28:49.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.136+0000 7f8ded7fa700 1 -- 172.21.15.40:0/4164938450 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ddc004580 con 0x7f8df009c600 2023-09-30T22:28:49.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.136+0000 7f8df708f700 1 -- 172.21.15.40:0/4164938450 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ddc0094a0 con 0x7f8df009c600 2023-09-30T22:28:49.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.136+0000 7f8ded7fa700 1 -- 172.21.15.40:0/4164938450 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc01da00 con 0x7f8df009c600 2023-09-30T22:28:49.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.136+0000 7f8df708f700 1 -- 172.21.15.40:0/4164938450 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8df012ca50 con 0x7f8df009c600 2023-09-30T22:28:49.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.137+0000 7f8ded7fa700 1 -- 172.21.15.40:0/4164938450 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8ddc025070 con 0x7f8df009c600 2023-09-30T22:28:49.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.137+0000 7f8ded7fa700 1 -- 172.21.15.40:0/4164938450 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f8ddc044700 con 0x7f8df009c600 2023-09-30T22:28:49.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.137+0000 7f8df708f700 1 -- 172.21.15.40:0/4164938450 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8df0062380 con 0x7f8df009c600 2023-09-30T22:28:49.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.147+0000 7f8ded7fa700 1 -- 172.21.15.40:0/4164938450 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ddc0256f0 con 0x7f8df009c600 2023-09-30T22:28:49.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.169+0000 7f82f1514700 1 Processor -- start 2023-09-30T22:28:49.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.169+0000 7f82f1514700 1 -- start start 2023-09-30T22:28:49.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.170+0000 7f82f1514700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f82ec09c890 0x7f82ec09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:49.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.170+0000 7f82f1514700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f82ec09d920 0x7f82ec09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:49.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.170+0000 7f82f1514700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82ec09e2b0 0x7f82ec13ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:49.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.170+0000 7f82f1514700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82ec0a29d0 con 0x7f82ec09c890 2023-09-30T22:28:49.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.170+0000 7f82f1514700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82ec09fb40 con 0x7f82ec09e2b0 2023-09-30T22:28:49.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.170+0000 7f82f1514700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82ec0a2600 con 0x7f82ec09d920 2023-09-30T22:28:49.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.170+0000 7f82eaffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f82ec09c890 0x7f82ec09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:49.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.170+0000 7f82ea7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f82ec09d920 0x7f82ec09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:49.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.170+0000 7f82eaffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f82ec09c890 0x7f82ec09cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35746/0 (socket says 172.21.15.40:35746) 2023-09-30T22:28:49.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.170+0000 7f82eaffd700 1 -- 172.21.15.40:0/3482922557 learned_addr learned my addr 172.21.15.40:0/3482922557 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:49.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.170+0000 7f82eb7fe700 1 --2- 172.21.15.40:0/3482922557 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82ec09e2b0 0x7f82ec13ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:49.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.171+0000 7f82eb7fe700 1 -- 172.21.15.40:0/3482922557 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f82ec09d920 msgr2=0x7f82ec09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:49.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.171+0000 7f82eb7fe700 1 --2- 172.21.15.40:0/3482922557 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f82ec09d920 0x7f82ec09dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.171+0000 7f82eb7fe700 1 -- 172.21.15.40:0/3482922557 >> v2:172.21.15.40:3300/0 conn(0x7f82ec09c890 msgr2=0x7f82ec09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:49.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.171+0000 7f82eb7fe700 1 --2- 172.21.15.40:0/3482922557 >> v2:172.21.15.40:3300/0 conn(0x7f82ec09c890 0x7f82ec09cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.171+0000 7f82eb7fe700 1 -- 172.21.15.40:0/3482922557 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ec09fed0 con 0x7f82ec09e2b0 2023-09-30T22:28:49.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.171+0000 7f82eb7fe700 1 --2- 172.21.15.40:0/3482922557 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82ec09e2b0 0x7f82ec13ac10 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f82e4009d90 tx=0x7f82e400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8eb2be83372a78c8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:49.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.171+0000 7f82e9ffb700 1 -- 172.21.15.40:0/3482922557 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e400e070 con 0x7f82ec09e2b0 2023-09-30T22:28:49.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.171+0000 7f82e9ffb700 1 -- 172.21.15.40:0/3482922557 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e400bb20 con 0x7f82ec09e2b0 2023-09-30T22:28:49.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.171+0000 7f82e9ffb700 1 -- 172.21.15.40:0/3482922557 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e4012430 con 0x7f82ec09e2b0 2023-09-30T22:28:49.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.172+0000 7f82f1514700 1 -- 172.21.15.40:0/3482922557 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82ec09e2b0 msgr2=0x7f82ec13ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:49.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.172+0000 7f82f1514700 1 --2- 172.21.15.40:0/3482922557 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82ec09e2b0 0x7f82ec13ac10 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f82e4009d90 tx=0x7f82e400b330 comp rx=0 tx=0).stop 2023-09-30T22:28:49.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.172+0000 7f82f1514700 1 -- 172.21.15.40:0/3482922557 shutdown_connections 2023-09-30T22:28:49.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.172+0000 7f82f1514700 1 --2- 172.21.15.40:0/3482922557 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82ec09e2b0 0x7f82ec13ac10 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.172+0000 7f82f1514700 1 --2- 172.21.15.40:0/3482922557 >> v2:172.21.15.40:3300/0 conn(0x7f82ec09c890 0x7f82ec09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.172+0000 7f82f1514700 1 --2- 172.21.15.40:0/3482922557 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f82ec09d920 0x7f82ec09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.172+0000 7f82f1514700 1 -- 172.21.15.40:0/3482922557 >> 172.21.15.40:0/3482922557 conn(0x7f82ec0a7080 msgr2=0x7f82ec0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:49.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.172+0000 7f82f1514700 1 -- 172.21.15.40:0/3482922557 shutdown_connections 2023-09-30T22:28:49.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.172+0000 7f82f1514700 1 -- 172.21.15.40:0/3482922557 wait complete. 2023-09-30T22:28:49.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.173+0000 7f82f1514700 1 Processor -- start 2023-09-30T22:28:49.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.173+0000 7f82f1514700 1 -- start start 2023-09-30T22:28:49.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.173+0000 7f82f1514700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82ec09c890 0x7f82ec12d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:49.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.173+0000 7f82f1514700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f82ec09d920 0x7f82ec12d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:49.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.173+0000 7f82f1514700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82ec09e2b0 0x7f82ec12ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:49.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.173+0000 7f82f1514700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82ec09ecf0 con 0x7f82ec09e2b0 2023-09-30T22:28:49.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.173+0000 7f82f1514700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82ec1305e0 con 0x7f82ec09c890 2023-09-30T22:28:49.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.173+0000 7f82f1514700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82ec09c230 con 0x7f82ec09d920 2023-09-30T22:28:49.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.173+0000 7f82eaffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82ec09c890 0x7f82ec12d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:49.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.173+0000 7f82eaffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82ec09c890 0x7f82ec12d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:43338/0 (socket says 172.21.15.40:43338) 2023-09-30T22:28:49.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.173+0000 7f82eaffd700 1 -- 172.21.15.40:0/1230715860 learned_addr learned my addr 172.21.15.40:0/1230715860 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:49.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.173+0000 7f82eb7fe700 1 --2- 172.21.15.40:0/1230715860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82ec09e2b0 0x7f82ec12ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:49.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.173+0000 7f82ea7fc700 1 --2- 172.21.15.40:0/1230715860 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f82ec09d920 0x7f82ec12d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:49.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.174+0000 7f82eaffd700 1 -- 172.21.15.40:0/1230715860 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f82ec09d920 msgr2=0x7f82ec12d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:49.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.174+0000 7f82eaffd700 1 --2- 172.21.15.40:0/1230715860 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f82ec09d920 0x7f82ec12d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.174+0000 7f82eaffd700 1 -- 172.21.15.40:0/1230715860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82ec09e2b0 msgr2=0x7f82ec12ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:49.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.174+0000 7f82eaffd700 1 --2- 172.21.15.40:0/1230715860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82ec09e2b0 0x7f82ec12ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.174+0000 7f82eaffd700 1 -- 172.21.15.40:0/1230715860 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e4009a70 con 0x7f82ec09c890 2023-09-30T22:28:49.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.174+0000 7f82eaffd700 1 --2- 172.21.15.40:0/1230715860 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82ec09c890 0x7f82ec12d340 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f82dc00e840 tx=0x7f82dc00eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:49.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.174+0000 7f82d37fe700 1 -- 172.21.15.40:0/1230715860 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc013680 con 0x7f82ec09c890 2023-09-30T22:28:49.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.174+0000 7f82d37fe700 1 -- 172.21.15.40:0/1230715860 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82dc0137e0 con 0x7f82ec09c890 2023-09-30T22:28:49.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.174+0000 7f82f1514700 1 -- 172.21.15.40:0/1230715860 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82ec12e300 con 0x7f82ec09c890 2023-09-30T22:28:49.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.174+0000 7f82d37fe700 1 -- 172.21.15.40:0/1230715860 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc013b50 con 0x7f82ec09c890 2023-09-30T22:28:49.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.174+0000 7f82f1514700 1 -- 172.21.15.40:0/1230715860 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82ec12f9c0 con 0x7f82ec09c890 2023-09-30T22:28:49.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.175+0000 7f82d37fe700 1 -- 172.21.15.40:0/1230715860 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f82dc013cb0 con 0x7f82ec09c890 2023-09-30T22:28:49.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.175+0000 7f82d37fe700 1 -- 172.21.15.40:0/1230715860 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f82dc03f9d0 con 0x7f82ec09c890 2023-09-30T22:28:49.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.175+0000 7f82f1514700 1 -- 172.21.15.40:0/1230715860 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82ec130ae0 con 0x7f82ec09c890 2023-09-30T22:28:49.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.180+0000 7f82d37fe700 1 -- 172.21.15.40:0/1230715860 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f82ec130ae0 con 0x7f82ec09c890 2023-09-30T22:28:49.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.273+0000 7f10ce061700 1 -- 172.21.15.40:0/3449572856 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f10c8062380 con 0x7f10c809e400 2023-09-30T22:28:49.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.273+0000 7f10affff700 1 -- 172.21.15.40:0/3449572856 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f10bc027090 con 0x7f10c809e400 2023-09-30T22:28:49.273 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:49.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.275+0000 7f10ce061700 1 -- 172.21.15.40:0/3449572856 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10c809e400 msgr2=0x7f10c8122ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:49.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.275+0000 7f10ce061700 1 --2- 172.21.15.40:0/3449572856 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10c809e400 0x7f10c8122ec0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f10bc00ed40 tx=0x7f10bc00d630 comp rx=0 tx=0).stop 2023-09-30T22:28:49.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.275+0000 7f10ce061700 1 -- 172.21.15.40:0/3449572856 shutdown_connections 2023-09-30T22:28:49.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.275+0000 7f10ce061700 1 --2- 172.21.15.40:0/3449572856 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10c8136230 0x7f10c8123400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.275+0000 7f10ce061700 1 --2- 172.21.15.40:0/3449572856 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10c809d920 0x7f10c8122980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.275+0000 7f10ce061700 1 --2- 172.21.15.40:0/3449572856 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10c809e400 0x7f10c8122ec0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.275+0000 7f10ce061700 1 -- 172.21.15.40:0/3449572856 >> 172.21.15.40:0/3449572856 conn(0x7f10c809fb20 msgr2=0x7f10c8070310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:49.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.275+0000 7f10ce061700 1 -- 172.21.15.40:0/3449572856 shutdown_connections 2023-09-30T22:28:49.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.275+0000 7f10ce061700 1 -- 172.21.15.40:0/3449572856 wait complete. 2023-09-30T22:28:49.288 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:49.321 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:49.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.349+0000 7f8df708f700 1 -- 172.21.15.40:0/4164938450 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8df00a3160 con 0x7f8df009c600 2023-09-30T22:28:49.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.350+0000 7f8ded7fa700 1 -- 172.21.15.40:0/4164938450 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ddc02c030 con 0x7f8df009c600 2023-09-30T22:28:49.350 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:49.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.353+0000 7f8df708f700 1 -- 172.21.15.40:0/4164938450 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8df009c600 msgr2=0x7f8df011c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:49.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.353+0000 7f8df708f700 1 --2- 172.21.15.40:0/4164938450 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8df009c600 0x7f8df011c470 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc016000 tx=0x7f8ddc004750 comp rx=0 tx=0).stop 2023-09-30T22:28:49.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.353+0000 7f8df708f700 1 -- 172.21.15.40:0/4164938450 shutdown_connections 2023-09-30T22:28:49.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.354+0000 7f8df708f700 1 --2- 172.21.15.40:0/4164938450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8df0131d50 0x7f8df011c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.354+0000 7f8df708f700 1 --2- 172.21.15.40:0/4164938450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8df009bc50 0x7f8df011bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.354+0000 7f8df708f700 1 --2- 172.21.15.40:0/4164938450 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8df009c600 0x7f8df011c470 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.354+0000 7f8df708f700 1 -- 172.21.15.40:0/4164938450 >> 172.21.15.40:0/4164938450 conn(0x7f8df00a2a00 msgr2=0x7f8df00702a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:49.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.354+0000 7f8df708f700 1 -- 172.21.15.40:0/4164938450 shutdown_connections 2023-09-30T22:28:49.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.354+0000 7f8df708f700 1 -- 172.21.15.40:0/4164938450 wait complete. 2023-09-30T22:28:49.367 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:49.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.383+0000 7f82f1514700 1 -- 172.21.15.40:0/1230715860 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f82ec130ae0 con 0x7f82ec09c890 2023-09-30T22:28:49.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.383+0000 7f82d37fe700 1 -- 172.21.15.40:0/1230715860 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f82ec130ae0 con 0x7f82ec09c890 2023-09-30T22:28:49.383 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:49.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.385+0000 7f82f1514700 1 -- 172.21.15.40:0/1230715860 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82ec09c890 msgr2=0x7f82ec12d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:49.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.385+0000 7f82f1514700 1 --2- 172.21.15.40:0/1230715860 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82ec09c890 0x7f82ec12d340 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f82dc00e840 tx=0x7f82dc00eb50 comp rx=0 tx=0).stop 2023-09-30T22:28:49.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.385+0000 7f82f1514700 1 -- 172.21.15.40:0/1230715860 shutdown_connections 2023-09-30T22:28:49.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.385+0000 7f82f1514700 1 --2- 172.21.15.40:0/1230715860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82ec09e2b0 0x7f82ec12ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.385+0000 7f82f1514700 1 --2- 172.21.15.40:0/1230715860 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82ec09c890 0x7f82ec12d340 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.385+0000 7f82f1514700 1 --2- 172.21.15.40:0/1230715860 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f82ec09d920 0x7f82ec12d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.385+0000 7f82f1514700 1 -- 172.21.15.40:0/1230715860 >> 172.21.15.40:0/1230715860 conn(0x7f82ec0a7080 msgr2=0x7f82ec0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:49.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.385+0000 7f82f1514700 1 -- 172.21.15.40:0/1230715860 shutdown_connections 2023-09-30T22:28:49.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.385+0000 7f82f1514700 1 -- 172.21.15.40:0/1230715860 wait complete. 2023-09-30T22:28:49.397 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:49.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.462+0000 7fcc7ec58700 1 Processor -- start 2023-09-30T22:28:49.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.462+0000 7fcc7ec58700 1 -- start start 2023-09-30T22:28:49.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.463+0000 7fcc7ec58700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcc7806f070 0x7fcc7806f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:49.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.463+0000 7fcc7ec58700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc7806fdb0 0x7fcc780977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:49.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.463+0000 7fcc7ec58700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc78070830 con 0x7fcc7806f980 2023-09-30T22:28:49.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.463+0000 7fcc7ec58700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc78070ad0 con 0x7fcc7806f070 2023-09-30T22:28:49.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.463+0000 7fcc7ec58700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc78070de0 con 0x7fcc7806fdb0 2023-09-30T22:28:49.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.463+0000 7fcc7c9f4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcc7806f070 0x7fcc7806f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:49.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.463+0000 7fcc7d1f5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc7806fdb0 0x7fcc780977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:49.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.463+0000 7fcc7c9f4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcc7806f070 0x7fcc7806f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35768/0 (socket says 172.21.15.40:35768) 2023-09-30T22:28:49.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.463+0000 7fcc7c9f4700 1 -- 172.21.15.40:0/2391255701 learned_addr learned my addr 172.21.15.40:0/2391255701 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:49.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.464+0000 7fcc7c9f4700 1 -- 172.21.15.40:0/2391255701 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc7806fdb0 msgr2=0x7fcc780977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:49.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.464+0000 7fcc7c9f4700 1 --2- 172.21.15.40:0/2391255701 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc7806fdb0 0x7fcc780977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.464+0000 7fcc7c9f4700 1 -- 172.21.15.40:0/2391255701 >> v1:172.21.15.40:6789/0 conn(0x7fcc7806f980 legacy=0x7fcc78097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:49.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.464+0000 7fcc7c9f4700 1 -- 172.21.15.40:0/2391255701 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc7809fe20 con 0x7fcc7806f070 2023-09-30T22:28:49.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.464+0000 7fcc7d1f5700 1 --2- 172.21.15.40:0/2391255701 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc7806fdb0 0x7fcc780977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:49.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.464+0000 7fcc7c9f4700 1 --2- 172.21.15.40:0/2391255701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc7806f070 0x7fcc7806f440 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fcc680098f0 tx=0x7fcc68009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae2ec5444879919 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:49.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.464+0000 7fcc777fe700 1 -- 172.21.15.40:0/2391255701 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc68011830 con 0x7fcc7806f070 2023-09-30T22:28:49.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.464+0000 7fcc777fe700 1 -- 172.21.15.40:0/2391255701 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc68011990 con 0x7fcc7806f070 2023-09-30T22:28:49.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.464+0000 7fcc777fe700 1 -- 172.21.15.40:0/2391255701 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc68011d20 con 0x7fcc7806f070 2023-09-30T22:28:49.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.464+0000 7fcc7ec58700 1 -- 172.21.15.40:0/2391255701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc7806f070 msgr2=0x7fcc7806f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:49.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.464+0000 7fcc7ec58700 1 --2- 172.21.15.40:0/2391255701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc7806f070 0x7fcc7806f440 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fcc680098f0 tx=0x7fcc68009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:49.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.465+0000 7fcc7ec58700 1 -- 172.21.15.40:0/2391255701 shutdown_connections 2023-09-30T22:28:49.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.465+0000 7fcc7ec58700 1 --2- 172.21.15.40:0/2391255701 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc7806fdb0 0x7fcc780977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.465+0000 7fcc7ec58700 1 --2- 172.21.15.40:0/2391255701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc7806f070 0x7fcc7806f440 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.465+0000 7fcc7ec58700 1 -- 172.21.15.40:0/2391255701 >> 172.21.15.40:0/2391255701 conn(0x7fcc780a41a0 msgr2=0x7fcc780a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:49.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.465+0000 7fcc7ec58700 1 -- 172.21.15.40:0/2391255701 shutdown_connections 2023-09-30T22:28:49.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.465+0000 7fcc7ec58700 1 -- 172.21.15.40:0/2391255701 wait complete. 2023-09-30T22:28:49.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.465+0000 7fcc7ec58700 1 Processor -- start 2023-09-30T22:28:49.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.466+0000 7fcc7ec58700 1 -- start start 2023-09-30T22:28:49.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.466+0000 7fcc7ec58700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc7806f070 0x7fcc7812d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:49.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.466+0000 7fcc7ec58700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc7806f980 0x7fcc7812d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:49.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.466+0000 7fcc7ec58700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc7806fdb0 0x7fcc7812db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:49.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.466+0000 7fcc7ec58700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7812f450 con 0x7fcc7806fdb0 2023-09-30T22:28:49.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.466+0000 7fcc7ec58700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc78130270 con 0x7fcc7806f070 2023-09-30T22:28:49.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.466+0000 7fcc7ec58700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7812c2d0 con 0x7fcc7806f980 2023-09-30T22:28:49.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.466+0000 7fcc7c9f4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc7806f070 0x7fcc7812d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:49.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.466+0000 7fcc77fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc7806f980 0x7fcc7812d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:49.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.466+0000 7fcc7c9f4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc7806f070 0x7fcc7812d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:43342/0 (socket says 172.21.15.40:43342) 2023-09-30T22:28:49.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.466+0000 7fcc7c9f4700 1 -- 172.21.15.40:0/1774552781 learned_addr learned my addr 172.21.15.40:0/1774552781 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:49.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.466+0000 7fcc7d1f5700 1 --2- 172.21.15.40:0/1774552781 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc7806fdb0 0x7fcc7812db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:49.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.467+0000 7fcc77fff700 1 -- 172.21.15.40:0/1774552781 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc7806f070 msgr2=0x7fcc7812d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:49.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.467+0000 7fcc77fff700 1 --2- 172.21.15.40:0/1774552781 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc7806f070 0x7fcc7812d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.467+0000 7fcc77fff700 1 -- 172.21.15.40:0/1774552781 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc7806fdb0 msgr2=0x7fcc7812db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:49.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.467+0000 7fcc77fff700 1 --2- 172.21.15.40:0/1774552781 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc7806fdb0 0x7fcc7812db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.467+0000 7fcc77fff700 1 -- 172.21.15.40:0/1774552781 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc70009a70 con 0x7fcc7806f980 2023-09-30T22:28:49.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.467+0000 7fcc7c9f4700 1 --2- 172.21.15.40:0/1774552781 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc7806f070 0x7fcc7812d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:49.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.467+0000 7fcc7d1f5700 1 --2- 172.21.15.40:0/1774552781 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc7806fdb0 0x7fcc7812db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:49.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.467+0000 7fcc77fff700 1 --2- 172.21.15.40:0/1774552781 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc7806f980 0x7fcc7812d5d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fcc6000c450 tx=0x7fcc6000c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:49.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.467+0000 7fcc757fa700 1 -- 172.21.15.40:0/1774552781 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc600052d0 con 0x7fcc7806f980 2023-09-30T22:28:49.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.467+0000 7fcc757fa700 1 -- 172.21.15.40:0/1774552781 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc60005430 con 0x7fcc7806f980 2023-09-30T22:28:49.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.467+0000 7fcc7ec58700 1 -- 172.21.15.40:0/1774552781 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc68009550 con 0x7fcc7806f980 2023-09-30T22:28:49.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.467+0000 7fcc757fa700 1 -- 172.21.15.40:0/1774552781 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc600038c0 con 0x7fcc7806f980 2023-09-30T22:28:49.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.467+0000 7fcc7ec58700 1 -- 172.21.15.40:0/1774552781 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc78132300 con 0x7fcc7806f980 2023-09-30T22:28:49.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.468+0000 7fcc757fa700 1 -- 172.21.15.40:0/1774552781 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcc60003a20 con 0x7fcc7806f980 2023-09-30T22:28:49.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.468+0000 7fcc757fa700 1 -- 172.21.15.40:0/1774552781 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fcc6003e9e0 con 0x7fcc7806f980 2023-09-30T22:28:49.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.468+0000 7fcc7ec58700 1 -- 172.21.15.40:0/1774552781 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc78062380 con 0x7fcc7806f980 2023-09-30T22:28:49.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.473+0000 7fcc757fa700 1 -- 172.21.15.40:0/1774552781 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcc60017030 con 0x7fcc7806f980 2023-09-30T22:28:49.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.667+0000 7fcc7ec58700 1 -- 172.21.15.40:0/1774552781 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcc78074620 con 0x7fcc7806f980 2023-09-30T22:28:49.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.668+0000 7fcc757fa700 1 -- 172.21.15.40:0/1774552781 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcc60011590 con 0x7fcc7806f980 2023-09-30T22:28:49.668 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:49.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.670+0000 7fcc7ec58700 1 -- 172.21.15.40:0/1774552781 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc7806f980 msgr2=0x7fcc7812d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:49.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.670+0000 7fcc7ec58700 1 --2- 172.21.15.40:0/1774552781 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc7806f980 0x7fcc7812d5d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fcc6000c450 tx=0x7fcc6000c760 comp rx=0 tx=0).stop 2023-09-30T22:28:49.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.670+0000 7fcc7ec58700 1 -- 172.21.15.40:0/1774552781 shutdown_connections 2023-09-30T22:28:49.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.670+0000 7fcc7ec58700 1 --2- 172.21.15.40:0/1774552781 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc7806fdb0 0x7fcc7812db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.670+0000 7fcc7ec58700 1 --2- 172.21.15.40:0/1774552781 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcc7806f070 0x7fcc7812d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.670+0000 7fcc7ec58700 1 --2- 172.21.15.40:0/1774552781 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcc7806f980 0x7fcc7812d5d0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.670+0000 7fcc7ec58700 1 -- 172.21.15.40:0/1774552781 >> 172.21.15.40:0/1774552781 conn(0x7fcc780a41a0 msgr2=0x7fcc780974a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:49.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.670+0000 7fcc7ec58700 1 -- 172.21.15.40:0/1774552781 shutdown_connections 2023-09-30T22:28:49.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:49.670+0000 7fcc7ec58700 1 -- 172.21.15.40:0/1774552781 wait complete. 2023-09-30T22:28:49.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:50.289 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:50.368 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:50.398 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:50.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.428+0000 7ffa68ad9700 1 Processor -- start 2023-09-30T22:28:50.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.428+0000 7ffa68ad9700 1 -- start start 2023-09-30T22:28:50.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.429+0000 7ffa68ad9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa6406f070 0x7ffa6406f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.429+0000 7ffa68ad9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffa6406f980 0x7ffa64097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.429+0000 7ffa68ad9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa6406fdb0 0x7ffa640975d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.429+0000 7ffa68ad9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa64070830 con 0x7ffa6406f980 2023-09-30T22:28:50.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.429+0000 7ffa68ad9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa64070ad0 con 0x7ffa6406f070 2023-09-30T22:28:50.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.429+0000 7ffa68ad9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa64070de0 con 0x7ffa6406fdb0 2023-09-30T22:28:50.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.429+0000 7ffa6259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa6406f070 0x7ffa6406f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.429+0000 7ffa62d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa6406fdb0 0x7ffa640975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.429+0000 7ffa62d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa6406fdb0 0x7ffa640975d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:44452/0 (socket says 172.21.15.40:44452) 2023-09-30T22:28:50.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.429+0000 7ffa6259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa6406f070 0x7ffa6406f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:43344/0 (socket says 172.21.15.40:43344) 2023-09-30T22:28:50.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.429+0000 7ffa62d9d700 1 -- 172.21.15.40:0/3189602098 learned_addr learned my addr 172.21.15.40:0/3189602098 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:50.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.429+0000 7ffa61d9b700 1 --2- 172.21.15.40:0/3189602098 >> v2:172.21.15.40:3300/0 conn(0x7ffa6406f980 0x7ffa64097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.429+0000 7ffa6259c700 1 -- 172.21.15.40:0/3189602098 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa6406fdb0 msgr2=0x7ffa640975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:50.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.429+0000 7ffa6259c700 1 --2- 172.21.15.40:0/3189602098 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa6406fdb0 0x7ffa640975d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.429+0000 7ffa6259c700 1 -- 172.21.15.40:0/3189602098 >> v2:172.21.15.40:3300/0 conn(0x7ffa6406f980 msgr2=0x7ffa64097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:50.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.429+0000 7ffa6259c700 1 --2- 172.21.15.40:0/3189602098 >> v2:172.21.15.40:3300/0 conn(0x7ffa6406f980 0x7ffa64097090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.429+0000 7ffa6259c700 1 -- 172.21.15.40:0/3189602098 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6409fe20 con 0x7ffa6406f070 2023-09-30T22:28:50.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.429+0000 7ffa6259c700 1 --2- 172.21.15.40:0/3189602098 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa6406f070 0x7ffa6406f440 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ffa54009840 tx=0x7ffa54009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=148222fe8586afc1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:50.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.430+0000 7ffa6159a700 1 -- 172.21.15.40:0/3189602098 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa54011830 con 0x7ffa6406f070 2023-09-30T22:28:50.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.430+0000 7ffa6159a700 1 -- 172.21.15.40:0/3189602098 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa54011990 con 0x7ffa6406f070 2023-09-30T22:28:50.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.430+0000 7ffa6159a700 1 -- 172.21.15.40:0/3189602098 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa54011d20 con 0x7ffa6406f070 2023-09-30T22:28:50.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.430+0000 7ffa68ad9700 1 -- 172.21.15.40:0/3189602098 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa6406f070 msgr2=0x7ffa6406f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:50.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.430+0000 7ffa68ad9700 1 --2- 172.21.15.40:0/3189602098 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa6406f070 0x7ffa6406f440 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ffa54009840 tx=0x7ffa54009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:50.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.431+0000 7ffa68ad9700 1 -- 172.21.15.40:0/3189602098 shutdown_connections 2023-09-30T22:28:50.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.431+0000 7ffa68ad9700 1 --2- 172.21.15.40:0/3189602098 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa6406fdb0 0x7ffa640975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.431+0000 7ffa68ad9700 1 --2- 172.21.15.40:0/3189602098 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa6406f070 0x7ffa6406f440 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.431+0000 7ffa68ad9700 1 --2- 172.21.15.40:0/3189602098 >> v2:172.21.15.40:3300/0 conn(0x7ffa6406f980 0x7ffa64097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.431+0000 7ffa68ad9700 1 -- 172.21.15.40:0/3189602098 >> 172.21.15.40:0/3189602098 conn(0x7ffa640a41a0 msgr2=0x7ffa640a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:50.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.431+0000 7ffa68ad9700 1 -- 172.21.15.40:0/3189602098 shutdown_connections 2023-09-30T22:28:50.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.431+0000 7ffa68ad9700 1 -- 172.21.15.40:0/3189602098 wait complete. 2023-09-30T22:28:50.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.432+0000 7ffa68ad9700 1 Processor -- start 2023-09-30T22:28:50.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.432+0000 7ffa68ad9700 1 -- start start 2023-09-30T22:28:50.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.432+0000 7ffa68ad9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa6406f070 0x7ffa6406c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.432+0000 7ffa68ad9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa6406f980 0x7ffa6406ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.432+0000 7ffa68ad9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa6406fdb0 0x7ffa6406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.432+0000 7ffa68ad9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa641292a0 con 0x7ffa6406f980 2023-09-30T22:28:50.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.432+0000 7ffa68ad9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6406e5d0 con 0x7ffa6406fdb0 2023-09-30T22:28:50.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.432+0000 7ffa68ad9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6406e1a0 con 0x7ffa6406f070 2023-09-30T22:28:50.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.432+0000 7ffa6259c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa6406f070 0x7ffa6406c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.432+0000 7ffa6259c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa6406f070 0x7ffa6406c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:44466/0 (socket says 172.21.15.40:44466) 2023-09-30T22:28:50.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.432+0000 7ffa6259c700 1 -- 172.21.15.40:0/1382993845 learned_addr learned my addr 172.21.15.40:0/1382993845 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:50.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.432+0000 7ffa61d9b700 1 --2- 172.21.15.40:0/1382993845 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa6406f980 0x7ffa6406ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.433+0000 7ffa6259c700 1 -- 172.21.15.40:0/1382993845 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa6406fdb0 msgr2=0x7ffa6406d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:50.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.433+0000 7ffa6259c700 1 --2- 172.21.15.40:0/1382993845 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa6406fdb0 0x7ffa6406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.433+0000 7ffa6259c700 1 -- 172.21.15.40:0/1382993845 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa6406f980 msgr2=0x7ffa6406ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:50.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.433+0000 7ffa6259c700 1 --2- 172.21.15.40:0/1382993845 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa6406f980 0x7ffa6406ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.433+0000 7ffa6259c700 1 -- 172.21.15.40:0/1382993845 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa540094a0 con 0x7ffa6406f070 2023-09-30T22:28:50.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.433+0000 7ffa61d9b700 1 --2- 172.21.15.40:0/1382993845 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa6406f980 0x7ffa6406ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:50.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.433+0000 7ffa6259c700 1 --2- 172.21.15.40:0/1382993845 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa6406f070 0x7ffa6406c990 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ffa540090b0 tx=0x7ffa54004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:50.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.433+0000 7ffa52ffd700 1 -- 172.21.15.40:0/1382993845 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa54004240 con 0x7ffa6406f070 2023-09-30T22:28:50.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.433+0000 7ffa52ffd700 1 -- 172.21.15.40:0/1382993845 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5401f070 con 0x7ffa6406f070 2023-09-30T22:28:50.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.433+0000 7ffa68ad9700 1 -- 172.21.15.40:0/1382993845 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa6408b530 con 0x7ffa6406f070 2023-09-30T22:28:50.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.433+0000 7ffa52ffd700 1 -- 172.21.15.40:0/1382993845 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa540036a0 con 0x7ffa6406f070 2023-09-30T22:28:50.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.433+0000 7ffa68ad9700 1 -- 172.21.15.40:0/1382993845 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa64131bb0 con 0x7ffa6406f070 2023-09-30T22:28:50.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.434+0000 7ffa52ffd700 1 -- 172.21.15.40:0/1382993845 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffa54021030 con 0x7ffa6406f070 2023-09-30T22:28:50.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.434+0000 7ffa68ad9700 1 -- 172.21.15.40:0/1382993845 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa64062380 con 0x7ffa6406f070 2023-09-30T22:28:50.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.434+0000 7ffa52ffd700 1 -- 172.21.15.40:0/1382993845 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ffa54040620 con 0x7ffa6406f070 2023-09-30T22:28:50.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.439+0000 7ffa52ffd700 1 -- 172.21.15.40:0/1382993845 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa540239c0 con 0x7ffa6406f070 2023-09-30T22:28:50.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.504+0000 7fb4f352c700 1 Processor -- start 2023-09-30T22:28:50.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.504+0000 7fb4f352c700 1 -- start start 2023-09-30T22:28:50.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.505+0000 7fb4f352c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb4ec09c890 0x7fb4ec09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.505+0000 7fb4f352c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4ec09d920 0x7fb4ec09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.505+0000 7fb4f352c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4ec09e2b0 0x7fb4ec13ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.505+0000 7fb4f352c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4ec0a29d0 con 0x7fb4ec09c890 2023-09-30T22:28:50.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.505+0000 7fb4f352c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec09fb40 con 0x7fb4ec09e2b0 2023-09-30T22:28:50.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.505+0000 7fb4f352c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec0a2600 con 0x7fb4ec09d920 2023-09-30T22:28:50.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.505+0000 7fb4f0ac7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4ec09d920 0x7fb4ec09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.505+0000 7fb4f0ac7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4ec09d920 0x7fb4ec09dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:44474/0 (socket says 172.21.15.40:44474) 2023-09-30T22:28:50.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.505+0000 7fb4f0ac7700 1 -- 172.21.15.40:0/485369968 learned_addr learned my addr 172.21.15.40:0/485369968 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:50.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.505+0000 7fb4f12c8700 1 --2- 172.21.15.40:0/485369968 >> v2:172.21.15.40:3300/0 conn(0x7fb4ec09c890 0x7fb4ec09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.505+0000 7fb4f1ac9700 1 --2- 172.21.15.40:0/485369968 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4ec09e2b0 0x7fb4ec13ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.505+0000 7fb4f0ac7700 1 -- 172.21.15.40:0/485369968 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4ec09e2b0 msgr2=0x7fb4ec13ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:50.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.505+0000 7fb4f0ac7700 1 --2- 172.21.15.40:0/485369968 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4ec09e2b0 0x7fb4ec13ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.505+0000 7fb4f0ac7700 1 -- 172.21.15.40:0/485369968 >> v2:172.21.15.40:3300/0 conn(0x7fb4ec09c890 msgr2=0x7fb4ec09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:50.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.505+0000 7fb4f0ac7700 1 --2- 172.21.15.40:0/485369968 >> v2:172.21.15.40:3300/0 conn(0x7fb4ec09c890 0x7fb4ec09cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.505+0000 7fb4f0ac7700 1 -- 172.21.15.40:0/485369968 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ec09fed0 con 0x7fb4ec09d920 2023-09-30T22:28:50.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.505+0000 7fb4f12c8700 1 --2- 172.21.15.40:0/485369968 >> v2:172.21.15.40:3300/0 conn(0x7fb4ec09c890 0x7fb4ec09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:50.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.505+0000 7fb4f0ac7700 1 --2- 172.21.15.40:0/485369968 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4ec09d920 0x7fb4ec09dd70 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc0098f0 tx=0x7fb4dc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1726f3661fcfe6e2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:50.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.505+0000 7fb4e3fff700 1 -- 172.21.15.40:0/485369968 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc011830 con 0x7fb4ec09d920 2023-09-30T22:28:50.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.506+0000 7fb4e3fff700 1 -- 172.21.15.40:0/485369968 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4dc011990 con 0x7fb4ec09d920 2023-09-30T22:28:50.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.506+0000 7fb4e3fff700 1 -- 172.21.15.40:0/485369968 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc011d20 con 0x7fb4ec09d920 2023-09-30T22:28:50.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.506+0000 7fb4f352c700 1 -- 172.21.15.40:0/485369968 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4ec09d920 msgr2=0x7fb4ec09dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:50.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.506+0000 7fb4f352c700 1 --2- 172.21.15.40:0/485369968 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4ec09d920 0x7fb4ec09dd70 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc0098f0 tx=0x7fb4dc009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:50.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.506+0000 7fb4f352c700 1 -- 172.21.15.40:0/485369968 shutdown_connections 2023-09-30T22:28:50.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.506+0000 7fb4f352c700 1 --2- 172.21.15.40:0/485369968 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4ec09e2b0 0x7fb4ec13ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.506+0000 7fb4f352c700 1 --2- 172.21.15.40:0/485369968 >> v2:172.21.15.40:3300/0 conn(0x7fb4ec09c890 0x7fb4ec09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.506+0000 7fb4f352c700 1 --2- 172.21.15.40:0/485369968 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4ec09d920 0x7fb4ec09dd70 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.506+0000 7fb4f352c700 1 -- 172.21.15.40:0/485369968 >> 172.21.15.40:0/485369968 conn(0x7fb4ec0a7080 msgr2=0x7fb4ec0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:50.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.506+0000 7fb4f352c700 1 -- 172.21.15.40:0/485369968 shutdown_connections 2023-09-30T22:28:50.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.506+0000 7fb4f352c700 1 -- 172.21.15.40:0/485369968 wait complete. 2023-09-30T22:28:50.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.507+0000 7fb4f352c700 1 Processor -- start 2023-09-30T22:28:50.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.507+0000 7fb4f352c700 1 -- start start 2023-09-30T22:28:50.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.508+0000 7fb4f352c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4ec09c890 0x7fb4ec12d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.508+0000 7fb4f352c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4ec09d920 0x7fb4ec12d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.508+0000 7fb4f352c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4ec09e2b0 0x7fb4ec12dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.508+0000 7fb4f352c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec0a5d60 con 0x7fb4ec09d920 2023-09-30T22:28:50.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.508+0000 7fb4f352c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec130560 con 0x7fb4ec09c890 2023-09-30T22:28:50.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.508+0000 7fb4f352c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec09c310 con 0x7fb4ec09e2b0 2023-09-30T22:28:50.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.508+0000 7fb4f12c8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4ec09c890 0x7fb4ec12d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.508+0000 7fb4f12c8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4ec09c890 0x7fb4ec12d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:43364/0 (socket says 172.21.15.40:43364) 2023-09-30T22:28:50.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.508+0000 7fb4f12c8700 1 -- 172.21.15.40:0/3217746007 learned_addr learned my addr 172.21.15.40:0/3217746007 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:50.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.508+0000 7fb4f1ac9700 1 --2- 172.21.15.40:0/3217746007 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4ec09e2b0 0x7fb4ec12dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.508+0000 7fb4f0ac7700 1 --2- 172.21.15.40:0/3217746007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4ec09d920 0x7fb4ec12d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.508+0000 7fb4f12c8700 1 -- 172.21.15.40:0/3217746007 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4ec09e2b0 msgr2=0x7fb4ec12dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:50.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.508+0000 7fb4f12c8700 1 --2- 172.21.15.40:0/3217746007 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4ec09e2b0 0x7fb4ec12dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.508+0000 7fb4f12c8700 1 -- 172.21.15.40:0/3217746007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4ec09d920 msgr2=0x7fb4ec12d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:50.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.508+0000 7fb4f12c8700 1 --2- 172.21.15.40:0/3217746007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4ec09d920 0x7fb4ec12d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.508+0000 7fb4f12c8700 1 -- 172.21.15.40:0/3217746007 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e8009430 con 0x7fb4ec09c890 2023-09-30T22:28:50.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.509+0000 7fb4f12c8700 1 --2- 172.21.15.40:0/3217746007 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4ec09c890 0x7fb4ec12d210 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb4e800e960 tx=0x7fb4e800ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:50.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.509+0000 7fb4e1ffb700 1 -- 172.21.15.40:0/3217746007 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e80096c0 con 0x7fb4ec09c890 2023-09-30T22:28:50.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.509+0000 7fb4e1ffb700 1 -- 172.21.15.40:0/3217746007 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e8005a20 con 0x7fb4ec09c890 2023-09-30T22:28:50.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.509+0000 7fb4f352c700 1 -- 172.21.15.40:0/3217746007 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4dc009550 con 0x7fb4ec09c890 2023-09-30T22:28:50.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.509+0000 7fb4e1ffb700 1 -- 172.21.15.40:0/3217746007 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e8005db0 con 0x7fb4ec09c890 2023-09-30T22:28:50.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.509+0000 7fb4f352c700 1 -- 172.21.15.40:0/3217746007 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4ec12fc40 con 0x7fb4ec09c890 2023-09-30T22:28:50.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.510+0000 7fb4e1ffb700 1 -- 172.21.15.40:0/3217746007 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb4e8013680 con 0x7fb4ec09c890 2023-09-30T22:28:50.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.510+0000 7fb4e1ffb700 1 -- 172.21.15.40:0/3217746007 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb4e803f8e0 con 0x7fb4ec09c890 2023-09-30T22:28:50.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.510+0000 7fb4f352c700 1 -- 172.21.15.40:0/3217746007 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4ec1306a0 con 0x7fb4ec09c890 2023-09-30T22:28:50.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.515+0000 7fb4e1ffb700 1 -- 172.21.15.40:0/3217746007 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb4e8020080 con 0x7fb4ec09c890 2023-09-30T22:28:50.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.544+0000 7ffa2883c700 1 Processor -- start 2023-09-30T22:28:50.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.544+0000 7ffa2883c700 1 -- start start 2023-09-30T22:28:50.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.545+0000 7ffa2883c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa2409c890 0x7ffa2409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.545+0000 7ffa2883c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffa2409e480 0x7ffa2413bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.545+0000 7ffa2883c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa240a2600 con 0x7ffa2409d920 2023-09-30T22:28:50.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.545+0000 7ffa2883c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa240a29d0 con 0x7ffa2409e480 2023-09-30T22:28:50.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.545+0000 7ffa2883c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2409fb40 con 0x7ffa2409c890 2023-09-30T22:28:50.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.545+0000 7ffa2259c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa2409c890 0x7ffa2409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.545+0000 7ffa2259c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa2409c890 0x7ffa2409cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:44496/0 (socket says 172.21.15.40:44496) 2023-09-30T22:28:50.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.545+0000 7ffa2259c700 1 -- 172.21.15.40:0/3138513038 learned_addr learned my addr 172.21.15.40:0/3138513038 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:50.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.545+0000 7ffa22d9d700 1 --2- 172.21.15.40:0/3138513038 >> v2:172.21.15.40:3300/0 conn(0x7ffa2409e480 0x7ffa2413bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.546+0000 7ffa2259c700 1 -- 172.21.15.40:0/3138513038 >> v2:172.21.15.40:3300/0 conn(0x7ffa2409e480 msgr2=0x7ffa2413bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:50.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.546+0000 7ffa2259c700 1 --2- 172.21.15.40:0/3138513038 >> v2:172.21.15.40:3300/0 conn(0x7ffa2409e480 0x7ffa2413bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.546+0000 7ffa2259c700 1 -- 172.21.15.40:0/3138513038 >> v1:172.21.15.40:6789/0 conn(0x7ffa2409d920 legacy=0x7ffa2409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:50.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.546+0000 7ffa2259c700 1 -- 172.21.15.40:0/3138513038 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa2409fed0 con 0x7ffa2409c890 2023-09-30T22:28:50.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.546+0000 7ffa22d9d700 1 --2- 172.21.15.40:0/3138513038 >> v2:172.21.15.40:3300/0 conn(0x7ffa2409e480 0x7ffa2413bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:50.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.546+0000 7ffa2259c700 1 --2- 172.21.15.40:0/3138513038 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa2409c890 0x7ffa2409cc60 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ffa14006fd0 tx=0x7ffa14009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53ca8da9df0c4db0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:50.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.546+0000 7ffa2159a700 1 -- 172.21.15.40:0/3138513038 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa14005e30 con 0x7ffa2409c890 2023-09-30T22:28:50.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.546+0000 7ffa2159a700 1 -- 172.21.15.40:0/3138513038 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa14004030 con 0x7ffa2409c890 2023-09-30T22:28:50.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.546+0000 7ffa2159a700 1 -- 172.21.15.40:0/3138513038 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa140043e0 con 0x7ffa2409c890 2023-09-30T22:28:50.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.546+0000 7ffa2883c700 1 -- 172.21.15.40:0/3138513038 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa2409c890 msgr2=0x7ffa2409cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:50.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.546+0000 7ffa2883c700 1 --2- 172.21.15.40:0/3138513038 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa2409c890 0x7ffa2409cc60 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ffa14006fd0 tx=0x7ffa14009bd0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.547+0000 7ffa2883c700 1 -- 172.21.15.40:0/3138513038 shutdown_connections 2023-09-30T22:28:50.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.547+0000 7ffa2883c700 1 --2- 172.21.15.40:0/3138513038 >> v2:172.21.15.40:3300/0 conn(0x7ffa2409e480 0x7ffa2413bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.547+0000 7ffa2883c700 1 --2- 172.21.15.40:0/3138513038 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa2409c890 0x7ffa2409cc60 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.547+0000 7ffa2883c700 1 -- 172.21.15.40:0/3138513038 >> 172.21.15.40:0/3138513038 conn(0x7ffa240a7080 msgr2=0x7ffa240a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:50.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.547+0000 7ffa2883c700 1 -- 172.21.15.40:0/3138513038 shutdown_connections 2023-09-30T22:28:50.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.547+0000 7ffa2883c700 1 -- 172.21.15.40:0/3138513038 wait complete. 2023-09-30T22:28:50.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.548+0000 7ffa2883c700 1 Processor -- start 2023-09-30T22:28:50.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.548+0000 7ffa2883c700 1 -- start start 2023-09-30T22:28:50.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.549+0000 7ffa2883c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa2409c890 0x7ffa2412d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.549+0000 7ffa2883c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa2409d920 0x7ffa2412da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.549+0000 7ffa2883c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa2409e480 0x7ffa2412dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.549+0000 7ffa2883c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2408f4f0 con 0x7ffa2409e480 2023-09-30T22:28:50.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.549+0000 7ffa2883c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa24130af0 con 0x7ffa2409d920 2023-09-30T22:28:50.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.549+0000 7ffa2883c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa240a5da0 con 0x7ffa2409c890 2023-09-30T22:28:50.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.549+0000 7ffa2259c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa2409c890 0x7ffa2412d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.549+0000 7ffa21d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa2409d920 0x7ffa2412da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.549+0000 7ffa22d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa2409e480 0x7ffa2412dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.549+0000 7ffa2259c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa2409c890 0x7ffa2412d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:44506/0 (socket says 172.21.15.40:44506) 2023-09-30T22:28:50.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.549+0000 7ffa2259c700 1 -- 172.21.15.40:0/3678270234 learned_addr learned my addr 172.21.15.40:0/3678270234 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:50.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.549+0000 7ffa22d9d700 1 -- 172.21.15.40:0/3678270234 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa2409c890 msgr2=0x7ffa2412d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:50.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.549+0000 7ffa22d9d700 1 --2- 172.21.15.40:0/3678270234 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa2409c890 0x7ffa2412d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.549+0000 7ffa22d9d700 1 -- 172.21.15.40:0/3678270234 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa2409d920 msgr2=0x7ffa2412da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:50.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.549+0000 7ffa22d9d700 1 --2- 172.21.15.40:0/3678270234 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa2409d920 0x7ffa2412da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.549+0000 7ffa22d9d700 1 -- 172.21.15.40:0/3678270234 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1c009a70 con 0x7ffa2409e480 2023-09-30T22:28:50.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.550+0000 7ffa22d9d700 1 --2- 172.21.15.40:0/3678270234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa2409e480 0x7ffa2412dfa0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c00efc0 tx=0x7ffa1c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:50.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.550+0000 7ffa12ffd700 1 -- 172.21.15.40:0/3678270234 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c00ca90 con 0x7ffa2409e480 2023-09-30T22:28:50.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.550+0000 7ffa12ffd700 1 -- 172.21.15.40:0/3678270234 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1c00f040 con 0x7ffa2409e480 2023-09-30T22:28:50.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.550+0000 7ffa2883c700 1 -- 172.21.15.40:0/3678270234 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa14009500 con 0x7ffa2409e480 2023-09-30T22:28:50.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.550+0000 7ffa12ffd700 1 -- 172.21.15.40:0/3678270234 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c00ce30 con 0x7ffa2409e480 2023-09-30T22:28:50.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.550+0000 7ffa2883c700 1 -- 172.21.15.40:0/3678270234 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa24130dd0 con 0x7ffa2409e480 2023-09-30T22:28:50.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.551+0000 7ffa2883c700 1 -- 172.21.15.40:0/3678270234 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa24130890 con 0x7ffa2409e480 2023-09-30T22:28:50.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.552+0000 7ffa12ffd700 1 -- 172.21.15.40:0/3678270234 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffa1c003a20 con 0x7ffa2409e480 2023-09-30T22:28:50.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.552+0000 7ffa12ffd700 1 -- 172.21.15.40:0/3678270234 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ffa1c040530 con 0x7ffa2409e480 2023-09-30T22:28:50.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.556+0000 7ffa12ffd700 1 -- 172.21.15.40:0/3678270234 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa1c024370 con 0x7ffa2409e480 2023-09-30T22:28:50.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.645+0000 7ffa68ad9700 1 -- 172.21.15.40:0/1382993845 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ffa64074620 con 0x7ffa6406f070 2023-09-30T22:28:50.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.645+0000 7ffa52ffd700 1 -- 172.21.15.40:0/1382993845 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffa5401b430 con 0x7ffa6406f070 2023-09-30T22:28:50.645 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.647+0000 7ffa68ad9700 1 -- 172.21.15.40:0/1382993845 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa6406f070 msgr2=0x7ffa6406c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.647+0000 7ffa68ad9700 1 --2- 172.21.15.40:0/1382993845 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa6406f070 0x7ffa6406c990 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ffa540090b0 tx=0x7ffa54004750 comp rx=0 tx=0).stop 2023-09-30T22:28:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.647+0000 7ffa68ad9700 1 -- 172.21.15.40:0/1382993845 shutdown_connections 2023-09-30T22:28:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.647+0000 7ffa68ad9700 1 --2- 172.21.15.40:0/1382993845 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa6406f070 0x7ffa6406c990 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.647+0000 7ffa68ad9700 1 --2- 172.21.15.40:0/1382993845 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa6406fdb0 0x7ffa6406d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.647+0000 7ffa68ad9700 1 --2- 172.21.15.40:0/1382993845 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa6406f980 0x7ffa6406ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.647+0000 7ffa68ad9700 1 -- 172.21.15.40:0/1382993845 >> 172.21.15.40:0/1382993845 conn(0x7ffa640a41a0 msgr2=0x7ffa640973c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.647+0000 7ffa68ad9700 1 -- 172.21.15.40:0/1382993845 shutdown_connections 2023-09-30T22:28:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.647+0000 7ffa68ad9700 1 -- 172.21.15.40:0/1382993845 wait complete. 2023-09-30T22:28:50.659 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:50.682 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:50.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.718+0000 7fb4f352c700 1 -- 172.21.15.40:0/3217746007 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb4ec062380 con 0x7fb4ec09c890 2023-09-30T22:28:50.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.719+0000 7fb4e1ffb700 1 -- 172.21.15.40:0/3217746007 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb4e8013930 con 0x7fb4ec09c890 2023-09-30T22:28:50.719 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:50.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.721+0000 7fb4f352c700 1 -- 172.21.15.40:0/3217746007 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4ec09c890 msgr2=0x7fb4ec12d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:50.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.721+0000 7fb4f352c700 1 --2- 172.21.15.40:0/3217746007 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4ec09c890 0x7fb4ec12d210 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb4e800e960 tx=0x7fb4e800ec70 comp rx=0 tx=0).stop 2023-09-30T22:28:50.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.721+0000 7fb4f352c700 1 -- 172.21.15.40:0/3217746007 shutdown_connections 2023-09-30T22:28:50.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.721+0000 7fb4f352c700 1 --2- 172.21.15.40:0/3217746007 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb4ec09e2b0 0x7fb4ec12dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.721+0000 7fb4f352c700 1 --2- 172.21.15.40:0/3217746007 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4ec09c890 0x7fb4ec12d210 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.721+0000 7fb4f352c700 1 --2- 172.21.15.40:0/3217746007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4ec09d920 0x7fb4ec12d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.721+0000 7fb4f352c700 1 -- 172.21.15.40:0/3217746007 >> 172.21.15.40:0/3217746007 conn(0x7fb4ec0a7080 msgr2=0x7fb4ec0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:50.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.721+0000 7fb4f352c700 1 -- 172.21.15.40:0/3217746007 shutdown_connections 2023-09-30T22:28:50.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.721+0000 7fb4f352c700 1 -- 172.21.15.40:0/3217746007 wait complete. 2023-09-30T22:28:50.734 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:50.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.753+0000 7ffa2883c700 1 -- 172.21.15.40:0/3678270234 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffa2409ed50 con 0x7ffa2409e480 2023-09-30T22:28:50.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.753+0000 7ffa12ffd700 1 -- 172.21.15.40:0/3678270234 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffa1c02a090 con 0x7ffa2409e480 2023-09-30T22:28:50.753 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:50.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.756+0000 7ffa2883c700 1 -- 172.21.15.40:0/3678270234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa2409e480 msgr2=0x7ffa2412dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:50.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.756+0000 7ffa2883c700 1 --2- 172.21.15.40:0/3678270234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa2409e480 0x7ffa2412dfa0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c00efc0 tx=0x7ffa1c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.756+0000 7ffa2883c700 1 -- 172.21.15.40:0/3678270234 shutdown_connections 2023-09-30T22:28:50.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.756+0000 7ffa2883c700 1 --2- 172.21.15.40:0/3678270234 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa2409c890 0x7ffa2412d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.756+0000 7ffa2883c700 1 --2- 172.21.15.40:0/3678270234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa2409e480 0x7ffa2412dfa0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.756+0000 7ffa2883c700 1 --2- 172.21.15.40:0/3678270234 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa2409d920 0x7ffa2412da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.756+0000 7ffa2883c700 1 -- 172.21.15.40:0/3678270234 >> 172.21.15.40:0/3678270234 conn(0x7ffa240a7080 msgr2=0x7ffa240a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:50.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.756+0000 7ffa2883c700 1 -- 172.21.15.40:0/3678270234 shutdown_connections 2023-09-30T22:28:50.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.756+0000 7ffa2883c700 1 -- 172.21.15.40:0/3678270234 wait complete. 2023-09-30T22:28:50.768 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:50.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.830+0000 7fed32df3700 1 Processor -- start 2023-09-30T22:28:50.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.830+0000 7fed32df3700 1 -- start start 2023-09-30T22:28:50.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.831+0000 7fed32df3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fed2c09fbb0 0x7fed2c06c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.831+0000 7fed32df3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed2c06ced0 0x7fed2c06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.831+0000 7fed32df3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fed2c138370 0x7fed2c13a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.831+0000 7fed32df3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed2c09ff80 con 0x7fed2c09fbb0 2023-09-30T22:28:50.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.831+0000 7fed32df3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c06da80 con 0x7fed2c06ced0 2023-09-30T22:28:50.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.831+0000 7fed32df3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c06d800 con 0x7fed2c138370 2023-09-30T22:28:50.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.831+0000 7fed2bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed2c06ced0 0x7fed2c06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.831+0000 7fed30b8f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fed2c09fbb0 0x7fed2c06c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.831+0000 7fed31390700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fed2c138370 0x7fed2c13a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.831+0000 7fed2bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed2c06ced0 0x7fed2c06d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:43376/0 (socket says 172.21.15.40:43376) 2023-09-30T22:28:50.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.831+0000 7fed30b8f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fed2c09fbb0 0x7fed2c06c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35840/0 (socket says 172.21.15.40:35840) 2023-09-30T22:28:50.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.831+0000 7fed2bfff700 1 -- 172.21.15.40:0/3188209662 learned_addr learned my addr 172.21.15.40:0/3188209662 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:50.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.831+0000 7fed31390700 1 -- 172.21.15.40:0/3188209662 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed2c06ced0 msgr2=0x7fed2c06d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:50.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.831+0000 7fed31390700 1 --2- 172.21.15.40:0/3188209662 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed2c06ced0 0x7fed2c06d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.831+0000 7fed31390700 1 -- 172.21.15.40:0/3188209662 >> v2:172.21.15.40:3300/0 conn(0x7fed2c09fbb0 msgr2=0x7fed2c06c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:50.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.831+0000 7fed31390700 1 --2- 172.21.15.40:0/3188209662 >> v2:172.21.15.40:3300/0 conn(0x7fed2c09fbb0 0x7fed2c06c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.831+0000 7fed31390700 1 -- 172.21.15.40:0/3188209662 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed2c0a0590 con 0x7fed2c138370 2023-09-30T22:28:50.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.831+0000 7fed2bfff700 1 --2- 172.21.15.40:0/3188209662 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed2c06ced0 0x7fed2c06d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:50.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.831+0000 7fed30b8f700 1 --2- 172.21.15.40:0/3188209662 >> v2:172.21.15.40:3300/0 conn(0x7fed2c09fbb0 0x7fed2c06c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:50.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.831+0000 7fed31390700 1 --2- 172.21.15.40:0/3188209662 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fed2c138370 0x7fed2c13a750 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fed24009870 tx=0x7fed24009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70b7bcac9aaa8b3a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:50.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.831+0000 7fed2b7fe700 1 -- 172.21.15.40:0/3188209662 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed24011830 con 0x7fed2c138370 2023-09-30T22:28:50.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.832+0000 7fed2b7fe700 1 -- 172.21.15.40:0/3188209662 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed24011990 con 0x7fed2c138370 2023-09-30T22:28:50.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.832+0000 7fed2b7fe700 1 -- 172.21.15.40:0/3188209662 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed24011d20 con 0x7fed2c138370 2023-09-30T22:28:50.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.832+0000 7fed32df3700 1 -- 172.21.15.40:0/3188209662 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fed2c138370 msgr2=0x7fed2c13a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:50.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.832+0000 7fed32df3700 1 --2- 172.21.15.40:0/3188209662 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fed2c138370 0x7fed2c13a750 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fed24009870 tx=0x7fed24009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:50.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.832+0000 7fed32df3700 1 -- 172.21.15.40:0/3188209662 shutdown_connections 2023-09-30T22:28:50.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.832+0000 7fed32df3700 1 --2- 172.21.15.40:0/3188209662 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fed2c138370 0x7fed2c13a750 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.832+0000 7fed32df3700 1 --2- 172.21.15.40:0/3188209662 >> v2:172.21.15.40:3300/0 conn(0x7fed2c09fbb0 0x7fed2c06c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.832+0000 7fed32df3700 1 --2- 172.21.15.40:0/3188209662 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed2c06ced0 0x7fed2c06d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.832+0000 7fed32df3700 1 -- 172.21.15.40:0/3188209662 >> 172.21.15.40:0/3188209662 conn(0x7fed2c0a41a0 msgr2=0x7fed2c0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:50.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.832+0000 7fed32df3700 1 -- 172.21.15.40:0/3188209662 shutdown_connections 2023-09-30T22:28:50.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.832+0000 7fed32df3700 1 -- 172.21.15.40:0/3188209662 wait complete. 2023-09-30T22:28:50.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.833+0000 7fed32df3700 1 Processor -- start 2023-09-30T22:28:50.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.833+0000 7fed32df3700 1 -- start start 2023-09-30T22:28:50.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.834+0000 7fed32df3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed2c06ced0 0x7fed2c137a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.834+0000 7fed32df3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed2c09fbb0 0x7fed2c095c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.834+0000 7fed32df3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fed2c138370 0x7fed2c096190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.834+0000 7fed32df3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c071eb0 con 0x7fed2c06ced0 2023-09-30T22:28:50.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.834+0000 7fed32df3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c094ad0 con 0x7fed2c09fbb0 2023-09-30T22:28:50.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.834+0000 7fed32df3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c095800 con 0x7fed2c138370 2023-09-30T22:28:50.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.834+0000 7fed30b8f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed2c06ced0 0x7fed2c137a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.834+0000 7fed31390700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fed2c138370 0x7fed2c096190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.834+0000 7fed30b8f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed2c06ced0 0x7fed2c137a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35852/0 (socket says 172.21.15.40:35852) 2023-09-30T22:28:50.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.834+0000 7fed2bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed2c09fbb0 0x7fed2c095c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.834+0000 7fed30b8f700 1 -- 172.21.15.40:0/1318580775 learned_addr learned my addr 172.21.15.40:0/1318580775 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:50.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.834+0000 7fed30b8f700 1 -- 172.21.15.40:0/1318580775 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fed2c138370 msgr2=0x7fed2c096190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:50.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.834+0000 7fed30b8f700 1 --2- 172.21.15.40:0/1318580775 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fed2c138370 0x7fed2c096190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.834+0000 7fed30b8f700 1 -- 172.21.15.40:0/1318580775 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed2c09fbb0 msgr2=0x7fed2c095c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:50.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.834+0000 7fed30b8f700 1 --2- 172.21.15.40:0/1318580775 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed2c09fbb0 0x7fed2c095c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.834+0000 7fed30b8f700 1 -- 172.21.15.40:0/1318580775 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed1c009b30 con 0x7fed2c06ced0 2023-09-30T22:28:50.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.834+0000 7fed31390700 1 --2- 172.21.15.40:0/1318580775 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fed2c138370 0x7fed2c096190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:50.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.834+0000 7fed2bfff700 1 --2- 172.21.15.40:0/1318580775 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed2c09fbb0 0x7fed2c095c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:50.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.834+0000 7fed30b8f700 1 --2- 172.21.15.40:0/1318580775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed2c06ced0 0x7fed2c137a30 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fed1400ebe0 tx=0x7fed1400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:50.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.834+0000 7fed297fa700 1 -- 172.21.15.40:0/1318580775 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1400c850 con 0x7fed2c06ced0 2023-09-30T22:28:50.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.834+0000 7fed297fa700 1 -- 172.21.15.40:0/1318580775 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1400c9b0 con 0x7fed2c06ced0 2023-09-30T22:28:50.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.834+0000 7fed32df3700 1 -- 172.21.15.40:0/1318580775 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed140094a0 con 0x7fed2c06ced0 2023-09-30T22:28:50.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.834+0000 7fed297fa700 1 -- 172.21.15.40:0/1318580775 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1400cd40 con 0x7fed2c06ced0 2023-09-30T22:28:50.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.835+0000 7fed32df3700 1 -- 172.21.15.40:0/1318580775 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed240094a0 con 0x7fed2c06ced0 2023-09-30T22:28:50.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.835+0000 7fed297fa700 1 -- 172.21.15.40:0/1318580775 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fed14013470 con 0x7fed2c06ced0 2023-09-30T22:28:50.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.835+0000 7fed297fa700 1 -- 172.21.15.40:0/1318580775 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fed1403fb90 con 0x7fed2c06ced0 2023-09-30T22:28:50.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.835+0000 7fed32df3700 1 -- 172.21.15.40:0/1318580775 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed2c092b70 con 0x7fed2c06ced0 2023-09-30T22:28:50.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:50.840+0000 7fed297fa700 1 -- 172.21.15.40:0/1318580775 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fed14013720 con 0x7fed2c06ced0 2023-09-30T22:28:51.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.035+0000 7fed32df3700 1 -- 172.21.15.40:0/1318580775 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fed2c062380 con 0x7fed2c06ced0 2023-09-30T22:28:51.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.036+0000 7fed297fa700 1 -- 172.21.15.40:0/1318580775 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fed14011b40 con 0x7fed2c06ced0 2023-09-30T22:28:51.036 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:51.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.038+0000 7fed32df3700 1 -- 172.21.15.40:0/1318580775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed2c06ced0 msgr2=0x7fed2c137a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:51.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.038+0000 7fed32df3700 1 --2- 172.21.15.40:0/1318580775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed2c06ced0 0x7fed2c137a30 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fed1400ebe0 tx=0x7fed1400eef0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.038+0000 7fed32df3700 1 -- 172.21.15.40:0/1318580775 shutdown_connections 2023-09-30T22:28:51.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.038+0000 7fed32df3700 1 --2- 172.21.15.40:0/1318580775 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fed2c138370 0x7fed2c096190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.038+0000 7fed32df3700 1 --2- 172.21.15.40:0/1318580775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed2c06ced0 0x7fed2c137a30 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.038+0000 7fed32df3700 1 --2- 172.21.15.40:0/1318580775 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed2c09fbb0 0x7fed2c095c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.038+0000 7fed32df3700 1 -- 172.21.15.40:0/1318580775 >> 172.21.15.40:0/1318580775 conn(0x7fed2c0a41a0 msgr2=0x7fed2c0a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:51.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.038+0000 7fed32df3700 1 -- 172.21.15.40:0/1318580775 shutdown_connections 2023-09-30T22:28:51.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.038+0000 7fed32df3700 1 -- 172.21.15.40:0/1318580775 wait complete. 2023-09-30T22:28:51.049 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:51.660 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:51.734 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:51.769 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:51.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.798+0000 7f63f17d5700 1 Processor -- start 2023-09-30T22:28:51.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.798+0000 7f63f17d5700 1 -- start start 2023-09-30T22:28:51.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.799+0000 7f63f17d5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f63ec09d920 0x7f63ec09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:51.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.799+0000 7f63f17d5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63ec09e230 0x7f63ec1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:51.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.799+0000 7f63f17d5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63ec09f940 con 0x7f63ec09f0f0 2023-09-30T22:28:51.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.799+0000 7f63f17d5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec06b4c0 con 0x7f63ec09e230 2023-09-30T22:28:51.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.799+0000 7f63f17d5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec09a8f0 con 0x7f63ec09d920 2023-09-30T22:28:51.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.799+0000 7f63eaffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f63ec09d920 0x7f63ec09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:51.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.799+0000 7f63ea7fc700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f63ec09f0f0 0x7f63ec133ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55882/0 (socket says 172.21.15.40:55882) 2023-09-30T22:28:51.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.799+0000 7f63ea7fc700 1 -- 172.21.15.40:0/2371199974 learned_addr learned my addr 172.21.15.40:0/2371199974 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:51.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.799+0000 7f63eb7fe700 1 --2- 172.21.15.40:0/2371199974 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63ec09e230 0x7f63ec1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:51.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.799+0000 7f63e9ffb700 1 -- 172.21.15.40:0/2371199974 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 265466208 0 0) 0x7f63ec09f940 con 0x7f63ec09f0f0 2023-09-30T22:28:51.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.799+0000 7f63e9ffb700 1 -- 172.21.15.40:0/2371199974 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63d40035b0 con 0x7f63ec09f0f0 2023-09-30T22:28:51.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.799+0000 7f63eb7fe700 1 -- 172.21.15.40:0/2371199974 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f63ec09d920 msgr2=0x7f63ec09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:51.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.799+0000 7f63eb7fe700 1 --2- 172.21.15.40:0/2371199974 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f63ec09d920 0x7f63ec09dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.799+0000 7f63eb7fe700 1 -- 172.21.15.40:0/2371199974 >> v1:172.21.15.40:6789/0 conn(0x7f63ec09f0f0 legacy=0x7f63ec133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:51.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.799+0000 7f63eb7fe700 1 -- 172.21.15.40:0/2371199974 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ec09f6e0 con 0x7f63ec09e230 2023-09-30T22:28:51.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.800+0000 7f63eb7fe700 1 --2- 172.21.15.40:0/2371199974 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63ec09e230 0x7f63ec1343b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f63e4009dc0 tx=0x7f63e400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29acbb08efa459a6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:51.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.800+0000 7f63e9ffb700 1 -- 172.21.15.40:0/2371199974 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e400e070 con 0x7f63ec09e230 2023-09-30T22:28:51.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.800+0000 7f63e9ffb700 1 -- 172.21.15.40:0/2371199974 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e400bb20 con 0x7f63ec09e230 2023-09-30T22:28:51.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.800+0000 7f63e9ffb700 1 -- 172.21.15.40:0/2371199974 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e4012430 con 0x7f63ec09e230 2023-09-30T22:28:51.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.801+0000 7f63f17d5700 1 -- 172.21.15.40:0/2371199974 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63ec09e230 msgr2=0x7f63ec1343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:51.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.801+0000 7f63f17d5700 1 --2- 172.21.15.40:0/2371199974 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63ec09e230 0x7f63ec1343b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f63e4009dc0 tx=0x7f63e400b330 comp rx=0 tx=0).stop 2023-09-30T22:28:51.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.801+0000 7f63f17d5700 1 -- 172.21.15.40:0/2371199974 shutdown_connections 2023-09-30T22:28:51.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.801+0000 7f63f17d5700 1 --2- 172.21.15.40:0/2371199974 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63ec09e230 0x7f63ec1343b0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.801+0000 7f63f17d5700 1 --2- 172.21.15.40:0/2371199974 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f63ec09d920 0x7f63ec09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.801+0000 7f63f17d5700 1 -- 172.21.15.40:0/2371199974 >> 172.21.15.40:0/2371199974 conn(0x7f63ec09fb20 msgr2=0x7f63ec09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:51.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.801+0000 7f63f17d5700 1 -- 172.21.15.40:0/2371199974 shutdown_connections 2023-09-30T22:28:51.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.801+0000 7f63f17d5700 1 -- 172.21.15.40:0/2371199974 wait complete. 2023-09-30T22:28:51.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.802+0000 7f63f17d5700 1 Processor -- start 2023-09-30T22:28:51.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.802+0000 7f63f17d5700 1 -- start start 2023-09-30T22:28:51.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.802+0000 7f63f17d5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63ec09d920 0x7f63ec122870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:51.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.802+0000 7f63f17d5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f63ec09e230 0x7f63ec122db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:51.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.803+0000 7f63f17d5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63ec1232f0 0x7f63ec1ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:51.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.803+0000 7f63f17d5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec09c9e0 con 0x7f63ec1232f0 2023-09-30T22:28:51.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.803+0000 7f63f17d5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec124c60 con 0x7f63ec09d920 2023-09-30T22:28:51.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.803+0000 7f63f17d5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec0a2f40 con 0x7f63ec09e230 2023-09-30T22:28:51.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.803+0000 7f63eaffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63ec09d920 0x7f63ec122870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:51.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.803+0000 7f63eaffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63ec09d920 0x7f63ec122870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:43392/0 (socket says 172.21.15.40:43392) 2023-09-30T22:28:51.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.803+0000 7f63eaffd700 1 -- 172.21.15.40:0/3885855513 learned_addr learned my addr 172.21.15.40:0/3885855513 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:51.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.803+0000 7f63ea7fc700 1 --2- 172.21.15.40:0/3885855513 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f63ec09e230 0x7f63ec122db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:51.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.803+0000 7f63eb7fe700 1 --2- 172.21.15.40:0/3885855513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63ec1232f0 0x7f63ec1ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:51.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.803+0000 7f63eaffd700 1 -- 172.21.15.40:0/3885855513 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f63ec09e230 msgr2=0x7f63ec122db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:51.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.803+0000 7f63eaffd700 1 --2- 172.21.15.40:0/3885855513 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f63ec09e230 0x7f63ec122db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.803+0000 7f63eaffd700 1 -- 172.21.15.40:0/3885855513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63ec1232f0 msgr2=0x7f63ec1ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:51.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.803+0000 7f63eaffd700 1 --2- 172.21.15.40:0/3885855513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63ec1232f0 0x7f63ec1ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.803+0000 7f63eaffd700 1 -- 172.21.15.40:0/3885855513 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e4009a70 con 0x7f63ec09d920 2023-09-30T22:28:51.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.803+0000 7f63eaffd700 1 --2- 172.21.15.40:0/3885855513 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63ec09d920 0x7f63ec122870 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f63dc00e900 tx=0x7f63dc00ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:51.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.803+0000 7f63d37fe700 1 -- 172.21.15.40:0/3885855513 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63dc013680 con 0x7f63ec09d920 2023-09-30T22:28:51.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.804+0000 7f63d37fe700 1 -- 172.21.15.40:0/3885855513 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63dc0137e0 con 0x7f63ec09d920 2023-09-30T22:28:51.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.804+0000 7f63f17d5700 1 -- 172.21.15.40:0/3885855513 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63ec125210 con 0x7f63ec09d920 2023-09-30T22:28:51.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.804+0000 7f63d37fe700 1 -- 172.21.15.40:0/3885855513 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63dc013b50 con 0x7f63ec09d920 2023-09-30T22:28:51.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.804+0000 7f63f17d5700 1 -- 172.21.15.40:0/3885855513 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63ec1263a0 con 0x7f63ec09d920 2023-09-30T22:28:51.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.804+0000 7f63d37fe700 1 -- 172.21.15.40:0/3885855513 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f63dc013cb0 con 0x7f63ec09d920 2023-09-30T22:28:51.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.805+0000 7f63d37fe700 1 -- 172.21.15.40:0/3885855513 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f63dc03fa90 con 0x7f63ec09d920 2023-09-30T22:28:51.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.805+0000 7f63f17d5700 1 -- 172.21.15.40:0/3885855513 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63ec062380 con 0x7f63ec09d920 2023-09-30T22:28:51.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.810+0000 7f63d37fe700 1 -- 172.21.15.40:0/3885855513 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f63dc017080 con 0x7f63ec09d920 2023-09-30T22:28:51.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.903+0000 7ff968fb6700 1 Processor -- start 2023-09-30T22:28:51.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.903+0000 7ff968fb6700 1 -- start start 2023-09-30T22:28:51.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.904+0000 7ff968fb6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff96409d920 0x7ff96409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:51.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.904+0000 7ff968fb6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff96409e230 0x7ff9641308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:51.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.904+0000 7ff968fb6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff96409adf0 con 0x7ff964130de0 2023-09-30T22:28:51.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.904+0000 7ff968fb6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff96409edf0 con 0x7ff96409e230 2023-09-30T22:28:51.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.904+0000 7ff968fb6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96409b660 con 0x7ff96409d920 2023-09-30T22:28:51.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.904+0000 7ff96259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff96409d920 0x7ff96409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:51.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.904+0000 7ff96259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff96409d920 0x7ff96409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:43404/0 (socket says 172.21.15.40:43404) 2023-09-30T22:28:51.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.904+0000 7ff96259c700 1 -- 172.21.15.40:0/4211589989 learned_addr learned my addr 172.21.15.40:0/4211589989 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:51.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.904+0000 7ff961d9b700 1 --2- 172.21.15.40:0/4211589989 >> v2:172.21.15.40:3300/0 conn(0x7ff96409e230 0x7ff9641308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:51.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.904+0000 7ff96259c700 1 -- 172.21.15.40:0/4211589989 >> v2:172.21.15.40:3300/0 conn(0x7ff96409e230 msgr2=0x7ff9641308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:51.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.904+0000 7ff96259c700 1 --2- 172.21.15.40:0/4211589989 >> v2:172.21.15.40:3300/0 conn(0x7ff96409e230 0x7ff9641308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.904+0000 7ff96259c700 1 -- 172.21.15.40:0/4211589989 >> v1:172.21.15.40:6789/0 conn(0x7ff964130de0 legacy=0x7ff964137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:51.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.904+0000 7ff96259c700 1 -- 172.21.15.40:0/4211589989 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96409a6e0 con 0x7ff96409d920 2023-09-30T22:28:51.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.905+0000 7ff96259c700 1 --2- 172.21.15.40:0/4211589989 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff96409d920 0x7ff96409dcf0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff954006fd0 tx=0x7ff954009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd4c1bb2ca2fbc2b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:51.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.905+0000 7ff96159a700 1 -- 172.21.15.40:0/4211589989 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff954005e30 con 0x7ff96409d920 2023-09-30T22:28:51.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.905+0000 7ff96159a700 1 -- 172.21.15.40:0/4211589989 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff954004030 con 0x7ff96409d920 2023-09-30T22:28:51.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.905+0000 7ff96159a700 1 -- 172.21.15.40:0/4211589989 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9540043e0 con 0x7ff96409d920 2023-09-30T22:28:51.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.905+0000 7ff968fb6700 1 -- 172.21.15.40:0/4211589989 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff96409d920 msgr2=0x7ff96409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:51.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.905+0000 7ff968fb6700 1 --2- 172.21.15.40:0/4211589989 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff96409d920 0x7ff96409dcf0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff954006fd0 tx=0x7ff954009bd0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.906+0000 7ff968fb6700 1 -- 172.21.15.40:0/4211589989 shutdown_connections 2023-09-30T22:28:51.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.906+0000 7ff968fb6700 1 --2- 172.21.15.40:0/4211589989 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff96409d920 0x7ff96409dcf0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.906+0000 7ff968fb6700 1 --2- 172.21.15.40:0/4211589989 >> v2:172.21.15.40:3300/0 conn(0x7ff96409e230 0x7ff9641308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.906+0000 7ff968fb6700 1 -- 172.21.15.40:0/4211589989 >> 172.21.15.40:0/4211589989 conn(0x7ff96409fb20 msgr2=0x7ff96409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:51.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.906+0000 7ff968fb6700 1 -- 172.21.15.40:0/4211589989 shutdown_connections 2023-09-30T22:28:51.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.906+0000 7ff968fb6700 1 -- 172.21.15.40:0/4211589989 wait complete. 2023-09-30T22:28:51.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.907+0000 7ff968fb6700 1 Processor -- start 2023-09-30T22:28:51.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.907+0000 7ff968fb6700 1 -- start start 2023-09-30T22:28:51.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.908+0000 7ff968fb6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff96409d920 0x7ff96412bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:51.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.908+0000 7ff968fb6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff96409e230 0x7ff96412c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:51.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.908+0000 7ff968fb6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff964130de0 0x7ff96412ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:51.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.908+0000 7ff968fb6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96412d390 con 0x7ff964130de0 2023-09-30T22:28:51.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.908+0000 7ff968fb6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff964139b40 con 0x7ff96409d920 2023-09-30T22:28:51.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.908+0000 7ff968fb6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9641305b0 con 0x7ff96409e230 2023-09-30T22:28:51.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.908+0000 7ff96259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff96409d920 0x7ff96412bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:51.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.908+0000 7ff96259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff96409d920 0x7ff96412bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:43414/0 (socket says 172.21.15.40:43414) 2023-09-30T22:28:51.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.908+0000 7ff96259c700 1 -- 172.21.15.40:0/2748914149 learned_addr learned my addr 172.21.15.40:0/2748914149 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:51.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.908+0000 7ff961d9b700 1 --2- 172.21.15.40:0/2748914149 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff96409e230 0x7ff96412c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:51.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.908+0000 7ff962d9d700 1 --2- 172.21.15.40:0/2748914149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff964130de0 0x7ff96412ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:51.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.908+0000 7ff96259c700 1 -- 172.21.15.40:0/2748914149 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff96409e230 msgr2=0x7ff96412c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:51.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.908+0000 7ff96259c700 1 --2- 172.21.15.40:0/2748914149 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff96409e230 0x7ff96412c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.908+0000 7ff96259c700 1 -- 172.21.15.40:0/2748914149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff964130de0 msgr2=0x7ff96412ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:51.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.908+0000 7ff96259c700 1 --2- 172.21.15.40:0/2748914149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff964130de0 0x7ff96412ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.908+0000 7ff96259c700 1 -- 172.21.15.40:0/2748914149 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff954009500 con 0x7ff96409d920 2023-09-30T22:28:51.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.908+0000 7ff962d9d700 1 --2- 172.21.15.40:0/2748914149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff964130de0 0x7ff96412ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:28:51.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.908+0000 7ff96259c700 1 --2- 172.21.15.40:0/2748914149 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff96409d920 0x7ff96412bfc0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff954000c00 tx=0x7ff954004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:51.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.909+0000 7ff952ffd700 1 -- 172.21.15.40:0/2748914149 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95401c420 con 0x7ff96409d920 2023-09-30T22:28:51.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.909+0000 7ff952ffd700 1 -- 172.21.15.40:0/2748914149 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95401c580 con 0x7ff96409d920 2023-09-30T22:28:51.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.909+0000 7ff952ffd700 1 -- 172.21.15.40:0/2748914149 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95401c930 con 0x7ff96409d920 2023-09-30T22:28:51.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.909+0000 7ff968fb6700 1 -- 172.21.15.40:0/2748914149 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff96412daf0 con 0x7ff96409d920 2023-09-30T22:28:51.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.909+0000 7ff968fb6700 1 -- 172.21.15.40:0/2748914149 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff96412e240 con 0x7ff96409d920 2023-09-30T22:28:51.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.910+0000 7ff952ffd700 1 -- 172.21.15.40:0/2748914149 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff95401ca90 con 0x7ff96409d920 2023-09-30T22:28:51.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.910+0000 7ff952ffd700 1 -- 172.21.15.40:0/2748914149 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff954040570 con 0x7ff96409d920 2023-09-30T22:28:51.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.911+0000 7ff968fb6700 1 -- 172.21.15.40:0/2748914149 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff964062380 con 0x7ff96409d920 2023-09-30T22:28:51.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.915+0000 7ff952ffd700 1 -- 172.21.15.40:0/2748914149 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff954016080 con 0x7ff96409d920 2023-09-30T22:28:51.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.921+0000 7f4fd866a700 1 Processor -- start 2023-09-30T22:28:51.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.921+0000 7f4fd866a700 1 -- start start 2023-09-30T22:28:51.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.921+0000 7f4fd866a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4fd009c890 0x7f4fd009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:51.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.921+0000 7f4fd866a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fd009d920 0x7f4fd009dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:51.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.921+0000 7f4fd866a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fd00a2600 con 0x7f4fd009e2b0 2023-09-30T22:28:51.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.921+0000 7f4fd866a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fd00a29d0 con 0x7f4fd009c890 2023-09-30T22:28:51.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.921+0000 7f4fd866a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd009fb40 con 0x7f4fd009d920 2023-09-30T22:28:51.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.922+0000 7f4fd5c05700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fd009d920 0x7f4fd009dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:51.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.922+0000 7f4fd6406700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4fd009c890 0x7f4fd009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:51.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.922+0000 7f4fd5c05700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fd009d920 0x7f4fd009dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:44560/0 (socket says 172.21.15.40:44560) 2023-09-30T22:28:51.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.922+0000 7f4fd6406700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4fd009c890 0x7f4fd009cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35880/0 (socket says 172.21.15.40:35880) 2023-09-30T22:28:51.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.922+0000 7f4fd5c05700 1 -- 172.21.15.40:0/4085818478 learned_addr learned my addr 172.21.15.40:0/4085818478 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:51.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.922+0000 7f4fd5404700 1 -- 172.21.15.40:0/4085818478 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1594906846 0 0) 0x7f4fd00a2600 con 0x7f4fd009e2b0 2023-09-30T22:28:51.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.922+0000 7f4fd5c05700 1 -- 172.21.15.40:0/4085818478 >> v2:172.21.15.40:3300/0 conn(0x7f4fd009c890 msgr2=0x7f4fd009cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:51.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.922+0000 7f4fd5c05700 1 --2- 172.21.15.40:0/4085818478 >> v2:172.21.15.40:3300/0 conn(0x7f4fd009c890 0x7f4fd009cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.922+0000 7f4fd5c05700 1 -- 172.21.15.40:0/4085818478 >> v1:172.21.15.40:6789/0 conn(0x7f4fd009e2b0 legacy=0x7f4fd013ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:51.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.922+0000 7f4fd5c05700 1 -- 172.21.15.40:0/4085818478 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd009e730 con 0x7f4fd009d920 2023-09-30T22:28:51.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.922+0000 7f4fd5c05700 1 --2- 172.21.15.40:0/4085818478 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fd009d920 0x7f4fd009dd70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f4fc00098f0 tx=0x7f4fc0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0d596f74a00ba90 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:51.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.922+0000 7f4fd5404700 1 -- 172.21.15.40:0/4085818478 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc000b8a0 con 0x7f4fd009d920 2023-09-30T22:28:51.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.922+0000 7f4fd5404700 1 -- 172.21.15.40:0/4085818478 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc000ba00 con 0x7f4fd009d920 2023-09-30T22:28:51.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.922+0000 7f4fd5404700 1 -- 172.21.15.40:0/4085818478 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc000bd90 con 0x7f4fd009d920 2023-09-30T22:28:51.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.923+0000 7f4fd866a700 1 -- 172.21.15.40:0/4085818478 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fd009d920 msgr2=0x7f4fd009dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:51.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.923+0000 7f4fd866a700 1 --2- 172.21.15.40:0/4085818478 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fd009d920 0x7f4fd009dd70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f4fc00098f0 tx=0x7f4fc0009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:51.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.923+0000 7f4fd866a700 1 -- 172.21.15.40:0/4085818478 shutdown_connections 2023-09-30T22:28:51.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.923+0000 7f4fd866a700 1 --2- 172.21.15.40:0/4085818478 >> v2:172.21.15.40:3300/0 conn(0x7f4fd009c890 0x7f4fd009cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.923+0000 7f4fd866a700 1 --2- 172.21.15.40:0/4085818478 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fd009d920 0x7f4fd009dd70 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.923+0000 7f4fd866a700 1 -- 172.21.15.40:0/4085818478 >> 172.21.15.40:0/4085818478 conn(0x7f4fd00a7080 msgr2=0x7f4fd00a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:51.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.923+0000 7f4fd866a700 1 -- 172.21.15.40:0/4085818478 shutdown_connections 2023-09-30T22:28:51.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.923+0000 7f4fd866a700 1 -- 172.21.15.40:0/4085818478 wait complete. 2023-09-30T22:28:51.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.924+0000 7f4fd866a700 1 Processor -- start 2023-09-30T22:28:51.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.924+0000 7f4fd866a700 1 -- start start 2023-09-30T22:28:51.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.924+0000 7f4fd866a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fd009c890 0x7f4fd012f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:51.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.924+0000 7f4fd866a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fd009d920 0x7f4fd012fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:51.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.924+0000 7f4fd866a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fd009e2b0 0x7f4fd01301d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:51.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.924+0000 7f4fd866a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd012ec80 con 0x7f4fd009d920 2023-09-30T22:28:51.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.925+0000 7f4fd866a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd00a5b80 con 0x7f4fd009c890 2023-09-30T22:28:51.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.925+0000 7f4fd866a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd009ecf0 con 0x7f4fd009e2b0 2023-09-30T22:28:51.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.925+0000 7f4fd5c05700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fd009d920 0x7f4fd012fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:51.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.925+0000 7f4fd5c05700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fd009d920 0x7f4fd012fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35892/0 (socket says 172.21.15.40:35892) 2023-09-30T22:28:51.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.925+0000 7f4fd5c05700 1 -- 172.21.15.40:0/2502957585 learned_addr learned my addr 172.21.15.40:0/2502957585 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:51.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.925+0000 7f4fd6c07700 1 --2- 172.21.15.40:0/2502957585 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fd009e2b0 0x7f4fd01301d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:51.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.925+0000 7f4fd5c05700 1 -- 172.21.15.40:0/2502957585 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fd009e2b0 msgr2=0x7f4fd01301d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:51.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.925+0000 7f4fd5c05700 1 --2- 172.21.15.40:0/2502957585 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fd009e2b0 0x7f4fd01301d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.925+0000 7f4fd5c05700 1 -- 172.21.15.40:0/2502957585 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fd009c890 msgr2=0x7f4fd012f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:51.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.925+0000 7f4fd5c05700 1 --2- 172.21.15.40:0/2502957585 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fd009c890 0x7f4fd012f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.925+0000 7f4fd5c05700 1 -- 172.21.15.40:0/2502957585 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc0009550 con 0x7f4fd009d920 2023-09-30T22:28:51.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.925+0000 7f4fd5c05700 1 --2- 172.21.15.40:0/2502957585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fd009d920 0x7f4fd012fc90 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0009c40 tx=0x7f4fc0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:51.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.925+0000 7f4fc6ffd700 1 -- 172.21.15.40:0/2502957585 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0004510 con 0x7f4fd009d920 2023-09-30T22:28:51.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.925+0000 7f4fc6ffd700 1 -- 172.21.15.40:0/2502957585 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc00036a0 con 0x7f4fd009d920 2023-09-30T22:28:51.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.925+0000 7f4fd866a700 1 -- 172.21.15.40:0/2502957585 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd012e890 con 0x7f4fd009d920 2023-09-30T22:28:51.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.925+0000 7f4fc6ffd700 1 -- 172.21.15.40:0/2502957585 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0003a50 con 0x7f4fd009d920 2023-09-30T22:28:51.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.925+0000 7f4fd866a700 1 -- 172.21.15.40:0/2502957585 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd012f300 con 0x7f4fd009d920 2023-09-30T22:28:51.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.926+0000 7f4fc6ffd700 1 -- 172.21.15.40:0/2502957585 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4fc0021070 con 0x7f4fd009d920 2023-09-30T22:28:51.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.926+0000 7f4fc6ffd700 1 -- 172.21.15.40:0/2502957585 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4fc0040d10 con 0x7f4fd009d920 2023-09-30T22:28:51.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.927+0000 7f4fd866a700 1 -- 172.21.15.40:0/2502957585 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd006e600 con 0x7f4fd009d920 2023-09-30T22:28:51.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:51.931+0000 7f4fc6ffd700 1 -- 172.21.15.40:0/2502957585 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4fc0015020 con 0x7f4fd009d920 2023-09-30T22:28:52.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.042+0000 7f63f17d5700 1 -- 172.21.15.40:0/3885855513 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f63ec074720 con 0x7f63ec09d920 2023-09-30T22:28:52.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.043+0000 7f63d37fe700 1 -- 172.21.15.40:0/3885855513 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f63dc01adc0 con 0x7f63ec09d920 2023-09-30T22:28:52.043 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:52.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.045+0000 7f63f17d5700 1 -- 172.21.15.40:0/3885855513 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63ec09d920 msgr2=0x7f63ec122870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:52.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.045+0000 7f63f17d5700 1 --2- 172.21.15.40:0/3885855513 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63ec09d920 0x7f63ec122870 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f63dc00e900 tx=0x7f63dc00ec10 comp rx=0 tx=0).stop 2023-09-30T22:28:52.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.045+0000 7f63f17d5700 1 -- 172.21.15.40:0/3885855513 shutdown_connections 2023-09-30T22:28:52.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.045+0000 7f63f17d5700 1 --2- 172.21.15.40:0/3885855513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63ec1232f0 0x7f63ec1ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:52.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.045+0000 7f63f17d5700 1 --2- 172.21.15.40:0/3885855513 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63ec09d920 0x7f63ec122870 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:52.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.045+0000 7f63f17d5700 1 --2- 172.21.15.40:0/3885855513 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f63ec09e230 0x7f63ec122db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:52.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.045+0000 7f63f17d5700 1 -- 172.21.15.40:0/3885855513 >> 172.21.15.40:0/3885855513 conn(0x7f63ec09fb20 msgr2=0x7f63ec06e710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:52.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.045+0000 7f63f17d5700 1 -- 172.21.15.40:0/3885855513 shutdown_connections 2023-09-30T22:28:52.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.045+0000 7f63f17d5700 1 -- 172.21.15.40:0/3885855513 wait complete. 2023-09-30T22:28:52.051 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:52.058 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:52.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.117+0000 7ff968fb6700 1 -- 172.21.15.40:0/2748914149 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff96412f390 con 0x7ff96409d920 2023-09-30T22:28:52.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.117+0000 7ff952ffd700 1 -- 172.21.15.40:0/2748914149 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff954020020 con 0x7ff96409d920 2023-09-30T22:28:52.117 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:52.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.120+0000 7ff968fb6700 1 -- 172.21.15.40:0/2748914149 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff96409d920 msgr2=0x7ff96412bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:52.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.120+0000 7ff968fb6700 1 --2- 172.21.15.40:0/2748914149 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff96409d920 0x7ff96412bfc0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff954000c00 tx=0x7ff954004750 comp rx=0 tx=0).stop 2023-09-30T22:28:52.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.120+0000 7ff968fb6700 1 -- 172.21.15.40:0/2748914149 shutdown_connections 2023-09-30T22:28:52.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.120+0000 7ff968fb6700 1 --2- 172.21.15.40:0/2748914149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff964130de0 0x7ff96412ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:52.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.120+0000 7ff968fb6700 1 --2- 172.21.15.40:0/2748914149 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff96409d920 0x7ff96412bfc0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:52.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.120+0000 7ff968fb6700 1 --2- 172.21.15.40:0/2748914149 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff96409e230 0x7ff96412c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:52.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.120+0000 7ff968fb6700 1 -- 172.21.15.40:0/2748914149 >> 172.21.15.40:0/2748914149 conn(0x7ff96409fb20 msgr2=0x7ff9641299a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:52.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.120+0000 7ff968fb6700 1 -- 172.21.15.40:0/2748914149 shutdown_connections 2023-09-30T22:28:52.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.120+0000 7ff968fb6700 1 -- 172.21.15.40:0/2748914149 wait complete. 2023-09-30T22:28:52.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.136+0000 7f4fd866a700 1 -- 172.21.15.40:0/2502957585 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4fd012ea20 con 0x7f4fd009d920 2023-09-30T22:28:52.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.136+0000 7f4fc6ffd700 1 -- 172.21.15.40:0/2502957585 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4fc0024470 con 0x7f4fd009d920 2023-09-30T22:28:52.136 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:52.137 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:52.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.138+0000 7f4fd866a700 1 -- 172.21.15.40:0/2502957585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fd009d920 msgr2=0x7f4fd012fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:52.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.138+0000 7f4fd866a700 1 --2- 172.21.15.40:0/2502957585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fd009d920 0x7f4fd012fc90 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0009c40 tx=0x7f4fc0004750 comp rx=0 tx=0).stop 2023-09-30T22:28:52.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.138+0000 7f4fd866a700 1 -- 172.21.15.40:0/2502957585 shutdown_connections 2023-09-30T22:28:52.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.138+0000 7f4fd866a700 1 --2- 172.21.15.40:0/2502957585 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fd009e2b0 0x7f4fd01301d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:52.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.139+0000 7f4fd866a700 1 --2- 172.21.15.40:0/2502957585 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fd009c890 0x7f4fd012f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:52.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.139+0000 7f4fd866a700 1 --2- 172.21.15.40:0/2502957585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fd009d920 0x7f4fd012fc90 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:52.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.139+0000 7f4fd866a700 1 -- 172.21.15.40:0/2502957585 >> 172.21.15.40:0/2502957585 conn(0x7f4fd00a7080 msgr2=0x7f4fd01bb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:52.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.139+0000 7f4fd866a700 1 -- 172.21.15.40:0/2502957585 shutdown_connections 2023-09-30T22:28:52.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.139+0000 7f4fd866a700 1 -- 172.21.15.40:0/2502957585 wait complete. 2023-09-30T22:28:52.151 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:52.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.180+0000 7f5b02c5d700 1 Processor -- start 2023-09-30T22:28:52.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.180+0000 7f5b02c5d700 1 -- start start 2023-09-30T22:28:52.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.181+0000 7f5b02c5d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5afc06f3a0 0x7f5afc06c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:52.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.181+0000 7f5b02c5d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5afc139380 0x7f5afc13b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:52.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.181+0000 7f5b02c5d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5afc0a0780 con 0x7f5afc09fbb0 2023-09-30T22:28:52.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.181+0000 7f5b02c5d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5afc0a0590 con 0x7f5afc139380 2023-09-30T22:28:52.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.181+0000 7f5b02c5d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc06bac0 con 0x7f5afc06f3a0 2023-09-30T22:28:52.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.181+0000 7f5b009f9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5afc06f3a0 0x7f5afc06c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:52.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.181+0000 7f5b011fa700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5afc139380 0x7f5afc13b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:52.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.181+0000 7f5b009f9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5afc06f3a0 0x7f5afc06c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:44574/0 (socket says 172.21.15.40:44574) 2023-09-30T22:28:52.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.181+0000 7f5b009f9700 1 -- 172.21.15.40:0/4062767170 learned_addr learned my addr 172.21.15.40:0/4062767170 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:52.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.181+0000 7f5b011fa700 1 -- 172.21.15.40:0/4062767170 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5afc06f3a0 msgr2=0x7f5afc06c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:52.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.181+0000 7f5b011fa700 1 --2- 172.21.15.40:0/4062767170 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5afc06f3a0 0x7f5afc06c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:52.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.181+0000 7f5b011fa700 1 -- 172.21.15.40:0/4062767170 >> v1:172.21.15.40:6789/0 conn(0x7f5afc09fbb0 legacy=0x7f5afc06ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:52.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.181+0000 7f5b011fa700 1 -- 172.21.15.40:0/4062767170 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc06df90 con 0x7f5afc139380 2023-09-30T22:28:52.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.181+0000 7f5b011fa700 1 --2- 172.21.15.40:0/4062767170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc139380 0x7f5afc13b760 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f5af4009d90 tx=0x7f5af400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c758e55c1ebe0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:52.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.181+0000 7f5afb7fe700 1 -- 172.21.15.40:0/4062767170 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af400e070 con 0x7f5afc139380 2023-09-30T22:28:52.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.181+0000 7f5afb7fe700 1 -- 172.21.15.40:0/4062767170 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af400bb20 con 0x7f5afc139380 2023-09-30T22:28:52.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.181+0000 7f5afb7fe700 1 -- 172.21.15.40:0/4062767170 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af4012430 con 0x7f5afc139380 2023-09-30T22:28:52.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.182+0000 7f5b02c5d700 1 -- 172.21.15.40:0/4062767170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc139380 msgr2=0x7f5afc13b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:52.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.182+0000 7f5b02c5d700 1 --2- 172.21.15.40:0/4062767170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc139380 0x7f5afc13b760 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f5af4009d90 tx=0x7f5af400b330 comp rx=0 tx=0).stop 2023-09-30T22:28:52.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.182+0000 7f5b02c5d700 1 -- 172.21.15.40:0/4062767170 shutdown_connections 2023-09-30T22:28:52.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.182+0000 7f5b02c5d700 1 --2- 172.21.15.40:0/4062767170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc139380 0x7f5afc13b760 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:52.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.182+0000 7f5b02c5d700 1 --2- 172.21.15.40:0/4062767170 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5afc06f3a0 0x7f5afc06c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:52.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.182+0000 7f5b02c5d700 1 -- 172.21.15.40:0/4062767170 >> 172.21.15.40:0/4062767170 conn(0x7f5afc0a41a0 msgr2=0x7f5afc0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:52.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.182+0000 7f5b02c5d700 1 -- 172.21.15.40:0/4062767170 shutdown_connections 2023-09-30T22:28:52.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.182+0000 7f5b02c5d700 1 -- 172.21.15.40:0/4062767170 wait complete. 2023-09-30T22:28:52.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.183+0000 7f5b02c5d700 1 Processor -- start 2023-09-30T22:28:52.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.183+0000 7f5b02c5d700 1 -- start start 2023-09-30T22:28:52.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.183+0000 7f5b02c5d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc06f3a0 0x7f5afc138860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:52.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.183+0000 7f5b02c5d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5afc09fbb0 0x7f5afc138da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:52.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.183+0000 7f5b02c5d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5afc139380 0x7f5afc095ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:52.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.184+0000 7f5b02c5d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc096e30 con 0x7f5afc06f3a0 2023-09-30T22:28:52.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.184+0000 7f5b02c5d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc093a10 con 0x7f5afc09fbb0 2023-09-30T22:28:52.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.184+0000 7f5b02c5d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc0950c0 con 0x7f5afc139380 2023-09-30T22:28:52.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.184+0000 7f5b009f9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc06f3a0 0x7f5afc138860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:52.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.184+0000 7f5b011fa700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5afc139380 0x7f5afc095ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:52.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.184+0000 7f5b009f9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc06f3a0 0x7f5afc138860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35914/0 (socket says 172.21.15.40:35914) 2023-09-30T22:28:52.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.184+0000 7f5b009f9700 1 -- 172.21.15.40:0/3009844748 learned_addr learned my addr 172.21.15.40:0/3009844748 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:52.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.184+0000 7f5afbfff700 1 --2- 172.21.15.40:0/3009844748 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5afc09fbb0 0x7f5afc138da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:52.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.184+0000 7f5b009f9700 1 -- 172.21.15.40:0/3009844748 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5afc139380 msgr2=0x7f5afc095ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:52.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.184+0000 7f5b009f9700 1 --2- 172.21.15.40:0/3009844748 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5afc139380 0x7f5afc095ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:52.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.184+0000 7f5b009f9700 1 -- 172.21.15.40:0/3009844748 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5afc09fbb0 msgr2=0x7f5afc138da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:52.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.184+0000 7f5b009f9700 1 --2- 172.21.15.40:0/3009844748 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5afc09fbb0 0x7f5afc138da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:52.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.184+0000 7f5b009f9700 1 -- 172.21.15.40:0/3009844748 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af4009a70 con 0x7f5afc06f3a0 2023-09-30T22:28:52.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.184+0000 7f5b011fa700 1 --2- 172.21.15.40:0/3009844748 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5afc139380 0x7f5afc095ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:52.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.184+0000 7f5b009f9700 1 --2- 172.21.15.40:0/3009844748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc06f3a0 0x7f5afc138860 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00e8b0 tx=0x7f5aec00ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:52.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.184+0000 7f5af97fa700 1 -- 172.21.15.40:0/3009844748 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec009600 con 0x7f5afc06f3a0 2023-09-30T22:28:52.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.184+0000 7f5af97fa700 1 -- 172.21.15.40:0/3009844748 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aec013680 con 0x7f5afc06f3a0 2023-09-30T22:28:52.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.184+0000 7f5b02c5d700 1 -- 172.21.15.40:0/3009844748 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5afc093760 con 0x7f5afc06f3a0 2023-09-30T22:28:52.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.184+0000 7f5af97fa700 1 -- 172.21.15.40:0/3009844748 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec013a30 con 0x7f5afc06f3a0 2023-09-30T22:28:52.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.184+0000 7f5b02c5d700 1 -- 172.21.15.40:0/3009844748 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5afc094de0 con 0x7f5afc06f3a0 2023-09-30T22:28:52.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.185+0000 7f5af97fa700 1 -- 172.21.15.40:0/3009844748 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5aec013b90 con 0x7f5afc06f3a0 2023-09-30T22:28:52.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.185+0000 7f5af97fa700 1 -- 172.21.15.40:0/3009844748 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5aec03f900 con 0x7f5afc06f3a0 2023-09-30T22:28:52.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.185+0000 7f5b02c5d700 1 -- 172.21.15.40:0/3009844748 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5afc062380 con 0x7f5afc06f3a0 2023-09-30T22:28:52.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.190+0000 7f5af97fa700 1 -- 172.21.15.40:0/3009844748 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5aec017020 con 0x7f5afc06f3a0 2023-09-30T22:28:52.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.381+0000 7f5b02c5d700 1 -- 172.21.15.40:0/3009844748 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5afc06e3c0 con 0x7f5afc06f3a0 2023-09-30T22:28:52.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.381+0000 7f5af97fa700 1 -- 172.21.15.40:0/3009844748 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5aec01ae40 con 0x7f5afc06f3a0 2023-09-30T22:28:52.381 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:52.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.383+0000 7f5b02c5d700 1 -- 172.21.15.40:0/3009844748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc06f3a0 msgr2=0x7f5afc138860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:52.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.383+0000 7f5b02c5d700 1 --2- 172.21.15.40:0/3009844748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc06f3a0 0x7f5afc138860 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00e8b0 tx=0x7f5aec00ebc0 comp rx=0 tx=0).stop 2023-09-30T22:28:52.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.383+0000 7f5b02c5d700 1 -- 172.21.15.40:0/3009844748 shutdown_connections 2023-09-30T22:28:52.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.383+0000 7f5b02c5d700 1 --2- 172.21.15.40:0/3009844748 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5afc139380 0x7f5afc095ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:52.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.383+0000 7f5b02c5d700 1 --2- 172.21.15.40:0/3009844748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc06f3a0 0x7f5afc138860 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:52.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.383+0000 7f5b02c5d700 1 --2- 172.21.15.40:0/3009844748 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5afc09fbb0 0x7f5afc138da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:52.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.383+0000 7f5b02c5d700 1 -- 172.21.15.40:0/3009844748 >> 172.21.15.40:0/3009844748 conn(0x7f5afc0a41a0 msgr2=0x7f5afc06f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:52.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.383+0000 7f5b02c5d700 1 -- 172.21.15.40:0/3009844748 shutdown_connections 2023-09-30T22:28:52.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:52.383+0000 7f5b02c5d700 1 -- 172.21.15.40:0/3009844748 wait complete. 2023-09-30T22:28:52.395 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:53.059 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:53.138 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:53.152 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:53.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.203+0000 7fe21186d700 1 Processor -- start 2023-09-30T22:28:53.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.203+0000 7fe21186d700 1 -- start start 2023-09-30T22:28:53.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.204+0000 7fe21186d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe20c12e590 0x7fe20c12e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.204+0000 7fe21186d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe20c12d8a0 0x7fe20c138c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.204+0000 7fe21186d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe20c09ab70 con 0x7fe20c12eea0 2023-09-30T22:28:53.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.204+0000 7fe21186d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c09b270 con 0x7fe20c12d8a0 2023-09-30T22:28:53.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.204+0000 7fe21186d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c09bab0 con 0x7fe20c12e590 2023-09-30T22:28:53.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.204+0000 7fe20affd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe20c12e590 0x7fe20c12e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.204+0000 7fe20a7fc700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe20c12eea0 0x7fe20c12d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51220/0 (socket says 172.21.15.40:51220) 2023-09-30T22:28:53.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.204+0000 7fe20a7fc700 1 -- 172.21.15.40:0/1672104573 learned_addr learned my addr 172.21.15.40:0/1672104573 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:53.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.204+0000 7fe20b7fe700 1 --2- 172.21.15.40:0/1672104573 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe20c12d8a0 0x7fe20c138c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.204+0000 7fe209ffb700 1 -- 172.21.15.40:0/1672104573 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1855939976 0 0) 0x7fe20c09ab70 con 0x7fe20c12eea0 2023-09-30T22:28:53.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.204+0000 7fe209ffb700 1 -- 172.21.15.40:0/1672104573 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1f40035b0 con 0x7fe20c12eea0 2023-09-30T22:28:53.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.204+0000 7fe20b7fe700 1 -- 172.21.15.40:0/1672104573 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe20c12e590 msgr2=0x7fe20c12e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:53.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.204+0000 7fe20b7fe700 1 --2- 172.21.15.40:0/1672104573 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe20c12e590 0x7fe20c12e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.204+0000 7fe20b7fe700 1 -- 172.21.15.40:0/1672104573 >> v1:172.21.15.40:6789/0 conn(0x7fe20c12eea0 legacy=0x7fe20c12d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.204+0000 7fe20b7fe700 1 -- 172.21.15.40:0/1672104573 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe20c09bd70 con 0x7fe20c12d8a0 2023-09-30T22:28:53.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.204+0000 7fe20affd700 1 --2- 172.21.15.40:0/1672104573 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe20c12e590 0x7fe20c12e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:53.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.205+0000 7fe20b7fe700 1 --2- 172.21.15.40:0/1672104573 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe20c12d8a0 0x7fe20c138c50 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe204009dc0 tx=0x7fe20400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb9c7f4bd0648432 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:53.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.205+0000 7fe209ffb700 1 -- 172.21.15.40:0/1672104573 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20400e070 con 0x7fe20c12d8a0 2023-09-30T22:28:53.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.205+0000 7fe209ffb700 1 -- 172.21.15.40:0/1672104573 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe20400bb20 con 0x7fe20c12d8a0 2023-09-30T22:28:53.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.205+0000 7fe209ffb700 1 -- 172.21.15.40:0/1672104573 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe204012430 con 0x7fe20c12d8a0 2023-09-30T22:28:53.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.206+0000 7fe21186d700 1 -- 172.21.15.40:0/1672104573 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe20c12d8a0 msgr2=0x7fe20c138c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.206+0000 7fe21186d700 1 --2- 172.21.15.40:0/1672104573 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe20c12d8a0 0x7fe20c138c50 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe204009dc0 tx=0x7fe20400b330 comp rx=0 tx=0).stop 2023-09-30T22:28:53.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.206+0000 7fe21186d700 1 -- 172.21.15.40:0/1672104573 shutdown_connections 2023-09-30T22:28:53.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.206+0000 7fe21186d700 1 --2- 172.21.15.40:0/1672104573 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe20c12d8a0 0x7fe20c138c50 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.206+0000 7fe21186d700 1 --2- 172.21.15.40:0/1672104573 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe20c12e590 0x7fe20c12e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.206+0000 7fe21186d700 1 -- 172.21.15.40:0/1672104573 >> 172.21.15.40:0/1672104573 conn(0x7fe20c0a2a00 msgr2=0x7fe20c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:53.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.206+0000 7fe21186d700 1 -- 172.21.15.40:0/1672104573 shutdown_connections 2023-09-30T22:28:53.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.206+0000 7fe21186d700 1 -- 172.21.15.40:0/1672104573 wait complete. 2023-09-30T22:28:53.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.207+0000 7fe21186d700 1 Processor -- start 2023-09-30T22:28:53.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.207+0000 7fe21186d700 1 -- start start 2023-09-30T22:28:53.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.208+0000 7fe21186d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe20c12d8a0 0x7fe20c13abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.208+0000 7fe21186d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe20c12e590 0x7fe20c13b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.208+0000 7fe21186d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe20c12eea0 0x7fe20c1c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.208+0000 7fe21186d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c09b4b0 con 0x7fe20c12e590 2023-09-30T22:28:53.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.208+0000 7fe21186d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c138ad0 con 0x7fe20c12d8a0 2023-09-30T22:28:53.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.208+0000 7fe21186d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c13b670 con 0x7fe20c12eea0 2023-09-30T22:28:53.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.208+0000 7fe20affd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe20c12d8a0 0x7fe20c13abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.208+0000 7fe20affd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe20c12d8a0 0x7fe20c13abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38550/0 (socket says 172.21.15.40:38550) 2023-09-30T22:28:53.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.208+0000 7fe20affd700 1 -- 172.21.15.40:0/722018797 learned_addr learned my addr 172.21.15.40:0/722018797 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:53.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.208+0000 7fe20a7fc700 1 --2- 172.21.15.40:0/722018797 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe20c12e590 0x7fe20c13b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.208+0000 7fe20b7fe700 1 --2- 172.21.15.40:0/722018797 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe20c12eea0 0x7fe20c1c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.208+0000 7fe20affd700 1 -- 172.21.15.40:0/722018797 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe20c12eea0 msgr2=0x7fe20c1c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.208+0000 7fe20affd700 1 --2- 172.21.15.40:0/722018797 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe20c12eea0 0x7fe20c1c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.208+0000 7fe20affd700 1 -- 172.21.15.40:0/722018797 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe20c12e590 msgr2=0x7fe20c13b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.208+0000 7fe20affd700 1 --2- 172.21.15.40:0/722018797 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe20c12e590 0x7fe20c13b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.208+0000 7fe20affd700 1 -- 172.21.15.40:0/722018797 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1fc0094a0 con 0x7fe20c12d8a0 2023-09-30T22:28:53.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.209+0000 7fe20affd700 1 --2- 172.21.15.40:0/722018797 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe20c12d8a0 0x7fe20c13abf0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc00ebe0 tx=0x7fe1fc00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:53.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.209+0000 7fe1f3fff700 1 -- 172.21.15.40:0/722018797 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc00c850 con 0x7fe20c12d8a0 2023-09-30T22:28:53.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.209+0000 7fe1f3fff700 1 -- 172.21.15.40:0/722018797 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1fc00c9b0 con 0x7fe20c12d8a0 2023-09-30T22:28:53.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.209+0000 7fe21186d700 1 -- 172.21.15.40:0/722018797 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe204009a70 con 0x7fe20c12d8a0 2023-09-30T22:28:53.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.209+0000 7fe1f3fff700 1 -- 172.21.15.40:0/722018797 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc00cd40 con 0x7fe20c12d8a0 2023-09-30T22:28:53.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.209+0000 7fe21186d700 1 -- 172.21.15.40:0/722018797 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe20c13bd50 con 0x7fe20c12d8a0 2023-09-30T22:28:53.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.210+0000 7fe1f3fff700 1 -- 172.21.15.40:0/722018797 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe1fc013470 con 0x7fe20c12d8a0 2023-09-30T22:28:53.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.210+0000 7fe1f3fff700 1 -- 172.21.15.40:0/722018797 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe1fc03fb90 con 0x7fe20c12d8a0 2023-09-30T22:28:53.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.210+0000 7fe21186d700 1 -- 172.21.15.40:0/722018797 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe20c062380 con 0x7fe20c12d8a0 2023-09-30T22:28:53.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.215+0000 7fe1f3fff700 1 -- 172.21.15.40:0/722018797 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe1fc017030 con 0x7fe20c12d8a0 2023-09-30T22:28:53.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.277+0000 7f3769650700 1 Processor -- start 2023-09-30T22:28:53.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.277+0000 7f3769650700 1 -- start start 2023-09-30T22:28:53.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.278+0000 7f3769650700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f376409c890 0x7f376409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.278+0000 7f3769650700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f376409e480 0x7f376413bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.278+0000 7f3769650700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37640a2600 con 0x7f376409d920 2023-09-30T22:28:53.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.278+0000 7f3769650700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37640a29d0 con 0x7f376409e480 2023-09-30T22:28:53.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.278+0000 7f3769650700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f376409fb40 con 0x7f376409c890 2023-09-30T22:28:53.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.278+0000 7f3762ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f376409c890 0x7f376409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.278+0000 7f3762ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f376409c890 0x7f376409cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:57782/0 (socket says 172.21.15.40:57782) 2023-09-30T22:28:53.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.278+0000 7f3762ffd700 1 -- 172.21.15.40:0/434938860 learned_addr learned my addr 172.21.15.40:0/434938860 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:53.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.278+0000 7f37637fe700 1 --2- 172.21.15.40:0/434938860 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f376409e480 0x7f376413bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.278+0000 7f3762ffd700 1 -- 172.21.15.40:0/434938860 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f376409e480 msgr2=0x7f376413bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:53.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.278+0000 7f3762ffd700 1 --2- 172.21.15.40:0/434938860 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f376409e480 0x7f376413bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.278+0000 7f3762ffd700 1 -- 172.21.15.40:0/434938860 >> v1:172.21.15.40:6789/0 conn(0x7f376409d920 legacy=0x7f376409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:53.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.278+0000 7f3762ffd700 1 -- 172.21.15.40:0/434938860 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376409fed0 con 0x7f376409c890 2023-09-30T22:28:53.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.278+0000 7f37637fe700 1 --2- 172.21.15.40:0/434938860 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f376409e480 0x7f376413bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:53.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.278+0000 7f3762ffd700 1 --2- 172.21.15.40:0/434938860 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f376409c890 0x7f376409cc60 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f37540098f0 tx=0x7f3754009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb6fcd3e645c239d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:53.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.279+0000 7f3761ffb700 1 -- 172.21.15.40:0/434938860 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3754005e30 con 0x7f376409c890 2023-09-30T22:28:53.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.279+0000 7f3761ffb700 1 -- 172.21.15.40:0/434938860 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3754004030 con 0x7f376409c890 2023-09-30T22:28:53.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.279+0000 7f3761ffb700 1 -- 172.21.15.40:0/434938860 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37540043e0 con 0x7f376409c890 2023-09-30T22:28:53.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.279+0000 7f3769650700 1 -- 172.21.15.40:0/434938860 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f376409c890 msgr2=0x7f376409cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.279+0000 7f3769650700 1 --2- 172.21.15.40:0/434938860 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f376409c890 0x7f376409cc60 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f37540098f0 tx=0x7f3754009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:53.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.279+0000 7f3769650700 1 -- 172.21.15.40:0/434938860 shutdown_connections 2023-09-30T22:28:53.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.279+0000 7f3769650700 1 --2- 172.21.15.40:0/434938860 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f376409e480 0x7f376413bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.279+0000 7f3769650700 1 --2- 172.21.15.40:0/434938860 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f376409c890 0x7f376409cc60 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.279+0000 7f3769650700 1 -- 172.21.15.40:0/434938860 >> 172.21.15.40:0/434938860 conn(0x7f37640a7080 msgr2=0x7f37640a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:53.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.280+0000 7f3769650700 1 -- 172.21.15.40:0/434938860 shutdown_connections 2023-09-30T22:28:53.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.280+0000 7f3769650700 1 -- 172.21.15.40:0/434938860 wait complete. 2023-09-30T22:28:53.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.281+0000 7f3769650700 1 Processor -- start 2023-09-30T22:28:53.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.281+0000 7f3769650700 1 -- start start 2023-09-30T22:28:53.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.282+0000 7f3769650700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f376409c890 0x7f376412d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.282+0000 7f3769650700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f376409d920 0x7f376412dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.282+0000 7f3769650700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f376409e480 0x7f376412e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.282+0000 7f3769650700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3764130b40 con 0x7f376409e480 2023-09-30T22:28:53.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.282+0000 7f3769650700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3764130590 con 0x7f376409d920 2023-09-30T22:28:53.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.282+0000 7f3769650700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3764130880 con 0x7f376409c890 2023-09-30T22:28:53.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.282+0000 7f37627fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f376409d920 0x7f376412dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.282+0000 7f37627fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f376409d920 0x7f376412dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38568/0 (socket says 172.21.15.40:38568) 2023-09-30T22:28:53.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.282+0000 7f3762ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f376409c890 0x7f376412d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.282+0000 7f37627fc700 1 -- 172.21.15.40:0/2434778108 learned_addr learned my addr 172.21.15.40:0/2434778108 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:53.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.282+0000 7f37637fe700 1 --2- 172.21.15.40:0/2434778108 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f376409e480 0x7f376412e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.282+0000 7f3762ffd700 1 -- 172.21.15.40:0/2434778108 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f376409d920 msgr2=0x7f376412dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.282+0000 7f3762ffd700 1 --2- 172.21.15.40:0/2434778108 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f376409d920 0x7f376412dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.282+0000 7f3762ffd700 1 -- 172.21.15.40:0/2434778108 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f376409e480 msgr2=0x7f376412e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.282+0000 7f3762ffd700 1 --2- 172.21.15.40:0/2434778108 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f376409e480 0x7f376412e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.282+0000 7f3762ffd700 1 -- 172.21.15.40:0/2434778108 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375c009a70 con 0x7f376409c890 2023-09-30T22:28:53.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.282+0000 7f37627fc700 1 --2- 172.21.15.40:0/2434778108 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f376409d920 0x7f376412dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:53.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.283+0000 7f3762ffd700 1 --2- 172.21.15.40:0/2434778108 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f376409c890 0x7f376412d6f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f3754013000 tx=0x7f3754004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:53.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.283+0000 7f374b7fe700 1 -- 172.21.15.40:0/2434778108 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3754003ce0 con 0x7f376409c890 2023-09-30T22:28:53.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.283+0000 7f374b7fe700 1 -- 172.21.15.40:0/2434778108 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3754003e60 con 0x7f376409c890 2023-09-30T22:28:53.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.283+0000 7f3769650700 1 -- 172.21.15.40:0/2434778108 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3754009500 con 0x7f376409c890 2023-09-30T22:28:53.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.283+0000 7f374b7fe700 1 -- 172.21.15.40:0/2434778108 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375401c660 con 0x7f376409c890 2023-09-30T22:28:53.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.283+0000 7f3769650700 1 -- 172.21.15.40:0/2434778108 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f376412e6b0 con 0x7f376409c890 2023-09-30T22:28:53.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.284+0000 7f374b7fe700 1 -- 172.21.15.40:0/2434778108 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f375401c7c0 con 0x7f376409c890 2023-09-30T22:28:53.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.284+0000 7f3769650700 1 -- 172.21.15.40:0/2434778108 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3764062380 con 0x7f376409c890 2023-09-30T22:28:53.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.284+0000 7f374b7fe700 1 -- 172.21.15.40:0/2434778108 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3754040400 con 0x7f376409c890 2023-09-30T22:28:53.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.289+0000 7f374b7fe700 1 -- 172.21.15.40:0/2434778108 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3754020020 con 0x7f376409c890 2023-09-30T22:28:53.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.321+0000 7f893699d700 1 Processor -- start 2023-09-30T22:28:53.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.321+0000 7f893699d700 1 -- start start 2023-09-30T22:28:53.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.322+0000 7f893699d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f893009d920 0x7f893009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.322+0000 7f893699d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f893009e230 0x7f89301308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.322+0000 7f893699d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8930130de0 0x7f8930131260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.322+0000 7f893699d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f893009edf0 con 0x7f893009e230 2023-09-30T22:28:53.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.322+0000 7f893699d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f893009adf0 con 0x7f8930130de0 2023-09-30T22:28:53.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.322+0000 7f893699d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f893009b660 con 0x7f893009d920 2023-09-30T22:28:53.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.322+0000 7f892ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f893009d920 0x7f893009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.322+0000 7f892f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f893009e230 0x7f89301308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.322+0000 7f8934f3a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8930130de0 0x7f8930131260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.322+0000 7f892ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f893009d920 0x7f893009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:57798/0 (socket says 172.21.15.40:57798) 2023-09-30T22:28:53.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.322+0000 7f892f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f893009e230 0x7f89301308a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50592/0 (socket says 172.21.15.40:50592) 2023-09-30T22:28:53.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.322+0000 7f892ffff700 1 -- 172.21.15.40:0/2594882198 learned_addr learned my addr 172.21.15.40:0/2594882198 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:53.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.322+0000 7f892ffff700 1 -- 172.21.15.40:0/2594882198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8930130de0 msgr2=0x7f8930131260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:53.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.322+0000 7f892ffff700 1 --2- 172.21.15.40:0/2594882198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8930130de0 0x7f8930131260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.322+0000 7f892ffff700 1 -- 172.21.15.40:0/2594882198 >> v2:172.21.15.40:3300/0 conn(0x7f893009e230 msgr2=0x7f89301308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:53.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.322+0000 7f892ffff700 1 --2- 172.21.15.40:0/2594882198 >> v2:172.21.15.40:3300/0 conn(0x7f893009e230 0x7f89301308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.322+0000 7f892ffff700 1 -- 172.21.15.40:0/2594882198 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893009a6e0 con 0x7f893009d920 2023-09-30T22:28:53.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.322+0000 7f8934f3a700 1 --2- 172.21.15.40:0/2594882198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8930130de0 0x7f8930131260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:53.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.323+0000 7f892ffff700 1 --2- 172.21.15.40:0/2594882198 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f893009d920 0x7f893009dcf0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f8920006fd0 tx=0x7f8920009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d7a8b995adc98d2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:53.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.323+0000 7f892effd700 1 -- 172.21.15.40:0/2594882198 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8920005e30 con 0x7f893009d920 2023-09-30T22:28:53.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.323+0000 7f892effd700 1 -- 172.21.15.40:0/2594882198 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8920004030 con 0x7f893009d920 2023-09-30T22:28:53.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.323+0000 7f892effd700 1 -- 172.21.15.40:0/2594882198 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89200043e0 con 0x7f893009d920 2023-09-30T22:28:53.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.323+0000 7f893699d700 1 -- 172.21.15.40:0/2594882198 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f893009d920 msgr2=0x7f893009dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.323+0000 7f893699d700 1 --2- 172.21.15.40:0/2594882198 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f893009d920 0x7f893009dcf0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f8920006fd0 tx=0x7f8920009bd0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.323+0000 7f893699d700 1 -- 172.21.15.40:0/2594882198 shutdown_connections 2023-09-30T22:28:53.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.323+0000 7f893699d700 1 --2- 172.21.15.40:0/2594882198 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f893009d920 0x7f893009dcf0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.323+0000 7f893699d700 1 --2- 172.21.15.40:0/2594882198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8930130de0 0x7f8930131260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.323+0000 7f893699d700 1 --2- 172.21.15.40:0/2594882198 >> v2:172.21.15.40:3300/0 conn(0x7f893009e230 0x7f89301308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.323+0000 7f893699d700 1 -- 172.21.15.40:0/2594882198 >> 172.21.15.40:0/2594882198 conn(0x7f893009fb20 msgr2=0x7f893009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:53.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.323+0000 7f893699d700 1 -- 172.21.15.40:0/2594882198 shutdown_connections 2023-09-30T22:28:53.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.323+0000 7f893699d700 1 -- 172.21.15.40:0/2594882198 wait complete. 2023-09-30T22:28:53.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.325+0000 7f893699d700 1 Processor -- start 2023-09-30T22:28:53.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.325+0000 7f893699d700 1 -- start start 2023-09-30T22:28:53.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.325+0000 7f893699d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f893009d920 0x7f893011f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.326+0000 7f893699d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f893009e230 0x7f893011f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.326+0000 7f893699d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8930130de0 0x7f893011fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.326+0000 7f893699d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8930122e00 con 0x7f893009e230 2023-09-30T22:28:53.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.326+0000 7f893699d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f893009cb70 con 0x7f893009d920 2023-09-30T22:28:53.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.326+0000 7f893699d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f893009a210 con 0x7f8930130de0 2023-09-30T22:28:53.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.326+0000 7f892f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f893009e230 0x7f893011f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.326+0000 7f892f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f893009e230 0x7f893011f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50606/0 (socket says 172.21.15.40:50606) 2023-09-30T22:28:53.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.326+0000 7f892f7fe700 1 -- 172.21.15.40:0/1502103607 learned_addr learned my addr 172.21.15.40:0/1502103607 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:53.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.326+0000 7f892ffff700 1 --2- 172.21.15.40:0/1502103607 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f893009d920 0x7f893011f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.326+0000 7f8934f3a700 1 --2- 172.21.15.40:0/1502103607 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8930130de0 0x7f893011fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.326+0000 7f892ffff700 1 -- 172.21.15.40:0/1502103607 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8930130de0 msgr2=0x7f893011fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.326+0000 7f892ffff700 1 --2- 172.21.15.40:0/1502103607 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8930130de0 0x7f893011fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.326+0000 7f892ffff700 1 -- 172.21.15.40:0/1502103607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f893009e230 msgr2=0x7f893011f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.326+0000 7f892ffff700 1 --2- 172.21.15.40:0/1502103607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f893009e230 0x7f893011f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.326+0000 7f892ffff700 1 -- 172.21.15.40:0/1502103607 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8928009a70 con 0x7f893009d920 2023-09-30T22:28:53.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.326+0000 7f892f7fe700 1 --2- 172.21.15.40:0/1502103607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f893009e230 0x7f893011f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:53.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.326+0000 7f892ffff700 1 --2- 172.21.15.40:0/1502103607 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f893009d920 0x7f893011f370 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f8920009fd0 tx=0x7f8920004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:53.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.326+0000 7f892cff9700 1 -- 172.21.15.40:0/1502103607 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89200043f0 con 0x7f893009d920 2023-09-30T22:28:53.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.326+0000 7f892cff9700 1 -- 172.21.15.40:0/1502103607 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8920003dd0 con 0x7f893009d920 2023-09-30T22:28:53.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.326+0000 7f892cff9700 1 -- 172.21.15.40:0/1502103607 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892001c660 con 0x7f893009d920 2023-09-30T22:28:53.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.327+0000 7f893699d700 1 -- 172.21.15.40:0/1502103607 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8920009500 con 0x7f893009d920 2023-09-30T22:28:53.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.327+0000 7f893699d700 1 -- 172.21.15.40:0/1502103607 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8930122140 con 0x7f893009d920 2023-09-30T22:28:53.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.328+0000 7f892cff9700 1 -- 172.21.15.40:0/1502103607 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f892001c7c0 con 0x7f893009d920 2023-09-30T22:28:53.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.328+0000 7f893699d700 1 -- 172.21.15.40:0/1502103607 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f893011bee0 con 0x7f893009d920 2023-09-30T22:28:53.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.328+0000 7f892cff9700 1 -- 172.21.15.40:0/1502103607 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f8920040280 con 0x7f893009d920 2023-09-30T22:28:53.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.337+0000 7f892cff9700 1 -- 172.21.15.40:0/1502103607 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f892001ca70 con 0x7f893009d920 2023-09-30T22:28:53.396 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:53.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.420+0000 7fe21186d700 1 -- 172.21.15.40:0/722018797 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe20c138350 con 0x7fe20c12d8a0 2023-09-30T22:28:53.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.420+0000 7fe1f3fff700 1 -- 172.21.15.40:0/722018797 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe1fc02b090 con 0x7fe20c12d8a0 2023-09-30T22:28:53.420 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:53.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.423+0000 7fe21186d700 1 -- 172.21.15.40:0/722018797 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe20c12d8a0 msgr2=0x7fe20c13abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.423+0000 7fe21186d700 1 --2- 172.21.15.40:0/722018797 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe20c12d8a0 0x7fe20c13abf0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc00ebe0 tx=0x7fe1fc00eef0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.423+0000 7fe21186d700 1 -- 172.21.15.40:0/722018797 shutdown_connections 2023-09-30T22:28:53.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.423+0000 7fe21186d700 1 --2- 172.21.15.40:0/722018797 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe20c12eea0 0x7fe20c1c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.423+0000 7fe21186d700 1 --2- 172.21.15.40:0/722018797 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe20c12d8a0 0x7fe20c13abf0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.423+0000 7fe21186d700 1 --2- 172.21.15.40:0/722018797 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe20c12e590 0x7fe20c13b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.423+0000 7fe21186d700 1 -- 172.21.15.40:0/722018797 >> 172.21.15.40:0/722018797 conn(0x7fe20c0a2a00 msgr2=0x7fe20c130cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:53.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.424+0000 7fe21186d700 1 -- 172.21.15.40:0/722018797 shutdown_connections 2023-09-30T22:28:53.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.424+0000 7fe21186d700 1 -- 172.21.15.40:0/722018797 wait complete. 2023-09-30T22:28:53.437 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:53.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.497+0000 7f3769650700 1 -- 172.21.15.40:0/2434778108 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3764130d60 con 0x7f376409c890 2023-09-30T22:28:53.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.497+0000 7f374b7fe700 1 -- 172.21.15.40:0/2434778108 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3754016070 con 0x7f376409c890 2023-09-30T22:28:53.497 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:53.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.499+0000 7f3769650700 1 -- 172.21.15.40:0/2434778108 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f376409c890 msgr2=0x7f376412d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.499+0000 7f3769650700 1 --2- 172.21.15.40:0/2434778108 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f376409c890 0x7f376412d6f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f3754013000 tx=0x7f3754004750 comp rx=0 tx=0).stop 2023-09-30T22:28:53.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.499+0000 7f3769650700 1 -- 172.21.15.40:0/2434778108 shutdown_connections 2023-09-30T22:28:53.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.499+0000 7f3769650700 1 --2- 172.21.15.40:0/2434778108 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f376409c890 0x7f376412d6f0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.499+0000 7f3769650700 1 --2- 172.21.15.40:0/2434778108 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f376409e480 0x7f376412e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.499+0000 7f3769650700 1 --2- 172.21.15.40:0/2434778108 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f376409d920 0x7f376412dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.499+0000 7f3769650700 1 -- 172.21.15.40:0/2434778108 >> 172.21.15.40:0/2434778108 conn(0x7f37640a7080 msgr2=0x7f37640a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:53.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.499+0000 7f3769650700 1 -- 172.21.15.40:0/2434778108 shutdown_connections 2023-09-30T22:28:53.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.499+0000 7f3769650700 1 -- 172.21.15.40:0/2434778108 wait complete. 2023-09-30T22:28:53.511 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:53.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.528+0000 7f39e150c700 1 Processor -- start 2023-09-30T22:28:53.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.528+0000 7f39e150c700 1 -- start start 2023-09-30T22:28:53.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.529+0000 7f39e150c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f39dc09c890 0x7f39dc09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.529+0000 7f39e150c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f39dc09d920 0x7f39dc09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.529+0000 7f39e150c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f39dc09e2b0 0x7f39dc13ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.529+0000 7f39e150c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39dc0a29d0 con 0x7f39dc09c890 2023-09-30T22:28:53.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.529+0000 7f39e150c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc09fb40 con 0x7f39dc09e2b0 2023-09-30T22:28:53.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.529+0000 7f39e150c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc0a2600 con 0x7f39dc09d920 2023-09-30T22:28:53.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.529+0000 7f39daffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f39dc09c890 0x7f39dc09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.529+0000 7f39da7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f39dc09d920 0x7f39dc09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.529+0000 7f39db7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f39dc09e2b0 0x7f39dc13ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.529+0000 7f39daffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f39dc09c890 0x7f39dc09cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50622/0 (socket says 172.21.15.40:50622) 2023-09-30T22:28:53.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.529+0000 7f39da7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f39dc09d920 0x7f39dc09dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:57806/0 (socket says 172.21.15.40:57806) 2023-09-30T22:28:53.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.529+0000 7f39daffd700 1 -- 172.21.15.40:0/1371811559 learned_addr learned my addr 172.21.15.40:0/1371811559 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:53.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.529+0000 7f39db7fe700 1 -- 172.21.15.40:0/1371811559 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f39dc09d920 msgr2=0x7f39dc09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:53.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.529+0000 7f39db7fe700 1 --2- 172.21.15.40:0/1371811559 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f39dc09d920 0x7f39dc09dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.529+0000 7f39db7fe700 1 -- 172.21.15.40:0/1371811559 >> v2:172.21.15.40:3300/0 conn(0x7f39dc09c890 msgr2=0x7f39dc09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:53.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.529+0000 7f39db7fe700 1 --2- 172.21.15.40:0/1371811559 >> v2:172.21.15.40:3300/0 conn(0x7f39dc09c890 0x7f39dc09cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.529+0000 7f39db7fe700 1 -- 172.21.15.40:0/1371811559 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39dc09fed0 con 0x7f39dc09e2b0 2023-09-30T22:28:53.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.529+0000 7f39da7fc700 1 --2- 172.21.15.40:0/1371811559 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f39dc09d920 0x7f39dc09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:53.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.529+0000 7f39daffd700 1 --2- 172.21.15.40:0/1371811559 >> v2:172.21.15.40:3300/0 conn(0x7f39dc09c890 0x7f39dc09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:53.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.529+0000 7f39db7fe700 1 --2- 172.21.15.40:0/1371811559 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f39dc09e2b0 0x7f39dc13ac10 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f39d4009d90 tx=0x7f39d400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e61f2f647a4af29 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:53.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.530+0000 7f39d9ffb700 1 -- 172.21.15.40:0/1371811559 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d400e070 con 0x7f39dc09e2b0 2023-09-30T22:28:53.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.530+0000 7f39d9ffb700 1 -- 172.21.15.40:0/1371811559 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d400bb20 con 0x7f39dc09e2b0 2023-09-30T22:28:53.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.530+0000 7f39d9ffb700 1 -- 172.21.15.40:0/1371811559 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d4012430 con 0x7f39dc09e2b0 2023-09-30T22:28:53.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.530+0000 7f39e150c700 1 -- 172.21.15.40:0/1371811559 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f39dc09e2b0 msgr2=0x7f39dc13ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.530+0000 7f39e150c700 1 --2- 172.21.15.40:0/1371811559 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f39dc09e2b0 0x7f39dc13ac10 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f39d4009d90 tx=0x7f39d400b330 comp rx=0 tx=0).stop 2023-09-30T22:28:53.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.530+0000 7f39e150c700 1 -- 172.21.15.40:0/1371811559 shutdown_connections 2023-09-30T22:28:53.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.530+0000 7f39e150c700 1 --2- 172.21.15.40:0/1371811559 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f39dc09e2b0 0x7f39dc13ac10 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.530+0000 7f39e150c700 1 --2- 172.21.15.40:0/1371811559 >> v2:172.21.15.40:3300/0 conn(0x7f39dc09c890 0x7f39dc09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.530+0000 7f39e150c700 1 --2- 172.21.15.40:0/1371811559 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f39dc09d920 0x7f39dc09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.530+0000 7f39e150c700 1 -- 172.21.15.40:0/1371811559 >> 172.21.15.40:0/1371811559 conn(0x7f39dc0a7080 msgr2=0x7f39dc0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:53.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.530+0000 7f39e150c700 1 -- 172.21.15.40:0/1371811559 shutdown_connections 2023-09-30T22:28:53.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.530+0000 7f39e150c700 1 -- 172.21.15.40:0/1371811559 wait complete. 2023-09-30T22:28:53.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.531+0000 7f39e150c700 1 Processor -- start 2023-09-30T22:28:53.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.531+0000 7f39e150c700 1 -- start start 2023-09-30T22:28:53.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.532+0000 7f39e150c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f39dc09c890 0x7f39dc12d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.532+0000 7f39e150c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39dc09d920 0x7f39dc12d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.532+0000 7f39e150c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f39dc09e2b0 0x7f39dc12de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.532+0000 7f39e150c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc12e780 con 0x7f39dc09d920 2023-09-30T22:28:53.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.532+0000 7f39e150c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc09ecf0 con 0x7f39dc09e2b0 2023-09-30T22:28:53.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.532+0000 7f39e150c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc12f020 con 0x7f39dc09c890 2023-09-30T22:28:53.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.532+0000 7f39daffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f39dc09c890 0x7f39dc12d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.532+0000 7f39da7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39dc09d920 0x7f39dc12d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.532+0000 7f39da7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39dc09d920 0x7f39dc12d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50634/0 (socket says 172.21.15.40:50634) 2023-09-30T22:28:53.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.532+0000 7f39daffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f39dc09c890 0x7f39dc12d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:57812/0 (socket says 172.21.15.40:57812) 2023-09-30T22:28:53.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.532+0000 7f39da7fc700 1 -- 172.21.15.40:0/1112085551 learned_addr learned my addr 172.21.15.40:0/1112085551 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:53.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.532+0000 7f39db7fe700 1 --2- 172.21.15.40:0/1112085551 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f39dc09e2b0 0x7f39dc12de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.532+0000 7f39daffd700 1 -- 172.21.15.40:0/1112085551 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f39dc09e2b0 msgr2=0x7f39dc12de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.532+0000 7f39daffd700 1 --2- 172.21.15.40:0/1112085551 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f39dc09e2b0 0x7f39dc12de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.532+0000 7f39daffd700 1 -- 172.21.15.40:0/1112085551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39dc09d920 msgr2=0x7f39dc12d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.532+0000 7f39daffd700 1 --2- 172.21.15.40:0/1112085551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39dc09d920 0x7f39dc12d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.532+0000 7f39daffd700 1 -- 172.21.15.40:0/1112085551 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d0009500 con 0x7f39dc09c890 2023-09-30T22:28:53.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.532+0000 7f39da7fc700 1 --2- 172.21.15.40:0/1112085551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39dc09d920 0x7f39dc12d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:53.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.532+0000 7f39daffd700 1 --2- 172.21.15.40:0/1112085551 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f39dc09c890 0x7f39dc12d3b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f39d000e980 tx=0x7f39d000ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:53.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.533+0000 7f39c37fe700 1 -- 172.21.15.40:0/1112085551 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d0005a20 con 0x7f39dc09c890 2023-09-30T22:28:53.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.533+0000 7f39c37fe700 1 -- 172.21.15.40:0/1112085551 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d0005b80 con 0x7f39dc09c890 2023-09-30T22:28:53.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.533+0000 7f39e150c700 1 -- 172.21.15.40:0/1112085551 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39cc0094a0 con 0x7f39dc09c890 2023-09-30T22:28:53.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.533+0000 7f39c37fe700 1 -- 172.21.15.40:0/1112085551 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d0013680 con 0x7f39dc09c890 2023-09-30T22:28:53.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.533+0000 7f39e150c700 1 -- 172.21.15.40:0/1112085551 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d4009a70 con 0x7f39dc09c890 2023-09-30T22:28:53.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.533+0000 7f39c37fe700 1 -- 172.21.15.40:0/1112085551 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f39d00137e0 con 0x7f39dc09c890 2023-09-30T22:28:53.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.534+0000 7f39e150c700 1 -- 172.21.15.40:0/1112085551 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39dc062380 con 0x7f39dc09c890 2023-09-30T22:28:53.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.534+0000 7f39c37fe700 1 -- 172.21.15.40:0/1112085551 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f39d003f9c0 con 0x7f39dc09c890 2023-09-30T22:28:53.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.538+0000 7f39c37fe700 1 -- 172.21.15.40:0/1112085551 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f39d0006030 con 0x7f39dc09c890 2023-09-30T22:28:53.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.539+0000 7f893699d700 1 -- 172.21.15.40:0/1502103607 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8930121d70 con 0x7f893009d920 2023-09-30T22:28:53.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.540+0000 7f892cff9700 1 -- 172.21.15.40:0/1502103607 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8920020030 con 0x7f893009d920 2023-09-30T22:28:53.542 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:53.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.542+0000 7f893699d700 1 -- 172.21.15.40:0/1502103607 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f893009d920 msgr2=0x7f893011f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.542+0000 7f893699d700 1 --2- 172.21.15.40:0/1502103607 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f893009d920 0x7f893011f370 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f8920009fd0 tx=0x7f8920004750 comp rx=0 tx=0).stop 2023-09-30T22:28:53.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.542+0000 7f893699d700 1 -- 172.21.15.40:0/1502103607 shutdown_connections 2023-09-30T22:28:53.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.542+0000 7f893699d700 1 --2- 172.21.15.40:0/1502103607 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8930130de0 0x7f893011fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.542+0000 7f893699d700 1 --2- 172.21.15.40:0/1502103607 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f893009d920 0x7f893011f370 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.542+0000 7f893699d700 1 --2- 172.21.15.40:0/1502103607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f893009e230 0x7f893011f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.542+0000 7f893699d700 1 -- 172.21.15.40:0/1502103607 >> 172.21.15.40:0/1502103607 conn(0x7f893009fb20 msgr2=0x7f893006df50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:53.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.542+0000 7f893699d700 1 -- 172.21.15.40:0/1502103607 shutdown_connections 2023-09-30T22:28:53.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.542+0000 7f893699d700 1 -- 172.21.15.40:0/1502103607 wait complete. 2023-09-30T22:28:53.554 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:53.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.736+0000 7f39e150c700 1 -- 172.21.15.40:0/1112085551 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f39dc12ed10 con 0x7f39dc09c890 2023-09-30T22:28:53.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.736+0000 7f39c37fe700 1 -- 172.21.15.40:0/1112085551 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f39d0011350 con 0x7f39dc09c890 2023-09-30T22:28:53.736 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:53.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.738+0000 7f39e150c700 1 -- 172.21.15.40:0/1112085551 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f39dc09c890 msgr2=0x7f39dc12d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.738+0000 7f39e150c700 1 --2- 172.21.15.40:0/1112085551 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f39dc09c890 0x7f39dc12d3b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f39d000e980 tx=0x7f39d000ec90 comp rx=0 tx=0).stop 2023-09-30T22:28:53.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.738+0000 7f39e150c700 1 -- 172.21.15.40:0/1112085551 shutdown_connections 2023-09-30T22:28:53.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.738+0000 7f39e150c700 1 --2- 172.21.15.40:0/1112085551 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f39dc09c890 0x7f39dc12d3b0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.738+0000 7f39e150c700 1 --2- 172.21.15.40:0/1112085551 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f39dc09e2b0 0x7f39dc12de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.738+0000 7f39e150c700 1 --2- 172.21.15.40:0/1112085551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39dc09d920 0x7f39dc12d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.738+0000 7f39e150c700 1 -- 172.21.15.40:0/1112085551 >> 172.21.15.40:0/1112085551 conn(0x7f39dc0a7080 msgr2=0x7f39dc0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:53.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.738+0000 7f39e150c700 1 -- 172.21.15.40:0/1112085551 shutdown_connections 2023-09-30T22:28:53.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:53.738+0000 7f39e150c700 1 -- 172.21.15.40:0/1112085551 wait complete. 2023-09-30T22:28:53.750 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:54.438 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:54.512 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:54.554 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:54.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.585+0000 7feb86550700 1 Processor -- start 2023-09-30T22:28:54.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.585+0000 7feb86550700 1 -- start start 2023-09-30T22:28:54.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.586+0000 7feb86550700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb8009d920 0x7feb8009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.586+0000 7feb86550700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feb8009f0f0 0x7feb8009e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.586+0000 7feb86550700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb8009f940 con 0x7feb80133ca0 2023-09-30T22:28:54.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.586+0000 7feb86550700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8006b4c0 con 0x7feb8009d920 2023-09-30T22:28:54.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.586+0000 7feb86550700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb8009a8f0 con 0x7feb8009f0f0 2023-09-30T22:28:54.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.586+0000 7feb84aed700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7feb80133ca0 0x7feb80134140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51236/0 (socket says 172.21.15.40:51236) 2023-09-30T22:28:54.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.586+0000 7feb84aed700 1 -- 172.21.15.40:0/405870881 learned_addr learned my addr 172.21.15.40:0/405870881 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:54.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.586+0000 7feb7ffff700 1 --2- 172.21.15.40:0/405870881 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb8009d920 0x7feb8009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.586+0000 7feb7f7fe700 1 --2- 172.21.15.40:0/405870881 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feb8009f0f0 0x7feb8009e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.586+0000 7feb7f7fe700 1 -- 172.21.15.40:0/405870881 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb8009d920 msgr2=0x7feb8009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:54.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.586+0000 7feb7f7fe700 1 --2- 172.21.15.40:0/405870881 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb8009d920 0x7feb8009dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.586+0000 7feb7f7fe700 1 -- 172.21.15.40:0/405870881 >> v1:172.21.15.40:6789/0 conn(0x7feb80133ca0 legacy=0x7feb80134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.586+0000 7feb7f7fe700 1 -- 172.21.15.40:0/405870881 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8009f6e0 con 0x7feb8009f0f0 2023-09-30T22:28:54.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.586+0000 7feb7effd700 1 -- 172.21.15.40:0/405870881 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1491007033 0 0) 0x7feb8009f940 con 0x7feb80133ca0 2023-09-30T22:28:54.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.587+0000 7feb7ffff700 1 --2- 172.21.15.40:0/405870881 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb8009d920 0x7feb8009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:54.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.587+0000 7feb7f7fe700 1 --2- 172.21.15.40:0/405870881 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feb8009f0f0 0x7feb8009e230 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7feb740098a0 tx=0x7feb74009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=945a33390a4b5d31 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:54.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.587+0000 7feb7effd700 1 -- 172.21.15.40:0/405870881 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb74011830 con 0x7feb8009f0f0 2023-09-30T22:28:54.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.587+0000 7feb7effd700 1 -- 172.21.15.40:0/405870881 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb74011990 con 0x7feb8009f0f0 2023-09-30T22:28:54.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.587+0000 7feb7effd700 1 -- 172.21.15.40:0/405870881 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb74011d20 con 0x7feb8009f0f0 2023-09-30T22:28:54.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.588+0000 7feb86550700 1 -- 172.21.15.40:0/405870881 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feb8009f0f0 msgr2=0x7feb8009e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.588+0000 7feb86550700 1 --2- 172.21.15.40:0/405870881 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feb8009f0f0 0x7feb8009e230 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7feb740098a0 tx=0x7feb74009bb0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.588+0000 7feb86550700 1 -- 172.21.15.40:0/405870881 shutdown_connections 2023-09-30T22:28:54.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.588+0000 7feb86550700 1 --2- 172.21.15.40:0/405870881 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb8009d920 0x7feb8009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.588+0000 7feb86550700 1 --2- 172.21.15.40:0/405870881 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feb8009f0f0 0x7feb8009e230 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.588+0000 7feb86550700 1 -- 172.21.15.40:0/405870881 >> 172.21.15.40:0/405870881 conn(0x7feb8009fb20 msgr2=0x7feb8009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:54.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.588+0000 7feb86550700 1 -- 172.21.15.40:0/405870881 shutdown_connections 2023-09-30T22:28:54.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.588+0000 7feb86550700 1 -- 172.21.15.40:0/405870881 wait complete. 2023-09-30T22:28:54.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.589+0000 7feb86550700 1 Processor -- start 2023-09-30T22:28:54.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.590+0000 7feb86550700 1 -- start start 2023-09-30T22:28:54.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.590+0000 7feb86550700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feb8009d920 0x7feb801316f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.590+0000 7feb86550700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb80133ca0 0x7feb8011e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.590+0000 7feb86550700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb8011e890 0x7feb8011ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.590+0000 7feb86550700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb801209d0 con 0x7feb8011e890 2023-09-30T22:28:54.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.590+0000 7feb86550700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb801227e0 con 0x7feb80133ca0 2023-09-30T22:28:54.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.590+0000 7feb86550700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb80121e20 con 0x7feb8009d920 2023-09-30T22:28:54.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.590+0000 7feb7f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb80133ca0 0x7feb8011e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.591+0000 7feb7f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb80133ca0 0x7feb8011e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38624/0 (socket says 172.21.15.40:38624) 2023-09-30T22:28:54.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.591+0000 7feb7f7fe700 1 -- 172.21.15.40:0/15331084 learned_addr learned my addr 172.21.15.40:0/15331084 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:54.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.591+0000 7feb7ffff700 1 --2- 172.21.15.40:0/15331084 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feb8009d920 0x7feb801316f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.591+0000 7feb84aed700 1 --2- 172.21.15.40:0/15331084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb8011e890 0x7feb8011ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.591+0000 7feb7f7fe700 1 -- 172.21.15.40:0/15331084 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feb8009d920 msgr2=0x7feb801316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.591+0000 7feb7f7fe700 1 --2- 172.21.15.40:0/15331084 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feb8009d920 0x7feb801316f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.591+0000 7feb7f7fe700 1 -- 172.21.15.40:0/15331084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb8011e890 msgr2=0x7feb8011ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.591+0000 7feb7f7fe700 1 --2- 172.21.15.40:0/15331084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb8011e890 0x7feb8011ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.591+0000 7feb7f7fe700 1 -- 172.21.15.40:0/15331084 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb70009430 con 0x7feb80133ca0 2023-09-30T22:28:54.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.591+0000 7feb7f7fe700 1 --2- 172.21.15.40:0/15331084 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb80133ca0 0x7feb8011e350 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7feb740097c0 tx=0x7feb74004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:54.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.591+0000 7feb7cff9700 1 -- 172.21.15.40:0/15331084 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb74004550 con 0x7feb80133ca0 2023-09-30T22:28:54.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.591+0000 7feb7cff9700 1 -- 172.21.15.40:0/15331084 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7401f070 con 0x7feb80133ca0 2023-09-30T22:28:54.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.591+0000 7feb86550700 1 -- 172.21.15.40:0/15331084 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb740094a0 con 0x7feb80133ca0 2023-09-30T22:28:54.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.591+0000 7feb7cff9700 1 -- 172.21.15.40:0/15331084 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb740038c0 con 0x7feb80133ca0 2023-09-30T22:28:54.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.591+0000 7feb86550700 1 -- 172.21.15.40:0/15331084 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb80121160 con 0x7feb80133ca0 2023-09-30T22:28:54.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.592+0000 7feb7cff9700 1 -- 172.21.15.40:0/15331084 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feb74003a20 con 0x7feb80133ca0 2023-09-30T22:28:54.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.593+0000 7feb86550700 1 -- 172.21.15.40:0/15331084 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb801217e0 con 0x7feb80133ca0 2023-09-30T22:28:54.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.593+0000 7feb7cff9700 1 -- 172.21.15.40:0/15331084 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7feb74021070 con 0x7feb80133ca0 2023-09-30T22:28:54.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.598+0000 7feb7cff9700 1 -- 172.21.15.40:0/15331084 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feb801217e0 con 0x7feb80133ca0 2023-09-30T22:28:54.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.654+0000 7fb843de3700 1 Processor -- start 2023-09-30T22:28:54.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.654+0000 7fb843de3700 1 -- start start 2023-09-30T22:28:54.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.654+0000 7fb843de3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb83c09d920 0x7fb83c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.654+0000 7fb843de3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb83c09e230 0x7fb83c1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.654+0000 7fb843de3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb83c09f940 con 0x7fb83c09f0f0 2023-09-30T22:28:54.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.654+0000 7fb843de3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb83c06b4c0 con 0x7fb83c09d920 2023-09-30T22:28:54.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.654+0000 7fb843de3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c09a8f0 con 0x7fb83c09e230 2023-09-30T22:28:54.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.654+0000 7fb841b7f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb83c09d920 0x7fb83c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.654+0000 7fb842380700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb83c09e230 0x7fb83c1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.655+0000 7fb841b7f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb83c09d920 0x7fb83c09dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50650/0 (socket says 172.21.15.40:50650) 2023-09-30T22:28:54.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.655+0000 7fb841b7f700 1 -- 172.21.15.40:0/979850577 learned_addr learned my addr 172.21.15.40:0/979850577 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:54.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.655+0000 7fb842380700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb83c09e230 0x7fb83c1343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38630/0 (socket says 172.21.15.40:38630) 2023-09-30T22:28:54.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.655+0000 7fb842380700 1 -- 172.21.15.40:0/979850577 >> v2:172.21.15.40:3300/0 conn(0x7fb83c09d920 msgr2=0x7fb83c09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:54.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.655+0000 7fb842380700 1 --2- 172.21.15.40:0/979850577 >> v2:172.21.15.40:3300/0 conn(0x7fb83c09d920 0x7fb83c09dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.655+0000 7fb842380700 1 -- 172.21.15.40:0/979850577 >> v1:172.21.15.40:6789/0 conn(0x7fb83c09f0f0 legacy=0x7fb83c133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.655+0000 7fb840b7d700 1 -- 172.21.15.40:0/979850577 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2043415430 0 0) 0x7fb83c09f940 con 0x7fb83c09f0f0 2023-09-30T22:28:54.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.655+0000 7fb842380700 1 -- 172.21.15.40:0/979850577 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83c09f6e0 con 0x7fb83c09e230 2023-09-30T22:28:54.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.655+0000 7fb841b7f700 1 --2- 172.21.15.40:0/979850577 >> v2:172.21.15.40:3300/0 conn(0x7fb83c09d920 0x7fb83c09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:54.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.655+0000 7fb842380700 1 --2- 172.21.15.40:0/979850577 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb83c09e230 0x7fb83c1343b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fb834009dc0 tx=0x7fb83400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=359454d5e44ac21e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:54.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.655+0000 7fb840b7d700 1 -- 172.21.15.40:0/979850577 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83400e070 con 0x7fb83c09e230 2023-09-30T22:28:54.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.655+0000 7fb840b7d700 1 -- 172.21.15.40:0/979850577 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83400bae0 con 0x7fb83c09e230 2023-09-30T22:28:54.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.655+0000 7fb840b7d700 1 -- 172.21.15.40:0/979850577 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83400be90 con 0x7fb83c09e230 2023-09-30T22:28:54.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.656+0000 7fb843de3700 1 -- 172.21.15.40:0/979850577 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb83c09e230 msgr2=0x7fb83c1343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.656+0000 7fb843de3700 1 --2- 172.21.15.40:0/979850577 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb83c09e230 0x7fb83c1343b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fb834009dc0 tx=0x7fb83400b330 comp rx=0 tx=0).stop 2023-09-30T22:28:54.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.656+0000 7fb843de3700 1 -- 172.21.15.40:0/979850577 shutdown_connections 2023-09-30T22:28:54.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.656+0000 7fb843de3700 1 --2- 172.21.15.40:0/979850577 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb83c09e230 0x7fb83c1343b0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.656+0000 7fb843de3700 1 --2- 172.21.15.40:0/979850577 >> v2:172.21.15.40:3300/0 conn(0x7fb83c09d920 0x7fb83c09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.656+0000 7fb843de3700 1 -- 172.21.15.40:0/979850577 >> 172.21.15.40:0/979850577 conn(0x7fb83c09fb20 msgr2=0x7fb83c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:54.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.656+0000 7fb843de3700 1 -- 172.21.15.40:0/979850577 shutdown_connections 2023-09-30T22:28:54.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.656+0000 7fb843de3700 1 -- 172.21.15.40:0/979850577 wait complete. 2023-09-30T22:28:54.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.657+0000 7fb843de3700 1 Processor -- start 2023-09-30T22:28:54.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.657+0000 7fb843de3700 1 -- start start 2023-09-30T22:28:54.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.658+0000 7fb843de3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb83c09d920 0x7fb83c1c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.658+0000 7fb843de3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb83c09e230 0x7fb83c1c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.658+0000 7fb843de3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb83c1a9f60 0x7fb83c1c4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.658+0000 7fb843de3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c1a95a0 con 0x7fb83c09d920 2023-09-30T22:28:54.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.658+0000 7fb843de3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c1a9780 con 0x7fb83c09e230 2023-09-30T22:28:54.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.658+0000 7fb843de3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c1c9170 con 0x7fb83c1a9f60 2023-09-30T22:28:54.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.658+0000 7fb841b7f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb83c09d920 0x7fb83c1c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.658+0000 7fb84137e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb83c09e230 0x7fb83c1c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.658+0000 7fb841b7f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb83c09d920 0x7fb83c1c86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50662/0 (socket says 172.21.15.40:50662) 2023-09-30T22:28:54.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.658+0000 7fb841b7f700 1 -- 172.21.15.40:0/2489035778 learned_addr learned my addr 172.21.15.40:0/2489035778 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:54.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.658+0000 7fb842380700 1 --2- 172.21.15.40:0/2489035778 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb83c1a9f60 0x7fb83c1c4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.658+0000 7fb84137e700 1 -- 172.21.15.40:0/2489035778 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb83c1a9f60 msgr2=0x7fb83c1c4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.658+0000 7fb84137e700 1 --2- 172.21.15.40:0/2489035778 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb83c1a9f60 0x7fb83c1c4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.658+0000 7fb84137e700 1 -- 172.21.15.40:0/2489035778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb83c09d920 msgr2=0x7fb83c1c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.658+0000 7fb84137e700 1 --2- 172.21.15.40:0/2489035778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb83c09d920 0x7fb83c1c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.658+0000 7fb84137e700 1 -- 172.21.15.40:0/2489035778 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb838009500 con 0x7fb83c09e230 2023-09-30T22:28:54.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.658+0000 7fb841b7f700 1 --2- 172.21.15.40:0/2489035778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb83c09d920 0x7fb83c1c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:54.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.658+0000 7fb84137e700 1 --2- 172.21.15.40:0/2489035778 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb83c09e230 0x7fb83c1c8c30 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb82c00c580 tx=0x7fb82c00c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:54.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.659+0000 7fb8327fc700 1 -- 172.21.15.40:0/2489035778 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82c0054e0 con 0x7fb83c09e230 2023-09-30T22:28:54.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.659+0000 7fb8327fc700 1 -- 172.21.15.40:0/2489035778 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82c003680 con 0x7fb83c09e230 2023-09-30T22:28:54.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.659+0000 7fb843de3700 1 -- 172.21.15.40:0/2489035778 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb834009a70 con 0x7fb83c09e230 2023-09-30T22:28:54.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.659+0000 7fb8327fc700 1 -- 172.21.15.40:0/2489035778 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82c003a30 con 0x7fb83c09e230 2023-09-30T22:28:54.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.659+0000 7fb843de3700 1 -- 172.21.15.40:0/2489035778 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb83c0a32f0 con 0x7fb83c09e230 2023-09-30T22:28:54.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.659+0000 7fb8327fc700 1 -- 172.21.15.40:0/2489035778 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb82c003b90 con 0x7fb83c09e230 2023-09-30T22:28:54.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.660+0000 7fb8327fc700 1 -- 172.21.15.40:0/2489035778 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb82c03ea50 con 0x7fb83c09e230 2023-09-30T22:28:54.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.660+0000 7fb843de3700 1 -- 172.21.15.40:0/2489035778 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb83c062380 con 0x7fb83c09e230 2023-09-30T22:28:54.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.664+0000 7fb8327fc700 1 -- 172.21.15.40:0/2489035778 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb82c017070 con 0x7fb83c09e230 2023-09-30T22:28:54.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.699+0000 7f9762ff4700 1 Processor -- start 2023-09-30T22:28:54.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.699+0000 7f9762ff4700 1 -- start start 2023-09-30T22:28:54.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.700+0000 7f9762ff4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f975c136bf0 0x7f975c138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.700+0000 7f9762ff4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f975c139510 0x7f975c13b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.700+0000 7f9762ff4700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f975c0a2600 con 0x7f975c09c890 2023-09-30T22:28:54.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.700+0000 7f9762ff4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f975c0a29d0 con 0x7f975c136bf0 2023-09-30T22:28:54.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.700+0000 7f9762ff4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975c09fb40 con 0x7f975c139510 2023-09-30T22:28:54.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.700+0000 7f975bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f975c136bf0 0x7f975c138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.700+0000 7f975bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f975c136bf0 0x7f975c138fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50678/0 (socket says 172.21.15.40:50678) 2023-09-30T22:28:54.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.700+0000 7f9761591700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f975c139510 0x7f975c13b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.700+0000 7f975bfff700 1 -- 172.21.15.40:0/4146015574 learned_addr learned my addr 172.21.15.40:0/4146015574 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:54.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.700+0000 7f9761591700 1 -- 172.21.15.40:0/4146015574 >> v2:172.21.15.40:3300/0 conn(0x7f975c136bf0 msgr2=0x7f975c138fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:54.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.700+0000 7f9761591700 1 --2- 172.21.15.40:0/4146015574 >> v2:172.21.15.40:3300/0 conn(0x7f975c136bf0 0x7f975c138fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.700+0000 7f9761591700 1 -- 172.21.15.40:0/4146015574 >> v1:172.21.15.40:6789/0 conn(0x7f975c09c890 legacy=0x7f975c09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.700+0000 7f9761591700 1 -- 172.21.15.40:0/4146015574 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975c09d370 con 0x7f975c139510 2023-09-30T22:28:54.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.700+0000 7f975bfff700 1 --2- 172.21.15.40:0/4146015574 >> v2:172.21.15.40:3300/0 conn(0x7f975c136bf0 0x7f975c138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:54.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.701+0000 7f9761591700 1 --2- 172.21.15.40:0/4146015574 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f975c139510 0x7f975c13b8f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f9754009d90 tx=0x7f975400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccbcfb16e320bc26 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:54.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.701+0000 7f975b7fe700 1 -- 172.21.15.40:0/4146015574 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975400e070 con 0x7f975c139510 2023-09-30T22:28:54.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.701+0000 7f975b7fe700 1 -- 172.21.15.40:0/4146015574 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975400bb20 con 0x7f975c139510 2023-09-30T22:28:54.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.701+0000 7f975b7fe700 1 -- 172.21.15.40:0/4146015574 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9754012430 con 0x7f975c139510 2023-09-30T22:28:54.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.701+0000 7f9762ff4700 1 -- 172.21.15.40:0/4146015574 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f975c139510 msgr2=0x7f975c13b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.701+0000 7f9762ff4700 1 --2- 172.21.15.40:0/4146015574 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f975c139510 0x7f975c13b8f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f9754009d90 tx=0x7f975400b330 comp rx=0 tx=0).stop 2023-09-30T22:28:54.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.701+0000 7f9762ff4700 1 -- 172.21.15.40:0/4146015574 shutdown_connections 2023-09-30T22:28:54.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.701+0000 7f9762ff4700 1 --2- 172.21.15.40:0/4146015574 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f975c139510 0x7f975c13b8f0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.701+0000 7f9762ff4700 1 --2- 172.21.15.40:0/4146015574 >> v2:172.21.15.40:3300/0 conn(0x7f975c136bf0 0x7f975c138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.701+0000 7f9762ff4700 1 -- 172.21.15.40:0/4146015574 >> 172.21.15.40:0/4146015574 conn(0x7f975c0a7080 msgr2=0x7f975c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:54.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.701+0000 7f9762ff4700 1 -- 172.21.15.40:0/4146015574 shutdown_connections 2023-09-30T22:28:54.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.701+0000 7f9762ff4700 1 -- 172.21.15.40:0/4146015574 wait complete. 2023-09-30T22:28:54.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.703+0000 7f9762ff4700 1 Processor -- start 2023-09-30T22:28:54.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.703+0000 7f9762ff4700 1 -- start start 2023-09-30T22:28:54.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.703+0000 7f9762ff4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f975c09c890 0x7f975c06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.703+0000 7f9762ff4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f975c136bf0 0x7f975c06f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.704+0000 7f9762ff4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f975c139510 0x7f975c06fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.704+0000 7f9762ff4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975c070cb0 con 0x7f975c09c890 2023-09-30T22:28:54.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.704+0000 7f9762ff4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975c139070 con 0x7f975c136bf0 2023-09-30T22:28:54.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.704+0000 7f9762ff4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f975c09ecf0 con 0x7f975c139510 2023-09-30T22:28:54.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.704+0000 7f975bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f975c136bf0 0x7f975c06f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.704+0000 7f975bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f975c136bf0 0x7f975c06f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38674/0 (socket says 172.21.15.40:38674) 2023-09-30T22:28:54.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.704+0000 7f975bfff700 1 -- 172.21.15.40:0/1182472703 learned_addr learned my addr 172.21.15.40:0/1182472703 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:54.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.704+0000 7f9760d90700 1 --2- 172.21.15.40:0/1182472703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f975c09c890 0x7f975c06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.704+0000 7f975bfff700 1 -- 172.21.15.40:0/1182472703 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f975c139510 msgr2=0x7f975c06fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.704+0000 7f975bfff700 1 --2- 172.21.15.40:0/1182472703 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f975c139510 0x7f975c06fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.704+0000 7f975bfff700 1 -- 172.21.15.40:0/1182472703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f975c09c890 msgr2=0x7f975c06f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.704+0000 7f975bfff700 1 --2- 172.21.15.40:0/1182472703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f975c09c890 0x7f975c06f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.704+0000 7f975bfff700 1 -- 172.21.15.40:0/1182472703 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9748009550 con 0x7f975c136bf0 2023-09-30T22:28:54.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.704+0000 7f975bfff700 1 --2- 172.21.15.40:0/1182472703 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f975c136bf0 0x7f975c06f5c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f974800ebe0 tx=0x7f974800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:54.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.704+0000 7f97597fa700 1 -- 172.21.15.40:0/1182472703 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974800c850 con 0x7f975c136bf0 2023-09-30T22:28:54.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.704+0000 7f97597fa700 1 -- 172.21.15.40:0/1182472703 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974800c9b0 con 0x7f975c136bf0 2023-09-30T22:28:54.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.704+0000 7f97597fa700 1 -- 172.21.15.40:0/1182472703 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974800cd20 con 0x7f975c136bf0 2023-09-30T22:28:54.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.704+0000 7f9762ff4700 1 -- 172.21.15.40:0/1182472703 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9754009a70 con 0x7f975c136bf0 2023-09-30T22:28:54.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.704+0000 7f9762ff4700 1 -- 172.21.15.40:0/1182472703 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f975c0717a0 con 0x7f975c136bf0 2023-09-30T22:28:54.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.705+0000 7f97597fa700 1 -- 172.21.15.40:0/1182472703 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9748013470 con 0x7f975c136bf0 2023-09-30T22:28:54.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.705+0000 7f97597fa700 1 -- 172.21.15.40:0/1182472703 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f974803fd00 con 0x7f975c136bf0 2023-09-30T22:28:54.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.706+0000 7f9762ff4700 1 -- 172.21.15.40:0/1182472703 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f975c062380 con 0x7f975c136bf0 2023-09-30T22:28:54.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.715+0000 7f97597fa700 1 -- 172.21.15.40:0/1182472703 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9748017080 con 0x7f975c136bf0 2023-09-30T22:28:54.752 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:54.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.863+0000 7fb843de3700 1 -- 172.21.15.40:0/2489035778 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb83c1a7b50 con 0x7fb83c09e230 2023-09-30T22:28:54.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.863+0000 7fb8327fc700 1 -- 172.21.15.40:0/2489035778 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb82c012400 con 0x7fb83c09e230 2023-09-30T22:28:54.863 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:54.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.866+0000 7fb843de3700 1 -- 172.21.15.40:0/2489035778 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb83c09e230 msgr2=0x7fb83c1c8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.866+0000 7fb843de3700 1 --2- 172.21.15.40:0/2489035778 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb83c09e230 0x7fb83c1c8c30 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb82c00c580 tx=0x7fb82c00c890 comp rx=0 tx=0).stop 2023-09-30T22:28:54.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.866+0000 7fb843de3700 1 -- 172.21.15.40:0/2489035778 shutdown_connections 2023-09-30T22:28:54.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.866+0000 7fb843de3700 1 --2- 172.21.15.40:0/2489035778 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb83c1a9f60 0x7fb83c1c4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.866+0000 7fb843de3700 1 --2- 172.21.15.40:0/2489035778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb83c09d920 0x7fb83c1c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.866+0000 7fb843de3700 1 --2- 172.21.15.40:0/2489035778 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb83c09e230 0x7fb83c1c8c30 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.866+0000 7fb843de3700 1 -- 172.21.15.40:0/2489035778 >> 172.21.15.40:0/2489035778 conn(0x7fb83c09fb20 msgr2=0x7fb83c1bae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:54.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.866+0000 7fb843de3700 1 -- 172.21.15.40:0/2489035778 shutdown_connections 2023-09-30T22:28:54.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.866+0000 7fb843de3700 1 -- 172.21.15.40:0/2489035778 wait complete. 2023-09-30T22:28:54.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.881+0000 7feb86550700 1 -- 172.21.15.40:0/15331084 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7feb801217e0 con 0x7feb80133ca0 2023-09-30T22:28:54.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.881+0000 7fba6300d700 1 Processor -- start 2023-09-30T22:28:54.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.881+0000 7feb7cff9700 1 -- 172.21.15.40:0/15331084 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feb801217e0 con 0x7feb80133ca0 2023-09-30T22:28:54.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.881+0000 7fba6300d700 1 -- start start 2023-09-30T22:28:54.883 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:54.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.882+0000 7fba6300d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fba5c06f070 0x7fba5c06f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.882+0000 7fba6300d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fba5c06f980 0x7fba5c097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.882+0000 7fba6300d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba5c06fdb0 0x7fba5c0975d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.882+0000 7fba6300d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba5c070830 con 0x7fba5c06f070 2023-09-30T22:28:54.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.882+0000 7fba6300d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c070ad0 con 0x7fba5c06fdb0 2023-09-30T22:28:54.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.882+0000 7fba6300d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c070de0 con 0x7fba5c06f980 2023-09-30T22:28:54.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.882+0000 7fba615aa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba5c06fdb0 0x7fba5c0975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.882+0000 7fba615aa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba5c06fdb0 0x7fba5c0975d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38680/0 (socket says 172.21.15.40:38680) 2023-09-30T22:28:54.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.882+0000 7fba615aa700 1 -- 172.21.15.40:0/448179429 learned_addr learned my addr 172.21.15.40:0/448179429 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:54.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.882+0000 7fba60da9700 1 --2- 172.21.15.40:0/448179429 >> v2:172.21.15.40:3300/0 conn(0x7fba5c06f070 0x7fba5c06f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.882+0000 7fba5bfff700 1 --2- 172.21.15.40:0/448179429 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fba5c06f980 0x7fba5c097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.883+0000 7fba615aa700 1 -- 172.21.15.40:0/448179429 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fba5c06f980 msgr2=0x7fba5c097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:54.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.883+0000 7fba615aa700 1 --2- 172.21.15.40:0/448179429 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fba5c06f980 0x7fba5c097090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.883+0000 7fba615aa700 1 -- 172.21.15.40:0/448179429 >> v2:172.21.15.40:3300/0 conn(0x7fba5c06f070 msgr2=0x7fba5c06f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:54.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.883+0000 7fba615aa700 1 --2- 172.21.15.40:0/448179429 >> v2:172.21.15.40:3300/0 conn(0x7fba5c06f070 0x7fba5c06f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.883+0000 7fba615aa700 1 -- 172.21.15.40:0/448179429 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5c09fe20 con 0x7fba5c06fdb0 2023-09-30T22:28:54.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.883+0000 7fba615aa700 1 --2- 172.21.15.40:0/448179429 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba5c06fdb0 0x7fba5c0975d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fba54009e50 tx=0x7fba5400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74736dfb3aa73ce5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:54.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.883+0000 7fba5b7fe700 1 -- 172.21.15.40:0/448179429 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5400e070 con 0x7fba5c06fdb0 2023-09-30T22:28:54.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.883+0000 7fba5b7fe700 1 -- 172.21.15.40:0/448179429 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5400b910 con 0x7fba5c06fdb0 2023-09-30T22:28:54.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.883+0000 7fba5b7fe700 1 -- 172.21.15.40:0/448179429 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5400bcc0 con 0x7fba5c06fdb0 2023-09-30T22:28:54.887 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:54.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.884+0000 7fba6300d700 1 -- 172.21.15.40:0/448179429 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba5c06fdb0 msgr2=0x7fba5c0975d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.884+0000 7fba6300d700 1 --2- 172.21.15.40:0/448179429 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba5c06fdb0 0x7fba5c0975d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fba54009e50 tx=0x7fba5400b330 comp rx=0 tx=0).stop 2023-09-30T22:28:54.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.884+0000 7fba6300d700 1 -- 172.21.15.40:0/448179429 shutdown_connections 2023-09-30T22:28:54.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.884+0000 7fba6300d700 1 --2- 172.21.15.40:0/448179429 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba5c06fdb0 0x7fba5c0975d0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.884+0000 7fba6300d700 1 --2- 172.21.15.40:0/448179429 >> v2:172.21.15.40:3300/0 conn(0x7fba5c06f070 0x7fba5c06f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.884+0000 7fba6300d700 1 --2- 172.21.15.40:0/448179429 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fba5c06f980 0x7fba5c097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.884+0000 7fba6300d700 1 -- 172.21.15.40:0/448179429 >> 172.21.15.40:0/448179429 conn(0x7fba5c0a41a0 msgr2=0x7fba5c0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:54.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.884+0000 7fba6300d700 1 -- 172.21.15.40:0/448179429 shutdown_connections 2023-09-30T22:28:54.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.884+0000 7fba6300d700 1 -- 172.21.15.40:0/448179429 wait complete. 2023-09-30T22:28:54.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.884+0000 7feb86550700 1 -- 172.21.15.40:0/15331084 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb80133ca0 msgr2=0x7feb8011e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.884+0000 7feb86550700 1 --2- 172.21.15.40:0/15331084 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb80133ca0 0x7feb8011e350 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7feb740097c0 tx=0x7feb74004750 comp rx=0 tx=0).stop 2023-09-30T22:28:54.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.885+0000 7feb86550700 1 -- 172.21.15.40:0/15331084 shutdown_connections 2023-09-30T22:28:54.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.885+0000 7feb86550700 1 --2- 172.21.15.40:0/15331084 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feb8009d920 0x7feb801316f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.885+0000 7feb86550700 1 --2- 172.21.15.40:0/15331084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb8011e890 0x7feb8011ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.885+0000 7feb86550700 1 --2- 172.21.15.40:0/15331084 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb80133ca0 0x7feb8011e350 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.885+0000 7feb86550700 1 -- 172.21.15.40:0/15331084 >> 172.21.15.40:0/15331084 conn(0x7feb8009fb20 msgr2=0x7feb80133380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:54.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.885+0000 7feb86550700 1 -- 172.21.15.40:0/15331084 shutdown_connections 2023-09-30T22:28:54.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.885+0000 7feb86550700 1 -- 172.21.15.40:0/15331084 wait complete. 2023-09-30T22:28:54.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.885+0000 7fba6300d700 1 Processor -- start 2023-09-30T22:28:54.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.885+0000 7fba6300d700 1 -- start start 2023-09-30T22:28:54.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.886+0000 7fba6300d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fba5c06f070 0x7fba5c1c4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.886+0000 7fba6300d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba5c06f980 0x7fba5c1c4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.886+0000 7fba6300d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba5c06fdb0 0x7fba5c1c07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.886+0000 7fba6300d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c06e5c0 con 0x7fba5c06fdb0 2023-09-30T22:28:54.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.886+0000 7fba6300d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c12d550 con 0x7fba5c06f980 2023-09-30T22:28:54.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.886+0000 7fba6300d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c12e150 con 0x7fba5c06f070 2023-09-30T22:28:54.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.886+0000 7fba60da9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fba5c06f070 0x7fba5c1c4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.886+0000 7fba5bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba5c06f980 0x7fba5c1c4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.886+0000 7fba5bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba5c06f980 0x7fba5c1c4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38694/0 (socket says 172.21.15.40:38694) 2023-09-30T22:28:54.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.886+0000 7fba60da9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fba5c06f070 0x7fba5c1c4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:57870/0 (socket says 172.21.15.40:57870) 2023-09-30T22:28:54.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.886+0000 7fba5bfff700 1 -- 172.21.15.40:0/2207316481 learned_addr learned my addr 172.21.15.40:0/2207316481 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:54.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.886+0000 7fba615aa700 1 --2- 172.21.15.40:0/2207316481 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba5c06fdb0 0x7fba5c1c07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.886+0000 7fba5bfff700 1 -- 172.21.15.40:0/2207316481 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fba5c06f070 msgr2=0x7fba5c1c4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.886+0000 7fba5bfff700 1 --2- 172.21.15.40:0/2207316481 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fba5c06f070 0x7fba5c1c4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.886+0000 7fba5bfff700 1 -- 172.21.15.40:0/2207316481 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba5c06fdb0 msgr2=0x7fba5c1c07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.886+0000 7fba5bfff700 1 --2- 172.21.15.40:0/2207316481 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba5c06fdb0 0x7fba5c1c07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.886+0000 7fba5bfff700 1 -- 172.21.15.40:0/2207316481 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba54009b30 con 0x7fba5c06f980 2023-09-30T22:28:54.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.887+0000 7fba5bfff700 1 --2- 172.21.15.40:0/2207316481 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba5c06f980 0x7fba5c1c4840 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fba48012fc0 tx=0x7fba480103a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:54.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.887+0000 7fba597fa700 1 -- 172.21.15.40:0/2207316481 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba48010d10 con 0x7fba5c06f980 2023-09-30T22:28:54.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.887+0000 7fba597fa700 1 -- 172.21.15.40:0/2207316481 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba48013040 con 0x7fba5c06f980 2023-09-30T22:28:54.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.887+0000 7fba6300d700 1 -- 172.21.15.40:0/2207316481 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba5c12e410 con 0x7fba5c06f980 2023-09-30T22:28:54.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.887+0000 7fba597fa700 1 -- 172.21.15.40:0/2207316481 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba480186a0 con 0x7fba5c06f980 2023-09-30T22:28:54.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.887+0000 7fba6300d700 1 -- 172.21.15.40:0/2207316481 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba5c12c9c0 con 0x7fba5c06f980 2023-09-30T22:28:54.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.888+0000 7fba597fa700 1 -- 172.21.15.40:0/2207316481 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fba48018800 con 0x7fba5c06f980 2023-09-30T22:28:54.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.888+0000 7fba597fa700 1 -- 172.21.15.40:0/2207316481 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fba48043bf0 con 0x7fba5c06f980 2023-09-30T22:28:54.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.888+0000 7fba6300d700 1 -- 172.21.15.40:0/2207316481 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba5c12c9c0 con 0x7fba5c06f980 2023-09-30T22:28:54.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.897+0000 7fba597fa700 1 -- 172.21.15.40:0/2207316481 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fba5c12c9c0 con 0x7fba5c06f980 2023-09-30T22:28:54.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:54.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.994+0000 7f9762ff4700 1 -- 172.21.15.40:0/1182472703 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f975c074620 con 0x7f975c136bf0 2023-09-30T22:28:54.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.994+0000 7f97597fa700 1 -- 172.21.15.40:0/1182472703 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f974801b3b0 con 0x7f975c136bf0 2023-09-30T22:28:54.994 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:54.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.996+0000 7f9762ff4700 1 -- 172.21.15.40:0/1182472703 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f975c136bf0 msgr2=0x7f975c06f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.996+0000 7f9762ff4700 1 --2- 172.21.15.40:0/1182472703 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f975c136bf0 0x7f975c06f5c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f974800ebe0 tx=0x7f974800eef0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.996+0000 7f9762ff4700 1 -- 172.21.15.40:0/1182472703 shutdown_connections 2023-09-30T22:28:54.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.996+0000 7f9762ff4700 1 --2- 172.21.15.40:0/1182472703 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f975c139510 0x7f975c06fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.996+0000 7f9762ff4700 1 --2- 172.21.15.40:0/1182472703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f975c09c890 0x7f975c06f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.996+0000 7f9762ff4700 1 --2- 172.21.15.40:0/1182472703 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f975c136bf0 0x7f975c06f5c0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.996+0000 7f9762ff4700 1 -- 172.21.15.40:0/1182472703 >> 172.21.15.40:0/1182472703 conn(0x7f975c0a7080 msgr2=0x7f975c1349d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:54.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.996+0000 7f9762ff4700 1 -- 172.21.15.40:0/1182472703 shutdown_connections 2023-09-30T22:28:54.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:54.996+0000 7f9762ff4700 1 -- 172.21.15.40:0/1182472703 wait complete. 2023-09-30T22:28:55.008 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:55.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:55.092+0000 7fba6300d700 1 -- 172.21.15.40:0/2207316481 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fba5c12c9c0 con 0x7fba5c06f980 2023-09-30T22:28:55.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:55.092+0000 7fba597fa700 1 -- 172.21.15.40:0/2207316481 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fba5c12c9c0 con 0x7fba5c06f980 2023-09-30T22:28:55.092 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:55.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:55.094+0000 7fba6300d700 1 -- 172.21.15.40:0/2207316481 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba5c06f980 msgr2=0x7fba5c1c4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:55.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:55.094+0000 7fba6300d700 1 --2- 172.21.15.40:0/2207316481 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba5c06f980 0x7fba5c1c4840 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fba48012fc0 tx=0x7fba480103a0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:55.094+0000 7fba6300d700 1 -- 172.21.15.40:0/2207316481 shutdown_connections 2023-09-30T22:28:55.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:55.094+0000 7fba6300d700 1 --2- 172.21.15.40:0/2207316481 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fba5c06f070 0x7fba5c1c4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:55.094+0000 7fba6300d700 1 --2- 172.21.15.40:0/2207316481 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba5c06fdb0 0x7fba5c1c07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:55.094+0000 7fba6300d700 1 --2- 172.21.15.40:0/2207316481 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba5c06f980 0x7fba5c1c4840 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:55.094+0000 7fba6300d700 1 -- 172.21.15.40:0/2207316481 >> 172.21.15.40:0/2207316481 conn(0x7fba5c0a41a0 msgr2=0x7fba5c0972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:55.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:55.094+0000 7fba6300d700 1 -- 172.21.15.40:0/2207316481 shutdown_connections 2023-09-30T22:28:55.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:55.094+0000 7fba6300d700 1 -- 172.21.15.40:0/2207316481 wait complete. 2023-09-30T22:28:55.105 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:55.888 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:55.899 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:56.009 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:56.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.032+0000 7f8292434700 1 Processor -- start 2023-09-30T22:28:56.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.032+0000 7f8292434700 1 -- start start 2023-09-30T22:28:56.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.032+0000 7f8292434700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f828c09f0f0 0x7f828c138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.032+0000 7f8292434700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f828c09e400 0x7f828c13b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.032+0000 7f8292434700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f828c09f940 con 0x7f828c09d920 2023-09-30T22:28:56.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.032+0000 7f8292434700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f828c06b4c0 con 0x7f828c09f0f0 2023-09-30T22:28:56.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.032+0000 7f8292434700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f828c09a8f0 con 0x7f828c09e400 2023-09-30T22:28:56.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.032+0000 7f82909d1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f828c09e400 0x7f828c13b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.032+0000 7f82909d1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f828c09e400 0x7f828c13b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38704/0 (socket says 172.21.15.40:38704) 2023-09-30T22:28:56.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.032+0000 7f82909d1700 1 -- 172.21.15.40:0/2757352902 learned_addr learned my addr 172.21.15.40:0/2757352902 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:56.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.032+0000 7f828b7fe700 1 --2- 172.21.15.40:0/2757352902 >> v2:172.21.15.40:3300/0 conn(0x7f828c09f0f0 0x7f828c138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.033+0000 7f82909d1700 1 -- 172.21.15.40:0/2757352902 >> v2:172.21.15.40:3300/0 conn(0x7f828c09f0f0 msgr2=0x7f828c138ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:56.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.033+0000 7f82909d1700 1 --2- 172.21.15.40:0/2757352902 >> v2:172.21.15.40:3300/0 conn(0x7f828c09f0f0 0x7f828c138ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.033+0000 7f82909d1700 1 -- 172.21.15.40:0/2757352902 >> v1:172.21.15.40:6789/0 conn(0x7f828c09d920 legacy=0x7f828c09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.033+0000 7f82909d1700 1 -- 172.21.15.40:0/2757352902 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828c09f6e0 con 0x7f828c09e400 2023-09-30T22:28:56.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.033+0000 7f82909d1700 1 --2- 172.21.15.40:0/2757352902 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f828c09e400 0x7f828c13b430 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8284009e80 tx=0x7f828400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=310cd470be6bf147 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:56.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.033+0000 7f828affd700 1 -- 172.21.15.40:0/2757352902 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828400e070 con 0x7f828c09e400 2023-09-30T22:28:56.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.033+0000 7f828affd700 1 -- 172.21.15.40:0/2757352902 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828400b8d0 con 0x7f828c09e400 2023-09-30T22:28:56.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.033+0000 7f828affd700 1 -- 172.21.15.40:0/2757352902 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828400bc80 con 0x7f828c09e400 2023-09-30T22:28:56.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.034+0000 7f8292434700 1 -- 172.21.15.40:0/2757352902 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f828c09e400 msgr2=0x7f828c13b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.034+0000 7f8292434700 1 --2- 172.21.15.40:0/2757352902 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f828c09e400 0x7f828c13b430 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8284009e80 tx=0x7f828400b330 comp rx=0 tx=0).stop 2023-09-30T22:28:56.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.034+0000 7f8292434700 1 -- 172.21.15.40:0/2757352902 shutdown_connections 2023-09-30T22:28:56.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.034+0000 7f8292434700 1 --2- 172.21.15.40:0/2757352902 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f828c09e400 0x7f828c13b430 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.034+0000 7f8292434700 1 --2- 172.21.15.40:0/2757352902 >> v2:172.21.15.40:3300/0 conn(0x7f828c09f0f0 0x7f828c138ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.034+0000 7f8292434700 1 -- 172.21.15.40:0/2757352902 >> 172.21.15.40:0/2757352902 conn(0x7f828c09fb20 msgr2=0x7f828c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:56.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.034+0000 7f8292434700 1 -- 172.21.15.40:0/2757352902 shutdown_connections 2023-09-30T22:28:56.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.034+0000 7f8292434700 1 -- 172.21.15.40:0/2757352902 wait complete. 2023-09-30T22:28:56.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.036+0000 7f8292434700 1 Processor -- start 2023-09-30T22:28:56.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.036+0000 7f8292434700 1 -- start start 2023-09-30T22:28:56.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.037+0000 7f8292434700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f828c09d920 0x7f828c11e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.037+0000 7f8292434700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f828c09e400 0x7f828c11eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.037+0000 7f8292434700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f828c11f400 0x7f828c1c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.037+0000 7f8292434700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828c11f830 con 0x7f828c11f400 2023-09-30T22:28:56.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.037+0000 7f8292434700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f828c121670 con 0x7f828c09e400 2023-09-30T22:28:56.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.037+0000 7f8292434700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f828c09c9e0 con 0x7f828c09d920 2023-09-30T22:28:56.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.037+0000 7f828bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f828c09d920 0x7f828c11e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.037+0000 7f828bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f828c09d920 0x7f828c11e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:57872/0 (socket says 172.21.15.40:57872) 2023-09-30T22:28:56.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.037+0000 7f828bfff700 1 -- 172.21.15.40:0/1260658900 learned_addr learned my addr 172.21.15.40:0/1260658900 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:56.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.037+0000 7f82909d1700 1 --2- 172.21.15.40:0/1260658900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f828c11f400 0x7f828c1c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.037+0000 7f828b7fe700 1 --2- 172.21.15.40:0/1260658900 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f828c09e400 0x7f828c11eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.037+0000 7f82909d1700 1 -- 172.21.15.40:0/1260658900 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f828c09d920 msgr2=0x7f828c11e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.037+0000 7f82909d1700 1 --2- 172.21.15.40:0/1260658900 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f828c09d920 0x7f828c11e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.037+0000 7f82909d1700 1 -- 172.21.15.40:0/1260658900 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f828c09e400 msgr2=0x7f828c11eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.037+0000 7f82909d1700 1 --2- 172.21.15.40:0/1260658900 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f828c09e400 0x7f828c11eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.037+0000 7f82909d1700 1 -- 172.21.15.40:0/1260658900 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8284009b30 con 0x7f828c11f400 2023-09-30T22:28:56.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.037+0000 7f828bfff700 1 --2- 172.21.15.40:0/1260658900 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f828c09d920 0x7f828c11e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:56.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.037+0000 7f828b7fe700 1 --2- 172.21.15.40:0/1260658900 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f828c09e400 0x7f828c11eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:56.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.037+0000 7f82909d1700 1 --2- 172.21.15.40:0/1260658900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f828c11f400 0x7f828c1c8880 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f8284015000 tx=0x7f8284004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:56.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.038+0000 7f8288ff9700 1 -- 172.21.15.40:0/1260658900 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82840048b0 con 0x7f828c11f400 2023-09-30T22:28:56.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.038+0000 7f8288ff9700 1 -- 172.21.15.40:0/1260658900 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82840092e0 con 0x7f828c11f400 2023-09-30T22:28:56.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.038+0000 7f8292434700 1 -- 172.21.15.40:0/1260658900 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f828c120c80 con 0x7f828c11f400 2023-09-30T22:28:56.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.038+0000 7f8288ff9700 1 -- 172.21.15.40:0/1260658900 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828401c660 con 0x7f828c11f400 2023-09-30T22:28:56.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.038+0000 7f8292434700 1 -- 172.21.15.40:0/1260658900 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f828c121ac0 con 0x7f828c11f400 2023-09-30T22:28:56.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.039+0000 7f8288ff9700 1 -- 172.21.15.40:0/1260658900 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f828401c7c0 con 0x7f828c11f400 2023-09-30T22:28:56.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.039+0000 7f8292434700 1 -- 172.21.15.40:0/1260658900 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f828c13b920 con 0x7f828c11f400 2023-09-30T22:28:56.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.039+0000 7f8288ff9700 1 -- 172.21.15.40:0/1260658900 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f8284041000 con 0x7f828c11f400 2023-09-30T22:28:56.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.044+0000 7f8288ff9700 1 -- 172.21.15.40:0/1260658900 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f82840249a0 con 0x7f828c11f400 2023-09-30T22:28:56.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.072+0000 7fd13d2ce700 1 Processor -- start 2023-09-30T22:28:56.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.072+0000 7fd13d2ce700 1 -- start start 2023-09-30T22:28:56.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.072+0000 7fd13d2ce700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd13806f070 0x7fd13806f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.072+0000 7fd13d2ce700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd13806f980 0x7fd138097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.072+0000 7fd13d2ce700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd138070830 con 0x7fd13806fdb0 2023-09-30T22:28:56.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.072+0000 7fd13d2ce700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd138071af0 con 0x7fd13806f980 2023-09-30T22:28:56.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.072+0000 7fd13d2ce700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd138070ad0 con 0x7fd13806f070 2023-09-30T22:28:56.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.073+0000 7fd136ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd13806f070 0x7fd13806f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.073+0000 7fd1367fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd13806f980 0x7fd138097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.073+0000 7fd136ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd13806f070 0x7fd13806f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:57882/0 (socket says 172.21.15.40:57882) 2023-09-30T22:28:56.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.073+0000 7fd1377fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd13806fdb0 0x7fd1380975d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51266/0 (socket says 172.21.15.40:51266) 2023-09-30T22:28:56.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.073+0000 7fd136ffd700 1 -- 172.21.15.40:0/1028014399 learned_addr learned my addr 172.21.15.40:0/1028014399 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:56.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.073+0000 7fd136ffd700 1 -- 172.21.15.40:0/1028014399 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd13806f980 msgr2=0x7fd138097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:56.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.073+0000 7fd136ffd700 1 --2- 172.21.15.40:0/1028014399 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd13806f980 0x7fd138097090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.073+0000 7fd136ffd700 1 -- 172.21.15.40:0/1028014399 >> v1:172.21.15.40:6789/0 conn(0x7fd13806fdb0 legacy=0x7fd1380975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.073+0000 7fd135ffb700 1 -- 172.21.15.40:0/1028014399 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3389078656 0 0) 0x7fd138070830 con 0x7fd13806fdb0 2023-09-30T22:28:56.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.073+0000 7fd136ffd700 1 -- 172.21.15.40:0/1028014399 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd138070de0 con 0x7fd13806f070 2023-09-30T22:28:56.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.073+0000 7fd136ffd700 1 --2- 172.21.15.40:0/1028014399 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd13806f070 0x7fd13806f440 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fd128009950 tx=0x7fd128009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ab6f186967bac25 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:56.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.073+0000 7fd135ffb700 1 -- 172.21.15.40:0/1028014399 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd128011830 con 0x7fd13806f070 2023-09-30T22:28:56.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.073+0000 7fd135ffb700 1 -- 172.21.15.40:0/1028014399 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd128011990 con 0x7fd13806f070 2023-09-30T22:28:56.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.073+0000 7fd135ffb700 1 -- 172.21.15.40:0/1028014399 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd128011d40 con 0x7fd13806f070 2023-09-30T22:28:56.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.074+0000 7fd13d2ce700 1 -- 172.21.15.40:0/1028014399 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd13806f070 msgr2=0x7fd13806f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.074+0000 7fd13d2ce700 1 --2- 172.21.15.40:0/1028014399 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd13806f070 0x7fd13806f440 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fd128009950 tx=0x7fd128009c60 comp rx=0 tx=0).stop 2023-09-30T22:28:56.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.074+0000 7fd13d2ce700 1 -- 172.21.15.40:0/1028014399 shutdown_connections 2023-09-30T22:28:56.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.074+0000 7fd13d2ce700 1 --2- 172.21.15.40:0/1028014399 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd13806f070 0x7fd13806f440 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.074+0000 7fd13d2ce700 1 --2- 172.21.15.40:0/1028014399 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd13806f980 0x7fd138097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.074+0000 7fd13d2ce700 1 -- 172.21.15.40:0/1028014399 >> 172.21.15.40:0/1028014399 conn(0x7fd1380a41a0 msgr2=0x7fd1380a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:56.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.074+0000 7fd13d2ce700 1 -- 172.21.15.40:0/1028014399 shutdown_connections 2023-09-30T22:28:56.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.074+0000 7fd13d2ce700 1 -- 172.21.15.40:0/1028014399 wait complete. 2023-09-30T22:28:56.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.075+0000 7fd13d2ce700 1 Processor -- start 2023-09-30T22:28:56.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.076+0000 7fd13d2ce700 1 -- start start 2023-09-30T22:28:56.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.076+0000 7fd13d2ce700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd13806f070 0x7fd13806c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.076+0000 7fd13d2ce700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd13806f980 0x7fd13806ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.076+0000 7fd13d2ce700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd13806fdb0 0x7fd13806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.076+0000 7fd13d2ce700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13808b610 con 0x7fd13806fdb0 2023-09-30T22:28:56.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.076+0000 7fd13d2ce700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd13812c340 con 0x7fd13806f070 2023-09-30T22:28:56.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.076+0000 7fd13d2ce700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd13806e160 con 0x7fd13806f980 2023-09-30T22:28:56.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.076+0000 7fd136ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd13806f070 0x7fd13806c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.076+0000 7fd136ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd13806f070 0x7fd13806c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38728/0 (socket says 172.21.15.40:38728) 2023-09-30T22:28:56.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.076+0000 7fd136ffd700 1 -- 172.21.15.40:0/809774316 learned_addr learned my addr 172.21.15.40:0/809774316 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:56.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.076+0000 7fd1367fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd13806f980 0x7fd13806ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.076+0000 7fd1377fe700 1 --2- 172.21.15.40:0/809774316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd13806fdb0 0x7fd13806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.076+0000 7fd136ffd700 1 -- 172.21.15.40:0/809774316 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd13806f980 msgr2=0x7fd13806ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.076+0000 7fd136ffd700 1 --2- 172.21.15.40:0/809774316 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd13806f980 0x7fd13806ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.076+0000 7fd136ffd700 1 -- 172.21.15.40:0/809774316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd13806fdb0 msgr2=0x7fd13806d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.076+0000 7fd136ffd700 1 --2- 172.21.15.40:0/809774316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd13806fdb0 0x7fd13806d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.076+0000 7fd136ffd700 1 -- 172.21.15.40:0/809774316 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd128009550 con 0x7fd13806f070 2023-09-30T22:28:56.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.076+0000 7fd1367fc700 1 --2- 172.21.15.40:0/809774316 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd13806f980 0x7fd13806ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:56.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.076+0000 7fd1377fe700 1 --2- 172.21.15.40:0/809774316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd13806fdb0 0x7fd13806d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:56.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.077+0000 7fd136ffd700 1 --2- 172.21.15.40:0/809774316 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd13806f070 0x7fd13806c990 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fd138070c10 tx=0x7fd128004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:56.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.077+0000 7fd11f7fe700 1 -- 172.21.15.40:0/809774316 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12801a840 con 0x7fd13806f070 2023-09-30T22:28:56.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.077+0000 7fd11f7fe700 1 -- 172.21.15.40:0/809774316 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12801f070 con 0x7fd13806f070 2023-09-30T22:28:56.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.077+0000 7fd13d2ce700 1 -- 172.21.15.40:0/809774316 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd138129350 con 0x7fd13806f070 2023-09-30T22:28:56.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.077+0000 7fd11f7fe700 1 -- 172.21.15.40:0/809774316 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12801ac00 con 0x7fd13806f070 2023-09-30T22:28:56.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.077+0000 7fd13d2ce700 1 -- 172.21.15.40:0/809774316 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd13806e970 con 0x7fd13806f070 2023-09-30T22:28:56.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.078+0000 7fd11f7fe700 1 -- 172.21.15.40:0/809774316 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd12801b430 con 0x7fd13806f070 2023-09-30T22:28:56.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.078+0000 7fd11f7fe700 1 -- 172.21.15.40:0/809774316 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd128021070 con 0x7fd13806f070 2023-09-30T22:28:56.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.078+0000 7fd13d2ce700 1 -- 172.21.15.40:0/809774316 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd138062380 con 0x7fd13806f070 2023-09-30T22:28:56.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.087+0000 7fd11f7fe700 1 -- 172.21.15.40:0/809774316 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd128015020 con 0x7fd13806f070 2023-09-30T22:28:56.106 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:56.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.144+0000 7faa06f9d700 1 Processor -- start 2023-09-30T22:28:56.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.144+0000 7faa06f9d700 1 -- start start 2023-09-30T22:28:56.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.145+0000 7faa06f9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa001369d0 0x7faa00138db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.145+0000 7faa06f9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faa001392f0 0x7faa0013b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.145+0000 7faa06f9d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa001336c0 con 0x7faa00133a80 2023-09-30T22:28:56.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.145+0000 7faa06f9d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0009b920 con 0x7faa001369d0 2023-09-30T22:28:56.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.145+0000 7faa06f9d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa00071590 con 0x7faa001392f0 2023-09-30T22:28:56.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.145+0000 7faa05f9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7faa00133a80 0x7faa00133e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51270/0 (socket says 172.21.15.40:51270) 2023-09-30T22:28:56.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.145+0000 7faa05f9b700 1 -- 172.21.15.40:0/1418126916 learned_addr learned my addr 172.21.15.40:0/1418126916 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:56.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.145+0000 7faa0579a700 1 --2- 172.21.15.40:0/1418126916 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa001369d0 0x7faa00138db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.145+0000 7faa0679c700 1 --2- 172.21.15.40:0/1418126916 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faa001392f0 0x7faa0013b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.145+0000 7faa0579a700 1 -- 172.21.15.40:0/1418126916 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faa001392f0 msgr2=0x7faa0013b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:56.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.145+0000 7faa0579a700 1 --2- 172.21.15.40:0/1418126916 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faa001392f0 0x7faa0013b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.145+0000 7faa0579a700 1 -- 172.21.15.40:0/1418126916 >> v1:172.21.15.40:6789/0 conn(0x7faa00133a80 legacy=0x7faa00133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.145+0000 7faa0579a700 1 -- 172.21.15.40:0/1418126916 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0006eb70 con 0x7faa001369d0 2023-09-30T22:28:56.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.146+0000 7faa0579a700 1 --2- 172.21.15.40:0/1418126916 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa001369d0 0x7faa00138db0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0009870 tx=0x7fa9f0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52a359a77a19fc48 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:56.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.146+0000 7faa04f99700 1 -- 172.21.15.40:0/1418126916 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f0011830 con 0x7faa001369d0 2023-09-30T22:28:56.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.146+0000 7faa04f99700 1 -- 172.21.15.40:0/1418126916 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f0011990 con 0x7faa001369d0 2023-09-30T22:28:56.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.146+0000 7faa04f99700 1 -- 172.21.15.40:0/1418126916 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f0011d20 con 0x7faa001369d0 2023-09-30T22:28:56.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.146+0000 7faa06f9d700 1 -- 172.21.15.40:0/1418126916 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa001369d0 msgr2=0x7faa00138db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.146+0000 7faa06f9d700 1 --2- 172.21.15.40:0/1418126916 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa001369d0 0x7faa00138db0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0009870 tx=0x7fa9f0009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:56.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.146+0000 7faa06f9d700 1 -- 172.21.15.40:0/1418126916 shutdown_connections 2023-09-30T22:28:56.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.146+0000 7faa06f9d700 1 --2- 172.21.15.40:0/1418126916 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faa001392f0 0x7faa0013b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.146+0000 7faa06f9d700 1 --2- 172.21.15.40:0/1418126916 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa001369d0 0x7faa00138db0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.146+0000 7faa06f9d700 1 -- 172.21.15.40:0/1418126916 >> 172.21.15.40:0/1418126916 conn(0x7faa000a27f0 msgr2=0x7faa000a2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:56.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.147+0000 7faa06f9d700 1 -- 172.21.15.40:0/1418126916 shutdown_connections 2023-09-30T22:28:56.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.147+0000 7faa06f9d700 1 -- 172.21.15.40:0/1418126916 wait complete. 2023-09-30T22:28:56.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.148+0000 7faa06f9d700 1 Processor -- start 2023-09-30T22:28:56.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.148+0000 7faa06f9d700 1 -- start start 2023-09-30T22:28:56.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.148+0000 7faa06f9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa00133a80 0x7faa001c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.148+0000 7faa06f9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa001369d0 0x7faa001c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.148+0000 7faa06f9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faa001392f0 0x7faa00118c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.148+0000 7faa06f9d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0011b440 con 0x7faa00133a80 2023-09-30T22:28:56.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.148+0000 7faa06f9d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa00130d40 con 0x7faa001369d0 2023-09-30T22:28:56.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.148+0000 7faa06f9d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa00138ec0 con 0x7faa001392f0 2023-09-30T22:28:56.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.148+0000 7faa05f9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa00133a80 0x7faa001c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.148+0000 7faa05f9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa00133a80 0x7faa001c8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50758/0 (socket says 172.21.15.40:50758) 2023-09-30T22:28:56.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.148+0000 7faa05f9b700 1 -- 172.21.15.40:0/1305216291 learned_addr learned my addr 172.21.15.40:0/1305216291 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:56.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.148+0000 7faa0679c700 1 --2- 172.21.15.40:0/1305216291 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faa001392f0 0x7faa00118c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.149+0000 7faa0579a700 1 --2- 172.21.15.40:0/1305216291 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa001369d0 0x7faa001c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.149+0000 7faa05f9b700 1 -- 172.21.15.40:0/1305216291 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faa001392f0 msgr2=0x7faa00118c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.149+0000 7faa05f9b700 1 --2- 172.21.15.40:0/1305216291 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faa001392f0 0x7faa00118c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.149+0000 7faa05f9b700 1 -- 172.21.15.40:0/1305216291 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa001369d0 msgr2=0x7faa001c8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.149+0000 7faa05f9b700 1 --2- 172.21.15.40:0/1305216291 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa001369d0 0x7faa001c8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.149+0000 7faa05f9b700 1 -- 172.21.15.40:0/1305216291 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f00094a0 con 0x7faa00133a80 2023-09-30T22:28:56.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.149+0000 7faa05f9b700 1 --2- 172.21.15.40:0/1305216291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa00133a80 0x7faa001c8650 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00c520 tx=0x7fa9fc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:56.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.149+0000 7fa9f67fc700 1 -- 172.21.15.40:0/1305216291 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc005d70 con 0x7faa00133a80 2023-09-30T22:28:56.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.149+0000 7fa9f67fc700 1 -- 172.21.15.40:0/1305216291 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9fc0070d0 con 0x7faa00133a80 2023-09-30T22:28:56.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.149+0000 7fa9f67fc700 1 -- 172.21.15.40:0/1305216291 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc007440 con 0x7faa00133a80 2023-09-30T22:28:56.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.149+0000 7faa06f9d700 1 -- 172.21.15.40:0/1305216291 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa0012ddb0 con 0x7faa00133a80 2023-09-30T22:28:56.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.149+0000 7faa06f9d700 1 -- 172.21.15.40:0/1305216291 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa0012da40 con 0x7faa00133a80 2023-09-30T22:28:56.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.150+0000 7fa9f67fc700 1 -- 172.21.15.40:0/1305216291 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa9fc0075a0 con 0x7faa00133a80 2023-09-30T22:28:56.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.150+0000 7faa06f9d700 1 -- 172.21.15.40:0/1305216291 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa00062380 con 0x7faa00133a80 2023-09-30T22:28:56.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.151+0000 7fa9f67fc700 1 -- 172.21.15.40:0/1305216291 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa9fc03ea50 con 0x7faa00133a80 2023-09-30T22:28:56.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.160+0000 7fa9f67fc700 1 -- 172.21.15.40:0/1305216291 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa9fc019b40 con 0x7faa00133a80 2023-09-30T22:28:56.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.244+0000 7f09e1446700 1 Processor -- start 2023-09-30T22:28:56.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.245+0000 7f09e1446700 1 -- start start 2023-09-30T22:28:56.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.245+0000 7f09e1446700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f09dc09d920 0x7f09dc09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.245+0000 7f09e1446700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f09dc09e230 0x7f09dc1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.245+0000 7f09e1446700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09dc09f940 con 0x7f09dc09f0f0 2023-09-30T22:28:56.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.245+0000 7f09e1446700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc06b4c0 con 0x7f09dc09e230 2023-09-30T22:28:56.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.245+0000 7f09e1446700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc09a8f0 con 0x7f09dc09d920 2023-09-30T22:28:56.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.246+0000 7f09daffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f09dc09d920 0x7f09dc09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.246+0000 7f09daffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f09dc09d920 0x7f09dc09dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:57906/0 (socket says 172.21.15.40:57906) 2023-09-30T22:28:56.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.246+0000 7f09daffd700 1 -- 172.21.15.40:0/2884436501 learned_addr learned my addr 172.21.15.40:0/2884436501 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:56.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.246+0000 7f09db7fe700 1 --2- 172.21.15.40:0/2884436501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f09dc09e230 0x7f09dc1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.246+0000 7f09db7fe700 1 -- 172.21.15.40:0/2884436501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f09dc09d920 msgr2=0x7f09dc09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:56.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.246+0000 7f09db7fe700 1 --2- 172.21.15.40:0/2884436501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f09dc09d920 0x7f09dc09dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.246+0000 7f09db7fe700 1 -- 172.21.15.40:0/2884436501 >> v1:172.21.15.40:6789/0 conn(0x7f09dc09f0f0 legacy=0x7f09dc133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.246+0000 7f09db7fe700 1 -- 172.21.15.40:0/2884436501 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09dc09f6e0 con 0x7f09dc09e230 2023-09-30T22:28:56.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.246+0000 7f09daffd700 1 --2- 172.21.15.40:0/2884436501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f09dc09d920 0x7f09dc09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:56.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.246+0000 7f09db7fe700 1 --2- 172.21.15.40:0/2884436501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f09dc09e230 0x7f09dc1343b0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f09d4009dc0 tx=0x7f09d400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35f0f4ce64ed29d2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:56.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.246+0000 7f09d9ffb700 1 -- 172.21.15.40:0/2884436501 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d400e070 con 0x7f09dc09e230 2023-09-30T22:28:56.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.246+0000 7f09d9ffb700 1 -- 172.21.15.40:0/2884436501 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d400bb20 con 0x7f09dc09e230 2023-09-30T22:28:56.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.247+0000 7f09d9ffb700 1 -- 172.21.15.40:0/2884436501 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d4012430 con 0x7f09dc09e230 2023-09-30T22:28:56.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.247+0000 7f09e1446700 1 -- 172.21.15.40:0/2884436501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f09dc09e230 msgr2=0x7f09dc1343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.247+0000 7f09e1446700 1 --2- 172.21.15.40:0/2884436501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f09dc09e230 0x7f09dc1343b0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f09d4009dc0 tx=0x7f09d400b330 comp rx=0 tx=0).stop 2023-09-30T22:28:56.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.247+0000 7f09e1446700 1 -- 172.21.15.40:0/2884436501 shutdown_connections 2023-09-30T22:28:56.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.247+0000 7f09e1446700 1 --2- 172.21.15.40:0/2884436501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f09dc09e230 0x7f09dc1343b0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.247+0000 7f09e1446700 1 --2- 172.21.15.40:0/2884436501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f09dc09d920 0x7f09dc09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.247+0000 7f09e1446700 1 -- 172.21.15.40:0/2884436501 >> 172.21.15.40:0/2884436501 conn(0x7f09dc09fb20 msgr2=0x7f09dc09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:56.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.247+0000 7f09e1446700 1 -- 172.21.15.40:0/2884436501 shutdown_connections 2023-09-30T22:28:56.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.248+0000 7f09e1446700 1 -- 172.21.15.40:0/2884436501 wait complete. 2023-09-30T22:28:56.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.249+0000 7f09e1446700 1 Processor -- start 2023-09-30T22:28:56.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.249+0000 7f09e1446700 1 -- start start 2023-09-30T22:28:56.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.250+0000 7f09e1446700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09dc09d920 0x7f09dc1227a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.250+0000 7f09e1446700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f09dc09e230 0x7f09dc122ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.250+0000 7f09e1446700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f09dc123220 0x7f09dc1ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.250+0000 7f09e1446700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc09c9e0 con 0x7f09dc09d920 2023-09-30T22:28:56.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.250+0000 7f09e1446700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc0a3220 con 0x7f09dc09e230 2023-09-30T22:28:56.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.250+0000 7f09e1446700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc1251d0 con 0x7f09dc123220 2023-09-30T22:28:56.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.250+0000 7f09daffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09dc09d920 0x7f09dc1227a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.250+0000 7f09daffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09dc09d920 0x7f09dc1227a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50764/0 (socket says 172.21.15.40:50764) 2023-09-30T22:28:56.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.250+0000 7f09daffd700 1 -- 172.21.15.40:0/2433455592 learned_addr learned my addr 172.21.15.40:0/2433455592 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:56.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.250+0000 7f09da7fc700 1 --2- 172.21.15.40:0/2433455592 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f09dc09e230 0x7f09dc122ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.250+0000 7f09db7fe700 1 --2- 172.21.15.40:0/2433455592 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f09dc123220 0x7f09dc1ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.250+0000 7f09db7fe700 1 -- 172.21.15.40:0/2433455592 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f09dc09e230 msgr2=0x7f09dc122ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.250+0000 7f09db7fe700 1 --2- 172.21.15.40:0/2433455592 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f09dc09e230 0x7f09dc122ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.250+0000 7f09db7fe700 1 -- 172.21.15.40:0/2433455592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09dc09d920 msgr2=0x7f09dc1227a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.250+0000 7f09db7fe700 1 --2- 172.21.15.40:0/2433455592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09dc09d920 0x7f09dc1227a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.250+0000 7f09db7fe700 1 -- 172.21.15.40:0/2433455592 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09cc009500 con 0x7f09dc123220 2023-09-30T22:28:56.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.250+0000 7f09daffd700 1 --2- 172.21.15.40:0/2433455592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09dc09d920 0x7f09dc1227a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:56.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.251+0000 7f09db7fe700 1 --2- 172.21.15.40:0/2433455592 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f09dc123220 0x7f09dc1ce9c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f09d4009dc0 tx=0x7f09d4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:56.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.251+0000 7f09c37fe700 1 -- 172.21.15.40:0/2433455592 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d4004880 con 0x7f09dc123220 2023-09-30T22:28:56.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.251+0000 7f09c37fe700 1 -- 172.21.15.40:0/2433455592 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d4020070 con 0x7f09dc123220 2023-09-30T22:28:56.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.251+0000 7f09e1446700 1 -- 172.21.15.40:0/2433455592 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d4009a70 con 0x7f09dc123220 2023-09-30T22:28:56.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.251+0000 7f09c37fe700 1 -- 172.21.15.40:0/2433455592 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d40276c0 con 0x7f09dc123220 2023-09-30T22:28:56.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.251+0000 7f09e1446700 1 -- 172.21.15.40:0/2433455592 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09dc125fe0 con 0x7f09dc123220 2023-09-30T22:28:56.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.252+0000 7f09e1446700 1 -- 172.21.15.40:0/2433455592 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09dc062380 con 0x7f09dc123220 2023-09-30T22:28:56.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.253+0000 7f09c37fe700 1 -- 172.21.15.40:0/2433455592 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f09d4012430 con 0x7f09dc123220 2023-09-30T22:28:56.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.253+0000 7f09c37fe700 1 -- 172.21.15.40:0/2433455592 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f09d4022070 con 0x7f09dc123220 2023-09-30T22:28:56.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.255+0000 7f8292434700 1 -- 172.21.15.40:0/1260658900 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f828c062380 con 0x7f828c11f400 2023-09-30T22:28:56.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.255+0000 7f8288ff9700 1 -- 172.21.15.40:0/1260658900 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f82840243b0 con 0x7f828c11f400 2023-09-30T22:28:56.256 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:56.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.257+0000 7f8292434700 1 -- 172.21.15.40:0/1260658900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f828c11f400 msgr2=0x7f828c1c8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.257+0000 7f8292434700 1 --2- 172.21.15.40:0/1260658900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f828c11f400 0x7f828c1c8880 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f8284015000 tx=0x7f8284004ad0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.257+0000 7f8292434700 1 -- 172.21.15.40:0/1260658900 shutdown_connections 2023-09-30T22:28:56.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.257+0000 7f8292434700 1 --2- 172.21.15.40:0/1260658900 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f828c09d920 0x7f828c11e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.257+0000 7f8292434700 1 --2- 172.21.15.40:0/1260658900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f828c11f400 0x7f828c1c8880 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.257+0000 7f8292434700 1 --2- 172.21.15.40:0/1260658900 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f828c09e400 0x7f828c11eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.257+0000 7f8292434700 1 -- 172.21.15.40:0/1260658900 >> 172.21.15.40:0/1260658900 conn(0x7f828c09fb20 msgr2=0x7f828c0a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:56.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.257+0000 7f8292434700 1 -- 172.21.15.40:0/1260658900 shutdown_connections 2023-09-30T22:28:56.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.258+0000 7f8292434700 1 -- 172.21.15.40:0/1260658900 wait complete. 2023-09-30T22:28:56.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.262+0000 7f09c37fe700 1 -- 172.21.15.40:0/2433455592 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f09d401b400 con 0x7f09dc123220 2023-09-30T22:28:56.271 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:56.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.314+0000 7fd13d2ce700 1 -- 172.21.15.40:0/809774316 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd13809fe20 con 0x7fd13806f070 2023-09-30T22:28:56.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.314+0000 7fd11f7fe700 1 -- 172.21.15.40:0/809774316 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd128024380 con 0x7fd13806f070 2023-09-30T22:28:56.315 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:56.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.317+0000 7fd13d2ce700 1 -- 172.21.15.40:0/809774316 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd13806f070 msgr2=0x7fd13806c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.317+0000 7fd13d2ce700 1 --2- 172.21.15.40:0/809774316 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd13806f070 0x7fd13806c990 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fd138070c10 tx=0x7fd128004750 comp rx=0 tx=0).stop 2023-09-30T22:28:56.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.317+0000 7fd13d2ce700 1 -- 172.21.15.40:0/809774316 shutdown_connections 2023-09-30T22:28:56.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.317+0000 7fd13d2ce700 1 --2- 172.21.15.40:0/809774316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd13806fdb0 0x7fd13806d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.317+0000 7fd13d2ce700 1 --2- 172.21.15.40:0/809774316 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd13806f070 0x7fd13806c990 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.317+0000 7fd13d2ce700 1 --2- 172.21.15.40:0/809774316 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd13806f980 0x7fd13806ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.317+0000 7fd13d2ce700 1 -- 172.21.15.40:0/809774316 >> 172.21.15.40:0/809774316 conn(0x7fd1380a41a0 msgr2=0x7fd138097530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:56.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.318+0000 7fd13d2ce700 1 -- 172.21.15.40:0/809774316 shutdown_connections 2023-09-30T22:28:56.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.318+0000 7fd13d2ce700 1 -- 172.21.15.40:0/809774316 wait complete. 2023-09-30T22:28:56.336 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:56.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.372+0000 7faa06f9d700 1 -- 172.21.15.40:0/1305216291 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7faa00074820 con 0x7faa00133a80 2023-09-30T22:28:56.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.373+0000 7fa9f67fc700 1 -- 172.21.15.40:0/1305216291 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa9fc017030 con 0x7faa00133a80 2023-09-30T22:28:56.374 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:56.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.375+0000 7faa06f9d700 1 -- 172.21.15.40:0/1305216291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa00133a80 msgr2=0x7faa001c8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.375+0000 7faa06f9d700 1 --2- 172.21.15.40:0/1305216291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa00133a80 0x7faa001c8650 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00c520 tx=0x7fa9fc00c830 comp rx=0 tx=0).stop 2023-09-30T22:28:56.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.375+0000 7faa06f9d700 1 -- 172.21.15.40:0/1305216291 shutdown_connections 2023-09-30T22:28:56.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.375+0000 7faa06f9d700 1 --2- 172.21.15.40:0/1305216291 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faa001392f0 0x7faa00118c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.375+0000 7faa06f9d700 1 --2- 172.21.15.40:0/1305216291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa00133a80 0x7faa001c8650 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.375+0000 7faa06f9d700 1 --2- 172.21.15.40:0/1305216291 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa001369d0 0x7faa001c8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.375+0000 7faa06f9d700 1 -- 172.21.15.40:0/1305216291 >> 172.21.15.40:0/1305216291 conn(0x7faa000a27f0 msgr2=0x7faa00134790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:56.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.375+0000 7faa06f9d700 1 -- 172.21.15.40:0/1305216291 shutdown_connections 2023-09-30T22:28:56.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.375+0000 7faa06f9d700 1 -- 172.21.15.40:0/1305216291 wait complete. 2023-09-30T22:28:56.387 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:56.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.479+0000 7f09e1446700 1 -- 172.21.15.40:0/2433455592 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f09dc074720 con 0x7f09dc123220 2023-09-30T22:28:56.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.479+0000 7f09c37fe700 1 -- 172.21.15.40:0/2433455592 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f09d40263e0 con 0x7f09dc123220 2023-09-30T22:28:56.480 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:56.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.481+0000 7f09e1446700 1 -- 172.21.15.40:0/2433455592 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f09dc123220 msgr2=0x7f09dc1ce9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.481+0000 7f09e1446700 1 --2- 172.21.15.40:0/2433455592 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f09dc123220 0x7f09dc1ce9c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f09d4009dc0 tx=0x7f09d4004ad0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.481+0000 7f09e1446700 1 -- 172.21.15.40:0/2433455592 shutdown_connections 2023-09-30T22:28:56.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.481+0000 7f09e1446700 1 --2- 172.21.15.40:0/2433455592 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f09dc123220 0x7f09dc1ce9c0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.481+0000 7f09e1446700 1 --2- 172.21.15.40:0/2433455592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09dc09d920 0x7f09dc1227a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.481+0000 7f09e1446700 1 --2- 172.21.15.40:0/2433455592 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f09dc09e230 0x7f09dc122ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.481+0000 7f09e1446700 1 -- 172.21.15.40:0/2433455592 >> 172.21.15.40:0/2433455592 conn(0x7f09dc09fb20 msgr2=0x7f09dc0a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:56.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.481+0000 7f09e1446700 1 -- 172.21.15.40:0/2433455592 shutdown_connections 2023-09-30T22:28:56.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:56.481+0000 7f09e1446700 1 -- 172.21.15.40:0/2433455592 wait complete. 2023-09-30T22:28:56.494 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:57.272 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:57.337 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:57.388 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:57.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.416+0000 7f377ff73700 1 Processor -- start 2023-09-30T22:28:57.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.416+0000 7f377ff73700 1 -- start start 2023-09-30T22:28:57.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.417+0000 7f377ff73700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3778095430 0x7f3778095800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.417+0000 7f377ff73700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f37781306b0 0x7f3778130ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.417+0000 7f377ff73700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3778072880 con 0x7f3778131020 2023-09-30T22:28:57.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.417+0000 7f377ff73700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3778098990 con 0x7f3778095430 2023-09-30T22:28:57.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.417+0000 7f377ff73700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3778099720 con 0x7f37781306b0 2023-09-30T22:28:57.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.417+0000 7f377dd0f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3778095430 0x7f3778095800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.417+0000 7f377dd0f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3778095430 0x7f3778095800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50780/0 (socket says 172.21.15.40:50780) 2023-09-30T22:28:57.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.417+0000 7f377dd0f700 1 -- 172.21.15.40:0/313238059 learned_addr learned my addr 172.21.15.40:0/313238059 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:57.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.417+0000 7f377d50e700 1 --2- 172.21.15.40:0/313238059 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f37781306b0 0x7f3778130ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.417+0000 7f377dd0f700 1 -- 172.21.15.40:0/313238059 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f37781306b0 msgr2=0x7f3778130ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:57.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.417+0000 7f377dd0f700 1 --2- 172.21.15.40:0/313238059 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f37781306b0 0x7f3778130ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.417+0000 7f377dd0f700 1 -- 172.21.15.40:0/313238059 >> v1:172.21.15.40:6789/0 conn(0x7f3778131020 legacy=0x7f37781379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.417+0000 7f377dd0f700 1 -- 172.21.15.40:0/313238059 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37781314a0 con 0x7f3778095430 2023-09-30T22:28:57.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.417+0000 7f377d50e700 1 --2- 172.21.15.40:0/313238059 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f37781306b0 0x7f3778130ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:57.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.418+0000 7f377dd0f700 1 --2- 172.21.15.40:0/313238059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3778095430 0x7f3778095800 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f377400dd10 tx=0x7f3774008330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a32b4501ced46b7e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:57.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.418+0000 7f377cd0d700 1 -- 172.21.15.40:0/313238059 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377400b070 con 0x7f3778095430 2023-09-30T22:28:57.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.418+0000 7f377cd0d700 1 -- 172.21.15.40:0/313238059 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377400de60 con 0x7f3778095430 2023-09-30T22:28:57.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.418+0000 7f377cd0d700 1 -- 172.21.15.40:0/313238059 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3774016670 con 0x7f3778095430 2023-09-30T22:28:57.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.418+0000 7f377ff73700 1 -- 172.21.15.40:0/313238059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3778095430 msgr2=0x7f3778095800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.418+0000 7f377ff73700 1 --2- 172.21.15.40:0/313238059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3778095430 0x7f3778095800 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f377400dd10 tx=0x7f3774008330 comp rx=0 tx=0).stop 2023-09-30T22:28:57.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.419+0000 7f377ff73700 1 -- 172.21.15.40:0/313238059 shutdown_connections 2023-09-30T22:28:57.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.419+0000 7f377ff73700 1 --2- 172.21.15.40:0/313238059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3778095430 0x7f3778095800 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.419+0000 7f377ff73700 1 --2- 172.21.15.40:0/313238059 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f37781306b0 0x7f3778130ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.419+0000 7f377ff73700 1 -- 172.21.15.40:0/313238059 >> 172.21.15.40:0/313238059 conn(0x7f37780a2ff0 msgr2=0x7f377809ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:57.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.419+0000 7f377ff73700 1 -- 172.21.15.40:0/313238059 shutdown_connections 2023-09-30T22:28:57.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.419+0000 7f377ff73700 1 -- 172.21.15.40:0/313238059 wait complete. 2023-09-30T22:28:57.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.420+0000 7f377ff73700 1 Processor -- start 2023-09-30T22:28:57.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.420+0000 7f377ff73700 1 -- start start 2023-09-30T22:28:57.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.420+0000 7f377ff73700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3778095430 0x7f377806fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.420+0000 7f377ff73700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37781306b0 0x7f3778070300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.420+0000 7f377ff73700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3778131020 0x7f3778070840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.420+0000 7f377ff73700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3778128420 con 0x7f37781306b0 2023-09-30T22:28:57.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.420+0000 7f377ff73700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3778128600 con 0x7f3778131020 2023-09-30T22:28:57.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.420+0000 7f377ff73700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3778096aa0 con 0x7f3778095430 2023-09-30T22:28:57.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.420+0000 7f377dd0f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3778095430 0x7f377806fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.420+0000 7f377e510700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3778131020 0x7f3778070840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.420+0000 7f377dd0f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3778095430 0x7f377806fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:57952/0 (socket says 172.21.15.40:57952) 2023-09-30T22:28:57.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.420+0000 7f377dd0f700 1 -- 172.21.15.40:0/3685973616 learned_addr learned my addr 172.21.15.40:0/3685973616 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:57.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.420+0000 7f377d50e700 1 --2- 172.21.15.40:0/3685973616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37781306b0 0x7f3778070300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.421+0000 7f377e510700 1 -- 172.21.15.40:0/3685973616 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3778095430 msgr2=0x7f377806fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.421+0000 7f377e510700 1 --2- 172.21.15.40:0/3685973616 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3778095430 0x7f377806fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.421+0000 7f377e510700 1 -- 172.21.15.40:0/3685973616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37781306b0 msgr2=0x7f3778070300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.421+0000 7f377e510700 1 --2- 172.21.15.40:0/3685973616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37781306b0 0x7f3778070300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.421+0000 7f377e510700 1 -- 172.21.15.40:0/3685973616 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37680094a0 con 0x7f3778131020 2023-09-30T22:28:57.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.421+0000 7f377e510700 1 --2- 172.21.15.40:0/3685973616 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3778131020 0x7f3778070840 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f377000cbc0 tx=0x7f377000ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:57.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.421+0000 7f376e7fc700 1 -- 172.21.15.40:0/3685973616 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770003c00 con 0x7f3778131020 2023-09-30T22:28:57.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.421+0000 7f376e7fc700 1 -- 172.21.15.40:0/3685973616 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3770003d60 con 0x7f3778131020 2023-09-30T22:28:57.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.421+0000 7f377ff73700 1 -- 172.21.15.40:0/3685973616 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f377400d9f0 con 0x7f3778131020 2023-09-30T22:28:57.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.421+0000 7f376e7fc700 1 -- 172.21.15.40:0/3685973616 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377000aa40 con 0x7f3778131020 2023-09-30T22:28:57.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.421+0000 7f377ff73700 1 -- 172.21.15.40:0/3685973616 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3778071ef0 con 0x7f3778131020 2023-09-30T22:28:57.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.422+0000 7f376e7fc700 1 -- 172.21.15.40:0/3685973616 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f377000aba0 con 0x7f3778131020 2023-09-30T22:28:57.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.422+0000 7f376e7fc700 1 -- 172.21.15.40:0/3685973616 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f377003f620 con 0x7f3778131020 2023-09-30T22:28:57.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.423+0000 7f377ff73700 1 -- 172.21.15.40:0/3685973616 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3778128740 con 0x7f3778131020 2023-09-30T22:28:57.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.427+0000 7f376e7fc700 1 -- 172.21.15.40:0/3685973616 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3778128740 con 0x7f3778131020 2023-09-30T22:28:57.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.478+0000 7fde24028700 1 Processor -- start 2023-09-30T22:28:57.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.478+0000 7fde24028700 1 -- start start 2023-09-30T22:28:57.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.479+0000 7fde24028700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fde1c09c890 0x7fde1c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.479+0000 7fde24028700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde1c09d920 0x7fde1c09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.479+0000 7fde24028700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fde1c09e2b0 0x7fde1c13ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.479+0000 7fde24028700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde1c0a29d0 con 0x7fde1c09e2b0 2023-09-30T22:28:57.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.479+0000 7fde24028700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c09fb40 con 0x7fde1c09d920 2023-09-30T22:28:57.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.479+0000 7fde24028700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c0a2600 con 0x7fde1c09c890 2023-09-30T22:28:57.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.479+0000 7fde21dc4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fde1c09c890 0x7fde1c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.479+0000 7fde215c3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde1c09d920 0x7fde1c09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.479+0000 7fde21dc4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fde1c09c890 0x7fde1c09cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:57958/0 (socket says 172.21.15.40:57958) 2023-09-30T22:28:57.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.479+0000 7fde21dc4700 1 -- 172.21.15.40:0/373247336 learned_addr learned my addr 172.21.15.40:0/373247336 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:57.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.479+0000 7fde225c5700 1 --2- 172.21.15.40:0/373247336 >> v2:172.21.15.40:3300/0 conn(0x7fde1c09e2b0 0x7fde1c13ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.479+0000 7fde21dc4700 1 -- 172.21.15.40:0/373247336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde1c09d920 msgr2=0x7fde1c09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:57.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.479+0000 7fde21dc4700 1 --2- 172.21.15.40:0/373247336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde1c09d920 0x7fde1c09dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.479+0000 7fde21dc4700 1 -- 172.21.15.40:0/373247336 >> v2:172.21.15.40:3300/0 conn(0x7fde1c09e2b0 msgr2=0x7fde1c13ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:57.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.479+0000 7fde21dc4700 1 --2- 172.21.15.40:0/373247336 >> v2:172.21.15.40:3300/0 conn(0x7fde1c09e2b0 0x7fde1c13ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.479+0000 7fde21dc4700 1 -- 172.21.15.40:0/373247336 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde1c09e720 con 0x7fde1c09c890 2023-09-30T22:28:57.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.479+0000 7fde225c5700 1 --2- 172.21.15.40:0/373247336 >> v2:172.21.15.40:3300/0 conn(0x7fde1c09e2b0 0x7fde1c13ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:57.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.479+0000 7fde21dc4700 1 --2- 172.21.15.40:0/373247336 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fde1c09c890 0x7fde1c09cc60 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fde18006fd0 tx=0x7fde18009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f96405ae45f8a22 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:57.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.480+0000 7fde20dc2700 1 -- 172.21.15.40:0/373247336 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde18005e30 con 0x7fde1c09c890 2023-09-30T22:28:57.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.480+0000 7fde20dc2700 1 -- 172.21.15.40:0/373247336 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde18004030 con 0x7fde1c09c890 2023-09-30T22:28:57.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.480+0000 7fde20dc2700 1 -- 172.21.15.40:0/373247336 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde180043e0 con 0x7fde1c09c890 2023-09-30T22:28:57.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.480+0000 7fde24028700 1 -- 172.21.15.40:0/373247336 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fde1c09c890 msgr2=0x7fde1c09cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.480+0000 7fde24028700 1 --2- 172.21.15.40:0/373247336 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fde1c09c890 0x7fde1c09cc60 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fde18006fd0 tx=0x7fde18009bd0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.480+0000 7fde24028700 1 -- 172.21.15.40:0/373247336 shutdown_connections 2023-09-30T22:28:57.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.480+0000 7fde24028700 1 --2- 172.21.15.40:0/373247336 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fde1c09c890 0x7fde1c09cc60 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.480+0000 7fde24028700 1 --2- 172.21.15.40:0/373247336 >> v2:172.21.15.40:3300/0 conn(0x7fde1c09e2b0 0x7fde1c13ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.480+0000 7fde24028700 1 --2- 172.21.15.40:0/373247336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde1c09d920 0x7fde1c09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.480+0000 7fde24028700 1 -- 172.21.15.40:0/373247336 >> 172.21.15.40:0/373247336 conn(0x7fde1c0a7080 msgr2=0x7fde1c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:57.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.480+0000 7fde24028700 1 -- 172.21.15.40:0/373247336 shutdown_connections 2023-09-30T22:28:57.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.480+0000 7fde24028700 1 -- 172.21.15.40:0/373247336 wait complete. 2023-09-30T22:28:57.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.482+0000 7fde24028700 1 Processor -- start 2023-09-30T22:28:57.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.482+0000 7fde24028700 1 -- start start 2023-09-30T22:28:57.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.482+0000 7fde24028700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde1c09c890 0x7fde1c12d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.482+0000 7fde24028700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fde1c09d920 0x7fde1c12d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.482+0000 7fde24028700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde1c09e2b0 0x7fde1c12ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.482+0000 7fde24028700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c12ffd0 con 0x7fde1c09c890 2023-09-30T22:28:57.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.482+0000 7fde24028700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c09ecf0 con 0x7fde1c09e2b0 2023-09-30T22:28:57.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.482+0000 7fde24028700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c130710 con 0x7fde1c09d920 2023-09-30T22:28:57.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.482+0000 7fde215c3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fde1c09d920 0x7fde1c12d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.482+0000 7fde215c3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fde1c09d920 0x7fde1c12d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:57964/0 (socket says 172.21.15.40:57964) 2023-09-30T22:28:57.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.482+0000 7fde215c3700 1 -- 172.21.15.40:0/595425404 learned_addr learned my addr 172.21.15.40:0/595425404 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:57.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.482+0000 7fde21dc4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde1c09c890 0x7fde1c12d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.483+0000 7fde225c5700 1 --2- 172.21.15.40:0/595425404 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde1c09e2b0 0x7fde1c12ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.483+0000 7fde21dc4700 1 -- 172.21.15.40:0/595425404 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fde1c09d920 msgr2=0x7fde1c12d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.483+0000 7fde21dc4700 1 --2- 172.21.15.40:0/595425404 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fde1c09d920 0x7fde1c12d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.483+0000 7fde21dc4700 1 -- 172.21.15.40:0/595425404 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde1c09e2b0 msgr2=0x7fde1c12ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.483+0000 7fde21dc4700 1 --2- 172.21.15.40:0/595425404 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde1c09e2b0 0x7fde1c12ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.483+0000 7fde21dc4700 1 -- 172.21.15.40:0/595425404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde14009a70 con 0x7fde1c09c890 2023-09-30T22:28:57.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.483+0000 7fde215c3700 1 --2- 172.21.15.40:0/595425404 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fde1c09d920 0x7fde1c12d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:57.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.483+0000 7fde21dc4700 1 --2- 172.21.15.40:0/595425404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde1c09c890 0x7fde1c12d340 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fde18013000 tx=0x7fde18004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:57.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.483+0000 7fde127fc700 1 -- 172.21.15.40:0/595425404 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde180043d0 con 0x7fde1c09c890 2023-09-30T22:28:57.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.483+0000 7fde127fc700 1 -- 172.21.15.40:0/595425404 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1801c420 con 0x7fde1c09c890 2023-09-30T22:28:57.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.483+0000 7fde24028700 1 -- 172.21.15.40:0/595425404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde18009500 con 0x7fde1c09c890 2023-09-30T22:28:57.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.483+0000 7fde127fc700 1 -- 172.21.15.40:0/595425404 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1801c7d0 con 0x7fde1c09c890 2023-09-30T22:28:57.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.483+0000 7fde24028700 1 -- 172.21.15.40:0/595425404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde1c12fb60 con 0x7fde1c09c890 2023-09-30T22:28:57.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.484+0000 7fde127fc700 1 -- 172.21.15.40:0/595425404 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fde1801c930 con 0x7fde1c09c890 2023-09-30T22:28:57.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.484+0000 7fde24028700 1 -- 172.21.15.40:0/595425404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde1c062380 con 0x7fde1c09c890 2023-09-30T22:28:57.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.485+0000 7fde127fc700 1 -- 172.21.15.40:0/595425404 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fde18040350 con 0x7fde1c09c890 2023-09-30T22:28:57.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.489+0000 7fde127fc700 1 -- 172.21.15.40:0/595425404 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fde1801b740 con 0x7fde1c09c890 2023-09-30T22:28:57.495 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:57.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.535+0000 7f2356b07700 1 Processor -- start 2023-09-30T22:28:57.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.535+0000 7f2356b07700 1 -- start start 2023-09-30T22:28:57.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.536+0000 7f2356b07700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f235006a6d0 0x7f235006aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.536+0000 7f2356b07700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f235006afe0 0x7f23501318b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.536+0000 7f2356b07700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f235009eb60 con 0x7f2350131df0 2023-09-30T22:28:57.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.536+0000 7f2356b07700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f235009db70 con 0x7f235006afe0 2023-09-30T22:28:57.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.536+0000 7f2356b07700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f235009ddf0 con 0x7f235006a6d0 2023-09-30T22:28:57.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.536+0000 7f23550a4700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2350131df0 0x7f2350138b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51302/0 (socket says 172.21.15.40:51302) 2023-09-30T22:28:57.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.537+0000 7f23550a4700 1 -- 172.21.15.40:0/1507439967 learned_addr learned my addr 172.21.15.40:0/1507439967 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:57.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.537+0000 7f23548a3700 1 --2- 172.21.15.40:0/1507439967 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f235006a6d0 0x7f235006aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.537+0000 7f234ffff700 1 --2- 172.21.15.40:0/1507439967 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f235006afe0 0x7f23501318b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.537+0000 7f234ffff700 1 -- 172.21.15.40:0/1507439967 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f235006a6d0 msgr2=0x7f235006aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:57.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.537+0000 7f234f7fe700 1 -- 172.21.15.40:0/1507439967 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1936124885 0 0) 0x7f235009eb60 con 0x7f2350131df0 2023-09-30T22:28:57.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.537+0000 7f234ffff700 1 --2- 172.21.15.40:0/1507439967 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f235006a6d0 0x7f235006aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.537+0000 7f234ffff700 1 -- 172.21.15.40:0/1507439967 >> v1:172.21.15.40:6789/0 conn(0x7f2350131df0 legacy=0x7f2350138b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.537+0000 7f234ffff700 1 -- 172.21.15.40:0/1507439967 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235009c9a0 con 0x7f235006afe0 2023-09-30T22:28:57.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.537+0000 7f234ffff700 1 --2- 172.21.15.40:0/1507439967 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f235006afe0 0x7f23501318b0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f233c009870 tx=0x7f233c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc02768b9b62b683 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:57.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.537+0000 7f234f7fe700 1 -- 172.21.15.40:0/1507439967 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c011830 con 0x7f235006afe0 2023-09-30T22:28:57.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.537+0000 7f234f7fe700 1 -- 172.21.15.40:0/1507439967 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c011990 con 0x7f235006afe0 2023-09-30T22:28:57.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.537+0000 7f234f7fe700 1 -- 172.21.15.40:0/1507439967 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c011d20 con 0x7f235006afe0 2023-09-30T22:28:57.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.538+0000 7f2356b07700 1 -- 172.21.15.40:0/1507439967 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f235006afe0 msgr2=0x7f23501318b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.538+0000 7f2356b07700 1 --2- 172.21.15.40:0/1507439967 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f235006afe0 0x7f23501318b0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f233c009870 tx=0x7f233c009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:57.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.538+0000 7f2356b07700 1 -- 172.21.15.40:0/1507439967 shutdown_connections 2023-09-30T22:28:57.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.538+0000 7f2356b07700 1 --2- 172.21.15.40:0/1507439967 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f235006a6d0 0x7f235006aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.538+0000 7f2356b07700 1 --2- 172.21.15.40:0/1507439967 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f235006afe0 0x7f23501318b0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.538+0000 7f2356b07700 1 -- 172.21.15.40:0/1507439967 >> 172.21.15.40:0/1507439967 conn(0x7f235009fb20 msgr2=0x7f235009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:57.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.538+0000 7f2356b07700 1 -- 172.21.15.40:0/1507439967 shutdown_connections 2023-09-30T22:28:57.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.539+0000 7f2356b07700 1 -- 172.21.15.40:0/1507439967 wait complete. 2023-09-30T22:28:57.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.540+0000 7f2356b07700 1 Processor -- start 2023-09-30T22:28:57.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.540+0000 7f2356b07700 1 -- start start 2023-09-30T22:28:57.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.541+0000 7f2356b07700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f235006a6d0 0x7f235011c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.541+0000 7f2356b07700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f235006afe0 0x7f235011cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.541+0000 7f2356b07700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2350131df0 0x7f235011d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.541+0000 7f2356b07700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235011ff30 con 0x7f235006afe0 2023-09-30T22:28:57.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.541+0000 7f2356b07700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2350120180 con 0x7f2350131df0 2023-09-30T22:28:57.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.541+0000 7f2356b07700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2350131830 con 0x7f235006a6d0 2023-09-30T22:28:57.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.541+0000 7f23548a3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f235006a6d0 0x7f235011c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.541+0000 7f23548a3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f235006a6d0 0x7f235011c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:57970/0 (socket says 172.21.15.40:57970) 2023-09-30T22:28:57.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.541+0000 7f23548a3700 1 -- 172.21.15.40:0/3051731724 learned_addr learned my addr 172.21.15.40:0/3051731724 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:57.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.541+0000 7f234ffff700 1 --2- 172.21.15.40:0/3051731724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f235006afe0 0x7f235011cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.541+0000 7f23550a4700 1 --2- 172.21.15.40:0/3051731724 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2350131df0 0x7f235011d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.541+0000 7f234ffff700 1 -- 172.21.15.40:0/3051731724 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f235006a6d0 msgr2=0x7f235011c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.541+0000 7f234ffff700 1 --2- 172.21.15.40:0/3051731724 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f235006a6d0 0x7f235011c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.541+0000 7f234ffff700 1 -- 172.21.15.40:0/3051731724 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2350131df0 msgr2=0x7f235011d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.541+0000 7f234ffff700 1 --2- 172.21.15.40:0/3051731724 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2350131df0 0x7f235011d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.541+0000 7f234ffff700 1 -- 172.21.15.40:0/3051731724 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c0094a0 con 0x7f235006afe0 2023-09-30T22:28:57.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.541+0000 7f23548a3700 1 --2- 172.21.15.40:0/3051731724 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f235006a6d0 0x7f235011c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:57.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.542+0000 7f23550a4700 1 --2- 172.21.15.40:0/3051731724 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2350131df0 0x7f235011d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:57.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.542+0000 7f234ffff700 1 --2- 172.21.15.40:0/3051731724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f235006afe0 0x7f235011cc30 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f233c016000 tx=0x7f233c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:57.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.542+0000 7f234d7fa700 1 -- 172.21.15.40:0/3051731724 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c004510 con 0x7f235006afe0 2023-09-30T22:28:57.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.542+0000 7f234d7fa700 1 -- 172.21.15.40:0/3051731724 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c01f070 con 0x7f235006afe0 2023-09-30T22:28:57.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.542+0000 7f2356b07700 1 -- 172.21.15.40:0/3051731724 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f235009e420 con 0x7f235006afe0 2023-09-30T22:28:57.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.542+0000 7f234d7fa700 1 -- 172.21.15.40:0/3051731724 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c0038e0 con 0x7f235006afe0 2023-09-30T22:28:57.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.542+0000 7f2356b07700 1 -- 172.21.15.40:0/3051731724 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23501315f0 con 0x7f235006afe0 2023-09-30T22:28:57.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.543+0000 7f2356b07700 1 -- 172.21.15.40:0/3051731724 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2350062380 con 0x7f235006afe0 2023-09-30T22:28:57.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.544+0000 7f234d7fa700 1 -- 172.21.15.40:0/3051731724 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f233c003a40 con 0x7f235006afe0 2023-09-30T22:28:57.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.544+0000 7f234d7fa700 1 -- 172.21.15.40:0/3051731724 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f233c021070 con 0x7f235006afe0 2023-09-30T22:28:57.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.552+0000 7f234d7fa700 1 -- 172.21.15.40:0/3051731724 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f233c0253e0 con 0x7f235006afe0 2023-09-30T22:28:57.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.631+0000 7f6768e35700 1 Processor -- start 2023-09-30T22:28:57.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.631+0000 7f6768e35700 1 -- start start 2023-09-30T22:28:57.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.632+0000 7f6768e35700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f676409d920 0x7f676409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.632+0000 7f6768e35700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f676409f0f0 0x7f676409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.632+0000 7f6768e35700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6764133ca0 0x7f6764134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.632+0000 7f6768e35700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f676406b4c0 con 0x7f676409f0f0 2023-09-30T22:28:57.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.632+0000 7f6768e35700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f676409a8f0 con 0x7f6764133ca0 2023-09-30T22:28:57.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.632+0000 7f6768e35700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f676409f940 con 0x7f676409d920 2023-09-30T22:28:57.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.632+0000 7f6761d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f676409f0f0 0x7f676409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.632+0000 7f6761d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f676409f0f0 0x7f676409e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50814/0 (socket says 172.21.15.40:50814) 2023-09-30T22:28:57.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.632+0000 7f6761d9b700 1 -- 172.21.15.40:0/3403425503 learned_addr learned my addr 172.21.15.40:0/3403425503 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:57.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.632+0000 7f6762d9d700 1 --2- 172.21.15.40:0/3403425503 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6764133ca0 0x7f6764134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.632+0000 7f676259c700 1 --2- 172.21.15.40:0/3403425503 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f676409d920 0x7f676409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.632+0000 7f6761d9b700 1 -- 172.21.15.40:0/3403425503 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f676409d920 msgr2=0x7f676409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.632+0000 7f6761d9b700 1 --2- 172.21.15.40:0/3403425503 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f676409d920 0x7f676409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.632+0000 7f6761d9b700 1 -- 172.21.15.40:0/3403425503 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6764133ca0 msgr2=0x7f6764134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.632+0000 7f6761d9b700 1 --2- 172.21.15.40:0/3403425503 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6764133ca0 0x7f6764134140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.632+0000 7f6761d9b700 1 -- 172.21.15.40:0/3403425503 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f676409f6e0 con 0x7f676409f0f0 2023-09-30T22:28:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.633+0000 7f6761d9b700 1 --2- 172.21.15.40:0/3403425503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f676409f0f0 0x7f676409e230 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f6758009920 tx=0x7f6758009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e941642f632f05a1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.633+0000 7f676159a700 1 -- 172.21.15.40:0/3403425503 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6758011830 con 0x7f676409f0f0 2023-09-30T22:28:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.633+0000 7f676159a700 1 -- 172.21.15.40:0/3403425503 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6758011990 con 0x7f676409f0f0 2023-09-30T22:28:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.633+0000 7f676159a700 1 -- 172.21.15.40:0/3403425503 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6758011d20 con 0x7f676409f0f0 2023-09-30T22:28:57.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.633+0000 7f6768e35700 1 -- 172.21.15.40:0/3403425503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f676409f0f0 msgr2=0x7f676409e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.633+0000 7f6768e35700 1 --2- 172.21.15.40:0/3403425503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f676409f0f0 0x7f676409e230 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f6758009920 tx=0x7f6758009c30 comp rx=0 tx=0).stop 2023-09-30T22:28:57.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.633+0000 7f6768e35700 1 -- 172.21.15.40:0/3403425503 shutdown_connections 2023-09-30T22:28:57.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.633+0000 7f6768e35700 1 --2- 172.21.15.40:0/3403425503 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f676409d920 0x7f676409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.633+0000 7f6768e35700 1 --2- 172.21.15.40:0/3403425503 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6764133ca0 0x7f6764134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.633+0000 7f6768e35700 1 --2- 172.21.15.40:0/3403425503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f676409f0f0 0x7f676409e230 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.634+0000 7f6768e35700 1 -- 172.21.15.40:0/3403425503 >> 172.21.15.40:0/3403425503 conn(0x7f676409fb20 msgr2=0x7f676409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:57.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.634+0000 7f6768e35700 1 -- 172.21.15.40:0/3403425503 shutdown_connections 2023-09-30T22:28:57.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.634+0000 7f6768e35700 1 -- 172.21.15.40:0/3403425503 wait complete. 2023-09-30T22:28:57.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.635+0000 7f6768e35700 1 Processor -- start 2023-09-30T22:28:57.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.635+0000 7f6768e35700 1 -- start start 2023-09-30T22:28:57.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.635+0000 7f6768e35700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f676409d920 0x7f6764122940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.635+0000 7f6768e35700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6764133ca0 0x7f6764122e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.635+0000 7f6768e35700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67641233c0 0x7f67641c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.635+0000 7f6768e35700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6764133540 con 0x7f676409d920 2023-09-30T22:28:57.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.635+0000 7f6768e35700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6764125b40 con 0x7f67641233c0 2023-09-30T22:28:57.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.635+0000 7f6768e35700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6764124550 con 0x7f6764133ca0 2023-09-30T22:28:57.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.635+0000 7f676259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f676409d920 0x7f6764122940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.635+0000 7f676259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f676409d920 0x7f6764122940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50828/0 (socket says 172.21.15.40:50828) 2023-09-30T22:28:57.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.635+0000 7f676259c700 1 -- 172.21.15.40:0/1826468223 learned_addr learned my addr 172.21.15.40:0/1826468223 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:57.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.635+0000 7f6761d9b700 1 --2- 172.21.15.40:0/1826468223 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6764133ca0 0x7f6764122e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.635+0000 7f6762d9d700 1 --2- 172.21.15.40:0/1826468223 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67641233c0 0x7f67641c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.636+0000 7f676259c700 1 -- 172.21.15.40:0/1826468223 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6764133ca0 msgr2=0x7f6764122e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.636+0000 7f676259c700 1 --2- 172.21.15.40:0/1826468223 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6764133ca0 0x7f6764122e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.636+0000 7f676259c700 1 -- 172.21.15.40:0/1826468223 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67641233c0 msgr2=0x7f67641c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.636+0000 7f676259c700 1 --2- 172.21.15.40:0/1826468223 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67641233c0 0x7f67641c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.636+0000 7f676259c700 1 -- 172.21.15.40:0/1826468223 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6758009550 con 0x7f676409d920 2023-09-30T22:28:57.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.636+0000 7f676259c700 1 --2- 172.21.15.40:0/1826468223 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f676409d920 0x7f6764122940 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f675400e870 tx=0x7f675400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:57.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.636+0000 7f6752ffd700 1 -- 172.21.15.40:0/1826468223 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6754005a20 con 0x7f676409d920 2023-09-30T22:28:57.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.636+0000 7f6752ffd700 1 -- 172.21.15.40:0/1826468223 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6754005b80 con 0x7f676409d920 2023-09-30T22:28:57.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.636+0000 7f6768e35700 1 -- 172.21.15.40:0/1826468223 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6764126460 con 0x7f676409d920 2023-09-30T22:28:57.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.636+0000 7f6752ffd700 1 -- 172.21.15.40:0/1826468223 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6754013680 con 0x7f676409d920 2023-09-30T22:28:57.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.636+0000 7f6768e35700 1 -- 172.21.15.40:0/1826468223 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f676409c9e0 con 0x7f676409d920 2023-09-30T22:28:57.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.637+0000 7f6752ffd700 1 -- 172.21.15.40:0/1826468223 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f67540137e0 con 0x7f676409d920 2023-09-30T22:28:57.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.637+0000 7f6752ffd700 1 -- 172.21.15.40:0/1826468223 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6754040d50 con 0x7f676409d920 2023-09-30T22:28:57.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.637+0000 7f6768e35700 1 -- 172.21.15.40:0/1826468223 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6764133920 con 0x7f676409d920 2023-09-30T22:28:57.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.642+0000 7f6752ffd700 1 -- 172.21.15.40:0/1826468223 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6754017070 con 0x7f676409d920 2023-09-30T22:28:57.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.697+0000 7fde24028700 1 -- 172.21.15.40:0/595425404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fde1c130930 con 0x7fde1c09c890 2023-09-30T22:28:57.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.698+0000 7fde127fc700 1 -- 172.21.15.40:0/595425404 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fde1800b3e0 con 0x7fde1c09c890 2023-09-30T22:28:57.699 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:57.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.700+0000 7fde24028700 1 -- 172.21.15.40:0/595425404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde1c09c890 msgr2=0x7fde1c12d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.700+0000 7fde24028700 1 --2- 172.21.15.40:0/595425404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde1c09c890 0x7fde1c12d340 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fde18013000 tx=0x7fde18004750 comp rx=0 tx=0).stop 2023-09-30T22:28:57.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.700+0000 7fde24028700 1 -- 172.21.15.40:0/595425404 shutdown_connections 2023-09-30T22:28:57.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.700+0000 7fde24028700 1 --2- 172.21.15.40:0/595425404 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde1c09e2b0 0x7fde1c12ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.700+0000 7fde24028700 1 --2- 172.21.15.40:0/595425404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde1c09c890 0x7fde1c12d340 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.700+0000 7fde24028700 1 --2- 172.21.15.40:0/595425404 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fde1c09d920 0x7fde1c12d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.700+0000 7fde24028700 1 -- 172.21.15.40:0/595425404 >> 172.21.15.40:0/595425404 conn(0x7fde1c0a7080 msgr2=0x7fde1c0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:57.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.700+0000 7fde24028700 1 -- 172.21.15.40:0/595425404 shutdown_connections 2023-09-30T22:28:57.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.700+0000 7fde24028700 1 -- 172.21.15.40:0/595425404 wait complete. 2023-09-30T22:28:57.713 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:57.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.739+0000 7f377ff73700 1 -- 172.21.15.40:0/3685973616 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3778128740 con 0x7f3778131020 2023-09-30T22:28:57.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.740+0000 7f376e7fc700 1 -- 172.21.15.40:0/3685973616 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3778128740 con 0x7f3778131020 2023-09-30T22:28:57.740 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:57.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.742+0000 7f377ff73700 1 -- 172.21.15.40:0/3685973616 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3778131020 msgr2=0x7f3778070840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.742+0000 7f377ff73700 1 --2- 172.21.15.40:0/3685973616 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3778131020 0x7f3778070840 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f377000cbc0 tx=0x7f377000ced0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.742+0000 7f377ff73700 1 -- 172.21.15.40:0/3685973616 shutdown_connections 2023-09-30T22:28:57.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.742+0000 7f377ff73700 1 --2- 172.21.15.40:0/3685973616 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3778095430 0x7f377806fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.742+0000 7f377ff73700 1 --2- 172.21.15.40:0/3685973616 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3778131020 0x7f3778070840 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.742+0000 7f377ff73700 1 --2- 172.21.15.40:0/3685973616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37781306b0 0x7f3778070300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.742+0000 7f377ff73700 1 -- 172.21.15.40:0/3685973616 >> 172.21.15.40:0/3685973616 conn(0x7f37780a2ff0 msgr2=0x7f377809b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:57.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.742+0000 7f377ff73700 1 -- 172.21.15.40:0/3685973616 shutdown_connections 2023-09-30T22:28:57.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.742+0000 7f377ff73700 1 -- 172.21.15.40:0/3685973616 wait complete. 2023-09-30T22:28:57.760 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:57.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.842+0000 7f6768e35700 1 -- 172.21.15.40:0/1826468223 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6764125e20 con 0x7f676409d920 2023-09-30T22:28:57.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.843+0000 7f6752ffd700 1 -- 172.21.15.40:0/1826468223 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6754017030 con 0x7f676409d920 2023-09-30T22:28:57.843 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:57.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.844+0000 7f6768e35700 1 -- 172.21.15.40:0/1826468223 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f676409d920 msgr2=0x7f6764122940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.844+0000 7f6768e35700 1 --2- 172.21.15.40:0/1826468223 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f676409d920 0x7f6764122940 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f675400e870 tx=0x7f675400eb80 comp rx=0 tx=0).stop 2023-09-30T22:28:57.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.844+0000 7f6768e35700 1 -- 172.21.15.40:0/1826468223 shutdown_connections 2023-09-30T22:28:57.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.844+0000 7f6768e35700 1 --2- 172.21.15.40:0/1826468223 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67641233c0 0x7f67641c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.844+0000 7f6768e35700 1 --2- 172.21.15.40:0/1826468223 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f676409d920 0x7f6764122940 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.844+0000 7f6768e35700 1 --2- 172.21.15.40:0/1826468223 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6764133ca0 0x7f6764122e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.844+0000 7f6768e35700 1 -- 172.21.15.40:0/1826468223 >> 172.21.15.40:0/1826468223 conn(0x7f676409fb20 msgr2=0x7f67640a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:57.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.845+0000 7f6768e35700 1 -- 172.21.15.40:0/1826468223 shutdown_connections 2023-09-30T22:28:57.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.845+0000 7f6768e35700 1 -- 172.21.15.40:0/1826468223 wait complete. 2023-09-30T22:28:57.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.848+0000 7f2356b07700 1 -- 172.21.15.40:0/3051731724 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f235011ea60 con 0x7f235006afe0 2023-09-30T22:28:57.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.849+0000 7f234d7fa700 1 -- 172.21.15.40:0/3051731724 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f233c015030 con 0x7f235006afe0 2023-09-30T22:28:57.849 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:57.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.851+0000 7f2356b07700 1 -- 172.21.15.40:0/3051731724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f235006afe0 msgr2=0x7f235011cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.851+0000 7f2356b07700 1 --2- 172.21.15.40:0/3051731724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f235006afe0 0x7f235011cc30 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f233c016000 tx=0x7f233c004750 comp rx=0 tx=0).stop 2023-09-30T22:28:57.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.851+0000 7f2356b07700 1 -- 172.21.15.40:0/3051731724 shutdown_connections 2023-09-30T22:28:57.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.851+0000 7f2356b07700 1 --2- 172.21.15.40:0/3051731724 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f235006a6d0 0x7f235011c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.851+0000 7f2356b07700 1 --2- 172.21.15.40:0/3051731724 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2350131df0 0x7f235011d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.851+0000 7f2356b07700 1 --2- 172.21.15.40:0/3051731724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f235006afe0 0x7f235011cc30 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.851+0000 7f2356b07700 1 -- 172.21.15.40:0/3051731724 >> 172.21.15.40:0/3051731724 conn(0x7f235009fb20 msgr2=0x7f235006f760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:57.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.851+0000 7f2356b07700 1 -- 172.21.15.40:0/3051731724 shutdown_connections 2023-09-30T22:28:57.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:57.851+0000 7f2356b07700 1 -- 172.21.15.40:0/3051731724 wait complete. 2023-09-30T22:28:57.858 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:57.864 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:28:58.715 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:58.762 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:58.858 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:58.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.862+0000 7f8898823700 1 Processor -- start 2023-09-30T22:28:58.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.862+0000 7f8898823700 1 -- start start 2023-09-30T22:28:58.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.862+0000 7f8898823700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8894131d50 0x7f8894132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:58.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.862+0000 7f8898823700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f889409c7d0 0x7f8894139ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:58.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.862+0000 7f8898823700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8894132660 con 0x7f889409bc50 2023-09-30T22:28:58.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.862+0000 7f8898823700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88940719e0 con 0x7f889409c7d0 2023-09-30T22:28:58.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.862+0000 7f8898823700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8894131900 con 0x7f8894131d50 2023-09-30T22:28:58.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.863+0000 7f889259c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8894131d50 0x7f8894132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:58.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.863+0000 7f8891d9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f889409bc50 0x7f889409c0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51310/0 (socket says 172.21.15.40:51310) 2023-09-30T22:28:58.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.863+0000 7f8891d9b700 1 -- 172.21.15.40:0/2256864000 learned_addr learned my addr 172.21.15.40:0/2256864000 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:58.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.863+0000 7f8892d9d700 1 --2- 172.21.15.40:0/2256864000 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f889409c7d0 0x7f8894139ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:58.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.863+0000 7f889259c700 1 -- 172.21.15.40:0/2256864000 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f889409c7d0 msgr2=0x7f8894139ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:58.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.863+0000 7f889259c700 1 --2- 172.21.15.40:0/2256864000 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f889409c7d0 0x7f8894139ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.863+0000 7f889259c700 1 -- 172.21.15.40:0/2256864000 >> v1:172.21.15.40:6789/0 conn(0x7f889409bc50 legacy=0x7f889409c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:58.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.863+0000 7f889259c700 1 -- 172.21.15.40:0/2256864000 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889409e820 con 0x7f8894131d50 2023-09-30T22:28:58.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.863+0000 7f889159a700 1 -- 172.21.15.40:0/2256864000 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 568183203 0 0) 0x7f8894132660 con 0x7f889409bc50 2023-09-30T22:28:58.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.863+0000 7f889259c700 1 --2- 172.21.15.40:0/2256864000 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8894131d50 0x7f8894132120 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f88840098a0 tx=0x7f8884009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=274ba99c13aa86b3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:58.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.863+0000 7f889159a700 1 -- 172.21.15.40:0/2256864000 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8884011830 con 0x7f8894131d50 2023-09-30T22:28:58.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.863+0000 7f889159a700 1 -- 172.21.15.40:0/2256864000 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8884011990 con 0x7f8894131d50 2023-09-30T22:28:58.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.863+0000 7f889159a700 1 -- 172.21.15.40:0/2256864000 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8884011d20 con 0x7f8894131d50 2023-09-30T22:28:58.865 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:58.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.864+0000 7f8898823700 1 -- 172.21.15.40:0/2256864000 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8894131d50 msgr2=0x7f8894132120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:58.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.864+0000 7f8898823700 1 --2- 172.21.15.40:0/2256864000 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8894131d50 0x7f8894132120 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f88840098a0 tx=0x7f8884009bb0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.864+0000 7f8898823700 1 -- 172.21.15.40:0/2256864000 shutdown_connections 2023-09-30T22:28:58.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.864+0000 7f8898823700 1 --2- 172.21.15.40:0/2256864000 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f889409c7d0 0x7f8894139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.864+0000 7f8898823700 1 --2- 172.21.15.40:0/2256864000 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8894131d50 0x7f8894132120 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.864+0000 7f8898823700 1 -- 172.21.15.40:0/2256864000 >> 172.21.15.40:0/2256864000 conn(0x7f88940a2a00 msgr2=0x7f88940a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:58.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.864+0000 7f8898823700 1 -- 172.21.15.40:0/2256864000 shutdown_connections 2023-09-30T22:28:58.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.864+0000 7f8898823700 1 -- 172.21.15.40:0/2256864000 wait complete. 2023-09-30T22:28:58.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.865+0000 7f8898823700 1 Processor -- start 2023-09-30T22:28:58.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.865+0000 7f8898823700 1 -- start start 2023-09-30T22:28:58.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.866+0000 7f8898823700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f889409bc50 0x7f88941c4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:58.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.866+0000 7f8898823700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f889409c7d0 0x7f88941c48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:58.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.866+0000 7f8898823700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8894131d50 0x7f8894119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:58.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.866+0000 7f8898823700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88941c3fa0 con 0x7f889409c7d0 2023-09-30T22:28:58.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.866+0000 7f8898823700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f889409ea60 con 0x7f889409bc50 2023-09-30T22:28:58.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.866+0000 7f8898823700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f889411bc40 con 0x7f8894131d50 2023-09-30T22:28:58.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.866+0000 7f889259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f889409bc50 0x7f88941c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:58.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.866+0000 7f889259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f889409bc50 0x7f88941c4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38828/0 (socket says 172.21.15.40:38828) 2023-09-30T22:28:58.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.866+0000 7f889259c700 1 -- 172.21.15.40:0/2774327602 learned_addr learned my addr 172.21.15.40:0/2774327602 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:58.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.866+0000 7f8892d9d700 1 --2- 172.21.15.40:0/2774327602 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8894131d50 0x7f8894119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:58.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.866+0000 7f8891d9b700 1 --2- 172.21.15.40:0/2774327602 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f889409c7d0 0x7f88941c48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:58.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.866+0000 7f889259c700 1 -- 172.21.15.40:0/2774327602 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8894131d50 msgr2=0x7f8894119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:58.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.867+0000 7f889259c700 1 --2- 172.21.15.40:0/2774327602 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8894131d50 0x7f8894119050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.867+0000 7f889259c700 1 -- 172.21.15.40:0/2774327602 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f889409c7d0 msgr2=0x7f88941c48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:58.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.867+0000 7f889259c700 1 --2- 172.21.15.40:0/2774327602 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f889409c7d0 0x7f88941c48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.867+0000 7f889259c700 1 -- 172.21.15.40:0/2774327602 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88840094a0 con 0x7f889409bc50 2023-09-30T22:28:58.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.867+0000 7f8891d9b700 1 --2- 172.21.15.40:0/2774327602 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f889409c7d0 0x7f88941c48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:58.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.867+0000 7f8892d9d700 1 --2- 172.21.15.40:0/2774327602 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8894131d50 0x7f8894119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:58.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.867+0000 7f889259c700 1 --2- 172.21.15.40:0/2774327602 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f889409bc50 0x7f88941c4360 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f88840090b0 tx=0x7f8884004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:58.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.867+0000 7f8882ffd700 1 -- 172.21.15.40:0/2774327602 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8884004450 con 0x7f889409bc50 2023-09-30T22:28:58.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.867+0000 7f8882ffd700 1 -- 172.21.15.40:0/2774327602 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88840045b0 con 0x7f889409bc50 2023-09-30T22:28:58.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.867+0000 7f8898823700 1 -- 172.21.15.40:0/2774327602 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f889411bf00 con 0x7f889409bc50 2023-09-30T22:28:58.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.867+0000 7f8882ffd700 1 -- 172.21.15.40:0/2774327602 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88840038c0 con 0x7f889409bc50 2023-09-30T22:28:58.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.867+0000 7f8898823700 1 -- 172.21.15.40:0/2774327602 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f889411a2f0 con 0x7f889409bc50 2023-09-30T22:28:58.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.868+0000 7f8882ffd700 1 -- 172.21.15.40:0/2774327602 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8884003a20 con 0x7f889409bc50 2023-09-30T22:28:58.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.868+0000 7f8882ffd700 1 -- 172.21.15.40:0/2774327602 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f88840406e0 con 0x7f889409bc50 2023-09-30T22:28:58.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.869+0000 7f8898823700 1 -- 172.21.15.40:0/2774327602 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88780052e0 con 0x7f889409bc50 2023-09-30T22:28:58.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.875+0000 7f8882ffd700 1 -- 172.21.15.40:0/2774327602 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f888401a420 con 0x7f889409bc50 2023-09-30T22:28:58.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.908+0000 7fb47123a700 1 Processor -- start 2023-09-30T22:28:58.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.908+0000 7fb47123a700 1 -- start start 2023-09-30T22:28:58.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.909+0000 7fb47123a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb46c09d920 0x7fb46c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:58.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.909+0000 7fb47123a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb46c09e230 0x7fb46c1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:58.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.909+0000 7fb47123a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb46c09f940 con 0x7fb46c09f0f0 2023-09-30T22:28:58.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.909+0000 7fb47123a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c06b4c0 con 0x7fb46c09d920 2023-09-30T22:28:58.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.909+0000 7fb47123a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c09a8f0 con 0x7fb46c09e230 2023-09-30T22:28:58.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.909+0000 7fb46a59c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb46c09f0f0 0x7fb46c133ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51322/0 (socket says 172.21.15.40:51322) 2023-09-30T22:28:58.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.909+0000 7fb46a59c700 1 -- 172.21.15.40:0/358465139 learned_addr learned my addr 172.21.15.40:0/358465139 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:28:58.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.909+0000 7fb46ad9d700 1 --2- 172.21.15.40:0/358465139 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb46c09d920 0x7fb46c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:58.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.909+0000 7fb46b59e700 1 --2- 172.21.15.40:0/358465139 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb46c09e230 0x7fb46c1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:58.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.909+0000 7fb469d9b700 1 -- 172.21.15.40:0/358465139 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1083881181 0 0) 0x7fb46c09f940 con 0x7fb46c09f0f0 2023-09-30T22:28:58.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.909+0000 7fb469d9b700 1 -- 172.21.15.40:0/358465139 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4540035b0 con 0x7fb46c09f0f0 2023-09-30T22:28:58.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.910+0000 7fb46ad9d700 1 -- 172.21.15.40:0/358465139 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb46c09e230 msgr2=0x7fb46c1343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:58.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.910+0000 7fb46ad9d700 1 --2- 172.21.15.40:0/358465139 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb46c09e230 0x7fb46c1343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.910+0000 7fb46ad9d700 1 -- 172.21.15.40:0/358465139 >> v1:172.21.15.40:6789/0 conn(0x7fb46c09f0f0 legacy=0x7fb46c133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:58.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.910+0000 7fb46ad9d700 1 -- 172.21.15.40:0/358465139 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46c09f6e0 con 0x7fb46c09d920 2023-09-30T22:28:58.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.910+0000 7fb46ad9d700 1 --2- 172.21.15.40:0/358465139 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb46c09d920 0x7fb46c09dcf0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fb45c009850 tx=0x7fb45c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1e5ed7514fc467d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:58.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.910+0000 7fb469d9b700 1 -- 172.21.15.40:0/358465139 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45c005e30 con 0x7fb46c09d920 2023-09-30T22:28:58.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.910+0000 7fb469d9b700 1 -- 172.21.15.40:0/358465139 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45c006030 con 0x7fb46c09d920 2023-09-30T22:28:58.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.910+0000 7fb469d9b700 1 -- 172.21.15.40:0/358465139 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45c0063e0 con 0x7fb46c09d920 2023-09-30T22:28:58.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.911+0000 7fb47123a700 1 -- 172.21.15.40:0/358465139 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb46c09d920 msgr2=0x7fb46c09dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:58.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.911+0000 7fb47123a700 1 --2- 172.21.15.40:0/358465139 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb46c09d920 0x7fb46c09dcf0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fb45c009850 tx=0x7fb45c009b60 comp rx=0 tx=0).stop 2023-09-30T22:28:58.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.911+0000 7fb47123a700 1 -- 172.21.15.40:0/358465139 shutdown_connections 2023-09-30T22:28:58.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.911+0000 7fb47123a700 1 --2- 172.21.15.40:0/358465139 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb46c09e230 0x7fb46c1343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.911+0000 7fb47123a700 1 --2- 172.21.15.40:0/358465139 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb46c09d920 0x7fb46c09dcf0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.911+0000 7fb47123a700 1 -- 172.21.15.40:0/358465139 >> 172.21.15.40:0/358465139 conn(0x7fb46c09fb20 msgr2=0x7fb46c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:58.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.911+0000 7fb47123a700 1 -- 172.21.15.40:0/358465139 shutdown_connections 2023-09-30T22:28:58.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.911+0000 7fb47123a700 1 -- 172.21.15.40:0/358465139 wait complete. 2023-09-30T22:28:58.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.913+0000 7fb47123a700 1 Processor -- start 2023-09-30T22:28:58.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.913+0000 7fb47123a700 1 -- start start 2023-09-30T22:28:58.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.913+0000 7fb47123a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb46c09d920 0x7fb46c122720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:58.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.913+0000 7fb47123a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb46c09e230 0x7fb46c122c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:58.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.913+0000 7fb47123a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb46c1231a0 0x7fb46c1ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:58.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.913+0000 7fb47123a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c133af0 con 0x7fb46c09e230 2023-09-30T22:28:58.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.913+0000 7fb47123a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c123b80 con 0x7fb46c09d920 2023-09-30T22:28:58.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.913+0000 7fb47123a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c1251c0 con 0x7fb46c1231a0 2023-09-30T22:28:58.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.914+0000 7fb46b59e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb46c1231a0 0x7fb46c1ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:58.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.914+0000 7fb46b59e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb46c1231a0 0x7fb46c1ce9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58028/0 (socket says 172.21.15.40:58028) 2023-09-30T22:28:58.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.914+0000 7fb46b59e700 1 -- 172.21.15.40:0/2826411554 learned_addr learned my addr 172.21.15.40:0/2826411554 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:58.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.914+0000 7fb46ad9d700 1 --2- 172.21.15.40:0/2826411554 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb46c09d920 0x7fb46c122720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:58.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.914+0000 7fb46a59c700 1 --2- 172.21.15.40:0/2826411554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb46c09e230 0x7fb46c122c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:58.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.914+0000 7fb46b59e700 1 -- 172.21.15.40:0/2826411554 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb46c09d920 msgr2=0x7fb46c122720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:58.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.914+0000 7fb46b59e700 1 --2- 172.21.15.40:0/2826411554 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb46c09d920 0x7fb46c122720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.914+0000 7fb46b59e700 1 -- 172.21.15.40:0/2826411554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb46c09e230 msgr2=0x7fb46c122c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:58.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.914+0000 7fb46b59e700 1 --2- 172.21.15.40:0/2826411554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb46c09e230 0x7fb46c122c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.914+0000 7fb46b59e700 1 -- 172.21.15.40:0/2826411554 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45c009430 con 0x7fb46c1231a0 2023-09-30T22:28:58.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.914+0000 7fb46b59e700 1 --2- 172.21.15.40:0/2826411554 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb46c1231a0 0x7fb46c1ce9c0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb464009dd0 tx=0x7fb46400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:58.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.915+0000 7fb4537fe700 1 -- 172.21.15.40:0/2826411554 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb464009c40 con 0x7fb46c1231a0 2023-09-30T22:28:58.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.915+0000 7fb4537fe700 1 -- 172.21.15.40:0/2826411554 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46400f040 con 0x7fb46c1231a0 2023-09-30T22:28:58.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.915+0000 7fb4537fe700 1 -- 172.21.15.40:0/2826411554 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46400c880 con 0x7fb46c1231a0 2023-09-30T22:28:58.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.915+0000 7fb47123a700 1 -- 172.21.15.40:0/2826411554 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb46c125ca0 con 0x7fb46c1231a0 2023-09-30T22:28:58.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.915+0000 7fb47123a700 1 -- 172.21.15.40:0/2826411554 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb46c0a2eb0 con 0x7fb46c1231a0 2023-09-30T22:28:58.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.916+0000 7fb47123a700 1 -- 172.21.15.40:0/2826411554 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb46c09ca40 con 0x7fb46c1231a0 2023-09-30T22:28:58.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.916+0000 7fb4537fe700 1 -- 172.21.15.40:0/2826411554 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb46400ca00 con 0x7fb46c1231a0 2023-09-30T22:28:58.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.916+0000 7fb4537fe700 1 -- 172.21.15.40:0/2826411554 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb4640480e0 con 0x7fb46c1231a0 2023-09-30T22:28:58.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.925+0000 7fb4537fe700 1 -- 172.21.15.40:0/2826411554 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb46401c2c0 con 0x7fb46c1231a0 2023-09-30T22:28:58.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.998+0000 7fc38a614700 1 Processor -- start 2023-09-30T22:28:58.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.998+0000 7fc38a614700 1 -- start start 2023-09-30T22:28:58.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.999+0000 7fc38a614700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc38406fb50 0x7fc384136c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.999+0000 7fc38a614700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3841371b0 0x7fc384139590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.999+0000 7fe8411ef700 1 Processor -- start 2023-09-30T22:28:59.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.999+0000 7fe8411ef700 1 -- start start 2023-09-30T22:28:59.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.999+0000 7fc38a614700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc384070830 con 0x7fc38406f070 2023-09-30T22:28:59.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.999+0000 7fc38a614700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc384070ad0 con 0x7fc38406fb50 2023-09-30T22:28:59.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.999+0000 7fc38a614700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc384070de0 con 0x7fc3841371b0 2023-09-30T22:28:59.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.999+0000 7fc3837fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc38406fb50 0x7fc384136c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:59.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.999+0000 7fc3837fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc38406fb50 0x7fc384136c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38854/0 (socket says 172.21.15.40:38854) 2023-09-30T22:28:59.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.999+0000 7fc3837fe700 1 -- 172.21.15.40:0/1657706797 learned_addr learned my addr 172.21.15.40:0/1657706797 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:59.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:58.999+0000 7fc388bb1700 1 --2- 172.21.15.40:0/1657706797 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3841371b0 0x7fc384139590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:59.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.000+0000 7fe8411ef700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe83c09d920 0x7fe83c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.000+0000 7fe8411ef700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe83c09e230 0x7fe83c133ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.000+0000 7fe8411ef700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe83c1341e0 0x7fe83c134630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.000+0000 7fe8411ef700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe83c134b70 con 0x7fe83c09e230 2023-09-30T22:28:59.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.000+0000 7fe8411ef700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c09f0f0 con 0x7fe83c09d920 2023-09-30T22:28:59.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.000+0000 7fe8411ef700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c09a960 con 0x7fe83c1341e0 2023-09-30T22:28:59.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.000+0000 7fe83b59e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe83c1341e0 0x7fe83c134630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:59.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.000+0000 7fe83b59e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe83c1341e0 0x7fe83c134630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58046/0 (socket says 172.21.15.40:58046) 2023-09-30T22:28:59.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.000+0000 7fe83b59e700 1 -- 172.21.15.40:0/2922007860 learned_addr learned my addr 172.21.15.40:0/2922007860 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:59.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.000+0000 7fe83ad9d700 1 --2- 172.21.15.40:0/2922007860 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe83c09d920 0x7fe83c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:59.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.000+0000 7fe83b59e700 1 -- 172.21.15.40:0/2922007860 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe83c09d920 msgr2=0x7fe83c09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:59.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.000+0000 7fe83b59e700 1 --2- 172.21.15.40:0/2922007860 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe83c09d920 0x7fe83c09dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.000+0000 7fe83b59e700 1 -- 172.21.15.40:0/2922007860 >> v2:172.21.15.40:3300/0 conn(0x7fe83c09e230 msgr2=0x7fe83c133ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:28:59.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.000+0000 7fe83b59e700 1 --2- 172.21.15.40:0/2922007860 >> v2:172.21.15.40:3300/0 conn(0x7fe83c09e230 0x7fe83c133ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.000+0000 7fe83b59e700 1 -- 172.21.15.40:0/2922007860 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83c09abd0 con 0x7fe83c1341e0 2023-09-30T22:28:59.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.000+0000 7fc3837fe700 1 -- 172.21.15.40:0/1657706797 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3841371b0 msgr2=0x7fc384139590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:59.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.000+0000 7fc3837fe700 1 --2- 172.21.15.40:0/1657706797 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3841371b0 0x7fc384139590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.000+0000 7fc3837fe700 1 -- 172.21.15.40:0/1657706797 >> v1:172.21.15.40:6789/0 conn(0x7fc38406f070 legacy=0x7fc38406f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:59.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.000+0000 7fc3837fe700 1 -- 172.21.15.40:0/1657706797 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc38409fe20 con 0x7fc38406fb50 2023-09-30T22:28:59.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.000+0000 7fc3837fe700 1 --2- 172.21.15.40:0/1657706797 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc38406fb50 0x7fc384136c70 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc378009920 tx=0x7fc378009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c0a2ce3cfec1182 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:59.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.000+0000 7fc382ffd700 1 -- 172.21.15.40:0/1657706797 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37800ba60 con 0x7fc38406fb50 2023-09-30T22:28:59.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.000+0000 7fc382ffd700 1 -- 172.21.15.40:0/1657706797 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37800bbc0 con 0x7fc38406fb50 2023-09-30T22:28:59.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.000+0000 7fc382ffd700 1 -- 172.21.15.40:0/1657706797 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc378009e70 con 0x7fc38406fb50 2023-09-30T22:28:59.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.001+0000 7fe83b59e700 1 --2- 172.21.15.40:0/2922007860 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe83c1341e0 0x7fe83c134630 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe834009e50 tx=0x7fe83400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebb2973605041b83 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:59.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.001+0000 7fe839d9b700 1 -- 172.21.15.40:0/2922007860 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83400e070 con 0x7fe83c1341e0 2023-09-30T22:28:59.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.001+0000 7fe839d9b700 1 -- 172.21.15.40:0/2922007860 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83400b910 con 0x7fe83c1341e0 2023-09-30T22:28:59.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.001+0000 7fe839d9b700 1 -- 172.21.15.40:0/2922007860 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83400bcc0 con 0x7fe83c1341e0 2023-09-30T22:28:59.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.001+0000 7fc38a614700 1 -- 172.21.15.40:0/1657706797 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc38406fb50 msgr2=0x7fc384136c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.001+0000 7fc38a614700 1 --2- 172.21.15.40:0/1657706797 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc38406fb50 0x7fc384136c70 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc378009920 tx=0x7fc378009c30 comp rx=0 tx=0).stop 2023-09-30T22:28:59.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.001+0000 7fc38a614700 1 -- 172.21.15.40:0/1657706797 shutdown_connections 2023-09-30T22:28:59.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.001+0000 7fc38a614700 1 --2- 172.21.15.40:0/1657706797 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3841371b0 0x7fc384139590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.001+0000 7fc38a614700 1 --2- 172.21.15.40:0/1657706797 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc38406fb50 0x7fc384136c70 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.001+0000 7fc38a614700 1 -- 172.21.15.40:0/1657706797 >> 172.21.15.40:0/1657706797 conn(0x7fc3840a41a0 msgr2=0x7fc3840a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:59.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.001+0000 7fc38a614700 1 -- 172.21.15.40:0/1657706797 shutdown_connections 2023-09-30T22:28:59.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.001+0000 7fc38a614700 1 -- 172.21.15.40:0/1657706797 wait complete. 2023-09-30T22:28:59.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.002+0000 7fe8411ef700 1 -- 172.21.15.40:0/2922007860 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe83c1341e0 msgr2=0x7fe83c134630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.002+0000 7fe8411ef700 1 --2- 172.21.15.40:0/2922007860 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe83c1341e0 0x7fe83c134630 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe834009e50 tx=0x7fe83400b330 comp rx=0 tx=0).stop 2023-09-30T22:28:59.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.002+0000 7fe8411ef700 1 -- 172.21.15.40:0/2922007860 shutdown_connections 2023-09-30T22:28:59.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.002+0000 7fe8411ef700 1 --2- 172.21.15.40:0/2922007860 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe83c1341e0 0x7fe83c134630 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.002+0000 7fe8411ef700 1 --2- 172.21.15.40:0/2922007860 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe83c09d920 0x7fe83c09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.002+0000 7fe8411ef700 1 --2- 172.21.15.40:0/2922007860 >> v2:172.21.15.40:3300/0 conn(0x7fe83c09e230 0x7fe83c133ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.002+0000 7fe8411ef700 1 -- 172.21.15.40:0/2922007860 >> 172.21.15.40:0/2922007860 conn(0x7fe83c09fb20 msgr2=0x7fe83c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:59.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.003+0000 7fc38a614700 1 Processor -- start 2023-09-30T22:28:59.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.003+0000 7fe8411ef700 1 -- 172.21.15.40:0/2922007860 shutdown_connections 2023-09-30T22:28:59.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.003+0000 7fc38a614700 1 -- start start 2023-09-30T22:28:59.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.003+0000 7fe8411ef700 1 -- 172.21.15.40:0/2922007860 wait complete. 2023-09-30T22:28:59.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.003+0000 7fc38a614700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc38406f070 0x7fc384134b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.003+0000 7fc38a614700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc38406fb50 0x7fc3841350d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.003+0000 7fc38a614700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3841371b0 0x7fc384135610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.003+0000 7fc38a614700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38412e080 con 0x7fc38406f070 2023-09-30T22:28:59.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.003+0000 7fc38a614700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc384136cf0 con 0x7fc3841371b0 2023-09-30T22:28:59.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.003+0000 7fc38a614700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc38412c570 con 0x7fc38406fb50 2023-09-30T22:28:59.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.004+0000 7fc388bb1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3841371b0 0x7fc384135610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:59.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.004+0000 7fc3837fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc38406fb50 0x7fc3841350d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:59.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.004+0000 7fc388bb1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3841371b0 0x7fc384135610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38868/0 (socket says 172.21.15.40:38868) 2023-09-30T22:28:59.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.004+0000 7fc388bb1700 1 -- 172.21.15.40:0/2020504878 learned_addr learned my addr 172.21.15.40:0/2020504878 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:59.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.004+0000 7fc383fff700 1 --2- 172.21.15.40:0/2020504878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc38406f070 0x7fc384134b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:59.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.004+0000 7fc3837fe700 1 -- 172.21.15.40:0/2020504878 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3841371b0 msgr2=0x7fc384135610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.004+0000 7fc3837fe700 1 --2- 172.21.15.40:0/2020504878 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3841371b0 0x7fc384135610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.004+0000 7fc3837fe700 1 -- 172.21.15.40:0/2020504878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc38406f070 msgr2=0x7fc384134b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.004+0000 7fc3837fe700 1 --2- 172.21.15.40:0/2020504878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc38406f070 0x7fc384134b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.004+0000 7fc3837fe700 1 -- 172.21.15.40:0/2020504878 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc378009550 con 0x7fc38406fb50 2023-09-30T22:28:59.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.004+0000 7fc388bb1700 1 --2- 172.21.15.40:0/2020504878 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3841371b0 0x7fc384135610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:59.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.004+0000 7fc3837fe700 1 --2- 172.21.15.40:0/2020504878 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc38406fb50 0x7fc3841350d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc37801a000 tx=0x7fc378004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:59.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.005+0000 7fe8411ef700 1 Processor -- start 2023-09-30T22:28:59.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.005+0000 7fe8411ef700 1 -- start start 2023-09-30T22:28:59.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.005+0000 7fe8411ef700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe83c09d920 0x7fe83c1c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.005+0000 7fe8411ef700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe83c09e230 0x7fe83c1c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.005+0000 7fe8411ef700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe83c1341e0 0x7fe83c1c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.005+0000 7fe8411ef700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c122a20 con 0x7fe83c09d920 2023-09-30T22:28:59.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.005+0000 7fe8411ef700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c120cb0 con 0x7fe83c1341e0 2023-09-30T22:28:59.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.005+0000 7fe8411ef700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c120a80 con 0x7fe83c09e230 2023-09-30T22:28:59.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.006+0000 7fe83ad9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe83c09d920 0x7fe83c1c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:59.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.006+0000 7fe83ad9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe83c09d920 0x7fe83c1c8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50850/0 (socket says 172.21.15.40:50850) 2023-09-30T22:28:59.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.006+0000 7fe83ad9d700 1 -- 172.21.15.40:0/2577111381 learned_addr learned my addr 172.21.15.40:0/2577111381 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:28:59.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.006+0000 7fe83b59e700 1 --2- 172.21.15.40:0/2577111381 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe83c1341e0 0x7fe83c1c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:59.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.006+0000 7fe83ad9d700 1 -- 172.21.15.40:0/2577111381 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe83c09e230 msgr2=0x7fe83c1c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.006+0000 7fe83ad9d700 1 --2- 172.21.15.40:0/2577111381 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe83c09e230 0x7fe83c1c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.006+0000 7fe83ad9d700 1 -- 172.21.15.40:0/2577111381 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe83c1341e0 msgr2=0x7fe83c1c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.006+0000 7fe83ad9d700 1 --2- 172.21.15.40:0/2577111381 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe83c1341e0 0x7fe83c1c8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.006+0000 7fe83ad9d700 1 -- 172.21.15.40:0/2577111381 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe834009b30 con 0x7fe83c09d920 2023-09-30T22:28:59.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.006+0000 7fe83ad9d700 1 --2- 172.21.15.40:0/2577111381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe83c09d920 0x7fe83c1c8400 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fe82c00e9c0 tx=0x7fe82c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:59.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.006+0000 7fe8237fe700 1 -- 172.21.15.40:0/2577111381 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c0096f0 con 0x7fe83c09d920 2023-09-30T22:28:59.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.006+0000 7fe8237fe700 1 -- 172.21.15.40:0/2577111381 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82c00c850 con 0x7fe83c09d920 2023-09-30T22:28:59.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.006+0000 7fe8237fe700 1 -- 172.21.15.40:0/2577111381 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c00cbc0 con 0x7fe83c09d920 2023-09-30T22:28:59.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.005+0000 7fc380ff9700 1 -- 172.21.15.40:0/2020504878 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc378023070 con 0x7fc38406fb50 2023-09-30T22:28:59.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.005+0000 7fc380ff9700 1 -- 172.21.15.40:0/2020504878 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc378004310 con 0x7fc38406fb50 2023-09-30T22:28:59.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.005+0000 7fc380ff9700 1 -- 172.21.15.40:0/2020504878 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3780036a0 con 0x7fc38406fb50 2023-09-30T22:28:59.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.005+0000 7fc38a614700 1 -- 172.21.15.40:0/2020504878 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc38412c330 con 0x7fc38406fb50 2023-09-30T22:28:59.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.005+0000 7fc38a614700 1 -- 172.21.15.40:0/2020504878 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc38412c980 con 0x7fc38406fb50 2023-09-30T22:28:59.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.007+0000 7fc38a614700 1 -- 172.21.15.40:0/2020504878 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc384062380 con 0x7fc38406fb50 2023-09-30T22:28:59.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.007+0000 7fc380ff9700 1 -- 172.21.15.40:0/2020504878 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc378003800 con 0x7fc38406fb50 2023-09-30T22:28:59.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.007+0000 7fe8411ef700 1 -- 172.21.15.40:0/2577111381 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe83c1223f0 con 0x7fe83c09d920 2023-09-30T22:28:59.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.007+0000 7fe8411ef700 1 -- 172.21.15.40:0/2577111381 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe83c133bd0 con 0x7fe83c09d920 2023-09-30T22:28:59.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.008+0000 7fe8237fe700 1 -- 172.21.15.40:0/2577111381 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe82c00cd20 con 0x7fe83c09d920 2023-09-30T22:28:59.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.007+0000 7fc380ff9700 1 -- 172.21.15.40:0/2020504878 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc37803f970 con 0x7fc38406fb50 2023-09-30T22:28:59.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.009+0000 7fe8237fe700 1 -- 172.21.15.40:0/2577111381 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe82c03fbb0 con 0x7fe83c09d920 2023-09-30T22:28:59.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.009+0000 7fe8411ef700 1 -- 172.21.15.40:0/2577111381 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe83c062380 con 0x7fe83c09d920 2023-09-30T22:28:59.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.013+0000 7fc380ff9700 1 -- 172.21.15.40:0/2020504878 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc37801e770 con 0x7fc38406fb50 2023-09-30T22:28:59.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.018+0000 7fe8237fe700 1 -- 172.21.15.40:0/2577111381 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe82c021020 con 0x7fe83c09d920 2023-09-30T22:28:59.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.090+0000 7f8898823700 1 -- 172.21.15.40:0/2774327602 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8878005590 con 0x7f889409bc50 2023-09-30T22:28:59.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.091+0000 7f8882ffd700 1 -- 172.21.15.40:0/2774327602 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8884028030 con 0x7f889409bc50 2023-09-30T22:28:59.091 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:28:59.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.094+0000 7f8898823700 1 -- 172.21.15.40:0/2774327602 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f889409bc50 msgr2=0x7f88941c4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.094+0000 7f8898823700 1 --2- 172.21.15.40:0/2774327602 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f889409bc50 0x7f88941c4360 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f88840090b0 tx=0x7f8884004750 comp rx=0 tx=0).stop 2023-09-30T22:28:59.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.094+0000 7f8898823700 1 -- 172.21.15.40:0/2774327602 shutdown_connections 2023-09-30T22:28:59.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.094+0000 7f8898823700 1 --2- 172.21.15.40:0/2774327602 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8894131d50 0x7f8894119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.094+0000 7f8898823700 1 --2- 172.21.15.40:0/2774327602 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f889409bc50 0x7f88941c4360 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.094+0000 7f8898823700 1 --2- 172.21.15.40:0/2774327602 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f889409c7d0 0x7f88941c48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.094+0000 7f8898823700 1 -- 172.21.15.40:0/2774327602 >> 172.21.15.40:0/2774327602 conn(0x7f88940a2a00 msgr2=0x7f889412d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:59.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.094+0000 7f8898823700 1 -- 172.21.15.40:0/2774327602 shutdown_connections 2023-09-30T22:28:59.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.094+0000 7f8898823700 1 -- 172.21.15.40:0/2774327602 wait complete. 2023-09-30T22:28:59.112 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:28:59.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.134+0000 7fb47123a700 1 -- 172.21.15.40:0/2826411554 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb46c062380 con 0x7fb46c1231a0 2023-09-30T22:28:59.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.135+0000 7fb4537fe700 1 -- 172.21.15.40:0/2826411554 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb464026ac0 con 0x7fb46c1231a0 2023-09-30T22:28:59.135 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:59.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.137+0000 7fb47123a700 1 -- 172.21.15.40:0/2826411554 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb46c1231a0 msgr2=0x7fb46c1ce9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.137+0000 7fb47123a700 1 --2- 172.21.15.40:0/2826411554 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb46c1231a0 0x7fb46c1ce9c0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb464009dd0 tx=0x7fb46400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.137+0000 7fb47123a700 1 -- 172.21.15.40:0/2826411554 shutdown_connections 2023-09-30T22:28:59.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.137+0000 7fb47123a700 1 --2- 172.21.15.40:0/2826411554 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb46c1231a0 0x7fb46c1ce9c0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.137+0000 7fb47123a700 1 --2- 172.21.15.40:0/2826411554 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb46c09d920 0x7fb46c122720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.137+0000 7fb47123a700 1 --2- 172.21.15.40:0/2826411554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb46c09e230 0x7fb46c122c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.137+0000 7fb47123a700 1 -- 172.21.15.40:0/2826411554 >> 172.21.15.40:0/2826411554 conn(0x7fb46c09fb20 msgr2=0x7fb46c0706b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:59.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.137+0000 7fb47123a700 1 -- 172.21.15.40:0/2826411554 shutdown_connections 2023-09-30T22:28:59.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.137+0000 7fb47123a700 1 -- 172.21.15.40:0/2826411554 wait complete. 2023-09-30T22:28:59.149 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:28:59.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.211+0000 7fc38a614700 1 -- 172.21.15.40:0/2020504878 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc38412c310 con 0x7fc38406fb50 2023-09-30T22:28:59.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.211+0000 7fc380ff9700 1 -- 172.21.15.40:0/2020504878 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc37801e3b0 con 0x7fc38406fb50 2023-09-30T22:28:59.212 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:28:59.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.213+0000 7fc38a614700 1 -- 172.21.15.40:0/2020504878 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc38406fb50 msgr2=0x7fc3841350d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.213+0000 7fc38a614700 1 --2- 172.21.15.40:0/2020504878 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc38406fb50 0x7fc3841350d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc37801a000 tx=0x7fc378004750 comp rx=0 tx=0).stop 2023-09-30T22:28:59.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.213+0000 7fc38a614700 1 -- 172.21.15.40:0/2020504878 shutdown_connections 2023-09-30T22:28:59.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.213+0000 7fc38a614700 1 --2- 172.21.15.40:0/2020504878 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3841371b0 0x7fc384135610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.213+0000 7fc38a614700 1 --2- 172.21.15.40:0/2020504878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc38406f070 0x7fc384134b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.213+0000 7fc38a614700 1 --2- 172.21.15.40:0/2020504878 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc38406fb50 0x7fc3841350d0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.213+0000 7fc38a614700 1 -- 172.21.15.40:0/2020504878 >> 172.21.15.40:0/2020504878 conn(0x7fc3840a41a0 msgr2=0x7fc3840a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:59.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.213+0000 7fc38a614700 1 -- 172.21.15.40:0/2020504878 shutdown_connections 2023-09-30T22:28:59.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.213+0000 7fc38a614700 1 -- 172.21.15.40:0/2020504878 wait complete. 2023-09-30T22:28:59.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.215+0000 7fe8411ef700 1 -- 172.21.15.40:0/2577111381 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe83c09c9e0 con 0x7fe83c09d920 2023-09-30T22:28:59.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.215+0000 7fe8237fe700 1 -- 172.21.15.40:0/2577111381 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe82c017070 con 0x7fe83c09d920 2023-09-30T22:28:59.216 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:28:59.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.218+0000 7fe8411ef700 1 -- 172.21.15.40:0/2577111381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe83c09d920 msgr2=0x7fe83c1c8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.218+0000 7fe8411ef700 1 --2- 172.21.15.40:0/2577111381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe83c09d920 0x7fe83c1c8400 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fe82c00e9c0 tx=0x7fe82c00ecd0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.218+0000 7fe8411ef700 1 -- 172.21.15.40:0/2577111381 shutdown_connections 2023-09-30T22:28:59.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.218+0000 7fe8411ef700 1 --2- 172.21.15.40:0/2577111381 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe83c1341e0 0x7fe83c1c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.218+0000 7fe8411ef700 1 --2- 172.21.15.40:0/2577111381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe83c09d920 0x7fe83c1c8400 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.218+0000 7fe8411ef700 1 --2- 172.21.15.40:0/2577111381 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe83c09e230 0x7fe83c1c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.218+0000 7fe8411ef700 1 -- 172.21.15.40:0/2577111381 >> 172.21.15.40:0/2577111381 conn(0x7fe83c09fb20 msgr2=0x7fe83c0a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:59.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.218+0000 7fe8411ef700 1 -- 172.21.15.40:0/2577111381 shutdown_connections 2023-09-30T22:28:59.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:28:59.218+0000 7fe8411ef700 1 -- 172.21.15.40:0/2577111381 wait complete. 2023-09-30T22:28:59.227 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:28:59.231 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:00.112 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:00.151 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:00.228 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:00.232 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:00.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.263+0000 7fc5cc4e5700 1 Processor -- start 2023-09-30T22:29:00.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.263+0000 7fc5cc4e5700 1 -- start start 2023-09-30T22:29:00.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.264+0000 7fc5cc4e5700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc5c409e2b0 0x7fc5c409e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.264+0000 7fc5cc4e5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5c4131040 0x7fc5c4138da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.264+0000 7fc5cc4e5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5c409fad0 con 0x7fc5c409ebc0 2023-09-30T22:29:00.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.264+0000 7fc5cc4e5700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5c406b900 con 0x7fc5c409e2b0 2023-09-30T22:29:00.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.264+0000 7fc5cc4e5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c409a880 con 0x7fc5c4131040 2023-09-30T22:29:00.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.264+0000 7fc5caa82700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5c4131040 0x7fc5c4138da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.264+0000 7fc5ca281700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc5c409e2b0 0x7fc5c409e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.264+0000 7fc5caa82700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5c4131040 0x7fc5c4138da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38872/0 (socket says 172.21.15.40:38872) 2023-09-30T22:29:00.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.264+0000 7fc5caa82700 1 -- 172.21.15.40:0/921119176 learned_addr learned my addr 172.21.15.40:0/921119176 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:00.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.264+0000 7fc5caa82700 1 -- 172.21.15.40:0/921119176 >> v2:172.21.15.40:3300/0 conn(0x7fc5c409e2b0 msgr2=0x7fc5c409e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:00.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.264+0000 7fc5caa82700 1 --2- 172.21.15.40:0/921119176 >> v2:172.21.15.40:3300/0 conn(0x7fc5c409e2b0 0x7fc5c409e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.264+0000 7fc5caa82700 1 -- 172.21.15.40:0/921119176 >> v1:172.21.15.40:6789/0 conn(0x7fc5c409ebc0 legacy=0x7fc5c4130930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.264+0000 7fc5caa82700 1 -- 172.21.15.40:0/921119176 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c409c780 con 0x7fc5c4131040 2023-09-30T22:29:00.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.264+0000 7fc5ca281700 1 --2- 172.21.15.40:0/921119176 >> v2:172.21.15.40:3300/0 conn(0x7fc5c409e2b0 0x7fc5c409e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:00.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.264+0000 7fc5caa82700 1 --2- 172.21.15.40:0/921119176 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5c4131040 0x7fc5c4138da0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc009e50 tx=0x7fc5bc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2f566cb4e8c9e15 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:00.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.265+0000 7fc5c927f700 1 -- 172.21.15.40:0/921119176 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc00e070 con 0x7fc5c4131040 2023-09-30T22:29:00.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.265+0000 7fc5c927f700 1 -- 172.21.15.40:0/921119176 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5bc00b910 con 0x7fc5c4131040 2023-09-30T22:29:00.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.265+0000 7fc5c927f700 1 -- 172.21.15.40:0/921119176 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc00bcc0 con 0x7fc5c4131040 2023-09-30T22:29:00.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.265+0000 7fc5cc4e5700 1 -- 172.21.15.40:0/921119176 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5c4131040 msgr2=0x7fc5c4138da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.265+0000 7fc5cc4e5700 1 --2- 172.21.15.40:0/921119176 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5c4131040 0x7fc5c4138da0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc009e50 tx=0x7fc5bc00b330 comp rx=0 tx=0).stop 2023-09-30T22:29:00.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.265+0000 7fc5cc4e5700 1 -- 172.21.15.40:0/921119176 shutdown_connections 2023-09-30T22:29:00.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.265+0000 7fc5cc4e5700 1 --2- 172.21.15.40:0/921119176 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5c4131040 0x7fc5c4138da0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.265+0000 7fc5cc4e5700 1 --2- 172.21.15.40:0/921119176 >> v2:172.21.15.40:3300/0 conn(0x7fc5c409e2b0 0x7fc5c409e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.265+0000 7fc5cc4e5700 1 -- 172.21.15.40:0/921119176 >> 172.21.15.40:0/921119176 conn(0x7fc5c40a3590 msgr2=0x7fc5c40a3990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:00.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.266+0000 7fc5cc4e5700 1 -- 172.21.15.40:0/921119176 shutdown_connections 2023-09-30T22:29:00.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.266+0000 7fc5cc4e5700 1 -- 172.21.15.40:0/921119176 wait complete. 2023-09-30T22:29:00.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.266+0000 7fc5cc4e5700 1 Processor -- start 2023-09-30T22:29:00.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.267+0000 7fc5cc4e5700 1 -- start start 2023-09-30T22:29:00.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.267+0000 7fc5cc4e5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5c409e2b0 0x7fc5c41c4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.267+0000 7fc5cc4e5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5c409ebc0 0x7fc5c41c4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.267+0000 7fc5cc4e5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc5c4131040 0x7fc5c41c0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.267+0000 7fc5cc4e5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c411f9f0 con 0x7fc5c409ebc0 2023-09-30T22:29:00.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.267+0000 7fc5cc4e5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c411fdb0 con 0x7fc5c409e2b0 2023-09-30T22:29:00.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.267+0000 7fc5cc4e5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c41204f0 con 0x7fc5c4131040 2023-09-30T22:29:00.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.267+0000 7fc5ca281700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5c409e2b0 0x7fc5c41c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.267+0000 7fc5ca281700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5c409e2b0 0x7fc5c41c4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38880/0 (socket says 172.21.15.40:38880) 2023-09-30T22:29:00.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.267+0000 7fc5ca281700 1 -- 172.21.15.40:0/1400755352 learned_addr learned my addr 172.21.15.40:0/1400755352 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:00.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.268+0000 7fc5caa82700 1 --2- 172.21.15.40:0/1400755352 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc5c4131040 0x7fc5c41c0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.268+0000 7fc5ca281700 1 -- 172.21.15.40:0/1400755352 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc5c4131040 msgr2=0x7fc5c41c0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.268+0000 7fc5ca281700 1 --2- 172.21.15.40:0/1400755352 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc5c4131040 0x7fc5c41c0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.268+0000 7fc5ca281700 1 -- 172.21.15.40:0/1400755352 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5c409ebc0 msgr2=0x7fc5c41c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.268+0000 7fc5ca281700 1 --2- 172.21.15.40:0/1400755352 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5c409ebc0 0x7fc5c41c4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.268+0000 7fc5ca281700 1 -- 172.21.15.40:0/1400755352 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c00094a0 con 0x7fc5c409e2b0 2023-09-30T22:29:00.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.268+0000 7fc5caa82700 1 --2- 172.21.15.40:0/1400755352 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc5c4131040 0x7fc5c41c0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:29:00.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.268+0000 7fc5ca281700 1 --2- 172.21.15.40:0/1400755352 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5c409e2b0 0x7fc5c41c4710 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fc5c000ebe0 tx=0x7fc5c0009ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:00.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.268+0000 7fc5baffd700 1 -- 172.21.15.40:0/1400755352 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c000c910 con 0x7fc5c409e2b0 2023-09-30T22:29:00.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.268+0000 7fc5baffd700 1 -- 172.21.15.40:0/1400755352 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c000ca70 con 0x7fc5c409e2b0 2023-09-30T22:29:00.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.268+0000 7fc5baffd700 1 -- 172.21.15.40:0/1400755352 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c000cde0 con 0x7fc5c409e2b0 2023-09-30T22:29:00.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.269+0000 7fc5cc4e5700 1 -- 172.21.15.40:0/1400755352 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5bc009b30 con 0x7fc5c409e2b0 2023-09-30T22:29:00.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.269+0000 7fc5cc4e5700 1 -- 172.21.15.40:0/1400755352 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c411eb80 con 0x7fc5c409e2b0 2023-09-30T22:29:00.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.270+0000 7fc5baffd700 1 -- 172.21.15.40:0/1400755352 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc5c0013470 con 0x7fc5c409e2b0 2023-09-30T22:29:00.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.270+0000 7fc5baffd700 1 -- 172.21.15.40:0/1400755352 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc5c003f910 con 0x7fc5c409e2b0 2023-09-30T22:29:00.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.270+0000 7fc5cc4e5700 1 -- 172.21.15.40:0/1400755352 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5c4062380 con 0x7fc5c409e2b0 2023-09-30T22:29:00.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.279+0000 7fc5baffd700 1 -- 172.21.15.40:0/1400755352 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc5c00232f0 con 0x7fc5c409e2b0 2023-09-30T22:29:00.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.303+0000 7f66cb689700 1 Processor -- start 2023-09-30T22:29:00.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.303+0000 7f66cb689700 1 -- start start 2023-09-30T22:29:00.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.303+0000 7f66cb689700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66c409d920 0x7f66c409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.303+0000 7f66cb689700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f66c4130fb0 0x7f66c4138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.303+0000 7f66cb689700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66c409adf0 con 0x7f66c409e230 2023-09-30T22:29:00.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.303+0000 7f66cb689700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66c409edf0 con 0x7f66c4130fb0 2023-09-30T22:29:00.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.303+0000 7f66cb689700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c409b660 con 0x7f66c409d920 2023-09-30T22:29:00.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.304+0000 7f66c9c26700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f66c4130fb0 0x7f66c4138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.304+0000 7f66c9425700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66c409d920 0x7f66c409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.304+0000 7f66c9c26700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f66c4130fb0 0x7f66c4138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50872/0 (socket says 172.21.15.40:50872) 2023-09-30T22:29:00.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.304+0000 7f66c9425700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66c409d920 0x7f66c409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38892/0 (socket says 172.21.15.40:38892) 2023-09-30T22:29:00.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.304+0000 7f66c9c26700 1 -- 172.21.15.40:0/2359620405 learned_addr learned my addr 172.21.15.40:0/2359620405 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:00.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.304+0000 7f66c9c26700 1 -- 172.21.15.40:0/2359620405 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66c409d920 msgr2=0x7f66c409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:00.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.304+0000 7f66c9c26700 1 --2- 172.21.15.40:0/2359620405 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66c409d920 0x7f66c409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.304+0000 7f66c9c26700 1 -- 172.21.15.40:0/2359620405 >> v1:172.21.15.40:6789/0 conn(0x7f66c409e230 legacy=0x7f66c41308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.304+0000 7f66c9c26700 1 -- 172.21.15.40:0/2359620405 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c409a6e0 con 0x7f66c4130fb0 2023-09-30T22:29:00.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.304+0000 7f66c9c26700 1 --2- 172.21.15.40:0/2359620405 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66c4130fb0 0x7f66c4138d10 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f66bc009e50 tx=0x7f66bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6161c1702c3fe682 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:00.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.304+0000 7f66bbfff700 1 -- 172.21.15.40:0/2359620405 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66bc00e070 con 0x7f66c4130fb0 2023-09-30T22:29:00.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.305+0000 7f66bbfff700 1 -- 172.21.15.40:0/2359620405 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66bc00b910 con 0x7f66c4130fb0 2023-09-30T22:29:00.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.305+0000 7f66bbfff700 1 -- 172.21.15.40:0/2359620405 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66bc00bcc0 con 0x7f66c4130fb0 2023-09-30T22:29:00.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.305+0000 7f66cb689700 1 -- 172.21.15.40:0/2359620405 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66c4130fb0 msgr2=0x7f66c4138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.305+0000 7f66cb689700 1 --2- 172.21.15.40:0/2359620405 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66c4130fb0 0x7f66c4138d10 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f66bc009e50 tx=0x7f66bc00b330 comp rx=0 tx=0).stop 2023-09-30T22:29:00.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.305+0000 7f66cb689700 1 -- 172.21.15.40:0/2359620405 shutdown_connections 2023-09-30T22:29:00.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.305+0000 7f66cb689700 1 --2- 172.21.15.40:0/2359620405 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66c4130fb0 0x7f66c4138d10 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.305+0000 7f66cb689700 1 --2- 172.21.15.40:0/2359620405 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66c409d920 0x7f66c409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.305+0000 7f66cb689700 1 -- 172.21.15.40:0/2359620405 >> 172.21.15.40:0/2359620405 conn(0x7f66c409fb20 msgr2=0x7f66c409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:00.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.305+0000 7f66cb689700 1 -- 172.21.15.40:0/2359620405 shutdown_connections 2023-09-30T22:29:00.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.305+0000 7f66cb689700 1 -- 172.21.15.40:0/2359620405 wait complete. 2023-09-30T22:29:00.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.306+0000 7f66cb689700 1 Processor -- start 2023-09-30T22:29:00.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.306+0000 7f66cb689700 1 -- start start 2023-09-30T22:29:00.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.307+0000 7f66cb689700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66c409d920 0x7f66c4138b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.307+0000 7f66cb689700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66c409e230 0x7f66c4139040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.307+0000 7f66cb689700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66c4130fb0 0x7f66c41c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.307+0000 7f66cb689700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c413b700 con 0x7f66c409d920 2023-09-30T22:29:00.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.307+0000 7f66cb689700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c41373d0 con 0x7f66c4130fb0 2023-09-30T22:29:00.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.307+0000 7f66cb689700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66c409cb00 con 0x7f66c409e230 2023-09-30T22:29:00.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.307+0000 7f66c9425700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66c409d920 0x7f66c4138b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.307+0000 7f66c9c26700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66c4130fb0 0x7f66c41c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.307+0000 7f66c9425700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66c409d920 0x7f66c4138b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50886/0 (socket says 172.21.15.40:50886) 2023-09-30T22:29:00.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.307+0000 7f66c9425700 1 -- 172.21.15.40:0/94317396 learned_addr learned my addr 172.21.15.40:0/94317396 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:00.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.307+0000 7f66c9425700 1 -- 172.21.15.40:0/94317396 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66c409e230 msgr2=0x7f66c4139040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.307+0000 7f66c9425700 1 --2- 172.21.15.40:0/94317396 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66c409e230 0x7f66c4139040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.307+0000 7f66c9425700 1 -- 172.21.15.40:0/94317396 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66c4130fb0 msgr2=0x7f66c41c8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.307+0000 7f66c9425700 1 --2- 172.21.15.40:0/94317396 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66c4130fb0 0x7f66c41c8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.307+0000 7f66c9425700 1 -- 172.21.15.40:0/94317396 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66bc009b30 con 0x7f66c409d920 2023-09-30T22:29:00.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.307+0000 7f66c9c26700 1 --2- 172.21.15.40:0/94317396 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66c4130fb0 0x7f66c41c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:00.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.308+0000 7f66c9425700 1 --2- 172.21.15.40:0/94317396 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66c409d920 0x7f66c4138b00 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f66c000e990 tx=0x7f66c000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:00.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.308+0000 7f66b9ffb700 1 -- 172.21.15.40:0/94317396 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c00096f0 con 0x7f66c409d920 2023-09-30T22:29:00.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.308+0000 7f66b9ffb700 1 -- 172.21.15.40:0/94317396 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c000c850 con 0x7f66c409d920 2023-09-30T22:29:00.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.308+0000 7f66cb689700 1 -- 172.21.15.40:0/94317396 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66c4135fd0 con 0x7f66c409d920 2023-09-30T22:29:00.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.308+0000 7f66b9ffb700 1 -- 172.21.15.40:0/94317396 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c000eee0 con 0x7f66c409d920 2023-09-30T22:29:00.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.308+0000 7f66cb689700 1 -- 172.21.15.40:0/94317396 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c4139580 con 0x7f66c409d920 2023-09-30T22:29:00.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.309+0000 7f66b9ffb700 1 -- 172.21.15.40:0/94317396 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f66c000cbc0 con 0x7f66c409d920 2023-09-30T22:29:00.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.309+0000 7f66cb689700 1 -- 172.21.15.40:0/94317396 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c4062380 con 0x7f66c409d920 2023-09-30T22:29:00.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.309+0000 7f66b9ffb700 1 -- 172.21.15.40:0/94317396 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f66c003fbc0 con 0x7f66c409d920 2023-09-30T22:29:00.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.318+0000 7f66b9ffb700 1 -- 172.21.15.40:0/94317396 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f66c001b3b0 con 0x7f66c409d920 2023-09-30T22:29:00.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.371+0000 7f905fcdc700 1 Processor -- start 2023-09-30T22:29:00.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.371+0000 7f905fcdc700 1 -- start start 2023-09-30T22:29:00.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.372+0000 7f905fcdc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9058136c50 0x7f9058139030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.372+0000 7f905fcdc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9058139570 0x7f905813b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.372+0000 7f905fcdc700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9058133940 con 0x7f9058133e00 2023-09-30T22:29:00.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.372+0000 7f905fcdc700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f905809af70 con 0x7f9058136c50 2023-09-30T22:29:00.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.372+0000 7f905fcdc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f905809ab20 con 0x7f9058139570 2023-09-30T22:29:00.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.372+0000 7f905d277700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9058136c50 0x7f9058139030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.372+0000 7f905e279700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9058139570 0x7f905813b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.372+0000 7f905d277700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9058136c50 0x7f9058139030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50898/0 (socket says 172.21.15.40:50898) 2023-09-30T22:29:00.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.372+0000 7f905e279700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9058139570 0x7f905813b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38918/0 (socket says 172.21.15.40:38918) 2023-09-30T22:29:00.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.372+0000 7f905d277700 1 -- 172.21.15.40:0/1629919977 learned_addr learned my addr 172.21.15.40:0/1629919977 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:00.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.373+0000 7f905e279700 1 -- 172.21.15.40:0/1629919977 >> v2:172.21.15.40:3300/0 conn(0x7f9058136c50 msgr2=0x7f9058139030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:00.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.373+0000 7f905e279700 1 --2- 172.21.15.40:0/1629919977 >> v2:172.21.15.40:3300/0 conn(0x7f9058136c50 0x7f9058139030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.373+0000 7f905e279700 1 -- 172.21.15.40:0/1629919977 >> v1:172.21.15.40:6789/0 conn(0x7f9058133e00 legacy=0x7f90581341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.373+0000 7f905e279700 1 -- 172.21.15.40:0/1629919977 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f905809f0d0 con 0x7f9058139570 2023-09-30T22:29:00.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.373+0000 7f905d277700 1 --2- 172.21.15.40:0/1629919977 >> v2:172.21.15.40:3300/0 conn(0x7f9058136c50 0x7f9058139030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:00.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.373+0000 7f905e279700 1 --2- 172.21.15.40:0/1629919977 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9058139570 0x7f905813b950 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9050009d90 tx=0x7f905000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6627140f86bb7a6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:00.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.373+0000 7f905ca76700 1 -- 172.21.15.40:0/1629919977 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905000e070 con 0x7f9058139570 2023-09-30T22:29:00.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.373+0000 7f905ca76700 1 -- 172.21.15.40:0/1629919977 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905000bb20 con 0x7f9058139570 2023-09-30T22:29:00.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.373+0000 7f905ca76700 1 -- 172.21.15.40:0/1629919977 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9050012430 con 0x7f9058139570 2023-09-30T22:29:00.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.374+0000 7f905fcdc700 1 -- 172.21.15.40:0/1629919977 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9058139570 msgr2=0x7f905813b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.374+0000 7f905fcdc700 1 --2- 172.21.15.40:0/1629919977 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9058139570 0x7f905813b950 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9050009d90 tx=0x7f905000b330 comp rx=0 tx=0).stop 2023-09-30T22:29:00.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.374+0000 7f905fcdc700 1 -- 172.21.15.40:0/1629919977 shutdown_connections 2023-09-30T22:29:00.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.374+0000 7f905fcdc700 1 --2- 172.21.15.40:0/1629919977 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9058139570 0x7f905813b950 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.374+0000 7f905fcdc700 1 --2- 172.21.15.40:0/1629919977 >> v2:172.21.15.40:3300/0 conn(0x7f9058136c50 0x7f9058139030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.374+0000 7f905fcdc700 1 -- 172.21.15.40:0/1629919977 >> 172.21.15.40:0/1629919977 conn(0x7f90580a2a00 msgr2=0x7f90580a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:00.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.374+0000 7f905fcdc700 1 -- 172.21.15.40:0/1629919977 shutdown_connections 2023-09-30T22:29:00.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.374+0000 7f905fcdc700 1 -- 172.21.15.40:0/1629919977 wait complete. 2023-09-30T22:29:00.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.375+0000 7f905fcdc700 1 Processor -- start 2023-09-30T22:29:00.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.375+0000 7f905fcdc700 1 -- start start 2023-09-30T22:29:00.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.375+0000 7f905fcdc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9058133e00 0x7f90581c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.375+0000 7f905fcdc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9058136c50 0x7f90581c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.375+0000 7f905fcdc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9058139570 0x7f90581c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.375+0000 7f905fcdc700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905811ab10 con 0x7f9058136c50 2023-09-30T22:29:00.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.375+0000 7f905fcdc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90580a0190 con 0x7f9058133e00 2023-09-30T22:29:00.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.375+0000 7f905fcdc700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f905811bad0 con 0x7f9058139570 2023-09-30T22:29:00.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.375+0000 7f905e279700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9058139570 0x7f90581c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.376+0000 7f905e279700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9058139570 0x7f90581c92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58090/0 (socket says 172.21.15.40:58090) 2023-09-30T22:29:00.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.376+0000 7f905e279700 1 -- 172.21.15.40:0/3902306202 learned_addr learned my addr 172.21.15.40:0/3902306202 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:00.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.376+0000 7f905da78700 1 --2- 172.21.15.40:0/3902306202 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9058133e00 0x7f90581c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.376+0000 7f905d277700 1 --2- 172.21.15.40:0/3902306202 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9058136c50 0x7f90581c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.376+0000 7f905e279700 1 -- 172.21.15.40:0/3902306202 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9058133e00 msgr2=0x7f90581c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.376+0000 7f905e279700 1 --2- 172.21.15.40:0/3902306202 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9058133e00 0x7f90581c8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.376+0000 7f905e279700 1 -- 172.21.15.40:0/3902306202 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9058136c50 msgr2=0x7f90581c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.376+0000 7f905e279700 1 --2- 172.21.15.40:0/3902306202 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9058136c50 0x7f90581c8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.376+0000 7f905e279700 1 -- 172.21.15.40:0/3902306202 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9048009550 con 0x7f9058139570 2023-09-30T22:29:00.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.376+0000 7f905e279700 1 --2- 172.21.15.40:0/3902306202 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9058139570 0x7f90581c92e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f905809ac60 tx=0x7f9050004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:00.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.376+0000 7f904e7fc700 1 -- 172.21.15.40:0/3902306202 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9050012430 con 0x7f9058139570 2023-09-30T22:29:00.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.376+0000 7f904e7fc700 1 -- 172.21.15.40:0/3902306202 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9050020070 con 0x7f9058139570 2023-09-30T22:29:00.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.376+0000 7f905fcdc700 1 -- 172.21.15.40:0/3902306202 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9050009a70 con 0x7f9058139570 2023-09-30T22:29:00.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.376+0000 7f905fcdc700 1 -- 172.21.15.40:0/3902306202 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9058130940 con 0x7f9058139570 2023-09-30T22:29:00.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.376+0000 7f904e7fc700 1 -- 172.21.15.40:0/3902306202 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9050004040 con 0x7f9058139570 2023-09-30T22:29:00.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.377+0000 7f904e7fc700 1 -- 172.21.15.40:0/3902306202 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f90500041a0 con 0x7f9058139570 2023-09-30T22:29:00.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.378+0000 7f904e7fc700 1 -- 172.21.15.40:0/3902306202 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9050022070 con 0x7f9058139570 2023-09-30T22:29:00.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.378+0000 7f905fcdc700 1 -- 172.21.15.40:0/3902306202 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90400052e0 con 0x7f9058139570 2023-09-30T22:29:00.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.387+0000 7f904e7fc700 1 -- 172.21.15.40:0/3902306202 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f905001c400 con 0x7f9058139570 2023-09-30T22:29:00.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.398+0000 7fbf33b67700 1 Processor -- start 2023-09-30T22:29:00.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.398+0000 7fbf33b67700 1 -- start start 2023-09-30T22:29:00.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.399+0000 7fbf33b67700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbf2c095430 0x7fbf2c095800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.399+0000 7fbf33b67700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf2c1306b0 0x7fbf2c130ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.399+0000 7fbf33b67700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf2c131020 0x7fbf2c1379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.399+0000 7fbf33b67700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf2c072880 con 0x7fbf2c095430 2023-09-30T22:29:00.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.399+0000 7fbf33b67700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c098990 con 0x7fbf2c131020 2023-09-30T22:29:00.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.399+0000 7fbf33b67700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c099720 con 0x7fbf2c1306b0 2023-09-30T22:29:00.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.399+0000 7fbf32104700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf2c131020 0x7fbf2c1379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.399+0000 7fbf32104700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf2c131020 0x7fbf2c1379e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38922/0 (socket says 172.21.15.40:38922) 2023-09-30T22:29:00.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.399+0000 7fbf32104700 1 -- 172.21.15.40:0/3850375041 learned_addr learned my addr 172.21.15.40:0/3850375041 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:00.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.399+0000 7fbf31102700 1 --2- 172.21.15.40:0/3850375041 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf2c1306b0 0x7fbf2c130ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.399+0000 7fbf31903700 1 --2- 172.21.15.40:0/3850375041 >> v2:172.21.15.40:3300/0 conn(0x7fbf2c095430 0x7fbf2c095800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.399+0000 7fbf32104700 1 -- 172.21.15.40:0/3850375041 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf2c1306b0 msgr2=0x7fbf2c130ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:00.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.399+0000 7fbf32104700 1 --2- 172.21.15.40:0/3850375041 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf2c1306b0 0x7fbf2c130ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.399+0000 7fbf32104700 1 -- 172.21.15.40:0/3850375041 >> v2:172.21.15.40:3300/0 conn(0x7fbf2c095430 msgr2=0x7fbf2c095800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:00.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.399+0000 7fbf32104700 1 --2- 172.21.15.40:0/3850375041 >> v2:172.21.15.40:3300/0 conn(0x7fbf2c095430 0x7fbf2c095800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.399+0000 7fbf32104700 1 -- 172.21.15.40:0/3850375041 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf2c1314a0 con 0x7fbf2c131020 2023-09-30T22:29:00.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.400+0000 7fbf32104700 1 --2- 172.21.15.40:0/3850375041 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf2c131020 0x7fbf2c1379e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fbf24009e50 tx=0x7fbf2400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c25e22345ab9d6e4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:00.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.400+0000 7fbf30901700 1 -- 172.21.15.40:0/3850375041 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2400e070 con 0x7fbf2c131020 2023-09-30T22:29:00.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.400+0000 7fbf30901700 1 -- 172.21.15.40:0/3850375041 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2400b910 con 0x7fbf2c131020 2023-09-30T22:29:00.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.400+0000 7fbf30901700 1 -- 172.21.15.40:0/3850375041 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2400bca0 con 0x7fbf2c131020 2023-09-30T22:29:00.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.400+0000 7fbf33b67700 1 -- 172.21.15.40:0/3850375041 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf2c131020 msgr2=0x7fbf2c1379e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.400+0000 7fbf33b67700 1 --2- 172.21.15.40:0/3850375041 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf2c131020 0x7fbf2c1379e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fbf24009e50 tx=0x7fbf2400b330 comp rx=0 tx=0).stop 2023-09-30T22:29:00.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.401+0000 7fbf33b67700 1 -- 172.21.15.40:0/3850375041 shutdown_connections 2023-09-30T22:29:00.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.401+0000 7fbf33b67700 1 --2- 172.21.15.40:0/3850375041 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf2c131020 0x7fbf2c1379e0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.401+0000 7fbf33b67700 1 --2- 172.21.15.40:0/3850375041 >> v2:172.21.15.40:3300/0 conn(0x7fbf2c095430 0x7fbf2c095800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.401+0000 7fbf33b67700 1 --2- 172.21.15.40:0/3850375041 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf2c1306b0 0x7fbf2c130ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.401+0000 7fbf33b67700 1 -- 172.21.15.40:0/3850375041 >> 172.21.15.40:0/3850375041 conn(0x7fbf2c0a2ff0 msgr2=0x7fbf2c09ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:00.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.401+0000 7fbf33b67700 1 -- 172.21.15.40:0/3850375041 shutdown_connections 2023-09-30T22:29:00.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.401+0000 7fbf33b67700 1 -- 172.21.15.40:0/3850375041 wait complete. 2023-09-30T22:29:00.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.402+0000 7fbf33b67700 1 Processor -- start 2023-09-30T22:29:00.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.402+0000 7fbf33b67700 1 -- start start 2023-09-30T22:29:00.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.403+0000 7fbf33b67700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf2c095430 0x7fbf2c0700a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.403+0000 7fbf33b67700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf2c1306b0 0x7fbf2c06d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.403+0000 7fbf33b67700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf2c131020 0x7fbf2c06d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.403+0000 7fbf33b67700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c06f400 con 0x7fbf2c131020 2023-09-30T22:29:00.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.403+0000 7fbf33b67700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c06fde0 con 0x7fbf2c1306b0 2023-09-30T22:29:00.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.403+0000 7fbf33b67700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c070780 con 0x7fbf2c095430 2023-09-30T22:29:00.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.403+0000 7fbf32104700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf2c131020 0x7fbf2c06d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.403+0000 7fbf32104700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf2c131020 0x7fbf2c06d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50920/0 (socket says 172.21.15.40:50920) 2023-09-30T22:29:00.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.403+0000 7fbf32104700 1 -- 172.21.15.40:0/2297940645 learned_addr learned my addr 172.21.15.40:0/2297940645 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:00.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.403+0000 7fbf31903700 1 --2- 172.21.15.40:0/2297940645 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf2c095430 0x7fbf2c0700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.403+0000 7fbf31102700 1 --2- 172.21.15.40:0/2297940645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf2c1306b0 0x7fbf2c06d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.403+0000 7fbf32104700 1 -- 172.21.15.40:0/2297940645 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf2c095430 msgr2=0x7fbf2c0700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.403+0000 7fbf32104700 1 --2- 172.21.15.40:0/2297940645 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf2c095430 0x7fbf2c0700a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.403+0000 7fbf32104700 1 -- 172.21.15.40:0/2297940645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf2c1306b0 msgr2=0x7fbf2c06d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.403+0000 7fbf32104700 1 --2- 172.21.15.40:0/2297940645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf2c1306b0 0x7fbf2c06d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.403+0000 7fbf32104700 1 -- 172.21.15.40:0/2297940645 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf24009b30 con 0x7fbf2c131020 2023-09-30T22:29:00.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.404+0000 7fbf32104700 1 --2- 172.21.15.40:0/2297940645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf2c131020 0x7fbf2c06d740 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fbf24003f50 tx=0x7fbf24004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:00.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.404+0000 7fbf227fc700 1 -- 172.21.15.40:0/2297940645 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf24004450 con 0x7fbf2c131020 2023-09-30T22:29:00.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.404+0000 7fbf227fc700 1 -- 172.21.15.40:0/2297940645 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf240045b0 con 0x7fbf2c131020 2023-09-30T22:29:00.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.404+0000 7fbf33b67700 1 -- 172.21.15.40:0/2297940645 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf2c072190 con 0x7fbf2c131020 2023-09-30T22:29:00.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.404+0000 7fbf227fc700 1 -- 172.21.15.40:0/2297940645 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf24004940 con 0x7fbf2c131020 2023-09-30T22:29:00.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.404+0000 7fbf33b67700 1 -- 172.21.15.40:0/2297940645 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf2c06f650 con 0x7fbf2c131020 2023-09-30T22:29:00.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.405+0000 7fbf227fc700 1 -- 172.21.15.40:0/2297940645 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbf24025460 con 0x7fbf2c131020 2023-09-30T22:29:00.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.405+0000 7fbf33b67700 1 -- 172.21.15.40:0/2297940645 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf2c062380 con 0x7fbf2c131020 2023-09-30T22:29:00.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.406+0000 7fbf227fc700 1 -- 172.21.15.40:0/2297940645 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fbf240415b0 con 0x7fbf2c131020 2023-09-30T22:29:00.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.415+0000 7fbf227fc700 1 -- 172.21.15.40:0/2297940645 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbf24011390 con 0x7fbf2c131020 2023-09-30T22:29:00.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.487+0000 7fc5cc4e5700 1 -- 172.21.15.40:0/1400755352 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc5c409bc60 con 0x7fc5c409e2b0 2023-09-30T22:29:00.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.488+0000 7fc5baffd700 1 -- 172.21.15.40:0/1400755352 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc5c0021030 con 0x7fc5c409e2b0 2023-09-30T22:29:00.488 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:00.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.490+0000 7fc5cc4e5700 1 -- 172.21.15.40:0/1400755352 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5c409e2b0 msgr2=0x7fc5c41c4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.490+0000 7fc5cc4e5700 1 --2- 172.21.15.40:0/1400755352 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5c409e2b0 0x7fc5c41c4710 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fc5c000ebe0 tx=0x7fc5c0009ec0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.490+0000 7fc5cc4e5700 1 -- 172.21.15.40:0/1400755352 shutdown_connections 2023-09-30T22:29:00.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.490+0000 7fc5cc4e5700 1 --2- 172.21.15.40:0/1400755352 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc5c4131040 0x7fc5c41c0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.490+0000 7fc5cc4e5700 1 --2- 172.21.15.40:0/1400755352 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5c409e2b0 0x7fc5c41c4710 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.490+0000 7fc5cc4e5700 1 --2- 172.21.15.40:0/1400755352 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5c409ebc0 0x7fc5c41c4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.490+0000 7fc5cc4e5700 1 -- 172.21.15.40:0/1400755352 >> 172.21.15.40:0/1400755352 conn(0x7fc5c40a3590 msgr2=0x7fc5c4130110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:00.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.490+0000 7fc5cc4e5700 1 -- 172.21.15.40:0/1400755352 shutdown_connections 2023-09-30T22:29:00.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.490+0000 7fc5cc4e5700 1 -- 172.21.15.40:0/1400755352 wait complete. 2023-09-30T22:29:00.503 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:00.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.526+0000 7f66cb689700 1 -- 172.21.15.40:0/94317396 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f66c4074720 con 0x7f66c409d920 2023-09-30T22:29:00.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.526+0000 7f66b9ffb700 1 -- 172.21.15.40:0/94317396 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f66c0017020 con 0x7f66c409d920 2023-09-30T22:29:00.527 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:00.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.528+0000 7f66cb689700 1 -- 172.21.15.40:0/94317396 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66c409d920 msgr2=0x7f66c4138b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.528+0000 7f66cb689700 1 --2- 172.21.15.40:0/94317396 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66c409d920 0x7f66c4138b00 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f66c000e990 tx=0x7f66c000eca0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.528+0000 7f66cb689700 1 -- 172.21.15.40:0/94317396 shutdown_connections 2023-09-30T22:29:00.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.528+0000 7f66cb689700 1 --2- 172.21.15.40:0/94317396 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66c4130fb0 0x7f66c41c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.528+0000 7f66cb689700 1 --2- 172.21.15.40:0/94317396 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66c409d920 0x7f66c4138b00 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.528+0000 7f66cb689700 1 --2- 172.21.15.40:0/94317396 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f66c409e230 0x7f66c4139040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.528+0000 7f66cb689700 1 -- 172.21.15.40:0/94317396 >> 172.21.15.40:0/94317396 conn(0x7f66c409fb20 msgr2=0x7f66c40717f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:00.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.529+0000 7f66cb689700 1 -- 172.21.15.40:0/94317396 shutdown_connections 2023-09-30T22:29:00.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.529+0000 7f66cb689700 1 -- 172.21.15.40:0/94317396 wait complete. 2023-09-30T22:29:00.542 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:00.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.592+0000 7f905fcdc700 1 -- 172.21.15.40:0/3902306202 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9040005590 con 0x7f9058139570 2023-09-30T22:29:00.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.593+0000 7f904e7fc700 1 -- 172.21.15.40:0/3902306202 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f90500117b0 con 0x7f9058139570 2023-09-30T22:29:00.593 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:00.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.595+0000 7f905fcdc700 1 -- 172.21.15.40:0/3902306202 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9058139570 msgr2=0x7f90581c92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.595+0000 7f905fcdc700 1 --2- 172.21.15.40:0/3902306202 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9058139570 0x7f90581c92e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f905809ac60 tx=0x7f9050004ad0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.595+0000 7f905fcdc700 1 -- 172.21.15.40:0/3902306202 shutdown_connections 2023-09-30T22:29:00.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.595+0000 7f905fcdc700 1 --2- 172.21.15.40:0/3902306202 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9058139570 0x7f90581c92e0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.595+0000 7f905fcdc700 1 --2- 172.21.15.40:0/3902306202 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9058133e00 0x7f90581c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.595+0000 7f905fcdc700 1 --2- 172.21.15.40:0/3902306202 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9058136c50 0x7f90581c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.595+0000 7f905fcdc700 1 -- 172.21.15.40:0/3902306202 >> 172.21.15.40:0/3902306202 conn(0x7f90580a2a00 msgr2=0x7f9058135070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:00.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.595+0000 7f905fcdc700 1 -- 172.21.15.40:0/3902306202 shutdown_connections 2023-09-30T22:29:00.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.595+0000 7f905fcdc700 1 -- 172.21.15.40:0/3902306202 wait complete. 2023-09-30T22:29:00.608 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:00.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.615+0000 7fbf33b67700 1 -- 172.21.15.40:0/2297940645 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbf2c066d60 con 0x7fbf2c131020 2023-09-30T22:29:00.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.615+0000 7fbf227fc700 1 -- 172.21.15.40:0/2297940645 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbf2401bcf0 con 0x7fbf2c131020 2023-09-30T22:29:00.616 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:00.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.617+0000 7fbf33b67700 1 -- 172.21.15.40:0/2297940645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf2c131020 msgr2=0x7fbf2c06d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.617+0000 7fbf33b67700 1 --2- 172.21.15.40:0/2297940645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf2c131020 0x7fbf2c06d740 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fbf24003f50 tx=0x7fbf24004ad0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.617+0000 7fbf33b67700 1 -- 172.21.15.40:0/2297940645 shutdown_connections 2023-09-30T22:29:00.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.617+0000 7fbf33b67700 1 --2- 172.21.15.40:0/2297940645 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbf2c095430 0x7fbf2c0700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.617+0000 7fbf33b67700 1 --2- 172.21.15.40:0/2297940645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf2c131020 0x7fbf2c06d740 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.617+0000 7fbf33b67700 1 --2- 172.21.15.40:0/2297940645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf2c1306b0 0x7fbf2c06d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.617+0000 7fbf33b67700 1 -- 172.21.15.40:0/2297940645 >> 172.21.15.40:0/2297940645 conn(0x7fbf2c0a2ff0 msgr2=0x7fbf2c0976c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:00.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.617+0000 7fbf33b67700 1 -- 172.21.15.40:0/2297940645 shutdown_connections 2023-09-30T22:29:00.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:00.618+0000 7fbf33b67700 1 -- 172.21.15.40:0/2297940645 wait complete. 2023-09-30T22:29:00.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:01.504 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:01.542 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:01.609 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:01.631 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:01.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.655+0000 7f6a741b5700 1 Processor -- start 2023-09-30T22:29:01.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.655+0000 7f6a741b5700 1 -- start start 2023-09-30T22:29:01.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.656+0000 7f6a741b5700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6a6c09d920 0x7f6a6c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.656+0000 7f6a741b5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a6c09f0f0 0x7f6a6c09e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.656+0000 7f6a741b5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6a6c133ca0 0x7f6a6c134110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.656+0000 7f6a741b5700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a6c06b4c0 con 0x7f6a6c09d920 2023-09-30T22:29:01.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.656+0000 7f6a741b5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6c09a8f0 con 0x7f6a6c09f0f0 2023-09-30T22:29:01.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.656+0000 7f6a741b5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6c09f940 con 0x7f6a6c133ca0 2023-09-30T22:29:01.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.656+0000 7f6a72752700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6a6c133ca0 0x7f6a6c134110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.656+0000 7f6a72752700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6a6c133ca0 0x7f6a6c134110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58108/0 (socket says 172.21.15.40:58108) 2023-09-30T22:29:01.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.656+0000 7f6a71750700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a6c09f0f0 0x7f6a6c09e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.656+0000 7f6a72752700 1 -- 172.21.15.40:0/1214489795 learned_addr learned my addr 172.21.15.40:0/1214489795 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:01.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.657+0000 7f6a71f51700 1 --2- 172.21.15.40:0/1214489795 >> v2:172.21.15.40:3300/0 conn(0x7f6a6c09d920 0x7f6a6c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.657+0000 7f6a72752700 1 -- 172.21.15.40:0/1214489795 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a6c09f0f0 msgr2=0x7f6a6c09e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:01.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.657+0000 7f6a72752700 1 --2- 172.21.15.40:0/1214489795 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a6c09f0f0 0x7f6a6c09e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.657+0000 7f6a72752700 1 -- 172.21.15.40:0/1214489795 >> v2:172.21.15.40:3300/0 conn(0x7f6a6c09d920 msgr2=0x7f6a6c09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:01.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.657+0000 7f6a72752700 1 --2- 172.21.15.40:0/1214489795 >> v2:172.21.15.40:3300/0 conn(0x7f6a6c09d920 0x7f6a6c09dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.657+0000 7f6a72752700 1 -- 172.21.15.40:0/1214489795 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6c09f6e0 con 0x7f6a6c133ca0 2023-09-30T22:29:01.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.657+0000 7f6a71750700 1 --2- 172.21.15.40:0/1214489795 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a6c09f0f0 0x7f6a6c09e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:01.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.657+0000 7f6a72752700 1 --2- 172.21.15.40:0/1214489795 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6a6c133ca0 0x7f6a6c134110 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f6a64009e80 tx=0x7f6a6400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52cf0306de64d090 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:01.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.657+0000 7f6a70f4f700 1 -- 172.21.15.40:0/1214489795 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6400e070 con 0x7f6a6c133ca0 2023-09-30T22:29:01.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.657+0000 7f6a70f4f700 1 -- 172.21.15.40:0/1214489795 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6400b8d0 con 0x7f6a6c133ca0 2023-09-30T22:29:01.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.657+0000 7f6a70f4f700 1 -- 172.21.15.40:0/1214489795 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6400bc40 con 0x7f6a6c133ca0 2023-09-30T22:29:01.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.658+0000 7f6a741b5700 1 -- 172.21.15.40:0/1214489795 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6a6c133ca0 msgr2=0x7f6a6c134110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.658+0000 7f6a741b5700 1 --2- 172.21.15.40:0/1214489795 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6a6c133ca0 0x7f6a6c134110 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f6a64009e80 tx=0x7f6a6400b330 comp rx=0 tx=0).stop 2023-09-30T22:29:01.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.659+0000 7f6a741b5700 1 -- 172.21.15.40:0/1214489795 shutdown_connections 2023-09-30T22:29:01.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.659+0000 7f6a741b5700 1 --2- 172.21.15.40:0/1214489795 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6a6c133ca0 0x7f6a6c134110 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.659+0000 7f6a741b5700 1 --2- 172.21.15.40:0/1214489795 >> v2:172.21.15.40:3300/0 conn(0x7f6a6c09d920 0x7f6a6c09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.659+0000 7f6a741b5700 1 --2- 172.21.15.40:0/1214489795 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a6c09f0f0 0x7f6a6c09e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.659+0000 7f6a741b5700 1 -- 172.21.15.40:0/1214489795 >> 172.21.15.40:0/1214489795 conn(0x7f6a6c09fb20 msgr2=0x7f6a6c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:01.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.659+0000 7f6a741b5700 1 -- 172.21.15.40:0/1214489795 shutdown_connections 2023-09-30T22:29:01.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.659+0000 7f6a741b5700 1 -- 172.21.15.40:0/1214489795 wait complete. 2023-09-30T22:29:01.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.661+0000 7f6a741b5700 1 Processor -- start 2023-09-30T22:29:01.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.661+0000 7f6a741b5700 1 -- start start 2023-09-30T22:29:01.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.661+0000 7f6a741b5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6a6c09d920 0x7f6a6c122b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.661+0000 7f6a741b5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a6c133ca0 0x7f6a6c123050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.661+0000 7f6a741b5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a6c123590 0x7f6a6c1c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.661+0000 7f6a741b5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6c126350 con 0x7f6a6c133ca0 2023-09-30T22:29:01.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.661+0000 7f6a741b5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6c124830 con 0x7f6a6c123590 2023-09-30T22:29:01.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.661+0000 7f6a741b5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6c0a2d70 con 0x7f6a6c09d920 2023-09-30T22:29:01.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.662+0000 7f6a71f51700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6a6c09d920 0x7f6a6c122b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.662+0000 7f6a71f51700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6a6c09d920 0x7f6a6c122b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58116/0 (socket says 172.21.15.40:58116) 2023-09-30T22:29:01.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.662+0000 7f6a71f51700 1 -- 172.21.15.40:0/2309679329 learned_addr learned my addr 172.21.15.40:0/2309679329 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:01.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.662+0000 7f6a71750700 1 --2- 172.21.15.40:0/2309679329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a6c133ca0 0x7f6a6c123050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.662+0000 7f6a72752700 1 --2- 172.21.15.40:0/2309679329 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a6c123590 0x7f6a6c1c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.662+0000 7f6a71f51700 1 -- 172.21.15.40:0/2309679329 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a6c123590 msgr2=0x7f6a6c1c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.662+0000 7f6a71f51700 1 --2- 172.21.15.40:0/2309679329 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a6c123590 0x7f6a6c1c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.662+0000 7f6a71f51700 1 -- 172.21.15.40:0/2309679329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a6c133ca0 msgr2=0x7f6a6c123050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.662+0000 7f6a71f51700 1 --2- 172.21.15.40:0/2309679329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a6c133ca0 0x7f6a6c123050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.662+0000 7f6a71f51700 1 -- 172.21.15.40:0/2309679329 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a5c0094a0 con 0x7f6a6c09d920 2023-09-30T22:29:01.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.662+0000 7f6a71f51700 1 --2- 172.21.15.40:0/2309679329 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6a6c09d920 0x7f6a6c122b10 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f6a6800e870 tx=0x7f6a6800eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:01.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.662+0000 7f6a627fc700 1 -- 172.21.15.40:0/2309679329 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a68005a20 con 0x7f6a6c09d920 2023-09-30T22:29:01.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.663+0000 7f6a741b5700 1 -- 172.21.15.40:0/2309679329 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a64009b30 con 0x7f6a6c09d920 2023-09-30T22:29:01.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.663+0000 7f6a627fc700 1 -- 172.21.15.40:0/2309679329 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a68005b80 con 0x7f6a6c09d920 2023-09-30T22:29:01.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.663+0000 7f6a627fc700 1 -- 172.21.15.40:0/2309679329 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a68013680 con 0x7f6a6c09d920 2023-09-30T22:29:01.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.663+0000 7f6a741b5700 1 -- 172.21.15.40:0/2309679329 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a6c133630 con 0x7f6a6c09d920 2023-09-30T22:29:01.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.663+0000 7f6a627fc700 1 -- 172.21.15.40:0/2309679329 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6a680137e0 con 0x7f6a6c09d920 2023-09-30T22:29:01.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.664+0000 7f6a627fc700 1 -- 172.21.15.40:0/2309679329 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6a6803f950 con 0x7f6a6c09d920 2023-09-30T22:29:01.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.664+0000 7f6a741b5700 1 -- 172.21.15.40:0/2309679329 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a540052e0 con 0x7f6a6c09d920 2023-09-30T22:29:01.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.670+0000 7f6a627fc700 1 -- 172.21.15.40:0/2309679329 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6a68006030 con 0x7f6a6c09d920 2023-09-30T22:29:01.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.706+0000 7f991b6d3700 1 Processor -- start 2023-09-30T22:29:01.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.706+0000 7f991b6d3700 1 -- start start 2023-09-30T22:29:01.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.707+0000 7f991b6d3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f991406fb50 0x7f9914136c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.707+0000 7f991b6d3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f99141371b0 0x7f9914139590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.707+0000 7f991b6d3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9914070830 con 0x7f991406f070 2023-09-30T22:29:01.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.707+0000 7f991b6d3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9914071af0 con 0x7f99141371b0 2023-09-30T22:29:01.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.707+0000 7f991b6d3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9914070ad0 con 0x7f991406fb50 2023-09-30T22:29:01.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.707+0000 7f9919c70700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f99141371b0 0x7f9914139590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.707+0000 7f9918c6e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f991406fb50 0x7f9914136c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.707+0000 7f9919c70700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f99141371b0 0x7f9914139590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50950/0 (socket says 172.21.15.40:50950) 2023-09-30T22:29:01.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.707+0000 7f9919c70700 1 -- 172.21.15.40:0/433310517 learned_addr learned my addr 172.21.15.40:0/433310517 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:01.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.708+0000 7f9919c70700 1 -- 172.21.15.40:0/433310517 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f991406fb50 msgr2=0x7f9914136c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:01.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.708+0000 7f9919c70700 1 --2- 172.21.15.40:0/433310517 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f991406fb50 0x7f9914136c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.708+0000 7f9919c70700 1 -- 172.21.15.40:0/433310517 >> v1:172.21.15.40:6789/0 conn(0x7f991406f070 legacy=0x7f991406f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.708+0000 7f9919c70700 1 -- 172.21.15.40:0/433310517 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9914070de0 con 0x7f99141371b0 2023-09-30T22:29:01.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.708+0000 7f9919c70700 1 --2- 172.21.15.40:0/433310517 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99141371b0 0x7f9914139590 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f990c009e50 tx=0x7f990c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df5616a81c7e3bc9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:01.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.708+0000 7f990bfff700 1 -- 172.21.15.40:0/433310517 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c00e070 con 0x7f99141371b0 2023-09-30T22:29:01.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.708+0000 7f990bfff700 1 -- 172.21.15.40:0/433310517 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990c00b910 con 0x7f99141371b0 2023-09-30T22:29:01.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.708+0000 7f990bfff700 1 -- 172.21.15.40:0/433310517 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c00bcc0 con 0x7f99141371b0 2023-09-30T22:29:01.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.709+0000 7f991b6d3700 1 -- 172.21.15.40:0/433310517 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99141371b0 msgr2=0x7f9914139590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.709+0000 7f991b6d3700 1 --2- 172.21.15.40:0/433310517 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99141371b0 0x7f9914139590 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f990c009e50 tx=0x7f990c00b330 comp rx=0 tx=0).stop 2023-09-30T22:29:01.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.709+0000 7f991b6d3700 1 -- 172.21.15.40:0/433310517 shutdown_connections 2023-09-30T22:29:01.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.709+0000 7f991b6d3700 1 --2- 172.21.15.40:0/433310517 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99141371b0 0x7f9914139590 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.709+0000 7f991b6d3700 1 --2- 172.21.15.40:0/433310517 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f991406fb50 0x7f9914136c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.709+0000 7f991b6d3700 1 -- 172.21.15.40:0/433310517 >> 172.21.15.40:0/433310517 conn(0x7f99140a41a0 msgr2=0x7f99140a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:01.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.709+0000 7f991b6d3700 1 -- 172.21.15.40:0/433310517 shutdown_connections 2023-09-30T22:29:01.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.709+0000 7f991b6d3700 1 -- 172.21.15.40:0/433310517 wait complete. 2023-09-30T22:29:01.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.710+0000 7f991b6d3700 1 Processor -- start 2023-09-30T22:29:01.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.710+0000 7f991b6d3700 1 -- start start 2023-09-30T22:29:01.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.711+0000 7f991b6d3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f991406f070 0x7f9914134a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.711+0000 7f991b6d3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f991406fb50 0x7f9914134f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.711+0000 7f991b6d3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99141371b0 0x7f99141354b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.711+0000 7f991b6d3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991412dab0 con 0x7f991406fb50 2023-09-30T22:29:01.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.711+0000 7f991b6d3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9914136b10 con 0x7f99141371b0 2023-09-30T22:29:01.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.711+0000 7f991b6d3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f991412c2d0 con 0x7f991406f070 2023-09-30T22:29:01.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.711+0000 7f9919c70700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99141371b0 0x7f99141354b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.711+0000 7f9919c70700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99141371b0 0x7f99141354b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:38962/0 (socket says 172.21.15.40:38962) 2023-09-30T22:29:01.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.711+0000 7f9919c70700 1 -- 172.21.15.40:0/493506598 learned_addr learned my addr 172.21.15.40:0/493506598 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:01.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.711+0000 7f991946f700 1 --2- 172.21.15.40:0/493506598 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f991406f070 0x7f9914134a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.711+0000 7f9918c6e700 1 --2- 172.21.15.40:0/493506598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f991406fb50 0x7f9914134f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.711+0000 7f991946f700 1 -- 172.21.15.40:0/493506598 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99141371b0 msgr2=0x7f99141354b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.711+0000 7f991946f700 1 --2- 172.21.15.40:0/493506598 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99141371b0 0x7f99141354b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.711+0000 7f991946f700 1 -- 172.21.15.40:0/493506598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f991406fb50 msgr2=0x7f9914134f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.711+0000 7f991946f700 1 --2- 172.21.15.40:0/493506598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f991406fb50 0x7f9914134f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.712+0000 7f991946f700 1 -- 172.21.15.40:0/493506598 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f990c009b30 con 0x7f991406f070 2023-09-30T22:29:01.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.712+0000 7f991946f700 1 --2- 172.21.15.40:0/493506598 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f991406f070 0x7f9914134a30 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9910000f60 tx=0x7f991000c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:01.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.712+0000 7f9909ffb700 1 -- 172.21.15.40:0/493506598 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99100052d0 con 0x7f991406f070 2023-09-30T22:29:01.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.712+0000 7f9909ffb700 1 -- 172.21.15.40:0/493506598 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9910005430 con 0x7f991406f070 2023-09-30T22:29:01.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.712+0000 7f9909ffb700 1 -- 172.21.15.40:0/493506598 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99100038c0 con 0x7f991406f070 2023-09-30T22:29:01.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.713+0000 7f991b6d3700 1 -- 172.21.15.40:0/493506598 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9914132040 con 0x7f991406f070 2023-09-30T22:29:01.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.713+0000 7f991b6d3700 1 -- 172.21.15.40:0/493506598 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f991412e050 con 0x7f991406f070 2023-09-30T22:29:01.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.713+0000 7f9909ffb700 1 -- 172.21.15.40:0/493506598 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9910003a20 con 0x7f991406f070 2023-09-30T22:29:01.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.714+0000 7f9909ffb700 1 -- 172.21.15.40:0/493506598 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f991003ea30 con 0x7f991406f070 2023-09-30T22:29:01.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.714+0000 7f991b6d3700 1 -- 172.21.15.40:0/493506598 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f991412de70 con 0x7f991406f070 2023-09-30T22:29:01.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.723+0000 7f9909ffb700 1 -- 172.21.15.40:0/493506598 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9910017080 con 0x7f991406f070 2023-09-30T22:29:01.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.758+0000 7f46b2ba8700 1 Processor -- start 2023-09-30T22:29:01.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.758+0000 7f46b2ba8700 1 -- start start 2023-09-30T22:29:01.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.759+0000 7f46b2ba8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46ac09f0f0 0x7f46ac138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.759+0000 7f46b2ba8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f46ac09e400 0x7f46ac13b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.759+0000 7f46b2ba8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46ac09f940 con 0x7f46ac09d920 2023-09-30T22:29:01.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.759+0000 7f46b2ba8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac06b4c0 con 0x7f46ac09f0f0 2023-09-30T22:29:01.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.759+0000 7f46b2ba8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac09a8f0 con 0x7f46ac09e400 2023-09-30T22:29:01.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.759+0000 7f46b1145700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f46ac09e400 0x7f46ac13b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.759+0000 7f46b1145700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f46ac09e400 0x7f46ac13b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58160/0 (socket says 172.21.15.40:58160) 2023-09-30T22:29:01.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.759+0000 7f46b1145700 1 -- 172.21.15.40:0/2885090638 learned_addr learned my addr 172.21.15.40:0/2885090638 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:01.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.759+0000 7f46b0944700 1 --1- 172.21.15.40:0/2885090638 >> v1:172.21.15.40:6789/0 conn(0x7f46ac09d920 0x7f46ac09dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51382/0 (socket says 172.21.15.40:51382) 2023-09-30T22:29:01.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.759+0000 7f46abfff700 1 --2- 172.21.15.40:0/2885090638 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46ac09f0f0 0x7f46ac138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.759+0000 7f46b1145700 1 -- 172.21.15.40:0/2885090638 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46ac09f0f0 msgr2=0x7f46ac138ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:01.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.759+0000 7f46b1145700 1 --2- 172.21.15.40:0/2885090638 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46ac09f0f0 0x7f46ac138ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.759+0000 7f46b1145700 1 -- 172.21.15.40:0/2885090638 >> v1:172.21.15.40:6789/0 conn(0x7f46ac09d920 legacy=0x7f46ac09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.759+0000 7f46b1145700 1 -- 172.21.15.40:0/2885090638 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ac09f6e0 con 0x7f46ac09e400 2023-09-30T22:29:01.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.759+0000 7f46ab7fe700 1 -- 172.21.15.40:0/2885090638 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1188593811 0 0) 0x7f46ac09f940 con 0x7f46ac09d920 2023-09-30T22:29:01.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.760+0000 7f46b1145700 1 --2- 172.21.15.40:0/2885090638 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f46ac09e400 0x7f46ac13b430 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f46a4009eb0 tx=0x7f46a400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=392f89fe5b5bdd06 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:01.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.760+0000 7f46ab7fe700 1 -- 172.21.15.40:0/2885090638 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a400e070 con 0x7f46ac09e400 2023-09-30T22:29:01.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.760+0000 7f46ab7fe700 1 -- 172.21.15.40:0/2885090638 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a400b8d0 con 0x7f46ac09e400 2023-09-30T22:29:01.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.760+0000 7f46ab7fe700 1 -- 172.21.15.40:0/2885090638 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a400bc80 con 0x7f46ac09e400 2023-09-30T22:29:01.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.761+0000 7f46b2ba8700 1 -- 172.21.15.40:0/2885090638 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f46ac09e400 msgr2=0x7f46ac13b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.761+0000 7f46b2ba8700 1 --2- 172.21.15.40:0/2885090638 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f46ac09e400 0x7f46ac13b430 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f46a4009eb0 tx=0x7f46a400b330 comp rx=0 tx=0).stop 2023-09-30T22:29:01.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.761+0000 7f46b2ba8700 1 -- 172.21.15.40:0/2885090638 shutdown_connections 2023-09-30T22:29:01.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.761+0000 7f46b2ba8700 1 --2- 172.21.15.40:0/2885090638 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f46ac09e400 0x7f46ac13b430 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.761+0000 7f46b2ba8700 1 --2- 172.21.15.40:0/2885090638 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46ac09f0f0 0x7f46ac138ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.761+0000 7f46b2ba8700 1 -- 172.21.15.40:0/2885090638 >> 172.21.15.40:0/2885090638 conn(0x7f46ac09fb20 msgr2=0x7f46ac09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:01.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.765+0000 7f46b2ba8700 1 -- 172.21.15.40:0/2885090638 shutdown_connections 2023-09-30T22:29:01.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.765+0000 7f46b2ba8700 1 -- 172.21.15.40:0/2885090638 wait complete. 2023-09-30T22:29:01.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.765+0000 7f46b2ba8700 1 Processor -- start 2023-09-30T22:29:01.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.766+0000 7f46b2ba8700 1 -- start start 2023-09-30T22:29:01.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.766+0000 7f46b2ba8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46ac09d920 0x7f46ac1272e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.766+0000 7f46b2ba8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46ac09e400 0x7f46ac127820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.766+0000 7f46b2ba8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f46ac127d60 0x7f46ac139d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.766+0000 7f46b2ba8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac12a940 con 0x7f46ac09d920 2023-09-30T22:29:01.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.766+0000 7f46b2ba8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac09c9e0 con 0x7f46ac09e400 2023-09-30T22:29:01.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.766+0000 7f46b2ba8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac12ab20 con 0x7f46ac127d60 2023-09-30T22:29:01.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.766+0000 7f46b1145700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f46ac127d60 0x7f46ac139d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.766+0000 7f46b0944700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46ac09d920 0x7f46ac1272e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.766+0000 7f46b1145700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f46ac127d60 0x7f46ac139d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58164/0 (socket says 172.21.15.40:58164) 2023-09-30T22:29:01.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.766+0000 7f46b1145700 1 -- 172.21.15.40:0/1772615245 learned_addr learned my addr 172.21.15.40:0/1772615245 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:01.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.767+0000 7f46abfff700 1 --2- 172.21.15.40:0/1772615245 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46ac09e400 0x7f46ac127820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.767+0000 7f46b1145700 1 -- 172.21.15.40:0/1772615245 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46ac09e400 msgr2=0x7f46ac127820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.767+0000 7f46b1145700 1 --2- 172.21.15.40:0/1772615245 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46ac09e400 0x7f46ac127820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.767+0000 7f46b1145700 1 -- 172.21.15.40:0/1772615245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46ac09d920 msgr2=0x7f46ac1272e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.767+0000 7f46b1145700 1 --2- 172.21.15.40:0/1772615245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46ac09d920 0x7f46ac1272e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.767+0000 7f46b1145700 1 -- 172.21.15.40:0/1772615245 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a4009b30 con 0x7f46ac127d60 2023-09-30T22:29:01.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.767+0000 7f46abfff700 1 --2- 172.21.15.40:0/1772615245 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46ac09e400 0x7f46ac127820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:01.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.767+0000 7f46b1145700 1 --2- 172.21.15.40:0/1772615245 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f46ac127d60 0x7f46ac139d50 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f46a400b680 tx=0x7f46a4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:01.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.767+0000 7f46a97fa700 1 -- 172.21.15.40:0/1772615245 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a4004450 con 0x7f46ac127d60 2023-09-30T22:29:01.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.767+0000 7f46a97fa700 1 -- 172.21.15.40:0/1772615245 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a40045d0 con 0x7f46ac127d60 2023-09-30T22:29:01.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.767+0000 7f46a97fa700 1 -- 172.21.15.40:0/1772615245 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a40094d0 con 0x7f46ac127d60 2023-09-30T22:29:01.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.767+0000 7f46b2ba8700 1 -- 172.21.15.40:0/1772615245 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46ac129000 con 0x7f46ac127d60 2023-09-30T22:29:01.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.767+0000 7f46b2ba8700 1 -- 172.21.15.40:0/1772615245 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46ac0a30d0 con 0x7f46ac127d60 2023-09-30T22:29:01.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.768+0000 7f46a97fa700 1 -- 172.21.15.40:0/1772615245 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f46a4025450 con 0x7f46ac127d60 2023-09-30T22:29:01.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.769+0000 7f46a97fa700 1 -- 172.21.15.40:0/1772615245 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f46a4042990 con 0x7f46ac127d60 2023-09-30T22:29:01.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.769+0000 7f46b2ba8700 1 -- 172.21.15.40:0/1772615245 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46ac062380 con 0x7f46ac127d60 2023-09-30T22:29:01.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.777+0000 7f46a97fa700 1 -- 172.21.15.40:0/1772615245 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f46a4046060 con 0x7f46ac127d60 2023-09-30T22:29:01.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.797+0000 7fb073c84700 1 Processor -- start 2023-09-30T22:29:01.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.797+0000 7fb073c84700 1 -- start start 2023-09-30T22:29:01.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.798+0000 7fb073c84700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb06c06f3a0 0x7fb06c06c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.798+0000 7fb073c84700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb06c09fbb0 0x7fb06c06ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.798+0000 7fb073c84700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb06c0a0780 con 0x7fb06c06d410 2023-09-30T22:29:01.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.798+0000 7fb073c84700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb06c09ff80 con 0x7fb06c09fbb0 2023-09-30T22:29:01.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.798+0000 7fb073c84700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c0a0590 con 0x7fb06c06f3a0 2023-09-30T22:29:01.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.798+0000 7fb07121f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb06c09fbb0 0x7fb06c06ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.798+0000 7fb07121f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb06c09fbb0 0x7fb06c06ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50980/0 (socket says 172.21.15.40:50980) 2023-09-30T22:29:01.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.798+0000 7fb07121f700 1 -- 172.21.15.40:0/239326117 learned_addr learned my addr 172.21.15.40:0/239326117 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:01.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.798+0000 7fb072221700 1 --1- 172.21.15.40:0/239326117 >> v1:172.21.15.40:6789/0 conn(0x7fb06c06d410 0x7fb06c13a380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51386/0 (socket says 172.21.15.40:51386) 2023-09-30T22:29:01.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.798+0000 7fb071a20700 1 --2- 172.21.15.40:0/239326117 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb06c06f3a0 0x7fb06c06c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.798+0000 7fb07121f700 1 -- 172.21.15.40:0/239326117 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb06c06f3a0 msgr2=0x7fb06c06c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:01.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.798+0000 7fb07121f700 1 --2- 172.21.15.40:0/239326117 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb06c06f3a0 0x7fb06c06c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.798+0000 7fb070a1e700 1 -- 172.21.15.40:0/239326117 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 163606303 0 0) 0x7fb06c0a0780 con 0x7fb06c06d410 2023-09-30T22:29:01.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.798+0000 7fb07121f700 1 -- 172.21.15.40:0/239326117 >> v1:172.21.15.40:6789/0 conn(0x7fb06c06d410 legacy=0x7fb06c13a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.798+0000 7fb07121f700 1 -- 172.21.15.40:0/239326117 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb06c06df90 con 0x7fb06c09fbb0 2023-09-30T22:29:01.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.799+0000 7fb07121f700 1 --2- 172.21.15.40:0/239326117 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb06c09fbb0 0x7fb06c06ced0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fb05c0098f0 tx=0x7fb05c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f9cea476f49768 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:01.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.799+0000 7fb070a1e700 1 -- 172.21.15.40:0/239326117 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05c00b8a0 con 0x7fb06c09fbb0 2023-09-30T22:29:01.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.799+0000 7fb070a1e700 1 -- 172.21.15.40:0/239326117 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05c00ba00 con 0x7fb06c09fbb0 2023-09-30T22:29:01.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.799+0000 7fb070a1e700 1 -- 172.21.15.40:0/239326117 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05c00bd90 con 0x7fb06c09fbb0 2023-09-30T22:29:01.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.800+0000 7fb073c84700 1 -- 172.21.15.40:0/239326117 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb06c09fbb0 msgr2=0x7fb06c06ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.800+0000 7fb073c84700 1 --2- 172.21.15.40:0/239326117 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb06c09fbb0 0x7fb06c06ced0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fb05c0098f0 tx=0x7fb05c009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:01.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.800+0000 7fb073c84700 1 -- 172.21.15.40:0/239326117 shutdown_connections 2023-09-30T22:29:01.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.800+0000 7fb073c84700 1 --2- 172.21.15.40:0/239326117 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb06c06f3a0 0x7fb06c06c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.800+0000 7fb073c84700 1 --2- 172.21.15.40:0/239326117 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb06c09fbb0 0x7fb06c06ced0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.800+0000 7fb073c84700 1 -- 172.21.15.40:0/239326117 >> 172.21.15.40:0/239326117 conn(0x7fb06c0a41a0 msgr2=0x7fb06c0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:01.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.800+0000 7fb073c84700 1 -- 172.21.15.40:0/239326117 shutdown_connections 2023-09-30T22:29:01.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.800+0000 7fb073c84700 1 -- 172.21.15.40:0/239326117 wait complete. 2023-09-30T22:29:01.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.801+0000 7fb073c84700 1 Processor -- start 2023-09-30T22:29:01.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.801+0000 7fb073c84700 1 -- start start 2023-09-30T22:29:01.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.801+0000 7fb073c84700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb06c06d410 0x7fb06c08bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.801+0000 7fb073c84700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb06c06f3a0 0x7fb06c08c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.801+0000 7fb073c84700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb06c09fbb0 0x7fb06c08c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.801+0000 7fb073c84700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c08e290 con 0x7fb06c09fbb0 2023-09-30T22:29:01.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.801+0000 7fb073c84700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c08ddf0 con 0x7fb06c06d410 2023-09-30T22:29:01.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.801+0000 7fb073c84700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb06c071eb0 con 0x7fb06c06f3a0 2023-09-30T22:29:01.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.802+0000 7fb072221700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb06c09fbb0 0x7fb06c08c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.802+0000 7fb072221700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb06c09fbb0 0x7fb06c08c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50990/0 (socket says 172.21.15.40:50990) 2023-09-30T22:29:01.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.802+0000 7fb072221700 1 -- 172.21.15.40:0/503070758 learned_addr learned my addr 172.21.15.40:0/503070758 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:01.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.802+0000 7fb07121f700 1 --2- 172.21.15.40:0/503070758 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb06c06f3a0 0x7fb06c08c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.802+0000 7fb071a20700 1 --2- 172.21.15.40:0/503070758 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb06c06d410 0x7fb06c08bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.802+0000 7fb071a20700 1 -- 172.21.15.40:0/503070758 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb06c06f3a0 msgr2=0x7fb06c08c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.802+0000 7fb071a20700 1 --2- 172.21.15.40:0/503070758 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb06c06f3a0 0x7fb06c08c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.802+0000 7fb071a20700 1 -- 172.21.15.40:0/503070758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb06c09fbb0 msgr2=0x7fb06c08c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.802+0000 7fb071a20700 1 --2- 172.21.15.40:0/503070758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb06c09fbb0 0x7fb06c08c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.802+0000 7fb071a20700 1 -- 172.21.15.40:0/503070758 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb05c009550 con 0x7fb06c06d410 2023-09-30T22:29:01.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.802+0000 7fb072221700 1 --2- 172.21.15.40:0/503070758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb06c09fbb0 0x7fb06c08c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:01.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.802+0000 7fb071a20700 1 --2- 172.21.15.40:0/503070758 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb06c06d410 0x7fb06c08bbe0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb06800d5f0 tx=0x7fb06800d900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:01.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.802+0000 7fb0627fc700 1 -- 172.21.15.40:0/503070758 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0680125f0 con 0x7fb06c06d410 2023-09-30T22:29:01.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.802+0000 7fb0627fc700 1 -- 172.21.15.40:0/503070758 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb068012750 con 0x7fb06c06d410 2023-09-30T22:29:01.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.802+0000 7fb073c84700 1 -- 172.21.15.40:0/503070758 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb06c08eaf0 con 0x7fb06c06d410 2023-09-30T22:29:01.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.802+0000 7fb0627fc700 1 -- 172.21.15.40:0/503070758 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb068012ac0 con 0x7fb06c06d410 2023-09-30T22:29:01.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.803+0000 7fb073c84700 1 -- 172.21.15.40:0/503070758 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb06c08d180 con 0x7fb06c06d410 2023-09-30T22:29:01.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.803+0000 7fb0627fc700 1 -- 172.21.15.40:0/503070758 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb068012c20 con 0x7fb06c06d410 2023-09-30T22:29:01.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.803+0000 7fb073c84700 1 -- 172.21.15.40:0/503070758 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb06c062380 con 0x7fb06c06d410 2023-09-30T22:29:01.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.804+0000 7fb0627fc700 1 -- 172.21.15.40:0/503070758 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb06803f6f0 con 0x7fb06c06d410 2023-09-30T22:29:01.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.812+0000 7fb0627fc700 1 -- 172.21.15.40:0/503070758 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb06801a720 con 0x7fb06c06d410 2023-09-30T22:29:01.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.903+0000 7f6a741b5700 1 -- 172.21.15.40:0/2309679329 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6a54005590 con 0x7f6a6c09d920 2023-09-30T22:29:01.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.903+0000 7f6a627fc700 1 -- 172.21.15.40:0/2309679329 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6a68029030 con 0x7f6a6c09d920 2023-09-30T22:29:01.904 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:01.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.905+0000 7f6a741b5700 1 -- 172.21.15.40:0/2309679329 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6a6c09d920 msgr2=0x7f6a6c122b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.905+0000 7f6a741b5700 1 --2- 172.21.15.40:0/2309679329 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6a6c09d920 0x7f6a6c122b10 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f6a6800e870 tx=0x7f6a6800eb80 comp rx=0 tx=0).stop 2023-09-30T22:29:01.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.905+0000 7f6a741b5700 1 -- 172.21.15.40:0/2309679329 shutdown_connections 2023-09-30T22:29:01.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.905+0000 7f6a741b5700 1 --2- 172.21.15.40:0/2309679329 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6a6c09d920 0x7f6a6c122b10 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.905+0000 7f6a741b5700 1 --2- 172.21.15.40:0/2309679329 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a6c123590 0x7f6a6c1c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.905+0000 7f6a741b5700 1 --2- 172.21.15.40:0/2309679329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a6c133ca0 0x7f6a6c123050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.905+0000 7f6a741b5700 1 -- 172.21.15.40:0/2309679329 >> 172.21.15.40:0/2309679329 conn(0x7f6a6c09fb20 msgr2=0x7f6a6c0a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:01.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.905+0000 7f6a741b5700 1 -- 172.21.15.40:0/2309679329 shutdown_connections 2023-09-30T22:29:01.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.905+0000 7f6a741b5700 1 -- 172.21.15.40:0/2309679329 wait complete. 2023-09-30T22:29:01.918 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:01.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.966+0000 7f991b6d3700 1 -- 172.21.15.40:0/493506598 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9914062380 con 0x7f991406f070 2023-09-30T22:29:01.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.966+0000 7f9909ffb700 1 -- 172.21.15.40:0/493506598 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9910011590 con 0x7f991406f070 2023-09-30T22:29:01.967 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:01.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.969+0000 7f991b6d3700 1 -- 172.21.15.40:0/493506598 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f991406f070 msgr2=0x7f9914134a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.969+0000 7f991b6d3700 1 --2- 172.21.15.40:0/493506598 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f991406f070 0x7f9914134a30 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9910000f60 tx=0x7f991000c730 comp rx=0 tx=0).stop 2023-09-30T22:29:01.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.969+0000 7f991b6d3700 1 -- 172.21.15.40:0/493506598 shutdown_connections 2023-09-30T22:29:01.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.969+0000 7f991b6d3700 1 --2- 172.21.15.40:0/493506598 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f991406f070 0x7f9914134a30 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.969+0000 7f991b6d3700 1 --2- 172.21.15.40:0/493506598 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99141371b0 0x7f99141354b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.969+0000 7f991b6d3700 1 --2- 172.21.15.40:0/493506598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f991406fb50 0x7f9914134f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.969+0000 7f991b6d3700 1 -- 172.21.15.40:0/493506598 >> 172.21.15.40:0/493506598 conn(0x7f99140a41a0 msgr2=0x7f99140a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:01.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.969+0000 7f991b6d3700 1 -- 172.21.15.40:0/493506598 shutdown_connections 2023-09-30T22:29:01.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:01.969+0000 7f991b6d3700 1 -- 172.21.15.40:0/493506598 wait complete. 2023-09-30T22:29:01.982 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:02.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:02.011+0000 7fb073c84700 1 -- 172.21.15.40:0/503070758 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb06c06e3c0 con 0x7fb06c06d410 2023-09-30T22:29:02.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:02.011+0000 7fb0627fc700 1 -- 172.21.15.40:0/503070758 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb068011340 con 0x7fb06c06d410 2023-09-30T22:29:02.012 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:02.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:02.013+0000 7fb073c84700 1 -- 172.21.15.40:0/503070758 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb06c06d410 msgr2=0x7fb06c08bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:02.013+0000 7fb073c84700 1 --2- 172.21.15.40:0/503070758 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb06c06d410 0x7fb06c08bbe0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb06800d5f0 tx=0x7fb06800d900 comp rx=0 tx=0).stop 2023-09-30T22:29:02.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:02.013+0000 7fb073c84700 1 -- 172.21.15.40:0/503070758 shutdown_connections 2023-09-30T22:29:02.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:02.013+0000 7fb073c84700 1 --2- 172.21.15.40:0/503070758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb06c09fbb0 0x7fb06c08c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:02.013+0000 7fb073c84700 1 --2- 172.21.15.40:0/503070758 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb06c06d410 0x7fb06c08bbe0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:02.013+0000 7fb073c84700 1 --2- 172.21.15.40:0/503070758 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb06c06f3a0 0x7fb06c08c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:02.013+0000 7fb073c84700 1 -- 172.21.15.40:0/503070758 >> 172.21.15.40:0/503070758 conn(0x7fb06c0a41a0 msgr2=0x7fb06c13af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:02.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:02.013+0000 7fb073c84700 1 -- 172.21.15.40:0/503070758 shutdown_connections 2023-09-30T22:29:02.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:02.013+0000 7fb073c84700 1 -- 172.21.15.40:0/503070758 wait complete. 2023-09-30T22:29:02.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:02.016+0000 7f46b2ba8700 1 -- 172.21.15.40:0/1772615245 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f46ac074720 con 0x7f46ac127d60 2023-09-30T22:29:02.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:02.017+0000 7f46a97fa700 1 -- 172.21.15.40:0/1772615245 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f46a4023950 con 0x7f46ac127d60 2023-09-30T22:29:02.018 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:02.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:02.019+0000 7f46b2ba8700 1 -- 172.21.15.40:0/1772615245 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f46ac127d60 msgr2=0x7f46ac139d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:02.019+0000 7f46b2ba8700 1 --2- 172.21.15.40:0/1772615245 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f46ac127d60 0x7f46ac139d50 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f46a400b680 tx=0x7f46a4004ad0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:02.019+0000 7f46b2ba8700 1 -- 172.21.15.40:0/1772615245 shutdown_connections 2023-09-30T22:29:02.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:02.019+0000 7f46b2ba8700 1 --2- 172.21.15.40:0/1772615245 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f46ac127d60 0x7f46ac139d50 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:02.019+0000 7f46b2ba8700 1 --2- 172.21.15.40:0/1772615245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46ac09d920 0x7f46ac1272e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:02.019+0000 7f46b2ba8700 1 --2- 172.21.15.40:0/1772615245 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46ac09e400 0x7f46ac127820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:02.019+0000 7f46b2ba8700 1 -- 172.21.15.40:0/1772615245 >> 172.21.15.40:0/1772615245 conn(0x7f46ac09fb20 msgr2=0x7f46ac0707d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:02.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:02.019+0000 7f46b2ba8700 1 -- 172.21.15.40:0/1772615245 shutdown_connections 2023-09-30T22:29:02.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:02.019+0000 7f46b2ba8700 1 -- 172.21.15.40:0/1772615245 wait complete. 2023-09-30T22:29:02.027 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:02.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:02.920 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:02.983 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:03.028 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:03.034 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:03.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.064+0000 7f00503bd700 1 Processor -- start 2023-09-30T22:29:03.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.064+0000 7f00503bd700 1 -- start start 2023-09-30T22:29:03.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.064+0000 7f00503bd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0048133e00 0x7f00481341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.064+0000 7f00503bd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f004809d400 0x7f004809d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.064+0000 7f00503bd700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0048133940 con 0x7f004809dd70 2023-09-30T22:29:03.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.064+0000 7f00503bd700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f004809f0d0 con 0x7f004809d400 2023-09-30T22:29:03.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.064+0000 7f00503bd700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f004809e210 con 0x7f0048133e00 2023-09-30T22:29:03.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.064+0000 7f004d958700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f004809d400 0x7f004809d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.065+0000 7f004d958700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f004809d400 0x7f004809d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50992/0 (socket says 172.21.15.40:50992) 2023-09-30T22:29:03.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.065+0000 7f004d958700 1 -- 172.21.15.40:0/2157526244 learned_addr learned my addr 172.21.15.40:0/2157526244 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:03.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.065+0000 7f004e159700 1 --2- 172.21.15.40:0/2157526244 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0048133e00 0x7f00481341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.065+0000 7f004e159700 1 -- 172.21.15.40:0/2157526244 >> v2:172.21.15.40:3300/0 conn(0x7f004809d400 msgr2=0x7f004809d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:03.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.065+0000 7f004e159700 1 --2- 172.21.15.40:0/2157526244 >> v2:172.21.15.40:3300/0 conn(0x7f004809d400 0x7f004809d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.065+0000 7f004e159700 1 -- 172.21.15.40:0/2157526244 >> v1:172.21.15.40:6789/0 conn(0x7f004809dd70 legacy=0x7f004813ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.065+0000 7f004e159700 1 -- 172.21.15.40:0/2157526244 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0048133be0 con 0x7f0048133e00 2023-09-30T22:29:03.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.065+0000 7f004d958700 1 --2- 172.21.15.40:0/2157526244 >> v2:172.21.15.40:3300/0 conn(0x7f004809d400 0x7f004809d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:03.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.065+0000 7f004e159700 1 --2- 172.21.15.40:0/2157526244 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0048133e00 0x7f00481341d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f0044009840 tx=0x7f0044009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7df5fa8d48529eda server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:03.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.065+0000 7f004d157700 1 -- 172.21.15.40:0/2157526244 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0044011830 con 0x7f0048133e00 2023-09-30T22:29:03.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.065+0000 7f004d157700 1 -- 172.21.15.40:0/2157526244 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0044011990 con 0x7f0048133e00 2023-09-30T22:29:03.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.065+0000 7f004d157700 1 -- 172.21.15.40:0/2157526244 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0044011d20 con 0x7f0048133e00 2023-09-30T22:29:03.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.066+0000 7f00503bd700 1 -- 172.21.15.40:0/2157526244 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0048133e00 msgr2=0x7f00481341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.066+0000 7f00503bd700 1 --2- 172.21.15.40:0/2157526244 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0048133e00 0x7f00481341d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f0044009840 tx=0x7f0044009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:03.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.066+0000 7f00503bd700 1 -- 172.21.15.40:0/2157526244 shutdown_connections 2023-09-30T22:29:03.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.066+0000 7f00503bd700 1 --2- 172.21.15.40:0/2157526244 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0048133e00 0x7f00481341d0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.066+0000 7f00503bd700 1 --2- 172.21.15.40:0/2157526244 >> v2:172.21.15.40:3300/0 conn(0x7f004809d400 0x7f004809d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.066+0000 7f00503bd700 1 -- 172.21.15.40:0/2157526244 >> 172.21.15.40:0/2157526244 conn(0x7f00480a2a00 msgr2=0x7f00480a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:03.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.066+0000 7f00503bd700 1 -- 172.21.15.40:0/2157526244 shutdown_connections 2023-09-30T22:29:03.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.066+0000 7f00503bd700 1 -- 172.21.15.40:0/2157526244 wait complete. 2023-09-30T22:29:03.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.067+0000 7f00503bd700 1 Processor -- start 2023-09-30T22:29:03.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.067+0000 7f00503bd700 1 -- start start 2023-09-30T22:29:03.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.068+0000 7f00503bd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f004809d400 0x7f004811a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.068+0000 7f00503bd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f004809dd70 0x7f004811ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.068+0000 7f00503bd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0048133e00 0x7f004811b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.068+0000 7f00503bd700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004811de40 con 0x7f0048133e00 2023-09-30T22:29:03.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.068+0000 7f00503bd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f004811c650 con 0x7f004809dd70 2023-09-30T22:29:03.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.068+0000 7f00503bd700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f004809ff00 con 0x7f004809d400 2023-09-30T22:29:03.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.068+0000 7f004e159700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f004809d400 0x7f004811a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.068+0000 7f004e159700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f004809d400 0x7f004811a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58198/0 (socket says 172.21.15.40:58198) 2023-09-30T22:29:03.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.068+0000 7f004e159700 1 -- 172.21.15.40:0/2642799112 learned_addr learned my addr 172.21.15.40:0/2642799112 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:03.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.068+0000 7f004d958700 1 --2- 172.21.15.40:0/2642799112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f004809dd70 0x7f004811ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.068+0000 7f004e159700 1 -- 172.21.15.40:0/2642799112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f004809dd70 msgr2=0x7f004811ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.068+0000 7f004e159700 1 --2- 172.21.15.40:0/2642799112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f004809dd70 0x7f004811ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.068+0000 7f004e159700 1 -- 172.21.15.40:0/2642799112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0048133e00 msgr2=0x7f004811b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.068+0000 7f004e159700 1 --2- 172.21.15.40:0/2642799112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0048133e00 0x7f004811b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.068+0000 7f004e159700 1 -- 172.21.15.40:0/2642799112 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0038009550 con 0x7f004809d400 2023-09-30T22:29:03.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.069+0000 7f004d958700 1 --2- 172.21.15.40:0/2642799112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f004809dd70 0x7f004811ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:03.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.069+0000 7f004e159700 1 --2- 172.21.15.40:0/2642799112 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f004809d400 0x7f004811a950 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f0044009b90 tx=0x7f0044004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:03.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.069+0000 7f003effd700 1 -- 172.21.15.40:0/2642799112 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00440036a0 con 0x7f004809d400 2023-09-30T22:29:03.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.069+0000 7f00503bd700 1 -- 172.21.15.40:0/2642799112 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00440094a0 con 0x7f004809d400 2023-09-30T22:29:03.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.069+0000 7f00503bd700 1 -- 172.21.15.40:0/2642799112 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f004811d720 con 0x7f004809d400 2023-09-30T22:29:03.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.069+0000 7f003effd700 1 -- 172.21.15.40:0/2642799112 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0044003800 con 0x7f004809d400 2023-09-30T22:29:03.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.069+0000 7f003effd700 1 -- 172.21.15.40:0/2642799112 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0044003b70 con 0x7f004809d400 2023-09-30T22:29:03.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.070+0000 7f003effd700 1 -- 172.21.15.40:0/2642799112 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0044003cd0 con 0x7f004809d400 2023-09-30T22:29:03.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.070+0000 7f003effd700 1 -- 172.21.15.40:0/2642799112 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f0044040940 con 0x7f004809d400 2023-09-30T22:29:03.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.071+0000 7f00503bd700 1 -- 172.21.15.40:0/2642799112 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00300052e0 con 0x7f004809d400 2023-09-30T22:29:03.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.080+0000 7f003effd700 1 -- 172.21.15.40:0/2642799112 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0044010380 con 0x7f004809d400 2023-09-30T22:29:03.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.126+0000 7f305ad2b700 1 Processor -- start 2023-09-30T22:29:03.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.126+0000 7f305ad2b700 1 -- start start 2023-09-30T22:29:03.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.126+0000 7f305ad2b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3054136c50 0x7f3054139030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.126+0000 7f305ad2b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3054139570 0x7f305413b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.126+0000 7f305ad2b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3054133940 con 0x7f3054133e00 2023-09-30T22:29:03.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.126+0000 7f305ad2b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305409af70 con 0x7f3054139570 2023-09-30T22:29:03.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.126+0000 7f305ad2b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f305409ab20 con 0x7f3054136c50 2023-09-30T22:29:03.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.127+0000 7f3058ac7700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3054133e00 0x7f30541341d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51400/0 (socket says 172.21.15.40:51400) 2023-09-30T22:29:03.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.127+0000 7f3058ac7700 1 -- 172.21.15.40:0/395393723 learned_addr learned my addr 172.21.15.40:0/395393723 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:29:03.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.127+0000 7f3053fff700 1 --2- 172.21.15.40:0/395393723 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3054136c50 0x7f3054139030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.127+0000 7f30537fe700 1 -- 172.21.15.40:0/395393723 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 78179880 0 0) 0x7f3054133940 con 0x7f3054133e00 2023-09-30T22:29:03.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.127+0000 7f30537fe700 1 -- 172.21.15.40:0/395393723 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30440035b0 con 0x7f3054133e00 2023-09-30T22:29:03.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.127+0000 7f3053fff700 1 -- 172.21.15.40:0/395393723 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3054139570 msgr2=0x7f305413b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:03.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.127+0000 7f3053fff700 1 --2- 172.21.15.40:0/395393723 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3054139570 0x7f305413b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.127+0000 7f3053fff700 1 -- 172.21.15.40:0/395393723 >> v1:172.21.15.40:6789/0 conn(0x7f3054133e00 legacy=0x7f30541341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.127+0000 7f3053fff700 1 -- 172.21.15.40:0/395393723 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305409f0d0 con 0x7f3054136c50 2023-09-30T22:29:03.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.127+0000 7f3053fff700 1 --2- 172.21.15.40:0/395393723 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3054136c50 0x7f3054139030 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3040009870 tx=0x7f3040009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34d20b4b407f9fce server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:03.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.127+0000 7f30537fe700 1 -- 172.21.15.40:0/395393723 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3040004230 con 0x7f3054136c50 2023-09-30T22:29:03.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.127+0000 7f30537fe700 1 -- 172.21.15.40:0/395393723 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3040004390 con 0x7f3054136c50 2023-09-30T22:29:03.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.127+0000 7f30537fe700 1 -- 172.21.15.40:0/395393723 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30400036a0 con 0x7f3054136c50 2023-09-30T22:29:03.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.128+0000 7f305ad2b700 1 -- 172.21.15.40:0/395393723 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3054136c50 msgr2=0x7f3054139030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.128+0000 7f305ad2b700 1 --2- 172.21.15.40:0/395393723 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3054136c50 0x7f3054139030 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3040009870 tx=0x7f3040009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:03.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.128+0000 7f305ad2b700 1 -- 172.21.15.40:0/395393723 shutdown_connections 2023-09-30T22:29:03.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.128+0000 7f305ad2b700 1 --2- 172.21.15.40:0/395393723 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3054139570 0x7f305413b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.128+0000 7f305ad2b700 1 --2- 172.21.15.40:0/395393723 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3054136c50 0x7f3054139030 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.128+0000 7f305ad2b700 1 -- 172.21.15.40:0/395393723 >> 172.21.15.40:0/395393723 conn(0x7f30540a2a00 msgr2=0x7f30540a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:03.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.128+0000 7f305ad2b700 1 -- 172.21.15.40:0/395393723 shutdown_connections 2023-09-30T22:29:03.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.128+0000 7f305ad2b700 1 -- 172.21.15.40:0/395393723 wait complete. 2023-09-30T22:29:03.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.129+0000 7f305ad2b700 1 Processor -- start 2023-09-30T22:29:03.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.129+0000 7f305ad2b700 1 -- start start 2023-09-30T22:29:03.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.130+0000 7f305ad2b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3054133e00 0x7f30540710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.130+0000 7f305ad2b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3054136c50 0x7f305406d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.130+0000 7f305ad2b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3054139570 0x7f305406db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.130+0000 7f305ad2b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30540a2460 con 0x7f3054136c50 2023-09-30T22:29:03.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.130+0000 7f305ad2b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30540700a0 con 0x7f3054139570 2023-09-30T22:29:03.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.130+0000 7f305ad2b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3054070c80 con 0x7f3054133e00 2023-09-30T22:29:03.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.131+0000 7f3058ac7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3054133e00 0x7f30540710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.131+0000 7f3058ac7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3054133e00 0x7f30540710b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58210/0 (socket says 172.21.15.40:58210) 2023-09-30T22:29:03.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.131+0000 7f3058ac7700 1 -- 172.21.15.40:0/1515486516 learned_addr learned my addr 172.21.15.40:0/1515486516 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:03.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.131+0000 7f3053fff700 1 --2- 172.21.15.40:0/1515486516 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3054136c50 0x7f305406d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.131+0000 7f30592c8700 1 --2- 172.21.15.40:0/1515486516 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3054139570 0x7f305406db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.131+0000 7f3058ac7700 1 -- 172.21.15.40:0/1515486516 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3054139570 msgr2=0x7f305406db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.131+0000 7f3058ac7700 1 --2- 172.21.15.40:0/1515486516 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3054139570 0x7f305406db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.131+0000 7f3058ac7700 1 -- 172.21.15.40:0/1515486516 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3054136c50 msgr2=0x7f305406d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.131+0000 7f3058ac7700 1 --2- 172.21.15.40:0/1515486516 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3054136c50 0x7f305406d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.131+0000 7f3058ac7700 1 -- 172.21.15.40:0/1515486516 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30400094a0 con 0x7f3054133e00 2023-09-30T22:29:03.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.131+0000 7f3053fff700 1 --2- 172.21.15.40:0/1515486516 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3054136c50 0x7f305406d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:03.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.131+0000 7f30592c8700 1 --2- 172.21.15.40:0/1515486516 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3054139570 0x7f305406db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:03.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.131+0000 7f3058ac7700 1 --2- 172.21.15.40:0/1515486516 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3054133e00 0x7f30540710b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f304800c580 tx=0x7f304800c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:03.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.132+0000 7f30517fa700 1 -- 172.21.15.40:0/1515486516 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3048004c80 con 0x7f3054133e00 2023-09-30T22:29:03.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.132+0000 7f30517fa700 1 -- 172.21.15.40:0/1515486516 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3048004e00 con 0x7f3054133e00 2023-09-30T22:29:03.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.132+0000 7f30517fa700 1 -- 172.21.15.40:0/1515486516 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3048007310 con 0x7f3054133e00 2023-09-30T22:29:03.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.132+0000 7f305ad2b700 1 -- 172.21.15.40:0/1515486516 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f305406fb00 con 0x7f3054133e00 2023-09-30T22:29:03.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.132+0000 7f305ad2b700 1 -- 172.21.15.40:0/1515486516 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f305406fdc0 con 0x7f3054133e00 2023-09-30T22:29:03.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.134+0000 7f30517fa700 1 -- 172.21.15.40:0/1515486516 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3048007470 con 0x7f3054133e00 2023-09-30T22:29:03.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.134+0000 7f305ad2b700 1 -- 172.21.15.40:0/1515486516 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3054062380 con 0x7f3054133e00 2023-09-30T22:29:03.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.134+0000 7f30517fa700 1 -- 172.21.15.40:0/1515486516 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f304803f3c0 con 0x7f3054133e00 2023-09-30T22:29:03.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.139+0000 7f30517fa700 1 -- 172.21.15.40:0/1515486516 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f30480133c0 con 0x7f3054133e00 2023-09-30T22:29:03.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.178+0000 7f46a211d700 1 Processor -- start 2023-09-30T22:29:03.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.178+0000 7f46a211d700 1 -- start start 2023-09-30T22:29:03.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.179+0000 7f46a211d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f469c06fb50 0x7f469c136c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.179+0000 7f46a211d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f469c1371b0 0x7f469c139590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.179+0000 7f46a211d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f469c070830 con 0x7f469c06f070 2023-09-30T22:29:03.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.179+0000 7f46a211d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f469c071af0 con 0x7f469c1371b0 2023-09-30T22:29:03.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.179+0000 7f46a211d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f469c070ad0 con 0x7f469c06fb50 2023-09-30T22:29:03.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.179+0000 7f4693fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f469c06fb50 0x7f469c136c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.179+0000 7f4693fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f469c06fb50 0x7f469c136c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58220/0 (socket says 172.21.15.40:58220) 2023-09-30T22:29:03.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.179+0000 7f4693fff700 1 -- 172.21.15.40:0/1197805480 learned_addr learned my addr 172.21.15.40:0/1197805480 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:03.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.179+0000 7f469bfff700 1 --2- 172.21.15.40:0/1197805480 >> v2:172.21.15.40:3300/0 conn(0x7f469c1371b0 0x7f469c139590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.179+0000 7f4693fff700 1 -- 172.21.15.40:0/1197805480 >> v2:172.21.15.40:3300/0 conn(0x7f469c1371b0 msgr2=0x7f469c139590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:03.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.179+0000 7f4693fff700 1 --2- 172.21.15.40:0/1197805480 >> v2:172.21.15.40:3300/0 conn(0x7f469c1371b0 0x7f469c139590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.179+0000 7f4693fff700 1 -- 172.21.15.40:0/1197805480 >> v1:172.21.15.40:6789/0 conn(0x7f469c06f070 legacy=0x7f469c06f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.179+0000 7f4693fff700 1 -- 172.21.15.40:0/1197805480 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469c070de0 con 0x7f469c06fb50 2023-09-30T22:29:03.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.179+0000 7f4693fff700 1 --2- 172.21.15.40:0/1197805480 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f469c06fb50 0x7f469c136c70 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f46840098f0 tx=0x7f4684009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8a9ccbfa4e036f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:03.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.180+0000 7f469affd700 1 -- 172.21.15.40:0/1197805480 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4684011830 con 0x7f469c06fb50 2023-09-30T22:29:03.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.180+0000 7f469affd700 1 -- 172.21.15.40:0/1197805480 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4684011990 con 0x7f469c06fb50 2023-09-30T22:29:03.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.180+0000 7f469affd700 1 -- 172.21.15.40:0/1197805480 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4684011d20 con 0x7f469c06fb50 2023-09-30T22:29:03.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.180+0000 7f46a211d700 1 -- 172.21.15.40:0/1197805480 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f469c06fb50 msgr2=0x7f469c136c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.180+0000 7f46a211d700 1 --2- 172.21.15.40:0/1197805480 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f469c06fb50 0x7f469c136c70 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f46840098f0 tx=0x7f4684009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:03.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.180+0000 7f46a211d700 1 -- 172.21.15.40:0/1197805480 shutdown_connections 2023-09-30T22:29:03.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.180+0000 7f46a211d700 1 --2- 172.21.15.40:0/1197805480 >> v2:172.21.15.40:3300/0 conn(0x7f469c1371b0 0x7f469c139590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.180+0000 7f46a211d700 1 --2- 172.21.15.40:0/1197805480 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f469c06fb50 0x7f469c136c70 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.180+0000 7f46a211d700 1 -- 172.21.15.40:0/1197805480 >> 172.21.15.40:0/1197805480 conn(0x7f469c0a41a0 msgr2=0x7f469c0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:03.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.181+0000 7f46a211d700 1 -- 172.21.15.40:0/1197805480 shutdown_connections 2023-09-30T22:29:03.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.181+0000 7f46a211d700 1 -- 172.21.15.40:0/1197805480 wait complete. 2023-09-30T22:29:03.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.181+0000 7f46a211d700 1 Processor -- start 2023-09-30T22:29:03.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.182+0000 7f46a211d700 1 -- start start 2023-09-30T22:29:03.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.182+0000 7f46a211d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f469c06f070 0x7f469c131ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.182+0000 7f46a211d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f469c06fb50 0x7f469c06c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.182+0000 7f46a211d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f469c1371b0 0x7f469c06ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.182+0000 7f46a211d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c136440 con 0x7f469c1371b0 2023-09-30T22:29:03.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.182+0000 7f46a211d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469c06e6c0 con 0x7f469c06fb50 2023-09-30T22:29:03.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.182+0000 7f46a211d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f469c12c640 con 0x7f469c06f070 2023-09-30T22:29:03.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.182+0000 7f469bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f469c1371b0 0x7f469c06ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.182+0000 7f4693fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f469c06fb50 0x7f469c06c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.182+0000 7f469bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f469c1371b0 0x7f469c06ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51026/0 (socket says 172.21.15.40:51026) 2023-09-30T22:29:03.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.182+0000 7f469bfff700 1 -- 172.21.15.40:0/2381010683 learned_addr learned my addr 172.21.15.40:0/2381010683 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:03.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.182+0000 7f469b7fe700 1 --2- 172.21.15.40:0/2381010683 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f469c06f070 0x7f469c131ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.183+0000 7f4693fff700 1 -- 172.21.15.40:0/2381010683 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f469c06f070 msgr2=0x7f469c131ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.183+0000 7f4693fff700 1 --2- 172.21.15.40:0/2381010683 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f469c06f070 0x7f469c131ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.183+0000 7f4693fff700 1 -- 172.21.15.40:0/2381010683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f469c1371b0 msgr2=0x7f469c06ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.183+0000 7f4693fff700 1 --2- 172.21.15.40:0/2381010683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f469c1371b0 0x7f469c06ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.183+0000 7f4693fff700 1 -- 172.21.15.40:0/2381010683 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4684009550 con 0x7f469c06fb50 2023-09-30T22:29:03.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.183+0000 7f4693fff700 1 --2- 172.21.15.40:0/2381010683 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f469c06fb50 0x7f469c06c990 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4684016000 tx=0x7f4684004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:03.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.183+0000 7f4698ff9700 1 -- 172.21.15.40:0/2381010683 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4684004450 con 0x7f469c06fb50 2023-09-30T22:29:03.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.183+0000 7f4698ff9700 1 -- 172.21.15.40:0/2381010683 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46840045b0 con 0x7f469c06fb50 2023-09-30T22:29:03.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.183+0000 7f4698ff9700 1 -- 172.21.15.40:0/2381010683 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46840038c0 con 0x7f469c06fb50 2023-09-30T22:29:03.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.183+0000 7f46a211d700 1 -- 172.21.15.40:0/2381010683 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f469c12ca90 con 0x7f469c06fb50 2023-09-30T22:29:03.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.183+0000 7f46a211d700 1 -- 172.21.15.40:0/2381010683 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f469c12cd70 con 0x7f469c06fb50 2023-09-30T22:29:03.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.185+0000 7f46a211d700 1 -- 172.21.15.40:0/2381010683 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f469c062380 con 0x7f469c06fb50 2023-09-30T22:29:03.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.185+0000 7f4698ff9700 1 -- 172.21.15.40:0/2381010683 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4684003a20 con 0x7f469c06fb50 2023-09-30T22:29:03.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.185+0000 7f4698ff9700 1 -- 172.21.15.40:0/2381010683 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4684040170 con 0x7f469c06fb50 2023-09-30T22:29:03.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.190+0000 7f4698ff9700 1 -- 172.21.15.40:0/2381010683 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4684003cd0 con 0x7f469c06fb50 2023-09-30T22:29:03.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.199+0000 7f6c8c56d700 1 Processor -- start 2023-09-30T22:29:03.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.199+0000 7f6c8c56d700 1 -- start start 2023-09-30T22:29:03.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.200+0000 7f6c8c56d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c8409c890 0x7f6c8409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.200+0000 7f6c8c56d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6c8409e480 0x7f6c8413bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.200+0000 7f6c8c56d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c840a2600 con 0x7f6c8409d920 2023-09-30T22:29:03.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.200+0000 7f6c8c56d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c840a29d0 con 0x7f6c8409e480 2023-09-30T22:29:03.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.200+0000 7f6c8c56d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8409fb40 con 0x7f6c8409c890 2023-09-30T22:29:03.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.200+0000 7f6c8a309700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c8409c890 0x7f6c8409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.200+0000 7f6c8a309700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c8409c890 0x7f6c8409cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48640/0 (socket says 172.21.15.40:48640) 2023-09-30T22:29:03.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.200+0000 7f6c8a309700 1 -- 172.21.15.40:0/243115249 learned_addr learned my addr 172.21.15.40:0/243115249 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:03.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.200+0000 7f6c8ab0a700 1 --2- 172.21.15.40:0/243115249 >> v2:172.21.15.40:3300/0 conn(0x7f6c8409e480 0x7f6c8413bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.201+0000 7f6c8a309700 1 -- 172.21.15.40:0/243115249 >> v2:172.21.15.40:3300/0 conn(0x7f6c8409e480 msgr2=0x7f6c8413bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:03.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.201+0000 7f6c8a309700 1 --2- 172.21.15.40:0/243115249 >> v2:172.21.15.40:3300/0 conn(0x7f6c8409e480 0x7f6c8413bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.201+0000 7f6c8a309700 1 -- 172.21.15.40:0/243115249 >> v1:172.21.15.40:6789/0 conn(0x7f6c8409d920 legacy=0x7f6c8409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:03.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.201+0000 7f6c8a309700 1 -- 172.21.15.40:0/243115249 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8409fed0 con 0x7f6c8409c890 2023-09-30T22:29:03.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.201+0000 7f6c8a309700 1 --2- 172.21.15.40:0/243115249 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c8409c890 0x7f6c8409cc60 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f6c80006fd0 tx=0x7f6c80009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=674a3d66d8e2e552 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:03.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.201+0000 7f6c89307700 1 -- 172.21.15.40:0/243115249 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80005e30 con 0x7f6c8409c890 2023-09-30T22:29:03.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.201+0000 7f6c89307700 1 -- 172.21.15.40:0/243115249 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c80006030 con 0x7f6c8409c890 2023-09-30T22:29:03.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.201+0000 7f6c89307700 1 -- 172.21.15.40:0/243115249 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c800063c0 con 0x7f6c8409c890 2023-09-30T22:29:03.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.202+0000 7f6c8c56d700 1 -- 172.21.15.40:0/243115249 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c8409c890 msgr2=0x7f6c8409cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.202+0000 7f6c8c56d700 1 --2- 172.21.15.40:0/243115249 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c8409c890 0x7f6c8409cc60 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f6c80006fd0 tx=0x7f6c80009bd0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.202+0000 7f6c8c56d700 1 -- 172.21.15.40:0/243115249 shutdown_connections 2023-09-30T22:29:03.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.202+0000 7f6c8c56d700 1 --2- 172.21.15.40:0/243115249 >> v2:172.21.15.40:3300/0 conn(0x7f6c8409e480 0x7f6c8413bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.202+0000 7f6c8c56d700 1 --2- 172.21.15.40:0/243115249 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c8409c890 0x7f6c8409cc60 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.202+0000 7f6c8c56d700 1 -- 172.21.15.40:0/243115249 >> 172.21.15.40:0/243115249 conn(0x7f6c840a7080 msgr2=0x7f6c840a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:03.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.202+0000 7f6c8c56d700 1 -- 172.21.15.40:0/243115249 shutdown_connections 2023-09-30T22:29:03.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.202+0000 7f6c8c56d700 1 -- 172.21.15.40:0/243115249 wait complete. 2023-09-30T22:29:03.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.203+0000 7f6c8c56d700 1 Processor -- start 2023-09-30T22:29:03.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.203+0000 7f6c8c56d700 1 -- start start 2023-09-30T22:29:03.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.204+0000 7f6c8c56d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c8409c890 0x7f6c841c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.204+0000 7f6c8c56d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c8409d920 0x7f6c841c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.204+0000 7f6c8c56d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c8409e480 0x7f6c8412d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.204+0000 7f6c8c56d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c84130db0 con 0x7f6c8409e480 2023-09-30T22:29:03.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.204+0000 7f6c8c56d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c84130750 con 0x7f6c8409d920 2023-09-30T22:29:03.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.204+0000 7f6c8c56d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8412f460 con 0x7f6c8409c890 2023-09-30T22:29:03.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.204+0000 7f6c8ab0a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c8409e480 0x7f6c8412d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.204+0000 7f6c8ab0a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c8409e480 0x7f6c8412d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46500/0 (socket says 172.21.15.40:46500) 2023-09-30T22:29:03.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.204+0000 7f6c8ab0a700 1 -- 172.21.15.40:0/3258889760 learned_addr learned my addr 172.21.15.40:0/3258889760 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:03.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.204+0000 7f6c8ab0a700 1 -- 172.21.15.40:0/3258889760 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c8409c890 msgr2=0x7f6c841c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.204+0000 7f6c8ab0a700 1 --2- 172.21.15.40:0/3258889760 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c8409c890 0x7f6c841c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.204+0000 7f6c8ab0a700 1 -- 172.21.15.40:0/3258889760 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c8409d920 msgr2=0x7f6c841c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.204+0000 7f6c8ab0a700 1 --2- 172.21.15.40:0/3258889760 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c8409d920 0x7f6c841c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.204+0000 7f6c8ab0a700 1 -- 172.21.15.40:0/3258889760 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c80009500 con 0x7f6c8409e480 2023-09-30T22:29:03.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.204+0000 7f6c8ab0a700 1 --2- 172.21.15.40:0/3258889760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c8409e480 0x7f6c8412d520 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00efc0 tx=0x7f6c7c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:03.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.205+0000 7f6c7affd700 1 -- 172.21.15.40:0/3258889760 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c009ca0 con 0x7f6c8409e480 2023-09-30T22:29:03.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.205+0000 7f6c7affd700 1 -- 172.21.15.40:0/3258889760 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7c00f040 con 0x7f6c8409e480 2023-09-30T22:29:03.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.205+0000 7f6c7affd700 1 -- 172.21.15.40:0/3258889760 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c014480 con 0x7f6c8409e480 2023-09-30T22:29:03.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.205+0000 7f6c8c56d700 1 -- 172.21.15.40:0/3258889760 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c84130fb0 con 0x7f6c8409e480 2023-09-30T22:29:03.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.205+0000 7f6c8c56d700 1 -- 172.21.15.40:0/3258889760 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c840a5f10 con 0x7f6c8409e480 2023-09-30T22:29:03.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.206+0000 7f6c8c56d700 1 -- 172.21.15.40:0/3258889760 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c84062380 con 0x7f6c8409e480 2023-09-30T22:29:03.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.206+0000 7f6c7affd700 1 -- 172.21.15.40:0/3258889760 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6c7c0145e0 con 0x7f6c8409e480 2023-09-30T22:29:03.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.206+0000 7f6c7affd700 1 -- 172.21.15.40:0/3258889760 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6c7c0404f0 con 0x7f6c8409e480 2023-09-30T22:29:03.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.211+0000 7f6c7affd700 1 -- 172.21.15.40:0/3258889760 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6c7c007920 con 0x7f6c8409e480 2023-09-30T22:29:03.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.280+0000 7f00503bd700 1 -- 172.21.15.40:0/2642799112 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0030005590 con 0x7f004809d400 2023-09-30T22:29:03.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.281+0000 7f003effd700 1 -- 172.21.15.40:0/2642799112 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0044015020 con 0x7f004809d400 2023-09-30T22:29:03.282 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:03.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.283+0000 7f00503bd700 1 -- 172.21.15.40:0/2642799112 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f004809d400 msgr2=0x7f004811a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.283+0000 7f00503bd700 1 --2- 172.21.15.40:0/2642799112 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f004809d400 0x7f004811a950 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f0044009b90 tx=0x7f0044004750 comp rx=0 tx=0).stop 2023-09-30T22:29:03.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.283+0000 7f00503bd700 1 -- 172.21.15.40:0/2642799112 shutdown_connections 2023-09-30T22:29:03.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.283+0000 7f00503bd700 1 --2- 172.21.15.40:0/2642799112 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f004809d400 0x7f004811a950 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.283+0000 7f00503bd700 1 --2- 172.21.15.40:0/2642799112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0048133e00 0x7f004811b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.283+0000 7f00503bd700 1 --2- 172.21.15.40:0/2642799112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f004809dd70 0x7f004811ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.283+0000 7f00503bd700 1 -- 172.21.15.40:0/2642799112 >> 172.21.15.40:0/2642799112 conn(0x7f00480a2a00 msgr2=0x7f00480a2270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:03.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.283+0000 7f00503bd700 1 -- 172.21.15.40:0/2642799112 shutdown_connections 2023-09-30T22:29:03.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.283+0000 7f00503bd700 1 -- 172.21.15.40:0/2642799112 wait complete. 2023-09-30T22:29:03.296 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:03.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.373+0000 7f305ad2b700 1 -- 172.21.15.40:0/1515486516 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3054074330 con 0x7f3054133e00 2023-09-30T22:29:03.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.374+0000 7f30517fa700 1 -- 172.21.15.40:0/1515486516 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3048011360 con 0x7f3054133e00 2023-09-30T22:29:03.375 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:03.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.376+0000 7f305ad2b700 1 -- 172.21.15.40:0/1515486516 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3054133e00 msgr2=0x7f30540710b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.376+0000 7f305ad2b700 1 --2- 172.21.15.40:0/1515486516 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3054133e00 0x7f30540710b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f304800c580 tx=0x7f304800c890 comp rx=0 tx=0).stop 2023-09-30T22:29:03.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.376+0000 7f305ad2b700 1 -- 172.21.15.40:0/1515486516 shutdown_connections 2023-09-30T22:29:03.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.376+0000 7f305ad2b700 1 --2- 172.21.15.40:0/1515486516 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3054133e00 0x7f30540710b0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.376+0000 7f305ad2b700 1 --2- 172.21.15.40:0/1515486516 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3054139570 0x7f305406db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.376+0000 7f305ad2b700 1 --2- 172.21.15.40:0/1515486516 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3054136c50 0x7f305406d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.376+0000 7f305ad2b700 1 -- 172.21.15.40:0/1515486516 >> 172.21.15.40:0/1515486516 conn(0x7f30540a2a00 msgr2=0x7f305409b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:03.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.376+0000 7f305ad2b700 1 -- 172.21.15.40:0/1515486516 shutdown_connections 2023-09-30T22:29:03.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.376+0000 7f305ad2b700 1 -- 172.21.15.40:0/1515486516 wait complete. 2023-09-30T22:29:03.389 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:03.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.406+0000 7f6c8c56d700 1 -- 172.21.15.40:0/3258889760 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6c84074620 con 0x7f6c8409e480 2023-09-30T22:29:03.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.407+0000 7f6c7affd700 1 -- 172.21.15.40:0/3258889760 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6c7c018020 con 0x7f6c8409e480 2023-09-30T22:29:03.407 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:03.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.409+0000 7f46a211d700 1 -- 172.21.15.40:0/2381010683 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f469c074620 con 0x7f469c06fb50 2023-09-30T22:29:03.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.409+0000 7f6c8c56d700 1 -- 172.21.15.40:0/3258889760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c8409e480 msgr2=0x7f6c8412d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.409+0000 7f6c8c56d700 1 --2- 172.21.15.40:0/3258889760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c8409e480 0x7f6c8412d520 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00efc0 tx=0x7f6c7c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.409+0000 7f6c8c56d700 1 -- 172.21.15.40:0/3258889760 shutdown_connections 2023-09-30T22:29:03.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.409+0000 7f6c8c56d700 1 --2- 172.21.15.40:0/3258889760 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c8409c890 0x7f6c841c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.409+0000 7f6c8c56d700 1 --2- 172.21.15.40:0/3258889760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c8409e480 0x7f6c8412d520 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.409+0000 7f6c8c56d700 1 --2- 172.21.15.40:0/3258889760 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c8409d920 0x7f6c841c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.409+0000 7f6c8c56d700 1 -- 172.21.15.40:0/3258889760 >> 172.21.15.40:0/3258889760 conn(0x7f6c840a7080 msgr2=0x7f6c84132970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:03.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.409+0000 7f6c8c56d700 1 -- 172.21.15.40:0/3258889760 shutdown_connections 2023-09-30T22:29:03.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.409+0000 7f6c8c56d700 1 -- 172.21.15.40:0/3258889760 wait complete. 2023-09-30T22:29:03.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.409+0000 7f4698ff9700 1 -- 172.21.15.40:0/2381010683 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4684028030 con 0x7f469c06fb50 2023-09-30T22:29:03.411 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:03.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.411+0000 7f46a211d700 1 -- 172.21.15.40:0/2381010683 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f469c06fb50 msgr2=0x7f469c06c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.411+0000 7f46a211d700 1 --2- 172.21.15.40:0/2381010683 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f469c06fb50 0x7f469c06c990 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4684016000 tx=0x7f4684004750 comp rx=0 tx=0).stop 2023-09-30T22:29:03.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.411+0000 7f46a211d700 1 -- 172.21.15.40:0/2381010683 shutdown_connections 2023-09-30T22:29:03.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.412+0000 7f46a211d700 1 --2- 172.21.15.40:0/2381010683 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f469c06f070 0x7f469c131ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.412+0000 7f46a211d700 1 --2- 172.21.15.40:0/2381010683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f469c1371b0 0x7f469c06ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.412+0000 7f46a211d700 1 --2- 172.21.15.40:0/2381010683 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f469c06fb50 0x7f469c06c990 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.412+0000 7f46a211d700 1 -- 172.21.15.40:0/2381010683 >> 172.21.15.40:0/2381010683 conn(0x7f469c0a41a0 msgr2=0x7f469c0a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:03.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.412+0000 7f46a211d700 1 -- 172.21.15.40:0/2381010683 shutdown_connections 2023-09-30T22:29:03.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:03.412+0000 7f46a211d700 1 -- 172.21.15.40:0/2381010683 wait complete. 2023-09-30T22:29:03.424 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:03.425 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:04.297 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:04.391 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:04.425 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:04.425 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:04.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.439+0000 7fd012e7d700 1 Processor -- start 2023-09-30T22:29:04.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.439+0000 7fd012e7d700 1 -- start start 2023-09-30T22:29:04.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.440+0000 7fd012e7d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd00c136bf0 0x7fd00c138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.440+0000 7fd012e7d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd00c139510 0x7fd00c13b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.440+0000 7fd012e7d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd00c0a2600 con 0x7fd00c09c890 2023-09-30T22:29:04.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.440+0000 7fd012e7d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c0a29d0 con 0x7fd00c139510 2023-09-30T22:29:04.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.440+0000 7fd012e7d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c09fb40 con 0x7fd00c136bf0 2023-09-30T22:29:04.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.440+0000 7fd010c19700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd00c09c890 0x7fd00c09cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46894/0 (socket says 172.21.15.40:46894) 2023-09-30T22:29:04.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.440+0000 7fd010c19700 1 -- 172.21.15.40:0/2549155566 learned_addr learned my addr 172.21.15.40:0/2549155566 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:29:04.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.440+0000 7fd00bfff700 1 --2- 172.21.15.40:0/2549155566 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd00c136bf0 0x7fd00c138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.441+0000 7fd00b7fe700 1 -- 172.21.15.40:0/2549155566 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3200334608 0 0) 0x7fd00c0a2600 con 0x7fd00c09c890 2023-09-30T22:29:04.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.441+0000 7fd00b7fe700 1 -- 172.21.15.40:0/2549155566 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcffc0035b0 con 0x7fd00c09c890 2023-09-30T22:29:04.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.441+0000 7fd00bfff700 1 -- 172.21.15.40:0/2549155566 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd00c139510 msgr2=0x7fd00c13b8f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:29:04.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.441+0000 7fd00bfff700 1 --2- 172.21.15.40:0/2549155566 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd00c139510 0x7fd00c13b8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.441+0000 7fd00bfff700 1 -- 172.21.15.40:0/2549155566 >> v1:172.21.15.40:6789/0 conn(0x7fd00c09c890 legacy=0x7fd00c09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.441+0000 7fd00bfff700 1 -- 172.21.15.40:0/2549155566 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd00c09d370 con 0x7fd00c136bf0 2023-09-30T22:29:04.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.441+0000 7fd00bfff700 1 --2- 172.21.15.40:0/2549155566 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd00c136bf0 0x7fd00c138fd0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fcff8009870 tx=0x7fcff8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9713ae5ebe4875 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:04.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.441+0000 7fd00b7fe700 1 -- 172.21.15.40:0/2549155566 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff8004230 con 0x7fd00c136bf0 2023-09-30T22:29:04.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.441+0000 7fd00b7fe700 1 -- 172.21.15.40:0/2549155566 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff8004390 con 0x7fd00c136bf0 2023-09-30T22:29:04.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.441+0000 7fd00b7fe700 1 -- 172.21.15.40:0/2549155566 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff80036a0 con 0x7fd00c136bf0 2023-09-30T22:29:04.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.442+0000 7fd012e7d700 1 -- 172.21.15.40:0/2549155566 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd00c136bf0 msgr2=0x7fd00c138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.442+0000 7fd012e7d700 1 --2- 172.21.15.40:0/2549155566 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd00c136bf0 0x7fd00c138fd0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fcff8009870 tx=0x7fcff8009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:04.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.442+0000 7fd012e7d700 1 -- 172.21.15.40:0/2549155566 shutdown_connections 2023-09-30T22:29:04.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.442+0000 7fd012e7d700 1 --2- 172.21.15.40:0/2549155566 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd00c139510 0x7fd00c13b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.442+0000 7fd012e7d700 1 --2- 172.21.15.40:0/2549155566 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd00c136bf0 0x7fd00c138fd0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.442+0000 7fd012e7d700 1 -- 172.21.15.40:0/2549155566 >> 172.21.15.40:0/2549155566 conn(0x7fd00c0a7080 msgr2=0x7fd00c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:04.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.442+0000 7fd012e7d700 1 -- 172.21.15.40:0/2549155566 shutdown_connections 2023-09-30T22:29:04.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.442+0000 7fd012e7d700 1 -- 172.21.15.40:0/2549155566 wait complete. 2023-09-30T22:29:04.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.443+0000 7fd012e7d700 1 Processor -- start 2023-09-30T22:29:04.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.443+0000 7fd012e7d700 1 -- start start 2023-09-30T22:29:04.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.444+0000 7fd012e7d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd00c09c890 0x7fd00c06f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.444+0000 7fd012e7d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd00c136bf0 0x7fd00c06f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.444+0000 7fd012e7d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd00c139510 0x7fd00c06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.444+0000 7fd012e7d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c12bdc0 con 0x7fd00c09c890 2023-09-30T22:29:04.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.444+0000 7fd012e7d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c070c60 con 0x7fd00c136bf0 2023-09-30T22:29:04.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.444+0000 7fd012e7d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c09ecf0 con 0x7fd00c139510 2023-09-30T22:29:04.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.444+0000 7fd010c19700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd00c09c890 0x7fd00c06f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.444+0000 7fd010c19700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd00c09c890 0x7fd00c06f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46510/0 (socket says 172.21.15.40:46510) 2023-09-30T22:29:04.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.444+0000 7fd010c19700 1 -- 172.21.15.40:0/417079503 learned_addr learned my addr 172.21.15.40:0/417079503 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:04.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.444+0000 7fd01141a700 1 --2- 172.21.15.40:0/417079503 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd00c139510 0x7fd00c06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.444+0000 7fd01141a700 1 -- 172.21.15.40:0/417079503 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd00c136bf0 msgr2=0x7fd00c06f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.444+0000 7fd01141a700 1 --2- 172.21.15.40:0/417079503 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd00c136bf0 0x7fd00c06f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.444+0000 7fd01141a700 1 -- 172.21.15.40:0/417079503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd00c09c890 msgr2=0x7fd00c06f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.444+0000 7fd01141a700 1 --2- 172.21.15.40:0/417079503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd00c09c890 0x7fd00c06f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.444+0000 7fd01141a700 1 -- 172.21.15.40:0/417079503 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff80094a0 con 0x7fd00c139510 2023-09-30T22:29:04.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.444+0000 7fd010c19700 1 --2- 172.21.15.40:0/417079503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd00c09c890 0x7fd00c06f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:04.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.445+0000 7fd01141a700 1 --2- 172.21.15.40:0/417079503 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd00c139510 0x7fd00c06fc00 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fd00c09d5e0 tx=0x7fd004009ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:04.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.445+0000 7fd0097fa700 1 -- 172.21.15.40:0/417079503 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00400cb90 con 0x7fd00c139510 2023-09-30T22:29:04.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.445+0000 7fd0097fa700 1 -- 172.21.15.40:0/417079503 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00400cd30 con 0x7fd00c139510 2023-09-30T22:29:04.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.445+0000 7fd0097fa700 1 -- 172.21.15.40:0/417079503 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00400cea0 con 0x7fd00c139510 2023-09-30T22:29:04.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.445+0000 7fd012e7d700 1 -- 172.21.15.40:0/417079503 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd00c0717e0 con 0x7fd00c139510 2023-09-30T22:29:04.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.445+0000 7fd012e7d700 1 -- 172.21.15.40:0/417079503 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd00c12c830 con 0x7fd00c139510 2023-09-30T22:29:04.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.446+0000 7fd012e7d700 1 -- 172.21.15.40:0/417079503 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd00c12bf10 con 0x7fd00c139510 2023-09-30T22:29:04.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.446+0000 7fd0097fa700 1 -- 172.21.15.40:0/417079503 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd004014680 con 0x7fd00c139510 2023-09-30T22:29:04.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.447+0000 7fd0097fa700 1 -- 172.21.15.40:0/417079503 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd00403f580 con 0x7fd00c139510 2023-09-30T22:29:04.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.453+0000 7fd0097fa700 1 -- 172.21.15.40:0/417079503 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd00401d3b0 con 0x7fd00c139510 2023-09-30T22:29:04.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.530+0000 7f36bf4b4700 1 Processor -- start 2023-09-30T22:29:04.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.530+0000 7f36bf4b4700 1 -- start start 2023-09-30T22:29:04.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.531+0000 7f36bf4b4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f36b809d920 0x7f36b809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.531+0000 7f36bf4b4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36b809f0f0 0x7f36b809e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.531+0000 7f36bf4b4700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36b809f940 con 0x7f36b8133ca0 2023-09-30T22:29:04.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.531+0000 7f36bf4b4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b806b4c0 con 0x7f36b809d920 2023-09-30T22:29:04.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.531+0000 7f36bf4b4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36b809a8f0 con 0x7f36b809f0f0 2023-09-30T22:29:04.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.531+0000 7f36bd250700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f36b809d920 0x7f36b809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.531+0000 7f36bd250700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f36b809d920 0x7f36b809dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46518/0 (socket says 172.21.15.40:46518) 2023-09-30T22:29:04.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.531+0000 7f36bd250700 1 -- 172.21.15.40:0/2907701840 learned_addr learned my addr 172.21.15.40:0/2907701840 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:04.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.531+0000 7f36bca4f700 1 --2- 172.21.15.40:0/2907701840 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36b809f0f0 0x7f36b809e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.531+0000 7f36bca4f700 1 -- 172.21.15.40:0/2907701840 >> v2:172.21.15.40:3300/0 conn(0x7f36b809d920 msgr2=0x7f36b809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:04.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.532+0000 7f36affff700 1 -- 172.21.15.40:0/2907701840 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1716343028 0 0) 0x7f36b809f940 con 0x7f36b8133ca0 2023-09-30T22:29:04.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.532+0000 7f36bca4f700 1 --2- 172.21.15.40:0/2907701840 >> v2:172.21.15.40:3300/0 conn(0x7f36b809d920 0x7f36b809dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.532+0000 7f36bca4f700 1 -- 172.21.15.40:0/2907701840 >> v1:172.21.15.40:6789/0 conn(0x7f36b8133ca0 legacy=0x7f36b8134120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.532+0000 7f36bca4f700 1 -- 172.21.15.40:0/2907701840 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b809f6e0 con 0x7f36b809f0f0 2023-09-30T22:29:04.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.532+0000 7f36bd250700 1 --2- 172.21.15.40:0/2907701840 >> v2:172.21.15.40:3300/0 conn(0x7f36b809d920 0x7f36b809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:04.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.532+0000 7f36bca4f700 1 --2- 172.21.15.40:0/2907701840 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36b809f0f0 0x7f36b809e230 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f36a8009840 tx=0x7f36a8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d8c17a0da97f027 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:04.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.532+0000 7f36affff700 1 -- 172.21.15.40:0/2907701840 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a8011830 con 0x7f36b809f0f0 2023-09-30T22:29:04.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.532+0000 7f36affff700 1 -- 172.21.15.40:0/2907701840 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a8011990 con 0x7f36b809f0f0 2023-09-30T22:29:04.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.532+0000 7f36affff700 1 -- 172.21.15.40:0/2907701840 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a8011d20 con 0x7f36b809f0f0 2023-09-30T22:29:04.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.533+0000 7f36bf4b4700 1 -- 172.21.15.40:0/2907701840 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36b809f0f0 msgr2=0x7f36b809e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.533+0000 7f36bf4b4700 1 --2- 172.21.15.40:0/2907701840 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36b809f0f0 0x7f36b809e230 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f36a8009840 tx=0x7f36a8009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:04.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.533+0000 7f36bf4b4700 1 -- 172.21.15.40:0/2907701840 shutdown_connections 2023-09-30T22:29:04.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.533+0000 7f36bf4b4700 1 --2- 172.21.15.40:0/2907701840 >> v2:172.21.15.40:3300/0 conn(0x7f36b809d920 0x7f36b809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.533+0000 7f36bf4b4700 1 --2- 172.21.15.40:0/2907701840 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36b809f0f0 0x7f36b809e230 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.533+0000 7f36bf4b4700 1 -- 172.21.15.40:0/2907701840 >> 172.21.15.40:0/2907701840 conn(0x7f36b809fb20 msgr2=0x7f36b809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:04.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.533+0000 7f36bf4b4700 1 -- 172.21.15.40:0/2907701840 shutdown_connections 2023-09-30T22:29:04.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.533+0000 7f36bf4b4700 1 -- 172.21.15.40:0/2907701840 wait complete. 2023-09-30T22:29:04.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.534+0000 7f36bf4b4700 1 Processor -- start 2023-09-30T22:29:04.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.534+0000 7f36bf4b4700 1 -- start start 2023-09-30T22:29:04.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.534+0000 7f36bf4b4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36b809d920 0x7f36b811e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.534+0000 7f36bf4b4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36b8133ca0 0x7f36b811e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.534+0000 7f36bf4b4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36b81223d0 0x7f36b811eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.534+0000 7f36bf4b4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b8121ed0 con 0x7f36b809d920 2023-09-30T22:29:04.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.534+0000 7f36bf4b4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b8120c30 con 0x7f36b8133ca0 2023-09-30T22:29:04.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.534+0000 7f36bf4b4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36b81212a0 con 0x7f36b81223d0 2023-09-30T22:29:04.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.535+0000 7f36bda51700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36b81223d0 0x7f36b811eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.535+0000 7f36bda51700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36b81223d0 0x7f36b811eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48350/0 (socket says 172.21.15.40:48350) 2023-09-30T22:29:04.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.535+0000 7f36bda51700 1 -- 172.21.15.40:0/1717219907 learned_addr learned my addr 172.21.15.40:0/1717219907 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:04.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.535+0000 7f36bca4f700 1 --2- 172.21.15.40:0/1717219907 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36b8133ca0 0x7f36b811e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.535+0000 7f36bda51700 1 -- 172.21.15.40:0/1717219907 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36b8133ca0 msgr2=0x7f36b811e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.535+0000 7f36bda51700 1 --2- 172.21.15.40:0/1717219907 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36b8133ca0 0x7f36b811e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.535+0000 7f36bda51700 1 -- 172.21.15.40:0/1717219907 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36b809d920 msgr2=0x7f36b811e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.535+0000 7f36bda51700 1 --2- 172.21.15.40:0/1717219907 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36b809d920 0x7f36b811e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.535+0000 7f36bda51700 1 -- 172.21.15.40:0/1717219907 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b4009500 con 0x7f36b81223d0 2023-09-30T22:29:04.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.535+0000 7f36bda51700 1 --2- 172.21.15.40:0/1717219907 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36b81223d0 0x7f36b811eeb0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f36b000c870 tx=0x7f36b000cb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:04.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.535+0000 7f36adffb700 1 -- 172.21.15.40:0/1717219907 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b0003e30 con 0x7f36b81223d0 2023-09-30T22:29:04.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.535+0000 7f36adffb700 1 -- 172.21.15.40:0/1717219907 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b0005070 con 0x7f36b81223d0 2023-09-30T22:29:04.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.535+0000 7f36adffb700 1 -- 172.21.15.40:0/1717219907 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b00053e0 con 0x7f36b81223d0 2023-09-30T22:29:04.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.536+0000 7f36bf4b4700 1 -- 172.21.15.40:0/1717219907 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a80094a0 con 0x7f36b81223d0 2023-09-30T22:29:04.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.536+0000 7f36bf4b4700 1 -- 172.21.15.40:0/1717219907 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b80a24b0 con 0x7f36b81223d0 2023-09-30T22:29:04.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.537+0000 7f36adffb700 1 -- 172.21.15.40:0/1717219907 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f36b0005540 con 0x7f36b81223d0 2023-09-30T22:29:04.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.537+0000 7f36adffb700 1 -- 172.21.15.40:0/1717219907 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f36b003ed90 con 0x7f36b81223d0 2023-09-30T22:29:04.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.537+0000 7f36bf4b4700 1 -- 172.21.15.40:0/1717219907 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b8121890 con 0x7f36b81223d0 2023-09-30T22:29:04.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.542+0000 7f36adffb700 1 -- 172.21.15.40:0/1717219907 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f36b8121890 con 0x7f36b81223d0 2023-09-30T22:29:04.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.571+0000 7f9201918700 1 Processor -- start 2023-09-30T22:29:04.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.571+0000 7f9201918700 1 -- start start 2023-09-30T22:29:04.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.572+0000 7f9201918700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f91fc09d450 0x7f91fc09d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.572+0000 7f9201918700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f91fc09dd60 0x7f91fc1301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.572+0000 7f9201918700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91fc09c3b0 con 0x7f91fc130700 2023-09-30T22:29:04.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.572+0000 7f9201918700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91fc09a6b0 con 0x7f91fc09d450 2023-09-30T22:29:04.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.572+0000 7f9201918700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc09b4f0 con 0x7f91fc09dd60 2023-09-30T22:29:04.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.572+0000 7f91faffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f91fc09d450 0x7f91fc09d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.572+0000 7f91faffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f91fc09d450 0x7f91fc09d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46536/0 (socket says 172.21.15.40:46536) 2023-09-30T22:29:04.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.573+0000 7f91faffd700 1 -- 172.21.15.40:0/2511788783 learned_addr learned my addr 172.21.15.40:0/2511788783 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:04.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.573+0000 7f91fb7fe700 1 --1- 172.21.15.40:0/2511788783 >> v1:172.21.15.40:6789/0 conn(0x7f91fc130700 0x7f91fc137410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46908/0 (socket says 172.21.15.40:46908) 2023-09-30T22:29:04.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.573+0000 7f91faffd700 1 -- 172.21.15.40:0/2511788783 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f91fc09dd60 msgr2=0x7f91fc1301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:04.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.573+0000 7f91faffd700 1 --2- 172.21.15.40:0/2511788783 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f91fc09dd60 0x7f91fc1301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.573+0000 7f91faffd700 1 -- 172.21.15.40:0/2511788783 >> v1:172.21.15.40:6789/0 conn(0x7f91fc130700 legacy=0x7f91fc137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.573+0000 7f91faffd700 1 -- 172.21.15.40:0/2511788783 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91fc09af90 con 0x7f91fc09d450 2023-09-30T22:29:04.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.573+0000 7f91faffd700 1 --2- 172.21.15.40:0/2511788783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91fc09d450 0x7f91fc09d820 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f91ec0098f0 tx=0x7f91ec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee808272b3ff9de server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:04.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.573+0000 7f91f9ffb700 1 -- 172.21.15.40:0/2511788783 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec00f940 con 0x7f91fc09d450 2023-09-30T22:29:04.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.573+0000 7f91f9ffb700 1 -- 172.21.15.40:0/2511788783 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ec00faa0 con 0x7f91fc09d450 2023-09-30T22:29:04.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.573+0000 7f91f9ffb700 1 -- 172.21.15.40:0/2511788783 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec00fe30 con 0x7f91fc09d450 2023-09-30T22:29:04.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.574+0000 7f9201918700 1 -- 172.21.15.40:0/2511788783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91fc09d450 msgr2=0x7f91fc09d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.574+0000 7f9201918700 1 --2- 172.21.15.40:0/2511788783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91fc09d450 0x7f91fc09d820 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f91ec0098f0 tx=0x7f91ec009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:04.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.574+0000 7f9201918700 1 -- 172.21.15.40:0/2511788783 shutdown_connections 2023-09-30T22:29:04.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.574+0000 7f9201918700 1 --2- 172.21.15.40:0/2511788783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91fc09d450 0x7f91fc09d820 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.574+0000 7f9201918700 1 --2- 172.21.15.40:0/2511788783 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f91fc09dd60 0x7f91fc1301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.574+0000 7f9201918700 1 -- 172.21.15.40:0/2511788783 >> 172.21.15.40:0/2511788783 conn(0x7f91fc0a2a00 msgr2=0x7f91fc0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:04.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.574+0000 7f9201918700 1 -- 172.21.15.40:0/2511788783 shutdown_connections 2023-09-30T22:29:04.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.574+0000 7f9201918700 1 -- 172.21.15.40:0/2511788783 wait complete. 2023-09-30T22:29:04.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.576+0000 7f9201918700 1 Processor -- start 2023-09-30T22:29:04.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.576+0000 7f2deb839700 1 Processor -- start 2023-09-30T22:29:04.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.576+0000 7f9201918700 1 -- start start 2023-09-30T22:29:04.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.576+0000 7f9201918700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91fc09d450 0x7f91fc1c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.577+0000 7f9201918700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f91fc09dd60 0x7f91fc1c4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.577+0000 7f9201918700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f91fc130700 0x7f91fc1c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.577+0000 7f9201918700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc11d7f0 con 0x7f91fc09d450 2023-09-30T22:29:04.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.577+0000 7f9201918700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc11be80 con 0x7f91fc09dd60 2023-09-30T22:29:04.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.577+0000 7f9201918700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc11de70 con 0x7f91fc130700 2023-09-30T22:29:04.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.577+0000 7f91faffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91fc09d450 0x7f91fc1c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.577+0000 7f91faffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91fc09d450 0x7f91fc1c41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46556/0 (socket says 172.21.15.40:46556) 2023-09-30T22:29:04.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.577+0000 7f91faffd700 1 -- 172.21.15.40:0/184921736 learned_addr learned my addr 172.21.15.40:0/184921736 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:04.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.577+0000 7f91fa7fc700 1 --2- 172.21.15.40:0/184921736 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f91fc09dd60 0x7f91fc1c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.576+0000 7f2deb839700 1 -- start start 2023-09-30T22:29:04.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.576+0000 7f2deb839700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2de413b130 0x7f2de413d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.576+0000 7f2deb839700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2de413da50 0x7f2de413fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.576+0000 7f2deb839700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de4137e20 con 0x7f2de4138250 2023-09-30T22:29:04.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.576+0000 7f2deb839700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de4138d30 con 0x7f2de413b130 2023-09-30T22:29:04.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.576+0000 7f2deb839700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2de4138050 con 0x7f2de413da50 2023-09-30T22:29:04.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.577+0000 7f2de95d5700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2de4138250 0x7f2de4138620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46914/0 (socket says 172.21.15.40:46914) 2023-09-30T22:29:04.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.577+0000 7f2de95d5700 1 -- 172.21.15.40:0/1017934989 learned_addr learned my addr 172.21.15.40:0/1017934989 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:29:04.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.577+0000 7f2de9dd6700 1 --2- 172.21.15.40:0/1017934989 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2de413da50 0x7f2de413fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.577+0000 7f2de8dd4700 1 --2- 172.21.15.40:0/1017934989 >> v2:172.21.15.40:3300/0 conn(0x7f2de413b130 0x7f2de413d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.577+0000 7f91fb7fe700 1 --2- 172.21.15.40:0/184921736 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f91fc130700 0x7f91fc1c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.577+0000 7f2ddbfff700 1 -- 172.21.15.40:0/1017934989 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 875720185 0 0) 0x7f2de4137e20 con 0x7f2de4138250 2023-09-30T22:29:04.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.577+0000 7f2ddbfff700 1 -- 172.21.15.40:0/1017934989 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dd00035b0 con 0x7f2de4138250 2023-09-30T22:29:04.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.577+0000 7f2de9dd6700 1 -- 172.21.15.40:0/1017934989 >> v2:172.21.15.40:3300/0 conn(0x7f2de413b130 msgr2=0x7f2de413d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:04.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.577+0000 7f2de9dd6700 1 --2- 172.21.15.40:0/1017934989 >> v2:172.21.15.40:3300/0 conn(0x7f2de413b130 0x7f2de413d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.577+0000 7f2de9dd6700 1 -- 172.21.15.40:0/1017934989 >> v1:172.21.15.40:6789/0 conn(0x7f2de4138250 legacy=0x7f2de4138620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.577+0000 7f2de9dd6700 1 -- 172.21.15.40:0/1017934989 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de409b010 con 0x7f2de413da50 2023-09-30T22:29:04.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.577+0000 7f91fa7fc700 1 -- 172.21.15.40:0/184921736 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f91fc130700 msgr2=0x7f91fc1c4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.577+0000 7f91fa7fc700 1 --2- 172.21.15.40:0/184921736 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f91fc130700 0x7f91fc1c4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.577+0000 7f91fa7fc700 1 -- 172.21.15.40:0/184921736 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91fc09d450 msgr2=0x7f91fc1c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.577+0000 7f91fa7fc700 1 --2- 172.21.15.40:0/184921736 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91fc09d450 0x7f91fc1c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.577+0000 7f91fa7fc700 1 -- 172.21.15.40:0/184921736 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ec009550 con 0x7f91fc09dd60 2023-09-30T22:29:04.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.578+0000 7f2de8dd4700 1 --2- 172.21.15.40:0/1017934989 >> v2:172.21.15.40:3300/0 conn(0x7f2de413b130 0x7f2de413d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:04.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.578+0000 7f2de9dd6700 1 --2- 172.21.15.40:0/1017934989 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2de413da50 0x7f2de413fe30 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc009d90 tx=0x7f2ddc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8314d0998ac6b4d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:04.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.578+0000 7f91fa7fc700 1 --2- 172.21.15.40:0/184921736 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f91fc09dd60 0x7f91fc1c4700 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f91f000b450 tx=0x7f91f000b760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:04.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.578+0000 7f91e3fff700 1 -- 172.21.15.40:0/184921736 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f0011830 con 0x7f91fc09dd60 2023-09-30T22:29:04.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.578+0000 7f91e3fff700 1 -- 172.21.15.40:0/184921736 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f0011990 con 0x7f91fc09dd60 2023-09-30T22:29:04.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.578+0000 7f91e3fff700 1 -- 172.21.15.40:0/184921736 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f0011d40 con 0x7f91fc09dd60 2023-09-30T22:29:04.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.579+0000 7f2ddbfff700 1 -- 172.21.15.40:0/1017934989 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc00e070 con 0x7f2de413da50 2023-09-30T22:29:04.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.579+0000 7f2ddbfff700 1 -- 172.21.15.40:0/1017934989 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ddc00bb20 con 0x7f2de413da50 2023-09-30T22:29:04.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.579+0000 7f2ddbfff700 1 -- 172.21.15.40:0/1017934989 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc012430 con 0x7f2de413da50 2023-09-30T22:29:04.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.578+0000 7f9201918700 1 -- 172.21.15.40:0/184921736 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91fc0a2480 con 0x7f91fc09dd60 2023-09-30T22:29:04.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.578+0000 7f9201918700 1 -- 172.21.15.40:0/184921736 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91fc12ed20 con 0x7f91fc09dd60 2023-09-30T22:29:04.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.579+0000 7f91e3fff700 1 -- 172.21.15.40:0/184921736 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f91f001a400 con 0x7f91fc09dd60 2023-09-30T22:29:04.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.579+0000 7f9201918700 1 -- 172.21.15.40:0/184921736 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91fc062380 con 0x7f91fc09dd60 2023-09-30T22:29:04.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.579+0000 7f2deb839700 1 -- 172.21.15.40:0/1017934989 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2de413da50 msgr2=0x7f2de413fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.579+0000 7f2deb839700 1 --2- 172.21.15.40:0/1017934989 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2de413da50 0x7f2de413fe30 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc009d90 tx=0x7f2ddc00b330 comp rx=0 tx=0).stop 2023-09-30T22:29:04.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.580+0000 7f91e3fff700 1 -- 172.21.15.40:0/184921736 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f91f0040b40 con 0x7f91fc09dd60 2023-09-30T22:29:04.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.580+0000 7f2deb839700 1 -- 172.21.15.40:0/1017934989 shutdown_connections 2023-09-30T22:29:04.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.580+0000 7f2deb839700 1 --2- 172.21.15.40:0/1017934989 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2de413da50 0x7f2de413fe30 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.580+0000 7f2deb839700 1 --2- 172.21.15.40:0/1017934989 >> v2:172.21.15.40:3300/0 conn(0x7f2de413b130 0x7f2de413d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.580+0000 7f2deb839700 1 -- 172.21.15.40:0/1017934989 >> 172.21.15.40:0/1017934989 conn(0x7f2de40a2a00 msgr2=0x7f2de40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:04.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.584+0000 7f2deb839700 1 -- 172.21.15.40:0/1017934989 shutdown_connections 2023-09-30T22:29:04.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.584+0000 7f2deb839700 1 -- 172.21.15.40:0/1017934989 wait complete. 2023-09-30T22:29:04.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.585+0000 7f2deb839700 1 Processor -- start 2023-09-30T22:29:04.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.585+0000 7f2deb839700 1 -- start start 2023-09-30T22:29:04.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.585+0000 7f2deb839700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2de4138250 0x7f2de4134dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.585+0000 7f2deb839700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2de413b130 0x7f2de4135300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.585+0000 7f2deb839700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2de413da50 0x7f2de4133830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.585+0000 7f2deb839700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de4135840 con 0x7f2de4138250 2023-09-30T22:29:04.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.585+0000 7f2deb839700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de4140740 con 0x7f2de413b130 2023-09-30T22:29:04.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.585+0000 7f2deb839700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2de413f7e0 con 0x7f2de413da50 2023-09-30T22:29:04.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.585+0000 7f2de95d5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2de4138250 0x7f2de4134dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.585+0000 7f2de95d5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2de4138250 0x7f2de4134dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46570/0 (socket says 172.21.15.40:46570) 2023-09-30T22:29:04.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.586+0000 7f2de8dd4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2de413b130 0x7f2de4135300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.586+0000 7f2de95d5700 1 -- 172.21.15.40:0/3347746610 learned_addr learned my addr 172.21.15.40:0/3347746610 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:04.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.586+0000 7f2de9dd6700 1 --2- 172.21.15.40:0/3347746610 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2de413da50 0x7f2de4133830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.586+0000 7f2de95d5700 1 -- 172.21.15.40:0/3347746610 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2de413da50 msgr2=0x7f2de4133830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.586+0000 7f2de95d5700 1 --2- 172.21.15.40:0/3347746610 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2de413da50 0x7f2de4133830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.586+0000 7f2de95d5700 1 -- 172.21.15.40:0/3347746610 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2de413b130 msgr2=0x7f2de4135300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.586+0000 7f2de95d5700 1 --2- 172.21.15.40:0/3347746610 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2de413b130 0x7f2de4135300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.586+0000 7f2de95d5700 1 -- 172.21.15.40:0/3347746610 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ddc009a70 con 0x7f2de4138250 2023-09-30T22:29:04.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.586+0000 7f2de95d5700 1 --2- 172.21.15.40:0/3347746610 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2de4138250 0x7f2de4134dc0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f2de000c730 tx=0x7f2de000ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:04.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.586+0000 7f2dd9ffb700 1 -- 172.21.15.40:0/3347746610 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de0005d70 con 0x7f2de4138250 2023-09-30T22:29:04.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.586+0000 7f2dd9ffb700 1 -- 172.21.15.40:0/3347746610 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de00070d0 con 0x7f2de4138250 2023-09-30T22:29:04.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.586+0000 7f2dd9ffb700 1 -- 172.21.15.40:0/3347746610 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de0007440 con 0x7f2de4138250 2023-09-30T22:29:04.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.586+0000 7f2deb839700 1 -- 172.21.15.40:0/3347746610 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de413e820 con 0x7f2de4138250 2023-09-30T22:29:04.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.587+0000 7f2deb839700 1 -- 172.21.15.40:0/3347746610 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de413e3a0 con 0x7f2de4138250 2023-09-30T22:29:04.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.587+0000 7f2dd9ffb700 1 -- 172.21.15.40:0/3347746610 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2de00075a0 con 0x7f2de4138250 2023-09-30T22:29:04.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.588+0000 7f2dd9ffb700 1 -- 172.21.15.40:0/3347746610 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f2de003ec20 con 0x7f2de4138250 2023-09-30T22:29:04.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.588+0000 7f2deb839700 1 -- 172.21.15.40:0/3347746610 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de413f480 con 0x7f2de4138250 2023-09-30T22:29:04.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.589+0000 7f91e3fff700 1 -- 172.21.15.40:0/184921736 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f91f0044060 con 0x7f91fc09dd60 2023-09-30T22:29:04.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.593+0000 7f2dd9ffb700 1 -- 172.21.15.40:0/3347746610 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2de0017020 con 0x7f2de4138250 2023-09-30T22:29:04.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.671+0000 7fd012e7d700 1 -- 172.21.15.40:0/417079503 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd00c062380 con 0x7fd00c139510 2023-09-30T22:29:04.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.671+0000 7fd0097fa700 1 -- 172.21.15.40:0/417079503 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd004019020 con 0x7fd00c139510 2023-09-30T22:29:04.672 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:04.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.674+0000 7fd012e7d700 1 -- 172.21.15.40:0/417079503 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd00c139510 msgr2=0x7fd00c06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.674+0000 7fd012e7d700 1 --2- 172.21.15.40:0/417079503 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd00c139510 0x7fd00c06fc00 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fd00c09d5e0 tx=0x7fd004009ed0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.674+0000 7fd012e7d700 1 -- 172.21.15.40:0/417079503 shutdown_connections 2023-09-30T22:29:04.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.674+0000 7fd012e7d700 1 --2- 172.21.15.40:0/417079503 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd00c139510 0x7fd00c06fc00 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.674+0000 7fd012e7d700 1 --2- 172.21.15.40:0/417079503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd00c09c890 0x7fd00c06f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.674+0000 7fd012e7d700 1 --2- 172.21.15.40:0/417079503 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd00c136bf0 0x7fd00c06f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.674+0000 7fd012e7d700 1 -- 172.21.15.40:0/417079503 >> 172.21.15.40:0/417079503 conn(0x7fd00c0a7080 msgr2=0x7fd00c136fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:04.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.674+0000 7fd012e7d700 1 -- 172.21.15.40:0/417079503 shutdown_connections 2023-09-30T22:29:04.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.674+0000 7fd012e7d700 1 -- 172.21.15.40:0/417079503 wait complete. 2023-09-30T22:29:04.687 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:04.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.762+0000 7f36bf4b4700 1 -- 172.21.15.40:0/1717219907 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f36b8121890 con 0x7f36b81223d0 2023-09-30T22:29:04.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.763+0000 7f36adffb700 1 -- 172.21.15.40:0/1717219907 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f36b8121890 con 0x7f36b81223d0 2023-09-30T22:29:04.763 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:04.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.765+0000 7f36bf4b4700 1 -- 172.21.15.40:0/1717219907 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36b81223d0 msgr2=0x7f36b811eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.765+0000 7f36bf4b4700 1 --2- 172.21.15.40:0/1717219907 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36b81223d0 0x7f36b811eeb0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f36b000c870 tx=0x7f36b000cb80 comp rx=0 tx=0).stop 2023-09-30T22:29:04.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.765+0000 7f36bf4b4700 1 -- 172.21.15.40:0/1717219907 shutdown_connections 2023-09-30T22:29:04.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.765+0000 7f36bf4b4700 1 --2- 172.21.15.40:0/1717219907 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36b81223d0 0x7f36b811eeb0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.765+0000 7f36bf4b4700 1 --2- 172.21.15.40:0/1717219907 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36b809d920 0x7f36b811e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.765+0000 7f36bf4b4700 1 --2- 172.21.15.40:0/1717219907 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36b8133ca0 0x7f36b811e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.765+0000 7f36bf4b4700 1 -- 172.21.15.40:0/1717219907 >> 172.21.15.40:0/1717219907 conn(0x7f36b809fb20 msgr2=0x7f36b81333f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:04.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.765+0000 7f36bf4b4700 1 -- 172.21.15.40:0/1717219907 shutdown_connections 2023-09-30T22:29:04.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.765+0000 7f36bf4b4700 1 -- 172.21.15.40:0/1717219907 wait complete. 2023-09-30T22:29:04.778 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:04.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.790+0000 7f2deb839700 1 -- 172.21.15.40:0/3347746610 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2de4062380 con 0x7f2de4138250 2023-09-30T22:29:04.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.791+0000 7f2dd9ffb700 1 -- 172.21.15.40:0/3347746610 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2de0011be0 con 0x7f2de4138250 2023-09-30T22:29:04.791 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:04.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.793+0000 7f2deb839700 1 -- 172.21.15.40:0/3347746610 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2de4138250 msgr2=0x7f2de4134dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.793+0000 7f2deb839700 1 --2- 172.21.15.40:0/3347746610 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2de4138250 0x7f2de4134dc0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f2de000c730 tx=0x7f2de000ca40 comp rx=0 tx=0).stop 2023-09-30T22:29:04.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.793+0000 7f2deb839700 1 -- 172.21.15.40:0/3347746610 shutdown_connections 2023-09-30T22:29:04.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.793+0000 7f2deb839700 1 --2- 172.21.15.40:0/3347746610 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2de413da50 0x7f2de4133830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.793+0000 7f2deb839700 1 --2- 172.21.15.40:0/3347746610 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2de4138250 0x7f2de4134dc0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.793+0000 7f2deb839700 1 --2- 172.21.15.40:0/3347746610 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2de413b130 0x7f2de4135300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.793+0000 7f2deb839700 1 -- 172.21.15.40:0/3347746610 >> 172.21.15.40:0/3347746610 conn(0x7f2de40a2a00 msgr2=0x7f2de409d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:04.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.793+0000 7f2deb839700 1 -- 172.21.15.40:0/3347746610 shutdown_connections 2023-09-30T22:29:04.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.793+0000 7f2deb839700 1 -- 172.21.15.40:0/3347746610 wait complete. 2023-09-30T22:29:04.806 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:04.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.811+0000 7f9201918700 1 -- 172.21.15.40:0/184921736 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f91fc074330 con 0x7f91fc09dd60 2023-09-30T22:29:04.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.811+0000 7f91e3fff700 1 -- 172.21.15.40:0/184921736 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f91f0015070 con 0x7f91fc09dd60 2023-09-30T22:29:04.812 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:04.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.813+0000 7f9201918700 1 -- 172.21.15.40:0/184921736 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f91fc09dd60 msgr2=0x7f91fc1c4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.813+0000 7f9201918700 1 --2- 172.21.15.40:0/184921736 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f91fc09dd60 0x7f91fc1c4700 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f91f000b450 tx=0x7f91f000b760 comp rx=0 tx=0).stop 2023-09-30T22:29:04.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.814+0000 7f9201918700 1 -- 172.21.15.40:0/184921736 shutdown_connections 2023-09-30T22:29:04.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.814+0000 7f9201918700 1 --2- 172.21.15.40:0/184921736 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f91fc130700 0x7f91fc1c4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.814+0000 7f9201918700 1 --2- 172.21.15.40:0/184921736 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91fc09d450 0x7f91fc1c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.814+0000 7f9201918700 1 --2- 172.21.15.40:0/184921736 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f91fc09dd60 0x7f91fc1c4700 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.814+0000 7f9201918700 1 -- 172.21.15.40:0/184921736 >> 172.21.15.40:0/184921736 conn(0x7f91fc0a2a00 msgr2=0x7f91fc0a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:04.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.814+0000 7f9201918700 1 -- 172.21.15.40:0/184921736 shutdown_connections 2023-09-30T22:29:04.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:04.814+0000 7f9201918700 1 -- 172.21.15.40:0/184921736 wait complete. 2023-09-30T22:29:04.826 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:05.688 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:05.779 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:05.807 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:05.827 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:05.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.830+0000 7fa24f933700 1 Processor -- start 2023-09-30T22:29:05.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.830+0000 7fa24f933700 1 -- start start 2023-09-30T22:29:05.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.831+0000 7fa24f933700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa24809c890 0x7fa24809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.831+0000 7fa24f933700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa24809d920 0x7fa24809dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.831+0000 7fa24f933700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa24809e2b0 0x7fa24813ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.831+0000 7fa24f933700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2480a29d0 con 0x7fa24809c890 2023-09-30T22:29:05.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.831+0000 7fa24f933700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24809fb40 con 0x7fa24809d920 2023-09-30T22:29:05.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.831+0000 7fa24f933700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2480a2600 con 0x7fa24809e2b0 2023-09-30T22:29:05.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.831+0000 7fa24d6cf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa24809c890 0x7fa24809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.831+0000 7fa24cece700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa24809d920 0x7fa24809dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.831+0000 7fa24d6cf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa24809c890 0x7fa24809cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46584/0 (socket says 172.21.15.40:46584) 2023-09-30T22:29:05.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.831+0000 7fa24d6cf700 1 -- 172.21.15.40:0/3031543562 learned_addr learned my addr 172.21.15.40:0/3031543562 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:05.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.831+0000 7fa24ded0700 1 --2- 172.21.15.40:0/3031543562 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa24809e2b0 0x7fa24813ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.832+0000 7fa24d6cf700 1 -- 172.21.15.40:0/3031543562 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa24809e2b0 msgr2=0x7fa24813ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:05.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.832+0000 7fa24d6cf700 1 --2- 172.21.15.40:0/3031543562 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa24809e2b0 0x7fa24813ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.832+0000 7fa24d6cf700 1 -- 172.21.15.40:0/3031543562 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa24809d920 msgr2=0x7fa24809dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:05.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.832+0000 7fa24d6cf700 1 --2- 172.21.15.40:0/3031543562 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa24809d920 0x7fa24809dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.832+0000 7fa24d6cf700 1 -- 172.21.15.40:0/3031543562 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24809fed0 con 0x7fa24809c890 2023-09-30T22:29:05.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.832+0000 7fa24d6cf700 1 --2- 172.21.15.40:0/3031543562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa24809c890 0x7fa24809cc60 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fa244006fd0 tx=0x7fa244009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c05ae6001fad34 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:05.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.832+0000 7fa23ffff700 1 -- 172.21.15.40:0/3031543562 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa244005e30 con 0x7fa24809c890 2023-09-30T22:29:05.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.832+0000 7fa23ffff700 1 -- 172.21.15.40:0/3031543562 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa244004030 con 0x7fa24809c890 2023-09-30T22:29:05.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.832+0000 7fa23ffff700 1 -- 172.21.15.40:0/3031543562 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2440043e0 con 0x7fa24809c890 2023-09-30T22:29:05.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.833+0000 7fa24f933700 1 -- 172.21.15.40:0/3031543562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa24809c890 msgr2=0x7fa24809cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.833+0000 7fa24f933700 1 --2- 172.21.15.40:0/3031543562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa24809c890 0x7fa24809cc60 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fa244006fd0 tx=0x7fa244009bd0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.833+0000 7fa24f933700 1 -- 172.21.15.40:0/3031543562 shutdown_connections 2023-09-30T22:29:05.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.833+0000 7fa24f933700 1 --2- 172.21.15.40:0/3031543562 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa24809e2b0 0x7fa24813ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.833+0000 7fa24f933700 1 --2- 172.21.15.40:0/3031543562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa24809c890 0x7fa24809cc60 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.833+0000 7fa24f933700 1 --2- 172.21.15.40:0/3031543562 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa24809d920 0x7fa24809dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.833+0000 7fa24f933700 1 -- 172.21.15.40:0/3031543562 >> 172.21.15.40:0/3031543562 conn(0x7fa2480a7080 msgr2=0x7fa2480a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:05.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.833+0000 7fa24f933700 1 -- 172.21.15.40:0/3031543562 shutdown_connections 2023-09-30T22:29:05.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.833+0000 7fa24f933700 1 -- 172.21.15.40:0/3031543562 wait complete. 2023-09-30T22:29:05.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.835+0000 7fa24f933700 1 Processor -- start 2023-09-30T22:29:05.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.835+0000 7fa24f933700 1 -- start start 2023-09-30T22:29:05.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.835+0000 7fa24f933700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa24809c890 0x7fa24812d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.835+0000 7fa24f933700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa24809d920 0x7fa24812db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.835+0000 7fa24f933700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa24809e2b0 0x7fa24812e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.835+0000 7fa24f933700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa248130a30 con 0x7fa24809e2b0 2023-09-30T22:29:05.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.835+0000 7fa24f933700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2480a5ec0 con 0x7fa24809c890 2023-09-30T22:29:05.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.835+0000 7fa24f933700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa24809ecf0 con 0x7fa24809d920 2023-09-30T22:29:05.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.835+0000 7fa24d6cf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa24809c890 0x7fa24812d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.835+0000 7fa24d6cf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa24809c890 0x7fa24812d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48718/0 (socket says 172.21.15.40:48718) 2023-09-30T22:29:05.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.835+0000 7fa24d6cf700 1 -- 172.21.15.40:0/4060606827 learned_addr learned my addr 172.21.15.40:0/4060606827 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:05.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.835+0000 7fa24ded0700 1 --2- 172.21.15.40:0/4060606827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa24809e2b0 0x7fa24812e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.836+0000 7fa24ded0700 1 -- 172.21.15.40:0/4060606827 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa24809d920 msgr2=0x7fa24812db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.836+0000 7fa24ded0700 1 --2- 172.21.15.40:0/4060606827 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa24809d920 0x7fa24812db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.836+0000 7fa24ded0700 1 -- 172.21.15.40:0/4060606827 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa24809c890 msgr2=0x7fa24812d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.836+0000 7fa24ded0700 1 --2- 172.21.15.40:0/4060606827 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa24809c890 0x7fa24812d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.836+0000 7fa24ded0700 1 -- 172.21.15.40:0/4060606827 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa244009500 con 0x7fa24809e2b0 2023-09-30T22:29:05.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.836+0000 7fa24ded0700 1 --2- 172.21.15.40:0/4060606827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa24809e2b0 0x7fa24812e070 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fa24000efc0 tx=0x7fa24000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:05.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.836+0000 7fa23dffb700 1 -- 172.21.15.40:0/4060606827 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24000cd40 con 0x7fa24809e2b0 2023-09-30T22:29:05.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.836+0000 7fa23dffb700 1 -- 172.21.15.40:0/4060606827 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24000f040 con 0x7fa24809e2b0 2023-09-30T22:29:05.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.836+0000 7fa24f933700 1 -- 172.21.15.40:0/4060606827 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa248130770 con 0x7fa24809e2b0 2023-09-30T22:29:05.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.836+0000 7fa23dffb700 1 -- 172.21.15.40:0/4060606827 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2400146c0 con 0x7fa24809e2b0 2023-09-30T22:29:05.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.836+0000 7fa24f933700 1 -- 172.21.15.40:0/4060606827 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa24812e5b0 con 0x7fa24809e2b0 2023-09-30T22:29:05.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.837+0000 7fa23dffb700 1 -- 172.21.15.40:0/4060606827 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa240014820 con 0x7fa24809e2b0 2023-09-30T22:29:05.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.838+0000 7fa23dffb700 1 -- 172.21.15.40:0/4060606827 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa240041880 con 0x7fa24809e2b0 2023-09-30T22:29:05.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.838+0000 7fa24f933700 1 -- 172.21.15.40:0/4060606827 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa248062380 con 0x7fa24809e2b0 2023-09-30T22:29:05.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.844+0000 7fa23dffb700 1 -- 172.21.15.40:0/4060606827 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa240018020 con 0x7fa24809e2b0 2023-09-30T22:29:05.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.932+0000 7f3ae95db700 1 Processor -- start 2023-09-30T22:29:05.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.932+0000 7f3ae95db700 1 -- start start 2023-09-30T22:29:05.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.933+0000 7f3ae95db700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3ae412e590 0x7f3ae412e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.933+0000 7f3ae95db700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ae412eea0 0x7f3ae412d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.933+0000 7f3ae95db700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ae412d6d0 0x7f3ae412db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.933+0000 7f3ae95db700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ae409ca30 con 0x7f3ae412e590 2023-09-30T22:29:05.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.933+0000 7f3ae95db700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae409ab70 con 0x7f3ae412eea0 2023-09-30T22:29:05.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.933+0000 7f3ae95db700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae409bd70 con 0x7f3ae412d6d0 2023-09-30T22:29:05.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.933+0000 7f3ae27fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ae412eea0 0x7f3ae412d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.933+0000 7f3ae27fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ae412eea0 0x7f3ae412d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48720/0 (socket says 172.21.15.40:48720) 2023-09-30T22:29:05.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.933+0000 7f3ae27fc700 1 -- 172.21.15.40:0/4256957566 learned_addr learned my addr 172.21.15.40:0/4256957566 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:05.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.933+0000 7f3ae2ffd700 1 --2- 172.21.15.40:0/4256957566 >> v2:172.21.15.40:3300/0 conn(0x7f3ae412e590 0x7f3ae412e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.933+0000 7f3ae37fe700 1 --2- 172.21.15.40:0/4256957566 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ae412d6d0 0x7f3ae412db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.934+0000 7f3ae27fc700 1 -- 172.21.15.40:0/4256957566 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ae412d6d0 msgr2=0x7f3ae412db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:05.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.934+0000 7f3ae27fc700 1 --2- 172.21.15.40:0/4256957566 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ae412d6d0 0x7f3ae412db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.934+0000 7f3ae27fc700 1 -- 172.21.15.40:0/4256957566 >> v2:172.21.15.40:3300/0 conn(0x7f3ae412e590 msgr2=0x7f3ae412e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:05.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.934+0000 7f3ae27fc700 1 --2- 172.21.15.40:0/4256957566 >> v2:172.21.15.40:3300/0 conn(0x7f3ae412e590 0x7f3ae412e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.934+0000 7f3ae27fc700 1 -- 172.21.15.40:0/4256957566 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae409b270 con 0x7f3ae412eea0 2023-09-30T22:29:05.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.934+0000 7f3ae2ffd700 1 --2- 172.21.15.40:0/4256957566 >> v2:172.21.15.40:3300/0 conn(0x7f3ae412e590 0x7f3ae412e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:05.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.934+0000 7f3ae27fc700 1 --2- 172.21.15.40:0/4256957566 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ae412eea0 0x7f3ae412d190 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f3ad80098f0 tx=0x7f3ad8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6f6d54a72823406 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:05.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.934+0000 7f3ae1ffb700 1 -- 172.21.15.40:0/4256957566 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8011830 con 0x7f3ae412eea0 2023-09-30T22:29:05.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.934+0000 7f3ae1ffb700 1 -- 172.21.15.40:0/4256957566 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad8011990 con 0x7f3ae412eea0 2023-09-30T22:29:05.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.934+0000 7f3ae1ffb700 1 -- 172.21.15.40:0/4256957566 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8011d20 con 0x7f3ae412eea0 2023-09-30T22:29:05.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.935+0000 7f3ae95db700 1 -- 172.21.15.40:0/4256957566 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ae412eea0 msgr2=0x7f3ae412d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.935+0000 7f3ae95db700 1 --2- 172.21.15.40:0/4256957566 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ae412eea0 0x7f3ae412d190 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f3ad80098f0 tx=0x7f3ad8009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:05.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.935+0000 7f3ae95db700 1 -- 172.21.15.40:0/4256957566 shutdown_connections 2023-09-30T22:29:05.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.935+0000 7f3ae95db700 1 --2- 172.21.15.40:0/4256957566 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ae412d6d0 0x7f3ae412db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.935+0000 7f3ae95db700 1 --2- 172.21.15.40:0/4256957566 >> v2:172.21.15.40:3300/0 conn(0x7f3ae412e590 0x7f3ae412e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.935+0000 7f3ae95db700 1 --2- 172.21.15.40:0/4256957566 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ae412eea0 0x7f3ae412d190 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.935+0000 7f3ae95db700 1 -- 172.21.15.40:0/4256957566 >> 172.21.15.40:0/4256957566 conn(0x7f3ae40a2a00 msgr2=0x7f3ae40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:05.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.935+0000 7f3ae95db700 1 -- 172.21.15.40:0/4256957566 shutdown_connections 2023-09-30T22:29:05.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.935+0000 7f3ae95db700 1 -- 172.21.15.40:0/4256957566 wait complete. 2023-09-30T22:29:05.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.936+0000 7f3ae95db700 1 Processor -- start 2023-09-30T22:29:05.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.937+0000 7f3ae95db700 1 -- start start 2023-09-30T22:29:05.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.937+0000 7f3ae95db700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ae412d6d0 0x7f3ae41198a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.937+0000 7f3ae95db700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ae412e590 0x7f3ae4119de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.937+0000 7f3ae95db700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ae412eea0 0x7f3ae411a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.937+0000 7f3ae95db700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae411ba90 con 0x7f3ae412d6d0 2023-09-30T22:29:05.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.937+0000 7f3ae95db700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae411cb50 con 0x7f3ae412e590 2023-09-30T22:29:05.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.937+0000 7f3ae95db700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae409b4b0 con 0x7f3ae412eea0 2023-09-30T22:29:05.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.937+0000 7f3ae37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ae412eea0 0x7f3ae411a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.937+0000 7f3ae37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ae412eea0 0x7f3ae411a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48398/0 (socket says 172.21.15.40:48398) 2023-09-30T22:29:05.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.938+0000 7f3ae2ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ae412d6d0 0x7f3ae41198a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.938+0000 7f3ae37fe700 1 -- 172.21.15.40:0/441507906 learned_addr learned my addr 172.21.15.40:0/441507906 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:05.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.938+0000 7f3ae27fc700 1 --2- 172.21.15.40:0/441507906 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ae412e590 0x7f3ae4119de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.938+0000 7f3ae37fe700 1 -- 172.21.15.40:0/441507906 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ae412e590 msgr2=0x7f3ae4119de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.938+0000 7f3ae37fe700 1 --2- 172.21.15.40:0/441507906 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ae412e590 0x7f3ae4119de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.938+0000 7f3ae37fe700 1 -- 172.21.15.40:0/441507906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ae412d6d0 msgr2=0x7f3ae41198a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.938+0000 7f3ae37fe700 1 --2- 172.21.15.40:0/441507906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ae412d6d0 0x7f3ae41198a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.938+0000 7f3ae37fe700 1 -- 172.21.15.40:0/441507906 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad40094a0 con 0x7f3ae412eea0 2023-09-30T22:29:05.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.938+0000 7f3ae37fe700 1 --2- 172.21.15.40:0/441507906 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ae412eea0 0x7f3ae411a320 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f3adc00eed0 tx=0x7f3adc00b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:05.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.938+0000 7f3acb7fe700 1 -- 172.21.15.40:0/441507906 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3adc010040 con 0x7f3ae412eea0 2023-09-30T22:29:05.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.938+0000 7f3acb7fe700 1 -- 172.21.15.40:0/441507906 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3adc00bd30 con 0x7f3ae412eea0 2023-09-30T22:29:05.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.938+0000 7f3acb7fe700 1 -- 172.21.15.40:0/441507906 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3adc00bea0 con 0x7f3ae412eea0 2023-09-30T22:29:05.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.938+0000 7f3ae95db700 1 -- 172.21.15.40:0/441507906 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ad8009550 con 0x7f3ae412eea0 2023-09-30T22:29:05.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.938+0000 7f3ae95db700 1 -- 172.21.15.40:0/441507906 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae411b4b0 con 0x7f3ae412eea0 2023-09-30T22:29:05.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.939+0000 7f3acb7fe700 1 -- 172.21.15.40:0/441507906 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3adc014620 con 0x7f3ae412eea0 2023-09-30T22:29:05.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.940+0000 7f3acb7fe700 1 -- 172.21.15.40:0/441507906 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3adc03fae0 con 0x7f3ae412eea0 2023-09-30T22:29:05.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.940+0000 7f3ae95db700 1 -- 172.21.15.40:0/441507906 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ae406edb0 con 0x7f3ae412eea0 2023-09-30T22:29:05.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.949+0000 7f3acb7fe700 1 -- 172.21.15.40:0/441507906 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3adc018080 con 0x7f3ae412eea0 2023-09-30T22:29:05.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.957+0000 7ff2c2321700 1 Processor -- start 2023-09-30T22:29:05.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.957+0000 7ff2c2321700 1 -- start start 2023-09-30T22:29:05.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.958+0000 7ff2c2321700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff2bc06f070 0x7ff2bc06f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.958+0000 7ff2c2321700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff2bc06f980 0x7ff2bc097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.958+0000 7ff2c2321700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2bc070830 con 0x7ff2bc06fdb0 2023-09-30T22:29:05.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.958+0000 7ff2c2321700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2bc071af0 con 0x7ff2bc06f980 2023-09-30T22:29:05.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.958+0000 7ff2c2321700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2bc070ad0 con 0x7ff2bc06f070 2023-09-30T22:29:05.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.958+0000 7ff2c08be700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff2bc06fdb0 0x7ff2bc0975d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46928/0 (socket says 172.21.15.40:46928) 2023-09-30T22:29:05.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.958+0000 7ff2c08be700 1 -- 172.21.15.40:0/4070361834 learned_addr learned my addr 172.21.15.40:0/4070361834 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:29:05.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.958+0000 7ff2bb7fe700 1 --2- 172.21.15.40:0/4070361834 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff2bc06f980 0x7ff2bc097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.958+0000 7ff2bbfff700 1 --2- 172.21.15.40:0/4070361834 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff2bc06f070 0x7ff2bc06f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.958+0000 7ff2baffd700 1 -- 172.21.15.40:0/4070361834 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2056533680 0 0) 0x7ff2bc070830 con 0x7ff2bc06fdb0 2023-09-30T22:29:05.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.958+0000 7ff2baffd700 1 -- 172.21.15.40:0/4070361834 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2a40035b0 con 0x7ff2bc06fdb0 2023-09-30T22:29:05.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.959+0000 7ff2bb7fe700 1 -- 172.21.15.40:0/4070361834 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff2bc06f070 msgr2=0x7ff2bc06f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:05.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.959+0000 7ff2bb7fe700 1 --2- 172.21.15.40:0/4070361834 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff2bc06f070 0x7ff2bc06f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.959+0000 7ff2bb7fe700 1 -- 172.21.15.40:0/4070361834 >> v1:172.21.15.40:6789/0 conn(0x7ff2bc06fdb0 legacy=0x7ff2bc0975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.959+0000 7ff2bb7fe700 1 -- 172.21.15.40:0/4070361834 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2bc070de0 con 0x7ff2bc06f980 2023-09-30T22:29:05.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.959+0000 7ff2bb7fe700 1 --2- 172.21.15.40:0/4070361834 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff2bc06f980 0x7ff2bc097090 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0009870 tx=0x7ff2b0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e88e71761d53adc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:05.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.959+0000 7ff2baffd700 1 -- 172.21.15.40:0/4070361834 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0011830 con 0x7ff2bc06f980 2023-09-30T22:29:05.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.959+0000 7ff2baffd700 1 -- 172.21.15.40:0/4070361834 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b0011990 con 0x7ff2bc06f980 2023-09-30T22:29:05.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.959+0000 7ff2baffd700 1 -- 172.21.15.40:0/4070361834 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0011d20 con 0x7ff2bc06f980 2023-09-30T22:29:05.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.960+0000 7ff2c2321700 1 -- 172.21.15.40:0/4070361834 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff2bc06f980 msgr2=0x7ff2bc097090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.960+0000 7ff2c2321700 1 --2- 172.21.15.40:0/4070361834 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff2bc06f980 0x7ff2bc097090 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0009870 tx=0x7ff2b0009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:05.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.960+0000 7ff2c2321700 1 -- 172.21.15.40:0/4070361834 shutdown_connections 2023-09-30T22:29:05.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.960+0000 7ff2c2321700 1 --2- 172.21.15.40:0/4070361834 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff2bc06f070 0x7ff2bc06f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.960+0000 7ff2c2321700 1 --2- 172.21.15.40:0/4070361834 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff2bc06f980 0x7ff2bc097090 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.960+0000 7ff2c2321700 1 -- 172.21.15.40:0/4070361834 >> 172.21.15.40:0/4070361834 conn(0x7ff2bc0a41a0 msgr2=0x7ff2bc0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:05.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.960+0000 7ff2c2321700 1 -- 172.21.15.40:0/4070361834 shutdown_connections 2023-09-30T22:29:05.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.960+0000 7ff2c2321700 1 -- 172.21.15.40:0/4070361834 wait complete. 2023-09-30T22:29:05.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.961+0000 7ff2c2321700 1 Processor -- start 2023-09-30T22:29:05.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.961+0000 7ff2c2321700 1 -- start start 2023-09-30T22:29:05.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.962+0000 7ff2c2321700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff2bc06f070 0x7ff2bc1c0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.962+0000 7ff2c2321700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2bc06f980 0x7ff2bc1c13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.962+0000 7ff2c2321700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff2bc06fdb0 0x7ff2bc1c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.962+0000 7ff2c2321700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2bc12cc20 con 0x7ff2bc06f980 2023-09-30T22:29:05.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.962+0000 7ff2c2321700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2bc12e700 con 0x7ff2bc06fdb0 2023-09-30T22:29:05.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.962+0000 7ff2c2321700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2bc12c9f0 con 0x7ff2bc06f070 2023-09-30T22:29:05.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.962+0000 7ff2c08be700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff2bc06fdb0 0x7ff2bc1c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.962+0000 7ff2c08be700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff2bc06fdb0 0x7ff2bc1c3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48754/0 (socket says 172.21.15.40:48754) 2023-09-30T22:29:05.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.962+0000 7ff2c08be700 1 -- 172.21.15.40:0/938539633 learned_addr learned my addr 172.21.15.40:0/938539633 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:05.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.962+0000 7ff2bb7fe700 1 --2- 172.21.15.40:0/938539633 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2bc06f980 0x7ff2bc1c13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.962+0000 7ff2bbfff700 1 --2- 172.21.15.40:0/938539633 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff2bc06f070 0x7ff2bc1c0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.962+0000 7ff2c08be700 1 -- 172.21.15.40:0/938539633 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff2bc06f070 msgr2=0x7ff2bc1c0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.962+0000 7ff2c08be700 1 --2- 172.21.15.40:0/938539633 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff2bc06f070 0x7ff2bc1c0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.962+0000 7ff2c08be700 1 -- 172.21.15.40:0/938539633 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2bc06f980 msgr2=0x7ff2bc1c13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.962+0000 7ff2c08be700 1 --2- 172.21.15.40:0/938539633 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2bc06f980 0x7ff2bc1c13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.962+0000 7ff2c08be700 1 -- 172.21.15.40:0/938539633 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b00094a0 con 0x7ff2bc06fdb0 2023-09-30T22:29:05.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.963+0000 7ff2c08be700 1 --2- 172.21.15.40:0/938539633 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff2bc06fdb0 0x7ff2bc1c3ec0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff2b400cbe0 tx=0x7ff2b400cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:05.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.963+0000 7ff2b8ff9700 1 -- 172.21.15.40:0/938539633 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b400ab10 con 0x7ff2bc06fdb0 2023-09-30T22:29:05.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.963+0000 7ff2b8ff9700 1 -- 172.21.15.40:0/938539633 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b400ac70 con 0x7ff2bc06fdb0 2023-09-30T22:29:05.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.963+0000 7ff2c2321700 1 -- 172.21.15.40:0/938539633 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2bc06cac0 con 0x7ff2bc06fdb0 2023-09-30T22:29:05.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.963+0000 7ff2b8ff9700 1 -- 172.21.15.40:0/938539633 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4012400 con 0x7ff2bc06fdb0 2023-09-30T22:29:05.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.963+0000 7ff2c2321700 1 -- 172.21.15.40:0/938539633 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2bc12d660 con 0x7ff2bc06fdb0 2023-09-30T22:29:05.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.964+0000 7ff2b8ff9700 1 -- 172.21.15.40:0/938539633 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff2b401b3b0 con 0x7ff2bc06fdb0 2023-09-30T22:29:05.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.964+0000 7ff2c2321700 1 -- 172.21.15.40:0/938539633 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2bc062380 con 0x7ff2bc06fdb0 2023-09-30T22:29:05.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.964+0000 7ff2b8ff9700 1 -- 172.21.15.40:0/938539633 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff2b403f360 con 0x7ff2bc06fdb0 2023-09-30T22:29:05.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.969+0000 7ff2b8ff9700 1 -- 172.21.15.40:0/938539633 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff2b40192c0 con 0x7ff2bc06fdb0 2023-09-30T22:29:05.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.980+0000 7fb61a24b700 1 Processor -- start 2023-09-30T22:29:05.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.980+0000 7fb61a24b700 1 -- start start 2023-09-30T22:29:05.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.981+0000 7fb61a24b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb61409e400 0x7fb61413d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.981+0000 7fb61a24b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb61413db20 0x7fb61413ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.981+0000 7fb61a24b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb61409f1f0 con 0x7fb61409d920 2023-09-30T22:29:05.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.981+0000 7fb61a24b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb61409e820 con 0x7fb61409e400 2023-09-30T22:29:05.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.981+0000 7fb61a24b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6140a0380 con 0x7fb61413db20 2023-09-30T22:29:05.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.981+0000 7fb612ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb61409e400 0x7fb61413d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.981+0000 7fb612ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb61409e400 0x7fb61413d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46626/0 (socket says 172.21.15.40:46626) 2023-09-30T22:29:05.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.981+0000 7fb612ffd700 1 -- 172.21.15.40:0/320590485 learned_addr learned my addr 172.21.15.40:0/320590485 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:05.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.981+0000 7fb613fff700 1 --2- 172.21.15.40:0/320590485 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb61413db20 0x7fb61413ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.982+0000 7fb613fff700 1 -- 172.21.15.40:0/320590485 >> v2:172.21.15.40:3300/0 conn(0x7fb61409e400 msgr2=0x7fb61413d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:05.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.982+0000 7fb613fff700 1 --2- 172.21.15.40:0/320590485 >> v2:172.21.15.40:3300/0 conn(0x7fb61409e400 0x7fb61413d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.982+0000 7fb613fff700 1 -- 172.21.15.40:0/320590485 >> v1:172.21.15.40:6789/0 conn(0x7fb61409d920 legacy=0x7fb61409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.982+0000 7fb613fff700 1 -- 172.21.15.40:0/320590485 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6140a29c0 con 0x7fb61413db20 2023-09-30T22:29:05.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.982+0000 7fb613fff700 1 --2- 172.21.15.40:0/320590485 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb61413db20 0x7fb61413ff00 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb60c009dc0 tx=0x7fb60c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de37abf2b91881ac server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:05.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.982+0000 7fb6127fc700 1 -- 172.21.15.40:0/320590485 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c00e070 con 0x7fb61413db20 2023-09-30T22:29:05.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.982+0000 7fb6127fc700 1 -- 172.21.15.40:0/320590485 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60c00bae0 con 0x7fb61413db20 2023-09-30T22:29:05.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.982+0000 7fb6127fc700 1 -- 172.21.15.40:0/320590485 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c00be90 con 0x7fb61413db20 2023-09-30T22:29:05.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.983+0000 7fb61a24b700 1 -- 172.21.15.40:0/320590485 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb61413db20 msgr2=0x7fb61413ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.983+0000 7fb61a24b700 1 --2- 172.21.15.40:0/320590485 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb61413db20 0x7fb61413ff00 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb60c009dc0 tx=0x7fb60c00b330 comp rx=0 tx=0).stop 2023-09-30T22:29:05.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.983+0000 7fb61a24b700 1 -- 172.21.15.40:0/320590485 shutdown_connections 2023-09-30T22:29:05.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.983+0000 7fb61a24b700 1 --2- 172.21.15.40:0/320590485 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb61413db20 0x7fb61413ff00 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.983+0000 7fb61a24b700 1 --2- 172.21.15.40:0/320590485 >> v2:172.21.15.40:3300/0 conn(0x7fb61409e400 0x7fb61413d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.983+0000 7fb61a24b700 1 -- 172.21.15.40:0/320590485 >> 172.21.15.40:0/320590485 conn(0x7fb6140a7080 msgr2=0x7fb6140a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:05.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.983+0000 7fb61a24b700 1 -- 172.21.15.40:0/320590485 shutdown_connections 2023-09-30T22:29:05.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.983+0000 7fb61a24b700 1 -- 172.21.15.40:0/320590485 wait complete. 2023-09-30T22:29:05.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.984+0000 7fb61a24b700 1 Processor -- start 2023-09-30T22:29:05.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.984+0000 7fb61a24b700 1 -- start start 2023-09-30T22:29:05.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.985+0000 7fb61a24b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb61409d920 0x7fb614097bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.985+0000 7fb61a24b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb61409e400 0x7fb614098130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.985+0000 7fb61a24b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb61413db20 0x7fb614098670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.985+0000 7fb61a24b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61409adf0 con 0x7fb61413db20 2023-09-30T22:29:05.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.985+0000 7fb61a24b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb61409a0d0 con 0x7fb61409e400 2023-09-30T22:29:05.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.985+0000 7fb61a24b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb61409c2f0 con 0x7fb61409d920 2023-09-30T22:29:05.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.985+0000 7fb613fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb61413db20 0x7fb614098670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.985+0000 7fb613fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb61413db20 0x7fb614098670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46628/0 (socket says 172.21.15.40:46628) 2023-09-30T22:29:05.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.985+0000 7fb613fff700 1 -- 172.21.15.40:0/1540306194 learned_addr learned my addr 172.21.15.40:0/1540306194 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:05.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.985+0000 7fb612ffd700 1 --2- 172.21.15.40:0/1540306194 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb61409e400 0x7fb614098130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.985+0000 7fb6137fe700 1 --2- 172.21.15.40:0/1540306194 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb61409d920 0x7fb614097bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.986+0000 7fb613fff700 1 -- 172.21.15.40:0/1540306194 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb61409d920 msgr2=0x7fb614097bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.986+0000 7fb613fff700 1 --2- 172.21.15.40:0/1540306194 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb61409d920 0x7fb614097bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.986+0000 7fb613fff700 1 -- 172.21.15.40:0/1540306194 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb61409e400 msgr2=0x7fb614098130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.986+0000 7fb613fff700 1 --2- 172.21.15.40:0/1540306194 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb61409e400 0x7fb614098130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.986+0000 7fb613fff700 1 -- 172.21.15.40:0/1540306194 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60c009a70 con 0x7fb61413db20 2023-09-30T22:29:05.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.986+0000 7fb6137fe700 1 --2- 172.21.15.40:0/1540306194 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb61409d920 0x7fb614097bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:05.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.986+0000 7fb613fff700 1 --2- 172.21.15.40:0/1540306194 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb61413db20 0x7fb614098670 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fb60c013000 tx=0x7fb60c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:05.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.986+0000 7fb5fbfff700 1 -- 172.21.15.40:0/1540306194 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c0045d0 con 0x7fb61413db20 2023-09-30T22:29:05.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.986+0000 7fb5fbfff700 1 -- 172.21.15.40:0/1540306194 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60c020070 con 0x7fb61413db20 2023-09-30T22:29:05.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.986+0000 7fb5fbfff700 1 -- 172.21.15.40:0/1540306194 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c027480 con 0x7fb61413db20 2023-09-30T22:29:05.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.986+0000 7fb61a24b700 1 -- 172.21.15.40:0/1540306194 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb61409b710 con 0x7fb61413db20 2023-09-30T22:29:05.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.986+0000 7fb61a24b700 1 -- 172.21.15.40:0/1540306194 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb61409eba0 con 0x7fb61413db20 2023-09-30T22:29:05.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.987+0000 7fb61a24b700 1 -- 172.21.15.40:0/1540306194 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb61409b550 con 0x7fb61413db20 2023-09-30T22:29:05.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.988+0000 7fb5fbfff700 1 -- 172.21.15.40:0/1540306194 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb60c031430 con 0x7fb61413db20 2023-09-30T22:29:05.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.989+0000 7fb5fbfff700 1 -- 172.21.15.40:0/1540306194 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb60c022070 con 0x7fb61413db20 2023-09-30T22:29:05.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:05.997+0000 7fb5fbfff700 1 -- 172.21.15.40:0/1540306194 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb60c012430 con 0x7fb61413db20 2023-09-30T22:29:06.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.073+0000 7fa24f933700 1 -- 172.21.15.40:0/4060606827 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa248074620 con 0x7fa24809e2b0 2023-09-30T22:29:06.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.074+0000 7fa23dffb700 1 -- 172.21.15.40:0/4060606827 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa240045060 con 0x7fa24809e2b0 2023-09-30T22:29:06.075 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:06.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.076+0000 7fa24f933700 1 -- 172.21.15.40:0/4060606827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa24809e2b0 msgr2=0x7fa24812e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:06.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.076+0000 7fa24f933700 1 --2- 172.21.15.40:0/4060606827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa24809e2b0 0x7fa24812e070 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fa24000efc0 tx=0x7fa24000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.076+0000 7fa24f933700 1 -- 172.21.15.40:0/4060606827 shutdown_connections 2023-09-30T22:29:06.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.076+0000 7fa24f933700 1 --2- 172.21.15.40:0/4060606827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa24809e2b0 0x7fa24812e070 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.076+0000 7fa24f933700 1 --2- 172.21.15.40:0/4060606827 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa24809c890 0x7fa24812d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.076+0000 7fa24f933700 1 --2- 172.21.15.40:0/4060606827 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa24809d920 0x7fa24812db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.076+0000 7fa24f933700 1 -- 172.21.15.40:0/4060606827 >> 172.21.15.40:0/4060606827 conn(0x7fa2480a7080 msgr2=0x7fa2480a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:06.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.076+0000 7fa24f933700 1 -- 172.21.15.40:0/4060606827 shutdown_connections 2023-09-30T22:29:06.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.076+0000 7fa24f933700 1 -- 172.21.15.40:0/4060606827 wait complete. 2023-09-30T22:29:06.094 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:06.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.161+0000 7f3ae95db700 1 -- 172.21.15.40:0/441507906 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3ae4062380 con 0x7f3ae412eea0 2023-09-30T22:29:06.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.161+0000 7f3acb7fe700 1 -- 172.21.15.40:0/441507906 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3adc009e40 con 0x7f3ae412eea0 2023-09-30T22:29:06.163 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:06.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.164+0000 7f3ae95db700 1 -- 172.21.15.40:0/441507906 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ae412eea0 msgr2=0x7f3ae411a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:06.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.164+0000 7f3ae95db700 1 --2- 172.21.15.40:0/441507906 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ae412eea0 0x7f3ae411a320 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f3adc00eed0 tx=0x7f3adc00b390 comp rx=0 tx=0).stop 2023-09-30T22:29:06.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.164+0000 7f3ae95db700 1 -- 172.21.15.40:0/441507906 shutdown_connections 2023-09-30T22:29:06.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.164+0000 7f3ae95db700 1 --2- 172.21.15.40:0/441507906 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ae412eea0 0x7f3ae411a320 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.164+0000 7f3ae95db700 1 --2- 172.21.15.40:0/441507906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ae412d6d0 0x7f3ae41198a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.164+0000 7f3ae95db700 1 --2- 172.21.15.40:0/441507906 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ae412e590 0x7f3ae4119de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.164+0000 7f3ae95db700 1 -- 172.21.15.40:0/441507906 >> 172.21.15.40:0/441507906 conn(0x7f3ae40a2a00 msgr2=0x7f3ae412c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:06.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.164+0000 7f3ae95db700 1 -- 172.21.15.40:0/441507906 shutdown_connections 2023-09-30T22:29:06.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.164+0000 7f3ae95db700 1 -- 172.21.15.40:0/441507906 wait complete. 2023-09-30T22:29:06.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.173+0000 7ff2c2321700 1 -- 172.21.15.40:0/938539633 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff2bc074620 con 0x7ff2bc06fdb0 2023-09-30T22:29:06.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.174+0000 7ff2b8ff9700 1 -- 172.21.15.40:0/938539633 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff2b4017030 con 0x7ff2bc06fdb0 2023-09-30T22:29:06.174 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:06.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.176+0000 7ff2c2321700 1 -- 172.21.15.40:0/938539633 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff2bc06fdb0 msgr2=0x7ff2bc1c3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:06.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.176+0000 7ff2c2321700 1 --2- 172.21.15.40:0/938539633 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff2bc06fdb0 0x7ff2bc1c3ec0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff2b400cbe0 tx=0x7ff2b400cef0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.176+0000 7ff2c2321700 1 -- 172.21.15.40:0/938539633 shutdown_connections 2023-09-30T22:29:06.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.176+0000 7ff2c2321700 1 --2- 172.21.15.40:0/938539633 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff2bc06f070 0x7ff2bc1c0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.176+0000 7ff2c2321700 1 --2- 172.21.15.40:0/938539633 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff2bc06fdb0 0x7ff2bc1c3ec0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.176+0000 7ff2c2321700 1 --2- 172.21.15.40:0/938539633 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2bc06f980 0x7ff2bc1c13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.176+0000 7ff2c2321700 1 -- 172.21.15.40:0/938539633 >> 172.21.15.40:0/938539633 conn(0x7ff2bc0a41a0 msgr2=0x7ff2bc0972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:06.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.176+0000 7ff2c2321700 1 -- 172.21.15.40:0/938539633 shutdown_connections 2023-09-30T22:29:06.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.176+0000 7ff2c2321700 1 -- 172.21.15.40:0/938539633 wait complete. 2023-09-30T22:29:06.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:06.188 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:06.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.205+0000 7fb61a24b700 1 -- 172.21.15.40:0/1540306194 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb6140a2bf0 con 0x7fb61413db20 2023-09-30T22:29:06.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.205+0000 7fb5fbfff700 1 -- 172.21.15.40:0/1540306194 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb60c02c020 con 0x7fb61413db20 2023-09-30T22:29:06.206 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:06.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.207+0000 7fb61a24b700 1 -- 172.21.15.40:0/1540306194 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb61413db20 msgr2=0x7fb614098670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:06.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.207+0000 7fb61a24b700 1 --2- 172.21.15.40:0/1540306194 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb61413db20 0x7fb614098670 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fb60c013000 tx=0x7fb60c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.207+0000 7fb61a24b700 1 -- 172.21.15.40:0/1540306194 shutdown_connections 2023-09-30T22:29:06.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.207+0000 7fb61a24b700 1 --2- 172.21.15.40:0/1540306194 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb61409d920 0x7fb614097bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.207+0000 7fb61a24b700 1 --2- 172.21.15.40:0/1540306194 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb61413db20 0x7fb614098670 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.207+0000 7fb61a24b700 1 --2- 172.21.15.40:0/1540306194 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb61409e400 0x7fb614098130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.207+0000 7fb61a24b700 1 -- 172.21.15.40:0/1540306194 >> 172.21.15.40:0/1540306194 conn(0x7fb6140a7080 msgr2=0x7fb61413c800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:06.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.207+0000 7fb61a24b700 1 -- 172.21.15.40:0/1540306194 shutdown_connections 2023-09-30T22:29:06.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:06.207+0000 7fb61a24b700 1 -- 172.21.15.40:0/1540306194 wait complete. 2023-09-30T22:29:06.220 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:07.095 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:07.179 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:07.189 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:07.221 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:07.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.246+0000 7f9bef556700 1 Processor -- start 2023-09-30T22:29:07.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.246+0000 7f9bef556700 1 -- start start 2023-09-30T22:29:07.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.247+0000 7f9bef556700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9be809d920 0x7f9be809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.247+0000 7f9bef556700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9be809f0f0 0x7f9be809e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.247+0000 7f9bef556700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9be8133ca0 0x7f9be8134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.247+0000 7f9bef556700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9be806b4c0 con 0x7f9be809f0f0 2023-09-30T22:29:07.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.247+0000 7f9bef556700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be809a8f0 con 0x7f9be8133ca0 2023-09-30T22:29:07.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.247+0000 7f9bef556700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9be809f940 con 0x7f9be809d920 2023-09-30T22:29:07.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.247+0000 7f9bed2f2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9be809d920 0x7f9be809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:07.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.247+0000 7f9bed2f2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9be809d920 0x7f9be809dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48438/0 (socket says 172.21.15.40:48438) 2023-09-30T22:29:07.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.247+0000 7f9bed2f2700 1 -- 172.21.15.40:0/1187278374 learned_addr learned my addr 172.21.15.40:0/1187278374 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:07.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.247+0000 7f9becaf1700 1 --2- 172.21.15.40:0/1187278374 >> v2:172.21.15.40:3300/0 conn(0x7f9be809f0f0 0x7f9be809e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:07.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.247+0000 7f9bed2f2700 1 -- 172.21.15.40:0/1187278374 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9be8133ca0 msgr2=0x7f9be8134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:07.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.247+0000 7f9bed2f2700 1 --2- 172.21.15.40:0/1187278374 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9be8133ca0 0x7f9be8134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.247+0000 7f9bed2f2700 1 -- 172.21.15.40:0/1187278374 >> v2:172.21.15.40:3300/0 conn(0x7f9be809f0f0 msgr2=0x7f9be809e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:07.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.247+0000 7f9bed2f2700 1 --2- 172.21.15.40:0/1187278374 >> v2:172.21.15.40:3300/0 conn(0x7f9be809f0f0 0x7f9be809e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.247+0000 7f9bed2f2700 1 -- 172.21.15.40:0/1187278374 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be809f6e0 con 0x7f9be809d920 2023-09-30T22:29:07.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.247+0000 7f9bed2f2700 1 --2- 172.21.15.40:0/1187278374 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9be809d920 0x7f9be809dcf0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9be40098f0 tx=0x7f9be4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=481121f519558057 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:07.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.248+0000 7f9bdffff700 1 -- 172.21.15.40:0/1187278374 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be4005e30 con 0x7f9be809d920 2023-09-30T22:29:07.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.248+0000 7f9bdffff700 1 -- 172.21.15.40:0/1187278374 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be4004030 con 0x7f9be809d920 2023-09-30T22:29:07.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.248+0000 7f9bdffff700 1 -- 172.21.15.40:0/1187278374 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be40043e0 con 0x7f9be809d920 2023-09-30T22:29:07.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.248+0000 7f9bef556700 1 -- 172.21.15.40:0/1187278374 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9be809d920 msgr2=0x7f9be809dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:07.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.248+0000 7f9bef556700 1 --2- 172.21.15.40:0/1187278374 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9be809d920 0x7f9be809dcf0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9be40098f0 tx=0x7f9be4009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:07.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.248+0000 7f9bef556700 1 -- 172.21.15.40:0/1187278374 shutdown_connections 2023-09-30T22:29:07.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.248+0000 7f9bef556700 1 --2- 172.21.15.40:0/1187278374 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9be809d920 0x7f9be809dcf0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.248+0000 7f9bef556700 1 --2- 172.21.15.40:0/1187278374 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9be8133ca0 0x7f9be8134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.248+0000 7f9bef556700 1 --2- 172.21.15.40:0/1187278374 >> v2:172.21.15.40:3300/0 conn(0x7f9be809f0f0 0x7f9be809e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.248+0000 7f9bef556700 1 -- 172.21.15.40:0/1187278374 >> 172.21.15.40:0/1187278374 conn(0x7f9be809fb20 msgr2=0x7f9be809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:07.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.249+0000 7f9bef556700 1 -- 172.21.15.40:0/1187278374 shutdown_connections 2023-09-30T22:29:07.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.249+0000 7f9bef556700 1 -- 172.21.15.40:0/1187278374 wait complete. 2023-09-30T22:29:07.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.250+0000 7f9bef556700 1 Processor -- start 2023-09-30T22:29:07.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.250+0000 7f9bef556700 1 -- start start 2023-09-30T22:29:07.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.251+0000 7f9bef556700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9be809d920 0x7f9be81218a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.251+0000 7f9bef556700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9be8133ca0 0x7f9be8121de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.251+0000 7f9bef556700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9be8122320 0x7f9be81c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.251+0000 7f9bef556700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be81253c0 con 0x7f9be8122320 2023-09-30T22:29:07.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.251+0000 7f9bef556700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be8122d00 con 0x7f9be8133ca0 2023-09-30T22:29:07.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.251+0000 7f9bef556700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9be81234b0 con 0x7f9be809d920 2023-09-30T22:29:07.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.251+0000 7f9becaf1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9be8133ca0 0x7f9be8121de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:07.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.251+0000 7f9bedaf3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9be8122320 0x7f9be81c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:07.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.251+0000 7f9bedaf3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9be8122320 0x7f9be81c8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46640/0 (socket says 172.21.15.40:46640) 2023-09-30T22:29:07.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.251+0000 7f9becaf1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9be8133ca0 0x7f9be8121de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48780/0 (socket says 172.21.15.40:48780) 2023-09-30T22:29:07.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.251+0000 7f9bedaf3700 1 -- 172.21.15.40:0/2120393847 learned_addr learned my addr 172.21.15.40:0/2120393847 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:07.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.251+0000 7f9bed2f2700 1 --2- 172.21.15.40:0/2120393847 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9be809d920 0x7f9be81218a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:07.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.252+0000 7f9becaf1700 1 -- 172.21.15.40:0/2120393847 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9be809d920 msgr2=0x7f9be81218a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:07.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.252+0000 7f9becaf1700 1 --2- 172.21.15.40:0/2120393847 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9be809d920 0x7f9be81218a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.252+0000 7f9becaf1700 1 -- 172.21.15.40:0/2120393847 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9be8122320 msgr2=0x7f9be81c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:07.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.252+0000 7f9becaf1700 1 --2- 172.21.15.40:0/2120393847 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9be8122320 0x7f9be81c8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.252+0000 7f9becaf1700 1 -- 172.21.15.40:0/2120393847 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be4009500 con 0x7f9be8133ca0 2023-09-30T22:29:07.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.252+0000 7f9bedaf3700 1 --2- 172.21.15.40:0/2120393847 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9be8122320 0x7f9be81c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:07.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.252+0000 7f9becaf1700 1 --2- 172.21.15.40:0/2120393847 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9be8133ca0 0x7f9be8121de0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9bd800e8d0 tx=0x7f9bd800ebe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:07.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.252+0000 7f9bddffb700 1 -- 172.21.15.40:0/2120393847 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd8013680 con 0x7f9be8133ca0 2023-09-30T22:29:07.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.252+0000 7f9bddffb700 1 -- 172.21.15.40:0/2120393847 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd80137e0 con 0x7f9be8133ca0 2023-09-30T22:29:07.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.252+0000 7f9bef556700 1 -- 172.21.15.40:0/2120393847 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9be80a2a80 con 0x7f9be8133ca0 2023-09-30T22:29:07.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.252+0000 7f9bddffb700 1 -- 172.21.15.40:0/2120393847 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd8013b50 con 0x7f9be8133ca0 2023-09-30T22:29:07.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.252+0000 7f9bef556700 1 -- 172.21.15.40:0/2120393847 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9be81327f0 con 0x7f9be8133ca0 2023-09-30T22:29:07.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.254+0000 7f9bef556700 1 -- 172.21.15.40:0/2120393847 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9be8062380 con 0x7f9be8133ca0 2023-09-30T22:29:07.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.254+0000 7f9bddffb700 1 -- 172.21.15.40:0/2120393847 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9bd8013cb0 con 0x7f9be8133ca0 2023-09-30T22:29:07.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.254+0000 7f9bddffb700 1 -- 172.21.15.40:0/2120393847 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9bd8047350 con 0x7f9be8133ca0 2023-09-30T22:29:07.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.260+0000 7f9bddffb700 1 -- 172.21.15.40:0/2120393847 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9bd8044060 con 0x7f9be8133ca0 2023-09-30T22:29:07.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.324+0000 7f50b8f61700 1 Processor -- start 2023-09-30T22:29:07.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.324+0000 7f50b8f61700 1 -- start start 2023-09-30T22:29:07.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.324+0000 7f50b8f61700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50b4133e00 0x7f50b41341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.324+0000 7f50b8f61700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f50b409d400 0x7f50b409d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.324+0000 7f50b8f61700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f50b409dd70 0x7f50b413ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.324+0000 7f50b8f61700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50b409ab20 con 0x7f50b409d400 2023-09-30T22:29:07.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.324+0000 7f50b8f61700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b4133940 con 0x7f50b4133e00 2023-09-30T22:29:07.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.324+0000 7f50b8f61700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50b409f0d0 con 0x7f50b409dd70 2023-09-30T22:29:07.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.325+0000 7f50b259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50b4133e00 0x7f50b41341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:07.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.325+0000 7f50b259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50b4133e00 0x7f50b41341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48790/0 (socket says 172.21.15.40:48790) 2023-09-30T22:29:07.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.325+0000 7f50b259c700 1 -- 172.21.15.40:0/2856099544 learned_addr learned my addr 172.21.15.40:0/2856099544 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:07.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.325+0000 7f50b1d9b700 1 --2- 172.21.15.40:0/2856099544 >> v2:172.21.15.40:3300/0 conn(0x7f50b409d400 0x7f50b409d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:07.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.325+0000 7f50b2d9d700 1 --2- 172.21.15.40:0/2856099544 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f50b409dd70 0x7f50b413ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:07.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.325+0000 7f50b259c700 1 -- 172.21.15.40:0/2856099544 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f50b409dd70 msgr2=0x7f50b413ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:07.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.325+0000 7f50b259c700 1 --2- 172.21.15.40:0/2856099544 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f50b409dd70 0x7f50b413ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.325+0000 7f50b259c700 1 -- 172.21.15.40:0/2856099544 >> v2:172.21.15.40:3300/0 conn(0x7f50b409d400 msgr2=0x7f50b409d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:07.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.325+0000 7f50b259c700 1 --2- 172.21.15.40:0/2856099544 >> v2:172.21.15.40:3300/0 conn(0x7f50b409d400 0x7f50b409d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.325+0000 7f50b259c700 1 -- 172.21.15.40:0/2856099544 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b409e210 con 0x7f50b4133e00 2023-09-30T22:29:07.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.325+0000 7f50b259c700 1 --2- 172.21.15.40:0/2856099544 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50b4133e00 0x7f50b41341d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f50a40098f0 tx=0x7f50a4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16f1cd9cde1d1f92 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:07.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.325+0000 7f50b159a700 1 -- 172.21.15.40:0/2856099544 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a4011830 con 0x7f50b4133e00 2023-09-30T22:29:07.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.326+0000 7f50b159a700 1 -- 172.21.15.40:0/2856099544 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a4011990 con 0x7f50b4133e00 2023-09-30T22:29:07.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.326+0000 7f50b159a700 1 -- 172.21.15.40:0/2856099544 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a4011d20 con 0x7f50b4133e00 2023-09-30T22:29:07.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.326+0000 7f50b8f61700 1 -- 172.21.15.40:0/2856099544 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50b4133e00 msgr2=0x7f50b41341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:07.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.326+0000 7f50b8f61700 1 --2- 172.21.15.40:0/2856099544 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50b4133e00 0x7f50b41341d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f50a40098f0 tx=0x7f50a4009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:07.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.326+0000 7f50b8f61700 1 -- 172.21.15.40:0/2856099544 shutdown_connections 2023-09-30T22:29:07.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.326+0000 7f50b8f61700 1 --2- 172.21.15.40:0/2856099544 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f50b409dd70 0x7f50b413ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.326+0000 7f50b8f61700 1 --2- 172.21.15.40:0/2856099544 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50b4133e00 0x7f50b41341d0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.326+0000 7f50b8f61700 1 --2- 172.21.15.40:0/2856099544 >> v2:172.21.15.40:3300/0 conn(0x7f50b409d400 0x7f50b409d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.326+0000 7f50b8f61700 1 -- 172.21.15.40:0/2856099544 >> 172.21.15.40:0/2856099544 conn(0x7f50b40a2a00 msgr2=0x7f50b40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:07.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.326+0000 7f50b8f61700 1 -- 172.21.15.40:0/2856099544 shutdown_connections 2023-09-30T22:29:07.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.326+0000 7f50b8f61700 1 -- 172.21.15.40:0/2856099544 wait complete. 2023-09-30T22:29:07.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.328+0000 7f50b8f61700 1 Processor -- start 2023-09-30T22:29:07.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.328+0000 7f50b8f61700 1 -- start start 2023-09-30T22:29:07.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.329+0000 7f50b8f61700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50b409d400 0x7f50b4119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.329+0000 7f50b8f61700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50b409dd70 0x7f50b4119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.329+0000 7f50b8f61700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f50b4133e00 0x7f50b4119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.329+0000 7f50b8f61700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b411b160 con 0x7f50b409d400 2023-09-30T22:29:07.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.329+0000 7f50b8f61700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b411c350 con 0x7f50b409dd70 2023-09-30T22:29:07.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.329+0000 7f50b8f61700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50b409c1f0 con 0x7f50b4133e00 2023-09-30T22:29:07.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.329+0000 7f50b259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50b409d400 0x7f50b4119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:07.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.329+0000 7f50b259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50b409d400 0x7f50b4119050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46658/0 (socket says 172.21.15.40:46658) 2023-09-30T22:29:07.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.329+0000 7f50b259c700 1 -- 172.21.15.40:0/4076764745 learned_addr learned my addr 172.21.15.40:0/4076764745 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:07.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.329+0000 7f50b1d9b700 1 --2- 172.21.15.40:0/4076764745 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50b409dd70 0x7f50b4119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:07.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.329+0000 7f50b2d9d700 1 --2- 172.21.15.40:0/4076764745 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f50b4133e00 0x7f50b4119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:07.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.329+0000 7f50b259c700 1 -- 172.21.15.40:0/4076764745 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f50b4133e00 msgr2=0x7f50b4119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:07.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.329+0000 7f50b259c700 1 --2- 172.21.15.40:0/4076764745 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f50b4133e00 0x7f50b4119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.329+0000 7f50b259c700 1 -- 172.21.15.40:0/4076764745 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50b409dd70 msgr2=0x7f50b4119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:07.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.329+0000 7f50b259c700 1 --2- 172.21.15.40:0/4076764745 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50b409dd70 0x7f50b4119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.329+0000 7f50b259c700 1 -- 172.21.15.40:0/4076764745 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a4009550 con 0x7f50b409d400 2023-09-30T22:29:07.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.330+0000 7f50b259c700 1 --2- 172.21.15.40:0/4076764745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50b409d400 0x7f50b4119050 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f50a4009c40 tx=0x7f50a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:07.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.330+0000 7f50a2ffd700 1 -- 172.21.15.40:0/4076764745 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a4004450 con 0x7f50b409d400 2023-09-30T22:29:07.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.330+0000 7f50a2ffd700 1 -- 172.21.15.40:0/4076764745 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a40045d0 con 0x7f50b409d400 2023-09-30T22:29:07.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.330+0000 7f50a2ffd700 1 -- 172.21.15.40:0/4076764745 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a40038e0 con 0x7f50b409d400 2023-09-30T22:29:07.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.330+0000 7f50b8f61700 1 -- 172.21.15.40:0/4076764745 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50b412e1a0 con 0x7f50b409d400 2023-09-30T22:29:07.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.330+0000 7f50b8f61700 1 -- 172.21.15.40:0/4076764745 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50b411c070 con 0x7f50b409d400 2023-09-30T22:29:07.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.331+0000 7f50b8f61700 1 -- 172.21.15.40:0/4076764745 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50b4062380 con 0x7f50b409d400 2023-09-30T22:29:07.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.332+0000 7f50a2ffd700 1 -- 172.21.15.40:0/4076764745 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f50a4003a40 con 0x7f50b409d400 2023-09-30T22:29:07.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.332+0000 7f50a2ffd700 1 -- 172.21.15.40:0/4076764745 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f50a4040b10 con 0x7f50b409d400 2023-09-30T22:29:07.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.336+0000 7f50a2ffd700 1 -- 172.21.15.40:0/4076764745 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f50a401a420 con 0x7f50b409d400 2023-09-30T22:29:07.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.359+0000 7f1f54df0700 1 Processor -- start 2023-09-30T22:29:07.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.359+0000 7f1f54df0700 1 -- start start 2023-09-30T22:29:07.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.360+0000 7f51b9a2d700 1 Processor -- start 2023-09-30T22:29:07.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.360+0000 7f1f54df0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f5009f0f0 0x7f1f50138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.360+0000 7f1f54df0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f5009e400 0x7f1f5013b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.360+0000 7f1f54df0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f5009f940 con 0x7f1f5009d920 2023-09-30T22:29:07.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.360+0000 7f1f54df0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5006b4c0 con 0x7f1f5009f0f0 2023-09-30T22:29:07.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.360+0000 7f1f54df0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5009a8f0 con 0x7f1f5009e400 2023-09-30T22:29:07.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.360+0000 7f1f4dd9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f5009f0f0 0x7f1f50138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:07.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.360+0000 7f1f4dd9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f5009f0f0 0x7f1f50138ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48804/0 (socket says 172.21.15.40:48804) 2023-09-30T22:29:07.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.360+0000 7f1f4dd9b700 1 -- 172.21.15.40:0/1904504554 learned_addr learned my addr 172.21.15.40:0/1904504554 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:07.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.360+0000 7f1f4ed9d700 1 --2- 172.21.15.40:0/1904504554 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f5009e400 0x7f1f5013b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:07.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.360+0000 7f51b9a2d700 1 -- start start 2023-09-30T22:29:07.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.360+0000 7f51b9a2d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f51b406a6d0 0x7f51b409d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.360+0000 7f51b9a2d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51b409de60 0x7f51b409e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.360+0000 7f51b9a2d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f51b413c490 0x7f51b413e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.360+0000 7f51b9a2d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51b406aaa0 con 0x7f51b413c490 2023-09-30T22:29:07.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.360+0000 7f51b9a2d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b409e790 con 0x7f51b409de60 2023-09-30T22:29:07.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.360+0000 7f51b9a2d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51b406b150 con 0x7f51b406a6d0 2023-09-30T22:29:07.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.361+0000 7f51b27fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51b409de60 0x7f51b409e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:07.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.361+0000 7f51b27fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51b409de60 0x7f51b409e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48806/0 (socket says 172.21.15.40:48806) 2023-09-30T22:29:07.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.361+0000 7f51b27fc700 1 -- 172.21.15.40:0/2726002811 learned_addr learned my addr 172.21.15.40:0/2726002811 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:07.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.361+0000 7f1f4ed9d700 1 -- 172.21.15.40:0/1904504554 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f5009f0f0 msgr2=0x7f1f50138ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:07.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.361+0000 7f1f4ed9d700 1 --2- 172.21.15.40:0/1904504554 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f5009f0f0 0x7f1f50138ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.361+0000 7f1f4ed9d700 1 -- 172.21.15.40:0/1904504554 >> v1:172.21.15.40:6789/0 conn(0x7f1f5009d920 legacy=0x7f1f5009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:07.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.361+0000 7f1f4ed9d700 1 -- 172.21.15.40:0/1904504554 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5009f6e0 con 0x7f1f5009e400 2023-09-30T22:29:07.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.361+0000 7f1f4ed9d700 1 --2- 172.21.15.40:0/1904504554 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f5009e400 0x7f1f5013b430 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f1f48009df0 tx=0x7f1f4800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c830be1fcf647170 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:07.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.361+0000 7f51b27fc700 1 -- 172.21.15.40:0/2726002811 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f51b406a6d0 msgr2=0x7f51b409d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:07.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.361+0000 7f51b27fc700 1 --2- 172.21.15.40:0/2726002811 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f51b406a6d0 0x7f51b409d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.361+0000 7f51b27fc700 1 -- 172.21.15.40:0/2726002811 >> v2:172.21.15.40:3300/0 conn(0x7f51b413c490 msgr2=0x7f51b413e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:07.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.361+0000 7f51b27fc700 1 --2- 172.21.15.40:0/2726002811 >> v2:172.21.15.40:3300/0 conn(0x7f51b413c490 0x7f51b413e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.361+0000 7f51b27fc700 1 -- 172.21.15.40:0/2726002811 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b409f300 con 0x7f51b409de60 2023-09-30T22:29:07.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.361+0000 7f51b27fc700 1 --2- 172.21.15.40:0/2726002811 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51b409de60 0x7f51b409e250 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009920 tx=0x7f51a8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c93338815ee2b1c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:07.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.361+0000 7f1f4d59a700 1 -- 172.21.15.40:0/1904504554 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4800e070 con 0x7f1f5009e400 2023-09-30T22:29:07.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.361+0000 7f1f4d59a700 1 -- 172.21.15.40:0/1904504554 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4800baa0 con 0x7f1f5009e400 2023-09-30T22:29:07.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.361+0000 7f1f4d59a700 1 -- 172.21.15.40:0/1904504554 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4800be50 con 0x7f1f5009e400 2023-09-30T22:29:07.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.361+0000 7f51b1ffb700 1 -- 172.21.15.40:0/2726002811 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a800ba20 con 0x7f51b409de60 2023-09-30T22:29:07.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.361+0000 7f51b1ffb700 1 -- 172.21.15.40:0/2726002811 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a800bb80 con 0x7f51b409de60 2023-09-30T22:29:07.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.361+0000 7f51b1ffb700 1 -- 172.21.15.40:0/2726002811 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a8009e70 con 0x7f51b409de60 2023-09-30T22:29:07.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.362+0000 7f1f54df0700 1 -- 172.21.15.40:0/1904504554 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f5009e400 msgr2=0x7f1f5013b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:07.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.362+0000 7f1f54df0700 1 --2- 172.21.15.40:0/1904504554 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f5009e400 0x7f1f5013b430 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f1f48009df0 tx=0x7f1f4800b330 comp rx=0 tx=0).stop 2023-09-30T22:29:07.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.362+0000 7f51b9a2d700 1 -- 172.21.15.40:0/2726002811 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51b409de60 msgr2=0x7f51b409e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:07.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.362+0000 7f51b9a2d700 1 --2- 172.21.15.40:0/2726002811 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51b409de60 0x7f51b409e250 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009920 tx=0x7f51a8009c30 comp rx=0 tx=0).stop 2023-09-30T22:29:07.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.362+0000 7f1f54df0700 1 -- 172.21.15.40:0/1904504554 shutdown_connections 2023-09-30T22:29:07.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.362+0000 7f1f54df0700 1 --2- 172.21.15.40:0/1904504554 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f5009e400 0x7f1f5013b430 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.362+0000 7f1f54df0700 1 --2- 172.21.15.40:0/1904504554 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f5009f0f0 0x7f1f50138ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.362+0000 7f1f54df0700 1 -- 172.21.15.40:0/1904504554 >> 172.21.15.40:0/1904504554 conn(0x7f1f5009fb20 msgr2=0x7f1f5009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:07.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.362+0000 7f51b9a2d700 1 -- 172.21.15.40:0/2726002811 shutdown_connections 2023-09-30T22:29:07.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.362+0000 7f51b9a2d700 1 --2- 172.21.15.40:0/2726002811 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f51b406a6d0 0x7f51b409d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.362+0000 7f51b9a2d700 1 --2- 172.21.15.40:0/2726002811 >> v2:172.21.15.40:3300/0 conn(0x7f51b413c490 0x7f51b413e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.362+0000 7f51b9a2d700 1 --2- 172.21.15.40:0/2726002811 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51b409de60 0x7f51b409e250 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.362+0000 7f51b9a2d700 1 -- 172.21.15.40:0/2726002811 >> 172.21.15.40:0/2726002811 conn(0x7f51b409fb20 msgr2=0x7f51b409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:07.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.362+0000 7f1f54df0700 1 -- 172.21.15.40:0/1904504554 shutdown_connections 2023-09-30T22:29:07.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.362+0000 7f51b9a2d700 1 -- 172.21.15.40:0/2726002811 shutdown_connections 2023-09-30T22:29:07.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.362+0000 7f1f54df0700 1 -- 172.21.15.40:0/1904504554 wait complete. 2023-09-30T22:29:07.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.362+0000 7f51b9a2d700 1 -- 172.21.15.40:0/2726002811 wait complete. 2023-09-30T22:29:07.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.363+0000 7f51b9a2d700 1 Processor -- start 2023-09-30T22:29:07.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.363+0000 7f1f54df0700 1 Processor -- start 2023-09-30T22:29:07.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.363+0000 7f51b9a2d700 1 -- start start 2023-09-30T22:29:07.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.364+0000 7f51b9a2d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51b406a6d0 0x7f51b4131df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.364+0000 7f51b9a2d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51b409de60 0x7f51b4132330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.364+0000 7f51b9a2d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f51b413c490 0x7f51b4132870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.364+0000 7f51b9a2d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b41350a0 con 0x7f51b409de60 2023-09-30T22:29:07.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.364+0000 7f51b9a2d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b4134140 con 0x7f51b406a6d0 2023-09-30T22:29:07.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.364+0000 7f51b9a2d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51b4133a20 con 0x7f51b413c490 2023-09-30T22:29:07.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.363+0000 7f1f54df0700 1 -- start start 2023-09-30T22:29:07.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.364+0000 7f1f54df0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f5009d920 0x7f1f50127400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.364+0000 7f1f54df0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f5009e400 0x7f1f50127940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.364+0000 7f1f54df0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f50127e80 0x7f1f50139e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.364+0000 7f1f54df0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f50129120 con 0x7f1f50127e80 2023-09-30T22:29:07.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.364+0000 7f1f54df0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5012ac40 con 0x7f1f5009e400 2023-09-30T22:29:07.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.364+0000 7f1f54df0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f500a30d0 con 0x7f1f5009d920 2023-09-30T22:29:07.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.364+0000 7f51b27fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51b409de60 0x7f51b4132330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:07.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.364+0000 7f51b27fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51b409de60 0x7f51b4132330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46678/0 (socket says 172.21.15.40:46678) 2023-09-30T22:29:07.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.364+0000 7f51b27fc700 1 -- 172.21.15.40:0/4291880770 learned_addr learned my addr 172.21.15.40:0/4291880770 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:07.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.364+0000 7f51b2ffd700 1 --2- 172.21.15.40:0/4291880770 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51b406a6d0 0x7f51b4131df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:07.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.364+0000 7f1f4ed9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f50127e80 0x7f1f50139e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:07.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.364+0000 7f1f4ed9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f50127e80 0x7f1f50139e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46692/0 (socket says 172.21.15.40:46692) 2023-09-30T22:29:07.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.364+0000 7f1f4ed9d700 1 -- 172.21.15.40:0/1221066819 learned_addr learned my addr 172.21.15.40:0/1221066819 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:07.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.364+0000 7f1f4e59c700 1 --2- 172.21.15.40:0/1221066819 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f5009d920 0x7f1f50127400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:07.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.364+0000 7f1f4dd9b700 1 --2- 172.21.15.40:0/1221066819 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f5009e400 0x7f1f50127940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:07.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.364+0000 7f51b27fc700 1 -- 172.21.15.40:0/4291880770 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f51b413c490 msgr2=0x7f51b4132870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:07.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.364+0000 7f51b27fc700 1 --2- 172.21.15.40:0/4291880770 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f51b413c490 0x7f51b4132870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.364+0000 7f51b27fc700 1 -- 172.21.15.40:0/4291880770 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51b406a6d0 msgr2=0x7f51b4131df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:07.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.364+0000 7f51b27fc700 1 --2- 172.21.15.40:0/4291880770 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51b406a6d0 0x7f51b4131df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.364+0000 7f51b27fc700 1 -- 172.21.15.40:0/4291880770 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a8009550 con 0x7f51b409de60 2023-09-30T22:29:07.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.365+0000 7f51b27fc700 1 --2- 172.21.15.40:0/4291880770 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51b409de60 0x7f51b4132330 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f51a8013000 tx=0x7f51a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:07.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.365+0000 7f1f4ed9d700 1 -- 172.21.15.40:0/1221066819 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f5009d920 msgr2=0x7f1f50127400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:07.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.365+0000 7f1f4ed9d700 1 --2- 172.21.15.40:0/1221066819 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f5009d920 0x7f1f50127400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.365+0000 7f1f4ed9d700 1 -- 172.21.15.40:0/1221066819 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f5009e400 msgr2=0x7f1f50127940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:07.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.365+0000 7f1f4ed9d700 1 --2- 172.21.15.40:0/1221066819 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f5009e400 0x7f1f50127940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.365+0000 7f1f4ed9d700 1 -- 172.21.15.40:0/1221066819 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f48009a70 con 0x7f1f50127e80 2023-09-30T22:29:07.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.365+0000 7f1f4ed9d700 1 --2- 172.21.15.40:0/1221066819 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f50127e80 0x7f1f50139e00 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f1f4800d010 tx=0x7f1f48004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:07.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.365+0000 7f1f3effd700 1 -- 172.21.15.40:0/1221066819 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f480047f0 con 0x7f1f50127e80 2023-09-30T22:29:07.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.365+0000 7f1f54df0700 1 -- 172.21.15.40:0/1221066819 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f5009c9e0 con 0x7f1f50127e80 2023-09-30T22:29:07.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.366+0000 7f1f54df0700 1 -- 172.21.15.40:0/1221066819 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f5012af20 con 0x7f1f50127e80 2023-09-30T22:29:07.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.365+0000 7f1f3effd700 1 -- 172.21.15.40:0/1221066819 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f48004950 con 0x7f1f50127e80 2023-09-30T22:29:07.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.366+0000 7f1f3effd700 1 -- 172.21.15.40:0/1221066819 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f480266a0 con 0x7f1f50127e80 2023-09-30T22:29:07.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.365+0000 7f519bfff700 1 -- 172.21.15.40:0/4291880770 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a8004480 con 0x7f51b409de60 2023-09-30T22:29:07.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.365+0000 7f519bfff700 1 -- 172.21.15.40:0/4291880770 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a801f070 con 0x7f51b409de60 2023-09-30T22:29:07.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.365+0000 7f519bfff700 1 -- 172.21.15.40:0/4291880770 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a80038e0 con 0x7f51b409de60 2023-09-30T22:29:07.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.365+0000 7f51b9a2d700 1 -- 172.21.15.40:0/4291880770 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b411d370 con 0x7f51b409de60 2023-09-30T22:29:07.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.366+0000 7f51b9a2d700 1 -- 172.21.15.40:0/4291880770 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51b41346e0 con 0x7f51b409de60 2023-09-30T22:29:07.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.367+0000 7f51b9a2d700 1 -- 172.21.15.40:0/4291880770 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51b4062380 con 0x7f51b409de60 2023-09-30T22:29:07.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.367+0000 7f1f54df0700 1 -- 172.21.15.40:0/1221066819 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f5012a8e0 con 0x7f1f50127e80 2023-09-30T22:29:07.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.367+0000 7f519bfff700 1 -- 172.21.15.40:0/4291880770 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f51a8021030 con 0x7f51b409de60 2023-09-30T22:29:07.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.368+0000 7f1f3effd700 1 -- 172.21.15.40:0/1221066819 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1f48026800 con 0x7f1f50127e80 2023-09-30T22:29:07.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.368+0000 7f519bfff700 1 -- 172.21.15.40:0/4291880770 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f51a80411d0 con 0x7f51b409de60 2023-09-30T22:29:07.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.368+0000 7f1f3effd700 1 -- 172.21.15.40:0/1221066819 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f1f48041800 con 0x7f1f50127e80 2023-09-30T22:29:07.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.376+0000 7f519bfff700 1 -- 172.21.15.40:0/4291880770 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f51a80239c0 con 0x7f51b409de60 2023-09-30T22:29:07.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.384+0000 7f1f3effd700 1 -- 172.21.15.40:0/1221066819 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f5012a8e0 con 0x7f1f50127e80 2023-09-30T22:29:07.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.472+0000 7f9bef556700 1 -- 172.21.15.40:0/2120393847 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9be8074720 con 0x7f9be8133ca0 2023-09-30T22:29:07.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.472+0000 7f9bddffb700 1 -- 172.21.15.40:0/2120393847 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9bd8017070 con 0x7f9be8133ca0 2023-09-30T22:29:07.473 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:07.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.475+0000 7f9bef556700 1 -- 172.21.15.40:0/2120393847 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9be8133ca0 msgr2=0x7f9be8121de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:07.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.475+0000 7f9bef556700 1 --2- 172.21.15.40:0/2120393847 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9be8133ca0 0x7f9be8121de0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9bd800e8d0 tx=0x7f9bd800ebe0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.475+0000 7f9bef556700 1 -- 172.21.15.40:0/2120393847 shutdown_connections 2023-09-30T22:29:07.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.475+0000 7f9bef556700 1 --2- 172.21.15.40:0/2120393847 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9be809d920 0x7f9be81218a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.475+0000 7f9bef556700 1 --2- 172.21.15.40:0/2120393847 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9be8122320 0x7f9be81c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.475+0000 7f9bef556700 1 --2- 172.21.15.40:0/2120393847 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9be8133ca0 0x7f9be8121de0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.475+0000 7f9bef556700 1 -- 172.21.15.40:0/2120393847 >> 172.21.15.40:0/2120393847 conn(0x7f9be809fb20 msgr2=0x7f9be80a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:07.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.475+0000 7f9bef556700 1 -- 172.21.15.40:0/2120393847 shutdown_connections 2023-09-30T22:29:07.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.475+0000 7f9bef556700 1 -- 172.21.15.40:0/2120393847 wait complete. 2023-09-30T22:29:07.488 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:07.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.539+0000 7f50b8f61700 1 -- 172.21.15.40:0/4076764745 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f50b411ab80 con 0x7f50b409d400 2023-09-30T22:29:07.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.539+0000 7f50a2ffd700 1 -- 172.21.15.40:0/4076764745 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f50a4015070 con 0x7f50b409d400 2023-09-30T22:29:07.541 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:07.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.542+0000 7f50b8f61700 1 -- 172.21.15.40:0/4076764745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50b409d400 msgr2=0x7f50b4119050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:07.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.542+0000 7f50b8f61700 1 --2- 172.21.15.40:0/4076764745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50b409d400 0x7f50b4119050 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f50a4009c40 tx=0x7f50a4004750 comp rx=0 tx=0).stop 2023-09-30T22:29:07.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.542+0000 7f50b8f61700 1 -- 172.21.15.40:0/4076764745 shutdown_connections 2023-09-30T22:29:07.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.542+0000 7f50b8f61700 1 --2- 172.21.15.40:0/4076764745 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f50b4133e00 0x7f50b4119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.542+0000 7f50b8f61700 1 --2- 172.21.15.40:0/4076764745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50b409d400 0x7f50b4119050 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.542+0000 7f50b8f61700 1 --2- 172.21.15.40:0/4076764745 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50b409dd70 0x7f50b4119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.542+0000 7f50b8f61700 1 -- 172.21.15.40:0/4076764745 >> 172.21.15.40:0/4076764745 conn(0x7f50b40a2a00 msgr2=0x7f50b412d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:07.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.542+0000 7f50b8f61700 1 -- 172.21.15.40:0/4076764745 shutdown_connections 2023-09-30T22:29:07.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.542+0000 7f50b8f61700 1 -- 172.21.15.40:0/4076764745 wait complete. 2023-09-30T22:29:07.559 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:07.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.581+0000 7f1f54df0700 1 -- 172.21.15.40:0/1221066819 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1f5012a8e0 con 0x7f1f50127e80 2023-09-30T22:29:07.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.581+0000 7f1f3effd700 1 -- 172.21.15.40:0/1221066819 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1f5012a8e0 con 0x7f1f50127e80 2023-09-30T22:29:07.583 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:07.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.582+0000 7f51b9a2d700 1 -- 172.21.15.40:0/4291880770 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f51b4133f20 con 0x7f51b409de60 2023-09-30T22:29:07.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.582+0000 7f519bfff700 1 -- 172.21.15.40:0/4291880770 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f51a80233d0 con 0x7f51b409de60 2023-09-30T22:29:07.584 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:07.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.584+0000 7f1f54df0700 1 -- 172.21.15.40:0/1221066819 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f50127e80 msgr2=0x7f1f50139e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:07.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.584+0000 7f1f54df0700 1 --2- 172.21.15.40:0/1221066819 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f50127e80 0x7f1f50139e00 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f1f4800d010 tx=0x7f1f48004ad0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.584+0000 7f1f54df0700 1 -- 172.21.15.40:0/1221066819 shutdown_connections 2023-09-30T22:29:07.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.584+0000 7f1f54df0700 1 --2- 172.21.15.40:0/1221066819 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f5009d920 0x7f1f50127400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.584+0000 7f1f54df0700 1 --2- 172.21.15.40:0/1221066819 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f50127e80 0x7f1f50139e00 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.584+0000 7f1f54df0700 1 --2- 172.21.15.40:0/1221066819 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f5009e400 0x7f1f50127940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.584+0000 7f1f54df0700 1 -- 172.21.15.40:0/1221066819 >> 172.21.15.40:0/1221066819 conn(0x7f1f5009fb20 msgr2=0x7f1f5006e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:07.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.584+0000 7f1f54df0700 1 -- 172.21.15.40:0/1221066819 shutdown_connections 2023-09-30T22:29:07.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.584+0000 7f1f54df0700 1 -- 172.21.15.40:0/1221066819 wait complete. 2023-09-30T22:29:07.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.584+0000 7f51b9a2d700 1 -- 172.21.15.40:0/4291880770 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51b409de60 msgr2=0x7f51b4132330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:07.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.584+0000 7f51b9a2d700 1 --2- 172.21.15.40:0/4291880770 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51b409de60 0x7f51b4132330 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f51a8013000 tx=0x7f51a8004750 comp rx=0 tx=0).stop 2023-09-30T22:29:07.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.584+0000 7f51b9a2d700 1 -- 172.21.15.40:0/4291880770 shutdown_connections 2023-09-30T22:29:07.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.584+0000 7f51b9a2d700 1 --2- 172.21.15.40:0/4291880770 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f51b413c490 0x7f51b4132870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.584+0000 7f51b9a2d700 1 --2- 172.21.15.40:0/4291880770 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51b406a6d0 0x7f51b4131df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.584+0000 7f51b9a2d700 1 --2- 172.21.15.40:0/4291880770 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51b409de60 0x7f51b4132330 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.585+0000 7f51b9a2d700 1 -- 172.21.15.40:0/4291880770 >> 172.21.15.40:0/4291880770 conn(0x7f51b409fb20 msgr2=0x7f51b413d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:07.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.585+0000 7f51b9a2d700 1 -- 172.21.15.40:0/4291880770 shutdown_connections 2023-09-30T22:29:07.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:07.585+0000 7f51b9a2d700 1 -- 172.21.15.40:0/4291880770 wait complete. 2023-09-30T22:29:07.598 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:07.599 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:08.489 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:08.560 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:08.599 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:08.599 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:08.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.637+0000 7feabba8e700 1 Processor -- start 2023-09-30T22:29:08.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.638+0000 7feabba8e700 1 -- start start 2023-09-30T22:29:08.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.638+0000 7feabba8e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feab409d450 0x7feab409d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.639+0000 7feabba8e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feab409dd60 0x7feab41301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.639+0000 7feabba8e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab409c3b0 con 0x7feab4130700 2023-09-30T22:29:08.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.639+0000 7feabba8e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab409a6b0 con 0x7feab409d450 2023-09-30T22:29:08.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.639+0000 7feabba8e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feab409b4f0 con 0x7feab409dd60 2023-09-30T22:29:08.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.639+0000 7feab9029700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feab409dd60 0x7feab41301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.639+0000 7feab9029700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feab409dd60 0x7feab41301c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48496/0 (socket says 172.21.15.40:48496) 2023-09-30T22:29:08.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.639+0000 7feab9029700 1 -- 172.21.15.40:0/781245878 learned_addr learned my addr 172.21.15.40:0/781245878 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:08.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.639+0000 7feab9029700 1 -- 172.21.15.40:0/781245878 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feab409d450 msgr2=0x7feab409d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:08.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.639+0000 7feab9029700 1 --2- 172.21.15.40:0/781245878 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feab409d450 0x7feab409d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.639+0000 7feab9029700 1 -- 172.21.15.40:0/781245878 >> v1:172.21.15.40:6789/0 conn(0x7feab4130700 legacy=0x7feab4137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:08.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.639+0000 7feab9029700 1 -- 172.21.15.40:0/781245878 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab409af90 con 0x7feab409dd60 2023-09-30T22:29:08.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.639+0000 7feab9029700 1 --2- 172.21.15.40:0/781245878 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feab409dd60 0x7feab41301c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7feaa400bbc0 tx=0x7feaa400bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=990f73b5a6affd28 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:08.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.640+0000 7feab8828700 1 -- 172.21.15.40:0/781245878 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa400dc40 con 0x7feab409dd60 2023-09-30T22:29:08.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.640+0000 7feab8828700 1 -- 172.21.15.40:0/781245878 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa400dda0 con 0x7feab409dd60 2023-09-30T22:29:08.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.640+0000 7feab8828700 1 -- 172.21.15.40:0/781245878 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa4004270 con 0x7feab409dd60 2023-09-30T22:29:08.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.640+0000 7feabba8e700 1 -- 172.21.15.40:0/781245878 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feab409dd60 msgr2=0x7feab41301c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.640+0000 7feabba8e700 1 --2- 172.21.15.40:0/781245878 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feab409dd60 0x7feab41301c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7feaa400bbc0 tx=0x7feaa400bed0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.641+0000 7feabba8e700 1 -- 172.21.15.40:0/781245878 shutdown_connections 2023-09-30T22:29:08.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.641+0000 7feabba8e700 1 --2- 172.21.15.40:0/781245878 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feab409d450 0x7feab409d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.641+0000 7feabba8e700 1 --2- 172.21.15.40:0/781245878 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feab409dd60 0x7feab41301c0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.641+0000 7feabba8e700 1 -- 172.21.15.40:0/781245878 >> 172.21.15.40:0/781245878 conn(0x7feab40a2a00 msgr2=0x7feab40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:08.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.641+0000 7feabba8e700 1 -- 172.21.15.40:0/781245878 shutdown_connections 2023-09-30T22:29:08.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.641+0000 7feabba8e700 1 -- 172.21.15.40:0/781245878 wait complete. 2023-09-30T22:29:08.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.642+0000 7feabba8e700 1 Processor -- start 2023-09-30T22:29:08.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.642+0000 7feabba8e700 1 -- start start 2023-09-30T22:29:08.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.643+0000 7feabba8e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feab409d450 0x7feab411db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.643+0000 7feabba8e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feab409dd60 0x7feab411e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.643+0000 7feabba8e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feab4130700 0x7feab411e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.643+0000 7feabba8e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab412f070 con 0x7feab4130700 2023-09-30T22:29:08.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.643+0000 7feabba8e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab41213c0 con 0x7feab409dd60 2023-09-30T22:29:08.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.643+0000 7feabba8e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feab41206a0 con 0x7feab409d450 2023-09-30T22:29:08.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.643+0000 7feab982a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feab409d450 0x7feab411db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.643+0000 7feab982a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feab409d450 0x7feab411db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48498/0 (socket says 172.21.15.40:48498) 2023-09-30T22:29:08.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.643+0000 7feab982a700 1 -- 172.21.15.40:0/3498116339 learned_addr learned my addr 172.21.15.40:0/3498116339 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:08.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.643+0000 7feab9029700 1 --2- 172.21.15.40:0/3498116339 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feab409dd60 0x7feab411e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.644+0000 7feab9029700 1 -- 172.21.15.40:0/3498116339 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feab409d450 msgr2=0x7feab411db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.644+0000 7feab9029700 1 --2- 172.21.15.40:0/3498116339 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feab409d450 0x7feab411db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.644+0000 7feab9029700 1 -- 172.21.15.40:0/3498116339 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feab4130700 msgr2=0x7feab411e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.644+0000 7feab9029700 1 --2- 172.21.15.40:0/3498116339 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feab4130700 0x7feab411e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.644+0000 7feab9029700 1 -- 172.21.15.40:0/3498116339 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa400b7f0 con 0x7feab409dd60 2023-09-30T22:29:08.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.644+0000 7feab9029700 1 --2- 172.21.15.40:0/3498116339 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feab409dd60 0x7feab411e0c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7feaa4018000 tx=0x7feaa4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:08.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.645+0000 7feaaa7fc700 1 -- 172.21.15.40:0/3498116339 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa4024070 con 0x7feab409dd60 2023-09-30T22:29:08.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.645+0000 7feaaa7fc700 1 -- 172.21.15.40:0/3498116339 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa40045a0 con 0x7feab409dd60 2023-09-30T22:29:08.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.645+0000 7feaaa7fc700 1 -- 172.21.15.40:0/3498116339 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa4009040 con 0x7feab409dd60 2023-09-30T22:29:08.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.645+0000 7feabba8e700 1 -- 172.21.15.40:0/3498116339 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab411efe0 con 0x7feab409dd60 2023-09-30T22:29:08.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.645+0000 7feabba8e700 1 -- 172.21.15.40:0/3498116339 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab409c5d0 con 0x7feab409dd60 2023-09-30T22:29:08.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.647+0000 7feabba8e700 1 -- 172.21.15.40:0/3498116339 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab4062380 con 0x7feab409dd60 2023-09-30T22:29:08.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.647+0000 7feaaa7fc700 1 -- 172.21.15.40:0/3498116339 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feaa4015070 con 0x7feab409dd60 2023-09-30T22:29:08.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.647+0000 7feaaa7fc700 1 -- 172.21.15.40:0/3498116339 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7feaa4040850 con 0x7feab409dd60 2023-09-30T22:29:08.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.653+0000 7feaaa7fc700 1 -- 172.21.15.40:0/3498116339 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feaa4006c80 con 0x7feab409dd60 2023-09-30T22:29:08.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.705+0000 7f2d07b23700 1 Processor -- start 2023-09-30T22:29:08.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.705+0000 7f2d07b23700 1 -- start start 2023-09-30T22:29:08.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.706+0000 7f2d07b23700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d0009d920 0x7f2d0009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.706+0000 7f2d07b23700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2d0009f0f0 0x7f2d0009e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.706+0000 7f2d07b23700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2d00133ca0 0x7f2d00134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.706+0000 7f2d07b23700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d0006b4c0 con 0x7f2d0009f0f0 2023-09-30T22:29:08.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.706+0000 7f2d07b23700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0009a8f0 con 0x7f2d0009d920 2023-09-30T22:29:08.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.706+0000 7f2d07b23700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0009f940 con 0x7f2d00133ca0 2023-09-30T22:29:08.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.706+0000 7f2d058bf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d0009d920 0x7f2d0009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.706+0000 7f2d058bf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d0009d920 0x7f2d0009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48854/0 (socket says 172.21.15.40:48854) 2023-09-30T22:29:08.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.706+0000 7f2d060c0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2d00133ca0 0x7f2d00134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.706+0000 7f2d058bf700 1 -- 172.21.15.40:0/3973613570 learned_addr learned my addr 172.21.15.40:0/3973613570 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:08.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.706+0000 7f2d050be700 1 --2- 172.21.15.40:0/3973613570 >> v2:172.21.15.40:3300/0 conn(0x7f2d0009f0f0 0x7f2d0009e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.707+0000 7f2d060c0700 1 -- 172.21.15.40:0/3973613570 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d0009d920 msgr2=0x7f2d0009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:08.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.707+0000 7f2d060c0700 1 --2- 172.21.15.40:0/3973613570 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d0009d920 0x7f2d0009dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.707+0000 7f2d060c0700 1 -- 172.21.15.40:0/3973613570 >> v2:172.21.15.40:3300/0 conn(0x7f2d0009f0f0 msgr2=0x7f2d0009e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:08.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.707+0000 7f2d060c0700 1 --2- 172.21.15.40:0/3973613570 >> v2:172.21.15.40:3300/0 conn(0x7f2d0009f0f0 0x7f2d0009e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.707+0000 7f2d060c0700 1 -- 172.21.15.40:0/3973613570 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0009f6e0 con 0x7f2d00133ca0 2023-09-30T22:29:08.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.707+0000 7f2d060c0700 1 --2- 172.21.15.40:0/3973613570 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2d00133ca0 0x7f2d00134140 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8009dc0 tx=0x7f2cf800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9851d0a0656ad7ae server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:08.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.707+0000 7f2d048bd700 1 -- 172.21.15.40:0/3973613570 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf800e070 con 0x7f2d00133ca0 2023-09-30T22:29:08.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.707+0000 7f2d048bd700 1 -- 172.21.15.40:0/3973613570 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf800bae0 con 0x7f2d00133ca0 2023-09-30T22:29:08.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.707+0000 7f2d048bd700 1 -- 172.21.15.40:0/3973613570 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf800be90 con 0x7f2d00133ca0 2023-09-30T22:29:08.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.708+0000 7f2d07b23700 1 -- 172.21.15.40:0/3973613570 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2d00133ca0 msgr2=0x7f2d00134140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.708+0000 7f2d07b23700 1 --2- 172.21.15.40:0/3973613570 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2d00133ca0 0x7f2d00134140 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8009dc0 tx=0x7f2cf800b330 comp rx=0 tx=0).stop 2023-09-30T22:29:08.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.708+0000 7f2d07b23700 1 -- 172.21.15.40:0/3973613570 shutdown_connections 2023-09-30T22:29:08.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.708+0000 7f2d07b23700 1 --2- 172.21.15.40:0/3973613570 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2d00133ca0 0x7f2d00134140 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.708+0000 7f2d07b23700 1 --2- 172.21.15.40:0/3973613570 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d0009d920 0x7f2d0009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.708+0000 7f2d07b23700 1 --2- 172.21.15.40:0/3973613570 >> v2:172.21.15.40:3300/0 conn(0x7f2d0009f0f0 0x7f2d0009e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.708+0000 7f2d07b23700 1 -- 172.21.15.40:0/3973613570 >> 172.21.15.40:0/3973613570 conn(0x7f2d0009fb20 msgr2=0x7f2d0009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:08.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.709+0000 7f2d07b23700 1 -- 172.21.15.40:0/3973613570 shutdown_connections 2023-09-30T22:29:08.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.709+0000 7f2d07b23700 1 -- 172.21.15.40:0/3973613570 wait complete. 2023-09-30T22:29:08.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.710+0000 7f2d07b23700 1 Processor -- start 2023-09-30T22:29:08.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.710+0000 7f2d07b23700 1 -- start start 2023-09-30T22:29:08.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.711+0000 7f2d07b23700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2d0009d920 0x7f2d001199d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.711+0000 7f2d07b23700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d00133ca0 0x7f2d00119f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.711+0000 7f2d07b23700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d001cc860 0x7f2d001cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.711+0000 7f2d07b23700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0011b3c0 con 0x7f2d00133ca0 2023-09-30T22:29:08.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.711+0000 7f2d07b23700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0011cf50 con 0x7f2d001cc860 2023-09-30T22:29:08.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.711+0000 7f2d07b23700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d000a29f0 con 0x7f2d0009d920 2023-09-30T22:29:08.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.711+0000 7f2d058bf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2d0009d920 0x7f2d001199d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.711+0000 7f2d050be700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d00133ca0 0x7f2d00119f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.711+0000 7f2d058bf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2d0009d920 0x7f2d001199d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48528/0 (socket says 172.21.15.40:48528) 2023-09-30T22:29:08.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.711+0000 7f2d058bf700 1 -- 172.21.15.40:0/517326112 learned_addr learned my addr 172.21.15.40:0/517326112 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:08.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.711+0000 7f2d050be700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d00133ca0 0x7f2d00119f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46720/0 (socket says 172.21.15.40:46720) 2023-09-30T22:29:08.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.711+0000 7f2d060c0700 1 --2- 172.21.15.40:0/517326112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d001cc860 0x7f2d001cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.711+0000 7f2d050be700 1 -- 172.21.15.40:0/517326112 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2d0009d920 msgr2=0x7f2d001199d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.711+0000 7f2d050be700 1 --2- 172.21.15.40:0/517326112 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2d0009d920 0x7f2d001199d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.711+0000 7f2d050be700 1 -- 172.21.15.40:0/517326112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d001cc860 msgr2=0x7f2d001cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.711+0000 7f2d050be700 1 --2- 172.21.15.40:0/517326112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d001cc860 0x7f2d001cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.711+0000 7f2d050be700 1 -- 172.21.15.40:0/517326112 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf8009a70 con 0x7f2d00133ca0 2023-09-30T22:29:08.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.711+0000 7f2d050be700 1 --2- 172.21.15.40:0/517326112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d00133ca0 0x7f2d00119f10 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f2d0006b7b0 tx=0x7f2cf000ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:08.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.712+0000 7f2cf67fc700 1 -- 172.21.15.40:0/517326112 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf0013680 con 0x7f2d00133ca0 2023-09-30T22:29:08.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.712+0000 7f2cf67fc700 1 -- 172.21.15.40:0/517326112 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf00137e0 con 0x7f2d00133ca0 2023-09-30T22:29:08.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.712+0000 7f2cf67fc700 1 -- 172.21.15.40:0/517326112 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf0013b50 con 0x7f2d00133ca0 2023-09-30T22:29:08.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.712+0000 7f2d07b23700 1 -- 172.21.15.40:0/517326112 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d0009c9e0 con 0x7f2d00133ca0 2023-09-30T22:29:08.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.712+0000 7f2d07b23700 1 -- 172.21.15.40:0/517326112 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d0011d230 con 0x7f2d00133ca0 2023-09-30T22:29:08.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.713+0000 7f2cf67fc700 1 -- 172.21.15.40:0/517326112 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2cf0013cb0 con 0x7f2d00133ca0 2023-09-30T22:29:08.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.713+0000 7f2cf67fc700 1 -- 172.21.15.40:0/517326112 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f2cf003f9b0 con 0x7f2d00133ca0 2023-09-30T22:29:08.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.713+0000 7f2d07b23700 1 -- 172.21.15.40:0/517326112 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d00062380 con 0x7f2d00133ca0 2023-09-30T22:29:08.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.718+0000 7f2cf67fc700 1 -- 172.21.15.40:0/517326112 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2cf001abb0 con 0x7f2d00133ca0 2023-09-30T22:29:08.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.746+0000 7f9f79791700 1 Processor -- start 2023-09-30T22:29:08.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.746+0000 7f967543e700 1 Processor -- start 2023-09-30T22:29:08.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.746+0000 7f967543e700 1 -- start start 2023-09-30T22:29:08.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.746+0000 7f9f79791700 1 -- start start 2023-09-30T22:29:08.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.747+0000 7f967543e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f967009df30 0x7f9670135400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.747+0000 7f967543e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9670135940 0x7f9670137d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.747+0000 7f9f79791700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f7409e030 0x7f9f7413d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.747+0000 7f9f79791700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9f7409e420 0x7f9f7413f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.747+0000 7f9f79791700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f7411d980 con 0x7f9f7406a6d0 2023-09-30T22:29:08.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.747+0000 7f9f79791700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f7406aaa0 con 0x7f9f7409e420 2023-09-30T22:29:08.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.747+0000 7f9f79791700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7406b150 con 0x7f9f7409e030 2023-09-30T22:29:08.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.747+0000 7f967543e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f967009e8b0 con 0x7f967009d450 2023-09-30T22:29:08.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.747+0000 7f967543e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f967009c3b0 con 0x7f967009df30 2023-09-30T22:29:08.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.747+0000 7f967543e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f967009a6b0 con 0x7f9670135940 2023-09-30T22:29:08.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.747+0000 7f9f727fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f7409e030 0x7f9f7413d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.747+0000 7f9f727fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f7409e030 0x7f9f7413d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48868/0 (socket says 172.21.15.40:48868) 2023-09-30T22:29:08.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.747+0000 7f9f727fc700 1 -- 172.21.15.40:0/1643099454 learned_addr learned my addr 172.21.15.40:0/1643099454 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:08.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.747+0000 7f9f737fe700 1 --2- 172.21.15.40:0/1643099454 >> v2:172.21.15.40:3300/0 conn(0x7f9f7409e420 0x7f9f7413f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.747+0000 7f966f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9670135940 0x7f9670137d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.747+0000 7f966f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9670135940 0x7f9670137d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48538/0 (socket says 172.21.15.40:48538) 2023-09-30T22:29:08.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.747+0000 7f966f7fe700 1 -- 172.21.15.40:0/590003213 learned_addr learned my addr 172.21.15.40:0/590003213 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:08.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.747+0000 7f9f737fe700 1 -- 172.21.15.40:0/1643099454 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f7409e030 msgr2=0x7f9f7413d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:08.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.747+0000 7f9f737fe700 1 --2- 172.21.15.40:0/1643099454 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f7409e030 0x7f9f7413d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.747+0000 7f9f737fe700 1 -- 172.21.15.40:0/1643099454 >> v1:172.21.15.40:6789/0 conn(0x7f9f7406a6d0 legacy=0x7f9f7409d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.747+0000 7f9f737fe700 1 -- 172.21.15.40:0/1643099454 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f7409f300 con 0x7f9f7409e420 2023-09-30T22:29:08.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.747+0000 7f9f727fc700 1 --2- 172.21.15.40:0/1643099454 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f7409e030 0x7f9f7413d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:08.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.748+0000 7f966f7fe700 1 -- 172.21.15.40:0/590003213 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f967009df30 msgr2=0x7f9670135400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:29:08.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.748+0000 7f966f7fe700 1 --2- 172.21.15.40:0/590003213 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f967009df30 0x7f9670135400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.748+0000 7f966f7fe700 1 -- 172.21.15.40:0/590003213 >> v1:172.21.15.40:6789/0 conn(0x7f967009d450 legacy=0x7f967009d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.748+0000 7f966f7fe700 1 -- 172.21.15.40:0/590003213 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f967009b4f0 con 0x7f9670135940 2023-09-30T22:29:08.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.748+0000 7f9f737fe700 1 --2- 172.21.15.40:0/1643099454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f7409e420 0x7f9f7413f9f0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c009d90 tx=0x7f9f6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3940cd0935a7df46 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:08.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.748+0000 7f966f7fe700 1 --2- 172.21.15.40:0/590003213 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9670135940 0x7f9670137d20 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f9668009e80 tx=0x7f966800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c439e989db423803 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:08.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.748+0000 7f966dffb700 1 -- 172.21.15.40:0/590003213 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966800e070 con 0x7f9670135940 2023-09-30T22:29:08.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.748+0000 7f9f71ffb700 1 -- 172.21.15.40:0/1643099454 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c00e070 con 0x7f9f7409e420 2023-09-30T22:29:08.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.748+0000 7f966dffb700 1 -- 172.21.15.40:0/590003213 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966800b9c0 con 0x7f9670135940 2023-09-30T22:29:08.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.748+0000 7f966dffb700 1 -- 172.21.15.40:0/590003213 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966800bd70 con 0x7f9670135940 2023-09-30T22:29:08.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.748+0000 7f9f71ffb700 1 -- 172.21.15.40:0/1643099454 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6c003a20 con 0x7f9f7409e420 2023-09-30T22:29:08.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.748+0000 7f9f71ffb700 1 -- 172.21.15.40:0/1643099454 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c003dd0 con 0x7f9f7409e420 2023-09-30T22:29:08.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.749+0000 7f9f79791700 1 -- 172.21.15.40:0/1643099454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f7409e420 msgr2=0x7f9f7413f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.749+0000 7f9f79791700 1 --2- 172.21.15.40:0/1643099454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f7409e420 0x7f9f7413f9f0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c009d90 tx=0x7f9f6c00b330 comp rx=0 tx=0).stop 2023-09-30T22:29:08.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.749+0000 7f9f79791700 1 -- 172.21.15.40:0/1643099454 shutdown_connections 2023-09-30T22:29:08.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.749+0000 7f9f79791700 1 --2- 172.21.15.40:0/1643099454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f7409e420 0x7f9f7413f9f0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.749+0000 7f9f79791700 1 --2- 172.21.15.40:0/1643099454 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f7409e030 0x7f9f7413d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.749+0000 7f9f79791700 1 -- 172.21.15.40:0/1643099454 >> 172.21.15.40:0/1643099454 conn(0x7f9f7409fb20 msgr2=0x7f9f7409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:08.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.749+0000 7f967543e700 1 -- 172.21.15.40:0/590003213 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9670135940 msgr2=0x7f9670137d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.749+0000 7f967543e700 1 --2- 172.21.15.40:0/590003213 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9670135940 0x7f9670137d20 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f9668009e80 tx=0x7f966800b330 comp rx=0 tx=0).stop 2023-09-30T22:29:08.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.749+0000 7f967543e700 1 -- 172.21.15.40:0/590003213 shutdown_connections 2023-09-30T22:29:08.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.749+0000 7f967543e700 1 --2- 172.21.15.40:0/590003213 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9670135940 0x7f9670137d20 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.749+0000 7f967543e700 1 --2- 172.21.15.40:0/590003213 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f967009df30 0x7f9670135400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.749+0000 7f967543e700 1 -- 172.21.15.40:0/590003213 >> 172.21.15.40:0/590003213 conn(0x7f96700a2a00 msgr2=0x7f96700a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:08.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.749+0000 7f9f79791700 1 -- 172.21.15.40:0/1643099454 shutdown_connections 2023-09-30T22:29:08.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.749+0000 7f9f79791700 1 -- 172.21.15.40:0/1643099454 wait complete. 2023-09-30T22:29:08.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.749+0000 7f967543e700 1 -- 172.21.15.40:0/590003213 shutdown_connections 2023-09-30T22:29:08.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.749+0000 7f967543e700 1 -- 172.21.15.40:0/590003213 wait complete. 2023-09-30T22:29:08.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.750+0000 7f967543e700 1 Processor -- start 2023-09-30T22:29:08.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.750+0000 7f9f79791700 1 Processor -- start 2023-09-30T22:29:08.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.750+0000 7f967543e700 1 -- start start 2023-09-30T22:29:08.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.751+0000 7f967543e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f967009d450 0x7f9670138bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.751+0000 7f967543e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f967009df30 0x7f9670139100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.751+0000 7f967543e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9670135940 0x7f96701c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.751+0000 7f967543e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9670131760 con 0x7f967009df30 2023-09-30T22:29:08.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.751+0000 7f967543e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9670138800 con 0x7f967009d450 2023-09-30T22:29:08.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.751+0000 7f967543e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f967009c5d0 con 0x7f9670135940 2023-09-30T22:29:08.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.751+0000 7f966e7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f967009df30 0x7f9670139100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.751+0000 7f966e7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f967009df30 0x7f9670139100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46738/0 (socket says 172.21.15.40:46738) 2023-09-30T22:29:08.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.751+0000 7f966e7fc700 1 -- 172.21.15.40:0/738217206 learned_addr learned my addr 172.21.15.40:0/738217206 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:08.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.751+0000 7f966effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f967009d450 0x7f9670138bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.751+0000 7f966f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9670135940 0x7f96701c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.751+0000 7f966f7fe700 1 -- 172.21.15.40:0/738217206 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f967009d450 msgr2=0x7f9670138bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.751+0000 7f966f7fe700 1 --2- 172.21.15.40:0/738217206 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f967009d450 0x7f9670138bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.751+0000 7f966f7fe700 1 -- 172.21.15.40:0/738217206 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f967009df30 msgr2=0x7f9670139100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.751+0000 7f966f7fe700 1 --2- 172.21.15.40:0/738217206 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f967009df30 0x7f9670139100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.751+0000 7f966f7fe700 1 -- 172.21.15.40:0/738217206 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9668009b30 con 0x7f9670135940 2023-09-30T22:29:08.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.752+0000 7f966f7fe700 1 --2- 172.21.15.40:0/738217206 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9670135940 0x7f96701c65e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f9668009e80 tx=0x7f9668004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:08.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.752+0000 7f96577fe700 1 -- 172.21.15.40:0/738217206 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9668004450 con 0x7f9670135940 2023-09-30T22:29:08.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.752+0000 7f96577fe700 1 -- 172.21.15.40:0/738217206 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96680045b0 con 0x7f9670135940 2023-09-30T22:29:08.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.752+0000 7f96577fe700 1 -- 172.21.15.40:0/738217206 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9668004920 con 0x7f9670135940 2023-09-30T22:29:08.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.752+0000 7f967543e700 1 -- 172.21.15.40:0/738217206 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96700a2050 con 0x7f9670135940 2023-09-30T22:29:08.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.752+0000 7f967543e700 1 -- 172.21.15.40:0/738217206 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9670139640 con 0x7f9670135940 2023-09-30T22:29:08.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.752+0000 7f9f79791700 1 -- start start 2023-09-30T22:29:08.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.752+0000 7f9f79791700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f7406a6d0 0x7f9f74137460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.752+0000 7f9f79791700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f7409e030 0x7f9f741379a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.753+0000 7f9f79791700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f7409e420 0x7f9f74137ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.753+0000 7f9f79791700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7413f9c0 con 0x7f9f7409e030 2023-09-30T22:29:08.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.753+0000 7f9f79791700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7411d3d0 con 0x7f9f7409e420 2023-09-30T22:29:08.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.753+0000 7f9f79791700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7409f540 con 0x7f9f7406a6d0 2023-09-30T22:29:08.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.753+0000 7f9f737fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f7409e420 0x7f9f74137ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.753+0000 7f9f727fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f7409e030 0x7f9f741379a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.753+0000 7f9f737fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f7409e420 0x7f9f74137ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48886/0 (socket says 172.21.15.40:48886) 2023-09-30T22:29:08.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.753+0000 7f9f727fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f7409e030 0x7f9f741379a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46744/0 (socket says 172.21.15.40:46744) 2023-09-30T22:29:08.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.753+0000 7f9f737fe700 1 -- 172.21.15.40:0/8747442 learned_addr learned my addr 172.21.15.40:0/8747442 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:08.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.753+0000 7f9f72ffd700 1 --2- 172.21.15.40:0/8747442 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f7406a6d0 0x7f9f74137460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.753+0000 7f9f737fe700 1 -- 172.21.15.40:0/8747442 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f7406a6d0 msgr2=0x7f9f74137460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.753+0000 7f9f737fe700 1 --2- 172.21.15.40:0/8747442 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f7406a6d0 0x7f9f74137460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.753+0000 7f9f737fe700 1 -- 172.21.15.40:0/8747442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f7409e030 msgr2=0x7f9f741379a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.753+0000 7f9f737fe700 1 --2- 172.21.15.40:0/8747442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f7409e030 0x7f9f741379a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.753+0000 7f9f737fe700 1 -- 172.21.15.40:0/8747442 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f68009550 con 0x7f9f7409e420 2023-09-30T22:29:08.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.753+0000 7f96577fe700 1 -- 172.21.15.40:0/738217206 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f966802d420 con 0x7f9670135940 2023-09-30T22:29:08.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.753+0000 7f96577fe700 1 -- 172.21.15.40:0/738217206 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f966802c3b0 con 0x7f9670135940 2023-09-30T22:29:08.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.754+0000 7f9f737fe700 1 --2- 172.21.15.40:0/8747442 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f7409e420 0x7f9f74137ee0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9f7411db10 tx=0x7f9f6c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:08.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.754+0000 7f9f5b7fe700 1 -- 172.21.15.40:0/8747442 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c0046a0 con 0x7f9f7409e420 2023-09-30T22:29:08.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.754+0000 7f9f5b7fe700 1 -- 172.21.15.40:0/8747442 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6c004800 con 0x7f9f7409e420 2023-09-30T22:29:08.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.754+0000 7f9f5b7fe700 1 -- 172.21.15.40:0/8747442 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c004970 con 0x7f9f7409e420 2023-09-30T22:29:08.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.755+0000 7f9f79791700 1 -- 172.21.15.40:0/8747442 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f6c009a70 con 0x7f9f7409e420 2023-09-30T22:29:08.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.755+0000 7f9f79791700 1 -- 172.21.15.40:0/8747442 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f7411a6c0 con 0x7f9f7409e420 2023-09-30T22:29:08.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.755+0000 7f967543e700 1 -- 172.21.15.40:0/738217206 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96700a2820 con 0x7f9670135940 2023-09-30T22:29:08.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.756+0000 7f9f79791700 1 -- 172.21.15.40:0/8747442 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f7411ac00 con 0x7f9f7409e420 2023-09-30T22:29:08.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.757+0000 7f9f5b7fe700 1 -- 172.21.15.40:0/8747442 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9f6c01e670 con 0x7f9f7409e420 2023-09-30T22:29:08.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.757+0000 7f9f5b7fe700 1 -- 172.21.15.40:0/8747442 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9f6c042160 con 0x7f9f7409e420 2023-09-30T22:29:08.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.760+0000 7f96577fe700 1 -- 172.21.15.40:0/738217206 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f96680353c0 con 0x7f9670135940 2023-09-30T22:29:08.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.761+0000 7f9f5b7fe700 1 -- 172.21.15.40:0/8747442 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9f6c011980 con 0x7f9f7409e420 2023-09-30T22:29:08.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.859+0000 7feabba8e700 1 -- 172.21.15.40:0/3498116339 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7feab41304e0 con 0x7feab409dd60 2023-09-30T22:29:08.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.859+0000 7feaaa7fc700 1 -- 172.21.15.40:0/3498116339 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feaa40163c0 con 0x7feab409dd60 2023-09-30T22:29:08.860 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:08.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.861+0000 7feabba8e700 1 -- 172.21.15.40:0/3498116339 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feab409dd60 msgr2=0x7feab411e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.861+0000 7feabba8e700 1 --2- 172.21.15.40:0/3498116339 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feab409dd60 0x7feab411e0c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7feaa4018000 tx=0x7feaa4004750 comp rx=0 tx=0).stop 2023-09-30T22:29:08.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.861+0000 7feabba8e700 1 -- 172.21.15.40:0/3498116339 shutdown_connections 2023-09-30T22:29:08.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.861+0000 7feabba8e700 1 --2- 172.21.15.40:0/3498116339 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feab409d450 0x7feab411db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.861+0000 7feabba8e700 1 --2- 172.21.15.40:0/3498116339 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feab4130700 0x7feab411e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.861+0000 7feabba8e700 1 --2- 172.21.15.40:0/3498116339 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feab409dd60 0x7feab411e0c0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.861+0000 7feabba8e700 1 -- 172.21.15.40:0/3498116339 >> 172.21.15.40:0/3498116339 conn(0x7feab40a2a00 msgr2=0x7feab40a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:08.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.861+0000 7feabba8e700 1 -- 172.21.15.40:0/3498116339 shutdown_connections 2023-09-30T22:29:08.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.861+0000 7feabba8e700 1 -- 172.21.15.40:0/3498116339 wait complete. 2023-09-30T22:29:08.875 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:08.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.921+0000 7f2d07b23700 1 -- 172.21.15.40:0/517326112 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2d00074720 con 0x7f2d00133ca0 2023-09-30T22:29:08.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.921+0000 7f2cf67fc700 1 -- 172.21.15.40:0/517326112 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2cf0017020 con 0x7f2d00133ca0 2023-09-30T22:29:08.922 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:08.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.923+0000 7f2d07b23700 1 -- 172.21.15.40:0/517326112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d00133ca0 msgr2=0x7f2d00119f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.923+0000 7f2d07b23700 1 --2- 172.21.15.40:0/517326112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d00133ca0 0x7f2d00119f10 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f2d0006b7b0 tx=0x7f2cf000ebb0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.923+0000 7f2d07b23700 1 -- 172.21.15.40:0/517326112 shutdown_connections 2023-09-30T22:29:08.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.923+0000 7f2d07b23700 1 --2- 172.21.15.40:0/517326112 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2d0009d920 0x7f2d001199d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.923+0000 7f2d07b23700 1 --2- 172.21.15.40:0/517326112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d001cc860 0x7f2d001cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.923+0000 7f2d07b23700 1 --2- 172.21.15.40:0/517326112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d00133ca0 0x7f2d00119f10 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.923+0000 7f2d07b23700 1 -- 172.21.15.40:0/517326112 >> 172.21.15.40:0/517326112 conn(0x7f2d0009fb20 msgr2=0x7f2d000a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:08.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.924+0000 7f2d07b23700 1 -- 172.21.15.40:0/517326112 shutdown_connections 2023-09-30T22:29:08.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.924+0000 7f2d07b23700 1 -- 172.21.15.40:0/517326112 wait complete. 2023-09-30T22:29:08.936 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:08.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.958+0000 7f967543e700 1 -- 172.21.15.40:0/738217206 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9670062380 con 0x7f9670135940 2023-09-30T22:29:08.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.958+0000 7f96577fe700 1 -- 172.21.15.40:0/738217206 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9668019320 con 0x7f9670135940 2023-09-30T22:29:08.959 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:08.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.960+0000 7f967543e700 1 -- 172.21.15.40:0/738217206 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9670135940 msgr2=0x7f96701c65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.960+0000 7f967543e700 1 --2- 172.21.15.40:0/738217206 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9670135940 0x7f96701c65e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f9668009e80 tx=0x7f9668004ad0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.960+0000 7f967543e700 1 -- 172.21.15.40:0/738217206 shutdown_connections 2023-09-30T22:29:08.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.960+0000 7f967543e700 1 --2- 172.21.15.40:0/738217206 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9670135940 0x7f96701c65e0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.960+0000 7f967543e700 1 --2- 172.21.15.40:0/738217206 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f967009d450 0x7f9670138bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.960+0000 7f967543e700 1 --2- 172.21.15.40:0/738217206 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f967009df30 0x7f9670139100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.960+0000 7f967543e700 1 -- 172.21.15.40:0/738217206 >> 172.21.15.40:0/738217206 conn(0x7f96700a2a00 msgr2=0x7f967006e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:08.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.960+0000 7f967543e700 1 -- 172.21.15.40:0/738217206 shutdown_connections 2023-09-30T22:29:08.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.960+0000 7f967543e700 1 -- 172.21.15.40:0/738217206 wait complete. 2023-09-30T22:29:08.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.961+0000 7f9f79791700 1 -- 172.21.15.40:0/8747442 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9f74062380 con 0x7f9f7409e420 2023-09-30T22:29:08.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.961+0000 7f9f5b7fe700 1 -- 172.21.15.40:0/8747442 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9f6c02b020 con 0x7f9f7409e420 2023-09-30T22:29:08.962 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:08.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.964+0000 7f9f79791700 1 -- 172.21.15.40:0/8747442 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f7409e420 msgr2=0x7f9f74137ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.964+0000 7f9f79791700 1 --2- 172.21.15.40:0/8747442 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f7409e420 0x7f9f74137ee0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9f7411db10 tx=0x7f9f6c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.964+0000 7f9f79791700 1 -- 172.21.15.40:0/8747442 shutdown_connections 2023-09-30T22:29:08.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.964+0000 7f9f79791700 1 --2- 172.21.15.40:0/8747442 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f7406a6d0 0x7f9f74137460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.964+0000 7f9f79791700 1 --2- 172.21.15.40:0/8747442 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f7409e420 0x7f9f74137ee0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.964+0000 7f9f79791700 1 --2- 172.21.15.40:0/8747442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f7409e030 0x7f9f741379a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.964+0000 7f9f79791700 1 -- 172.21.15.40:0/8747442 >> 172.21.15.40:0/8747442 conn(0x7f9f7409fb20 msgr2=0x7f9f7406e920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:08.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.964+0000 7f9f79791700 1 -- 172.21.15.40:0/8747442 shutdown_connections 2023-09-30T22:29:08.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:08.964+0000 7f9f79791700 1 -- 172.21.15.40:0/8747442 wait complete. 2023-09-30T22:29:08.975 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:08.977 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:09.876 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:09.937 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:09.976 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:09.978 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:10.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.022+0000 7f95a3d96700 1 Processor -- start 2023-09-30T22:29:10.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.023+0000 7f95a3d96700 1 -- start start 2023-09-30T22:29:10.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.023+0000 7f95a3d96700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f959c12e590 0x7f959c12e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.023+0000 7f95a3d96700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f959c12d8a0 0x7f959c138c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.023+0000 7f95a3d96700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f959c09ab70 con 0x7f959c12eea0 2023-09-30T22:29:10.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.023+0000 7f95a3d96700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f959c09b270 con 0x7f959c12d8a0 2023-09-30T22:29:10.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.023+0000 7f95a3d96700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959c09bab0 con 0x7f959c12e590 2023-09-30T22:29:10.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.023+0000 7f95a1b32700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f959c12e590 0x7f959c12e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.023+0000 7f95a1b32700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f959c12e590 0x7f959c12e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48888/0 (socket says 172.21.15.40:48888) 2023-09-30T22:29:10.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.023+0000 7f95a1b32700 1 -- 172.21.15.40:0/63768723 learned_addr learned my addr 172.21.15.40:0/63768723 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:10.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.024+0000 7f95a2333700 1 --2- 172.21.15.40:0/63768723 >> v2:172.21.15.40:3300/0 conn(0x7f959c12d8a0 0x7f959c138c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.024+0000 7f95a1b32700 1 -- 172.21.15.40:0/63768723 >> v2:172.21.15.40:3300/0 conn(0x7f959c12d8a0 msgr2=0x7f959c138c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:10.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.024+0000 7f95a1b32700 1 --2- 172.21.15.40:0/63768723 >> v2:172.21.15.40:3300/0 conn(0x7f959c12d8a0 0x7f959c138c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.024+0000 7f95a1b32700 1 -- 172.21.15.40:0/63768723 >> v1:172.21.15.40:6789/0 conn(0x7f959c12eea0 legacy=0x7f959c12d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:10.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.024+0000 7f95a1b32700 1 -- 172.21.15.40:0/63768723 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959c09bd70 con 0x7f959c12e590 2023-09-30T22:29:10.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.024+0000 7f95a1b32700 1 --2- 172.21.15.40:0/63768723 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f959c12e590 0x7f959c12e960 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f959800bbc0 tx=0x7f959800bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9e04a6ae0ee05f7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:10.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.024+0000 7f95a0b30700 1 -- 172.21.15.40:0/63768723 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959800dd50 con 0x7f959c12e590 2023-09-30T22:29:10.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.024+0000 7f95a0b30700 1 -- 172.21.15.40:0/63768723 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9598010470 con 0x7f959c12e590 2023-09-30T22:29:10.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.024+0000 7f95a0b30700 1 -- 172.21.15.40:0/63768723 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9598010800 con 0x7f959c12e590 2023-09-30T22:29:10.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.025+0000 7f95a3d96700 1 -- 172.21.15.40:0/63768723 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f959c12e590 msgr2=0x7f959c12e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:10.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.025+0000 7f95a3d96700 1 --2- 172.21.15.40:0/63768723 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f959c12e590 0x7f959c12e960 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f959800bbc0 tx=0x7f959800bed0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.025+0000 7f95a3d96700 1 -- 172.21.15.40:0/63768723 shutdown_connections 2023-09-30T22:29:10.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.025+0000 7f95a3d96700 1 --2- 172.21.15.40:0/63768723 >> v2:172.21.15.40:3300/0 conn(0x7f959c12d8a0 0x7f959c138c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.025+0000 7f95a3d96700 1 --2- 172.21.15.40:0/63768723 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f959c12e590 0x7f959c12e960 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.025+0000 7f95a3d96700 1 -- 172.21.15.40:0/63768723 >> 172.21.15.40:0/63768723 conn(0x7f959c0a2a00 msgr2=0x7f959c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:10.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.025+0000 7f95a3d96700 1 -- 172.21.15.40:0/63768723 shutdown_connections 2023-09-30T22:29:10.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.025+0000 7f95a3d96700 1 -- 172.21.15.40:0/63768723 wait complete. 2023-09-30T22:29:10.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.027+0000 7f95a3d96700 1 Processor -- start 2023-09-30T22:29:10.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.027+0000 7f95a3d96700 1 -- start start 2023-09-30T22:29:10.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.028+0000 7f95a3d96700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f959c12d8a0 0x7f959c11ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.028+0000 7f95a3d96700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f959c12e590 0x7f959c11f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.028+0000 7f95a3d96700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f959c12eea0 0x7f959c11f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.028+0000 7f95a3d96700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959c1227a0 con 0x7f959c12d8a0 2023-09-30T22:29:10.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.028+0000 7f95a3d96700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959c120a90 con 0x7f959c12eea0 2023-09-30T22:29:10.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.028+0000 7f95a3d96700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f959c09b4b0 con 0x7f959c12e590 2023-09-30T22:29:10.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.028+0000 7f95a1b32700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f959c12d8a0 0x7f959c11ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.028+0000 7f95a1b32700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f959c12d8a0 0x7f959c11ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46772/0 (socket says 172.21.15.40:46772) 2023-09-30T22:29:10.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.028+0000 7f95a2333700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f959c12eea0 0x7f959c11f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.028+0000 7f95a1b32700 1 -- 172.21.15.40:0/3721107065 learned_addr learned my addr 172.21.15.40:0/3721107065 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:10.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.028+0000 7f95a1b32700 1 -- 172.21.15.40:0/3721107065 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f959c12e590 msgr2=0x7f959c11f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:10.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.028+0000 7f95a1b32700 1 --2- 172.21.15.40:0/3721107065 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f959c12e590 0x7f959c11f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.028+0000 7f95a1b32700 1 -- 172.21.15.40:0/3721107065 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f959c12eea0 msgr2=0x7f959c11f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:10.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.028+0000 7f95a1b32700 1 --2- 172.21.15.40:0/3721107065 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f959c12eea0 0x7f959c11f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.028+0000 7f95a1b32700 1 -- 172.21.15.40:0/3721107065 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959800b7f0 con 0x7f959c12d8a0 2023-09-30T22:29:10.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.028+0000 7f95a2333700 1 --2- 172.21.15.40:0/3721107065 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f959c12eea0 0x7f959c11f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:10.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.028+0000 7f95a1b32700 1 --2- 172.21.15.40:0/3721107065 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f959c12d8a0 0x7f959c11ee80 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f959800bf10 tx=0x7f9598004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:10.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.029+0000 7f95927fc700 1 -- 172.21.15.40:0/3721107065 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9598003bb0 con 0x7f959c12d8a0 2023-09-30T22:29:10.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.029+0000 7f95a3d96700 1 -- 172.21.15.40:0/3721107065 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f959c09cdb0 con 0x7f959c12d8a0 2023-09-30T22:29:10.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.029+0000 7f95a3d96700 1 -- 172.21.15.40:0/3721107065 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f959c123130 con 0x7f959c12d8a0 2023-09-30T22:29:10.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.029+0000 7f95927fc700 1 -- 172.21.15.40:0/3721107065 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9598003d10 con 0x7f959c12d8a0 2023-09-30T22:29:10.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.029+0000 7f95927fc700 1 -- 172.21.15.40:0/3721107065 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95980107e0 con 0x7f959c12d8a0 2023-09-30T22:29:10.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.030+0000 7f95927fc700 1 -- 172.21.15.40:0/3721107065 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9598010940 con 0x7f959c12d8a0 2023-09-30T22:29:10.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.030+0000 7f95927fc700 1 -- 172.21.15.40:0/3721107065 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9598040aa0 con 0x7f959c12d8a0 2023-09-30T22:29:10.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.030+0000 7f95a3d96700 1 -- 172.21.15.40:0/3721107065 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95840052e0 con 0x7f959c12d8a0 2023-09-30T22:29:10.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.039+0000 7f95927fc700 1 -- 172.21.15.40:0/3721107065 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9598006bd0 con 0x7f959c12d8a0 2023-09-30T22:29:10.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.091+0000 7f1271ab1700 1 Processor -- start 2023-09-30T22:29:10.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.091+0000 7f1271ab1700 1 -- start start 2023-09-30T22:29:10.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.091+0000 7f1271ab1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f126c06f070 0x7f126c06f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.091+0000 7f1271ab1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f126c06f980 0x7f126c097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.091+0000 7f1271ab1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f126c06fdb0 0x7f126c0975d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.091+0000 7f1271ab1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f126c070830 con 0x7f126c06f980 2023-09-30T22:29:10.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.091+0000 7f1271ab1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126c070ad0 con 0x7f126c06f070 2023-09-30T22:29:10.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.091+0000 7f1271ab1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f126c070de0 con 0x7f126c06fdb0 2023-09-30T22:29:10.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.092+0000 7f126bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f126c06fdb0 0x7f126c0975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.092+0000 7f126bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f126c06fdb0 0x7f126c0975d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48574/0 (socket says 172.21.15.40:48574) 2023-09-30T22:29:10.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.092+0000 7f126bfff700 1 -- 172.21.15.40:0/3534855836 learned_addr learned my addr 172.21.15.40:0/3534855836 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:10.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.092+0000 7f1263fff700 1 --2- 172.21.15.40:0/3534855836 >> v2:172.21.15.40:3300/0 conn(0x7f126c06f980 0x7f126c097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.092+0000 7f126bfff700 1 -- 172.21.15.40:0/3534855836 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f126c06f070 msgr2=0x7f126c06f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:10.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.092+0000 7f126bfff700 1 --2- 172.21.15.40:0/3534855836 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f126c06f070 0x7f126c06f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.092+0000 7f126bfff700 1 -- 172.21.15.40:0/3534855836 >> v2:172.21.15.40:3300/0 conn(0x7f126c06f980 msgr2=0x7f126c097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:10.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.092+0000 7f126bfff700 1 --2- 172.21.15.40:0/3534855836 >> v2:172.21.15.40:3300/0 conn(0x7f126c06f980 0x7f126c097090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.092+0000 7f126bfff700 1 -- 172.21.15.40:0/3534855836 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126c09fe20 con 0x7f126c06fdb0 2023-09-30T22:29:10.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.092+0000 7f126bfff700 1 --2- 172.21.15.40:0/3534855836 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f126c06fdb0 0x7f126c0975d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f1264009e50 tx=0x7f126400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e926a99a2dfa95ce server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:10.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.092+0000 7f126affd700 1 -- 172.21.15.40:0/3534855836 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126400e070 con 0x7f126c06fdb0 2023-09-30T22:29:10.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.092+0000 7f126affd700 1 -- 172.21.15.40:0/3534855836 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126400b910 con 0x7f126c06fdb0 2023-09-30T22:29:10.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.092+0000 7f126affd700 1 -- 172.21.15.40:0/3534855836 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126400bcc0 con 0x7f126c06fdb0 2023-09-30T22:29:10.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.093+0000 7f1271ab1700 1 -- 172.21.15.40:0/3534855836 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f126c06fdb0 msgr2=0x7f126c0975d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:10.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.093+0000 7f1271ab1700 1 --2- 172.21.15.40:0/3534855836 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f126c06fdb0 0x7f126c0975d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f1264009e50 tx=0x7f126400b330 comp rx=0 tx=0).stop 2023-09-30T22:29:10.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.094+0000 7f1271ab1700 1 -- 172.21.15.40:0/3534855836 shutdown_connections 2023-09-30T22:29:10.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.094+0000 7f1271ab1700 1 --2- 172.21.15.40:0/3534855836 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f126c06fdb0 0x7f126c0975d0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.094+0000 7f1271ab1700 1 --2- 172.21.15.40:0/3534855836 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f126c06f070 0x7f126c06f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.094+0000 7f1271ab1700 1 --2- 172.21.15.40:0/3534855836 >> v2:172.21.15.40:3300/0 conn(0x7f126c06f980 0x7f126c097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.094+0000 7f1271ab1700 1 -- 172.21.15.40:0/3534855836 >> 172.21.15.40:0/3534855836 conn(0x7f126c0a41a0 msgr2=0x7f126c0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:10.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.094+0000 7f1271ab1700 1 -- 172.21.15.40:0/3534855836 shutdown_connections 2023-09-30T22:29:10.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.094+0000 7f1271ab1700 1 -- 172.21.15.40:0/3534855836 wait complete. 2023-09-30T22:29:10.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.095+0000 7f1271ab1700 1 Processor -- start 2023-09-30T22:29:10.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.095+0000 7f1271ab1700 1 -- start start 2023-09-30T22:29:10.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.095+0000 7f1271ab1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f126c06f070 0x7f126c06c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.095+0000 7f1271ab1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f126c06f980 0x7f126c06ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.095+0000 7f1271ab1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f126c06fdb0 0x7f126c06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.095+0000 7f1271ab1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c129310 con 0x7f126c06f070 2023-09-30T22:29:10.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.095+0000 7f1271ab1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126c097020 con 0x7f126c06f980 2023-09-30T22:29:10.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.095+0000 7f1271ab1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f126c06e5b0 con 0x7f126c06fdb0 2023-09-30T22:29:10.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.095+0000 7f126b7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f126c06f070 0x7f126c06c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.095+0000 7f126b7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f126c06f070 0x7f126c06c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46788/0 (socket says 172.21.15.40:46788) 2023-09-30T22:29:10.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.095+0000 7f126b7fe700 1 -- 172.21.15.40:0/1303431460 learned_addr learned my addr 172.21.15.40:0/1303431460 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:10.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.095+0000 7f1263fff700 1 --2- 172.21.15.40:0/1303431460 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f126c06f980 0x7f126c06ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.095+0000 7f126bfff700 1 --2- 172.21.15.40:0/1303431460 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f126c06fdb0 0x7f126c06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.096+0000 7f126b7fe700 1 -- 172.21.15.40:0/1303431460 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f126c06fdb0 msgr2=0x7f126c06d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:10.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.096+0000 7f126b7fe700 1 --2- 172.21.15.40:0/1303431460 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f126c06fdb0 0x7f126c06d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.096+0000 7f126b7fe700 1 -- 172.21.15.40:0/1303431460 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f126c06f980 msgr2=0x7f126c06ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:10.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.096+0000 7f126b7fe700 1 --2- 172.21.15.40:0/1303431460 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f126c06f980 0x7f126c06ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.096+0000 7f126b7fe700 1 -- 172.21.15.40:0/1303431460 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1264009b30 con 0x7f126c06f070 2023-09-30T22:29:10.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.096+0000 7f1263fff700 1 --2- 172.21.15.40:0/1303431460 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f126c06f980 0x7f126c06ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:10.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.096+0000 7f126b7fe700 1 --2- 172.21.15.40:0/1303431460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f126c06f070 0x7f126c06c990 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f125c00b560 tx=0x7f125c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:10.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.096+0000 7f1268ff9700 1 -- 172.21.15.40:0/1303431460 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c011830 con 0x7f126c06f070 2023-09-30T22:29:10.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.096+0000 7f1268ff9700 1 -- 172.21.15.40:0/1303431460 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125c0119b0 con 0x7f126c06f070 2023-09-30T22:29:10.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.096+0000 7f1268ff9700 1 -- 172.21.15.40:0/1303431460 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c011d60 con 0x7f126c06f070 2023-09-30T22:29:10.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.096+0000 7f1271ab1700 1 -- 172.21.15.40:0/1303431460 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f126c08bff0 con 0x7f126c06f070 2023-09-30T22:29:10.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.096+0000 7f1271ab1700 1 -- 172.21.15.40:0/1303431460 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f126c08b0e0 con 0x7f126c06f070 2023-09-30T22:29:10.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.097+0000 7f1268ff9700 1 -- 172.21.15.40:0/1303431460 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f125c01a400 con 0x7f126c06f070 2023-09-30T22:29:10.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.097+0000 7f1268ff9700 1 -- 172.21.15.40:0/1303431460 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f125c03f6b0 con 0x7f126c06f070 2023-09-30T22:29:10.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.098+0000 7f1271ab1700 1 -- 172.21.15.40:0/1303431460 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f126c062380 con 0x7f126c06f070 2023-09-30T22:29:10.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.102+0000 7f1268ff9700 1 -- 172.21.15.40:0/1303431460 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f125c015070 con 0x7f126c06f070 2023-09-30T22:29:10.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.128+0000 7fd9e4c42700 1 Processor -- start 2023-09-30T22:29:10.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.128+0000 7fd9e4c42700 1 -- start start 2023-09-30T22:29:10.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.129+0000 7fd9e4c42700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9e0133e00 0x7fd9e01341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.129+0000 7fd9e4c42700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd9e009d400 0x7fd9e009d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.129+0000 7fd9e4c42700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd9e009dd70 0x7fd9e013ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.129+0000 7fd9e4c42700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9e009ab20 con 0x7fd9e009dd70 2023-09-30T22:29:10.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.129+0000 7fd9e4c42700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e0133940 con 0x7fd9e0133e00 2023-09-30T22:29:10.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.129+0000 7fd9e4c42700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e009f0d0 con 0x7fd9e009d400 2023-09-30T22:29:10.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.129+0000 7fd9ddd9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd9e009d400 0x7fd9e009d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.129+0000 7fd9ded9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd9e009dd70 0x7fd9e013ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.129+0000 7fd9de59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9e0133e00 0x7fd9e01341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.129+0000 7fd9ddd9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd9e009d400 0x7fd9e009d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48590/0 (socket says 172.21.15.40:48590) 2023-09-30T22:29:10.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.129+0000 7fd9ddd9b700 1 -- 172.21.15.40:0/3453400449 learned_addr learned my addr 172.21.15.40:0/3453400449 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:10.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.130+0000 7fd9ddd9b700 1 -- 172.21.15.40:0/3453400449 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9e0133e00 msgr2=0x7fd9e01341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:10.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.130+0000 7fd9ddd9b700 1 --2- 172.21.15.40:0/3453400449 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9e0133e00 0x7fd9e01341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.130+0000 7fd9ddd9b700 1 -- 172.21.15.40:0/3453400449 >> v2:172.21.15.40:3300/0 conn(0x7fd9e009dd70 msgr2=0x7fd9e013ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:10.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.130+0000 7fd9ddd9b700 1 --2- 172.21.15.40:0/3453400449 >> v2:172.21.15.40:3300/0 conn(0x7fd9e009dd70 0x7fd9e013ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.130+0000 7fd9ddd9b700 1 -- 172.21.15.40:0/3453400449 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e009e210 con 0x7fd9e009d400 2023-09-30T22:29:10.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.130+0000 7fd9de59c700 1 --2- 172.21.15.40:0/3453400449 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9e0133e00 0x7fd9e01341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:10.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.130+0000 7fd9ded9d700 1 --2- 172.21.15.40:0/3453400449 >> v2:172.21.15.40:3300/0 conn(0x7fd9e009dd70 0x7fd9e013ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:10.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.130+0000 7fd9ddd9b700 1 --2- 172.21.15.40:0/3453400449 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd9e009d400 0x7fd9e009d830 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd9d40098f0 tx=0x7fd9d4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=889491ae8180bf95 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:10.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.130+0000 7fd9dd59a700 1 -- 172.21.15.40:0/3453400449 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4011830 con 0x7fd9e009d400 2023-09-30T22:29:10.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.130+0000 7fd9dd59a700 1 -- 172.21.15.40:0/3453400449 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d4011990 con 0x7fd9e009d400 2023-09-30T22:29:10.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.130+0000 7fd9dd59a700 1 -- 172.21.15.40:0/3453400449 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4011d20 con 0x7fd9e009d400 2023-09-30T22:29:10.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.131+0000 7fd9e4c42700 1 -- 172.21.15.40:0/3453400449 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd9e009d400 msgr2=0x7fd9e009d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:10.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.131+0000 7fd9e4c42700 1 --2- 172.21.15.40:0/3453400449 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd9e009d400 0x7fd9e009d830 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd9d40098f0 tx=0x7fd9d4009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:10.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.131+0000 7fd9e4c42700 1 -- 172.21.15.40:0/3453400449 shutdown_connections 2023-09-30T22:29:10.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.131+0000 7fd9e4c42700 1 --2- 172.21.15.40:0/3453400449 >> v2:172.21.15.40:3300/0 conn(0x7fd9e009dd70 0x7fd9e013ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.131+0000 7fd9e4c42700 1 --2- 172.21.15.40:0/3453400449 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9e0133e00 0x7fd9e01341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.131+0000 7fd9e4c42700 1 --2- 172.21.15.40:0/3453400449 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd9e009d400 0x7fd9e009d830 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.131+0000 7fd9e4c42700 1 -- 172.21.15.40:0/3453400449 >> 172.21.15.40:0/3453400449 conn(0x7fd9e00a2a00 msgr2=0x7fd9e00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:10.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.131+0000 7fd9e4c42700 1 -- 172.21.15.40:0/3453400449 shutdown_connections 2023-09-30T22:29:10.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.131+0000 7fd9e4c42700 1 -- 172.21.15.40:0/3453400449 wait complete. 2023-09-30T22:29:10.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.132+0000 7fd9e4c42700 1 Processor -- start 2023-09-30T22:29:10.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.132+0000 7fd9e4c42700 1 -- start start 2023-09-30T22:29:10.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.133+0000 7fd9e4c42700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9e009d400 0x7fd9e0119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.133+0000 7fd9e4c42700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd9e009dd70 0x7fd9e0119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.133+0000 7fd9e4c42700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9e0133e00 0x7fd9e0119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.133+0000 7fd9e4c42700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e011aa90 con 0x7fd9e009d400 2023-09-30T22:29:10.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.133+0000 7fd9e4c42700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e011cd10 con 0x7fd9e0133e00 2023-09-30T22:29:10.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.133+0000 7fd9e4c42700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e011c350 con 0x7fd9e009dd70 2023-09-30T22:29:10.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.133+0000 7fd9de59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9e009d400 0x7fd9e0119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.133+0000 7fd9de59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9e009d400 0x7fd9e0119050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46808/0 (socket says 172.21.15.40:46808) 2023-09-30T22:29:10.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.133+0000 7fd9de59c700 1 -- 172.21.15.40:0/3582650084 learned_addr learned my addr 172.21.15.40:0/3582650084 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:10.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.133+0000 7fd9ddd9b700 1 --2- 172.21.15.40:0/3582650084 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd9e009dd70 0x7fd9e0119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.134+0000 7fd9ded9d700 1 --2- 172.21.15.40:0/3582650084 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9e0133e00 0x7fd9e0119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.134+0000 7fd9ddd9b700 1 -- 172.21.15.40:0/3582650084 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9e0133e00 msgr2=0x7fd9e0119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:10.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.134+0000 7fd9ddd9b700 1 --2- 172.21.15.40:0/3582650084 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9e0133e00 0x7fd9e0119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.134+0000 7fd9ddd9b700 1 -- 172.21.15.40:0/3582650084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9e009d400 msgr2=0x7fd9e0119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:10.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.134+0000 7fd9ddd9b700 1 --2- 172.21.15.40:0/3582650084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9e009d400 0x7fd9e0119050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.134+0000 7fd9ddd9b700 1 -- 172.21.15.40:0/3582650084 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d8009a70 con 0x7fd9e009dd70 2023-09-30T22:29:10.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.134+0000 7fd9de59c700 1 --2- 172.21.15.40:0/3582650084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9e009d400 0x7fd9e0119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:10.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.134+0000 7fd9ddd9b700 1 --2- 172.21.15.40:0/3582650084 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd9e009dd70 0x7fd9e0119590 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4016000 tx=0x7fd9d4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:10.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.134+0000 7fd9ceffd700 1 -- 172.21.15.40:0/3582650084 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4004240 con 0x7fd9e009dd70 2023-09-30T22:29:10.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.134+0000 7fd9ceffd700 1 -- 172.21.15.40:0/3582650084 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d4027070 con 0x7fd9e009dd70 2023-09-30T22:29:10.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.134+0000 7fd9ceffd700 1 -- 172.21.15.40:0/3582650084 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d40036a0 con 0x7fd9e009dd70 2023-09-30T22:29:10.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.135+0000 7fd9e4c42700 1 -- 172.21.15.40:0/3582650084 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d00094a0 con 0x7fd9e009dd70 2023-09-30T22:29:10.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.135+0000 7fd9e4c42700 1 -- 172.21.15.40:0/3582650084 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d4009550 con 0x7fd9e009dd70 2023-09-30T22:29:10.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.136+0000 7fd9ceffd700 1 -- 172.21.15.40:0/3582650084 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd9d4029030 con 0x7fd9e009dd70 2023-09-30T22:29:10.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.136+0000 7fd9ceffd700 1 -- 172.21.15.40:0/3582650084 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd9d4019570 con 0x7fd9e009dd70 2023-09-30T22:29:10.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.137+0000 7fd9e4c42700 1 -- 172.21.15.40:0/3582650084 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9e011bd10 con 0x7fd9e009dd70 2023-09-30T22:29:10.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.141+0000 7fd9ceffd700 1 -- 172.21.15.40:0/3582650084 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd9e011bd10 con 0x7fd9e009dd70 2023-09-30T22:29:10.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.144+0000 7fa50d692700 1 Processor -- start 2023-09-30T22:29:10.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.144+0000 7fa50d692700 1 -- start start 2023-09-30T22:29:10.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.144+0000 7fa50d692700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa508138250 0x7fa508138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.144+0000 7fa50d692700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa50809d400 0x7fa50809d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.144+0000 7fa50d692700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa508137e20 con 0x7fa50809dd50 2023-09-30T22:29:10.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.144+0000 7fa50d692700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa508138050 con 0x7fa508138250 2023-09-30T22:29:10.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.144+0000 7fa50d692700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa50809b010 con 0x7fa50809d400 2023-09-30T22:29:10.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.144+0000 7fa506ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa508138250 0x7fa508138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.144+0000 7fa5077fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa50809dd50 0x7fa50813f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46984/0 (socket says 172.21.15.40:46984) 2023-09-30T22:29:10.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.144+0000 7fa5077fe700 1 -- 172.21.15.40:0/629353500 learned_addr learned my addr 172.21.15.40:0/629353500 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:29:10.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.145+0000 7fa5067fc700 1 --2- 172.21.15.40:0/629353500 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa50809d400 0x7fa50809d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.145+0000 7fa506ffd700 1 -- 172.21.15.40:0/629353500 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa50809d400 msgr2=0x7fa50809d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:10.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.145+0000 7fa506ffd700 1 --2- 172.21.15.40:0/629353500 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa50809d400 0x7fa50809d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.145+0000 7fa506ffd700 1 -- 172.21.15.40:0/629353500 >> v1:172.21.15.40:6789/0 conn(0x7fa50809dd50 legacy=0x7fa50813f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:10.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.145+0000 7fa506ffd700 1 -- 172.21.15.40:0/629353500 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50809f1f0 con 0x7fa508138250 2023-09-30T22:29:10.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.145+0000 7fa506ffd700 1 --2- 172.21.15.40:0/629353500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa508138250 0x7fa508138620 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8009840 tx=0x7fa4f8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf31ca3a5f1547a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:10.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.145+0000 7fa505ffb700 1 -- 172.21.15.40:0/629353500 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f8011830 con 0x7fa508138250 2023-09-30T22:29:10.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.145+0000 7fa505ffb700 1 -- 172.21.15.40:0/629353500 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f8011990 con 0x7fa508138250 2023-09-30T22:29:10.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.145+0000 7fa505ffb700 1 -- 172.21.15.40:0/629353500 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f8011d20 con 0x7fa508138250 2023-09-30T22:29:10.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.146+0000 7fa50d692700 1 -- 172.21.15.40:0/629353500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa508138250 msgr2=0x7fa508138620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:10.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.146+0000 7fa50d692700 1 --2- 172.21.15.40:0/629353500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa508138250 0x7fa508138620 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8009840 tx=0x7fa4f8009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:10.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.146+0000 7fa50d692700 1 -- 172.21.15.40:0/629353500 shutdown_connections 2023-09-30T22:29:10.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.146+0000 7fa50d692700 1 --2- 172.21.15.40:0/629353500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa508138250 0x7fa508138620 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.146+0000 7fa50d692700 1 --2- 172.21.15.40:0/629353500 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa50809d400 0x7fa50809d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.146+0000 7fa50d692700 1 -- 172.21.15.40:0/629353500 >> 172.21.15.40:0/629353500 conn(0x7fa5080a2a00 msgr2=0x7fa5080a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:10.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.146+0000 7fa50d692700 1 -- 172.21.15.40:0/629353500 shutdown_connections 2023-09-30T22:29:10.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.146+0000 7fa50d692700 1 -- 172.21.15.40:0/629353500 wait complete. 2023-09-30T22:29:10.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.147+0000 7fa50d692700 1 Processor -- start 2023-09-30T22:29:10.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.147+0000 7fa50d692700 1 -- start start 2023-09-30T22:29:10.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.147+0000 7fa50d692700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa50809d400 0x7fa508133590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.147+0000 7fa50d692700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa50809dd50 0x7fa508133ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.147+0000 7fa50d692700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa508138250 0x7fa508134010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.147+0000 7fa50d692700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50813d2b0 con 0x7fa50809dd50 2023-09-30T22:29:10.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.147+0000 7fa50d692700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50813f190 con 0x7fa508138250 2023-09-30T22:29:10.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.147+0000 7fa50d692700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa508136040 con 0x7fa50809d400 2023-09-30T22:29:10.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.148+0000 7fa506ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa50809d400 0x7fa508133590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.148+0000 7fa506ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa50809d400 0x7fa508133590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48608/0 (socket says 172.21.15.40:48608) 2023-09-30T22:29:10.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.148+0000 7fa506ffd700 1 -- 172.21.15.40:0/3007115838 learned_addr learned my addr 172.21.15.40:0/3007115838 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:10.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.148+0000 7fa5067fc700 1 --2- 172.21.15.40:0/3007115838 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa50809dd50 0x7fa508133ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.148+0000 7fa5077fe700 1 --2- 172.21.15.40:0/3007115838 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa508138250 0x7fa508134010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.148+0000 7fa5067fc700 1 -- 172.21.15.40:0/3007115838 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa50809d400 msgr2=0x7fa508133590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:10.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.148+0000 7fa5067fc700 1 --2- 172.21.15.40:0/3007115838 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa50809d400 0x7fa508133590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.148+0000 7fa5067fc700 1 -- 172.21.15.40:0/3007115838 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa508138250 msgr2=0x7fa508134010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:10.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.148+0000 7fa5067fc700 1 --2- 172.21.15.40:0/3007115838 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa508138250 0x7fa508134010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.148+0000 7fa5067fc700 1 -- 172.21.15.40:0/3007115838 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f80094a0 con 0x7fa50809dd50 2023-09-30T22:29:10.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.148+0000 7fa5067fc700 1 --2- 172.21.15.40:0/3007115838 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa50809dd50 0x7fa508133ad0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc00e7e0 tx=0x7fa4fc00eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:10.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.148+0000 7fa4ef7fe700 1 -- 172.21.15.40:0/3007115838 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc00c070 con 0x7fa50809dd50 2023-09-30T22:29:10.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.149+0000 7fa4ef7fe700 1 -- 172.21.15.40:0/3007115838 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4fc013610 con 0x7fa50809dd50 2023-09-30T22:29:10.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.149+0000 7fa50d692700 1 -- 172.21.15.40:0/3007115838 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa50809a300 con 0x7fa50809dd50 2023-09-30T22:29:10.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.149+0000 7fa4ef7fe700 1 -- 172.21.15.40:0/3007115838 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc013980 con 0x7fa50809dd50 2023-09-30T22:29:10.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.149+0000 7fa50d692700 1 -- 172.21.15.40:0/3007115838 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa50813f840 con 0x7fa50809dd50 2023-09-30T22:29:10.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.150+0000 7fa4ef7fe700 1 -- 172.21.15.40:0/3007115838 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa4fc013ae0 con 0x7fa50809dd50 2023-09-30T22:29:10.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.150+0000 7fa50d692700 1 -- 172.21.15.40:0/3007115838 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa508070dc0 con 0x7fa50809dd50 2023-09-30T22:29:10.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.150+0000 7fa4ef7fe700 1 -- 172.21.15.40:0/3007115838 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa4fc03f4a0 con 0x7fa50809dd50 2023-09-30T22:29:10.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.155+0000 7fa4ef7fe700 1 -- 172.21.15.40:0/3007115838 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa4fc010900 con 0x7fa50809dd50 2023-09-30T22:29:10.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.279+0000 7f95a3d96700 1 -- 172.21.15.40:0/3721107065 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9584005590 con 0x7f959c12d8a0 2023-09-30T22:29:10.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.280+0000 7f95927fc700 1 -- 172.21.15.40:0/3721107065 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9598017300 con 0x7f959c12d8a0 2023-09-30T22:29:10.280 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:10.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.282+0000 7f95a3d96700 1 -- 172.21.15.40:0/3721107065 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f959c12d8a0 msgr2=0x7f959c11ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:10.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.282+0000 7f95a3d96700 1 --2- 172.21.15.40:0/3721107065 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f959c12d8a0 0x7f959c11ee80 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f959800bf10 tx=0x7f9598004750 comp rx=0 tx=0).stop 2023-09-30T22:29:10.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.282+0000 7f95a3d96700 1 -- 172.21.15.40:0/3721107065 shutdown_connections 2023-09-30T22:29:10.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.282+0000 7f95a3d96700 1 --2- 172.21.15.40:0/3721107065 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f959c12eea0 0x7f959c11f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.282+0000 7f95a3d96700 1 --2- 172.21.15.40:0/3721107065 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f959c12d8a0 0x7f959c11ee80 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.282+0000 7f95a3d96700 1 --2- 172.21.15.40:0/3721107065 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f959c12e590 0x7f959c11f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.282+0000 7f95a3d96700 1 -- 172.21.15.40:0/3721107065 >> 172.21.15.40:0/3721107065 conn(0x7f959c0a2a00 msgr2=0x7f959c130e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:10.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.282+0000 7f95a3d96700 1 -- 172.21.15.40:0/3721107065 shutdown_connections 2023-09-30T22:29:10.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.282+0000 7f95a3d96700 1 -- 172.21.15.40:0/3721107065 wait complete. 2023-09-30T22:29:10.296 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:10.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.366+0000 7fd9e4c42700 1 -- 172.21.15.40:0/3582650084 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd9e011bd10 con 0x7fd9e009dd70 2023-09-30T22:29:10.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.366+0000 7fd9ceffd700 1 -- 172.21.15.40:0/3582650084 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd9e011bd10 con 0x7fd9e009dd70 2023-09-30T22:29:10.367 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:10.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.368+0000 7fd9e4c42700 1 -- 172.21.15.40:0/3582650084 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd9e009dd70 msgr2=0x7fd9e0119590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:10.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.368+0000 7fd9e4c42700 1 --2- 172.21.15.40:0/3582650084 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd9e009dd70 0x7fd9e0119590 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4016000 tx=0x7fd9d4004750 comp rx=0 tx=0).stop 2023-09-30T22:29:10.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.368+0000 7fd9e4c42700 1 -- 172.21.15.40:0/3582650084 shutdown_connections 2023-09-30T22:29:10.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.368+0000 7fd9e4c42700 1 --2- 172.21.15.40:0/3582650084 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9e0133e00 0x7fd9e0119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.368+0000 7fd9e4c42700 1 --2- 172.21.15.40:0/3582650084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9e009d400 0x7fd9e0119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.368+0000 7fd9e4c42700 1 --2- 172.21.15.40:0/3582650084 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd9e009dd70 0x7fd9e0119590 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.368+0000 7fd9e4c42700 1 -- 172.21.15.40:0/3582650084 >> 172.21.15.40:0/3582650084 conn(0x7fd9e00a2a00 msgr2=0x7fd9e012d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:10.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.369+0000 7fd9e4c42700 1 -- 172.21.15.40:0/3582650084 shutdown_connections 2023-09-30T22:29:10.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.369+0000 7fd9e4c42700 1 -- 172.21.15.40:0/3582650084 wait complete. 2023-09-30T22:29:10.381 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:10.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.387+0000 7f1271ab1700 1 -- 172.21.15.40:0/1303431460 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f126c074620 con 0x7f126c06f070 2023-09-30T22:29:10.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.388+0000 7f1268ff9700 1 -- 172.21.15.40:0/1303431460 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f125c028090 con 0x7f126c06f070 2023-09-30T22:29:10.388 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:10.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.390+0000 7f1271ab1700 1 -- 172.21.15.40:0/1303431460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f126c06f070 msgr2=0x7f126c06c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:10.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.390+0000 7f1271ab1700 1 --2- 172.21.15.40:0/1303431460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f126c06f070 0x7f126c06c990 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f125c00b560 tx=0x7f125c00b870 comp rx=0 tx=0).stop 2023-09-30T22:29:10.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.390+0000 7f1271ab1700 1 -- 172.21.15.40:0/1303431460 shutdown_connections 2023-09-30T22:29:10.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.390+0000 7f1271ab1700 1 --2- 172.21.15.40:0/1303431460 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f126c06fdb0 0x7f126c06d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.390+0000 7f1271ab1700 1 --2- 172.21.15.40:0/1303431460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f126c06f070 0x7f126c06c990 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.390+0000 7f1271ab1700 1 --2- 172.21.15.40:0/1303431460 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f126c06f980 0x7f126c06ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.390+0000 7f1271ab1700 1 -- 172.21.15.40:0/1303431460 >> 172.21.15.40:0/1303431460 conn(0x7f126c0a41a0 msgr2=0x7f126c0a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:10.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.390+0000 7f1271ab1700 1 -- 172.21.15.40:0/1303431460 shutdown_connections 2023-09-30T22:29:10.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.390+0000 7f1271ab1700 1 -- 172.21.15.40:0/1303431460 wait complete. 2023-09-30T22:29:10.403 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:10.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.418+0000 7fa50d692700 1 -- 172.21.15.40:0/3007115838 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa508062380 con 0x7fa50809dd50 2023-09-30T22:29:10.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.419+0000 7fa4ef7fe700 1 -- 172.21.15.40:0/3007115838 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa4fc010310 con 0x7fa50809dd50 2023-09-30T22:29:10.420 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:10.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.421+0000 7fa50d692700 1 -- 172.21.15.40:0/3007115838 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa50809dd50 msgr2=0x7fa508133ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:10.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.421+0000 7fa50d692700 1 --2- 172.21.15.40:0/3007115838 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa50809dd50 0x7fa508133ad0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc00e7e0 tx=0x7fa4fc00eaf0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.421+0000 7fa50d692700 1 -- 172.21.15.40:0/3007115838 shutdown_connections 2023-09-30T22:29:10.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.421+0000 7fa50d692700 1 --2- 172.21.15.40:0/3007115838 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa50809d400 0x7fa508133590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.421+0000 7fa50d692700 1 --2- 172.21.15.40:0/3007115838 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa508138250 0x7fa508134010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.421+0000 7fa50d692700 1 --2- 172.21.15.40:0/3007115838 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa50809dd50 0x7fa508133ad0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.421+0000 7fa50d692700 1 -- 172.21.15.40:0/3007115838 >> 172.21.15.40:0/3007115838 conn(0x7fa5080a2a00 msgr2=0x7fa5080a1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:10.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.421+0000 7fa50d692700 1 -- 172.21.15.40:0/3007115838 shutdown_connections 2023-09-30T22:29:10.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:10.421+0000 7fa50d692700 1 -- 172.21.15.40:0/3007115838 wait complete. 2023-09-30T22:29:10.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:11.296 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:11.382 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:11.404 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:11.434 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:11.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.439+0000 7fa4a97c1700 1 Processor -- start 2023-09-30T22:29:11.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.439+0000 7fa4a97c1700 1 -- start start 2023-09-30T22:29:11.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.439+0000 7fa4a97c1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4a4133e00 0x7fa4a41341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:11.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.439+0000 7fa4a97c1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa4a409d400 0x7fa4a409d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:11.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.440+0000 7fa4a97c1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a4133940 con 0x7fa4a409dd70 2023-09-30T22:29:11.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.440+0000 7fa4a97c1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4a409f0d0 con 0x7fa4a409d400 2023-09-30T22:29:11.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.440+0000 7fa4a97c1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a409e210 con 0x7fa4a4133e00 2023-09-30T22:29:11.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.440+0000 7fa4a2ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4a4133e00 0x7fa4a41341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:11.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.440+0000 7fa4a2ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4a4133e00 0x7fa4a41341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48624/0 (socket says 172.21.15.40:48624) 2023-09-30T22:29:11.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.440+0000 7fa4a2ffd700 1 -- 172.21.15.40:0/3508715275 learned_addr learned my addr 172.21.15.40:0/3508715275 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:11.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.440+0000 7fa4a27fc700 1 --2- 172.21.15.40:0/3508715275 >> v2:172.21.15.40:3300/0 conn(0x7fa4a409d400 0x7fa4a409d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:11.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.440+0000 7fa4a2ffd700 1 -- 172.21.15.40:0/3508715275 >> v2:172.21.15.40:3300/0 conn(0x7fa4a409d400 msgr2=0x7fa4a409d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:11.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.440+0000 7fa4a2ffd700 1 --2- 172.21.15.40:0/3508715275 >> v2:172.21.15.40:3300/0 conn(0x7fa4a409d400 0x7fa4a409d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.440+0000 7fa4a2ffd700 1 -- 172.21.15.40:0/3508715275 >> v1:172.21.15.40:6789/0 conn(0x7fa4a409dd70 legacy=0x7fa4a413ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:11.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.440+0000 7fa4a2ffd700 1 -- 172.21.15.40:0/3508715275 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a4133be0 con 0x7fa4a4133e00 2023-09-30T22:29:11.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.440+0000 7fa4a27fc700 1 --2- 172.21.15.40:0/3508715275 >> v2:172.21.15.40:3300/0 conn(0x7fa4a409d400 0x7fa4a409d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:11.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.440+0000 7fa4a2ffd700 1 --2- 172.21.15.40:0/3508715275 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4a4133e00 0x7fa4a41341d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa4940098f0 tx=0x7fa494009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c6f464f09271b6e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:11.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.440+0000 7fa4a1ffb700 1 -- 172.21.15.40:0/3508715275 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49400b8a0 con 0x7fa4a4133e00 2023-09-30T22:29:11.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.441+0000 7fa4a1ffb700 1 -- 172.21.15.40:0/3508715275 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49400ba00 con 0x7fa4a4133e00 2023-09-30T22:29:11.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.441+0000 7fa4a1ffb700 1 -- 172.21.15.40:0/3508715275 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49400bd90 con 0x7fa4a4133e00 2023-09-30T22:29:11.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.441+0000 7fa4a97c1700 1 -- 172.21.15.40:0/3508715275 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4a4133e00 msgr2=0x7fa4a41341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:11.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.442+0000 7fa4a97c1700 1 --2- 172.21.15.40:0/3508715275 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4a4133e00 0x7fa4a41341d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa4940098f0 tx=0x7fa494009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:11.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.442+0000 7fa4a97c1700 1 -- 172.21.15.40:0/3508715275 shutdown_connections 2023-09-30T22:29:11.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.442+0000 7fa4a97c1700 1 --2- 172.21.15.40:0/3508715275 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4a4133e00 0x7fa4a41341d0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.442+0000 7fa4a97c1700 1 --2- 172.21.15.40:0/3508715275 >> v2:172.21.15.40:3300/0 conn(0x7fa4a409d400 0x7fa4a409d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.442+0000 7fa4a97c1700 1 -- 172.21.15.40:0/3508715275 >> 172.21.15.40:0/3508715275 conn(0x7fa4a40a2a00 msgr2=0x7fa4a40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:11.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.442+0000 7fa4a97c1700 1 -- 172.21.15.40:0/3508715275 shutdown_connections 2023-09-30T22:29:11.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.442+0000 7fa4a97c1700 1 -- 172.21.15.40:0/3508715275 wait complete. 2023-09-30T22:29:11.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.443+0000 7fa4a97c1700 1 Processor -- start 2023-09-30T22:29:11.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.443+0000 7fa4a97c1700 1 -- start start 2023-09-30T22:29:11.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.444+0000 7fa4a97c1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4a409d400 0x7fa4a4119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:11.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.444+0000 7fa4a97c1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4a409dd70 0x7fa4a4119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:11.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.444+0000 7fa4a97c1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4a4133e00 0x7fa4a4119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:11.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.444+0000 7fa4a97c1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a411c1a0 con 0x7fa4a409d400 2023-09-30T22:29:11.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.444+0000 7fa4a97c1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a411cd60 con 0x7fa4a4133e00 2023-09-30T22:29:11.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.444+0000 7fa4a97c1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a411a540 con 0x7fa4a409dd70 2023-09-30T22:29:11.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.444+0000 7fa4a37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4a4133e00 0x7fa4a4119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:11.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.444+0000 7fa4a37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4a4133e00 0x7fa4a4119ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48954/0 (socket says 172.21.15.40:48954) 2023-09-30T22:29:11.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.444+0000 7fa4a37fe700 1 -- 172.21.15.40:0/3414914864 learned_addr learned my addr 172.21.15.40:0/3414914864 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:11.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.444+0000 7fa4a2ffd700 1 --2- 172.21.15.40:0/3414914864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4a409d400 0x7fa4a4119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:11.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.444+0000 7fa4a27fc700 1 --2- 172.21.15.40:0/3414914864 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4a409dd70 0x7fa4a4119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:11.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.445+0000 7fa4a37fe700 1 -- 172.21.15.40:0/3414914864 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4a409dd70 msgr2=0x7fa4a4119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:11.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.445+0000 7fa4a37fe700 1 --2- 172.21.15.40:0/3414914864 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4a409dd70 0x7fa4a4119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.445+0000 7fa4a37fe700 1 -- 172.21.15.40:0/3414914864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4a409d400 msgr2=0x7fa4a4119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:11.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.445+0000 7fa4a37fe700 1 --2- 172.21.15.40:0/3414914864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4a409d400 0x7fa4a4119050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.445+0000 7fa4a37fe700 1 -- 172.21.15.40:0/3414914864 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa494009550 con 0x7fa4a4133e00 2023-09-30T22:29:11.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.445+0000 7fa4a27fc700 1 --2- 172.21.15.40:0/3414914864 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4a409dd70 0x7fa4a4119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:11.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.445+0000 7fa4a2ffd700 1 --2- 172.21.15.40:0/3414914864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4a409d400 0x7fa4a4119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:11.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.445+0000 7fa4a37fe700 1 --2- 172.21.15.40:0/3414914864 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4a4133e00 0x7fa4a4119ad0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa49c00cc50 tx=0x7fa49c00cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:11.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.445+0000 7fa48b7fe700 1 -- 172.21.15.40:0/3414914864 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49c003c00 con 0x7fa4a4133e00 2023-09-30T22:29:11.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.445+0000 7fa48b7fe700 1 -- 172.21.15.40:0/3414914864 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49c003d60 con 0x7fa4a4133e00 2023-09-30T22:29:11.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.445+0000 7fa48b7fe700 1 -- 172.21.15.40:0/3414914864 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49c00ab60 con 0x7fa4a4133e00 2023-09-30T22:29:11.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.445+0000 7fa4a97c1700 1 -- 172.21.15.40:0/3414914864 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a409fe50 con 0x7fa4a4133e00 2023-09-30T22:29:11.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.445+0000 7fa4a97c1700 1 -- 172.21.15.40:0/3414914864 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a411b220 con 0x7fa4a4133e00 2023-09-30T22:29:11.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.446+0000 7fa48b7fe700 1 -- 172.21.15.40:0/3414914864 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa49c00acc0 con 0x7fa4a4133e00 2023-09-30T22:29:11.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.446+0000 7fa48b7fe700 1 -- 172.21.15.40:0/3414914864 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa49c03f6b0 con 0x7fa4a4133e00 2023-09-30T22:29:11.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.446+0000 7fa4a97c1700 1 -- 172.21.15.40:0/3414914864 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a40a20a0 con 0x7fa4a4133e00 2023-09-30T22:29:11.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.452+0000 7fa48b7fe700 1 -- 172.21.15.40:0/3414914864 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa49c0198f0 con 0x7fa4a4133e00 2023-09-30T22:29:11.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.521+0000 7f5f54f05700 1 Processor -- start 2023-09-30T22:29:11.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.521+0000 7f5f54f05700 1 -- start start 2023-09-30T22:29:11.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.522+0000 7f5f54f05700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5f5012e590 0x7f5f5012e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:11.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.522+0000 7f5f54f05700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f5012eea0 0x7f5f5012d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:11.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.522+0000 7f5f54f05700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f5009ab70 con 0x7f5f5012d6d0 2023-09-30T22:29:11.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.522+0000 7f5f54f05700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f5009b270 con 0x7f5f5012e590 2023-09-30T22:29:11.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.522+0000 7f5f54f05700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5009bab0 con 0x7f5f5012eea0 2023-09-30T22:29:11.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.522+0000 7f5f4dd9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f5012eea0 0x7f5f5012d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:11.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.522+0000 7f5f4e59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5f5012e590 0x7f5f5012e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:11.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.522+0000 7f5f4ed9d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5f5012d6d0 0x7f5f50137c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47002/0 (socket says 172.21.15.40:47002) 2023-09-30T22:29:11.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.522+0000 7f5f4ed9d700 1 -- 172.21.15.40:0/3877190979 learned_addr learned my addr 172.21.15.40:0/3877190979 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:29:11.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.522+0000 7f5f4dd9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f5012eea0 0x7f5f5012d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48644/0 (socket says 172.21.15.40:48644) 2023-09-30T22:29:11.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.523+0000 7f5f4dd9b700 1 -- 172.21.15.40:0/3877190979 >> v2:172.21.15.40:3300/0 conn(0x7f5f5012e590 msgr2=0x7f5f5012e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:11.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.523+0000 7f5f4dd9b700 1 --2- 172.21.15.40:0/3877190979 >> v2:172.21.15.40:3300/0 conn(0x7f5f5012e590 0x7f5f5012e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.523+0000 7f5f4dd9b700 1 -- 172.21.15.40:0/3877190979 >> v1:172.21.15.40:6789/0 conn(0x7f5f5012d6d0 legacy=0x7f5f50137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:11.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.523+0000 7f5f4dd9b700 1 -- 172.21.15.40:0/3877190979 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5009bd70 con 0x7f5f5012eea0 2023-09-30T22:29:11.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.523+0000 7f5f4e59c700 1 --2- 172.21.15.40:0/3877190979 >> v2:172.21.15.40:3300/0 conn(0x7f5f5012e590 0x7f5f5012e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:11.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.523+0000 7f5f4dd9b700 1 --2- 172.21.15.40:0/3877190979 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f5012eea0 0x7f5f5012d190 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009870 tx=0x7f5f44009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=516220553cea734b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:11.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.523+0000 7f5f4d59a700 1 -- 172.21.15.40:0/3877190979 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44011830 con 0x7f5f5012eea0 2023-09-30T22:29:11.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.523+0000 7f5f4d59a700 1 -- 172.21.15.40:0/3877190979 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f44011990 con 0x7f5f5012eea0 2023-09-30T22:29:11.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.523+0000 7f5f4d59a700 1 -- 172.21.15.40:0/3877190979 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44011d20 con 0x7f5f5012eea0 2023-09-30T22:29:11.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.524+0000 7f5f54f05700 1 -- 172.21.15.40:0/3877190979 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f5012eea0 msgr2=0x7f5f5012d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:11.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.524+0000 7f5f54f05700 1 --2- 172.21.15.40:0/3877190979 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f5012eea0 0x7f5f5012d190 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009870 tx=0x7f5f44009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:11.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.524+0000 7f5f54f05700 1 -- 172.21.15.40:0/3877190979 shutdown_connections 2023-09-30T22:29:11.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.524+0000 7f5f54f05700 1 --2- 172.21.15.40:0/3877190979 >> v2:172.21.15.40:3300/0 conn(0x7f5f5012e590 0x7f5f5012e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.524+0000 7f5f54f05700 1 --2- 172.21.15.40:0/3877190979 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f5012eea0 0x7f5f5012d190 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.524+0000 7f5f54f05700 1 -- 172.21.15.40:0/3877190979 >> 172.21.15.40:0/3877190979 conn(0x7f5f500a2a00 msgr2=0x7f5f500a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:11.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.524+0000 7f5f54f05700 1 -- 172.21.15.40:0/3877190979 shutdown_connections 2023-09-30T22:29:11.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.524+0000 7f5f54f05700 1 -- 172.21.15.40:0/3877190979 wait complete. 2023-09-30T22:29:11.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.525+0000 7f5f54f05700 1 Processor -- start 2023-09-30T22:29:11.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.525+0000 7f5f54f05700 1 -- start start 2023-09-30T22:29:11.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.526+0000 7f5f54f05700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f5012d6d0 0x7f5f5011dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:11.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.526+0000 7f5f54f05700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f5012e590 0x7f5f5011e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:11.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.526+0000 7f5f54f05700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f5012eea0 0x7f5f5011e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:11.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.526+0000 7f5f54f05700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f50121950 con 0x7f5f5012eea0 2023-09-30T22:29:11.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.526+0000 7f5f54f05700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5009b4b0 con 0x7f5f5012d6d0 2023-09-30T22:29:11.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.526+0000 7f5f54f05700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f50120000 con 0x7f5f5012e590 2023-09-30T22:29:11.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.526+0000 7f5f4e59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f5012d6d0 0x7f5f5011dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:11.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.526+0000 7f5f4e59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f5012d6d0 0x7f5f5011dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48962/0 (socket says 172.21.15.40:48962) 2023-09-30T22:29:11.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.526+0000 7f5f4e59c700 1 -- 172.21.15.40:0/3360578852 learned_addr learned my addr 172.21.15.40:0/3360578852 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:11.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.526+0000 7f5f4dd9b700 1 --2- 172.21.15.40:0/3360578852 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f5012e590 0x7f5f5011e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:11.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.526+0000 7f5f4ed9d700 1 --2- 172.21.15.40:0/3360578852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f5012eea0 0x7f5f5011e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:11.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.527+0000 7f5f4dd9b700 1 -- 172.21.15.40:0/3360578852 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f5012d6d0 msgr2=0x7f5f5011dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:11.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.527+0000 7f5f4dd9b700 1 --2- 172.21.15.40:0/3360578852 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f5012d6d0 0x7f5f5011dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.527+0000 7f5f4dd9b700 1 -- 172.21.15.40:0/3360578852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f5012eea0 msgr2=0x7f5f5011e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:11.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.527+0000 7f5f4dd9b700 1 --2- 172.21.15.40:0/3360578852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f5012eea0 0x7f5f5011e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.527+0000 7f5f4dd9b700 1 -- 172.21.15.40:0/3360578852 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f4000b740 con 0x7f5f5012e590 2023-09-30T22:29:11.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.527+0000 7f5f4dd9b700 1 --2- 172.21.15.40:0/3360578852 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f5012e590 0x7f5f5011e3e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009840 tx=0x7f5f44004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:11.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.527+0000 7f5f3effd700 1 -- 172.21.15.40:0/3360578852 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f440036a0 con 0x7f5f5012e590 2023-09-30T22:29:11.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.527+0000 7f5f3effd700 1 -- 172.21.15.40:0/3360578852 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4401f070 con 0x7f5f5012e590 2023-09-30T22:29:11.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.527+0000 7f5f54f05700 1 -- 172.21.15.40:0/3360578852 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f440094a0 con 0x7f5f5012e590 2023-09-30T22:29:11.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.527+0000 7f5f3effd700 1 -- 172.21.15.40:0/3360578852 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44003a20 con 0x7f5f5012e590 2023-09-30T22:29:11.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.527+0000 7f5f54f05700 1 -- 172.21.15.40:0/3360578852 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f5012bd50 con 0x7f5f5012e590 2023-09-30T22:29:11.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.528+0000 7f5f3effd700 1 -- 172.21.15.40:0/3360578852 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5f44003b80 con 0x7f5f5012e590 2023-09-30T22:29:11.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.528+0000 7f5f3effd700 1 -- 172.21.15.40:0/3360578852 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5f44021070 con 0x7f5f5012e590 2023-09-30T22:29:11.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.529+0000 7f5f3cff9700 1 -- 172.21.15.40:0/3360578852 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f280052e0 con 0x7f5f5012e590 2023-09-30T22:29:11.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.534+0000 7f5f3effd700 1 -- 172.21.15.40:0/3360578852 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5f44003e30 con 0x7f5f5012e590 2023-09-30T22:29:11.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.568+0000 7fe152045700 1 Processor -- start 2023-09-30T22:29:11.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.568+0000 7fe152045700 1 -- start start 2023-09-30T22:29:11.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.569+0000 7fe152045700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe14c09e400 0x7fe14c135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:11.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.569+0000 7fe152045700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe14c136230 0x7fe14c138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:11.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.569+0000 7fe152045700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe14c09adf0 con 0x7fe14c09d920 2023-09-30T22:29:11.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.569+0000 7fe152045700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe14c09edf0 con 0x7fe14c09e400 2023-09-30T22:29:11.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.569+0000 7fe152045700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c09b660 con 0x7fe14c136230 2023-09-30T22:29:11.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.569+0000 7fe14bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe14c136230 0x7fe14c138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:11.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.569+0000 7fe14bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe14c136230 0x7fe14c138610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48974/0 (socket says 172.21.15.40:48974) 2023-09-30T22:29:11.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.569+0000 7fe14affd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe14c09e400 0x7fe14c135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:11.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.569+0000 7fe14bfff700 1 -- 172.21.15.40:0/2526159797 learned_addr learned my addr 172.21.15.40:0/2526159797 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:11.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.569+0000 7fe14bfff700 1 -- 172.21.15.40:0/2526159797 >> v2:172.21.15.40:3300/0 conn(0x7fe14c09e400 msgr2=0x7fe14c135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:11.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.569+0000 7fe14bfff700 1 --2- 172.21.15.40:0/2526159797 >> v2:172.21.15.40:3300/0 conn(0x7fe14c09e400 0x7fe14c135cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.569+0000 7fe14bfff700 1 -- 172.21.15.40:0/2526159797 >> v1:172.21.15.40:6789/0 conn(0x7fe14c09d920 legacy=0x7fe14c09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:11.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.569+0000 7fe14bfff700 1 -- 172.21.15.40:0/2526159797 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14c09a6e0 con 0x7fe14c136230 2023-09-30T22:29:11.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.570+0000 7fe14bfff700 1 --2- 172.21.15.40:0/2526159797 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe14c136230 0x7fe14c138610 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fe144009e50 tx=0x7fe14400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cea42eedbf85775 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:11.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.570+0000 7fe14a7fc700 1 -- 172.21.15.40:0/2526159797 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14400e070 con 0x7fe14c136230 2023-09-30T22:29:11.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.570+0000 7fe14a7fc700 1 -- 172.21.15.40:0/2526159797 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe144003a20 con 0x7fe14c136230 2023-09-30T22:29:11.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.570+0000 7fe14a7fc700 1 -- 172.21.15.40:0/2526159797 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe144003db0 con 0x7fe14c136230 2023-09-30T22:29:11.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.571+0000 7fe152045700 1 -- 172.21.15.40:0/2526159797 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe14c136230 msgr2=0x7fe14c138610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:11.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.571+0000 7fe152045700 1 --2- 172.21.15.40:0/2526159797 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe14c136230 0x7fe14c138610 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fe144009e50 tx=0x7fe14400b330 comp rx=0 tx=0).stop 2023-09-30T22:29:11.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.571+0000 7fe152045700 1 -- 172.21.15.40:0/2526159797 shutdown_connections 2023-09-30T22:29:11.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.571+0000 7fe152045700 1 --2- 172.21.15.40:0/2526159797 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe14c136230 0x7fe14c138610 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.571+0000 7fe152045700 1 --2- 172.21.15.40:0/2526159797 >> v2:172.21.15.40:3300/0 conn(0x7fe14c09e400 0x7fe14c135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.571+0000 7fe152045700 1 -- 172.21.15.40:0/2526159797 >> 172.21.15.40:0/2526159797 conn(0x7fe14c09fb20 msgr2=0x7fe14c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:11.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.571+0000 7fe152045700 1 -- 172.21.15.40:0/2526159797 shutdown_connections 2023-09-30T22:29:11.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.571+0000 7fe152045700 1 -- 172.21.15.40:0/2526159797 wait complete. 2023-09-30T22:29:11.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.572+0000 7fe152045700 1 Processor -- start 2023-09-30T22:29:11.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.572+0000 7fe152045700 1 -- start start 2023-09-30T22:29:11.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.572+0000 7fe152045700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe14c09d920 0x7fe14c11e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:11.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.572+0000 7fe152045700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe14c09e400 0x7fe14c11ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:11.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.572+0000 7fe152045700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe14c136230 0x7fe14c11f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:11.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.572+0000 7fe152045700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c120580 con 0x7fe14c136230 2023-09-30T22:29:11.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.572+0000 7fe152045700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c1217d0 con 0x7fe14c09d920 2023-09-30T22:29:11.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.572+0000 7fe152045700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c120de0 con 0x7fe14c09e400 2023-09-30T22:29:11.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.572+0000 7fe14bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe14c136230 0x7fe14c11f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:11.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.572+0000 7fe14bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe14c136230 0x7fe14c11f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46874/0 (socket says 172.21.15.40:46874) 2023-09-30T22:29:11.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.572+0000 7fe14bfff700 1 -- 172.21.15.40:0/83939730 learned_addr learned my addr 172.21.15.40:0/83939730 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:11.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.572+0000 7fe14affd700 1 --2- 172.21.15.40:0/83939730 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe14c09e400 0x7fe14c11ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:11.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.573+0000 7fe14b7fe700 1 --2- 172.21.15.40:0/83939730 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe14c09d920 0x7fe14c11e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:11.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.573+0000 7fe14bfff700 1 -- 172.21.15.40:0/83939730 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe14c09e400 msgr2=0x7fe14c11ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:11.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.573+0000 7fe14bfff700 1 --2- 172.21.15.40:0/83939730 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe14c09e400 0x7fe14c11ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.573+0000 7fe14bfff700 1 -- 172.21.15.40:0/83939730 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe14c09d920 msgr2=0x7fe14c11e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:11.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.573+0000 7fe14bfff700 1 --2- 172.21.15.40:0/83939730 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe14c09d920 0x7fe14c11e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.573+0000 7fe14bfff700 1 -- 172.21.15.40:0/83939730 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe144009b30 con 0x7fe14c136230 2023-09-30T22:29:11.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.573+0000 7fe14bfff700 1 --2- 172.21.15.40:0/83939730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe14c136230 0x7fe14c11f440 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fe14c072270 tx=0x7fe144004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:11.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.573+0000 7fe133fff700 1 -- 172.21.15.40:0/83939730 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1440092e0 con 0x7fe14c136230 2023-09-30T22:29:11.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.573+0000 7fe133fff700 1 -- 172.21.15.40:0/83939730 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe144004240 con 0x7fe14c136230 2023-09-30T22:29:11.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.573+0000 7fe133fff700 1 -- 172.21.15.40:0/83939730 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1440045d0 con 0x7fe14c136230 2023-09-30T22:29:11.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.574+0000 7fe152045700 1 -- 172.21.15.40:0/83939730 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe14c1221b0 con 0x7fe14c136230 2023-09-30T22:29:11.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.574+0000 7fe152045700 1 -- 172.21.15.40:0/83939730 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe14c136020 con 0x7fe14c136230 2023-09-30T22:29:11.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.575+0000 7fe133fff700 1 -- 172.21.15.40:0/83939730 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe144019070 con 0x7fe14c136230 2023-09-30T22:29:11.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.575+0000 7fe152045700 1 -- 172.21.15.40:0/83939730 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe14c09cb00 con 0x7fe14c136230 2023-09-30T22:29:11.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.575+0000 7fe133fff700 1 -- 172.21.15.40:0/83939730 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe144040730 con 0x7fe14c136230 2023-09-30T22:29:11.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.583+0000 7f62b4548700 1 Processor -- start 2023-09-30T22:29:11.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.583+0000 7fe133fff700 1 -- 172.21.15.40:0/83939730 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe14401b7e0 con 0x7fe14c136230 2023-09-30T22:29:11.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.583+0000 7f62b4548700 1 -- start start 2023-09-30T22:29:11.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.584+0000 7f62b4548700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f62ac09e400 0x7f62ac135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:11.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.584+0000 7f62b4548700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62ac136230 0x7f62ac138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:11.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.584+0000 7f62b4548700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62ac09adf0 con 0x7f62ac09d920 2023-09-30T22:29:11.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.584+0000 7f62b4548700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62ac09edf0 con 0x7f62ac09e400 2023-09-30T22:29:11.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.584+0000 7f62b4548700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac09b660 con 0x7f62ac136230 2023-09-30T22:29:11.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.584+0000 7f62b2ae5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62ac136230 0x7f62ac138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:11.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.584+0000 7f62b2ae5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62ac136230 0x7f62ac138610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48994/0 (socket says 172.21.15.40:48994) 2023-09-30T22:29:11.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.584+0000 7f62b2ae5700 1 -- 172.21.15.40:0/1092830529 learned_addr learned my addr 172.21.15.40:0/1092830529 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:11.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.584+0000 7f62b1ae3700 1 --2- 172.21.15.40:0/1092830529 >> v2:172.21.15.40:3300/0 conn(0x7f62ac09e400 0x7f62ac135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:11.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.585+0000 7f62b2ae5700 1 -- 172.21.15.40:0/1092830529 >> v2:172.21.15.40:3300/0 conn(0x7f62ac09e400 msgr2=0x7f62ac135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:11.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.585+0000 7f62b2ae5700 1 --2- 172.21.15.40:0/1092830529 >> v2:172.21.15.40:3300/0 conn(0x7f62ac09e400 0x7f62ac135cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.585+0000 7f62b2ae5700 1 -- 172.21.15.40:0/1092830529 >> v1:172.21.15.40:6789/0 conn(0x7f62ac09d920 legacy=0x7f62ac09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:11.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.585+0000 7f62b2ae5700 1 -- 172.21.15.40:0/1092830529 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ac09a6e0 con 0x7f62ac136230 2023-09-30T22:29:11.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.585+0000 7f62b2ae5700 1 --2- 172.21.15.40:0/1092830529 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62ac136230 0x7f62ac138610 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f62a400d150 tx=0x7f62a400d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45001dfc0161ec38 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:11.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.585+0000 7f62b12e2700 1 -- 172.21.15.40:0/1092830529 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a4010070 con 0x7f62ac136230 2023-09-30T22:29:11.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.585+0000 7f62b12e2700 1 -- 172.21.15.40:0/1092830529 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a400dcd0 con 0x7f62ac136230 2023-09-30T22:29:11.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.585+0000 7f62b12e2700 1 -- 172.21.15.40:0/1092830529 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a400b310 con 0x7f62ac136230 2023-09-30T22:29:11.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.586+0000 7f62b4548700 1 -- 172.21.15.40:0/1092830529 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62ac136230 msgr2=0x7f62ac138610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:11.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.586+0000 7f62b4548700 1 --2- 172.21.15.40:0/1092830529 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62ac136230 0x7f62ac138610 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f62a400d150 tx=0x7f62a400d460 comp rx=0 tx=0).stop 2023-09-30T22:29:11.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.586+0000 7f62b4548700 1 -- 172.21.15.40:0/1092830529 shutdown_connections 2023-09-30T22:29:11.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.586+0000 7f62b4548700 1 --2- 172.21.15.40:0/1092830529 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62ac136230 0x7f62ac138610 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.586+0000 7f62b4548700 1 --2- 172.21.15.40:0/1092830529 >> v2:172.21.15.40:3300/0 conn(0x7f62ac09e400 0x7f62ac135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.586+0000 7f62b4548700 1 -- 172.21.15.40:0/1092830529 >> 172.21.15.40:0/1092830529 conn(0x7f62ac09fb20 msgr2=0x7f62ac09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:11.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.586+0000 7f62b4548700 1 -- 172.21.15.40:0/1092830529 shutdown_connections 2023-09-30T22:29:11.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.586+0000 7f62b4548700 1 -- 172.21.15.40:0/1092830529 wait complete. 2023-09-30T22:29:11.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.587+0000 7f62b4548700 1 Processor -- start 2023-09-30T22:29:11.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.587+0000 7f62b4548700 1 -- start start 2023-09-30T22:29:11.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.588+0000 7f62b4548700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62ac09d920 0x7f62ac122c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:11.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.588+0000 7f62b4548700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62ac09e400 0x7f62ac123150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:11.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.588+0000 7f62b4548700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62ac136230 0x7f62ac123690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:11.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.588+0000 7f62b4548700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac1249a0 con 0x7f62ac136230 2023-09-30T22:29:11.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.588+0000 7f62b4548700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac125080 con 0x7f62ac09e400 2023-09-30T22:29:11.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.588+0000 7f62b4548700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac126730 con 0x7f62ac09d920 2023-09-30T22:29:11.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.588+0000 7f62b1ae3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62ac09e400 0x7f62ac123150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:11.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.588+0000 7f62b1ae3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62ac09e400 0x7f62ac123150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:49002/0 (socket says 172.21.15.40:49002) 2023-09-30T22:29:11.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.588+0000 7f62b1ae3700 1 -- 172.21.15.40:0/3816581471 learned_addr learned my addr 172.21.15.40:0/3816581471 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:11.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.588+0000 7f62b2ae5700 1 --2- 172.21.15.40:0/3816581471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62ac136230 0x7f62ac123690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:11.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.588+0000 7f62b22e4700 1 --2- 172.21.15.40:0/3816581471 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62ac09d920 0x7f62ac122c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:11.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.588+0000 7f62b1ae3700 1 -- 172.21.15.40:0/3816581471 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62ac09d920 msgr2=0x7f62ac122c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:11.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.588+0000 7f62b1ae3700 1 --2- 172.21.15.40:0/3816581471 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62ac09d920 0x7f62ac122c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.588+0000 7f62b1ae3700 1 -- 172.21.15.40:0/3816581471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62ac136230 msgr2=0x7f62ac123690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:11.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.588+0000 7f62b1ae3700 1 --2- 172.21.15.40:0/3816581471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62ac136230 0x7f62ac123690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.588+0000 7f62b1ae3700 1 -- 172.21.15.40:0/3816581471 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a400bd40 con 0x7f62ac09e400 2023-09-30T22:29:11.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.588+0000 7f62b1ae3700 1 --2- 172.21.15.40:0/3816581471 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62ac09e400 0x7f62ac123150 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f629c00e9b0 tx=0x7f629c00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:11.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.589+0000 7f62a2ffd700 1 -- 172.21.15.40:0/3816581471 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c009710 con 0x7f62ac09e400 2023-09-30T22:29:11.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.589+0000 7f62a2ffd700 1 -- 172.21.15.40:0/3816581471 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629c00c850 con 0x7f62ac09e400 2023-09-30T22:29:11.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.589+0000 7f62b4548700 1 -- 172.21.15.40:0/3816581471 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62ac124dd0 con 0x7f62ac09e400 2023-09-30T22:29:11.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.589+0000 7f62a2ffd700 1 -- 172.21.15.40:0/3816581471 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c00cbc0 con 0x7f62ac09e400 2023-09-30T22:29:11.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.589+0000 7f62b4548700 1 -- 172.21.15.40:0/3816581471 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62ac126450 con 0x7f62ac09e400 2023-09-30T22:29:11.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.590+0000 7f62a2ffd700 1 -- 172.21.15.40:0/3816581471 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f629c00cd20 con 0x7f62ac09e400 2023-09-30T22:29:11.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.590+0000 7f62a2ffd700 1 -- 172.21.15.40:0/3816581471 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f629c03fb80 con 0x7f62ac09e400 2023-09-30T22:29:11.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.590+0000 7f62b4548700 1 -- 172.21.15.40:0/3816581471 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62ac062380 con 0x7f62ac09e400 2023-09-30T22:29:11.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.595+0000 7f62a2ffd700 1 -- 172.21.15.40:0/3816581471 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f629c03fe60 con 0x7f62ac09e400 2023-09-30T22:29:11.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.661+0000 7fa4a97c1700 1 -- 172.21.15.40:0/3414914864 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa4a4062380 con 0x7fa4a4133e00 2023-09-30T22:29:11.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.661+0000 7fa48b7fe700 1 -- 172.21.15.40:0/3414914864 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa49c019300 con 0x7fa4a4133e00 2023-09-30T22:29:11.662 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:11.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.663+0000 7fa4a97c1700 1 -- 172.21.15.40:0/3414914864 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4a4133e00 msgr2=0x7fa4a4119ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:11.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.663+0000 7fa4a97c1700 1 --2- 172.21.15.40:0/3414914864 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4a4133e00 0x7fa4a4119ad0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa49c00cc50 tx=0x7fa49c00cf60 comp rx=0 tx=0).stop 2023-09-30T22:29:11.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.663+0000 7fa4a97c1700 1 -- 172.21.15.40:0/3414914864 shutdown_connections 2023-09-30T22:29:11.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.663+0000 7fa4a97c1700 1 --2- 172.21.15.40:0/3414914864 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4a4133e00 0x7fa4a4119ad0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.663+0000 7fa4a97c1700 1 --2- 172.21.15.40:0/3414914864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4a409d400 0x7fa4a4119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.663+0000 7fa4a97c1700 1 --2- 172.21.15.40:0/3414914864 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4a409dd70 0x7fa4a4119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.663+0000 7fa4a97c1700 1 -- 172.21.15.40:0/3414914864 >> 172.21.15.40:0/3414914864 conn(0x7fa4a40a2a00 msgr2=0x7fa4a412d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:11.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.663+0000 7fa4a97c1700 1 -- 172.21.15.40:0/3414914864 shutdown_connections 2023-09-30T22:29:11.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.664+0000 7fa4a97c1700 1 -- 172.21.15.40:0/3414914864 wait complete. 2023-09-30T22:29:11.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:11.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.744+0000 7f5f3cff9700 1 -- 172.21.15.40:0/3360578852 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5f28005590 con 0x7f5f5012e590 2023-09-30T22:29:11.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.744+0000 7f5f3effd700 1 -- 172.21.15.40:0/3360578852 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5f44010b70 con 0x7f5f5012e590 2023-09-30T22:29:11.745 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:11.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.746+0000 7f5f3cff9700 1 -- 172.21.15.40:0/3360578852 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f5012e590 msgr2=0x7f5f5011e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:11.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.746+0000 7f5f3cff9700 1 --2- 172.21.15.40:0/3360578852 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f5012e590 0x7f5f5011e3e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009840 tx=0x7f5f44004750 comp rx=0 tx=0).stop 2023-09-30T22:29:11.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.746+0000 7f5f3cff9700 1 -- 172.21.15.40:0/3360578852 shutdown_connections 2023-09-30T22:29:11.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.746+0000 7f5f3cff9700 1 --2- 172.21.15.40:0/3360578852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f5012eea0 0x7f5f5011e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.746+0000 7f5f3cff9700 1 --2- 172.21.15.40:0/3360578852 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f5012d6d0 0x7f5f5011dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.746+0000 7f5f3cff9700 1 --2- 172.21.15.40:0/3360578852 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f5012e590 0x7f5f5011e3e0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.746+0000 7f5f3cff9700 1 -- 172.21.15.40:0/3360578852 >> 172.21.15.40:0/3360578852 conn(0x7f5f500a2a00 msgr2=0x7f5f5012c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:11.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.746+0000 7f5f3cff9700 1 -- 172.21.15.40:0/3360578852 shutdown_connections 2023-09-30T22:29:11.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.746+0000 7f5f3cff9700 1 -- 172.21.15.40:0/3360578852 wait complete. 2023-09-30T22:29:11.759 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:11.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.791+0000 7fe152045700 1 -- 172.21.15.40:0/83939730 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe14c062380 con 0x7fe14c136230 2023-09-30T22:29:11.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.791+0000 7fe133fff700 1 -- 172.21.15.40:0/83939730 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe144017030 con 0x7fe14c136230 2023-09-30T22:29:11.791 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:11.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.793+0000 7fe152045700 1 -- 172.21.15.40:0/83939730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe14c136230 msgr2=0x7fe14c11f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:11.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.793+0000 7fe152045700 1 --2- 172.21.15.40:0/83939730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe14c136230 0x7fe14c11f440 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fe14c072270 tx=0x7fe144004ad0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.793+0000 7fe152045700 1 -- 172.21.15.40:0/83939730 shutdown_connections 2023-09-30T22:29:11.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.793+0000 7fe152045700 1 --2- 172.21.15.40:0/83939730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe14c136230 0x7fe14c11f440 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.793+0000 7fe152045700 1 --2- 172.21.15.40:0/83939730 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe14c09d920 0x7fe14c11e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.793+0000 7fe152045700 1 --2- 172.21.15.40:0/83939730 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe14c09e400 0x7fe14c11ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.793+0000 7fe152045700 1 -- 172.21.15.40:0/83939730 >> 172.21.15.40:0/83939730 conn(0x7fe14c09fb20 msgr2=0x7fe14c0a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:11.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.793+0000 7fe152045700 1 -- 172.21.15.40:0/83939730 shutdown_connections 2023-09-30T22:29:11.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.793+0000 7fe152045700 1 -- 172.21.15.40:0/83939730 wait complete. 2023-09-30T22:29:11.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.796+0000 7f62b4548700 1 -- 172.21.15.40:0/3816581471 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f62ac074720 con 0x7f62ac09e400 2023-09-30T22:29:11.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.797+0000 7f62a2ffd700 1 -- 172.21.15.40:0/3816581471 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f629c017080 con 0x7f62ac09e400 2023-09-30T22:29:11.798 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:11.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.801+0000 7f62b4548700 1 -- 172.21.15.40:0/3816581471 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62ac09e400 msgr2=0x7f62ac123150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:11.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.801+0000 7f62b4548700 1 --2- 172.21.15.40:0/3816581471 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62ac09e400 0x7f62ac123150 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f629c00e9b0 tx=0x7f629c00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.801+0000 7f62b4548700 1 -- 172.21.15.40:0/3816581471 shutdown_connections 2023-09-30T22:29:11.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.801+0000 7f62b4548700 1 --2- 172.21.15.40:0/3816581471 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f62ac09d920 0x7f62ac122c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.801+0000 7f62b4548700 1 --2- 172.21.15.40:0/3816581471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62ac136230 0x7f62ac123690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.801+0000 7f62b4548700 1 --2- 172.21.15.40:0/3816581471 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62ac09e400 0x7f62ac123150 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.801+0000 7f62b4548700 1 -- 172.21.15.40:0/3816581471 >> 172.21.15.40:0/3816581471 conn(0x7f62ac09fb20 msgr2=0x7f62ac0a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:11.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.801+0000 7f62b4548700 1 -- 172.21.15.40:0/3816581471 shutdown_connections 2023-09-30T22:29:11.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:11.801+0000 7f62b4548700 1 -- 172.21.15.40:0/3816581471 wait complete. 2023-09-30T22:29:11.808 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:11.814 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:12.681 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:12.760 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:12.809 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:12.815 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:12.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.828+0000 7fa0b1318700 1 Processor -- start 2023-09-30T22:29:12.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.828+0000 7fa0b1318700 1 -- start start 2023-09-30T22:29:12.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.828+0000 7fa0b1318700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0ac09d920 0x7fa0ac09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.828+0000 7fa0b1318700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa0ac09f0f0 0x7fa0ac09e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.828+0000 7fa0b1318700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa0ac133ca0 0x7fa0ac134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.828+0000 7fa0b1318700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0ac06b4c0 con 0x7fa0ac09f0f0 2023-09-30T22:29:12.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.828+0000 7fa0b1318700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac09a8f0 con 0x7fa0ac09d920 2023-09-30T22:29:12.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.828+0000 7fa0b1318700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac09f940 con 0x7fa0ac133ca0 2023-09-30T22:29:12.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.829+0000 7fa0aa7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa0ac09f0f0 0x7fa0ac09e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.829+0000 7fa0aa7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa0ac09f0f0 0x7fa0ac09e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46892/0 (socket says 172.21.15.40:46892) 2023-09-30T22:29:12.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.829+0000 7fa0aa7fc700 1 -- 172.21.15.40:0/378395940 learned_addr learned my addr 172.21.15.40:0/378395940 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:12.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.829+0000 7fa0aaffd700 1 --2- 172.21.15.40:0/378395940 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0ac09d920 0x7fa0ac09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.829+0000 7fa0ab7fe700 1 --2- 172.21.15.40:0/378395940 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa0ac133ca0 0x7fa0ac134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.829+0000 7fa0aa7fc700 1 -- 172.21.15.40:0/378395940 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa0ac133ca0 msgr2=0x7fa0ac134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:12.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.829+0000 7fa0aa7fc700 1 --2- 172.21.15.40:0/378395940 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa0ac133ca0 0x7fa0ac134140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.829+0000 7fa0aa7fc700 1 -- 172.21.15.40:0/378395940 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0ac09d920 msgr2=0x7fa0ac09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:12.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.829+0000 7fa0aa7fc700 1 --2- 172.21.15.40:0/378395940 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0ac09d920 0x7fa0ac09dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.829+0000 7fa0aa7fc700 1 -- 172.21.15.40:0/378395940 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ac09f6e0 con 0x7fa0ac09f0f0 2023-09-30T22:29:12.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.829+0000 7fa0aaffd700 1 --2- 172.21.15.40:0/378395940 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0ac09d920 0x7fa0ac09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:12.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.829+0000 7fa0aa7fc700 1 --2- 172.21.15.40:0/378395940 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0ac09f0f0 0x7fa0ac09e230 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0009920 tx=0x7fa0a0009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaed3fb3d03000e7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:12.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.830+0000 7fa0a9ffb700 1 -- 172.21.15.40:0/378395940 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a0011830 con 0x7fa0ac09f0f0 2023-09-30T22:29:12.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.830+0000 7fa0a9ffb700 1 -- 172.21.15.40:0/378395940 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a0011990 con 0x7fa0ac09f0f0 2023-09-30T22:29:12.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.830+0000 7fa0a9ffb700 1 -- 172.21.15.40:0/378395940 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a0011d20 con 0x7fa0ac09f0f0 2023-09-30T22:29:12.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.830+0000 7fa0b1318700 1 -- 172.21.15.40:0/378395940 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0ac09f0f0 msgr2=0x7fa0ac09e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:12.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.830+0000 7fa0b1318700 1 --2- 172.21.15.40:0/378395940 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0ac09f0f0 0x7fa0ac09e230 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0009920 tx=0x7fa0a0009c30 comp rx=0 tx=0).stop 2023-09-30T22:29:12.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.830+0000 7fa0b1318700 1 -- 172.21.15.40:0/378395940 shutdown_connections 2023-09-30T22:29:12.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.830+0000 7fa0b1318700 1 --2- 172.21.15.40:0/378395940 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa0ac133ca0 0x7fa0ac134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.830+0000 7fa0b1318700 1 --2- 172.21.15.40:0/378395940 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0ac09d920 0x7fa0ac09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.830+0000 7fa0b1318700 1 --2- 172.21.15.40:0/378395940 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0ac09f0f0 0x7fa0ac09e230 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.830+0000 7fa0b1318700 1 -- 172.21.15.40:0/378395940 >> 172.21.15.40:0/378395940 conn(0x7fa0ac09fb20 msgr2=0x7fa0ac09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:12.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.831+0000 7fa0b1318700 1 -- 172.21.15.40:0/378395940 shutdown_connections 2023-09-30T22:29:12.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.831+0000 7fa0b1318700 1 -- 172.21.15.40:0/378395940 wait complete. 2023-09-30T22:29:12.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.832+0000 7fa0b1318700 1 Processor -- start 2023-09-30T22:29:12.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.832+0000 7fa0b1318700 1 -- start start 2023-09-30T22:29:12.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.833+0000 7fa0b1318700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0ac09d920 0x7fa0ac122b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.833+0000 7fa0b1318700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0ac133ca0 0x7fa0ac1230b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.833+0000 7fa0b1318700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa0ac1235f0 0x7fa0ac1c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.833+0000 7fa0b1318700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac123a40 con 0x7fa0ac09d920 2023-09-30T22:29:12.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.833+0000 7fa0b1318700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac126180 con 0x7fa0ac133ca0 2023-09-30T22:29:12.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.833+0000 7fa0b1318700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac127270 con 0x7fa0ac1235f0 2023-09-30T22:29:12.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.833+0000 7fa0aaffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0ac09d920 0x7fa0ac122b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.833+0000 7fa0aaffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0ac09d920 0x7fa0ac122b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46908/0 (socket says 172.21.15.40:46908) 2023-09-30T22:29:12.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.833+0000 7fa0aaffd700 1 -- 172.21.15.40:0/3018045901 learned_addr learned my addr 172.21.15.40:0/3018045901 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:12.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.833+0000 7fa0aa7fc700 1 --2- 172.21.15.40:0/3018045901 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0ac133ca0 0x7fa0ac1230b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.833+0000 7fa0ab7fe700 1 --2- 172.21.15.40:0/3018045901 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa0ac1235f0 0x7fa0ac1c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.834+0000 7fa0aaffd700 1 -- 172.21.15.40:0/3018045901 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa0ac1235f0 msgr2=0x7fa0ac1c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:12.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.834+0000 7fa0aaffd700 1 --2- 172.21.15.40:0/3018045901 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa0ac1235f0 0x7fa0ac1c8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.834+0000 7fa0aaffd700 1 -- 172.21.15.40:0/3018045901 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0ac133ca0 msgr2=0x7fa0ac1230b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:12.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.834+0000 7fa0aaffd700 1 --2- 172.21.15.40:0/3018045901 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0ac133ca0 0x7fa0ac1230b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.834+0000 7fa0aaffd700 1 -- 172.21.15.40:0/3018045901 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09c009430 con 0x7fa0ac09d920 2023-09-30T22:29:12.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.834+0000 7fa0aa7fc700 1 --2- 172.21.15.40:0/3018045901 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0ac133ca0 0x7fa0ac1230b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:12.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.834+0000 7fa0aaffd700 1 --2- 172.21.15.40:0/3018045901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0ac09d920 0x7fa0ac122b70 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fa09c00e990 tx=0x7fa09c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:12.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.834+0000 7fa0937fe700 1 -- 172.21.15.40:0/3018045901 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c0096c0 con 0x7fa0ac09d920 2023-09-30T22:29:12.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.834+0000 7fa0937fe700 1 -- 172.21.15.40:0/3018045901 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09c005a20 con 0x7fa0ac09d920 2023-09-30T22:29:12.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.834+0000 7fa0b1318700 1 -- 172.21.15.40:0/3018045901 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a0009550 con 0x7fa0ac09d920 2023-09-30T22:29:12.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.834+0000 7fa0937fe700 1 -- 172.21.15.40:0/3018045901 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c00eee0 con 0x7fa0ac09d920 2023-09-30T22:29:12.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.834+0000 7fa0b1318700 1 -- 172.21.15.40:0/3018045901 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0ac124780 con 0x7fa0ac09d920 2023-09-30T22:29:12.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.835+0000 7fa0937fe700 1 -- 172.21.15.40:0/3018045901 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa09c00c850 con 0x7fa0ac09d920 2023-09-30T22:29:12.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.835+0000 7fa0937fe700 1 -- 172.21.15.40:0/3018045901 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa09c03f980 con 0x7fa0ac09d920 2023-09-30T22:29:12.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.836+0000 7fa0b1318700 1 -- 172.21.15.40:0/3018045901 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0ac125fd0 con 0x7fa0ac09d920 2023-09-30T22:29:12.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.845+0000 7fa0937fe700 1 -- 172.21.15.40:0/3018045901 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa09c011bd0 con 0x7fa0ac09d920 2023-09-30T22:29:12.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.903+0000 7f5419e1b700 1 Processor -- start 2023-09-30T22:29:12.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.903+0000 7f5419e1b700 1 -- start start 2023-09-30T22:29:12.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.903+0000 7f5419e1b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5414138250 0x7f5414138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.903+0000 7f5419e1b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f541409d400 0x7f541409d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.903+0000 7f5419e1b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5414137e20 con 0x7f541409dd50 2023-09-30T22:29:12.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.903+0000 7f5419e1b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5414138050 con 0x7f5414138250 2023-09-30T22:29:12.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.903+0000 7f5419e1b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f541409b010 con 0x7f541409d400 2023-09-30T22:29:12.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.904+0000 7f5412ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f541409d400 0x7f541409d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.904+0000 7f5412ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f541409d400 0x7f541409d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48710/0 (socket says 172.21.15.40:48710) 2023-09-30T22:29:12.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.904+0000 7f5412ffd700 1 -- 172.21.15.40:0/4069758955 learned_addr learned my addr 172.21.15.40:0/4069758955 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:12.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.904+0000 7f54137fe700 1 --2- 172.21.15.40:0/4069758955 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5414138250 0x7f5414138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.904+0000 7f5412ffd700 1 -- 172.21.15.40:0/4069758955 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5414138250 msgr2=0x7f5414138620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:12.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.904+0000 7f5412ffd700 1 --2- 172.21.15.40:0/4069758955 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5414138250 0x7f5414138620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.904+0000 7f5412ffd700 1 -- 172.21.15.40:0/4069758955 >> v1:172.21.15.40:6789/0 conn(0x7f541409dd50 legacy=0x7f541413f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:12.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.904+0000 7f5412ffd700 1 -- 172.21.15.40:0/4069758955 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541409e1f0 con 0x7f541409d400 2023-09-30T22:29:12.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.904+0000 7f54127fc700 1 -- 172.21.15.40:0/4069758955 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3443217356 0 0) 0x7f5414137e20 con 0x7f541409dd50 2023-09-30T22:29:12.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.904+0000 7f54137fe700 1 --2- 172.21.15.40:0/4069758955 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5414138250 0x7f5414138620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:12.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.904+0000 7f5412ffd700 1 --2- 172.21.15.40:0/4069758955 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f541409d400 0x7f541409d810 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f5408009920 tx=0x7f5408009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24189392029f0687 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:12.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.904+0000 7f54127fc700 1 -- 172.21.15.40:0/4069758955 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5408011830 con 0x7f541409d400 2023-09-30T22:29:12.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.905+0000 7f54127fc700 1 -- 172.21.15.40:0/4069758955 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5408011990 con 0x7f541409d400 2023-09-30T22:29:12.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.905+0000 7f54127fc700 1 -- 172.21.15.40:0/4069758955 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5408011d20 con 0x7f541409d400 2023-09-30T22:29:12.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.905+0000 7f5419e1b700 1 -- 172.21.15.40:0/4069758955 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f541409d400 msgr2=0x7f541409d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:12.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.905+0000 7f5419e1b700 1 --2- 172.21.15.40:0/4069758955 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f541409d400 0x7f541409d810 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f5408009920 tx=0x7f5408009c30 comp rx=0 tx=0).stop 2023-09-30T22:29:12.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.905+0000 7f5419e1b700 1 -- 172.21.15.40:0/4069758955 shutdown_connections 2023-09-30T22:29:12.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.905+0000 7f5419e1b700 1 --2- 172.21.15.40:0/4069758955 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5414138250 0x7f5414138620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.905+0000 7f5419e1b700 1 --2- 172.21.15.40:0/4069758955 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f541409d400 0x7f541409d810 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.905+0000 7f5419e1b700 1 -- 172.21.15.40:0/4069758955 >> 172.21.15.40:0/4069758955 conn(0x7f54140a2a00 msgr2=0x7f54140a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:12.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.905+0000 7f5419e1b700 1 -- 172.21.15.40:0/4069758955 shutdown_connections 2023-09-30T22:29:12.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.905+0000 7f5419e1b700 1 -- 172.21.15.40:0/4069758955 wait complete. 2023-09-30T22:29:12.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.907+0000 7f5419e1b700 1 Processor -- start 2023-09-30T22:29:12.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.907+0000 7f5419e1b700 1 -- start start 2023-09-30T22:29:12.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.908+0000 7f5419e1b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f541409d400 0x7f5414127360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.908+0000 7f5419e1b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f541409dd50 0x7f54141278a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.908+0000 7f5419e1b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5414138250 0x7f5414126120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.908+0000 7f5419e1b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5414135720 con 0x7f541409dd50 2023-09-30T22:29:12.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.908+0000 7f5419e1b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f541409a370 con 0x7f5414138250 2023-09-30T22:29:12.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.908+0000 7f5419e1b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f541413ec30 con 0x7f541409d400 2023-09-30T22:29:12.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.908+0000 7f54137fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f541409d400 0x7f5414127360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.908+0000 7f54137fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f541409d400 0x7f5414127360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48726/0 (socket says 172.21.15.40:48726) 2023-09-30T22:29:12.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.908+0000 7f54137fe700 1 -- 172.21.15.40:0/3000631985 learned_addr learned my addr 172.21.15.40:0/3000631985 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:12.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.908+0000 7f5412ffd700 1 --2- 172.21.15.40:0/3000631985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f541409dd50 0x7f54141278a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.908+0000 7f5413fff700 1 --2- 172.21.15.40:0/3000631985 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5414138250 0x7f5414126120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.908+0000 7f54137fe700 1 -- 172.21.15.40:0/3000631985 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5414138250 msgr2=0x7f5414126120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:12.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.908+0000 7f54137fe700 1 --2- 172.21.15.40:0/3000631985 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5414138250 0x7f5414126120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.908+0000 7f54137fe700 1 -- 172.21.15.40:0/3000631985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f541409dd50 msgr2=0x7f54141278a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:12.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.908+0000 7f54137fe700 1 --2- 172.21.15.40:0/3000631985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f541409dd50 0x7f54141278a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.908+0000 7f54137fe700 1 -- 172.21.15.40:0/3000631985 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54040094a0 con 0x7f541409d400 2023-09-30T22:29:12.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.909+0000 7f54137fe700 1 --2- 172.21.15.40:0/3000631985 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f541409d400 0x7f5414127360 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f540400ebe0 tx=0x7f540400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:12.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.909+0000 7f53fbfff700 1 -- 172.21.15.40:0/3000631985 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540400c7f0 con 0x7f541409d400 2023-09-30T22:29:12.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.909+0000 7f53fbfff700 1 -- 172.21.15.40:0/3000631985 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540400c950 con 0x7f541409d400 2023-09-30T22:29:12.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.909+0000 7f5419e1b700 1 -- 172.21.15.40:0/3000631985 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5408009550 con 0x7f541409d400 2023-09-30T22:29:12.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.909+0000 7f53fbfff700 1 -- 172.21.15.40:0/3000631985 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540400cce0 con 0x7f541409d400 2023-09-30T22:29:12.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.909+0000 7f5419e1b700 1 -- 172.21.15.40:0/3000631985 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f541413f3a0 con 0x7f541409d400 2023-09-30T22:29:12.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.910+0000 7f53fbfff700 1 -- 172.21.15.40:0/3000631985 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5404013470 con 0x7f541409d400 2023-09-30T22:29:12.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.910+0000 7f53fbfff700 1 -- 172.21.15.40:0/3000631985 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f540403f820 con 0x7f541409d400 2023-09-30T22:29:12.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.910+0000 7f5419e1b700 1 -- 172.21.15.40:0/3000631985 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5414062380 con 0x7f541409d400 2023-09-30T22:29:12.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.915+0000 7f53fbfff700 1 -- 172.21.15.40:0/3000631985 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5404013720 con 0x7f541409d400 2023-09-30T22:29:12.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.947+0000 7f69db19e700 1 Processor -- start 2023-09-30T22:29:12.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.947+0000 7f69db19e700 1 -- start start 2023-09-30T22:29:12.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.948+0000 7f69db19e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69d409d8b0 0x7f69d409dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.948+0000 7f69db19e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f69d409e1c0 0x7f69d413bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.948+0000 7f69db19e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f69d413c4d0 0x7f69d413e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.948+0000 7f69db19e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69d409aa30 con 0x7f69d409e1c0 2023-09-30T22:29:12.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.948+0000 7f69db19e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d409f040 con 0x7f69d409d8b0 2023-09-30T22:29:12.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.948+0000 7f69db19e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69d409a4b0 con 0x7f69d413c4d0 2023-09-30T22:29:12.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.948+0000 7f69da19c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69d409d8b0 0x7f69d409dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.948+0000 7f69da19c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69d409d8b0 0x7f69d409dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:49044/0 (socket says 172.21.15.40:49044) 2023-09-30T22:29:12.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.948+0000 7f69da19c700 1 -- 172.21.15.40:0/1977260648 learned_addr learned my addr 172.21.15.40:0/1977260648 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:12.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.948+0000 7f69da99d700 1 --2- 172.21.15.40:0/1977260648 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f69d413c4d0 0x7f69d413e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.948+0000 7f69d999b700 1 --2- 172.21.15.40:0/1977260648 >> v2:172.21.15.40:3300/0 conn(0x7f69d409e1c0 0x7f69d413bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.948+0000 7f69da19c700 1 -- 172.21.15.40:0/1977260648 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f69d413c4d0 msgr2=0x7f69d413e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:12.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.948+0000 7f69da19c700 1 --2- 172.21.15.40:0/1977260648 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f69d413c4d0 0x7f69d413e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.948+0000 7f69da19c700 1 -- 172.21.15.40:0/1977260648 >> v2:172.21.15.40:3300/0 conn(0x7f69d409e1c0 msgr2=0x7f69d413bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:12.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.948+0000 7f69da19c700 1 --2- 172.21.15.40:0/1977260648 >> v2:172.21.15.40:3300/0 conn(0x7f69d409e1c0 0x7f69d413bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.948+0000 7f69da19c700 1 -- 172.21.15.40:0/1977260648 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d409f520 con 0x7f69d409d8b0 2023-09-30T22:29:12.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.948+0000 7f69da19c700 1 --2- 172.21.15.40:0/1977260648 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69d409d8b0 0x7f69d409dc80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f69d00098f0 tx=0x7f69d0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7ac82aa1ebe30db server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:12.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.949+0000 7f69d919a700 1 -- 172.21.15.40:0/1977260648 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d0011830 con 0x7f69d409d8b0 2023-09-30T22:29:12.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.949+0000 7f69d919a700 1 -- 172.21.15.40:0/1977260648 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d0011990 con 0x7f69d409d8b0 2023-09-30T22:29:12.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.949+0000 7f69d919a700 1 -- 172.21.15.40:0/1977260648 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d0011d20 con 0x7f69d409d8b0 2023-09-30T22:29:12.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.949+0000 7f69db19e700 1 -- 172.21.15.40:0/1977260648 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69d409d8b0 msgr2=0x7f69d409dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:12.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.949+0000 7f69db19e700 1 --2- 172.21.15.40:0/1977260648 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69d409d8b0 0x7f69d409dc80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f69d00098f0 tx=0x7f69d0009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:12.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.949+0000 7f69db19e700 1 -- 172.21.15.40:0/1977260648 shutdown_connections 2023-09-30T22:29:12.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.949+0000 7f69db19e700 1 --2- 172.21.15.40:0/1977260648 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f69d413c4d0 0x7f69d413e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.949+0000 7f69db19e700 1 --2- 172.21.15.40:0/1977260648 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69d409d8b0 0x7f69d409dc80 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.949+0000 7f69db19e700 1 --2- 172.21.15.40:0/1977260648 >> v2:172.21.15.40:3300/0 conn(0x7f69d409e1c0 0x7f69d413bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.950+0000 7f69db19e700 1 -- 172.21.15.40:0/1977260648 >> 172.21.15.40:0/1977260648 conn(0x7f69d40a2fb0 msgr2=0x7f69d40a33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:12.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.950+0000 7f69db19e700 1 -- 172.21.15.40:0/1977260648 shutdown_connections 2023-09-30T22:29:12.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.950+0000 7f69db19e700 1 -- 172.21.15.40:0/1977260648 wait complete. 2023-09-30T22:29:12.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.951+0000 7f69db19e700 1 Processor -- start 2023-09-30T22:29:12.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.951+0000 7f69db19e700 1 -- start start 2023-09-30T22:29:12.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.951+0000 7f69db19e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69d409d8b0 0x7f69d41ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.951+0000 7f69db19e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69d409e1c0 0x7f69d41ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.951+0000 7f69db19e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f69d413c4d0 0x7f69d4126ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.951+0000 7f69db19e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d41c15b0 con 0x7f69d409e1c0 2023-09-30T22:29:12.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.951+0000 7f69db19e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d413bbb0 con 0x7f69d409d8b0 2023-09-30T22:29:12.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.951+0000 7f69db19e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69d412ad10 con 0x7f69d413c4d0 2023-09-30T22:29:12.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.951+0000 7f69da19c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69d409d8b0 0x7f69d41ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.951+0000 7f69da99d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f69d413c4d0 0x7f69d4126ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.951+0000 7f69da19c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69d409d8b0 0x7f69d41ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:49058/0 (socket says 172.21.15.40:49058) 2023-09-30T22:29:12.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.951+0000 7f69da19c700 1 -- 172.21.15.40:0/3091403561 learned_addr learned my addr 172.21.15.40:0/3091403561 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:12.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.952+0000 7f69d999b700 1 --2- 172.21.15.40:0/3091403561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69d409e1c0 0x7f69d41ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.952+0000 7f69da99d700 1 -- 172.21.15.40:0/3091403561 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69d409d8b0 msgr2=0x7f69d41ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:12.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.952+0000 7f69da99d700 1 --2- 172.21.15.40:0/3091403561 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69d409d8b0 0x7f69d41ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.952+0000 7f69da99d700 1 -- 172.21.15.40:0/3091403561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69d409e1c0 msgr2=0x7f69d41ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:12.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.952+0000 7f69da99d700 1 --2- 172.21.15.40:0/3091403561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69d409e1c0 0x7f69d41ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.952+0000 7f69da99d700 1 -- 172.21.15.40:0/3091403561 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d0009550 con 0x7f69d413c4d0 2023-09-30T22:29:12.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.952+0000 7f69da99d700 1 --2- 172.21.15.40:0/3091403561 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f69d413c4d0 0x7f69d4126ff0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f69d406b340 tx=0x7f69cc00ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:12.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.952+0000 7f69caffd700 1 -- 172.21.15.40:0/3091403561 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc00cc20 con 0x7f69d413c4d0 2023-09-30T22:29:12.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.952+0000 7f69caffd700 1 -- 172.21.15.40:0/3091403561 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69cc00f040 con 0x7f69d413c4d0 2023-09-30T22:29:12.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.952+0000 7f69db19e700 1 -- 172.21.15.40:0/3091403561 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69d412a830 con 0x7f69d413c4d0 2023-09-30T22:29:12.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.952+0000 7f69caffd700 1 -- 172.21.15.40:0/3091403561 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc009e60 con 0x7f69d413c4d0 2023-09-30T22:29:12.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.952+0000 7f69db19e700 1 -- 172.21.15.40:0/3091403561 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d41cd530 con 0x7f69d413c4d0 2023-09-30T22:29:12.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.953+0000 7f69caffd700 1 -- 172.21.15.40:0/3091403561 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f69cc014480 con 0x7f69d413c4d0 2023-09-30T22:29:12.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.954+0000 7f69db19e700 1 -- 172.21.15.40:0/3091403561 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69d409c840 con 0x7f69d413c4d0 2023-09-30T22:29:12.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.954+0000 7f69caffd700 1 -- 172.21.15.40:0/3091403561 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f69cc0401f0 con 0x7f69d413c4d0 2023-09-30T22:29:12.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.959+0000 7f69caffd700 1 -- 172.21.15.40:0/3091403561 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f69cc018030 con 0x7f69d413c4d0 2023-09-30T22:29:12.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.965+0000 7fb9f7950700 1 Processor -- start 2023-09-30T22:29:12.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.966+0000 7fb9f7950700 1 -- start start 2023-09-30T22:29:12.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.966+0000 7fb9f7950700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9f009c890 0x7fb9f009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.966+0000 7fb9f7950700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9f009d920 0x7fb9f009dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.966+0000 7fb9f7950700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb9f009e2b0 0x7fb9f013ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.966+0000 7fb9f7950700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f00a29d0 con 0x7fb9f009e2b0 2023-09-30T22:29:12.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.966+0000 7fb9f7950700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f009fb40 con 0x7fb9f009d920 2023-09-30T22:29:12.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.966+0000 7fb9f7950700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f00a2600 con 0x7fb9f009c890 2023-09-30T22:29:12.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.966+0000 7fb9f56ec700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9f009c890 0x7fb9f009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.966+0000 7fb9f56ec700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9f009c890 0x7fb9f009cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48750/0 (socket says 172.21.15.40:48750) 2023-09-30T22:29:12.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.966+0000 7fb9f56ec700 1 -- 172.21.15.40:0/2088833529 learned_addr learned my addr 172.21.15.40:0/2088833529 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:12.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.966+0000 7fb9f5eed700 1 --2- 172.21.15.40:0/2088833529 >> v2:172.21.15.40:3300/0 conn(0x7fb9f009e2b0 0x7fb9f013ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.966+0000 7fb9f4eeb700 1 --2- 172.21.15.40:0/2088833529 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9f009d920 0x7fb9f009dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.967+0000 7fb9f56ec700 1 -- 172.21.15.40:0/2088833529 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9f009d920 msgr2=0x7fb9f009dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:12.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.967+0000 7fb9f56ec700 1 --2- 172.21.15.40:0/2088833529 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9f009d920 0x7fb9f009dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.967+0000 7fb9f56ec700 1 -- 172.21.15.40:0/2088833529 >> v2:172.21.15.40:3300/0 conn(0x7fb9f009e2b0 msgr2=0x7fb9f013ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:12.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.967+0000 7fb9f56ec700 1 --2- 172.21.15.40:0/2088833529 >> v2:172.21.15.40:3300/0 conn(0x7fb9f009e2b0 0x7fb9f013ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.967+0000 7fb9f56ec700 1 -- 172.21.15.40:0/2088833529 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f009e720 con 0x7fb9f009c890 2023-09-30T22:29:12.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.967+0000 7fb9f56ec700 1 --2- 172.21.15.40:0/2088833529 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9f009c890 0x7fb9f009cc60 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec006fd0 tx=0x7fb9ec009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86aa98c4b97f0bfa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:12.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.967+0000 7fb9e7fff700 1 -- 172.21.15.40:0/2088833529 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec005e30 con 0x7fb9f009c890 2023-09-30T22:29:12.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.967+0000 7fb9e7fff700 1 -- 172.21.15.40:0/2088833529 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ec004030 con 0x7fb9f009c890 2023-09-30T22:29:12.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.967+0000 7fb9e7fff700 1 -- 172.21.15.40:0/2088833529 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec0043e0 con 0x7fb9f009c890 2023-09-30T22:29:12.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.968+0000 7fb9f7950700 1 -- 172.21.15.40:0/2088833529 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9f009c890 msgr2=0x7fb9f009cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:12.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.968+0000 7fb9f7950700 1 --2- 172.21.15.40:0/2088833529 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9f009c890 0x7fb9f009cc60 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec006fd0 tx=0x7fb9ec009bd0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.968+0000 7fb9f7950700 1 -- 172.21.15.40:0/2088833529 shutdown_connections 2023-09-30T22:29:12.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.968+0000 7fb9f7950700 1 --2- 172.21.15.40:0/2088833529 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9f009c890 0x7fb9f009cc60 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.968+0000 7fb9f7950700 1 --2- 172.21.15.40:0/2088833529 >> v2:172.21.15.40:3300/0 conn(0x7fb9f009e2b0 0x7fb9f013ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.968+0000 7fb9f7950700 1 --2- 172.21.15.40:0/2088833529 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9f009d920 0x7fb9f009dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.968+0000 7fb9f7950700 1 -- 172.21.15.40:0/2088833529 >> 172.21.15.40:0/2088833529 conn(0x7fb9f00a7080 msgr2=0x7fb9f00a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:12.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.968+0000 7fb9f7950700 1 -- 172.21.15.40:0/2088833529 shutdown_connections 2023-09-30T22:29:12.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.968+0000 7fb9f7950700 1 -- 172.21.15.40:0/2088833529 wait complete. 2023-09-30T22:29:12.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.969+0000 7fb9f7950700 1 Processor -- start 2023-09-30T22:29:12.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.969+0000 7fb9f7950700 1 -- start start 2023-09-30T22:29:12.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.969+0000 7fb9f7950700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9f009c890 0x7fb9f012d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.969+0000 7fb9f7950700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9f009d920 0x7fb9f012d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.969+0000 7fb9f7950700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9f009e2b0 0x7fb9f012de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.969+0000 7fb9f7950700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f012fbb0 con 0x7fb9f009e2b0 2023-09-30T22:29:12.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.969+0000 7fb9f7950700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f008f3e0 con 0x7fb9f009c890 2023-09-30T22:29:12.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.969+0000 7fb9f7950700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f009ecf0 con 0x7fb9f009d920 2023-09-30T22:29:12.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.969+0000 7fb9f5eed700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9f009e2b0 0x7fb9f012de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.970+0000 7fb9f5eed700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9f009e2b0 0x7fb9f012de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46952/0 (socket says 172.21.15.40:46952) 2023-09-30T22:29:12.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.970+0000 7fb9f5eed700 1 -- 172.21.15.40:0/912717741 learned_addr learned my addr 172.21.15.40:0/912717741 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:12.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.970+0000 7fb9f4eeb700 1 --2- 172.21.15.40:0/912717741 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9f009d920 0x7fb9f012d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.970+0000 7fb9f56ec700 1 --2- 172.21.15.40:0/912717741 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9f009c890 0x7fb9f012d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.970+0000 7fb9f5eed700 1 -- 172.21.15.40:0/912717741 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9f009d920 msgr2=0x7fb9f012d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:12.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.970+0000 7fb9f5eed700 1 --2- 172.21.15.40:0/912717741 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9f009d920 0x7fb9f012d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.970+0000 7fb9f5eed700 1 -- 172.21.15.40:0/912717741 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9f009c890 msgr2=0x7fb9f012d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:12.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.970+0000 7fb9f5eed700 1 --2- 172.21.15.40:0/912717741 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9f009c890 0x7fb9f012d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.970+0000 7fb9f5eed700 1 -- 172.21.15.40:0/912717741 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ec009500 con 0x7fb9f009e2b0 2023-09-30T22:29:12.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.970+0000 7fb9f5eed700 1 --2- 172.21.15.40:0/912717741 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9f009e2b0 0x7fb9f012de20 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fb9e800efc0 tx=0x7fb9e800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:12.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.970+0000 7fb9e5ffb700 1 -- 172.21.15.40:0/912717741 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e8009ea0 con 0x7fb9f009e2b0 2023-09-30T22:29:12.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.970+0000 7fb9e5ffb700 1 -- 172.21.15.40:0/912717741 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e800f040 con 0x7fb9f009e2b0 2023-09-30T22:29:12.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.970+0000 7fb9e5ffb700 1 -- 172.21.15.40:0/912717741 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e800ced0 con 0x7fb9f009e2b0 2023-09-30T22:29:12.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.970+0000 7fb9f7950700 1 -- 172.21.15.40:0/912717741 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f0130930 con 0x7fb9f009e2b0 2023-09-30T22:29:12.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.971+0000 7fb9f7950700 1 -- 172.21.15.40:0/912717741 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f01303a0 con 0x7fb9f009e2b0 2023-09-30T22:29:12.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.971+0000 7fb9e5ffb700 1 -- 172.21.15.40:0/912717741 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb9e8014480 con 0x7fb9f009e2b0 2023-09-30T22:29:12.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.972+0000 7fb9e5ffb700 1 -- 172.21.15.40:0/912717741 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb9e80417e0 con 0x7fb9f009e2b0 2023-09-30T22:29:12.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.972+0000 7fb9f7950700 1 -- 172.21.15.40:0/912717741 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9f0062380 con 0x7fb9f009e2b0 2023-09-30T22:29:12.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:12.977+0000 7fb9e5ffb700 1 -- 172.21.15.40:0/912717741 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb9e8018080 con 0x7fb9f009e2b0 2023-09-30T22:29:13.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.065+0000 7fa0b1318700 1 -- 172.21.15.40:0/3018045901 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa0ac133690 con 0x7fa0ac09d920 2023-09-30T22:29:13.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.066+0000 7fa0937fe700 1 -- 172.21.15.40:0/3018045901 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa09c02a090 con 0x7fa0ac09d920 2023-09-30T22:29:13.067 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:13.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.069+0000 7fa0b1318700 1 -- 172.21.15.40:0/3018045901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0ac09d920 msgr2=0x7fa0ac122b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:13.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.069+0000 7fa0b1318700 1 --2- 172.21.15.40:0/3018045901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0ac09d920 0x7fa0ac122b70 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fa09c00e990 tx=0x7fa09c00eca0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.069+0000 7fa0b1318700 1 -- 172.21.15.40:0/3018045901 shutdown_connections 2023-09-30T22:29:13.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.069+0000 7fa0b1318700 1 --2- 172.21.15.40:0/3018045901 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa0ac1235f0 0x7fa0ac1c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.069+0000 7fa0b1318700 1 --2- 172.21.15.40:0/3018045901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0ac09d920 0x7fa0ac122b70 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.069+0000 7fa0b1318700 1 --2- 172.21.15.40:0/3018045901 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0ac133ca0 0x7fa0ac1230b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.069+0000 7fa0b1318700 1 -- 172.21.15.40:0/3018045901 >> 172.21.15.40:0/3018045901 conn(0x7fa0ac09fb20 msgr2=0x7fa0ac0a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:13.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.069+0000 7fa0b1318700 1 -- 172.21.15.40:0/3018045901 shutdown_connections 2023-09-30T22:29:13.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.069+0000 7fa0b1318700 1 -- 172.21.15.40:0/3018045901 wait complete. 2023-09-30T22:29:13.083 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:13.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.118+0000 7f5419e1b700 1 -- 172.21.15.40:0/3000631985 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f541409abb0 con 0x7f541409d400 2023-09-30T22:29:13.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.118+0000 7f53fbfff700 1 -- 172.21.15.40:0/3000631985 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f540401b3b0 con 0x7f541409d400 2023-09-30T22:29:13.119 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:13.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.120+0000 7f5419e1b700 1 -- 172.21.15.40:0/3000631985 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f541409d400 msgr2=0x7f5414127360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:13.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.120+0000 7f5419e1b700 1 --2- 172.21.15.40:0/3000631985 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f541409d400 0x7f5414127360 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f540400ebe0 tx=0x7f540400eef0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.121+0000 7f5419e1b700 1 -- 172.21.15.40:0/3000631985 shutdown_connections 2023-09-30T22:29:13.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.121+0000 7f5419e1b700 1 --2- 172.21.15.40:0/3000631985 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f541409d400 0x7f5414127360 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.121+0000 7f5419e1b700 1 --2- 172.21.15.40:0/3000631985 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5414138250 0x7f5414126120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.121+0000 7f5419e1b700 1 --2- 172.21.15.40:0/3000631985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f541409dd50 0x7f54141278a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.121+0000 7f5419e1b700 1 -- 172.21.15.40:0/3000631985 >> 172.21.15.40:0/3000631985 conn(0x7f54140a2a00 msgr2=0x7f541409f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:13.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.121+0000 7f5419e1b700 1 -- 172.21.15.40:0/3000631985 shutdown_connections 2023-09-30T22:29:13.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.121+0000 7f5419e1b700 1 -- 172.21.15.40:0/3000631985 wait complete. 2023-09-30T22:29:13.134 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:13.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.173+0000 7f69db19e700 1 -- 172.21.15.40:0/3091403561 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f69d409eac0 con 0x7f69d413c4d0 2023-09-30T22:29:13.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.174+0000 7f69caffd700 1 -- 172.21.15.40:0/3091403561 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f69cc02b090 con 0x7f69d413c4d0 2023-09-30T22:29:13.175 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:13.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.176+0000 7f69db19e700 1 -- 172.21.15.40:0/3091403561 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f69d413c4d0 msgr2=0x7f69d4126ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:13.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.176+0000 7f69db19e700 1 --2- 172.21.15.40:0/3091403561 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f69d413c4d0 0x7f69d4126ff0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f69d406b340 tx=0x7f69cc00ef90 comp rx=0 tx=0).stop 2023-09-30T22:29:13.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.176+0000 7f69db19e700 1 -- 172.21.15.40:0/3091403561 shutdown_connections 2023-09-30T22:29:13.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.176+0000 7f69db19e700 1 --2- 172.21.15.40:0/3091403561 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f69d413c4d0 0x7f69d4126ff0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.176+0000 7f69db19e700 1 --2- 172.21.15.40:0/3091403561 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69d409d8b0 0x7f69d41ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.176+0000 7f69db19e700 1 --2- 172.21.15.40:0/3091403561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69d409e1c0 0x7f69d41ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.176+0000 7f69db19e700 1 -- 172.21.15.40:0/3091403561 >> 172.21.15.40:0/3091403561 conn(0x7f69d40a2fb0 msgr2=0x7f69d4070340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:13.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.176+0000 7f69db19e700 1 -- 172.21.15.40:0/3091403561 shutdown_connections 2023-09-30T22:29:13.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.176+0000 7f69db19e700 1 -- 172.21.15.40:0/3091403561 wait complete. 2023-09-30T22:29:13.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.176+0000 7fb9f7950700 1 -- 172.21.15.40:0/912717741 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb9f0074620 con 0x7fb9f009e2b0 2023-09-30T22:29:13.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.176+0000 7fb9e5ffb700 1 -- 172.21.15.40:0/912717741 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb9e8045060 con 0x7fb9f009e2b0 2023-09-30T22:29:13.182 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:13.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.179+0000 7fb9f7950700 1 -- 172.21.15.40:0/912717741 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9f009e2b0 msgr2=0x7fb9f012de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:13.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.179+0000 7fb9f7950700 1 --2- 172.21.15.40:0/912717741 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9f009e2b0 0x7fb9f012de20 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fb9e800efc0 tx=0x7fb9e800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.179+0000 7fb9f7950700 1 -- 172.21.15.40:0/912717741 shutdown_connections 2023-09-30T22:29:13.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.179+0000 7fb9f7950700 1 --2- 172.21.15.40:0/912717741 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9f009e2b0 0x7fb9f012de20 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.179+0000 7fb9f7950700 1 --2- 172.21.15.40:0/912717741 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9f009c890 0x7fb9f012d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.179+0000 7fb9f7950700 1 --2- 172.21.15.40:0/912717741 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9f009d920 0x7fb9f012d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.179+0000 7fb9f7950700 1 -- 172.21.15.40:0/912717741 >> 172.21.15.40:0/912717741 conn(0x7fb9f00a7080 msgr2=0x7fb9f00a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:13.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.179+0000 7fb9f7950700 1 -- 172.21.15.40:0/912717741 shutdown_connections 2023-09-30T22:29:13.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:13.179+0000 7fb9f7950700 1 -- 172.21.15.40:0/912717741 wait complete. 2023-09-30T22:29:13.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:13.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:14.083 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:14.135 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:14.194 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:14.194 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:14.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.228+0000 7f1305ab0700 1 Processor -- start 2023-09-30T22:29:14.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.228+0000 7f1305ab0700 1 -- start start 2023-09-30T22:29:14.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.229+0000 7f1305ab0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1300131d50 0x7f1300132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:14.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.229+0000 7f1305ab0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f130009bc50 0x7f130009c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:14.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.229+0000 7f1305ab0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f130009c600 0x7f1300138ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:14.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.229+0000 7f1305ab0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1300071920 con 0x7f130009bc50 2023-09-30T22:29:14.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.229+0000 7f1305ab0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1300132660 con 0x7f130009c600 2023-09-30T22:29:14.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.229+0000 7f1305ab0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1300131900 con 0x7f1300131d50 2023-09-30T22:29:14.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.229+0000 7f12fffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f130009c600 0x7f1300138ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:14.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.229+0000 7f12ff7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1300131d50 0x7f1300132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:14.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.230+0000 7f12fffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f130009c600 0x7f1300138ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:57638/0 (socket says 172.21.15.40:57638) 2023-09-30T22:29:14.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.230+0000 7f12fffff700 1 -- 172.21.15.40:0/1374579588 learned_addr learned my addr 172.21.15.40:0/1374579588 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:14.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.230+0000 7f12ff7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1300131d50 0x7f1300132120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:35014/0 (socket says 172.21.15.40:35014) 2023-09-30T22:29:14.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.230+0000 7f12feffd700 1 --2- 172.21.15.40:0/1374579588 >> v2:172.21.15.40:3300/0 conn(0x7f130009bc50 0x7f130009c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:14.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.230+0000 7f12ff7fe700 1 -- 172.21.15.40:0/1374579588 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f130009c600 msgr2=0x7f1300138ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:14.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.230+0000 7f12ff7fe700 1 --2- 172.21.15.40:0/1374579588 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f130009c600 0x7f1300138ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.230+0000 7f12ff7fe700 1 -- 172.21.15.40:0/1374579588 >> v2:172.21.15.40:3300/0 conn(0x7f130009bc50 msgr2=0x7f130009c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:14.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.230+0000 7f12ff7fe700 1 --2- 172.21.15.40:0/1374579588 >> v2:172.21.15.40:3300/0 conn(0x7f130009bc50 0x7f130009c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.230+0000 7f12ff7fe700 1 -- 172.21.15.40:0/1374579588 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130009e820 con 0x7f1300131d50 2023-09-30T22:29:14.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.230+0000 7f12fffff700 1 --2- 172.21.15.40:0/1374579588 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f130009c600 0x7f1300138ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:14.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.230+0000 7f12feffd700 1 --2- 172.21.15.40:0/1374579588 >> v2:172.21.15.40:3300/0 conn(0x7f130009bc50 0x7f130009c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:14.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.230+0000 7f12ff7fe700 1 --2- 172.21.15.40:0/1374579588 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1300131d50 0x7f1300132120 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009840 tx=0x7f12f0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c137d59f6c9a53e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:14.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.230+0000 7f12fe7fc700 1 -- 172.21.15.40:0/1374579588 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f0011830 con 0x7f1300131d50 2023-09-30T22:29:14.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.230+0000 7f12fe7fc700 1 -- 172.21.15.40:0/1374579588 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f0011990 con 0x7f1300131d50 2023-09-30T22:29:14.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.230+0000 7f12fe7fc700 1 -- 172.21.15.40:0/1374579588 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f0011d20 con 0x7f1300131d50 2023-09-30T22:29:14.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.231+0000 7f1305ab0700 1 -- 172.21.15.40:0/1374579588 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1300131d50 msgr2=0x7f1300132120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:14.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.231+0000 7f1305ab0700 1 --2- 172.21.15.40:0/1374579588 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1300131d50 0x7f1300132120 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009840 tx=0x7f12f0009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:14.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.231+0000 7f1305ab0700 1 -- 172.21.15.40:0/1374579588 shutdown_connections 2023-09-30T22:29:14.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.231+0000 7f1305ab0700 1 --2- 172.21.15.40:0/1374579588 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1300131d50 0x7f1300132120 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.231+0000 7f1305ab0700 1 --2- 172.21.15.40:0/1374579588 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f130009c600 0x7f1300138ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.231+0000 7f1305ab0700 1 --2- 172.21.15.40:0/1374579588 >> v2:172.21.15.40:3300/0 conn(0x7f130009bc50 0x7f130009c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.231+0000 7f1305ab0700 1 -- 172.21.15.40:0/1374579588 >> 172.21.15.40:0/1374579588 conn(0x7f13000a2a00 msgr2=0x7f13000a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:14.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.231+0000 7f1305ab0700 1 -- 172.21.15.40:0/1374579588 shutdown_connections 2023-09-30T22:29:14.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.231+0000 7f1305ab0700 1 -- 172.21.15.40:0/1374579588 wait complete. 2023-09-30T22:29:14.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.232+0000 7f1305ab0700 1 Processor -- start 2023-09-30T22:29:14.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.233+0000 7f1305ab0700 1 -- start start 2023-09-30T22:29:14.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.233+0000 7f1305ab0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f130009bc50 0x7f13001c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:14.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.233+0000 7f1305ab0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f130009c600 0x7f13001c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:14.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.233+0000 7f1305ab0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1300131d50 0x7f13001c9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:14.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.233+0000 7f1305ab0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1300137400 con 0x7f1300131d50 2023-09-30T22:29:14.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.233+0000 7f1305ab0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130009ea60 con 0x7f130009bc50 2023-09-30T22:29:14.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.233+0000 7f1305ab0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1300136700 con 0x7f130009c600 2023-09-30T22:29:14.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.233+0000 7f12ff7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f130009bc50 0x7f13001c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:14.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.233+0000 7f12ff7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f130009bc50 0x7f13001c85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:57652/0 (socket says 172.21.15.40:57652) 2023-09-30T22:29:14.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.233+0000 7f12ff7fe700 1 -- 172.21.15.40:0/2446791752 learned_addr learned my addr 172.21.15.40:0/2446791752 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:14.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.233+0000 7f12feffd700 1 --2- 172.21.15.40:0/2446791752 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f130009c600 0x7f13001c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:14.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.233+0000 7f12fffff700 1 --2- 172.21.15.40:0/2446791752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1300131d50 0x7f13001c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:14.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.234+0000 7f12ff7fe700 1 -- 172.21.15.40:0/2446791752 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f130009c600 msgr2=0x7f13001c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:14.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.234+0000 7f12ff7fe700 1 --2- 172.21.15.40:0/2446791752 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f130009c600 0x7f13001c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.234+0000 7f12ff7fe700 1 -- 172.21.15.40:0/2446791752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1300131d50 msgr2=0x7f13001c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:14.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.234+0000 7f12ff7fe700 1 --2- 172.21.15.40:0/2446791752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1300131d50 0x7f13001c9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.234+0000 7f12ff7fe700 1 -- 172.21.15.40:0/2446791752 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f8009b30 con 0x7f130009bc50 2023-09-30T22:29:14.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.234+0000 7f12ff7fe700 1 --2- 172.21.15.40:0/2446791752 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f130009bc50 0x7f13001c85d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009b90 tx=0x7f12f0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:14.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.234+0000 7f12e7fff700 1 -- 172.21.15.40:0/2446791752 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f0004510 con 0x7f130009bc50 2023-09-30T22:29:14.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.234+0000 7f12e7fff700 1 -- 172.21.15.40:0/2446791752 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f00036a0 con 0x7f130009bc50 2023-09-30T22:29:14.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.234+0000 7f1305ab0700 1 -- 172.21.15.40:0/2446791752 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f00094a0 con 0x7f130009bc50 2023-09-30T22:29:14.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.234+0000 7f12e7fff700 1 -- 172.21.15.40:0/2446791752 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f0003a10 con 0x7f130009bc50 2023-09-30T22:29:14.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.234+0000 7f1305ab0700 1 -- 172.21.15.40:0/2446791752 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1300138de0 con 0x7f130009bc50 2023-09-30T22:29:14.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.235+0000 7f12e7fff700 1 -- 172.21.15.40:0/2446791752 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f12f0003b70 con 0x7f130009bc50 2023-09-30T22:29:14.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.236+0000 7f12e7fff700 1 -- 172.21.15.40:0/2446791752 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f12f0040260 con 0x7f130009bc50 2023-09-30T22:29:14.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.241+0000 7f12e5ffb700 1 -- 172.21.15.40:0/2446791752 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1300062380 con 0x7f130009bc50 2023-09-30T22:29:14.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.250+0000 7f12e7fff700 1 -- 172.21.15.40:0/2446791752 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f12f0015080 con 0x7f130009bc50 2023-09-30T22:29:14.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.280+0000 7f36f5c26700 1 Processor -- start 2023-09-30T22:29:14.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.280+0000 7f36f5c26700 1 -- start start 2023-09-30T22:29:14.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.280+0000 7f36f5c26700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36f0138250 0x7f36f0138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:14.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.280+0000 7f36f5c26700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f36f009d400 0x7f36f009d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:14.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.280+0000 7f36f5c26700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36f009dd50 0x7f36f013f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:14.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.280+0000 7f36f5c26700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f0137e20 con 0x7f36f009d400 2023-09-30T22:29:14.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.280+0000 7f36f5c26700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f0138050 con 0x7f36f009dd50 2023-09-30T22:29:14.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.280+0000 7f36f5c26700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36f009b010 con 0x7f36f0138250 2023-09-30T22:29:14.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.280+0000 7f36effff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36f009dd50 0x7f36f013f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:14.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.280+0000 7f36ef7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36f0138250 0x7f36f0138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:14.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.280+0000 7f36ef7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36f0138250 0x7f36f0138620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:35030/0 (socket says 172.21.15.40:35030) 2023-09-30T22:29:14.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.280+0000 7f36effff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36f009dd50 0x7f36f013f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:57666/0 (socket says 172.21.15.40:57666) 2023-09-30T22:29:14.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.280+0000 7f36ef7fe700 1 -- 172.21.15.40:0/481208639 learned_addr learned my addr 172.21.15.40:0/481208639 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:14.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.281+0000 7f36eeffd700 1 --2- 172.21.15.40:0/481208639 >> v2:172.21.15.40:3300/0 conn(0x7f36f009d400 0x7f36f009d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:14.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.281+0000 7f36ef7fe700 1 -- 172.21.15.40:0/481208639 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36f009dd50 msgr2=0x7f36f013f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:14.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.281+0000 7f36ef7fe700 1 --2- 172.21.15.40:0/481208639 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36f009dd50 0x7f36f013f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.281+0000 7f36ef7fe700 1 -- 172.21.15.40:0/481208639 >> v2:172.21.15.40:3300/0 conn(0x7f36f009d400 msgr2=0x7f36f009d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:14.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.281+0000 7f36ef7fe700 1 --2- 172.21.15.40:0/481208639 >> v2:172.21.15.40:3300/0 conn(0x7f36f009d400 0x7f36f009d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.281+0000 7f36ef7fe700 1 -- 172.21.15.40:0/481208639 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f009e1f0 con 0x7f36f0138250 2023-09-30T22:29:14.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.281+0000 7f36effff700 1 --2- 172.21.15.40:0/481208639 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36f009dd50 0x7f36f013f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:14.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.281+0000 7f36ef7fe700 1 --2- 172.21.15.40:0/481208639 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36f0138250 0x7f36f0138620 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f36e00098f0 tx=0x7f36e0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb36d1e94b464949 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:14.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.281+0000 7f36ee7fc700 1 -- 172.21.15.40:0/481208639 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e0011830 con 0x7f36f0138250 2023-09-30T22:29:14.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.281+0000 7f36ee7fc700 1 -- 172.21.15.40:0/481208639 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e0011990 con 0x7f36f0138250 2023-09-30T22:29:14.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.281+0000 7f36ee7fc700 1 -- 172.21.15.40:0/481208639 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e0011d20 con 0x7f36f0138250 2023-09-30T22:29:14.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.282+0000 7f36f5c26700 1 -- 172.21.15.40:0/481208639 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36f0138250 msgr2=0x7f36f0138620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:14.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.282+0000 7f36f5c26700 1 --2- 172.21.15.40:0/481208639 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36f0138250 0x7f36f0138620 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f36e00098f0 tx=0x7f36e0009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:14.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.282+0000 7f36f5c26700 1 -- 172.21.15.40:0/481208639 shutdown_connections 2023-09-30T22:29:14.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.282+0000 7f36f5c26700 1 --2- 172.21.15.40:0/481208639 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36f0138250 0x7f36f0138620 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.282+0000 7f36f5c26700 1 --2- 172.21.15.40:0/481208639 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36f009dd50 0x7f36f013f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.282+0000 7f36f5c26700 1 --2- 172.21.15.40:0/481208639 >> v2:172.21.15.40:3300/0 conn(0x7f36f009d400 0x7f36f009d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.282+0000 7f36f5c26700 1 -- 172.21.15.40:0/481208639 >> 172.21.15.40:0/481208639 conn(0x7f36f00a2a00 msgr2=0x7f36f00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:14.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.282+0000 7f36f5c26700 1 -- 172.21.15.40:0/481208639 shutdown_connections 2023-09-30T22:29:14.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.282+0000 7f36f5c26700 1 -- 172.21.15.40:0/481208639 wait complete. 2023-09-30T22:29:14.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.284+0000 7f36f5c26700 1 Processor -- start 2023-09-30T22:29:14.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.284+0000 7f36f5c26700 1 -- start start 2023-09-30T22:29:14.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.285+0000 7f36f5c26700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36f009d400 0x7f36f01d53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:14.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.285+0000 7f36f5c26700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36f009dd50 0x7f36f01d58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:14.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.285+0000 7f36f5c26700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36f0138250 0x7f36f01d5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:14.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.285+0000 7f36f5c26700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f013e3b0 con 0x7f36f009dd50 2023-09-30T22:29:14.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.285+0000 7f36f5c26700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f013d9d0 con 0x7f36f0138250 2023-09-30T22:29:14.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.285+0000 7f36f5c26700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36f013d2e0 con 0x7f36f009d400 2023-09-30T22:29:14.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.285+0000 7f36ef7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36f009d400 0x7f36f01d53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:14.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.285+0000 7f36effff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36f0138250 0x7f36f01d5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:14.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.285+0000 7f36ef7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36f009d400 0x7f36f01d53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:35042/0 (socket says 172.21.15.40:35042) 2023-09-30T22:29:14.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.285+0000 7f36ef7fe700 1 -- 172.21.15.40:0/292388333 learned_addr learned my addr 172.21.15.40:0/292388333 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:14.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.285+0000 7f36eeffd700 1 --2- 172.21.15.40:0/292388333 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36f009dd50 0x7f36f01d58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:14.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.285+0000 7f36ef7fe700 1 -- 172.21.15.40:0/292388333 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36f0138250 msgr2=0x7f36f01d5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:14.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.285+0000 7f36ef7fe700 1 --2- 172.21.15.40:0/292388333 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36f0138250 0x7f36f01d5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.285+0000 7f36ef7fe700 1 -- 172.21.15.40:0/292388333 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36f009dd50 msgr2=0x7f36f01d58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:14.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.285+0000 7f36ef7fe700 1 --2- 172.21.15.40:0/292388333 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36f009dd50 0x7f36f01d58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.285+0000 7f36ef7fe700 1 -- 172.21.15.40:0/292388333 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e8009a70 con 0x7f36f009d400 2023-09-30T22:29:14.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.285+0000 7f36eeffd700 1 --2- 172.21.15.40:0/292388333 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36f009dd50 0x7f36f01d58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:14.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.286+0000 7f36ef7fe700 1 --2- 172.21.15.40:0/292388333 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36f009d400 0x7f36f01d53b0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f36e0009c40 tx=0x7f36e0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:14.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.286+0000 7f36d7fff700 1 -- 172.21.15.40:0/292388333 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e00044d0 con 0x7f36f009d400 2023-09-30T22:29:14.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.286+0000 7f36d7fff700 1 -- 172.21.15.40:0/292388333 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e00036a0 con 0x7f36f009d400 2023-09-30T22:29:14.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.286+0000 7f36f5c26700 1 -- 172.21.15.40:0/292388333 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e0009550 con 0x7f36f009d400 2023-09-30T22:29:14.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.286+0000 7f36d7fff700 1 -- 172.21.15.40:0/292388333 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e0003a50 con 0x7f36f009d400 2023-09-30T22:29:14.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.286+0000 7f36f5c26700 1 -- 172.21.15.40:0/292388333 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f009a350 con 0x7f36f009d400 2023-09-30T22:29:14.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.287+0000 7f36d7fff700 1 -- 172.21.15.40:0/292388333 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f36e0003bb0 con 0x7f36f009d400 2023-09-30T22:29:14.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.287+0000 7f36f5c26700 1 -- 172.21.15.40:0/292388333 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f0062380 con 0x7f36f009d400 2023-09-30T22:29:14.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.287+0000 7f36d7fff700 1 -- 172.21.15.40:0/292388333 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f36e00407a0 con 0x7f36f009d400 2023-09-30T22:29:14.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.296+0000 7f36d7fff700 1 -- 172.21.15.40:0/292388333 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f36e001a420 con 0x7f36f009d400 2023-09-30T22:29:14.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.337+0000 7f6533469700 1 Processor -- start 2023-09-30T22:29:14.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.337+0000 7f6533469700 1 -- start start 2023-09-30T22:29:14.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.337+0000 7f6533469700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f652c09d450 0x7f652c09d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:14.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.338+0000 7f6533469700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f652c1308d0 0x7f652c138420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:14.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.338+0000 7f6533469700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f652c09e8b0 con 0x7f652c09dd60 2023-09-30T22:29:14.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.338+0000 7f6533469700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f652c09c3b0 con 0x7f652c09d450 2023-09-30T22:29:14.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.338+0000 7f6533469700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f652c09a6b0 con 0x7f652c1308d0 2023-09-30T22:29:14.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.338+0000 7f6531a06700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f652c1308d0 0x7f652c138420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:14.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.338+0000 7f6531a06700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f652c1308d0 0x7f652c138420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:35050/0 (socket says 172.21.15.40:35050) 2023-09-30T22:29:14.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.338+0000 7f6531a06700 1 -- 172.21.15.40:0/1365235893 learned_addr learned my addr 172.21.15.40:0/1365235893 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:14.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.338+0000 7f6530a04700 1 --1- 172.21.15.40:0/1365235893 >> v1:172.21.15.40:6789/0 conn(0x7f652c09dd60 0x7f652c1301c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52376/0 (socket says 172.21.15.40:52376) 2023-09-30T22:29:14.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.338+0000 7f6531205700 1 --2- 172.21.15.40:0/1365235893 >> v2:172.21.15.40:3300/0 conn(0x7f652c09d450 0x7f652c09d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:14.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.338+0000 7f6531a06700 1 -- 172.21.15.40:0/1365235893 >> v2:172.21.15.40:3300/0 conn(0x7f652c09d450 msgr2=0x7f652c09d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:14.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.338+0000 7f6531a06700 1 --2- 172.21.15.40:0/1365235893 >> v2:172.21.15.40:3300/0 conn(0x7f652c09d450 0x7f652c09d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.338+0000 7f6531a06700 1 -- 172.21.15.40:0/1365235893 >> v1:172.21.15.40:6789/0 conn(0x7f652c09dd60 legacy=0x7f652c1301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:14.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.338+0000 7f6531a06700 1 -- 172.21.15.40:0/1365235893 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f652c09b4f0 con 0x7f652c1308d0 2023-09-30T22:29:14.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.338+0000 7f6531a06700 1 --2- 172.21.15.40:0/1365235893 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f652c1308d0 0x7f652c138420 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f6524009e50 tx=0x7f652400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d04e454f441b1da4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:14.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.339+0000 7f6523fff700 1 -- 172.21.15.40:0/1365235893 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652400e070 con 0x7f652c1308d0 2023-09-30T22:29:14.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.339+0000 7f6523fff700 1 -- 172.21.15.40:0/1365235893 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f652400b910 con 0x7f652c1308d0 2023-09-30T22:29:14.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.339+0000 7f6523fff700 1 -- 172.21.15.40:0/1365235893 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652400bcc0 con 0x7f652c1308d0 2023-09-30T22:29:14.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.339+0000 7f6533469700 1 -- 172.21.15.40:0/1365235893 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f652c1308d0 msgr2=0x7f652c138420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:14.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.339+0000 7f6533469700 1 --2- 172.21.15.40:0/1365235893 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f652c1308d0 0x7f652c138420 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f6524009e50 tx=0x7f652400b330 comp rx=0 tx=0).stop 2023-09-30T22:29:14.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.339+0000 7f6533469700 1 -- 172.21.15.40:0/1365235893 shutdown_connections 2023-09-30T22:29:14.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.339+0000 7f6533469700 1 --2- 172.21.15.40:0/1365235893 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f652c1308d0 0x7f652c138420 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.339+0000 7f6533469700 1 --2- 172.21.15.40:0/1365235893 >> v2:172.21.15.40:3300/0 conn(0x7f652c09d450 0x7f652c09d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.339+0000 7f6533469700 1 -- 172.21.15.40:0/1365235893 >> 172.21.15.40:0/1365235893 conn(0x7f652c0a2a00 msgr2=0x7f652c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:14.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.339+0000 7f6533469700 1 -- 172.21.15.40:0/1365235893 shutdown_connections 2023-09-30T22:29:14.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.340+0000 7f6533469700 1 -- 172.21.15.40:0/1365235893 wait complete. 2023-09-30T22:29:14.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.340+0000 7f6533469700 1 Processor -- start 2023-09-30T22:29:14.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.340+0000 7f6533469700 1 -- start start 2023-09-30T22:29:14.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.341+0000 7f6533469700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f652c09d450 0x7f652c1b92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:14.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.341+0000 7f6533469700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f652c09dd60 0x7f652c1b9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:14.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.341+0000 7f6533469700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f652c1308d0 0x7f652c1b9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:14.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.341+0000 7f6533469700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652c11f170 con 0x7f652c09dd60 2023-09-30T22:29:14.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.341+0000 7f6533469700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f652c11e210 con 0x7f652c1308d0 2023-09-30T22:29:14.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.341+0000 7f6533469700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f652c09c5d0 con 0x7f652c09d450 2023-09-30T22:29:14.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.341+0000 7f6531205700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f652c09d450 0x7f652c1b92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:14.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.341+0000 7f6531205700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f652c09d450 0x7f652c1b92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:35064/0 (socket says 172.21.15.40:35064) 2023-09-30T22:29:14.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.341+0000 7f6531205700 1 -- 172.21.15.40:0/2724849606 learned_addr learned my addr 172.21.15.40:0/2724849606 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:14.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.341+0000 7f6530a04700 1 --2- 172.21.15.40:0/2724849606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f652c09dd60 0x7f652c1b9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:14.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.341+0000 7f6531a06700 1 --2- 172.21.15.40:0/2724849606 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f652c1308d0 0x7f652c1b9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:14.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.341+0000 7f6531205700 1 -- 172.21.15.40:0/2724849606 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f652c1308d0 msgr2=0x7f652c1b9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:14.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.341+0000 7f6531205700 1 --2- 172.21.15.40:0/2724849606 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f652c1308d0 0x7f652c1b9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.342+0000 7f6531205700 1 -- 172.21.15.40:0/2724849606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f652c09dd60 msgr2=0x7f652c1b9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:14.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.342+0000 7f6531205700 1 --2- 172.21.15.40:0/2724849606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f652c09dd60 0x7f652c1b9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.342+0000 7f6531205700 1 -- 172.21.15.40:0/2724849606 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6524009b30 con 0x7f652c09d450 2023-09-30T22:29:14.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.342+0000 7f6530a04700 1 --2- 172.21.15.40:0/2724849606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f652c09dd60 0x7f652c1b9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:14.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.342+0000 7f1f3c2b9700 1 Processor -- start 2023-09-30T22:29:14.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.342+0000 7f6531205700 1 --2- 172.21.15.40:0/2724849606 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f652c09d450 0x7f652c1b92c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f652800e9e0 tx=0x7f652800ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:14.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.342+0000 7f1f3c2b9700 1 -- start start 2023-09-30T22:29:14.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.342+0000 7f6521ffb700 1 -- 172.21.15.40:0/2724849606 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6528009710 con 0x7f652c09d450 2023-09-30T22:29:14.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.342+0000 7f6521ffb700 1 -- 172.21.15.40:0/2724849606 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f652800c850 con 0x7f652c09d450 2023-09-30T22:29:14.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.342+0000 7f6521ffb700 1 -- 172.21.15.40:0/2724849606 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652800cbc0 con 0x7f652c09d450 2023-09-30T22:29:14.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.342+0000 7f6533469700 1 -- 172.21.15.40:0/2724849606 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f652c1bae90 con 0x7f652c09d450 2023-09-30T22:29:14.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.343+0000 7f1f3c2b9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f3409d920 0x7f1f3409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:14.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.343+0000 7f1f3c2b9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f3409f0f0 0x7f1f3409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:14.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.343+0000 7f1f3c2b9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f3409f940 con 0x7f1f34133ca0 2023-09-30T22:29:14.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.343+0000 7f1f3c2b9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3406b4c0 con 0x7f1f3409f0f0 2023-09-30T22:29:14.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.343+0000 7f1f3c2b9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3409a8f0 con 0x7f1f3409d920 2023-09-30T22:29:14.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.343+0000 7f6533469700 1 -- 172.21.15.40:0/2724849606 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f652c11da80 con 0x7f652c09d450 2023-09-30T22:29:14.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.343+0000 7f1f39854700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f3409f0f0 0x7f1f3409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:14.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.343+0000 7f1f39854700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f3409f0f0 0x7f1f3409e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:57692/0 (socket says 172.21.15.40:57692) 2023-09-30T22:29:14.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.343+0000 7f1f39854700 1 -- 172.21.15.40:0/2963859231 learned_addr learned my addr 172.21.15.40:0/2963859231 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:14.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.343+0000 7f1f3a055700 1 --2- 172.21.15.40:0/2963859231 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f3409d920 0x7f1f3409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:14.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.343+0000 7f1f39854700 1 -- 172.21.15.40:0/2963859231 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f3409d920 msgr2=0x7f1f3409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:14.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.343+0000 7f1f39854700 1 --2- 172.21.15.40:0/2963859231 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f3409d920 0x7f1f3409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.343+0000 7f1f39053700 1 -- 172.21.15.40:0/2963859231 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2746987641 0 0) 0x7f1f3409f940 con 0x7f1f34133ca0 2023-09-30T22:29:14.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.344+0000 7f1f39854700 1 -- 172.21.15.40:0/2963859231 >> v1:172.21.15.40:6789/0 conn(0x7f1f34133ca0 legacy=0x7f1f34134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:14.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.344+0000 7f1f39854700 1 -- 172.21.15.40:0/2963859231 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3409f6e0 con 0x7f1f3409f0f0 2023-09-30T22:29:14.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.344+0000 7f1f3a055700 1 --2- 172.21.15.40:0/2963859231 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f3409d920 0x7f1f3409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:14.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.344+0000 7f1f39854700 1 --2- 172.21.15.40:0/2963859231 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f3409f0f0 0x7f1f3409e230 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f1f24009920 tx=0x7f1f24009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e291aaa80873071a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:14.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.344+0000 7f6521ffb700 1 -- 172.21.15.40:0/2724849606 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f652800cd20 con 0x7f652c09d450 2023-09-30T22:29:14.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.344+0000 7f6533469700 1 -- 172.21.15.40:0/2724849606 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f652c062380 con 0x7f652c09d450 2023-09-30T22:29:14.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.344+0000 7f6521ffb700 1 -- 172.21.15.40:0/2724849606 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f652801a360 con 0x7f652c09d450 2023-09-30T22:29:14.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.344+0000 7f1f39053700 1 -- 172.21.15.40:0/2963859231 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2400ba60 con 0x7f1f3409f0f0 2023-09-30T22:29:14.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.344+0000 7f1f39053700 1 -- 172.21.15.40:0/2963859231 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2400bbc0 con 0x7f1f3409f0f0 2023-09-30T22:29:14.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.344+0000 7f1f39053700 1 -- 172.21.15.40:0/2963859231 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f24009e70 con 0x7f1f3409f0f0 2023-09-30T22:29:14.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.345+0000 7f1f3c2b9700 1 -- 172.21.15.40:0/2963859231 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f3409f0f0 msgr2=0x7f1f3409e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:14.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.345+0000 7f1f3c2b9700 1 --2- 172.21.15.40:0/2963859231 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f3409f0f0 0x7f1f3409e230 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f1f24009920 tx=0x7f1f24009c30 comp rx=0 tx=0).stop 2023-09-30T22:29:14.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.345+0000 7f1f3c2b9700 1 -- 172.21.15.40:0/2963859231 shutdown_connections 2023-09-30T22:29:14.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.345+0000 7f1f3c2b9700 1 --2- 172.21.15.40:0/2963859231 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f3409d920 0x7f1f3409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.345+0000 7f1f3c2b9700 1 --2- 172.21.15.40:0/2963859231 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f3409f0f0 0x7f1f3409e230 secure :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f1f24009920 tx=0x7f1f24009c30 comp rx=0 tx=0).stop 2023-09-30T22:29:14.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.345+0000 7f1f3c2b9700 1 -- 172.21.15.40:0/2963859231 >> 172.21.15.40:0/2963859231 conn(0x7f1f3409fb20 msgr2=0x7f1f3409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:14.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.346+0000 7f1f3c2b9700 1 -- 172.21.15.40:0/2963859231 shutdown_connections 2023-09-30T22:29:14.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.346+0000 7f1f3c2b9700 1 -- 172.21.15.40:0/2963859231 wait complete. 2023-09-30T22:29:14.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.347+0000 7f1f3c2b9700 1 Processor -- start 2023-09-30T22:29:14.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.347+0000 7f1f3c2b9700 1 -- start start 2023-09-30T22:29:14.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.347+0000 7f1f3c2b9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f3409d920 0x7f1f3411db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:14.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.347+0000 7f1f3c2b9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f34133ca0 0x7f1f3411e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:14.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.347+0000 7f1f3c2b9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f3411e5c0 0x7f1f341ced80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:14.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.347+0000 7f1f3c2b9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f341219c0 con 0x7f1f34133ca0 2023-09-30T22:29:14.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.347+0000 7f1f3c2b9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3411f0f0 con 0x7f1f3411e5c0 2023-09-30T22:29:14.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.347+0000 7f1f3c2b9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f34120320 con 0x7f1f3409d920 2023-09-30T22:29:14.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.347+0000 7f1f3a055700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f3409d920 0x7f1f3411db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:14.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.347+0000 7f1f3a055700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f3409d920 0x7f1f3411db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:35080/0 (socket says 172.21.15.40:35080) 2023-09-30T22:29:14.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.347+0000 7f1f3a055700 1 -- 172.21.15.40:0/1292793536 learned_addr learned my addr 172.21.15.40:0/1292793536 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:14.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.347+0000 7f1f39854700 1 --2- 172.21.15.40:0/1292793536 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f34133ca0 0x7f1f3411e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:14.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.347+0000 7f1f3a856700 1 --2- 172.21.15.40:0/1292793536 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f3411e5c0 0x7f1f341ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:14.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.348+0000 7f1f39854700 1 -- 172.21.15.40:0/1292793536 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f3409d920 msgr2=0x7f1f3411db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:14.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.348+0000 7f1f39854700 1 --2- 172.21.15.40:0/1292793536 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f3409d920 0x7f1f3411db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.348+0000 7f1f39854700 1 -- 172.21.15.40:0/1292793536 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f3411e5c0 msgr2=0x7f1f341ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:14.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.348+0000 7f1f39854700 1 --2- 172.21.15.40:0/1292793536 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f3411e5c0 0x7f1f341ced80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.348+0000 7f1f39854700 1 -- 172.21.15.40:0/1292793536 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f24009550 con 0x7f1f34133ca0 2023-09-30T22:29:14.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.348+0000 7f1f39854700 1 --2- 172.21.15.40:0/1292793536 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f34133ca0 0x7f1f3411e080 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f1f24016000 tx=0x7f1f24004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:14.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.348+0000 7f1f2affd700 1 -- 172.21.15.40:0/1292793536 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2401a840 con 0x7f1f34133ca0 2023-09-30T22:29:14.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.348+0000 7f1f2affd700 1 -- 172.21.15.40:0/1292793536 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2401f070 con 0x7f1f34133ca0 2023-09-30T22:29:14.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.348+0000 7f1f2affd700 1 -- 172.21.15.40:0/1292793536 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2401aba0 con 0x7f1f34133ca0 2023-09-30T22:29:14.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.348+0000 7f1f3c2b9700 1 -- 172.21.15.40:0/1292793536 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f3411f6c0 con 0x7f1f34133ca0 2023-09-30T22:29:14.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.348+0000 7f1f3c2b9700 1 -- 172.21.15.40:0/1292793536 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f340a2910 con 0x7f1f34133ca0 2023-09-30T22:29:14.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.349+0000 7f1f2affd700 1 -- 172.21.15.40:0/1292793536 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1f2401ad00 con 0x7f1f34133ca0 2023-09-30T22:29:14.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.349+0000 7f1f2affd700 1 -- 172.21.15.40:0/1292793536 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f1f24021070 con 0x7f1f34133ca0 2023-09-30T22:29:14.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.353+0000 7f1f3c2b9700 1 -- 172.21.15.40:0/1292793536 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f340a3260 con 0x7f1f34133ca0 2023-09-30T22:29:14.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.353+0000 7f6521ffb700 1 -- 172.21.15.40:0/2724849606 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6528017070 con 0x7f652c09d450 2023-09-30T22:29:14.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.358+0000 7f1f2affd700 1 -- 172.21.15.40:0/1292793536 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f2402b080 con 0x7f1f34133ca0 2023-09-30T22:29:14.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.457+0000 7f12e5ffb700 1 -- 172.21.15.40:0/2446791752 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1300074330 con 0x7f130009bc50 2023-09-30T22:29:14.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.457+0000 7f12e7fff700 1 -- 172.21.15.40:0/2446791752 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f12f0028020 con 0x7f130009bc50 2023-09-30T22:29:14.458 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:14.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.459+0000 7f12e5ffb700 1 -- 172.21.15.40:0/2446791752 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f130009bc50 msgr2=0x7f13001c85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:14.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.459+0000 7f12e5ffb700 1 --2- 172.21.15.40:0/2446791752 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f130009bc50 0x7f13001c85d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009b90 tx=0x7f12f0004750 comp rx=0 tx=0).stop 2023-09-30T22:29:14.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.459+0000 7f12e5ffb700 1 -- 172.21.15.40:0/2446791752 shutdown_connections 2023-09-30T22:29:14.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.459+0000 7f12e5ffb700 1 --2- 172.21.15.40:0/2446791752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1300131d50 0x7f13001c9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.459+0000 7f12e5ffb700 1 --2- 172.21.15.40:0/2446791752 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f130009bc50 0x7f13001c85d0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.459+0000 7f12e5ffb700 1 --2- 172.21.15.40:0/2446791752 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f130009c600 0x7f13001c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.459+0000 7f12e5ffb700 1 -- 172.21.15.40:0/2446791752 >> 172.21.15.40:0/2446791752 conn(0x7f13000a2a00 msgr2=0x7f130009af80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:14.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.459+0000 7f12e5ffb700 1 -- 172.21.15.40:0/2446791752 shutdown_connections 2023-09-30T22:29:14.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.460+0000 7f12e5ffb700 1 -- 172.21.15.40:0/2446791752 wait complete. 2023-09-30T22:29:14.473 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:14.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.511+0000 7f36f5c26700 1 -- 172.21.15.40:0/292388333 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f36f009abb0 con 0x7f36f009d400 2023-09-30T22:29:14.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.512+0000 7f36d7fff700 1 -- 172.21.15.40:0/292388333 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f36e0028020 con 0x7f36f009d400 2023-09-30T22:29:14.512 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:14.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.514+0000 7f36f5c26700 1 -- 172.21.15.40:0/292388333 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36f009d400 msgr2=0x7f36f01d53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:14.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.514+0000 7f36f5c26700 1 --2- 172.21.15.40:0/292388333 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36f009d400 0x7f36f01d53b0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f36e0009c40 tx=0x7f36e0004750 comp rx=0 tx=0).stop 2023-09-30T22:29:14.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.514+0000 7f36f5c26700 1 -- 172.21.15.40:0/292388333 shutdown_connections 2023-09-30T22:29:14.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.514+0000 7f36f5c26700 1 --2- 172.21.15.40:0/292388333 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36f009d400 0x7f36f01d53b0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.514+0000 7f36f5c26700 1 --2- 172.21.15.40:0/292388333 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36f0138250 0x7f36f01d5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.514+0000 7f36f5c26700 1 --2- 172.21.15.40:0/292388333 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36f009dd50 0x7f36f01d58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.514+0000 7f36f5c26700 1 -- 172.21.15.40:0/292388333 >> 172.21.15.40:0/292388333 conn(0x7f36f00a2a00 msgr2=0x7f36f00a1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:14.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.514+0000 7f36f5c26700 1 -- 172.21.15.40:0/292388333 shutdown_connections 2023-09-30T22:29:14.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.514+0000 7f36f5c26700 1 -- 172.21.15.40:0/292388333 wait complete. 2023-09-30T22:29:14.527 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:14.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.624+0000 7f6533469700 1 -- 172.21.15.40:0/2724849606 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f652c11e430 con 0x7f652c09d450 2023-09-30T22:29:14.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.624+0000 7f6521ffb700 1 -- 172.21.15.40:0/2724849606 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6528017030 con 0x7f652c09d450 2023-09-30T22:29:14.625 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:14.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.626+0000 7f6533469700 1 -- 172.21.15.40:0/2724849606 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f652c09d450 msgr2=0x7f652c1b92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:14.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.626+0000 7f6533469700 1 --2- 172.21.15.40:0/2724849606 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f652c09d450 0x7f652c1b92c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f652800e9e0 tx=0x7f652800ecf0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.627+0000 7f6533469700 1 -- 172.21.15.40:0/2724849606 shutdown_connections 2023-09-30T22:29:14.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.627+0000 7f6533469700 1 --2- 172.21.15.40:0/2724849606 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f652c09d450 0x7f652c1b92c0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.627+0000 7f6533469700 1 --2- 172.21.15.40:0/2724849606 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f652c1308d0 0x7f652c1b9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.627+0000 7f6533469700 1 --2- 172.21.15.40:0/2724849606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f652c09dd60 0x7f652c1b9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.627+0000 7f6533469700 1 -- 172.21.15.40:0/2724849606 >> 172.21.15.40:0/2724849606 conn(0x7f652c0a2a00 msgr2=0x7f652c12fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:14.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.627+0000 7f6533469700 1 -- 172.21.15.40:0/2724849606 shutdown_connections 2023-09-30T22:29:14.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.627+0000 7f6533469700 1 -- 172.21.15.40:0/2724849606 wait complete. 2023-09-30T22:29:14.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.632+0000 7f1f3c2b9700 1 -- 172.21.15.40:0/1292793536 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1f3409c9e0 con 0x7f1f34133ca0 2023-09-30T22:29:14.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.632+0000 7f1f2affd700 1 -- 172.21.15.40:0/1292793536 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1f24015020 con 0x7f1f34133ca0 2023-09-30T22:29:14.633 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:14.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.635+0000 7f1f3c2b9700 1 -- 172.21.15.40:0/1292793536 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f34133ca0 msgr2=0x7f1f3411e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:14.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.635+0000 7f1f3c2b9700 1 --2- 172.21.15.40:0/1292793536 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f34133ca0 0x7f1f3411e080 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f1f24016000 tx=0x7f1f24004750 comp rx=0 tx=0).stop 2023-09-30T22:29:14.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.635+0000 7f1f3c2b9700 1 -- 172.21.15.40:0/1292793536 shutdown_connections 2023-09-30T22:29:14.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.635+0000 7f1f3c2b9700 1 --2- 172.21.15.40:0/1292793536 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f3409d920 0x7f1f3411db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.635+0000 7f1f3c2b9700 1 --2- 172.21.15.40:0/1292793536 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f3411e5c0 0x7f1f341ced80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.635+0000 7f1f3c2b9700 1 --2- 172.21.15.40:0/1292793536 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f34133ca0 0x7f1f3411e080 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.635+0000 7f1f3c2b9700 1 -- 172.21.15.40:0/1292793536 >> 172.21.15.40:0/1292793536 conn(0x7f1f3409fb20 msgr2=0x7f1f341ba980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:14.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.635+0000 7f1f3c2b9700 1 -- 172.21.15.40:0/1292793536 shutdown_connections 2023-09-30T22:29:14.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:14.635+0000 7f1f3c2b9700 1 -- 172.21.15.40:0/1292793536 wait complete. 2023-09-30T22:29:14.640 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:14.647 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:15.474 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:15.528 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:15.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.616+0000 7f021011e700 1 Processor -- start 2023-09-30T22:29:15.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.616+0000 7f021011e700 1 -- start start 2023-09-30T22:29:15.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.617+0000 7f021011e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f020806f070 0x7f020806f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:15.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.617+0000 7f021011e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f020806fdb0 0x7f02080977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:15.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.617+0000 7f021011e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0208070830 con 0x7f020806f980 2023-09-30T22:29:15.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.617+0000 7f021011e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0208070ad0 con 0x7f020806f070 2023-09-30T22:29:15.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.617+0000 7f021011e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0208070de0 con 0x7f020806fdb0 2023-09-30T22:29:15.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.617+0000 7f020deba700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f020806f070 0x7f020806f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:15.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.617+0000 7f020e6bb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f020806fdb0 0x7f02080977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:15.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.617+0000 7f020deba700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f020806f070 0x7f020806f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36446/0 (socket says 172.21.15.40:36446) 2023-09-30T22:29:15.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.617+0000 7f020e6bb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f020806fdb0 0x7f02080977a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:57710/0 (socket says 172.21.15.40:57710) 2023-09-30T22:29:15.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.617+0000 7f020deba700 1 -- 172.21.15.40:0/2055126572 learned_addr learned my addr 172.21.15.40:0/2055126572 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:15.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.617+0000 7f020d6b9700 1 --1- 172.21.15.40:0/2055126572 >> v1:172.21.15.40:6789/0 conn(0x7f020806f980 0x7f0208097090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52394/0 (socket says 172.21.15.40:52394) 2023-09-30T22:29:15.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.617+0000 7f020deba700 1 -- 172.21.15.40:0/2055126572 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f020806fdb0 msgr2=0x7f02080977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:15.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.617+0000 7f020deba700 1 --2- 172.21.15.40:0/2055126572 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f020806fdb0 0x7f02080977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.617+0000 7f020deba700 1 -- 172.21.15.40:0/2055126572 >> v1:172.21.15.40:6789/0 conn(0x7f020806f980 legacy=0x7f0208097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:15.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.617+0000 7f020deba700 1 -- 172.21.15.40:0/2055126572 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020809fe20 con 0x7f020806f070 2023-09-30T22:29:15.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.617+0000 7f020e6bb700 1 --2- 172.21.15.40:0/2055126572 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f020806fdb0 0x7f02080977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:15.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.618+0000 7f020deba700 1 --2- 172.21.15.40:0/2055126572 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f020806f070 0x7f020806f440 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f01f80098f0 tx=0x7f01f8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ebd02fa7b2a6346 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:15.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.618+0000 7f020ceb8700 1 -- 172.21.15.40:0/2055126572 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f8011830 con 0x7f020806f070 2023-09-30T22:29:15.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.618+0000 7f020ceb8700 1 -- 172.21.15.40:0/2055126572 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f8011990 con 0x7f020806f070 2023-09-30T22:29:15.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.618+0000 7f020ceb8700 1 -- 172.21.15.40:0/2055126572 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f8011d20 con 0x7f020806f070 2023-09-30T22:29:15.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.618+0000 7f021011e700 1 -- 172.21.15.40:0/2055126572 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f020806f070 msgr2=0x7f020806f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:15.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.618+0000 7f021011e700 1 --2- 172.21.15.40:0/2055126572 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f020806f070 0x7f020806f440 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f01f80098f0 tx=0x7f01f8009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:15.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.619+0000 7f021011e700 1 -- 172.21.15.40:0/2055126572 shutdown_connections 2023-09-30T22:29:15.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.619+0000 7f021011e700 1 --2- 172.21.15.40:0/2055126572 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f020806fdb0 0x7f02080977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.619+0000 7f021011e700 1 --2- 172.21.15.40:0/2055126572 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f020806f070 0x7f020806f440 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.619+0000 7f021011e700 1 -- 172.21.15.40:0/2055126572 >> 172.21.15.40:0/2055126572 conn(0x7f02080a41a0 msgr2=0x7f02080a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:15.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.619+0000 7f021011e700 1 -- 172.21.15.40:0/2055126572 shutdown_connections 2023-09-30T22:29:15.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.619+0000 7f021011e700 1 -- 172.21.15.40:0/2055126572 wait complete. 2023-09-30T22:29:15.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.620+0000 7f021011e700 1 Processor -- start 2023-09-30T22:29:15.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.620+0000 7f021011e700 1 -- start start 2023-09-30T22:29:15.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.620+0000 7f021011e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f020806f070 0x7f020806c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:15.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.620+0000 7f021011e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f020806f980 0x7f020806ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:15.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.620+0000 7f021011e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f020806fdb0 0x7f020806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:15.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.620+0000 7f021011e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020806e280 con 0x7f020806fdb0 2023-09-30T22:29:15.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.620+0000 7f021011e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0208129450 con 0x7f020806f980 2023-09-30T22:29:15.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.620+0000 7f021011e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f020812c2d0 con 0x7f020806f070 2023-09-30T22:29:15.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.620+0000 7f020d6b9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f020806f980 0x7f020806ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:15.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.620+0000 7f020deba700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f020806f070 0x7f020806c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:15.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.620+0000 7f020deba700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f020806f070 0x7f020806c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:35088/0 (socket says 172.21.15.40:35088) 2023-09-30T22:29:15.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.620+0000 7f020d6b9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f020806f980 0x7f020806ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:57712/0 (socket says 172.21.15.40:57712) 2023-09-30T22:29:15.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.620+0000 7f020deba700 1 -- 172.21.15.40:0/1218505465 learned_addr learned my addr 172.21.15.40:0/1218505465 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:15.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.620+0000 7f020e6bb700 1 --2- 172.21.15.40:0/1218505465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f020806fdb0 0x7f020806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:15.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.621+0000 7f020e6bb700 1 -- 172.21.15.40:0/1218505465 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f020806f070 msgr2=0x7f020806c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:15.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.621+0000 7f020e6bb700 1 --2- 172.21.15.40:0/1218505465 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f020806f070 0x7f020806c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.621+0000 7f020e6bb700 1 -- 172.21.15.40:0/1218505465 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f020806f980 msgr2=0x7f020806ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:15.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.621+0000 7f020e6bb700 1 --2- 172.21.15.40:0/1218505465 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f020806f980 0x7f020806ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.621+0000 7f020e6bb700 1 -- 172.21.15.40:0/1218505465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0200009a70 con 0x7f020806fdb0 2023-09-30T22:29:15.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.621+0000 7f020deba700 1 --2- 172.21.15.40:0/1218505465 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f020806f070 0x7f020806c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:15.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.621+0000 7f020d6b9700 1 --2- 172.21.15.40:0/1218505465 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f020806f980 0x7f020806ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:15.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.621+0000 7f020e6bb700 1 --2- 172.21.15.40:0/1218505465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f020806fdb0 0x7f020806d410 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f020000efc0 tx=0x7f020000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:15.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.621+0000 7f02067fc700 1 -- 172.21.15.40:0/1218505465 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020000ca90 con 0x7f020806fdb0 2023-09-30T22:29:15.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.621+0000 7f02067fc700 1 -- 172.21.15.40:0/1218505465 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020000f040 con 0x7f020806fdb0 2023-09-30T22:29:15.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.621+0000 7f02067fc700 1 -- 172.21.15.40:0/1218505465 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020000ce30 con 0x7f020806fdb0 2023-09-30T22:29:15.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.621+0000 7f021011e700 1 -- 172.21.15.40:0/1218505465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f8009550 con 0x7f020806fdb0 2023-09-30T22:29:15.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.621+0000 7f021011e700 1 -- 172.21.15.40:0/1218505465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0208132010 con 0x7f020806fdb0 2023-09-30T22:29:15.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.622+0000 7f021011e700 1 -- 172.21.15.40:0/1218505465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0208062380 con 0x7f020806fdb0 2023-09-30T22:29:15.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.622+0000 7f02067fc700 1 -- 172.21.15.40:0/1218505465 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0200003a20 con 0x7f020806fdb0 2023-09-30T22:29:15.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.622+0000 7f02067fc700 1 -- 172.21.15.40:0/1218505465 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f02000406c0 con 0x7f020806fdb0 2023-09-30T22:29:15.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.627+0000 7f02067fc700 1 -- 172.21.15.40:0/1218505465 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f020001c7c0 con 0x7f020806fdb0 2023-09-30T22:29:15.641 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:15.648 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:15.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.669+0000 7f1096fd6700 1 Processor -- start 2023-09-30T22:29:15.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.669+0000 7f1096fd6700 1 -- start start 2023-09-30T22:29:15.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.670+0000 7f1096fd6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f109012e590 0x7f109012e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:15.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.670+0000 7f1096fd6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f109012d8a0 0x7f1090138c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:15.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.670+0000 7f1096fd6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f109009ab70 con 0x7f109012eea0 2023-09-30T22:29:15.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.670+0000 7f1096fd6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f109009b270 con 0x7f109012e590 2023-09-30T22:29:15.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.670+0000 7f1096fd6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f109009bab0 con 0x7f109012d8a0 2023-09-30T22:29:15.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.670+0000 7f108ffff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f109012eea0 0x7f109012d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52400/0 (socket says 172.21.15.40:52400) 2023-09-30T22:29:15.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.670+0000 7f108ffff700 1 -- 172.21.15.40:0/3438177811 learned_addr learned my addr 172.21.15.40:0/3438177811 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:29:15.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.670+0000 7f1095573700 1 --2- 172.21.15.40:0/3438177811 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f109012d8a0 0x7f1090138c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:15.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.671+0000 7f1095573700 1 -- 172.21.15.40:0/3438177811 >> v2:172.21.15.40:3300/0 conn(0x7f109012e590 msgr2=0x7f109012e960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:29:15.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.671+0000 7f1095573700 1 --2- 172.21.15.40:0/3438177811 >> v2:172.21.15.40:3300/0 conn(0x7f109012e590 0x7f109012e960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.671+0000 7f1095573700 1 -- 172.21.15.40:0/3438177811 >> v1:172.21.15.40:6789/0 conn(0x7f109012eea0 legacy=0x7f109012d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:15.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.671+0000 7f108f7fe700 1 -- 172.21.15.40:0/3438177811 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4055661911 0 0) 0x7f109009ab70 con 0x7f109012eea0 2023-09-30T22:29:15.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.671+0000 7f1095573700 1 -- 172.21.15.40:0/3438177811 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f109009bd70 con 0x7f109012d8a0 2023-09-30T22:29:15.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.671+0000 7f1095573700 1 --2- 172.21.15.40:0/3438177811 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f109012d8a0 0x7f1090138c50 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f1088009d90 tx=0x7f108800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75fa554c34048ee0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:15.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.671+0000 7f108f7fe700 1 -- 172.21.15.40:0/3438177811 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108800e070 con 0x7f109012d8a0 2023-09-30T22:29:15.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.671+0000 7f108f7fe700 1 -- 172.21.15.40:0/3438177811 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108800bbd0 con 0x7f109012d8a0 2023-09-30T22:29:15.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.671+0000 7f108f7fe700 1 -- 172.21.15.40:0/3438177811 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1088012430 con 0x7f109012d8a0 2023-09-30T22:29:15.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.672+0000 7f1096fd6700 1 -- 172.21.15.40:0/3438177811 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f109012d8a0 msgr2=0x7f1090138c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:15.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.672+0000 7f1096fd6700 1 --2- 172.21.15.40:0/3438177811 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f109012d8a0 0x7f1090138c50 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f1088009d90 tx=0x7f108800b330 comp rx=0 tx=0).stop 2023-09-30T22:29:15.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.672+0000 7f1096fd6700 1 -- 172.21.15.40:0/3438177811 shutdown_connections 2023-09-30T22:29:15.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.672+0000 7f1096fd6700 1 --2- 172.21.15.40:0/3438177811 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f109012d8a0 0x7f1090138c50 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.672+0000 7f1096fd6700 1 --2- 172.21.15.40:0/3438177811 >> v2:172.21.15.40:3300/0 conn(0x7f109012e590 0x7f109012e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.672+0000 7f1096fd6700 1 -- 172.21.15.40:0/3438177811 >> 172.21.15.40:0/3438177811 conn(0x7f10900a2a00 msgr2=0x7f10900a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:15.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.672+0000 7f1096fd6700 1 -- 172.21.15.40:0/3438177811 shutdown_connections 2023-09-30T22:29:15.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.672+0000 7f1096fd6700 1 -- 172.21.15.40:0/3438177811 wait complete. 2023-09-30T22:29:15.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.673+0000 7f1096fd6700 1 Processor -- start 2023-09-30T22:29:15.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.673+0000 7f1096fd6700 1 -- start start 2023-09-30T22:29:15.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.673+0000 7f1096fd6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f109012d8a0 0x7f109011dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:15.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.673+0000 7f1096fd6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f109012e590 0x7f109011e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:15.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.674+0000 7f1096fd6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f109012eea0 0x7f109011e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:15.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.674+0000 7f1096fd6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10901217b0 con 0x7f109012eea0 2023-09-30T22:29:15.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.674+0000 7f1096fd6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f109009fe30 con 0x7f109012e590 2023-09-30T22:29:15.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.674+0000 7f1096fd6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f109009b4b0 con 0x7f109012d8a0 2023-09-30T22:29:15.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.674+0000 7f1095573700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f109012eea0 0x7f109011e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:15.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.674+0000 7f1095573700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f109012eea0 0x7f109011e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36460/0 (socket says 172.21.15.40:36460) 2023-09-30T22:29:15.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.674+0000 7f1095573700 1 -- 172.21.15.40:0/3435171719 learned_addr learned my addr 172.21.15.40:0/3435171719 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:15.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.674+0000 7f108ffff700 1 --2- 172.21.15.40:0/3435171719 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f109012e590 0x7f109011e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:15.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.674+0000 7f1095573700 1 -- 172.21.15.40:0/3435171719 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f109012d8a0 msgr2=0x7f109011dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:15.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.674+0000 7f1095573700 1 --2- 172.21.15.40:0/3435171719 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f109012d8a0 0x7f109011dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.674+0000 7f1095573700 1 -- 172.21.15.40:0/3435171719 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f109012e590 msgr2=0x7f109011e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:15.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.674+0000 7f1095573700 1 --2- 172.21.15.40:0/3435171719 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f109012e590 0x7f109011e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.674+0000 7f1095573700 1 -- 172.21.15.40:0/3435171719 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1088009a70 con 0x7f109012eea0 2023-09-30T22:29:15.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.674+0000 7f108ffff700 1 --2- 172.21.15.40:0/3435171719 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f109012e590 0x7f109011e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:15.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.674+0000 7f1095573700 1 --2- 172.21.15.40:0/3435171719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f109012eea0 0x7f109011e760 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f1088014040 tx=0x7f1088004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:15.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.674+0000 7f108d7fa700 1 -- 172.21.15.40:0/3435171719 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1088012430 con 0x7f109012eea0 2023-09-30T22:29:15.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.675+0000 7f108d7fa700 1 -- 172.21.15.40:0/3435171719 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1088020070 con 0x7f109012eea0 2023-09-30T22:29:15.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.675+0000 7f108d7fa700 1 -- 172.21.15.40:0/3435171719 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1088004260 con 0x7f109012eea0 2023-09-30T22:29:15.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.675+0000 7f1096fd6700 1 -- 172.21.15.40:0/3435171719 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1090120af0 con 0x7f109012eea0 2023-09-30T22:29:15.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.675+0000 7f1096fd6700 1 -- 172.21.15.40:0/3435171719 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1090121f40 con 0x7f109012eea0 2023-09-30T22:29:15.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.676+0000 7f108d7fa700 1 -- 172.21.15.40:0/3435171719 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f10880043c0 con 0x7f109012eea0 2023-09-30T22:29:15.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.676+0000 7f108d7fa700 1 -- 172.21.15.40:0/3435171719 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f1088022070 con 0x7f109012eea0 2023-09-30T22:29:15.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.677+0000 7f1096fd6700 1 -- 172.21.15.40:0/3435171719 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f109006edb0 con 0x7f109012eea0 2023-09-30T22:29:15.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.681+0000 7f108d7fa700 1 -- 172.21.15.40:0/3435171719 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f108801b400 con 0x7f109012eea0 2023-09-30T22:29:15.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.799+0000 7f5a00545700 1 Processor -- start 2023-09-30T22:29:15.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.799+0000 7ff8656b9700 1 Processor -- start 2023-09-30T22:29:15.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.799+0000 7f5a00545700 1 -- start start 2023-09-30T22:29:15.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.799+0000 7ff8656b9700 1 -- start start 2023-09-30T22:29:15.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.799+0000 7f5a00545700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59f809e400 0x7f59f8135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:15.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.799+0000 7f5a00545700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f59f8136230 0x7f59f8138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:15.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.799+0000 7f5a00545700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59f809adf0 con 0x7f59f809d920 2023-09-30T22:29:15.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.799+0000 7f5a00545700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f809e7f0 con 0x7f59f809e400 2023-09-30T22:29:15.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.799+0000 7f5a00545700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59f809edf0 con 0x7f59f8136230 2023-09-30T22:29:15.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.799+0000 7f59feae2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f59f8136230 0x7f59f8138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:15.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.800+0000 7f59feae2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f59f8136230 0x7f59f8138610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:35108/0 (socket says 172.21.15.40:35108) 2023-09-30T22:29:15.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.800+0000 7f59feae2700 1 -- 172.21.15.40:0/1926589525 learned_addr learned my addr 172.21.15.40:0/1926589525 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:15.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.800+0000 7ff8656b9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff860133e00 0x7ff8601341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:15.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.800+0000 7ff8656b9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff86009d400 0x7ff86009d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:15.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.800+0000 7ff8656b9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff86009dd70 0x7ff86013ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:15.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.800+0000 7ff8656b9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff86009ab20 con 0x7ff86009d400 2023-09-30T22:29:15.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.800+0000 7ff8656b9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff860133940 con 0x7ff860133e00 2023-09-30T22:29:15.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.800+0000 7ff8656b9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff86009f0d0 con 0x7ff86009dd70 2023-09-30T22:29:15.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.800+0000 7ff85f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff86009dd70 0x7ff86013ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:15.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.800+0000 7ff85f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff86009dd70 0x7ff86013ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:35118/0 (socket says 172.21.15.40:35118) 2023-09-30T22:29:15.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.800+0000 7ff85f7fe700 1 -- 172.21.15.40:0/3597057658 learned_addr learned my addr 172.21.15.40:0/3597057658 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:15.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.800+0000 7f59feae2700 1 -- 172.21.15.40:0/1926589525 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59f809e400 msgr2=0x7f59f8135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:15.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.800+0000 7f59feae2700 1 --2- 172.21.15.40:0/1926589525 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59f809e400 0x7f59f8135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.800+0000 7f59feae2700 1 -- 172.21.15.40:0/1926589525 >> v1:172.21.15.40:6789/0 conn(0x7f59f809d920 legacy=0x7f59f809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:15.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.800+0000 7f59feae2700 1 -- 172.21.15.40:0/1926589525 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f809b660 con 0x7f59f8136230 2023-09-30T22:29:15.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.800+0000 7ff85f7fe700 1 -- 172.21.15.40:0/3597057658 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff860133e00 msgr2=0x7ff8601341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:15.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.800+0000 7ff85f7fe700 1 --2- 172.21.15.40:0/3597057658 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff860133e00 0x7ff8601341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.800+0000 7ff85f7fe700 1 -- 172.21.15.40:0/3597057658 >> v2:172.21.15.40:3300/0 conn(0x7ff86009d400 msgr2=0x7ff86009d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:15.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.800+0000 7ff85f7fe700 1 --2- 172.21.15.40:0/3597057658 >> v2:172.21.15.40:3300/0 conn(0x7ff86009d400 0x7ff86009d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.800+0000 7ff85f7fe700 1 -- 172.21.15.40:0/3597057658 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff86009e210 con 0x7ff86009dd70 2023-09-30T22:29:15.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.800+0000 7f59feae2700 1 --2- 172.21.15.40:0/1926589525 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f59f8136230 0x7f59f8138610 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f59f000d180 tx=0x7f59f000d490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c7d76604fd8ee74 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:15.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.800+0000 7ff85f7fe700 1 --2- 172.21.15.40:0/3597057658 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff86009dd70 0x7ff86013ac70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ff858009e50 tx=0x7ff85800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5be4a60f9113957c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:15.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.800+0000 7f59fd2df700 1 -- 172.21.15.40:0/1926589525 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f0010070 con 0x7f59f8136230 2023-09-30T22:29:15.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.800+0000 7ff85dffb700 1 -- 172.21.15.40:0/3597057658 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85800e070 con 0x7ff86009dd70 2023-09-30T22:29:15.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.800+0000 7f59fd2df700 1 -- 172.21.15.40:0/1926589525 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f000dd50 con 0x7f59f8136230 2023-09-30T22:29:15.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.800+0000 7f59fd2df700 1 -- 172.21.15.40:0/1926589525 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f000b310 con 0x7f59f8136230 2023-09-30T22:29:15.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.800+0000 7ff85dffb700 1 -- 172.21.15.40:0/3597057658 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85800b9c0 con 0x7ff86009dd70 2023-09-30T22:29:15.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.800+0000 7ff85dffb700 1 -- 172.21.15.40:0/3597057658 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85800bd70 con 0x7ff86009dd70 2023-09-30T22:29:15.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.801+0000 7ff8656b9700 1 -- 172.21.15.40:0/3597057658 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff86009dd70 msgr2=0x7ff86013ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:15.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.801+0000 7ff8656b9700 1 --2- 172.21.15.40:0/3597057658 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff86009dd70 0x7ff86013ac70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ff858009e50 tx=0x7ff85800b330 comp rx=0 tx=0).stop 2023-09-30T22:29:15.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.801+0000 7f5a00545700 1 -- 172.21.15.40:0/1926589525 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f59f8136230 msgr2=0x7f59f8138610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:15.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.801+0000 7f5a00545700 1 --2- 172.21.15.40:0/1926589525 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f59f8136230 0x7f59f8138610 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f59f000d180 tx=0x7f59f000d490 comp rx=0 tx=0).stop 2023-09-30T22:29:15.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.801+0000 7ff8656b9700 1 -- 172.21.15.40:0/3597057658 shutdown_connections 2023-09-30T22:29:15.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.801+0000 7ff8656b9700 1 --2- 172.21.15.40:0/3597057658 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff86009dd70 0x7ff86013ac70 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.801+0000 7ff8656b9700 1 --2- 172.21.15.40:0/3597057658 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff860133e00 0x7ff8601341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.801+0000 7ff8656b9700 1 --2- 172.21.15.40:0/3597057658 >> v2:172.21.15.40:3300/0 conn(0x7ff86009d400 0x7ff86009d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.801+0000 7ff8656b9700 1 -- 172.21.15.40:0/3597057658 >> 172.21.15.40:0/3597057658 conn(0x7ff8600a2a00 msgr2=0x7ff8600a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:15.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.801+0000 7ff8656b9700 1 -- 172.21.15.40:0/3597057658 shutdown_connections 2023-09-30T22:29:15.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.802+0000 7ff8656b9700 1 -- 172.21.15.40:0/3597057658 wait complete. 2023-09-30T22:29:15.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.802+0000 7f5a00545700 1 -- 172.21.15.40:0/1926589525 shutdown_connections 2023-09-30T22:29:15.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.802+0000 7f5a00545700 1 --2- 172.21.15.40:0/1926589525 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f59f8136230 0x7f59f8138610 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.802+0000 7f5a00545700 1 --2- 172.21.15.40:0/1926589525 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59f809e400 0x7f59f8135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.802+0000 7f5a00545700 1 -- 172.21.15.40:0/1926589525 >> 172.21.15.40:0/1926589525 conn(0x7f59f809fb20 msgr2=0x7f59f809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:15.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.802+0000 7f5a00545700 1 -- 172.21.15.40:0/1926589525 shutdown_connections 2023-09-30T22:29:15.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.802+0000 7f5a00545700 1 -- 172.21.15.40:0/1926589525 wait complete. 2023-09-30T22:29:15.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.803+0000 7ff8656b9700 1 Processor -- start 2023-09-30T22:29:15.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.803+0000 7f5a00545700 1 Processor -- start 2023-09-30T22:29:15.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.803+0000 7ff8656b9700 1 -- start start 2023-09-30T22:29:15.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.804+0000 7ff8656b9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff86009d400 0x7ff86011a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:15.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.804+0000 7ff8656b9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff86009dd70 0x7ff86011ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:15.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.804+0000 7ff8656b9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff860133e00 0x7ff86011b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:15.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.804+0000 7ff8656b9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86011de40 con 0x7ff86009d400 2023-09-30T22:29:15.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.804+0000 7ff8656b9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff86011c650 con 0x7ff86009dd70 2023-09-30T22:29:15.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.804+0000 7ff8656b9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff86009c630 con 0x7ff860133e00 2023-09-30T22:29:15.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.804+0000 7ff85f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff860133e00 0x7ff86011b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:15.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.804+0000 7ff85f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff860133e00 0x7ff86011b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:35134/0 (socket says 172.21.15.40:35134) 2023-09-30T22:29:15.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.804+0000 7ff85f7fe700 1 -- 172.21.15.40:0/1154307869 learned_addr learned my addr 172.21.15.40:0/1154307869 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:15.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.804+0000 7ff85e7fc700 1 --2- 172.21.15.40:0/1154307869 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff86009dd70 0x7ff86011ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:15.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.804+0000 7ff85f7fe700 1 -- 172.21.15.40:0/1154307869 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff86009dd70 msgr2=0x7ff86011ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:15.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.804+0000 7ff85f7fe700 1 --2- 172.21.15.40:0/1154307869 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff86009dd70 0x7ff86011ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.804+0000 7ff85f7fe700 1 -- 172.21.15.40:0/1154307869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff86009d400 msgr2=0x7ff86011a8c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:15.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.804+0000 7ff85f7fe700 1 --2- 172.21.15.40:0/1154307869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff86009d400 0x7ff86011a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.804+0000 7ff85f7fe700 1 -- 172.21.15.40:0/1154307869 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff858009b30 con 0x7ff860133e00 2023-09-30T22:29:15.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.804+0000 7f5a00545700 1 -- start start 2023-09-30T22:29:15.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.804+0000 7f5a00545700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f59f809d920 0x7f59f811c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:15.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.804+0000 7f5a00545700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59f809e400 0x7f59f811ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:15.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.804+0000 7f5a00545700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59f8136230 0x7f59f811cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:15.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.804+0000 7f5a00545700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f811d9e0 con 0x7f59f809e400 2023-09-30T22:29:15.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.804+0000 7f5a00545700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f811f270 con 0x7f59f8136230 2023-09-30T22:29:15.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.804+0000 7f5a00545700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59f811e250 con 0x7f59f809d920 2023-09-30T22:29:15.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.804+0000 7f59fdae0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59f809e400 0x7f59f811ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:15.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.804+0000 7f59fdae0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59f809e400 0x7f59f811ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36492/0 (socket says 172.21.15.40:36492) 2023-09-30T22:29:15.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.804+0000 7f59fdae0700 1 -- 172.21.15.40:0/3094784195 learned_addr learned my addr 172.21.15.40:0/3094784195 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:15.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.805+0000 7ff85e7fc700 1 --2- 172.21.15.40:0/1154307869 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff86009dd70 0x7ff86011ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:15.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.805+0000 7f59fe2e1700 1 --2- 172.21.15.40:0/3094784195 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f59f809d920 0x7f59f811c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:15.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.805+0000 7f59feae2700 1 --2- 172.21.15.40:0/3094784195 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59f8136230 0x7f59f811cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:15.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.805+0000 7f59fdae0700 1 -- 172.21.15.40:0/3094784195 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f59f809d920 msgr2=0x7f59f811c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:15.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.805+0000 7f59fdae0700 1 --2- 172.21.15.40:0/3094784195 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f59f809d920 0x7f59f811c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.805+0000 7f59fdae0700 1 -- 172.21.15.40:0/3094784195 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59f8136230 msgr2=0x7f59f811cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:15.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.805+0000 7f59fdae0700 1 --2- 172.21.15.40:0/3094784195 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59f8136230 0x7f59f811cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.805+0000 7f59fdae0700 1 -- 172.21.15.40:0/3094784195 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f000bd40 con 0x7f59f809e400 2023-09-30T22:29:15.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.805+0000 7f59feae2700 1 --2- 172.21.15.40:0/3094784195 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59f8136230 0x7f59f811cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:29:15.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.805+0000 7f59fdae0700 1 --2- 172.21.15.40:0/3094784195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59f809e400 0x7f59f811ca70 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f59e800b560 tx=0x7f59e800b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:15.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.805+0000 7ff85f7fe700 1 --2- 172.21.15.40:0/1154307869 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff860133e00 0x7ff86011b340 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff86009f210 tx=0x7ff858004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:15.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.805+0000 7f59eeffd700 1 -- 172.21.15.40:0/3094784195 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e8011830 con 0x7f59f809e400 2023-09-30T22:29:15.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.805+0000 7f59eeffd700 1 -- 172.21.15.40:0/3094784195 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e8011990 con 0x7f59f809e400 2023-09-30T22:29:15.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.805+0000 7f59eeffd700 1 -- 172.21.15.40:0/3094784195 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e8011d40 con 0x7f59f809e400 2023-09-30T22:29:15.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.805+0000 7f5a00545700 1 -- 172.21.15.40:0/3094784195 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59f809cb00 con 0x7f59f809e400 2023-09-30T22:29:15.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.805+0000 7f5a00545700 1 -- 172.21.15.40:0/3094784195 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59f81cc880 con 0x7f59f809e400 2023-09-30T22:29:15.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.805+0000 7ff8477fe700 1 -- 172.21.15.40:0/1154307869 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff858004390 con 0x7ff860133e00 2023-09-30T22:29:15.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.805+0000 7ff8477fe700 1 -- 172.21.15.40:0/1154307869 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff858004510 con 0x7ff860133e00 2023-09-30T22:29:15.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.805+0000 7ff8477fe700 1 -- 172.21.15.40:0/1154307869 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8580048c0 con 0x7ff860133e00 2023-09-30T22:29:15.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.805+0000 7ff8656b9700 1 -- 172.21.15.40:0/1154307869 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff86012e1c0 con 0x7ff860133e00 2023-09-30T22:29:15.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.806+0000 7ff8656b9700 1 -- 172.21.15.40:0/1154307869 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff86011d720 con 0x7ff860133e00 2023-09-30T22:29:15.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.806+0000 7f5a00545700 1 -- 172.21.15.40:0/3094784195 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59f811fa10 con 0x7f59f809e400 2023-09-30T22:29:15.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.807+0000 7ff8477fe700 1 -- 172.21.15.40:0/1154307869 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff85801c440 con 0x7ff860133e00 2023-09-30T22:29:15.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.807+0000 7ff8477fe700 1 -- 172.21.15.40:0/1154307869 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff858041160 con 0x7ff860133e00 2023-09-30T22:29:15.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.807+0000 7ff8656b9700 1 -- 172.21.15.40:0/1154307869 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff860062380 con 0x7ff860133e00 2023-09-30T22:29:15.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.807+0000 7f59eeffd700 1 -- 172.21.15.40:0/3094784195 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f59e801a400 con 0x7f59f809e400 2023-09-30T22:29:15.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.807+0000 7f59eeffd700 1 -- 172.21.15.40:0/3094784195 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f59e803fd20 con 0x7f59f809e400 2023-09-30T22:29:15.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.812+0000 7f59eeffd700 1 -- 172.21.15.40:0/3094784195 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f59e8022ce0 con 0x7f59f809e400 2023-09-30T22:29:15.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.816+0000 7ff8477fe700 1 -- 172.21.15.40:0/1154307869 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff858011980 con 0x7ff860133e00 2023-09-30T22:29:15.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.834+0000 7f021011e700 1 -- 172.21.15.40:0/1218505465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0208074620 con 0x7f020806fdb0 2023-09-30T22:29:15.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.834+0000 7f02067fc700 1 -- 172.21.15.40:0/1218505465 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f020002b090 con 0x7f020806fdb0 2023-09-30T22:29:15.835 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:15.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.837+0000 7f021011e700 1 -- 172.21.15.40:0/1218505465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f020806fdb0 msgr2=0x7f020806d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:15.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.837+0000 7f021011e700 1 --2- 172.21.15.40:0/1218505465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f020806fdb0 0x7f020806d410 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f020000efc0 tx=0x7f020000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.837+0000 7f021011e700 1 -- 172.21.15.40:0/1218505465 shutdown_connections 2023-09-30T22:29:15.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.837+0000 7f021011e700 1 --2- 172.21.15.40:0/1218505465 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f020806f070 0x7f020806c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.837+0000 7f021011e700 1 --2- 172.21.15.40:0/1218505465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f020806fdb0 0x7f020806d410 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.837+0000 7f021011e700 1 --2- 172.21.15.40:0/1218505465 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f020806f980 0x7f020806ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.837+0000 7f021011e700 1 -- 172.21.15.40:0/1218505465 >> 172.21.15.40:0/1218505465 conn(0x7f02080a41a0 msgr2=0x7f02080974a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:15.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.838+0000 7f021011e700 1 -- 172.21.15.40:0/1218505465 shutdown_connections 2023-09-30T22:29:15.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.838+0000 7f021011e700 1 -- 172.21.15.40:0/1218505465 wait complete. 2023-09-30T22:29:15.856 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:15.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.923+0000 7f1096fd6700 1 -- 172.21.15.40:0/3435171719 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1090062380 con 0x7f109012eea0 2023-09-30T22:29:15.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.924+0000 7f108d7fa700 1 -- 172.21.15.40:0/3435171719 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f108802c030 con 0x7f109012eea0 2023-09-30T22:29:15.925 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:15.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.926+0000 7f1096fd6700 1 -- 172.21.15.40:0/3435171719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f109012eea0 msgr2=0x7f109011e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:15.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.926+0000 7f1096fd6700 1 --2- 172.21.15.40:0/3435171719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f109012eea0 0x7f109011e760 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f1088014040 tx=0x7f1088004ad0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.926+0000 7f1096fd6700 1 -- 172.21.15.40:0/3435171719 shutdown_connections 2023-09-30T22:29:15.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.926+0000 7f1096fd6700 1 --2- 172.21.15.40:0/3435171719 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f109012d8a0 0x7f109011dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.926+0000 7f1096fd6700 1 --2- 172.21.15.40:0/3435171719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f109012eea0 0x7f109011e760 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.926+0000 7f1096fd6700 1 --2- 172.21.15.40:0/3435171719 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f109012e590 0x7f109011e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.926+0000 7f1096fd6700 1 -- 172.21.15.40:0/3435171719 >> 172.21.15.40:0/3435171719 conn(0x7f10900a2a00 msgr2=0x7f109012c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:15.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.926+0000 7f1096fd6700 1 -- 172.21.15.40:0/3435171719 shutdown_connections 2023-09-30T22:29:15.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:15.926+0000 7f1096fd6700 1 -- 172.21.15.40:0/3435171719 wait complete. 2023-09-30T22:29:15.939 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:16.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:16.014+0000 7ff8656b9700 1 -- 172.21.15.40:0/1154307869 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff86011dc20 con 0x7ff860133e00 2023-09-30T22:29:16.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:16.014+0000 7ff8477fe700 1 -- 172.21.15.40:0/1154307869 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff858034090 con 0x7ff860133e00 2023-09-30T22:29:16.015 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:16.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:16.016+0000 7ff8656b9700 1 -- 172.21.15.40:0/1154307869 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff860133e00 msgr2=0x7ff86011b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:16.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:16.016+0000 7ff8656b9700 1 --2- 172.21.15.40:0/1154307869 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff860133e00 0x7ff86011b340 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff86009f210 tx=0x7ff858004ad0 comp rx=0 tx=0).stop 2023-09-30T22:29:16.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:16.016+0000 7ff8656b9700 1 -- 172.21.15.40:0/1154307869 shutdown_connections 2023-09-30T22:29:16.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:16.016+0000 7ff8656b9700 1 --2- 172.21.15.40:0/1154307869 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff860133e00 0x7ff86011b340 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:16.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:16.016+0000 7ff8656b9700 1 --2- 172.21.15.40:0/1154307869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff86009d400 0x7ff86011a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:16.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:16.016+0000 7ff8656b9700 1 --2- 172.21.15.40:0/1154307869 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff86009dd70 0x7ff86011ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:16.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:16.016+0000 7ff8656b9700 1 -- 172.21.15.40:0/1154307869 >> 172.21.15.40:0/1154307869 conn(0x7ff8600a2a00 msgr2=0x7ff8601bb2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:16.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:16.016+0000 7ff8656b9700 1 -- 172.21.15.40:0/1154307869 shutdown_connections 2023-09-30T22:29:16.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:16.016+0000 7ff8656b9700 1 -- 172.21.15.40:0/1154307869 wait complete. 2023-09-30T22:29:16.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:16.020+0000 7f5a00545700 1 -- 172.21.15.40:0/3094784195 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f59f811fa10 con 0x7f59f809e400 2023-09-30T22:29:16.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:16.020+0000 7f59eeffd700 1 -- 172.21.15.40:0/3094784195 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f59f811fa10 con 0x7f59f809e400 2023-09-30T22:29:16.021 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:16.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:16.022+0000 7f5a00545700 1 -- 172.21.15.40:0/3094784195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59f809e400 msgr2=0x7f59f811ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:16.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:16.022+0000 7f5a00545700 1 --2- 172.21.15.40:0/3094784195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59f809e400 0x7f59f811ca70 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f59e800b560 tx=0x7f59e800b920 comp rx=0 tx=0).stop 2023-09-30T22:29:16.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:16.022+0000 7f5a00545700 1 -- 172.21.15.40:0/3094784195 shutdown_connections 2023-09-30T22:29:16.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:16.023+0000 7f5a00545700 1 --2- 172.21.15.40:0/3094784195 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f59f809d920 0x7f59f811c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:16.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:16.023+0000 7f5a00545700 1 --2- 172.21.15.40:0/3094784195 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59f8136230 0x7f59f811cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:16.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:16.023+0000 7f5a00545700 1 --2- 172.21.15.40:0/3094784195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59f809e400 0x7f59f811ca70 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:16.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:16.023+0000 7f5a00545700 1 -- 172.21.15.40:0/3094784195 >> 172.21.15.40:0/3094784195 conn(0x7f59f809fb20 msgr2=0x7f59f80a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:16.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:16.023+0000 7f5a00545700 1 -- 172.21.15.40:0/3094784195 shutdown_connections 2023-09-30T22:29:16.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:16.023+0000 7f5a00545700 1 -- 172.21.15.40:0/3094784195 wait complete. 2023-09-30T22:29:16.029 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:16.162 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:16.857 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:16.940 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:17.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.002+0000 7f326820d700 1 Processor -- start 2023-09-30T22:29:17.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.002+0000 7f326820d700 1 -- start start 2023-09-30T22:29:17.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.003+0000 7f326820d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f326006f070 0x7f326006f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:17.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.003+0000 7f326820d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f326006f980 0x7f3260097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:17.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.003+0000 7f326820d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3260070830 con 0x7f326006fdb0 2023-09-30T22:29:17.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.003+0000 7f326820d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3260071af0 con 0x7f326006f980 2023-09-30T22:29:17.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.003+0000 7f326820d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3260070ad0 con 0x7f326006f070 2023-09-30T22:29:17.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.003+0000 7f32657a8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f326006f980 0x7f3260097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:17.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.003+0000 7f3265fa9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f326006f070 0x7f326006f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:17.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.003+0000 7f3265fa9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f326006f070 0x7f326006f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:57778/0 (socket says 172.21.15.40:57778) 2023-09-30T22:29:17.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.003+0000 7f32657a8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f326006f980 0x7f3260097090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36494/0 (socket says 172.21.15.40:36494) 2023-09-30T22:29:17.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.003+0000 7f3265fa9700 1 -- 172.21.15.40:0/3519866461 learned_addr learned my addr 172.21.15.40:0/3519866461 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:17.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.003+0000 7f32657a8700 1 -- 172.21.15.40:0/3519866461 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f326006f070 msgr2=0x7f326006f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:17.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.003+0000 7f32657a8700 1 --2- 172.21.15.40:0/3519866461 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f326006f070 0x7f326006f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:17.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.003+0000 7f32657a8700 1 -- 172.21.15.40:0/3519866461 >> v1:172.21.15.40:6789/0 conn(0x7f326006fdb0 legacy=0x7f32600975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:17.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.003+0000 7f32657a8700 1 -- 172.21.15.40:0/3519866461 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3260070de0 con 0x7f326006f980 2023-09-30T22:29:17.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.003+0000 7f3265fa9700 1 --2- 172.21.15.40:0/3519866461 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f326006f070 0x7f326006f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:17.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.004+0000 7f32657a8700 1 --2- 172.21.15.40:0/3519866461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f326006f980 0x7f3260097090 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f3250009870 tx=0x7f3250009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8af17b75bc23a1d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:17.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.004+0000 7f3264fa7700 1 -- 172.21.15.40:0/3519866461 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3250011830 con 0x7f326006f980 2023-09-30T22:29:17.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.004+0000 7f3264fa7700 1 -- 172.21.15.40:0/3519866461 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3250011990 con 0x7f326006f980 2023-09-30T22:29:17.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.004+0000 7f3264fa7700 1 -- 172.21.15.40:0/3519866461 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3250011d20 con 0x7f326006f980 2023-09-30T22:29:17.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.004+0000 7f326820d700 1 -- 172.21.15.40:0/3519866461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f326006f980 msgr2=0x7f3260097090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:17.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.004+0000 7f326820d700 1 --2- 172.21.15.40:0/3519866461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f326006f980 0x7f3260097090 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f3250009870 tx=0x7f3250009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:17.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.004+0000 7f326820d700 1 -- 172.21.15.40:0/3519866461 shutdown_connections 2023-09-30T22:29:17.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.005+0000 7f326820d700 1 --2- 172.21.15.40:0/3519866461 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f326006f070 0x7f326006f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:17.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.005+0000 7f326820d700 1 --2- 172.21.15.40:0/3519866461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f326006f980 0x7f3260097090 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:17.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.005+0000 7f326820d700 1 -- 172.21.15.40:0/3519866461 >> 172.21.15.40:0/3519866461 conn(0x7f32600a41a0 msgr2=0x7f32600a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:17.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.005+0000 7f326820d700 1 -- 172.21.15.40:0/3519866461 shutdown_connections 2023-09-30T22:29:17.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.005+0000 7f326820d700 1 -- 172.21.15.40:0/3519866461 wait complete. 2023-09-30T22:29:17.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.006+0000 7f326820d700 1 Processor -- start 2023-09-30T22:29:17.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.006+0000 7f326820d700 1 -- start start 2023-09-30T22:29:17.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.007+0000 7f326820d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f326006f070 0x7f326012d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:17.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.007+0000 7f326820d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f326006f980 0x7f326012da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:17.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.007+0000 7f326820d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f326006fdb0 0x7f326012dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:17.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.007+0000 7f326820d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32601306d0 con 0x7f326006fdb0 2023-09-30T22:29:17.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.007+0000 7f326820d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32601308b0 con 0x7f326006f980 2023-09-30T22:29:17.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.007+0000 7f326820d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32601294c0 con 0x7f326006f070 2023-09-30T22:29:17.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.007+0000 7f32657a8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f326006f980 0x7f326012da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:17.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.007+0000 7f32667aa700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f326006fdb0 0x7f326012dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:17.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.007+0000 7f32657a8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f326006f980 0x7f326012da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:57792/0 (socket says 172.21.15.40:57792) 2023-09-30T22:29:17.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.007+0000 7f32657a8700 1 -- 172.21.15.40:0/2845362295 learned_addr learned my addr 172.21.15.40:0/2845362295 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:17.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.007+0000 7f3265fa9700 1 --2- 172.21.15.40:0/2845362295 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f326006f070 0x7f326012d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:17.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.007+0000 7f32667aa700 1 -- 172.21.15.40:0/2845362295 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f326006f070 msgr2=0x7f326012d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:17.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.007+0000 7f32667aa700 1 --2- 172.21.15.40:0/2845362295 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f326006f070 0x7f326012d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:17.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.007+0000 7f32667aa700 1 -- 172.21.15.40:0/2845362295 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f326006f980 msgr2=0x7f326012da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:17.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.007+0000 7f32667aa700 1 --2- 172.21.15.40:0/2845362295 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f326006f980 0x7f326012da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:17.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.007+0000 7f32667aa700 1 -- 172.21.15.40:0/2845362295 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f325c009550 con 0x7f326006fdb0 2023-09-30T22:29:17.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.007+0000 7f32657a8700 1 --2- 172.21.15.40:0/2845362295 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f326006f980 0x7f326012da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:17.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.007+0000 7f32667aa700 1 --2- 172.21.15.40:0/2845362295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f326006fdb0 0x7f326012dfb0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f3260070250 tx=0x7f3258010330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:17.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.008+0000 7f32567fc700 1 -- 172.21.15.40:0/2845362295 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3258013070 con 0x7f326006fdb0 2023-09-30T22:29:17.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.008+0000 7f32567fc700 1 -- 172.21.15.40:0/2845362295 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325800e2e0 con 0x7f326006fdb0 2023-09-30T22:29:17.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.008+0000 7f326820d700 1 -- 172.21.15.40:0/2845362295 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32500094a0 con 0x7f326006fdb0 2023-09-30T22:29:17.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.008+0000 7f32567fc700 1 -- 172.21.15.40:0/2845362295 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3258003c20 con 0x7f326006fdb0 2023-09-30T22:29:17.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.008+0000 7f326820d700 1 -- 172.21.15.40:0/2845362295 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f326012f160 con 0x7f326006fdb0 2023-09-30T22:29:17.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.008+0000 7f32567fc700 1 -- 172.21.15.40:0/2845362295 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3258010970 con 0x7f326006fdb0 2023-09-30T22:29:17.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.009+0000 7f326820d700 1 -- 172.21.15.40:0/2845362295 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3260062380 con 0x7f326006fdb0 2023-09-30T22:29:17.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.009+0000 7f32567fc700 1 -- 172.21.15.40:0/2845362295 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3258043470 con 0x7f326006fdb0 2023-09-30T22:29:17.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.017+0000 7f32567fc700 1 -- 172.21.15.40:0/2845362295 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f32580207b0 con 0x7f326006fdb0 2023-09-30T22:29:17.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.078+0000 7f7c80d1c700 1 Processor -- start 2023-09-30T22:29:17.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.078+0000 7f7c80d1c700 1 -- start start 2023-09-30T22:29:17.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.079+0000 7f7c80d1c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7c7c09d920 0x7f7c7c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:17.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.079+0000 7f7c80d1c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7c7c130fb0 0x7f7c7c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:17.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.079+0000 7f7c80d1c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c7c09adf0 con 0x7f7c7c09e230 2023-09-30T22:29:17.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.079+0000 7f7c80d1c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c7c09edf0 con 0x7f7c7c09d920 2023-09-30T22:29:17.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.079+0000 7f7c80d1c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c09b660 con 0x7f7c7c130fb0 2023-09-30T22:29:17.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.079+0000 7f7c7a59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7c7c09d920 0x7f7c7c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:17.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.079+0000 7f7c7ad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7c7c130fb0 0x7f7c7c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:17.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.079+0000 7f7c7a59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7c7c09d920 0x7f7c7c09dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36518/0 (socket says 172.21.15.40:36518) 2023-09-30T22:29:17.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.079+0000 7f7c7a59c700 1 -- 172.21.15.40:0/431648664 learned_addr learned my addr 172.21.15.40:0/431648664 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:17.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.079+0000 7f7c7ad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7c7c130fb0 0x7f7c7c138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:35148/0 (socket says 172.21.15.40:35148) 2023-09-30T22:29:17.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.079+0000 7f7c79d9b700 1 --1- 172.21.15.40:0/431648664 >> v1:172.21.15.40:6789/0 conn(0x7f7c7c09e230 0x7f7c7c1308a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52434/0 (socket says 172.21.15.40:52434) 2023-09-30T22:29:17.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.080+0000 7f7c7ad9d700 1 -- 172.21.15.40:0/431648664 >> v2:172.21.15.40:3300/0 conn(0x7f7c7c09d920 msgr2=0x7f7c7c09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:17.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.080+0000 7f7c7ad9d700 1 --2- 172.21.15.40:0/431648664 >> v2:172.21.15.40:3300/0 conn(0x7f7c7c09d920 0x7f7c7c09dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:17.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.080+0000 7f7c7ad9d700 1 -- 172.21.15.40:0/431648664 >> v1:172.21.15.40:6789/0 conn(0x7f7c7c09e230 legacy=0x7f7c7c1308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:17.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.080+0000 7f7c7ad9d700 1 -- 172.21.15.40:0/431648664 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7c09a6e0 con 0x7f7c7c130fb0 2023-09-30T22:29:17.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.080+0000 7f7c7a59c700 1 --2- 172.21.15.40:0/431648664 >> v2:172.21.15.40:3300/0 conn(0x7f7c7c09d920 0x7f7c7c09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:17.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.080+0000 7f7c7ad9d700 1 --2- 172.21.15.40:0/431648664 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7c7c130fb0 0x7f7c7c138d10 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f7c7400bfa0 tx=0x7f7c7400d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abad8b34ee69199c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:17.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.080+0000 7f7c7959a700 1 -- 172.21.15.40:0/431648664 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c74010070 con 0x7f7c7c130fb0 2023-09-30T22:29:17.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.080+0000 7f7c7959a700 1 -- 172.21.15.40:0/431648664 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7400b2e0 con 0x7f7c7c130fb0 2023-09-30T22:29:17.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.080+0000 7f7c7959a700 1 -- 172.21.15.40:0/431648664 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7400dc40 con 0x7f7c7c130fb0 2023-09-30T22:29:17.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.080+0000 7f7c80d1c700 1 -- 172.21.15.40:0/431648664 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7c7c130fb0 msgr2=0x7f7c7c138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:17.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.080+0000 7f7c80d1c700 1 --2- 172.21.15.40:0/431648664 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7c7c130fb0 0x7f7c7c138d10 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f7c7400bfa0 tx=0x7f7c7400d330 comp rx=0 tx=0).stop 2023-09-30T22:29:17.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.081+0000 7f7c80d1c700 1 -- 172.21.15.40:0/431648664 shutdown_connections 2023-09-30T22:29:17.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.081+0000 7f7c80d1c700 1 --2- 172.21.15.40:0/431648664 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7c7c130fb0 0x7f7c7c138d10 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:17.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.081+0000 7f7c80d1c700 1 --2- 172.21.15.40:0/431648664 >> v2:172.21.15.40:3300/0 conn(0x7f7c7c09d920 0x7f7c7c09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:17.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.081+0000 7f7c80d1c700 1 -- 172.21.15.40:0/431648664 >> 172.21.15.40:0/431648664 conn(0x7f7c7c09fb20 msgr2=0x7f7c7c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:17.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.081+0000 7f7c80d1c700 1 -- 172.21.15.40:0/431648664 shutdown_connections 2023-09-30T22:29:17.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.081+0000 7f7c80d1c700 1 -- 172.21.15.40:0/431648664 wait complete. 2023-09-30T22:29:17.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.082+0000 7f7c80d1c700 1 Processor -- start 2023-09-30T22:29:17.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.082+0000 7f7c80d1c700 1 -- start start 2023-09-30T22:29:17.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.082+0000 7f7c80d1c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c7c09d920 0x7f7c7c11cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:17.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.082+0000 7f7c80d1c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c7c09e230 0x7f7c7c11d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:17.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.082+0000 7f7c80d1c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7c7c130fb0 0x7f7c7c11da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:17.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.082+0000 7f7c80d1c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c11f1e0 con 0x7f7c7c09e230 2023-09-30T22:29:17.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.082+0000 7f7c80d1c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c121460 con 0x7f7c7c09d920 2023-09-30T22:29:17.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.082+0000 7f7c80d1c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c120aa0 con 0x7f7c7c130fb0 2023-09-30T22:29:17.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.082+0000 7f7c79d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c7c09e230 0x7f7c7c11d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:17.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.082+0000 7f7c7ad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7c7c130fb0 0x7f7c7c11da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:17.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.082+0000 7f7c79d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c7c09e230 0x7f7c7c11d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36522/0 (socket says 172.21.15.40:36522) 2023-09-30T22:29:17.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.082+0000 7f7c79d9b700 1 -- 172.21.15.40:0/2177347527 learned_addr learned my addr 172.21.15.40:0/2177347527 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:17.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.083+0000 7f7c7a59c700 1 --2- 172.21.15.40:0/2177347527 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c7c09d920 0x7f7c7c11cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:17.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.083+0000 7f7c79d9b700 1 -- 172.21.15.40:0/2177347527 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7c7c130fb0 msgr2=0x7f7c7c11da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:17.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.083+0000 7f7c79d9b700 1 --2- 172.21.15.40:0/2177347527 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7c7c130fb0 0x7f7c7c11da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:17.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.083+0000 7f7c79d9b700 1 -- 172.21.15.40:0/2177347527 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c7c09d920 msgr2=0x7f7c7c11cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:17.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.083+0000 7f7c79d9b700 1 --2- 172.21.15.40:0/2177347527 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c7c09d920 0x7f7c7c11cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:17.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.083+0000 7f7c79d9b700 1 -- 172.21.15.40:0/2177347527 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6c009500 con 0x7f7c7c09e230 2023-09-30T22:29:17.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.083+0000 7f7c7ad9d700 1 --2- 172.21.15.40:0/2177347527 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7c7c130fb0 0x7f7c7c11da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:17.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.083+0000 7f7c79d9b700 1 --2- 172.21.15.40:0/2177347527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c7c09e230 0x7f7c7c11d510 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f7c7000c580 tx=0x7f7c7000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:17.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.083+0000 7f7c6affd700 1 -- 172.21.15.40:0/2177347527 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c70005cb0 con 0x7f7c7c09e230 2023-09-30T22:29:17.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.083+0000 7f7c6affd700 1 -- 172.21.15.40:0/2177347527 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c70005e10 con 0x7f7c7c09e230 2023-09-30T22:29:17.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.083+0000 7f7c6affd700 1 -- 172.21.15.40:0/2177347527 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c700072d0 con 0x7f7c7c09e230 2023-09-30T22:29:17.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.083+0000 7f7c80d1c700 1 -- 172.21.15.40:0/2177347527 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c7400bc80 con 0x7f7c7c09e230 2023-09-30T22:29:17.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.083+0000 7f7c80d1c700 1 -- 172.21.15.40:0/2177347527 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7c09cb00 con 0x7f7c7c09e230 2023-09-30T22:29:17.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.084+0000 7f7c6affd700 1 -- 172.21.15.40:0/2177347527 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7c70007430 con 0x7f7c7c09e230 2023-09-30T22:29:17.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.084+0000 7f7c6affd700 1 -- 172.21.15.40:0/2177347527 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f7c7003ea60 con 0x7f7c7c09e230 2023-09-30T22:29:17.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.084+0000 7f7c80d1c700 1 -- 172.21.15.40:0/2177347527 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c7c062380 con 0x7f7c7c09e230 2023-09-30T22:29:17.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.089+0000 7f7c6affd700 1 -- 172.21.15.40:0/2177347527 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7c70017030 con 0x7f7c7c09e230 2023-09-30T22:29:17.162 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:17.162 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:17.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.219+0000 7f326820d700 1 -- 172.21.15.40:0/2845362295 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3260074620 con 0x7f326006fdb0 2023-09-30T22:29:17.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.220+0000 7f32567fc700 1 -- 172.21.15.40:0/2845362295 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f32580173e0 con 0x7f326006fdb0 2023-09-30T22:29:17.221 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:17.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.222+0000 7f326820d700 1 -- 172.21.15.40:0/2845362295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f326006fdb0 msgr2=0x7f326012dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:17.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.222+0000 7f326820d700 1 --2- 172.21.15.40:0/2845362295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f326006fdb0 0x7f326012dfb0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f3260070250 tx=0x7f3258010330 comp rx=0 tx=0).stop 2023-09-30T22:29:17.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.222+0000 7f326820d700 1 -- 172.21.15.40:0/2845362295 shutdown_connections 2023-09-30T22:29:17.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.222+0000 7f326820d700 1 --2- 172.21.15.40:0/2845362295 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f326006f070 0x7f326012d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:17.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.222+0000 7f326820d700 1 --2- 172.21.15.40:0/2845362295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f326006fdb0 0x7f326012dfb0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:17.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.222+0000 7f326820d700 1 --2- 172.21.15.40:0/2845362295 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f326006f980 0x7f326012da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:17.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.222+0000 7f326820d700 1 -- 172.21.15.40:0/2845362295 >> 172.21.15.40:0/2845362295 conn(0x7f32600a41a0 msgr2=0x7f32600a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:17.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.222+0000 7f326820d700 1 -- 172.21.15.40:0/2845362295 shutdown_connections 2023-09-30T22:29:17.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.222+0000 7f326820d700 1 -- 172.21.15.40:0/2845362295 wait complete. 2023-09-30T22:29:17.236 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:17.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.291+0000 7f7c80d1c700 1 -- 172.21.15.40:0/2177347527 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7c7c11eb90 con 0x7f7c7c09e230 2023-09-30T22:29:17.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.291+0000 7f7c6affd700 1 -- 172.21.15.40:0/2177347527 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7c7001b3b0 con 0x7f7c7c09e230 2023-09-30T22:29:17.292 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:17.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.293+0000 7f7c80d1c700 1 -- 172.21.15.40:0/2177347527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c7c09e230 msgr2=0x7f7c7c11d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:17.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.293+0000 7f7c80d1c700 1 --2- 172.21.15.40:0/2177347527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c7c09e230 0x7f7c7c11d510 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f7c7000c580 tx=0x7f7c7000c890 comp rx=0 tx=0).stop 2023-09-30T22:29:17.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.293+0000 7f7c80d1c700 1 -- 172.21.15.40:0/2177347527 shutdown_connections 2023-09-30T22:29:17.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.293+0000 7f7c80d1c700 1 --2- 172.21.15.40:0/2177347527 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7c7c130fb0 0x7f7c7c11da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:17.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.293+0000 7f7c80d1c700 1 --2- 172.21.15.40:0/2177347527 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c7c09d920 0x7f7c7c11cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:17.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.293+0000 7f7c80d1c700 1 --2- 172.21.15.40:0/2177347527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c7c09e230 0x7f7c7c11d510 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:17.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.293+0000 7f7c80d1c700 1 -- 172.21.15.40:0/2177347527 >> 172.21.15.40:0/2177347527 conn(0x7f7c7c09fb20 msgr2=0x7f7c7c12fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:17.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.293+0000 7f7c80d1c700 1 -- 172.21.15.40:0/2177347527 shutdown_connections 2023-09-30T22:29:17.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.293+0000 7f7c80d1c700 1 -- 172.21.15.40:0/2177347527 wait complete. 2023-09-30T22:29:17.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.302+0000 7fe5c04ad700 1 Processor -- start 2023-09-30T22:29:17.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.302+0000 7fe5c04ad700 1 -- start start 2023-09-30T22:29:17.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.302+0000 7f394e6bf700 1 Processor -- start 2023-09-30T22:29:17.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.302+0000 7f394e6bf700 1 -- start start 2023-09-30T22:29:17.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.303+0000 7fe5c04ad700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5b806b1b0 0x7fe5b8136b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:17.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.303+0000 7fe5c04ad700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe5b81370a0 0x7fe5b8139480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:17.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.303+0000 7f394e6bf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f394809d920 0x7f394809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:17.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.303+0000 7f394e6bf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f394809e230 0x7f39481308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:17.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.303+0000 7f394e6bf700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f394809adf0 con 0x7f3948130de0 2023-09-30T22:29:17.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.303+0000 7f394e6bf700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f394809edf0 con 0x7f394809d920 2023-09-30T22:29:17.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.303+0000 7f394e6bf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394809b660 con 0x7f394809e230 2023-09-30T22:29:17.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.303+0000 7fe5c04ad700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5b809eb60 con 0x7fe5b806a6d0 2023-09-30T22:29:17.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.303+0000 7fe5c04ad700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b809db70 con 0x7fe5b806b1b0 2023-09-30T22:29:17.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.303+0000 7fe5c04ad700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b809ddf0 con 0x7fe5b81370a0 2023-09-30T22:29:17.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.303+0000 7fe5be249700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe5b806a6d0 0x7fe5b806aaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52446/0 (socket says 172.21.15.40:52446) 2023-09-30T22:29:17.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.303+0000 7fe5be249700 1 -- 172.21.15.40:0/3674084854 learned_addr learned my addr 172.21.15.40:0/3674084854 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:29:17.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.303+0000 7fe5bea4a700 1 --2- 172.21.15.40:0/3674084854 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe5b81370a0 0x7fe5b8139480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:17.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.303+0000 7f3947fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f394809d920 0x7f394809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:17.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.303+0000 7f394cc5c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3948130de0 0x7f3948137d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52462/0 (socket says 172.21.15.40:52462) 2023-09-30T22:29:17.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.303+0000 7f394cc5c700 1 -- 172.21.15.40:0/832849065 learned_addr learned my addr 172.21.15.40:0/832849065 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:29:17.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.303+0000 7f39477fe700 1 --2- 172.21.15.40:0/832849065 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f394809e230 0x7f39481308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:17.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.303+0000 7fe5bda48700 1 --2- 172.21.15.40:0/3674084854 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5b806b1b0 0x7fe5b8136b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:17.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.304+0000 7fe5bea4a700 1 -- 172.21.15.40:0/3674084854 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5b806b1b0 msgr2=0x7fe5b8136b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:17.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.304+0000 7fe5bea4a700 1 --2- 172.21.15.40:0/3674084854 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5b806b1b0 0x7fe5b8136b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:17.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.304+0000 7fe5bea4a700 1 -- 172.21.15.40:0/3674084854 >> v1:172.21.15.40:6789/0 conn(0x7fe5b806a6d0 legacy=0x7fe5b806aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:17.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.304+0000 7fe5bea4a700 1 -- 172.21.15.40:0/3674084854 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b809c9a0 con 0x7fe5b81370a0 2023-09-30T22:29:17.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.304+0000 7fe5bd247700 1 -- 172.21.15.40:0/3674084854 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1488077704 0 0) 0x7fe5b809eb60 con 0x7fe5b806a6d0 2023-09-30T22:29:17.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.304+0000 7fe5bda48700 1 --2- 172.21.15.40:0/3674084854 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5b806b1b0 0x7fe5b8136b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:17.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.304+0000 7f39477fe700 1 -- 172.21.15.40:0/832849065 >> v2:172.21.15.40:3300/0 conn(0x7f394809d920 msgr2=0x7f394809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:17.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.304+0000 7f39477fe700 1 --2- 172.21.15.40:0/832849065 >> v2:172.21.15.40:3300/0 conn(0x7f394809d920 0x7f394809dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:17.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.304+0000 7f39477fe700 1 -- 172.21.15.40:0/832849065 >> v1:172.21.15.40:6789/0 conn(0x7f3948130de0 legacy=0x7f3948137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:17.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.304+0000 7f39477fe700 1 -- 172.21.15.40:0/832849065 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394809a6e0 con 0x7f394809e230 2023-09-30T22:29:17.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.304+0000 7f3947fff700 1 --2- 172.21.15.40:0/832849065 >> v2:172.21.15.40:3300/0 conn(0x7f394809d920 0x7f394809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:17.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.304+0000 7fe5bea4a700 1 --2- 172.21.15.40:0/3674084854 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe5b81370a0 0x7fe5b8139480 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0009dc0 tx=0x7fe5b000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3f5f33c6094115e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:17.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.304+0000 7fe5bd247700 1 -- 172.21.15.40:0/3674084854 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b000e070 con 0x7fe5b81370a0 2023-09-30T22:29:17.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.304+0000 7fe5bd247700 1 -- 172.21.15.40:0/3674084854 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b000bbd0 con 0x7fe5b81370a0 2023-09-30T22:29:17.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.304+0000 7f39477fe700 1 --2- 172.21.15.40:0/832849065 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f394809e230 0x7f39481308a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f393c009840 tx=0x7f393c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b6c659fc5585929 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:17.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.304+0000 7fe5bd247700 1 -- 172.21.15.40:0/3674084854 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b0012430 con 0x7fe5b81370a0 2023-09-30T22:29:17.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.304+0000 7f3946ffd700 1 -- 172.21.15.40:0/832849065 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c00f8a0 con 0x7f394809e230 2023-09-30T22:29:17.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.304+0000 7f3946ffd700 1 -- 172.21.15.40:0/832849065 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393c00fa00 con 0x7f394809e230 2023-09-30T22:29:17.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.304+0000 7f3946ffd700 1 -- 172.21.15.40:0/832849065 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c00fd90 con 0x7f394809e230 2023-09-30T22:29:17.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.305+0000 7fe5c04ad700 1 -- 172.21.15.40:0/3674084854 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe5b81370a0 msgr2=0x7fe5b8139480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:17.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.305+0000 7fe5c04ad700 1 --2- 172.21.15.40:0/3674084854 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe5b81370a0 0x7fe5b8139480 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0009dc0 tx=0x7fe5b000b330 comp rx=0 tx=0).stop 2023-09-30T22:29:17.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.305+0000 7fe5c04ad700 1 -- 172.21.15.40:0/3674084854 shutdown_connections 2023-09-30T22:29:17.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.305+0000 7fe5c04ad700 1 --2- 172.21.15.40:0/3674084854 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe5b81370a0 0x7fe5b8139480 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:17.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.305+0000 7fe5c04ad700 1 --2- 172.21.15.40:0/3674084854 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5b806b1b0 0x7fe5b8136b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:17.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.305+0000 7fe5c04ad700 1 -- 172.21.15.40:0/3674084854 >> 172.21.15.40:0/3674084854 conn(0x7fe5b809fb20 msgr2=0x7fe5b809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:17.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.305+0000 7fe5c04ad700 1 -- 172.21.15.40:0/3674084854 shutdown_connections 2023-09-30T22:29:17.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.305+0000 7fe5c04ad700 1 -- 172.21.15.40:0/3674084854 wait complete. 2023-09-30T22:29:17.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.305+0000 7f394e6bf700 1 -- 172.21.15.40:0/832849065 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f394809e230 msgr2=0x7f39481308a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:17.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.305+0000 7f394e6bf700 1 --2- 172.21.15.40:0/832849065 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f394809e230 0x7f39481308a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f393c009840 tx=0x7f393c009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:17.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.305+0000 7f394e6bf700 1 -- 172.21.15.40:0/832849065 shutdown_connections 2023-09-30T22:29:17.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.305+0000 7f394e6bf700 1 --2- 172.21.15.40:0/832849065 >> v2:172.21.15.40:3300/0 conn(0x7f394809d920 0x7f394809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:17.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.305+0000 7f394e6bf700 1 --2- 172.21.15.40:0/832849065 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f394809e230 0x7f39481308a0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:17.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.305+0000 7f394e6bf700 1 -- 172.21.15.40:0/832849065 >> 172.21.15.40:0/832849065 conn(0x7f394809fb20 msgr2=0x7f394809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:17.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.305+0000 7f394e6bf700 1 -- 172.21.15.40:0/832849065 shutdown_connections 2023-09-30T22:29:17.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.305+0000 7f394e6bf700 1 -- 172.21.15.40:0/832849065 wait complete. 2023-09-30T22:29:17.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.306+0000 7fe5c04ad700 1 Processor -- start 2023-09-30T22:29:17.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.306+0000 7fe5c04ad700 1 -- start start 2023-09-30T22:29:17.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.306+0000 7fe5c04ad700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5b806a6d0 0x7fe5b809a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:17.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.306+0000 7fe5c04ad700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe5b806b1b0 0x7fe5b809aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:17.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.307+0000 7fe5c04ad700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5b81370a0 0x7fe5b809afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:17.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.307+0000 7fe5c04ad700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b80715d0 con 0x7fe5b81370a0 2023-09-30T22:29:17.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.307+0000 7fe5c04ad700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b8139300 con 0x7fe5b806a6d0 2023-09-30T22:29:17.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.307+0000 7fe5c04ad700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b8120680 con 0x7fe5b806b1b0 2023-09-30T22:29:17.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.307+0000 7f394e6bf700 1 Processor -- start 2023-09-30T22:29:17.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.307+0000 7fe5be249700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5b806a6d0 0x7fe5b809a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:17.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.307+0000 7fe5bda48700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe5b806b1b0 0x7fe5b809aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:17.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.307+0000 7fe5bda48700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe5b806b1b0 0x7fe5b809aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:35184/0 (socket says 172.21.15.40:35184) 2023-09-30T22:29:17.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.307+0000 7fe5be249700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5b806a6d0 0x7fe5b809a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:57830/0 (socket says 172.21.15.40:57830) 2023-09-30T22:29:17.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.307+0000 7fe5bda48700 1 -- 172.21.15.40:0/1169265723 learned_addr learned my addr 172.21.15.40:0/1169265723 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:17.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.307+0000 7fe5bea4a700 1 --2- 172.21.15.40:0/1169265723 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5b81370a0 0x7fe5b809afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:17.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.307+0000 7fe5bda48700 1 -- 172.21.15.40:0/1169265723 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5b806a6d0 msgr2=0x7fe5b809a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:17.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.307+0000 7fe5bda48700 1 --2- 172.21.15.40:0/1169265723 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5b806a6d0 0x7fe5b809a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:17.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.307+0000 7f394e6bf700 1 -- start start 2023-09-30T22:29:17.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.307+0000 7fe5bda48700 1 -- 172.21.15.40:0/1169265723 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5b81370a0 msgr2=0x7fe5b809afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:17.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.307+0000 7fe5bda48700 1 --2- 172.21.15.40:0/1169265723 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5b81370a0 0x7fe5b809afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:17.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.307+0000 7fe5bda48700 1 -- 172.21.15.40:0/1169265723 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b0009a70 con 0x7fe5b806b1b0 2023-09-30T22:29:17.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.307+0000 7fe5bea4a700 1 --2- 172.21.15.40:0/1169265723 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5b81370a0 0x7fe5b809afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:17.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.307+0000 7fe5bda48700 1 --2- 172.21.15.40:0/1169265723 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe5b806b1b0 0x7fe5b809aa90 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fe5a800e810 tx=0x7fe5a800eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:17.317 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:17.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.307+0000 7fe5aeffd700 1 -- 172.21.15.40:0/1169265723 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8004230 con 0x7fe5b806b1b0 2023-09-30T22:29:17.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.307+0000 7fe5aeffd700 1 -- 172.21.15.40:0/1169265723 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a80043b0 con 0x7fe5b806b1b0 2023-09-30T22:29:17.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.308+0000 7fe5aeffd700 1 -- 172.21.15.40:0/1169265723 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a80038e0 con 0x7fe5b806b1b0 2023-09-30T22:29:17.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.308+0000 7f394e6bf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f394809d920 0x7f3948119730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:17.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.308+0000 7f394e6bf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f394809e230 0x7f3948119c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:17.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.308+0000 7fe5c04ad700 1 -- 172.21.15.40:0/1169265723 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5b809e420 con 0x7fe5b806b1b0 2023-09-30T22:29:17.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.308+0000 7f394e6bf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3948130de0 0x7f394811a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:17.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.308+0000 7f394e6bf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394812e880 con 0x7f394809e230 2023-09-30T22:29:17.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.308+0000 7f394e6bf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394811c9a0 con 0x7f3948130de0 2023-09-30T22:29:17.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.308+0000 7f394e6bf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f394811af30 con 0x7f394809d920 2023-09-30T22:29:17.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.308+0000 7fe5c04ad700 1 -- 172.21.15.40:0/1169265723 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5b811f7d0 con 0x7fe5b806b1b0 2023-09-30T22:29:17.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.308+0000 7f39477fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f394809e230 0x7f3948119c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:17.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.308+0000 7f39477fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f394809e230 0x7f3948119c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36548/0 (socket says 172.21.15.40:36548) 2023-09-30T22:29:17.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.308+0000 7f39477fe700 1 -- 172.21.15.40:0/3891213518 learned_addr learned my addr 172.21.15.40:0/3891213518 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:17.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.308+0000 7f394cc5c700 1 --2- 172.21.15.40:0/3891213518 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3948130de0 0x7f394811a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:17.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.308+0000 7f3947fff700 1 --2- 172.21.15.40:0/3891213518 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f394809d920 0x7f3948119730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:17.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.308+0000 7f39477fe700 1 -- 172.21.15.40:0/3891213518 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f394809d920 msgr2=0x7f3948119730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:17.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.308+0000 7f39477fe700 1 --2- 172.21.15.40:0/3891213518 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f394809d920 0x7f3948119730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:17.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.308+0000 7f39477fe700 1 -- 172.21.15.40:0/3891213518 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3948130de0 msgr2=0x7f394811a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:17.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.308+0000 7f39477fe700 1 --2- 172.21.15.40:0/3891213518 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3948130de0 0x7f394811a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:17.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.308+0000 7f39477fe700 1 -- 172.21.15.40:0/3891213518 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3938009430 con 0x7f394809e230 2023-09-30T22:29:17.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.308+0000 7f39477fe700 1 --2- 172.21.15.40:0/3891213518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f394809e230 0x7f3948119c70 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f393c000c00 tx=0x7f393c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:17.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.308+0000 7f3944ff9700 1 -- 172.21.15.40:0/3891213518 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c0038a0 con 0x7f394809e230 2023-09-30T22:29:17.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.309+0000 7f3944ff9700 1 -- 172.21.15.40:0/3891213518 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393c003a00 con 0x7f394809e230 2023-09-30T22:29:17.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.309+0000 7f394e6bf700 1 -- 172.21.15.40:0/3891213518 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f393c0094a0 con 0x7f394809e230 2023-09-30T22:29:17.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.309+0000 7f3944ff9700 1 -- 172.21.15.40:0/3891213518 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c003d90 con 0x7f394809e230 2023-09-30T22:29:17.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.309+0000 7f394e6bf700 1 -- 172.21.15.40:0/3891213518 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f394811c5b0 con 0x7f394809e230 2023-09-30T22:29:17.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.309+0000 7fe5aeffd700 1 -- 172.21.15.40:0/1169265723 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe5a8003a40 con 0x7fe5b806b1b0 2023-09-30T22:29:17.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.309+0000 7fe5c04ad700 1 -- 172.21.15.40:0/1169265723 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5b809cc20 con 0x7fe5b806b1b0 2023-09-30T22:29:17.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.309+0000 7fe5aeffd700 1 -- 172.21.15.40:0/1169265723 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe5a803f280 con 0x7fe5b806b1b0 2023-09-30T22:29:17.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.309+0000 7f3944ff9700 1 -- 172.21.15.40:0/3891213518 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f393c019400 con 0x7f394809e230 2023-09-30T22:29:17.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.309+0000 7f3944ff9700 1 -- 172.21.15.40:0/3891213518 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f393c040c10 con 0x7f394809e230 2023-09-30T22:29:17.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.310+0000 7f394e6bf700 1 -- 172.21.15.40:0/3891213518 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3948062380 con 0x7f394809e230 2023-09-30T22:29:17.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.314+0000 7fe5aeffd700 1 -- 172.21.15.40:0/1169265723 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe5a8003cf0 con 0x7fe5b806b1b0 2023-09-30T22:29:17.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.315+0000 7f3944ff9700 1 -- 172.21.15.40:0/3891213518 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f393c02a900 con 0x7f394809e230 2023-09-30T22:29:17.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.511+0000 7f394e6bf700 1 -- 172.21.15.40:0/3891213518 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f394811b170 con 0x7f394809e230 2023-09-30T22:29:17.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.511+0000 7fe5c04ad700 1 -- 172.21.15.40:0/1169265723 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe5b8120850 con 0x7fe5b806b1b0 2023-09-30T22:29:17.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.511+0000 7f3944ff9700 1 -- 172.21.15.40:0/3891213518 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f393c02a310 con 0x7f394809e230 2023-09-30T22:29:17.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.512+0000 7fe5aeffd700 1 -- 172.21.15.40:0/1169265723 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe5a8020030 con 0x7fe5b806b1b0 2023-09-30T22:29:17.513 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:17.513 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:17.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.514+0000 7fe5c04ad700 1 -- 172.21.15.40:0/1169265723 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe5b806b1b0 msgr2=0x7fe5b809aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:17.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.514+0000 7fe5c04ad700 1 --2- 172.21.15.40:0/1169265723 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe5b806b1b0 0x7fe5b809aa90 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fe5a800e810 tx=0x7fe5a800eb20 comp rx=0 tx=0).stop 2023-09-30T22:29:17.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.514+0000 7fe5c04ad700 1 -- 172.21.15.40:0/1169265723 shutdown_connections 2023-09-30T22:29:17.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.514+0000 7fe5c04ad700 1 --2- 172.21.15.40:0/1169265723 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5b81370a0 0x7fe5b809afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:17.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.514+0000 7fe5c04ad700 1 --2- 172.21.15.40:0/1169265723 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5b806a6d0 0x7fe5b809a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:17.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.514+0000 7fe5c04ad700 1 --2- 172.21.15.40:0/1169265723 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe5b806b1b0 0x7fe5b809aa90 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:17.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.514+0000 7fe5c04ad700 1 -- 172.21.15.40:0/1169265723 >> 172.21.15.40:0/1169265723 conn(0x7fe5b809fb20 msgr2=0x7fe5b80a2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:17.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.514+0000 7fe5c04ad700 1 -- 172.21.15.40:0/1169265723 shutdown_connections 2023-09-30T22:29:17.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.514+0000 7fe5c04ad700 1 -- 172.21.15.40:0/1169265723 wait complete. 2023-09-30T22:29:17.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.514+0000 7f394e6bf700 1 -- 172.21.15.40:0/3891213518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f394809e230 msgr2=0x7f3948119c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:17.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.514+0000 7f394e6bf700 1 --2- 172.21.15.40:0/3891213518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f394809e230 0x7f3948119c70 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f393c000c00 tx=0x7f393c004750 comp rx=0 tx=0).stop 2023-09-30T22:29:17.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.514+0000 7f394e6bf700 1 -- 172.21.15.40:0/3891213518 shutdown_connections 2023-09-30T22:29:17.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.514+0000 7f394e6bf700 1 --2- 172.21.15.40:0/3891213518 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f394809d920 0x7f3948119730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:17.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.514+0000 7f394e6bf700 1 --2- 172.21.15.40:0/3891213518 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3948130de0 0x7f394811a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:17.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.514+0000 7f394e6bf700 1 --2- 172.21.15.40:0/3891213518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f394809e230 0x7f3948119c70 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:17.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.514+0000 7f394e6bf700 1 -- 172.21.15.40:0/3891213518 >> 172.21.15.40:0/3891213518 conn(0x7f394809fb20 msgr2=0x7f394812ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:17.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.514+0000 7f394e6bf700 1 -- 172.21.15.40:0/3891213518 shutdown_connections 2023-09-30T22:29:17.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:17.514+0000 7f394e6bf700 1 -- 172.21.15.40:0/3891213518 wait complete. 2023-09-30T22:29:17.528 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:17.529 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:18.237 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:18.317 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:18.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.379+0000 7f833340b700 1 Processor -- start 2023-09-30T22:29:18.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.380+0000 7f833340b700 1 -- start start 2023-09-30T22:29:18.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.380+0000 7f833340b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f832c136bf0 0x7f832c138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:18.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.380+0000 7f833340b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f832c139510 0x7f832c13b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:18.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.380+0000 7f833340b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f832c0a2600 con 0x7f832c09c890 2023-09-30T22:29:18.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.380+0000 7f833340b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f832c0a29d0 con 0x7f832c139510 2023-09-30T22:29:18.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.380+0000 7f833340b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f832c09fb40 con 0x7f832c136bf0 2023-09-30T22:29:18.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.380+0000 7f83309a6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f832c136bf0 0x7f832c138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:18.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.380+0000 7f83319a8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f832c139510 0x7f832c13b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:18.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.380+0000 7f83319a8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f832c139510 0x7f832c13b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36562/0 (socket says 172.21.15.40:36562) 2023-09-30T22:29:18.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.380+0000 7f83309a6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f832c136bf0 0x7f832c138fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:35206/0 (socket says 172.21.15.40:35206) 2023-09-30T22:29:18.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.380+0000 7f83319a8700 1 -- 172.21.15.40:0/39139135 learned_addr learned my addr 172.21.15.40:0/39139135 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:18.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.381+0000 7f83319a8700 1 -- 172.21.15.40:0/39139135 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f832c136bf0 msgr2=0x7f832c138fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:18.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.381+0000 7f83319a8700 1 --2- 172.21.15.40:0/39139135 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f832c136bf0 0x7f832c138fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.381+0000 7f83319a8700 1 -- 172.21.15.40:0/39139135 >> v1:172.21.15.40:6789/0 conn(0x7f832c09c890 legacy=0x7f832c09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:18.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.381+0000 7f83319a8700 1 -- 172.21.15.40:0/39139135 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832c09d370 con 0x7f832c139510 2023-09-30T22:29:18.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.381+0000 7f83309a6700 1 --2- 172.21.15.40:0/39139135 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f832c136bf0 0x7f832c138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:18.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.381+0000 7f83319a8700 1 --2- 172.21.15.40:0/39139135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f832c139510 0x7f832c13b8f0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f8324009e50 tx=0x7f832400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9d944d72724fff server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:18.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.381+0000 7f8323fff700 1 -- 172.21.15.40:0/39139135 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832400e070 con 0x7f832c139510 2023-09-30T22:29:18.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.381+0000 7f8323fff700 1 -- 172.21.15.40:0/39139135 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f832400b910 con 0x7f832c139510 2023-09-30T22:29:18.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.381+0000 7f8323fff700 1 -- 172.21.15.40:0/39139135 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832400bcc0 con 0x7f832c139510 2023-09-30T22:29:18.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.381+0000 7f833340b700 1 -- 172.21.15.40:0/39139135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f832c139510 msgr2=0x7f832c13b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:18.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.381+0000 7f833340b700 1 --2- 172.21.15.40:0/39139135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f832c139510 0x7f832c13b8f0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f8324009e50 tx=0x7f832400b330 comp rx=0 tx=0).stop 2023-09-30T22:29:18.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.382+0000 7f833340b700 1 -- 172.21.15.40:0/39139135 shutdown_connections 2023-09-30T22:29:18.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.382+0000 7f833340b700 1 --2- 172.21.15.40:0/39139135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f832c139510 0x7f832c13b8f0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.382+0000 7f833340b700 1 --2- 172.21.15.40:0/39139135 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f832c136bf0 0x7f832c138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.382+0000 7f833340b700 1 -- 172.21.15.40:0/39139135 >> 172.21.15.40:0/39139135 conn(0x7f832c0a7080 msgr2=0x7f832c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:18.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.382+0000 7f833340b700 1 -- 172.21.15.40:0/39139135 shutdown_connections 2023-09-30T22:29:18.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.382+0000 7f833340b700 1 -- 172.21.15.40:0/39139135 wait complete. 2023-09-30T22:29:18.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.383+0000 7f833340b700 1 Processor -- start 2023-09-30T22:29:18.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.383+0000 7f833340b700 1 -- start start 2023-09-30T22:29:18.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.383+0000 7f833340b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f832c09c890 0x7f832c09a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:18.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.383+0000 7f833340b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f832c136bf0 0x7f832c09ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:18.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.383+0000 7f833340b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f832c139510 0x7f832c06deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:18.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.383+0000 7f833340b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832c130e30 con 0x7f832c136bf0 2023-09-30T22:29:18.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.383+0000 7f833340b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832c070e40 con 0x7f832c139510 2023-09-30T22:29:18.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.383+0000 7f833340b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f832c0a5ef0 con 0x7f832c09c890 2023-09-30T22:29:18.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.383+0000 7f83309a6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f832c136bf0 0x7f832c09ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:18.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.383+0000 7f83309a6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f832c136bf0 0x7f832c09ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36572/0 (socket says 172.21.15.40:36572) 2023-09-30T22:29:18.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.383+0000 7f83309a6700 1 -- 172.21.15.40:0/431427879 learned_addr learned my addr 172.21.15.40:0/431427879 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:18.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.383+0000 7f83311a7700 1 --2- 172.21.15.40:0/431427879 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f832c09c890 0x7f832c09a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:18.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.383+0000 7f83319a8700 1 --2- 172.21.15.40:0/431427879 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f832c139510 0x7f832c06deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:18.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.384+0000 7f83309a6700 1 -- 172.21.15.40:0/431427879 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f832c09c890 msgr2=0x7f832c09a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:18.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.384+0000 7f83309a6700 1 --2- 172.21.15.40:0/431427879 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f832c09c890 0x7f832c09a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.384+0000 7f83309a6700 1 -- 172.21.15.40:0/431427879 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f832c139510 msgr2=0x7f832c06deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:18.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.384+0000 7f83309a6700 1 --2- 172.21.15.40:0/431427879 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f832c139510 0x7f832c06deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.384+0000 7f83309a6700 1 -- 172.21.15.40:0/431427879 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831c0094a0 con 0x7f832c136bf0 2023-09-30T22:29:18.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.384+0000 7f83311a7700 1 --2- 172.21.15.40:0/431427879 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f832c09c890 0x7f832c09a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:18.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.384+0000 7f83309a6700 1 --2- 172.21.15.40:0/431427879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f832c136bf0 0x7f832c09ac40 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f831c00ebe0 tx=0x7f831c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:18.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.384+0000 7f8321ffb700 1 -- 172.21.15.40:0/431427879 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c00c850 con 0x7f832c136bf0 2023-09-30T22:29:18.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.384+0000 7f8321ffb700 1 -- 172.21.15.40:0/431427879 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831c00c9b0 con 0x7f832c136bf0 2023-09-30T22:29:18.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.384+0000 7f833340b700 1 -- 172.21.15.40:0/431427879 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8324009b30 con 0x7f832c136bf0 2023-09-30T22:29:18.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.384+0000 7f8321ffb700 1 -- 172.21.15.40:0/431427879 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c00cd40 con 0x7f832c136bf0 2023-09-30T22:29:18.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.384+0000 7f833340b700 1 -- 172.21.15.40:0/431427879 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f832c09ecf0 con 0x7f832c136bf0 2023-09-30T22:29:18.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.385+0000 7f8321ffb700 1 -- 172.21.15.40:0/431427879 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f831c013470 con 0x7f832c136bf0 2023-09-30T22:29:18.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.385+0000 7f8321ffb700 1 -- 172.21.15.40:0/431427879 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f831c03fbb0 con 0x7f832c136bf0 2023-09-30T22:29:18.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.385+0000 7f833340b700 1 -- 172.21.15.40:0/431427879 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f832c131240 con 0x7f832c136bf0 2023-09-30T22:29:18.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.390+0000 7f8321ffb700 1 -- 172.21.15.40:0/431427879 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f831c013720 con 0x7f832c136bf0 2023-09-30T22:29:18.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.451+0000 7f8bed913700 1 Processor -- start 2023-09-30T22:29:18.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.452+0000 7f8bed913700 1 -- start start 2023-09-30T22:29:18.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.452+0000 7f8bed913700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8be806f3a0 0x7f8be806c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:18.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.452+0000 7f8bed913700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8be8139380 0x7f8be813b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:18.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.452+0000 7f8bed913700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8be80a0780 con 0x7f8be809fbb0 2023-09-30T22:29:18.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.452+0000 7f8bed913700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be809ff80 con 0x7f8be806f3a0 2023-09-30T22:29:18.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.452+0000 7f8bed913700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8be80a0590 con 0x7f8be8139380 2023-09-30T22:29:18.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.452+0000 7f8be6ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8be806f3a0 0x7f8be806c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:18.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.452+0000 7f8be77fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8be8139380 0x7f8be813b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:18.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.452+0000 7f8be67fc700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8be809fbb0 0x7f8be806ced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52484/0 (socket says 172.21.15.40:52484) 2023-09-30T22:29:18.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.452+0000 7f8be67fc700 1 -- 172.21.15.40:0/2741165831 learned_addr learned my addr 172.21.15.40:0/2741165831 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:29:18.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.452+0000 7f8be5ffb700 1 -- 172.21.15.40:0/2741165831 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 557995756 0 0) 0x7f8be80a0780 con 0x7f8be809fbb0 2023-09-30T22:29:18.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.453+0000 7f8be6ffd700 1 -- 172.21.15.40:0/2741165831 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8be8139380 msgr2=0x7f8be813b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:18.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.453+0000 7f8be6ffd700 1 --2- 172.21.15.40:0/2741165831 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8be8139380 0x7f8be813b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.453+0000 7f8be6ffd700 1 -- 172.21.15.40:0/2741165831 >> v1:172.21.15.40:6789/0 conn(0x7f8be809fbb0 legacy=0x7f8be806ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:18.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.453+0000 7f8be6ffd700 1 -- 172.21.15.40:0/2741165831 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be806df90 con 0x7f8be806f3a0 2023-09-30T22:29:18.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.453+0000 7f8be6ffd700 1 --2- 172.21.15.40:0/2741165831 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8be806f3a0 0x7f8be806c990 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8009870 tx=0x7f8bd8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d11bd279aec9572 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:18.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.453+0000 7f8be5ffb700 1 -- 172.21.15.40:0/2741165831 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd8011830 con 0x7f8be806f3a0 2023-09-30T22:29:18.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.453+0000 7f8be5ffb700 1 -- 172.21.15.40:0/2741165831 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd8011990 con 0x7f8be806f3a0 2023-09-30T22:29:18.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.453+0000 7f8be5ffb700 1 -- 172.21.15.40:0/2741165831 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd8011d20 con 0x7f8be806f3a0 2023-09-30T22:29:18.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.453+0000 7f8bed913700 1 -- 172.21.15.40:0/2741165831 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8be806f3a0 msgr2=0x7f8be806c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:18.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.453+0000 7f8bed913700 1 --2- 172.21.15.40:0/2741165831 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8be806f3a0 0x7f8be806c990 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8009870 tx=0x7f8bd8009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:18.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.453+0000 7f8bed913700 1 -- 172.21.15.40:0/2741165831 shutdown_connections 2023-09-30T22:29:18.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.453+0000 7f8bed913700 1 --2- 172.21.15.40:0/2741165831 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8be8139380 0x7f8be813b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.453+0000 7f8bed913700 1 --2- 172.21.15.40:0/2741165831 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8be806f3a0 0x7f8be806c990 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.454+0000 7f8bed913700 1 -- 172.21.15.40:0/2741165831 >> 172.21.15.40:0/2741165831 conn(0x7f8be80a41a0 msgr2=0x7f8be80a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:18.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.454+0000 7f8bed913700 1 -- 172.21.15.40:0/2741165831 shutdown_connections 2023-09-30T22:29:18.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.454+0000 7f8bed913700 1 -- 172.21.15.40:0/2741165831 wait complete. 2023-09-30T22:29:18.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.454+0000 7f8bed913700 1 Processor -- start 2023-09-30T22:29:18.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.455+0000 7f8bed913700 1 -- start start 2023-09-30T22:29:18.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.455+0000 7f8bed913700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8be806f3a0 0x7f8be81387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:18.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.455+0000 7f8bed913700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8be809fbb0 0x7f8be8138d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:18.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.455+0000 7f8bed913700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8be8139380 0x7f8be8095a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:18.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.455+0000 7f8bed913700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be80927d0 con 0x7f8be809fbb0 2023-09-30T22:29:18.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.455+0000 7f8bed913700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be8094c40 con 0x7f8be806f3a0 2023-09-30T22:29:18.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.455+0000 7f8bed913700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8be8094e90 con 0x7f8be8139380 2023-09-30T22:29:18.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.455+0000 7f8be67fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8be809fbb0 0x7f8be8138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:18.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.455+0000 7f8be67fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8be809fbb0 0x7f8be8138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36584/0 (socket says 172.21.15.40:36584) 2023-09-30T22:29:18.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.455+0000 7f8be67fc700 1 -- 172.21.15.40:0/1264204657 learned_addr learned my addr 172.21.15.40:0/1264204657 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:18.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.455+0000 7f8be77fe700 1 --2- 172.21.15.40:0/1264204657 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8be8139380 0x7f8be8095a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:18.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.455+0000 7f8be6ffd700 1 --2- 172.21.15.40:0/1264204657 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8be806f3a0 0x7f8be81387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:18.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.456+0000 7f8be67fc700 1 -- 172.21.15.40:0/1264204657 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8be8139380 msgr2=0x7f8be8095a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:18.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.456+0000 7f8be67fc700 1 --2- 172.21.15.40:0/1264204657 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8be8139380 0x7f8be8095a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.456+0000 7f8be67fc700 1 -- 172.21.15.40:0/1264204657 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8be806f3a0 msgr2=0x7f8be81387d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:18.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.456+0000 7f8be67fc700 1 --2- 172.21.15.40:0/1264204657 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8be806f3a0 0x7f8be81387d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.456+0000 7f8be67fc700 1 -- 172.21.15.40:0/1264204657 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd80094a0 con 0x7f8be809fbb0 2023-09-30T22:29:18.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.456+0000 7f8be77fe700 1 --2- 172.21.15.40:0/1264204657 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8be8139380 0x7f8be8095a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:18.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.456+0000 7f8be67fc700 1 --2- 172.21.15.40:0/1264204657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8be809fbb0 0x7f8be8138d10 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00c550 tx=0x7f8bdc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:18.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.456+0000 7f8bcffff700 1 -- 172.21.15.40:0/1264204657 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc004c80 con 0x7f8be809fbb0 2023-09-30T22:29:18.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.456+0000 7f8bcffff700 1 -- 172.21.15.40:0/1264204657 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bdc004e00 con 0x7f8be809fbb0 2023-09-30T22:29:18.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.456+0000 7f8bed913700 1 -- 172.21.15.40:0/1264204657 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8be8094600 con 0x7f8be809fbb0 2023-09-30T22:29:18.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.456+0000 7f8bcffff700 1 -- 172.21.15.40:0/1264204657 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc007310 con 0x7f8be809fbb0 2023-09-30T22:29:18.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.456+0000 7f8bed913700 1 -- 172.21.15.40:0/1264204657 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be8071eb0 con 0x7f8be809fbb0 2023-09-30T22:29:18.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.457+0000 7f8bed913700 1 -- 172.21.15.40:0/1264204657 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8be8094a80 con 0x7f8be809fbb0 2023-09-30T22:29:18.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.457+0000 7f8bcffff700 1 -- 172.21.15.40:0/1264204657 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8bdc007470 con 0x7f8be809fbb0 2023-09-30T22:29:18.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.457+0000 7f8bcffff700 1 -- 172.21.15.40:0/1264204657 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f8bdc03f350 con 0x7f8be809fbb0 2023-09-30T22:29:18.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.462+0000 7f8bcffff700 1 -- 172.21.15.40:0/1264204657 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8bdc0133c0 con 0x7f8be809fbb0 2023-09-30T22:29:18.529 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:18.529 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:18.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.598+0000 7f833340b700 1 -- 172.21.15.40:0/431427879 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f832c062380 con 0x7f832c136bf0 2023-09-30T22:29:18.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.599+0000 7f8321ffb700 1 -- 172.21.15.40:0/431427879 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f831c017030 con 0x7f832c136bf0 2023-09-30T22:29:18.599 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:18.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.601+0000 7f833340b700 1 -- 172.21.15.40:0/431427879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f832c136bf0 msgr2=0x7f832c09ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:18.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.601+0000 7f833340b700 1 --2- 172.21.15.40:0/431427879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f832c136bf0 0x7f832c09ac40 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f831c00ebe0 tx=0x7f831c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.601+0000 7f833340b700 1 -- 172.21.15.40:0/431427879 shutdown_connections 2023-09-30T22:29:18.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.601+0000 7f833340b700 1 --2- 172.21.15.40:0/431427879 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f832c09c890 0x7f832c09a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.601+0000 7f833340b700 1 --2- 172.21.15.40:0/431427879 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f832c139510 0x7f832c06deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.601+0000 7f833340b700 1 --2- 172.21.15.40:0/431427879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f832c136bf0 0x7f832c09ac40 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.601+0000 7f833340b700 1 -- 172.21.15.40:0/431427879 >> 172.21.15.40:0/431427879 conn(0x7f832c0a7080 msgr2=0x7f832c135aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:18.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.601+0000 7f833340b700 1 -- 172.21.15.40:0/431427879 shutdown_connections 2023-09-30T22:29:18.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.601+0000 7f833340b700 1 -- 172.21.15.40:0/431427879 wait complete. 2023-09-30T22:29:18.614 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:18.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.663+0000 7f8bed913700 1 -- 172.21.15.40:0/1264204657 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8be8094850 con 0x7f8be809fbb0 2023-09-30T22:29:18.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.663+0000 7f8bcffff700 1 -- 172.21.15.40:0/1264204657 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8bdc011360 con 0x7f8be809fbb0 2023-09-30T22:29:18.664 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:18.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.665+0000 7f8bed913700 1 -- 172.21.15.40:0/1264204657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8be809fbb0 msgr2=0x7f8be8138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:18.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.665+0000 7f8bed913700 1 --2- 172.21.15.40:0/1264204657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8be809fbb0 0x7f8be8138d10 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00c550 tx=0x7f8bdc00c860 comp rx=0 tx=0).stop 2023-09-30T22:29:18.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.665+0000 7f8bed913700 1 -- 172.21.15.40:0/1264204657 shutdown_connections 2023-09-30T22:29:18.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.665+0000 7f8bed913700 1 --2- 172.21.15.40:0/1264204657 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8be8139380 0x7f8be8095a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.665+0000 7f8bed913700 1 --2- 172.21.15.40:0/1264204657 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8be806f3a0 0x7f8be81387d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.665+0000 7f8bed913700 1 --2- 172.21.15.40:0/1264204657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8be809fbb0 0x7f8be8138d10 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.665+0000 7f8bed913700 1 -- 172.21.15.40:0/1264204657 >> 172.21.15.40:0/1264204657 conn(0x7f8be80a41a0 msgr2=0x7f8be806f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:18.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.665+0000 7f8bed913700 1 -- 172.21.15.40:0/1264204657 shutdown_connections 2023-09-30T22:29:18.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.665+0000 7f8bed913700 1 -- 172.21.15.40:0/1264204657 wait complete. 2023-09-30T22:29:18.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.672+0000 7f23ae9d5700 1 Processor -- start 2023-09-30T22:29:18.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.672+0000 7f23ae9d5700 1 -- start start 2023-09-30T22:29:18.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.672+0000 7fd1c8e2a700 1 Processor -- start 2023-09-30T22:29:18.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.672+0000 7fd1c8e2a700 1 -- start start 2023-09-30T22:29:18.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.672+0000 7f23ae9d5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f23a8133e00 0x7f23a81341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:18.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.672+0000 7f23ae9d5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23a809d400 0x7f23a809d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:18.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.672+0000 7f23ae9d5700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f23a809dd70 0x7f23a813ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:18.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.672+0000 7f23ae9d5700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23a809ab20 con 0x7f23a809dd70 2023-09-30T22:29:18.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.672+0000 7f23ae9d5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a8133940 con 0x7f23a809d400 2023-09-30T22:29:18.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.672+0000 7f23ae9d5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23a809f0d0 con 0x7f23a8133e00 2023-09-30T22:29:18.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.672+0000 7f23a77fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23a809d400 0x7f23a809d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:18.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.672+0000 7f23a77fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23a809d400 0x7f23a809d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:57898/0 (socket says 172.21.15.40:57898) 2023-09-30T22:29:18.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.672+0000 7f23a77fe700 1 -- 172.21.15.40:0/2674499859 learned_addr learned my addr 172.21.15.40:0/2674499859 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:18.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.672+0000 7f23a7fff700 1 --2- 172.21.15.40:0/2674499859 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f23a8133e00 0x7f23a81341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:18.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.673+0000 7f23a77fe700 1 -- 172.21.15.40:0/2674499859 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f23a8133e00 msgr2=0x7f23a81341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:18.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.673+0000 7f23a77fe700 1 --2- 172.21.15.40:0/2674499859 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f23a8133e00 0x7f23a81341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.673+0000 7f23a77fe700 1 -- 172.21.15.40:0/2674499859 >> v2:172.21.15.40:3300/0 conn(0x7f23a809dd70 msgr2=0x7f23a813ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:18.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.673+0000 7f23a77fe700 1 --2- 172.21.15.40:0/2674499859 >> v2:172.21.15.40:3300/0 conn(0x7f23a809dd70 0x7f23a813ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.673+0000 7f23a77fe700 1 -- 172.21.15.40:0/2674499859 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a809e210 con 0x7f23a809d400 2023-09-30T22:29:18.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.673+0000 7f23a77fe700 1 --2- 172.21.15.40:0/2674499859 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23a809d400 0x7f23a809d830 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f239c0098f0 tx=0x7f239c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37e05bb675c9a2de server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:18.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.673+0000 7fd1c8e2a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd1c409d920 0x7fd1c409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:18.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.673+0000 7fd1c8e2a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1c409f0f0 0x7fd1c409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:18.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.673+0000 7fd1c8e2a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd1c4133ca0 0x7fd1c4134110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:18.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.673+0000 7fd1c8e2a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c406b4c0 con 0x7fd1c409d920 2023-09-30T22:29:18.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.673+0000 7fd1c8e2a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c409a8f0 con 0x7fd1c409f0f0 2023-09-30T22:29:18.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.673+0000 7fd1c8e2a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c409f940 con 0x7fd1c4133ca0 2023-09-30T22:29:18.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.673+0000 7fd1c259c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd1c409d920 0x7fd1c409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:18.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.673+0000 7fd1c1d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1c409f0f0 0x7fd1c409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:18.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.673+0000 7fd1c259c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd1c409d920 0x7fd1c409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36594/0 (socket says 172.21.15.40:36594) 2023-09-30T22:29:18.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.673+0000 7fd1c1d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1c409f0f0 0x7fd1c409e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:57908/0 (socket says 172.21.15.40:57908) 2023-09-30T22:29:18.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.673+0000 7fd1c259c700 1 -- 172.21.15.40:0/2596085287 learned_addr learned my addr 172.21.15.40:0/2596085287 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:18.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.673+0000 7fd1c2d9d700 1 --2- 172.21.15.40:0/2596085287 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd1c4133ca0 0x7fd1c4134110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:18.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.673+0000 7f23a6ffd700 1 -- 172.21.15.40:0/2674499859 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239c011830 con 0x7f23a809d400 2023-09-30T22:29:18.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.673+0000 7f23a6ffd700 1 -- 172.21.15.40:0/2674499859 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f239c011990 con 0x7f23a809d400 2023-09-30T22:29:18.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.673+0000 7f23a6ffd700 1 -- 172.21.15.40:0/2674499859 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239c011d20 con 0x7f23a809d400 2023-09-30T22:29:18.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.673+0000 7fd1c1d9b700 1 -- 172.21.15.40:0/2596085287 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd1c4133ca0 msgr2=0x7fd1c4134110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:18.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.673+0000 7fd1c1d9b700 1 --2- 172.21.15.40:0/2596085287 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd1c4133ca0 0x7fd1c4134110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.673+0000 7fd1c1d9b700 1 -- 172.21.15.40:0/2596085287 >> v2:172.21.15.40:3300/0 conn(0x7fd1c409d920 msgr2=0x7fd1c409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:18.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.673+0000 7fd1c1d9b700 1 --2- 172.21.15.40:0/2596085287 >> v2:172.21.15.40:3300/0 conn(0x7fd1c409d920 0x7fd1c409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.674+0000 7fd1c1d9b700 1 -- 172.21.15.40:0/2596085287 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c409f6e0 con 0x7fd1c409f0f0 2023-09-30T22:29:18.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.674+0000 7fd1c259c700 1 --2- 172.21.15.40:0/2596085287 >> v2:172.21.15.40:3300/0 conn(0x7fd1c409d920 0x7fd1c409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:18.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.674+0000 7fd1c1d9b700 1 --2- 172.21.15.40:0/2596085287 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1c409f0f0 0x7fd1c409e230 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd1b80098a0 tx=0x7fd1b8009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5dcefc5988f866d7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:18.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.674+0000 7fd1c159a700 1 -- 172.21.15.40:0/2596085287 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b8011830 con 0x7fd1c409f0f0 2023-09-30T22:29:18.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.674+0000 7fd1c159a700 1 -- 172.21.15.40:0/2596085287 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b8011990 con 0x7fd1c409f0f0 2023-09-30T22:29:18.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.674+0000 7fd1c159a700 1 -- 172.21.15.40:0/2596085287 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b8011d20 con 0x7fd1c409f0f0 2023-09-30T22:29:18.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.674+0000 7f23ae9d5700 1 -- 172.21.15.40:0/2674499859 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23a809d400 msgr2=0x7f23a809d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:18.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.674+0000 7f23ae9d5700 1 --2- 172.21.15.40:0/2674499859 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23a809d400 0x7f23a809d830 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f239c0098f0 tx=0x7f239c009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:18.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.674+0000 7f23ae9d5700 1 -- 172.21.15.40:0/2674499859 shutdown_connections 2023-09-30T22:29:18.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.674+0000 7f23ae9d5700 1 --2- 172.21.15.40:0/2674499859 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f23a8133e00 0x7f23a81341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.674+0000 7f23ae9d5700 1 --2- 172.21.15.40:0/2674499859 >> v2:172.21.15.40:3300/0 conn(0x7f23a809dd70 0x7f23a813ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.674+0000 7f23ae9d5700 1 --2- 172.21.15.40:0/2674499859 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23a809d400 0x7f23a809d830 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.674+0000 7f23ae9d5700 1 -- 172.21.15.40:0/2674499859 >> 172.21.15.40:0/2674499859 conn(0x7f23a80a2a00 msgr2=0x7f23a80a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:18.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.674+0000 7f23ae9d5700 1 -- 172.21.15.40:0/2674499859 shutdown_connections 2023-09-30T22:29:18.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.674+0000 7f23ae9d5700 1 -- 172.21.15.40:0/2674499859 wait complete. 2023-09-30T22:29:18.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.675+0000 7fd1c8e2a700 1 -- 172.21.15.40:0/2596085287 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1c409f0f0 msgr2=0x7fd1c409e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:18.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.675+0000 7fd1c8e2a700 1 --2- 172.21.15.40:0/2596085287 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1c409f0f0 0x7fd1c409e230 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd1b80098a0 tx=0x7fd1b8009bb0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.675+0000 7fd1c8e2a700 1 -- 172.21.15.40:0/2596085287 shutdown_connections 2023-09-30T22:29:18.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.675+0000 7fd1c8e2a700 1 --2- 172.21.15.40:0/2596085287 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd1c4133ca0 0x7fd1c4134110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.675+0000 7fd1c8e2a700 1 --2- 172.21.15.40:0/2596085287 >> v2:172.21.15.40:3300/0 conn(0x7fd1c409d920 0x7fd1c409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.675+0000 7fd1c8e2a700 1 --2- 172.21.15.40:0/2596085287 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1c409f0f0 0x7fd1c409e230 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.675+0000 7fd1c8e2a700 1 -- 172.21.15.40:0/2596085287 >> 172.21.15.40:0/2596085287 conn(0x7fd1c409fb20 msgr2=0x7fd1c409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:18.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.675+0000 7fd1c8e2a700 1 -- 172.21.15.40:0/2596085287 shutdown_connections 2023-09-30T22:29:18.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.675+0000 7fd1c8e2a700 1 -- 172.21.15.40:0/2596085287 wait complete. 2023-09-30T22:29:18.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.675+0000 7f23ae9d5700 1 Processor -- start 2023-09-30T22:29:18.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.676+0000 7f23ae9d5700 1 -- start start 2023-09-30T22:29:18.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.676+0000 7f23ae9d5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23a809d400 0x7f23a8119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:18.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.676+0000 7f23ae9d5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23a809dd70 0x7f23a8119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:18.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.676+0000 7fd1c8e2a700 1 Processor -- start 2023-09-30T22:29:18.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.676+0000 7f23ae9d5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f23a8133e00 0x7f23a8119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:18.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.676+0000 7f23ae9d5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a81311c0 con 0x7f23a809d400 2023-09-30T22:29:18.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.676+0000 7f23ae9d5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a811a6a0 con 0x7f23a809dd70 2023-09-30T22:29:18.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.676+0000 7f23ae9d5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23a811be90 con 0x7f23a8133e00 2023-09-30T22:29:18.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.676+0000 7fd1c8e2a700 1 -- start start 2023-09-30T22:29:18.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.676+0000 7f23acf72700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f23a8133e00 0x7f23a8119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:18.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.677+0000 7f23acf72700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f23a8133e00 0x7f23a8119ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:35278/0 (socket says 172.21.15.40:35278) 2023-09-30T22:29:18.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.677+0000 7f23acf72700 1 -- 172.21.15.40:0/245269947 learned_addr learned my addr 172.21.15.40:0/245269947 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:18.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.677+0000 7fd1c8e2a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1c409d920 0x7fd1c4137370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:18.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.677+0000 7fd1c8e2a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd1c4133ca0 0x7fd1c4138ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:18.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.677+0000 7fd1c8e2a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1c41378b0 0x7fd1c4139410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:18.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.677+0000 7fd1c8e2a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c41380d0 con 0x7fd1c409d920 2023-09-30T22:29:18.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.677+0000 7fd1c8e2a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c413a670 con 0x7fd1c41378b0 2023-09-30T22:29:18.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.677+0000 7fd1c8e2a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c4138a80 con 0x7fd1c4133ca0 2023-09-30T22:29:18.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.677+0000 7fd1c1d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd1c4133ca0 0x7fd1c4138ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:18.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.677+0000 7fd1c1d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd1c4133ca0 0x7fd1c4138ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:35286/0 (socket says 172.21.15.40:35286) 2023-09-30T22:29:18.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.677+0000 7fd1c1d9b700 1 -- 172.21.15.40:0/372302983 learned_addr learned my addr 172.21.15.40:0/372302983 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:18.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.677+0000 7f23acf72700 1 -- 172.21.15.40:0/245269947 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23a809dd70 msgr2=0x7f23a8119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:18.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.677+0000 7f23acf72700 1 --2- 172.21.15.40:0/245269947 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23a809dd70 0x7f23a8119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.677+0000 7f23acf72700 1 -- 172.21.15.40:0/245269947 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23a809d400 msgr2=0x7f23a8119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:18.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.677+0000 7f23acf72700 1 --2- 172.21.15.40:0/245269947 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23a809d400 0x7f23a8119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.677+0000 7f23acf72700 1 -- 172.21.15.40:0/245269947 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f239c009550 con 0x7f23a8133e00 2023-09-30T22:29:18.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.677+0000 7fd1c2d9d700 1 --2- 172.21.15.40:0/372302983 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1c41378b0 0x7fd1c4139410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:18.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.677+0000 7fd1c259c700 1 --2- 172.21.15.40:0/372302983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1c409d920 0x7fd1c4137370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:18.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.677+0000 7fd1c1d9b700 1 -- 172.21.15.40:0/372302983 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1c41378b0 msgr2=0x7fd1c4139410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:18.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.677+0000 7fd1c1d9b700 1 --2- 172.21.15.40:0/372302983 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1c41378b0 0x7fd1c4139410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.677+0000 7fd1c1d9b700 1 -- 172.21.15.40:0/372302983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1c409d920 msgr2=0x7fd1c4137370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:18.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.677+0000 7fd1c1d9b700 1 --2- 172.21.15.40:0/372302983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1c409d920 0x7fd1c4137370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.677+0000 7f23acf72700 1 --2- 172.21.15.40:0/245269947 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f23a8133e00 0x7f23a8119ad0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f23a000b970 tx=0x7f23a000bd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:18.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.677+0000 7fd1c1d9b700 1 -- 172.21.15.40:0/372302983 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b4009500 con 0x7fd1c4133ca0 2023-09-30T22:29:18.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.677+0000 7fd1c259c700 1 --2- 172.21.15.40:0/372302983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1c409d920 0x7fd1c4137370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:29:18.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.677+0000 7fd1c1d9b700 1 --2- 172.21.15.40:0/372302983 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd1c4133ca0 0x7fd1c4138ed0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8000c00 tx=0x7fd1b8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:18.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.677+0000 7f23a4ff9700 1 -- 172.21.15.40:0/245269947 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a000c9b0 con 0x7f23a8133e00 2023-09-30T22:29:18.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.678+0000 7f23ae9d5700 1 -- 172.21.15.40:0/245269947 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23a81320c0 con 0x7f23a8133e00 2023-09-30T22:29:18.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.678+0000 7f23a4ff9700 1 -- 172.21.15.40:0/245269947 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a000cb30 con 0x7f23a8133e00 2023-09-30T22:29:18.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.678+0000 7f23a4ff9700 1 -- 172.21.15.40:0/245269947 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a0014440 con 0x7f23a8133e00 2023-09-30T22:29:18.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.678+0000 7f23ae9d5700 1 -- 172.21.15.40:0/245269947 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23a811c430 con 0x7f23a8133e00 2023-09-30T22:29:18.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.678+0000 7fd1b2ffd700 1 -- 172.21.15.40:0/372302983 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b80036a0 con 0x7fd1c4133ca0 2023-09-30T22:29:18.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.678+0000 7fd1b2ffd700 1 -- 172.21.15.40:0/372302983 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b801f070 con 0x7fd1c4133ca0 2023-09-30T22:29:18.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.678+0000 7fd1b2ffd700 1 -- 172.21.15.40:0/372302983 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b8003a20 con 0x7fd1c4133ca0 2023-09-30T22:29:18.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.678+0000 7fd1c8e2a700 1 -- 172.21.15.40:0/372302983 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b80094a0 con 0x7fd1c4133ca0 2023-09-30T22:29:18.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.679+0000 7fd1c8e2a700 1 -- 172.21.15.40:0/372302983 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c41369a0 con 0x7fd1c4133ca0 2023-09-30T22:29:18.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.679+0000 7f23ae9d5700 1 -- 172.21.15.40:0/245269947 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23a81bb0f0 con 0x7f23a8133e00 2023-09-30T22:29:18.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.679+0000 7f23a4ff9700 1 -- 172.21.15.40:0/245269947 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f23a001d3b0 con 0x7f23a8133e00 2023-09-30T22:29:18.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.679+0000 7f23a4ff9700 1 -- 172.21.15.40:0/245269947 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f23a0006e40 con 0x7f23a8133e00 2023-09-30T22:29:18.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.680+0000 7fd1b2ffd700 1 -- 172.21.15.40:0/372302983 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd1b8003b80 con 0x7fd1c4133ca0 2023-09-30T22:29:18.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.680+0000 7fd1c8e2a700 1 -- 172.21.15.40:0/372302983 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c4062380 con 0x7fd1c4133ca0 2023-09-30T22:29:18.694 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:18.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.684+0000 7fd1b2ffd700 1 -- 172.21.15.40:0/372302983 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd1b8021070 con 0x7fd1c4133ca0 2023-09-30T22:29:18.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.684+0000 7f23a4ff9700 1 -- 172.21.15.40:0/245269947 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f23a0007370 con 0x7f23a8133e00 2023-09-30T22:29:18.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.693+0000 7fd1b2ffd700 1 -- 172.21.15.40:0/372302983 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd1b801a7b0 con 0x7fd1c4133ca0 2023-09-30T22:29:18.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.883+0000 7f23ae9d5700 1 -- 172.21.15.40:0/245269947 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f23a811c050 con 0x7f23a8133e00 2023-09-30T22:29:18.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.884+0000 7f23a4ff9700 1 -- 172.21.15.40:0/245269947 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f23a0019030 con 0x7f23a8133e00 2023-09-30T22:29:18.884 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:18.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.886+0000 7f23ae9d5700 1 -- 172.21.15.40:0/245269947 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f23a8133e00 msgr2=0x7f23a8119ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:18.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.886+0000 7f23ae9d5700 1 --2- 172.21.15.40:0/245269947 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f23a8133e00 0x7f23a8119ad0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f23a000b970 tx=0x7f23a000bd30 comp rx=0 tx=0).stop 2023-09-30T22:29:18.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.886+0000 7f23ae9d5700 1 -- 172.21.15.40:0/245269947 shutdown_connections 2023-09-30T22:29:18.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.886+0000 7f23ae9d5700 1 --2- 172.21.15.40:0/245269947 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f23a8133e00 0x7f23a8119ad0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.886+0000 7f23ae9d5700 1 --2- 172.21.15.40:0/245269947 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23a809d400 0x7f23a8119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.886+0000 7f23ae9d5700 1 --2- 172.21.15.40:0/245269947 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23a809dd70 0x7f23a8119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.886+0000 7f23ae9d5700 1 -- 172.21.15.40:0/245269947 >> 172.21.15.40:0/245269947 conn(0x7f23a80a2a00 msgr2=0x7f23a812d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:18.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.886+0000 7f23ae9d5700 1 -- 172.21.15.40:0/245269947 shutdown_connections 2023-09-30T22:29:18.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.886+0000 7f23ae9d5700 1 -- 172.21.15.40:0/245269947 wait complete. 2023-09-30T22:29:18.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.890+0000 7fd1c8e2a700 1 -- 172.21.15.40:0/372302983 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd1c4074720 con 0x7fd1c4133ca0 2023-09-30T22:29:18.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.891+0000 7fd1b2ffd700 1 -- 172.21.15.40:0/372302983 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd1b8015030 con 0x7fd1c4133ca0 2023-09-30T22:29:18.891 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:18.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.894+0000 7fd1c8e2a700 1 -- 172.21.15.40:0/372302983 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd1c4133ca0 msgr2=0x7fd1c4138ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:18.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.894+0000 7fd1c8e2a700 1 --2- 172.21.15.40:0/372302983 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd1c4133ca0 0x7fd1c4138ed0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8000c00 tx=0x7fd1b8004750 comp rx=0 tx=0).stop 2023-09-30T22:29:18.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.895+0000 7fd1c8e2a700 1 -- 172.21.15.40:0/372302983 shutdown_connections 2023-09-30T22:29:18.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.895+0000 7fd1c8e2a700 1 --2- 172.21.15.40:0/372302983 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1c41378b0 0x7fd1c4139410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.895+0000 7fd1c8e2a700 1 --2- 172.21.15.40:0/372302983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1c409d920 0x7fd1c4137370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.895+0000 7fd1c8e2a700 1 --2- 172.21.15.40:0/372302983 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd1c4133ca0 0x7fd1c4138ed0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:18.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.895+0000 7fd1c8e2a700 1 -- 172.21.15.40:0/372302983 >> 172.21.15.40:0/372302983 conn(0x7fd1c409fb20 msgr2=0x7fd1c412bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:18.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.895+0000 7fd1c8e2a700 1 -- 172.21.15.40:0/372302983 shutdown_connections 2023-09-30T22:29:18.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:18.895+0000 7fd1c8e2a700 1 -- 172.21.15.40:0/372302983 wait complete. 2023-09-30T22:29:18.903 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:18.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:19.615 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:19.813 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:19.903 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:19.910 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:19.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.957+0000 7f846b757700 1 Processor -- start 2023-09-30T22:29:19.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.957+0000 7f846b757700 1 -- start start 2023-09-30T22:29:19.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.958+0000 7f846b757700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f846409d920 0x7f846409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:19.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.958+0000 7f846b757700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f846409e230 0x7f84641308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:19.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.958+0000 7f846b757700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8464130de0 0x7f8464131240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:19.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.958+0000 7f846b757700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f846409edf0 con 0x7f846409d920 2023-09-30T22:29:19.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.958+0000 7f846b757700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f846409adf0 con 0x7f846409e230 2023-09-30T22:29:19.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.958+0000 7f846b757700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f846409b660 con 0x7f8464130de0 2023-09-30T22:29:19.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.958+0000 7f84694f3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f846409d920 0x7f846409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:19.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.958+0000 7f84694f3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f846409d920 0x7f846409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36614/0 (socket says 172.21.15.40:36614) 2023-09-30T22:29:19.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.958+0000 7f84694f3700 1 -- 172.21.15.40:0/2408815295 learned_addr learned my addr 172.21.15.40:0/2408815295 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:19.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.958+0000 7f8469cf4700 1 --2- 172.21.15.40:0/2408815295 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8464130de0 0x7f8464131240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:19.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.958+0000 7f8468cf2700 1 --2- 172.21.15.40:0/2408815295 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f846409e230 0x7f84641308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:19.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.958+0000 7f8469cf4700 1 -- 172.21.15.40:0/2408815295 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f846409e230 msgr2=0x7f84641308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:19.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.958+0000 7f8469cf4700 1 --2- 172.21.15.40:0/2408815295 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f846409e230 0x7f84641308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:19.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.958+0000 7f8469cf4700 1 -- 172.21.15.40:0/2408815295 >> v2:172.21.15.40:3300/0 conn(0x7f846409d920 msgr2=0x7f846409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:19.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.958+0000 7f8469cf4700 1 --2- 172.21.15.40:0/2408815295 >> v2:172.21.15.40:3300/0 conn(0x7f846409d920 0x7f846409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:19.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.958+0000 7f8469cf4700 1 -- 172.21.15.40:0/2408815295 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846409a6e0 con 0x7f8464130de0 2023-09-30T22:29:19.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.959+0000 7f8469cf4700 1 --2- 172.21.15.40:0/2408815295 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8464130de0 0x7f8464131240 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f845c009d90 tx=0x7f845c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d953c80c3199a887 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:19.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.959+0000 7f845bfff700 1 -- 172.21.15.40:0/2408815295 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845c00e070 con 0x7f8464130de0 2023-09-30T22:29:19.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.959+0000 7f845bfff700 1 -- 172.21.15.40:0/2408815295 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845c00bb20 con 0x7f8464130de0 2023-09-30T22:29:19.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.959+0000 7f845bfff700 1 -- 172.21.15.40:0/2408815295 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845c012430 con 0x7f8464130de0 2023-09-30T22:29:19.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.960+0000 7f846b757700 1 -- 172.21.15.40:0/2408815295 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8464130de0 msgr2=0x7f8464131240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:19.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.960+0000 7f846b757700 1 --2- 172.21.15.40:0/2408815295 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8464130de0 0x7f8464131240 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f845c009d90 tx=0x7f845c00b330 comp rx=0 tx=0).stop 2023-09-30T22:29:19.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.960+0000 7f846b757700 1 -- 172.21.15.40:0/2408815295 shutdown_connections 2023-09-30T22:29:19.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.960+0000 7f846b757700 1 --2- 172.21.15.40:0/2408815295 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8464130de0 0x7f8464131240 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:19.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.960+0000 7f846b757700 1 --2- 172.21.15.40:0/2408815295 >> v2:172.21.15.40:3300/0 conn(0x7f846409d920 0x7f846409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:19.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.960+0000 7f846b757700 1 --2- 172.21.15.40:0/2408815295 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f846409e230 0x7f84641308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:19.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.960+0000 7f846b757700 1 -- 172.21.15.40:0/2408815295 >> 172.21.15.40:0/2408815295 conn(0x7f846409fb20 msgr2=0x7f846409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:19.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.961+0000 7f846b757700 1 -- 172.21.15.40:0/2408815295 shutdown_connections 2023-09-30T22:29:19.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.961+0000 7f846b757700 1 -- 172.21.15.40:0/2408815295 wait complete. 2023-09-30T22:29:19.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.962+0000 7f846b757700 1 Processor -- start 2023-09-30T22:29:19.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.962+0000 7f846b757700 1 -- start start 2023-09-30T22:29:19.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.962+0000 7f846b757700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f846409d920 0x7f846411d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:19.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.962+0000 7f846b757700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f846409e230 0x7f846411d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:19.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.962+0000 7f846b757700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8464130de0 0x7f846411db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:19.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.962+0000 7f846b757700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8464120930 con 0x7f846409e230 2023-09-30T22:29:19.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.962+0000 7f846b757700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f846411ec60 con 0x7f846409d920 2023-09-30T22:29:19.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.962+0000 7f846b757700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f846411feb0 con 0x7f8464130de0 2023-09-30T22:29:19.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.962+0000 7f8468cf2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f846409e230 0x7f846411d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:19.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.963+0000 7f8468cf2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f846409e230 0x7f846411d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36622/0 (socket says 172.21.15.40:36622) 2023-09-30T22:29:19.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.963+0000 7f8468cf2700 1 -- 172.21.15.40:0/3239102205 learned_addr learned my addr 172.21.15.40:0/3239102205 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:19.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.963+0000 7f84694f3700 1 --2- 172.21.15.40:0/3239102205 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f846409d920 0x7f846411d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:19.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.963+0000 7f8469cf4700 1 --2- 172.21.15.40:0/3239102205 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8464130de0 0x7f846411db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:19.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.963+0000 7f84694f3700 1 -- 172.21.15.40:0/3239102205 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8464130de0 msgr2=0x7f846411db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:19.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.963+0000 7f84694f3700 1 --2- 172.21.15.40:0/3239102205 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8464130de0 0x7f846411db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:19.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.963+0000 7f84694f3700 1 -- 172.21.15.40:0/3239102205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f846409e230 msgr2=0x7f846411d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:19.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.963+0000 7f84694f3700 1 --2- 172.21.15.40:0/3239102205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f846409e230 0x7f846411d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:19.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.963+0000 7f84694f3700 1 -- 172.21.15.40:0/3239102205 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845c009a70 con 0x7f846409d920 2023-09-30T22:29:19.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.963+0000 7f8469cf4700 1 --2- 172.21.15.40:0/3239102205 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8464130de0 0x7f846411db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:19.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.963+0000 7f84694f3700 1 --2- 172.21.15.40:0/3239102205 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f846409d920 0x7f846411d0f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f846000fbd0 tx=0x7f846000fee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:19.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.963+0000 7f8459ffb700 1 -- 172.21.15.40:0/3239102205 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846000dcb0 con 0x7f846409d920 2023-09-30T22:29:19.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.963+0000 7f8459ffb700 1 -- 172.21.15.40:0/3239102205 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846000de10 con 0x7f846409d920 2023-09-30T22:29:19.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.963+0000 7f8459ffb700 1 -- 172.21.15.40:0/3239102205 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8460011670 con 0x7f846409d920 2023-09-30T22:29:19.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.963+0000 7f846b757700 1 -- 172.21.15.40:0/3239102205 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f846411f220 con 0x7f846409d920 2023-09-30T22:29:19.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.964+0000 7f846b757700 1 -- 172.21.15.40:0/3239102205 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8464120350 con 0x7f846409d920 2023-09-30T22:29:19.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.965+0000 7f8459ffb700 1 -- 172.21.15.40:0/3239102205 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f84600117d0 con 0x7f846409d920 2023-09-30T22:29:19.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.965+0000 7f8459ffb700 1 -- 172.21.15.40:0/3239102205 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f8460041e70 con 0x7f846409d920 2023-09-30T22:29:19.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.965+0000 7f846b757700 1 -- 172.21.15.40:0/3239102205 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8464062380 con 0x7f846409d920 2023-09-30T22:29:19.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.960+0000 7fab42368700 1 Processor -- start 2023-09-30T22:29:19.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.960+0000 7fab42368700 1 -- start start 2023-09-30T22:29:19.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.961+0000 7fab42368700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fab3c099c20 0x7fab3c08b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:19.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.961+0000 7fab42368700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fab3c09a080 0x7fab3c08d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:19.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.961+0000 7fab42368700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab3c09bd10 con 0x7fab3c098bc0 2023-09-30T22:29:19.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.961+0000 7fab42368700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab3c09b790 con 0x7fab3c099c20 2023-09-30T22:29:19.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.961+0000 7fab42368700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c09bb00 con 0x7fab3c09a080 2023-09-30T22:29:19.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.961+0000 7fab40905700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fab3c09a080 0x7fab3c08d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:19.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.961+0000 7fab40905700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fab3c09a080 0x7fab3c08d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:35312/0 (socket says 172.21.15.40:35312) 2023-09-30T22:29:19.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.961+0000 7fab40905700 1 -- 172.21.15.40:0/359123274 learned_addr learned my addr 172.21.15.40:0/359123274 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:19.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.961+0000 7fab3b7fe700 1 --2- 172.21.15.40:0/359123274 >> v2:172.21.15.40:3300/0 conn(0x7fab3c099c20 0x7fab3c08b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:19.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.962+0000 7fab3affd700 1 -- 172.21.15.40:0/359123274 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4166322410 0 0) 0x7fab3c09bd10 con 0x7fab3c098bc0 2023-09-30T22:29:19.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.966+0000 7fab3affd700 1 -- 172.21.15.40:0/359123274 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab240034b0 con 0x7fab3c098bc0 2023-09-30T22:29:19.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.966+0000 7fab3b7fe700 1 -- 172.21.15.40:0/359123274 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fab3c09a080 msgr2=0x7fab3c08d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:19.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.966+0000 7fab3b7fe700 1 --2- 172.21.15.40:0/359123274 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fab3c09a080 0x7fab3c08d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:19.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.966+0000 7fab3b7fe700 1 -- 172.21.15.40:0/359123274 >> v1:172.21.15.40:6789/0 conn(0x7fab3c098bc0 legacy=0x7fab3c099510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:19.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.966+0000 7fab3b7fe700 1 -- 172.21.15.40:0/359123274 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab3c09e570 con 0x7fab3c099c20 2023-09-30T22:29:19.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.966+0000 7fab40905700 1 --2- 172.21.15.40:0/359123274 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fab3c09a080 0x7fab3c08d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:19.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.966+0000 7fab3b7fe700 1 --2- 172.21.15.40:0/359123274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab3c099c20 0x7fab3c08b0b0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fab30006280 tx=0x7fab3000ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2361f23c594560ef server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:19.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.966+0000 7fab3affd700 1 -- 172.21.15.40:0/359123274 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3000cb40 con 0x7fab3c099c20 2023-09-30T22:29:19.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.967+0000 7fab3affd700 1 -- 172.21.15.40:0/359123274 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3000cca0 con 0x7fab3c099c20 2023-09-30T22:29:19.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.967+0000 7fab3affd700 1 -- 172.21.15.40:0/359123274 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab30014630 con 0x7fab3c099c20 2023-09-30T22:29:19.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.967+0000 7fab42368700 1 -- 172.21.15.40:0/359123274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab3c099c20 msgr2=0x7fab3c08b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:19.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.967+0000 7fab42368700 1 --2- 172.21.15.40:0/359123274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab3c099c20 0x7fab3c08b0b0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fab30006280 tx=0x7fab3000ac20 comp rx=0 tx=0).stop 2023-09-30T22:29:19.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.967+0000 7fab42368700 1 -- 172.21.15.40:0/359123274 shutdown_connections 2023-09-30T22:29:19.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.967+0000 7fab42368700 1 --2- 172.21.15.40:0/359123274 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fab3c09a080 0x7fab3c08d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:19.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.967+0000 7fab42368700 1 --2- 172.21.15.40:0/359123274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab3c099c20 0x7fab3c08b0b0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:19.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.967+0000 7fab42368700 1 -- 172.21.15.40:0/359123274 >> 172.21.15.40:0/359123274 conn(0x7fab3c0a2c70 msgr2=0x7fab3c09eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:19.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.967+0000 7fab42368700 1 -- 172.21.15.40:0/359123274 shutdown_connections 2023-09-30T22:29:19.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.967+0000 7fab42368700 1 -- 172.21.15.40:0/359123274 wait complete. 2023-09-30T22:29:19.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.969+0000 7fab42368700 1 Processor -- start 2023-09-30T22:29:19.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.969+0000 7fab42368700 1 -- start start 2023-09-30T22:29:19.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.969+0000 7fab42368700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab3c098bc0 0x7fab3c070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:19.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.969+0000 7fab42368700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab3c099c20 0x7fab3c0705c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:19.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.969+0000 7fab42368700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fab3c09a080 0x7fab3c070b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:19.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.969+0000 7fab42368700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c0930f0 con 0x7fab3c099c20 2023-09-30T22:29:19.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.969+0000 7fab42368700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c0714e0 con 0x7fab3c098bc0 2023-09-30T22:29:19.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.969+0000 7fab42368700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c071c90 con 0x7fab3c09a080 2023-09-30T22:29:19.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.970+0000 7fab3bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab3c098bc0 0x7fab3c070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:19.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.970+0000 7fab40905700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fab3c09a080 0x7fab3c070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:19.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.970+0000 7fab3bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab3c098bc0 0x7fab3c070080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:57960/0 (socket says 172.21.15.40:57960) 2023-09-30T22:29:19.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.970+0000 7fab3bfff700 1 -- 172.21.15.40:0/2827703498 learned_addr learned my addr 172.21.15.40:0/2827703498 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:19.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.970+0000 7fab40905700 1 -- 172.21.15.40:0/2827703498 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab3c098bc0 msgr2=0x7fab3c070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:19.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.970+0000 7fab40905700 1 --2- 172.21.15.40:0/2827703498 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab3c098bc0 0x7fab3c070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:19.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.970+0000 7fab40905700 1 -- 172.21.15.40:0/2827703498 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab3c099c20 msgr2=0x7fab3c0705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:19.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.970+0000 7fab40905700 1 --2- 172.21.15.40:0/2827703498 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab3c099c20 0x7fab3c0705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:19.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.970+0000 7fab40905700 1 -- 172.21.15.40:0/2827703498 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab3400ab50 con 0x7fab3c09a080 2023-09-30T22:29:19.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.970+0000 7fab3bfff700 1 --2- 172.21.15.40:0/2827703498 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab3c098bc0 0x7fab3c070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:19.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.970+0000 7fab40905700 1 --2- 172.21.15.40:0/2827703498 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fab3c09a080 0x7fab3c070b00 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fab34007fd0 tx=0x7fab3400e410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:19.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.970+0000 7fab38ff9700 1 -- 172.21.15.40:0/2827703498 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3400f040 con 0x7fab3c09a080 2023-09-30T22:29:19.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.971+0000 7fab38ff9700 1 -- 172.21.15.40:0/2827703498 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3400eae0 con 0x7fab3c09a080 2023-09-30T22:29:19.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.971+0000 7fab38ff9700 1 -- 172.21.15.40:0/2827703498 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3400ae30 con 0x7fab3c09a080 2023-09-30T22:29:19.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.971+0000 7f8459ffb700 1 -- 172.21.15.40:0/3239102205 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8460024440 con 0x7f846409d920 2023-09-30T22:29:19.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.971+0000 7fab42368700 1 -- 172.21.15.40:0/2827703498 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab3000a5a0 con 0x7fab3c09a080 2023-09-30T22:29:19.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.971+0000 7fab42368700 1 -- 172.21.15.40:0/2827703498 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab3c098350 con 0x7fab3c09a080 2023-09-30T22:29:19.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.973+0000 7fab42368700 1 -- 172.21.15.40:0/2827703498 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab3c09a970 con 0x7fab3c09a080 2023-09-30T22:29:19.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.975+0000 7fab38ff9700 1 -- 172.21.15.40:0/2827703498 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab34008500 con 0x7fab3c09a080 2023-09-30T22:29:19.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.975+0000 7fab38ff9700 1 -- 172.21.15.40:0/2827703498 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fab34040fa0 con 0x7fab3c09a080 2023-09-30T22:29:19.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:19.978+0000 7fab38ff9700 1 -- 172.21.15.40:0/2827703498 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab3401d9b0 con 0x7fab3c09a080 2023-09-30T22:29:20.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.075+0000 7fcb3b776700 1 Processor -- start 2023-09-30T22:29:20.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.075+0000 7fcb3b776700 1 -- start start 2023-09-30T22:29:20.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.075+0000 7fcb3b776700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb3409d450 0x7fcb3409d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:20.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.075+0000 7fcb3b776700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcb341308d0 0x7fcb34138420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:20.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.075+0000 7fcb3b776700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb3409c3b0 con 0x7fcb3409dd60 2023-09-30T22:29:20.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.075+0000 7fcb3b776700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb3409a6b0 con 0x7fcb341308d0 2023-09-30T22:29:20.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.075+0000 7fcb3b776700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3409b4f0 con 0x7fcb3409d450 2023-09-30T22:29:20.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.076+0000 7fcb38d11700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fcb3409dd60 0x7fcb341301c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52502/0 (socket says 172.21.15.40:52502) 2023-09-30T22:29:20.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.076+0000 7fcb38d11700 1 -- 172.21.15.40:0/1041599541 learned_addr learned my addr 172.21.15.40:0/1041599541 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:29:20.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.076+0000 7fcb39d13700 1 --2- 172.21.15.40:0/1041599541 >> v2:172.21.15.40:3300/0 conn(0x7fcb341308d0 0x7fcb34138420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:20.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.076+0000 7fcb39512700 1 --2- 172.21.15.40:0/1041599541 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb3409d450 0x7fcb3409d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:20.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.076+0000 7fcb39512700 1 -- 172.21.15.40:0/1041599541 >> v2:172.21.15.40:3300/0 conn(0x7fcb341308d0 msgr2=0x7fcb34138420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:20.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.076+0000 7fcb39512700 1 --2- 172.21.15.40:0/1041599541 >> v2:172.21.15.40:3300/0 conn(0x7fcb341308d0 0x7fcb34138420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:20.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.076+0000 7fcb39512700 1 -- 172.21.15.40:0/1041599541 >> v1:172.21.15.40:6789/0 conn(0x7fcb3409dd60 legacy=0x7fcb341301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:20.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.076+0000 7fcb39512700 1 -- 172.21.15.40:0/1041599541 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3409af90 con 0x7fcb3409d450 2023-09-30T22:29:20.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.076+0000 7fcb39512700 1 --2- 172.21.15.40:0/1041599541 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb3409d450 0x7fcb3409d820 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fcb3000dc60 tx=0x7fcb3000df70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a587ddf05fdaae5b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:20.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.076+0000 7fcb2bfff700 1 -- 172.21.15.40:0/1041599541 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb30012070 con 0x7fcb3409d450 2023-09-30T22:29:20.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.076+0000 7fcb2bfff700 1 -- 172.21.15.40:0/1041599541 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3000d2e0 con 0x7fcb3409d450 2023-09-30T22:29:20.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.076+0000 7fcb2bfff700 1 -- 172.21.15.40:0/1041599541 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3000f900 con 0x7fcb3409d450 2023-09-30T22:29:20.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.077+0000 7fcb3b776700 1 -- 172.21.15.40:0/1041599541 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb3409d450 msgr2=0x7fcb3409d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:20.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.077+0000 7fcb3b776700 1 --2- 172.21.15.40:0/1041599541 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb3409d450 0x7fcb3409d820 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fcb3000dc60 tx=0x7fcb3000df70 comp rx=0 tx=0).stop 2023-09-30T22:29:20.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.077+0000 7fcb3b776700 1 -- 172.21.15.40:0/1041599541 shutdown_connections 2023-09-30T22:29:20.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.077+0000 7fcb3b776700 1 --2- 172.21.15.40:0/1041599541 >> v2:172.21.15.40:3300/0 conn(0x7fcb341308d0 0x7fcb34138420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:20.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.077+0000 7fcb3b776700 1 --2- 172.21.15.40:0/1041599541 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb3409d450 0x7fcb3409d820 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:20.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.077+0000 7fcb3b776700 1 -- 172.21.15.40:0/1041599541 >> 172.21.15.40:0/1041599541 conn(0x7fcb340a2a00 msgr2=0x7fcb340a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:20.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.078+0000 7fcb3b776700 1 -- 172.21.15.40:0/1041599541 shutdown_connections 2023-09-30T22:29:20.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.078+0000 7fcb3b776700 1 -- 172.21.15.40:0/1041599541 wait complete. 2023-09-30T22:29:20.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.079+0000 7fcb3b776700 1 Processor -- start 2023-09-30T22:29:20.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.079+0000 7fcb3b776700 1 -- start start 2023-09-30T22:29:20.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.080+0000 7fcb3b776700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb3409d450 0x7fcb3411aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:20.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.080+0000 7fcb3b776700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb3409dd60 0x7fcb3411b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:20.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.080+0000 7fcb3b776700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb341308d0 0x7fcb341c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:20.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.080+0000 7fcb3b776700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3412ebb0 con 0x7fcb3409dd60 2023-09-30T22:29:20.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.080+0000 7fcb3b776700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3411a700 con 0x7fcb3409d450 2023-09-30T22:29:20.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.080+0000 7fcb3b776700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3411be30 con 0x7fcb341308d0 2023-09-30T22:29:20.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.080+0000 7fcb39512700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb3409d450 0x7fcb3411aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:20.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.080+0000 7fcb39512700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb3409d450 0x7fcb3411aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:57980/0 (socket says 172.21.15.40:57980) 2023-09-30T22:29:20.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.080+0000 7fcb39512700 1 -- 172.21.15.40:0/751730477 learned_addr learned my addr 172.21.15.40:0/751730477 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:20.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.080+0000 7fcb38d11700 1 --2- 172.21.15.40:0/751730477 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb3409dd60 0x7fcb3411b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:20.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.080+0000 7fcb39512700 1 -- 172.21.15.40:0/751730477 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb341308d0 msgr2=0x7fcb341c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:20.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.080+0000 7fcb39512700 1 --2- 172.21.15.40:0/751730477 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb341308d0 0x7fcb341c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:20.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.080+0000 7fcb39512700 1 -- 172.21.15.40:0/751730477 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb3409dd60 msgr2=0x7fcb3411b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:20.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.080+0000 7fcb39512700 1 --2- 172.21.15.40:0/751730477 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb3409dd60 0x7fcb3411b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:20.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.080+0000 7fcb39512700 1 -- 172.21.15.40:0/751730477 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3000d940 con 0x7fcb3409d450 2023-09-30T22:29:20.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.080+0000 7fcb39512700 1 --2- 172.21.15.40:0/751730477 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb3409d450 0x7fcb3411aaf0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fcb3409b630 tx=0x7fcb30004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:20.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.080+0000 7fcb29ffb700 1 -- 172.21.15.40:0/751730477 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb300036a0 con 0x7fcb3409d450 2023-09-30T22:29:20.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.080+0000 7fcb3b776700 1 -- 172.21.15.40:0/751730477 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb3411d7a0 con 0x7fcb3409d450 2023-09-30T22:29:20.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.081+0000 7fcb29ffb700 1 -- 172.21.15.40:0/751730477 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb30003800 con 0x7fcb3409d450 2023-09-30T22:29:20.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.081+0000 7fcb29ffb700 1 -- 172.21.15.40:0/751730477 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb30003bb0 con 0x7fcb3409d450 2023-09-30T22:29:20.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.081+0000 7fcb3b776700 1 -- 172.21.15.40:0/751730477 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb340a2560 con 0x7fcb3409d450 2023-09-30T22:29:20.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.082+0000 7fcb29ffb700 1 -- 172.21.15.40:0/751730477 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcb30003d10 con 0x7fcb3409d450 2023-09-30T22:29:20.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.082+0000 7fcb29ffb700 1 -- 172.21.15.40:0/751730477 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fcb30044c80 con 0x7fcb3409d450 2023-09-30T22:29:20.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.082+0000 7fcb3b776700 1 -- 172.21.15.40:0/751730477 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb3411cb60 con 0x7fcb3409d450 2023-09-30T22:29:20.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.084+0000 7fe2b08b8700 1 Processor -- start 2023-09-30T22:29:20.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.084+0000 7fe2b08b8700 1 -- start start 2023-09-30T22:29:20.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.085+0000 7fe2b08b8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2ac13b130 0x7fe2ac13d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:20.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.085+0000 7fe2b08b8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe2ac13da50 0x7fe2ac13fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:20.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.085+0000 7fe2b08b8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2ac137e20 con 0x7fe2ac138250 2023-09-30T22:29:20.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.085+0000 7fe2b08b8700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2ac138d30 con 0x7fe2ac13da50 2023-09-30T22:29:20.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.085+0000 7fe2b08b8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac138050 con 0x7fe2ac13b130 2023-09-30T22:29:20.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.085+0000 7fe2aad9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe2ac13da50 0x7fe2ac13fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:20.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.085+0000 7fe2a9d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2ac13b130 0x7fe2ac13d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:20.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.085+0000 7fe2aad9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe2ac13da50 0x7fe2ac13fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36666/0 (socket says 172.21.15.40:36666) 2023-09-30T22:29:20.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.085+0000 7fe2a9d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2ac13b130 0x7fe2ac13d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:57994/0 (socket says 172.21.15.40:57994) 2023-09-30T22:29:20.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.085+0000 7fe2aad9d700 1 -- 172.21.15.40:0/3964494781 learned_addr learned my addr 172.21.15.40:0/3964494781 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:20.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.086+0000 7fe2a9d9b700 1 -- 172.21.15.40:0/3964494781 >> v2:172.21.15.40:3300/0 conn(0x7fe2ac13da50 msgr2=0x7fe2ac13fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:20.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.086+0000 7fe2a9d9b700 1 --2- 172.21.15.40:0/3964494781 >> v2:172.21.15.40:3300/0 conn(0x7fe2ac13da50 0x7fe2ac13fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:20.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.086+0000 7fe2a9d9b700 1 -- 172.21.15.40:0/3964494781 >> v1:172.21.15.40:6789/0 conn(0x7fe2ac138250 legacy=0x7fe2ac138620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:20.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.086+0000 7fe2a9d9b700 1 -- 172.21.15.40:0/3964494781 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ac09b010 con 0x7fe2ac13b130 2023-09-30T22:29:20.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.086+0000 7fe2aad9d700 1 --2- 172.21.15.40:0/3964494781 >> v2:172.21.15.40:3300/0 conn(0x7fe2ac13da50 0x7fe2ac13fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:20.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.086+0000 7fe2a9d9b700 1 --2- 172.21.15.40:0/3964494781 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2ac13b130 0x7fe2ac13d510 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0009870 tx=0x7fe2a0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70fe230f35688b7b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:20.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.088+0000 7fe2a959a700 1 -- 172.21.15.40:0/3964494781 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a0004230 con 0x7fe2ac13b130 2023-09-30T22:29:20.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.088+0000 7fe2a959a700 1 -- 172.21.15.40:0/3964494781 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a0004390 con 0x7fe2ac13b130 2023-09-30T22:29:20.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.088+0000 7fe2a959a700 1 -- 172.21.15.40:0/3964494781 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a00036a0 con 0x7fe2ac13b130 2023-09-30T22:29:20.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.088+0000 7fcb29ffb700 1 -- 172.21.15.40:0/751730477 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcb30015390 con 0x7fcb3409d450 2023-09-30T22:29:20.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.089+0000 7fe2b08b8700 1 -- 172.21.15.40:0/3964494781 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2ac13b130 msgr2=0x7fe2ac13d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:20.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.089+0000 7fe2b08b8700 1 --2- 172.21.15.40:0/3964494781 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2ac13b130 0x7fe2ac13d510 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0009870 tx=0x7fe2a0009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:20.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.089+0000 7fe2b08b8700 1 -- 172.21.15.40:0/3964494781 shutdown_connections 2023-09-30T22:29:20.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.089+0000 7fe2b08b8700 1 --2- 172.21.15.40:0/3964494781 >> v2:172.21.15.40:3300/0 conn(0x7fe2ac13da50 0x7fe2ac13fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:20.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.089+0000 7fe2b08b8700 1 --2- 172.21.15.40:0/3964494781 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2ac13b130 0x7fe2ac13d510 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:20.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.089+0000 7fe2b08b8700 1 -- 172.21.15.40:0/3964494781 >> 172.21.15.40:0/3964494781 conn(0x7fe2ac0a2a00 msgr2=0x7fe2ac0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:20.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.091+0000 7fe2b08b8700 1 -- 172.21.15.40:0/3964494781 shutdown_connections 2023-09-30T22:29:20.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.091+0000 7fe2b08b8700 1 -- 172.21.15.40:0/3964494781 wait complete. 2023-09-30T22:29:20.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.092+0000 7fe2b08b8700 1 Processor -- start 2023-09-30T22:29:20.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.092+0000 7fe2b08b8700 1 -- start start 2023-09-30T22:29:20.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.092+0000 7fe2b08b8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2ac138250 0x7fe2ac13f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:20.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.092+0000 7fe2b08b8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2ac13b130 0x7fe2ac13fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:20.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.092+0000 7fe2b08b8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe2ac13da50 0x7fe2ac1402e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:20.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.092+0000 7fe2b08b8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac06e0f0 con 0x7fe2ac13b130 2023-09-30T22:29:20.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.092+0000 7fe2b08b8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac06ed00 con 0x7fe2ac138250 2023-09-30T22:29:20.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.092+0000 7fe2b08b8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac070380 con 0x7fe2ac13da50 2023-09-30T22:29:20.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.092+0000 7fe2aa59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2ac138250 0x7fe2ac13f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:20.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.092+0000 7fe2aa59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2ac138250 0x7fe2ac13f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:57998/0 (socket says 172.21.15.40:57998) 2023-09-30T22:29:20.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.092+0000 7fe2aa59c700 1 -- 172.21.15.40:0/56638055 learned_addr learned my addr 172.21.15.40:0/56638055 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:20.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.093+0000 7fe2a9d9b700 1 --2- 172.21.15.40:0/56638055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2ac13b130 0x7fe2ac13fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:20.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.093+0000 7fe2aad9d700 1 --2- 172.21.15.40:0/56638055 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe2ac13da50 0x7fe2ac1402e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:20.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.093+0000 7fe2a9d9b700 1 -- 172.21.15.40:0/56638055 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe2ac13da50 msgr2=0x7fe2ac1402e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:20.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.093+0000 7fe2a9d9b700 1 --2- 172.21.15.40:0/56638055 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe2ac13da50 0x7fe2ac1402e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:20.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.093+0000 7fe2a9d9b700 1 -- 172.21.15.40:0/56638055 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2ac138250 msgr2=0x7fe2ac13f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:20.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.093+0000 7fe2a9d9b700 1 --2- 172.21.15.40:0/56638055 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2ac138250 0x7fe2ac13f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:20.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.093+0000 7fe2a9d9b700 1 -- 172.21.15.40:0/56638055 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a4009b30 con 0x7fe2ac13b130 2023-09-30T22:29:20.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.093+0000 7fe2a9d9b700 1 --2- 172.21.15.40:0/56638055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2ac13b130 0x7fe2ac13fda0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0015000 tx=0x7fe2a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:20.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.097+0000 7fe29affd700 1 -- 172.21.15.40:0/56638055 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a0003e60 con 0x7fe2ac13b130 2023-09-30T22:29:20.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.097+0000 7fe29affd700 1 -- 172.21.15.40:0/56638055 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a001e070 con 0x7fe2ac13b130 2023-09-30T22:29:20.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.097+0000 7fe2b08b8700 1 -- 172.21.15.40:0/56638055 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2a00094a0 con 0x7fe2ac13b130 2023-09-30T22:29:20.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.097+0000 7fe29affd700 1 -- 172.21.15.40:0/56638055 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a0011830 con 0x7fe2ac13b130 2023-09-30T22:29:20.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.097+0000 7fe2b08b8700 1 -- 172.21.15.40:0/56638055 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2ac09a300 con 0x7fe2ac13b130 2023-09-30T22:29:20.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.098+0000 7fe29affd700 1 -- 172.21.15.40:0/56638055 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe2a0011990 con 0x7fe2ac13b130 2023-09-30T22:29:20.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.098+0000 7fe2b08b8700 1 -- 172.21.15.40:0/56638055 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2ac062380 con 0x7fe2ac13b130 2023-09-30T22:29:20.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.098+0000 7fe29affd700 1 -- 172.21.15.40:0/56638055 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe2a00405b0 con 0x7fe2ac13b130 2023-09-30T22:29:20.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.107+0000 7fe29affd700 1 -- 172.21.15.40:0/56638055 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe2a0010de0 con 0x7fe2ac13b130 2023-09-30T22:29:20.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.181+0000 7fab42368700 1 -- 172.21.15.40:0/2827703498 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fab3c062380 con 0x7fab3c09a080 2023-09-30T22:29:20.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.182+0000 7fab38ff9700 1 -- 172.21.15.40:0/2827703498 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fab340273e0 con 0x7fab3c09a080 2023-09-30T22:29:20.182 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:20.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.184+0000 7fab42368700 1 -- 172.21.15.40:0/2827703498 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fab3c09a080 msgr2=0x7fab3c070b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:20.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.184+0000 7fab42368700 1 --2- 172.21.15.40:0/2827703498 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fab3c09a080 0x7fab3c070b00 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fab34007fd0 tx=0x7fab3400e410 comp rx=0 tx=0).stop 2023-09-30T22:29:20.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.184+0000 7fab42368700 1 -- 172.21.15.40:0/2827703498 shutdown_connections 2023-09-30T22:29:20.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.184+0000 7fab42368700 1 --2- 172.21.15.40:0/2827703498 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fab3c09a080 0x7fab3c070b00 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:20.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.184+0000 7fab42368700 1 --2- 172.21.15.40:0/2827703498 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab3c098bc0 0x7fab3c070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:20.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.184+0000 7fab42368700 1 --2- 172.21.15.40:0/2827703498 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab3c099c20 0x7fab3c0705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:20.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.184+0000 7fab42368700 1 -- 172.21.15.40:0/2827703498 >> 172.21.15.40:0/2827703498 conn(0x7fab3c0a2c70 msgr2=0x7fab3c08fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:20.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.184+0000 7fab42368700 1 -- 172.21.15.40:0/2827703498 shutdown_connections 2023-09-30T22:29:20.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.184+0000 7fab42368700 1 -- 172.21.15.40:0/2827703498 wait complete. 2023-09-30T22:29:20.197 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:20.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.231+0000 7f846b757700 1 -- 172.21.15.40:0/3239102205 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f84640a3380 con 0x7f846409d920 2023-09-30T22:29:20.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.231+0000 7f8459ffb700 1 -- 172.21.15.40:0/3239102205 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f84600233a0 con 0x7f846409d920 2023-09-30T22:29:20.232 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:20.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.234+0000 7f846b757700 1 -- 172.21.15.40:0/3239102205 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f846409d920 msgr2=0x7f846411d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:20.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.234+0000 7f846b757700 1 --2- 172.21.15.40:0/3239102205 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f846409d920 0x7f846411d0f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f846000fbd0 tx=0x7f846000fee0 comp rx=0 tx=0).stop 2023-09-30T22:29:20.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.234+0000 7f846b757700 1 -- 172.21.15.40:0/3239102205 shutdown_connections 2023-09-30T22:29:20.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.234+0000 7f846b757700 1 --2- 172.21.15.40:0/3239102205 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8464130de0 0x7f846411db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:20.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.234+0000 7f846b757700 1 --2- 172.21.15.40:0/3239102205 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f846409d920 0x7f846411d0f0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:20.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.234+0000 7f846b757700 1 --2- 172.21.15.40:0/3239102205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f846409e230 0x7f846411d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:20.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.234+0000 7f846b757700 1 -- 172.21.15.40:0/3239102205 >> 172.21.15.40:0/3239102205 conn(0x7f846409fb20 msgr2=0x7f846412fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:20.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.234+0000 7f846b757700 1 -- 172.21.15.40:0/3239102205 shutdown_connections 2023-09-30T22:29:20.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.234+0000 7f846b757700 1 -- 172.21.15.40:0/3239102205 wait complete. 2023-09-30T22:29:20.247 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:20.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.294+0000 7fcb3b776700 1 -- 172.21.15.40:0/751730477 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcb34062380 con 0x7fcb3409d450 2023-09-30T22:29:20.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.295+0000 7fcb29ffb700 1 -- 172.21.15.40:0/751730477 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcb30037090 con 0x7fcb3409d450 2023-09-30T22:29:20.296 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:20.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.297+0000 7fcb3b776700 1 -- 172.21.15.40:0/751730477 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb3409d450 msgr2=0x7fcb3411aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:20.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.297+0000 7fcb3b776700 1 --2- 172.21.15.40:0/751730477 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb3409d450 0x7fcb3411aaf0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fcb3409b630 tx=0x7fcb30004750 comp rx=0 tx=0).stop 2023-09-30T22:29:20.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.297+0000 7fcb3b776700 1 -- 172.21.15.40:0/751730477 shutdown_connections 2023-09-30T22:29:20.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.297+0000 7fcb3b776700 1 --2- 172.21.15.40:0/751730477 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb341308d0 0x7fcb341c40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:20.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.297+0000 7fcb3b776700 1 --2- 172.21.15.40:0/751730477 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb3409d450 0x7fcb3411aaf0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:20.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.297+0000 7fcb3b776700 1 --2- 172.21.15.40:0/751730477 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb3409dd60 0x7fcb3411b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:20.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.297+0000 7fcb3b776700 1 -- 172.21.15.40:0/751730477 >> 172.21.15.40:0/751730477 conn(0x7fcb340a2a00 msgr2=0x7fcb340a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:20.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.297+0000 7fcb3b776700 1 -- 172.21.15.40:0/751730477 shutdown_connections 2023-09-30T22:29:20.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.297+0000 7fcb3b776700 1 -- 172.21.15.40:0/751730477 wait complete. 2023-09-30T22:29:20.309 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:20.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.319+0000 7fe2b08b8700 1 -- 172.21.15.40:0/56638055 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe2ac09abb0 con 0x7fe2ac13b130 2023-09-30T22:29:20.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.319+0000 7fe29affd700 1 -- 172.21.15.40:0/56638055 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe2a0010380 con 0x7fe2ac13b130 2023-09-30T22:29:20.320 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:20.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.321+0000 7fe2b08b8700 1 -- 172.21.15.40:0/56638055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2ac13b130 msgr2=0x7fe2ac13fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:20.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.321+0000 7fe2b08b8700 1 --2- 172.21.15.40:0/56638055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2ac13b130 0x7fe2ac13fda0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0015000 tx=0x7fe2a0004750 comp rx=0 tx=0).stop 2023-09-30T22:29:20.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.321+0000 7fe2b08b8700 1 -- 172.21.15.40:0/56638055 shutdown_connections 2023-09-30T22:29:20.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.321+0000 7fe2b08b8700 1 --2- 172.21.15.40:0/56638055 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe2ac13da50 0x7fe2ac1402e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:20.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.321+0000 7fe2b08b8700 1 --2- 172.21.15.40:0/56638055 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2ac138250 0x7fe2ac13f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:20.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.321+0000 7fe2b08b8700 1 --2- 172.21.15.40:0/56638055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2ac13b130 0x7fe2ac13fda0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:20.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.321+0000 7fe2b08b8700 1 -- 172.21.15.40:0/56638055 >> 172.21.15.40:0/56638055 conn(0x7fe2ac0a2a00 msgr2=0x7fe2ac13cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:20.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.321+0000 7fe2b08b8700 1 -- 172.21.15.40:0/56638055 shutdown_connections 2023-09-30T22:29:20.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:20.321+0000 7fe2b08b8700 1 -- 172.21.15.40:0/56638055 wait complete. 2023-09-30T22:29:20.334 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:21.199 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:21.248 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:21.310 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:21.335 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:21.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.343+0000 7f470ad5c700 1 Processor -- start 2023-09-30T22:29:21.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.344+0000 7f470ad5c700 1 -- start start 2023-09-30T22:29:21.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.344+0000 7f470ad5c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f470412f070 0x7f4704135c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:21.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.344+0000 7f470ad5c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4704136170 0x7f4704138550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:21.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.344+0000 7f470ad5c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f470409ab70 con 0x7f470412e590 2023-09-30T22:29:21.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.344+0000 7f470ad5c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f470409b270 con 0x7f470412f070 2023-09-30T22:29:21.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.344+0000 7f470ad5c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f470412f440 con 0x7f4704136170 2023-09-30T22:29:21.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.345+0000 7f4703fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f470412f070 0x7f4704135c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:21.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.345+0000 7f47092f9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4704136170 0x7f4704138550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:21.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.345+0000 7f4708af8700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f470412e590 0x7f470412e960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52520/0 (socket says 172.21.15.40:52520) 2023-09-30T22:29:21.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.345+0000 7f4708af8700 1 -- 172.21.15.40:0/711676338 learned_addr learned my addr 172.21.15.40:0/711676338 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:29:21.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.345+0000 7f4703fff700 1 -- 172.21.15.40:0/711676338 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4704136170 msgr2=0x7f4704138550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:21.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.345+0000 7f4703fff700 1 --2- 172.21.15.40:0/711676338 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4704136170 0x7f4704138550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:21.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.345+0000 7f4703fff700 1 -- 172.21.15.40:0/711676338 >> v1:172.21.15.40:6789/0 conn(0x7f470412e590 legacy=0x7f470412e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:21.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.345+0000 7f47037fe700 1 -- 172.21.15.40:0/711676338 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1709877292 0 0) 0x7f470409ab70 con 0x7f470412e590 2023-09-30T22:29:21.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.345+0000 7f4703fff700 1 -- 172.21.15.40:0/711676338 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f470409bd70 con 0x7f470412f070 2023-09-30T22:29:21.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.345+0000 7f47092f9700 1 --2- 172.21.15.40:0/711676338 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4704136170 0x7f4704138550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:21.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.345+0000 7f4703fff700 1 --2- 172.21.15.40:0/711676338 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f470412f070 0x7f4704135c30 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f46f00098a0 tx=0x7f46f0009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4a8ed020a204543 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:21.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.345+0000 7f47037fe700 1 -- 172.21.15.40:0/711676338 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f000d980 con 0x7f470412f070 2023-09-30T22:29:21.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.346+0000 7f47037fe700 1 -- 172.21.15.40:0/711676338 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f000dae0 con 0x7f470412f070 2023-09-30T22:29:21.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.346+0000 7f47037fe700 1 -- 172.21.15.40:0/711676338 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f000de70 con 0x7f470412f070 2023-09-30T22:29:21.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.346+0000 7f470ad5c700 1 -- 172.21.15.40:0/711676338 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f470412f070 msgr2=0x7f4704135c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:21.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.346+0000 7f470ad5c700 1 --2- 172.21.15.40:0/711676338 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f470412f070 0x7f4704135c30 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f46f00098a0 tx=0x7f46f0009bb0 comp rx=0 tx=0).stop 2023-09-30T22:29:21.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.346+0000 7f470ad5c700 1 -- 172.21.15.40:0/711676338 shutdown_connections 2023-09-30T22:29:21.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.346+0000 7f470ad5c700 1 --2- 172.21.15.40:0/711676338 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4704136170 0x7f4704138550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:21.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.346+0000 7f470ad5c700 1 --2- 172.21.15.40:0/711676338 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f470412f070 0x7f4704135c30 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:21.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.346+0000 7f470ad5c700 1 -- 172.21.15.40:0/711676338 >> 172.21.15.40:0/711676338 conn(0x7f47040a2a00 msgr2=0x7f47040a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:21.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.347+0000 7f470ad5c700 1 -- 172.21.15.40:0/711676338 shutdown_connections 2023-09-30T22:29:21.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.347+0000 7f470ad5c700 1 -- 172.21.15.40:0/711676338 wait complete. 2023-09-30T22:29:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.348+0000 7f470ad5c700 1 Processor -- start 2023-09-30T22:29:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.348+0000 7f470ad5c700 1 -- start start 2023-09-30T22:29:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.349+0000 7f470ad5c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f470412e590 0x7f47041c4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.349+0000 7f470ad5c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f470412f070 0x7f47041c4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.349+0000 7f470ad5c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4704136170 0x7f47041c4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.349+0000 7f470ad5c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470411ac80 con 0x7f470412f070 2023-09-30T22:29:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.349+0000 7f470ad5c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4704119940 con 0x7f470412e590 2023-09-30T22:29:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.349+0000 7f470ad5c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47040a2620 con 0x7f4704136170 2023-09-30T22:29:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.349+0000 7f4708af8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f470412e590 0x7f47041c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.349+0000 7f4708af8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f470412e590 0x7f47041c4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:58030/0 (socket says 172.21.15.40:58030) 2023-09-30T22:29:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.349+0000 7f4708af8700 1 -- 172.21.15.40:0/203145219 learned_addr learned my addr 172.21.15.40:0/203145219 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:21.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.349+0000 7f4703fff700 1 --2- 172.21.15.40:0/203145219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f470412f070 0x7f47041c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:21.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.349+0000 7f47092f9700 1 --2- 172.21.15.40:0/203145219 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4704136170 0x7f47041c4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:21.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.350+0000 7f4708af8700 1 -- 172.21.15.40:0/203145219 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4704136170 msgr2=0x7f47041c4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:21.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.350+0000 7f4708af8700 1 --2- 172.21.15.40:0/203145219 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4704136170 0x7f47041c4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:21.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.350+0000 7f4708af8700 1 -- 172.21.15.40:0/203145219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f470412f070 msgr2=0x7f47041c4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:21.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.350+0000 7f4708af8700 1 --2- 172.21.15.40:0/203145219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f470412f070 0x7f47041c4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:21.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.350+0000 7f4708af8700 1 -- 172.21.15.40:0/203145219 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46fc009a70 con 0x7f470412e590 2023-09-30T22:29:21.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.350+0000 7f47092f9700 1 --2- 172.21.15.40:0/203145219 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4704136170 0x7f47041c4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:21.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.350+0000 7f4703fff700 1 --2- 172.21.15.40:0/203145219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f470412f070 0x7f47041c4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:21.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.350+0000 7f4708af8700 1 --2- 172.21.15.40:0/203145219 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f470412e590 0x7f47041c4350 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f46f800c520 tx=0x7f46f800c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:21.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.350+0000 7f47017fa700 1 -- 172.21.15.40:0/203145219 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f8004c80 con 0x7f470412e590 2023-09-30T22:29:21.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.350+0000 7f47017fa700 1 -- 172.21.15.40:0/203145219 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f8004de0 con 0x7f470412e590 2023-09-30T22:29:21.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.350+0000 7f470ad5c700 1 -- 172.21.15.40:0/203145219 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46f00094a0 con 0x7f470412e590 2023-09-30T22:29:21.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.350+0000 7f47017fa700 1 -- 172.21.15.40:0/203145219 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f8007310 con 0x7f470412e590 2023-09-30T22:29:21.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.350+0000 7f470ad5c700 1 -- 172.21.15.40:0/203145219 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f470411a900 con 0x7f470412e590 2023-09-30T22:29:21.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.351+0000 7f47017fa700 1 -- 172.21.15.40:0/203145219 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f46f8007470 con 0x7f470412e590 2023-09-30T22:29:21.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.351+0000 7f47017fa700 1 -- 172.21.15.40:0/203145219 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f46f803f220 con 0x7f470412e590 2023-09-30T22:29:21.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.352+0000 7f470ad5c700 1 -- 172.21.15.40:0/203145219 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4704062380 con 0x7f470412e590 2023-09-30T22:29:21.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.361+0000 7f47017fa700 1 -- 172.21.15.40:0/203145219 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f46f800ce60 con 0x7f470412e590 2023-09-30T22:29:21.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.392+0000 7fadf27ca700 1 Processor -- start 2023-09-30T22:29:21.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.392+0000 7fadf27ca700 1 -- start start 2023-09-30T22:29:21.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.392+0000 7fadf27ca700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadec133e00 0x7fadec1341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:21.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.392+0000 7fadf27ca700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadec09d400 0x7fadec09d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:21.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.392+0000 7fadf27ca700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadec133940 con 0x7fadec09dd70 2023-09-30T22:29:21.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.392+0000 7fadf27ca700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadec09ab20 con 0x7fadec09d400 2023-09-30T22:29:21.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.392+0000 7fadf27ca700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fadec09f0d0 con 0x7fadec133e00 2023-09-30T22:29:21.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.393+0000 7fadebfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadec133e00 0x7fadec1341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:21.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.393+0000 7fadeb7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadec09d400 0x7fadec09d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:21.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.393+0000 7fadebfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadec133e00 0x7fadec1341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:35366/0 (socket says 172.21.15.40:35366) 2023-09-30T22:29:21.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.393+0000 7fadebfff700 1 -- 172.21.15.40:0/1991036466 learned_addr learned my addr 172.21.15.40:0/1991036466 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:21.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.393+0000 7fadebfff700 1 -- 172.21.15.40:0/1991036466 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadec09d400 msgr2=0x7fadec09d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:21.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.393+0000 7fadebfff700 1 --2- 172.21.15.40:0/1991036466 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadec09d400 0x7fadec09d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:21.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.393+0000 7fadebfff700 1 -- 172.21.15.40:0/1991036466 >> v1:172.21.15.40:6789/0 conn(0x7fadec09dd70 legacy=0x7fadec13ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:21.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.393+0000 7fadebfff700 1 -- 172.21.15.40:0/1991036466 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadec09e210 con 0x7fadec133e00 2023-09-30T22:29:21.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.393+0000 7fadebfff700 1 --2- 172.21.15.40:0/1991036466 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadec133e00 0x7fadec1341d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7faddc009920 tx=0x7faddc009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf285f606a7cc4aa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:21.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.393+0000 7fadeaffd700 1 -- 172.21.15.40:0/1991036466 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faddc00ba60 con 0x7fadec133e00 2023-09-30T22:29:21.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.393+0000 7fadeaffd700 1 -- 172.21.15.40:0/1991036466 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faddc00bbc0 con 0x7fadec133e00 2023-09-30T22:29:21.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.393+0000 7fadeaffd700 1 -- 172.21.15.40:0/1991036466 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faddc009e70 con 0x7fadec133e00 2023-09-30T22:29:21.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.394+0000 7fadf27ca700 1 -- 172.21.15.40:0/1991036466 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadec133e00 msgr2=0x7fadec1341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:21.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.394+0000 7fadf27ca700 1 --2- 172.21.15.40:0/1991036466 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadec133e00 0x7fadec1341d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7faddc009920 tx=0x7faddc009c30 comp rx=0 tx=0).stop 2023-09-30T22:29:21.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.394+0000 7fadf27ca700 1 -- 172.21.15.40:0/1991036466 shutdown_connections 2023-09-30T22:29:21.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.394+0000 7fadf27ca700 1 --2- 172.21.15.40:0/1991036466 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadec133e00 0x7fadec1341d0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:21.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.394+0000 7fadf27ca700 1 --2- 172.21.15.40:0/1991036466 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadec09d400 0x7fadec09d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:21.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.394+0000 7fadf27ca700 1 -- 172.21.15.40:0/1991036466 >> 172.21.15.40:0/1991036466 conn(0x7fadec0a2a00 msgr2=0x7fadec0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:21.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.394+0000 7fadf27ca700 1 -- 172.21.15.40:0/1991036466 shutdown_connections 2023-09-30T22:29:21.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.394+0000 7fadf27ca700 1 -- 172.21.15.40:0/1991036466 wait complete. 2023-09-30T22:29:21.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.395+0000 7fadf27ca700 1 Processor -- start 2023-09-30T22:29:21.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.395+0000 7fadf27ca700 1 -- start start 2023-09-30T22:29:21.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.396+0000 7fadf27ca700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadec09d400 0x7fadec12fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:21.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.396+0000 7fadf27ca700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadec09dd70 0x7fadec130350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:21.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.396+0000 7fadf27ca700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadec133e00 0x7fadec130890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:21.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.396+0000 7fadf27ca700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadec11b210 con 0x7fadec133e00 2023-09-30T22:29:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.396+0000 7fadf27ca700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadec11bdd0 con 0x7fadec09d400 2023-09-30T22:29:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.396+0000 7fadf27ca700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fadec11b410 con 0x7fadec09dd70 2023-09-30T22:29:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.396+0000 7fadeb7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadec09dd70 0x7fadec130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.396+0000 7fadebfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadec09d400 0x7fadec12fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.396+0000 7fadeb7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadec09dd70 0x7fadec130350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:35372/0 (socket says 172.21.15.40:35372) 2023-09-30T22:29:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.396+0000 7fadeb7fe700 1 -- 172.21.15.40:0/818416696 learned_addr learned my addr 172.21.15.40:0/818416696 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.397+0000 7fadf0d67700 1 --2- 172.21.15.40:0/818416696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadec133e00 0x7fadec130890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.397+0000 7fadeb7fe700 1 -- 172.21.15.40:0/818416696 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadec09d400 msgr2=0x7fadec12fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.397+0000 7fadeb7fe700 1 --2- 172.21.15.40:0/818416696 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadec09d400 0x7fadec12fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.397+0000 7fadeb7fe700 1 -- 172.21.15.40:0/818416696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadec133e00 msgr2=0x7fadec130890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.397+0000 7fadeb7fe700 1 --2- 172.21.15.40:0/818416696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadec133e00 0x7fadec130890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:21.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.397+0000 7fadeb7fe700 1 -- 172.21.15.40:0/818416696 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faddc009550 con 0x7fadec09dd70 2023-09-30T22:29:21.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.397+0000 7fadf0d67700 1 --2- 172.21.15.40:0/818416696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadec133e00 0x7fadec130890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:21.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.397+0000 7fadeb7fe700 1 --2- 172.21.15.40:0/818416696 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadec09dd70 0x7fadec130350 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fade000e840 tx=0x7fade000eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:21.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.397+0000 7fade8ff9700 1 -- 172.21.15.40:0/818416696 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade0013610 con 0x7fadec09dd70 2023-09-30T22:29:21.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.397+0000 7fade8ff9700 1 -- 172.21.15.40:0/818416696 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade0013770 con 0x7fadec09dd70 2023-09-30T22:29:21.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.397+0000 7fadf27ca700 1 -- 172.21.15.40:0/818416696 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadec12e160 con 0x7fadec09dd70 2023-09-30T22:29:21.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.397+0000 7fade8ff9700 1 -- 172.21.15.40:0/818416696 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade0013ae0 con 0x7fadec09dd70 2023-09-30T22:29:21.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.397+0000 7fadf27ca700 1 -- 172.21.15.40:0/818416696 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadec11a2b0 con 0x7fadec09dd70 2023-09-30T22:29:21.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.398+0000 7fade8ff9700 1 -- 172.21.15.40:0/818416696 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fade0013c40 con 0x7fadec09dd70 2023-09-30T22:29:21.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.398+0000 7fade8ff9700 1 -- 172.21.15.40:0/818416696 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fade003f3a0 con 0x7fadec09dd70 2023-09-30T22:29:21.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.398+0000 7fadf27ca700 1 -- 172.21.15.40:0/818416696 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadec11acc0 con 0x7fadec09dd70 2023-09-30T22:29:21.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.403+0000 7fade8ff9700 1 -- 172.21.15.40:0/818416696 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fade0012370 con 0x7fadec09dd70 2023-09-30T22:29:21.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.460+0000 7fa3c0cc9700 1 Processor -- start 2023-09-30T22:29:21.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.460+0000 7fa3c0cc9700 1 -- start start 2023-09-30T22:29:21.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.461+0000 7fa3c0cc9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa3bc06fb50 0x7fa3bc136c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:21.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.461+0000 7fa3c0cc9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa3bc1371b0 0x7fa3bc139590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:21.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.461+0000 7fa3c0cc9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3bc070830 con 0x7fa3bc06f070 2023-09-30T22:29:21.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.461+0000 7fa3c0cc9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3bc071af0 con 0x7fa3bc1371b0 2023-09-30T22:29:21.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.461+0000 7fa3c0cc9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc070ad0 con 0x7fa3bc06fb50 2023-09-30T22:29:21.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.461+0000 7fa3b9d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa3bc06fb50 0x7fa3bc136c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:21.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.461+0000 7fa3b9d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa3bc06fb50 0x7fa3bc136c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:35384/0 (socket says 172.21.15.40:35384) 2023-09-30T22:29:21.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.461+0000 7fa3b9d9b700 1 -- 172.21.15.40:0/1616308857 learned_addr learned my addr 172.21.15.40:0/1616308857 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:21.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.461+0000 7fa3bad9d700 1 --2- 172.21.15.40:0/1616308857 >> v2:172.21.15.40:3300/0 conn(0x7fa3bc1371b0 0x7fa3bc139590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:21.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.461+0000 7fa3bad9d700 1 -- 172.21.15.40:0/1616308857 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa3bc06fb50 msgr2=0x7fa3bc136c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:21.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.461+0000 7fa3bad9d700 1 --2- 172.21.15.40:0/1616308857 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa3bc06fb50 0x7fa3bc136c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:21.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.461+0000 7fa3bad9d700 1 -- 172.21.15.40:0/1616308857 >> v1:172.21.15.40:6789/0 conn(0x7fa3bc06f070 legacy=0x7fa3bc06f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:21.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.461+0000 7fa3bad9d700 1 -- 172.21.15.40:0/1616308857 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3bc070de0 con 0x7fa3bc1371b0 2023-09-30T22:29:21.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.461+0000 7fa3b9d9b700 1 --2- 172.21.15.40:0/1616308857 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa3bc06fb50 0x7fa3bc136c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:21.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.462+0000 7fa3bad9d700 1 --2- 172.21.15.40:0/1616308857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3bc1371b0 0x7fa3bc139590 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4009d90 tx=0x7fa3b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f40176b54bbd5a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:21.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.462+0000 7fa3b959a700 1 -- 172.21.15.40:0/1616308857 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b400e070 con 0x7fa3bc1371b0 2023-09-30T22:29:21.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.462+0000 7fa3b959a700 1 -- 172.21.15.40:0/1616308857 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b400bb20 con 0x7fa3bc1371b0 2023-09-30T22:29:21.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.462+0000 7fa3b959a700 1 -- 172.21.15.40:0/1616308857 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4012430 con 0x7fa3bc1371b0 2023-09-30T22:29:21.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.463+0000 7fa3c0cc9700 1 -- 172.21.15.40:0/1616308857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3bc1371b0 msgr2=0x7fa3bc139590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:21.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.463+0000 7fa3c0cc9700 1 --2- 172.21.15.40:0/1616308857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3bc1371b0 0x7fa3bc139590 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4009d90 tx=0x7fa3b400b330 comp rx=0 tx=0).stop 2023-09-30T22:29:21.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.463+0000 7fa3c0cc9700 1 -- 172.21.15.40:0/1616308857 shutdown_connections 2023-09-30T22:29:21.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.463+0000 7fa3c0cc9700 1 --2- 172.21.15.40:0/1616308857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3bc1371b0 0x7fa3bc139590 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:21.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.463+0000 7fa3c0cc9700 1 --2- 172.21.15.40:0/1616308857 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa3bc06fb50 0x7fa3bc136c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:21.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.463+0000 7fa3c0cc9700 1 -- 172.21.15.40:0/1616308857 >> 172.21.15.40:0/1616308857 conn(0x7fa3bc0a41a0 msgr2=0x7fa3bc0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:21.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.463+0000 7fa3c0cc9700 1 -- 172.21.15.40:0/1616308857 shutdown_connections 2023-09-30T22:29:21.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.463+0000 7fa3c0cc9700 1 -- 172.21.15.40:0/1616308857 wait complete. 2023-09-30T22:29:21.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.464+0000 7fa3c0cc9700 1 Processor -- start 2023-09-30T22:29:21.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.464+0000 7fa3c0cc9700 1 -- start start 2023-09-30T22:29:21.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.465+0000 7fa3c0cc9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa3bc06f070 0x7fa3bc0990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:21.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.465+0000 7fa3c0cc9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3bc06fb50 0x7fa3bc0995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:21.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.465+0000 7fa3c0cc9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3bc1371b0 0x7fa3bc099b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:21.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.465+0000 7fa3c0cc9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc1362e0 con 0x7fa3bc06fb50 2023-09-30T22:29:21.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.465+0000 7fa3c0cc9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc12e5c0 con 0x7fa3bc1371b0 2023-09-30T22:29:21.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.465+0000 7fa3c0cc9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc12eee0 con 0x7fa3bc06f070 2023-09-30T22:29:21.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.465+0000 7fa3bad9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3bc1371b0 0x7fa3bc099b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:21.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.465+0000 7fa3b9d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3bc06fb50 0x7fa3bc0995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:21.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.465+0000 7fa3bad9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3bc1371b0 0x7fa3bc099b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:58042/0 (socket says 172.21.15.40:58042) 2023-09-30T22:29:21.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.465+0000 7fa3ba59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa3bc06f070 0x7fa3bc0990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:21.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.465+0000 7fa3bad9d700 1 -- 172.21.15.40:0/2944057564 learned_addr learned my addr 172.21.15.40:0/2944057564 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:21.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.466+0000 7fa3bad9d700 1 -- 172.21.15.40:0/2944057564 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa3bc06f070 msgr2=0x7fa3bc0990b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:21.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.466+0000 7fa3bad9d700 1 --2- 172.21.15.40:0/2944057564 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa3bc06f070 0x7fa3bc0990b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:21.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.466+0000 7fa3bad9d700 1 -- 172.21.15.40:0/2944057564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3bc06fb50 msgr2=0x7fa3bc0995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:21.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.466+0000 7fa3bad9d700 1 --2- 172.21.15.40:0/2944057564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3bc06fb50 0x7fa3bc0995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:21.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.466+0000 7fa3bad9d700 1 -- 172.21.15.40:0/2944057564 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b0009550 con 0x7fa3bc1371b0 2023-09-30T22:29:21.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.466+0000 7fa3ba59c700 1 --2- 172.21.15.40:0/2944057564 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa3bc06f070 0x7fa3bc0990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:21.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.466+0000 7fa3b9d9b700 1 --2- 172.21.15.40:0/2944057564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3bc06fb50 0x7fa3bc0995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:21.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.466+0000 7fa3bad9d700 1 --2- 172.21.15.40:0/2944057564 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3bc1371b0 0x7fa3bc099b30 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4014040 tx=0x7fa3b4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:21.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.466+0000 7fa3aaffd700 1 -- 172.21.15.40:0/2944057564 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4012430 con 0x7fa3bc1371b0 2023-09-30T22:29:21.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.466+0000 7fa3aaffd700 1 -- 172.21.15.40:0/2944057564 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b4020070 con 0x7fa3bc1371b0 2023-09-30T22:29:21.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.466+0000 7fa3c0cc9700 1 -- 172.21.15.40:0/2944057564 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b4009a70 con 0x7fa3bc1371b0 2023-09-30T22:29:21.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.466+0000 7fa3aaffd700 1 -- 172.21.15.40:0/2944057564 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4003ea0 con 0x7fa3bc1371b0 2023-09-30T22:29:21.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.466+0000 7fa3c0cc9700 1 -- 172.21.15.40:0/2944057564 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3bc12ec00 con 0x7fa3bc1371b0 2023-09-30T22:29:21.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.467+0000 7fa3aaffd700 1 -- 172.21.15.40:0/2944057564 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa3b4004280 con 0x7fa3bc1371b0 2023-09-30T22:29:21.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.467+0000 7fa3c0cc9700 1 -- 172.21.15.40:0/2944057564 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3bc062380 con 0x7fa3bc1371b0 2023-09-30T22:29:21.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.468+0000 7fa3aaffd700 1 -- 172.21.15.40:0/2944057564 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa3b4022070 con 0x7fa3bc1371b0 2023-09-30T22:29:21.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.476+0000 7fa3aaffd700 1 -- 172.21.15.40:0/2944057564 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa3b4012e60 con 0x7fa3bc1371b0 2023-09-30T22:29:21.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.481+0000 7f05fc578700 1 Processor -- start 2023-09-30T22:29:21.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.482+0000 7f05fc578700 1 -- start start 2023-09-30T22:29:21.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.482+0000 7f05fc578700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05f409d920 0x7f05f409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:21.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.482+0000 7f05fc578700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05f4130fb0 0x7f05f4138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:21.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.482+0000 7f05fc578700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05f409adf0 con 0x7f05f409e230 2023-09-30T22:29:21.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.482+0000 7f05fc578700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f409edf0 con 0x7f05f4130fb0 2023-09-30T22:29:21.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.482+0000 7f05fc578700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05f409b660 con 0x7f05f409d920 2023-09-30T22:29:21.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.482+0000 7f05f9b13700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f05f409e230 0x7f05f41308a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52554/0 (socket says 172.21.15.40:52554) 2023-09-30T22:29:21.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.482+0000 7f05f9b13700 1 -- 172.21.15.40:0/3829435532 learned_addr learned my addr 172.21.15.40:0/3829435532 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:29:21.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.482+0000 7f05fab15700 1 --2- 172.21.15.40:0/3829435532 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05f4130fb0 0x7f05f4138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:21.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.483+0000 7f05fa314700 1 --2- 172.21.15.40:0/3829435532 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05f409d920 0x7f05f409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:21.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.483+0000 7f05f9312700 1 -- 172.21.15.40:0/3829435532 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 151469510 0 0) 0x7f05f409adf0 con 0x7f05f409e230 2023-09-30T22:29:21.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.483+0000 7f05f9312700 1 -- 172.21.15.40:0/3829435532 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05e00035b0 con 0x7f05f409e230 2023-09-30T22:29:21.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.483+0000 7f05fa314700 1 -- 172.21.15.40:0/3829435532 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05f4130fb0 msgr2=0x7f05f4138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:21.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.483+0000 7f05fa314700 1 --2- 172.21.15.40:0/3829435532 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05f4130fb0 0x7f05f4138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:21.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.483+0000 7f05fa314700 1 -- 172.21.15.40:0/3829435532 >> v1:172.21.15.40:6789/0 conn(0x7f05f409e230 legacy=0x7f05f41308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:21.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.483+0000 7f05fa314700 1 -- 172.21.15.40:0/3829435532 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f409a6e0 con 0x7f05f409d920 2023-09-30T22:29:21.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.483+0000 7f05fa314700 1 --2- 172.21.15.40:0/3829435532 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05f409d920 0x7f05f409dcf0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f05f0009850 tx=0x7f05f0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b443f292e0c8a0f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:21.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.486+0000 7f05f9312700 1 -- 172.21.15.40:0/3829435532 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f0005e30 con 0x7f05f409d920 2023-09-30T22:29:21.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.486+0000 7f05f9312700 1 -- 172.21.15.40:0/3829435532 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f0004030 con 0x7f05f409d920 2023-09-30T22:29:21.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.486+0000 7f05f9312700 1 -- 172.21.15.40:0/3829435532 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f00043a0 con 0x7f05f409d920 2023-09-30T22:29:21.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.486+0000 7f05fc578700 1 -- 172.21.15.40:0/3829435532 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05f409d920 msgr2=0x7f05f409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:21.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.486+0000 7f05fc578700 1 --2- 172.21.15.40:0/3829435532 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05f409d920 0x7f05f409dcf0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f05f0009850 tx=0x7f05f0009b60 comp rx=0 tx=0).stop 2023-09-30T22:29:21.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.487+0000 7f05fc578700 1 -- 172.21.15.40:0/3829435532 shutdown_connections 2023-09-30T22:29:21.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.487+0000 7f05fc578700 1 --2- 172.21.15.40:0/3829435532 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05f4130fb0 0x7f05f4138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:21.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.487+0000 7f05fc578700 1 --2- 172.21.15.40:0/3829435532 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05f409d920 0x7f05f409dcf0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:21.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.487+0000 7f05fc578700 1 -- 172.21.15.40:0/3829435532 >> 172.21.15.40:0/3829435532 conn(0x7f05f409fb20 msgr2=0x7f05f409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:21.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.487+0000 7f05fc578700 1 -- 172.21.15.40:0/3829435532 shutdown_connections 2023-09-30T22:29:21.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.487+0000 7f05fc578700 1 -- 172.21.15.40:0/3829435532 wait complete. 2023-09-30T22:29:21.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.488+0000 7f05fc578700 1 Processor -- start 2023-09-30T22:29:21.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.488+0000 7f05fc578700 1 -- start start 2023-09-30T22:29:21.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.488+0000 7f05fc578700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05f409d920 0x7f05f412a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:21.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.488+0000 7f05fc578700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05f409e230 0x7f05f412ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:21.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.488+0000 7f05fc578700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05f4130fb0 0x7f05f412b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:21.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.488+0000 7f05fc578700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f412c960 con 0x7f05f409d920 2023-09-30T22:29:21.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.488+0000 7f05fc578700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f412d6e0 con 0x7f05f4130fb0 2023-09-30T22:29:21.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.488+0000 7f05fc578700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05f409cb00 con 0x7f05f409e230 2023-09-30T22:29:21.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.488+0000 7f05fab15700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05f4130fb0 0x7f05f412b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:21.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.488+0000 7f05fab15700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05f4130fb0 0x7f05f412b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:58062/0 (socket says 172.21.15.40:58062) 2023-09-30T22:29:21.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.488+0000 7f05fab15700 1 -- 172.21.15.40:0/4159946189 learned_addr learned my addr 172.21.15.40:0/4159946189 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:21.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.488+0000 7f05f9b13700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05f409e230 0x7f05f412ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:21.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.489+0000 7f05fa314700 1 --2- 172.21.15.40:0/4159946189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05f409d920 0x7f05f412a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:21.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.489+0000 7f05f9b13700 1 -- 172.21.15.40:0/4159946189 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05f4130fb0 msgr2=0x7f05f412b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:21.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.489+0000 7f05f9b13700 1 --2- 172.21.15.40:0/4159946189 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05f4130fb0 0x7f05f412b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:21.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.489+0000 7f05f9b13700 1 -- 172.21.15.40:0/4159946189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05f409d920 msgr2=0x7f05f412a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:21.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.489+0000 7f05f9b13700 1 --2- 172.21.15.40:0/4159946189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05f409d920 0x7f05f412a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:21.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.489+0000 7f05f9b13700 1 -- 172.21.15.40:0/4159946189 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f0009430 con 0x7f05f409e230 2023-09-30T22:29:21.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.489+0000 7f05fa314700 1 --2- 172.21.15.40:0/4159946189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05f409d920 0x7f05f412a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:21.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.489+0000 7f05f9b13700 1 --2- 172.21.15.40:0/4159946189 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05f409e230 0x7f05f412ab60 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f05e400c4b0 tx=0x7f05e400c7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:21.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.489+0000 7f05eaffd700 1 -- 172.21.15.40:0/4159946189 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e4004c80 con 0x7f05f409e230 2023-09-30T22:29:21.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.489+0000 7f05fc578700 1 -- 172.21.15.40:0/4159946189 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f412cb80 con 0x7f05f409e230 2023-09-30T22:29:21.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.489+0000 7f05eaffd700 1 -- 172.21.15.40:0/4159946189 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e4004e00 con 0x7f05f409e230 2023-09-30T22:29:21.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.489+0000 7f05fc578700 1 -- 172.21.15.40:0/4159946189 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f406b360 con 0x7f05f409e230 2023-09-30T22:29:21.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.490+0000 7f05eaffd700 1 -- 172.21.15.40:0/4159946189 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e4007310 con 0x7f05f409e230 2023-09-30T22:29:21.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.491+0000 7f05eaffd700 1 -- 172.21.15.40:0/4159946189 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f05e4007470 con 0x7f05f409e230 2023-09-30T22:29:21.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.491+0000 7f05fc578700 1 -- 172.21.15.40:0/4159946189 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05dc0052e0 con 0x7f05f409e230 2023-09-30T22:29:21.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.491+0000 7f05eaffd700 1 -- 172.21.15.40:0/4159946189 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f05e403f3c0 con 0x7f05f409e230 2023-09-30T22:29:21.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.500+0000 7f05eaffd700 1 -- 172.21.15.40:0/4159946189 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f05e401a6c0 con 0x7f05f409e230 2023-09-30T22:29:21.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.581+0000 7f470ad5c700 1 -- 172.21.15.40:0/203145219 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f47040a20e0 con 0x7f470412e590 2023-09-30T22:29:21.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.581+0000 7f47017fa700 1 -- 172.21.15.40:0/203145219 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f46f803f020 con 0x7f470412e590 2023-09-30T22:29:21.583 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:21.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.584+0000 7f470ad5c700 1 -- 172.21.15.40:0/203145219 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f470412e590 msgr2=0x7f47041c4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:21.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.584+0000 7f470ad5c700 1 --2- 172.21.15.40:0/203145219 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f470412e590 0x7f47041c4350 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f46f800c520 tx=0x7f46f800c830 comp rx=0 tx=0).stop 2023-09-30T22:29:21.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.584+0000 7f470ad5c700 1 -- 172.21.15.40:0/203145219 shutdown_connections 2023-09-30T22:29:21.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.584+0000 7f470ad5c700 1 --2- 172.21.15.40:0/203145219 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4704136170 0x7f47041c4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:21.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.584+0000 7f470ad5c700 1 --2- 172.21.15.40:0/203145219 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f470412e590 0x7f47041c4350 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:21.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.584+0000 7f470ad5c700 1 --2- 172.21.15.40:0/203145219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f470412f070 0x7f47041c4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:21.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.584+0000 7f470ad5c700 1 -- 172.21.15.40:0/203145219 >> 172.21.15.40:0/203145219 conn(0x7f47040a2a00 msgr2=0x7f4704099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:21.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.584+0000 7f470ad5c700 1 -- 172.21.15.40:0/203145219 shutdown_connections 2023-09-30T22:29:21.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.584+0000 7f470ad5c700 1 -- 172.21.15.40:0/203145219 wait complete. 2023-09-30T22:29:21.602 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:21.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.608+0000 7fadf27ca700 1 -- 172.21.15.40:0/818416696 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fadec062380 con 0x7fadec09dd70 2023-09-30T22:29:21.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.608+0000 7fade8ff9700 1 -- 172.21.15.40:0/818416696 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fade0021020 con 0x7fadec09dd70 2023-09-30T22:29:21.609 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:21.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.610+0000 7fadf27ca700 1 -- 172.21.15.40:0/818416696 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadec09dd70 msgr2=0x7fadec130350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:21.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.610+0000 7fadf27ca700 1 --2- 172.21.15.40:0/818416696 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadec09dd70 0x7fadec130350 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fade000e840 tx=0x7fade000eb50 comp rx=0 tx=0).stop 2023-09-30T22:29:21.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.610+0000 7fadf27ca700 1 -- 172.21.15.40:0/818416696 shutdown_connections 2023-09-30T22:29:21.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.610+0000 7fadf27ca700 1 --2- 172.21.15.40:0/818416696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadec133e00 0x7fadec130890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:21.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.610+0000 7fadf27ca700 1 --2- 172.21.15.40:0/818416696 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadec09d400 0x7fadec12fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:21.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.610+0000 7fadf27ca700 1 --2- 172.21.15.40:0/818416696 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadec09dd70 0x7fadec130350 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:21.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.610+0000 7fadf27ca700 1 -- 172.21.15.40:0/818416696 >> 172.21.15.40:0/818416696 conn(0x7fadec0a2a00 msgr2=0x7fadec12c660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:21.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.611+0000 7fadf27ca700 1 -- 172.21.15.40:0/818416696 shutdown_connections 2023-09-30T22:29:21.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.611+0000 7fadf27ca700 1 -- 172.21.15.40:0/818416696 wait complete. 2023-09-30T22:29:21.624 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:21.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.692+0000 7fa3c0cc9700 1 -- 172.21.15.40:0/2944057564 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa3bc0a04e0 con 0x7fa3bc1371b0 2023-09-30T22:29:21.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.692+0000 7fa3aaffd700 1 -- 172.21.15.40:0/2944057564 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa3b402c030 con 0x7fa3bc1371b0 2023-09-30T22:29:21.693 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:21.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.694+0000 7fa3c0cc9700 1 -- 172.21.15.40:0/2944057564 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3bc1371b0 msgr2=0x7fa3bc099b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:21.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.694+0000 7fa3c0cc9700 1 --2- 172.21.15.40:0/2944057564 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3bc1371b0 0x7fa3bc099b30 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4014040 tx=0x7fa3b4004ad0 comp rx=0 tx=0).stop 2023-09-30T22:29:21.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.694+0000 7fa3c0cc9700 1 -- 172.21.15.40:0/2944057564 shutdown_connections 2023-09-30T22:29:21.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.694+0000 7fa3c0cc9700 1 --2- 172.21.15.40:0/2944057564 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa3bc06f070 0x7fa3bc0990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:21.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.694+0000 7fa3c0cc9700 1 --2- 172.21.15.40:0/2944057564 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3bc1371b0 0x7fa3bc099b30 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:21.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.694+0000 7fa3c0cc9700 1 --2- 172.21.15.40:0/2944057564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3bc06fb50 0x7fa3bc0995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:21.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.694+0000 7fa3c0cc9700 1 -- 172.21.15.40:0/2944057564 >> 172.21.15.40:0/2944057564 conn(0x7fa3bc0a41a0 msgr2=0x7fa3bc0a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:21.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.694+0000 7fa3c0cc9700 1 -- 172.21.15.40:0/2944057564 shutdown_connections 2023-09-30T22:29:21.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.694+0000 7fa3c0cc9700 1 -- 172.21.15.40:0/2944057564 wait complete. 2023-09-30T22:29:21.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.698+0000 7f05fc578700 1 -- 172.21.15.40:0/4159946189 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f05dc005590 con 0x7f05f409e230 2023-09-30T22:29:21.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.698+0000 7f05eaffd700 1 -- 172.21.15.40:0/4159946189 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f05e4011360 con 0x7f05f409e230 2023-09-30T22:29:21.700 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:21.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.700+0000 7f05fc578700 1 -- 172.21.15.40:0/4159946189 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05f409e230 msgr2=0x7f05f412ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:21.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.700+0000 7f05fc578700 1 --2- 172.21.15.40:0/4159946189 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05f409e230 0x7f05f412ab60 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f05e400c4b0 tx=0x7f05e400c7c0 comp rx=0 tx=0).stop 2023-09-30T22:29:21.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.700+0000 7f05fc578700 1 -- 172.21.15.40:0/4159946189 shutdown_connections 2023-09-30T22:29:21.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.700+0000 7f05fc578700 1 --2- 172.21.15.40:0/4159946189 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05f4130fb0 0x7f05f412b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:21.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.700+0000 7f05fc578700 1 --2- 172.21.15.40:0/4159946189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05f409d920 0x7f05f412a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:21.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.700+0000 7f05fc578700 1 --2- 172.21.15.40:0/4159946189 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f05f409e230 0x7f05f412ab60 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:21.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.700+0000 7f05fc578700 1 -- 172.21.15.40:0/4159946189 >> 172.21.15.40:0/4159946189 conn(0x7f05f409fb20 msgr2=0x7f05f41b8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:21.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.700+0000 7f05fc578700 1 -- 172.21.15.40:0/4159946189 shutdown_connections 2023-09-30T22:29:21.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:21.700+0000 7f05fc578700 1 -- 172.21.15.40:0/4159946189 wait complete. 2023-09-30T22:29:21.709 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:21.714 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:22.603 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:22.625 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:22.709 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:22.714 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:22.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.747+0000 7f22ee6d3700 1 Processor -- start 2023-09-30T22:29:22.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.747+0000 7f22ee6d3700 1 -- start start 2023-09-30T22:29:22.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.748+0000 7f22ee6d3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f22e806f070 0x7f22e806f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:22.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.748+0000 7f22ee6d3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22e806fdb0 0x7f22e80977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:22.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.748+0000 7f22ee6d3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e8070830 con 0x7f22e806f980 2023-09-30T22:29:22.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.748+0000 7f22ee6d3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22e8070ad0 con 0x7f22e806f070 2023-09-30T22:29:22.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.748+0000 7f22ee6d3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e8070de0 con 0x7f22e806fdb0 2023-09-30T22:29:22.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.748+0000 7f22e7fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f22e806f070 0x7f22e806f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:22.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.748+0000 7f22e7fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f22e806f070 0x7f22e806f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36742/0 (socket says 172.21.15.40:36742) 2023-09-30T22:29:22.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.748+0000 7f22e7fff700 1 -- 172.21.15.40:0/3918574554 learned_addr learned my addr 172.21.15.40:0/3918574554 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:22.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.748+0000 7f22ecc70700 1 --2- 172.21.15.40:0/3918574554 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22e806fdb0 0x7f22e80977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:22.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.748+0000 7f22e7fff700 1 -- 172.21.15.40:0/3918574554 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22e806fdb0 msgr2=0x7f22e80977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:22.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.748+0000 7f22e7fff700 1 --2- 172.21.15.40:0/3918574554 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22e806fdb0 0x7f22e80977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:22.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.748+0000 7f22e7fff700 1 -- 172.21.15.40:0/3918574554 >> v1:172.21.15.40:6789/0 conn(0x7f22e806f980 legacy=0x7f22e8097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:22.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.748+0000 7f22e7fff700 1 -- 172.21.15.40:0/3918574554 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e809fe20 con 0x7f22e806f070 2023-09-30T22:29:22.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.749+0000 7f22e7fff700 1 --2- 172.21.15.40:0/3918574554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22e806f070 0x7f22e806f440 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f22d80098f0 tx=0x7f22d8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f4eb75114917ce4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:22.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.749+0000 7f22e77fe700 1 -- 172.21.15.40:0/3918574554 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d8011830 con 0x7f22e806f070 2023-09-30T22:29:22.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.749+0000 7f22e77fe700 1 -- 172.21.15.40:0/3918574554 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d8011990 con 0x7f22e806f070 2023-09-30T22:29:22.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.749+0000 7f22e77fe700 1 -- 172.21.15.40:0/3918574554 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d8011d20 con 0x7f22e806f070 2023-09-30T22:29:22.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.750+0000 7f22ee6d3700 1 -- 172.21.15.40:0/3918574554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22e806f070 msgr2=0x7f22e806f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:22.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.750+0000 7f22ee6d3700 1 --2- 172.21.15.40:0/3918574554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22e806f070 0x7f22e806f440 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f22d80098f0 tx=0x7f22d8009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:22.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.750+0000 7f22ee6d3700 1 -- 172.21.15.40:0/3918574554 shutdown_connections 2023-09-30T22:29:22.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.750+0000 7f22ee6d3700 1 --2- 172.21.15.40:0/3918574554 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22e806fdb0 0x7f22e80977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:22.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.750+0000 7f22ee6d3700 1 --2- 172.21.15.40:0/3918574554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22e806f070 0x7f22e806f440 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:22.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.750+0000 7f22ee6d3700 1 -- 172.21.15.40:0/3918574554 >> 172.21.15.40:0/3918574554 conn(0x7f22e80a41a0 msgr2=0x7f22e80a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:22.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.750+0000 7f22ee6d3700 1 -- 172.21.15.40:0/3918574554 shutdown_connections 2023-09-30T22:29:22.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.750+0000 7f22ee6d3700 1 -- 172.21.15.40:0/3918574554 wait complete. 2023-09-30T22:29:22.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.751+0000 7f22ee6d3700 1 Processor -- start 2023-09-30T22:29:22.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.752+0000 7f22ee6d3700 1 -- start start 2023-09-30T22:29:22.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.752+0000 7f22ee6d3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22e806f070 0x7f22e812d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:22.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.752+0000 7f22ee6d3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22e806f980 0x7f22e812da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:22.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.752+0000 7f22ee6d3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22e806fdb0 0x7f22e812dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:22.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.752+0000 7f22ee6d3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e812e920 con 0x7f22e806f070 2023-09-30T22:29:22.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.752+0000 7f22ee6d3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e812fee0 con 0x7f22e806f980 2023-09-30T22:29:22.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.752+0000 7f22ee6d3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22e81294a0 con 0x7f22e806fdb0 2023-09-30T22:29:22.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.753+0000 7f22dffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22e806f980 0x7f22e812da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:22.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.753+0000 7f22dffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22e806f980 0x7f22e812da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:58086/0 (socket says 172.21.15.40:58086) 2023-09-30T22:29:22.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.753+0000 7f22dffff700 1 -- 172.21.15.40:0/2905899215 learned_addr learned my addr 172.21.15.40:0/2905899215 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:22.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.753+0000 7f22ecc70700 1 --2- 172.21.15.40:0/2905899215 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22e806fdb0 0x7f22e812dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:22.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.753+0000 7f22e7fff700 1 --2- 172.21.15.40:0/2905899215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22e806f070 0x7f22e812d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:22.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.753+0000 7f22dffff700 1 -- 172.21.15.40:0/2905899215 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22e806fdb0 msgr2=0x7f22e812dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:22.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.753+0000 7f22dffff700 1 --2- 172.21.15.40:0/2905899215 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22e806fdb0 0x7f22e812dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:22.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.753+0000 7f22dffff700 1 -- 172.21.15.40:0/2905899215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22e806f070 msgr2=0x7f22e812d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:22.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.753+0000 7f22dffff700 1 --2- 172.21.15.40:0/2905899215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22e806f070 0x7f22e812d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:22.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.753+0000 7f22dffff700 1 -- 172.21.15.40:0/2905899215 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d8009550 con 0x7f22e806f980 2023-09-30T22:29:22.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.753+0000 7f22dffff700 1 --2- 172.21.15.40:0/2905899215 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22e806f980 0x7f22e812da70 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f22d0001920 tx=0x7f22d0001c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:22.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.753+0000 7f22e57fa700 1 -- 172.21.15.40:0/2905899215 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d0014030 con 0x7f22e806f980 2023-09-30T22:29:22.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.753+0000 7f22e57fa700 1 -- 172.21.15.40:0/2905899215 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d000d070 con 0x7f22e806f980 2023-09-30T22:29:22.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.754+0000 7f22ee6d3700 1 -- 172.21.15.40:0/2905899215 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e812c2d0 con 0x7f22e806f980 2023-09-30T22:29:22.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.754+0000 7f22ee6d3700 1 -- 172.21.15.40:0/2905899215 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22e8130bd0 con 0x7f22e806f980 2023-09-30T22:29:22.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.754+0000 7f22e57fa700 1 -- 172.21.15.40:0/2905899215 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d00052f0 con 0x7f22e806f980 2023-09-30T22:29:22.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.755+0000 7f22ee6d3700 1 -- 172.21.15.40:0/2905899215 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22cc0052e0 con 0x7f22e806f980 2023-09-30T22:29:22.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.755+0000 7f22e57fa700 1 -- 172.21.15.40:0/2905899215 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f22d0017070 con 0x7f22e806f980 2023-09-30T22:29:22.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.755+0000 7f22e57fa700 1 -- 172.21.15.40:0/2905899215 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f22d0015070 con 0x7f22e806f980 2023-09-30T22:29:22.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.764+0000 7f22e57fa700 1 -- 172.21.15.40:0/2905899215 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f22d00199c0 con 0x7f22e806f980 2023-09-30T22:29:22.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.792+0000 7f3a8b6e1700 1 Processor -- start 2023-09-30T22:29:22.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.792+0000 7f3a8b6e1700 1 -- start start 2023-09-30T22:29:22.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.792+0000 7f3a8b6e1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3a8409d920 0x7f3a8409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:22.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.792+0000 7f3a8b6e1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a8409f0f0 0x7f3a8409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:22.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.792+0000 7f3a8b6e1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a84133ca0 0x7f3a84134110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:22.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.792+0000 7f3a8b6e1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a8406b4c0 con 0x7f3a8409d920 2023-09-30T22:29:22.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.792+0000 7f3a8b6e1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8409a8f0 con 0x7f3a8409f0f0 2023-09-30T22:29:22.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.792+0000 7f3a8b6e1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8409f940 con 0x7f3a84133ca0 2023-09-30T22:29:22.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.793+0000 7f3a88c7c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a8409f0f0 0x7f3a8409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:22.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.793+0000 7f3a88c7c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a8409f0f0 0x7f3a8409e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:58094/0 (socket says 172.21.15.40:58094) 2023-09-30T22:29:22.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.793+0000 7f3a88c7c700 1 -- 172.21.15.40:0/2245024472 learned_addr learned my addr 172.21.15.40:0/2245024472 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:22.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.793+0000 7f3a89c7e700 1 --2- 172.21.15.40:0/2245024472 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a84133ca0 0x7f3a84134110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:22.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.793+0000 7f3a8947d700 1 --2- 172.21.15.40:0/2245024472 >> v2:172.21.15.40:3300/0 conn(0x7f3a8409d920 0x7f3a8409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:22.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.793+0000 7f3a89c7e700 1 -- 172.21.15.40:0/2245024472 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a8409f0f0 msgr2=0x7f3a8409e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:22.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.793+0000 7f3a89c7e700 1 --2- 172.21.15.40:0/2245024472 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a8409f0f0 0x7f3a8409e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:22.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.793+0000 7f3a89c7e700 1 -- 172.21.15.40:0/2245024472 >> v2:172.21.15.40:3300/0 conn(0x7f3a8409d920 msgr2=0x7f3a8409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:22.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.793+0000 7f3a89c7e700 1 --2- 172.21.15.40:0/2245024472 >> v2:172.21.15.40:3300/0 conn(0x7f3a8409d920 0x7f3a8409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:22.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.793+0000 7f3a89c7e700 1 -- 172.21.15.40:0/2245024472 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8409f6e0 con 0x7f3a84133ca0 2023-09-30T22:29:22.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.793+0000 7f3a8947d700 1 --2- 172.21.15.40:0/2245024472 >> v2:172.21.15.40:3300/0 conn(0x7f3a8409d920 0x7f3a8409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:22.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.793+0000 7f3a89c7e700 1 --2- 172.21.15.40:0/2245024472 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a84133ca0 0x7f3a84134110 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c009dc0 tx=0x7f3a7c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bffd44b2996046de server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:22.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.793+0000 7f3a7bfff700 1 -- 172.21.15.40:0/2245024472 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c00e070 con 0x7f3a84133ca0 2023-09-30T22:29:22.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.793+0000 7f3a7bfff700 1 -- 172.21.15.40:0/2245024472 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7c00bae0 con 0x7f3a84133ca0 2023-09-30T22:29:22.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.793+0000 7f3a7bfff700 1 -- 172.21.15.40:0/2245024472 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c00be90 con 0x7f3a84133ca0 2023-09-30T22:29:22.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.794+0000 7f3a8b6e1700 1 -- 172.21.15.40:0/2245024472 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a84133ca0 msgr2=0x7f3a84134110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:22.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.794+0000 7f3a8b6e1700 1 --2- 172.21.15.40:0/2245024472 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a84133ca0 0x7f3a84134110 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c009dc0 tx=0x7f3a7c00b330 comp rx=0 tx=0).stop 2023-09-30T22:29:22.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.794+0000 7f3a8b6e1700 1 -- 172.21.15.40:0/2245024472 shutdown_connections 2023-09-30T22:29:22.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.794+0000 7f3a8b6e1700 1 --2- 172.21.15.40:0/2245024472 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a84133ca0 0x7f3a84134110 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:22.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.794+0000 7f3a8b6e1700 1 --2- 172.21.15.40:0/2245024472 >> v2:172.21.15.40:3300/0 conn(0x7f3a8409d920 0x7f3a8409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:22.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.794+0000 7f3a8b6e1700 1 --2- 172.21.15.40:0/2245024472 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a8409f0f0 0x7f3a8409e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:22.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.794+0000 7f3a8b6e1700 1 -- 172.21.15.40:0/2245024472 >> 172.21.15.40:0/2245024472 conn(0x7f3a8409fb20 msgr2=0x7f3a8409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:22.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.795+0000 7f3a8b6e1700 1 -- 172.21.15.40:0/2245024472 shutdown_connections 2023-09-30T22:29:22.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.795+0000 7f3a8b6e1700 1 -- 172.21.15.40:0/2245024472 wait complete. 2023-09-30T22:29:22.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.796+0000 7f3a8b6e1700 1 Processor -- start 2023-09-30T22:29:22.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.796+0000 7f3a8b6e1700 1 -- start start 2023-09-30T22:29:22.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.796+0000 7f3a8b6e1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a8409d920 0x7f3a8411e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:22.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.796+0000 7f3a8b6e1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a84133ca0 0x7f3a8411ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:22.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.796+0000 7f3a8b6e1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a8411ef70 0x7f3a841c4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:22.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.796+0000 7f3a8b6e1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8411f9c0 con 0x7f3a84133ca0 2023-09-30T22:29:22.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.796+0000 7f3a8b6e1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a84121d30 con 0x7f3a8411ef70 2023-09-30T22:29:22.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.796+0000 7f3a8b6e1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a84120210 con 0x7f3a8409d920 2023-09-30T22:29:22.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.796+0000 7f3a88c7c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a84133ca0 0x7f3a8411ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:22.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.796+0000 7f3a88c7c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a84133ca0 0x7f3a8411ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36764/0 (socket says 172.21.15.40:36764) 2023-09-30T22:29:22.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.796+0000 7f3a88c7c700 1 -- 172.21.15.40:0/1028372083 learned_addr learned my addr 172.21.15.40:0/1028372083 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:22.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.796+0000 7f3a89c7e700 1 --2- 172.21.15.40:0/1028372083 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a8411ef70 0x7f3a841c4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:22.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.797+0000 7f3a8947d700 1 --2- 172.21.15.40:0/1028372083 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a8409d920 0x7f3a8411e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:22.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.797+0000 7f3a88c7c700 1 -- 172.21.15.40:0/1028372083 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a8409d920 msgr2=0x7f3a8411e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:22.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.797+0000 7f3a88c7c700 1 --2- 172.21.15.40:0/1028372083 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a8409d920 0x7f3a8411e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:22.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.797+0000 7f3a88c7c700 1 -- 172.21.15.40:0/1028372083 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a8411ef70 msgr2=0x7f3a841c4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:22.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.797+0000 7f3a88c7c700 1 --2- 172.21.15.40:0/1028372083 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a8411ef70 0x7f3a841c4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:22.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.797+0000 7f3a88c7c700 1 -- 172.21.15.40:0/1028372083 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a80011cd0 con 0x7f3a84133ca0 2023-09-30T22:29:22.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.797+0000 7f3a89c7e700 1 --2- 172.21.15.40:0/1028372083 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a8411ef70 0x7f3a841c4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:22.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.797+0000 7f3a8947d700 1 --2- 172.21.15.40:0/1028372083 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a8409d920 0x7f3a8411e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:29:22.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.797+0000 7f3a88c7c700 1 --2- 172.21.15.40:0/1028372083 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a84133ca0 0x7f3a8411ea30 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f3a7400e910 tx=0x7f3a7400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:22.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.797+0000 7f3a79ffb700 1 -- 172.21.15.40:0/1028372083 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a740096a0 con 0x7f3a84133ca0 2023-09-30T22:29:22.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.797+0000 7f3a79ffb700 1 -- 172.21.15.40:0/1028372083 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7400c850 con 0x7f3a84133ca0 2023-09-30T22:29:22.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.797+0000 7f3a8b6e1700 1 -- 172.21.15.40:0/1028372083 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a7c009a70 con 0x7f3a84133ca0 2023-09-30T22:29:22.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.797+0000 7f3a79ffb700 1 -- 172.21.15.40:0/1028372083 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7400cc00 con 0x7f3a84133ca0 2023-09-30T22:29:22.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.797+0000 7f3a8b6e1700 1 -- 172.21.15.40:0/1028372083 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a841208c0 con 0x7f3a84133ca0 2023-09-30T22:29:22.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.798+0000 7f3a79ffb700 1 -- 172.21.15.40:0/1028372083 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3a7400cd60 con 0x7f3a84133ca0 2023-09-30T22:29:22.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.798+0000 7f3a8b6e1700 1 -- 172.21.15.40:0/1028372083 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a84062380 con 0x7f3a84133ca0 2023-09-30T22:29:22.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.799+0000 7f3a79ffb700 1 -- 172.21.15.40:0/1028372083 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3a7403f7a0 con 0x7f3a84133ca0 2023-09-30T22:29:22.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.804+0000 7f3a79ffb700 1 -- 172.21.15.40:0/1028372083 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3a740232f0 con 0x7f3a84133ca0 2023-09-30T22:29:22.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.852+0000 7f6c8bfb7700 1 Processor -- start 2023-09-30T22:29:22.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.853+0000 7f6c8bfb7700 1 -- start start 2023-09-30T22:29:22.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.853+0000 7f6c8bfb7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c84133e00 0x7f6c841341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:22.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.853+0000 7f6c8bfb7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6c8409df40 0x7f6c8413bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:22.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.853+0000 7f6c8bfb7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c84133940 con 0x7f6c8409d400 2023-09-30T22:29:22.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.853+0000 7f6c8bfb7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c8409f0d0 con 0x7f6c8409df40 2023-09-30T22:29:22.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.853+0000 7f6c8bfb7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c84133be0 con 0x7f6c84133e00 2023-09-30T22:29:22.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.853+0000 7f6c89d53700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c84133e00 0x7f6c841341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:22.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.853+0000 7f6c89d53700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c84133e00 0x7f6c841341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:35458/0 (socket says 172.21.15.40:35458) 2023-09-30T22:29:22.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.853+0000 7f6c89d53700 1 -- 172.21.15.40:0/4110264840 learned_addr learned my addr 172.21.15.40:0/4110264840 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:22.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.853+0000 7f6c8a554700 1 --2- 172.21.15.40:0/4110264840 >> v2:172.21.15.40:3300/0 conn(0x7f6c8409df40 0x7f6c8413bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:22.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.854+0000 7f6c89d53700 1 -- 172.21.15.40:0/4110264840 >> v2:172.21.15.40:3300/0 conn(0x7f6c8409df40 msgr2=0x7f6c8413bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:22.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.854+0000 7f6c89d53700 1 --2- 172.21.15.40:0/4110264840 >> v2:172.21.15.40:3300/0 conn(0x7f6c8409df40 0x7f6c8413bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:22.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.854+0000 7f6c89d53700 1 -- 172.21.15.40:0/4110264840 >> v1:172.21.15.40:6789/0 conn(0x7f6c8409d400 legacy=0x7f6c8409d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:22.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.854+0000 7f6c89d53700 1 -- 172.21.15.40:0/4110264840 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8409a860 con 0x7f6c84133e00 2023-09-30T22:29:22.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.854+0000 7f6c89d53700 1 --2- 172.21.15.40:0/4110264840 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c84133e00 0x7f6c841341d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f6c800098f0 tx=0x7f6c80009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa73852e628e06f9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:22.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.854+0000 7f6c88d51700 1 -- 172.21.15.40:0/4110264840 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80011830 con 0x7f6c84133e00 2023-09-30T22:29:22.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.854+0000 7f6c88d51700 1 -- 172.21.15.40:0/4110264840 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c80011990 con 0x7f6c84133e00 2023-09-30T22:29:22.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.854+0000 7f6c88d51700 1 -- 172.21.15.40:0/4110264840 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80011d00 con 0x7f6c84133e00 2023-09-30T22:29:22.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.855+0000 7f6c8bfb7700 1 -- 172.21.15.40:0/4110264840 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c84133e00 msgr2=0x7f6c841341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:22.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.855+0000 7f6c8bfb7700 1 --2- 172.21.15.40:0/4110264840 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c84133e00 0x7f6c841341d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f6c800098f0 tx=0x7f6c80009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:22.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.855+0000 7f6c8bfb7700 1 -- 172.21.15.40:0/4110264840 shutdown_connections 2023-09-30T22:29:22.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.855+0000 7f6c8bfb7700 1 --2- 172.21.15.40:0/4110264840 >> v2:172.21.15.40:3300/0 conn(0x7f6c8409df40 0x7f6c8413bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:22.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.855+0000 7f6c8bfb7700 1 --2- 172.21.15.40:0/4110264840 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c84133e00 0x7f6c841341d0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:22.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.855+0000 7f6c8bfb7700 1 -- 172.21.15.40:0/4110264840 >> 172.21.15.40:0/4110264840 conn(0x7f6c840a2a00 msgr2=0x7f6c840a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:22.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.855+0000 7f6c8bfb7700 1 -- 172.21.15.40:0/4110264840 shutdown_connections 2023-09-30T22:29:22.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.855+0000 7f6c8bfb7700 1 -- 172.21.15.40:0/4110264840 wait complete. 2023-09-30T22:29:22.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.856+0000 7f6c8bfb7700 1 Processor -- start 2023-09-30T22:29:22.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.856+0000 7f6c8bfb7700 1 -- start start 2023-09-30T22:29:22.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.856+0000 7f6c8bfb7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c8409d400 0x7f6c8411bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:22.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.857+0000 7f6c8bfb7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c8409df40 0x7f6c8411c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:22.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.857+0000 7f6c8bfb7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c84133e00 0x7f6c8411c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:22.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.857+0000 7f6c8bfb7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c840a0100 con 0x7f6c84133e00 2023-09-30T22:29:22.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.857+0000 7f6c8bfb7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8411dab0 con 0x7f6c8409d400 2023-09-30T22:29:22.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.857+0000 7f6c8bfb7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8411e1e0 con 0x7f6c8409df40 2023-09-30T22:29:22.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.857+0000 7f6c8a554700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c84133e00 0x7f6c8411c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:22.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.857+0000 7f6c8a554700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c84133e00 0x7f6c8411c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36782/0 (socket says 172.21.15.40:36782) 2023-09-30T22:29:22.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.857+0000 7f6c8a554700 1 -- 172.21.15.40:0/1530501743 learned_addr learned my addr 172.21.15.40:0/1530501743 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:22.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.857+0000 7f6c89552700 1 --2- 172.21.15.40:0/1530501743 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c8409df40 0x7f6c8411c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:22.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.857+0000 7f6c8a554700 1 -- 172.21.15.40:0/1530501743 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c8409df40 msgr2=0x7f6c8411c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:22.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.857+0000 7f6c8a554700 1 --2- 172.21.15.40:0/1530501743 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c8409df40 0x7f6c8411c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:22.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.857+0000 7f6c8a554700 1 -- 172.21.15.40:0/1530501743 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c8409d400 msgr2=0x7f6c8411bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:22.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.857+0000 7f6c8a554700 1 --2- 172.21.15.40:0/1530501743 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c8409d400 0x7f6c8411bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:22.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.857+0000 7f6c8a554700 1 -- 172.21.15.40:0/1530501743 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c80009550 con 0x7f6c84133e00 2023-09-30T22:29:22.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.857+0000 7f6c8a554700 1 --2- 172.21.15.40:0/1530501743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c84133e00 0x7f6c8411c810 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00efc0 tx=0x7f6c7c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:22.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.857+0000 7f6c7a7fc700 1 -- 172.21.15.40:0/1530501743 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c00cd40 con 0x7f6c84133e00 2023-09-30T22:29:22.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.858+0000 7f6c7a7fc700 1 -- 172.21.15.40:0/1530501743 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7c00f040 con 0x7f6c84133e00 2023-09-30T22:29:22.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.858+0000 7f6c8bfb7700 1 -- 172.21.15.40:0/1530501743 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c8412e1a0 con 0x7f6c84133e00 2023-09-30T22:29:22.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.858+0000 7f6c7a7fc700 1 -- 172.21.15.40:0/1530501743 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c0146c0 con 0x7f6c84133e00 2023-09-30T22:29:22.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.858+0000 7f6c8bfb7700 1 -- 172.21.15.40:0/1530501743 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c84120040 con 0x7f6c84133e00 2023-09-30T22:29:22.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.858+0000 7f6c7a7fc700 1 -- 172.21.15.40:0/1530501743 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6c7c014820 con 0x7f6c84133e00 2023-09-30T22:29:22.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.858+0000 7f6c7a7fc700 1 -- 172.21.15.40:0/1530501743 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6c7c0402c0 con 0x7f6c84133e00 2023-09-30T22:29:22.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.859+0000 7f6c8bfb7700 1 -- 172.21.15.40:0/1530501743 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c84062380 con 0x7f6c84133e00 2023-09-30T22:29:22.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.868+0000 7f6c7a7fc700 1 -- 172.21.15.40:0/1530501743 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6c7c018020 con 0x7f6c84133e00 2023-09-30T22:29:22.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.891+0000 7effbfabf700 1 Processor -- start 2023-09-30T22:29:22.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.892+0000 7effbfabf700 1 -- start start 2023-09-30T22:29:22.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.892+0000 7effbfabf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7effb809e400 0x7effb8135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:22.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.892+0000 7effbfabf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7effb8136230 0x7effb8138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:22.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.892+0000 7effbfabf700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb809adf0 con 0x7effb809d920 2023-09-30T22:29:22.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.892+0000 7effbfabf700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb809e7f0 con 0x7effb8136230 2023-09-30T22:29:22.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.892+0000 7effbfabf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effb809edf0 con 0x7effb809e400 2023-09-30T22:29:22.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.892+0000 7effbe05c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7effb8136230 0x7effb8138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:22.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.893+0000 7effbe05c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7effb8136230 0x7effb8138610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36796/0 (socket says 172.21.15.40:36796) 2023-09-30T22:29:22.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.893+0000 7effbe05c700 1 -- 172.21.15.40:0/562534085 learned_addr learned my addr 172.21.15.40:0/562534085 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:22.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.893+0000 7effbd05a700 1 --2- 172.21.15.40:0/562534085 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7effb809e400 0x7effb8135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:22.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.893+0000 7effbe05c700 1 -- 172.21.15.40:0/562534085 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7effb809e400 msgr2=0x7effb8135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:22.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.893+0000 7effbe05c700 1 --2- 172.21.15.40:0/562534085 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7effb809e400 0x7effb8135cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:22.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.893+0000 7effbe05c700 1 -- 172.21.15.40:0/562534085 >> v1:172.21.15.40:6789/0 conn(0x7effb809d920 legacy=0x7effb809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:22.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.893+0000 7effbe05c700 1 -- 172.21.15.40:0/562534085 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb809b660 con 0x7effb8136230 2023-09-30T22:29:22.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.893+0000 7effbe05c700 1 --2- 172.21.15.40:0/562534085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effb8136230 0x7effb8138610 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7effb0009e50 tx=0x7effb000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3f5d8db7322aae server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:22.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.893+0000 7effbc859700 1 -- 172.21.15.40:0/562534085 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb000bbc0 con 0x7effb8136230 2023-09-30T22:29:22.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.893+0000 7effbc859700 1 -- 172.21.15.40:0/562534085 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb000bd20 con 0x7effb8136230 2023-09-30T22:29:22.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.893+0000 7effbc859700 1 -- 172.21.15.40:0/562534085 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb00116a0 con 0x7effb8136230 2023-09-30T22:29:22.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.894+0000 7effbfabf700 1 -- 172.21.15.40:0/562534085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effb8136230 msgr2=0x7effb8138610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:22.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.894+0000 7effbfabf700 1 --2- 172.21.15.40:0/562534085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effb8136230 0x7effb8138610 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7effb0009e50 tx=0x7effb000b330 comp rx=0 tx=0).stop 2023-09-30T22:29:22.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.894+0000 7effbfabf700 1 -- 172.21.15.40:0/562534085 shutdown_connections 2023-09-30T22:29:22.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.894+0000 7effbfabf700 1 --2- 172.21.15.40:0/562534085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effb8136230 0x7effb8138610 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:22.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.894+0000 7effbfabf700 1 --2- 172.21.15.40:0/562534085 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7effb809e400 0x7effb8135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:22.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.894+0000 7effbfabf700 1 -- 172.21.15.40:0/562534085 >> 172.21.15.40:0/562534085 conn(0x7effb809fb20 msgr2=0x7effb809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:22.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.894+0000 7effbfabf700 1 -- 172.21.15.40:0/562534085 shutdown_connections 2023-09-30T22:29:22.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.894+0000 7effbfabf700 1 -- 172.21.15.40:0/562534085 wait complete. 2023-09-30T22:29:22.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.895+0000 7effbfabf700 1 Processor -- start 2023-09-30T22:29:22.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.895+0000 7effbfabf700 1 -- start start 2023-09-30T22:29:22.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.895+0000 7effbfabf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effb809d920 0x7effb8132040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:22.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.895+0000 7effbfabf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7effb809e400 0x7effb8132580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:22.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.895+0000 7effbfabf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7effb8136230 0x7effb811fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:22.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.895+0000 7effbfabf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb8071420 con 0x7effb809d920 2023-09-30T22:29:22.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.895+0000 7effbfabf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb809cb00 con 0x7effb8136230 2023-09-30T22:29:22.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.895+0000 7effbfabf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effb811e5b0 con 0x7effb809e400 2023-09-30T22:29:22.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.896+0000 7effbe05c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7effb8136230 0x7effb811fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:22.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.896+0000 7effbe05c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7effb8136230 0x7effb811fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:58114/0 (socket says 172.21.15.40:58114) 2023-09-30T22:29:22.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.896+0000 7effbe05c700 1 -- 172.21.15.40:0/2617844754 learned_addr learned my addr 172.21.15.40:0/2617844754 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:22.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.896+0000 7effbd05a700 1 --2- 172.21.15.40:0/2617844754 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7effb809e400 0x7effb8132580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:22.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.896+0000 7effbe05c700 1 -- 172.21.15.40:0/2617844754 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7effb809e400 msgr2=0x7effb8132580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:22.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.896+0000 7effbe05c700 1 --2- 172.21.15.40:0/2617844754 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7effb809e400 0x7effb8132580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:22.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.896+0000 7effbe05c700 1 -- 172.21.15.40:0/2617844754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effb809d920 msgr2=0x7effb8132040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:22.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.896+0000 7effbe05c700 1 --2- 172.21.15.40:0/2617844754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effb809d920 0x7effb8132040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:22.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.896+0000 7effbe05c700 1 -- 172.21.15.40:0/2617844754 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb0009b30 con 0x7effb8136230 2023-09-30T22:29:22.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.896+0000 7effbe05c700 1 --2- 172.21.15.40:0/2617844754 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7effb8136230 0x7effb811fa00 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7effb809b9b0 tx=0x7effb0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:22.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.896+0000 7effae7fc700 1 -- 172.21.15.40:0/2617844754 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb000cea0 con 0x7effb8136230 2023-09-30T22:29:22.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.897+0000 7effae7fc700 1 -- 172.21.15.40:0/2617844754 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb0011c80 con 0x7effb8136230 2023-09-30T22:29:22.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.897+0000 7effae7fc700 1 -- 172.21.15.40:0/2617844754 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb00092e0 con 0x7effb8136230 2023-09-30T22:29:22.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.897+0000 7effbfabf700 1 -- 172.21.15.40:0/2617844754 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb811d700 con 0x7effb8136230 2023-09-30T22:29:22.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.897+0000 7effbfabf700 1 -- 172.21.15.40:0/2617844754 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb8132ac0 con 0x7effb8136230 2023-09-30T22:29:22.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.897+0000 7effae7fc700 1 -- 172.21.15.40:0/2617844754 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7effb0004040 con 0x7effb8136230 2023-09-30T22:29:22.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.898+0000 7effae7fc700 1 -- 172.21.15.40:0/2617844754 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7effb0040f70 con 0x7effb8136230 2023-09-30T22:29:22.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.898+0000 7effbfabf700 1 -- 172.21.15.40:0/2617844754 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb811ec50 con 0x7effb8136230 2023-09-30T22:29:22.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.907+0000 7effae7fc700 1 -- 172.21.15.40:0/2617844754 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7effb0027080 con 0x7effb8136230 2023-09-30T22:29:22.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.977+0000 7f22ee6d3700 1 -- 172.21.15.40:0/2905899215 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f22cc005860 con 0x7f22e806f980 2023-09-30T22:29:22.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.977+0000 7f22e57fa700 1 -- 172.21.15.40:0/2905899215 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f22d00193d0 con 0x7f22e806f980 2023-09-30T22:29:22.978 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:22.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.980+0000 7f22ee6d3700 1 -- 172.21.15.40:0/2905899215 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22e806f980 msgr2=0x7f22e812da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:22.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.980+0000 7f22ee6d3700 1 --2- 172.21.15.40:0/2905899215 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22e806f980 0x7f22e812da70 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f22d0001920 tx=0x7f22d0001c30 comp rx=0 tx=0).stop 2023-09-30T22:29:22.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.980+0000 7f22ee6d3700 1 -- 172.21.15.40:0/2905899215 shutdown_connections 2023-09-30T22:29:22.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.980+0000 7f22ee6d3700 1 --2- 172.21.15.40:0/2905899215 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f22e806fdb0 0x7f22e812dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:22.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.980+0000 7f22ee6d3700 1 --2- 172.21.15.40:0/2905899215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22e806f070 0x7f22e812d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:22.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.980+0000 7f22ee6d3700 1 --2- 172.21.15.40:0/2905899215 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22e806f980 0x7f22e812da70 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:22.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.980+0000 7f22ee6d3700 1 -- 172.21.15.40:0/2905899215 >> 172.21.15.40:0/2905899215 conn(0x7f22e80a41a0 msgr2=0x7f22e80a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:22.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.980+0000 7f22ee6d3700 1 -- 172.21.15.40:0/2905899215 shutdown_connections 2023-09-30T22:29:22.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:22.980+0000 7f22ee6d3700 1 -- 172.21.15.40:0/2905899215 wait complete. 2023-09-30T22:29:22.994 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:23.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:23.008+0000 7f3a8b6e1700 1 -- 172.21.15.40:0/1028372083 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3a840a2810 con 0x7f3a84133ca0 2023-09-30T22:29:23.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:23.009+0000 7f3a79ffb700 1 -- 172.21.15.40:0/1028372083 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3a74021020 con 0x7f3a84133ca0 2023-09-30T22:29:23.010 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:23.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:23.011+0000 7f3a8b6e1700 1 -- 172.21.15.40:0/1028372083 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a84133ca0 msgr2=0x7f3a8411ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:23.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:23.011+0000 7f3a8b6e1700 1 --2- 172.21.15.40:0/1028372083 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a84133ca0 0x7f3a8411ea30 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f3a7400e910 tx=0x7f3a7400ecd0 comp rx=0 tx=0).stop 2023-09-30T22:29:23.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:23.011+0000 7f3a8b6e1700 1 -- 172.21.15.40:0/1028372083 shutdown_connections 2023-09-30T22:29:23.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:23.011+0000 7f3a8b6e1700 1 --2- 172.21.15.40:0/1028372083 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a8409d920 0x7f3a8411e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:23.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:23.011+0000 7f3a8b6e1700 1 --2- 172.21.15.40:0/1028372083 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a8411ef70 0x7f3a841c4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:23.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:23.011+0000 7f3a8b6e1700 1 --2- 172.21.15.40:0/1028372083 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a84133ca0 0x7f3a8411ea30 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:23.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:23.011+0000 7f3a8b6e1700 1 -- 172.21.15.40:0/1028372083 >> 172.21.15.40:0/1028372083 conn(0x7f3a8409fb20 msgr2=0x7f3a840a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:23.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:23.011+0000 7f3a8b6e1700 1 -- 172.21.15.40:0/1028372083 shutdown_connections 2023-09-30T22:29:23.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:23.011+0000 7f3a8b6e1700 1 -- 172.21.15.40:0/1028372083 wait complete. 2023-09-30T22:29:23.024 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:23.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:23.093+0000 7f6c8bfb7700 1 -- 172.21.15.40:0/1530501743 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6c84074330 con 0x7f6c84133e00 2023-09-30T22:29:23.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:23.094+0000 7f6c7a7fc700 1 -- 172.21.15.40:0/1530501743 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6c7c02b090 con 0x7f6c84133e00 2023-09-30T22:29:23.095 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:23.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:23.096+0000 7f6c8bfb7700 1 -- 172.21.15.40:0/1530501743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c84133e00 msgr2=0x7f6c8411c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:23.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:23.096+0000 7f6c8bfb7700 1 --2- 172.21.15.40:0/1530501743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c84133e00 0x7f6c8411c810 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00efc0 tx=0x7f6c7c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:29:23.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:23.096+0000 7f6c8bfb7700 1 -- 172.21.15.40:0/1530501743 shutdown_connections 2023-09-30T22:29:23.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:23.096+0000 7f6c8bfb7700 1 --2- 172.21.15.40:0/1530501743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c84133e00 0x7f6c8411c810 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:23.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:23.096+0000 7f6c8bfb7700 1 --2- 172.21.15.40:0/1530501743 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c8409d400 0x7f6c8411bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:23.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:23.096+0000 7f6c8bfb7700 1 --2- 172.21.15.40:0/1530501743 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c8409df40 0x7f6c8411c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:23.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:23.096+0000 7f6c8bfb7700 1 -- 172.21.15.40:0/1530501743 >> 172.21.15.40:0/1530501743 conn(0x7f6c840a2a00 msgr2=0x7f6c84131840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:23.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:23.096+0000 7f6c8bfb7700 1 -- 172.21.15.40:0/1530501743 shutdown_connections 2023-09-30T22:29:23.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:23.096+0000 7f6c8bfb7700 1 -- 172.21.15.40:0/1530501743 wait complete. 2023-09-30T22:29:23.109 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:23.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:23.123+0000 7effbfabf700 1 -- 172.21.15.40:0/2617844754 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7effb8062380 con 0x7effb8136230 2023-09-30T22:29:23.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:23.124+0000 7effae7fc700 1 -- 172.21.15.40:0/2617844754 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7effb0015020 con 0x7effb8136230 2023-09-30T22:29:23.124 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:23.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:23.126+0000 7effbfabf700 1 -- 172.21.15.40:0/2617844754 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7effb8136230 msgr2=0x7effb811fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:23.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:23.126+0000 7effbfabf700 1 --2- 172.21.15.40:0/2617844754 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7effb8136230 0x7effb811fa00 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7effb809b9b0 tx=0x7effb0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:29:23.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:23.126+0000 7effbfabf700 1 -- 172.21.15.40:0/2617844754 shutdown_connections 2023-09-30T22:29:23.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:23.126+0000 7effbfabf700 1 --2- 172.21.15.40:0/2617844754 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7effb8136230 0x7effb811fa00 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:23.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:23.126+0000 7effbfabf700 1 --2- 172.21.15.40:0/2617844754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effb809d920 0x7effb8132040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:23.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:23.126+0000 7effbfabf700 1 --2- 172.21.15.40:0/2617844754 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7effb809e400 0x7effb8132580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:23.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:23.126+0000 7effbfabf700 1 -- 172.21.15.40:0/2617844754 >> 172.21.15.40:0/2617844754 conn(0x7effb809fb20 msgr2=0x7effb8134f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:23.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:23.126+0000 7effbfabf700 1 -- 172.21.15.40:0/2617844754 shutdown_connections 2023-09-30T22:29:23.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:23.126+0000 7effbfabf700 1 -- 172.21.15.40:0/2617844754 wait complete. 2023-09-30T22:29:23.138 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:23.995 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:24.025 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:24.109 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:24.139 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:24.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.138+0000 7fbcb6f9c700 1 Processor -- start 2023-09-30T22:29:24.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.139+0000 7fbcb6f9c700 1 -- start start 2023-09-30T22:29:24.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.139+0000 7fbcb6f9c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbcb009d920 0x7fbcb009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:24.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.139+0000 7fbcb6f9c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcb009e230 0x7fbcb01308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:24.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.139+0000 7fbcb6f9c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbcb0130de0 0x7fbcb0131240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:24.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.139+0000 7fbcb6f9c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcb009edf0 con 0x7fbcb009d920 2023-09-30T22:29:24.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.139+0000 7fbcb6f9c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb009adf0 con 0x7fbcb009e230 2023-09-30T22:29:24.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.139+0000 7fbcb6f9c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb009b660 con 0x7fbcb0130de0 2023-09-30T22:29:24.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.139+0000 7fbcaffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcb009e230 0x7fbcb01308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:24.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.139+0000 7fbcb4d38700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbcb009d920 0x7fbcb009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:24.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.139+0000 7fbcaffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcb009e230 0x7fbcb01308a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:34632/0 (socket says 172.21.15.40:34632) 2023-09-30T22:29:24.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.139+0000 7fbcaffff700 1 -- 172.21.15.40:0/3749059729 learned_addr learned my addr 172.21.15.40:0/3749059729 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:24.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.139+0000 7fbcb4d38700 1 --2- 172.21.15.40:0/3749059729 >> v2:172.21.15.40:3300/0 conn(0x7fbcb009d920 0x7fbcb009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56724/0 (socket says 172.21.15.40:56724) 2023-09-30T22:29:24.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.140+0000 7fbcb5539700 1 --2- 172.21.15.40:0/3749059729 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbcb0130de0 0x7fbcb0131240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:24.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.140+0000 7fbcaffff700 1 -- 172.21.15.40:0/3749059729 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbcb0130de0 msgr2=0x7fbcb0131240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:24.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.140+0000 7fbcaffff700 1 --2- 172.21.15.40:0/3749059729 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbcb0130de0 0x7fbcb0131240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:24.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.140+0000 7fbcaffff700 1 -- 172.21.15.40:0/3749059729 >> v2:172.21.15.40:3300/0 conn(0x7fbcb009d920 msgr2=0x7fbcb009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:24.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.140+0000 7fbcaffff700 1 --2- 172.21.15.40:0/3749059729 >> v2:172.21.15.40:3300/0 conn(0x7fbcb009d920 0x7fbcb009dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:24.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.140+0000 7fbcaffff700 1 -- 172.21.15.40:0/3749059729 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb009a6e0 con 0x7fbcb009e230 2023-09-30T22:29:24.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.140+0000 7fbcb5539700 1 --2- 172.21.15.40:0/3749059729 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbcb0130de0 0x7fbcb0131240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:24.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.140+0000 7fbcb4d38700 1 --2- 172.21.15.40:0/3749059729 >> v2:172.21.15.40:3300/0 conn(0x7fbcb009d920 0x7fbcb009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:24.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.140+0000 7fbcaffff700 1 --2- 172.21.15.40:0/3749059729 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcb009e230 0x7fbcb01308a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c0098f0 tx=0x7fbc9c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e483ffa99a20b66 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:24.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.140+0000 7fbcaf7fe700 1 -- 172.21.15.40:0/3749059729 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c011830 con 0x7fbcb009e230 2023-09-30T22:29:24.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.140+0000 7fbcaf7fe700 1 -- 172.21.15.40:0/3749059729 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9c011990 con 0x7fbcb009e230 2023-09-30T22:29:24.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.140+0000 7fbcaf7fe700 1 -- 172.21.15.40:0/3749059729 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c011d20 con 0x7fbcb009e230 2023-09-30T22:29:24.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.141+0000 7fbcb6f9c700 1 -- 172.21.15.40:0/3749059729 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcb009e230 msgr2=0x7fbcb01308a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:24.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.141+0000 7fbcb6f9c700 1 --2- 172.21.15.40:0/3749059729 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcb009e230 0x7fbcb01308a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c0098f0 tx=0x7fbc9c009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:24.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.141+0000 7fbcb6f9c700 1 -- 172.21.15.40:0/3749059729 shutdown_connections 2023-09-30T22:29:24.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.141+0000 7fbcb6f9c700 1 --2- 172.21.15.40:0/3749059729 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbcb0130de0 0x7fbcb0131240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:24.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.141+0000 7fbcb6f9c700 1 --2- 172.21.15.40:0/3749059729 >> v2:172.21.15.40:3300/0 conn(0x7fbcb009d920 0x7fbcb009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:24.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.141+0000 7fbcb6f9c700 1 --2- 172.21.15.40:0/3749059729 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcb009e230 0x7fbcb01308a0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:24.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.141+0000 7fbcb6f9c700 1 -- 172.21.15.40:0/3749059729 >> 172.21.15.40:0/3749059729 conn(0x7fbcb009fb20 msgr2=0x7fbcb009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:24.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.141+0000 7fbcb6f9c700 1 -- 172.21.15.40:0/3749059729 shutdown_connections 2023-09-30T22:29:24.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.141+0000 7fbcb6f9c700 1 -- 172.21.15.40:0/3749059729 wait complete. 2023-09-30T22:29:24.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.142+0000 7fbcb6f9c700 1 Processor -- start 2023-09-30T22:29:24.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.143+0000 7fbcb6f9c700 1 -- start start 2023-09-30T22:29:24.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.143+0000 7fbcb6f9c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcb009d920 0x7fbcb0119dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:24.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.143+0000 7fbcb6f9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcb009e230 0x7fbcb011a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:24.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.143+0000 7fbcb6f9c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbcb0130de0 0x7fbcb011a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:24.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.143+0000 7fbcb6f9c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb012f8f0 con 0x7fbcb009e230 2023-09-30T22:29:24.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.143+0000 7fbcb6f9c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb009cb00 con 0x7fbcb009d920 2023-09-30T22:29:24.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.143+0000 7fbcb6f9c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb011bd50 con 0x7fbcb0130de0 2023-09-30T22:29:24.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.144+0000 7fbcb4d38700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcb009d920 0x7fbcb0119dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:24.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.144+0000 7fbcb4d38700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcb009d920 0x7fbcb0119dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:34646/0 (socket says 172.21.15.40:34646) 2023-09-30T22:29:24.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.144+0000 7fbcb4d38700 1 -- 172.21.15.40:0/3037887025 learned_addr learned my addr 172.21.15.40:0/3037887025 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:24.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.144+0000 7fbcaffff700 1 --2- 172.21.15.40:0/3037887025 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcb009e230 0x7fbcb011a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:24.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.144+0000 7fbcb4d38700 1 -- 172.21.15.40:0/3037887025 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbcb0130de0 msgr2=0x7fbcb011a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:24.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.144+0000 7fbcb4d38700 1 --2- 172.21.15.40:0/3037887025 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbcb0130de0 0x7fbcb011a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:24.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.144+0000 7fbcb4d38700 1 -- 172.21.15.40:0/3037887025 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcb009e230 msgr2=0x7fbcb011a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:24.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.144+0000 7fbcb4d38700 1 --2- 172.21.15.40:0/3037887025 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcb009e230 0x7fbcb011a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:24.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.144+0000 7fbcb4d38700 1 -- 172.21.15.40:0/3037887025 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca4009430 con 0x7fbcb009d920 2023-09-30T22:29:24.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.144+0000 7fbcb4d38700 1 --2- 172.21.15.40:0/3037887025 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcb009d920 0x7fbcb0119dc0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fbca400ebe0 tx=0x7fbca400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:24.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.144+0000 7fbcad7fa700 1 -- 172.21.15.40:0/3037887025 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca4009760 con 0x7fbcb009d920 2023-09-30T22:29:24.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.145+0000 7fbcad7fa700 1 -- 172.21.15.40:0/3037887025 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca4005a20 con 0x7fbcb009d920 2023-09-30T22:29:24.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.145+0000 7fbcb6f9c700 1 -- 172.21.15.40:0/3037887025 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc9c009550 con 0x7fbcb009d920 2023-09-30T22:29:24.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.145+0000 7fbcad7fa700 1 -- 172.21.15.40:0/3037887025 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca4005db0 con 0x7fbcb009d920 2023-09-30T22:29:24.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.145+0000 7fbcb6f9c700 1 -- 172.21.15.40:0/3037887025 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcb0120c40 con 0x7fbcb009d920 2023-09-30T22:29:24.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.146+0000 7fbcb6f9c700 1 -- 172.21.15.40:0/3037887025 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcb01208c0 con 0x7fbcb009d920 2023-09-30T22:29:24.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.146+0000 7fbcad7fa700 1 -- 172.21.15.40:0/3037887025 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbca400c850 con 0x7fbcb009d920 2023-09-30T22:29:24.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.147+0000 7fbcad7fa700 1 -- 172.21.15.40:0/3037887025 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fbca403fdd0 con 0x7fbcb009d920 2023-09-30T22:29:24.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.151+0000 7fbcad7fa700 1 -- 172.21.15.40:0/3037887025 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbca4024c10 con 0x7fbcb009d920 2023-09-30T22:29:24.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.184+0000 7fed64950700 1 Processor -- start 2023-09-30T22:29:24.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.184+0000 7fed64950700 1 -- start start 2023-09-30T22:29:24.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.185+0000 7fed64950700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fed6009d450 0x7fed6009d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:24.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.185+0000 7fed64950700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fed6009dd60 0x7fed601301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:24.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.185+0000 7fed64950700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed6009c3b0 con 0x7fed60130700 2023-09-30T22:29:24.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.185+0000 7fed64950700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed6009a6b0 con 0x7fed6009d450 2023-09-30T22:29:24.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.185+0000 7fed64950700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed6009b4f0 con 0x7fed6009dd60 2023-09-30T22:29:24.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.185+0000 7fed5dd9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fed6009dd60 0x7fed601301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:24.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.185+0000 7fed5e59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fed6009d450 0x7fed6009d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:24.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.185+0000 7fed5dd9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fed6009dd60 0x7fed601301c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:39076/0 (socket says 172.21.15.40:39076) 2023-09-30T22:29:24.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.185+0000 7fed5dd9b700 1 -- 172.21.15.40:0/2815904670 learned_addr learned my addr 172.21.15.40:0/2815904670 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:24.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.185+0000 7fed5ed9d700 1 --1- 172.21.15.40:0/2815904670 >> v1:172.21.15.40:6789/0 conn(0x7fed60130700 0x7fed60137410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58140/0 (socket says 172.21.15.40:58140) 2023-09-30T22:29:24.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.186+0000 7fed5e59c700 1 -- 172.21.15.40:0/2815904670 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fed6009dd60 msgr2=0x7fed601301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:24.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.186+0000 7fed5e59c700 1 --2- 172.21.15.40:0/2815904670 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fed6009dd60 0x7fed601301c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:24.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.186+0000 7fed5e59c700 1 -- 172.21.15.40:0/2815904670 >> v1:172.21.15.40:6789/0 conn(0x7fed60130700 legacy=0x7fed60137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:24.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.186+0000 7fed5e59c700 1 -- 172.21.15.40:0/2815904670 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6009af90 con 0x7fed6009d450 2023-09-30T22:29:24.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.186+0000 7fed5e59c700 1 --2- 172.21.15.40:0/2815904670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed6009d450 0x7fed6009d820 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fed50009840 tx=0x7fed50009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6fea9691651726e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:24.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.186+0000 7fed5d59a700 1 -- 172.21.15.40:0/2815904670 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed50011830 con 0x7fed6009d450 2023-09-30T22:29:24.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.186+0000 7fed5d59a700 1 -- 172.21.15.40:0/2815904670 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed50011990 con 0x7fed6009d450 2023-09-30T22:29:24.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.186+0000 7fed5d59a700 1 -- 172.21.15.40:0/2815904670 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed50011d20 con 0x7fed6009d450 2023-09-30T22:29:24.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.187+0000 7fed64950700 1 -- 172.21.15.40:0/2815904670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed6009d450 msgr2=0x7fed6009d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:24.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.187+0000 7fed64950700 1 --2- 172.21.15.40:0/2815904670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed6009d450 0x7fed6009d820 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fed50009840 tx=0x7fed50009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:24.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.187+0000 7fed64950700 1 -- 172.21.15.40:0/2815904670 shutdown_connections 2023-09-30T22:29:24.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.187+0000 7fed64950700 1 --2- 172.21.15.40:0/2815904670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed6009d450 0x7fed6009d820 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:24.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.187+0000 7fed64950700 1 --2- 172.21.15.40:0/2815904670 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fed6009dd60 0x7fed601301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:24.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.187+0000 7fed64950700 1 -- 172.21.15.40:0/2815904670 >> 172.21.15.40:0/2815904670 conn(0x7fed600a2a00 msgr2=0x7fed600a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:24.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.187+0000 7fed64950700 1 -- 172.21.15.40:0/2815904670 shutdown_connections 2023-09-30T22:29:24.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.187+0000 7fed64950700 1 -- 172.21.15.40:0/2815904670 wait complete. 2023-09-30T22:29:24.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.188+0000 7fed64950700 1 Processor -- start 2023-09-30T22:29:24.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.188+0000 7fed64950700 1 -- start start 2023-09-30T22:29:24.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.189+0000 7fed64950700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fed6009d450 0x7fed6011b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:24.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.189+0000 7fed64950700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed6009dd60 0x7fed6011b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:24.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.189+0000 7fed64950700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed60130700 0x7fed6011bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:24.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.189+0000 7fed64950700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6011cf80 con 0x7fed6009dd60 2023-09-30T22:29:24.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.189+0000 7fed64950700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed6011cd90 con 0x7fed60130700 2023-09-30T22:29:24.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.189+0000 7fed64950700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed6011eca0 con 0x7fed6009d450 2023-09-30T22:29:24.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.189+0000 7fed5dd9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed6009dd60 0x7fed6011b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:24.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.189+0000 7fed5dd9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed6009dd60 0x7fed6011b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56742/0 (socket says 172.21.15.40:56742) 2023-09-30T22:29:24.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.189+0000 7fed5dd9b700 1 -- 172.21.15.40:0/4058304925 learned_addr learned my addr 172.21.15.40:0/4058304925 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:24.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.189+0000 7fed5e59c700 1 --2- 172.21.15.40:0/4058304925 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fed6009d450 0x7fed6011b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:24.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.189+0000 7fed5dd9b700 1 -- 172.21.15.40:0/4058304925 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fed6009d450 msgr2=0x7fed6011b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:24.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.189+0000 7fed5dd9b700 1 --2- 172.21.15.40:0/4058304925 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fed6009d450 0x7fed6011b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:24.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.189+0000 7fed5dd9b700 1 -- 172.21.15.40:0/4058304925 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed60130700 msgr2=0x7fed6011bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:24.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.189+0000 7fed5dd9b700 1 --2- 172.21.15.40:0/4058304925 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed60130700 0x7fed6011bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:24.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.189+0000 7fed5dd9b700 1 -- 172.21.15.40:0/4058304925 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed500094a0 con 0x7fed6009dd60 2023-09-30T22:29:24.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.189+0000 7fed5dd9b700 1 --2- 172.21.15.40:0/4058304925 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed6009dd60 0x7fed6011b6c0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fed5400cb30 tx=0x7fed5400ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:24.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.190+0000 7fed4effd700 1 -- 172.21.15.40:0/4058304925 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed54016a00 con 0x7fed6009dd60 2023-09-30T22:29:24.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.190+0000 7fed4effd700 1 -- 172.21.15.40:0/4058304925 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed54016b60 con 0x7fed6009dd60 2023-09-30T22:29:24.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.190+0000 7fed64950700 1 -- 172.21.15.40:0/4058304925 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed600a2360 con 0x7fed6009dd60 2023-09-30T22:29:24.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.190+0000 7fed4effd700 1 -- 172.21.15.40:0/4058304925 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed54016ed0 con 0x7fed6009dd60 2023-09-30T22:29:24.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.190+0000 7fed64950700 1 -- 172.21.15.40:0/4058304925 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed6011d580 con 0x7fed6009dd60 2023-09-30T22:29:24.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.191+0000 7fed4effd700 1 -- 172.21.15.40:0/4058304925 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fed5401d420 con 0x7fed6009dd60 2023-09-30T22:29:24.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.192+0000 7fed64950700 1 -- 172.21.15.40:0/4058304925 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed60062380 con 0x7fed6009dd60 2023-09-30T22:29:24.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.192+0000 7fed4effd700 1 -- 172.21.15.40:0/4058304925 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fed54026410 con 0x7fed6009dd60 2023-09-30T22:29:24.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.201+0000 7fed4effd700 1 -- 172.21.15.40:0/4058304925 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fed5401b8d0 con 0x7fed6009dd60 2023-09-30T22:29:24.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.259+0000 7ff3aad9d700 1 Processor -- start 2023-09-30T22:29:24.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.259+0000 7ff3aad9d700 1 -- start start 2023-09-30T22:29:24.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.260+0000 7ff3aad9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3a412f070 0x7ff3a4135c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:24.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.260+0000 7ff3aad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff3a4136170 0x7ff3a4138550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:24.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.260+0000 7ff3aad9d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3a409ab70 con 0x7ff3a412e590 2023-09-30T22:29:24.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.260+0000 7ff3aad9d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a409b270 con 0x7ff3a412f070 2023-09-30T22:29:24.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.260+0000 7ff3aad9d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a412f440 con 0x7ff3a4136170 2023-09-30T22:29:24.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.260+0000 7ff3a3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3a412f070 0x7ff3a4135c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:24.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.260+0000 7ff3a3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3a412f070 0x7ff3a4135c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:34666/0 (socket says 172.21.15.40:34666) 2023-09-30T22:29:24.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.260+0000 7ff3a3fff700 1 -- 172.21.15.40:0/2884229493 learned_addr learned my addr 172.21.15.40:0/2884229493 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:24.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.260+0000 7ff3a933a700 1 --2- 172.21.15.40:0/2884229493 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff3a4136170 0x7ff3a4138550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:24.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.260+0000 7ff3a3fff700 1 -- 172.21.15.40:0/2884229493 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff3a4136170 msgr2=0x7ff3a4138550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:24.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.260+0000 7ff3a3fff700 1 --2- 172.21.15.40:0/2884229493 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff3a4136170 0x7ff3a4138550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:24.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.260+0000 7ff3a3fff700 1 -- 172.21.15.40:0/2884229493 >> v1:172.21.15.40:6789/0 conn(0x7ff3a412e590 legacy=0x7ff3a412e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:24.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.260+0000 7ff3a3fff700 1 -- 172.21.15.40:0/2884229493 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a409bd70 con 0x7ff3a412f070 2023-09-30T22:29:24.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.260+0000 7ff3a3fff700 1 --2- 172.21.15.40:0/2884229493 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3a412f070 0x7ff3a4135c30 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7ff390009950 tx=0x7ff390009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf175f55b28d6210 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:24.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.261+0000 7ff3a37fe700 1 -- 172.21.15.40:0/2884229493 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff390011830 con 0x7ff3a412f070 2023-09-30T22:29:24.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.261+0000 7ff3a37fe700 1 -- 172.21.15.40:0/2884229493 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff390011990 con 0x7ff3a412f070 2023-09-30T22:29:24.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.261+0000 7ff3a37fe700 1 -- 172.21.15.40:0/2884229493 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff390011d40 con 0x7ff3a412f070 2023-09-30T22:29:24.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.261+0000 7ff3aad9d700 1 -- 172.21.15.40:0/2884229493 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3a412f070 msgr2=0x7ff3a4135c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:24.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.261+0000 7ff3aad9d700 1 --2- 172.21.15.40:0/2884229493 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3a412f070 0x7ff3a4135c30 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7ff390009950 tx=0x7ff390009c60 comp rx=0 tx=0).stop 2023-09-30T22:29:24.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.261+0000 7ff3aad9d700 1 -- 172.21.15.40:0/2884229493 shutdown_connections 2023-09-30T22:29:24.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.261+0000 7ff3aad9d700 1 --2- 172.21.15.40:0/2884229493 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff3a4136170 0x7ff3a4138550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:24.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.261+0000 7ff3aad9d700 1 --2- 172.21.15.40:0/2884229493 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3a412f070 0x7ff3a4135c30 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:24.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.261+0000 7ff3aad9d700 1 -- 172.21.15.40:0/2884229493 >> 172.21.15.40:0/2884229493 conn(0x7ff3a40a2a00 msgr2=0x7ff3a40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:24.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.261+0000 7ff3aad9d700 1 -- 172.21.15.40:0/2884229493 shutdown_connections 2023-09-30T22:29:24.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.261+0000 7ff3aad9d700 1 -- 172.21.15.40:0/2884229493 wait complete. 2023-09-30T22:29:24.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.262+0000 7ff3aad9d700 1 Processor -- start 2023-09-30T22:29:24.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.262+0000 7ff3aad9d700 1 -- start start 2023-09-30T22:29:24.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.263+0000 7ff3aad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff3a412e590 0x7ff3a4134130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:24.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.263+0000 7ff3aad9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3a412f070 0x7ff3a4134670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:24.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.263+0000 7ff3aad9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3a4136170 0x7ff3a41c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:24.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.263+0000 7ff3aad9d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a4134bb0 con 0x7ff3a4136170 2023-09-30T22:29:24.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.263+0000 7ff3aad9d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a412dc50 con 0x7ff3a412f070 2023-09-30T22:29:24.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.263+0000 7ff3aad9d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a4133c40 con 0x7ff3a412e590 2023-09-30T22:29:24.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.263+0000 7ff3a3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3a412f070 0x7ff3a4134670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:24.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.263+0000 7ff3a3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3a412f070 0x7ff3a4134670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:34680/0 (socket says 172.21.15.40:34680) 2023-09-30T22:29:24.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.263+0000 7ff3a3fff700 1 -- 172.21.15.40:0/2690790954 learned_addr learned my addr 172.21.15.40:0/2690790954 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:24.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.263+0000 7ff3a8b39700 1 --2- 172.21.15.40:0/2690790954 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff3a412e590 0x7ff3a4134130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:24.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.263+0000 7ff3a933a700 1 --2- 172.21.15.40:0/2690790954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3a4136170 0x7ff3a41c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:24.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.264+0000 7ff3a3fff700 1 -- 172.21.15.40:0/2690790954 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff3a412e590 msgr2=0x7ff3a4134130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:24.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.264+0000 7ff3a3fff700 1 --2- 172.21.15.40:0/2690790954 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff3a412e590 0x7ff3a4134130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:24.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.264+0000 7ff3a3fff700 1 -- 172.21.15.40:0/2690790954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3a4136170 msgr2=0x7ff3a41c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:24.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.264+0000 7ff3a3fff700 1 --2- 172.21.15.40:0/2690790954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3a4136170 0x7ff3a41c8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:24.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.264+0000 7ff3a3fff700 1 -- 172.21.15.40:0/2690790954 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff390009550 con 0x7ff3a412f070 2023-09-30T22:29:24.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.264+0000 7ff3a3fff700 1 --2- 172.21.15.40:0/2690790954 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3a412f070 0x7ff3a4134670 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7ff3a409b400 tx=0x7ff390004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:24.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.264+0000 7ff3a17fa700 1 -- 172.21.15.40:0/2690790954 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff390004240 con 0x7ff3a412f070 2023-09-30T22:29:24.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.264+0000 7ff3a17fa700 1 -- 172.21.15.40:0/2690790954 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39001f070 con 0x7ff3a412f070 2023-09-30T22:29:24.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.264+0000 7ff3a17fa700 1 -- 172.21.15.40:0/2690790954 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3900036a0 con 0x7ff3a412f070 2023-09-30T22:29:24.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.264+0000 7ff3aad9d700 1 -- 172.21.15.40:0/2690790954 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a4135a40 con 0x7ff3a412f070 2023-09-30T22:29:24.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.264+0000 7ff3aad9d700 1 -- 172.21.15.40:0/2690790954 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a41352e0 con 0x7ff3a412f070 2023-09-30T22:29:24.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.265+0000 7ff3a17fa700 1 -- 172.21.15.40:0/2690790954 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff390021030 con 0x7ff3a412f070 2023-09-30T22:29:24.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.265+0000 7ff3a17fa700 1 -- 172.21.15.40:0/2690790954 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff390040810 con 0x7ff3a412f070 2023-09-30T22:29:24.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.265+0000 7ff3aad9d700 1 -- 172.21.15.40:0/2690790954 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3a4062380 con 0x7ff3a412f070 2023-09-30T22:29:24.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.273+0000 7ff3a17fa700 1 -- 172.21.15.40:0/2690790954 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff3900239c0 con 0x7ff3a412f070 2023-09-30T22:29:24.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.280+0000 7eff509a9700 1 Processor -- start 2023-09-30T22:29:24.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.280+0000 7eff509a9700 1 -- start start 2023-09-30T22:29:24.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.280+0000 7eff509a9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7eff4c09c890 0x7eff4c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:24.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.281+0000 7eff509a9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff4c09e480 0x7eff4c13bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:24.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.281+0000 7eff509a9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff4c0a2600 con 0x7eff4c09d920 2023-09-30T22:29:24.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.281+0000 7eff509a9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff4c0a29d0 con 0x7eff4c09c890 2023-09-30T22:29:24.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.281+0000 7eff509a9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c09fb40 con 0x7eff4c09e480 2023-09-30T22:29:24.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.281+0000 7eff4ad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff4c09e480 0x7eff4c13bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:24.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.281+0000 7eff4ad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff4c09e480 0x7eff4c13bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:39112/0 (socket says 172.21.15.40:39112) 2023-09-30T22:29:24.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.281+0000 7eff4ad9d700 1 -- 172.21.15.40:0/1259739661 learned_addr learned my addr 172.21.15.40:0/1259739661 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:24.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.281+0000 7eff4a59c700 1 --2- 172.21.15.40:0/1259739661 >> v2:172.21.15.40:3300/0 conn(0x7eff4c09c890 0x7eff4c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:24.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.281+0000 7eff4ad9d700 1 -- 172.21.15.40:0/1259739661 >> v2:172.21.15.40:3300/0 conn(0x7eff4c09c890 msgr2=0x7eff4c09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:24.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.281+0000 7eff4ad9d700 1 --2- 172.21.15.40:0/1259739661 >> v2:172.21.15.40:3300/0 conn(0x7eff4c09c890 0x7eff4c09cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:24.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.281+0000 7eff4ad9d700 1 -- 172.21.15.40:0/1259739661 >> v1:172.21.15.40:6789/0 conn(0x7eff4c09d920 legacy=0x7eff4c09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:24.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.281+0000 7eff4ad9d700 1 -- 172.21.15.40:0/1259739661 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4c09fed0 con 0x7eff4c09e480 2023-09-30T22:29:24.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.281+0000 7eff4a59c700 1 --2- 172.21.15.40:0/1259739661 >> v2:172.21.15.40:3300/0 conn(0x7eff4c09c890 0x7eff4c09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:29:24.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.281+0000 7eff4ad9d700 1 --2- 172.21.15.40:0/1259739661 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff4c09e480 0x7eff4c13bc20 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7eff44009e50 tx=0x7eff4400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd383a8eb83b8dbe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:24.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.281+0000 7eff4959a700 1 -- 172.21.15.40:0/1259739661 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4400e070 con 0x7eff4c09e480 2023-09-30T22:29:24.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.282+0000 7eff4959a700 1 -- 172.21.15.40:0/1259739661 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff44003a20 con 0x7eff4c09e480 2023-09-30T22:29:24.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.282+0000 7eff4959a700 1 -- 172.21.15.40:0/1259739661 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff44003dd0 con 0x7eff4c09e480 2023-09-30T22:29:24.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.282+0000 7eff509a9700 1 -- 172.21.15.40:0/1259739661 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff4c09e480 msgr2=0x7eff4c13bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:24.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.282+0000 7eff509a9700 1 --2- 172.21.15.40:0/1259739661 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff4c09e480 0x7eff4c13bc20 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7eff44009e50 tx=0x7eff4400b330 comp rx=0 tx=0).stop 2023-09-30T22:29:24.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.282+0000 7eff509a9700 1 -- 172.21.15.40:0/1259739661 shutdown_connections 2023-09-30T22:29:24.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.282+0000 7eff509a9700 1 --2- 172.21.15.40:0/1259739661 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff4c09e480 0x7eff4c13bc20 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:24.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.282+0000 7eff509a9700 1 --2- 172.21.15.40:0/1259739661 >> v2:172.21.15.40:3300/0 conn(0x7eff4c09c890 0x7eff4c09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:24.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.282+0000 7eff509a9700 1 -- 172.21.15.40:0/1259739661 >> 172.21.15.40:0/1259739661 conn(0x7eff4c0a7080 msgr2=0x7eff4c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:24.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.282+0000 7eff509a9700 1 -- 172.21.15.40:0/1259739661 shutdown_connections 2023-09-30T22:29:24.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.282+0000 7eff509a9700 1 -- 172.21.15.40:0/1259739661 wait complete. 2023-09-30T22:29:24.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.283+0000 7eff509a9700 1 Processor -- start 2023-09-30T22:29:24.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.283+0000 7eff509a9700 1 -- start start 2023-09-30T22:29:24.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.284+0000 7eff509a9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff4c09c890 0x7eff4c1c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:24.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.284+0000 7eff509a9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7eff4c09d920 0x7eff4c1c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:24.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.284+0000 7eff509a9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff4c09e480 0x7eff4c12d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:24.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.284+0000 7eff509a9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c12f780 con 0x7eff4c09e480 2023-09-30T22:29:24.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.284+0000 7eff509a9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c09ecf0 con 0x7eff4c09d920 2023-09-30T22:29:24.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.284+0000 7eff509a9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c08f560 con 0x7eff4c09c890 2023-09-30T22:29:24.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.284+0000 7eff4ad9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff4c09e480 0x7eff4c12d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:24.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.284+0000 7eff4a59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff4c09c890 0x7eff4c1c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:24.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.284+0000 7eff4a59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff4c09c890 0x7eff4c1c8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:39114/0 (socket says 172.21.15.40:39114) 2023-09-30T22:29:24.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.284+0000 7eff4ad9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff4c09e480 0x7eff4c12d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56772/0 (socket says 172.21.15.40:56772) 2023-09-30T22:29:24.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.284+0000 7eff4a59c700 1 -- 172.21.15.40:0/4124363240 learned_addr learned my addr 172.21.15.40:0/4124363240 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:24.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.284+0000 7eff49d9b700 1 --2- 172.21.15.40:0/4124363240 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7eff4c09d920 0x7eff4c1c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:24.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.284+0000 7eff4ad9d700 1 -- 172.21.15.40:0/4124363240 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff4c09c890 msgr2=0x7eff4c1c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:24.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.284+0000 7eff4ad9d700 1 --2- 172.21.15.40:0/4124363240 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff4c09c890 0x7eff4c1c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:24.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.284+0000 7eff4ad9d700 1 -- 172.21.15.40:0/4124363240 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7eff4c09d920 msgr2=0x7eff4c1c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:24.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.284+0000 7eff4ad9d700 1 --2- 172.21.15.40:0/4124363240 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7eff4c09d920 0x7eff4c1c9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:24.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.284+0000 7eff4ad9d700 1 -- 172.21.15.40:0/4124363240 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff44009b30 con 0x7eff4c09e480 2023-09-30T22:29:24.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.285+0000 7eff4ad9d700 1 --2- 172.21.15.40:0/4124363240 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff4c09e480 0x7eff4c12d3e0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7eff44014000 tx=0x7eff44004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:24.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.285+0000 7eff3affd700 1 -- 172.21.15.40:0/4124363240 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff44004440 con 0x7eff4c09e480 2023-09-30T22:29:24.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.285+0000 7eff3affd700 1 -- 172.21.15.40:0/4124363240 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff440045c0 con 0x7eff4c09e480 2023-09-30T22:29:24.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.285+0000 7eff509a9700 1 -- 172.21.15.40:0/4124363240 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff4c0a5d20 con 0x7eff4c09e480 2023-09-30T22:29:24.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.285+0000 7eff3affd700 1 -- 172.21.15.40:0/4124363240 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff44004970 con 0x7eff4c09e480 2023-09-30T22:29:24.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.285+0000 7eff509a9700 1 -- 172.21.15.40:0/4124363240 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff4c1c96d0 con 0x7eff4c09e480 2023-09-30T22:29:24.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.286+0000 7eff3affd700 1 -- 172.21.15.40:0/4124363240 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7eff44012430 con 0x7eff4c09e480 2023-09-30T22:29:24.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.286+0000 7eff509a9700 1 -- 172.21.15.40:0/4124363240 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff4c130c70 con 0x7eff4c09e480 2023-09-30T22:29:24.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.286+0000 7eff3affd700 1 -- 172.21.15.40:0/4124363240 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7eff44040c40 con 0x7eff4c09e480 2023-09-30T22:29:24.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.291+0000 7eff3affd700 1 -- 172.21.15.40:0/4124363240 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7eff4c130c70 con 0x7eff4c09e480 2023-09-30T22:29:24.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.368+0000 7fbcb6f9c700 1 -- 172.21.15.40:0/3037887025 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbcb01208c0 con 0x7fbcb009d920 2023-09-30T22:29:24.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.368+0000 7fbcad7fa700 1 -- 172.21.15.40:0/3037887025 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbcb01208c0 con 0x7fbcb009d920 2023-09-30T22:29:24.369 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:24.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.370+0000 7fbcb6f9c700 1 -- 172.21.15.40:0/3037887025 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcb009d920 msgr2=0x7fbcb0119dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:24.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.370+0000 7fbcb6f9c700 1 --2- 172.21.15.40:0/3037887025 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcb009d920 0x7fbcb0119dc0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fbca400ebe0 tx=0x7fbca400eef0 comp rx=0 tx=0).stop 2023-09-30T22:29:24.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.370+0000 7fbcb6f9c700 1 -- 172.21.15.40:0/3037887025 shutdown_connections 2023-09-30T22:29:24.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.370+0000 7fbcb6f9c700 1 --2- 172.21.15.40:0/3037887025 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbcb0130de0 0x7fbcb011a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:24.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.370+0000 7fbcb6f9c700 1 --2- 172.21.15.40:0/3037887025 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcb009d920 0x7fbcb0119dc0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:24.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.370+0000 7fbcb6f9c700 1 --2- 172.21.15.40:0/3037887025 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcb009e230 0x7fbcb011a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:24.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.370+0000 7fbcb6f9c700 1 -- 172.21.15.40:0/3037887025 >> 172.21.15.40:0/3037887025 conn(0x7fbcb009fb20 msgr2=0x7fbcb012eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:24.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.371+0000 7fbcb6f9c700 1 -- 172.21.15.40:0/3037887025 shutdown_connections 2023-09-30T22:29:24.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.372+0000 7fbcb6f9c700 1 -- 172.21.15.40:0/3037887025 wait complete. 2023-09-30T22:29:24.385 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:24.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.449+0000 7fed64950700 1 -- 172.21.15.40:0/4058304925 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fed60074330 con 0x7fed6009dd60 2023-09-30T22:29:24.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.449+0000 7fed4effd700 1 -- 172.21.15.40:0/4058304925 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fed5401b2e0 con 0x7fed6009dd60 2023-09-30T22:29:24.450 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:24.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.451+0000 7fed64950700 1 -- 172.21.15.40:0/4058304925 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed6009dd60 msgr2=0x7fed6011b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:24.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.451+0000 7fed64950700 1 --2- 172.21.15.40:0/4058304925 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed6009dd60 0x7fed6011b6c0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fed5400cb30 tx=0x7fed5400ce40 comp rx=0 tx=0).stop 2023-09-30T22:29:24.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.451+0000 7fed64950700 1 -- 172.21.15.40:0/4058304925 shutdown_connections 2023-09-30T22:29:24.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.451+0000 7fed64950700 1 --2- 172.21.15.40:0/4058304925 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fed6009d450 0x7fed6011b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:24.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.451+0000 7fed64950700 1 --2- 172.21.15.40:0/4058304925 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed60130700 0x7fed6011bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:24.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.451+0000 7fed64950700 1 --2- 172.21.15.40:0/4058304925 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed6009dd60 0x7fed6011b6c0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:24.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.451+0000 7fed64950700 1 -- 172.21.15.40:0/4058304925 >> 172.21.15.40:0/4058304925 conn(0x7fed600a2a00 msgr2=0x7fed601b7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:24.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.451+0000 7fed64950700 1 -- 172.21.15.40:0/4058304925 shutdown_connections 2023-09-30T22:29:24.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.451+0000 7fed64950700 1 -- 172.21.15.40:0/4058304925 wait complete. 2023-09-30T22:29:24.464 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:24.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.488+0000 7eff509a9700 1 -- 172.21.15.40:0/4124363240 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7eff4c130c70 con 0x7eff4c09e480 2023-09-30T22:29:24.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.488+0000 7eff3affd700 1 -- 172.21.15.40:0/4124363240 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7eff4c130c70 con 0x7eff4c09e480 2023-09-30T22:29:24.489 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:24.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.490+0000 7eff509a9700 1 -- 172.21.15.40:0/4124363240 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff4c09e480 msgr2=0x7eff4c12d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:24.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.490+0000 7eff509a9700 1 --2- 172.21.15.40:0/4124363240 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff4c09e480 0x7eff4c12d3e0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7eff44014000 tx=0x7eff44004ad0 comp rx=0 tx=0).stop 2023-09-30T22:29:24.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.490+0000 7eff509a9700 1 -- 172.21.15.40:0/4124363240 shutdown_connections 2023-09-30T22:29:24.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.490+0000 7eff509a9700 1 --2- 172.21.15.40:0/4124363240 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff4c09c890 0x7eff4c1c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:24.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.490+0000 7eff509a9700 1 --2- 172.21.15.40:0/4124363240 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff4c09e480 0x7eff4c12d3e0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:24.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.490+0000 7eff509a9700 1 --2- 172.21.15.40:0/4124363240 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7eff4c09d920 0x7eff4c1c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:24.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.490+0000 7eff509a9700 1 -- 172.21.15.40:0/4124363240 >> 172.21.15.40:0/4124363240 conn(0x7eff4c0a7080 msgr2=0x7eff4c0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:24.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.491+0000 7eff509a9700 1 -- 172.21.15.40:0/4124363240 shutdown_connections 2023-09-30T22:29:24.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.491+0000 7eff509a9700 1 -- 172.21.15.40:0/4124363240 wait complete. 2023-09-30T22:29:24.504 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:24.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.507+0000 7ff3aad9d700 1 -- 172.21.15.40:0/2690790954 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff3a411ecb0 con 0x7ff3a412f070 2023-09-30T22:29:24.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.507+0000 7ff3a17fa700 1 -- 172.21.15.40:0/2690790954 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff390015020 con 0x7ff3a412f070 2023-09-30T22:29:24.508 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:24.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.509+0000 7ff3aad9d700 1 -- 172.21.15.40:0/2690790954 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3a412f070 msgr2=0x7ff3a4134670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:24.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.509+0000 7ff3aad9d700 1 --2- 172.21.15.40:0/2690790954 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3a412f070 0x7ff3a4134670 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7ff3a409b400 tx=0x7ff390004750 comp rx=0 tx=0).stop 2023-09-30T22:29:24.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.509+0000 7ff3aad9d700 1 -- 172.21.15.40:0/2690790954 shutdown_connections 2023-09-30T22:29:24.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.509+0000 7ff3aad9d700 1 --2- 172.21.15.40:0/2690790954 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff3a412e590 0x7ff3a4134130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:24.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.509+0000 7ff3aad9d700 1 --2- 172.21.15.40:0/2690790954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3a4136170 0x7ff3a41c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:24.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.509+0000 7ff3aad9d700 1 --2- 172.21.15.40:0/2690790954 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3a412f070 0x7ff3a4134670 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:24.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.509+0000 7ff3aad9d700 1 -- 172.21.15.40:0/2690790954 >> 172.21.15.40:0/2690790954 conn(0x7ff3a40a2a00 msgr2=0x7ff3a409d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:24.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.509+0000 7ff3aad9d700 1 -- 172.21.15.40:0/2690790954 shutdown_connections 2023-09-30T22:29:24.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:24.509+0000 7ff3aad9d700 1 -- 172.21.15.40:0/2690790954 wait complete. 2023-09-30T22:29:24.523 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:25.386 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:25.466 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:25.504 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:25.524 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:25.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.529+0000 7f7d52f21700 1 Processor -- start 2023-09-30T22:29:25.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.529+0000 7f7d52f21700 1 -- start start 2023-09-30T22:29:25.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.529+0000 7f7d52f21700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d4c136bf0 0x7f7d4c138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:25.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.529+0000 7f7d52f21700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7d4c139510 0x7f7d4c13b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:25.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.529+0000 7f7d52f21700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d4c0a2600 con 0x7f7d4c09c890 2023-09-30T22:29:25.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.529+0000 7f7d52f21700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d4c0a29d0 con 0x7f7d4c139510 2023-09-30T22:29:25.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.529+0000 7f7d52f21700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c09fb40 con 0x7f7d4c136bf0 2023-09-30T22:29:25.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.530+0000 7f7d50cbd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7d4c09c890 0x7f7d4c09cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58176/0 (socket says 172.21.15.40:58176) 2023-09-30T22:29:25.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.530+0000 7f7d50cbd700 1 -- 172.21.15.40:0/1943326268 learned_addr learned my addr 172.21.15.40:0/1943326268 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:29:25.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.530+0000 7f7d514be700 1 --2- 172.21.15.40:0/1943326268 >> v2:172.21.15.40:3300/0 conn(0x7f7d4c139510 0x7f7d4c13b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:25.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.530+0000 7f7d4bfff700 1 --2- 172.21.15.40:0/1943326268 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d4c136bf0 0x7f7d4c138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:25.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.530+0000 7f7d4bfff700 1 -- 172.21.15.40:0/1943326268 >> v2:172.21.15.40:3300/0 conn(0x7f7d4c139510 msgr2=0x7f7d4c13b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:25.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.530+0000 7f7d4bfff700 1 --2- 172.21.15.40:0/1943326268 >> v2:172.21.15.40:3300/0 conn(0x7f7d4c139510 0x7f7d4c13b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:25.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.530+0000 7f7d4bfff700 1 -- 172.21.15.40:0/1943326268 >> v1:172.21.15.40:6789/0 conn(0x7f7d4c09c890 legacy=0x7f7d4c09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:25.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.530+0000 7f7d4bfff700 1 -- 172.21.15.40:0/1943326268 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c09d370 con 0x7f7d4c136bf0 2023-09-30T22:29:25.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.530+0000 7f7d514be700 1 --2- 172.21.15.40:0/1943326268 >> v2:172.21.15.40:3300/0 conn(0x7f7d4c139510 0x7f7d4c13b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:25.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.530+0000 7f7d4bfff700 1 --2- 172.21.15.40:0/1943326268 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d4c136bf0 0x7f7d4c138fd0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f7d38009840 tx=0x7f7d38009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba65441a33220b8c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:25.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.531+0000 7f7d4b7fe700 1 -- 172.21.15.40:0/1943326268 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d38011830 con 0x7f7d4c136bf0 2023-09-30T22:29:25.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.531+0000 7f7d4b7fe700 1 -- 172.21.15.40:0/1943326268 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d38011990 con 0x7f7d4c136bf0 2023-09-30T22:29:25.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.531+0000 7f7d4b7fe700 1 -- 172.21.15.40:0/1943326268 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d38011d20 con 0x7f7d4c136bf0 2023-09-30T22:29:25.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.531+0000 7f7d52f21700 1 -- 172.21.15.40:0/1943326268 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d4c136bf0 msgr2=0x7f7d4c138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:25.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.531+0000 7f7d52f21700 1 --2- 172.21.15.40:0/1943326268 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d4c136bf0 0x7f7d4c138fd0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f7d38009840 tx=0x7f7d38009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:25.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.532+0000 7f7d52f21700 1 -- 172.21.15.40:0/1943326268 shutdown_connections 2023-09-30T22:29:25.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.532+0000 7f7d52f21700 1 --2- 172.21.15.40:0/1943326268 >> v2:172.21.15.40:3300/0 conn(0x7f7d4c139510 0x7f7d4c13b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:25.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.532+0000 7f7d52f21700 1 --2- 172.21.15.40:0/1943326268 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d4c136bf0 0x7f7d4c138fd0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:25.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.532+0000 7f7d52f21700 1 -- 172.21.15.40:0/1943326268 >> 172.21.15.40:0/1943326268 conn(0x7f7d4c0a7080 msgr2=0x7f7d4c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:25.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.532+0000 7f7d52f21700 1 -- 172.21.15.40:0/1943326268 shutdown_connections 2023-09-30T22:29:25.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.532+0000 7f7d52f21700 1 -- 172.21.15.40:0/1943326268 wait complete. 2023-09-30T22:29:25.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.533+0000 7f7d52f21700 1 Processor -- start 2023-09-30T22:29:25.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.534+0000 7f7d52f21700 1 -- start start 2023-09-30T22:29:25.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.534+0000 7f7d52f21700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7d4c09c890 0x7f7d4c06f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:25.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.534+0000 7f7d52f21700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d4c136bf0 0x7f7d4c06f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:25.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.534+0000 7f7d52f21700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d4c139510 0x7f7d4c06fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:25.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.534+0000 7f7d52f21700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c070c50 con 0x7f7d4c139510 2023-09-30T22:29:25.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.535+0000 7f7d52f21700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c070540 con 0x7f7d4c136bf0 2023-09-30T22:29:25.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.535+0000 7f7d52f21700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c138fe0 con 0x7f7d4c09c890 2023-09-30T22:29:25.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.535+0000 7f7d50cbd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7d4c09c890 0x7f7d4c06f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:25.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.535+0000 7f7d50cbd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7d4c09c890 0x7f7d4c06f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:39128/0 (socket says 172.21.15.40:39128) 2023-09-30T22:29:25.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.535+0000 7f7d50cbd700 1 -- 172.21.15.40:0/3281637755 learned_addr learned my addr 172.21.15.40:0/3281637755 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:25.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.535+0000 7f7d514be700 1 --2- 172.21.15.40:0/3281637755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d4c139510 0x7f7d4c06fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:25.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.535+0000 7f7d4bfff700 1 --2- 172.21.15.40:0/3281637755 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d4c136bf0 0x7f7d4c06f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:25.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.535+0000 7f7d50cbd700 1 -- 172.21.15.40:0/3281637755 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d4c136bf0 msgr2=0x7f7d4c06f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:25.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.535+0000 7f7d50cbd700 1 --2- 172.21.15.40:0/3281637755 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d4c136bf0 0x7f7d4c06f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:25.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.535+0000 7f7d50cbd700 1 -- 172.21.15.40:0/3281637755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d4c139510 msgr2=0x7f7d4c06fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:25.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.535+0000 7f7d50cbd700 1 --2- 172.21.15.40:0/3281637755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d4c139510 0x7f7d4c06fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:25.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.535+0000 7f7d50cbd700 1 -- 172.21.15.40:0/3281637755 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d44009a70 con 0x7f7d4c09c890 2023-09-30T22:29:25.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.535+0000 7f7d514be700 1 --2- 172.21.15.40:0/3281637755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d4c139510 0x7f7d4c06fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:25.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.535+0000 7f7d4bfff700 1 --2- 172.21.15.40:0/3281637755 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d4c136bf0 0x7f7d4c06f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:25.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.536+0000 7f7d50cbd700 1 --2- 172.21.15.40:0/3281637755 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7d4c09c890 0x7f7d4c06f0e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f7d4000c700 tx=0x7f7d4000ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:25.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.536+0000 7f7d497fa700 1 -- 172.21.15.40:0/3281637755 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d400074e0 con 0x7f7d4c09c890 2023-09-30T22:29:25.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.536+0000 7f7d497fa700 1 -- 172.21.15.40:0/3281637755 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d40007640 con 0x7f7d4c09c890 2023-09-30T22:29:25.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.536+0000 7f7d497fa700 1 -- 172.21.15.40:0/3281637755 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d40005a30 con 0x7f7d4c09c890 2023-09-30T22:29:25.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.536+0000 7f7d52f21700 1 -- 172.21.15.40:0/3281637755 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d380094a0 con 0x7f7d4c09c890 2023-09-30T22:29:25.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.536+0000 7f7d52f21700 1 -- 172.21.15.40:0/3281637755 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4c12c0a0 con 0x7f7d4c09c890 2023-09-30T22:29:25.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.537+0000 7f7d52f21700 1 -- 172.21.15.40:0/3281637755 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d4c12bc70 con 0x7f7d4c09c890 2023-09-30T22:29:25.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.537+0000 7f7d497fa700 1 -- 172.21.15.40:0/3281637755 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7d40005b90 con 0x7f7d4c09c890 2023-09-30T22:29:25.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.538+0000 7f7d497fa700 1 -- 172.21.15.40:0/3281637755 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f7d4003ec70 con 0x7f7d4c09c890 2023-09-30T22:29:25.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.547+0000 7f7d497fa700 1 -- 172.21.15.40:0/3281637755 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d40012400 con 0x7f7d4c09c890 2023-09-30T22:29:25.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.610+0000 7f36c8966700 1 Processor -- start 2023-09-30T22:29:25.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.611+0000 7f36c8966700 1 -- start start 2023-09-30T22:29:25.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.611+0000 7f36c8966700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36c409d920 0x7f36c409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:25.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.611+0000 7f36c8966700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36c409f0f0 0x7f36c409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:25.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.611+0000 7f36c8966700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36c409f940 con 0x7f36c4133ca0 2023-09-30T22:29:25.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.611+0000 7f36c8966700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c406b4c0 con 0x7f36c409f0f0 2023-09-30T22:29:25.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.611+0000 7f36c8966700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36c409a8f0 con 0x7f36c409d920 2023-09-30T22:29:25.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.612+0000 7f36c259c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36c409d920 0x7f36c409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:25.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.612+0000 7f36c2d9d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f36c4133ca0 0x7f36c4134140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58190/0 (socket says 172.21.15.40:58190) 2023-09-30T22:29:25.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.612+0000 7f36c2d9d700 1 -- 172.21.15.40:0/1907334841 learned_addr learned my addr 172.21.15.40:0/1907334841 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:29:25.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.612+0000 7f36c1d9b700 1 --2- 172.21.15.40:0/1907334841 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36c409f0f0 0x7f36c409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:25.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.612+0000 7f36c1d9b700 1 -- 172.21.15.40:0/1907334841 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36c409d920 msgr2=0x7f36c409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:25.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.612+0000 7f36c1d9b700 1 --2- 172.21.15.40:0/1907334841 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36c409d920 0x7f36c409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:25.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.612+0000 7f36c1d9b700 1 -- 172.21.15.40:0/1907334841 >> v1:172.21.15.40:6789/0 conn(0x7f36c4133ca0 legacy=0x7f36c4134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:25.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.612+0000 7f36c1d9b700 1 -- 172.21.15.40:0/1907334841 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c409f6e0 con 0x7f36c409f0f0 2023-09-30T22:29:25.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.612+0000 7f36c159a700 1 -- 172.21.15.40:0/1907334841 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1740781238 0 0) 0x7f36c409f940 con 0x7f36c4133ca0 2023-09-30T22:29:25.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.612+0000 7f36c259c700 1 --2- 172.21.15.40:0/1907334841 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36c409d920 0x7f36c409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:25.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.612+0000 7f36c1d9b700 1 --2- 172.21.15.40:0/1907334841 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36c409f0f0 0x7f36c409e230 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f36b8009870 tx=0x7f36b8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9bc1686efe863bb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:25.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.612+0000 7f36c159a700 1 -- 172.21.15.40:0/1907334841 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b8011830 con 0x7f36c409f0f0 2023-09-30T22:29:25.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.612+0000 7f36c159a700 1 -- 172.21.15.40:0/1907334841 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b8011990 con 0x7f36c409f0f0 2023-09-30T22:29:25.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.612+0000 7f36c159a700 1 -- 172.21.15.40:0/1907334841 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b8011d20 con 0x7f36c409f0f0 2023-09-30T22:29:25.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.613+0000 7f36c8966700 1 -- 172.21.15.40:0/1907334841 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36c409f0f0 msgr2=0x7f36c409e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:25.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.613+0000 7f36c8966700 1 --2- 172.21.15.40:0/1907334841 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36c409f0f0 0x7f36c409e230 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f36b8009870 tx=0x7f36b8009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:25.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.613+0000 7f36c8966700 1 -- 172.21.15.40:0/1907334841 shutdown_connections 2023-09-30T22:29:25.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.613+0000 7f36c8966700 1 --2- 172.21.15.40:0/1907334841 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36c409d920 0x7f36c409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:25.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.613+0000 7f36c8966700 1 --2- 172.21.15.40:0/1907334841 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36c409f0f0 0x7f36c409e230 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:25.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.613+0000 7f36c8966700 1 -- 172.21.15.40:0/1907334841 >> 172.21.15.40:0/1907334841 conn(0x7f36c409fb20 msgr2=0x7f36c409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:25.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.613+0000 7f36c8966700 1 -- 172.21.15.40:0/1907334841 shutdown_connections 2023-09-30T22:29:25.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.613+0000 7f36c8966700 1 -- 172.21.15.40:0/1907334841 wait complete. 2023-09-30T22:29:25.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.614+0000 7f36c8966700 1 Processor -- start 2023-09-30T22:29:25.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.615+0000 7f36c8966700 1 -- start start 2023-09-30T22:29:25.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.615+0000 7f36c8966700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36c409d920 0x7f36c411e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:25.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.615+0000 7f36c8966700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36c4133ca0 0x7f36c411e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:25.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.615+0000 7f36c8966700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36c41316d0 0x7f36c411ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:25.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.615+0000 7f36c8966700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c4120540 con 0x7f36c41316d0 2023-09-30T22:29:25.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.615+0000 7f36c8966700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c41227c0 con 0x7f36c409d920 2023-09-30T22:29:25.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.615+0000 7f36c8966700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36c4121e00 con 0x7f36c4133ca0 2023-09-30T22:29:25.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.615+0000 7f36c1d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36c4133ca0 0x7f36c411e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:25.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.615+0000 7f36c1d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36c4133ca0 0x7f36c411e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:39146/0 (socket says 172.21.15.40:39146) 2023-09-30T22:29:25.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.615+0000 7f36c1d9b700 1 -- 172.21.15.40:0/1194874576 learned_addr learned my addr 172.21.15.40:0/1194874576 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:25.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.615+0000 7f36c2d9d700 1 --2- 172.21.15.40:0/1194874576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36c41316d0 0x7f36c411ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:25.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.616+0000 7f36c259c700 1 --2- 172.21.15.40:0/1194874576 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36c409d920 0x7f36c411e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:25.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.616+0000 7f36c1d9b700 1 -- 172.21.15.40:0/1194874576 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36c409d920 msgr2=0x7f36c411e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:25.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.616+0000 7f36c1d9b700 1 --2- 172.21.15.40:0/1194874576 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36c409d920 0x7f36c411e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:25.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.616+0000 7f36c1d9b700 1 -- 172.21.15.40:0/1194874576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36c41316d0 msgr2=0x7f36c411ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:25.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.616+0000 7f36c1d9b700 1 --2- 172.21.15.40:0/1194874576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36c41316d0 0x7f36c411ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:25.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.616+0000 7f36c1d9b700 1 -- 172.21.15.40:0/1194874576 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b4009430 con 0x7f36c4133ca0 2023-09-30T22:29:25.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.616+0000 7f36c1d9b700 1 --2- 172.21.15.40:0/1194874576 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36c4133ca0 0x7f36c411e820 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f36b8000c00 tx=0x7f36b8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:25.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.616+0000 7f36b2ffd700 1 -- 172.21.15.40:0/1194874576 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b801a6e0 con 0x7f36c4133ca0 2023-09-30T22:29:25.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.616+0000 7f36b2ffd700 1 -- 172.21.15.40:0/1194874576 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b801a840 con 0x7f36c4133ca0 2023-09-30T22:29:25.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.616+0000 7f36c8966700 1 -- 172.21.15.40:0/1194874576 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b80094a0 con 0x7f36c4133ca0 2023-09-30T22:29:25.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.616+0000 7f36b2ffd700 1 -- 172.21.15.40:0/1194874576 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b801abb0 con 0x7f36c4133ca0 2023-09-30T22:29:25.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.616+0000 7f36c8966700 1 -- 172.21.15.40:0/1194874576 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36c409c9e0 con 0x7f36c4133ca0 2023-09-30T22:29:25.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.618+0000 7f36c8966700 1 -- 172.21.15.40:0/1194874576 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36c41217c0 con 0x7f36c4133ca0 2023-09-30T22:29:25.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.618+0000 7f36b2ffd700 1 -- 172.21.15.40:0/1194874576 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f36b8022070 con 0x7f36c4133ca0 2023-09-30T22:29:25.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.618+0000 7f36b2ffd700 1 -- 172.21.15.40:0/1194874576 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f36b8040b00 con 0x7f36c4133ca0 2023-09-30T22:29:25.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.627+0000 7f36b2ffd700 1 -- 172.21.15.40:0/1194874576 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f36b802d3b0 con 0x7f36c4133ca0 2023-09-30T22:29:25.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.650+0000 7fdb3d07d700 1 Processor -- start 2023-09-30T22:29:25.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.650+0000 7fdb3d07d700 1 -- start start 2023-09-30T22:29:25.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.651+0000 7fdb3d07d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb3809d920 0x7fdb3809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:25.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.651+0000 7fdb3d07d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdb3809f0f0 0x7fdb3809e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:25.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.651+0000 7fdb3d07d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb3809f940 con 0x7fdb38133ca0 2023-09-30T22:29:25.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.651+0000 7fdb3d07d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb3806b4c0 con 0x7fdb3809f0f0 2023-09-30T22:29:25.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.651+0000 7fdb3d07d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3809a8f0 con 0x7fdb3809d920 2023-09-30T22:29:25.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.651+0000 7fdb36d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb3809d920 0x7fdb3809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:25.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.651+0000 7fdb36d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb3809d920 0x7fdb3809dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:39162/0 (socket says 172.21.15.40:39162) 2023-09-30T22:29:25.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.651+0000 7fdb36d9d700 1 -- 172.21.15.40:0/2550068080 learned_addr learned my addr 172.21.15.40:0/2550068080 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:25.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.651+0000 7fdb36d9d700 1 -- 172.21.15.40:0/2550068080 >> v2:172.21.15.40:3300/0 conn(0x7fdb3809f0f0 msgr2=0x7fdb3809e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:25.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.651+0000 7fdb36d9d700 1 --2- 172.21.15.40:0/2550068080 >> v2:172.21.15.40:3300/0 conn(0x7fdb3809f0f0 0x7fdb3809e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:25.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.651+0000 7fdb36d9d700 1 -- 172.21.15.40:0/2550068080 >> v1:172.21.15.40:6789/0 conn(0x7fdb38133ca0 legacy=0x7fdb38134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:25.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.651+0000 7fdb36d9d700 1 -- 172.21.15.40:0/2550068080 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb3809f6e0 con 0x7fdb3809d920 2023-09-30T22:29:25.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.651+0000 7fdb36d9d700 1 --2- 172.21.15.40:0/2550068080 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb3809d920 0x7fdb3809dcf0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fdb28006fd0 tx=0x7fdb28009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=664d00007943f2d3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:25.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.651+0000 7fdb35d9b700 1 -- 172.21.15.40:0/2550068080 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb28005e30 con 0x7fdb3809d920 2023-09-30T22:29:25.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.652+0000 7fdb35d9b700 1 -- 172.21.15.40:0/2550068080 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb28006030 con 0x7fdb3809d920 2023-09-30T22:29:25.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.652+0000 7fdb35d9b700 1 -- 172.21.15.40:0/2550068080 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb280063e0 con 0x7fdb3809d920 2023-09-30T22:29:25.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.652+0000 7fdb3d07d700 1 -- 172.21.15.40:0/2550068080 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb3809d920 msgr2=0x7fdb3809dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:25.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.652+0000 7fdb3d07d700 1 --2- 172.21.15.40:0/2550068080 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb3809d920 0x7fdb3809dcf0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fdb28006fd0 tx=0x7fdb28009bd0 comp rx=0 tx=0).stop 2023-09-30T22:29:25.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.652+0000 7fdb3d07d700 1 -- 172.21.15.40:0/2550068080 shutdown_connections 2023-09-30T22:29:25.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.652+0000 7fdb3d07d700 1 --2- 172.21.15.40:0/2550068080 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb3809d920 0x7fdb3809dcf0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:25.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.652+0000 7fdb3d07d700 1 --2- 172.21.15.40:0/2550068080 >> v2:172.21.15.40:3300/0 conn(0x7fdb3809f0f0 0x7fdb3809e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:25.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.652+0000 7fdb3d07d700 1 -- 172.21.15.40:0/2550068080 >> 172.21.15.40:0/2550068080 conn(0x7fdb3809fb20 msgr2=0x7fdb3809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:25.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.652+0000 7fdb3d07d700 1 -- 172.21.15.40:0/2550068080 shutdown_connections 2023-09-30T22:29:25.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.652+0000 7fdb3d07d700 1 -- 172.21.15.40:0/2550068080 wait complete. 2023-09-30T22:29:25.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.653+0000 7fdb3d07d700 1 Processor -- start 2023-09-30T22:29:25.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.654+0000 7fdb3d07d700 1 -- start start 2023-09-30T22:29:25.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.654+0000 7fdb3d07d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb3809d920 0x7fdb3811e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:25.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.654+0000 7fdb3d07d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb38133ca0 0x7fdb3811eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:25.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.654+0000 7fdb3d07d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb38122540 0x7fdb3811eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:25.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.654+0000 7fdb3d07d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3811fa20 con 0x7fdb3809d920 2023-09-30T22:29:25.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.654+0000 7fdb3d07d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb38120130 con 0x7fdb38122540 2023-09-30T22:29:25.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.654+0000 7fdb3d07d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb38121380 con 0x7fdb38133ca0 2023-09-30T22:29:25.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.654+0000 7fdb3659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb38133ca0 0x7fdb3811eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:25.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.654+0000 7fdb3659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb38133ca0 0x7fdb3811eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:39164/0 (socket says 172.21.15.40:39164) 2023-09-30T22:29:25.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.654+0000 7fdb3659c700 1 -- 172.21.15.40:0/1495634582 learned_addr learned my addr 172.21.15.40:0/1495634582 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:25.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.654+0000 7fdb36d9d700 1 --2- 172.21.15.40:0/1495634582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb3809d920 0x7fdb3811e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:25.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.655+0000 7fdb36d9d700 1 -- 172.21.15.40:0/1495634582 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb38133ca0 msgr2=0x7fdb3811eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:25.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.655+0000 7fdb36d9d700 1 --2- 172.21.15.40:0/1495634582 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb38133ca0 0x7fdb3811eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:25.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.655+0000 7fdb36d9d700 1 -- 172.21.15.40:0/1495634582 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb38122540 msgr2=0x7fdb3811eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:25.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.655+0000 7fdb36d9d700 1 --2- 172.21.15.40:0/1495634582 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb38122540 0x7fdb3811eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:25.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.655+0000 7fdb36d9d700 1 -- 172.21.15.40:0/1495634582 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb28009500 con 0x7fdb3809d920 2023-09-30T22:29:25.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.655+0000 7fdb36d9d700 1 --2- 172.21.15.40:0/1495634582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb3809d920 0x7fdb3811e570 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fdb28015000 tx=0x7fdb28004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:25.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.655+0000 7fdb1f7fe700 1 -- 172.21.15.40:0/1495634582 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb28004250 con 0x7fdb3809d920 2023-09-30T22:29:25.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.655+0000 7fdb1f7fe700 1 -- 172.21.15.40:0/1495634582 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb280043d0 con 0x7fdb3809d920 2023-09-30T22:29:25.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.655+0000 7fdb3d07d700 1 -- 172.21.15.40:0/1495634582 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb38120710 con 0x7fdb3809d920 2023-09-30T22:29:25.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.655+0000 7fdb1f7fe700 1 -- 172.21.15.40:0/1495634582 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb280036a0 con 0x7fdb3809d920 2023-09-30T22:29:25.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.655+0000 7fdb3d07d700 1 -- 172.21.15.40:0/1495634582 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb380a29e0 con 0x7fdb3809d920 2023-09-30T22:29:25.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.656+0000 7fdb1f7fe700 1 -- 172.21.15.40:0/1495634582 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb28022070 con 0x7fdb3809d920 2023-09-30T22:29:25.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.656+0000 7fdb1f7fe700 1 -- 172.21.15.40:0/1495634582 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fdb28040cf0 con 0x7fdb3809d920 2023-09-30T22:29:25.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.657+0000 7fdb3d07d700 1 -- 172.21.15.40:0/1495634582 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb3809c9e0 con 0x7fdb3809d920 2023-09-30T22:29:25.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.662+0000 7fdb1f7fe700 1 -- 172.21.15.40:0/1495634582 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb28019730 con 0x7fdb3809d920 2023-09-30T22:29:25.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.667+0000 7f00755bf700 1 Processor -- start 2023-09-30T22:29:25.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.668+0000 7f00755bf700 1 -- start start 2023-09-30T22:29:25.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.668+0000 7f00755bf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0070099a40 0x7f0070099e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:25.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.668+0000 7f00755bf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f007012d910 0x7f00701388f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:25.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.668+0000 7f00755bf700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f007009c650 con 0x7f007009a350 2023-09-30T22:29:25.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.668+0000 7f00755bf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007009b800 con 0x7f007012d910 2023-09-30T22:29:25.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.668+0000 7f00755bf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f007009f100 con 0x7f0070099a40 2023-09-30T22:29:25.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.668+0000 7f006e7fc700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f007009a350 0x7f007012d200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58194/0 (socket says 172.21.15.40:58194) 2023-09-30T22:29:25.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.668+0000 7f006e7fc700 1 -- 172.21.15.40:0/308500938 learned_addr learned my addr 172.21.15.40:0/308500938 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:29:25.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.668+0000 7f006effd700 1 --2- 172.21.15.40:0/308500938 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0070099a40 0x7f0070099e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:25.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.668+0000 7f006f7fe700 1 --2- 172.21.15.40:0/308500938 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f007012d910 0x7f00701388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:25.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.669+0000 7f006dffb700 1 -- 172.21.15.40:0/308500938 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1923793575 0 0) 0x7f007009c650 con 0x7f007009a350 2023-09-30T22:29:25.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.669+0000 7f006dffb700 1 -- 172.21.15.40:0/308500938 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00580035b0 con 0x7f007009a350 2023-09-30T22:29:25.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.669+0000 7f006effd700 1 -- 172.21.15.40:0/308500938 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f007012d910 msgr2=0x7f00701388f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:25.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.669+0000 7f006effd700 1 --2- 172.21.15.40:0/308500938 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f007012d910 0x7f00701388f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:25.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.669+0000 7f006effd700 1 -- 172.21.15.40:0/308500938 >> v1:172.21.15.40:6789/0 conn(0x7f007009a350 legacy=0x7f007012d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:25.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.669+0000 7f006effd700 1 -- 172.21.15.40:0/308500938 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0070067a90 con 0x7f0070099a40 2023-09-30T22:29:25.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.669+0000 7f006effd700 1 --2- 172.21.15.40:0/308500938 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0070099a40 0x7f0070099e10 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0060009870 tx=0x7f0060009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffea17a0c3c6102e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:25.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.669+0000 7f006dffb700 1 -- 172.21.15.40:0/308500938 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0060011830 con 0x7f0070099a40 2023-09-30T22:29:25.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.669+0000 7f006dffb700 1 -- 172.21.15.40:0/308500938 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0060011990 con 0x7f0070099a40 2023-09-30T22:29:25.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.669+0000 7f006dffb700 1 -- 172.21.15.40:0/308500938 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0060011d00 con 0x7f0070099a40 2023-09-30T22:29:25.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.670+0000 7f00755bf700 1 -- 172.21.15.40:0/308500938 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0070099a40 msgr2=0x7f0070099e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:25.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.670+0000 7f00755bf700 1 --2- 172.21.15.40:0/308500938 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0070099a40 0x7f0070099e10 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0060009870 tx=0x7f0060009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:25.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.670+0000 7f00755bf700 1 -- 172.21.15.40:0/308500938 shutdown_connections 2023-09-30T22:29:25.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.670+0000 7f00755bf700 1 --2- 172.21.15.40:0/308500938 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f007012d910 0x7f00701388f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:25.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.670+0000 7f00755bf700 1 --2- 172.21.15.40:0/308500938 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0070099a40 0x7f0070099e10 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:25.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.670+0000 7f00755bf700 1 -- 172.21.15.40:0/308500938 >> 172.21.15.40:0/308500938 conn(0x7f007006a6d0 msgr2=0x7f007006aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:25.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.670+0000 7f00755bf700 1 -- 172.21.15.40:0/308500938 shutdown_connections 2023-09-30T22:29:25.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.670+0000 7f00755bf700 1 -- 172.21.15.40:0/308500938 wait complete. 2023-09-30T22:29:25.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.671+0000 7f00755bf700 1 Processor -- start 2023-09-30T22:29:25.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.671+0000 7f00755bf700 1 -- start start 2023-09-30T22:29:25.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.672+0000 7f00755bf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0070099a40 0x7f007006d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:25.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.672+0000 7f00755bf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f007009a350 0x7f007006dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:25.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.672+0000 7f00755bf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f007012d910 0x7f007006e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:25.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.672+0000 7f00755bf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0070070ba0 con 0x7f0070099a40 2023-09-30T22:29:25.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.672+0000 7f00755bf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0070071380 con 0x7f007012d910 2023-09-30T22:29:25.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.672+0000 7f00755bf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f007006f760 con 0x7f007009a350 2023-09-30T22:29:25.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.672+0000 7f006effd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0070099a40 0x7f007006d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:25.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.672+0000 7f006effd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0070099a40 0x7f007006d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56802/0 (socket says 172.21.15.40:56802) 2023-09-30T22:29:25.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.672+0000 7f006effd700 1 -- 172.21.15.40:0/2456182983 learned_addr learned my addr 172.21.15.40:0/2456182983 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:25.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.672+0000 7f006e7fc700 1 --2- 172.21.15.40:0/2456182983 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f007009a350 0x7f007006dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:25.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.672+0000 7f006f7fe700 1 --2- 172.21.15.40:0/2456182983 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f007012d910 0x7f007006e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:25.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.672+0000 7f006effd700 1 -- 172.21.15.40:0/2456182983 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f007009a350 msgr2=0x7f007006dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:25.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.672+0000 7f006effd700 1 --2- 172.21.15.40:0/2456182983 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f007009a350 0x7f007006dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:25.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.672+0000 7f006effd700 1 -- 172.21.15.40:0/2456182983 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f007012d910 msgr2=0x7f007006e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:25.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.672+0000 7f006effd700 1 --2- 172.21.15.40:0/2456182983 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f007012d910 0x7f007006e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:25.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.672+0000 7f006effd700 1 -- 172.21.15.40:0/2456182983 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00600094a0 con 0x7f0070099a40 2023-09-30T22:29:25.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.673+0000 7f006effd700 1 --2- 172.21.15.40:0/2456182983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0070099a40 0x7f007006d6a0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f00600090b0 tx=0x7f0060004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:25.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.673+0000 7f00577fe700 1 -- 172.21.15.40:0/2456182983 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00600043c0 con 0x7f0070099a40 2023-09-30T22:29:25.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.673+0000 7f00755bf700 1 -- 172.21.15.40:0/2456182983 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f007009c420 con 0x7f0070099a40 2023-09-30T22:29:25.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.673+0000 7f00755bf700 1 -- 172.21.15.40:0/2456182983 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f007006ef90 con 0x7f0070099a40 2023-09-30T22:29:25.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.674+0000 7f00577fe700 1 -- 172.21.15.40:0/2456182983 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006001f070 con 0x7f0070099a40 2023-09-30T22:29:25.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.674+0000 7f00577fe700 1 -- 172.21.15.40:0/2456182983 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00600036a0 con 0x7f0070099a40 2023-09-30T22:29:25.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.674+0000 7f00755bf700 1 -- 172.21.15.40:0/2456182983 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00500052e0 con 0x7f0070099a40 2023-09-30T22:29:25.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.674+0000 7f00577fe700 1 -- 172.21.15.40:0/2456182983 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0060021030 con 0x7f0070099a40 2023-09-30T22:29:25.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.675+0000 7f00577fe700 1 -- 172.21.15.40:0/2456182983 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f0060040a90 con 0x7f0070099a40 2023-09-30T22:29:25.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.679+0000 7f00577fe700 1 -- 172.21.15.40:0/2456182983 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0060023790 con 0x7f0070099a40 2023-09-30T22:29:25.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.790+0000 7f7d52f21700 1 -- 172.21.15.40:0/3281637755 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7d4c062380 con 0x7f7d4c09c890 2023-09-30T22:29:25.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.790+0000 7f7d497fa700 1 -- 172.21.15.40:0/3281637755 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7d40017030 con 0x7f7d4c09c890 2023-09-30T22:29:25.791 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:25.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.793+0000 7f7d52f21700 1 -- 172.21.15.40:0/3281637755 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7d4c09c890 msgr2=0x7f7d4c06f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:25.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.793+0000 7f7d52f21700 1 --2- 172.21.15.40:0/3281637755 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7d4c09c890 0x7f7d4c06f0e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f7d4000c700 tx=0x7f7d4000ca10 comp rx=0 tx=0).stop 2023-09-30T22:29:25.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.793+0000 7f7d52f21700 1 -- 172.21.15.40:0/3281637755 shutdown_connections 2023-09-30T22:29:25.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.793+0000 7f7d52f21700 1 --2- 172.21.15.40:0/3281637755 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7d4c09c890 0x7f7d4c06f0e0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:25.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.793+0000 7f7d52f21700 1 --2- 172.21.15.40:0/3281637755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d4c139510 0x7f7d4c06fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:25.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.793+0000 7f7d52f21700 1 --2- 172.21.15.40:0/3281637755 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d4c136bf0 0x7f7d4c06f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:25.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.793+0000 7f7d52f21700 1 -- 172.21.15.40:0/3281637755 >> 172.21.15.40:0/3281637755 conn(0x7f7d4c0a7080 msgr2=0x7f7d4c1349d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:25.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.793+0000 7f7d52f21700 1 -- 172.21.15.40:0/3281637755 shutdown_connections 2023-09-30T22:29:25.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.793+0000 7f7d52f21700 1 -- 172.21.15.40:0/3281637755 wait complete. 2023-09-30T22:29:25.811 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:25.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.866+0000 7f36c8966700 1 -- 172.21.15.40:0/1194874576 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f36c41217c0 con 0x7f36c4133ca0 2023-09-30T22:29:25.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.866+0000 7f36b2ffd700 1 -- 172.21.15.40:0/1194874576 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f36b8015030 con 0x7f36c4133ca0 2023-09-30T22:29:25.867 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:25.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.868+0000 7f36c8966700 1 -- 172.21.15.40:0/1194874576 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36c4133ca0 msgr2=0x7f36c411e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:25.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.868+0000 7f36c8966700 1 --2- 172.21.15.40:0/1194874576 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36c4133ca0 0x7f36c411e820 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f36b8000c00 tx=0x7f36b8004750 comp rx=0 tx=0).stop 2023-09-30T22:29:25.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.868+0000 7f36c8966700 1 -- 172.21.15.40:0/1194874576 shutdown_connections 2023-09-30T22:29:25.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.868+0000 7f36c8966700 1 --2- 172.21.15.40:0/1194874576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36c41316d0 0x7f36c411ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:25.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.868+0000 7f36c8966700 1 --2- 172.21.15.40:0/1194874576 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36c409d920 0x7f36c411e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:25.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.868+0000 7f36c8966700 1 --2- 172.21.15.40:0/1194874576 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36c4133ca0 0x7f36c411e820 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:25.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.868+0000 7f36c8966700 1 -- 172.21.15.40:0/1194874576 >> 172.21.15.40:0/1194874576 conn(0x7f36c409fb20 msgr2=0x7f36c4133360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:25.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.869+0000 7f36c8966700 1 -- 172.21.15.40:0/1194874576 shutdown_connections 2023-09-30T22:29:25.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.869+0000 7f36c8966700 1 -- 172.21.15.40:0/1194874576 wait complete. 2023-09-30T22:29:25.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.870+0000 7fdb3d07d700 1 -- 172.21.15.40:0/1495634582 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdb38062380 con 0x7fdb3809d920 2023-09-30T22:29:25.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.871+0000 7fdb1f7fe700 1 -- 172.21.15.40:0/1495634582 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdb28033090 con 0x7fdb3809d920 2023-09-30T22:29:25.871 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:25.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.873+0000 7fdb3d07d700 1 -- 172.21.15.40:0/1495634582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb3809d920 msgr2=0x7fdb3811e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:25.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.873+0000 7fdb3d07d700 1 --2- 172.21.15.40:0/1495634582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb3809d920 0x7fdb3811e570 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fdb28015000 tx=0x7fdb28004750 comp rx=0 tx=0).stop 2023-09-30T22:29:25.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.873+0000 7fdb3d07d700 1 -- 172.21.15.40:0/1495634582 shutdown_connections 2023-09-30T22:29:25.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.873+0000 7fdb3d07d700 1 --2- 172.21.15.40:0/1495634582 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb38122540 0x7fdb3811eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:25.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.873+0000 7fdb3d07d700 1 --2- 172.21.15.40:0/1495634582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb3809d920 0x7fdb3811e570 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:25.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.873+0000 7fdb3d07d700 1 --2- 172.21.15.40:0/1495634582 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb38133ca0 0x7fdb3811eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:25.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.873+0000 7fdb3d07d700 1 -- 172.21.15.40:0/1495634582 >> 172.21.15.40:0/1495634582 conn(0x7fdb3809fb20 msgr2=0x7fdb381334f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:25.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.873+0000 7fdb3d07d700 1 -- 172.21.15.40:0/1495634582 shutdown_connections 2023-09-30T22:29:25.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.873+0000 7fdb3d07d700 1 -- 172.21.15.40:0/1495634582 wait complete. 2023-09-30T22:29:25.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.877+0000 7f00755bf700 1 -- 172.21.15.40:0/2456182983 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0050005590 con 0x7f0070099a40 2023-09-30T22:29:25.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.877+0000 7f00577fe700 1 -- 172.21.15.40:0/2456182983 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f00600233d0 con 0x7f0070099a40 2023-09-30T22:29:25.878 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:25.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.879+0000 7f00755bf700 1 -- 172.21.15.40:0/2456182983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0070099a40 msgr2=0x7f007006d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:25.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.879+0000 7f00755bf700 1 --2- 172.21.15.40:0/2456182983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0070099a40 0x7f007006d6a0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f00600090b0 tx=0x7f0060004750 comp rx=0 tx=0).stop 2023-09-30T22:29:25.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.880+0000 7f00755bf700 1 -- 172.21.15.40:0/2456182983 shutdown_connections 2023-09-30T22:29:25.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.880+0000 7f00755bf700 1 --2- 172.21.15.40:0/2456182983 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f007012d910 0x7f007006e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:25.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.880+0000 7f00755bf700 1 --2- 172.21.15.40:0/2456182983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0070099a40 0x7f007006d6a0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:25.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.880+0000 7f00755bf700 1 --2- 172.21.15.40:0/2456182983 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f007009a350 0x7f007006dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:25.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.880+0000 7f00755bf700 1 -- 172.21.15.40:0/2456182983 >> 172.21.15.40:0/2456182983 conn(0x7f007006a6d0 msgr2=0x7f007013fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:25.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.880+0000 7f00755bf700 1 -- 172.21.15.40:0/2456182983 shutdown_connections 2023-09-30T22:29:25.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:25.880+0000 7f00755bf700 1 -- 172.21.15.40:0/2456182983 wait complete. 2023-09-30T22:29:25.883 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:25.888 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:25.893 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:26.811 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:26.885 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:26.889 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:26.894 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:26.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.960+0000 7f042b973700 1 Processor -- start 2023-09-30T22:29:26.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.960+0000 7f042b973700 1 -- start start 2023-09-30T22:29:26.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.961+0000 7f042b973700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f042409dca0 0x7f0424099510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:26.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.961+0000 7f042b973700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0424099a50 0x7f0424099ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:26.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.961+0000 7f042b973700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f04241381c0 0x7f042413a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:26.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.961+0000 7f042b973700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f042409e070 con 0x7f04241381c0 2023-09-30T22:29:26.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.961+0000 7f042b973700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042409b710 con 0x7f042409dca0 2023-09-30T22:29:26.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.961+0000 7f042b973700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f042409fa60 con 0x7f0424099a50 2023-09-30T22:29:26.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.961+0000 7f0429f10700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f04241381c0 0x7f042413a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:26.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.961+0000 7f0429f10700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f04241381c0 0x7f042413a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56810/0 (socket says 172.21.15.40:56810) 2023-09-30T22:29:26.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.961+0000 7f0429f10700 1 -- 172.21.15.40:0/1526986623 learned_addr learned my addr 172.21.15.40:0/1526986623 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:26.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.962+0000 7f0428f0e700 1 --2- 172.21.15.40:0/1526986623 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0424099a50 0x7f0424099ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:26.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.962+0000 7f042970f700 1 --2- 172.21.15.40:0/1526986623 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f042409dca0 0x7f0424099510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:26.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.962+0000 7f0428f0e700 1 -- 172.21.15.40:0/1526986623 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f042409dca0 msgr2=0x7f0424099510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:26.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.962+0000 7f0428f0e700 1 --2- 172.21.15.40:0/1526986623 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f042409dca0 0x7f0424099510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:26.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.962+0000 7f0428f0e700 1 -- 172.21.15.40:0/1526986623 >> v2:172.21.15.40:3300/0 conn(0x7f04241381c0 msgr2=0x7f042413a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:26.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.962+0000 7f0428f0e700 1 --2- 172.21.15.40:0/1526986623 >> v2:172.21.15.40:3300/0 conn(0x7f04241381c0 0x7f042413a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:26.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.962+0000 7f0428f0e700 1 -- 172.21.15.40:0/1526986623 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042409a950 con 0x7f0424099a50 2023-09-30T22:29:26.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.962+0000 7f0428f0e700 1 --2- 172.21.15.40:0/1526986623 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0424099a50 0x7f0424099ea0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f0414009840 tx=0x7f0414009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7dca4f1be2f7fb5e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:26.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.962+0000 7f041bfff700 1 -- 172.21.15.40:0/1526986623 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0414011830 con 0x7f0424099a50 2023-09-30T22:29:26.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.962+0000 7f041bfff700 1 -- 172.21.15.40:0/1526986623 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0414011990 con 0x7f0424099a50 2023-09-30T22:29:26.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.962+0000 7f041bfff700 1 -- 172.21.15.40:0/1526986623 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0414011d20 con 0x7f0424099a50 2023-09-30T22:29:26.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.963+0000 7f042b973700 1 -- 172.21.15.40:0/1526986623 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0424099a50 msgr2=0x7f0424099ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:26.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.963+0000 7f042b973700 1 --2- 172.21.15.40:0/1526986623 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0424099a50 0x7f0424099ea0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f0414009840 tx=0x7f0414009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:26.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.963+0000 7f042b973700 1 -- 172.21.15.40:0/1526986623 shutdown_connections 2023-09-30T22:29:26.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.963+0000 7f042b973700 1 --2- 172.21.15.40:0/1526986623 >> v2:172.21.15.40:3300/0 conn(0x7f04241381c0 0x7f042413a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:26.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.963+0000 7f042b973700 1 --2- 172.21.15.40:0/1526986623 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f042409dca0 0x7f0424099510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:26.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.963+0000 7f042b973700 1 --2- 172.21.15.40:0/1526986623 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0424099a50 0x7f0424099ea0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:26.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.963+0000 7f042b973700 1 -- 172.21.15.40:0/1526986623 >> 172.21.15.40:0/1526986623 conn(0x7f04240a2c70 msgr2=0x7f042409eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:26.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.963+0000 7f042b973700 1 -- 172.21.15.40:0/1526986623 shutdown_connections 2023-09-30T22:29:26.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.963+0000 7f042b973700 1 -- 172.21.15.40:0/1526986623 wait complete. 2023-09-30T22:29:26.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.964+0000 7f042b973700 1 Processor -- start 2023-09-30T22:29:26.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.964+0000 7f042b973700 1 -- start start 2023-09-30T22:29:26.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.965+0000 7f042b973700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0424099a50 0x7f04241365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:26.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.965+0000 7f042b973700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f042409dca0 0x7f0424136ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:26.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.965+0000 7f042b973700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04241381c0 0x7f04241c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:26.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.965+0000 7f042b973700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0424097280 con 0x7f0424099a50 2023-09-30T22:29:26.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.965+0000 7f042b973700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0424095570 con 0x7f04241381c0 2023-09-30T22:29:26.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.965+0000 7f042b973700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0424137020 con 0x7f042409dca0 2023-09-30T22:29:26.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.965+0000 7f042970f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0424099a50 0x7f04241365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:26.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.965+0000 7f042970f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0424099a50 0x7f04241365a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56818/0 (socket says 172.21.15.40:56818) 2023-09-30T22:29:26.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.965+0000 7f042970f700 1 -- 172.21.15.40:0/3657953890 learned_addr learned my addr 172.21.15.40:0/3657953890 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:26.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.965+0000 7f042970f700 1 -- 172.21.15.40:0/3657953890 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f042409dca0 msgr2=0x7f0424136ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:26.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.965+0000 7f042970f700 1 --2- 172.21.15.40:0/3657953890 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f042409dca0 0x7f0424136ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:26.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.965+0000 7f042970f700 1 -- 172.21.15.40:0/3657953890 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04241381c0 msgr2=0x7f04241c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:26.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.965+0000 7f042970f700 1 --2- 172.21.15.40:0/3657953890 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04241381c0 0x7f04241c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:26.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.965+0000 7f042970f700 1 -- 172.21.15.40:0/3657953890 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04140094a0 con 0x7f0424099a50 2023-09-30T22:29:26.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.966+0000 7f042970f700 1 --2- 172.21.15.40:0/3657953890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0424099a50 0x7f04241365a0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f042000e9b0 tx=0x7f042000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:26.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.966+0000 7f0419ffb700 1 -- 172.21.15.40:0/3657953890 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0420009670 con 0x7f0424099a50 2023-09-30T22:29:26.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.966+0000 7f0419ffb700 1 -- 172.21.15.40:0/3657953890 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0420005a20 con 0x7f0424099a50 2023-09-30T22:29:26.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.966+0000 7f042b973700 1 -- 172.21.15.40:0/3657953890 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0424097480 con 0x7f0424099a50 2023-09-30T22:29:26.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.966+0000 7f0419ffb700 1 -- 172.21.15.40:0/3657953890 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0420005db0 con 0x7f0424099a50 2023-09-30T22:29:26.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.966+0000 7f042b973700 1 -- 172.21.15.40:0/3657953890 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04240980b0 con 0x7f0424099a50 2023-09-30T22:29:26.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.967+0000 7f0419ffb700 1 -- 172.21.15.40:0/3657953890 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f042000c7d0 con 0x7f0424099a50 2023-09-30T22:29:26.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.967+0000 7f0419ffb700 1 -- 172.21.15.40:0/3657953890 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f042003f9b0 con 0x7f0424099a50 2023-09-30T22:29:26.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.968+0000 7f042b973700 1 -- 172.21.15.40:0/3657953890 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f042409e5d0 con 0x7f0424099a50 2023-09-30T22:29:26.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:26.972+0000 7f0419ffb700 1 -- 172.21.15.40:0/3657953890 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0420011bd0 con 0x7f0424099a50 2023-09-30T22:29:27.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.057+0000 7f92551d4700 1 Processor -- start 2023-09-30T22:29:27.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.057+0000 7f92551d4700 1 -- start start 2023-09-30T22:29:27.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.058+0000 7f92551d4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f925009d920 0x7f925009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:27.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.058+0000 7f92551d4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f925009e230 0x7f92501343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:27.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.058+0000 7f92551d4700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f925009f940 con 0x7f925009f0f0 2023-09-30T22:29:27.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.058+0000 7f92551d4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f925006b4c0 con 0x7f925009d920 2023-09-30T22:29:27.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.058+0000 7f92551d4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925009a8f0 con 0x7f925009e230 2023-09-30T22:29:27.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.058+0000 7f924ed9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f925009d920 0x7f925009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:27.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.058+0000 7f924ed9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f925009d920 0x7f925009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56828/0 (socket says 172.21.15.40:56828) 2023-09-30T22:29:27.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.058+0000 7f924ed9d700 1 -- 172.21.15.40:0/27638943 learned_addr learned my addr 172.21.15.40:0/27638943 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:27.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.058+0000 7f924f59e700 1 --2- 172.21.15.40:0/27638943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f925009e230 0x7f92501343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:27.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.059+0000 7f924f59e700 1 -- 172.21.15.40:0/27638943 >> v2:172.21.15.40:3300/0 conn(0x7f925009d920 msgr2=0x7f925009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:27.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.059+0000 7f924f59e700 1 --2- 172.21.15.40:0/27638943 >> v2:172.21.15.40:3300/0 conn(0x7f925009d920 0x7f925009dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:27.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.059+0000 7f924f59e700 1 -- 172.21.15.40:0/27638943 >> v1:172.21.15.40:6789/0 conn(0x7f925009f0f0 legacy=0x7f9250133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:27.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.059+0000 7f924f59e700 1 -- 172.21.15.40:0/27638943 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925009f6e0 con 0x7f925009e230 2023-09-30T22:29:27.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.059+0000 7f924ed9d700 1 --2- 172.21.15.40:0/27638943 >> v2:172.21.15.40:3300/0 conn(0x7f925009d920 0x7f925009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:27.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.059+0000 7f924f59e700 1 --2- 172.21.15.40:0/27638943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f925009e230 0x7f92501343b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f9248009dc0 tx=0x7f924800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48621a7e9febb4e9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:27.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.059+0000 7f924dd9b700 1 -- 172.21.15.40:0/27638943 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924800e070 con 0x7f925009e230 2023-09-30T22:29:27.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.059+0000 7f924dd9b700 1 -- 172.21.15.40:0/27638943 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924800bae0 con 0x7f925009e230 2023-09-30T22:29:27.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.059+0000 7f924dd9b700 1 -- 172.21.15.40:0/27638943 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924800be90 con 0x7f925009e230 2023-09-30T22:29:27.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.060+0000 7f92551d4700 1 -- 172.21.15.40:0/27638943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f925009e230 msgr2=0x7f92501343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:27.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.060+0000 7f92551d4700 1 --2- 172.21.15.40:0/27638943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f925009e230 0x7f92501343b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f9248009dc0 tx=0x7f924800b330 comp rx=0 tx=0).stop 2023-09-30T22:29:27.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.060+0000 7f92551d4700 1 -- 172.21.15.40:0/27638943 shutdown_connections 2023-09-30T22:29:27.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.060+0000 7f92551d4700 1 --2- 172.21.15.40:0/27638943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f925009e230 0x7f92501343b0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:27.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.060+0000 7f92551d4700 1 --2- 172.21.15.40:0/27638943 >> v2:172.21.15.40:3300/0 conn(0x7f925009d920 0x7f925009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:27.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.060+0000 7f92551d4700 1 -- 172.21.15.40:0/27638943 >> 172.21.15.40:0/27638943 conn(0x7f925009fb20 msgr2=0x7f925009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:27.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.060+0000 7f92551d4700 1 -- 172.21.15.40:0/27638943 shutdown_connections 2023-09-30T22:29:27.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.060+0000 7f92551d4700 1 -- 172.21.15.40:0/27638943 wait complete. 2023-09-30T22:29:27.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.062+0000 7f92551d4700 1 Processor -- start 2023-09-30T22:29:27.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.062+0000 7f92551d4700 1 -- start start 2023-09-30T22:29:27.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.062+0000 7f92551d4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f925009d920 0x7f92501a61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:27.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.062+0000 7f92551d4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f925009e230 0x7f92501a66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:27.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.062+0000 7f5497834700 1 Processor -- start 2023-09-30T22:29:27.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.062+0000 7f92551d4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92501b95a0 0x7f92501a6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:27.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.062+0000 7f92551d4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92501aa690 con 0x7f92501b95a0 2023-09-30T22:29:27.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.062+0000 7f92551d4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92501a9cd0 con 0x7f925009d920 2023-09-30T22:29:27.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.062+0000 7f92551d4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92501a9010 con 0x7f925009e230 2023-09-30T22:29:27.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.063+0000 7f924f59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92501b95a0 0x7f92501a6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:27.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.063+0000 7f924f59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92501b95a0 0x7f92501a6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56830/0 (socket says 172.21.15.40:56830) 2023-09-30T22:29:27.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.063+0000 7f924f59e700 1 -- 172.21.15.40:0/237294779 learned_addr learned my addr 172.21.15.40:0/237294779 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:27.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.063+0000 7f924e59c700 1 --2- 172.21.15.40:0/237294779 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f925009e230 0x7f92501a66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:27.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.063+0000 7f5497834700 1 -- start start 2023-09-30T22:29:27.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.063+0000 7f924f59e700 1 -- 172.21.15.40:0/237294779 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f925009e230 msgr2=0x7f92501a66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:27.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.063+0000 7f924f59e700 1 --2- 172.21.15.40:0/237294779 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f925009e230 0x7f92501a66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:27.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.063+0000 7f924f59e700 1 -- 172.21.15.40:0/237294779 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f925009d920 msgr2=0x7f92501a61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:27.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.063+0000 7f924f59e700 1 --2- 172.21.15.40:0/237294779 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f925009d920 0x7f92501a61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:27.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.063+0000 7f924f59e700 1 -- 172.21.15.40:0/237294779 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9240009500 con 0x7f92501b95a0 2023-09-30T22:29:27.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.063+0000 7f924f59e700 1 --2- 172.21.15.40:0/237294779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92501b95a0 0x7f92501a6c30 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f925009b7b0 tx=0x7f9248004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:27.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.063+0000 7f92377fe700 1 -- 172.21.15.40:0/237294779 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9248026070 con 0x7f92501b95a0 2023-09-30T22:29:27.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.064+0000 7f92377fe700 1 -- 172.21.15.40:0/237294779 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9248012640 con 0x7f92501b95a0 2023-09-30T22:29:27.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.064+0000 7f92551d4700 1 -- 172.21.15.40:0/237294779 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9248009a70 con 0x7f92501b95a0 2023-09-30T22:29:27.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.064+0000 7f92377fe700 1 -- 172.21.15.40:0/237294779 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92480129d0 con 0x7f92501b95a0 2023-09-30T22:29:27.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.064+0000 7f5497834700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f549009d920 0x7f549009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:27.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.064+0000 7f5497834700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f549009e230 0x7f54901308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:27.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.064+0000 7f5497834700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5490130de0 0x7f5490131260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:27.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.064+0000 7f5497834700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f549009edf0 con 0x7f549009e230 2023-09-30T22:29:27.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.064+0000 7f5497834700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f549009adf0 con 0x7f549009d920 2023-09-30T22:29:27.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.064+0000 7f5497834700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f549009b660 con 0x7f5490130de0 2023-09-30T22:29:27.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.064+0000 7f92551d4700 1 -- 172.21.15.40:0/237294779 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f925009c9e0 con 0x7f92501b95a0 2023-09-30T22:29:27.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.064+0000 7f5494dcf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f549009e230 0x7f54901308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:27.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.064+0000 7f5494dcf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f549009e230 0x7f54901308a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56832/0 (socket says 172.21.15.40:56832) 2023-09-30T22:29:27.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.064+0000 7f5494dcf700 1 -- 172.21.15.40:0/2337950154 learned_addr learned my addr 172.21.15.40:0/2337950154 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:27.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.064+0000 7f5494dcf700 1 -- 172.21.15.40:0/2337950154 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5490130de0 msgr2=0x7f5490131260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:27.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.064+0000 7f5494dcf700 1 --2- 172.21.15.40:0/2337950154 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5490130de0 0x7f5490131260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:27.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.064+0000 7f5494dcf700 1 -- 172.21.15.40:0/2337950154 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f549009d920 msgr2=0x7f549009dcf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:29:27.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.064+0000 7f5494dcf700 1 --2- 172.21.15.40:0/2337950154 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f549009d920 0x7f549009dcf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:27.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.064+0000 7f5494dcf700 1 -- 172.21.15.40:0/2337950154 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549009a6e0 con 0x7f549009e230 2023-09-30T22:29:27.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.065+0000 7f92377fe700 1 -- 172.21.15.40:0/237294779 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9248012b30 con 0x7f92501b95a0 2023-09-30T22:29:27.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.065+0000 7f5494dcf700 1 --2- 172.21.15.40:0/2337950154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f549009e230 0x7f54901308a0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f548c0098f0 tx=0x7f548c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b13036b8e960b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:27.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.065+0000 7f92551d4700 1 -- 172.21.15.40:0/237294779 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92501a9870 con 0x7f92501b95a0 2023-09-30T22:29:27.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.065+0000 7f5483fff700 1 -- 172.21.15.40:0/2337950154 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c00b8a0 con 0x7f549009e230 2023-09-30T22:29:27.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.065+0000 7f5483fff700 1 -- 172.21.15.40:0/2337950154 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548c00ba00 con 0x7f549009e230 2023-09-30T22:29:27.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.065+0000 7f5483fff700 1 -- 172.21.15.40:0/2337950154 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c00bd90 con 0x7f549009e230 2023-09-30T22:29:27.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.065+0000 7f92377fe700 1 -- 172.21.15.40:0/237294779 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9248049540 con 0x7f92501b95a0 2023-09-30T22:29:27.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.066+0000 7f5497834700 1 -- 172.21.15.40:0/2337950154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f549009e230 msgr2=0x7f54901308a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:27.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.066+0000 7f5497834700 1 --2- 172.21.15.40:0/2337950154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f549009e230 0x7f54901308a0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f548c0098f0 tx=0x7f548c009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:27.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.066+0000 7f5497834700 1 -- 172.21.15.40:0/2337950154 shutdown_connections 2023-09-30T22:29:27.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.066+0000 7f5497834700 1 --2- 172.21.15.40:0/2337950154 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5490130de0 0x7f5490131260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:27.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.066+0000 7f5497834700 1 --2- 172.21.15.40:0/2337950154 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f549009d920 0x7f549009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:27.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.066+0000 7f5497834700 1 --2- 172.21.15.40:0/2337950154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f549009e230 0x7f54901308a0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:27.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.066+0000 7f5497834700 1 -- 172.21.15.40:0/2337950154 >> 172.21.15.40:0/2337950154 conn(0x7f549009fb20 msgr2=0x7f549009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:27.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.066+0000 7f5497834700 1 -- 172.21.15.40:0/2337950154 shutdown_connections 2023-09-30T22:29:27.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.066+0000 7f5497834700 1 -- 172.21.15.40:0/2337950154 wait complete. 2023-09-30T22:29:27.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.067+0000 7f5497834700 1 Processor -- start 2023-09-30T22:29:27.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.067+0000 7f5497834700 1 -- start start 2023-09-30T22:29:27.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.067+0000 7f5497834700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f549009d920 0x7f54901c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:27.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.067+0000 7f5497834700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f549009e230 0x7f54901c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:27.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.067+0000 7f5497834700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5490130de0 0x7f54901c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:27.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.067+0000 7f5497834700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5490119b70 con 0x7f549009e230 2023-09-30T22:29:27.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.067+0000 7f5497834700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f549009cb00 con 0x7f549009d920 2023-09-30T22:29:27.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.067+0000 7f5497834700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5490137fb0 con 0x7f5490130de0 2023-09-30T22:29:27.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.068+0000 7f5495dd1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5490130de0 0x7f54901c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:27.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.068+0000 7f5495dd1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5490130de0 0x7f54901c8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:39234/0 (socket says 172.21.15.40:39234) 2023-09-30T22:29:27.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.068+0000 7f5495dd1700 1 -- 172.21.15.40:0/2361932015 learned_addr learned my addr 172.21.15.40:0/2361932015 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:27.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.068+0000 7f5494dcf700 1 --2- 172.21.15.40:0/2361932015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f549009e230 0x7f54901c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:27.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.068+0000 7f5495dd1700 1 -- 172.21.15.40:0/2361932015 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f549009d920 msgr2=0x7f54901c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:27.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.068+0000 7f5495dd1700 1 --2- 172.21.15.40:0/2361932015 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f549009d920 0x7f54901c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:27.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.068+0000 7f5495dd1700 1 -- 172.21.15.40:0/2361932015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f549009e230 msgr2=0x7f54901c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:27.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.068+0000 7f5495dd1700 1 --2- 172.21.15.40:0/2361932015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f549009e230 0x7f54901c8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:27.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.068+0000 7f5495dd1700 1 -- 172.21.15.40:0/2361932015 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f548c009550 con 0x7f5490130de0 2023-09-30T22:29:27.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.068+0000 7fb505b2d700 1 Processor -- start 2023-09-30T22:29:27.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.068+0000 7f5495dd1700 1 --2- 172.21.15.40:0/2361932015 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5490130de0 0x7f54901c8f60 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f548800b970 tx=0x7f548800bd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:27.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.068+0000 7f5481ffb700 1 -- 172.21.15.40:0/2361932015 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548800c9b0 con 0x7f5490130de0 2023-09-30T22:29:27.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.068+0000 7fb505b2d700 1 -- start start 2023-09-30T22:29:27.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.068+0000 7f5497834700 1 -- 172.21.15.40:0/2361932015 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54900a2e20 con 0x7f5490130de0 2023-09-30T22:29:27.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.068+0000 7f5481ffb700 1 -- 172.21.15.40:0/2361932015 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548800cb30 con 0x7f5490130de0 2023-09-30T22:29:27.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.069+0000 7f5481ffb700 1 -- 172.21.15.40:0/2361932015 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5488014440 con 0x7f5490130de0 2023-09-30T22:29:27.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.069+0000 7f5497834700 1 -- 172.21.15.40:0/2361932015 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f549011a500 con 0x7f5490130de0 2023-09-30T22:29:27.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.069+0000 7fb505b2d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb50006c990 0x7fb50006cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:27.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.069+0000 7fb505b2d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb50006d2a0 0x7fb50013c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:27.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.069+0000 7fb505b2d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb50006df30 con 0x7fb50013c8f0 2023-09-30T22:29:27.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.069+0000 7fb505b2d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb50006ec40 con 0x7fb50006c990 2023-09-30T22:29:27.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.069+0000 7fb505b2d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb50006ea40 con 0x7fb50006d2a0 2023-09-30T22:29:27.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.069+0000 7fb4fffff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb50013c8f0 0x7fb50013ecd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58214/0 (socket says 172.21.15.40:58214) 2023-09-30T22:29:27.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.069+0000 7fb4fffff700 1 -- 172.21.15.40:0/1039517764 learned_addr learned my addr 172.21.15.40:0/1039517764 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:29:27.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.069+0000 7fb4feffd700 1 --2- 172.21.15.40:0/1039517764 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb50006d2a0 0x7fb50013c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:27.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.070+0000 7fb4ff7fe700 1 --2- 172.21.15.40:0/1039517764 >> v2:172.21.15.40:3300/0 conn(0x7fb50006c990 0x7fb50006cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:27.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.070+0000 7fb4ff7fe700 1 -- 172.21.15.40:0/1039517764 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb50006d2a0 msgr2=0x7fb50013c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:27.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.070+0000 7fb4ff7fe700 1 --2- 172.21.15.40:0/1039517764 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb50006d2a0 0x7fb50013c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:27.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.070+0000 7fb4ff7fe700 1 -- 172.21.15.40:0/1039517764 >> v1:172.21.15.40:6789/0 conn(0x7fb50013c8f0 legacy=0x7fb50013ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:27.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.070+0000 7fb4ff7fe700 1 -- 172.21.15.40:0/1039517764 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb500072050 con 0x7fb50006c990 2023-09-30T22:29:27.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.070+0000 7fb4ff7fe700 1 --2- 172.21.15.40:0/1039517764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb50006c990 0x7fb50006cd60 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8009d90 tx=0x7fb4f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=869edc6734b6c067 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:27.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.070+0000 7f5497834700 1 -- 172.21.15.40:0/2361932015 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5490062380 con 0x7f5490130de0 2023-09-30T22:29:27.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.070+0000 7f5481ffb700 1 -- 172.21.15.40:0/2361932015 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f548801d3b0 con 0x7f5490130de0 2023-09-30T22:29:27.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.070+0000 7f5481ffb700 1 -- 172.21.15.40:0/2361932015 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5488006e40 con 0x7f5490130de0 2023-09-30T22:29:27.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.074+0000 7fb4fe7fc700 1 -- 172.21.15.40:0/1039517764 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f800e070 con 0x7fb50006c990 2023-09-30T22:29:27.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.074+0000 7fb4fe7fc700 1 -- 172.21.15.40:0/1039517764 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f800bb20 con 0x7fb50006c990 2023-09-30T22:29:27.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.074+0000 7fb4fe7fc700 1 -- 172.21.15.40:0/1039517764 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f8012430 con 0x7fb50006c990 2023-09-30T22:29:27.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.074+0000 7f92377fe700 1 -- 172.21.15.40:0/237294779 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9248003e00 con 0x7f92501b95a0 2023-09-30T22:29:27.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.075+0000 7fb505b2d700 1 -- 172.21.15.40:0/1039517764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb50006c990 msgr2=0x7fb50006cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:27.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.075+0000 7fb505b2d700 1 --2- 172.21.15.40:0/1039517764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb50006c990 0x7fb50006cd60 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8009d90 tx=0x7fb4f800b330 comp rx=0 tx=0).stop 2023-09-30T22:29:27.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.075+0000 7fb505b2d700 1 -- 172.21.15.40:0/1039517764 shutdown_connections 2023-09-30T22:29:27.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.075+0000 7fb505b2d700 1 --2- 172.21.15.40:0/1039517764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb50006c990 0x7fb50006cd60 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:27.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.075+0000 7fb505b2d700 1 --2- 172.21.15.40:0/1039517764 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb50006d2a0 0x7fb50013c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:27.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.075+0000 7fb505b2d700 1 -- 172.21.15.40:0/1039517764 >> 172.21.15.40:0/1039517764 conn(0x7fb5000a41a0 msgr2=0x7fb5000a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:27.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.075+0000 7fb505b2d700 1 -- 172.21.15.40:0/1039517764 shutdown_connections 2023-09-30T22:29:27.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.075+0000 7fb505b2d700 1 -- 172.21.15.40:0/1039517764 wait complete. 2023-09-30T22:29:27.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.075+0000 7f5481ffb700 1 -- 172.21.15.40:0/2361932015 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5488007370 con 0x7f5490130de0 2023-09-30T22:29:27.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.076+0000 7fb505b2d700 1 Processor -- start 2023-09-30T22:29:27.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.077+0000 7fb505b2d700 1 -- start start 2023-09-30T22:29:27.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.077+0000 7fb505b2d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb50006c990 0x7fb50008dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:27.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.077+0000 7fb505b2d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb50006d2a0 0x7fb50008e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:27.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.077+0000 7fb505b2d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb50013c8f0 0x7fb5001cce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:27.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.077+0000 7fb505b2d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5001298f0 con 0x7fb50013c8f0 2023-09-30T22:29:27.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.077+0000 7fb505b2d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb50012aef0 con 0x7fb50006d2a0 2023-09-30T22:29:27.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.077+0000 7fb505b2d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb50013c040 con 0x7fb50006c990 2023-09-30T22:29:27.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.077+0000 7fb4fffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb50013c8f0 0x7fb5001cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:27.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.077+0000 7fb4fffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb50013c8f0 0x7fb5001cce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56850/0 (socket says 172.21.15.40:56850) 2023-09-30T22:29:27.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.077+0000 7fb4fffff700 1 -- 172.21.15.40:0/513410067 learned_addr learned my addr 172.21.15.40:0/513410067 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:27.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.078+0000 7fb4feffd700 1 --2- 172.21.15.40:0/513410067 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb50006d2a0 0x7fb50008e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:27.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.078+0000 7fb4ff7fe700 1 --2- 172.21.15.40:0/513410067 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb50006c990 0x7fb50008dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:27.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.078+0000 7fb4feffd700 1 -- 172.21.15.40:0/513410067 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb50006c990 msgr2=0x7fb50008dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:27.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.078+0000 7fb4feffd700 1 --2- 172.21.15.40:0/513410067 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb50006c990 0x7fb50008dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:27.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.078+0000 7fb4feffd700 1 -- 172.21.15.40:0/513410067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb50013c8f0 msgr2=0x7fb5001cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:27.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.078+0000 7fb4feffd700 1 --2- 172.21.15.40:0/513410067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb50013c8f0 0x7fb5001cce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:27.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.078+0000 7fb4feffd700 1 -- 172.21.15.40:0/513410067 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f8009a70 con 0x7fb50006d2a0 2023-09-30T22:29:27.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.078+0000 7fb4feffd700 1 --2- 172.21.15.40:0/513410067 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb50006d2a0 0x7fb50008e2d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb4f400e960 tx=0x7fb4f400ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:27.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.078+0000 7fb4e7fff700 1 -- 172.21.15.40:0/513410067 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f4013680 con 0x7fb50006d2a0 2023-09-30T22:29:27.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.078+0000 7fb4e7fff700 1 -- 172.21.15.40:0/513410067 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f40137e0 con 0x7fb50006d2a0 2023-09-30T22:29:27.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.078+0000 7fb4e7fff700 1 -- 172.21.15.40:0/513410067 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f4013b50 con 0x7fb50006d2a0 2023-09-30T22:29:27.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.079+0000 7fb505b2d700 1 -- 172.21.15.40:0/513410067 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5000a0850 con 0x7fb50006d2a0 2023-09-30T22:29:27.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.079+0000 7fb505b2d700 1 -- 172.21.15.40:0/513410067 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb500129ab0 con 0x7fb50006d2a0 2023-09-30T22:29:27.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.080+0000 7fb505b2d700 1 -- 172.21.15.40:0/513410067 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb50008d9d0 con 0x7fb50006d2a0 2023-09-30T22:29:27.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.080+0000 7fb4e7fff700 1 -- 172.21.15.40:0/513410067 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb4f4013cb0 con 0x7fb50006d2a0 2023-09-30T22:29:27.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.080+0000 7fb4e7fff700 1 -- 172.21.15.40:0/513410067 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb4f403f6f0 con 0x7fb50006d2a0 2023-09-30T22:29:27.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.085+0000 7fb4e7fff700 1 -- 172.21.15.40:0/513410067 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb4f401be10 con 0x7fb50006d2a0 2023-09-30T22:29:27.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.245+0000 7f042b973700 1 -- 172.21.15.40:0/3657953890 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0424062380 con 0x7f0424099a50 2023-09-30T22:29:27.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.245+0000 7f0419ffb700 1 -- 172.21.15.40:0/3657953890 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f042002a090 con 0x7f0424099a50 2023-09-30T22:29:27.246 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:27.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.249+0000 7f042b973700 1 -- 172.21.15.40:0/3657953890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0424099a50 msgr2=0x7f04241365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:27.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.249+0000 7f042b973700 1 --2- 172.21.15.40:0/3657953890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0424099a50 0x7f04241365a0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f042000e9b0 tx=0x7f042000ed70 comp rx=0 tx=0).stop 2023-09-30T22:29:27.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.249+0000 7f042b973700 1 -- 172.21.15.40:0/3657953890 shutdown_connections 2023-09-30T22:29:27.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.249+0000 7f042b973700 1 --2- 172.21.15.40:0/3657953890 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04241381c0 0x7f04241c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:27.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.249+0000 7f042b973700 1 --2- 172.21.15.40:0/3657953890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0424099a50 0x7f04241365a0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:27.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.249+0000 7f042b973700 1 --2- 172.21.15.40:0/3657953890 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f042409dca0 0x7f0424136ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:27.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.249+0000 7f042b973700 1 -- 172.21.15.40:0/3657953890 >> 172.21.15.40:0/3657953890 conn(0x7f04240a2c70 msgr2=0x7f04241373e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:27.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.250+0000 7f042b973700 1 -- 172.21.15.40:0/3657953890 shutdown_connections 2023-09-30T22:29:27.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.250+0000 7f042b973700 1 -- 172.21.15.40:0/3657953890 wait complete. 2023-09-30T22:29:27.267 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:27.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.274+0000 7f5497834700 1 -- 172.21.15.40:0/2361932015 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5490119960 con 0x7f5490130de0 2023-09-30T22:29:27.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.274+0000 7f5481ffb700 1 -- 172.21.15.40:0/2361932015 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5488019030 con 0x7f5490130de0 2023-09-30T22:29:27.275 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:27.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.276+0000 7f5497834700 1 -- 172.21.15.40:0/2361932015 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5490130de0 msgr2=0x7f54901c8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:27.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.276+0000 7f5497834700 1 --2- 172.21.15.40:0/2361932015 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5490130de0 0x7f54901c8f60 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f548800b970 tx=0x7f548800bd30 comp rx=0 tx=0).stop 2023-09-30T22:29:27.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.277+0000 7f5497834700 1 -- 172.21.15.40:0/2361932015 shutdown_connections 2023-09-30T22:29:27.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.277+0000 7f5497834700 1 --2- 172.21.15.40:0/2361932015 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5490130de0 0x7f54901c8f60 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:27.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.277+0000 7f5497834700 1 --2- 172.21.15.40:0/2361932015 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f549009d920 0x7f54901c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:27.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.277+0000 7f5497834700 1 --2- 172.21.15.40:0/2361932015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f549009e230 0x7f54901c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:27.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.277+0000 7f5497834700 1 -- 172.21.15.40:0/2361932015 >> 172.21.15.40:0/2361932015 conn(0x7f549009fb20 msgr2=0x7f54900a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:27.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.277+0000 7f5497834700 1 -- 172.21.15.40:0/2361932015 shutdown_connections 2023-09-30T22:29:27.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.277+0000 7f5497834700 1 -- 172.21.15.40:0/2361932015 wait complete. 2023-09-30T22:29:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.283+0000 7fb505b2d700 1 -- 172.21.15.40:0/513410067 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb50006e680 con 0x7fb50006d2a0 2023-09-30T22:29:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.284+0000 7fb4e7fff700 1 -- 172.21.15.40:0/513410067 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb50006e680 con 0x7fb50006d2a0 2023-09-30T22:29:27.284 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:27.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.286+0000 7fb505b2d700 1 -- 172.21.15.40:0/513410067 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb50006d2a0 msgr2=0x7fb50008e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:27.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.286+0000 7fb505b2d700 1 --2- 172.21.15.40:0/513410067 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb50006d2a0 0x7fb50008e2d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb4f400e960 tx=0x7fb4f400ec70 comp rx=0 tx=0).stop 2023-09-30T22:29:27.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.286+0000 7fb505b2d700 1 -- 172.21.15.40:0/513410067 shutdown_connections 2023-09-30T22:29:27.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.286+0000 7fb505b2d700 1 --2- 172.21.15.40:0/513410067 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb50006c990 0x7fb50008dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:27.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.286+0000 7fb505b2d700 1 --2- 172.21.15.40:0/513410067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb50013c8f0 0x7fb5001cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:27.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.286+0000 7fb505b2d700 1 --2- 172.21.15.40:0/513410067 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb50006d2a0 0x7fb50008e2d0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:27.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.286+0000 7fb505b2d700 1 -- 172.21.15.40:0/513410067 >> 172.21.15.40:0/513410067 conn(0x7fb5000a41a0 msgr2=0x7fb5000a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:27.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.286+0000 7fb505b2d700 1 -- 172.21.15.40:0/513410067 shutdown_connections 2023-09-30T22:29:27.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.286+0000 7fb505b2d700 1 -- 172.21.15.40:0/513410067 wait complete. 2023-09-30T22:29:27.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:27.299 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:27.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.312+0000 7f92551d4700 1 -- 172.21.15.40:0/237294779 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9250062380 con 0x7f92501b95a0 2023-09-30T22:29:27.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.313+0000 7f92377fe700 1 -- 172.21.15.40:0/237294779 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9248001a00 con 0x7f92501b95a0 2023-09-30T22:29:27.313 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:27.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.314+0000 7f92551d4700 1 -- 172.21.15.40:0/237294779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92501b95a0 msgr2=0x7f92501a6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:27.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.314+0000 7f92551d4700 1 --2- 172.21.15.40:0/237294779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92501b95a0 0x7f92501a6c30 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f925009b7b0 tx=0x7f9248004ad0 comp rx=0 tx=0).stop 2023-09-30T22:29:27.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.315+0000 7f92551d4700 1 -- 172.21.15.40:0/237294779 shutdown_connections 2023-09-30T22:29:27.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.315+0000 7f92551d4700 1 --2- 172.21.15.40:0/237294779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92501b95a0 0x7f92501a6c30 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:27.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.315+0000 7f92551d4700 1 --2- 172.21.15.40:0/237294779 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f925009d920 0x7f92501a61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:27.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.315+0000 7f92551d4700 1 --2- 172.21.15.40:0/237294779 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f925009e230 0x7f92501a66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:27.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.315+0000 7f92551d4700 1 -- 172.21.15.40:0/237294779 >> 172.21.15.40:0/237294779 conn(0x7f925009fb20 msgr2=0x7f92501bb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:27.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.315+0000 7f92551d4700 1 -- 172.21.15.40:0/237294779 shutdown_connections 2023-09-30T22:29:27.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:27.315+0000 7f92551d4700 1 -- 172.21.15.40:0/237294779 wait complete. 2023-09-30T22:29:27.327 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:28.268 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:28.291 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:28.300 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:28.329 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:28.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.422+0000 7f31523a6700 1 Processor -- start 2023-09-30T22:29:28.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.422+0000 7f31523a6700 1 -- start start 2023-09-30T22:29:28.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.422+0000 7f31523a6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f314c09d920 0x7f314c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:28.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.423+0000 7f31523a6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f314c09e230 0x7f314c1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:28.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.423+0000 7f31523a6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f314c09f940 con 0x7f314c09f0f0 2023-09-30T22:29:28.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.423+0000 7f31523a6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f314c06b4c0 con 0x7f314c09d920 2023-09-30T22:29:28.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.423+0000 7f31523a6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f314c09a8f0 con 0x7f314c09e230 2023-09-30T22:29:28.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.423+0000 7f314bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f314c09d920 0x7f314c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:28.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.423+0000 7f314bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f314c09d920 0x7f314c09dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56854/0 (socket says 172.21.15.40:56854) 2023-09-30T22:29:28.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.423+0000 7f314bfff700 1 -- 172.21.15.40:0/1860780133 learned_addr learned my addr 172.21.15.40:0/1860780133 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:28.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.423+0000 7f3150943700 1 --2- 172.21.15.40:0/1860780133 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f314c09e230 0x7f314c1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:28.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.423+0000 7f314bfff700 1 -- 172.21.15.40:0/1860780133 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f314c09e230 msgr2=0x7f314c1343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:28.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.423+0000 7f314bfff700 1 --2- 172.21.15.40:0/1860780133 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f314c09e230 0x7f314c1343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.423+0000 7f314bfff700 1 -- 172.21.15.40:0/1860780133 >> v1:172.21.15.40:6789/0 conn(0x7f314c09f0f0 legacy=0x7f314c133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:28.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.423+0000 7f314bfff700 1 -- 172.21.15.40:0/1860780133 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314c09f6e0 con 0x7f314c09d920 2023-09-30T22:29:28.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.424+0000 7f314bfff700 1 --2- 172.21.15.40:0/1860780133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f314c09d920 0x7f314c09dcf0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f313c006fd0 tx=0x7f313c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac6afdd096d9c0f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:28.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.424+0000 7f314affd700 1 -- 172.21.15.40:0/1860780133 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c005e30 con 0x7f314c09d920 2023-09-30T22:29:28.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.424+0000 7f314affd700 1 -- 172.21.15.40:0/1860780133 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313c004030 con 0x7f314c09d920 2023-09-30T22:29:28.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.424+0000 7f314affd700 1 -- 172.21.15.40:0/1860780133 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c0043e0 con 0x7f314c09d920 2023-09-30T22:29:28.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.425+0000 7f31523a6700 1 -- 172.21.15.40:0/1860780133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f314c09d920 msgr2=0x7f314c09dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:28.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.425+0000 7f31523a6700 1 --2- 172.21.15.40:0/1860780133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f314c09d920 0x7f314c09dcf0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f313c006fd0 tx=0x7f313c009bd0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.425+0000 7f31523a6700 1 -- 172.21.15.40:0/1860780133 shutdown_connections 2023-09-30T22:29:28.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.425+0000 7f31523a6700 1 --2- 172.21.15.40:0/1860780133 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f314c09e230 0x7f314c1343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.425+0000 7f31523a6700 1 --2- 172.21.15.40:0/1860780133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f314c09d920 0x7f314c09dcf0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.425+0000 7f31523a6700 1 -- 172.21.15.40:0/1860780133 >> 172.21.15.40:0/1860780133 conn(0x7f314c09fb20 msgr2=0x7f314c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:28.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.425+0000 7f31523a6700 1 -- 172.21.15.40:0/1860780133 shutdown_connections 2023-09-30T22:29:28.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.425+0000 7f31523a6700 1 -- 172.21.15.40:0/1860780133 wait complete. 2023-09-30T22:29:28.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.426+0000 7f31523a6700 1 Processor -- start 2023-09-30T22:29:28.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.426+0000 7f31523a6700 1 -- start start 2023-09-30T22:29:28.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.426+0000 7f31523a6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f314c09d920 0x7f314c1a6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:28.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.426+0000 7f31523a6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f314c09e230 0x7f314c1a65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:28.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.426+0000 7f31523a6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f314c1b9430 0x7f314c1a6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:28.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.426+0000 7f31523a6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314c1aa520 con 0x7f314c09d920 2023-09-30T22:29:28.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.426+0000 7f31523a6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f314c1a7c50 con 0x7f314c1b9430 2023-09-30T22:29:28.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.426+0000 7f31523a6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f314c1a8270 con 0x7f314c09e230 2023-09-30T22:29:28.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.427+0000 7f3150943700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f314c1b9430 0x7f314c1a6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:28.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.427+0000 7f314bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f314c09d920 0x7f314c1a6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:28.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.427+0000 7f3150943700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f314c1b9430 0x7f314c1a6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:34828/0 (socket says 172.21.15.40:34828) 2023-09-30T22:29:28.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.427+0000 7f3150943700 1 -- 172.21.15.40:0/2901480782 learned_addr learned my addr 172.21.15.40:0/2901480782 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:28.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.427+0000 7f314b7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f314c09e230 0x7f314c1a65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:28.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.427+0000 7f3150943700 1 -- 172.21.15.40:0/2901480782 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f314c09e230 msgr2=0x7f314c1a65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:28.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.427+0000 7f3150943700 1 --2- 172.21.15.40:0/2901480782 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f314c09e230 0x7f314c1a65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.427+0000 7f3150943700 1 -- 172.21.15.40:0/2901480782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f314c09d920 msgr2=0x7f314c1a6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:28.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.427+0000 7f3150943700 1 --2- 172.21.15.40:0/2901480782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f314c09d920 0x7f314c1a6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.427+0000 7f3150943700 1 -- 172.21.15.40:0/2901480782 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f313c009500 con 0x7f314c1b9430 2023-09-30T22:29:28.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.427+0000 7f3150943700 1 --2- 172.21.15.40:0/2901480782 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f314c1b9430 0x7f314c1a6b10 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3144009dd0 tx=0x7f314400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:28.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.427+0000 7f3148ff9700 1 -- 172.21.15.40:0/2901480782 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3144009c40 con 0x7f314c1b9430 2023-09-30T22:29:28.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.427+0000 7f3148ff9700 1 -- 172.21.15.40:0/2901480782 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314400f040 con 0x7f314c1b9430 2023-09-30T22:29:28.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.427+0000 7f31523a6700 1 -- 172.21.15.40:0/2901480782 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f314c1a8ea0 con 0x7f314c1b9430 2023-09-30T22:29:28.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.427+0000 7f3148ff9700 1 -- 172.21.15.40:0/2901480782 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314400ceb0 con 0x7f314c1b9430 2023-09-30T22:29:28.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.427+0000 7f31523a6700 1 -- 172.21.15.40:0/2901480782 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f314c0a3630 con 0x7f314c1b9430 2023-09-30T22:29:28.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.428+0000 7f3148ff9700 1 -- 172.21.15.40:0/2901480782 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3144014480 con 0x7f314c1b9430 2023-09-30T22:29:28.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.429+0000 7f31523a6700 1 -- 172.21.15.40:0/2901480782 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f314c09ca40 con 0x7f314c1b9430 2023-09-30T22:29:28.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.429+0000 7f3148ff9700 1 -- 172.21.15.40:0/2901480782 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f314403ff30 con 0x7f314c1b9430 2023-09-30T22:29:28.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.438+0000 7f3148ff9700 1 -- 172.21.15.40:0/2901480782 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3144018070 con 0x7f314c1b9430 2023-09-30T22:29:28.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.461+0000 7f5a069b0700 1 Processor -- start 2023-09-30T22:29:28.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.461+0000 7f5a069b0700 1 -- start start 2023-09-30T22:29:28.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.461+0000 7f5a069b0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a0009d920 0x7f5a0009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:28.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.461+0000 7f5a069b0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a0009e230 0x7f5a001308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:28.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.461+0000 7f5a069b0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a0009adf0 con 0x7f5a00130de0 2023-09-30T22:29:28.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.461+0000 7f5a069b0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0009edf0 con 0x7f5a0009e230 2023-09-30T22:29:28.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.461+0000 7f5a069b0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0009b660 con 0x7f5a0009d920 2023-09-30T22:29:28.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.461+0000 7f59fffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a0009d920 0x7f5a0009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:28.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.461+0000 7f59fffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a0009d920 0x7f5a0009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:39264/0 (socket says 172.21.15.40:39264) 2023-09-30T22:29:28.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.461+0000 7f59fffff700 1 -- 172.21.15.40:0/2205228679 learned_addr learned my addr 172.21.15.40:0/2205228679 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:28.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.461+0000 7fb836eb3700 1 Processor -- start 2023-09-30T22:29:28.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.461+0000 7f59ff7fe700 1 --2- 172.21.15.40:0/2205228679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a0009e230 0x7f5a001308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:28.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.462+0000 7fb836eb3700 1 -- start start 2023-09-30T22:29:28.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.462+0000 7f59ff7fe700 1 -- 172.21.15.40:0/2205228679 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a0009d920 msgr2=0x7f5a0009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:28.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.462+0000 7f59ff7fe700 1 --2- 172.21.15.40:0/2205228679 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a0009d920 0x7f5a0009dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.462+0000 7f59ff7fe700 1 -- 172.21.15.40:0/2205228679 >> v1:172.21.15.40:6789/0 conn(0x7f5a00130de0 legacy=0x7f5a00137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:28.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.462+0000 7f59ff7fe700 1 -- 172.21.15.40:0/2205228679 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a0009a6e0 con 0x7f5a0009e230 2023-09-30T22:29:28.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.462+0000 7f59ff7fe700 1 --2- 172.21.15.40:0/2205228679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a0009e230 0x7f5a001308a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f59f4009870 tx=0x7f59f4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55125ee7fde184ec server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:28.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.462+0000 7f59feffd700 1 -- 172.21.15.40:0/2205228679 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f4011830 con 0x7f5a0009e230 2023-09-30T22:29:28.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.462+0000 7f59feffd700 1 -- 172.21.15.40:0/2205228679 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f4011990 con 0x7f5a0009e230 2023-09-30T22:29:28.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.462+0000 7f59feffd700 1 -- 172.21.15.40:0/2205228679 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f4011d20 con 0x7f5a0009e230 2023-09-30T22:29:28.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.462+0000 7fb836eb3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb83009e400 0x7fb830135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:28.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.462+0000 7fb836eb3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb830136230 0x7fb830138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:28.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.462+0000 7fb836eb3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb83009adf0 con 0x7fb83009d920 2023-09-30T22:29:28.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.462+0000 7fb836eb3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb83009e7f0 con 0x7fb830136230 2023-09-30T22:29:28.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.462+0000 7fb836eb3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb83009edf0 con 0x7fb83009e400 2023-09-30T22:29:28.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.462+0000 7fb82ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb83009e400 0x7fb830135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:28.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.463+0000 7fb835450700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb830136230 0x7fb830138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:28.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.463+0000 7fb82ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb83009e400 0x7fb830135cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:39274/0 (socket says 172.21.15.40:39274) 2023-09-30T22:29:28.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.463+0000 7fb82ffff700 1 -- 172.21.15.40:0/1779606838 learned_addr learned my addr 172.21.15.40:0/1779606838 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:28.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.463+0000 7fb82ffff700 1 -- 172.21.15.40:0/1779606838 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb830136230 msgr2=0x7fb830138610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:28.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.463+0000 7fb82ffff700 1 --2- 172.21.15.40:0/1779606838 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb830136230 0x7fb830138610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.463+0000 7fb82ffff700 1 -- 172.21.15.40:0/1779606838 >> v1:172.21.15.40:6789/0 conn(0x7fb83009d920 legacy=0x7fb83009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:28.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.463+0000 7fb82ffff700 1 -- 172.21.15.40:0/1779606838 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83009b660 con 0x7fb83009e400 2023-09-30T22:29:28.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.463+0000 7f5a069b0700 1 -- 172.21.15.40:0/2205228679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a0009e230 msgr2=0x7f5a001308a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:28.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.463+0000 7f5a069b0700 1 --2- 172.21.15.40:0/2205228679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a0009e230 0x7f5a001308a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f59f4009870 tx=0x7f59f4009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:28.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.463+0000 7fb82ffff700 1 --2- 172.21.15.40:0/1779606838 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb83009e400 0x7fb830135cf0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fb81c00b9d0 tx=0x7fb81c00bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7553d819d20dbc5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:28.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.463+0000 7f5a069b0700 1 -- 172.21.15.40:0/2205228679 shutdown_connections 2023-09-30T22:29:28.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.463+0000 7f5a069b0700 1 --2- 172.21.15.40:0/2205228679 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a0009d920 0x7f5a0009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.463+0000 7f5a069b0700 1 --2- 172.21.15.40:0/2205228679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a0009e230 0x7f5a001308a0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.463+0000 7f5a069b0700 1 -- 172.21.15.40:0/2205228679 >> 172.21.15.40:0/2205228679 conn(0x7f5a0009fb20 msgr2=0x7f5a0009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:28.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.463+0000 7f5a069b0700 1 -- 172.21.15.40:0/2205228679 shutdown_connections 2023-09-30T22:29:28.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.463+0000 7f5a069b0700 1 -- 172.21.15.40:0/2205228679 wait complete. 2023-09-30T22:29:28.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.463+0000 7fb82f7fe700 1 -- 172.21.15.40:0/1779606838 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c00cc00 con 0x7fb83009e400 2023-09-30T22:29:28.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.463+0000 7fb82f7fe700 1 -- 172.21.15.40:0/1779606838 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81c00cd60 con 0x7fb83009e400 2023-09-30T22:29:28.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.463+0000 7fb82f7fe700 1 -- 172.21.15.40:0/1779606838 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c00f680 con 0x7fb83009e400 2023-09-30T22:29:28.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.464+0000 7fb836eb3700 1 -- 172.21.15.40:0/1779606838 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb83009e400 msgr2=0x7fb830135cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:28.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.464+0000 7fb836eb3700 1 --2- 172.21.15.40:0/1779606838 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb83009e400 0x7fb830135cf0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fb81c00b9d0 tx=0x7fb81c00bce0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.465+0000 7f5a069b0700 1 Processor -- start 2023-09-30T22:29:28.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.465+0000 7fb836eb3700 1 -- 172.21.15.40:0/1779606838 shutdown_connections 2023-09-30T22:29:28.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.465+0000 7fb836eb3700 1 --2- 172.21.15.40:0/1779606838 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb830136230 0x7fb830138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.465+0000 7fb836eb3700 1 --2- 172.21.15.40:0/1779606838 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb83009e400 0x7fb830135cf0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.465+0000 7fb836eb3700 1 -- 172.21.15.40:0/1779606838 >> 172.21.15.40:0/1779606838 conn(0x7fb83009fb20 msgr2=0x7fb83009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:28.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.465+0000 7fb836eb3700 1 -- 172.21.15.40:0/1779606838 shutdown_connections 2023-09-30T22:29:28.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.465+0000 7fb836eb3700 1 -- 172.21.15.40:0/1779606838 wait complete. 2023-09-30T22:29:28.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.465+0000 7f5a069b0700 1 -- start start 2023-09-30T22:29:28.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.466+0000 7f5a069b0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a0009d920 0x7f5a0012ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:28.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.466+0000 7f5a069b0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a0009e230 0x7f5a0012f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:28.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.466+0000 7f5a069b0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a00130de0 0x7f5a0012f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:28.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.466+0000 7f5a069b0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a00133240 con 0x7f5a0009e230 2023-09-30T22:29:28.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.466+0000 7f5a069b0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a00132c90 con 0x7f5a0009d920 2023-09-30T22:29:28.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.466+0000 7f5a069b0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a00131bc0 con 0x7f5a00130de0 2023-09-30T22:29:28.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.466+0000 7fb836eb3700 1 Processor -- start 2023-09-30T22:29:28.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.466+0000 7fb836eb3700 1 -- start start 2023-09-30T22:29:28.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.466+0000 7f5a04f4d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a00130de0 0x7f5a0012f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:28.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.466+0000 7f5a04f4d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a00130de0 0x7f5a0012f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:39288/0 (socket says 172.21.15.40:39288) 2023-09-30T22:29:28.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.466+0000 7f5a04f4d700 1 -- 172.21.15.40:0/376760278 learned_addr learned my addr 172.21.15.40:0/376760278 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:28.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.466+0000 7fb836eb3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb83009d920 0x7fb83011e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:28.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.466+0000 7fb836eb3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb83009e400 0x7fb83011ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:28.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.466+0000 7fb836eb3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb830136230 0x7fb83011f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:28.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.466+0000 7fb836eb3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb830135aa0 con 0x7fb83009e400 2023-09-30T22:29:28.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.466+0000 7fb836eb3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb830120280 con 0x7fb83009d920 2023-09-30T22:29:28.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.466+0000 7fb836eb3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb830120b10 con 0x7fb830136230 2023-09-30T22:29:28.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.466+0000 7f5a04f4d700 1 -- 172.21.15.40:0/376760278 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a0009d920 msgr2=0x7f5a0012ef20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:28.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.466+0000 7f5a04f4d700 1 --2- 172.21.15.40:0/376760278 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a0009d920 0x7f5a0012ef20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.466+0000 7f5a04f4d700 1 -- 172.21.15.40:0/376760278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a0009e230 msgr2=0x7f5a0012f460 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:28.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.466+0000 7f5a04f4d700 1 --2- 172.21.15.40:0/376760278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a0009e230 0x7f5a0012f460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.467+0000 7f5a04f4d700 1 -- 172.21.15.40:0/376760278 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f40094a0 con 0x7f5a00130de0 2023-09-30T22:29:28.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.467+0000 7fb82ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb83009e400 0x7fb83011ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:28.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.467+0000 7fb82ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb83009e400 0x7fb83011ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56862/0 (socket says 172.21.15.40:56862) 2023-09-30T22:29:28.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.467+0000 7fb82ffff700 1 -- 172.21.15.40:0/4023083995 learned_addr learned my addr 172.21.15.40:0/4023083995 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:28.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.467+0000 7fb835450700 1 --2- 172.21.15.40:0/4023083995 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb830136230 0x7fb83011f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:28.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.467+0000 7fb834c4f700 1 --2- 172.21.15.40:0/4023083995 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb83009d920 0x7fb83011e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:28.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.467+0000 7fb82ffff700 1 -- 172.21.15.40:0/4023083995 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb830136230 msgr2=0x7fb83011f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:28.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.467+0000 7fb82ffff700 1 --2- 172.21.15.40:0/4023083995 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb830136230 0x7fb83011f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.467+0000 7fb82ffff700 1 -- 172.21.15.40:0/4023083995 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb83009d920 msgr2=0x7fb83011e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:28.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.467+0000 7fb82ffff700 1 --2- 172.21.15.40:0/4023083995 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb83009d920 0x7fb83011e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.467+0000 7fb82ffff700 1 -- 172.21.15.40:0/4023083995 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81c00b600 con 0x7fb83009e400 2023-09-30T22:29:28.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.467+0000 7fb835450700 1 --2- 172.21.15.40:0/4023083995 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb830136230 0x7fb83011f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:28.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.467+0000 7f5a04f4d700 1 --2- 172.21.15.40:0/376760278 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a00130de0 0x7f5a0012f9a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f59f8002200 tx=0x7f59f800a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:28.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.467+0000 7fb834c4f700 1 --2- 172.21.15.40:0/4023083995 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb83009d920 0x7fb83011e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:29:28.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.467+0000 7f59fcff9700 1 -- 172.21.15.40:0/376760278 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f8003c00 con 0x7f5a00130de0 2023-09-30T22:29:28.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.467+0000 7f59fcff9700 1 -- 172.21.15.40:0/376760278 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f8003d60 con 0x7f5a00130de0 2023-09-30T22:29:28.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.467+0000 7fb82ffff700 1 --2- 172.21.15.40:0/4023083995 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb83009e400 0x7fb83011ec40 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fb81c0090b0 tx=0x7fb81c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:28.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.468+0000 7fb82d7fa700 1 -- 172.21.15.40:0/4023083995 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c01c070 con 0x7fb83009e400 2023-09-30T22:29:28.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.468+0000 7fb82d7fa700 1 -- 172.21.15.40:0/4023083995 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81c00be70 con 0x7fb83009e400 2023-09-30T22:29:28.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.468+0000 7fb82d7fa700 1 -- 172.21.15.40:0/4023083995 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c004270 con 0x7fb83009e400 2023-09-30T22:29:28.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.467+0000 7f59fcff9700 1 -- 172.21.15.40:0/376760278 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f800ac10 con 0x7f5a00130de0 2023-09-30T22:29:28.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.467+0000 7f5a069b0700 1 -- 172.21.15.40:0/376760278 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a00130bd0 con 0x7f5a00130de0 2023-09-30T22:29:28.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.467+0000 7f5a069b0700 1 -- 172.21.15.40:0/376760278 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a00131e00 con 0x7f5a00130de0 2023-09-30T22:29:28.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.468+0000 7f5a069b0700 1 -- 172.21.15.40:0/376760278 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a00062380 con 0x7f5a00130de0 2023-09-30T22:29:28.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.468+0000 7fb836eb3700 1 -- 172.21.15.40:0/4023083995 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb83009cb00 con 0x7fb83009e400 2023-09-30T22:29:28.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.468+0000 7fb836eb3700 1 -- 172.21.15.40:0/4023083995 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8301214d0 con 0x7fb83009e400 2023-09-30T22:29:28.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.469+0000 7fb836eb3700 1 -- 172.21.15.40:0/4023083995 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb83009a660 con 0x7fb83009e400 2023-09-30T22:29:28.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.470+0000 7fb82d7fa700 1 -- 172.21.15.40:0/4023083995 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb81c0043d0 con 0x7fb83009e400 2023-09-30T22:29:28.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.469+0000 7f59fcff9700 1 -- 172.21.15.40:0/376760278 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f59f80050d0 con 0x7f5a00130de0 2023-09-30T22:29:28.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.469+0000 7f59fcff9700 1 -- 172.21.15.40:0/376760278 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f59f8043810 con 0x7f5a00130de0 2023-09-30T22:29:28.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.470+0000 7fb82d7fa700 1 -- 172.21.15.40:0/4023083995 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb81c040cd0 con 0x7fb83009e400 2023-09-30T22:29:28.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.475+0000 7fb82d7fa700 1 -- 172.21.15.40:0/4023083995 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb81c0209c0 con 0x7fb83009e400 2023-09-30T22:29:28.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.478+0000 7f59fcff9700 1 -- 172.21.15.40:0/376760278 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f59f8021950 con 0x7f5a00130de0 2023-09-30T22:29:28.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.499+0000 7f12fddc6700 1 Processor -- start 2023-09-30T22:29:28.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.499+0000 7f12fddc6700 1 -- start start 2023-09-30T22:29:28.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.500+0000 7f12fddc6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f12f806a6d0 0x7f12f809d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:28.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.500+0000 7f12fddc6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12f809e250 0x7f12f813fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:28.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.500+0000 7f12fddc6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12f811d980 con 0x7f12f809de60 2023-09-30T22:29:28.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.500+0000 7f12fddc6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f806aaa0 con 0x7f12f809e250 2023-09-30T22:29:28.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.500+0000 7f12fddc6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12f806b150 con 0x7f12f806a6d0 2023-09-30T22:29:28.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.500+0000 7f12f77fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f12f806a6d0 0x7f12f809d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:28.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.500+0000 7f12f77fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f12f806a6d0 0x7f12f809d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:39304/0 (socket says 172.21.15.40:39304) 2023-09-30T22:29:28.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.500+0000 7f12f77fe700 1 -- 172.21.15.40:0/1450827806 learned_addr learned my addr 172.21.15.40:0/1450827806 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:28.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.500+0000 7f12f7fff700 1 --2- 172.21.15.40:0/1450827806 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12f809e250 0x7f12f813fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:28.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.500+0000 7f12f77fe700 1 -- 172.21.15.40:0/1450827806 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12f809e250 msgr2=0x7f12f813fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:28.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.500+0000 7f12f77fe700 1 --2- 172.21.15.40:0/1450827806 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12f809e250 0x7f12f813fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.500+0000 7f12f77fe700 1 -- 172.21.15.40:0/1450827806 >> v1:172.21.15.40:6789/0 conn(0x7f12f809de60 legacy=0x7f12f813c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:28.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.500+0000 7f12f77fe700 1 -- 172.21.15.40:0/1450827806 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f809f300 con 0x7f12f806a6d0 2023-09-30T22:29:28.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.500+0000 7f12f77fe700 1 --2- 172.21.15.40:0/1450827806 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f12f806a6d0 0x7f12f809d920 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f12e80098f0 tx=0x7f12e8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83a493ebc5469726 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:28.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.501+0000 7f12f67fc700 1 -- 172.21.15.40:0/1450827806 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e8005e30 con 0x7f12f806a6d0 2023-09-30T22:29:28.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.501+0000 7f12f67fc700 1 -- 172.21.15.40:0/1450827806 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e8004030 con 0x7f12f806a6d0 2023-09-30T22:29:28.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.501+0000 7f12f67fc700 1 -- 172.21.15.40:0/1450827806 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e80043e0 con 0x7f12f806a6d0 2023-09-30T22:29:28.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.502+0000 7f12fddc6700 1 -- 172.21.15.40:0/1450827806 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f12f806a6d0 msgr2=0x7f12f809d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:28.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.502+0000 7f12fddc6700 1 --2- 172.21.15.40:0/1450827806 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f12f806a6d0 0x7f12f809d920 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f12e80098f0 tx=0x7f12e8009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:28.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.502+0000 7f12fddc6700 1 -- 172.21.15.40:0/1450827806 shutdown_connections 2023-09-30T22:29:28.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.502+0000 7f12fddc6700 1 --2- 172.21.15.40:0/1450827806 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12f809e250 0x7f12f813fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.502+0000 7f12fddc6700 1 --2- 172.21.15.40:0/1450827806 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f12f806a6d0 0x7f12f809d920 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.502+0000 7f12fddc6700 1 -- 172.21.15.40:0/1450827806 >> 172.21.15.40:0/1450827806 conn(0x7f12f809fb20 msgr2=0x7f12f809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:28.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.502+0000 7f12fddc6700 1 -- 172.21.15.40:0/1450827806 shutdown_connections 2023-09-30T22:29:28.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.502+0000 7f12fddc6700 1 -- 172.21.15.40:0/1450827806 wait complete. 2023-09-30T22:29:28.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.503+0000 7f12fddc6700 1 Processor -- start 2023-09-30T22:29:28.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.503+0000 7f12fddc6700 1 -- start start 2023-09-30T22:29:28.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.503+0000 7f12fddc6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f12f806a6d0 0x7f12f81cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:28.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.503+0000 7f12fddc6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12f809de60 0x7f12f81ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:28.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.503+0000 7f12fddc6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12f809e250 0x7f12f81cd440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:28.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.503+0000 7f12fddc6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f809f540 con 0x7f12f809de60 2023-09-30T22:29:28.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.503+0000 7f12fddc6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f811d5c0 con 0x7f12f809e250 2023-09-30T22:29:28.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.503+0000 7f12fddc6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12f81bdb20 con 0x7f12f806a6d0 2023-09-30T22:29:28.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.504+0000 7f12f6ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12f809de60 0x7f12f81ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:28.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.504+0000 7f12f6ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12f809de60 0x7f12f81ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56878/0 (socket says 172.21.15.40:56878) 2023-09-30T22:29:28.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.504+0000 7f12f6ffd700 1 -- 172.21.15.40:0/2247422901 learned_addr learned my addr 172.21.15.40:0/2247422901 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:28.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.504+0000 7f12f77fe700 1 --2- 172.21.15.40:0/2247422901 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f12f806a6d0 0x7f12f81cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:28.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.504+0000 7f12f7fff700 1 --2- 172.21.15.40:0/2247422901 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12f809e250 0x7f12f81cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:28.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.504+0000 7f12f77fe700 1 -- 172.21.15.40:0/2247422901 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12f809e250 msgr2=0x7f12f81cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:28.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.504+0000 7f12f77fe700 1 --2- 172.21.15.40:0/2247422901 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12f809e250 0x7f12f81cd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.504+0000 7f12f77fe700 1 -- 172.21.15.40:0/2247422901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12f809de60 msgr2=0x7f12f81ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:28.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.504+0000 7f12f77fe700 1 --2- 172.21.15.40:0/2247422901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12f809de60 0x7f12f81ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.504+0000 7f12f77fe700 1 -- 172.21.15.40:0/2247422901 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e8009500 con 0x7f12f806a6d0 2023-09-30T22:29:28.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.504+0000 7f12f77fe700 1 --2- 172.21.15.40:0/2247422901 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f12f806a6d0 0x7f12f81cc9c0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f12e8013000 tx=0x7f12e8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:28.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.504+0000 7f12dffff700 1 -- 172.21.15.40:0/2247422901 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e8003bb0 con 0x7f12f806a6d0 2023-09-30T22:29:28.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.504+0000 7f12dffff700 1 -- 172.21.15.40:0/2247422901 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e8003d10 con 0x7f12f806a6d0 2023-09-30T22:29:28.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.505+0000 7f12fddc6700 1 -- 172.21.15.40:0/2247422901 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f81ab350 con 0x7f12f806a6d0 2023-09-30T22:29:28.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.505+0000 7f12dffff700 1 -- 172.21.15.40:0/2247422901 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e802e680 con 0x7f12f806a6d0 2023-09-30T22:29:28.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.505+0000 7f12fddc6700 1 -- 172.21.15.40:0/2247422901 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12f81ac9d0 con 0x7f12f806a6d0 2023-09-30T22:29:28.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.506+0000 7f12fddc6700 1 -- 172.21.15.40:0/2247422901 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12f81abad0 con 0x7f12f806a6d0 2023-09-30T22:29:28.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.507+0000 7f12dffff700 1 -- 172.21.15.40:0/2247422901 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f12e802e7e0 con 0x7f12f806a6d0 2023-09-30T22:29:28.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.507+0000 7f12dffff700 1 -- 172.21.15.40:0/2247422901 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f12e8051ee0 con 0x7f12f806a6d0 2023-09-30T22:29:28.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.511+0000 7f12dffff700 1 -- 172.21.15.40:0/2247422901 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f12e8041480 con 0x7f12f806a6d0 2023-09-30T22:29:28.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.640+0000 7f31523a6700 1 -- 172.21.15.40:0/2901480782 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f314c062380 con 0x7f314c1b9430 2023-09-30T22:29:28.641 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:28.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.640+0000 7f3148ff9700 1 -- 172.21.15.40:0/2901480782 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f31440114a0 con 0x7f314c1b9430 2023-09-30T22:29:28.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.643+0000 7f31523a6700 1 -- 172.21.15.40:0/2901480782 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f314c1b9430 msgr2=0x7f314c1a6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:28.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.643+0000 7f31523a6700 1 --2- 172.21.15.40:0/2901480782 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f314c1b9430 0x7f314c1a6b10 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3144009dd0 tx=0x7f314400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.643+0000 7f31523a6700 1 -- 172.21.15.40:0/2901480782 shutdown_connections 2023-09-30T22:29:28.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.643+0000 7f31523a6700 1 --2- 172.21.15.40:0/2901480782 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f314c1b9430 0x7f314c1a6b10 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.643+0000 7f31523a6700 1 --2- 172.21.15.40:0/2901480782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f314c09d920 0x7f314c1a6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.643+0000 7f31523a6700 1 --2- 172.21.15.40:0/2901480782 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f314c09e230 0x7f314c1a65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.643+0000 7f31523a6700 1 -- 172.21.15.40:0/2901480782 >> 172.21.15.40:0/2901480782 conn(0x7f314c09fb20 msgr2=0x7f314c1bb080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:28.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.643+0000 7f31523a6700 1 -- 172.21.15.40:0/2901480782 shutdown_connections 2023-09-30T22:29:28.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.643+0000 7f31523a6700 1 -- 172.21.15.40:0/2901480782 wait complete. 2023-09-30T22:29:28.661 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:28.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.675+0000 7fb836eb3700 1 -- 172.21.15.40:0/4023083995 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb830062380 con 0x7fb83009e400 2023-09-30T22:29:28.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.675+0000 7fb82d7fa700 1 -- 172.21.15.40:0/4023083995 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb81c026020 con 0x7fb83009e400 2023-09-30T22:29:28.676 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:28.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.677+0000 7fb836eb3700 1 -- 172.21.15.40:0/4023083995 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb83009e400 msgr2=0x7fb83011ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:28.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.677+0000 7fb836eb3700 1 --2- 172.21.15.40:0/4023083995 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb83009e400 0x7fb83011ec40 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fb81c0090b0 tx=0x7fb81c004750 comp rx=0 tx=0).stop 2023-09-30T22:29:28.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.677+0000 7fb836eb3700 1 -- 172.21.15.40:0/4023083995 shutdown_connections 2023-09-30T22:29:28.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.677+0000 7fb836eb3700 1 --2- 172.21.15.40:0/4023083995 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb830136230 0x7fb83011f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.677+0000 7fb836eb3700 1 --2- 172.21.15.40:0/4023083995 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb83009d920 0x7fb83011e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.677+0000 7fb836eb3700 1 --2- 172.21.15.40:0/4023083995 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb83009e400 0x7fb83011ec40 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.677+0000 7fb836eb3700 1 -- 172.21.15.40:0/4023083995 >> 172.21.15.40:0/4023083995 conn(0x7fb83009fb20 msgr2=0x7fb830070620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:28.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.677+0000 7fb836eb3700 1 -- 172.21.15.40:0/4023083995 shutdown_connections 2023-09-30T22:29:28.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.677+0000 7fb836eb3700 1 -- 172.21.15.40:0/4023083995 wait complete. 2023-09-30T22:29:28.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.680+0000 7f5a069b0700 1 -- 172.21.15.40:0/376760278 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5a00074720 con 0x7f5a00130de0 2023-09-30T22:29:28.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.680+0000 7f59fcff9700 1 -- 172.21.15.40:0/376760278 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f59f8021720 con 0x7f5a00130de0 2023-09-30T22:29:28.681 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:28.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.683+0000 7f5a069b0700 1 -- 172.21.15.40:0/376760278 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a00130de0 msgr2=0x7f5a0012f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:28.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.683+0000 7f5a069b0700 1 --2- 172.21.15.40:0/376760278 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a00130de0 0x7f5a0012f9a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f59f8002200 tx=0x7f59f800a060 comp rx=0 tx=0).stop 2023-09-30T22:29:28.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.683+0000 7f5a069b0700 1 -- 172.21.15.40:0/376760278 shutdown_connections 2023-09-30T22:29:28.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.683+0000 7f5a069b0700 1 --2- 172.21.15.40:0/376760278 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5a00130de0 0x7f5a0012f9a0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.683+0000 7f5a069b0700 1 --2- 172.21.15.40:0/376760278 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5a0009d920 0x7f5a0012ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.683+0000 7f5a069b0700 1 --2- 172.21.15.40:0/376760278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a0009e230 0x7f5a0012f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.683+0000 7f5a069b0700 1 -- 172.21.15.40:0/376760278 >> 172.21.15.40:0/376760278 conn(0x7f5a0009fb20 msgr2=0x7f5a00070000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:28.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.683+0000 7f5a069b0700 1 -- 172.21.15.40:0/376760278 shutdown_connections 2023-09-30T22:29:28.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.683+0000 7f5a069b0700 1 -- 172.21.15.40:0/376760278 wait complete. 2023-09-30T22:29:28.692 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:28.697 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:28.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.718+0000 7f12fddc6700 1 -- 172.21.15.40:0/2247422901 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f12f81ac670 con 0x7f12f806a6d0 2023-09-30T22:29:28.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.719+0000 7f12dffff700 1 -- 172.21.15.40:0/2247422901 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f12e803c030 con 0x7f12f806a6d0 2023-09-30T22:29:28.720 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:28.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.720+0000 7f12fddc6700 1 -- 172.21.15.40:0/2247422901 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f12f806a6d0 msgr2=0x7f12f81cc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:28.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.720+0000 7f12fddc6700 1 --2- 172.21.15.40:0/2247422901 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f12f806a6d0 0x7f12f81cc9c0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f12e8013000 tx=0x7f12e8004750 comp rx=0 tx=0).stop 2023-09-30T22:29:28.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.721+0000 7f12fddc6700 1 -- 172.21.15.40:0/2247422901 shutdown_connections 2023-09-30T22:29:28.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.721+0000 7f12fddc6700 1 --2- 172.21.15.40:0/2247422901 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f12f806a6d0 0x7f12f81cc9c0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.721+0000 7f12fddc6700 1 --2- 172.21.15.40:0/2247422901 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12f809e250 0x7f12f81cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.721+0000 7f12fddc6700 1 --2- 172.21.15.40:0/2247422901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12f809de60 0x7f12f81ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:28.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.721+0000 7f12fddc6700 1 -- 172.21.15.40:0/2247422901 >> 172.21.15.40:0/2247422901 conn(0x7f12f809fb20 msgr2=0x7f12f81c0530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:28.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.721+0000 7f12fddc6700 1 -- 172.21.15.40:0/2247422901 shutdown_connections 2023-09-30T22:29:28.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:28.721+0000 7f12fddc6700 1 -- 172.21.15.40:0/2247422901 wait complete. 2023-09-30T22:29:28.733 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:29.663 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:29.692 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:29.698 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:29.735 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:29.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.810+0000 7f0ff8553700 1 Processor -- start 2023-09-30T22:29:29.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.810+0000 7f0ff8553700 1 -- start start 2023-09-30T22:29:29.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.811+0000 7f0ff8553700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ff0133e00 0x7f0ff01341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:29.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.811+0000 7f0ff8553700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ff009df40 0x7f0ff013bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:29.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.811+0000 7f0ff8553700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff0133940 con 0x7f0ff009d400 2023-09-30T22:29:29.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.811+0000 7f0ff8553700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff009ab20 con 0x7f0ff0133e00 2023-09-30T22:29:29.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.811+0000 7f0ff8553700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff009f0d0 con 0x7f0ff009df40 2023-09-30T22:29:29.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.811+0000 7f0ff6af0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ff009df40 0x7f0ff013bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:29.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.811+0000 7f0ff62ef700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ff0133e00 0x7f0ff01341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:29.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.811+0000 7f0ff6af0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ff009df40 0x7f0ff013bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:39320/0 (socket says 172.21.15.40:39320) 2023-09-30T22:29:29.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.811+0000 7f0ff6af0700 1 -- 172.21.15.40:0/2523294009 learned_addr learned my addr 172.21.15.40:0/2523294009 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:29.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.811+0000 7f0ff62ef700 1 -- 172.21.15.40:0/2523294009 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ff009df40 msgr2=0x7f0ff013bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:29.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.811+0000 7f0ff62ef700 1 --2- 172.21.15.40:0/2523294009 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ff009df40 0x7f0ff013bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.811+0000 7f0ff62ef700 1 -- 172.21.15.40:0/2523294009 >> v1:172.21.15.40:6789/0 conn(0x7f0ff009d400 legacy=0x7f0ff009d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:29.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.811+0000 7f0ff62ef700 1 -- 172.21.15.40:0/2523294009 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff0133be0 con 0x7f0ff0133e00 2023-09-30T22:29:29.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.812+0000 7f0ff62ef700 1 --2- 172.21.15.40:0/2523294009 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ff0133e00 0x7f0ff01341d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f0fec009870 tx=0x7f0fec009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=567cef4aee91ebfe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:29.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.812+0000 7f0ff52ed700 1 -- 172.21.15.40:0/2523294009 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec004230 con 0x7f0ff0133e00 2023-09-30T22:29:29.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.812+0000 7f0ff52ed700 1 -- 172.21.15.40:0/2523294009 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fec004390 con 0x7f0ff0133e00 2023-09-30T22:29:29.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.812+0000 7f0ff52ed700 1 -- 172.21.15.40:0/2523294009 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec0036a0 con 0x7f0ff0133e00 2023-09-30T22:29:29.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.813+0000 7f0ff8553700 1 -- 172.21.15.40:0/2523294009 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ff0133e00 msgr2=0x7f0ff01341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:29.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.813+0000 7f0ff8553700 1 --2- 172.21.15.40:0/2523294009 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ff0133e00 0x7f0ff01341d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f0fec009870 tx=0x7f0fec009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:29.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.813+0000 7f0ff8553700 1 -- 172.21.15.40:0/2523294009 shutdown_connections 2023-09-30T22:29:29.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.813+0000 7f0ff8553700 1 --2- 172.21.15.40:0/2523294009 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ff009df40 0x7f0ff013bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.813+0000 7f0ff8553700 1 --2- 172.21.15.40:0/2523294009 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ff0133e00 0x7f0ff01341d0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.813+0000 7f0ff8553700 1 -- 172.21.15.40:0/2523294009 >> 172.21.15.40:0/2523294009 conn(0x7f0ff00a2a00 msgr2=0x7f0ff00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:29.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.813+0000 7f0ff8553700 1 -- 172.21.15.40:0/2523294009 shutdown_connections 2023-09-30T22:29:29.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.813+0000 7f0ff8553700 1 -- 172.21.15.40:0/2523294009 wait complete. 2023-09-30T22:29:29.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.814+0000 7f0ff8553700 1 Processor -- start 2023-09-30T22:29:29.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.814+0000 7f0ff8553700 1 -- start start 2023-09-30T22:29:29.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.814+0000 7f0ff8553700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ff009d400 0x7f0ff0119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:29.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.814+0000 7f0ff8553700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ff009df40 0x7f0ff0119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:29.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.814+0000 7f0ff8553700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ff0133e00 0x7f0ff0119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:29.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.814+0000 7f0ff8553700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff011aa20 con 0x7f0ff009d400 2023-09-30T22:29:29.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.814+0000 7f0ff8553700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff011c300 con 0x7f0ff0133e00 2023-09-30T22:29:29.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.814+0000 7f0ff8553700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff011cca0 con 0x7f0ff009df40 2023-09-30T22:29:29.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.815+0000 7f0ff6af0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ff0133e00 0x7f0ff0119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:29.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.815+0000 7f0ff6af0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ff0133e00 0x7f0ff0119ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:34892/0 (socket says 172.21.15.40:34892) 2023-09-30T22:29:29.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.815+0000 7f0ff6af0700 1 -- 172.21.15.40:0/2481691960 learned_addr learned my addr 172.21.15.40:0/2481691960 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:29.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.815+0000 7f0ff5aee700 1 --2- 172.21.15.40:0/2481691960 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ff009df40 0x7f0ff0119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:29.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.815+0000 7f0ff62ef700 1 --2- 172.21.15.40:0/2481691960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ff009d400 0x7f0ff0119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:29.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.815+0000 7f0ff6af0700 1 -- 172.21.15.40:0/2481691960 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ff009df40 msgr2=0x7f0ff0119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:29.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.815+0000 7f0ff6af0700 1 --2- 172.21.15.40:0/2481691960 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ff009df40 0x7f0ff0119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.815+0000 7f0ff6af0700 1 -- 172.21.15.40:0/2481691960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ff009d400 msgr2=0x7f0ff0119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:29.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.815+0000 7f0ff6af0700 1 --2- 172.21.15.40:0/2481691960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ff009d400 0x7f0ff0119050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.815+0000 7f0ff6af0700 1 -- 172.21.15.40:0/2481691960 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fec0094a0 con 0x7f0ff0133e00 2023-09-30T22:29:29.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.815+0000 7f0ff5aee700 1 --2- 172.21.15.40:0/2481691960 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ff009df40 0x7f0ff0119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:29.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.815+0000 7f0ff6af0700 1 --2- 172.21.15.40:0/2481691960 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ff0133e00 0x7f0ff0119ad0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8009d60 tx=0x7f0fe800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:29.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.816+0000 7f0fe6ffd700 1 -- 172.21.15.40:0/2481691960 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe8009bd0 con 0x7f0ff0133e00 2023-09-30T22:29:29.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.816+0000 7f0fe6ffd700 1 -- 172.21.15.40:0/2481691960 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe800f040 con 0x7f0ff0133e00 2023-09-30T22:29:29.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.816+0000 7f0ff8553700 1 -- 172.21.15.40:0/2481691960 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff009ff50 con 0x7f0ff0133e00 2023-09-30T22:29:29.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.816+0000 7f0fe6ffd700 1 -- 172.21.15.40:0/2481691960 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe8003e80 con 0x7f0ff0133e00 2023-09-30T22:29:29.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.816+0000 7f0ff8553700 1 -- 172.21.15.40:0/2481691960 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff011a3f0 con 0x7f0ff0133e00 2023-09-30T22:29:29.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.816+0000 7f0fe6ffd700 1 -- 172.21.15.40:0/2481691960 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0fe800c8d0 con 0x7f0ff0133e00 2023-09-30T22:29:29.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.817+0000 7f0fe6ffd700 1 -- 172.21.15.40:0/2481691960 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f0fe803f9f0 con 0x7f0ff0133e00 2023-09-30T22:29:29.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.817+0000 7f0ff8553700 1 -- 172.21.15.40:0/2481691960 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff011bcc0 con 0x7f0ff0133e00 2023-09-30T22:29:29.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.822+0000 7f0fe6ffd700 1 -- 172.21.15.40:0/2481691960 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0ff011bcc0 con 0x7f0ff0133e00 2023-09-30T22:29:29.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.851+0000 7fc813f97700 1 Processor -- start 2023-09-30T22:29:29.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.851+0000 7fc813f97700 1 -- start start 2023-09-30T22:29:29.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.852+0000 7fc813f97700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc80c138250 0x7fc80c138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:29.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.852+0000 7fc813f97700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc80c09df20 0x7fc80c140160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:29.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.852+0000 7fc813f97700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc80c137e20 con 0x7fc80c09d400 2023-09-30T22:29:29.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.852+0000 7fc813f97700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc80c138050 con 0x7fc80c138250 2023-09-30T22:29:29.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.852+0000 7fc813f97700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c09b010 con 0x7fc80c09df20 2023-09-30T22:29:29.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.852+0000 7fc811d33700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc80c138250 0x7fc80c138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:29.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.852+0000 7fc811d33700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc80c138250 0x7fc80c138620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56886/0 (socket says 172.21.15.40:56886) 2023-09-30T22:29:29.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.852+0000 7fc811d33700 1 -- 172.21.15.40:0/28481237 learned_addr learned my addr 172.21.15.40:0/28481237 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:29.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.852+0000 7fc812534700 1 --2- 172.21.15.40:0/28481237 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc80c09df20 0x7fc80c140160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:29.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.852+0000 7fc811d33700 1 -- 172.21.15.40:0/28481237 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc80c09df20 msgr2=0x7fc80c140160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:29.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.852+0000 7fc811d33700 1 --2- 172.21.15.40:0/28481237 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc80c09df20 0x7fc80c140160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.852+0000 7fc811d33700 1 -- 172.21.15.40:0/28481237 >> v1:172.21.15.40:6789/0 conn(0x7fc80c09d400 legacy=0x7fc80c09d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:29.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.852+0000 7fc811d33700 1 -- 172.21.15.40:0/28481237 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc80c09f1f0 con 0x7fc80c138250 2023-09-30T22:29:29.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.853+0000 7fc811d33700 1 --2- 172.21.15.40:0/28481237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc80c138250 0x7fc80c138620 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fc8080098f0 tx=0x7fc808009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b7d42426b1f8959 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:29.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.853+0000 7fc810d31700 1 -- 172.21.15.40:0/28481237 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc808011830 con 0x7fc80c138250 2023-09-30T22:29:29.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.853+0000 7fc810d31700 1 -- 172.21.15.40:0/28481237 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc808011990 con 0x7fc80c138250 2023-09-30T22:29:29.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.853+0000 7fc810d31700 1 -- 172.21.15.40:0/28481237 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc808011d20 con 0x7fc80c138250 2023-09-30T22:29:29.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.853+0000 7fc813f97700 1 -- 172.21.15.40:0/28481237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc80c138250 msgr2=0x7fc80c138620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:29.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.853+0000 7fc813f97700 1 --2- 172.21.15.40:0/28481237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc80c138250 0x7fc80c138620 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fc8080098f0 tx=0x7fc808009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:29.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.853+0000 7fc813f97700 1 -- 172.21.15.40:0/28481237 shutdown_connections 2023-09-30T22:29:29.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.853+0000 7fc813f97700 1 --2- 172.21.15.40:0/28481237 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc80c09df20 0x7fc80c140160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.853+0000 7fc813f97700 1 --2- 172.21.15.40:0/28481237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc80c138250 0x7fc80c138620 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.853+0000 7fc813f97700 1 -- 172.21.15.40:0/28481237 >> 172.21.15.40:0/28481237 conn(0x7fc80c0a2a00 msgr2=0x7fc80c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:29.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.854+0000 7fc813f97700 1 -- 172.21.15.40:0/28481237 shutdown_connections 2023-09-30T22:29:29.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.854+0000 7fc813f97700 1 -- 172.21.15.40:0/28481237 wait complete. 2023-09-30T22:29:29.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.855+0000 7fc813f97700 1 Processor -- start 2023-09-30T22:29:29.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.855+0000 7fc813f97700 1 -- start start 2023-09-30T22:29:29.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.855+0000 7fc813f97700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc80c09d400 0x7fc80c1228b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:29.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.855+0000 7fc813f97700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc80c09df20 0x7fc80c122df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:29.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.855+0000 7fc813f97700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc80c138250 0x7fc80c123330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:29.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.855+0000 7fc813f97700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c125b00 con 0x7fc80c09d400 2023-09-30T22:29:29.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.855+0000 7fc813f97700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c0a11a0 con 0x7fc80c138250 2023-09-30T22:29:29.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.855+0000 7fc813f97700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c123e70 con 0x7fc80c09df20 2023-09-30T22:29:29.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.855+0000 7fc811d33700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc80c09d400 0x7fc80c1228b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:29.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.855+0000 7fc811d33700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc80c09d400 0x7fc80c1228b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56888/0 (socket says 172.21.15.40:56888) 2023-09-30T22:29:29.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.855+0000 7fc811d33700 1 -- 172.21.15.40:0/3212270334 learned_addr learned my addr 172.21.15.40:0/3212270334 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:29.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.855+0000 7fc812534700 1 --2- 172.21.15.40:0/3212270334 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc80c138250 0x7fc80c123330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:29.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.855+0000 7fc811532700 1 --2- 172.21.15.40:0/3212270334 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc80c09df20 0x7fc80c122df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:29.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.856+0000 7fc811d33700 1 -- 172.21.15.40:0/3212270334 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc80c09df20 msgr2=0x7fc80c122df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:29.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.856+0000 7fc811d33700 1 --2- 172.21.15.40:0/3212270334 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc80c09df20 0x7fc80c122df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.856+0000 7fc811d33700 1 -- 172.21.15.40:0/3212270334 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc80c138250 msgr2=0x7fc80c123330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:29.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.856+0000 7fc811d33700 1 --2- 172.21.15.40:0/3212270334 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc80c138250 0x7fc80c123330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.856+0000 7fc811d33700 1 -- 172.21.15.40:0/3212270334 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc808009550 con 0x7fc80c09d400 2023-09-30T22:29:29.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.856+0000 7fc811d33700 1 --2- 172.21.15.40:0/3212270334 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc80c09d400 0x7fc80c1228b0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fc808000c00 tx=0x7fc808004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:29.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.856+0000 7fc8027fc700 1 -- 172.21.15.40:0/3212270334 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc808004590 con 0x7fc80c09d400 2023-09-30T22:29:29.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.856+0000 7fc8027fc700 1 -- 172.21.15.40:0/3212270334 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8080036a0 con 0x7fc80c09d400 2023-09-30T22:29:29.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.856+0000 7fc813f97700 1 -- 172.21.15.40:0/3212270334 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc80c125d50 con 0x7fc80c09d400 2023-09-30T22:29:29.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.856+0000 7fc8027fc700 1 -- 172.21.15.40:0/3212270334 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc808003a50 con 0x7fc80c09d400 2023-09-30T22:29:29.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.856+0000 7fc813f97700 1 -- 172.21.15.40:0/3212270334 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc80c1245c0 con 0x7fc80c09d400 2023-09-30T22:29:29.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.857+0000 7fc8027fc700 1 -- 172.21.15.40:0/3212270334 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc808003bb0 con 0x7fc80c09d400 2023-09-30T22:29:29.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.857+0000 7fc813f97700 1 -- 172.21.15.40:0/3212270334 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc80c06edb0 con 0x7fc80c09d400 2023-09-30T22:29:29.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.857+0000 7fc8027fc700 1 -- 172.21.15.40:0/3212270334 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc808021030 con 0x7fc80c09d400 2023-09-30T22:29:29.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.862+0000 7fc8027fc700 1 -- 172.21.15.40:0/3212270334 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc808003e60 con 0x7fc80c09d400 2023-09-30T22:29:29.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.866+0000 7f57d4d5c700 1 Processor -- start 2023-09-30T22:29:29.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.866+0000 7f57d4d5c700 1 -- start start 2023-09-30T22:29:29.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.866+0000 7f57d4d5c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57d0138250 0x7f57d0138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:29.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.866+0000 7f57d4d5c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f57d009d400 0x7f57d009d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:29.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.866+0000 7f57d4d5c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57d0137e20 con 0x7f57d009dd50 2023-09-30T22:29:29.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.866+0000 7f57d4d5c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d0138050 con 0x7f57d0138250 2023-09-30T22:29:29.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.866+0000 7f57d4d5c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f57d009b010 con 0x7f57d009d400 2023-09-30T22:29:29.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.867+0000 7f57cdd9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f57d009d400 0x7f57d009d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:29.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.867+0000 7f57cdd9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f57d009d400 0x7f57d009d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:39358/0 (socket says 172.21.15.40:39358) 2023-09-30T22:29:29.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.867+0000 7f57cdd9b700 1 -- 172.21.15.40:0/3256358153 learned_addr learned my addr 172.21.15.40:0/3256358153 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:29.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.867+0000 7f57ce59c700 1 --2- 172.21.15.40:0/3256358153 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57d0138250 0x7f57d0138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:29.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.867+0000 7f57cdd9b700 1 -- 172.21.15.40:0/3256358153 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57d0138250 msgr2=0x7f57d0138620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:29.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.867+0000 7f57cdd9b700 1 --2- 172.21.15.40:0/3256358153 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57d0138250 0x7f57d0138620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.867+0000 7f57cdd9b700 1 -- 172.21.15.40:0/3256358153 >> v1:172.21.15.40:6789/0 conn(0x7f57d009dd50 legacy=0x7f57d013f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:29.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.867+0000 7f57cdd9b700 1 -- 172.21.15.40:0/3256358153 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d009e1f0 con 0x7f57d009d400 2023-09-30T22:29:29.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.867+0000 7f57cdd9b700 1 --2- 172.21.15.40:0/3256358153 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f57d009d400 0x7f57d009d810 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f57c4009920 tx=0x7f57c4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72b4ef03be9ea61 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:29.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.867+0000 7f57cd59a700 1 -- 172.21.15.40:0/3256358153 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c4011830 con 0x7f57d009d400 2023-09-30T22:29:29.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.867+0000 7f57cd59a700 1 -- 172.21.15.40:0/3256358153 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c4011990 con 0x7f57d009d400 2023-09-30T22:29:29.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.867+0000 7f57cd59a700 1 -- 172.21.15.40:0/3256358153 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c4011d20 con 0x7f57d009d400 2023-09-30T22:29:29.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.868+0000 7f57d4d5c700 1 -- 172.21.15.40:0/3256358153 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f57d009d400 msgr2=0x7f57d009d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:29.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.868+0000 7f57d4d5c700 1 --2- 172.21.15.40:0/3256358153 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f57d009d400 0x7f57d009d810 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f57c4009920 tx=0x7f57c4009c30 comp rx=0 tx=0).stop 2023-09-30T22:29:29.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.868+0000 7f57d4d5c700 1 -- 172.21.15.40:0/3256358153 shutdown_connections 2023-09-30T22:29:29.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.868+0000 7f57d4d5c700 1 --2- 172.21.15.40:0/3256358153 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57d0138250 0x7f57d0138620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.868+0000 7f57d4d5c700 1 --2- 172.21.15.40:0/3256358153 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f57d009d400 0x7f57d009d810 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.868+0000 7f57d4d5c700 1 -- 172.21.15.40:0/3256358153 >> 172.21.15.40:0/3256358153 conn(0x7f57d00a2a00 msgr2=0x7f57d00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:29.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.868+0000 7f57d4d5c700 1 -- 172.21.15.40:0/3256358153 shutdown_connections 2023-09-30T22:29:29.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.868+0000 7f57d4d5c700 1 -- 172.21.15.40:0/3256358153 wait complete. 2023-09-30T22:29:29.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.869+0000 7f57d4d5c700 1 Processor -- start 2023-09-30T22:29:29.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.869+0000 7f57d4d5c700 1 -- start start 2023-09-30T22:29:29.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.870+0000 7f57d4d5c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f57d009d400 0x7f57d01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:29.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.870+0000 7f57d4d5c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57d009dd50 0x7f57d0133f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:29.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.870+0000 7f57d4d5c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57d0138250 0x7f57d01349e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:29.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.870+0000 7f57d4d5c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d0136120 con 0x7f57d0138250 2023-09-30T22:29:29.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.870+0000 7f57d4d5c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d013b470 con 0x7f57d009dd50 2023-09-30T22:29:29.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.870+0000 7f57d4d5c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f57d0071410 con 0x7f57d009d400 2023-09-30T22:29:29.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.870+0000 7f57ced9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57d0138250 0x7f57d01349e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:29.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.870+0000 7f57cdd9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57d009dd50 0x7f57d0133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:29.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.870+0000 7f57ced9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57d0138250 0x7f57d01349e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56896/0 (socket says 172.21.15.40:56896) 2023-09-30T22:29:29.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.870+0000 7f57cdd9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57d009dd50 0x7f57d0133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:34908/0 (socket says 172.21.15.40:34908) 2023-09-30T22:29:29.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.870+0000 7f57ced9d700 1 -- 172.21.15.40:0/2915352984 learned_addr learned my addr 172.21.15.40:0/2915352984 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:29.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.870+0000 7f57ce59c700 1 --2- 172.21.15.40:0/2915352984 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f57d009d400 0x7f57d01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:29.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.871+0000 7f57cdd9b700 1 -- 172.21.15.40:0/2915352984 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f57d009d400 msgr2=0x7f57d01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:29.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.871+0000 7f57cdd9b700 1 --2- 172.21.15.40:0/2915352984 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f57d009d400 0x7f57d01339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.871+0000 7f57cdd9b700 1 -- 172.21.15.40:0/2915352984 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57d0138250 msgr2=0x7f57d01349e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:29.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.871+0000 7f57cdd9b700 1 --2- 172.21.15.40:0/2915352984 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57d0138250 0x7f57d01349e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.871+0000 7f57cdd9b700 1 -- 172.21.15.40:0/2915352984 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c4009550 con 0x7f57d009dd50 2023-09-30T22:29:29.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.871+0000 7f57ced9d700 1 --2- 172.21.15.40:0/2915352984 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57d0138250 0x7f57d01349e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:29.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.871+0000 7f57cdd9b700 1 --2- 172.21.15.40:0/2915352984 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57d009dd50 0x7f57d0133f30 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f57c4016000 tx=0x7f57c4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:29.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.871+0000 7f57beffd700 1 -- 172.21.15.40:0/2915352984 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c4004450 con 0x7f57d009dd50 2023-09-30T22:29:29.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.871+0000 7f57d4d5c700 1 -- 172.21.15.40:0/2915352984 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d009a300 con 0x7f57d009dd50 2023-09-30T22:29:29.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.871+0000 7f57d4d5c700 1 -- 172.21.15.40:0/2915352984 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d0070aa0 con 0x7f57d009dd50 2023-09-30T22:29:29.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.871+0000 7f57beffd700 1 -- 172.21.15.40:0/2915352984 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c4006d30 con 0x7f57d009dd50 2023-09-30T22:29:29.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.871+0000 7f57beffd700 1 -- 172.21.15.40:0/2915352984 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c40038a0 con 0x7f57d009dd50 2023-09-30T22:29:29.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.872+0000 7f57d4d5c700 1 -- 172.21.15.40:0/2915352984 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b40052e0 con 0x7f57d009dd50 2023-09-30T22:29:29.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.872+0000 7f57beffd700 1 -- 172.21.15.40:0/2915352984 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f57c4021020 con 0x7f57d009dd50 2023-09-30T22:29:29.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.873+0000 7f57beffd700 1 -- 172.21.15.40:0/2915352984 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f57c4040560 con 0x7f57d009dd50 2023-09-30T22:29:29.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.882+0000 7f57beffd700 1 -- 172.21.15.40:0/2915352984 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f57c401a450 con 0x7f57d009dd50 2023-09-30T22:29:29.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.903+0000 7ff44db0b700 1 Processor -- start 2023-09-30T22:29:29.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.903+0000 7ff44db0b700 1 -- start start 2023-09-30T22:29:29.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.903+0000 7ff44db0b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff448138250 0x7ff448138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:29.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.903+0000 7ff44db0b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff44809d400 0x7ff44809d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:29.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.903+0000 7ff44db0b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff44809dd50 0x7ff44813f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:29.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.903+0000 7ff44db0b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff448137e20 con 0x7ff44809dd50 2023-09-30T22:29:29.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.903+0000 7ff44db0b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff448138050 con 0x7ff448138250 2023-09-30T22:29:29.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.903+0000 7ff44db0b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff44809b010 con 0x7ff44809d400 2023-09-30T22:29:29.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.903+0000 7ff447fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff44809dd50 0x7ff44813f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:29.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.903+0000 7ff447fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff44809dd50 0x7ff44813f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56900/0 (socket says 172.21.15.40:56900) 2023-09-30T22:29:29.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.903+0000 7ff447fff700 1 -- 172.21.15.40:0/3702955848 learned_addr learned my addr 172.21.15.40:0/3702955848 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:29.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.903+0000 7ff446ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff44809d400 0x7ff44809d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:29.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.904+0000 7ff4477fe700 1 --2- 172.21.15.40:0/3702955848 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff448138250 0x7ff448138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:29.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.904+0000 7ff447fff700 1 -- 172.21.15.40:0/3702955848 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff44809d400 msgr2=0x7ff44809d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:29.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.904+0000 7ff447fff700 1 --2- 172.21.15.40:0/3702955848 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff44809d400 0x7ff44809d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.904+0000 7ff447fff700 1 -- 172.21.15.40:0/3702955848 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff448138250 msgr2=0x7ff448138620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:29.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.904+0000 7ff447fff700 1 --2- 172.21.15.40:0/3702955848 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff448138250 0x7ff448138620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.904+0000 7ff447fff700 1 -- 172.21.15.40:0/3702955848 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44809e1f0 con 0x7ff44809dd50 2023-09-30T22:29:29.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.904+0000 7ff447fff700 1 --2- 172.21.15.40:0/3702955848 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff44809dd50 0x7ff44813f150 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7ff440009e50 tx=0x7ff44000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9300fdc98029db14 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:29.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.904+0000 7ff4467fc700 1 -- 172.21.15.40:0/3702955848 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44000e070 con 0x7ff44809dd50 2023-09-30T22:29:29.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.904+0000 7ff4467fc700 1 -- 172.21.15.40:0/3702955848 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44000b910 con 0x7ff44809dd50 2023-09-30T22:29:29.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.904+0000 7ff4467fc700 1 -- 172.21.15.40:0/3702955848 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44000bcc0 con 0x7ff44809dd50 2023-09-30T22:29:29.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.905+0000 7ff44db0b700 1 -- 172.21.15.40:0/3702955848 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff44809dd50 msgr2=0x7ff44813f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:29.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.905+0000 7ff44db0b700 1 --2- 172.21.15.40:0/3702955848 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff44809dd50 0x7ff44813f150 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7ff440009e50 tx=0x7ff44000b330 comp rx=0 tx=0).stop 2023-09-30T22:29:29.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.905+0000 7ff44db0b700 1 -- 172.21.15.40:0/3702955848 shutdown_connections 2023-09-30T22:29:29.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.905+0000 7ff44db0b700 1 --2- 172.21.15.40:0/3702955848 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff44809dd50 0x7ff44813f150 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.905+0000 7ff44db0b700 1 --2- 172.21.15.40:0/3702955848 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff448138250 0x7ff448138620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.905+0000 7ff44db0b700 1 --2- 172.21.15.40:0/3702955848 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff44809d400 0x7ff44809d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.905+0000 7ff44db0b700 1 -- 172.21.15.40:0/3702955848 >> 172.21.15.40:0/3702955848 conn(0x7ff4480a2a00 msgr2=0x7ff4480a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:29.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.905+0000 7ff44db0b700 1 -- 172.21.15.40:0/3702955848 shutdown_connections 2023-09-30T22:29:29.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.905+0000 7ff44db0b700 1 -- 172.21.15.40:0/3702955848 wait complete. 2023-09-30T22:29:29.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.906+0000 7ff44db0b700 1 Processor -- start 2023-09-30T22:29:29.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.907+0000 7ff44db0b700 1 -- start start 2023-09-30T22:29:29.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.907+0000 7ff44db0b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff44809d400 0x7ff4481d53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:29.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.907+0000 7ff44db0b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff44809dd50 0x7ff4481d58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:29.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.907+0000 7ff44db0b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff448138250 0x7ff4481d5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:29.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.907+0000 7ff44db0b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44813de80 con 0x7ff44809d400 2023-09-30T22:29:29.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.907+0000 7ff44db0b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44813d200 con 0x7ff44809dd50 2023-09-30T22:29:29.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.907+0000 7ff44db0b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff448135fd0 con 0x7ff448138250 2023-09-30T22:29:29.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.908+0000 7ff447fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff448138250 0x7ff4481d5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:29.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.908+0000 7ff447fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff448138250 0x7ff4481d5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:39392/0 (socket says 172.21.15.40:39392) 2023-09-30T22:29:29.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.908+0000 7ff447fff700 1 -- 172.21.15.40:0/575402465 learned_addr learned my addr 172.21.15.40:0/575402465 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:29.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.908+0000 7ff4477fe700 1 --2- 172.21.15.40:0/575402465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff44809d400 0x7ff4481d53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:29.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.908+0000 7ff4477fe700 1 -- 172.21.15.40:0/575402465 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff448138250 msgr2=0x7ff4481d5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:29.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.908+0000 7ff4477fe700 1 --2- 172.21.15.40:0/575402465 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff448138250 0x7ff4481d5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.908+0000 7ff4477fe700 1 -- 172.21.15.40:0/575402465 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff44809dd50 msgr2=0x7ff4481d58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:29.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.908+0000 7ff4477fe700 1 --2- 172.21.15.40:0/575402465 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff44809dd50 0x7ff4481d58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:29.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.908+0000 7ff4477fe700 1 -- 172.21.15.40:0/575402465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff440009b30 con 0x7ff44809d400 2023-09-30T22:29:29.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.908+0000 7ff447fff700 1 --2- 172.21.15.40:0/575402465 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff448138250 0x7ff4481d5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:29.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.908+0000 7ff4477fe700 1 --2- 172.21.15.40:0/575402465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff44809d400 0x7ff4481d53b0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7ff43800e7e0 tx=0x7ff43800eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:29.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.909+0000 7ff42ffff700 1 -- 172.21.15.40:0/575402465 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43800c070 con 0x7ff44809d400 2023-09-30T22:29:29.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.909+0000 7ff42ffff700 1 -- 172.21.15.40:0/575402465 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff438013610 con 0x7ff44809d400 2023-09-30T22:29:29.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.909+0000 7ff42ffff700 1 -- 172.21.15.40:0/575402465 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4380139a0 con 0x7ff44809d400 2023-09-30T22:29:29.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.909+0000 7ff44db0b700 1 -- 172.21.15.40:0/575402465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff44809a300 con 0x7ff44809d400 2023-09-30T22:29:29.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.909+0000 7ff44db0b700 1 -- 172.21.15.40:0/575402465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff448119880 con 0x7ff44809d400 2023-09-30T22:29:29.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.910+0000 7ff42ffff700 1 -- 172.21.15.40:0/575402465 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff438013b00 con 0x7ff44809d400 2023-09-30T22:29:29.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.910+0000 7ff42ffff700 1 -- 172.21.15.40:0/575402465 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff43803f3a0 con 0x7ff44809d400 2023-09-30T22:29:29.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.910+0000 7ff44db0b700 1 -- 172.21.15.40:0/575402465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff448062380 con 0x7ff44809d400 2023-09-30T22:29:29.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:29.920+0000 7ff42ffff700 1 -- 172.21.15.40:0/575402465 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff438010900 con 0x7ff44809d400 2023-09-30T22:29:30.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.034+0000 7f0ff8553700 1 -- 172.21.15.40:0/2481691960 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0ff011b6a0 con 0x7f0ff0133e00 2023-09-30T22:29:30.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.034+0000 7f0fe6ffd700 1 -- 172.21.15.40:0/2481691960 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0fe800cb80 con 0x7f0ff0133e00 2023-09-30T22:29:30.035 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:30.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.036+0000 7f0ff8553700 1 -- 172.21.15.40:0/2481691960 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ff0133e00 msgr2=0x7f0ff0119ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:30.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.036+0000 7f0ff8553700 1 --2- 172.21.15.40:0/2481691960 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ff0133e00 0x7f0ff0119ad0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8009d60 tx=0x7f0fe800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:29:30.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.036+0000 7f0ff8553700 1 -- 172.21.15.40:0/2481691960 shutdown_connections 2023-09-30T22:29:30.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.036+0000 7f0ff8553700 1 --2- 172.21.15.40:0/2481691960 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ff0133e00 0x7f0ff0119ad0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:30.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.036+0000 7f0ff8553700 1 --2- 172.21.15.40:0/2481691960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ff009d400 0x7f0ff0119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:30.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.036+0000 7f0ff8553700 1 --2- 172.21.15.40:0/2481691960 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ff009df40 0x7f0ff0119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:30.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.036+0000 7f0ff8553700 1 -- 172.21.15.40:0/2481691960 >> 172.21.15.40:0/2481691960 conn(0x7f0ff00a2a00 msgr2=0x7f0ff012d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:30.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.036+0000 7f0ff8553700 1 -- 172.21.15.40:0/2481691960 shutdown_connections 2023-09-30T22:29:30.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.036+0000 7f0ff8553700 1 -- 172.21.15.40:0/2481691960 wait complete. 2023-09-30T22:29:30.049 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:30.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.065+0000 7fc813f97700 1 -- 172.21.15.40:0/3212270334 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc80c062380 con 0x7fc80c09d400 2023-09-30T22:29:30.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.065+0000 7fc8027fc700 1 -- 172.21.15.40:0/3212270334 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc80802b070 con 0x7fc80c09d400 2023-09-30T22:29:30.066 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:30.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.068+0000 7fc813f97700 1 -- 172.21.15.40:0/3212270334 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc80c09d400 msgr2=0x7fc80c1228b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:30.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.068+0000 7fc813f97700 1 --2- 172.21.15.40:0/3212270334 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc80c09d400 0x7fc80c1228b0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fc808000c00 tx=0x7fc808004750 comp rx=0 tx=0).stop 2023-09-30T22:29:30.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.068+0000 7fc813f97700 1 -- 172.21.15.40:0/3212270334 shutdown_connections 2023-09-30T22:29:30.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.068+0000 7fc813f97700 1 --2- 172.21.15.40:0/3212270334 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc80c138250 0x7fc80c123330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:30.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.068+0000 7fc813f97700 1 --2- 172.21.15.40:0/3212270334 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc80c09d400 0x7fc80c1228b0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:30.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.068+0000 7fc813f97700 1 --2- 172.21.15.40:0/3212270334 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc80c09df20 0x7fc80c122df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:30.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.068+0000 7fc813f97700 1 -- 172.21.15.40:0/3212270334 >> 172.21.15.40:0/3212270334 conn(0x7fc80c0a2a00 msgr2=0x7fc80c1bf580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:30.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.068+0000 7fc813f97700 1 -- 172.21.15.40:0/3212270334 shutdown_connections 2023-09-30T22:29:30.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.068+0000 7fc813f97700 1 -- 172.21.15.40:0/3212270334 wait complete. 2023-09-30T22:29:30.081 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:30.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.094+0000 7f57d4d5c700 1 -- 172.21.15.40:0/2915352984 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f57b4005150 con 0x7f57d009dd50 2023-09-30T22:29:30.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.094+0000 7f57beffd700 1 -- 172.21.15.40:0/2915352984 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f57c400b420 con 0x7f57d009dd50 2023-09-30T22:29:30.095 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:30.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.096+0000 7f57d4d5c700 1 -- 172.21.15.40:0/2915352984 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57d009dd50 msgr2=0x7f57d0133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:30.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.096+0000 7f57d4d5c700 1 --2- 172.21.15.40:0/2915352984 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57d009dd50 0x7f57d0133f30 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f57c4016000 tx=0x7f57c4004750 comp rx=0 tx=0).stop 2023-09-30T22:29:30.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.096+0000 7f57d4d5c700 1 -- 172.21.15.40:0/2915352984 shutdown_connections 2023-09-30T22:29:30.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.096+0000 7f57d4d5c700 1 --2- 172.21.15.40:0/2915352984 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f57d009d400 0x7f57d01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:30.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.096+0000 7f57d4d5c700 1 --2- 172.21.15.40:0/2915352984 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57d0138250 0x7f57d01349e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:30.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.096+0000 7f57d4d5c700 1 --2- 172.21.15.40:0/2915352984 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57d009dd50 0x7f57d0133f30 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:30.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.096+0000 7f57d4d5c700 1 -- 172.21.15.40:0/2915352984 >> 172.21.15.40:0/2915352984 conn(0x7f57d00a2a00 msgr2=0x7f57d009f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:30.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.096+0000 7f57d4d5c700 1 -- 172.21.15.40:0/2915352984 shutdown_connections 2023-09-30T22:29:30.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.096+0000 7f57d4d5c700 1 -- 172.21.15.40:0/2915352984 wait complete. 2023-09-30T22:29:30.110 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:30.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.129+0000 7ff44db0b700 1 -- 172.21.15.40:0/575402465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff44809abb0 con 0x7ff44809d400 2023-09-30T22:29:30.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.129+0000 7ff42ffff700 1 -- 172.21.15.40:0/575402465 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff43802b090 con 0x7ff44809d400 2023-09-30T22:29:30.130 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:30.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.131+0000 7ff44db0b700 1 -- 172.21.15.40:0/575402465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff44809d400 msgr2=0x7ff4481d53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:30.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.131+0000 7ff44db0b700 1 --2- 172.21.15.40:0/575402465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff44809d400 0x7ff4481d53b0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7ff43800e7e0 tx=0x7ff43800eaf0 comp rx=0 tx=0).stop 2023-09-30T22:29:30.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.131+0000 7ff44db0b700 1 -- 172.21.15.40:0/575402465 shutdown_connections 2023-09-30T22:29:30.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.131+0000 7ff44db0b700 1 --2- 172.21.15.40:0/575402465 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff448138250 0x7ff4481d5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:30.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.131+0000 7ff44db0b700 1 --2- 172.21.15.40:0/575402465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff44809d400 0x7ff4481d53b0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:30.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.131+0000 7ff44db0b700 1 --2- 172.21.15.40:0/575402465 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff44809dd50 0x7ff4481d58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:30.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.132+0000 7ff44db0b700 1 -- 172.21.15.40:0/575402465 >> 172.21.15.40:0/575402465 conn(0x7ff4480a2a00 msgr2=0x7ff4480a1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:30.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.132+0000 7ff44db0b700 1 -- 172.21.15.40:0/575402465 shutdown_connections 2023-09-30T22:29:30.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:30.132+0000 7ff44db0b700 1 -- 172.21.15.40:0/575402465 wait complete. 2023-09-30T22:29:30.144 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:31.051 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:31.082 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:31.111 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:31.145 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:31.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.203+0000 7f0c913fa700 1 Processor -- start 2023-09-30T22:29:31.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.203+0000 7f0c913fa700 1 -- start start 2023-09-30T22:29:31.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.204+0000 7f0c913fa700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0c8c12e590 0x7f0c8c12e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:31.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.204+0000 7f0c913fa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0c8c12eea0 0x7f0c8c12d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:31.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.204+0000 7f0c913fa700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0c8c12d6d0 0x7f0c8c12db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:31.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.204+0000 7f0c913fa700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c8c09ca30 con 0x7f0c8c12e590 2023-09-30T22:29:31.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.204+0000 7f0c913fa700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c09ab70 con 0x7f0c8c12eea0 2023-09-30T22:29:31.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.204+0000 7f0c913fa700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c09bd70 con 0x7f0c8c12d6d0 2023-09-30T22:29:31.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.204+0000 7f0c8affd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0c8c12e590 0x7f0c8c12e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:31.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.205+0000 7f0c8a7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0c8c12eea0 0x7f0c8c12d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:31.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.205+0000 7f0c8a7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0c8c12eea0 0x7f0c8c12d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:34926/0 (socket says 172.21.15.40:34926) 2023-09-30T22:29:31.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.205+0000 7f0c8affd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0c8c12e590 0x7f0c8c12e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56914/0 (socket says 172.21.15.40:56914) 2023-09-30T22:29:31.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.205+0000 7f0c8a7fc700 1 -- 172.21.15.40:0/4201373789 learned_addr learned my addr 172.21.15.40:0/4201373789 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:31.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.205+0000 7f0c8b7fe700 1 --2- 172.21.15.40:0/4201373789 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0c8c12d6d0 0x7f0c8c12db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:31.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.205+0000 7f0c8affd700 1 -- 172.21.15.40:0/4201373789 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0c8c12d6d0 msgr2=0x7f0c8c12db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:31.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.205+0000 7f0c8affd700 1 --2- 172.21.15.40:0/4201373789 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0c8c12d6d0 0x7f0c8c12db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.205+0000 7f0c8affd700 1 -- 172.21.15.40:0/4201373789 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0c8c12eea0 msgr2=0x7f0c8c12d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:31.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.205+0000 7f0c8affd700 1 --2- 172.21.15.40:0/4201373789 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0c8c12eea0 0x7f0c8c12d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.205+0000 7f0c8affd700 1 -- 172.21.15.40:0/4201373789 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c8c09b270 con 0x7f0c8c12e590 2023-09-30T22:29:31.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.205+0000 7f0c8b7fe700 1 --2- 172.21.15.40:0/4201373789 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0c8c12d6d0 0x7f0c8c12db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:31.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.205+0000 7f0c8affd700 1 --2- 172.21.15.40:0/4201373789 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c8c12e590 0x7f0c8c12e960 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c009840 tx=0x7f0c7c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dd2975ee257cbe4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:31.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.206+0000 7f0c89ffb700 1 -- 172.21.15.40:0/4201373789 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c011830 con 0x7f0c8c12e590 2023-09-30T22:29:31.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.206+0000 7f0c89ffb700 1 -- 172.21.15.40:0/4201373789 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7c011990 con 0x7f0c8c12e590 2023-09-30T22:29:31.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.206+0000 7f0c89ffb700 1 -- 172.21.15.40:0/4201373789 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c011d20 con 0x7f0c8c12e590 2023-09-30T22:29:31.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.207+0000 7f0c913fa700 1 -- 172.21.15.40:0/4201373789 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c8c12e590 msgr2=0x7f0c8c12e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:31.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.207+0000 7f0c913fa700 1 --2- 172.21.15.40:0/4201373789 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c8c12e590 0x7f0c8c12e960 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c009840 tx=0x7f0c7c009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:31.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.207+0000 7f0c913fa700 1 -- 172.21.15.40:0/4201373789 shutdown_connections 2023-09-30T22:29:31.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.207+0000 7f0c913fa700 1 --2- 172.21.15.40:0/4201373789 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0c8c12d6d0 0x7f0c8c12db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.207+0000 7f0c913fa700 1 --2- 172.21.15.40:0/4201373789 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c8c12e590 0x7f0c8c12e960 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.207+0000 7f0c913fa700 1 --2- 172.21.15.40:0/4201373789 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0c8c12eea0 0x7f0c8c12d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.207+0000 7f0c913fa700 1 -- 172.21.15.40:0/4201373789 >> 172.21.15.40:0/4201373789 conn(0x7f0c8c0a2a00 msgr2=0x7f0c8c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:31.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.207+0000 7f0c913fa700 1 -- 172.21.15.40:0/4201373789 shutdown_connections 2023-09-30T22:29:31.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.207+0000 7f0c913fa700 1 -- 172.21.15.40:0/4201373789 wait complete. 2023-09-30T22:29:31.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.208+0000 7f0c913fa700 1 Processor -- start 2023-09-30T22:29:31.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.208+0000 7f0c913fa700 1 -- start start 2023-09-30T22:29:31.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.209+0000 7f0c913fa700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c8c12d6d0 0x7f0c8c1c2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:31.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.209+0000 7f0c913fa700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0c8c12e590 0x7f0c8c1c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:31.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.209+0000 7f0c913fa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0c8c12eea0 0x7f0c8c1c6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:31.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.209+0000 7f0c913fa700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c136e50 con 0x7f0c8c12d6d0 2023-09-30T22:29:31.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.209+0000 7f0c913fa700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c137030 con 0x7f0c8c12eea0 2023-09-30T22:29:31.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.209+0000 7f0c913fa700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c136a90 con 0x7f0c8c12e590 2023-09-30T22:29:31.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.209+0000 7f0c8b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0c8c12eea0 0x7f0c8c1c6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:31.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.209+0000 7f0c8a7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0c8c12e590 0x7f0c8c1c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:31.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.209+0000 7f0c8b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0c8c12eea0 0x7f0c8c1c6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:34936/0 (socket says 172.21.15.40:34936) 2023-09-30T22:29:31.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.209+0000 7f0c8b7fe700 1 -- 172.21.15.40:0/450703761 learned_addr learned my addr 172.21.15.40:0/450703761 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:31.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.209+0000 7f0c8a7fc700 1 --2- 172.21.15.40:0/450703761 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0c8c12e590 0x7f0c8c1c34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:39408/0 (socket says 172.21.15.40:39408) 2023-09-30T22:29:31.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.209+0000 7f0c8a7fc700 1 -- 172.21.15.40:0/450703761 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0c8c12eea0 msgr2=0x7f0c8c1c6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:31.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.209+0000 7f0c8a7fc700 1 --2- 172.21.15.40:0/450703761 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0c8c12eea0 0x7f0c8c1c6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.210+0000 7f0c8a7fc700 1 -- 172.21.15.40:0/450703761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c8c12d6d0 msgr2=0x7f0c8c1c2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:31.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.210+0000 7f0c8a7fc700 1 --2- 172.21.15.40:0/450703761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c8c12d6d0 0x7f0c8c1c2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.210+0000 7f0c8a7fc700 1 -- 172.21.15.40:0/450703761 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c7c0094a0 con 0x7f0c8c12e590 2023-09-30T22:29:31.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.210+0000 7f0c8b7fe700 1 --2- 172.21.15.40:0/450703761 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0c8c12eea0 0x7f0c8c1c6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:31.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.210+0000 7f0c8a7fc700 1 --2- 172.21.15.40:0/450703761 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0c8c12e590 0x7f0c8c1c34c0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0c8000e8e0 tx=0x7f0c8000ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:31.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.210+0000 7f0c737fe700 1 -- 172.21.15.40:0/450703761 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8000c690 con 0x7f0c8c12e590 2023-09-30T22:29:31.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.210+0000 7f0c737fe700 1 -- 172.21.15.40:0/450703761 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8000c7f0 con 0x7f0c8c12e590 2023-09-30T22:29:31.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.210+0000 7f0c913fa700 1 -- 172.21.15.40:0/450703761 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c8c09b4b0 con 0x7f0c8c12e590 2023-09-30T22:29:31.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.210+0000 7f0c737fe700 1 -- 172.21.15.40:0/450703761 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8000cb80 con 0x7f0c8c12e590 2023-09-30T22:29:31.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.210+0000 7f0c913fa700 1 -- 172.21.15.40:0/450703761 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c8c136370 con 0x7f0c8c12e590 2023-09-30T22:29:31.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.211+0000 7f0c737fe700 1 -- 172.21.15.40:0/450703761 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0c8000cce0 con 0x7f0c8c12e590 2023-09-30T22:29:31.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.211+0000 7f0c737fe700 1 -- 172.21.15.40:0/450703761 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f0c8003f700 con 0x7f0c8c12e590 2023-09-30T22:29:31.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.212+0000 7f0c913fa700 1 -- 172.21.15.40:0/450703761 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c8c1190b0 con 0x7f0c8c12e590 2023-09-30T22:29:31.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.221+0000 7f0c737fe700 1 -- 172.21.15.40:0/450703761 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0c800232f0 con 0x7f0c8c12e590 2023-09-30T22:29:31.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.237+0000 7f4c1b3b7700 1 Processor -- start 2023-09-30T22:29:31.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.237+0000 7f4c1b3b7700 1 -- start start 2023-09-30T22:29:31.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.238+0000 7f4c1b3b7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4c1406f070 0x7f4c1406f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:31.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.238+0000 7f4c1b3b7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c1406f980 0x7f4c14097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:31.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.238+0000 7f4c1b3b7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c14070830 con 0x7f4c1406fdb0 2023-09-30T22:29:31.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.238+0000 7f4c1b3b7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c14071af0 con 0x7f4c1406f070 2023-09-30T22:29:31.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.238+0000 7f4c1b3b7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c14070ad0 con 0x7f4c1406f980 2023-09-30T22:29:31.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.238+0000 7f4c19153700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4c1406f070 0x7f4c1406f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:31.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.238+0000 7f4c19153700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4c1406f070 0x7f4c1406f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56932/0 (socket says 172.21.15.40:56932) 2023-09-30T22:29:31.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.238+0000 7f4c19153700 1 -- 172.21.15.40:0/1371695309 learned_addr learned my addr 172.21.15.40:0/1371695309 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:31.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.238+0000 7f4c18952700 1 --2- 172.21.15.40:0/1371695309 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c1406f980 0x7f4c14097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:31.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.238+0000 7f4c19153700 1 -- 172.21.15.40:0/1371695309 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c1406f980 msgr2=0x7f4c14097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:31.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.238+0000 7f4c19153700 1 --2- 172.21.15.40:0/1371695309 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c1406f980 0x7f4c14097090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.238+0000 7f4c19153700 1 -- 172.21.15.40:0/1371695309 >> v1:172.21.15.40:6789/0 conn(0x7f4c1406fdb0 legacy=0x7f4c140975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:31.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.238+0000 7f4c19153700 1 -- 172.21.15.40:0/1371695309 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c14070de0 con 0x7f4c1406f070 2023-09-30T22:29:31.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.238+0000 7f4c18952700 1 --2- 172.21.15.40:0/1371695309 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c1406f980 0x7f4c14097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:31.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.239+0000 7f4c19153700 1 --2- 172.21.15.40:0/1371695309 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c1406f070 0x7f4c1406f440 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f4c100098f0 tx=0x7f4c10009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=177491076de91c61 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:31.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.239+0000 7f4c0bfff700 1 -- 172.21.15.40:0/1371695309 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c10011830 con 0x7f4c1406f070 2023-09-30T22:29:31.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.239+0000 7f4c0bfff700 1 -- 172.21.15.40:0/1371695309 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c10011990 con 0x7f4c1406f070 2023-09-30T22:29:31.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.239+0000 7f4c0bfff700 1 -- 172.21.15.40:0/1371695309 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c10011d20 con 0x7f4c1406f070 2023-09-30T22:29:31.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.239+0000 7f4c1b3b7700 1 -- 172.21.15.40:0/1371695309 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c1406f070 msgr2=0x7f4c1406f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:31.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.239+0000 7f4c1b3b7700 1 --2- 172.21.15.40:0/1371695309 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c1406f070 0x7f4c1406f440 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f4c100098f0 tx=0x7f4c10009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:31.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.239+0000 7f4c1b3b7700 1 -- 172.21.15.40:0/1371695309 shutdown_connections 2023-09-30T22:29:31.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.239+0000 7f4c1b3b7700 1 --2- 172.21.15.40:0/1371695309 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c1406f070 0x7f4c1406f440 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.239+0000 7f4c1b3b7700 1 --2- 172.21.15.40:0/1371695309 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c1406f980 0x7f4c14097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.239+0000 7f4c1b3b7700 1 -- 172.21.15.40:0/1371695309 >> 172.21.15.40:0/1371695309 conn(0x7f4c140a41a0 msgr2=0x7f4c140a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:31.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.240+0000 7f4c1b3b7700 1 -- 172.21.15.40:0/1371695309 shutdown_connections 2023-09-30T22:29:31.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.240+0000 7f4c1b3b7700 1 -- 172.21.15.40:0/1371695309 wait complete. 2023-09-30T22:29:31.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.241+0000 7f4c1b3b7700 1 Processor -- start 2023-09-30T22:29:31.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.241+0000 7f4c1b3b7700 1 -- start start 2023-09-30T22:29:31.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.241+0000 7f4c1b3b7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c1406f070 0x7f4c1406c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:31.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.241+0000 7f4c1b3b7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c1406f980 0x7f4c1406ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:31.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.241+0000 7f4c1b3b7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c1406fdb0 0x7f4c1406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:31.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.241+0000 7f4c1b3b7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1406e9d0 con 0x7f4c1406fdb0 2023-09-30T22:29:31.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.242+0000 7f4c1b3b7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1408c060 con 0x7f4c1406f070 2023-09-30T22:29:31.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.242+0000 7f4c1b3b7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c14132090 con 0x7f4c1406f980 2023-09-30T22:29:31.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.242+0000 7f4c19153700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c1406f070 0x7f4c1406c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:31.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.242+0000 7f4c19153700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c1406f070 0x7f4c1406c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:34946/0 (socket says 172.21.15.40:34946) 2023-09-30T22:29:31.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.242+0000 7f4c19153700 1 -- 172.21.15.40:0/332334560 learned_addr learned my addr 172.21.15.40:0/332334560 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:31.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.242+0000 7f4c19954700 1 --2- 172.21.15.40:0/332334560 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c1406fdb0 0x7f4c1406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:31.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.242+0000 7f4c19153700 1 -- 172.21.15.40:0/332334560 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c1406f980 msgr2=0x7f4c1406ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:31.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.242+0000 7f4c19153700 1 --2- 172.21.15.40:0/332334560 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c1406f980 0x7f4c1406ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.242+0000 7f4c19153700 1 -- 172.21.15.40:0/332334560 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c1406fdb0 msgr2=0x7f4c1406d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:31.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.242+0000 7f4c19153700 1 --2- 172.21.15.40:0/332334560 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c1406fdb0 0x7f4c1406d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.242+0000 7f4c19153700 1 -- 172.21.15.40:0/332334560 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c040094a0 con 0x7f4c1406f070 2023-09-30T22:29:31.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.242+0000 7f4c19153700 1 --2- 172.21.15.40:0/332334560 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c1406f070 0x7f4c1406c990 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f4c10009c40 tx=0x7f4c10004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:31.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.242+0000 7f4c09ffb700 1 -- 172.21.15.40:0/332334560 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c10004400 con 0x7f4c1406f070 2023-09-30T22:29:31.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.242+0000 7f4c09ffb700 1 -- 172.21.15.40:0/332334560 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1001f070 con 0x7f4c1406f070 2023-09-30T22:29:31.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.242+0000 7f4c1b3b7700 1 -- 172.21.15.40:0/332334560 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c10009550 con 0x7f4c1406f070 2023-09-30T22:29:31.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.242+0000 7f4c09ffb700 1 -- 172.21.15.40:0/332334560 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c100038e0 con 0x7f4c1406f070 2023-09-30T22:29:31.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.243+0000 7f4c1b3b7700 1 -- 172.21.15.40:0/332334560 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c14129530 con 0x7f4c1406f070 2023-09-30T22:29:31.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.244+0000 7f4c09ffb700 1 -- 172.21.15.40:0/332334560 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4c10021030 con 0x7f4c1406f070 2023-09-30T22:29:31.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.244+0000 7f4c1b3b7700 1 -- 172.21.15.40:0/332334560 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c14062380 con 0x7f4c1406f070 2023-09-30T22:29:31.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.244+0000 7f4c09ffb700 1 -- 172.21.15.40:0/332334560 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4c10040a90 con 0x7f4c1406f070 2023-09-30T22:29:31.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.252+0000 7f4c09ffb700 1 -- 172.21.15.40:0/332334560 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4c100199a0 con 0x7f4c1406f070 2023-09-30T22:29:31.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.314+0000 7f6c089af700 1 Processor -- start 2023-09-30T22:29:31.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.314+0000 7f6c089af700 1 -- start start 2023-09-30T22:29:31.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.315+0000 7f6c089af700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6c04133e00 0x7f6c041341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:31.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.315+0000 7f6c089af700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c0409df70 0x7f6c0413bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:31.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.315+0000 7f6c089af700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c04133940 con 0x7f6c0409d400 2023-09-30T22:29:31.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.315+0000 7f6c089af700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c0409ab20 con 0x7f6c04133e00 2023-09-30T22:29:31.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.315+0000 7f6c089af700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0409f0d0 con 0x7f6c0409df70 2023-09-30T22:29:31.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.315+0000 7f6c0259c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6c04133e00 0x7f6c041341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:31.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.315+0000 7f6c0259c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6c04133e00 0x7f6c041341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56950/0 (socket says 172.21.15.40:56950) 2023-09-30T22:29:31.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.315+0000 7f6c0259c700 1 -- 172.21.15.40:0/3673976979 learned_addr learned my addr 172.21.15.40:0/3673976979 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:31.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.315+0000 7f6c02d9d700 1 --2- 172.21.15.40:0/3673976979 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c0409df70 0x7f6c0413bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:31.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.315+0000 7f6c0259c700 1 -- 172.21.15.40:0/3673976979 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c0409df70 msgr2=0x7f6c0413bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:31.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.315+0000 7f6c0259c700 1 --2- 172.21.15.40:0/3673976979 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c0409df70 0x7f6c0413bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.315+0000 7f6c0259c700 1 -- 172.21.15.40:0/3673976979 >> v1:172.21.15.40:6789/0 conn(0x7f6c0409d400 legacy=0x7f6c0409d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:31.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.315+0000 7f6c0259c700 1 -- 172.21.15.40:0/3673976979 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c04133be0 con 0x7f6c04133e00 2023-09-30T22:29:31.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.316+0000 7f6c0259c700 1 --2- 172.21.15.40:0/3673976979 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c04133e00 0x7f6c041341d0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40098f0 tx=0x7f6bf4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1c0003a81a0b384 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:31.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.316+0000 7f6c0159a700 1 -- 172.21.15.40:0/3673976979 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf4011830 con 0x7f6c04133e00 2023-09-30T22:29:31.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.316+0000 7f6c0159a700 1 -- 172.21.15.40:0/3673976979 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf4011990 con 0x7f6c04133e00 2023-09-30T22:29:31.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.316+0000 7f6c0159a700 1 -- 172.21.15.40:0/3673976979 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf4011d20 con 0x7f6c04133e00 2023-09-30T22:29:31.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.316+0000 7f6c089af700 1 -- 172.21.15.40:0/3673976979 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c04133e00 msgr2=0x7f6c041341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:31.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.316+0000 7f6c089af700 1 --2- 172.21.15.40:0/3673976979 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c04133e00 0x7f6c041341d0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40098f0 tx=0x7f6bf4009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:31.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.317+0000 7f6c089af700 1 -- 172.21.15.40:0/3673976979 shutdown_connections 2023-09-30T22:29:31.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.317+0000 7f6c089af700 1 --2- 172.21.15.40:0/3673976979 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c0409df70 0x7f6c0413bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.317+0000 7f6c089af700 1 --2- 172.21.15.40:0/3673976979 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c04133e00 0x7f6c041341d0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.317+0000 7f6c089af700 1 -- 172.21.15.40:0/3673976979 >> 172.21.15.40:0/3673976979 conn(0x7f6c040a2a00 msgr2=0x7f6c040a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:31.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.317+0000 7f6c089af700 1 -- 172.21.15.40:0/3673976979 shutdown_connections 2023-09-30T22:29:31.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.317+0000 7f6c089af700 1 -- 172.21.15.40:0/3673976979 wait complete. 2023-09-30T22:29:31.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.318+0000 7f6c089af700 1 Processor -- start 2023-09-30T22:29:31.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.318+0000 7f6c089af700 1 -- start start 2023-09-30T22:29:31.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.319+0000 7f6c089af700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c0409d400 0x7f6c04119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:31.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.319+0000 7f6c089af700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c0409df70 0x7f6c04119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:31.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.319+0000 7f6c089af700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c04133e00 0x7f6c04119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:31.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.319+0000 7f6c089af700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0411c500 con 0x7f6c04133e00 2023-09-30T22:29:31.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.319+0000 7f6c089af700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0411a590 con 0x7f6c0409d400 2023-09-30T22:29:31.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.319+0000 7f6c089af700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0411be60 con 0x7f6c0409df70 2023-09-30T22:29:31.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.319+0000 7f6c0259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c0409d400 0x7f6c04119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:31.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.319+0000 7f6c0259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c0409d400 0x7f6c04119050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:34974/0 (socket says 172.21.15.40:34974) 2023-09-30T22:29:31.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.319+0000 7f6c0259c700 1 -- 172.21.15.40:0/4052658038 learned_addr learned my addr 172.21.15.40:0/4052658038 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:31.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.319+0000 7f6c01d9b700 1 --2- 172.21.15.40:0/4052658038 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c0409df70 0x7f6c04119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:31.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.319+0000 7f6c02d9d700 1 --2- 172.21.15.40:0/4052658038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c04133e00 0x7f6c04119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:31.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.319+0000 7f6c0259c700 1 -- 172.21.15.40:0/4052658038 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c0409df70 msgr2=0x7f6c04119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:31.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.319+0000 7f6c0259c700 1 --2- 172.21.15.40:0/4052658038 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c0409df70 0x7f6c04119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.319+0000 7f6c0259c700 1 -- 172.21.15.40:0/4052658038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c04133e00 msgr2=0x7f6c04119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:31.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.319+0000 7f6c0259c700 1 --2- 172.21.15.40:0/4052658038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c04133e00 0x7f6c04119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.319+0000 7f6c0259c700 1 -- 172.21.15.40:0/4052658038 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf4009550 con 0x7f6c0409d400 2023-09-30T22:29:31.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.319+0000 7f6c02d9d700 1 --2- 172.21.15.40:0/4052658038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c04133e00 0x7f6c04119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:31.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.320+0000 7f6c0259c700 1 --2- 172.21.15.40:0/4052658038 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c0409d400 0x7f6c04119050 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4000c00 tx=0x7f6bf4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:31.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.320+0000 7f6bf2ffd700 1 -- 172.21.15.40:0/4052658038 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf40036a0 con 0x7f6c0409d400 2023-09-30T22:29:31.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.320+0000 7f6bf2ffd700 1 -- 172.21.15.40:0/4052658038 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf4003800 con 0x7f6c0409d400 2023-09-30T22:29:31.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.320+0000 7f6c089af700 1 -- 172.21.15.40:0/4052658038 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c0411b230 con 0x7f6c0409d400 2023-09-30T22:29:31.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.320+0000 7f6bf2ffd700 1 -- 172.21.15.40:0/4052658038 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf4003bd0 con 0x7f6c0409d400 2023-09-30T22:29:31.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.320+0000 7f6c089af700 1 -- 172.21.15.40:0/4052658038 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c0412e150 con 0x7f6c0409d400 2023-09-30T22:29:31.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.322+0000 7f6c089af700 1 -- 172.21.15.40:0/4052658038 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c04062380 con 0x7f6c0409d400 2023-09-30T22:29:31.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.323+0000 7f6bf2ffd700 1 -- 172.21.15.40:0/4052658038 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6bf4021070 con 0x7f6c0409d400 2023-09-30T22:29:31.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.323+0000 7f6bf2ffd700 1 -- 172.21.15.40:0/4052658038 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6bf4040ed0 con 0x7f6c0409d400 2023-09-30T22:29:31.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.325+0000 7f1c24a7e700 1 Processor -- start 2023-09-30T22:29:31.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.325+0000 7f1c24a7e700 1 -- start start 2023-09-30T22:29:31.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.326+0000 7f1c24a7e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c2009d920 0x7f1c2009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:31.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.326+0000 7f1c24a7e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1c20130fb0 0x7f1c20138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:31.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.326+0000 7f1c24a7e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c2009adf0 con 0x7f1c2009e230 2023-09-30T22:29:31.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.326+0000 7f1c24a7e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c2009edf0 con 0x7f1c20130fb0 2023-09-30T22:29:31.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.326+0000 7f1c24a7e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2009b660 con 0x7f1c2009d920 2023-09-30T22:29:31.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.326+0000 7f1c1ed9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1c20130fb0 0x7f1c20138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:31.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.326+0000 7f1c1ed9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1c20130fb0 0x7f1c20138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56974/0 (socket says 172.21.15.40:56974) 2023-09-30T22:29:31.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.326+0000 7f1c1ed9d700 1 -- 172.21.15.40:0/163989800 learned_addr learned my addr 172.21.15.40:0/163989800 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:31.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.327+0000 7f1c1ed9d700 1 -- 172.21.15.40:0/163989800 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c2009d920 msgr2=0x7f1c2009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:31.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.327+0000 7f1c1ed9d700 1 --2- 172.21.15.40:0/163989800 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c2009d920 0x7f1c2009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.327+0000 7f1c1ed9d700 1 -- 172.21.15.40:0/163989800 >> v1:172.21.15.40:6789/0 conn(0x7f1c2009e230 legacy=0x7f1c201308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:31.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.327+0000 7f1c1ed9d700 1 -- 172.21.15.40:0/163989800 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2009a6e0 con 0x7f1c20130fb0 2023-09-30T22:29:31.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.327+0000 7f1c1ed9d700 1 --2- 172.21.15.40:0/163989800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c20130fb0 0x7f1c20138d10 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f1c18009e50 tx=0x7f1c1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6cb7f3378edeeac server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:31.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.327+0000 7f1c1d59a700 1 -- 172.21.15.40:0/163989800 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1800e070 con 0x7f1c20130fb0 2023-09-30T22:29:31.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.327+0000 7f1c1d59a700 1 -- 172.21.15.40:0/163989800 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1800b9c0 con 0x7f1c20130fb0 2023-09-30T22:29:31.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.327+0000 7f1c1d59a700 1 -- 172.21.15.40:0/163989800 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1800bd70 con 0x7f1c20130fb0 2023-09-30T22:29:31.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.328+0000 7f1c24a7e700 1 -- 172.21.15.40:0/163989800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c20130fb0 msgr2=0x7f1c20138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:31.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.328+0000 7f1c24a7e700 1 --2- 172.21.15.40:0/163989800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c20130fb0 0x7f1c20138d10 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f1c18009e50 tx=0x7f1c1800b330 comp rx=0 tx=0).stop 2023-09-30T22:29:31.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.328+0000 7f1c24a7e700 1 -- 172.21.15.40:0/163989800 shutdown_connections 2023-09-30T22:29:31.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.328+0000 7f1c24a7e700 1 --2- 172.21.15.40:0/163989800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c20130fb0 0x7f1c20138d10 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.328+0000 7f1c24a7e700 1 --2- 172.21.15.40:0/163989800 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c2009d920 0x7f1c2009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.328+0000 7f1c24a7e700 1 -- 172.21.15.40:0/163989800 >> 172.21.15.40:0/163989800 conn(0x7f1c2009fb20 msgr2=0x7f1c2009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:31.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.328+0000 7f1c24a7e700 1 -- 172.21.15.40:0/163989800 shutdown_connections 2023-09-30T22:29:31.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.328+0000 7f1c24a7e700 1 -- 172.21.15.40:0/163989800 wait complete. 2023-09-30T22:29:31.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.329+0000 7f1c24a7e700 1 Processor -- start 2023-09-30T22:29:31.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.329+0000 7f1c24a7e700 1 -- start start 2023-09-30T22:29:31.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.330+0000 7f1c24a7e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c2009d920 0x7f1c20124ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:31.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.330+0000 7f1c24a7e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c2009e230 0x7f1c201250e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:31.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.330+0000 7f1c24a7e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c20130fb0 0x7f1c20129ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:31.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.330+0000 7f1c24a7e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2012e660 con 0x7f1c2009e230 2023-09-30T22:29:31.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.330+0000 7f1c24a7e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2012d830 con 0x7f1c20130fb0 2023-09-30T22:29:31.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.330+0000 7f1c24a7e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c20125620 con 0x7f1c2009d920 2023-09-30T22:29:31.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.330+0000 7f1c1e59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c2009d920 0x7f1c20124ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:31.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.330+0000 7f1c1e59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c2009d920 0x7f1c20124ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:39440/0 (socket says 172.21.15.40:39440) 2023-09-30T22:29:31.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.330+0000 7f1c1e59c700 1 -- 172.21.15.40:0/283611997 learned_addr learned my addr 172.21.15.40:0/283611997 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:31.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.330+0000 7f1c1dd9b700 1 --2- 172.21.15.40:0/283611997 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c2009e230 0x7f1c201250e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:31.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.330+0000 7f1c1ed9d700 1 --2- 172.21.15.40:0/283611997 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c20130fb0 0x7f1c20129ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:31.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.330+0000 7f1c1e59c700 1 -- 172.21.15.40:0/283611997 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c20130fb0 msgr2=0x7f1c20129ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:31.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.330+0000 7f1c1e59c700 1 --2- 172.21.15.40:0/283611997 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c20130fb0 0x7f1c20129ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.330+0000 7f1c1e59c700 1 -- 172.21.15.40:0/283611997 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c2009e230 msgr2=0x7f1c201250e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:31.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.330+0000 7f1c1e59c700 1 --2- 172.21.15.40:0/283611997 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c2009e230 0x7f1c201250e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.330+0000 7f1c1e59c700 1 -- 172.21.15.40:0/283611997 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c18009b30 con 0x7f1c2009d920 2023-09-30T22:29:31.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.331+0000 7f1c1e59c700 1 --2- 172.21.15.40:0/283611997 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c2009d920 0x7f1c20124ba0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f1c1000b520 tx=0x7f1c1000b830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:31.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.332+0000 7f6bf2ffd700 1 -- 172.21.15.40:0/4052658038 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6bf4010380 con 0x7f6c0409d400 2023-09-30T22:29:31.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.332+0000 7f1c0effd700 1 -- 172.21.15.40:0/283611997 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c10005aa0 con 0x7f1c2009d920 2023-09-30T22:29:31.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.332+0000 7f1c0effd700 1 -- 172.21.15.40:0/283611997 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c10005c00 con 0x7f1c2009d920 2023-09-30T22:29:31.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.332+0000 7f1c0effd700 1 -- 172.21.15.40:0/283611997 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c10011630 con 0x7f1c2009d920 2023-09-30T22:29:31.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.332+0000 7f1c24a7e700 1 -- 172.21.15.40:0/283611997 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c2012bb70 con 0x7f1c2009d920 2023-09-30T22:29:31.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.332+0000 7f1c24a7e700 1 -- 172.21.15.40:0/283611997 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c2009cb00 con 0x7f1c2009d920 2023-09-30T22:29:31.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.333+0000 7f1c24a7e700 1 -- 172.21.15.40:0/283611997 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c2012d670 con 0x7f1c2009d920 2023-09-30T22:29:31.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.334+0000 7f1c0effd700 1 -- 172.21.15.40:0/283611997 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1c10011790 con 0x7f1c2009d920 2023-09-30T22:29:31.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.334+0000 7f1c0effd700 1 -- 172.21.15.40:0/283611997 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f1c1003f810 con 0x7f1c2009d920 2023-09-30T22:29:31.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.343+0000 7f1c0effd700 1 -- 172.21.15.40:0/283611997 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1c10010740 con 0x7f1c2009d920 2023-09-30T22:29:31.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.462+0000 7f4c1b3b7700 1 -- 172.21.15.40:0/332334560 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4c1409fef0 con 0x7f4c1406f070 2023-09-30T22:29:31.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.462+0000 7f4c09ffb700 1 -- 172.21.15.40:0/332334560 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4c1409fef0 con 0x7f4c1406f070 2023-09-30T22:29:31.463 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:31.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.465+0000 7f4c1b3b7700 1 -- 172.21.15.40:0/332334560 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c1406f070 msgr2=0x7f4c1406c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:31.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.465+0000 7f4c1b3b7700 1 --2- 172.21.15.40:0/332334560 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c1406f070 0x7f4c1406c990 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f4c10009c40 tx=0x7f4c10004750 comp rx=0 tx=0).stop 2023-09-30T22:29:31.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.465+0000 7f4c1b3b7700 1 -- 172.21.15.40:0/332334560 shutdown_connections 2023-09-30T22:29:31.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.465+0000 7f4c1b3b7700 1 --2- 172.21.15.40:0/332334560 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c1406fdb0 0x7f4c1406d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.465+0000 7f4c1b3b7700 1 --2- 172.21.15.40:0/332334560 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c1406f070 0x7f4c1406c990 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.465+0000 7f4c1b3b7700 1 --2- 172.21.15.40:0/332334560 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c1406f980 0x7f4c1406ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.465+0000 7f4c1b3b7700 1 -- 172.21.15.40:0/332334560 >> 172.21.15.40:0/332334560 conn(0x7f4c140a41a0 msgr2=0x7f4c140a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:31.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.466+0000 7f4c1b3b7700 1 -- 172.21.15.40:0/332334560 shutdown_connections 2023-09-30T22:29:31.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.466+0000 7f4c1b3b7700 1 -- 172.21.15.40:0/332334560 wait complete. 2023-09-30T22:29:31.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:31.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.502+0000 7f0c913fa700 1 -- 172.21.15.40:0/450703761 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0c8c062380 con 0x7f0c8c12e590 2023-09-30T22:29:31.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.503+0000 7f0c737fe700 1 -- 172.21.15.40:0/450703761 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0c80021030 con 0x7f0c8c12e590 2023-09-30T22:29:31.503 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:31.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.505+0000 7f0c913fa700 1 -- 172.21.15.40:0/450703761 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0c8c12e590 msgr2=0x7f0c8c1c34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:31.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.505+0000 7f0c913fa700 1 --2- 172.21.15.40:0/450703761 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0c8c12e590 0x7f0c8c1c34c0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0c8000e8e0 tx=0x7f0c8000ebf0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.505+0000 7f0c913fa700 1 -- 172.21.15.40:0/450703761 shutdown_connections 2023-09-30T22:29:31.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.505+0000 7f0c913fa700 1 --2- 172.21.15.40:0/450703761 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0c8c12eea0 0x7f0c8c1c6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.505+0000 7f0c913fa700 1 --2- 172.21.15.40:0/450703761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c8c12d6d0 0x7f0c8c1c2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.505+0000 7f0c913fa700 1 --2- 172.21.15.40:0/450703761 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0c8c12e590 0x7f0c8c1c34c0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.505+0000 7f0c913fa700 1 -- 172.21.15.40:0/450703761 >> 172.21.15.40:0/450703761 conn(0x7f0c8c0a2a00 msgr2=0x7f0c8c09d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:31.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.505+0000 7f0c913fa700 1 -- 172.21.15.40:0/450703761 shutdown_connections 2023-09-30T22:29:31.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.505+0000 7f0c913fa700 1 -- 172.21.15.40:0/450703761 wait complete. 2023-09-30T22:29:31.518 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:31.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.538+0000 7f1c24a7e700 1 -- 172.21.15.40:0/283611997 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1c2012d670 con 0x7f1c2009d920 2023-09-30T22:29:31.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.538+0000 7f1c0effd700 1 -- 172.21.15.40:0/283611997 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1c2012d670 con 0x7f1c2009d920 2023-09-30T22:29:31.539 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:31.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.541+0000 7f1c24a7e700 1 -- 172.21.15.40:0/283611997 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c2009d920 msgr2=0x7f1c20124ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:31.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.541+0000 7f1c24a7e700 1 --2- 172.21.15.40:0/283611997 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c2009d920 0x7f1c20124ba0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f1c1000b520 tx=0x7f1c1000b830 comp rx=0 tx=0).stop 2023-09-30T22:29:31.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.541+0000 7f1c24a7e700 1 -- 172.21.15.40:0/283611997 shutdown_connections 2023-09-30T22:29:31.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.541+0000 7f1c24a7e700 1 --2- 172.21.15.40:0/283611997 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1c2009d920 0x7f1c20124ba0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.541+0000 7f1c24a7e700 1 --2- 172.21.15.40:0/283611997 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1c20130fb0 0x7f1c20129ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.541+0000 7f1c24a7e700 1 --2- 172.21.15.40:0/283611997 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c2009e230 0x7f1c201250e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.541+0000 7f1c24a7e700 1 -- 172.21.15.40:0/283611997 >> 172.21.15.40:0/283611997 conn(0x7f1c2009fb20 msgr2=0x7f1c201279f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:31.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.541+0000 7f1c24a7e700 1 -- 172.21.15.40:0/283611997 shutdown_connections 2023-09-30T22:29:31.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.541+0000 7f1c24a7e700 1 -- 172.21.15.40:0/283611997 wait complete. 2023-09-30T22:29:31.554 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:31.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.561+0000 7f6c089af700 1 -- 172.21.15.40:0/4052658038 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6c04074330 con 0x7f6c0409d400 2023-09-30T22:29:31.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.562+0000 7f6bf2ffd700 1 -- 172.21.15.40:0/4052658038 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6bf4032090 con 0x7f6c0409d400 2023-09-30T22:29:31.564 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:31.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.564+0000 7f6c089af700 1 -- 172.21.15.40:0/4052658038 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c0409d400 msgr2=0x7f6c04119050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:31.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.564+0000 7f6c089af700 1 --2- 172.21.15.40:0/4052658038 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c0409d400 0x7f6c04119050 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4000c00 tx=0x7f6bf4004750 comp rx=0 tx=0).stop 2023-09-30T22:29:31.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.564+0000 7f6c089af700 1 -- 172.21.15.40:0/4052658038 shutdown_connections 2023-09-30T22:29:31.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.564+0000 7f6c089af700 1 --2- 172.21.15.40:0/4052658038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c04133e00 0x7f6c04119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.564+0000 7f6c089af700 1 --2- 172.21.15.40:0/4052658038 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c0409d400 0x7f6c04119050 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.564+0000 7f6c089af700 1 --2- 172.21.15.40:0/4052658038 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c0409df70 0x7f6c04119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:31.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.564+0000 7f6c089af700 1 -- 172.21.15.40:0/4052658038 >> 172.21.15.40:0/4052658038 conn(0x7f6c040a2a00 msgr2=0x7f6c0412d980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:31.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.564+0000 7f6c089af700 1 -- 172.21.15.40:0/4052658038 shutdown_connections 2023-09-30T22:29:31.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:31.564+0000 7f6c089af700 1 -- 172.21.15.40:0/4052658038 wait complete. 2023-09-30T22:29:31.577 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:32.479 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:32.519 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:32.555 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:32.578 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:32.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.623+0000 7f0666a37700 1 Processor -- start 2023-09-30T22:29:32.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.623+0000 7f0666a37700 1 -- start start 2023-09-30T22:29:32.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.623+0000 7f0666a37700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0660138250 0x7f0660138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:32.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.623+0000 7f0666a37700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f066009d400 0x7f066009d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:32.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.623+0000 7f0666a37700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0660137e20 con 0x7f066009dd50 2023-09-30T22:29:32.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.623+0000 7f0666a37700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0660138050 con 0x7f0660138250 2023-09-30T22:29:32.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.623+0000 7f0666a37700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f066009b010 con 0x7f066009d400 2023-09-30T22:29:32.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.623+0000 7f065ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0660138250 0x7f0660138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:32.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.623+0000 7f065ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0660138250 0x7f0660138620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56990/0 (socket says 172.21.15.40:56990) 2023-09-30T22:29:32.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.623+0000 7f065ffff700 1 -- 172.21.15.40:0/2271045437 learned_addr learned my addr 172.21.15.40:0/2271045437 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:32.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.624+0000 7f065ffff700 1 -- 172.21.15.40:0/2271045437 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f066009d400 msgr2=0x7f066009d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:32.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.624+0000 7f065f7fe700 1 --2- 172.21.15.40:0/2271045437 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f066009d400 0x7f066009d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:32.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.624+0000 7f065ffff700 1 --2- 172.21.15.40:0/2271045437 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f066009d400 0x7f066009d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.624+0000 7f065ffff700 1 -- 172.21.15.40:0/2271045437 >> v1:172.21.15.40:6789/0 conn(0x7f066009dd50 legacy=0x7f066013f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:32.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.624+0000 7f065ffff700 1 -- 172.21.15.40:0/2271045437 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f066009f1f0 con 0x7f0660138250 2023-09-30T22:29:32.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.624+0000 7f065f7fe700 1 --2- 172.21.15.40:0/2271045437 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f066009d400 0x7f066009d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:29:32.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.624+0000 7f065ffff700 1 --2- 172.21.15.40:0/2271045437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0660138250 0x7f0660138620 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f06500098f0 tx=0x7f0650009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99430650199d2be0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:32.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.624+0000 7f065effd700 1 -- 172.21.15.40:0/2271045437 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065000b8a0 con 0x7f0660138250 2023-09-30T22:29:32.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.624+0000 7f065effd700 1 -- 172.21.15.40:0/2271045437 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f065000ba00 con 0x7f0660138250 2023-09-30T22:29:32.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.624+0000 7f065effd700 1 -- 172.21.15.40:0/2271045437 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065000bd90 con 0x7f0660138250 2023-09-30T22:29:32.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.625+0000 7f0666a37700 1 -- 172.21.15.40:0/2271045437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0660138250 msgr2=0x7f0660138620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:32.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.625+0000 7f0666a37700 1 --2- 172.21.15.40:0/2271045437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0660138250 0x7f0660138620 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f06500098f0 tx=0x7f0650009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:32.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.625+0000 7f0666a37700 1 -- 172.21.15.40:0/2271045437 shutdown_connections 2023-09-30T22:29:32.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.625+0000 7f0666a37700 1 --2- 172.21.15.40:0/2271045437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0660138250 0x7f0660138620 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.625+0000 7f0666a37700 1 --2- 172.21.15.40:0/2271045437 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f066009d400 0x7f066009d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.625+0000 7f0666a37700 1 -- 172.21.15.40:0/2271045437 >> 172.21.15.40:0/2271045437 conn(0x7f06600a2a00 msgr2=0x7f06600a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:32.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.625+0000 7f0666a37700 1 -- 172.21.15.40:0/2271045437 shutdown_connections 2023-09-30T22:29:32.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.625+0000 7f0666a37700 1 -- 172.21.15.40:0/2271045437 wait complete. 2023-09-30T22:29:32.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.626+0000 7f0666a37700 1 Processor -- start 2023-09-30T22:29:32.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.627+0000 7f0666a37700 1 -- start start 2023-09-30T22:29:32.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.627+0000 7f0666a37700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f066009d400 0x7f0660134d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:32.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.627+0000 7f0666a37700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f066009dd50 0x7f0660135280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:32.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.627+0000 7f0666a37700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0660138250 0x7f0660133520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:32.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.627+0000 7f0666a37700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066013cee0 con 0x7f066009dd50 2023-09-30T22:29:32.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.627+0000 7f0666a37700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f066013c7d0 con 0x7f0660138250 2023-09-30T22:29:32.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.627+0000 7f0666a37700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f066013d7b0 con 0x7f066009d400 2023-09-30T22:29:32.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.627+0000 7f065f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f066009dd50 0x7f0660135280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:32.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.627+0000 7f065f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f066009dd50 0x7f0660135280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56994/0 (socket says 172.21.15.40:56994) 2023-09-30T22:29:32.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.627+0000 7f065f7fe700 1 -- 172.21.15.40:0/1787321643 learned_addr learned my addr 172.21.15.40:0/1787321643 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:32.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.627+0000 7f065ffff700 1 --2- 172.21.15.40:0/1787321643 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f066009d400 0x7f0660134d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:32.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.628+0000 7f065f7fe700 1 -- 172.21.15.40:0/1787321643 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f066009d400 msgr2=0x7f0660134d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:32.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.628+0000 7f065f7fe700 1 --2- 172.21.15.40:0/1787321643 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f066009d400 0x7f0660134d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.628+0000 7f065f7fe700 1 -- 172.21.15.40:0/1787321643 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0660138250 msgr2=0x7f0660133520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:32.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.628+0000 7f065f7fe700 1 --2- 172.21.15.40:0/1787321643 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0660138250 0x7f0660133520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.628+0000 7f065f7fe700 1 -- 172.21.15.40:0/1787321643 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0650009550 con 0x7f066009dd50 2023-09-30T22:29:32.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.628+0000 7f065f7fe700 1 --2- 172.21.15.40:0/1787321643 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f066009dd50 0x7f0660135280 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f065400c780 tx=0x7f065400ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:32.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.628+0000 7f065cff9700 1 -- 172.21.15.40:0/1787321643 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0654011800 con 0x7f066009dd50 2023-09-30T22:29:32.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.628+0000 7f065cff9700 1 -- 172.21.15.40:0/1787321643 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0654011960 con 0x7f066009dd50 2023-09-30T22:29:32.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.628+0000 7f0666a37700 1 -- 172.21.15.40:0/1787321643 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f066013eb10 con 0x7f066009dd50 2023-09-30T22:29:32.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.628+0000 7f065cff9700 1 -- 172.21.15.40:0/1787321643 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0654011cd0 con 0x7f066009dd50 2023-09-30T22:29:32.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.628+0000 7f0666a37700 1 -- 172.21.15.40:0/1787321643 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f066013ddd0 con 0x7f066009dd50 2023-09-30T22:29:32.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.629+0000 7f0666a37700 1 -- 172.21.15.40:0/1787321643 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0660062380 con 0x7f066009dd50 2023-09-30T22:29:32.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.630+0000 7f065cff9700 1 -- 172.21.15.40:0/1787321643 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0654021350 con 0x7f066009dd50 2023-09-30T22:29:32.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.630+0000 7f065cff9700 1 -- 172.21.15.40:0/1787321643 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f065403f6e0 con 0x7f066009dd50 2023-09-30T22:29:32.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.639+0000 7f065cff9700 1 -- 172.21.15.40:0/1787321643 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0654011e30 con 0x7f066009dd50 2023-09-30T22:29:32.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.670+0000 7fae933be700 1 Processor -- start 2023-09-30T22:29:32.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.670+0000 7fae933be700 1 -- start start 2023-09-30T22:29:32.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.670+0000 7fae933be700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae8c09d920 0x7fae8c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:32.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.670+0000 7fae933be700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fae8c130fb0 0x7fae8c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:32.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.670+0000 7fae933be700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae8c09adf0 con 0x7fae8c09e230 2023-09-30T22:29:32.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.670+0000 7fae933be700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae8c09edf0 con 0x7fae8c130fb0 2023-09-30T22:29:32.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.670+0000 7fae933be700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c09b660 con 0x7fae8c09d920 2023-09-30T22:29:32.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.671+0000 7fae9195b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fae8c130fb0 0x7fae8c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:32.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.671+0000 7fae9115a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae8c09d920 0x7fae8c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:32.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.671+0000 7fae9195b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fae8c130fb0 0x7fae8c138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57002/0 (socket says 172.21.15.40:57002) 2023-09-30T22:29:32.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.671+0000 7fae9195b700 1 -- 172.21.15.40:0/3343481024 learned_addr learned my addr 172.21.15.40:0/3343481024 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:32.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.671+0000 7fae9195b700 1 -- 172.21.15.40:0/3343481024 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae8c09d920 msgr2=0x7fae8c09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:32.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.671+0000 7fae9195b700 1 --2- 172.21.15.40:0/3343481024 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae8c09d920 0x7fae8c09dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.671+0000 7fae9195b700 1 -- 172.21.15.40:0/3343481024 >> v1:172.21.15.40:6789/0 conn(0x7fae8c09e230 legacy=0x7fae8c1308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:32.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.671+0000 7fae9195b700 1 -- 172.21.15.40:0/3343481024 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8c09a6e0 con 0x7fae8c130fb0 2023-09-30T22:29:32.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.671+0000 7fae9115a700 1 --2- 172.21.15.40:0/3343481024 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae8c09d920 0x7fae8c09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:32.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.671+0000 7fae9195b700 1 --2- 172.21.15.40:0/3343481024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae8c130fb0 0x7fae8c138d10 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fae8400bef0 tx=0x7fae84009370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6372f898981988 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:32.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.671+0000 7fae83fff700 1 -- 172.21.15.40:0/3343481024 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8400b480 con 0x7fae8c130fb0 2023-09-30T22:29:32.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.671+0000 7fae83fff700 1 -- 172.21.15.40:0/3343481024 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8400c950 con 0x7fae8c130fb0 2023-09-30T22:29:32.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.671+0000 7fae83fff700 1 -- 172.21.15.40:0/3343481024 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8400cd00 con 0x7fae8c130fb0 2023-09-30T22:29:32.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.672+0000 7fae933be700 1 -- 172.21.15.40:0/3343481024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae8c130fb0 msgr2=0x7fae8c138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:32.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.672+0000 7fae933be700 1 --2- 172.21.15.40:0/3343481024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae8c130fb0 0x7fae8c138d10 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fae8400bef0 tx=0x7fae84009370 comp rx=0 tx=0).stop 2023-09-30T22:29:32.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.672+0000 7fae933be700 1 -- 172.21.15.40:0/3343481024 shutdown_connections 2023-09-30T22:29:32.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.672+0000 7fae933be700 1 --2- 172.21.15.40:0/3343481024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae8c130fb0 0x7fae8c138d10 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.672+0000 7fae933be700 1 --2- 172.21.15.40:0/3343481024 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae8c09d920 0x7fae8c09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.672+0000 7fae933be700 1 -- 172.21.15.40:0/3343481024 >> 172.21.15.40:0/3343481024 conn(0x7fae8c09fb20 msgr2=0x7fae8c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:32.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.672+0000 7fae933be700 1 -- 172.21.15.40:0/3343481024 shutdown_connections 2023-09-30T22:29:32.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.672+0000 7fae933be700 1 -- 172.21.15.40:0/3343481024 wait complete. 2023-09-30T22:29:32.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.674+0000 7fae933be700 1 Processor -- start 2023-09-30T22:29:32.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.674+0000 7fae933be700 1 -- start start 2023-09-30T22:29:32.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.674+0000 7fae933be700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae8c09d920 0x7fae8c11cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:32.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.674+0000 7fae933be700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae8c09e230 0x7fae8c11d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:32.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.674+0000 7fae933be700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae8c130fb0 0x7fae8c11d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:32.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.674+0000 7fae933be700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c121450 con 0x7fae8c130fb0 2023-09-30T22:29:32.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.674+0000 7fae933be700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c11ec20 con 0x7fae8c09d920 2023-09-30T22:29:32.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.674+0000 7fae933be700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c1207b0 con 0x7fae8c09e230 2023-09-30T22:29:32.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.674+0000 7fae90959700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae8c09e230 0x7fae8c11d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:32.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.675+0000 7fae90959700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae8c09e230 0x7fae8c11d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:39472/0 (socket says 172.21.15.40:39472) 2023-09-30T22:29:32.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.675+0000 7fae90959700 1 -- 172.21.15.40:0/1892553683 learned_addr learned my addr 172.21.15.40:0/1892553683 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:32.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.675+0000 7fae9195b700 1 --2- 172.21.15.40:0/1892553683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae8c130fb0 0x7fae8c11d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:32.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.675+0000 7fae9115a700 1 --2- 172.21.15.40:0/1892553683 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae8c09d920 0x7fae8c11cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:32.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.675+0000 7fae9195b700 1 -- 172.21.15.40:0/1892553683 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae8c09e230 msgr2=0x7fae8c11d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:32.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.675+0000 7fae9195b700 1 --2- 172.21.15.40:0/1892553683 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae8c09e230 0x7fae8c11d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.675+0000 7fae9195b700 1 -- 172.21.15.40:0/1892553683 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae8c09d920 msgr2=0x7fae8c11cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:32.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.675+0000 7fae9195b700 1 --2- 172.21.15.40:0/1892553683 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae8c09d920 0x7fae8c11cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.675+0000 7fae9195b700 1 -- 172.21.15.40:0/1892553683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8800d8d0 con 0x7fae8c130fb0 2023-09-30T22:29:32.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.675+0000 7fae9195b700 1 --2- 172.21.15.40:0/1892553683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae8c130fb0 0x7fae8c11d9f0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fae84015000 tx=0x7fae84004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:32.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.675+0000 7fae81ffb700 1 -- 172.21.15.40:0/1892553683 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae84009e70 con 0x7fae8c130fb0 2023-09-30T22:29:32.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.675+0000 7fae81ffb700 1 -- 172.21.15.40:0/1892553683 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8400b9a0 con 0x7fae8c130fb0 2023-09-30T22:29:32.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.675+0000 7fae933be700 1 -- 172.21.15.40:0/1892553683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae8400bb50 con 0x7fae8c130fb0 2023-09-30T22:29:32.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.675+0000 7fae81ffb700 1 -- 172.21.15.40:0/1892553683 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae84003c40 con 0x7fae8c130fb0 2023-09-30T22:29:32.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.676+0000 7fae933be700 1 -- 172.21.15.40:0/1892553683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae8c11fdd0 con 0x7fae8c130fb0 2023-09-30T22:29:32.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.677+0000 7fae777fe700 1 -- 172.21.15.40:0/1892553683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae640052e0 con 0x7fae8c130fb0 2023-09-30T22:29:32.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.677+0000 7fae81ffb700 1 -- 172.21.15.40:0/1892553683 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fae8401a030 con 0x7fae8c130fb0 2023-09-30T22:29:32.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.677+0000 7fae81ffb700 1 -- 172.21.15.40:0/1892553683 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fae84041690 con 0x7fae8c130fb0 2023-09-30T22:29:32.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.686+0000 7fae81ffb700 1 -- 172.21.15.40:0/1892553683 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fae84003da0 con 0x7fae8c130fb0 2023-09-30T22:29:32.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.715+0000 7f1865042700 1 Processor -- start 2023-09-30T22:29:32.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.715+0000 7f1865042700 1 -- start start 2023-09-30T22:29:32.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.715+0000 7f1865042700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f186009d920 0x7f186009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:32.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.715+0000 7f1865042700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f186009f0f0 0x7f186009e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:32.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.715+0000 7f1865042700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f186009f940 con 0x7f1860133ca0 2023-09-30T22:29:32.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.715+0000 7f1865042700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f186006b4c0 con 0x7f186009f0f0 2023-09-30T22:29:32.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.715+0000 7f1865042700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f186009a8f0 con 0x7f186009d920 2023-09-30T22:29:32.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.715+0000 7f185ed9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f186009d920 0x7f186009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:32.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.715+0000 7f185f59e700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1860133ca0 0x7f1860134100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58320/0 (socket says 172.21.15.40:58320) 2023-09-30T22:29:32.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.715+0000 7f185f59e700 1 -- 172.21.15.40:0/4281171929 learned_addr learned my addr 172.21.15.40:0/4281171929 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:29:32.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.716+0000 7f185e59c700 1 --2- 172.21.15.40:0/4281171929 >> v2:172.21.15.40:3300/0 conn(0x7f186009f0f0 0x7f186009e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:32.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.716+0000 7f185dd9b700 1 -- 172.21.15.40:0/4281171929 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1303295873 0 0) 0x7f186009f940 con 0x7f1860133ca0 2023-09-30T22:29:32.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.716+0000 7f185dd9b700 1 -- 172.21.15.40:0/4281171929 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18480035b0 con 0x7f1860133ca0 2023-09-30T22:29:32.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.716+0000 7f185e59c700 1 -- 172.21.15.40:0/4281171929 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f186009d920 msgr2=0x7f186009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:32.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.716+0000 7f185e59c700 1 --2- 172.21.15.40:0/4281171929 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f186009d920 0x7f186009dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.716+0000 7f185e59c700 1 -- 172.21.15.40:0/4281171929 >> v1:172.21.15.40:6789/0 conn(0x7f1860133ca0 legacy=0x7f1860134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:32.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.716+0000 7f185e59c700 1 -- 172.21.15.40:0/4281171929 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186009f6e0 con 0x7f186009f0f0 2023-09-30T22:29:32.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.716+0000 7f185e59c700 1 --2- 172.21.15.40:0/4281171929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f186009f0f0 0x7f186009e230 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f1854009870 tx=0x7f1854009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5667c7d4157b093 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:32.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.716+0000 7f185dd9b700 1 -- 172.21.15.40:0/4281171929 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1854004230 con 0x7f186009f0f0 2023-09-30T22:29:32.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.716+0000 7f185dd9b700 1 -- 172.21.15.40:0/4281171929 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1854004390 con 0x7f186009f0f0 2023-09-30T22:29:32.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.716+0000 7f185dd9b700 1 -- 172.21.15.40:0/4281171929 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18540036a0 con 0x7f186009f0f0 2023-09-30T22:29:32.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.717+0000 7f1865042700 1 -- 172.21.15.40:0/4281171929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f186009f0f0 msgr2=0x7f186009e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:32.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.717+0000 7f1865042700 1 --2- 172.21.15.40:0/4281171929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f186009f0f0 0x7f186009e230 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f1854009870 tx=0x7f1854009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:32.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.717+0000 7f1865042700 1 -- 172.21.15.40:0/4281171929 shutdown_connections 2023-09-30T22:29:32.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.717+0000 7f1865042700 1 --2- 172.21.15.40:0/4281171929 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f186009d920 0x7f186009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.717+0000 7f1865042700 1 --2- 172.21.15.40:0/4281171929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f186009f0f0 0x7f186009e230 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.717+0000 7f1865042700 1 -- 172.21.15.40:0/4281171929 >> 172.21.15.40:0/4281171929 conn(0x7f186009fb20 msgr2=0x7f186009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:32.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.717+0000 7f1865042700 1 -- 172.21.15.40:0/4281171929 shutdown_connections 2023-09-30T22:29:32.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.717+0000 7f1865042700 1 -- 172.21.15.40:0/4281171929 wait complete. 2023-09-30T22:29:32.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.718+0000 7f1865042700 1 Processor -- start 2023-09-30T22:29:32.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.719+0000 7f1865042700 1 -- start start 2023-09-30T22:29:32.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.719+0000 7f1865042700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f186009d920 0x7f186011e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:32.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.719+0000 7f1865042700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1860133ca0 0x7f186011eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:32.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.719+0000 7f1865042700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f186011f0b0 0x7f18601cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:32.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.719+0000 7f1865042700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1860122100 con 0x7f186011f0b0 2023-09-30T22:29:32.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.719+0000 7f1865042700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1860120810 con 0x7f1860133ca0 2023-09-30T22:29:32.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.719+0000 7f1865042700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18601214d0 con 0x7f186009d920 2023-09-30T22:29:32.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.719+0000 7f185e59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1860133ca0 0x7f186011eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:32.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.719+0000 7f185e59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1860133ca0 0x7f186011eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35024/0 (socket says 172.21.15.40:35024) 2023-09-30T22:29:32.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.719+0000 7f185e59c700 1 -- 172.21.15.40:0/4083559905 learned_addr learned my addr 172.21.15.40:0/4083559905 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:32.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.719+0000 7f185ed9d700 1 --2- 172.21.15.40:0/4083559905 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f186009d920 0x7f186011e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:32.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.719+0000 7f185f59e700 1 --2- 172.21.15.40:0/4083559905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f186011f0b0 0x7f18601cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:32.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.720+0000 7f185e59c700 1 -- 172.21.15.40:0/4083559905 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f186009d920 msgr2=0x7f186011e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:32.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.720+0000 7f185e59c700 1 --2- 172.21.15.40:0/4083559905 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f186009d920 0x7f186011e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.720+0000 7f185e59c700 1 -- 172.21.15.40:0/4083559905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f186011f0b0 msgr2=0x7f18601cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:32.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.720+0000 7f185e59c700 1 --2- 172.21.15.40:0/4083559905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f186011f0b0 0x7f18601cebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.720+0000 7f185e59c700 1 -- 172.21.15.40:0/4083559905 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18540094a0 con 0x7f1860133ca0 2023-09-30T22:29:32.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.720+0000 7f185e59c700 1 --2- 172.21.15.40:0/4083559905 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1860133ca0 0x7f186011eb70 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f18540097c0 tx=0x7f1854004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:32.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.720+0000 7f18477fe700 1 -- 172.21.15.40:0/4083559905 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1854011630 con 0x7f1860133ca0 2023-09-30T22:29:32.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.720+0000 7f1865042700 1 -- 172.21.15.40:0/4083559905 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1860121890 con 0x7f1860133ca0 2023-09-30T22:29:32.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.720+0000 7f1865042700 1 -- 172.21.15.40:0/4083559905 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18600a26c0 con 0x7f1860133ca0 2023-09-30T22:29:32.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.720+0000 7f18477fe700 1 -- 172.21.15.40:0/4083559905 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185401e070 con 0x7f1860133ca0 2023-09-30T22:29:32.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.721+0000 7f18477fe700 1 -- 172.21.15.40:0/4083559905 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18540119d0 con 0x7f1860133ca0 2023-09-30T22:29:32.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.721+0000 7f18477fe700 1 -- 172.21.15.40:0/4083559905 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1854011b30 con 0x7f1860133ca0 2023-09-30T22:29:32.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.721+0000 7f1865042700 1 -- 172.21.15.40:0/4083559905 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18400052e0 con 0x7f1860133ca0 2023-09-30T22:29:32.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.725+0000 7f18477fe700 1 -- 172.21.15.40:0/4083559905 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f1854020070 con 0x7f1860133ca0 2023-09-30T22:29:32.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.730+0000 7f18477fe700 1 -- 172.21.15.40:0/4083559905 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f18540247f0 con 0x7f1860133ca0 2023-09-30T22:29:32.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.759+0000 7f67f1b33700 1 Processor -- start 2023-09-30T22:29:32.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.759+0000 7f67f1b33700 1 -- start start 2023-09-30T22:29:32.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.759+0000 7f67f1b33700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67ec06f070 0x7f67ec06f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:32.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.759+0000 7f67f1b33700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f67ec06fdb0 0x7f67ec0977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:32.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.759+0000 7f67f1b33700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67ec070830 con 0x7f67ec06f980 2023-09-30T22:29:32.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.759+0000 7f67f1b33700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67ec070ad0 con 0x7f67ec06f070 2023-09-30T22:29:32.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.759+0000 7f67f1b33700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67ec070de0 con 0x7f67ec06fdb0 2023-09-30T22:29:32.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.759+0000 7f67eb7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67ec06f070 0x7f67ec06f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:32.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.760+0000 7f67eb7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67ec06f070 0x7f67ec06f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35028/0 (socket says 172.21.15.40:35028) 2023-09-30T22:29:32.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.760+0000 7f67eb7fe700 1 -- 172.21.15.40:0/4133246138 learned_addr learned my addr 172.21.15.40:0/4133246138 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:32.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.760+0000 7f67ebfff700 1 --2- 172.21.15.40:0/4133246138 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f67ec06fdb0 0x7f67ec0977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:32.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.760+0000 7f67eb7fe700 1 -- 172.21.15.40:0/4133246138 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f67ec06fdb0 msgr2=0x7f67ec0977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:32.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.760+0000 7f67eb7fe700 1 --2- 172.21.15.40:0/4133246138 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f67ec06fdb0 0x7f67ec0977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.760+0000 7f67ea7fc700 1 -- 172.21.15.40:0/4133246138 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1464754847 0 0) 0x7f67ec070830 con 0x7f67ec06f980 2023-09-30T22:29:32.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.760+0000 7f67eb7fe700 1 -- 172.21.15.40:0/4133246138 >> v1:172.21.15.40:6789/0 conn(0x7f67ec06f980 legacy=0x7f67ec097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:32.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.760+0000 7f67eb7fe700 1 -- 172.21.15.40:0/4133246138 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67ec09fe20 con 0x7f67ec06f070 2023-09-30T22:29:32.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.760+0000 7f67eb7fe700 1 --2- 172.21.15.40:0/4133246138 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67ec06f070 0x7f67ec06f440 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f67dc009920 tx=0x7f67dc009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36b6961cbf98f6ce server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:32.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.760+0000 7f67ea7fc700 1 -- 172.21.15.40:0/4133246138 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67dc00ba60 con 0x7f67ec06f070 2023-09-30T22:29:32.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.760+0000 7f67ea7fc700 1 -- 172.21.15.40:0/4133246138 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67dc00bbc0 con 0x7f67ec06f070 2023-09-30T22:29:32.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.760+0000 7f67ea7fc700 1 -- 172.21.15.40:0/4133246138 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67dc009e70 con 0x7f67ec06f070 2023-09-30T22:29:32.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.761+0000 7f67f1b33700 1 -- 172.21.15.40:0/4133246138 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67ec06f070 msgr2=0x7f67ec06f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:32.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.761+0000 7f67f1b33700 1 --2- 172.21.15.40:0/4133246138 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67ec06f070 0x7f67ec06f440 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f67dc009920 tx=0x7f67dc009c30 comp rx=0 tx=0).stop 2023-09-30T22:29:32.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.761+0000 7f67f1b33700 1 -- 172.21.15.40:0/4133246138 shutdown_connections 2023-09-30T22:29:32.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.761+0000 7f67f1b33700 1 --2- 172.21.15.40:0/4133246138 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f67ec06fdb0 0x7f67ec0977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.761+0000 7f67f1b33700 1 --2- 172.21.15.40:0/4133246138 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67ec06f070 0x7f67ec06f440 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.761+0000 7f67f1b33700 1 -- 172.21.15.40:0/4133246138 >> 172.21.15.40:0/4133246138 conn(0x7f67ec0a41a0 msgr2=0x7f67ec0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:32.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.761+0000 7f67f1b33700 1 -- 172.21.15.40:0/4133246138 shutdown_connections 2023-09-30T22:29:32.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.761+0000 7f67f1b33700 1 -- 172.21.15.40:0/4133246138 wait complete. 2023-09-30T22:29:32.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.762+0000 7f67f1b33700 1 Processor -- start 2023-09-30T22:29:32.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.762+0000 7f67f1b33700 1 -- start start 2023-09-30T22:29:32.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.763+0000 7f67f1b33700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f67ec06f070 0x7f67ec09b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:32.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.763+0000 7f67f1b33700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67ec06f980 0x7f67ec09bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:32.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.763+0000 7f67f1b33700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67ec06fdb0 0x7f67ec09c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:32.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.763+0000 7f67f1b33700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67ec08b3c0 con 0x7f67ec06f980 2023-09-30T22:29:32.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.763+0000 7f67f1b33700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67ec096e60 con 0x7f67ec06fdb0 2023-09-30T22:29:32.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.763+0000 7f67f1b33700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67ec08b610 con 0x7f67ec06f070 2023-09-30T22:29:32.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.763+0000 7f67ebfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67ec06fdb0 0x7f67ec09c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:32.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.763+0000 7f67eb7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f67ec06f070 0x7f67ec09b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:32.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.763+0000 7f67ebfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67ec06fdb0 0x7f67ec09c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35034/0 (socket says 172.21.15.40:35034) 2023-09-30T22:29:32.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.763+0000 7f67ebfff700 1 -- 172.21.15.40:0/1080631436 learned_addr learned my addr 172.21.15.40:0/1080631436 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:32.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.763+0000 7f67eb7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f67ec06f070 0x7f67ec09b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:39498/0 (socket says 172.21.15.40:39498) 2023-09-30T22:29:32.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.763+0000 7f67eaffd700 1 --2- 172.21.15.40:0/1080631436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67ec06f980 0x7f67ec09bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:32.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.763+0000 7f67ebfff700 1 -- 172.21.15.40:0/1080631436 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f67ec06f070 msgr2=0x7f67ec09b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:32.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.763+0000 7f67ebfff700 1 --2- 172.21.15.40:0/1080631436 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f67ec06f070 0x7f67ec09b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.763+0000 7f67ebfff700 1 -- 172.21.15.40:0/1080631436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67ec06f980 msgr2=0x7f67ec09bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:32.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.763+0000 7f67ebfff700 1 --2- 172.21.15.40:0/1080631436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67ec06f980 0x7f67ec09bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.763+0000 7f67ebfff700 1 -- 172.21.15.40:0/1080631436 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67dc009550 con 0x7f67ec06fdb0 2023-09-30T22:29:32.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.763+0000 7f67ebfff700 1 --2- 172.21.15.40:0/1080631436 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67ec06fdb0 0x7f67ec09c020 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f67e4007e40 tx=0x7f67e400e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:32.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.763+0000 7f67d3fff700 1 -- 172.21.15.40:0/1080631436 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e4017d70 con 0x7f67ec06fdb0 2023-09-30T22:29:32.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.764+0000 7f67d3fff700 1 -- 172.21.15.40:0/1080631436 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e400e920 con 0x7f67ec06fdb0 2023-09-30T22:29:32.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.764+0000 7f67d3fff700 1 -- 172.21.15.40:0/1080631436 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e400ecd0 con 0x7f67ec06fdb0 2023-09-30T22:29:32.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.764+0000 7f67f1b33700 1 -- 172.21.15.40:0/1080631436 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67ec130af0 con 0x7f67ec06fdb0 2023-09-30T22:29:32.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.764+0000 7f67f1b33700 1 -- 172.21.15.40:0/1080631436 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67ec09e590 con 0x7f67ec06fdb0 2023-09-30T22:29:32.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.765+0000 7f67f1b33700 1 -- 172.21.15.40:0/1080631436 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67ec062380 con 0x7f67ec06fdb0 2023-09-30T22:29:32.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.765+0000 7f67d3fff700 1 -- 172.21.15.40:0/1080631436 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f67e401f3f0 con 0x7f67ec06fdb0 2023-09-30T22:29:32.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.766+0000 7f67d3fff700 1 -- 172.21.15.40:0/1080631436 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f67e4048900 con 0x7f67ec06fdb0 2023-09-30T22:29:32.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.774+0000 7f67d3fff700 1 -- 172.21.15.40:0/1080631436 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f67e401c2a0 con 0x7f67ec06fdb0 2023-09-30T22:29:32.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.860+0000 7f0666a37700 1 -- 172.21.15.40:0/1787321643 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f06601357c0 con 0x7f066009dd50 2023-09-30T22:29:32.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.860+0000 7f065cff9700 1 -- 172.21.15.40:0/1787321643 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0654017af0 con 0x7f066009dd50 2023-09-30T22:29:32.861 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:32.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.863+0000 7f0666a37700 1 -- 172.21.15.40:0/1787321643 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f066009dd50 msgr2=0x7f0660135280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:32.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.863+0000 7f0666a37700 1 --2- 172.21.15.40:0/1787321643 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f066009dd50 0x7f0660135280 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f065400c780 tx=0x7f065400ca90 comp rx=0 tx=0).stop 2023-09-30T22:29:32.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.863+0000 7f0666a37700 1 -- 172.21.15.40:0/1787321643 shutdown_connections 2023-09-30T22:29:32.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.863+0000 7f0666a37700 1 --2- 172.21.15.40:0/1787321643 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f066009d400 0x7f0660134d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.863+0000 7f0666a37700 1 --2- 172.21.15.40:0/1787321643 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0660138250 0x7f0660133520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.863+0000 7f0666a37700 1 --2- 172.21.15.40:0/1787321643 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f066009dd50 0x7f0660135280 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.863+0000 7f0666a37700 1 -- 172.21.15.40:0/1787321643 >> 172.21.15.40:0/1787321643 conn(0x7f06600a2a00 msgr2=0x7f06600a1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:32.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.863+0000 7f0666a37700 1 -- 172.21.15.40:0/1787321643 shutdown_connections 2023-09-30T22:29:32.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.863+0000 7f0666a37700 1 -- 172.21.15.40:0/1787321643 wait complete. 2023-09-30T22:29:32.880 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:32.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.939+0000 7f1865042700 1 -- 172.21.15.40:0/4083559905 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1840005590 con 0x7f1860133ca0 2023-09-30T22:29:32.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.939+0000 7f18477fe700 1 -- 172.21.15.40:0/4083559905 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1854010380 con 0x7f1860133ca0 2023-09-30T22:29:32.940 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:32.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.941+0000 7f1865042700 1 -- 172.21.15.40:0/4083559905 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1860133ca0 msgr2=0x7f186011eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:32.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.941+0000 7f1865042700 1 --2- 172.21.15.40:0/4083559905 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1860133ca0 0x7f186011eb70 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f18540097c0 tx=0x7f1854004750 comp rx=0 tx=0).stop 2023-09-30T22:29:32.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.941+0000 7f1865042700 1 -- 172.21.15.40:0/4083559905 shutdown_connections 2023-09-30T22:29:32.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.941+0000 7f1865042700 1 --2- 172.21.15.40:0/4083559905 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f186009d920 0x7f186011e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.941+0000 7f1865042700 1 --2- 172.21.15.40:0/4083559905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f186011f0b0 0x7f18601cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.941+0000 7f1865042700 1 --2- 172.21.15.40:0/4083559905 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1860133ca0 0x7f186011eb70 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.941+0000 7f1865042700 1 -- 172.21.15.40:0/4083559905 >> 172.21.15.40:0/4083559905 conn(0x7f186009fb20 msgr2=0x7f18601332b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:32.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.941+0000 7f1865042700 1 -- 172.21.15.40:0/4083559905 shutdown_connections 2023-09-30T22:29:32.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.941+0000 7f1865042700 1 -- 172.21.15.40:0/4083559905 wait complete. 2023-09-30T22:29:32.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.950+0000 7fae777fe700 1 -- 172.21.15.40:0/1892553683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fae64005860 con 0x7fae8c130fb0 2023-09-30T22:29:32.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.950+0000 7fae81ffb700 1 -- 172.21.15.40:0/1892553683 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fae84035090 con 0x7fae8c130fb0 2023-09-30T22:29:32.951 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:32.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.952+0000 7fae777fe700 1 -- 172.21.15.40:0/1892553683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae8c130fb0 msgr2=0x7fae8c11d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:32.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.952+0000 7fae777fe700 1 --2- 172.21.15.40:0/1892553683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae8c130fb0 0x7fae8c11d9f0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fae84015000 tx=0x7fae84004ad0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.952+0000 7fae777fe700 1 -- 172.21.15.40:0/1892553683 shutdown_connections 2023-09-30T22:29:32.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.952+0000 7fae777fe700 1 --2- 172.21.15.40:0/1892553683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae8c130fb0 0x7fae8c11d9f0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.952+0000 7fae777fe700 1 --2- 172.21.15.40:0/1892553683 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae8c09d920 0x7fae8c11cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.952+0000 7fae777fe700 1 --2- 172.21.15.40:0/1892553683 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae8c09e230 0x7fae8c11d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:32.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.952+0000 7fae777fe700 1 -- 172.21.15.40:0/1892553683 >> 172.21.15.40:0/1892553683 conn(0x7fae8c09fb20 msgr2=0x7fae8c12ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:32.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.953+0000 7fae777fe700 1 -- 172.21.15.40:0/1892553683 shutdown_connections 2023-09-30T22:29:32.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:32.953+0000 7fae777fe700 1 -- 172.21.15.40:0/1892553683 wait complete. 2023-09-30T22:29:32.955 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:32.965 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:33.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:33.031+0000 7f67f1b33700 1 -- 172.21.15.40:0/1080631436 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f67ec08be00 con 0x7f67ec06fdb0 2023-09-30T22:29:33.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:33.031+0000 7f67d3fff700 1 -- 172.21.15.40:0/1080631436 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f67e4026b00 con 0x7f67ec06fdb0 2023-09-30T22:29:33.032 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:33.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:33.033+0000 7f67f1b33700 1 -- 172.21.15.40:0/1080631436 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67ec06fdb0 msgr2=0x7f67ec09c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:33.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:33.033+0000 7f67f1b33700 1 --2- 172.21.15.40:0/1080631436 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67ec06fdb0 0x7f67ec09c020 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f67e4007e40 tx=0x7f67e400e3c0 comp rx=0 tx=0).stop 2023-09-30T22:29:33.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:33.033+0000 7f67f1b33700 1 -- 172.21.15.40:0/1080631436 shutdown_connections 2023-09-30T22:29:33.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:33.033+0000 7f67f1b33700 1 --2- 172.21.15.40:0/1080631436 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f67ec06f070 0x7f67ec09b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:33.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:33.033+0000 7f67f1b33700 1 --2- 172.21.15.40:0/1080631436 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67ec06fdb0 0x7f67ec09c020 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:33.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:33.033+0000 7f67f1b33700 1 --2- 172.21.15.40:0/1080631436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67ec06f980 0x7f67ec09bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:33.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:33.033+0000 7f67f1b33700 1 -- 172.21.15.40:0/1080631436 >> 172.21.15.40:0/1080631436 conn(0x7f67ec0a41a0 msgr2=0x7f67ec0a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:33.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:33.034+0000 7f67f1b33700 1 -- 172.21.15.40:0/1080631436 shutdown_connections 2023-09-30T22:29:33.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:33.034+0000 7f67f1b33700 1 -- 172.21.15.40:0/1080631436 wait complete. 2023-09-30T22:29:33.046 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:33.882 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:33.956 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:33.966 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:34.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.026+0000 7f83dfcdd700 1 Processor -- start 2023-09-30T22:29:34.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.026+0000 7f83dfcdd700 1 -- start start 2023-09-30T22:29:34.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.026+0000 7f83dfcdd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83d8133e00 0x7f83d81341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:34.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.026+0000 7f83dfcdd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f83d809d400 0x7f83d809d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:34.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.026+0000 7f83dfcdd700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83d8133940 con 0x7f83d809dd70 2023-09-30T22:29:34.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.026+0000 7f83dfcdd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d809ab20 con 0x7f83d8133e00 2023-09-30T22:29:34.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.026+0000 7f83dfcdd700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83d809f0d0 con 0x7f83d809d400 2023-09-30T22:29:34.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.027+0000 7f83dd278700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f83d809d400 0x7f83d809d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:34.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.027+0000 7f83dd278700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f83d809d400 0x7f83d809d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:43358/0 (socket says 172.21.15.40:43358) 2023-09-30T22:29:34.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.027+0000 7f83dd278700 1 -- 172.21.15.40:0/3336802899 learned_addr learned my addr 172.21.15.40:0/3336802899 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:34.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.027+0000 7f83dd278700 1 -- 172.21.15.40:0/3336802899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83d8133e00 msgr2=0x7f83d81341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:34.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.027+0000 7f83dd278700 1 --2- 172.21.15.40:0/3336802899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83d8133e00 0x7f83d81341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.027+0000 7f83dca77700 1 -- 172.21.15.40:0/3336802899 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3621010186 0 0) 0x7f83d8133940 con 0x7f83d809dd70 2023-09-30T22:29:34.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.027+0000 7f83dd278700 1 -- 172.21.15.40:0/3336802899 >> v1:172.21.15.40:6789/0 conn(0x7f83d809dd70 legacy=0x7f83d813ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:34.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.027+0000 7f83dd278700 1 -- 172.21.15.40:0/3336802899 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d809e210 con 0x7f83d809d400 2023-09-30T22:29:34.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.027+0000 7f83dd278700 1 --2- 172.21.15.40:0/3336802899 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f83d809d400 0x7f83d809d830 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f83c8009920 tx=0x7f83c8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7885606416e2ccc6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:34.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.027+0000 7f83dca77700 1 -- 172.21.15.40:0/3336802899 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c800ba60 con 0x7f83d809d400 2023-09-30T22:29:34.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.027+0000 7f83dca77700 1 -- 172.21.15.40:0/3336802899 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c800bbc0 con 0x7f83d809d400 2023-09-30T22:29:34.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.027+0000 7f83dca77700 1 -- 172.21.15.40:0/3336802899 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c8009e70 con 0x7f83d809d400 2023-09-30T22:29:34.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.028+0000 7f83dfcdd700 1 -- 172.21.15.40:0/3336802899 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f83d809d400 msgr2=0x7f83d809d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:34.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.028+0000 7f83dfcdd700 1 --2- 172.21.15.40:0/3336802899 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f83d809d400 0x7f83d809d830 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f83c8009920 tx=0x7f83c8009c30 comp rx=0 tx=0).stop 2023-09-30T22:29:34.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.028+0000 7f83dfcdd700 1 -- 172.21.15.40:0/3336802899 shutdown_connections 2023-09-30T22:29:34.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.028+0000 7f83dfcdd700 1 --2- 172.21.15.40:0/3336802899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83d8133e00 0x7f83d81341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.028+0000 7f83dfcdd700 1 --2- 172.21.15.40:0/3336802899 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f83d809d400 0x7f83d809d830 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.028+0000 7f83dfcdd700 1 -- 172.21.15.40:0/3336802899 >> 172.21.15.40:0/3336802899 conn(0x7f83d80a2a00 msgr2=0x7f83d80a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:34.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.028+0000 7f83dfcdd700 1 -- 172.21.15.40:0/3336802899 shutdown_connections 2023-09-30T22:29:34.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.028+0000 7f83dfcdd700 1 -- 172.21.15.40:0/3336802899 wait complete. 2023-09-30T22:29:34.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.030+0000 7f83dfcdd700 1 Processor -- start 2023-09-30T22:29:34.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.030+0000 7f83dfcdd700 1 -- start start 2023-09-30T22:29:34.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.030+0000 7f83dfcdd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f83d809d400 0x7f83d8119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:34.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.030+0000 7f83dfcdd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83d809dd70 0x7f83d8119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:34.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.030+0000 7f83dfcdd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83d8133e00 0x7f83d8119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:34.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.030+0000 7f83dfcdd700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d811b430 con 0x7f83d8133e00 2023-09-30T22:29:34.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.030+0000 7f83dfcdd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d80a1180 con 0x7f83d809dd70 2023-09-30T22:29:34.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.030+0000 7f83dfcdd700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83d812e1a0 con 0x7f83d809d400 2023-09-30T22:29:34.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.031+0000 7f83dd278700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83d809dd70 0x7f83d8119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:34.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.031+0000 7f83dd278700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83d809dd70 0x7f83d8119590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60334/0 (socket says 172.21.15.40:60334) 2023-09-30T22:29:34.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.031+0000 7f83dd278700 1 -- 172.21.15.40:0/2290471671 learned_addr learned my addr 172.21.15.40:0/2290471671 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:34.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.031+0000 7f83dda79700 1 --2- 172.21.15.40:0/2290471671 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f83d809d400 0x7f83d8119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:34.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.031+0000 7f83de27a700 1 --2- 172.21.15.40:0/2290471671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83d8133e00 0x7f83d8119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:34.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.031+0000 7f83dd278700 1 -- 172.21.15.40:0/2290471671 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f83d809d400 msgr2=0x7f83d8119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:34.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.031+0000 7f83dd278700 1 --2- 172.21.15.40:0/2290471671 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f83d809d400 0x7f83d8119050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.031+0000 7f83dd278700 1 -- 172.21.15.40:0/2290471671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83d8133e00 msgr2=0x7f83d8119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:34.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.031+0000 7f83dd278700 1 --2- 172.21.15.40:0/2290471671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83d8133e00 0x7f83d8119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.031+0000 7f83dd278700 1 -- 172.21.15.40:0/2290471671 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c8009550 con 0x7f83d809dd70 2023-09-30T22:29:34.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.031+0000 7f83dda79700 1 --2- 172.21.15.40:0/2290471671 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f83d809d400 0x7f83d8119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:34.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.031+0000 7f83dd278700 1 --2- 172.21.15.40:0/2290471671 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83d809dd70 0x7f83d8119590 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f83c8009c70 tx=0x7f83c8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:34.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.031+0000 7f83ce7fc700 1 -- 172.21.15.40:0/2290471671 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c8004590 con 0x7f83d809dd70 2023-09-30T22:29:34.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.031+0000 7f83ce7fc700 1 -- 172.21.15.40:0/2290471671 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c80036a0 con 0x7f83d809dd70 2023-09-30T22:29:34.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.031+0000 7f83dfcdd700 1 -- 172.21.15.40:0/2290471671 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83d811c340 con 0x7f83d809dd70 2023-09-30T22:29:34.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.032+0000 7f83ce7fc700 1 -- 172.21.15.40:0/2290471671 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c8003a70 con 0x7f83d809dd70 2023-09-30T22:29:34.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.032+0000 7f83dfcdd700 1 -- 172.21.15.40:0/2290471671 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83d811a740 con 0x7f83d809dd70 2023-09-30T22:29:34.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.033+0000 7f83dfcdd700 1 -- 172.21.15.40:0/2290471671 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83d8062380 con 0x7f83d809dd70 2023-09-30T22:29:34.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.033+0000 7f83ce7fc700 1 -- 172.21.15.40:0/2290471671 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f83c8021070 con 0x7f83d809dd70 2023-09-30T22:29:34.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.033+0000 7f83ce7fc700 1 -- 172.21.15.40:0/2290471671 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f83c8040d70 con 0x7f83d809dd70 2023-09-30T22:29:34.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.038+0000 7f83ce7fc700 1 -- 172.21.15.40:0/2290471671 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f83c8019770 con 0x7f83d809dd70 2023-09-30T22:29:34.048 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:34.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.097+0000 7f71fa553700 1 Processor -- start 2023-09-30T22:29:34.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.097+0000 7f71fa553700 1 -- start start 2023-09-30T22:29:34.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.098+0000 7f71fa553700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71f4138250 0x7f71f4138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:34.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.098+0000 7f71fa553700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f71f409d400 0x7f71f409d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:34.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.098+0000 7f71fa553700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f71f409dd50 0x7f71f413f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:34.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.098+0000 7f71fa553700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f4137e20 con 0x7f71f409d400 2023-09-30T22:29:34.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.098+0000 7f71fa553700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f4138050 con 0x7f71f4138250 2023-09-30T22:29:34.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.098+0000 7f71fa553700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71f409b010 con 0x7f71f409dd50 2023-09-30T22:29:34.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.098+0000 7f71f37fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f71f409d400 0x7f71f409d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:34.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.098+0000 7f71f3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71f4138250 0x7f71f4138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:34.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.098+0000 7f71f37fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f71f409d400 0x7f71f409d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56800/0 (socket says 172.21.15.40:56800) 2023-09-30T22:29:34.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.098+0000 7f71f37fe700 1 -- 172.21.15.40:0/3161717410 learned_addr learned my addr 172.21.15.40:0/3161717410 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:34.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.098+0000 7f71f8af0700 1 --2- 172.21.15.40:0/3161717410 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f71f409dd50 0x7f71f413f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:34.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.098+0000 7f71f3fff700 1 -- 172.21.15.40:0/3161717410 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f71f409dd50 msgr2=0x7f71f413f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:34.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.098+0000 7f71f3fff700 1 --2- 172.21.15.40:0/3161717410 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f71f409dd50 0x7f71f413f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.098+0000 7f71f3fff700 1 -- 172.21.15.40:0/3161717410 >> v2:172.21.15.40:3300/0 conn(0x7f71f409d400 msgr2=0x7f71f409d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:34.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.098+0000 7f71f3fff700 1 --2- 172.21.15.40:0/3161717410 >> v2:172.21.15.40:3300/0 conn(0x7f71f409d400 0x7f71f409d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.098+0000 7f71f3fff700 1 -- 172.21.15.40:0/3161717410 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f409e1f0 con 0x7f71f4138250 2023-09-30T22:29:34.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.098+0000 7f71f37fe700 1 --2- 172.21.15.40:0/3161717410 >> v2:172.21.15.40:3300/0 conn(0x7f71f409d400 0x7f71f409d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:34.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.099+0000 7f71f3fff700 1 --2- 172.21.15.40:0/3161717410 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71f4138250 0x7f71f4138620 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009840 tx=0x7f71e4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bf04318e5ca84b8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:34.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.099+0000 7f71f2ffd700 1 -- 172.21.15.40:0/3161717410 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e4011830 con 0x7f71f4138250 2023-09-30T22:29:34.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.099+0000 7f71f2ffd700 1 -- 172.21.15.40:0/3161717410 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e4011990 con 0x7f71f4138250 2023-09-30T22:29:34.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.099+0000 7f71f2ffd700 1 -- 172.21.15.40:0/3161717410 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e4011d20 con 0x7f71f4138250 2023-09-30T22:29:34.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.099+0000 7f71fa553700 1 -- 172.21.15.40:0/3161717410 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71f4138250 msgr2=0x7f71f4138620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:34.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.099+0000 7f71fa553700 1 --2- 172.21.15.40:0/3161717410 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71f4138250 0x7f71f4138620 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009840 tx=0x7f71e4009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:34.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.100+0000 7f71fa553700 1 -- 172.21.15.40:0/3161717410 shutdown_connections 2023-09-30T22:29:34.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.100+0000 7f71fa553700 1 --2- 172.21.15.40:0/3161717410 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f71f409dd50 0x7f71f413f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.100+0000 7f71fa553700 1 --2- 172.21.15.40:0/3161717410 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71f4138250 0x7f71f4138620 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.100+0000 7f71fa553700 1 --2- 172.21.15.40:0/3161717410 >> v2:172.21.15.40:3300/0 conn(0x7f71f409d400 0x7f71f409d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.100+0000 7f71fa553700 1 -- 172.21.15.40:0/3161717410 >> 172.21.15.40:0/3161717410 conn(0x7f71f40a2a00 msgr2=0x7f71f40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:34.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.100+0000 7f71fa553700 1 -- 172.21.15.40:0/3161717410 shutdown_connections 2023-09-30T22:29:34.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.100+0000 7f71fa553700 1 -- 172.21.15.40:0/3161717410 wait complete. 2023-09-30T22:29:34.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.101+0000 7f71fa553700 1 Processor -- start 2023-09-30T22:29:34.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.101+0000 7f71fa553700 1 -- start start 2023-09-30T22:29:34.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.101+0000 7f71fa553700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f71f409d400 0x7f71f41d53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:34.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.101+0000 7f71fa553700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71f409dd50 0x7f71f41d58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:34.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.101+0000 7f71fa553700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71f4138250 0x7f71f41d5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:34.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.101+0000 7f71fa553700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f4071550 con 0x7f71f409dd50 2023-09-30T22:29:34.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.101+0000 7f71fa553700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f40712f0 con 0x7f71f4138250 2023-09-30T22:29:34.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.101+0000 7f71fa553700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71f413ece0 con 0x7f71f409d400 2023-09-30T22:29:34.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.101+0000 7f71f3fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f71f409d400 0x7f71f41d53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:34.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.101+0000 7f71f3fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f71f409d400 0x7f71f41d53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:43376/0 (socket says 172.21.15.40:43376) 2023-09-30T22:29:34.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.101+0000 7f71f3fff700 1 -- 172.21.15.40:0/12627225 learned_addr learned my addr 172.21.15.40:0/12627225 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:34.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.101+0000 7f71f8af0700 1 --2- 172.21.15.40:0/12627225 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71f4138250 0x7f71f41d5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:34.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.102+0000 7f71f37fe700 1 --2- 172.21.15.40:0/12627225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71f409dd50 0x7f71f41d58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:34.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.102+0000 7f71f3fff700 1 -- 172.21.15.40:0/12627225 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71f4138250 msgr2=0x7f71f41d5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:34.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.102+0000 7f71f3fff700 1 --2- 172.21.15.40:0/12627225 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71f4138250 0x7f71f41d5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.102+0000 7f71f3fff700 1 -- 172.21.15.40:0/12627225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71f409dd50 msgr2=0x7f71f41d58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:34.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.102+0000 7f71f3fff700 1 --2- 172.21.15.40:0/12627225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71f409dd50 0x7f71f41d58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.102+0000 7f71f3fff700 1 -- 172.21.15.40:0/12627225 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e8009550 con 0x7f71f409d400 2023-09-30T22:29:34.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.102+0000 7f71f3fff700 1 --2- 172.21.15.40:0/12627225 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f71f409d400 0x7f71f41d53b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f71e40090b0 tx=0x7f71e4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:34.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.102+0000 7f71f0ff9700 1 -- 172.21.15.40:0/12627225 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e4004510 con 0x7f71f409d400 2023-09-30T22:29:34.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.102+0000 7f71f0ff9700 1 -- 172.21.15.40:0/12627225 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e40036a0 con 0x7f71f409d400 2023-09-30T22:29:34.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.102+0000 7f71fa553700 1 -- 172.21.15.40:0/12627225 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e40094a0 con 0x7f71f409d400 2023-09-30T22:29:34.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.102+0000 7f71f0ff9700 1 -- 172.21.15.40:0/12627225 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e4003a30 con 0x7f71f409d400 2023-09-30T22:29:34.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.102+0000 7f71fa553700 1 -- 172.21.15.40:0/12627225 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f413b4f0 con 0x7f71f409d400 2023-09-30T22:29:34.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.104+0000 7f71fa553700 1 -- 172.21.15.40:0/12627225 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f4062380 con 0x7f71f409d400 2023-09-30T22:29:34.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.104+0000 7f71f0ff9700 1 -- 172.21.15.40:0/12627225 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f71e4003b90 con 0x7f71f409d400 2023-09-30T22:29:34.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.104+0000 7f71f0ff9700 1 -- 172.21.15.40:0/12627225 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f71e40405a0 con 0x7f71f409d400 2023-09-30T22:29:34.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.109+0000 7f71f0ff9700 1 -- 172.21.15.40:0/12627225 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f71e401a420 con 0x7f71f409d400 2023-09-30T22:29:34.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.135+0000 7f9d3f634700 1 Processor -- start 2023-09-30T22:29:34.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.135+0000 7f9d3f634700 1 -- start start 2023-09-30T22:29:34.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.135+0000 7f9d3f634700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9d3809e400 0x7f9d38135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:34.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.135+0000 7f9d3f634700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d38136230 0x7f9d38138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:34.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.135+0000 7f9d3f634700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d3809adf0 con 0x7f9d3809d920 2023-09-30T22:29:34.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.135+0000 7f9d3f634700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d3809edf0 con 0x7f9d3809e400 2023-09-30T22:29:34.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.135+0000 7f9d3f634700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3809b660 con 0x7f9d38136230 2023-09-30T22:29:34.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.135+0000 7f9d3cbcf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9d3809e400 0x7f9d38135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:34.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.136+0000 7f9d3cbcf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9d3809e400 0x7f9d38135cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56822/0 (socket says 172.21.15.40:56822) 2023-09-30T22:29:34.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.136+0000 7f9d3cbcf700 1 -- 172.21.15.40:0/15226044 learned_addr learned my addr 172.21.15.40:0/15226044 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:34.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.136+0000 7f9d3dbd1700 1 --2- 172.21.15.40:0/15226044 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d38136230 0x7f9d38138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:34.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.136+0000 7f9d3dbd1700 1 -- 172.21.15.40:0/15226044 >> v2:172.21.15.40:3300/0 conn(0x7f9d3809e400 msgr2=0x7f9d38135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:34.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.136+0000 7f9d3dbd1700 1 --2- 172.21.15.40:0/15226044 >> v2:172.21.15.40:3300/0 conn(0x7f9d3809e400 0x7f9d38135cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.136+0000 7f9d3dbd1700 1 -- 172.21.15.40:0/15226044 >> v1:172.21.15.40:6789/0 conn(0x7f9d3809d920 legacy=0x7f9d3809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:34.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.136+0000 7f9d3dbd1700 1 -- 172.21.15.40:0/15226044 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3809a6e0 con 0x7f9d38136230 2023-09-30T22:29:34.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.136+0000 7f9d3cbcf700 1 --2- 172.21.15.40:0/15226044 >> v2:172.21.15.40:3300/0 conn(0x7f9d3809e400 0x7f9d38135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:34.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.136+0000 7f9d3dbd1700 1 --2- 172.21.15.40:0/15226044 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d38136230 0x7f9d38138610 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f9d30009d90 tx=0x7f9d3000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b89b1bb6bc077273 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:34.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.136+0000 7f9d2ffff700 1 -- 172.21.15.40:0/15226044 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3000e070 con 0x7f9d38136230 2023-09-30T22:29:34.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.136+0000 7f9d2ffff700 1 -- 172.21.15.40:0/15226044 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3000bb20 con 0x7f9d38136230 2023-09-30T22:29:34.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.136+0000 7f9d2ffff700 1 -- 172.21.15.40:0/15226044 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d30012430 con 0x7f9d38136230 2023-09-30T22:29:34.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.137+0000 7f9d3f634700 1 -- 172.21.15.40:0/15226044 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d38136230 msgr2=0x7f9d38138610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:34.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.137+0000 7f9d3f634700 1 --2- 172.21.15.40:0/15226044 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d38136230 0x7f9d38138610 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f9d30009d90 tx=0x7f9d3000b330 comp rx=0 tx=0).stop 2023-09-30T22:29:34.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.137+0000 7f9d3f634700 1 -- 172.21.15.40:0/15226044 shutdown_connections 2023-09-30T22:29:34.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.137+0000 7f9d3f634700 1 --2- 172.21.15.40:0/15226044 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d38136230 0x7f9d38138610 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.137+0000 7f9d3f634700 1 --2- 172.21.15.40:0/15226044 >> v2:172.21.15.40:3300/0 conn(0x7f9d3809e400 0x7f9d38135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.137+0000 7f9d3f634700 1 -- 172.21.15.40:0/15226044 >> 172.21.15.40:0/15226044 conn(0x7f9d3809fb20 msgr2=0x7f9d3809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:34.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.137+0000 7f9d3f634700 1 -- 172.21.15.40:0/15226044 shutdown_connections 2023-09-30T22:29:34.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.137+0000 7f9d3f634700 1 -- 172.21.15.40:0/15226044 wait complete. 2023-09-30T22:29:34.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.138+0000 7f9d3f634700 1 Processor -- start 2023-09-30T22:29:34.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.139+0000 7f9d3f634700 1 -- start start 2023-09-30T22:29:34.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.139+0000 7f9d3f634700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d3809d920 0x7f9d3811c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:34.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.139+0000 7f9d3f634700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d3809e400 0x7f9d3811cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:34.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.139+0000 7f9d3f634700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d38136230 0x7f9d3811d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:34.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.139+0000 7f9d3f634700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d38120050 con 0x7f9d38136230 2023-09-30T22:29:34.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.139+0000 7f9d3f634700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d380a2e20 con 0x7f9d3809e400 2023-09-30T22:29:34.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.139+0000 7f9d3f634700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3809cb00 con 0x7f9d3809d920 2023-09-30T22:29:34.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.139+0000 7f9d3cbcf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d3809e400 0x7f9d3811cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:34.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.139+0000 7f9d3cbcf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d3809e400 0x7f9d3811cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60356/0 (socket says 172.21.15.40:60356) 2023-09-30T22:29:34.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.139+0000 7f9d3cbcf700 1 -- 172.21.15.40:0/2275273023 learned_addr learned my addr 172.21.15.40:0/2275273023 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:34.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.140+0000 7f9d3dbd1700 1 --2- 172.21.15.40:0/2275273023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d38136230 0x7f9d3811d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:34.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.140+0000 7f9d3d3d0700 1 --2- 172.21.15.40:0/2275273023 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d3809d920 0x7f9d3811c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:34.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.140+0000 7f9d3dbd1700 1 -- 172.21.15.40:0/2275273023 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d3809d920 msgr2=0x7f9d3811c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:34.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.140+0000 7f9d3dbd1700 1 --2- 172.21.15.40:0/2275273023 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d3809d920 0x7f9d3811c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.140+0000 7f9d3dbd1700 1 -- 172.21.15.40:0/2275273023 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d3809e400 msgr2=0x7f9d3811cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:34.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.140+0000 7f9d3dbd1700 1 --2- 172.21.15.40:0/2275273023 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d3809e400 0x7f9d3811cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.140+0000 7f9d3dbd1700 1 -- 172.21.15.40:0/2275273023 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d2800b7f0 con 0x7f9d38136230 2023-09-30T22:29:34.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.140+0000 7f9d3cbcf700 1 --2- 172.21.15.40:0/2275273023 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d3809e400 0x7f9d3811cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:34.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.140+0000 7f9d3dbd1700 1 --2- 172.21.15.40:0/2275273023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d38136230 0x7f9d3811d040 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f9d30016000 tx=0x7f9d30004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:34.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.140+0000 7f9d2dffb700 1 -- 172.21.15.40:0/2275273023 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d30012430 con 0x7f9d38136230 2023-09-30T22:29:34.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.140+0000 7f9d2dffb700 1 -- 172.21.15.40:0/2275273023 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d30020070 con 0x7f9d38136230 2023-09-30T22:29:34.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.140+0000 7f9d2dffb700 1 -- 172.21.15.40:0/2275273023 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d30004280 con 0x7f9d38136230 2023-09-30T22:29:34.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.140+0000 7f9d3f634700 1 -- 172.21.15.40:0/2275273023 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d30009a70 con 0x7f9d38136230 2023-09-30T22:29:34.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.141+0000 7f9d3f634700 1 -- 172.21.15.40:0/2275273023 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d3811f7e0 con 0x7f9d38136230 2023-09-30T22:29:34.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.142+0000 7f9d2dffb700 1 -- 172.21.15.40:0/2275273023 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d300043e0 con 0x7f9d38136230 2023-09-30T22:29:34.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.142+0000 7f9d3f634700 1 -- 172.21.15.40:0/2275273023 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d38062380 con 0x7f9d38136230 2023-09-30T22:29:34.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.142+0000 7f9d2dffb700 1 -- 172.21.15.40:0/2275273023 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9d30022070 con 0x7f9d38136230 2023-09-30T22:29:34.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.147+0000 7f9d2dffb700 1 -- 172.21.15.40:0/2275273023 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d30012e60 con 0x7f9d38136230 2023-09-30T22:29:34.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.183+0000 7f4837d49700 1 Processor -- start 2023-09-30T22:29:34.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.183+0000 7f4837d49700 1 -- start start 2023-09-30T22:29:34.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.184+0000 7f4837d49700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f483009d920 0x7f483009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:34.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.184+0000 7f4837d49700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f483009f0f0 0x7f483009e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:34.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.184+0000 7f4837d49700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f483009f940 con 0x7f4830133ca0 2023-09-30T22:29:34.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.184+0000 7f4837d49700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f483006b4c0 con 0x7f483009f0f0 2023-09-30T22:29:34.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.184+0000 7f4837d49700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f483009a8f0 con 0x7f483009d920 2023-09-30T22:29:34.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.184+0000 7f48362e6700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f4830133ca0 0x7f4830134100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38716/0 (socket says 172.21.15.40:38716) 2023-09-30T22:29:34.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.184+0000 7f4835ae5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f483009d920 0x7f483009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:34.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.184+0000 7f48362e6700 1 -- 172.21.15.40:0/272176033 learned_addr learned my addr 172.21.15.40:0/272176033 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:29:34.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.184+0000 7f48352e4700 1 --2- 172.21.15.40:0/272176033 >> v2:172.21.15.40:3300/0 conn(0x7f483009f0f0 0x7f483009e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:34.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.184+0000 7f4834ae3700 1 -- 172.21.15.40:0/272176033 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1412695820 0 0) 0x7f483009f940 con 0x7f4830133ca0 2023-09-30T22:29:34.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.185+0000 7f4834ae3700 1 -- 172.21.15.40:0/272176033 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f481c0035b0 con 0x7f4830133ca0 2023-09-30T22:29:34.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.185+0000 7f48352e4700 1 -- 172.21.15.40:0/272176033 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f483009d920 msgr2=0x7f483009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:34.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.185+0000 7f48352e4700 1 --2- 172.21.15.40:0/272176033 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f483009d920 0x7f483009dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.185+0000 7f48352e4700 1 -- 172.21.15.40:0/272176033 >> v1:172.21.15.40:6789/0 conn(0x7f4830133ca0 legacy=0x7f4830134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:34.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.185+0000 7f48352e4700 1 -- 172.21.15.40:0/272176033 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f483009f6e0 con 0x7f483009f0f0 2023-09-30T22:29:34.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.185+0000 7f48352e4700 1 --2- 172.21.15.40:0/272176033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f483009f0f0 0x7f483009e230 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f4820009870 tx=0x7f4820009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3baeddb9bc030649 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:34.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.185+0000 7f4834ae3700 1 -- 172.21.15.40:0/272176033 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4820011830 con 0x7f483009f0f0 2023-09-30T22:29:34.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.185+0000 7f4834ae3700 1 -- 172.21.15.40:0/272176033 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4820011990 con 0x7f483009f0f0 2023-09-30T22:29:34.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.185+0000 7f4834ae3700 1 -- 172.21.15.40:0/272176033 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4820011d00 con 0x7f483009f0f0 2023-09-30T22:29:34.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.186+0000 7f4837d49700 1 -- 172.21.15.40:0/272176033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f483009f0f0 msgr2=0x7f483009e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:34.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.186+0000 7f4837d49700 1 --2- 172.21.15.40:0/272176033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f483009f0f0 0x7f483009e230 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f4820009870 tx=0x7f4820009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:34.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.186+0000 7f4837d49700 1 -- 172.21.15.40:0/272176033 shutdown_connections 2023-09-30T22:29:34.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.186+0000 7f4837d49700 1 --2- 172.21.15.40:0/272176033 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f483009d920 0x7f483009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.186+0000 7f4837d49700 1 --2- 172.21.15.40:0/272176033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f483009f0f0 0x7f483009e230 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.186+0000 7f4837d49700 1 -- 172.21.15.40:0/272176033 >> 172.21.15.40:0/272176033 conn(0x7f483009fb20 msgr2=0x7f483009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:34.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.186+0000 7f4837d49700 1 -- 172.21.15.40:0/272176033 shutdown_connections 2023-09-30T22:29:34.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.186+0000 7f4837d49700 1 -- 172.21.15.40:0/272176033 wait complete. 2023-09-30T22:29:34.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.187+0000 7f4837d49700 1 Processor -- start 2023-09-30T22:29:34.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.187+0000 7f4837d49700 1 -- start start 2023-09-30T22:29:34.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.187+0000 7f4837d49700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f483009d920 0x7f483011e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:34.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.187+0000 7f4837d49700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4830133ca0 0x7f483011ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:34.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.187+0000 7f4837d49700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48301224d0 0x7f483011efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:34.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.187+0000 7f4837d49700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48301200f0 con 0x7f48301224d0 2023-09-30T22:29:34.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.187+0000 7f4837d49700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4830121cf0 con 0x7f4830133ca0 2023-09-30T22:29:34.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.187+0000 7f4837d49700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48300a25f0 con 0x7f483009d920 2023-09-30T22:29:34.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.187+0000 7f48362e6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48301224d0 0x7f483011efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:34.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.187+0000 7f48362e6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48301224d0 0x7f483011efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56856/0 (socket says 172.21.15.40:56856) 2023-09-30T22:29:34.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.187+0000 7f48362e6700 1 -- 172.21.15.40:0/3430648839 learned_addr learned my addr 172.21.15.40:0/3430648839 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:34.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.187+0000 7f4835ae5700 1 --2- 172.21.15.40:0/3430648839 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f483009d920 0x7f483011e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:34.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.188+0000 7f48352e4700 1 --2- 172.21.15.40:0/3430648839 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4830133ca0 0x7f483011ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:34.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.188+0000 7f48362e6700 1 -- 172.21.15.40:0/3430648839 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f483009d920 msgr2=0x7f483011e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:34.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.188+0000 7f48362e6700 1 --2- 172.21.15.40:0/3430648839 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f483009d920 0x7f483011e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.188+0000 7f48362e6700 1 -- 172.21.15.40:0/3430648839 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4830133ca0 msgr2=0x7f483011ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:34.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.188+0000 7f48362e6700 1 --2- 172.21.15.40:0/3430648839 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4830133ca0 0x7f483011ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.188+0000 7f48362e6700 1 -- 172.21.15.40:0/3430648839 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48200094a0 con 0x7f48301224d0 2023-09-30T22:29:34.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.188+0000 7f48362e6700 1 --2- 172.21.15.40:0/3430648839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48301224d0 0x7f483011efb0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f482800cb40 tx=0x7f482800ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:34.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.188+0000 7f48267fc700 1 -- 172.21.15.40:0/3430648839 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482800a9e0 con 0x7f48301224d0 2023-09-30T22:29:34.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.188+0000 7f48267fc700 1 -- 172.21.15.40:0/3430648839 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f482800ab40 con 0x7f48301224d0 2023-09-30T22:29:34.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.188+0000 7f4837d49700 1 -- 172.21.15.40:0/3430648839 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f483009c9e0 con 0x7f48301224d0 2023-09-30T22:29:34.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.188+0000 7f48267fc700 1 -- 172.21.15.40:0/3430648839 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4828012400 con 0x7f48301224d0 2023-09-30T22:29:34.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.188+0000 7f4837d49700 1 -- 172.21.15.40:0/3430648839 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4830121fd0 con 0x7f48301224d0 2023-09-30T22:29:34.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.189+0000 7f4837d49700 1 -- 172.21.15.40:0/3430648839 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f483006f6f0 con 0x7f48301224d0 2023-09-30T22:29:34.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.189+0000 7f48267fc700 1 -- 172.21.15.40:0/3430648839 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f482801b3b0 con 0x7f48301224d0 2023-09-30T22:29:34.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.190+0000 7f48267fc700 1 -- 172.21.15.40:0/3430648839 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f482803f350 con 0x7f48301224d0 2023-09-30T22:29:34.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.199+0000 7f48267fc700 1 -- 172.21.15.40:0/3430648839 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f48280192c0 con 0x7f48301224d0 2023-09-30T22:29:34.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.243+0000 7f83dfcdd700 1 -- 172.21.15.40:0/2290471671 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f83d811bf70 con 0x7f83d809dd70 2023-09-30T22:29:34.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.244+0000 7f83ce7fc700 1 -- 172.21.15.40:0/2290471671 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f83c8011420 con 0x7f83d809dd70 2023-09-30T22:29:34.245 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:34.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.246+0000 7f83dfcdd700 1 -- 172.21.15.40:0/2290471671 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83d809dd70 msgr2=0x7f83d8119590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:34.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.246+0000 7f83dfcdd700 1 --2- 172.21.15.40:0/2290471671 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83d809dd70 0x7f83d8119590 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f83c8009c70 tx=0x7f83c8004750 comp rx=0 tx=0).stop 2023-09-30T22:29:34.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.246+0000 7f83dfcdd700 1 -- 172.21.15.40:0/2290471671 shutdown_connections 2023-09-30T22:29:34.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.246+0000 7f83dfcdd700 1 --2- 172.21.15.40:0/2290471671 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f83d809d400 0x7f83d8119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.246+0000 7f83dfcdd700 1 --2- 172.21.15.40:0/2290471671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83d8133e00 0x7f83d8119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.246+0000 7f83dfcdd700 1 --2- 172.21.15.40:0/2290471671 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83d809dd70 0x7f83d8119590 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.246+0000 7f83dfcdd700 1 -- 172.21.15.40:0/2290471671 >> 172.21.15.40:0/2290471671 conn(0x7f83d80a2a00 msgr2=0x7f83d812c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:34.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.246+0000 7f83dfcdd700 1 -- 172.21.15.40:0/2290471671 shutdown_connections 2023-09-30T22:29:34.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.246+0000 7f83dfcdd700 1 -- 172.21.15.40:0/2290471671 wait complete. 2023-09-30T22:29:34.260 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:34.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.315+0000 7f71fa553700 1 -- 172.21.15.40:0/12627225 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f71f409abb0 con 0x7f71f409d400 2023-09-30T22:29:34.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.316+0000 7f71f0ff9700 1 -- 172.21.15.40:0/12627225 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f71e4028020 con 0x7f71f409d400 2023-09-30T22:29:34.317 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:34.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.318+0000 7f71fa553700 1 -- 172.21.15.40:0/12627225 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f71f409d400 msgr2=0x7f71f41d53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:34.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.318+0000 7f71fa553700 1 --2- 172.21.15.40:0/12627225 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f71f409d400 0x7f71f41d53b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f71e40090b0 tx=0x7f71e4004750 comp rx=0 tx=0).stop 2023-09-30T22:29:34.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.318+0000 7f71fa553700 1 -- 172.21.15.40:0/12627225 shutdown_connections 2023-09-30T22:29:34.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.318+0000 7f71fa553700 1 --2- 172.21.15.40:0/12627225 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f71f409d400 0x7f71f41d53b0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.318+0000 7f71fa553700 1 --2- 172.21.15.40:0/12627225 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71f4138250 0x7f71f41d5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.318+0000 7f71fa553700 1 --2- 172.21.15.40:0/12627225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71f409dd50 0x7f71f41d58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.318+0000 7f71fa553700 1 -- 172.21.15.40:0/12627225 >> 172.21.15.40:0/12627225 conn(0x7f71f40a2a00 msgr2=0x7f71f409f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:34.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.318+0000 7f71fa553700 1 -- 172.21.15.40:0/12627225 shutdown_connections 2023-09-30T22:29:34.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.318+0000 7f71fa553700 1 -- 172.21.15.40:0/12627225 wait complete. 2023-09-30T22:29:34.331 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:34.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.350+0000 7f9d3f634700 1 -- 172.21.15.40:0/2275273023 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9d3811e8f0 con 0x7f9d38136230 2023-09-30T22:29:34.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.351+0000 7f9d2dffb700 1 -- 172.21.15.40:0/2275273023 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9d3002c020 con 0x7f9d38136230 2023-09-30T22:29:34.351 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:34.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.353+0000 7f9d3f634700 1 -- 172.21.15.40:0/2275273023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d38136230 msgr2=0x7f9d3811d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:34.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.353+0000 7f9d3f634700 1 --2- 172.21.15.40:0/2275273023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d38136230 0x7f9d3811d040 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f9d30016000 tx=0x7f9d30004ad0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.353+0000 7f9d3f634700 1 -- 172.21.15.40:0/2275273023 shutdown_connections 2023-09-30T22:29:34.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.353+0000 7f9d3f634700 1 --2- 172.21.15.40:0/2275273023 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d3809d920 0x7f9d3811c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.353+0000 7f9d3f634700 1 --2- 172.21.15.40:0/2275273023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d38136230 0x7f9d3811d040 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.353+0000 7f9d3f634700 1 --2- 172.21.15.40:0/2275273023 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d3809e400 0x7f9d3811cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.353+0000 7f9d3f634700 1 -- 172.21.15.40:0/2275273023 >> 172.21.15.40:0/2275273023 conn(0x7f9d3809fb20 msgr2=0x7f9d380a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:34.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.353+0000 7f9d3f634700 1 -- 172.21.15.40:0/2275273023 shutdown_connections 2023-09-30T22:29:34.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.353+0000 7f9d3f634700 1 -- 172.21.15.40:0/2275273023 wait complete. 2023-09-30T22:29:34.365 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:34.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.397+0000 7f4837d49700 1 -- 172.21.15.40:0/3430648839 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4830062380 con 0x7f48301224d0 2023-09-30T22:29:34.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.397+0000 7f48267fc700 1 -- 172.21.15.40:0/3430648839 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4828017070 con 0x7f48301224d0 2023-09-30T22:29:34.398 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:34.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.399+0000 7f4837d49700 1 -- 172.21.15.40:0/3430648839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48301224d0 msgr2=0x7f483011efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:34.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.399+0000 7f4837d49700 1 --2- 172.21.15.40:0/3430648839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48301224d0 0x7f483011efb0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f482800cb40 tx=0x7f482800ce50 comp rx=0 tx=0).stop 2023-09-30T22:29:34.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.399+0000 7f4837d49700 1 -- 172.21.15.40:0/3430648839 shutdown_connections 2023-09-30T22:29:34.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.399+0000 7f4837d49700 1 --2- 172.21.15.40:0/3430648839 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f483009d920 0x7f483011e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.399+0000 7f4837d49700 1 --2- 172.21.15.40:0/3430648839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48301224d0 0x7f483011efb0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.399+0000 7f4837d49700 1 --2- 172.21.15.40:0/3430648839 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4830133ca0 0x7f483011ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:34.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.399+0000 7f4837d49700 1 -- 172.21.15.40:0/3430648839 >> 172.21.15.40:0/3430648839 conn(0x7f483009fb20 msgr2=0x7f4830133360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:34.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.399+0000 7f4837d49700 1 -- 172.21.15.40:0/3430648839 shutdown_connections 2023-09-30T22:29:34.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:34.399+0000 7f4837d49700 1 -- 172.21.15.40:0/3430648839 wait complete. 2023-09-30T22:29:34.412 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:35.260 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:35.332 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:35.367 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:35.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.403+0000 7fc6eaf5a700 1 Processor -- start 2023-09-30T22:29:35.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.404+0000 7fc6eaf5a700 1 -- start start 2023-09-30T22:29:35.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.404+0000 7fc6eaf5a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc6e409df30 0x7fc6e4135400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:35.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.404+0000 7fc6eaf5a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6e4135940 0x7fc6e4137d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:35.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.404+0000 7fc6eaf5a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e409e8b0 con 0x7fc6e409d450 2023-09-30T22:29:35.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.404+0000 7fc6eaf5a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6e409c3b0 con 0x7fc6e409df30 2023-09-30T22:29:35.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.404+0000 7fc6eaf5a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e409a6b0 con 0x7fc6e4135940 2023-09-30T22:29:35.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.404+0000 7fc6e3fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc6e409df30 0x7fc6e4135400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:35.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.404+0000 7fc6e94f7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6e4135940 0x7fc6e4137d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:35.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.404+0000 7fc6e3fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc6e409df30 0x7fc6e4135400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56860/0 (socket says 172.21.15.40:56860) 2023-09-30T22:29:35.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.404+0000 7fc6e3fff700 1 -- 172.21.15.40:0/2943038703 learned_addr learned my addr 172.21.15.40:0/2943038703 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:35.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.404+0000 7fc6e8cf6700 1 --1- 172.21.15.40:0/2943038703 >> v1:172.21.15.40:6789/0 conn(0x7fc6e409d450 0x7fc6e409d820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38724/0 (socket says 172.21.15.40:38724) 2023-09-30T22:29:35.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.405+0000 7fc6e94f7700 1 -- 172.21.15.40:0/2943038703 >> v2:172.21.15.40:3300/0 conn(0x7fc6e409df30 msgr2=0x7fc6e4135400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:35.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.405+0000 7fc6e94f7700 1 --2- 172.21.15.40:0/2943038703 >> v2:172.21.15.40:3300/0 conn(0x7fc6e409df30 0x7fc6e4135400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.405+0000 7fc6e94f7700 1 -- 172.21.15.40:0/2943038703 >> v1:172.21.15.40:6789/0 conn(0x7fc6e409d450 legacy=0x7fc6e409d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:35.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.405+0000 7fc6e94f7700 1 -- 172.21.15.40:0/2943038703 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e409b4f0 con 0x7fc6e4135940 2023-09-30T22:29:35.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.405+0000 7fc6e37fe700 1 -- 172.21.15.40:0/2943038703 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2733060509 0 0) 0x7fc6e409e8b0 con 0x7fc6e409d450 2023-09-30T22:29:35.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.405+0000 7fc6e3fff700 1 --2- 172.21.15.40:0/2943038703 >> v2:172.21.15.40:3300/0 conn(0x7fc6e409df30 0x7fc6e4135400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:35.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.405+0000 7fc6e94f7700 1 --2- 172.21.15.40:0/2943038703 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6e4135940 0x7fc6e4137d20 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc009d90 tx=0x7fc6dc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=947ac926c06f7e1f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:35.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.405+0000 7fc6e37fe700 1 -- 172.21.15.40:0/2943038703 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc00e070 con 0x7fc6e4135940 2023-09-30T22:29:35.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.405+0000 7fc6e37fe700 1 -- 172.21.15.40:0/2943038703 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6dc00bb20 con 0x7fc6e4135940 2023-09-30T22:29:35.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.405+0000 7fc6e37fe700 1 -- 172.21.15.40:0/2943038703 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc012430 con 0x7fc6e4135940 2023-09-30T22:29:35.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.406+0000 7fc6eaf5a700 1 -- 172.21.15.40:0/2943038703 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6e4135940 msgr2=0x7fc6e4137d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:35.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.406+0000 7fc6eaf5a700 1 --2- 172.21.15.40:0/2943038703 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6e4135940 0x7fc6e4137d20 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc009d90 tx=0x7fc6dc00b330 comp rx=0 tx=0).stop 2023-09-30T22:29:35.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.406+0000 7fc6eaf5a700 1 -- 172.21.15.40:0/2943038703 shutdown_connections 2023-09-30T22:29:35.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.406+0000 7fc6eaf5a700 1 --2- 172.21.15.40:0/2943038703 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6e4135940 0x7fc6e4137d20 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.406+0000 7fc6eaf5a700 1 --2- 172.21.15.40:0/2943038703 >> v2:172.21.15.40:3300/0 conn(0x7fc6e409df30 0x7fc6e4135400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.406+0000 7fc6eaf5a700 1 -- 172.21.15.40:0/2943038703 >> 172.21.15.40:0/2943038703 conn(0x7fc6e40a2a00 msgr2=0x7fc6e40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:35.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.407+0000 7fc6eaf5a700 1 -- 172.21.15.40:0/2943038703 shutdown_connections 2023-09-30T22:29:35.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.407+0000 7fc6eaf5a700 1 -- 172.21.15.40:0/2943038703 wait complete. 2023-09-30T22:29:35.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.408+0000 7fc6eaf5a700 1 Processor -- start 2023-09-30T22:29:35.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.408+0000 7fc6eaf5a700 1 -- start start 2023-09-30T22:29:35.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.409+0000 7fc6eaf5a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6e409d450 0x7fc6e41332c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:35.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.409+0000 7fc6eaf5a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6e409df30 0x7fc6e4133800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:35.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.409+0000 7fc6eaf5a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc6e4135940 0x7fc6e4133d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:35.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.409+0000 7fc6eaf5a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e4135510 con 0x7fc6e409d450 2023-09-30T22:29:35.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.409+0000 7fc6eaf5a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e40a21d0 con 0x7fc6e409df30 2023-09-30T22:29:35.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.409+0000 7fc6eaf5a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e409c5d0 con 0x7fc6e4135940 2023-09-30T22:29:35.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.409+0000 7fc6e8cf6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6e409d450 0x7fc6e41332c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:35.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.409+0000 7fc6e8cf6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6e409d450 0x7fc6e41332c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56864/0 (socket says 172.21.15.40:56864) 2023-09-30T22:29:35.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.409+0000 7fc6e3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6e409df30 0x7fc6e4133800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:35.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.409+0000 7fc6e8cf6700 1 -- 172.21.15.40:0/2460912619 learned_addr learned my addr 172.21.15.40:0/2460912619 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:35.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.409+0000 7fc6e94f7700 1 --2- 172.21.15.40:0/2460912619 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc6e4135940 0x7fc6e4133d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:35.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.410+0000 7fc6e3fff700 1 -- 172.21.15.40:0/2460912619 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc6e4135940 msgr2=0x7fc6e4133d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:35.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.410+0000 7fc6e3fff700 1 --2- 172.21.15.40:0/2460912619 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc6e4135940 0x7fc6e4133d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.410+0000 7fc6e3fff700 1 -- 172.21.15.40:0/2460912619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6e409d450 msgr2=0x7fc6e41332c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:35.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.410+0000 7fc6e3fff700 1 --2- 172.21.15.40:0/2460912619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6e409d450 0x7fc6e41332c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.410+0000 7fc6e3fff700 1 -- 172.21.15.40:0/2460912619 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d000f880 con 0x7fc6e409df30 2023-09-30T22:29:35.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.410+0000 7fc6e8cf6700 1 --2- 172.21.15.40:0/2460912619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6e409d450 0x7fc6e41332c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:35.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.410+0000 7fc6e3fff700 1 --2- 172.21.15.40:0/2460912619 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6e409df30 0x7fc6e4133800 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000ebb0 tx=0x7fc6d000eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:35.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.410+0000 7fc6e17fa700 1 -- 172.21.15.40:0/2460912619 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0014040 con 0x7fc6e409df30 2023-09-30T22:29:35.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.410+0000 7fc6e17fa700 1 -- 172.21.15.40:0/2460912619 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d0009b90 con 0x7fc6e409df30 2023-09-30T22:29:35.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.410+0000 7fc6eaf5a700 1 -- 172.21.15.40:0/2460912619 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6dc009a70 con 0x7fc6e409df30 2023-09-30T22:29:35.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.410+0000 7fc6e17fa700 1 -- 172.21.15.40:0/2460912619 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d000fc20 con 0x7fc6e409df30 2023-09-30T22:29:35.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.410+0000 7fc6eaf5a700 1 -- 172.21.15.40:0/2460912619 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e4134810 con 0x7fc6e409df30 2023-09-30T22:29:35.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.411+0000 7fc6e17fa700 1 -- 172.21.15.40:0/2460912619 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc6d0022460 con 0x7fc6e409df30 2023-09-30T22:29:35.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.411+0000 7fc6e17fa700 1 -- 172.21.15.40:0/2460912619 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc6d0043870 con 0x7fc6e409df30 2023-09-30T22:29:35.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.411+0000 7fc6eaf5a700 1 -- 172.21.15.40:0/2460912619 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e4062380 con 0x7fc6e409df30 2023-09-30T22:29:35.417 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:35.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.420+0000 7fc6e17fa700 1 -- 172.21.15.40:0/2460912619 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc6d001f900 con 0x7fc6e409df30 2023-09-30T22:29:35.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.499+0000 7f7293bc9700 1 Processor -- start 2023-09-30T22:29:35.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.499+0000 7f7293bc9700 1 -- start start 2023-09-30T22:29:35.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.500+0000 7f7293bc9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f728c09d920 0x7f728c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:35.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.500+0000 7f7293bc9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f728c09e230 0x7f728c1308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:35.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.500+0000 7f7293bc9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f728c130de0 0x7f728c131260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:35.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.500+0000 7f7293bc9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f728c09edf0 con 0x7f728c09e230 2023-09-30T22:29:35.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.500+0000 7f7293bc9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f728c09adf0 con 0x7f728c09d920 2023-09-30T22:29:35.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.500+0000 7f7293bc9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f728c09b660 con 0x7f728c130de0 2023-09-30T22:29:35.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.500+0000 7f7291965700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f728c09d920 0x7f728c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:35.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.500+0000 7f7291965700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f728c09d920 0x7f728c09dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60394/0 (socket says 172.21.15.40:60394) 2023-09-30T22:29:35.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.500+0000 7f7291965700 1 -- 172.21.15.40:0/800231547 learned_addr learned my addr 172.21.15.40:0/800231547 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:35.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.500+0000 7f7291164700 1 --2- 172.21.15.40:0/800231547 >> v2:172.21.15.40:3300/0 conn(0x7f728c09e230 0x7f728c1308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:35.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.501+0000 7f7292166700 1 --2- 172.21.15.40:0/800231547 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f728c130de0 0x7f728c131260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:35.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.501+0000 7f7291164700 1 -- 172.21.15.40:0/800231547 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f728c130de0 msgr2=0x7f728c131260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:35.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.501+0000 7f7291164700 1 --2- 172.21.15.40:0/800231547 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f728c130de0 0x7f728c131260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.501+0000 7f7291164700 1 -- 172.21.15.40:0/800231547 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f728c09d920 msgr2=0x7f728c09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:35.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.501+0000 7f7291164700 1 --2- 172.21.15.40:0/800231547 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f728c09d920 0x7f728c09dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.501+0000 7f7291164700 1 -- 172.21.15.40:0/800231547 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f728c09a6e0 con 0x7f728c09e230 2023-09-30T22:29:35.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.501+0000 7f7291965700 1 --2- 172.21.15.40:0/800231547 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f728c09d920 0x7f728c09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:35.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.501+0000 7f7291164700 1 --2- 172.21.15.40:0/800231547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f728c09e230 0x7f728c1308a0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f727c009840 tx=0x7f727c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51f02095101704b7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:35.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.501+0000 7f7290963700 1 -- 172.21.15.40:0/800231547 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c011830 con 0x7f728c09e230 2023-09-30T22:29:35.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.501+0000 7f7290963700 1 -- 172.21.15.40:0/800231547 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727c011990 con 0x7f728c09e230 2023-09-30T22:29:35.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.501+0000 7f7290963700 1 -- 172.21.15.40:0/800231547 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c011d20 con 0x7f728c09e230 2023-09-30T22:29:35.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.502+0000 7f7293bc9700 1 -- 172.21.15.40:0/800231547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f728c09e230 msgr2=0x7f728c1308a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:35.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.502+0000 7f7293bc9700 1 --2- 172.21.15.40:0/800231547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f728c09e230 0x7f728c1308a0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f727c009840 tx=0x7f727c009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:35.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.502+0000 7f7293bc9700 1 -- 172.21.15.40:0/800231547 shutdown_connections 2023-09-30T22:29:35.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.502+0000 7f7293bc9700 1 --2- 172.21.15.40:0/800231547 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f728c130de0 0x7f728c131260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.502+0000 7f7293bc9700 1 --2- 172.21.15.40:0/800231547 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f728c09d920 0x7f728c09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.502+0000 7f7293bc9700 1 --2- 172.21.15.40:0/800231547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f728c09e230 0x7f728c1308a0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.502+0000 7f7293bc9700 1 -- 172.21.15.40:0/800231547 >> 172.21.15.40:0/800231547 conn(0x7f728c09fb20 msgr2=0x7f728c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:35.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.502+0000 7f7293bc9700 1 -- 172.21.15.40:0/800231547 shutdown_connections 2023-09-30T22:29:35.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.502+0000 7f7293bc9700 1 -- 172.21.15.40:0/800231547 wait complete. 2023-09-30T22:29:35.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.503+0000 7f7293bc9700 1 Processor -- start 2023-09-30T22:29:35.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.504+0000 7f7293bc9700 1 -- start start 2023-09-30T22:29:35.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.504+0000 7f7293bc9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f728c09d920 0x7f728c1c4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:35.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.504+0000 7f7293bc9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f728c09e230 0x7f728c1c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:35.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.504+0000 7f7293bc9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f728c130de0 0x7f728c119730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:35.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.504+0000 7f7293bc9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728c12c650 con 0x7f728c09d920 2023-09-30T22:29:35.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.504+0000 7f7293bc9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f728c11b630 con 0x7f728c09e230 2023-09-30T22:29:35.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.504+0000 7f7293bc9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f728c1c4100 con 0x7f728c130de0 2023-09-30T22:29:35.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.505+0000 7f7291164700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f728c09e230 0x7f728c1c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:35.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.505+0000 7f7291965700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f728c09d920 0x7f728c1c4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:35.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.505+0000 7f7291164700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f728c09e230 0x7f728c1c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60398/0 (socket says 172.21.15.40:60398) 2023-09-30T22:29:35.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.505+0000 7f7291164700 1 -- 172.21.15.40:0/2316481362 learned_addr learned my addr 172.21.15.40:0/2316481362 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:35.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.505+0000 7f7292166700 1 --2- 172.21.15.40:0/2316481362 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f728c130de0 0x7f728c119730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:35.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.505+0000 7f7291965700 1 -- 172.21.15.40:0/2316481362 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f728c130de0 msgr2=0x7f728c119730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:35.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.505+0000 7f7291965700 1 --2- 172.21.15.40:0/2316481362 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f728c130de0 0x7f728c119730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.505+0000 7f7291965700 1 -- 172.21.15.40:0/2316481362 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f728c09e230 msgr2=0x7f728c1c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:35.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.505+0000 7f7291965700 1 --2- 172.21.15.40:0/2316481362 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f728c09e230 0x7f728c1c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.505+0000 7f7291965700 1 -- 172.21.15.40:0/2316481362 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f728800b7a0 con 0x7f728c09d920 2023-09-30T22:29:35.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.505+0000 7f7291965700 1 --2- 172.21.15.40:0/2316481362 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f728c09d920 0x7f728c1c4550 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f7288010ee0 tx=0x7f728800e640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:35.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.505+0000 7f72827fc700 1 -- 172.21.15.40:0/2316481362 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728800ba20 con 0x7f728c09d920 2023-09-30T22:29:35.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.505+0000 7f72827fc700 1 -- 172.21.15.40:0/2316481362 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7288005c20 con 0x7f728c09d920 2023-09-30T22:29:35.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.505+0000 7f7293bc9700 1 -- 172.21.15.40:0/2316481362 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f727c0094a0 con 0x7f728c09d920 2023-09-30T22:29:35.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.505+0000 7f72827fc700 1 -- 172.21.15.40:0/2316481362 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728800ee70 con 0x7f728c09d920 2023-09-30T22:29:35.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.506+0000 7f7293bc9700 1 -- 172.21.15.40:0/2316481362 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f728c11c230 con 0x7f728c09d920 2023-09-30T22:29:35.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.506+0000 7f72827fc700 1 -- 172.21.15.40:0/2316481362 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7288006030 con 0x7f728c09d920 2023-09-30T22:29:35.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.507+0000 7f72827fc700 1 -- 172.21.15.40:0/2316481362 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f7288042380 con 0x7f728c09d920 2023-09-30T22:29:35.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.507+0000 7f7293bc9700 1 -- 172.21.15.40:0/2316481362 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f728c062380 con 0x7f728c09d920 2023-09-30T22:29:35.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.514+0000 7f426292e700 1 Processor -- start 2023-09-30T22:29:35.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.514+0000 7f426292e700 1 -- start start 2023-09-30T22:29:35.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.514+0000 7f426292e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f425c09d920 0x7f425c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:35.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.515+0000 7f426292e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f425c130fb0 0x7f425c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:35.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.515+0000 7f426292e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f425c09adf0 con 0x7f425c09e230 2023-09-30T22:29:35.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.515+0000 7f426292e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f425c09edf0 con 0x7f425c130fb0 2023-09-30T22:29:35.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.515+0000 7f426292e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f425c09b660 con 0x7f425c09d920 2023-09-30T22:29:35.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.515+0000 7f4253fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f425c09e230 0x7f425c1308a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38730/0 (socket says 172.21.15.40:38730) 2023-09-30T22:29:35.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.515+0000 7f4260ecb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f425c130fb0 0x7f425c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:35.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.515+0000 7f4253fff700 1 -- 172.21.15.40:0/741238702 learned_addr learned my addr 172.21.15.40:0/741238702 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:29:35.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.515+0000 7f425bfff700 1 --2- 172.21.15.40:0/741238702 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f425c09d920 0x7f425c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:35.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.515+0000 7f4260ecb700 1 -- 172.21.15.40:0/741238702 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f425c09d920 msgr2=0x7f425c09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:35.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.515+0000 7f4260ecb700 1 --2- 172.21.15.40:0/741238702 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f425c09d920 0x7f425c09dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.515+0000 7f4260ecb700 1 -- 172.21.15.40:0/741238702 >> v1:172.21.15.40:6789/0 conn(0x7f425c09e230 legacy=0x7f425c1308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:35.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.515+0000 7f4260ecb700 1 -- 172.21.15.40:0/741238702 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f425c09a6e0 con 0x7f425c130fb0 2023-09-30T22:29:35.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.515+0000 7f4260ecb700 1 --2- 172.21.15.40:0/741238702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f425c130fb0 0x7f425c138d10 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f4254009d90 tx=0x7f425400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b4104f28654d963 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:35.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.516+0000 7f425b7fe700 1 -- 172.21.15.40:0/741238702 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425400e070 con 0x7f425c130fb0 2023-09-30T22:29:35.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.516+0000 7f425b7fe700 1 -- 172.21.15.40:0/741238702 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425400bb20 con 0x7f425c130fb0 2023-09-30T22:29:35.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.516+0000 7f425b7fe700 1 -- 172.21.15.40:0/741238702 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4254012430 con 0x7f425c130fb0 2023-09-30T22:29:35.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.516+0000 7f72827fc700 1 -- 172.21.15.40:0/2316481362 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f728800d940 con 0x7f728c09d920 2023-09-30T22:29:35.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.516+0000 7f426292e700 1 -- 172.21.15.40:0/741238702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f425c130fb0 msgr2=0x7f425c138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:35.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.516+0000 7f426292e700 1 --2- 172.21.15.40:0/741238702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f425c130fb0 0x7f425c138d10 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f4254009d90 tx=0x7f425400b330 comp rx=0 tx=0).stop 2023-09-30T22:29:35.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.517+0000 7f426292e700 1 -- 172.21.15.40:0/741238702 shutdown_connections 2023-09-30T22:29:35.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.517+0000 7f426292e700 1 --2- 172.21.15.40:0/741238702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f425c130fb0 0x7f425c138d10 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.517+0000 7f426292e700 1 --2- 172.21.15.40:0/741238702 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f425c09d920 0x7f425c09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.517+0000 7f426292e700 1 -- 172.21.15.40:0/741238702 >> 172.21.15.40:0/741238702 conn(0x7f425c09fb20 msgr2=0x7f425c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:35.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.517+0000 7f426292e700 1 -- 172.21.15.40:0/741238702 shutdown_connections 2023-09-30T22:29:35.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.517+0000 7f426292e700 1 -- 172.21.15.40:0/741238702 wait complete. 2023-09-30T22:29:35.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.518+0000 7f426292e700 1 Processor -- start 2023-09-30T22:29:35.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.518+0000 7f426292e700 1 -- start start 2023-09-30T22:29:35.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.518+0000 7f426292e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f425c09d920 0x7f425c1c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:35.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.518+0000 7f426292e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f425c09e230 0x7f425c1c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:35.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.518+0000 7f426292e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f425c130fb0 0x7f425c13a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:35.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.518+0000 7f426292e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425c13bc70 con 0x7f425c09d920 2023-09-30T22:29:35.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.518+0000 7f426292e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f425c132900 con 0x7f425c130fb0 2023-09-30T22:29:35.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.518+0000 7f426292e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f425c1c8660 con 0x7f425c09e230 2023-09-30T22:29:35.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.518+0000 7f4253fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f425c09e230 0x7f425c1c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:35.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.518+0000 7f4260ecb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f425c130fb0 0x7f425c13a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:35.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.518+0000 7f4253fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f425c09e230 0x7f425c1c8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:43436/0 (socket says 172.21.15.40:43436) 2023-09-30T22:29:35.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.518+0000 7f4260ecb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f425c130fb0 0x7f425c13a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60416/0 (socket says 172.21.15.40:60416) 2023-09-30T22:29:35.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.518+0000 7f4253fff700 1 -- 172.21.15.40:0/2576657779 learned_addr learned my addr 172.21.15.40:0/2576657779 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:35.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.518+0000 7f425bfff700 1 --2- 172.21.15.40:0/2576657779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f425c09d920 0x7f425c1c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:35.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.519+0000 7f4260ecb700 1 -- 172.21.15.40:0/2576657779 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f425c09e230 msgr2=0x7f425c1c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:35.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.519+0000 7f4260ecb700 1 --2- 172.21.15.40:0/2576657779 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f425c09e230 0x7f425c1c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.519+0000 7f4260ecb700 1 -- 172.21.15.40:0/2576657779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f425c09d920 msgr2=0x7f425c1c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:35.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.519+0000 7f4260ecb700 1 --2- 172.21.15.40:0/2576657779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f425c09d920 0x7f425c1c8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.519+0000 7f4260ecb700 1 -- 172.21.15.40:0/2576657779 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4254009a70 con 0x7f425c130fb0 2023-09-30T22:29:35.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.519+0000 7f4260ecb700 1 --2- 172.21.15.40:0/2576657779 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f425c130fb0 0x7f425c13a260 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4254016000 tx=0x7f4254004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:35.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.519+0000 7f42597fa700 1 -- 172.21.15.40:0/2576657779 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4254012430 con 0x7f425c130fb0 2023-09-30T22:29:35.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.519+0000 7f42597fa700 1 -- 172.21.15.40:0/2576657779 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4254020070 con 0x7f425c130fb0 2023-09-30T22:29:35.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.519+0000 7f426292e700 1 -- 172.21.15.40:0/2576657779 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f425c139b40 con 0x7f425c130fb0 2023-09-30T22:29:35.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.519+0000 7f42597fa700 1 -- 172.21.15.40:0/2576657779 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4254012e90 con 0x7f425c130fb0 2023-09-30T22:29:35.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.519+0000 7f426292e700 1 -- 172.21.15.40:0/2576657779 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f425c09cb50 con 0x7f425c130fb0 2023-09-30T22:29:35.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.520+0000 7f42597fa700 1 -- 172.21.15.40:0/2576657779 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4254004040 con 0x7f425c130fb0 2023-09-30T22:29:35.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.520+0000 7f426292e700 1 -- 172.21.15.40:0/2576657779 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f425c062380 con 0x7f425c130fb0 2023-09-30T22:29:35.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.521+0000 7f42597fa700 1 -- 172.21.15.40:0/2576657779 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4254022070 con 0x7f425c130fb0 2023-09-30T22:29:35.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.525+0000 7f42597fa700 1 -- 172.21.15.40:0/2576657779 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4254025970 con 0x7f425c130fb0 2023-09-30T22:29:35.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.574+0000 7f9497fc0700 1 Processor -- start 2023-09-30T22:29:35.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.574+0000 7f9497fc0700 1 -- start start 2023-09-30T22:29:35.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.574+0000 7f9497fc0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f949009d920 0x7f949009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:35.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.574+0000 7f9497fc0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f949009f0f0 0x7f949009e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:35.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.574+0000 7f9497fc0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9490133ca0 0x7f9490134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:35.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.574+0000 7f9497fc0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f949006b4c0 con 0x7f949009f0f0 2023-09-30T22:29:35.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.574+0000 7f9497fc0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f949009a8f0 con 0x7f9490133ca0 2023-09-30T22:29:35.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.574+0000 7f9497fc0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f949009f940 con 0x7f949009d920 2023-09-30T22:29:35.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.575+0000 7f9495d5c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f949009d920 0x7f949009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:35.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.575+0000 7f9495d5c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f949009d920 0x7f949009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:43440/0 (socket says 172.21.15.40:43440) 2023-09-30T22:29:35.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.575+0000 7f9495d5c700 1 -- 172.21.15.40:0/1531969260 learned_addr learned my addr 172.21.15.40:0/1531969260 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:35.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.575+0000 7f949655d700 1 --2- 172.21.15.40:0/1531969260 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9490133ca0 0x7f9490134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:35.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.575+0000 7f949555b700 1 --2- 172.21.15.40:0/1531969260 >> v2:172.21.15.40:3300/0 conn(0x7f949009f0f0 0x7f949009e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:35.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.575+0000 7f949655d700 1 -- 172.21.15.40:0/1531969260 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f949009d920 msgr2=0x7f949009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:35.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.575+0000 7f949655d700 1 --2- 172.21.15.40:0/1531969260 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f949009d920 0x7f949009dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.575+0000 7f949655d700 1 -- 172.21.15.40:0/1531969260 >> v2:172.21.15.40:3300/0 conn(0x7f949009f0f0 msgr2=0x7f949009e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:35.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.575+0000 7f949655d700 1 --2- 172.21.15.40:0/1531969260 >> v2:172.21.15.40:3300/0 conn(0x7f949009f0f0 0x7f949009e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.575+0000 7f949655d700 1 -- 172.21.15.40:0/1531969260 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949009f6e0 con 0x7f9490133ca0 2023-09-30T22:29:35.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.575+0000 7f9495d5c700 1 --2- 172.21.15.40:0/1531969260 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f949009d920 0x7f949009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:35.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.575+0000 7f949655d700 1 --2- 172.21.15.40:0/1531969260 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9490133ca0 0x7f9490134140 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f9488009df0 tx=0x7f948800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bd0894fc08bff4f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:35.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.575+0000 7f9494d5a700 1 -- 172.21.15.40:0/1531969260 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948800e070 con 0x7f9490133ca0 2023-09-30T22:29:35.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.576+0000 7f9494d5a700 1 -- 172.21.15.40:0/1531969260 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948800baa0 con 0x7f9490133ca0 2023-09-30T22:29:35.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.576+0000 7f9494d5a700 1 -- 172.21.15.40:0/1531969260 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948800be50 con 0x7f9490133ca0 2023-09-30T22:29:35.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.576+0000 7f9497fc0700 1 -- 172.21.15.40:0/1531969260 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9490133ca0 msgr2=0x7f9490134140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:35.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.576+0000 7f9497fc0700 1 --2- 172.21.15.40:0/1531969260 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9490133ca0 0x7f9490134140 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f9488009df0 tx=0x7f948800b330 comp rx=0 tx=0).stop 2023-09-30T22:29:35.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.576+0000 7f9497fc0700 1 -- 172.21.15.40:0/1531969260 shutdown_connections 2023-09-30T22:29:35.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.576+0000 7f9497fc0700 1 --2- 172.21.15.40:0/1531969260 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f949009d920 0x7f949009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.576+0000 7f9497fc0700 1 --2- 172.21.15.40:0/1531969260 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9490133ca0 0x7f9490134140 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.576+0000 7f9497fc0700 1 --2- 172.21.15.40:0/1531969260 >> v2:172.21.15.40:3300/0 conn(0x7f949009f0f0 0x7f949009e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.576+0000 7f9497fc0700 1 -- 172.21.15.40:0/1531969260 >> 172.21.15.40:0/1531969260 conn(0x7f949009fb20 msgr2=0x7f949009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:35.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.576+0000 7f9497fc0700 1 -- 172.21.15.40:0/1531969260 shutdown_connections 2023-09-30T22:29:35.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.576+0000 7f9497fc0700 1 -- 172.21.15.40:0/1531969260 wait complete. 2023-09-30T22:29:35.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.577+0000 7f9497fc0700 1 Processor -- start 2023-09-30T22:29:35.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.577+0000 7f9497fc0700 1 -- start start 2023-09-30T22:29:35.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.578+0000 7f9497fc0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f949009d920 0x7f94901204e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:35.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.578+0000 7f9497fc0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9490133ca0 0x7f9490120a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:35.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.578+0000 7f9497fc0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9490124470 0x7f9490120f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:35.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.578+0000 7f9497fc0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9490122640 con 0x7f9490133ca0 2023-09-30T22:29:35.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.578+0000 7f9497fc0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9490123700 con 0x7f949009d920 2023-09-30T22:29:35.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.578+0000 7f9497fc0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f949009c9e0 con 0x7f9490124470 2023-09-30T22:29:35.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.578+0000 7f949555b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9490133ca0 0x7f9490120a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:35.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.578+0000 7f949555b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9490133ca0 0x7f9490120a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56936/0 (socket says 172.21.15.40:56936) 2023-09-30T22:29:35.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.578+0000 7f949555b700 1 -- 172.21.15.40:0/4211444777 learned_addr learned my addr 172.21.15.40:0/4211444777 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:35.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.578+0000 7f949655d700 1 --2- 172.21.15.40:0/4211444777 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9490124470 0x7f9490120f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:35.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.578+0000 7f9495d5c700 1 --2- 172.21.15.40:0/4211444777 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f949009d920 0x7f94901204e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:35.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.578+0000 7f949655d700 1 -- 172.21.15.40:0/4211444777 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f949009d920 msgr2=0x7f94901204e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:35.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.578+0000 7f949655d700 1 --2- 172.21.15.40:0/4211444777 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f949009d920 0x7f94901204e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.578+0000 7f949655d700 1 -- 172.21.15.40:0/4211444777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9490133ca0 msgr2=0x7f9490120a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:35.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.578+0000 7f949655d700 1 --2- 172.21.15.40:0/4211444777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9490133ca0 0x7f9490120a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.578+0000 7f949655d700 1 -- 172.21.15.40:0/4211444777 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948c009500 con 0x7f9490124470 2023-09-30T22:29:35.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.578+0000 7f9495d5c700 1 --2- 172.21.15.40:0/4211444777 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f949009d920 0x7f94901204e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:35.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.578+0000 7f949655d700 1 --2- 172.21.15.40:0/4211444777 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9490124470 0x7f9490120f60 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f9488016000 tx=0x7f9488004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:35.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.579+0000 7f94867fc700 1 -- 172.21.15.40:0/4211444777 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94880045d0 con 0x7f9490124470 2023-09-30T22:29:35.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.579+0000 7f94867fc700 1 -- 172.21.15.40:0/4211444777 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9488020070 con 0x7f9490124470 2023-09-30T22:29:35.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.579+0000 7f94867fc700 1 -- 172.21.15.40:0/4211444777 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9488027480 con 0x7f9490124470 2023-09-30T22:29:35.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.579+0000 7f9497fc0700 1 -- 172.21.15.40:0/4211444777 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9488009a70 con 0x7f9490124470 2023-09-30T22:29:35.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.579+0000 7f9497fc0700 1 -- 172.21.15.40:0/4211444777 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9490122060 con 0x7f9490124470 2023-09-30T22:29:35.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.580+0000 7f9497fc0700 1 -- 172.21.15.40:0/4211444777 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9490123af0 con 0x7f9490124470 2023-09-30T22:29:35.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.580+0000 7f94867fc700 1 -- 172.21.15.40:0/4211444777 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9488012430 con 0x7f9490124470 2023-09-30T22:29:35.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.580+0000 7f94867fc700 1 -- 172.21.15.40:0/4211444777 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9488022070 con 0x7f9490124470 2023-09-30T22:29:35.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.589+0000 7f94867fc700 1 -- 172.21.15.40:0/4211444777 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9490123af0 con 0x7f9490124470 2023-09-30T22:29:35.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.653+0000 7fc6eaf5a700 1 -- 172.21.15.40:0/2460912619 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc6e4074330 con 0x7fc6e409df30 2023-09-30T22:29:35.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.653+0000 7fc6e17fa700 1 -- 172.21.15.40:0/2460912619 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc6d001f310 con 0x7fc6e409df30 2023-09-30T22:29:35.654 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:35.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.656+0000 7fc6eaf5a700 1 -- 172.21.15.40:0/2460912619 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6e409df30 msgr2=0x7fc6e4133800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:35.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.656+0000 7fc6eaf5a700 1 --2- 172.21.15.40:0/2460912619 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6e409df30 0x7fc6e4133800 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000ebb0 tx=0x7fc6d000eec0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.656+0000 7fc6eaf5a700 1 -- 172.21.15.40:0/2460912619 shutdown_connections 2023-09-30T22:29:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.656+0000 7fc6eaf5a700 1 --2- 172.21.15.40:0/2460912619 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc6e4135940 0x7fc6e4133d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.656+0000 7fc6eaf5a700 1 --2- 172.21.15.40:0/2460912619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6e409d450 0x7fc6e41332c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.656+0000 7fc6eaf5a700 1 --2- 172.21.15.40:0/2460912619 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6e409df30 0x7fc6e4133800 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.656+0000 7fc6eaf5a700 1 -- 172.21.15.40:0/2460912619 >> 172.21.15.40:0/2460912619 conn(0x7fc6e40a2a00 msgr2=0x7fc6e406e290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.656+0000 7fc6eaf5a700 1 -- 172.21.15.40:0/2460912619 shutdown_connections 2023-09-30T22:29:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.656+0000 7fc6eaf5a700 1 -- 172.21.15.40:0/2460912619 wait complete. 2023-09-30T22:29:35.669 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:35.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.729+0000 7f426292e700 1 -- 172.21.15.40:0/2576657779 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f425c130a50 con 0x7f425c130fb0 2023-09-30T22:29:35.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.729+0000 7f42597fa700 1 -- 172.21.15.40:0/2576657779 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f425402f390 con 0x7f425c130fb0 2023-09-30T22:29:35.730 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:35.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.731+0000 7f426292e700 1 -- 172.21.15.40:0/2576657779 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f425c130fb0 msgr2=0x7f425c13a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:35.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.731+0000 7f426292e700 1 --2- 172.21.15.40:0/2576657779 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f425c130fb0 0x7f425c13a260 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4254016000 tx=0x7f4254004ad0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.731+0000 7f426292e700 1 -- 172.21.15.40:0/2576657779 shutdown_connections 2023-09-30T22:29:35.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.731+0000 7f426292e700 1 --2- 172.21.15.40:0/2576657779 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f425c130fb0 0x7f425c13a260 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.731+0000 7f426292e700 1 --2- 172.21.15.40:0/2576657779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f425c09d920 0x7f425c1c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.731+0000 7f426292e700 1 --2- 172.21.15.40:0/2576657779 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f425c09e230 0x7f425c1c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.731+0000 7f426292e700 1 -- 172.21.15.40:0/2576657779 >> 172.21.15.40:0/2576657779 conn(0x7f425c09fb20 msgr2=0x7f425c0a26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:35.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.731+0000 7f426292e700 1 -- 172.21.15.40:0/2576657779 shutdown_connections 2023-09-30T22:29:35.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.731+0000 7f426292e700 1 -- 172.21.15.40:0/2576657779 wait complete. 2023-09-30T22:29:35.744 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:35.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.772+0000 7f7293bc9700 1 -- 172.21.15.40:0/2316481362 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f728c11c550 con 0x7f728c09d920 2023-09-30T22:29:35.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.772+0000 7f72827fc700 1 -- 172.21.15.40:0/2316481362 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f728800d350 con 0x7f728c09d920 2023-09-30T22:29:35.773 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:35.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.774+0000 7f7293bc9700 1 -- 172.21.15.40:0/2316481362 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f728c09d920 msgr2=0x7f728c1c4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:35.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.774+0000 7f7293bc9700 1 --2- 172.21.15.40:0/2316481362 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f728c09d920 0x7f728c1c4550 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f7288010ee0 tx=0x7f728800e640 comp rx=0 tx=0).stop 2023-09-30T22:29:35.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.774+0000 7f7293bc9700 1 -- 172.21.15.40:0/2316481362 shutdown_connections 2023-09-30T22:29:35.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.774+0000 7f7293bc9700 1 --2- 172.21.15.40:0/2316481362 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f728c130de0 0x7f728c119730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.774+0000 7f7293bc9700 1 --2- 172.21.15.40:0/2316481362 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f728c09d920 0x7f728c1c4550 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.774+0000 7f7293bc9700 1 --2- 172.21.15.40:0/2316481362 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f728c09e230 0x7f728c1c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.774+0000 7f7293bc9700 1 -- 172.21.15.40:0/2316481362 >> 172.21.15.40:0/2316481362 conn(0x7f728c09fb20 msgr2=0x7f728c12dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:35.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.774+0000 7f7293bc9700 1 -- 172.21.15.40:0/2316481362 shutdown_connections 2023-09-30T22:29:35.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.774+0000 7f7293bc9700 1 -- 172.21.15.40:0/2316481362 wait complete. 2023-09-30T22:29:35.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:35.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.823+0000 7f9497fc0700 1 -- 172.21.15.40:0/4211444777 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9490123af0 con 0x7f9490124470 2023-09-30T22:29:35.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.823+0000 7f94867fc700 1 -- 172.21.15.40:0/4211444777 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9490123af0 con 0x7f9490124470 2023-09-30T22:29:35.824 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:35.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.825+0000 7f9497fc0700 1 -- 172.21.15.40:0/4211444777 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9490124470 msgr2=0x7f9490120f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:35.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.825+0000 7f9497fc0700 1 --2- 172.21.15.40:0/4211444777 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9490124470 0x7f9490120f60 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f9488016000 tx=0x7f9488004ad0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.825+0000 7f9497fc0700 1 -- 172.21.15.40:0/4211444777 shutdown_connections 2023-09-30T22:29:35.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.825+0000 7f9497fc0700 1 --2- 172.21.15.40:0/4211444777 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9490124470 0x7f9490120f60 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.825+0000 7f9497fc0700 1 --2- 172.21.15.40:0/4211444777 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f949009d920 0x7f94901204e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.825+0000 7f9497fc0700 1 --2- 172.21.15.40:0/4211444777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9490133ca0 0x7f9490120a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:35.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.825+0000 7f9497fc0700 1 -- 172.21.15.40:0/4211444777 >> 172.21.15.40:0/4211444777 conn(0x7f949009fb20 msgr2=0x7f94901bb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:35.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.825+0000 7f9497fc0700 1 -- 172.21.15.40:0/4211444777 shutdown_connections 2023-09-30T22:29:35.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:35.825+0000 7f9497fc0700 1 -- 172.21.15.40:0/4211444777 wait complete. 2023-09-30T22:29:35.838 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:36.670 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:36.746 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:36.788 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:36.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.820+0000 7fd97513a700 1 Processor -- start 2023-09-30T22:29:36.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.820+0000 7fd97513a700 1 -- start start 2023-09-30T22:29:36.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.821+0000 7fd97513a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd97006f070 0x7fd97006f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.821+0000 7fd97513a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd97006fdb0 0x7fd9700977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.821+0000 7fd97513a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd970070830 con 0x7fd97006f980 2023-09-30T22:29:36.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.821+0000 7fd97513a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd970071af0 con 0x7fd97006fdb0 2023-09-30T22:29:36.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.821+0000 7fd97513a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd970070ad0 con 0x7fd97006f070 2023-09-30T22:29:36.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.821+0000 7fd96ed9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd97006f070 0x7fd97006f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.821+0000 7fd96ed9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd97006f070 0x7fd97006f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:43452/0 (socket says 172.21.15.40:43452) 2023-09-30T22:29:36.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.821+0000 7fd96ed9d700 1 -- 172.21.15.40:0/3182704604 learned_addr learned my addr 172.21.15.40:0/3182704604 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:36.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.822+0000 7fd96ed9d700 1 -- 172.21.15.40:0/3182704604 >> v2:172.21.15.40:3300/0 conn(0x7fd97006fdb0 msgr2=0x7fd9700977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:36.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.822+0000 7fd96ed9d700 1 --2- 172.21.15.40:0/3182704604 >> v2:172.21.15.40:3300/0 conn(0x7fd97006fdb0 0x7fd9700977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.822+0000 7fd96ed9d700 1 -- 172.21.15.40:0/3182704604 >> v1:172.21.15.40:6789/0 conn(0x7fd97006f980 legacy=0x7fd970097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:36.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.822+0000 7fd96ed9d700 1 -- 172.21.15.40:0/3182704604 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd970070de0 con 0x7fd97006f070 2023-09-30T22:29:36.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.822+0000 7fd96ed9d700 1 --2- 172.21.15.40:0/3182704604 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd97006f070 0x7fd97006f440 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fd960009950 tx=0x7fd960009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b9b694881d07d9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:36.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.822+0000 7fd96dd9b700 1 -- 172.21.15.40:0/3182704604 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd960009ea0 con 0x7fd97006f070 2023-09-30T22:29:36.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.822+0000 7fd96dd9b700 1 -- 172.21.15.40:0/3182704604 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd960004230 con 0x7fd97006f070 2023-09-30T22:29:36.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.822+0000 7fd96dd9b700 1 -- 172.21.15.40:0/3182704604 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96000b7e0 con 0x7fd97006f070 2023-09-30T22:29:36.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.823+0000 7fd97513a700 1 -- 172.21.15.40:0/3182704604 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd97006f070 msgr2=0x7fd97006f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.823+0000 7fd97513a700 1 --2- 172.21.15.40:0/3182704604 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd97006f070 0x7fd97006f440 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fd960009950 tx=0x7fd960009c60 comp rx=0 tx=0).stop 2023-09-30T22:29:36.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.823+0000 7fd97513a700 1 -- 172.21.15.40:0/3182704604 shutdown_connections 2023-09-30T22:29:36.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.823+0000 7fd97513a700 1 --2- 172.21.15.40:0/3182704604 >> v2:172.21.15.40:3300/0 conn(0x7fd97006fdb0 0x7fd9700977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.823+0000 7fd97513a700 1 --2- 172.21.15.40:0/3182704604 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd97006f070 0x7fd97006f440 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.823+0000 7fd97513a700 1 -- 172.21.15.40:0/3182704604 >> 172.21.15.40:0/3182704604 conn(0x7fd9700a41a0 msgr2=0x7fd9700a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:36.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.823+0000 7fd97513a700 1 -- 172.21.15.40:0/3182704604 shutdown_connections 2023-09-30T22:29:36.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.823+0000 7fd97513a700 1 -- 172.21.15.40:0/3182704604 wait complete. 2023-09-30T22:29:36.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.825+0000 7fd97513a700 1 Processor -- start 2023-09-30T22:29:36.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.825+0000 7fd97513a700 1 -- start start 2023-09-30T22:29:36.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.826+0000 7fd97513a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd97006f070 0x7fd97012d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.826+0000 7fd97513a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd97006f980 0x7fd97012da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.826+0000 7fd97513a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd97006fdb0 0x7fd97012dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.826+0000 7fd97513a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97012f710 con 0x7fd97006f980 2023-09-30T22:29:36.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.826+0000 7fd97513a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd970130550 con 0x7fd97006f070 2023-09-30T22:29:36.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.826+0000 7fd97513a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd97012efa0 con 0x7fd97006fdb0 2023-09-30T22:29:36.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.826+0000 7fd96ed9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd97006f070 0x7fd97012d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.826+0000 7fd96ed9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd97006f070 0x7fd97012d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60450/0 (socket says 172.21.15.40:60450) 2023-09-30T22:29:36.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.826+0000 7fd96ed9d700 1 -- 172.21.15.40:0/2102096970 learned_addr learned my addr 172.21.15.40:0/2102096970 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:36.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.826+0000 7fd96f59e700 1 --2- 172.21.15.40:0/2102096970 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd97006fdb0 0x7fd97012dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.826+0000 7fd96e59c700 1 --2- 172.21.15.40:0/2102096970 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd97006f980 0x7fd97012da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.826+0000 7fd96ed9d700 1 -- 172.21.15.40:0/2102096970 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd97006fdb0 msgr2=0x7fd97012dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.826+0000 7fd96ed9d700 1 --2- 172.21.15.40:0/2102096970 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd97006fdb0 0x7fd97012dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.826+0000 7fd96ed9d700 1 -- 172.21.15.40:0/2102096970 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd97006f980 msgr2=0x7fd97012da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.826+0000 7fd96ed9d700 1 --2- 172.21.15.40:0/2102096970 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd97006f980 0x7fd97012da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.826+0000 7fd96ed9d700 1 -- 172.21.15.40:0/2102096970 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd960009550 con 0x7fd97006f070 2023-09-30T22:29:36.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.826+0000 7fd96ed9d700 1 --2- 172.21.15.40:0/2102096970 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd97006f070 0x7fd97012d530 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fd960009130 tx=0x7fd960004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:36.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.827+0000 7fd9577fe700 1 -- 172.21.15.40:0/2102096970 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96000bea0 con 0x7fd97006f070 2023-09-30T22:29:36.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.827+0000 7fd9577fe700 1 -- 172.21.15.40:0/2102096970 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd960020860 con 0x7fd97006f070 2023-09-30T22:29:36.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.827+0000 7fd9577fe700 1 -- 172.21.15.40:0/2102096970 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd960020c30 con 0x7fd97006f070 2023-09-30T22:29:36.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.827+0000 7fd97513a700 1 -- 172.21.15.40:0/2102096970 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9701307f0 con 0x7fd97006f070 2023-09-30T22:29:36.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.827+0000 7fd97513a700 1 -- 172.21.15.40:0/2102096970 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd970130ab0 con 0x7fd97006f070 2023-09-30T22:29:36.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.828+0000 7fd9577fe700 1 -- 172.21.15.40:0/2102096970 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd960026020 con 0x7fd97006f070 2023-09-30T22:29:36.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.828+0000 7fd9577fe700 1 -- 172.21.15.40:0/2102096970 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd960045270 con 0x7fd97006f070 2023-09-30T22:29:36.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.828+0000 7fd97513a700 1 -- 172.21.15.40:0/2102096970 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd970130ca0 con 0x7fd97006f070 2023-09-30T22:29:36.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.833+0000 7fd9577fe700 1 -- 172.21.15.40:0/2102096970 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd9600283d0 con 0x7fd97006f070 2023-09-30T22:29:36.839 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:36.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.920+0000 7fa41830f700 1 Processor -- start 2023-09-30T22:29:36.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.920+0000 7fa41830f700 1 -- start start 2023-09-30T22:29:36.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.920+0000 7fa41830f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa41006a6d0 0x7fa41006aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.920+0000 7fa41830f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa41006afe0 0x7fa4101318b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.920+0000 7fa41830f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa410131df0 0x7fa410132270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.920+0000 7fa41830f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa41009eb50 con 0x7fa41006a6d0 2023-09-30T22:29:36.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.920+0000 7fa41830f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa41009dde0 con 0x7fa41006afe0 2023-09-30T22:29:36.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.920+0000 7fa41830f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa41009d4a0 con 0x7fa410131df0 2023-09-30T22:29:36.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.921+0000 7fa4158aa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa41006afe0 0x7fa4101318b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.921+0000 7fa4160ab700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa41006a6d0 0x7fa41006aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.921+0000 7fa4168ac700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa410131df0 0x7fa410132270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.921+0000 7fa4158aa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa41006afe0 0x7fa4101318b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60460/0 (socket says 172.21.15.40:60460) 2023-09-30T22:29:36.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.921+0000 7fa4158aa700 1 -- 172.21.15.40:0/572104212 learned_addr learned my addr 172.21.15.40:0/572104212 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:36.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.921+0000 7fa4168ac700 1 -- 172.21.15.40:0/572104212 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa41006afe0 msgr2=0x7fa4101318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:36.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.921+0000 7fa4168ac700 1 --2- 172.21.15.40:0/572104212 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa41006afe0 0x7fa4101318b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.921+0000 7fa4168ac700 1 -- 172.21.15.40:0/572104212 >> v2:172.21.15.40:3300/0 conn(0x7fa41006a6d0 msgr2=0x7fa41006aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:36.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.921+0000 7fa4168ac700 1 --2- 172.21.15.40:0/572104212 >> v2:172.21.15.40:3300/0 conn(0x7fa41006a6d0 0x7fa41006aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.921+0000 7fa4168ac700 1 -- 172.21.15.40:0/572104212 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa41009f5f0 con 0x7fa410131df0 2023-09-30T22:29:36.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.921+0000 7fa4160ab700 1 --2- 172.21.15.40:0/572104212 >> v2:172.21.15.40:3300/0 conn(0x7fa41006a6d0 0x7fa41006aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:36.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.921+0000 7fa4158aa700 1 --2- 172.21.15.40:0/572104212 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa41006afe0 0x7fa4101318b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:36.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.921+0000 7fa4168ac700 1 --2- 172.21.15.40:0/572104212 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa410131df0 0x7fa410132270 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa408009d90 tx=0x7fa40800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7184ff9e5f41bc01 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:36.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.921+0000 7fa4150a9700 1 -- 172.21.15.40:0/572104212 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40800bd20 con 0x7fa410131df0 2023-09-30T22:29:36.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.921+0000 7fa4150a9700 1 -- 172.21.15.40:0/572104212 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa40800be80 con 0x7fa410131df0 2023-09-30T22:29:36.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.921+0000 7fa4150a9700 1 -- 172.21.15.40:0/572104212 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa408010710 con 0x7fa410131df0 2023-09-30T22:29:36.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.922+0000 7fa41830f700 1 -- 172.21.15.40:0/572104212 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa410131df0 msgr2=0x7fa410132270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.922+0000 7fa41830f700 1 --2- 172.21.15.40:0/572104212 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa410131df0 0x7fa410132270 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa408009d90 tx=0x7fa40800b330 comp rx=0 tx=0).stop 2023-09-30T22:29:36.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.922+0000 7fa41830f700 1 -- 172.21.15.40:0/572104212 shutdown_connections 2023-09-30T22:29:36.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.922+0000 7fa41830f700 1 --2- 172.21.15.40:0/572104212 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa410131df0 0x7fa410132270 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.922+0000 7fa41830f700 1 --2- 172.21.15.40:0/572104212 >> v2:172.21.15.40:3300/0 conn(0x7fa41006a6d0 0x7fa41006aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.922+0000 7fa41830f700 1 --2- 172.21.15.40:0/572104212 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa41006afe0 0x7fa4101318b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.922+0000 7fa41830f700 1 -- 172.21.15.40:0/572104212 >> 172.21.15.40:0/572104212 conn(0x7fa41009fb20 msgr2=0x7fa41009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:36.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.922+0000 7fa41830f700 1 -- 172.21.15.40:0/572104212 shutdown_connections 2023-09-30T22:29:36.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.922+0000 7fa41830f700 1 -- 172.21.15.40:0/572104212 wait complete. 2023-09-30T22:29:36.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.924+0000 7fa41830f700 1 Processor -- start 2023-09-30T22:29:36.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.924+0000 7fa41830f700 1 -- start start 2023-09-30T22:29:36.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.925+0000 7fa41830f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa41006a6d0 0x7fa4101c4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.925+0000 7fa41830f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa41006afe0 0x7fa4101c4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.925+0000 7fa41830f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa410131df0 0x7fa41011c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.925+0000 7fa41830f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4101b9130 con 0x7fa41006afe0 2023-09-30T22:29:36.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.925+0000 7fa41830f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4101313b0 con 0x7fa41006a6d0 2023-09-30T22:29:36.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.925+0000 7fa41830f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa410120510 con 0x7fa410131df0 2023-09-30T22:29:36.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.925+0000 7fa4168ac700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa410131df0 0x7fa41011c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.925+0000 7fa4168ac700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa410131df0 0x7fa41011c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:43470/0 (socket says 172.21.15.40:43470) 2023-09-30T22:29:36.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.925+0000 7fa4168ac700 1 -- 172.21.15.40:0/1577053262 learned_addr learned my addr 172.21.15.40:0/1577053262 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:36.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.925+0000 7fa4160ab700 1 --2- 172.21.15.40:0/1577053262 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa41006a6d0 0x7fa4101c4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.925+0000 7fa4158aa700 1 --2- 172.21.15.40:0/1577053262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa41006afe0 0x7fa4101c4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.925+0000 7fa4168ac700 1 -- 172.21.15.40:0/1577053262 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa41006a6d0 msgr2=0x7fa4101c4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.925+0000 7fa4168ac700 1 --2- 172.21.15.40:0/1577053262 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa41006a6d0 0x7fa4101c4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.925+0000 7fa4168ac700 1 -- 172.21.15.40:0/1577053262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa41006afe0 msgr2=0x7fa4101c4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.925+0000 7fa4168ac700 1 --2- 172.21.15.40:0/1577053262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa41006afe0 0x7fa4101c4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.925+0000 7fa4168ac700 1 -- 172.21.15.40:0/1577053262 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa40c009430 con 0x7fa410131df0 2023-09-30T22:29:36.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.925+0000 7fa4158aa700 1 --2- 172.21.15.40:0/1577053262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa41006afe0 0x7fa4101c4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:36.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.925+0000 7fa4168ac700 1 --2- 172.21.15.40:0/1577053262 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa410131df0 0x7fa41011c880 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa40801b040 tx=0x7fa408004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:36.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.926+0000 7fa406ffd700 1 -- 172.21.15.40:0/1577053262 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4080048b0 con 0x7fa410131df0 2023-09-30T22:29:36.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.926+0000 7fa406ffd700 1 -- 172.21.15.40:0/1577053262 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa408003e10 con 0x7fa410131df0 2023-09-30T22:29:36.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.926+0000 7fa41830f700 1 -- 172.21.15.40:0/1577053262 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa400009550 con 0x7fa410131df0 2023-09-30T22:29:36.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.926+0000 7fa406ffd700 1 -- 172.21.15.40:0/1577053262 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa408010710 con 0x7fa410131df0 2023-09-30T22:29:36.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.926+0000 7fa41830f700 1 -- 172.21.15.40:0/1577053262 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa408009a70 con 0x7fa410131df0 2023-09-30T22:29:36.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.927+0000 7fa406ffd700 1 -- 172.21.15.40:0/1577053262 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa40800bd70 con 0x7fa410131df0 2023-09-30T22:29:36.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.927+0000 7fa41830f700 1 -- 172.21.15.40:0/1577053262 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa41009a8d0 con 0x7fa410131df0 2023-09-30T22:29:36.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.927+0000 7fa406ffd700 1 -- 172.21.15.40:0/1577053262 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa408045110 con 0x7fa410131df0 2023-09-30T22:29:36.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.930+0000 7f2d78cc8700 1 Processor -- start 2023-09-30T22:29:36.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.930+0000 7f2d78cc8700 1 -- start start 2023-09-30T22:29:36.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.931+0000 7f2d78cc8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2d74067820 0x7f2d7409d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.931+0000 7f2d78cc8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d74067bf0 0x7f2d7409d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.931+0000 7f2d78cc8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2d7409ded0 0x7f2d741301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.931+0000 7f2d78cc8700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d7409e8b0 con 0x7f2d7409ded0 2023-09-30T22:29:36.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.931+0000 7f2d78cc8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7409c3b0 con 0x7f2d74067bf0 2023-09-30T22:29:36.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.931+0000 7f2d78cc8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7409a6b0 con 0x7f2d74067820 2023-09-30T22:29:36.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.931+0000 7f2d7259c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2d74067820 0x7f2d7409d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.931+0000 7f2d7259c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2d74067820 0x7f2d7409d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:43474/0 (socket says 172.21.15.40:43474) 2023-09-30T22:29:36.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.931+0000 7f2d7259c700 1 -- 172.21.15.40:0/381196164 learned_addr learned my addr 172.21.15.40:0/381196164 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:36.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.931+0000 7f2d72d9d700 1 --2- 172.21.15.40:0/381196164 >> v2:172.21.15.40:3300/0 conn(0x7f2d7409ded0 0x7f2d741301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.932+0000 7f2d71d9b700 1 --2- 172.21.15.40:0/381196164 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d74067bf0 0x7f2d7409d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.932+0000 7f2d7259c700 1 -- 172.21.15.40:0/381196164 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d74067bf0 msgr2=0x7f2d7409d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:36.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.932+0000 7f2d7259c700 1 --2- 172.21.15.40:0/381196164 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d74067bf0 0x7f2d7409d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.932+0000 7f2d7259c700 1 -- 172.21.15.40:0/381196164 >> v2:172.21.15.40:3300/0 conn(0x7f2d7409ded0 msgr2=0x7f2d741301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:36.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.932+0000 7f2d7259c700 1 --2- 172.21.15.40:0/381196164 >> v2:172.21.15.40:3300/0 conn(0x7f2d7409ded0 0x7f2d741301c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.932+0000 7f2d7259c700 1 -- 172.21.15.40:0/381196164 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d7409b4f0 con 0x7f2d74067820 2023-09-30T22:29:36.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.932+0000 7f2d72d9d700 1 --2- 172.21.15.40:0/381196164 >> v2:172.21.15.40:3300/0 conn(0x7f2d7409ded0 0x7f2d741301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:36.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.932+0000 7fa406ffd700 1 -- 172.21.15.40:0/1577053262 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa408016730 con 0x7fa410131df0 2023-09-30T22:29:36.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.932+0000 7f2d7259c700 1 --2- 172.21.15.40:0/381196164 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2d74067820 0x7f2d7409d450 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f2d640098f0 tx=0x7f2d64009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d555942875b313d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:36.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.932+0000 7f2d7159a700 1 -- 172.21.15.40:0/381196164 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d64011830 con 0x7f2d74067820 2023-09-30T22:29:36.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.932+0000 7f2d7159a700 1 -- 172.21.15.40:0/381196164 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d64011990 con 0x7f2d74067820 2023-09-30T22:29:36.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.932+0000 7f2d7159a700 1 -- 172.21.15.40:0/381196164 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d64011d20 con 0x7f2d74067820 2023-09-30T22:29:36.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.933+0000 7f2d78cc8700 1 -- 172.21.15.40:0/381196164 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2d74067820 msgr2=0x7f2d7409d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.933+0000 7f2d78cc8700 1 --2- 172.21.15.40:0/381196164 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2d74067820 0x7f2d7409d450 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f2d640098f0 tx=0x7f2d64009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:36.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.933+0000 7f2d78cc8700 1 -- 172.21.15.40:0/381196164 shutdown_connections 2023-09-30T22:29:36.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.933+0000 7f2d78cc8700 1 --2- 172.21.15.40:0/381196164 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2d74067820 0x7f2d7409d450 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.933+0000 7f2d78cc8700 1 --2- 172.21.15.40:0/381196164 >> v2:172.21.15.40:3300/0 conn(0x7f2d7409ded0 0x7f2d741301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.933+0000 7f2d78cc8700 1 --2- 172.21.15.40:0/381196164 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d74067bf0 0x7f2d7409d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.933+0000 7f2d78cc8700 1 -- 172.21.15.40:0/381196164 >> 172.21.15.40:0/381196164 conn(0x7f2d740a2a00 msgr2=0x7f2d740a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:36.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.933+0000 7f2d78cc8700 1 -- 172.21.15.40:0/381196164 shutdown_connections 2023-09-30T22:29:36.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.933+0000 7f2d78cc8700 1 -- 172.21.15.40:0/381196164 wait complete. 2023-09-30T22:29:36.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.935+0000 7f2d78cc8700 1 Processor -- start 2023-09-30T22:29:36.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.935+0000 7f2d78cc8700 1 -- start start 2023-09-30T22:29:36.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.935+0000 7f2d78cc8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d74067820 0x7f2d74119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.935+0000 7f2d78cc8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d74067bf0 0x7f2d74119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.935+0000 7f2d78cc8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2d7409ded0 0x7f2d74119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.935+0000 7f2d78cc8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7411c4b0 con 0x7f2d74067820 2023-09-30T22:29:36.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.935+0000 7f2d78cc8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7409c5d0 con 0x7f2d74067bf0 2023-09-30T22:29:36.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.935+0000 7f2d78cc8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d74071e80 con 0x7f2d7409ded0 2023-09-30T22:29:36.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.936+0000 7f2d7259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d74067820 0x7f2d74119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.936+0000 7f2d7259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d74067820 0x7f2d74119050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57006/0 (socket says 172.21.15.40:57006) 2023-09-30T22:29:36.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.936+0000 7f2d7259c700 1 -- 172.21.15.40:0/3737171772 learned_addr learned my addr 172.21.15.40:0/3737171772 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:36.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.936+0000 7f2d71d9b700 1 --2- 172.21.15.40:0/3737171772 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d74067bf0 0x7f2d74119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.936+0000 7f2d72d9d700 1 --2- 172.21.15.40:0/3737171772 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2d7409ded0 0x7f2d74119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.936+0000 7f2d7259c700 1 -- 172.21.15.40:0/3737171772 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2d7409ded0 msgr2=0x7f2d74119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.936+0000 7f2d7259c700 1 --2- 172.21.15.40:0/3737171772 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2d7409ded0 0x7f2d74119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.936+0000 7f2d7259c700 1 -- 172.21.15.40:0/3737171772 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d74067bf0 msgr2=0x7f2d74119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.936+0000 7f2d7259c700 1 --2- 172.21.15.40:0/3737171772 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d74067bf0 0x7f2d74119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.936+0000 7f2d7259c700 1 -- 172.21.15.40:0/3737171772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6c009a70 con 0x7f2d74067820 2023-09-30T22:29:36.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.936+0000 7f2d72d9d700 1 --2- 172.21.15.40:0/3737171772 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2d7409ded0 0x7f2d74119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:29:36.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.936+0000 7f2d71d9b700 1 --2- 172.21.15.40:0/3737171772 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d74067bf0 0x7f2d74119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:36.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.936+0000 7f2d7259c700 1 --2- 172.21.15.40:0/3737171772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d74067820 0x7f2d74119050 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f2d64000c00 tx=0x7f2d64004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:36.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.937+0000 7f2d62ffd700 1 -- 172.21.15.40:0/3737171772 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d64004380 con 0x7f2d74067820 2023-09-30T22:29:36.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.937+0000 7f2d62ffd700 1 -- 172.21.15.40:0/3737171772 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6401f070 con 0x7f2d74067820 2023-09-30T22:29:36.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.937+0000 7f2d62ffd700 1 -- 172.21.15.40:0/3737171772 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d640036a0 con 0x7f2d74067820 2023-09-30T22:29:36.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.937+0000 7f2d78cc8700 1 -- 172.21.15.40:0/3737171772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d64009550 con 0x7f2d74067820 2023-09-30T22:29:36.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.937+0000 7f2d78cc8700 1 -- 172.21.15.40:0/3737171772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d7411c690 con 0x7f2d74067820 2023-09-30T22:29:36.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.938+0000 7f2d62ffd700 1 -- 172.21.15.40:0/3737171772 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2d64021030 con 0x7f2d74067820 2023-09-30T22:29:36.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.938+0000 7f2d78cc8700 1 -- 172.21.15.40:0/3737171772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d7411c2e0 con 0x7f2d74067820 2023-09-30T22:29:36.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.938+0000 7f2d62ffd700 1 -- 172.21.15.40:0/3737171772 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f2d64040940 con 0x7f2d74067820 2023-09-30T22:29:36.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.943+0000 7f2d62ffd700 1 -- 172.21.15.40:0/3737171772 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d640199a0 con 0x7f2d74067820 2023-09-30T22:29:36.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.980+0000 7fef3a343700 1 Processor -- start 2023-09-30T22:29:36.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.980+0000 7fef3a343700 1 -- start start 2023-09-30T22:29:36.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.981+0000 7fef3a343700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef3409fbb0 0x7fef3406c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.981+0000 7fef3a343700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef3406ced0 0x7fef3406d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.981+0000 7fef3a343700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef34138370 0x7fef3413a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.981+0000 7fef3a343700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef3409ff80 con 0x7fef3406ced0 2023-09-30T22:29:36.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.981+0000 7fef3a343700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef3406ec40 con 0x7fef3409fbb0 2023-09-30T22:29:36.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.981+0000 7fef3a343700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef3406f510 con 0x7fef34138370 2023-09-30T22:29:36.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.981+0000 7fef33fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef3409fbb0 0x7fef3406c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.981+0000 7fef33fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef3409fbb0 0x7fef3406c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60500/0 (socket says 172.21.15.40:60500) 2023-09-30T22:29:36.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.981+0000 7fef33fff700 1 -- 172.21.15.40:0/4175263079 learned_addr learned my addr 172.21.15.40:0/4175263079 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:36.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.981+0000 7fef337fe700 1 --2- 172.21.15.40:0/4175263079 >> v2:172.21.15.40:3300/0 conn(0x7fef3406ced0 0x7fef3406d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.981+0000 7fef388e0700 1 --2- 172.21.15.40:0/4175263079 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef34138370 0x7fef3413a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.982+0000 7fef388e0700 1 -- 172.21.15.40:0/4175263079 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef3409fbb0 msgr2=0x7fef3406c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:36.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.982+0000 7fef388e0700 1 --2- 172.21.15.40:0/4175263079 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef3409fbb0 0x7fef3406c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.982+0000 7fef388e0700 1 -- 172.21.15.40:0/4175263079 >> v2:172.21.15.40:3300/0 conn(0x7fef3406ced0 msgr2=0x7fef3406d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:36.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.982+0000 7fef388e0700 1 --2- 172.21.15.40:0/4175263079 >> v2:172.21.15.40:3300/0 conn(0x7fef3406ced0 0x7fef3406d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.982+0000 7fef388e0700 1 -- 172.21.15.40:0/4175263079 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef3406e3f0 con 0x7fef34138370 2023-09-30T22:29:36.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.982+0000 7fef337fe700 1 --2- 172.21.15.40:0/4175263079 >> v2:172.21.15.40:3300/0 conn(0x7fef3406ced0 0x7fef3406d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:36.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.982+0000 7fef388e0700 1 --2- 172.21.15.40:0/4175263079 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef34138370 0x7fef3413a750 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fef2c009dc0 tx=0x7fef2c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88884e2f376afe2d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:36.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.982+0000 7fef32ffd700 1 -- 172.21.15.40:0/4175263079 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2c00e070 con 0x7fef34138370 2023-09-30T22:29:36.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.982+0000 7fef32ffd700 1 -- 172.21.15.40:0/4175263079 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2c00bae0 con 0x7fef34138370 2023-09-30T22:29:36.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.982+0000 7fef32ffd700 1 -- 172.21.15.40:0/4175263079 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2c00be90 con 0x7fef34138370 2023-09-30T22:29:36.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.983+0000 7fef3a343700 1 -- 172.21.15.40:0/4175263079 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef34138370 msgr2=0x7fef3413a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.983+0000 7fef3a343700 1 --2- 172.21.15.40:0/4175263079 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef34138370 0x7fef3413a750 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fef2c009dc0 tx=0x7fef2c00b330 comp rx=0 tx=0).stop 2023-09-30T22:29:36.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.983+0000 7fef3a343700 1 -- 172.21.15.40:0/4175263079 shutdown_connections 2023-09-30T22:29:36.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.983+0000 7fef3a343700 1 --2- 172.21.15.40:0/4175263079 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef34138370 0x7fef3413a750 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.983+0000 7fef3a343700 1 --2- 172.21.15.40:0/4175263079 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef3409fbb0 0x7fef3406c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.983+0000 7fef3a343700 1 --2- 172.21.15.40:0/4175263079 >> v2:172.21.15.40:3300/0 conn(0x7fef3406ced0 0x7fef3406d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.983+0000 7fef3a343700 1 -- 172.21.15.40:0/4175263079 >> 172.21.15.40:0/4175263079 conn(0x7fef340a41a0 msgr2=0x7fef340a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:36.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.983+0000 7fef3a343700 1 -- 172.21.15.40:0/4175263079 shutdown_connections 2023-09-30T22:29:36.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.983+0000 7fef3a343700 1 -- 172.21.15.40:0/4175263079 wait complete. 2023-09-30T22:29:36.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.984+0000 7fef3a343700 1 Processor -- start 2023-09-30T22:29:36.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.984+0000 7fef3a343700 1 -- start start 2023-09-30T22:29:36.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.984+0000 7fef3a343700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef3406ced0 0x7fef341377c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.984+0000 7fef3a343700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef3409fbb0 0x7fef34137d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.984+0000 7fef3a343700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef34138370 0x7fef34095ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:36.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.984+0000 7fef3a343700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef34094d00 con 0x7fef34138370 2023-09-30T22:29:36.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.984+0000 7fef3a343700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef34094ee0 con 0x7fef3409fbb0 2023-09-30T22:29:36.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.984+0000 7fef3a343700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef340928c0 con 0x7fef3406ced0 2023-09-30T22:29:36.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.985+0000 7fef337fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef3409fbb0 0x7fef34137d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.985+0000 7fef337fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef3409fbb0 0x7fef34137d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60514/0 (socket says 172.21.15.40:60514) 2023-09-30T22:29:36.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.985+0000 7fef337fe700 1 -- 172.21.15.40:0/10597451 learned_addr learned my addr 172.21.15.40:0/10597451 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:36.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.985+0000 7fef388e0700 1 --2- 172.21.15.40:0/10597451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef34138370 0x7fef34095ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.985+0000 7fef33fff700 1 --2- 172.21.15.40:0/10597451 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef3406ced0 0x7fef341377c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:36.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.985+0000 7fef33fff700 1 -- 172.21.15.40:0/10597451 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef3409fbb0 msgr2=0x7fef34137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.985+0000 7fef33fff700 1 --2- 172.21.15.40:0/10597451 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef3409fbb0 0x7fef34137d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.985+0000 7fef33fff700 1 -- 172.21.15.40:0/10597451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef34138370 msgr2=0x7fef34095ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:36.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.985+0000 7fef33fff700 1 --2- 172.21.15.40:0/10597451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef34138370 0x7fef34095ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:36.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.985+0000 7fef33fff700 1 -- 172.21.15.40:0/10597451 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef280094a0 con 0x7fef3406ced0 2023-09-30T22:29:36.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.985+0000 7fef33fff700 1 --2- 172.21.15.40:0/10597451 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef3406ced0 0x7fef341377c0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fef2400e910 tx=0x7fef2400ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:36.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.986+0000 7fef30ff9700 1 -- 172.21.15.40:0/10597451 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef24013680 con 0x7fef3406ced0 2023-09-30T22:29:36.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.986+0000 7fef30ff9700 1 -- 172.21.15.40:0/10597451 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef240137e0 con 0x7fef3406ced0 2023-09-30T22:29:36.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.986+0000 7fef3a343700 1 -- 172.21.15.40:0/10597451 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef2c009a70 con 0x7fef3406ced0 2023-09-30T22:29:36.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.986+0000 7fef30ff9700 1 -- 172.21.15.40:0/10597451 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef24013b50 con 0x7fef3406ced0 2023-09-30T22:29:36.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.986+0000 7fef3a343700 1 -- 172.21.15.40:0/10597451 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef3406f9a0 con 0x7fef3406ced0 2023-09-30T22:29:36.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.987+0000 7fef30ff9700 1 -- 172.21.15.40:0/10597451 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fef24013cb0 con 0x7fef3406ced0 2023-09-30T22:29:36.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.987+0000 7fef3a343700 1 -- 172.21.15.40:0/10597451 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef34071db0 con 0x7fef3406ced0 2023-09-30T22:29:36.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.987+0000 7fef30ff9700 1 -- 172.21.15.40:0/10597451 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fef2403f9f0 con 0x7fef3406ced0 2023-09-30T22:29:36.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:36.992+0000 7fef30ff9700 1 -- 172.21.15.40:0/10597451 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef2401ada0 con 0x7fef3406ced0 2023-09-30T22:29:37.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.097+0000 7fd97513a700 1 -- 172.21.15.40:0/2102096970 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd970062380 con 0x7fd97006f070 2023-09-30T22:29:37.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.097+0000 7fd9577fe700 1 -- 172.21.15.40:0/2102096970 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd96001ab80 con 0x7fd97006f070 2023-09-30T22:29:37.098 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:37.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.100+0000 7fd97513a700 1 -- 172.21.15.40:0/2102096970 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd97006f070 msgr2=0x7fd97012d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:37.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.100+0000 7fd97513a700 1 --2- 172.21.15.40:0/2102096970 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd97006f070 0x7fd97012d530 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fd960009130 tx=0x7fd960004750 comp rx=0 tx=0).stop 2023-09-30T22:29:37.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.100+0000 7fd97513a700 1 -- 172.21.15.40:0/2102096970 shutdown_connections 2023-09-30T22:29:37.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.100+0000 7fd97513a700 1 --2- 172.21.15.40:0/2102096970 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd97006fdb0 0x7fd97012dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:37.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.100+0000 7fd97513a700 1 --2- 172.21.15.40:0/2102096970 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd97006f070 0x7fd97012d530 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:37.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.100+0000 7fd97513a700 1 --2- 172.21.15.40:0/2102096970 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd97006f980 0x7fd97012da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:37.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.100+0000 7fd97513a700 1 -- 172.21.15.40:0/2102096970 >> 172.21.15.40:0/2102096970 conn(0x7fd9700a41a0 msgr2=0x7fd9700a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:37.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.101+0000 7fd97513a700 1 -- 172.21.15.40:0/2102096970 shutdown_connections 2023-09-30T22:29:37.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.101+0000 7fd97513a700 1 -- 172.21.15.40:0/2102096970 wait complete. 2023-09-30T22:29:37.118 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:37.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.145+0000 7fa41830f700 1 -- 172.21.15.40:0/1577053262 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa410062380 con 0x7fa410131df0 2023-09-30T22:29:37.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.145+0000 7fa406ffd700 1 -- 172.21.15.40:0/1577053262 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa408026070 con 0x7fa410131df0 2023-09-30T22:29:37.146 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:37.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.147+0000 7fa41830f700 1 -- 172.21.15.40:0/1577053262 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa410131df0 msgr2=0x7fa41011c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:37.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.147+0000 7fa41830f700 1 --2- 172.21.15.40:0/1577053262 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa410131df0 0x7fa41011c880 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa40801b040 tx=0x7fa408004ad0 comp rx=0 tx=0).stop 2023-09-30T22:29:37.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.147+0000 7fa41830f700 1 -- 172.21.15.40:0/1577053262 shutdown_connections 2023-09-30T22:29:37.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.147+0000 7fa41830f700 1 --2- 172.21.15.40:0/1577053262 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa410131df0 0x7fa41011c880 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:37.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.147+0000 7fa41830f700 1 --2- 172.21.15.40:0/1577053262 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa41006a6d0 0x7fa4101c4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:37.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.147+0000 7fa41830f700 1 --2- 172.21.15.40:0/1577053262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa41006afe0 0x7fa4101c4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:37.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.147+0000 7fa41830f700 1 -- 172.21.15.40:0/1577053262 >> 172.21.15.40:0/1577053262 conn(0x7fa41009fb20 msgr2=0x7fa4100a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:37.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.148+0000 7fa41830f700 1 -- 172.21.15.40:0/1577053262 shutdown_connections 2023-09-30T22:29:37.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.148+0000 7fa41830f700 1 -- 172.21.15.40:0/1577053262 wait complete. 2023-09-30T22:29:37.166 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:37.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.188+0000 7f2d78cc8700 1 -- 172.21.15.40:0/3737171772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2d7409af90 con 0x7f2d74067820 2023-09-30T22:29:37.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.188+0000 7f2d62ffd700 1 -- 172.21.15.40:0/3737171772 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d64015070 con 0x7f2d74067820 2023-09-30T22:29:37.189 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:37.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.191+0000 7f2d78cc8700 1 -- 172.21.15.40:0/3737171772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d74067820 msgr2=0x7f2d74119050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:37.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.191+0000 7f2d78cc8700 1 --2- 172.21.15.40:0/3737171772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d74067820 0x7f2d74119050 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f2d64000c00 tx=0x7f2d64004750 comp rx=0 tx=0).stop 2023-09-30T22:29:37.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.191+0000 7f2d78cc8700 1 -- 172.21.15.40:0/3737171772 shutdown_connections 2023-09-30T22:29:37.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.191+0000 7f2d78cc8700 1 --2- 172.21.15.40:0/3737171772 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2d7409ded0 0x7f2d74119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:37.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.191+0000 7f2d78cc8700 1 --2- 172.21.15.40:0/3737171772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d74067820 0x7f2d74119050 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:37.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.191+0000 7f2d78cc8700 1 --2- 172.21.15.40:0/3737171772 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d74067bf0 0x7f2d74119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:37.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.191+0000 7f2d78cc8700 1 -- 172.21.15.40:0/3737171772 >> 172.21.15.40:0/3737171772 conn(0x7f2d740a2a00 msgr2=0x7f2d74134410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:37.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.191+0000 7f2d78cc8700 1 -- 172.21.15.40:0/3737171772 shutdown_connections 2023-09-30T22:29:37.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.191+0000 7f2d78cc8700 1 -- 172.21.15.40:0/3737171772 wait complete. 2023-09-30T22:29:37.203 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:37.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.219+0000 7fef3a343700 1 -- 172.21.15.40:0/10597451 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fef34062380 con 0x7fef3406ced0 2023-09-30T22:29:37.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.219+0000 7fef30ff9700 1 -- 172.21.15.40:0/10597451 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fef24017070 con 0x7fef3406ced0 2023-09-30T22:29:37.220 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:37.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.221+0000 7fef3a343700 1 -- 172.21.15.40:0/10597451 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef3406ced0 msgr2=0x7fef341377c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:37.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.221+0000 7fef3a343700 1 --2- 172.21.15.40:0/10597451 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef3406ced0 0x7fef341377c0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fef2400e910 tx=0x7fef2400ec20 comp rx=0 tx=0).stop 2023-09-30T22:29:37.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.221+0000 7fef3a343700 1 -- 172.21.15.40:0/10597451 shutdown_connections 2023-09-30T22:29:37.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.221+0000 7fef3a343700 1 --2- 172.21.15.40:0/10597451 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef3406ced0 0x7fef341377c0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:37.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.221+0000 7fef3a343700 1 --2- 172.21.15.40:0/10597451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef34138370 0x7fef34095ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:37.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.221+0000 7fef3a343700 1 --2- 172.21.15.40:0/10597451 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef3409fbb0 0x7fef34137d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:37.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.221+0000 7fef3a343700 1 -- 172.21.15.40:0/10597451 >> 172.21.15.40:0/10597451 conn(0x7fef340a41a0 msgr2=0x7fef340a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:37.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.221+0000 7fef3a343700 1 -- 172.21.15.40:0/10597451 shutdown_connections 2023-09-30T22:29:37.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:37.221+0000 7fef3a343700 1 -- 172.21.15.40:0/10597451 wait complete. 2023-09-30T22:29:37.234 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:38.119 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:38.167 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:38.204 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:38.235 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:38.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.265+0000 7fa09d51f700 1 Processor -- start 2023-09-30T22:29:38.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.265+0000 7fa09d51f700 1 -- start start 2023-09-30T22:29:38.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.266+0000 7fa09d51f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa09809d920 0x7fa09809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.266+0000 7fa09d51f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa09809f0f0 0x7fa09809e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.266+0000 7fa09d51f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa09809f940 con 0x7fa098133ca0 2023-09-30T22:29:38.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.266+0000 7fa09d51f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa09806b4c0 con 0x7fa09809d920 2023-09-30T22:29:38.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.266+0000 7fa09d51f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa09809a8f0 con 0x7fa09809f0f0 2023-09-30T22:29:38.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.266+0000 7fa096ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa09809d920 0x7fa09809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.266+0000 7fa096ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa09809d920 0x7fa09809dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60522/0 (socket says 172.21.15.40:60522) 2023-09-30T22:29:38.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.266+0000 7fa096ffd700 1 -- 172.21.15.40:0/2226299360 learned_addr learned my addr 172.21.15.40:0/2226299360 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:38.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.266+0000 7fa0967fc700 1 --2- 172.21.15.40:0/2226299360 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa09809f0f0 0x7fa09809e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.267+0000 7fa095ffb700 1 -- 172.21.15.40:0/2226299360 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1794724456 0 0) 0x7fa09809f940 con 0x7fa098133ca0 2023-09-30T22:29:38.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.267+0000 7fa095ffb700 1 -- 172.21.15.40:0/2226299360 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0800035b0 con 0x7fa098133ca0 2023-09-30T22:29:38.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.267+0000 7fa096ffd700 1 -- 172.21.15.40:0/2226299360 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa09809f0f0 msgr2=0x7fa09809e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:38.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.267+0000 7fa096ffd700 1 --2- 172.21.15.40:0/2226299360 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa09809f0f0 0x7fa09809e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.267+0000 7fa096ffd700 1 -- 172.21.15.40:0/2226299360 >> v1:172.21.15.40:6789/0 conn(0x7fa098133ca0 legacy=0x7fa098134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.267+0000 7fa096ffd700 1 -- 172.21.15.40:0/2226299360 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09809f6e0 con 0x7fa09809d920 2023-09-30T22:29:38.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.267+0000 7fa0967fc700 1 --2- 172.21.15.40:0/2226299360 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa09809f0f0 0x7fa09809e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:38.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.267+0000 7fa096ffd700 1 --2- 172.21.15.40:0/2226299360 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa09809d920 0x7fa09809dcf0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa0880098f0 tx=0x7fa088009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=598195932f01198c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:38.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.267+0000 7fa095ffb700 1 -- 172.21.15.40:0/2226299360 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa088005e30 con 0x7fa09809d920 2023-09-30T22:29:38.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.267+0000 7fa095ffb700 1 -- 172.21.15.40:0/2226299360 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa088006030 con 0x7fa09809d920 2023-09-30T22:29:38.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.267+0000 7fa095ffb700 1 -- 172.21.15.40:0/2226299360 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0880063c0 con 0x7fa09809d920 2023-09-30T22:29:38.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.268+0000 7fa09d51f700 1 -- 172.21.15.40:0/2226299360 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa09809d920 msgr2=0x7fa09809dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.268+0000 7fa09d51f700 1 --2- 172.21.15.40:0/2226299360 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa09809d920 0x7fa09809dcf0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa0880098f0 tx=0x7fa088009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:38.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.268+0000 7fa09d51f700 1 -- 172.21.15.40:0/2226299360 shutdown_connections 2023-09-30T22:29:38.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.268+0000 7fa09d51f700 1 --2- 172.21.15.40:0/2226299360 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa09809d920 0x7fa09809dcf0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.268+0000 7fa09d51f700 1 --2- 172.21.15.40:0/2226299360 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa09809f0f0 0x7fa09809e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.268+0000 7fa09d51f700 1 -- 172.21.15.40:0/2226299360 >> 172.21.15.40:0/2226299360 conn(0x7fa09809fb20 msgr2=0x7fa09809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:38.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.268+0000 7fa09d51f700 1 -- 172.21.15.40:0/2226299360 shutdown_connections 2023-09-30T22:29:38.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.268+0000 7fa09d51f700 1 -- 172.21.15.40:0/2226299360 wait complete. 2023-09-30T22:29:38.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.269+0000 7fa09d51f700 1 Processor -- start 2023-09-30T22:29:38.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.269+0000 7fa09d51f700 1 -- start start 2023-09-30T22:29:38.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.270+0000 7fa09d51f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa09809d920 0x7fa098120450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.270+0000 7fa09d51f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa098133ca0 0x7fa098120990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.270+0000 7fa09d51f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa098124430 0x7fa098120ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.270+0000 7fa09d51f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa098122020 con 0x7fa098124430 2023-09-30T22:29:38.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.270+0000 7fa09d51f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa09809c9e0 con 0x7fa09809d920 2023-09-30T22:29:38.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.270+0000 7fa09d51f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa098123c50 con 0x7fa098133ca0 2023-09-30T22:29:38.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.270+0000 7fa096ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa09809d920 0x7fa098120450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.270+0000 7fa0967fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa098133ca0 0x7fa098120990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.270+0000 7fa096ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa09809d920 0x7fa098120450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60534/0 (socket says 172.21.15.40:60534) 2023-09-30T22:29:38.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.270+0000 7fa096ffd700 1 -- 172.21.15.40:0/4184544342 learned_addr learned my addr 172.21.15.40:0/4184544342 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:38.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.270+0000 7fa0967fc700 1 -- 172.21.15.40:0/4184544342 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa09809d920 msgr2=0x7fa098120450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.270+0000 7fa0967fc700 1 --2- 172.21.15.40:0/4184544342 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa09809d920 0x7fa098120450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.270+0000 7fa0977fe700 1 --2- 172.21.15.40:0/4184544342 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa098124430 0x7fa098120ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.270+0000 7fa0967fc700 1 -- 172.21.15.40:0/4184544342 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa098124430 msgr2=0x7fa098120ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.271+0000 7fa0967fc700 1 --2- 172.21.15.40:0/4184544342 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa098124430 0x7fa098120ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.271+0000 7fa0967fc700 1 -- 172.21.15.40:0/4184544342 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa08c0094a0 con 0x7fa098133ca0 2023-09-30T22:29:38.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.271+0000 7fa096ffd700 1 --2- 172.21.15.40:0/4184544342 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa09809d920 0x7fa098120450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:38.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.271+0000 7fa0977fe700 1 --2- 172.21.15.40:0/4184544342 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa098124430 0x7fa098120ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:29:38.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.271+0000 7fa0967fc700 1 --2- 172.21.15.40:0/4184544342 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa098133ca0 0x7fa098120990 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa08c00e980 tx=0x7fa08c00ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:38.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.271+0000 7fa07f7fe700 1 -- 172.21.15.40:0/4184544342 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c00eed0 con 0x7fa098133ca0 2023-09-30T22:29:38.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.271+0000 7fa07f7fe700 1 -- 172.21.15.40:0/4184544342 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08c00c850 con 0x7fa098133ca0 2023-09-30T22:29:38.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.271+0000 7fa07f7fe700 1 -- 172.21.15.40:0/4184544342 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c00cbe0 con 0x7fa098133ca0 2023-09-30T22:29:38.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.272+0000 7fa09d51f700 1 -- 172.21.15.40:0/4184544342 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa088009500 con 0x7fa098133ca0 2023-09-30T22:29:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.272+0000 7fa09d51f700 1 -- 172.21.15.40:0/4184544342 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa098123270 con 0x7fa098133ca0 2023-09-30T22:29:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.273+0000 7fa07f7fe700 1 -- 172.21.15.40:0/4184544342 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa08c00cd40 con 0x7fa098133ca0 2023-09-30T22:29:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.273+0000 7fa09d51f700 1 -- 172.21.15.40:0/4184544342 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa098071700 con 0x7fa098133ca0 2023-09-30T22:29:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.273+0000 7fa07f7fe700 1 -- 172.21.15.40:0/4184544342 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa08c03f770 con 0x7fa098133ca0 2023-09-30T22:29:38.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.278+0000 7fa07f7fe700 1 -- 172.21.15.40:0/4184544342 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa08c0232f0 con 0x7fa098133ca0 2023-09-30T22:29:38.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.307+0000 7f8914bc0700 1 Processor -- start 2023-09-30T22:29:38.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.307+0000 7f8914bc0700 1 -- start start 2023-09-30T22:29:38.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.308+0000 7f8914bc0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f891006f070 0x7f891006f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.308+0000 7f8914bc0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f891006f980 0x7f8910097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.308+0000 7f8914bc0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8910070830 con 0x7f891006fdb0 2023-09-30T22:29:38.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.308+0000 7f8914bc0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8910071af0 con 0x7f891006f980 2023-09-30T22:29:38.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.308+0000 7f8914bc0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8910070ad0 con 0x7f891006f070 2023-09-30T22:29:38.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.309+0000 7f890dd9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f891006f980 0x7f8910097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.309+0000 7f890e59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f891006f070 0x7f891006f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.309+0000 7f890dd9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f891006f980 0x7f8910097090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57034/0 (socket says 172.21.15.40:57034) 2023-09-30T22:29:38.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.309+0000 7f890dd9b700 1 -- 172.21.15.40:0/3275875905 learned_addr learned my addr 172.21.15.40:0/3275875905 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:38.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.309+0000 7f890dd9b700 1 -- 172.21.15.40:0/3275875905 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f891006f070 msgr2=0x7f891006f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:38.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.309+0000 7f890dd9b700 1 --2- 172.21.15.40:0/3275875905 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f891006f070 0x7f891006f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.309+0000 7f890dd9b700 1 -- 172.21.15.40:0/3275875905 >> v1:172.21.15.40:6789/0 conn(0x7f891006fdb0 legacy=0x7f89100975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.309+0000 7f890dd9b700 1 -- 172.21.15.40:0/3275875905 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8910070de0 con 0x7f891006f980 2023-09-30T22:29:38.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.309+0000 7f890e59c700 1 --2- 172.21.15.40:0/3275875905 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f891006f070 0x7f891006f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:38.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.309+0000 7f890dd9b700 1 --2- 172.21.15.40:0/3275875905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f891006f980 0x7f8910097090 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f8904009920 tx=0x7f8904009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fadcec1c90b2a932 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:38.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.309+0000 7f890d59a700 1 -- 172.21.15.40:0/3275875905 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8904011830 con 0x7f891006f980 2023-09-30T22:29:38.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.310+0000 7f890d59a700 1 -- 172.21.15.40:0/3275875905 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8904011990 con 0x7f891006f980 2023-09-30T22:29:38.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.310+0000 7f890d59a700 1 -- 172.21.15.40:0/3275875905 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8904011d20 con 0x7f891006f980 2023-09-30T22:29:38.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.310+0000 7f8914bc0700 1 -- 172.21.15.40:0/3275875905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f891006f980 msgr2=0x7f8910097090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.310+0000 7f8914bc0700 1 --2- 172.21.15.40:0/3275875905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f891006f980 0x7f8910097090 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f8904009920 tx=0x7f8904009c30 comp rx=0 tx=0).stop 2023-09-30T22:29:38.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.311+0000 7f8914bc0700 1 -- 172.21.15.40:0/3275875905 shutdown_connections 2023-09-30T22:29:38.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.311+0000 7f8914bc0700 1 --2- 172.21.15.40:0/3275875905 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f891006f070 0x7f891006f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.311+0000 7f8914bc0700 1 --2- 172.21.15.40:0/3275875905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f891006f980 0x7f8910097090 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.311+0000 7f8914bc0700 1 -- 172.21.15.40:0/3275875905 >> 172.21.15.40:0/3275875905 conn(0x7f89100a41a0 msgr2=0x7f89100a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:38.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.311+0000 7f8914bc0700 1 -- 172.21.15.40:0/3275875905 shutdown_connections 2023-09-30T22:29:38.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.311+0000 7f8914bc0700 1 -- 172.21.15.40:0/3275875905 wait complete. 2023-09-30T22:29:38.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.312+0000 7f8914bc0700 1 Processor -- start 2023-09-30T22:29:38.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.312+0000 7f8914bc0700 1 -- start start 2023-09-30T22:29:38.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.312+0000 7f8914bc0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f891006f070 0x7f89101c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.312+0000 7f8914bc0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f891006f980 0x7f89101c7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.312+0000 7f8914bc0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f891006fdb0 0x7f891012d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.312+0000 7f8914bc0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891012f8a0 con 0x7f891006fdb0 2023-09-30T22:29:38.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.312+0000 7f8914bc0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8910131b20 con 0x7f891006f070 2023-09-30T22:29:38.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.312+0000 7f8914bc0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89101c7680 con 0x7f891006f980 2023-09-30T22:29:38.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.313+0000 7f890dd9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f891006f980 0x7f89101c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.313+0000 7f890dd9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f891006f980 0x7f89101c7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:43536/0 (socket says 172.21.15.40:43536) 2023-09-30T22:29:38.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.313+0000 7f890dd9b700 1 -- 172.21.15.40:0/814398406 learned_addr learned my addr 172.21.15.40:0/814398406 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.313+0000 7f890ed9d700 1 --2- 172.21.15.40:0/814398406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f891006fdb0 0x7f891012d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.313+0000 7f890e59c700 1 --2- 172.21.15.40:0/814398406 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f891006f070 0x7f89101c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.313+0000 7f890ed9d700 1 -- 172.21.15.40:0/814398406 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f891006f980 msgr2=0x7f89101c7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.313+0000 7f890ed9d700 1 --2- 172.21.15.40:0/814398406 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f891006f980 0x7f89101c7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.313+0000 7f890ed9d700 1 -- 172.21.15.40:0/814398406 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f891006f070 msgr2=0x7f89101c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.313+0000 7f890ed9d700 1 --2- 172.21.15.40:0/814398406 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f891006f070 0x7f89101c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.313+0000 7f890ed9d700 1 -- 172.21.15.40:0/814398406 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89000094a0 con 0x7f891006fdb0 2023-09-30T22:29:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.313+0000 7f890ed9d700 1 --2- 172.21.15.40:0/814398406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f891006fdb0 0x7f891012d530 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f890800cbc0 tx=0x7f890800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.313+0000 7f88feffd700 1 -- 172.21.15.40:0/814398406 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8908003c00 con 0x7f891006fdb0 2023-09-30T22:29:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.313+0000 7f88feffd700 1 -- 172.21.15.40:0/814398406 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8908003d60 con 0x7f891006fdb0 2023-09-30T22:29:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.313+0000 7f8914bc0700 1 -- 172.21.15.40:0/814398406 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8904009550 con 0x7f891006fdb0 2023-09-30T22:29:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.314+0000 7f88feffd700 1 -- 172.21.15.40:0/814398406 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890800aa60 con 0x7f891006fdb0 2023-09-30T22:29:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.314+0000 7f8914bc0700 1 -- 172.21.15.40:0/814398406 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8910130bc0 con 0x7f891006fdb0 2023-09-30T22:29:38.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.314+0000 7f88feffd700 1 -- 172.21.15.40:0/814398406 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f890800abc0 con 0x7f891006fdb0 2023-09-30T22:29:38.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.315+0000 7f8914bc0700 1 -- 172.21.15.40:0/814398406 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8910062380 con 0x7f891006fdb0 2023-09-30T22:29:38.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.315+0000 7f88feffd700 1 -- 172.21.15.40:0/814398406 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f890803f5f0 con 0x7f891006fdb0 2023-09-30T22:29:38.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.324+0000 7f88feffd700 1 -- 172.21.15.40:0/814398406 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f89080198f0 con 0x7f891006fdb0 2023-09-30T22:29:38.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.351+0000 7f1b95620700 1 Processor -- start 2023-09-30T22:29:38.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.351+0000 7f1b95620700 1 -- start start 2023-09-30T22:29:38.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.352+0000 7f1b95620700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1b90133e00 0x7f1b901341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.352+0000 7f1b95620700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1b9009d400 0x7f1b9009d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.352+0000 7f1b95620700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b90133940 con 0x7f1b9009dd70 2023-09-30T22:29:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.352+0000 7f1b95620700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b9009f0d0 con 0x7f1b9009d400 2023-09-30T22:29:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.352+0000 7f1b95620700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9009e210 con 0x7f1b90133e00 2023-09-30T22:29:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.352+0000 7f1b8e7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1b9009d400 0x7f1b9009d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.352+0000 7f1b8e7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1b9009d400 0x7f1b9009d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57046/0 (socket says 172.21.15.40:57046) 2023-09-30T22:29:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.352+0000 7f1b8e7fc700 1 -- 172.21.15.40:0/1522151695 learned_addr learned my addr 172.21.15.40:0/1522151695 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:38.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.352+0000 7f1b8effd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1b90133e00 0x7f1b901341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.352+0000 7f1b8effd700 1 -- 172.21.15.40:0/1522151695 >> v2:172.21.15.40:3300/0 conn(0x7f1b9009d400 msgr2=0x7f1b9009d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:38.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.352+0000 7f1b8effd700 1 --2- 172.21.15.40:0/1522151695 >> v2:172.21.15.40:3300/0 conn(0x7f1b9009d400 0x7f1b9009d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.352+0000 7f1b8effd700 1 -- 172.21.15.40:0/1522151695 >> v1:172.21.15.40:6789/0 conn(0x7f1b9009dd70 legacy=0x7f1b9013ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.352+0000 7f1b8effd700 1 -- 172.21.15.40:0/1522151695 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b90133be0 con 0x7f1b90133e00 2023-09-30T22:29:38.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.352+0000 7f1b8e7fc700 1 --2- 172.21.15.40:0/1522151695 >> v2:172.21.15.40:3300/0 conn(0x7f1b9009d400 0x7f1b9009d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:38.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.353+0000 7f1b8effd700 1 --2- 172.21.15.40:0/1522151695 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1b90133e00 0x7f1b901341d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f1b80009840 tx=0x7f1b80009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d36640806e9c466 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:38.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.353+0000 7f1b8dffb700 1 -- 172.21.15.40:0/1522151695 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b80011830 con 0x7f1b90133e00 2023-09-30T22:29:38.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.353+0000 7f1b8dffb700 1 -- 172.21.15.40:0/1522151695 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b80011990 con 0x7f1b90133e00 2023-09-30T22:29:38.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.353+0000 7f1b8dffb700 1 -- 172.21.15.40:0/1522151695 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b80011d20 con 0x7f1b90133e00 2023-09-30T22:29:38.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.353+0000 7f1b95620700 1 -- 172.21.15.40:0/1522151695 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1b90133e00 msgr2=0x7f1b901341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.353+0000 7f1b95620700 1 --2- 172.21.15.40:0/1522151695 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1b90133e00 0x7f1b901341d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f1b80009840 tx=0x7f1b80009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:38.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.354+0000 7f1b95620700 1 -- 172.21.15.40:0/1522151695 shutdown_connections 2023-09-30T22:29:38.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.354+0000 7f1b95620700 1 --2- 172.21.15.40:0/1522151695 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1b90133e00 0x7f1b901341d0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.354+0000 7f1b95620700 1 --2- 172.21.15.40:0/1522151695 >> v2:172.21.15.40:3300/0 conn(0x7f1b9009d400 0x7f1b9009d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.354+0000 7f1b95620700 1 -- 172.21.15.40:0/1522151695 >> 172.21.15.40:0/1522151695 conn(0x7f1b900a2a00 msgr2=0x7f1b900a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:38.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.354+0000 7f1b95620700 1 -- 172.21.15.40:0/1522151695 shutdown_connections 2023-09-30T22:29:38.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.354+0000 7f1b95620700 1 -- 172.21.15.40:0/1522151695 wait complete. 2023-09-30T22:29:38.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.355+0000 7f1b95620700 1 Processor -- start 2023-09-30T22:29:38.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.355+0000 7f1b95620700 1 -- start start 2023-09-30T22:29:38.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.355+0000 7f1b95620700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b9009d400 0x7f1b90119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.355+0000 7f1b95620700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1b9009dd70 0x7f1b90119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.356+0000 7f1b95620700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b90133e00 0x7f1b90119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.356+0000 7f1b95620700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9011bdc0 con 0x7f1b9009d400 2023-09-30T22:29:38.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.356+0000 7f1b95620700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9011b280 con 0x7f1b90133e00 2023-09-30T22:29:38.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.356+0000 7f1b95620700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b90132190 con 0x7f1b9009dd70 2023-09-30T22:29:38.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.356+0000 7f1b8effd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b9009d400 0x7f1b90119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.356+0000 7f1b8effd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b9009d400 0x7f1b90119050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57060/0 (socket says 172.21.15.40:57060) 2023-09-30T22:29:38.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.356+0000 7f1b8effd700 1 -- 172.21.15.40:0/1376437574 learned_addr learned my addr 172.21.15.40:0/1376437574 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:38.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.356+0000 7f1b8e7fc700 1 --2- 172.21.15.40:0/1376437574 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1b9009dd70 0x7f1b90119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.356+0000 7f1b8f7fe700 1 --2- 172.21.15.40:0/1376437574 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b90133e00 0x7f1b90119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.356+0000 7f1b8effd700 1 -- 172.21.15.40:0/1376437574 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1b9009dd70 msgr2=0x7f1b90119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.356+0000 7f1b8effd700 1 --2- 172.21.15.40:0/1376437574 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1b9009dd70 0x7f1b90119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.356+0000 7f1b8effd700 1 -- 172.21.15.40:0/1376437574 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b90133e00 msgr2=0x7f1b90119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.356+0000 7f1b8effd700 1 --2- 172.21.15.40:0/1376437574 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b90133e00 0x7f1b90119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.356+0000 7f1b8effd700 1 -- 172.21.15.40:0/1376437574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b84009550 con 0x7f1b9009d400 2023-09-30T22:29:38.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.356+0000 7f1b8effd700 1 --2- 172.21.15.40:0/1376437574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b9009d400 0x7f1b90119050 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f1b80000c00 tx=0x7f1b80004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:38.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.357+0000 7f1b777fe700 1 -- 172.21.15.40:0/1376437574 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b800044d0 con 0x7f1b9009d400 2023-09-30T22:29:38.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.357+0000 7f1b777fe700 1 -- 172.21.15.40:0/1376437574 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b800036a0 con 0x7f1b9009d400 2023-09-30T22:29:38.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.357+0000 7f1b777fe700 1 -- 172.21.15.40:0/1376437574 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b80003a50 con 0x7f1b9009d400 2023-09-30T22:29:38.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.357+0000 7f1b95620700 1 -- 172.21.15.40:0/1376437574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b800094a0 con 0x7f1b9009d400 2023-09-30T22:29:38.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.357+0000 7f1b95620700 1 -- 172.21.15.40:0/1376437574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b9011ac00 con 0x7f1b9009d400 2023-09-30T22:29:38.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.358+0000 7f1b777fe700 1 -- 172.21.15.40:0/1376437574 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1b80003bb0 con 0x7f1b9009d400 2023-09-30T22:29:38.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.358+0000 7f1b777fe700 1 -- 172.21.15.40:0/1376437574 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f1b800409d0 con 0x7f1b9009d400 2023-09-30T22:29:38.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.358+0000 7f1b95620700 1 -- 172.21.15.40:0/1376437574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b9011bf70 con 0x7f1b9009d400 2023-09-30T22:29:38.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.367+0000 7f1b777fe700 1 -- 172.21.15.40:0/1376437574 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1b9011bf70 con 0x7f1b9009d400 2023-09-30T22:29:38.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.397+0000 7fc10df57700 1 Processor -- start 2023-09-30T22:29:38.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.397+0000 7fc10df57700 1 -- start start 2023-09-30T22:29:38.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.397+0000 7fc10df57700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc10809d920 0x7fc10809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.397+0000 7fc10df57700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc10809e230 0x7fc1081308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.397+0000 7fc10df57700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc10809adf0 con 0x7fc108130de0 2023-09-30T22:29:38.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.397+0000 7fc10df57700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc10809edf0 con 0x7fc10809d920 2023-09-30T22:29:38.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.397+0000 7fc10df57700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc10809b660 con 0x7fc10809e230 2023-09-30T22:29:38.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.398+0000 7fc107fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc108130de0 0x7fc108137d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38770/0 (socket says 172.21.15.40:38770) 2023-09-30T22:29:38.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.398+0000 7fc107fff700 1 -- 172.21.15.40:0/2266948296 learned_addr learned my addr 172.21.15.40:0/2266948296 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:29:38.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.398+0000 7fc106ffd700 1 --2- 172.21.15.40:0/2266948296 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc10809e230 0x7fc1081308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.398+0000 7fc1077fe700 1 --2- 172.21.15.40:0/2266948296 >> v2:172.21.15.40:3300/0 conn(0x7fc10809d920 0x7fc10809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.398+0000 7fc1067fc700 1 -- 172.21.15.40:0/2266948296 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2406868310 0 0) 0x7fc10809adf0 con 0x7fc108130de0 2023-09-30T22:29:38.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.398+0000 7fc1067fc700 1 -- 172.21.15.40:0/2266948296 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0f00035b0 con 0x7fc108130de0 2023-09-30T22:29:38.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.398+0000 7fc106ffd700 1 -- 172.21.15.40:0/2266948296 >> v2:172.21.15.40:3300/0 conn(0x7fc10809d920 msgr2=0x7fc10809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:38.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.398+0000 7fc106ffd700 1 --2- 172.21.15.40:0/2266948296 >> v2:172.21.15.40:3300/0 conn(0x7fc10809d920 0x7fc10809dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.398+0000 7fc106ffd700 1 -- 172.21.15.40:0/2266948296 >> v1:172.21.15.40:6789/0 conn(0x7fc108130de0 legacy=0x7fc108137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.398+0000 7fc106ffd700 1 -- 172.21.15.40:0/2266948296 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10809a6e0 con 0x7fc10809e230 2023-09-30T22:29:38.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.398+0000 7fc106ffd700 1 --2- 172.21.15.40:0/2266948296 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc10809e230 0x7fc1081308a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc00bae0 tx=0x7fc0fc00bdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e25305d4e7ff2736 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:38.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.398+0000 7fc1067fc700 1 -- 172.21.15.40:0/2266948296 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc00dc30 con 0x7fc10809e230 2023-09-30T22:29:38.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.398+0000 7fc1067fc700 1 -- 172.21.15.40:0/2266948296 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0fc00dd90 con 0x7fc10809e230 2023-09-30T22:29:38.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.398+0000 7fc1067fc700 1 -- 172.21.15.40:0/2266948296 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc004230 con 0x7fc10809e230 2023-09-30T22:29:38.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.399+0000 7fc10df57700 1 -- 172.21.15.40:0/2266948296 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc10809e230 msgr2=0x7fc1081308a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.399+0000 7fc10df57700 1 --2- 172.21.15.40:0/2266948296 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc10809e230 0x7fc1081308a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc00bae0 tx=0x7fc0fc00bdf0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.399+0000 7fc10df57700 1 -- 172.21.15.40:0/2266948296 shutdown_connections 2023-09-30T22:29:38.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.399+0000 7fc10df57700 1 --2- 172.21.15.40:0/2266948296 >> v2:172.21.15.40:3300/0 conn(0x7fc10809d920 0x7fc10809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.399+0000 7fc10df57700 1 --2- 172.21.15.40:0/2266948296 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc10809e230 0x7fc1081308a0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.399+0000 7fc10df57700 1 -- 172.21.15.40:0/2266948296 >> 172.21.15.40:0/2266948296 conn(0x7fc10809fb20 msgr2=0x7fc10809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:38.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.399+0000 7fc10df57700 1 -- 172.21.15.40:0/2266948296 shutdown_connections 2023-09-30T22:29:38.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.399+0000 7fc10df57700 1 -- 172.21.15.40:0/2266948296 wait complete. 2023-09-30T22:29:38.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.400+0000 7fc10df57700 1 Processor -- start 2023-09-30T22:29:38.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.400+0000 7fc10df57700 1 -- start start 2023-09-30T22:29:38.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.401+0000 7fc10df57700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc10809d920 0x7fc108126790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.401+0000 7fc10df57700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc10809e230 0x7fc108126cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.401+0000 7fc10df57700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc108130de0 0x7fc108127210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:38.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.401+0000 7fc10df57700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc108127c40 con 0x7fc108130de0 2023-09-30T22:29:38.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.401+0000 7fc10df57700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc108128650 con 0x7fc10809e230 2023-09-30T22:29:38.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.401+0000 7fc10df57700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc10806b360 con 0x7fc10809d920 2023-09-30T22:29:38.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.401+0000 7fc1077fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc10809d920 0x7fc108126790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.401+0000 7fc1077fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc10809d920 0x7fc108126790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:43560/0 (socket says 172.21.15.40:43560) 2023-09-30T22:29:38.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.401+0000 7fc1077fe700 1 -- 172.21.15.40:0/2859901878 learned_addr learned my addr 172.21.15.40:0/2859901878 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:38.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.401+0000 7fc107fff700 1 --2- 172.21.15.40:0/2859901878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc108130de0 0x7fc108127210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.401+0000 7fc106ffd700 1 --2- 172.21.15.40:0/2859901878 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc10809e230 0x7fc108126cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:38.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.401+0000 7fc107fff700 1 -- 172.21.15.40:0/2859901878 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc10809d920 msgr2=0x7fc108126790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.401+0000 7fc107fff700 1 --2- 172.21.15.40:0/2859901878 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc10809d920 0x7fc108126790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.401+0000 7fc107fff700 1 -- 172.21.15.40:0/2859901878 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc10809e230 msgr2=0x7fc108126cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.401+0000 7fc107fff700 1 --2- 172.21.15.40:0/2859901878 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc10809e230 0x7fc108126cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.401+0000 7fc107fff700 1 -- 172.21.15.40:0/2859901878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0fc00b740 con 0x7fc108130de0 2023-09-30T22:29:38.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.402+0000 7fc107fff700 1 --2- 172.21.15.40:0/2859901878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc108130de0 0x7fc108127210 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fc10000cbe0 tx=0x7fc10000cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:38.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.402+0000 7fc0effff700 1 -- 172.21.15.40:0/2859901878 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10000aaa0 con 0x7fc108130de0 2023-09-30T22:29:38.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.402+0000 7fc0effff700 1 -- 172.21.15.40:0/2859901878 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10000ac00 con 0x7fc108130de0 2023-09-30T22:29:38.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.402+0000 7fc0effff700 1 -- 172.21.15.40:0/2859901878 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1000070d0 con 0x7fc108130de0 2023-09-30T22:29:38.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.402+0000 7fc10df57700 1 -- 172.21.15.40:0/2859901878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc10809cb60 con 0x7fc108130de0 2023-09-30T22:29:38.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.403+0000 7fc10df57700 1 -- 172.21.15.40:0/2859901878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc108128110 con 0x7fc108130de0 2023-09-30T22:29:38.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.403+0000 7fc0effff700 1 -- 172.21.15.40:0/2859901878 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc100007230 con 0x7fc108130de0 2023-09-30T22:29:38.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.404+0000 7fc10df57700 1 -- 172.21.15.40:0/2859901878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc108128910 con 0x7fc108130de0 2023-09-30T22:29:38.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.404+0000 7fc0effff700 1 -- 172.21.15.40:0/2859901878 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc10003f040 con 0x7fc108130de0 2023-09-30T22:29:38.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.409+0000 7fc0effff700 1 -- 172.21.15.40:0/2859901878 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc1000074e0 con 0x7fc108130de0 2023-09-30T22:29:38.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.486+0000 7fa09d51f700 1 -- 172.21.15.40:0/4184544342 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa098062380 con 0x7fa098133ca0 2023-09-30T22:29:38.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.486+0000 7fa07f7fe700 1 -- 172.21.15.40:0/4184544342 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa08c021020 con 0x7fa098133ca0 2023-09-30T22:29:38.487 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:38.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.489+0000 7fa09d51f700 1 -- 172.21.15.40:0/4184544342 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa098133ca0 msgr2=0x7fa098120990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.489+0000 7fa09d51f700 1 --2- 172.21.15.40:0/4184544342 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa098133ca0 0x7fa098120990 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa08c00e980 tx=0x7fa08c00ec90 comp rx=0 tx=0).stop 2023-09-30T22:29:38.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.489+0000 7fa09d51f700 1 -- 172.21.15.40:0/4184544342 shutdown_connections 2023-09-30T22:29:38.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.489+0000 7fa09d51f700 1 --2- 172.21.15.40:0/4184544342 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa098124430 0x7fa098120ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.489+0000 7fa09d51f700 1 --2- 172.21.15.40:0/4184544342 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa09809d920 0x7fa098120450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.489+0000 7fa09d51f700 1 --2- 172.21.15.40:0/4184544342 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa098133ca0 0x7fa098120990 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.489+0000 7fa09d51f700 1 -- 172.21.15.40:0/4184544342 >> 172.21.15.40:0/4184544342 conn(0x7fa09809fb20 msgr2=0x7fa0981bb0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:38.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.489+0000 7fa09d51f700 1 -- 172.21.15.40:0/4184544342 shutdown_connections 2023-09-30T22:29:38.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.490+0000 7fa09d51f700 1 -- 172.21.15.40:0/4184544342 wait complete. 2023-09-30T22:29:38.507 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:38.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.525+0000 7f8914bc0700 1 -- 172.21.15.40:0/814398406 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f891006f640 con 0x7f891006fdb0 2023-09-30T22:29:38.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.526+0000 7f88feffd700 1 -- 172.21.15.40:0/814398406 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8908019300 con 0x7f891006fdb0 2023-09-30T22:29:38.527 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:38.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.528+0000 7f8914bc0700 1 -- 172.21.15.40:0/814398406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f891006fdb0 msgr2=0x7f891012d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.528+0000 7f8914bc0700 1 --2- 172.21.15.40:0/814398406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f891006fdb0 0x7f891012d530 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f890800cbc0 tx=0x7f890800ced0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.528+0000 7f8914bc0700 1 -- 172.21.15.40:0/814398406 shutdown_connections 2023-09-30T22:29:38.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.528+0000 7f8914bc0700 1 --2- 172.21.15.40:0/814398406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f891006fdb0 0x7f891012d530 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.528+0000 7f8914bc0700 1 --2- 172.21.15.40:0/814398406 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f891006f070 0x7f89101c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.528+0000 7f8914bc0700 1 --2- 172.21.15.40:0/814398406 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f891006f980 0x7f89101c7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.528+0000 7f8914bc0700 1 -- 172.21.15.40:0/814398406 >> 172.21.15.40:0/814398406 conn(0x7f89100a41a0 msgr2=0x7f89100a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:38.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.528+0000 7f8914bc0700 1 -- 172.21.15.40:0/814398406 shutdown_connections 2023-09-30T22:29:38.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.528+0000 7f8914bc0700 1 -- 172.21.15.40:0/814398406 wait complete. 2023-09-30T22:29:38.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:38.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.567+0000 7f1b95620700 1 -- 172.21.15.40:0/1376437574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1b9012e200 con 0x7f1b9009d400 2023-09-30T22:29:38.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.568+0000 7f1b777fe700 1 -- 172.21.15.40:0/1376437574 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1b80003e60 con 0x7f1b9009d400 2023-09-30T22:29:38.568 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:38.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.570+0000 7f1b95620700 1 -- 172.21.15.40:0/1376437574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b9009d400 msgr2=0x7f1b90119050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.570+0000 7f1b95620700 1 --2- 172.21.15.40:0/1376437574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b9009d400 0x7f1b90119050 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f1b80000c00 tx=0x7f1b80004750 comp rx=0 tx=0).stop 2023-09-30T22:29:38.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.570+0000 7f1b95620700 1 -- 172.21.15.40:0/1376437574 shutdown_connections 2023-09-30T22:29:38.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.570+0000 7f1b95620700 1 --2- 172.21.15.40:0/1376437574 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b90133e00 0x7f1b90119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.570+0000 7f1b95620700 1 --2- 172.21.15.40:0/1376437574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b9009d400 0x7f1b90119050 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.570+0000 7f1b95620700 1 --2- 172.21.15.40:0/1376437574 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1b9009dd70 0x7f1b90119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.570+0000 7f1b95620700 1 -- 172.21.15.40:0/1376437574 >> 172.21.15.40:0/1376437574 conn(0x7f1b900a2a00 msgr2=0x7f1b9012d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:38.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.570+0000 7f1b95620700 1 -- 172.21.15.40:0/1376437574 shutdown_connections 2023-09-30T22:29:38.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.570+0000 7f1b95620700 1 -- 172.21.15.40:0/1376437574 wait complete. 2023-09-30T22:29:38.584 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:38.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.614+0000 7fc10df57700 1 -- 172.21.15.40:0/2859901878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc1081283f0 con 0x7fc108130de0 2023-09-30T22:29:38.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.614+0000 7fc0effff700 1 -- 172.21.15.40:0/2859901878 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc100018020 con 0x7fc108130de0 2023-09-30T22:29:38.615 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:38.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.616+0000 7fc10df57700 1 -- 172.21.15.40:0/2859901878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc108130de0 msgr2=0x7fc108127210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:38.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.616+0000 7fc10df57700 1 --2- 172.21.15.40:0/2859901878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc108130de0 0x7fc108127210 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fc10000cbe0 tx=0x7fc10000cef0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.616+0000 7fc10df57700 1 -- 172.21.15.40:0/2859901878 shutdown_connections 2023-09-30T22:29:38.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.616+0000 7fc10df57700 1 --2- 172.21.15.40:0/2859901878 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc10809d920 0x7fc108126790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.616+0000 7fc10df57700 1 --2- 172.21.15.40:0/2859901878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc108130de0 0x7fc108127210 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.616+0000 7fc10df57700 1 --2- 172.21.15.40:0/2859901878 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc10809e230 0x7fc108126cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:38.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.616+0000 7fc10df57700 1 -- 172.21.15.40:0/2859901878 >> 172.21.15.40:0/2859901878 conn(0x7fc10809fb20 msgr2=0x7fc10811b740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:38.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.617+0000 7fc10df57700 1 -- 172.21.15.40:0/2859901878 shutdown_connections 2023-09-30T22:29:38.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:38.617+0000 7fc10df57700 1 -- 172.21.15.40:0/2859901878 wait complete. 2023-09-30T22:29:38.629 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:39.509 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:39.542 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:39.585 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:39.630 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:39.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.667+0000 7f4ff1591700 1 Processor -- start 2023-09-30T22:29:39.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.667+0000 7f4ff1591700 1 -- start start 2023-09-30T22:29:39.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.667+0000 7f4ff1591700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4fec09d920 0x7f4fec09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.667+0000 7f4ff1591700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fec130fb0 0x7f4fec138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.667+0000 7f4ff1591700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fec09adf0 con 0x7f4fec09e230 2023-09-30T22:29:39.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.667+0000 7f4ff1591700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fec09edf0 con 0x7f4fec09d920 2023-09-30T22:29:39.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.667+0000 7f4ff1591700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fec09b660 con 0x7f4fec130fb0 2023-09-30T22:29:39.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.667+0000 7f4feb7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fec130fb0 0x7f4fec138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.667+0000 7f4feb7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fec130fb0 0x7f4fec138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60586/0 (socket says 172.21.15.40:60586) 2023-09-30T22:29:39.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.667+0000 7f4feb7fe700 1 -- 172.21.15.40:0/2721664765 learned_addr learned my addr 172.21.15.40:0/2721664765 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:39.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.668+0000 7f4feaffd700 1 --2- 172.21.15.40:0/2721664765 >> v2:172.21.15.40:3300/0 conn(0x7f4fec09d920 0x7f4fec09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.668+0000 7f4feb7fe700 1 -- 172.21.15.40:0/2721664765 >> v2:172.21.15.40:3300/0 conn(0x7f4fec09d920 msgr2=0x7f4fec09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:39.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.668+0000 7f4feb7fe700 1 --2- 172.21.15.40:0/2721664765 >> v2:172.21.15.40:3300/0 conn(0x7f4fec09d920 0x7f4fec09dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.668+0000 7f4feb7fe700 1 -- 172.21.15.40:0/2721664765 >> v1:172.21.15.40:6789/0 conn(0x7f4fec09e230 legacy=0x7f4fec1308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:39.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.668+0000 7f4feb7fe700 1 -- 172.21.15.40:0/2721664765 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fec09a6e0 con 0x7f4fec130fb0 2023-09-30T22:29:39.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.668+0000 7f4feb7fe700 1 --2- 172.21.15.40:0/2721664765 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fec130fb0 0x7f4fec138d10 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f4fe400d150 tx=0x7f4fe400d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a9b6e98ba88ad5c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:39.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.668+0000 7f4fe9ffb700 1 -- 172.21.15.40:0/2721664765 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4010070 con 0x7f4fec130fb0 2023-09-30T22:29:39.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.668+0000 7f4fe9ffb700 1 -- 172.21.15.40:0/2721664765 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe400ddc0 con 0x7f4fec130fb0 2023-09-30T22:29:39.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.668+0000 7f4fe9ffb700 1 -- 172.21.15.40:0/2721664765 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe400b310 con 0x7f4fec130fb0 2023-09-30T22:29:39.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.669+0000 7f4ff1591700 1 -- 172.21.15.40:0/2721664765 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fec130fb0 msgr2=0x7f4fec138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:39.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.669+0000 7f4ff1591700 1 --2- 172.21.15.40:0/2721664765 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fec130fb0 0x7f4fec138d10 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f4fe400d150 tx=0x7f4fe400d460 comp rx=0 tx=0).stop 2023-09-30T22:29:39.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.669+0000 7f4ff1591700 1 -- 172.21.15.40:0/2721664765 shutdown_connections 2023-09-30T22:29:39.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.669+0000 7f4ff1591700 1 --2- 172.21.15.40:0/2721664765 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fec130fb0 0x7f4fec138d10 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.669+0000 7f4ff1591700 1 --2- 172.21.15.40:0/2721664765 >> v2:172.21.15.40:3300/0 conn(0x7f4fec09d920 0x7f4fec09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.669+0000 7f4ff1591700 1 -- 172.21.15.40:0/2721664765 >> 172.21.15.40:0/2721664765 conn(0x7f4fec09fb20 msgr2=0x7f4fec09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:39.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.669+0000 7f4ff1591700 1 -- 172.21.15.40:0/2721664765 shutdown_connections 2023-09-30T22:29:39.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.669+0000 7f4ff1591700 1 -- 172.21.15.40:0/2721664765 wait complete. 2023-09-30T22:29:39.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.671+0000 7f4ff1591700 1 Processor -- start 2023-09-30T22:29:39.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.671+0000 7f4ff1591700 1 -- start start 2023-09-30T22:29:39.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.671+0000 7f4ff1591700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fec09d920 0x7f4fec12d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.672+0000 7f4ff1591700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fec09e230 0x7f4fec12d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.672+0000 7f4ff1591700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fec130fb0 0x7f4fec12de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.672+0000 7f4ff1591700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fec130c80 con 0x7f4fec09d920 2023-09-30T22:29:39.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.672+0000 7f4ff1591700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fec132300 con 0x7f4fec130fb0 2023-09-30T22:29:39.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.672+0000 7f4ff1591700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fec1386c0 con 0x7f4fec09e230 2023-09-30T22:29:39.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.672+0000 7f4feaffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fec09d920 0x7f4fec12d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.672+0000 7f4feaffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fec09d920 0x7f4fec12d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57080/0 (socket says 172.21.15.40:57080) 2023-09-30T22:29:39.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.672+0000 7f4feaffd700 1 -- 172.21.15.40:0/1186161367 learned_addr learned my addr 172.21.15.40:0/1186161367 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:39.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.672+0000 7f4fea7fc700 1 --2- 172.21.15.40:0/1186161367 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fec09e230 0x7f4fec12d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.672+0000 7f4feb7fe700 1 --2- 172.21.15.40:0/1186161367 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fec130fb0 0x7f4fec12de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.672+0000 7f4feaffd700 1 -- 172.21.15.40:0/1186161367 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fec09e230 msgr2=0x7f4fec12d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:39.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.672+0000 7f4feaffd700 1 --2- 172.21.15.40:0/1186161367 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fec09e230 0x7f4fec12d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.672+0000 7f4feaffd700 1 -- 172.21.15.40:0/1186161367 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fec130fb0 msgr2=0x7f4fec12de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:39.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.672+0000 7f4feaffd700 1 --2- 172.21.15.40:0/1186161367 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fec130fb0 0x7f4fec12de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.672+0000 7f4feaffd700 1 -- 172.21.15.40:0/1186161367 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe400bd40 con 0x7f4fec09d920 2023-09-30T22:29:39.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.672+0000 7f4fea7fc700 1 --2- 172.21.15.40:0/1186161367 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fec09e230 0x7f4fec12d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:39.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.672+0000 7f4feb7fe700 1 --2- 172.21.15.40:0/1186161367 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fec130fb0 0x7f4fec12de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:39.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.673+0000 7f4feaffd700 1 --2- 172.21.15.40:0/1186161367 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fec09d920 0x7f4fec12d400 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc00d7d0 tx=0x7f4fdc00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:39.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.673+0000 7f4fd37fe700 1 -- 172.21.15.40:0/1186161367 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc0125f0 con 0x7f4fec09d920 2023-09-30T22:29:39.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.673+0000 7f4fd37fe700 1 -- 172.21.15.40:0/1186161367 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fdc012750 con 0x7f4fec09d920 2023-09-30T22:29:39.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.673+0000 7f4ff1591700 1 -- 172.21.15.40:0/1186161367 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fec09cb00 con 0x7f4fec09d920 2023-09-30T22:29:39.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.673+0000 7f4fd37fe700 1 -- 172.21.15.40:0/1186161367 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc012b00 con 0x7f4fec09d920 2023-09-30T22:29:39.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.673+0000 7f4ff1591700 1 -- 172.21.15.40:0/1186161367 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fec12eee0 con 0x7f4fec09d920 2023-09-30T22:29:39.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.674+0000 7f4fd37fe700 1 -- 172.21.15.40:0/1186161367 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4fdc012c60 con 0x7f4fec09d920 2023-09-30T22:29:39.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.674+0000 7f4fd37fe700 1 -- 172.21.15.40:0/1186161367 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4fdc03f690 con 0x7f4fec09d920 2023-09-30T22:29:39.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.674+0000 7f4ff1591700 1 -- 172.21.15.40:0/1186161367 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fec062380 con 0x7f4fec09d920 2023-09-30T22:29:39.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.679+0000 7f4fd37fe700 1 -- 172.21.15.40:0/1186161367 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4fdc01d460 con 0x7f4fec09d920 2023-09-30T22:29:39.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.697+0000 7f8dd3f51700 1 Processor -- start 2023-09-30T22:29:39.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.697+0000 7f8dd3f51700 1 -- start start 2023-09-30T22:29:39.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.697+0000 7f8dd3f51700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8dcc09d920 0x7f8dcc09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.697+0000 7f8dd3f51700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8dcc09e230 0x7f8dcc1308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.697+0000 7f8dd3f51700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8dcc130de0 0x7f8dcc131260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.697+0000 7f8dd3f51700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dcc09edf0 con 0x7f8dcc09e230 2023-09-30T22:29:39.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.697+0000 7f8dd3f51700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc09adf0 con 0x7f8dcc09d920 2023-09-30T22:29:39.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.697+0000 7f8dd3f51700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc09b660 con 0x7f8dcc130de0 2023-09-30T22:29:39.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.698+0000 7f8dd24ee700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8dcc130de0 0x7f8dcc131260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.698+0000 7f8dd24ee700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8dcc130de0 0x7f8dcc131260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:43568/0 (socket says 172.21.15.40:43568) 2023-09-30T22:29:39.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.698+0000 7f8dd24ee700 1 -- 172.21.15.40:0/3741661519 learned_addr learned my addr 172.21.15.40:0/3741661519 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:39.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.698+0000 7f8dd14ec700 1 --2- 172.21.15.40:0/3741661519 >> v2:172.21.15.40:3300/0 conn(0x7f8dcc09e230 0x7f8dcc1308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.698+0000 7f8dd1ced700 1 --2- 172.21.15.40:0/3741661519 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8dcc09d920 0x7f8dcc09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.698+0000 7f8dd24ee700 1 -- 172.21.15.40:0/3741661519 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8dcc09d920 msgr2=0x7f8dcc09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:39.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.698+0000 7f8dd24ee700 1 --2- 172.21.15.40:0/3741661519 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8dcc09d920 0x7f8dcc09dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.698+0000 7f8dd24ee700 1 -- 172.21.15.40:0/3741661519 >> v2:172.21.15.40:3300/0 conn(0x7f8dcc09e230 msgr2=0x7f8dcc1308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:39.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.698+0000 7f8dd24ee700 1 --2- 172.21.15.40:0/3741661519 >> v2:172.21.15.40:3300/0 conn(0x7f8dcc09e230 0x7f8dcc1308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.698+0000 7f8dd24ee700 1 -- 172.21.15.40:0/3741661519 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dcc09a6e0 con 0x7f8dcc130de0 2023-09-30T22:29:39.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.698+0000 7f8dd24ee700 1 --2- 172.21.15.40:0/3741661519 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8dcc130de0 0x7f8dcc131260 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8dc4009e50 tx=0x7f8dc400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e50c6aae9031df06 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:39.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.698+0000 7f8dd0ceb700 1 -- 172.21.15.40:0/3741661519 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc400e070 con 0x7f8dcc130de0 2023-09-30T22:29:39.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.698+0000 7f8dd0ceb700 1 -- 172.21.15.40:0/3741661519 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc400b910 con 0x7f8dcc130de0 2023-09-30T22:29:39.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.698+0000 7f8dd0ceb700 1 -- 172.21.15.40:0/3741661519 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc400bca0 con 0x7f8dcc130de0 2023-09-30T22:29:39.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.699+0000 7f8dd3f51700 1 -- 172.21.15.40:0/3741661519 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8dcc130de0 msgr2=0x7f8dcc131260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:39.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.699+0000 7f8dd3f51700 1 --2- 172.21.15.40:0/3741661519 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8dcc130de0 0x7f8dcc131260 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8dc4009e50 tx=0x7f8dc400b330 comp rx=0 tx=0).stop 2023-09-30T22:29:39.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.699+0000 7f8dd3f51700 1 -- 172.21.15.40:0/3741661519 shutdown_connections 2023-09-30T22:29:39.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.699+0000 7f8dd3f51700 1 --2- 172.21.15.40:0/3741661519 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8dcc130de0 0x7f8dcc131260 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.699+0000 7f8dd3f51700 1 --2- 172.21.15.40:0/3741661519 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8dcc09d920 0x7f8dcc09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.699+0000 7f8dd3f51700 1 --2- 172.21.15.40:0/3741661519 >> v2:172.21.15.40:3300/0 conn(0x7f8dcc09e230 0x7f8dcc1308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.699+0000 7f8dd3f51700 1 -- 172.21.15.40:0/3741661519 >> 172.21.15.40:0/3741661519 conn(0x7f8dcc09fb20 msgr2=0x7f8dcc09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:39.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.700+0000 7f8dd3f51700 1 -- 172.21.15.40:0/3741661519 shutdown_connections 2023-09-30T22:29:39.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.700+0000 7f8dd3f51700 1 -- 172.21.15.40:0/3741661519 wait complete. 2023-09-30T22:29:39.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.701+0000 7f8dd3f51700 1 Processor -- start 2023-09-30T22:29:39.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.701+0000 7f8dd3f51700 1 -- start start 2023-09-30T22:29:39.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.702+0000 7f8dd3f51700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8dcc09d920 0x7f8dcc131890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.702+0000 7f8dd3f51700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8dcc09e230 0x7f8dcc131dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.702+0000 7f8dd3f51700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8dcc130de0 0x7f8dcc132310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.702+0000 7f8dd3f51700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc133330 con 0x7f8dcc09e230 2023-09-30T22:29:39.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.702+0000 7f8dd3f51700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc06af40 con 0x7f8dcc130de0 2023-09-30T22:29:39.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.702+0000 7f8dd3f51700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc134470 con 0x7f8dcc09d920 2023-09-30T22:29:39.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.702+0000 7f8dd1ced700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8dcc09d920 0x7f8dcc131890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.702+0000 7f8dd1ced700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8dcc09d920 0x7f8dcc131890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:43580/0 (socket says 172.21.15.40:43580) 2023-09-30T22:29:39.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.702+0000 7f8dd1ced700 1 -- 172.21.15.40:0/1114688518 learned_addr learned my addr 172.21.15.40:0/1114688518 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:39.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.702+0000 7f8dd24ee700 1 --2- 172.21.15.40:0/1114688518 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8dcc130de0 0x7f8dcc132310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.702+0000 7f8dd14ec700 1 --2- 172.21.15.40:0/1114688518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8dcc09e230 0x7f8dcc131dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.702+0000 7f8dd1ced700 1 -- 172.21.15.40:0/1114688518 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8dcc130de0 msgr2=0x7f8dcc132310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:39.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.702+0000 7f8dd1ced700 1 --2- 172.21.15.40:0/1114688518 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8dcc130de0 0x7f8dcc132310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.702+0000 7f8dd1ced700 1 -- 172.21.15.40:0/1114688518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8dcc09e230 msgr2=0x7f8dcc131dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:39.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.702+0000 7f8dd1ced700 1 --2- 172.21.15.40:0/1114688518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8dcc09e230 0x7f8dcc131dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.702+0000 7f8dd1ced700 1 -- 172.21.15.40:0/1114688518 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc4009b30 con 0x7f8dcc09d920 2023-09-30T22:29:39.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.702+0000 7f8dd1ced700 1 --2- 172.21.15.40:0/1114688518 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8dcc09d920 0x7f8dcc131890 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f8dc800e9b0 tx=0x7f8dc800ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:39.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.702+0000 7f8dd14ec700 1 --2- 172.21.15.40:0/1114688518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8dcc09e230 0x7f8dcc131dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:29:39.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.702+0000 7f8dc27fc700 1 -- 172.21.15.40:0/1114688518 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc800eea0 con 0x7f8dcc09d920 2023-09-30T22:29:39.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.703+0000 7f8dd3f51700 1 -- 172.21.15.40:0/1114688518 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dcc133770 con 0x7f8dcc09d920 2023-09-30T22:29:39.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.703+0000 7f8dc27fc700 1 -- 172.21.15.40:0/1114688518 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc8005a20 con 0x7f8dcc09d920 2023-09-30T22:29:39.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.703+0000 7f8dc27fc700 1 -- 172.21.15.40:0/1114688518 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc8005d90 con 0x7f8dcc09d920 2023-09-30T22:29:39.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.703+0000 7f8dd3f51700 1 -- 172.21.15.40:0/1114688518 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dcc132b00 con 0x7f8dcc09d920 2023-09-30T22:29:39.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.703+0000 7f8dc27fc700 1 -- 172.21.15.40:0/1114688518 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8dc800c850 con 0x7f8dcc09d920 2023-09-30T22:29:39.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.704+0000 7f8dc27fc700 1 -- 172.21.15.40:0/1114688518 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f8dc803f8d0 con 0x7f8dcc09d920 2023-09-30T22:29:39.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.704+0000 7f8dd3f51700 1 -- 172.21.15.40:0/1114688518 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dcc132cf0 con 0x7f8dcc09d920 2023-09-30T22:29:39.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.709+0000 7f8dc27fc700 1 -- 172.21.15.40:0/1114688518 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8dc8020020 con 0x7f8dcc09d920 2023-09-30T22:29:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.741+0000 7fc00ff2f700 1 Processor -- start 2023-09-30T22:29:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.742+0000 7fc00ff2f700 1 -- start start 2023-09-30T22:29:39.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.742+0000 7fc00ff2f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc00806f070 0x7fc00806f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.742+0000 7fc00ff2f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc00806f980 0x7fc008097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.742+0000 7fc00ff2f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc00806fdb0 0x7fc0080975d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.742+0000 7fc00ff2f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc008071af0 con 0x7fc00806fdb0 2023-09-30T22:29:39.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.742+0000 7fc00ff2f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc008070830 con 0x7fc00806f070 2023-09-30T22:29:39.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.742+0000 7fc00ff2f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc008070ad0 con 0x7fc00806f980 2023-09-30T22:29:39.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.742+0000 7fc00dccb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc00806f070 0x7fc00806f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.742+0000 7fc00e4cc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc00806fdb0 0x7fc0080975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.742+0000 7fc00dccb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc00806f070 0x7fc00806f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60626/0 (socket says 172.21.15.40:60626) 2023-09-30T22:29:39.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.742+0000 7fc00dccb700 1 -- 172.21.15.40:0/2767884835 learned_addr learned my addr 172.21.15.40:0/2767884835 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:39.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.743+0000 7fc00d4ca700 1 --2- 172.21.15.40:0/2767884835 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc00806f980 0x7fc008097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.743+0000 7fc00dccb700 1 -- 172.21.15.40:0/2767884835 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc00806f980 msgr2=0x7fc008097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:39.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.743+0000 7fc00dccb700 1 --2- 172.21.15.40:0/2767884835 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc00806f980 0x7fc008097090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.743+0000 7fc00dccb700 1 -- 172.21.15.40:0/2767884835 >> v2:172.21.15.40:3300/0 conn(0x7fc00806fdb0 msgr2=0x7fc0080975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.743+0000 7fc00dccb700 1 --2- 172.21.15.40:0/2767884835 >> v2:172.21.15.40:3300/0 conn(0x7fc00806fdb0 0x7fc0080975d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.743+0000 7fc00dccb700 1 -- 172.21.15.40:0/2767884835 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc008070de0 con 0x7fc00806f070 2023-09-30T22:29:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.743+0000 7fc00e4cc700 1 --2- 172.21.15.40:0/2767884835 >> v2:172.21.15.40:3300/0 conn(0x7fc00806fdb0 0x7fc0080975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.743+0000 7fc00dccb700 1 --2- 172.21.15.40:0/2767884835 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc00806f070 0x7fc00806f440 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc004009920 tx=0x7fc004009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d58179acf8be607 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.743+0000 7fc00ccc9700 1 -- 172.21.15.40:0/2767884835 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc004011830 con 0x7fc00806f070 2023-09-30T22:29:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.743+0000 7fc00ccc9700 1 -- 172.21.15.40:0/2767884835 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc004011990 con 0x7fc00806f070 2023-09-30T22:29:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.743+0000 7fc00ccc9700 1 -- 172.21.15.40:0/2767884835 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc004011d20 con 0x7fc00806f070 2023-09-30T22:29:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.744+0000 7fc00ff2f700 1 -- 172.21.15.40:0/2767884835 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc00806f070 msgr2=0x7fc00806f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.744+0000 7fc00ff2f700 1 --2- 172.21.15.40:0/2767884835 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc00806f070 0x7fc00806f440 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc004009920 tx=0x7fc004009c30 comp rx=0 tx=0).stop 2023-09-30T22:29:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.744+0000 7fc00ff2f700 1 -- 172.21.15.40:0/2767884835 shutdown_connections 2023-09-30T22:29:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.744+0000 7fc00ff2f700 1 --2- 172.21.15.40:0/2767884835 >> v2:172.21.15.40:3300/0 conn(0x7fc00806fdb0 0x7fc0080975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.744+0000 7fc00ff2f700 1 --2- 172.21.15.40:0/2767884835 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc00806f070 0x7fc00806f440 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.744+0000 7fc00ff2f700 1 --2- 172.21.15.40:0/2767884835 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc00806f980 0x7fc008097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.744+0000 7fc00ff2f700 1 -- 172.21.15.40:0/2767884835 >> 172.21.15.40:0/2767884835 conn(0x7fc0080a41a0 msgr2=0x7fc0080a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.744+0000 7fc00ff2f700 1 -- 172.21.15.40:0/2767884835 shutdown_connections 2023-09-30T22:29:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.744+0000 7fc00ff2f700 1 -- 172.21.15.40:0/2767884835 wait complete. 2023-09-30T22:29:39.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.745+0000 7fc00ff2f700 1 Processor -- start 2023-09-30T22:29:39.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.745+0000 7fc00ff2f700 1 -- start start 2023-09-30T22:29:39.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.745+0000 7fc00ff2f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc00806f070 0x7fc00812d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.745+0000 7fc00ff2f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc00806f980 0x7fc00812da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.745+0000 7fc00ff2f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc00806fdb0 0x7fc00812dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.745+0000 7fc00ff2f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0081305b0 con 0x7fc00806f070 2023-09-30T22:29:39.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.745+0000 7fc00ff2f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc008130950 con 0x7fc00806f980 2023-09-30T22:29:39.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.745+0000 7fc00ff2f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc00812e900 con 0x7fc00806fdb0 2023-09-30T22:29:39.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.746+0000 7fc00d4ca700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc00806f980 0x7fc00812da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.746+0000 7fc00d4ca700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc00806f980 0x7fc00812da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60640/0 (socket says 172.21.15.40:60640) 2023-09-30T22:29:39.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.746+0000 7fc00d4ca700 1 -- 172.21.15.40:0/557667424 learned_addr learned my addr 172.21.15.40:0/557667424 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:39.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.746+0000 7fc00dccb700 1 --2- 172.21.15.40:0/557667424 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc00806f070 0x7fc00812d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.746+0000 7fc00e4cc700 1 --2- 172.21.15.40:0/557667424 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc00806fdb0 0x7fc00812dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.746+0000 7fc00d4ca700 1 -- 172.21.15.40:0/557667424 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc00806fdb0 msgr2=0x7fc00812dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:39.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.746+0000 7fc00d4ca700 1 --2- 172.21.15.40:0/557667424 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc00806fdb0 0x7fc00812dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.746+0000 7fc00d4ca700 1 -- 172.21.15.40:0/557667424 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc00806f070 msgr2=0x7fc00812d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:39.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.746+0000 7fc00d4ca700 1 --2- 172.21.15.40:0/557667424 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc00806f070 0x7fc00812d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.746+0000 7fc00d4ca700 1 -- 172.21.15.40:0/557667424 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc000009a70 con 0x7fc00806f980 2023-09-30T22:29:39.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.746+0000 7fc00e4cc700 1 --2- 172.21.15.40:0/557667424 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc00806fdb0 0x7fc00812dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:39.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.746+0000 7fc00d4ca700 1 --2- 172.21.15.40:0/557667424 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc00806f980 0x7fc00812da70 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fbff800e810 tx=0x7fbff800ebd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:39.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.746+0000 7fbffe7fc700 1 -- 172.21.15.40:0/557667424 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff8013610 con 0x7fc00806f980 2023-09-30T22:29:39.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.746+0000 7fbffe7fc700 1 -- 172.21.15.40:0/557667424 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff8013770 con 0x7fc00806f980 2023-09-30T22:29:39.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.746+0000 7fc00ff2f700 1 -- 172.21.15.40:0/557667424 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc004009550 con 0x7fc00806f980 2023-09-30T22:29:39.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.746+0000 7fbffe7fc700 1 -- 172.21.15.40:0/557667424 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff8013ae0 con 0x7fc00806f980 2023-09-30T22:29:39.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.746+0000 7fc00ff2f700 1 -- 172.21.15.40:0/557667424 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc00812ece0 con 0x7fc00806f980 2023-09-30T22:29:39.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.747+0000 7fbffe7fc700 1 -- 172.21.15.40:0/557667424 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbff8013c40 con 0x7fc00806f980 2023-09-30T22:29:39.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.747+0000 7fbffe7fc700 1 -- 172.21.15.40:0/557667424 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fbff803f4b0 con 0x7fc00806f980 2023-09-30T22:29:39.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.747+0000 7fc00ff2f700 1 -- 172.21.15.40:0/557667424 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc008131730 con 0x7fc00806f980 2023-09-30T22:29:39.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.752+0000 7fbffe7fc700 1 -- 172.21.15.40:0/557667424 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbff8012370 con 0x7fc00806f980 2023-09-30T22:29:39.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.832+0000 7fc3d7d23700 1 Processor -- start 2023-09-30T22:29:39.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.833+0000 7fc3d7d23700 1 -- start start 2023-09-30T22:29:39.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.833+0000 7fc3d7d23700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3d009fbb0 0x7fc3d006c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.833+0000 7fc3d7d23700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc3d006ced0 0x7fc3d006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.833+0000 7fc3d7d23700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3d0138370 0x7fc3d013a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.833+0000 7fc3d7d23700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3d009ff80 con 0x7fc3d006ced0 2023-09-30T22:29:39.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.833+0000 7fc3d7d23700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d006da80 con 0x7fc3d0138370 2023-09-30T22:29:39.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.833+0000 7fc3d7d23700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d006d800 con 0x7fc3d009fbb0 2023-09-30T22:29:39.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.833+0000 7fc3d62c0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3d0138370 0x7fc3d013a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.833+0000 7fc3d52be700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc3d006ced0 0x7fc3d006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.833+0000 7fc3d62c0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3d0138370 0x7fc3d013a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60652/0 (socket says 172.21.15.40:60652) 2023-09-30T22:29:39.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.833+0000 7fc3d62c0700 1 -- 172.21.15.40:0/1210507386 learned_addr learned my addr 172.21.15.40:0/1210507386 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:39.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.833+0000 7fc3d52be700 1 -- 172.21.15.40:0/1210507386 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3d009fbb0 msgr2=0x7fc3d006c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:39.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.834+0000 7fc3d52be700 1 --2- 172.21.15.40:0/1210507386 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3d009fbb0 0x7fc3d006c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.834+0000 7fc3d52be700 1 -- 172.21.15.40:0/1210507386 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3d0138370 msgr2=0x7fc3d013a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:39.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.834+0000 7fc3d52be700 1 --2- 172.21.15.40:0/1210507386 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3d0138370 0x7fc3d013a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.834+0000 7fc3d52be700 1 -- 172.21.15.40:0/1210507386 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d00a0590 con 0x7fc3d006ced0 2023-09-30T22:29:39.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.834+0000 7fc3d52be700 1 --2- 172.21.15.40:0/1210507386 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3d006ced0 0x7fc3d006d2c0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0009870 tx=0x7fc3c0009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf2bb9fc42d31bd6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:39.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.834+0000 7fc3d4abd700 1 -- 172.21.15.40:0/1210507386 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0011830 con 0x7fc3d006ced0 2023-09-30T22:29:39.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.834+0000 7fc3d4abd700 1 -- 172.21.15.40:0/1210507386 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c0011990 con 0x7fc3d006ced0 2023-09-30T22:29:39.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.834+0000 7fc3d4abd700 1 -- 172.21.15.40:0/1210507386 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0011d20 con 0x7fc3d006ced0 2023-09-30T22:29:39.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.835+0000 7fc3d7d23700 1 -- 172.21.15.40:0/1210507386 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3d006ced0 msgr2=0x7fc3d006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:39.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.835+0000 7fc3d7d23700 1 --2- 172.21.15.40:0/1210507386 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3d006ced0 0x7fc3d006d2c0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0009870 tx=0x7fc3c0009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:39.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.835+0000 7fc3d7d23700 1 -- 172.21.15.40:0/1210507386 shutdown_connections 2023-09-30T22:29:39.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.835+0000 7fc3d7d23700 1 --2- 172.21.15.40:0/1210507386 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3d009fbb0 0x7fc3d006c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.835+0000 7fc3d7d23700 1 --2- 172.21.15.40:0/1210507386 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3d0138370 0x7fc3d013a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.835+0000 7fc3d7d23700 1 --2- 172.21.15.40:0/1210507386 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3d006ced0 0x7fc3d006d2c0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.835+0000 7fc3d7d23700 1 -- 172.21.15.40:0/1210507386 >> 172.21.15.40:0/1210507386 conn(0x7fc3d00a41a0 msgr2=0x7fc3d00a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:39.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.835+0000 7fc3d7d23700 1 -- 172.21.15.40:0/1210507386 shutdown_connections 2023-09-30T22:29:39.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.835+0000 7fc3d7d23700 1 -- 172.21.15.40:0/1210507386 wait complete. 2023-09-30T22:29:39.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.836+0000 7fc3d7d23700 1 Processor -- start 2023-09-30T22:29:39.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.837+0000 7fc3d7d23700 1 -- start start 2023-09-30T22:29:39.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.837+0000 7fc3d7d23700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3d006ced0 0x7fc3d0090870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.837+0000 7fc3d7d23700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3d009fbb0 0x7fc3d0090db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.837+0000 7fc3d7d23700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3d0138370 0x7fc3d00912f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:39.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.837+0000 7fc3d7d23700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d0071f20 con 0x7fc3d009fbb0 2023-09-30T22:29:39.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.837+0000 7fc3d7d23700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d006f950 con 0x7fc3d006ced0 2023-09-30T22:29:39.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.837+0000 7fc3d7d23700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d0094e40 con 0x7fc3d0138370 2023-09-30T22:29:39.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.837+0000 7fc3d5abf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3d006ced0 0x7fc3d0090870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.837+0000 7fc3d5abf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3d006ced0 0x7fc3d0090870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60662/0 (socket says 172.21.15.40:60662) 2023-09-30T22:29:39.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.837+0000 7fc3d5abf700 1 -- 172.21.15.40:0/3521810571 learned_addr learned my addr 172.21.15.40:0/3521810571 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:39.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.837+0000 7fc3d62c0700 1 --2- 172.21.15.40:0/3521810571 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3d0138370 0x7fc3d00912f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.838+0000 7fc3d52be700 1 --2- 172.21.15.40:0/3521810571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3d009fbb0 0x7fc3d0090db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:39.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.838+0000 7fc3d5abf700 1 -- 172.21.15.40:0/3521810571 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3d0138370 msgr2=0x7fc3d00912f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:39.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.838+0000 7fc3d5abf700 1 --2- 172.21.15.40:0/3521810571 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3d0138370 0x7fc3d00912f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.838+0000 7fc3d5abf700 1 -- 172.21.15.40:0/3521810571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3d009fbb0 msgr2=0x7fc3d0090db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:39.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.838+0000 7fc3d5abf700 1 --2- 172.21.15.40:0/3521810571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3d009fbb0 0x7fc3d0090db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.838+0000 7fc3d5abf700 1 -- 172.21.15.40:0/3521810571 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c00094a0 con 0x7fc3d006ced0 2023-09-30T22:29:39.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.838+0000 7fc3d5abf700 1 --2- 172.21.15.40:0/3521810571 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3d006ced0 0x7fc3d0090870 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc00b530 tx=0x7fc3cc00b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:39.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.838+0000 7fc3c67fc700 1 -- 172.21.15.40:0/3521810571 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc011830 con 0x7fc3d006ced0 2023-09-30T22:29:39.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.838+0000 7fc3c67fc700 1 -- 172.21.15.40:0/3521810571 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3cc011990 con 0x7fc3d006ced0 2023-09-30T22:29:39.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.838+0000 7fc3d7d23700 1 -- 172.21.15.40:0/3521810571 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d00923f0 con 0x7fc3d006ced0 2023-09-30T22:29:39.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.838+0000 7fc3c67fc700 1 -- 172.21.15.40:0/3521810571 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc011d40 con 0x7fc3d006ced0 2023-09-30T22:29:39.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.838+0000 7fc3d7d23700 1 -- 172.21.15.40:0/3521810571 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d0092b40 con 0x7fc3d006ced0 2023-09-30T22:29:39.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.839+0000 7fc3c67fc700 1 -- 172.21.15.40:0/3521810571 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc3cc01a400 con 0x7fc3d006ced0 2023-09-30T22:29:39.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.839+0000 7fc3c67fc700 1 -- 172.21.15.40:0/3521810571 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc3cc03f6f0 con 0x7fc3d006ced0 2023-09-30T22:29:39.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.840+0000 7fc3d7d23700 1 -- 172.21.15.40:0/3521810571 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3d0062380 con 0x7fc3d006ced0 2023-09-30T22:29:39.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.845+0000 7fc3c67fc700 1 -- 172.21.15.40:0/3521810571 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc3cc015080 con 0x7fc3d006ced0 2023-09-30T22:29:39.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.917+0000 7f8dd3f51700 1 -- 172.21.15.40:0/1114688518 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8dcc1345e0 con 0x7f8dcc09d920 2023-09-30T22:29:39.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.918+0000 7f8dc27fc700 1 -- 172.21.15.40:0/1114688518 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8dc8017070 con 0x7f8dcc09d920 2023-09-30T22:29:39.919 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:39.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.920+0000 7f8dd3f51700 1 -- 172.21.15.40:0/1114688518 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8dcc09d920 msgr2=0x7f8dcc131890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:39.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.920+0000 7f8dd3f51700 1 --2- 172.21.15.40:0/1114688518 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8dcc09d920 0x7f8dcc131890 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f8dc800e9b0 tx=0x7f8dc800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.920+0000 7f8dd3f51700 1 -- 172.21.15.40:0/1114688518 shutdown_connections 2023-09-30T22:29:39.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.920+0000 7f8dd3f51700 1 --2- 172.21.15.40:0/1114688518 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8dcc09d920 0x7f8dcc131890 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.920+0000 7f8dd3f51700 1 --2- 172.21.15.40:0/1114688518 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8dcc130de0 0x7f8dcc132310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.920+0000 7f8dd3f51700 1 --2- 172.21.15.40:0/1114688518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8dcc09e230 0x7f8dcc131dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.920+0000 7f8dd3f51700 1 -- 172.21.15.40:0/1114688518 >> 172.21.15.40:0/1114688518 conn(0x7f8dcc09fb20 msgr2=0x7f8dcc0718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:39.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.920+0000 7f8dd3f51700 1 -- 172.21.15.40:0/1114688518 shutdown_connections 2023-09-30T22:29:39.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.920+0000 7f8dd3f51700 1 -- 172.21.15.40:0/1114688518 wait complete. 2023-09-30T22:29:39.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:39.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.952+0000 7fc00ff2f700 1 -- 172.21.15.40:0/557667424 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc00812c2d0 con 0x7fc00806f980 2023-09-30T22:29:39.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.952+0000 7fbffe7fc700 1 -- 172.21.15.40:0/557667424 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbff8021020 con 0x7fc00806f980 2023-09-30T22:29:39.953 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:39.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.954+0000 7fc00ff2f700 1 -- 172.21.15.40:0/557667424 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc00806f980 msgr2=0x7fc00812da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:39.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.954+0000 7fc00ff2f700 1 --2- 172.21.15.40:0/557667424 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc00806f980 0x7fc00812da70 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fbff800e810 tx=0x7fbff800ebd0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.954+0000 7fc00ff2f700 1 -- 172.21.15.40:0/557667424 shutdown_connections 2023-09-30T22:29:39.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.954+0000 7fc00ff2f700 1 --2- 172.21.15.40:0/557667424 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc00806fdb0 0x7fc00812dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.954+0000 7fc00ff2f700 1 --2- 172.21.15.40:0/557667424 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc00806f070 0x7fc00812d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.954+0000 7fc00ff2f700 1 --2- 172.21.15.40:0/557667424 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc00806f980 0x7fc00812da70 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.954+0000 7fc00ff2f700 1 -- 172.21.15.40:0/557667424 >> 172.21.15.40:0/557667424 conn(0x7fc0080a41a0 msgr2=0x7fc00812bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:39.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.954+0000 7fc00ff2f700 1 -- 172.21.15.40:0/557667424 shutdown_connections 2023-09-30T22:29:39.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.954+0000 7fc00ff2f700 1 -- 172.21.15.40:0/557667424 wait complete. 2023-09-30T22:29:39.968 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:39.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.971+0000 7f4ff1591700 1 -- 172.21.15.40:0/1186161367 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4fec1309d0 con 0x7f4fec09d920 2023-09-30T22:29:39.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.972+0000 7f4fd37fe700 1 -- 172.21.15.40:0/1186161367 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4fdc00f300 con 0x7f4fec09d920 2023-09-30T22:29:39.972 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.974+0000 7f4ff1591700 1 -- 172.21.15.40:0/1186161367 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fec09d920 msgr2=0x7f4fec12d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.974+0000 7f4ff1591700 1 --2- 172.21.15.40:0/1186161367 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fec09d920 0x7f4fec12d400 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc00d7d0 tx=0x7f4fdc00dae0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.974+0000 7f4ff1591700 1 -- 172.21.15.40:0/1186161367 shutdown_connections 2023-09-30T22:29:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.974+0000 7f4ff1591700 1 --2- 172.21.15.40:0/1186161367 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fec130fb0 0x7f4fec12de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.974+0000 7f4ff1591700 1 --2- 172.21.15.40:0/1186161367 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fec09d920 0x7f4fec12d400 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.974+0000 7f4ff1591700 1 --2- 172.21.15.40:0/1186161367 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fec09e230 0x7f4fec12d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.974+0000 7f4ff1591700 1 -- 172.21.15.40:0/1186161367 >> 172.21.15.40:0/1186161367 conn(0x7f4fec09fb20 msgr2=0x7f4fec12abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.974+0000 7f4ff1591700 1 -- 172.21.15.40:0/1186161367 shutdown_connections 2023-09-30T22:29:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:39.974+0000 7f4ff1591700 1 -- 172.21.15.40:0/1186161367 wait complete. 2023-09-30T22:29:39.987 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:40.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:40.060+0000 7fc3d7d23700 1 -- 172.21.15.40:0/3521810571 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc3d0093c20 con 0x7fc3d006ced0 2023-09-30T22:29:40.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:40.061+0000 7fc3c67fc700 1 -- 172.21.15.40:0/3521810571 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc3cc00f8d0 con 0x7fc3d006ced0 2023-09-30T22:29:40.061 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:40.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:40.063+0000 7fc3d7d23700 1 -- 172.21.15.40:0/3521810571 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3d006ced0 msgr2=0x7fc3d0090870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:40.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:40.063+0000 7fc3d7d23700 1 --2- 172.21.15.40:0/3521810571 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3d006ced0 0x7fc3d0090870 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc00b530 tx=0x7fc3cc00b840 comp rx=0 tx=0).stop 2023-09-30T22:29:40.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:40.063+0000 7fc3d7d23700 1 -- 172.21.15.40:0/3521810571 shutdown_connections 2023-09-30T22:29:40.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:40.063+0000 7fc3d7d23700 1 --2- 172.21.15.40:0/3521810571 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc3d0138370 0x7fc3d00912f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:40.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:40.063+0000 7fc3d7d23700 1 --2- 172.21.15.40:0/3521810571 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3d006ced0 0x7fc3d0090870 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:40.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:40.063+0000 7fc3d7d23700 1 --2- 172.21.15.40:0/3521810571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3d009fbb0 0x7fc3d0090db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:40.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:40.063+0000 7fc3d7d23700 1 -- 172.21.15.40:0/3521810571 >> 172.21.15.40:0/3521810571 conn(0x7fc3d00a41a0 msgr2=0x7fc3d0137590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:40.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:40.063+0000 7fc3d7d23700 1 -- 172.21.15.40:0/3521810571 shutdown_connections 2023-09-30T22:29:40.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:40.063+0000 7fc3d7d23700 1 -- 172.21.15.40:0/3521810571 wait complete. 2023-09-30T22:29:40.075 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:40.935 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:40.969 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:40.988 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:41.076 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:41.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.079+0000 7f8c551f8700 1 Processor -- start 2023-09-30T22:29:41.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.080+0000 7f8c551f8700 1 -- start start 2023-09-30T22:29:41.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.080+0000 7f8c551f8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c5009d920 0x7f8c5009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.080+0000 7f8c551f8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8c5009f0f0 0x7f8c5009e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.080+0000 7f8c551f8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c50133ca0 0x7f8c50134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.080+0000 7f8c551f8700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c5006b4c0 con 0x7f8c5009f0f0 2023-09-30T22:29:41.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.080+0000 7f8c551f8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5009a8f0 con 0x7f8c5009d920 2023-09-30T22:29:41.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.080+0000 7f8c551f8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5009f940 con 0x7f8c50133ca0 2023-09-30T22:29:41.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.080+0000 7f8c4ed9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c5009d920 0x7f8c5009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.080+0000 7f8c4ed9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c5009d920 0x7f8c5009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60666/0 (socket says 172.21.15.40:60666) 2023-09-30T22:29:41.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.080+0000 7f8c4ed9d700 1 -- 172.21.15.40:0/4035347658 learned_addr learned my addr 172.21.15.40:0/4035347658 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:41.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.080+0000 7f8c4f59e700 1 --2- 172.21.15.40:0/4035347658 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c50133ca0 0x7f8c50134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.081+0000 7f8c4ed9d700 1 -- 172.21.15.40:0/4035347658 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c50133ca0 msgr2=0x7f8c50134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:41.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.081+0000 7f8c4ed9d700 1 --2- 172.21.15.40:0/4035347658 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c50133ca0 0x7f8c50134140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.081+0000 7f8c4ed9d700 1 -- 172.21.15.40:0/4035347658 >> v2:172.21.15.40:3300/0 conn(0x7f8c5009f0f0 msgr2=0x7f8c5009e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:41.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.081+0000 7f8c4ed9d700 1 --2- 172.21.15.40:0/4035347658 >> v2:172.21.15.40:3300/0 conn(0x7f8c5009f0f0 0x7f8c5009e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.081+0000 7f8c4ed9d700 1 -- 172.21.15.40:0/4035347658 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5009f6e0 con 0x7f8c5009d920 2023-09-30T22:29:41.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.081+0000 7f8c4ed9d700 1 --2- 172.21.15.40:0/4035347658 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c5009d920 0x7f8c5009dcf0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f8c40009920 tx=0x7f8c40009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23d7285375d50ab3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:41.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.081+0000 7f8c4dd9b700 1 -- 172.21.15.40:0/4035347658 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c40005e30 con 0x7f8c5009d920 2023-09-30T22:29:41.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.081+0000 7f8c4dd9b700 1 -- 172.21.15.40:0/4035347658 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c40004030 con 0x7f8c5009d920 2023-09-30T22:29:41.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.081+0000 7f8c4dd9b700 1 -- 172.21.15.40:0/4035347658 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c400043e0 con 0x7f8c5009d920 2023-09-30T22:29:41.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.082+0000 7f8c551f8700 1 -- 172.21.15.40:0/4035347658 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c5009d920 msgr2=0x7f8c5009dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.082+0000 7f8c551f8700 1 --2- 172.21.15.40:0/4035347658 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c5009d920 0x7f8c5009dcf0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f8c40009920 tx=0x7f8c40009c30 comp rx=0 tx=0).stop 2023-09-30T22:29:41.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.082+0000 7f8c551f8700 1 -- 172.21.15.40:0/4035347658 shutdown_connections 2023-09-30T22:29:41.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.082+0000 7f8c551f8700 1 --2- 172.21.15.40:0/4035347658 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c50133ca0 0x7f8c50134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.082+0000 7f8c551f8700 1 --2- 172.21.15.40:0/4035347658 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c5009d920 0x7f8c5009dcf0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.082+0000 7f8c551f8700 1 --2- 172.21.15.40:0/4035347658 >> v2:172.21.15.40:3300/0 conn(0x7f8c5009f0f0 0x7f8c5009e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.082+0000 7f8c551f8700 1 -- 172.21.15.40:0/4035347658 >> 172.21.15.40:0/4035347658 conn(0x7f8c5009fb20 msgr2=0x7f8c5009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:41.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.082+0000 7f8c551f8700 1 -- 172.21.15.40:0/4035347658 shutdown_connections 2023-09-30T22:29:41.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.082+0000 7f8c551f8700 1 -- 172.21.15.40:0/4035347658 wait complete. 2023-09-30T22:29:41.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.083+0000 7f8c551f8700 1 Processor -- start 2023-09-30T22:29:41.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.083+0000 7f8c551f8700 1 -- start start 2023-09-30T22:29:41.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.084+0000 7f8c551f8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c5009d920 0x7f8c50121a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.084+0000 7f8c551f8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c50133ca0 0x7f8c50121f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.084+0000 7f8c551f8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c50122480 0x7f8c501c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.084+0000 7f8c551f8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c50124c90 con 0x7f8c50122480 2023-09-30T22:29:41.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.084+0000 7f8c551f8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c501325d0 con 0x7f8c5009d920 2023-09-30T22:29:41.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.084+0000 7f8c551f8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c50125010 con 0x7f8c50133ca0 2023-09-30T22:29:41.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.084+0000 7f8c4ed9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c5009d920 0x7f8c50121a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.084+0000 7f8c4ed9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c5009d920 0x7f8c50121a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60674/0 (socket says 172.21.15.40:60674) 2023-09-30T22:29:41.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.084+0000 7f8c4e59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c50133ca0 0x7f8c50121f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.084+0000 7f8c4ed9d700 1 -- 172.21.15.40:0/579050635 learned_addr learned my addr 172.21.15.40:0/579050635 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:41.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.084+0000 7f8c4f59e700 1 --2- 172.21.15.40:0/579050635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c50122480 0x7f8c501c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.084+0000 7f8c4e59c700 1 -- 172.21.15.40:0/579050635 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c5009d920 msgr2=0x7f8c50121a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.084+0000 7f8c4e59c700 1 --2- 172.21.15.40:0/579050635 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c5009d920 0x7f8c50121a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.084+0000 7f8c4e59c700 1 -- 172.21.15.40:0/579050635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c50122480 msgr2=0x7f8c501c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.084+0000 7f8c4e59c700 1 --2- 172.21.15.40:0/579050635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c50122480 0x7f8c501c8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.085+0000 7f8c4e59c700 1 -- 172.21.15.40:0/579050635 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c40009500 con 0x7f8c50133ca0 2023-09-30T22:29:41.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.085+0000 7f8c4e59c700 1 --2- 172.21.15.40:0/579050635 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c50133ca0 0x7f8c50121f40 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8c5006b7b0 tx=0x7f8c4400b730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:41.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.085+0000 7f8c377fe700 1 -- 172.21.15.40:0/579050635 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4400bea0 con 0x7f8c50133ca0 2023-09-30T22:29:41.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.085+0000 7f8c377fe700 1 -- 172.21.15.40:0/579050635 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c44011830 con 0x7f8c50133ca0 2023-09-30T22:29:41.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.085+0000 7f8c551f8700 1 -- 172.21.15.40:0/579050635 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c50125520 con 0x7f8c50133ca0 2023-09-30T22:29:41.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.085+0000 7f8c551f8700 1 -- 172.21.15.40:0/579050635 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c50123610 con 0x7f8c50133ca0 2023-09-30T22:29:41.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.085+0000 7f8c377fe700 1 -- 172.21.15.40:0/579050635 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c44011be0 con 0x7f8c50133ca0 2023-09-30T22:29:41.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.085+0000 7f8c4f59e700 1 --2- 172.21.15.40:0/579050635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c50122480 0x7f8c501c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:41.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.086+0000 7f8c377fe700 1 -- 172.21.15.40:0/579050635 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8c44011d40 con 0x7f8c50133ca0 2023-09-30T22:29:41.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.086+0000 7f8c551f8700 1 -- 172.21.15.40:0/579050635 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c300052e0 con 0x7f8c50133ca0 2023-09-30T22:29:41.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.087+0000 7f8c377fe700 1 -- 172.21.15.40:0/579050635 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f8c4403f690 con 0x7f8c50133ca0 2023-09-30T22:29:41.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.093+0000 7f8c377fe700 1 -- 172.21.15.40:0/579050635 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c4400f6f0 con 0x7f8c50133ca0 2023-09-30T22:29:41.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.124+0000 7fd869cf1700 1 Processor -- start 2023-09-30T22:29:41.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.124+0000 7fd869cf1700 1 -- start start 2023-09-30T22:29:41.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.124+0000 7fd869cf1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd86409d920 0x7fd86409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.124+0000 7fd869cf1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd86409e230 0x7fd8641343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.124+0000 7fd869cf1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd86409f940 con 0x7fd86409f0f0 2023-09-30T22:29:41.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.124+0000 7fd869cf1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd86406b4c0 con 0x7fd86409e230 2023-09-30T22:29:41.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.124+0000 7fd869cf1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86409a8f0 con 0x7fd86409d920 2023-09-30T22:29:41.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.124+0000 7fd8637fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd86409d920 0x7fd86409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.124+0000 7fd8637fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd86409d920 0x7fd86409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60680/0 (socket says 172.21.15.40:60680) 2023-09-30T22:29:41.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.124+0000 7fd8637fe700 1 -- 172.21.15.40:0/209717315 learned_addr learned my addr 172.21.15.40:0/209717315 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:41.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.125+0000 7fd863fff700 1 --2- 172.21.15.40:0/209717315 >> v2:172.21.15.40:3300/0 conn(0x7fd86409e230 0x7fd8641343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.125+0000 7fd8637fe700 1 -- 172.21.15.40:0/209717315 >> v2:172.21.15.40:3300/0 conn(0x7fd86409e230 msgr2=0x7fd8641343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:41.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.125+0000 7fd8637fe700 1 --2- 172.21.15.40:0/209717315 >> v2:172.21.15.40:3300/0 conn(0x7fd86409e230 0x7fd8641343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.125+0000 7fd8637fe700 1 -- 172.21.15.40:0/209717315 >> v1:172.21.15.40:6789/0 conn(0x7fd86409f0f0 legacy=0x7fd864133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.125+0000 7fd8637fe700 1 -- 172.21.15.40:0/209717315 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd86409f6e0 con 0x7fd86409d920 2023-09-30T22:29:41.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.125+0000 7fd863fff700 1 --2- 172.21.15.40:0/209717315 >> v2:172.21.15.40:3300/0 conn(0x7fd86409e230 0x7fd8641343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:41.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.125+0000 7fd8637fe700 1 --2- 172.21.15.40:0/209717315 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd86409d920 0x7fd86409dcf0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd854006fd0 tx=0x7fd854009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f3f26edf92ec527 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:41.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.125+0000 7fd8627fc700 1 -- 172.21.15.40:0/209717315 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd854005e30 con 0x7fd86409d920 2023-09-30T22:29:41.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.125+0000 7fd8627fc700 1 -- 172.21.15.40:0/209717315 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd854004030 con 0x7fd86409d920 2023-09-30T22:29:41.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.125+0000 7fd8627fc700 1 -- 172.21.15.40:0/209717315 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8540043e0 con 0x7fd86409d920 2023-09-30T22:29:41.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.126+0000 7fd869cf1700 1 -- 172.21.15.40:0/209717315 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd86409d920 msgr2=0x7fd86409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.126+0000 7fd869cf1700 1 --2- 172.21.15.40:0/209717315 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd86409d920 0x7fd86409dcf0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd854006fd0 tx=0x7fd854009bd0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.126+0000 7fd869cf1700 1 -- 172.21.15.40:0/209717315 shutdown_connections 2023-09-30T22:29:41.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.126+0000 7fd869cf1700 1 --2- 172.21.15.40:0/209717315 >> v2:172.21.15.40:3300/0 conn(0x7fd86409e230 0x7fd8641343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.126+0000 7fd869cf1700 1 --2- 172.21.15.40:0/209717315 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd86409d920 0x7fd86409dcf0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.126+0000 7fd869cf1700 1 -- 172.21.15.40:0/209717315 >> 172.21.15.40:0/209717315 conn(0x7fd86409fb20 msgr2=0x7fd86409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:41.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.126+0000 7fd869cf1700 1 -- 172.21.15.40:0/209717315 shutdown_connections 2023-09-30T22:29:41.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.126+0000 7fd869cf1700 1 -- 172.21.15.40:0/209717315 wait complete. 2023-09-30T22:29:41.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.127+0000 7fd869cf1700 1 Processor -- start 2023-09-30T22:29:41.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.127+0000 7fd869cf1700 1 -- start start 2023-09-30T22:29:41.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.128+0000 7fd869cf1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd86409d920 0x7fd8641a6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.128+0000 7fd869cf1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd86409e230 0x7fd8641a6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.128+0000 7fd869cf1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8641aa260 0x7fd8641a6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.128+0000 7fd869cf1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8641a7e50 con 0x7fd86409e230 2023-09-30T22:29:41.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.128+0000 7fd869cf1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8641a8470 con 0x7fd8641aa260 2023-09-30T22:29:41.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.128+0000 7fd869cf1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8641a90a0 con 0x7fd86409d920 2023-09-30T22:29:41.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.128+0000 7fd8637fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd86409d920 0x7fd8641a6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.128+0000 7fd8637fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd86409d920 0x7fd8641a6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:43634/0 (socket says 172.21.15.40:43634) 2023-09-30T22:29:41.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.128+0000 7fd8637fe700 1 -- 172.21.15.40:0/2184593115 learned_addr learned my addr 172.21.15.40:0/2184593115 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:41.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.128+0000 7fd862ffd700 1 --2- 172.21.15.40:0/2184593115 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd86409e230 0x7fd8641a6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.128+0000 7fd863fff700 1 --2- 172.21.15.40:0/2184593115 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8641aa260 0x7fd8641a6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.128+0000 7fd863fff700 1 -- 172.21.15.40:0/2184593115 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd86409d920 msgr2=0x7fd8641a6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.128+0000 7fd863fff700 1 --2- 172.21.15.40:0/2184593115 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd86409d920 0x7fd8641a6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.129+0000 7fd863fff700 1 -- 172.21.15.40:0/2184593115 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd86409e230 msgr2=0x7fd8641a6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.129+0000 7fd863fff700 1 --2- 172.21.15.40:0/2184593115 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd86409e230 0x7fd8641a6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.129+0000 7fd863fff700 1 -- 172.21.15.40:0/2184593115 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd854009500 con 0x7fd8641aa260 2023-09-30T22:29:41.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.129+0000 7fd8637fe700 1 --2- 172.21.15.40:0/2184593115 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd86409d920 0x7fd8641a6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:41.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.129+0000 7fd863fff700 1 --2- 172.21.15.40:0/2184593115 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8641aa260 0x7fd8641a6cc0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd85c007e90 tx=0x7fd85c00d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:41.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.129+0000 7fd84bfff700 1 -- 172.21.15.40:0/2184593115 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c00dd20 con 0x7fd8641aa260 2023-09-30T22:29:41.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.129+0000 7fd84bfff700 1 -- 172.21.15.40:0/2184593115 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85c00f040 con 0x7fd8641aa260 2023-09-30T22:29:41.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.129+0000 7fd869cf1700 1 -- 172.21.15.40:0/2184593115 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8641a9a80 con 0x7fd8641aa260 2023-09-30T22:29:41.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.129+0000 7fd84bfff700 1 -- 172.21.15.40:0/2184593115 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c003c60 con 0x7fd8641aa260 2023-09-30T22:29:41.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.129+0000 7fd869cf1700 1 -- 172.21.15.40:0/2184593115 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8640a3610 con 0x7fd8641aa260 2023-09-30T22:29:41.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.130+0000 7fd84bfff700 1 -- 172.21.15.40:0/2184593115 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd85c004030 con 0x7fd8641aa260 2023-09-30T22:29:41.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.130+0000 7fd84bfff700 1 -- 172.21.15.40:0/2184593115 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd85c03f710 con 0x7fd8641aa260 2023-09-30T22:29:41.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.130+0000 7fd869cf1700 1 -- 172.21.15.40:0/2184593115 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd86406df50 con 0x7fd8641aa260 2023-09-30T22:29:41.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.140+0000 7fd84bfff700 1 -- 172.21.15.40:0/2184593115 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd85c01a020 con 0x7fd8641aa260 2023-09-30T22:29:41.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.184+0000 7f57aceae700 1 Processor -- start 2023-09-30T22:29:41.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.184+0000 7f57aceae700 1 -- start start 2023-09-30T22:29:41.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.185+0000 7f57aceae700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f57a806a6d0 0x7f57a806aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.185+0000 7f57aceae700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57a806afe0 0x7f57a81318b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.185+0000 7f57aceae700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57a809eb60 con 0x7f57a8131df0 2023-09-30T22:29:41.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.185+0000 7f57aceae700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57a809db70 con 0x7f57a806a6d0 2023-09-30T22:29:41.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.185+0000 7f57aceae700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a809ddf0 con 0x7f57a806afe0 2023-09-30T22:29:41.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.185+0000 7f579ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57a806afe0 0x7f57a81318b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.185+0000 7f57a659c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f57a806a6d0 0x7f57a806aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.185+0000 7f57a659c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f57a806a6d0 0x7f57a806aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57172/0 (socket says 172.21.15.40:57172) 2023-09-30T22:29:41.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.185+0000 7f579ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57a806afe0 0x7f57a81318b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60694/0 (socket says 172.21.15.40:60694) 2023-09-30T22:29:41.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.185+0000 7f57a659c700 1 -- 172.21.15.40:0/2796585757 learned_addr learned my addr 172.21.15.40:0/2796585757 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:41.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.186+0000 7f57a659c700 1 -- 172.21.15.40:0/2796585757 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57a806afe0 msgr2=0x7f57a81318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:41.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.186+0000 7f57a659c700 1 --2- 172.21.15.40:0/2796585757 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57a806afe0 0x7f57a81318b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.186+0000 7f57a659c700 1 -- 172.21.15.40:0/2796585757 >> v1:172.21.15.40:6789/0 conn(0x7f57a8131df0 legacy=0x7f57a8138b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.186+0000 7f57a659c700 1 -- 172.21.15.40:0/2796585757 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a809c9a0 con 0x7f57a806a6d0 2023-09-30T22:29:41.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.186+0000 7f579ffff700 1 --2- 172.21.15.40:0/2796585757 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57a806afe0 0x7f57a81318b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:41.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.186+0000 7f57a659c700 1 --2- 172.21.15.40:0/2796585757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57a806a6d0 0x7f57a806aaa0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f5798006fd0 tx=0x7f5798009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf8e3a47c72d0ac server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:41.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.186+0000 7f57a5d9b700 1 -- 172.21.15.40:0/2796585757 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5798005e30 con 0x7f57a806a6d0 2023-09-30T22:29:41.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.186+0000 7f57a5d9b700 1 -- 172.21.15.40:0/2796585757 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5798004030 con 0x7f57a806a6d0 2023-09-30T22:29:41.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.186+0000 7f57a5d9b700 1 -- 172.21.15.40:0/2796585757 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57980043e0 con 0x7f57a806a6d0 2023-09-30T22:29:41.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.187+0000 7f57aceae700 1 -- 172.21.15.40:0/2796585757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57a806a6d0 msgr2=0x7f57a806aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.187+0000 7f57aceae700 1 --2- 172.21.15.40:0/2796585757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57a806a6d0 0x7f57a806aaa0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f5798006fd0 tx=0x7f5798009bd0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.187+0000 7f57aceae700 1 -- 172.21.15.40:0/2796585757 shutdown_connections 2023-09-30T22:29:41.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.187+0000 7f57aceae700 1 --2- 172.21.15.40:0/2796585757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57a806a6d0 0x7f57a806aaa0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.187+0000 7f57aceae700 1 --2- 172.21.15.40:0/2796585757 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57a806afe0 0x7f57a81318b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.187+0000 7f57aceae700 1 -- 172.21.15.40:0/2796585757 >> 172.21.15.40:0/2796585757 conn(0x7f57a809fb20 msgr2=0x7f57a809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:41.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.187+0000 7f57aceae700 1 -- 172.21.15.40:0/2796585757 shutdown_connections 2023-09-30T22:29:41.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.187+0000 7f57aceae700 1 -- 172.21.15.40:0/2796585757 wait complete. 2023-09-30T22:29:41.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.188+0000 7f57aceae700 1 Processor -- start 2023-09-30T22:29:41.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.188+0000 7f57aceae700 1 -- start start 2023-09-30T22:29:41.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.189+0000 7f57aceae700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57a806a6d0 0x7f57a81273a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.189+0000 7f57aceae700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f57a806afe0 0x7f57a81278e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.189+0000 7f57aceae700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57a8131df0 0x7f57a8127e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.189+0000 7f57aceae700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a812a6f0 con 0x7f57a8131df0 2023-09-30T22:29:41.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.189+0000 7f57aceae700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a8131940 con 0x7f57a806a6d0 2023-09-30T22:29:41.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.189+0000 7f57aceae700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f57a80715d0 con 0x7f57a806afe0 2023-09-30T22:29:41.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.189+0000 7f57a659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57a806a6d0 0x7f57a81273a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.189+0000 7f57a659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57a806a6d0 0x7f57a81273a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60698/0 (socket says 172.21.15.40:60698) 2023-09-30T22:29:41.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.189+0000 7f57a659c700 1 -- 172.21.15.40:0/1497246931 learned_addr learned my addr 172.21.15.40:0/1497246931 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:41.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.189+0000 7f57a6d9d700 1 --2- 172.21.15.40:0/1497246931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57a8131df0 0x7f57a8127e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.190+0000 7f579ffff700 1 --2- 172.21.15.40:0/1497246931 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f57a806afe0 0x7f57a81278e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.190+0000 7f57a659c700 1 -- 172.21.15.40:0/1497246931 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f57a806afe0 msgr2=0x7f57a81278e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.190+0000 7f57a659c700 1 --2- 172.21.15.40:0/1497246931 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f57a806afe0 0x7f57a81278e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.190+0000 7f57a659c700 1 -- 172.21.15.40:0/1497246931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57a8131df0 msgr2=0x7f57a8127e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.190+0000 7f57a659c700 1 --2- 172.21.15.40:0/1497246931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57a8131df0 0x7f57a8127e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.190+0000 7f57a659c700 1 -- 172.21.15.40:0/1497246931 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57900094a0 con 0x7f57a806a6d0 2023-09-30T22:29:41.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.190+0000 7f57a6d9d700 1 --2- 172.21.15.40:0/1497246931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57a8131df0 0x7f57a8127e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:41.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.190+0000 7f57a659c700 1 --2- 172.21.15.40:0/1497246931 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57a806a6d0 0x7f57a81273a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f5798000c00 tx=0x7f5798004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:41.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.190+0000 7f579effd700 1 -- 172.21.15.40:0/1497246931 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5798003d20 con 0x7f57a806a6d0 2023-09-30T22:29:41.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.190+0000 7f579effd700 1 -- 172.21.15.40:0/1497246931 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5798003e80 con 0x7f57a806a6d0 2023-09-30T22:29:41.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.190+0000 7f57aceae700 1 -- 172.21.15.40:0/1497246931 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5798009500 con 0x7f57a806a6d0 2023-09-30T22:29:41.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.190+0000 7f579effd700 1 -- 172.21.15.40:0/1497246931 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579801c640 con 0x7f57a806a6d0 2023-09-30T22:29:41.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.190+0000 7f57aceae700 1 -- 172.21.15.40:0/1497246931 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a809e420 con 0x7f57a806a6d0 2023-09-30T22:29:41.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.191+0000 7f579effd700 1 -- 172.21.15.40:0/1497246931 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f579801c7a0 con 0x7f57a806a6d0 2023-09-30T22:29:41.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.191+0000 7f57aceae700 1 -- 172.21.15.40:0/1497246931 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57a811aed0 con 0x7f57a806a6d0 2023-09-30T22:29:41.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.192+0000 7f579effd700 1 -- 172.21.15.40:0/1497246931 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5798040730 con 0x7f57a806a6d0 2023-09-30T22:29:41.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.200+0000 7f579effd700 1 -- 172.21.15.40:0/1497246931 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5798011420 con 0x7f57a806a6d0 2023-09-30T22:29:41.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.217+0000 7f04e6fdf700 1 Processor -- start 2023-09-30T22:29:41.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.217+0000 7f04e6fdf700 1 -- start start 2023-09-30T22:29:41.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.217+0000 7f04e6fdf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f04e009d920 0x7f04e009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.217+0000 7f04e6fdf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04e009e230 0x7f04e01308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.217+0000 7f04e6fdf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f04e0130de0 0x7f04e0131280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.217+0000 7f04e6fdf700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e009edf0 con 0x7f04e0130de0 2023-09-30T22:29:41.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.217+0000 7f04e6fdf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e009adf0 con 0x7f04e009e230 2023-09-30T22:29:41.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.217+0000 7f04e6fdf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04e009b660 con 0x7f04e009d920 2023-09-30T22:29:41.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.217+0000 7f04dffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04e009e230 0x7f04e01308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.217+0000 7f04e4d7b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f04e009d920 0x7f04e009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.217+0000 7f04dffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04e009e230 0x7f04e01308a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60706/0 (socket says 172.21.15.40:60706) 2023-09-30T22:29:41.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.217+0000 7f04e4d7b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f04e009d920 0x7f04e009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:43652/0 (socket says 172.21.15.40:43652) 2023-09-30T22:29:41.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.218+0000 7f04dffff700 1 -- 172.21.15.40:0/4029417853 learned_addr learned my addr 172.21.15.40:0/4029417853 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:41.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.218+0000 7f04e557c700 1 --2- 172.21.15.40:0/4029417853 >> v2:172.21.15.40:3300/0 conn(0x7f04e0130de0 0x7f04e0131280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.218+0000 7f04e4d7b700 1 -- 172.21.15.40:0/4029417853 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04e009e230 msgr2=0x7f04e01308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:41.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.218+0000 7f04e4d7b700 1 --2- 172.21.15.40:0/4029417853 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04e009e230 0x7f04e01308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.218+0000 7f04e4d7b700 1 -- 172.21.15.40:0/4029417853 >> v2:172.21.15.40:3300/0 conn(0x7f04e0130de0 msgr2=0x7f04e0131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:41.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.218+0000 7f04e4d7b700 1 --2- 172.21.15.40:0/4029417853 >> v2:172.21.15.40:3300/0 conn(0x7f04e0130de0 0x7f04e0131280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.218+0000 7f04e4d7b700 1 -- 172.21.15.40:0/4029417853 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e009a6e0 con 0x7f04e009d920 2023-09-30T22:29:41.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.218+0000 7f04e4d7b700 1 --2- 172.21.15.40:0/4029417853 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f04e009d920 0x7f04e009dcf0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f04d4009820 tx=0x7f04d4009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=456e9c54abf9bbbe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:41.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.218+0000 7f04df7fe700 1 -- 172.21.15.40:0/4029417853 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d4005e30 con 0x7f04e009d920 2023-09-30T22:29:41.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.218+0000 7f04df7fe700 1 -- 172.21.15.40:0/4029417853 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d4006030 con 0x7f04e009d920 2023-09-30T22:29:41.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.218+0000 7f04df7fe700 1 -- 172.21.15.40:0/4029417853 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d40063c0 con 0x7f04e009d920 2023-09-30T22:29:41.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.219+0000 7f04e6fdf700 1 -- 172.21.15.40:0/4029417853 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f04e009d920 msgr2=0x7f04e009dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.219+0000 7f04e6fdf700 1 --2- 172.21.15.40:0/4029417853 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f04e009d920 0x7f04e009dcf0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f04d4009820 tx=0x7f04d4009b30 comp rx=0 tx=0).stop 2023-09-30T22:29:41.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.219+0000 7f04e6fdf700 1 -- 172.21.15.40:0/4029417853 shutdown_connections 2023-09-30T22:29:41.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.219+0000 7f04e6fdf700 1 --2- 172.21.15.40:0/4029417853 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f04e009d920 0x7f04e009dcf0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.219+0000 7f04e6fdf700 1 --2- 172.21.15.40:0/4029417853 >> v2:172.21.15.40:3300/0 conn(0x7f04e0130de0 0x7f04e0131280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.219+0000 7f04e6fdf700 1 --2- 172.21.15.40:0/4029417853 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04e009e230 0x7f04e01308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.219+0000 7f04e6fdf700 1 -- 172.21.15.40:0/4029417853 >> 172.21.15.40:0/4029417853 conn(0x7f04e009fb20 msgr2=0x7f04e009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:41.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.219+0000 7f04e6fdf700 1 -- 172.21.15.40:0/4029417853 shutdown_connections 2023-09-30T22:29:41.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.219+0000 7f04e6fdf700 1 -- 172.21.15.40:0/4029417853 wait complete. 2023-09-30T22:29:41.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.220+0000 7f04e6fdf700 1 Processor -- start 2023-09-30T22:29:41.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.220+0000 7f04e6fdf700 1 -- start start 2023-09-30T22:29:41.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.221+0000 7f04e6fdf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f04e009d920 0x7f04e01c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.221+0000 7f04e6fdf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04e009e230 0x7f04e01c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.221+0000 7f04e6fdf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04e0130de0 0x7f04e01c0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:41.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.221+0000 7f04e6fdf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e0120640 con 0x7f04e009e230 2023-09-30T22:29:41.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.221+0000 7f04e6fdf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e009cb70 con 0x7f04e0130de0 2023-09-30T22:29:41.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.221+0000 7f04e6fdf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04e01c4d40 con 0x7f04e009d920 2023-09-30T22:29:41.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.221+0000 7f04e4d7b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f04e009d920 0x7f04e01c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.221+0000 7f04dffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04e009e230 0x7f04e01c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.221+0000 7f04e4d7b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f04e009d920 0x7f04e01c42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:43662/0 (socket says 172.21.15.40:43662) 2023-09-30T22:29:41.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.221+0000 7f04e4d7b700 1 -- 172.21.15.40:0/1590005922 learned_addr learned my addr 172.21.15.40:0/1590005922 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:41.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.221+0000 7f04e557c700 1 --2- 172.21.15.40:0/1590005922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04e0130de0 0x7f04e01c0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:41.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.222+0000 7f04e4d7b700 1 -- 172.21.15.40:0/1590005922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04e0130de0 msgr2=0x7f04e01c0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.222+0000 7f04e4d7b700 1 --2- 172.21.15.40:0/1590005922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04e0130de0 0x7f04e01c0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.222+0000 7f04e4d7b700 1 -- 172.21.15.40:0/1590005922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04e009e230 msgr2=0x7f04e01c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.222+0000 7f04e4d7b700 1 --2- 172.21.15.40:0/1590005922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04e009e230 0x7f04e01c4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.222+0000 7f04e4d7b700 1 -- 172.21.15.40:0/1590005922 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d4009430 con 0x7f04e009d920 2023-09-30T22:29:41.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.222+0000 7f04e4d7b700 1 --2- 172.21.15.40:0/1590005922 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f04e009d920 0x7f04e01c42c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f04d4009b70 tx=0x7f04d4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:41.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.222+0000 7f04dd7fa700 1 -- 172.21.15.40:0/1590005922 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d4004240 con 0x7f04e009d920 2023-09-30T22:29:41.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.222+0000 7f04dd7fa700 1 -- 172.21.15.40:0/1590005922 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d40043a0 con 0x7f04e009d920 2023-09-30T22:29:41.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.222+0000 7f04e6fdf700 1 -- 172.21.15.40:0/1590005922 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e0120380 con 0x7f04e009d920 2023-09-30T22:29:41.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.222+0000 7f04dd7fa700 1 -- 172.21.15.40:0/1590005922 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d4006950 con 0x7f04e009d920 2023-09-30T22:29:41.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.222+0000 7f04e6fdf700 1 -- 172.21.15.40:0/1590005922 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e011f680 con 0x7f04e009d920 2023-09-30T22:29:41.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.223+0000 7f04dd7fa700 1 -- 172.21.15.40:0/1590005922 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f04d4022070 con 0x7f04e009d920 2023-09-30T22:29:41.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.224+0000 7f04e6fdf700 1 -- 172.21.15.40:0/1590005922 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04e0062380 con 0x7f04e009d920 2023-09-30T22:29:41.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.224+0000 7f04dd7fa700 1 -- 172.21.15.40:0/1590005922 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f04d40036a0 con 0x7f04e009d920 2023-09-30T22:29:41.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.229+0000 7f04dd7fa700 1 -- 172.21.15.40:0/1590005922 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f04d4003e00 con 0x7f04e009d920 2023-09-30T22:29:41.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.305+0000 7f8c551f8700 1 -- 172.21.15.40:0/579050635 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8c30005590 con 0x7f8c50133ca0 2023-09-30T22:29:41.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.306+0000 7f8c377fe700 1 -- 172.21.15.40:0/579050635 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8c44022350 con 0x7f8c50133ca0 2023-09-30T22:29:41.307 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:41.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.309+0000 7f8c551f8700 1 -- 172.21.15.40:0/579050635 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c50133ca0 msgr2=0x7f8c50121f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.309+0000 7f8c551f8700 1 --2- 172.21.15.40:0/579050635 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c50133ca0 0x7f8c50121f40 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8c5006b7b0 tx=0x7f8c4400b730 comp rx=0 tx=0).stop 2023-09-30T22:29:41.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.309+0000 7f8c551f8700 1 -- 172.21.15.40:0/579050635 shutdown_connections 2023-09-30T22:29:41.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.309+0000 7f8c551f8700 1 --2- 172.21.15.40:0/579050635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c50122480 0x7f8c501c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.309+0000 7f8c551f8700 1 --2- 172.21.15.40:0/579050635 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c5009d920 0x7f8c50121a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.309+0000 7f8c551f8700 1 --2- 172.21.15.40:0/579050635 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c50133ca0 0x7f8c50121f40 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.309+0000 7f8c551f8700 1 -- 172.21.15.40:0/579050635 >> 172.21.15.40:0/579050635 conn(0x7f8c5009fb20 msgr2=0x7f8c500a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:41.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.310+0000 7f8c551f8700 1 -- 172.21.15.40:0/579050635 shutdown_connections 2023-09-30T22:29:41.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.310+0000 7f8c551f8700 1 -- 172.21.15.40:0/579050635 wait complete. 2023-09-30T22:29:41.327 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:41.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.361+0000 7fd869cf1700 1 -- 172.21.15.40:0/2184593115 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd864062380 con 0x7fd8641aa260 2023-09-30T22:29:41.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.361+0000 7fd84bfff700 1 -- 172.21.15.40:0/2184593115 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd85c0042e0 con 0x7fd8641aa260 2023-09-30T22:29:41.362 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:41.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.364+0000 7fd869cf1700 1 -- 172.21.15.40:0/2184593115 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8641aa260 msgr2=0x7fd8641a6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.364+0000 7fd869cf1700 1 --2- 172.21.15.40:0/2184593115 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8641aa260 0x7fd8641a6cc0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd85c007e90 tx=0x7fd85c00d3b0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.364+0000 7fd869cf1700 1 -- 172.21.15.40:0/2184593115 shutdown_connections 2023-09-30T22:29:41.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.364+0000 7fd869cf1700 1 --2- 172.21.15.40:0/2184593115 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd86409d920 0x7fd8641a6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.364+0000 7fd869cf1700 1 --2- 172.21.15.40:0/2184593115 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8641aa260 0x7fd8641a6cc0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.364+0000 7fd869cf1700 1 --2- 172.21.15.40:0/2184593115 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd86409e230 0x7fd8641a6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.364+0000 7fd869cf1700 1 -- 172.21.15.40:0/2184593115 >> 172.21.15.40:0/2184593115 conn(0x7fd86409fb20 msgr2=0x7fd8641bb030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:41.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.364+0000 7fd869cf1700 1 -- 172.21.15.40:0/2184593115 shutdown_connections 2023-09-30T22:29:41.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.364+0000 7fd869cf1700 1 -- 172.21.15.40:0/2184593115 wait complete. 2023-09-30T22:29:41.378 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:41.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.410+0000 7f57aceae700 1 -- 172.21.15.40:0/1497246931 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f57a8062380 con 0x7f57a806a6d0 2023-09-30T22:29:41.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.411+0000 7f579effd700 1 -- 172.21.15.40:0/1497246931 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f579802a020 con 0x7f57a806a6d0 2023-09-30T22:29:41.412 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:41.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.413+0000 7f57aceae700 1 -- 172.21.15.40:0/1497246931 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57a806a6d0 msgr2=0x7f57a81273a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.413+0000 7f57aceae700 1 --2- 172.21.15.40:0/1497246931 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57a806a6d0 0x7f57a81273a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f5798000c00 tx=0x7f5798004750 comp rx=0 tx=0).stop 2023-09-30T22:29:41.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.413+0000 7f57aceae700 1 -- 172.21.15.40:0/1497246931 shutdown_connections 2023-09-30T22:29:41.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.413+0000 7f57aceae700 1 --2- 172.21.15.40:0/1497246931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57a8131df0 0x7f57a8127e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.413+0000 7f57aceae700 1 --2- 172.21.15.40:0/1497246931 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57a806a6d0 0x7f57a81273a0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.413+0000 7f57aceae700 1 --2- 172.21.15.40:0/1497246931 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f57a806afe0 0x7f57a81278e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.413+0000 7f57aceae700 1 -- 172.21.15.40:0/1497246931 >> 172.21.15.40:0/1497246931 conn(0x7f57a809fb20 msgr2=0x7f57a80a35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:41.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.413+0000 7f57aceae700 1 -- 172.21.15.40:0/1497246931 shutdown_connections 2023-09-30T22:29:41.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.413+0000 7f57aceae700 1 -- 172.21.15.40:0/1497246931 wait complete. 2023-09-30T22:29:41.426 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:41.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.430+0000 7f04e6fdf700 1 -- 172.21.15.40:0/1590005922 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f04e0074720 con 0x7f04e009d920 2023-09-30T22:29:41.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.431+0000 7f04dd7fa700 1 -- 172.21.15.40:0/1590005922 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f04d402a020 con 0x7f04e009d920 2023-09-30T22:29:41.431 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:41.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.433+0000 7f04e6fdf700 1 -- 172.21.15.40:0/1590005922 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f04e009d920 msgr2=0x7f04e01c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:41.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.433+0000 7f04e6fdf700 1 --2- 172.21.15.40:0/1590005922 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f04e009d920 0x7f04e01c42c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f04d4009b70 tx=0x7f04d4004750 comp rx=0 tx=0).stop 2023-09-30T22:29:41.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.433+0000 7f04e6fdf700 1 -- 172.21.15.40:0/1590005922 shutdown_connections 2023-09-30T22:29:41.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.433+0000 7f04e6fdf700 1 --2- 172.21.15.40:0/1590005922 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f04e009d920 0x7f04e01c42c0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.433+0000 7f04e6fdf700 1 --2- 172.21.15.40:0/1590005922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04e0130de0 0x7f04e01c0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.433+0000 7f04e6fdf700 1 --2- 172.21.15.40:0/1590005922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04e009e230 0x7f04e01c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:41.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.433+0000 7f04e6fdf700 1 -- 172.21.15.40:0/1590005922 >> 172.21.15.40:0/1590005922 conn(0x7f04e009fb20 msgr2=0x7f04e012fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:41.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.433+0000 7f04e6fdf700 1 -- 172.21.15.40:0/1590005922 shutdown_connections 2023-09-30T22:29:41.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:41.433+0000 7f04e6fdf700 1 -- 172.21.15.40:0/1590005922 wait complete. 2023-09-30T22:29:41.445 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:42.328 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:42.378 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:42.427 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:42.446 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:42.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.479+0000 7f0017704700 1 Processor -- start 2023-09-30T22:29:42.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.479+0000 7f0017704700 1 -- start start 2023-09-30T22:29:42.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.480+0000 7f0017704700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f001012e590 0x7f001012e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.480+0000 7f0017704700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f001012eea0 0x7f001012d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.480+0000 7f0017704700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f001009ab70 con 0x7f001012d6d0 2023-09-30T22:29:42.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.480+0000 7f0017704700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f001009b270 con 0x7f001012eea0 2023-09-30T22:29:42.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.480+0000 7f0017704700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f001009bab0 con 0x7f001012e590 2023-09-30T22:29:42.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.480+0000 7f0015ca1700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f001012d6d0 0x7f0010137c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38808/0 (socket says 172.21.15.40:38808) 2023-09-30T22:29:42.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.480+0000 7f00154a0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f001012e590 0x7f001012e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:42.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.480+0000 7f0015ca1700 1 -- 172.21.15.40:0/1349301484 learned_addr learned my addr 172.21.15.40:0/1349301484 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:29:42.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.480+0000 7f00154a0700 1 -- 172.21.15.40:0/1349301484 >> v2:172.21.15.40:3300/0 conn(0x7f001012eea0 msgr2=0x7f001012d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:42.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.480+0000 7f00154a0700 1 --2- 172.21.15.40:0/1349301484 >> v2:172.21.15.40:3300/0 conn(0x7f001012eea0 0x7f001012d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.480+0000 7f00154a0700 1 -- 172.21.15.40:0/1349301484 >> v1:172.21.15.40:6789/0 conn(0x7f001012d6d0 legacy=0x7f0010137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.480+0000 7f00154a0700 1 -- 172.21.15.40:0/1349301484 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f001009bd70 con 0x7f001012e590 2023-09-30T22:29:42.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.481+0000 7f00154a0700 1 --2- 172.21.15.40:0/1349301484 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f001012e590 0x7f001012e960 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f000c009870 tx=0x7f000c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=355ecc656fffbfe2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:42.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.481+0000 7f0007fff700 1 -- 172.21.15.40:0/1349301484 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000c011830 con 0x7f001012e590 2023-09-30T22:29:42.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.481+0000 7f0007fff700 1 -- 172.21.15.40:0/1349301484 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000c011990 con 0x7f001012e590 2023-09-30T22:29:42.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.481+0000 7f0007fff700 1 -- 172.21.15.40:0/1349301484 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000c011d20 con 0x7f001012e590 2023-09-30T22:29:42.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.482+0000 7f0017704700 1 -- 172.21.15.40:0/1349301484 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f001012e590 msgr2=0x7f001012e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.482+0000 7f0017704700 1 --2- 172.21.15.40:0/1349301484 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f001012e590 0x7f001012e960 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f000c009870 tx=0x7f000c009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:42.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.482+0000 7f0017704700 1 -- 172.21.15.40:0/1349301484 shutdown_connections 2023-09-30T22:29:42.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.482+0000 7f0017704700 1 --2- 172.21.15.40:0/1349301484 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f001012e590 0x7f001012e960 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.482+0000 7f0017704700 1 --2- 172.21.15.40:0/1349301484 >> v2:172.21.15.40:3300/0 conn(0x7f001012eea0 0x7f001012d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.482+0000 7f0017704700 1 -- 172.21.15.40:0/1349301484 >> 172.21.15.40:0/1349301484 conn(0x7f00100a2a00 msgr2=0x7f00100a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:42.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.482+0000 7f0017704700 1 -- 172.21.15.40:0/1349301484 shutdown_connections 2023-09-30T22:29:42.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.482+0000 7f0017704700 1 -- 172.21.15.40:0/1349301484 wait complete. 2023-09-30T22:29:42.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.483+0000 7f0017704700 1 Processor -- start 2023-09-30T22:29:42.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.483+0000 7f0017704700 1 -- start start 2023-09-30T22:29:42.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.484+0000 7f0017704700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f001012d6d0 0x7f0010138f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.484+0000 7f0017704700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f001012e590 0x7f0010137660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.484+0000 7f0017704700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f001012eea0 0x7f0010137ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.484+0000 7f0017704700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0010138750 con 0x7f001012e590 2023-09-30T22:29:42.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.484+0000 7f0017704700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0010135dc0 con 0x7f001012eea0 2023-09-30T22:29:42.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.484+0000 7f0017704700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f001009b4b0 con 0x7f001012d6d0 2023-09-30T22:29:42.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.484+0000 7f0015ca1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f001012eea0 0x7f0010137ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:42.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.484+0000 7f0015ca1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f001012eea0 0x7f0010137ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60724/0 (socket says 172.21.15.40:60724) 2023-09-30T22:29:42.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.484+0000 7f0015ca1700 1 -- 172.21.15.40:0/4246824927 learned_addr learned my addr 172.21.15.40:0/4246824927 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:42.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.484+0000 7f0014c9f700 1 --2- 172.21.15.40:0/4246824927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f001012e590 0x7f0010137660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:42.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.485+0000 7f0015ca1700 1 -- 172.21.15.40:0/4246824927 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f001012d6d0 msgr2=0x7f0010138f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.485+0000 7f0015ca1700 1 --2- 172.21.15.40:0/4246824927 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f001012d6d0 0x7f0010138f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.485+0000 7f0015ca1700 1 -- 172.21.15.40:0/4246824927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f001012e590 msgr2=0x7f0010137660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.485+0000 7f0015ca1700 1 --2- 172.21.15.40:0/4246824927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f001012e590 0x7f0010137660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.485+0000 7f0015ca1700 1 -- 172.21.15.40:0/4246824927 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000c0094a0 con 0x7f001012eea0 2023-09-30T22:29:42.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.485+0000 7f0015ca1700 1 --2- 172.21.15.40:0/4246824927 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f001012eea0 0x7f0010137ba0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f000800cbc0 tx=0x7f000800ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:42.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.485+0000 7f0005ffb700 1 -- 172.21.15.40:0/4246824927 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000800aaa0 con 0x7f001012eea0 2023-09-30T22:29:42.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.485+0000 7f0017704700 1 -- 172.21.15.40:0/4246824927 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f001009cdb0 con 0x7f001012eea0 2023-09-30T22:29:42.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.485+0000 7f0005ffb700 1 -- 172.21.15.40:0/4246824927 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000800ac00 con 0x7f001012eea0 2023-09-30T22:29:42.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.485+0000 7f0005ffb700 1 -- 172.21.15.40:0/4246824927 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0008012400 con 0x7f001012eea0 2023-09-30T22:29:42.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.486+0000 7f0017704700 1 -- 172.21.15.40:0/4246824927 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0010136210 con 0x7f001012eea0 2023-09-30T22:29:42.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.486+0000 7f0005ffb700 1 -- 172.21.15.40:0/4246824927 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f000801b3b0 con 0x7f001012eea0 2023-09-30T22:29:42.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.487+0000 7f0005ffb700 1 -- 172.21.15.40:0/4246824927 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f000803f300 con 0x7f001012eea0 2023-09-30T22:29:42.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.487+0000 7f0017704700 1 -- 172.21.15.40:0/4246824927 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0010062380 con 0x7f001012eea0 2023-09-30T22:29:42.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.492+0000 7f0005ffb700 1 -- 172.21.15.40:0/4246824927 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0008017020 con 0x7f001012eea0 2023-09-30T22:29:42.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.530+0000 7f0e590af700 1 Processor -- start 2023-09-30T22:29:42.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.530+0000 7f0e590af700 1 -- start start 2023-09-30T22:29:42.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.530+0000 7f0e590af700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e5406a6d0 0x7f0e5406aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.530+0000 7f0e590af700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0e54131fc0 0x7f0e54139b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.530+0000 7f0e590af700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e5409eb60 con 0x7f0e5406afe0 2023-09-30T22:29:42.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.530+0000 7f0e590af700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e5409db70 con 0x7f0e54131fc0 2023-09-30T22:29:42.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.531+0000 7f0e590af700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5409ddf0 con 0x7f0e5406a6d0 2023-09-30T22:29:42.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.531+0000 7f0e52d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e5406a6d0 0x7f0e5406aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:42.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.531+0000 7f0e52d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e5406a6d0 0x7f0e5406aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60732/0 (socket says 172.21.15.40:60732) 2023-09-30T22:29:42.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.531+0000 7f0e52d9d700 1 -- 172.21.15.40:0/2017306862 learned_addr learned my addr 172.21.15.40:0/2017306862 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:42.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.531+0000 7f0e52d9d700 1 -- 172.21.15.40:0/2017306862 >> v2:172.21.15.40:3300/0 conn(0x7f0e54131fc0 msgr2=0x7f0e54139b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:42.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.531+0000 7f0e52d9d700 1 --2- 172.21.15.40:0/2017306862 >> v2:172.21.15.40:3300/0 conn(0x7f0e54131fc0 0x7f0e54139b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.531+0000 7f0e52d9d700 1 -- 172.21.15.40:0/2017306862 >> v1:172.21.15.40:6789/0 conn(0x7f0e5406afe0 legacy=0x7f0e541318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:42.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.531+0000 7f0e52d9d700 1 -- 172.21.15.40:0/2017306862 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5409c9a0 con 0x7f0e5406a6d0 2023-09-30T22:29:42.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.531+0000 7f0e52d9d700 1 --2- 172.21.15.40:0/2017306862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e5406a6d0 0x7f0e5406aaa0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f0e44006fd0 tx=0x7f0e44009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4570d5fcd0515fd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:42.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.531+0000 7f0e5259c700 1 -- 172.21.15.40:0/2017306862 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e44005e30 con 0x7f0e5406a6d0 2023-09-30T22:29:42.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.531+0000 7f0e5259c700 1 -- 172.21.15.40:0/2017306862 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e44006030 con 0x7f0e5406a6d0 2023-09-30T22:29:42.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.532+0000 7f0e5259c700 1 -- 172.21.15.40:0/2017306862 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e440063c0 con 0x7f0e5406a6d0 2023-09-30T22:29:42.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.533+0000 7f0e590af700 1 -- 172.21.15.40:0/2017306862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e5406a6d0 msgr2=0x7f0e5406aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.533+0000 7f0e590af700 1 --2- 172.21.15.40:0/2017306862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e5406a6d0 0x7f0e5406aaa0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f0e44006fd0 tx=0x7f0e44009bd0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.533+0000 7f0e590af700 1 -- 172.21.15.40:0/2017306862 shutdown_connections 2023-09-30T22:29:42.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.533+0000 7f0e590af700 1 --2- 172.21.15.40:0/2017306862 >> v2:172.21.15.40:3300/0 conn(0x7f0e54131fc0 0x7f0e54139b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.533+0000 7f0e590af700 1 --2- 172.21.15.40:0/2017306862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e5406a6d0 0x7f0e5406aaa0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.533+0000 7f0e590af700 1 -- 172.21.15.40:0/2017306862 >> 172.21.15.40:0/2017306862 conn(0x7f0e5409fb20 msgr2=0x7f0e5409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:42.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.533+0000 7f0e590af700 1 -- 172.21.15.40:0/2017306862 shutdown_connections 2023-09-30T22:29:42.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.533+0000 7f0e590af700 1 -- 172.21.15.40:0/2017306862 wait complete. 2023-09-30T22:29:42.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.534+0000 7f0e590af700 1 Processor -- start 2023-09-30T22:29:42.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.535+0000 7f0e590af700 1 -- start start 2023-09-30T22:29:42.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.535+0000 7f0e590af700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e5406a6d0 0x7f0e5411db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.535+0000 7f0e590af700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0e5406afe0 0x7f0e5411e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.535+0000 7f0e590af700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e54131fc0 0x7f0e5411e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.535+0000 7f0e590af700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5411ec70 con 0x7f0e5406a6d0 2023-09-30T22:29:42.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.535+0000 7f0e590af700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e541313d0 con 0x7f0e54131fc0 2023-09-30T22:29:42.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.535+0000 7f0e590af700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e540715d0 con 0x7f0e5406afe0 2023-09-30T22:29:42.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.535+0000 7f0e5359e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e54131fc0 0x7f0e5411e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:42.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.535+0000 7f0e5359e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e54131fc0 0x7f0e5411e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60738/0 (socket says 172.21.15.40:60738) 2023-09-30T22:29:42.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.535+0000 7f0e5359e700 1 -- 172.21.15.40:0/2190245374 learned_addr learned my addr 172.21.15.40:0/2190245374 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:42.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.536+0000 7f0e4bfff700 1 --2- 172.21.15.40:0/2190245374 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0e5406afe0 0x7f0e5411e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:42.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.536+0000 7f0e5359e700 1 -- 172.21.15.40:0/2190245374 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0e5406afe0 msgr2=0x7f0e5411e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.536+0000 7f0e5359e700 1 --2- 172.21.15.40:0/2190245374 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0e5406afe0 0x7f0e5411e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.536+0000 7f0e5359e700 1 -- 172.21.15.40:0/2190245374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e5406a6d0 msgr2=0x7f0e5411db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.536+0000 7f0e5359e700 1 --2- 172.21.15.40:0/2190245374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e5406a6d0 0x7f0e5411db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.536+0000 7f0e5359e700 1 -- 172.21.15.40:0/2190245374 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e44009500 con 0x7f0e54131fc0 2023-09-30T22:29:42.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.536+0000 7f0e5359e700 1 --2- 172.21.15.40:0/2190245374 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e54131fc0 0x7f0e5411e5c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c00b9a0 tx=0x7f0e4c00bd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:42.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.536+0000 7f0e4b7fe700 1 -- 172.21.15.40:0/2190245374 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c00c9b0 con 0x7f0e54131fc0 2023-09-30T22:29:42.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.536+0000 7f0e4b7fe700 1 -- 172.21.15.40:0/2190245374 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4c00cb30 con 0x7f0e54131fc0 2023-09-30T22:29:42.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.536+0000 7f0e4b7fe700 1 -- 172.21.15.40:0/2190245374 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c014440 con 0x7f0e54131fc0 2023-09-30T22:29:42.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.536+0000 7f0e590af700 1 -- 172.21.15.40:0/2190245374 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e5409e420 con 0x7f0e54131fc0 2023-09-30T22:29:42.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.536+0000 7f0e590af700 1 -- 172.21.15.40:0/2190245374 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e5411ffc0 con 0x7f0e54131fc0 2023-09-30T22:29:42.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.538+0000 7f0e4b7fe700 1 -- 172.21.15.40:0/2190245374 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0e4c01d3b0 con 0x7f0e54131fc0 2023-09-30T22:29:42.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.538+0000 7f0e590af700 1 -- 172.21.15.40:0/2190245374 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e54062380 con 0x7f0e54131fc0 2023-09-30T22:29:42.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.538+0000 7f0e4b7fe700 1 -- 172.21.15.40:0/2190245374 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f0e4c006e40 con 0x7f0e54131fc0 2023-09-30T22:29:42.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.547+0000 7f0e4b7fe700 1 -- 172.21.15.40:0/2190245374 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0e4c019070 con 0x7f0e54131fc0 2023-09-30T22:29:42.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.566+0000 7f319817d700 1 Processor -- start 2023-09-30T22:29:42.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.566+0000 7f319817d700 1 -- start start 2023-09-30T22:29:42.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.567+0000 7f319817d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319009f0f0 0x7f3190138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.567+0000 7f319817d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f319009e400 0x7f319013b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.567+0000 7f319817d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f319009f940 con 0x7f319009d920 2023-09-30T22:29:42.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.567+0000 7f319817d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f319006b4c0 con 0x7f319009e400 2023-09-30T22:29:42.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.567+0000 7f319817d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319009a8f0 con 0x7f319009f0f0 2023-09-30T22:29:42.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.567+0000 7f3195718700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319009f0f0 0x7f3190138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:42.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.567+0000 7f3195718700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319009f0f0 0x7f3190138ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60746/0 (socket says 172.21.15.40:60746) 2023-09-30T22:29:42.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.567+0000 7f3195718700 1 -- 172.21.15.40:0/363145033 learned_addr learned my addr 172.21.15.40:0/363145033 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:42.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.567+0000 7f319671a700 1 --2- 172.21.15.40:0/363145033 >> v2:172.21.15.40:3300/0 conn(0x7f319009e400 0x7f319013b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:42.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.567+0000 7f3195718700 1 -- 172.21.15.40:0/363145033 >> v2:172.21.15.40:3300/0 conn(0x7f319009e400 msgr2=0x7f319013b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:42.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.567+0000 7f3195718700 1 --2- 172.21.15.40:0/363145033 >> v2:172.21.15.40:3300/0 conn(0x7f319009e400 0x7f319013b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.567+0000 7f3195718700 1 -- 172.21.15.40:0/363145033 >> v1:172.21.15.40:6789/0 conn(0x7f319009d920 legacy=0x7f319009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.567+0000 7f3195718700 1 -- 172.21.15.40:0/363145033 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319009f6e0 con 0x7f319009f0f0 2023-09-30T22:29:42.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.567+0000 7f319671a700 1 --2- 172.21.15.40:0/363145033 >> v2:172.21.15.40:3300/0 conn(0x7f319009e400 0x7f319013b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:42.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.568+0000 7f3195718700 1 --2- 172.21.15.40:0/363145033 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319009f0f0 0x7f3190138ee0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f31800098f0 tx=0x7f3180009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fbb8266ffefbf28 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:42.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.568+0000 7f3194f17700 1 -- 172.21.15.40:0/363145033 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3180011830 con 0x7f319009f0f0 2023-09-30T22:29:42.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.568+0000 7f3194f17700 1 -- 172.21.15.40:0/363145033 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3180011990 con 0x7f319009f0f0 2023-09-30T22:29:42.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.568+0000 7f3194f17700 1 -- 172.21.15.40:0/363145033 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3180011d20 con 0x7f319009f0f0 2023-09-30T22:29:42.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.569+0000 7f319817d700 1 -- 172.21.15.40:0/363145033 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319009f0f0 msgr2=0x7f3190138ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.569+0000 7f319817d700 1 --2- 172.21.15.40:0/363145033 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319009f0f0 0x7f3190138ee0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f31800098f0 tx=0x7f3180009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:42.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.569+0000 7f319817d700 1 -- 172.21.15.40:0/363145033 shutdown_connections 2023-09-30T22:29:42.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.569+0000 7f319817d700 1 --2- 172.21.15.40:0/363145033 >> v2:172.21.15.40:3300/0 conn(0x7f319009e400 0x7f319013b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.569+0000 7f319817d700 1 --2- 172.21.15.40:0/363145033 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319009f0f0 0x7f3190138ee0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.569+0000 7f319817d700 1 -- 172.21.15.40:0/363145033 >> 172.21.15.40:0/363145033 conn(0x7f319009fb20 msgr2=0x7f319009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:42.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.569+0000 7f319817d700 1 -- 172.21.15.40:0/363145033 shutdown_connections 2023-09-30T22:29:42.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.569+0000 7f319817d700 1 -- 172.21.15.40:0/363145033 wait complete. 2023-09-30T22:29:42.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.570+0000 7f319817d700 1 Processor -- start 2023-09-30T22:29:42.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.570+0000 7f319817d700 1 -- start start 2023-09-30T22:29:42.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.570+0000 7f319817d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f319009d920 0x7f319011ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.570+0000 7f319817d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319009e400 0x7f319011ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.570+0000 7f319817d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f319011f4a0 0x7f31901351b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.570+0000 7f319817d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31900a32b0 con 0x7f319011f4a0 2023-09-30T22:29:42.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.570+0000 7f319817d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319009c9e0 con 0x7f319009e400 2023-09-30T22:29:42.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.570+0000 7f319817d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3190121c40 con 0x7f319009d920 2023-09-30T22:29:42.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.570+0000 7f3195718700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319009e400 0x7f319011ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:42.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.570+0000 7f3195718700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319009e400 0x7f319011ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:60754/0 (socket says 172.21.15.40:60754) 2023-09-30T22:29:42.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.570+0000 7f3195718700 1 -- 172.21.15.40:0/1949669605 learned_addr learned my addr 172.21.15.40:0/1949669605 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:42.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.570+0000 7f319671a700 1 --2- 172.21.15.40:0/1949669605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f319011f4a0 0x7f31901351b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:42.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.571+0000 7f3195718700 1 -- 172.21.15.40:0/1949669605 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f319009d920 msgr2=0x7f319011ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.571+0000 7f3195718700 1 --2- 172.21.15.40:0/1949669605 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f319009d920 0x7f319011ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.571+0000 7f3195718700 1 -- 172.21.15.40:0/1949669605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f319011f4a0 msgr2=0x7f31901351b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.571+0000 7f3195718700 1 --2- 172.21.15.40:0/1949669605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f319011f4a0 0x7f31901351b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.571+0000 7f3195718700 1 -- 172.21.15.40:0/1949669605 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3188009a70 con 0x7f319009e400 2023-09-30T22:29:42.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.571+0000 7f319671a700 1 --2- 172.21.15.40:0/1949669605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f319011f4a0 0x7f31901351b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:42.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.571+0000 7f3195718700 1 --2- 172.21.15.40:0/1949669605 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319009e400 0x7f319011ef60 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f3180009f50 tx=0x7f3180004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:42.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.571+0000 7f31867fc700 1 -- 172.21.15.40:0/1949669605 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3180004590 con 0x7f319009e400 2023-09-30T22:29:42.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.571+0000 7f31867fc700 1 -- 172.21.15.40:0/1949669605 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31800036a0 con 0x7f319009e400 2023-09-30T22:29:42.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.571+0000 7f319817d700 1 -- 172.21.15.40:0/1949669605 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3180009550 con 0x7f319009e400 2023-09-30T22:29:42.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.571+0000 7f319817d700 1 -- 172.21.15.40:0/1949669605 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3190120d60 con 0x7f319009e400 2023-09-30T22:29:42.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.571+0000 7f31867fc700 1 -- 172.21.15.40:0/1949669605 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3180003a10 con 0x7f319009e400 2023-09-30T22:29:42.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.573+0000 7f319817d700 1 -- 172.21.15.40:0/1949669605 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3190121e10 con 0x7f319009e400 2023-09-30T22:29:42.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.573+0000 7f31867fc700 1 -- 172.21.15.40:0/1949669605 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3180003b70 con 0x7f319009e400 2023-09-30T22:29:42.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.573+0000 7f31867fc700 1 -- 172.21.15.40:0/1949669605 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3180040a60 con 0x7f319009e400 2023-09-30T22:29:42.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.578+0000 7f31867fc700 1 -- 172.21.15.40:0/1949669605 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3180010970 con 0x7f319009e400 2023-09-30T22:29:42.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.641+0000 7f8e535b6700 1 Processor -- start 2023-09-30T22:29:42.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.641+0000 7f8e535b6700 1 -- start start 2023-09-30T22:29:42.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.642+0000 7f8e535b6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e4c09c890 0x7f8e4c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.642+0000 7f8e535b6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8e4c09d920 0x7f8e4c09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.642+0000 7f8e535b6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e4c09e2b0 0x7f8e4c13ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.642+0000 7f8e535b6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e4c0a29d0 con 0x7f8e4c09d920 2023-09-30T22:29:42.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.642+0000 7f8e535b6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c09fb40 con 0x7f8e4c09e2b0 2023-09-30T22:29:42.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.642+0000 7f8e535b6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c0a2600 con 0x7f8e4c09c890 2023-09-30T22:29:42.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.642+0000 7f8e50b51700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8e4c09d920 0x7f8e4c09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:42.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.642+0000 7f8e50b51700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8e4c09d920 0x7f8e4c09dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57268/0 (socket says 172.21.15.40:57268) 2023-09-30T22:29:42.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.642+0000 7f8e50b51700 1 -- 172.21.15.40:0/3945706645 learned_addr learned my addr 172.21.15.40:0/3945706645 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:42.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.642+0000 7f8e51b53700 1 --2- 172.21.15.40:0/3945706645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e4c09e2b0 0x7f8e4c13ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:42.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.642+0000 7f8e51352700 1 --2- 172.21.15.40:0/3945706645 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e4c09c890 0x7f8e4c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:42.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.642+0000 7f8e50b51700 1 -- 172.21.15.40:0/3945706645 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e4c09c890 msgr2=0x7f8e4c09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:42.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.642+0000 7f8e50b51700 1 --2- 172.21.15.40:0/3945706645 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e4c09c890 0x7f8e4c09cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.643+0000 7f8e50b51700 1 -- 172.21.15.40:0/3945706645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e4c09e2b0 msgr2=0x7f8e4c13ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:42.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.643+0000 7f8e50b51700 1 --2- 172.21.15.40:0/3945706645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e4c09e2b0 0x7f8e4c13ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.643+0000 7f8e50b51700 1 -- 172.21.15.40:0/3945706645 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4c09e750 con 0x7f8e4c09d920 2023-09-30T22:29:42.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.643+0000 7f8e50b51700 1 --2- 172.21.15.40:0/3945706645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e4c09d920 0x7f8e4c09dd70 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c0098f0 tx=0x7f8e3c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d12c075b7e8159ff server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:42.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.643+0000 7f8e43fff700 1 -- 172.21.15.40:0/3945706645 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c011830 con 0x7f8e4c09d920 2023-09-30T22:29:42.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.643+0000 7f8e43fff700 1 -- 172.21.15.40:0/3945706645 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3c011990 con 0x7f8e4c09d920 2023-09-30T22:29:42.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.643+0000 7f8e43fff700 1 -- 172.21.15.40:0/3945706645 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c011d20 con 0x7f8e4c09d920 2023-09-30T22:29:42.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.644+0000 7f8e535b6700 1 -- 172.21.15.40:0/3945706645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e4c09d920 msgr2=0x7f8e4c09dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.644+0000 7f8e535b6700 1 --2- 172.21.15.40:0/3945706645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e4c09d920 0x7f8e4c09dd70 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c0098f0 tx=0x7f8e3c009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:42.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.644+0000 7f8e535b6700 1 -- 172.21.15.40:0/3945706645 shutdown_connections 2023-09-30T22:29:42.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.644+0000 7f8e535b6700 1 --2- 172.21.15.40:0/3945706645 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e4c09c890 0x7f8e4c09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.644+0000 7f8e535b6700 1 --2- 172.21.15.40:0/3945706645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e4c09e2b0 0x7f8e4c13ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.644+0000 7f8e535b6700 1 --2- 172.21.15.40:0/3945706645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e4c09d920 0x7f8e4c09dd70 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.644+0000 7f8e535b6700 1 -- 172.21.15.40:0/3945706645 >> 172.21.15.40:0/3945706645 conn(0x7f8e4c0a7080 msgr2=0x7f8e4c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:42.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.644+0000 7f8e535b6700 1 -- 172.21.15.40:0/3945706645 shutdown_connections 2023-09-30T22:29:42.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.644+0000 7f8e535b6700 1 -- 172.21.15.40:0/3945706645 wait complete. 2023-09-30T22:29:42.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.645+0000 7f8e535b6700 1 Processor -- start 2023-09-30T22:29:42.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.646+0000 7f8e535b6700 1 -- start start 2023-09-30T22:29:42.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.646+0000 7f8e535b6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e4c09c890 0x7f8e4c12d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.646+0000 7f8e535b6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e4c09d920 0x7f8e4c12d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.646+0000 7f8e535b6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e4c09e2b0 0x7f8e4c12dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:42.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.646+0000 7f8e535b6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c09c3b0 con 0x7f8e4c09c890 2023-09-30T22:29:42.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.646+0000 7f8e535b6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c130870 con 0x7f8e4c09e2b0 2023-09-30T22:29:42.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.646+0000 7f8e535b6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c0a5bf0 con 0x7f8e4c09d920 2023-09-30T22:29:42.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.646+0000 7f8e51352700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e4c09c890 0x7f8e4c12d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:42.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.646+0000 7f8e51352700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e4c09c890 0x7f8e4c12d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57276/0 (socket says 172.21.15.40:57276) 2023-09-30T22:29:42.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.646+0000 7f8e51352700 1 -- 172.21.15.40:0/3110047585 learned_addr learned my addr 172.21.15.40:0/3110047585 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:42.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.646+0000 7f8e51b53700 1 --2- 172.21.15.40:0/3110047585 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e4c09e2b0 0x7f8e4c12dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:42.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.647+0000 7f8e50b51700 1 --2- 172.21.15.40:0/3110047585 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e4c09d920 0x7f8e4c12d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:42.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.647+0000 7f8e51352700 1 -- 172.21.15.40:0/3110047585 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e4c09d920 msgr2=0x7f8e4c12d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.647+0000 7f8e51352700 1 --2- 172.21.15.40:0/3110047585 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e4c09d920 0x7f8e4c12d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.647+0000 7f8e51352700 1 -- 172.21.15.40:0/3110047585 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e4c09e2b0 msgr2=0x7f8e4c12dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.647+0000 7f8e51352700 1 --2- 172.21.15.40:0/3110047585 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e4c09e2b0 0x7f8e4c12dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.647+0000 7f8e51352700 1 -- 172.21.15.40:0/3110047585 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3c009550 con 0x7f8e4c09c890 2023-09-30T22:29:42.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.647+0000 7f8e51b53700 1 --2- 172.21.15.40:0/3110047585 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e4c09e2b0 0x7f8e4c12dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:42.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.647+0000 7f8e51352700 1 --2- 172.21.15.40:0/3110047585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e4c09c890 0x7f8e4c12d190 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f8e4800e870 tx=0x7f8e4800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:42.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.647+0000 7f8e41ffb700 1 -- 172.21.15.40:0/3110047585 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4800ee70 con 0x7f8e4c09c890 2023-09-30T22:29:42.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.647+0000 7f8e41ffb700 1 -- 172.21.15.40:0/3110047585 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e48005a20 con 0x7f8e4c09c890 2023-09-30T22:29:42.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.647+0000 7f8e535b6700 1 -- 172.21.15.40:0/3110047585 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e4c09ecf0 con 0x7f8e4c09c890 2023-09-30T22:29:42.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.647+0000 7f8e535b6700 1 -- 172.21.15.40:0/3110047585 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e4c1312e0 con 0x7f8e4c09c890 2023-09-30T22:29:42.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.648+0000 7f8e41ffb700 1 -- 172.21.15.40:0/3110047585 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e48005d90 con 0x7f8e4c09c890 2023-09-30T22:29:42.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.648+0000 7f8e41ffb700 1 -- 172.21.15.40:0/3110047585 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8e4800c850 con 0x7f8e4c09c890 2023-09-30T22:29:42.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.648+0000 7f8e41ffb700 1 -- 172.21.15.40:0/3110047585 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f8e4803f880 con 0x7f8e4c09c890 2023-09-30T22:29:42.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.649+0000 7f8e535b6700 1 -- 172.21.15.40:0/3110047585 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e2c0052e0 con 0x7f8e4c09c890 2023-09-30T22:29:42.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.658+0000 7f8e41ffb700 1 -- 172.21.15.40:0/3110047585 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e48020080 con 0x7f8e4c09c890 2023-09-30T22:29:42.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.726+0000 7f0017704700 1 -- 172.21.15.40:0/4246824927 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0010074330 con 0x7f001012eea0 2023-09-30T22:29:42.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.727+0000 7f0005ffb700 1 -- 172.21.15.40:0/4246824927 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f00080192c0 con 0x7f001012eea0 2023-09-30T22:29:42.728 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:42.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.730+0000 7f0017704700 1 -- 172.21.15.40:0/4246824927 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f001012eea0 msgr2=0x7f0010137ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.730+0000 7f0017704700 1 --2- 172.21.15.40:0/4246824927 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f001012eea0 0x7f0010137ba0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f000800cbc0 tx=0x7f000800ced0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.730+0000 7f0017704700 1 -- 172.21.15.40:0/4246824927 shutdown_connections 2023-09-30T22:29:42.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.730+0000 7f0017704700 1 --2- 172.21.15.40:0/4246824927 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f001012d6d0 0x7f0010138f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.730+0000 7f0017704700 1 --2- 172.21.15.40:0/4246824927 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f001012eea0 0x7f0010137ba0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.730+0000 7f0017704700 1 --2- 172.21.15.40:0/4246824927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f001012e590 0x7f0010137660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.730+0000 7f0017704700 1 -- 172.21.15.40:0/4246824927 >> 172.21.15.40:0/4246824927 conn(0x7f00100a2a00 msgr2=0x7f0010130df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:42.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.730+0000 7f0017704700 1 -- 172.21.15.40:0/4246824927 shutdown_connections 2023-09-30T22:29:42.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.730+0000 7f0017704700 1 -- 172.21.15.40:0/4246824927 wait complete. 2023-09-30T22:29:42.744 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:42.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.802+0000 7f319817d700 1 -- 172.21.15.40:0/1949669605 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3190062380 con 0x7f319009e400 2023-09-30T22:29:42.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.803+0000 7f31867fc700 1 -- 172.21.15.40:0/1949669605 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3180028020 con 0x7f319009e400 2023-09-30T22:29:42.803 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:42.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.806+0000 7f319817d700 1 -- 172.21.15.40:0/1949669605 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319009e400 msgr2=0x7f319011ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.806+0000 7f319817d700 1 --2- 172.21.15.40:0/1949669605 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319009e400 0x7f319011ef60 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f3180009f50 tx=0x7f3180004750 comp rx=0 tx=0).stop 2023-09-30T22:29:42.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.806+0000 7f319817d700 1 -- 172.21.15.40:0/1949669605 shutdown_connections 2023-09-30T22:29:42.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.806+0000 7f319817d700 1 --2- 172.21.15.40:0/1949669605 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f319009d920 0x7f319011ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.806+0000 7f319817d700 1 --2- 172.21.15.40:0/1949669605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f319011f4a0 0x7f31901351b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.806+0000 7f319817d700 1 --2- 172.21.15.40:0/1949669605 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f319009e400 0x7f319011ef60 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.806+0000 7f319817d700 1 -- 172.21.15.40:0/1949669605 >> 172.21.15.40:0/1949669605 conn(0x7f319009fb20 msgr2=0x7f3190070860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:42.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.806+0000 7f319817d700 1 -- 172.21.15.40:0/1949669605 shutdown_connections 2023-09-30T22:29:42.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.806+0000 7f319817d700 1 -- 172.21.15.40:0/1949669605 wait complete. 2023-09-30T22:29:42.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.817+0000 7f0e590af700 1 -- 172.21.15.40:0/2190245374 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0e5411ee40 con 0x7f0e54131fc0 2023-09-30T22:29:42.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.818+0000 7f0e4b7fe700 1 -- 172.21.15.40:0/2190245374 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0e4c023090 con 0x7f0e54131fc0 2023-09-30T22:29:42.819 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:42.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.820+0000 7f0e590af700 1 -- 172.21.15.40:0/2190245374 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e54131fc0 msgr2=0x7f0e5411e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.820+0000 7f0e590af700 1 --2- 172.21.15.40:0/2190245374 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e54131fc0 0x7f0e5411e5c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c00b9a0 tx=0x7f0e4c00bd60 comp rx=0 tx=0).stop 2023-09-30T22:29:42.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.820+0000 7f0e590af700 1 -- 172.21.15.40:0/2190245374 shutdown_connections 2023-09-30T22:29:42.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.820+0000 7f0e590af700 1 --2- 172.21.15.40:0/2190245374 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e54131fc0 0x7f0e5411e5c0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.820+0000 7f0e590af700 1 --2- 172.21.15.40:0/2190245374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e5406a6d0 0x7f0e5411db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.820+0000 7f0e590af700 1 --2- 172.21.15.40:0/2190245374 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0e5406afe0 0x7f0e5411e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.820+0000 7f0e590af700 1 -- 172.21.15.40:0/2190245374 >> 172.21.15.40:0/2190245374 conn(0x7f0e5409fb20 msgr2=0x7f0e540a2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:42.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.820+0000 7f0e590af700 1 -- 172.21.15.40:0/2190245374 shutdown_connections 2023-09-30T22:29:42.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.820+0000 7f0e590af700 1 -- 172.21.15.40:0/2190245374 wait complete. 2023-09-30T22:29:42.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:42.833 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:42.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.890+0000 7f8e535b6700 1 -- 172.21.15.40:0/3110047585 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8e2c005590 con 0x7f8e4c09c890 2023-09-30T22:29:42.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.890+0000 7f8e41ffb700 1 -- 172.21.15.40:0/3110047585 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8e48017020 con 0x7f8e4c09c890 2023-09-30T22:29:42.891 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:42.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.893+0000 7f8e535b6700 1 -- 172.21.15.40:0/3110047585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e4c09c890 msgr2=0x7f8e4c12d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:42.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.893+0000 7f8e535b6700 1 --2- 172.21.15.40:0/3110047585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e4c09c890 0x7f8e4c12d190 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f8e4800e870 tx=0x7f8e4800ec30 comp rx=0 tx=0).stop 2023-09-30T22:29:42.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.893+0000 7f8e535b6700 1 -- 172.21.15.40:0/3110047585 shutdown_connections 2023-09-30T22:29:42.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.893+0000 7f8e535b6700 1 --2- 172.21.15.40:0/3110047585 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e4c09e2b0 0x7f8e4c12dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.893+0000 7f8e535b6700 1 --2- 172.21.15.40:0/3110047585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e4c09c890 0x7f8e4c12d190 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.893+0000 7f8e535b6700 1 --2- 172.21.15.40:0/3110047585 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e4c09d920 0x7f8e4c12d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:42.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.893+0000 7f8e535b6700 1 -- 172.21.15.40:0/3110047585 >> 172.21.15.40:0/3110047585 conn(0x7f8e4c0a7080 msgr2=0x7f8e4c0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:42.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.893+0000 7f8e535b6700 1 -- 172.21.15.40:0/3110047585 shutdown_connections 2023-09-30T22:29:42.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:42.893+0000 7f8e535b6700 1 -- 172.21.15.40:0/3110047585 wait complete. 2023-09-30T22:29:42.905 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:43.745 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:43.824 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:43.835 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:43.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.889+0000 7f86e61d8700 1 Processor -- start 2023-09-30T22:29:43.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.889+0000 7f86e61d8700 1 -- start start 2023-09-30T22:29:43.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.889+0000 7f86e61d8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f86e009c890 0x7f86e009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:43.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.890+0000 7f86e61d8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f86e009e480 0x7f86e013bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:43.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.890+0000 7f86e61d8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e00a2600 con 0x7f86e009d920 2023-09-30T22:29:43.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.890+0000 7f86e61d8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e00a29d0 con 0x7f86e009c890 2023-09-30T22:29:43.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.890+0000 7f86e61d8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86e009fb40 con 0x7f86e009e480 2023-09-30T22:29:43.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.890+0000 7f86df7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f86e009c890 0x7f86e009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:43.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.890+0000 7f86dffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f86e009e480 0x7f86e013bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:43.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.890+0000 7f86df7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f86e009c890 0x7f86e009cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:40198/0 (socket says 172.21.15.40:40198) 2023-09-30T22:29:43.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.890+0000 7f86df7fe700 1 -- 172.21.15.40:0/157150314 learned_addr learned my addr 172.21.15.40:0/157150314 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:43.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.890+0000 7f86dffff700 1 -- 172.21.15.40:0/157150314 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f86e009c890 msgr2=0x7f86e009cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:43.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.890+0000 7f86dffff700 1 --2- 172.21.15.40:0/157150314 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f86e009c890 0x7f86e009cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:43.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.890+0000 7f86de7fc700 1 -- 172.21.15.40:0/157150314 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2131909833 0 0) 0x7f86e00a2600 con 0x7f86e009d920 2023-09-30T22:29:43.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.890+0000 7f86dffff700 1 -- 172.21.15.40:0/157150314 >> v1:172.21.15.40:6789/0 conn(0x7f86e009d920 legacy=0x7f86e009dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:43.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.890+0000 7f86dffff700 1 -- 172.21.15.40:0/157150314 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e009fed0 con 0x7f86e009e480 2023-09-30T22:29:43.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.890+0000 7f86df7fe700 1 --2- 172.21.15.40:0/157150314 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f86e009c890 0x7f86e009cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:43.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.890+0000 7f86dffff700 1 --2- 172.21.15.40:0/157150314 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f86e009e480 0x7f86e013bc20 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f86d8009dc0 tx=0x7f86d800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec06c1872effca43 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:43.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.891+0000 7f86de7fc700 1 -- 172.21.15.40:0/157150314 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d800e070 con 0x7f86e009e480 2023-09-30T22:29:43.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.891+0000 7f86de7fc700 1 -- 172.21.15.40:0/157150314 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d800bb20 con 0x7f86e009e480 2023-09-30T22:29:43.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.891+0000 7f86de7fc700 1 -- 172.21.15.40:0/157150314 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d8012430 con 0x7f86e009e480 2023-09-30T22:29:43.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.891+0000 7f86e61d8700 1 -- 172.21.15.40:0/157150314 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f86e009e480 msgr2=0x7f86e013bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:43.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.891+0000 7f86e61d8700 1 --2- 172.21.15.40:0/157150314 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f86e009e480 0x7f86e013bc20 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f86d8009dc0 tx=0x7f86d800b330 comp rx=0 tx=0).stop 2023-09-30T22:29:43.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.891+0000 7f86e61d8700 1 -- 172.21.15.40:0/157150314 shutdown_connections 2023-09-30T22:29:43.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.891+0000 7f86e61d8700 1 --2- 172.21.15.40:0/157150314 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f86e009e480 0x7f86e013bc20 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:43.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.891+0000 7f86e61d8700 1 --2- 172.21.15.40:0/157150314 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f86e009c890 0x7f86e009cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:43.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.891+0000 7f86e61d8700 1 -- 172.21.15.40:0/157150314 >> 172.21.15.40:0/157150314 conn(0x7f86e00a7080 msgr2=0x7f86e00a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:43.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.891+0000 7f86e61d8700 1 -- 172.21.15.40:0/157150314 shutdown_connections 2023-09-30T22:29:43.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.891+0000 7f86e61d8700 1 -- 172.21.15.40:0/157150314 wait complete. 2023-09-30T22:29:43.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.892+0000 7f86e61d8700 1 Processor -- start 2023-09-30T22:29:43.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.893+0000 7f86e61d8700 1 -- start start 2023-09-30T22:29:43.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.893+0000 7f86e61d8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f86e009c890 0x7f86e012f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:43.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.893+0000 7f86e61d8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86e009d920 0x7f86e012fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:43.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.893+0000 7f86e61d8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f86e009e480 0x7f86e012ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:43.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.893+0000 7f86e61d8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e009ecf0 con 0x7f86e009d920 2023-09-30T22:29:43.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.893+0000 7f86e61d8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e0131120 con 0x7f86e009c890 2023-09-30T22:29:43.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.893+0000 7f86e61d8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86e012e680 con 0x7f86e009e480 2023-09-30T22:29:43.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.893+0000 7f86df7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f86e009c890 0x7f86e012f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:43.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.893+0000 7f86df7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f86e009c890 0x7f86e012f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:40210/0 (socket says 172.21.15.40:40210) 2023-09-30T22:29:43.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.893+0000 7f86df7fe700 1 -- 172.21.15.40:0/2554418096 learned_addr learned my addr 172.21.15.40:0/2554418096 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:43.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.893+0000 7f86deffd700 1 --2- 172.21.15.40:0/2554418096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86e009d920 0x7f86e012fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:43.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.893+0000 7f86dffff700 1 --2- 172.21.15.40:0/2554418096 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f86e009e480 0x7f86e012ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:43.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.894+0000 7f86df7fe700 1 -- 172.21.15.40:0/2554418096 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f86e009e480 msgr2=0x7f86e012ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:43.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.894+0000 7f86df7fe700 1 --2- 172.21.15.40:0/2554418096 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f86e009e480 0x7f86e012ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:43.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.894+0000 7f86df7fe700 1 -- 172.21.15.40:0/2554418096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86e009d920 msgr2=0x7f86e012fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:43.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.894+0000 7f86df7fe700 1 --2- 172.21.15.40:0/2554418096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86e009d920 0x7f86e012fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:43.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.894+0000 7f86df7fe700 1 -- 172.21.15.40:0/2554418096 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d0009500 con 0x7f86e009c890 2023-09-30T22:29:43.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.894+0000 7f86deffd700 1 --2- 172.21.15.40:0/2554418096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86e009d920 0x7f86e012fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:43.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.894+0000 7f86df7fe700 1 --2- 172.21.15.40:0/2554418096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f86e009c890 0x7f86e012f540 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f86d000e9a0 tx=0x7f86d000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:43.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.894+0000 7f86c7fff700 1 -- 172.21.15.40:0/2554418096 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d0005a20 con 0x7f86e009c890 2023-09-30T22:29:43.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.894+0000 7f86c7fff700 1 -- 172.21.15.40:0/2554418096 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d0005b80 con 0x7f86e009c890 2023-09-30T22:29:43.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.894+0000 7f86e61d8700 1 -- 172.21.15.40:0/2554418096 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86d8009a70 con 0x7f86e009c890 2023-09-30T22:29:43.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.894+0000 7f86c7fff700 1 -- 172.21.15.40:0/2554418096 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d000c690 con 0x7f86e009c890 2023-09-30T22:29:43.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.894+0000 7f86e61d8700 1 -- 172.21.15.40:0/2554418096 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e012dbf0 con 0x7f86e009c890 2023-09-30T22:29:43.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.895+0000 7f86c7fff700 1 -- 172.21.15.40:0/2554418096 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f86d000c7f0 con 0x7f86e009c890 2023-09-30T22:29:43.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.895+0000 7f86c7fff700 1 -- 172.21.15.40:0/2554418096 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f86d003f8d0 con 0x7f86e009c890 2023-09-30T22:29:43.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.896+0000 7f86e61d8700 1 -- 172.21.15.40:0/2554418096 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e006e600 con 0x7f86e009c890 2023-09-30T22:29:43.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.900+0000 7f86c7fff700 1 -- 172.21.15.40:0/2554418096 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f86d0020080 con 0x7f86e009c890 2023-09-30T22:29:43.906 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:43.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.962+0000 7f5160cd9700 1 Processor -- start 2023-09-30T22:29:43.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.962+0000 7f5160cd9700 1 -- start start 2023-09-30T22:29:43.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.963+0000 7f5160cd9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f515c09e400 0x7f515c135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:43.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.963+0000 7f5160cd9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f515c136230 0x7f515c138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:43.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.963+0000 7f5160cd9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f515c09adf0 con 0x7f515c09d920 2023-09-30T22:29:43.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.963+0000 7f5160cd9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f515c09e7f0 con 0x7f515c136230 2023-09-30T22:29:43.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.963+0000 7f5160cd9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f515c09edf0 con 0x7f515c09e400 2023-09-30T22:29:43.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.963+0000 7f515a59c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f515c09d920 0x7f515c09dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40294/0 (socket says 172.21.15.40:40294) 2023-09-30T22:29:43.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.963+0000 7f515a59c700 1 -- 172.21.15.40:0/4237135396 learned_addr learned my addr 172.21.15.40:0/4237135396 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:29:43.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.963+0000 7f515ad9d700 1 --2- 172.21.15.40:0/4237135396 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f515c136230 0x7f515c138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:43.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.963+0000 7f5159d9b700 1 --2- 172.21.15.40:0/4237135396 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f515c09e400 0x7f515c135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:43.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.963+0000 7f515959a700 1 -- 172.21.15.40:0/4237135396 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1270662729 0 0) 0x7f515c09adf0 con 0x7f515c09d920 2023-09-30T22:29:43.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.963+0000 7f515959a700 1 -- 172.21.15.40:0/4237135396 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51440035b0 con 0x7f515c09d920 2023-09-30T22:29:43.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.964+0000 7f515ad9d700 1 -- 172.21.15.40:0/4237135396 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f515c09e400 msgr2=0x7f515c135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:43.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.964+0000 7f515ad9d700 1 --2- 172.21.15.40:0/4237135396 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f515c09e400 0x7f515c135cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:43.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.964+0000 7f515ad9d700 1 -- 172.21.15.40:0/4237135396 >> v1:172.21.15.40:6789/0 conn(0x7f515c09d920 legacy=0x7f515c09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:43.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.964+0000 7f515ad9d700 1 -- 172.21.15.40:0/4237135396 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f515c09b660 con 0x7f515c136230 2023-09-30T22:29:43.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.964+0000 7f515ad9d700 1 --2- 172.21.15.40:0/4237135396 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f515c136230 0x7f515c138610 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f5154009df0 tx=0x7f515400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6e7f52ff1882edd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:43.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.964+0000 7f5159d9b700 1 --2- 172.21.15.40:0/4237135396 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f515c09e400 0x7f515c135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:43.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.964+0000 7f515959a700 1 -- 172.21.15.40:0/4237135396 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515400e070 con 0x7f515c136230 2023-09-30T22:29:43.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.964+0000 7f515959a700 1 -- 172.21.15.40:0/4237135396 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f515400bae0 con 0x7f515c136230 2023-09-30T22:29:43.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.964+0000 7f515959a700 1 -- 172.21.15.40:0/4237135396 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515400be70 con 0x7f515c136230 2023-09-30T22:29:43.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.965+0000 7f5160cd9700 1 -- 172.21.15.40:0/4237135396 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f515c136230 msgr2=0x7f515c138610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:43.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.965+0000 7f5160cd9700 1 --2- 172.21.15.40:0/4237135396 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f515c136230 0x7f515c138610 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f5154009df0 tx=0x7f515400b330 comp rx=0 tx=0).stop 2023-09-30T22:29:43.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.965+0000 7f5160cd9700 1 -- 172.21.15.40:0/4237135396 shutdown_connections 2023-09-30T22:29:43.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.965+0000 7f5160cd9700 1 --2- 172.21.15.40:0/4237135396 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f515c136230 0x7f515c138610 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:43.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.965+0000 7f5160cd9700 1 --2- 172.21.15.40:0/4237135396 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f515c09e400 0x7f515c135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:43.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.965+0000 7f5160cd9700 1 -- 172.21.15.40:0/4237135396 >> 172.21.15.40:0/4237135396 conn(0x7f515c09fb20 msgr2=0x7f515c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:43.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.965+0000 7f5160cd9700 1 -- 172.21.15.40:0/4237135396 shutdown_connections 2023-09-30T22:29:43.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.965+0000 7f5160cd9700 1 -- 172.21.15.40:0/4237135396 wait complete. 2023-09-30T22:29:43.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.966+0000 7f5160cd9700 1 Processor -- start 2023-09-30T22:29:43.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.967+0000 7f5160cd9700 1 -- start start 2023-09-30T22:29:43.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.967+0000 7f5160cd9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f515c09d920 0x7f515c1228d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:43.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.967+0000 7f5160cd9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f515c09e400 0x7f515c122e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:43.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.967+0000 7f5160cd9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f515c136230 0x7f515c123350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:43.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.967+0000 7f5160cd9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515c124d60 con 0x7f515c09e400 2023-09-30T22:29:43.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.967+0000 7f5160cd9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f515c1263a0 con 0x7f515c09d920 2023-09-30T22:29:43.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.967+0000 7f5160cd9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f515c124490 con 0x7f515c136230 2023-09-30T22:29:43.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.967+0000 7f515a59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f515c09d920 0x7f515c1228d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:43.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.967+0000 7f515a59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f515c09d920 0x7f515c1228d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:40232/0 (socket says 172.21.15.40:40232) 2023-09-30T22:29:43.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.967+0000 7f515a59c700 1 -- 172.21.15.40:0/2219890628 learned_addr learned my addr 172.21.15.40:0/2219890628 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:43.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.968+0000 7f515ad9d700 1 --2- 172.21.15.40:0/2219890628 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f515c136230 0x7f515c123350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:43.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.968+0000 7f5159d9b700 1 --2- 172.21.15.40:0/2219890628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f515c09e400 0x7f515c122e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:43.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.968+0000 7f515a59c700 1 -- 172.21.15.40:0/2219890628 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f515c136230 msgr2=0x7f515c123350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:43.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.968+0000 7f515a59c700 1 --2- 172.21.15.40:0/2219890628 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f515c136230 0x7f515c123350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:43.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.968+0000 7f515a59c700 1 -- 172.21.15.40:0/2219890628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f515c09e400 msgr2=0x7f515c122e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:43.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.968+0000 7f515a59c700 1 --2- 172.21.15.40:0/2219890628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f515c09e400 0x7f515c122e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:43.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.968+0000 7f515a59c700 1 -- 172.21.15.40:0/2219890628 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5154009a70 con 0x7f515c09d920 2023-09-30T22:29:43.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.968+0000 7f515a59c700 1 --2- 172.21.15.40:0/2219890628 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f515c09d920 0x7f515c1228d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f514c001260 tx=0x7f514c00c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:43.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.968+0000 7f514affd700 1 -- 172.21.15.40:0/2219890628 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c0074e0 con 0x7f515c09d920 2023-09-30T22:29:43.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.968+0000 7f514affd700 1 -- 172.21.15.40:0/2219890628 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514c007640 con 0x7f515c09d920 2023-09-30T22:29:43.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.968+0000 7f514affd700 1 -- 172.21.15.40:0/2219890628 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c005a50 con 0x7f515c09d920 2023-09-30T22:29:43.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.968+0000 7f5160cd9700 1 -- 172.21.15.40:0/2219890628 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f515c124a40 con 0x7f515c09d920 2023-09-30T22:29:43.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.969+0000 7f5160cd9700 1 -- 172.21.15.40:0/2219890628 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f515c09cb00 con 0x7f515c09d920 2023-09-30T22:29:43.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.969+0000 7f514affd700 1 -- 172.21.15.40:0/2219890628 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f514c005bb0 con 0x7f515c09d920 2023-09-30T22:29:43.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.970+0000 7f514affd700 1 -- 172.21.15.40:0/2219890628 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f514c03eb80 con 0x7f515c09d920 2023-09-30T22:29:43.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.970+0000 7f5160cd9700 1 -- 172.21.15.40:0/2219890628 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f515c09a660 con 0x7f515c09d920 2023-09-30T22:29:43.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:43.981+0000 7f514affd700 1 -- 172.21.15.40:0/2219890628 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f514c03ee60 con 0x7f515c09d920 2023-09-30T22:29:44.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.011+0000 7f15dfd4a700 1 Processor -- start 2023-09-30T22:29:44.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.011+0000 7f15dfd4a700 1 -- start start 2023-09-30T22:29:44.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.012+0000 7f15dfd4a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15d809d920 0x7f15d809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:44.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.012+0000 7f15dfd4a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f15d809e230 0x7f15d81308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:44.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.012+0000 7f15dfd4a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f15d8130de0 0x7f15d8131260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:44.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.012+0000 7f15dfd4a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15d809edf0 con 0x7f15d809e230 2023-09-30T22:29:44.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.012+0000 7f15dfd4a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d809adf0 con 0x7f15d809d920 2023-09-30T22:29:44.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.012+0000 7f15dfd4a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15d809b660 con 0x7f15d8130de0 2023-09-30T22:29:44.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.012+0000 7f15de2e7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f15d8130de0 0x7f15d8131260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:44.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.012+0000 7f15dd2e5700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f15d809e230 0x7f15d81308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:44.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.012+0000 7f15de2e7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f15d8130de0 0x7f15d8131260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:37920/0 (socket says 172.21.15.40:37920) 2023-09-30T22:29:44.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.012+0000 7f15dd2e5700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f15d809e230 0x7f15d81308a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49580/0 (socket says 172.21.15.40:49580) 2023-09-30T22:29:44.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.012+0000 7f15de2e7700 1 -- 172.21.15.40:0/386910964 learned_addr learned my addr 172.21.15.40:0/386910964 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:44.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.012+0000 7f15ddae6700 1 --2- 172.21.15.40:0/386910964 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15d809d920 0x7f15d809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:44.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.012+0000 7f15dd2e5700 1 -- 172.21.15.40:0/386910964 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f15d8130de0 msgr2=0x7f15d8131260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:44.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.012+0000 7f15dd2e5700 1 --2- 172.21.15.40:0/386910964 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f15d8130de0 0x7f15d8131260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.012+0000 7f15dd2e5700 1 -- 172.21.15.40:0/386910964 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15d809d920 msgr2=0x7f15d809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:44.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.012+0000 7f15dd2e5700 1 --2- 172.21.15.40:0/386910964 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15d809d920 0x7f15d809dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.012+0000 7f15dd2e5700 1 -- 172.21.15.40:0/386910964 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d809a6e0 con 0x7f15d809e230 2023-09-30T22:29:44.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.013+0000 7f15dd2e5700 1 --2- 172.21.15.40:0/386910964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15d809e230 0x7f15d81308a0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f15c8009840 tx=0x7f15c8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=483ffc8da0bcfbd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:44.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.014+0000 7f15dcae4700 1 -- 172.21.15.40:0/386910964 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c8011830 con 0x7f15d809e230 2023-09-30T22:29:44.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.014+0000 7f15dcae4700 1 -- 172.21.15.40:0/386910964 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c8011990 con 0x7f15d809e230 2023-09-30T22:29:44.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.014+0000 7f15dcae4700 1 -- 172.21.15.40:0/386910964 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c8011d00 con 0x7f15d809e230 2023-09-30T22:29:44.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.015+0000 7f15dfd4a700 1 -- 172.21.15.40:0/386910964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15d809e230 msgr2=0x7f15d81308a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:44.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.015+0000 7f15dfd4a700 1 --2- 172.21.15.40:0/386910964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15d809e230 0x7f15d81308a0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f15c8009840 tx=0x7f15c8009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:44.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.015+0000 7f15dfd4a700 1 -- 172.21.15.40:0/386910964 shutdown_connections 2023-09-30T22:29:44.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.015+0000 7f15dfd4a700 1 --2- 172.21.15.40:0/386910964 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f15d8130de0 0x7f15d8131260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.015+0000 7f15dfd4a700 1 --2- 172.21.15.40:0/386910964 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15d809d920 0x7f15d809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.015+0000 7f15dfd4a700 1 --2- 172.21.15.40:0/386910964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15d809e230 0x7f15d81308a0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.015+0000 7f15dfd4a700 1 -- 172.21.15.40:0/386910964 >> 172.21.15.40:0/386910964 conn(0x7f15d809fb20 msgr2=0x7f15d809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:44.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.015+0000 7f15dfd4a700 1 -- 172.21.15.40:0/386910964 shutdown_connections 2023-09-30T22:29:44.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.015+0000 7f15dfd4a700 1 -- 172.21.15.40:0/386910964 wait complete. 2023-09-30T22:29:44.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.016+0000 7f15dfd4a700 1 Processor -- start 2023-09-30T22:29:44.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.016+0000 7f15dfd4a700 1 -- start start 2023-09-30T22:29:44.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.017+0000 7f15dfd4a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f15d809d920 0x7f15d812e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:44.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.017+0000 7f15dfd4a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15d809e230 0x7f15d812e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:44.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.017+0000 7f15dfd4a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15d8130de0 0x7f15d812ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:44.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.017+0000 7f15dfd4a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d81303b0 con 0x7f15d8130de0 2023-09-30T22:29:44.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.017+0000 7f15dfd4a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d813e060 con 0x7f15d809e230 2023-09-30T22:29:44.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.017+0000 7f15dfd4a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15d812ff10 con 0x7f15d809d920 2023-09-30T22:29:44.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.017+0000 7f15dd2e5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15d809e230 0x7f15d812e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:44.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.017+0000 7f15dd2e5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15d809e230 0x7f15d812e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:40238/0 (socket says 172.21.15.40:40238) 2023-09-30T22:29:44.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.017+0000 7f15dd2e5700 1 -- 172.21.15.40:0/220761874 learned_addr learned my addr 172.21.15.40:0/220761874 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:44.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.018+0000 7f15de2e7700 1 --2- 172.21.15.40:0/220761874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15d8130de0 0x7f15d812ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:44.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.018+0000 7f15dd2e5700 1 -- 172.21.15.40:0/220761874 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f15d809d920 msgr2=0x7f15d812e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:44.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.018+0000 7f15dd2e5700 1 --2- 172.21.15.40:0/220761874 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f15d809d920 0x7f15d812e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.018+0000 7f15dd2e5700 1 -- 172.21.15.40:0/220761874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15d8130de0 msgr2=0x7f15d812ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:44.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.018+0000 7f15dd2e5700 1 --2- 172.21.15.40:0/220761874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15d8130de0 0x7f15d812ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.018+0000 7f15dd2e5700 1 -- 172.21.15.40:0/220761874 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c80094a0 con 0x7f15d809e230 2023-09-30T22:29:44.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.018+0000 7f15dd2e5700 1 --2- 172.21.15.40:0/220761874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15d809e230 0x7f15d812e750 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f15c80090b0 tx=0x7f15c8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:44.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.018+0000 7f15ce7fc700 1 -- 172.21.15.40:0/220761874 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c80036a0 con 0x7f15d809e230 2023-09-30T22:29:44.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.018+0000 7f15ce7fc700 1 -- 172.21.15.40:0/220761874 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c801f070 con 0x7f15d809e230 2023-09-30T22:29:44.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.018+0000 7f15dfd4a700 1 -- 172.21.15.40:0/220761874 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15d806b140 con 0x7f15d809e230 2023-09-30T22:29:44.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.018+0000 7f15ce7fc700 1 -- 172.21.15.40:0/220761874 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c8003a60 con 0x7f15d809e230 2023-09-30T22:29:44.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.019+0000 7f15dfd4a700 1 -- 172.21.15.40:0/220761874 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15d809cb00 con 0x7f15d809e230 2023-09-30T22:29:44.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.020+0000 7f15dfd4a700 1 -- 172.21.15.40:0/220761874 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15d812b1e0 con 0x7f15d809e230 2023-09-30T22:29:44.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.020+0000 7f15ce7fc700 1 -- 172.21.15.40:0/220761874 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f15c8003bc0 con 0x7f15d809e230 2023-09-30T22:29:44.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.029+0000 7f15ce7fc700 1 -- 172.21.15.40:0/220761874 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f15c8021070 con 0x7f15d809e230 2023-09-30T22:29:44.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.029+0000 7f15ce7fc700 1 -- 172.21.15.40:0/220761874 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f15c8046060 con 0x7f15d809e230 2023-09-30T22:29:44.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.055+0000 7f6265d9f700 1 Processor -- start 2023-09-30T22:29:44.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.055+0000 7f6265d9f700 1 -- start start 2023-09-30T22:29:44.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.056+0000 7f6265d9f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6260133a80 0x7f6260133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:44.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.056+0000 7f6265d9f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6260134390 0x7f6260099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.056+0000 7f6265d9f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62601336c0 con 0x7f6260099f80 2023-09-30T22:29:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.056+0000 7f6265d9f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f626009b920 con 0x7f6260134390 2023-09-30T22:29:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.056+0000 7f6265d9f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6260071590 con 0x7f6260133a80 2023-09-30T22:29:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.056+0000 7f6264d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6260133a80 0x7f6260133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.056+0000 7f6264d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6260133a80 0x7f6260133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:40248/0 (socket says 172.21.15.40:40248) 2023-09-30T22:29:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.056+0000 7f6264d9d700 1 -- 172.21.15.40:0/493383726 learned_addr learned my addr 172.21.15.40:0/493383726 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:44.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.056+0000 7f6264d9d700 1 -- 172.21.15.40:0/493383726 >> v2:172.21.15.40:3300/0 conn(0x7f6260134390 msgr2=0x7f6260099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:44.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.056+0000 7f6264d9d700 1 --2- 172.21.15.40:0/493383726 >> v2:172.21.15.40:3300/0 conn(0x7f6260134390 0x7f6260099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.056+0000 7f6264d9d700 1 -- 172.21.15.40:0/493383726 >> v1:172.21.15.40:6789/0 conn(0x7f6260099f80 legacy=0x7f626013a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:44.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.056+0000 7f6264d9d700 1 -- 172.21.15.40:0/493383726 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626006eb70 con 0x7f6260133a80 2023-09-30T22:29:44.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.056+0000 7f6264d9d700 1 --2- 172.21.15.40:0/493383726 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6260133a80 0x7f6260133e50 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f62540098f0 tx=0x7f6254009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b3d6068a815b213 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:44.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.056+0000 7f625f7fe700 1 -- 172.21.15.40:0/493383726 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6254004230 con 0x7f6260133a80 2023-09-30T22:29:44.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.056+0000 7f625f7fe700 1 -- 172.21.15.40:0/493383726 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6254004390 con 0x7f6260133a80 2023-09-30T22:29:44.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.056+0000 7f625f7fe700 1 -- 172.21.15.40:0/493383726 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62540036a0 con 0x7f6260133a80 2023-09-30T22:29:44.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.057+0000 7f6265d9f700 1 -- 172.21.15.40:0/493383726 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6260133a80 msgr2=0x7f6260133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:44.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.057+0000 7f6265d9f700 1 --2- 172.21.15.40:0/493383726 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6260133a80 0x7f6260133e50 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f62540098f0 tx=0x7f6254009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:44.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.057+0000 7f6265d9f700 1 -- 172.21.15.40:0/493383726 shutdown_connections 2023-09-30T22:29:44.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.057+0000 7f6265d9f700 1 --2- 172.21.15.40:0/493383726 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6260133a80 0x7f6260133e50 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.057+0000 7f6265d9f700 1 --2- 172.21.15.40:0/493383726 >> v2:172.21.15.40:3300/0 conn(0x7f6260134390 0x7f6260099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.057+0000 7f6265d9f700 1 -- 172.21.15.40:0/493383726 >> 172.21.15.40:0/493383726 conn(0x7f62600a27f0 msgr2=0x7f62600a2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:44.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.057+0000 7f6265d9f700 1 -- 172.21.15.40:0/493383726 shutdown_connections 2023-09-30T22:29:44.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.057+0000 7f6265d9f700 1 -- 172.21.15.40:0/493383726 wait complete. 2023-09-30T22:29:44.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.059+0000 7f6265d9f700 1 Processor -- start 2023-09-30T22:29:44.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.059+0000 7f6265d9f700 1 -- start start 2023-09-30T22:29:44.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.059+0000 7f6265d9f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6260099f80 0x7f626011a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:44.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.059+0000 7f6265d9f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6260133a80 0x7f626011ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:44.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.059+0000 7f6265d9f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6260134390 0x7f626011b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:44.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.059+0000 7f6265d9f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626011ba70 con 0x7f6260099f80 2023-09-30T22:29:44.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.059+0000 7f6265d9f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f626012d940 con 0x7f6260134390 2023-09-30T22:29:44.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.059+0000 7f6265d9f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f626011dab0 con 0x7f6260133a80 2023-09-30T22:29:44.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.060+0000 7f6264d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6260099f80 0x7f626011a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:44.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.060+0000 7f6264d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6260099f80 0x7f626011a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49614/0 (socket says 172.21.15.40:49614) 2023-09-30T22:29:44.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.060+0000 7f6264d9d700 1 -- 172.21.15.40:0/2023045458 learned_addr learned my addr 172.21.15.40:0/2023045458 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:44.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.060+0000 7f625ffff700 1 --2- 172.21.15.40:0/2023045458 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6260133a80 0x7f626011ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:44.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.060+0000 7f626559e700 1 --2- 172.21.15.40:0/2023045458 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6260134390 0x7f626011b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:44.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.060+0000 7f6264d9d700 1 -- 172.21.15.40:0/2023045458 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6260133a80 msgr2=0x7f626011ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:44.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.060+0000 7f6264d9d700 1 --2- 172.21.15.40:0/2023045458 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6260133a80 0x7f626011ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.060+0000 7f6264d9d700 1 -- 172.21.15.40:0/2023045458 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6260134390 msgr2=0x7f626011b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:44.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.060+0000 7f6264d9d700 1 --2- 172.21.15.40:0/2023045458 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6260134390 0x7f626011b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.060+0000 7f6264d9d700 1 -- 172.21.15.40:0/2023045458 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6254009550 con 0x7f6260099f80 2023-09-30T22:29:44.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.060+0000 7f625ffff700 1 --2- 172.21.15.40:0/2023045458 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6260133a80 0x7f626011ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:44.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.060+0000 7f6264d9d700 1 --2- 172.21.15.40:0/2023045458 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6260099f80 0x7f626011a5c0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f6254009c40 tx=0x7f6254004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:44.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.060+0000 7f625d7fa700 1 -- 172.21.15.40:0/2023045458 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6254025070 con 0x7f6260099f80 2023-09-30T22:29:44.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.060+0000 7f625d7fa700 1 -- 172.21.15.40:0/2023045458 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62540038b0 con 0x7f6260099f80 2023-09-30T22:29:44.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.060+0000 7f625d7fa700 1 -- 172.21.15.40:0/2023045458 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6254003c60 con 0x7f6260099f80 2023-09-30T22:29:44.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.061+0000 7f6265d9f700 1 -- 172.21.15.40:0/2023045458 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f626011c140 con 0x7f6260099f80 2023-09-30T22:29:44.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.061+0000 7f6265d9f700 1 -- 172.21.15.40:0/2023045458 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f626011cf40 con 0x7f6260099f80 2023-09-30T22:29:44.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.061+0000 7f6265d9f700 1 -- 172.21.15.40:0/2023045458 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f626012f760 con 0x7f6260099f80 2023-09-30T22:29:44.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.062+0000 7f625d7fa700 1 -- 172.21.15.40:0/2023045458 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f625400b660 con 0x7f6260099f80 2023-09-30T22:29:44.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.062+0000 7f625d7fa700 1 -- 172.21.15.40:0/2023045458 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6254048da0 con 0x7f6260099f80 2023-09-30T22:29:44.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.066+0000 7f625d7fa700 1 -- 172.21.15.40:0/2023045458 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6254011420 con 0x7f6260099f80 2023-09-30T22:29:44.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.157+0000 7f86e61d8700 1 -- 172.21.15.40:0/2554418096 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f86e0062380 con 0x7f86e009c890 2023-09-30T22:29:44.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.158+0000 7f86c7fff700 1 -- 172.21.15.40:0/2554418096 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f86d0006030 con 0x7f86e009c890 2023-09-30T22:29:44.158 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:44.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.161+0000 7f86e61d8700 1 -- 172.21.15.40:0/2554418096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f86e009c890 msgr2=0x7f86e012f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:44.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.161+0000 7f86e61d8700 1 --2- 172.21.15.40:0/2554418096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f86e009c890 0x7f86e012f540 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f86d000e9a0 tx=0x7f86d000ecb0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.161+0000 7f86e61d8700 1 -- 172.21.15.40:0/2554418096 shutdown_connections 2023-09-30T22:29:44.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.161+0000 7f86e61d8700 1 --2- 172.21.15.40:0/2554418096 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f86e009e480 0x7f86e012ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.161+0000 7f86e61d8700 1 --2- 172.21.15.40:0/2554418096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f86e009c890 0x7f86e012f540 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.161+0000 7f86e61d8700 1 --2- 172.21.15.40:0/2554418096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86e009d920 0x7f86e012fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.161+0000 7f86e61d8700 1 -- 172.21.15.40:0/2554418096 >> 172.21.15.40:0/2554418096 conn(0x7f86e00a7080 msgr2=0x7f86e01baf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:44.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.162+0000 7f86e61d8700 1 -- 172.21.15.40:0/2554418096 shutdown_connections 2023-09-30T22:29:44.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.164+0000 7f86e61d8700 1 -- 172.21.15.40:0/2554418096 wait complete. 2023-09-30T22:29:44.182 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:44.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.234+0000 7f5160cd9700 1 -- 172.21.15.40:0/2219890628 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f515c062380 con 0x7f515c09d920 2023-09-30T22:29:44.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.234+0000 7f514affd700 1 -- 172.21.15.40:0/2219890628 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f514c017080 con 0x7f515c09d920 2023-09-30T22:29:44.235 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:44.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.236+0000 7f5160cd9700 1 -- 172.21.15.40:0/2219890628 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f515c09d920 msgr2=0x7f515c1228d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:44.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.236+0000 7f5160cd9700 1 --2- 172.21.15.40:0/2219890628 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f515c09d920 0x7f515c1228d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f514c001260 tx=0x7f514c00c9e0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.236+0000 7f5160cd9700 1 -- 172.21.15.40:0/2219890628 shutdown_connections 2023-09-30T22:29:44.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.236+0000 7f5160cd9700 1 --2- 172.21.15.40:0/2219890628 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f515c136230 0x7f515c123350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.236+0000 7f5160cd9700 1 --2- 172.21.15.40:0/2219890628 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f515c09d920 0x7f515c1228d0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.236+0000 7f5160cd9700 1 --2- 172.21.15.40:0/2219890628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f515c09e400 0x7f515c122e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.236+0000 7f5160cd9700 1 -- 172.21.15.40:0/2219890628 >> 172.21.15.40:0/2219890628 conn(0x7f515c09fb20 msgr2=0x7f515c0704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:44.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.236+0000 7f5160cd9700 1 -- 172.21.15.40:0/2219890628 shutdown_connections 2023-09-30T22:29:44.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.236+0000 7f5160cd9700 1 -- 172.21.15.40:0/2219890628 wait complete. 2023-09-30T22:29:44.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.241+0000 7f15dfd4a700 1 -- 172.21.15.40:0/220761874 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f15d8062380 con 0x7f15d809e230 2023-09-30T22:29:44.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.241+0000 7f15ce7fc700 1 -- 172.21.15.40:0/220761874 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f15c8015090 con 0x7f15d809e230 2023-09-30T22:29:44.242 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:44.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.243+0000 7f15dfd4a700 1 -- 172.21.15.40:0/220761874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15d809e230 msgr2=0x7f15d812e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:44.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.243+0000 7f15dfd4a700 1 --2- 172.21.15.40:0/220761874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15d809e230 0x7f15d812e750 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f15c80090b0 tx=0x7f15c8004750 comp rx=0 tx=0).stop 2023-09-30T22:29:44.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.243+0000 7f15dfd4a700 1 -- 172.21.15.40:0/220761874 shutdown_connections 2023-09-30T22:29:44.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.243+0000 7f15dfd4a700 1 --2- 172.21.15.40:0/220761874 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f15d809d920 0x7f15d812e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.243+0000 7f15dfd4a700 1 --2- 172.21.15.40:0/220761874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15d8130de0 0x7f15d812ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.243+0000 7f15dfd4a700 1 --2- 172.21.15.40:0/220761874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15d809e230 0x7f15d812e750 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.243+0000 7f15dfd4a700 1 -- 172.21.15.40:0/220761874 >> 172.21.15.40:0/220761874 conn(0x7f15d809fb20 msgr2=0x7f15d80716a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:44.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.244+0000 7f15dfd4a700 1 -- 172.21.15.40:0/220761874 shutdown_connections 2023-09-30T22:29:44.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.244+0000 7f15dfd4a700 1 -- 172.21.15.40:0/220761874 wait complete. 2023-09-30T22:29:44.250 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:44.257 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:44.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.268+0000 7f6265d9f700 1 -- 172.21.15.40:0/2023045458 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6260062380 con 0x7f6260099f80 2023-09-30T22:29:44.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.268+0000 7f625d7fa700 1 -- 172.21.15.40:0/2023045458 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6254027310 con 0x7f6260099f80 2023-09-30T22:29:44.269 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:44.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.270+0000 7f6265d9f700 1 -- 172.21.15.40:0/2023045458 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6260099f80 msgr2=0x7f626011a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:44.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.270+0000 7f6265d9f700 1 --2- 172.21.15.40:0/2023045458 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6260099f80 0x7f626011a5c0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f6254009c40 tx=0x7f6254004750 comp rx=0 tx=0).stop 2023-09-30T22:29:44.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.270+0000 7f6265d9f700 1 -- 172.21.15.40:0/2023045458 shutdown_connections 2023-09-30T22:29:44.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.270+0000 7f6265d9f700 1 --2- 172.21.15.40:0/2023045458 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6260134390 0x7f626011b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.270+0000 7f6265d9f700 1 --2- 172.21.15.40:0/2023045458 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6260099f80 0x7f626011a5c0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.270+0000 7f6265d9f700 1 --2- 172.21.15.40:0/2023045458 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6260133a80 0x7f626011ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:44.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.270+0000 7f6265d9f700 1 -- 172.21.15.40:0/2023045458 >> 172.21.15.40:0/2023045458 conn(0x7f62600a27f0 msgr2=0x7f62601baf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:44.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.270+0000 7f6265d9f700 1 -- 172.21.15.40:0/2023045458 shutdown_connections 2023-09-30T22:29:44.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:44.270+0000 7f6265d9f700 1 -- 172.21.15.40:0/2023045458 wait complete. 2023-09-30T22:29:44.283 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:45.183 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:45.252 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:45.258 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:45.284 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:45.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.332+0000 7f9172dff700 1 Processor -- start 2023-09-30T22:29:45.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.332+0000 7f9172dff700 1 -- start start 2023-09-30T22:29:45.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.332+0000 7f9172dff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f916c09d450 0x7f916c09d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.332+0000 7f9172dff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f916c09dd60 0x7f916c1301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.333+0000 7f9172dff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f916c09c3b0 con 0x7f916c130700 2023-09-30T22:29:45.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.333+0000 7f9172dff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f916c09a6b0 con 0x7f916c09d450 2023-09-30T22:29:45.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.333+0000 7f9172dff700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f916c09b4f0 con 0x7f916c09dd60 2023-09-30T22:29:45.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.333+0000 7f9170b9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f916c09d450 0x7f916c09d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.333+0000 7f9170b9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f916c09d450 0x7f916c09d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49628/0 (socket says 172.21.15.40:49628) 2023-09-30T22:29:45.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.333+0000 7f9170b9b700 1 -- 172.21.15.40:0/3167012010 learned_addr learned my addr 172.21.15.40:0/3167012010 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:45.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.333+0000 7f916bfff700 1 --2- 172.21.15.40:0/3167012010 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f916c09dd60 0x7f916c1301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.333+0000 7f9170b9b700 1 -- 172.21.15.40:0/3167012010 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f916c09dd60 msgr2=0x7f916c1301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:45.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.333+0000 7f9170b9b700 1 --2- 172.21.15.40:0/3167012010 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f916c09dd60 0x7f916c1301c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.333+0000 7f9170b9b700 1 -- 172.21.15.40:0/3167012010 >> v1:172.21.15.40:6789/0 conn(0x7f916c130700 legacy=0x7f916c137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.333+0000 7f9170b9b700 1 -- 172.21.15.40:0/3167012010 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f916c09af90 con 0x7f916c09d450 2023-09-30T22:29:45.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.333+0000 7f9170b9b700 1 --2- 172.21.15.40:0/3167012010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f916c09d450 0x7f916c09d820 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f91600098f0 tx=0x7f9160009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b4fbc463265e424 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:45.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.334+0000 7f916b7fe700 1 -- 172.21.15.40:0/3167012010 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916000f940 con 0x7f916c09d450 2023-09-30T22:29:45.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.334+0000 7f916b7fe700 1 -- 172.21.15.40:0/3167012010 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916000faa0 con 0x7f916c09d450 2023-09-30T22:29:45.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.334+0000 7f916b7fe700 1 -- 172.21.15.40:0/3167012010 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916000fe30 con 0x7f916c09d450 2023-09-30T22:29:45.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.334+0000 7f9172dff700 1 -- 172.21.15.40:0/3167012010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f916c09d450 msgr2=0x7f916c09d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.334+0000 7f9172dff700 1 --2- 172.21.15.40:0/3167012010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f916c09d450 0x7f916c09d820 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f91600098f0 tx=0x7f9160009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:45.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.334+0000 7f9172dff700 1 -- 172.21.15.40:0/3167012010 shutdown_connections 2023-09-30T22:29:45.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.334+0000 7f9172dff700 1 --2- 172.21.15.40:0/3167012010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f916c09d450 0x7f916c09d820 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.334+0000 7f9172dff700 1 --2- 172.21.15.40:0/3167012010 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f916c09dd60 0x7f916c1301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.335+0000 7f9172dff700 1 -- 172.21.15.40:0/3167012010 >> 172.21.15.40:0/3167012010 conn(0x7f916c0a2a00 msgr2=0x7f916c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:45.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.335+0000 7f9172dff700 1 -- 172.21.15.40:0/3167012010 shutdown_connections 2023-09-30T22:29:45.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.335+0000 7f9172dff700 1 -- 172.21.15.40:0/3167012010 wait complete. 2023-09-30T22:29:45.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.336+0000 7f9172dff700 1 Processor -- start 2023-09-30T22:29:45.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.336+0000 7f9172dff700 1 -- start start 2023-09-30T22:29:45.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.337+0000 7f9172dff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f916c09d450 0x7f916c11ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.337+0000 7f9172dff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f916c09dd60 0x7f916c11f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.337+0000 7f9172dff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f916c130700 0x7f916c11f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.337+0000 7f9172dff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916c122150 con 0x7f916c09d450 2023-09-30T22:29:45.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.337+0000 7f9172dff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f916c1223e0 con 0x7f916c130700 2023-09-30T22:29:45.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.337+0000 7f9172dff700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f916c12be00 con 0x7f916c09dd60 2023-09-30T22:29:45.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.337+0000 7f9170b9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f916c09d450 0x7f916c11ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.337+0000 7f9170b9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f916c09d450 0x7f916c11ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49638/0 (socket says 172.21.15.40:49638) 2023-09-30T22:29:45.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.337+0000 7f9170b9b700 1 -- 172.21.15.40:0/4128220641 learned_addr learned my addr 172.21.15.40:0/4128220641 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:45.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.337+0000 7f916bfff700 1 --2- 172.21.15.40:0/4128220641 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f916c09dd60 0x7f916c11f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.338+0000 7f9170b9b700 1 -- 172.21.15.40:0/4128220641 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f916c09dd60 msgr2=0x7f916c11f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.338+0000 7f9170b9b700 1 --2- 172.21.15.40:0/4128220641 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f916c09dd60 0x7f916c11f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.338+0000 7f917139c700 1 --2- 172.21.15.40:0/4128220641 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f916c130700 0x7f916c11f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.338+0000 7f9170b9b700 1 -- 172.21.15.40:0/4128220641 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f916c130700 msgr2=0x7f916c11f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.338+0000 7f9170b9b700 1 --2- 172.21.15.40:0/4128220641 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f916c130700 0x7f916c11f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.338+0000 7f9170b9b700 1 -- 172.21.15.40:0/4128220641 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9160009550 con 0x7f916c09d450 2023-09-30T22:29:45.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.338+0000 7f917139c700 1 --2- 172.21.15.40:0/4128220641 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f916c130700 0x7f916c11f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:29:45.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.338+0000 7f9170b9b700 1 --2- 172.21.15.40:0/4128220641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f916c09d450 0x7f916c11ef00 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f9160000c00 tx=0x7f9160004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:45.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.338+0000 7f91697fa700 1 -- 172.21.15.40:0/4128220641 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91600038a0 con 0x7f916c09d450 2023-09-30T22:29:45.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.338+0000 7f91697fa700 1 -- 172.21.15.40:0/4128220641 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916000fe20 con 0x7f916c09d450 2023-09-30T22:29:45.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.338+0000 7f9172dff700 1 -- 172.21.15.40:0/4128220641 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f916c09c5d0 con 0x7f916c09d450 2023-09-30T22:29:45.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.338+0000 7f91697fa700 1 -- 172.21.15.40:0/4128220641 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9160003c00 con 0x7f916c09d450 2023-09-30T22:29:45.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.338+0000 7f9172dff700 1 -- 172.21.15.40:0/4128220641 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f916c122e80 con 0x7f916c09d450 2023-09-30T22:29:45.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.339+0000 7f91697fa700 1 -- 172.21.15.40:0/4128220641 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9160020470 con 0x7f916c09d450 2023-09-30T22:29:45.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.339+0000 7f91697fa700 1 -- 172.21.15.40:0/4128220641 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9160013070 con 0x7f916c09d450 2023-09-30T22:29:45.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.340+0000 7f9156ffd700 1 -- 172.21.15.40:0/4128220641 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91440052e0 con 0x7f916c09d450 2023-09-30T22:29:45.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.349+0000 7f91697fa700 1 -- 172.21.15.40:0/4128220641 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f91600169c0 con 0x7f916c09d450 2023-09-30T22:29:45.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.415+0000 7fd48a3cb700 1 Processor -- start 2023-09-30T22:29:45.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.415+0000 7fd48a3cb700 1 -- start start 2023-09-30T22:29:45.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.416+0000 7fd48a3cb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd48409d920 0x7fd48409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.416+0000 7fd48a3cb700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd48409f0f0 0x7fd48409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.416+0000 7fd48a3cb700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48409f940 con 0x7fd484133ca0 2023-09-30T22:29:45.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.416+0000 7fd48a3cb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48406b4c0 con 0x7fd48409d920 2023-09-30T22:29:45.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.416+0000 7fd48a3cb700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd48409a8f0 con 0x7fd48409f0f0 2023-09-30T22:29:45.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.416+0000 7fd483fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd48409d920 0x7fd48409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.416+0000 7fd483fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd48409d920 0x7fd48409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:40266/0 (socket says 172.21.15.40:40266) 2023-09-30T22:29:45.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.416+0000 7fd483fff700 1 -- 172.21.15.40:0/3223969666 learned_addr learned my addr 172.21.15.40:0/3223969666 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:45.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.416+0000 7fd4837fe700 1 --2- 172.21.15.40:0/3223969666 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd48409f0f0 0x7fd48409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.417+0000 7fd483fff700 1 -- 172.21.15.40:0/3223969666 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd48409f0f0 msgr2=0x7fd48409e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:45.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.417+0000 7fd483fff700 1 --2- 172.21.15.40:0/3223969666 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd48409f0f0 0x7fd48409e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.417+0000 7fd483fff700 1 -- 172.21.15.40:0/3223969666 >> v1:172.21.15.40:6789/0 conn(0x7fd484133ca0 legacy=0x7fd484134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.417+0000 7fd483fff700 1 -- 172.21.15.40:0/3223969666 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48409f6e0 con 0x7fd48409d920 2023-09-30T22:29:45.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.417+0000 7fd483fff700 1 --2- 172.21.15.40:0/3223969666 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd48409d920 0x7fd48409dcf0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd4740098f0 tx=0x7fd474009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9655d2e8dfbe981a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:45.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.417+0000 7fd482ffd700 1 -- 172.21.15.40:0/3223969666 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd474005e30 con 0x7fd48409d920 2023-09-30T22:29:45.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.417+0000 7fd482ffd700 1 -- 172.21.15.40:0/3223969666 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd474004030 con 0x7fd48409d920 2023-09-30T22:29:45.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.417+0000 7fd482ffd700 1 -- 172.21.15.40:0/3223969666 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4740043e0 con 0x7fd48409d920 2023-09-30T22:29:45.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.418+0000 7fd48a3cb700 1 -- 172.21.15.40:0/3223969666 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd48409d920 msgr2=0x7fd48409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.418+0000 7fd48a3cb700 1 --2- 172.21.15.40:0/3223969666 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd48409d920 0x7fd48409dcf0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd4740098f0 tx=0x7fd474009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:45.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.418+0000 7fd48a3cb700 1 -- 172.21.15.40:0/3223969666 shutdown_connections 2023-09-30T22:29:45.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.418+0000 7fd48a3cb700 1 --2- 172.21.15.40:0/3223969666 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd48409d920 0x7fd48409dcf0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.418+0000 7fd48a3cb700 1 --2- 172.21.15.40:0/3223969666 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd48409f0f0 0x7fd48409e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.418+0000 7fd48a3cb700 1 -- 172.21.15.40:0/3223969666 >> 172.21.15.40:0/3223969666 conn(0x7fd48409fb20 msgr2=0x7fd48409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:45.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.418+0000 7fd48a3cb700 1 -- 172.21.15.40:0/3223969666 shutdown_connections 2023-09-30T22:29:45.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.418+0000 7fd48a3cb700 1 -- 172.21.15.40:0/3223969666 wait complete. 2023-09-30T22:29:45.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.420+0000 7fd48a3cb700 1 Processor -- start 2023-09-30T22:29:45.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.420+0000 7fd48a3cb700 1 -- start start 2023-09-30T22:29:45.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.421+0000 7fd48a3cb700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd48409d920 0x7fd48411e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.421+0000 7fd48a3cb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd484133ca0 0x7fd48411e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.421+0000 7fd48a3cb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd484122450 0x7fd48411eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.421+0000 7fd48a3cb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd484120040 con 0x7fd484133ca0 2023-09-30T22:29:45.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.421+0000 7fd48a3cb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48409c9e0 con 0x7fd484122450 2023-09-30T22:29:45.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.421+0000 7fd48a3cb700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd484121c70 con 0x7fd48409d920 2023-09-30T22:29:45.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.421+0000 7fd483fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd48409d920 0x7fd48411e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.421+0000 7fd4837fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd484133ca0 0x7fd48411e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.421+0000 7fd483fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd48409d920 0x7fd48411e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:37980/0 (socket says 172.21.15.40:37980) 2023-09-30T22:29:45.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.421+0000 7fd483fff700 1 -- 172.21.15.40:0/3143798691 learned_addr learned my addr 172.21.15.40:0/3143798691 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:45.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.421+0000 7fd4837fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd484133ca0 0x7fd48411e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49652/0 (socket says 172.21.15.40:49652) 2023-09-30T22:29:45.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.421+0000 7fd488968700 1 --2- 172.21.15.40:0/3143798691 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd484122450 0x7fd48411eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.421+0000 7fd483fff700 1 -- 172.21.15.40:0/3143798691 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd484122450 msgr2=0x7fd48411eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.421+0000 7fd483fff700 1 --2- 172.21.15.40:0/3143798691 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd484122450 0x7fd48411eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.421+0000 7fd483fff700 1 -- 172.21.15.40:0/3143798691 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd484133ca0 msgr2=0x7fd48411e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.421+0000 7fd483fff700 1 --2- 172.21.15.40:0/3143798691 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd484133ca0 0x7fd48411e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.421+0000 7fd483fff700 1 -- 172.21.15.40:0/3143798691 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd474009500 con 0x7fd48409d920 2023-09-30T22:29:45.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.421+0000 7fd4837fe700 1 --2- 172.21.15.40:0/3143798691 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd484133ca0 0x7fd48411e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:45.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.422+0000 7fd483fff700 1 --2- 172.21.15.40:0/3143798691 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd48409d920 0x7fd48411e470 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fd474009f50 tx=0x7fd474004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:45.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.422+0000 7fd480ff9700 1 -- 172.21.15.40:0/3143798691 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd474003c60 con 0x7fd48409d920 2023-09-30T22:29:45.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.422+0000 7fd480ff9700 1 -- 172.21.15.40:0/3143798691 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd474003dc0 con 0x7fd48409d920 2023-09-30T22:29:45.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.422+0000 7fd48a3cb700 1 -- 172.21.15.40:0/3143798691 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4840a29a0 con 0x7fd48409d920 2023-09-30T22:29:45.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.422+0000 7fd480ff9700 1 -- 172.21.15.40:0/3143798691 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47401c640 con 0x7fd48409d920 2023-09-30T22:29:45.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.422+0000 7fd48a3cb700 1 -- 172.21.15.40:0/3143798691 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4841216e0 con 0x7fd48409d920 2023-09-30T22:29:45.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.423+0000 7fd48a3cb700 1 -- 172.21.15.40:0/3143798691 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd484062380 con 0x7fd48409d920 2023-09-30T22:29:45.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.424+0000 7fd480ff9700 1 -- 172.21.15.40:0/3143798691 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd47401c7a0 con 0x7fd48409d920 2023-09-30T22:29:45.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.424+0000 7fd480ff9700 1 -- 172.21.15.40:0/3143798691 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd474040bd0 con 0x7fd48409d920 2023-09-30T22:29:45.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.429+0000 7fd480ff9700 1 -- 172.21.15.40:0/3143798691 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd47402f480 con 0x7fd48409d920 2023-09-30T22:29:45.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.435+0000 7fdf2ead9700 1 Processor -- start 2023-09-30T22:29:45.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.435+0000 7fdf2ead9700 1 -- start start 2023-09-30T22:29:45.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.436+0000 7fdf2ead9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdf28131d50 0x7fdf28132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.436+0000 7fdf2ead9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf2809bc50 0x7fdf2809c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.436+0000 7fdf2ead9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf28071920 con 0x7fdf2809c600 2023-09-30T22:29:45.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.436+0000 7fdf2ead9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf2809cb10 con 0x7fdf28131d50 2023-09-30T22:29:45.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.436+0000 7fdf2ead9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf28132660 con 0x7fdf2809bc50 2023-09-30T22:29:45.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.437+0000 7fdf2c875700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdf28131d50 0x7fdf28132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.437+0000 7fdf2c875700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdf28131d50 0x7fdf28132120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49664/0 (socket says 172.21.15.40:49664) 2023-09-30T22:29:45.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.437+0000 7fdf2c875700 1 -- 172.21.15.40:0/2928184427 learned_addr learned my addr 172.21.15.40:0/2928184427 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:45.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.437+0000 7fdf27fff700 1 --2- 172.21.15.40:0/2928184427 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf2809bc50 0x7fdf2809c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.437+0000 7fdf2c875700 1 -- 172.21.15.40:0/2928184427 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf2809bc50 msgr2=0x7fdf2809c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:45.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.437+0000 7fdf2c875700 1 --2- 172.21.15.40:0/2928184427 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf2809bc50 0x7fdf2809c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.437+0000 7fdf2c875700 1 -- 172.21.15.40:0/2928184427 >> v1:172.21.15.40:6789/0 conn(0x7fdf2809c600 legacy=0x7fdf28138ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.437+0000 7fdf2c875700 1 -- 172.21.15.40:0/2928184427 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf28131900 con 0x7fdf28131d50 2023-09-30T22:29:45.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.437+0000 7fdf27fff700 1 --2- 172.21.15.40:0/2928184427 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf2809bc50 0x7fdf2809c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:45.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.437+0000 7fdf2c875700 1 --2- 172.21.15.40:0/2928184427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf28131d50 0x7fdf28132120 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c0098f0 tx=0x7fdf1c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55c3d0a17e5e51c1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:45.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.437+0000 7fdf277fe700 1 -- 172.21.15.40:0/2928184427 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c011830 con 0x7fdf28131d50 2023-09-30T22:29:45.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.437+0000 7fdf277fe700 1 -- 172.21.15.40:0/2928184427 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1c011990 con 0x7fdf28131d50 2023-09-30T22:29:45.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.437+0000 7fdf277fe700 1 -- 172.21.15.40:0/2928184427 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c011d20 con 0x7fdf28131d50 2023-09-30T22:29:45.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.438+0000 7fdf2ead9700 1 -- 172.21.15.40:0/2928184427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf28131d50 msgr2=0x7fdf28132120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.438+0000 7fdf2ead9700 1 --2- 172.21.15.40:0/2928184427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf28131d50 0x7fdf28132120 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c0098f0 tx=0x7fdf1c009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:45.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.438+0000 7fdf2ead9700 1 -- 172.21.15.40:0/2928184427 shutdown_connections 2023-09-30T22:29:45.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.438+0000 7fdf2ead9700 1 --2- 172.21.15.40:0/2928184427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf28131d50 0x7fdf28132120 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.438+0000 7fdf2ead9700 1 --2- 172.21.15.40:0/2928184427 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf2809bc50 0x7fdf2809c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.438+0000 7fdf2ead9700 1 -- 172.21.15.40:0/2928184427 >> 172.21.15.40:0/2928184427 conn(0x7fdf280a2a00 msgr2=0x7fdf280a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:45.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.438+0000 7fdf2ead9700 1 -- 172.21.15.40:0/2928184427 shutdown_connections 2023-09-30T22:29:45.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.438+0000 7fdf2ead9700 1 -- 172.21.15.40:0/2928184427 wait complete. 2023-09-30T22:29:45.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.440+0000 7fdf2ead9700 1 Processor -- start 2023-09-30T22:29:45.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.440+0000 7fdf2ead9700 1 -- start start 2023-09-30T22:29:45.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.440+0000 7f32815a7700 1 Processor -- start 2023-09-30T22:29:45.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.440+0000 7f32815a7700 1 -- start start 2023-09-30T22:29:45.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.440+0000 7f32815a7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f327c09d920 0x7f327c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.440+0000 7f32815a7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f327c09e230 0x7f327c1308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.440+0000 7f32815a7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f327c130de0 0x7f327c131260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.440+0000 7f32815a7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f327c09edf0 con 0x7f327c09e230 2023-09-30T22:29:45.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.440+0000 7f32815a7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f327c09adf0 con 0x7f327c130de0 2023-09-30T22:29:45.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.440+0000 7f32815a7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f327c09b660 con 0x7f327c09d920 2023-09-30T22:29:45.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.441+0000 7f327b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f327c130de0 0x7f327c131260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.441+0000 7f327b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f327c130de0 0x7f327c131260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:40290/0 (socket says 172.21.15.40:40290) 2023-09-30T22:29:45.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.441+0000 7f327b7fe700 1 -- 172.21.15.40:0/1493590147 learned_addr learned my addr 172.21.15.40:0/1493590147 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:45.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.441+0000 7f327a7fc700 1 --2- 172.21.15.40:0/1493590147 >> v2:172.21.15.40:3300/0 conn(0x7f327c09e230 0x7f327c1308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.441+0000 7f327b7fe700 1 -- 172.21.15.40:0/1493590147 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f327c09d920 msgr2=0x7f327c09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:45.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.441+0000 7f327b7fe700 1 --2- 172.21.15.40:0/1493590147 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f327c09d920 0x7f327c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.441+0000 7f327b7fe700 1 -- 172.21.15.40:0/1493590147 >> v2:172.21.15.40:3300/0 conn(0x7f327c09e230 msgr2=0x7f327c1308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:45.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.441+0000 7f327b7fe700 1 --2- 172.21.15.40:0/1493590147 >> v2:172.21.15.40:3300/0 conn(0x7f327c09e230 0x7f327c1308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.441+0000 7f327b7fe700 1 -- 172.21.15.40:0/1493590147 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327c09a6e0 con 0x7f327c130de0 2023-09-30T22:29:45.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.440+0000 7fdf2ead9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf2809bc50 0x7fdf2811bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.440+0000 7fdf2ead9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf2809c600 0x7fdf2811c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.440+0000 7fdf2ead9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf28131d50 0x7fdf2811c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.441+0000 7fdf2ead9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2809ea60 con 0x7fdf2809bc50 2023-09-30T22:29:45.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.441+0000 7fdf2ead9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2811f5c0 con 0x7fdf2809c600 2023-09-30T22:29:45.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.441+0000 7fdf2ead9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf280a0100 con 0x7fdf28131d50 2023-09-30T22:29:45.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.441+0000 7fdf2c875700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf2809bc50 0x7fdf2811bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.441+0000 7fdf27fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf2809c600 0x7fdf2811c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.441+0000 7fdf2c875700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf2809bc50 0x7fdf2811bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49690/0 (socket says 172.21.15.40:49690) 2023-09-30T22:29:45.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.441+0000 7fdf2c875700 1 -- 172.21.15.40:0/1029419337 learned_addr learned my addr 172.21.15.40:0/1029419337 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:45.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.441+0000 7fdf2d076700 1 --2- 172.21.15.40:0/1029419337 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf28131d50 0x7fdf2811c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.441+0000 7fdf2c875700 1 -- 172.21.15.40:0/1029419337 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf28131d50 msgr2=0x7fdf2811c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.441+0000 7fdf2c875700 1 --2- 172.21.15.40:0/1029419337 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf28131d50 0x7fdf2811c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.441+0000 7fdf2c875700 1 -- 172.21.15.40:0/1029419337 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf2809c600 msgr2=0x7fdf2811c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.441+0000 7fdf2c875700 1 --2- 172.21.15.40:0/1029419337 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf2809c600 0x7fdf2811c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.441+0000 7fdf2c875700 1 -- 172.21.15.40:0/1029419337 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf140094a0 con 0x7fdf2809bc50 2023-09-30T22:29:45.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.441+0000 7f327b7fe700 1 --2- 172.21.15.40:0/1493590147 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f327c130de0 0x7f327c131260 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f327400d150 tx=0x7f327400d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7aa17f641712c67 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:45.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.441+0000 7fdf2c875700 1 --2- 172.21.15.40:0/1029419337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf2809bc50 0x7fdf2811bd80 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c009c40 tx=0x7fdf1c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:45.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.442+0000 7f3279ffb700 1 -- 172.21.15.40:0/1493590147 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3274010070 con 0x7f327c130de0 2023-09-30T22:29:45.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.442+0000 7f3279ffb700 1 -- 172.21.15.40:0/1493590147 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327400ddc0 con 0x7f327c130de0 2023-09-30T22:29:45.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.442+0000 7f3279ffb700 1 -- 172.21.15.40:0/1493590147 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327400b310 con 0x7f327c130de0 2023-09-30T22:29:45.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.442+0000 7fdf257fa700 1 -- 172.21.15.40:0/1029419337 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c0036a0 con 0x7fdf2809bc50 2023-09-30T22:29:45.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.442+0000 7fdf257fa700 1 -- 172.21.15.40:0/1029419337 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1c003800 con 0x7fdf2809bc50 2023-09-30T22:29:45.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.442+0000 7f327a7fc700 1 --2- 172.21.15.40:0/1493590147 >> v2:172.21.15.40:3300/0 conn(0x7f327c09e230 0x7f327c1308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:29:45.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.442+0000 7fdf257fa700 1 -- 172.21.15.40:0/1029419337 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c003bb0 con 0x7fdf2809bc50 2023-09-30T22:29:45.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.442+0000 7f32815a7700 1 -- 172.21.15.40:0/1493590147 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f327c130de0 msgr2=0x7f327c131260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.442+0000 7f32815a7700 1 --2- 172.21.15.40:0/1493590147 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f327c130de0 0x7f327c131260 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f327400d150 tx=0x7f327400d460 comp rx=0 tx=0).stop 2023-09-30T22:29:45.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.443+0000 7f32815a7700 1 -- 172.21.15.40:0/1493590147 shutdown_connections 2023-09-30T22:29:45.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.443+0000 7f32815a7700 1 --2- 172.21.15.40:0/1493590147 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f327c09d920 0x7f327c09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.443+0000 7f32815a7700 1 --2- 172.21.15.40:0/1493590147 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f327c130de0 0x7f327c131260 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.443+0000 7f32815a7700 1 --2- 172.21.15.40:0/1493590147 >> v2:172.21.15.40:3300/0 conn(0x7f327c09e230 0x7f327c1308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.443+0000 7f32815a7700 1 -- 172.21.15.40:0/1493590147 >> 172.21.15.40:0/1493590147 conn(0x7f327c09fb20 msgr2=0x7f327c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:45.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.443+0000 7f32815a7700 1 -- 172.21.15.40:0/1493590147 shutdown_connections 2023-09-30T22:29:45.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.442+0000 7fdf2ead9700 1 -- 172.21.15.40:0/1029419337 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf1c009550 con 0x7fdf2809bc50 2023-09-30T22:29:45.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.442+0000 7fdf2ead9700 1 -- 172.21.15.40:0/1029419337 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf2812c8a0 con 0x7fdf2809bc50 2023-09-30T22:29:45.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.443+0000 7fdf257fa700 1 -- 172.21.15.40:0/1029419337 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdf1c021070 con 0x7fdf2809bc50 2023-09-30T22:29:45.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.443+0000 7fdf257fa700 1 -- 172.21.15.40:0/1029419337 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fdf1c040d20 con 0x7fdf2809bc50 2023-09-30T22:29:45.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.444+0000 7fdf2ead9700 1 -- 172.21.15.40:0/1029419337 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf28062380 con 0x7fdf2809bc50 2023-09-30T22:29:45.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.443+0000 7f32815a7700 1 -- 172.21.15.40:0/1493590147 wait complete. 2023-09-30T22:29:45.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.444+0000 7f32815a7700 1 Processor -- start 2023-09-30T22:29:45.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.444+0000 7f32815a7700 1 -- start start 2023-09-30T22:29:45.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.444+0000 7f32815a7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f327c09d920 0x7f327c12a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.444+0000 7f32815a7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f327c09e230 0x7f327c12ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.444+0000 7f32815a7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f327c130de0 0x7f327c12b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:45.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.444+0000 7f32815a7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327c12bc60 con 0x7f327c09e230 2023-09-30T22:29:45.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.444+0000 7f32815a7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f327c12b9b0 con 0x7f327c09d920 2023-09-30T22:29:45.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.444+0000 7f32815a7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f327c06b330 con 0x7f327c130de0 2023-09-30T22:29:45.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.445+0000 7f327a7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f327c09e230 0x7f327c12ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.445+0000 7f327b7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f327c130de0 0x7f327c12b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:45.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.445+0000 7f327a7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f327c09e230 0x7f327c12ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49700/0 (socket says 172.21.15.40:49700) 2023-09-30T22:29:45.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.445+0000 7f327b7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f327c130de0 0x7f327c12b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:38028/0 (socket says 172.21.15.40:38028) 2023-09-30T22:29:45.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.445+0000 7f327a7fc700 1 -- 172.21.15.40:0/3961944153 learned_addr learned my addr 172.21.15.40:0/3961944153 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:45.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.445+0000 7f327a7fc700 1 -- 172.21.15.40:0/3961944153 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f327c130de0 msgr2=0x7f327c12b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.445+0000 7f327a7fc700 1 --2- 172.21.15.40:0/3961944153 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f327c130de0 0x7f327c12b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.445+0000 7f327a7fc700 1 -- 172.21.15.40:0/3961944153 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f327c09d920 msgr2=0x7f327c12a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.445+0000 7f327a7fc700 1 --2- 172.21.15.40:0/3961944153 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f327c09d920 0x7f327c12a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.445+0000 7f327a7fc700 1 -- 172.21.15.40:0/3961944153 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327400bd40 con 0x7f327c09e230 2023-09-30T22:29:45.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.445+0000 7f327a7fc700 1 --2- 172.21.15.40:0/3961944153 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f327c09e230 0x7f327c12ac80 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f327000c740 tx=0x7f327000ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:45.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.449+0000 7f32637fe700 1 -- 172.21.15.40:0/3961944153 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3270004220 con 0x7f327c09e230 2023-09-30T22:29:45.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.449+0000 7f32637fe700 1 -- 172.21.15.40:0/3961944153 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3270004380 con 0x7f327c09e230 2023-09-30T22:29:45.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.449+0000 7f32637fe700 1 -- 172.21.15.40:0/3961944153 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32700036a0 con 0x7f327c09e230 2023-09-30T22:29:45.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.449+0000 7fdf257fa700 1 -- 172.21.15.40:0/1029419337 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdf1c029020 con 0x7fdf2809bc50 2023-09-30T22:29:45.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.449+0000 7f32815a7700 1 -- 172.21.15.40:0/3961944153 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f327c1bb680 con 0x7f327c09e230 2023-09-30T22:29:45.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.449+0000 7f32815a7700 1 -- 172.21.15.40:0/3961944153 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f327c1bacc0 con 0x7f327c09e230 2023-09-30T22:29:45.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.450+0000 7f32637fe700 1 -- 172.21.15.40:0/3961944153 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3270003800 con 0x7f327c09e230 2023-09-30T22:29:45.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.450+0000 7f32815a7700 1 -- 172.21.15.40:0/3961944153 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f327c062380 con 0x7f327c09e230 2023-09-30T22:29:45.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.451+0000 7f32637fe700 1 -- 172.21.15.40:0/3961944153 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f327003f940 con 0x7f327c09e230 2023-09-30T22:29:45.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.455+0000 7f32637fe700 1 -- 172.21.15.40:0/3961944153 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3270020300 con 0x7f327c09e230 2023-09-30T22:29:45.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.632+0000 7f9156ffd700 1 -- 172.21.15.40:0/4128220641 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9144005590 con 0x7f916c09d450 2023-09-30T22:29:45.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.632+0000 7f91697fa700 1 -- 172.21.15.40:0/4128220641 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f916001f3d0 con 0x7f916c09d450 2023-09-30T22:29:45.634 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:45.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.635+0000 7f9156ffd700 1 -- 172.21.15.40:0/4128220641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f916c09d450 msgr2=0x7f916c11ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.635+0000 7f9156ffd700 1 --2- 172.21.15.40:0/4128220641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f916c09d450 0x7f916c11ef00 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f9160000c00 tx=0x7f9160004750 comp rx=0 tx=0).stop 2023-09-30T22:29:45.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.636+0000 7f9156ffd700 1 -- 172.21.15.40:0/4128220641 shutdown_connections 2023-09-30T22:29:45.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.636+0000 7f9156ffd700 1 --2- 172.21.15.40:0/4128220641 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f916c130700 0x7f916c11f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.636+0000 7f9156ffd700 1 --2- 172.21.15.40:0/4128220641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f916c09d450 0x7f916c11ef00 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.636+0000 7f9156ffd700 1 --2- 172.21.15.40:0/4128220641 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f916c09dd60 0x7f916c11f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.636+0000 7f9156ffd700 1 -- 172.21.15.40:0/4128220641 >> 172.21.15.40:0/4128220641 conn(0x7f916c0a2a00 msgr2=0x7f916c12f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:45.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.637+0000 7f9156ffd700 1 -- 172.21.15.40:0/4128220641 shutdown_connections 2023-09-30T22:29:45.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.637+0000 7f9156ffd700 1 -- 172.21.15.40:0/4128220641 wait complete. 2023-09-30T22:29:45.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.647+0000 7fdf2ead9700 1 -- 172.21.15.40:0/1029419337 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdf28074330 con 0x7fdf2809bc50 2023-09-30T22:29:45.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.647+0000 7fdf257fa700 1 -- 172.21.15.40:0/1029419337 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdf1c015070 con 0x7fdf2809bc50 2023-09-30T22:29:45.648 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:45.651 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:45.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.650+0000 7fdf2ead9700 1 -- 172.21.15.40:0/1029419337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf2809bc50 msgr2=0x7fdf2811bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.650+0000 7fdf2ead9700 1 --2- 172.21.15.40:0/1029419337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf2809bc50 0x7fdf2811bd80 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c009c40 tx=0x7fdf1c004750 comp rx=0 tx=0).stop 2023-09-30T22:29:45.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.650+0000 7fdf2ead9700 1 -- 172.21.15.40:0/1029419337 shutdown_connections 2023-09-30T22:29:45.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.650+0000 7fdf2ead9700 1 --2- 172.21.15.40:0/1029419337 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf28131d50 0x7fdf2811c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.650+0000 7fdf2ead9700 1 --2- 172.21.15.40:0/1029419337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf2809bc50 0x7fdf2811bd80 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.650+0000 7fdf2ead9700 1 --2- 172.21.15.40:0/1029419337 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf2809c600 0x7fdf2811c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.650+0000 7fdf2ead9700 1 -- 172.21.15.40:0/1029419337 >> 172.21.15.40:0/1029419337 conn(0x7fdf280a2a00 msgr2=0x7fdf2812f680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:45.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.650+0000 7fdf2ead9700 1 -- 172.21.15.40:0/1029419337 shutdown_connections 2023-09-30T22:29:45.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.650+0000 7fdf2ead9700 1 -- 172.21.15.40:0/1029419337 wait complete. 2023-09-30T22:29:45.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.657+0000 7f32815a7700 1 -- 172.21.15.40:0/3961944153 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f327c12cc60 con 0x7f327c09e230 2023-09-30T22:29:45.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.658+0000 7f32637fe700 1 -- 172.21.15.40:0/3961944153 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f327c12cc60 con 0x7f327c09e230 2023-09-30T22:29:45.659 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:45.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.660+0000 7f32815a7700 1 -- 172.21.15.40:0/3961944153 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f327c09e230 msgr2=0x7f327c12ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.660+0000 7f32815a7700 1 --2- 172.21.15.40:0/3961944153 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f327c09e230 0x7f327c12ac80 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f327000c740 tx=0x7f327000ca50 comp rx=0 tx=0).stop 2023-09-30T22:29:45.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.660+0000 7f32815a7700 1 -- 172.21.15.40:0/3961944153 shutdown_connections 2023-09-30T22:29:45.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.660+0000 7f32815a7700 1 --2- 172.21.15.40:0/3961944153 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f327c130de0 0x7f327c12b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.660+0000 7f32815a7700 1 --2- 172.21.15.40:0/3961944153 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f327c09d920 0x7f327c12a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.660+0000 7f32815a7700 1 --2- 172.21.15.40:0/3961944153 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f327c09e230 0x7f327c12ac80 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.660+0000 7f32815a7700 1 -- 172.21.15.40:0/3961944153 >> 172.21.15.40:0/3961944153 conn(0x7f327c09fb20 msgr2=0x7f327c06ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:45.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.660+0000 7f32815a7700 1 -- 172.21.15.40:0/3961944153 shutdown_connections 2023-09-30T22:29:45.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.660+0000 7f32815a7700 1 -- 172.21.15.40:0/3961944153 wait complete. 2023-09-30T22:29:45.664 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:45.673 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:45.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.676+0000 7fd48a3cb700 1 -- 172.21.15.40:0/3143798691 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd484074720 con 0x7fd48409d920 2023-09-30T22:29:45.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.676+0000 7fd480ff9700 1 -- 172.21.15.40:0/3143798691 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd47402a030 con 0x7fd48409d920 2023-09-30T22:29:45.677 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:45.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.678+0000 7fd48a3cb700 1 -- 172.21.15.40:0/3143798691 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd48409d920 msgr2=0x7fd48411e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:45.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.678+0000 7fd48a3cb700 1 --2- 172.21.15.40:0/3143798691 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd48409d920 0x7fd48411e470 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fd474009f50 tx=0x7fd474004750 comp rx=0 tx=0).stop 2023-09-30T22:29:45.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.678+0000 7fd48a3cb700 1 -- 172.21.15.40:0/3143798691 shutdown_connections 2023-09-30T22:29:45.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.678+0000 7fd48a3cb700 1 --2- 172.21.15.40:0/3143798691 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd48409d920 0x7fd48411e470 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.678+0000 7fd48a3cb700 1 --2- 172.21.15.40:0/3143798691 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd484122450 0x7fd48411eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.678+0000 7fd48a3cb700 1 --2- 172.21.15.40:0/3143798691 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd484133ca0 0x7fd48411e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:45.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.678+0000 7fd48a3cb700 1 -- 172.21.15.40:0/3143798691 >> 172.21.15.40:0/3143798691 conn(0x7fd48409fb20 msgr2=0x7fd484133480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:45.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.679+0000 7fd48a3cb700 1 -- 172.21.15.40:0/3143798691 shutdown_connections 2023-09-30T22:29:45.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:45.679+0000 7fd48a3cb700 1 -- 172.21.15.40:0/3143798691 wait complete. 2023-09-30T22:29:45.692 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:46.652 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:46.665 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:46.674 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:46.693 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:46.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.802+0000 7f0ff1ecb700 1 Processor -- start 2023-09-30T22:29:46.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.803+0000 7f0ff1ecb700 1 -- start start 2023-09-30T22:29:46.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.803+0000 7f0ff1ecb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fec06a6d0 0x7f0fec06aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:46.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.803+0000 7f0ff1ecb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0fec131fc0 0x7f0fec139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:46.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.803+0000 7f0ff1ecb700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fec09eb50 con 0x7f0fec06afe0 2023-09-30T22:29:46.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.803+0000 7f0ff1ecb700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fec09dde0 con 0x7f0fec131fc0 2023-09-30T22:29:46.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.803+0000 7f0ff1ecb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec09d4a0 con 0x7f0fec06a6d0 2023-09-30T22:29:46.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.803+0000 7f0febfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0fec131fc0 0x7f0fec139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:46.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.803+0000 7f0febfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0fec131fc0 0x7f0fec139b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49714/0 (socket says 172.21.15.40:49714) 2023-09-30T22:29:46.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.803+0000 7f0febfff700 1 -- 172.21.15.40:0/470769645 learned_addr learned my addr 172.21.15.40:0/470769645 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:46.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.804+0000 7f0feb7fe700 1 --2- 172.21.15.40:0/470769645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fec06a6d0 0x7f0fec06aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:46.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.804+0000 7f0febfff700 1 -- 172.21.15.40:0/470769645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fec06a6d0 msgr2=0x7f0fec06aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:46.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.804+0000 7f0febfff700 1 --2- 172.21.15.40:0/470769645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fec06a6d0 0x7f0fec06aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:46.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.804+0000 7f0febfff700 1 -- 172.21.15.40:0/470769645 >> v1:172.21.15.40:6789/0 conn(0x7f0fec06afe0 legacy=0x7f0fec1318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:46.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.804+0000 7f0febfff700 1 -- 172.21.15.40:0/470769645 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fec09f5f0 con 0x7f0fec131fc0 2023-09-30T22:29:46.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.804+0000 7f0febfff700 1 --2- 172.21.15.40:0/470769645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fec131fc0 0x7f0fec139b10 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4009e50 tx=0x7f0fe400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e7d70c720fa281a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:46.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.804+0000 7f0fea7fc700 1 -- 172.21.15.40:0/470769645 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe400e070 con 0x7f0fec131fc0 2023-09-30T22:29:46.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.804+0000 7f0fea7fc700 1 -- 172.21.15.40:0/470769645 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe400b9c0 con 0x7f0fec131fc0 2023-09-30T22:29:46.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.804+0000 7f0fea7fc700 1 -- 172.21.15.40:0/470769645 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe400bd70 con 0x7f0fec131fc0 2023-09-30T22:29:46.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.805+0000 7f0ff1ecb700 1 -- 172.21.15.40:0/470769645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fec131fc0 msgr2=0x7f0fec139b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:46.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.805+0000 7f0ff1ecb700 1 --2- 172.21.15.40:0/470769645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fec131fc0 0x7f0fec139b10 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4009e50 tx=0x7f0fe400b330 comp rx=0 tx=0).stop 2023-09-30T22:29:46.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.805+0000 7f0ff1ecb700 1 -- 172.21.15.40:0/470769645 shutdown_connections 2023-09-30T22:29:46.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.805+0000 7f0ff1ecb700 1 --2- 172.21.15.40:0/470769645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fec131fc0 0x7f0fec139b10 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:46.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.805+0000 7f0ff1ecb700 1 --2- 172.21.15.40:0/470769645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fec06a6d0 0x7f0fec06aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:46.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.805+0000 7f0ff1ecb700 1 -- 172.21.15.40:0/470769645 >> 172.21.15.40:0/470769645 conn(0x7f0fec09fb20 msgr2=0x7f0fec09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:46.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.805+0000 7f0ff1ecb700 1 -- 172.21.15.40:0/470769645 shutdown_connections 2023-09-30T22:29:46.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.805+0000 7f0ff1ecb700 1 -- 172.21.15.40:0/470769645 wait complete. 2023-09-30T22:29:46.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.806+0000 7f0ff1ecb700 1 Processor -- start 2023-09-30T22:29:46.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.806+0000 7f0ff1ecb700 1 -- start start 2023-09-30T22:29:46.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.807+0000 7f0ff1ecb700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0fec06a6d0 0x7f0fec120630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:46.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.807+0000 7f0ff1ecb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fec06afe0 0x7f0fec120b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:46.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.807+0000 7f0ff1ecb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fec131fc0 0x7f0fec1210b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:46.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.807+0000 7f0ff1ecb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec123f50 con 0x7f0fec131fc0 2023-09-30T22:29:46.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.807+0000 7f0ff1ecb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec121a90 con 0x7f0fec06afe0 2023-09-30T22:29:46.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.807+0000 7f0ff1ecb700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec124150 con 0x7f0fec06a6d0 2023-09-30T22:29:46.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.807+0000 7f0feaffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fec06afe0 0x7f0fec120b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:46.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.807+0000 7f0feaffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fec06afe0 0x7f0fec120b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:40332/0 (socket says 172.21.15.40:40332) 2023-09-30T22:29:46.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.807+0000 7f0feaffd700 1 -- 172.21.15.40:0/640344281 learned_addr learned my addr 172.21.15.40:0/640344281 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:46.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.807+0000 7f0febfff700 1 --2- 172.21.15.40:0/640344281 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fec131fc0 0x7f0fec1210b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:46.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.807+0000 7f0feaffd700 1 -- 172.21.15.40:0/640344281 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0fec06a6d0 msgr2=0x7f0fec120630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:46.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.807+0000 7f0feaffd700 1 --2- 172.21.15.40:0/640344281 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0fec06a6d0 0x7f0fec120630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:46.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.807+0000 7f0feaffd700 1 -- 172.21.15.40:0/640344281 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fec131fc0 msgr2=0x7f0fec1210b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:46.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.807+0000 7f0feaffd700 1 --2- 172.21.15.40:0/640344281 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fec131fc0 0x7f0fec1210b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:46.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.807+0000 7f0feaffd700 1 -- 172.21.15.40:0/640344281 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe4009b30 con 0x7f0fec06afe0 2023-09-30T22:29:46.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.808+0000 7f0feaffd700 1 --2- 172.21.15.40:0/640344281 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fec06afe0 0x7f0fec120b70 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f0fe000c4e0 tx=0x7f0fe000c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:46.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.808+0000 7f0fd3fff700 1 -- 172.21.15.40:0/640344281 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe00052d0 con 0x7f0fec06afe0 2023-09-30T22:29:46.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.808+0000 7f0fd3fff700 1 -- 172.21.15.40:0/640344281 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe0005430 con 0x7f0fec06afe0 2023-09-30T22:29:46.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.808+0000 7f0ff1ecb700 1 -- 172.21.15.40:0/640344281 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fec131820 con 0x7f0fec06afe0 2023-09-30T22:29:46.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.808+0000 7f0fd3fff700 1 -- 172.21.15.40:0/640344281 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe00038c0 con 0x7f0fec06afe0 2023-09-30T22:29:46.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.808+0000 7f0ff1ecb700 1 -- 172.21.15.40:0/640344281 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fec131150 con 0x7f0fec06afe0 2023-09-30T22:29:46.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.809+0000 7f0fd3fff700 1 -- 172.21.15.40:0/640344281 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0fe0003a20 con 0x7f0fec06afe0 2023-09-30T22:29:46.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.809+0000 7f0fd3fff700 1 -- 172.21.15.40:0/640344281 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f0fe003e890 con 0x7f0fec06afe0 2023-09-30T22:29:46.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.809+0000 7f0ff1ecb700 1 -- 172.21.15.40:0/640344281 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fec1317c0 con 0x7f0fec06afe0 2023-09-30T22:29:46.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.818+0000 7f0fd3fff700 1 -- 172.21.15.40:0/640344281 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0fe0011590 con 0x7f0fec06afe0 2023-09-30T22:29:46.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.839+0000 7f3bc57ff700 1 Processor -- start 2023-09-30T22:29:46.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.839+0000 7f3bc57ff700 1 -- start start 2023-09-30T22:29:46.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.840+0000 7f54e14f7700 1 Processor -- start 2023-09-30T22:29:46.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.840+0000 7f3bc57ff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bc009d760 0x7f3bc009db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:46.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.840+0000 7f3bc57ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3bc009e070 0x7f3bc0130620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:46.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.840+0000 7f3bc57ff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3bc0130b60 0x7f3bc0131000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:46.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.840+0000 7f3bc57ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc009ec30 con 0x7f3bc009e070 2023-09-30T22:29:46.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.840+0000 7f3bc57ff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc009f1a0 con 0x7f3bc009d760 2023-09-30T22:29:46.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.840+0000 7f3bc57ff700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc009a4f0 con 0x7f3bc0130b60 2023-09-30T22:29:46.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.840+0000 7f3bbeffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bc009d760 0x7f3bc009db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:46.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.840+0000 7f3bbe7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3bc009e070 0x7f3bc0130620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:46.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.840+0000 7f3bbeffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bc009d760 0x7f3bc009db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:40348/0 (socket says 172.21.15.40:40348) 2023-09-30T22:29:46.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.840+0000 7f3bbeffd700 1 -- 172.21.15.40:0/272061877 learned_addr learned my addr 172.21.15.40:0/272061877 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:46.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.840+0000 7f3bbf7fe700 1 --2- 172.21.15.40:0/272061877 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3bc0130b60 0x7f3bc0131000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:46.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.840+0000 7f54e14f7700 1 -- start start 2023-09-30T22:29:46.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.841+0000 7f3bbeffd700 1 -- 172.21.15.40:0/272061877 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3bc0130b60 msgr2=0x7f3bc0131000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:46.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.841+0000 7f3bbeffd700 1 --2- 172.21.15.40:0/272061877 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3bc0130b60 0x7f3bc0131000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:46.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.841+0000 7f3bbeffd700 1 -- 172.21.15.40:0/272061877 >> v2:172.21.15.40:3300/0 conn(0x7f3bc009e070 msgr2=0x7f3bc0130620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:46.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.841+0000 7f3bbeffd700 1 --2- 172.21.15.40:0/272061877 >> v2:172.21.15.40:3300/0 conn(0x7f3bc009e070 0x7f3bc0130620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:46.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.841+0000 7f3bbeffd700 1 -- 172.21.15.40:0/272061877 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc009a9c0 con 0x7f3bc009d760 2023-09-30T22:29:46.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.841+0000 7f3bbeffd700 1 --2- 172.21.15.40:0/272061877 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bc009d760 0x7f3bc009db30 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0006fd0 tx=0x7f3bb0009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8358af28596fb54 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:46.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.841+0000 7f3bbdffb700 1 -- 172.21.15.40:0/272061877 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb0005e30 con 0x7f3bc009d760 2023-09-30T22:29:46.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.841+0000 7f3bbdffb700 1 -- 172.21.15.40:0/272061877 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb000c070 con 0x7f3bc009d760 2023-09-30T22:29:46.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.841+0000 7f3bbdffb700 1 -- 172.21.15.40:0/272061877 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb0004270 con 0x7f3bc009d760 2023-09-30T22:29:46.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.841+0000 7f54e14f7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f54dc13b130 0x7f54dc13d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:46.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.841+0000 7f54e14f7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54dc13da50 0x7f54dc13fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:46.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.841+0000 7f54e14f7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54dc137e20 con 0x7f54dc138250 2023-09-30T22:29:46.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.841+0000 7f54e14f7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc138d30 con 0x7f54dc13da50 2023-09-30T22:29:46.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.841+0000 7f54e14f7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc138050 con 0x7f54dc13b130 2023-09-30T22:29:46.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.841+0000 7f54da7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f54dc13b130 0x7f54dc13d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:46.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.841+0000 7f54da7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f54dc13b130 0x7f54dc13d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:38060/0 (socket says 172.21.15.40:38060) 2023-09-30T22:29:46.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.841+0000 7f54da7fc700 1 -- 172.21.15.40:0/3989934428 learned_addr learned my addr 172.21.15.40:0/3989934428 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:46.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.841+0000 7f54da7fc700 1 -- 172.21.15.40:0/3989934428 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54dc13da50 msgr2=0x7f54dc13fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:46.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.841+0000 7f54da7fc700 1 --2- 172.21.15.40:0/3989934428 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54dc13da50 0x7f54dc13fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:46.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.842+0000 7f54da7fc700 1 -- 172.21.15.40:0/3989934428 >> v1:172.21.15.40:6789/0 conn(0x7f54dc138250 legacy=0x7f54dc138620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:46.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.842+0000 7f54da7fc700 1 -- 172.21.15.40:0/3989934428 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54dc09b010 con 0x7f54dc13b130 2023-09-30T22:29:46.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.842+0000 7f54da7fc700 1 --2- 172.21.15.40:0/3989934428 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f54dc13b130 0x7f54dc13d510 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f54d0009920 tx=0x7f54d0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14bd32aecfa08a83 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:46.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.842+0000 7f3bc57ff700 1 -- 172.21.15.40:0/272061877 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bc009d760 msgr2=0x7f3bc009db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:46.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.842+0000 7f3bc57ff700 1 --2- 172.21.15.40:0/272061877 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bc009d760 0x7f3bc009db30 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0006fd0 tx=0x7f3bb0009bd0 comp rx=0 tx=0).stop 2023-09-30T22:29:46.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.842+0000 7f54d9ffb700 1 -- 172.21.15.40:0/3989934428 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d000ba60 con 0x7f54dc13b130 2023-09-30T22:29:46.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.842+0000 7f54d9ffb700 1 -- 172.21.15.40:0/3989934428 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d000bbc0 con 0x7f54dc13b130 2023-09-30T22:29:46.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.842+0000 7f54d9ffb700 1 -- 172.21.15.40:0/3989934428 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d0009e70 con 0x7f54dc13b130 2023-09-30T22:29:46.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.842+0000 7f3bc57ff700 1 -- 172.21.15.40:0/272061877 shutdown_connections 2023-09-30T22:29:46.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.842+0000 7f3bc57ff700 1 --2- 172.21.15.40:0/272061877 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3bc0130b60 0x7f3bc0131000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:46.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.842+0000 7f3bc57ff700 1 --2- 172.21.15.40:0/272061877 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bc009d760 0x7f3bc009db30 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:46.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.842+0000 7f3bc57ff700 1 --2- 172.21.15.40:0/272061877 >> v2:172.21.15.40:3300/0 conn(0x7f3bc009e070 0x7f3bc0130620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:46.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.842+0000 7f3bc57ff700 1 -- 172.21.15.40:0/272061877 >> 172.21.15.40:0/272061877 conn(0x7f3bc00a2e60 msgr2=0x7f3bc00a3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:46.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.842+0000 7f3bc57ff700 1 -- 172.21.15.40:0/272061877 shutdown_connections 2023-09-30T22:29:46.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.842+0000 7f3bc57ff700 1 -- 172.21.15.40:0/272061877 wait complete. 2023-09-30T22:29:46.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.843+0000 7f54e14f7700 1 -- 172.21.15.40:0/3989934428 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f54dc13b130 msgr2=0x7f54dc13d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:46.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.843+0000 7f54e14f7700 1 --2- 172.21.15.40:0/3989934428 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f54dc13b130 0x7f54dc13d510 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f54d0009920 tx=0x7f54d0009c30 comp rx=0 tx=0).stop 2023-09-30T22:29:46.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.843+0000 7f54e14f7700 1 -- 172.21.15.40:0/3989934428 shutdown_connections 2023-09-30T22:29:46.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.843+0000 7f54e14f7700 1 --2- 172.21.15.40:0/3989934428 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54dc13da50 0x7f54dc13fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:46.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.843+0000 7f54e14f7700 1 --2- 172.21.15.40:0/3989934428 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f54dc13b130 0x7f54dc13d510 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:46.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.843+0000 7f54e14f7700 1 -- 172.21.15.40:0/3989934428 >> 172.21.15.40:0/3989934428 conn(0x7f54dc0a2a00 msgr2=0x7f54dc0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:46.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.843+0000 7f54e14f7700 1 -- 172.21.15.40:0/3989934428 shutdown_connections 2023-09-30T22:29:46.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.843+0000 7f54e14f7700 1 -- 172.21.15.40:0/3989934428 wait complete. 2023-09-30T22:29:46.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.843+0000 7f3bc57ff700 1 Processor -- start 2023-09-30T22:29:46.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.843+0000 7f3bc57ff700 1 -- start start 2023-09-30T22:29:46.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.844+0000 7f3bc57ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bc009d760 0x7f3bc011e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:46.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.844+0000 7f3bc57ff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3bc009e070 0x7f3bc011e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:46.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.844+0000 7f54e14f7700 1 Processor -- start 2023-09-30T22:29:46.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.844+0000 7f3bc57ff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bc0130b60 0x7f3bc011eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:46.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.844+0000 7f3bc57ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc0120700 con 0x7f3bc009d760 2023-09-30T22:29:46.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.844+0000 7f3bc57ff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc0121d40 con 0x7f3bc0130b60 2023-09-30T22:29:46.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.844+0000 7f3bc57ff700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc0071130 con 0x7f3bc009e070 2023-09-30T22:29:46.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.844+0000 7f3bbeffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bc009d760 0x7f3bc011e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:46.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.844+0000 7f3bbeffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bc009d760 0x7f3bc011e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49748/0 (socket says 172.21.15.40:49748) 2023-09-30T22:29:46.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.844+0000 7f3bbeffd700 1 -- 172.21.15.40:0/334401991 learned_addr learned my addr 172.21.15.40:0/334401991 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:46.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.844+0000 7f3bbf7fe700 1 --2- 172.21.15.40:0/334401991 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bc0130b60 0x7f3bc011eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:46.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.844+0000 7f3bbe7fc700 1 --2- 172.21.15.40:0/334401991 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3bc009e070 0x7f3bc011e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:46.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.844+0000 7f54e14f7700 1 -- start start 2023-09-30T22:29:46.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.844+0000 7f3bbeffd700 1 -- 172.21.15.40:0/334401991 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3bc009e070 msgr2=0x7f3bc011e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:46.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.844+0000 7f3bbeffd700 1 --2- 172.21.15.40:0/334401991 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3bc009e070 0x7f3bc011e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:46.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.844+0000 7f3bbeffd700 1 -- 172.21.15.40:0/334401991 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bc0130b60 msgr2=0x7f3bc011eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:46.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.844+0000 7f3bbeffd700 1 --2- 172.21.15.40:0/334401991 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bc0130b60 0x7f3bc011eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:46.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.844+0000 7f3bbeffd700 1 -- 172.21.15.40:0/334401991 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb0009500 con 0x7f3bc009d760 2023-09-30T22:29:46.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.844+0000 7f3bbf7fe700 1 --2- 172.21.15.40:0/334401991 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bc0130b60 0x7f3bc011eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:46.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.845+0000 7f3bbeffd700 1 --2- 172.21.15.40:0/334401991 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bc009d760 0x7f3bc011e220 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0009c10 tx=0x7f3bb0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:46.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.845+0000 7f3ba77fe700 1 -- 172.21.15.40:0/334401991 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb0022070 con 0x7f3bc009d760 2023-09-30T22:29:46.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.845+0000 7f3ba77fe700 1 -- 172.21.15.40:0/334401991 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb0012de0 con 0x7f3bc009d760 2023-09-30T22:29:46.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.845+0000 7f3ba77fe700 1 -- 172.21.15.40:0/334401991 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb00038a0 con 0x7f3bc009d760 2023-09-30T22:29:46.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.845+0000 7fae2c469700 1 Processor -- start 2023-09-30T22:29:46.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.845+0000 7f54e14f7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54dc138250 0x7f54dc06f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:46.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.845+0000 7f54e14f7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f54dc13b130 0x7f54dc06fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:46.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.845+0000 7f54e14f7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54dc13da50 0x7f54dc070250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:46.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.845+0000 7f54e14f7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc123200 con 0x7f54dc138250 2023-09-30T22:29:46.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.845+0000 7f54e14f7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc1229b0 con 0x7f54dc13da50 2023-09-30T22:29:46.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.845+0000 7f54e14f7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc121b50 con 0x7f54dc13b130 2023-09-30T22:29:46.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.845+0000 7f54da7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f54dc13b130 0x7f54dc06fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:46.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.845+0000 7f54da7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f54dc13b130 0x7f54dc06fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:38072/0 (socket says 172.21.15.40:38072) 2023-09-30T22:29:46.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.845+0000 7f54daffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54dc138250 0x7f54dc06f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:46.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.845+0000 7f54da7fc700 1 -- 172.21.15.40:0/1442928145 learned_addr learned my addr 172.21.15.40:0/1442928145 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:46.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.845+0000 7f54db7fe700 1 --2- 172.21.15.40:0/1442928145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54dc13da50 0x7f54dc070250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:46.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.845+0000 7f54daffd700 1 -- 172.21.15.40:0/1442928145 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f54dc13b130 msgr2=0x7f54dc06fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:46.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.845+0000 7f54daffd700 1 --2- 172.21.15.40:0/1442928145 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f54dc13b130 0x7f54dc06fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:46.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.845+0000 7f54daffd700 1 -- 172.21.15.40:0/1442928145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54dc13da50 msgr2=0x7f54dc070250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:46.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.845+0000 7f54daffd700 1 --2- 172.21.15.40:0/1442928145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54dc13da50 0x7f54dc070250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:46.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.845+0000 7f54daffd700 1 -- 172.21.15.40:0/1442928145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d0009550 con 0x7f54dc138250 2023-09-30T22:29:46.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.846+0000 7f54daffd700 1 --2- 172.21.15.40:0/1442928145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54dc138250 0x7f54dc06f7d0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f54cc00c450 tx=0x7f54cc00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:46.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.846+0000 7f3bc57ff700 1 -- 172.21.15.40:0/334401991 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc011fe30 con 0x7f3bc009d760 2023-09-30T22:29:46.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.846+0000 7f3bc57ff700 1 -- 172.21.15.40:0/334401991 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc01217a0 con 0x7f3bc009d760 2023-09-30T22:29:46.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.846+0000 7f54c37fe700 1 -- 172.21.15.40:0/1442928145 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54cc0052d0 con 0x7f54dc138250 2023-09-30T22:29:46.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.846+0000 7f54c37fe700 1 -- 172.21.15.40:0/1442928145 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54cc005430 con 0x7f54dc138250 2023-09-30T22:29:46.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.846+0000 7f54c37fe700 1 -- 172.21.15.40:0/1442928145 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54cc003880 con 0x7f54dc138250 2023-09-30T22:29:46.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.845+0000 7fae2c469700 1 -- start start 2023-09-30T22:29:46.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.846+0000 7fae2c469700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fae240956e0 0x7fae24135040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:46.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.846+0000 7fae2c469700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae241387f0 0x7fae2413ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:46.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.846+0000 7fae2c469700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae2409e230 con 0x7fae24137c60 2023-09-30T22:29:46.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.846+0000 7fae2c469700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae241346f0 con 0x7fae240956e0 2023-09-30T22:29:46.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.846+0000 7fae2c469700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae24094ee0 con 0x7fae241387f0 2023-09-30T22:29:46.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.847+0000 7fae29a04700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fae24137c60 0x7fae241380e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40334/0 (socket says 172.21.15.40:40334) 2023-09-30T22:29:46.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.847+0000 7fae29a04700 1 -- 172.21.15.40:0/1429486629 learned_addr learned my addr 172.21.15.40:0/1429486629 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:29:46.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.847+0000 7fae29203700 1 -- 172.21.15.40:0/1429486629 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1767129951 0 0) 0x7fae2409e230 con 0x7fae24137c60 2023-09-30T22:29:46.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.847+0000 7fae2aa06700 1 --2- 172.21.15.40:0/1429486629 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae241387f0 0x7fae2413ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:46.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.847+0000 7fae29203700 1 -- 172.21.15.40:0/1429486629 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae100035b0 con 0x7fae24137c60 2023-09-30T22:29:46.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.847+0000 7f54e14f7700 1 -- 172.21.15.40:0/1442928145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54dc071240 con 0x7f54dc138250 2023-09-30T22:29:46.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.847+0000 7f54e14f7700 1 -- 172.21.15.40:0/1442928145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54dc13d6b0 con 0x7f54dc138250 2023-09-30T22:29:46.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.847+0000 7f3bc57ff700 1 -- 172.21.15.40:0/334401991 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc01203e0 con 0x7f3bc009d760 2023-09-30T22:29:46.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.847+0000 7fae2a205700 1 --2- 172.21.15.40:0/1429486629 >> v2:172.21.15.40:3300/0 conn(0x7fae240956e0 0x7fae24135040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:46.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.847+0000 7fae2aa06700 1 -- 172.21.15.40:0/1429486629 >> v2:172.21.15.40:3300/0 conn(0x7fae240956e0 msgr2=0x7fae24135040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:46.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.847+0000 7fae2aa06700 1 --2- 172.21.15.40:0/1429486629 >> v2:172.21.15.40:3300/0 conn(0x7fae240956e0 0x7fae24135040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:46.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.847+0000 7fae2aa06700 1 -- 172.21.15.40:0/1429486629 >> v1:172.21.15.40:6789/0 conn(0x7fae24137c60 legacy=0x7fae241380e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:46.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.847+0000 7fae29203700 1 -- 172.21.15.40:0/1429486629 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3710590361 0 0) 0x7fae100035b0 con 0x7fae24137c60 2023-09-30T22:29:46.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.847+0000 7fae2aa06700 1 -- 172.21.15.40:0/1429486629 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae24095ea0 con 0x7fae241387f0 2023-09-30T22:29:46.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.848+0000 7fae2aa06700 1 --2- 172.21.15.40:0/1429486629 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae241387f0 0x7fae2413ffa0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fae20009870 tx=0x7fae20009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7ac1517a68c2a88 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:46.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.848+0000 7fae29203700 1 -- 172.21.15.40:0/1429486629 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae18001670 con 0x7fae241387f0 2023-09-30T22:29:46.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.848+0000 7fae29203700 1 -- 172.21.15.40:0/1429486629 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae20004030 con 0x7fae241387f0 2023-09-30T22:29:46.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.848+0000 7fae29203700 1 -- 172.21.15.40:0/1429486629 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae200043c0 con 0x7fae241387f0 2023-09-30T22:29:46.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.848+0000 7f54e14f7700 1 -- 172.21.15.40:0/1442928145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54dc122d20 con 0x7f54dc138250 2023-09-30T22:29:46.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.848+0000 7f54c37fe700 1 -- 172.21.15.40:0/1442928145 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f54cc0039e0 con 0x7f54dc138250 2023-09-30T22:29:46.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.849+0000 7f54c37fe700 1 -- 172.21.15.40:0/1442928145 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f54cc03eb60 con 0x7f54dc138250 2023-09-30T22:29:46.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.849+0000 7fae2c469700 1 -- 172.21.15.40:0/1429486629 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae241387f0 msgr2=0x7fae2413ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:46.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.849+0000 7fae2c469700 1 --2- 172.21.15.40:0/1429486629 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae241387f0 0x7fae2413ffa0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fae20009870 tx=0x7fae20009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:46.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.849+0000 7f3ba77fe700 1 -- 172.21.15.40:0/334401991 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3bb0003a00 con 0x7f3bc009d760 2023-09-30T22:29:46.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.849+0000 7f3ba77fe700 1 -- 172.21.15.40:0/334401991 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3bb00445b0 con 0x7f3bc009d760 2023-09-30T22:29:46.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.849+0000 7fae2c469700 1 -- 172.21.15.40:0/1429486629 shutdown_connections 2023-09-30T22:29:46.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.849+0000 7fae2c469700 1 --2- 172.21.15.40:0/1429486629 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae241387f0 0x7fae2413ffa0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:46.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.849+0000 7fae2c469700 1 --2- 172.21.15.40:0/1429486629 >> v2:172.21.15.40:3300/0 conn(0x7fae240956e0 0x7fae24135040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:46.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.849+0000 7fae2c469700 1 -- 172.21.15.40:0/1429486629 >> 172.21.15.40:0/1429486629 conn(0x7fae240a2ff0 msgr2=0x7fae2409ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:46.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.849+0000 7fae2c469700 1 -- 172.21.15.40:0/1429486629 shutdown_connections 2023-09-30T22:29:46.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.849+0000 7fae2c469700 1 -- 172.21.15.40:0/1429486629 wait complete. 2023-09-30T22:29:46.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.850+0000 7fae2c469700 1 Processor -- start 2023-09-30T22:29:46.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.850+0000 7fae2c469700 1 -- start start 2023-09-30T22:29:46.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.851+0000 7fae2c469700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae240956e0 0x7fae241403c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:46.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.851+0000 7fae2c469700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae24137c60 0x7fae2406ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:46.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.851+0000 7fae2c469700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae241387f0 0x7fae2406f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:46.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.851+0000 7fae2c469700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae24070c20 con 0x7fae241387f0 2023-09-30T22:29:46.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.851+0000 7fae2c469700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae24070a30 con 0x7fae240956e0 2023-09-30T22:29:46.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.851+0000 7fae2c469700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae24071300 con 0x7fae24137c60 2023-09-30T22:29:46.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.851+0000 7fae29a04700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae24137c60 0x7fae2406ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:46.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.851+0000 7fae29a04700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae24137c60 0x7fae2406ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:38094/0 (socket says 172.21.15.40:38094) 2023-09-30T22:29:46.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.851+0000 7fae29a04700 1 -- 172.21.15.40:0/741751582 learned_addr learned my addr 172.21.15.40:0/741751582 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:46.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.851+0000 7fae2aa06700 1 --2- 172.21.15.40:0/741751582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae241387f0 0x7fae2406f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:46.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.852+0000 7fae29a04700 1 -- 172.21.15.40:0/741751582 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae240956e0 msgr2=0x7fae241403c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:46.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.852+0000 7fae29a04700 1 --2- 172.21.15.40:0/741751582 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae240956e0 0x7fae241403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:46.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.852+0000 7fae29a04700 1 -- 172.21.15.40:0/741751582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae241387f0 msgr2=0x7fae2406f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:46.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.852+0000 7fae29a04700 1 --2- 172.21.15.40:0/741751582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae241387f0 0x7fae2406f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:46.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.852+0000 7fae29a04700 1 -- 172.21.15.40:0/741751582 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae200094a0 con 0x7fae24137c60 2023-09-30T22:29:46.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.852+0000 7fae29a04700 1 --2- 172.21.15.40:0/741751582 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae24137c60 0x7fae2406ee20 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fae1800c520 tx=0x7fae1800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:46.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.852+0000 7fae16ffd700 1 -- 172.21.15.40:0/741751582 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae18004c80 con 0x7fae24137c60 2023-09-30T22:29:46.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.852+0000 7fae16ffd700 1 -- 172.21.15.40:0/741751582 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae18004e00 con 0x7fae24137c60 2023-09-30T22:29:46.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.852+0000 7fae2c469700 1 -- 172.21.15.40:0/741751582 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae24139470 con 0x7fae24137c60 2023-09-30T22:29:46.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.852+0000 7fae16ffd700 1 -- 172.21.15.40:0/741751582 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae18007310 con 0x7fae24137c60 2023-09-30T22:29:46.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.852+0000 7fae2c469700 1 -- 172.21.15.40:0/741751582 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae24139190 con 0x7fae24137c60 2023-09-30T22:29:46.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.853+0000 7fae16ffd700 1 -- 172.21.15.40:0/741751582 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fae18007470 con 0x7fae24137c60 2023-09-30T22:29:46.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.853+0000 7fae16ffd700 1 -- 172.21.15.40:0/741751582 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fae1803f4e0 con 0x7fae24137c60 2023-09-30T22:29:46.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.853+0000 7fae2c469700 1 -- 172.21.15.40:0/741751582 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae24062380 con 0x7fae24137c60 2023-09-30T22:29:46.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.857+0000 7f3ba77fe700 1 -- 172.21.15.40:0/334401991 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3bb000d530 con 0x7f3bc009d760 2023-09-30T22:29:46.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.858+0000 7f54c37fe700 1 -- 172.21.15.40:0/1442928145 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f54cc010b40 con 0x7f54dc138250 2023-09-30T22:29:46.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:46.858+0000 7fae16ffd700 1 -- 172.21.15.40:0/741751582 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fae180123b0 con 0x7fae24137c60 2023-09-30T22:29:47.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.053+0000 7f3bc57ff700 1 -- 172.21.15.40:0/334401991 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3bc0062380 con 0x7f3bc009d760 2023-09-30T22:29:47.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.053+0000 7f3ba77fe700 1 -- 172.21.15.40:0/334401991 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3bb0034020 con 0x7f3bc009d760 2023-09-30T22:29:47.054 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:47.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.054+0000 7fae2c469700 1 -- 172.21.15.40:0/741751582 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fae240991b0 con 0x7fae24137c60 2023-09-30T22:29:47.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.054+0000 7fae16ffd700 1 -- 172.21.15.40:0/741751582 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fae18011360 con 0x7fae24137c60 2023-09-30T22:29:47.055 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:47.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.055+0000 7f3bc57ff700 1 -- 172.21.15.40:0/334401991 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bc009d760 msgr2=0x7f3bc011e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:47.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.055+0000 7f3bc57ff700 1 --2- 172.21.15.40:0/334401991 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bc009d760 0x7f3bc011e220 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0009c10 tx=0x7f3bb0004750 comp rx=0 tx=0).stop 2023-09-30T22:29:47.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.055+0000 7f3bc57ff700 1 -- 172.21.15.40:0/334401991 shutdown_connections 2023-09-30T22:29:47.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.055+0000 7f3bc57ff700 1 --2- 172.21.15.40:0/334401991 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bc0130b60 0x7f3bc011eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.055+0000 7f3bc57ff700 1 --2- 172.21.15.40:0/334401991 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bc009d760 0x7f3bc011e220 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.055+0000 7f3bc57ff700 1 --2- 172.21.15.40:0/334401991 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3bc009e070 0x7f3bc011e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.055+0000 7f3bc57ff700 1 -- 172.21.15.40:0/334401991 >> 172.21.15.40:0/334401991 conn(0x7f3bc00a2e60 msgr2=0x7f3bc00a0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:47.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.055+0000 7f3bc57ff700 1 -- 172.21.15.40:0/334401991 shutdown_connections 2023-09-30T22:29:47.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.055+0000 7f3bc57ff700 1 -- 172.21.15.40:0/334401991 wait complete. 2023-09-30T22:29:47.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.056+0000 7fae2c469700 1 -- 172.21.15.40:0/741751582 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae24137c60 msgr2=0x7fae2406ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:47.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.056+0000 7fae2c469700 1 --2- 172.21.15.40:0/741751582 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae24137c60 0x7fae2406ee20 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fae1800c520 tx=0x7fae1800c830 comp rx=0 tx=0).stop 2023-09-30T22:29:47.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.056+0000 7fae2c469700 1 -- 172.21.15.40:0/741751582 shutdown_connections 2023-09-30T22:29:47.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.056+0000 7fae2c469700 1 --2- 172.21.15.40:0/741751582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae241387f0 0x7fae2406f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.056+0000 7fae2c469700 1 --2- 172.21.15.40:0/741751582 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae240956e0 0x7fae241403c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.056+0000 7fae2c469700 1 --2- 172.21.15.40:0/741751582 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fae24137c60 0x7fae2406ee20 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.056+0000 7fae2c469700 1 -- 172.21.15.40:0/741751582 >> 172.21.15.40:0/741751582 conn(0x7fae240a2ff0 msgr2=0x7fae240a0290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:47.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.056+0000 7fae2c469700 1 -- 172.21.15.40:0/741751582 shutdown_connections 2023-09-30T22:29:47.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.056+0000 7fae2c469700 1 -- 172.21.15.40:0/741751582 wait complete. 2023-09-30T22:29:47.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.057+0000 7f0ff1ecb700 1 -- 172.21.15.40:0/640344281 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0fec062380 con 0x7f0fec06afe0 2023-09-30T22:29:47.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.057+0000 7f0fd3fff700 1 -- 172.21.15.40:0/640344281 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0fe0017020 con 0x7f0fec06afe0 2023-09-30T22:29:47.059 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:47.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.059+0000 7f0ff1ecb700 1 -- 172.21.15.40:0/640344281 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fec06afe0 msgr2=0x7f0fec120b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:47.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.059+0000 7f0ff1ecb700 1 --2- 172.21.15.40:0/640344281 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fec06afe0 0x7f0fec120b70 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f0fe000c4e0 tx=0x7f0fe000c7f0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.059+0000 7f0ff1ecb700 1 -- 172.21.15.40:0/640344281 shutdown_connections 2023-09-30T22:29:47.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.059+0000 7f0ff1ecb700 1 --2- 172.21.15.40:0/640344281 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0fec06a6d0 0x7f0fec120630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.059+0000 7f0ff1ecb700 1 --2- 172.21.15.40:0/640344281 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fec131fc0 0x7f0fec1210b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.059+0000 7f0ff1ecb700 1 --2- 172.21.15.40:0/640344281 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0fec06afe0 0x7f0fec120b70 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.059+0000 7f0ff1ecb700 1 -- 172.21.15.40:0/640344281 >> 172.21.15.40:0/640344281 conn(0x7f0fec09fb20 msgr2=0x7f0fec0a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:47.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.060+0000 7f0ff1ecb700 1 -- 172.21.15.40:0/640344281 shutdown_connections 2023-09-30T22:29:47.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.060+0000 7f0ff1ecb700 1 -- 172.21.15.40:0/640344281 wait complete. 2023-09-30T22:29:47.073 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:47.074 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:47.075 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:47.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.093+0000 7f54e14f7700 1 -- 172.21.15.40:0/1442928145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f54dc062380 con 0x7f54dc138250 2023-09-30T22:29:47.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.094+0000 7f54c37fe700 1 -- 172.21.15.40:0/1442928145 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f54cc017070 con 0x7f54dc138250 2023-09-30T22:29:47.095 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:47.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.096+0000 7f54e14f7700 1 -- 172.21.15.40:0/1442928145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54dc138250 msgr2=0x7f54dc06f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:47.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.096+0000 7f54e14f7700 1 --2- 172.21.15.40:0/1442928145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54dc138250 0x7f54dc06f7d0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f54cc00c450 tx=0x7f54cc00c760 comp rx=0 tx=0).stop 2023-09-30T22:29:47.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.096+0000 7f54e14f7700 1 -- 172.21.15.40:0/1442928145 shutdown_connections 2023-09-30T22:29:47.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.096+0000 7f54e14f7700 1 --2- 172.21.15.40:0/1442928145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54dc13da50 0x7f54dc070250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.096+0000 7f54e14f7700 1 --2- 172.21.15.40:0/1442928145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54dc138250 0x7f54dc06f7d0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.096+0000 7f54e14f7700 1 --2- 172.21.15.40:0/1442928145 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f54dc13b130 0x7f54dc06fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:47.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.096+0000 7f54e14f7700 1 -- 172.21.15.40:0/1442928145 >> 172.21.15.40:0/1442928145 conn(0x7f54dc0a2a00 msgr2=0x7f54dc138f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:47.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.096+0000 7f54e14f7700 1 -- 172.21.15.40:0/1442928145 shutdown_connections 2023-09-30T22:29:47.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:47.096+0000 7f54e14f7700 1 -- 172.21.15.40:0/1442928145 wait complete. 2023-09-30T22:29:47.109 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:48.073 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:48.074 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:48.076 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:48.110 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:48.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.229+0000 7f8ae4e64700 1 Processor -- start 2023-09-30T22:29:48.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.229+0000 7f8ae4e64700 1 -- start start 2023-09-30T22:29:48.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.230+0000 7f8ae4e64700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8ae009fbb0 0x7f8ae006c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.230+0000 7f8ae4e64700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ae006d2c0 0x7f8ae013baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.230+0000 7f8ae4e64700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae00a0590 con 0x7f8ae006ced0 2023-09-30T22:29:48.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.230+0000 7f8ae4e64700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae009ff80 con 0x7f8ae009fbb0 2023-09-30T22:29:48.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.230+0000 7f8ae4e64700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae006da80 con 0x7f8ae006d2c0 2023-09-30T22:29:48.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.230+0000 7f8ade59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8ae009fbb0 0x7f8ae006c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:48.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.230+0000 7f8ade59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8ae009fbb0 0x7f8ae006c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49798/0 (socket says 172.21.15.40:49798) 2023-09-30T22:29:48.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.230+0000 7f8ade59c700 1 -- 172.21.15.40:0/699441912 learned_addr learned my addr 172.21.15.40:0/699441912 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:48.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.230+0000 7f8aded9d700 1 --2- 172.21.15.40:0/699441912 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ae006d2c0 0x7f8ae013baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:48.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.231+0000 7f8ade59c700 1 -- 172.21.15.40:0/699441912 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ae006d2c0 msgr2=0x7f8ae013baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:48.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.231+0000 7f8ade59c700 1 --2- 172.21.15.40:0/699441912 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ae006d2c0 0x7f8ae013baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.231+0000 7f8ade59c700 1 -- 172.21.15.40:0/699441912 >> v1:172.21.15.40:6789/0 conn(0x7f8ae006ced0 legacy=0x7f8ae0138370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.231+0000 7f8ade59c700 1 -- 172.21.15.40:0/699441912 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae00a0780 con 0x7f8ae009fbb0 2023-09-30T22:29:48.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.231+0000 7f8ade59c700 1 --2- 172.21.15.40:0/699441912 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ae009fbb0 0x7f8ae006c990 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f8ad00098f0 tx=0x7f8ad0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51c76f50319d779b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:48.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.231+0000 7f8add59a700 1 -- 172.21.15.40:0/699441912 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad0011830 con 0x7f8ae009fbb0 2023-09-30T22:29:48.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.231+0000 7f8add59a700 1 -- 172.21.15.40:0/699441912 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad0011990 con 0x7f8ae009fbb0 2023-09-30T22:29:48.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.231+0000 7f8add59a700 1 -- 172.21.15.40:0/699441912 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad0011d20 con 0x7f8ae009fbb0 2023-09-30T22:29:48.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.232+0000 7f8ae4e64700 1 -- 172.21.15.40:0/699441912 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ae009fbb0 msgr2=0x7f8ae006c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.232+0000 7f8ae4e64700 1 --2- 172.21.15.40:0/699441912 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ae009fbb0 0x7f8ae006c990 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f8ad00098f0 tx=0x7f8ad0009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:48.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.232+0000 7f8ae4e64700 1 -- 172.21.15.40:0/699441912 shutdown_connections 2023-09-30T22:29:48.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.232+0000 7f8ae4e64700 1 --2- 172.21.15.40:0/699441912 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ae006d2c0 0x7f8ae013baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.232+0000 7f8ae4e64700 1 --2- 172.21.15.40:0/699441912 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ae009fbb0 0x7f8ae006c990 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.232+0000 7f8ae4e64700 1 -- 172.21.15.40:0/699441912 >> 172.21.15.40:0/699441912 conn(0x7f8ae00a41a0 msgr2=0x7f8ae00a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:48.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.232+0000 7f8ae4e64700 1 -- 172.21.15.40:0/699441912 shutdown_connections 2023-09-30T22:29:48.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.232+0000 7f8ae4e64700 1 -- 172.21.15.40:0/699441912 wait complete. 2023-09-30T22:29:48.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.234+0000 7ff0b41a7700 1 Processor -- start 2023-09-30T22:29:48.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.234+0000 7f8ae4e64700 1 Processor -- start 2023-09-30T22:29:48.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.234+0000 7f8ae4e64700 1 -- start start 2023-09-30T22:29:48.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.234+0000 7ff0b41a7700 1 -- start start 2023-09-30T22:29:48.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.235+0000 7ff0b41a7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0ac13b130 0x7ff0ac13d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.235+0000 7ff0b41a7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff0ac13da50 0x7ff0ac13fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.235+0000 7ff0b41a7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0ac137e20 con 0x7ff0ac138250 2023-09-30T22:29:48.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.235+0000 7ff0b41a7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0ac138d30 con 0x7ff0ac13da50 2023-09-30T22:29:48.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.235+0000 7ff0b41a7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac138050 con 0x7ff0ac13b130 2023-09-30T22:29:48.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.235+0000 7ff0b1f43700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff0ac138250 0x7ff0ac138620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40348/0 (socket says 172.21.15.40:40348) 2023-09-30T22:29:48.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.235+0000 7ff0b1f43700 1 -- 172.21.15.40:0/4010042282 learned_addr learned my addr 172.21.15.40:0/4010042282 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:29:48.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.235+0000 7ff0b2744700 1 --2- 172.21.15.40:0/4010042282 >> v2:172.21.15.40:3300/0 conn(0x7ff0ac13da50 0x7ff0ac13fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:48.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.235+0000 7f8ae4e64700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ae006ced0 0x7f8ae0096060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.235+0000 7f8ae4e64700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ae006d2c0 0x7f8ae00965a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.235+0000 7f8ae4e64700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ae009fbb0 0x7f8ae01c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.235+0000 7f8ae4e64700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae0093220 con 0x7f8ae009fbb0 2023-09-30T22:29:48.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.235+0000 7f8ae4e64700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae0071760 con 0x7f8ae006d2c0 2023-09-30T22:29:48.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.235+0000 7f8ae4e64700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae0071eb0 con 0x7f8ae006ced0 2023-09-30T22:29:48.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.235+0000 7f8aded9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ae009fbb0 0x7f8ae01c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:48.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.235+0000 7f8aded9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ae009fbb0 0x7f8ae01c8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49812/0 (socket says 172.21.15.40:49812) 2023-09-30T22:29:48.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.235+0000 7f8aded9d700 1 -- 172.21.15.40:0/2407310060 learned_addr learned my addr 172.21.15.40:0/2407310060 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:48.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.235+0000 7f8ade59c700 1 --2- 172.21.15.40:0/2407310060 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ae006ced0 0x7f8ae0096060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:48.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.235+0000 7f8aded9d700 1 -- 172.21.15.40:0/2407310060 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ae006ced0 msgr2=0x7f8ae0096060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.235+0000 7f8aded9d700 1 --2- 172.21.15.40:0/2407310060 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ae006ced0 0x7f8ae0096060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.235+0000 7f8aded9d700 1 -- 172.21.15.40:0/2407310060 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ae006d2c0 msgr2=0x7f8ae00965a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.235+0000 7f8aded9d700 1 --2- 172.21.15.40:0/2407310060 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ae006d2c0 0x7f8ae00965a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.235+0000 7f8aded9d700 1 -- 172.21.15.40:0/2407310060 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad0009550 con 0x7f8ae009fbb0 2023-09-30T22:29:48.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.235+0000 7ff0b2744700 1 -- 172.21.15.40:0/4010042282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0ac13b130 msgr2=0x7ff0ac13d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:48.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.235+0000 7ff0b2744700 1 --2- 172.21.15.40:0/4010042282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0ac13b130 0x7ff0ac13d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.235+0000 7ff0b2744700 1 -- 172.21.15.40:0/4010042282 >> v1:172.21.15.40:6789/0 conn(0x7ff0ac138250 legacy=0x7ff0ac138620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:48.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.236+0000 7ff0b2744700 1 -- 172.21.15.40:0/4010042282 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ac09b010 con 0x7ff0ac13da50 2023-09-30T22:29:48.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.236+0000 7ff0b2744700 1 --2- 172.21.15.40:0/4010042282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0ac13da50 0x7ff0ac13fe30 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7ff09c009870 tx=0x7ff09c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79f18e9b5bce90c7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:48.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.236+0000 7f8aded9d700 1 --2- 172.21.15.40:0/2407310060 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ae009fbb0 0x7f8ae01c8520 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f8ad800efc0 tx=0x7f8ad800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:48.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.236+0000 7ff0b0f41700 1 -- 172.21.15.40:0/4010042282 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09c004230 con 0x7ff0ac13da50 2023-09-30T22:29:48.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.236+0000 7ff0b0f41700 1 -- 172.21.15.40:0/4010042282 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff09c004390 con 0x7ff0ac13da50 2023-09-30T22:29:48.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.236+0000 7ff0b0f41700 1 -- 172.21.15.40:0/4010042282 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09c0036a0 con 0x7ff0ac13da50 2023-09-30T22:29:48.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.236+0000 7f8aceffd700 1 -- 172.21.15.40:0/2407310060 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8009ea0 con 0x7f8ae009fbb0 2023-09-30T22:29:48.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.236+0000 7f8aceffd700 1 -- 172.21.15.40:0/2407310060 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad800f040 con 0x7f8ae009fbb0 2023-09-30T22:29:48.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.236+0000 7f8ae4e64700 1 -- 172.21.15.40:0/2407310060 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae0094b90 con 0x7f8ae009fbb0 2023-09-30T22:29:48.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.236+0000 7f8aceffd700 1 -- 172.21.15.40:0/2407310060 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8014480 con 0x7f8ae009fbb0 2023-09-30T22:29:48.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.236+0000 7f8ae4e64700 1 -- 172.21.15.40:0/2407310060 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae0093e90 con 0x7f8ae009fbb0 2023-09-30T22:29:48.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.237+0000 7ff0b41a7700 1 -- 172.21.15.40:0/4010042282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0ac13da50 msgr2=0x7ff0ac13fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.237+0000 7ff0b41a7700 1 --2- 172.21.15.40:0/4010042282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0ac13da50 0x7ff0ac13fe30 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7ff09c009870 tx=0x7ff09c009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:48.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.237+0000 7ff0b41a7700 1 -- 172.21.15.40:0/4010042282 shutdown_connections 2023-09-30T22:29:48.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.237+0000 7ff0b41a7700 1 --2- 172.21.15.40:0/4010042282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0ac13da50 0x7ff0ac13fe30 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.237+0000 7ff0b41a7700 1 --2- 172.21.15.40:0/4010042282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0ac13b130 0x7ff0ac13d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.237+0000 7ff0b41a7700 1 -- 172.21.15.40:0/4010042282 >> 172.21.15.40:0/4010042282 conn(0x7ff0ac0a2a00 msgr2=0x7ff0ac0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:48.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.237+0000 7f8aceffd700 1 -- 172.21.15.40:0/2407310060 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8ad80145e0 con 0x7f8ae009fbb0 2023-09-30T22:29:48.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.237+0000 7f8ae4e64700 1 -- 172.21.15.40:0/2407310060 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae0062380 con 0x7f8ae009fbb0 2023-09-30T22:29:48.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.237+0000 7ff0b41a7700 1 -- 172.21.15.40:0/4010042282 shutdown_connections 2023-09-30T22:29:48.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.238+0000 7ff0b41a7700 1 -- 172.21.15.40:0/4010042282 wait complete. 2023-09-30T22:29:48.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.238+0000 7ff0b41a7700 1 Processor -- start 2023-09-30T22:29:48.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.239+0000 7ff0b41a7700 1 -- start start 2023-09-30T22:29:48.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.239+0000 7ff0b41a7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0ac138250 0x7ff0ac06f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.239+0000 7ff0b41a7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff0ac13b130 0x7ff0ac06fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.239+0000 7ff0b41a7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0ac13da50 0x7ff0ac070190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.239+0000 7ff0b41a7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac123310 con 0x7ff0ac138250 2023-09-30T22:29:48.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.239+0000 7ff0b41a7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac135640 con 0x7ff0ac13da50 2023-09-30T22:29:48.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.239+0000 7ff0b41a7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac09a300 con 0x7ff0ac13b130 2023-09-30T22:29:48.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.239+0000 7ff0b1f43700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0ac138250 0x7ff0ac06f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:48.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.239+0000 7ff0b1f43700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0ac138250 0x7ff0ac06f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49824/0 (socket says 172.21.15.40:49824) 2023-09-30T22:29:48.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.239+0000 7ff0b1f43700 1 -- 172.21.15.40:0/1992525053 learned_addr learned my addr 172.21.15.40:0/1992525053 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:48.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.239+0000 7ff0b1742700 1 --2- 172.21.15.40:0/1992525053 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff0ac13b130 0x7ff0ac06fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:48.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.239+0000 7ff0b2744700 1 --2- 172.21.15.40:0/1992525053 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0ac13da50 0x7ff0ac070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:48.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.240+0000 7ff0b1742700 1 -- 172.21.15.40:0/1992525053 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0ac13da50 msgr2=0x7ff0ac070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.240+0000 7ff0b1742700 1 --2- 172.21.15.40:0/1992525053 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0ac13da50 0x7ff0ac070190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.240+0000 7ff0b1742700 1 -- 172.21.15.40:0/1992525053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0ac138250 msgr2=0x7ff0ac06f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.240+0000 7ff0b1742700 1 --2- 172.21.15.40:0/1992525053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0ac138250 0x7ff0ac06f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.240+0000 7ff0b1742700 1 -- 172.21.15.40:0/1992525053 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09c0094a0 con 0x7ff0ac13b130 2023-09-30T22:29:48.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.240+0000 7ff0b1742700 1 --2- 172.21.15.40:0/1992525053 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff0ac13b130 0x7ff0ac06fc50 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ff0a800b480 tx=0x7ff0a800b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:48.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.240+0000 7ff0a27fc700 1 -- 172.21.15.40:0/1992525053 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a8011830 con 0x7ff0ac13b130 2023-09-30T22:29:48.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.240+0000 7ff0a27fc700 1 -- 172.21.15.40:0/1992525053 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a8011990 con 0x7ff0ac13b130 2023-09-30T22:29:48.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.240+0000 7ff0b41a7700 1 -- 172.21.15.40:0/1992525053 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0ac121bc0 con 0x7ff0ac13b130 2023-09-30T22:29:48.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.238+0000 7f8aceffd700 1 -- 172.21.15.40:0/2407310060 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f8ad803ffc0 con 0x7f8ae009fbb0 2023-09-30T22:29:48.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.240+0000 7ff0a27fc700 1 -- 172.21.15.40:0/1992525053 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a8011d40 con 0x7ff0ac13b130 2023-09-30T22:29:48.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.240+0000 7ff0b41a7700 1 -- 172.21.15.40:0/1992525053 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0ac13d600 con 0x7ff0ac13b130 2023-09-30T22:29:48.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.241+0000 7ff0a27fc700 1 -- 172.21.15.40:0/1992525053 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff0a801a400 con 0x7ff0ac13b130 2023-09-30T22:29:48.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.241+0000 7ff0b41a7700 1 -- 172.21.15.40:0/1992525053 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0ac122c30 con 0x7ff0ac13b130 2023-09-30T22:29:48.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.246+0000 7ff0a27fc700 1 -- 172.21.15.40:0/1992525053 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff0a800f4a0 con 0x7ff0ac13b130 2023-09-30T22:29:48.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.246+0000 7f8aceffd700 1 -- 172.21.15.40:0/2407310060 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ad8071750 con 0x7f8ae009fbb0 2023-09-30T22:29:48.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.247+0000 7ff0a27fc700 1 -- 172.21.15.40:0/1992525053 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff0a8044060 con 0x7ff0ac13b130 2023-09-30T22:29:48.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.265+0000 7fb57d37c700 1 Processor -- start 2023-09-30T22:29:48.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.265+0000 7fb57d37c700 1 -- start start 2023-09-30T22:29:48.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.265+0000 7fb57d37c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb57806f070 0x7fb57806f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.265+0000 7fb57d37c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb57806f980 0x7fb578097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.265+0000 7fb57d37c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb57806fdb0 0x7fb5780975d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.265+0000 7fb57d37c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb578071af0 con 0x7fb57806fdb0 2023-09-30T22:29:48.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.265+0000 7fb57d37c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb578070830 con 0x7fb57806f980 2023-09-30T22:29:48.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.265+0000 7fb57d37c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb578070ad0 con 0x7fb57806f070 2023-09-30T22:29:48.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.266+0000 7fb5767fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb57806f980 0x7fb578097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:48.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.266+0000 7fb5767fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb57806f980 0x7fb578097090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:40424/0 (socket says 172.21.15.40:40424) 2023-09-30T22:29:48.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.266+0000 7fb5767fc700 1 -- 172.21.15.40:0/55064464 learned_addr learned my addr 172.21.15.40:0/55064464 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:48.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.266+0000 7fb5767fc700 1 -- 172.21.15.40:0/55064464 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb57806f070 msgr2=0x7fb57806f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:48.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.266+0000 7fb5767fc700 1 --2- 172.21.15.40:0/55064464 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb57806f070 0x7fb57806f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.266+0000 7fb5767fc700 1 -- 172.21.15.40:0/55064464 >> v2:172.21.15.40:3300/0 conn(0x7fb57806fdb0 msgr2=0x7fb5780975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:48.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.266+0000 7fb5767fc700 1 --2- 172.21.15.40:0/55064464 >> v2:172.21.15.40:3300/0 conn(0x7fb57806fdb0 0x7fb5780975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.266+0000 7fb5767fc700 1 -- 172.21.15.40:0/55064464 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb578070de0 con 0x7fb57806f980 2023-09-30T22:29:48.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.266+0000 7fb5767fc700 1 --2- 172.21.15.40:0/55064464 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb57806f980 0x7fb578097090 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fb56c009920 tx=0x7fb56c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6c50647272e366e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:48.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.268+0000 7fb575ffb700 1 -- 172.21.15.40:0/55064464 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c00ba20 con 0x7fb57806f980 2023-09-30T22:29:48.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.268+0000 7fb575ffb700 1 -- 172.21.15.40:0/55064464 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56c00bb80 con 0x7fb57806f980 2023-09-30T22:29:48.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.268+0000 7fb575ffb700 1 -- 172.21.15.40:0/55064464 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c009e70 con 0x7fb57806f980 2023-09-30T22:29:48.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.268+0000 7fb57d37c700 1 -- 172.21.15.40:0/55064464 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb57806f980 msgr2=0x7fb578097090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.268+0000 7fb57d37c700 1 --2- 172.21.15.40:0/55064464 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb57806f980 0x7fb578097090 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fb56c009920 tx=0x7fb56c009c30 comp rx=0 tx=0).stop 2023-09-30T22:29:48.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.268+0000 7fb57d37c700 1 -- 172.21.15.40:0/55064464 shutdown_connections 2023-09-30T22:29:48.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.268+0000 7fb57d37c700 1 --2- 172.21.15.40:0/55064464 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb57806f070 0x7fb57806f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.268+0000 7fb57d37c700 1 --2- 172.21.15.40:0/55064464 >> v2:172.21.15.40:3300/0 conn(0x7fb57806fdb0 0x7fb5780975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.268+0000 7fb57d37c700 1 --2- 172.21.15.40:0/55064464 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb57806f980 0x7fb578097090 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.268+0000 7fb57d37c700 1 -- 172.21.15.40:0/55064464 >> 172.21.15.40:0/55064464 conn(0x7fb5780a41a0 msgr2=0x7fb5780a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:48.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.269+0000 7fb57d37c700 1 -- 172.21.15.40:0/55064464 shutdown_connections 2023-09-30T22:29:48.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.269+0000 7fb57d37c700 1 -- 172.21.15.40:0/55064464 wait complete. 2023-09-30T22:29:48.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.270+0000 7fb57d37c700 1 Processor -- start 2023-09-30T22:29:48.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.270+0000 7fb57d37c700 1 -- start start 2023-09-30T22:29:48.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.270+0000 7fb57d37c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb57806f070 0x7fb57806c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.270+0000 7fb57d37c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb57806f980 0x7fb57806ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.270+0000 7fb57d37c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb57806fdb0 0x7fb57806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.270+0000 7fb57d37c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57806e670 con 0x7fb57806fdb0 2023-09-30T22:29:48.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.270+0000 7fb57d37c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb57808b310 con 0x7fb57806f070 2023-09-30T22:29:48.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.270+0000 7fb57d37c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5781320f0 con 0x7fb57806f980 2023-09-30T22:29:48.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.270+0000 7fb576ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb57806f070 0x7fb57806c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:48.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.270+0000 7fb576ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb57806f070 0x7fb57806c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:40436/0 (socket says 172.21.15.40:40436) 2023-09-30T22:29:48.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.271+0000 7fb576ffd700 1 -- 172.21.15.40:0/1183276729 learned_addr learned my addr 172.21.15.40:0/1183276729 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:48.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.271+0000 7fb5767fc700 1 --2- 172.21.15.40:0/1183276729 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb57806f980 0x7fb57806ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:48.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.271+0000 7fb576ffd700 1 -- 172.21.15.40:0/1183276729 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb57806f980 msgr2=0x7fb57806ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.271+0000 7fb576ffd700 1 --2- 172.21.15.40:0/1183276729 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb57806f980 0x7fb57806ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.271+0000 7fb576ffd700 1 -- 172.21.15.40:0/1183276729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb57806fdb0 msgr2=0x7fb57806d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.271+0000 7fb576ffd700 1 --2- 172.21.15.40:0/1183276729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb57806fdb0 0x7fb57806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.271+0000 7fb576ffd700 1 -- 172.21.15.40:0/1183276729 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb56c009550 con 0x7fb57806f070 2023-09-30T22:29:48.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.271+0000 7fb576ffd700 1 --2- 172.21.15.40:0/1183276729 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb57806f070 0x7fb57806c990 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fb56800b530 tx=0x7fb56800b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:48.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.271+0000 7fb55f7fe700 1 -- 172.21.15.40:0/1183276729 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb568011830 con 0x7fb57806f070 2023-09-30T22:29:48.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.271+0000 7fb55f7fe700 1 -- 172.21.15.40:0/1183276729 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb568011990 con 0x7fb57806f070 2023-09-30T22:29:48.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.271+0000 7fb55f7fe700 1 -- 172.21.15.40:0/1183276729 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb568011d40 con 0x7fb57806f070 2023-09-30T22:29:48.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.271+0000 7fb57d37c700 1 -- 172.21.15.40:0/1183276729 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb57808b070 con 0x7fb57806f070 2023-09-30T22:29:48.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.272+0000 7fb57d37c700 1 -- 172.21.15.40:0/1183276729 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5781317e0 con 0x7fb57806f070 2023-09-30T22:29:48.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.273+0000 7fb57d37c700 1 -- 172.21.15.40:0/1183276729 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb578062380 con 0x7fb57806f070 2023-09-30T22:29:48.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.273+0000 7fb55f7fe700 1 -- 172.21.15.40:0/1183276729 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb56801a400 con 0x7fb57806f070 2023-09-30T22:29:48.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.273+0000 7fb55f7fe700 1 -- 172.21.15.40:0/1183276729 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb56803f7c0 con 0x7fb57806f070 2023-09-30T22:29:48.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.278+0000 7fb55f7fe700 1 -- 172.21.15.40:0/1183276729 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb56800f8d0 con 0x7fb57806f070 2023-09-30T22:29:48.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.279+0000 7f62384db700 1 Processor -- start 2023-09-30T22:29:48.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.279+0000 7f62384db700 1 -- start start 2023-09-30T22:29:48.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.280+0000 7f62384db700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6230133e00 0x7f62301341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.280+0000 7f62384db700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f623009df70 0x7f623013bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.280+0000 7f62384db700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6230133940 con 0x7f623009d400 2023-09-30T22:29:48.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.280+0000 7f62384db700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f623009ab20 con 0x7f6230133e00 2023-09-30T22:29:48.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.280+0000 7f62384db700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f623009f0d0 con 0x7f623009df70 2023-09-30T22:29:48.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.280+0000 7f6236277700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6230133e00 0x7f62301341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:48.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.280+0000 7f6236277700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6230133e00 0x7f62301341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49864/0 (socket says 172.21.15.40:49864) 2023-09-30T22:29:48.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.280+0000 7f6236a78700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f623009df70 0x7f623013bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:48.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.280+0000 7f6236277700 1 -- 172.21.15.40:0/3723486373 learned_addr learned my addr 172.21.15.40:0/3723486373 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:48.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.280+0000 7f6235a76700 1 --1- 172.21.15.40:0/3723486373 >> v1:172.21.15.40:6789/0 conn(0x7f623009d400 0x7f623009d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40352/0 (socket says 172.21.15.40:40352) 2023-09-30T22:29:48.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.280+0000 7f6236277700 1 -- 172.21.15.40:0/3723486373 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f623009df70 msgr2=0x7f623013bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:48.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.280+0000 7f6236277700 1 --2- 172.21.15.40:0/3723486373 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f623009df70 0x7f623013bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.280+0000 7f6236277700 1 -- 172.21.15.40:0/3723486373 >> v1:172.21.15.40:6789/0 conn(0x7f623009d400 legacy=0x7f623009d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.280+0000 7f6236277700 1 -- 172.21.15.40:0/3723486373 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6230133be0 con 0x7f6230133e00 2023-09-30T22:29:48.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.280+0000 7f6236277700 1 --2- 172.21.15.40:0/3723486373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6230133e00 0x7f62301341d0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f622c0098f0 tx=0x7f622c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43858248d6440e50 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:48.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.281+0000 7f6235275700 1 -- 172.21.15.40:0/3723486373 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622c011830 con 0x7f6230133e00 2023-09-30T22:29:48.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.281+0000 7f6235275700 1 -- 172.21.15.40:0/3723486373 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f622c011990 con 0x7f6230133e00 2023-09-30T22:29:48.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.281+0000 7f6235275700 1 -- 172.21.15.40:0/3723486373 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622c011d20 con 0x7f6230133e00 2023-09-30T22:29:48.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.281+0000 7f62384db700 1 -- 172.21.15.40:0/3723486373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6230133e00 msgr2=0x7f62301341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.281+0000 7f62384db700 1 --2- 172.21.15.40:0/3723486373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6230133e00 0x7f62301341d0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f622c0098f0 tx=0x7f622c009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:48.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.281+0000 7f62384db700 1 -- 172.21.15.40:0/3723486373 shutdown_connections 2023-09-30T22:29:48.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.281+0000 7f62384db700 1 --2- 172.21.15.40:0/3723486373 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f623009df70 0x7f623013bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.281+0000 7f62384db700 1 --2- 172.21.15.40:0/3723486373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6230133e00 0x7f62301341d0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.281+0000 7f62384db700 1 -- 172.21.15.40:0/3723486373 >> 172.21.15.40:0/3723486373 conn(0x7f62300a2a00 msgr2=0x7f62300a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:48.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.281+0000 7f62384db700 1 -- 172.21.15.40:0/3723486373 shutdown_connections 2023-09-30T22:29:48.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.282+0000 7f62384db700 1 -- 172.21.15.40:0/3723486373 wait complete. 2023-09-30T22:29:48.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.282+0000 7f62384db700 1 Processor -- start 2023-09-30T22:29:48.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.282+0000 7f62384db700 1 -- start start 2023-09-30T22:29:48.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.283+0000 7f62384db700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f623009d400 0x7f6230119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.283+0000 7f62384db700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f623009df70 0x7f6230119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.283+0000 7f62384db700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6230133e00 0x7f6230119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:48.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.283+0000 7f62384db700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623011ccc0 con 0x7f623009d400 2023-09-30T22:29:48.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.283+0000 7f62384db700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f623011a3f0 con 0x7f623009df70 2023-09-30T22:29:48.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.283+0000 7f62384db700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f623011b640 con 0x7f6230133e00 2023-09-30T22:29:48.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.283+0000 7f6236277700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f623009d400 0x7f6230119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:48.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.283+0000 7f6236277700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f623009d400 0x7f6230119050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49870/0 (socket says 172.21.15.40:49870) 2023-09-30T22:29:48.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.283+0000 7f6236277700 1 -- 172.21.15.40:0/532193971 learned_addr learned my addr 172.21.15.40:0/532193971 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:48.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.283+0000 7f6235a76700 1 --2- 172.21.15.40:0/532193971 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f623009df70 0x7f6230119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:48.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.283+0000 7f6236a78700 1 --2- 172.21.15.40:0/532193971 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6230133e00 0x7f6230119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:48.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.283+0000 7f6236277700 1 -- 172.21.15.40:0/532193971 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6230133e00 msgr2=0x7f6230119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.283+0000 7f6236277700 1 --2- 172.21.15.40:0/532193971 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6230133e00 0x7f6230119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.283+0000 7f6236277700 1 -- 172.21.15.40:0/532193971 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f623009df70 msgr2=0x7f6230119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.283+0000 7f6236277700 1 --2- 172.21.15.40:0/532193971 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f623009df70 0x7f6230119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.283+0000 7f6236277700 1 -- 172.21.15.40:0/532193971 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622c009550 con 0x7f623009d400 2023-09-30T22:29:48.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.284+0000 7f6236277700 1 --2- 172.21.15.40:0/532193971 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f623009d400 0x7f6230119050 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f622c009c40 tx=0x7f622c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:48.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.284+0000 7f6226ffd700 1 -- 172.21.15.40:0/532193971 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622c004450 con 0x7f623009d400 2023-09-30T22:29:48.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.284+0000 7f6226ffd700 1 -- 172.21.15.40:0/532193971 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f622c0045b0 con 0x7f623009d400 2023-09-30T22:29:48.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.284+0000 7f6226ffd700 1 -- 172.21.15.40:0/532193971 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622c022510 con 0x7f623009d400 2023-09-30T22:29:48.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.284+0000 7f62384db700 1 -- 172.21.15.40:0/532193971 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f623011a9e0 con 0x7f623009d400 2023-09-30T22:29:48.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.284+0000 7f62384db700 1 -- 172.21.15.40:0/532193971 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f623012e1a0 con 0x7f623009d400 2023-09-30T22:29:48.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.285+0000 7f6226ffd700 1 -- 172.21.15.40:0/532193971 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f622c022670 con 0x7f623009d400 2023-09-30T22:29:48.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.285+0000 7f6226ffd700 1 -- 172.21.15.40:0/532193971 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f622c051ae0 con 0x7f623009d400 2023-09-30T22:29:48.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.285+0000 7f62384db700 1 -- 172.21.15.40:0/532193971 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6230062380 con 0x7f623009d400 2023-09-30T22:29:48.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.290+0000 7f6226ffd700 1 -- 172.21.15.40:0/532193971 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f622c015080 con 0x7f623009d400 2023-09-30T22:29:48.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.450+0000 7ff0b41a7700 1 -- 172.21.15.40:0/1992525053 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff0ac062380 con 0x7ff0ac13b130 2023-09-30T22:29:48.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.450+0000 7ff0a27fc700 1 -- 172.21.15.40:0/1992525053 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff0a8015070 con 0x7ff0ac13b130 2023-09-30T22:29:48.452 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:48.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.452+0000 7ff0b41a7700 1 -- 172.21.15.40:0/1992525053 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff0ac13b130 msgr2=0x7ff0ac06fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.452+0000 7ff0b41a7700 1 --2- 172.21.15.40:0/1992525053 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff0ac13b130 0x7ff0ac06fc50 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ff0a800b480 tx=0x7ff0a800b790 comp rx=0 tx=0).stop 2023-09-30T22:29:48.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.453+0000 7ff0b41a7700 1 -- 172.21.15.40:0/1992525053 shutdown_connections 2023-09-30T22:29:48.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.453+0000 7ff0b41a7700 1 --2- 172.21.15.40:0/1992525053 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff0ac13da50 0x7ff0ac070190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.453+0000 7ff0b41a7700 1 --2- 172.21.15.40:0/1992525053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0ac138250 0x7ff0ac06f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.453+0000 7ff0b41a7700 1 --2- 172.21.15.40:0/1992525053 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff0ac13b130 0x7ff0ac06fc50 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.453+0000 7ff0b41a7700 1 -- 172.21.15.40:0/1992525053 >> 172.21.15.40:0/1992525053 conn(0x7ff0ac0a2a00 msgr2=0x7ff0ac09d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:48.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.453+0000 7ff0b41a7700 1 -- 172.21.15.40:0/1992525053 shutdown_connections 2023-09-30T22:29:48.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.453+0000 7ff0b41a7700 1 -- 172.21.15.40:0/1992525053 wait complete. 2023-09-30T22:29:48.466 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:48.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.477+0000 7f8ae4e64700 1 -- 172.21.15.40:0/2407310060 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8ae0094db0 con 0x7f8ae009fbb0 2023-09-30T22:29:48.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.478+0000 7f8aceffd700 1 -- 172.21.15.40:0/2407310060 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ad8018020 con 0x7f8ae009fbb0 2023-09-30T22:29:48.479 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:48.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.479+0000 7fb57d37c700 1 -- 172.21.15.40:0/1183276729 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb578074620 con 0x7fb57806f070 2023-09-30T22:29:48.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.479+0000 7fb55f7fe700 1 -- 172.21.15.40:0/1183276729 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb568015020 con 0x7fb57806f070 2023-09-30T22:29:48.480 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:48.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.480+0000 7f8ae4e64700 1 -- 172.21.15.40:0/2407310060 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ae009fbb0 msgr2=0x7f8ae01c8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.480+0000 7f8ae4e64700 1 --2- 172.21.15.40:0/2407310060 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ae009fbb0 0x7f8ae01c8520 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f8ad800efc0 tx=0x7f8ad800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.480+0000 7f8ae4e64700 1 -- 172.21.15.40:0/2407310060 shutdown_connections 2023-09-30T22:29:48.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.480+0000 7f8ae4e64700 1 --2- 172.21.15.40:0/2407310060 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ae006ced0 0x7f8ae0096060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.480+0000 7f8ae4e64700 1 --2- 172.21.15.40:0/2407310060 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ae009fbb0 0x7f8ae01c8520 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.480+0000 7f8ae4e64700 1 --2- 172.21.15.40:0/2407310060 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ae006d2c0 0x7f8ae00965a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.480+0000 7f8ae4e64700 1 -- 172.21.15.40:0/2407310060 >> 172.21.15.40:0/2407310060 conn(0x7f8ae00a41a0 msgr2=0x7f8ae00a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:48.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.481+0000 7f8ae4e64700 1 -- 172.21.15.40:0/2407310060 shutdown_connections 2023-09-30T22:29:48.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.481+0000 7f8ae4e64700 1 -- 172.21.15.40:0/2407310060 wait complete. 2023-09-30T22:29:48.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.481+0000 7fb57d37c700 1 -- 172.21.15.40:0/1183276729 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb57806f070 msgr2=0x7fb57806c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.481+0000 7fb57d37c700 1 --2- 172.21.15.40:0/1183276729 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb57806f070 0x7fb57806c990 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fb56800b530 tx=0x7fb56800b840 comp rx=0 tx=0).stop 2023-09-30T22:29:48.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.482+0000 7fb57d37c700 1 -- 172.21.15.40:0/1183276729 shutdown_connections 2023-09-30T22:29:48.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.482+0000 7fb57d37c700 1 --2- 172.21.15.40:0/1183276729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb57806fdb0 0x7fb57806d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.482+0000 7fb57d37c700 1 --2- 172.21.15.40:0/1183276729 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb57806f070 0x7fb57806c990 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.482+0000 7fb57d37c700 1 --2- 172.21.15.40:0/1183276729 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb57806f980 0x7fb57806ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.482+0000 7fb57d37c700 1 -- 172.21.15.40:0/1183276729 >> 172.21.15.40:0/1183276729 conn(0x7fb5780a41a0 msgr2=0x7fb578129ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:48.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.482+0000 7fb57d37c700 1 -- 172.21.15.40:0/1183276729 shutdown_connections 2023-09-30T22:29:48.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.482+0000 7fb57d37c700 1 -- 172.21.15.40:0/1183276729 wait complete. 2023-09-30T22:29:48.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:48.500 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:48.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.516+0000 7f62384db700 1 -- 172.21.15.40:0/532193971 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6230074330 con 0x7f623009d400 2023-09-30T22:29:48.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.516+0000 7f6226ffd700 1 -- 172.21.15.40:0/532193971 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f622c0036a0 con 0x7f623009d400 2023-09-30T22:29:48.518 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:48.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.518+0000 7f62384db700 1 -- 172.21.15.40:0/532193971 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f623009d400 msgr2=0x7f6230119050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:48.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.518+0000 7f62384db700 1 --2- 172.21.15.40:0/532193971 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f623009d400 0x7f6230119050 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f622c009c40 tx=0x7f622c004750 comp rx=0 tx=0).stop 2023-09-30T22:29:48.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.518+0000 7f62384db700 1 -- 172.21.15.40:0/532193971 shutdown_connections 2023-09-30T22:29:48.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.518+0000 7f62384db700 1 --2- 172.21.15.40:0/532193971 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6230133e00 0x7f6230119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.518+0000 7f62384db700 1 --2- 172.21.15.40:0/532193971 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f623009d400 0x7f6230119050 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.518+0000 7f62384db700 1 --2- 172.21.15.40:0/532193971 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f623009df70 0x7f6230119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:48.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.518+0000 7f62384db700 1 -- 172.21.15.40:0/532193971 >> 172.21.15.40:0/532193971 conn(0x7f62300a2a00 msgr2=0x7f623012d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:48.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.518+0000 7f62384db700 1 -- 172.21.15.40:0/532193971 shutdown_connections 2023-09-30T22:29:48.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:48.518+0000 7f62384db700 1 -- 172.21.15.40:0/532193971 wait complete. 2023-09-30T22:29:48.531 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:49.467 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:49.497 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:49.501 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:49.533 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:49.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.622+0000 7fa4c2043700 1 Processor -- start 2023-09-30T22:29:49.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.622+0000 7fa4c2043700 1 -- start start 2023-09-30T22:29:49.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.622+0000 7fa4c2043700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa4bc0956e0 0x7fa4bc135040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.622+0000 7fa4c2043700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4bc1387f0 0x7fa4bc13ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.623+0000 7fa4c2043700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4bc09e230 con 0x7fa4bc137c60 2023-09-30T22:29:49.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.623+0000 7fa4c2043700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4bc1346f0 con 0x7fa4bc0956e0 2023-09-30T22:29:49.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.623+0000 7fa4c2043700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc094ee0 con 0x7fa4bc1387f0 2023-09-30T22:29:49.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.623+0000 7fa4bb7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa4bc0956e0 0x7fa4bc135040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.623+0000 7fa4bb7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa4bc0956e0 0x7fa4bc135040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49884/0 (socket says 172.21.15.40:49884) 2023-09-30T22:29:49.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.623+0000 7fa4bb7fe700 1 -- 172.21.15.40:0/712386451 learned_addr learned my addr 172.21.15.40:0/712386451 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:49.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.623+0000 7fa4bbfff700 1 --2- 172.21.15.40:0/712386451 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4bc1387f0 0x7fa4bc13ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.623+0000 7fa4bb7fe700 1 -- 172.21.15.40:0/712386451 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4bc1387f0 msgr2=0x7fa4bc13ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:49.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.623+0000 7fa4bb7fe700 1 --2- 172.21.15.40:0/712386451 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4bc1387f0 0x7fa4bc13ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.623+0000 7fa4bb7fe700 1 -- 172.21.15.40:0/712386451 >> v1:172.21.15.40:6789/0 conn(0x7fa4bc137c60 legacy=0x7fa4bc1380e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:49.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.623+0000 7fa4bb7fe700 1 -- 172.21.15.40:0/712386451 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc095ea0 con 0x7fa4bc0956e0 2023-09-30T22:29:49.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.624+0000 7fa4bb7fe700 1 --2- 172.21.15.40:0/712386451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4bc0956e0 0x7fa4bc135040 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac0098f0 tx=0x7fa4ac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2abac375ec02913d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:49.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.624+0000 7fa4ba7fc700 1 -- 172.21.15.40:0/712386451 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac011830 con 0x7fa4bc0956e0 2023-09-30T22:29:49.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.624+0000 7fa4ba7fc700 1 -- 172.21.15.40:0/712386451 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4ac011990 con 0x7fa4bc0956e0 2023-09-30T22:29:49.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.624+0000 7fa4ba7fc700 1 -- 172.21.15.40:0/712386451 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac011d20 con 0x7fa4bc0956e0 2023-09-30T22:29:49.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.625+0000 7fa4c2043700 1 -- 172.21.15.40:0/712386451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4bc0956e0 msgr2=0x7fa4bc135040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:49.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.625+0000 7fa4c2043700 1 --2- 172.21.15.40:0/712386451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4bc0956e0 0x7fa4bc135040 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac0098f0 tx=0x7fa4ac009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:49.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.625+0000 7fa4c2043700 1 -- 172.21.15.40:0/712386451 shutdown_connections 2023-09-30T22:29:49.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.625+0000 7fa4c2043700 1 --2- 172.21.15.40:0/712386451 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4bc1387f0 0x7fa4bc13ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.625+0000 7fa4c2043700 1 --2- 172.21.15.40:0/712386451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4bc0956e0 0x7fa4bc135040 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.625+0000 7fa4c2043700 1 -- 172.21.15.40:0/712386451 >> 172.21.15.40:0/712386451 conn(0x7fa4bc0a2ff0 msgr2=0x7fa4bc09ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:49.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.625+0000 7fa4c2043700 1 -- 172.21.15.40:0/712386451 shutdown_connections 2023-09-30T22:29:49.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.625+0000 7fa4c2043700 1 -- 172.21.15.40:0/712386451 wait complete. 2023-09-30T22:29:49.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.626+0000 7fa4c2043700 1 Processor -- start 2023-09-30T22:29:49.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.626+0000 7fa4c2043700 1 -- start start 2023-09-30T22:29:49.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.626+0000 7fa4c2043700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4bc0956e0 0x7fa4bc06f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.626+0000 7fa4c2043700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4bc137c60 0x7fa4bc132890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.626+0000 7fa4c2043700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4bc1387f0 0x7fa4bc132dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.626+0000 7fa4c2043700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc070250 con 0x7fa4bc137c60 2023-09-30T22:29:49.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.626+0000 7fa4c2043700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc135b60 con 0x7fa4bc1387f0 2023-09-30T22:29:49.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.626+0000 7fa4c2043700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc071e80 con 0x7fa4bc0956e0 2023-09-30T22:29:49.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.626+0000 7fa4baffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4bc137c60 0x7fa4bc132890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.627+0000 7fa4baffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4bc137c60 0x7fa4bc132890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49898/0 (socket says 172.21.15.40:49898) 2023-09-30T22:29:49.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.627+0000 7fa4baffd700 1 -- 172.21.15.40:0/3223698133 learned_addr learned my addr 172.21.15.40:0/3223698133 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:49.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.627+0000 7fa4bb7fe700 1 --2- 172.21.15.40:0/3223698133 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4bc0956e0 0x7fa4bc06f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.627+0000 7fa4bbfff700 1 --2- 172.21.15.40:0/3223698133 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4bc1387f0 0x7fa4bc132dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.627+0000 7fa4baffd700 1 -- 172.21.15.40:0/3223698133 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4bc0956e0 msgr2=0x7fa4bc06f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:49.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.627+0000 7fa4baffd700 1 --2- 172.21.15.40:0/3223698133 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4bc0956e0 0x7fa4bc06f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.627+0000 7fa4baffd700 1 -- 172.21.15.40:0/3223698133 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4bc1387f0 msgr2=0x7fa4bc132dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:49.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.627+0000 7fa4baffd700 1 --2- 172.21.15.40:0/3223698133 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4bc1387f0 0x7fa4bc132dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.627+0000 7fa4baffd700 1 -- 172.21.15.40:0/3223698133 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ac009550 con 0x7fa4bc137c60 2023-09-30T22:29:49.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.627+0000 7fa4bb7fe700 1 --2- 172.21.15.40:0/3223698133 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4bc0956e0 0x7fa4bc06f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:49.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.627+0000 7fa4bbfff700 1 --2- 172.21.15.40:0/3223698133 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4bc1387f0 0x7fa4bc132dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:49.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.627+0000 7fa4baffd700 1 --2- 172.21.15.40:0/3223698133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4bc137c60 0x7fa4bc132890 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fa4b000c450 tx=0x7fa4b000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:49.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.627+0000 7fa4a3fff700 1 -- 172.21.15.40:0/3223698133 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b00052d0 con 0x7fa4bc137c60 2023-09-30T22:29:49.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.628+0000 7fa4a3fff700 1 -- 172.21.15.40:0/3223698133 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b0005430 con 0x7fa4bc137c60 2023-09-30T22:29:49.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.628+0000 7fa4c2043700 1 -- 172.21.15.40:0/3223698133 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4bc09e880 con 0x7fa4bc137c60 2023-09-30T22:29:49.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.628+0000 7fa4a3fff700 1 -- 172.21.15.40:0/3223698133 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b00038c0 con 0x7fa4bc137c60 2023-09-30T22:29:49.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.628+0000 7fa4c2043700 1 -- 172.21.15.40:0/3223698133 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4bc071bc0 con 0x7fa4bc137c60 2023-09-30T22:29:49.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.628+0000 7fa4a3fff700 1 -- 172.21.15.40:0/3223698133 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa4b0003a20 con 0x7fa4bc137c60 2023-09-30T22:29:49.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.629+0000 7fa4a3fff700 1 -- 172.21.15.40:0/3223698133 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa4b003ec50 con 0x7fa4bc137c60 2023-09-30T22:29:49.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.629+0000 7fa4c2043700 1 -- 172.21.15.40:0/3223698133 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4bc062380 con 0x7fa4bc137c60 2023-09-30T22:29:49.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.634+0000 7fa4a3fff700 1 -- 172.21.15.40:0/3223698133 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa4b0017080 con 0x7fa4bc137c60 2023-09-30T22:29:49.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.652+0000 7fe7d4876700 1 Processor -- start 2023-09-30T22:29:49.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.652+0000 7fe7d4876700 1 -- start start 2023-09-30T22:29:49.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.652+0000 7f30ce458700 1 Processor -- start 2023-09-30T22:29:49.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.652+0000 7f30ce458700 1 -- start start 2023-09-30T22:29:49.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.653+0000 7fe7d4876700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7d009d450 0x7fe7d009d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.653+0000 7fe7d4876700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe7d01308d0 0x7fe7d0138420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.653+0000 7fe7d4876700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7d009e8b0 con 0x7fe7d009dd60 2023-09-30T22:29:49.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.653+0000 7fe7d4876700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d009c3b0 con 0x7fe7d009d450 2023-09-30T22:29:49.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.653+0000 7fe7d4876700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d009a6b0 con 0x7fe7d01308d0 2023-09-30T22:29:49.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.653+0000 7f30ce458700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f30c809c890 0x7f30c809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.653+0000 7f30ce458700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f30c809e480 0x7f30c813bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.653+0000 7f30ce458700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c80a2600 con 0x7f30c809d920 2023-09-30T22:29:49.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.653+0000 7f30ce458700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c80a29d0 con 0x7f30c809c890 2023-09-30T22:29:49.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.653+0000 7f30ce458700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30c809fb40 con 0x7f30c809e480 2023-09-30T22:29:49.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.653+0000 7f30c77fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f30c809d920 0x7f30c809dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40372/0 (socket says 172.21.15.40:40372) 2023-09-30T22:29:49.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.653+0000 7f30c7fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f30c809c890 0x7f30c809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.653+0000 7f30c77fe700 1 -- 172.21.15.40:0/2943072659 learned_addr learned my addr 172.21.15.40:0/2943072659 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:29:49.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.653+0000 7f30cc9f5700 1 --2- 172.21.15.40:0/2943072659 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f30c809e480 0x7f30c813bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.653+0000 7f30c6ffd700 1 -- 172.21.15.40:0/2943072659 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1328392960 0 0) 0x7f30c80a2600 con 0x7f30c809d920 2023-09-30T22:29:49.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.654+0000 7f30cc9f5700 1 -- 172.21.15.40:0/2943072659 >> v2:172.21.15.40:3300/0 conn(0x7f30c809c890 msgr2=0x7f30c809cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:49.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.654+0000 7f30cc9f5700 1 --2- 172.21.15.40:0/2943072659 >> v2:172.21.15.40:3300/0 conn(0x7f30c809c890 0x7f30c809cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.654+0000 7f30cc9f5700 1 -- 172.21.15.40:0/2943072659 >> v1:172.21.15.40:6789/0 conn(0x7f30c809d920 legacy=0x7f30c809dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:49.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.654+0000 7f30cc9f5700 1 -- 172.21.15.40:0/2943072659 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c809fed0 con 0x7f30c809e480 2023-09-30T22:29:49.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.653+0000 7fe7c7fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe7d009dd60 0x7fe7d01301c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40370/0 (socket says 172.21.15.40:40370) 2023-09-30T22:29:49.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.653+0000 7fe7c7fff700 1 -- 172.21.15.40:0/1329191491 learned_addr learned my addr 172.21.15.40:0/1329191491 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:29:49.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.654+0000 7f30cc9f5700 1 --2- 172.21.15.40:0/2943072659 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f30c809e480 0x7f30c813bc20 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f30c0009d90 tx=0x7f30c000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d32c87ab544f632d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:49.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.654+0000 7fe7cdd9b700 1 -- 172.21.15.40:0/1329191491 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 225351930 0 0) 0x7fe7d009e8b0 con 0x7fe7d009dd60 2023-09-30T22:29:49.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.654+0000 7fe7cdd9b700 1 -- 172.21.15.40:0/1329191491 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7bc0035b0 con 0x7fe7d009dd60 2023-09-30T22:29:49.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.654+0000 7f30c6ffd700 1 -- 172.21.15.40:0/2943072659 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c000e070 con 0x7f30c809e480 2023-09-30T22:29:49.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.654+0000 7f30c6ffd700 1 -- 172.21.15.40:0/2943072659 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c000bb20 con 0x7f30c809e480 2023-09-30T22:29:49.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.654+0000 7f30c6ffd700 1 -- 172.21.15.40:0/2943072659 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c0012430 con 0x7f30c809e480 2023-09-30T22:29:49.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.654+0000 7fe7cdd9b700 1 -- 172.21.15.40:0/1329191491 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3192281227 0 0) 0x7fe7bc0035b0 con 0x7fe7d009dd60 2023-09-30T22:29:49.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.654+0000 7fe7cdd9b700 1 -- 172.21.15.40:0/1329191491 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe7d01308d0 msgr2=0x7fe7d0138420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:49.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.654+0000 7fe7cdd9b700 1 --2- 172.21.15.40:0/1329191491 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe7d01308d0 0x7fe7d0138420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.654+0000 7fe7cdd9b700 1 -- 172.21.15.40:0/1329191491 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7d009d450 msgr2=0x7fe7d009d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:49.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.654+0000 7fe7cdd9b700 1 --2- 172.21.15.40:0/1329191491 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7d009d450 0x7fe7d009d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.654+0000 7fe7cdd9b700 1 -- 172.21.15.40:0/1329191491 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d009b4f0 con 0x7fe7d009dd60 2023-09-30T22:29:49.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.654+0000 7fe7cdd9b700 1 -- 172.21.15.40:0/1329191491 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4231795173 0 0) 0x7fe7b8001670 con 0x7fe7d009dd60 2023-09-30T22:29:49.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.654+0000 7fe7cdd9b700 1 -- 172.21.15.40:0/1329191491 >> v1:172.21.15.40:6789/0 conn(0x7fe7d009dd60 legacy=0x7fe7d01301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:49.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.654+0000 7fe7cdd9b700 1 --2- 172.21.15.40:0/1329191491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7bc003a00 0x7fe7bc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.654+0000 7fe7cdd9b700 1 --2- 172.21.15.40:0/1329191491 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7d009d450 0x7fe7bc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.654+0000 7fe7cdd9b700 1 --2- 172.21.15.40:0/1329191491 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe7d01308d0 0x7fe7bc004f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.654+0000 7fe7cdd9b700 1 -- 172.21.15.40:0/1329191491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d009c3b0 con 0x7fe7bc003a00 2023-09-30T22:29:49.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.654+0000 7fe7cdd9b700 1 -- 172.21.15.40:0/1329191491 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d009a6b0 con 0x7fe7d009d450 2023-09-30T22:29:49.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.654+0000 7fe7cdd9b700 1 -- 172.21.15.40:0/1329191491 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc005660 con 0x7fe7d01308d0 2023-09-30T22:29:49.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.654+0000 7fe7c7fff700 1 --2- 172.21.15.40:0/1329191491 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7d009d450 0x7fe7bc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.654+0000 7fe7ced9d700 1 --2- 172.21.15.40:0/1329191491 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe7d01308d0 0x7fe7bc004f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.655+0000 7fe7ce59c700 1 --2- 172.21.15.40:0/1329191491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7bc003a00 0x7fe7bc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.655+0000 7fe7ced9d700 1 -- 172.21.15.40:0/1329191491 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7d009d450 msgr2=0x7fe7bc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:49.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.655+0000 7fe7ced9d700 1 --2- 172.21.15.40:0/1329191491 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7d009d450 0x7fe7bc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.655+0000 7fe7ced9d700 1 -- 172.21.15.40:0/1329191491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7bc003a00 msgr2=0x7fe7bc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:49.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.655+0000 7fe7ced9d700 1 --2- 172.21.15.40:0/1329191491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7bc003a00 0x7fe7bc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.655+0000 7fe7ced9d700 1 -- 172.21.15.40:0/1329191491 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7bc0035b0 con 0x7fe7d01308d0 2023-09-30T22:29:49.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.655+0000 7f30ce458700 1 -- 172.21.15.40:0/2943072659 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f30c809e480 msgr2=0x7f30c813bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:49.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.655+0000 7f30ce458700 1 --2- 172.21.15.40:0/2943072659 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f30c809e480 0x7f30c813bc20 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f30c0009d90 tx=0x7f30c000b330 comp rx=0 tx=0).stop 2023-09-30T22:29:49.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.655+0000 7fe7ced9d700 1 --2- 172.21.15.40:0/1329191491 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe7d01308d0 0x7fe7bc004f10 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8009e40 tx=0x7fe7bc005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1f5d762de4b016a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:49.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.655+0000 7f30ce458700 1 -- 172.21.15.40:0/2943072659 shutdown_connections 2023-09-30T22:29:49.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.655+0000 7f30ce458700 1 --2- 172.21.15.40:0/2943072659 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f30c809e480 0x7f30c813bc20 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.655+0000 7f30ce458700 1 --2- 172.21.15.40:0/2943072659 >> v2:172.21.15.40:3300/0 conn(0x7f30c809c890 0x7f30c809cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.655+0000 7f30ce458700 1 -- 172.21.15.40:0/2943072659 >> 172.21.15.40:0/2943072659 conn(0x7f30c80a7080 msgr2=0x7f30c80a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:49.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.655+0000 7f30ce458700 1 -- 172.21.15.40:0/2943072659 shutdown_connections 2023-09-30T22:29:49.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.655+0000 7fe7cdd9b700 1 -- 172.21.15.40:0/1329191491 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c80098b0 con 0x7fe7d01308d0 2023-09-30T22:29:49.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.655+0000 7f30ce458700 1 -- 172.21.15.40:0/2943072659 wait complete. 2023-09-30T22:29:49.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.655+0000 7fe7cdd9b700 1 -- 172.21.15.40:0/1329191491 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c800baa0 con 0x7fe7d01308d0 2023-09-30T22:29:49.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.655+0000 7fe7cdd9b700 1 -- 172.21.15.40:0/1329191491 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c800be50 con 0x7fe7d01308d0 2023-09-30T22:29:49.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.656+0000 7fe7d4876700 1 -- 172.21.15.40:0/1329191491 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe7d01308d0 msgr2=0x7fe7bc004f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:49.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.656+0000 7fe7d4876700 1 --2- 172.21.15.40:0/1329191491 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe7d01308d0 0x7fe7bc004f10 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8009e40 tx=0x7fe7bc005880 comp rx=0 tx=0).stop 2023-09-30T22:29:49.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.656+0000 7fe7d4876700 1 -- 172.21.15.40:0/1329191491 shutdown_connections 2023-09-30T22:29:49.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.656+0000 7fe7d4876700 1 --2- 172.21.15.40:0/1329191491 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe7d01308d0 0x7fe7bc004f10 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.656+0000 7fe7d4876700 1 --2- 172.21.15.40:0/1329191491 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7d009d450 0x7fe7bc004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.656+0000 7fe7d4876700 1 --2- 172.21.15.40:0/1329191491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7bc003a00 0x7fe7bc003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.656+0000 7fe7d4876700 1 -- 172.21.15.40:0/1329191491 >> 172.21.15.40:0/1329191491 conn(0x7fe7d00a2a00 msgr2=0x7fe7d00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:49.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.656+0000 7fe7d4876700 1 -- 172.21.15.40:0/1329191491 shutdown_connections 2023-09-30T22:29:49.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.656+0000 7f30ce458700 1 Processor -- start 2023-09-30T22:29:49.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.656+0000 7fe7d4876700 1 -- 172.21.15.40:0/1329191491 wait complete. 2023-09-30T22:29:49.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.656+0000 7f30ce458700 1 -- start start 2023-09-30T22:29:49.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.657+0000 7f30ce458700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30c809c890 0x7f30c808afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.657+0000 7f30ce458700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f30c809d920 0x7f30c808b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.657+0000 7f30ce458700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f30c809e480 0x7f30c808ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.657+0000 7f30ce458700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c808c3c0 con 0x7f30c809d920 2023-09-30T22:29:49.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.657+0000 7f30ce458700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c808c890 con 0x7f30c809c890 2023-09-30T22:29:49.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.657+0000 7f30ce458700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30c808e070 con 0x7f30c809e480 2023-09-30T22:29:49.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.657+0000 7f30c77fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f30c809d920 0x7f30c808b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.657+0000 7f30c77fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f30c809d920 0x7f30c808b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49942/0 (socket says 172.21.15.40:49942) 2023-09-30T22:29:49.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.657+0000 7f30c77fe700 1 -- 172.21.15.40:0/664316520 learned_addr learned my addr 172.21.15.40:0/664316520 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:49.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.658+0000 7f30c77fe700 1 -- 172.21.15.40:0/664316520 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f30c809e480 msgr2=0x7f30c808ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:49.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.658+0000 7f30c77fe700 1 --2- 172.21.15.40:0/664316520 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f30c809e480 0x7f30c808ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.658+0000 7f30c77fe700 1 -- 172.21.15.40:0/664316520 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30c809c890 msgr2=0x7f30c808afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:49.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.658+0000 7f30c77fe700 1 --2- 172.21.15.40:0/664316520 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30c809c890 0x7f30c808afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.658+0000 7f30c77fe700 1 -- 172.21.15.40:0/664316520 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c0009a70 con 0x7f30c809d920 2023-09-30T22:29:49.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.658+0000 7fe7d4876700 1 Processor -- start 2023-09-30T22:29:49.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.658+0000 7f30c77fe700 1 --2- 172.21.15.40:0/664316520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f30c809d920 0x7f30c808b510 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f30bc0011e0 tx=0x7f30bc00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:49.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.658+0000 7fe7d4876700 1 -- start start 2023-09-30T22:29:49.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.658+0000 7f30c4ff9700 1 -- 172.21.15.40:0/664316520 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc004c80 con 0x7f30c809d920 2023-09-30T22:29:49.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.658+0000 7f30c4ff9700 1 -- 172.21.15.40:0/664316520 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30bc004e00 con 0x7f30c809d920 2023-09-30T22:29:49.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.658+0000 7f30c4ff9700 1 -- 172.21.15.40:0/664316520 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc007310 con 0x7f30c809d920 2023-09-30T22:29:49.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.658+0000 7f30ce458700 1 -- 172.21.15.40:0/664316520 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c809bde0 con 0x7f30c809d920 2023-09-30T22:29:49.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.658+0000 7f30ce458700 1 -- 172.21.15.40:0/664316520 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c808dd60 con 0x7f30c809d920 2023-09-30T22:29:49.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.658+0000 7fe7d4876700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe7bc003a00 0x7fe7d012f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.658+0000 7fe7d4876700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7d009d450 0x7fe7d012fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.658+0000 7fe7d4876700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7d009dd60 0x7fe7d0138040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.658+0000 7fe7d4876700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d01393b0 con 0x7fe7d009d450 2023-09-30T22:29:49.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.658+0000 7fe7d4876700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d009c5d0 con 0x7fe7d009dd60 2023-09-30T22:29:49.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.658+0000 7fe7d4876700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d0136b50 con 0x7fe7bc003a00 2023-09-30T22:29:49.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.659+0000 7fe7ced9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7d009dd60 0x7fe7d0138040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.659+0000 7fe7ced9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7d009dd60 0x7fe7d0138040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:40500/0 (socket says 172.21.15.40:40500) 2023-09-30T22:29:49.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.659+0000 7fe7ced9d700 1 -- 172.21.15.40:0/81443324 learned_addr learned my addr 172.21.15.40:0/81443324 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:49.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.659+0000 7fe7ce59c700 1 --2- 172.21.15.40:0/81443324 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe7bc003a00 0x7fe7d012f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.659+0000 7fe7ced9d700 1 -- 172.21.15.40:0/81443324 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe7bc003a00 msgr2=0x7fe7d012f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:49.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.659+0000 7fe7ced9d700 1 --2- 172.21.15.40:0/81443324 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe7bc003a00 0x7fe7d012f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.659+0000 7fe7ced9d700 1 -- 172.21.15.40:0/81443324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7d009d450 msgr2=0x7fe7d012fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:49.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.659+0000 7fe7ced9d700 1 --2- 172.21.15.40:0/81443324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7d009d450 0x7fe7d012fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.659+0000 7fe7ced9d700 1 -- 172.21.15.40:0/81443324 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d0136ec0 con 0x7fe7d009dd60 2023-09-30T22:29:49.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.659+0000 7fe7ce59c700 1 --2- 172.21.15.40:0/81443324 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe7bc003a00 0x7fe7d012f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:49.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.659+0000 7f30c4ff9700 1 -- 172.21.15.40:0/664316520 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f30bc007470 con 0x7f30c809d920 2023-09-30T22:29:49.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.659+0000 7f30c4ff9700 1 -- 172.21.15.40:0/664316520 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f30bc013d60 con 0x7f30c809d920 2023-09-30T22:29:49.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.660+0000 7fe7ced9d700 1 --2- 172.21.15.40:0/81443324 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7d009dd60 0x7fe7d0138040 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8009fd0 tx=0x7fe7c8004be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:49.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.660+0000 7fe7c6ffd700 1 -- 172.21.15.40:0/81443324 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c8021680 con 0x7fe7d009dd60 2023-09-30T22:29:49.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.660+0000 7fe7c6ffd700 1 -- 172.21.15.40:0/81443324 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c8021820 con 0x7fe7d009dd60 2023-09-30T22:29:49.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.660+0000 7fe7c6ffd700 1 -- 172.21.15.40:0/81443324 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c8021bd0 con 0x7fe7d009dd60 2023-09-30T22:29:49.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.660+0000 7f30ce458700 1 -- 172.21.15.40:0/664316520 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30c808e270 con 0x7f30c809d920 2023-09-30T22:29:49.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.660+0000 7fe7d4876700 1 -- 172.21.15.40:0/81443324 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d0137460 con 0x7fe7d009dd60 2023-09-30T22:29:49.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.660+0000 7fe7d4876700 1 -- 172.21.15.40:0/81443324 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d01303c0 con 0x7fe7d009dd60 2023-09-30T22:29:49.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.661+0000 7fe7c6ffd700 1 -- 172.21.15.40:0/81443324 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe7c8021d30 con 0x7fe7d009dd60 2023-09-30T22:29:49.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.661+0000 7fe7c6ffd700 1 -- 172.21.15.40:0/81443324 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe7c8011070 con 0x7fe7d009dd60 2023-09-30T22:29:49.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.664+0000 7fe7d4876700 1 -- 172.21.15.40:0/81443324 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d01370e0 con 0x7fe7d009dd60 2023-09-30T22:29:49.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.666+0000 7f30c4ff9700 1 -- 172.21.15.40:0/664316520 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f30c808e270 con 0x7f30c809d920 2023-09-30T22:29:49.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.669+0000 7fe7c6ffd700 1 -- 172.21.15.40:0/81443324 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe7d01370e0 con 0x7fe7d009dd60 2023-09-30T22:29:49.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.716+0000 7f981deca700 1 Processor -- start 2023-09-30T22:29:49.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.716+0000 7f981deca700 1 -- start start 2023-09-30T22:29:49.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.717+0000 7f981deca700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f981809d920 0x7f981809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.717+0000 7f981deca700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f981809e230 0x7f98181343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.717+0000 7f981deca700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f981809f940 con 0x7f981809f0f0 2023-09-30T22:29:49.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.717+0000 7f981deca700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f981806b4c0 con 0x7f981809e230 2023-09-30T22:29:49.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.717+0000 7f981deca700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f981809a8f0 con 0x7f981809d920 2023-09-30T22:29:49.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.717+0000 7f98177fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f981809d920 0x7f981809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.717+0000 7f9817fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f981809e230 0x7f98181343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.717+0000 7f98177fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f981809d920 0x7f981809dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:38214/0 (socket says 172.21.15.40:38214) 2023-09-30T22:29:49.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.717+0000 7f98177fe700 1 -- 172.21.15.40:0/2968537248 learned_addr learned my addr 172.21.15.40:0/2968537248 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:49.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.717+0000 7f9817fff700 1 -- 172.21.15.40:0/2968537248 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f981809d920 msgr2=0x7f981809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:49.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.717+0000 7f9817fff700 1 --2- 172.21.15.40:0/2968537248 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f981809d920 0x7f981809dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.717+0000 7f9817fff700 1 -- 172.21.15.40:0/2968537248 >> v1:172.21.15.40:6789/0 conn(0x7f981809f0f0 legacy=0x7f9818133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:49.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.717+0000 7f9817fff700 1 -- 172.21.15.40:0/2968537248 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981809f6e0 con 0x7f981809e230 2023-09-30T22:29:49.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.717+0000 7f9817fff700 1 --2- 172.21.15.40:0/2968537248 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f981809e230 0x7f98181343b0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9810009dc0 tx=0x7f981000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93a20a9c18474812 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:49.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.718+0000 7f98167fc700 1 -- 172.21.15.40:0/2968537248 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981000e070 con 0x7f981809e230 2023-09-30T22:29:49.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.718+0000 7f98167fc700 1 -- 172.21.15.40:0/2968537248 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981000bb20 con 0x7f981809e230 2023-09-30T22:29:49.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.718+0000 7f98167fc700 1 -- 172.21.15.40:0/2968537248 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9810012430 con 0x7f981809e230 2023-09-30T22:29:49.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.718+0000 7f981deca700 1 -- 172.21.15.40:0/2968537248 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f981809e230 msgr2=0x7f98181343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:49.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.718+0000 7f981deca700 1 --2- 172.21.15.40:0/2968537248 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f981809e230 0x7f98181343b0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9810009dc0 tx=0x7f981000b330 comp rx=0 tx=0).stop 2023-09-30T22:29:49.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.718+0000 7f981deca700 1 -- 172.21.15.40:0/2968537248 shutdown_connections 2023-09-30T22:29:49.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.718+0000 7f981deca700 1 --2- 172.21.15.40:0/2968537248 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f981809e230 0x7f98181343b0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.718+0000 7f981deca700 1 --2- 172.21.15.40:0/2968537248 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f981809d920 0x7f981809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.718+0000 7f981deca700 1 -- 172.21.15.40:0/2968537248 >> 172.21.15.40:0/2968537248 conn(0x7f981809fb20 msgr2=0x7f981809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:49.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.718+0000 7f981deca700 1 -- 172.21.15.40:0/2968537248 shutdown_connections 2023-09-30T22:29:49.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.718+0000 7f981deca700 1 -- 172.21.15.40:0/2968537248 wait complete. 2023-09-30T22:29:49.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.719+0000 7f981deca700 1 Processor -- start 2023-09-30T22:29:49.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.720+0000 7f981deca700 1 -- start start 2023-09-30T22:29:49.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.720+0000 7f981deca700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f981809d920 0x7f98181b94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.720+0000 7f981deca700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f981809e230 0x7f98181a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.720+0000 7f981deca700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f98181a6640 0x7f98181a6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:49.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.720+0000 7f981deca700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98181aa5e0 con 0x7f981809e230 2023-09-30T22:29:49.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.720+0000 7f981deca700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98181a9c20 con 0x7f981809d920 2023-09-30T22:29:49.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.720+0000 7f981deca700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98181a93b0 con 0x7f98181a6640 2023-09-30T22:29:49.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.720+0000 7f98177fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f981809d920 0x7f98181b94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.720+0000 7f98177fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f981809d920 0x7f98181b94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:40522/0 (socket says 172.21.15.40:40522) 2023-09-30T22:29:49.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.720+0000 7f98177fe700 1 -- 172.21.15.40:0/2239208696 learned_addr learned my addr 172.21.15.40:0/2239208696 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:49.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.720+0000 7f9817fff700 1 --2- 172.21.15.40:0/2239208696 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f98181a6640 0x7f98181a6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.720+0000 7f9816ffd700 1 --2- 172.21.15.40:0/2239208696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f981809e230 0x7f98181a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:49.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.720+0000 7f9817fff700 1 -- 172.21.15.40:0/2239208696 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f981809d920 msgr2=0x7f98181b94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:49.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.720+0000 7f9817fff700 1 --2- 172.21.15.40:0/2239208696 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f981809d920 0x7f98181b94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.721+0000 7f9817fff700 1 -- 172.21.15.40:0/2239208696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f981809e230 msgr2=0x7f98181a6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:49.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.721+0000 7f9817fff700 1 --2- 172.21.15.40:0/2239208696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f981809e230 0x7f98181a6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.721+0000 7f9817fff700 1 -- 172.21.15.40:0/2239208696 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9810009a70 con 0x7f98181a6640 2023-09-30T22:29:49.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.721+0000 7f9817fff700 1 --2- 172.21.15.40:0/2239208696 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f98181a6640 0x7f98181a6ac0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f9810016000 tx=0x7f9810004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:49.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.721+0000 7f97fffff700 1 -- 172.21.15.40:0/2239208696 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981001b810 con 0x7f98181a6640 2023-09-30T22:29:49.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.721+0000 7f981deca700 1 -- 172.21.15.40:0/2239208696 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98181a8f60 con 0x7f98181a6640 2023-09-30T22:29:49.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.721+0000 7f981deca700 1 -- 172.21.15.40:0/2239208696 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f981809c9e0 con 0x7f98181a6640 2023-09-30T22:29:49.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.721+0000 7f97fffff700 1 -- 172.21.15.40:0/2239208696 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9810020070 con 0x7f98181a6640 2023-09-30T22:29:49.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.721+0000 7f97fffff700 1 -- 172.21.15.40:0/2239208696 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981001bb70 con 0x7f98181a6640 2023-09-30T22:29:49.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.722+0000 7f97fffff700 1 -- 172.21.15.40:0/2239208696 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f981001bcd0 con 0x7f98181a6640 2023-09-30T22:29:49.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.722+0000 7f97fffff700 1 -- 172.21.15.40:0/2239208696 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9810022070 con 0x7f98181a6640 2023-09-30T22:29:49.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.722+0000 7f981deca700 1 -- 172.21.15.40:0/2239208696 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98181a95e0 con 0x7f98181a6640 2023-09-30T22:29:49.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.728+0000 7f97fffff700 1 -- 172.21.15.40:0/2239208696 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f98181a95e0 con 0x7f98181a6640 2023-09-30T22:29:49.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.864+0000 7f30ce458700 1 -- 172.21.15.40:0/664316520 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f30c808e270 con 0x7f30c809d920 2023-09-30T22:29:49.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.865+0000 7f30c4ff9700 1 -- 172.21.15.40:0/664316520 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f30c808e270 con 0x7f30c809d920 2023-09-30T22:29:49.866 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:49.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.867+0000 7f30ce458700 1 -- 172.21.15.40:0/664316520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f30c809d920 msgr2=0x7f30c808b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:49.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.867+0000 7f30ce458700 1 --2- 172.21.15.40:0/664316520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f30c809d920 0x7f30c808b510 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f30bc0011e0 tx=0x7f30bc00cae0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.867+0000 7f30ce458700 1 -- 172.21.15.40:0/664316520 shutdown_connections 2023-09-30T22:29:49.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.867+0000 7f30ce458700 1 --2- 172.21.15.40:0/664316520 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f30c809e480 0x7f30c808ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.867+0000 7f30ce458700 1 --2- 172.21.15.40:0/664316520 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30c809c890 0x7f30c808afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.867+0000 7f30ce458700 1 --2- 172.21.15.40:0/664316520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f30c809d920 0x7f30c808b510 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.867+0000 7f30ce458700 1 -- 172.21.15.40:0/664316520 >> 172.21.15.40:0/664316520 conn(0x7f30c80a7080 msgr2=0x7f30c81bb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:49.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.867+0000 7f30ce458700 1 -- 172.21.15.40:0/664316520 shutdown_connections 2023-09-30T22:29:49.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.867+0000 7f30ce458700 1 -- 172.21.15.40:0/664316520 wait complete. 2023-09-30T22:29:49.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.871+0000 7fa4c2043700 1 -- 172.21.15.40:0/3223698133 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa4bc0991b0 con 0x7fa4bc137c60 2023-09-30T22:29:49.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.871+0000 7fa4a3fff700 1 -- 172.21.15.40:0/3223698133 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa4b0018260 con 0x7fa4bc137c60 2023-09-30T22:29:49.872 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:49.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.873+0000 7fa4c2043700 1 -- 172.21.15.40:0/3223698133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4bc137c60 msgr2=0x7fa4bc132890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:49.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.873+0000 7fa4c2043700 1 --2- 172.21.15.40:0/3223698133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4bc137c60 0x7fa4bc132890 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fa4b000c450 tx=0x7fa4b000c760 comp rx=0 tx=0).stop 2023-09-30T22:29:49.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.873+0000 7fa4c2043700 1 -- 172.21.15.40:0/3223698133 shutdown_connections 2023-09-30T22:29:49.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.873+0000 7fa4c2043700 1 --2- 172.21.15.40:0/3223698133 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4bc0956e0 0x7fa4bc06f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.873+0000 7fa4c2043700 1 --2- 172.21.15.40:0/3223698133 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4bc1387f0 0x7fa4bc132dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.873+0000 7fa4c2043700 1 --2- 172.21.15.40:0/3223698133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4bc137c60 0x7fa4bc132890 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.873+0000 7fa4c2043700 1 -- 172.21.15.40:0/3223698133 >> 172.21.15.40:0/3223698133 conn(0x7fa4bc0a2ff0 msgr2=0x7fa4bc09be00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:49.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.874+0000 7fa4c2043700 1 -- 172.21.15.40:0/3223698133 shutdown_connections 2023-09-30T22:29:49.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.874+0000 7fa4c2043700 1 -- 172.21.15.40:0/3223698133 wait complete. 2023-09-30T22:29:49.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:49.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.885+0000 7fe7d4876700 1 -- 172.21.15.40:0/81443324 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe7d01370e0 con 0x7fe7d009dd60 2023-09-30T22:29:49.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.885+0000 7fe7c6ffd700 1 -- 172.21.15.40:0/81443324 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe7d01370e0 con 0x7fe7d009dd60 2023-09-30T22:29:49.886 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:49.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.887+0000 7fe7d4876700 1 -- 172.21.15.40:0/81443324 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7d009dd60 msgr2=0x7fe7d0138040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:49.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.887+0000 7fe7d4876700 1 --2- 172.21.15.40:0/81443324 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7d009dd60 0x7fe7d0138040 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8009fd0 tx=0x7fe7c8004be0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.887+0000 7fe7d4876700 1 -- 172.21.15.40:0/81443324 shutdown_connections 2023-09-30T22:29:49.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.887+0000 7fe7d4876700 1 --2- 172.21.15.40:0/81443324 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe7bc003a00 0x7fe7d012f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.887+0000 7fe7d4876700 1 --2- 172.21.15.40:0/81443324 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7d009dd60 0x7fe7d0138040 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.887+0000 7fe7d4876700 1 --2- 172.21.15.40:0/81443324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7d009d450 0x7fe7d012fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.887+0000 7fe7d4876700 1 -- 172.21.15.40:0/81443324 >> 172.21.15.40:0/81443324 conn(0x7fe7d00a2a00 msgr2=0x7fe7d0139fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:49.889 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:49.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.888+0000 7fe7d4876700 1 -- 172.21.15.40:0/81443324 shutdown_connections 2023-09-30T22:29:49.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.888+0000 7fe7d4876700 1 -- 172.21.15.40:0/81443324 wait complete. 2023-09-30T22:29:49.901 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:49.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.941+0000 7f981deca700 1 -- 172.21.15.40:0/2239208696 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f98181a95e0 con 0x7f98181a6640 2023-09-30T22:29:49.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.941+0000 7f97fffff700 1 -- 172.21.15.40:0/2239208696 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f98181a95e0 con 0x7f98181a6640 2023-09-30T22:29:49.943 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:49.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.944+0000 7f981deca700 1 -- 172.21.15.40:0/2239208696 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f98181a6640 msgr2=0x7f98181a6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:49.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.944+0000 7f981deca700 1 --2- 172.21.15.40:0/2239208696 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f98181a6640 0x7f98181a6ac0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f9810016000 tx=0x7f9810004ad0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.944+0000 7f981deca700 1 -- 172.21.15.40:0/2239208696 shutdown_connections 2023-09-30T22:29:49.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.944+0000 7f981deca700 1 --2- 172.21.15.40:0/2239208696 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f98181a6640 0x7f98181a6ac0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.944+0000 7f981deca700 1 --2- 172.21.15.40:0/2239208696 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f981809d920 0x7f98181b94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.944+0000 7f981deca700 1 --2- 172.21.15.40:0/2239208696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f981809e230 0x7f98181a6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:49.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.944+0000 7f981deca700 1 -- 172.21.15.40:0/2239208696 >> 172.21.15.40:0/2239208696 conn(0x7f981809fb20 msgr2=0x7f98181bb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:49.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.944+0000 7f981deca700 1 -- 172.21.15.40:0/2239208696 shutdown_connections 2023-09-30T22:29:49.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:49.944+0000 7f981deca700 1 -- 172.21.15.40:0/2239208696 wait complete. 2023-09-30T22:29:49.957 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:50.882 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:50.890 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:50.901 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:50.958 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:51.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.035+0000 7f5543112700 1 Processor -- start 2023-09-30T22:29:51.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.035+0000 7f5543112700 1 -- start start 2023-09-30T22:29:51.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.035+0000 7f5543112700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f553c06b1b0 0x7f553c136af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.035+0000 7f5543112700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f553c137030 0x7f553c139410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.036+0000 7f5543112700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f553c09eb50 con 0x7f553c06a6d0 2023-09-30T22:29:51.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.036+0000 7f5543112700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f553c06b580 con 0x7f553c137030 2023-09-30T22:29:51.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.036+0000 7f5543112700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f553c09dde0 con 0x7f553c06b1b0 2023-09-30T22:29:51.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.036+0000 7f5540eae700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f553c06a6d0 0x7f553c06aaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40392/0 (socket says 172.21.15.40:40392) 2023-09-30T22:29:51.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.036+0000 7f5540eae700 1 -- 172.21.15.40:0/1302199031 learned_addr learned my addr 172.21.15.40:0/1302199031 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:29:51.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.036+0000 7f55416af700 1 --2- 172.21.15.40:0/1302199031 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f553c137030 0x7f553c139410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:51.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.036+0000 7f553b7fe700 1 -- 172.21.15.40:0/1302199031 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3751635947 0 0) 0x7f553c09eb50 con 0x7f553c06a6d0 2023-09-30T22:29:51.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.036+0000 7f553b7fe700 1 -- 172.21.15.40:0/1302199031 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f552c0035b0 con 0x7f553c06a6d0 2023-09-30T22:29:51.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.036+0000 7f55416af700 1 -- 172.21.15.40:0/1302199031 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f553c06b1b0 msgr2=0x7f553c136af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:51.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.036+0000 7f55416af700 1 --2- 172.21.15.40:0/1302199031 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f553c06b1b0 0x7f553c136af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.036+0000 7f55416af700 1 -- 172.21.15.40:0/1302199031 >> v1:172.21.15.40:6789/0 conn(0x7f553c06a6d0 legacy=0x7f553c06aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:51.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.036+0000 7f55416af700 1 -- 172.21.15.40:0/1302199031 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f553c09d4a0 con 0x7f553c137030 2023-09-30T22:29:51.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.036+0000 7f55416af700 1 --2- 172.21.15.40:0/1302199031 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f553c137030 0x7f553c139410 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f5534009dc0 tx=0x7f553400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22a413dff99a0595 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:51.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.037+0000 7f553b7fe700 1 -- 172.21.15.40:0/1302199031 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553400e070 con 0x7f553c137030 2023-09-30T22:29:51.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.037+0000 7f553b7fe700 1 -- 172.21.15.40:0/1302199031 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553400bb20 con 0x7f553c137030 2023-09-30T22:29:51.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.037+0000 7f553b7fe700 1 -- 172.21.15.40:0/1302199031 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553400be90 con 0x7f553c137030 2023-09-30T22:29:51.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.037+0000 7f5543112700 1 -- 172.21.15.40:0/1302199031 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f553c137030 msgr2=0x7f553c139410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:51.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.037+0000 7f5543112700 1 --2- 172.21.15.40:0/1302199031 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f553c137030 0x7f553c139410 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f5534009dc0 tx=0x7f553400b330 comp rx=0 tx=0).stop 2023-09-30T22:29:51.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.037+0000 7f5543112700 1 -- 172.21.15.40:0/1302199031 shutdown_connections 2023-09-30T22:29:51.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.037+0000 7f5543112700 1 --2- 172.21.15.40:0/1302199031 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f553c137030 0x7f553c139410 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.038+0000 7f5543112700 1 --2- 172.21.15.40:0/1302199031 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f553c06b1b0 0x7f553c136af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.038+0000 7f5543112700 1 -- 172.21.15.40:0/1302199031 >> 172.21.15.40:0/1302199031 conn(0x7f553c09fb20 msgr2=0x7f553c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:51.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.038+0000 7f5543112700 1 -- 172.21.15.40:0/1302199031 shutdown_connections 2023-09-30T22:29:51.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.038+0000 7f5543112700 1 -- 172.21.15.40:0/1302199031 wait complete. 2023-09-30T22:29:51.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.038+0000 7f5543112700 1 Processor -- start 2023-09-30T22:29:51.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.039+0000 7f5543112700 1 -- start start 2023-09-30T22:29:51.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.039+0000 7f5543112700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f553c06a6d0 0x7f553c11c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.039+0000 7f5543112700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f553c06b1b0 0x7f553c11cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.039+0000 7f5543112700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f553c137030 0x7f553c11d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.039+0000 7f5543112700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553c11e4d0 con 0x7f553c137030 2023-09-30T22:29:51.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.039+0000 7f5543112700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f553c11fd30 con 0x7f553c06a6d0 2023-09-30T22:29:51.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.039+0000 7f5543112700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f553c11e970 con 0x7f553c06b1b0 2023-09-30T22:29:51.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.039+0000 7f55416af700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f553c137030 0x7f553c11d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:51.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.039+0000 7f55416af700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f553c137030 0x7f553c11d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49962/0 (socket says 172.21.15.40:49962) 2023-09-30T22:29:51.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.039+0000 7f55416af700 1 -- 172.21.15.40:0/196661855 learned_addr learned my addr 172.21.15.40:0/196661855 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:51.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.039+0000 7f5540eae700 1 --2- 172.21.15.40:0/196661855 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f553c06a6d0 0x7f553c11c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:51.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.040+0000 7f5540eae700 1 -- 172.21.15.40:0/196661855 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f553c06b1b0 msgr2=0x7f553c11cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:51.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.040+0000 7f5540eae700 1 --2- 172.21.15.40:0/196661855 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f553c06b1b0 0x7f553c11cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.040+0000 7f5540eae700 1 -- 172.21.15.40:0/196661855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f553c137030 msgr2=0x7f553c11d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:51.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.040+0000 7f5540eae700 1 --2- 172.21.15.40:0/196661855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f553c137030 0x7f553c11d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.040+0000 7f5540eae700 1 -- 172.21.15.40:0/196661855 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5534009a70 con 0x7f553c06a6d0 2023-09-30T22:29:51.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.040+0000 7f55416af700 1 --2- 172.21.15.40:0/196661855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f553c137030 0x7f553c11d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:51.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.040+0000 7f5540eae700 1 --2- 172.21.15.40:0/196661855 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f553c06a6d0 0x7f553c11c850 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f5530001360 tx=0x7f553000c6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:51.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.040+0000 7f55397fa700 1 -- 172.21.15.40:0/196661855 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55300074e0 con 0x7f553c06a6d0 2023-09-30T22:29:51.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.040+0000 7f55397fa700 1 -- 172.21.15.40:0/196661855 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553000ce90 con 0x7f553c06a6d0 2023-09-30T22:29:51.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.040+0000 7f5543112700 1 -- 172.21.15.40:0/196661855 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f553c070f80 con 0x7f553c06a6d0 2023-09-30T22:29:51.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.040+0000 7f55397fa700 1 -- 172.21.15.40:0/196661855 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5530005830 con 0x7f553c06a6d0 2023-09-30T22:29:51.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.040+0000 7f5543112700 1 -- 172.21.15.40:0/196661855 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f553c11ebb0 con 0x7f553c06a6d0 2023-09-30T22:29:51.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.041+0000 7f5543112700 1 -- 172.21.15.40:0/196661855 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f553c062380 con 0x7f553c06a6d0 2023-09-30T22:29:51.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.041+0000 7f55397fa700 1 -- 172.21.15.40:0/196661855 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f55300059b0 con 0x7f553c06a6d0 2023-09-30T22:29:51.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.042+0000 7f55397fa700 1 -- 172.21.15.40:0/196661855 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5530010920 con 0x7f553c06a6d0 2023-09-30T22:29:51.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.051+0000 7f55397fa700 1 -- 172.21.15.40:0/196661855 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5530017070 con 0x7f553c06a6d0 2023-09-30T22:29:51.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.076+0000 7fa6f72ce700 1 Processor -- start 2023-09-30T22:29:51.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.076+0000 7fa6f72ce700 1 -- start start 2023-09-30T22:29:51.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.077+0000 7fa6f72ce700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa6f009dca0 0x7fa6f0099510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.077+0000 7fa6f72ce700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa6f0099a50 0x7fa6f0099ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.077+0000 7fa6f72ce700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6f01381c0 0x7fa6f013a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.077+0000 7fa6f72ce700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f009e070 con 0x7fa6f0099a50 2023-09-30T22:29:51.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.077+0000 7fa6f72ce700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f009b710 con 0x7fa6f01381c0 2023-09-30T22:29:51.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.077+0000 7fa6f72ce700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f009fa60 con 0x7fa6f009dca0 2023-09-30T22:29:51.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.077+0000 7fa6f586b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6f01381c0 0x7fa6f013a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:51.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.077+0000 7fa6f586b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6f01381c0 0x7fa6f013a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:40548/0 (socket says 172.21.15.40:40548) 2023-09-30T22:29:51.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.077+0000 7fa6f586b700 1 -- 172.21.15.40:0/4060402314 learned_addr learned my addr 172.21.15.40:0/4060402314 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:51.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.077+0000 7fa6f4869700 1 --2- 172.21.15.40:0/4060402314 >> v2:172.21.15.40:3300/0 conn(0x7fa6f0099a50 0x7fa6f0099ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:51.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.077+0000 7fa6f506a700 1 --2- 172.21.15.40:0/4060402314 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa6f009dca0 0x7fa6f0099510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:51.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.078+0000 7fa6f586b700 1 -- 172.21.15.40:0/4060402314 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa6f009dca0 msgr2=0x7fa6f0099510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:51.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.078+0000 7fa6f586b700 1 --2- 172.21.15.40:0/4060402314 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa6f009dca0 0x7fa6f0099510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.078+0000 7fa6f586b700 1 -- 172.21.15.40:0/4060402314 >> v2:172.21.15.40:3300/0 conn(0x7fa6f0099a50 msgr2=0x7fa6f0099ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:51.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.078+0000 7fa6f586b700 1 --2- 172.21.15.40:0/4060402314 >> v2:172.21.15.40:3300/0 conn(0x7fa6f0099a50 0x7fa6f0099ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.078+0000 7fa6f586b700 1 -- 172.21.15.40:0/4060402314 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f009a950 con 0x7fa6f01381c0 2023-09-30T22:29:51.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.078+0000 7fa6f4869700 1 --2- 172.21.15.40:0/4060402314 >> v2:172.21.15.40:3300/0 conn(0x7fa6f0099a50 0x7fa6f0099ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:51.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.078+0000 7fa6f586b700 1 --2- 172.21.15.40:0/4060402314 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6f01381c0 0x7fa6f013a5a0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8009e50 tx=0x7fa6e800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b39cadad182c806f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:51.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.078+0000 7fa6e7fff700 1 -- 172.21.15.40:0/4060402314 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e800e070 con 0x7fa6f01381c0 2023-09-30T22:29:51.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.078+0000 7fa6e7fff700 1 -- 172.21.15.40:0/4060402314 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e800b910 con 0x7fa6f01381c0 2023-09-30T22:29:51.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.078+0000 7fa6e7fff700 1 -- 172.21.15.40:0/4060402314 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e800bcc0 con 0x7fa6f01381c0 2023-09-30T22:29:51.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.079+0000 7fa6f72ce700 1 -- 172.21.15.40:0/4060402314 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6f01381c0 msgr2=0x7fa6f013a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:51.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.079+0000 7fa6f72ce700 1 --2- 172.21.15.40:0/4060402314 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6f01381c0 0x7fa6f013a5a0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8009e50 tx=0x7fa6e800b330 comp rx=0 tx=0).stop 2023-09-30T22:29:51.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.079+0000 7fa6f72ce700 1 -- 172.21.15.40:0/4060402314 shutdown_connections 2023-09-30T22:29:51.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.079+0000 7fa6f72ce700 1 --2- 172.21.15.40:0/4060402314 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa6f009dca0 0x7fa6f0099510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.079+0000 7fa6f72ce700 1 --2- 172.21.15.40:0/4060402314 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6f01381c0 0x7fa6f013a5a0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.079+0000 7fa6f72ce700 1 --2- 172.21.15.40:0/4060402314 >> v2:172.21.15.40:3300/0 conn(0x7fa6f0099a50 0x7fa6f0099ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.079+0000 7fa6f72ce700 1 -- 172.21.15.40:0/4060402314 >> 172.21.15.40:0/4060402314 conn(0x7fa6f00a2c70 msgr2=0x7fa6f009eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:51.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.079+0000 7fa6f72ce700 1 -- 172.21.15.40:0/4060402314 shutdown_connections 2023-09-30T22:29:51.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.079+0000 7fa6f72ce700 1 -- 172.21.15.40:0/4060402314 wait complete. 2023-09-30T22:29:51.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.080+0000 7fa6f72ce700 1 Processor -- start 2023-09-30T22:29:51.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.080+0000 7fa6f72ce700 1 -- start start 2023-09-30T22:29:51.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.081+0000 7fa6f72ce700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6f0099a50 0x7fa6f01365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.081+0000 7fa6f72ce700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa6f009dca0 0x7fa6f0136ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.081+0000 7fa6f72ce700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6f01381c0 0x7fa6f01c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.081+0000 7fa6f72ce700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f0096050 con 0x7fa6f01381c0 2023-09-30T22:29:51.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.081+0000 7fa6f72ce700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f0137020 con 0x7fa6f0099a50 2023-09-30T22:29:51.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.081+0000 7fa6f72ce700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f0096c50 con 0x7fa6f009dca0 2023-09-30T22:29:51.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.081+0000 7fa6f506a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6f0099a50 0x7fa6f01365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:51.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.081+0000 7fa6f506a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6f0099a50 0x7fa6f01365a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:40558/0 (socket says 172.21.15.40:40558) 2023-09-30T22:29:51.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.081+0000 7fa6f506a700 1 -- 172.21.15.40:0/954798104 learned_addr learned my addr 172.21.15.40:0/954798104 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:51.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.081+0000 7fa6f4869700 1 --2- 172.21.15.40:0/954798104 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa6f009dca0 0x7fa6f0136ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:51.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.081+0000 7fa6f586b700 1 --2- 172.21.15.40:0/954798104 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6f01381c0 0x7fa6f01c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:51.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.082+0000 7fa6f506a700 1 -- 172.21.15.40:0/954798104 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa6f009dca0 msgr2=0x7fa6f0136ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:51.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.082+0000 7fa6f506a700 1 --2- 172.21.15.40:0/954798104 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa6f009dca0 0x7fa6f0136ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.082+0000 7fa6f506a700 1 -- 172.21.15.40:0/954798104 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6f01381c0 msgr2=0x7fa6f01c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:51.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.082+0000 7fa6f506a700 1 --2- 172.21.15.40:0/954798104 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6f01381c0 0x7fa6f01c8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.082+0000 7fa6f506a700 1 -- 172.21.15.40:0/954798104 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e00094a0 con 0x7fa6f0099a50 2023-09-30T22:29:51.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.082+0000 7fa6f506a700 1 --2- 172.21.15.40:0/954798104 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6f0099a50 0x7fa6f01365a0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00e990 tx=0x7fa6ec00eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:51.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.082+0000 7fa6e5ffb700 1 -- 172.21.15.40:0/954798104 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec00eee0 con 0x7fa6f0099a50 2023-09-30T22:29:51.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.082+0000 7fce4fa5a700 1 Processor -- start 2023-09-30T22:29:51.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.082+0000 7fa6e5ffb700 1 -- 172.21.15.40:0/954798104 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6ec00c850 con 0x7fa6f0099a50 2023-09-30T22:29:51.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.082+0000 7fa6e5ffb700 1 -- 172.21.15.40:0/954798104 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec0096f0 con 0x7fa6f0099a50 2023-09-30T22:29:51.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.082+0000 7fa6f72ce700 1 -- 172.21.15.40:0/954798104 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6e8009b30 con 0x7fa6f0099a50 2023-09-30T22:29:51.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.083+0000 7fa6f72ce700 1 -- 172.21.15.40:0/954798104 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f0096f10 con 0x7fa6f0099a50 2023-09-30T22:29:51.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.083+0000 7fce4fa5a700 1 -- start start 2023-09-30T22:29:51.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.083+0000 7fce4fa5a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fce4809c890 0x7fce4809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.083+0000 7fce4fa5a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fce4809e480 0x7fce4813bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.083+0000 7fce4fa5a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce480a2600 con 0x7fce4809d920 2023-09-30T22:29:51.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.083+0000 7fce4fa5a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce480a29d0 con 0x7fce4809e480 2023-09-30T22:29:51.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.083+0000 7fce4fa5a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce4809fb40 con 0x7fce4809c890 2023-09-30T22:29:51.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.083+0000 7fce4d7f6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fce4809c890 0x7fce4809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:51.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.083+0000 7fce4d7f6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fce4809c890 0x7fce4809cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:38260/0 (socket says 172.21.15.40:38260) 2023-09-30T22:29:51.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.083+0000 7fce4d7f6700 1 -- 172.21.15.40:0/447397976 learned_addr learned my addr 172.21.15.40:0/447397976 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:51.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.084+0000 7fce4d7f6700 1 -- 172.21.15.40:0/447397976 >> v2:172.21.15.40:3300/0 conn(0x7fce4809e480 msgr2=0x7fce4813bc20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:29:51.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.084+0000 7fce4d7f6700 1 --2- 172.21.15.40:0/447397976 >> v2:172.21.15.40:3300/0 conn(0x7fce4809e480 0x7fce4813bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.084+0000 7fce4d7f6700 1 -- 172.21.15.40:0/447397976 >> v1:172.21.15.40:6789/0 conn(0x7fce4809d920 legacy=0x7fce4809dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:51.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.084+0000 7fce4d7f6700 1 -- 172.21.15.40:0/447397976 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4809fed0 con 0x7fce4809c890 2023-09-30T22:29:51.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.084+0000 7fce4d7f6700 1 --2- 172.21.15.40:0/447397976 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fce4809c890 0x7fce4809cc60 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fce44006fd0 tx=0x7fce44009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ec307a3b14b8fcd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:51.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.084+0000 7fce3ffff700 1 -- 172.21.15.40:0/447397976 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce44005e30 con 0x7fce4809c890 2023-09-30T22:29:51.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.084+0000 7fce3ffff700 1 -- 172.21.15.40:0/447397976 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce44006030 con 0x7fce4809c890 2023-09-30T22:29:51.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.084+0000 7fce3ffff700 1 -- 172.21.15.40:0/447397976 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce440063e0 con 0x7fce4809c890 2023-09-30T22:29:51.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.085+0000 7fa6e5ffb700 1 -- 172.21.15.40:0/954798104 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa6ec00cbc0 con 0x7fa6f0099a50 2023-09-30T22:29:51.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.085+0000 7fce4fa5a700 1 -- 172.21.15.40:0/447397976 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fce4809c890 msgr2=0x7fce4809cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:51.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.085+0000 7fce4fa5a700 1 --2- 172.21.15.40:0/447397976 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fce4809c890 0x7fce4809cc60 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fce44006fd0 tx=0x7fce44009bd0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.085+0000 7fa6f72ce700 1 -- 172.21.15.40:0/954798104 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6f0095460 con 0x7fa6f0099a50 2023-09-30T22:29:51.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.085+0000 7fa6e5ffb700 1 -- 172.21.15.40:0/954798104 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa6ec012dc0 con 0x7fa6f0099a50 2023-09-30T22:29:51.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.085+0000 7fce4fa5a700 1 -- 172.21.15.40:0/447397976 shutdown_connections 2023-09-30T22:29:51.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.085+0000 7fce4fa5a700 1 --2- 172.21.15.40:0/447397976 >> v2:172.21.15.40:3300/0 conn(0x7fce4809e480 0x7fce4813bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.085+0000 7fce4fa5a700 1 --2- 172.21.15.40:0/447397976 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fce4809c890 0x7fce4809cc60 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.085+0000 7fce4fa5a700 1 -- 172.21.15.40:0/447397976 >> 172.21.15.40:0/447397976 conn(0x7fce480a7080 msgr2=0x7fce480a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:51.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.085+0000 7fce4fa5a700 1 -- 172.21.15.40:0/447397976 shutdown_connections 2023-09-30T22:29:51.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.085+0000 7fce4fa5a700 1 -- 172.21.15.40:0/447397976 wait complete. 2023-09-30T22:29:51.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.086+0000 7fce4fa5a700 1 Processor -- start 2023-09-30T22:29:51.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.086+0000 7fce4fa5a700 1 -- start start 2023-09-30T22:29:51.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.087+0000 7fce4fa5a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce4809c890 0x7fce481c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.087+0000 7fce4fa5a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce4809d920 0x7fce481c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.087+0000 7fce4fa5a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fce4809e480 0x7fce4812d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.087+0000 7fce4fa5a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4809ecf0 con 0x7fce4809d920 2023-09-30T22:29:51.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.087+0000 7fce4fa5a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4809c050 con 0x7fce4809c890 2023-09-30T22:29:51.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.087+0000 7fce4fa5a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce4808f4f0 con 0x7fce4809e480 2023-09-30T22:29:51.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.087+0000 7fce4dff7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fce4809e480 0x7fce4812d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:51.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.087+0000 7fce4dff7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fce4809e480 0x7fce4812d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:38262/0 (socket says 172.21.15.40:38262) 2023-09-30T22:29:51.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.087+0000 7fce4dff7700 1 -- 172.21.15.40:0/2253312552 learned_addr learned my addr 172.21.15.40:0/2253312552 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:51.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.087+0000 7fce4cff5700 1 --2- 172.21.15.40:0/2253312552 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce4809d920 0x7fce481c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:51.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.087+0000 7fce4dff7700 1 -- 172.21.15.40:0/2253312552 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce4809c890 msgr2=0x7fce481c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:51.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.087+0000 7fce4dff7700 1 --2- 172.21.15.40:0/2253312552 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce4809c890 0x7fce481c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.087+0000 7fce4dff7700 1 -- 172.21.15.40:0/2253312552 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce4809d920 msgr2=0x7fce481c92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:51.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.087+0000 7fce4dff7700 1 --2- 172.21.15.40:0/2253312552 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce4809d920 0x7fce481c92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.087+0000 7fce4dff7700 1 -- 172.21.15.40:0/2253312552 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce44009500 con 0x7fce4809e480 2023-09-30T22:29:51.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.088+0000 7fce4dff7700 1 --2- 172.21.15.40:0/2253312552 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fce4809e480 0x7fce4812d490 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fce4000b9e0 tx=0x7fce4000bcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:51.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.088+0000 7fce3dffb700 1 -- 172.21.15.40:0/2253312552 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4000c930 con 0x7fce4809e480 2023-09-30T22:29:51.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.088+0000 7fce3dffb700 1 -- 172.21.15.40:0/2253312552 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4000cad0 con 0x7fce4809e480 2023-09-30T22:29:51.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.088+0000 7fce3dffb700 1 -- 172.21.15.40:0/2253312552 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4000ce80 con 0x7fce4809e480 2023-09-30T22:29:51.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.088+0000 7fce4fa5a700 1 -- 172.21.15.40:0/2253312552 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce48130940 con 0x7fce4809e480 2023-09-30T22:29:51.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.088+0000 7fce4fa5a700 1 -- 172.21.15.40:0/2253312552 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce48130ee0 con 0x7fce4809e480 2023-09-30T22:29:51.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.089+0000 7fce4fa5a700 1 -- 172.21.15.40:0/2253312552 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce48062380 con 0x7fce4809e480 2023-09-30T22:29:51.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.090+0000 7fce3dffb700 1 -- 172.21.15.40:0/2253312552 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fce40014440 con 0x7fce4809e480 2023-09-30T22:29:51.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.090+0000 7fce3dffb700 1 -- 172.21.15.40:0/2253312552 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fce4003f3f0 con 0x7fce4809e480 2023-09-30T22:29:51.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.091+0000 7fa6e5ffb700 1 -- 172.21.15.40:0/954798104 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa6ec021030 con 0x7fa6f0099a50 2023-09-30T22:29:51.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.098+0000 7fce3dffb700 1 -- 172.21.15.40:0/2253312552 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fce40007320 con 0x7fce4809e480 2023-09-30T22:29:51.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.114+0000 7f2e46478700 1 Processor -- start 2023-09-30T22:29:51.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.114+0000 7f2e46478700 1 -- start start 2023-09-30T22:29:51.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.115+0000 7f2e46478700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2e40131960 0x7f2e40131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.115+0000 7f2e46478700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e4009dcb0 0x7f2e4009bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.115+0000 7f2e46478700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e40132270 0x7f2e4009c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.115+0000 7f2e46478700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e4006ddd0 con 0x7f2e40131960 2023-09-30T22:29:51.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.115+0000 7f2e46478700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4009ef60 con 0x7f2e40132270 2023-09-30T22:29:51.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.115+0000 7f2e46478700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e40071a20 con 0x7f2e4009dcb0 2023-09-30T22:29:51.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.115+0000 7f2e3ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2e40131960 0x7f2e40131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:51.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.115+0000 7f2e3ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2e40131960 0x7f2e40131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49994/0 (socket says 172.21.15.40:49994) 2023-09-30T22:29:51.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.115+0000 7f2e3ffff700 1 -- 172.21.15.40:0/3159293419 learned_addr learned my addr 172.21.15.40:0/3159293419 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:51.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.115+0000 7f2e3f7fe700 1 --2- 172.21.15.40:0/3159293419 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e4009dcb0 0x7f2e4009bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:51.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.115+0000 7f2e3ffff700 1 -- 172.21.15.40:0/3159293419 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e4009dcb0 msgr2=0x7f2e4009bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:51.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.115+0000 7f2e3ffff700 1 --2- 172.21.15.40:0/3159293419 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e4009dcb0 0x7f2e4009bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.115+0000 7f2e3ffff700 1 -- 172.21.15.40:0/3159293419 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e40132270 msgr2=0x7f2e4009c190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:29:51.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.115+0000 7f2e3ffff700 1 --2- 172.21.15.40:0/3159293419 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e40132270 0x7f2e4009c190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.116+0000 7f2e3ffff700 1 -- 172.21.15.40:0/3159293419 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e40131740 con 0x7f2e40131960 2023-09-30T22:29:51.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.116+0000 7f2e3f7fe700 1 --2- 172.21.15.40:0/3159293419 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e4009dcb0 0x7f2e4009bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:51.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.116+0000 7f2e3ffff700 1 --2- 172.21.15.40:0/3159293419 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e40131960 0x7f2e40131d30 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f2e300098f0 tx=0x7f2e30009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103982ec1e9eee83 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:51.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.116+0000 7f2e3effd700 1 -- 172.21.15.40:0/3159293419 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e30011830 con 0x7f2e40131960 2023-09-30T22:29:51.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.116+0000 7f2e3effd700 1 -- 172.21.15.40:0/3159293419 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e30011990 con 0x7f2e40131960 2023-09-30T22:29:51.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.116+0000 7f2e3effd700 1 -- 172.21.15.40:0/3159293419 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e30011d20 con 0x7f2e40131960 2023-09-30T22:29:51.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.116+0000 7f2e46478700 1 -- 172.21.15.40:0/3159293419 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e40131960 msgr2=0x7f2e40131d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:51.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.116+0000 7f2e46478700 1 --2- 172.21.15.40:0/3159293419 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e40131960 0x7f2e40131d30 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f2e300098f0 tx=0x7f2e30009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:51.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.118+0000 7f2e46478700 1 -- 172.21.15.40:0/3159293419 shutdown_connections 2023-09-30T22:29:51.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.118+0000 7f2e46478700 1 --2- 172.21.15.40:0/3159293419 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e40132270 0x7f2e4009c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.118+0000 7f2e46478700 1 --2- 172.21.15.40:0/3159293419 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e40131960 0x7f2e40131d30 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.118+0000 7f2e46478700 1 --2- 172.21.15.40:0/3159293419 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e4009dcb0 0x7f2e4009bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.118+0000 7f2e46478700 1 -- 172.21.15.40:0/3159293419 >> 172.21.15.40:0/3159293419 conn(0x7f2e4006a6d0 msgr2=0x7f2e4006aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:51.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.118+0000 7f2e46478700 1 -- 172.21.15.40:0/3159293419 shutdown_connections 2023-09-30T22:29:51.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.118+0000 7f2e46478700 1 -- 172.21.15.40:0/3159293419 wait complete. 2023-09-30T22:29:51.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.119+0000 7f2e46478700 1 Processor -- start 2023-09-30T22:29:51.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.119+0000 7f2e46478700 1 -- start start 2023-09-30T22:29:51.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.119+0000 7f2e46478700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e4009dcb0 0x7f2e401190c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.119+0000 7f2e46478700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e40131960 0x7f2e40119600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.119+0000 7f2e46478700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e40132270 0x7f2e40119b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:51.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.119+0000 7f2e46478700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4011a4e0 con 0x7f2e4009dcb0 2023-09-30T22:29:51.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.119+0000 7f2e46478700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4011ad70 con 0x7f2e40131960 2023-09-30T22:29:51.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.119+0000 7f2e46478700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e40130b10 con 0x7f2e40132270 2023-09-30T22:29:51.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.120+0000 7f2e3ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e4009dcb0 0x7f2e401190c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:51.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.120+0000 7f2e3ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e4009dcb0 0x7f2e401190c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50010/0 (socket says 172.21.15.40:50010) 2023-09-30T22:29:51.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.120+0000 7f2e3ffff700 1 -- 172.21.15.40:0/464049505 learned_addr learned my addr 172.21.15.40:0/464049505 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:51.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.120+0000 7f2e44a15700 1 --2- 172.21.15.40:0/464049505 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e40132270 0x7f2e40119b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:51.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.120+0000 7f2e3ffff700 1 -- 172.21.15.40:0/464049505 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e40132270 msgr2=0x7f2e40119b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:51.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.120+0000 7f2e3ffff700 1 --2- 172.21.15.40:0/464049505 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e40132270 0x7f2e40119b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.120+0000 7f2e3ffff700 1 -- 172.21.15.40:0/464049505 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e40131960 msgr2=0x7f2e40119600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:51.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.120+0000 7f2e3ffff700 1 --2- 172.21.15.40:0/464049505 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e40131960 0x7f2e40119600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.120+0000 7f2e3ffff700 1 -- 172.21.15.40:0/464049505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e340094a0 con 0x7f2e4009dcb0 2023-09-30T22:29:51.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.120+0000 7f2e3ffff700 1 --2- 172.21.15.40:0/464049505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e4009dcb0 0x7f2e401190c0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f2e4006df10 tx=0x7f2e30004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:51.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.120+0000 7f2e3cff9700 1 -- 172.21.15.40:0/464049505 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e30004450 con 0x7f2e4009dcb0 2023-09-30T22:29:51.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.120+0000 7f2e3cff9700 1 -- 172.21.15.40:0/464049505 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e300045b0 con 0x7f2e4009dcb0 2023-09-30T22:29:51.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.120+0000 7f2e3cff9700 1 -- 172.21.15.40:0/464049505 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e300038c0 con 0x7f2e4009dcb0 2023-09-30T22:29:51.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.121+0000 7f2e46478700 1 -- 172.21.15.40:0/464049505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e30009550 con 0x7f2e4009dcb0 2023-09-30T22:29:51.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.121+0000 7f2e46478700 1 -- 172.21.15.40:0/464049505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e4009e680 con 0x7f2e4009dcb0 2023-09-30T22:29:51.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.122+0000 7f2e3cff9700 1 -- 172.21.15.40:0/464049505 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2e30021070 con 0x7f2e4009dcb0 2023-09-30T22:29:51.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.122+0000 7f2e46478700 1 -- 172.21.15.40:0/464049505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e4011c210 con 0x7f2e4009dcb0 2023-09-30T22:29:51.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.122+0000 7f2e3cff9700 1 -- 172.21.15.40:0/464049505 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f2e30040b60 con 0x7f2e4009dcb0 2023-09-30T22:29:51.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.127+0000 7f2e3cff9700 1 -- 172.21.15.40:0/464049505 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e300199a0 con 0x7f2e4009dcb0 2023-09-30T22:29:51.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.287+0000 7f5543112700 1 -- 172.21.15.40:0/196661855 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f553c074720 con 0x7f553c06a6d0 2023-09-30T22:29:51.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.287+0000 7f55397fa700 1 -- 172.21.15.40:0/196661855 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5530017030 con 0x7f553c06a6d0 2023-09-30T22:29:51.288 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:51.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.288+0000 7fa6f72ce700 1 -- 172.21.15.40:0/954798104 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa6f009e5d0 con 0x7fa6f0099a50 2023-09-30T22:29:51.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.288+0000 7fa6e5ffb700 1 -- 172.21.15.40:0/954798104 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa6ec01b3b0 con 0x7fa6f0099a50 2023-09-30T22:29:51.289 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:51.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.290+0000 7f5543112700 1 -- 172.21.15.40:0/196661855 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f553c06a6d0 msgr2=0x7f553c11c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:51.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.290+0000 7f5543112700 1 --2- 172.21.15.40:0/196661855 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f553c06a6d0 0x7f553c11c850 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f5530001360 tx=0x7f553000c6e0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.290+0000 7fa6f72ce700 1 -- 172.21.15.40:0/954798104 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6f0099a50 msgr2=0x7fa6f01365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:51.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.290+0000 7fa6f72ce700 1 --2- 172.21.15.40:0/954798104 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6f0099a50 0x7fa6f01365a0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00e990 tx=0x7fa6ec00eca0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.291+0000 7f5543112700 1 -- 172.21.15.40:0/196661855 shutdown_connections 2023-09-30T22:29:51.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.291+0000 7f5543112700 1 --2- 172.21.15.40:0/196661855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f553c137030 0x7f553c11d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.291+0000 7f5543112700 1 --2- 172.21.15.40:0/196661855 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f553c06a6d0 0x7f553c11c850 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.291+0000 7f5543112700 1 --2- 172.21.15.40:0/196661855 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f553c06b1b0 0x7f553c11cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.291+0000 7f5543112700 1 -- 172.21.15.40:0/196661855 >> 172.21.15.40:0/196661855 conn(0x7f553c09fb20 msgr2=0x7f553c0a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:51.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.291+0000 7fa6f72ce700 1 -- 172.21.15.40:0/954798104 shutdown_connections 2023-09-30T22:29:51.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.291+0000 7fa6f72ce700 1 --2- 172.21.15.40:0/954798104 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6f01381c0 0x7fa6f01c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.291+0000 7fa6f72ce700 1 --2- 172.21.15.40:0/954798104 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6f0099a50 0x7fa6f01365a0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.291+0000 7fa6f72ce700 1 --2- 172.21.15.40:0/954798104 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa6f009dca0 0x7fa6f0136ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.291+0000 7fa6f72ce700 1 -- 172.21.15.40:0/954798104 >> 172.21.15.40:0/954798104 conn(0x7fa6f00a2c70 msgr2=0x7fa6f01373e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:51.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.291+0000 7fa6f72ce700 1 -- 172.21.15.40:0/954798104 shutdown_connections 2023-09-30T22:29:51.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.291+0000 7fa6f72ce700 1 -- 172.21.15.40:0/954798104 wait complete. 2023-09-30T22:29:51.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.292+0000 7f5543112700 1 -- 172.21.15.40:0/196661855 shutdown_connections 2023-09-30T22:29:51.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.292+0000 7f5543112700 1 -- 172.21.15.40:0/196661855 wait complete. 2023-09-30T22:29:51.310 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:51.311 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:51.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.322+0000 7fce4fa5a700 1 -- 172.21.15.40:0/2253312552 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fce4809c290 con 0x7fce4809e480 2023-09-30T22:29:51.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.322+0000 7fce3dffb700 1 -- 172.21.15.40:0/2253312552 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fce40019020 con 0x7fce4809e480 2023-09-30T22:29:51.323 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:51.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.324+0000 7fce4fa5a700 1 -- 172.21.15.40:0/2253312552 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fce4809e480 msgr2=0x7fce4812d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:51.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.324+0000 7fce4fa5a700 1 --2- 172.21.15.40:0/2253312552 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fce4809e480 0x7fce4812d490 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fce4000b9e0 tx=0x7fce4000bcf0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.324+0000 7fce4fa5a700 1 -- 172.21.15.40:0/2253312552 shutdown_connections 2023-09-30T22:29:51.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.324+0000 7fce4fa5a700 1 --2- 172.21.15.40:0/2253312552 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fce4809e480 0x7fce4812d490 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.324+0000 7fce4fa5a700 1 --2- 172.21.15.40:0/2253312552 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce4809c890 0x7fce481c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.324+0000 7fce4fa5a700 1 --2- 172.21.15.40:0/2253312552 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce4809d920 0x7fce481c92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.324+0000 7fce4fa5a700 1 -- 172.21.15.40:0/2253312552 >> 172.21.15.40:0/2253312552 conn(0x7fce480a7080 msgr2=0x7fce480a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:51.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.325+0000 7fce4fa5a700 1 -- 172.21.15.40:0/2253312552 shutdown_connections 2023-09-30T22:29:51.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.325+0000 7fce4fa5a700 1 -- 172.21.15.40:0/2253312552 wait complete. 2023-09-30T22:29:51.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.327+0000 7f2e46478700 1 -- 172.21.15.40:0/464049505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2e400716e0 con 0x7f2e4009dcb0 2023-09-30T22:29:51.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.327+0000 7f2e3cff9700 1 -- 172.21.15.40:0/464049505 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2e30029070 con 0x7f2e4009dcb0 2023-09-30T22:29:51.328 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:51.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.329+0000 7f2e46478700 1 -- 172.21.15.40:0/464049505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e4009dcb0 msgr2=0x7f2e401190c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:51.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.329+0000 7f2e46478700 1 --2- 172.21.15.40:0/464049505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e4009dcb0 0x7f2e401190c0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f2e4006df10 tx=0x7f2e30004750 comp rx=0 tx=0).stop 2023-09-30T22:29:51.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.329+0000 7f2e46478700 1 -- 172.21.15.40:0/464049505 shutdown_connections 2023-09-30T22:29:51.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.329+0000 7f2e46478700 1 --2- 172.21.15.40:0/464049505 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e40132270 0x7f2e40119b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.329+0000 7f2e46478700 1 --2- 172.21.15.40:0/464049505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e4009dcb0 0x7f2e401190c0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.329+0000 7f2e46478700 1 --2- 172.21.15.40:0/464049505 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e40131960 0x7f2e40119600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:51.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.329+0000 7f2e46478700 1 -- 172.21.15.40:0/464049505 >> 172.21.15.40:0/464049505 conn(0x7f2e4006a6d0 msgr2=0x7f2e4012eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:51.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.329+0000 7f2e46478700 1 -- 172.21.15.40:0/464049505 shutdown_connections 2023-09-30T22:29:51.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:51.329+0000 7f2e46478700 1 -- 172.21.15.40:0/464049505 wait complete. 2023-09-30T22:29:51.339 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:51.343 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:52.311 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:52.312 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:52.340 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:52.344 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:52.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.462+0000 7f253b902700 1 Processor -- start 2023-09-30T22:29:52.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.462+0000 7f253b902700 1 -- start start 2023-09-30T22:29:52.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.463+0000 7f253b902700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f253406d0a0 0x7f253406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.463+0000 7f253b902700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2534139380 0x7f253413b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.463+0000 7f253b902700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f253406e3f0 con 0x7f253409fbb0 2023-09-30T22:29:52.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.463+0000 7f253b902700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f253409ff80 con 0x7f2534139380 2023-09-30T22:29:52.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.463+0000 7f253b902700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253406ec40 con 0x7f253406d0a0 2023-09-30T22:29:52.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.463+0000 7f2538e9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f253406d0a0 0x7f253406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.463+0000 7f2538e9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f253406d0a0 0x7f253406d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:40590/0 (socket says 172.21.15.40:40590) 2023-09-30T22:29:52.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.463+0000 7f2538e9d700 1 -- 172.21.15.40:0/4231158817 learned_addr learned my addr 172.21.15.40:0/4231158817 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:52.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.463+0000 7f2539e9f700 1 --2- 172.21.15.40:0/4231158817 >> v2:172.21.15.40:3300/0 conn(0x7f2534139380 0x7f253413b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.463+0000 7f2538e9d700 1 -- 172.21.15.40:0/4231158817 >> v2:172.21.15.40:3300/0 conn(0x7f2534139380 msgr2=0x7f253413b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:52.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.463+0000 7f2538e9d700 1 --2- 172.21.15.40:0/4231158817 >> v2:172.21.15.40:3300/0 conn(0x7f2534139380 0x7f253413b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.463+0000 7f2538e9d700 1 -- 172.21.15.40:0/4231158817 >> v1:172.21.15.40:6789/0 conn(0x7f253409fbb0 legacy=0x7f253406c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:52.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.463+0000 7f2538e9d700 1 -- 172.21.15.40:0/4231158817 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253406d9f0 con 0x7f253406d0a0 2023-09-30T22:29:52.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.464+0000 7f2538e9d700 1 --2- 172.21.15.40:0/4231158817 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f253406d0a0 0x7f253406d4b0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f25240098f0 tx=0x7f2524009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0120aa9a0ae934a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:52.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.464+0000 7f252bfff700 1 -- 172.21.15.40:0/4231158817 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2524004230 con 0x7f253406d0a0 2023-09-30T22:29:52.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.464+0000 7f252bfff700 1 -- 172.21.15.40:0/4231158817 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2524004390 con 0x7f253406d0a0 2023-09-30T22:29:52.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.464+0000 7f252bfff700 1 -- 172.21.15.40:0/4231158817 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25240036a0 con 0x7f253406d0a0 2023-09-30T22:29:52.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.464+0000 7f253b902700 1 -- 172.21.15.40:0/4231158817 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f253406d0a0 msgr2=0x7f253406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:52.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.464+0000 7f253b902700 1 --2- 172.21.15.40:0/4231158817 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f253406d0a0 0x7f253406d4b0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f25240098f0 tx=0x7f2524009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:52.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.464+0000 7f253b902700 1 -- 172.21.15.40:0/4231158817 shutdown_connections 2023-09-30T22:29:52.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.464+0000 7f253b902700 1 --2- 172.21.15.40:0/4231158817 >> v2:172.21.15.40:3300/0 conn(0x7f2534139380 0x7f253413b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.464+0000 7f253b902700 1 --2- 172.21.15.40:0/4231158817 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f253406d0a0 0x7f253406d4b0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.464+0000 7f253b902700 1 -- 172.21.15.40:0/4231158817 >> 172.21.15.40:0/4231158817 conn(0x7f25340a41a0 msgr2=0x7f25340a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:52.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.465+0000 7f253b902700 1 -- 172.21.15.40:0/4231158817 shutdown_connections 2023-09-30T22:29:52.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.465+0000 7f253b902700 1 -- 172.21.15.40:0/4231158817 wait complete. 2023-09-30T22:29:52.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.465+0000 7f253b902700 1 Processor -- start 2023-09-30T22:29:52.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.466+0000 7f253b902700 1 -- start start 2023-09-30T22:29:52.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.466+0000 7f253b902700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f253406d0a0 0x7f2534138390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.466+0000 7f253b902700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f253409fbb0 0x7f25341388d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.466+0000 7f253b902700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2534139380 0x7f2534138e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.466+0000 7f253b902700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2534093820 con 0x7f253409fbb0 2023-09-30T22:29:52.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.466+0000 7f253b902700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253413b7e0 con 0x7f2534139380 2023-09-30T22:29:52.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.466+0000 7f253b902700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2534092960 con 0x7f253406d0a0 2023-09-30T22:29:52.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.466+0000 7f2539e9f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2534139380 0x7f2534138e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.466+0000 7f2539e9f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2534139380 0x7f2534138e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:40600/0 (socket says 172.21.15.40:40600) 2023-09-30T22:29:52.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.466+0000 7f2539e9f700 1 -- 172.21.15.40:0/1136763064 learned_addr learned my addr 172.21.15.40:0/1136763064 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:52.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.466+0000 7f2539e9f700 1 -- 172.21.15.40:0/1136763064 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f253406d0a0 msgr2=0x7f2534138390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:52.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.466+0000 7f2539e9f700 1 --2- 172.21.15.40:0/1136763064 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f253406d0a0 0x7f2534138390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.466+0000 7f2539e9f700 1 -- 172.21.15.40:0/1136763064 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f253409fbb0 msgr2=0x7f25341388d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:52.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.466+0000 7f2539e9f700 1 --2- 172.21.15.40:0/1136763064 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f253409fbb0 0x7f25341388d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.466+0000 7f2539e9f700 1 -- 172.21.15.40:0/1136763064 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2524009550 con 0x7f2534139380 2023-09-30T22:29:52.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.467+0000 7f2539e9f700 1 --2- 172.21.15.40:0/1136763064 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2534139380 0x7f2534138e10 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f252c007e40 tx=0x7f252c00e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:52.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.467+0000 7f2529ffb700 1 -- 172.21.15.40:0/1136763064 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c00eea0 con 0x7f2534139380 2023-09-30T22:29:52.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.467+0000 7f2529ffb700 1 -- 172.21.15.40:0/1136763064 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252c014420 con 0x7f2534139380 2023-09-30T22:29:52.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.467+0000 7f2529ffb700 1 -- 172.21.15.40:0/1136763064 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c0147d0 con 0x7f2534139380 2023-09-30T22:29:52.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.467+0000 7f253b902700 1 -- 172.21.15.40:0/1136763064 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2534097f10 con 0x7f2534139380 2023-09-30T22:29:52.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.467+0000 7f253b902700 1 -- 172.21.15.40:0/1136763064 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2534092700 con 0x7f2534139380 2023-09-30T22:29:52.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.468+0000 7f2529ffb700 1 -- 172.21.15.40:0/1136763064 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f252c014930 con 0x7f2534139380 2023-09-30T22:29:52.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.468+0000 7f2529ffb700 1 -- 172.21.15.40:0/1136763064 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f252c03ffe0 con 0x7f2534139380 2023-09-30T22:29:52.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.468+0000 7f253b902700 1 -- 172.21.15.40:0/1136763064 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2534062380 con 0x7f2534139380 2023-09-30T22:29:52.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.473+0000 7f2529ffb700 1 -- 172.21.15.40:0/1136763064 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f252c0122e0 con 0x7f2534139380 2023-09-30T22:29:52.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.500+0000 7fc50f287700 1 Processor -- start 2023-09-30T22:29:52.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.501+0000 7f6507bbe700 1 Processor -- start 2023-09-30T22:29:52.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.501+0000 7fc50f287700 1 -- start start 2023-09-30T22:29:52.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.501+0000 7f6507bbe700 1 -- start start 2023-09-30T22:29:52.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.501+0000 7fc50f287700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc50812e590 0x7fc50812e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.501+0000 7fc50f287700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc50812eea0 0x7fc50812d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.501+0000 7fc50f287700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc50809ab70 con 0x7fc50812d6d0 2023-09-30T22:29:52.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.501+0000 7fc50f287700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc50809b270 con 0x7fc50812eea0 2023-09-30T22:29:52.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.501+0000 7fc50f287700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc50809bab0 con 0x7fc50812e590 2023-09-30T22:29:52.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.502+0000 7f6507bbe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f650009d450 0x7f650009d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.502+0000 7f6507bbe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f650009dd60 0x7f65001301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.502+0000 7f6507bbe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6500130700 0x7f6500130b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.502+0000 7fc50d023700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc50812e590 0x7fc50812e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.502+0000 7fc50d023700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc50812e590 0x7fc50812e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:38298/0 (socket says 172.21.15.40:38298) 2023-09-30T22:29:52.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.502+0000 7fc50d023700 1 -- 172.21.15.40:0/2572146748 learned_addr learned my addr 172.21.15.40:0/2572146748 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:52.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.502+0000 7f6507bbe700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f650009e8b0 con 0x7f650009d450 2023-09-30T22:29:52.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.502+0000 7f6507bbe700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f650009c3b0 con 0x7f6500130700 2023-09-30T22:29:52.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.502+0000 7f6507bbe700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f650009a6b0 con 0x7f650009dd60 2023-09-30T22:29:52.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.502+0000 7fc50c822700 1 --2- 172.21.15.40:0/2572146748 >> v2:172.21.15.40:3300/0 conn(0x7fc50812eea0 0x7fc50812d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.502+0000 7f6505159700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f650009dd60 0x7f65001301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.502+0000 7f6505159700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f650009dd60 0x7f65001301c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:38302/0 (socket says 172.21.15.40:38302) 2023-09-30T22:29:52.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.502+0000 7f6505159700 1 -- 172.21.15.40:0/3590392774 learned_addr learned my addr 172.21.15.40:0/3590392774 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:52.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.502+0000 7f650595a700 1 --2- 172.21.15.40:0/3590392774 >> v2:172.21.15.40:3300/0 conn(0x7f650009d450 0x7f650009d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.502+0000 7fc50d023700 1 -- 172.21.15.40:0/2572146748 >> v2:172.21.15.40:3300/0 conn(0x7fc50812eea0 msgr2=0x7fc50812d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:52.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.502+0000 7fc50d023700 1 --2- 172.21.15.40:0/2572146748 >> v2:172.21.15.40:3300/0 conn(0x7fc50812eea0 0x7fc50812d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.502+0000 7fc4fffff700 1 -- 172.21.15.40:0/2572146748 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2585048042 0 0) 0x7fc50809ab70 con 0x7fc50812d6d0 2023-09-30T22:29:52.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.502+0000 7fc50d023700 1 -- 172.21.15.40:0/2572146748 >> v1:172.21.15.40:6789/0 conn(0x7fc50812d6d0 legacy=0x7fc508137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:52.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.502+0000 7fc50d023700 1 -- 172.21.15.40:0/2572146748 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc50809bd70 con 0x7fc50812e590 2023-09-30T22:29:52.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.502+0000 7f6505159700 1 -- 172.21.15.40:0/3590392774 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6500130700 msgr2=0x7f6500130b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:52.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.502+0000 7f6505159700 1 --2- 172.21.15.40:0/3590392774 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6500130700 0x7f6500130b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.502+0000 7f6505159700 1 -- 172.21.15.40:0/3590392774 >> v2:172.21.15.40:3300/0 conn(0x7f650009d450 msgr2=0x7f650009d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:52.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.502+0000 7f6505159700 1 --2- 172.21.15.40:0/3590392774 >> v2:172.21.15.40:3300/0 conn(0x7f650009d450 0x7f650009d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.502+0000 7f6505159700 1 -- 172.21.15.40:0/3590392774 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f650009b4f0 con 0x7f650009dd60 2023-09-30T22:29:52.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.503+0000 7fc50d023700 1 --2- 172.21.15.40:0/2572146748 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc50812e590 0x7fc50812e960 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fc504009920 tx=0x7fc504009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c90cb7a01fa752f7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:52.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.503+0000 7f6505159700 1 --2- 172.21.15.40:0/3590392774 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f650009dd60 0x7f65001301c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f64f0009920 tx=0x7f64f0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97e4b2fb6fb4d68c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:52.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.503+0000 7fc4fffff700 1 -- 172.21.15.40:0/2572146748 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc504011830 con 0x7fc50812e590 2023-09-30T22:29:52.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.503+0000 7f6504958700 1 -- 172.21.15.40:0/3590392774 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f000ba20 con 0x7f650009dd60 2023-09-30T22:29:52.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.503+0000 7f6504958700 1 -- 172.21.15.40:0/3590392774 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f000bb80 con 0x7f650009dd60 2023-09-30T22:29:52.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.503+0000 7f6504958700 1 -- 172.21.15.40:0/3590392774 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f0009e70 con 0x7f650009dd60 2023-09-30T22:29:52.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.503+0000 7fc4fffff700 1 -- 172.21.15.40:0/2572146748 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc504011990 con 0x7fc50812e590 2023-09-30T22:29:52.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.503+0000 7fc4fffff700 1 -- 172.21.15.40:0/2572146748 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc504011d20 con 0x7fc50812e590 2023-09-30T22:29:52.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.504+0000 7f6507bbe700 1 -- 172.21.15.40:0/3590392774 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f650009dd60 msgr2=0x7f65001301c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:52.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.504+0000 7f6507bbe700 1 --2- 172.21.15.40:0/3590392774 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f650009dd60 0x7f65001301c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f64f0009920 tx=0x7f64f0009c30 comp rx=0 tx=0).stop 2023-09-30T22:29:52.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.504+0000 7f6507bbe700 1 -- 172.21.15.40:0/3590392774 shutdown_connections 2023-09-30T22:29:52.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.504+0000 7f6507bbe700 1 --2- 172.21.15.40:0/3590392774 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6500130700 0x7f6500130b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.504+0000 7f6507bbe700 1 --2- 172.21.15.40:0/3590392774 >> v2:172.21.15.40:3300/0 conn(0x7f650009d450 0x7f650009d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.504+0000 7f6507bbe700 1 --2- 172.21.15.40:0/3590392774 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f650009dd60 0x7f65001301c0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.504+0000 7f6507bbe700 1 -- 172.21.15.40:0/3590392774 >> 172.21.15.40:0/3590392774 conn(0x7f65000a2a00 msgr2=0x7f65000a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:52.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.504+0000 7f6507bbe700 1 -- 172.21.15.40:0/3590392774 shutdown_connections 2023-09-30T22:29:52.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.504+0000 7f6507bbe700 1 -- 172.21.15.40:0/3590392774 wait complete. 2023-09-30T22:29:52.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.504+0000 7fc50f287700 1 -- 172.21.15.40:0/2572146748 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc50812e590 msgr2=0x7fc50812e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:52.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.504+0000 7fc50f287700 1 --2- 172.21.15.40:0/2572146748 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc50812e590 0x7fc50812e960 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fc504009920 tx=0x7fc504009c30 comp rx=0 tx=0).stop 2023-09-30T22:29:52.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.504+0000 7fc50f287700 1 -- 172.21.15.40:0/2572146748 shutdown_connections 2023-09-30T22:29:52.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.504+0000 7fc50f287700 1 --2- 172.21.15.40:0/2572146748 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc50812e590 0x7fc50812e960 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.504+0000 7fc50f287700 1 --2- 172.21.15.40:0/2572146748 >> v2:172.21.15.40:3300/0 conn(0x7fc50812eea0 0x7fc50812d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.504+0000 7fc50f287700 1 -- 172.21.15.40:0/2572146748 >> 172.21.15.40:0/2572146748 conn(0x7fc5080a2a00 msgr2=0x7fc5080a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:52.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.505+0000 7fc50f287700 1 -- 172.21.15.40:0/2572146748 shutdown_connections 2023-09-30T22:29:52.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.505+0000 7f6507bbe700 1 Processor -- start 2023-09-30T22:29:52.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.505+0000 7f6507bbe700 1 -- start start 2023-09-30T22:29:52.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.505+0000 7f6507bbe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f650009d450 0x7f6500137220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.505+0000 7f6507bbe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f650009dd60 0x7f65001c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.505+0000 7f6507bbe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6500130700 0x7f65001c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.505+0000 7f6507bbe700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6500139400 con 0x7f650009d450 2023-09-30T22:29:52.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.505+0000 7f6507bbe700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6500139ee0 con 0x7f6500130700 2023-09-30T22:29:52.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.505+0000 7f6507bbe700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f650009c5d0 con 0x7f650009dd60 2023-09-30T22:29:52.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.505+0000 7f650595a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f650009d450 0x7f6500137220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.505+0000 7f650595a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f650009d450 0x7f6500137220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50060/0 (socket says 172.21.15.40:50060) 2023-09-30T22:29:52.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.506+0000 7f650595a700 1 -- 172.21.15.40:0/3683587217 learned_addr learned my addr 172.21.15.40:0/3683587217 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:52.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.506+0000 7f650615b700 1 --2- 172.21.15.40:0/3683587217 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6500130700 0x7f65001c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.506+0000 7f6505159700 1 --2- 172.21.15.40:0/3683587217 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f650009dd60 0x7f65001c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.505+0000 7fc50f287700 1 -- 172.21.15.40:0/2572146748 wait complete. 2023-09-30T22:29:52.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.506+0000 7fc50f287700 1 Processor -- start 2023-09-30T22:29:52.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.506+0000 7f650595a700 1 -- 172.21.15.40:0/3683587217 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f650009dd60 msgr2=0x7f65001c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:52.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.506+0000 7f650595a700 1 --2- 172.21.15.40:0/3683587217 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f650009dd60 0x7f65001c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.506+0000 7f650595a700 1 -- 172.21.15.40:0/3683587217 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6500130700 msgr2=0x7f65001c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:52.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.506+0000 7f650595a700 1 --2- 172.21.15.40:0/3683587217 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6500130700 0x7f65001c8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.506+0000 7f650595a700 1 -- 172.21.15.40:0/3683587217 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f0009550 con 0x7f650009d450 2023-09-30T22:29:52.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.506+0000 7f650595a700 1 --2- 172.21.15.40:0/3683587217 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f650009d450 0x7f6500137220 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f64fc00d800 tx=0x7f64fc00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:52.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.506+0000 7f64f67fc700 1 -- 172.21.15.40:0/3683587217 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc0125f0 con 0x7f650009d450 2023-09-30T22:29:52.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.506+0000 7f64f67fc700 1 -- 172.21.15.40:0/3683587217 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64fc012750 con 0x7f650009d450 2023-09-30T22:29:52.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.506+0000 7f6507bbe700 1 -- 172.21.15.40:0/3683587217 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6500136cd0 con 0x7f650009d450 2023-09-30T22:29:52.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.506+0000 7fc50f287700 1 -- start start 2023-09-30T22:29:52.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.507+0000 7fc50f287700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc50812d6d0 0x7fc5081221c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.507+0000 7fc50f287700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc50812e590 0x7fc508122700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.507+0000 7fc50f287700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc50812eea0 0x7fc508122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.507+0000 7fc50f287700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc508123e00 con 0x7fc50812d6d0 2023-09-30T22:29:52.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.507+0000 7fc50f287700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc50809a900 con 0x7fc50812e590 2023-09-30T22:29:52.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.507+0000 7fc50f287700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc50809b4b0 con 0x7fc50812eea0 2023-09-30T22:29:52.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.506+0000 7f64f67fc700 1 -- 172.21.15.40:0/3683587217 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc012b00 con 0x7f650009d450 2023-09-30T22:29:52.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.507+0000 7f6507bbe700 1 -- 172.21.15.40:0/3683587217 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65001385b0 con 0x7f650009d450 2023-09-30T22:29:52.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.507+0000 7fc50d824700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc50812eea0 0x7fc508122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.507+0000 7fc50d824700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc50812eea0 0x7fc508122c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:38314/0 (socket says 172.21.15.40:38314) 2023-09-30T22:29:52.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.507+0000 7fc50d824700 1 -- 172.21.15.40:0/4270552496 learned_addr learned my addr 172.21.15.40:0/4270552496 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:52.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.507+0000 7fc50d023700 1 --2- 172.21.15.40:0/4270552496 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc50812d6d0 0x7fc5081221c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.507+0000 7fc50d824700 1 -- 172.21.15.40:0/4270552496 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc50812e590 msgr2=0x7fc508122700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:52.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.507+0000 7fc50d824700 1 --2- 172.21.15.40:0/4270552496 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc50812e590 0x7fc508122700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.507+0000 7fc50d824700 1 -- 172.21.15.40:0/4270552496 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc50812d6d0 msgr2=0x7fc5081221c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:52.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.507+0000 7fc50d824700 1 --2- 172.21.15.40:0/4270552496 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc50812d6d0 0x7fc5081221c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.508+0000 7fc50d824700 1 -- 172.21.15.40:0/4270552496 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc504009550 con 0x7fc50812eea0 2023-09-30T22:29:52.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.508+0000 7fc50d824700 1 --2- 172.21.15.40:0/4270552496 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc50812eea0 0x7fc508122c40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fc500001560 tx=0x7fc50000cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:52.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.508+0000 7fc4fdffb700 1 -- 172.21.15.40:0/4270552496 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc500003e30 con 0x7fc50812eea0 2023-09-30T22:29:52.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.508+0000 7fc4fdffb700 1 -- 172.21.15.40:0/4270552496 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc500005070 con 0x7fc50812eea0 2023-09-30T22:29:52.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.508+0000 7fc4fdffb700 1 -- 172.21.15.40:0/4270552496 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc500005420 con 0x7fc50812eea0 2023-09-30T22:29:52.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.508+0000 7fc50f287700 1 -- 172.21.15.40:0/4270552496 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc50809cdb0 con 0x7fc50812eea0 2023-09-30T22:29:52.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.508+0000 7fc50f287700 1 -- 172.21.15.40:0/4270552496 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5081244e0 con 0x7fc50812eea0 2023-09-30T22:29:52.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.509+0000 7fc4fdffb700 1 -- 172.21.15.40:0/4270552496 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc500005580 con 0x7fc50812eea0 2023-09-30T22:29:52.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.509+0000 7fc4fdffb700 1 -- 172.21.15.40:0/4270552496 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc50000a8e0 con 0x7fc50812eea0 2023-09-30T22:29:52.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.508+0000 7f6507bbe700 1 -- 172.21.15.40:0/3683587217 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6500062380 con 0x7f650009d450 2023-09-30T22:29:52.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.508+0000 7f64f67fc700 1 -- 172.21.15.40:0/3683587217 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f64fc012c60 con 0x7f650009d450 2023-09-30T22:29:52.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.509+0000 7f64f67fc700 1 -- 172.21.15.40:0/3683587217 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f64fc040310 con 0x7f650009d450 2023-09-30T22:29:52.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.510+0000 7fc50f287700 1 -- 172.21.15.40:0/4270552496 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc508125710 con 0x7fc50812eea0 2023-09-30T22:29:52.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.516+0000 7f64f67fc700 1 -- 172.21.15.40:0/3683587217 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f64fc01b770 con 0x7f650009d450 2023-09-30T22:29:52.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.518+0000 7fc4fdffb700 1 -- 172.21.15.40:0/4270552496 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc508125710 con 0x7fc50812eea0 2023-09-30T22:29:52.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.546+0000 7fbafaca5700 1 Processor -- start 2023-09-30T22:29:52.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.546+0000 7fbafaca5700 1 -- start start 2023-09-30T22:29:52.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.547+0000 7fbafaca5700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbaf409e400 0x7fbaf4135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.547+0000 7fbafaca5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbaf4136230 0x7fbaf4138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.547+0000 7fbafaca5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaf409adf0 con 0x7fbaf409d920 2023-09-30T22:29:52.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.547+0000 7fbafaca5700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaf409edf0 con 0x7fbaf409e400 2023-09-30T22:29:52.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.547+0000 7fbafaca5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf409b660 con 0x7fbaf4136230 2023-09-30T22:29:52.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.547+0000 7fbaf9242700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbaf4136230 0x7fbaf4138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.547+0000 7fbaf9242700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbaf4136230 0x7fbaf4138610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:38330/0 (socket says 172.21.15.40:38330) 2023-09-30T22:29:52.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.547+0000 7fbaf9242700 1 -- 172.21.15.40:0/1387977984 learned_addr learned my addr 172.21.15.40:0/1387977984 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:52.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.547+0000 7fbaf3fff700 1 --2- 172.21.15.40:0/1387977984 >> v2:172.21.15.40:3300/0 conn(0x7fbaf409e400 0x7fbaf4135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.547+0000 7fbaf37fe700 1 -- 172.21.15.40:0/1387977984 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1639261247 0 0) 0x7fbaf409adf0 con 0x7fbaf409d920 2023-09-30T22:29:52.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.548+0000 7fbaf37fe700 1 -- 172.21.15.40:0/1387977984 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbae40035b0 con 0x7fbaf409d920 2023-09-30T22:29:52.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.548+0000 7fbaf9242700 1 -- 172.21.15.40:0/1387977984 >> v2:172.21.15.40:3300/0 conn(0x7fbaf409e400 msgr2=0x7fbaf4135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:52.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.548+0000 7fbaf9242700 1 --2- 172.21.15.40:0/1387977984 >> v2:172.21.15.40:3300/0 conn(0x7fbaf409e400 0x7fbaf4135cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.548+0000 7fbaf9242700 1 -- 172.21.15.40:0/1387977984 >> v1:172.21.15.40:6789/0 conn(0x7fbaf409d920 legacy=0x7fbaf409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:52.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.548+0000 7fbaf9242700 1 -- 172.21.15.40:0/1387977984 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf409a6e0 con 0x7fbaf4136230 2023-09-30T22:29:52.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.548+0000 7fbaf9242700 1 --2- 172.21.15.40:0/1387977984 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbaf4136230 0x7fbaf4138610 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fbaec009e50 tx=0x7fbaec00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b36527221e467b08 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:52.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.548+0000 7fbaf37fe700 1 -- 172.21.15.40:0/1387977984 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaec00e070 con 0x7fbaf4136230 2023-09-30T22:29:52.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.548+0000 7fbaf37fe700 1 -- 172.21.15.40:0/1387977984 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaec00b910 con 0x7fbaf4136230 2023-09-30T22:29:52.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.548+0000 7fbaf37fe700 1 -- 172.21.15.40:0/1387977984 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaec00bcc0 con 0x7fbaf4136230 2023-09-30T22:29:52.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.549+0000 7fbafaca5700 1 -- 172.21.15.40:0/1387977984 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbaf4136230 msgr2=0x7fbaf4138610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:52.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.549+0000 7fbafaca5700 1 --2- 172.21.15.40:0/1387977984 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbaf4136230 0x7fbaf4138610 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fbaec009e50 tx=0x7fbaec00b330 comp rx=0 tx=0).stop 2023-09-30T22:29:52.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.549+0000 7fbafaca5700 1 -- 172.21.15.40:0/1387977984 shutdown_connections 2023-09-30T22:29:52.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.549+0000 7fbafaca5700 1 --2- 172.21.15.40:0/1387977984 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbaf4136230 0x7fbaf4138610 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.549+0000 7fbafaca5700 1 --2- 172.21.15.40:0/1387977984 >> v2:172.21.15.40:3300/0 conn(0x7fbaf409e400 0x7fbaf4135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.549+0000 7fbafaca5700 1 -- 172.21.15.40:0/1387977984 >> 172.21.15.40:0/1387977984 conn(0x7fbaf409fb20 msgr2=0x7fbaf409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:52.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.549+0000 7fbafaca5700 1 -- 172.21.15.40:0/1387977984 shutdown_connections 2023-09-30T22:29:52.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.549+0000 7fbafaca5700 1 -- 172.21.15.40:0/1387977984 wait complete. 2023-09-30T22:29:52.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.550+0000 7fbafaca5700 1 Processor -- start 2023-09-30T22:29:52.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.550+0000 7fbafaca5700 1 -- start start 2023-09-30T22:29:52.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.551+0000 7fbafaca5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbaf409d920 0x7fbaf4139b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.551+0000 7fbafaca5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbaf409e400 0x7fbaf413a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.551+0000 7fbafaca5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbaf4136230 0x7fbaf413a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:52.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.551+0000 7fbafaca5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf413b840 con 0x7fbaf4136230 2023-09-30T22:29:52.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.551+0000 7fbafaca5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf40a2fd0 con 0x7fbaf409e400 2023-09-30T22:29:52.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.551+0000 7fbafaca5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf41209e0 con 0x7fbaf409d920 2023-09-30T22:29:52.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.551+0000 7fbaf8a41700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbaf409d920 0x7fbaf4139b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.551+0000 7fbaf3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbaf409e400 0x7fbaf413a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.552+0000 7fbaf8a41700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbaf409d920 0x7fbaf4139b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:38344/0 (socket says 172.21.15.40:38344) 2023-09-30T22:29:52.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.552+0000 7fbaf3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbaf409e400 0x7fbaf413a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:40630/0 (socket says 172.21.15.40:40630) 2023-09-30T22:29:52.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.552+0000 7fbaf8a41700 1 -- 172.21.15.40:0/523727139 learned_addr learned my addr 172.21.15.40:0/523727139 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:52.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.552+0000 7fbaf9242700 1 --2- 172.21.15.40:0/523727139 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbaf4136230 0x7fbaf413a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:52.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.552+0000 7fbaf3fff700 1 -- 172.21.15.40:0/523727139 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbaf409d920 msgr2=0x7fbaf4139b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:52.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.552+0000 7fbaf3fff700 1 --2- 172.21.15.40:0/523727139 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbaf409d920 0x7fbaf4139b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.552+0000 7fbaf3fff700 1 -- 172.21.15.40:0/523727139 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbaf4136230 msgr2=0x7fbaf413a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:52.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.552+0000 7fbaf3fff700 1 --2- 172.21.15.40:0/523727139 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbaf4136230 0x7fbaf413a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.552+0000 7fbaf3fff700 1 -- 172.21.15.40:0/523727139 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaec009b30 con 0x7fbaf409e400 2023-09-30T22:29:52.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.552+0000 7fbaf8a41700 1 --2- 172.21.15.40:0/523727139 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbaf409d920 0x7fbaf4139b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:52.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.552+0000 7fbaf3fff700 1 --2- 172.21.15.40:0/523727139 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbaf409e400 0x7fbaf413a0d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fbae000c480 tx=0x7fbae000c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:52.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.552+0000 7fbaf17fa700 1 -- 172.21.15.40:0/523727139 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae0015bd0 con 0x7fbaf409e400 2023-09-30T22:29:52.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.552+0000 7fbaf17fa700 1 -- 172.21.15.40:0/523727139 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae0015d30 con 0x7fbaf409e400 2023-09-30T22:29:52.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.552+0000 7fbafaca5700 1 -- 172.21.15.40:0/523727139 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaf4120000 con 0x7fbaf409e400 2023-09-30T22:29:52.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.552+0000 7fbaf17fa700 1 -- 172.21.15.40:0/523727139 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae0015ea0 con 0x7fbaf409e400 2023-09-30T22:29:52.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.552+0000 7fbafaca5700 1 -- 172.21.15.40:0/523727139 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaf4120cc0 con 0x7fbaf409e400 2023-09-30T22:29:52.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.554+0000 7fbaf17fa700 1 -- 172.21.15.40:0/523727139 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbae0016250 con 0x7fbaf409e400 2023-09-30T22:29:52.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.554+0000 7fbafaca5700 1 -- 172.21.15.40:0/523727139 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaf4070700 con 0x7fbaf409e400 2023-09-30T22:29:52.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.554+0000 7fbaf17fa700 1 -- 172.21.15.40:0/523727139 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fbae0047860 con 0x7fbaf409e400 2023-09-30T22:29:52.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.563+0000 7fbaf17fa700 1 -- 172.21.15.40:0/523727139 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbae001d980 con 0x7fbaf409e400 2023-09-30T22:29:52.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.674+0000 7f253b902700 1 -- 172.21.15.40:0/1136763064 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f25340a04e0 con 0x7f2534139380 2023-09-30T22:29:52.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.674+0000 7f2529ffb700 1 -- 172.21.15.40:0/1136763064 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f252c01bb00 con 0x7f2534139380 2023-09-30T22:29:52.675 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:52.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.676+0000 7f253b902700 1 -- 172.21.15.40:0/1136763064 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2534139380 msgr2=0x7f2534138e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:52.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.676+0000 7f253b902700 1 --2- 172.21.15.40:0/1136763064 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2534139380 0x7f2534138e10 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f252c007e40 tx=0x7f252c00e3c0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.676+0000 7f253b902700 1 -- 172.21.15.40:0/1136763064 shutdown_connections 2023-09-30T22:29:52.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.676+0000 7f253b902700 1 --2- 172.21.15.40:0/1136763064 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f253406d0a0 0x7f2534138390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.676+0000 7f253b902700 1 --2- 172.21.15.40:0/1136763064 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2534139380 0x7f2534138e10 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.676+0000 7f253b902700 1 --2- 172.21.15.40:0/1136763064 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f253409fbb0 0x7f25341388d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.676+0000 7f253b902700 1 -- 172.21.15.40:0/1136763064 >> 172.21.15.40:0/1136763064 conn(0x7f25340a41a0 msgr2=0x7f25340a20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:52.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.676+0000 7f253b902700 1 -- 172.21.15.40:0/1136763064 shutdown_connections 2023-09-30T22:29:52.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.676+0000 7f253b902700 1 -- 172.21.15.40:0/1136763064 wait complete. 2023-09-30T22:29:52.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:52.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.730+0000 7fc50f287700 1 -- 172.21.15.40:0/4270552496 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc508125710 con 0x7fc50812eea0 2023-09-30T22:29:52.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.730+0000 7fc4fdffb700 1 -- 172.21.15.40:0/4270552496 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc508125710 con 0x7fc50812eea0 2023-09-30T22:29:52.732 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:52.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.733+0000 7fc50f287700 1 -- 172.21.15.40:0/4270552496 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc50812eea0 msgr2=0x7fc508122c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:52.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.733+0000 7fc50f287700 1 --2- 172.21.15.40:0/4270552496 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc50812eea0 0x7fc508122c40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fc500001560 tx=0x7fc50000cc00 comp rx=0 tx=0).stop 2023-09-30T22:29:52.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.733+0000 7fc50f287700 1 -- 172.21.15.40:0/4270552496 shutdown_connections 2023-09-30T22:29:52.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.733+0000 7fc50f287700 1 --2- 172.21.15.40:0/4270552496 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc50812eea0 0x7fc508122c40 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.733+0000 7fc50f287700 1 --2- 172.21.15.40:0/4270552496 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc50812d6d0 0x7fc5081221c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.733+0000 7fc50f287700 1 --2- 172.21.15.40:0/4270552496 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc50812e590 0x7fc508122700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.733+0000 7fc50f287700 1 -- 172.21.15.40:0/4270552496 >> 172.21.15.40:0/4270552496 conn(0x7fc5080a2a00 msgr2=0x7fc50812c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:52.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.734+0000 7fc50f287700 1 -- 172.21.15.40:0/4270552496 shutdown_connections 2023-09-30T22:29:52.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.734+0000 7fc50f287700 1 -- 172.21.15.40:0/4270552496 wait complete. 2023-09-30T22:29:52.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.741+0000 7f6507bbe700 1 -- 172.21.15.40:0/3683587217 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6500139b00 con 0x7f650009d450 2023-09-30T22:29:52.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.741+0000 7f64f67fc700 1 -- 172.21.15.40:0/3683587217 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f64fc01b360 con 0x7f650009d450 2023-09-30T22:29:52.742 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:52.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.743+0000 7f6507bbe700 1 -- 172.21.15.40:0/3683587217 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f650009d450 msgr2=0x7f6500137220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:52.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.743+0000 7f6507bbe700 1 --2- 172.21.15.40:0/3683587217 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f650009d450 0x7f6500137220 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f64fc00d800 tx=0x7f64fc00db10 comp rx=0 tx=0).stop 2023-09-30T22:29:52.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.743+0000 7f6507bbe700 1 -- 172.21.15.40:0/3683587217 shutdown_connections 2023-09-30T22:29:52.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.743+0000 7f6507bbe700 1 --2- 172.21.15.40:0/3683587217 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6500130700 0x7f65001c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.743+0000 7f6507bbe700 1 --2- 172.21.15.40:0/3683587217 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f650009d450 0x7f6500137220 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.743+0000 7f6507bbe700 1 --2- 172.21.15.40:0/3683587217 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f650009dd60 0x7f65001c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.744+0000 7f6507bbe700 1 -- 172.21.15.40:0/3683587217 >> 172.21.15.40:0/3683587217 conn(0x7f65000a2a00 msgr2=0x7f65000a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:52.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.744+0000 7f6507bbe700 1 -- 172.21.15.40:0/3683587217 shutdown_connections 2023-09-30T22:29:52.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.744+0000 7f6507bbe700 1 -- 172.21.15.40:0/3683587217 wait complete. 2023-09-30T22:29:52.747 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:52.757 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:52.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.776+0000 7fbafaca5700 1 -- 172.21.15.40:0/523727139 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbaf4062380 con 0x7fbaf409e400 2023-09-30T22:29:52.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.777+0000 7fbaf17fa700 1 -- 172.21.15.40:0/523727139 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbae001d390 con 0x7fbaf409e400 2023-09-30T22:29:52.778 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:52.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.779+0000 7fbafaca5700 1 -- 172.21.15.40:0/523727139 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbaf409e400 msgr2=0x7fbaf413a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:52.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.779+0000 7fbafaca5700 1 --2- 172.21.15.40:0/523727139 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbaf409e400 0x7fbaf413a0d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fbae000c480 tx=0x7fbae000c790 comp rx=0 tx=0).stop 2023-09-30T22:29:52.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.779+0000 7fbafaca5700 1 -- 172.21.15.40:0/523727139 shutdown_connections 2023-09-30T22:29:52.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.779+0000 7fbafaca5700 1 --2- 172.21.15.40:0/523727139 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbaf409d920 0x7fbaf4139b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.779+0000 7fbafaca5700 1 --2- 172.21.15.40:0/523727139 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbaf4136230 0x7fbaf413a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.779+0000 7fbafaca5700 1 --2- 172.21.15.40:0/523727139 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbaf409e400 0x7fbaf413a0d0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:52.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.779+0000 7fbafaca5700 1 -- 172.21.15.40:0/523727139 >> 172.21.15.40:0/523727139 conn(0x7fbaf409fb20 msgr2=0x7fbaf4139230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:52.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.779+0000 7fbafaca5700 1 -- 172.21.15.40:0/523727139 shutdown_connections 2023-09-30T22:29:52.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:52.779+0000 7fbafaca5700 1 -- 172.21.15.40:0/523727139 wait complete. 2023-09-30T22:29:52.791 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:53.690 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:53.748 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:53.758 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:53.792 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:53.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.844+0000 7f474c236700 1 Processor -- start 2023-09-30T22:29:53.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.844+0000 7f474c236700 1 -- start start 2023-09-30T22:29:53.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.845+0000 7f474c236700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f474409e400 0x7f4744135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:53.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.845+0000 7f474c236700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4744136230 0x7f4744138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:53.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.845+0000 7f474c236700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f474409adf0 con 0x7f474409d920 2023-09-30T22:29:53.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.845+0000 7f474c236700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f474409edf0 con 0x7f474409e400 2023-09-30T22:29:53.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.845+0000 7f474c236700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f474409b660 con 0x7f4744136230 2023-09-30T22:29:53.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.845+0000 7f47497d1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f474409e400 0x7f4744135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:53.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.845+0000 7f4749fd2700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f474409d920 0x7f474409dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33020/0 (socket says 172.21.15.40:33020) 2023-09-30T22:29:53.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.845+0000 7f4749fd2700 1 -- 172.21.15.40:0/3988221255 learned_addr learned my addr 172.21.15.40:0/3988221255 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:29:53.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.845+0000 7f47497d1700 1 --2- 172.21.15.40:0/3988221255 >> v2:172.21.15.40:3300/0 conn(0x7f474409e400 0x7f4744135cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36578/0 (socket says 172.21.15.40:36578) 2023-09-30T22:29:53.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.845+0000 7f474a7d3700 1 --2- 172.21.15.40:0/3988221255 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4744136230 0x7f4744138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:53.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.845+0000 7f47497d1700 1 -- 172.21.15.40:0/3988221255 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4744136230 msgr2=0x7f4744138610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:53.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.845+0000 7f47497d1700 1 --2- 172.21.15.40:0/3988221255 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4744136230 0x7f4744138610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:53.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.845+0000 7f47497d1700 1 -- 172.21.15.40:0/3988221255 >> v1:172.21.15.40:6789/0 conn(0x7f474409d920 legacy=0x7f474409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:53.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.845+0000 7f4748fd0700 1 -- 172.21.15.40:0/3988221255 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445205629 0 0) 0x7f474409adf0 con 0x7f474409d920 2023-09-30T22:29:53.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.845+0000 7f47497d1700 1 -- 172.21.15.40:0/3988221255 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f474409a6e0 con 0x7f474409e400 2023-09-30T22:29:53.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.845+0000 7f474a7d3700 1 --2- 172.21.15.40:0/3988221255 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4744136230 0x7f4744138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:53.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.846+0000 7f47497d1700 1 --2- 172.21.15.40:0/3988221255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f474409e400 0x7f4744135cf0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f4734009840 tx=0x7f4734009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ce2eea819baac7f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:53.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.846+0000 7f4748fd0700 1 -- 172.21.15.40:0/3988221255 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4734011830 con 0x7f474409e400 2023-09-30T22:29:53.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.846+0000 7f4748fd0700 1 -- 172.21.15.40:0/3988221255 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4734011990 con 0x7f474409e400 2023-09-30T22:29:53.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.846+0000 7f4748fd0700 1 -- 172.21.15.40:0/3988221255 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4734011d20 con 0x7f474409e400 2023-09-30T22:29:53.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.846+0000 7f474c236700 1 -- 172.21.15.40:0/3988221255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f474409e400 msgr2=0x7f4744135cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:53.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.847+0000 7f474c236700 1 --2- 172.21.15.40:0/3988221255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f474409e400 0x7f4744135cf0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f4734009840 tx=0x7f4734009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:53.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.847+0000 7f474c236700 1 -- 172.21.15.40:0/3988221255 shutdown_connections 2023-09-30T22:29:53.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.847+0000 7f474c236700 1 --2- 172.21.15.40:0/3988221255 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4744136230 0x7f4744138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:53.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.847+0000 7f474c236700 1 --2- 172.21.15.40:0/3988221255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f474409e400 0x7f4744135cf0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:53.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.847+0000 7f474c236700 1 -- 172.21.15.40:0/3988221255 >> 172.21.15.40:0/3988221255 conn(0x7f474409fb20 msgr2=0x7f474409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:53.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.847+0000 7f474c236700 1 -- 172.21.15.40:0/3988221255 shutdown_connections 2023-09-30T22:29:53.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.847+0000 7f474c236700 1 -- 172.21.15.40:0/3988221255 wait complete. 2023-09-30T22:29:53.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.848+0000 7f474c236700 1 Processor -- start 2023-09-30T22:29:53.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.848+0000 7f474c236700 1 -- start start 2023-09-30T22:29:53.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.849+0000 7f474c236700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f474409d920 0x7f4744122a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:53.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.849+0000 7f474c236700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f474409e400 0x7f4744122f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:53.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.849+0000 7f474c236700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4744136230 0x7f4744123480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:53.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.849+0000 7f474c236700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4744124bc0 con 0x7f474409d920 2023-09-30T22:29:53.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.849+0000 7f474c236700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4744124720 con 0x7f474409e400 2023-09-30T22:29:53.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.849+0000 7f474c236700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4744135970 con 0x7f4744136230 2023-09-30T22:29:53.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.849+0000 7f474a7d3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4744136230 0x7f4744123480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:53.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.849+0000 7f474a7d3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4744136230 0x7f4744123480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:39438/0 (socket says 172.21.15.40:39438) 2023-09-30T22:29:53.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.849+0000 7f474a7d3700 1 -- 172.21.15.40:0/696884640 learned_addr learned my addr 172.21.15.40:0/696884640 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:53.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.849+0000 7f4749fd2700 1 --2- 172.21.15.40:0/696884640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f474409d920 0x7f4744122a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:53.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.849+0000 7f47497d1700 1 --2- 172.21.15.40:0/696884640 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f474409e400 0x7f4744122f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:53.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.849+0000 7f474a7d3700 1 -- 172.21.15.40:0/696884640 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f474409e400 msgr2=0x7f4744122f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:53.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.849+0000 7f474a7d3700 1 --2- 172.21.15.40:0/696884640 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f474409e400 0x7f4744122f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:53.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.849+0000 7f474a7d3700 1 -- 172.21.15.40:0/696884640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f474409d920 msgr2=0x7f4744122a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:53.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.849+0000 7f474a7d3700 1 --2- 172.21.15.40:0/696884640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f474409d920 0x7f4744122a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:53.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.850+0000 7f474a7d3700 1 -- 172.21.15.40:0/696884640 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f473c0099e0 con 0x7f4744136230 2023-09-30T22:29:53.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.850+0000 7f474a7d3700 1 --2- 172.21.15.40:0/696884640 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4744136230 0x7f4744123480 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f473c00feb0 tx=0x7f473c00e430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:53.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.850+0000 7f473a7fc700 1 -- 172.21.15.40:0/696884640 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c00eda0 con 0x7f4744136230 2023-09-30T22:29:53.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.850+0000 7f473a7fc700 1 -- 172.21.15.40:0/696884640 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473c003a20 con 0x7f4744136230 2023-09-30T22:29:53.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.850+0000 7f474c236700 1 -- 172.21.15.40:0/696884640 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47340094a0 con 0x7f4744136230 2023-09-30T22:29:53.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.850+0000 7f473a7fc700 1 -- 172.21.15.40:0/696884640 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c003db0 con 0x7f4744136230 2023-09-30T22:29:53.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.850+0000 7f474c236700 1 -- 172.21.15.40:0/696884640 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4744126240 con 0x7f4744136230 2023-09-30T22:29:53.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.851+0000 7f473a7fc700 1 -- 172.21.15.40:0/696884640 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f473c004030 con 0x7f4744136230 2023-09-30T22:29:53.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.851+0000 7f473a7fc700 1 -- 172.21.15.40:0/696884640 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f473c03fe70 con 0x7f4744136230 2023-09-30T22:29:53.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.852+0000 7f474c236700 1 -- 172.21.15.40:0/696884640 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4744062380 con 0x7f4744136230 2023-09-30T22:29:53.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.861+0000 7f473a7fc700 1 -- 172.21.15.40:0/696884640 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f473c012930 con 0x7f4744136230 2023-09-30T22:29:53.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.896+0000 7f8dc5ba5700 1 Processor -- start 2023-09-30T22:29:53.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.896+0000 7f8dc5ba5700 1 -- start start 2023-09-30T22:29:53.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.897+0000 7f8dc5ba5700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8dc009d920 0x7f8dc009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:53.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.897+0000 7f8dc5ba5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8dc009e230 0x7f8dc01343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:53.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.897+0000 7f8dc5ba5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dc009f940 con 0x7f8dc009f0f0 2023-09-30T22:29:53.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.897+0000 7f8dc5ba5700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc006b4c0 con 0x7f8dc009d920 2023-09-30T22:29:53.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.897+0000 7f8dc5ba5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc009a8f0 con 0x7f8dc009e230 2023-09-30T22:29:53.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.897+0000 7f8dbf7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8dc009d920 0x7f8dc009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:53.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.897+0000 7f8dbf7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8dc009d920 0x7f8dc009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36586/0 (socket says 172.21.15.40:36586) 2023-09-30T22:29:53.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.897+0000 7f8dbf7fe700 1 -- 172.21.15.40:0/2216766022 learned_addr learned my addr 172.21.15.40:0/2216766022 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:53.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.897+0000 7f8dbffff700 1 --2- 172.21.15.40:0/2216766022 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8dc009e230 0x7f8dc01343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:53.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.897+0000 7f8dbf7fe700 1 -- 172.21.15.40:0/2216766022 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8dc009e230 msgr2=0x7f8dc01343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:53.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.897+0000 7f8dbf7fe700 1 --2- 172.21.15.40:0/2216766022 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8dc009e230 0x7f8dc01343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:53.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.897+0000 7f8dbf7fe700 1 -- 172.21.15.40:0/2216766022 >> v1:172.21.15.40:6789/0 conn(0x7f8dc009f0f0 legacy=0x7f8dc0133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:53.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.897+0000 7f8dbf7fe700 1 -- 172.21.15.40:0/2216766022 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc009f6e0 con 0x7f8dc009d920 2023-09-30T22:29:53.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.897+0000 7f8dbffff700 1 --2- 172.21.15.40:0/2216766022 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8dc009e230 0x7f8dc01343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:53.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.897+0000 7f8dbf7fe700 1 --2- 172.21.15.40:0/2216766022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8dc009d920 0x7f8dc009dcf0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f8db0006fd0 tx=0x7f8db0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be73a4183a68c921 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:53.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.898+0000 7f8dbe7fc700 1 -- 172.21.15.40:0/2216766022 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db0005e30 con 0x7f8dc009d920 2023-09-30T22:29:53.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.898+0000 7f8dbe7fc700 1 -- 172.21.15.40:0/2216766022 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db0004030 con 0x7f8dc009d920 2023-09-30T22:29:53.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.898+0000 7f8dbe7fc700 1 -- 172.21.15.40:0/2216766022 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db00043e0 con 0x7f8dc009d920 2023-09-30T22:29:53.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.899+0000 7f8dc5ba5700 1 -- 172.21.15.40:0/2216766022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8dc009d920 msgr2=0x7f8dc009dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:53.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.899+0000 7f8dc5ba5700 1 --2- 172.21.15.40:0/2216766022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8dc009d920 0x7f8dc009dcf0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f8db0006fd0 tx=0x7f8db0009bd0 comp rx=0 tx=0).stop 2023-09-30T22:29:53.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.899+0000 7f8dc5ba5700 1 -- 172.21.15.40:0/2216766022 shutdown_connections 2023-09-30T22:29:53.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.899+0000 7f8dc5ba5700 1 --2- 172.21.15.40:0/2216766022 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8dc009e230 0x7f8dc01343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:53.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.899+0000 7f8dc5ba5700 1 --2- 172.21.15.40:0/2216766022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8dc009d920 0x7f8dc009dcf0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:53.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.899+0000 7f8dc5ba5700 1 -- 172.21.15.40:0/2216766022 >> 172.21.15.40:0/2216766022 conn(0x7f8dc009fb20 msgr2=0x7f8dc009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:53.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.899+0000 7f8dc5ba5700 1 -- 172.21.15.40:0/2216766022 shutdown_connections 2023-09-30T22:29:53.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.899+0000 7f8dc5ba5700 1 -- 172.21.15.40:0/2216766022 wait complete. 2023-09-30T22:29:53.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.900+0000 7f8dc5ba5700 1 Processor -- start 2023-09-30T22:29:53.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.900+0000 7f8dc5ba5700 1 -- start start 2023-09-30T22:29:53.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.901+0000 7f8dc5ba5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8dc009d920 0x7f8dc01a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:53.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.901+0000 7f8dc5ba5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8dc009e230 0x7f8dc01a66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:53.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.901+0000 7f8dc5ba5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8dc01b9400 0x7f8dc01a6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:53.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.901+0000 7f8dc5ba5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc01a7660 con 0x7f8dc009e230 2023-09-30T22:29:53.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.901+0000 7f8dc5ba5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc01a8a80 con 0x7f8dc01b9400 2023-09-30T22:29:53.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.901+0000 7f8dc5ba5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc01a9c30 con 0x7f8dc009d920 2023-09-30T22:29:53.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.901+0000 7f8dbffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8dc01b9400 0x7f8dc01a6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:53.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.901+0000 7f8dbeffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8dc009e230 0x7f8dc01a66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:53.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.901+0000 7f8dbffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8dc01b9400 0x7f8dc01a6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:45658/0 (socket says 172.21.15.40:45658) 2023-09-30T22:29:53.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.901+0000 7f8dbffff700 1 -- 172.21.15.40:0/4188091938 learned_addr learned my addr 172.21.15.40:0/4188091938 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:53.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.901+0000 7f8dbf7fe700 1 --2- 172.21.15.40:0/4188091938 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8dc009d920 0x7f8dc01a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:53.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.902+0000 7f8dbffff700 1 -- 172.21.15.40:0/4188091938 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8dc009d920 msgr2=0x7f8dc01a6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:53.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.902+0000 7f8dbffff700 1 --2- 172.21.15.40:0/4188091938 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8dc009d920 0x7f8dc01a6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:53.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.902+0000 7f8dbffff700 1 -- 172.21.15.40:0/4188091938 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8dc009e230 msgr2=0x7f8dc01a66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:53.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.902+0000 7f8dbffff700 1 --2- 172.21.15.40:0/4188091938 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8dc009e230 0x7f8dc01a66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:53.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.902+0000 7f8dbffff700 1 -- 172.21.15.40:0/4188091938 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db8009a70 con 0x7f8dc01b9400 2023-09-30T22:29:53.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.902+0000 7f8dbeffd700 1 --2- 172.21.15.40:0/4188091938 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8dc009e230 0x7f8dc01a66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:53.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.902+0000 7f8dbffff700 1 --2- 172.21.15.40:0/4188091938 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8dc01b9400 0x7f8dc01a6c10 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f8db800efc0 tx=0x7f8db800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:53.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.902+0000 7f8da7fff700 1 -- 172.21.15.40:0/4188091938 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db800ca90 con 0x7f8dc01b9400 2023-09-30T22:29:53.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.902+0000 7f8da7fff700 1 -- 172.21.15.40:0/4188091938 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db800f040 con 0x7f8dc01b9400 2023-09-30T22:29:53.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.902+0000 7f8dc5ba5700 1 -- 172.21.15.40:0/4188091938 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8db0009500 con 0x7f8dc01b9400 2023-09-30T22:29:53.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.902+0000 7f8da7fff700 1 -- 172.21.15.40:0/4188091938 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db800ce10 con 0x7f8dc01b9400 2023-09-30T22:29:53.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.902+0000 7f8dc5ba5700 1 -- 172.21.15.40:0/4188091938 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc01a7cb0 con 0x7f8dc01b9400 2023-09-30T22:29:53.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.903+0000 7f8dc5ba5700 1 -- 172.21.15.40:0/4188091938 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dc01a97b0 con 0x7f8dc01b9400 2023-09-30T22:29:53.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.903+0000 7f8da7fff700 1 -- 172.21.15.40:0/4188091938 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8db8014480 con 0x7f8dc01b9400 2023-09-30T22:29:53.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.904+0000 7f8da7fff700 1 -- 172.21.15.40:0/4188091938 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f8db803fd10 con 0x7f8dc01b9400 2023-09-30T22:29:53.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.908+0000 7f8da7fff700 1 -- 172.21.15.40:0/4188091938 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8dc01a97b0 con 0x7f8dc01b9400 2023-09-30T22:29:53.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.939+0000 7efd6a41e700 1 Processor -- start 2023-09-30T22:29:53.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.939+0000 7efd6a41e700 1 -- start start 2023-09-30T22:29:53.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.940+0000 7efd6a41e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd64138250 0x7efd64138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:53.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.940+0000 7efd6a41e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efd6409df20 0x7efd64140160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:53.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.940+0000 7efd6a41e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd64137e20 con 0x7efd6409d400 2023-09-30T22:29:53.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.940+0000 7efd6a41e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd64138050 con 0x7efd6409df20 2023-09-30T22:29:53.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.940+0000 7efd6a41e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6409b010 con 0x7efd64138250 2023-09-30T22:29:53.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.940+0000 7efd689bb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efd6409df20 0x7efd64140160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:53.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.940+0000 7efd689bb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efd6409df20 0x7efd64140160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36614/0 (socket says 172.21.15.40:36614) 2023-09-30T22:29:53.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.940+0000 7efd689bb700 1 -- 172.21.15.40:0/3534670574 learned_addr learned my addr 172.21.15.40:0/3534670574 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:53.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.940+0000 7efd63fff700 1 --2- 172.21.15.40:0/3534670574 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd64138250 0x7efd64138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:53.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.940+0000 7efd689bb700 1 -- 172.21.15.40:0/3534670574 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd64138250 msgr2=0x7efd64138620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:53.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.940+0000 7efd689bb700 1 --2- 172.21.15.40:0/3534670574 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd64138250 0x7efd64138620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:53.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.940+0000 7efd689bb700 1 -- 172.21.15.40:0/3534670574 >> v1:172.21.15.40:6789/0 conn(0x7efd6409d400 legacy=0x7efd6409d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:53.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.940+0000 7efd689bb700 1 -- 172.21.15.40:0/3534670574 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6409f1f0 con 0x7efd6409df20 2023-09-30T22:29:53.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.940+0000 7efd689bb700 1 --2- 172.21.15.40:0/3534670574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd6409df20 0x7efd64140160 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7efd5c009e50 tx=0x7efd5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcfba54b6656395d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:53.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.941+0000 7efd62ffd700 1 -- 172.21.15.40:0/3534670574 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c00e070 con 0x7efd6409df20 2023-09-30T22:29:53.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.941+0000 7efd62ffd700 1 -- 172.21.15.40:0/3534670574 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5c00b910 con 0x7efd6409df20 2023-09-30T22:29:53.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.941+0000 7efd62ffd700 1 -- 172.21.15.40:0/3534670574 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c00bcc0 con 0x7efd6409df20 2023-09-30T22:29:53.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.941+0000 7efd6a41e700 1 -- 172.21.15.40:0/3534670574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd6409df20 msgr2=0x7efd64140160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:53.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.941+0000 7efd6a41e700 1 --2- 172.21.15.40:0/3534670574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd6409df20 0x7efd64140160 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7efd5c009e50 tx=0x7efd5c00b330 comp rx=0 tx=0).stop 2023-09-30T22:29:53.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.941+0000 7efd6a41e700 1 -- 172.21.15.40:0/3534670574 shutdown_connections 2023-09-30T22:29:53.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.941+0000 7efd6a41e700 1 --2- 172.21.15.40:0/3534670574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd6409df20 0x7efd64140160 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:53.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.941+0000 7efd6a41e700 1 --2- 172.21.15.40:0/3534670574 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd64138250 0x7efd64138620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:53.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.941+0000 7efd6a41e700 1 -- 172.21.15.40:0/3534670574 >> 172.21.15.40:0/3534670574 conn(0x7efd640a2a00 msgr2=0x7efd640a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:53.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.942+0000 7efd6a41e700 1 -- 172.21.15.40:0/3534670574 shutdown_connections 2023-09-30T22:29:53.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.942+0000 7efd6a41e700 1 -- 172.21.15.40:0/3534670574 wait complete. 2023-09-30T22:29:53.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.942+0000 7efd6a41e700 1 Processor -- start 2023-09-30T22:29:53.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.943+0000 7efd6a41e700 1 -- start start 2023-09-30T22:29:53.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.943+0000 7efd6a41e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd6409d400 0x7efd64122310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:53.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.943+0000 7efd6a41e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd6409df20 0x7efd64122850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:53.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.943+0000 7efd6a41e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd64138250 0x7efd64122d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:53.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.943+0000 7efd6a41e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd64135700 con 0x7efd6409df20 2023-09-30T22:29:53.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.943+0000 7efd6a41e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd64124540 con 0x7efd64138250 2023-09-30T22:29:53.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.943+0000 7efd6a41e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd64123770 con 0x7efd6409d400 2023-09-30T22:29:53.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.943+0000 7efd63fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd6409d400 0x7efd64122310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:53.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.943+0000 7efd63fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd6409d400 0x7efd64122310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:39470/0 (socket says 172.21.15.40:39470) 2023-09-30T22:29:53.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.943+0000 7efd689bb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd64138250 0x7efd64122d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:53.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.943+0000 7efd63fff700 1 -- 172.21.15.40:0/1784318153 learned_addr learned my addr 172.21.15.40:0/1784318153 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:53.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.943+0000 7efd637fe700 1 --2- 172.21.15.40:0/1784318153 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd6409df20 0x7efd64122850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:53.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.944+0000 7efd63fff700 1 -- 172.21.15.40:0/1784318153 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd64138250 msgr2=0x7efd64122d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:53.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.944+0000 7efd63fff700 1 --2- 172.21.15.40:0/1784318153 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd64138250 0x7efd64122d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:53.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.944+0000 7efd63fff700 1 -- 172.21.15.40:0/1784318153 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd6409df20 msgr2=0x7efd64122850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:53.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.944+0000 7efd63fff700 1 --2- 172.21.15.40:0/1784318153 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd6409df20 0x7efd64122850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:53.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.944+0000 7efd63fff700 1 -- 172.21.15.40:0/1784318153 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5c009b30 con 0x7efd6409d400 2023-09-30T22:29:53.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.944+0000 7efd63fff700 1 --2- 172.21.15.40:0/1784318153 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd6409d400 0x7efd64122310 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7efd5400e9e0 tx=0x7efd5400ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:53.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.944+0000 7efd60ff9700 1 -- 172.21.15.40:0/1784318153 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd54009710 con 0x7efd6409d400 2023-09-30T22:29:53.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.944+0000 7efd60ff9700 1 -- 172.21.15.40:0/1784318153 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5400ee80 con 0x7efd6409d400 2023-09-30T22:29:53.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.944+0000 7efd60ff9700 1 -- 172.21.15.40:0/1784318153 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5400ca50 con 0x7efd6409d400 2023-09-30T22:29:53.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.944+0000 7efd6a41e700 1 -- 172.21.15.40:0/1784318153 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd64125170 con 0x7efd6409d400 2023-09-30T22:29:53.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.944+0000 7efd6a41e700 1 -- 172.21.15.40:0/1784318153 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd640a10d0 con 0x7efd6409d400 2023-09-30T22:29:53.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.946+0000 7efd60ff9700 1 -- 172.21.15.40:0/1784318153 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efd5400cbb0 con 0x7efd6409d400 2023-09-30T22:29:53.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.946+0000 7efd6a41e700 1 -- 172.21.15.40:0/1784318153 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd6409a360 con 0x7efd6409d400 2023-09-30T22:29:53.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.946+0000 7efd60ff9700 1 -- 172.21.15.40:0/1784318153 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7efd5403fbf0 con 0x7efd6409d400 2023-09-30T22:29:53.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.949+0000 7fde40f59700 1 Processor -- start 2023-09-30T22:29:53.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.949+0000 7fde40f59700 1 -- start start 2023-09-30T22:29:53.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.949+0000 7fde40f59700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fde3c09d450 0x7fde3c09d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:53.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.949+0000 7fde40f59700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fde3c1308d0 0x7fde3c138420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:53.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.949+0000 7fde40f59700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde3c09e8b0 con 0x7fde3c09dd60 2023-09-30T22:29:53.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.949+0000 7fde40f59700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde3c09c3b0 con 0x7fde3c09d450 2023-09-30T22:29:53.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.949+0000 7fde40f59700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c09a6b0 con 0x7fde3c1308d0 2023-09-30T22:29:53.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.950+0000 7fde3ad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fde3c1308d0 0x7fde3c138420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:53.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.950+0000 7fde3ad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fde3c1308d0 0x7fde3c138420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:39472/0 (socket says 172.21.15.40:39472) 2023-09-30T22:29:53.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.950+0000 7fde3ad9d700 1 -- 172.21.15.40:0/1079330034 learned_addr learned my addr 172.21.15.40:0/1079330034 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:53.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.950+0000 7fde3ad9d700 1 -- 172.21.15.40:0/1079330034 >> v2:172.21.15.40:3300/0 conn(0x7fde3c09d450 msgr2=0x7fde3c09d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:53.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.950+0000 7fde3ad9d700 1 --2- 172.21.15.40:0/1079330034 >> v2:172.21.15.40:3300/0 conn(0x7fde3c09d450 0x7fde3c09d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:53.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.950+0000 7fde3ad9d700 1 -- 172.21.15.40:0/1079330034 >> v1:172.21.15.40:6789/0 conn(0x7fde3c09dd60 legacy=0x7fde3c1301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:53.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.950+0000 7fde3ad9d700 1 -- 172.21.15.40:0/1079330034 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3c09b4f0 con 0x7fde3c1308d0 2023-09-30T22:29:53.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.950+0000 7fde3ad9d700 1 --2- 172.21.15.40:0/1079330034 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fde3c1308d0 0x7fde3c138420 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fde3400af60 tx=0x7fde3400af90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffa83c287d6df595 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:53.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.951+0000 7fde3959a700 1 -- 172.21.15.40:0/1079330034 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3400f070 con 0x7fde3c1308d0 2023-09-30T22:29:53.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.951+0000 7fde3959a700 1 -- 172.21.15.40:0/1079330034 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3400a2e0 con 0x7fde3c1308d0 2023-09-30T22:29:53.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.951+0000 7fde3959a700 1 -- 172.21.15.40:0/1079330034 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3400cc70 con 0x7fde3c1308d0 2023-09-30T22:29:53.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.951+0000 7efd60ff9700 1 -- 172.21.15.40:0/1784318153 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efd5401b3b0 con 0x7efd6409d400 2023-09-30T22:29:53.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.951+0000 7fde40f59700 1 -- 172.21.15.40:0/1079330034 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fde3c1308d0 msgr2=0x7fde3c138420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:53.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.951+0000 7fde40f59700 1 --2- 172.21.15.40:0/1079330034 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fde3c1308d0 0x7fde3c138420 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fde3400af60 tx=0x7fde3400af90 comp rx=0 tx=0).stop 2023-09-30T22:29:53.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.952+0000 7fde40f59700 1 -- 172.21.15.40:0/1079330034 shutdown_connections 2023-09-30T22:29:53.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.952+0000 7fde40f59700 1 --2- 172.21.15.40:0/1079330034 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fde3c1308d0 0x7fde3c138420 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:53.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.952+0000 7fde40f59700 1 --2- 172.21.15.40:0/1079330034 >> v2:172.21.15.40:3300/0 conn(0x7fde3c09d450 0x7fde3c09d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:53.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.952+0000 7fde40f59700 1 -- 172.21.15.40:0/1079330034 >> 172.21.15.40:0/1079330034 conn(0x7fde3c0a2a00 msgr2=0x7fde3c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:53.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.952+0000 7fde40f59700 1 -- 172.21.15.40:0/1079330034 shutdown_connections 2023-09-30T22:29:53.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.952+0000 7fde40f59700 1 -- 172.21.15.40:0/1079330034 wait complete. 2023-09-30T22:29:53.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.953+0000 7fde40f59700 1 Processor -- start 2023-09-30T22:29:53.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.953+0000 7fde40f59700 1 -- start start 2023-09-30T22:29:53.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.953+0000 7fde40f59700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fde3c09d450 0x7fde3c1c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:53.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.953+0000 7fde40f59700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde3c09dd60 0x7fde3c1c4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:53.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.953+0000 7fde40f59700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde3c1308d0 0x7fde3c1c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:53.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.953+0000 7fde40f59700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c11bf10 con 0x7fde3c09dd60 2023-09-30T22:29:53.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.953+0000 7fde40f59700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c11bd20 con 0x7fde3c1308d0 2023-09-30T22:29:53.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.953+0000 7fde40f59700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c11dc30 con 0x7fde3c09d450 2023-09-30T22:29:53.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.953+0000 7fde3a59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fde3c09d450 0x7fde3c1c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:53.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.953+0000 7fde3a59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fde3c09d450 0x7fde3c1c41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:39478/0 (socket says 172.21.15.40:39478) 2023-09-30T22:29:53.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.953+0000 7fde3a59c700 1 -- 172.21.15.40:0/3353755791 learned_addr learned my addr 172.21.15.40:0/3353755791 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:53.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.954+0000 7fde3ad9d700 1 --2- 172.21.15.40:0/3353755791 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde3c1308d0 0x7fde3c1c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:53.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.954+0000 7fde3a59c700 1 -- 172.21.15.40:0/3353755791 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde3c1308d0 msgr2=0x7fde3c1c4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:53.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.954+0000 7fde3a59c700 1 --2- 172.21.15.40:0/3353755791 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde3c1308d0 0x7fde3c1c4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:53.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.954+0000 7fde3a59c700 1 -- 172.21.15.40:0/3353755791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde3c09dd60 msgr2=0x7fde3c1c4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:53.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.954+0000 7fde3a59c700 1 --2- 172.21.15.40:0/3353755791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde3c09dd60 0x7fde3c1c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:53.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.954+0000 7fde3a59c700 1 -- 172.21.15.40:0/3353755791 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3400ac40 con 0x7fde3c09d450 2023-09-30T22:29:53.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.954+0000 7fde3a59c700 1 --2- 172.21.15.40:0/3353755791 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fde3c09d450 0x7fde3c1c41e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fde2c013f70 tx=0x7fde2c007320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:53.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.954+0000 7fde2affd700 1 -- 172.21.15.40:0/3353755791 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2c027070 con 0x7fde3c09d450 2023-09-30T22:29:53.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.954+0000 7fde2affd700 1 -- 172.21.15.40:0/3353755791 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2c00b070 con 0x7fde3c09d450 2023-09-30T22:29:53.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.954+0000 7fde40f59700 1 -- 172.21.15.40:0/3353755791 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde3c0a2540 con 0x7fde3c09d450 2023-09-30T22:29:53.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.954+0000 7fde2affd700 1 -- 172.21.15.40:0/3353755791 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2c011640 con 0x7fde3c09d450 2023-09-30T22:29:53.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.954+0000 7fde40f59700 1 -- 172.21.15.40:0/3353755791 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde3c11c510 con 0x7fde3c09d450 2023-09-30T22:29:53.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.955+0000 7fde40f59700 1 -- 172.21.15.40:0/3353755791 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde3c11d5f0 con 0x7fde3c09d450 2023-09-30T22:29:53.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.955+0000 7fde2affd700 1 -- 172.21.15.40:0/3353755791 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fde2c007b20 con 0x7fde3c09d450 2023-09-30T22:29:53.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.956+0000 7fde2affd700 1 -- 172.21.15.40:0/3353755791 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fde2c04fc90 con 0x7fde3c09d450 2023-09-30T22:29:53.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:53.960+0000 7fde2affd700 1 -- 172.21.15.40:0/3353755791 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fde2c00ecd0 con 0x7fde3c09d450 2023-09-30T22:29:54.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.129+0000 7f474c236700 1 -- 172.21.15.40:0/696884640 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4744074720 con 0x7f4744136230 2023-09-30T22:29:54.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.130+0000 7f473a7fc700 1 -- 172.21.15.40:0/696884640 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f473c012340 con 0x7f4744136230 2023-09-30T22:29:54.131 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:54.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.132+0000 7f474c236700 1 -- 172.21.15.40:0/696884640 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4744136230 msgr2=0x7f4744123480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:54.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.132+0000 7f474c236700 1 --2- 172.21.15.40:0/696884640 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4744136230 0x7f4744123480 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f473c00feb0 tx=0x7f473c00e430 comp rx=0 tx=0).stop 2023-09-30T22:29:54.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.132+0000 7f474c236700 1 -- 172.21.15.40:0/696884640 shutdown_connections 2023-09-30T22:29:54.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.132+0000 7f474c236700 1 --2- 172.21.15.40:0/696884640 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4744136230 0x7f4744123480 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.132+0000 7f474c236700 1 --2- 172.21.15.40:0/696884640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f474409d920 0x7f4744122a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.132+0000 7f474c236700 1 --2- 172.21.15.40:0/696884640 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f474409e400 0x7f4744122f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.132+0000 7f474c236700 1 -- 172.21.15.40:0/696884640 >> 172.21.15.40:0/696884640 conn(0x7f474409fb20 msgr2=0x7f4744070460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:54.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.133+0000 7f474c236700 1 -- 172.21.15.40:0/696884640 shutdown_connections 2023-09-30T22:29:54.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.133+0000 7f474c236700 1 -- 172.21.15.40:0/696884640 wait complete. 2023-09-30T22:29:54.148 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:54.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.173+0000 7f8dc5ba5700 1 -- 172.21.15.40:0/4188091938 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8dc01a97b0 con 0x7f8dc01b9400 2023-09-30T22:29:54.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.174+0000 7f8da7fff700 1 -- 172.21.15.40:0/4188091938 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8dc01a97b0 con 0x7f8dc01b9400 2023-09-30T22:29:54.174 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:54.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.176+0000 7f8dc5ba5700 1 -- 172.21.15.40:0/4188091938 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8dc01b9400 msgr2=0x7f8dc01a6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:54.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.176+0000 7f8dc5ba5700 1 --2- 172.21.15.40:0/4188091938 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8dc01b9400 0x7f8dc01a6c10 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f8db800efc0 tx=0x7f8db800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.176+0000 7f8dc5ba5700 1 -- 172.21.15.40:0/4188091938 shutdown_connections 2023-09-30T22:29:54.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.176+0000 7f8dc5ba5700 1 --2- 172.21.15.40:0/4188091938 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8dc009d920 0x7f8dc01a6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.176+0000 7f8dc5ba5700 1 --2- 172.21.15.40:0/4188091938 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8dc01b9400 0x7f8dc01a6c10 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.176+0000 7f8dc5ba5700 1 --2- 172.21.15.40:0/4188091938 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8dc009e230 0x7f8dc01a66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.176+0000 7f8dc5ba5700 1 -- 172.21.15.40:0/4188091938 >> 172.21.15.40:0/4188091938 conn(0x7f8dc009fb20 msgr2=0x7f8dc01bb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:54.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.176+0000 7f8dc5ba5700 1 -- 172.21.15.40:0/4188091938 shutdown_connections 2023-09-30T22:29:54.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.176+0000 7f8dc5ba5700 1 -- 172.21.15.40:0/4188091938 wait complete. 2023-09-30T22:29:54.189 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:54.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.203+0000 7efd6a41e700 1 -- 172.21.15.40:0/1784318153 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efd6406edb0 con 0x7efd6409d400 2023-09-30T22:29:54.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.204+0000 7efd60ff9700 1 -- 172.21.15.40:0/1784318153 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efd54021070 con 0x7efd6409d400 2023-09-30T22:29:54.205 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:54.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.206+0000 7efd6a41e700 1 -- 172.21.15.40:0/1784318153 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd6409d400 msgr2=0x7efd64122310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:54.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.206+0000 7efd6a41e700 1 --2- 172.21.15.40:0/1784318153 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd6409d400 0x7efd64122310 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7efd5400e9e0 tx=0x7efd5400ecf0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.206+0000 7efd6a41e700 1 -- 172.21.15.40:0/1784318153 shutdown_connections 2023-09-30T22:29:54.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.206+0000 7efd6a41e700 1 --2- 172.21.15.40:0/1784318153 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd6409d400 0x7efd64122310 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.206+0000 7efd6a41e700 1 --2- 172.21.15.40:0/1784318153 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd64138250 0x7efd64122d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.206+0000 7efd6a41e700 1 --2- 172.21.15.40:0/1784318153 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd6409df20 0x7efd64122850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.206+0000 7efd6a41e700 1 -- 172.21.15.40:0/1784318153 >> 172.21.15.40:0/1784318153 conn(0x7efd640a2a00 msgr2=0x7efd641bf510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:54.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.206+0000 7efd6a41e700 1 -- 172.21.15.40:0/1784318153 shutdown_connections 2023-09-30T22:29:54.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.206+0000 7efd6a41e700 1 -- 172.21.15.40:0/1784318153 wait complete. 2023-09-30T22:29:54.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.212+0000 7fde40f59700 1 -- 172.21.15.40:0/3353755791 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fde3c062380 con 0x7fde3c09d450 2023-09-30T22:29:54.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.212+0000 7fde2affd700 1 -- 172.21.15.40:0/3353755791 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fde2c00e8c0 con 0x7fde3c09d450 2023-09-30T22:29:54.213 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:54.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.214+0000 7fde40f59700 1 -- 172.21.15.40:0/3353755791 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fde3c09d450 msgr2=0x7fde3c1c41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:54.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.214+0000 7fde40f59700 1 --2- 172.21.15.40:0/3353755791 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fde3c09d450 0x7fde3c1c41e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fde2c013f70 tx=0x7fde2c007320 comp rx=0 tx=0).stop 2023-09-30T22:29:54.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.214+0000 7fde40f59700 1 -- 172.21.15.40:0/3353755791 shutdown_connections 2023-09-30T22:29:54.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.215+0000 7fde40f59700 1 --2- 172.21.15.40:0/3353755791 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fde3c09d450 0x7fde3c1c41e0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.215+0000 7fde40f59700 1 --2- 172.21.15.40:0/3353755791 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde3c1308d0 0x7fde3c1c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.215+0000 7fde40f59700 1 --2- 172.21.15.40:0/3353755791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde3c09dd60 0x7fde3c1c4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:54.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.215+0000 7fde40f59700 1 -- 172.21.15.40:0/3353755791 >> 172.21.15.40:0/3353755791 conn(0x7fde3c0a2a00 msgr2=0x7fde3c1b7dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:54.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.215+0000 7fde40f59700 1 -- 172.21.15.40:0/3353755791 shutdown_connections 2023-09-30T22:29:54.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:54.215+0000 7fde40f59700 1 -- 172.21.15.40:0/3353755791 wait complete. 2023-09-30T22:29:54.220 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:54.228 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:55.149 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:55.189 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:55.221 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:55.229 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:55.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.297+0000 7efc5a225700 1 Processor -- start 2023-09-30T22:29:55.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.297+0000 7efc5a225700 1 -- start start 2023-09-30T22:29:55.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.298+0000 7efc5a225700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efc54131d50 0x7efc54132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.298+0000 7efc5a225700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efc5409c7d0 0x7efc54139ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.298+0000 7efc5a225700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc54132660 con 0x7efc5409bc50 2023-09-30T22:29:55.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.298+0000 7efc5a225700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc540719e0 con 0x7efc54131d50 2023-09-30T22:29:55.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.298+0000 7efc5a225700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc54131900 con 0x7efc5409c7d0 2023-09-30T22:29:55.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.298+0000 7efc53fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efc5409c7d0 0x7efc54139ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.298+0000 7efc53fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efc5409c7d0 0x7efc54139ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:45690/0 (socket says 172.21.15.40:45690) 2023-09-30T22:29:55.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.298+0000 7efc53fff700 1 -- 172.21.15.40:0/1549845369 learned_addr learned my addr 172.21.15.40:0/1549845369 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:55.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.298+0000 7efc537fe700 1 --2- 172.21.15.40:0/1549845369 >> v2:172.21.15.40:3300/0 conn(0x7efc54131d50 0x7efc54132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.298+0000 7efc53fff700 1 -- 172.21.15.40:0/1549845369 >> v2:172.21.15.40:3300/0 conn(0x7efc54131d50 msgr2=0x7efc54132120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:55.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.298+0000 7efc53fff700 1 --2- 172.21.15.40:0/1549845369 >> v2:172.21.15.40:3300/0 conn(0x7efc54131d50 0x7efc54132120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.298+0000 7efc53fff700 1 -- 172.21.15.40:0/1549845369 >> v1:172.21.15.40:6789/0 conn(0x7efc5409bc50 legacy=0x7efc5409c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:55.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.298+0000 7efc53fff700 1 -- 172.21.15.40:0/1549845369 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc5409e820 con 0x7efc5409c7d0 2023-09-30T22:29:55.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.299+0000 7efc53fff700 1 --2- 172.21.15.40:0/1549845369 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efc5409c7d0 0x7efc54139ac0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7efc4c009e50 tx=0x7efc4c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6534a3eb311a52fc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:55.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.299+0000 7efc527fc700 1 -- 172.21.15.40:0/1549845369 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c00e070 con 0x7efc5409c7d0 2023-09-30T22:29:55.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.299+0000 7efc527fc700 1 -- 172.21.15.40:0/1549845369 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4c00b910 con 0x7efc5409c7d0 2023-09-30T22:29:55.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.299+0000 7efc527fc700 1 -- 172.21.15.40:0/1549845369 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c00bcc0 con 0x7efc5409c7d0 2023-09-30T22:29:55.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.300+0000 7efc5a225700 1 -- 172.21.15.40:0/1549845369 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efc5409c7d0 msgr2=0x7efc54139ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:55.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.300+0000 7efc5a225700 1 --2- 172.21.15.40:0/1549845369 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efc5409c7d0 0x7efc54139ac0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7efc4c009e50 tx=0x7efc4c00b330 comp rx=0 tx=0).stop 2023-09-30T22:29:55.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.300+0000 7efc5a225700 1 -- 172.21.15.40:0/1549845369 shutdown_connections 2023-09-30T22:29:55.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.300+0000 7efc5a225700 1 --2- 172.21.15.40:0/1549845369 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efc5409c7d0 0x7efc54139ac0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.300+0000 7efc5a225700 1 --2- 172.21.15.40:0/1549845369 >> v2:172.21.15.40:3300/0 conn(0x7efc54131d50 0x7efc54132120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.300+0000 7efc5a225700 1 -- 172.21.15.40:0/1549845369 >> 172.21.15.40:0/1549845369 conn(0x7efc540a2a00 msgr2=0x7efc540a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:55.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.300+0000 7efc5a225700 1 -- 172.21.15.40:0/1549845369 shutdown_connections 2023-09-30T22:29:55.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.300+0000 7efc5a225700 1 -- 172.21.15.40:0/1549845369 wait complete. 2023-09-30T22:29:55.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.301+0000 7efc5a225700 1 Processor -- start 2023-09-30T22:29:55.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.302+0000 7efc5a225700 1 -- start start 2023-09-30T22:29:55.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.302+0000 7efc5a225700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc5409bc50 0x7efc5411ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.302+0000 7efc5a225700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efc5409c7d0 0x7efc5411b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.302+0000 7efc5a225700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efc54131d50 0x7efc5411b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.302+0000 7efc5a225700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5411e450 con 0x7efc5409bc50 2023-09-30T22:29:55.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.302+0000 7efc5a225700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5411c0b0 con 0x7efc5409c7d0 2023-09-30T22:29:55.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.302+0000 7efc5a225700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc5412e9d0 con 0x7efc54131d50 2023-09-30T22:29:55.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.303+0000 7efc537fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc5409bc50 0x7efc5411ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.303+0000 7efc537fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc5409bc50 0x7efc5411ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36634/0 (socket says 172.21.15.40:36634) 2023-09-30T22:29:55.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.303+0000 7efc537fe700 1 -- 172.21.15.40:0/3998814769 learned_addr learned my addr 172.21.15.40:0/3998814769 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:55.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.303+0000 7efc53fff700 1 --2- 172.21.15.40:0/3998814769 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efc54131d50 0x7efc5411b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.303+0000 7efc52ffd700 1 --2- 172.21.15.40:0/3998814769 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efc5409c7d0 0x7efc5411b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.303+0000 7efc537fe700 1 -- 172.21.15.40:0/3998814769 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efc54131d50 msgr2=0x7efc5411b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:55.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.303+0000 7efc537fe700 1 --2- 172.21.15.40:0/3998814769 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efc54131d50 0x7efc5411b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.303+0000 7efc537fe700 1 -- 172.21.15.40:0/3998814769 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efc5409c7d0 msgr2=0x7efc5411b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:55.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.303+0000 7efc537fe700 1 --2- 172.21.15.40:0/3998814769 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efc5409c7d0 0x7efc5411b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.303+0000 7efc537fe700 1 -- 172.21.15.40:0/3998814769 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4c009b30 con 0x7efc5409bc50 2023-09-30T22:29:55.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.303+0000 7efc537fe700 1 --2- 172.21.15.40:0/3998814769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc5409bc50 0x7efc5411ac50 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7efc4400e9b0 tx=0x7efc4400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:55.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.303+0000 7efc3bfff700 1 -- 172.21.15.40:0/3998814769 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc44009710 con 0x7efc5409bc50 2023-09-30T22:29:55.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.304+0000 7efc3bfff700 1 -- 172.21.15.40:0/3998814769 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4400c850 con 0x7efc5409bc50 2023-09-30T22:29:55.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.304+0000 7efc3bfff700 1 -- 172.21.15.40:0/3998814769 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4400cbc0 con 0x7efc5409bc50 2023-09-30T22:29:55.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.304+0000 7efc5a225700 1 -- 172.21.15.40:0/3998814769 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc5412e000 con 0x7efc5409bc50 2023-09-30T22:29:55.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.304+0000 7efc5a225700 1 -- 172.21.15.40:0/3998814769 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc5411e190 con 0x7efc5409bc50 2023-09-30T22:29:55.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.305+0000 7efc3bfff700 1 -- 172.21.15.40:0/3998814769 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efc4400cd20 con 0x7efc5409bc50 2023-09-30T22:29:55.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.305+0000 7efc5a225700 1 -- 172.21.15.40:0/3998814769 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc5406fa30 con 0x7efc5409bc50 2023-09-30T22:29:55.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.305+0000 7efc3bfff700 1 -- 172.21.15.40:0/3998814769 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7efc4403f820 con 0x7efc5409bc50 2023-09-30T22:29:55.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.314+0000 7efc3bfff700 1 -- 172.21.15.40:0/3998814769 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efc440232f0 con 0x7efc5409bc50 2023-09-30T22:29:55.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.338+0000 7f1100124700 1 Processor -- start 2023-09-30T22:29:55.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.339+0000 7f1100124700 1 -- start start 2023-09-30T22:29:55.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.339+0000 7f1100124700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10f809d920 0x7f10f809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.339+0000 7f1100124700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f10f809e230 0x7f10f81308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.339+0000 7f1100124700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f809adf0 con 0x7f10f8130de0 2023-09-30T22:29:55.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.339+0000 7f1100124700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f809edf0 con 0x7f10f809e230 2023-09-30T22:29:55.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.339+0000 7f1100124700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10f809b660 con 0x7f10f809d920 2023-09-30T22:29:55.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.340+0000 7f10fd6bf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f10f809e230 0x7f10f81308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.340+0000 7f10fdec0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10f809d920 0x7f10f809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.340+0000 7f10fd6bf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f10f809e230 0x7f10f81308a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36640/0 (socket says 172.21.15.40:36640) 2023-09-30T22:29:55.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.340+0000 7f10fdec0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10f809d920 0x7f10f809dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:39496/0 (socket says 172.21.15.40:39496) 2023-09-30T22:29:55.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.340+0000 7f10fd6bf700 1 -- 172.21.15.40:0/676984578 learned_addr learned my addr 172.21.15.40:0/676984578 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:55.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.340+0000 7f10fdec0700 1 -- 172.21.15.40:0/676984578 >> v2:172.21.15.40:3300/0 conn(0x7f10f809e230 msgr2=0x7f10f81308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:55.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.340+0000 7f10fdec0700 1 --2- 172.21.15.40:0/676984578 >> v2:172.21.15.40:3300/0 conn(0x7f10f809e230 0x7f10f81308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.340+0000 7f10fdec0700 1 -- 172.21.15.40:0/676984578 >> v1:172.21.15.40:6789/0 conn(0x7f10f8130de0 legacy=0x7f10f8137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:55.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.340+0000 7f10fdec0700 1 -- 172.21.15.40:0/676984578 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f809a6e0 con 0x7f10f809d920 2023-09-30T22:29:55.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.340+0000 7f10fdec0700 1 --2- 172.21.15.40:0/676984578 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10f809d920 0x7f10f809dcf0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f10f4009820 tx=0x7f10f4009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df4c5baa9efe75f8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:55.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.340+0000 7f10fcebe700 1 -- 172.21.15.40:0/676984578 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f4005e30 con 0x7f10f809d920 2023-09-30T22:29:55.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.340+0000 7f10fcebe700 1 -- 172.21.15.40:0/676984578 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f4006030 con 0x7f10f809d920 2023-09-30T22:29:55.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.340+0000 7f10fcebe700 1 -- 172.21.15.40:0/676984578 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f40063c0 con 0x7f10f809d920 2023-09-30T22:29:55.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.341+0000 7f1100124700 1 -- 172.21.15.40:0/676984578 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10f809d920 msgr2=0x7f10f809dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:55.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.341+0000 7f1100124700 1 --2- 172.21.15.40:0/676984578 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10f809d920 0x7f10f809dcf0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f10f4009820 tx=0x7f10f4009b30 comp rx=0 tx=0).stop 2023-09-30T22:29:55.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.341+0000 7f1100124700 1 -- 172.21.15.40:0/676984578 shutdown_connections 2023-09-30T22:29:55.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.341+0000 7f1100124700 1 --2- 172.21.15.40:0/676984578 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10f809d920 0x7f10f809dcf0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.341+0000 7f1100124700 1 --2- 172.21.15.40:0/676984578 >> v2:172.21.15.40:3300/0 conn(0x7f10f809e230 0x7f10f81308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.341+0000 7f1100124700 1 -- 172.21.15.40:0/676984578 >> 172.21.15.40:0/676984578 conn(0x7f10f809fb20 msgr2=0x7f10f809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:55.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.341+0000 7f1100124700 1 -- 172.21.15.40:0/676984578 shutdown_connections 2023-09-30T22:29:55.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.341+0000 7f1100124700 1 -- 172.21.15.40:0/676984578 wait complete. 2023-09-30T22:29:55.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.342+0000 7f1100124700 1 Processor -- start 2023-09-30T22:29:55.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.342+0000 7f1100124700 1 -- start start 2023-09-30T22:29:55.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.343+0000 7f1100124700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10f809d920 0x7f10f812df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.343+0000 7f1100124700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10f809e230 0x7f10f812e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.343+0000 7f1100124700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10f8130de0 0x7f10f812e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.343+0000 7f1100124700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f8132620 con 0x7f10f8130de0 2023-09-30T22:29:55.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.343+0000 7f1100124700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f8139b40 con 0x7f10f809d920 2023-09-30T22:29:55.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.343+0000 7f1100124700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10f8130250 con 0x7f10f809e230 2023-09-30T22:29:55.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.343+0000 7f10fd6bf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10f809e230 0x7f10f812e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.343+0000 7f10fd6bf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10f809e230 0x7f10f812e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:39504/0 (socket says 172.21.15.40:39504) 2023-09-30T22:29:55.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.343+0000 7f10fd6bf700 1 -- 172.21.15.40:0/1341544601 learned_addr learned my addr 172.21.15.40:0/1341544601 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:55.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.343+0000 7f10fdec0700 1 --2- 172.21.15.40:0/1341544601 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10f809d920 0x7f10f812df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.343+0000 7f10fe6c1700 1 --2- 172.21.15.40:0/1341544601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10f8130de0 0x7f10f812e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.343+0000 7f10fd6bf700 1 -- 172.21.15.40:0/1341544601 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10f809d920 msgr2=0x7f10f812df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:55.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.343+0000 7f10fd6bf700 1 --2- 172.21.15.40:0/1341544601 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10f809d920 0x7f10f812df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.343+0000 7f10fd6bf700 1 -- 172.21.15.40:0/1341544601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10f8130de0 msgr2=0x7f10f812e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:55.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.343+0000 7f10fd6bf700 1 --2- 172.21.15.40:0/1341544601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10f8130de0 0x7f10f812e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.343+0000 7f10fd6bf700 1 -- 172.21.15.40:0/1341544601 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f4009430 con 0x7f10f809e230 2023-09-30T22:29:55.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.343+0000 7f10fe6c1700 1 --2- 172.21.15.40:0/1341544601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10f8130de0 0x7f10f812e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:55.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.343+0000 7f10fdec0700 1 --2- 172.21.15.40:0/1341544601 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10f809d920 0x7f10f812df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:55.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.344+0000 7f10fd6bf700 1 --2- 172.21.15.40:0/1341544601 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10f809e230 0x7f10f812e480 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f10e800e8e0 tx=0x7f10e800eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:55.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.344+0000 7f10ee7fc700 1 -- 172.21.15.40:0/1341544601 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e800eee0 con 0x7f10f809e230 2023-09-30T22:29:55.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.344+0000 7f10ee7fc700 1 -- 172.21.15.40:0/1341544601 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e800c850 con 0x7f10f809e230 2023-09-30T22:29:55.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.344+0000 7f1100124700 1 -- 172.21.15.40:0/1341544601 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f812fb00 con 0x7f10f809e230 2023-09-30T22:29:55.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.344+0000 7f10ee7fc700 1 -- 172.21.15.40:0/1341544601 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e800cbc0 con 0x7f10f809e230 2023-09-30T22:29:55.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.344+0000 7f1100124700 1 -- 172.21.15.40:0/1341544601 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f809cb50 con 0x7f10f809e230 2023-09-30T22:29:55.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.345+0000 7f10ee7fc700 1 -- 172.21.15.40:0/1341544601 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f10e800cd20 con 0x7f10f809e230 2023-09-30T22:29:55.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.345+0000 7f10ee7fc700 1 -- 172.21.15.40:0/1341544601 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f10e803fb40 con 0x7f10f809e230 2023-09-30T22:29:55.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.345+0000 7f1100124700 1 -- 172.21.15.40:0/1341544601 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f8132c50 con 0x7f10f809e230 2023-09-30T22:29:55.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.350+0000 7f10ee7fc700 1 -- 172.21.15.40:0/1341544601 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f10e801b3b0 con 0x7f10f809e230 2023-09-30T22:29:55.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.380+0000 7f2154ced700 1 Processor -- start 2023-09-30T22:29:55.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.380+0000 7f2154ced700 1 -- start start 2023-09-30T22:29:55.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.381+0000 7f2154ced700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f215009fbb0 0x7f215006c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.381+0000 7f2154ced700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f215006ced0 0x7f215006d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.381+0000 7f2154ced700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2150138370 0x7f215013a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.381+0000 7f2154ced700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f215009ff80 con 0x7f2150138370 2023-09-30T22:29:55.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.381+0000 7f2154ced700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f215006ec40 con 0x7f215006ced0 2023-09-30T22:29:55.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.381+0000 7f2154ced700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f215006f510 con 0x7f215009fbb0 2023-09-30T22:29:55.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.381+0000 7f214ed9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2150138370 0x7f215013a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.381+0000 7f214e59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f215009fbb0 0x7f215006c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.381+0000 7f214ed9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2150138370 0x7f215013a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36652/0 (socket says 172.21.15.40:36652) 2023-09-30T22:29:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.381+0000 7f214e59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f215009fbb0 0x7f215006c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:39520/0 (socket says 172.21.15.40:39520) 2023-09-30T22:29:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.381+0000 7f214ed9d700 1 -- 172.21.15.40:0/3485169960 learned_addr learned my addr 172.21.15.40:0/3485169960 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.381+0000 7f214dd9b700 1 --2- 172.21.15.40:0/3485169960 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f215006ced0 0x7f215006d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.381+0000 7f214ed9d700 1 -- 172.21.15.40:0/3485169960 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f215009fbb0 msgr2=0x7f215006c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.381+0000 7f214ed9d700 1 --2- 172.21.15.40:0/3485169960 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f215009fbb0 0x7f215006c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.381+0000 7f214ed9d700 1 -- 172.21.15.40:0/3485169960 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f215006ced0 msgr2=0x7f215006d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.381+0000 7f214ed9d700 1 --2- 172.21.15.40:0/3485169960 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f215006ced0 0x7f215006d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.381+0000 7f214ed9d700 1 -- 172.21.15.40:0/3485169960 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f215006e3f0 con 0x7f2150138370 2023-09-30T22:29:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.381+0000 7f214e59c700 1 --2- 172.21.15.40:0/3485169960 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f215009fbb0 0x7f215006c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.381+0000 7f214ed9d700 1 --2- 172.21.15.40:0/3485169960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2150138370 0x7f215013a750 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f2148009950 tx=0x7f2148009c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b25a29a7b1763d7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:55.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.382+0000 7f214d59a700 1 -- 172.21.15.40:0/3485169960 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2148011830 con 0x7f2150138370 2023-09-30T22:29:55.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.382+0000 7f214d59a700 1 -- 172.21.15.40:0/3485169960 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2148011990 con 0x7f2150138370 2023-09-30T22:29:55.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.382+0000 7f214d59a700 1 -- 172.21.15.40:0/3485169960 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2148011d40 con 0x7f2150138370 2023-09-30T22:29:55.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.382+0000 7f2154ced700 1 -- 172.21.15.40:0/3485169960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2150138370 msgr2=0x7f215013a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:55.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.382+0000 7f2154ced700 1 --2- 172.21.15.40:0/3485169960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2150138370 0x7f215013a750 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f2148009950 tx=0x7f2148009c60 comp rx=0 tx=0).stop 2023-09-30T22:29:55.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.382+0000 7f2154ced700 1 -- 172.21.15.40:0/3485169960 shutdown_connections 2023-09-30T22:29:55.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.382+0000 7f2154ced700 1 --2- 172.21.15.40:0/3485169960 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f215009fbb0 0x7f215006c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.382+0000 7f2154ced700 1 --2- 172.21.15.40:0/3485169960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2150138370 0x7f215013a750 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.382+0000 7f2154ced700 1 --2- 172.21.15.40:0/3485169960 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f215006ced0 0x7f215006d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.382+0000 7f2154ced700 1 -- 172.21.15.40:0/3485169960 >> 172.21.15.40:0/3485169960 conn(0x7f21500a41a0 msgr2=0x7f21500a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:55.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.382+0000 7f2154ced700 1 -- 172.21.15.40:0/3485169960 shutdown_connections 2023-09-30T22:29:55.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.382+0000 7f2154ced700 1 -- 172.21.15.40:0/3485169960 wait complete. 2023-09-30T22:29:55.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.384+0000 7f2154ced700 1 Processor -- start 2023-09-30T22:29:55.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.384+0000 7f2154ced700 1 -- start start 2023-09-30T22:29:55.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.384+0000 7f2154ced700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f215006ced0 0x7f21501377c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.384+0000 7f2154ced700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f215009fbb0 0x7f2150137d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.384+0000 7f2154ced700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2150138370 0x7f2150095a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.384+0000 7f2154ced700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2150094c40 con 0x7f2150138370 2023-09-30T22:29:55.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.384+0000 7f2154ced700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2150071db0 con 0x7f215006ced0 2023-09-30T22:29:55.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.384+0000 7f2154ced700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21500945b0 con 0x7f215009fbb0 2023-09-30T22:29:55.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.384+0000 7f214ed9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2150138370 0x7f2150095a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.384+0000 7f214ed9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2150138370 0x7f2150095a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36656/0 (socket says 172.21.15.40:36656) 2023-09-30T22:29:55.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.384+0000 7f214ed9d700 1 -- 172.21.15.40:0/3189890449 learned_addr learned my addr 172.21.15.40:0/3189890449 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:55.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.384+0000 7f214e59c700 1 --2- 172.21.15.40:0/3189890449 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f215006ced0 0x7f21501377c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.384+0000 7f214dd9b700 1 --2- 172.21.15.40:0/3189890449 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f215009fbb0 0x7f2150137d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.385+0000 7f214ed9d700 1 -- 172.21.15.40:0/3189890449 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f215009fbb0 msgr2=0x7f2150137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:55.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.385+0000 7f214ed9d700 1 --2- 172.21.15.40:0/3189890449 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f215009fbb0 0x7f2150137d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.385+0000 7f214ed9d700 1 -- 172.21.15.40:0/3189890449 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f215006ced0 msgr2=0x7f21501377c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:55.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.385+0000 7f214ed9d700 1 --2- 172.21.15.40:0/3189890449 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f215006ced0 0x7f21501377c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.385+0000 7f214ed9d700 1 -- 172.21.15.40:0/3189890449 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2140009a70 con 0x7f2150138370 2023-09-30T22:29:55.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.385+0000 7f214ed9d700 1 --2- 172.21.15.40:0/3189890449 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2150138370 0x7f2150095a20 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f2148009fb0 tx=0x7f2148004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:55.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.385+0000 7f2146ffd700 1 -- 172.21.15.40:0/3189890449 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2148004300 con 0x7f2150138370 2023-09-30T22:29:55.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.385+0000 7f2146ffd700 1 -- 172.21.15.40:0/3189890449 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214801f070 con 0x7f2150138370 2023-09-30T22:29:55.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.385+0000 7f2154ced700 1 -- 172.21.15.40:0/3189890449 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2148009550 con 0x7f2150138370 2023-09-30T22:29:55.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.385+0000 7f2146ffd700 1 -- 172.21.15.40:0/3189890449 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21480036a0 con 0x7f2150138370 2023-09-30T22:29:55.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.385+0000 7f2154ced700 1 -- 172.21.15.40:0/3189890449 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2150096ad0 con 0x7f2150138370 2023-09-30T22:29:55.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.386+0000 7f2146ffd700 1 -- 172.21.15.40:0/3189890449 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2148021030 con 0x7f2150138370 2023-09-30T22:29:55.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.386+0000 7f2146ffd700 1 -- 172.21.15.40:0/3189890449 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f2148044370 con 0x7f2150138370 2023-09-30T22:29:55.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.386+0000 7f2154ced700 1 -- 172.21.15.40:0/3189890449 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2150062380 con 0x7f2150138370 2023-09-30T22:29:55.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.391+0000 7f2146ffd700 1 -- 172.21.15.40:0/3189890449 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2148015080 con 0x7f2150138370 2023-09-30T22:29:55.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.394+0000 7f07af7b9700 1 Processor -- start 2023-09-30T22:29:55.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.394+0000 7f07af7b9700 1 -- start start 2023-09-30T22:29:55.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.395+0000 7f07af7b9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07a809e400 0x7f07a8135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.395+0000 7f07af7b9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07a8136230 0x7f07a8138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.395+0000 7f07af7b9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07a809adf0 con 0x7f07a809d920 2023-09-30T22:29:55.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.395+0000 7f07af7b9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a809e7f0 con 0x7f07a809e400 2023-09-30T22:29:55.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.395+0000 7f07af7b9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07a809edf0 con 0x7f07a8136230 2023-09-30T22:29:55.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.395+0000 7f07acd54700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07a809e400 0x7f07a8135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.395+0000 7f07acd54700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07a809e400 0x7f07a8135cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:45744/0 (socket says 172.21.15.40:45744) 2023-09-30T22:29:55.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.395+0000 7f07acd54700 1 -- 172.21.15.40:0/3717413303 learned_addr learned my addr 172.21.15.40:0/3717413303 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:55.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.395+0000 7f07add56700 1 --2- 172.21.15.40:0/3717413303 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07a8136230 0x7f07a8138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.395+0000 7f07acd54700 1 -- 172.21.15.40:0/3717413303 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07a8136230 msgr2=0x7f07a8138610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:55.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.395+0000 7f07acd54700 1 --2- 172.21.15.40:0/3717413303 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07a8136230 0x7f07a8138610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.395+0000 7f07acd54700 1 -- 172.21.15.40:0/3717413303 >> v1:172.21.15.40:6789/0 conn(0x7f07a809d920 legacy=0x7f07a809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:55.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.395+0000 7f07acd54700 1 -- 172.21.15.40:0/3717413303 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a809b660 con 0x7f07a809e400 2023-09-30T22:29:55.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.396+0000 7f07acd54700 1 --2- 172.21.15.40:0/3717413303 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07a809e400 0x7f07a8135cf0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f0798009950 tx=0x7f0798009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21a6928bf72464a3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:55.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.396+0000 7f079ffff700 1 -- 172.21.15.40:0/3717413303 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0798004230 con 0x7f07a809e400 2023-09-30T22:29:55.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.396+0000 7f079ffff700 1 -- 172.21.15.40:0/3717413303 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0798004390 con 0x7f07a809e400 2023-09-30T22:29:55.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.396+0000 7f079ffff700 1 -- 172.21.15.40:0/3717413303 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07980036a0 con 0x7f07a809e400 2023-09-30T22:29:55.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.397+0000 7f07af7b9700 1 -- 172.21.15.40:0/3717413303 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07a809e400 msgr2=0x7f07a8135cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:55.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.397+0000 7f07af7b9700 1 --2- 172.21.15.40:0/3717413303 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07a809e400 0x7f07a8135cf0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f0798009950 tx=0x7f0798009c60 comp rx=0 tx=0).stop 2023-09-30T22:29:55.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.397+0000 7f07af7b9700 1 -- 172.21.15.40:0/3717413303 shutdown_connections 2023-09-30T22:29:55.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.397+0000 7f07af7b9700 1 --2- 172.21.15.40:0/3717413303 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07a8136230 0x7f07a8138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.397+0000 7f07af7b9700 1 --2- 172.21.15.40:0/3717413303 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07a809e400 0x7f07a8135cf0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.397+0000 7f07af7b9700 1 -- 172.21.15.40:0/3717413303 >> 172.21.15.40:0/3717413303 conn(0x7f07a809fb20 msgr2=0x7f07a809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:55.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.397+0000 7f07af7b9700 1 -- 172.21.15.40:0/3717413303 shutdown_connections 2023-09-30T22:29:55.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.397+0000 7f07af7b9700 1 -- 172.21.15.40:0/3717413303 wait complete. 2023-09-30T22:29:55.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.398+0000 7f07af7b9700 1 Processor -- start 2023-09-30T22:29:55.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.398+0000 7f07af7b9700 1 -- start start 2023-09-30T22:29:55.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.399+0000 7f07af7b9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07a809d920 0x7f07a811b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.399+0000 7f07af7b9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07a809e400 0x7f07a811b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.399+0000 7f07af7b9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07a8136230 0x7f07a811bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:55.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.399+0000 7f07af7b9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a811e9b0 con 0x7f07a809d920 2023-09-30T22:29:55.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.399+0000 7f07af7b9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a811ce90 con 0x7f07a809e400 2023-09-30T22:29:55.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.399+0000 7f07af7b9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07a80a21b0 con 0x7f07a8136230 2023-09-30T22:29:55.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.399+0000 7f07ad555700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07a809d920 0x7f07a811b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.399+0000 7f07ad555700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07a809d920 0x7f07a811b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36658/0 (socket says 172.21.15.40:36658) 2023-09-30T22:29:55.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.399+0000 7f07add56700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07a8136230 0x7f07a811bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.399+0000 7f07ad555700 1 -- 172.21.15.40:0/978678145 learned_addr learned my addr 172.21.15.40:0/978678145 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:55.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.399+0000 7f07acd54700 1 --2- 172.21.15.40:0/978678145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07a809e400 0x7f07a811b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:55.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.399+0000 7f07acd54700 1 -- 172.21.15.40:0/978678145 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07a8136230 msgr2=0x7f07a811bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:55.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.399+0000 7f07acd54700 1 --2- 172.21.15.40:0/978678145 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07a8136230 0x7f07a811bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.399+0000 7f07acd54700 1 -- 172.21.15.40:0/978678145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07a809d920 msgr2=0x7f07a811b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:55.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.399+0000 7f07acd54700 1 --2- 172.21.15.40:0/978678145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07a809d920 0x7f07a811b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.399+0000 7f07acd54700 1 -- 172.21.15.40:0/978678145 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0798009550 con 0x7f07a809e400 2023-09-30T22:29:55.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.400+0000 7f07acd54700 1 --2- 172.21.15.40:0/978678145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07a809e400 0x7f07a811b6b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f0798015000 tx=0x7f0798004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:55.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.400+0000 7f079dffb700 1 -- 172.21.15.40:0/978678145 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0798003c70 con 0x7f07a809e400 2023-09-30T22:29:55.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.400+0000 7f079dffb700 1 -- 172.21.15.40:0/978678145 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0798003e10 con 0x7f07a809e400 2023-09-30T22:29:55.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.400+0000 7f079dffb700 1 -- 172.21.15.40:0/978678145 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0798011870 con 0x7f07a809e400 2023-09-30T22:29:55.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.400+0000 7f07af7b9700 1 -- 172.21.15.40:0/978678145 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07a809cb00 con 0x7f07a809e400 2023-09-30T22:29:55.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.401+0000 7f07af7b9700 1 -- 172.21.15.40:0/978678145 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07a811ec90 con 0x7f07a809e400 2023-09-30T22:29:55.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.402+0000 7f079dffb700 1 -- 172.21.15.40:0/978678145 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0798021020 con 0x7f07a809e400 2023-09-30T22:29:55.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.402+0000 7f07af7b9700 1 -- 172.21.15.40:0/978678145 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07a8070700 con 0x7f07a809e400 2023-09-30T22:29:55.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.402+0000 7f079dffb700 1 -- 172.21.15.40:0/978678145 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f0798040d60 con 0x7f07a809e400 2023-09-30T22:29:55.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.407+0000 7f079dffb700 1 -- 172.21.15.40:0/978678145 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f07980199b0 con 0x7f07a809e400 2023-09-30T22:29:55.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.523+0000 7efc5a225700 1 -- 172.21.15.40:0/3998814769 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efc5409ea60 con 0x7efc5409bc50 2023-09-30T22:29:55.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.523+0000 7efc3bfff700 1 -- 172.21.15.40:0/3998814769 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efc4401ae80 con 0x7efc5409bc50 2023-09-30T22:29:55.524 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:55.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.525+0000 7efc5a225700 1 -- 172.21.15.40:0/3998814769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc5409bc50 msgr2=0x7efc5411ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:55.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.525+0000 7efc5a225700 1 --2- 172.21.15.40:0/3998814769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc5409bc50 0x7efc5411ac50 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7efc4400e9b0 tx=0x7efc4400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.525+0000 7efc5a225700 1 -- 172.21.15.40:0/3998814769 shutdown_connections 2023-09-30T22:29:55.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.525+0000 7efc5a225700 1 --2- 172.21.15.40:0/3998814769 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efc54131d50 0x7efc5411b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.525+0000 7efc5a225700 1 --2- 172.21.15.40:0/3998814769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc5409bc50 0x7efc5411ac50 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.525+0000 7efc5a225700 1 --2- 172.21.15.40:0/3998814769 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efc5409c7d0 0x7efc5411b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.525+0000 7efc5a225700 1 -- 172.21.15.40:0/3998814769 >> 172.21.15.40:0/3998814769 conn(0x7efc540a2a00 msgr2=0x7efc5409b080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:55.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.525+0000 7efc5a225700 1 -- 172.21.15.40:0/3998814769 shutdown_connections 2023-09-30T22:29:55.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.525+0000 7efc5a225700 1 -- 172.21.15.40:0/3998814769 wait complete. 2023-09-30T22:29:55.539 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:55.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.588+0000 7f2154ced700 1 -- 172.21.15.40:0/3189890449 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2150094800 con 0x7f2150138370 2023-09-30T22:29:55.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.589+0000 7f2146ffd700 1 -- 172.21.15.40:0/3189890449 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f214800b9d0 con 0x7f2150138370 2023-09-30T22:29:55.589 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:55.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.591+0000 7f2154ced700 1 -- 172.21.15.40:0/3189890449 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2150138370 msgr2=0x7f2150095a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:55.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.591+0000 7f2154ced700 1 --2- 172.21.15.40:0/3189890449 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2150138370 0x7f2150095a20 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f2148009fb0 tx=0x7f2148004750 comp rx=0 tx=0).stop 2023-09-30T22:29:55.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.592+0000 7f2154ced700 1 -- 172.21.15.40:0/3189890449 shutdown_connections 2023-09-30T22:29:55.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.592+0000 7f2154ced700 1 --2- 172.21.15.40:0/3189890449 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2150138370 0x7f2150095a20 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.592+0000 7f2154ced700 1 --2- 172.21.15.40:0/3189890449 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f215006ced0 0x7f21501377c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.592+0000 7f2154ced700 1 --2- 172.21.15.40:0/3189890449 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f215009fbb0 0x7f2150137d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.592+0000 7f2154ced700 1 -- 172.21.15.40:0/3189890449 >> 172.21.15.40:0/3189890449 conn(0x7f21500a41a0 msgr2=0x7f21500a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:55.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.592+0000 7f2154ced700 1 -- 172.21.15.40:0/3189890449 shutdown_connections 2023-09-30T22:29:55.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.592+0000 7f2154ced700 1 -- 172.21.15.40:0/3189890449 wait complete. 2023-09-30T22:29:55.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.592+0000 7f1100124700 1 -- 172.21.15.40:0/1341544601 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f10f8062380 con 0x7f10f809e230 2023-09-30T22:29:55.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.593+0000 7f10ee7fc700 1 -- 172.21.15.40:0/1341544601 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f10e801ab10 con 0x7f10f809e230 2023-09-30T22:29:55.594 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:55.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.595+0000 7f1100124700 1 -- 172.21.15.40:0/1341544601 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10f809e230 msgr2=0x7f10f812e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:55.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.595+0000 7f1100124700 1 --2- 172.21.15.40:0/1341544601 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10f809e230 0x7f10f812e480 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f10e800e8e0 tx=0x7f10e800eca0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.595+0000 7f1100124700 1 -- 172.21.15.40:0/1341544601 shutdown_connections 2023-09-30T22:29:55.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.595+0000 7f1100124700 1 --2- 172.21.15.40:0/1341544601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10f8130de0 0x7f10f812e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.595+0000 7f1100124700 1 --2- 172.21.15.40:0/1341544601 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10f809d920 0x7f10f812df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.595+0000 7f1100124700 1 --2- 172.21.15.40:0/1341544601 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f10f809e230 0x7f10f812e480 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.595+0000 7f1100124700 1 -- 172.21.15.40:0/1341544601 >> 172.21.15.40:0/1341544601 conn(0x7f10f809fb20 msgr2=0x7f10f8129930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:55.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.595+0000 7f1100124700 1 -- 172.21.15.40:0/1341544601 shutdown_connections 2023-09-30T22:29:55.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.595+0000 7f1100124700 1 -- 172.21.15.40:0/1341544601 wait complete. 2023-09-30T22:29:55.609 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:55.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:55.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.635+0000 7f07af7b9700 1 -- 172.21.15.40:0/978678145 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f07a809a660 con 0x7f07a809e400 2023-09-30T22:29:55.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.635+0000 7f079dffb700 1 -- 172.21.15.40:0/978678145 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0798029020 con 0x7f07a809e400 2023-09-30T22:29:55.636 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:55.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.637+0000 7f07af7b9700 1 -- 172.21.15.40:0/978678145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07a809e400 msgr2=0x7f07a811b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:55.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.637+0000 7f07af7b9700 1 --2- 172.21.15.40:0/978678145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07a809e400 0x7f07a811b6b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f0798015000 tx=0x7f0798004750 comp rx=0 tx=0).stop 2023-09-30T22:29:55.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.637+0000 7f07af7b9700 1 -- 172.21.15.40:0/978678145 shutdown_connections 2023-09-30T22:29:55.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.637+0000 7f07af7b9700 1 --2- 172.21.15.40:0/978678145 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07a8136230 0x7f07a811bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.637+0000 7f07af7b9700 1 --2- 172.21.15.40:0/978678145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07a809d920 0x7f07a811b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.637+0000 7f07af7b9700 1 --2- 172.21.15.40:0/978678145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07a809e400 0x7f07a811b6b0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:55.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.637+0000 7f07af7b9700 1 -- 172.21.15.40:0/978678145 >> 172.21.15.40:0/978678145 conn(0x7f07a809fb20 msgr2=0x7f07a8139420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:55.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.637+0000 7f07af7b9700 1 -- 172.21.15.40:0/978678145 shutdown_connections 2023-09-30T22:29:55.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:55.637+0000 7f07af7b9700 1 -- 172.21.15.40:0/978678145 wait complete. 2023-09-30T22:29:55.651 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:56.540 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:56.610 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:56.612 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:56.652 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:56.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.689+0000 7f535584e700 1 Processor -- start 2023-09-30T22:29:56.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.689+0000 7f535584e700 1 -- start start 2023-09-30T22:29:56.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.689+0000 7f535584e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5350133e00 0x7f53501341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.689+0000 7f535584e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f535009df70 0x7f535013bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.690+0000 7f535584e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5350133940 con 0x7f535009d400 2023-09-30T22:29:56.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.690+0000 7f535584e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f535009ab20 con 0x7f5350133e00 2023-09-30T22:29:56.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.690+0000 7f535584e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f535009f0d0 con 0x7f535009df70 2023-09-30T22:29:56.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.690+0000 7f534effd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5350133e00 0x7f53501341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:56.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.690+0000 7f534effd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5350133e00 0x7f53501341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36664/0 (socket says 172.21.15.40:36664) 2023-09-30T22:29:56.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.690+0000 7f534effd700 1 -- 172.21.15.40:0/2970735232 learned_addr learned my addr 172.21.15.40:0/2970735232 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:56.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.690+0000 7f534f7fe700 1 --2- 172.21.15.40:0/2970735232 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f535009df70 0x7f535013bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:56.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.690+0000 7f534effd700 1 -- 172.21.15.40:0/2970735232 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f535009df70 msgr2=0x7f535013bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:56.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.690+0000 7f534effd700 1 --2- 172.21.15.40:0/2970735232 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f535009df70 0x7f535013bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.690+0000 7f534effd700 1 -- 172.21.15.40:0/2970735232 >> v1:172.21.15.40:6789/0 conn(0x7f535009d400 legacy=0x7f535009d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:56.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.690+0000 7f534effd700 1 -- 172.21.15.40:0/2970735232 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5350133be0 con 0x7f5350133e00 2023-09-30T22:29:56.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.690+0000 7f534effd700 1 --2- 172.21.15.40:0/2970735232 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5350133e00 0x7f53501341d0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f53400098f0 tx=0x7f5340009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223153439fde4262 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:56.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.692+0000 7f534dffb700 1 -- 172.21.15.40:0/2970735232 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5340011830 con 0x7f5350133e00 2023-09-30T22:29:56.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.692+0000 7f534dffb700 1 -- 172.21.15.40:0/2970735232 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5340011990 con 0x7f5350133e00 2023-09-30T22:29:56.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.692+0000 7f534dffb700 1 -- 172.21.15.40:0/2970735232 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5340011d20 con 0x7f5350133e00 2023-09-30T22:29:56.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.693+0000 7f535584e700 1 -- 172.21.15.40:0/2970735232 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5350133e00 msgr2=0x7f53501341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:56.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.693+0000 7f535584e700 1 --2- 172.21.15.40:0/2970735232 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5350133e00 0x7f53501341d0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f53400098f0 tx=0x7f5340009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:56.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.693+0000 7f535584e700 1 -- 172.21.15.40:0/2970735232 shutdown_connections 2023-09-30T22:29:56.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.693+0000 7f535584e700 1 --2- 172.21.15.40:0/2970735232 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f535009df70 0x7f535013bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.693+0000 7f535584e700 1 --2- 172.21.15.40:0/2970735232 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5350133e00 0x7f53501341d0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.693+0000 7f535584e700 1 -- 172.21.15.40:0/2970735232 >> 172.21.15.40:0/2970735232 conn(0x7f53500a2a00 msgr2=0x7f53500a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:56.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.693+0000 7f535584e700 1 -- 172.21.15.40:0/2970735232 shutdown_connections 2023-09-30T22:29:56.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.693+0000 7f535584e700 1 -- 172.21.15.40:0/2970735232 wait complete. 2023-09-30T22:29:56.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.694+0000 7f535584e700 1 Processor -- start 2023-09-30T22:29:56.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.694+0000 7f535584e700 1 -- start start 2023-09-30T22:29:56.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.695+0000 7f535584e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f535009d400 0x7f535006f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.695+0000 7f535584e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f535009df70 0x7f535006fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.695+0000 7f535584e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5350133e00 0x7f53500700b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.695+0000 7f535584e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5350070a70 con 0x7f535009d400 2023-09-30T22:29:56.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.695+0000 7f535584e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f535012e1a0 con 0x7f5350133e00 2023-09-30T22:29:56.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.695+0000 7f535584e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5350122d00 con 0x7f535009df70 2023-09-30T22:29:56.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.695+0000 7f534effd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f535009d400 0x7f535006f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:56.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.695+0000 7f534effd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f535009d400 0x7f535006f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36666/0 (socket says 172.21.15.40:36666) 2023-09-30T22:29:56.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.695+0000 7f534effd700 1 -- 172.21.15.40:0/1856887929 learned_addr learned my addr 172.21.15.40:0/1856887929 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:56.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.695+0000 7f534e7fc700 1 --2- 172.21.15.40:0/1856887929 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f535009df70 0x7f535006fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:56.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.695+0000 7f534f7fe700 1 --2- 172.21.15.40:0/1856887929 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5350133e00 0x7f53500700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:56.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.695+0000 7f534effd700 1 -- 172.21.15.40:0/1856887929 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f535009df70 msgr2=0x7f535006fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:56.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.695+0000 7f534effd700 1 --2- 172.21.15.40:0/1856887929 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f535009df70 0x7f535006fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.695+0000 7f534effd700 1 -- 172.21.15.40:0/1856887929 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5350133e00 msgr2=0x7f53500700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:56.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.695+0000 7f534effd700 1 --2- 172.21.15.40:0/1856887929 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5350133e00 0x7f53500700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.695+0000 7f534effd700 1 -- 172.21.15.40:0/1856887929 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5340009550 con 0x7f535009d400 2023-09-30T22:29:56.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.695+0000 7f534effd700 1 --2- 172.21.15.40:0/1856887929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f535009d400 0x7f535006f630 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f5340000c00 tx=0x7f5340004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:56.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.696+0000 7f5337fff700 1 -- 172.21.15.40:0/1856887929 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53400036a0 con 0x7f535009d400 2023-09-30T22:29:56.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.696+0000 7f535584e700 1 -- 172.21.15.40:0/1856887929 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f535012c690 con 0x7f535009d400 2023-09-30T22:29:56.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.696+0000 7f5337fff700 1 -- 172.21.15.40:0/1856887929 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5340003800 con 0x7f535009d400 2023-09-30T22:29:56.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.696+0000 7f5337fff700 1 -- 172.21.15.40:0/1856887929 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5340003b70 con 0x7f535009d400 2023-09-30T22:29:56.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.696+0000 7f535584e700 1 -- 172.21.15.40:0/1856887929 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5350121860 con 0x7f535009d400 2023-09-30T22:29:56.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.697+0000 7f535584e700 1 -- 172.21.15.40:0/1856887929 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5350062380 con 0x7f535009d400 2023-09-30T22:29:56.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.697+0000 7f5337fff700 1 -- 172.21.15.40:0/1856887929 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5340021070 con 0x7f535009d400 2023-09-30T22:29:56.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.698+0000 7f5337fff700 1 -- 172.21.15.40:0/1856887929 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5340041410 con 0x7f535009d400 2023-09-30T22:29:56.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.702+0000 7f5337fff700 1 -- 172.21.15.40:0/1856887929 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5340010380 con 0x7f535009d400 2023-09-30T22:29:56.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.754+0000 7f8c670ed700 1 Processor -- start 2023-09-30T22:29:56.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.754+0000 7f8c670ed700 1 -- start start 2023-09-30T22:29:56.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.754+0000 7f8c670ed700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c6012e590 0x7f8c6012e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.754+0000 7f8c670ed700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c6012eea0 0x7f8c6012d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.754+0000 7f8c670ed700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c6009ab70 con 0x7f8c6012d6d0 2023-09-30T22:29:56.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.754+0000 7f8c670ed700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6009b270 con 0x7f8c6012eea0 2023-09-30T22:29:56.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.754+0000 7f8c670ed700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6009bab0 con 0x7f8c6012e590 2023-09-30T22:29:56.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.755+0000 7f8c6568a700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8c6012d6d0 0x7f8c60137c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33090/0 (socket says 172.21.15.40:33090) 2023-09-30T22:29:56.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.755+0000 7f8c6568a700 1 -- 172.21.15.40:0/3336555757 learned_addr learned my addr 172.21.15.40:0/3336555757 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:29:56.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.755+0000 7f8c5ffff700 1 --2- 172.21.15.40:0/3336555757 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c6012eea0 0x7f8c6012d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:56.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.755+0000 7f8c64e89700 1 --2- 172.21.15.40:0/3336555757 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c6012e590 0x7f8c6012e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:56.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.755+0000 7f8c5ffff700 1 -- 172.21.15.40:0/3336555757 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c6012e590 msgr2=0x7f8c6012e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:56.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.755+0000 7f8c5ffff700 1 --2- 172.21.15.40:0/3336555757 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c6012e590 0x7f8c6012e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.755+0000 7f8c5ffff700 1 -- 172.21.15.40:0/3336555757 >> v1:172.21.15.40:6789/0 conn(0x7f8c6012d6d0 legacy=0x7f8c60137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:56.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.755+0000 7f8c5ffff700 1 -- 172.21.15.40:0/3336555757 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6009bd70 con 0x7f8c6012eea0 2023-09-30T22:29:56.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.755+0000 7f8c64e89700 1 --2- 172.21.15.40:0/3336555757 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c6012e590 0x7f8c6012e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:56.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.755+0000 7f8c5ffff700 1 --2- 172.21.15.40:0/3336555757 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c6012eea0 0x7f8c6012d190 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c009870 tx=0x7f8c4c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f378be652a6bbfc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:56.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.755+0000 7f8c5f7fe700 1 -- 172.21.15.40:0/3336555757 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c011830 con 0x7f8c6012eea0 2023-09-30T22:29:56.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.755+0000 7f8c5f7fe700 1 -- 172.21.15.40:0/3336555757 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c4c011990 con 0x7f8c6012eea0 2023-09-30T22:29:56.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.755+0000 7f8c5f7fe700 1 -- 172.21.15.40:0/3336555757 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c011d20 con 0x7f8c6012eea0 2023-09-30T22:29:56.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.756+0000 7f2bbf367700 1 Processor -- start 2023-09-30T22:29:56.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.756+0000 7f2bbf367700 1 -- start start 2023-09-30T22:29:56.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.756+0000 7f2bbf367700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2bb809fbb0 0x7f2bb806c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.756+0000 7f8c670ed700 1 -- 172.21.15.40:0/3336555757 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c6012eea0 msgr2=0x7f8c6012d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:56.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.756+0000 7f8c670ed700 1 --2- 172.21.15.40:0/3336555757 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c6012eea0 0x7f8c6012d190 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c009870 tx=0x7f8c4c009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:56.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.757+0000 7f8c670ed700 1 -- 172.21.15.40:0/3336555757 shutdown_connections 2023-09-30T22:29:56.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.757+0000 7f8c670ed700 1 --2- 172.21.15.40:0/3336555757 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c6012e590 0x7f8c6012e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.757+0000 7f8c670ed700 1 --2- 172.21.15.40:0/3336555757 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c6012eea0 0x7f8c6012d190 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.757+0000 7f8c670ed700 1 -- 172.21.15.40:0/3336555757 >> 172.21.15.40:0/3336555757 conn(0x7f8c600a2a00 msgr2=0x7f8c600a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:56.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.756+0000 7f2bbf367700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2bb806ced0 0x7f2bb806d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.756+0000 7f2bbf367700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bb806e3f0 con 0x7f2bb8138370 2023-09-30T22:29:56.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.756+0000 7f2bbf367700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb809ff80 con 0x7f2bb806ced0 2023-09-30T22:29:56.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.756+0000 7f2bbf367700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb806ec40 con 0x7f2bb809fbb0 2023-09-30T22:29:56.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.756+0000 7f2bbd904700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2bb8138370 0x7f2bb813a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33100/0 (socket says 172.21.15.40:33100) 2023-09-30T22:29:56.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.757+0000 7f2bbd904700 1 -- 172.21.15.40:0/73750144 learned_addr learned my addr 172.21.15.40:0/73750144 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:29:56.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.757+0000 7f2bbc902700 1 --2- 172.21.15.40:0/73750144 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2bb806ced0 0x7f2bb806d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:56.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.757+0000 7f8c670ed700 1 -- 172.21.15.40:0/3336555757 shutdown_connections 2023-09-30T22:29:56.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.757+0000 7f8c670ed700 1 -- 172.21.15.40:0/3336555757 wait complete. 2023-09-30T22:29:56.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.757+0000 7f2bbd103700 1 --2- 172.21.15.40:0/73750144 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2bb809fbb0 0x7f2bb806c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:56.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.757+0000 7f2baffff700 1 -- 172.21.15.40:0/73750144 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1283428984 0 0) 0x7f2bb806e3f0 con 0x7f2bb8138370 2023-09-30T22:29:56.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.757+0000 7f2baffff700 1 -- 172.21.15.40:0/73750144 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ba40035b0 con 0x7f2bb8138370 2023-09-30T22:29:56.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.757+0000 7f2bbc902700 1 -- 172.21.15.40:0/73750144 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2bb809fbb0 msgr2=0x7f2bb806c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:56.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.757+0000 7f2bbc902700 1 --2- 172.21.15.40:0/73750144 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2bb809fbb0 0x7f2bb806c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.757+0000 7f2bbc902700 1 -- 172.21.15.40:0/73750144 >> v1:172.21.15.40:6789/0 conn(0x7f2bb8138370 legacy=0x7f2bb813a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:56.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.757+0000 7f2bbc902700 1 -- 172.21.15.40:0/73750144 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb8097ed0 con 0x7f2bb806ced0 2023-09-30T22:29:56.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.757+0000 7f2bbc902700 1 --2- 172.21.15.40:0/73750144 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2bb806ced0 0x7f2bb806d2e0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8009870 tx=0x7f2ba8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c0ab2d4349be459 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:56.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.757+0000 7f2bbd103700 1 --2- 172.21.15.40:0/73750144 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2bb809fbb0 0x7f2bb806c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:56.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.758+0000 7f2baffff700 1 -- 172.21.15.40:0/73750144 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8011830 con 0x7f2bb806ced0 2023-09-30T22:29:56.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.758+0000 7f2baffff700 1 -- 172.21.15.40:0/73750144 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba8011990 con 0x7f2bb806ced0 2023-09-30T22:29:56.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.758+0000 7f2baffff700 1 -- 172.21.15.40:0/73750144 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8011d00 con 0x7f2bb806ced0 2023-09-30T22:29:56.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.758+0000 7f8c670ed700 1 Processor -- start 2023-09-30T22:29:56.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.758+0000 7f8c670ed700 1 -- start start 2023-09-30T22:29:56.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.758+0000 7f2bbf367700 1 -- 172.21.15.40:0/73750144 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2bb806ced0 msgr2=0x7f2bb806d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:56.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.758+0000 7f2bbf367700 1 --2- 172.21.15.40:0/73750144 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2bb806ced0 0x7f2bb806d2e0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8009870 tx=0x7f2ba8009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:56.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.758+0000 7f2bbf367700 1 -- 172.21.15.40:0/73750144 shutdown_connections 2023-09-30T22:29:56.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.758+0000 7f2bbf367700 1 --2- 172.21.15.40:0/73750144 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2bb809fbb0 0x7f2bb806c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.758+0000 7f2bbf367700 1 --2- 172.21.15.40:0/73750144 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2bb806ced0 0x7f2bb806d2e0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.758+0000 7f2bbf367700 1 -- 172.21.15.40:0/73750144 >> 172.21.15.40:0/73750144 conn(0x7f2bb80a41a0 msgr2=0x7f2bb80a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:56.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.758+0000 7f2bbf367700 1 -- 172.21.15.40:0/73750144 shutdown_connections 2023-09-30T22:29:56.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.759+0000 7f2bbf367700 1 -- 172.21.15.40:0/73750144 wait complete. 2023-09-30T22:29:56.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.759+0000 7f8c670ed700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c6012d6d0 0x7f8c601c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.759+0000 7f8c670ed700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c6012e590 0x7f8c601c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.759+0000 7f8c670ed700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c6012eea0 0x7f8c601c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.759+0000 7f8c670ed700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6006f260 con 0x7f8c6012e590 2023-09-30T22:29:56.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.759+0000 7f8c670ed700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6006d7b0 con 0x7f8c6012eea0 2023-09-30T22:29:56.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.759+0000 7f8c670ed700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c600713e0 con 0x7f8c6012d6d0 2023-09-30T22:29:56.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.759+0000 7f8c64e89700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c6012d6d0 0x7f8c601c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:56.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.759+0000 7f8c64e89700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c6012d6d0 0x7f8c601c8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:39582/0 (socket says 172.21.15.40:39582) 2023-09-30T22:29:56.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.759+0000 7f8c64e89700 1 -- 172.21.15.40:0/3650706818 learned_addr learned my addr 172.21.15.40:0/3650706818 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:56.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.759+0000 7f8c5ffff700 1 --2- 172.21.15.40:0/3650706818 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c6012e590 0x7f8c601c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:56.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.759+0000 7f8c64e89700 1 -- 172.21.15.40:0/3650706818 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c6012eea0 msgr2=0x7f8c601c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:56.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.759+0000 7f8c64e89700 1 --2- 172.21.15.40:0/3650706818 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c6012eea0 0x7f8c601c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.759+0000 7f8c64e89700 1 -- 172.21.15.40:0/3650706818 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c6012e590 msgr2=0x7f8c601c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:56.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.759+0000 7f8c64e89700 1 --2- 172.21.15.40:0/3650706818 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c6012e590 0x7f8c601c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.759+0000 7f8c64e89700 1 -- 172.21.15.40:0/3650706818 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c4c0094a0 con 0x7f8c6012d6d0 2023-09-30T22:29:56.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.759+0000 7f2bbf367700 1 Processor -- start 2023-09-30T22:29:56.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.760+0000 7f8c64e89700 1 --2- 172.21.15.40:0/3650706818 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c6012d6d0 0x7f8c601c8580 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f8c5400e810 tx=0x7f8c5400eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:56.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.760+0000 7f8c5d7fa700 1 -- 172.21.15.40:0/3650706818 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c54004230 con 0x7f8c6012d6d0 2023-09-30T22:29:56.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.760+0000 7f8c5d7fa700 1 -- 172.21.15.40:0/3650706818 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c54004390 con 0x7f8c6012d6d0 2023-09-30T22:29:56.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.760+0000 7f8c5d7fa700 1 -- 172.21.15.40:0/3650706818 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c540036a0 con 0x7f8c6012d6d0 2023-09-30T22:29:56.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.760+0000 7f2bbf367700 1 -- start start 2023-09-30T22:29:56.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.760+0000 7f2bbf367700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bb806ced0 0x7f2bb8132d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.760+0000 7f2bbf367700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2bb809fbb0 0x7f2bb81332a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.760+0000 7f2bbf367700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2bb8138370 0x7f2bb81337e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.760+0000 7f2bbf367700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb809f2f0 con 0x7f2bb806ced0 2023-09-30T22:29:56.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.760+0000 7f2bbf367700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb8071db0 con 0x7f2bb8138370 2023-09-30T22:29:56.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.760+0000 7f2bbf367700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb81373c0 con 0x7f2bb809fbb0 2023-09-30T22:29:56.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.760+0000 7f2bbd103700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bb806ced0 0x7f2bb8132d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:56.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.760+0000 7f2bbd103700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bb806ced0 0x7f2bb8132d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36690/0 (socket says 172.21.15.40:36690) 2023-09-30T22:29:56.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.760+0000 7f2bbd103700 1 -- 172.21.15.40:0/1734822024 learned_addr learned my addr 172.21.15.40:0/1734822024 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:56.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.760+0000 7f2bbd904700 1 --2- 172.21.15.40:0/1734822024 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2bb8138370 0x7f2bb81337e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:56.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.760+0000 7f2bbc902700 1 --2- 172.21.15.40:0/1734822024 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2bb809fbb0 0x7f2bb81332a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:56.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.761+0000 7f2bbd103700 1 -- 172.21.15.40:0/1734822024 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2bb809fbb0 msgr2=0x7f2bb81332a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:56.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.761+0000 7f2bbd103700 1 --2- 172.21.15.40:0/1734822024 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2bb809fbb0 0x7f2bb81332a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.761+0000 7f2bbd103700 1 -- 172.21.15.40:0/1734822024 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2bb8138370 msgr2=0x7f2bb81337e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:56.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.761+0000 7f2bbd103700 1 --2- 172.21.15.40:0/1734822024 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2bb8138370 0x7f2bb81337e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.761+0000 7f2bbd103700 1 -- 172.21.15.40:0/1734822024 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb40094a0 con 0x7f2bb806ced0 2023-09-30T22:29:56.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.761+0000 7f8c670ed700 1 -- 172.21.15.40:0/3650706818 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c6009cdb0 con 0x7f8c6012d6d0 2023-09-30T22:29:56.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.761+0000 7f8c670ed700 1 -- 172.21.15.40:0/3650706818 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6006fcd0 con 0x7f8c6012d6d0 2023-09-30T22:29:56.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.761+0000 7f2bbd103700 1 --2- 172.21.15.40:0/1734822024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bb806ced0 0x7f2bb8132d60 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f2bb400ebe0 tx=0x7f2bb400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:56.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.761+0000 7f2badffb700 1 -- 172.21.15.40:0/1734822024 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb400c850 con 0x7f2bb806ced0 2023-09-30T22:29:56.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.761+0000 7f2badffb700 1 -- 172.21.15.40:0/1734822024 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb400c9b0 con 0x7f2bb806ced0 2023-09-30T22:29:56.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.761+0000 7f2badffb700 1 -- 172.21.15.40:0/1734822024 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb400cd40 con 0x7f2bb806ced0 2023-09-30T22:29:56.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.761+0000 7f2bbf367700 1 -- 172.21.15.40:0/1734822024 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba80094a0 con 0x7f2bb806ced0 2023-09-30T22:29:56.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.762+0000 7f2bbf367700 1 -- 172.21.15.40:0/1734822024 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb8136ed0 con 0x7f2bb806ced0 2023-09-30T22:29:56.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.762+0000 7f8c670ed700 1 -- 172.21.15.40:0/3650706818 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c60062380 con 0x7f8c6012d6d0 2023-09-30T22:29:56.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.762+0000 7f8c5d7fa700 1 -- 172.21.15.40:0/3650706818 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8c54003800 con 0x7f8c6012d6d0 2023-09-30T22:29:56.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.763+0000 7f8c5d7fa700 1 -- 172.21.15.40:0/3650706818 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f8c5403f260 con 0x7f8c6012d6d0 2023-09-30T22:29:56.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.763+0000 7f2bbf367700 1 -- 172.21.15.40:0/1734822024 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bb8062380 con 0x7f2bb806ced0 2023-09-30T22:29:56.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.767+0000 7f2badffb700 1 -- 172.21.15.40:0/1734822024 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2bb4013470 con 0x7f2bb806ced0 2023-09-30T22:29:56.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.768+0000 7f2badffb700 1 -- 172.21.15.40:0/1734822024 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f2bb4040120 con 0x7f2bb806ced0 2023-09-30T22:29:56.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.768+0000 7f2badffb700 1 -- 172.21.15.40:0/1734822024 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2bb4013720 con 0x7f2bb806ced0 2023-09-30T22:29:56.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.771+0000 7f8c5d7fa700 1 -- 172.21.15.40:0/3650706818 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c540228f0 con 0x7f8c6012d6d0 2023-09-30T22:29:56.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.798+0000 7f0d57872700 1 Processor -- start 2023-09-30T22:29:56.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.799+0000 7f0d57872700 1 -- start start 2023-09-30T22:29:56.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.799+0000 7f0d57872700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0d5006f070 0x7f0d5006f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.799+0000 7f0d57872700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0d5006fdb0 0x7f0d500977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.799+0000 7f0d57872700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d50070830 con 0x7f0d5006f980 2023-09-30T22:29:56.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.799+0000 7f0d57872700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d50070ad0 con 0x7f0d5006f070 2023-09-30T22:29:56.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.799+0000 7f0d57872700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d50070de0 con 0x7f0d5006fdb0 2023-09-30T22:29:56.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.799+0000 7f0d5560e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0d5006f070 0x7f0d5006f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:56.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.799+0000 7f0d5560e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0d5006f070 0x7f0d5006f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:45824/0 (socket says 172.21.15.40:45824) 2023-09-30T22:29:56.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.799+0000 7f0d5560e700 1 -- 172.21.15.40:0/3065773913 learned_addr learned my addr 172.21.15.40:0/3065773913 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:56.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.799+0000 7f0d54e0d700 1 --1- 172.21.15.40:0/3065773913 >> v1:172.21.15.40:6789/0 conn(0x7f0d5006f980 0x7f0d50097090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33108/0 (socket says 172.21.15.40:33108) 2023-09-30T22:29:56.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.800+0000 7f0d55e0f700 1 --2- 172.21.15.40:0/3065773913 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0d5006fdb0 0x7f0d500977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:56.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.800+0000 7f0d5560e700 1 -- 172.21.15.40:0/3065773913 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0d5006fdb0 msgr2=0x7f0d500977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:56.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.800+0000 7f0d5560e700 1 --2- 172.21.15.40:0/3065773913 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0d5006fdb0 0x7f0d500977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.800+0000 7f0d47fff700 1 -- 172.21.15.40:0/3065773913 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2803285211 0 0) 0x7f0d50070830 con 0x7f0d5006f980 2023-09-30T22:29:56.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.800+0000 7f0d5560e700 1 -- 172.21.15.40:0/3065773913 >> v1:172.21.15.40:6789/0 conn(0x7f0d5006f980 legacy=0x7f0d50097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:56.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.800+0000 7f0d5560e700 1 -- 172.21.15.40:0/3065773913 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5009fe20 con 0x7f0d5006f070 2023-09-30T22:29:56.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.800+0000 7f0d5560e700 1 --2- 172.21.15.40:0/3065773913 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0d5006f070 0x7f0d5006f440 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009920 tx=0x7f0d4c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15f2c7c89469b19f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:56.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.800+0000 7f0d47fff700 1 -- 172.21.15.40:0/3065773913 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c00ba60 con 0x7f0d5006f070 2023-09-30T22:29:56.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.800+0000 7f0d47fff700 1 -- 172.21.15.40:0/3065773913 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4c00bbc0 con 0x7f0d5006f070 2023-09-30T22:29:56.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.800+0000 7f0d47fff700 1 -- 172.21.15.40:0/3065773913 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c009e70 con 0x7f0d5006f070 2023-09-30T22:29:56.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.801+0000 7f0d57872700 1 -- 172.21.15.40:0/3065773913 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0d5006f070 msgr2=0x7f0d5006f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:56.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.801+0000 7f0d57872700 1 --2- 172.21.15.40:0/3065773913 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0d5006f070 0x7f0d5006f440 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009920 tx=0x7f0d4c009c30 comp rx=0 tx=0).stop 2023-09-30T22:29:56.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.801+0000 7f0d57872700 1 -- 172.21.15.40:0/3065773913 shutdown_connections 2023-09-30T22:29:56.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.801+0000 7f0d57872700 1 --2- 172.21.15.40:0/3065773913 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0d5006fdb0 0x7f0d500977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.801+0000 7f0d57872700 1 --2- 172.21.15.40:0/3065773913 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0d5006f070 0x7f0d5006f440 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.801+0000 7f0d57872700 1 -- 172.21.15.40:0/3065773913 >> 172.21.15.40:0/3065773913 conn(0x7f0d500a41a0 msgr2=0x7f0d500a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:56.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.801+0000 7f0d57872700 1 -- 172.21.15.40:0/3065773913 shutdown_connections 2023-09-30T22:29:56.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.802+0000 7f0d57872700 1 -- 172.21.15.40:0/3065773913 wait complete. 2023-09-30T22:29:56.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.802+0000 7f0d57872700 1 Processor -- start 2023-09-30T22:29:56.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.802+0000 7f0d57872700 1 -- start start 2023-09-30T22:29:56.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.803+0000 7f0d57872700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0d5006f070 0x7f0d5006c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.803+0000 7f0d57872700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0d5006f980 0x7f0d5006ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.803+0000 7f0d57872700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d5006fdb0 0x7f0d5006d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:56.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.803+0000 7f0d57872700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d50096fb0 con 0x7f0d5006fdb0 2023-09-30T22:29:56.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.803+0000 7f0d57872700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d50129330 con 0x7f0d5006f980 2023-09-30T22:29:56.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.803+0000 7f0d57872700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5012c2d0 con 0x7f0d5006f070 2023-09-30T22:29:56.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.803+0000 7f0d5560e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0d5006f070 0x7f0d5006c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:56.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.803+0000 7f0d5560e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0d5006f070 0x7f0d5006c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:39606/0 (socket says 172.21.15.40:39606) 2023-09-30T22:29:56.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.803+0000 7f0d5560e700 1 -- 172.21.15.40:0/2142832689 learned_addr learned my addr 172.21.15.40:0/2142832689 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:56.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.803+0000 7f0d55e0f700 1 --2- 172.21.15.40:0/2142832689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d5006fdb0 0x7f0d5006d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:56.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.803+0000 7f0d54e0d700 1 --2- 172.21.15.40:0/2142832689 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0d5006f980 0x7f0d5006ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:56.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.803+0000 7f0d5560e700 1 -- 172.21.15.40:0/2142832689 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0d5006f980 msgr2=0x7f0d5006ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:56.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.803+0000 7f0d5560e700 1 --2- 172.21.15.40:0/2142832689 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0d5006f980 0x7f0d5006ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.803+0000 7f0d5560e700 1 -- 172.21.15.40:0/2142832689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d5006fdb0 msgr2=0x7f0d5006d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:56.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.803+0000 7f0d5560e700 1 --2- 172.21.15.40:0/2142832689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d5006fdb0 0x7f0d5006d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.804+0000 7f0d5560e700 1 -- 172.21.15.40:0/2142832689 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d4c009550 con 0x7f0d5006f070 2023-09-30T22:29:56.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.804+0000 7f0d5560e700 1 --2- 172.21.15.40:0/2142832689 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0d5006f070 0x7f0d5006c990 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c006d30 tx=0x7f0d4c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:56.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.804+0000 7f0d45ffb700 1 -- 172.21.15.40:0/2142832689 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c004510 con 0x7f0d5006f070 2023-09-30T22:29:56.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.804+0000 7f0d45ffb700 1 -- 172.21.15.40:0/2142832689 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4c0036a0 con 0x7f0d5006f070 2023-09-30T22:29:56.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.804+0000 7f0d45ffb700 1 -- 172.21.15.40:0/2142832689 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c003a10 con 0x7f0d5006f070 2023-09-30T22:29:56.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.805+0000 7f0d57872700 1 -- 172.21.15.40:0/2142832689 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d5008b3a0 con 0x7f0d5006f070 2023-09-30T22:29:56.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.805+0000 7f0d57872700 1 -- 172.21.15.40:0/2142832689 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d50131740 con 0x7f0d5006f070 2023-09-30T22:29:56.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.805+0000 7f0d45ffb700 1 -- 172.21.15.40:0/2142832689 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0d4c021070 con 0x7f0d5006f070 2023-09-30T22:29:56.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.806+0000 7f0d45ffb700 1 -- 172.21.15.40:0/2142832689 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f0d4c040bb0 con 0x7f0d5006f070 2023-09-30T22:29:56.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.806+0000 7f0d57872700 1 -- 172.21.15.40:0/2142832689 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d50062380 con 0x7f0d5006f070 2023-09-30T22:29:56.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.811+0000 7f0d45ffb700 1 -- 172.21.15.40:0/2142832689 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0d4c015020 con 0x7f0d5006f070 2023-09-30T22:29:56.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.911+0000 7f535584e700 1 -- 172.21.15.40:0/1856887929 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5350122f20 con 0x7f535009d400 2023-09-30T22:29:56.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.912+0000 7f5337fff700 1 -- 172.21.15.40:0/1856887929 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f534000bbd0 con 0x7f535009d400 2023-09-30T22:29:56.913 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:56.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.914+0000 7f535584e700 1 -- 172.21.15.40:0/1856887929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f535009d400 msgr2=0x7f535006f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:56.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.914+0000 7f535584e700 1 --2- 172.21.15.40:0/1856887929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f535009d400 0x7f535006f630 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f5340000c00 tx=0x7f5340004750 comp rx=0 tx=0).stop 2023-09-30T22:29:56.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.915+0000 7f535584e700 1 -- 172.21.15.40:0/1856887929 shutdown_connections 2023-09-30T22:29:56.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.915+0000 7f535584e700 1 --2- 172.21.15.40:0/1856887929 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5350133e00 0x7f53500700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.915+0000 7f535584e700 1 --2- 172.21.15.40:0/1856887929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f535009d400 0x7f535006f630 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.915+0000 7f535584e700 1 --2- 172.21.15.40:0/1856887929 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f535009df70 0x7f535006fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.915+0000 7f535584e700 1 -- 172.21.15.40:0/1856887929 >> 172.21.15.40:0/1856887929 conn(0x7f53500a2a00 msgr2=0x7f53500a0900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:56.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.915+0000 7f535584e700 1 -- 172.21.15.40:0/1856887929 shutdown_connections 2023-09-30T22:29:56.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.915+0000 7f535584e700 1 -- 172.21.15.40:0/1856887929 wait complete. 2023-09-30T22:29:56.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:56.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.975+0000 7f8c670ed700 1 -- 172.21.15.40:0/3650706818 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8c6009b4b0 con 0x7f8c6012d6d0 2023-09-30T22:29:56.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.975+0000 7f8c5d7fa700 1 -- 172.21.15.40:0/3650706818 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8c54022300 con 0x7f8c6012d6d0 2023-09-30T22:29:56.976 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:56.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.976+0000 7f2bbf367700 1 -- 172.21.15.40:0/1734822024 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2bb80a04e0 con 0x7f2bb806ced0 2023-09-30T22:29:56.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.976+0000 7f2badffb700 1 -- 172.21.15.40:0/1734822024 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2bb4017090 con 0x7f2bb806ced0 2023-09-30T22:29:56.977 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:56.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.977+0000 7f8c670ed700 1 -- 172.21.15.40:0/3650706818 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c6012d6d0 msgr2=0x7f8c601c8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:56.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.977+0000 7f8c670ed700 1 --2- 172.21.15.40:0/3650706818 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c6012d6d0 0x7f8c601c8580 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f8c5400e810 tx=0x7f8c5400eb20 comp rx=0 tx=0).stop 2023-09-30T22:29:56.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.977+0000 7f8c670ed700 1 -- 172.21.15.40:0/3650706818 shutdown_connections 2023-09-30T22:29:56.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.977+0000 7f8c670ed700 1 --2- 172.21.15.40:0/3650706818 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8c6012d6d0 0x7f8c601c8580 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.977+0000 7f8c670ed700 1 --2- 172.21.15.40:0/3650706818 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c6012eea0 0x7f8c601c9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.977+0000 7f8c670ed700 1 --2- 172.21.15.40:0/3650706818 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c6012e590 0x7f8c601c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.977+0000 7f8c670ed700 1 -- 172.21.15.40:0/3650706818 >> 172.21.15.40:0/3650706818 conn(0x7f8c600a2a00 msgr2=0x7f8c6009d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:56.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.977+0000 7f8c670ed700 1 -- 172.21.15.40:0/3650706818 shutdown_connections 2023-09-30T22:29:56.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.977+0000 7f8c670ed700 1 -- 172.21.15.40:0/3650706818 wait complete. 2023-09-30T22:29:56.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.979+0000 7f2bbf367700 1 -- 172.21.15.40:0/1734822024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bb806ced0 msgr2=0x7f2bb8132d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:56.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.979+0000 7f2bbf367700 1 --2- 172.21.15.40:0/1734822024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bb806ced0 0x7f2bb8132d60 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f2bb400ebe0 tx=0x7f2bb400eef0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.979+0000 7f2bbf367700 1 -- 172.21.15.40:0/1734822024 shutdown_connections 2023-09-30T22:29:56.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.979+0000 7f2bbf367700 1 --2- 172.21.15.40:0/1734822024 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2bb8138370 0x7f2bb81337e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.979+0000 7f2bbf367700 1 --2- 172.21.15.40:0/1734822024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bb806ced0 0x7f2bb8132d60 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.979+0000 7f2bbf367700 1 --2- 172.21.15.40:0/1734822024 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2bb809fbb0 0x7f2bb81332a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:56.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.979+0000 7f2bbf367700 1 -- 172.21.15.40:0/1734822024 >> 172.21.15.40:0/1734822024 conn(0x7f2bb80a41a0 msgr2=0x7f2bb809dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:56.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.979+0000 7f2bbf367700 1 -- 172.21.15.40:0/1734822024 shutdown_connections 2023-09-30T22:29:56.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:56.979+0000 7f2bbf367700 1 -- 172.21.15.40:0/1734822024 wait complete. 2023-09-30T22:29:56.992 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:56.993 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:57.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:57.018+0000 7f0d57872700 1 -- 172.21.15.40:0/2142832689 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0d50074620 con 0x7f0d5006f070 2023-09-30T22:29:57.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:57.018+0000 7f0d45ffb700 1 -- 172.21.15.40:0/2142832689 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0d4c0199a0 con 0x7f0d5006f070 2023-09-30T22:29:57.019 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:57.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:57.020+0000 7f0d57872700 1 -- 172.21.15.40:0/2142832689 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0d5006f070 msgr2=0x7f0d5006c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:57.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:57.020+0000 7f0d57872700 1 --2- 172.21.15.40:0/2142832689 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0d5006f070 0x7f0d5006c990 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c006d30 tx=0x7f0d4c004750 comp rx=0 tx=0).stop 2023-09-30T22:29:57.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:57.020+0000 7f0d57872700 1 -- 172.21.15.40:0/2142832689 shutdown_connections 2023-09-30T22:29:57.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:57.020+0000 7f0d57872700 1 --2- 172.21.15.40:0/2142832689 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0d5006f070 0x7f0d5006c990 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:57.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:57.020+0000 7f0d57872700 1 --2- 172.21.15.40:0/2142832689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d5006fdb0 0x7f0d5006d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:57.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:57.020+0000 7f0d57872700 1 --2- 172.21.15.40:0/2142832689 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0d5006f980 0x7f0d5006ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:57.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:57.020+0000 7f0d57872700 1 -- 172.21.15.40:0/2142832689 >> 172.21.15.40:0/2142832689 conn(0x7f0d500a41a0 msgr2=0x7f0d500974c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:57.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:57.020+0000 7f0d57872700 1 -- 172.21.15.40:0/2142832689 shutdown_connections 2023-09-30T22:29:57.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:57.020+0000 7f0d57872700 1 -- 172.21.15.40:0/2142832689 wait complete. 2023-09-30T22:29:57.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:57.934 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:57.993 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:57.994 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:58.034 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:58.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.082+0000 7f399a3dd700 1 Processor -- start 2023-09-30T22:29:58.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.083+0000 7f399a3dd700 1 -- start start 2023-09-30T22:29:58.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.083+0000 7f399a3dd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f399409e400 0x7f3994135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.083+0000 7f399a3dd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3994136230 0x7f3994138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.083+0000 7f399a3dd700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f399409adf0 con 0x7f399409d920 2023-09-30T22:29:58.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.083+0000 7f399a3dd700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f399409e7f0 con 0x7f3994136230 2023-09-30T22:29:58.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.083+0000 7f399a3dd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f399409edf0 con 0x7f399409e400 2023-09-30T22:29:58.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.083+0000 7f399897a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3994136230 0x7f3994138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.083+0000 7f399897a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3994136230 0x7f3994138610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36710/0 (socket says 172.21.15.40:36710) 2023-09-30T22:29:58.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.083+0000 7f399897a700 1 -- 172.21.15.40:0/55023906 learned_addr learned my addr 172.21.15.40:0/55023906 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:58.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.083+0000 7f39937fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f399409e400 0x7f3994135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.084+0000 7f399897a700 1 -- 172.21.15.40:0/55023906 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f399409e400 msgr2=0x7f3994135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:58.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.084+0000 7f399897a700 1 --2- 172.21.15.40:0/55023906 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f399409e400 0x7f3994135cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.084+0000 7f399897a700 1 -- 172.21.15.40:0/55023906 >> v1:172.21.15.40:6789/0 conn(0x7f399409d920 legacy=0x7f399409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:58.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.084+0000 7f399897a700 1 -- 172.21.15.40:0/55023906 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399409b660 con 0x7f3994136230 2023-09-30T22:29:58.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.084+0000 7f39937fe700 1 --2- 172.21.15.40:0/55023906 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f399409e400 0x7f3994135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:58.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.084+0000 7f399897a700 1 --2- 172.21.15.40:0/55023906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3994136230 0x7f3994138610 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f398c009e50 tx=0x7f398c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a922ffb94cfc5128 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:58.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.084+0000 7f3992ffd700 1 -- 172.21.15.40:0/55023906 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398c00e070 con 0x7f3994136230 2023-09-30T22:29:58.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.084+0000 7f3992ffd700 1 -- 172.21.15.40:0/55023906 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398c003a20 con 0x7f3994136230 2023-09-30T22:29:58.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.084+0000 7f3992ffd700 1 -- 172.21.15.40:0/55023906 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398c003dd0 con 0x7f3994136230 2023-09-30T22:29:58.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.085+0000 7f399a3dd700 1 -- 172.21.15.40:0/55023906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3994136230 msgr2=0x7f3994138610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:58.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.085+0000 7f399a3dd700 1 --2- 172.21.15.40:0/55023906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3994136230 0x7f3994138610 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f398c009e50 tx=0x7f398c00b330 comp rx=0 tx=0).stop 2023-09-30T22:29:58.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.085+0000 7f399a3dd700 1 -- 172.21.15.40:0/55023906 shutdown_connections 2023-09-30T22:29:58.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.085+0000 7f399a3dd700 1 --2- 172.21.15.40:0/55023906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3994136230 0x7f3994138610 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.085+0000 7f399a3dd700 1 --2- 172.21.15.40:0/55023906 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f399409e400 0x7f3994135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.085+0000 7f399a3dd700 1 -- 172.21.15.40:0/55023906 >> 172.21.15.40:0/55023906 conn(0x7f399409fb20 msgr2=0x7f399409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:58.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.085+0000 7f399a3dd700 1 -- 172.21.15.40:0/55023906 shutdown_connections 2023-09-30T22:29:58.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.085+0000 7f399a3dd700 1 -- 172.21.15.40:0/55023906 wait complete. 2023-09-30T22:29:58.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.087+0000 7f399a3dd700 1 Processor -- start 2023-09-30T22:29:58.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.087+0000 7f399a3dd700 1 -- start start 2023-09-30T22:29:58.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.088+0000 7f399a3dd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f399409d920 0x7f399411f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.088+0000 7f399a3dd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f399409e400 0x7f399411fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.088+0000 7f399a3dd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3994136230 0x7f3994120290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.088+0000 7f399a3dd700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3994123300 con 0x7f3994136230 2023-09-30T22:29:58.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.088+0000 7f399a3dd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3994135630 con 0x7f399409d920 2023-09-30T22:29:58.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.088+0000 7f399a3dd700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f399409cb00 con 0x7f399409e400 2023-09-30T22:29:58.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.088+0000 7f3993fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f399409d920 0x7f399411f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.088+0000 7f3993fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f399409d920 0x7f399411f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:45840/0 (socket says 172.21.15.40:45840) 2023-09-30T22:29:58.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.088+0000 7f3993fff700 1 -- 172.21.15.40:0/3428117800 learned_addr learned my addr 172.21.15.40:0/3428117800 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:58.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.088+0000 7f39937fe700 1 --2- 172.21.15.40:0/3428117800 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f399409e400 0x7f399411fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.088+0000 7f399897a700 1 --2- 172.21.15.40:0/3428117800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3994136230 0x7f3994120290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.088+0000 7f3993fff700 1 -- 172.21.15.40:0/3428117800 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f399409e400 msgr2=0x7f399411fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:58.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.088+0000 7f3993fff700 1 --2- 172.21.15.40:0/3428117800 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f399409e400 0x7f399411fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.088+0000 7f3993fff700 1 -- 172.21.15.40:0/3428117800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3994136230 msgr2=0x7f3994120290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:58.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.088+0000 7f3993fff700 1 --2- 172.21.15.40:0/3428117800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3994136230 0x7f3994120290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.088+0000 7f3993fff700 1 -- 172.21.15.40:0/3428117800 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39880094a0 con 0x7f399409d920 2023-09-30T22:29:58.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.089+0000 7f3993fff700 1 --2- 172.21.15.40:0/3428117800 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f399409d920 0x7f399411f810 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f398400e990 tx=0x7f398400eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:58.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.089+0000 7f3990ff9700 1 -- 172.21.15.40:0/3428117800 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3984005480 con 0x7f399409d920 2023-09-30T22:29:58.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.089+0000 7f3990ff9700 1 -- 172.21.15.40:0/3428117800 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3984003680 con 0x7f399409d920 2023-09-30T22:29:58.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.089+0000 7f3990ff9700 1 -- 172.21.15.40:0/3428117800 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3984003a30 con 0x7f399409d920 2023-09-30T22:29:58.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.089+0000 7f399a3dd700 1 -- 172.21.15.40:0/3428117800 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f398c009b30 con 0x7f399409d920 2023-09-30T22:29:58.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.089+0000 7f399a3dd700 1 -- 172.21.15.40:0/3428117800 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3994121bb0 con 0x7f399409d920 2023-09-30T22:29:58.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.090+0000 7f399a3dd700 1 -- 172.21.15.40:0/3428117800 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3994122c20 con 0x7f399409d920 2023-09-30T22:29:58.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.090+0000 7f3990ff9700 1 -- 172.21.15.40:0/3428117800 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3984003b90 con 0x7f399409d920 2023-09-30T22:29:58.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.090+0000 7f3990ff9700 1 -- 172.21.15.40:0/3428117800 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f39840418d0 con 0x7f399409d920 2023-09-30T22:29:58.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.099+0000 7f3990ff9700 1 -- 172.21.15.40:0/3428117800 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3984010490 con 0x7f399409d920 2023-09-30T22:29:58.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.135+0000 7fdbb0376700 1 Processor -- start 2023-09-30T22:29:58.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.135+0000 7fdbb0376700 1 -- start start 2023-09-30T22:29:58.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.135+0000 7fdbb0376700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdba806a6d0 0x7fdba806aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.135+0000 7fdbb0376700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdba806afe0 0x7fdba81318b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.135+0000 7fdbb0376700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdba8131df0 0x7fdba8132250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.135+0000 7fdbb0376700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba809eb60 con 0x7fdba806a6d0 2023-09-30T22:29:58.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.135+0000 7fdbb0376700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba809db70 con 0x7fdba8131df0 2023-09-30T22:29:58.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.135+0000 7fdbb0376700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdba809ddf0 con 0x7fdba806afe0 2023-09-30T22:29:58.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.136+0000 7fdbae112700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdba806a6d0 0x7fdba806aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.136+0000 7fdbae112700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdba806a6d0 0x7fdba806aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36718/0 (socket says 172.21.15.40:36718) 2023-09-30T22:29:58.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.136+0000 7fdbae112700 1 -- 172.21.15.40:0/1692004570 learned_addr learned my addr 172.21.15.40:0/1692004570 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:58.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.136+0000 7fdbad911700 1 --2- 172.21.15.40:0/1692004570 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdba806afe0 0x7fdba81318b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.136+0000 7fdbae913700 1 --2- 172.21.15.40:0/1692004570 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdba8131df0 0x7fdba8132250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.136+0000 7fdbae112700 1 -- 172.21.15.40:0/1692004570 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdba806afe0 msgr2=0x7fdba81318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:58.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.136+0000 7fdbae112700 1 --2- 172.21.15.40:0/1692004570 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdba806afe0 0x7fdba81318b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.136+0000 7fdbae112700 1 -- 172.21.15.40:0/1692004570 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdba8131df0 msgr2=0x7fdba8132250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:58.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.136+0000 7fdbae112700 1 --2- 172.21.15.40:0/1692004570 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdba8131df0 0x7fdba8132250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.136+0000 7fdbae112700 1 -- 172.21.15.40:0/1692004570 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba809c9a0 con 0x7fdba806a6d0 2023-09-30T22:29:58.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.136+0000 7fdbae112700 1 --2- 172.21.15.40:0/1692004570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdba806a6d0 0x7fdba806aaa0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fdba4006fd0 tx=0x7fdba4009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=393478d663016f7b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:58.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.136+0000 7fdbad110700 1 -- 172.21.15.40:0/1692004570 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba4005e30 con 0x7fdba806a6d0 2023-09-30T22:29:58.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.136+0000 7fdbad110700 1 -- 172.21.15.40:0/1692004570 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba4004030 con 0x7fdba806a6d0 2023-09-30T22:29:58.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.136+0000 7fdbad110700 1 -- 172.21.15.40:0/1692004570 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba40043e0 con 0x7fdba806a6d0 2023-09-30T22:29:58.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.137+0000 7fdbb0376700 1 -- 172.21.15.40:0/1692004570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdba806a6d0 msgr2=0x7fdba806aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:58.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.137+0000 7fdbb0376700 1 --2- 172.21.15.40:0/1692004570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdba806a6d0 0x7fdba806aaa0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fdba4006fd0 tx=0x7fdba4009c50 comp rx=0 tx=0).stop 2023-09-30T22:29:58.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.137+0000 7fdbb0376700 1 -- 172.21.15.40:0/1692004570 shutdown_connections 2023-09-30T22:29:58.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.137+0000 7fdbb0376700 1 --2- 172.21.15.40:0/1692004570 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdba8131df0 0x7fdba8132250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.137+0000 7fdbb0376700 1 --2- 172.21.15.40:0/1692004570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdba806a6d0 0x7fdba806aaa0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.137+0000 7fdbb0376700 1 --2- 172.21.15.40:0/1692004570 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdba806afe0 0x7fdba81318b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.137+0000 7fdbb0376700 1 -- 172.21.15.40:0/1692004570 >> 172.21.15.40:0/1692004570 conn(0x7fdba809fb20 msgr2=0x7fdba809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:58.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.138+0000 7fdbb0376700 1 -- 172.21.15.40:0/1692004570 shutdown_connections 2023-09-30T22:29:58.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.138+0000 7fdbb0376700 1 -- 172.21.15.40:0/1692004570 wait complete. 2023-09-30T22:29:58.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.138+0000 7f152c312700 1 Processor -- start 2023-09-30T22:29:58.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.138+0000 7f152c312700 1 -- start start 2023-09-30T22:29:58.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.139+0000 7fdbb0376700 1 Processor -- start 2023-09-30T22:29:58.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.139+0000 7fdbb0376700 1 -- start start 2023-09-30T22:29:58.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.139+0000 7f152c312700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f152406d0a0 0x7f152406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.139+0000 7f152c312700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1524139380 0x7f152413b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.139+0000 7f152c312700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f152406e3f0 con 0x7f152409fbb0 2023-09-30T22:29:58.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.139+0000 7f152c312700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f152409ff80 con 0x7f1524139380 2023-09-30T22:29:58.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.139+0000 7f152c312700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f152406ec40 con 0x7f152406d0a0 2023-09-30T22:29:58.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.139+0000 7f15298ad700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f152406d0a0 0x7f152406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.140+0000 7f15298ad700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f152406d0a0 0x7f152406d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:39630/0 (socket says 172.21.15.40:39630) 2023-09-30T22:29:58.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.140+0000 7f15298ad700 1 -- 172.21.15.40:0/924762735 learned_addr learned my addr 172.21.15.40:0/924762735 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:58.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.140+0000 7f152a8af700 1 --2- 172.21.15.40:0/924762735 >> v2:172.21.15.40:3300/0 conn(0x7f1524139380 0x7f152413b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.140+0000 7fdbb0376700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdba806a6d0 0x7fdba811e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.140+0000 7fdbb0376700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdba806afe0 0x7fdba811ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.140+0000 7fdbb0376700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdba8131df0 0x7fdba811f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.140+0000 7fdbb0376700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba8120540 con 0x7fdba8131df0 2023-09-30T22:29:58.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.140+0000 7fdbb0376700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba8120970 con 0x7fdba806afe0 2023-09-30T22:29:58.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.140+0000 7fdbb0376700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdba806f420 con 0x7fdba806a6d0 2023-09-30T22:29:58.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.140+0000 7f15298ad700 1 -- 172.21.15.40:0/924762735 >> v2:172.21.15.40:3300/0 conn(0x7f1524139380 msgr2=0x7f152413b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:58.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.140+0000 7f15298ad700 1 --2- 172.21.15.40:0/924762735 >> v2:172.21.15.40:3300/0 conn(0x7f1524139380 0x7f152413b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.140+0000 7f15298ad700 1 -- 172.21.15.40:0/924762735 >> v1:172.21.15.40:6789/0 conn(0x7f152409fbb0 legacy=0x7f152406c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:58.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.140+0000 7f15298ad700 1 -- 172.21.15.40:0/924762735 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152406d9f0 con 0x7f152406d0a0 2023-09-30T22:29:58.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.140+0000 7fdbae112700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdba806a6d0 0x7fdba811e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.140+0000 7fdbae112700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdba806a6d0 0x7fdba811e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:39638/0 (socket says 172.21.15.40:39638) 2023-09-30T22:29:58.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.140+0000 7fdbae112700 1 -- 172.21.15.40:0/1964728624 learned_addr learned my addr 172.21.15.40:0/1964728624 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:58.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.140+0000 7fdbae913700 1 --2- 172.21.15.40:0/1964728624 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdba8131df0 0x7fdba811f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.140+0000 7fdbae112700 1 -- 172.21.15.40:0/1964728624 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdba806afe0 msgr2=0x7fdba811ecf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:29:58.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.140+0000 7fdbae112700 1 --2- 172.21.15.40:0/1964728624 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdba806afe0 0x7fdba811ecf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.140+0000 7fdbae112700 1 -- 172.21.15.40:0/1964728624 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdba8131df0 msgr2=0x7fdba811f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:58.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.140+0000 7fdbae112700 1 --2- 172.21.15.40:0/1964728624 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdba8131df0 0x7fdba811f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.140+0000 7fdbae112700 1 -- 172.21.15.40:0/1964728624 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba4009500 con 0x7fdba806a6d0 2023-09-30T22:29:58.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.141+0000 7f15298ad700 1 --2- 172.21.15.40:0/924762735 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f152406d0a0 0x7f152406d4b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f15140098f0 tx=0x7f1514009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a3bed2edfb24b35 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:58.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.141+0000 7fdbae112700 1 --2- 172.21.15.40:0/1964728624 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdba806a6d0 0x7fdba811e7b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fdba809eca0 tx=0x7fdba4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:58.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.141+0000 7f15290ac700 1 -- 172.21.15.40:0/924762735 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1514004230 con 0x7f152406d0a0 2023-09-30T22:29:58.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.141+0000 7f15290ac700 1 -- 172.21.15.40:0/924762735 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1514004390 con 0x7f152406d0a0 2023-09-30T22:29:58.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.141+0000 7f15290ac700 1 -- 172.21.15.40:0/924762735 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15140036a0 con 0x7f152406d0a0 2023-09-30T22:29:58.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.141+0000 7fdb9effd700 1 -- 172.21.15.40:0/1964728624 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba4006b70 con 0x7fdba806a6d0 2023-09-30T22:29:58.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.141+0000 7fdb9effd700 1 -- 172.21.15.40:0/1964728624 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba4003d70 con 0x7fdba806a6d0 2023-09-30T22:29:58.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.141+0000 7fdbb0376700 1 -- 172.21.15.40:0/1964728624 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba809e420 con 0x7fdba806a6d0 2023-09-30T22:29:58.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.141+0000 7fdb9effd700 1 -- 172.21.15.40:0/1964728624 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba4010880 con 0x7fdba806a6d0 2023-09-30T22:29:58.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.141+0000 7fdbb0376700 1 -- 172.21.15.40:0/1964728624 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba81222d0 con 0x7fdba806a6d0 2023-09-30T22:29:58.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.142+0000 7fdb9effd700 1 -- 172.21.15.40:0/1964728624 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdba40109e0 con 0x7fdba806a6d0 2023-09-30T22:29:58.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.142+0000 7fdb9effd700 1 -- 172.21.15.40:0/1964728624 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fdba4044900 con 0x7fdba806a6d0 2023-09-30T22:29:58.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.142+0000 7f152c312700 1 -- 172.21.15.40:0/924762735 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f152406d0a0 msgr2=0x7f152406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:58.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.142+0000 7f152c312700 1 --2- 172.21.15.40:0/924762735 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f152406d0a0 0x7f152406d4b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f15140098f0 tx=0x7f1514009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:58.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.142+0000 7f152c312700 1 -- 172.21.15.40:0/924762735 shutdown_connections 2023-09-30T22:29:58.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.142+0000 7f152c312700 1 --2- 172.21.15.40:0/924762735 >> v2:172.21.15.40:3300/0 conn(0x7f1524139380 0x7f152413b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.142+0000 7f152c312700 1 --2- 172.21.15.40:0/924762735 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f152406d0a0 0x7f152406d4b0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.142+0000 7f152c312700 1 -- 172.21.15.40:0/924762735 >> 172.21.15.40:0/924762735 conn(0x7f15240a41a0 msgr2=0x7f15240a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:58.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.142+0000 7f152c312700 1 -- 172.21.15.40:0/924762735 shutdown_connections 2023-09-30T22:29:58.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.142+0000 7f152c312700 1 -- 172.21.15.40:0/924762735 wait complete. 2023-09-30T22:29:58.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.143+0000 7fdbb0376700 1 -- 172.21.15.40:0/1964728624 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba8062380 con 0x7fdba806a6d0 2023-09-30T22:29:58.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.143+0000 7f152c312700 1 Processor -- start 2023-09-30T22:29:58.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.143+0000 7f152c312700 1 -- start start 2023-09-30T22:29:58.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.144+0000 7f152c312700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f152406d0a0 0x7f15241385c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.144+0000 7f152c312700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f152409fbb0 0x7f1524138b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.144+0000 7f152c312700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1524139380 0x7f152408f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.144+0000 7f152c312700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15240923b0 con 0x7f1524139380 2023-09-30T22:29:58.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.144+0000 7f152c312700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1524092a10 con 0x7f152409fbb0 2023-09-30T22:29:58.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.144+0000 7f152c312700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1524096bf0 con 0x7f152406d0a0 2023-09-30T22:29:58.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.144+0000 7f152a8af700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1524139380 0x7f152408f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.144+0000 7f152a0ae700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f152406d0a0 0x7f15241385c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.144+0000 7f152a8af700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1524139380 0x7f152408f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36736/0 (socket says 172.21.15.40:36736) 2023-09-30T22:29:58.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.144+0000 7f152a8af700 1 -- 172.21.15.40:0/1717993785 learned_addr learned my addr 172.21.15.40:0/1717993785 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:58.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.144+0000 7f15298ad700 1 --2- 172.21.15.40:0/1717993785 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f152409fbb0 0x7f1524138b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.144+0000 7f152a8af700 1 -- 172.21.15.40:0/1717993785 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f152406d0a0 msgr2=0x7f15241385c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:58.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.144+0000 7f152a8af700 1 --2- 172.21.15.40:0/1717993785 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f152406d0a0 0x7f15241385c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.144+0000 7f152a8af700 1 -- 172.21.15.40:0/1717993785 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f152409fbb0 msgr2=0x7f1524138b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:58.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.144+0000 7f152a8af700 1 --2- 172.21.15.40:0/1717993785 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f152409fbb0 0x7f1524138b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.144+0000 7f152a8af700 1 -- 172.21.15.40:0/1717993785 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1514009550 con 0x7f1524139380 2023-09-30T22:29:58.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.144+0000 7f152a8af700 1 --2- 172.21.15.40:0/1717993785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1524139380 0x7f152408f3e0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f151c00efc0 tx=0x7f151c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:58.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.145+0000 7f151affd700 1 -- 172.21.15.40:0/1717993785 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c009ea0 con 0x7f1524139380 2023-09-30T22:29:58.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.145+0000 7f151affd700 1 -- 172.21.15.40:0/1717993785 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151c00f040 con 0x7f1524139380 2023-09-30T22:29:58.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.145+0000 7f151affd700 1 -- 172.21.15.40:0/1717993785 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c00ceb0 con 0x7f1524139380 2023-09-30T22:29:58.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.145+0000 7f152c312700 1 -- 172.21.15.40:0/1717993785 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1524097f10 con 0x7f1524139380 2023-09-30T22:29:58.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.145+0000 7f152c312700 1 -- 172.21.15.40:0/1717993785 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1524071db0 con 0x7f1524139380 2023-09-30T22:29:58.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.146+0000 7f152c312700 1 -- 172.21.15.40:0/1717993785 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1524092870 con 0x7f1524139380 2023-09-30T22:29:58.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.147+0000 7f151affd700 1 -- 172.21.15.40:0/1717993785 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f151c014480 con 0x7f1524139380 2023-09-30T22:29:58.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.147+0000 7f151affd700 1 -- 172.21.15.40:0/1717993785 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f151c0405e0 con 0x7f1524139380 2023-09-30T22:29:58.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.150+0000 7fdb9effd700 1 -- 172.21.15.40:0/1964728624 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdba4016340 con 0x7fdba806a6d0 2023-09-30T22:29:58.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.152+0000 7f151affd700 1 -- 172.21.15.40:0/1717993785 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f151c012520 con 0x7f1524139380 2023-09-30T22:29:58.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.192+0000 7feea56ca700 1 Processor -- start 2023-09-30T22:29:58.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.193+0000 7feea56ca700 1 -- start start 2023-09-30T22:29:58.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.193+0000 7feea56ca700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feea009d920 0x7feea009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.193+0000 7feea56ca700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7feea009e230 0x7feea01308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.193+0000 7feea56ca700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea009adf0 con 0x7feea0130de0 2023-09-30T22:29:58.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.193+0000 7feea56ca700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea009edf0 con 0x7feea009e230 2023-09-30T22:29:58.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.193+0000 7feea56ca700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feea009b660 con 0x7feea009d920 2023-09-30T22:29:58.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.193+0000 7fee9e7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7feea009e230 0x7feea01308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.193+0000 7fee9e7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7feea009e230 0x7feea01308a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36748/0 (socket says 172.21.15.40:36748) 2023-09-30T22:29:58.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.193+0000 7fee9e7fc700 1 -- 172.21.15.40:0/3033903853 learned_addr learned my addr 172.21.15.40:0/3033903853 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:58.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.193+0000 7fee9effd700 1 --2- 172.21.15.40:0/3033903853 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feea009d920 0x7feea009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.194+0000 7fee9effd700 1 -- 172.21.15.40:0/3033903853 >> v2:172.21.15.40:3300/0 conn(0x7feea009e230 msgr2=0x7feea01308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:58.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.194+0000 7fee9effd700 1 --2- 172.21.15.40:0/3033903853 >> v2:172.21.15.40:3300/0 conn(0x7feea009e230 0x7feea01308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.194+0000 7fee9effd700 1 -- 172.21.15.40:0/3033903853 >> v1:172.21.15.40:6789/0 conn(0x7feea0130de0 legacy=0x7feea0137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:58.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.194+0000 7fee9effd700 1 -- 172.21.15.40:0/3033903853 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea009a6e0 con 0x7feea009d920 2023-09-30T22:29:58.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.194+0000 7fee9effd700 1 --2- 172.21.15.40:0/3033903853 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feea009d920 0x7feea009dcf0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fee90009820 tx=0x7fee90009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=501a33f4902b3ff server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:58.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.194+0000 7fee9dffb700 1 -- 172.21.15.40:0/3033903853 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee90005e30 con 0x7feea009d920 2023-09-30T22:29:58.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.194+0000 7fee9dffb700 1 -- 172.21.15.40:0/3033903853 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee90006030 con 0x7feea009d920 2023-09-30T22:29:58.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.194+0000 7fee9dffb700 1 -- 172.21.15.40:0/3033903853 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee900063c0 con 0x7feea009d920 2023-09-30T22:29:58.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.195+0000 7feea56ca700 1 -- 172.21.15.40:0/3033903853 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feea009d920 msgr2=0x7feea009dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:58.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.195+0000 7feea56ca700 1 --2- 172.21.15.40:0/3033903853 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feea009d920 0x7feea009dcf0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fee90009820 tx=0x7fee90009b30 comp rx=0 tx=0).stop 2023-09-30T22:29:58.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.195+0000 7feea56ca700 1 -- 172.21.15.40:0/3033903853 shutdown_connections 2023-09-30T22:29:58.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.195+0000 7feea56ca700 1 --2- 172.21.15.40:0/3033903853 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feea009d920 0x7feea009dcf0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.195+0000 7feea56ca700 1 --2- 172.21.15.40:0/3033903853 >> v2:172.21.15.40:3300/0 conn(0x7feea009e230 0x7feea01308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.195+0000 7feea56ca700 1 -- 172.21.15.40:0/3033903853 >> 172.21.15.40:0/3033903853 conn(0x7feea009fb20 msgr2=0x7feea009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:58.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.195+0000 7feea56ca700 1 -- 172.21.15.40:0/3033903853 shutdown_connections 2023-09-30T22:29:58.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.195+0000 7feea56ca700 1 -- 172.21.15.40:0/3033903853 wait complete. 2023-09-30T22:29:58.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.196+0000 7feea56ca700 1 Processor -- start 2023-09-30T22:29:58.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.196+0000 7feea56ca700 1 -- start start 2023-09-30T22:29:58.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.197+0000 7feea56ca700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feea009d920 0x7feea01203b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.197+0000 7feea56ca700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feea009e230 0x7feea01208f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.197+0000 7feea56ca700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feea0130de0 0x7feea0120e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:58.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.197+0000 7feea56ca700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea0122560 con 0x7feea009e230 2023-09-30T22:29:58.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.197+0000 7feea56ca700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea006b1b0 con 0x7feea009d920 2023-09-30T22:29:58.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.197+0000 7feea56ca700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feea009cb00 con 0x7feea0130de0 2023-09-30T22:29:58.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.197+0000 7fee9e7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feea009e230 0x7feea01208f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.197+0000 7fee9e7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feea009e230 0x7feea01208f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36754/0 (socket says 172.21.15.40:36754) 2023-09-30T22:29:58.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.197+0000 7fee9e7fc700 1 -- 172.21.15.40:0/1811632418 learned_addr learned my addr 172.21.15.40:0/1811632418 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:58.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.197+0000 7fee9f7fe700 1 --2- 172.21.15.40:0/1811632418 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feea0130de0 0x7feea0120e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.197+0000 7fee9effd700 1 --2- 172.21.15.40:0/1811632418 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feea009d920 0x7feea01203b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:58.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.198+0000 7fee9f7fe700 1 -- 172.21.15.40:0/1811632418 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feea009d920 msgr2=0x7feea01203b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:58.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.198+0000 7fee9f7fe700 1 --2- 172.21.15.40:0/1811632418 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feea009d920 0x7feea01203b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.198+0000 7fee9f7fe700 1 -- 172.21.15.40:0/1811632418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feea009e230 msgr2=0x7feea01208f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:58.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.198+0000 7fee9f7fe700 1 --2- 172.21.15.40:0/1811632418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feea009e230 0x7feea01208f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.198+0000 7fee9f7fe700 1 -- 172.21.15.40:0/1811632418 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee90009430 con 0x7feea0130de0 2023-09-30T22:29:58.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.198+0000 7fee9e7fc700 1 --2- 172.21.15.40:0/1811632418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feea009e230 0x7feea01208f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:58.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.198+0000 7fee9f7fe700 1 --2- 172.21.15.40:0/1811632418 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feea0130de0 0x7feea0120e30 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fee9800cb90 tx=0x7fee9800cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:58.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.198+0000 7fee877fe700 1 -- 172.21.15.40:0/1811632418 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee98003c00 con 0x7feea0130de0 2023-09-30T22:29:58.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.198+0000 7fee877fe700 1 -- 172.21.15.40:0/1811632418 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee98003d60 con 0x7feea0130de0 2023-09-30T22:29:58.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.198+0000 7feea56ca700 1 -- 172.21.15.40:0/1811632418 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea0123660 con 0x7feea0130de0 2023-09-30T22:29:58.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.198+0000 7fee877fe700 1 -- 172.21.15.40:0/1811632418 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9800aa60 con 0x7feea0130de0 2023-09-30T22:29:58.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.198+0000 7feea56ca700 1 -- 172.21.15.40:0/1811632418 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea01227b0 con 0x7feea0130de0 2023-09-30T22:29:58.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.199+0000 7fee877fe700 1 -- 172.21.15.40:0/1811632418 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fee9800abc0 con 0x7feea0130de0 2023-09-30T22:29:58.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.199+0000 7fee877fe700 1 -- 172.21.15.40:0/1811632418 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fee9803f500 con 0x7feea0130de0 2023-09-30T22:29:58.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.199+0000 7feea56ca700 1 -- 172.21.15.40:0/1811632418 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea0062380 con 0x7feea0130de0 2023-09-30T22:29:58.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.209+0000 7fee877fe700 1 -- 172.21.15.40:0/1811632418 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fee980198f0 con 0x7feea0130de0 2023-09-30T22:29:58.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.306+0000 7f399a3dd700 1 -- 172.21.15.40:0/3428117800 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3994062380 con 0x7f399409d920 2023-09-30T22:29:58.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.306+0000 7f3990ff9700 1 -- 172.21.15.40:0/3428117800 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3984018b50 con 0x7f399409d920 2023-09-30T22:29:58.307 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:58.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.308+0000 7f399a3dd700 1 -- 172.21.15.40:0/3428117800 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f399409d920 msgr2=0x7f399411f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:58.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.308+0000 7f399a3dd700 1 --2- 172.21.15.40:0/3428117800 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f399409d920 0x7f399411f810 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f398400e990 tx=0x7f398400eca0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.309+0000 7f399a3dd700 1 -- 172.21.15.40:0/3428117800 shutdown_connections 2023-09-30T22:29:58.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.309+0000 7f399a3dd700 1 --2- 172.21.15.40:0/3428117800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3994136230 0x7f3994120290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.309+0000 7f399a3dd700 1 --2- 172.21.15.40:0/3428117800 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f399409d920 0x7f399411f810 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.309+0000 7f399a3dd700 1 --2- 172.21.15.40:0/3428117800 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f399409e400 0x7f399411fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.309+0000 7f399a3dd700 1 -- 172.21.15.40:0/3428117800 >> 172.21.15.40:0/3428117800 conn(0x7f399409fb20 msgr2=0x7f3994119730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:58.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.309+0000 7f399a3dd700 1 -- 172.21.15.40:0/3428117800 shutdown_connections 2023-09-30T22:29:58.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.309+0000 7f399a3dd700 1 -- 172.21.15.40:0/3428117800 wait complete. 2023-09-30T22:29:58.322 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:58.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.353+0000 7fdbb0376700 1 -- 172.21.15.40:0/1964728624 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdba8121de0 con 0x7fdba806a6d0 2023-09-30T22:29:58.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.353+0000 7fdb9effd700 1 -- 172.21.15.40:0/1964728624 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdba4020b50 con 0x7fdba806a6d0 2023-09-30T22:29:58.354 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:58.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.355+0000 7fdbb0376700 1 -- 172.21.15.40:0/1964728624 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdba806a6d0 msgr2=0x7fdba811e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:58.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.355+0000 7fdbb0376700 1 --2- 172.21.15.40:0/1964728624 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdba806a6d0 0x7fdba811e7b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fdba809eca0 tx=0x7fdba4004750 comp rx=0 tx=0).stop 2023-09-30T22:29:58.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.355+0000 7fdbb0376700 1 -- 172.21.15.40:0/1964728624 shutdown_connections 2023-09-30T22:29:58.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.355+0000 7fdbb0376700 1 --2- 172.21.15.40:0/1964728624 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdba806a6d0 0x7fdba811e7b0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.355+0000 7fdbb0376700 1 --2- 172.21.15.40:0/1964728624 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdba8131df0 0x7fdba811f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.355+0000 7fdbb0376700 1 --2- 172.21.15.40:0/1964728624 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdba806afe0 0x7fdba811ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.355+0000 7fdbb0376700 1 -- 172.21.15.40:0/1964728624 >> 172.21.15.40:0/1964728624 conn(0x7fdba809fb20 msgr2=0x7fdba806e180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:58.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.355+0000 7fdbb0376700 1 -- 172.21.15.40:0/1964728624 shutdown_connections 2023-09-30T22:29:58.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.355+0000 7fdbb0376700 1 -- 172.21.15.40:0/1964728624 wait complete. 2023-09-30T22:29:58.368 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:58.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.387+0000 7f152c312700 1 -- 172.21.15.40:0/1717993785 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1524092850 con 0x7f1524139380 2023-09-30T22:29:58.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.388+0000 7f151affd700 1 -- 172.21.15.40:0/1717993785 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f151c012340 con 0x7f1524139380 2023-09-30T22:29:58.389 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:58.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.390+0000 7f152c312700 1 -- 172.21.15.40:0/1717993785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1524139380 msgr2=0x7f152408f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:58.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.390+0000 7f152c312700 1 --2- 172.21.15.40:0/1717993785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1524139380 0x7f152408f3e0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f151c00efc0 tx=0x7f151c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.390+0000 7f152c312700 1 -- 172.21.15.40:0/1717993785 shutdown_connections 2023-09-30T22:29:58.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.390+0000 7f152c312700 1 --2- 172.21.15.40:0/1717993785 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f152406d0a0 0x7f15241385c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.390+0000 7f152c312700 1 --2- 172.21.15.40:0/1717993785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1524139380 0x7f152408f3e0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.390+0000 7f152c312700 1 --2- 172.21.15.40:0/1717993785 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f152409fbb0 0x7f1524138b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.390+0000 7f152c312700 1 -- 172.21.15.40:0/1717993785 >> 172.21.15.40:0/1717993785 conn(0x7f15240a41a0 msgr2=0x7f15240a20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:58.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.390+0000 7f152c312700 1 -- 172.21.15.40:0/1717993785 shutdown_connections 2023-09-30T22:29:58.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.390+0000 7f152c312700 1 -- 172.21.15.40:0/1717993785 wait complete. 2023-09-30T22:29:58.403 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:58.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.426+0000 7feea56ca700 1 -- 172.21.15.40:0/1811632418 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7feea0074720 con 0x7feea0130de0 2023-09-30T22:29:58.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.426+0000 7fee877fe700 1 -- 172.21.15.40:0/1811632418 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fee98011380 con 0x7feea0130de0 2023-09-30T22:29:58.427 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:58.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.429+0000 7feea56ca700 1 -- 172.21.15.40:0/1811632418 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feea0130de0 msgr2=0x7feea0120e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:58.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.429+0000 7feea56ca700 1 --2- 172.21.15.40:0/1811632418 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feea0130de0 0x7feea0120e30 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fee9800cb90 tx=0x7fee9800cea0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.429+0000 7feea56ca700 1 -- 172.21.15.40:0/1811632418 shutdown_connections 2023-09-30T22:29:58.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.429+0000 7feea56ca700 1 --2- 172.21.15.40:0/1811632418 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feea0130de0 0x7feea0120e30 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.429+0000 7feea56ca700 1 --2- 172.21.15.40:0/1811632418 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feea009d920 0x7feea01203b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.429+0000 7feea56ca700 1 --2- 172.21.15.40:0/1811632418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feea009e230 0x7feea01208f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:58.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.429+0000 7feea56ca700 1 -- 172.21.15.40:0/1811632418 >> 172.21.15.40:0/1811632418 conn(0x7feea009fb20 msgr2=0x7feea0130140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:58.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.429+0000 7feea56ca700 1 -- 172.21.15.40:0/1811632418 shutdown_connections 2023-09-30T22:29:58.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:58.429+0000 7feea56ca700 1 -- 172.21.15.40:0/1811632418 wait complete. 2023-09-30T22:29:58.441 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:29:59.323 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:59.368 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:59.404 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:59.442 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:59.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.473+0000 7fe49897f700 1 Processor -- start 2023-09-30T22:29:59.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.473+0000 7fe49897f700 1 -- start start 2023-09-30T22:29:59.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.474+0000 7fe49897f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe49406b1b0 0x7fe494136af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.474+0000 7fe49897f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe494137030 0x7fe494139410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.474+0000 7fe49897f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe49409eb50 con 0x7fe49406a6d0 2023-09-30T22:29:59.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.474+0000 7fe49897f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49406b580 con 0x7fe494137030 2023-09-30T22:29:59.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.474+0000 7fe49897f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe49409dde0 con 0x7fe49406b1b0 2023-09-30T22:29:59.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.474+0000 7fe49259c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe49406a6d0 0x7fe49406aaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33148/0 (socket says 172.21.15.40:33148) 2023-09-30T22:29:59.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.474+0000 7fe49259c700 1 -- 172.21.15.40:0/193965888 learned_addr learned my addr 172.21.15.40:0/193965888 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:29:59.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.474+0000 7fe49159a700 1 -- 172.21.15.40:0/193965888 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3068119823 0 0) 0x7fe49409eb50 con 0x7fe49406a6d0 2023-09-30T22:29:59.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.475+0000 7fe49159a700 1 -- 172.21.15.40:0/193965888 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe47c0035b0 con 0x7fe49406a6d0 2023-09-30T22:29:59.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.475+0000 7fe492d9d700 1 --2- 172.21.15.40:0/193965888 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe494137030 0x7fe494139410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.475+0000 7fe49159a700 1 -- 172.21.15.40:0/193965888 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3618227429 0 0) 0x7fe47c0035b0 con 0x7fe49406a6d0 2023-09-30T22:29:59.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.475+0000 7fe49159a700 1 -- 172.21.15.40:0/193965888 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe49406b1b0 msgr2=0x7fe494136af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:59.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.475+0000 7fe49159a700 1 --2- 172.21.15.40:0/193965888 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe49406b1b0 0x7fe494136af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.475+0000 7fe49159a700 1 -- 172.21.15.40:0/193965888 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe494137030 msgr2=0x7fe494139410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:59.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.475+0000 7fe49159a700 1 --2- 172.21.15.40:0/193965888 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe494137030 0x7fe494139410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.475+0000 7fe49159a700 1 -- 172.21.15.40:0/193965888 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49409d4a0 con 0x7fe49406a6d0 2023-09-30T22:29:59.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.475+0000 7fe49159a700 1 -- 172.21.15.40:0/193965888 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4231795173 0 0) 0x7fe4840017f0 con 0x7fe49406a6d0 2023-09-30T22:29:59.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.475+0000 7fe49159a700 1 -- 172.21.15.40:0/193965888 >> v1:172.21.15.40:6789/0 conn(0x7fe49406a6d0 legacy=0x7fe49406aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:59.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.475+0000 7fe49159a700 1 --2- 172.21.15.40:0/193965888 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe47c003a00 0x7fe47c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.475+0000 7fe49159a700 1 --2- 172.21.15.40:0/193965888 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe49406b1b0 0x7fe47c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.475+0000 7fe49159a700 1 --2- 172.21.15.40:0/193965888 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe494137030 0x7fe47c004d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.475+0000 7fe49159a700 1 -- 172.21.15.40:0/193965888 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49406b580 con 0x7fe47c003a00 2023-09-30T22:29:59.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.475+0000 7fe49159a700 1 -- 172.21.15.40:0/193965888 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49409dde0 con 0x7fe494137030 2023-09-30T22:29:59.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.475+0000 7fe49159a700 1 -- 172.21.15.40:0/193965888 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c005450 con 0x7fe49406b1b0 2023-09-30T22:29:59.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.475+0000 7fe49259c700 1 --2- 172.21.15.40:0/193965888 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe47c003a00 0x7fe47c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.475+0000 7fe492d9d700 1 --2- 172.21.15.40:0/193965888 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe494137030 0x7fe47c004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.476+0000 7fe49259c700 1 -- 172.21.15.40:0/193965888 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe49406b1b0 msgr2=0x7fe47c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:59.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.476+0000 7fe49259c700 1 --2- 172.21.15.40:0/193965888 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe49406b1b0 0x7fe47c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.476+0000 7fe49259c700 1 -- 172.21.15.40:0/193965888 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe494137030 msgr2=0x7fe47c004d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:59.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.476+0000 7fe49259c700 1 --2- 172.21.15.40:0/193965888 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe494137030 0x7fe47c004d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.476+0000 7fe49259c700 1 -- 172.21.15.40:0/193965888 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47c0035b0 con 0x7fe47c003a00 2023-09-30T22:29:59.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.476+0000 7fe49259c700 1 --2- 172.21.15.40:0/193965888 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe47c003a00 0x7fe47c003e10 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fe48400c160 tx=0x7fe47c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9806ad285c8c2eb1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:59.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.476+0000 7fe49159a700 1 -- 172.21.15.40:0/193965888 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe484007b70 con 0x7fe47c003a00 2023-09-30T22:29:59.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.476+0000 7fe49159a700 1 -- 172.21.15.40:0/193965888 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48400cd00 con 0x7fe47c003a00 2023-09-30T22:29:59.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.476+0000 7fe49159a700 1 -- 172.21.15.40:0/193965888 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4840072f0 con 0x7fe47c003a00 2023-09-30T22:29:59.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.477+0000 7fe49897f700 1 -- 172.21.15.40:0/193965888 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe47c003a00 msgr2=0x7fe47c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:59.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.477+0000 7fe49897f700 1 --2- 172.21.15.40:0/193965888 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe47c003a00 0x7fe47c003e10 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fe48400c160 tx=0x7fe47c005880 comp rx=0 tx=0).stop 2023-09-30T22:29:59.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.477+0000 7fe49897f700 1 -- 172.21.15.40:0/193965888 shutdown_connections 2023-09-30T22:29:59.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.477+0000 7fe49897f700 1 --2- 172.21.15.40:0/193965888 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe49406b1b0 0x7fe47c004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.477+0000 7fe49897f700 1 --2- 172.21.15.40:0/193965888 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe494137030 0x7fe47c004d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.477+0000 7fe49897f700 1 --2- 172.21.15.40:0/193965888 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe47c003a00 0x7fe47c003e10 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.477+0000 7fe49897f700 1 -- 172.21.15.40:0/193965888 >> 172.21.15.40:0/193965888 conn(0x7fe49409fb20 msgr2=0x7fe49409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:59.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.477+0000 7fe49897f700 1 -- 172.21.15.40:0/193965888 shutdown_connections 2023-09-30T22:29:59.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.477+0000 7fe49897f700 1 -- 172.21.15.40:0/193965888 wait complete. 2023-09-30T22:29:59.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.479+0000 7fe49897f700 1 Processor -- start 2023-09-30T22:29:59.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.479+0000 7fe49897f700 1 -- start start 2023-09-30T22:29:59.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.480+0000 7fe49897f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe47c003a00 0x7fe49411b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.480+0000 7fe49897f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe49406a6d0 0x7fe49411bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.480+0000 7fe49897f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe49406b1b0 0x7fe49411c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.480+0000 7fe49897f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49411f200 con 0x7fe49406b1b0 2023-09-30T22:29:59.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.480+0000 7fe49897f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe494071560 con 0x7fe49406a6d0 2023-09-30T22:29:59.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.480+0000 7fe49897f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe49409c2f0 con 0x7fe47c003a00 2023-09-30T22:29:59.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.480+0000 7fe49259c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe47c003a00 0x7fe49411b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.480+0000 7fe49259c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe47c003a00 0x7fe49411b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:39700/0 (socket says 172.21.15.40:39700) 2023-09-30T22:29:59.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.480+0000 7fe49259c700 1 -- 172.21.15.40:0/2116188772 learned_addr learned my addr 172.21.15.40:0/2116188772 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:59.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.480+0000 7fe491d9b700 1 --2- 172.21.15.40:0/2116188772 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe49406a6d0 0x7fe49411bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.480+0000 7fe492d9d700 1 --2- 172.21.15.40:0/2116188772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe49406b1b0 0x7fe49411c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.480+0000 7fe49259c700 1 -- 172.21.15.40:0/2116188772 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe49406a6d0 msgr2=0x7fe49411bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:59.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.480+0000 7fe49259c700 1 --2- 172.21.15.40:0/2116188772 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe49406a6d0 0x7fe49411bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.480+0000 7fe49259c700 1 -- 172.21.15.40:0/2116188772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe49406b1b0 msgr2=0x7fe49411c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:59.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.480+0000 7fe49259c700 1 --2- 172.21.15.40:0/2116188772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe49406b1b0 0x7fe49411c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.480+0000 7fe49259c700 1 -- 172.21.15.40:0/2116188772 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49411e8f0 con 0x7fe47c003a00 2023-09-30T22:29:59.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.480+0000 7fe49259c700 1 --2- 172.21.15.40:0/2116188772 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe47c003a00 0x7fe49411b690 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe47c0053a0 tx=0x7fe49409df70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:59.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.481+0000 7fe482ffd700 1 -- 172.21.15.40:0/2116188772 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe484001d60 con 0x7fe47c003a00 2023-09-30T22:29:59.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.481+0000 7fe49897f700 1 -- 172.21.15.40:0/2116188772 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe49411ee80 con 0x7fe47c003a00 2023-09-30T22:29:59.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.481+0000 7fe49897f700 1 -- 172.21.15.40:0/2116188772 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe49411f8f0 con 0x7fe47c003a00 2023-09-30T22:29:59.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.481+0000 7fe482ffd700 1 -- 172.21.15.40:0/2116188772 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48400ce70 con 0x7fe47c003a00 2023-09-30T22:29:59.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.481+0000 7fe482ffd700 1 -- 172.21.15.40:0/2116188772 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe484005a30 con 0x7fe47c003a00 2023-09-30T22:29:59.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.482+0000 7fe482ffd700 1 -- 172.21.15.40:0/2116188772 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe484005b90 con 0x7fe47c003a00 2023-09-30T22:29:59.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.482+0000 7fe49897f700 1 -- 172.21.15.40:0/2116188772 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe494062380 con 0x7fe47c003a00 2023-09-30T22:29:59.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.482+0000 7fe482ffd700 1 -- 172.21.15.40:0/2116188772 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe484040410 con 0x7fe47c003a00 2023-09-30T22:29:59.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.489+0000 7fe482ffd700 1 -- 172.21.15.40:0/2116188772 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe484007cd0 con 0x7fe47c003a00 2023-09-30T22:29:59.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.512+0000 7fcede4a3700 1 Processor -- start 2023-09-30T22:29:59.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.512+0000 7fcede4a3700 1 -- start start 2023-09-30T22:29:59.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.512+0000 7fcede4a3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fced812f070 0x7fced8135c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.512+0000 7fcede4a3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fced8136170 0x7fced8138550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.512+0000 7fcede4a3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced809ab70 con 0x7fced812e590 2023-09-30T22:29:59.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.512+0000 7fcede4a3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced809b270 con 0x7fced8136170 2023-09-30T22:29:59.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.512+0000 7fcede4a3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced812f440 con 0x7fced812f070 2023-09-30T22:29:59.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.512+0000 7fced77fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fced812f070 0x7fced8135c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.512+0000 7fced77fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fced812f070 0x7fced8135c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:45922/0 (socket says 172.21.15.40:45922) 2023-09-30T22:29:59.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.512+0000 7fced77fe700 1 -- 172.21.15.40:0/154561840 learned_addr learned my addr 172.21.15.40:0/154561840 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:59.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.512+0000 7fcedca40700 1 --2- 172.21.15.40:0/154561840 >> v2:172.21.15.40:3300/0 conn(0x7fced8136170 0x7fced8138550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.513+0000 7fced77fe700 1 -- 172.21.15.40:0/154561840 >> v2:172.21.15.40:3300/0 conn(0x7fced8136170 msgr2=0x7fced8138550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:59.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.513+0000 7fced77fe700 1 --2- 172.21.15.40:0/154561840 >> v2:172.21.15.40:3300/0 conn(0x7fced8136170 0x7fced8138550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.513+0000 7fced77fe700 1 -- 172.21.15.40:0/154561840 >> v1:172.21.15.40:6789/0 conn(0x7fced812e590 legacy=0x7fced812e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:59.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.513+0000 7fced77fe700 1 -- 172.21.15.40:0/154561840 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced809bd70 con 0x7fced812f070 2023-09-30T22:29:59.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.513+0000 7fced77fe700 1 --2- 172.21.15.40:0/154561840 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fced812f070 0x7fced8135c30 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fcecc00bb90 tx=0x7fcecc00bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=785d78ab1fc667c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:59.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.513+0000 7fced6ffd700 1 -- 172.21.15.40:0/154561840 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc00dd30 con 0x7fced812f070 2023-09-30T22:29:59.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.513+0000 7fced6ffd700 1 -- 172.21.15.40:0/154561840 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcecc00de90 con 0x7fced812f070 2023-09-30T22:29:59.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.513+0000 7fced6ffd700 1 -- 172.21.15.40:0/154561840 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc010690 con 0x7fced812f070 2023-09-30T22:29:59.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.514+0000 7fcede4a3700 1 -- 172.21.15.40:0/154561840 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fced812f070 msgr2=0x7fced8135c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:59.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.514+0000 7fcede4a3700 1 --2- 172.21.15.40:0/154561840 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fced812f070 0x7fced8135c30 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fcecc00bb90 tx=0x7fcecc00bea0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.514+0000 7fcede4a3700 1 -- 172.21.15.40:0/154561840 shutdown_connections 2023-09-30T22:29:59.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.514+0000 7fcede4a3700 1 --2- 172.21.15.40:0/154561840 >> v2:172.21.15.40:3300/0 conn(0x7fced8136170 0x7fced8138550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.514+0000 7fcede4a3700 1 --2- 172.21.15.40:0/154561840 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fced812f070 0x7fced8135c30 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.514+0000 7fcede4a3700 1 -- 172.21.15.40:0/154561840 >> 172.21.15.40:0/154561840 conn(0x7fced80a2a00 msgr2=0x7fced80a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:59.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.514+0000 7fcede4a3700 1 -- 172.21.15.40:0/154561840 shutdown_connections 2023-09-30T22:29:59.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.514+0000 7fcede4a3700 1 -- 172.21.15.40:0/154561840 wait complete. 2023-09-30T22:29:59.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.515+0000 7fcede4a3700 1 Processor -- start 2023-09-30T22:29:59.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.515+0000 7fcede4a3700 1 -- start start 2023-09-30T22:29:59.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.516+0000 7fcede4a3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fced812e590 0x7fced8133a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.516+0000 7fcede4a3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fced812f070 0x7fced8133fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.516+0000 7fcede4a3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fced8136170 0x7fced81344e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.516+0000 7fcede4a3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced811a340 con 0x7fced8136170 2023-09-30T22:29:59.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.516+0000 7fcede4a3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced812dde0 con 0x7fced812f070 2023-09-30T22:29:59.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.516+0000 7fcede4a3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fced81357f0 con 0x7fced812e590 2023-09-30T22:29:59.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.516+0000 7fced77fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fced812f070 0x7fced8133fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.516+0000 7fced77fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fced812f070 0x7fced8133fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:45932/0 (socket says 172.21.15.40:45932) 2023-09-30T22:29:59.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.516+0000 7fced77fe700 1 -- 172.21.15.40:0/3008724527 learned_addr learned my addr 172.21.15.40:0/3008724527 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:59.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.516+0000 7fced7fff700 1 --2- 172.21.15.40:0/3008724527 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fced812e590 0x7fced8133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.516+0000 7fcedca40700 1 --2- 172.21.15.40:0/3008724527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fced8136170 0x7fced81344e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.516+0000 7fced77fe700 1 -- 172.21.15.40:0/3008724527 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fced812e590 msgr2=0x7fced8133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:59.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.516+0000 7fced77fe700 1 --2- 172.21.15.40:0/3008724527 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fced812e590 0x7fced8133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.516+0000 7fced77fe700 1 -- 172.21.15.40:0/3008724527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fced8136170 msgr2=0x7fced81344e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:59.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.516+0000 7fced77fe700 1 --2- 172.21.15.40:0/3008724527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fced8136170 0x7fced81344e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.516+0000 7fced77fe700 1 -- 172.21.15.40:0/3008724527 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc00b7f0 con 0x7fced812f070 2023-09-30T22:29:59.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.516+0000 7fced77fe700 1 --2- 172.21.15.40:0/3008724527 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fced812f070 0x7fced8133fa0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fced812f580 tx=0x7fcecc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:59.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.517+0000 7fced4ff9700 1 -- 172.21.15.40:0/3008724527 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc01f070 con 0x7fced812f070 2023-09-30T22:29:59.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.517+0000 7fced4ff9700 1 -- 172.21.15.40:0/3008724527 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcecc003970 con 0x7fced812f070 2023-09-30T22:29:59.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.517+0000 7fced4ff9700 1 -- 172.21.15.40:0/3008724527 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc003d20 con 0x7fced812f070 2023-09-30T22:29:59.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.517+0000 7fcede4a3700 1 -- 172.21.15.40:0/3008724527 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced811ab20 con 0x7fced812f070 2023-09-30T22:29:59.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.518+0000 7fcede4a3700 1 -- 172.21.15.40:0/3008724527 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced8135b30 con 0x7fced812f070 2023-09-30T22:29:59.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.519+0000 7fcede4a3700 1 -- 172.21.15.40:0/3008724527 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced8062380 con 0x7fced812f070 2023-09-30T22:29:59.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.519+0000 7fced4ff9700 1 -- 172.21.15.40:0/3008724527 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcecc02d430 con 0x7fced812f070 2023-09-30T22:29:59.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.519+0000 7fced4ff9700 1 -- 172.21.15.40:0/3008724527 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fcecc043180 con 0x7fced812f070 2023-09-30T22:29:59.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.524+0000 7fced4ff9700 1 -- 172.21.15.40:0/3008724527 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcecc003e80 con 0x7fced812f070 2023-09-30T22:29:59.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.555+0000 7f5bfd2d3700 1 Processor -- start 2023-09-30T22:29:59.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.555+0000 7f5bfd2d3700 1 -- start start 2023-09-30T22:29:59.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.555+0000 7f5bfd2d3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bf806a6d0 0x7f5bf809d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.555+0000 7f5bfd2d3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5bf809de60 0x7f5bf809e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.555+0000 7f5bfd2d3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bf813c490 0x7f5bf813e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.556+0000 7f5bfd2d3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf806aaa0 con 0x7f5bf809de60 2023-09-30T22:29:59.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.556+0000 7f5bfd2d3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf809e790 con 0x7f5bf806a6d0 2023-09-30T22:29:59.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.556+0000 7f5bfd2d3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf806b150 con 0x7f5bf813c490 2023-09-30T22:29:59.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.556+0000 7f5bf6ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bf806a6d0 0x7f5bf809d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.556+0000 7f5bf77fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bf813c490 0x7f5bf813e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.556+0000 7f5bf6ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bf806a6d0 0x7f5bf809d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:45934/0 (socket says 172.21.15.40:45934) 2023-09-30T22:29:59.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.556+0000 7f5bf6ffd700 1 -- 172.21.15.40:0/1769368486 learned_addr learned my addr 172.21.15.40:0/1769368486 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:59.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.556+0000 7f5bf67fc700 1 --2- 172.21.15.40:0/1769368486 >> v2:172.21.15.40:3300/0 conn(0x7f5bf809de60 0x7f5bf809e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.556+0000 7f5bf77fe700 1 -- 172.21.15.40:0/1769368486 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bf806a6d0 msgr2=0x7f5bf809d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:59.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.556+0000 7f5bf77fe700 1 --2- 172.21.15.40:0/1769368486 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bf806a6d0 0x7f5bf809d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.556+0000 7f5bf77fe700 1 -- 172.21.15.40:0/1769368486 >> v2:172.21.15.40:3300/0 conn(0x7f5bf809de60 msgr2=0x7f5bf809e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:59.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.556+0000 7f5bf77fe700 1 --2- 172.21.15.40:0/1769368486 >> v2:172.21.15.40:3300/0 conn(0x7f5bf809de60 0x7f5bf809e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.556+0000 7f5bf77fe700 1 -- 172.21.15.40:0/1769368486 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf809f300 con 0x7f5bf813c490 2023-09-30T22:29:59.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.556+0000 7f5bf6ffd700 1 --2- 172.21.15.40:0/1769368486 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bf806a6d0 0x7f5bf809d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:59.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.556+0000 7f5bf77fe700 1 --2- 172.21.15.40:0/1769368486 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bf813c490 0x7f5bf813e870 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0009dc0 tx=0x7f5bf000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97a1da8a27a0729e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:59.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.557+0000 7f5bf5ffb700 1 -- 172.21.15.40:0/1769368486 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf000e070 con 0x7f5bf813c490 2023-09-30T22:29:59.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.557+0000 7f5bf5ffb700 1 -- 172.21.15.40:0/1769368486 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf000ba80 con 0x7f5bf813c490 2023-09-30T22:29:59.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.557+0000 7f5bf5ffb700 1 -- 172.21.15.40:0/1769368486 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf000be30 con 0x7f5bf813c490 2023-09-30T22:29:59.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.557+0000 7f5bfd2d3700 1 -- 172.21.15.40:0/1769368486 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bf813c490 msgr2=0x7f5bf813e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:59.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.557+0000 7f5bfd2d3700 1 --2- 172.21.15.40:0/1769368486 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bf813c490 0x7f5bf813e870 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0009dc0 tx=0x7f5bf000b330 comp rx=0 tx=0).stop 2023-09-30T22:29:59.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.557+0000 7f5bfd2d3700 1 -- 172.21.15.40:0/1769368486 shutdown_connections 2023-09-30T22:29:59.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.557+0000 7f5bfd2d3700 1 --2- 172.21.15.40:0/1769368486 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bf813c490 0x7f5bf813e870 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.557+0000 7f5bfd2d3700 1 --2- 172.21.15.40:0/1769368486 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bf806a6d0 0x7f5bf809d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.557+0000 7f5bfd2d3700 1 --2- 172.21.15.40:0/1769368486 >> v2:172.21.15.40:3300/0 conn(0x7f5bf809de60 0x7f5bf809e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.557+0000 7f5bfd2d3700 1 -- 172.21.15.40:0/1769368486 >> 172.21.15.40:0/1769368486 conn(0x7f5bf809fb20 msgr2=0x7f5bf809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:59.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.557+0000 7f5bfd2d3700 1 -- 172.21.15.40:0/1769368486 shutdown_connections 2023-09-30T22:29:59.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.557+0000 7f5bfd2d3700 1 -- 172.21.15.40:0/1769368486 wait complete. 2023-09-30T22:29:59.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.558+0000 7f5bfd2d3700 1 Processor -- start 2023-09-30T22:29:59.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.559+0000 7f5bfd2d3700 1 -- start start 2023-09-30T22:29:59.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.559+0000 7f5bfd2d3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bf806a6d0 0x7f5bf811db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.559+0000 7f5bfd2d3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bf809de60 0x7f5bf811e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.559+0000 7f5bfd2d3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bf813c490 0x7f5bf811e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.559+0000 7f5bfd2d3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf8120f10 con 0x7f5bf806a6d0 2023-09-30T22:29:59.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.559+0000 7f5bfd2d3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf8120270 con 0x7f5bf809de60 2023-09-30T22:29:59.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.559+0000 7f5bfd2d3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf8071be0 con 0x7f5bf813c490 2023-09-30T22:29:59.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.559+0000 7f5bf77fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bf813c490 0x7f5bf811e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.559+0000 7f5bf77fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bf813c490 0x7f5bf811e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:39726/0 (socket says 172.21.15.40:39726) 2023-09-30T22:29:59.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.559+0000 7f5bf77fe700 1 -- 172.21.15.40:0/1458038698 learned_addr learned my addr 172.21.15.40:0/1458038698 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:59.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.559+0000 7f5bf6ffd700 1 --2- 172.21.15.40:0/1458038698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bf806a6d0 0x7f5bf811db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.559+0000 7f5bf67fc700 1 --2- 172.21.15.40:0/1458038698 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bf809de60 0x7f5bf811e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.560+0000 7f5bf77fe700 1 -- 172.21.15.40:0/1458038698 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bf809de60 msgr2=0x7f5bf811e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:59.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.560+0000 7f5bf77fe700 1 --2- 172.21.15.40:0/1458038698 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bf809de60 0x7f5bf811e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.560+0000 7f5bf77fe700 1 -- 172.21.15.40:0/1458038698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bf806a6d0 msgr2=0x7f5bf811db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:59.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.560+0000 7f5bf77fe700 1 --2- 172.21.15.40:0/1458038698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bf806a6d0 0x7f5bf811db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.560+0000 7f5bf77fe700 1 -- 172.21.15.40:0/1458038698 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf0009a70 con 0x7f5bf813c490 2023-09-30T22:29:59.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.560+0000 7f5bf77fe700 1 --2- 172.21.15.40:0/1458038698 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bf813c490 0x7f5bf811e5b0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0013000 tx=0x7f5bf0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:59.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.560+0000 7f5bdf7fe700 1 -- 172.21.15.40:0/1458038698 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0004550 con 0x7f5bf813c490 2023-09-30T22:29:59.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.560+0000 7f5bdf7fe700 1 -- 172.21.15.40:0/1458038698 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf0020070 con 0x7f5bf813c490 2023-09-30T22:29:59.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.560+0000 7f5bfd2d3700 1 -- 172.21.15.40:0/1458038698 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf809f540 con 0x7f5bf813c490 2023-09-30T22:29:59.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.560+0000 7f5bdf7fe700 1 -- 172.21.15.40:0/1458038698 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0004930 con 0x7f5bf813c490 2023-09-30T22:29:59.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.560+0000 7f5bfd2d3700 1 -- 172.21.15.40:0/1458038698 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf809c1e0 con 0x7f5bf813c490 2023-09-30T22:29:59.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.561+0000 7f5bfd2d3700 1 -- 172.21.15.40:0/1458038698 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf8062380 con 0x7f5bf813c490 2023-09-30T22:29:59.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.562+0000 7f5bdf7fe700 1 -- 172.21.15.40:0/1458038698 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5bf0031470 con 0x7f5bf813c490 2023-09-30T22:29:59.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.562+0000 7f5bdf7fe700 1 -- 172.21.15.40:0/1458038698 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5bf0022070 con 0x7f5bf813c490 2023-09-30T22:29:59.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.571+0000 7f5bdf7fe700 1 -- 172.21.15.40:0/1458038698 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5bf002f750 con 0x7f5bf813c490 2023-09-30T22:29:59.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.596+0000 7f5c7ba3d700 1 Processor -- start 2023-09-30T22:29:59.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.596+0000 7f5c7ba3d700 1 -- start start 2023-09-30T22:29:59.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.597+0000 7f5c7ba3d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5c740a1e30 0x7f5c7409d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.597+0000 7f5c7ba3d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c7409de60 0x7f5c7409e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.597+0000 7f5c7ba3d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c7413c5d0 0x7f5c7413e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.597+0000 7f5c7ba3d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c740a2200 con 0x7f5c740a1e30 2023-09-30T22:29:59.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.597+0000 7f5c7ba3d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7406b790 con 0x7f5c7409de60 2023-09-30T22:29:59.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.597+0000 7f5c7ba3d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7409f960 con 0x7f5c7413c5d0 2023-09-30T22:29:59.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.597+0000 7f5c78fd8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c7409de60 0x7f5c7409e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.597+0000 7f5c79fda700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c7413c5d0 0x7f5c7413e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.597+0000 7f5c78fd8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c7409de60 0x7f5c7409e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:45948/0 (socket says 172.21.15.40:45948) 2023-09-30T22:29:59.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.597+0000 7f5c797d9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5c740a1e30 0x7f5c7409d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.597+0000 7f5c78fd8700 1 -- 172.21.15.40:0/2275638363 learned_addr learned my addr 172.21.15.40:0/2275638363 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:59.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.597+0000 7f5c797d9700 1 -- 172.21.15.40:0/2275638363 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c7413c5d0 msgr2=0x7f5c7413e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:59.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.597+0000 7f5c797d9700 1 --2- 172.21.15.40:0/2275638363 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c7413c5d0 0x7f5c7413e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.597+0000 7f5c797d9700 1 -- 172.21.15.40:0/2275638363 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c7409de60 msgr2=0x7f5c7409e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:59.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.597+0000 7f5c797d9700 1 --2- 172.21.15.40:0/2275638363 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c7409de60 0x7f5c7409e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.597+0000 7f5c797d9700 1 -- 172.21.15.40:0/2275638363 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c740a2760 con 0x7f5c740a1e30 2023-09-30T22:29:59.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.597+0000 7f5c78fd8700 1 --2- 172.21.15.40:0/2275638363 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c7409de60 0x7f5c7409e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:59.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.597+0000 7f5c79fda700 1 --2- 172.21.15.40:0/2275638363 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c7413c5d0 0x7f5c7413e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:59.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.598+0000 7f5c797d9700 1 --2- 172.21.15.40:0/2275638363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c740a1e30 0x7f5c7409d920 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f5c70009840 tx=0x7f5c70009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66d2ed37285d689d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:59.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.598+0000 7f5c6bfff700 1 -- 172.21.15.40:0/2275638363 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c70011830 con 0x7f5c740a1e30 2023-09-30T22:29:59.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.598+0000 7f5c6bfff700 1 -- 172.21.15.40:0/2275638363 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c70011990 con 0x7f5c740a1e30 2023-09-30T22:29:59.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.598+0000 7f5c6bfff700 1 -- 172.21.15.40:0/2275638363 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c70011d20 con 0x7f5c740a1e30 2023-09-30T22:29:59.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.599+0000 7f5c7ba3d700 1 -- 172.21.15.40:0/2275638363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c740a1e30 msgr2=0x7f5c7409d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:59.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.599+0000 7f5c7ba3d700 1 --2- 172.21.15.40:0/2275638363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c740a1e30 0x7f5c7409d920 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f5c70009840 tx=0x7f5c70009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:59.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.599+0000 7f5c7ba3d700 1 -- 172.21.15.40:0/2275638363 shutdown_connections 2023-09-30T22:29:59.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.599+0000 7f5c7ba3d700 1 --2- 172.21.15.40:0/2275638363 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c7413c5d0 0x7f5c7413e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.599+0000 7f5c7ba3d700 1 --2- 172.21.15.40:0/2275638363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c740a1e30 0x7f5c7409d920 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.599+0000 7f5c7ba3d700 1 --2- 172.21.15.40:0/2275638363 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c7409de60 0x7f5c7409e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.599+0000 7f5c7ba3d700 1 -- 172.21.15.40:0/2275638363 >> 172.21.15.40:0/2275638363 conn(0x7f5c740a2f20 msgr2=0x7f5c740a3320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:59.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.599+0000 7f5c7ba3d700 1 -- 172.21.15.40:0/2275638363 shutdown_connections 2023-09-30T22:29:59.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.599+0000 7f5c7ba3d700 1 -- 172.21.15.40:0/2275638363 wait complete. 2023-09-30T22:29:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.600+0000 7f5c7ba3d700 1 Processor -- start 2023-09-30T22:29:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.600+0000 7f5c7ba3d700 1 -- start start 2023-09-30T22:29:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.601+0000 7f5c7ba3d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c7409de60 0x7f5c7413bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.601+0000 7f5c7ba3d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c740a1e30 0x7f5c740705d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.601+0000 7f5c7ba3d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c7413c5d0 0x7f5c74070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.601+0000 7f5c7ba3d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7412d160 con 0x7f5c740a1e30 2023-09-30T22:29:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.601+0000 7f5c7ba3d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7412d340 con 0x7f5c7409de60 2023-09-30T22:29:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.601+0000 7f5c7ba3d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7412b7f0 con 0x7f5c7413c5d0 2023-09-30T22:29:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.601+0000 7f5c797d9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c7409de60 0x7f5c7413bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.601+0000 7f5c797d9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c7409de60 0x7f5c7413bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:45962/0 (socket says 172.21.15.40:45962) 2023-09-30T22:29:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.601+0000 7f5c797d9700 1 -- 172.21.15.40:0/4070594926 learned_addr learned my addr 172.21.15.40:0/4070594926 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:29:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.601+0000 7f5c78fd8700 1 --2- 172.21.15.40:0/4070594926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c740a1e30 0x7f5c740705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.601+0000 7f5c79fda700 1 --2- 172.21.15.40:0/4070594926 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c7413c5d0 0x7f5c74070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.601+0000 7f5c78fd8700 1 -- 172.21.15.40:0/4070594926 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c7413c5d0 msgr2=0x7f5c74070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.601+0000 7f5c78fd8700 1 --2- 172.21.15.40:0/4070594926 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c7413c5d0 0x7f5c74070b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.601+0000 7f5c78fd8700 1 -- 172.21.15.40:0/4070594926 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c7409de60 msgr2=0x7f5c7413bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:59.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.601+0000 7f5c78fd8700 1 --2- 172.21.15.40:0/4070594926 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c7409de60 0x7f5c7413bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.601+0000 7f5c78fd8700 1 -- 172.21.15.40:0/4070594926 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c64009550 con 0x7f5c740a1e30 2023-09-30T22:29:59.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.601+0000 7f5c797d9700 1 --2- 172.21.15.40:0/4070594926 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c7409de60 0x7f5c7413bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:59.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.602+0000 7f5c78fd8700 1 --2- 172.21.15.40:0/4070594926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c740a1e30 0x7f5c740705d0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f5c6400e9b0 tx=0x7f5c6400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:59.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.602+0000 7f5c69ffb700 1 -- 172.21.15.40:0/4070594926 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6400eea0 con 0x7f5c740a1e30 2023-09-30T22:29:59.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.602+0000 7f5c69ffb700 1 -- 172.21.15.40:0/4070594926 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c6400c850 con 0x7f5c740a1e30 2023-09-30T22:29:59.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.602+0000 7f5c7ba3d700 1 -- 172.21.15.40:0/4070594926 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c700094a0 con 0x7f5c740a1e30 2023-09-30T22:29:59.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.602+0000 7f5c69ffb700 1 -- 172.21.15.40:0/4070594926 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6400cbe0 con 0x7f5c740a1e30 2023-09-30T22:29:59.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.602+0000 7f5c7ba3d700 1 -- 172.21.15.40:0/4070594926 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c7412b9e0 con 0x7f5c740a1e30 2023-09-30T22:29:59.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.603+0000 7f5c69ffb700 1 -- 172.21.15.40:0/4070594926 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5c6400cd40 con 0x7f5c740a1e30 2023-09-30T22:29:59.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.603+0000 7f5c69ffb700 1 -- 172.21.15.40:0/4070594926 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5c6403f870 con 0x7f5c740a1e30 2023-09-30T22:29:59.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.603+0000 7f5c7ba3d700 1 -- 172.21.15.40:0/4070594926 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c7404f2a0 con 0x7f5c740a1e30 2023-09-30T22:29:59.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.608+0000 7f5c69ffb700 1 -- 172.21.15.40:0/4070594926 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5c64017080 con 0x7f5c740a1e30 2023-09-30T22:29:59.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.697+0000 7fe49897f700 1 -- 172.21.15.40:0/2116188772 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe49409cdf0 con 0x7fe47c003a00 2023-09-30T22:29:59.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.697+0000 7fe482ffd700 1 -- 172.21.15.40:0/2116188772 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe484017030 con 0x7fe47c003a00 2023-09-30T22:29:59.699 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:59.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.699+0000 7fe49897f700 1 -- 172.21.15.40:0/2116188772 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe47c003a00 msgr2=0x7fe49411b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:59.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.699+0000 7fe49897f700 1 --2- 172.21.15.40:0/2116188772 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe47c003a00 0x7fe49411b690 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe47c0053a0 tx=0x7fe49409df70 comp rx=0 tx=0).stop 2023-09-30T22:29:59.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.699+0000 7fe49897f700 1 -- 172.21.15.40:0/2116188772 shutdown_connections 2023-09-30T22:29:59.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.699+0000 7fe49897f700 1 --2- 172.21.15.40:0/2116188772 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe47c003a00 0x7fe49411b690 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.699+0000 7fe49897f700 1 --2- 172.21.15.40:0/2116188772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe49406b1b0 0x7fe49411c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.699+0000 7fe49897f700 1 --2- 172.21.15.40:0/2116188772 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe49406a6d0 0x7fe49411bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.699+0000 7fe49897f700 1 -- 172.21.15.40:0/2116188772 >> 172.21.15.40:0/2116188772 conn(0x7fe49409fb20 msgr2=0x7fe4940a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:59.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.699+0000 7fe49897f700 1 -- 172.21.15.40:0/2116188772 shutdown_connections 2023-09-30T22:29:59.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.699+0000 7fe49897f700 1 -- 172.21.15.40:0/2116188772 wait complete. 2023-09-30T22:29:59.713 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:29:59.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.726+0000 7fcede4a3700 1 -- 172.21.15.40:0/3008724527 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fced811a900 con 0x7fced812f070 2023-09-30T22:29:59.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.726+0000 7fced4ff9700 1 -- 172.21.15.40:0/3008724527 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcecc0233c0 con 0x7fced812f070 2023-09-30T22:29:59.727 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:29:59.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.728+0000 7fcede4a3700 1 -- 172.21.15.40:0/3008724527 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fced812f070 msgr2=0x7fced8133fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:59.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.728+0000 7fcede4a3700 1 --2- 172.21.15.40:0/3008724527 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fced812f070 0x7fced8133fa0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fced812f580 tx=0x7fcecc004750 comp rx=0 tx=0).stop 2023-09-30T22:29:59.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.728+0000 7fcede4a3700 1 -- 172.21.15.40:0/3008724527 shutdown_connections 2023-09-30T22:29:59.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.728+0000 7fcede4a3700 1 --2- 172.21.15.40:0/3008724527 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fced812e590 0x7fced8133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.728+0000 7fcede4a3700 1 --2- 172.21.15.40:0/3008724527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fced8136170 0x7fced81344e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.728+0000 7fcede4a3700 1 --2- 172.21.15.40:0/3008724527 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fced812f070 0x7fced8133fa0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.728+0000 7fcede4a3700 1 -- 172.21.15.40:0/3008724527 >> 172.21.15.40:0/3008724527 conn(0x7fced80a2a00 msgr2=0x7fced809d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:59.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.729+0000 7fcede4a3700 1 -- 172.21.15.40:0/3008724527 shutdown_connections 2023-09-30T22:29:59.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.729+0000 7fcede4a3700 1 -- 172.21.15.40:0/3008724527 wait complete. 2023-09-30T22:29:59.741 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:29:59.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.772+0000 7f5bfd2d3700 1 -- 172.21.15.40:0/1458038698 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5bf8120610 con 0x7f5bf813c490 2023-09-30T22:29:59.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.772+0000 7f5bdf7fe700 1 -- 172.21.15.40:0/1458038698 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5bf0036090 con 0x7f5bf813c490 2023-09-30T22:29:59.773 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:29:59.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.774+0000 7f5bfd2d3700 1 -- 172.21.15.40:0/1458038698 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bf813c490 msgr2=0x7f5bf811e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:59.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.774+0000 7f5bfd2d3700 1 --2- 172.21.15.40:0/1458038698 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bf813c490 0x7f5bf811e5b0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0013000 tx=0x7f5bf0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.775+0000 7f5bfd2d3700 1 -- 172.21.15.40:0/1458038698 shutdown_connections 2023-09-30T22:29:59.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.775+0000 7f5bfd2d3700 1 --2- 172.21.15.40:0/1458038698 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bf813c490 0x7f5bf811e5b0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.775+0000 7f5bfd2d3700 1 --2- 172.21.15.40:0/1458038698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bf806a6d0 0x7f5bf811db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.775+0000 7f5bfd2d3700 1 --2- 172.21.15.40:0/1458038698 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bf809de60 0x7f5bf811e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.775+0000 7f5bfd2d3700 1 -- 172.21.15.40:0/1458038698 >> 172.21.15.40:0/1458038698 conn(0x7f5bf809fb20 msgr2=0x7f5bf80a22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:59.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.775+0000 7f5bfd2d3700 1 -- 172.21.15.40:0/1458038698 shutdown_connections 2023-09-30T22:29:59.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.775+0000 7f5bfd2d3700 1 -- 172.21.15.40:0/1458038698 wait complete. 2023-09-30T22:29:59.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:29:59.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.808+0000 7f5c7ba3d700 1 -- 172.21.15.40:0/4070594926 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5c74062380 con 0x7f5c740a1e30 2023-09-30T22:29:59.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.808+0000 7f5c69ffb700 1 -- 172.21.15.40:0/4070594926 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5c64021020 con 0x7f5c740a1e30 2023-09-30T22:29:59.809 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:29:59.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.810+0000 7f5c7ba3d700 1 -- 172.21.15.40:0/4070594926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c740a1e30 msgr2=0x7f5c740705d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:59.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.810+0000 7f5c7ba3d700 1 --2- 172.21.15.40:0/4070594926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c740a1e30 0x7f5c740705d0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f5c6400e9b0 tx=0x7f5c6400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.810+0000 7f5c7ba3d700 1 -- 172.21.15.40:0/4070594926 shutdown_connections 2023-09-30T22:29:59.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.810+0000 7f5c7ba3d700 1 --2- 172.21.15.40:0/4070594926 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c7413c5d0 0x7f5c74070b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.810+0000 7f5c7ba3d700 1 --2- 172.21.15.40:0/4070594926 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c7409de60 0x7f5c7413bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.810+0000 7f5c7ba3d700 1 --2- 172.21.15.40:0/4070594926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c740a1e30 0x7f5c740705d0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:59.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.810+0000 7f5c7ba3d700 1 -- 172.21.15.40:0/4070594926 >> 172.21.15.40:0/4070594926 conn(0x7f5c740a2f20 msgr2=0x7f5c7413ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:59.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.810+0000 7f5c7ba3d700 1 -- 172.21.15.40:0/4070594926 shutdown_connections 2023-09-30T22:29:59.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:29:59.811+0000 7f5c7ba3d700 1 -- 172.21.15.40:0/4070594926 wait complete. 2023-09-30T22:29:59.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:00.714 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:00.742 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:00.788 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:00.824 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:00.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.870+0000 7f5e1b3db700 1 Processor -- start 2023-09-30T22:30:00.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.870+0000 7f5e1b3db700 1 -- start start 2023-09-30T22:30:00.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.871+0000 7f5e1b3db700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e1406a6d0 0x7f5e1406aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:00.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.871+0000 7f5e1b3db700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5e1406afe0 0x7f5e141318b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:00.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.871+0000 7f5e1b3db700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e1409eb60 con 0x7f5e14131df0 2023-09-30T22:30:00.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.871+0000 7f5e1b3db700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e1409db70 con 0x7f5e1406afe0 2023-09-30T22:30:00.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.871+0000 7f5e1b3db700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1409ddf0 con 0x7f5e1406a6d0 2023-09-30T22:30:00.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.871+0000 7f5e18976700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5e1406afe0 0x7f5e141318b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:00.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.871+0000 7f5e18976700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5e1406afe0 0x7f5e141318b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36832/0 (socket says 172.21.15.40:36832) 2023-09-30T22:30:00.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.871+0000 7f5e18976700 1 -- 172.21.15.40:0/3561240895 learned_addr learned my addr 172.21.15.40:0/3561240895 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:00.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.871+0000 7f5e19177700 1 --2- 172.21.15.40:0/3561240895 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e1406a6d0 0x7f5e1406aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:00.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.872+0000 7f5e19177700 1 -- 172.21.15.40:0/3561240895 >> v2:172.21.15.40:3300/0 conn(0x7f5e1406afe0 msgr2=0x7f5e141318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:00.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.872+0000 7f5e19177700 1 --2- 172.21.15.40:0/3561240895 >> v2:172.21.15.40:3300/0 conn(0x7f5e1406afe0 0x7f5e141318b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:00.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.872+0000 7f5e19177700 1 -- 172.21.15.40:0/3561240895 >> v1:172.21.15.40:6789/0 conn(0x7f5e14131df0 legacy=0x7f5e14138b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:00.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.872+0000 7f5e19177700 1 -- 172.21.15.40:0/3561240895 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e1409c9a0 con 0x7f5e1406a6d0 2023-09-30T22:30:00.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.872+0000 7f5e19177700 1 --2- 172.21.15.40:0/3561240895 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e1406a6d0 0x7f5e1406aaa0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f5e1000dc40 tx=0x7f5e1000df50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5cc765c2daf5a81 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:00.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.872+0000 7f5e0bfff700 1 -- 172.21.15.40:0/3561240895 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e10012070 con 0x7f5e1406a6d0 2023-09-30T22:30:00.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.872+0000 7f5e0bfff700 1 -- 172.21.15.40:0/3561240895 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e10005a20 con 0x7f5e1406a6d0 2023-09-30T22:30:00.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.872+0000 7f5e0bfff700 1 -- 172.21.15.40:0/3561240895 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e10005db0 con 0x7f5e1406a6d0 2023-09-30T22:30:00.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.873+0000 7f5e1b3db700 1 -- 172.21.15.40:0/3561240895 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e1406a6d0 msgr2=0x7f5e1406aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:00.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.873+0000 7f5e1b3db700 1 --2- 172.21.15.40:0/3561240895 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e1406a6d0 0x7f5e1406aaa0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f5e1000dc40 tx=0x7f5e1000df50 comp rx=0 tx=0).stop 2023-09-30T22:30:00.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.873+0000 7f5e1b3db700 1 -- 172.21.15.40:0/3561240895 shutdown_connections 2023-09-30T22:30:00.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.873+0000 7f5e1b3db700 1 --2- 172.21.15.40:0/3561240895 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e1406a6d0 0x7f5e1406aaa0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:00.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.873+0000 7f5e1b3db700 1 --2- 172.21.15.40:0/3561240895 >> v2:172.21.15.40:3300/0 conn(0x7f5e1406afe0 0x7f5e141318b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:00.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.873+0000 7f5e1b3db700 1 -- 172.21.15.40:0/3561240895 >> 172.21.15.40:0/3561240895 conn(0x7f5e1409fb20 msgr2=0x7f5e1409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:00.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.873+0000 7f5e1b3db700 1 -- 172.21.15.40:0/3561240895 shutdown_connections 2023-09-30T22:30:00.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.873+0000 7f5e1b3db700 1 -- 172.21.15.40:0/3561240895 wait complete. 2023-09-30T22:30:00.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.874+0000 7f5e1b3db700 1 Processor -- start 2023-09-30T22:30:00.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.874+0000 7f5e1b3db700 1 -- start start 2023-09-30T22:30:00.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.875+0000 7f5e1b3db700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e1406a6d0 0x7f5e141c4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:00.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.875+0000 7f5e1b3db700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e1406afe0 0x7f5e141c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:00.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.875+0000 7f5e1b3db700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e14131df0 0x7f5e1411b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:00.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.875+0000 7f5e1b3db700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1411dd50 con 0x7f5e1406afe0 2023-09-30T22:30:00.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.875+0000 7f5e1b3db700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e14130630 con 0x7f5e14131df0 2023-09-30T22:30:00.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.875+0000 7f5e1b3db700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e14130280 con 0x7f5e1406a6d0 2023-09-30T22:30:00.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.875+0000 7f5e18976700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e1406afe0 0x7f5e141c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:00.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.875+0000 7f5e18976700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e1406afe0 0x7f5e141c4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36834/0 (socket says 172.21.15.40:36834) 2023-09-30T22:30:00.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.875+0000 7f5e18976700 1 -- 172.21.15.40:0/1842932267 learned_addr learned my addr 172.21.15.40:0/1842932267 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:00.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.875+0000 7f5e18976700 1 -- 172.21.15.40:0/1842932267 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e1406a6d0 msgr2=0x7f5e141c4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:00.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.875+0000 7f5e18976700 1 --2- 172.21.15.40:0/1842932267 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e1406a6d0 0x7f5e141c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:00.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.875+0000 7f5e18976700 1 -- 172.21.15.40:0/1842932267 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e14131df0 msgr2=0x7f5e1411b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:00.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.875+0000 7f5e19978700 1 --2- 172.21.15.40:0/1842932267 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e14131df0 0x7f5e1411b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:00.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.875+0000 7f5e18976700 1 --2- 172.21.15.40:0/1842932267 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e14131df0 0x7f5e1411b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:00.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.875+0000 7f5e18976700 1 -- 172.21.15.40:0/1842932267 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e1000d8d0 con 0x7f5e1406afe0 2023-09-30T22:30:00.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.876+0000 7f5e19978700 1 --2- 172.21.15.40:0/1842932267 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e14131df0 0x7f5e1411b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:30:00.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.876+0000 7f5e18976700 1 --2- 172.21.15.40:0/1842932267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e1406afe0 0x7f5e141c4b90 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f5e0400e910 tx=0x7f5e0400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:00.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.876+0000 7f5e09ffb700 1 -- 172.21.15.40:0/1842932267 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0400c7f0 con 0x7f5e1406afe0 2023-09-30T22:30:00.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.876+0000 7f5e09ffb700 1 -- 172.21.15.40:0/1842932267 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e0400c950 con 0x7f5e1406afe0 2023-09-30T22:30:00.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.876+0000 7f5e1b3db700 1 -- 172.21.15.40:0/1842932267 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e1409e420 con 0x7f5e1406afe0 2023-09-30T22:30:00.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.876+0000 7f5e09ffb700 1 -- 172.21.15.40:0/1842932267 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0400ccc0 con 0x7f5e1406afe0 2023-09-30T22:30:00.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.876+0000 7f5e1b3db700 1 -- 172.21.15.40:0/1842932267 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e140715d0 con 0x7f5e1406afe0 2023-09-30T22:30:00.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.878+0000 7f5e09ffb700 1 -- 172.21.15.40:0/1842932267 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5e04013470 con 0x7f5e1406afe0 2023-09-30T22:30:00.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.878+0000 7f5e09ffb700 1 -- 172.21.15.40:0/1842932267 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5e0403f910 con 0x7f5e1406afe0 2023-09-30T22:30:00.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.878+0000 7f5e1b3db700 1 -- 172.21.15.40:0/1842932267 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e14062380 con 0x7f5e1406afe0 2023-09-30T22:30:00.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.884+0000 7f5e09ffb700 1 -- 172.21.15.40:0/1842932267 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5e04013720 con 0x7f5e1406afe0 2023-09-30T22:30:00.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.906+0000 7f1389f38700 1 Processor -- start 2023-09-30T22:30:00.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.906+0000 7f1389f38700 1 -- start start 2023-09-30T22:30:00.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.906+0000 7f1389f38700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f138409d920 0x7f138409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:00.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.906+0000 7f1389f38700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f138409f0f0 0x7f138409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:00.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.906+0000 7f1389f38700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1384133ca0 0x7f1384134110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:00.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.906+0000 7f1389f38700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138406b4c0 con 0x7f138409d920 2023-09-30T22:30:00.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.906+0000 7f1389f38700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138409a8f0 con 0x7f138409f0f0 2023-09-30T22:30:00.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.906+0000 7f1389f38700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f138409f940 con 0x7f1384133ca0 2023-09-30T22:30:00.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.906+0000 7f13837fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f138409d920 0x7f138409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:00.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.906+0000 7f13837fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f138409d920 0x7f138409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36850/0 (socket says 172.21.15.40:36850) 2023-09-30T22:30:00.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.907+0000 7f13837fe700 1 -- 172.21.15.40:0/3206668362 learned_addr learned my addr 172.21.15.40:0/3206668362 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:00.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.907+0000 7f1382ffd700 1 --2- 172.21.15.40:0/3206668362 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f138409f0f0 0x7f138409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:00.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.907+0000 7f1383fff700 1 --2- 172.21.15.40:0/3206668362 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1384133ca0 0x7f1384134110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:00.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.907+0000 7f13837fe700 1 -- 172.21.15.40:0/3206668362 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1384133ca0 msgr2=0x7f1384134110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:00.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.907+0000 7f13837fe700 1 --2- 172.21.15.40:0/3206668362 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1384133ca0 0x7f1384134110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:00.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.907+0000 7f13837fe700 1 -- 172.21.15.40:0/3206668362 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f138409f0f0 msgr2=0x7f138409e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:00.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.907+0000 7f13837fe700 1 --2- 172.21.15.40:0/3206668362 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f138409f0f0 0x7f138409e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:00.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.907+0000 7f13837fe700 1 -- 172.21.15.40:0/3206668362 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f138409f6e0 con 0x7f138409d920 2023-09-30T22:30:00.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.907+0000 7f1382ffd700 1 --2- 172.21.15.40:0/3206668362 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f138409f0f0 0x7f138409e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:00.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.907+0000 7f1383fff700 1 --2- 172.21.15.40:0/3206668362 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1384133ca0 0x7f1384134110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:30:00.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.907+0000 7f13837fe700 1 --2- 172.21.15.40:0/3206668362 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f138409d920 0x7f138409dcf0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f13740098f0 tx=0x7f1374009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49be29159fff32f4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:00.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.907+0000 7f13827fc700 1 -- 172.21.15.40:0/3206668362 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1374005e30 con 0x7f138409d920 2023-09-30T22:30:00.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.907+0000 7f13827fc700 1 -- 172.21.15.40:0/3206668362 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1374004030 con 0x7f138409d920 2023-09-30T22:30:00.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.907+0000 7f13827fc700 1 -- 172.21.15.40:0/3206668362 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13740043e0 con 0x7f138409d920 2023-09-30T22:30:00.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.908+0000 7f1389f38700 1 -- 172.21.15.40:0/3206668362 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f138409d920 msgr2=0x7f138409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:00.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.908+0000 7f1389f38700 1 --2- 172.21.15.40:0/3206668362 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f138409d920 0x7f138409dcf0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f13740098f0 tx=0x7f1374009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:00.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.908+0000 7f1389f38700 1 -- 172.21.15.40:0/3206668362 shutdown_connections 2023-09-30T22:30:00.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.908+0000 7f1389f38700 1 --2- 172.21.15.40:0/3206668362 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1384133ca0 0x7f1384134110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:00.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.908+0000 7f1389f38700 1 --2- 172.21.15.40:0/3206668362 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f138409d920 0x7f138409dcf0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:00.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.908+0000 7f1389f38700 1 --2- 172.21.15.40:0/3206668362 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f138409f0f0 0x7f138409e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:00.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.908+0000 7f1389f38700 1 -- 172.21.15.40:0/3206668362 >> 172.21.15.40:0/3206668362 conn(0x7f138409fb20 msgr2=0x7f138409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:00.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.908+0000 7f1389f38700 1 -- 172.21.15.40:0/3206668362 shutdown_connections 2023-09-30T22:30:00.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.908+0000 7f1389f38700 1 -- 172.21.15.40:0/3206668362 wait complete. 2023-09-30T22:30:00.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.909+0000 7f1389f38700 1 Processor -- start 2023-09-30T22:30:00.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.909+0000 7f1389f38700 1 -- start start 2023-09-30T22:30:00.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.910+0000 7f1389f38700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f138409d920 0x7f138411db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:00.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.910+0000 7f1389f38700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1384133ca0 0x7f138411e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:00.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.910+0000 7f1389f38700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f138411e5c0 0x7f13841ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:00.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.910+0000 7f1389f38700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138411f230 con 0x7f138411e5c0 2023-09-30T22:30:00.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.910+0000 7f1389f38700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138411ea10 con 0x7f1384133ca0 2023-09-30T22:30:00.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.910+0000 7f1389f38700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f138411f040 con 0x7f138409d920 2023-09-30T22:30:00.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.910+0000 7f1382ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1384133ca0 0x7f138411e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:00.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.910+0000 7f1382ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1384133ca0 0x7f138411e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:45986/0 (socket says 172.21.15.40:45986) 2023-09-30T22:30:00.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.910+0000 7f1382ffd700 1 -- 172.21.15.40:0/3381886203 learned_addr learned my addr 172.21.15.40:0/3381886203 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:00.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.910+0000 7f13837fe700 1 --2- 172.21.15.40:0/3381886203 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f138409d920 0x7f138411db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:00.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.910+0000 7f1383fff700 1 --2- 172.21.15.40:0/3381886203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f138411e5c0 0x7f13841ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:00.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.910+0000 7f1382ffd700 1 -- 172.21.15.40:0/3381886203 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f138409d920 msgr2=0x7f138411db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:00.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.910+0000 7f1382ffd700 1 --2- 172.21.15.40:0/3381886203 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f138409d920 0x7f138411db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:00.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.910+0000 7f1382ffd700 1 -- 172.21.15.40:0/3381886203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f138411e5c0 msgr2=0x7f13841ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:00.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.910+0000 7f1382ffd700 1 --2- 172.21.15.40:0/3381886203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f138411e5c0 0x7f13841ceb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:00.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.911+0000 7f1382ffd700 1 -- 172.21.15.40:0/3381886203 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13780094a0 con 0x7f1384133ca0 2023-09-30T22:30:00.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.911+0000 7f1382ffd700 1 --2- 172.21.15.40:0/3381886203 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1384133ca0 0x7f138411e080 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f1378009f20 tx=0x7f137800ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:00.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.911+0000 7f136bfff700 1 -- 172.21.15.40:0/3381886203 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1378017d20 con 0x7f1384133ca0 2023-09-30T22:30:00.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.911+0000 7f136bfff700 1 -- 172.21.15.40:0/3381886203 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1378017e80 con 0x7f1384133ca0 2023-09-30T22:30:00.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.911+0000 7f136bfff700 1 -- 172.21.15.40:0/3381886203 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137800c860 con 0x7f1384133ca0 2023-09-30T22:30:00.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.911+0000 7f1389f38700 1 -- 172.21.15.40:0/3381886203 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1374009500 con 0x7f1384133ca0 2023-09-30T22:30:00.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.911+0000 7f1389f38700 1 -- 172.21.15.40:0/3381886203 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13840a28d0 con 0x7f1384133ca0 2023-09-30T22:30:00.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.912+0000 7f136bfff700 1 -- 172.21.15.40:0/3381886203 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f137800c9c0 con 0x7f1384133ca0 2023-09-30T22:30:00.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.912+0000 7f136bfff700 1 -- 172.21.15.40:0/3381886203 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f1378047ae0 con 0x7f1384133ca0 2023-09-30T22:30:00.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.913+0000 7f1389f38700 1 -- 172.21.15.40:0/3381886203 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f138409ca40 con 0x7f1384133ca0 2023-09-30T22:30:00.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.921+0000 7f136bfff700 1 -- 172.21.15.40:0/3381886203 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f137800cc70 con 0x7f1384133ca0 2023-09-30T22:30:00.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.951+0000 7ff265afe700 1 Processor -- start 2023-09-30T22:30:00.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.951+0000 7ff265afe700 1 -- start start 2023-09-30T22:30:00.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.952+0000 7ff265afe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff26006a6d0 0x7ff26006aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:00.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.952+0000 7ff265afe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff26006afe0 0x7ff2601318b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:00.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.952+0000 7ff265afe700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff26009eb60 con 0x7ff260131df0 2023-09-30T22:30:00.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.952+0000 7ff265afe700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff26009db70 con 0x7ff26006afe0 2023-09-30T22:30:00.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.952+0000 7ff265afe700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff26009ddf0 con 0x7ff26006a6d0 2023-09-30T22:30:00.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.952+0000 7ff25effd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff26006afe0 0x7ff2601318b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:00.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.952+0000 7ff25f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff26006a6d0 0x7ff26006aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:00.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.952+0000 7ff25effd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff26006afe0 0x7ff2601318b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36862/0 (socket says 172.21.15.40:36862) 2023-09-30T22:30:00.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.952+0000 7ff25f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff26006a6d0 0x7ff26006aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:46002/0 (socket says 172.21.15.40:46002) 2023-09-30T22:30:00.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.952+0000 7ff25effd700 1 -- 172.21.15.40:0/3974071783 learned_addr learned my addr 172.21.15.40:0/3974071783 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:00.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.952+0000 7ff25f7fe700 1 -- 172.21.15.40:0/3974071783 >> v2:172.21.15.40:3300/0 conn(0x7ff26006afe0 msgr2=0x7ff2601318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:00.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.952+0000 7ff25f7fe700 1 --2- 172.21.15.40:0/3974071783 >> v2:172.21.15.40:3300/0 conn(0x7ff26006afe0 0x7ff2601318b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:00.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.952+0000 7ff25f7fe700 1 -- 172.21.15.40:0/3974071783 >> v1:172.21.15.40:6789/0 conn(0x7ff260131df0 legacy=0x7ff260138b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:00.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.952+0000 7ff25f7fe700 1 -- 172.21.15.40:0/3974071783 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26009c9a0 con 0x7ff26006a6d0 2023-09-30T22:30:00.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.953+0000 7ff25f7fe700 1 --2- 172.21.15.40:0/3974071783 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff26006a6d0 0x7ff26006aaa0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff250009820 tx=0x7ff250009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1165bc2016ad14bf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:00.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.953+0000 7ff25e7fc700 1 -- 172.21.15.40:0/3974071783 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff250005e30 con 0x7ff26006a6d0 2023-09-30T22:30:00.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.953+0000 7ff25e7fc700 1 -- 172.21.15.40:0/3974071783 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff250006030 con 0x7ff26006a6d0 2023-09-30T22:30:00.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.953+0000 7ff25e7fc700 1 -- 172.21.15.40:0/3974071783 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2500063c0 con 0x7ff26006a6d0 2023-09-30T22:30:00.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.954+0000 7ff265afe700 1 -- 172.21.15.40:0/3974071783 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff26006a6d0 msgr2=0x7ff26006aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:00.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.954+0000 7ff265afe700 1 --2- 172.21.15.40:0/3974071783 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff26006a6d0 0x7ff26006aaa0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff250009820 tx=0x7ff250009b30 comp rx=0 tx=0).stop 2023-09-30T22:30:00.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.954+0000 7ff265afe700 1 -- 172.21.15.40:0/3974071783 shutdown_connections 2023-09-30T22:30:00.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.954+0000 7ff265afe700 1 --2- 172.21.15.40:0/3974071783 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff26006a6d0 0x7ff26006aaa0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:00.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.954+0000 7ff265afe700 1 --2- 172.21.15.40:0/3974071783 >> v2:172.21.15.40:3300/0 conn(0x7ff26006afe0 0x7ff2601318b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:00.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.954+0000 7ff265afe700 1 -- 172.21.15.40:0/3974071783 >> 172.21.15.40:0/3974071783 conn(0x7ff26009fb20 msgr2=0x7ff26009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:00.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.954+0000 7ff265afe700 1 -- 172.21.15.40:0/3974071783 shutdown_connections 2023-09-30T22:30:00.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.954+0000 7ff265afe700 1 -- 172.21.15.40:0/3974071783 wait complete. 2023-09-30T22:30:00.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.955+0000 7ff265afe700 1 Processor -- start 2023-09-30T22:30:00.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.956+0000 7ff265afe700 1 -- start start 2023-09-30T22:30:00.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.956+0000 7ff265afe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff26006a6d0 0x7ff2601c6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:00.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.956+0000 7ff265afe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff26006afe0 0x7ff2601c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:00.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.956+0000 7ff265afe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff260131df0 0x7ff26011c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:00.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.956+0000 7ff265afe700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2601bb250 con 0x7ff26006afe0 2023-09-30T22:30:00.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.956+0000 7ff265afe700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff260131480 con 0x7ff260131df0 2023-09-30T22:30:00.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.956+0000 7ff265afe700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff26011fe40 con 0x7ff26006a6d0 2023-09-30T22:30:00.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.956+0000 7ff25effd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff26006afe0 0x7ff2601c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:00.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.956+0000 7ff25effd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff26006afe0 0x7ff2601c6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36870/0 (socket says 172.21.15.40:36870) 2023-09-30T22:30:00.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.956+0000 7ff25effd700 1 -- 172.21.15.40:0/1617246757 learned_addr learned my addr 172.21.15.40:0/1617246757 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:00.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.957+0000 7ff25f7fe700 1 --2- 172.21.15.40:0/1617246757 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff26006a6d0 0x7ff2601c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:00.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.957+0000 7ff25ffff700 1 --2- 172.21.15.40:0/1617246757 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff260131df0 0x7ff26011c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:00.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.957+0000 7ff25effd700 1 -- 172.21.15.40:0/1617246757 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff26006a6d0 msgr2=0x7ff2601c6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:00.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.957+0000 7ff25effd700 1 --2- 172.21.15.40:0/1617246757 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff26006a6d0 0x7ff2601c6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:00.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.957+0000 7ff25effd700 1 -- 172.21.15.40:0/1617246757 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff260131df0 msgr2=0x7ff26011c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:00.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.957+0000 7ff25effd700 1 --2- 172.21.15.40:0/1617246757 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff260131df0 0x7ff26011c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:00.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.957+0000 7ff25effd700 1 -- 172.21.15.40:0/1617246757 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff250009430 con 0x7ff26006afe0 2023-09-30T22:30:00.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.957+0000 7ff25ffff700 1 --2- 172.21.15.40:0/1617246757 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff260131df0 0x7ff26011c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:00.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.957+0000 7ff25effd700 1 --2- 172.21.15.40:0/1617246757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff26006afe0 0x7ff2601c6b60 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7ff25400e8e0 tx=0x7ff25400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:00.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.957+0000 7ff247fff700 1 -- 172.21.15.40:0/1617246757 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff254013680 con 0x7ff26006afe0 2023-09-30T22:30:00.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.957+0000 7ff247fff700 1 -- 172.21.15.40:0/1617246757 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2540137e0 con 0x7ff26006afe0 2023-09-30T22:30:00.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.957+0000 7ff247fff700 1 -- 172.21.15.40:0/1617246757 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff254013b50 con 0x7ff26006afe0 2023-09-30T22:30:00.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.958+0000 7ff265afe700 1 -- 172.21.15.40:0/1617246757 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff26009e420 con 0x7ff26006afe0 2023-09-30T22:30:00.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.958+0000 7ff265afe700 1 -- 172.21.15.40:0/1617246757 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2601c70a0 con 0x7ff26006afe0 2023-09-30T22:30:00.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.959+0000 7ff265afe700 1 -- 172.21.15.40:0/1617246757 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff260062380 con 0x7ff26006afe0 2023-09-30T22:30:00.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.959+0000 7ff247fff700 1 -- 172.21.15.40:0/1617246757 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff254013cb0 con 0x7ff26006afe0 2023-09-30T22:30:00.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.959+0000 7ff247fff700 1 -- 172.21.15.40:0/1617246757 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff25403f750 con 0x7ff26006afe0 2023-09-30T22:30:00.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.964+0000 7ff247fff700 1 -- 172.21.15.40:0/1617246757 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff25401bde0 con 0x7ff26006afe0 2023-09-30T22:30:00.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.997+0000 7f724660b700 1 Processor -- start 2023-09-30T22:30:00.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.997+0000 7f724660b700 1 -- start start 2023-09-30T22:30:00.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.997+0000 7f724660b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7240136bf0 0x7f7240138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:00.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.997+0000 7f724660b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7240139510 0x7f724013b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:00.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.997+0000 7f724660b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72400a2600 con 0x7f724009c890 2023-09-30T22:30:00.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.997+0000 7f724660b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72400a29d0 con 0x7f7240139510 2023-09-30T22:30:00.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.997+0000 7f724660b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f724009fb40 con 0x7f7240136bf0 2023-09-30T22:30:01.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.998+0000 7f723ffff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f724009c890 0x7f724009cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33176/0 (socket says 172.21.15.40:33176) 2023-09-30T22:30:01.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.998+0000 7f723ffff700 1 -- 172.21.15.40:0/4161823258 learned_addr learned my addr 172.21.15.40:0/4161823258 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:01.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.998+0000 7f723f7fe700 1 --2- 172.21.15.40:0/4161823258 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7240136bf0 0x7f7240138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:01.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.998+0000 7f7244ba8700 1 --2- 172.21.15.40:0/4161823258 >> v2:172.21.15.40:3300/0 conn(0x7f7240139510 0x7f724013b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:01.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.998+0000 7f723f7fe700 1 -- 172.21.15.40:0/4161823258 >> v2:172.21.15.40:3300/0 conn(0x7f7240139510 msgr2=0x7f724013b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:01.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.998+0000 7f723f7fe700 1 --2- 172.21.15.40:0/4161823258 >> v2:172.21.15.40:3300/0 conn(0x7f7240139510 0x7f724013b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.998+0000 7f723f7fe700 1 -- 172.21.15.40:0/4161823258 >> v1:172.21.15.40:6789/0 conn(0x7f724009c890 legacy=0x7f724009cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:01.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.998+0000 7f723f7fe700 1 -- 172.21.15.40:0/4161823258 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f724009d370 con 0x7f7240136bf0 2023-09-30T22:30:01.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.998+0000 7f723f7fe700 1 --2- 172.21.15.40:0/4161823258 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7240136bf0 0x7f7240138fd0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f7234009840 tx=0x7f7234009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db1e4584d45698b2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:01.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.998+0000 7f723effd700 1 -- 172.21.15.40:0/4161823258 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7234011830 con 0x7f7240136bf0 2023-09-30T22:30:01.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.998+0000 7f723effd700 1 -- 172.21.15.40:0/4161823258 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7234011990 con 0x7f7240136bf0 2023-09-30T22:30:01.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.998+0000 7f723effd700 1 -- 172.21.15.40:0/4161823258 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7234011d20 con 0x7f7240136bf0 2023-09-30T22:30:01.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.999+0000 7f724660b700 1 -- 172.21.15.40:0/4161823258 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7240136bf0 msgr2=0x7f7240138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:01.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.999+0000 7f724660b700 1 --2- 172.21.15.40:0/4161823258 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7240136bf0 0x7f7240138fd0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f7234009840 tx=0x7f7234009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:01.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.999+0000 7f724660b700 1 -- 172.21.15.40:0/4161823258 shutdown_connections 2023-09-30T22:30:01.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.999+0000 7f724660b700 1 --2- 172.21.15.40:0/4161823258 >> v2:172.21.15.40:3300/0 conn(0x7f7240139510 0x7f724013b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.999+0000 7f724660b700 1 --2- 172.21.15.40:0/4161823258 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7240136bf0 0x7f7240138fd0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.999+0000 7f724660b700 1 -- 172.21.15.40:0/4161823258 >> 172.21.15.40:0/4161823258 conn(0x7f72400a7080 msgr2=0x7f72400a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:01.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.999+0000 7f724660b700 1 -- 172.21.15.40:0/4161823258 shutdown_connections 2023-09-30T22:30:01.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:00.999+0000 7f724660b700 1 -- 172.21.15.40:0/4161823258 wait complete. 2023-09-30T22:30:01.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.000+0000 7f724660b700 1 Processor -- start 2023-09-30T22:30:01.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.000+0000 7f724660b700 1 -- start start 2023-09-30T22:30:01.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.001+0000 7f724660b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f724009c890 0x7f724006f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:01.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.001+0000 7f724660b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7240136bf0 0x7f724006f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:01.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.001+0000 7f724660b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7240139510 0x7f724006fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:01.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.001+0000 7f724660b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7240139050 con 0x7f7240136bf0 2023-09-30T22:30:01.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.001+0000 7f724660b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f724012be30 con 0x7f7240139510 2023-09-30T22:30:01.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.001+0000 7f724660b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f724012b710 con 0x7f724009c890 2023-09-30T22:30:01.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.001+0000 7f723f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7240136bf0 0x7f724006f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:01.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.001+0000 7f7244ba8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7240139510 0x7f724006fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:01.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.001+0000 7f723f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7240136bf0 0x7f724006f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36888/0 (socket says 172.21.15.40:36888) 2023-09-30T22:30:01.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.001+0000 7f723f7fe700 1 -- 172.21.15.40:0/3249265029 learned_addr learned my addr 172.21.15.40:0/3249265029 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:01.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.001+0000 7f723ffff700 1 --2- 172.21.15.40:0/3249265029 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f724009c890 0x7f724006f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:01.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.001+0000 7f723f7fe700 1 -- 172.21.15.40:0/3249265029 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f724009c890 msgr2=0x7f724006f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:01.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.001+0000 7f723f7fe700 1 --2- 172.21.15.40:0/3249265029 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f724009c890 0x7f724006f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.001+0000 7f723f7fe700 1 -- 172.21.15.40:0/3249265029 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7240139510 msgr2=0x7f724006fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:01.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.001+0000 7f723f7fe700 1 --2- 172.21.15.40:0/3249265029 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7240139510 0x7f724006fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.001+0000 7f723f7fe700 1 -- 172.21.15.40:0/3249265029 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72340094a0 con 0x7f7240136bf0 2023-09-30T22:30:01.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.001+0000 7f7244ba8700 1 --2- 172.21.15.40:0/3249265029 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7240139510 0x7f724006fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:01.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.001+0000 7f723ffff700 1 --2- 172.21.15.40:0/3249265029 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f724009c890 0x7f724006f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:30:01.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.001+0000 7f723f7fe700 1 --2- 172.21.15.40:0/3249265029 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7240136bf0 0x7f724006f620 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f7234009fd0 tx=0x7f7234004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:01.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.002+0000 7f723cff9700 1 -- 172.21.15.40:0/3249265029 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7234004480 con 0x7f7240136bf0 2023-09-30T22:30:01.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.002+0000 7f723cff9700 1 -- 172.21.15.40:0/3249265029 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f723401f070 con 0x7f7240136bf0 2023-09-30T22:30:01.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.002+0000 7f724660b700 1 -- 172.21.15.40:0/3249265029 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f724009ecf0 con 0x7f7240136bf0 2023-09-30T22:30:01.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.002+0000 7f724660b700 1 -- 172.21.15.40:0/3249265029 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f724012c8a0 con 0x7f7240136bf0 2023-09-30T22:30:01.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.003+0000 7f723cff9700 1 -- 172.21.15.40:0/3249265029 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72340038e0 con 0x7f7240136bf0 2023-09-30T22:30:01.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.003+0000 7f723cff9700 1 -- 172.21.15.40:0/3249265029 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7234021030 con 0x7f7240136bf0 2023-09-30T22:30:01.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.003+0000 7f724660b700 1 -- 172.21.15.40:0/3249265029 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7240062380 con 0x7f7240136bf0 2023-09-30T22:30:01.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.003+0000 7f723cff9700 1 -- 172.21.15.40:0/3249265029 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f7234040b00 con 0x7f7240136bf0 2023-09-30T22:30:01.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.012+0000 7f723cff9700 1 -- 172.21.15.40:0/3249265029 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f723401a450 con 0x7f7240136bf0 2023-09-30T22:30:01.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.103+0000 7f5e1b3db700 1 -- 172.21.15.40:0/1842932267 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5e14074720 con 0x7f5e1406afe0 2023-09-30T22:30:01.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.103+0000 7f5e09ffb700 1 -- 172.21.15.40:0/1842932267 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5e0402a090 con 0x7f5e1406afe0 2023-09-30T22:30:01.104 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:01.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.105+0000 7f5e1b3db700 1 -- 172.21.15.40:0/1842932267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e1406afe0 msgr2=0x7f5e141c4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:01.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.105+0000 7f5e1b3db700 1 --2- 172.21.15.40:0/1842932267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e1406afe0 0x7f5e141c4b90 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f5e0400e910 tx=0x7f5e0400ecd0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.105+0000 7f5e1b3db700 1 -- 172.21.15.40:0/1842932267 shutdown_connections 2023-09-30T22:30:01.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.105+0000 7f5e1b3db700 1 --2- 172.21.15.40:0/1842932267 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5e1406a6d0 0x7f5e141c4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.105+0000 7f5e1b3db700 1 --2- 172.21.15.40:0/1842932267 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e14131df0 0x7f5e1411b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.105+0000 7f5e1b3db700 1 --2- 172.21.15.40:0/1842932267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e1406afe0 0x7f5e141c4b90 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.105+0000 7f5e1b3db700 1 -- 172.21.15.40:0/1842932267 >> 172.21.15.40:0/1842932267 conn(0x7f5e1409fb20 msgr2=0x7f5e14130bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:01.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.105+0000 7f5e1b3db700 1 -- 172.21.15.40:0/1842932267 shutdown_connections 2023-09-30T22:30:01.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.105+0000 7f5e1b3db700 1 -- 172.21.15.40:0/1842932267 wait complete. 2023-09-30T22:30:01.123 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:01.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.126+0000 7f1389f38700 1 -- 172.21.15.40:0/3381886203 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1384062380 con 0x7f1384133ca0 2023-09-30T22:30:01.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.126+0000 7f136bfff700 1 -- 172.21.15.40:0/3381886203 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f137801c8d0 con 0x7f1384133ca0 2023-09-30T22:30:01.127 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:01.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.128+0000 7f1389f38700 1 -- 172.21.15.40:0/3381886203 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1384133ca0 msgr2=0x7f138411e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:01.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.128+0000 7f1389f38700 1 --2- 172.21.15.40:0/3381886203 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1384133ca0 0x7f138411e080 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f1378009f20 tx=0x7f137800ee40 comp rx=0 tx=0).stop 2023-09-30T22:30:01.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.128+0000 7f1389f38700 1 -- 172.21.15.40:0/3381886203 shutdown_connections 2023-09-30T22:30:01.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.128+0000 7f1389f38700 1 --2- 172.21.15.40:0/3381886203 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f138409d920 0x7f138411db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.128+0000 7f1389f38700 1 --2- 172.21.15.40:0/3381886203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f138411e5c0 0x7f13841ceb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.128+0000 7f1389f38700 1 --2- 172.21.15.40:0/3381886203 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1384133ca0 0x7f138411e080 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.128+0000 7f1389f38700 1 -- 172.21.15.40:0/3381886203 >> 172.21.15.40:0/3381886203 conn(0x7f138409fb20 msgr2=0x7f1384133580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:01.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.129+0000 7f1389f38700 1 -- 172.21.15.40:0/3381886203 shutdown_connections 2023-09-30T22:30:01.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.129+0000 7f1389f38700 1 -- 172.21.15.40:0/3381886203 wait complete. 2023-09-30T22:30:01.142 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:01.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.177+0000 7ff265afe700 1 -- 172.21.15.40:0/1617246757 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff260120060 con 0x7ff26006afe0 2023-09-30T22:30:01.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.177+0000 7ff247fff700 1 -- 172.21.15.40:0/1617246757 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff260120060 con 0x7ff26006afe0 2023-09-30T22:30:01.178 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:01.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.179+0000 7ff265afe700 1 -- 172.21.15.40:0/1617246757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff26006afe0 msgr2=0x7ff2601c6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:01.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.179+0000 7ff265afe700 1 --2- 172.21.15.40:0/1617246757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff26006afe0 0x7ff2601c6b60 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7ff25400e8e0 tx=0x7ff25400ebf0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.179+0000 7ff265afe700 1 -- 172.21.15.40:0/1617246757 shutdown_connections 2023-09-30T22:30:01.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.179+0000 7ff265afe700 1 --2- 172.21.15.40:0/1617246757 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff26006a6d0 0x7ff2601c6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.179+0000 7ff265afe700 1 --2- 172.21.15.40:0/1617246757 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff260131df0 0x7ff26011c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.179+0000 7ff265afe700 1 --2- 172.21.15.40:0/1617246757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff26006afe0 0x7ff2601c6b60 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.179+0000 7ff265afe700 1 -- 172.21.15.40:0/1617246757 >> 172.21.15.40:0/1617246757 conn(0x7ff26009fb20 msgr2=0x7ff26006f760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:01.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.179+0000 7ff265afe700 1 -- 172.21.15.40:0/1617246757 shutdown_connections 2023-09-30T22:30:01.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.179+0000 7ff265afe700 1 -- 172.21.15.40:0/1617246757 wait complete. 2023-09-30T22:30:01.192 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:01.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.211+0000 7f724660b700 1 -- 172.21.15.40:0/3249265029 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7240074620 con 0x7f7240136bf0 2023-09-30T22:30:01.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.211+0000 7f723cff9700 1 -- 172.21.15.40:0/3249265029 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7234015070 con 0x7f7240136bf0 2023-09-30T22:30:01.212 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:01.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.213+0000 7f724660b700 1 -- 172.21.15.40:0/3249265029 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7240136bf0 msgr2=0x7f724006f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:01.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.213+0000 7f724660b700 1 --2- 172.21.15.40:0/3249265029 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7240136bf0 0x7f724006f620 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f7234009fd0 tx=0x7f7234004750 comp rx=0 tx=0).stop 2023-09-30T22:30:01.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.213+0000 7f724660b700 1 -- 172.21.15.40:0/3249265029 shutdown_connections 2023-09-30T22:30:01.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.213+0000 7f724660b700 1 --2- 172.21.15.40:0/3249265029 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f724009c890 0x7f724006f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.213+0000 7f724660b700 1 --2- 172.21.15.40:0/3249265029 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7240139510 0x7f724006fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.213+0000 7f724660b700 1 --2- 172.21.15.40:0/3249265029 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7240136bf0 0x7f724006f620 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:01.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.213+0000 7f724660b700 1 -- 172.21.15.40:0/3249265029 >> 172.21.15.40:0/3249265029 conn(0x7f72400a7080 msgr2=0x7f72401349d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:01.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.213+0000 7f724660b700 1 -- 172.21.15.40:0/3249265029 shutdown_connections 2023-09-30T22:30:01.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:01.213+0000 7f724660b700 1 -- 172.21.15.40:0/3249265029 wait complete. 2023-09-30T22:30:01.226 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:02.124 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:02.143 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:02.193 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:02.227 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:02.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.269+0000 7f70b1a39700 1 Processor -- start 2023-09-30T22:30:02.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.269+0000 7f70b1a39700 1 -- start start 2023-09-30T22:30:02.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.269+0000 7f70b1a39700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f70ac131d50 0x7f70ac132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.269+0000 7f70b1a39700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f70ac09bc50 0x7f70ac09c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.269+0000 7f70b1a39700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f70ac09c600 0x7f70ac138ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.269+0000 7f70b1a39700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70ac0719e0 con 0x7f70ac131d50 2023-09-30T22:30:02.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.269+0000 7f70b1a39700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70ac132660 con 0x7f70ac09bc50 2023-09-30T22:30:02.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.269+0000 7f70b1a39700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70ac09ca50 con 0x7f70ac09c600 2023-09-30T22:30:02.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.270+0000 7f70aaffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f70ac131d50 0x7f70ac132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.270+0000 7f70ab7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f70ac09c600 0x7f70ac138ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.270+0000 7f70aaffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f70ac131d50 0x7f70ac132120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36904/0 (socket says 172.21.15.40:36904) 2023-09-30T22:30:02.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.270+0000 7f70ab7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f70ac09c600 0x7f70ac138ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:39802/0 (socket says 172.21.15.40:39802) 2023-09-30T22:30:02.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.270+0000 7f70aaffd700 1 -- 172.21.15.40:0/2563438617 learned_addr learned my addr 172.21.15.40:0/2563438617 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:02.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.270+0000 7f70aa7fc700 1 --2- 172.21.15.40:0/2563438617 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f70ac09bc50 0x7f70ac09c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.270+0000 7f70ab7fe700 1 -- 172.21.15.40:0/2563438617 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f70ac09bc50 msgr2=0x7f70ac09c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:02.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.270+0000 7f70ab7fe700 1 --2- 172.21.15.40:0/2563438617 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f70ac09bc50 0x7f70ac09c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.270+0000 7f70ab7fe700 1 -- 172.21.15.40:0/2563438617 >> v2:172.21.15.40:3300/0 conn(0x7f70ac131d50 msgr2=0x7f70ac132120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:02.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.270+0000 7f70ab7fe700 1 --2- 172.21.15.40:0/2563438617 >> v2:172.21.15.40:3300/0 conn(0x7f70ac131d50 0x7f70ac132120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.270+0000 7f70ab7fe700 1 -- 172.21.15.40:0/2563438617 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ac131900 con 0x7f70ac09c600 2023-09-30T22:30:02.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.270+0000 7f70aaffd700 1 --2- 172.21.15.40:0/2563438617 >> v2:172.21.15.40:3300/0 conn(0x7f70ac131d50 0x7f70ac132120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:02.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.270+0000 7f70ab7fe700 1 --2- 172.21.15.40:0/2563438617 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f70ac09c600 0x7f70ac138ab0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f70a4009d90 tx=0x7f70a400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83ce65bfb7bcba99 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:02.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.270+0000 7f70a9ffb700 1 -- 172.21.15.40:0/2563438617 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a400e070 con 0x7f70ac09c600 2023-09-30T22:30:02.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.271+0000 7f70a9ffb700 1 -- 172.21.15.40:0/2563438617 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a400bb20 con 0x7f70ac09c600 2023-09-30T22:30:02.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.271+0000 7f70a9ffb700 1 -- 172.21.15.40:0/2563438617 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a4012430 con 0x7f70ac09c600 2023-09-30T22:30:02.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.271+0000 7f70b1a39700 1 -- 172.21.15.40:0/2563438617 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f70ac09c600 msgr2=0x7f70ac138ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:02.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.271+0000 7f70b1a39700 1 --2- 172.21.15.40:0/2563438617 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f70ac09c600 0x7f70ac138ab0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f70a4009d90 tx=0x7f70a400b330 comp rx=0 tx=0).stop 2023-09-30T22:30:02.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.272+0000 7f70b1a39700 1 -- 172.21.15.40:0/2563438617 shutdown_connections 2023-09-30T22:30:02.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.272+0000 7f70b1a39700 1 --2- 172.21.15.40:0/2563438617 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f70ac09c600 0x7f70ac138ab0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.272+0000 7f70b1a39700 1 --2- 172.21.15.40:0/2563438617 >> v2:172.21.15.40:3300/0 conn(0x7f70ac131d50 0x7f70ac132120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.272+0000 7f70b1a39700 1 --2- 172.21.15.40:0/2563438617 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f70ac09bc50 0x7f70ac09c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.272+0000 7f70b1a39700 1 -- 172.21.15.40:0/2563438617 >> 172.21.15.40:0/2563438617 conn(0x7f70ac0a2a00 msgr2=0x7f70ac0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:02.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.272+0000 7f70b1a39700 1 -- 172.21.15.40:0/2563438617 shutdown_connections 2023-09-30T22:30:02.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.272+0000 7f70b1a39700 1 -- 172.21.15.40:0/2563438617 wait complete. 2023-09-30T22:30:02.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.273+0000 7f70b1a39700 1 Processor -- start 2023-09-30T22:30:02.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.273+0000 7f70b1a39700 1 -- start start 2023-09-30T22:30:02.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.274+0000 7f70b1a39700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70ac09bc50 0x7f70ac119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.274+0000 7f70b1a39700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f70ac09c600 0x7f70ac119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.274+0000 7f70b1a39700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f70ac131d50 0x7f70ac119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.274+0000 7f70b1a39700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ac11b630 con 0x7f70ac09bc50 2023-09-30T22:30:02.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.274+0000 7f70b1a39700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70ac11aff0 con 0x7f70ac131d50 2023-09-30T22:30:02.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.274+0000 7f70b1a39700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70ac11be20 con 0x7f70ac09c600 2023-09-30T22:30:02.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.274+0000 7f70aa7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f70ac09c600 0x7f70ac119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.274+0000 7f70aa7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f70ac09c600 0x7f70ac119590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:39806/0 (socket says 172.21.15.40:39806) 2023-09-30T22:30:02.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.274+0000 7f70aa7fc700 1 -- 172.21.15.40:0/3466607133 learned_addr learned my addr 172.21.15.40:0/3466607133 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:02.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.274+0000 7f70aaffd700 1 --2- 172.21.15.40:0/3466607133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70ac09bc50 0x7f70ac119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.274+0000 7f70aa7fc700 1 -- 172.21.15.40:0/3466607133 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f70ac131d50 msgr2=0x7f70ac119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:02.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.274+0000 7f70aa7fc700 1 --2- 172.21.15.40:0/3466607133 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f70ac131d50 0x7f70ac119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.274+0000 7f70aa7fc700 1 -- 172.21.15.40:0/3466607133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70ac09bc50 msgr2=0x7f70ac119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:02.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.274+0000 7f70aa7fc700 1 --2- 172.21.15.40:0/3466607133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70ac09bc50 0x7f70ac119050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.274+0000 7f70aa7fc700 1 -- 172.21.15.40:0/3466607133 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709c009550 con 0x7f70ac09c600 2023-09-30T22:30:02.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.274+0000 7f70aa7fc700 1 --2- 172.21.15.40:0/3466607133 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f70ac09c600 0x7f70ac119590 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f70a000e870 tx=0x7f70a000eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:02.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.274+0000 7f7093fff700 1 -- 172.21.15.40:0/3466607133 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a0013680 con 0x7f70ac09c600 2023-09-30T22:30:02.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.275+0000 7f7093fff700 1 -- 172.21.15.40:0/3466607133 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a00137e0 con 0x7f70ac09c600 2023-09-30T22:30:02.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.275+0000 7f70b1a39700 1 -- 172.21.15.40:0/3466607133 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70a4009a70 con 0x7f70ac09c600 2023-09-30T22:30:02.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.275+0000 7f70b1a39700 1 -- 172.21.15.40:0/3466607133 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70ac129f40 con 0x7f70ac09c600 2023-09-30T22:30:02.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.275+0000 7f7093fff700 1 -- 172.21.15.40:0/3466607133 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a0013b50 con 0x7f70ac09c600 2023-09-30T22:30:02.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.276+0000 7f70b1a39700 1 -- 172.21.15.40:0/3466607133 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f708c0052e0 con 0x7f70ac09c600 2023-09-30T22:30:02.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.276+0000 7f7093fff700 1 -- 172.21.15.40:0/3466607133 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f70a0013cb0 con 0x7f70ac09c600 2023-09-30T22:30:02.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.276+0000 7f7093fff700 1 -- 172.21.15.40:0/3466607133 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f70a0047350 con 0x7f70ac09c600 2023-09-30T22:30:02.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.281+0000 7f7093fff700 1 -- 172.21.15.40:0/3466607133 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f70a0044060 con 0x7f70ac09c600 2023-09-30T22:30:02.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.308+0000 7f41eb017700 1 Processor -- start 2023-09-30T22:30:02.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.309+0000 7f41eb017700 1 -- start start 2023-09-30T22:30:02.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.309+0000 7f41eb017700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f41e412e590 0x7f41e412e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.309+0000 7f41eb017700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f41e412d8a0 0x7f41e4138c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.309+0000 7f41eb017700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e409ab70 con 0x7f41e412eea0 2023-09-30T22:30:02.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.309+0000 7f41eb017700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e409b270 con 0x7f41e412e590 2023-09-30T22:30:02.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.309+0000 7f41eb017700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e409bab0 con 0x7f41e412d8a0 2023-09-30T22:30:02.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.309+0000 7f41e3fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f41e412eea0 0x7f41e412d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33180/0 (socket says 172.21.15.40:33180) 2023-09-30T22:30:02.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.309+0000 7f41e3fff700 1 -- 172.21.15.40:0/1808325087 learned_addr learned my addr 172.21.15.40:0/1808325087 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:02.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.309+0000 7f41e95b4700 1 --2- 172.21.15.40:0/1808325087 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f41e412d8a0 0x7f41e4138c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.309+0000 7f41e8db3700 1 --2- 172.21.15.40:0/1808325087 >> v2:172.21.15.40:3300/0 conn(0x7f41e412e590 0x7f41e412e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.310+0000 7f41e8db3700 1 -- 172.21.15.40:0/1808325087 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f41e412d8a0 msgr2=0x7f41e4138c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:02.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.310+0000 7f41e8db3700 1 --2- 172.21.15.40:0/1808325087 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f41e412d8a0 0x7f41e4138c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.310+0000 7f41e8db3700 1 -- 172.21.15.40:0/1808325087 >> v1:172.21.15.40:6789/0 conn(0x7f41e412eea0 legacy=0x7f41e412d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:02.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.310+0000 7f41e8db3700 1 -- 172.21.15.40:0/1808325087 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e409bd70 con 0x7f41e412e590 2023-09-30T22:30:02.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.310+0000 7f41e37fe700 1 -- 172.21.15.40:0/1808325087 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3813449681 0 0) 0x7f41e409ab70 con 0x7f41e412eea0 2023-09-30T22:30:02.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.310+0000 7f41e95b4700 1 --2- 172.21.15.40:0/1808325087 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f41e412d8a0 0x7f41e4138c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:02.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.310+0000 7f41e8db3700 1 --2- 172.21.15.40:0/1808325087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41e412e590 0x7f41e412e960 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f41d8009840 tx=0x7f41d8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8012fd22bd408d1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:02.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.310+0000 7f41e37fe700 1 -- 172.21.15.40:0/1808325087 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d8011830 con 0x7f41e412e590 2023-09-30T22:30:02.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.310+0000 7f41e37fe700 1 -- 172.21.15.40:0/1808325087 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d8011990 con 0x7f41e412e590 2023-09-30T22:30:02.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.310+0000 7f41e37fe700 1 -- 172.21.15.40:0/1808325087 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d8011d20 con 0x7f41e412e590 2023-09-30T22:30:02.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.311+0000 7f41eb017700 1 -- 172.21.15.40:0/1808325087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41e412e590 msgr2=0x7f41e412e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:02.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.311+0000 7f41eb017700 1 --2- 172.21.15.40:0/1808325087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41e412e590 0x7f41e412e960 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f41d8009840 tx=0x7f41d8009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:02.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.311+0000 7f41eb017700 1 -- 172.21.15.40:0/1808325087 shutdown_connections 2023-09-30T22:30:02.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.311+0000 7f41eb017700 1 --2- 172.21.15.40:0/1808325087 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f41e412d8a0 0x7f41e4138c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.311+0000 7f41eb017700 1 --2- 172.21.15.40:0/1808325087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41e412e590 0x7f41e412e960 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.311+0000 7f41eb017700 1 -- 172.21.15.40:0/1808325087 >> 172.21.15.40:0/1808325087 conn(0x7f41e40a2a00 msgr2=0x7f41e40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:02.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.311+0000 7f41eb017700 1 -- 172.21.15.40:0/1808325087 shutdown_connections 2023-09-30T22:30:02.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.311+0000 7f41eb017700 1 -- 172.21.15.40:0/1808325087 wait complete. 2023-09-30T22:30:02.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.312+0000 7f41eb017700 1 Processor -- start 2023-09-30T22:30:02.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.312+0000 7f41eb017700 1 -- start start 2023-09-30T22:30:02.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.313+0000 7f41eb017700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f41e412d8a0 0x7f41e4119860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.313+0000 7f41eb017700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f41e412e590 0x7f41e4119da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.313+0000 7f41eb017700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41e412eea0 0x7f41e411a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.313+0000 7f41eb017700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e411dd40 con 0x7f41e412eea0 2023-09-30T22:30:02.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.313+0000 7f41eb017700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e411b510 con 0x7f41e412d8a0 2023-09-30T22:30:02.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.313+0000 7f41eb017700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41e411d0a0 con 0x7f41e412e590 2023-09-30T22:30:02.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.313+0000 7f41e95b4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41e412eea0 0x7f41e411a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.313+0000 7f41e95b4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41e412eea0 0x7f41e411a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36932/0 (socket says 172.21.15.40:36932) 2023-09-30T22:30:02.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.313+0000 7f41e95b4700 1 -- 172.21.15.40:0/3617088209 learned_addr learned my addr 172.21.15.40:0/3617088209 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:02.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.313+0000 7f41e8db3700 1 --2- 172.21.15.40:0/3617088209 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f41e412d8a0 0x7f41e4119860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.314+0000 7f41e3fff700 1 --2- 172.21.15.40:0/3617088209 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f41e412e590 0x7f41e4119da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.314+0000 7f41e95b4700 1 -- 172.21.15.40:0/3617088209 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f41e412e590 msgr2=0x7f41e4119da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:02.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.314+0000 7f41e95b4700 1 --2- 172.21.15.40:0/3617088209 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f41e412e590 0x7f41e4119da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.314+0000 7f41e95b4700 1 -- 172.21.15.40:0/3617088209 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f41e412d8a0 msgr2=0x7f41e4119860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:02.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.314+0000 7f41e95b4700 1 --2- 172.21.15.40:0/3617088209 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f41e412d8a0 0x7f41e4119860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.314+0000 7f41e95b4700 1 -- 172.21.15.40:0/3617088209 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41dc009a70 con 0x7f41e412eea0 2023-09-30T22:30:02.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.314+0000 7f41e95b4700 1 --2- 172.21.15.40:0/3617088209 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41e412eea0 0x7f41e411a2e0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f41dc00efc0 tx=0x7f41dc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:02.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.314+0000 7f41e17fa700 1 -- 172.21.15.40:0/3617088209 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41dc00cc90 con 0x7f41e412eea0 2023-09-30T22:30:02.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.314+0000 7f41eb017700 1 -- 172.21.15.40:0/3617088209 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41d80094a0 con 0x7f41e412eea0 2023-09-30T22:30:02.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.314+0000 7f41eb017700 1 -- 172.21.15.40:0/3617088209 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e411c6c0 con 0x7f41e412eea0 2023-09-30T22:30:02.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.314+0000 7f41e17fa700 1 -- 172.21.15.40:0/3617088209 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41dc00f040 con 0x7f41e412eea0 2023-09-30T22:30:02.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.314+0000 7f41e17fa700 1 -- 172.21.15.40:0/3617088209 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41dc014480 con 0x7f41e412eea0 2023-09-30T22:30:02.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.315+0000 7f41e17fa700 1 -- 172.21.15.40:0/3617088209 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f41dc0145e0 con 0x7f41e412eea0 2023-09-30T22:30:02.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.316+0000 7f41eb017700 1 -- 172.21.15.40:0/3617088209 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41c40052e0 con 0x7f41e412eea0 2023-09-30T22:30:02.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.316+0000 7f41e17fa700 1 -- 172.21.15.40:0/3617088209 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f41dc0404b0 con 0x7f41e412eea0 2023-09-30T22:30:02.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.321+0000 7f41e17fa700 1 -- 172.21.15.40:0/3617088209 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f41dc012700 con 0x7f41e412eea0 2023-09-30T22:30:02.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.356+0000 7eff90177700 1 Processor -- start 2023-09-30T22:30:02.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.356+0000 7eff90177700 1 -- start start 2023-09-30T22:30:02.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.357+0000 7eff90177700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7eff8806a6d0 0x7eff8809d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.357+0000 7eff90177700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff8809de60 0x7eff8809e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.357+0000 7eff90177700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7eff8813c490 0x7eff8813e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.357+0000 7eff90177700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff8806aaa0 con 0x7eff8813c490 2023-09-30T22:30:02.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.357+0000 7eff90177700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff8809e790 con 0x7eff8806a6d0 2023-09-30T22:30:02.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.357+0000 7eff90177700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff8806b150 con 0x7eff8809de60 2023-09-30T22:30:02.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.357+0000 7eff8e714700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7eff8813c490 0x7eff8813e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.357+0000 7eff8e714700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7eff8813c490 0x7eff8813e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36942/0 (socket says 172.21.15.40:36942) 2023-09-30T22:30:02.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.357+0000 7eff8df13700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7eff8806a6d0 0x7eff8809d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.357+0000 7eff8e714700 1 -- 172.21.15.40:0/3109573123 learned_addr learned my addr 172.21.15.40:0/3109573123 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:02.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.357+0000 7eff8d712700 1 --2- 172.21.15.40:0/3109573123 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff8809de60 0x7eff8809e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.357+0000 7eff8e714700 1 -- 172.21.15.40:0/3109573123 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff8809de60 msgr2=0x7eff8809e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:02.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.357+0000 7eff8e714700 1 --2- 172.21.15.40:0/3109573123 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff8809de60 0x7eff8809e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.357+0000 7eff8e714700 1 -- 172.21.15.40:0/3109573123 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7eff8806a6d0 msgr2=0x7eff8809d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:02.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.357+0000 7eff8e714700 1 --2- 172.21.15.40:0/3109573123 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7eff8806a6d0 0x7eff8809d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.357+0000 7eff8e714700 1 -- 172.21.15.40:0/3109573123 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8809f300 con 0x7eff8813c490 2023-09-30T22:30:02.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.357+0000 7eff8df13700 1 --2- 172.21.15.40:0/3109573123 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7eff8806a6d0 0x7eff8809d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:02.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.357+0000 7eff8e714700 1 --2- 172.21.15.40:0/3109573123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff8813c490 0x7eff8813e870 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7eff80009e80 tx=0x7eff8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=143935059eab7a7c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:02.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.358+0000 7eff8cf11700 1 -- 172.21.15.40:0/3109573123 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8000e070 con 0x7eff8813c490 2023-09-30T22:30:02.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.358+0000 7eff8cf11700 1 -- 172.21.15.40:0/3109573123 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8000b8d0 con 0x7eff8813c490 2023-09-30T22:30:02.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.358+0000 7eff8cf11700 1 -- 172.21.15.40:0/3109573123 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8000bc80 con 0x7eff8813c490 2023-09-30T22:30:02.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.358+0000 7eff90177700 1 -- 172.21.15.40:0/3109573123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff8813c490 msgr2=0x7eff8813e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:02.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.358+0000 7eff90177700 1 --2- 172.21.15.40:0/3109573123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff8813c490 0x7eff8813e870 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7eff80009e80 tx=0x7eff8000b330 comp rx=0 tx=0).stop 2023-09-30T22:30:02.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.358+0000 7eff90177700 1 -- 172.21.15.40:0/3109573123 shutdown_connections 2023-09-30T22:30:02.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.358+0000 7eff90177700 1 --2- 172.21.15.40:0/3109573123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff8813c490 0x7eff8813e870 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.358+0000 7eff90177700 1 --2- 172.21.15.40:0/3109573123 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7eff8806a6d0 0x7eff8809d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.358+0000 7eff90177700 1 --2- 172.21.15.40:0/3109573123 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff8809de60 0x7eff8809e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.358+0000 7eff90177700 1 -- 172.21.15.40:0/3109573123 >> 172.21.15.40:0/3109573123 conn(0x7eff8809fb20 msgr2=0x7eff8809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:02.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.359+0000 7eff90177700 1 -- 172.21.15.40:0/3109573123 shutdown_connections 2023-09-30T22:30:02.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.359+0000 7eff90177700 1 -- 172.21.15.40:0/3109573123 wait complete. 2023-09-30T22:30:02.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.360+0000 7eff90177700 1 Processor -- start 2023-09-30T22:30:02.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.360+0000 7eff90177700 1 -- start start 2023-09-30T22:30:02.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.361+0000 7eff90177700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff8806a6d0 0x7eff8813a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.361+0000 7eff90177700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff8809de60 0x7eff8813ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.361+0000 7eff90177700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7eff8813c490 0x7eff8813b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.361+0000 7eff90177700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff88120db0 con 0x7eff8806a6d0 2023-09-30T22:30:02.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.361+0000 7eff90177700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff881371c0 con 0x7eff8813c490 2023-09-30T22:30:02.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.361+0000 7eff90177700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff8813bd80 con 0x7eff8809de60 2023-09-30T22:30:02.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.361+0000 7eff8df13700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff8806a6d0 0x7eff8813a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.361+0000 7eff8d712700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff8809de60 0x7eff8813ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.361+0000 7eff8df13700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff8806a6d0 0x7eff8813a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36946/0 (socket says 172.21.15.40:36946) 2023-09-30T22:30:02.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.361+0000 7eff8df13700 1 -- 172.21.15.40:0/915186285 learned_addr learned my addr 172.21.15.40:0/915186285 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:02.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.361+0000 7eff8e714700 1 --2- 172.21.15.40:0/915186285 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7eff8813c490 0x7eff8813b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.361+0000 7eff8d712700 1 -- 172.21.15.40:0/915186285 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7eff8813c490 msgr2=0x7eff8813b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:02.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.361+0000 7eff8d712700 1 --2- 172.21.15.40:0/915186285 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7eff8813c490 0x7eff8813b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.361+0000 7eff8d712700 1 -- 172.21.15.40:0/915186285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff8806a6d0 msgr2=0x7eff8813a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:02.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.361+0000 7eff8d712700 1 --2- 172.21.15.40:0/915186285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff8806a6d0 0x7eff8813a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.361+0000 7eff8d712700 1 -- 172.21.15.40:0/915186285 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff84009430 con 0x7eff8809de60 2023-09-30T22:30:02.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.361+0000 7eff8df13700 1 --2- 172.21.15.40:0/915186285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff8806a6d0 0x7eff8813a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:02.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.362+0000 7eff8d712700 1 --2- 172.21.15.40:0/915186285 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff8809de60 0x7eff8813ae80 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7eff7800e810 tx=0x7eff7800eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:02.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.362+0000 7eff7e7fc700 1 -- 172.21.15.40:0/915186285 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7800c070 con 0x7eff8809de60 2023-09-30T22:30:02.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.362+0000 7eff7e7fc700 1 -- 172.21.15.40:0/915186285 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff78013610 con 0x7eff8809de60 2023-09-30T22:30:02.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.362+0000 7eff90177700 1 -- 172.21.15.40:0/915186285 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff80009b30 con 0x7eff8809de60 2023-09-30T22:30:02.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.362+0000 7eff90177700 1 -- 172.21.15.40:0/915186285 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff881201a0 con 0x7eff8809de60 2023-09-30T22:30:02.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.362+0000 7eff7e7fc700 1 -- 172.21.15.40:0/915186285 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff780139a0 con 0x7eff8809de60 2023-09-30T22:30:02.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.363+0000 7eff90177700 1 -- 172.21.15.40:0/915186285 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff700052e0 con 0x7eff8809de60 2023-09-30T22:30:02.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.363+0000 7eff7e7fc700 1 -- 172.21.15.40:0/915186285 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7eff78013b00 con 0x7eff8809de60 2023-09-30T22:30:02.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.363+0000 7eff7e7fc700 1 -- 172.21.15.40:0/915186285 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7eff7803f320 con 0x7eff8809de60 2023-09-30T22:30:02.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.368+0000 7eff7e7fc700 1 -- 172.21.15.40:0/915186285 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7eff780104f0 con 0x7eff8809de60 2023-09-30T22:30:02.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.397+0000 7fb543128700 1 Processor -- start 2023-09-30T22:30:02.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.397+0000 7fb543128700 1 -- start start 2023-09-30T22:30:02.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.398+0000 7fb543128700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb53c09d920 0x7fb53c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.398+0000 7fb543128700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb53c130fb0 0x7fb53c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.398+0000 7fb543128700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb53c09adf0 con 0x7fb53c09e230 2023-09-30T22:30:02.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.398+0000 7fb543128700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb53c09edf0 con 0x7fb53c130fb0 2023-09-30T22:30:02.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.398+0000 7fb543128700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c09b660 con 0x7fb53c09d920 2023-09-30T22:30:02.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.398+0000 7fb540ec4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb53c09d920 0x7fb53c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.398+0000 7fb540ec4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb53c09d920 0x7fb53c09dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:46086/0 (socket says 172.21.15.40:46086) 2023-09-30T22:30:02.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.398+0000 7fb540ec4700 1 -- 172.21.15.40:0/3798630936 learned_addr learned my addr 172.21.15.40:0/3798630936 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:02.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.398+0000 7fb5416c5700 1 --2- 172.21.15.40:0/3798630936 >> v2:172.21.15.40:3300/0 conn(0x7fb53c130fb0 0x7fb53c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.398+0000 7fb540ec4700 1 -- 172.21.15.40:0/3798630936 >> v2:172.21.15.40:3300/0 conn(0x7fb53c130fb0 msgr2=0x7fb53c138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:02.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.398+0000 7fb540ec4700 1 --2- 172.21.15.40:0/3798630936 >> v2:172.21.15.40:3300/0 conn(0x7fb53c130fb0 0x7fb53c138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.398+0000 7fb540ec4700 1 -- 172.21.15.40:0/3798630936 >> v1:172.21.15.40:6789/0 conn(0x7fb53c09e230 legacy=0x7fb53c1308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:02.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.398+0000 7fb540ec4700 1 -- 172.21.15.40:0/3798630936 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53c09a6e0 con 0x7fb53c09d920 2023-09-30T22:30:02.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.398+0000 7fb5416c5700 1 --2- 172.21.15.40:0/3798630936 >> v2:172.21.15.40:3300/0 conn(0x7fb53c130fb0 0x7fb53c138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:30:02.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.398+0000 7fb540ec4700 1 --2- 172.21.15.40:0/3798630936 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb53c09d920 0x7fb53c09dcf0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fb530006fd0 tx=0x7fb530009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=180f9e83f2a1b87d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:02.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.399+0000 7fb53b7fe700 1 -- 172.21.15.40:0/3798630936 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb530005e30 con 0x7fb53c09d920 2023-09-30T22:30:02.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.399+0000 7fb53b7fe700 1 -- 172.21.15.40:0/3798630936 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb530006030 con 0x7fb53c09d920 2023-09-30T22:30:02.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.399+0000 7fb53b7fe700 1 -- 172.21.15.40:0/3798630936 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5300063c0 con 0x7fb53c09d920 2023-09-30T22:30:02.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.399+0000 7fb543128700 1 -- 172.21.15.40:0/3798630936 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb53c09d920 msgr2=0x7fb53c09dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:02.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.399+0000 7fb543128700 1 --2- 172.21.15.40:0/3798630936 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb53c09d920 0x7fb53c09dcf0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fb530006fd0 tx=0x7fb530009bd0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.399+0000 7fb543128700 1 -- 172.21.15.40:0/3798630936 shutdown_connections 2023-09-30T22:30:02.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.399+0000 7fb543128700 1 --2- 172.21.15.40:0/3798630936 >> v2:172.21.15.40:3300/0 conn(0x7fb53c130fb0 0x7fb53c138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.399+0000 7fb543128700 1 --2- 172.21.15.40:0/3798630936 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb53c09d920 0x7fb53c09dcf0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.399+0000 7fb543128700 1 -- 172.21.15.40:0/3798630936 >> 172.21.15.40:0/3798630936 conn(0x7fb53c09fb20 msgr2=0x7fb53c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:02.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.399+0000 7fb543128700 1 -- 172.21.15.40:0/3798630936 shutdown_connections 2023-09-30T22:30:02.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.399+0000 7fb543128700 1 -- 172.21.15.40:0/3798630936 wait complete. 2023-09-30T22:30:02.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.400+0000 7fb543128700 1 Processor -- start 2023-09-30T22:30:02.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.400+0000 7fb543128700 1 -- start start 2023-09-30T22:30:02.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.401+0000 7fb543128700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb53c09d920 0x7fb53c1ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.401+0000 7fb543128700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb53c09e230 0x7fb53c1cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.401+0000 7fb543128700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb53c130fb0 0x7fb53c119730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:02.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.401+0000 7fb543128700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c1cc980 con 0x7fb53c09e230 2023-09-30T22:30:02.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.401+0000 7fb543128700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c06b390 con 0x7fb53c130fb0 2023-09-30T22:30:02.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.401+0000 7fb543128700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c09cb00 con 0x7fb53c09d920 2023-09-30T22:30:02.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.401+0000 7fb540ec4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb53c09d920 0x7fb53c1ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.401+0000 7fb540ec4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb53c09d920 0x7fb53c1ccdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:39834/0 (socket says 172.21.15.40:39834) 2023-09-30T22:30:02.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.401+0000 7fb540ec4700 1 -- 172.21.15.40:0/3689003529 learned_addr learned my addr 172.21.15.40:0/3689003529 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:02.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.401+0000 7fb53bfff700 1 --2- 172.21.15.40:0/3689003529 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb53c09e230 0x7fb53c1cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.401+0000 7fb5416c5700 1 --2- 172.21.15.40:0/3689003529 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb53c130fb0 0x7fb53c119730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:02.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.402+0000 7fb540ec4700 1 -- 172.21.15.40:0/3689003529 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb53c130fb0 msgr2=0x7fb53c119730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:02.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.402+0000 7fb540ec4700 1 --2- 172.21.15.40:0/3689003529 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb53c130fb0 0x7fb53c119730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.402+0000 7fb540ec4700 1 -- 172.21.15.40:0/3689003529 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb53c09e230 msgr2=0x7fb53c1cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:02.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.402+0000 7fb540ec4700 1 --2- 172.21.15.40:0/3689003529 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb53c09e230 0x7fb53c1cd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.402+0000 7fb540ec4700 1 -- 172.21.15.40:0/3689003529 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb530009500 con 0x7fb53c09d920 2023-09-30T22:30:02.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.402+0000 7fb540ec4700 1 --2- 172.21.15.40:0/3689003529 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb53c09d920 0x7fb53c1ccdb0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fb530000c00 tx=0x7fb530004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:02.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.402+0000 7fb5397fa700 1 -- 172.21.15.40:0/3689003529 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb530025470 con 0x7fb53c09d920 2023-09-30T22:30:02.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.402+0000 7fb5397fa700 1 -- 172.21.15.40:0/3689003529 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5300255d0 con 0x7fb53c09d920 2023-09-30T22:30:02.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.402+0000 7fb5397fa700 1 -- 172.21.15.40:0/3689003529 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb530025980 con 0x7fb53c09d920 2023-09-30T22:30:02.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.402+0000 7fb543128700 1 -- 172.21.15.40:0/3689003529 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb53c13f920 con 0x7fb53c09d920 2023-09-30T22:30:02.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.402+0000 7fb543128700 1 -- 172.21.15.40:0/3689003529 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb53c13eef0 con 0x7fb53c09d920 2023-09-30T22:30:02.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.403+0000 7fb543128700 1 -- 172.21.15.40:0/3689003529 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb53c09e980 con 0x7fb53c09d920 2023-09-30T22:30:02.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.404+0000 7fb5397fa700 1 -- 172.21.15.40:0/3689003529 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb530022070 con 0x7fb53c09d920 2023-09-30T22:30:02.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.404+0000 7fb5397fa700 1 -- 172.21.15.40:0/3689003529 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb530041120 con 0x7fb53c09d920 2023-09-30T22:30:02.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.413+0000 7fb5397fa700 1 -- 172.21.15.40:0/3689003529 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb53000bdf0 con 0x7fb53c09d920 2023-09-30T22:30:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.494+0000 7f70b1a39700 1 -- 172.21.15.40:0/3466607133 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f708c005150 con 0x7f70ac09c600 2023-09-30T22:30:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.494+0000 7f7093fff700 1 -- 172.21.15.40:0/3466607133 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f70a0017070 con 0x7f70ac09c600 2023-09-30T22:30:02.495 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:02.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.497+0000 7f70b1a39700 1 -- 172.21.15.40:0/3466607133 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f70ac09c600 msgr2=0x7f70ac119590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:02.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.497+0000 7f70b1a39700 1 --2- 172.21.15.40:0/3466607133 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f70ac09c600 0x7f70ac119590 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f70a000e870 tx=0x7f70a000eb80 comp rx=0 tx=0).stop 2023-09-30T22:30:02.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.497+0000 7f70b1a39700 1 -- 172.21.15.40:0/3466607133 shutdown_connections 2023-09-30T22:30:02.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.497+0000 7f70b1a39700 1 --2- 172.21.15.40:0/3466607133 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f70ac131d50 0x7f70ac119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.497+0000 7f70b1a39700 1 --2- 172.21.15.40:0/3466607133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70ac09bc50 0x7f70ac119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.497+0000 7f70b1a39700 1 --2- 172.21.15.40:0/3466607133 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f70ac09c600 0x7f70ac119590 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.497+0000 7f70b1a39700 1 -- 172.21.15.40:0/3466607133 >> 172.21.15.40:0/3466607133 conn(0x7f70ac0a2a00 msgr2=0x7f70ac0a0900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:02.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.498+0000 7f70b1a39700 1 -- 172.21.15.40:0/3466607133 shutdown_connections 2023-09-30T22:30:02.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.498+0000 7f70b1a39700 1 -- 172.21.15.40:0/3466607133 wait complete. 2023-09-30T22:30:02.511 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:02.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.526+0000 7f41eb017700 1 -- 172.21.15.40:0/3617088209 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f41c4005150 con 0x7f41e412eea0 2023-09-30T22:30:02.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.527+0000 7f41e17fa700 1 -- 172.21.15.40:0/3617088209 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f41dc02c090 con 0x7f41e412eea0 2023-09-30T22:30:02.528 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:02.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.529+0000 7f41eb017700 1 -- 172.21.15.40:0/3617088209 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41e412eea0 msgr2=0x7f41e411a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:02.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.529+0000 7f41eb017700 1 --2- 172.21.15.40:0/3617088209 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41e412eea0 0x7f41e411a2e0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f41dc00efc0 tx=0x7f41dc00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.529+0000 7f41eb017700 1 -- 172.21.15.40:0/3617088209 shutdown_connections 2023-09-30T22:30:02.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.529+0000 7f41eb017700 1 --2- 172.21.15.40:0/3617088209 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41e412eea0 0x7f41e411a2e0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.529+0000 7f41eb017700 1 --2- 172.21.15.40:0/3617088209 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f41e412d8a0 0x7f41e4119860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.529+0000 7f41eb017700 1 --2- 172.21.15.40:0/3617088209 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f41e412e590 0x7f41e4119da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.529+0000 7f41eb017700 1 -- 172.21.15.40:0/3617088209 >> 172.21.15.40:0/3617088209 conn(0x7f41e40a2a00 msgr2=0x7f41e412c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:02.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.529+0000 7f41eb017700 1 -- 172.21.15.40:0/3617088209 shutdown_connections 2023-09-30T22:30:02.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.529+0000 7f41eb017700 1 -- 172.21.15.40:0/3617088209 wait complete. 2023-09-30T22:30:02.542 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:02.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.570+0000 7eff90177700 1 -- 172.21.15.40:0/915186285 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7eff70005590 con 0x7eff8809de60 2023-09-30T22:30:02.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.570+0000 7eff7e7fc700 1 -- 172.21.15.40:0/915186285 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7eff78010310 con 0x7eff8809de60 2023-09-30T22:30:02.571 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:02.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.572+0000 7eff90177700 1 -- 172.21.15.40:0/915186285 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff8809de60 msgr2=0x7eff8813ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:02.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.572+0000 7eff90177700 1 --2- 172.21.15.40:0/915186285 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff8809de60 0x7eff8813ae80 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7eff7800e810 tx=0x7eff7800eb20 comp rx=0 tx=0).stop 2023-09-30T22:30:02.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.572+0000 7eff90177700 1 -- 172.21.15.40:0/915186285 shutdown_connections 2023-09-30T22:30:02.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.572+0000 7eff90177700 1 --2- 172.21.15.40:0/915186285 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7eff8813c490 0x7eff8813b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.572+0000 7eff90177700 1 --2- 172.21.15.40:0/915186285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff8806a6d0 0x7eff8813a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.572+0000 7eff90177700 1 --2- 172.21.15.40:0/915186285 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff8809de60 0x7eff8813ae80 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.572+0000 7eff90177700 1 -- 172.21.15.40:0/915186285 >> 172.21.15.40:0/915186285 conn(0x7eff8809fb20 msgr2=0x7eff8813d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:02.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.572+0000 7eff90177700 1 -- 172.21.15.40:0/915186285 shutdown_connections 2023-09-30T22:30:02.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.572+0000 7eff90177700 1 -- 172.21.15.40:0/915186285 wait complete. 2023-09-30T22:30:02.585 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:02.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.615+0000 7fb543128700 1 -- 172.21.15.40:0/3689003529 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb53c062380 con 0x7fb53c09d920 2023-09-30T22:30:02.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.615+0000 7fb5397fa700 1 -- 172.21.15.40:0/3689003529 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb53002a020 con 0x7fb53c09d920 2023-09-30T22:30:02.616 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:02.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.617+0000 7fb543128700 1 -- 172.21.15.40:0/3689003529 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb53c09d920 msgr2=0x7fb53c1ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:02.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.617+0000 7fb543128700 1 --2- 172.21.15.40:0/3689003529 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb53c09d920 0x7fb53c1ccdb0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fb530000c00 tx=0x7fb530004750 comp rx=0 tx=0).stop 2023-09-30T22:30:02.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.617+0000 7fb543128700 1 -- 172.21.15.40:0/3689003529 shutdown_connections 2023-09-30T22:30:02.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.617+0000 7fb543128700 1 --2- 172.21.15.40:0/3689003529 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb53c09d920 0x7fb53c1ccdb0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.617+0000 7fb543128700 1 --2- 172.21.15.40:0/3689003529 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb53c130fb0 0x7fb53c119730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.617+0000 7fb543128700 1 --2- 172.21.15.40:0/3689003529 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb53c09e230 0x7fb53c1cd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:02.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.617+0000 7fb543128700 1 -- 172.21.15.40:0/3689003529 >> 172.21.15.40:0/3689003529 conn(0x7fb53c09fb20 msgr2=0x7fb53c13a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:02.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.617+0000 7fb543128700 1 -- 172.21.15.40:0/3689003529 shutdown_connections 2023-09-30T22:30:02.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:02.617+0000 7fb543128700 1 -- 172.21.15.40:0/3689003529 wait complete. 2023-09-30T22:30:02.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:03.513 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:03.543 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:03.586 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:03.630 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:03.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.670+0000 7f0236c98700 1 Processor -- start 2023-09-30T22:30:03.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.670+0000 7f0236c98700 1 -- start start 2023-09-30T22:30:03.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.671+0000 7f0236c98700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f023009df30 0x7f0230135400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:03.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.671+0000 7f0236c98700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0230135940 0x7f0230137d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:03.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.671+0000 7f0236c98700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f023009e8b0 con 0x7f023009d450 2023-09-30T22:30:03.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.671+0000 7f0236c98700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f023009c3b0 con 0x7f0230135940 2023-09-30T22:30:03.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.671+0000 7f0236c98700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f023009a6b0 con 0x7f023009df30 2023-09-30T22:30:03.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.671+0000 7f0234a34700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f023009d450 0x7f023009d820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47618/0 (socket says 172.21.15.40:47618) 2023-09-30T22:30:03.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.671+0000 7f0234a34700 1 -- 172.21.15.40:0/884195395 learned_addr learned my addr 172.21.15.40:0/884195395 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:03.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.671+0000 7f0235235700 1 --2- 172.21.15.40:0/884195395 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0230135940 0x7f0230137d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:03.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.671+0000 7f022f7fe700 1 -- 172.21.15.40:0/884195395 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1479806319 0 0) 0x7f023009e8b0 con 0x7f023009d450 2023-09-30T22:30:03.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.672+0000 7f022f7fe700 1 -- 172.21.15.40:0/884195395 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02200034d0 con 0x7f023009d450 2023-09-30T22:30:03.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.672+0000 7f0235235700 1 -- 172.21.15.40:0/884195395 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f023009df30 msgr2=0x7f0230135400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:03.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.672+0000 7f0235235700 1 --2- 172.21.15.40:0/884195395 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f023009df30 0x7f0230135400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:03.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.672+0000 7f0235235700 1 -- 172.21.15.40:0/884195395 >> v1:172.21.15.40:6789/0 conn(0x7f023009d450 legacy=0x7f023009d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:03.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.672+0000 7f0235235700 1 -- 172.21.15.40:0/884195395 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f023009b4f0 con 0x7f0230135940 2023-09-30T22:30:03.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.672+0000 7f0235235700 1 --2- 172.21.15.40:0/884195395 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0230135940 0x7f0230137d20 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f0228009dc0 tx=0x7f022800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f05a06f00b969a0d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:03.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.672+0000 7f022f7fe700 1 -- 172.21.15.40:0/884195395 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022800e070 con 0x7f0230135940 2023-09-30T22:30:03.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.672+0000 7f022f7fe700 1 -- 172.21.15.40:0/884195395 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022800bae0 con 0x7f0230135940 2023-09-30T22:30:03.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.672+0000 7f022f7fe700 1 -- 172.21.15.40:0/884195395 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022800be90 con 0x7f0230135940 2023-09-30T22:30:03.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.673+0000 7f0236c98700 1 -- 172.21.15.40:0/884195395 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0230135940 msgr2=0x7f0230137d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:03.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.673+0000 7f0236c98700 1 --2- 172.21.15.40:0/884195395 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0230135940 0x7f0230137d20 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f0228009dc0 tx=0x7f022800b330 comp rx=0 tx=0).stop 2023-09-30T22:30:03.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.673+0000 7f0236c98700 1 -- 172.21.15.40:0/884195395 shutdown_connections 2023-09-30T22:30:03.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.673+0000 7f0236c98700 1 --2- 172.21.15.40:0/884195395 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0230135940 0x7f0230137d20 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:03.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.673+0000 7f0236c98700 1 --2- 172.21.15.40:0/884195395 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f023009df30 0x7f0230135400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:03.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.673+0000 7f0236c98700 1 -- 172.21.15.40:0/884195395 >> 172.21.15.40:0/884195395 conn(0x7f02300a2a00 msgr2=0x7f02300a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:03.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.673+0000 7f0236c98700 1 -- 172.21.15.40:0/884195395 shutdown_connections 2023-09-30T22:30:03.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.673+0000 7f0236c98700 1 -- 172.21.15.40:0/884195395 wait complete. 2023-09-30T22:30:03.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.674+0000 7f0236c98700 1 Processor -- start 2023-09-30T22:30:03.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.675+0000 7f0236c98700 1 -- start start 2023-09-30T22:30:03.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.675+0000 7f0236c98700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f023009d450 0x7f0230132690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:03.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.675+0000 7f0236c98700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f023009df30 0x7f0230132bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:03.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.676+0000 7f0236c98700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0230135940 0x7f0230133110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:03.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.676+0000 7f0236c98700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02301356e0 con 0x7f023009df30 2023-09-30T22:30:03.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.676+0000 7f0236c98700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f023011d460 con 0x7f0230135940 2023-09-30T22:30:03.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.676+0000 7f0236c98700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02300a22f0 con 0x7f023009d450 2023-09-30T22:30:03.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.676+0000 7f0234a34700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f023009d450 0x7f0230132690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:03.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.676+0000 7f0234a34700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f023009d450 0x7f0230132690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58062/0 (socket says 172.21.15.40:58062) 2023-09-30T22:30:03.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.676+0000 7f0234a34700 1 -- 172.21.15.40:0/3744921927 learned_addr learned my addr 172.21.15.40:0/3744921927 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:03.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.676+0000 7f0235235700 1 --2- 172.21.15.40:0/3744921927 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0230135940 0x7f0230133110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:03.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.676+0000 7f022ffff700 1 --2- 172.21.15.40:0/3744921927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f023009df30 0x7f0230132bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:03.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.676+0000 7f0234a34700 1 -- 172.21.15.40:0/3744921927 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0230135940 msgr2=0x7f0230133110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:03.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.676+0000 7f0234a34700 1 --2- 172.21.15.40:0/3744921927 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0230135940 0x7f0230133110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:03.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.676+0000 7f0234a34700 1 -- 172.21.15.40:0/3744921927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f023009df30 msgr2=0x7f0230132bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:03.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.676+0000 7f0234a34700 1 --2- 172.21.15.40:0/3744921927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f023009df30 0x7f0230132bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:03.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.676+0000 7f0234a34700 1 -- 172.21.15.40:0/3744921927 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0228009a70 con 0x7f023009d450 2023-09-30T22:30:03.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.676+0000 7f0234a34700 1 --2- 172.21.15.40:0/3744921927 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f023009d450 0x7f0230132690 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f02240011e0 tx=0x7f022400ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:03.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.677+0000 7f022d7fa700 1 -- 172.21.15.40:0/3744921927 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0224004c80 con 0x7f023009d450 2023-09-30T22:30:03.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.677+0000 7f022d7fa700 1 -- 172.21.15.40:0/3744921927 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0224004e00 con 0x7f023009d450 2023-09-30T22:30:03.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.677+0000 7f0236c98700 1 -- 172.21.15.40:0/3744921927 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f023009c5d0 con 0x7f023009d450 2023-09-30T22:30:03.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.677+0000 7f0236c98700 1 -- 172.21.15.40:0/3744921927 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0230134cc0 con 0x7f023009d450 2023-09-30T22:30:03.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.677+0000 7f022d7fa700 1 -- 172.21.15.40:0/3744921927 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0224007310 con 0x7f023009d450 2023-09-30T22:30:03.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.678+0000 7f022d7fa700 1 -- 172.21.15.40:0/3744921927 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0224007470 con 0x7f023009d450 2023-09-30T22:30:03.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.678+0000 7f0236c98700 1 -- 172.21.15.40:0/3744921927 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0230062380 con 0x7f023009d450 2023-09-30T22:30:03.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.678+0000 7f022d7fa700 1 -- 172.21.15.40:0/3744921927 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f022403f370 con 0x7f023009d450 2023-09-30T22:30:03.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.683+0000 7f022d7fa700 1 -- 172.21.15.40:0/3744921927 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f02240133c0 con 0x7f023009d450 2023-09-30T22:30:03.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.706+0000 7f8f50fc7700 1 Processor -- start 2023-09-30T22:30:03.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.706+0000 7f8f50fc7700 1 -- start start 2023-09-30T22:30:03.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.707+0000 7f8f50fc7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8f4c12e590 0x7f8f4c12e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:03.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.707+0000 7f8f50fc7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f4c12eea0 0x7f8f4c12d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:03.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.707+0000 7f8f50fc7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f4c12d6d0 0x7f8f4c12db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:03.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.707+0000 7f8f50fc7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f4c09ca30 con 0x7f8f4c12e590 2023-09-30T22:30:03.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.707+0000 7f8f50fc7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c09ab70 con 0x7f8f4c12d6d0 2023-09-30T22:30:03.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.707+0000 7f8f50fc7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c09bd70 con 0x7f8f4c12eea0 2023-09-30T22:30:03.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.707+0000 7f8f49d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f4c12eea0 0x7f8f4c12d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:03.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.707+0000 7f8f49d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f4c12eea0 0x7f8f4c12d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58072/0 (socket says 172.21.15.40:58072) 2023-09-30T22:30:03.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.707+0000 7f8f49d9b700 1 -- 172.21.15.40:0/1720232514 learned_addr learned my addr 172.21.15.40:0/1720232514 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:03.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.707+0000 7f8f4ad9d700 1 --2- 172.21.15.40:0/1720232514 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f4c12d6d0 0x7f8f4c12db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:03.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.707+0000 7f8f4a59c700 1 --2- 172.21.15.40:0/1720232514 >> v2:172.21.15.40:3300/0 conn(0x7f8f4c12e590 0x7f8f4c12e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:03.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.708+0000 7f8f4ad9d700 1 -- 172.21.15.40:0/1720232514 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f4c12eea0 msgr2=0x7f8f4c12d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:03.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.708+0000 7f8f4ad9d700 1 --2- 172.21.15.40:0/1720232514 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f4c12eea0 0x7f8f4c12d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:03.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.708+0000 7f8f4ad9d700 1 -- 172.21.15.40:0/1720232514 >> v2:172.21.15.40:3300/0 conn(0x7f8f4c12e590 msgr2=0x7f8f4c12e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:03.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.708+0000 7f8f4ad9d700 1 --2- 172.21.15.40:0/1720232514 >> v2:172.21.15.40:3300/0 conn(0x7f8f4c12e590 0x7f8f4c12e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:03.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.708+0000 7f8f4ad9d700 1 -- 172.21.15.40:0/1720232514 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f4c09b270 con 0x7f8f4c12d6d0 2023-09-30T22:30:03.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.708+0000 7f8f4ad9d700 1 --2- 172.21.15.40:0/1720232514 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f4c12d6d0 0x7f8f4c12db50 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f8f44009d90 tx=0x7f8f4400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=632a306440f6d6de server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:03.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.708+0000 7f8f4959a700 1 -- 172.21.15.40:0/1720232514 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4400e070 con 0x7f8f4c12d6d0 2023-09-30T22:30:03.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.708+0000 7f8f4959a700 1 -- 172.21.15.40:0/1720232514 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f4400bb20 con 0x7f8f4c12d6d0 2023-09-30T22:30:03.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.708+0000 7f8f4959a700 1 -- 172.21.15.40:0/1720232514 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f44012430 con 0x7f8f4c12d6d0 2023-09-30T22:30:03.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.709+0000 7f8f50fc7700 1 -- 172.21.15.40:0/1720232514 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f4c12d6d0 msgr2=0x7f8f4c12db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:03.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.709+0000 7f8f50fc7700 1 --2- 172.21.15.40:0/1720232514 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f4c12d6d0 0x7f8f4c12db50 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f8f44009d90 tx=0x7f8f4400b330 comp rx=0 tx=0).stop 2023-09-30T22:30:03.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.709+0000 7f8f50fc7700 1 -- 172.21.15.40:0/1720232514 shutdown_connections 2023-09-30T22:30:03.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.709+0000 7f8f50fc7700 1 --2- 172.21.15.40:0/1720232514 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f4c12d6d0 0x7f8f4c12db50 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:03.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.709+0000 7f8f50fc7700 1 --2- 172.21.15.40:0/1720232514 >> v2:172.21.15.40:3300/0 conn(0x7f8f4c12e590 0x7f8f4c12e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:03.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.709+0000 7f8f50fc7700 1 --2- 172.21.15.40:0/1720232514 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f4c12eea0 0x7f8f4c12d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:03.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.709+0000 7f8f50fc7700 1 -- 172.21.15.40:0/1720232514 >> 172.21.15.40:0/1720232514 conn(0x7f8f4c0a2a00 msgr2=0x7f8f4c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:03.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.709+0000 7f8f50fc7700 1 -- 172.21.15.40:0/1720232514 shutdown_connections 2023-09-30T22:30:03.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.709+0000 7f8f50fc7700 1 -- 172.21.15.40:0/1720232514 wait complete. 2023-09-30T22:30:03.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.710+0000 7f8f50fc7700 1 Processor -- start 2023-09-30T22:30:03.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.710+0000 7f8f50fc7700 1 -- start start 2023-09-30T22:30:03.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.710+0000 7f8f50fc7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f4c12d6d0 0x7f8f4c138ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:03.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.710+0000 7f8f50fc7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f4c12e590 0x7f8f4c1376d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:03.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.710+0000 7f8f50fc7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f4c12eea0 0x7f8f4c137c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:03.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.710+0000 7f8f50fc7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c136810 con 0x7f8f4c12e590 2023-09-30T22:30:03.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.710+0000 7f8f50fc7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c09b540 con 0x7f8f4c12d6d0 2023-09-30T22:30:03.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.710+0000 7f8f50fc7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c1354b0 con 0x7f8f4c12eea0 2023-09-30T22:30:03.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.711+0000 7f8f4a59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f4c12d6d0 0x7f8f4c138ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:03.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.711+0000 7f8f4a59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f4c12d6d0 0x7f8f4c138ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50360/0 (socket says 172.21.15.40:50360) 2023-09-30T22:30:03.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.711+0000 7f8f4a59c700 1 -- 172.21.15.40:0/3130408548 learned_addr learned my addr 172.21.15.40:0/3130408548 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:03.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.711+0000 7f8f49d9b700 1 --2- 172.21.15.40:0/3130408548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f4c12e590 0x7f8f4c1376d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:03.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.711+0000 7f8f4ad9d700 1 --2- 172.21.15.40:0/3130408548 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f4c12eea0 0x7f8f4c137c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:03.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.711+0000 7f8f4a59c700 1 -- 172.21.15.40:0/3130408548 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f4c12eea0 msgr2=0x7f8f4c137c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:03.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.711+0000 7f8f4a59c700 1 --2- 172.21.15.40:0/3130408548 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f4c12eea0 0x7f8f4c137c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:03.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.711+0000 7f8f4a59c700 1 -- 172.21.15.40:0/3130408548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f4c12e590 msgr2=0x7f8f4c1376d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:03.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.711+0000 7f8f4a59c700 1 --2- 172.21.15.40:0/3130408548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f4c12e590 0x7f8f4c1376d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:03.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.711+0000 7f8f4a59c700 1 -- 172.21.15.40:0/3130408548 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f44009a70 con 0x7f8f4c12d6d0 2023-09-30T22:30:03.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.711+0000 7f8f49d9b700 1 --2- 172.21.15.40:0/3130408548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f4c12e590 0x7f8f4c1376d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:03.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.711+0000 7f8f4a59c700 1 --2- 172.21.15.40:0/3130408548 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f4c12d6d0 0x7f8f4c138ff0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00e990 tx=0x7f8f3c00eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:03.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.711+0000 7f8f3affd700 1 -- 172.21.15.40:0/3130408548 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c00eee0 con 0x7f8f4c12d6d0 2023-09-30T22:30:03.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.712+0000 7f8f3affd700 1 -- 172.21.15.40:0/3130408548 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3c00c850 con 0x7f8f4c12d6d0 2023-09-30T22:30:03.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.712+0000 7f8f3affd700 1 -- 172.21.15.40:0/3130408548 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c00cbe0 con 0x7f8f4c12d6d0 2023-09-30T22:30:03.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.712+0000 7f8f50fc7700 1 -- 172.21.15.40:0/3130408548 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f4c0a0a90 con 0x7f8f4c12d6d0 2023-09-30T22:30:03.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.712+0000 7f8f50fc7700 1 -- 172.21.15.40:0/3130408548 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f4c136280 con 0x7f8f4c12d6d0 2023-09-30T22:30:03.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.713+0000 7f8f50fc7700 1 -- 172.21.15.40:0/3130408548 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f4c062380 con 0x7f8f4c12d6d0 2023-09-30T22:30:03.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.713+0000 7f8f3affd700 1 -- 172.21.15.40:0/3130408548 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8f3c00cd40 con 0x7f8f4c12d6d0 2023-09-30T22:30:03.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.713+0000 7f8f3affd700 1 -- 172.21.15.40:0/3130408548 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f8f3c03f740 con 0x7f8f4c12d6d0 2023-09-30T22:30:03.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.718+0000 7f8f3affd700 1 -- 172.21.15.40:0/3130408548 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8f3c0232f0 con 0x7f8f4c12d6d0 2023-09-30T22:30:03.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.762+0000 7f8e21f9b700 1 Processor -- start 2023-09-30T22:30:03.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.763+0000 7f8e21f9b700 1 -- start start 2023-09-30T22:30:03.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.763+0000 7f8e21f9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e1c09d450 0x7f8e1c09d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:03.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.763+0000 7f8e21f9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8e1c09dd60 0x7f8e1c067820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:03.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.763+0000 7f8e21f9b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e1c09e8b0 con 0x7f8e1c1301c0 2023-09-30T22:30:03.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.763+0000 7f8e21f9b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e1c09c3b0 con 0x7f8e1c09dd60 2023-09-30T22:30:03.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.763+0000 7f8e21f9b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c09a6b0 con 0x7f8e1c09d450 2023-09-30T22:30:03.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.763+0000 7f8e1b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e1c09d450 0x7f8e1c09d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:03.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.763+0000 7f8e1b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e1c09d450 0x7f8e1c09d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50372/0 (socket says 172.21.15.40:50372) 2023-09-30T22:30:03.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.763+0000 7f8e1b7fe700 1 -- 172.21.15.40:0/581813437 learned_addr learned my addr 172.21.15.40:0/581813437 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:03.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.763+0000 7f8e1affd700 1 --2- 172.21.15.40:0/581813437 >> v2:172.21.15.40:3300/0 conn(0x7f8e1c09dd60 0x7f8e1c067820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:03.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.764+0000 7f8e1affd700 1 -- 172.21.15.40:0/581813437 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e1c09d450 msgr2=0x7f8e1c09d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:03.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.764+0000 7f8e1affd700 1 --2- 172.21.15.40:0/581813437 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e1c09d450 0x7f8e1c09d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:03.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.764+0000 7f8e1affd700 1 -- 172.21.15.40:0/581813437 >> v1:172.21.15.40:6789/0 conn(0x7f8e1c1301c0 legacy=0x7f8e1c1305f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:03.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.764+0000 7f8e1affd700 1 -- 172.21.15.40:0/581813437 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1c09b4f0 con 0x7f8e1c09dd60 2023-09-30T22:30:03.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.764+0000 7f8e1affd700 1 --2- 172.21.15.40:0/581813437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e1c09dd60 0x7f8e1c067820 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f8e10009840 tx=0x7f8e10009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f00a5ca0b1a4a0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:03.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.764+0000 7f8e1a7fc700 1 -- 172.21.15.40:0/581813437 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e10011830 con 0x7f8e1c09dd60 2023-09-30T22:30:03.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.764+0000 7f8e1a7fc700 1 -- 172.21.15.40:0/581813437 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e10011990 con 0x7f8e1c09dd60 2023-09-30T22:30:03.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.764+0000 7f8e1a7fc700 1 -- 172.21.15.40:0/581813437 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e10011d20 con 0x7f8e1c09dd60 2023-09-30T22:30:03.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.765+0000 7f8e21f9b700 1 -- 172.21.15.40:0/581813437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e1c09dd60 msgr2=0x7f8e1c067820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:03.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.765+0000 7f8e21f9b700 1 --2- 172.21.15.40:0/581813437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e1c09dd60 0x7f8e1c067820 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f8e10009840 tx=0x7f8e10009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:03.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.765+0000 7f8e21f9b700 1 -- 172.21.15.40:0/581813437 shutdown_connections 2023-09-30T22:30:03.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.765+0000 7f8e21f9b700 1 --2- 172.21.15.40:0/581813437 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e1c09d450 0x7f8e1c09d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:03.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.765+0000 7f8e21f9b700 1 --2- 172.21.15.40:0/581813437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e1c09dd60 0x7f8e1c067820 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:03.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.765+0000 7f8e21f9b700 1 -- 172.21.15.40:0/581813437 >> 172.21.15.40:0/581813437 conn(0x7f8e1c0a2a00 msgr2=0x7f8e1c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:03.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.765+0000 7f8e21f9b700 1 -- 172.21.15.40:0/581813437 shutdown_connections 2023-09-30T22:30:03.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.765+0000 7f8e21f9b700 1 -- 172.21.15.40:0/581813437 wait complete. 2023-09-30T22:30:03.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.766+0000 7f8e21f9b700 1 Processor -- start 2023-09-30T22:30:03.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.766+0000 7f8e21f9b700 1 -- start start 2023-09-30T22:30:03.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.767+0000 7f8e21f9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e1c09d450 0x7f8e1c1365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:03.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.767+0000 7f8e21f9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e1c09dd60 0x7f8e1c136ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:03.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.767+0000 7f8e21f9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e1c1301c0 0x7f8e1c137020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:03.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.767+0000 7f8e21f9b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c1396e0 con 0x7f8e1c09dd60 2023-09-30T22:30:03.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.767+0000 7f8e21f9b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c13abc0 con 0x7f8e1c09d450 2023-09-30T22:30:03.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.767+0000 7f8e21f9b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c0a20f0 con 0x7f8e1c1301c0 2023-09-30T22:30:03.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.767+0000 7f8e1affd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e1c09dd60 0x7f8e1c136ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:03.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.767+0000 7f8e1affd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e1c09dd60 0x7f8e1c136ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37672/0 (socket says 172.21.15.40:37672) 2023-09-30T22:30:03.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.767+0000 7f8e1affd700 1 -- 172.21.15.40:0/4269525489 learned_addr learned my addr 172.21.15.40:0/4269525489 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:03.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.767+0000 7f8e1b7fe700 1 --2- 172.21.15.40:0/4269525489 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e1c09d450 0x7f8e1c1365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:03.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.767+0000 7f8e1affd700 1 -- 172.21.15.40:0/4269525489 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e1c1301c0 msgr2=0x7f8e1c137020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:03.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.767+0000 7f8e1affd700 1 --2- 172.21.15.40:0/4269525489 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e1c1301c0 0x7f8e1c137020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:03.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.767+0000 7f8e1affd700 1 -- 172.21.15.40:0/4269525489 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e1c09d450 msgr2=0x7f8e1c1365a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:03.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.767+0000 7f8e1affd700 1 --2- 172.21.15.40:0/4269525489 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e1c09d450 0x7f8e1c1365a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:03.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.767+0000 7f8e1affd700 1 -- 172.21.15.40:0/4269525489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e100094a0 con 0x7f8e1c09dd60 2023-09-30T22:30:03.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.767+0000 7f8e1affd700 1 --2- 172.21.15.40:0/4269525489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e1c09dd60 0x7f8e1c136ae0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f8e10009b90 tx=0x7f8e10004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:03.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.767+0000 7f8e03fff700 1 -- 172.21.15.40:0/4269525489 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e100036a0 con 0x7f8e1c09dd60 2023-09-30T22:30:03.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.768+0000 7f8e03fff700 1 -- 172.21.15.40:0/4269525489 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1001f070 con 0x7f8e1c09dd60 2023-09-30T22:30:03.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.768+0000 7f8e21f9b700 1 -- 172.21.15.40:0/4269525489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e1c139fe0 con 0x7f8e1c09dd60 2023-09-30T22:30:03.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.768+0000 7f8e03fff700 1 -- 172.21.15.40:0/4269525489 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e10003a00 con 0x7f8e1c09dd60 2023-09-30T22:30:03.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.768+0000 7f8e21f9b700 1 -- 172.21.15.40:0/4269525489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e1c139d00 con 0x7f8e1c09dd60 2023-09-30T22:30:03.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.769+0000 7f8e03fff700 1 -- 172.21.15.40:0/4269525489 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8e10003b60 con 0x7f8e1c09dd60 2023-09-30T22:30:03.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.769+0000 7f8e03fff700 1 -- 172.21.15.40:0/4269525489 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f8e10021070 con 0x7f8e1c09dd60 2023-09-30T22:30:03.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.769+0000 7f8e21f9b700 1 -- 172.21.15.40:0/4269525489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e1c1399a0 con 0x7f8e1c09dd60 2023-09-30T22:30:03.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.774+0000 7f8e03fff700 1 -- 172.21.15.40:0/4269525489 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e1c1399a0 con 0x7f8e1c09dd60 2023-09-30T22:30:03.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.798+0000 7fab91fe1700 1 Processor -- start 2023-09-30T22:30:03.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.799+0000 7fab91fe1700 1 -- start start 2023-09-30T22:30:03.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.799+0000 7fab91fe1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fab8c09c890 0x7fab8c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:03.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.799+0000 7fab91fe1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab8c09e480 0x7fab8c13bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:03.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.799+0000 7fab91fe1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab8c0a2600 con 0x7fab8c09d920 2023-09-30T22:30:03.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.799+0000 7fab91fe1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c0a29d0 con 0x7fab8c09e480 2023-09-30T22:30:03.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.799+0000 7fab91fe1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c09fb40 con 0x7fab8c09c890 2023-09-30T22:30:03.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.799+0000 7fab8bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab8c09e480 0x7fab8c13bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:03.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.799+0000 7fab8bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab8c09e480 0x7fab8c13bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50396/0 (socket says 172.21.15.40:50396) 2023-09-30T22:30:03.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.799+0000 7fab8bfff700 1 -- 172.21.15.40:0/4020630386 learned_addr learned my addr 172.21.15.40:0/4020630386 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:03.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.799+0000 7fab82ffd700 1 --1- 172.21.15.40:0/4020630386 >> v1:172.21.15.40:6789/0 conn(0x7fab8c09d920 0x7fab8c09dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47632/0 (socket says 172.21.15.40:47632) 2023-09-30T22:30:03.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.799+0000 7fab8affd700 1 -- 172.21.15.40:0/4020630386 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2130751143 0 0) 0x7fab8c0a2600 con 0x7fab8c09d920 2023-09-30T22:30:03.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.800+0000 7fab8affd700 1 -- 172.21.15.40:0/4020630386 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab780035b0 con 0x7fab8c09d920 2023-09-30T22:30:03.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.800+0000 7fab8bfff700 1 -- 172.21.15.40:0/4020630386 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fab8c09c890 msgr2=0x7fab8c09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:03.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.800+0000 7fab8bfff700 1 --2- 172.21.15.40:0/4020630386 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fab8c09c890 0x7fab8c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:03.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.800+0000 7fab8bfff700 1 -- 172.21.15.40:0/4020630386 >> v1:172.21.15.40:6789/0 conn(0x7fab8c09d920 legacy=0x7fab8c09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:03.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.800+0000 7fab8bfff700 1 -- 172.21.15.40:0/4020630386 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8c09fed0 con 0x7fab8c09e480 2023-09-30T22:30:03.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.800+0000 7fab8bfff700 1 --2- 172.21.15.40:0/4020630386 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab8c09e480 0x7fab8c13bc20 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fab84009e80 tx=0x7fab8400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a11ac769c5cb5370 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:03.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.800+0000 7fab8affd700 1 -- 172.21.15.40:0/4020630386 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8400e070 con 0x7fab8c09e480 2023-09-30T22:30:03.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.800+0000 7fab8affd700 1 -- 172.21.15.40:0/4020630386 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8400b910 con 0x7fab8c09e480 2023-09-30T22:30:03.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.800+0000 7fab8affd700 1 -- 172.21.15.40:0/4020630386 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8400bcc0 con 0x7fab8c09e480 2023-09-30T22:30:03.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.801+0000 7fab91fe1700 1 -- 172.21.15.40:0/4020630386 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab8c09e480 msgr2=0x7fab8c13bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:03.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.801+0000 7fab91fe1700 1 --2- 172.21.15.40:0/4020630386 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab8c09e480 0x7fab8c13bc20 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fab84009e80 tx=0x7fab8400b330 comp rx=0 tx=0).stop 2023-09-30T22:30:03.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.801+0000 7fab91fe1700 1 -- 172.21.15.40:0/4020630386 shutdown_connections 2023-09-30T22:30:03.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.801+0000 7fab91fe1700 1 --2- 172.21.15.40:0/4020630386 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab8c09e480 0x7fab8c13bc20 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:03.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.801+0000 7fab91fe1700 1 --2- 172.21.15.40:0/4020630386 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fab8c09c890 0x7fab8c09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:03.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.801+0000 7fab91fe1700 1 -- 172.21.15.40:0/4020630386 >> 172.21.15.40:0/4020630386 conn(0x7fab8c0a7080 msgr2=0x7fab8c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:03.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.801+0000 7fab91fe1700 1 -- 172.21.15.40:0/4020630386 shutdown_connections 2023-09-30T22:30:03.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.801+0000 7fab91fe1700 1 -- 172.21.15.40:0/4020630386 wait complete. 2023-09-30T22:30:03.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.802+0000 7fab91fe1700 1 Processor -- start 2023-09-30T22:30:03.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.802+0000 7fab91fe1700 1 -- start start 2023-09-30T22:30:03.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.802+0000 7fab91fe1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fab8c09c890 0x7fab8c12d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:03.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.802+0000 7fab91fe1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab8c09d920 0x7fab8c12d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:03.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.802+0000 7fab91fe1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab8c09e480 0x7fab8c12dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:03.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.802+0000 7fab91fe1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c12e600 con 0x7fab8c09d920 2023-09-30T22:30:03.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.802+0000 7fab91fe1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c09c210 con 0x7fab8c09e480 2023-09-30T22:30:03.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.802+0000 7fab91fe1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c12fbd0 con 0x7fab8c09c890 2023-09-30T22:30:03.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.803+0000 7fab8b7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fab8c09c890 0x7fab8c12d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:03.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.803+0000 7fab8b7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fab8c09c890 0x7fab8c12d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58126/0 (socket says 172.21.15.40:58126) 2023-09-30T22:30:03.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.803+0000 7fab8b7fe700 1 -- 172.21.15.40:0/2043188009 learned_addr learned my addr 172.21.15.40:0/2043188009 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:03.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.803+0000 7fab8bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab8c09e480 0x7fab8c12dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:03.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.803+0000 7fab82ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab8c09d920 0x7fab8c12d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:03.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.803+0000 7fab82ffd700 1 -- 172.21.15.40:0/2043188009 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fab8c09c890 msgr2=0x7fab8c12d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:03.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.803+0000 7fab82ffd700 1 --2- 172.21.15.40:0/2043188009 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fab8c09c890 0x7fab8c12d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:03.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.803+0000 7fab82ffd700 1 -- 172.21.15.40:0/2043188009 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab8c09e480 msgr2=0x7fab8c12dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:03.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.803+0000 7fab82ffd700 1 --2- 172.21.15.40:0/2043188009 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab8c09e480 0x7fab8c12dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:03.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.803+0000 7fab82ffd700 1 -- 172.21.15.40:0/2043188009 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab84009b30 con 0x7fab8c09d920 2023-09-30T22:30:03.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.803+0000 7fab8bfff700 1 --2- 172.21.15.40:0/2043188009 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab8c09e480 0x7fab8c12dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:03.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.803+0000 7fab82ffd700 1 --2- 172.21.15.40:0/2043188009 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab8c09d920 0x7fab8c12d670 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fab7400c460 tx=0x7fab7400c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:03.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.804+0000 7fab88ff9700 1 -- 172.21.15.40:0/2043188009 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab74005cb0 con 0x7fab8c09d920 2023-09-30T22:30:03.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.804+0000 7fab88ff9700 1 -- 172.21.15.40:0/2043188009 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab74005e10 con 0x7fab8c09d920 2023-09-30T22:30:03.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.804+0000 7fab91fe1700 1 -- 172.21.15.40:0/2043188009 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab8c1306b0 con 0x7fab8c09d920 2023-09-30T22:30:03.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.804+0000 7fab88ff9700 1 -- 172.21.15.40:0/2043188009 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab74007310 con 0x7fab8c09d920 2023-09-30T22:30:03.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.804+0000 7fab91fe1700 1 -- 172.21.15.40:0/2043188009 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab8c09ecf0 con 0x7fab8c09d920 2023-09-30T22:30:03.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.805+0000 7fab91fe1700 1 -- 172.21.15.40:0/2043188009 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab8c062380 con 0x7fab8c09d920 2023-09-30T22:30:03.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.805+0000 7fab88ff9700 1 -- 172.21.15.40:0/2043188009 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab74007470 con 0x7fab8c09d920 2023-09-30T22:30:03.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.805+0000 7fab88ff9700 1 -- 172.21.15.40:0/2043188009 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fab7403eb70 con 0x7fab8c09d920 2023-09-30T22:30:03.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.810+0000 7fab88ff9700 1 -- 172.21.15.40:0/2043188009 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab74007720 con 0x7fab8c09d920 2023-09-30T22:30:03.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.917+0000 7f0236c98700 1 -- 172.21.15.40:0/3744921927 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0230074330 con 0x7f023009d450 2023-09-30T22:30:03.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.918+0000 7f022d7fa700 1 -- 172.21.15.40:0/3744921927 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f022401b340 con 0x7f023009d450 2023-09-30T22:30:03.919 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:03.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.920+0000 7f0236c98700 1 -- 172.21.15.40:0/3744921927 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f023009d450 msgr2=0x7f0230132690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:03.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.920+0000 7f0236c98700 1 --2- 172.21.15.40:0/3744921927 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f023009d450 0x7f0230132690 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f02240011e0 tx=0x7f022400ca30 comp rx=0 tx=0).stop 2023-09-30T22:30:03.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.920+0000 7f0236c98700 1 -- 172.21.15.40:0/3744921927 shutdown_connections 2023-09-30T22:30:03.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.920+0000 7f0236c98700 1 --2- 172.21.15.40:0/3744921927 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f023009d450 0x7f0230132690 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:03.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.920+0000 7f0236c98700 1 --2- 172.21.15.40:0/3744921927 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0230135940 0x7f0230133110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:03.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.920+0000 7f0236c98700 1 --2- 172.21.15.40:0/3744921927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f023009df30 0x7f0230132bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:03.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.920+0000 7f0236c98700 1 -- 172.21.15.40:0/3744921927 >> 172.21.15.40:0/3744921927 conn(0x7f02300a2a00 msgr2=0x7f02301312b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:03.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.920+0000 7f0236c98700 1 -- 172.21.15.40:0/3744921927 shutdown_connections 2023-09-30T22:30:03.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.920+0000 7f0236c98700 1 -- 172.21.15.40:0/3744921927 wait complete. 2023-09-30T22:30:03.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.921+0000 7f8f50fc7700 1 -- 172.21.15.40:0/3130408548 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8f4c135e30 con 0x7f8f4c12d6d0 2023-09-30T22:30:03.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.922+0000 7f8f3affd700 1 -- 172.21.15.40:0/3130408548 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8f3c021020 con 0x7f8f4c12d6d0 2023-09-30T22:30:03.925 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:03.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.924+0000 7f8f50fc7700 1 -- 172.21.15.40:0/3130408548 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f4c12d6d0 msgr2=0x7f8f4c138ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:03.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.924+0000 7f8f50fc7700 1 --2- 172.21.15.40:0/3130408548 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f4c12d6d0 0x7f8f4c138ff0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00e990 tx=0x7f8f3c00eca0 comp rx=0 tx=0).stop 2023-09-30T22:30:03.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.924+0000 7f8f50fc7700 1 -- 172.21.15.40:0/3130408548 shutdown_connections 2023-09-30T22:30:03.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.924+0000 7f8f50fc7700 1 --2- 172.21.15.40:0/3130408548 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8f4c12eea0 0x7f8f4c137c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:03.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.924+0000 7f8f50fc7700 1 --2- 172.21.15.40:0/3130408548 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8f4c12d6d0 0x7f8f4c138ff0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:03.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.924+0000 7f8f50fc7700 1 --2- 172.21.15.40:0/3130408548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f4c12e590 0x7f8f4c1376d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:03.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.924+0000 7f8f50fc7700 1 -- 172.21.15.40:0/3130408548 >> 172.21.15.40:0/3130408548 conn(0x7f8f4c0a2a00 msgr2=0x7f8f4c130e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:03.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.924+0000 7f8f50fc7700 1 -- 172.21.15.40:0/3130408548 shutdown_connections 2023-09-30T22:30:03.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:03.924+0000 7f8f50fc7700 1 -- 172.21.15.40:0/3130408548 wait complete. 2023-09-30T22:30:03.939 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:03.941 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:04.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:04.007+0000 7fab91fe1700 1 -- 172.21.15.40:0/2043188009 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fab8c074620 con 0x7fab8c09d920 2023-09-30T22:30:04.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:04.007+0000 7fab88ff9700 1 -- 172.21.15.40:0/2043188009 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fab74017020 con 0x7fab8c09d920 2023-09-30T22:30:04.008 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:04.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:04.009+0000 7f8e21f9b700 1 -- 172.21.15.40:0/4269525489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8e1c1399a0 con 0x7f8e1c09dd60 2023-09-30T22:30:04.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:04.009+0000 7fab91fe1700 1 -- 172.21.15.40:0/2043188009 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab8c09d920 msgr2=0x7fab8c12d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:04.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:04.009+0000 7fab91fe1700 1 --2- 172.21.15.40:0/2043188009 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab8c09d920 0x7fab8c12d670 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fab7400c460 tx=0x7fab7400c770 comp rx=0 tx=0).stop 2023-09-30T22:30:04.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:04.009+0000 7f8e03fff700 1 -- 172.21.15.40:0/4269525489 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8e1c1399a0 con 0x7f8e1c09dd60 2023-09-30T22:30:04.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:04.009+0000 7fab91fe1700 1 -- 172.21.15.40:0/2043188009 shutdown_connections 2023-09-30T22:30:04.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:04.009+0000 7fab91fe1700 1 --2- 172.21.15.40:0/2043188009 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fab8c09c890 0x7fab8c12d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:04.009+0000 7fab91fe1700 1 --2- 172.21.15.40:0/2043188009 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab8c09e480 0x7fab8c12dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:04.009+0000 7fab91fe1700 1 --2- 172.21.15.40:0/2043188009 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab8c09d920 0x7fab8c12d670 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:04.009+0000 7fab91fe1700 1 -- 172.21.15.40:0/2043188009 >> 172.21.15.40:0/2043188009 conn(0x7fab8c0a7080 msgr2=0x7fab8c0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:04.011 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:04.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:04.009+0000 7fab91fe1700 1 -- 172.21.15.40:0/2043188009 shutdown_connections 2023-09-30T22:30:04.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:04.009+0000 7fab91fe1700 1 -- 172.21.15.40:0/2043188009 wait complete. 2023-09-30T22:30:04.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:04.012+0000 7f8e21f9b700 1 -- 172.21.15.40:0/4269525489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e1c09dd60 msgr2=0x7f8e1c136ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:04.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:04.012+0000 7f8e21f9b700 1 --2- 172.21.15.40:0/4269525489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e1c09dd60 0x7f8e1c136ae0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f8e10009b90 tx=0x7f8e10004750 comp rx=0 tx=0).stop 2023-09-30T22:30:04.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:04.012+0000 7f8e21f9b700 1 -- 172.21.15.40:0/4269525489 shutdown_connections 2023-09-30T22:30:04.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:04.012+0000 7f8e21f9b700 1 --2- 172.21.15.40:0/4269525489 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e1c1301c0 0x7f8e1c137020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:04.012+0000 7f8e21f9b700 1 --2- 172.21.15.40:0/4269525489 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e1c09d450 0x7f8e1c1365a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:04.012+0000 7f8e21f9b700 1 --2- 172.21.15.40:0/4269525489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e1c09dd60 0x7f8e1c136ae0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:04.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:04.012+0000 7f8e21f9b700 1 -- 172.21.15.40:0/4269525489 >> 172.21.15.40:0/4269525489 conn(0x7f8e1c0a2a00 msgr2=0x7f8e1c0a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:04.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:04.012+0000 7f8e21f9b700 1 -- 172.21.15.40:0/4269525489 shutdown_connections 2023-09-30T22:30:04.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:04.012+0000 7f8e21f9b700 1 -- 172.21.15.40:0/4269525489 wait complete. 2023-09-30T22:30:04.024 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:04.025 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:04.939 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:04.942 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:05.025 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:05.027 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:05.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.090+0000 7fd0c3779700 1 Processor -- start 2023-09-30T22:30:05.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.091+0000 7fd0c3779700 1 -- start start 2023-09-30T22:30:05.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.091+0000 7fd0c3779700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd0bc09d920 0x7fd0bc09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.091+0000 7fd0c3779700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd0bc09e230 0x7fd0bc1308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.091+0000 7fd0c3779700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0bc130de0 0x7fd0bc131240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.091+0000 7fd0c3779700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0bc09edf0 con 0x7fd0bc09d920 2023-09-30T22:30:05.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.091+0000 7fd0c3779700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc09adf0 con 0x7fd0bc130de0 2023-09-30T22:30:05.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.091+0000 7fd0c3779700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc09b660 con 0x7fd0bc09e230 2023-09-30T22:30:05.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.091+0000 7fd0c0d14700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd0bc09e230 0x7fd0bc1308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.091+0000 7fd0c1d16700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0bc130de0 0x7fd0bc131240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.091+0000 7fd0c1d16700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0bc130de0 0x7fd0bc131240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50418/0 (socket says 172.21.15.40:50418) 2023-09-30T22:30:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.091+0000 7fd0c0d14700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd0bc09e230 0x7fd0bc1308a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58140/0 (socket says 172.21.15.40:58140) 2023-09-30T22:30:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.091+0000 7fd0c1d16700 1 -- 172.21.15.40:0/3093556737 learned_addr learned my addr 172.21.15.40:0/3093556737 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.092+0000 7fd0c1515700 1 --2- 172.21.15.40:0/3093556737 >> v2:172.21.15.40:3300/0 conn(0x7fd0bc09d920 0x7fd0bc09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.092+0000 7fd0c1d16700 1 -- 172.21.15.40:0/3093556737 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd0bc09e230 msgr2=0x7fd0bc1308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.092+0000 7fd0c1d16700 1 --2- 172.21.15.40:0/3093556737 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd0bc09e230 0x7fd0bc1308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.092+0000 7fd0c1d16700 1 -- 172.21.15.40:0/3093556737 >> v2:172.21.15.40:3300/0 conn(0x7fd0bc09d920 msgr2=0x7fd0bc09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.092+0000 7fd0c1d16700 1 --2- 172.21.15.40:0/3093556737 >> v2:172.21.15.40:3300/0 conn(0x7fd0bc09d920 0x7fd0bc09dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.092+0000 7fd0c1d16700 1 -- 172.21.15.40:0/3093556737 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0bc09a6e0 con 0x7fd0bc130de0 2023-09-30T22:30:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.092+0000 7fd0c1515700 1 --2- 172.21.15.40:0/3093556737 >> v2:172.21.15.40:3300/0 conn(0x7fd0bc09d920 0x7fd0bc09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.092+0000 7fd0c1d16700 1 --2- 172.21.15.40:0/3093556737 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0bc130de0 0x7fd0bc131240 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4009480 tx=0x7fd0b400f5c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5928f849bd1a4f3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:05.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.092+0000 7fd0b3fff700 1 -- 172.21.15.40:0/3093556737 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b4012070 con 0x7fd0bc130de0 2023-09-30T22:30:05.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.092+0000 7fd0b3fff700 1 -- 172.21.15.40:0/3093556737 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b4016430 con 0x7fd0bc130de0 2023-09-30T22:30:05.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.092+0000 7fd0b3fff700 1 -- 172.21.15.40:0/3093556737 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b40167c0 con 0x7fd0bc130de0 2023-09-30T22:30:05.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.093+0000 7fd0c3779700 1 -- 172.21.15.40:0/3093556737 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0bc130de0 msgr2=0x7fd0bc131240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.093+0000 7fd0c3779700 1 --2- 172.21.15.40:0/3093556737 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0bc130de0 0x7fd0bc131240 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4009480 tx=0x7fd0b400f5c0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.093+0000 7fd0c3779700 1 -- 172.21.15.40:0/3093556737 shutdown_connections 2023-09-30T22:30:05.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.093+0000 7fd0c3779700 1 --2- 172.21.15.40:0/3093556737 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0bc130de0 0x7fd0bc131240 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.093+0000 7fd0c3779700 1 --2- 172.21.15.40:0/3093556737 >> v2:172.21.15.40:3300/0 conn(0x7fd0bc09d920 0x7fd0bc09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.093+0000 7fd0c3779700 1 --2- 172.21.15.40:0/3093556737 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd0bc09e230 0x7fd0bc1308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.093+0000 7fd0c3779700 1 -- 172.21.15.40:0/3093556737 >> 172.21.15.40:0/3093556737 conn(0x7fd0bc09fb20 msgr2=0x7fd0bc09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:05.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.094+0000 7fd0c3779700 1 -- 172.21.15.40:0/3093556737 shutdown_connections 2023-09-30T22:30:05.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.094+0000 7fd0c3779700 1 -- 172.21.15.40:0/3093556737 wait complete. 2023-09-30T22:30:05.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.095+0000 7fd0c3779700 1 Processor -- start 2023-09-30T22:30:05.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.095+0000 7fd0c3779700 1 -- start start 2023-09-30T22:30:05.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.095+0000 7fd0c3779700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0bc09d920 0x7fd0bc1c4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.095+0000 7fd0c3779700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd0bc09e230 0x7fd0bc1c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.095+0000 7fd0c3779700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0bc130de0 0x7fd0bc1c08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.095+0000 7fd0c3779700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc11d8b0 con 0x7fd0bc09d920 2023-09-30T22:30:05.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.095+0000 7fd0c3779700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc11dc90 con 0x7fd0bc130de0 2023-09-30T22:30:05.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.095+0000 7fd0c3779700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc11e3d0 con 0x7fd0bc09e230 2023-09-30T22:30:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.095+0000 7fd0c0d14700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd0bc09e230 0x7fd0bc1c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.095+0000 7fd0c0d14700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd0bc09e230 0x7fd0bc1c49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58144/0 (socket says 172.21.15.40:58144) 2023-09-30T22:30:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.095+0000 7fd0c0d14700 1 -- 172.21.15.40:0/3554989183 learned_addr learned my addr 172.21.15.40:0/3554989183 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.096+0000 7fd0c1515700 1 --2- 172.21.15.40:0/3554989183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0bc09d920 0x7fd0bc1c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.096+0000 7fd0c0d14700 1 -- 172.21.15.40:0/3554989183 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0bc130de0 msgr2=0x7fd0bc1c08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.096+0000 7fd0c1d16700 1 --2- 172.21.15.40:0/3554989183 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0bc130de0 0x7fd0bc1c08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.096+0000 7fd0c0d14700 1 --2- 172.21.15.40:0/3554989183 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0bc130de0 0x7fd0bc1c08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.096+0000 7fd0c0d14700 1 -- 172.21.15.40:0/3554989183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0bc09d920 msgr2=0x7fd0bc1c4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.096+0000 7fd0c0d14700 1 --2- 172.21.15.40:0/3554989183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0bc09d920 0x7fd0bc1c4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.096+0000 7fd0c0d14700 1 -- 172.21.15.40:0/3554989183 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b8009430 con 0x7fd0bc09e230 2023-09-30T22:30:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.096+0000 7fd0c1515700 1 --2- 172.21.15.40:0/3554989183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0bc09d920 0x7fd0bc1c4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.096+0000 7fd0c1d16700 1 --2- 172.21.15.40:0/3554989183 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0bc130de0 0x7fd0bc1c08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:30:05.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.096+0000 7fd0c0d14700 1 --2- 172.21.15.40:0/3554989183 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd0bc09e230 0x7fd0bc1c49b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac00e810 tx=0x7fd0ac00ebd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:05.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.096+0000 7fd0b1ffb700 1 -- 172.21.15.40:0/3554989183 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac013610 con 0x7fd0bc09e230 2023-09-30T22:30:05.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.096+0000 7fd0b1ffb700 1 -- 172.21.15.40:0/3554989183 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0ac013770 con 0x7fd0bc09e230 2023-09-30T22:30:05.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.096+0000 7fd0c3779700 1 -- 172.21.15.40:0/3554989183 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b400f050 con 0x7fd0bc09e230 2023-09-30T22:30:05.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.096+0000 7fd0b1ffb700 1 -- 172.21.15.40:0/3554989183 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac013b20 con 0x7fd0bc09e230 2023-09-30T22:30:05.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.096+0000 7fd0c3779700 1 -- 172.21.15.40:0/3554989183 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0bc11ca60 con 0x7fd0bc09e230 2023-09-30T22:30:05.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.097+0000 7fd0b1ffb700 1 -- 172.21.15.40:0/3554989183 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd0ac013c80 con 0x7fd0bc09e230 2023-09-30T22:30:05.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.097+0000 7fd0b1ffb700 1 -- 172.21.15.40:0/3554989183 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd0ac03f460 con 0x7fd0bc09e230 2023-09-30T22:30:05.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.099+0000 7fd0c3779700 1 -- 172.21.15.40:0/3554989183 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0bc11cc20 con 0x7fd0bc09e230 2023-09-30T22:30:05.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.099+0000 7f2c6a766700 1 Processor -- start 2023-09-30T22:30:05.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.099+0000 7f2c6a766700 1 -- start start 2023-09-30T22:30:05.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.100+0000 7f2c6a766700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c6409f0f0 0x7f2c64138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.100+0000 7f2c6a766700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2c6409e400 0x7f2c6413b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.100+0000 7f2c6a766700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c6409f940 con 0x7f2c6409d920 2023-09-30T22:30:05.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.100+0000 7f2c6a766700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c6406b4c0 con 0x7f2c6409e400 2023-09-30T22:30:05.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.100+0000 7f2c6a766700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6409a8f0 con 0x7f2c6409f0f0 2023-09-30T22:30:05.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.100+0000 7f2c63fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2c6409d920 0x7f2c6409dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47644/0 (socket says 172.21.15.40:47644) 2023-09-30T22:30:05.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.100+0000 7f2c63fff700 1 -- 172.21.15.40:0/1026967782 learned_addr learned my addr 172.21.15.40:0/1026967782 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:05.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.100+0000 7f2c68d03700 1 --2- 172.21.15.40:0/1026967782 >> v2:172.21.15.40:3300/0 conn(0x7f2c6409e400 0x7f2c6413b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.100+0000 7f2c62ffd700 1 -- 172.21.15.40:0/1026967782 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4112414167 0 0) 0x7f2c6409f940 con 0x7f2c6409d920 2023-09-30T22:30:05.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.100+0000 7f2c62ffd700 1 -- 172.21.15.40:0/1026967782 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c4c0035b0 con 0x7f2c6409d920 2023-09-30T22:30:05.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.100+0000 7f2c68d03700 1 -- 172.21.15.40:0/1026967782 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c6409f0f0 msgr2=0x7f2c64138ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:05.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.100+0000 7f2c68d03700 1 --2- 172.21.15.40:0/1026967782 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c6409f0f0 0x7f2c64138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.100+0000 7f2c68d03700 1 -- 172.21.15.40:0/1026967782 >> v1:172.21.15.40:6789/0 conn(0x7f2c6409d920 legacy=0x7f2c6409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.100+0000 7f2c68d03700 1 -- 172.21.15.40:0/1026967782 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6409f6e0 con 0x7f2c6409e400 2023-09-30T22:30:05.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.101+0000 7f2c68d03700 1 --2- 172.21.15.40:0/1026967782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c6409e400 0x7f2c6413b430 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c009dc0 tx=0x7f2c5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0982f4a2c34733 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:05.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.101+0000 7f2c62ffd700 1 -- 172.21.15.40:0/1026967782 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c00e070 con 0x7f2c6409e400 2023-09-30T22:30:05.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.101+0000 7f2c62ffd700 1 -- 172.21.15.40:0/1026967782 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c5c00bae0 con 0x7f2c6409e400 2023-09-30T22:30:05.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.101+0000 7f2c62ffd700 1 -- 172.21.15.40:0/1026967782 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c00be50 con 0x7f2c6409e400 2023-09-30T22:30:05.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.102+0000 7f2c6a766700 1 -- 172.21.15.40:0/1026967782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c6409e400 msgr2=0x7f2c6413b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.102+0000 7f2c6a766700 1 --2- 172.21.15.40:0/1026967782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c6409e400 0x7f2c6413b430 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c009dc0 tx=0x7f2c5c00b330 comp rx=0 tx=0).stop 2023-09-30T22:30:05.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.102+0000 7f2c6a766700 1 -- 172.21.15.40:0/1026967782 shutdown_connections 2023-09-30T22:30:05.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.102+0000 7f2c6a766700 1 --2- 172.21.15.40:0/1026967782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c6409e400 0x7f2c6413b430 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.102+0000 7f2c6a766700 1 --2- 172.21.15.40:0/1026967782 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c6409f0f0 0x7f2c64138ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.102+0000 7f2c6a766700 1 -- 172.21.15.40:0/1026967782 >> 172.21.15.40:0/1026967782 conn(0x7f2c6409fb20 msgr2=0x7f2c6409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:05.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.102+0000 7f2c6a766700 1 -- 172.21.15.40:0/1026967782 shutdown_connections 2023-09-30T22:30:05.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.102+0000 7f2c6a766700 1 -- 172.21.15.40:0/1026967782 wait complete. 2023-09-30T22:30:05.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.103+0000 7f2c6a766700 1 Processor -- start 2023-09-30T22:30:05.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.103+0000 7f2c6a766700 1 -- start start 2023-09-30T22:30:05.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.103+0000 7f2c6a766700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c6409d920 0x7f2c6411db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.103+0000 7f2c6a766700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c6409e400 0x7f2c6411e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.104+0000 7f2c63fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c6409d920 0x7f2c6411db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.104+0000 7f2c63fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c6409d920 0x7f2c6411db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58156/0 (socket says 172.21.15.40:58156) 2023-09-30T22:30:05.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.104+0000 7f2c6a766700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c6413a400 0x7f2c6411e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.104+0000 7f2c6a766700 1 -- 172.21.15.40:0/624526909 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c64120150 con 0x7f2c6409e400 2023-09-30T22:30:05.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.104+0000 7f2c6a766700 1 -- 172.21.15.40:0/624526909 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c64134990 con 0x7f2c6413a400 2023-09-30T22:30:05.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.104+0000 7f2c63fff700 1 -- 172.21.15.40:0/624526909 learned_addr learned my addr 172.21.15.40:0/624526909 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:05.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.104+0000 7f2c6a766700 1 -- 172.21.15.40:0/624526909 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6413b5b0 con 0x7f2c6409d920 2023-09-30T22:30:05.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.104+0000 7f2c637fe700 1 --2- 172.21.15.40:0/624526909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c6409e400 0x7f2c6411e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.104+0000 7f2c68d03700 1 --2- 172.21.15.40:0/624526909 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c6413a400 0x7f2c6411e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.104+0000 7f2c637fe700 1 -- 172.21.15.40:0/624526909 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c6409d920 msgr2=0x7f2c6411db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.104+0000 7f2c637fe700 1 --2- 172.21.15.40:0/624526909 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c6409d920 0x7f2c6411db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.104+0000 7f2c637fe700 1 -- 172.21.15.40:0/624526909 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c6413a400 msgr2=0x7f2c6411e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.104+0000 7f2c637fe700 1 --2- 172.21.15.40:0/624526909 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c6413a400 0x7f2c6411e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.104+0000 7f2c637fe700 1 -- 172.21.15.40:0/624526909 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c5c009a70 con 0x7f2c6409e400 2023-09-30T22:30:05.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.104+0000 7f2c68d03700 1 --2- 172.21.15.40:0/624526909 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c6413a400 0x7f2c6411e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:05.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.104+0000 7f2c637fe700 1 --2- 172.21.15.40:0/624526909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c6409e400 0x7f2c6411e080 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f2c5800b450 tx=0x7f2c5800b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:05.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.104+0000 7f2c60ff9700 1 -- 172.21.15.40:0/624526909 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c58011830 con 0x7f2c6409e400 2023-09-30T22:30:05.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.105+0000 7f2c60ff9700 1 -- 172.21.15.40:0/624526909 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c58011990 con 0x7f2c6409e400 2023-09-30T22:30:05.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.105+0000 7f2c60ff9700 1 -- 172.21.15.40:0/624526909 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c58011d40 con 0x7f2c6409e400 2023-09-30T22:30:05.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.105+0000 7f2c6a766700 1 -- 172.21.15.40:0/624526909 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c640a3040 con 0x7f2c6409e400 2023-09-30T22:30:05.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.105+0000 7f2c6a766700 1 -- 172.21.15.40:0/624526909 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c6411fbb0 con 0x7f2c6409e400 2023-09-30T22:30:05.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.106+0000 7f2c60ff9700 1 -- 172.21.15.40:0/624526909 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2c5801a400 con 0x7f2c6409e400 2023-09-30T22:30:05.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.106+0000 7f2c60ff9700 1 -- 172.21.15.40:0/624526909 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f2c5803f780 con 0x7f2c6409e400 2023-09-30T22:30:05.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.108+0000 7fd0b1ffb700 1 -- 172.21.15.40:0/3554989183 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd0ac012370 con 0x7fd0bc09e230 2023-09-30T22:30:05.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.109+0000 7f2c6a766700 1 -- 172.21.15.40:0/624526909 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c6411ff80 con 0x7f2c6409e400 2023-09-30T22:30:05.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.120+0000 7f2c60ff9700 1 -- 172.21.15.40:0/624526909 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2c58009280 con 0x7f2c6409e400 2023-09-30T22:30:05.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.171+0000 7f7279f66700 1 Processor -- start 2023-09-30T22:30:05.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.171+0000 7f7279f66700 1 -- start start 2023-09-30T22:30:05.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.171+0000 7f7279f66700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f727409c890 0x7f727409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.171+0000 7f7279f66700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f727409e480 0x7f727413bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.171+0000 7f7279f66700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72740a2600 con 0x7f727409d920 2023-09-30T22:30:05.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.171+0000 7f7279f66700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72740a29d0 con 0x7f727409c890 2023-09-30T22:30:05.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.171+0000 7f7279f66700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f727409fb40 con 0x7f727409e480 2023-09-30T22:30:05.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.171+0000 7f72737fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f727409c890 0x7f727409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.171+0000 7f72737fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f727409c890 0x7f727409cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37746/0 (socket says 172.21.15.40:37746) 2023-09-30T22:30:05.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.172+0000 7f72737fe700 1 -- 172.21.15.40:0/1741402200 learned_addr learned my addr 172.21.15.40:0/1741402200 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:05.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.172+0000 7f7273fff700 1 --2- 172.21.15.40:0/1741402200 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f727409e480 0x7f727413bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.172+0000 7f7273fff700 1 -- 172.21.15.40:0/1741402200 >> v2:172.21.15.40:3300/0 conn(0x7f727409c890 msgr2=0x7f727409cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:05.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.172+0000 7f7273fff700 1 --2- 172.21.15.40:0/1741402200 >> v2:172.21.15.40:3300/0 conn(0x7f727409c890 0x7f727409cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.172+0000 7f7273fff700 1 -- 172.21.15.40:0/1741402200 >> v1:172.21.15.40:6789/0 conn(0x7f727409d920 legacy=0x7f727409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.172+0000 7f7273fff700 1 -- 172.21.15.40:0/1741402200 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f727409fed0 con 0x7f727409e480 2023-09-30T22:30:05.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.172+0000 7f7273fff700 1 --2- 172.21.15.40:0/1741402200 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f727409e480 0x7f727413bc20 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f726c009d90 tx=0x7f726c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=760aab6614cc7ecf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:05.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.172+0000 7f72727fc700 1 -- 172.21.15.40:0/1741402200 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c00e070 con 0x7f727409e480 2023-09-30T22:30:05.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.172+0000 7f72727fc700 1 -- 172.21.15.40:0/1741402200 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726c00bb20 con 0x7f727409e480 2023-09-30T22:30:05.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.172+0000 7f72727fc700 1 -- 172.21.15.40:0/1741402200 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c012430 con 0x7f727409e480 2023-09-30T22:30:05.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.173+0000 7f7279f66700 1 -- 172.21.15.40:0/1741402200 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f727409e480 msgr2=0x7f727413bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.173+0000 7f7279f66700 1 --2- 172.21.15.40:0/1741402200 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f727409e480 0x7f727413bc20 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f726c009d90 tx=0x7f726c00b330 comp rx=0 tx=0).stop 2023-09-30T22:30:05.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.173+0000 7f7279f66700 1 -- 172.21.15.40:0/1741402200 shutdown_connections 2023-09-30T22:30:05.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.173+0000 7f7279f66700 1 --2- 172.21.15.40:0/1741402200 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f727409e480 0x7f727413bc20 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.173+0000 7f7279f66700 1 --2- 172.21.15.40:0/1741402200 >> v2:172.21.15.40:3300/0 conn(0x7f727409c890 0x7f727409cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.173+0000 7f7279f66700 1 -- 172.21.15.40:0/1741402200 >> 172.21.15.40:0/1741402200 conn(0x7f72740a7080 msgr2=0x7f72740a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:05.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.173+0000 7f7279f66700 1 -- 172.21.15.40:0/1741402200 shutdown_connections 2023-09-30T22:30:05.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.173+0000 7f7279f66700 1 -- 172.21.15.40:0/1741402200 wait complete. 2023-09-30T22:30:05.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.174+0000 7f7279f66700 1 Processor -- start 2023-09-30T22:30:05.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.174+0000 7f7279f66700 1 -- start start 2023-09-30T22:30:05.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.175+0000 7f7279f66700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f727409c890 0x7f72741c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.175+0000 7f7279f66700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f727409d920 0x7f72741c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.175+0000 7f7279f66700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f727409e480 0x7f727412d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.175+0000 7f7279f66700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72741313c0 con 0x7f727409e480 2023-09-30T22:30:05.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.175+0000 7f7279f66700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7274130500 con 0x7f727409d920 2023-09-30T22:30:05.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.175+0000 7f7279f66700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7274130820 con 0x7f727409c890 2023-09-30T22:30:05.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.175+0000 7f7273fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f727409e480 0x7f727412d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.175+0000 7f7273fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f727409e480 0x7f727412d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37762/0 (socket says 172.21.15.40:37762) 2023-09-30T22:30:05.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.175+0000 7f7273fff700 1 -- 172.21.15.40:0/242456140 learned_addr learned my addr 172.21.15.40:0/242456140 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:05.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.175+0000 7f7272ffd700 1 --2- 172.21.15.40:0/242456140 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f727409d920 0x7f72741c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.175+0000 7f72737fe700 1 --2- 172.21.15.40:0/242456140 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f727409c890 0x7f72741c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.175+0000 7f7273fff700 1 -- 172.21.15.40:0/242456140 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f727409c890 msgr2=0x7f72741c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.175+0000 7f7273fff700 1 --2- 172.21.15.40:0/242456140 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f727409c890 0x7f72741c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.175+0000 7f7273fff700 1 -- 172.21.15.40:0/242456140 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f727409d920 msgr2=0x7f72741c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.175+0000 7f7273fff700 1 --2- 172.21.15.40:0/242456140 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f727409d920 0x7f72741c9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.175+0000 7f7273fff700 1 -- 172.21.15.40:0/242456140 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726c009a70 con 0x7f727409e480 2023-09-30T22:30:05.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.175+0000 7f7273fff700 1 --2- 172.21.15.40:0/242456140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f727409e480 0x7f727412d340 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f726c014040 tx=0x7f726c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:05.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.176+0000 7f725bfff700 1 -- 172.21.15.40:0/242456140 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c026070 con 0x7f727409e480 2023-09-30T22:30:05.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.176+0000 7f725bfff700 1 -- 172.21.15.40:0/242456140 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726c009860 con 0x7f727409e480 2023-09-30T22:30:05.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.176+0000 7f7279f66700 1 -- 172.21.15.40:0/242456140 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72740a5c50 con 0x7f727409e480 2023-09-30T22:30:05.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.176+0000 7f725bfff700 1 -- 172.21.15.40:0/242456140 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c012430 con 0x7f727409e480 2023-09-30T22:30:05.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.176+0000 7f7279f66700 1 -- 172.21.15.40:0/242456140 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7274130dc0 con 0x7f727409e480 2023-09-30T22:30:05.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.177+0000 7f725bfff700 1 -- 172.21.15.40:0/242456140 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f726c02a070 con 0x7f727409e480 2023-09-30T22:30:05.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.177+0000 7f725bfff700 1 -- 172.21.15.40:0/242456140 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f726c048a70 con 0x7f727409e480 2023-09-30T22:30:05.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.177+0000 7f7279f66700 1 -- 172.21.15.40:0/242456140 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f727404f2a0 con 0x7f727409e480 2023-09-30T22:30:05.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.182+0000 7f725bfff700 1 -- 172.21.15.40:0/242456140 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f726c033720 con 0x7f727409e480 2023-09-30T22:30:05.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.205+0000 7f3bd3490700 1 Processor -- start 2023-09-30T22:30:05.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.206+0000 7f3bd3490700 1 -- start start 2023-09-30T22:30:05.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.206+0000 7f3bd3490700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3bcc09c890 0x7f3bcc09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.206+0000 7f3bd3490700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3bcc09d920 0x7f3bcc09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.206+0000 7f3bd3490700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bcc09e2b0 0x7f3bcc13ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.206+0000 7f3bd3490700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bcc0a29d0 con 0x7f3bcc09c890 2023-09-30T22:30:05.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.206+0000 7f3bd3490700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc09fb40 con 0x7f3bcc09e2b0 2023-09-30T22:30:05.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.206+0000 7f3bd3490700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc0a2600 con 0x7f3bcc09d920 2023-09-30T22:30:05.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.207+0000 7f3bd122c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3bcc09c890 0x7f3bcc09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.207+0000 7f3bd1a2d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bcc09e2b0 0x7f3bcc13ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.207+0000 7f3bd122c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3bcc09c890 0x7f3bcc09cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37764/0 (socket says 172.21.15.40:37764) 2023-09-30T22:30:05.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.207+0000 7f3bd122c700 1 -- 172.21.15.40:0/401300805 learned_addr learned my addr 172.21.15.40:0/401300805 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:05.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.207+0000 7f3bd0a2b700 1 --2- 172.21.15.40:0/401300805 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3bcc09d920 0x7f3bcc09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.207+0000 7f3bd1a2d700 1 -- 172.21.15.40:0/401300805 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3bcc09d920 msgr2=0x7f3bcc09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:05.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.207+0000 7f3bd1a2d700 1 --2- 172.21.15.40:0/401300805 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3bcc09d920 0x7f3bcc09dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.207+0000 7f3bd1a2d700 1 -- 172.21.15.40:0/401300805 >> v2:172.21.15.40:3300/0 conn(0x7f3bcc09c890 msgr2=0x7f3bcc09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:05.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.207+0000 7f3bd1a2d700 1 --2- 172.21.15.40:0/401300805 >> v2:172.21.15.40:3300/0 conn(0x7f3bcc09c890 0x7f3bcc09cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.207+0000 7f3bd1a2d700 1 -- 172.21.15.40:0/401300805 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bcc09fed0 con 0x7f3bcc09e2b0 2023-09-30T22:30:05.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.207+0000 7f3bd122c700 1 --2- 172.21.15.40:0/401300805 >> v2:172.21.15.40:3300/0 conn(0x7f3bcc09c890 0x7f3bcc09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:05.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.207+0000 7f3bd1a2d700 1 --2- 172.21.15.40:0/401300805 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bcc09e2b0 0x7f3bcc13ac10 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4009d90 tx=0x7f3bc400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36ce812b83cd203 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:05.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.207+0000 7f3bc3fff700 1 -- 172.21.15.40:0/401300805 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc400e070 con 0x7f3bcc09e2b0 2023-09-30T22:30:05.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.207+0000 7f3bc3fff700 1 -- 172.21.15.40:0/401300805 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc400bb20 con 0x7f3bcc09e2b0 2023-09-30T22:30:05.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.207+0000 7f3bc3fff700 1 -- 172.21.15.40:0/401300805 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4012430 con 0x7f3bcc09e2b0 2023-09-30T22:30:05.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.208+0000 7f3bd3490700 1 -- 172.21.15.40:0/401300805 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bcc09e2b0 msgr2=0x7f3bcc13ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.208+0000 7f3bd3490700 1 --2- 172.21.15.40:0/401300805 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bcc09e2b0 0x7f3bcc13ac10 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4009d90 tx=0x7f3bc400b330 comp rx=0 tx=0).stop 2023-09-30T22:30:05.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.208+0000 7f3bd3490700 1 -- 172.21.15.40:0/401300805 shutdown_connections 2023-09-30T22:30:05.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.208+0000 7f3bd3490700 1 --2- 172.21.15.40:0/401300805 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bcc09e2b0 0x7f3bcc13ac10 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.208+0000 7f3bd3490700 1 --2- 172.21.15.40:0/401300805 >> v2:172.21.15.40:3300/0 conn(0x7f3bcc09c890 0x7f3bcc09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.208+0000 7f3bd3490700 1 --2- 172.21.15.40:0/401300805 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3bcc09d920 0x7f3bcc09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.208+0000 7f3bd3490700 1 -- 172.21.15.40:0/401300805 >> 172.21.15.40:0/401300805 conn(0x7f3bcc0a7080 msgr2=0x7f3bcc0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:05.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.208+0000 7f3bd3490700 1 -- 172.21.15.40:0/401300805 shutdown_connections 2023-09-30T22:30:05.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.208+0000 7f3bd3490700 1 -- 172.21.15.40:0/401300805 wait complete. 2023-09-30T22:30:05.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.210+0000 7f3bd3490700 1 Processor -- start 2023-09-30T22:30:05.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.210+0000 7f3bd3490700 1 -- start start 2023-09-30T22:30:05.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.210+0000 7f3bd3490700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bcc09c890 0x7f3bcc12d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.210+0000 7f3bd3490700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bcc09d920 0x7f3bcc12d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.210+0000 7f3bd3490700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3bcc09e2b0 0x7f3bcc12de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:05.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.210+0000 7f3bd3490700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc09c2a0 con 0x7f3bcc09c890 2023-09-30T22:30:05.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.210+0000 7f3bd3490700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc130720 con 0x7f3bcc09d920 2023-09-30T22:30:05.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.210+0000 7f3bd3490700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc12fc40 con 0x7f3bcc09e2b0 2023-09-30T22:30:05.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.211+0000 7f3bd122c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bcc09c890 0x7f3bcc12d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.211+0000 7f3bd1a2d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3bcc09e2b0 0x7f3bcc12de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.211+0000 7f3bd122c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bcc09c890 0x7f3bcc12d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37774/0 (socket says 172.21.15.40:37774) 2023-09-30T22:30:05.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.211+0000 7f3bd122c700 1 -- 172.21.15.40:0/555561110 learned_addr learned my addr 172.21.15.40:0/555561110 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:05.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.211+0000 7f3bd1a2d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3bcc09e2b0 0x7f3bcc12de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58192/0 (socket says 172.21.15.40:58192) 2023-09-30T22:30:05.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.211+0000 7f3bd0a2b700 1 --2- 172.21.15.40:0/555561110 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bcc09d920 0x7f3bcc12d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:05.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.211+0000 7f3bd1a2d700 1 -- 172.21.15.40:0/555561110 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bcc09d920 msgr2=0x7f3bcc12d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.211+0000 7f3bd1a2d700 1 --2- 172.21.15.40:0/555561110 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bcc09d920 0x7f3bcc12d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.211+0000 7f3bd1a2d700 1 -- 172.21.15.40:0/555561110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bcc09c890 msgr2=0x7f3bcc12d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.211+0000 7f3bd1a2d700 1 --2- 172.21.15.40:0/555561110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bcc09c890 0x7f3bcc12d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.211+0000 7f3bd1a2d700 1 -- 172.21.15.40:0/555561110 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc8009500 con 0x7f3bcc09e2b0 2023-09-30T22:30:05.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.211+0000 7f3bd122c700 1 --2- 172.21.15.40:0/555561110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bcc09c890 0x7f3bcc12d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:05.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.211+0000 7f3bd0a2b700 1 --2- 172.21.15.40:0/555561110 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bcc09d920 0x7f3bcc12d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:05.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.211+0000 7f3bd1a2d700 1 --2- 172.21.15.40:0/555561110 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3bcc09e2b0 0x7f3bcc12de90 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4016000 tx=0x7f3bc4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:05.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.211+0000 7f3bc1ffb700 1 -- 172.21.15.40:0/555561110 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4012430 con 0x7f3bcc09e2b0 2023-09-30T22:30:05.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.211+0000 7f3bc1ffb700 1 -- 172.21.15.40:0/555561110 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc4020070 con 0x7f3bcc09e2b0 2023-09-30T22:30:05.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.211+0000 7f3bc1ffb700 1 -- 172.21.15.40:0/555561110 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4004280 con 0x7f3bcc09e2b0 2023-09-30T22:30:05.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.211+0000 7f3bd3490700 1 -- 172.21.15.40:0/555561110 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc4009a70 con 0x7f3bcc09e2b0 2023-09-30T22:30:05.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.212+0000 7f3bd3490700 1 -- 172.21.15.40:0/555561110 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bcc1304b0 con 0x7f3bcc09e2b0 2023-09-30T22:30:05.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.213+0000 7f3bd3490700 1 -- 172.21.15.40:0/555561110 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bcc062380 con 0x7f3bcc09e2b0 2023-09-30T22:30:05.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.214+0000 7f3bc1ffb700 1 -- 172.21.15.40:0/555561110 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3bc40043e0 con 0x7f3bcc09e2b0 2023-09-30T22:30:05.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.214+0000 7f3bc1ffb700 1 -- 172.21.15.40:0/555561110 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3bc4022070 con 0x7f3bcc09e2b0 2023-09-30T22:30:05.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.218+0000 7f3bc1ffb700 1 -- 172.21.15.40:0/555561110 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3bc4004690 con 0x7f3bcc09e2b0 2023-09-30T22:30:05.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.332+0000 7fd0c3779700 1 -- 172.21.15.40:0/3554989183 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd0bc062380 con 0x7fd0bc09e230 2023-09-30T22:30:05.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.332+0000 7fd0b1ffb700 1 -- 172.21.15.40:0/3554989183 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd0ac021020 con 0x7fd0bc09e230 2023-09-30T22:30:05.333 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:05.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.335+0000 7fd0c3779700 1 -- 172.21.15.40:0/3554989183 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd0bc09e230 msgr2=0x7fd0bc1c49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.335+0000 7fd0c3779700 1 --2- 172.21.15.40:0/3554989183 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd0bc09e230 0x7fd0bc1c49b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac00e810 tx=0x7fd0ac00ebd0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.335+0000 7fd0c3779700 1 -- 172.21.15.40:0/3554989183 shutdown_connections 2023-09-30T22:30:05.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.335+0000 7fd0c3779700 1 --2- 172.21.15.40:0/3554989183 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0bc130de0 0x7fd0bc1c08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.335+0000 7fd0c3779700 1 --2- 172.21.15.40:0/3554989183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0bc09d920 0x7fd0bc1c4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.335+0000 7fd0c3779700 1 --2- 172.21.15.40:0/3554989183 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd0bc09e230 0x7fd0bc1c49b0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.335+0000 7fd0c3779700 1 -- 172.21.15.40:0/3554989183 >> 172.21.15.40:0/3554989183 conn(0x7fd0bc09fb20 msgr2=0x7fd0bc12dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:05.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.335+0000 7fd0c3779700 1 -- 172.21.15.40:0/3554989183 shutdown_connections 2023-09-30T22:30:05.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.335+0000 7fd0c3779700 1 -- 172.21.15.40:0/3554989183 wait complete. 2023-09-30T22:30:05.348 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:05.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.360+0000 7f2c6a766700 1 -- 172.21.15.40:0/624526909 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2c64062380 con 0x7f2c6409e400 2023-09-30T22:30:05.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.360+0000 7f2c60ff9700 1 -- 172.21.15.40:0/624526909 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2c58029090 con 0x7f2c6409e400 2023-09-30T22:30:05.361 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:05.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.362+0000 7f2c6a766700 1 -- 172.21.15.40:0/624526909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c6409e400 msgr2=0x7f2c6411e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.362+0000 7f2c6a766700 1 --2- 172.21.15.40:0/624526909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c6409e400 0x7f2c6411e080 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f2c5800b450 tx=0x7f2c5800b810 comp rx=0 tx=0).stop 2023-09-30T22:30:05.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.362+0000 7f2c6a766700 1 -- 172.21.15.40:0/624526909 shutdown_connections 2023-09-30T22:30:05.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.362+0000 7f2c6a766700 1 --2- 172.21.15.40:0/624526909 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c6409d920 0x7f2c6411db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.362+0000 7f2c6a766700 1 --2- 172.21.15.40:0/624526909 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c6413a400 0x7f2c6411e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.362+0000 7f2c6a766700 1 --2- 172.21.15.40:0/624526909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c6409e400 0x7f2c6411e080 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.362+0000 7f2c6a766700 1 -- 172.21.15.40:0/624526909 >> 172.21.15.40:0/624526909 conn(0x7f2c6409fb20 msgr2=0x7f2c64070700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:05.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.363+0000 7f2c6a766700 1 -- 172.21.15.40:0/624526909 shutdown_connections 2023-09-30T22:30:05.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.363+0000 7f2c6a766700 1 -- 172.21.15.40:0/624526909 wait complete. 2023-09-30T22:30:05.375 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:05.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.382+0000 7f7279f66700 1 -- 172.21.15.40:0/242456140 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7274062380 con 0x7f727409e480 2023-09-30T22:30:05.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.382+0000 7f725bfff700 1 -- 172.21.15.40:0/242456140 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f726c031020 con 0x7f727409e480 2023-09-30T22:30:05.383 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:05.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.385+0000 7f7279f66700 1 -- 172.21.15.40:0/242456140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f727409e480 msgr2=0x7f727412d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.385+0000 7f7279f66700 1 --2- 172.21.15.40:0/242456140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f727409e480 0x7f727412d340 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f726c014040 tx=0x7f726c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.385+0000 7f7279f66700 1 -- 172.21.15.40:0/242456140 shutdown_connections 2023-09-30T22:30:05.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.385+0000 7f7279f66700 1 --2- 172.21.15.40:0/242456140 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f727409c890 0x7f72741c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.385+0000 7f7279f66700 1 --2- 172.21.15.40:0/242456140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f727409e480 0x7f727412d340 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.385+0000 7f7279f66700 1 --2- 172.21.15.40:0/242456140 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f727409d920 0x7f72741c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.385+0000 7f7279f66700 1 -- 172.21.15.40:0/242456140 >> 172.21.15.40:0/242456140 conn(0x7f72740a7080 msgr2=0x7f72740a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:05.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.385+0000 7f7279f66700 1 -- 172.21.15.40:0/242456140 shutdown_connections 2023-09-30T22:30:05.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.385+0000 7f7279f66700 1 -- 172.21.15.40:0/242456140 wait complete. 2023-09-30T22:30:05.397 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:05.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.440+0000 7f3bd3490700 1 -- 172.21.15.40:0/555561110 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3bcc1304b0 con 0x7f3bcc09e2b0 2023-09-30T22:30:05.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.440+0000 7f3bc1ffb700 1 -- 172.21.15.40:0/555561110 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3bc4035090 con 0x7f3bcc09e2b0 2023-09-30T22:30:05.441 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:05.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.443+0000 7f3bd3490700 1 -- 172.21.15.40:0/555561110 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3bcc09e2b0 msgr2=0x7f3bcc12de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:05.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.443+0000 7f3bd3490700 1 --2- 172.21.15.40:0/555561110 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3bcc09e2b0 0x7f3bcc12de90 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4016000 tx=0x7f3bc4004ad0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.443+0000 7f3bd3490700 1 -- 172.21.15.40:0/555561110 shutdown_connections 2023-09-30T22:30:05.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.443+0000 7f3bd3490700 1 --2- 172.21.15.40:0/555561110 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3bcc09e2b0 0x7f3bcc12de90 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.443+0000 7f3bd3490700 1 --2- 172.21.15.40:0/555561110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bcc09c890 0x7f3bcc12d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.443+0000 7f3bd3490700 1 --2- 172.21.15.40:0/555561110 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bcc09d920 0x7f3bcc12d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:05.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.443+0000 7f3bd3490700 1 -- 172.21.15.40:0/555561110 >> 172.21.15.40:0/555561110 conn(0x7f3bcc0a7080 msgr2=0x7f3bcc0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:05.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.443+0000 7f3bd3490700 1 -- 172.21.15.40:0/555561110 shutdown_connections 2023-09-30T22:30:05.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:05.443+0000 7f3bd3490700 1 -- 172.21.15.40:0/555561110 wait complete. 2023-09-30T22:30:05.455 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:06.350 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:06.376 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:06.398 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:06.456 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:06.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.497+0000 7fc70dd35700 1 Processor -- start 2023-09-30T22:30:06.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.497+0000 7fc70dd35700 1 -- start start 2023-09-30T22:30:06.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.497+0000 7fc70dd35700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc708131d50 0x7fc708132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:06.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.497+0000 7fc70dd35700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc70809bc50 0x7fc70809c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:06.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.497+0000 7fc70dd35700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc708071920 con 0x7fc70809c600 2023-09-30T22:30:06.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.497+0000 7fc70dd35700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc70809cb10 con 0x7fc708131d50 2023-09-30T22:30:06.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.497+0000 7fc70dd35700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc708132660 con 0x7fc70809bc50 2023-09-30T22:30:06.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.498+0000 7fc7077fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc708131d50 0x7fc708132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:06.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.498+0000 7fc706ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc70809bc50 0x7fc70809c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:06.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.498+0000 7fc7077fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc708131d50 0x7fc708132120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37776/0 (socket says 172.21.15.40:37776) 2023-09-30T22:30:06.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.498+0000 7fc706ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc70809bc50 0x7fc70809c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50468/0 (socket says 172.21.15.40:50468) 2023-09-30T22:30:06.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.498+0000 7fc7077fe700 1 -- 172.21.15.40:0/2227340055 learned_addr learned my addr 172.21.15.40:0/2227340055 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:06.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.498+0000 7fc7077fe700 1 -- 172.21.15.40:0/2227340055 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc70809bc50 msgr2=0x7fc70809c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:06.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.498+0000 7fc7077fe700 1 --2- 172.21.15.40:0/2227340055 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc70809bc50 0x7fc70809c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.498+0000 7fc7077fe700 1 -- 172.21.15.40:0/2227340055 >> v1:172.21.15.40:6789/0 conn(0x7fc70809c600 legacy=0x7fc708138ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:06.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.498+0000 7fc7077fe700 1 -- 172.21.15.40:0/2227340055 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc708131900 con 0x7fc708131d50 2023-09-30T22:30:06.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.498+0000 7fc7077fe700 1 --2- 172.21.15.40:0/2227340055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc708131d50 0x7fc708132120 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fc6f800dd10 tx=0x7fc6f800f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edf57d7e6831c84a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:06.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.498+0000 7fc7067fc700 1 -- 172.21.15.40:0/2227340055 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f8012070 con 0x7fc708131d50 2023-09-30T22:30:06.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.498+0000 7fc7067fc700 1 -- 172.21.15.40:0/2227340055 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f800d2e0 con 0x7fc708131d50 2023-09-30T22:30:06.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.498+0000 7fc7067fc700 1 -- 172.21.15.40:0/2227340055 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f800fbc0 con 0x7fc708131d50 2023-09-30T22:30:06.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.499+0000 7fc70dd35700 1 -- 172.21.15.40:0/2227340055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc708131d50 msgr2=0x7fc708132120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:06.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.499+0000 7fc70dd35700 1 --2- 172.21.15.40:0/2227340055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc708131d50 0x7fc708132120 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fc6f800dd10 tx=0x7fc6f800f330 comp rx=0 tx=0).stop 2023-09-30T22:30:06.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.499+0000 7fc70dd35700 1 -- 172.21.15.40:0/2227340055 shutdown_connections 2023-09-30T22:30:06.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.499+0000 7fc70dd35700 1 --2- 172.21.15.40:0/2227340055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc708131d50 0x7fc708132120 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.499+0000 7fc70dd35700 1 --2- 172.21.15.40:0/2227340055 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc70809bc50 0x7fc70809c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.499+0000 7fc70dd35700 1 -- 172.21.15.40:0/2227340055 >> 172.21.15.40:0/2227340055 conn(0x7fc7080a2a00 msgr2=0x7fc7080a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:06.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.499+0000 7fc70dd35700 1 -- 172.21.15.40:0/2227340055 shutdown_connections 2023-09-30T22:30:06.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.499+0000 7fc70dd35700 1 -- 172.21.15.40:0/2227340055 wait complete. 2023-09-30T22:30:06.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.500+0000 7fc70dd35700 1 Processor -- start 2023-09-30T22:30:06.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.501+0000 7fc70dd35700 1 -- start start 2023-09-30T22:30:06.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.501+0000 7fc70dd35700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc70809bc50 0x7fc70811a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:06.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.501+0000 7fc70dd35700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc70809c600 0x7fc70811ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:06.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.501+0000 7fc70dd35700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc708131d50 0x7fc70811b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:06.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.501+0000 7fc70dd35700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70811ecf0 con 0x7fc70809bc50 2023-09-30T22:30:06.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.501+0000 7fc70dd35700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70811c420 con 0x7fc70809c600 2023-09-30T22:30:06.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.501+0000 7fc70dd35700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc70811ca40 con 0x7fc708131d50 2023-09-30T22:30:06.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.501+0000 7fc7077fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc70809bc50 0x7fc70811a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:06.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.501+0000 7fc7077fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc70809bc50 0x7fc70811a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37790/0 (socket says 172.21.15.40:37790) 2023-09-30T22:30:06.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.501+0000 7fc7077fe700 1 -- 172.21.15.40:0/682263120 learned_addr learned my addr 172.21.15.40:0/682263120 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:06.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.501+0000 7fc706ffd700 1 --2- 172.21.15.40:0/682263120 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc70809c600 0x7fc70811ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:06.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.502+0000 7fc7077fe700 1 -- 172.21.15.40:0/682263120 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc708131d50 msgr2=0x7fc70811b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:06.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.502+0000 7fc7077fe700 1 --2- 172.21.15.40:0/682263120 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc708131d50 0x7fc70811b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.502+0000 7fc7077fe700 1 -- 172.21.15.40:0/682263120 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc70809c600 msgr2=0x7fc70811ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:06.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.502+0000 7fc7077fe700 1 --2- 172.21.15.40:0/682263120 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc70809c600 0x7fc70811ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.502+0000 7fc7077fe700 1 -- 172.21.15.40:0/682263120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f800d9f0 con 0x7fc70809bc50 2023-09-30T22:30:06.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.502+0000 7fc7077fe700 1 --2- 172.21.15.40:0/682263120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc70809bc50 0x7fc70811a810 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fc70809ee70 tx=0x7fc6f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:06.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.502+0000 7fc6effff700 1 -- 172.21.15.40:0/682263120 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f80036a0 con 0x7fc70809bc50 2023-09-30T22:30:06.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.502+0000 7fc6effff700 1 -- 172.21.15.40:0/682263120 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f8003800 con 0x7fc70809bc50 2023-09-30T22:30:06.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.502+0000 7fc70dd35700 1 -- 172.21.15.40:0/682263120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc70811d670 con 0x7fc70809bc50 2023-09-30T22:30:06.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.502+0000 7fc6effff700 1 -- 172.21.15.40:0/682263120 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f8003bb0 con 0x7fc70809bc50 2023-09-30T22:30:06.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.502+0000 7fc70dd35700 1 -- 172.21.15.40:0/682263120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc70809ea60 con 0x7fc70809bc50 2023-09-30T22:30:06.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.503+0000 7fc6effff700 1 -- 172.21.15.40:0/682263120 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc6f8003d10 con 0x7fc70809bc50 2023-09-30T22:30:06.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.503+0000 7fc70dd35700 1 -- 172.21.15.40:0/682263120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc70806fa30 con 0x7fc70809bc50 2023-09-30T22:30:06.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.504+0000 7fc6effff700 1 -- 172.21.15.40:0/682263120 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc6f8044e10 con 0x7fc70809bc50 2023-09-30T22:30:06.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.513+0000 7fc6effff700 1 -- 172.21.15.40:0/682263120 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc6f801f7b0 con 0x7fc70809bc50 2023-09-30T22:30:06.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.547+0000 7fc5ca420700 1 Processor -- start 2023-09-30T22:30:06.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.547+0000 7fc5ca420700 1 -- start start 2023-09-30T22:30:06.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.547+0000 7fc5ca420700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc5c409d920 0x7fc5c409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:06.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.547+0000 7fc5ca420700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5c409e230 0x7fc5c41308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:06.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.547+0000 7fc5ca420700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc5c4130de0 0x7fc5c4131280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:06.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.547+0000 7fc5ca420700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5c409edf0 con 0x7fc5c4130de0 2023-09-30T22:30:06.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.547+0000 7fc5ca420700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c409adf0 con 0x7fc5c409e230 2023-09-30T22:30:06.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.547+0000 7fc5ca420700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c409b660 con 0x7fc5c409d920 2023-09-30T22:30:06.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.548+0000 7fc5c3fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc5c409d920 0x7fc5c409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:06.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.548+0000 7fc5c37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5c409e230 0x7fc5c41308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:06.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.548+0000 7fc5c3fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc5c409d920 0x7fc5c409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58216/0 (socket says 172.21.15.40:58216) 2023-09-30T22:30:06.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.548+0000 7fc5c3fff700 1 -- 172.21.15.40:0/2735667923 learned_addr learned my addr 172.21.15.40:0/2735667923 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:06.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.548+0000 7fc5c3fff700 1 -- 172.21.15.40:0/2735667923 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5c409e230 msgr2=0x7fc5c41308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:06.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.548+0000 7fc5c3fff700 1 --2- 172.21.15.40:0/2735667923 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5c409e230 0x7fc5c41308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.548+0000 7fc5c3fff700 1 -- 172.21.15.40:0/2735667923 >> v2:172.21.15.40:3300/0 conn(0x7fc5c4130de0 msgr2=0x7fc5c4131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:06.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.548+0000 7fc5c3fff700 1 --2- 172.21.15.40:0/2735667923 >> v2:172.21.15.40:3300/0 conn(0x7fc5c4130de0 0x7fc5c4131280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.548+0000 7fc5c3fff700 1 -- 172.21.15.40:0/2735667923 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c409a6e0 con 0x7fc5c409d920 2023-09-30T22:30:06.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.548+0000 7fc5c37fe700 1 --2- 172.21.15.40:0/2735667923 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5c409e230 0x7fc5c41308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:06.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.548+0000 7fc5c3fff700 1 --2- 172.21.15.40:0/2735667923 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc5c409d920 0x7fc5c409dcf0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4006fd0 tx=0x7fc5b4009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1263b817580791cf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:06.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.548+0000 7fc5c2ffd700 1 -- 172.21.15.40:0/2735667923 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4005e30 con 0x7fc5c409d920 2023-09-30T22:30:06.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.548+0000 7fc5c2ffd700 1 -- 172.21.15.40:0/2735667923 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b4004030 con 0x7fc5c409d920 2023-09-30T22:30:06.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.548+0000 7fc5c2ffd700 1 -- 172.21.15.40:0/2735667923 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b40043e0 con 0x7fc5c409d920 2023-09-30T22:30:06.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.549+0000 7fc5ca420700 1 -- 172.21.15.40:0/2735667923 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc5c409d920 msgr2=0x7fc5c409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:06.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.549+0000 7fc5ca420700 1 --2- 172.21.15.40:0/2735667923 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc5c409d920 0x7fc5c409dcf0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4006fd0 tx=0x7fc5b4009bd0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.549+0000 7fc5ca420700 1 -- 172.21.15.40:0/2735667923 shutdown_connections 2023-09-30T22:30:06.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.549+0000 7fc5ca420700 1 --2- 172.21.15.40:0/2735667923 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc5c409d920 0x7fc5c409dcf0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.549+0000 7fc5ca420700 1 --2- 172.21.15.40:0/2735667923 >> v2:172.21.15.40:3300/0 conn(0x7fc5c4130de0 0x7fc5c4131280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.549+0000 7fc5ca420700 1 --2- 172.21.15.40:0/2735667923 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5c409e230 0x7fc5c41308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.549+0000 7fc5ca420700 1 -- 172.21.15.40:0/2735667923 >> 172.21.15.40:0/2735667923 conn(0x7fc5c409fb20 msgr2=0x7fc5c409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:06.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.549+0000 7fc5ca420700 1 -- 172.21.15.40:0/2735667923 shutdown_connections 2023-09-30T22:30:06.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.549+0000 7fc5ca420700 1 -- 172.21.15.40:0/2735667923 wait complete. 2023-09-30T22:30:06.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.551+0000 7fc5ca420700 1 Processor -- start 2023-09-30T22:30:06.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.551+0000 7fc5ca420700 1 -- start start 2023-09-30T22:30:06.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.551+0000 7fc5ca420700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5c409d920 0x7fc5c411f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:06.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.552+0000 7fc5ca420700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5c409e230 0x7fc5c411fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:06.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.552+0000 7fc5ca420700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc5c4130de0 0x7fc5c411ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:06.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.552+0000 7fc5ca420700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c4122a70 con 0x7fc5c409d920 2023-09-30T22:30:06.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.552+0000 7fc5ca420700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c4122e10 con 0x7fc5c409e230 2023-09-30T22:30:06.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.552+0000 7fc5ca420700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c4121100 con 0x7fc5c4130de0 2023-09-30T22:30:06.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.552+0000 7fc5c89bd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc5c4130de0 0x7fc5c411ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:06.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.552+0000 7fc5c89bd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc5c4130de0 0x7fc5c411ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58232/0 (socket says 172.21.15.40:58232) 2023-09-30T22:30:06.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.552+0000 7fc5c89bd700 1 -- 172.21.15.40:0/188538530 learned_addr learned my addr 172.21.15.40:0/188538530 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:06.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.552+0000 7fc5c3fff700 1 --2- 172.21.15.40:0/188538530 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5c409d920 0x7fc5c411f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:06.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.552+0000 7fc5c37fe700 1 --2- 172.21.15.40:0/188538530 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5c409e230 0x7fc5c411fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:06.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.552+0000 7fc5c89bd700 1 -- 172.21.15.40:0/188538530 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5c409e230 msgr2=0x7fc5c411fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:06.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.552+0000 7fc5c89bd700 1 --2- 172.21.15.40:0/188538530 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5c409e230 0x7fc5c411fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.552+0000 7fc5c89bd700 1 -- 172.21.15.40:0/188538530 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5c409d920 msgr2=0x7fc5c411f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:06.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.552+0000 7fc5c89bd700 1 --2- 172.21.15.40:0/188538530 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5c409d920 0x7fc5c411f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.552+0000 7fc5c89bd700 1 -- 172.21.15.40:0/188538530 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b80094a0 con 0x7fc5c4130de0 2023-09-30T22:30:06.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.552+0000 7fc5c3fff700 1 --2- 172.21.15.40:0/188538530 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5c409d920 0x7fc5c411f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:06.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.552+0000 7fc5c37fe700 1 --2- 172.21.15.40:0/188538530 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5c409e230 0x7fc5c411fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:30:06.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.552+0000 7fc5c89bd700 1 --2- 172.21.15.40:0/188538530 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc5c4130de0 0x7fc5c411ffc0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc00b970 tx=0x7fc5bc00bd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:06.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.552+0000 7fc5c0ff9700 1 -- 172.21.15.40:0/188538530 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc00c9b0 con 0x7fc5c4130de0 2023-09-30T22:30:06.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.553+0000 7fc5c0ff9700 1 -- 172.21.15.40:0/188538530 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5bc00cb30 con 0x7fc5c4130de0 2023-09-30T22:30:06.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.553+0000 7fc5ca420700 1 -- 172.21.15.40:0/188538530 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b4009500 con 0x7fc5c4130de0 2023-09-30T22:30:06.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.553+0000 7fc5c0ff9700 1 -- 172.21.15.40:0/188538530 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc014440 con 0x7fc5c4130de0 2023-09-30T22:30:06.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.553+0000 7fc5ca420700 1 -- 172.21.15.40:0/188538530 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c4121870 con 0x7fc5c4130de0 2023-09-30T22:30:06.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.554+0000 7fc5ca420700 1 -- 172.21.15.40:0/188538530 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5a40052e0 con 0x7fc5c4130de0 2023-09-30T22:30:06.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.554+0000 7fc5c0ff9700 1 -- 172.21.15.40:0/188538530 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc5bc01d3b0 con 0x7fc5c4130de0 2023-09-30T22:30:06.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.554+0000 7fc5c0ff9700 1 -- 172.21.15.40:0/188538530 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc5bc006e40 con 0x7fc5c4130de0 2023-09-30T22:30:06.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.559+0000 7fc5c0ff9700 1 -- 172.21.15.40:0/188538530 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc5bc007370 con 0x7fc5c4130de0 2023-09-30T22:30:06.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.579+0000 7f208d688700 1 Processor -- start 2023-09-30T22:30:06.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.579+0000 7f208d688700 1 -- start start 2023-09-30T22:30:06.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.579+0000 7f208d688700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f208812e590 0x7f208812e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:06.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.579+0000 7f208d688700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f208812d8a0 0x7f2088138c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:06.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.579+0000 7f208d688700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f208809ab70 con 0x7f208812eea0 2023-09-30T22:30:06.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.579+0000 7f208d688700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f208809b270 con 0x7f208812d8a0 2023-09-30T22:30:06.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.579+0000 7f208d688700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f208809bab0 con 0x7f208812e590 2023-09-30T22:30:06.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.579+0000 7f20867fc700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f208812eea0 0x7f208812d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47662/0 (socket says 172.21.15.40:47662) 2023-09-30T22:30:06.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.579+0000 7f20867fc700 1 -- 172.21.15.40:0/1183201184 learned_addr learned my addr 172.21.15.40:0/1183201184 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:06.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.579+0000 7f2086ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f208812e590 0x7f208812e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:06.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.579+0000 7f20877fe700 1 --2- 172.21.15.40:0/1183201184 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f208812d8a0 0x7f2088138c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:06.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.580+0000 7f2085ffb700 1 -- 172.21.15.40:0/1183201184 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2348038547 0 0) 0x7f208809ab70 con 0x7f208812eea0 2023-09-30T22:30:06.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.580+0000 7f20877fe700 1 -- 172.21.15.40:0/1183201184 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f208812e590 msgr2=0x7f208812e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:06.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.580+0000 7f20877fe700 1 --2- 172.21.15.40:0/1183201184 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f208812e590 0x7f208812e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.580+0000 7f20877fe700 1 -- 172.21.15.40:0/1183201184 >> v1:172.21.15.40:6789/0 conn(0x7f208812eea0 legacy=0x7f208812d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:06.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.580+0000 7f20877fe700 1 -- 172.21.15.40:0/1183201184 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f208809bd70 con 0x7f208812d8a0 2023-09-30T22:30:06.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.580+0000 7f20877fe700 1 --2- 172.21.15.40:0/1183201184 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f208812d8a0 0x7f2088138c50 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f208000f3a0 tx=0x7f208000f6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=509de0439766b74d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:06.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.580+0000 7f2085ffb700 1 -- 172.21.15.40:0/1183201184 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2080012070 con 0x7f208812d8a0 2023-09-30T22:30:06.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.580+0000 7f2085ffb700 1 -- 172.21.15.40:0/1183201184 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208000d0d0 con 0x7f208812d8a0 2023-09-30T22:30:06.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.580+0000 7f2085ffb700 1 -- 172.21.15.40:0/1183201184 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208000fea0 con 0x7f208812d8a0 2023-09-30T22:30:06.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.581+0000 7f208d688700 1 -- 172.21.15.40:0/1183201184 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f208812d8a0 msgr2=0x7f2088138c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:06.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.581+0000 7f208d688700 1 --2- 172.21.15.40:0/1183201184 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f208812d8a0 0x7f2088138c50 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f208000f3a0 tx=0x7f208000f6b0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.581+0000 7f208d688700 1 -- 172.21.15.40:0/1183201184 shutdown_connections 2023-09-30T22:30:06.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.581+0000 7f208d688700 1 --2- 172.21.15.40:0/1183201184 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f208812d8a0 0x7f2088138c50 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.581+0000 7f208d688700 1 --2- 172.21.15.40:0/1183201184 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f208812e590 0x7f208812e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.581+0000 7f208d688700 1 -- 172.21.15.40:0/1183201184 >> 172.21.15.40:0/1183201184 conn(0x7f20880a2a00 msgr2=0x7f20880a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:06.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.581+0000 7f208d688700 1 -- 172.21.15.40:0/1183201184 shutdown_connections 2023-09-30T22:30:06.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.581+0000 7f208d688700 1 -- 172.21.15.40:0/1183201184 wait complete. 2023-09-30T22:30:06.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.583+0000 7f208d688700 1 Processor -- start 2023-09-30T22:30:06.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.583+0000 7f208d688700 1 -- start start 2023-09-30T22:30:06.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.583+0000 7f208d688700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f208812d8a0 0x7f20881c0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:06.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.583+0000 7f208d688700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f208812e590 0x7f20881c1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:06.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.583+0000 7f208d688700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f208812eea0 0x7f20881c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:06.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.583+0000 7f208d688700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208811d3f0 con 0x7f208812e590 2023-09-30T22:30:06.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.583+0000 7f208d688700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f208811d070 con 0x7f208812eea0 2023-09-30T22:30:06.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.583+0000 7f208d688700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20881c1860 con 0x7f208812d8a0 2023-09-30T22:30:06.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.584+0000 7f20867fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f208812e590 0x7f20881c1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:06.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.584+0000 7f20867fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f208812e590 0x7f20881c1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37812/0 (socket says 172.21.15.40:37812) 2023-09-30T22:30:06.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.584+0000 7f20867fc700 1 -- 172.21.15.40:0/1082731212 learned_addr learned my addr 172.21.15.40:0/1082731212 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:06.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.584+0000 7f20877fe700 1 --2- 172.21.15.40:0/1082731212 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f208812eea0 0x7f20881c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:06.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.584+0000 7f20867fc700 1 -- 172.21.15.40:0/1082731212 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f208812d8a0 msgr2=0x7f20881c0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:06.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.584+0000 7f20867fc700 1 --2- 172.21.15.40:0/1082731212 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f208812d8a0 0x7f20881c0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.584+0000 7f20867fc700 1 -- 172.21.15.40:0/1082731212 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f208812eea0 msgr2=0x7f20881c3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:06.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.584+0000 7f20867fc700 1 --2- 172.21.15.40:0/1082731212 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f208812eea0 0x7f20881c3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.584+0000 7f20867fc700 1 -- 172.21.15.40:0/1082731212 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f208000f050 con 0x7f208812e590 2023-09-30T22:30:06.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.584+0000 7f20867fc700 1 --2- 172.21.15.40:0/1082731212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f208812e590 0x7f20881c1320 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f207c00c520 tx=0x7f207c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:06.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.589+0000 7f206f7fe700 1 -- 172.21.15.40:0/1082731212 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207c004c80 con 0x7f208812e590 2023-09-30T22:30:06.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.589+0000 7f206f7fe700 1 -- 172.21.15.40:0/1082731212 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207c004de0 con 0x7f208812e590 2023-09-30T22:30:06.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.589+0000 7f208d688700 1 -- 172.21.15.40:0/1082731212 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f208811b360 con 0x7f208812e590 2023-09-30T22:30:06.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.589+0000 7f208d688700 1 -- 172.21.15.40:0/1082731212 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f208809fd20 con 0x7f208812e590 2023-09-30T22:30:06.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.590+0000 7f206f7fe700 1 -- 172.21.15.40:0/1082731212 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207c007310 con 0x7f208812e590 2023-09-30T22:30:06.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.590+0000 7f208d688700 1 -- 172.21.15.40:0/1082731212 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2088062380 con 0x7f208812e590 2023-09-30T22:30:06.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.591+0000 7f206f7fe700 1 -- 172.21.15.40:0/1082731212 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f207c007470 con 0x7f208812e590 2023-09-30T22:30:06.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.591+0000 7f206f7fe700 1 -- 172.21.15.40:0/1082731212 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f207c03f9b0 con 0x7f208812e590 2023-09-30T22:30:06.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.600+0000 7f206f7fe700 1 -- 172.21.15.40:0/1082731212 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f207c01bd10 con 0x7f208812e590 2023-09-30T22:30:06.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.617+0000 7f57a7d24700 1 Processor -- start 2023-09-30T22:30:06.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.617+0000 7f57a7d24700 1 -- start start 2023-09-30T22:30:06.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.617+0000 7f57a7d24700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57a009e400 0x7f57a0135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:06.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.617+0000 7f57a7d24700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f57a0136230 0x7f57a0138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:06.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.617+0000 7f57a7d24700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57a009adf0 con 0x7f57a009d920 2023-09-30T22:30:06.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.617+0000 7f57a7d24700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57a009e7f0 con 0x7f57a0136230 2023-09-30T22:30:06.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.617+0000 7f57a7d24700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a009edf0 con 0x7f57a009e400 2023-09-30T22:30:06.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.618+0000 7f57a52bf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57a009e400 0x7f57a0135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:06.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.618+0000 7f57a62c1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f57a0136230 0x7f57a0138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:06.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.618+0000 7f57a52bf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57a009e400 0x7f57a0135cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50516/0 (socket says 172.21.15.40:50516) 2023-09-30T22:30:06.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.618+0000 7f57a52bf700 1 -- 172.21.15.40:0/476654453 learned_addr learned my addr 172.21.15.40:0/476654453 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:06.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.618+0000 7f57a62c1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f57a0136230 0x7f57a0138610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37818/0 (socket says 172.21.15.40:37818) 2023-09-30T22:30:06.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.618+0000 7f57a52bf700 1 -- 172.21.15.40:0/476654453 >> v2:172.21.15.40:3300/0 conn(0x7f57a0136230 msgr2=0x7f57a0138610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:06.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.618+0000 7f57a52bf700 1 --2- 172.21.15.40:0/476654453 >> v2:172.21.15.40:3300/0 conn(0x7f57a0136230 0x7f57a0138610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.618+0000 7f57a52bf700 1 -- 172.21.15.40:0/476654453 >> v1:172.21.15.40:6789/0 conn(0x7f57a009d920 legacy=0x7f57a009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:06.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.618+0000 7f57a52bf700 1 -- 172.21.15.40:0/476654453 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a009b660 con 0x7f57a009e400 2023-09-30T22:30:06.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.618+0000 7f57a52bf700 1 --2- 172.21.15.40:0/476654453 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57a009e400 0x7f57a0135cf0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f57900098f0 tx=0x7f5790009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9907483af6137a91 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:06.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.618+0000 7f57a4abe700 1 -- 172.21.15.40:0/476654453 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5790011830 con 0x7f57a009e400 2023-09-30T22:30:06.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.618+0000 7f57a4abe700 1 -- 172.21.15.40:0/476654453 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5790011990 con 0x7f57a009e400 2023-09-30T22:30:06.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.618+0000 7f57a4abe700 1 -- 172.21.15.40:0/476654453 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5790011d20 con 0x7f57a009e400 2023-09-30T22:30:06.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.619+0000 7f57a7d24700 1 -- 172.21.15.40:0/476654453 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57a009e400 msgr2=0x7f57a0135cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:06.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.619+0000 7f57a7d24700 1 --2- 172.21.15.40:0/476654453 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57a009e400 0x7f57a0135cf0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f57900098f0 tx=0x7f5790009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:06.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.619+0000 7f57a7d24700 1 -- 172.21.15.40:0/476654453 shutdown_connections 2023-09-30T22:30:06.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.619+0000 7f57a7d24700 1 --2- 172.21.15.40:0/476654453 >> v2:172.21.15.40:3300/0 conn(0x7f57a0136230 0x7f57a0138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.619+0000 7f57a7d24700 1 --2- 172.21.15.40:0/476654453 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57a009e400 0x7f57a0135cf0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.619+0000 7f57a7d24700 1 -- 172.21.15.40:0/476654453 >> 172.21.15.40:0/476654453 conn(0x7f57a009fb20 msgr2=0x7f57a009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:06.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.619+0000 7f57a7d24700 1 -- 172.21.15.40:0/476654453 shutdown_connections 2023-09-30T22:30:06.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.619+0000 7f57a7d24700 1 -- 172.21.15.40:0/476654453 wait complete. 2023-09-30T22:30:06.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.621+0000 7f57a7d24700 1 Processor -- start 2023-09-30T22:30:06.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.621+0000 7f57a7d24700 1 -- start start 2023-09-30T22:30:06.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.621+0000 7f57a7d24700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f57a009d920 0x7f57a01c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:06.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.621+0000 7f57a7d24700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57a009e400 0x7f57a01c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:06.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.621+0000 7f57a7d24700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57a0136230 0x7f57a0122a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:06.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.621+0000 7f57a7d24700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a01247f0 con 0x7f57a009e400 2023-09-30T22:30:06.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.621+0000 7f57a7d24700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a0124600 con 0x7f57a0136230 2023-09-30T22:30:06.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.621+0000 7f57a7d24700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f57a01355b0 con 0x7f57a009d920 2023-09-30T22:30:06.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.622+0000 7f57a52bf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57a009e400 0x7f57a01c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:06.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.622+0000 7f57a62c1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57a0136230 0x7f57a0122a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:06.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.622+0000 7f57a52bf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57a009e400 0x7f57a01c8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37832/0 (socket says 172.21.15.40:37832) 2023-09-30T22:30:06.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.622+0000 7f57a52bf700 1 -- 172.21.15.40:0/2198060500 learned_addr learned my addr 172.21.15.40:0/2198060500 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:06.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.622+0000 7f57a52bf700 1 -- 172.21.15.40:0/2198060500 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f57a009d920 msgr2=0x7f57a01c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:06.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.622+0000 7f57a52bf700 1 --2- 172.21.15.40:0/2198060500 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f57a009d920 0x7f57a01c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.622+0000 7f57a52bf700 1 -- 172.21.15.40:0/2198060500 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57a0136230 msgr2=0x7f57a0122a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:06.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.622+0000 7f57a52bf700 1 --2- 172.21.15.40:0/2198060500 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57a0136230 0x7f57a0122a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.622+0000 7f57a52bf700 1 -- 172.21.15.40:0/2198060500 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5790009550 con 0x7f57a009e400 2023-09-30T22:30:06.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.622+0000 7f57a62c1700 1 --2- 172.21.15.40:0/2198060500 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57a0136230 0x7f57a0122a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:06.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.622+0000 7f57a52bf700 1 --2- 172.21.15.40:0/2198060500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57a009e400 0x7f57a01c8d30 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f5790000c00 tx=0x7f5790004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:06.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.622+0000 7f57967fc700 1 -- 172.21.15.40:0/2198060500 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5790004480 con 0x7f57a009e400 2023-09-30T22:30:06.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.622+0000 7f57967fc700 1 -- 172.21.15.40:0/2198060500 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f579001f070 con 0x7f57a009e400 2023-09-30T22:30:06.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.622+0000 7f57a7d24700 1 -- 172.21.15.40:0/2198060500 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57a01c9270 con 0x7f57a009e400 2023-09-30T22:30:06.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.622+0000 7f57967fc700 1 -- 172.21.15.40:0/2198060500 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57900038c0 con 0x7f57a009e400 2023-09-30T22:30:06.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.623+0000 7f57a7d24700 1 -- 172.21.15.40:0/2198060500 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a0124c00 con 0x7f57a009e400 2023-09-30T22:30:06.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.624+0000 7f57967fc700 1 -- 172.21.15.40:0/2198060500 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5790021030 con 0x7f57a009e400 2023-09-30T22:30:06.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.624+0000 7f57a7d24700 1 -- 172.21.15.40:0/2198060500 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57a0062380 con 0x7f57a009e400 2023-09-30T22:30:06.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.624+0000 7f57967fc700 1 -- 172.21.15.40:0/2198060500 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5790040a50 con 0x7f57a009e400 2023-09-30T22:30:06.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.633+0000 7f57967fc700 1 -- 172.21.15.40:0/2198060500 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f57900199a0 con 0x7f57a009e400 2023-09-30T22:30:06.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.736+0000 7fc70dd35700 1 -- 172.21.15.40:0/682263120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc708062380 con 0x7fc70809bc50 2023-09-30T22:30:06.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.736+0000 7fc6effff700 1 -- 172.21.15.40:0/682263120 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc6f80283c0 con 0x7fc70809bc50 2023-09-30T22:30:06.737 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:06.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.738+0000 7fc70dd35700 1 -- 172.21.15.40:0/682263120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc70809bc50 msgr2=0x7fc70811a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:06.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.738+0000 7fc70dd35700 1 --2- 172.21.15.40:0/682263120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc70809bc50 0x7fc70811a810 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fc70809ee70 tx=0x7fc6f8004750 comp rx=0 tx=0).stop 2023-09-30T22:30:06.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.738+0000 7fc70dd35700 1 -- 172.21.15.40:0/682263120 shutdown_connections 2023-09-30T22:30:06.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.738+0000 7fc70dd35700 1 --2- 172.21.15.40:0/682263120 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc708131d50 0x7fc70811b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.738+0000 7fc70dd35700 1 --2- 172.21.15.40:0/682263120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc70809bc50 0x7fc70811a810 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.738+0000 7fc70dd35700 1 --2- 172.21.15.40:0/682263120 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc70809c600 0x7fc70811ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.738+0000 7fc70dd35700 1 -- 172.21.15.40:0/682263120 >> 172.21.15.40:0/682263120 conn(0x7fc7080a2a00 msgr2=0x7fc7080a1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:06.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.738+0000 7fc70dd35700 1 -- 172.21.15.40:0/682263120 shutdown_connections 2023-09-30T22:30:06.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.738+0000 7fc70dd35700 1 -- 172.21.15.40:0/682263120 wait complete. 2023-09-30T22:30:06.752 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:06.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.767+0000 7fc5ca420700 1 -- 172.21.15.40:0/188538530 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc5a4005590 con 0x7fc5c4130de0 2023-09-30T22:30:06.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.767+0000 7fc5c0ff9700 1 -- 172.21.15.40:0/188538530 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc5bc012340 con 0x7fc5c4130de0 2023-09-30T22:30:06.768 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:06.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.769+0000 7fc5ca420700 1 -- 172.21.15.40:0/188538530 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc5c4130de0 msgr2=0x7fc5c411ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:06.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.769+0000 7fc5ca420700 1 --2- 172.21.15.40:0/188538530 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc5c4130de0 0x7fc5c411ffc0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc00b970 tx=0x7fc5bc00bd30 comp rx=0 tx=0).stop 2023-09-30T22:30:06.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.769+0000 7fc5ca420700 1 -- 172.21.15.40:0/188538530 shutdown_connections 2023-09-30T22:30:06.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.769+0000 7fc5ca420700 1 --2- 172.21.15.40:0/188538530 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc5c4130de0 0x7fc5c411ffc0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.769+0000 7fc5ca420700 1 --2- 172.21.15.40:0/188538530 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5c409d920 0x7fc5c411f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.769+0000 7fc5ca420700 1 --2- 172.21.15.40:0/188538530 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5c409e230 0x7fc5c411fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.769+0000 7fc5ca420700 1 -- 172.21.15.40:0/188538530 >> 172.21.15.40:0/188538530 conn(0x7fc5c409fb20 msgr2=0x7fc5c412ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:06.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.770+0000 7fc5ca420700 1 -- 172.21.15.40:0/188538530 shutdown_connections 2023-09-30T22:30:06.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.770+0000 7fc5ca420700 1 -- 172.21.15.40:0/188538530 wait complete. 2023-09-30T22:30:06.782 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:06.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.831+0000 7f208d688700 1 -- 172.21.15.40:0/1082731212 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f208811ce60 con 0x7f208812e590 2023-09-30T22:30:06.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.831+0000 7f206f7fe700 1 -- 172.21.15.40:0/1082731212 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f207c011e80 con 0x7f208812e590 2023-09-30T22:30:06.832 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:06.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.833+0000 7f208d688700 1 -- 172.21.15.40:0/1082731212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f208812e590 msgr2=0x7f20881c1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:06.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.833+0000 7f208d688700 1 --2- 172.21.15.40:0/1082731212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f208812e590 0x7f20881c1320 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f207c00c520 tx=0x7f207c00c830 comp rx=0 tx=0).stop 2023-09-30T22:30:06.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.833+0000 7f208d688700 1 -- 172.21.15.40:0/1082731212 shutdown_connections 2023-09-30T22:30:06.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.833+0000 7f208d688700 1 --2- 172.21.15.40:0/1082731212 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f208812d8a0 0x7f20881c0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.833+0000 7f208d688700 1 --2- 172.21.15.40:0/1082731212 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f208812eea0 0x7f20881c3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.833+0000 7f208d688700 1 --2- 172.21.15.40:0/1082731212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f208812e590 0x7f20881c1320 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.833+0000 7f208d688700 1 -- 172.21.15.40:0/1082731212 >> 172.21.15.40:0/1082731212 conn(0x7f20880a2a00 msgr2=0x7f208812c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:06.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.833+0000 7f208d688700 1 -- 172.21.15.40:0/1082731212 shutdown_connections 2023-09-30T22:30:06.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.833+0000 7f208d688700 1 -- 172.21.15.40:0/1082731212 wait complete. 2023-09-30T22:30:06.846 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:06.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.862+0000 7f57a7d24700 1 -- 172.21.15.40:0/2198060500 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f57a0126000 con 0x7f57a009e400 2023-09-30T22:30:06.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.862+0000 7f57967fc700 1 -- 172.21.15.40:0/2198060500 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5790015030 con 0x7f57a009e400 2023-09-30T22:30:06.863 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:06.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.865+0000 7f57a7d24700 1 -- 172.21.15.40:0/2198060500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57a009e400 msgr2=0x7f57a01c8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:06.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.865+0000 7f57a7d24700 1 --2- 172.21.15.40:0/2198060500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57a009e400 0x7f57a01c8d30 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f5790000c00 tx=0x7f5790004750 comp rx=0 tx=0).stop 2023-09-30T22:30:06.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.865+0000 7f57a7d24700 1 -- 172.21.15.40:0/2198060500 shutdown_connections 2023-09-30T22:30:06.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.865+0000 7f57a7d24700 1 --2- 172.21.15.40:0/2198060500 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f57a009d920 0x7f57a01c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.865+0000 7f57a7d24700 1 --2- 172.21.15.40:0/2198060500 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f57a0136230 0x7f57a0122a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.865+0000 7f57a7d24700 1 --2- 172.21.15.40:0/2198060500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57a009e400 0x7f57a01c8d30 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:06.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.865+0000 7f57a7d24700 1 -- 172.21.15.40:0/2198060500 >> 172.21.15.40:0/2198060500 conn(0x7f57a009fb20 msgr2=0x7f57a00704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:06.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.865+0000 7f57a7d24700 1 -- 172.21.15.40:0/2198060500 shutdown_connections 2023-09-30T22:30:06.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:06.865+0000 7f57a7d24700 1 -- 172.21.15.40:0/2198060500 wait complete. 2023-09-30T22:30:06.877 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:07.753 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:07.783 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:07.847 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:07.878 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:07.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.901+0000 7f448e3c7700 1 Processor -- start 2023-09-30T22:30:07.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.901+0000 7f448e3c7700 1 -- start start 2023-09-30T22:30:07.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.902+0000 7f448e3c7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4488133e00 0x7f44881341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:07.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.902+0000 7f448e3c7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f448809d400 0x7f448809d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:07.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.902+0000 7f448e3c7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f448809dd70 0x7f448813ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:07.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.902+0000 7f448e3c7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f448809ab20 con 0x7f448809dd70 2023-09-30T22:30:07.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.902+0000 7f448e3c7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4488133940 con 0x7f448809d400 2023-09-30T22:30:07.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.902+0000 7f448e3c7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f448809f0d0 con 0x7f4488133e00 2023-09-30T22:30:07.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.902+0000 7f44877fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f448809d400 0x7f448809d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:07.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.902+0000 7f44877fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f448809d400 0x7f448809d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50530/0 (socket says 172.21.15.40:50530) 2023-09-30T22:30:07.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.902+0000 7f44877fe700 1 -- 172.21.15.40:0/3391246568 learned_addr learned my addr 172.21.15.40:0/3391246568 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:07.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.902+0000 7f448c964700 1 --2- 172.21.15.40:0/3391246568 >> v2:172.21.15.40:3300/0 conn(0x7f448809dd70 0x7f448813ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:07.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.902+0000 7f4487fff700 1 --2- 172.21.15.40:0/3391246568 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4488133e00 0x7f44881341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:07.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.902+0000 7f4487fff700 1 -- 172.21.15.40:0/3391246568 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f448809d400 msgr2=0x7f448809d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:07.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.902+0000 7f4487fff700 1 --2- 172.21.15.40:0/3391246568 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f448809d400 0x7f448809d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.902+0000 7f4487fff700 1 -- 172.21.15.40:0/3391246568 >> v2:172.21.15.40:3300/0 conn(0x7f448809dd70 msgr2=0x7f448813ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:07.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.902+0000 7f4487fff700 1 --2- 172.21.15.40:0/3391246568 >> v2:172.21.15.40:3300/0 conn(0x7f448809dd70 0x7f448813ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.902+0000 7f4487fff700 1 -- 172.21.15.40:0/3391246568 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f448809e210 con 0x7f4488133e00 2023-09-30T22:30:07.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.902+0000 7f44877fe700 1 --2- 172.21.15.40:0/3391246568 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f448809d400 0x7f448809d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:07.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.902+0000 7f448c964700 1 --2- 172.21.15.40:0/3391246568 >> v2:172.21.15.40:3300/0 conn(0x7f448809dd70 0x7f448813ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:07.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.903+0000 7f4487fff700 1 --2- 172.21.15.40:0/3391246568 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4488133e00 0x7f44881341d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f4478013150 tx=0x7f4478013460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb3fb7abdb6b7cb1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:07.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.903+0000 7f4486ffd700 1 -- 172.21.15.40:0/3391246568 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4478016070 con 0x7f4488133e00 2023-09-30T22:30:07.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.903+0000 7f4486ffd700 1 -- 172.21.15.40:0/3391246568 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4478013d10 con 0x7f4488133e00 2023-09-30T22:30:07.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.903+0000 7f4486ffd700 1 -- 172.21.15.40:0/3391246568 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44780112f0 con 0x7f4488133e00 2023-09-30T22:30:07.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.904+0000 7f448e3c7700 1 -- 172.21.15.40:0/3391246568 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4488133e00 msgr2=0x7f44881341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:07.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.904+0000 7f448e3c7700 1 --2- 172.21.15.40:0/3391246568 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4488133e00 0x7f44881341d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f4478013150 tx=0x7f4478013460 comp rx=0 tx=0).stop 2023-09-30T22:30:07.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.904+0000 7f448e3c7700 1 -- 172.21.15.40:0/3391246568 shutdown_connections 2023-09-30T22:30:07.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.904+0000 7f448e3c7700 1 --2- 172.21.15.40:0/3391246568 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4488133e00 0x7f44881341d0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.904+0000 7f448e3c7700 1 --2- 172.21.15.40:0/3391246568 >> v2:172.21.15.40:3300/0 conn(0x7f448809dd70 0x7f448813ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.904+0000 7f448e3c7700 1 --2- 172.21.15.40:0/3391246568 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f448809d400 0x7f448809d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.904+0000 7f448e3c7700 1 -- 172.21.15.40:0/3391246568 >> 172.21.15.40:0/3391246568 conn(0x7f44880a2a00 msgr2=0x7f44880a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:07.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.904+0000 7f448e3c7700 1 -- 172.21.15.40:0/3391246568 shutdown_connections 2023-09-30T22:30:07.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.904+0000 7f448e3c7700 1 -- 172.21.15.40:0/3391246568 wait complete. 2023-09-30T22:30:07.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.905+0000 7f448e3c7700 1 Processor -- start 2023-09-30T22:30:07.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.905+0000 7f448e3c7700 1 -- start start 2023-09-30T22:30:07.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.905+0000 7f448e3c7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f448809d400 0x7f448806d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:07.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.905+0000 7f448e3c7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f448809dd70 0x7f448806db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:07.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.905+0000 7f448e3c7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4488133e00 0x7f448806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:07.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.905+0000 7f448e3c7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448806ea50 con 0x7f448809d400 2023-09-30T22:30:07.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.905+0000 7f448e3c7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4488070290 con 0x7f4488133e00 2023-09-30T22:30:07.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.905+0000 7f448e3c7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f448812e1a0 con 0x7f448809dd70 2023-09-30T22:30:07.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.906+0000 7f44877fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f448809dd70 0x7f448806db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:07.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.906+0000 7f4487fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f448809d400 0x7f448806d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:07.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.906+0000 7f44877fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f448809dd70 0x7f448806db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58288/0 (socket says 172.21.15.40:58288) 2023-09-30T22:30:07.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.906+0000 7f4487fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f448809d400 0x7f448806d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37850/0 (socket says 172.21.15.40:37850) 2023-09-30T22:30:07.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.906+0000 7f44877fe700 1 -- 172.21.15.40:0/1217098180 learned_addr learned my addr 172.21.15.40:0/1217098180 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:07.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.906+0000 7f44877fe700 1 -- 172.21.15.40:0/1217098180 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4488133e00 msgr2=0x7f448806e090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:30:07.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.906+0000 7f44877fe700 1 --2- 172.21.15.40:0/1217098180 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4488133e00 0x7f448806e090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.906+0000 7f44877fe700 1 -- 172.21.15.40:0/1217098180 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f448809d400 msgr2=0x7f448806d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:07.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.906+0000 7f44877fe700 1 --2- 172.21.15.40:0/1217098180 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f448809d400 0x7f448806d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.906+0000 7f44877fe700 1 -- 172.21.15.40:0/1217098180 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f447c009550 con 0x7f448809dd70 2023-09-30T22:30:07.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.906+0000 7f4487fff700 1 --2- 172.21.15.40:0/1217098180 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f448809d400 0x7f448806d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:07.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.906+0000 7f44877fe700 1 --2- 172.21.15.40:0/1217098180 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f448809dd70 0x7f448806db50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f447c00ebe0 tx=0x7f447c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:07.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.906+0000 7f4484ff9700 1 -- 172.21.15.40:0/1217098180 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c00c850 con 0x7f448809dd70 2023-09-30T22:30:07.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.906+0000 7f448e3c7700 1 -- 172.21.15.40:0/1217098180 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4480009a70 con 0x7f448809dd70 2023-09-30T22:30:07.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.907+0000 7f448e3c7700 1 -- 172.21.15.40:0/1217098180 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4478011d40 con 0x7f448809dd70 2023-09-30T22:30:07.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.907+0000 7f4484ff9700 1 -- 172.21.15.40:0/1217098180 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447c00c9b0 con 0x7f448809dd70 2023-09-30T22:30:07.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.907+0000 7f4484ff9700 1 -- 172.21.15.40:0/1217098180 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c00cd60 con 0x7f448809dd70 2023-09-30T22:30:07.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.908+0000 7f448e3c7700 1 -- 172.21.15.40:0/1217098180 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44680052e0 con 0x7f448809dd70 2023-09-30T22:30:07.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.908+0000 7f4484ff9700 1 -- 172.21.15.40:0/1217098180 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f447c013470 con 0x7f448809dd70 2023-09-30T22:30:07.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.909+0000 7f4484ff9700 1 -- 172.21.15.40:0/1217098180 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f447c011350 con 0x7f448809dd70 2023-09-30T22:30:07.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.914+0000 7f4484ff9700 1 -- 172.21.15.40:0/1217098180 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f447c0102b0 con 0x7f448809dd70 2023-09-30T22:30:07.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.938+0000 7f4fc834d700 1 Processor -- start 2023-09-30T22:30:07.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.939+0000 7f4fc834d700 1 -- start start 2023-09-30T22:30:07.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.939+0000 7f4fc834d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc006b1b0 0x7f4fc0136af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:07.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.939+0000 7f4fc834d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fc0137030 0x7f4fc0139410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:07.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.939+0000 7f4fc834d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc009eb50 con 0x7f4fc006a6d0 2023-09-30T22:30:07.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.939+0000 7f4fc834d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc006b580 con 0x7f4fc006b1b0 2023-09-30T22:30:07.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.939+0000 7f4fc834d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc009dde0 con 0x7f4fc0137030 2023-09-30T22:30:07.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.939+0000 7f4fc60e9700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f4fc006a6d0 0x7f4fc006aaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47680/0 (socket says 172.21.15.40:47680) 2023-09-30T22:30:07.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.939+0000 7f4fc60e9700 1 -- 172.21.15.40:0/1424639898 learned_addr learned my addr 172.21.15.40:0/1424639898 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:07.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.939+0000 7f4fc58e8700 1 --2- 172.21.15.40:0/1424639898 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc006b1b0 0x7f4fc0136af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:07.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.940+0000 7f4fc68ea700 1 --2- 172.21.15.40:0/1424639898 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fc0137030 0x7f4fc0139410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:07.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.940+0000 7f4fc50e7700 1 -- 172.21.15.40:0/1424639898 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2118098863 0 0) 0x7f4fc009eb50 con 0x7f4fc006a6d0 2023-09-30T22:30:07.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.940+0000 7f4fc50e7700 1 -- 172.21.15.40:0/1424639898 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fac0035b0 con 0x7f4fc006a6d0 2023-09-30T22:30:07.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.940+0000 7f4fc68ea700 1 -- 172.21.15.40:0/1424639898 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc006b1b0 msgr2=0x7f4fc0136af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:07.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.940+0000 7f4fc68ea700 1 --2- 172.21.15.40:0/1424639898 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc006b1b0 0x7f4fc0136af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.940+0000 7f4fc68ea700 1 -- 172.21.15.40:0/1424639898 >> v1:172.21.15.40:6789/0 conn(0x7f4fc006a6d0 legacy=0x7f4fc006aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:07.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.940+0000 7f4fc68ea700 1 -- 172.21.15.40:0/1424639898 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc009d4a0 con 0x7f4fc0137030 2023-09-30T22:30:07.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.940+0000 7f4fc58e8700 1 --2- 172.21.15.40:0/1424639898 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc006b1b0 0x7f4fc0136af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:07.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.940+0000 7f4fc68ea700 1 --2- 172.21.15.40:0/1424639898 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fc0137030 0x7f4fc0139410 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4fb800f3a0 tx=0x7f4fb800f6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac512325d47358ee server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:07.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.940+0000 7f4fc50e7700 1 -- 172.21.15.40:0/1424639898 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb8012070 con 0x7f4fc0137030 2023-09-30T22:30:07.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.940+0000 7f4fc50e7700 1 -- 172.21.15.40:0/1424639898 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb800d0d0 con 0x7f4fc0137030 2023-09-30T22:30:07.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.940+0000 7f4fc50e7700 1 -- 172.21.15.40:0/1424639898 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb800fea0 con 0x7f4fc0137030 2023-09-30T22:30:07.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.941+0000 7f4fc834d700 1 -- 172.21.15.40:0/1424639898 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fc0137030 msgr2=0x7f4fc0139410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:07.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.941+0000 7f4fc834d700 1 --2- 172.21.15.40:0/1424639898 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fc0137030 0x7f4fc0139410 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4fb800f3a0 tx=0x7f4fb800f6b0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.941+0000 7f4fc834d700 1 -- 172.21.15.40:0/1424639898 shutdown_connections 2023-09-30T22:30:07.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.941+0000 7f4fc834d700 1 --2- 172.21.15.40:0/1424639898 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fc0137030 0x7f4fc0139410 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.941+0000 7f4fc834d700 1 --2- 172.21.15.40:0/1424639898 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc006b1b0 0x7f4fc0136af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.941+0000 7f4fc834d700 1 -- 172.21.15.40:0/1424639898 >> 172.21.15.40:0/1424639898 conn(0x7f4fc009fb20 msgr2=0x7f4fc009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:07.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.941+0000 7f4fc834d700 1 -- 172.21.15.40:0/1424639898 shutdown_connections 2023-09-30T22:30:07.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.941+0000 7f4fc834d700 1 -- 172.21.15.40:0/1424639898 wait complete. 2023-09-30T22:30:07.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.942+0000 7f4fc834d700 1 Processor -- start 2023-09-30T22:30:07.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.942+0000 7f4fc834d700 1 -- start start 2023-09-30T22:30:07.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.943+0000 7f4fc834d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc006a6d0 0x7f4fc011a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:07.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.943+0000 7f4fc834d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fc006b1b0 0x7f4fc011aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:07.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.943+0000 7f4fc834d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fc0137030 0x7f4fc011af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:07.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.943+0000 7f4fc834d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc011dfe0 con 0x7f4fc006b1b0 2023-09-30T22:30:07.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.943+0000 7f4fc834d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc011d320 con 0x7f4fc006a6d0 2023-09-30T22:30:07.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.943+0000 7f4fc834d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc011d770 con 0x7f4fc0137030 2023-09-30T22:30:07.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.943+0000 7f4fc68ea700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fc0137030 0x7f4fc011af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:07.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.943+0000 7f4fc68ea700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fc0137030 0x7f4fc011af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58298/0 (socket says 172.21.15.40:58298) 2023-09-30T22:30:07.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.943+0000 7f4fc68ea700 1 -- 172.21.15.40:0/2804341393 learned_addr learned my addr 172.21.15.40:0/2804341393 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:07.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.943+0000 7f4fc60e9700 1 --2- 172.21.15.40:0/2804341393 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc006a6d0 0x7f4fc011a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:07.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.943+0000 7f4fc58e8700 1 --2- 172.21.15.40:0/2804341393 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fc006b1b0 0x7f4fc011aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:07.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.943+0000 7f4fc68ea700 1 -- 172.21.15.40:0/2804341393 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc006a6d0 msgr2=0x7f4fc011a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:07.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.943+0000 7f4fc68ea700 1 --2- 172.21.15.40:0/2804341393 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc006a6d0 0x7f4fc011a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.943+0000 7f4fc68ea700 1 -- 172.21.15.40:0/2804341393 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fc006b1b0 msgr2=0x7f4fc011aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:07.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.943+0000 7f4fc68ea700 1 --2- 172.21.15.40:0/2804341393 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fc006b1b0 0x7f4fc011aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.943+0000 7f4fc68ea700 1 -- 172.21.15.40:0/2804341393 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb00094a0 con 0x7f4fc0137030 2023-09-30T22:30:07.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.943+0000 7f4fc58e8700 1 --2- 172.21.15.40:0/2804341393 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fc006b1b0 0x7f4fc011aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:30:07.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.943+0000 7f4fc68ea700 1 --2- 172.21.15.40:0/2804341393 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fc0137030 0x7f4fc011af90 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8016000 tx=0x7f4fb8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:07.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.944+0000 7f4fb6ffd700 1 -- 172.21.15.40:0/2804341393 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb800bb50 con 0x7f4fc0137030 2023-09-30T22:30:07.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.944+0000 7f4fb6ffd700 1 -- 172.21.15.40:0/2804341393 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb800bcb0 con 0x7f4fc0137030 2023-09-30T22:30:07.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.944+0000 7f4fb6ffd700 1 -- 172.21.15.40:0/2804341393 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb8004260 con 0x7f4fc0137030 2023-09-30T22:30:07.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.944+0000 7f4fc834d700 1 -- 172.21.15.40:0/2804341393 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb800f050 con 0x7f4fc0137030 2023-09-30T22:30:07.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.944+0000 7f4fc834d700 1 -- 172.21.15.40:0/2804341393 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc0071560 con 0x7f4fc0137030 2023-09-30T22:30:07.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.945+0000 7f4fb6ffd700 1 -- 172.21.15.40:0/2804341393 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4fb80043c0 con 0x7f4fc0137030 2023-09-30T22:30:07.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.945+0000 7f4fc834d700 1 -- 172.21.15.40:0/2804341393 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc0062380 con 0x7f4fc0137030 2023-09-30T22:30:07.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.945+0000 7f4fb6ffd700 1 -- 172.21.15.40:0/2804341393 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4fb8045300 con 0x7f4fc0137030 2023-09-30T22:30:07.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.950+0000 7f4fb6ffd700 1 -- 172.21.15.40:0/2804341393 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4fb8004670 con 0x7f4fc0137030 2023-09-30T22:30:07.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.986+0000 7ffaa3ac7700 1 Processor -- start 2023-09-30T22:30:07.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.987+0000 7ffaa3ac7700 1 -- start start 2023-09-30T22:30:07.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.987+0000 7ffaa3ac7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa9c09c890 0x7ffa9c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:07.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.987+0000 7ffaa3ac7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffa9c09e480 0x7ffa9c13bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:07.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.987+0000 7ffaa3ac7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa9c0a2600 con 0x7ffa9c09d920 2023-09-30T22:30:07.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.987+0000 7ffaa3ac7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa9c0a29d0 con 0x7ffa9c09e480 2023-09-30T22:30:07.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.987+0000 7ffaa3ac7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c09fb40 con 0x7ffa9c09c890 2023-09-30T22:30:07.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.987+0000 7ffaa1863700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa9c09c890 0x7ffa9c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:07.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.987+0000 7ffaa1863700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa9c09c890 0x7ffa9c09cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58302/0 (socket says 172.21.15.40:58302) 2023-09-30T22:30:07.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.987+0000 7ffaa1863700 1 -- 172.21.15.40:0/1214690417 learned_addr learned my addr 172.21.15.40:0/1214690417 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:07.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.987+0000 7ffaa2064700 1 --2- 172.21.15.40:0/1214690417 >> v2:172.21.15.40:3300/0 conn(0x7ffa9c09e480 0x7ffa9c13bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:07.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.988+0000 7ffaa2064700 1 -- 172.21.15.40:0/1214690417 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa9c09c890 msgr2=0x7ffa9c09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:07.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.988+0000 7ffaa2064700 1 --2- 172.21.15.40:0/1214690417 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa9c09c890 0x7ffa9c09cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.988+0000 7ffaa2064700 1 -- 172.21.15.40:0/1214690417 >> v1:172.21.15.40:6789/0 conn(0x7ffa9c09d920 legacy=0x7ffa9c09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:07.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.988+0000 7ffaa2064700 1 -- 172.21.15.40:0/1214690417 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa9c09fed0 con 0x7ffa9c09e480 2023-09-30T22:30:07.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.988+0000 7ffaa1863700 1 --2- 172.21.15.40:0/1214690417 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa9c09c890 0x7ffa9c09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:07.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.988+0000 7ffaa2064700 1 --2- 172.21.15.40:0/1214690417 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa9c09e480 0x7ffa9c13bc20 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7ffa94009d90 tx=0x7ffa9400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c00213f494949c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:07.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.989+0000 7ffaa0861700 1 -- 172.21.15.40:0/1214690417 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9400e070 con 0x7ffa9c09e480 2023-09-30T22:30:07.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.989+0000 7ffaa0861700 1 -- 172.21.15.40:0/1214690417 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9400bb20 con 0x7ffa9c09e480 2023-09-30T22:30:07.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.989+0000 7ffaa0861700 1 -- 172.21.15.40:0/1214690417 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa94012430 con 0x7ffa9c09e480 2023-09-30T22:30:07.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.989+0000 7ffaa3ac7700 1 -- 172.21.15.40:0/1214690417 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa9c09e480 msgr2=0x7ffa9c13bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:07.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.989+0000 7ffaa3ac7700 1 --2- 172.21.15.40:0/1214690417 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa9c09e480 0x7ffa9c13bc20 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7ffa94009d90 tx=0x7ffa9400b330 comp rx=0 tx=0).stop 2023-09-30T22:30:07.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.989+0000 7ffaa3ac7700 1 -- 172.21.15.40:0/1214690417 shutdown_connections 2023-09-30T22:30:07.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.989+0000 7ffaa3ac7700 1 --2- 172.21.15.40:0/1214690417 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa9c09e480 0x7ffa9c13bc20 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.989+0000 7ffaa3ac7700 1 --2- 172.21.15.40:0/1214690417 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa9c09c890 0x7ffa9c09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.989+0000 7ffaa3ac7700 1 -- 172.21.15.40:0/1214690417 >> 172.21.15.40:0/1214690417 conn(0x7ffa9c0a7080 msgr2=0x7ffa9c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:07.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.989+0000 7ffaa3ac7700 1 -- 172.21.15.40:0/1214690417 shutdown_connections 2023-09-30T22:30:07.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.990+0000 7ffaa3ac7700 1 -- 172.21.15.40:0/1214690417 wait complete. 2023-09-30T22:30:07.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.990+0000 7ffaa3ac7700 1 Processor -- start 2023-09-30T22:30:07.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.990+0000 7ffaa3ac7700 1 -- start start 2023-09-30T22:30:07.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.991+0000 7ffaa3ac7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa9c09c890 0x7ffa9c12d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:07.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.991+0000 7ffaa3ac7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa9c09d920 0x7ffa9c12db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:07.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.991+0000 7ffaa3ac7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa9c09e480 0x7ffa9c12e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:07.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.991+0000 7ffaa3ac7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c131460 con 0x7ffa9c09e480 2023-09-30T22:30:07.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.991+0000 7ffaa3ac7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c09bbb0 con 0x7ffa9c09d920 2023-09-30T22:30:07.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.991+0000 7ffaa3ac7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9c130820 con 0x7ffa9c09c890 2023-09-30T22:30:07.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.991+0000 7ffaa2064700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa9c09e480 0x7ffa9c12e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:07.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.991+0000 7ffaa2064700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa9c09e480 0x7ffa9c12e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37884/0 (socket says 172.21.15.40:37884) 2023-09-30T22:30:07.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.991+0000 7ffaa2064700 1 -- 172.21.15.40:0/1244514902 learned_addr learned my addr 172.21.15.40:0/1244514902 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:07.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.991+0000 7ffaa1863700 1 --2- 172.21.15.40:0/1244514902 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa9c09c890 0x7ffa9c12d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:07.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.991+0000 7ffaa2064700 1 -- 172.21.15.40:0/1244514902 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa9c09c890 msgr2=0x7ffa9c12d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:07.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.991+0000 7ffaa2064700 1 --2- 172.21.15.40:0/1244514902 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa9c09c890 0x7ffa9c12d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.991+0000 7ffaa2064700 1 -- 172.21.15.40:0/1244514902 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa9c09d920 msgr2=0x7ffa9c12db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:07.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.991+0000 7ffaa2064700 1 --2- 172.21.15.40:0/1244514902 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa9c09d920 0x7ffa9c12db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:07.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.991+0000 7ffaa2064700 1 -- 172.21.15.40:0/1244514902 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa98009500 con 0x7ffa9c09e480 2023-09-30T22:30:07.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.991+0000 7ffaa1863700 1 --2- 172.21.15.40:0/1244514902 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa9c09c890 0x7ffa9c12d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:07.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.992+0000 7ffaa2064700 1 --2- 172.21.15.40:0/1244514902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa9c09e480 0x7ffa9c12e050 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7ffa94014040 tx=0x7ffa94004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:07.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.992+0000 7ffa927fc700 1 -- 172.21.15.40:0/1244514902 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa94012430 con 0x7ffa9c09e480 2023-09-30T22:30:07.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.992+0000 7ffa927fc700 1 -- 172.21.15.40:0/1244514902 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa94020070 con 0x7ffa9c09e480 2023-09-30T22:30:07.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.992+0000 7ffa927fc700 1 -- 172.21.15.40:0/1244514902 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa94003ea0 con 0x7ffa9c09e480 2023-09-30T22:30:07.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.992+0000 7ffaa3ac7700 1 -- 172.21.15.40:0/1244514902 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa94009a70 con 0x7ffa9c09e480 2023-09-30T22:30:07.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.992+0000 7ffaa3ac7700 1 -- 172.21.15.40:0/1244514902 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa9c130510 con 0x7ffa9c09e480 2023-09-30T22:30:07.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.993+0000 7ffa927fc700 1 -- 172.21.15.40:0/1244514902 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffa94004280 con 0x7ffa9c09e480 2023-09-30T22:30:07.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.993+0000 7ffaa3ac7700 1 -- 172.21.15.40:0/1244514902 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa9c130c70 con 0x7ffa9c09e480 2023-09-30T22:30:07.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:07.993+0000 7ffa927fc700 1 -- 172.21.15.40:0/1244514902 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ffa94022070 con 0x7ffa9c09e480 2023-09-30T22:30:08.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.002+0000 7ffa927fc700 1 -- 172.21.15.40:0/1244514902 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa9401c400 con 0x7ffa9c09e480 2023-09-30T22:30:08.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.065+0000 7fe7b31d4700 1 Processor -- start 2023-09-30T22:30:08.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.065+0000 7fe7b31d4700 1 -- start start 2023-09-30T22:30:08.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.065+0000 7fe7b31d4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe7ac12e590 0x7fe7ac12e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:08.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.065+0000 7fe7b31d4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7ac12eea0 0x7fe7ac12d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:08.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.065+0000 7fe7b31d4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe7ac12d6d0 0x7fe7ac12db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:08.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.065+0000 7fe7b31d4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7ac09ca30 con 0x7fe7ac12d6d0 2023-09-30T22:30:08.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.065+0000 7fe7b31d4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac09ab70 con 0x7fe7ac12eea0 2023-09-30T22:30:08.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.065+0000 7fe7b31d4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac09bd70 con 0x7fe7ac12e590 2023-09-30T22:30:08.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.065+0000 7fe7b1771700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe7ac12d6d0 0x7fe7ac12db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:08.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.065+0000 7fe7b1771700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe7ac12d6d0 0x7fe7ac12db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37894/0 (socket says 172.21.15.40:37894) 2023-09-30T22:30:08.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.065+0000 7fe7b1771700 1 -- 172.21.15.40:0/4132488760 learned_addr learned my addr 172.21.15.40:0/4132488760 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:08.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.065+0000 7fe7b0f70700 1 --2- 172.21.15.40:0/4132488760 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe7ac12e590 0x7fe7ac12e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:08.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.066+0000 7fe7abfff700 1 --2- 172.21.15.40:0/4132488760 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7ac12eea0 0x7fe7ac12d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:08.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.066+0000 7fe7b1771700 1 -- 172.21.15.40:0/4132488760 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe7ac12e590 msgr2=0x7fe7ac12e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:08.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.066+0000 7fe7b1771700 1 --2- 172.21.15.40:0/4132488760 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe7ac12e590 0x7fe7ac12e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.066+0000 7fe7b1771700 1 -- 172.21.15.40:0/4132488760 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7ac12eea0 msgr2=0x7fe7ac12d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:08.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.066+0000 7fe7b1771700 1 --2- 172.21.15.40:0/4132488760 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7ac12eea0 0x7fe7ac12d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.066+0000 7fe7b1771700 1 -- 172.21.15.40:0/4132488760 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ac09b270 con 0x7fe7ac12d6d0 2023-09-30T22:30:08.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.066+0000 7fe7b0f70700 1 --2- 172.21.15.40:0/4132488760 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe7ac12e590 0x7fe7ac12e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:08.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.066+0000 7fe7b1771700 1 --2- 172.21.15.40:0/4132488760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7ac12d6d0 0x7fe7ac12db70 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4009e50 tx=0x7fe7a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c647361b4148d0ad server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:08.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.066+0000 7fe7ab7fe700 1 -- 172.21.15.40:0/4132488760 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a400e070 con 0x7fe7ac12d6d0 2023-09-30T22:30:08.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.066+0000 7fe7ab7fe700 1 -- 172.21.15.40:0/4132488760 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a400bb10 con 0x7fe7ac12d6d0 2023-09-30T22:30:08.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.066+0000 7fe7ab7fe700 1 -- 172.21.15.40:0/4132488760 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a40126e0 con 0x7fe7ac12d6d0 2023-09-30T22:30:08.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.067+0000 7fe7b31d4700 1 -- 172.21.15.40:0/4132488760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7ac12d6d0 msgr2=0x7fe7ac12db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:08.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.067+0000 7fe7b31d4700 1 --2- 172.21.15.40:0/4132488760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7ac12d6d0 0x7fe7ac12db70 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4009e50 tx=0x7fe7a400b330 comp rx=0 tx=0).stop 2023-09-30T22:30:08.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.067+0000 7fe7b31d4700 1 -- 172.21.15.40:0/4132488760 shutdown_connections 2023-09-30T22:30:08.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.067+0000 7fe7b31d4700 1 --2- 172.21.15.40:0/4132488760 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe7ac12e590 0x7fe7ac12e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.067+0000 7fe7b31d4700 1 --2- 172.21.15.40:0/4132488760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7ac12d6d0 0x7fe7ac12db70 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.067+0000 7fe7b31d4700 1 --2- 172.21.15.40:0/4132488760 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7ac12eea0 0x7fe7ac12d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.067+0000 7fe7b31d4700 1 -- 172.21.15.40:0/4132488760 >> 172.21.15.40:0/4132488760 conn(0x7fe7ac0a2a00 msgr2=0x7fe7ac0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:08.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.067+0000 7fe7b31d4700 1 -- 172.21.15.40:0/4132488760 shutdown_connections 2023-09-30T22:30:08.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.067+0000 7fe7b31d4700 1 -- 172.21.15.40:0/4132488760 wait complete. 2023-09-30T22:30:08.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.068+0000 7fe7b31d4700 1 Processor -- start 2023-09-30T22:30:08.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.068+0000 7fe7b31d4700 1 -- start start 2023-09-30T22:30:08.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.069+0000 7fe7b31d4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7ac12d6d0 0x7fe7ac11a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:08.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.069+0000 7fe7b31d4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7ac12e590 0x7fe7ac11a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:08.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.069+0000 7fe7b31d4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe7ac12eea0 0x7fe7ac11ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:08.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.069+0000 7fe7b31d4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac12c0a0 con 0x7fe7ac12e590 2023-09-30T22:30:08.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.069+0000 7fe7b31d4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac11d140 con 0x7fe7ac12d6d0 2023-09-30T22:30:08.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.069+0000 7fe7b31d4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac09fd70 con 0x7fe7ac12eea0 2023-09-30T22:30:08.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.069+0000 7fe7abfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7ac12e590 0x7fe7ac11a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:08.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.069+0000 7fe7abfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7ac12e590 0x7fe7ac11a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37896/0 (socket says 172.21.15.40:37896) 2023-09-30T22:30:08.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.069+0000 7fe7abfff700 1 -- 172.21.15.40:0/1884348590 learned_addr learned my addr 172.21.15.40:0/1884348590 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:08.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.069+0000 7fe7b1771700 1 --2- 172.21.15.40:0/1884348590 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe7ac12eea0 0x7fe7ac11ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:08.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.069+0000 7fe7b0f70700 1 --2- 172.21.15.40:0/1884348590 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7ac12d6d0 0x7fe7ac11a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:08.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.070+0000 7fe7b1771700 1 -- 172.21.15.40:0/1884348590 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7ac12d6d0 msgr2=0x7fe7ac11a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:08.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.070+0000 7fe7b1771700 1 --2- 172.21.15.40:0/1884348590 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7ac12d6d0 0x7fe7ac11a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.070+0000 7fe7b1771700 1 -- 172.21.15.40:0/1884348590 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7ac12e590 msgr2=0x7fe7ac11a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:08.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.070+0000 7fe7b1771700 1 --2- 172.21.15.40:0/1884348590 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7ac12e590 0x7fe7ac11a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.070+0000 7fe7b1771700 1 -- 172.21.15.40:0/1884348590 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a00094a0 con 0x7fe7ac12eea0 2023-09-30T22:30:08.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.070+0000 7fe7abfff700 1 --2- 172.21.15.40:0/1884348590 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7ac12e590 0x7fe7ac11a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:08.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.070+0000 7fe7b1771700 1 --2- 172.21.15.40:0/1884348590 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe7ac12eea0 0x7fe7ac11ab20 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4019000 tx=0x7fe7a4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:08.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.070+0000 7fe7a97fa700 1 -- 172.21.15.40:0/1884348590 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a4021070 con 0x7fe7ac12eea0 2023-09-30T22:30:08.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.070+0000 7fe7a97fa700 1 -- 172.21.15.40:0/1884348590 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a40092e0 con 0x7fe7ac12eea0 2023-09-30T22:30:08.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.070+0000 7fe7b31d4700 1 -- 172.21.15.40:0/1884348590 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7a4009b30 con 0x7fe7ac12eea0 2023-09-30T22:30:08.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.070+0000 7fe7a97fa700 1 -- 172.21.15.40:0/1884348590 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a400e070 con 0x7fe7ac12eea0 2023-09-30T22:30:08.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.070+0000 7fe7b31d4700 1 -- 172.21.15.40:0/1884348590 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7ac11bd00 con 0x7fe7ac12eea0 2023-09-30T22:30:08.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.071+0000 7fe7a97fa700 1 -- 172.21.15.40:0/1884348590 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe7a40128f0 con 0x7fe7ac12eea0 2023-09-30T22:30:08.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.071+0000 7fe7a97fa700 1 -- 172.21.15.40:0/1884348590 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe7a4044910 con 0x7fe7ac12eea0 2023-09-30T22:30:08.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.072+0000 7fe7b31d4700 1 -- 172.21.15.40:0/1884348590 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7ac11c700 con 0x7fe7ac12eea0 2023-09-30T22:30:08.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.081+0000 7fe7a97fa700 1 -- 172.21.15.40:0/1884348590 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe7a402b080 con 0x7fe7ac12eea0 2023-09-30T22:30:08.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.128+0000 7f448e3c7700 1 -- 172.21.15.40:0/1217098180 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4468005590 con 0x7f448809dd70 2023-09-30T22:30:08.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.128+0000 7f4484ff9700 1 -- 172.21.15.40:0/1217098180 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f447c017030 con 0x7f448809dd70 2023-09-30T22:30:08.129 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:08.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.131+0000 7f448e3c7700 1 -- 172.21.15.40:0/1217098180 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f448809dd70 msgr2=0x7f448806db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:08.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.131+0000 7f448e3c7700 1 --2- 172.21.15.40:0/1217098180 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f448809dd70 0x7f448806db50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f447c00ebe0 tx=0x7f447c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.131+0000 7f448e3c7700 1 -- 172.21.15.40:0/1217098180 shutdown_connections 2023-09-30T22:30:08.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.131+0000 7f448e3c7700 1 --2- 172.21.15.40:0/1217098180 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4488133e00 0x7f448806e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.131+0000 7f448e3c7700 1 --2- 172.21.15.40:0/1217098180 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f448809d400 0x7f448806d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.131+0000 7f448e3c7700 1 --2- 172.21.15.40:0/1217098180 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f448809dd70 0x7f448806db50 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.131+0000 7f448e3c7700 1 -- 172.21.15.40:0/1217098180 >> 172.21.15.40:0/1217098180 conn(0x7f44880a2a00 msgr2=0x7f448812d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:08.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.131+0000 7f448e3c7700 1 -- 172.21.15.40:0/1217098180 shutdown_connections 2023-09-30T22:30:08.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.131+0000 7f448e3c7700 1 -- 172.21.15.40:0/1217098180 wait complete. 2023-09-30T22:30:08.145 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:08.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.206+0000 7ffaa3ac7700 1 -- 172.21.15.40:0/1244514902 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ffa9c062380 con 0x7ffa9c09e480 2023-09-30T22:30:08.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.206+0000 7ffa927fc700 1 -- 172.21.15.40:0/1244514902 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffa9401a380 con 0x7ffa9c09e480 2023-09-30T22:30:08.467 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:08.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.207+0000 7f4fc834d700 1 -- 172.21.15.40:0/2804341393 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4fc01326f0 con 0x7f4fc0137030 2023-09-30T22:30:08.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.208+0000 7f4fb6ffd700 1 -- 172.21.15.40:0/2804341393 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4fb802e020 con 0x7f4fc0137030 2023-09-30T22:30:08.469 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:08.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.208+0000 7ffaa3ac7700 1 -- 172.21.15.40:0/1244514902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa9c09e480 msgr2=0x7ffa9c12e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:08.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.208+0000 7ffaa3ac7700 1 --2- 172.21.15.40:0/1244514902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa9c09e480 0x7ffa9c12e050 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7ffa94014040 tx=0x7ffa94004ad0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.208+0000 7ffaa3ac7700 1 -- 172.21.15.40:0/1244514902 shutdown_connections 2023-09-30T22:30:08.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.208+0000 7ffaa3ac7700 1 --2- 172.21.15.40:0/1244514902 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa9c09c890 0x7ffa9c12d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.208+0000 7ffaa3ac7700 1 --2- 172.21.15.40:0/1244514902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa9c09e480 0x7ffa9c12e050 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.208+0000 7ffaa3ac7700 1 --2- 172.21.15.40:0/1244514902 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa9c09d920 0x7ffa9c12db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.208+0000 7ffaa3ac7700 1 -- 172.21.15.40:0/1244514902 >> 172.21.15.40:0/1244514902 conn(0x7ffa9c0a7080 msgr2=0x7ffa9c0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:08.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.208+0000 7ffaa3ac7700 1 -- 172.21.15.40:0/1244514902 shutdown_connections 2023-09-30T22:30:08.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.209+0000 7ffaa3ac7700 1 -- 172.21.15.40:0/1244514902 wait complete. 2023-09-30T22:30:08.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.210+0000 7f4fc834d700 1 -- 172.21.15.40:0/2804341393 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fc0137030 msgr2=0x7f4fc011af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:08.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.210+0000 7f4fc834d700 1 --2- 172.21.15.40:0/2804341393 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fc0137030 0x7f4fc011af90 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8016000 tx=0x7f4fb8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.210+0000 7f4fc834d700 1 -- 172.21.15.40:0/2804341393 shutdown_connections 2023-09-30T22:30:08.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.210+0000 7f4fc834d700 1 --2- 172.21.15.40:0/2804341393 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4fc0137030 0x7f4fc011af90 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.210+0000 7f4fc834d700 1 --2- 172.21.15.40:0/2804341393 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc006a6d0 0x7f4fc011a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.210+0000 7f4fc834d700 1 --2- 172.21.15.40:0/2804341393 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fc006b1b0 0x7f4fc011aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.210+0000 7f4fc834d700 1 -- 172.21.15.40:0/2804341393 >> 172.21.15.40:0/2804341393 conn(0x7f4fc009fb20 msgr2=0x7f4fc0132930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:08.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.210+0000 7f4fc834d700 1 -- 172.21.15.40:0/2804341393 shutdown_connections 2023-09-30T22:30:08.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.210+0000 7f4fc834d700 1 -- 172.21.15.40:0/2804341393 wait complete. 2023-09-30T22:30:08.720 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:08.721 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:08.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.286+0000 7fe7b31d4700 1 -- 172.21.15.40:0/1884348590 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe7ac06edb0 con 0x7fe7ac12eea0 2023-09-30T22:30:08.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.286+0000 7fe7a97fa700 1 -- 172.21.15.40:0/1884348590 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe7a4017020 con 0x7fe7ac12eea0 2023-09-30T22:30:08.722 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:08.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.288+0000 7fe7b31d4700 1 -- 172.21.15.40:0/1884348590 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe7ac12eea0 msgr2=0x7fe7ac11ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:08.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.288+0000 7fe7b31d4700 1 --2- 172.21.15.40:0/1884348590 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe7ac12eea0 0x7fe7ac11ab20 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4019000 tx=0x7fe7a4004ad0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.289+0000 7fe7b31d4700 1 -- 172.21.15.40:0/1884348590 shutdown_connections 2023-09-30T22:30:08.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.289+0000 7fe7b31d4700 1 --2- 172.21.15.40:0/1884348590 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe7ac12eea0 0x7fe7ac11ab20 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.289+0000 7fe7b31d4700 1 --2- 172.21.15.40:0/1884348590 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7ac12d6d0 0x7fe7ac11a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.289+0000 7fe7b31d4700 1 --2- 172.21.15.40:0/1884348590 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7ac12e590 0x7fe7ac11a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:08.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.289+0000 7fe7b31d4700 1 -- 172.21.15.40:0/1884348590 >> 172.21.15.40:0/1884348590 conn(0x7fe7ac0a2a00 msgr2=0x7fe7ac12c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:08.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.289+0000 7fe7b31d4700 1 -- 172.21.15.40:0/1884348590 shutdown_connections 2023-09-30T22:30:08.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:08.289+0000 7fe7b31d4700 1 -- 172.21.15.40:0/1884348590 wait complete. 2023-09-30T22:30:08.758 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:09.146 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:09.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.286+0000 7fe638320700 1 Processor -- start 2023-09-30T22:30:09.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.286+0000 7fe638320700 1 -- start start 2023-09-30T22:30:09.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.287+0000 7fe638320700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe63009e400 0x7fe630135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:09.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.287+0000 7fe638320700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe630136230 0x7fe630138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:09.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.287+0000 7fe638320700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe63009adf0 con 0x7fe63009d920 2023-09-30T22:30:09.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.287+0000 7fe638320700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe63009e7f0 con 0x7fe630136230 2023-09-30T22:30:09.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.287+0000 7fe638320700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe63009edf0 con 0x7fe63009e400 2023-09-30T22:30:09.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.287+0000 7fe6360bc700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe63009d920 0x7fe63009dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47688/0 (socket says 172.21.15.40:47688) 2023-09-30T22:30:09.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.287+0000 7fe6360bc700 1 -- 172.21.15.40:0/1894532447 learned_addr learned my addr 172.21.15.40:0/1894532447 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:09.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.287+0000 7fe6368bd700 1 --2- 172.21.15.40:0/1894532447 >> v2:172.21.15.40:3300/0 conn(0x7fe630136230 0x7fe630138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:09.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.287+0000 7fe6358bb700 1 --2- 172.21.15.40:0/1894532447 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe63009e400 0x7fe630135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:09.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.288+0000 7fe6358bb700 1 -- 172.21.15.40:0/1894532447 >> v2:172.21.15.40:3300/0 conn(0x7fe630136230 msgr2=0x7fe630138610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:09.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.288+0000 7fe6358bb700 1 --2- 172.21.15.40:0/1894532447 >> v2:172.21.15.40:3300/0 conn(0x7fe630136230 0x7fe630138610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.288+0000 7fe6358bb700 1 -- 172.21.15.40:0/1894532447 >> v1:172.21.15.40:6789/0 conn(0x7fe63009d920 legacy=0x7fe63009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:09.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.288+0000 7fe6358bb700 1 -- 172.21.15.40:0/1894532447 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63009b660 con 0x7fe63009e400 2023-09-30T22:30:09.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.288+0000 7fe6368bd700 1 --2- 172.21.15.40:0/1894532447 >> v2:172.21.15.40:3300/0 conn(0x7fe630136230 0x7fe630138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:09.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.288+0000 7fe6358bb700 1 --2- 172.21.15.40:0/1894532447 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe63009e400 0x7fe630135cf0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fe620009840 tx=0x7fe620009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b957754554716a6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:09.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.288+0000 7fe6350ba700 1 -- 172.21.15.40:0/1894532447 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe620011830 con 0x7fe63009e400 2023-09-30T22:30:09.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.288+0000 7fe6350ba700 1 -- 172.21.15.40:0/1894532447 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe620011990 con 0x7fe63009e400 2023-09-30T22:30:09.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.288+0000 7fe6350ba700 1 -- 172.21.15.40:0/1894532447 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe620011d20 con 0x7fe63009e400 2023-09-30T22:30:09.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.288+0000 7fe638320700 1 -- 172.21.15.40:0/1894532447 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe63009e400 msgr2=0x7fe630135cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:09.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.288+0000 7fe638320700 1 --2- 172.21.15.40:0/1894532447 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe63009e400 0x7fe630135cf0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fe620009840 tx=0x7fe620009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:09.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.289+0000 7fe638320700 1 -- 172.21.15.40:0/1894532447 shutdown_connections 2023-09-30T22:30:09.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.289+0000 7fe638320700 1 --2- 172.21.15.40:0/1894532447 >> v2:172.21.15.40:3300/0 conn(0x7fe630136230 0x7fe630138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.289+0000 7fe638320700 1 --2- 172.21.15.40:0/1894532447 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe63009e400 0x7fe630135cf0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.289+0000 7fe638320700 1 -- 172.21.15.40:0/1894532447 >> 172.21.15.40:0/1894532447 conn(0x7fe63009fb20 msgr2=0x7fe63009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:09.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.289+0000 7fe638320700 1 -- 172.21.15.40:0/1894532447 shutdown_connections 2023-09-30T22:30:09.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.289+0000 7fe638320700 1 -- 172.21.15.40:0/1894532447 wait complete. 2023-09-30T22:30:09.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.290+0000 7fe638320700 1 Processor -- start 2023-09-30T22:30:09.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.290+0000 7fe638320700 1 -- start start 2023-09-30T22:30:09.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.291+0000 7fe638320700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe63009d920 0x7fe6301c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:09.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.291+0000 7fe638320700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe63009e400 0x7fe6301c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:09.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.291+0000 7fe638320700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe630136230 0x7fe6301c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:09.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.291+0000 7fe638320700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63011f7e0 con 0x7fe63009d920 2023-09-30T22:30:09.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.291+0000 7fe638320700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6301216d0 con 0x7fe63009e400 2023-09-30T22:30:09.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.291+0000 7fe638320700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6301265c0 con 0x7fe630136230 2023-09-30T22:30:09.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.291+0000 7fe6360bc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe63009d920 0x7fe6301c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:09.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.291+0000 7fe6360bc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe63009d920 0x7fe6301c84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37916/0 (socket says 172.21.15.40:37916) 2023-09-30T22:30:09.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.291+0000 7fe6360bc700 1 -- 172.21.15.40:0/3774339416 learned_addr learned my addr 172.21.15.40:0/3774339416 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:09.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.291+0000 7fe6358bb700 1 --2- 172.21.15.40:0/3774339416 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe63009e400 0x7fe6301c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:09.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.291+0000 7fe6368bd700 1 --2- 172.21.15.40:0/3774339416 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe630136230 0x7fe6301c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:09.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.291+0000 7fe6360bc700 1 -- 172.21.15.40:0/3774339416 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe630136230 msgr2=0x7fe6301c8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:09.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.291+0000 7fe6360bc700 1 --2- 172.21.15.40:0/3774339416 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe630136230 0x7fe6301c8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.291+0000 7fe6360bc700 1 -- 172.21.15.40:0/3774339416 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe63009e400 msgr2=0x7fe6301c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:09.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.291+0000 7fe6360bc700 1 --2- 172.21.15.40:0/3774339416 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe63009e400 0x7fe6301c8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.291+0000 7fe6360bc700 1 -- 172.21.15.40:0/3774339416 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe628009a70 con 0x7fe63009d920 2023-09-30T22:30:09.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.291+0000 7fe6368bd700 1 --2- 172.21.15.40:0/3774339416 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe630136230 0x7fe6301c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:09.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.291+0000 7fe6358bb700 1 --2- 172.21.15.40:0/3774339416 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe63009e400 0x7fe6301c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:09.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.291+0000 7fe6360bc700 1 --2- 172.21.15.40:0/3774339416 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe63009d920 0x7fe6301c84c0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fe62c00c700 tx=0x7fe62c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:09.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.291+0000 7fe626ffd700 1 -- 172.21.15.40:0/3774339416 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c0074e0 con 0x7fe63009d920 2023-09-30T22:30:09.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.291+0000 7fe626ffd700 1 -- 172.21.15.40:0/3774339416 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62c007640 con 0x7fe63009d920 2023-09-30T22:30:09.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.291+0000 7fe638320700 1 -- 172.21.15.40:0/3774339416 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6200094a0 con 0x7fe63009d920 2023-09-30T22:30:09.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.292+0000 7fe626ffd700 1 -- 172.21.15.40:0/3774339416 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c005a30 con 0x7fe63009d920 2023-09-30T22:30:09.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.292+0000 7fe638320700 1 -- 172.21.15.40:0/3774339416 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe630120a90 con 0x7fe63009d920 2023-09-30T22:30:09.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.292+0000 7fe638320700 1 -- 172.21.15.40:0/3774339416 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe63006aa60 con 0x7fe63009d920 2023-09-30T22:30:09.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.292+0000 7fe626ffd700 1 -- 172.21.15.40:0/3774339416 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe62c005b90 con 0x7fe63009d920 2023-09-30T22:30:09.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.293+0000 7fe626ffd700 1 -- 172.21.15.40:0/3774339416 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe62c03eab0 con 0x7fe63009d920 2023-09-30T22:30:09.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.298+0000 7fe626ffd700 1 -- 172.21.15.40:0/3774339416 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe62c01b3b0 con 0x7fe63009d920 2023-09-30T22:30:09.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.492+0000 7fe638320700 1 -- 172.21.15.40:0/3774339416 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe630062380 con 0x7fe63009d920 2023-09-30T22:30:09.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.492+0000 7fe626ffd700 1 -- 172.21.15.40:0/3774339416 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe62c017030 con 0x7fe63009d920 2023-09-30T22:30:09.493 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:09.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.494+0000 7fe638320700 1 -- 172.21.15.40:0/3774339416 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe63009d920 msgr2=0x7fe6301c84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:09.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.494+0000 7fe638320700 1 --2- 172.21.15.40:0/3774339416 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe63009d920 0x7fe6301c84c0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fe62c00c700 tx=0x7fe62c00ca10 comp rx=0 tx=0).stop 2023-09-30T22:30:09.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.494+0000 7fe638320700 1 -- 172.21.15.40:0/3774339416 shutdown_connections 2023-09-30T22:30:09.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.494+0000 7fe638320700 1 --2- 172.21.15.40:0/3774339416 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe630136230 0x7fe6301c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.494+0000 7fe638320700 1 --2- 172.21.15.40:0/3774339416 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe63009d920 0x7fe6301c84c0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.494+0000 7fe638320700 1 --2- 172.21.15.40:0/3774339416 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe63009e400 0x7fe6301c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.494+0000 7fe638320700 1 -- 172.21.15.40:0/3774339416 >> 172.21.15.40:0/3774339416 conn(0x7fe63009fb20 msgr2=0x7fe630119730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:09.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.494+0000 7fe638320700 1 -- 172.21.15.40:0/3774339416 shutdown_connections 2023-09-30T22:30:09.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.494+0000 7fe638320700 1 -- 172.21.15.40:0/3774339416 wait complete. 2023-09-30T22:30:09.507 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:09.720 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:09.722 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:09.759 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:09.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.853+0000 7f894ca48700 1 Processor -- start 2023-09-30T22:30:09.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.853+0000 7f894ca48700 1 -- start start 2023-09-30T22:30:09.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.853+0000 7f93a8f52700 1 Processor -- start 2023-09-30T22:30:09.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.853+0000 7f93a8f52700 1 -- start start 2023-09-30T22:30:09.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.854+0000 7f894ca48700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f894809f0f0 0x7f8948138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:09.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.854+0000 7f894ca48700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f894809e400 0x7f894813b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:09.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.854+0000 7f894ca48700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f894809f940 con 0x7f894809d920 2023-09-30T22:30:09.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.854+0000 7f894ca48700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894806b4c0 con 0x7f894809e400 2023-09-30T22:30:09.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.854+0000 7f894ca48700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f894809a8f0 con 0x7f894809f0f0 2023-09-30T22:30:09.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.854+0000 7f8946d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f894809e400 0x7f894813b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:09.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.854+0000 7f894659c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f894809d920 0x7f894809dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47698/0 (socket says 172.21.15.40:47698) 2023-09-30T22:30:09.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.854+0000 7f894659c700 1 -- 172.21.15.40:0/2853732968 learned_addr learned my addr 172.21.15.40:0/2853732968 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:09.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.854+0000 7f8945d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f894809f0f0 0x7f8948138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:09.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.854+0000 7f93a8f52700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f93a409d920 0x7f93a409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:09.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.854+0000 7f93a8f52700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93a409f0f0 0x7f93a409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:09.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.854+0000 7f93a8f52700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a409f940 con 0x7f93a4133ca0 2023-09-30T22:30:09.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.854+0000 7f93a8f52700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a406b4c0 con 0x7f93a409d920 2023-09-30T22:30:09.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.854+0000 7f93a8f52700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a409a8f0 con 0x7f93a409f0f0 2023-09-30T22:30:09.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.854+0000 7f8945d9b700 1 -- 172.21.15.40:0/2853732968 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f894809e400 msgr2=0x7f894813b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:09.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.854+0000 7f93a1d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93a409f0f0 0x7f93a409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:09.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.854+0000 7f93a2d9d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f93a4133ca0 0x7f93a4134120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47714/0 (socket says 172.21.15.40:47714) 2023-09-30T22:30:09.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.854+0000 7f93a2d9d700 1 -- 172.21.15.40:0/2334577028 learned_addr learned my addr 172.21.15.40:0/2334577028 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:09.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.854+0000 7f8945d9b700 1 --2- 172.21.15.40:0/2853732968 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f894809e400 0x7f894813b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.854+0000 7f8945d9b700 1 -- 172.21.15.40:0/2853732968 >> v1:172.21.15.40:6789/0 conn(0x7f894809d920 legacy=0x7f894809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:09.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.854+0000 7f894559a700 1 -- 172.21.15.40:0/2853732968 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3186835868 0 0) 0x7f894809f940 con 0x7f894809d920 2023-09-30T22:30:09.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.855+0000 7f8945d9b700 1 -- 172.21.15.40:0/2853732968 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f894809f6e0 con 0x7f894809f0f0 2023-09-30T22:30:09.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.854+0000 7f93a259c700 1 --2- 172.21.15.40:0/2334577028 >> v2:172.21.15.40:3300/0 conn(0x7f93a409d920 0x7f93a409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:09.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.855+0000 7f8946d9d700 1 --2- 172.21.15.40:0/2853732968 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f894809e400 0x7f894813b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:09.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.855+0000 7f8945d9b700 1 --2- 172.21.15.40:0/2853732968 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f894809f0f0 0x7f8948138ee0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f893c0098a0 tx=0x7f893c009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24bddaee45e9bbc8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:09.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.855+0000 7f93a1d9b700 1 -- 172.21.15.40:0/2334577028 >> v2:172.21.15.40:3300/0 conn(0x7f93a409d920 msgr2=0x7f93a409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:09.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.855+0000 7f93a1d9b700 1 --2- 172.21.15.40:0/2334577028 >> v2:172.21.15.40:3300/0 conn(0x7f93a409d920 0x7f93a409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.855+0000 7f93a1d9b700 1 -- 172.21.15.40:0/2334577028 >> v1:172.21.15.40:6789/0 conn(0x7f93a4133ca0 legacy=0x7f93a4134120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:09.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.855+0000 7f93a1d9b700 1 -- 172.21.15.40:0/2334577028 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a409f6e0 con 0x7f93a409f0f0 2023-09-30T22:30:09.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.855+0000 7f93a259c700 1 --2- 172.21.15.40:0/2334577028 >> v2:172.21.15.40:3300/0 conn(0x7f93a409d920 0x7f93a409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:09.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.855+0000 7f894559a700 1 -- 172.21.15.40:0/2853732968 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c011830 con 0x7f894809f0f0 2023-09-30T22:30:09.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.855+0000 7f93a1d9b700 1 --2- 172.21.15.40:0/2334577028 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93a409f0f0 0x7f93a409e230 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f9398009840 tx=0x7f9398009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81a2c581c420ac73 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:09.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.855+0000 7f894559a700 1 -- 172.21.15.40:0/2853732968 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893c011990 con 0x7f894809f0f0 2023-09-30T22:30:09.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.855+0000 7f894559a700 1 -- 172.21.15.40:0/2853732968 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c011d20 con 0x7f894809f0f0 2023-09-30T22:30:09.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.855+0000 7f93a159a700 1 -- 172.21.15.40:0/2334577028 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9398011830 con 0x7f93a409f0f0 2023-09-30T22:30:09.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.855+0000 7f93a159a700 1 -- 172.21.15.40:0/2334577028 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9398011990 con 0x7f93a409f0f0 2023-09-30T22:30:09.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.855+0000 7f93a159a700 1 -- 172.21.15.40:0/2334577028 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9398011d20 con 0x7f93a409f0f0 2023-09-30T22:30:09.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.856+0000 7f894ca48700 1 -- 172.21.15.40:0/2853732968 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f894809f0f0 msgr2=0x7f8948138ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:09.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.856+0000 7f894ca48700 1 --2- 172.21.15.40:0/2853732968 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f894809f0f0 0x7f8948138ee0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f893c0098a0 tx=0x7f893c009bb0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.856+0000 7f894ca48700 1 -- 172.21.15.40:0/2853732968 shutdown_connections 2023-09-30T22:30:09.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.856+0000 7f894ca48700 1 --2- 172.21.15.40:0/2853732968 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f894809e400 0x7f894813b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.856+0000 7f894ca48700 1 --2- 172.21.15.40:0/2853732968 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f894809f0f0 0x7f8948138ee0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.856+0000 7f894ca48700 1 -- 172.21.15.40:0/2853732968 >> 172.21.15.40:0/2853732968 conn(0x7f894809fb20 msgr2=0x7f894809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:09.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.856+0000 7f894ca48700 1 -- 172.21.15.40:0/2853732968 shutdown_connections 2023-09-30T22:30:09.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.856+0000 7f93a8f52700 1 -- 172.21.15.40:0/2334577028 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93a409f0f0 msgr2=0x7f93a409e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:09.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.856+0000 7f93a8f52700 1 --2- 172.21.15.40:0/2334577028 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93a409f0f0 0x7f93a409e230 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f9398009840 tx=0x7f9398009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:09.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.856+0000 7f894ca48700 1 -- 172.21.15.40:0/2853732968 wait complete. 2023-09-30T22:30:09.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.856+0000 7f93a8f52700 1 -- 172.21.15.40:0/2334577028 shutdown_connections 2023-09-30T22:30:09.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.856+0000 7f93a8f52700 1 --2- 172.21.15.40:0/2334577028 >> v2:172.21.15.40:3300/0 conn(0x7f93a409d920 0x7f93a409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.856+0000 7f93a8f52700 1 --2- 172.21.15.40:0/2334577028 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93a409f0f0 0x7f93a409e230 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.856+0000 7f93a8f52700 1 -- 172.21.15.40:0/2334577028 >> 172.21.15.40:0/2334577028 conn(0x7f93a409fb20 msgr2=0x7f93a409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:09.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.857+0000 7f894ca48700 1 Processor -- start 2023-09-30T22:30:09.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.857+0000 7f93a8f52700 1 -- 172.21.15.40:0/2334577028 shutdown_connections 2023-09-30T22:30:09.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.857+0000 7f93a8f52700 1 -- 172.21.15.40:0/2334577028 wait complete. 2023-09-30T22:30:09.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.857+0000 7f894ca48700 1 -- start start 2023-09-30T22:30:09.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.858+0000 7f894ca48700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f894809d920 0x7f89481331b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:09.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.858+0000 7f894ca48700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f894809e400 0x7f89481336f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:09.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.858+0000 7f894ca48700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8948133c30 0x7f894811db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:09.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.858+0000 7f894ca48700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8948134250 con 0x7f894809d920 2023-09-30T22:30:09.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.858+0000 7f894ca48700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89480a31b0 con 0x7f894809e400 2023-09-30T22:30:09.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.858+0000 7f894ca48700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f894809c9e0 con 0x7f8948133c30 2023-09-30T22:30:09.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.858+0000 7f8945d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f894809e400 0x7f89481336f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:09.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.858+0000 7f8945d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f894809e400 0x7f89481336f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50638/0 (socket says 172.21.15.40:50638) 2023-09-30T22:30:09.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.858+0000 7f8945d9b700 1 -- 172.21.15.40:0/2647885577 learned_addr learned my addr 172.21.15.40:0/2647885577 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:09.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.858+0000 7f894659c700 1 --2- 172.21.15.40:0/2647885577 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f894809d920 0x7f89481331b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:09.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.858+0000 7f8946d9d700 1 --2- 172.21.15.40:0/2647885577 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8948133c30 0x7f894811db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:09.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.858+0000 7f8945d9b700 1 -- 172.21.15.40:0/2647885577 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8948133c30 msgr2=0x7f894811db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:09.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.858+0000 7f8945d9b700 1 --2- 172.21.15.40:0/2647885577 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8948133c30 0x7f894811db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.858+0000 7f8945d9b700 1 -- 172.21.15.40:0/2647885577 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f894809d920 msgr2=0x7f89481331b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:09.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.858+0000 7f8945d9b700 1 --2- 172.21.15.40:0/2647885577 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f894809d920 0x7f89481331b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.858+0000 7f8945d9b700 1 -- 172.21.15.40:0/2647885577 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8940009a70 con 0x7f894809e400 2023-09-30T22:30:09.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.858+0000 7f93a8f52700 1 Processor -- start 2023-09-30T22:30:09.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.859+0000 7f93a8f52700 1 -- start start 2023-09-30T22:30:09.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.859+0000 7f93a8f52700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93a409d920 0x7f93a411e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:09.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.859+0000 7f93a8f52700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f93a4133ca0 0x7f93a411e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:09.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.859+0000 7f93a8f52700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93a41317a0 0x7f93a411eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:09.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.859+0000 7f93a8f52700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a4122890 con 0x7f93a41317a0 2023-09-30T22:30:09.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.859+0000 7f93a8f52700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a4121ed0 con 0x7f93a409d920 2023-09-30T22:30:09.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.859+0000 7f93a8f52700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93a40a2980 con 0x7f93a4133ca0 2023-09-30T22:30:09.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.859+0000 7f93a259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93a409d920 0x7f93a411e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:09.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.859+0000 7f93a2d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93a41317a0 0x7f93a411eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:09.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.859+0000 7f93a259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93a409d920 0x7f93a411e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50654/0 (socket says 172.21.15.40:50654) 2023-09-30T22:30:09.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.859+0000 7f93a259c700 1 -- 172.21.15.40:0/2500201704 learned_addr learned my addr 172.21.15.40:0/2500201704 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:09.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.859+0000 7f93a1d9b700 1 --2- 172.21.15.40:0/2500201704 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f93a4133ca0 0x7f93a411e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:09.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.860+0000 7f8945d9b700 1 --2- 172.21.15.40:0/2647885577 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f894809e400 0x7f89481336f0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f893c0090b0 tx=0x7f893c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:09.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.860+0000 7f8936ffd700 1 -- 172.21.15.40:0/2647885577 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c0044d0 con 0x7f894809e400 2023-09-30T22:30:09.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.860+0000 7f8936ffd700 1 -- 172.21.15.40:0/2647885577 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893c0036a0 con 0x7f894809e400 2023-09-30T22:30:09.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.860+0000 7f8936ffd700 1 -- 172.21.15.40:0/2647885577 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c003a30 con 0x7f894809e400 2023-09-30T22:30:09.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.860+0000 7f894ca48700 1 -- 172.21.15.40:0/2647885577 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f893c0094a0 con 0x7f894809e400 2023-09-30T22:30:09.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.860+0000 7f93a1d9b700 1 -- 172.21.15.40:0/2500201704 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93a409d920 msgr2=0x7f93a411e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:09.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.860+0000 7f93a1d9b700 1 --2- 172.21.15.40:0/2500201704 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93a409d920 0x7f93a411e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.860+0000 7f93a1d9b700 1 -- 172.21.15.40:0/2500201704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93a41317a0 msgr2=0x7f93a411eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:09.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.860+0000 7f93a1d9b700 1 --2- 172.21.15.40:0/2500201704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93a41317a0 0x7f93a411eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.860+0000 7f93a1d9b700 1 -- 172.21.15.40:0/2500201704 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93980094a0 con 0x7f93a4133ca0 2023-09-30T22:30:09.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.860+0000 7f93a2d9d700 1 --2- 172.21.15.40:0/2500201704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93a41317a0 0x7f93a411eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:09.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.860+0000 7f894ca48700 1 -- 172.21.15.40:0/2647885577 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8948120550 con 0x7f894809e400 2023-09-30T22:30:09.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.860+0000 7f93a1d9b700 1 --2- 172.21.15.40:0/2500201704 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f93a4133ca0 0x7f93a411e990 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f9398016000 tx=0x7f9398004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:09.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.860+0000 7f9392ffd700 1 -- 172.21.15.40:0/2500201704 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93980036a0 con 0x7f93a4133ca0 2023-09-30T22:30:09.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.860+0000 7f9392ffd700 1 -- 172.21.15.40:0/2500201704 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939801f070 con 0x7f93a4133ca0 2023-09-30T22:30:09.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.861+0000 7f93a8f52700 1 -- 172.21.15.40:0/2500201704 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93a4121210 con 0x7f93a4133ca0 2023-09-30T22:30:09.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.861+0000 7f93a8f52700 1 -- 172.21.15.40:0/2500201704 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a411ffc0 con 0x7f93a4133ca0 2023-09-30T22:30:09.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.861+0000 7f8936ffd700 1 -- 172.21.15.40:0/2647885577 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f893c003b90 con 0x7f894809e400 2023-09-30T22:30:09.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.861+0000 7f894ca48700 1 -- 172.21.15.40:0/2647885577 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89480a3ed0 con 0x7f894809e400 2023-09-30T22:30:09.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.861+0000 7f8936ffd700 1 -- 172.21.15.40:0/2647885577 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f893c040b80 con 0x7f894809e400 2023-09-30T22:30:09.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.861+0000 7f9392ffd700 1 -- 172.21.15.40:0/2500201704 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9398003a20 con 0x7f93a4133ca0 2023-09-30T22:30:09.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.861+0000 7f9392ffd700 1 -- 172.21.15.40:0/2500201704 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9398003b80 con 0x7f93a4133ca0 2023-09-30T22:30:09.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.862+0000 7f9392ffd700 1 -- 172.21.15.40:0/2500201704 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9398021070 con 0x7f93a4133ca0 2023-09-30T22:30:09.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.862+0000 7f93a8f52700 1 -- 172.21.15.40:0/2500201704 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93880052e0 con 0x7f93a4133ca0 2023-09-30T22:30:09.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.866+0000 7f8936ffd700 1 -- 172.21.15.40:0/2647885577 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f893c01a420 con 0x7f894809e400 2023-09-30T22:30:09.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.867+0000 7f9392ffd700 1 -- 172.21.15.40:0/2500201704 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9398015070 con 0x7f93a4133ca0 2023-09-30T22:30:09.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.897+0000 7f1ce7296700 1 Processor -- start 2023-09-30T22:30:09.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.897+0000 7f1ce7296700 1 -- start start 2023-09-30T22:30:09.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.898+0000 7f1ce7296700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ce009c890 0x7f1ce009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:09.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.898+0000 7f1ce7296700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ce009e480 0x7f1ce013bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:09.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.898+0000 7f1ce7296700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce00a2600 con 0x7f1ce009d920 2023-09-30T22:30:09.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.898+0000 7f1ce7296700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce00a29d0 con 0x7f1ce009c890 2023-09-30T22:30:09.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.898+0000 7f1ce7296700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce009fb40 con 0x7f1ce009e480 2023-09-30T22:30:09.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.898+0000 7f1ce5032700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ce009c890 0x7f1ce009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:09.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.898+0000 7f1ce5032700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ce009c890 0x7f1ce009cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50660/0 (socket says 172.21.15.40:50660) 2023-09-30T22:30:09.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.898+0000 7f1ce5032700 1 -- 172.21.15.40:0/2210952068 learned_addr learned my addr 172.21.15.40:0/2210952068 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:09.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.898+0000 7f1ce5833700 1 --2- 172.21.15.40:0/2210952068 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ce009e480 0x7f1ce013bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:09.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.898+0000 7f1ce5032700 1 -- 172.21.15.40:0/2210952068 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ce009e480 msgr2=0x7f1ce013bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:09.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.898+0000 7f1ce5032700 1 --2- 172.21.15.40:0/2210952068 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ce009e480 0x7f1ce013bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.898+0000 7f1ce5032700 1 -- 172.21.15.40:0/2210952068 >> v1:172.21.15.40:6789/0 conn(0x7f1ce009d920 legacy=0x7f1ce009dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:09.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.898+0000 7f1cd7fff700 1 -- 172.21.15.40:0/2210952068 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3844448033 0 0) 0x7f1ce00a2600 con 0x7f1ce009d920 2023-09-30T22:30:09.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.898+0000 7f1ce5032700 1 -- 172.21.15.40:0/2210952068 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce009fed0 con 0x7f1ce009c890 2023-09-30T22:30:09.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.899+0000 7f1ce5032700 1 --2- 172.21.15.40:0/2210952068 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ce009c890 0x7f1ce009cc60 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc0098f0 tx=0x7f1cdc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d80dbbb8fb0b5c95 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:09.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.899+0000 7f1cd7fff700 1 -- 172.21.15.40:0/2210952068 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc005e30 con 0x7f1ce009c890 2023-09-30T22:30:09.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.899+0000 7f1cd7fff700 1 -- 172.21.15.40:0/2210952068 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cdc004030 con 0x7f1ce009c890 2023-09-30T22:30:09.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.899+0000 7f1cd7fff700 1 -- 172.21.15.40:0/2210952068 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc0043e0 con 0x7f1ce009c890 2023-09-30T22:30:09.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.900+0000 7f1ce7296700 1 -- 172.21.15.40:0/2210952068 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ce009c890 msgr2=0x7f1ce009cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:09.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.900+0000 7f1ce7296700 1 --2- 172.21.15.40:0/2210952068 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ce009c890 0x7f1ce009cc60 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc0098f0 tx=0x7f1cdc009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:09.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.900+0000 7f1ce7296700 1 -- 172.21.15.40:0/2210952068 shutdown_connections 2023-09-30T22:30:09.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.900+0000 7f1ce7296700 1 --2- 172.21.15.40:0/2210952068 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ce009e480 0x7f1ce013bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.900+0000 7f1ce7296700 1 --2- 172.21.15.40:0/2210952068 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ce009c890 0x7f1ce009cc60 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.900+0000 7f1ce7296700 1 -- 172.21.15.40:0/2210952068 >> 172.21.15.40:0/2210952068 conn(0x7f1ce00a7080 msgr2=0x7f1ce00a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:09.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.900+0000 7f1ce7296700 1 -- 172.21.15.40:0/2210952068 shutdown_connections 2023-09-30T22:30:09.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.900+0000 7f1ce7296700 1 -- 172.21.15.40:0/2210952068 wait complete. 2023-09-30T22:30:09.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.901+0000 7f1ce7296700 1 Processor -- start 2023-09-30T22:30:09.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.901+0000 7f1ce7296700 1 -- start start 2023-09-30T22:30:09.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.902+0000 7f1ce7296700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ce009c890 0x7f1ce012f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:09.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.902+0000 7f1ce7296700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ce009d920 0x7f1ce012fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:09.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.902+0000 7f1ce7296700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ce009e480 0x7f1ce0130170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:09.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.902+0000 7f1ce7296700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce012eb10 con 0x7f1ce009c890 2023-09-30T22:30:09.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.902+0000 7f1ce7296700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce00a5bf0 con 0x7f1ce009d920 2023-09-30T22:30:09.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.902+0000 7f1ce7296700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce009ecf0 con 0x7f1ce009e480 2023-09-30T22:30:09.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.902+0000 7f1ce5032700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ce009c890 0x7f1ce012f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:09.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.902+0000 7f1ce5032700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ce009c890 0x7f1ce012f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37950/0 (socket says 172.21.15.40:37950) 2023-09-30T22:30:09.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.902+0000 7f1ce5032700 1 -- 172.21.15.40:0/3075409286 learned_addr learned my addr 172.21.15.40:0/3075409286 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:09.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.902+0000 7f1ce4831700 1 --2- 172.21.15.40:0/3075409286 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ce009d920 0x7f1ce012fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:09.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.902+0000 7f1ce5833700 1 --2- 172.21.15.40:0/3075409286 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ce009e480 0x7f1ce0130170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:09.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.902+0000 7f1ce5032700 1 -- 172.21.15.40:0/3075409286 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ce009e480 msgr2=0x7f1ce0130170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:09.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.902+0000 7f1ce5032700 1 --2- 172.21.15.40:0/3075409286 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ce009e480 0x7f1ce0130170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.902+0000 7f1ce5032700 1 -- 172.21.15.40:0/3075409286 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ce009d920 msgr2=0x7f1ce012fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:09.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.902+0000 7f1ce5032700 1 --2- 172.21.15.40:0/3075409286 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ce009d920 0x7f1ce012fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:09.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.902+0000 7f1ce5032700 1 -- 172.21.15.40:0/3075409286 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cdc009500 con 0x7f1ce009c890 2023-09-30T22:30:09.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.902+0000 7f1ce4831700 1 --2- 172.21.15.40:0/3075409286 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ce009d920 0x7f1ce012fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:09.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.902+0000 7f1ce5833700 1 --2- 172.21.15.40:0/3075409286 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ce009e480 0x7f1ce0130170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:09.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.903+0000 7f1ce5032700 1 --2- 172.21.15.40:0/3075409286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ce009c890 0x7f1ce012f6f0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc009c40 tx=0x7f1cdc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:09.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.903+0000 7f1cd5ffb700 1 -- 172.21.15.40:0/3075409286 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc003cb0 con 0x7f1ce009c890 2023-09-30T22:30:09.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.903+0000 7f1cd5ffb700 1 -- 172.21.15.40:0/3075409286 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cdc003e10 con 0x7f1ce009c890 2023-09-30T22:30:09.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.903+0000 7f1ce7296700 1 -- 172.21.15.40:0/3075409286 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce012e2a0 con 0x7f1ce009c890 2023-09-30T22:30:09.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.903+0000 7f1cd5ffb700 1 -- 172.21.15.40:0/3075409286 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc01c660 con 0x7f1ce009c890 2023-09-30T22:30:09.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.903+0000 7f1ce7296700 1 -- 172.21.15.40:0/3075409286 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce012f2a0 con 0x7f1ce009c890 2023-09-30T22:30:09.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.904+0000 7f1ce7296700 1 -- 172.21.15.40:0/3075409286 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce012e690 con 0x7f1ce009c890 2023-09-30T22:30:09.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.905+0000 7f1cd5ffb700 1 -- 172.21.15.40:0/3075409286 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1cdc01c7c0 con 0x7f1ce009c890 2023-09-30T22:30:09.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.905+0000 7f1cd5ffb700 1 -- 172.21.15.40:0/3075409286 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f1cdc040a10 con 0x7f1ce009c890 2023-09-30T22:30:09.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:09.909+0000 7f1cd5ffb700 1 -- 172.21.15.40:0/3075409286 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1cdc02e3e0 con 0x7f1ce009c890 2023-09-30T22:30:10.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.064+0000 7f93a8f52700 1 -- 172.21.15.40:0/2500201704 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9388005150 con 0x7f93a4133ca0 2023-09-30T22:30:10.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.064+0000 7f9392ffd700 1 -- 172.21.15.40:0/2500201704 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f939800b3e0 con 0x7f93a4133ca0 2023-09-30T22:30:10.065 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:10.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.066+0000 7f894ca48700 1 -- 172.21.15.40:0/2647885577 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f894811fe20 con 0x7f894809e400 2023-09-30T22:30:10.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.067+0000 7f93a8f52700 1 -- 172.21.15.40:0/2500201704 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f93a4133ca0 msgr2=0x7f93a411e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:10.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.067+0000 7f93a8f52700 1 --2- 172.21.15.40:0/2500201704 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f93a4133ca0 0x7f93a411e990 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f9398016000 tx=0x7f9398004750 comp rx=0 tx=0).stop 2023-09-30T22:30:10.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.067+0000 7f93a8f52700 1 -- 172.21.15.40:0/2500201704 shutdown_connections 2023-09-30T22:30:10.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.067+0000 7f93a8f52700 1 --2- 172.21.15.40:0/2500201704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93a41317a0 0x7f93a411eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.067+0000 7f93a8f52700 1 --2- 172.21.15.40:0/2500201704 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93a409d920 0x7f93a411e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.067+0000 7f93a8f52700 1 --2- 172.21.15.40:0/2500201704 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f93a4133ca0 0x7f93a411e990 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.067+0000 7f93a8f52700 1 -- 172.21.15.40:0/2500201704 >> 172.21.15.40:0/2500201704 conn(0x7f93a409fb20 msgr2=0x7f93a4133480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:10.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.067+0000 7f8936ffd700 1 -- 172.21.15.40:0/2647885577 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f893c015070 con 0x7f894809e400 2023-09-30T22:30:10.069 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:10.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.067+0000 7f93a8f52700 1 -- 172.21.15.40:0/2500201704 shutdown_connections 2023-09-30T22:30:10.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.067+0000 7f93a8f52700 1 -- 172.21.15.40:0/2500201704 wait complete. 2023-09-30T22:30:10.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.069+0000 7f894ca48700 1 -- 172.21.15.40:0/2647885577 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f894809e400 msgr2=0x7f89481336f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:10.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.069+0000 7f894ca48700 1 --2- 172.21.15.40:0/2647885577 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f894809e400 0x7f89481336f0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f893c0090b0 tx=0x7f893c004750 comp rx=0 tx=0).stop 2023-09-30T22:30:10.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.069+0000 7f894ca48700 1 -- 172.21.15.40:0/2647885577 shutdown_connections 2023-09-30T22:30:10.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.069+0000 7f894ca48700 1 --2- 172.21.15.40:0/2647885577 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8948133c30 0x7f894811db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.069+0000 7f894ca48700 1 --2- 172.21.15.40:0/2647885577 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f894809d920 0x7f89481331b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.069+0000 7f894ca48700 1 --2- 172.21.15.40:0/2647885577 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f894809e400 0x7f89481336f0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.069+0000 7f894ca48700 1 -- 172.21.15.40:0/2647885577 >> 172.21.15.40:0/2647885577 conn(0x7f894809fb20 msgr2=0x7f8948137150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:10.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.069+0000 7f894ca48700 1 -- 172.21.15.40:0/2647885577 shutdown_connections 2023-09-30T22:30:10.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.069+0000 7f894ca48700 1 -- 172.21.15.40:0/2647885577 wait complete. 2023-09-30T22:30:10.082 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:10.083 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:10.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.105+0000 7f1ce7296700 1 -- 172.21.15.40:0/3075409286 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1ce012e690 con 0x7f1ce009c890 2023-09-30T22:30:10.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.105+0000 7f1cd5ffb700 1 -- 172.21.15.40:0/3075409286 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1ce012e690 con 0x7f1ce009c890 2023-09-30T22:30:10.107 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:10.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.108+0000 7f1ce7296700 1 -- 172.21.15.40:0/3075409286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ce009c890 msgr2=0x7f1ce012f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:10.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.108+0000 7f1ce7296700 1 --2- 172.21.15.40:0/3075409286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ce009c890 0x7f1ce012f6f0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc009c40 tx=0x7f1cdc004750 comp rx=0 tx=0).stop 2023-09-30T22:30:10.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.108+0000 7f1ce7296700 1 -- 172.21.15.40:0/3075409286 shutdown_connections 2023-09-30T22:30:10.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.108+0000 7f1ce7296700 1 --2- 172.21.15.40:0/3075409286 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ce009e480 0x7f1ce0130170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.108+0000 7f1ce7296700 1 --2- 172.21.15.40:0/3075409286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ce009c890 0x7f1ce012f6f0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.108+0000 7f1ce7296700 1 --2- 172.21.15.40:0/3075409286 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ce009d920 0x7f1ce012fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.108+0000 7f1ce7296700 1 -- 172.21.15.40:0/3075409286 >> 172.21.15.40:0/3075409286 conn(0x7f1ce00a7080 msgr2=0x7f1ce01bb100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:10.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.108+0000 7f1ce7296700 1 -- 172.21.15.40:0/3075409286 shutdown_connections 2023-09-30T22:30:10.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.108+0000 7f1ce7296700 1 -- 172.21.15.40:0/3075409286 wait complete. 2023-09-30T22:30:10.120 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:10.508 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:10.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.637+0000 7ff89c1e1700 1 Processor -- start 2023-09-30T22:30:10.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.637+0000 7ff89c1e1700 1 -- start start 2023-09-30T22:30:10.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.637+0000 7ff89c1e1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff89409fbb0 0x7ff89406c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:10.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.638+0000 7ff89c1e1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff89406ced0 0x7ff89406d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:10.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.638+0000 7ff89c1e1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff89406e3f0 con 0x7ff894138370 2023-09-30T22:30:10.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.638+0000 7ff89c1e1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff89409ff80 con 0x7ff89406ced0 2023-09-30T22:30:10.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.638+0000 7ff89c1e1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff89406ec40 con 0x7ff89409fbb0 2023-09-30T22:30:10.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.638+0000 7ff89a77e700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff894138370 0x7ff89413a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47718/0 (socket says 172.21.15.40:47718) 2023-09-30T22:30:10.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.638+0000 7ff89a77e700 1 -- 172.21.15.40:0/2097297817 learned_addr learned my addr 172.21.15.40:0/2097297817 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:10.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.638+0000 7ff899f7d700 1 --2- 172.21.15.40:0/2097297817 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff89409fbb0 0x7ff89406c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:10.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.638+0000 7ff89977c700 1 --2- 172.21.15.40:0/2097297817 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff89406ced0 0x7ff89406d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:10.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.638+0000 7ff89977c700 1 -- 172.21.15.40:0/2097297817 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff89409fbb0 msgr2=0x7ff89406c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:10.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.638+0000 7ff898f7b700 1 -- 172.21.15.40:0/2097297817 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3016030421 0 0) 0x7ff89406e3f0 con 0x7ff894138370 2023-09-30T22:30:10.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.638+0000 7ff89977c700 1 --2- 172.21.15.40:0/2097297817 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff89409fbb0 0x7ff89406c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.638+0000 7ff89977c700 1 -- 172.21.15.40:0/2097297817 >> v1:172.21.15.40:6789/0 conn(0x7ff894138370 legacy=0x7ff89413a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:10.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.638+0000 7ff89977c700 1 -- 172.21.15.40:0/2097297817 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff894097ed0 con 0x7ff89406ced0 2023-09-30T22:30:10.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.638+0000 7ff89977c700 1 --2- 172.21.15.40:0/2097297817 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff89406ced0 0x7ff89406d2e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7ff884009870 tx=0x7ff884009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb3a554498821440 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:10.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.638+0000 7ff898f7b700 1 -- 172.21.15.40:0/2097297817 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff884011830 con 0x7ff89406ced0 2023-09-30T22:30:10.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.638+0000 7ff898f7b700 1 -- 172.21.15.40:0/2097297817 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff884011990 con 0x7ff89406ced0 2023-09-30T22:30:10.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.638+0000 7ff898f7b700 1 -- 172.21.15.40:0/2097297817 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff884011d20 con 0x7ff89406ced0 2023-09-30T22:30:10.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.639+0000 7ff89c1e1700 1 -- 172.21.15.40:0/2097297817 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff89406ced0 msgr2=0x7ff89406d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:10.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.639+0000 7ff89c1e1700 1 --2- 172.21.15.40:0/2097297817 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff89406ced0 0x7ff89406d2e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7ff884009870 tx=0x7ff884009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:10.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.639+0000 7ff89c1e1700 1 -- 172.21.15.40:0/2097297817 shutdown_connections 2023-09-30T22:30:10.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.639+0000 7ff89c1e1700 1 --2- 172.21.15.40:0/2097297817 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff89409fbb0 0x7ff89406c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.639+0000 7ff89c1e1700 1 --2- 172.21.15.40:0/2097297817 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff89406ced0 0x7ff89406d2e0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.639+0000 7ff89c1e1700 1 -- 172.21.15.40:0/2097297817 >> 172.21.15.40:0/2097297817 conn(0x7ff8940a41a0 msgr2=0x7ff8940a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:10.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.639+0000 7ff89c1e1700 1 -- 172.21.15.40:0/2097297817 shutdown_connections 2023-09-30T22:30:10.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.639+0000 7ff89c1e1700 1 -- 172.21.15.40:0/2097297817 wait complete. 2023-09-30T22:30:10.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.640+0000 7ff89c1e1700 1 Processor -- start 2023-09-30T22:30:10.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.640+0000 7ff89c1e1700 1 -- start start 2023-09-30T22:30:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.640+0000 7ff89c1e1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff89406ced0 0x7ff894137590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.640+0000 7ff89c1e1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff89409fbb0 0x7ff894137ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.641+0000 7ff89c1e1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff894138370 0x7ff8940959a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.641+0000 7ff89c1e1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff894094ae0 con 0x7ff894138370 2023-09-30T22:30:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.641+0000 7ff89c1e1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff894096a50 con 0x7ff89406ced0 2023-09-30T22:30:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.641+0000 7ff89c1e1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff894094820 con 0x7ff89409fbb0 2023-09-30T22:30:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.641+0000 7ff899f7d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff89406ced0 0x7ff894137590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.641+0000 7ff899f7d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff89406ced0 0x7ff894137590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50684/0 (socket says 172.21.15.40:50684) 2023-09-30T22:30:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.641+0000 7ff899f7d700 1 -- 172.21.15.40:0/2522757119 learned_addr learned my addr 172.21.15.40:0/2522757119 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.641+0000 7ff89a77e700 1 --2- 172.21.15.40:0/2522757119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff894138370 0x7ff8940959a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.641+0000 7ff89977c700 1 --2- 172.21.15.40:0/2522757119 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff89409fbb0 0x7ff894137ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:10.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.641+0000 7ff89a77e700 1 -- 172.21.15.40:0/2522757119 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff89409fbb0 msgr2=0x7ff894137ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:10.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.641+0000 7ff89a77e700 1 --2- 172.21.15.40:0/2522757119 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff89409fbb0 0x7ff894137ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.641+0000 7ff89a77e700 1 -- 172.21.15.40:0/2522757119 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff89406ced0 msgr2=0x7ff894137590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:10.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.641+0000 7ff89a77e700 1 --2- 172.21.15.40:0/2522757119 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff89406ced0 0x7ff894137590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.641+0000 7ff89a77e700 1 -- 172.21.15.40:0/2522757119 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8840094a0 con 0x7ff894138370 2023-09-30T22:30:10.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.641+0000 7ff899f7d700 1 --2- 172.21.15.40:0/2522757119 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff89406ced0 0x7ff894137590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:10.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.641+0000 7ff89a77e700 1 --2- 172.21.15.40:0/2522757119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff894138370 0x7ff8940959a0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7ff88c00cbe0 tx=0x7ff88c00cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:10.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.641+0000 7ff88a7fc700 1 -- 172.21.15.40:0/2522757119 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c00aa40 con 0x7ff894138370 2023-09-30T22:30:10.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.641+0000 7ff88a7fc700 1 -- 172.21.15.40:0/2522757119 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88c00abc0 con 0x7ff894138370 2023-09-30T22:30:10.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.641+0000 7ff89c1e1700 1 -- 172.21.15.40:0/2522757119 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8940971b0 con 0x7ff894138370 2023-09-30T22:30:10.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.641+0000 7ff88a7fc700 1 -- 172.21.15.40:0/2522757119 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c0070d0 con 0x7ff894138370 2023-09-30T22:30:10.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.641+0000 7ff89c1e1700 1 -- 172.21.15.40:0/2522757119 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8940944c0 con 0x7ff894138370 2023-09-30T22:30:10.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.642+0000 7ff88a7fc700 1 -- 172.21.15.40:0/2522757119 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff88c007230 con 0x7ff894138370 2023-09-30T22:30:10.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.642+0000 7ff88a7fc700 1 -- 172.21.15.40:0/2522757119 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff88c03f090 con 0x7ff894138370 2023-09-30T22:30:10.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.642+0000 7ff89c1e1700 1 -- 172.21.15.40:0/2522757119 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff894094c50 con 0x7ff894138370 2023-09-30T22:30:10.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.647+0000 7ff88a7fc700 1 -- 172.21.15.40:0/2522757119 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff88c018020 con 0x7ff894138370 2023-09-30T22:30:10.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.841+0000 7ff89c1e1700 1 -- 172.21.15.40:0/2522757119 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff894062380 con 0x7ff894138370 2023-09-30T22:30:10.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.842+0000 7ff88a7fc700 1 -- 172.21.15.40:0/2522757119 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff88c0074e0 con 0x7ff894138370 2023-09-30T22:30:10.842 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:10.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.844+0000 7ff89c1e1700 1 -- 172.21.15.40:0/2522757119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff894138370 msgr2=0x7ff8940959a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:10.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.844+0000 7ff89c1e1700 1 --2- 172.21.15.40:0/2522757119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff894138370 0x7ff8940959a0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7ff88c00cbe0 tx=0x7ff88c00cef0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.844+0000 7ff89c1e1700 1 -- 172.21.15.40:0/2522757119 shutdown_connections 2023-09-30T22:30:10.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.844+0000 7ff89c1e1700 1 --2- 172.21.15.40:0/2522757119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff894138370 0x7ff8940959a0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.844+0000 7ff89c1e1700 1 --2- 172.21.15.40:0/2522757119 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff89406ced0 0x7ff894137590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.844+0000 7ff89c1e1700 1 --2- 172.21.15.40:0/2522757119 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff89409fbb0 0x7ff894137ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:10.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.844+0000 7ff89c1e1700 1 -- 172.21.15.40:0/2522757119 >> 172.21.15.40:0/2522757119 conn(0x7ff8940a41a0 msgr2=0x7ff8940a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:10.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.844+0000 7ff89c1e1700 1 -- 172.21.15.40:0/2522757119 shutdown_connections 2023-09-30T22:30:10.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:10.844+0000 7ff89c1e1700 1 -- 172.21.15.40:0/2522757119 wait complete. 2023-09-30T22:30:10.856 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:11.082 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:11.083 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:11.121 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:11.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.216+0000 7f7bb7f4e700 1 Processor -- start 2023-09-30T22:30:11.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.216+0000 7f7bb7f4e700 1 -- start start 2023-09-30T22:30:11.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.217+0000 7f7bb7f4e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7bb006fb50 0x7f7bb0136c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.217+0000 7f7bb7f4e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7bb01371b0 0x7f7bb0139590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.217+0000 7f7bb7f4e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bb0070830 con 0x7f7bb006f070 2023-09-30T22:30:11.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.217+0000 7f7bb7f4e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb0070ad0 con 0x7f7bb006fb50 2023-09-30T22:30:11.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.217+0000 7f7bb7f4e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb0070de0 con 0x7f7bb01371b0 2023-09-30T22:30:11.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.217+0000 7f7bb54e9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7bb006fb50 0x7f7bb0136c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.217+0000 7f7bb64eb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7bb01371b0 0x7f7bb0139590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.217+0000 7f7bb54e9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7bb006fb50 0x7f7bb0136c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37960/0 (socket says 172.21.15.40:37960) 2023-09-30T22:30:11.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.217+0000 7f7bb64eb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7bb01371b0 0x7f7bb0139590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50692/0 (socket says 172.21.15.40:50692) 2023-09-30T22:30:11.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.217+0000 7f7bb54e9700 1 -- 172.21.15.40:0/2266257179 learned_addr learned my addr 172.21.15.40:0/2266257179 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:11.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.217+0000 7f7bb54e9700 1 -- 172.21.15.40:0/2266257179 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7bb01371b0 msgr2=0x7f7bb0139590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:11.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.217+0000 7f7bb54e9700 1 --2- 172.21.15.40:0/2266257179 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7bb01371b0 0x7f7bb0139590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.217+0000 7f7bb54e9700 1 -- 172.21.15.40:0/2266257179 >> v1:172.21.15.40:6789/0 conn(0x7f7bb006f070 legacy=0x7f7bb006f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:11.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.217+0000 7f7bb54e9700 1 -- 172.21.15.40:0/2266257179 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb009fe20 con 0x7f7bb006fb50 2023-09-30T22:30:11.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.217+0000 7f7bb64eb700 1 --2- 172.21.15.40:0/2266257179 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7bb01371b0 0x7f7bb0139590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:11.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.218+0000 7f7bb54e9700 1 --2- 172.21.15.40:0/2266257179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bb006fb50 0x7f7bb0136c70 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f7ba00098f0 tx=0x7f7ba0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ecd8056d0156876 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:11.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.218+0000 7f7bb4ce8700 1 -- 172.21.15.40:0/2266257179 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba0011830 con 0x7f7bb006fb50 2023-09-30T22:30:11.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.218+0000 7f7bb4ce8700 1 -- 172.21.15.40:0/2266257179 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba0011990 con 0x7f7bb006fb50 2023-09-30T22:30:11.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.218+0000 7f7bb4ce8700 1 -- 172.21.15.40:0/2266257179 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba0011d20 con 0x7f7bb006fb50 2023-09-30T22:30:11.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.218+0000 7f7bb7f4e700 1 -- 172.21.15.40:0/2266257179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bb006fb50 msgr2=0x7f7bb0136c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:11.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.218+0000 7f7bb7f4e700 1 --2- 172.21.15.40:0/2266257179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bb006fb50 0x7f7bb0136c70 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f7ba00098f0 tx=0x7f7ba0009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:11.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.218+0000 7f7bb7f4e700 1 -- 172.21.15.40:0/2266257179 shutdown_connections 2023-09-30T22:30:11.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.218+0000 7f7bb7f4e700 1 --2- 172.21.15.40:0/2266257179 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7bb01371b0 0x7f7bb0139590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.218+0000 7f7bb7f4e700 1 --2- 172.21.15.40:0/2266257179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bb006fb50 0x7f7bb0136c70 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.218+0000 7f7bb7f4e700 1 -- 172.21.15.40:0/2266257179 >> 172.21.15.40:0/2266257179 conn(0x7f7bb00a41a0 msgr2=0x7f7bb00a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:11.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.219+0000 7f7bb7f4e700 1 -- 172.21.15.40:0/2266257179 shutdown_connections 2023-09-30T22:30:11.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.219+0000 7f7bb7f4e700 1 -- 172.21.15.40:0/2266257179 wait complete. 2023-09-30T22:30:11.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.220+0000 7fa48d1d7700 1 Processor -- start 2023-09-30T22:30:11.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.220+0000 7fa48d1d7700 1 -- start start 2023-09-30T22:30:11.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.220+0000 7f7bb7f4e700 1 Processor -- start 2023-09-30T22:30:11.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.220+0000 7f7bb7f4e700 1 -- start start 2023-09-30T22:30:11.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.220+0000 7fa48d1d7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa48809d920 0x7fa48809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.220+0000 7fa48d1d7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa48809f0f0 0x7fa48809e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.220+0000 7fa48d1d7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa488133ca0 0x7fa488134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.220+0000 7fa48d1d7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa48806b4c0 con 0x7fa488133ca0 2023-09-30T22:30:11.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.220+0000 7fa48d1d7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa48809a8f0 con 0x7fa48809d920 2023-09-30T22:30:11.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.220+0000 7fa48d1d7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa48809f940 con 0x7fa48809f0f0 2023-09-30T22:30:11.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.220+0000 7fa48759e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa488133ca0 0x7fa488134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.220+0000 7fa48759e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa488133ca0 0x7fa488134140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37962/0 (socket says 172.21.15.40:37962) 2023-09-30T22:30:11.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.220+0000 7fa48759e700 1 -- 172.21.15.40:0/3556907381 learned_addr learned my addr 172.21.15.40:0/3556907381 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:11.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.221+0000 7fa486d9d700 1 --2- 172.21.15.40:0/3556907381 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa48809d920 0x7fa48809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.221+0000 7fa48659c700 1 --2- 172.21.15.40:0/3556907381 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa48809f0f0 0x7fa48809e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.221+0000 7f7bb7f4e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7bb006f070 0x7f7bb009a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.221+0000 7f7bb7f4e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7bb006fb50 0x7f7bb009a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.221+0000 7f7bb7f4e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bb01371b0 0x7f7bb009ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.221+0000 7f7bb7f4e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb01364a0 con 0x7f7bb01371b0 2023-09-30T22:30:11.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.221+0000 7f7bb7f4e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb012c340 con 0x7f7bb006f070 2023-09-30T22:30:11.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.221+0000 7f7bb7f4e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb0135e40 con 0x7f7bb006fb50 2023-09-30T22:30:11.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.221+0000 7f7bb5cea700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7bb006f070 0x7f7bb009a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.221+0000 7f7bb5cea700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7bb006f070 0x7f7bb009a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50720/0 (socket says 172.21.15.40:50720) 2023-09-30T22:30:11.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.221+0000 7f7bb5cea700 1 -- 172.21.15.40:0/1868868081 learned_addr learned my addr 172.21.15.40:0/1868868081 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:11.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.221+0000 7f7bb54e9700 1 --2- 172.21.15.40:0/1868868081 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7bb006fb50 0x7f7bb009a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.221+0000 7fa48759e700 1 -- 172.21.15.40:0/3556907381 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa48809f0f0 msgr2=0x7fa48809e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:11.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.221+0000 7fa48759e700 1 --2- 172.21.15.40:0/3556907381 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa48809f0f0 0x7fa48809e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.221+0000 7fa48759e700 1 -- 172.21.15.40:0/3556907381 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa48809d920 msgr2=0x7fa48809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:11.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.221+0000 7fa48759e700 1 --2- 172.21.15.40:0/3556907381 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa48809d920 0x7fa48809dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.221+0000 7fa48759e700 1 -- 172.21.15.40:0/3556907381 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48809f6e0 con 0x7fa488133ca0 2023-09-30T22:30:11.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.221+0000 7f7bb64eb700 1 --2- 172.21.15.40:0/1868868081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bb01371b0 0x7f7bb009ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.221+0000 7fa48759e700 1 --2- 172.21.15.40:0/3556907381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa488133ca0 0x7fa488134140 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fa480009e80 tx=0x7fa48000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636a64a1ae416967 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:11.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.221+0000 7fa485d9b700 1 -- 172.21.15.40:0/3556907381 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48000e070 con 0x7fa488133ca0 2023-09-30T22:30:11.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.221+0000 7f7bb5cea700 1 -- 172.21.15.40:0/1868868081 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7bb006fb50 msgr2=0x7f7bb009a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:11.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.221+0000 7f7bb5cea700 1 --2- 172.21.15.40:0/1868868081 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7bb006fb50 0x7f7bb009a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.221+0000 7f7bb5cea700 1 -- 172.21.15.40:0/1868868081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bb01371b0 msgr2=0x7f7bb009ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:11.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.221+0000 7f7bb5cea700 1 --2- 172.21.15.40:0/1868868081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bb01371b0 0x7f7bb009ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.221+0000 7f7bb5cea700 1 -- 172.21.15.40:0/1868868081 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba8009a70 con 0x7f7bb006f070 2023-09-30T22:30:11.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.221+0000 7f7bb5cea700 1 --2- 172.21.15.40:0/1868868081 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7bb006f070 0x7f7bb009a0c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7bac00c450 tx=0x7f7bac00c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:11.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.222+0000 7fa485d9b700 1 -- 172.21.15.40:0/3556907381 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48000b980 con 0x7fa488133ca0 2023-09-30T22:30:11.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.222+0000 7fa485d9b700 1 -- 172.21.15.40:0/3556907381 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48000bd30 con 0x7fa488133ca0 2023-09-30T22:30:11.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.222+0000 7f7ba67fc700 1 -- 172.21.15.40:0/1868868081 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bac0052d0 con 0x7f7bb006f070 2023-09-30T22:30:11.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.222+0000 7f7ba67fc700 1 -- 172.21.15.40:0/1868868081 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bac005430 con 0x7f7bb006f070 2023-09-30T22:30:11.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.222+0000 7f7bb7f4e700 1 -- 172.21.15.40:0/1868868081 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ba0009550 con 0x7f7bb006f070 2023-09-30T22:30:11.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.222+0000 7f7ba67fc700 1 -- 172.21.15.40:0/1868868081 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bac0038c0 con 0x7f7bb006f070 2023-09-30T22:30:11.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.222+0000 7f7bb7f4e700 1 -- 172.21.15.40:0/1868868081 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb006e830 con 0x7f7bb006f070 2023-09-30T22:30:11.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.222+0000 7fa48d1d7700 1 -- 172.21.15.40:0/3556907381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa488133ca0 msgr2=0x7fa488134140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:11.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.222+0000 7fa48d1d7700 1 --2- 172.21.15.40:0/3556907381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa488133ca0 0x7fa488134140 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fa480009e80 tx=0x7fa48000b330 comp rx=0 tx=0).stop 2023-09-30T22:30:11.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.223+0000 7fa48d1d7700 1 -- 172.21.15.40:0/3556907381 shutdown_connections 2023-09-30T22:30:11.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.223+0000 7fa48d1d7700 1 --2- 172.21.15.40:0/3556907381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa488133ca0 0x7fa488134140 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.223+0000 7fa48d1d7700 1 --2- 172.21.15.40:0/3556907381 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa48809d920 0x7fa48809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.223+0000 7fa48d1d7700 1 --2- 172.21.15.40:0/3556907381 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa48809f0f0 0x7fa48809e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.223+0000 7fa48d1d7700 1 -- 172.21.15.40:0/3556907381 >> 172.21.15.40:0/3556907381 conn(0x7fa48809fb20 msgr2=0x7fa48809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:11.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.223+0000 7fa48d1d7700 1 -- 172.21.15.40:0/3556907381 shutdown_connections 2023-09-30T22:30:11.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.223+0000 7fa48d1d7700 1 -- 172.21.15.40:0/3556907381 wait complete. 2023-09-30T22:30:11.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.223+0000 7f7ba67fc700 1 -- 172.21.15.40:0/1868868081 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7bac003a20 con 0x7f7bb006f070 2023-09-30T22:30:11.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.223+0000 7f7ba67fc700 1 -- 172.21.15.40:0/1868868081 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f7bac03ea80 con 0x7f7bb006f070 2023-09-30T22:30:11.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.223+0000 7f7bb7f4e700 1 -- 172.21.15.40:0/1868868081 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bb0062380 con 0x7f7bb006f070 2023-09-30T22:30:11.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.224+0000 7fa48d1d7700 1 Processor -- start 2023-09-30T22:30:11.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.224+0000 7fa48d1d7700 1 -- start start 2023-09-30T22:30:11.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.225+0000 7fa48d1d7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa48809d920 0x7fa488122a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.225+0000 7fa48d1d7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa488133ca0 0x7fa488122f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.225+0000 7fa48d1d7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4881234b0 0x7fa4881c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.225+0000 7fa48d1d7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa488124640 con 0x7fa488133ca0 2023-09-30T22:30:11.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.225+0000 7fa48d1d7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa48809ca50 con 0x7fa4881234b0 2023-09-30T22:30:11.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.225+0000 7fa48d1d7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa488133980 con 0x7fa48809d920 2023-09-30T22:30:11.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.225+0000 7fa48659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa488133ca0 0x7fa488122f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.225+0000 7fa48759e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4881234b0 0x7fa4881c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.225+0000 7fa48659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa488133ca0 0x7fa488122f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37984/0 (socket says 172.21.15.40:37984) 2023-09-30T22:30:11.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.225+0000 7fa48659c700 1 -- 172.21.15.40:0/3325832958 learned_addr learned my addr 172.21.15.40:0/3325832958 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:11.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.226+0000 7fa48659c700 1 -- 172.21.15.40:0/3325832958 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa48809d920 msgr2=0x7fa488122a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:11.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.226+0000 7fa48659c700 1 --2- 172.21.15.40:0/3325832958 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa48809d920 0x7fa488122a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.226+0000 7fa48659c700 1 -- 172.21.15.40:0/3325832958 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4881234b0 msgr2=0x7fa4881c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:11.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.226+0000 7fa48659c700 1 --2- 172.21.15.40:0/3325832958 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4881234b0 0x7fa4881c8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.226+0000 7fa48659c700 1 -- 172.21.15.40:0/3325832958 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa480009b30 con 0x7fa488133ca0 2023-09-30T22:30:11.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.226+0000 7fa48759e700 1 --2- 172.21.15.40:0/3325832958 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4881234b0 0x7fa4881c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:11.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.226+0000 7fa48659c700 1 --2- 172.21.15.40:0/3325832958 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa488133ca0 0x7fa488122f70 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00e810 tx=0x7fa47c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:11.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.226+0000 7fa46f7fe700 1 -- 172.21.15.40:0/3325832958 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c013610 con 0x7fa488133ca0 2023-09-30T22:30:11.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.226+0000 7fa46f7fe700 1 -- 172.21.15.40:0/3325832958 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47c013770 con 0x7fa488133ca0 2023-09-30T22:30:11.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.226+0000 7fa48d1d7700 1 -- 172.21.15.40:0/3325832958 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa488124e60 con 0x7fa488133ca0 2023-09-30T22:30:11.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.226+0000 7fa46f7fe700 1 -- 172.21.15.40:0/3325832958 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c013b20 con 0x7fa488133ca0 2023-09-30T22:30:11.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.226+0000 7fa48d1d7700 1 -- 172.21.15.40:0/3325832958 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa488126270 con 0x7fa488133ca0 2023-09-30T22:30:11.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.227+0000 7fa46f7fe700 1 -- 172.21.15.40:0/3325832958 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa47c013c80 con 0x7fa488133ca0 2023-09-30T22:30:11.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.227+0000 7fa48d1d7700 1 -- 172.21.15.40:0/3325832958 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4680052e0 con 0x7fa488133ca0 2023-09-30T22:30:11.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.227+0000 7fa46f7fe700 1 -- 172.21.15.40:0/3325832958 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa47c03f390 con 0x7fa488133ca0 2023-09-30T22:30:11.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.229+0000 7f7ba67fc700 1 -- 172.21.15.40:0/1868868081 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7bac011590 con 0x7f7bb006f070 2023-09-30T22:30:11.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.235+0000 7fa46f7fe700 1 -- 172.21.15.40:0/3325832958 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa47c012370 con 0x7fa488133ca0 2023-09-30T22:30:11.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.262+0000 7effb5f50700 1 Processor -- start 2023-09-30T22:30:11.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.262+0000 7effb5f50700 1 -- start start 2023-09-30T22:30:11.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.262+0000 7effb5f50700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7effb0134060 0x7effb0134430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.263+0000 7effb5f50700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7effb009fe60 0x7effb009d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.263+0000 7effb5f50700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb0133950 con 0x7effb009de60 2023-09-30T22:30:11.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.263+0000 7effb5f50700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb009fad0 con 0x7effb009fe60 2023-09-30T22:30:11.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.263+0000 7effb5f50700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effb00a2760 con 0x7effb0134060 2023-09-30T22:30:11.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.263+0000 7effaeffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7effb009fe60 0x7effb009d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.263+0000 7effaf7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7effb0134060 0x7effb0134430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.263+0000 7effaffff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7effb009de60 0x7effb013ac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47740/0 (socket says 172.21.15.40:47740) 2023-09-30T22:30:11.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.263+0000 7effaffff700 1 -- 172.21.15.40:0/1543936594 learned_addr learned my addr 172.21.15.40:0/1543936594 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:11.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.263+0000 7effaf7fe700 1 -- 172.21.15.40:0/1543936594 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7effb009fe60 msgr2=0x7effb009d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:11.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.263+0000 7effaf7fe700 1 --2- 172.21.15.40:0/1543936594 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7effb009fe60 0x7effb009d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.263+0000 7effaf7fe700 1 -- 172.21.15.40:0/1543936594 >> v1:172.21.15.40:6789/0 conn(0x7effb009de60 legacy=0x7effb013ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:11.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.263+0000 7effae7fc700 1 -- 172.21.15.40:0/1543936594 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1148031579 0 0) 0x7effb0133950 con 0x7effb009de60 2023-09-30T22:30:11.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.263+0000 7effaf7fe700 1 -- 172.21.15.40:0/1543936594 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb009f680 con 0x7effb0134060 2023-09-30T22:30:11.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.263+0000 7effaeffd700 1 --2- 172.21.15.40:0/1543936594 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7effb009fe60 0x7effb009d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:11.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.263+0000 7effaf7fe700 1 --2- 172.21.15.40:0/1543936594 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7effb0134060 0x7effb0134430 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7effa0009dc0 tx=0x7effa000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c3bfbf41b45b343 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:11.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.264+0000 7effae7fc700 1 -- 172.21.15.40:0/1543936594 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa000e070 con 0x7effb0134060 2023-09-30T22:30:11.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.264+0000 7effae7fc700 1 -- 172.21.15.40:0/1543936594 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa000bb20 con 0x7effb0134060 2023-09-30T22:30:11.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.264+0000 7effae7fc700 1 -- 172.21.15.40:0/1543936594 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa0012430 con 0x7effb0134060 2023-09-30T22:30:11.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.264+0000 7effb5f50700 1 -- 172.21.15.40:0/1543936594 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7effb0134060 msgr2=0x7effb0134430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:11.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.264+0000 7effb5f50700 1 --2- 172.21.15.40:0/1543936594 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7effb0134060 0x7effb0134430 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7effa0009dc0 tx=0x7effa000b330 comp rx=0 tx=0).stop 2023-09-30T22:30:11.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.264+0000 7effb5f50700 1 -- 172.21.15.40:0/1543936594 shutdown_connections 2023-09-30T22:30:11.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.264+0000 7effb5f50700 1 --2- 172.21.15.40:0/1543936594 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7effb0134060 0x7effb0134430 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.264+0000 7effb5f50700 1 --2- 172.21.15.40:0/1543936594 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7effb009fe60 0x7effb009d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.264+0000 7effb5f50700 1 -- 172.21.15.40:0/1543936594 >> 172.21.15.40:0/1543936594 conn(0x7effb00a2f20 msgr2=0x7effb00a3320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:11.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.264+0000 7effb5f50700 1 -- 172.21.15.40:0/1543936594 shutdown_connections 2023-09-30T22:30:11.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.264+0000 7effb5f50700 1 -- 172.21.15.40:0/1543936594 wait complete. 2023-09-30T22:30:11.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.265+0000 7effb5f50700 1 Processor -- start 2023-09-30T22:30:11.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.265+0000 7effb5f50700 1 -- start start 2023-09-30T22:30:11.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.266+0000 7effb5f50700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effb009de60 0x7effb012e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.266+0000 7effb5f50700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7effb009fe60 0x7effb012ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.266+0000 7effb5f50700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7effb0134060 0x7effb012ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.266+0000 7effb5f50700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb012f8b0 con 0x7effb009de60 2023-09-30T22:30:11.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.266+0000 7effb5f50700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb009d340 con 0x7effb0134060 2023-09-30T22:30:11.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.266+0000 7effb5f50700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effb01303a0 con 0x7effb009fe60 2023-09-30T22:30:11.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.266+0000 7effaf7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effb009de60 0x7effb012e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.266+0000 7effaf7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effb009de60 0x7effb012e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37990/0 (socket says 172.21.15.40:37990) 2023-09-30T22:30:11.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.266+0000 7effaf7fe700 1 -- 172.21.15.40:0/100634436 learned_addr learned my addr 172.21.15.40:0/100634436 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:11.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.266+0000 7effaeffd700 1 --2- 172.21.15.40:0/100634436 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7effb009fe60 0x7effb012ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.266+0000 7effaffff700 1 --2- 172.21.15.40:0/100634436 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7effb0134060 0x7effb012ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.266+0000 7effaf7fe700 1 -- 172.21.15.40:0/100634436 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7effb009fe60 msgr2=0x7effb012ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:11.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.266+0000 7effaf7fe700 1 --2- 172.21.15.40:0/100634436 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7effb009fe60 0x7effb012ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.266+0000 7effaf7fe700 1 -- 172.21.15.40:0/100634436 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7effb0134060 msgr2=0x7effb012ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:11.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.266+0000 7effaf7fe700 1 --2- 172.21.15.40:0/100634436 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7effb0134060 0x7effb012ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.266+0000 7effaf7fe700 1 -- 172.21.15.40:0/100634436 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa40094a0 con 0x7effb009de60 2023-09-30T22:30:11.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.266+0000 7effaeffd700 1 --2- 172.21.15.40:0/100634436 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7effb009fe60 0x7effb012ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:11.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.267+0000 7effaf7fe700 1 --2- 172.21.15.40:0/100634436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effb009de60 0x7effb012e4c0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7effa0000f80 tx=0x7effa0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:11.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.267+0000 7eff97fff700 1 -- 172.21.15.40:0/100634436 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa0012430 con 0x7effb009de60 2023-09-30T22:30:11.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.267+0000 7effb5f50700 1 -- 172.21.15.40:0/100634436 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa0009a70 con 0x7effb009de60 2023-09-30T22:30:11.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.267+0000 7eff97fff700 1 -- 172.21.15.40:0/100634436 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa0020070 con 0x7effb009de60 2023-09-30T22:30:11.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.267+0000 7eff97fff700 1 -- 172.21.15.40:0/100634436 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa0004280 con 0x7effb009de60 2023-09-30T22:30:11.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.267+0000 7effb5f50700 1 -- 172.21.15.40:0/100634436 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb00a2d90 con 0x7effb009de60 2023-09-30T22:30:11.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.268+0000 7eff97fff700 1 -- 172.21.15.40:0/100634436 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7effa00043e0 con 0x7effb009de60 2023-09-30T22:30:11.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.268+0000 7eff97fff700 1 -- 172.21.15.40:0/100634436 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7effa0022070 con 0x7effb009de60 2023-09-30T22:30:11.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.268+0000 7effb5f50700 1 -- 172.21.15.40:0/100634436 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb008fb90 con 0x7effb009de60 2023-09-30T22:30:11.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.277+0000 7eff97fff700 1 -- 172.21.15.40:0/100634436 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7effa0012e40 con 0x7effb009de60 2023-09-30T22:30:11.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.434+0000 7fa48d1d7700 1 -- 172.21.15.40:0/3325832958 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa468005590 con 0x7fa488133ca0 2023-09-30T22:30:11.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.435+0000 7fa46f7fe700 1 -- 172.21.15.40:0/3325832958 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa47c010310 con 0x7fa488133ca0 2023-09-30T22:30:11.435 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:11.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.435+0000 7f7bb7f4e700 1 -- 172.21.15.40:0/1868868081 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7bb01366c0 con 0x7f7bb006f070 2023-09-30T22:30:11.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.435+0000 7f7ba67fc700 1 -- 172.21.15.40:0/1868868081 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7bac017030 con 0x7f7bb006f070 2023-09-30T22:30:11.435 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:11.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.437+0000 7fa48d1d7700 1 -- 172.21.15.40:0/3325832958 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa488133ca0 msgr2=0x7fa488122f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:11.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.437+0000 7fa48d1d7700 1 --2- 172.21.15.40:0/3325832958 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa488133ca0 0x7fa488122f70 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00e810 tx=0x7fa47c00eb20 comp rx=0 tx=0).stop 2023-09-30T22:30:11.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.437+0000 7fa48d1d7700 1 -- 172.21.15.40:0/3325832958 shutdown_connections 2023-09-30T22:30:11.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.437+0000 7fa48d1d7700 1 --2- 172.21.15.40:0/3325832958 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa48809d920 0x7fa488122a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.437+0000 7fa48d1d7700 1 --2- 172.21.15.40:0/3325832958 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4881234b0 0x7fa4881c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.437+0000 7fa48d1d7700 1 --2- 172.21.15.40:0/3325832958 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa488133ca0 0x7fa488122f70 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.437+0000 7fa48d1d7700 1 -- 172.21.15.40:0/3325832958 >> 172.21.15.40:0/3325832958 conn(0x7fa48809fb20 msgr2=0x7fa4880a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:11.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.437+0000 7fa48d1d7700 1 -- 172.21.15.40:0/3325832958 shutdown_connections 2023-09-30T22:30:11.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.437+0000 7fa48d1d7700 1 -- 172.21.15.40:0/3325832958 wait complete. 2023-09-30T22:30:11.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.438+0000 7f7bb7f4e700 1 -- 172.21.15.40:0/1868868081 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7bb006f070 msgr2=0x7f7bb009a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:11.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.438+0000 7f7bb7f4e700 1 --2- 172.21.15.40:0/1868868081 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7bb006f070 0x7f7bb009a0c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7bac00c450 tx=0x7f7bac00c760 comp rx=0 tx=0).stop 2023-09-30T22:30:11.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.438+0000 7f7bb7f4e700 1 -- 172.21.15.40:0/1868868081 shutdown_connections 2023-09-30T22:30:11.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.438+0000 7f7bb7f4e700 1 --2- 172.21.15.40:0/1868868081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bb01371b0 0x7f7bb009ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.438+0000 7f7bb7f4e700 1 --2- 172.21.15.40:0/1868868081 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7bb006f070 0x7f7bb009a0c0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.438+0000 7f7bb7f4e700 1 --2- 172.21.15.40:0/1868868081 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7bb006fb50 0x7f7bb009a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.438+0000 7f7bb7f4e700 1 -- 172.21.15.40:0/1868868081 >> 172.21.15.40:0/1868868081 conn(0x7f7bb00a41a0 msgr2=0x7f7bb0137630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:11.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.439+0000 7f7bb7f4e700 1 -- 172.21.15.40:0/1868868081 shutdown_connections 2023-09-30T22:30:11.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.439+0000 7f7bb7f4e700 1 -- 172.21.15.40:0/1868868081 wait complete. 2023-09-30T22:30:11.456 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:11.456 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:11.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.474+0000 7effb5f50700 1 -- 172.21.15.40:0/100634436 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7effb0062380 con 0x7effb009de60 2023-09-30T22:30:11.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.474+0000 7eff97fff700 1 -- 172.21.15.40:0/100634436 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7effa002c020 con 0x7effb009de60 2023-09-30T22:30:11.474 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:11.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.476+0000 7effb5f50700 1 -- 172.21.15.40:0/100634436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effb009de60 msgr2=0x7effb012e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:11.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.476+0000 7effb5f50700 1 --2- 172.21.15.40:0/100634436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effb009de60 0x7effb012e4c0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7effa0000f80 tx=0x7effa0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.476+0000 7effb5f50700 1 -- 172.21.15.40:0/100634436 shutdown_connections 2023-09-30T22:30:11.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.476+0000 7effb5f50700 1 --2- 172.21.15.40:0/100634436 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7effb0134060 0x7effb012ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.476+0000 7effb5f50700 1 --2- 172.21.15.40:0/100634436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effb009de60 0x7effb012e4c0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.476+0000 7effb5f50700 1 --2- 172.21.15.40:0/100634436 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7effb009fe60 0x7effb012ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.476+0000 7effb5f50700 1 -- 172.21.15.40:0/100634436 >> 172.21.15.40:0/100634436 conn(0x7effb00a2f20 msgr2=0x7effb00a51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:11.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.477+0000 7effb5f50700 1 -- 172.21.15.40:0/100634436 shutdown_connections 2023-09-30T22:30:11.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.477+0000 7effb5f50700 1 -- 172.21.15.40:0/100634436 wait complete. 2023-09-30T22:30:11.488 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:11.856 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:11.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.988+0000 7f2515b38700 1 Processor -- start 2023-09-30T22:30:11.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.988+0000 7f2515b38700 1 -- start start 2023-09-30T22:30:11.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.989+0000 7f2515b38700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f251006f070 0x7f251006f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.989+0000 7f2515b38700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f251006f980 0x7f2510097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.989+0000 7f2515b38700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f251006fdb0 0x7f25100975d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.989+0000 7f2515b38700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2510071af0 con 0x7f251006fdb0 2023-09-30T22:30:11.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.989+0000 7f2515b38700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2510070830 con 0x7f251006f070 2023-09-30T22:30:11.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.989+0000 7f2515b38700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2510070ad0 con 0x7f251006f980 2023-09-30T22:30:11.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.989+0000 7f250f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f251006f070 0x7f251006f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.989+0000 7f250ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f251006fdb0 0x7f25100975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.989+0000 7f250ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f251006fdb0 0x7f25100975d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38000/0 (socket says 172.21.15.40:38000) 2023-09-30T22:30:11.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.989+0000 7f250f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f251006f070 0x7f251006f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50750/0 (socket says 172.21.15.40:50750) 2023-09-30T22:30:11.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.989+0000 7f250effd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f251006f980 0x7f2510097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.989+0000 7f250ffff700 1 -- 172.21.15.40:0/3463477998 learned_addr learned my addr 172.21.15.40:0/3463477998 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:11.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.989+0000 7f250f7fe700 1 -- 172.21.15.40:0/3463477998 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f251006f980 msgr2=0x7f2510097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:11.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.989+0000 7f250f7fe700 1 --2- 172.21.15.40:0/3463477998 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f251006f980 0x7f2510097090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.989+0000 7f250f7fe700 1 -- 172.21.15.40:0/3463477998 >> v2:172.21.15.40:3300/0 conn(0x7f251006fdb0 msgr2=0x7f25100975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:11.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.989+0000 7f250f7fe700 1 --2- 172.21.15.40:0/3463477998 >> v2:172.21.15.40:3300/0 conn(0x7f251006fdb0 0x7f25100975d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.989+0000 7f250f7fe700 1 -- 172.21.15.40:0/3463477998 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2510070de0 con 0x7f251006f070 2023-09-30T22:30:11.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.989+0000 7f250ffff700 1 --2- 172.21.15.40:0/3463477998 >> v2:172.21.15.40:3300/0 conn(0x7f251006fdb0 0x7f25100975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:11.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.990+0000 7f250f7fe700 1 --2- 172.21.15.40:0/3463477998 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f251006f070 0x7f251006f440 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f2500009870 tx=0x7f2500009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7870e45b157e5717 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:11.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.990+0000 7f250e7fc700 1 -- 172.21.15.40:0/3463477998 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2500011830 con 0x7f251006f070 2023-09-30T22:30:11.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.990+0000 7f250e7fc700 1 -- 172.21.15.40:0/3463477998 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2500011990 con 0x7f251006f070 2023-09-30T22:30:11.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.990+0000 7f250e7fc700 1 -- 172.21.15.40:0/3463477998 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2500011d20 con 0x7f251006f070 2023-09-30T22:30:11.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.990+0000 7f2515b38700 1 -- 172.21.15.40:0/3463477998 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f251006f070 msgr2=0x7f251006f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:11.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.990+0000 7f2515b38700 1 --2- 172.21.15.40:0/3463477998 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f251006f070 0x7f251006f440 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f2500009870 tx=0x7f2500009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:11.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.990+0000 7f2515b38700 1 -- 172.21.15.40:0/3463477998 shutdown_connections 2023-09-30T22:30:11.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.990+0000 7f2515b38700 1 --2- 172.21.15.40:0/3463477998 >> v2:172.21.15.40:3300/0 conn(0x7f251006fdb0 0x7f25100975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.990+0000 7f2515b38700 1 --2- 172.21.15.40:0/3463477998 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f251006f070 0x7f251006f440 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.990+0000 7f2515b38700 1 --2- 172.21.15.40:0/3463477998 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f251006f980 0x7f2510097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.990+0000 7f2515b38700 1 -- 172.21.15.40:0/3463477998 >> 172.21.15.40:0/3463477998 conn(0x7f25100a41a0 msgr2=0x7f25100a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:11.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.990+0000 7f2515b38700 1 -- 172.21.15.40:0/3463477998 shutdown_connections 2023-09-30T22:30:11.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.991+0000 7f2515b38700 1 -- 172.21.15.40:0/3463477998 wait complete. 2023-09-30T22:30:11.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.991+0000 7f2515b38700 1 Processor -- start 2023-09-30T22:30:11.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.992+0000 7f2515b38700 1 -- start start 2023-09-30T22:30:11.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.992+0000 7f2515b38700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f251006f070 0x7f251012d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.992+0000 7f2515b38700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f251006f980 0x7f251012da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.992+0000 7f2515b38700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f251006fdb0 0x7f251012dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:11.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.992+0000 7f2515b38700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251012f310 con 0x7f251006f980 2023-09-30T22:30:11.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.992+0000 7f2515b38700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f251012c2d0 con 0x7f251006fdb0 2023-09-30T22:30:11.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.992+0000 7f2515b38700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f251012fb00 con 0x7f251006f070 2023-09-30T22:30:11.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.992+0000 7f250effd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f251006f980 0x7f251012da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.992+0000 7f250effd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f251006f980 0x7f251012da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38002/0 (socket says 172.21.15.40:38002) 2023-09-30T22:30:11.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.992+0000 7f250ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f251006fdb0 0x7f251012dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.992+0000 7f250f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f251006f070 0x7f251012d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:11.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.992+0000 7f250effd700 1 -- 172.21.15.40:0/606750252 learned_addr learned my addr 172.21.15.40:0/606750252 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:11.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.993+0000 7f250effd700 1 -- 172.21.15.40:0/606750252 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f251006f070 msgr2=0x7f251012d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:11.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.993+0000 7f250effd700 1 --2- 172.21.15.40:0/606750252 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f251006f070 0x7f251012d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.993+0000 7f250effd700 1 -- 172.21.15.40:0/606750252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f251006fdb0 msgr2=0x7f251012dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:11.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.993+0000 7f250effd700 1 --2- 172.21.15.40:0/606750252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f251006fdb0 0x7f251012dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:11.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.993+0000 7f250effd700 1 -- 172.21.15.40:0/606750252 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2508009b30 con 0x7f251006f980 2023-09-30T22:30:11.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.993+0000 7f250ffff700 1 --2- 172.21.15.40:0/606750252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f251006fdb0 0x7f251012dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:11.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.993+0000 7f250f7fe700 1 --2- 172.21.15.40:0/606750252 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f251006f070 0x7f251012d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:11.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.993+0000 7f250effd700 1 --2- 172.21.15.40:0/606750252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f251006f980 0x7f251012da70 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f24f800e980 tx=0x7f24f800ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:11.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.993+0000 7f2507fff700 1 -- 172.21.15.40:0/606750252 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f8009710 con 0x7f251006f980 2023-09-30T22:30:11.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.993+0000 7f2507fff700 1 -- 172.21.15.40:0/606750252 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f800c690 con 0x7f251006f980 2023-09-30T22:30:11.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.993+0000 7f2515b38700 1 -- 172.21.15.40:0/606750252 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25000094a0 con 0x7f251006f980 2023-09-30T22:30:11.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.993+0000 7f2507fff700 1 -- 172.21.15.40:0/606750252 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f800ca20 con 0x7f251006f980 2023-09-30T22:30:11.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.993+0000 7f2515b38700 1 -- 172.21.15.40:0/606750252 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2510130380 con 0x7f251006f980 2023-09-30T22:30:11.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.994+0000 7f2507fff700 1 -- 172.21.15.40:0/606750252 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f24f800cb80 con 0x7f251006f980 2023-09-30T22:30:11.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.994+0000 7f2507fff700 1 -- 172.21.15.40:0/606750252 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f24f803fb40 con 0x7f251006f980 2023-09-30T22:30:11.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.994+0000 7f2515b38700 1 -- 172.21.15.40:0/606750252 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2510130cf0 con 0x7f251006f980 2023-09-30T22:30:11.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:11.999+0000 7f2507fff700 1 -- 172.21.15.40:0/606750252 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f24f801b3b0 con 0x7f251006f980 2023-09-30T22:30:12.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.192+0000 7f2515b38700 1 -- 172.21.15.40:0/606750252 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2510062380 con 0x7f251006f980 2023-09-30T22:30:12.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.192+0000 7f2507fff700 1 -- 172.21.15.40:0/606750252 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f24f8017020 con 0x7f251006f980 2023-09-30T22:30:12.192 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:12.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.194+0000 7f2515b38700 1 -- 172.21.15.40:0/606750252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f251006f980 msgr2=0x7f251012da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:12.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.194+0000 7f2515b38700 1 --2- 172.21.15.40:0/606750252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f251006f980 0x7f251012da70 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f24f800e980 tx=0x7f24f800ec90 comp rx=0 tx=0).stop 2023-09-30T22:30:12.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.194+0000 7f2515b38700 1 -- 172.21.15.40:0/606750252 shutdown_connections 2023-09-30T22:30:12.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.194+0000 7f2515b38700 1 --2- 172.21.15.40:0/606750252 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f251006f070 0x7f251012d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.194+0000 7f2515b38700 1 --2- 172.21.15.40:0/606750252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f251006fdb0 0x7f251012dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.194+0000 7f2515b38700 1 --2- 172.21.15.40:0/606750252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f251006f980 0x7f251012da70 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.194+0000 7f2515b38700 1 -- 172.21.15.40:0/606750252 >> 172.21.15.40:0/606750252 conn(0x7f25100a41a0 msgr2=0x7f251012bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:12.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.194+0000 7f2515b38700 1 -- 172.21.15.40:0/606750252 shutdown_connections 2023-09-30T22:30:12.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.194+0000 7f2515b38700 1 -- 172.21.15.40:0/606750252 wait complete. 2023-09-30T22:30:12.206 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:12.457 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:12.458 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:12.489 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:12.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.593+0000 7f00e41b5700 1 Processor -- start 2023-09-30T22:30:12.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.593+0000 7f00e41b5700 1 -- start start 2023-09-30T22:30:12.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.594+0000 7f00e41b5700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f00dc09f0f0 0x7f00dc138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:12.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.594+0000 7f00e41b5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00dc09e400 0x7f00dc13b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:12.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.594+0000 7f00e41b5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00dc09f940 con 0x7f00dc09d920 2023-09-30T22:30:12.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.594+0000 7f00e41b5700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00dc06b4c0 con 0x7f00dc09f0f0 2023-09-30T22:30:12.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.594+0000 7f00e41b5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc09a8f0 con 0x7f00dc09e400 2023-09-30T22:30:12.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.594+0000 7f00e1750700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f00dc09f0f0 0x7f00dc138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:12.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.594+0000 7f00e2752700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00dc09e400 0x7f00dc13b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:12.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.594+0000 7f00e1750700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f00dc09f0f0 0x7f00dc138ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38014/0 (socket says 172.21.15.40:38014) 2023-09-30T22:30:12.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.594+0000 7f00e1750700 1 -- 172.21.15.40:0/2090699194 learned_addr learned my addr 172.21.15.40:0/2090699194 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:12.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.594+0000 7f00e2752700 1 -- 172.21.15.40:0/2090699194 >> v2:172.21.15.40:3300/0 conn(0x7f00dc09f0f0 msgr2=0x7f00dc138ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:12.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.594+0000 7f00e2752700 1 --2- 172.21.15.40:0/2090699194 >> v2:172.21.15.40:3300/0 conn(0x7f00dc09f0f0 0x7f00dc138ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.594+0000 7f00e2752700 1 -- 172.21.15.40:0/2090699194 >> v1:172.21.15.40:6789/0 conn(0x7f00dc09d920 legacy=0x7f00dc09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:12.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.594+0000 7f00e2752700 1 -- 172.21.15.40:0/2090699194 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00dc09f6e0 con 0x7f00dc09e400 2023-09-30T22:30:12.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.594+0000 7f00e1750700 1 --2- 172.21.15.40:0/2090699194 >> v2:172.21.15.40:3300/0 conn(0x7f00dc09f0f0 0x7f00dc138ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:12.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.594+0000 7f00e2752700 1 --2- 172.21.15.40:0/2090699194 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00dc09e400 0x7f00dc13b430 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f00d4009dc0 tx=0x7f00d400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32fae742a0de9850 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:12.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.595+0000 7f00e0f4f700 1 -- 172.21.15.40:0/2090699194 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d400e070 con 0x7f00dc09e400 2023-09-30T22:30:12.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.595+0000 7f00e0f4f700 1 -- 172.21.15.40:0/2090699194 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d400bae0 con 0x7f00dc09e400 2023-09-30T22:30:12.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.595+0000 7f00e0f4f700 1 -- 172.21.15.40:0/2090699194 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d400be90 con 0x7f00dc09e400 2023-09-30T22:30:12.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.595+0000 7f00e41b5700 1 -- 172.21.15.40:0/2090699194 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00dc09e400 msgr2=0x7f00dc13b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:12.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.595+0000 7f00e41b5700 1 --2- 172.21.15.40:0/2090699194 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00dc09e400 0x7f00dc13b430 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f00d4009dc0 tx=0x7f00d400b330 comp rx=0 tx=0).stop 2023-09-30T22:30:12.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.595+0000 7f00e41b5700 1 -- 172.21.15.40:0/2090699194 shutdown_connections 2023-09-30T22:30:12.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.595+0000 7f00e41b5700 1 --2- 172.21.15.40:0/2090699194 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00dc09e400 0x7f00dc13b430 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.595+0000 7f00e41b5700 1 --2- 172.21.15.40:0/2090699194 >> v2:172.21.15.40:3300/0 conn(0x7f00dc09f0f0 0x7f00dc138ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.595+0000 7f00e41b5700 1 -- 172.21.15.40:0/2090699194 >> 172.21.15.40:0/2090699194 conn(0x7f00dc09fb20 msgr2=0x7f00dc09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:12.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.595+0000 7f00e41b5700 1 -- 172.21.15.40:0/2090699194 shutdown_connections 2023-09-30T22:30:12.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.595+0000 7f00e41b5700 1 -- 172.21.15.40:0/2090699194 wait complete. 2023-09-30T22:30:12.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.596+0000 7f00e41b5700 1 Processor -- start 2023-09-30T22:30:12.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.596+0000 7f00e41b5700 1 -- start start 2023-09-30T22:30:12.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.597+0000 7f00e41b5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00dc09d920 0x7f00dc11db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:12.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.597+0000 7f00e41b5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00dc09e400 0x7f00dc11e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:12.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.597+0000 7f00e41b5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00dc11e5c0 0x7f00dc1c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:12.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.597+0000 7f00e41b5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc11ea10 con 0x7f00dc11e5c0 2023-09-30T22:30:12.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.597+0000 7f00e41b5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc11ff50 con 0x7f00dc09e400 2023-09-30T22:30:12.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.597+0000 7f00e41b5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc120230 con 0x7f00dc09d920 2023-09-30T22:30:12.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.597+0000 7f00e1f51700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00dc09d920 0x7f00dc11db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:12.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.597+0000 7f00e1f51700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00dc09d920 0x7f00dc11db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58506/0 (socket says 172.21.15.40:58506) 2023-09-30T22:30:12.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.597+0000 7f00e1f51700 1 -- 172.21.15.40:0/1634635456 learned_addr learned my addr 172.21.15.40:0/1634635456 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:12.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.597+0000 7f00e1750700 1 --2- 172.21.15.40:0/1634635456 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00dc09e400 0x7f00dc11e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:12.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.597+0000 7f00e2752700 1 --2- 172.21.15.40:0/1634635456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00dc11e5c0 0x7f00dc1c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:12.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.597+0000 7f00e1f51700 1 -- 172.21.15.40:0/1634635456 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00dc09e400 msgr2=0x7f00dc11e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:12.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.597+0000 7f00e1f51700 1 --2- 172.21.15.40:0/1634635456 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00dc09e400 0x7f00dc11e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.597+0000 7f00e1f51700 1 -- 172.21.15.40:0/1634635456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00dc11e5c0 msgr2=0x7f00dc1c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:12.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.597+0000 7f00e1f51700 1 --2- 172.21.15.40:0/1634635456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00dc11e5c0 0x7f00dc1c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.597+0000 7f00e1f51700 1 -- 172.21.15.40:0/1634635456 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00cc009550 con 0x7f00dc09d920 2023-09-30T22:30:12.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.597+0000 7f00e1f51700 1 --2- 172.21.15.40:0/1634635456 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00dc09d920 0x7f00dc11db40 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f00d800c500 tx=0x7f00d800c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:12.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.598+0000 7f00d27fc700 1 -- 172.21.15.40:0/1634635456 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d80054e0 con 0x7f00dc09d920 2023-09-30T22:30:12.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.598+0000 7f00d27fc700 1 -- 172.21.15.40:0/1634635456 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d8003680 con 0x7f00dc09d920 2023-09-30T22:30:12.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.598+0000 7f00d27fc700 1 -- 172.21.15.40:0/1634635456 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d8003a30 con 0x7f00dc09d920 2023-09-30T22:30:12.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.598+0000 7f00e41b5700 1 -- 172.21.15.40:0/1634635456 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d4009a70 con 0x7f00dc09d920 2023-09-30T22:30:12.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.598+0000 7f00e41b5700 1 -- 172.21.15.40:0/1634635456 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00dc0a3200 con 0x7f00dc09d920 2023-09-30T22:30:12.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.599+0000 7f00d27fc700 1 -- 172.21.15.40:0/1634635456 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f00d8003b90 con 0x7f00dc09d920 2023-09-30T22:30:12.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.599+0000 7f00e41b5700 1 -- 172.21.15.40:0/1634635456 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00dc11fdb0 con 0x7f00dc09d920 2023-09-30T22:30:12.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.599+0000 7f00d27fc700 1 -- 172.21.15.40:0/1634635456 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f00d803ea90 con 0x7f00dc09d920 2023-09-30T22:30:12.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.602+0000 7f327dc7b700 1 Processor -- start 2023-09-30T22:30:12.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.602+0000 7f327dc7b700 1 -- start start 2023-09-30T22:30:12.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.603+0000 7f327dc7b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f327809e400 0x7f3278135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:12.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.603+0000 7f327dc7b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3278136230 0x7f3278138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:12.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.603+0000 7f327dc7b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f327809adf0 con 0x7f327809d920 2023-09-30T22:30:12.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.603+0000 7f327dc7b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f327809edf0 con 0x7f327809e400 2023-09-30T22:30:12.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.603+0000 7f327dc7b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f327809b660 con 0x7f3278136230 2023-09-30T22:30:12.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.603+0000 7f3276ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f327809e400 0x7f3278135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:12.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.603+0000 7f3276ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f327809e400 0x7f3278135cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38032/0 (socket says 172.21.15.40:38032) 2023-09-30T22:30:12.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.603+0000 7f3276ffd700 1 -- 172.21.15.40:0/2891787382 learned_addr learned my addr 172.21.15.40:0/2891787382 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:12.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.603+0000 7f32777fe700 1 --1- 172.21.15.40:0/2891787382 >> v1:172.21.15.40:6789/0 conn(0x7f327809d920 0x7f327809dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47746/0 (socket says 172.21.15.40:47746) 2023-09-30T22:30:12.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.603+0000 7f3277fff700 1 --2- 172.21.15.40:0/2891787382 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3278136230 0x7f3278138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:12.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.603+0000 7f3276ffd700 1 -- 172.21.15.40:0/2891787382 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3278136230 msgr2=0x7f3278138610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:12.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.603+0000 7f3276ffd700 1 --2- 172.21.15.40:0/2891787382 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3278136230 0x7f3278138610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.603+0000 7f3276ffd700 1 -- 172.21.15.40:0/2891787382 >> v1:172.21.15.40:6789/0 conn(0x7f327809d920 legacy=0x7f327809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:12.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.603+0000 7f3276ffd700 1 -- 172.21.15.40:0/2891787382 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327809a6e0 con 0x7f327809e400 2023-09-30T22:30:12.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.603+0000 7f3277fff700 1 --2- 172.21.15.40:0/2891787382 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3278136230 0x7f3278138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:12.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.603+0000 7f3276ffd700 1 --2- 172.21.15.40:0/2891787382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f327809e400 0x7f3278135cf0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f326c0098f0 tx=0x7f326c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61071afc2ede6c9d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:12.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.604+0000 7f32767fc700 1 -- 172.21.15.40:0/2891787382 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c011830 con 0x7f327809e400 2023-09-30T22:30:12.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.604+0000 7f32767fc700 1 -- 172.21.15.40:0/2891787382 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f326c011990 con 0x7f327809e400 2023-09-30T22:30:12.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.604+0000 7f32767fc700 1 -- 172.21.15.40:0/2891787382 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c011d20 con 0x7f327809e400 2023-09-30T22:30:12.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.604+0000 7f00d27fc700 1 -- 172.21.15.40:0/1634635456 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f00dc11fdb0 con 0x7f00dc09d920 2023-09-30T22:30:12.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.605+0000 7f327dc7b700 1 -- 172.21.15.40:0/2891787382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f327809e400 msgr2=0x7f3278135cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:12.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.605+0000 7f327dc7b700 1 --2- 172.21.15.40:0/2891787382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f327809e400 0x7f3278135cf0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f326c0098f0 tx=0x7f326c009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:12.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.605+0000 7f327dc7b700 1 -- 172.21.15.40:0/2891787382 shutdown_connections 2023-09-30T22:30:12.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.605+0000 7f327dc7b700 1 --2- 172.21.15.40:0/2891787382 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3278136230 0x7f3278138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.605+0000 7f327dc7b700 1 --2- 172.21.15.40:0/2891787382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f327809e400 0x7f3278135cf0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.605+0000 7f327dc7b700 1 -- 172.21.15.40:0/2891787382 >> 172.21.15.40:0/2891787382 conn(0x7f327809fb20 msgr2=0x7f327809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:12.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.605+0000 7f327dc7b700 1 -- 172.21.15.40:0/2891787382 shutdown_connections 2023-09-30T22:30:12.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.605+0000 7f327dc7b700 1 -- 172.21.15.40:0/2891787382 wait complete. 2023-09-30T22:30:12.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.606+0000 7f327dc7b700 1 Processor -- start 2023-09-30T22:30:12.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.606+0000 7f327dc7b700 1 -- start start 2023-09-30T22:30:12.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.606+0000 7f327dc7b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f327809d920 0x7f327811c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:12.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.606+0000 7f327dc7b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f327809e400 0x7f327811cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:12.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.606+0000 7f327dc7b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3278136230 0x7f327811d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:12.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.606+0000 7f327dc7b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327809cb70 con 0x7f3278136230 2023-09-30T22:30:12.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.606+0000 7f327dc7b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f327811e580 con 0x7f327809d920 2023-09-30T22:30:12.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.606+0000 7f327dc7b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32780a31e0 con 0x7f327809e400 2023-09-30T22:30:12.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.607+0000 7f32777fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f327809d920 0x7f327811c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:12.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.607+0000 7f32777fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f327809d920 0x7f327811c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50782/0 (socket says 172.21.15.40:50782) 2023-09-30T22:30:12.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.607+0000 7f32777fe700 1 -- 172.21.15.40:0/2542584320 learned_addr learned my addr 172.21.15.40:0/2542584320 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:12.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.607+0000 7f3277fff700 1 --2- 172.21.15.40:0/2542584320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3278136230 0x7f327811d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:12.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.607+0000 7f3276ffd700 1 --2- 172.21.15.40:0/2542584320 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f327809e400 0x7f327811cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:12.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.607+0000 7f3276ffd700 1 -- 172.21.15.40:0/2542584320 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f327809d920 msgr2=0x7f327811c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:12.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.607+0000 7f3276ffd700 1 --2- 172.21.15.40:0/2542584320 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f327809d920 0x7f327811c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.607+0000 7f3276ffd700 1 -- 172.21.15.40:0/2542584320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3278136230 msgr2=0x7f327811d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:12.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.607+0000 7f3276ffd700 1 --2- 172.21.15.40:0/2542584320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3278136230 0x7f327811d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.607+0000 7f3276ffd700 1 -- 172.21.15.40:0/2542584320 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3270009a70 con 0x7f327809e400 2023-09-30T22:30:12.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.607+0000 7f3277fff700 1 --2- 172.21.15.40:0/2542584320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3278136230 0x7f327811d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:12.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.607+0000 7f32777fe700 1 --2- 172.21.15.40:0/2542584320 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f327809d920 0x7f327811c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:12.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.607+0000 7f3276ffd700 1 --2- 172.21.15.40:0/2542584320 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f327809e400 0x7f327811cdc0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f326c016000 tx=0x7f326c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:12.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.607+0000 7f325ffff700 1 -- 172.21.15.40:0/2542584320 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c0045d0 con 0x7f327809e400 2023-09-30T22:30:12.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.607+0000 7f325ffff700 1 -- 172.21.15.40:0/2542584320 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f326c0036a0 con 0x7f327809e400 2023-09-30T22:30:12.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.607+0000 7f325ffff700 1 -- 172.21.15.40:0/2542584320 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c003a50 con 0x7f327809e400 2023-09-30T22:30:12.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.608+0000 7f327dc7b700 1 -- 172.21.15.40:0/2542584320 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f326c009550 con 0x7f327809e400 2023-09-30T22:30:12.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.608+0000 7f327dc7b700 1 -- 172.21.15.40:0/2542584320 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f327811ebf0 con 0x7f327809e400 2023-09-30T22:30:12.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.608+0000 7f325ffff700 1 -- 172.21.15.40:0/2542584320 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f326c021070 con 0x7f327809e400 2023-09-30T22:30:12.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.608+0000 7f325ffff700 1 -- 172.21.15.40:0/2542584320 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f326c040a60 con 0x7f327809e400 2023-09-30T22:30:12.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.609+0000 7f327dc7b700 1 -- 172.21.15.40:0/2542584320 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3278062380 con 0x7f327809e400 2023-09-30T22:30:12.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.614+0000 7f325ffff700 1 -- 172.21.15.40:0/2542584320 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f326c02d990 con 0x7f327809e400 2023-09-30T22:30:12.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.648+0000 7f90fae51700 1 Processor -- start 2023-09-30T22:30:12.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.649+0000 7f90fae51700 1 -- start start 2023-09-30T22:30:12.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.649+0000 7f90fae51700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f90f409f0f0 0x7f90f4138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:12.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.649+0000 7f90fae51700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90f409e400 0x7f90f413b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:12.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.649+0000 7f90fae51700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f409f940 con 0x7f90f409d920 2023-09-30T22:30:12.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.649+0000 7f90fae51700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f406b4c0 con 0x7f90f409e400 2023-09-30T22:30:12.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.649+0000 7f90fae51700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90f409a8f0 con 0x7f90f409f0f0 2023-09-30T22:30:12.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.649+0000 7f90f3fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f90f409f0f0 0x7f90f4138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:12.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.650+0000 7f90f3fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f90f409f0f0 0x7f90f4138ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58524/0 (socket says 172.21.15.40:58524) 2023-09-30T22:30:12.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.650+0000 7f90f3fff700 1 -- 172.21.15.40:0/2696223 learned_addr learned my addr 172.21.15.40:0/2696223 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:12.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.650+0000 7f90f93ee700 1 --2- 172.21.15.40:0/2696223 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90f409e400 0x7f90f413b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:12.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.650+0000 7f90f3fff700 1 -- 172.21.15.40:0/2696223 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90f409e400 msgr2=0x7f90f413b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:12.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.650+0000 7f90f3fff700 1 --2- 172.21.15.40:0/2696223 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90f409e400 0x7f90f413b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.650+0000 7f90f37fe700 1 -- 172.21.15.40:0/2696223 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1411274367 0 0) 0x7f90f409f940 con 0x7f90f409d920 2023-09-30T22:30:12.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.650+0000 7f90f3fff700 1 -- 172.21.15.40:0/2696223 >> v1:172.21.15.40:6789/0 conn(0x7f90f409d920 legacy=0x7f90f409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:12.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.650+0000 7f90f3fff700 1 -- 172.21.15.40:0/2696223 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f409f6e0 con 0x7f90f409f0f0 2023-09-30T22:30:12.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.650+0000 7f90f3fff700 1 --2- 172.21.15.40:0/2696223 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f90f409f0f0 0x7f90f4138ee0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f90e0009950 tx=0x7f90e0009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8038fd67ba27857c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:12.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.650+0000 7f90f37fe700 1 -- 172.21.15.40:0/2696223 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e0009ea0 con 0x7f90f409f0f0 2023-09-30T22:30:12.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.650+0000 7f90f37fe700 1 -- 172.21.15.40:0/2696223 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e000ba20 con 0x7f90f409f0f0 2023-09-30T22:30:12.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.650+0000 7f90f37fe700 1 -- 172.21.15.40:0/2696223 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e000bdb0 con 0x7f90f409f0f0 2023-09-30T22:30:12.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.651+0000 7f90fae51700 1 -- 172.21.15.40:0/2696223 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f90f409f0f0 msgr2=0x7f90f4138ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:12.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.651+0000 7f90fae51700 1 --2- 172.21.15.40:0/2696223 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f90f409f0f0 0x7f90f4138ee0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f90e0009950 tx=0x7f90e0009c60 comp rx=0 tx=0).stop 2023-09-30T22:30:12.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.651+0000 7f90fae51700 1 -- 172.21.15.40:0/2696223 shutdown_connections 2023-09-30T22:30:12.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.651+0000 7f90fae51700 1 --2- 172.21.15.40:0/2696223 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90f409e400 0x7f90f413b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.651+0000 7f90fae51700 1 --2- 172.21.15.40:0/2696223 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f90f409f0f0 0x7f90f4138ee0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.651+0000 7f90fae51700 1 -- 172.21.15.40:0/2696223 >> 172.21.15.40:0/2696223 conn(0x7f90f409fb20 msgr2=0x7f90f409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:12.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.651+0000 7f90fae51700 1 -- 172.21.15.40:0/2696223 shutdown_connections 2023-09-30T22:30:12.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.651+0000 7f90fae51700 1 -- 172.21.15.40:0/2696223 wait complete. 2023-09-30T22:30:12.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.653+0000 7f90fae51700 1 Processor -- start 2023-09-30T22:30:12.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.653+0000 7f90fae51700 1 -- start start 2023-09-30T22:30:12.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.654+0000 7f90fae51700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90f409d920 0x7f90f41236b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:12.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.654+0000 7f90fae51700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f90f409e400 0x7f90f4123bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:12.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.654+0000 7f90fae51700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90f4124130 0x7f90f4139e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:12.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.654+0000 7f90fae51700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f4126c80 con 0x7f90f409d920 2023-09-30T22:30:12.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.654+0000 7f90fae51700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f413aee0 con 0x7f90f4124130 2023-09-30T22:30:12.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.654+0000 7f90fae51700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90f409c9e0 con 0x7f90f409e400 2023-09-30T22:30:12.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.654+0000 7f90f3fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f90f409e400 0x7f90f4123bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:12.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.654+0000 7f90f93ee700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90f4124130 0x7f90f4139e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:12.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.654+0000 7f90f8bed700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90f409d920 0x7f90f41236b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:12.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.654+0000 7f90f93ee700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90f4124130 0x7f90f4139e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50796/0 (socket says 172.21.15.40:50796) 2023-09-30T22:30:12.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.654+0000 7f90f93ee700 1 -- 172.21.15.40:0/4112415579 learned_addr learned my addr 172.21.15.40:0/4112415579 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:12.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.654+0000 7f90f3fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f90f409e400 0x7f90f4123bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:58526/0 (socket says 172.21.15.40:58526) 2023-09-30T22:30:12.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.654+0000 7f90f93ee700 1 -- 172.21.15.40:0/4112415579 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f90f409e400 msgr2=0x7f90f4123bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:12.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.654+0000 7f90f93ee700 1 --2- 172.21.15.40:0/4112415579 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f90f409e400 0x7f90f4123bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.654+0000 7f90f93ee700 1 -- 172.21.15.40:0/4112415579 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90f409d920 msgr2=0x7f90f41236b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:12.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.654+0000 7f90f93ee700 1 --2- 172.21.15.40:0/4112415579 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90f409d920 0x7f90f41236b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.654+0000 7f90f93ee700 1 -- 172.21.15.40:0/4112415579 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e0009550 con 0x7f90f4124130 2023-09-30T22:30:12.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.654+0000 7f90f3fff700 1 --2- 172.21.15.40:0/4112415579 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f90f409e400 0x7f90f4123bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:12.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.654+0000 7f90f93ee700 1 --2- 172.21.15.40:0/4112415579 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90f4124130 0x7f90f4139e40 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f90ec007e40 tx=0x7f90ec00e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:12.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.655+0000 7f90f17fa700 1 -- 172.21.15.40:0/4112415579 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec00ed30 con 0x7f90f4124130 2023-09-30T22:30:12.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.655+0000 7f90f17fa700 1 -- 172.21.15.40:0/4112415579 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90ec014420 con 0x7f90f4124130 2023-09-30T22:30:12.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.655+0000 7f90fae51700 1 -- 172.21.15.40:0/4112415579 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f409a210 con 0x7f90f4124130 2023-09-30T22:30:12.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.655+0000 7f90f17fa700 1 -- 172.21.15.40:0/4112415579 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec0147d0 con 0x7f90f4124130 2023-09-30T22:30:12.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.655+0000 7f90fae51700 1 -- 172.21.15.40:0/4112415579 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f4126e60 con 0x7f90f4124130 2023-09-30T22:30:12.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.656+0000 7f90f17fa700 1 -- 172.21.15.40:0/4112415579 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f90ec014930 con 0x7f90f4124130 2023-09-30T22:30:12.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.656+0000 7f90fae51700 1 -- 172.21.15.40:0/4112415579 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f4126ab0 con 0x7f90f4124130 2023-09-30T22:30:12.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.656+0000 7f90f17fa700 1 -- 172.21.15.40:0/4112415579 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f90ec03fe80 con 0x7f90f4124130 2023-09-30T22:30:12.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.660+0000 7f90f17fa700 1 -- 172.21.15.40:0/4112415579 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f90ec014be0 con 0x7f90f4124130 2023-09-30T22:30:12.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.809+0000 7f00e41b5700 1 -- 172.21.15.40:0/1634635456 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f00dc11fdb0 con 0x7f00dc09d920 2023-09-30T22:30:12.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.809+0000 7f00d27fc700 1 -- 172.21.15.40:0/1634635456 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f00dc11fdb0 con 0x7f00dc09d920 2023-09-30T22:30:12.809 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:12.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.811+0000 7f00e41b5700 1 -- 172.21.15.40:0/1634635456 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00dc09d920 msgr2=0x7f00dc11db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:12.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.811+0000 7f00e41b5700 1 --2- 172.21.15.40:0/1634635456 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00dc09d920 0x7f00dc11db40 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f00d800c500 tx=0x7f00d800c810 comp rx=0 tx=0).stop 2023-09-30T22:30:12.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.811+0000 7f00e41b5700 1 -- 172.21.15.40:0/1634635456 shutdown_connections 2023-09-30T22:30:12.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.811+0000 7f00e41b5700 1 --2- 172.21.15.40:0/1634635456 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00dc09d920 0x7f00dc11db40 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.811+0000 7f00e41b5700 1 --2- 172.21.15.40:0/1634635456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00dc11e5c0 0x7f00dc1c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.811+0000 7f00e41b5700 1 --2- 172.21.15.40:0/1634635456 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00dc09e400 0x7f00dc11e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.811+0000 7f00e41b5700 1 -- 172.21.15.40:0/1634635456 >> 172.21.15.40:0/1634635456 conn(0x7f00dc09fb20 msgr2=0x7f00dc137100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:12.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.811+0000 7f00e41b5700 1 -- 172.21.15.40:0/1634635456 shutdown_connections 2023-09-30T22:30:12.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.811+0000 7f00e41b5700 1 -- 172.21.15.40:0/1634635456 wait complete. 2023-09-30T22:30:12.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.817+0000 7f327dc7b700 1 -- 172.21.15.40:0/2542584320 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f327811fcd0 con 0x7f327809e400 2023-09-30T22:30:12.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.817+0000 7f325ffff700 1 -- 172.21.15.40:0/2542584320 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f326c015030 con 0x7f327809e400 2023-09-30T22:30:12.817 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:12.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.820+0000 7f327dc7b700 1 -- 172.21.15.40:0/2542584320 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f327809e400 msgr2=0x7f327811cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:12.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.820+0000 7f327dc7b700 1 --2- 172.21.15.40:0/2542584320 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f327809e400 0x7f327811cdc0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f326c016000 tx=0x7f326c004750 comp rx=0 tx=0).stop 2023-09-30T22:30:12.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.820+0000 7f327dc7b700 1 -- 172.21.15.40:0/2542584320 shutdown_connections 2023-09-30T22:30:12.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.820+0000 7f327dc7b700 1 --2- 172.21.15.40:0/2542584320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3278136230 0x7f327811d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.820+0000 7f327dc7b700 1 --2- 172.21.15.40:0/2542584320 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f327809d920 0x7f327811c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.821+0000 7f327dc7b700 1 --2- 172.21.15.40:0/2542584320 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f327809e400 0x7f327811cdc0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.821+0000 7f327dc7b700 1 -- 172.21.15.40:0/2542584320 >> 172.21.15.40:0/2542584320 conn(0x7f327809fb20 msgr2=0x7f327806e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:12.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.821+0000 7f327dc7b700 1 -- 172.21.15.40:0/2542584320 shutdown_connections 2023-09-30T22:30:12.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.821+0000 7f327dc7b700 1 -- 172.21.15.40:0/2542584320 wait complete. 2023-09-30T22:30:12.827 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:12.834 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:12.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.858+0000 7f90fae51700 1 -- 172.21.15.40:0/4112415579 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f90f4062380 con 0x7f90f4124130 2023-09-30T22:30:12.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.858+0000 7f90f17fa700 1 -- 172.21.15.40:0/4112415579 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f90ec01b310 con 0x7f90f4124130 2023-09-30T22:30:12.858 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:12.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.860+0000 7f90fae51700 1 -- 172.21.15.40:0/4112415579 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90f4124130 msgr2=0x7f90f4139e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:12.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.860+0000 7f90fae51700 1 --2- 172.21.15.40:0/4112415579 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90f4124130 0x7f90f4139e40 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f90ec007e40 tx=0x7f90ec00e3c0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.860+0000 7f90fae51700 1 -- 172.21.15.40:0/4112415579 shutdown_connections 2023-09-30T22:30:12.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.860+0000 7f90fae51700 1 --2- 172.21.15.40:0/4112415579 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f90f4124130 0x7f90f4139e40 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.860+0000 7f90fae51700 1 --2- 172.21.15.40:0/4112415579 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90f409d920 0x7f90f41236b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.860+0000 7f90fae51700 1 --2- 172.21.15.40:0/4112415579 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f90f409e400 0x7f90f4123bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:12.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.860+0000 7f90fae51700 1 -- 172.21.15.40:0/4112415579 >> 172.21.15.40:0/4112415579 conn(0x7f90f409fb20 msgr2=0x7f90f40a26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:12.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.860+0000 7f90fae51700 1 -- 172.21.15.40:0/4112415579 shutdown_connections 2023-09-30T22:30:12.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:12.860+0000 7f90fae51700 1 -- 172.21.15.40:0/4112415579 wait complete. 2023-09-30T22:30:12.872 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:13.207 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:13.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.338+0000 7febf158c700 1 Processor -- start 2023-09-30T22:30:13.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.338+0000 7febf158c700 1 -- start start 2023-09-30T22:30:13.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.338+0000 7febf158c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febec09c890 0x7febec09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:13.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.338+0000 7febf158c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febec09d920 0x7febec09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:13.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.339+0000 7febf158c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febec0a2600 con 0x7febec09e2b0 2023-09-30T22:30:13.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.339+0000 7febf158c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febec0a29d0 con 0x7febec09d920 2023-09-30T22:30:13.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.339+0000 7febf158c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febec09fb40 con 0x7febec09c890 2023-09-30T22:30:13.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.339+0000 7febea7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febec09d920 0x7febec09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:13.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.339+0000 7febeaffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febec09c890 0x7febec09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:13.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.339+0000 7febeb7fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7febec09e2b0 0x7febec13ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55558/0 (socket says 172.21.15.40:55558) 2023-09-30T22:30:13.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.339+0000 7febeb7fe700 1 -- 172.21.15.40:0/750535387 learned_addr learned my addr 172.21.15.40:0/750535387 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:13.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.339+0000 7febe9ffb700 1 -- 172.21.15.40:0/750535387 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 256855631 0 0) 0x7febec0a2600 con 0x7febec09e2b0 2023-09-30T22:30:13.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.339+0000 7febeaffd700 1 -- 172.21.15.40:0/750535387 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febec09d920 msgr2=0x7febec09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:13.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.339+0000 7febeaffd700 1 --2- 172.21.15.40:0/750535387 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febec09d920 0x7febec09dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.339+0000 7febeaffd700 1 -- 172.21.15.40:0/750535387 >> v1:172.21.15.40:6789/0 conn(0x7febec09e2b0 legacy=0x7febec13ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:13.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.339+0000 7febeaffd700 1 -- 172.21.15.40:0/750535387 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febec09e720 con 0x7febec09c890 2023-09-30T22:30:13.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.339+0000 7febea7fc700 1 --2- 172.21.15.40:0/750535387 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febec09d920 0x7febec09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:13.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.339+0000 7febeaffd700 1 --2- 172.21.15.40:0/750535387 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febec09c890 0x7febec09cc60 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7febe0009850 tx=0x7febe0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a2f311397c27cd4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:13.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.339+0000 7febe9ffb700 1 -- 172.21.15.40:0/750535387 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe0005e30 con 0x7febec09c890 2023-09-30T22:30:13.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.339+0000 7febe9ffb700 1 -- 172.21.15.40:0/750535387 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe0006030 con 0x7febec09c890 2023-09-30T22:30:13.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.339+0000 7febe9ffb700 1 -- 172.21.15.40:0/750535387 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe00063e0 con 0x7febec09c890 2023-09-30T22:30:13.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.340+0000 7febf158c700 1 -- 172.21.15.40:0/750535387 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febec09c890 msgr2=0x7febec09cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:13.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.340+0000 7febf158c700 1 --2- 172.21.15.40:0/750535387 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febec09c890 0x7febec09cc60 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7febe0009850 tx=0x7febe0009b60 comp rx=0 tx=0).stop 2023-09-30T22:30:13.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.340+0000 7febf158c700 1 -- 172.21.15.40:0/750535387 shutdown_connections 2023-09-30T22:30:13.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.340+0000 7febf158c700 1 --2- 172.21.15.40:0/750535387 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febec09c890 0x7febec09cc60 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.340+0000 7febf158c700 1 --2- 172.21.15.40:0/750535387 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febec09d920 0x7febec09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.340+0000 7febf158c700 1 -- 172.21.15.40:0/750535387 >> 172.21.15.40:0/750535387 conn(0x7febec0a7080 msgr2=0x7febec0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:13.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.340+0000 7febf158c700 1 -- 172.21.15.40:0/750535387 shutdown_connections 2023-09-30T22:30:13.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.340+0000 7febf158c700 1 -- 172.21.15.40:0/750535387 wait complete. 2023-09-30T22:30:13.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.341+0000 7febf158c700 1 Processor -- start 2023-09-30T22:30:13.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.341+0000 7febf158c700 1 -- start start 2023-09-30T22:30:13.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.342+0000 7febf158c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febec09c890 0x7febec12f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:13.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.342+0000 7febf158c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febec09d920 0x7febec12fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:13.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.342+0000 7febf158c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febec09e2b0 0x7febec130220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:13.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.342+0000 7febf158c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec12d500 con 0x7febec09d920 2023-09-30T22:30:13.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.342+0000 7febf158c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febec0a5c60 con 0x7febec09e2b0 2023-09-30T22:30:13.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.342+0000 7febf158c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febec130760 con 0x7febec09c890 2023-09-30T22:30:13.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.342+0000 7febeaffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febec09c890 0x7febec12f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:13.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.342+0000 7febea7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febec09d920 0x7febec12fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:13.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.342+0000 7febeaffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febec09c890 0x7febec12f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:47532/0 (socket says 172.21.15.40:47532) 2023-09-30T22:30:13.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.342+0000 7febeaffd700 1 -- 172.21.15.40:0/289657629 learned_addr learned my addr 172.21.15.40:0/289657629 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:13.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.342+0000 7febeb7fe700 1 --2- 172.21.15.40:0/289657629 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febec09e2b0 0x7febec130220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:13.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.342+0000 7febeaffd700 1 -- 172.21.15.40:0/289657629 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febec09e2b0 msgr2=0x7febec130220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:13.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.342+0000 7febeaffd700 1 --2- 172.21.15.40:0/289657629 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febec09e2b0 0x7febec130220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.342+0000 7febeaffd700 1 -- 172.21.15.40:0/289657629 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febec09d920 msgr2=0x7febec12fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:13.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.342+0000 7febeaffd700 1 --2- 172.21.15.40:0/289657629 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febec09d920 0x7febec12fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.342+0000 7febeaffd700 1 -- 172.21.15.40:0/289657629 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febdc0094a0 con 0x7febec09c890 2023-09-30T22:30:13.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.342+0000 7febea7fc700 1 --2- 172.21.15.40:0/289657629 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febec09d920 0x7febec12fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:13.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.343+0000 7febeaffd700 1 --2- 172.21.15.40:0/289657629 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febec09c890 0x7febec12f7a0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7febe0009ba0 tx=0x7febe0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:13.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.343+0000 7febd37fe700 1 -- 172.21.15.40:0/289657629 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe0006a20 con 0x7febec09c890 2023-09-30T22:30:13.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.343+0000 7febd37fe700 1 -- 172.21.15.40:0/289657629 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe0004040 con 0x7febec09c890 2023-09-30T22:30:13.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.343+0000 7febf158c700 1 -- 172.21.15.40:0/289657629 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe0009430 con 0x7febec09c890 2023-09-30T22:30:13.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.343+0000 7febd37fe700 1 -- 172.21.15.40:0/289657629 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe00043d0 con 0x7febec09c890 2023-09-30T22:30:13.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.343+0000 7febf158c700 1 -- 172.21.15.40:0/289657629 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febec09ecf0 con 0x7febec09c890 2023-09-30T22:30:13.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.344+0000 7febd37fe700 1 -- 172.21.15.40:0/289657629 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7febe0022070 con 0x7febec09c890 2023-09-30T22:30:13.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.344+0000 7febd37fe700 1 -- 172.21.15.40:0/289657629 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7febe00408d0 con 0x7febec09c890 2023-09-30T22:30:13.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.344+0000 7febf158c700 1 -- 172.21.15.40:0/289657629 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febec06e600 con 0x7febec09c890 2023-09-30T22:30:13.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.348+0000 7febd37fe700 1 -- 172.21.15.40:0/289657629 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7febe0029070 con 0x7febec09c890 2023-09-30T22:30:13.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.544+0000 7febf158c700 1 -- 172.21.15.40:0/289657629 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7febec1baa40 con 0x7febec09c890 2023-09-30T22:30:13.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.545+0000 7febd37fe700 1 -- 172.21.15.40:0/289657629 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7febe0029070 con 0x7febec09c890 2023-09-30T22:30:13.544 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:13.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.547+0000 7febf158c700 1 -- 172.21.15.40:0/289657629 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febec09c890 msgr2=0x7febec12f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:13.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.547+0000 7febf158c700 1 --2- 172.21.15.40:0/289657629 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febec09c890 0x7febec12f7a0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7febe0009ba0 tx=0x7febe0004750 comp rx=0 tx=0).stop 2023-09-30T22:30:13.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.547+0000 7febf158c700 1 -- 172.21.15.40:0/289657629 shutdown_connections 2023-09-30T22:30:13.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.547+0000 7febf158c700 1 --2- 172.21.15.40:0/289657629 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febec09c890 0x7febec12f7a0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.547+0000 7febf158c700 1 --2- 172.21.15.40:0/289657629 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febec09e2b0 0x7febec130220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.547+0000 7febf158c700 1 --2- 172.21.15.40:0/289657629 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febec09d920 0x7febec12fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.547+0000 7febf158c700 1 -- 172.21.15.40:0/289657629 >> 172.21.15.40:0/289657629 conn(0x7febec0a7080 msgr2=0x7febec1bae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:13.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.547+0000 7febf158c700 1 -- 172.21.15.40:0/289657629 shutdown_connections 2023-09-30T22:30:13.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.547+0000 7febf158c700 1 -- 172.21.15.40:0/289657629 wait complete. 2023-09-30T22:30:13.559 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:13.828 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:13.835 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:13.872 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:13.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.963+0000 7fdb89cdf700 1 Processor -- start 2023-09-30T22:30:13.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.963+0000 7fdb89cdf700 1 -- start start 2023-09-30T22:30:13.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.963+0000 7fdb89cdf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb8409d920 0x7fdb8409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:13.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.963+0000 7fdb89cdf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb8409f0f0 0x7fdb8409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:13.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.963+0000 7fdb89cdf700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb8409f940 con 0x7fdb84133ca0 2023-09-30T22:30:13.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.963+0000 7fdb89cdf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8406b4c0 con 0x7fdb8409d920 2023-09-30T22:30:13.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.963+0000 7fdb89cdf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8409a8f0 con 0x7fdb8409f0f0 2023-09-30T22:30:13.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.964+0000 7fdb837fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb8409d920 0x7fdb8409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:13.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.964+0000 7fdb83fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fdb84133ca0 0x7fdb84134140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55564/0 (socket says 172.21.15.40:55564) 2023-09-30T22:30:13.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.964+0000 7fdb837fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb8409d920 0x7fdb8409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35234/0 (socket says 172.21.15.40:35234) 2023-09-30T22:30:13.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.964+0000 7fdb83fff700 1 -- 172.21.15.40:0/3058823089 learned_addr learned my addr 172.21.15.40:0/3058823089 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:13.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.964+0000 7fdb82ffd700 1 --2- 172.21.15.40:0/3058823089 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb8409f0f0 0x7fdb8409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:13.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.964+0000 7fdb82ffd700 1 -- 172.21.15.40:0/3058823089 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb8409d920 msgr2=0x7fdb8409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:13.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.964+0000 7fdb82ffd700 1 --2- 172.21.15.40:0/3058823089 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb8409d920 0x7fdb8409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.964+0000 7fdb82ffd700 1 -- 172.21.15.40:0/3058823089 >> v1:172.21.15.40:6789/0 conn(0x7fdb84133ca0 legacy=0x7fdb84134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:13.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.964+0000 7fdb82ffd700 1 -- 172.21.15.40:0/3058823089 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb8409f6e0 con 0x7fdb8409f0f0 2023-09-30T22:30:13.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.964+0000 7fdb827fc700 1 -- 172.21.15.40:0/3058823089 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1163242555 0 0) 0x7fdb8409f940 con 0x7fdb84133ca0 2023-09-30T22:30:13.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.964+0000 7fdb837fe700 1 --2- 172.21.15.40:0/3058823089 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb8409d920 0x7fdb8409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:13.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.964+0000 7fdb82ffd700 1 --2- 172.21.15.40:0/3058823089 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb8409f0f0 0x7fdb8409e230 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fdb780098a0 tx=0x7fdb78009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da70c8c05b57f9b3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:13.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.964+0000 7fdb827fc700 1 -- 172.21.15.40:0/3058823089 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb78011830 con 0x7fdb8409f0f0 2023-09-30T22:30:13.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.964+0000 7fdb827fc700 1 -- 172.21.15.40:0/3058823089 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb78011990 con 0x7fdb8409f0f0 2023-09-30T22:30:13.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.964+0000 7fdb827fc700 1 -- 172.21.15.40:0/3058823089 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb78011d20 con 0x7fdb8409f0f0 2023-09-30T22:30:13.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.965+0000 7fdb89cdf700 1 -- 172.21.15.40:0/3058823089 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb8409f0f0 msgr2=0x7fdb8409e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:13.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.965+0000 7fdb89cdf700 1 --2- 172.21.15.40:0/3058823089 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb8409f0f0 0x7fdb8409e230 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fdb780098a0 tx=0x7fdb78009bb0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.965+0000 7fdb89cdf700 1 -- 172.21.15.40:0/3058823089 shutdown_connections 2023-09-30T22:30:13.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.965+0000 7fdb89cdf700 1 --2- 172.21.15.40:0/3058823089 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb8409d920 0x7fdb8409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.965+0000 7fdb89cdf700 1 --2- 172.21.15.40:0/3058823089 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb8409f0f0 0x7fdb8409e230 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.965+0000 7fdb89cdf700 1 -- 172.21.15.40:0/3058823089 >> 172.21.15.40:0/3058823089 conn(0x7fdb8409fb20 msgr2=0x7fdb8409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:13.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.966+0000 7fdb89cdf700 1 -- 172.21.15.40:0/3058823089 shutdown_connections 2023-09-30T22:30:13.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.966+0000 7fdb89cdf700 1 -- 172.21.15.40:0/3058823089 wait complete. 2023-09-30T22:30:13.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.967+0000 7fdb89cdf700 1 Processor -- start 2023-09-30T22:30:13.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.967+0000 7fdb89cdf700 1 -- start start 2023-09-30T22:30:13.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.968+0000 7fdb89cdf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb8409d920 0x7fdb8411e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:13.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.968+0000 7fdb89cdf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb84133ca0 0x7fdb8411e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:13.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.968+0000 7fdb89cdf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb84122480 0x7fdb8411ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:13.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.968+0000 7fdb89cdf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb84121f80 con 0x7fdb8409d920 2023-09-30T22:30:13.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.968+0000 7fdb89cdf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb84120650 con 0x7fdb84122480 2023-09-30T22:30:13.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.968+0000 7fdb89cdf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb84121710 con 0x7fdb84133ca0 2023-09-30T22:30:13.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.968+0000 7fdb82ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb84133ca0 0x7fdb8411e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:13.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.968+0000 7fdb837fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb8409d920 0x7fdb8411e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:13.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.968+0000 7fdb82ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb84133ca0 0x7fdb8411e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:47546/0 (socket says 172.21.15.40:47546) 2023-09-30T22:30:13.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.968+0000 7fdb82ffd700 1 -- 172.21.15.40:0/885223991 learned_addr learned my addr 172.21.15.40:0/885223991 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:13.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.968+0000 7fdb83fff700 1 --2- 172.21.15.40:0/885223991 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb84122480 0x7fdb8411ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:13.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.968+0000 7fdb837fe700 1 -- 172.21.15.40:0/885223991 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb84133ca0 msgr2=0x7fdb8411e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:13.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.968+0000 7fdb837fe700 1 --2- 172.21.15.40:0/885223991 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb84133ca0 0x7fdb8411e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.969+0000 7fdb837fe700 1 -- 172.21.15.40:0/885223991 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb84122480 msgr2=0x7fdb8411ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:13.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.969+0000 7fdb837fe700 1 --2- 172.21.15.40:0/885223991 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb84122480 0x7fdb8411ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:13.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.969+0000 7fdb837fe700 1 -- 172.21.15.40:0/885223991 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb74009430 con 0x7fdb8409d920 2023-09-30T22:30:13.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.969+0000 7fdb82ffd700 1 --2- 172.21.15.40:0/885223991 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb84133ca0 0x7fdb8411e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:13.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.969+0000 7fdb83fff700 1 --2- 172.21.15.40:0/885223991 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb84122480 0x7fdb8411ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:13.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.969+0000 7fdb837fe700 1 --2- 172.21.15.40:0/885223991 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb8409d920 0x7fdb8411e4b0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400e8e0 tx=0x7fdb7400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:13.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.969+0000 7fdb6bfff700 1 -- 172.21.15.40:0/885223991 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb74005a20 con 0x7fdb8409d920 2023-09-30T22:30:13.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.969+0000 7fdb89cdf700 1 -- 172.21.15.40:0/885223991 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb780094a0 con 0x7fdb8409d920 2023-09-30T22:30:13.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.969+0000 7fdb89cdf700 1 -- 172.21.15.40:0/885223991 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb840a2680 con 0x7fdb8409d920 2023-09-30T22:30:13.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.969+0000 7fdb6bfff700 1 -- 172.21.15.40:0/885223991 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb74005b80 con 0x7fdb8409d920 2023-09-30T22:30:13.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.969+0000 7fdb6bfff700 1 -- 172.21.15.40:0/885223991 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb74013680 con 0x7fdb8409d920 2023-09-30T22:30:13.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.970+0000 7fdb6bfff700 1 -- 172.21.15.40:0/885223991 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb740137e0 con 0x7fdb8409d920 2023-09-30T22:30:13.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.970+0000 7fdb89cdf700 1 -- 172.21.15.40:0/885223991 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb640052e0 con 0x7fdb8409d920 2023-09-30T22:30:13.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.970+0000 7fdb6bfff700 1 -- 172.21.15.40:0/885223991 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fdb7403fba0 con 0x7fdb8409d920 2023-09-30T22:30:13.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:13.975+0000 7fdb6bfff700 1 -- 172.21.15.40:0/885223991 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb74006030 con 0x7fdb8409d920 2023-09-30T22:30:14.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.005+0000 7febca245700 1 Processor -- start 2023-09-30T22:30:14.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.005+0000 7febca245700 1 -- start start 2023-09-30T22:30:14.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.005+0000 7febca245700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febc409d920 0x7febc409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.005+0000 7febca245700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7febc409f0f0 0x7febc409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.005+0000 7febca245700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc409f940 con 0x7febc4133ca0 2023-09-30T22:30:14.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.005+0000 7febca245700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc406b4c0 con 0x7febc409f0f0 2023-09-30T22:30:14.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.005+0000 7febca245700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc409a8f0 con 0x7febc409d920 2023-09-30T22:30:14.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.005+0000 7febbaffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7febc409f0f0 0x7febc409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:14.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.005+0000 7febbaffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7febc409f0f0 0x7febc409e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46242/0 (socket says 172.21.15.40:46242) 2023-09-30T22:30:14.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.005+0000 7febbaffd700 1 -- 172.21.15.40:0/2173323985 learned_addr learned my addr 172.21.15.40:0/2173323985 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:14.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.005+0000 7f379827b700 1 Processor -- start 2023-09-30T22:30:14.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.005+0000 7febc37fe700 1 --2- 172.21.15.40:0/2173323985 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febc409d920 0x7febc409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:14.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.006+0000 7f379827b700 1 -- start start 2023-09-30T22:30:14.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.006+0000 7febbaffd700 1 -- 172.21.15.40:0/2173323985 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febc409d920 msgr2=0x7febc409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:14.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.006+0000 7febbaffd700 1 --2- 172.21.15.40:0/2173323985 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febc409d920 0x7febc409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.006+0000 7febbaffd700 1 -- 172.21.15.40:0/2173323985 >> v1:172.21.15.40:6789/0 conn(0x7febc4133ca0 legacy=0x7febc4134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:14.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.006+0000 7febbaffd700 1 -- 172.21.15.40:0/2173323985 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc409f6e0 con 0x7febc409f0f0 2023-09-30T22:30:14.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.006+0000 7febbaffd700 1 --2- 172.21.15.40:0/2173323985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febc409f0f0 0x7febc409e230 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7febac009920 tx=0x7febac009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd27d972b1cdd586 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:14.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.006+0000 7febc2ffd700 1 -- 172.21.15.40:0/2173323985 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac011830 con 0x7febc409f0f0 2023-09-30T22:30:14.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.006+0000 7febc2ffd700 1 -- 172.21.15.40:0/2173323985 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febac011990 con 0x7febc409f0f0 2023-09-30T22:30:14.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.006+0000 7febc2ffd700 1 -- 172.21.15.40:0/2173323985 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac011d20 con 0x7febc409f0f0 2023-09-30T22:30:14.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.006+0000 7f379827b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f379006a6d0 0x7f379009d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.006+0000 7f379827b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f379009de60 0x7f379009e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.007+0000 7f379827b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f379013c490 0x7f379013e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.007+0000 7f379827b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f379006aaa0 con 0x7f379013c490 2023-09-30T22:30:14.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.007+0000 7f379827b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f379009e790 con 0x7f379009de60 2023-09-30T22:30:14.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.007+0000 7f379827b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f379011d980 con 0x7f379006a6d0 2023-09-30T22:30:14.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.007+0000 7f3796017700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f379006a6d0 0x7f379009d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:14.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.007+0000 7f3796017700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f379006a6d0 0x7f379009d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:47552/0 (socket says 172.21.15.40:47552) 2023-09-30T22:30:14.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.007+0000 7f3796017700 1 -- 172.21.15.40:0/1422792110 learned_addr learned my addr 172.21.15.40:0/1422792110 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:14.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.007+0000 7f3796017700 1 -- 172.21.15.40:0/1422792110 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f379009de60 msgr2=0x7f379009e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:14.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.007+0000 7f3796017700 1 --2- 172.21.15.40:0/1422792110 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f379009de60 0x7f379009e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.007+0000 7f3796017700 1 -- 172.21.15.40:0/1422792110 >> v2:172.21.15.40:3300/0 conn(0x7f379013c490 msgr2=0x7f379013e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:14.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.007+0000 7f3796017700 1 --2- 172.21.15.40:0/1422792110 >> v2:172.21.15.40:3300/0 conn(0x7f379013c490 0x7f379013e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.007+0000 7f3796017700 1 -- 172.21.15.40:0/1422792110 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f379006b150 con 0x7f379006a6d0 2023-09-30T22:30:14.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.007+0000 7febca245700 1 -- 172.21.15.40:0/2173323985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febc409f0f0 msgr2=0x7febc409e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:14.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.007+0000 7febca245700 1 --2- 172.21.15.40:0/2173323985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febc409f0f0 0x7febc409e230 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7febac009920 tx=0x7febac009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:14.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.007+0000 7f3796017700 1 --2- 172.21.15.40:0/1422792110 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f379006a6d0 0x7f379009d920 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f378c0098f0 tx=0x7f378c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6dfb46585fa35824 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:14.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.007+0000 7febca245700 1 -- 172.21.15.40:0/2173323985 shutdown_connections 2023-09-30T22:30:14.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.007+0000 7febca245700 1 --2- 172.21.15.40:0/2173323985 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febc409d920 0x7febc409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.007+0000 7febca245700 1 --2- 172.21.15.40:0/2173323985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febc409f0f0 0x7febc409e230 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.007+0000 7febca245700 1 -- 172.21.15.40:0/2173323985 >> 172.21.15.40:0/2173323985 conn(0x7febc409fb20 msgr2=0x7febc409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:14.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.007+0000 7febca245700 1 -- 172.21.15.40:0/2173323985 shutdown_connections 2023-09-30T22:30:14.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.007+0000 7febca245700 1 -- 172.21.15.40:0/2173323985 wait complete. 2023-09-30T22:30:14.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.007+0000 7f3795015700 1 -- 172.21.15.40:0/1422792110 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c005e30 con 0x7f379006a6d0 2023-09-30T22:30:14.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.007+0000 7f3795015700 1 -- 172.21.15.40:0/1422792110 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378c004030 con 0x7f379006a6d0 2023-09-30T22:30:14.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.007+0000 7f3795015700 1 -- 172.21.15.40:0/1422792110 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c0043e0 con 0x7f379006a6d0 2023-09-30T22:30:14.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.008+0000 7f379827b700 1 -- 172.21.15.40:0/1422792110 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f379006a6d0 msgr2=0x7f379009d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:14.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.008+0000 7f379827b700 1 --2- 172.21.15.40:0/1422792110 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f379006a6d0 0x7f379009d920 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f378c0098f0 tx=0x7f378c009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:14.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.008+0000 7f379827b700 1 -- 172.21.15.40:0/1422792110 shutdown_connections 2023-09-30T22:30:14.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.008+0000 7f379827b700 1 --2- 172.21.15.40:0/1422792110 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f379006a6d0 0x7f379009d920 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.008+0000 7f379827b700 1 --2- 172.21.15.40:0/1422792110 >> v2:172.21.15.40:3300/0 conn(0x7f379013c490 0x7f379013e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.008+0000 7f379827b700 1 --2- 172.21.15.40:0/1422792110 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f379009de60 0x7f379009e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.008+0000 7f379827b700 1 -- 172.21.15.40:0/1422792110 >> 172.21.15.40:0/1422792110 conn(0x7f379009fb20 msgr2=0x7f379009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:14.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.009+0000 7febca245700 1 Processor -- start 2023-09-30T22:30:14.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.009+0000 7febca245700 1 -- start start 2023-09-30T22:30:14.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.009+0000 7f379827b700 1 -- 172.21.15.40:0/1422792110 shutdown_connections 2023-09-30T22:30:14.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.009+0000 7f379827b700 1 -- 172.21.15.40:0/1422792110 wait complete. 2023-09-30T22:30:14.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.009+0000 7febca245700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febc409d920 0x7febc41219d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.009+0000 7febca245700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febc4133ca0 0x7febc4121f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.009+0000 7febca245700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febc4122450 0x7febc41c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.009+0000 7febca245700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc41325d0 con 0x7febc4133ca0 2023-09-30T22:30:14.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.009+0000 7febca245700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc4124c60 con 0x7febc4122450 2023-09-30T22:30:14.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.009+0000 7febca245700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febc4125570 con 0x7febc409d920 2023-09-30T22:30:14.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.010+0000 7febc37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febc409d920 0x7febc41219d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:14.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.010+0000 7febc37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febc409d920 0x7febc41219d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:47558/0 (socket says 172.21.15.40:47558) 2023-09-30T22:30:14.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.010+0000 7febc37fe700 1 -- 172.21.15.40:0/3025606714 learned_addr learned my addr 172.21.15.40:0/3025606714 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:14.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.010+0000 7febc3fff700 1 --2- 172.21.15.40:0/3025606714 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febc4122450 0x7febc41c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:14.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.010+0000 7febc37fe700 1 -- 172.21.15.40:0/3025606714 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febc4122450 msgr2=0x7febc41c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:14.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.010+0000 7febc37fe700 1 --2- 172.21.15.40:0/3025606714 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febc4122450 0x7febc41c8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.010+0000 7febc37fe700 1 -- 172.21.15.40:0/3025606714 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febc4133ca0 msgr2=0x7febc4121f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:14.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.010+0000 7febc37fe700 1 --2- 172.21.15.40:0/3025606714 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febc4133ca0 0x7febc4121f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.010+0000 7febc37fe700 1 -- 172.21.15.40:0/3025606714 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febac009550 con 0x7febc409d920 2023-09-30T22:30:14.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.010+0000 7febc37fe700 1 --2- 172.21.15.40:0/3025606714 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febc409d920 0x7febc41219d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7febb400e900 tx=0x7febb400ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:14.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.010+0000 7f379827b700 1 Processor -- start 2023-09-30T22:30:14.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.010+0000 7f379827b700 1 -- start start 2023-09-30T22:30:14.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.010+0000 7febc0ff9700 1 -- 172.21.15.40:0/3025606714 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb400ee50 con 0x7febc409d920 2023-09-30T22:30:14.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.010+0000 7febc0ff9700 1 -- 172.21.15.40:0/3025606714 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb400c850 con 0x7febc409d920 2023-09-30T22:30:14.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.010+0000 7febca245700 1 -- 172.21.15.40:0/3025606714 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc409c9e0 con 0x7febc409d920 2023-09-30T22:30:14.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.010+0000 7febc0ff9700 1 -- 172.21.15.40:0/3025606714 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb400cbc0 con 0x7febc409d920 2023-09-30T22:30:14.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.010+0000 7febca245700 1 -- 172.21.15.40:0/3025606714 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc4123640 con 0x7febc409d920 2023-09-30T22:30:14.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.011+0000 7f379827b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f379006a6d0 0x7f379011c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.011+0000 7f379827b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f379009de60 0x7f379011ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.011+0000 7f379827b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f379013c490 0x7f37901cca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.011+0000 7f379827b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3790128070 con 0x7f379013c490 2023-09-30T22:30:14.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.011+0000 7f379827b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37901391c0 con 0x7f379006a6d0 2023-09-30T22:30:14.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.011+0000 7f379827b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f379011d210 con 0x7f379009de60 2023-09-30T22:30:14.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.011+0000 7f3796818700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f379013c490 0x7f37901cca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:14.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.011+0000 7f3796818700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f379013c490 0x7f37901cca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46278/0 (socket says 172.21.15.40:46278) 2023-09-30T22:30:14.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.011+0000 7f3796818700 1 -- 172.21.15.40:0/554543580 learned_addr learned my addr 172.21.15.40:0/554543580 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:14.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.011+0000 7f3795816700 1 --2- 172.21.15.40:0/554543580 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f379009de60 0x7f379011ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:14.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.012+0000 7f3796818700 1 -- 172.21.15.40:0/554543580 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f379009de60 msgr2=0x7f379011ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:14.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.011+0000 7febc0ff9700 1 -- 172.21.15.40:0/3025606714 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7febb400cd20 con 0x7febc409d920 2023-09-30T22:30:14.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.011+0000 7febc0ff9700 1 -- 172.21.15.40:0/3025606714 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7febb403fb10 con 0x7febc409d920 2023-09-30T22:30:14.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.012+0000 7f3796818700 1 --2- 172.21.15.40:0/554543580 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f379009de60 0x7f379011ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.012+0000 7f3796818700 1 -- 172.21.15.40:0/554543580 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f379006a6d0 msgr2=0x7f379011c790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:30:14.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.012+0000 7febca245700 1 -- 172.21.15.40:0/3025606714 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc40a2a70 con 0x7febc409d920 2023-09-30T22:30:14.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.012+0000 7f3796818700 1 --2- 172.21.15.40:0/554543580 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f379006a6d0 0x7f379011c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.012+0000 7f3796818700 1 -- 172.21.15.40:0/554543580 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f378c009500 con 0x7f379013c490 2023-09-30T22:30:14.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.012+0000 7f3796818700 1 --2- 172.21.15.40:0/554543580 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f379013c490 0x7f37901cca80 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f378800b9e0 tx=0x7f378800bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:14.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.012+0000 7f3786ffd700 1 -- 172.21.15.40:0/554543580 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378800c930 con 0x7f379013c490 2023-09-30T22:30:14.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.012+0000 7f3786ffd700 1 -- 172.21.15.40:0/554543580 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378800cad0 con 0x7f379013c490 2023-09-30T22:30:14.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.012+0000 7f379827b700 1 -- 172.21.15.40:0/554543580 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f379011c280 con 0x7f379013c490 2023-09-30T22:30:14.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.012+0000 7f3786ffd700 1 -- 172.21.15.40:0/554543580 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378800ce80 con 0x7f379013c490 2023-09-30T22:30:14.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.012+0000 7f379827b700 1 -- 172.21.15.40:0/554543580 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3790126c30 con 0x7f379013c490 2023-09-30T22:30:14.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.013+0000 7f3786ffd700 1 -- 172.21.15.40:0/554543580 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3788014440 con 0x7f379013c490 2023-09-30T22:30:14.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.013+0000 7f3786ffd700 1 -- 172.21.15.40:0/554543580 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3788006e40 con 0x7f379013c490 2023-09-30T22:30:14.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.013+0000 7f379827b700 1 -- 172.21.15.40:0/554543580 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37901281b0 con 0x7f379013c490 2023-09-30T22:30:14.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.017+0000 7febc0ff9700 1 -- 172.21.15.40:0/3025606714 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7febb4021080 con 0x7febc409d920 2023-09-30T22:30:14.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.018+0000 7f3786ffd700 1 -- 172.21.15.40:0/554543580 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f37901281b0 con 0x7f379013c490 2023-09-30T22:30:14.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.177+0000 7fdb89cdf700 1 -- 172.21.15.40:0/885223991 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdb64005150 con 0x7fdb8409d920 2023-09-30T22:30:14.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.177+0000 7fdb6bfff700 1 -- 172.21.15.40:0/885223991 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdb74020070 con 0x7fdb8409d920 2023-09-30T22:30:14.177 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:14.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.179+0000 7fdb89cdf700 1 -- 172.21.15.40:0/885223991 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb8409d920 msgr2=0x7fdb8411e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:14.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.179+0000 7fdb89cdf700 1 --2- 172.21.15.40:0/885223991 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb8409d920 0x7fdb8411e4b0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400e8e0 tx=0x7fdb7400ebf0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.179+0000 7fdb89cdf700 1 -- 172.21.15.40:0/885223991 shutdown_connections 2023-09-30T22:30:14.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.179+0000 7fdb89cdf700 1 --2- 172.21.15.40:0/885223991 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdb84122480 0x7fdb8411ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.179+0000 7fdb89cdf700 1 --2- 172.21.15.40:0/885223991 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb8409d920 0x7fdb8411e4b0 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.179+0000 7fdb89cdf700 1 --2- 172.21.15.40:0/885223991 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdb84133ca0 0x7fdb8411e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.179+0000 7fdb89cdf700 1 -- 172.21.15.40:0/885223991 >> 172.21.15.40:0/885223991 conn(0x7fdb8409fb20 msgr2=0x7fdb84133460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:14.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.180+0000 7fdb89cdf700 1 -- 172.21.15.40:0/885223991 shutdown_connections 2023-09-30T22:30:14.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.180+0000 7fdb89cdf700 1 -- 172.21.15.40:0/885223991 wait complete. 2023-09-30T22:30:14.192 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:14.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.214+0000 7febca245700 1 -- 172.21.15.40:0/3025606714 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7febc40a2530 con 0x7febc409d920 2023-09-30T22:30:14.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.214+0000 7f379827b700 1 -- 172.21.15.40:0/554543580 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f37901281b0 con 0x7f379013c490 2023-09-30T22:30:14.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.214+0000 7febc0ff9700 1 -- 172.21.15.40:0/3025606714 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7febb401ab90 con 0x7febc409d920 2023-09-30T22:30:14.215 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:14.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.214+0000 7f3786ffd700 1 -- 172.21.15.40:0/554543580 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f37901281b0 con 0x7f379013c490 2023-09-30T22:30:14.215 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:14.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.217+0000 7febca245700 1 -- 172.21.15.40:0/3025606714 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febc409d920 msgr2=0x7febc41219d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:14.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.217+0000 7febca245700 1 --2- 172.21.15.40:0/3025606714 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febc409d920 0x7febc41219d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7febb400e900 tx=0x7febb400ec10 comp rx=0 tx=0).stop 2023-09-30T22:30:14.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.217+0000 7febca245700 1 -- 172.21.15.40:0/3025606714 shutdown_connections 2023-09-30T22:30:14.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.217+0000 7febca245700 1 --2- 172.21.15.40:0/3025606714 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7febc409d920 0x7febc41219d0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.217+0000 7febca245700 1 --2- 172.21.15.40:0/3025606714 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febc4122450 0x7febc41c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.217+0000 7febca245700 1 --2- 172.21.15.40:0/3025606714 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febc4133ca0 0x7febc4121f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.217+0000 7febca245700 1 -- 172.21.15.40:0/3025606714 >> 172.21.15.40:0/3025606714 conn(0x7febc409fb20 msgr2=0x7febc40a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:14.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.217+0000 7febca245700 1 -- 172.21.15.40:0/3025606714 shutdown_connections 2023-09-30T22:30:14.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.217+0000 7febca245700 1 -- 172.21.15.40:0/3025606714 wait complete. 2023-09-30T22:30:14.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.217+0000 7f379827b700 1 -- 172.21.15.40:0/554543580 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f379013c490 msgr2=0x7f37901cca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:14.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.217+0000 7f379827b700 1 --2- 172.21.15.40:0/554543580 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f379013c490 0x7f37901cca80 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f378800b9e0 tx=0x7f378800bcf0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.217+0000 7f379827b700 1 -- 172.21.15.40:0/554543580 shutdown_connections 2023-09-30T22:30:14.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.217+0000 7f379827b700 1 --2- 172.21.15.40:0/554543580 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f379013c490 0x7f37901cca80 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.217+0000 7f379827b700 1 --2- 172.21.15.40:0/554543580 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f379006a6d0 0x7f379011c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.217+0000 7f379827b700 1 --2- 172.21.15.40:0/554543580 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f379009de60 0x7f379011ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.217+0000 7f379827b700 1 -- 172.21.15.40:0/554543580 >> 172.21.15.40:0/554543580 conn(0x7f379009fb20 msgr2=0x7f379013b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:14.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.217+0000 7f379827b700 1 -- 172.21.15.40:0/554543580 shutdown_connections 2023-09-30T22:30:14.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.217+0000 7f379827b700 1 -- 172.21.15.40:0/554543580 wait complete. 2023-09-30T22:30:14.230 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:14.231 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:14.559 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:14.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.691+0000 7f9764cb3700 1 Processor -- start 2023-09-30T22:30:14.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.691+0000 7f9764cb3700 1 -- start start 2023-09-30T22:30:14.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.692+0000 7f9764cb3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f976006d0a0 0x7f976006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.692+0000 7f9764cb3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9760139380 0x7f976013b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.692+0000 7f9764cb3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f976006e3f0 con 0x7f976009fbb0 2023-09-30T22:30:14.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.692+0000 7f9764cb3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f976009ff80 con 0x7f976006d0a0 2023-09-30T22:30:14.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.692+0000 7f9764cb3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f976006ec40 con 0x7f9760139380 2023-09-30T22:30:14.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.692+0000 7f975dd9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f976006d0a0 0x7f976006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:14.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.692+0000 7f975ed9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9760139380 0x7f976013b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:14.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.692+0000 7f975dd9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f976006d0a0 0x7f976006d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46292/0 (socket says 172.21.15.40:46292) 2023-09-30T22:30:14.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.692+0000 7f975dd9b700 1 -- 172.21.15.40:0/3182203192 learned_addr learned my addr 172.21.15.40:0/3182203192 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:14.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.692+0000 7f975dd9b700 1 -- 172.21.15.40:0/3182203192 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9760139380 msgr2=0x7f976013b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:14.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.692+0000 7f975dd9b700 1 --2- 172.21.15.40:0/3182203192 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9760139380 0x7f976013b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.692+0000 7f975dd9b700 1 -- 172.21.15.40:0/3182203192 >> v1:172.21.15.40:6789/0 conn(0x7f976009fbb0 legacy=0x7f976006c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:14.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.692+0000 7f975dd9b700 1 -- 172.21.15.40:0/3182203192 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976006d9f0 con 0x7f976006d0a0 2023-09-30T22:30:14.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.692+0000 7f975dd9b700 1 --2- 172.21.15.40:0/3182203192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976006d0a0 0x7f976006d4b0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f97500098f0 tx=0x7f9750009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c875e4fe4668ed1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:14.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.693+0000 7f975d59a700 1 -- 172.21.15.40:0/3182203192 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9750011830 con 0x7f976006d0a0 2023-09-30T22:30:14.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.693+0000 7f975d59a700 1 -- 172.21.15.40:0/3182203192 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9750011990 con 0x7f976006d0a0 2023-09-30T22:30:14.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.693+0000 7f975d59a700 1 -- 172.21.15.40:0/3182203192 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9750011d20 con 0x7f976006d0a0 2023-09-30T22:30:14.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.693+0000 7f9764cb3700 1 -- 172.21.15.40:0/3182203192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976006d0a0 msgr2=0x7f976006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:14.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.693+0000 7f9764cb3700 1 --2- 172.21.15.40:0/3182203192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976006d0a0 0x7f976006d4b0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f97500098f0 tx=0x7f9750009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:14.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.693+0000 7f9764cb3700 1 -- 172.21.15.40:0/3182203192 shutdown_connections 2023-09-30T22:30:14.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.693+0000 7f9764cb3700 1 --2- 172.21.15.40:0/3182203192 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9760139380 0x7f976013b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.693+0000 7f9764cb3700 1 --2- 172.21.15.40:0/3182203192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976006d0a0 0x7f976006d4b0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.693+0000 7f9764cb3700 1 -- 172.21.15.40:0/3182203192 >> 172.21.15.40:0/3182203192 conn(0x7f97600a41a0 msgr2=0x7f97600a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:14.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.693+0000 7f9764cb3700 1 -- 172.21.15.40:0/3182203192 shutdown_connections 2023-09-30T22:30:14.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.693+0000 7f9764cb3700 1 -- 172.21.15.40:0/3182203192 wait complete. 2023-09-30T22:30:14.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.694+0000 7f9764cb3700 1 Processor -- start 2023-09-30T22:30:14.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.694+0000 7f9764cb3700 1 -- start start 2023-09-30T22:30:14.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.695+0000 7f9764cb3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f976006d0a0 0x7f97600906a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.695+0000 7f9764cb3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976009fbb0 0x7f9760090be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.695+0000 7f9764cb3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9760139380 0x7f9760091120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:14.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.695+0000 7f9764cb3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9760093a10 con 0x7f976009fbb0 2023-09-30T22:30:14.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.695+0000 7f9764cb3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f976006f7c0 con 0x7f9760139380 2023-09-30T22:30:14.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.695+0000 7f9764cb3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9760071db0 con 0x7f976006d0a0 2023-09-30T22:30:14.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.695+0000 7f975dd9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976009fbb0 0x7f9760090be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:14.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.695+0000 7f975dd9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976009fbb0 0x7f9760090be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46304/0 (socket says 172.21.15.40:46304) 2023-09-30T22:30:14.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.695+0000 7f975ed9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9760139380 0x7f9760091120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:14.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.695+0000 7f975dd9b700 1 -- 172.21.15.40:0/787400505 learned_addr learned my addr 172.21.15.40:0/787400505 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:14.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.695+0000 7f975e59c700 1 --2- 172.21.15.40:0/787400505 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f976006d0a0 0x7f97600906a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:14.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.695+0000 7f975dd9b700 1 -- 172.21.15.40:0/787400505 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f976006d0a0 msgr2=0x7f97600906a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:14.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.695+0000 7f975dd9b700 1 --2- 172.21.15.40:0/787400505 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f976006d0a0 0x7f97600906a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.695+0000 7f975dd9b700 1 -- 172.21.15.40:0/787400505 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9760139380 msgr2=0x7f9760091120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:14.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.695+0000 7f975dd9b700 1 --2- 172.21.15.40:0/787400505 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9760139380 0x7f9760091120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.695+0000 7f975dd9b700 1 -- 172.21.15.40:0/787400505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9750009550 con 0x7f976009fbb0 2023-09-30T22:30:14.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.695+0000 7f975e59c700 1 --2- 172.21.15.40:0/787400505 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f976006d0a0 0x7f97600906a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:14.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.695+0000 7f975dd9b700 1 --2- 172.21.15.40:0/787400505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976009fbb0 0x7f9760090be0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f9750000c00 tx=0x7f9750004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:14.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.696+0000 7f9756ffd700 1 -- 172.21.15.40:0/787400505 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97500036a0 con 0x7f976009fbb0 2023-09-30T22:30:14.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.696+0000 7f9756ffd700 1 -- 172.21.15.40:0/787400505 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9750003800 con 0x7f976009fbb0 2023-09-30T22:30:14.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.696+0000 7f9764cb3700 1 -- 172.21.15.40:0/787400505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9760092890 con 0x7f976009fbb0 2023-09-30T22:30:14.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.696+0000 7f9756ffd700 1 -- 172.21.15.40:0/787400505 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9750003bb0 con 0x7f976009fbb0 2023-09-30T22:30:14.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.696+0000 7f9764cb3700 1 -- 172.21.15.40:0/787400505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9760094740 con 0x7f976009fbb0 2023-09-30T22:30:14.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.696+0000 7f9756ffd700 1 -- 172.21.15.40:0/787400505 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9750021070 con 0x7f976009fbb0 2023-09-30T22:30:14.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.697+0000 7f9756ffd700 1 -- 172.21.15.40:0/787400505 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9750040ca0 con 0x7f976009fbb0 2023-09-30T22:30:14.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.697+0000 7f9764cb3700 1 -- 172.21.15.40:0/787400505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9760062380 con 0x7f976009fbb0 2023-09-30T22:30:14.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.701+0000 7f9756ffd700 1 -- 172.21.15.40:0/787400505 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9750015070 con 0x7f976009fbb0 2023-09-30T22:30:14.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.898+0000 7f9764cb3700 1 -- 172.21.15.40:0/787400505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f97600a04e0 con 0x7f976009fbb0 2023-09-30T22:30:14.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.898+0000 7f9756ffd700 1 -- 172.21.15.40:0/787400505 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f975000b3e0 con 0x7f976009fbb0 2023-09-30T22:30:14.898 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:14.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.900+0000 7f9764cb3700 1 -- 172.21.15.40:0/787400505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976009fbb0 msgr2=0x7f9760090be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:14.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.900+0000 7f9764cb3700 1 --2- 172.21.15.40:0/787400505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976009fbb0 0x7f9760090be0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f9750000c00 tx=0x7f9750004750 comp rx=0 tx=0).stop 2023-09-30T22:30:14.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.900+0000 7f9764cb3700 1 -- 172.21.15.40:0/787400505 shutdown_connections 2023-09-30T22:30:14.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.900+0000 7f9764cb3700 1 --2- 172.21.15.40:0/787400505 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f976006d0a0 0x7f97600906a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.900+0000 7f9764cb3700 1 --2- 172.21.15.40:0/787400505 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9760139380 0x7f9760091120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.900+0000 7f9764cb3700 1 --2- 172.21.15.40:0/787400505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976009fbb0 0x7f9760090be0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:14.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.900+0000 7f9764cb3700 1 -- 172.21.15.40:0/787400505 >> 172.21.15.40:0/787400505 conn(0x7f97600a41a0 msgr2=0x7f97601385a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:14.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.900+0000 7f9764cb3700 1 -- 172.21.15.40:0/787400505 shutdown_connections 2023-09-30T22:30:14.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:14.901+0000 7f9764cb3700 1 -- 172.21.15.40:0/787400505 wait complete. 2023-09-30T22:30:14.912 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:15.193 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:15.231 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:15.232 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:15.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.330+0000 7feb06866700 1 Processor -- start 2023-09-30T22:30:15.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.330+0000 7feb06866700 1 -- start start 2023-09-30T22:30:15.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.330+0000 7feb06866700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feb00136bf0 0x7feb00138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.330+0000 7feb06866700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb00139510 0x7feb0013b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.331+0000 7feb06866700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb000a2600 con 0x7feb0009c890 2023-09-30T22:30:15.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.331+0000 7feb06866700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb000a29d0 con 0x7feb00139510 2023-09-30T22:30:15.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.331+0000 7feb06866700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb0009fb40 con 0x7feb00136bf0 2023-09-30T22:30:15.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.331+0000 7feaff7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feb00136bf0 0x7feb00138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:15.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.331+0000 7feaff7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feb00136bf0 0x7feb00138fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:47584/0 (socket says 172.21.15.40:47584) 2023-09-30T22:30:15.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.331+0000 7feaff7fe700 1 -- 172.21.15.40:0/3834742444 learned_addr learned my addr 172.21.15.40:0/3834742444 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:15.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.331+0000 7feb04e03700 1 --2- 172.21.15.40:0/3834742444 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb00139510 0x7feb0013b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:15.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.331+0000 7feafeffd700 1 -- 172.21.15.40:0/3834742444 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3073405478 0 0) 0x7feb000a2600 con 0x7feb0009c890 2023-09-30T22:30:15.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.331+0000 7feaff7fe700 1 -- 172.21.15.40:0/3834742444 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb00139510 msgr2=0x7feb0013b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:15.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.331+0000 7feaff7fe700 1 --2- 172.21.15.40:0/3834742444 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb00139510 0x7feb0013b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.331+0000 7feaff7fe700 1 -- 172.21.15.40:0/3834742444 >> v1:172.21.15.40:6789/0 conn(0x7feb0009c890 legacy=0x7feb0009cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:15.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.331+0000 7feaff7fe700 1 -- 172.21.15.40:0/3834742444 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb0009d370 con 0x7feb00136bf0 2023-09-30T22:30:15.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.331+0000 7feb04e03700 1 --2- 172.21.15.40:0/3834742444 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb00139510 0x7feb0013b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:15.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.331+0000 7feaff7fe700 1 --2- 172.21.15.40:0/3834742444 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feb00136bf0 0x7feb00138fd0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7feaf4009920 tx=0x7feaf4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdc2bb118006d765 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:15.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.332+0000 7feafeffd700 1 -- 172.21.15.40:0/3834742444 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf400ba00 con 0x7feb00136bf0 2023-09-30T22:30:15.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.332+0000 7feafeffd700 1 -- 172.21.15.40:0/3834742444 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf400bb60 con 0x7feb00136bf0 2023-09-30T22:30:15.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.332+0000 7feafeffd700 1 -- 172.21.15.40:0/3834742444 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf4009e70 con 0x7feb00136bf0 2023-09-30T22:30:15.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.332+0000 7feb06866700 1 -- 172.21.15.40:0/3834742444 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feb00136bf0 msgr2=0x7feb00138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:15.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.332+0000 7feb06866700 1 --2- 172.21.15.40:0/3834742444 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feb00136bf0 0x7feb00138fd0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7feaf4009920 tx=0x7feaf4009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:15.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.332+0000 7feb06866700 1 -- 172.21.15.40:0/3834742444 shutdown_connections 2023-09-30T22:30:15.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.332+0000 7feb06866700 1 --2- 172.21.15.40:0/3834742444 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb00139510 0x7feb0013b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.332+0000 7feb06866700 1 --2- 172.21.15.40:0/3834742444 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feb00136bf0 0x7feb00138fd0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.332+0000 7feb06866700 1 -- 172.21.15.40:0/3834742444 >> 172.21.15.40:0/3834742444 conn(0x7feb000a7080 msgr2=0x7feb000a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:15.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.332+0000 7feb06866700 1 -- 172.21.15.40:0/3834742444 shutdown_connections 2023-09-30T22:30:15.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.332+0000 7feb06866700 1 -- 172.21.15.40:0/3834742444 wait complete. 2023-09-30T22:30:15.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.333+0000 7feb06866700 1 Processor -- start 2023-09-30T22:30:15.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.334+0000 7feb06866700 1 -- start start 2023-09-30T22:30:15.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.334+0000 7feb06866700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb0009c890 0x7feb0006efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.334+0000 7feb06866700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feb00136bf0 0x7feb0006f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.334+0000 7feb06866700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb00139510 0x7feb0006fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.334+0000 7feb06866700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0012bbe0 con 0x7feb0009c890 2023-09-30T22:30:15.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.334+0000 7feb06866700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb00070460 con 0x7feb00139510 2023-09-30T22:30:15.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.334+0000 7feb06866700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb00070d00 con 0x7feb00136bf0 2023-09-30T22:30:15.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.334+0000 7feaff7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feb00136bf0 0x7feb0006f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:15.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.334+0000 7feaff7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feb00136bf0 0x7feb0006f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:47592/0 (socket says 172.21.15.40:47592) 2023-09-30T22:30:15.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.334+0000 7feaff7fe700 1 -- 172.21.15.40:0/1287436483 learned_addr learned my addr 172.21.15.40:0/1287436483 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:15.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.334+0000 7feafffff700 1 --2- 172.21.15.40:0/1287436483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb0009c890 0x7feb0006efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:15.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.334+0000 7feb04e03700 1 --2- 172.21.15.40:0/1287436483 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb00139510 0x7feb0006fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:15.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.335+0000 7feb04e03700 1 -- 172.21.15.40:0/1287436483 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feb00136bf0 msgr2=0x7feb0006f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:15.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.335+0000 7feb04e03700 1 --2- 172.21.15.40:0/1287436483 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feb00136bf0 0x7feb0006f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.335+0000 7feb04e03700 1 -- 172.21.15.40:0/1287436483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb0009c890 msgr2=0x7feb0006efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:15.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.335+0000 7feb04e03700 1 --2- 172.21.15.40:0/1287436483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb0009c890 0x7feb0006efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.335+0000 7feb04e03700 1 -- 172.21.15.40:0/1287436483 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf4009550 con 0x7feb00139510 2023-09-30T22:30:15.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.335+0000 7feaff7fe700 1 --2- 172.21.15.40:0/1287436483 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feb00136bf0 0x7feb0006f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:15.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.335+0000 7feb04e03700 1 --2- 172.21.15.40:0/1287436483 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb00139510 0x7feb0006fa50 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7feb0009d5e0 tx=0x7feaf800d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:15.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.335+0000 7feafcff9700 1 -- 172.21.15.40:0/1287436483 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf800dcf0 con 0x7feb00139510 2023-09-30T22:30:15.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.335+0000 7feafcff9700 1 -- 172.21.15.40:0/1287436483 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf800f040 con 0x7feb00139510 2023-09-30T22:30:15.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.335+0000 7feb06866700 1 -- 172.21.15.40:0/1287436483 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb00138fe0 con 0x7feb00139510 2023-09-30T22:30:15.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.335+0000 7feafcff9700 1 -- 172.21.15.40:0/1287436483 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf8003c60 con 0x7feb00139510 2023-09-30T22:30:15.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.335+0000 7feb06866700 1 -- 172.21.15.40:0/1287436483 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb0012c8e0 con 0x7feb00139510 2023-09-30T22:30:15.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.336+0000 7feafcff9700 1 -- 172.21.15.40:0/1287436483 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feaf8004030 con 0x7feb00139510 2023-09-30T22:30:15.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.336+0000 7feafcff9700 1 -- 172.21.15.40:0/1287436483 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7feaf803f6c0 con 0x7feb00139510 2023-09-30T22:30:15.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.336+0000 7feb06866700 1 -- 172.21.15.40:0/1287436483 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb00062380 con 0x7feb00139510 2023-09-30T22:30:15.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.345+0000 7feafcff9700 1 -- 172.21.15.40:0/1287436483 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feaf80042e0 con 0x7feb00139510 2023-09-30T22:30:15.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.371+0000 7f3d0e957700 1 Processor -- start 2023-09-30T22:30:15.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.371+0000 7f3d0e957700 1 -- start start 2023-09-30T22:30:15.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.372+0000 7f3d0e957700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d08133e00 0x7f3d081341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.372+0000 7f3d0e957700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d0809d400 0x7f3d0809d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.372+0000 7f3d0e957700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3d0809dd70 0x7f3d0813ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.372+0000 7f3d0e957700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d0809ab20 con 0x7f3d0809dd70 2023-09-30T22:30:15.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.372+0000 7f3d0e957700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d08133940 con 0x7f3d08133e00 2023-09-30T22:30:15.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.372+0000 7f3d0e957700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0809f0d0 con 0x7f3d0809d400 2023-09-30T22:30:15.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.372+0000 7f3d07fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d08133e00 0x7f3d081341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:15.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.372+0000 7f3d07fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d08133e00 0x7f3d081341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35310/0 (socket says 172.21.15.40:35310) 2023-09-30T22:30:15.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.372+0000 7f3d07fff700 1 -- 172.21.15.40:0/3628957270 learned_addr learned my addr 172.21.15.40:0/3628957270 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:15.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.372+0000 7f3d077fe700 1 --2- 172.21.15.40:0/3628957270 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d0809d400 0x7f3d0809d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:15.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.372+0000 7f3d0cef4700 1 --2- 172.21.15.40:0/3628957270 >> v2:172.21.15.40:3300/0 conn(0x7f3d0809dd70 0x7f3d0813ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:15.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.373+0000 7f3d07fff700 1 -- 172.21.15.40:0/3628957270 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d0809d400 msgr2=0x7f3d0809d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:15.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.373+0000 7f3d07fff700 1 --2- 172.21.15.40:0/3628957270 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d0809d400 0x7f3d0809d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.373+0000 7f3d07fff700 1 -- 172.21.15.40:0/3628957270 >> v2:172.21.15.40:3300/0 conn(0x7f3d0809dd70 msgr2=0x7f3d0813ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:15.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.373+0000 7f3d07fff700 1 --2- 172.21.15.40:0/3628957270 >> v2:172.21.15.40:3300/0 conn(0x7f3d0809dd70 0x7f3d0813ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.373+0000 7f3d07fff700 1 -- 172.21.15.40:0/3628957270 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0809e210 con 0x7f3d08133e00 2023-09-30T22:30:15.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.373+0000 7f3d077fe700 1 --2- 172.21.15.40:0/3628957270 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d0809d400 0x7f3d0809d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:15.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.373+0000 7f3d07fff700 1 --2- 172.21.15.40:0/3628957270 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d08133e00 0x7f3d081341d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f3cf80098f0 tx=0x7f3cf8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5cacc73f341d0e8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:15.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.373+0000 7f3d06ffd700 1 -- 172.21.15.40:0/3628957270 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf8011830 con 0x7f3d08133e00 2023-09-30T22:30:15.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.373+0000 7f3d06ffd700 1 -- 172.21.15.40:0/3628957270 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf8011990 con 0x7f3d08133e00 2023-09-30T22:30:15.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.373+0000 7f3d06ffd700 1 -- 172.21.15.40:0/3628957270 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf8011d20 con 0x7f3d08133e00 2023-09-30T22:30:15.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.374+0000 7f3d0e957700 1 -- 172.21.15.40:0/3628957270 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d08133e00 msgr2=0x7f3d081341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:15.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.374+0000 7f3d0e957700 1 --2- 172.21.15.40:0/3628957270 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d08133e00 0x7f3d081341d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f3cf80098f0 tx=0x7f3cf8009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:15.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.374+0000 7f3d0e957700 1 -- 172.21.15.40:0/3628957270 shutdown_connections 2023-09-30T22:30:15.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.374+0000 7f3d0e957700 1 --2- 172.21.15.40:0/3628957270 >> v2:172.21.15.40:3300/0 conn(0x7f3d0809dd70 0x7f3d0813ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.374+0000 7f3d0e957700 1 --2- 172.21.15.40:0/3628957270 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d08133e00 0x7f3d081341d0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.374+0000 7f3d0e957700 1 --2- 172.21.15.40:0/3628957270 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d0809d400 0x7f3d0809d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.374+0000 7f3d0e957700 1 -- 172.21.15.40:0/3628957270 >> 172.21.15.40:0/3628957270 conn(0x7f3d080a2a00 msgr2=0x7f3d080a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:15.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.374+0000 7f3d0e957700 1 -- 172.21.15.40:0/3628957270 shutdown_connections 2023-09-30T22:30:15.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.374+0000 7f3d0e957700 1 -- 172.21.15.40:0/3628957270 wait complete. 2023-09-30T22:30:15.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.375+0000 7f1ea6e69700 1 Processor -- start 2023-09-30T22:30:15.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.375+0000 7f1ea6e69700 1 -- start start 2023-09-30T22:30:15.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.375+0000 7f1ea6e69700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ea009f0f0 0x7f1ea0138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.375+0000 7f1ea6e69700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1ea009e400 0x7f1ea013b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.375+0000 7f3d0e957700 1 Processor -- start 2023-09-30T22:30:15.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.375+0000 7f1ea6e69700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ea009f940 con 0x7f1ea009d920 2023-09-30T22:30:15.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.375+0000 7f1ea6e69700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ea006b4c0 con 0x7f1ea009e400 2023-09-30T22:30:15.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.375+0000 7f1ea6e69700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea009a8f0 con 0x7f1ea009f0f0 2023-09-30T22:30:15.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.375+0000 7f1e9ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ea009f0f0 0x7f1ea0138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:15.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.375+0000 7f1e9ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ea009f0f0 0x7f1ea0138ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35320/0 (socket says 172.21.15.40:35320) 2023-09-30T22:30:15.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.375+0000 7f1e9ffff700 1 -- 172.21.15.40:0/348087346 learned_addr learned my addr 172.21.15.40:0/348087346 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:15.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.375+0000 7f1ea5406700 1 --2- 172.21.15.40:0/348087346 >> v2:172.21.15.40:3300/0 conn(0x7f1ea009e400 0x7f1ea013b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:15.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.375+0000 7f3d0e957700 1 -- start start 2023-09-30T22:30:15.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.376+0000 7f1e9ffff700 1 -- 172.21.15.40:0/348087346 >> v2:172.21.15.40:3300/0 conn(0x7f1ea009e400 msgr2=0x7f1ea013b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:15.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.376+0000 7f1e9ffff700 1 --2- 172.21.15.40:0/348087346 >> v2:172.21.15.40:3300/0 conn(0x7f1ea009e400 0x7f1ea013b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.376+0000 7f1e9ffff700 1 -- 172.21.15.40:0/348087346 >> v1:172.21.15.40:6789/0 conn(0x7f1ea009d920 legacy=0x7f1ea009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:15.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.376+0000 7f1e9ffff700 1 -- 172.21.15.40:0/348087346 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea009f6e0 con 0x7f1ea009f0f0 2023-09-30T22:30:15.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.376+0000 7f1ea5406700 1 --2- 172.21.15.40:0/348087346 >> v2:172.21.15.40:3300/0 conn(0x7f1ea009e400 0x7f1ea013b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:15.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.376+0000 7f1e9ffff700 1 --2- 172.21.15.40:0/348087346 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ea009f0f0 0x7f1ea0138ee0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c0098f0 tx=0x7f1e8c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=411bb478ff5d5f5c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:15.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.376+0000 7f3d0e957700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d0809d400 0x7f3d0806d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.376+0000 7f3d0e957700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d0809dd70 0x7f3d0806db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.376+0000 7f3d0e957700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d08133e00 0x7f3d0806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.376+0000 7f3d0e957700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d08070ba0 con 0x7f3d0809dd70 2023-09-30T22:30:15.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.376+0000 7f3d0e957700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0812bd30 con 0x7f3d08133e00 2023-09-30T22:30:15.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.376+0000 7f3d0e957700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d08070500 con 0x7f3d0809d400 2023-09-30T22:30:15.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.376+0000 7f1e9f7fe700 1 -- 172.21.15.40:0/348087346 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c00b8a0 con 0x7f1ea009f0f0 2023-09-30T22:30:15.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.376+0000 7f3d077fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d0809dd70 0x7f3d0806db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:15.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.376+0000 7f3d077fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d0809dd70 0x7f3d0806db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46354/0 (socket says 172.21.15.40:46354) 2023-09-30T22:30:15.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.376+0000 7f3d077fe700 1 -- 172.21.15.40:0/1924743113 learned_addr learned my addr 172.21.15.40:0/1924743113 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:15.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.376+0000 7f1e9f7fe700 1 -- 172.21.15.40:0/348087346 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8c00ba00 con 0x7f1ea009f0f0 2023-09-30T22:30:15.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.376+0000 7f1e9f7fe700 1 -- 172.21.15.40:0/348087346 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c00bd90 con 0x7f1ea009f0f0 2023-09-30T22:30:15.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.376+0000 7f3d07fff700 1 --2- 172.21.15.40:0/1924743113 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d0809d400 0x7f3d0806d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:15.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.377+0000 7f3d077fe700 1 -- 172.21.15.40:0/1924743113 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d0809d400 msgr2=0x7f3d0806d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:15.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.377+0000 7f3d077fe700 1 --2- 172.21.15.40:0/1924743113 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d0809d400 0x7f3d0806d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.377+0000 7f3d0cef4700 1 --2- 172.21.15.40:0/1924743113 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d08133e00 0x7f3d0806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:15.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.377+0000 7f3d077fe700 1 -- 172.21.15.40:0/1924743113 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d08133e00 msgr2=0x7f3d0806e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:15.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.377+0000 7f3d077fe700 1 --2- 172.21.15.40:0/1924743113 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d08133e00 0x7f3d0806e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.377+0000 7f3d077fe700 1 -- 172.21.15.40:0/1924743113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cfc0094a0 con 0x7f3d0809dd70 2023-09-30T22:30:15.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.377+0000 7f3d0cef4700 1 --2- 172.21.15.40:0/1924743113 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d08133e00 0x7f3d0806e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:30:15.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.377+0000 7f3d077fe700 1 --2- 172.21.15.40:0/1924743113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d0809dd70 0x7f3d0806db50 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc00ebb0 tx=0x7f3cfc00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:15.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.377+0000 7f1ea6e69700 1 -- 172.21.15.40:0/348087346 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ea009f0f0 msgr2=0x7f1ea0138ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:15.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.377+0000 7f3d04ff9700 1 -- 172.21.15.40:0/1924743113 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc00c850 con 0x7f3d0809dd70 2023-09-30T22:30:15.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.377+0000 7f1ea6e69700 1 --2- 172.21.15.40:0/348087346 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ea009f0f0 0x7f1ea0138ee0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c0098f0 tx=0x7f1e8c009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:15.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.377+0000 7f1ea6e69700 1 -- 172.21.15.40:0/348087346 shutdown_connections 2023-09-30T22:30:15.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.377+0000 7f1ea6e69700 1 --2- 172.21.15.40:0/348087346 >> v2:172.21.15.40:3300/0 conn(0x7f1ea009e400 0x7f1ea013b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.377+0000 7f1ea6e69700 1 --2- 172.21.15.40:0/348087346 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ea009f0f0 0x7f1ea0138ee0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.377+0000 7f1ea6e69700 1 -- 172.21.15.40:0/348087346 >> 172.21.15.40:0/348087346 conn(0x7f1ea009fb20 msgr2=0x7f1ea009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:15.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.377+0000 7f3d04ff9700 1 -- 172.21.15.40:0/1924743113 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cfc00c9b0 con 0x7f3d0809dd70 2023-09-30T22:30:15.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.377+0000 7f3d0e957700 1 -- 172.21.15.40:0/1924743113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf8009550 con 0x7f3d0809dd70 2023-09-30T22:30:15.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.377+0000 7f3d04ff9700 1 -- 172.21.15.40:0/1924743113 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc00cd40 con 0x7f3d0809dd70 2023-09-30T22:30:15.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.377+0000 7f1ea6e69700 1 -- 172.21.15.40:0/348087346 shutdown_connections 2023-09-30T22:30:15.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.377+0000 7f3d0e957700 1 -- 172.21.15.40:0/1924743113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d0812e1a0 con 0x7f3d0809dd70 2023-09-30T22:30:15.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.378+0000 7f3d04ff9700 1 -- 172.21.15.40:0/1924743113 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3cfc013470 con 0x7f3d0809dd70 2023-09-30T22:30:15.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.378+0000 7f3d04ff9700 1 -- 172.21.15.40:0/1924743113 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3cfc03fc50 con 0x7f3d0809dd70 2023-09-30T22:30:15.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.377+0000 7f1ea6e69700 1 -- 172.21.15.40:0/348087346 wait complete. 2023-09-30T22:30:15.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.378+0000 7f3d0e957700 1 -- 172.21.15.40:0/1924743113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d080709e0 con 0x7f3d0809dd70 2023-09-30T22:30:15.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.378+0000 7f1ea6e69700 1 Processor -- start 2023-09-30T22:30:15.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.379+0000 7f1ea6e69700 1 -- start start 2023-09-30T22:30:15.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.379+0000 7f1ea6e69700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ea009d920 0x7f1ea012b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.379+0000 7f1ea6e69700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ea009e400 0x7f1ea012bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.379+0000 7f1ea6e69700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ea013a850 0x7f1ea012c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:15.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.379+0000 7f1ea6e69700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea012e450 con 0x7f1ea013a850 2023-09-30T22:30:15.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.379+0000 7f1ea6e69700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea012d2d0 con 0x7f1ea009e400 2023-09-30T22:30:15.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.379+0000 7f1ea6e69700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea00a3340 con 0x7f1ea009d920 2023-09-30T22:30:15.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.379+0000 7f1ea5406700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ea013a850 0x7f1ea012c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:15.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.379+0000 7f1ea5406700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ea013a850 0x7f1ea012c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46370/0 (socket says 172.21.15.40:46370) 2023-09-30T22:30:15.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.379+0000 7f1ea5406700 1 -- 172.21.15.40:0/1535737216 learned_addr learned my addr 172.21.15.40:0/1535737216 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:15.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.379+0000 7f1e9ffff700 1 --2- 172.21.15.40:0/1535737216 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ea009e400 0x7f1ea012bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:15.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.380+0000 7f1ea5406700 1 -- 172.21.15.40:0/1535737216 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ea009d920 msgr2=0x7f1ea012b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:15.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.380+0000 7f1ea5406700 1 --2- 172.21.15.40:0/1535737216 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ea009d920 0x7f1ea012b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.380+0000 7f1ea5406700 1 -- 172.21.15.40:0/1535737216 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ea009e400 msgr2=0x7f1ea012bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:15.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.380+0000 7f1ea5406700 1 --2- 172.21.15.40:0/1535737216 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ea009e400 0x7f1ea012bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.380+0000 7f1ea5406700 1 -- 172.21.15.40:0/1535737216 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8c009550 con 0x7f1ea013a850 2023-09-30T22:30:15.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.380+0000 7f1ea5406700 1 --2- 172.21.15.40:0/1535737216 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ea013a850 0x7f1ea012c210 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f1e98007df0 tx=0x7f1e9800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:15.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.387+0000 7f1e9d7fa700 1 -- 172.21.15.40:0/1535737216 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9800ddd0 con 0x7f1ea013a850 2023-09-30T22:30:15.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.388+0000 7f1e9d7fa700 1 -- 172.21.15.40:0/1535737216 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9800f040 con 0x7f1ea013a850 2023-09-30T22:30:15.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.388+0000 7f1ea6e69700 1 -- 172.21.15.40:0/1535737216 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ea009c9e0 con 0x7f1ea013a850 2023-09-30T22:30:15.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.388+0000 7f1e9d7fa700 1 -- 172.21.15.40:0/1535737216 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e98003c60 con 0x7f1ea013a850 2023-09-30T22:30:15.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.388+0000 7f1ea6e69700 1 -- 172.21.15.40:0/1535737216 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ea012d870 con 0x7f1ea013a850 2023-09-30T22:30:15.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.388+0000 7f1e9d7fa700 1 -- 172.21.15.40:0/1535737216 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e98004030 con 0x7f1ea013a850 2023-09-30T22:30:15.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.388+0000 7f3d04ff9700 1 -- 172.21.15.40:0/1924743113 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3d080709e0 con 0x7f3d0809dd70 2023-09-30T22:30:15.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.389+0000 7f1ea6e69700 1 -- 172.21.15.40:0/1535737216 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ea0138680 con 0x7f1ea013a850 2023-09-30T22:30:15.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.389+0000 7f1e9d7fa700 1 -- 172.21.15.40:0/1535737216 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f1e9803f890 con 0x7f1ea013a850 2023-09-30T22:30:15.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.393+0000 7f1e9d7fa700 1 -- 172.21.15.40:0/1535737216 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e9801e3b0 con 0x7f1ea013a850 2023-09-30T22:30:15.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.552+0000 7feb06866700 1 -- 172.21.15.40:0/1287436483 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7feb00074620 con 0x7feb00139510 2023-09-30T22:30:15.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.552+0000 7feafcff9700 1 -- 172.21.15.40:0/1287436483 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feaf801a020 con 0x7feb00139510 2023-09-30T22:30:15.552 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:15.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.555+0000 7feb06866700 1 -- 172.21.15.40:0/1287436483 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb00139510 msgr2=0x7feb0006fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:15.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.555+0000 7feb06866700 1 --2- 172.21.15.40:0/1287436483 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb00139510 0x7feb0006fa50 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7feb0009d5e0 tx=0x7feaf800d3b0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.555+0000 7feb06866700 1 -- 172.21.15.40:0/1287436483 shutdown_connections 2023-09-30T22:30:15.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.555+0000 7feb06866700 1 --2- 172.21.15.40:0/1287436483 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feb00139510 0x7feb0006fa50 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.555+0000 7feb06866700 1 --2- 172.21.15.40:0/1287436483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb0009c890 0x7feb0006efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.555+0000 7feb06866700 1 --2- 172.21.15.40:0/1287436483 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7feb00136bf0 0x7feb0006f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.555+0000 7feb06866700 1 -- 172.21.15.40:0/1287436483 >> 172.21.15.40:0/1287436483 conn(0x7feb000a7080 msgr2=0x7feb00136fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:15.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.555+0000 7feb06866700 1 -- 172.21.15.40:0/1287436483 shutdown_connections 2023-09-30T22:30:15.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.555+0000 7feb06866700 1 -- 172.21.15.40:0/1287436483 wait complete. 2023-09-30T22:30:15.567 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:15.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.585+0000 7f3d0e957700 1 -- 172.21.15.40:0/1924743113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3d080709e0 con 0x7f3d0809dd70 2023-09-30T22:30:15.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.586+0000 7f3d04ff9700 1 -- 172.21.15.40:0/1924743113 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3cfc017030 con 0x7f3d0809dd70 2023-09-30T22:30:15.586 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:15.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.588+0000 7f3d0e957700 1 -- 172.21.15.40:0/1924743113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d0809dd70 msgr2=0x7f3d0806db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:15.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.588+0000 7f3d0e957700 1 --2- 172.21.15.40:0/1924743113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d0809dd70 0x7f3d0806db50 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc00ebb0 tx=0x7f3cfc00eec0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.588+0000 7f3d0e957700 1 -- 172.21.15.40:0/1924743113 shutdown_connections 2023-09-30T22:30:15.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.588+0000 7f3d0e957700 1 --2- 172.21.15.40:0/1924743113 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d0809d400 0x7f3d0806d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.588+0000 7f3d0e957700 1 --2- 172.21.15.40:0/1924743113 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d08133e00 0x7f3d0806e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.588+0000 7f3d0e957700 1 --2- 172.21.15.40:0/1924743113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d0809dd70 0x7f3d0806db50 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.588+0000 7f3d0e957700 1 -- 172.21.15.40:0/1924743113 >> 172.21.15.40:0/1924743113 conn(0x7f3d080a2a00 msgr2=0x7f3d0812d880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:15.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.588+0000 7f3d0e957700 1 -- 172.21.15.40:0/1924743113 shutdown_connections 2023-09-30T22:30:15.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.588+0000 7f3d0e957700 1 -- 172.21.15.40:0/1924743113 wait complete. 2023-09-30T22:30:15.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.591+0000 7f1ea6e69700 1 -- 172.21.15.40:0/1535737216 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1ea013b920 con 0x7f1ea013a850 2023-09-30T22:30:15.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.591+0000 7f1e9d7fa700 1 -- 172.21.15.40:0/1535737216 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e9801a070 con 0x7f1ea013a850 2023-09-30T22:30:15.591 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:15.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.593+0000 7f1ea6e69700 1 -- 172.21.15.40:0/1535737216 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ea013a850 msgr2=0x7f1ea012c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:15.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.593+0000 7f1ea6e69700 1 --2- 172.21.15.40:0/1535737216 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ea013a850 0x7f1ea012c210 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f1e98007df0 tx=0x7f1e9800d3b0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.593+0000 7f1ea6e69700 1 -- 172.21.15.40:0/1535737216 shutdown_connections 2023-09-30T22:30:15.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.593+0000 7f1ea6e69700 1 --2- 172.21.15.40:0/1535737216 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ea009d920 0x7f1ea012b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.593+0000 7f1ea6e69700 1 --2- 172.21.15.40:0/1535737216 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ea013a850 0x7f1ea012c210 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.593+0000 7f1ea6e69700 1 --2- 172.21.15.40:0/1535737216 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ea009e400 0x7f1ea012bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:15.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.593+0000 7f1ea6e69700 1 -- 172.21.15.40:0/1535737216 >> 172.21.15.40:0/1535737216 conn(0x7f1ea009fb20 msgr2=0x7f1ea013b130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:15.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.593+0000 7f1ea6e69700 1 -- 172.21.15.40:0/1535737216 shutdown_connections 2023-09-30T22:30:15.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:15.593+0000 7f1ea6e69700 1 -- 172.21.15.40:0/1535737216 wait complete. 2023-09-30T22:30:15.602 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:15.606 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:15.913 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:16.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.041+0000 7f7088187700 1 Processor -- start 2023-09-30T22:30:16.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.042+0000 7f7088187700 1 -- start start 2023-09-30T22:30:16.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.042+0000 7f7088187700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7080131d50 0x7f7080132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:16.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.042+0000 7f7088187700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f708009bc50 0x7f708009c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:16.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.042+0000 7f7088187700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f708009c600 0x7f7080138ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:16.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.042+0000 7f7088187700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7080071920 con 0x7f708009bc50 2023-09-30T22:30:16.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.042+0000 7f7088187700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7080132660 con 0x7f7080131d50 2023-09-30T22:30:16.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.042+0000 7f7088187700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7080131900 con 0x7f708009c600 2023-09-30T22:30:16.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.043+0000 7f7085f23700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7080131d50 0x7f7080132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:16.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.043+0000 7f7085722700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f708009bc50 0x7f708009c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:16.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.043+0000 7f7086724700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f708009c600 0x7f7080138ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:16.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.043+0000 7f7085722700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f708009bc50 0x7f708009c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46374/0 (socket says 172.21.15.40:46374) 2023-09-30T22:30:16.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.043+0000 7f7085f23700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7080131d50 0x7f7080132120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35348/0 (socket says 172.21.15.40:35348) 2023-09-30T22:30:16.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.043+0000 7f7085722700 1 -- 172.21.15.40:0/2204012198 learned_addr learned my addr 172.21.15.40:0/2204012198 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:16.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.043+0000 7f7085722700 1 -- 172.21.15.40:0/2204012198 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f708009c600 msgr2=0x7f7080138ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:16.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.043+0000 7f7085722700 1 --2- 172.21.15.40:0/2204012198 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f708009c600 0x7f7080138ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.043+0000 7f7085722700 1 -- 172.21.15.40:0/2204012198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7080131d50 msgr2=0x7f7080132120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:16.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.043+0000 7f7085722700 1 --2- 172.21.15.40:0/2204012198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7080131d50 0x7f7080132120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.043+0000 7f7085722700 1 -- 172.21.15.40:0/2204012198 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f708009e820 con 0x7f708009bc50 2023-09-30T22:30:16.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.043+0000 7f7086724700 1 --2- 172.21.15.40:0/2204012198 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f708009c600 0x7f7080138ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:16.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.043+0000 7f7085722700 1 --2- 172.21.15.40:0/2204012198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f708009bc50 0x7f708009c0c0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f70700098f0 tx=0x7f7070009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a7d2754d34e4ace server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:16.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.043+0000 7f7084f21700 1 -- 172.21.15.40:0/2204012198 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7070011830 con 0x7f708009bc50 2023-09-30T22:30:16.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.043+0000 7f7084f21700 1 -- 172.21.15.40:0/2204012198 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7070011990 con 0x7f708009bc50 2023-09-30T22:30:16.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.043+0000 7f7084f21700 1 -- 172.21.15.40:0/2204012198 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7070011d20 con 0x7f708009bc50 2023-09-30T22:30:16.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.044+0000 7f7088187700 1 -- 172.21.15.40:0/2204012198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f708009bc50 msgr2=0x7f708009c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:16.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.044+0000 7f7088187700 1 --2- 172.21.15.40:0/2204012198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f708009bc50 0x7f708009c0c0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f70700098f0 tx=0x7f7070009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:16.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.044+0000 7f7088187700 1 -- 172.21.15.40:0/2204012198 shutdown_connections 2023-09-30T22:30:16.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.044+0000 7f7088187700 1 --2- 172.21.15.40:0/2204012198 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f708009c600 0x7f7080138ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.044+0000 7f7088187700 1 --2- 172.21.15.40:0/2204012198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7080131d50 0x7f7080132120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.044+0000 7f7088187700 1 --2- 172.21.15.40:0/2204012198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f708009bc50 0x7f708009c0c0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.044+0000 7f7088187700 1 -- 172.21.15.40:0/2204012198 >> 172.21.15.40:0/2204012198 conn(0x7f70800a2a00 msgr2=0x7f70800a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:16.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.044+0000 7f7088187700 1 -- 172.21.15.40:0/2204012198 shutdown_connections 2023-09-30T22:30:16.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.044+0000 7f7088187700 1 -- 172.21.15.40:0/2204012198 wait complete. 2023-09-30T22:30:16.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.045+0000 7f7088187700 1 Processor -- start 2023-09-30T22:30:16.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.045+0000 7f7088187700 1 -- start start 2023-09-30T22:30:16.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.045+0000 7f7088187700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f708009bc50 0x7f708011e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:16.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.045+0000 7f7088187700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f708009c600 0x7f708011ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:16.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.045+0000 7f7088187700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7080131d50 0x7f708011f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:16.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.045+0000 7f7088187700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7080120310 con 0x7f708009bc50 2023-09-30T22:30:16.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.045+0000 7f7088187700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f708011fbe0 con 0x7f708009c600 2023-09-30T22:30:16.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.045+0000 7f7088187700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f708012ecd0 con 0x7f7080131d50 2023-09-30T22:30:16.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.045+0000 7f7085722700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f708009c600 0x7f708011ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:16.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.045+0000 7f7086724700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7080131d50 0x7f708011f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:16.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.045+0000 7f7085722700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f708009c600 0x7f708011ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35360/0 (socket says 172.21.15.40:35360) 2023-09-30T22:30:16.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.045+0000 7f7085722700 1 -- 172.21.15.40:0/194869768 learned_addr learned my addr 172.21.15.40:0/194869768 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:16.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.045+0000 7f7085f23700 1 --2- 172.21.15.40:0/194869768 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f708009bc50 0x7f708011e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:16.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.046+0000 7f7085722700 1 -- 172.21.15.40:0/194869768 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7080131d50 msgr2=0x7f708011f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:16.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.046+0000 7f7085722700 1 --2- 172.21.15.40:0/194869768 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7080131d50 0x7f708011f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.046+0000 7f7085722700 1 -- 172.21.15.40:0/194869768 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f708009bc50 msgr2=0x7f708011e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:16.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.046+0000 7f7085722700 1 --2- 172.21.15.40:0/194869768 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f708009bc50 0x7f708011e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.046+0000 7f7085722700 1 -- 172.21.15.40:0/194869768 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7078009a70 con 0x7f708009c600 2023-09-30T22:30:16.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.046+0000 7f7085722700 1 --2- 172.21.15.40:0/194869768 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f708009c600 0x7f708011ec50 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f7070009c40 tx=0x7f7070004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:16.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.046+0000 7f70767fc700 1 -- 172.21.15.40:0/194869768 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7070004450 con 0x7f708009c600 2023-09-30T22:30:16.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.046+0000 7f70767fc700 1 -- 172.21.15.40:0/194869768 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707001e070 con 0x7f708009c600 2023-09-30T22:30:16.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.046+0000 7f7088187700 1 -- 172.21.15.40:0/194869768 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7070009550 con 0x7f708009c600 2023-09-30T22:30:16.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.046+0000 7f70767fc700 1 -- 172.21.15.40:0/194869768 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70700038e0 con 0x7f708009c600 2023-09-30T22:30:16.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.046+0000 7f7088187700 1 -- 172.21.15.40:0/194869768 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7080121dc0 con 0x7f708009c600 2023-09-30T22:30:16.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.047+0000 7f70767fc700 1 -- 172.21.15.40:0/194869768 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7070003a40 con 0x7f708009c600 2023-09-30T22:30:16.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.047+0000 7f70767fc700 1 -- 172.21.15.40:0/194869768 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f70700403c0 con 0x7f708009c600 2023-09-30T22:30:16.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.047+0000 7f7088187700 1 -- 172.21.15.40:0/194869768 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7080062380 con 0x7f708009c600 2023-09-30T22:30:16.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.052+0000 7f70767fc700 1 -- 172.21.15.40:0/194869768 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f707002d7d0 con 0x7f708009c600 2023-09-30T22:30:16.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.245+0000 7f7088187700 1 -- 172.21.15.40:0/194869768 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7080120700 con 0x7f708009c600 2023-09-30T22:30:16.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.245+0000 7f70767fc700 1 -- 172.21.15.40:0/194869768 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7070023ba0 con 0x7f708009c600 2023-09-30T22:30:16.245 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:16.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.248+0000 7f7088187700 1 -- 172.21.15.40:0/194869768 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f708009c600 msgr2=0x7f708011ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:16.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.248+0000 7f7088187700 1 --2- 172.21.15.40:0/194869768 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f708009c600 0x7f708011ec50 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f7070009c40 tx=0x7f7070004750 comp rx=0 tx=0).stop 2023-09-30T22:30:16.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.248+0000 7f7088187700 1 -- 172.21.15.40:0/194869768 shutdown_connections 2023-09-30T22:30:16.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.248+0000 7f7088187700 1 --2- 172.21.15.40:0/194869768 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7080131d50 0x7f708011f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.248+0000 7f7088187700 1 --2- 172.21.15.40:0/194869768 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f708009bc50 0x7f708011e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.248+0000 7f7088187700 1 --2- 172.21.15.40:0/194869768 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f708009c600 0x7f708011ec50 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.248+0000 7f7088187700 1 -- 172.21.15.40:0/194869768 >> 172.21.15.40:0/194869768 conn(0x7f70800a2a00 msgr2=0x7f70800a0900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:16.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.248+0000 7f7088187700 1 -- 172.21.15.40:0/194869768 shutdown_connections 2023-09-30T22:30:16.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.248+0000 7f7088187700 1 -- 172.21.15.40:0/194869768 wait complete. 2023-09-30T22:30:16.259 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:16.568 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:16.603 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:16.607 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:16.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.704+0000 7f8818936700 1 Processor -- start 2023-09-30T22:30:16.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.704+0000 7f8818936700 1 -- start start 2023-09-30T22:30:16.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.705+0000 7f8818936700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8814133e00 0x7f88141341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:16.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.705+0000 7f8818936700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f881409df40 0x7f881413bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:16.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.705+0000 7f8818936700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8814133940 con 0x7f881409d400 2023-09-30T22:30:16.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.705+0000 7f8818936700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f881409ab20 con 0x7f881409df40 2023-09-30T22:30:16.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.705+0000 7f8818936700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f881409f0d0 con 0x7f8814133e00 2023-09-30T22:30:16.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.705+0000 7f8811d9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f881409d400 0x7f881409d830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55608/0 (socket says 172.21.15.40:55608) 2023-09-30T22:30:16.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.705+0000 7f8811d9b700 1 -- 172.21.15.40:0/1205640346 learned_addr learned my addr 172.21.15.40:0/1205640346 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:16.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.705+0000 7f8812d9d700 1 --2- 172.21.15.40:0/1205640346 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f881409df40 0x7f881413bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:16.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.705+0000 7f881259c700 1 --2- 172.21.15.40:0/1205640346 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8814133e00 0x7f88141341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:16.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.705+0000 7f881159a700 1 -- 172.21.15.40:0/1205640346 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3017736560 0 0) 0x7f8814133940 con 0x7f881409d400 2023-09-30T22:30:16.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.705+0000 7f881159a700 1 -- 172.21.15.40:0/1205640346 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87fc0035b0 con 0x7f881409d400 2023-09-30T22:30:16.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.705+0000 7f881259c700 1 -- 172.21.15.40:0/1205640346 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f881409df40 msgr2=0x7f881413bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:16.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.705+0000 7f881259c700 1 --2- 172.21.15.40:0/1205640346 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f881409df40 0x7f881413bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.705+0000 7f881259c700 1 -- 172.21.15.40:0/1205640346 >> v1:172.21.15.40:6789/0 conn(0x7f881409d400 legacy=0x7f881409d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:16.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.705+0000 7f881259c700 1 -- 172.21.15.40:0/1205640346 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8814133be0 con 0x7f8814133e00 2023-09-30T22:30:16.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.705+0000 7f8812d9d700 1 --2- 172.21.15.40:0/1205640346 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f881409df40 0x7f881413bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:16.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.706+0000 7f881259c700 1 --2- 172.21.15.40:0/1205640346 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8814133e00 0x7f88141341d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f8804009870 tx=0x7f8804009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76d31b21dfe9fff5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:16.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.706+0000 7f881159a700 1 -- 172.21.15.40:0/1205640346 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8804011830 con 0x7f8814133e00 2023-09-30T22:30:16.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.706+0000 7f881159a700 1 -- 172.21.15.40:0/1205640346 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8804011990 con 0x7f8814133e00 2023-09-30T22:30:16.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.706+0000 7f881159a700 1 -- 172.21.15.40:0/1205640346 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8804011d20 con 0x7f8814133e00 2023-09-30T22:30:16.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.706+0000 7f8818936700 1 -- 172.21.15.40:0/1205640346 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8814133e00 msgr2=0x7f88141341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:16.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.706+0000 7f8818936700 1 --2- 172.21.15.40:0/1205640346 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8814133e00 0x7f88141341d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f8804009870 tx=0x7f8804009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:16.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.707+0000 7f8818936700 1 -- 172.21.15.40:0/1205640346 shutdown_connections 2023-09-30T22:30:16.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.707+0000 7f8818936700 1 --2- 172.21.15.40:0/1205640346 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f881409df40 0x7f881413bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.707+0000 7f8818936700 1 --2- 172.21.15.40:0/1205640346 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8814133e00 0x7f88141341d0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.707+0000 7f8818936700 1 -- 172.21.15.40:0/1205640346 >> 172.21.15.40:0/1205640346 conn(0x7f88140a2a00 msgr2=0x7f88140a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:16.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.707+0000 7f8818936700 1 -- 172.21.15.40:0/1205640346 shutdown_connections 2023-09-30T22:30:16.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.707+0000 7f8818936700 1 -- 172.21.15.40:0/1205640346 wait complete. 2023-09-30T22:30:16.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.708+0000 7f8818936700 1 Processor -- start 2023-09-30T22:30:16.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.708+0000 7f8818936700 1 -- start start 2023-09-30T22:30:16.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.708+0000 7f8818936700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f881409d400 0x7f881411a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:16.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.708+0000 7f8818936700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f881409df40 0x7f881411add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:16.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.708+0000 7f8818936700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8814133e00 0x7f881411b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:16.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.708+0000 7f8818936700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881412e200 con 0x7f881409d400 2023-09-30T22:30:16.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.708+0000 7f8818936700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f881411c620 con 0x7f8814133e00 2023-09-30T22:30:16.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.708+0000 7f8818936700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f881411de10 con 0x7f881409df40 2023-09-30T22:30:16.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.708+0000 7f8811d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f881409df40 0x7f881411add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:16.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.709+0000 7f8811d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f881409df40 0x7f881411add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:47650/0 (socket says 172.21.15.40:47650) 2023-09-30T22:30:16.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.709+0000 7f8811d9b700 1 -- 172.21.15.40:0/2975418853 learned_addr learned my addr 172.21.15.40:0/2975418853 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:16.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.709+0000 7f8812d9d700 1 --2- 172.21.15.40:0/2975418853 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8814133e00 0x7f881411b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:16.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.709+0000 7f881259c700 1 --2- 172.21.15.40:0/2975418853 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f881409d400 0x7f881411a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:16.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.709+0000 7f8811d9b700 1 -- 172.21.15.40:0/2975418853 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8814133e00 msgr2=0x7f881411b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:16.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.709+0000 7f8811d9b700 1 --2- 172.21.15.40:0/2975418853 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8814133e00 0x7f881411b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.709+0000 7f8811d9b700 1 -- 172.21.15.40:0/2975418853 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f881409d400 msgr2=0x7f881411a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:16.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.709+0000 7f8811d9b700 1 --2- 172.21.15.40:0/2975418853 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f881409d400 0x7f881411a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.709+0000 7f8811d9b700 1 -- 172.21.15.40:0/2975418853 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880c009a70 con 0x7f881409df40 2023-09-30T22:30:16.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.709+0000 7f8812d9d700 1 --2- 172.21.15.40:0/2975418853 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8814133e00 0x7f881411b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:16.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.709+0000 7f881259c700 1 --2- 172.21.15.40:0/2975418853 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f881409d400 0x7f881411a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:16.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.709+0000 7f8811d9b700 1 --2- 172.21.15.40:0/2975418853 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f881409df40 0x7f881411add0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f880800c700 tx=0x7f880800ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:16.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.709+0000 7f8802ffd700 1 -- 172.21.15.40:0/2975418853 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8808005d70 con 0x7f881409df40 2023-09-30T22:30:16.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.709+0000 7f8802ffd700 1 -- 172.21.15.40:0/2975418853 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88080070d0 con 0x7f881409df40 2023-09-30T22:30:16.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.709+0000 7f8818936700 1 -- 172.21.15.40:0/2975418853 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88040094a0 con 0x7f881409df40 2023-09-30T22:30:16.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.709+0000 7f8802ffd700 1 -- 172.21.15.40:0/2975418853 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8808007460 con 0x7f881409df40 2023-09-30T22:30:16.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.710+0000 7f8818936700 1 -- 172.21.15.40:0/2975418853 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f881411e400 con 0x7f881409df40 2023-09-30T22:30:16.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.710+0000 7f8802ffd700 1 -- 172.21.15.40:0/2975418853 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f88080075c0 con 0x7f881409df40 2023-09-30T22:30:16.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.711+0000 7f8818936700 1 -- 172.21.15.40:0/2975418853 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f881411db40 con 0x7f881409df40 2023-09-30T22:30:16.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.711+0000 7f8802ffd700 1 -- 172.21.15.40:0/2975418853 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f880803e970 con 0x7f881409df40 2023-09-30T22:30:16.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.716+0000 7f8802ffd700 1 -- 172.21.15.40:0/2975418853 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8808017080 con 0x7f881409df40 2023-09-30T22:30:16.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.745+0000 7f9db9566700 1 Processor -- start 2023-09-30T22:30:16.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.745+0000 7f45861c1700 1 Processor -- start 2023-09-30T22:30:16.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.745+0000 7f45861c1700 1 -- start start 2023-09-30T22:30:16.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.745+0000 7f9db9566700 1 -- start start 2023-09-30T22:30:16.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.745+0000 7f9db9566700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9db406f070 0x7f9db406f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:16.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.745+0000 7f9db9566700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9db406f980 0x7f9db4097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:16.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.745+0000 7f45861c1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f458009fbb0 0x7f458006c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:16.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.745+0000 7f9db9566700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9db406fdb0 0x7f9db40975d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:16.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.745+0000 7f9db9566700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9db4070830 con 0x7f9db406f070 2023-09-30T22:30:16.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.745+0000 7f45861c1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f458006ced0 0x7f458006d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:16.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.745+0000 7f9db9566700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db4070ad0 con 0x7f9db406fdb0 2023-09-30T22:30:16.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.745+0000 7f9db9566700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9db4070de0 con 0x7f9db406f980 2023-09-30T22:30:16.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.745+0000 7f45861c1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f458006e3f0 con 0x7f4580138370 2023-09-30T22:30:16.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.745+0000 7f45861c1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f458009ff80 con 0x7f458006ced0 2023-09-30T22:30:16.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.745+0000 7f45861c1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f458006ec40 con 0x7f458009fbb0 2023-09-30T22:30:16.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.746+0000 7f457ffff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f4580138370 0x7f458013a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55624/0 (socket says 172.21.15.40:55624) 2023-09-30T22:30:16.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.746+0000 7f457ffff700 1 -- 172.21.15.40:0/1285764540 learned_addr learned my addr 172.21.15.40:0/1285764540 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:16.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.746+0000 7f457effd700 1 --2- 172.21.15.40:0/1285764540 >> v2:172.21.15.40:3300/0 conn(0x7f458006ced0 0x7f458006d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:16.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.746+0000 7f9db37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9db406fdb0 0x7f9db40975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:16.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.746+0000 7f9db37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9db406fdb0 0x7f9db40975d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35394/0 (socket says 172.21.15.40:35394) 2023-09-30T22:30:16.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.746+0000 7f9db37fe700 1 -- 172.21.15.40:0/2477235531 learned_addr learned my addr 172.21.15.40:0/2477235531 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:16.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.746+0000 7f457effd700 1 -- 172.21.15.40:0/1285764540 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f458009fbb0 msgr2=0x7f458006c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:16.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.746+0000 7f457effd700 1 --2- 172.21.15.40:0/1285764540 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f458009fbb0 0x7f458006c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.746+0000 7f457effd700 1 -- 172.21.15.40:0/1285764540 >> v1:172.21.15.40:6789/0 conn(0x7f4580138370 legacy=0x7f458013a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:16.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.746+0000 7f457effd700 1 -- 172.21.15.40:0/1285764540 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4580097ed0 con 0x7f458006ced0 2023-09-30T22:30:16.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.746+0000 7f9db37fe700 1 -- 172.21.15.40:0/2477235531 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9db406f980 msgr2=0x7f9db4097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:16.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.746+0000 7f9db37fe700 1 --2- 172.21.15.40:0/2477235531 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9db406f980 0x7f9db4097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.746+0000 7f9db37fe700 1 -- 172.21.15.40:0/2477235531 >> v2:172.21.15.40:3300/0 conn(0x7f9db406f070 msgr2=0x7f9db406f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:16.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.746+0000 7f9db37fe700 1 --2- 172.21.15.40:0/2477235531 >> v2:172.21.15.40:3300/0 conn(0x7f9db406f070 0x7f9db406f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.746+0000 7f9db37fe700 1 -- 172.21.15.40:0/2477235531 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db409fe20 con 0x7f9db406fdb0 2023-09-30T22:30:16.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.746+0000 7f457effd700 1 --2- 172.21.15.40:0/1285764540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f458006ced0 0x7f458006d2e0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f4574009840 tx=0x7f4574009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45318632d7fdefab server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:16.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.746+0000 7f9db37fe700 1 --2- 172.21.15.40:0/2477235531 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9db406fdb0 0x7f9db40975d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9dac009e50 tx=0x7f9dac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c3c71f397c92b26 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:16.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.746+0000 7f457e7fc700 1 -- 172.21.15.40:0/1285764540 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4574011830 con 0x7f458006ced0 2023-09-30T22:30:16.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.746+0000 7f457e7fc700 1 -- 172.21.15.40:0/1285764540 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4574011990 con 0x7f458006ced0 2023-09-30T22:30:16.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.746+0000 7f457e7fc700 1 -- 172.21.15.40:0/1285764540 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4574011d20 con 0x7f458006ced0 2023-09-30T22:30:16.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.746+0000 7f9db1ffb700 1 -- 172.21.15.40:0/2477235531 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac00e070 con 0x7f9db406fdb0 2023-09-30T22:30:16.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.747+0000 7f9db1ffb700 1 -- 172.21.15.40:0/2477235531 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dac00b9c0 con 0x7f9db406fdb0 2023-09-30T22:30:16.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.747+0000 7f9db1ffb700 1 -- 172.21.15.40:0/2477235531 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac00bd70 con 0x7f9db406fdb0 2023-09-30T22:30:16.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.747+0000 7f9db9566700 1 -- 172.21.15.40:0/2477235531 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9db406fdb0 msgr2=0x7f9db40975d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:16.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.747+0000 7f45861c1700 1 -- 172.21.15.40:0/1285764540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f458006ced0 msgr2=0x7f458006d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:16.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.747+0000 7f45861c1700 1 --2- 172.21.15.40:0/1285764540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f458006ced0 0x7f458006d2e0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f4574009840 tx=0x7f4574009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:16.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.747+0000 7f9db9566700 1 --2- 172.21.15.40:0/2477235531 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9db406fdb0 0x7f9db40975d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9dac009e50 tx=0x7f9dac00b330 comp rx=0 tx=0).stop 2023-09-30T22:30:16.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.747+0000 7f9db9566700 1 -- 172.21.15.40:0/2477235531 shutdown_connections 2023-09-30T22:30:16.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.747+0000 7f9db9566700 1 --2- 172.21.15.40:0/2477235531 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9db406fdb0 0x7f9db40975d0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.747+0000 7f9db9566700 1 --2- 172.21.15.40:0/2477235531 >> v2:172.21.15.40:3300/0 conn(0x7f9db406f070 0x7f9db406f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.747+0000 7f9db9566700 1 --2- 172.21.15.40:0/2477235531 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9db406f980 0x7f9db4097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.747+0000 7f9db9566700 1 -- 172.21.15.40:0/2477235531 >> 172.21.15.40:0/2477235531 conn(0x7f9db40a41a0 msgr2=0x7f9db40a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:16.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.747+0000 7f45861c1700 1 -- 172.21.15.40:0/1285764540 shutdown_connections 2023-09-30T22:30:16.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.747+0000 7f45861c1700 1 --2- 172.21.15.40:0/1285764540 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f458009fbb0 0x7f458006c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.747+0000 7f45861c1700 1 --2- 172.21.15.40:0/1285764540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f458006ced0 0x7f458006d2e0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.747+0000 7f45861c1700 1 -- 172.21.15.40:0/1285764540 >> 172.21.15.40:0/1285764540 conn(0x7f45800a41a0 msgr2=0x7f45800a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:16.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.747+0000 7f9db9566700 1 -- 172.21.15.40:0/2477235531 shutdown_connections 2023-09-30T22:30:16.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.747+0000 7f9db9566700 1 -- 172.21.15.40:0/2477235531 wait complete. 2023-09-30T22:30:16.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.747+0000 7f45861c1700 1 -- 172.21.15.40:0/1285764540 shutdown_connections 2023-09-30T22:30:16.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.747+0000 7f45861c1700 1 -- 172.21.15.40:0/1285764540 wait complete. 2023-09-30T22:30:16.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.748+0000 7f9db9566700 1 Processor -- start 2023-09-30T22:30:16.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.749+0000 7f9db9566700 1 -- start start 2023-09-30T22:30:16.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.749+0000 7f45861c1700 1 Processor -- start 2023-09-30T22:30:16.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.749+0000 7f45861c1700 1 -- start start 2023-09-30T22:30:16.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.749+0000 7f9db9566700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9db406f070 0x7f9db412d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:16.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.749+0000 7f9db9566700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9db406f980 0x7f9db412d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:16.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.749+0000 7f9db9566700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9db406fdb0 0x7f9db412dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:16.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.749+0000 7f9db9566700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db4130a70 con 0x7f9db406f980 2023-09-30T22:30:16.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.749+0000 7f9db9566700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db412e690 con 0x7f9db406f070 2023-09-30T22:30:16.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.749+0000 7f9db9566700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9db4130d50 con 0x7f9db406fdb0 2023-09-30T22:30:16.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.749+0000 7f9db2ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9db406f070 0x7f9db412d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:16.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.749+0000 7f9db2ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9db406f070 0x7f9db412d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35410/0 (socket says 172.21.15.40:35410) 2023-09-30T22:30:16.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.749+0000 7f9db2ffd700 1 -- 172.21.15.40:0/2164663922 learned_addr learned my addr 172.21.15.40:0/2164663922 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:16.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.749+0000 7f9db27fc700 1 --2- 172.21.15.40:0/2164663922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9db406f980 0x7f9db412d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:16.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.750+0000 7f9db2ffd700 1 -- 172.21.15.40:0/2164663922 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9db406fdb0 msgr2=0x7f9db412dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:16.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.750+0000 7f9db2ffd700 1 --2- 172.21.15.40:0/2164663922 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9db406fdb0 0x7f9db412dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.750+0000 7f9db2ffd700 1 -- 172.21.15.40:0/2164663922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9db406f980 msgr2=0x7f9db412d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:16.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.750+0000 7f9db2ffd700 1 --2- 172.21.15.40:0/2164663922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9db406f980 0x7f9db412d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.750+0000 7f9db2ffd700 1 -- 172.21.15.40:0/2164663922 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dac009b30 con 0x7f9db406f070 2023-09-30T22:30:16.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.750+0000 7f9db27fc700 1 --2- 172.21.15.40:0/2164663922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9db406f980 0x7f9db412d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:16.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.750+0000 7f45861c1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f458006ced0 0x7f4580137720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:16.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.750+0000 7f45861c1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f458009fbb0 0x7f4580137c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:16.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.750+0000 7f45861c1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4580138370 0x7f4580095d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:16.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.750+0000 7f45861c1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4580094bf0 con 0x7f458006ced0 2023-09-30T22:30:16.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.750+0000 7f45861c1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45801381a0 con 0x7f458009fbb0 2023-09-30T22:30:16.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.750+0000 7f45861c1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4580093e80 con 0x7f4580138370 2023-09-30T22:30:16.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.750+0000 7f457ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4580138370 0x7f4580095d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:16.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.750+0000 7f457ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4580138370 0x7f4580095d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:47666/0 (socket says 172.21.15.40:47666) 2023-09-30T22:30:16.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.750+0000 7f457ffff700 1 -- 172.21.15.40:0/4203904254 learned_addr learned my addr 172.21.15.40:0/4203904254 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:16.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.750+0000 7f9db2ffd700 1 --2- 172.21.15.40:0/2164663922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9db406f070 0x7f9db412d230 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9da400b530 tx=0x7f9da400b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:16.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.750+0000 7f457f7fe700 1 --2- 172.21.15.40:0/4203904254 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f458006ced0 0x7f4580137720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:16.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.750+0000 7f457effd700 1 --2- 172.21.15.40:0/4203904254 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f458009fbb0 0x7f4580137c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:16.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.750+0000 7f457f7fe700 1 -- 172.21.15.40:0/4203904254 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4580138370 msgr2=0x7f4580095d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:16.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.750+0000 7f457f7fe700 1 --2- 172.21.15.40:0/4203904254 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4580138370 0x7f4580095d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.750+0000 7f457f7fe700 1 -- 172.21.15.40:0/4203904254 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f458009fbb0 msgr2=0x7f4580137c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:16.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.750+0000 7f457f7fe700 1 --2- 172.21.15.40:0/4203904254 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f458009fbb0 0x7f4580137c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.750+0000 7f457f7fe700 1 -- 172.21.15.40:0/4203904254 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45740094a0 con 0x7f458006ced0 2023-09-30T22:30:16.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.750+0000 7f457effd700 1 --2- 172.21.15.40:0/4203904254 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f458009fbb0 0x7f4580137c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:16.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.750+0000 7f9d9b7fe700 1 -- 172.21.15.40:0/2164663922 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da4011830 con 0x7f9db406f070 2023-09-30T22:30:16.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.750+0000 7f9d9b7fe700 1 -- 172.21.15.40:0/2164663922 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da4011990 con 0x7f9db406f070 2023-09-30T22:30:16.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.750+0000 7f9db9566700 1 -- 172.21.15.40:0/2164663922 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db41292a0 con 0x7f9db406f070 2023-09-30T22:30:16.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.750+0000 7f9d9b7fe700 1 -- 172.21.15.40:0/2164663922 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da4011d40 con 0x7f9db406f070 2023-09-30T22:30:16.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.751+0000 7f9db9566700 1 -- 172.21.15.40:0/2164663922 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db4131930 con 0x7f9db406f070 2023-09-30T22:30:16.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.751+0000 7f9d9b7fe700 1 -- 172.21.15.40:0/2164663922 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9da401a400 con 0x7f9db406f070 2023-09-30T22:30:16.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.751+0000 7f457f7fe700 1 --2- 172.21.15.40:0/4203904254 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f458006ced0 0x7f4580137720 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f457000b450 tx=0x7f457000b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:16.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.751+0000 7f9db9566700 1 -- 172.21.15.40:0/2164663922 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9db4062380 con 0x7f9db406f070 2023-09-30T22:30:16.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.752+0000 7f4567fff700 1 -- 172.21.15.40:0/4203904254 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4570011830 con 0x7f458006ced0 2023-09-30T22:30:16.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.752+0000 7f4567fff700 1 -- 172.21.15.40:0/4203904254 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4570011990 con 0x7f458006ced0 2023-09-30T22:30:16.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.752+0000 7f45861c1700 1 -- 172.21.15.40:0/4203904254 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f458009f4f0 con 0x7f458006ced0 2023-09-30T22:30:16.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.752+0000 7f4567fff700 1 -- 172.21.15.40:0/4203904254 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4570011d40 con 0x7f458006ced0 2023-09-30T22:30:16.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.752+0000 7f45861c1700 1 -- 172.21.15.40:0/4203904254 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4580093210 con 0x7f458006ced0 2023-09-30T22:30:16.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.752+0000 7f4567fff700 1 -- 172.21.15.40:0/4203904254 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f457001a400 con 0x7f458006ced0 2023-09-30T22:30:16.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.753+0000 7f4567fff700 1 -- 172.21.15.40:0/4203904254 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f457003f580 con 0x7f458006ced0 2023-09-30T22:30:16.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.753+0000 7f45861c1700 1 -- 172.21.15.40:0/4203904254 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4580062380 con 0x7f458006ced0 2023-09-30T22:30:16.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.752+0000 7f9d9b7fe700 1 -- 172.21.15.40:0/2164663922 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9da403f690 con 0x7f9db406f070 2023-09-30T22:30:16.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.757+0000 7f4567fff700 1 -- 172.21.15.40:0/4203904254 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4570015030 con 0x7f458006ced0 2023-09-30T22:30:16.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.761+0000 7f9d9b7fe700 1 -- 172.21.15.40:0/2164663922 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9da401ae60 con 0x7f9db406f070 2023-09-30T22:30:16.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.920+0000 7f8818936700 1 -- 172.21.15.40:0/2975418853 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f881411e400 con 0x7f881409df40 2023-09-30T22:30:16.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.921+0000 7f8802ffd700 1 -- 172.21.15.40:0/2975418853 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f881411e400 con 0x7f881409df40 2023-09-30T22:30:16.920 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:16.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.923+0000 7f8818936700 1 -- 172.21.15.40:0/2975418853 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f881409df40 msgr2=0x7f881411add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:16.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.923+0000 7f8818936700 1 --2- 172.21.15.40:0/2975418853 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f881409df40 0x7f881411add0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f880800c700 tx=0x7f880800ca10 comp rx=0 tx=0).stop 2023-09-30T22:30:16.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.923+0000 7f8818936700 1 -- 172.21.15.40:0/2975418853 shutdown_connections 2023-09-30T22:30:16.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.923+0000 7f8818936700 1 --2- 172.21.15.40:0/2975418853 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8814133e00 0x7f881411b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.923+0000 7f8818936700 1 --2- 172.21.15.40:0/2975418853 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f881409d400 0x7f881411a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.923+0000 7f8818936700 1 --2- 172.21.15.40:0/2975418853 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f881409df40 0x7f881411add0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.923+0000 7f8818936700 1 -- 172.21.15.40:0/2975418853 >> 172.21.15.40:0/2975418853 conn(0x7f88140a2a00 msgr2=0x7f88141bb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:16.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.923+0000 7f8818936700 1 -- 172.21.15.40:0/2975418853 shutdown_connections 2023-09-30T22:30:16.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.923+0000 7f8818936700 1 -- 172.21.15.40:0/2975418853 wait complete. 2023-09-30T22:30:16.935 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:16.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.955+0000 7f45861c1700 1 -- 172.21.15.40:0/4203904254 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4580070cc0 con 0x7f458006ced0 2023-09-30T22:30:16.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.955+0000 7f4567fff700 1 -- 172.21.15.40:0/4203904254 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4570029090 con 0x7f458006ced0 2023-09-30T22:30:16.955 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:16.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.957+0000 7f45861c1700 1 -- 172.21.15.40:0/4203904254 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f458006ced0 msgr2=0x7f4580137720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:16.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.957+0000 7f45861c1700 1 --2- 172.21.15.40:0/4203904254 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f458006ced0 0x7f4580137720 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f457000b450 tx=0x7f457000b760 comp rx=0 tx=0).stop 2023-09-30T22:30:16.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.957+0000 7f45861c1700 1 -- 172.21.15.40:0/4203904254 shutdown_connections 2023-09-30T22:30:16.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.957+0000 7f45861c1700 1 --2- 172.21.15.40:0/4203904254 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4580138370 0x7f4580095d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.957+0000 7f45861c1700 1 --2- 172.21.15.40:0/4203904254 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f458006ced0 0x7f4580137720 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.957+0000 7f45861c1700 1 --2- 172.21.15.40:0/4203904254 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f458009fbb0 0x7f4580137c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.957+0000 7f45861c1700 1 -- 172.21.15.40:0/4203904254 >> 172.21.15.40:0/4203904254 conn(0x7f45800a41a0 msgr2=0x7f458009a070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:16.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.957+0000 7f45861c1700 1 -- 172.21.15.40:0/4203904254 shutdown_connections 2023-09-30T22:30:16.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.957+0000 7f45861c1700 1 -- 172.21.15.40:0/4203904254 wait complete. 2023-09-30T22:30:16.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.958+0000 7f9db9566700 1 -- 172.21.15.40:0/2164663922 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9db4074620 con 0x7f9db406f070 2023-09-30T22:30:16.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.959+0000 7f9d9b7fe700 1 -- 172.21.15.40:0/2164663922 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9da4022350 con 0x7f9db406f070 2023-09-30T22:30:16.958 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:16.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.961+0000 7f9db9566700 1 -- 172.21.15.40:0/2164663922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9db406f070 msgr2=0x7f9db412d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:16.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.961+0000 7f9db9566700 1 --2- 172.21.15.40:0/2164663922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9db406f070 0x7f9db412d230 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9da400b530 tx=0x7f9da400b840 comp rx=0 tx=0).stop 2023-09-30T22:30:16.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.961+0000 7f9db9566700 1 -- 172.21.15.40:0/2164663922 shutdown_connections 2023-09-30T22:30:16.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.961+0000 7f9db9566700 1 --2- 172.21.15.40:0/2164663922 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9db406fdb0 0x7f9db412dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.961+0000 7f9db9566700 1 --2- 172.21.15.40:0/2164663922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9db406f070 0x7f9db412d230 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.961+0000 7f9db9566700 1 --2- 172.21.15.40:0/2164663922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9db406f980 0x7f9db412d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:16.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.961+0000 7f9db9566700 1 -- 172.21.15.40:0/2164663922 >> 172.21.15.40:0/2164663922 conn(0x7f9db40a41a0 msgr2=0x7f9db40973c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:16.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.961+0000 7f9db9566700 1 -- 172.21.15.40:0/2164663922 shutdown_connections 2023-09-30T22:30:16.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:16.961+0000 7f9db9566700 1 -- 172.21.15.40:0/2164663922 wait complete. 2023-09-30T22:30:16.970 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:16.974 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:17.260 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:17.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.390+0000 7fdaafbb6700 1 Processor -- start 2023-09-30T22:30:17.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.390+0000 7fdaafbb6700 1 -- start start 2023-09-30T22:30:17.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.390+0000 7fdaafbb6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdaa809d920 0x7fdaa809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:17.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.390+0000 7fdaafbb6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdaa809f0f0 0x7fdaa809e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:17.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.391+0000 7fdaafbb6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaa809f940 con 0x7fdaa8133ca0 2023-09-30T22:30:17.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.391+0000 7fdaafbb6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa806b4c0 con 0x7fdaa809f0f0 2023-09-30T22:30:17.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.391+0000 7fdaafbb6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa809a8f0 con 0x7fdaa809d920 2023-09-30T22:30:17.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.391+0000 7fdaad952700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdaa809d920 0x7fdaa809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:17.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.391+0000 7fdaae153700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fdaa8133ca0 0x7fdaa8134140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55626/0 (socket says 172.21.15.40:55626) 2023-09-30T22:30:17.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.391+0000 7fdaad151700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdaa809f0f0 0x7fdaa809e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:17.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.391+0000 7fdaae153700 1 -- 172.21.15.40:0/282927878 learned_addr learned my addr 172.21.15.40:0/282927878 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:17.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.391+0000 7fdaac950700 1 -- 172.21.15.40:0/282927878 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3016226616 0 0) 0x7fdaa809f940 con 0x7fdaa8133ca0 2023-09-30T22:30:17.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.391+0000 7fdaac950700 1 -- 172.21.15.40:0/282927878 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda940035b0 con 0x7fdaa8133ca0 2023-09-30T22:30:17.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.391+0000 7fdaad151700 1 -- 172.21.15.40:0/282927878 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdaa809d920 msgr2=0x7fdaa809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:17.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.391+0000 7fdaad151700 1 --2- 172.21.15.40:0/282927878 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdaa809d920 0x7fdaa809dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.391+0000 7fdaad151700 1 -- 172.21.15.40:0/282927878 >> v1:172.21.15.40:6789/0 conn(0x7fdaa8133ca0 legacy=0x7fdaa8134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:17.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.391+0000 7fdaad151700 1 -- 172.21.15.40:0/282927878 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa809f6e0 con 0x7fdaa809f0f0 2023-09-30T22:30:17.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.391+0000 7fdaad952700 1 --2- 172.21.15.40:0/282927878 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdaa809d920 0x7fdaa809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:17.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.391+0000 7fdaad151700 1 --2- 172.21.15.40:0/282927878 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdaa809f0f0 0x7fdaa809e230 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fda98009870 tx=0x7fda98009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b54f7e8296ba2064 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:17.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.391+0000 7fdaac950700 1 -- 172.21.15.40:0/282927878 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda98011830 con 0x7fdaa809f0f0 2023-09-30T22:30:17.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.391+0000 7fdaac950700 1 -- 172.21.15.40:0/282927878 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda98011990 con 0x7fdaa809f0f0 2023-09-30T22:30:17.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.391+0000 7fdaac950700 1 -- 172.21.15.40:0/282927878 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda98011d20 con 0x7fdaa809f0f0 2023-09-30T22:30:17.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.392+0000 7fdaafbb6700 1 -- 172.21.15.40:0/282927878 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdaa809f0f0 msgr2=0x7fdaa809e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:17.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.392+0000 7fdaafbb6700 1 --2- 172.21.15.40:0/282927878 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdaa809f0f0 0x7fdaa809e230 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fda98009870 tx=0x7fda98009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:17.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.392+0000 7fdaafbb6700 1 -- 172.21.15.40:0/282927878 shutdown_connections 2023-09-30T22:30:17.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.392+0000 7fdaafbb6700 1 --2- 172.21.15.40:0/282927878 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdaa809d920 0x7fdaa809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.392+0000 7fdaafbb6700 1 --2- 172.21.15.40:0/282927878 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdaa809f0f0 0x7fdaa809e230 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.392+0000 7fdaafbb6700 1 -- 172.21.15.40:0/282927878 >> 172.21.15.40:0/282927878 conn(0x7fdaa809fb20 msgr2=0x7fdaa809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:17.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.392+0000 7fdaafbb6700 1 -- 172.21.15.40:0/282927878 shutdown_connections 2023-09-30T22:30:17.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.392+0000 7fdaafbb6700 1 -- 172.21.15.40:0/282927878 wait complete. 2023-09-30T22:30:17.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.393+0000 7fdaafbb6700 1 Processor -- start 2023-09-30T22:30:17.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.393+0000 7fdaafbb6700 1 -- start start 2023-09-30T22:30:17.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.393+0000 7fdaafbb6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdaa809d920 0x7fdaa811e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:17.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.393+0000 7fdaafbb6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaa8133ca0 0x7fdaa811e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:17.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.393+0000 7fdaafbb6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdaa81223d0 0x7fdaa811ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:17.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.393+0000 7fdaafbb6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa811ffc0 con 0x7fdaa8133ca0 2023-09-30T22:30:17.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.393+0000 7fdaafbb6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa8121210 con 0x7fdaa81223d0 2023-09-30T22:30:17.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.393+0000 7fdaafbb6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa81205a0 con 0x7fdaa809d920 2023-09-30T22:30:17.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.393+0000 7fdaad952700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdaa809d920 0x7fdaa811e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:17.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.393+0000 7fdaad151700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaa8133ca0 0x7fdaa811e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:17.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.393+0000 7fdaae153700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdaa81223d0 0x7fdaa811ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:17.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.393+0000 7fdaad151700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaa8133ca0 0x7fdaa811e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46436/0 (socket says 172.21.15.40:46436) 2023-09-30T22:30:17.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.393+0000 7fdaad952700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdaa809d920 0x7fdaa811e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:47684/0 (socket says 172.21.15.40:47684) 2023-09-30T22:30:17.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.394+0000 7fdaad151700 1 -- 172.21.15.40:0/4038375475 learned_addr learned my addr 172.21.15.40:0/4038375475 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:17.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.394+0000 7fdaad952700 1 -- 172.21.15.40:0/4038375475 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdaa81223d0 msgr2=0x7fdaa811ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:17.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.394+0000 7fdaad952700 1 --2- 172.21.15.40:0/4038375475 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdaa81223d0 0x7fdaa811ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.394+0000 7fdaad952700 1 -- 172.21.15.40:0/4038375475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaa8133ca0 msgr2=0x7fdaa811e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:17.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.394+0000 7fdaad952700 1 --2- 172.21.15.40:0/4038375475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaa8133ca0 0x7fdaa811e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.394+0000 7fdaad952700 1 -- 172.21.15.40:0/4038375475 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa4009430 con 0x7fdaa809d920 2023-09-30T22:30:17.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.394+0000 7fdaae153700 1 --2- 172.21.15.40:0/4038375475 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdaa81223d0 0x7fdaa811ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:17.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.394+0000 7fdaad952700 1 --2- 172.21.15.40:0/4038375475 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdaa809d920 0x7fdaa811e3b0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fdaa400e8e0 tx=0x7fdaa400ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:17.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.394+0000 7fda9e7fc700 1 -- 172.21.15.40:0/4038375475 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4005a20 con 0x7fdaa809d920 2023-09-30T22:30:17.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.394+0000 7fda9e7fc700 1 -- 172.21.15.40:0/4038375475 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa4005b80 con 0x7fdaa809d920 2023-09-30T22:30:17.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.394+0000 7fdaafbb6700 1 -- 172.21.15.40:0/4038375475 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda980094a0 con 0x7fdaa809d920 2023-09-30T22:30:17.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.394+0000 7fda9e7fc700 1 -- 172.21.15.40:0/4038375475 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4013680 con 0x7fdaa809d920 2023-09-30T22:30:17.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.394+0000 7fdaafbb6700 1 -- 172.21.15.40:0/4038375475 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa8121660 con 0x7fdaa809d920 2023-09-30T22:30:17.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.395+0000 7fda9e7fc700 1 -- 172.21.15.40:0/4038375475 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdaa40137e0 con 0x7fdaa809d920 2023-09-30T22:30:17.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.395+0000 7fda9e7fc700 1 -- 172.21.15.40:0/4038375475 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fdaa403f840 con 0x7fdaa809d920 2023-09-30T22:30:17.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.395+0000 7fdaafbb6700 1 -- 172.21.15.40:0/4038375475 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa80a2690 con 0x7fdaa809d920 2023-09-30T22:30:17.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.400+0000 7fda9e7fc700 1 -- 172.21.15.40:0/4038375475 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdaa4020020 con 0x7fdaa809d920 2023-09-30T22:30:17.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.595+0000 7fdaafbb6700 1 -- 172.21.15.40:0/4038375475 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdaa806f6f0 con 0x7fdaa809d920 2023-09-30T22:30:17.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.595+0000 7fda9e7fc700 1 -- 172.21.15.40:0/4038375475 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdaa4006030 con 0x7fdaa809d920 2023-09-30T22:30:17.596 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:17.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.597+0000 7fdaafbb6700 1 -- 172.21.15.40:0/4038375475 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdaa809d920 msgr2=0x7fdaa811e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:17.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.597+0000 7fdaafbb6700 1 --2- 172.21.15.40:0/4038375475 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdaa809d920 0x7fdaa811e3b0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fdaa400e8e0 tx=0x7fdaa400ebf0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.597+0000 7fdaafbb6700 1 -- 172.21.15.40:0/4038375475 shutdown_connections 2023-09-30T22:30:17.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.597+0000 7fdaafbb6700 1 --2- 172.21.15.40:0/4038375475 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdaa809d920 0x7fdaa811e3b0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.597+0000 7fdaafbb6700 1 --2- 172.21.15.40:0/4038375475 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdaa81223d0 0x7fdaa811ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.597+0000 7fdaafbb6700 1 --2- 172.21.15.40:0/4038375475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaa8133ca0 0x7fdaa811e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:17.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.597+0000 7fdaafbb6700 1 -- 172.21.15.40:0/4038375475 >> 172.21.15.40:0/4038375475 conn(0x7fdaa809fb20 msgr2=0x7fdaa8133260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:17.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.597+0000 7fdaafbb6700 1 -- 172.21.15.40:0/4038375475 shutdown_connections 2023-09-30T22:30:17.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:17.597+0000 7fdaafbb6700 1 -- 172.21.15.40:0/4038375475 wait complete. 2023-09-30T22:30:17.610 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:17.937 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:17.972 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:17.975 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:18.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.071+0000 7fe428b95700 1 Processor -- start 2023-09-30T22:30:18.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.071+0000 7fe428b95700 1 -- start start 2023-09-30T22:30:18.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.071+0000 7fe428b95700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe42409d920 0x7fe42409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.071+0000 7fe428b95700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe42409f0f0 0x7fe42409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.071+0000 7fe428b95700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe42409f940 con 0x7fe424133ca0 2023-09-30T22:30:18.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.071+0000 7fe428b95700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe42406b4c0 con 0x7fe42409d920 2023-09-30T22:30:18.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.071+0000 7fe428b95700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe42409a8f0 con 0x7fe42409f0f0 2023-09-30T22:30:18.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.072+0000 7fe42259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe42409d920 0x7fe42409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.072+0000 7fe422d9d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe424133ca0 0x7fe424134140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55632/0 (socket says 172.21.15.40:55632) 2023-09-30T22:30:18.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.072+0000 7fe421d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe42409f0f0 0x7fe42409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.072+0000 7fe42259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe42409d920 0x7fe42409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35448/0 (socket says 172.21.15.40:35448) 2023-09-30T22:30:18.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.072+0000 7fe422d9d700 1 -- 172.21.15.40:0/3150017188 learned_addr learned my addr 172.21.15.40:0/3150017188 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:18.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.072+0000 7fe42159a700 1 -- 172.21.15.40:0/3150017188 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3122298958 0 0) 0x7fe42409f940 con 0x7fe424133ca0 2023-09-30T22:30:18.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.072+0000 7fe42259c700 1 -- 172.21.15.40:0/3150017188 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe42409f0f0 msgr2=0x7fe42409e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:18.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.072+0000 7fe42259c700 1 --2- 172.21.15.40:0/3150017188 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe42409f0f0 0x7fe42409e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.072+0000 7fe42259c700 1 -- 172.21.15.40:0/3150017188 >> v1:172.21.15.40:6789/0 conn(0x7fe424133ca0 legacy=0x7fe424134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.072+0000 7fe42259c700 1 -- 172.21.15.40:0/3150017188 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42409f6e0 con 0x7fe42409d920 2023-09-30T22:30:18.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.072+0000 7fe42259c700 1 --2- 172.21.15.40:0/3150017188 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe42409d920 0x7fe42409dcf0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fe414009850 tx=0x7fe414009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e66883d715b0dfa0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:18.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.072+0000 7fe42159a700 1 -- 172.21.15.40:0/3150017188 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe414005e30 con 0x7fe42409d920 2023-09-30T22:30:18.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.072+0000 7fe42159a700 1 -- 172.21.15.40:0/3150017188 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe414006030 con 0x7fe42409d920 2023-09-30T22:30:18.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.072+0000 7fe42159a700 1 -- 172.21.15.40:0/3150017188 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4140063e0 con 0x7fe42409d920 2023-09-30T22:30:18.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.073+0000 7fe428b95700 1 -- 172.21.15.40:0/3150017188 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe42409d920 msgr2=0x7fe42409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.073+0000 7fe428b95700 1 --2- 172.21.15.40:0/3150017188 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe42409d920 0x7fe42409dcf0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fe414009850 tx=0x7fe414009b60 comp rx=0 tx=0).stop 2023-09-30T22:30:18.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.073+0000 7fe428b95700 1 -- 172.21.15.40:0/3150017188 shutdown_connections 2023-09-30T22:30:18.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.073+0000 7fe428b95700 1 --2- 172.21.15.40:0/3150017188 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe42409d920 0x7fe42409dcf0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.073+0000 7fe428b95700 1 --2- 172.21.15.40:0/3150017188 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe42409f0f0 0x7fe42409e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.073+0000 7fe428b95700 1 -- 172.21.15.40:0/3150017188 >> 172.21.15.40:0/3150017188 conn(0x7fe42409fb20 msgr2=0x7fe42409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:18.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.074+0000 7fe428b95700 1 -- 172.21.15.40:0/3150017188 shutdown_connections 2023-09-30T22:30:18.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.074+0000 7fe428b95700 1 -- 172.21.15.40:0/3150017188 wait complete. 2023-09-30T22:30:18.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.075+0000 7fe428b95700 1 Processor -- start 2023-09-30T22:30:18.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.075+0000 7fe428b95700 1 -- start start 2023-09-30T22:30:18.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.076+0000 7fe428b95700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe42409d920 0x7fe42411e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.076+0000 7fe428b95700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe424133ca0 0x7fe42411ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.076+0000 7fe428b95700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe42411f370 0x7fe4241cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.076+0000 7fe428b95700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe424122370 con 0x7fe42409d920 2023-09-30T22:30:18.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.076+0000 7fe428b95700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe424121ba0 con 0x7fe424133ca0 2023-09-30T22:30:18.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.076+0000 7fe428b95700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe42409c9e0 con 0x7fe42411f370 2023-09-30T22:30:18.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.076+0000 7fe421d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe424133ca0 0x7fe42411ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.076+0000 7fe421d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe424133ca0 0x7fe42411ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35464/0 (socket says 172.21.15.40:35464) 2023-09-30T22:30:18.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.076+0000 7fe421d9b700 1 -- 172.21.15.40:0/1460628278 learned_addr learned my addr 172.21.15.40:0/1460628278 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:18.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.076+0000 7fe422d9d700 1 --2- 172.21.15.40:0/1460628278 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe42411f370 0x7fe4241cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.076+0000 7fe42259c700 1 --2- 172.21.15.40:0/1460628278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe42409d920 0x7fe42411e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.076+0000 7fe421d9b700 1 -- 172.21.15.40:0/1460628278 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe42411f370 msgr2=0x7fe4241cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.076+0000 7fe421d9b700 1 --2- 172.21.15.40:0/1460628278 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe42411f370 0x7fe4241cebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.076+0000 7fe421d9b700 1 -- 172.21.15.40:0/1460628278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe42409d920 msgr2=0x7fe42411e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.076+0000 7fe421d9b700 1 --2- 172.21.15.40:0/1460628278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe42409d920 0x7fe42411e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.076+0000 7fe421d9b700 1 -- 172.21.15.40:0/1460628278 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe414009430 con 0x7fe424133ca0 2023-09-30T22:30:18.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.076+0000 7fe422d9d700 1 --2- 172.21.15.40:0/1460628278 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe42411f370 0x7fe4241cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:18.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.076+0000 7fe42259c700 1 --2- 172.21.15.40:0/1460628278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe42409d920 0x7fe42411e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:18.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.077+0000 7fe421d9b700 1 --2- 172.21.15.40:0/1460628278 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe424133ca0 0x7fe42411ee30 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe41800e9b0 tx=0x7fe41800ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:18.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.077+0000 7fe412ffd700 1 -- 172.21.15.40:0/1460628278 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41800ee50 con 0x7fe424133ca0 2023-09-30T22:30:18.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.077+0000 7fe412ffd700 1 -- 172.21.15.40:0/1460628278 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41800c7f0 con 0x7fe424133ca0 2023-09-30T22:30:18.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.077+0000 7fe412ffd700 1 -- 172.21.15.40:0/1460628278 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41800cb60 con 0x7fe424133ca0 2023-09-30T22:30:18.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.077+0000 7fe428b95700 1 -- 172.21.15.40:0/1460628278 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4240a24d0 con 0x7fe424133ca0 2023-09-30T22:30:18.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.077+0000 7fe428b95700 1 -- 172.21.15.40:0/1460628278 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4241204c0 con 0x7fe424133ca0 2023-09-30T22:30:18.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.079+0000 7fe428b95700 1 -- 172.21.15.40:0/1460628278 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe424121ef0 con 0x7fe424133ca0 2023-09-30T22:30:18.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.079+0000 7fe412ffd700 1 -- 172.21.15.40:0/1460628278 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe41800ccc0 con 0x7fe424133ca0 2023-09-30T22:30:18.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.079+0000 7fe412ffd700 1 -- 172.21.15.40:0/1460628278 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe41803f8b0 con 0x7fe424133ca0 2023-09-30T22:30:18.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.084+0000 7fe412ffd700 1 -- 172.21.15.40:0/1460628278 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe424121ef0 con 0x7fe424133ca0 2023-09-30T22:30:18.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.113+0000 7fe652b94700 1 Processor -- start 2023-09-30T22:30:18.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.113+0000 7fe652b94700 1 -- start start 2023-09-30T22:30:18.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.114+0000 7fe652b94700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe64c09fbb0 0x7fe64c06c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.114+0000 7fe652b94700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe64c06ced0 0x7fe64c06d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.114+0000 7fe652b94700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe64c06e3f0 con 0x7fe64c138370 2023-09-30T22:30:18.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.114+0000 7fe652b94700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c09ff80 con 0x7fe64c06ced0 2023-09-30T22:30:18.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.114+0000 7fe652b94700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c06ec40 con 0x7fe64c09fbb0 2023-09-30T22:30:18.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.114+0000 7fe650930700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe64c09fbb0 0x7fe64c06c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.114+0000 7fe650930700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe64c09fbb0 0x7fe64c06c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:47714/0 (socket says 172.21.15.40:47714) 2023-09-30T22:30:18.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.114+0000 7fe650930700 1 -- 172.21.15.40:0/152193404 learned_addr learned my addr 172.21.15.40:0/152193404 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:18.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.114+0000 7fe64bfff700 1 --2- 172.21.15.40:0/152193404 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe64c06ced0 0x7fe64c06d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.114+0000 7fe650930700 1 -- 172.21.15.40:0/152193404 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe64c06ced0 msgr2=0x7fe64c06d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:18.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.114+0000 7fe650930700 1 --2- 172.21.15.40:0/152193404 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe64c06ced0 0x7fe64c06d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.114+0000 7fe650930700 1 -- 172.21.15.40:0/152193404 >> v1:172.21.15.40:6789/0 conn(0x7fe64c138370 legacy=0x7fe64c13a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.114+0000 7fe650930700 1 -- 172.21.15.40:0/152193404 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64c097ed0 con 0x7fe64c09fbb0 2023-09-30T22:30:18.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.115+0000 7fe650930700 1 --2- 172.21.15.40:0/152193404 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe64c09fbb0 0x7fe64c06c990 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fe63c009950 tx=0x7fe63c009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=525ec45fcde33ed7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:18.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.115+0000 7fe64b7fe700 1 -- 172.21.15.40:0/152193404 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c011830 con 0x7fe64c09fbb0 2023-09-30T22:30:18.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.115+0000 7fe64b7fe700 1 -- 172.21.15.40:0/152193404 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63c011990 con 0x7fe64c09fbb0 2023-09-30T22:30:18.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.115+0000 7fe64b7fe700 1 -- 172.21.15.40:0/152193404 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c011d40 con 0x7fe64c09fbb0 2023-09-30T22:30:18.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.115+0000 7fe652b94700 1 -- 172.21.15.40:0/152193404 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe64c09fbb0 msgr2=0x7fe64c06c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.115+0000 7fe652b94700 1 --2- 172.21.15.40:0/152193404 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe64c09fbb0 0x7fe64c06c990 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fe63c009950 tx=0x7fe63c009c60 comp rx=0 tx=0).stop 2023-09-30T22:30:18.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.115+0000 7fe652b94700 1 -- 172.21.15.40:0/152193404 shutdown_connections 2023-09-30T22:30:18.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.115+0000 7fe652b94700 1 --2- 172.21.15.40:0/152193404 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe64c09fbb0 0x7fe64c06c990 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.115+0000 7fe652b94700 1 --2- 172.21.15.40:0/152193404 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe64c06ced0 0x7fe64c06d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.115+0000 7fe652b94700 1 -- 172.21.15.40:0/152193404 >> 172.21.15.40:0/152193404 conn(0x7fe64c0a41a0 msgr2=0x7fe64c0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:18.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.116+0000 7fe652b94700 1 -- 172.21.15.40:0/152193404 shutdown_connections 2023-09-30T22:30:18.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.116+0000 7fe652b94700 1 -- 172.21.15.40:0/152193404 wait complete. 2023-09-30T22:30:18.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.116+0000 7fe652b94700 1 Processor -- start 2023-09-30T22:30:18.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.116+0000 7fe652b94700 1 -- start start 2023-09-30T22:30:18.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.117+0000 7fe652b94700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe64c06ced0 0x7fe64c1377c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.117+0000 7fe652b94700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe64c09fbb0 0x7fe64c137d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.117+0000 7fe652b94700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe64c138370 0x7fe64c095b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.117+0000 7fe652b94700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c0929b0 con 0x7fe64c06ced0 2023-09-30T22:30:18.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.117+0000 7fe652b94700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c0972f0 con 0x7fe64c09fbb0 2023-09-30T22:30:18.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.117+0000 7fe652b94700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c09f4a0 con 0x7fe64c138370 2023-09-30T22:30:18.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.117+0000 7fe64bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe64c09fbb0 0x7fe64c137d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.117+0000 7fe650930700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe64c06ced0 0x7fe64c1377c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.117+0000 7fe64bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe64c09fbb0 0x7fe64c137d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35470/0 (socket says 172.21.15.40:35470) 2023-09-30T22:30:18.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.117+0000 7fe64bfff700 1 -- 172.21.15.40:0/2305885944 learned_addr learned my addr 172.21.15.40:0/2305885944 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:18.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.117+0000 7fe651131700 1 --2- 172.21.15.40:0/2305885944 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe64c138370 0x7fe64c095b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.117+0000 7fe64bfff700 1 -- 172.21.15.40:0/2305885944 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe64c138370 msgr2=0x7fe64c095b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.117+0000 7fe64bfff700 1 --2- 172.21.15.40:0/2305885944 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe64c138370 0x7fe64c095b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.117+0000 7fe64bfff700 1 -- 172.21.15.40:0/2305885944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe64c06ced0 msgr2=0x7fe64c1377c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.117+0000 7fe64bfff700 1 --2- 172.21.15.40:0/2305885944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe64c06ced0 0x7fe64c1377c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.118+0000 7fe64bfff700 1 -- 172.21.15.40:0/2305885944 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63c009550 con 0x7fe64c09fbb0 2023-09-30T22:30:18.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.118+0000 7fe650930700 1 --2- 172.21.15.40:0/2305885944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe64c06ced0 0x7fe64c1377c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:18.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.118+0000 7fe64bfff700 1 --2- 172.21.15.40:0/2305885944 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe64c09fbb0 0x7fe64c137d00 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fe64000e980 tx=0x7fe64000ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:18.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.118+0000 7fe6497fa700 1 -- 172.21.15.40:0/2305885944 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe640009710 con 0x7fe64c09fbb0 2023-09-30T22:30:18.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.118+0000 7fe6497fa700 1 -- 172.21.15.40:0/2305885944 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe64000eed0 con 0x7fe64c09fbb0 2023-09-30T22:30:18.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.118+0000 7fe652b94700 1 -- 172.21.15.40:0/2305885944 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe64c096ce0 con 0x7fe64c09fbb0 2023-09-30T22:30:18.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.118+0000 7fe6497fa700 1 -- 172.21.15.40:0/2305885944 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64000ca70 con 0x7fe64c09fbb0 2023-09-30T22:30:18.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.118+0000 7fe652b94700 1 -- 172.21.15.40:0/2305885944 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe64c071db0 con 0x7fe64c09fbb0 2023-09-30T22:30:18.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.119+0000 7fe6497fa700 1 -- 172.21.15.40:0/2305885944 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe64000cbd0 con 0x7fe64c09fbb0 2023-09-30T22:30:18.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.119+0000 7fe6497fa700 1 -- 172.21.15.40:0/2305885944 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe64003f770 con 0x7fe64c09fbb0 2023-09-30T22:30:18.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.119+0000 7fe652b94700 1 -- 172.21.15.40:0/2305885944 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe64c062380 con 0x7fe64c09fbb0 2023-09-30T22:30:18.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.124+0000 7fe6497fa700 1 -- 172.21.15.40:0/2305885944 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe6400232f0 con 0x7fe64c09fbb0 2023-09-30T22:30:18.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.127+0000 7fbd49a12700 1 Processor -- start 2023-09-30T22:30:18.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.127+0000 7fbd49a12700 1 -- start start 2023-09-30T22:30:18.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.127+0000 7fbd49a12700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbd4409d920 0x7fbd4409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.127+0000 7fbd49a12700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbd44130fb0 0x7fbd44138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.127+0000 7fbd49a12700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd4409adf0 con 0x7fbd4409e230 2023-09-30T22:30:18.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.127+0000 7fbd49a12700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd4409edf0 con 0x7fbd4409d920 2023-09-30T22:30:18.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.127+0000 7fbd49a12700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4409b660 con 0x7fbd44130fb0 2023-09-30T22:30:18.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.127+0000 7fbd437fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbd44130fb0 0x7fbd44138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.127+0000 7fbd437fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbd44130fb0 0x7fbd44138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:47738/0 (socket says 172.21.15.40:47738) 2023-09-30T22:30:18.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.127+0000 7fbd42ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbd4409d920 0x7fbd4409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.127+0000 7fbd437fe700 1 -- 172.21.15.40:0/4077604734 learned_addr learned my addr 172.21.15.40:0/4077604734 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:18.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.128+0000 7fbd437fe700 1 -- 172.21.15.40:0/4077604734 >> v2:172.21.15.40:3300/0 conn(0x7fbd4409d920 msgr2=0x7fbd4409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:18.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.128+0000 7fbd437fe700 1 --2- 172.21.15.40:0/4077604734 >> v2:172.21.15.40:3300/0 conn(0x7fbd4409d920 0x7fbd4409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.128+0000 7fbd437fe700 1 -- 172.21.15.40:0/4077604734 >> v1:172.21.15.40:6789/0 conn(0x7fbd4409e230 legacy=0x7fbd441308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.128+0000 7fbd437fe700 1 -- 172.21.15.40:0/4077604734 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4409a6e0 con 0x7fbd44130fb0 2023-09-30T22:30:18.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.128+0000 7fbd42ffd700 1 --2- 172.21.15.40:0/4077604734 >> v2:172.21.15.40:3300/0 conn(0x7fbd4409d920 0x7fbd4409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:18.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.128+0000 7fbd437fe700 1 --2- 172.21.15.40:0/4077604734 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbd44130fb0 0x7fbd44138d10 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c00bef0 tx=0x7fbd3c0093b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99022464d3409cb0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:18.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.128+0000 7fbd41ffb700 1 -- 172.21.15.40:0/4077604734 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c00b4e0 con 0x7fbd44130fb0 2023-09-30T22:30:18.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.128+0000 7fbd41ffb700 1 -- 172.21.15.40:0/4077604734 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3c00c950 con 0x7fbd44130fb0 2023-09-30T22:30:18.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.128+0000 7fbd41ffb700 1 -- 172.21.15.40:0/4077604734 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c00cd00 con 0x7fbd44130fb0 2023-09-30T22:30:18.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.129+0000 7fbd49a12700 1 -- 172.21.15.40:0/4077604734 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbd44130fb0 msgr2=0x7fbd44138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.129+0000 7fbd49a12700 1 --2- 172.21.15.40:0/4077604734 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbd44130fb0 0x7fbd44138d10 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c00bef0 tx=0x7fbd3c0093b0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.129+0000 7fbd49a12700 1 -- 172.21.15.40:0/4077604734 shutdown_connections 2023-09-30T22:30:18.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.129+0000 7fbd49a12700 1 --2- 172.21.15.40:0/4077604734 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbd44130fb0 0x7fbd44138d10 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.129+0000 7fbd49a12700 1 --2- 172.21.15.40:0/4077604734 >> v2:172.21.15.40:3300/0 conn(0x7fbd4409d920 0x7fbd4409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.129+0000 7fbd49a12700 1 -- 172.21.15.40:0/4077604734 >> 172.21.15.40:0/4077604734 conn(0x7fbd4409fb20 msgr2=0x7fbd4409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:18.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.129+0000 7fbd49a12700 1 -- 172.21.15.40:0/4077604734 shutdown_connections 2023-09-30T22:30:18.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.129+0000 7fbd49a12700 1 -- 172.21.15.40:0/4077604734 wait complete. 2023-09-30T22:30:18.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.130+0000 7fbd49a12700 1 Processor -- start 2023-09-30T22:30:18.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.130+0000 7fbd49a12700 1 -- start start 2023-09-30T22:30:18.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.131+0000 7fbd49a12700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd4409d920 0x7fbd4411d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.131+0000 7fbd49a12700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbd4409e230 0x7fbd4411d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.131+0000 7fbd49a12700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd44130fb0 0x7fbd4411dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.131+0000 7fbd49a12700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd44120d20 con 0x7fbd4409d920 2023-09-30T22:30:18.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.131+0000 7fbd49a12700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4411f430 con 0x7fbd44130fb0 2023-09-30T22:30:18.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.131+0000 7fbd49a12700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd441200f0 con 0x7fbd4409e230 2023-09-30T22:30:18.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.131+0000 7fbd427fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbd4409e230 0x7fbd4411d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.131+0000 7fbd42ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd4409d920 0x7fbd4411d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.131+0000 7fbd427fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbd4409e230 0x7fbd4411d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:47748/0 (socket says 172.21.15.40:47748) 2023-09-30T22:30:18.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.131+0000 7fbd427fc700 1 -- 172.21.15.40:0/3807961348 learned_addr learned my addr 172.21.15.40:0/3807961348 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:18.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.131+0000 7fbd42ffd700 1 -- 172.21.15.40:0/3807961348 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbd4409e230 msgr2=0x7fbd4411d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.131+0000 7fbd42ffd700 1 --2- 172.21.15.40:0/3807961348 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbd4409e230 0x7fbd4411d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.131+0000 7fbd42ffd700 1 -- 172.21.15.40:0/3807961348 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd44130fb0 msgr2=0x7fbd4411dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.131+0000 7fbd42ffd700 1 --2- 172.21.15.40:0/3807961348 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd44130fb0 0x7fbd4411dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.131+0000 7fbd42ffd700 1 -- 172.21.15.40:0/3807961348 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd3400d8d0 con 0x7fbd4409d920 2023-09-30T22:30:18.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.131+0000 7fbd42ffd700 1 --2- 172.21.15.40:0/3807961348 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd4409d920 0x7fbd4411d200 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fbd34012fc0 tx=0x7fbd340100c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:18.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.131+0000 7fbd2bfff700 1 -- 172.21.15.40:0/3807961348 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd34005c20 con 0x7fbd4409d920 2023-09-30T22:30:18.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.132+0000 7fbd2bfff700 1 -- 172.21.15.40:0/3807961348 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd34013040 con 0x7fbd4409d920 2023-09-30T22:30:18.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.132+0000 7fbd49a12700 1 -- 172.21.15.40:0/3807961348 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd3c00bb50 con 0x7fbd4409d920 2023-09-30T22:30:18.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.132+0000 7fbd49a12700 1 -- 172.21.15.40:0/3807961348 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd4406b340 con 0x7fbd4409d920 2023-09-30T22:30:18.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.132+0000 7fbd2bfff700 1 -- 172.21.15.40:0/3807961348 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3400d2e0 con 0x7fbd4409d920 2023-09-30T22:30:18.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.132+0000 7fbd2bfff700 1 -- 172.21.15.40:0/3807961348 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbd340107f0 con 0x7fbd4409d920 2023-09-30T22:30:18.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.133+0000 7fbd2bfff700 1 -- 172.21.15.40:0/3807961348 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fbd34043ad0 con 0x7fbd4409d920 2023-09-30T22:30:18.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.133+0000 7fbd49a12700 1 -- 172.21.15.40:0/3807961348 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd240052e0 con 0x7fbd4409d920 2023-09-30T22:30:18.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.138+0000 7fbd2bfff700 1 -- 172.21.15.40:0/3807961348 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbd34020360 con 0x7fbd4409d920 2023-09-30T22:30:18.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.301+0000 7fe428b95700 1 -- 172.21.15.40:0/1460628278 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe4241204c0 con 0x7fe424133ca0 2023-09-30T22:30:18.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.302+0000 7fe412ffd700 1 -- 172.21.15.40:0/1460628278 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe4241204c0 con 0x7fe424133ca0 2023-09-30T22:30:18.303 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:18.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.304+0000 7fe428b95700 1 -- 172.21.15.40:0/1460628278 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe424133ca0 msgr2=0x7fe42411ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.304+0000 7fe428b95700 1 --2- 172.21.15.40:0/1460628278 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe424133ca0 0x7fe42411ee30 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe41800e9b0 tx=0x7fe41800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.304+0000 7fe428b95700 1 -- 172.21.15.40:0/1460628278 shutdown_connections 2023-09-30T22:30:18.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.304+0000 7fe428b95700 1 --2- 172.21.15.40:0/1460628278 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe42411f370 0x7fe4241cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.304+0000 7fe428b95700 1 --2- 172.21.15.40:0/1460628278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe42409d920 0x7fe42411e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.304+0000 7fe428b95700 1 --2- 172.21.15.40:0/1460628278 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe424133ca0 0x7fe42411ee30 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.304+0000 7fe428b95700 1 -- 172.21.15.40:0/1460628278 >> 172.21.15.40:0/1460628278 conn(0x7fe42409fb20 msgr2=0x7fe424133480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:18.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.304+0000 7fe428b95700 1 -- 172.21.15.40:0/1460628278 shutdown_connections 2023-09-30T22:30:18.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.304+0000 7fe428b95700 1 -- 172.21.15.40:0/1460628278 wait complete. 2023-09-30T22:30:18.317 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:18.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.321+0000 7fe652b94700 1 -- 172.21.15.40:0/2305885944 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe64c094d50 con 0x7fe64c09fbb0 2023-09-30T22:30:18.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.322+0000 7fe6497fa700 1 -- 172.21.15.40:0/2305885944 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe640021020 con 0x7fe64c09fbb0 2023-09-30T22:30:18.323 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:18.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.324+0000 7fe652b94700 1 -- 172.21.15.40:0/2305885944 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe64c09fbb0 msgr2=0x7fe64c137d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.324+0000 7fe652b94700 1 --2- 172.21.15.40:0/2305885944 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe64c09fbb0 0x7fe64c137d00 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fe64000e980 tx=0x7fe64000ec90 comp rx=0 tx=0).stop 2023-09-30T22:30:18.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.324+0000 7fe652b94700 1 -- 172.21.15.40:0/2305885944 shutdown_connections 2023-09-30T22:30:18.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.324+0000 7fe652b94700 1 --2- 172.21.15.40:0/2305885944 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe64c138370 0x7fe64c095b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.324+0000 7fe652b94700 1 --2- 172.21.15.40:0/2305885944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe64c06ced0 0x7fe64c1377c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.324+0000 7fe652b94700 1 --2- 172.21.15.40:0/2305885944 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe64c09fbb0 0x7fe64c137d00 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.324+0000 7fe652b94700 1 -- 172.21.15.40:0/2305885944 >> 172.21.15.40:0/2305885944 conn(0x7fe64c0a41a0 msgr2=0x7fe64c09a070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:18.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.324+0000 7fe652b94700 1 -- 172.21.15.40:0/2305885944 shutdown_connections 2023-09-30T22:30:18.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.324+0000 7fe652b94700 1 -- 172.21.15.40:0/2305885944 wait complete. 2023-09-30T22:30:18.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.334+0000 7fbd49a12700 1 -- 172.21.15.40:0/3807961348 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbd24005590 con 0x7fbd4409d920 2023-09-30T22:30:18.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.334+0000 7fbd2bfff700 1 -- 172.21.15.40:0/3807961348 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbd3402f090 con 0x7fbd4409d920 2023-09-30T22:30:18.336 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:18.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:18.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.337+0000 7fbd49a12700 1 -- 172.21.15.40:0/3807961348 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd4409d920 msgr2=0x7fbd4411d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.337+0000 7fbd49a12700 1 --2- 172.21.15.40:0/3807961348 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd4409d920 0x7fbd4411d200 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fbd34012fc0 tx=0x7fbd340100c0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.337+0000 7fbd49a12700 1 -- 172.21.15.40:0/3807961348 shutdown_connections 2023-09-30T22:30:18.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.337+0000 7fbd49a12700 1 --2- 172.21.15.40:0/3807961348 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd44130fb0 0x7fbd4411dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.337+0000 7fbd49a12700 1 --2- 172.21.15.40:0/3807961348 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd4409d920 0x7fbd4411d200 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.337+0000 7fbd49a12700 1 --2- 172.21.15.40:0/3807961348 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbd4409e230 0x7fbd4411d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.337+0000 7fbd49a12700 1 -- 172.21.15.40:0/3807961348 >> 172.21.15.40:0/3807961348 conn(0x7fbd4409fb20 msgr2=0x7fbd4412ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:18.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.337+0000 7fbd49a12700 1 -- 172.21.15.40:0/3807961348 shutdown_connections 2023-09-30T22:30:18.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.337+0000 7fbd49a12700 1 -- 172.21.15.40:0/3807961348 wait complete. 2023-09-30T22:30:18.350 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:18.612 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:18.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.742+0000 7fe9d2d91700 1 Processor -- start 2023-09-30T22:30:18.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.742+0000 7fe9d2d91700 1 -- start start 2023-09-30T22:30:18.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.743+0000 7fe9d2d91700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe9cc09c890 0x7fe9cc09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.743+0000 7fe9d2d91700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe9cc09d920 0x7fe9cc09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.743+0000 7fe9d2d91700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9cc0a2600 con 0x7fe9cc09e2b0 2023-09-30T22:30:18.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.743+0000 7fe9d2d91700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9cc0a29d0 con 0x7fe9cc09d920 2023-09-30T22:30:18.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.743+0000 7fe9d2d91700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc09fb40 con 0x7fe9cc09c890 2023-09-30T22:30:18.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.743+0000 7fe9cbfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe9cc09d920 0x7fe9cc09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.743+0000 7fe9d0b2d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe9cc09c890 0x7fe9cc09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.743+0000 7fe9cbfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe9cc09d920 0x7fe9cc09dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46492/0 (socket says 172.21.15.40:46492) 2023-09-30T22:30:18.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.743+0000 7fe9cbfff700 1 -- 172.21.15.40:0/3670015219 learned_addr learned my addr 172.21.15.40:0/3670015219 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:18.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.743+0000 7fe9d0b2d700 1 -- 172.21.15.40:0/3670015219 >> v2:172.21.15.40:3300/0 conn(0x7fe9cc09d920 msgr2=0x7fe9cc09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:18.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.743+0000 7fe9d0b2d700 1 --2- 172.21.15.40:0/3670015219 >> v2:172.21.15.40:3300/0 conn(0x7fe9cc09d920 0x7fe9cc09dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.743+0000 7fe9d0b2d700 1 -- 172.21.15.40:0/3670015219 >> v1:172.21.15.40:6789/0 conn(0x7fe9cc09e2b0 legacy=0x7fe9cc13ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.743+0000 7fe9d0b2d700 1 -- 172.21.15.40:0/3670015219 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9cc09e750 con 0x7fe9cc09c890 2023-09-30T22:30:18.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.743+0000 7fe9cbfff700 1 --2- 172.21.15.40:0/3670015219 >> v2:172.21.15.40:3300/0 conn(0x7fe9cc09d920 0x7fe9cc09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:18.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.743+0000 7fe9d0b2d700 1 --2- 172.21.15.40:0/3670015219 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe9cc09c890 0x7fe9cc09cc60 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc009820 tx=0x7fe9bc009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fc044e950d93348 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:18.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.744+0000 7fe9cb7fe700 1 -- 172.21.15.40:0/3670015219 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc005e30 con 0x7fe9cc09c890 2023-09-30T22:30:18.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.744+0000 7fe9cb7fe700 1 -- 172.21.15.40:0/3670015219 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9bc006030 con 0x7fe9cc09c890 2023-09-30T22:30:18.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.744+0000 7fe9cb7fe700 1 -- 172.21.15.40:0/3670015219 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc0063c0 con 0x7fe9cc09c890 2023-09-30T22:30:18.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.744+0000 7fe9d2d91700 1 -- 172.21.15.40:0/3670015219 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe9cc09c890 msgr2=0x7fe9cc09cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.744+0000 7fe9d2d91700 1 --2- 172.21.15.40:0/3670015219 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe9cc09c890 0x7fe9cc09cc60 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc009820 tx=0x7fe9bc009b30 comp rx=0 tx=0).stop 2023-09-30T22:30:18.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.744+0000 7fe9d2d91700 1 -- 172.21.15.40:0/3670015219 shutdown_connections 2023-09-30T22:30:18.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.744+0000 7fe9d2d91700 1 --2- 172.21.15.40:0/3670015219 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe9cc09c890 0x7fe9cc09cc60 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.744+0000 7fe9d2d91700 1 --2- 172.21.15.40:0/3670015219 >> v2:172.21.15.40:3300/0 conn(0x7fe9cc09d920 0x7fe9cc09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.744+0000 7fe9d2d91700 1 -- 172.21.15.40:0/3670015219 >> 172.21.15.40:0/3670015219 conn(0x7fe9cc0a7080 msgr2=0x7fe9cc0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:18.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.744+0000 7fe9d2d91700 1 -- 172.21.15.40:0/3670015219 shutdown_connections 2023-09-30T22:30:18.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.744+0000 7fe9d2d91700 1 -- 172.21.15.40:0/3670015219 wait complete. 2023-09-30T22:30:18.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.745+0000 7fe9d2d91700 1 Processor -- start 2023-09-30T22:30:18.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.745+0000 7fe9d2d91700 1 -- start start 2023-09-30T22:30:18.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.746+0000 7fe9d2d91700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe9cc09c890 0x7fe9cc1c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.746+0000 7fe9d2d91700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9cc09d920 0x7fe9cc1c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.746+0000 7fe9d2d91700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9cc09e2b0 0x7fe9cc1c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:18.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.746+0000 7fe9d2d91700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc130070 con 0x7fe9cc09e2b0 2023-09-30T22:30:18.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.746+0000 7fe9d2d91700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc09c230 con 0x7fe9cc09d920 2023-09-30T22:30:18.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.746+0000 7fe9d2d91700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc09ecf0 con 0x7fe9cc09c890 2023-09-30T22:30:18.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.746+0000 7fe9d0b2d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe9cc09c890 0x7fe9cc1c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.746+0000 7fe9d0b2d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe9cc09c890 0x7fe9cc1c89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:47770/0 (socket says 172.21.15.40:47770) 2023-09-30T22:30:18.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.746+0000 7fe9d0b2d700 1 -- 172.21.15.40:0/4275101229 learned_addr learned my addr 172.21.15.40:0/4275101229 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:18.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.746+0000 7fe9d132e700 1 --2- 172.21.15.40:0/4275101229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9cc09e2b0 0x7fe9cc1c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.746+0000 7fe9cbfff700 1 --2- 172.21.15.40:0/4275101229 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9cc09d920 0x7fe9cc1c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:18.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.746+0000 7fe9d0b2d700 1 -- 172.21.15.40:0/4275101229 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9cc09d920 msgr2=0x7fe9cc1c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.746+0000 7fe9d0b2d700 1 --2- 172.21.15.40:0/4275101229 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9cc09d920 0x7fe9cc1c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.746+0000 7fe9d0b2d700 1 -- 172.21.15.40:0/4275101229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9cc09e2b0 msgr2=0x7fe9cc1c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.746+0000 7fe9d0b2d700 1 --2- 172.21.15.40:0/4275101229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9cc09e2b0 0x7fe9cc1c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.746+0000 7fe9d0b2d700 1 -- 172.21.15.40:0/4275101229 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b4009550 con 0x7fe9cc09c890 2023-09-30T22:30:18.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.746+0000 7fe9cbfff700 1 --2- 172.21.15.40:0/4275101229 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9cc09d920 0x7fe9cc1c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:18.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.746+0000 7fe9d0b2d700 1 --2- 172.21.15.40:0/4275101229 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe9cc09c890 0x7fe9cc1c89e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc09fc80 tx=0x7fe9bc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:18.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.746+0000 7fe9c97fa700 1 -- 172.21.15.40:0/4275101229 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc004040 con 0x7fe9cc09c890 2023-09-30T22:30:18.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.746+0000 7fe9c97fa700 1 -- 172.21.15.40:0/4275101229 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9bc0041a0 con 0x7fe9cc09c890 2023-09-30T22:30:18.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.746+0000 7fe9d2d91700 1 -- 172.21.15.40:0/4275101229 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9bc009430 con 0x7fe9cc09c890 2023-09-30T22:30:18.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.747+0000 7fe9c97fa700 1 -- 172.21.15.40:0/4275101229 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc004510 con 0x7fe9cc09c890 2023-09-30T22:30:18.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.747+0000 7fe9d2d91700 1 -- 172.21.15.40:0/4275101229 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9cc130970 con 0x7fe9cc09c890 2023-09-30T22:30:18.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.747+0000 7fe9c97fa700 1 -- 172.21.15.40:0/4275101229 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe9bc022070 con 0x7fe9cc09c890 2023-09-30T22:30:18.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.748+0000 7fe9c97fa700 1 -- 172.21.15.40:0/4275101229 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe9bc040cd0 con 0x7fe9cc09c890 2023-09-30T22:30:18.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.748+0000 7fe9d2d91700 1 -- 172.21.15.40:0/4275101229 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9cc062380 con 0x7fe9cc09c890 2023-09-30T22:30:18.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.753+0000 7fe9c97fa700 1 -- 172.21.15.40:0/4275101229 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe9bc01a980 con 0x7fe9cc09c890 2023-09-30T22:30:18.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.950+0000 7fe9d2d91700 1 -- 172.21.15.40:0/4275101229 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe9cc074620 con 0x7fe9cc09c890 2023-09-30T22:30:18.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.950+0000 7fe9c97fa700 1 -- 172.21.15.40:0/4275101229 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe9bc01a390 con 0x7fe9cc09c890 2023-09-30T22:30:18.951 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:18.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.952+0000 7fe9d2d91700 1 -- 172.21.15.40:0/4275101229 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe9cc09c890 msgr2=0x7fe9cc1c89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:18.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.952+0000 7fe9d2d91700 1 --2- 172.21.15.40:0/4275101229 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe9cc09c890 0x7fe9cc1c89e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc09fc80 tx=0x7fe9bc004750 comp rx=0 tx=0).stop 2023-09-30T22:30:18.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.952+0000 7fe9d2d91700 1 -- 172.21.15.40:0/4275101229 shutdown_connections 2023-09-30T22:30:18.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.952+0000 7fe9d2d91700 1 --2- 172.21.15.40:0/4275101229 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe9cc09c890 0x7fe9cc1c89e0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.952+0000 7fe9d2d91700 1 --2- 172.21.15.40:0/4275101229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9cc09e2b0 0x7fe9cc1c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.952+0000 7fe9d2d91700 1 --2- 172.21.15.40:0/4275101229 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9cc09d920 0x7fe9cc1c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:18.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.952+0000 7fe9d2d91700 1 -- 172.21.15.40:0/4275101229 >> 172.21.15.40:0/4275101229 conn(0x7fe9cc0a7080 msgr2=0x7fe9cc0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:18.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.953+0000 7fe9d2d91700 1 -- 172.21.15.40:0/4275101229 shutdown_connections 2023-09-30T22:30:18.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:18.953+0000 7fe9d2d91700 1 -- 172.21.15.40:0/4275101229 wait complete. 2023-09-30T22:30:18.966 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:19.319 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:19.338 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:19.351 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:19.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.452+0000 7f6e47be7700 1 Processor -- start 2023-09-30T22:30:19.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.453+0000 7f6e47be7700 1 -- start start 2023-09-30T22:30:19.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.453+0000 7f6e47be7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6e4009f0f0 0x7f6e40138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:19.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.453+0000 7f6e47be7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e4009e400 0x7f6e4013b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:19.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.453+0000 7f6e47be7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e4009f940 con 0x7f6e4009d920 2023-09-30T22:30:19.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.453+0000 7f6e47be7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4006b4c0 con 0x7f6e4009e400 2023-09-30T22:30:19.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.453+0000 7f6e47be7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4009a8f0 con 0x7f6e4009f0f0 2023-09-30T22:30:19.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.453+0000 7f6e45182700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6e4009f0f0 0x7f6e40138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:19.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.453+0000 7f6e45983700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6e4009d920 0x7f6e4009dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55664/0 (socket says 172.21.15.40:55664) 2023-09-30T22:30:19.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.453+0000 7f6e45983700 1 -- 172.21.15.40:0/2483740135 learned_addr learned my addr 172.21.15.40:0/2483740135 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:19.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.453+0000 7f6e46184700 1 --2- 172.21.15.40:0/2483740135 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e4009e400 0x7f6e4013b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:19.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.454+0000 7f6e45182700 1 -- 172.21.15.40:0/2483740135 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e4009e400 msgr2=0x7f6e4013b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:19.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.454+0000 7f6e44981700 1 -- 172.21.15.40:0/2483740135 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2930762605 0 0) 0x7f6e4009f940 con 0x7f6e4009d920 2023-09-30T22:30:19.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.454+0000 7f6e45182700 1 --2- 172.21.15.40:0/2483740135 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e4009e400 0x7f6e4013b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.454+0000 7f6e45182700 1 -- 172.21.15.40:0/2483740135 >> v1:172.21.15.40:6789/0 conn(0x7f6e4009d920 legacy=0x7f6e4009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:19.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.454+0000 7f6e45182700 1 -- 172.21.15.40:0/2483740135 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e4009f6e0 con 0x7f6e4009f0f0 2023-09-30T22:30:19.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.454+0000 7f6e46184700 1 --2- 172.21.15.40:0/2483740135 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e4009e400 0x7f6e4013b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:19.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.454+0000 7f6e45182700 1 --2- 172.21.15.40:0/2483740135 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6e4009f0f0 0x7f6e40138ee0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f6e300098a0 tx=0x7f6e30009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c49b5d32559ce09c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:19.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.454+0000 7f6e44981700 1 -- 172.21.15.40:0/2483740135 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e30011830 con 0x7f6e4009f0f0 2023-09-30T22:30:19.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.454+0000 7f6e44981700 1 -- 172.21.15.40:0/2483740135 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e30011990 con 0x7f6e4009f0f0 2023-09-30T22:30:19.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.454+0000 7f6e44981700 1 -- 172.21.15.40:0/2483740135 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e30011d20 con 0x7f6e4009f0f0 2023-09-30T22:30:19.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.455+0000 7f6e47be7700 1 -- 172.21.15.40:0/2483740135 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6e4009f0f0 msgr2=0x7f6e40138ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:19.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.455+0000 7f6e47be7700 1 --2- 172.21.15.40:0/2483740135 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6e4009f0f0 0x7f6e40138ee0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f6e300098a0 tx=0x7f6e30009bb0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.455+0000 7f6e47be7700 1 -- 172.21.15.40:0/2483740135 shutdown_connections 2023-09-30T22:30:19.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.455+0000 7f6e47be7700 1 --2- 172.21.15.40:0/2483740135 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e4009e400 0x7f6e4013b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.455+0000 7f6e47be7700 1 --2- 172.21.15.40:0/2483740135 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6e4009f0f0 0x7f6e40138ee0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.455+0000 7f6e47be7700 1 -- 172.21.15.40:0/2483740135 >> 172.21.15.40:0/2483740135 conn(0x7f6e4009fb20 msgr2=0x7f6e4009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:19.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.455+0000 7f6e47be7700 1 -- 172.21.15.40:0/2483740135 shutdown_connections 2023-09-30T22:30:19.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.455+0000 7f6e47be7700 1 -- 172.21.15.40:0/2483740135 wait complete. 2023-09-30T22:30:19.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.456+0000 7f6e47be7700 1 Processor -- start 2023-09-30T22:30:19.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.456+0000 7f6e47be7700 1 -- start start 2023-09-30T22:30:19.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.457+0000 7f6e47be7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6e4009d920 0x7f6e4011db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:19.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.457+0000 7f6e47be7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e4009e400 0x7f6e4011e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:19.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.457+0000 7f6e47be7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e4011e5c0 0x7f6e401c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:19.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.457+0000 7f6e47be7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4011f080 con 0x7f6e4011e5c0 2023-09-30T22:30:19.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.457+0000 7f6e47be7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4013b1e0 con 0x7f6e4009e400 2023-09-30T22:30:19.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.457+0000 7f6e47be7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e40120320 con 0x7f6e4009d920 2023-09-30T22:30:19.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.457+0000 7f6e45182700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e4009e400 0x7f6e4011e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:19.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.457+0000 7f6e45182700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e4009e400 0x7f6e4011e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35520/0 (socket says 172.21.15.40:35520) 2023-09-30T22:30:19.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.457+0000 7f6e45182700 1 -- 172.21.15.40:0/809463496 learned_addr learned my addr 172.21.15.40:0/809463496 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:19.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.457+0000 7f6e45983700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6e4009d920 0x7f6e4011db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:19.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.457+0000 7f6e46184700 1 --2- 172.21.15.40:0/809463496 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e4011e5c0 0x7f6e401c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:19.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.457+0000 7f6e45983700 1 -- 172.21.15.40:0/809463496 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e4009e400 msgr2=0x7f6e4011e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:19.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.457+0000 7f6e45983700 1 --2- 172.21.15.40:0/809463496 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e4009e400 0x7f6e4011e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.458+0000 7f6e45983700 1 -- 172.21.15.40:0/809463496 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e4011e5c0 msgr2=0x7f6e401c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:19.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.458+0000 7f6e45983700 1 --2- 172.21.15.40:0/809463496 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e4011e5c0 0x7f6e401c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.458+0000 7f6e45983700 1 -- 172.21.15.40:0/809463496 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e38009a70 con 0x7f6e4009d920 2023-09-30T22:30:19.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.458+0000 7f6e45182700 1 --2- 172.21.15.40:0/809463496 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e4009e400 0x7f6e4011e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:19.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.458+0000 7f6e46184700 1 --2- 172.21.15.40:0/809463496 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e4011e5c0 0x7f6e401c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:30:19.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.458+0000 7f6e45983700 1 --2- 172.21.15.40:0/809463496 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6e4009d920 0x7f6e4011db40 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c00c410 tx=0x7f6e3c00c720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:19.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.458+0000 7f6e367fc700 1 -- 172.21.15.40:0/809463496 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c0074e0 con 0x7f6e4009d920 2023-09-30T22:30:19.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.458+0000 7f6e367fc700 1 -- 172.21.15.40:0/809463496 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3c007640 con 0x7f6e4009d920 2023-09-30T22:30:19.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.458+0000 7f6e47be7700 1 -- 172.21.15.40:0/809463496 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e300094a0 con 0x7f6e4009d920 2023-09-30T22:30:19.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.458+0000 7f6e367fc700 1 -- 172.21.15.40:0/809463496 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c005a70 con 0x7f6e4009d920 2023-09-30T22:30:19.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.458+0000 7f6e47be7700 1 -- 172.21.15.40:0/809463496 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e4011f5e0 con 0x7f6e4009d920 2023-09-30T22:30:19.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.459+0000 7f6e47be7700 1 -- 172.21.15.40:0/809463496 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e4009c9e0 con 0x7f6e4009d920 2023-09-30T22:30:19.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.460+0000 7f6e367fc700 1 -- 172.21.15.40:0/809463496 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6e3c005bd0 con 0x7f6e4009d920 2023-09-30T22:30:19.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.460+0000 7f6e367fc700 1 -- 172.21.15.40:0/809463496 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6e3c03ef80 con 0x7f6e4009d920 2023-09-30T22:30:19.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.464+0000 7f6e367fc700 1 -- 172.21.15.40:0/809463496 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6e3c019b40 con 0x7f6e4009d920 2023-09-30T22:30:19.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.494+0000 7fac3e19f700 1 Processor -- start 2023-09-30T22:30:19.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.495+0000 7fac3e19f700 1 -- start start 2023-09-30T22:30:19.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.495+0000 7f1bc932f700 1 Processor -- start 2023-09-30T22:30:19.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.495+0000 7fac3e19f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac3806a6d0 0x7fac3806aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:19.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.495+0000 7fac3e19f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fac38131fc0 0x7fac38139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:19.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.495+0000 7fac3e19f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac3809eb50 con 0x7fac3806afe0 2023-09-30T22:30:19.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.495+0000 7fac3e19f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac3809dde0 con 0x7fac3806a6d0 2023-09-30T22:30:19.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.495+0000 7fac3e19f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac3809d4a0 con 0x7fac38131fc0 2023-09-30T22:30:19.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.495+0000 7fac36ffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fac3806afe0 0x7fac381318b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55678/0 (socket says 172.21.15.40:55678) 2023-09-30T22:30:19.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.495+0000 7fac37fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fac38131fc0 0x7fac38139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:19.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.495+0000 7fac36ffd700 1 -- 172.21.15.40:0/579529900 learned_addr learned my addr 172.21.15.40:0/579529900 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:19.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.495+0000 7f1bc932f700 1 -- start start 2023-09-30T22:30:19.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.495+0000 7f1bc932f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1bc409e400 0x7f1bc4135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:19.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.496+0000 7f1bc932f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1bc4136230 0x7f1bc4138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:19.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.496+0000 7f1bc932f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc409adf0 con 0x7f1bc409d920 2023-09-30T22:30:19.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.496+0000 7f1bc932f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc409e7f0 con 0x7f1bc409e400 2023-09-30T22:30:19.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.496+0000 7f1bc932f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc409edf0 con 0x7f1bc4136230 2023-09-30T22:30:19.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.496+0000 7f1bc37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1bc4136230 0x7f1bc4138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:19.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.496+0000 7f1bc37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1bc4136230 0x7f1bc4138610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:47806/0 (socket says 172.21.15.40:47806) 2023-09-30T22:30:19.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.496+0000 7f1bc27fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1bc409e400 0x7f1bc4135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:19.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.496+0000 7f1bc37fe700 1 -- 172.21.15.40:0/2367219359 learned_addr learned my addr 172.21.15.40:0/2367219359 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:19.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.496+0000 7fac37fff700 1 -- 172.21.15.40:0/579529900 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac3806a6d0 msgr2=0x7fac3806aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:19.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.496+0000 7fac37fff700 1 --2- 172.21.15.40:0/579529900 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac3806a6d0 0x7fac3806aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.496+0000 7fac37fff700 1 -- 172.21.15.40:0/579529900 >> v1:172.21.15.40:6789/0 conn(0x7fac3806afe0 legacy=0x7fac381318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:19.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.496+0000 7fac37fff700 1 -- 172.21.15.40:0/579529900 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac3809f5f0 con 0x7fac38131fc0 2023-09-30T22:30:19.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.496+0000 7f1bc27fc700 1 -- 172.21.15.40:0/2367219359 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1bc4136230 msgr2=0x7f1bc4138610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:19.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.496+0000 7f1bc27fc700 1 --2- 172.21.15.40:0/2367219359 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1bc4136230 0x7f1bc4138610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.496+0000 7f1bc27fc700 1 -- 172.21.15.40:0/2367219359 >> v1:172.21.15.40:6789/0 conn(0x7f1bc409d920 legacy=0x7f1bc409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:19.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.496+0000 7f1bc1ffb700 1 -- 172.21.15.40:0/2367219359 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1412207326 0 0) 0x7f1bc409adf0 con 0x7f1bc409d920 2023-09-30T22:30:19.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.496+0000 7f1bc27fc700 1 -- 172.21.15.40:0/2367219359 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc409b660 con 0x7f1bc409e400 2023-09-30T22:30:19.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.496+0000 7f1bc27fc700 1 --2- 172.21.15.40:0/2367219359 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1bc409e400 0x7f1bc4135cf0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80098a0 tx=0x7f1bb8009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f477045091a03daa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:19.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.496+0000 7fac37fff700 1 --2- 172.21.15.40:0/579529900 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fac38131fc0 0x7fac38139b10 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fac30009dc0 tx=0x7fac3000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c47133c236389611 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:19.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.496+0000 7f1bc1ffb700 1 -- 172.21.15.40:0/2367219359 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb800f8a0 con 0x7f1bc409e400 2023-09-30T22:30:19.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.496+0000 7f1bc1ffb700 1 -- 172.21.15.40:0/2367219359 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb800fa00 con 0x7f1bc409e400 2023-09-30T22:30:19.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.496+0000 7f1bc1ffb700 1 -- 172.21.15.40:0/2367219359 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb800fd90 con 0x7f1bc409e400 2023-09-30T22:30:19.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.497+0000 7fac367fc700 1 -- 172.21.15.40:0/579529900 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3000e070 con 0x7fac38131fc0 2023-09-30T22:30:19.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.497+0000 7fac367fc700 1 -- 172.21.15.40:0/579529900 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac3000bbd0 con 0x7fac38131fc0 2023-09-30T22:30:19.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.497+0000 7fac367fc700 1 -- 172.21.15.40:0/579529900 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac30012430 con 0x7fac38131fc0 2023-09-30T22:30:19.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.497+0000 7f1bc932f700 1 -- 172.21.15.40:0/2367219359 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1bc409e400 msgr2=0x7f1bc4135cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:19.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.497+0000 7f1bc932f700 1 --2- 172.21.15.40:0/2367219359 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1bc409e400 0x7f1bc4135cf0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80098a0 tx=0x7f1bb8009bb0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.497+0000 7f1bc932f700 1 -- 172.21.15.40:0/2367219359 shutdown_connections 2023-09-30T22:30:19.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.497+0000 7f1bc932f700 1 --2- 172.21.15.40:0/2367219359 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1bc4136230 0x7f1bc4138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.497+0000 7f1bc932f700 1 --2- 172.21.15.40:0/2367219359 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1bc409e400 0x7f1bc4135cf0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.497+0000 7f1bc932f700 1 -- 172.21.15.40:0/2367219359 >> 172.21.15.40:0/2367219359 conn(0x7f1bc409fb20 msgr2=0x7f1bc409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:19.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.497+0000 7f1bc932f700 1 -- 172.21.15.40:0/2367219359 shutdown_connections 2023-09-30T22:30:19.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.497+0000 7f1bc932f700 1 -- 172.21.15.40:0/2367219359 wait complete. 2023-09-30T22:30:19.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.498+0000 7fac3e19f700 1 -- 172.21.15.40:0/579529900 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fac38131fc0 msgr2=0x7fac38139b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:19.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.498+0000 7fac3e19f700 1 --2- 172.21.15.40:0/579529900 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fac38131fc0 0x7fac38139b10 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fac30009dc0 tx=0x7fac3000b330 comp rx=0 tx=0).stop 2023-09-30T22:30:19.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.498+0000 7fac3e19f700 1 -- 172.21.15.40:0/579529900 shutdown_connections 2023-09-30T22:30:19.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.498+0000 7fac3e19f700 1 --2- 172.21.15.40:0/579529900 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fac38131fc0 0x7fac38139b10 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.498+0000 7fac3e19f700 1 --2- 172.21.15.40:0/579529900 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac3806a6d0 0x7fac3806aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.498+0000 7fac3e19f700 1 -- 172.21.15.40:0/579529900 >> 172.21.15.40:0/579529900 conn(0x7fac3809fb20 msgr2=0x7fac3809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:19.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.498+0000 7fac3e19f700 1 -- 172.21.15.40:0/579529900 shutdown_connections 2023-09-30T22:30:19.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.498+0000 7fac3e19f700 1 -- 172.21.15.40:0/579529900 wait complete. 2023-09-30T22:30:19.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.499+0000 7f1bc932f700 1 Processor -- start 2023-09-30T22:30:19.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.499+0000 7f1bc932f700 1 -- start start 2023-09-30T22:30:19.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.499+0000 7f1bc932f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1bc409d920 0x7f1bc4122950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:19.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.499+0000 7f1bc932f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bc409e400 0x7f1bc4122e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:19.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.500+0000 7f1bc932f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1bc4136230 0x7f1bc41233d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:19.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.500+0000 7f1bc932f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc4125fb0 con 0x7f1bc409e400 2023-09-30T22:30:19.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.500+0000 7f1bc932f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc4126190 con 0x7f1bc409d920 2023-09-30T22:30:19.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.500+0000 7f1bc932f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc4124670 con 0x7f1bc4136230 2023-09-30T22:30:19.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.500+0000 7fac3e19f700 1 Processor -- start 2023-09-30T22:30:19.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.500+0000 7f1bc37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1bc4136230 0x7f1bc41233d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:19.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.500+0000 7f1bc37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1bc4136230 0x7f1bc41233d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:47820/0 (socket says 172.21.15.40:47820) 2023-09-30T22:30:19.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.500+0000 7f1bc37fe700 1 -- 172.21.15.40:0/4096243046 learned_addr learned my addr 172.21.15.40:0/4096243046 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:19.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.500+0000 7f1bc27fc700 1 --2- 172.21.15.40:0/4096243046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bc409e400 0x7f1bc4122e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:19.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.500+0000 7f1bc2ffd700 1 --2- 172.21.15.40:0/4096243046 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1bc409d920 0x7f1bc4122950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:19.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.500+0000 7f1bc37fe700 1 -- 172.21.15.40:0/4096243046 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1bc409d920 msgr2=0x7f1bc4122950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:19.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.500+0000 7f1bc37fe700 1 --2- 172.21.15.40:0/4096243046 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1bc409d920 0x7f1bc4122950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.500+0000 7f1bc37fe700 1 -- 172.21.15.40:0/4096243046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bc409e400 msgr2=0x7f1bc4122e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:19.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.500+0000 7f1bc37fe700 1 --2- 172.21.15.40:0/4096243046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bc409e400 0x7f1bc4122e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.500+0000 7f1bc37fe700 1 -- 172.21.15.40:0/4096243046 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb80094a0 con 0x7f1bc4136230 2023-09-30T22:30:19.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.500+0000 7f1bc2ffd700 1 --2- 172.21.15.40:0/4096243046 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1bc409d920 0x7f1bc4122950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:30:19.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.500+0000 7f1bc37fe700 1 --2- 172.21.15.40:0/4096243046 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1bc4136230 0x7f1bc41233d0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc009d60 tx=0x7f1bbc00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:19.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.500+0000 7f1bab7fe700 1 -- 172.21.15.40:0/4096243046 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc009bd0 con 0x7f1bc4136230 2023-09-30T22:30:19.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.501+0000 7f1bab7fe700 1 -- 172.21.15.40:0/4096243046 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bbc00f040 con 0x7f1bc4136230 2023-09-30T22:30:19.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.501+0000 7f1bab7fe700 1 -- 172.21.15.40:0/4096243046 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc003e80 con 0x7f1bc4136230 2023-09-30T22:30:19.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.501+0000 7f1bc932f700 1 -- 172.21.15.40:0/4096243046 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc4124b10 con 0x7f1bc4136230 2023-09-30T22:30:19.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.501+0000 7f1bc932f700 1 -- 172.21.15.40:0/4096243046 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc4126c00 con 0x7f1bc4136230 2023-09-30T22:30:19.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.500+0000 7fac3e19f700 1 -- start start 2023-09-30T22:30:19.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.500+0000 7fac3e19f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fac3806a6d0 0x7fac38120340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:19.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.500+0000 7fac3e19f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac3806afe0 0x7fac3811eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:19.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.501+0000 7fac3e19f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac38131fc0 0x7fac3811eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:19.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.501+0000 7fac3e19f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3811cd30 con 0x7fac3806afe0 2023-09-30T22:30:19.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.501+0000 7fac3e19f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac3809c040 con 0x7fac38131fc0 2023-09-30T22:30:19.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.501+0000 7fac3e19f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac38071560 con 0x7fac3806a6d0 2023-09-30T22:30:19.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.501+0000 7fac37fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac38131fc0 0x7fac3811eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:19.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.501+0000 7fac36ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac3806afe0 0x7fac3811eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:19.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.501+0000 7fac37fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac38131fc0 0x7fac3811eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35560/0 (socket says 172.21.15.40:35560) 2023-09-30T22:30:19.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.501+0000 7fac37fff700 1 -- 172.21.15.40:0/2170477810 learned_addr learned my addr 172.21.15.40:0/2170477810 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:19.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.501+0000 7fac36ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac3806afe0 0x7fac3811eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46540/0 (socket says 172.21.15.40:46540) 2023-09-30T22:30:19.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.501+0000 7fac377fe700 1 --2- 172.21.15.40:0/2170477810 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fac3806a6d0 0x7fac38120340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:19.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.501+0000 7fac37fff700 1 -- 172.21.15.40:0/2170477810 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fac3806a6d0 msgr2=0x7fac38120340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:19.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.501+0000 7fac37fff700 1 --2- 172.21.15.40:0/2170477810 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fac3806a6d0 0x7fac38120340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.501+0000 7fac37fff700 1 -- 172.21.15.40:0/2170477810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac3806afe0 msgr2=0x7fac3811eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:19.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.501+0000 7fac37fff700 1 --2- 172.21.15.40:0/2170477810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac3806afe0 0x7fac3811eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.501+0000 7fac37fff700 1 -- 172.21.15.40:0/2170477810 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac30009a70 con 0x7fac38131fc0 2023-09-30T22:30:19.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.501+0000 7fac37fff700 1 --2- 172.21.15.40:0/2170477810 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac38131fc0 0x7fac3811eff0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fac30014040 tx=0x7fac30004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:19.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.501+0000 7fac1ffff700 1 -- 172.21.15.40:0/2170477810 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac300048b0 con 0x7fac38131fc0 2023-09-30T22:30:19.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.501+0000 7fac1ffff700 1 -- 172.21.15.40:0/2170477810 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac30020070 con 0x7fac38131fc0 2023-09-30T22:30:19.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.501+0000 7fac3e19f700 1 -- 172.21.15.40:0/2170477810 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac3811d930 con 0x7fac38131fc0 2023-09-30T22:30:19.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.502+0000 7fac1ffff700 1 -- 172.21.15.40:0/2170477810 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac300276c0 con 0x7fac38131fc0 2023-09-30T22:30:19.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.502+0000 7fac3e19f700 1 -- 172.21.15.40:0/2170477810 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac38131830 con 0x7fac38131fc0 2023-09-30T22:30:19.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.502+0000 7f1bc932f700 1 -- 172.21.15.40:0/4096243046 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ba40052e0 con 0x7f1bc4136230 2023-09-30T22:30:19.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.503+0000 7fac3e19f700 1 -- 172.21.15.40:0/2170477810 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac38062380 con 0x7fac38131fc0 2023-09-30T22:30:19.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.503+0000 7f1bab7fe700 1 -- 172.21.15.40:0/4096243046 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1bbc00c930 con 0x7f1bc4136230 2023-09-30T22:30:19.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.503+0000 7f1bab7fe700 1 -- 172.21.15.40:0/4096243046 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f1bbc0407e0 con 0x7f1bc4136230 2023-09-30T22:30:19.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.506+0000 7fac1ffff700 1 -- 172.21.15.40:0/2170477810 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fac30012430 con 0x7fac38131fc0 2023-09-30T22:30:19.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.506+0000 7fac1ffff700 1 -- 172.21.15.40:0/2170477810 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fac30022070 con 0x7fac38131fc0 2023-09-30T22:30:19.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.508+0000 7f1bab7fe700 1 -- 172.21.15.40:0/4096243046 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1bbc026d60 con 0x7f1bc4136230 2023-09-30T22:30:19.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.511+0000 7fac1ffff700 1 -- 172.21.15.40:0/2170477810 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fac30046060 con 0x7fac38131fc0 2023-09-30T22:30:19.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.670+0000 7f6e47be7700 1 -- 172.21.15.40:0/809463496 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6e40062380 con 0x7f6e4009d920 2023-09-30T22:30:19.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.670+0000 7f6e367fc700 1 -- 172.21.15.40:0/809463496 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6e3c017070 con 0x7f6e4009d920 2023-09-30T22:30:19.671 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:19.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.672+0000 7f6e47be7700 1 -- 172.21.15.40:0/809463496 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6e4009d920 msgr2=0x7f6e4011db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:19.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.672+0000 7f6e47be7700 1 --2- 172.21.15.40:0/809463496 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6e4009d920 0x7f6e4011db40 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c00c410 tx=0x7f6e3c00c720 comp rx=0 tx=0).stop 2023-09-30T22:30:19.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.673+0000 7f6e47be7700 1 -- 172.21.15.40:0/809463496 shutdown_connections 2023-09-30T22:30:19.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.673+0000 7f6e47be7700 1 --2- 172.21.15.40:0/809463496 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6e4009d920 0x7f6e4011db40 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.673+0000 7f6e47be7700 1 --2- 172.21.15.40:0/809463496 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e4011e5c0 0x7f6e401c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.673+0000 7f6e47be7700 1 --2- 172.21.15.40:0/809463496 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e4009e400 0x7f6e4011e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.673+0000 7f6e47be7700 1 -- 172.21.15.40:0/809463496 >> 172.21.15.40:0/809463496 conn(0x7f6e4009fb20 msgr2=0x7f6e40137150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:19.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.673+0000 7f6e47be7700 1 -- 172.21.15.40:0/809463496 shutdown_connections 2023-09-30T22:30:19.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.673+0000 7f6e47be7700 1 -- 172.21.15.40:0/809463496 wait complete. 2023-09-30T22:30:19.686 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:19.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.741+0000 7f1bc932f700 1 -- 172.21.15.40:0/4096243046 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1ba4005860 con 0x7f1bc4136230 2023-09-30T22:30:19.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.742+0000 7f1bab7fe700 1 -- 172.21.15.40:0/4096243046 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1bbc026b80 con 0x7f1bc4136230 2023-09-30T22:30:19.743 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:19.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.745+0000 7f1bc932f700 1 -- 172.21.15.40:0/4096243046 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1bc4136230 msgr2=0x7f1bc41233d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:19.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.745+0000 7f1bc932f700 1 --2- 172.21.15.40:0/4096243046 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1bc4136230 0x7f1bc41233d0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc009d60 tx=0x7f1bbc00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.745+0000 7f1bc932f700 1 -- 172.21.15.40:0/4096243046 shutdown_connections 2023-09-30T22:30:19.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.745+0000 7f1bc932f700 1 --2- 172.21.15.40:0/4096243046 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1bc4136230 0x7f1bc41233d0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.745+0000 7f1bc932f700 1 --2- 172.21.15.40:0/4096243046 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1bc409d920 0x7f1bc4122950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.745+0000 7f1bc932f700 1 --2- 172.21.15.40:0/4096243046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bc409e400 0x7f1bc4122e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.745+0000 7f1bc932f700 1 -- 172.21.15.40:0/4096243046 >> 172.21.15.40:0/4096243046 conn(0x7f1bc409fb20 msgr2=0x7f1bc40703f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:19.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.745+0000 7f1bc932f700 1 -- 172.21.15.40:0/4096243046 shutdown_connections 2023-09-30T22:30:19.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.745+0000 7f1bc932f700 1 -- 172.21.15.40:0/4096243046 wait complete. 2023-09-30T22:30:19.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.748+0000 7fac3e19f700 1 -- 172.21.15.40:0/2170477810 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fac3809db10 con 0x7fac38131fc0 2023-09-30T22:30:19.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.749+0000 7fac1ffff700 1 -- 172.21.15.40:0/2170477810 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fac30046020 con 0x7fac38131fc0 2023-09-30T22:30:19.749 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:19.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.753+0000 7fac3e19f700 1 -- 172.21.15.40:0/2170477810 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac38131fc0 msgr2=0x7fac3811eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:19.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.753+0000 7fac3e19f700 1 --2- 172.21.15.40:0/2170477810 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac38131fc0 0x7fac3811eff0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fac30014040 tx=0x7fac30004ad0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.753+0000 7fac3e19f700 1 -- 172.21.15.40:0/2170477810 shutdown_connections 2023-09-30T22:30:19.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.753+0000 7fac3e19f700 1 --2- 172.21.15.40:0/2170477810 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fac3806a6d0 0x7fac38120340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.753+0000 7fac3e19f700 1 --2- 172.21.15.40:0/2170477810 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac38131fc0 0x7fac3811eff0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.753+0000 7fac3e19f700 1 --2- 172.21.15.40:0/2170477810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac3806afe0 0x7fac3811eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:19.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.753+0000 7fac3e19f700 1 -- 172.21.15.40:0/2170477810 >> 172.21.15.40:0/2170477810 conn(0x7fac3809fb20 msgr2=0x7fac380a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:19.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.753+0000 7fac3e19f700 1 -- 172.21.15.40:0/2170477810 shutdown_connections 2023-09-30T22:30:19.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:19.753+0000 7fac3e19f700 1 -- 172.21.15.40:0/2170477810 wait complete. 2023-09-30T22:30:19.763 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:19.768 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:19.967 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:20.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.093+0000 7f97b0444700 1 Processor -- start 2023-09-30T22:30:20.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.093+0000 7f97b0444700 1 -- start start 2023-09-30T22:30:20.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.094+0000 7f97b0444700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97a809d450 0x7f97a809d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.094+0000 7f97b0444700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f97a809dd60 0x7f97a81301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.094+0000 7f97b0444700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a809c3b0 con 0x7f97a8130700 2023-09-30T22:30:20.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.094+0000 7f97b0444700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97a809a6b0 con 0x7f97a809dd60 2023-09-30T22:30:20.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.094+0000 7f97b0444700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a809b4f0 con 0x7f97a809d450 2023-09-30T22:30:20.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.094+0000 7f97ae1e0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97a809d450 0x7f97a809d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.094+0000 7f97ad9df700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f97a809dd60 0x7f97a81301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.094+0000 7f97ae1e0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97a809d450 0x7f97a809d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35564/0 (socket says 172.21.15.40:35564) 2023-09-30T22:30:20.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.094+0000 7f97ae1e0700 1 -- 172.21.15.40:0/873866176 learned_addr learned my addr 172.21.15.40:0/873866176 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:20.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.095+0000 7f97ad9df700 1 -- 172.21.15.40:0/873866176 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97a809d450 msgr2=0x7f97a809d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:20.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.095+0000 7f97ad9df700 1 --2- 172.21.15.40:0/873866176 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97a809d450 0x7f97a809d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.095+0000 7f97ad9df700 1 -- 172.21.15.40:0/873866176 >> v1:172.21.15.40:6789/0 conn(0x7f97a8130700 legacy=0x7f97a8137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:20.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.095+0000 7f97ad9df700 1 -- 172.21.15.40:0/873866176 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a809af90 con 0x7f97a809dd60 2023-09-30T22:30:20.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.095+0000 7f97ae1e0700 1 --2- 172.21.15.40:0/873866176 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97a809d450 0x7f97a809d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:20.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.095+0000 7f97ad9df700 1 --2- 172.21.15.40:0/873866176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97a809dd60 0x7f97a81301c0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f979800aa40 tx=0x7f979800ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7038f76d97164982 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:20.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.095+0000 7f97ad1de700 1 -- 172.21.15.40:0/873866176 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9798004220 con 0x7f97a809dd60 2023-09-30T22:30:20.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.095+0000 7f97ad1de700 1 -- 172.21.15.40:0/873866176 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9798004380 con 0x7f97a809dd60 2023-09-30T22:30:20.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.095+0000 7f97ad1de700 1 -- 172.21.15.40:0/873866176 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979800ae80 con 0x7f97a809dd60 2023-09-30T22:30:20.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.095+0000 7f97b0444700 1 -- 172.21.15.40:0/873866176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97a809dd60 msgr2=0x7f97a81301c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:20.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.095+0000 7f97b0444700 1 --2- 172.21.15.40:0/873866176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97a809dd60 0x7f97a81301c0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f979800aa40 tx=0x7f979800ad50 comp rx=0 tx=0).stop 2023-09-30T22:30:20.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.096+0000 7f97b0444700 1 -- 172.21.15.40:0/873866176 shutdown_connections 2023-09-30T22:30:20.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.096+0000 7f97b0444700 1 --2- 172.21.15.40:0/873866176 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97a809d450 0x7f97a809d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.096+0000 7f97b0444700 1 --2- 172.21.15.40:0/873866176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97a809dd60 0x7f97a81301c0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.096+0000 7f97b0444700 1 -- 172.21.15.40:0/873866176 >> 172.21.15.40:0/873866176 conn(0x7f97a80a2a00 msgr2=0x7f97a80a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:20.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.096+0000 7f97b0444700 1 -- 172.21.15.40:0/873866176 shutdown_connections 2023-09-30T22:30:20.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.096+0000 7f97b0444700 1 -- 172.21.15.40:0/873866176 wait complete. 2023-09-30T22:30:20.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.097+0000 7f97b0444700 1 Processor -- start 2023-09-30T22:30:20.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.097+0000 7f97b0444700 1 -- start start 2023-09-30T22:30:20.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.098+0000 7f97b0444700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f97a809d450 0x7f97a81c1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.098+0000 7f97b0444700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97a809dd60 0x7f97a81c1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.098+0000 7f97b0444700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97a8130700 0x7f97a81c4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.098+0000 7f97b0444700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a812f220 con 0x7f97a809dd60 2023-09-30T22:30:20.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.098+0000 7f97b0444700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a81c1b90 con 0x7f97a8130700 2023-09-30T22:30:20.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.098+0000 7f97b0444700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97a811d270 con 0x7f97a809d450 2023-09-30T22:30:20.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.098+0000 7f97ae1e0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f97a809d450 0x7f97a81c1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.098+0000 7f97ae1e0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f97a809d450 0x7f97a81c1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:47840/0 (socket says 172.21.15.40:47840) 2023-09-30T22:30:20.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.098+0000 7f97ae1e0700 1 -- 172.21.15.40:0/4065931954 learned_addr learned my addr 172.21.15.40:0/4065931954 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:20.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.098+0000 7f97ae9e1700 1 --2- 172.21.15.40:0/4065931954 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97a8130700 0x7f97a81c4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.098+0000 7f97ad9df700 1 --2- 172.21.15.40:0/4065931954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97a809dd60 0x7f97a81c1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.098+0000 7f97ae1e0700 1 -- 172.21.15.40:0/4065931954 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97a8130700 msgr2=0x7f97a81c4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:20.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.098+0000 7f97ae1e0700 1 --2- 172.21.15.40:0/4065931954 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97a8130700 0x7f97a81c4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.098+0000 7f97ae1e0700 1 -- 172.21.15.40:0/4065931954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97a809dd60 msgr2=0x7f97a81c1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:20.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.098+0000 7f97ae1e0700 1 --2- 172.21.15.40:0/4065931954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97a809dd60 0x7f97a81c1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.098+0000 7f97ae1e0700 1 -- 172.21.15.40:0/4065931954 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a4009550 con 0x7f97a809d450 2023-09-30T22:30:20.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.098+0000 7f97ae1e0700 1 --2- 172.21.15.40:0/4065931954 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f97a809d450 0x7f97a81c1110 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f97a400ec10 tx=0x7f97a400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:20.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.098+0000 7f979effd700 1 -- 172.21.15.40:0/4065931954 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a400c850 con 0x7f97a809d450 2023-09-30T22:30:20.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.098+0000 7f979effd700 1 -- 172.21.15.40:0/4065931954 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a400c9b0 con 0x7f97a809d450 2023-09-30T22:30:20.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.098+0000 7f97b0444700 1 -- 172.21.15.40:0/4065931954 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f979800a640 con 0x7f97a809d450 2023-09-30T22:30:20.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.098+0000 7f979effd700 1 -- 172.21.15.40:0/4065931954 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a400cd40 con 0x7f97a809d450 2023-09-30T22:30:20.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.099+0000 7f97b0444700 1 -- 172.21.15.40:0/4065931954 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a809c5d0 con 0x7f97a809d450 2023-09-30T22:30:20.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.099+0000 7f979effd700 1 -- 172.21.15.40:0/4065931954 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f97a4013470 con 0x7f97a809d450 2023-09-30T22:30:20.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.099+0000 7f979effd700 1 -- 172.21.15.40:0/4065931954 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f97a403f880 con 0x7f97a809d450 2023-09-30T22:30:20.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.099+0000 7f97b0444700 1 -- 172.21.15.40:0/4065931954 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97a811c5d0 con 0x7f97a809d450 2023-09-30T22:30:20.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.104+0000 7f979effd700 1 -- 172.21.15.40:0/4065931954 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f97a4013720 con 0x7f97a809d450 2023-09-30T22:30:20.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.299+0000 7f97b0444700 1 -- 172.21.15.40:0/4065931954 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f97a811cef0 con 0x7f97a809d450 2023-09-30T22:30:20.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.300+0000 7f979effd700 1 -- 172.21.15.40:0/4065931954 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f97a4021020 con 0x7f97a809d450 2023-09-30T22:30:20.300 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:20.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.301+0000 7f97b0444700 1 -- 172.21.15.40:0/4065931954 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f97a809d450 msgr2=0x7f97a81c1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:20.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.302+0000 7f97b0444700 1 --2- 172.21.15.40:0/4065931954 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f97a809d450 0x7f97a81c1110 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f97a400ec10 tx=0x7f97a400ef20 comp rx=0 tx=0).stop 2023-09-30T22:30:20.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.302+0000 7f97b0444700 1 -- 172.21.15.40:0/4065931954 shutdown_connections 2023-09-30T22:30:20.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.302+0000 7f97b0444700 1 --2- 172.21.15.40:0/4065931954 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f97a809d450 0x7f97a81c1110 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.302+0000 7f97b0444700 1 --2- 172.21.15.40:0/4065931954 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97a8130700 0x7f97a81c4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.302+0000 7f97b0444700 1 --2- 172.21.15.40:0/4065931954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97a809dd60 0x7f97a81c1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.302+0000 7f97b0444700 1 -- 172.21.15.40:0/4065931954 >> 172.21.15.40:0/4065931954 conn(0x7f97a80a2a00 msgr2=0x7f97a812e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:20.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.302+0000 7f97b0444700 1 -- 172.21.15.40:0/4065931954 shutdown_connections 2023-09-30T22:30:20.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.302+0000 7f97b0444700 1 -- 172.21.15.40:0/4065931954 wait complete. 2023-09-30T22:30:20.314 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:20.687 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:20.763 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:20.768 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:20.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.821+0000 7f6d62882700 1 Processor -- start 2023-09-30T22:30:20.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.821+0000 7f6d62882700 1 -- start start 2023-09-30T22:30:20.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.822+0000 7f6d62882700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6d5c09d920 0x7f6d5c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.822+0000 7f6d62882700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6d5c09e230 0x7f6d5c1308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.822+0000 7f6d62882700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6d5c130de0 0x7f6d5c131280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.822+0000 7f6d62882700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d5c09edf0 con 0x7f6d5c130de0 2023-09-30T22:30:20.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.822+0000 7f6d62882700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c09adf0 con 0x7f6d5c09d920 2023-09-30T22:30:20.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.822+0000 7f6d62882700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c09b660 con 0x7f6d5c09e230 2023-09-30T22:30:20.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.822+0000 7f6d60e1f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6d5c130de0 0x7f6d5c131280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.822+0000 7f6d60e1f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6d5c130de0 0x7f6d5c131280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46568/0 (socket says 172.21.15.40:46568) 2023-09-30T22:30:20.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.822+0000 7f6d60e1f700 1 -- 172.21.15.40:0/3377297105 learned_addr learned my addr 172.21.15.40:0/3377297105 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:20.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.822+0000 7f6d5b7fe700 1 --2- 172.21.15.40:0/3377297105 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6d5c09e230 0x7f6d5c1308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.822+0000 7f6d5bfff700 1 --2- 172.21.15.40:0/3377297105 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6d5c09d920 0x7f6d5c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.822+0000 7f6d60e1f700 1 -- 172.21.15.40:0/3377297105 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6d5c09e230 msgr2=0x7f6d5c1308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:20.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.822+0000 7f6d60e1f700 1 --2- 172.21.15.40:0/3377297105 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6d5c09e230 0x7f6d5c1308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.823+0000 7f6d60e1f700 1 -- 172.21.15.40:0/3377297105 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6d5c09d920 msgr2=0x7f6d5c09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:20.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.823+0000 7f6d60e1f700 1 --2- 172.21.15.40:0/3377297105 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6d5c09d920 0x7f6d5c09dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.823+0000 7f6d60e1f700 1 -- 172.21.15.40:0/3377297105 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5c09a6e0 con 0x7f6d5c130de0 2023-09-30T22:30:20.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.823+0000 7f6d60e1f700 1 --2- 172.21.15.40:0/3377297105 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d5c130de0 0x7f6d5c131280 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f6d5400d150 tx=0x7f6d5400d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a0c2778bfebc5a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:20.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.823+0000 7f6d5affd700 1 -- 172.21.15.40:0/3377297105 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d54010070 con 0x7f6d5c130de0 2023-09-30T22:30:20.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.823+0000 7f6d5affd700 1 -- 172.21.15.40:0/3377297105 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5400dd10 con 0x7f6d5c130de0 2023-09-30T22:30:20.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.823+0000 7f6d5affd700 1 -- 172.21.15.40:0/3377297105 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5400b310 con 0x7f6d5c130de0 2023-09-30T22:30:20.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.824+0000 7f6d62882700 1 -- 172.21.15.40:0/3377297105 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d5c130de0 msgr2=0x7f6d5c131280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:20.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.824+0000 7f6d62882700 1 --2- 172.21.15.40:0/3377297105 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d5c130de0 0x7f6d5c131280 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f6d5400d150 tx=0x7f6d5400d460 comp rx=0 tx=0).stop 2023-09-30T22:30:20.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.824+0000 7f6d62882700 1 -- 172.21.15.40:0/3377297105 shutdown_connections 2023-09-30T22:30:20.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.824+0000 7f6d62882700 1 --2- 172.21.15.40:0/3377297105 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d5c130de0 0x7f6d5c131280 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.824+0000 7f6d62882700 1 --2- 172.21.15.40:0/3377297105 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6d5c09d920 0x7f6d5c09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.824+0000 7f6d62882700 1 --2- 172.21.15.40:0/3377297105 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6d5c09e230 0x7f6d5c1308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.824+0000 7f6d62882700 1 -- 172.21.15.40:0/3377297105 >> 172.21.15.40:0/3377297105 conn(0x7f6d5c09fb20 msgr2=0x7f6d5c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:20.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.824+0000 7f6d62882700 1 -- 172.21.15.40:0/3377297105 shutdown_connections 2023-09-30T22:30:20.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.824+0000 7f6d62882700 1 -- 172.21.15.40:0/3377297105 wait complete. 2023-09-30T22:30:20.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.826+0000 7f6d62882700 1 Processor -- start 2023-09-30T22:30:20.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.826+0000 7f6d62882700 1 -- start start 2023-09-30T22:30:20.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.826+0000 7f6d62882700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d5c09d920 0x7f6d5c1c0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.827+0000 7f6d62882700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6d5c09e230 0x7f6d5c1c13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.827+0000 7f6d62882700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6d5c130de0 0x7f6d5c1c3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.827+0000 7f6d62882700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c11eae0 con 0x7f6d5c09d920 2023-09-30T22:30:20.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.827+0000 7f6d62882700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c11e760 con 0x7f6d5c130de0 2023-09-30T22:30:20.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.827+0000 7f6d62882700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c1c1920 con 0x7f6d5c09e230 2023-09-30T22:30:20.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.827+0000 7f6d5b7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6d5c09e230 0x7f6d5c1c13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.827+0000 7f6d5b7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6d5c09e230 0x7f6d5c1c13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:47868/0 (socket says 172.21.15.40:47868) 2023-09-30T22:30:20.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.827+0000 7f6d5b7fe700 1 -- 172.21.15.40:0/1895456489 learned_addr learned my addr 172.21.15.40:0/1895456489 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:20.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.827+0000 7f6d5bfff700 1 --2- 172.21.15.40:0/1895456489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d5c09d920 0x7f6d5c1c0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.827+0000 7f6d60e1f700 1 --2- 172.21.15.40:0/1895456489 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6d5c130de0 0x7f6d5c1c3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.827+0000 7f6d5b7fe700 1 -- 172.21.15.40:0/1895456489 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6d5c130de0 msgr2=0x7f6d5c1c3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:20.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.827+0000 7f6d5b7fe700 1 --2- 172.21.15.40:0/1895456489 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6d5c130de0 0x7f6d5c1c3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.827+0000 7f6d5b7fe700 1 -- 172.21.15.40:0/1895456489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d5c09d920 msgr2=0x7f6d5c1c0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:20.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.827+0000 7f6d5b7fe700 1 --2- 172.21.15.40:0/1895456489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d5c09d920 0x7f6d5c1c0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.827+0000 7f6d5b7fe700 1 -- 172.21.15.40:0/1895456489 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5400bd40 con 0x7f6d5c09e230 2023-09-30T22:30:20.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.827+0000 7f6d5b7fe700 1 --2- 172.21.15.40:0/1895456489 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6d5c09e230 0x7f6d5c1c13e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f6d5000e980 tx=0x7f6d5000ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:20.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.828+0000 7f6d58ff9700 1 -- 172.21.15.40:0/1895456489 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d50009710 con 0x7f6d5c09e230 2023-09-30T22:30:20.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.828+0000 7f6d58ff9700 1 -- 172.21.15.40:0/1895456489 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5000c690 con 0x7f6d5c09e230 2023-09-30T22:30:20.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.828+0000 7f6d62882700 1 -- 172.21.15.40:0/1895456489 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d5c11ca50 con 0x7f6d5c09e230 2023-09-30T22:30:20.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.828+0000 7f6d58ff9700 1 -- 172.21.15.40:0/1895456489 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5000ca20 con 0x7f6d5c09e230 2023-09-30T22:30:20.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.828+0000 7f6d62882700 1 -- 172.21.15.40:0/1895456489 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d5c0a3020 con 0x7f6d5c09e230 2023-09-30T22:30:20.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.829+0000 7f6d62882700 1 -- 172.21.15.40:0/1895456489 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d5c062380 con 0x7f6d5c09e230 2023-09-30T22:30:20.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.829+0000 7f6d58ff9700 1 -- 172.21.15.40:0/1895456489 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6d5000cb80 con 0x7f6d5c09e230 2023-09-30T22:30:20.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.829+0000 7f6d58ff9700 1 -- 172.21.15.40:0/1895456489 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6d5003ffe0 con 0x7f6d5c09e230 2023-09-30T22:30:20.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.834+0000 7f6d58ff9700 1 -- 172.21.15.40:0/1895456489 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6d5001ab50 con 0x7f6d5c09e230 2023-09-30T22:30:20.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.898+0000 7f5549986700 1 Processor -- start 2023-09-30T22:30:20.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.898+0000 7f5549986700 1 -- start start 2023-09-30T22:30:20.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.899+0000 7f5549986700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f554409d920 0x7f554409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.899+0000 7f5549986700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f554409f0f0 0x7f554409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.899+0000 7f5549986700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f554409f940 con 0x7f5544133ca0 2023-09-30T22:30:20.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.899+0000 7f5549986700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f554406b4c0 con 0x7f554409d920 2023-09-30T22:30:20.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.899+0000 7f5549986700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f554409a8f0 con 0x7f554409f0f0 2023-09-30T22:30:20.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.899+0000 7f55427fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f554409f0f0 0x7f554409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.899+0000 7f55427fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f554409f0f0 0x7f554409e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:47880/0 (socket says 172.21.15.40:47880) 2023-09-30T22:30:20.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.899+0000 7f55427fc700 1 -- 172.21.15.40:0/3454886434 learned_addr learned my addr 172.21.15.40:0/3454886434 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:20.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.899+0000 7f5542ffd700 1 --2- 172.21.15.40:0/3454886434 >> v2:172.21.15.40:3300/0 conn(0x7f554409d920 0x7f554409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.899+0000 7f5542ffd700 1 -- 172.21.15.40:0/3454886434 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f554409f0f0 msgr2=0x7f554409e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:20.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.899+0000 7f5542ffd700 1 --2- 172.21.15.40:0/3454886434 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f554409f0f0 0x7f554409e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.899+0000 7f5542ffd700 1 -- 172.21.15.40:0/3454886434 >> v1:172.21.15.40:6789/0 conn(0x7f5544133ca0 legacy=0x7f5544134120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:20.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.899+0000 7f5542ffd700 1 -- 172.21.15.40:0/3454886434 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554409f6e0 con 0x7f554409d920 2023-09-30T22:30:20.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.899+0000 7f55427fc700 1 --2- 172.21.15.40:0/3454886434 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f554409f0f0 0x7f554409e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:20.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.899+0000 7f5542ffd700 1 --2- 172.21.15.40:0/3454886434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f554409d920 0x7f554409dcf0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f5534009850 tx=0x7f5534009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6d5a092aaee6c3a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:20.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.900+0000 7f5541ffb700 1 -- 172.21.15.40:0/3454886434 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5534005e30 con 0x7f554409d920 2023-09-30T22:30:20.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.900+0000 7f5541ffb700 1 -- 172.21.15.40:0/3454886434 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5534006030 con 0x7f554409d920 2023-09-30T22:30:20.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.900+0000 7f5541ffb700 1 -- 172.21.15.40:0/3454886434 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55340063c0 con 0x7f554409d920 2023-09-30T22:30:20.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.900+0000 7f5549986700 1 -- 172.21.15.40:0/3454886434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f554409d920 msgr2=0x7f554409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:20.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.900+0000 7f5549986700 1 --2- 172.21.15.40:0/3454886434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f554409d920 0x7f554409dcf0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f5534009850 tx=0x7f5534009b60 comp rx=0 tx=0).stop 2023-09-30T22:30:20.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.900+0000 7f5549986700 1 -- 172.21.15.40:0/3454886434 shutdown_connections 2023-09-30T22:30:20.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.900+0000 7f5549986700 1 --2- 172.21.15.40:0/3454886434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f554409d920 0x7f554409dcf0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.900+0000 7f5549986700 1 --2- 172.21.15.40:0/3454886434 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f554409f0f0 0x7f554409e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.900+0000 7f5549986700 1 -- 172.21.15.40:0/3454886434 >> 172.21.15.40:0/3454886434 conn(0x7f554409fb20 msgr2=0x7f554409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:20.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.900+0000 7f5549986700 1 -- 172.21.15.40:0/3454886434 shutdown_connections 2023-09-30T22:30:20.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.900+0000 7f5549986700 1 -- 172.21.15.40:0/3454886434 wait complete. 2023-09-30T22:30:20.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.901+0000 7f5549986700 1 Processor -- start 2023-09-30T22:30:20.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.901+0000 7f5549986700 1 -- start start 2023-09-30T22:30:20.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.902+0000 7f5549986700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f554409d920 0x7f554411db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.902+0000 7f5549986700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5544133ca0 0x7f554411e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.902+0000 7f5549986700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5544130810 0x7f554411e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.902+0000 7f5549986700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5544121900 con 0x7f5544133ca0 2023-09-30T22:30:20.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.902+0000 7f5549986700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5544120740 con 0x7f5544130810 2023-09-30T22:30:20.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.902+0000 7f5549986700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f554411f130 con 0x7f554409d920 2023-09-30T22:30:20.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.902+0000 7f55427fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5544133ca0 0x7f554411e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.902+0000 7f55427fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5544133ca0 0x7f554411e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46598/0 (socket says 172.21.15.40:46598) 2023-09-30T22:30:20.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.902+0000 7f55427fc700 1 -- 172.21.15.40:0/139536666 learned_addr learned my addr 172.21.15.40:0/139536666 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:20.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.902+0000 7f5542ffd700 1 --2- 172.21.15.40:0/139536666 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f554409d920 0x7f554411db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.902+0000 7f55437fe700 1 --2- 172.21.15.40:0/139536666 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5544130810 0x7f554411e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.902+0000 7f55427fc700 1 -- 172.21.15.40:0/139536666 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f554409d920 msgr2=0x7f554411db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:20.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.902+0000 7f55427fc700 1 --2- 172.21.15.40:0/139536666 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f554409d920 0x7f554411db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.902+0000 7f55427fc700 1 -- 172.21.15.40:0/139536666 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5544130810 msgr2=0x7f554411e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:20.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.902+0000 7f55427fc700 1 --2- 172.21.15.40:0/139536666 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5544130810 0x7f554411e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.902+0000 7f55427fc700 1 -- 172.21.15.40:0/139536666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5538009550 con 0x7f5544133ca0 2023-09-30T22:30:20.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.902+0000 7f5542ffd700 1 --2- 172.21.15.40:0/139536666 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f554409d920 0x7f554411db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:20.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.903+0000 7f55427fc700 1 --2- 172.21.15.40:0/139536666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5544133ca0 0x7f554411e080 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f553800ec10 tx=0x7f553800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:20.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.903+0000 7f552bfff700 1 -- 172.21.15.40:0/139536666 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553800c850 con 0x7f5544133ca0 2023-09-30T22:30:20.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.903+0000 7f552bfff700 1 -- 172.21.15.40:0/139536666 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553800c9b0 con 0x7f5544133ca0 2023-09-30T22:30:20.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.903+0000 7f5549986700 1 -- 172.21.15.40:0/139536666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5534009430 con 0x7f5544133ca0 2023-09-30T22:30:20.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.903+0000 7f552bfff700 1 -- 172.21.15.40:0/139536666 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553800cd20 con 0x7f5544133ca0 2023-09-30T22:30:20.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.903+0000 7f5549986700 1 -- 172.21.15.40:0/139536666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55440a2850 con 0x7f5544133ca0 2023-09-30T22:30:20.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.904+0000 7f552bfff700 1 -- 172.21.15.40:0/139536666 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5538013470 con 0x7f5544133ca0 2023-09-30T22:30:20.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.904+0000 7f5549986700 1 -- 172.21.15.40:0/139536666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5544120900 con 0x7f5544133ca0 2023-09-30T22:30:20.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.904+0000 7f552bfff700 1 -- 172.21.15.40:0/139536666 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f553803fb80 con 0x7f5544133ca0 2023-09-30T22:30:20.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.909+0000 7f552bfff700 1 -- 172.21.15.40:0/139536666 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5538013720 con 0x7f5544133ca0 2023-09-30T22:30:20.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.938+0000 7fef47c19700 1 Processor -- start 2023-09-30T22:30:20.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.938+0000 7fef47c19700 1 -- start start 2023-09-30T22:30:20.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.938+0000 7fef47c19700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef40130c00 0x7fef40130fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.938+0000 7fef47c19700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef40130570 0x7fef4009a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.938+0000 7fef47c19700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef4009ab60 0x7fef4009afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.938+0000 7fef47c19700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef4009bfb0 con 0x7fef4009ab60 2023-09-30T22:30:20.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.938+0000 7fef47c19700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef4009ba60 con 0x7fef40130570 2023-09-30T22:30:20.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.938+0000 7fef47c19700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef4009df10 con 0x7fef40130c00 2023-09-30T22:30:20.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.939+0000 7fef451b4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef40130570 0x7fef4009a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.939+0000 7fef461b6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef4009ab60 0x7fef4009afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.939+0000 7fef451b4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef40130570 0x7fef4009a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35604/0 (socket says 172.21.15.40:35604) 2023-09-30T22:30:20.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.939+0000 7fef461b6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef4009ab60 0x7fef4009afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46610/0 (socket says 172.21.15.40:46610) 2023-09-30T22:30:20.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.939+0000 7fef451b4700 1 -- 172.21.15.40:0/3455744428 learned_addr learned my addr 172.21.15.40:0/3455744428 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:20.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.939+0000 7fef459b5700 1 --2- 172.21.15.40:0/3455744428 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef40130c00 0x7fef40130fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.939+0000 7fef451b4700 1 -- 172.21.15.40:0/3455744428 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef40130c00 msgr2=0x7fef40130fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:20.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.939+0000 7fef451b4700 1 --2- 172.21.15.40:0/3455744428 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef40130c00 0x7fef40130fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.939+0000 7fef451b4700 1 -- 172.21.15.40:0/3455744428 >> v2:172.21.15.40:3300/0 conn(0x7fef4009ab60 msgr2=0x7fef4009afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:20.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.939+0000 7fef451b4700 1 --2- 172.21.15.40:0/3455744428 >> v2:172.21.15.40:3300/0 conn(0x7fef4009ab60 0x7fef4009afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.939+0000 7fef451b4700 1 -- 172.21.15.40:0/3455744428 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef40131510 con 0x7fef40130570 2023-09-30T22:30:20.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.939+0000 7fef461b6700 1 --2- 172.21.15.40:0/3455744428 >> v2:172.21.15.40:3300/0 conn(0x7fef4009ab60 0x7fef4009afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:20.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.939+0000 7fef459b5700 1 --2- 172.21.15.40:0/3455744428 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef40130c00 0x7fef40130fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:20.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.939+0000 7fef451b4700 1 --2- 172.21.15.40:0/3455744428 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef40130570 0x7fef4009a620 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fef3000bb90 tx=0x7fef3000bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ba21ab17086f6fe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:20.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.939+0000 7fef449b3700 1 -- 172.21.15.40:0/3455744428 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3000dd30 con 0x7fef40130570 2023-09-30T22:30:20.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.939+0000 7fef449b3700 1 -- 172.21.15.40:0/3455744428 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3000de90 con 0x7fef40130570 2023-09-30T22:30:20.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.939+0000 7fef449b3700 1 -- 172.21.15.40:0/3455744428 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef30010690 con 0x7fef40130570 2023-09-30T22:30:20.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.940+0000 7fef47c19700 1 -- 172.21.15.40:0/3455744428 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef40130570 msgr2=0x7fef4009a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:20.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.940+0000 7fef47c19700 1 --2- 172.21.15.40:0/3455744428 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef40130570 0x7fef4009a620 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fef3000bb90 tx=0x7fef3000bea0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.940+0000 7fef47c19700 1 -- 172.21.15.40:0/3455744428 shutdown_connections 2023-09-30T22:30:20.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.940+0000 7fef47c19700 1 --2- 172.21.15.40:0/3455744428 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef40130c00 0x7fef40130fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.940+0000 7fef47c19700 1 --2- 172.21.15.40:0/3455744428 >> v2:172.21.15.40:3300/0 conn(0x7fef4009ab60 0x7fef4009afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.940+0000 7fef47c19700 1 --2- 172.21.15.40:0/3455744428 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef40130570 0x7fef4009a620 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.940+0000 7fef47c19700 1 -- 172.21.15.40:0/3455744428 >> 172.21.15.40:0/3455744428 conn(0x7fef4009eb10 msgr2=0x7fef4009ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:20.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.940+0000 7fef47c19700 1 -- 172.21.15.40:0/3455744428 shutdown_connections 2023-09-30T22:30:20.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.940+0000 7fef47c19700 1 -- 172.21.15.40:0/3455744428 wait complete. 2023-09-30T22:30:20.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.942+0000 7fef47c19700 1 Processor -- start 2023-09-30T22:30:20.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.942+0000 7fef47c19700 1 -- start start 2023-09-30T22:30:20.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.942+0000 7fef47c19700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef4009ab60 0x7fef40129ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.942+0000 7fef47c19700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef40130570 0x7fef4012a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.942+0000 7fef47c19700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef40130c00 0x7fef4012aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:20.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.942+0000 7fef47c19700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4012bdf0 con 0x7fef40130570 2023-09-30T22:30:20.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.942+0000 7fef47c19700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef4012bc00 con 0x7fef4009ab60 2023-09-30T22:30:20.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.942+0000 7fef47c19700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef4012c220 con 0x7fef40130c00 2023-09-30T22:30:20.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.942+0000 7fef459b5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef4009ab60 0x7fef40129ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.942+0000 7fef459b5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef4009ab60 0x7fef40129ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35612/0 (socket says 172.21.15.40:35612) 2023-09-30T22:30:20.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.942+0000 7fef459b5700 1 -- 172.21.15.40:0/926467747 learned_addr learned my addr 172.21.15.40:0/926467747 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:20.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.943+0000 7fef461b6700 1 --2- 172.21.15.40:0/926467747 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef40130c00 0x7fef4012aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.943+0000 7fef451b4700 1 --2- 172.21.15.40:0/926467747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef40130570 0x7fef4012a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:20.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.943+0000 7fef459b5700 1 -- 172.21.15.40:0/926467747 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef40130c00 msgr2=0x7fef4012aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:20.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.943+0000 7fef459b5700 1 --2- 172.21.15.40:0/926467747 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef40130c00 0x7fef4012aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.943+0000 7fef459b5700 1 -- 172.21.15.40:0/926467747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef40130570 msgr2=0x7fef4012a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:20.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.943+0000 7fef459b5700 1 --2- 172.21.15.40:0/926467747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef40130570 0x7fef4012a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:20.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.943+0000 7fef459b5700 1 -- 172.21.15.40:0/926467747 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef38009a70 con 0x7fef4009ab60 2023-09-30T22:30:20.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.943+0000 7fef459b5700 1 --2- 172.21.15.40:0/926467747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef4009ab60 0x7fef40129ff0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fef3c00ebe0 tx=0x7fef3c009ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:20.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.943+0000 7fef367fc700 1 -- 172.21.15.40:0/926467747 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3c005a20 con 0x7fef4009ab60 2023-09-30T22:30:20.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.943+0000 7fef367fc700 1 -- 172.21.15.40:0/926467747 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3c005b80 con 0x7fef4009ab60 2023-09-30T22:30:20.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.943+0000 7fef47c19700 1 -- 172.21.15.40:0/926467747 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef3c009430 con 0x7fef4009ab60 2023-09-30T22:30:20.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.943+0000 7fef367fc700 1 -- 172.21.15.40:0/926467747 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3c00c850 con 0x7fef4009ab60 2023-09-30T22:30:20.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.943+0000 7fef47c19700 1 -- 172.21.15.40:0/926467747 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef3000b7f0 con 0x7fef4009ab60 2023-09-30T22:30:20.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.944+0000 7fef47c19700 1 -- 172.21.15.40:0/926467747 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef40062380 con 0x7fef4009ab60 2023-09-30T22:30:20.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.944+0000 7fef367fc700 1 -- 172.21.15.40:0/926467747 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fef3c00c9b0 con 0x7fef4009ab60 2023-09-30T22:30:20.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.945+0000 7fef367fc700 1 -- 172.21.15.40:0/926467747 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fef3c03f9e0 con 0x7fef4009ab60 2023-09-30T22:30:20.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:20.949+0000 7fef367fc700 1 -- 172.21.15.40:0/926467747 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef3c022300 con 0x7fef4009ab60 2023-09-30T22:30:21.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.033+0000 7f6d62882700 1 -- 172.21.15.40:0/1895456489 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6d5c074720 con 0x7f6d5c09e230 2023-09-30T22:30:21.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.033+0000 7f6d58ff9700 1 -- 172.21.15.40:0/1895456489 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6d5001ab50 con 0x7f6d5c09e230 2023-09-30T22:30:21.034 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:21.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.036+0000 7f6d62882700 1 -- 172.21.15.40:0/1895456489 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6d5c09e230 msgr2=0x7f6d5c1c13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:21.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.036+0000 7f6d62882700 1 --2- 172.21.15.40:0/1895456489 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6d5c09e230 0x7f6d5c1c13e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f6d5000e980 tx=0x7f6d5000ec90 comp rx=0 tx=0).stop 2023-09-30T22:30:21.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.036+0000 7f6d62882700 1 -- 172.21.15.40:0/1895456489 shutdown_connections 2023-09-30T22:30:21.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.036+0000 7f6d62882700 1 --2- 172.21.15.40:0/1895456489 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6d5c130de0 0x7f6d5c1c3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.036+0000 7f6d62882700 1 --2- 172.21.15.40:0/1895456489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d5c09d920 0x7f6d5c1c0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.036+0000 7f6d62882700 1 --2- 172.21.15.40:0/1895456489 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6d5c09e230 0x7f6d5c1c13e0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.036+0000 7f6d62882700 1 -- 172.21.15.40:0/1895456489 >> 172.21.15.40:0/1895456489 conn(0x7f6d5c09fb20 msgr2=0x7f6d5c12ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:21.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.037+0000 7f6d62882700 1 -- 172.21.15.40:0/1895456489 shutdown_connections 2023-09-30T22:30:21.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.037+0000 7f6d62882700 1 -- 172.21.15.40:0/1895456489 wait complete. 2023-09-30T22:30:21.050 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:21.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.109+0000 7f5549986700 1 -- 172.21.15.40:0/139536666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5544062380 con 0x7f5544133ca0 2023-09-30T22:30:21.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.110+0000 7f552bfff700 1 -- 172.21.15.40:0/139536666 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5538021030 con 0x7f5544133ca0 2023-09-30T22:30:21.111 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:21.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.112+0000 7f5549986700 1 -- 172.21.15.40:0/139536666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5544133ca0 msgr2=0x7f554411e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:21.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.112+0000 7f5549986700 1 --2- 172.21.15.40:0/139536666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5544133ca0 0x7f554411e080 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f553800ec10 tx=0x7f553800ef20 comp rx=0 tx=0).stop 2023-09-30T22:30:21.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.112+0000 7f5549986700 1 -- 172.21.15.40:0/139536666 shutdown_connections 2023-09-30T22:30:21.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.112+0000 7f5549986700 1 --2- 172.21.15.40:0/139536666 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f554409d920 0x7f554411db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.112+0000 7f5549986700 1 --2- 172.21.15.40:0/139536666 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5544130810 0x7f554411e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.112+0000 7f5549986700 1 --2- 172.21.15.40:0/139536666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5544133ca0 0x7f554411e080 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.112+0000 7f5549986700 1 -- 172.21.15.40:0/139536666 >> 172.21.15.40:0/139536666 conn(0x7f554409fb20 msgr2=0x7f55440a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:21.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.112+0000 7f5549986700 1 -- 172.21.15.40:0/139536666 shutdown_connections 2023-09-30T22:30:21.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.112+0000 7f5549986700 1 -- 172.21.15.40:0/139536666 wait complete. 2023-09-30T22:30:21.125 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:21.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.148+0000 7fef47c19700 1 -- 172.21.15.40:0/926467747 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fef400a1df0 con 0x7fef4009ab60 2023-09-30T22:30:21.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.149+0000 7fef367fc700 1 -- 172.21.15.40:0/926467747 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fef3c013e60 con 0x7fef4009ab60 2023-09-30T22:30:21.150 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:21.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.151+0000 7fef47c19700 1 -- 172.21.15.40:0/926467747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef4009ab60 msgr2=0x7fef40129ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:21.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.151+0000 7fef47c19700 1 --2- 172.21.15.40:0/926467747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef4009ab60 0x7fef40129ff0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fef3c00ebe0 tx=0x7fef3c009ea0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.151+0000 7fef47c19700 1 -- 172.21.15.40:0/926467747 shutdown_connections 2023-09-30T22:30:21.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.151+0000 7fef47c19700 1 --2- 172.21.15.40:0/926467747 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef40130c00 0x7fef4012aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.151+0000 7fef47c19700 1 --2- 172.21.15.40:0/926467747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef4009ab60 0x7fef40129ff0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.151+0000 7fef47c19700 1 --2- 172.21.15.40:0/926467747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef40130570 0x7fef4012a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.151+0000 7fef47c19700 1 -- 172.21.15.40:0/926467747 >> 172.21.15.40:0/926467747 conn(0x7fef4009eb10 msgr2=0x7fef4012e470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:21.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.151+0000 7fef47c19700 1 -- 172.21.15.40:0/926467747 shutdown_connections 2023-09-30T22:30:21.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.151+0000 7fef47c19700 1 -- 172.21.15.40:0/926467747 wait complete. 2023-09-30T22:30:21.163 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:21.316 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:21.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.443+0000 7fb984ff2700 1 Processor -- start 2023-09-30T22:30:21.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.443+0000 7fb984ff2700 1 -- start start 2023-09-30T22:30:21.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.444+0000 7fb984ff2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb98009fbb0 0x7fb98006d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:21.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.444+0000 7fb984ff2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb980139380 0x7fb98013b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:21.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.444+0000 7fb984ff2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9800a0780 con 0x7fb98006f3a0 2023-09-30T22:30:21.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.444+0000 7fb984ff2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb98009ff80 con 0x7fb98009fbb0 2023-09-30T22:30:21.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.444+0000 7fb984ff2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9800a0590 con 0x7fb980139380 2023-09-30T22:30:21.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.444+0000 7fb97ed9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb980139380 0x7fb98013b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:21.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.444+0000 7fb977fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb98009fbb0 0x7fb98006d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:21.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.444+0000 7fb97e59c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb98006f3a0 0x7fb98006c990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55722/0 (socket says 172.21.15.40:55722) 2023-09-30T22:30:21.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.444+0000 7fb97e59c700 1 -- 172.21.15.40:0/1932144426 learned_addr learned my addr 172.21.15.40:0/1932144426 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:21.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.444+0000 7fb977fff700 1 -- 172.21.15.40:0/1932144426 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb980139380 msgr2=0x7fb98013b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.444+0000 7fb97dd9b700 1 -- 172.21.15.40:0/1932144426 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3409243412 0 0) 0x7fb9800a0780 con 0x7fb98006f3a0 2023-09-30T22:30:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.444+0000 7fb977fff700 1 --2- 172.21.15.40:0/1932144426 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb980139380 0x7fb98013b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.444+0000 7fb977fff700 1 -- 172.21.15.40:0/1932144426 >> v1:172.21.15.40:6789/0 conn(0x7fb98006f3a0 legacy=0x7fb98006c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.444+0000 7fb977fff700 1 -- 172.21.15.40:0/1932144426 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb98006df90 con 0x7fb98009fbb0 2023-09-30T22:30:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.444+0000 7fb97ed9d700 1 --2- 172.21.15.40:0/1932144426 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb980139380 0x7fb98013b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.444+0000 7fb977fff700 1 --2- 172.21.15.40:0/1932144426 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb98009fbb0 0x7fb98006d0a0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fb968009870 tx=0x7fb968009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d37062d3a1123502 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.444+0000 7fb97dd9b700 1 -- 172.21.15.40:0/1932144426 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb968011830 con 0x7fb98009fbb0 2023-09-30T22:30:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.444+0000 7fb97dd9b700 1 -- 172.21.15.40:0/1932144426 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb968011990 con 0x7fb98009fbb0 2023-09-30T22:30:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.444+0000 7fb97dd9b700 1 -- 172.21.15.40:0/1932144426 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb968011d20 con 0x7fb98009fbb0 2023-09-30T22:30:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.445+0000 7fb984ff2700 1 -- 172.21.15.40:0/1932144426 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb98009fbb0 msgr2=0x7fb98006d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.445+0000 7fb984ff2700 1 --2- 172.21.15.40:0/1932144426 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb98009fbb0 0x7fb98006d0a0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fb968009870 tx=0x7fb968009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:21.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.445+0000 7fb984ff2700 1 -- 172.21.15.40:0/1932144426 shutdown_connections 2023-09-30T22:30:21.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.445+0000 7fb984ff2700 1 --2- 172.21.15.40:0/1932144426 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb980139380 0x7fb98013b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.445+0000 7fb984ff2700 1 --2- 172.21.15.40:0/1932144426 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb98009fbb0 0x7fb98006d0a0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.445+0000 7fb984ff2700 1 -- 172.21.15.40:0/1932144426 >> 172.21.15.40:0/1932144426 conn(0x7fb9800a41a0 msgr2=0x7fb9800a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:21.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.445+0000 7fb984ff2700 1 -- 172.21.15.40:0/1932144426 shutdown_connections 2023-09-30T22:30:21.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.445+0000 7fb984ff2700 1 -- 172.21.15.40:0/1932144426 wait complete. 2023-09-30T22:30:21.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.446+0000 7fb984ff2700 1 Processor -- start 2023-09-30T22:30:21.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.446+0000 7fb984ff2700 1 -- start start 2023-09-30T22:30:21.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.446+0000 7fb984ff2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb98006f3a0 0x7fb980138860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:21.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.447+0000 7fb984ff2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb98009fbb0 0x7fb980138da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:21.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.447+0000 7fb984ff2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb980139380 0x7fb980095ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:21.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.447+0000 7fb984ff2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb980092ff0 con 0x7fb98009fbb0 2023-09-30T22:30:21.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.447+0000 7fb984ff2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb980094cb0 con 0x7fb980139380 2023-09-30T22:30:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.447+0000 7fb984ff2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb980094f00 con 0x7fb98006f3a0 2023-09-30T22:30:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.447+0000 7fb97e59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb98006f3a0 0x7fb980138860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.447+0000 7fb977fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb98009fbb0 0x7fb980138da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.447+0000 7fb97e59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb98006f3a0 0x7fb980138860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:47914/0 (socket says 172.21.15.40:47914) 2023-09-30T22:30:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.447+0000 7fb977fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb98009fbb0 0x7fb980138da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46622/0 (socket says 172.21.15.40:46622) 2023-09-30T22:30:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.447+0000 7fb97e59c700 1 -- 172.21.15.40:0/1985859746 learned_addr learned my addr 172.21.15.40:0/1985859746 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.447+0000 7fb97ed9d700 1 --2- 172.21.15.40:0/1985859746 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb980139380 0x7fb980095ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.447+0000 7fb97e59c700 1 -- 172.21.15.40:0/1985859746 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb980139380 msgr2=0x7fb980095ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.447+0000 7fb97e59c700 1 --2- 172.21.15.40:0/1985859746 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb980139380 0x7fb980095ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.447+0000 7fb97e59c700 1 -- 172.21.15.40:0/1985859746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb98009fbb0 msgr2=0x7fb980138da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.447+0000 7fb97e59c700 1 --2- 172.21.15.40:0/1985859746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb98009fbb0 0x7fb980138da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.447+0000 7fb97e59c700 1 -- 172.21.15.40:0/1985859746 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb978009a70 con 0x7fb98006f3a0 2023-09-30T22:30:21.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.447+0000 7fb97ed9d700 1 --2- 172.21.15.40:0/1985859746 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb980139380 0x7fb980095ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:21.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.447+0000 7fb977fff700 1 --2- 172.21.15.40:0/1985859746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb98009fbb0 0x7fb980138da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:21.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.447+0000 7fb97e59c700 1 --2- 172.21.15.40:0/1985859746 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb98006f3a0 0x7fb980138860 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fb97000c550 tx=0x7fb97000c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:21.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.447+0000 7fb976ffd700 1 -- 172.21.15.40:0/1985859746 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb970004c80 con 0x7fb98006f3a0 2023-09-30T22:30:21.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.447+0000 7fb976ffd700 1 -- 172.21.15.40:0/1985859746 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb970004de0 con 0x7fb98006f3a0 2023-09-30T22:30:21.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.447+0000 7fb976ffd700 1 -- 172.21.15.40:0/1985859746 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb970007310 con 0x7fb98006f3a0 2023-09-30T22:30:21.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.447+0000 7fb984ff2700 1 -- 172.21.15.40:0/1985859746 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9680094a0 con 0x7fb98006f3a0 2023-09-30T22:30:21.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.447+0000 7fb984ff2700 1 -- 172.21.15.40:0/1985859746 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb980071460 con 0x7fb98006f3a0 2023-09-30T22:30:21.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.448+0000 7fb976ffd700 1 -- 172.21.15.40:0/1985859746 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb970007470 con 0x7fb98006f3a0 2023-09-30T22:30:21.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.448+0000 7fb976ffd700 1 -- 172.21.15.40:0/1985859746 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb97003f270 con 0x7fb98006f3a0 2023-09-30T22:30:21.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.448+0000 7fb984ff2700 1 -- 172.21.15.40:0/1985859746 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb980062380 con 0x7fb98006f3a0 2023-09-30T22:30:21.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.453+0000 7fb976ffd700 1 -- 172.21.15.40:0/1985859746 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb9700123b0 con 0x7fb98006f3a0 2023-09-30T22:30:21.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.647+0000 7fb984ff2700 1 -- 172.21.15.40:0/1985859746 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb980097460 con 0x7fb98006f3a0 2023-09-30T22:30:21.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.647+0000 7fb976ffd700 1 -- 172.21.15.40:0/1985859746 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb970011360 con 0x7fb98006f3a0 2023-09-30T22:30:21.648 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:21.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.649+0000 7fb984ff2700 1 -- 172.21.15.40:0/1985859746 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb98006f3a0 msgr2=0x7fb980138860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:21.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.649+0000 7fb984ff2700 1 --2- 172.21.15.40:0/1985859746 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb98006f3a0 0x7fb980138860 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fb97000c550 tx=0x7fb97000c860 comp rx=0 tx=0).stop 2023-09-30T22:30:21.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.649+0000 7fb984ff2700 1 -- 172.21.15.40:0/1985859746 shutdown_connections 2023-09-30T22:30:21.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.649+0000 7fb984ff2700 1 --2- 172.21.15.40:0/1985859746 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb98006f3a0 0x7fb980138860 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.649+0000 7fb984ff2700 1 --2- 172.21.15.40:0/1985859746 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb980139380 0x7fb980095ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.649+0000 7fb984ff2700 1 --2- 172.21.15.40:0/1985859746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb98009fbb0 0x7fb980138da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:21.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.649+0000 7fb984ff2700 1 -- 172.21.15.40:0/1985859746 >> 172.21.15.40:0/1985859746 conn(0x7fb9800a41a0 msgr2=0x7fb98006f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:21.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.649+0000 7fb984ff2700 1 -- 172.21.15.40:0/1985859746 shutdown_connections 2023-09-30T22:30:21.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:21.649+0000 7fb984ff2700 1 -- 172.21.15.40:0/1985859746 wait complete. 2023-09-30T22:30:21.662 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:22.051 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:22.125 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:22.164 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:22.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.188+0000 7f5b077ab700 1 Processor -- start 2023-09-30T22:30:22.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.188+0000 7f5b077ab700 1 -- start start 2023-09-30T22:30:22.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.189+0000 7f5b077ab700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b0009d450 0x7f5b0009d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.189+0000 7f5b077ab700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5b0009dd60 0x7f5b001301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.189+0000 7f5b077ab700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b0009c3b0 con 0x7f5b00130700 2023-09-30T22:30:22.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.189+0000 7f5b077ab700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0009a6b0 con 0x7f5b0009d450 2023-09-30T22:30:22.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.189+0000 7f5b077ab700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0009b4f0 con 0x7f5b0009dd60 2023-09-30T22:30:22.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.189+0000 7f5b05547700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b0009d450 0x7f5b0009d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.189+0000 7f5b05d48700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5b00130700 0x7f5b00137410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55726/0 (socket says 172.21.15.40:55726) 2023-09-30T22:30:22.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.189+0000 7f5b05d48700 1 -- 172.21.15.40:0/433124112 learned_addr learned my addr 172.21.15.40:0/433124112 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:22.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.190+0000 7f5b04d46700 1 --2- 172.21.15.40:0/433124112 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5b0009dd60 0x7f5b001301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.190+0000 7f5b05547700 1 -- 172.21.15.40:0/433124112 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5b0009dd60 msgr2=0x7f5b001301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:22.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.190+0000 7f5b05547700 1 --2- 172.21.15.40:0/433124112 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5b0009dd60 0x7f5b001301c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.190+0000 7f5af7fff700 1 -- 172.21.15.40:0/433124112 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1516342 0 0) 0x7f5b0009c3b0 con 0x7f5b00130700 2023-09-30T22:30:22.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.190+0000 7f5b05547700 1 -- 172.21.15.40:0/433124112 >> v1:172.21.15.40:6789/0 conn(0x7f5b00130700 legacy=0x7f5b00137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:22.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.190+0000 7f5b05547700 1 -- 172.21.15.40:0/433124112 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0009af90 con 0x7f5b0009d450 2023-09-30T22:30:22.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.190+0000 7f5b05547700 1 --2- 172.21.15.40:0/433124112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b0009d450 0x7f5b0009d820 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f5afc00aa10 tx=0x7f5afc00ad20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6eddc633888a660 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:22.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.190+0000 7f5af7fff700 1 -- 172.21.15.40:0/433124112 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc00cb70 con 0x7f5b0009d450 2023-09-30T22:30:22.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.190+0000 7f5af7fff700 1 -- 172.21.15.40:0/433124112 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5afc00ccd0 con 0x7f5b0009d450 2023-09-30T22:30:22.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.190+0000 7f5af7fff700 1 -- 172.21.15.40:0/433124112 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc018600 con 0x7f5b0009d450 2023-09-30T22:30:22.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.191+0000 7f5b077ab700 1 -- 172.21.15.40:0/433124112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b0009d450 msgr2=0x7f5b0009d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:22.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.191+0000 7f5b077ab700 1 --2- 172.21.15.40:0/433124112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b0009d450 0x7f5b0009d820 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f5afc00aa10 tx=0x7f5afc00ad20 comp rx=0 tx=0).stop 2023-09-30T22:30:22.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.191+0000 7f5b077ab700 1 -- 172.21.15.40:0/433124112 shutdown_connections 2023-09-30T22:30:22.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.191+0000 7f5b077ab700 1 --2- 172.21.15.40:0/433124112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b0009d450 0x7f5b0009d820 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.191+0000 7f5b077ab700 1 --2- 172.21.15.40:0/433124112 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5b0009dd60 0x7f5b001301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.191+0000 7f5b077ab700 1 -- 172.21.15.40:0/433124112 >> 172.21.15.40:0/433124112 conn(0x7f5b000a2a00 msgr2=0x7f5b000a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:22.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.191+0000 7f5b077ab700 1 -- 172.21.15.40:0/433124112 shutdown_connections 2023-09-30T22:30:22.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.191+0000 7f5b077ab700 1 -- 172.21.15.40:0/433124112 wait complete. 2023-09-30T22:30:22.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.192+0000 7f5b077ab700 1 Processor -- start 2023-09-30T22:30:22.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.192+0000 7f5b077ab700 1 -- start start 2023-09-30T22:30:22.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.193+0000 7f5b077ab700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b0009d450 0x7f5b001c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.193+0000 7f5b077ab700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b0009dd60 0x7f5b001c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.193+0000 7f5b077ab700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5b00130700 0x7f5b001c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.193+0000 7f5b077ab700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b00123070 con 0x7f5b0009d450 2023-09-30T22:30:22.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.193+0000 7f5b077ab700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0011cf50 con 0x7f5b0009dd60 2023-09-30T22:30:22.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.193+0000 7f5b077ab700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b000a22d0 con 0x7f5b00130700 2023-09-30T22:30:22.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.193+0000 7f5b05547700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b0009d450 0x7f5b001c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.193+0000 7f5b05d48700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5b00130700 0x7f5b001c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.193+0000 7f5b05547700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b0009d450 0x7f5b001c83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46638/0 (socket says 172.21.15.40:46638) 2023-09-30T22:30:22.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.193+0000 7f5b05547700 1 -- 172.21.15.40:0/3622777026 learned_addr learned my addr 172.21.15.40:0/3622777026 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:22.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.193+0000 7f5b05547700 1 -- 172.21.15.40:0/3622777026 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5b00130700 msgr2=0x7f5b001c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:22.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.193+0000 7f5b05547700 1 --2- 172.21.15.40:0/3622777026 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5b00130700 0x7f5b001c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.193+0000 7f5b05547700 1 -- 172.21.15.40:0/3622777026 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b0009dd60 msgr2=0x7f5b001c88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:22.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.193+0000 7f5b05547700 1 --2- 172.21.15.40:0/3622777026 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b0009dd60 0x7f5b001c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.193+0000 7f5b05547700 1 -- 172.21.15.40:0/3622777026 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc00a640 con 0x7f5b0009d450 2023-09-30T22:30:22.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.193+0000 7f5b05d48700 1 --2- 172.21.15.40:0/3622777026 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5b00130700 0x7f5b001c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:22.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.193+0000 7f5b05547700 1 --2- 172.21.15.40:0/3622777026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b0009d450 0x7f5b001c83a0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f5afc000c00 tx=0x7f5afc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:22.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.194+0000 7f5af5ffb700 1 -- 172.21.15.40:0/3622777026 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc003ab0 con 0x7f5b0009d450 2023-09-30T22:30:22.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.194+0000 7f5af5ffb700 1 -- 172.21.15.40:0/3622777026 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5afc003c30 con 0x7f5b0009d450 2023-09-30T22:30:22.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.194+0000 7f5b077ab700 1 -- 172.21.15.40:0/3622777026 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b0009c5d0 con 0x7f5b0009d450 2023-09-30T22:30:22.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.194+0000 7f5af5ffb700 1 -- 172.21.15.40:0/3622777026 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc021480 con 0x7f5b0009d450 2023-09-30T22:30:22.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.194+0000 7f5b077ab700 1 -- 172.21.15.40:0/3622777026 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b00121fd0 con 0x7f5b0009d450 2023-09-30T22:30:22.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.195+0000 7f5af5ffb700 1 -- 172.21.15.40:0/3622777026 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5afc018400 con 0x7f5b0009d450 2023-09-30T22:30:22.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.195+0000 7f5b077ab700 1 -- 172.21.15.40:0/3622777026 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b00062380 con 0x7f5b0009d450 2023-09-30T22:30:22.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.195+0000 7f5af5ffb700 1 -- 172.21.15.40:0/3622777026 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5afc040eb0 con 0x7f5b0009d450 2023-09-30T22:30:22.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.200+0000 7f5af5ffb700 1 -- 172.21.15.40:0/3622777026 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5afc029360 con 0x7f5b0009d450 2023-09-30T22:30:22.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.259+0000 7fa5f5927700 1 Processor -- start 2023-09-30T22:30:22.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.259+0000 7fa5f5927700 1 -- start start 2023-09-30T22:30:22.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.259+0000 7fa5f5927700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa5f009fbb0 0x7fa5f006c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.259+0000 7fa5f5927700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5f0139380 0x7fa5f013b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.259+0000 7fa5f5927700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f006e3f0 con 0x7fa5f006ced0 2023-09-30T22:30:22.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.259+0000 7fa5f5927700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5f009ff80 con 0x7fa5f009fbb0 2023-09-30T22:30:22.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.259+0000 7fa5f5927700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f006ec40 con 0x7fa5f0139380 2023-09-30T22:30:22.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.260+0000 7fa5ef7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5f0139380 0x7fa5f013b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.260+0000 7fa5ef7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5f0139380 0x7fa5f013b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35656/0 (socket says 172.21.15.40:35656) 2023-09-30T22:30:22.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.260+0000 7fa5ef7fe700 1 -- 172.21.15.40:0/730909782 learned_addr learned my addr 172.21.15.40:0/730909782 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:22.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.260+0000 7fa5eeffd700 1 --2- 172.21.15.40:0/730909782 >> v2:172.21.15.40:3300/0 conn(0x7fa5f009fbb0 0x7fa5f006c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.260+0000 7fa5ef7fe700 1 -- 172.21.15.40:0/730909782 >> v2:172.21.15.40:3300/0 conn(0x7fa5f009fbb0 msgr2=0x7fa5f006c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:22.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.260+0000 7fa5ef7fe700 1 --2- 172.21.15.40:0/730909782 >> v2:172.21.15.40:3300/0 conn(0x7fa5f009fbb0 0x7fa5f006c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.260+0000 7fa5ef7fe700 1 -- 172.21.15.40:0/730909782 >> v1:172.21.15.40:6789/0 conn(0x7fa5f006ced0 legacy=0x7fa5f006d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:22.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.260+0000 7fa5ef7fe700 1 -- 172.21.15.40:0/730909782 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f006d9f0 con 0x7fa5f0139380 2023-09-30T22:30:22.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.260+0000 7fa5ef7fe700 1 --2- 172.21.15.40:0/730909782 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5f0139380 0x7fa5f013b760 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8009e50 tx=0x7fa5e800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ed0d59285a8b93a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:22.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.260+0000 7fa5edffb700 1 -- 172.21.15.40:0/730909782 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e800e070 con 0x7fa5f0139380 2023-09-30T22:30:22.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.260+0000 7fa5edffb700 1 -- 172.21.15.40:0/730909782 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e800b910 con 0x7fa5f0139380 2023-09-30T22:30:22.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.260+0000 7fa5edffb700 1 -- 172.21.15.40:0/730909782 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e800bcc0 con 0x7fa5f0139380 2023-09-30T22:30:22.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.261+0000 7fa5f5927700 1 -- 172.21.15.40:0/730909782 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5f0139380 msgr2=0x7fa5f013b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:22.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.261+0000 7fa5f5927700 1 --2- 172.21.15.40:0/730909782 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5f0139380 0x7fa5f013b760 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8009e50 tx=0x7fa5e800b330 comp rx=0 tx=0).stop 2023-09-30T22:30:22.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.261+0000 7fa5f5927700 1 -- 172.21.15.40:0/730909782 shutdown_connections 2023-09-30T22:30:22.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.261+0000 7fa5f5927700 1 --2- 172.21.15.40:0/730909782 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5f0139380 0x7fa5f013b760 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.261+0000 7fa5f5927700 1 --2- 172.21.15.40:0/730909782 >> v2:172.21.15.40:3300/0 conn(0x7fa5f009fbb0 0x7fa5f006c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.261+0000 7fa5f5927700 1 -- 172.21.15.40:0/730909782 >> 172.21.15.40:0/730909782 conn(0x7fa5f00a41a0 msgr2=0x7fa5f00a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:22.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.261+0000 7fa5f5927700 1 -- 172.21.15.40:0/730909782 shutdown_connections 2023-09-30T22:30:22.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.261+0000 7fa5f5927700 1 -- 172.21.15.40:0/730909782 wait complete. 2023-09-30T22:30:22.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.262+0000 7fa5f5927700 1 Processor -- start 2023-09-30T22:30:22.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.262+0000 7fa5f5927700 1 -- start start 2023-09-30T22:30:22.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.263+0000 7fa5f5927700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5f006ced0 0x7fa5f01385a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.263+0000 7fa5f5927700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5f009fbb0 0x7fa5f0138ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.263+0000 7fa5f5927700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa5f0139380 0x7fa5f0095ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.263+0000 7fa5f5927700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f0094c20 con 0x7fa5f009fbb0 2023-09-30T22:30:22.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.263+0000 7fa5f5927700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f0096c00 con 0x7fa5f006ced0 2023-09-30T22:30:22.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.263+0000 7fa5f5927700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f00935a0 con 0x7fa5f0139380 2023-09-30T22:30:22.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.263+0000 7fa5eeffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5f006ced0 0x7fa5f01385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.263+0000 7fa5eeffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5f006ced0 0x7fa5f01385a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35662/0 (socket says 172.21.15.40:35662) 2023-09-30T22:30:22.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.263+0000 7fa5eeffd700 1 -- 172.21.15.40:0/25668786 learned_addr learned my addr 172.21.15.40:0/25668786 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:22.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.263+0000 7fa5ef7fe700 1 --2- 172.21.15.40:0/25668786 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa5f0139380 0x7fa5f0095ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.263+0000 7fa5ee7fc700 1 --2- 172.21.15.40:0/25668786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5f009fbb0 0x7fa5f0138ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.263+0000 7fa5eeffd700 1 -- 172.21.15.40:0/25668786 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa5f0139380 msgr2=0x7fa5f0095ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:22.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.263+0000 7fa5eeffd700 1 --2- 172.21.15.40:0/25668786 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa5f0139380 0x7fa5f0095ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.263+0000 7fa5eeffd700 1 -- 172.21.15.40:0/25668786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5f009fbb0 msgr2=0x7fa5f0138ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:22.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.263+0000 7fa5eeffd700 1 --2- 172.21.15.40:0/25668786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5f009fbb0 0x7fa5f0138ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.263+0000 7fa5eeffd700 1 -- 172.21.15.40:0/25668786 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e8009b30 con 0x7fa5f006ced0 2023-09-30T22:30:22.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.263+0000 7fa5ee7fc700 1 --2- 172.21.15.40:0/25668786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5f009fbb0 0x7fa5f0138ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:22.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.264+0000 7fa5eeffd700 1 --2- 172.21.15.40:0/25668786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5f006ced0 0x7fa5f01385a0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fa5e000e9e0 tx=0x7fa5e000ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:22.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.264+0000 7fa5d7fff700 1 -- 172.21.15.40:0/25668786 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0009710 con 0x7fa5f006ced0 2023-09-30T22:30:22.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.264+0000 7fa5f5927700 1 -- 172.21.15.40:0/25668786 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f0071320 con 0x7fa5f006ced0 2023-09-30T22:30:22.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.264+0000 7fa5d7fff700 1 -- 172.21.15.40:0/25668786 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e000c850 con 0x7fa5f006ced0 2023-09-30T22:30:22.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.264+0000 7fa5d7fff700 1 -- 172.21.15.40:0/25668786 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e000cbc0 con 0x7fa5f006ced0 2023-09-30T22:30:22.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.264+0000 7fa5f5927700 1 -- 172.21.15.40:0/25668786 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f0094f00 con 0x7fa5f006ced0 2023-09-30T22:30:22.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.265+0000 7fa5f5927700 1 -- 172.21.15.40:0/25668786 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f0062380 con 0x7fa5f006ced0 2023-09-30T22:30:22.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.265+0000 7fa5d7fff700 1 -- 172.21.15.40:0/25668786 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa5e000cd20 con 0x7fa5f006ced0 2023-09-30T22:30:22.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.265+0000 7fa5d7fff700 1 -- 172.21.15.40:0/25668786 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa5e003f8a0 con 0x7fa5f006ced0 2023-09-30T22:30:22.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.274+0000 7fa5d7fff700 1 -- 172.21.15.40:0/25668786 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa5e001be10 con 0x7fa5f006ced0 2023-09-30T22:30:22.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.300+0000 7fa25be68700 1 Processor -- start 2023-09-30T22:30:22.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.300+0000 7fa25be68700 1 -- start start 2023-09-30T22:30:22.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.301+0000 7fa25be68700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa25409c890 0x7fa25409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.301+0000 7fa25be68700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa25409e480 0x7fa25413bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.301+0000 7fa25be68700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2540a2600 con 0x7fa25409d920 2023-09-30T22:30:22.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.301+0000 7fa25be68700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2540a29d0 con 0x7fa25409e480 2023-09-30T22:30:22.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.301+0000 7fa25be68700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa25409fb40 con 0x7fa25409c890 2023-09-30T22:30:22.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.301+0000 7fa25a405700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa25409e480 0x7fa25413bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.301+0000 7fa25a405700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa25409e480 0x7fa25413bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46662/0 (socket says 172.21.15.40:46662) 2023-09-30T22:30:22.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.301+0000 7fa259c04700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa25409c890 0x7fa25409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.301+0000 7fa25a405700 1 -- 172.21.15.40:0/276418406 learned_addr learned my addr 172.21.15.40:0/276418406 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:22.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.301+0000 7fa259c04700 1 -- 172.21.15.40:0/276418406 >> v2:172.21.15.40:3300/0 conn(0x7fa25409e480 msgr2=0x7fa25413bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:22.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.301+0000 7fa259c04700 1 --2- 172.21.15.40:0/276418406 >> v2:172.21.15.40:3300/0 conn(0x7fa25409e480 0x7fa25413bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.301+0000 7fa259c04700 1 -- 172.21.15.40:0/276418406 >> v1:172.21.15.40:6789/0 conn(0x7fa25409d920 legacy=0x7fa25409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:22.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.301+0000 7fa259c04700 1 -- 172.21.15.40:0/276418406 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa25409fed0 con 0x7fa25409c890 2023-09-30T22:30:22.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.301+0000 7fa25a405700 1 --2- 172.21.15.40:0/276418406 >> v2:172.21.15.40:3300/0 conn(0x7fa25409e480 0x7fa25413bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:22.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.302+0000 7fa259c04700 1 --2- 172.21.15.40:0/276418406 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa25409c890 0x7fa25409cc60 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fa250009830 tx=0x7fa250009b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e804a36070f55b86 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:22.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.302+0000 7fa258c02700 1 -- 172.21.15.40:0/276418406 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa250011830 con 0x7fa25409c890 2023-09-30T22:30:22.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.302+0000 7fa258c02700 1 -- 172.21.15.40:0/276418406 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa250011990 con 0x7fa25409c890 2023-09-30T22:30:22.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.302+0000 7fa258c02700 1 -- 172.21.15.40:0/276418406 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa250011d40 con 0x7fa25409c890 2023-09-30T22:30:22.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.302+0000 7fa25be68700 1 -- 172.21.15.40:0/276418406 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa25409c890 msgr2=0x7fa25409cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:22.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.302+0000 7fa25be68700 1 --2- 172.21.15.40:0/276418406 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa25409c890 0x7fa25409cc60 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fa250009830 tx=0x7fa250009b40 comp rx=0 tx=0).stop 2023-09-30T22:30:22.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.303+0000 7fa25be68700 1 -- 172.21.15.40:0/276418406 shutdown_connections 2023-09-30T22:30:22.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.303+0000 7fa25be68700 1 --2- 172.21.15.40:0/276418406 >> v2:172.21.15.40:3300/0 conn(0x7fa25409e480 0x7fa25413bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.303+0000 7fa25be68700 1 --2- 172.21.15.40:0/276418406 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa25409c890 0x7fa25409cc60 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.303+0000 7fa25be68700 1 -- 172.21.15.40:0/276418406 >> 172.21.15.40:0/276418406 conn(0x7fa2540a7080 msgr2=0x7fa2540a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:22.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.303+0000 7fa25be68700 1 -- 172.21.15.40:0/276418406 shutdown_connections 2023-09-30T22:30:22.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.303+0000 7fa25be68700 1 -- 172.21.15.40:0/276418406 wait complete. 2023-09-30T22:30:22.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.304+0000 7fa25be68700 1 Processor -- start 2023-09-30T22:30:22.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.304+0000 7fa25be68700 1 -- start start 2023-09-30T22:30:22.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.304+0000 7fa25be68700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa25409c890 0x7fa25412d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.304+0000 7fa25be68700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa25409d920 0x7fa25412db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.304+0000 7fa25be68700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa25409e480 0x7fa25412e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.304+0000 7fa25be68700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa254130ab0 con 0x7fa25409d920 2023-09-30T22:30:22.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.304+0000 7fa25be68700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa254130fe0 con 0x7fa25409c890 2023-09-30T22:30:22.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.304+0000 7fa25be68700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa25412f660 con 0x7fa25409e480 2023-09-30T22:30:22.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.304+0000 7fa259403700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa25409d920 0x7fa25412db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.304+0000 7fa259403700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa25409d920 0x7fa25412db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46670/0 (socket says 172.21.15.40:46670) 2023-09-30T22:30:22.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.304+0000 7fa259403700 1 -- 172.21.15.40:0/3735741617 learned_addr learned my addr 172.21.15.40:0/3735741617 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:22.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.304+0000 7fa25a405700 1 --2- 172.21.15.40:0/3735741617 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa25409e480 0x7fa25412e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.305+0000 7fa259c04700 1 --2- 172.21.15.40:0/3735741617 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa25409c890 0x7fa25412d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.305+0000 7fa25a405700 1 -- 172.21.15.40:0/3735741617 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa25409c890 msgr2=0x7fa25412d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:22.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.305+0000 7fa25a405700 1 --2- 172.21.15.40:0/3735741617 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa25409c890 0x7fa25412d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.305+0000 7fa25a405700 1 -- 172.21.15.40:0/3735741617 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa25409d920 msgr2=0x7fa25412db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:22.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.305+0000 7fa25a405700 1 --2- 172.21.15.40:0/3735741617 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa25409d920 0x7fa25412db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.305+0000 7fa25a405700 1 -- 172.21.15.40:0/3735741617 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24c009b30 con 0x7fa25409e480 2023-09-30T22:30:22.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.305+0000 7fa259403700 1 --2- 172.21.15.40:0/3735741617 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa25409d920 0x7fa25412db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:22.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.305+0000 7fa259c04700 1 --2- 172.21.15.40:0/3735741617 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa25409c890 0x7fa25412d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:30:22.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.305+0000 7fa25a405700 1 --2- 172.21.15.40:0/3735741617 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa25409e480 0x7fa25412e090 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fa24c00efc0 tx=0x7fa24c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:22.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.305+0000 7fa24a7fc700 1 -- 172.21.15.40:0/3735741617 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24c018070 con 0x7fa25409e480 2023-09-30T22:30:22.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.305+0000 7fa24a7fc700 1 -- 172.21.15.40:0/3735741617 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24c00f040 con 0x7fa25409e480 2023-09-30T22:30:22.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.305+0000 7fa25be68700 1 -- 172.21.15.40:0/3735741617 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa250009440 con 0x7fa25409e480 2023-09-30T22:30:22.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.305+0000 7fa24a7fc700 1 -- 172.21.15.40:0/3735741617 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24c003c60 con 0x7fa25409e480 2023-09-30T22:30:22.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.305+0000 7fa25be68700 1 -- 172.21.15.40:0/3735741617 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa25408f650 con 0x7fa25409e480 2023-09-30T22:30:22.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.306+0000 7fa24a7fc700 1 -- 172.21.15.40:0/3735741617 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa24c00c930 con 0x7fa25409e480 2023-09-30T22:30:22.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.306+0000 7fa25be68700 1 -- 172.21.15.40:0/3735741617 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa254062380 con 0x7fa25409e480 2023-09-30T22:30:22.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.306+0000 7fa24a7fc700 1 -- 172.21.15.40:0/3735741617 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa24c03f850 con 0x7fa25409e480 2023-09-30T22:30:22.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.311+0000 7fa24a7fc700 1 -- 172.21.15.40:0/3735741617 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa24c003dc0 con 0x7fa25409e480 2023-09-30T22:30:22.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.403+0000 7f5b077ab700 1 -- 172.21.15.40:0/3622777026 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5b00074330 con 0x7f5b0009d450 2023-09-30T22:30:22.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.404+0000 7f5af5ffb700 1 -- 172.21.15.40:0/3622777026 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5afc026090 con 0x7f5b0009d450 2023-09-30T22:30:22.404 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:22.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.406+0000 7f5b077ab700 1 -- 172.21.15.40:0/3622777026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b0009d450 msgr2=0x7f5b001c83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:22.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.406+0000 7f5b077ab700 1 --2- 172.21.15.40:0/3622777026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b0009d450 0x7f5b001c83a0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f5afc000c00 tx=0x7f5afc0047c0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.406+0000 7f5b077ab700 1 -- 172.21.15.40:0/3622777026 shutdown_connections 2023-09-30T22:30:22.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.406+0000 7f5b077ab700 1 --2- 172.21.15.40:0/3622777026 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5b00130700 0x7f5b001c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.406+0000 7f5b077ab700 1 --2- 172.21.15.40:0/3622777026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b0009d450 0x7f5b001c83a0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.406+0000 7f5b077ab700 1 --2- 172.21.15.40:0/3622777026 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b0009dd60 0x7f5b001c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.406+0000 7f5b077ab700 1 -- 172.21.15.40:0/3622777026 >> 172.21.15.40:0/3622777026 conn(0x7f5b000a2a00 msgr2=0x7f5b001b7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:22.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.406+0000 7f5b077ab700 1 -- 172.21.15.40:0/3622777026 shutdown_connections 2023-09-30T22:30:22.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.406+0000 7f5b077ab700 1 -- 172.21.15.40:0/3622777026 wait complete. 2023-09-30T22:30:22.419 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:22.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.474+0000 7fa5f5927700 1 -- 172.21.15.40:0/25668786 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa5f0094d60 con 0x7fa5f006ced0 2023-09-30T22:30:22.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.474+0000 7fa5d7fff700 1 -- 172.21.15.40:0/25668786 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa5f0094d60 con 0x7fa5f006ced0 2023-09-30T22:30:22.475 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:22.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.476+0000 7fa5f5927700 1 -- 172.21.15.40:0/25668786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5f006ced0 msgr2=0x7fa5f01385a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:22.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.476+0000 7fa5f5927700 1 --2- 172.21.15.40:0/25668786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5f006ced0 0x7fa5f01385a0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fa5e000e9e0 tx=0x7fa5e000ecf0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.476+0000 7fa5f5927700 1 -- 172.21.15.40:0/25668786 shutdown_connections 2023-09-30T22:30:22.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.476+0000 7fa5f5927700 1 --2- 172.21.15.40:0/25668786 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa5f0139380 0x7fa5f0095ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.476+0000 7fa5f5927700 1 --2- 172.21.15.40:0/25668786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5f006ced0 0x7fa5f01385a0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.476+0000 7fa5f5927700 1 --2- 172.21.15.40:0/25668786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5f009fbb0 0x7fa5f0138ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.476+0000 7fa5f5927700 1 -- 172.21.15.40:0/25668786 >> 172.21.15.40:0/25668786 conn(0x7fa5f00a41a0 msgr2=0x7fa5f006f730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:22.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.477+0000 7fa5f5927700 1 -- 172.21.15.40:0/25668786 shutdown_connections 2023-09-30T22:30:22.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.477+0000 7fa5f5927700 1 -- 172.21.15.40:0/25668786 wait complete. 2023-09-30T22:30:22.489 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:22.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.509+0000 7fa25be68700 1 -- 172.21.15.40:0/3735741617 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa2540a5840 con 0x7fa25409e480 2023-09-30T22:30:22.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.510+0000 7fa24a7fc700 1 -- 172.21.15.40:0/3735741617 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa24c02e010 con 0x7fa25409e480 2023-09-30T22:30:22.510 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:22.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.512+0000 7fa25be68700 1 -- 172.21.15.40:0/3735741617 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa25409e480 msgr2=0x7fa25412e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:22.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.512+0000 7fa25be68700 1 --2- 172.21.15.40:0/3735741617 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa25409e480 0x7fa25412e090 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fa24c00efc0 tx=0x7fa24c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.512+0000 7fa25be68700 1 -- 172.21.15.40:0/3735741617 shutdown_connections 2023-09-30T22:30:22.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.512+0000 7fa25be68700 1 --2- 172.21.15.40:0/3735741617 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa25409e480 0x7fa25412e090 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.512+0000 7fa25be68700 1 --2- 172.21.15.40:0/3735741617 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa25409c890 0x7fa25412d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.512+0000 7fa25be68700 1 --2- 172.21.15.40:0/3735741617 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa25409d920 0x7fa25412db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.512+0000 7fa25be68700 1 -- 172.21.15.40:0/3735741617 >> 172.21.15.40:0/3735741617 conn(0x7fa2540a7080 msgr2=0x7fa2540a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:22.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.512+0000 7fa25be68700 1 -- 172.21.15.40:0/3735741617 shutdown_connections 2023-09-30T22:30:22.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.512+0000 7fa25be68700 1 -- 172.21.15.40:0/3735741617 wait complete. 2023-09-30T22:30:22.524 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:22.662 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:22.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.789+0000 7f9f8f71a700 1 Processor -- start 2023-09-30T22:30:22.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.789+0000 7f9f8f71a700 1 -- start start 2023-09-30T22:30:22.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.789+0000 7f9f8f71a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f8812e780 0x7f9f8812eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.789+0000 7f9f8f71a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f881316b0 0x7f9f88131ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.789+0000 7f9f8f71a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9f88132020 0x7f9f881389e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.789+0000 7f9f8f71a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f881324c0 con 0x7f9f88132020 2023-09-30T22:30:22.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.789+0000 7f9f8f71a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8812f090 con 0x7f9f8812e780 2023-09-30T22:30:22.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.789+0000 7f9f8f71a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8812e560 con 0x7f9f881316b0 2023-09-30T22:30:22.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.789+0000 7f9f8d4b6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f8812e780 0x7f9f8812eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.789+0000 7f9f8ccb5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f881316b0 0x7f9f88131ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.789+0000 7f9f8dcb7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9f88132020 0x7f9f881389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.790+0000 7f9f8ccb5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f881316b0 0x7f9f88131ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:47976/0 (socket says 172.21.15.40:47976) 2023-09-30T22:30:22.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.790+0000 7f9f8dcb7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9f88132020 0x7f9f881389e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46678/0 (socket says 172.21.15.40:46678) 2023-09-30T22:30:22.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.790+0000 7f9f8d4b6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f8812e780 0x7f9f8812eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:35680/0 (socket says 172.21.15.40:35680) 2023-09-30T22:30:22.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.790+0000 7f9f8ccb5700 1 -- 172.21.15.40:0/4261840642 learned_addr learned my addr 172.21.15.40:0/4261840642 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:22.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.790+0000 7f9f8dcb7700 1 -- 172.21.15.40:0/4261840642 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f881316b0 msgr2=0x7f9f88131ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:22.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.790+0000 7f9f8dcb7700 1 --2- 172.21.15.40:0/4261840642 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f881316b0 0x7f9f88131ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.790+0000 7f9f8dcb7700 1 -- 172.21.15.40:0/4261840642 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f8812e780 msgr2=0x7f9f8812eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:22.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.790+0000 7f9f8dcb7700 1 --2- 172.21.15.40:0/4261840642 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f8812e780 0x7f9f8812eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.790+0000 7f9f8dcb7700 1 -- 172.21.15.40:0/4261840642 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8809b220 con 0x7f9f88132020 2023-09-30T22:30:22.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.790+0000 7f9f8ccb5700 1 --2- 172.21.15.40:0/4261840642 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f881316b0 0x7f9f88131ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:22.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.790+0000 7f9f8d4b6700 1 --2- 172.21.15.40:0/4261840642 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f8812e780 0x7f9f8812eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:22.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.790+0000 7f9f8dcb7700 1 --2- 172.21.15.40:0/4261840642 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f88132020 0x7f9f881389e0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f9f80009d90 tx=0x7f9f8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a5e1ecd68f9c541 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:22.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.790+0000 7f9f7ffff700 1 -- 172.21.15.40:0/4261840642 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8000e070 con 0x7f9f88132020 2023-09-30T22:30:22.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.790+0000 7f9f7ffff700 1 -- 172.21.15.40:0/4261840642 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8000bb20 con 0x7f9f88132020 2023-09-30T22:30:22.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.790+0000 7f9f7ffff700 1 -- 172.21.15.40:0/4261840642 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f80012430 con 0x7f9f88132020 2023-09-30T22:30:22.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.791+0000 7f9f8f71a700 1 -- 172.21.15.40:0/4261840642 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f88132020 msgr2=0x7f9f881389e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:22.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.791+0000 7f9f8f71a700 1 --2- 172.21.15.40:0/4261840642 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f88132020 0x7f9f881389e0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f9f80009d90 tx=0x7f9f8000b330 comp rx=0 tx=0).stop 2023-09-30T22:30:22.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.791+0000 7f9f8f71a700 1 -- 172.21.15.40:0/4261840642 shutdown_connections 2023-09-30T22:30:22.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.791+0000 7f9f8f71a700 1 --2- 172.21.15.40:0/4261840642 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f88132020 0x7f9f881389e0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.791+0000 7f9f8f71a700 1 --2- 172.21.15.40:0/4261840642 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f8812e780 0x7f9f8812eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.791+0000 7f9f8f71a700 1 --2- 172.21.15.40:0/4261840642 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f881316b0 0x7f9f88131ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.791+0000 7f9f8f71a700 1 -- 172.21.15.40:0/4261840642 >> 172.21.15.40:0/4261840642 conn(0x7f9f8809eb10 msgr2=0x7f9f8809ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:22.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.791+0000 7f9f8f71a700 1 -- 172.21.15.40:0/4261840642 shutdown_connections 2023-09-30T22:30:22.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.791+0000 7f9f8f71a700 1 -- 172.21.15.40:0/4261840642 wait complete. 2023-09-30T22:30:22.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.792+0000 7f9f8f71a700 1 Processor -- start 2023-09-30T22:30:22.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.792+0000 7f9f8f71a700 1 -- start start 2023-09-30T22:30:22.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.793+0000 7f9f8f71a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f8812e780 0x7f9f88098470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.793+0000 7f9f8f71a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f881316b0 0x7f9f880989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.793+0000 7f9f8f71a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f88132020 0x7f9f8806cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:22.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.793+0000 7f9f8f71a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8812c860 con 0x7f9f881316b0 2023-09-30T22:30:22.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.793+0000 7f9f8f71a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8812b3f0 con 0x7f9f88132020 2023-09-30T22:30:22.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.793+0000 7f9f8f71a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8812d440 con 0x7f9f8812e780 2023-09-30T22:30:22.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.793+0000 7f9f8d4b6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f8812e780 0x7f9f88098470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.793+0000 7f9f8d4b6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f8812e780 0x7f9f88098470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:47980/0 (socket says 172.21.15.40:47980) 2023-09-30T22:30:22.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.793+0000 7f9f8dcb7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f88132020 0x7f9f8806cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.793+0000 7f9f8d4b6700 1 -- 172.21.15.40:0/901676779 learned_addr learned my addr 172.21.15.40:0/901676779 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:22.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.793+0000 7f9f8ccb5700 1 --2- 172.21.15.40:0/901676779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f881316b0 0x7f9f880989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:22.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.793+0000 7f9f8d4b6700 1 -- 172.21.15.40:0/901676779 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f88132020 msgr2=0x7f9f8806cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:22.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.793+0000 7f9f8d4b6700 1 --2- 172.21.15.40:0/901676779 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f88132020 0x7f9f8806cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.793+0000 7f9f8d4b6700 1 -- 172.21.15.40:0/901676779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f881316b0 msgr2=0x7f9f880989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:22.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.793+0000 7f9f8d4b6700 1 --2- 172.21.15.40:0/901676779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f881316b0 0x7f9f880989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.793+0000 7f9f8d4b6700 1 -- 172.21.15.40:0/901676779 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f84009430 con 0x7f9f8812e780 2023-09-30T22:30:22.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.793+0000 7f9f8dcb7700 1 --2- 172.21.15.40:0/901676779 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f88132020 0x7f9f8806cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:22.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.793+0000 7f9f8ccb5700 1 --2- 172.21.15.40:0/901676779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f881316b0 0x7f9f880989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:22.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.793+0000 7f9f8d4b6700 1 --2- 172.21.15.40:0/901676779 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f8812e780 0x7f9f88098470 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f9f8400ebe0 tx=0x7f9f8400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:22.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.793+0000 7f9f7dffb700 1 -- 172.21.15.40:0/901676779 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f84009740 con 0x7f9f8812e780 2023-09-30T22:30:22.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.794+0000 7f9f7dffb700 1 -- 172.21.15.40:0/901676779 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f84005a20 con 0x7f9f8812e780 2023-09-30T22:30:22.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.794+0000 7f9f8f71a700 1 -- 172.21.15.40:0/901676779 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f78009550 con 0x7f9f8812e780 2023-09-30T22:30:22.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.794+0000 7f9f7dffb700 1 -- 172.21.15.40:0/901676779 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f84005db0 con 0x7f9f8812e780 2023-09-30T22:30:22.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.794+0000 7f9f8f71a700 1 -- 172.21.15.40:0/901676779 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f80009a70 con 0x7f9f8812e780 2023-09-30T22:30:22.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.794+0000 7f9f7dffb700 1 -- 172.21.15.40:0/901676779 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9f8400c850 con 0x7f9f8812e780 2023-09-30T22:30:22.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.794+0000 7f9f7dffb700 1 -- 172.21.15.40:0/901676779 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9f8403f8d0 con 0x7f9f8812e780 2023-09-30T22:30:22.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.795+0000 7f9f8f71a700 1 -- 172.21.15.40:0/901676779 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f88130550 con 0x7f9f8812e780 2023-09-30T22:30:22.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.799+0000 7f9f7dffb700 1 -- 172.21.15.40:0/901676779 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9f84006030 con 0x7f9f8812e780 2023-09-30T22:30:22.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.994+0000 7f9f8f71a700 1 -- 172.21.15.40:0/901676779 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9f88062380 con 0x7f9f8812e780 2023-09-30T22:30:22.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.995+0000 7f9f7dffb700 1 -- 172.21.15.40:0/901676779 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9f8402a090 con 0x7f9f8812e780 2023-09-30T22:30:22.996 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:22.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.997+0000 7f9f8f71a700 1 -- 172.21.15.40:0/901676779 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f8812e780 msgr2=0x7f9f88098470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:22.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.997+0000 7f9f8f71a700 1 --2- 172.21.15.40:0/901676779 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f8812e780 0x7f9f88098470 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f9f8400ebe0 tx=0x7f9f8400eef0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.997+0000 7f9f8f71a700 1 -- 172.21.15.40:0/901676779 shutdown_connections 2023-09-30T22:30:22.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.997+0000 7f9f8f71a700 1 --2- 172.21.15.40:0/901676779 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f8812e780 0x7f9f88098470 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.997+0000 7f9f8f71a700 1 --2- 172.21.15.40:0/901676779 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f88132020 0x7f9f8806cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.997+0000 7f9f8f71a700 1 --2- 172.21.15.40:0/901676779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f881316b0 0x7f9f880989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:22.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.997+0000 7f9f8f71a700 1 -- 172.21.15.40:0/901676779 >> 172.21.15.40:0/901676779 conn(0x7f9f8809eb10 msgr2=0x7f9f880a00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:22.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.997+0000 7f9f8f71a700 1 -- 172.21.15.40:0/901676779 shutdown_connections 2023-09-30T22:30:22.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:22.997+0000 7f9f8f71a700 1 -- 172.21.15.40:0/901676779 wait complete. 2023-09-30T22:30:23.010 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:23.420 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:23.490 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:23.525 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:23.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.550+0000 7fdd3616b700 1 Processor -- start 2023-09-30T22:30:23.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.550+0000 7fdd3616b700 1 -- start start 2023-09-30T22:30:23.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.550+0000 7fdd3616b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd3012e590 0x7fdd3012e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:23.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.550+0000 7fdd3616b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdd3012d8a0 0x7fdd30138c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:23.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.550+0000 7fdd3616b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd3009ab70 con 0x7fdd3012eea0 2023-09-30T22:30:23.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.550+0000 7fdd3616b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd3009b270 con 0x7fdd3012d8a0 2023-09-30T22:30:23.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.550+0000 7fdd3616b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3009bab0 con 0x7fdd3012e590 2023-09-30T22:30:23.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.550+0000 7fdd2f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd3012e590 0x7fdd3012e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:23.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.550+0000 7fdd2f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd3012e590 0x7fdd3012e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:33940/0 (socket says 172.21.15.40:33940) 2023-09-30T22:30:23.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.551+0000 7fdd2f7fe700 1 -- 172.21.15.40:0/1638615605 learned_addr learned my addr 172.21.15.40:0/1638615605 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:23.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.551+0000 7fdd2ffff700 1 --2- 172.21.15.40:0/1638615605 >> v2:172.21.15.40:3300/0 conn(0x7fdd3012d8a0 0x7fdd30138c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:23.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.551+0000 7fdd2f7fe700 1 -- 172.21.15.40:0/1638615605 >> v2:172.21.15.40:3300/0 conn(0x7fdd3012d8a0 msgr2=0x7fdd30138c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:23.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.551+0000 7fdd2f7fe700 1 --2- 172.21.15.40:0/1638615605 >> v2:172.21.15.40:3300/0 conn(0x7fdd3012d8a0 0x7fdd30138c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.551+0000 7fdd2f7fe700 1 -- 172.21.15.40:0/1638615605 >> v1:172.21.15.40:6789/0 conn(0x7fdd3012eea0 legacy=0x7fdd3012d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:23.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.551+0000 7fdd2f7fe700 1 -- 172.21.15.40:0/1638615605 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd3009bd70 con 0x7fdd3012e590 2023-09-30T22:30:23.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.551+0000 7fdd2f7fe700 1 --2- 172.21.15.40:0/1638615605 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd3012e590 0x7fdd3012e960 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fdd2000dd40 tx=0x7fdd2000f330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d9e6f9ba2ea7db9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:23.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.551+0000 7fdd2e7fc700 1 -- 172.21.15.40:0/1638615605 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd20012070 con 0x7fdd3012e590 2023-09-30T22:30:23.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.551+0000 7fdd2e7fc700 1 -- 172.21.15.40:0/1638615605 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2000de90 con 0x7fdd3012e590 2023-09-30T22:30:23.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.551+0000 7fdd2e7fc700 1 -- 172.21.15.40:0/1638615605 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd20004250 con 0x7fdd3012e590 2023-09-30T22:30:23.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.552+0000 7fdd3616b700 1 -- 172.21.15.40:0/1638615605 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd3012e590 msgr2=0x7fdd3012e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:23.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.552+0000 7fdd3616b700 1 --2- 172.21.15.40:0/1638615605 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd3012e590 0x7fdd3012e960 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fdd2000dd40 tx=0x7fdd2000f330 comp rx=0 tx=0).stop 2023-09-30T22:30:23.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.552+0000 7fdd3616b700 1 -- 172.21.15.40:0/1638615605 shutdown_connections 2023-09-30T22:30:23.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.552+0000 7fdd3616b700 1 --2- 172.21.15.40:0/1638615605 >> v2:172.21.15.40:3300/0 conn(0x7fdd3012d8a0 0x7fdd30138c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.552+0000 7fdd3616b700 1 --2- 172.21.15.40:0/1638615605 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd3012e590 0x7fdd3012e960 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.552+0000 7fdd3616b700 1 -- 172.21.15.40:0/1638615605 >> 172.21.15.40:0/1638615605 conn(0x7fdd300a2a00 msgr2=0x7fdd300a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:23.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.552+0000 7fdd3616b700 1 -- 172.21.15.40:0/1638615605 shutdown_connections 2023-09-30T22:30:23.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.552+0000 7fdd3616b700 1 -- 172.21.15.40:0/1638615605 wait complete. 2023-09-30T22:30:23.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.553+0000 7fdd3616b700 1 Processor -- start 2023-09-30T22:30:23.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.553+0000 7fdd3616b700 1 -- start start 2023-09-30T22:30:23.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.553+0000 7fdd3616b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdd3012d8a0 0x7fdd301199a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:23.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.553+0000 7fdd3616b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd3012e590 0x7fdd30119ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:23.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.553+0000 7fdd3616b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd3012eea0 0x7fdd3011a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:23.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.553+0000 7fdd3616b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3011ae30 con 0x7fdd3012e590 2023-09-30T22:30:23.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.553+0000 7fdd3616b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3011b5b0 con 0x7fdd3012eea0 2023-09-30T22:30:23.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.553+0000 7fdd3616b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3011bbd0 con 0x7fdd3012d8a0 2023-09-30T22:30:23.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.554+0000 7fdd2f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdd3012d8a0 0x7fdd301199a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:23.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.554+0000 7fdd2ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd3012eea0 0x7fdd3011a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:23.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.554+0000 7fdd2f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdd3012d8a0 0x7fdd301199a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51316/0 (socket says 172.21.15.40:51316) 2023-09-30T22:30:23.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.554+0000 7fdd2ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd3012eea0 0x7fdd3011a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:33944/0 (socket says 172.21.15.40:33944) 2023-09-30T22:30:23.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.554+0000 7fdd2f7fe700 1 -- 172.21.15.40:0/3942252708 learned_addr learned my addr 172.21.15.40:0/3942252708 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:23.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.554+0000 7fdd2effd700 1 --2- 172.21.15.40:0/3942252708 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd3012e590 0x7fdd30119ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:23.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.554+0000 7fdd2ffff700 1 -- 172.21.15.40:0/3942252708 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdd3012d8a0 msgr2=0x7fdd301199a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:23.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.554+0000 7fdd2ffff700 1 --2- 172.21.15.40:0/3942252708 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdd3012d8a0 0x7fdd301199a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.554+0000 7fdd2ffff700 1 -- 172.21.15.40:0/3942252708 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd3012e590 msgr2=0x7fdd30119ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:23.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.554+0000 7fdd2ffff700 1 --2- 172.21.15.40:0/3942252708 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd3012e590 0x7fdd30119ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.554+0000 7fdd2ffff700 1 -- 172.21.15.40:0/3942252708 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd2000d9f0 con 0x7fdd3012eea0 2023-09-30T22:30:23.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.554+0000 7fdd2effd700 1 --2- 172.21.15.40:0/3942252708 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd3012e590 0x7fdd30119ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:23.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.554+0000 7fdd2ffff700 1 --2- 172.21.15.40:0/3942252708 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd3012eea0 0x7fdd3011a420 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fdd28009d90 tx=0x7fdd2800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:23.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.554+0000 7fdd17fff700 1 -- 172.21.15.40:0/3942252708 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd28009c00 con 0x7fdd3012eea0 2023-09-30T22:30:23.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.554+0000 7fdd17fff700 1 -- 172.21.15.40:0/3942252708 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2800f040 con 0x7fdd3012eea0 2023-09-30T22:30:23.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.554+0000 7fdd3616b700 1 -- 172.21.15.40:0/3942252708 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd3011d1e0 con 0x7fdd3012eea0 2023-09-30T22:30:23.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.554+0000 7fdd17fff700 1 -- 172.21.15.40:0/3942252708 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd28014480 con 0x7fdd3012eea0 2023-09-30T22:30:23.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.555+0000 7fdd3616b700 1 -- 172.21.15.40:0/3942252708 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd3011cca0 con 0x7fdd3012eea0 2023-09-30T22:30:23.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.555+0000 7fdd17fff700 1 -- 172.21.15.40:0/3942252708 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdd280145e0 con 0x7fdd3012eea0 2023-09-30T22:30:23.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.556+0000 7fdd17fff700 1 -- 172.21.15.40:0/3942252708 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fdd28040220 con 0x7fdd3012eea0 2023-09-30T22:30:23.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.556+0000 7fdd3616b700 1 -- 172.21.15.40:0/3942252708 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd3006edb0 con 0x7fdd3012eea0 2023-09-30T22:30:23.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.561+0000 7fdd17fff700 1 -- 172.21.15.40:0/3942252708 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdd28007900 con 0x7fdd3012eea0 2023-09-30T22:30:23.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.623+0000 7f18a0330700 1 Processor -- start 2023-09-30T22:30:23.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.623+0000 7f18a0330700 1 -- start start 2023-09-30T22:30:23.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.624+0000 7f18a0330700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f189809d920 0x7f189809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:23.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.624+0000 7f18a0330700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f189809f0f0 0x7f189809e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:23.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.624+0000 7f18a0330700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f189809f940 con 0x7f1898133ca0 2023-09-30T22:30:23.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.624+0000 7f18a0330700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f189806b4c0 con 0x7f189809f0f0 2023-09-30T22:30:23.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.624+0000 7f18a0330700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f189809a8f0 con 0x7f189809d920 2023-09-30T22:30:23.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.624+0000 7f189e0cc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f189809d920 0x7f189809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:23.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.624+0000 7f189d8cb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f189809f0f0 0x7f189809e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:23.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.624+0000 7f189e0cc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f189809d920 0x7f189809dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:33950/0 (socket says 172.21.15.40:33950) 2023-09-30T22:30:23.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.624+0000 7f189d8cb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f189809f0f0 0x7f189809e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53662/0 (socket says 172.21.15.40:53662) 2023-09-30T22:30:23.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.624+0000 7f189e0cc700 1 -- 172.21.15.40:0/1599449519 learned_addr learned my addr 172.21.15.40:0/1599449519 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:23.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.624+0000 7f189d8cb700 1 -- 172.21.15.40:0/1599449519 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f189809d920 msgr2=0x7f189809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:23.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.624+0000 7f189d8cb700 1 --2- 172.21.15.40:0/1599449519 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f189809d920 0x7f189809dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.624+0000 7f189d8cb700 1 -- 172.21.15.40:0/1599449519 >> v1:172.21.15.40:6789/0 conn(0x7f1898133ca0 legacy=0x7f1898134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:23.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.624+0000 7f189d0ca700 1 -- 172.21.15.40:0/1599449519 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2554688175 0 0) 0x7f189809f940 con 0x7f1898133ca0 2023-09-30T22:30:23.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.624+0000 7f189d8cb700 1 -- 172.21.15.40:0/1599449519 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f189809f6e0 con 0x7f189809f0f0 2023-09-30T22:30:23.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.624+0000 7f189e0cc700 1 --2- 172.21.15.40:0/1599449519 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f189809d920 0x7f189809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:23.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.625+0000 7f189d8cb700 1 --2- 172.21.15.40:0/1599449519 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f189809f0f0 0x7f189809e230 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f1888009870 tx=0x7f1888009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98bf8273a71f79c2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:23.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.625+0000 7f189d0ca700 1 -- 172.21.15.40:0/1599449519 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1888011830 con 0x7f189809f0f0 2023-09-30T22:30:23.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.625+0000 7f189d0ca700 1 -- 172.21.15.40:0/1599449519 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1888011990 con 0x7f189809f0f0 2023-09-30T22:30:23.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.625+0000 7f189d0ca700 1 -- 172.21.15.40:0/1599449519 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1888011d20 con 0x7f189809f0f0 2023-09-30T22:30:23.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.625+0000 7f18a0330700 1 -- 172.21.15.40:0/1599449519 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f189809f0f0 msgr2=0x7f189809e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:23.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.625+0000 7f18a0330700 1 --2- 172.21.15.40:0/1599449519 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f189809f0f0 0x7f189809e230 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f1888009870 tx=0x7f1888009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:23.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.626+0000 7f18a0330700 1 -- 172.21.15.40:0/1599449519 shutdown_connections 2023-09-30T22:30:23.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.626+0000 7f18a0330700 1 --2- 172.21.15.40:0/1599449519 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f189809d920 0x7f189809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.626+0000 7f18a0330700 1 --2- 172.21.15.40:0/1599449519 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f189809f0f0 0x7f189809e230 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.626+0000 7f18a0330700 1 -- 172.21.15.40:0/1599449519 >> 172.21.15.40:0/1599449519 conn(0x7f189809fb20 msgr2=0x7f189809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:23.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.626+0000 7f18a0330700 1 -- 172.21.15.40:0/1599449519 shutdown_connections 2023-09-30T22:30:23.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.626+0000 7f18a0330700 1 -- 172.21.15.40:0/1599449519 wait complete. 2023-09-30T22:30:23.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.627+0000 7f18a0330700 1 Processor -- start 2023-09-30T22:30:23.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.627+0000 7f18a0330700 1 -- start start 2023-09-30T22:30:23.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.628+0000 7f18a0330700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f189809d920 0x7f189811e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:23.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.628+0000 7f18a0330700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1898133ca0 0x7f189811e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:23.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.628+0000 7f18a0330700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1898131720 0x7f189811ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:23.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.628+0000 7f18a0330700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1898121e50 con 0x7f1898131720 2023-09-30T22:30:23.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.628+0000 7f18a0330700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f189809c9e0 con 0x7f189809d920 2023-09-30T22:30:23.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.628+0000 7f18a0330700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18980a2710 con 0x7f1898133ca0 2023-09-30T22:30:23.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.628+0000 7f189e0cc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f189809d920 0x7f189811e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:23.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.628+0000 7f189d8cb700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1898133ca0 0x7f189811e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:23.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.628+0000 7f189e0cc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f189809d920 0x7f189811e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:33954/0 (socket says 172.21.15.40:33954) 2023-09-30T22:30:23.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.628+0000 7f189e0cc700 1 -- 172.21.15.40:0/3875362062 learned_addr learned my addr 172.21.15.40:0/3875362062 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:23.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.628+0000 7f189e8cd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1898131720 0x7f189811ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:23.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.628+0000 7f189d8cb700 1 -- 172.21.15.40:0/3875362062 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f189809d920 msgr2=0x7f189811e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:23.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.628+0000 7f189d8cb700 1 --2- 172.21.15.40:0/3875362062 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f189809d920 0x7f189811e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.628+0000 7f189d8cb700 1 -- 172.21.15.40:0/3875362062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1898131720 msgr2=0x7f189811ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:23.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.628+0000 7f189d8cb700 1 --2- 172.21.15.40:0/3875362062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1898131720 0x7f189811ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.628+0000 7f189d8cb700 1 -- 172.21.15.40:0/3875362062 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1894009500 con 0x7f1898133ca0 2023-09-30T22:30:23.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.628+0000 7f189d8cb700 1 --2- 172.21.15.40:0/3875362062 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1898133ca0 0x7f189811e900 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1898068460 tx=0x7f1888004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:23.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.629+0000 7f188effd700 1 -- 172.21.15.40:0/3875362062 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18880036a0 con 0x7f1898133ca0 2023-09-30T22:30:23.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.629+0000 7f188effd700 1 -- 172.21.15.40:0/3875362062 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188801f070 con 0x7f1898133ca0 2023-09-30T22:30:23.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.629+0000 7f188effd700 1 -- 172.21.15.40:0/3875362062 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1888003a40 con 0x7f1898133ca0 2023-09-30T22:30:23.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.629+0000 7f18a0330700 1 -- 172.21.15.40:0/3875362062 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18880094a0 con 0x7f1898133ca0 2023-09-30T22:30:23.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.629+0000 7f18a0330700 1 -- 172.21.15.40:0/3875362062 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1898120520 con 0x7f1898133ca0 2023-09-30T22:30:23.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.630+0000 7f18a0330700 1 -- 172.21.15.40:0/3875362062 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1898121810 con 0x7f1898133ca0 2023-09-30T22:30:23.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.631+0000 7f188effd700 1 -- 172.21.15.40:0/3875362062 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1888003ba0 con 0x7f1898133ca0 2023-09-30T22:30:23.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.631+0000 7f188effd700 1 -- 172.21.15.40:0/3875362062 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f1888021070 con 0x7f1898133ca0 2023-09-30T22:30:23.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.635+0000 7f188effd700 1 -- 172.21.15.40:0/3875362062 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f188802f760 con 0x7f1898133ca0 2023-09-30T22:30:23.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.666+0000 7f2b919d9700 1 Processor -- start 2023-09-30T22:30:23.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.666+0000 7f2b919d9700 1 -- start start 2023-09-30T22:30:23.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.667+0000 7f2b919d9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2b8c133e00 0x7f2b8c1341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:23.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.667+0000 7f2b919d9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b8c09d400 0x7f2b8c09d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:23.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.667+0000 7f2b919d9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b8c133940 con 0x7f2b8c09dd70 2023-09-30T22:30:23.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.667+0000 7f2b919d9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b8c09f0d0 con 0x7f2b8c133e00 2023-09-30T22:30:23.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.667+0000 7f2b919d9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c133be0 con 0x7f2b8c09d400 2023-09-30T22:30:23.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.667+0000 7f2b8affd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2b8c133e00 0x7f2b8c1341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:23.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.667+0000 7f2b8affd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2b8c133e00 0x7f2b8c1341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53678/0 (socket says 172.21.15.40:53678) 2023-09-30T22:30:23.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.667+0000 7f2b8affd700 1 -- 172.21.15.40:0/2378456120 learned_addr learned my addr 172.21.15.40:0/2378456120 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:23.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.667+0000 7f2b8a7fc700 1 --2- 172.21.15.40:0/2378456120 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b8c09d400 0x7f2b8c09d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:23.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.667+0000 7f2b8affd700 1 -- 172.21.15.40:0/2378456120 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b8c09d400 msgr2=0x7f2b8c09d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:23.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.667+0000 7f2b8affd700 1 --2- 172.21.15.40:0/2378456120 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b8c09d400 0x7f2b8c09d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.667+0000 7f2b8affd700 1 -- 172.21.15.40:0/2378456120 >> v1:172.21.15.40:6789/0 conn(0x7f2b8c09dd70 legacy=0x7f2b8c13ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:23.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.667+0000 7f2b8affd700 1 -- 172.21.15.40:0/2378456120 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8c09a860 con 0x7f2b8c133e00 2023-09-30T22:30:23.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.668+0000 7f2b8affd700 1 --2- 172.21.15.40:0/2378456120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b8c133e00 0x7f2b8c1341d0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c0098f0 tx=0x7f2b7c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35ca91cbb52a4372 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:23.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.668+0000 7f2b89ffb700 1 -- 172.21.15.40:0/2378456120 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c011830 con 0x7f2b8c133e00 2023-09-30T22:30:23.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.668+0000 7f2b89ffb700 1 -- 172.21.15.40:0/2378456120 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7c011990 con 0x7f2b8c133e00 2023-09-30T22:30:23.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.668+0000 7f2b89ffb700 1 -- 172.21.15.40:0/2378456120 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c011d20 con 0x7f2b8c133e00 2023-09-30T22:30:23.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.668+0000 7f2b919d9700 1 -- 172.21.15.40:0/2378456120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b8c133e00 msgr2=0x7f2b8c1341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:23.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.668+0000 7f2b919d9700 1 --2- 172.21.15.40:0/2378456120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b8c133e00 0x7f2b8c1341d0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c0098f0 tx=0x7f2b7c009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:23.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.668+0000 7f2b919d9700 1 -- 172.21.15.40:0/2378456120 shutdown_connections 2023-09-30T22:30:23.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.668+0000 7f2b919d9700 1 --2- 172.21.15.40:0/2378456120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b8c133e00 0x7f2b8c1341d0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.668+0000 7f2b919d9700 1 --2- 172.21.15.40:0/2378456120 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b8c09d400 0x7f2b8c09d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.668+0000 7f2b919d9700 1 -- 172.21.15.40:0/2378456120 >> 172.21.15.40:0/2378456120 conn(0x7f2b8c0a2a00 msgr2=0x7f2b8c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:23.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.668+0000 7f2b919d9700 1 -- 172.21.15.40:0/2378456120 shutdown_connections 2023-09-30T22:30:23.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.668+0000 7f2b919d9700 1 -- 172.21.15.40:0/2378456120 wait complete. 2023-09-30T22:30:23.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.669+0000 7f2b919d9700 1 Processor -- start 2023-09-30T22:30:23.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.670+0000 7f2b919d9700 1 -- start start 2023-09-30T22:30:23.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.670+0000 7f2b919d9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b8c09d400 0x7f2b8c119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:23.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.670+0000 7f2b919d9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b8c09dd70 0x7f2b8c119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:23.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.670+0000 7f2b919d9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2b8c133e00 0x7f2b8c119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:23.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.670+0000 7f2b919d9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c11cd70 con 0x7f2b8c09d400 2023-09-30T22:30:23.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.670+0000 7f2b919d9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c11c3b0 con 0x7f2b8c09dd70 2023-09-30T22:30:23.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.670+0000 7f2b919d9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c11b780 con 0x7f2b8c133e00 2023-09-30T22:30:23.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.670+0000 7f2b8a7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b8c09dd70 0x7f2b8c119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:23.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.670+0000 7f2b8a7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b8c09dd70 0x7f2b8c119590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:33968/0 (socket says 172.21.15.40:33968) 2023-09-30T22:30:23.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.670+0000 7f2b8a7fc700 1 -- 172.21.15.40:0/2793605877 learned_addr learned my addr 172.21.15.40:0/2793605877 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:23.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.670+0000 7f2b8b7fe700 1 --2- 172.21.15.40:0/2793605877 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2b8c133e00 0x7f2b8c119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:23.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.670+0000 7f2b8affd700 1 --2- 172.21.15.40:0/2793605877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b8c09d400 0x7f2b8c119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:23.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.670+0000 7f2b8a7fc700 1 -- 172.21.15.40:0/2793605877 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2b8c133e00 msgr2=0x7f2b8c119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:23.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.670+0000 7f2b8a7fc700 1 --2- 172.21.15.40:0/2793605877 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2b8c133e00 0x7f2b8c119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.670+0000 7f2b8a7fc700 1 -- 172.21.15.40:0/2793605877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b8c09d400 msgr2=0x7f2b8c119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:23.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.670+0000 7f2b8a7fc700 1 --2- 172.21.15.40:0/2793605877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b8c09d400 0x7f2b8c119050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.670+0000 7f2b8a7fc700 1 -- 172.21.15.40:0/2793605877 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7c009550 con 0x7f2b8c09dd70 2023-09-30T22:30:23.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.671+0000 7f2b8a7fc700 1 --2- 172.21.15.40:0/2793605877 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b8c09dd70 0x7f2b8c119590 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000e8d0 tx=0x7f2b8000ebe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:23.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.671+0000 7f2b73fff700 1 -- 172.21.15.40:0/2793605877 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b80009590 con 0x7f2b8c09dd70 2023-09-30T22:30:23.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.671+0000 7f2b73fff700 1 -- 172.21.15.40:0/2793605877 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b80013680 con 0x7f2b8c09dd70 2023-09-30T22:30:23.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.671+0000 7f2b919d9700 1 -- 172.21.15.40:0/2793605877 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b8c12e1a0 con 0x7f2b8c09dd70 2023-09-30T22:30:23.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.671+0000 7f2b919d9700 1 -- 172.21.15.40:0/2793605877 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b8c11a4a0 con 0x7f2b8c09dd70 2023-09-30T22:30:23.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.671+0000 7f2b73fff700 1 -- 172.21.15.40:0/2793605877 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b800139f0 con 0x7f2b8c09dd70 2023-09-30T22:30:23.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.672+0000 7f2b73fff700 1 -- 172.21.15.40:0/2793605877 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2b80013b50 con 0x7f2b8c09dd70 2023-09-30T22:30:23.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.672+0000 7f2b919d9700 1 -- 172.21.15.40:0/2793605877 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b6c0052e0 con 0x7f2b8c09dd70 2023-09-30T22:30:23.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.672+0000 7f2b73fff700 1 -- 172.21.15.40:0/2793605877 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f2b8003f8e0 con 0x7f2b8c09dd70 2023-09-30T22:30:23.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.677+0000 7f2b73fff700 1 -- 172.21.15.40:0/2793605877 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2b8001a9c0 con 0x7f2b8c09dd70 2023-09-30T22:30:23.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.767+0000 7fdd3616b700 1 -- 172.21.15.40:0/3942252708 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdd30062380 con 0x7fdd3012eea0 2023-09-30T22:30:23.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.767+0000 7fdd17fff700 1 -- 172.21.15.40:0/3942252708 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdd2802c090 con 0x7fdd3012eea0 2023-09-30T22:30:23.768 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:23.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.769+0000 7fdd3616b700 1 -- 172.21.15.40:0/3942252708 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd3012eea0 msgr2=0x7fdd3011a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:23.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.770+0000 7fdd3616b700 1 --2- 172.21.15.40:0/3942252708 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd3012eea0 0x7fdd3011a420 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fdd28009d90 tx=0x7fdd2800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.770+0000 7fdd3616b700 1 -- 172.21.15.40:0/3942252708 shutdown_connections 2023-09-30T22:30:23.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.770+0000 7fdd3616b700 1 --2- 172.21.15.40:0/3942252708 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdd3012d8a0 0x7fdd301199a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.770+0000 7fdd3616b700 1 --2- 172.21.15.40:0/3942252708 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd3012eea0 0x7fdd3011a420 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.770+0000 7fdd3616b700 1 --2- 172.21.15.40:0/3942252708 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd3012e590 0x7fdd30119ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.770+0000 7fdd3616b700 1 -- 172.21.15.40:0/3942252708 >> 172.21.15.40:0/3942252708 conn(0x7fdd300a2a00 msgr2=0x7fdd3012c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:23.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.770+0000 7fdd3616b700 1 -- 172.21.15.40:0/3942252708 shutdown_connections 2023-09-30T22:30:23.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.770+0000 7fdd3616b700 1 -- 172.21.15.40:0/3942252708 wait complete. 2023-09-30T22:30:23.783 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:23.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.836+0000 7f18a0330700 1 -- 172.21.15.40:0/3875362062 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f18981219d0 con 0x7f1898133ca0 2023-09-30T22:30:23.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.836+0000 7f188effd700 1 -- 172.21.15.40:0/3875362062 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f18981219d0 con 0x7f1898133ca0 2023-09-30T22:30:23.837 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:23.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.838+0000 7f18a0330700 1 -- 172.21.15.40:0/3875362062 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1898133ca0 msgr2=0x7f189811e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:23.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.838+0000 7f18a0330700 1 --2- 172.21.15.40:0/3875362062 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1898133ca0 0x7f189811e900 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1898068460 tx=0x7f1888004750 comp rx=0 tx=0).stop 2023-09-30T22:30:23.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.838+0000 7f18a0330700 1 -- 172.21.15.40:0/3875362062 shutdown_connections 2023-09-30T22:30:23.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.838+0000 7f18a0330700 1 --2- 172.21.15.40:0/3875362062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1898131720 0x7f189811ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.838+0000 7f18a0330700 1 --2- 172.21.15.40:0/3875362062 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f189809d920 0x7f189811e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.838+0000 7f18a0330700 1 --2- 172.21.15.40:0/3875362062 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1898133ca0 0x7f189811e900 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.838+0000 7f18a0330700 1 -- 172.21.15.40:0/3875362062 >> 172.21.15.40:0/3875362062 conn(0x7f189809fb20 msgr2=0x7f18981333f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:23.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.838+0000 7f18a0330700 1 -- 172.21.15.40:0/3875362062 shutdown_connections 2023-09-30T22:30:23.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.838+0000 7f18a0330700 1 -- 172.21.15.40:0/3875362062 wait complete. 2023-09-30T22:30:23.851 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:23.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.873+0000 7f2b919d9700 1 -- 172.21.15.40:0/2793605877 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2b6c005590 con 0x7f2b8c09dd70 2023-09-30T22:30:23.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.873+0000 7f2b73fff700 1 -- 172.21.15.40:0/2793605877 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2b80021030 con 0x7f2b8c09dd70 2023-09-30T22:30:23.874 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:23.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.875+0000 7f2b919d9700 1 -- 172.21.15.40:0/2793605877 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b8c09dd70 msgr2=0x7f2b8c119590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:23.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.875+0000 7f2b919d9700 1 --2- 172.21.15.40:0/2793605877 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b8c09dd70 0x7f2b8c119590 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000e8d0 tx=0x7f2b8000ebe0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.875+0000 7f2b919d9700 1 -- 172.21.15.40:0/2793605877 shutdown_connections 2023-09-30T22:30:23.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.875+0000 7f2b919d9700 1 --2- 172.21.15.40:0/2793605877 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2b8c133e00 0x7f2b8c119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.875+0000 7f2b919d9700 1 --2- 172.21.15.40:0/2793605877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b8c09d400 0x7f2b8c119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.875+0000 7f2b919d9700 1 --2- 172.21.15.40:0/2793605877 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b8c09dd70 0x7f2b8c119590 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:23.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.875+0000 7f2b919d9700 1 -- 172.21.15.40:0/2793605877 >> 172.21.15.40:0/2793605877 conn(0x7f2b8c0a2a00 msgr2=0x7f2b8c12d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:23.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.875+0000 7f2b919d9700 1 -- 172.21.15.40:0/2793605877 shutdown_connections 2023-09-30T22:30:23.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:23.875+0000 7f2b919d9700 1 -- 172.21.15.40:0/2793605877 wait complete. 2023-09-30T22:30:23.888 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:24.010 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:24.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.137+0000 7fc7aee08700 1 Processor -- start 2023-09-30T22:30:24.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.137+0000 7fc7aee08700 1 -- start start 2023-09-30T22:30:24.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.138+0000 7fc7aee08700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc7a8131d50 0x7fc7a8132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:24.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.138+0000 7fc7aee08700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7a809bc50 0x7fc7a809c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:24.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.138+0000 7fc7aee08700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc7a809c600 0x7fc7a8138ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:24.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.138+0000 7fc7aee08700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7a80719e0 con 0x7fc7a8131d50 2023-09-30T22:30:24.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.138+0000 7fc7aee08700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a8132660 con 0x7fc7a809bc50 2023-09-30T22:30:24.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.138+0000 7fc7aee08700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a809ca50 con 0x7fc7a809c600 2023-09-30T22:30:24.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.138+0000 7fc7acba4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc7a8131d50 0x7fc7a8132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:24.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.138+0000 7fc79ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7a809bc50 0x7fc7a809c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:24.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.138+0000 7fc7ad3a5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc7a809c600 0x7fc7a8138ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:24.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.138+0000 7fc79ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7a809bc50 0x7fc7a809c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:33972/0 (socket says 172.21.15.40:33972) 2023-09-30T22:30:24.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.138+0000 7fc7acba4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc7a8131d50 0x7fc7a8132120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53692/0 (socket says 172.21.15.40:53692) 2023-09-30T22:30:24.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.138+0000 7fc79ffff700 1 -- 172.21.15.40:0/4167045822 learned_addr learned my addr 172.21.15.40:0/4167045822 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:24.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.138+0000 7fc7acba4700 1 -- 172.21.15.40:0/4167045822 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc7a809c600 msgr2=0x7fc7a8138ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:24.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.138+0000 7fc7acba4700 1 --2- 172.21.15.40:0/4167045822 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc7a809c600 0x7fc7a8138ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.138+0000 7fc7acba4700 1 -- 172.21.15.40:0/4167045822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7a809bc50 msgr2=0x7fc7a809c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:24.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.138+0000 7fc7acba4700 1 --2- 172.21.15.40:0/4167045822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7a809bc50 0x7fc7a809c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.139+0000 7fc7acba4700 1 -- 172.21.15.40:0/4167045822 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a8131900 con 0x7fc7a8131d50 2023-09-30T22:30:24.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.139+0000 7fc79ffff700 1 --2- 172.21.15.40:0/4167045822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7a809bc50 0x7fc7a809c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:24.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.139+0000 7fc7ad3a5700 1 --2- 172.21.15.40:0/4167045822 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc7a809c600 0x7fc7a8138ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:24.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.139+0000 7fc7acba4700 1 --2- 172.21.15.40:0/4167045822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7a8131d50 0x7fc7a8132120 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4009840 tx=0x7fc7a4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67f1b4d2bba09d3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:24.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.139+0000 7fc79f7fe700 1 -- 172.21.15.40:0/4167045822 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4011830 con 0x7fc7a8131d50 2023-09-30T22:30:24.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.139+0000 7fc79f7fe700 1 -- 172.21.15.40:0/4167045822 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a4011990 con 0x7fc7a8131d50 2023-09-30T22:30:24.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.139+0000 7fc79f7fe700 1 -- 172.21.15.40:0/4167045822 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4011d20 con 0x7fc7a8131d50 2023-09-30T22:30:24.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.139+0000 7fc7aee08700 1 -- 172.21.15.40:0/4167045822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7a8131d50 msgr2=0x7fc7a8132120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:24.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.139+0000 7fc7aee08700 1 --2- 172.21.15.40:0/4167045822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7a8131d50 0x7fc7a8132120 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4009840 tx=0x7fc7a4009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:24.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.139+0000 7fc7aee08700 1 -- 172.21.15.40:0/4167045822 shutdown_connections 2023-09-30T22:30:24.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.139+0000 7fc7aee08700 1 --2- 172.21.15.40:0/4167045822 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc7a809c600 0x7fc7a8138ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.139+0000 7fc7aee08700 1 --2- 172.21.15.40:0/4167045822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7a8131d50 0x7fc7a8132120 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.139+0000 7fc7aee08700 1 --2- 172.21.15.40:0/4167045822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7a809bc50 0x7fc7a809c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.139+0000 7fc7aee08700 1 -- 172.21.15.40:0/4167045822 >> 172.21.15.40:0/4167045822 conn(0x7fc7a80a2a00 msgr2=0x7fc7a80a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:24.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.140+0000 7fc7aee08700 1 -- 172.21.15.40:0/4167045822 shutdown_connections 2023-09-30T22:30:24.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.140+0000 7fc7aee08700 1 -- 172.21.15.40:0/4167045822 wait complete. 2023-09-30T22:30:24.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.140+0000 7fc7aee08700 1 Processor -- start 2023-09-30T22:30:24.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.140+0000 7fc7aee08700 1 -- start start 2023-09-30T22:30:24.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.141+0000 7fc7aee08700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7a809bc50 0x7fc7a8099a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:24.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.141+0000 7fc7aee08700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc7a809c600 0x7fc7a8099f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:24.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.141+0000 7fc7aee08700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7a8131d50 0x7fc7a809a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:24.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.141+0000 7fc7aee08700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a811e980 con 0x7fc7a809bc50 2023-09-30T22:30:24.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.141+0000 7fc7aee08700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a811e120 con 0x7fc7a8131d50 2023-09-30T22:30:24.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.141+0000 7fc7aee08700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a8129d70 con 0x7fc7a809c600 2023-09-30T22:30:24.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.141+0000 7fc7acba4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7a809bc50 0x7fc7a8099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:24.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.141+0000 7fc7acba4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7a809bc50 0x7fc7a8099a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53706/0 (socket says 172.21.15.40:53706) 2023-09-30T22:30:24.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.141+0000 7fc7ad3a5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7a8131d50 0x7fc7a809a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:24.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.141+0000 7fc7acba4700 1 -- 172.21.15.40:0/1287840031 learned_addr learned my addr 172.21.15.40:0/1287840031 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:24.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.141+0000 7fc79ffff700 1 --2- 172.21.15.40:0/1287840031 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc7a809c600 0x7fc7a8099f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:24.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.141+0000 7fc7ad3a5700 1 -- 172.21.15.40:0/1287840031 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc7a809c600 msgr2=0x7fc7a8099f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:24.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.141+0000 7fc7ad3a5700 1 --2- 172.21.15.40:0/1287840031 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc7a809c600 0x7fc7a8099f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.141+0000 7fc7ad3a5700 1 -- 172.21.15.40:0/1287840031 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7a809bc50 msgr2=0x7fc7a8099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:24.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.141+0000 7fc7ad3a5700 1 --2- 172.21.15.40:0/1287840031 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7a809bc50 0x7fc7a8099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.141+0000 7fc7ad3a5700 1 -- 172.21.15.40:0/1287840031 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc798009550 con 0x7fc7a8131d50 2023-09-30T22:30:24.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.141+0000 7fc79ffff700 1 --2- 172.21.15.40:0/1287840031 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc7a809c600 0x7fc7a8099f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:24.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.141+0000 7fc7acba4700 1 --2- 172.21.15.40:0/1287840031 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7a809bc50 0x7fc7a8099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:24.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.142+0000 7fc7ad3a5700 1 --2- 172.21.15.40:0/1287840031 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7a8131d50 0x7fc7a809a4c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc7a000efc0 tx=0x7fc7a000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:24.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.142+0000 7fc79d7fa700 1 -- 172.21.15.40:0/1287840031 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a0003a20 con 0x7fc7a8131d50 2023-09-30T22:30:24.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.142+0000 7fc79d7fa700 1 -- 172.21.15.40:0/1287840031 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a000f040 con 0x7fc7a8131d50 2023-09-30T22:30:24.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.142+0000 7fc7aee08700 1 -- 172.21.15.40:0/1287840031 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7a0009a70 con 0x7fc7a8131d50 2023-09-30T22:30:24.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.142+0000 7fc79d7fa700 1 -- 172.21.15.40:0/1287840031 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a0003de0 con 0x7fc7a8131d50 2023-09-30T22:30:24.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.142+0000 7fc7aee08700 1 -- 172.21.15.40:0/1287840031 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7a40094a0 con 0x7fc7a8131d50 2023-09-30T22:30:24.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.143+0000 7fc79d7fa700 1 -- 172.21.15.40:0/1287840031 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc7a000c930 con 0x7fc7a8131d50 2023-09-30T22:30:24.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.143+0000 7fc7aee08700 1 -- 172.21.15.40:0/1287840031 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7a811e5c0 con 0x7fc7a8131d50 2023-09-30T22:30:24.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.143+0000 7fc79d7fa700 1 -- 172.21.15.40:0/1287840031 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc7a003fee0 con 0x7fc7a8131d50 2023-09-30T22:30:24.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.147+0000 7fc79d7fa700 1 -- 172.21.15.40:0/1287840031 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc7a001b770 con 0x7fc7a8131d50 2023-09-30T22:30:24.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.344+0000 7fc7aee08700 1 -- 172.21.15.40:0/1287840031 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc7a8062380 con 0x7fc7a8131d50 2023-09-30T22:30:24.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.345+0000 7fc79d7fa700 1 -- 172.21.15.40:0/1287840031 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc7a00133e0 con 0x7fc7a8131d50 2023-09-30T22:30:24.346 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:24.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.346+0000 7fc7aee08700 1 -- 172.21.15.40:0/1287840031 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7a8131d50 msgr2=0x7fc7a809a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:24.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.346+0000 7fc7aee08700 1 --2- 172.21.15.40:0/1287840031 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7a8131d50 0x7fc7a809a4c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc7a000efc0 tx=0x7fc7a000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.347+0000 7fc7aee08700 1 -- 172.21.15.40:0/1287840031 shutdown_connections 2023-09-30T22:30:24.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.347+0000 7fc7aee08700 1 --2- 172.21.15.40:0/1287840031 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7a8131d50 0x7fc7a809a4c0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.347+0000 7fc7aee08700 1 --2- 172.21.15.40:0/1287840031 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7a809bc50 0x7fc7a8099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.347+0000 7fc7aee08700 1 --2- 172.21.15.40:0/1287840031 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc7a809c600 0x7fc7a8099f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.347+0000 7fc7aee08700 1 -- 172.21.15.40:0/1287840031 >> 172.21.15.40:0/1287840031 conn(0x7fc7a80a2a00 msgr2=0x7fc7a80a0900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:24.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.347+0000 7fc7aee08700 1 -- 172.21.15.40:0/1287840031 shutdown_connections 2023-09-30T22:30:24.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.347+0000 7fc7aee08700 1 -- 172.21.15.40:0/1287840031 wait complete. 2023-09-30T22:30:24.360 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:24.784 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:24.852 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:24.889 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:24.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.926+0000 7f80ff15a700 1 Processor -- start 2023-09-30T22:30:24.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.927+0000 7f80ff15a700 1 -- start start 2023-09-30T22:30:24.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.927+0000 7f80ff15a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f80f809d920 0x7f80f809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:24.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.927+0000 7f80ff15a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f80f809f0f0 0x7f80f809e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:24.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.927+0000 7f80ff15a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f809f940 con 0x7f80f8133ca0 2023-09-30T22:30:24.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.927+0000 7f80ff15a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f806b4c0 con 0x7f80f809f0f0 2023-09-30T22:30:24.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.927+0000 7f80ff15a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80f809a8f0 con 0x7f80f809d920 2023-09-30T22:30:24.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.927+0000 7f80f7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f80f809f0f0 0x7f80f809e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:24.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.927+0000 7f80f7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f80f809f0f0 0x7f80f809e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:34002/0 (socket says 172.21.15.40:34002) 2023-09-30T22:30:24.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.927+0000 7f80f7fff700 1 -- 172.21.15.40:0/2334441166 learned_addr learned my addr 172.21.15.40:0/2334441166 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:24.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.927+0000 7f80fcef6700 1 --2- 172.21.15.40:0/2334441166 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f80f809d920 0x7f80f809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:24.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.928+0000 7f80f7fff700 1 -- 172.21.15.40:0/2334441166 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f80f809d920 msgr2=0x7f80f809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:24.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.928+0000 7f80f7fff700 1 --2- 172.21.15.40:0/2334441166 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f80f809d920 0x7f80f809dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.928+0000 7f80f7fff700 1 -- 172.21.15.40:0/2334441166 >> v1:172.21.15.40:6789/0 conn(0x7f80f8133ca0 legacy=0x7f80f8134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:24.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.928+0000 7f80f7fff700 1 -- 172.21.15.40:0/2334441166 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f809f6e0 con 0x7f80f809f0f0 2023-09-30T22:30:24.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.928+0000 7f80f7fff700 1 --2- 172.21.15.40:0/2334441166 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f80f809f0f0 0x7f80f809e230 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f80e4009920 tx=0x7f80e4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a0750616440d5b0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:24.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.928+0000 7f80f77fe700 1 -- 172.21.15.40:0/2334441166 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e4011830 con 0x7f80f809f0f0 2023-09-30T22:30:24.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.928+0000 7f80f77fe700 1 -- 172.21.15.40:0/2334441166 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e4011990 con 0x7f80f809f0f0 2023-09-30T22:30:24.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.928+0000 7f80f77fe700 1 -- 172.21.15.40:0/2334441166 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e4011d20 con 0x7f80f809f0f0 2023-09-30T22:30:24.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.929+0000 7f80ff15a700 1 -- 172.21.15.40:0/2334441166 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f80f809f0f0 msgr2=0x7f80f809e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:24.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.929+0000 7f80ff15a700 1 --2- 172.21.15.40:0/2334441166 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f80f809f0f0 0x7f80f809e230 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f80e4009920 tx=0x7f80e4009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:24.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.929+0000 7f80ff15a700 1 -- 172.21.15.40:0/2334441166 shutdown_connections 2023-09-30T22:30:24.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.929+0000 7f80ff15a700 1 --2- 172.21.15.40:0/2334441166 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f80f809d920 0x7f80f809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.929+0000 7f80ff15a700 1 --2- 172.21.15.40:0/2334441166 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f80f809f0f0 0x7f80f809e230 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.929+0000 7f80ff15a700 1 -- 172.21.15.40:0/2334441166 >> 172.21.15.40:0/2334441166 conn(0x7f80f809fb20 msgr2=0x7f80f809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:24.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.929+0000 7f80ff15a700 1 -- 172.21.15.40:0/2334441166 shutdown_connections 2023-09-30T22:30:24.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.929+0000 7f80ff15a700 1 -- 172.21.15.40:0/2334441166 wait complete. 2023-09-30T22:30:24.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.930+0000 7f80ff15a700 1 Processor -- start 2023-09-30T22:30:24.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.930+0000 7f80ff15a700 1 -- start start 2023-09-30T22:30:24.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.930+0000 7f80ff15a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f80f809d920 0x7f80f8121870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:24.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.930+0000 7f80ff15a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f80f8133ca0 0x7f80f8121db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:24.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.930+0000 7f80ff15a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80f81222f0 0x7f80f81ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:24.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.930+0000 7f80ff15a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f8122d40 con 0x7f80f81222f0 2023-09-30T22:30:24.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.930+0000 7f80ff15a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f8125340 con 0x7f80f8133ca0 2023-09-30T22:30:24.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.930+0000 7f80ff15a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80f8123430 con 0x7f80f809d920 2023-09-30T22:30:24.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.931+0000 7f80f7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f80f8133ca0 0x7f80f8121db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:24.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.931+0000 7f80fcef6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f80f809d920 0x7f80f8121870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:24.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.931+0000 7f80f7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f80f8133ca0 0x7f80f8121db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:34004/0 (socket says 172.21.15.40:34004) 2023-09-30T22:30:24.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.931+0000 7f80f7fff700 1 -- 172.21.15.40:0/4014867586 learned_addr learned my addr 172.21.15.40:0/4014867586 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:24.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.931+0000 7f80fd6f7700 1 --2- 172.21.15.40:0/4014867586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80f81222f0 0x7f80f81ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:24.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.931+0000 7f80fcef6700 1 -- 172.21.15.40:0/4014867586 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f80f8133ca0 msgr2=0x7f80f8121db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:24.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.931+0000 7f80fcef6700 1 --2- 172.21.15.40:0/4014867586 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f80f8133ca0 0x7f80f8121db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.931+0000 7f80fcef6700 1 -- 172.21.15.40:0/4014867586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80f81222f0 msgr2=0x7f80f81ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:24.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.931+0000 7f80fcef6700 1 --2- 172.21.15.40:0/4014867586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80f81222f0 0x7f80f81ce9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.931+0000 7f80fcef6700 1 -- 172.21.15.40:0/4014867586 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e4009550 con 0x7f80f809d920 2023-09-30T22:30:24.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.931+0000 7f80f7fff700 1 --2- 172.21.15.40:0/4014867586 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f80f8133ca0 0x7f80f8121db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:24.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.931+0000 7f80fcef6700 1 --2- 172.21.15.40:0/4014867586 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f80f809d920 0x7f80f8121870 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f80ec00e870 tx=0x7f80ec00eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:24.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.931+0000 7f80f57fa700 1 -- 172.21.15.40:0/4014867586 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec013680 con 0x7f80f809d920 2023-09-30T22:30:24.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.931+0000 7f80f57fa700 1 -- 172.21.15.40:0/4014867586 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ec0137e0 con 0x7f80f809d920 2023-09-30T22:30:24.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.931+0000 7f80f57fa700 1 -- 172.21.15.40:0/4014867586 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec013b50 con 0x7f80f809d920 2023-09-30T22:30:24.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.931+0000 7f80ff15a700 1 -- 172.21.15.40:0/4014867586 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f80a2b90 con 0x7f80f809d920 2023-09-30T22:30:24.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.931+0000 7f80ff15a700 1 -- 172.21.15.40:0/4014867586 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f8132340 con 0x7f80f809d920 2023-09-30T22:30:24.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.932+0000 7f80ff15a700 1 -- 172.21.15.40:0/4014867586 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80f8062380 con 0x7f80f809d920 2023-09-30T22:30:24.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.933+0000 7f80f57fa700 1 -- 172.21.15.40:0/4014867586 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f80ec013cb0 con 0x7f80f809d920 2023-09-30T22:30:24.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.933+0000 7f80f57fa700 1 -- 172.21.15.40:0/4014867586 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f80ec03f680 con 0x7f80f809d920 2023-09-30T22:30:24.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.938+0000 7f80f57fa700 1 -- 172.21.15.40:0/4014867586 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f80ec01b820 con 0x7f80f809d920 2023-09-30T22:30:24.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.989+0000 7f02af151700 1 Processor -- start 2023-09-30T22:30:24.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.989+0000 7f02af151700 1 -- start start 2023-09-30T22:30:24.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.989+0000 7f02af151700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f02a806d0a0 0x7f02a806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:24.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.989+0000 7f02af151700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02a8139380 0x7f02a813b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:24.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.989+0000 7f02af151700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02a806e3f0 con 0x7f02a809fbb0 2023-09-30T22:30:24.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.989+0000 7f02af151700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a809ff80 con 0x7f02a8139380 2023-09-30T22:30:24.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.989+0000 7f02af151700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02a806ec40 con 0x7f02a806d0a0 2023-09-30T22:30:24.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.990+0000 7f02a7fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f02a806d0a0 0x7f02a806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:24.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.990+0000 7f02a7fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f02a806d0a0 0x7f02a806d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51396/0 (socket says 172.21.15.40:51396) 2023-09-30T22:30:24.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.990+0000 7f02a7fff700 1 -- 172.21.15.40:0/2369808873 learned_addr learned my addr 172.21.15.40:0/2369808873 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:24.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.990+0000 7f02ad6ee700 1 --2- 172.21.15.40:0/2369808873 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02a8139380 0x7f02a813b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:24.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.990+0000 7f02a7fff700 1 -- 172.21.15.40:0/2369808873 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02a8139380 msgr2=0x7f02a813b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:24.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.990+0000 7f02a7fff700 1 --2- 172.21.15.40:0/2369808873 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02a8139380 0x7f02a813b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.990+0000 7f02a7fff700 1 -- 172.21.15.40:0/2369808873 >> v1:172.21.15.40:6789/0 conn(0x7f02a809fbb0 legacy=0x7f02a806c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:24.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.990+0000 7f02a77fe700 1 -- 172.21.15.40:0/2369808873 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2665020722 0 0) 0x7f02a806e3f0 con 0x7f02a809fbb0 2023-09-30T22:30:24.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.990+0000 7f02a7fff700 1 -- 172.21.15.40:0/2369808873 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a806d9f0 con 0x7f02a806d0a0 2023-09-30T22:30:24.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.990+0000 7f02a7fff700 1 --2- 172.21.15.40:0/2369808873 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f02a806d0a0 0x7f02a806d4b0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f0294009920 tx=0x7f0294009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86aab1d8465b461d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:24.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.990+0000 7f02a77fe700 1 -- 172.21.15.40:0/2369808873 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0294011830 con 0x7f02a806d0a0 2023-09-30T22:30:24.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.990+0000 7f02a77fe700 1 -- 172.21.15.40:0/2369808873 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0294011990 con 0x7f02a806d0a0 2023-09-30T22:30:24.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.990+0000 7f02a77fe700 1 -- 172.21.15.40:0/2369808873 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0294011d20 con 0x7f02a806d0a0 2023-09-30T22:30:24.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.991+0000 7f02af151700 1 -- 172.21.15.40:0/2369808873 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f02a806d0a0 msgr2=0x7f02a806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:24.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.991+0000 7f02af151700 1 --2- 172.21.15.40:0/2369808873 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f02a806d0a0 0x7f02a806d4b0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f0294009920 tx=0x7f0294009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:24.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.991+0000 7f02af151700 1 -- 172.21.15.40:0/2369808873 shutdown_connections 2023-09-30T22:30:24.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.991+0000 7f02af151700 1 --2- 172.21.15.40:0/2369808873 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02a8139380 0x7f02a813b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.991+0000 7f02af151700 1 --2- 172.21.15.40:0/2369808873 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f02a806d0a0 0x7f02a806d4b0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.991+0000 7f02af151700 1 -- 172.21.15.40:0/2369808873 >> 172.21.15.40:0/2369808873 conn(0x7f02a80a41a0 msgr2=0x7f02a80a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:24.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.991+0000 7f02af151700 1 -- 172.21.15.40:0/2369808873 shutdown_connections 2023-09-30T22:30:24.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.991+0000 7f02af151700 1 -- 172.21.15.40:0/2369808873 wait complete. 2023-09-30T22:30:24.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.992+0000 7f02af151700 1 Processor -- start 2023-09-30T22:30:24.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.992+0000 7f02af151700 1 -- start start 2023-09-30T22:30:24.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.993+0000 7f02af151700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f02a806d0a0 0x7f02a81385a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:24.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.993+0000 7f02af151700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02a809fbb0 0x7f02a8138ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:24.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.993+0000 7f02af151700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02a8139380 0x7f02a8095a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:24.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.993+0000 7f02af151700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a8094c40 con 0x7f02a8139380 2023-09-30T22:30:24.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.993+0000 7f02af151700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a8094eb0 con 0x7f02a809fbb0 2023-09-30T22:30:24.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.993+0000 7f02af151700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02a8097230 con 0x7f02a806d0a0 2023-09-30T22:30:24.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.993+0000 7f02aceed700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f02a806d0a0 0x7f02a81385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:24.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.993+0000 7f02aceed700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f02a806d0a0 0x7f02a81385a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51410/0 (socket says 172.21.15.40:51410) 2023-09-30T22:30:24.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.993+0000 7f02aceed700 1 -- 172.21.15.40:0/1004507717 learned_addr learned my addr 172.21.15.40:0/1004507717 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:24.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.993+0000 7f02ad6ee700 1 --2- 172.21.15.40:0/1004507717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02a8139380 0x7f02a8095a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:24.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.993+0000 7f02a7fff700 1 --2- 172.21.15.40:0/1004507717 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02a809fbb0 0x7f02a8138ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:24.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.993+0000 7f02aceed700 1 -- 172.21.15.40:0/1004507717 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02a809fbb0 msgr2=0x7f02a8138ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:24.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.993+0000 7f02aceed700 1 --2- 172.21.15.40:0/1004507717 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02a809fbb0 0x7f02a8138ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.993+0000 7f02aceed700 1 -- 172.21.15.40:0/1004507717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02a8139380 msgr2=0x7f02a8095a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:24.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.993+0000 7f02aceed700 1 --2- 172.21.15.40:0/1004507717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02a8139380 0x7f02a8095a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:24.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.993+0000 7f02aceed700 1 -- 172.21.15.40:0/1004507717 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0294009550 con 0x7f02a806d0a0 2023-09-30T22:30:24.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.993+0000 7f02a7fff700 1 --2- 172.21.15.40:0/1004507717 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02a809fbb0 0x7f02a8138ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:25.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.993+0000 7f02ad6ee700 1 --2- 172.21.15.40:0/1004507717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02a8139380 0x7f02a8095a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:25.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.993+0000 7f02aceed700 1 --2- 172.21.15.40:0/1004507717 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f02a806d0a0 0x7f02a81385a0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f029c001eb0 tx=0x7f029c00c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:25.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.994+0000 7f02a57fa700 1 -- 172.21.15.40:0/1004507717 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029c0054e0 con 0x7f02a806d0a0 2023-09-30T22:30:25.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.994+0000 7f02af151700 1 -- 172.21.15.40:0/1004507717 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a80a3860 con 0x7f02a806d0a0 2023-09-30T22:30:25.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.994+0000 7f02a57fa700 1 -- 172.21.15.40:0/1004507717 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029c003680 con 0x7f02a806d0a0 2023-09-30T22:30:25.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.994+0000 7f02a57fa700 1 -- 172.21.15.40:0/1004507717 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029c0039f0 con 0x7f02a806d0a0 2023-09-30T22:30:25.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.994+0000 7f02af151700 1 -- 172.21.15.40:0/1004507717 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a8095640 con 0x7f02a806d0a0 2023-09-30T22:30:25.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.995+0000 7f02af151700 1 -- 172.21.15.40:0/1004507717 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02a8062380 con 0x7f02a806d0a0 2023-09-30T22:30:25.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.995+0000 7f02a57fa700 1 -- 172.21.15.40:0/1004507717 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f029c003b50 con 0x7f02a806d0a0 2023-09-30T22:30:25.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:24.995+0000 7f02a57fa700 1 -- 172.21.15.40:0/1004507717 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f029c03ed40 con 0x7f02a806d0a0 2023-09-30T22:30:25.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.000+0000 7f02a57fa700 1 -- 172.21.15.40:0/1004507717 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f029c01b3b0 con 0x7f02a806d0a0 2023-09-30T22:30:25.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.030+0000 7f259e4d1700 1 Processor -- start 2023-09-30T22:30:25.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.030+0000 7f259e4d1700 1 -- start start 2023-09-30T22:30:25.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.030+0000 7f259e4d1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f259809e400 0x7f2598135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:25.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.030+0000 7f259e4d1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2598136230 0x7f2598138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:25.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.030+0000 7f259e4d1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f259809adf0 con 0x7f259809d920 2023-09-30T22:30:25.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.030+0000 7f259e4d1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f259809edf0 con 0x7f259809e400 2023-09-30T22:30:25.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.030+0000 7f259e4d1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f259809b660 con 0x7f2598136230 2023-09-30T22:30:25.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.031+0000 7f25977fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f259809e400 0x7f2598135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:25.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.031+0000 7f259ca6e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2598136230 0x7f2598138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:25.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.031+0000 7f25977fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f259809e400 0x7f2598135cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53730/0 (socket says 172.21.15.40:53730) 2023-09-30T22:30:25.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.031+0000 7f259ca6e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2598136230 0x7f2598138610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51420/0 (socket says 172.21.15.40:51420) 2023-09-30T22:30:25.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.031+0000 7f25977fe700 1 -- 172.21.15.40:0/4195291556 learned_addr learned my addr 172.21.15.40:0/4195291556 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:25.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.031+0000 7f259ca6e700 1 -- 172.21.15.40:0/4195291556 >> v2:172.21.15.40:3300/0 conn(0x7f259809e400 msgr2=0x7f2598135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:25.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.031+0000 7f259ca6e700 1 --2- 172.21.15.40:0/4195291556 >> v2:172.21.15.40:3300/0 conn(0x7f259809e400 0x7f2598135cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.031+0000 7f259ca6e700 1 -- 172.21.15.40:0/4195291556 >> v1:172.21.15.40:6789/0 conn(0x7f259809d920 legacy=0x7f259809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:25.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.031+0000 7f259ca6e700 1 -- 172.21.15.40:0/4195291556 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259809a6e0 con 0x7f2598136230 2023-09-30T22:30:25.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.031+0000 7f2596ffd700 1 -- 172.21.15.40:0/4195291556 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1002667360 0 0) 0x7f259809adf0 con 0x7f259809d920 2023-09-30T22:30:25.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.031+0000 7f25977fe700 1 --2- 172.21.15.40:0/4195291556 >> v2:172.21.15.40:3300/0 conn(0x7f259809e400 0x7f2598135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:25.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.031+0000 7f259ca6e700 1 --2- 172.21.15.40:0/4195291556 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2598136230 0x7f2598138610 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f2590009d90 tx=0x7f259000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88b60f0e2e56dbd2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:25.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.031+0000 7f2596ffd700 1 -- 172.21.15.40:0/4195291556 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259000e070 con 0x7f2598136230 2023-09-30T22:30:25.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.031+0000 7f2596ffd700 1 -- 172.21.15.40:0/4195291556 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259000bb20 con 0x7f2598136230 2023-09-30T22:30:25.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.031+0000 7f2596ffd700 1 -- 172.21.15.40:0/4195291556 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2590012430 con 0x7f2598136230 2023-09-30T22:30:25.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.032+0000 7f259e4d1700 1 -- 172.21.15.40:0/4195291556 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2598136230 msgr2=0x7f2598138610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:25.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.032+0000 7f259e4d1700 1 --2- 172.21.15.40:0/4195291556 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2598136230 0x7f2598138610 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f2590009d90 tx=0x7f259000b330 comp rx=0 tx=0).stop 2023-09-30T22:30:25.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.032+0000 7f259e4d1700 1 -- 172.21.15.40:0/4195291556 shutdown_connections 2023-09-30T22:30:25.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.032+0000 7f259e4d1700 1 --2- 172.21.15.40:0/4195291556 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2598136230 0x7f2598138610 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.032+0000 7f259e4d1700 1 --2- 172.21.15.40:0/4195291556 >> v2:172.21.15.40:3300/0 conn(0x7f259809e400 0x7f2598135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.032+0000 7f259e4d1700 1 -- 172.21.15.40:0/4195291556 >> 172.21.15.40:0/4195291556 conn(0x7f259809fb20 msgr2=0x7f259809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:25.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.032+0000 7f259e4d1700 1 -- 172.21.15.40:0/4195291556 shutdown_connections 2023-09-30T22:30:25.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.032+0000 7f259e4d1700 1 -- 172.21.15.40:0/4195291556 wait complete. 2023-09-30T22:30:25.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.033+0000 7f259e4d1700 1 Processor -- start 2023-09-30T22:30:25.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.034+0000 7f259e4d1700 1 -- start start 2023-09-30T22:30:25.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.034+0000 7f259e4d1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f259809d920 0x7f259811f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:25.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.034+0000 7f259e4d1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f259809e400 0x7f259811fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:25.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.034+0000 7f259e4d1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2598136230 0x7f2598120100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:25.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.034+0000 7f259e4d1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2598135ad0 con 0x7f259809e400 2023-09-30T22:30:25.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.034+0000 7f259e4d1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2598135290 con 0x7f2598136230 2023-09-30T22:30:25.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.034+0000 7f259e4d1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f259806b260 con 0x7f259809d920 2023-09-30T22:30:25.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.034+0000 7f2597fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f259809d920 0x7f259811f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:25.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.034+0000 7f25977fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f259809e400 0x7f259811fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:25.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.034+0000 7f2597fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f259809d920 0x7f259811f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51428/0 (socket says 172.21.15.40:51428) 2023-09-30T22:30:25.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.034+0000 7f25977fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f259809e400 0x7f259811fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53744/0 (socket says 172.21.15.40:53744) 2023-09-30T22:30:25.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.034+0000 7f2597fff700 1 -- 172.21.15.40:0/1779490228 learned_addr learned my addr 172.21.15.40:0/1779490228 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:25.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.034+0000 7f259ca6e700 1 --2- 172.21.15.40:0/1779490228 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2598136230 0x7f2598120100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:25.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.035+0000 7f2597fff700 1 -- 172.21.15.40:0/1779490228 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2598136230 msgr2=0x7f2598120100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:25.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.035+0000 7f2597fff700 1 --2- 172.21.15.40:0/1779490228 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2598136230 0x7f2598120100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.035+0000 7f2597fff700 1 -- 172.21.15.40:0/1779490228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f259809e400 msgr2=0x7f259811fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:25.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.035+0000 7f2597fff700 1 --2- 172.21.15.40:0/1779490228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f259809e400 0x7f259811fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.035+0000 7f2597fff700 1 -- 172.21.15.40:0/1779490228 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f258c009550 con 0x7f259809d920 2023-09-30T22:30:25.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.035+0000 7f2597fff700 1 --2- 172.21.15.40:0/1779490228 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f259809d920 0x7f259811f680 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f258800c4b0 tx=0x7f258800c7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:25.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.035+0000 7f2594ff9700 1 -- 172.21.15.40:0/1779490228 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25880054e0 con 0x7f259809d920 2023-09-30T22:30:25.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.035+0000 7f2594ff9700 1 -- 172.21.15.40:0/1779490228 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f258800ce40 con 0x7f259809d920 2023-09-30T22:30:25.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.035+0000 7f259e4d1700 1 -- 172.21.15.40:0/1779490228 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2590009a70 con 0x7f259809d920 2023-09-30T22:30:25.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.035+0000 7f2594ff9700 1 -- 172.21.15.40:0/1779490228 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25880038c0 con 0x7f259809d920 2023-09-30T22:30:25.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.035+0000 7f259e4d1700 1 -- 172.21.15.40:0/1779490228 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f259806a940 con 0x7f259809d920 2023-09-30T22:30:25.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.036+0000 7f2594ff9700 1 -- 172.21.15.40:0/1779490228 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2588003a20 con 0x7f259809d920 2023-09-30T22:30:25.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.036+0000 7f2594ff9700 1 -- 172.21.15.40:0/1779490228 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f258803eaf0 con 0x7f259809d920 2023-09-30T22:30:25.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.036+0000 7f259e4d1700 1 -- 172.21.15.40:0/1779490228 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2598062380 con 0x7f259809d920 2023-09-30T22:30:25.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.041+0000 7f2594ff9700 1 -- 172.21.15.40:0/1779490228 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2588017020 con 0x7f259809d920 2023-09-30T22:30:25.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.137+0000 7f80ff15a700 1 -- 172.21.15.40:0/4014867586 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f80f8074720 con 0x7f80f809d920 2023-09-30T22:30:25.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.137+0000 7f80f57fa700 1 -- 172.21.15.40:0/4014867586 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f80ec021020 con 0x7f80f809d920 2023-09-30T22:30:25.138 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:25.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.139+0000 7f80ff15a700 1 -- 172.21.15.40:0/4014867586 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f80f809d920 msgr2=0x7f80f8121870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:25.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.139+0000 7f80ff15a700 1 --2- 172.21.15.40:0/4014867586 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f80f809d920 0x7f80f8121870 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f80ec00e870 tx=0x7f80ec00eb80 comp rx=0 tx=0).stop 2023-09-30T22:30:25.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.139+0000 7f80ff15a700 1 -- 172.21.15.40:0/4014867586 shutdown_connections 2023-09-30T22:30:25.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.139+0000 7f80ff15a700 1 --2- 172.21.15.40:0/4014867586 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f80f809d920 0x7f80f8121870 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.139+0000 7f80ff15a700 1 --2- 172.21.15.40:0/4014867586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80f81222f0 0x7f80f81ce9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.139+0000 7f80ff15a700 1 --2- 172.21.15.40:0/4014867586 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f80f8133ca0 0x7f80f8121db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.139+0000 7f80ff15a700 1 -- 172.21.15.40:0/4014867586 >> 172.21.15.40:0/4014867586 conn(0x7f80f809fb20 msgr2=0x7f80f80a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:25.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.140+0000 7f80ff15a700 1 -- 172.21.15.40:0/4014867586 shutdown_connections 2023-09-30T22:30:25.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.140+0000 7f80ff15a700 1 -- 172.21.15.40:0/4014867586 wait complete. 2023-09-30T22:30:25.153 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:25.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.199+0000 7f02af151700 1 -- 172.21.15.40:0/1004507717 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f02a8074620 con 0x7f02a806d0a0 2023-09-30T22:30:25.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.200+0000 7f02a57fa700 1 -- 172.21.15.40:0/1004507717 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f029c017070 con 0x7f02a806d0a0 2023-09-30T22:30:25.200 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:25.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.201+0000 7f02af151700 1 -- 172.21.15.40:0/1004507717 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f02a806d0a0 msgr2=0x7f02a81385a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:25.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.201+0000 7f02af151700 1 --2- 172.21.15.40:0/1004507717 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f02a806d0a0 0x7f02a81385a0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f029c001eb0 tx=0x7f029c00c8b0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.202+0000 7f02af151700 1 -- 172.21.15.40:0/1004507717 shutdown_connections 2023-09-30T22:30:25.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.202+0000 7f02af151700 1 --2- 172.21.15.40:0/1004507717 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f02a806d0a0 0x7f02a81385a0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.202+0000 7f02af151700 1 --2- 172.21.15.40:0/1004507717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02a8139380 0x7f02a8095a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.202+0000 7f02af151700 1 --2- 172.21.15.40:0/1004507717 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02a809fbb0 0x7f02a8138ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.202+0000 7f02af151700 1 -- 172.21.15.40:0/1004507717 >> 172.21.15.40:0/1004507717 conn(0x7f02a80a41a0 msgr2=0x7f02a80a20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:25.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.202+0000 7f02af151700 1 -- 172.21.15.40:0/1004507717 shutdown_connections 2023-09-30T22:30:25.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.202+0000 7f02af151700 1 -- 172.21.15.40:0/1004507717 wait complete. 2023-09-30T22:30:25.215 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:25.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.238+0000 7f259e4d1700 1 -- 172.21.15.40:0/1779490228 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2598074720 con 0x7f259809d920 2023-09-30T22:30:25.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.238+0000 7f2594ff9700 1 -- 172.21.15.40:0/1779490228 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2588012400 con 0x7f259809d920 2023-09-30T22:30:25.239 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:25.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.240+0000 7f259e4d1700 1 -- 172.21.15.40:0/1779490228 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f259809d920 msgr2=0x7f259811f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:25.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.241+0000 7f259e4d1700 1 --2- 172.21.15.40:0/1779490228 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f259809d920 0x7f259811f680 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f258800c4b0 tx=0x7f258800c7c0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.241+0000 7f259e4d1700 1 -- 172.21.15.40:0/1779490228 shutdown_connections 2023-09-30T22:30:25.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.241+0000 7f259e4d1700 1 --2- 172.21.15.40:0/1779490228 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f259809d920 0x7f259811f680 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.241+0000 7f259e4d1700 1 --2- 172.21.15.40:0/1779490228 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2598136230 0x7f2598120100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.241+0000 7f259e4d1700 1 --2- 172.21.15.40:0/1779490228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f259809e400 0x7f259811fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.241+0000 7f259e4d1700 1 -- 172.21.15.40:0/1779490228 >> 172.21.15.40:0/1779490228 conn(0x7f259809fb20 msgr2=0x7f2598119730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:25.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.241+0000 7f259e4d1700 1 -- 172.21.15.40:0/1779490228 shutdown_connections 2023-09-30T22:30:25.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.241+0000 7f259e4d1700 1 -- 172.21.15.40:0/1779490228 wait complete. 2023-09-30T22:30:25.254 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:25.360 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:25.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.487+0000 7f6a2dde7700 1 Processor -- start 2023-09-30T22:30:25.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.487+0000 7f6a2dde7700 1 -- start start 2023-09-30T22:30:25.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.488+0000 7f6a2dde7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6a2809e400 0x7f6a28135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:25.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.488+0000 7f6a2dde7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6a28136230 0x7f6a28138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:25.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.488+0000 7f6a2dde7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a2809adf0 con 0x7f6a2809d920 2023-09-30T22:30:25.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.488+0000 7f6a2dde7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a2809e7f0 con 0x7f6a28136230 2023-09-30T22:30:25.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.488+0000 7f6a2dde7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2809edf0 con 0x7f6a2809e400 2023-09-30T22:30:25.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.488+0000 7f6a26ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6a2809e400 0x7f6a28135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:25.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.488+0000 7f6a27fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6a28136230 0x7f6a28138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:25.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.488+0000 7f6a26ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6a2809e400 0x7f6a28135cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51438/0 (socket says 172.21.15.40:51438) 2023-09-30T22:30:25.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.488+0000 7f6a27fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6a28136230 0x7f6a28138610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53748/0 (socket says 172.21.15.40:53748) 2023-09-30T22:30:25.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.488+0000 7f6a26ffd700 1 -- 172.21.15.40:0/338683781 learned_addr learned my addr 172.21.15.40:0/338683781 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:25.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.488+0000 7f6a27fff700 1 -- 172.21.15.40:0/338683781 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6a2809e400 msgr2=0x7f6a28135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:25.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.488+0000 7f6a27fff700 1 --2- 172.21.15.40:0/338683781 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6a2809e400 0x7f6a28135cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.488+0000 7f6a27fff700 1 -- 172.21.15.40:0/338683781 >> v1:172.21.15.40:6789/0 conn(0x7f6a2809d920 legacy=0x7f6a2809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:25.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.488+0000 7f6a27fff700 1 -- 172.21.15.40:0/338683781 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2809b660 con 0x7f6a28136230 2023-09-30T22:30:25.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.488+0000 7f6a267fc700 1 -- 172.21.15.40:0/338683781 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1098024108 0 0) 0x7f6a2809adf0 con 0x7f6a2809d920 2023-09-30T22:30:25.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.488+0000 7f6a26ffd700 1 --2- 172.21.15.40:0/338683781 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6a2809e400 0x7f6a28135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:25.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.488+0000 7f6a27fff700 1 --2- 172.21.15.40:0/338683781 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a28136230 0x7f6a28138610 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f6a20009d90 tx=0x7f6a2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a29cdb6545bf1df server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:25.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.488+0000 7f6a267fc700 1 -- 172.21.15.40:0/338683781 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2000e070 con 0x7f6a28136230 2023-09-30T22:30:25.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.488+0000 7f6a267fc700 1 -- 172.21.15.40:0/338683781 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2000bb20 con 0x7f6a28136230 2023-09-30T22:30:25.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.489+0000 7f6a267fc700 1 -- 172.21.15.40:0/338683781 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a20012430 con 0x7f6a28136230 2023-09-30T22:30:25.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.489+0000 7f6a2dde7700 1 -- 172.21.15.40:0/338683781 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a28136230 msgr2=0x7f6a28138610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:25.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.489+0000 7f6a2dde7700 1 --2- 172.21.15.40:0/338683781 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a28136230 0x7f6a28138610 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f6a20009d90 tx=0x7f6a2000b330 comp rx=0 tx=0).stop 2023-09-30T22:30:25.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.489+0000 7f6a2dde7700 1 -- 172.21.15.40:0/338683781 shutdown_connections 2023-09-30T22:30:25.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.489+0000 7f6a2dde7700 1 --2- 172.21.15.40:0/338683781 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a28136230 0x7f6a28138610 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.489+0000 7f6a2dde7700 1 --2- 172.21.15.40:0/338683781 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6a2809e400 0x7f6a28135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.489+0000 7f6a2dde7700 1 -- 172.21.15.40:0/338683781 >> 172.21.15.40:0/338683781 conn(0x7f6a2809fb20 msgr2=0x7f6a2809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:25.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.489+0000 7f6a2dde7700 1 -- 172.21.15.40:0/338683781 shutdown_connections 2023-09-30T22:30:25.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.489+0000 7f6a2dde7700 1 -- 172.21.15.40:0/338683781 wait complete. 2023-09-30T22:30:25.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.490+0000 7f6a2dde7700 1 Processor -- start 2023-09-30T22:30:25.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.490+0000 7f6a2dde7700 1 -- start start 2023-09-30T22:30:25.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.491+0000 7f6a2dde7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a2809d920 0x7f6a2811e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:25.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.491+0000 7f6a2dde7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a2809e400 0x7f6a2811eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:25.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.491+0000 7f6a2dde7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6a28136230 0x7f6a2811f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:25.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.491+0000 7f6a2dde7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a281358a0 con 0x7f6a2809d920 2023-09-30T22:30:25.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.491+0000 7f6a2dde7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a281212d0 con 0x7f6a2809e400 2023-09-30T22:30:25.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.491+0000 7f6a2dde7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a28121cb0 con 0x7f6a28136230 2023-09-30T22:30:25.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.491+0000 7f6a277fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a2809d920 0x7f6a2811e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:25.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.491+0000 7f6a27fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6a28136230 0x7f6a2811f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:25.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.491+0000 7f6a277fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a2809d920 0x7f6a2811e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53764/0 (socket says 172.21.15.40:53764) 2023-09-30T22:30:25.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.491+0000 7f6a277fe700 1 -- 172.21.15.40:0/4098867360 learned_addr learned my addr 172.21.15.40:0/4098867360 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:25.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.491+0000 7f6a26ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a2809e400 0x7f6a2811eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:25.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.491+0000 7f6a277fe700 1 -- 172.21.15.40:0/4098867360 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6a28136230 msgr2=0x7f6a2811f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:25.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.491+0000 7f6a277fe700 1 --2- 172.21.15.40:0/4098867360 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6a28136230 0x7f6a2811f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.491+0000 7f6a277fe700 1 -- 172.21.15.40:0/4098867360 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a2809e400 msgr2=0x7f6a2811eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:25.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.491+0000 7f6a277fe700 1 --2- 172.21.15.40:0/4098867360 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a2809e400 0x7f6a2811eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.491+0000 7f6a277fe700 1 -- 172.21.15.40:0/4098867360 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1000b7f0 con 0x7f6a2809d920 2023-09-30T22:30:25.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.491+0000 7f6a26ffd700 1 --2- 172.21.15.40:0/4098867360 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a2809e400 0x7f6a2811eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:25.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.491+0000 7f6a27fff700 1 --2- 172.21.15.40:0/4098867360 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6a28136230 0x7f6a2811f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:25.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.491+0000 7f6a277fe700 1 --2- 172.21.15.40:0/4098867360 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a2809d920 0x7f6a2811e5a0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f6a1800c550 tx=0x7f6a1800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:25.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.491+0000 7f6a1ffff700 1 -- 172.21.15.40:0/4098867360 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a180054e0 con 0x7f6a2809d920 2023-09-30T22:30:25.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.491+0000 7f6a1ffff700 1 -- 172.21.15.40:0/4098867360 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a18003680 con 0x7f6a2809d920 2023-09-30T22:30:25.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.492+0000 7f6a2dde7700 1 -- 172.21.15.40:0/4098867360 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a20009a70 con 0x7f6a2809d920 2023-09-30T22:30:25.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.492+0000 7f6a1ffff700 1 -- 172.21.15.40:0/4098867360 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a18003a30 con 0x7f6a2809d920 2023-09-30T22:30:25.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.492+0000 7f6a2dde7700 1 -- 172.21.15.40:0/4098867360 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a28121720 con 0x7f6a2809d920 2023-09-30T22:30:25.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.492+0000 7f6a1ffff700 1 -- 172.21.15.40:0/4098867360 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6a18003b90 con 0x7f6a2809d920 2023-09-30T22:30:25.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.492+0000 7f6a1ffff700 1 -- 172.21.15.40:0/4098867360 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6a1803eb60 con 0x7f6a2809d920 2023-09-30T22:30:25.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.493+0000 7f6a2dde7700 1 -- 172.21.15.40:0/4098867360 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a28062380 con 0x7f6a2809d920 2023-09-30T22:30:25.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.497+0000 7f6a1ffff700 1 -- 172.21.15.40:0/4098867360 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6a18017020 con 0x7f6a2809d920 2023-09-30T22:30:25.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.693+0000 7f6a2dde7700 1 -- 172.21.15.40:0/4098867360 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6a28120880 con 0x7f6a2809d920 2023-09-30T22:30:25.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.693+0000 7f6a1ffff700 1 -- 172.21.15.40:0/4098867360 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6a18003e40 con 0x7f6a2809d920 2023-09-30T22:30:25.694 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:25.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.696+0000 7f6a2dde7700 1 -- 172.21.15.40:0/4098867360 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a2809d920 msgr2=0x7f6a2811e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:25.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.696+0000 7f6a2dde7700 1 --2- 172.21.15.40:0/4098867360 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a2809d920 0x7f6a2811e5a0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f6a1800c550 tx=0x7f6a1800c860 comp rx=0 tx=0).stop 2023-09-30T22:30:25.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.696+0000 7f6a2dde7700 1 -- 172.21.15.40:0/4098867360 shutdown_connections 2023-09-30T22:30:25.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.696+0000 7f6a2dde7700 1 --2- 172.21.15.40:0/4098867360 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6a28136230 0x7f6a2811f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.696+0000 7f6a2dde7700 1 --2- 172.21.15.40:0/4098867360 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a2809d920 0x7f6a2811e5a0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.696+0000 7f6a2dde7700 1 --2- 172.21.15.40:0/4098867360 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6a2809e400 0x7f6a2811eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:25.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.696+0000 7f6a2dde7700 1 -- 172.21.15.40:0/4098867360 >> 172.21.15.40:0/4098867360 conn(0x7f6a2809fb20 msgr2=0x7f6a28070310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:25.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.696+0000 7f6a2dde7700 1 -- 172.21.15.40:0/4098867360 shutdown_connections 2023-09-30T22:30:25.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:25.696+0000 7f6a2dde7700 1 -- 172.21.15.40:0/4098867360 wait complete. 2023-09-30T22:30:25.708 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:26.154 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:26.215 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:26.254 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:26.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.288+0000 7fc6ac528700 1 Processor -- start 2023-09-30T22:30:26.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.288+0000 7fc6ac528700 1 -- start start 2023-09-30T22:30:26.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.288+0000 7fc6ac528700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6a409d920 0x7fc6a409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:26.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.288+0000 7fc6ac528700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc6a409f0f0 0x7fc6a409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:26.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.288+0000 7fc6ac528700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a409f940 con 0x7fc6a4133ca0 2023-09-30T22:30:26.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.288+0000 7fc6ac528700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6a406b4c0 con 0x7fc6a409f0f0 2023-09-30T22:30:26.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.288+0000 7fc6ac528700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a409a8f0 con 0x7fc6a409d920 2023-09-30T22:30:26.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.289+0000 7fc6a9ac3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc6a409f0f0 0x7fc6a409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:26.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.289+0000 7fc6a9ac3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc6a409f0f0 0x7fc6a409e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53766/0 (socket says 172.21.15.40:53766) 2023-09-30T22:30:26.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.289+0000 7fc6aaac5700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc6a4133ca0 0x7fc6a4134100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46014/0 (socket says 172.21.15.40:46014) 2023-09-30T22:30:26.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.289+0000 7fc6a9ac3700 1 -- 172.21.15.40:0/1640274538 learned_addr learned my addr 172.21.15.40:0/1640274538 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:26.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.289+0000 7fc6aa2c4700 1 --2- 172.21.15.40:0/1640274538 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6a409d920 0x7fc6a409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:26.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.289+0000 7fc6a9ac3700 1 -- 172.21.15.40:0/1640274538 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6a409d920 msgr2=0x7fc6a409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:26.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.289+0000 7fc6a9ac3700 1 --2- 172.21.15.40:0/1640274538 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6a409d920 0x7fc6a409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.289+0000 7fc6a9ac3700 1 -- 172.21.15.40:0/1640274538 >> v1:172.21.15.40:6789/0 conn(0x7fc6a4133ca0 legacy=0x7fc6a4134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:26.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.289+0000 7fc6a92c2700 1 -- 172.21.15.40:0/1640274538 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2208421390 0 0) 0x7fc6a409f940 con 0x7fc6a4133ca0 2023-09-30T22:30:26.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.289+0000 7fc6a9ac3700 1 -- 172.21.15.40:0/1640274538 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a409f6e0 con 0x7fc6a409f0f0 2023-09-30T22:30:26.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.289+0000 7fc6a9ac3700 1 --2- 172.21.15.40:0/1640274538 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6a409f0f0 0x7fc6a409e230 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fc694009920 tx=0x7fc694009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=392eef760c1b5810 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:26.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.289+0000 7fc6a92c2700 1 -- 172.21.15.40:0/1640274538 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc694011830 con 0x7fc6a409f0f0 2023-09-30T22:30:26.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.289+0000 7fc6a92c2700 1 -- 172.21.15.40:0/1640274538 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc694011990 con 0x7fc6a409f0f0 2023-09-30T22:30:26.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.289+0000 7fc6a92c2700 1 -- 172.21.15.40:0/1640274538 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc694011d20 con 0x7fc6a409f0f0 2023-09-30T22:30:26.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.290+0000 7fc6ac528700 1 -- 172.21.15.40:0/1640274538 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6a409f0f0 msgr2=0x7fc6a409e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:26.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.290+0000 7fc6ac528700 1 --2- 172.21.15.40:0/1640274538 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6a409f0f0 0x7fc6a409e230 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fc694009920 tx=0x7fc694009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:26.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.290+0000 7fc6ac528700 1 -- 172.21.15.40:0/1640274538 shutdown_connections 2023-09-30T22:30:26.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.290+0000 7fc6ac528700 1 --2- 172.21.15.40:0/1640274538 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6a409d920 0x7fc6a409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.290+0000 7fc6ac528700 1 --2- 172.21.15.40:0/1640274538 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6a409f0f0 0x7fc6a409e230 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.290+0000 7fc6ac528700 1 -- 172.21.15.40:0/1640274538 >> 172.21.15.40:0/1640274538 conn(0x7fc6a409fb20 msgr2=0x7fc6a409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:26.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.290+0000 7fc6ac528700 1 -- 172.21.15.40:0/1640274538 shutdown_connections 2023-09-30T22:30:26.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.290+0000 7fc6ac528700 1 -- 172.21.15.40:0/1640274538 wait complete. 2023-09-30T22:30:26.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.292+0000 7fc6ac528700 1 Processor -- start 2023-09-30T22:30:26.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.292+0000 7fc6ac528700 1 -- start start 2023-09-30T22:30:26.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.292+0000 7fc6ac528700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6a409d920 0x7fc6a411db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:26.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.292+0000 7fc6ac528700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc6a4133ca0 0x7fc6a411e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:26.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.292+0000 7fc6ac528700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6a41307d0 0x7fc6a411e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:26.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.292+0000 7fc6ac528700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a4120770 con 0x7fc6a41307d0 2023-09-30T22:30:26.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.292+0000 7fc6ac528700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a4120240 con 0x7fc6a409d920 2023-09-30T22:30:26.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.292+0000 7fc6ac528700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a41218c0 con 0x7fc6a4133ca0 2023-09-30T22:30:26.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.293+0000 7fc6aa2c4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6a409d920 0x7fc6a411db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:26.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.293+0000 7fc6aa2c4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6a409d920 0x7fc6a411db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:34066/0 (socket says 172.21.15.40:34066) 2023-09-30T22:30:26.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.293+0000 7fc6aa2c4700 1 -- 172.21.15.40:0/992439659 learned_addr learned my addr 172.21.15.40:0/992439659 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:26.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.293+0000 7fc6a9ac3700 1 --2- 172.21.15.40:0/992439659 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc6a4133ca0 0x7fc6a411e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:26.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.293+0000 7fc6aaac5700 1 --2- 172.21.15.40:0/992439659 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6a41307d0 0x7fc6a411e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:26.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.293+0000 7fc6aa2c4700 1 -- 172.21.15.40:0/992439659 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc6a4133ca0 msgr2=0x7fc6a411e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:26.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.293+0000 7fc6aa2c4700 1 --2- 172.21.15.40:0/992439659 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc6a4133ca0 0x7fc6a411e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.293+0000 7fc6aa2c4700 1 -- 172.21.15.40:0/992439659 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6a41307d0 msgr2=0x7fc6a411e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:26.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.293+0000 7fc6aa2c4700 1 --2- 172.21.15.40:0/992439659 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6a41307d0 0x7fc6a411e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.293+0000 7fc6aa2c4700 1 -- 172.21.15.40:0/992439659 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc694009550 con 0x7fc6a409d920 2023-09-30T22:30:26.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.293+0000 7fc6aa2c4700 1 --2- 172.21.15.40:0/992439659 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6a409d920 0x7fc6a411db40 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fc6a000e930 tx=0x7fc6a000ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:26.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.293+0000 7fc69affd700 1 -- 172.21.15.40:0/992439659 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0009650 con 0x7fc6a409d920 2023-09-30T22:30:26.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.293+0000 7fc69affd700 1 -- 172.21.15.40:0/992439659 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a0013680 con 0x7fc6a409d920 2023-09-30T22:30:26.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.293+0000 7fc69affd700 1 -- 172.21.15.40:0/992439659 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a00139f0 con 0x7fc6a409d920 2023-09-30T22:30:26.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.293+0000 7fc6ac528700 1 -- 172.21.15.40:0/992439659 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a409c9e0 con 0x7fc6a409d920 2023-09-30T22:30:26.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.293+0000 7fc6ac528700 1 -- 172.21.15.40:0/992439659 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a40a2560 con 0x7fc6a409d920 2023-09-30T22:30:26.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.294+0000 7fc6ac528700 1 -- 172.21.15.40:0/992439659 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6a4062380 con 0x7fc6a409d920 2023-09-30T22:30:26.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.295+0000 7fc69affd700 1 -- 172.21.15.40:0/992439659 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc6a0013b50 con 0x7fc6a409d920 2023-09-30T22:30:26.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.295+0000 7fc69affd700 1 -- 172.21.15.40:0/992439659 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc6a003fe60 con 0x7fc6a409d920 2023-09-30T22:30:26.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.299+0000 7fc69affd700 1 -- 172.21.15.40:0/992439659 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc6a0026480 con 0x7fc6a409d920 2023-09-30T22:30:26.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.348+0000 7fd54e8c8700 1 Processor -- start 2023-09-30T22:30:26.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.348+0000 7fd54e8c8700 1 -- start start 2023-09-30T22:30:26.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.349+0000 7fd54e8c8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd548136c50 0x7fd548139030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:26.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.349+0000 7fd54e8c8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd548139570 0x7fd54813b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:26.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.349+0000 7fd54e8c8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd548133940 con 0x7fd548133e00 2023-09-30T22:30:26.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.349+0000 7fd54e8c8700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd54809af70 con 0x7fd548136c50 2023-09-30T22:30:26.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.349+0000 7fd54e8c8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54809ab20 con 0x7fd548139570 2023-09-30T22:30:26.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.349+0000 7fd54ce65700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd548139570 0x7fd54813b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:26.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.349+0000 7fd54ce65700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd548139570 0x7fd54813b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:34074/0 (socket says 172.21.15.40:34074) 2023-09-30T22:30:26.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.349+0000 7fd54ce65700 1 -- 172.21.15.40:0/3396250508 learned_addr learned my addr 172.21.15.40:0/3396250508 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:26.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.349+0000 7fd5477fe700 1 --2- 172.21.15.40:0/3396250508 >> v2:172.21.15.40:3300/0 conn(0x7fd548136c50 0x7fd548139030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:26.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.349+0000 7fd54ce65700 1 -- 172.21.15.40:0/3396250508 >> v2:172.21.15.40:3300/0 conn(0x7fd548136c50 msgr2=0x7fd548139030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:26.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.349+0000 7fd54ce65700 1 --2- 172.21.15.40:0/3396250508 >> v2:172.21.15.40:3300/0 conn(0x7fd548136c50 0x7fd548139030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.350+0000 7fd54ce65700 1 -- 172.21.15.40:0/3396250508 >> v1:172.21.15.40:6789/0 conn(0x7fd548133e00 legacy=0x7fd5481341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:26.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.350+0000 7fd54ce65700 1 -- 172.21.15.40:0/3396250508 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54809f0d0 con 0x7fd548139570 2023-09-30T22:30:26.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.350+0000 7fd5477fe700 1 --2- 172.21.15.40:0/3396250508 >> v2:172.21.15.40:3300/0 conn(0x7fd548136c50 0x7fd548139030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:26.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.350+0000 7fd54ce65700 1 --2- 172.21.15.40:0/3396250508 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd548139570 0x7fd54813b950 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fd540009e50 tx=0x7fd54000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e28d271bb7d9bf4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:26.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.350+0000 7fd546ffd700 1 -- 172.21.15.40:0/3396250508 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54000e070 con 0x7fd548139570 2023-09-30T22:30:26.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.350+0000 7fd546ffd700 1 -- 172.21.15.40:0/3396250508 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54000b910 con 0x7fd548139570 2023-09-30T22:30:26.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.350+0000 7fd546ffd700 1 -- 172.21.15.40:0/3396250508 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54000bcc0 con 0x7fd548139570 2023-09-30T22:30:26.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.350+0000 7fd54e8c8700 1 -- 172.21.15.40:0/3396250508 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd548139570 msgr2=0x7fd54813b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:26.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.350+0000 7fd54e8c8700 1 --2- 172.21.15.40:0/3396250508 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd548139570 0x7fd54813b950 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fd540009e50 tx=0x7fd54000b330 comp rx=0 tx=0).stop 2023-09-30T22:30:26.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.351+0000 7fd54e8c8700 1 -- 172.21.15.40:0/3396250508 shutdown_connections 2023-09-30T22:30:26.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.351+0000 7fd54e8c8700 1 --2- 172.21.15.40:0/3396250508 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd548139570 0x7fd54813b950 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.351+0000 7fd54e8c8700 1 --2- 172.21.15.40:0/3396250508 >> v2:172.21.15.40:3300/0 conn(0x7fd548136c50 0x7fd548139030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.351+0000 7fd54e8c8700 1 -- 172.21.15.40:0/3396250508 >> 172.21.15.40:0/3396250508 conn(0x7fd5480a2a00 msgr2=0x7fd5480a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:26.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.351+0000 7fd54e8c8700 1 -- 172.21.15.40:0/3396250508 shutdown_connections 2023-09-30T22:30:26.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.351+0000 7fd54e8c8700 1 -- 172.21.15.40:0/3396250508 wait complete. 2023-09-30T22:30:26.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.352+0000 7fd54e8c8700 1 Processor -- start 2023-09-30T22:30:26.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.352+0000 7fd54e8c8700 1 -- start start 2023-09-30T22:30:26.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.352+0000 7fd54e8c8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd548133e00 0x7fd548119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:26.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.352+0000 7fd54e8c8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd548136c50 0x7fd548119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:26.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.352+0000 7fd54e8c8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd548139570 0x7fd548119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:26.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.352+0000 7fd54e8c8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54811b370 con 0x7fd548136c50 2023-09-30T22:30:26.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.352+0000 7fd54e8c8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54812dce0 con 0x7fd548139570 2023-09-30T22:30:26.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.352+0000 7fd54e8c8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5480a0090 con 0x7fd548133e00 2023-09-30T22:30:26.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.352+0000 7fd5477fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd548136c50 0x7fd548119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:26.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.352+0000 7fd5477fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd548136c50 0x7fd548119590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53786/0 (socket says 172.21.15.40:53786) 2023-09-30T22:30:26.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.352+0000 7fd5477fe700 1 -- 172.21.15.40:0/3809444368 learned_addr learned my addr 172.21.15.40:0/3809444368 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:26.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.352+0000 7fd54ce65700 1 --2- 172.21.15.40:0/3809444368 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd548139570 0x7fd548119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:26.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.352+0000 7fd547fff700 1 --2- 172.21.15.40:0/3809444368 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd548133e00 0x7fd548119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:26.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.353+0000 7fd5477fe700 1 -- 172.21.15.40:0/3809444368 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd548133e00 msgr2=0x7fd548119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:26.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.353+0000 7fd5477fe700 1 --2- 172.21.15.40:0/3809444368 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd548133e00 0x7fd548119050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.353+0000 7fd5477fe700 1 -- 172.21.15.40:0/3809444368 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd548139570 msgr2=0x7fd548119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:26.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.353+0000 7fd5477fe700 1 --2- 172.21.15.40:0/3809444368 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd548139570 0x7fd548119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.353+0000 7fd5477fe700 1 -- 172.21.15.40:0/3809444368 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd53c0094a0 con 0x7fd548136c50 2023-09-30T22:30:26.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.353+0000 7fd5477fe700 1 --2- 172.21.15.40:0/3809444368 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd548136c50 0x7fd548119590 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00ebe0 tx=0x7fd53c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:26.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.353+0000 7fd544ff9700 1 -- 172.21.15.40:0/3809444368 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c00c850 con 0x7fd548136c50 2023-09-30T22:30:26.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.353+0000 7fd544ff9700 1 -- 172.21.15.40:0/3809444368 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53c00c9b0 con 0x7fd548136c50 2023-09-30T22:30:26.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.353+0000 7fd54e8c8700 1 -- 172.21.15.40:0/3809444368 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd540009b30 con 0x7fd548136c50 2023-09-30T22:30:26.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.353+0000 7fd544ff9700 1 -- 172.21.15.40:0/3809444368 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c00cd40 con 0x7fd548136c50 2023-09-30T22:30:26.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.353+0000 7fd54e8c8700 1 -- 172.21.15.40:0/3809444368 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5481303e0 con 0x7fd548136c50 2023-09-30T22:30:26.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.354+0000 7fd544ff9700 1 -- 172.21.15.40:0/3809444368 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd53c013470 con 0x7fd548136c50 2023-09-30T22:30:26.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.354+0000 7fd544ff9700 1 -- 172.21.15.40:0/3809444368 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd53c03f760 con 0x7fd548136c50 2023-09-30T22:30:26.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.354+0000 7fd54e8c8700 1 -- 172.21.15.40:0/3809444368 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd548062380 con 0x7fd548136c50 2023-09-30T22:30:26.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.363+0000 7fd544ff9700 1 -- 172.21.15.40:0/3809444368 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd53c013720 con 0x7fd548136c50 2023-09-30T22:30:26.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.394+0000 7f47230b9700 1 Processor -- start 2023-09-30T22:30:26.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.394+0000 7f47230b9700 1 -- start start 2023-09-30T22:30:26.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.395+0000 7f47230b9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f471c06f070 0x7f471c06f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:26.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.395+0000 7f47230b9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f471c06f980 0x7f471c097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:26.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.395+0000 7f47230b9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f471c06fdb0 0x7f471c0975d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:26.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.395+0000 7f47230b9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f471c070830 con 0x7f471c06f070 2023-09-30T22:30:26.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.395+0000 7f47230b9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f471c070ad0 con 0x7f471c06fdb0 2023-09-30T22:30:26.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.395+0000 7f47230b9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f471c070de0 con 0x7f471c06f980 2023-09-30T22:30:26.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.395+0000 7f4721656700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f471c06fdb0 0x7f471c0975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:26.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.395+0000 7f4721656700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f471c06fdb0 0x7f471c0975d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:34092/0 (socket says 172.21.15.40:34092) 2023-09-30T22:30:26.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.395+0000 7f4720e55700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f471c06f070 0x7f471c06f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:26.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.395+0000 7f4721656700 1 -- 172.21.15.40:0/1544358781 learned_addr learned my addr 172.21.15.40:0/1544358781 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:26.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.395+0000 7f471bfff700 1 --2- 172.21.15.40:0/1544358781 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f471c06f980 0x7f471c097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:26.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.395+0000 7f4721656700 1 -- 172.21.15.40:0/1544358781 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f471c06f980 msgr2=0x7f471c097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:26.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.395+0000 7f4721656700 1 --2- 172.21.15.40:0/1544358781 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f471c06f980 0x7f471c097090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.395+0000 7f4721656700 1 -- 172.21.15.40:0/1544358781 >> v2:172.21.15.40:3300/0 conn(0x7f471c06f070 msgr2=0x7f471c06f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:26.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.395+0000 7f4721656700 1 --2- 172.21.15.40:0/1544358781 >> v2:172.21.15.40:3300/0 conn(0x7f471c06f070 0x7f471c06f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.395+0000 7f4721656700 1 -- 172.21.15.40:0/1544358781 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f471c09fe20 con 0x7f471c06fdb0 2023-09-30T22:30:26.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.395+0000 7f4720e55700 1 --2- 172.21.15.40:0/1544358781 >> v2:172.21.15.40:3300/0 conn(0x7f471c06f070 0x7f471c06f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:26.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.396+0000 7f4721656700 1 --2- 172.21.15.40:0/1544358781 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f471c06fdb0 0x7f471c0975d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f4714009e50 tx=0x7f471400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29fba3f767a5ba68 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:26.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.396+0000 7f471b7fe700 1 -- 172.21.15.40:0/1544358781 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471400e070 con 0x7f471c06fdb0 2023-09-30T22:30:26.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.396+0000 7f471b7fe700 1 -- 172.21.15.40:0/1544358781 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471400b910 con 0x7f471c06fdb0 2023-09-30T22:30:26.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.396+0000 7f471b7fe700 1 -- 172.21.15.40:0/1544358781 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471400bcc0 con 0x7f471c06fdb0 2023-09-30T22:30:26.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.396+0000 7f47230b9700 1 -- 172.21.15.40:0/1544358781 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f471c06fdb0 msgr2=0x7f471c0975d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:26.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.396+0000 7f47230b9700 1 --2- 172.21.15.40:0/1544358781 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f471c06fdb0 0x7f471c0975d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f4714009e50 tx=0x7f471400b330 comp rx=0 tx=0).stop 2023-09-30T22:30:26.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.396+0000 7f47230b9700 1 -- 172.21.15.40:0/1544358781 shutdown_connections 2023-09-30T22:30:26.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.396+0000 7f47230b9700 1 --2- 172.21.15.40:0/1544358781 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f471c06fdb0 0x7f471c0975d0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.396+0000 7f47230b9700 1 --2- 172.21.15.40:0/1544358781 >> v2:172.21.15.40:3300/0 conn(0x7f471c06f070 0x7f471c06f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.396+0000 7f47230b9700 1 --2- 172.21.15.40:0/1544358781 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f471c06f980 0x7f471c097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.397+0000 7f47230b9700 1 -- 172.21.15.40:0/1544358781 >> 172.21.15.40:0/1544358781 conn(0x7f471c0a41a0 msgr2=0x7f471c0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:26.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.397+0000 7f47230b9700 1 -- 172.21.15.40:0/1544358781 shutdown_connections 2023-09-30T22:30:26.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.397+0000 7f47230b9700 1 -- 172.21.15.40:0/1544358781 wait complete. 2023-09-30T22:30:26.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.397+0000 7f47230b9700 1 Processor -- start 2023-09-30T22:30:26.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.398+0000 7f47230b9700 1 -- start start 2023-09-30T22:30:26.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.398+0000 7f47230b9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f471c06f070 0x7f471c06c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:26.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.398+0000 7f47230b9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f471c06f980 0x7f471c06ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:26.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.398+0000 7f47230b9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f471c06fdb0 0x7f471c06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:26.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.398+0000 7f47230b9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471c08b790 con 0x7f471c06f070 2023-09-30T22:30:26.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.398+0000 7f47230b9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f471c08b1e0 con 0x7f471c06fdb0 2023-09-30T22:30:26.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.398+0000 7f47230b9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f471c06e600 con 0x7f471c06f980 2023-09-30T22:30:26.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.398+0000 7f4720e55700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f471c06f070 0x7f471c06c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:26.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.398+0000 7f4721656700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f471c06fdb0 0x7f471c06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:26.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.398+0000 7f4720e55700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f471c06f070 0x7f471c06c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53802/0 (socket says 172.21.15.40:53802) 2023-09-30T22:30:26.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.398+0000 7f4720e55700 1 -- 172.21.15.40:0/1563998477 learned_addr learned my addr 172.21.15.40:0/1563998477 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:26.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.398+0000 7f471bfff700 1 --2- 172.21.15.40:0/1563998477 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f471c06f980 0x7f471c06ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:26.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.399+0000 7f4721656700 1 -- 172.21.15.40:0/1563998477 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f471c06f980 msgr2=0x7f471c06ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:26.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.399+0000 7f4721656700 1 --2- 172.21.15.40:0/1563998477 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f471c06f980 0x7f471c06ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.399+0000 7f4721656700 1 -- 172.21.15.40:0/1563998477 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f471c06f070 msgr2=0x7f471c06c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:26.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.399+0000 7f4721656700 1 --2- 172.21.15.40:0/1563998477 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f471c06f070 0x7f471c06c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.399+0000 7f4721656700 1 -- 172.21.15.40:0/1563998477 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47100094a0 con 0x7f471c06fdb0 2023-09-30T22:30:26.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.399+0000 7f471bfff700 1 --2- 172.21.15.40:0/1563998477 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f471c06f980 0x7f471c06ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:26.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.399+0000 7f4720e55700 1 --2- 172.21.15.40:0/1563998477 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f471c06f070 0x7f471c06c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:26.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.399+0000 7f4721656700 1 --2- 172.21.15.40:0/1563998477 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f471c06fdb0 0x7f471c06d410 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f4714015000 tx=0x7f4714004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:26.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.399+0000 7f47197fa700 1 -- 172.21.15.40:0/1563998477 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4714004450 con 0x7f471c06fdb0 2023-09-30T22:30:26.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.399+0000 7f47197fa700 1 -- 172.21.15.40:0/1563998477 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47140045f0 con 0x7f471c06fdb0 2023-09-30T22:30:26.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.399+0000 7f47197fa700 1 -- 172.21.15.40:0/1563998477 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47140099b0 con 0x7f471c06fdb0 2023-09-30T22:30:26.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.399+0000 7f47230b9700 1 -- 172.21.15.40:0/1563998477 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4714009b30 con 0x7f471c06fdb0 2023-09-30T22:30:26.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.399+0000 7f47230b9700 1 -- 172.21.15.40:0/1563998477 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f471c12bef0 con 0x7f471c06fdb0 2023-09-30T22:30:26.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.400+0000 7f47197fa700 1 -- 172.21.15.40:0/1563998477 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f471401c410 con 0x7f471c06fdb0 2023-09-30T22:30:26.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.400+0000 7f47197fa700 1 -- 172.21.15.40:0/1563998477 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4714040f20 con 0x7f471c06fdb0 2023-09-30T22:30:26.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.400+0000 7f47230b9700 1 -- 172.21.15.40:0/1563998477 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f471c062380 con 0x7f471c06fdb0 2023-09-30T22:30:26.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.405+0000 7f47197fa700 1 -- 172.21.15.40:0/1563998477 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f471401c6c0 con 0x7f471c06fdb0 2023-09-30T22:30:26.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.498+0000 7fc6ac528700 1 -- 172.21.15.40:0/992439659 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc6a4074720 con 0x7fc6a409d920 2023-09-30T22:30:26.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.499+0000 7fc69affd700 1 -- 172.21.15.40:0/992439659 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc6a0017070 con 0x7fc6a409d920 2023-09-30T22:30:26.499 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:26.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.500+0000 7fc6ac528700 1 -- 172.21.15.40:0/992439659 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6a409d920 msgr2=0x7fc6a411db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:26.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.501+0000 7fc6ac528700 1 --2- 172.21.15.40:0/992439659 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6a409d920 0x7fc6a411db40 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fc6a000e930 tx=0x7fc6a000ec40 comp rx=0 tx=0).stop 2023-09-30T22:30:26.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.501+0000 7fc6ac528700 1 -- 172.21.15.40:0/992439659 shutdown_connections 2023-09-30T22:30:26.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.501+0000 7fc6ac528700 1 --2- 172.21.15.40:0/992439659 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6a41307d0 0x7fc6a411e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.501+0000 7fc6ac528700 1 --2- 172.21.15.40:0/992439659 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6a409d920 0x7fc6a411db40 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.501+0000 7fc6ac528700 1 --2- 172.21.15.40:0/992439659 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc6a4133ca0 0x7fc6a411e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.501+0000 7fc6ac528700 1 -- 172.21.15.40:0/992439659 >> 172.21.15.40:0/992439659 conn(0x7fc6a409fb20 msgr2=0x7fc6a4133580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:26.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.501+0000 7fc6ac528700 1 -- 172.21.15.40:0/992439659 shutdown_connections 2023-09-30T22:30:26.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.501+0000 7fc6ac528700 1 -- 172.21.15.40:0/992439659 wait complete. 2023-09-30T22:30:26.514 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:26.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.562+0000 7fd54e8c8700 1 -- 172.21.15.40:0/3809444368 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd548074330 con 0x7fd548136c50 2023-09-30T22:30:26.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.563+0000 7fd544ff9700 1 -- 172.21.15.40:0/3809444368 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd53c021020 con 0x7fd548136c50 2023-09-30T22:30:26.563 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:26.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.565+0000 7fd54e8c8700 1 -- 172.21.15.40:0/3809444368 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd548136c50 msgr2=0x7fd548119590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:26.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.565+0000 7fd54e8c8700 1 --2- 172.21.15.40:0/3809444368 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd548136c50 0x7fd548119590 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00ebe0 tx=0x7fd53c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.565+0000 7fd54e8c8700 1 -- 172.21.15.40:0/3809444368 shutdown_connections 2023-09-30T22:30:26.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.565+0000 7fd54e8c8700 1 --2- 172.21.15.40:0/3809444368 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd548133e00 0x7fd548119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.565+0000 7fd54e8c8700 1 --2- 172.21.15.40:0/3809444368 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd548139570 0x7fd548119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.565+0000 7fd54e8c8700 1 --2- 172.21.15.40:0/3809444368 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd548136c50 0x7fd548119590 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.565+0000 7fd54e8c8700 1 -- 172.21.15.40:0/3809444368 >> 172.21.15.40:0/3809444368 conn(0x7fd5480a2a00 msgr2=0x7fd54809b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:26.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.565+0000 7fd54e8c8700 1 -- 172.21.15.40:0/3809444368 shutdown_connections 2023-09-30T22:30:26.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.565+0000 7fd54e8c8700 1 -- 172.21.15.40:0/3809444368 wait complete. 2023-09-30T22:30:26.578 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:26.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.602+0000 7f47230b9700 1 -- 172.21.15.40:0/1563998477 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f471c06dba0 con 0x7f471c06fdb0 2023-09-30T22:30:26.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.602+0000 7f47197fa700 1 -- 172.21.15.40:0/1563998477 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f471402a030 con 0x7f471c06fdb0 2023-09-30T22:30:26.603 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:26.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.604+0000 7f47230b9700 1 -- 172.21.15.40:0/1563998477 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f471c06fdb0 msgr2=0x7f471c06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:26.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.604+0000 7f47230b9700 1 --2- 172.21.15.40:0/1563998477 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f471c06fdb0 0x7f471c06d410 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f4714015000 tx=0x7f4714004ad0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.604+0000 7f47230b9700 1 -- 172.21.15.40:0/1563998477 shutdown_connections 2023-09-30T22:30:26.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.604+0000 7f47230b9700 1 --2- 172.21.15.40:0/1563998477 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f471c06fdb0 0x7f471c06d410 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.604+0000 7f47230b9700 1 --2- 172.21.15.40:0/1563998477 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f471c06f070 0x7f471c06c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.604+0000 7f47230b9700 1 --2- 172.21.15.40:0/1563998477 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f471c06f980 0x7f471c06ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.604+0000 7f47230b9700 1 -- 172.21.15.40:0/1563998477 >> 172.21.15.40:0/1563998477 conn(0x7f471c0a41a0 msgr2=0x7f471c0973c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:26.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.604+0000 7f47230b9700 1 -- 172.21.15.40:0/1563998477 shutdown_connections 2023-09-30T22:30:26.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.604+0000 7f47230b9700 1 -- 172.21.15.40:0/1563998477 wait complete. 2023-09-30T22:30:26.617 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:26.710 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:26.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.837+0000 7ffa8a9c3700 1 Processor -- start 2023-09-30T22:30:26.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.837+0000 7ffa8a9c3700 1 -- start start 2023-09-30T22:30:26.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.838+0000 7ffa8a9c3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa8406f070 0x7ffa8406f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:26.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.838+0000 7ffa8a9c3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffa8406fdb0 0x7ffa840977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:26.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.838+0000 7ffa8a9c3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa84070830 con 0x7ffa8406f980 2023-09-30T22:30:26.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.838+0000 7ffa8a9c3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa84071af0 con 0x7ffa8406fdb0 2023-09-30T22:30:26.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.838+0000 7ffa8a9c3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa84070ad0 con 0x7ffa8406f070 2023-09-30T22:30:26.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.838+0000 7ffa83fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa8406f070 0x7ffa8406f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:26.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.838+0000 7ffa88f60700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffa8406fdb0 0x7ffa840977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:26.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.838+0000 7ffa88f60700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffa8406fdb0 0x7ffa840977a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53806/0 (socket says 172.21.15.40:53806) 2023-09-30T22:30:26.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.838+0000 7ffa83fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa8406f070 0x7ffa8406f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51486/0 (socket says 172.21.15.40:51486) 2023-09-30T22:30:26.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.838+0000 7ffa88f60700 1 -- 172.21.15.40:0/2748421091 learned_addr learned my addr 172.21.15.40:0/2748421091 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:26.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.838+0000 7ffa83fff700 1 -- 172.21.15.40:0/2748421091 >> v2:172.21.15.40:3300/0 conn(0x7ffa8406fdb0 msgr2=0x7ffa840977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:26.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.838+0000 7ffa83fff700 1 --2- 172.21.15.40:0/2748421091 >> v2:172.21.15.40:3300/0 conn(0x7ffa8406fdb0 0x7ffa840977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.838+0000 7ffa83fff700 1 -- 172.21.15.40:0/2748421091 >> v1:172.21.15.40:6789/0 conn(0x7ffa8406f980 legacy=0x7ffa84097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:26.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.838+0000 7ffa83fff700 1 -- 172.21.15.40:0/2748421091 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa84070de0 con 0x7ffa8406f070 2023-09-30T22:30:26.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.838+0000 7ffa88f60700 1 --2- 172.21.15.40:0/2748421091 >> v2:172.21.15.40:3300/0 conn(0x7ffa8406fdb0 0x7ffa840977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:26.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.838+0000 7ffa83fff700 1 --2- 172.21.15.40:0/2748421091 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa8406f070 0x7ffa8406f440 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ffa740098a0 tx=0x7ffa74009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e49accc74bb0685 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:26.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.838+0000 7ffa82ffd700 1 -- 172.21.15.40:0/2748421091 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa74011830 con 0x7ffa8406f070 2023-09-30T22:30:26.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.839+0000 7ffa82ffd700 1 -- 172.21.15.40:0/2748421091 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa74011990 con 0x7ffa8406f070 2023-09-30T22:30:26.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.839+0000 7ffa82ffd700 1 -- 172.21.15.40:0/2748421091 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa74011d20 con 0x7ffa8406f070 2023-09-30T22:30:26.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.839+0000 7ffa8a9c3700 1 -- 172.21.15.40:0/2748421091 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa8406f070 msgr2=0x7ffa8406f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:26.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.839+0000 7ffa8a9c3700 1 --2- 172.21.15.40:0/2748421091 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa8406f070 0x7ffa8406f440 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ffa740098a0 tx=0x7ffa74009bb0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.839+0000 7ffa8a9c3700 1 -- 172.21.15.40:0/2748421091 shutdown_connections 2023-09-30T22:30:26.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.839+0000 7ffa8a9c3700 1 --2- 172.21.15.40:0/2748421091 >> v2:172.21.15.40:3300/0 conn(0x7ffa8406fdb0 0x7ffa840977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.839+0000 7ffa8a9c3700 1 --2- 172.21.15.40:0/2748421091 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa8406f070 0x7ffa8406f440 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.839+0000 7ffa8a9c3700 1 -- 172.21.15.40:0/2748421091 >> 172.21.15.40:0/2748421091 conn(0x7ffa840a41a0 msgr2=0x7ffa840a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:26.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.839+0000 7ffa8a9c3700 1 -- 172.21.15.40:0/2748421091 shutdown_connections 2023-09-30T22:30:26.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.839+0000 7ffa8a9c3700 1 -- 172.21.15.40:0/2748421091 wait complete. 2023-09-30T22:30:26.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.840+0000 7ffa8a9c3700 1 Processor -- start 2023-09-30T22:30:26.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.840+0000 7ffa8a9c3700 1 -- start start 2023-09-30T22:30:26.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.841+0000 7ffa8a9c3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa8406f070 0x7ffa8406c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:26.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.841+0000 7ffa8a9c3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa8406f980 0x7ffa8406ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:26.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.841+0000 7ffa8a9c3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa8406fdb0 0x7ffa8406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:26.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.841+0000 7ffa8a9c3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa84131f80 con 0x7ffa8406f980 2023-09-30T22:30:26.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.841+0000 7ffa8a9c3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8408b190 con 0x7ffa8406f070 2023-09-30T22:30:26.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.841+0000 7ffa8a9c3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa84096780 con 0x7ffa8406fdb0 2023-09-30T22:30:26.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.841+0000 7ffa837fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa8406f980 0x7ffa8406ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:26.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.841+0000 7ffa88f60700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa8406fdb0 0x7ffa8406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:26.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.841+0000 7ffa837fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa8406f980 0x7ffa8406ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53820/0 (socket says 172.21.15.40:53820) 2023-09-30T22:30:26.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.841+0000 7ffa88f60700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa8406fdb0 0x7ffa8406d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51494/0 (socket says 172.21.15.40:51494) 2023-09-30T22:30:26.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.841+0000 7ffa837fe700 1 -- 172.21.15.40:0/4134799103 learned_addr learned my addr 172.21.15.40:0/4134799103 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:26.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.841+0000 7ffa83fff700 1 --2- 172.21.15.40:0/4134799103 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa8406f070 0x7ffa8406c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:26.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.841+0000 7ffa88f60700 1 -- 172.21.15.40:0/4134799103 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa8406f070 msgr2=0x7ffa8406c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:26.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.841+0000 7ffa88f60700 1 --2- 172.21.15.40:0/4134799103 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa8406f070 0x7ffa8406c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.841+0000 7ffa88f60700 1 -- 172.21.15.40:0/4134799103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa8406f980 msgr2=0x7ffa8406ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:26.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.841+0000 7ffa88f60700 1 --2- 172.21.15.40:0/4134799103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa8406f980 0x7ffa8406ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:26.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.841+0000 7ffa88f60700 1 -- 172.21.15.40:0/4134799103 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7c009b30 con 0x7ffa8406fdb0 2023-09-30T22:30:26.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.841+0000 7ffa88f60700 1 --2- 172.21.15.40:0/4134799103 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa8406fdb0 0x7ffa8406d410 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c00ef90 tx=0x7ffa7c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:26.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.841+0000 7ffa80ff9700 1 -- 172.21.15.40:0/4134799103 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c00ca80 con 0x7ffa8406fdb0 2023-09-30T22:30:26.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.842+0000 7ffa80ff9700 1 -- 172.21.15.40:0/4134799103 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7c00f040 con 0x7ffa8406fdb0 2023-09-30T22:30:26.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.842+0000 7ffa80ff9700 1 -- 172.21.15.40:0/4134799103 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c00ce20 con 0x7ffa8406fdb0 2023-09-30T22:30:26.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.842+0000 7ffa8a9c3700 1 -- 172.21.15.40:0/4134799103 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa740094a0 con 0x7ffa8406fdb0 2023-09-30T22:30:26.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.842+0000 7ffa8a9c3700 1 -- 172.21.15.40:0/4134799103 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa84129430 con 0x7ffa8406fdb0 2023-09-30T22:30:26.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.842+0000 7ffa80ff9700 1 -- 172.21.15.40:0/4134799103 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffa7c014480 con 0x7ffa8406fdb0 2023-09-30T22:30:26.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.842+0000 7ffa80ff9700 1 -- 172.21.15.40:0/4134799103 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ffa7c03fd00 con 0x7ffa8406fdb0 2023-09-30T22:30:26.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.842+0000 7ffa8a9c3700 1 -- 172.21.15.40:0/4134799103 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa8412c2d0 con 0x7ffa8406fdb0 2023-09-30T22:30:26.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:26.847+0000 7ffa80ff9700 1 -- 172.21.15.40:0/4134799103 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa7c01c950 con 0x7ffa8406fdb0 2023-09-30T22:30:27.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.043+0000 7ffa8a9c3700 1 -- 172.21.15.40:0/4134799103 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ffa84062380 con 0x7ffa8406fdb0 2023-09-30T22:30:27.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.044+0000 7ffa80ff9700 1 -- 172.21.15.40:0/4134799103 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffa7c02c090 con 0x7ffa8406fdb0 2023-09-30T22:30:27.045 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:27.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.046+0000 7ffa8a9c3700 1 -- 172.21.15.40:0/4134799103 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa8406fdb0 msgr2=0x7ffa8406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:27.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.046+0000 7ffa8a9c3700 1 --2- 172.21.15.40:0/4134799103 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa8406fdb0 0x7ffa8406d410 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c00ef90 tx=0x7ffa7c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.046+0000 7ffa8a9c3700 1 -- 172.21.15.40:0/4134799103 shutdown_connections 2023-09-30T22:30:27.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.046+0000 7ffa8a9c3700 1 --2- 172.21.15.40:0/4134799103 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffa8406fdb0 0x7ffa8406d410 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.046+0000 7ffa8a9c3700 1 --2- 172.21.15.40:0/4134799103 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffa8406f070 0x7ffa8406c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.046+0000 7ffa8a9c3700 1 --2- 172.21.15.40:0/4134799103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa8406f980 0x7ffa8406ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.046+0000 7ffa8a9c3700 1 -- 172.21.15.40:0/4134799103 >> 172.21.15.40:0/4134799103 conn(0x7ffa840a41a0 msgr2=0x7ffa840a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:27.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.046+0000 7ffa8a9c3700 1 -- 172.21.15.40:0/4134799103 shutdown_connections 2023-09-30T22:30:27.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.046+0000 7ffa8a9c3700 1 -- 172.21.15.40:0/4134799103 wait complete. 2023-09-30T22:30:27.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:27.515 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:27.578 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:27.618 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:27.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.653+0000 7ff09b513700 1 Processor -- start 2023-09-30T22:30:27.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.653+0000 7ff09b513700 1 -- start start 2023-09-30T22:30:27.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.654+0000 7ff09b513700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff09412f070 0x7ff094135c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.654+0000 7ff09b513700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff094136170 0x7ff094138550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.654+0000 7ff09b513700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff09409ab70 con 0x7ff09412e590 2023-09-30T22:30:27.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.654+0000 7ff09b513700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff09412f470 con 0x7ff09412f070 2023-09-30T22:30:27.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.654+0000 7ff09b513700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff09409b270 con 0x7ff094136170 2023-09-30T22:30:27.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.654+0000 7ff098aae700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff09412f070 0x7ff094135c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.654+0000 7ff099ab0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff094136170 0x7ff094138550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.654+0000 7ff098aae700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff09412f070 0x7ff094135c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53832/0 (socket says 172.21.15.40:53832) 2023-09-30T22:30:27.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.654+0000 7ff099ab0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff094136170 0x7ff094138550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51508/0 (socket says 172.21.15.40:51508) 2023-09-30T22:30:27.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.654+0000 7ff098aae700 1 -- 172.21.15.40:0/486062885 learned_addr learned my addr 172.21.15.40:0/486062885 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:27.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.654+0000 7ff098aae700 1 -- 172.21.15.40:0/486062885 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff094136170 msgr2=0x7ff094138550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:27.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.654+0000 7ff098aae700 1 --2- 172.21.15.40:0/486062885 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff094136170 0x7ff094138550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.654+0000 7ff098aae700 1 -- 172.21.15.40:0/486062885 >> v1:172.21.15.40:6789/0 conn(0x7ff09412e590 legacy=0x7ff09412e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:27.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.654+0000 7ff098aae700 1 -- 172.21.15.40:0/486062885 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09409bd70 con 0x7ff09412f070 2023-09-30T22:30:27.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.654+0000 7ff099ab0700 1 --2- 172.21.15.40:0/486062885 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff094136170 0x7ff094138550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:27.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.654+0000 7ff098aae700 1 --2- 172.21.15.40:0/486062885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff09412f070 0x7ff094135c30 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7ff0840098f0 tx=0x7ff084009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e8dfae6dc71198b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:27.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.655+0000 7ff08bfff700 1 -- 172.21.15.40:0/486062885 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff084011830 con 0x7ff09412f070 2023-09-30T22:30:27.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.655+0000 7ff08bfff700 1 -- 172.21.15.40:0/486062885 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff084011990 con 0x7ff09412f070 2023-09-30T22:30:27.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.655+0000 7ff08bfff700 1 -- 172.21.15.40:0/486062885 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff084011d20 con 0x7ff09412f070 2023-09-30T22:30:27.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.655+0000 7ff09b513700 1 -- 172.21.15.40:0/486062885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff09412f070 msgr2=0x7ff094135c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:27.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.655+0000 7ff09b513700 1 --2- 172.21.15.40:0/486062885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff09412f070 0x7ff094135c30 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7ff0840098f0 tx=0x7ff084009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:27.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.655+0000 7ff09b513700 1 -- 172.21.15.40:0/486062885 shutdown_connections 2023-09-30T22:30:27.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.655+0000 7ff09b513700 1 --2- 172.21.15.40:0/486062885 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff094136170 0x7ff094138550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.655+0000 7ff09b513700 1 --2- 172.21.15.40:0/486062885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff09412f070 0x7ff094135c30 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.655+0000 7ff09b513700 1 -- 172.21.15.40:0/486062885 >> 172.21.15.40:0/486062885 conn(0x7ff0940a2a00 msgr2=0x7ff0940a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:27.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.656+0000 7ff09b513700 1 -- 172.21.15.40:0/486062885 shutdown_connections 2023-09-30T22:30:27.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.656+0000 7ff09b513700 1 -- 172.21.15.40:0/486062885 wait complete. 2023-09-30T22:30:27.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.656+0000 7ff09b513700 1 Processor -- start 2023-09-30T22:30:27.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.657+0000 7ff09b513700 1 -- start start 2023-09-30T22:30:27.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.657+0000 7ff09b513700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff09412e590 0x7ff09406d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.657+0000 7ff09b513700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff09412f070 0x7ff09406db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.657+0000 7ff09b513700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff094136170 0x7ff09406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.657+0000 7ff09b513700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09406f6f0 con 0x7ff09412f070 2023-09-30T22:30:27.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.657+0000 7ff09b513700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff094070970 con 0x7ff094136170 2023-09-30T22:30:27.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.657+0000 7ff09b513700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff09406fda0 con 0x7ff09412e590 2023-09-30T22:30:27.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.657+0000 7ff098aae700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff09412f070 0x7ff09406db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.657+0000 7ff098aae700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff09412f070 0x7ff09406db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53848/0 (socket says 172.21.15.40:53848) 2023-09-30T22:30:27.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.657+0000 7ff098aae700 1 -- 172.21.15.40:0/1204000491 learned_addr learned my addr 172.21.15.40:0/1204000491 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:27.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.657+0000 7ff099ab0700 1 --2- 172.21.15.40:0/1204000491 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff094136170 0x7ff09406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.657+0000 7ff0992af700 1 --2- 172.21.15.40:0/1204000491 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff09412e590 0x7ff09406d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.657+0000 7ff098aae700 1 -- 172.21.15.40:0/1204000491 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff09412e590 msgr2=0x7ff09406d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:27.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.657+0000 7ff098aae700 1 --2- 172.21.15.40:0/1204000491 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff09412e590 0x7ff09406d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.657+0000 7ff098aae700 1 -- 172.21.15.40:0/1204000491 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff094136170 msgr2=0x7ff09406e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:27.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.657+0000 7ff098aae700 1 --2- 172.21.15.40:0/1204000491 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff094136170 0x7ff09406e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.658+0000 7ff098aae700 1 -- 172.21.15.40:0/1204000491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08c009a70 con 0x7ff09412f070 2023-09-30T22:30:27.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.658+0000 7ff098aae700 1 --2- 172.21.15.40:0/1204000491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff09412f070 0x7ff09406db50 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7ff084009c40 tx=0x7ff084004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:27.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.658+0000 7ff089ffb700 1 -- 172.21.15.40:0/1204000491 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0840043c0 con 0x7ff09412f070 2023-09-30T22:30:27.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.658+0000 7ff09b513700 1 -- 172.21.15.40:0/1204000491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff084009550 con 0x7ff09412f070 2023-09-30T22:30:27.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.658+0000 7ff09b513700 1 -- 172.21.15.40:0/1204000491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff09406e770 con 0x7ff09412f070 2023-09-30T22:30:27.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.658+0000 7ff089ffb700 1 -- 172.21.15.40:0/1204000491 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08401f070 con 0x7ff09412f070 2023-09-30T22:30:27.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.658+0000 7ff089ffb700 1 -- 172.21.15.40:0/1204000491 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0840036a0 con 0x7ff09412f070 2023-09-30T22:30:27.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.659+0000 7ff089ffb700 1 -- 172.21.15.40:0/1204000491 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff084021030 con 0x7ff09412f070 2023-09-30T22:30:27.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.659+0000 7ff089ffb700 1 -- 172.21.15.40:0/1204000491 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff084040b70 con 0x7ff09412f070 2023-09-30T22:30:27.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.659+0000 7ff09b513700 1 -- 172.21.15.40:0/1204000491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff094062380 con 0x7ff09412f070 2023-09-30T22:30:27.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.664+0000 7ff089ffb700 1 -- 172.21.15.40:0/1204000491 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff084015020 con 0x7ff09412f070 2023-09-30T22:30:27.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.735+0000 7f128f648700 1 Processor -- start 2023-09-30T22:30:27.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.736+0000 7f128f648700 1 -- start start 2023-09-30T22:30:27.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.736+0000 7f128f648700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f128806f070 0x7f128806f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.736+0000 7f128f648700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f128806fdb0 0x7f12880977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.736+0000 7f128f648700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1288070830 con 0x7f128806f980 2023-09-30T22:30:27.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.736+0000 7f128f648700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1288070ad0 con 0x7f128806f070 2023-09-30T22:30:27.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.736+0000 7f128f648700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1288070de0 con 0x7f128806fdb0 2023-09-30T22:30:27.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.736+0000 7f128d3e4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f128806f070 0x7f128806f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.736+0000 7f128d3e4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f128806f070 0x7f128806f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:34148/0 (socket says 172.21.15.40:34148) 2023-09-30T22:30:27.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.736+0000 7f128d3e4700 1 -- 172.21.15.40:0/875985991 learned_addr learned my addr 172.21.15.40:0/875985991 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:27.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.737+0000 7f128dbe5700 1 --2- 172.21.15.40:0/875985991 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f128806fdb0 0x7f12880977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.737+0000 7f128d3e4700 1 -- 172.21.15.40:0/875985991 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f128806fdb0 msgr2=0x7f12880977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:27.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.737+0000 7f128d3e4700 1 --2- 172.21.15.40:0/875985991 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f128806fdb0 0x7f12880977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.737+0000 7f128d3e4700 1 -- 172.21.15.40:0/875985991 >> v1:172.21.15.40:6789/0 conn(0x7f128806f980 legacy=0x7f1288097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:27.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.737+0000 7f128d3e4700 1 -- 172.21.15.40:0/875985991 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128809fe20 con 0x7f128806f070 2023-09-30T22:30:27.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.737+0000 7f1287fff700 1 -- 172.21.15.40:0/875985991 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 354845881 0 0) 0x7f1288070830 con 0x7f128806f980 2023-09-30T22:30:27.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.737+0000 7f128dbe5700 1 --2- 172.21.15.40:0/875985991 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f128806fdb0 0x7f12880977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:30:27.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.737+0000 7f128d3e4700 1 --2- 172.21.15.40:0/875985991 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f128806f070 0x7f128806f440 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f1278009920 tx=0x7f1278009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f477fc9910f51c20 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:27.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.737+0000 7f1287fff700 1 -- 172.21.15.40:0/875985991 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127800ba60 con 0x7f128806f070 2023-09-30T22:30:27.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.737+0000 7f1287fff700 1 -- 172.21.15.40:0/875985991 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127800bbc0 con 0x7f128806f070 2023-09-30T22:30:27.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.737+0000 7f1287fff700 1 -- 172.21.15.40:0/875985991 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1278009e70 con 0x7f128806f070 2023-09-30T22:30:27.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.738+0000 7f128f648700 1 -- 172.21.15.40:0/875985991 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f128806f070 msgr2=0x7f128806f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:27.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.738+0000 7f128f648700 1 --2- 172.21.15.40:0/875985991 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f128806f070 0x7f128806f440 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f1278009920 tx=0x7f1278009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:27.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.738+0000 7f128f648700 1 -- 172.21.15.40:0/875985991 shutdown_connections 2023-09-30T22:30:27.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.738+0000 7f128f648700 1 --2- 172.21.15.40:0/875985991 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f128806fdb0 0x7f12880977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.738+0000 7f128f648700 1 --2- 172.21.15.40:0/875985991 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f128806f070 0x7f128806f440 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.738+0000 7f128f648700 1 -- 172.21.15.40:0/875985991 >> 172.21.15.40:0/875985991 conn(0x7f12880a41a0 msgr2=0x7f12880a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:27.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.738+0000 7f128f648700 1 -- 172.21.15.40:0/875985991 shutdown_connections 2023-09-30T22:30:27.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.738+0000 7f128f648700 1 -- 172.21.15.40:0/875985991 wait complete. 2023-09-30T22:30:27.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.739+0000 7f128f648700 1 Processor -- start 2023-09-30T22:30:27.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.739+0000 7f128f648700 1 -- start start 2023-09-30T22:30:27.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.740+0000 7f128f648700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f128806f070 0x7f128806c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.740+0000 7f128f648700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f128806f980 0x7f128806ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.740+0000 7f128f648700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f128806fdb0 0x7f128806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.740+0000 7f128f648700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128808c010 con 0x7f128806f070 2023-09-30T22:30:27.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.740+0000 7f128f648700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1288097020 con 0x7f128806fdb0 2023-09-30T22:30:27.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.740+0000 7f128f648700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1288096e30 con 0x7f128806f980 2023-09-30T22:30:27.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.740+0000 7f128cbe3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f128806f980 0x7f128806ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.740+0000 7f128cbe3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f128806f980 0x7f128806ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51528/0 (socket says 172.21.15.40:51528) 2023-09-30T22:30:27.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.740+0000 7f128cbe3700 1 -- 172.21.15.40:0/4247915953 learned_addr learned my addr 172.21.15.40:0/4247915953 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:27.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.740+0000 7f128dbe5700 1 --2- 172.21.15.40:0/4247915953 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f128806fdb0 0x7f128806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.740+0000 7f128d3e4700 1 --2- 172.21.15.40:0/4247915953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f128806f070 0x7f128806c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.740+0000 7f128cbe3700 1 -- 172.21.15.40:0/4247915953 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f128806fdb0 msgr2=0x7f128806d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:27.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.740+0000 7f128cbe3700 1 --2- 172.21.15.40:0/4247915953 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f128806fdb0 0x7f128806d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.740+0000 7f128cbe3700 1 -- 172.21.15.40:0/4247915953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f128806f070 msgr2=0x7f128806c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:27.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.740+0000 7f128cbe3700 1 --2- 172.21.15.40:0/4247915953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f128806f070 0x7f128806c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.740+0000 7f128cbe3700 1 -- 172.21.15.40:0/4247915953 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1278009550 con 0x7f128806f980 2023-09-30T22:30:27.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.740+0000 7f128d3e4700 1 --2- 172.21.15.40:0/4247915953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f128806f070 0x7f128806c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:30:27.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.740+0000 7f128cbe3700 1 --2- 172.21.15.40:0/4247915953 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f128806f980 0x7f128806ced0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f127c00c550 tx=0x7f127c00c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:27.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.740+0000 7f1285ffb700 1 -- 172.21.15.40:0/4247915953 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127c0054e0 con 0x7f128806f980 2023-09-30T22:30:27.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.740+0000 7f1285ffb700 1 -- 172.21.15.40:0/4247915953 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127c003680 con 0x7f128806f980 2023-09-30T22:30:27.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.741+0000 7f128f648700 1 -- 172.21.15.40:0/4247915953 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12881292a0 con 0x7f128806f980 2023-09-30T22:30:27.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.741+0000 7f1285ffb700 1 -- 172.21.15.40:0/4247915953 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127c003a30 con 0x7f128806f980 2023-09-30T22:30:27.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.741+0000 7f128f648700 1 -- 172.21.15.40:0/4247915953 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f128806e090 con 0x7f128806f980 2023-09-30T22:30:27.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.742+0000 7f128f648700 1 -- 172.21.15.40:0/4247915953 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f128808b250 con 0x7f128806f980 2023-09-30T22:30:27.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.742+0000 7f1285ffb700 1 -- 172.21.15.40:0/4247915953 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f127c003b90 con 0x7f128806f980 2023-09-30T22:30:27.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.742+0000 7f1285ffb700 1 -- 172.21.15.40:0/4247915953 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f127c03ebf0 con 0x7f128806f980 2023-09-30T22:30:27.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.747+0000 7f1285ffb700 1 -- 172.21.15.40:0/4247915953 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f127c003e40 con 0x7f128806f980 2023-09-30T22:30:27.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.775+0000 7f498e19c700 1 Processor -- start 2023-09-30T22:30:27.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.775+0000 7f498e19c700 1 -- start start 2023-09-30T22:30:27.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.775+0000 7f498e19c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f498809fbb0 0x7f498806c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.775+0000 7f498e19c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4988139380 0x7f498813b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.776+0000 7f498e19c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49880a0a20 con 0x7f49880a0590 2023-09-30T22:30:27.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.776+0000 7f498e19c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f498809ff80 con 0x7f4988139380 2023-09-30T22:30:27.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.776+0000 7f498e19c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f498806da80 con 0x7f498809fbb0 2023-09-30T22:30:27.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.776+0000 7f49877fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f498809fbb0 0x7f498806c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.776+0000 7f4987fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4988139380 0x7f498813b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.776+0000 7f49877fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f498809fbb0 0x7f498806c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51544/0 (socket says 172.21.15.40:51544) 2023-09-30T22:30:27.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.776+0000 7f49877fe700 1 -- 172.21.15.40:0/4269814161 learned_addr learned my addr 172.21.15.40:0/4269814161 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:27.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.776+0000 7f49877fe700 1 -- 172.21.15.40:0/4269814161 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4988139380 msgr2=0x7f498813b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:27.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.776+0000 7f49877fe700 1 --2- 172.21.15.40:0/4269814161 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4988139380 0x7f498813b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.776+0000 7f49877fe700 1 -- 172.21.15.40:0/4269814161 >> v1:172.21.15.40:6789/0 conn(0x7f49880a0590 legacy=0x7f498806ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:27.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.776+0000 7f49877fe700 1 -- 172.21.15.40:0/4269814161 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498809b1d0 con 0x7f498809fbb0 2023-09-30T22:30:27.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.776+0000 7f4987fff700 1 --2- 172.21.15.40:0/4269814161 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4988139380 0x7f498813b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:27.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.776+0000 7f49877fe700 1 --2- 172.21.15.40:0/4269814161 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f498809fbb0 0x7f498806c990 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f4978009920 tx=0x7f4978009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d60fd439fa36172 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:27.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.776+0000 7f4986ffd700 1 -- 172.21.15.40:0/4269814161 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4978011830 con 0x7f498809fbb0 2023-09-30T22:30:27.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.776+0000 7f4986ffd700 1 -- 172.21.15.40:0/4269814161 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4978011990 con 0x7f498809fbb0 2023-09-30T22:30:27.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.776+0000 7f4986ffd700 1 -- 172.21.15.40:0/4269814161 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4978011d20 con 0x7f498809fbb0 2023-09-30T22:30:27.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.777+0000 7f498e19c700 1 -- 172.21.15.40:0/4269814161 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f498809fbb0 msgr2=0x7f498806c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:27.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.777+0000 7f498e19c700 1 --2- 172.21.15.40:0/4269814161 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f498809fbb0 0x7f498806c990 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f4978009920 tx=0x7f4978009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:27.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.777+0000 7f498e19c700 1 -- 172.21.15.40:0/4269814161 shutdown_connections 2023-09-30T22:30:27.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.777+0000 7f498e19c700 1 --2- 172.21.15.40:0/4269814161 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4988139380 0x7f498813b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.777+0000 7f498e19c700 1 --2- 172.21.15.40:0/4269814161 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f498809fbb0 0x7f498806c990 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.777+0000 7f498e19c700 1 -- 172.21.15.40:0/4269814161 >> 172.21.15.40:0/4269814161 conn(0x7f49880a41a0 msgr2=0x7f49880a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:27.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.777+0000 7f498e19c700 1 -- 172.21.15.40:0/4269814161 shutdown_connections 2023-09-30T22:30:27.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.777+0000 7f498e19c700 1 -- 172.21.15.40:0/4269814161 wait complete. 2023-09-30T22:30:27.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.778+0000 7f498e19c700 1 Processor -- start 2023-09-30T22:30:27.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.778+0000 7f498e19c700 1 -- start start 2023-09-30T22:30:27.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.779+0000 7f498e19c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f498809fbb0 0x7f49881389f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.779+0000 7f498e19c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f49880a0590 0x7f4988095cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.779+0000 7f498e19c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4988139380 0x7f49880961f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:27.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.779+0000 7f498e19c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4988096e40 con 0x7f498809fbb0 2023-09-30T22:30:27.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.779+0000 7f498e19c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49880711b0 con 0x7f4988139380 2023-09-30T22:30:27.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.779+0000 7f498e19c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4988094b30 con 0x7f49880a0590 2023-09-30T22:30:27.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.779+0000 7f497effd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f49880a0590 0x7f4988095cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.779+0000 7f497effd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f49880a0590 0x7f4988095cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51550/0 (socket says 172.21.15.40:51550) 2023-09-30T22:30:27.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.779+0000 7f49877fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f498809fbb0 0x7f49881389f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.779+0000 7f497effd700 1 -- 172.21.15.40:0/2781105862 learned_addr learned my addr 172.21.15.40:0/2781105862 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:27.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.779+0000 7f4987fff700 1 --2- 172.21.15.40:0/2781105862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4988139380 0x7f49880961f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:27.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.779+0000 7f497effd700 1 -- 172.21.15.40:0/2781105862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4988139380 msgr2=0x7f49880961f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:27.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.779+0000 7f497effd700 1 --2- 172.21.15.40:0/2781105862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4988139380 0x7f49880961f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.779+0000 7f497effd700 1 -- 172.21.15.40:0/2781105862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f498809fbb0 msgr2=0x7f49881389f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:27.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.779+0000 7f497effd700 1 --2- 172.21.15.40:0/2781105862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f498809fbb0 0x7f49881389f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.779+0000 7f497effd700 1 -- 172.21.15.40:0/2781105862 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4980009a70 con 0x7f49880a0590 2023-09-30T22:30:27.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.779+0000 7f497effd700 1 --2- 172.21.15.40:0/2781105862 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f49880a0590 0x7f4988095cb0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f497000c4e0 tx=0x7f497000c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:27.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.780+0000 7f4984ff9700 1 -- 172.21.15.40:0/2781105862 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49700052d0 con 0x7f49880a0590 2023-09-30T22:30:27.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.780+0000 7f4984ff9700 1 -- 172.21.15.40:0/2781105862 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4970005430 con 0x7f49880a0590 2023-09-30T22:30:27.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.780+0000 7f4984ff9700 1 -- 172.21.15.40:0/2781105862 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49700038c0 con 0x7f49880a0590 2023-09-30T22:30:27.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.780+0000 7f498e19c700 1 -- 172.21.15.40:0/2781105862 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4978009550 con 0x7f49880a0590 2023-09-30T22:30:27.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.780+0000 7f498e19c700 1 -- 172.21.15.40:0/2781105862 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4988095860 con 0x7f49880a0590 2023-09-30T22:30:27.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.780+0000 7f498e19c700 1 -- 172.21.15.40:0/2781105862 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4988062380 con 0x7f49880a0590 2023-09-30T22:30:27.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.781+0000 7f4984ff9700 1 -- 172.21.15.40:0/2781105862 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4970003a20 con 0x7f49880a0590 2023-09-30T22:30:27.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.781+0000 7f4984ff9700 1 -- 172.21.15.40:0/2781105862 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f497003fa90 con 0x7f49880a0590 2023-09-30T22:30:27.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.790+0000 7f4984ff9700 1 -- 172.21.15.40:0/2781105862 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4970018260 con 0x7f49880a0590 2023-09-30T22:30:27.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.867+0000 7ff09b513700 1 -- 172.21.15.40:0/1204000491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff094074330 con 0x7ff09412f070 2023-09-30T22:30:27.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.867+0000 7ff089ffb700 1 -- 172.21.15.40:0/1204000491 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff0840239c0 con 0x7ff09412f070 2023-09-30T22:30:27.868 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:27.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.869+0000 7ff09b513700 1 -- 172.21.15.40:0/1204000491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff09412f070 msgr2=0x7ff09406db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:27.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.869+0000 7ff09b513700 1 --2- 172.21.15.40:0/1204000491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff09412f070 0x7ff09406db50 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7ff084009c40 tx=0x7ff084004750 comp rx=0 tx=0).stop 2023-09-30T22:30:27.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.869+0000 7ff09b513700 1 -- 172.21.15.40:0/1204000491 shutdown_connections 2023-09-30T22:30:27.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.869+0000 7ff09b513700 1 --2- 172.21.15.40:0/1204000491 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff09412e590 0x7ff09406d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.869+0000 7ff09b513700 1 --2- 172.21.15.40:0/1204000491 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff094136170 0x7ff09406e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.869+0000 7ff09b513700 1 --2- 172.21.15.40:0/1204000491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff09412f070 0x7ff09406db50 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.869+0000 7ff09b513700 1 -- 172.21.15.40:0/1204000491 >> 172.21.15.40:0/1204000491 conn(0x7ff0940a2a00 msgr2=0x7ff09409d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:27.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.870+0000 7ff09b513700 1 -- 172.21.15.40:0/1204000491 shutdown_connections 2023-09-30T22:30:27.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.870+0000 7ff09b513700 1 -- 172.21.15.40:0/1204000491 wait complete. 2023-09-30T22:30:27.882 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:27.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.951+0000 7f128f648700 1 -- 172.21.15.40:0/4247915953 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1288062380 con 0x7f128806f980 2023-09-30T22:30:27.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.951+0000 7f1285ffb700 1 -- 172.21.15.40:0/4247915953 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f127c017020 con 0x7f128806f980 2023-09-30T22:30:27.952 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:27.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.953+0000 7f128f648700 1 -- 172.21.15.40:0/4247915953 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f128806f980 msgr2=0x7f128806ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:27.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.953+0000 7f128f648700 1 --2- 172.21.15.40:0/4247915953 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f128806f980 0x7f128806ced0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f127c00c550 tx=0x7f127c00c860 comp rx=0 tx=0).stop 2023-09-30T22:30:27.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.953+0000 7f128f648700 1 -- 172.21.15.40:0/4247915953 shutdown_connections 2023-09-30T22:30:27.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.953+0000 7f128f648700 1 --2- 172.21.15.40:0/4247915953 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f128806fdb0 0x7f128806d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.953+0000 7f128f648700 1 --2- 172.21.15.40:0/4247915953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f128806f070 0x7f128806c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.953+0000 7f128f648700 1 --2- 172.21.15.40:0/4247915953 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f128806f980 0x7f128806ced0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.953+0000 7f128f648700 1 -- 172.21.15.40:0/4247915953 >> 172.21.15.40:0/4247915953 conn(0x7f12880a41a0 msgr2=0x7f12880973c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:27.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.953+0000 7f128f648700 1 -- 172.21.15.40:0/4247915953 shutdown_connections 2023-09-30T22:30:27.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.953+0000 7f128f648700 1 -- 172.21.15.40:0/4247915953 wait complete. 2023-09-30T22:30:27.966 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:27.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.986+0000 7f498e19c700 1 -- 172.21.15.40:0/2781105862 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4988071eb0 con 0x7f49880a0590 2023-09-30T22:30:27.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.987+0000 7f4984ff9700 1 -- 172.21.15.40:0/2781105862 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4970017070 con 0x7f49880a0590 2023-09-30T22:30:27.987 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:27.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.989+0000 7f498e19c700 1 -- 172.21.15.40:0/2781105862 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f49880a0590 msgr2=0x7f4988095cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:27.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.989+0000 7f498e19c700 1 --2- 172.21.15.40:0/2781105862 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f49880a0590 0x7f4988095cb0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f497000c4e0 tx=0x7f497000c7f0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.989+0000 7f498e19c700 1 -- 172.21.15.40:0/2781105862 shutdown_connections 2023-09-30T22:30:27.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.989+0000 7f498e19c700 1 --2- 172.21.15.40:0/2781105862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4988139380 0x7f49880961f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.989+0000 7f498e19c700 1 --2- 172.21.15.40:0/2781105862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f498809fbb0 0x7f49881389f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.989+0000 7f498e19c700 1 --2- 172.21.15.40:0/2781105862 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f49880a0590 0x7f4988095cb0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:27.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.989+0000 7f498e19c700 1 -- 172.21.15.40:0/2781105862 >> 172.21.15.40:0/2781105862 conn(0x7f49880a41a0 msgr2=0x7f498809a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:27.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.989+0000 7f498e19c700 1 -- 172.21.15.40:0/2781105862 shutdown_connections 2023-09-30T22:30:27.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:27.989+0000 7f498e19c700 1 -- 172.21.15.40:0/2781105862 wait complete. 2023-09-30T22:30:28.002 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:28.059 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:28.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.185+0000 7fa54a974700 1 Processor -- start 2023-09-30T22:30:28.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.185+0000 7fa54a974700 1 -- start start 2023-09-30T22:30:28.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.186+0000 7fa54a974700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa54409d920 0x7fa54409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:28.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.186+0000 7fa54a974700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa54409e230 0x7fa5441308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:28.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.186+0000 7fa54a974700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa54409adf0 con 0x7fa544130de0 2023-09-30T22:30:28.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.186+0000 7fa54a974700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa54409edf0 con 0x7fa54409d920 2023-09-30T22:30:28.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.186+0000 7fa54a974700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa54409b660 con 0x7fa54409e230 2023-09-30T22:30:28.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.186+0000 7fa5437fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa54409e230 0x7fa5441308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:28.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.186+0000 7fa543fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa54409d920 0x7fa54409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:28.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.186+0000 7fa5437fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa54409e230 0x7fa5441308a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51564/0 (socket says 172.21.15.40:51564) 2023-09-30T22:30:28.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.186+0000 7fa548f11700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa544130de0 0x7fa544137d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46070/0 (socket says 172.21.15.40:46070) 2023-09-30T22:30:28.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.186+0000 7fa5437fe700 1 -- 172.21.15.40:0/455117860 learned_addr learned my addr 172.21.15.40:0/455117860 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:28.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.186+0000 7fa5437fe700 1 -- 172.21.15.40:0/455117860 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa54409d920 msgr2=0x7fa54409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:28.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.186+0000 7fa5437fe700 1 --2- 172.21.15.40:0/455117860 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa54409d920 0x7fa54409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:28.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.186+0000 7fa5437fe700 1 -- 172.21.15.40:0/455117860 >> v1:172.21.15.40:6789/0 conn(0x7fa544130de0 legacy=0x7fa544137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:28.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.186+0000 7fa5437fe700 1 -- 172.21.15.40:0/455117860 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54409a6e0 con 0x7fa54409e230 2023-09-30T22:30:28.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.186+0000 7fa543fff700 1 --2- 172.21.15.40:0/455117860 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa54409d920 0x7fa54409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:28.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.187+0000 7fa5437fe700 1 --2- 172.21.15.40:0/455117860 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa54409e230 0x7fa5441308a0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fa538009920 tx=0x7fa538009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fd0eda8fc038652 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:28.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.187+0000 7fa542ffd700 1 -- 172.21.15.40:0/455117860 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa538011830 con 0x7fa54409e230 2023-09-30T22:30:28.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.187+0000 7fa542ffd700 1 -- 172.21.15.40:0/455117860 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa538011990 con 0x7fa54409e230 2023-09-30T22:30:28.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.187+0000 7fa542ffd700 1 -- 172.21.15.40:0/455117860 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa538011d20 con 0x7fa54409e230 2023-09-30T22:30:28.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.187+0000 7fa54a974700 1 -- 172.21.15.40:0/455117860 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa54409e230 msgr2=0x7fa5441308a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:28.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.187+0000 7fa54a974700 1 --2- 172.21.15.40:0/455117860 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa54409e230 0x7fa5441308a0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fa538009920 tx=0x7fa538009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:28.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.187+0000 7fa54a974700 1 -- 172.21.15.40:0/455117860 shutdown_connections 2023-09-30T22:30:28.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.187+0000 7fa54a974700 1 --2- 172.21.15.40:0/455117860 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa54409d920 0x7fa54409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:28.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.187+0000 7fa54a974700 1 --2- 172.21.15.40:0/455117860 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa54409e230 0x7fa5441308a0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:28.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.187+0000 7fa54a974700 1 -- 172.21.15.40:0/455117860 >> 172.21.15.40:0/455117860 conn(0x7fa54409fb20 msgr2=0x7fa54409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:28.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.187+0000 7fa54a974700 1 -- 172.21.15.40:0/455117860 shutdown_connections 2023-09-30T22:30:28.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.187+0000 7fa54a974700 1 -- 172.21.15.40:0/455117860 wait complete. 2023-09-30T22:30:28.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.188+0000 7fa54a974700 1 Processor -- start 2023-09-30T22:30:28.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.188+0000 7fa54a974700 1 -- start start 2023-09-30T22:30:28.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.189+0000 7fa54a974700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa54409d920 0x7fa5441c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:28.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.189+0000 7fa54a974700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa54409e230 0x7fa5441c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:28.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.189+0000 7fa54a974700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa544130de0 0x7fa5441c9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:28.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.189+0000 7fa54a974700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa544130ba0 con 0x7fa544130de0 2023-09-30T22:30:28.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.189+0000 7fa54a974700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa54409cb90 con 0x7fa54409e230 2023-09-30T22:30:28.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.189+0000 7fa54a974700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa54411f2f0 con 0x7fa54409d920 2023-09-30T22:30:28.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.189+0000 7fa543fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa54409d920 0x7fa5441c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:28.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.189+0000 7fa5437fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa54409e230 0x7fa5441c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:28.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.189+0000 7fa548f11700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa544130de0 0x7fa5441c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:28.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.189+0000 7fa543fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa54409d920 0x7fa5441c8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51568/0 (socket says 172.21.15.40:51568) 2023-09-30T22:30:28.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.189+0000 7fa543fff700 1 -- 172.21.15.40:0/3572423917 learned_addr learned my addr 172.21.15.40:0/3572423917 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:28.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.189+0000 7fa543fff700 1 -- 172.21.15.40:0/3572423917 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa54409e230 msgr2=0x7fa5441c8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:28.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.189+0000 7fa543fff700 1 --2- 172.21.15.40:0/3572423917 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa54409e230 0x7fa5441c8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:28.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.189+0000 7fa543fff700 1 -- 172.21.15.40:0/3572423917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa544130de0 msgr2=0x7fa5441c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:28.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.189+0000 7fa543fff700 1 --2- 172.21.15.40:0/3572423917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa544130de0 0x7fa5441c9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:28.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.189+0000 7fa543fff700 1 -- 172.21.15.40:0/3572423917 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa534009430 con 0x7fa54409d920 2023-09-30T22:30:28.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.189+0000 7fa548f11700 1 --2- 172.21.15.40:0/3572423917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa544130de0 0x7fa5441c9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:28.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.189+0000 7fa5437fe700 1 --2- 172.21.15.40:0/3572423917 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa54409e230 0x7fa5441c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:28.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.189+0000 7fa543fff700 1 --2- 172.21.15.40:0/3572423917 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa54409d920 0x7fa5441c8590 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa53400ec10 tx=0x7fa53400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:28.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.190+0000 7fa540ff9700 1 -- 172.21.15.40:0/3572423917 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa534005a20 con 0x7fa54409d920 2023-09-30T22:30:28.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.190+0000 7fa540ff9700 1 -- 172.21.15.40:0/3572423917 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa534005b80 con 0x7fa54409d920 2023-09-30T22:30:28.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.190+0000 7fa54a974700 1 -- 172.21.15.40:0/3572423917 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa538009550 con 0x7fa54409d920 2023-09-30T22:30:28.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.190+0000 7fa540ff9700 1 -- 172.21.15.40:0/3572423917 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53400c850 con 0x7fa54409d920 2023-09-30T22:30:28.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.190+0000 7fa54a974700 1 -- 172.21.15.40:0/3572423917 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa54411f5b0 con 0x7fa54409d920 2023-09-30T22:30:28.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.190+0000 7fa540ff9700 1 -- 172.21.15.40:0/3572423917 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa53400c9b0 con 0x7fa54409d920 2023-09-30T22:30:28.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.191+0000 7fa54a974700 1 -- 172.21.15.40:0/3572423917 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa544062380 con 0x7fa54409d920 2023-09-30T22:30:28.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.191+0000 7fa540ff9700 1 -- 172.21.15.40:0/3572423917 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa53403f9d0 con 0x7fa54409d920 2023-09-30T22:30:28.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.196+0000 7fa540ff9700 1 -- 172.21.15.40:0/3572423917 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa534006030 con 0x7fa54409d920 2023-09-30T22:30:28.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.388+0000 7fa54a974700 1 -- 172.21.15.40:0/3572423917 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa544074720 con 0x7fa54409d920 2023-09-30T22:30:28.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.389+0000 7fa540ff9700 1 -- 172.21.15.40:0/3572423917 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa534029070 con 0x7fa54409d920 2023-09-30T22:30:28.390 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:28.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.391+0000 7fa54a974700 1 -- 172.21.15.40:0/3572423917 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa54409d920 msgr2=0x7fa5441c8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:28.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.391+0000 7fa54a974700 1 --2- 172.21.15.40:0/3572423917 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa54409d920 0x7fa5441c8590 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa53400ec10 tx=0x7fa53400ef20 comp rx=0 tx=0).stop 2023-09-30T22:30:28.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.391+0000 7fa54a974700 1 -- 172.21.15.40:0/3572423917 shutdown_connections 2023-09-30T22:30:28.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.391+0000 7fa54a974700 1 --2- 172.21.15.40:0/3572423917 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa54409d920 0x7fa5441c8590 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:28.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.391+0000 7fa54a974700 1 --2- 172.21.15.40:0/3572423917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa544130de0 0x7fa5441c9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:28.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.391+0000 7fa54a974700 1 --2- 172.21.15.40:0/3572423917 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa54409e230 0x7fa5441c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:28.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.391+0000 7fa54a974700 1 -- 172.21.15.40:0/3572423917 >> 172.21.15.40:0/3572423917 conn(0x7fa54409fb20 msgr2=0x7fa54406a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:28.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.391+0000 7fa54a974700 1 -- 172.21.15.40:0/3572423917 shutdown_connections 2023-09-30T22:30:28.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:28.391+0000 7fa54a974700 1 -- 172.21.15.40:0/3572423917 wait complete. 2023-09-30T22:30:28.403 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:28.883 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:28.967 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:29.003 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:29.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.018+0000 7f885534e700 1 Processor -- start 2023-09-30T22:30:29.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.018+0000 7f885534e700 1 -- start start 2023-09-30T22:30:29.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.019+0000 7f885534e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f885012f070 0x7f8850135c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.019+0000 7f885534e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8850136170 0x7f8850138550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.019+0000 7f885534e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f885009ab70 con 0x7f885012e590 2023-09-30T22:30:29.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.019+0000 7f885534e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f885012f470 con 0x7f885012f070 2023-09-30T22:30:29.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.019+0000 7f885534e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f885009b270 con 0x7f8850136170 2023-09-30T22:30:29.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.019+0000 7f884e7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f885012f070 0x7f8850135c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.019+0000 7f884e7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f885012f070 0x7f8850135c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53888/0 (socket says 172.21.15.40:53888) 2023-09-30T22:30:29.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.019+0000 7f884f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8850136170 0x7f8850138550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.019+0000 7f884e7fc700 1 -- 172.21.15.40:0/1624767731 learned_addr learned my addr 172.21.15.40:0/1624767731 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:29.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.019+0000 7f884f7fe700 1 -- 172.21.15.40:0/1624767731 >> v2:172.21.15.40:3300/0 conn(0x7f885012f070 msgr2=0x7f8850135c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:29.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.019+0000 7f884f7fe700 1 --2- 172.21.15.40:0/1624767731 >> v2:172.21.15.40:3300/0 conn(0x7f885012f070 0x7f8850135c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.019+0000 7f884f7fe700 1 -- 172.21.15.40:0/1624767731 >> v1:172.21.15.40:6789/0 conn(0x7f885012e590 legacy=0x7f885012e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:29.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.019+0000 7f884f7fe700 1 -- 172.21.15.40:0/1624767731 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885009bd70 con 0x7f8850136170 2023-09-30T22:30:29.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.020+0000 7f884f7fe700 1 --2- 172.21.15.40:0/1624767731 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8850136170 0x7f8850138550 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f8848009d90 tx=0x7f884800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bca595a1c371f586 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:29.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.020+0000 7f884dffb700 1 -- 172.21.15.40:0/1624767731 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884800e070 con 0x7f8850136170 2023-09-30T22:30:29.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.020+0000 7f884dffb700 1 -- 172.21.15.40:0/1624767731 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884800bb20 con 0x7f8850136170 2023-09-30T22:30:29.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.020+0000 7f884dffb700 1 -- 172.21.15.40:0/1624767731 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8848012430 con 0x7f8850136170 2023-09-30T22:30:29.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.020+0000 7f885534e700 1 -- 172.21.15.40:0/1624767731 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8850136170 msgr2=0x7f8850138550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:29.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.020+0000 7f885534e700 1 --2- 172.21.15.40:0/1624767731 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8850136170 0x7f8850138550 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f8848009d90 tx=0x7f884800b330 comp rx=0 tx=0).stop 2023-09-30T22:30:29.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.020+0000 7f885534e700 1 -- 172.21.15.40:0/1624767731 shutdown_connections 2023-09-30T22:30:29.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.020+0000 7f885534e700 1 --2- 172.21.15.40:0/1624767731 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8850136170 0x7f8850138550 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.020+0000 7f885534e700 1 --2- 172.21.15.40:0/1624767731 >> v2:172.21.15.40:3300/0 conn(0x7f885012f070 0x7f8850135c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.020+0000 7f885534e700 1 -- 172.21.15.40:0/1624767731 >> 172.21.15.40:0/1624767731 conn(0x7f88500a2a00 msgr2=0x7f88500a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:29.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.021+0000 7f885534e700 1 -- 172.21.15.40:0/1624767731 shutdown_connections 2023-09-30T22:30:29.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.021+0000 7f885534e700 1 -- 172.21.15.40:0/1624767731 wait complete. 2023-09-30T22:30:29.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.022+0000 7f885534e700 1 Processor -- start 2023-09-30T22:30:29.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.022+0000 7f885534e700 1 -- start start 2023-09-30T22:30:29.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.022+0000 7f885534e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f885012e590 0x7f88501c48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.022+0000 7f885534e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f885012f070 0x7f88501c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.022+0000 7f885534e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8850136170 0x7f885006f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.022+0000 7f885534e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8850071490 con 0x7f885012e590 2023-09-30T22:30:29.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.022+0000 7f885534e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88500712a0 con 0x7f8850136170 2023-09-30T22:30:29.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.022+0000 7f885534e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f885009b4b0 con 0x7f885012f070 2023-09-30T22:30:29.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.022+0000 7f884effd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f885012e590 0x7f88501c48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.022+0000 7f884effd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f885012e590 0x7f88501c48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53900/0 (socket says 172.21.15.40:53900) 2023-09-30T22:30:29.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.022+0000 7f884f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8850136170 0x7f885006f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.022+0000 7f884effd700 1 -- 172.21.15.40:0/2879165994 learned_addr learned my addr 172.21.15.40:0/2879165994 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:29.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.023+0000 7f884f7fe700 1 -- 172.21.15.40:0/2879165994 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f885012f070 msgr2=0x7f88501c4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:29.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.023+0000 7f884f7fe700 1 --2- 172.21.15.40:0/2879165994 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f885012f070 0x7f88501c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.023+0000 7f884f7fe700 1 -- 172.21.15.40:0/2879165994 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f885012e590 msgr2=0x7f88501c48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:29.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.023+0000 7f884f7fe700 1 --2- 172.21.15.40:0/2879165994 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f885012e590 0x7f88501c48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.023+0000 7f884f7fe700 1 -- 172.21.15.40:0/2879165994 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8848009a70 con 0x7f8850136170 2023-09-30T22:30:29.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.023+0000 7f884effd700 1 --2- 172.21.15.40:0/2879165994 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f885012e590 0x7f88501c48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:29.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.023+0000 7f884f7fe700 1 --2- 172.21.15.40:0/2879165994 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8850136170 0x7f885006f690 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f8848016000 tx=0x7f8848004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:29.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.023+0000 7f88377fe700 1 -- 172.21.15.40:0/2879165994 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8848012430 con 0x7f8850136170 2023-09-30T22:30:29.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.023+0000 7f88377fe700 1 -- 172.21.15.40:0/2879165994 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8848020070 con 0x7f8850136170 2023-09-30T22:30:29.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.023+0000 7f88377fe700 1 -- 172.21.15.40:0/2879165994 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8848004280 con 0x7f8850136170 2023-09-30T22:30:29.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.023+0000 7f885534e700 1 -- 172.21.15.40:0/2879165994 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8850119450 con 0x7f8850136170 2023-09-30T22:30:29.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.023+0000 7f885534e700 1 -- 172.21.15.40:0/2879165994 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f885012de00 con 0x7f8850136170 2023-09-30T22:30:29.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.024+0000 7f88377fe700 1 -- 172.21.15.40:0/2879165994 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f88480043e0 con 0x7f8850136170 2023-09-30T22:30:29.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.024+0000 7f88377fe700 1 -- 172.21.15.40:0/2879165994 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f8848022070 con 0x7f8850136170 2023-09-30T22:30:29.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.025+0000 7f885534e700 1 -- 172.21.15.40:0/2879165994 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f885009eb00 con 0x7f8850136170 2023-09-30T22:30:29.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.030+0000 7f88377fe700 1 -- 172.21.15.40:0/2879165994 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f884802c080 con 0x7f8850136170 2023-09-30T22:30:29.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.099+0000 7f826a6b7700 1 Processor -- start 2023-09-30T22:30:29.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.100+0000 7f826a6b7700 1 -- start start 2023-09-30T22:30:29.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.100+0000 7f826a6b7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f826409d920 0x7f826409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.100+0000 7f826a6b7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f826409e230 0x7f82641343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.100+0000 7f826a6b7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f826409f940 con 0x7f826409f0f0 2023-09-30T22:30:29.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.100+0000 7f826a6b7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f826406b4c0 con 0x7f826409d920 2023-09-30T22:30:29.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.100+0000 7f826a6b7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f826409a8f0 con 0x7f826409e230 2023-09-30T22:30:29.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.100+0000 7f8263fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f826409d920 0x7f826409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.100+0000 7f8263fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f826409d920 0x7f826409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53902/0 (socket says 172.21.15.40:53902) 2023-09-30T22:30:29.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.100+0000 7f8263fff700 1 -- 172.21.15.40:0/709760739 learned_addr learned my addr 172.21.15.40:0/709760739 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:29.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.100+0000 7f8268c54700 1 --2- 172.21.15.40:0/709760739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f826409e230 0x7f82641343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.101+0000 7f8268c54700 1 -- 172.21.15.40:0/709760739 >> v2:172.21.15.40:3300/0 conn(0x7f826409d920 msgr2=0x7f826409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:29.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.101+0000 7f8262ffd700 1 -- 172.21.15.40:0/709760739 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3578434676 0 0) 0x7f826409f940 con 0x7f826409f0f0 2023-09-30T22:30:29.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.101+0000 7f8268c54700 1 --2- 172.21.15.40:0/709760739 >> v2:172.21.15.40:3300/0 conn(0x7f826409d920 0x7f826409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.101+0000 7f8268c54700 1 -- 172.21.15.40:0/709760739 >> v1:172.21.15.40:6789/0 conn(0x7f826409f0f0 legacy=0x7f8264133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:29.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.101+0000 7f8268c54700 1 -- 172.21.15.40:0/709760739 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f826409f6e0 con 0x7f826409e230 2023-09-30T22:30:29.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.101+0000 7f8263fff700 1 --2- 172.21.15.40:0/709760739 >> v2:172.21.15.40:3300/0 conn(0x7f826409d920 0x7f826409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:29.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.101+0000 7f8268c54700 1 --2- 172.21.15.40:0/709760739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f826409e230 0x7f82641343b0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f825c009dc0 tx=0x7f825c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c31d574cea2aba3d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:29.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.101+0000 7f8262ffd700 1 -- 172.21.15.40:0/709760739 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c00e070 con 0x7f826409e230 2023-09-30T22:30:29.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.101+0000 7f8262ffd700 1 -- 172.21.15.40:0/709760739 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825c00bae0 con 0x7f826409e230 2023-09-30T22:30:29.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.101+0000 7f8262ffd700 1 -- 172.21.15.40:0/709760739 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c00be90 con 0x7f826409e230 2023-09-30T22:30:29.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.102+0000 7f826a6b7700 1 -- 172.21.15.40:0/709760739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f826409e230 msgr2=0x7f82641343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:29.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.102+0000 7f826a6b7700 1 --2- 172.21.15.40:0/709760739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f826409e230 0x7f82641343b0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f825c009dc0 tx=0x7f825c00b330 comp rx=0 tx=0).stop 2023-09-30T22:30:29.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.102+0000 7f826a6b7700 1 -- 172.21.15.40:0/709760739 shutdown_connections 2023-09-30T22:30:29.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.102+0000 7f826a6b7700 1 --2- 172.21.15.40:0/709760739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f826409e230 0x7f82641343b0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.102+0000 7f826a6b7700 1 --2- 172.21.15.40:0/709760739 >> v2:172.21.15.40:3300/0 conn(0x7f826409d920 0x7f826409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.102+0000 7f826a6b7700 1 -- 172.21.15.40:0/709760739 >> 172.21.15.40:0/709760739 conn(0x7f826409fb20 msgr2=0x7f826409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:29.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.102+0000 7f826a6b7700 1 -- 172.21.15.40:0/709760739 shutdown_connections 2023-09-30T22:30:29.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.102+0000 7f826a6b7700 1 -- 172.21.15.40:0/709760739 wait complete. 2023-09-30T22:30:29.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.103+0000 7f826a6b7700 1 Processor -- start 2023-09-30T22:30:29.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.103+0000 7f826a6b7700 1 -- start start 2023-09-30T22:30:29.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.103+0000 7f826a6b7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f826409d920 0x7f82641c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.103+0000 7f826a6b7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f826409e230 0x7f82641c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.103+0000 7f826a6b7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82641a9f60 0x7f82641c4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.103+0000 7f826a6b7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82641a95a0 con 0x7f826409e230 2023-09-30T22:30:29.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.103+0000 7f826a6b7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82641a9780 con 0x7f82641a9f60 2023-09-30T22:30:29.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.103+0000 7f826a6b7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82641c9170 con 0x7f826409d920 2023-09-30T22:30:29.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.103+0000 7f82637fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f826409e230 0x7f82641c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.104+0000 7f8268c54700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82641a9f60 0x7f82641c4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.104+0000 7f82637fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f826409e230 0x7f82641c8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53904/0 (socket says 172.21.15.40:53904) 2023-09-30T22:30:29.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.104+0000 7f82637fe700 1 -- 172.21.15.40:0/2304318657 learned_addr learned my addr 172.21.15.40:0/2304318657 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:29.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.104+0000 7f8263fff700 1 --2- 172.21.15.40:0/2304318657 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f826409d920 0x7f82641c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.104+0000 7f82637fe700 1 -- 172.21.15.40:0/2304318657 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f826409d920 msgr2=0x7f82641c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:29.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.104+0000 7f82637fe700 1 --2- 172.21.15.40:0/2304318657 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f826409d920 0x7f82641c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.104+0000 7f82637fe700 1 -- 172.21.15.40:0/2304318657 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82641a9f60 msgr2=0x7f82641c4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:29.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.104+0000 7f82637fe700 1 --2- 172.21.15.40:0/2304318657 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82641a9f60 0x7f82641c4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.104+0000 7f82637fe700 1 -- 172.21.15.40:0/2304318657 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8254009500 con 0x7f826409e230 2023-09-30T22:30:29.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.104+0000 7f8268c54700 1 --2- 172.21.15.40:0/2304318657 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82641a9f60 0x7f82641c4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:29.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.104+0000 7f82637fe700 1 --2- 172.21.15.40:0/2304318657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f826409e230 0x7f82641c8c30 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f825800c520 tx=0x7f825800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:29.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.104+0000 7f8260ff9700 1 -- 172.21.15.40:0/2304318657 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82580054e0 con 0x7f826409e230 2023-09-30T22:30:29.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.104+0000 7f8260ff9700 1 -- 172.21.15.40:0/2304318657 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8258003680 con 0x7f826409e230 2023-09-30T22:30:29.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.104+0000 7f826a6b7700 1 -- 172.21.15.40:0/2304318657 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f825c009a70 con 0x7f826409e230 2023-09-30T22:30:29.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.104+0000 7f8260ff9700 1 -- 172.21.15.40:0/2304318657 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82580039f0 con 0x7f826409e230 2023-09-30T22:30:29.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.104+0000 7f826a6b7700 1 -- 172.21.15.40:0/2304318657 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82640a33d0 con 0x7f826409e230 2023-09-30T22:30:29.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.105+0000 7f826a6b7700 1 -- 172.21.15.40:0/2304318657 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8264062380 con 0x7f826409e230 2023-09-30T22:30:29.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.106+0000 7f8260ff9700 1 -- 172.21.15.40:0/2304318657 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8258003b50 con 0x7f826409e230 2023-09-30T22:30:29.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.106+0000 7f8260ff9700 1 -- 172.21.15.40:0/2304318657 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f825803ef30 con 0x7f826409e230 2023-09-30T22:30:29.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.115+0000 7f8260ff9700 1 -- 172.21.15.40:0/2304318657 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f825801b3b0 con 0x7f826409e230 2023-09-30T22:30:29.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.144+0000 7f3201660700 1 Processor -- start 2023-09-30T22:30:29.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.144+0000 7f3201660700 1 -- start start 2023-09-30T22:30:29.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.145+0000 7f3201660700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f31fc09c890 0x7f31fc09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.145+0000 7f3201660700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31fc09d920 0x7f31fc09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.145+0000 7f3201660700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f31fc09e2b0 0x7f31fc13ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.145+0000 7f3201660700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31fc0a29d0 con 0x7f31fc09e2b0 2023-09-30T22:30:29.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.145+0000 7f3201660700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc09fb40 con 0x7f31fc09d920 2023-09-30T22:30:29.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.145+0000 7f3201660700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc0a2600 con 0x7f31fc09c890 2023-09-30T22:30:29.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.145+0000 7f31fb7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f31fc09e2b0 0x7f31fc13ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.145+0000 7f31fa7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31fc09d920 0x7f31fc09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.145+0000 7f31faffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f31fc09c890 0x7f31fc09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.145+0000 7f31fa7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31fc09d920 0x7f31fc09dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:34250/0 (socket says 172.21.15.40:34250) 2023-09-30T22:30:29.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.145+0000 7f31fb7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f31fc09e2b0 0x7f31fc13ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53918/0 (socket says 172.21.15.40:53918) 2023-09-30T22:30:29.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.145+0000 7f31fa7fc700 1 -- 172.21.15.40:0/1107314597 learned_addr learned my addr 172.21.15.40:0/1107314597 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:29.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.145+0000 7f31faffd700 1 -- 172.21.15.40:0/1107314597 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31fc09d920 msgr2=0x7f31fc09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:29.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.145+0000 7f31faffd700 1 --2- 172.21.15.40:0/1107314597 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31fc09d920 0x7f31fc09dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.145+0000 7f31faffd700 1 -- 172.21.15.40:0/1107314597 >> v2:172.21.15.40:3300/0 conn(0x7f31fc09e2b0 msgr2=0x7f31fc13ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:29.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.145+0000 7f31faffd700 1 --2- 172.21.15.40:0/1107314597 >> v2:172.21.15.40:3300/0 conn(0x7f31fc09e2b0 0x7f31fc13ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.145+0000 7f31faffd700 1 -- 172.21.15.40:0/1107314597 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31fc09e720 con 0x7f31fc09c890 2023-09-30T22:30:29.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.145+0000 7f31fa7fc700 1 --2- 172.21.15.40:0/1107314597 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31fc09d920 0x7f31fc09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:29.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.146+0000 7f31faffd700 1 --2- 172.21.15.40:0/1107314597 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f31fc09c890 0x7f31fc09cc60 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f31ec009820 tx=0x7f31ec009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18f468c34842ae43 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:29.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.146+0000 7f31f9ffb700 1 -- 172.21.15.40:0/1107314597 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec005e30 con 0x7f31fc09c890 2023-09-30T22:30:29.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.146+0000 7f31f9ffb700 1 -- 172.21.15.40:0/1107314597 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ec006030 con 0x7f31fc09c890 2023-09-30T22:30:29.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.146+0000 7f31f9ffb700 1 -- 172.21.15.40:0/1107314597 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec0063c0 con 0x7f31fc09c890 2023-09-30T22:30:29.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.146+0000 7f3201660700 1 -- 172.21.15.40:0/1107314597 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f31fc09c890 msgr2=0x7f31fc09cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:29.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.146+0000 7f3201660700 1 --2- 172.21.15.40:0/1107314597 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f31fc09c890 0x7f31fc09cc60 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f31ec009820 tx=0x7f31ec009b30 comp rx=0 tx=0).stop 2023-09-30T22:30:29.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.146+0000 7f3201660700 1 -- 172.21.15.40:0/1107314597 shutdown_connections 2023-09-30T22:30:29.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.146+0000 7f3201660700 1 --2- 172.21.15.40:0/1107314597 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f31fc09c890 0x7f31fc09cc60 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.146+0000 7f3201660700 1 --2- 172.21.15.40:0/1107314597 >> v2:172.21.15.40:3300/0 conn(0x7f31fc09e2b0 0x7f31fc13ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.146+0000 7f3201660700 1 --2- 172.21.15.40:0/1107314597 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31fc09d920 0x7f31fc09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.146+0000 7f3201660700 1 -- 172.21.15.40:0/1107314597 >> 172.21.15.40:0/1107314597 conn(0x7f31fc0a7080 msgr2=0x7f31fc0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:29.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.147+0000 7f3201660700 1 -- 172.21.15.40:0/1107314597 shutdown_connections 2023-09-30T22:30:29.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.147+0000 7f3201660700 1 -- 172.21.15.40:0/1107314597 wait complete. 2023-09-30T22:30:29.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.147+0000 7f3201660700 1 Processor -- start 2023-09-30T22:30:29.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.148+0000 7f3201660700 1 -- start start 2023-09-30T22:30:29.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.148+0000 7f3201660700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31fc09c890 0x7f31fc071790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.148+0000 7f3201660700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f31fc09d920 0x7f31fc12b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.148+0000 7f3201660700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31fc09e2b0 0x7f31fc12ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.148+0000 7f3201660700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc12e2c0 con 0x7f31fc09c890 2023-09-30T22:30:29.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.148+0000 7f3201660700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc0a5c50 con 0x7f31fc09e2b0 2023-09-30T22:30:29.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.148+0000 7f3201660700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc09ecf0 con 0x7f31fc09d920 2023-09-30T22:30:29.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.148+0000 7f31fa7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f31fc09d920 0x7f31fc12b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.148+0000 7f31fa7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f31fc09d920 0x7f31fc12b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51616/0 (socket says 172.21.15.40:51616) 2023-09-30T22:30:29.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.148+0000 7f31fa7fc700 1 -- 172.21.15.40:0/711070836 learned_addr learned my addr 172.21.15.40:0/711070836 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:29.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.148+0000 7f31fb7fe700 1 --2- 172.21.15.40:0/711070836 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31fc09e2b0 0x7f31fc12ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.148+0000 7f31faffd700 1 --2- 172.21.15.40:0/711070836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31fc09c890 0x7f31fc071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.148+0000 7f31fa7fc700 1 -- 172.21.15.40:0/711070836 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31fc09e2b0 msgr2=0x7f31fc12ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:29.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.148+0000 7f31fa7fc700 1 --2- 172.21.15.40:0/711070836 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31fc09e2b0 0x7f31fc12ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.148+0000 7f31fa7fc700 1 -- 172.21.15.40:0/711070836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31fc09c890 msgr2=0x7f31fc071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:29.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.148+0000 7f31fa7fc700 1 --2- 172.21.15.40:0/711070836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31fc09c890 0x7f31fc071790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.148+0000 7f31fa7fc700 1 -- 172.21.15.40:0/711070836 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f0009550 con 0x7f31fc09d920 2023-09-30T22:30:29.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.148+0000 7f31fb7fe700 1 --2- 172.21.15.40:0/711070836 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31fc09e2b0 0x7f31fc12ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:29.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.148+0000 7f31faffd700 1 --2- 172.21.15.40:0/711070836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31fc09c890 0x7f31fc071790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:29.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.149+0000 7f31fa7fc700 1 --2- 172.21.15.40:0/711070836 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f31fc09d920 0x7f31fc12b4e0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f31f000ebb0 tx=0x7f31f000eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:29.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.149+0000 7f31e37fe700 1 -- 172.21.15.40:0/711070836 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f0004240 con 0x7f31fc09d920 2023-09-30T22:30:29.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.149+0000 7f31e37fe700 1 -- 172.21.15.40:0/711070836 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f00043a0 con 0x7f31fc09d920 2023-09-30T22:30:29.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.149+0000 7f3201660700 1 -- 172.21.15.40:0/711070836 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31ec009430 con 0x7f31fc09d920 2023-09-30T22:30:29.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.149+0000 7f31e37fe700 1 -- 172.21.15.40:0/711070836 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f00036a0 con 0x7f31fc09d920 2023-09-30T22:30:29.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.149+0000 7f3201660700 1 -- 172.21.15.40:0/711070836 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31fc12d690 con 0x7f31fc09d920 2023-09-30T22:30:29.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.150+0000 7f31e37fe700 1 -- 172.21.15.40:0/711070836 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f31f0003800 con 0x7f31fc09d920 2023-09-30T22:30:29.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.150+0000 7f3201660700 1 -- 172.21.15.40:0/711070836 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31fc06e600 con 0x7f31fc09d920 2023-09-30T22:30:29.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.150+0000 7f31e37fe700 1 -- 172.21.15.40:0/711070836 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f31f003fd20 con 0x7f31fc09d920 2023-09-30T22:30:29.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.155+0000 7f31e37fe700 1 -- 172.21.15.40:0/711070836 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f31f0024350 con 0x7f31fc09d920 2023-09-30T22:30:29.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.233+0000 7f885534e700 1 -- 172.21.15.40:0/2879165994 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f885011a500 con 0x7f8850136170 2023-09-30T22:30:29.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.234+0000 7f88377fe700 1 -- 172.21.15.40:0/2879165994 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f884801c400 con 0x7f8850136170 2023-09-30T22:30:29.235 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:29.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.236+0000 7f885534e700 1 -- 172.21.15.40:0/2879165994 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8850136170 msgr2=0x7f885006f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:29.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.236+0000 7f885534e700 1 --2- 172.21.15.40:0/2879165994 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8850136170 0x7f885006f690 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f8848016000 tx=0x7f8848004ad0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.236+0000 7f885534e700 1 -- 172.21.15.40:0/2879165994 shutdown_connections 2023-09-30T22:30:29.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.236+0000 7f885534e700 1 --2- 172.21.15.40:0/2879165994 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8850136170 0x7f885006f690 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.236+0000 7f885534e700 1 --2- 172.21.15.40:0/2879165994 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f885012e590 0x7f88501c48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.236+0000 7f885534e700 1 --2- 172.21.15.40:0/2879165994 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f885012f070 0x7f88501c4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.236+0000 7f885534e700 1 -- 172.21.15.40:0/2879165994 >> 172.21.15.40:0/2879165994 conn(0x7f88500a2a00 msgr2=0x7f885009d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:29.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.236+0000 7f885534e700 1 -- 172.21.15.40:0/2879165994 shutdown_connections 2023-09-30T22:30:29.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.236+0000 7f885534e700 1 -- 172.21.15.40:0/2879165994 wait complete. 2023-09-30T22:30:29.250 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:29.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.314+0000 7f826a6b7700 1 -- 172.21.15.40:0/2304318657 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f82641a98c0 con 0x7f826409e230 2023-09-30T22:30:29.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.314+0000 7f8260ff9700 1 -- 172.21.15.40:0/2304318657 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f82641a98c0 con 0x7f826409e230 2023-09-30T22:30:29.319 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:29.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.316+0000 7f826a6b7700 1 -- 172.21.15.40:0/2304318657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f826409e230 msgr2=0x7f82641c8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:29.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.316+0000 7f826a6b7700 1 --2- 172.21.15.40:0/2304318657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f826409e230 0x7f82641c8c30 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f825800c520 tx=0x7f825800c830 comp rx=0 tx=0).stop 2023-09-30T22:30:29.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.316+0000 7f826a6b7700 1 -- 172.21.15.40:0/2304318657 shutdown_connections 2023-09-30T22:30:29.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.316+0000 7f826a6b7700 1 --2- 172.21.15.40:0/2304318657 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f826409d920 0x7f82641c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.316+0000 7f826a6b7700 1 --2- 172.21.15.40:0/2304318657 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f82641a9f60 0x7f82641c4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.316+0000 7f826a6b7700 1 --2- 172.21.15.40:0/2304318657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f826409e230 0x7f82641c8c30 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.316+0000 7f826a6b7700 1 -- 172.21.15.40:0/2304318657 >> 172.21.15.40:0/2304318657 conn(0x7f826409fb20 msgr2=0x7f82641bb030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:29.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.316+0000 7f826a6b7700 1 -- 172.21.15.40:0/2304318657 shutdown_connections 2023-09-30T22:30:29.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.316+0000 7f826a6b7700 1 -- 172.21.15.40:0/2304318657 wait complete. 2023-09-30T22:30:29.330 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:29.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.353+0000 7f3201660700 1 -- 172.21.15.40:0/711070836 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f31fc062380 con 0x7f31fc09d920 2023-09-30T22:30:29.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.353+0000 7f31e37fe700 1 -- 172.21.15.40:0/711070836 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f31f0024580 con 0x7f31fc09d920 2023-09-30T22:30:29.355 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:29.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.355+0000 7f3201660700 1 -- 172.21.15.40:0/711070836 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f31fc09d920 msgr2=0x7f31fc12b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:29.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.356+0000 7f3201660700 1 --2- 172.21.15.40:0/711070836 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f31fc09d920 0x7f31fc12b4e0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f31f000ebb0 tx=0x7f31f000eec0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.356+0000 7f3201660700 1 -- 172.21.15.40:0/711070836 shutdown_connections 2023-09-30T22:30:29.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.356+0000 7f3201660700 1 --2- 172.21.15.40:0/711070836 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31fc09e2b0 0x7f31fc12ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.356+0000 7f3201660700 1 --2- 172.21.15.40:0/711070836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31fc09c890 0x7f31fc071790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.356+0000 7f3201660700 1 --2- 172.21.15.40:0/711070836 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f31fc09d920 0x7f31fc12b4e0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.356+0000 7f3201660700 1 -- 172.21.15.40:0/711070836 >> 172.21.15.40:0/711070836 conn(0x7f31fc0a7080 msgr2=0x7f31fc1bae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:29.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.356+0000 7f3201660700 1 -- 172.21.15.40:0/711070836 shutdown_connections 2023-09-30T22:30:29.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.356+0000 7f3201660700 1 -- 172.21.15.40:0/711070836 wait complete. 2023-09-30T22:30:29.368 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:29.405 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:29.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.534+0000 7fb5ef94c700 1 Processor -- start 2023-09-30T22:30:29.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.534+0000 7fb5ef94c700 1 -- start start 2023-09-30T22:30:29.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.535+0000 7fb5ef94c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb5e809d920 0x7fb5e809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.535+0000 7fb5ef94c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5e809f0f0 0x7fb5e809e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.535+0000 7fb5ef94c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5e809f940 con 0x7fb5e8133ca0 2023-09-30T22:30:29.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.535+0000 7fb5ef94c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e806b4c0 con 0x7fb5e809f0f0 2023-09-30T22:30:29.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.535+0000 7fb5ef94c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e809a8f0 con 0x7fb5e809d920 2023-09-30T22:30:29.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.535+0000 7fb5ed6e8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb5e809d920 0x7fb5e809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.535+0000 7fb5ecee7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5e809f0f0 0x7fb5e809e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.535+0000 7fb5ed6e8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb5e809d920 0x7fb5e809dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51622/0 (socket says 172.21.15.40:51622) 2023-09-30T22:30:29.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.535+0000 7fb5edee9700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb5e8133ca0 0x7fb5e8134140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46094/0 (socket says 172.21.15.40:46094) 2023-09-30T22:30:29.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.535+0000 7fb5edee9700 1 -- 172.21.15.40:0/535754876 learned_addr learned my addr 172.21.15.40:0/535754876 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:29.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.535+0000 7fb5ed6e8700 1 -- 172.21.15.40:0/535754876 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5e809f0f0 msgr2=0x7fb5e809e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:29.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.535+0000 7fb5ed6e8700 1 --2- 172.21.15.40:0/535754876 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5e809f0f0 0x7fb5e809e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.535+0000 7fb5dffff700 1 -- 172.21.15.40:0/535754876 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2585181262 0 0) 0x7fb5e809f940 con 0x7fb5e8133ca0 2023-09-30T22:30:29.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.535+0000 7fb5ed6e8700 1 -- 172.21.15.40:0/535754876 >> v1:172.21.15.40:6789/0 conn(0x7fb5e8133ca0 legacy=0x7fb5e8134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:29.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.535+0000 7fb5ed6e8700 1 -- 172.21.15.40:0/535754876 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e809f6e0 con 0x7fb5e809d920 2023-09-30T22:30:29.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.535+0000 7fb5ecee7700 1 --2- 172.21.15.40:0/535754876 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5e809f0f0 0x7fb5e809e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:29.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.535+0000 7fb5ed6e8700 1 --2- 172.21.15.40:0/535754876 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb5e809d920 0x7fb5e809dcf0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4009880 tx=0x7fb5e4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33f3bb4a3d4bfba0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:29.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.535+0000 7fb5dffff700 1 -- 172.21.15.40:0/535754876 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e4005e30 con 0x7fb5e809d920 2023-09-30T22:30:29.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.535+0000 7fb5dffff700 1 -- 172.21.15.40:0/535754876 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e4006030 con 0x7fb5e809d920 2023-09-30T22:30:29.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.535+0000 7fb5dffff700 1 -- 172.21.15.40:0/535754876 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e40063c0 con 0x7fb5e809d920 2023-09-30T22:30:29.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.536+0000 7fb5ef94c700 1 -- 172.21.15.40:0/535754876 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb5e809d920 msgr2=0x7fb5e809dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:29.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.536+0000 7fb5ef94c700 1 --2- 172.21.15.40:0/535754876 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb5e809d920 0x7fb5e809dcf0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4009880 tx=0x7fb5e4009b90 comp rx=0 tx=0).stop 2023-09-30T22:30:29.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.536+0000 7fb5ef94c700 1 -- 172.21.15.40:0/535754876 shutdown_connections 2023-09-30T22:30:29.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.536+0000 7fb5ef94c700 1 --2- 172.21.15.40:0/535754876 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb5e809d920 0x7fb5e809dcf0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.536+0000 7fb5ef94c700 1 --2- 172.21.15.40:0/535754876 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5e809f0f0 0x7fb5e809e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.536+0000 7fb5ef94c700 1 -- 172.21.15.40:0/535754876 >> 172.21.15.40:0/535754876 conn(0x7fb5e809fb20 msgr2=0x7fb5e809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:29.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.536+0000 7fb5ef94c700 1 -- 172.21.15.40:0/535754876 shutdown_connections 2023-09-30T22:30:29.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.536+0000 7fb5ef94c700 1 -- 172.21.15.40:0/535754876 wait complete. 2023-09-30T22:30:29.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.537+0000 7fb5ef94c700 1 Processor -- start 2023-09-30T22:30:29.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.537+0000 7fb5ef94c700 1 -- start start 2023-09-30T22:30:29.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.537+0000 7fb5ef94c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb5e809d920 0x7fb5e811e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.537+0000 7fb5ef94c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5e8133ca0 0x7fb5e811e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.537+0000 7fb5ef94c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5e81317c0 0x7fb5e811eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:29.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.537+0000 7fb5ef94c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e8121c10 con 0x7fb5e8133ca0 2023-09-30T22:30:29.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.537+0000 7fb5ef94c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e81200f0 con 0x7fb5e81317c0 2023-09-30T22:30:29.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.537+0000 7fb5ef94c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e80a25a0 con 0x7fb5e809d920 2023-09-30T22:30:29.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.538+0000 7fb5ed6e8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb5e809d920 0x7fb5e811e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.538+0000 7fb5ecee7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5e8133ca0 0x7fb5e811e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.538+0000 7fb5edee9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5e81317c0 0x7fb5e811eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:29.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.538+0000 7fb5ed6e8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb5e809d920 0x7fb5e811e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51628/0 (socket says 172.21.15.40:51628) 2023-09-30T22:30:29.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.538+0000 7fb5ed6e8700 1 -- 172.21.15.40:0/2547623061 learned_addr learned my addr 172.21.15.40:0/2547623061 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:29.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.538+0000 7fb5ecee7700 1 --2- 172.21.15.40:0/2547623061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5e8133ca0 0x7fb5e811e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53926/0 (socket says 172.21.15.40:53926) 2023-09-30T22:30:29.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.538+0000 7fb5ed6e8700 1 -- 172.21.15.40:0/2547623061 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5e81317c0 msgr2=0x7fb5e811eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:29.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.538+0000 7fb5ed6e8700 1 --2- 172.21.15.40:0/2547623061 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5e81317c0 0x7fb5e811eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.538+0000 7fb5ed6e8700 1 -- 172.21.15.40:0/2547623061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5e8133ca0 msgr2=0x7fb5e811e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:29.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.538+0000 7fb5ed6e8700 1 --2- 172.21.15.40:0/2547623061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5e8133ca0 0x7fb5e811e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.538+0000 7fb5ed6e8700 1 -- 172.21.15.40:0/2547623061 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d80094a0 con 0x7fb5e809d920 2023-09-30T22:30:29.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.538+0000 7fb5ed6e8700 1 --2- 172.21.15.40:0/2547623061 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb5e809d920 0x7fb5e811e460 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4000c00 tx=0x7fb5e4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:29.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.538+0000 7fb5ddffb700 1 -- 172.21.15.40:0/2547623061 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e40063a0 con 0x7fb5e809d920 2023-09-30T22:30:29.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.538+0000 7fb5ddffb700 1 -- 172.21.15.40:0/2547623061 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e4006500 con 0x7fb5e809d920 2023-09-30T22:30:29.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.538+0000 7fb5ef94c700 1 -- 172.21.15.40:0/2547623061 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5e4009430 con 0x7fb5e809d920 2023-09-30T22:30:29.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.538+0000 7fb5ddffb700 1 -- 172.21.15.40:0/2547623061 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e40068b0 con 0x7fb5e809d920 2023-09-30T22:30:29.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.538+0000 7fb5ef94c700 1 -- 172.21.15.40:0/2547623061 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5e8121230 con 0x7fb5e809d920 2023-09-30T22:30:29.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.539+0000 7fb5ddffb700 1 -- 172.21.15.40:0/2547623061 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb5e4022070 con 0x7fb5e809d920 2023-09-30T22:30:29.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.539+0000 7fb5ddffb700 1 -- 172.21.15.40:0/2547623061 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb5e4040d80 con 0x7fb5e809d920 2023-09-30T22:30:29.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.540+0000 7fb5ef94c700 1 -- 172.21.15.40:0/2547623061 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5e806f6f0 con 0x7fb5e809d920 2023-09-30T22:30:29.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.545+0000 7fb5ddffb700 1 -- 172.21.15.40:0/2547623061 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb5e402a070 con 0x7fb5e809d920 2023-09-30T22:30:29.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.740+0000 7fb5ef94c700 1 -- 172.21.15.40:0/2547623061 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb5e8062380 con 0x7fb5e809d920 2023-09-30T22:30:29.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.740+0000 7fb5ddffb700 1 -- 172.21.15.40:0/2547623061 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb5e4025470 con 0x7fb5e809d920 2023-09-30T22:30:29.741 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:29.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.742+0000 7fb5ef94c700 1 -- 172.21.15.40:0/2547623061 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb5e809d920 msgr2=0x7fb5e811e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:29.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.742+0000 7fb5ef94c700 1 --2- 172.21.15.40:0/2547623061 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb5e809d920 0x7fb5e811e460 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4000c00 tx=0x7fb5e4004750 comp rx=0 tx=0).stop 2023-09-30T22:30:29.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.742+0000 7fb5ef94c700 1 -- 172.21.15.40:0/2547623061 shutdown_connections 2023-09-30T22:30:29.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.742+0000 7fb5ef94c700 1 --2- 172.21.15.40:0/2547623061 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb5e809d920 0x7fb5e811e460 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.742+0000 7fb5ef94c700 1 --2- 172.21.15.40:0/2547623061 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5e81317c0 0x7fb5e811eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.742+0000 7fb5ef94c700 1 --2- 172.21.15.40:0/2547623061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5e8133ca0 0x7fb5e811e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:29.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.742+0000 7fb5ef94c700 1 -- 172.21.15.40:0/2547623061 >> 172.21.15.40:0/2547623061 conn(0x7fb5e809fb20 msgr2=0x7fb5e8133480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:29.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.742+0000 7fb5ef94c700 1 -- 172.21.15.40:0/2547623061 shutdown_connections 2023-09-30T22:30:29.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:29.742+0000 7fb5ef94c700 1 -- 172.21.15.40:0/2547623061 wait complete. 2023-09-30T22:30:29.755 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:30.251 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:30.331 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:30.369 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:30.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.392+0000 7f8ecddf7700 1 Processor -- start 2023-09-30T22:30:30.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.392+0000 7f8ecddf7700 1 -- start start 2023-09-30T22:30:30.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.393+0000 7f8ecddf7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ec809d920 0x7f8ec809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:30.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.393+0000 7f8ecddf7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ec809e230 0x7f8ec81343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:30.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.393+0000 7f8ecddf7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ec809f940 con 0x7f8ec809f0f0 2023-09-30T22:30:30.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.393+0000 7f8ecddf7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec806b4c0 con 0x7f8ec809d920 2023-09-30T22:30:30.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.393+0000 7f8ecddf7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec809a8f0 con 0x7f8ec809e230 2023-09-30T22:30:30.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.393+0000 7f8ec7fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ec809e230 0x7f8ec81343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:30.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.393+0000 7f8ec6ffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8ec809f0f0 0x7f8ec8133ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46096/0 (socket says 172.21.15.40:46096) 2023-09-30T22:30:30.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.393+0000 7f8ec7fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ec809e230 0x7f8ec81343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51642/0 (socket says 172.21.15.40:51642) 2023-09-30T22:30:30.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.393+0000 7f8ec6ffd700 1 -- 172.21.15.40:0/2332129492 learned_addr learned my addr 172.21.15.40:0/2332129492 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:30.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.393+0000 7f8ec77fe700 1 --2- 172.21.15.40:0/2332129492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ec809d920 0x7f8ec809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:30.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.393+0000 7f8ec7fff700 1 -- 172.21.15.40:0/2332129492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ec809d920 msgr2=0x7f8ec809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:30.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.393+0000 7f8ec67fc700 1 -- 172.21.15.40:0/2332129492 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2863034625 0 0) 0x7f8ec809f940 con 0x7f8ec809f0f0 2023-09-30T22:30:30.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.393+0000 7f8ec7fff700 1 --2- 172.21.15.40:0/2332129492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ec809d920 0x7f8ec809dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.393+0000 7f8ec7fff700 1 -- 172.21.15.40:0/2332129492 >> v1:172.21.15.40:6789/0 conn(0x7f8ec809f0f0 legacy=0x7f8ec8133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:30.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.393+0000 7f8ec7fff700 1 -- 172.21.15.40:0/2332129492 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec809f6e0 con 0x7f8ec809e230 2023-09-30T22:30:30.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.394+0000 7f8ec7fff700 1 --2- 172.21.15.40:0/2332129492 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ec809e230 0x7f8ec81343b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0009df0 tx=0x7f8ec000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1166af7c93ae897 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:30.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.394+0000 7f8ec67fc700 1 -- 172.21.15.40:0/2332129492 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec000e070 con 0x7f8ec809e230 2023-09-30T22:30:30.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.394+0000 7f8ec67fc700 1 -- 172.21.15.40:0/2332129492 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec000bae0 con 0x7f8ec809e230 2023-09-30T22:30:30.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.394+0000 7f8ec67fc700 1 -- 172.21.15.40:0/2332129492 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec000be90 con 0x7f8ec809e230 2023-09-30T22:30:30.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.395+0000 7f8ecddf7700 1 -- 172.21.15.40:0/2332129492 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ec809e230 msgr2=0x7f8ec81343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:30.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.395+0000 7f8ecddf7700 1 --2- 172.21.15.40:0/2332129492 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ec809e230 0x7f8ec81343b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0009df0 tx=0x7f8ec000b330 comp rx=0 tx=0).stop 2023-09-30T22:30:30.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.395+0000 7f8ecddf7700 1 -- 172.21.15.40:0/2332129492 shutdown_connections 2023-09-30T22:30:30.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.395+0000 7f8ecddf7700 1 --2- 172.21.15.40:0/2332129492 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ec809e230 0x7f8ec81343b0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.395+0000 7f8ecddf7700 1 --2- 172.21.15.40:0/2332129492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ec809d920 0x7f8ec809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.395+0000 7f8ecddf7700 1 -- 172.21.15.40:0/2332129492 >> 172.21.15.40:0/2332129492 conn(0x7f8ec809fb20 msgr2=0x7f8ec809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:30.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.395+0000 7f8ecddf7700 1 -- 172.21.15.40:0/2332129492 shutdown_connections 2023-09-30T22:30:30.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.395+0000 7f8ecddf7700 1 -- 172.21.15.40:0/2332129492 wait complete. 2023-09-30T22:30:30.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.396+0000 7f8ecddf7700 1 Processor -- start 2023-09-30T22:30:30.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.396+0000 7f8ecddf7700 1 -- start start 2023-09-30T22:30:30.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.396+0000 7f8ecddf7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ec809d920 0x7f8ec81226b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:30.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.396+0000 7f8ecddf7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ec809e230 0x7f8ec8122bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:30.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.396+0000 7f8ecddf7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ec8123130 0x7f8ec81ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:30.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.396+0000 7f8ecddf7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec8125ef0 con 0x7f8ec809d920 2023-09-30T22:30:30.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.396+0000 7f8ecddf7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec8133b10 con 0x7f8ec809e230 2023-09-30T22:30:30.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.396+0000 7f8ecddf7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec8125150 con 0x7f8ec8123130 2023-09-30T22:30:30.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.397+0000 7f8ec6ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ec809e230 0x7f8ec8122bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:30.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.397+0000 7f8ec6ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ec809e230 0x7f8ec8122bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:34308/0 (socket says 172.21.15.40:34308) 2023-09-30T22:30:30.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.397+0000 7f8ec6ffd700 1 -- 172.21.15.40:0/1437884683 learned_addr learned my addr 172.21.15.40:0/1437884683 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:30.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.397+0000 7f8ec77fe700 1 --2- 172.21.15.40:0/1437884683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ec809d920 0x7f8ec81226b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:30.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.397+0000 7f8ec7fff700 1 --2- 172.21.15.40:0/1437884683 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ec8123130 0x7f8ec81ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:30.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.397+0000 7f8ec77fe700 1 -- 172.21.15.40:0/1437884683 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ec8123130 msgr2=0x7f8ec81ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:30.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.397+0000 7f8ec77fe700 1 --2- 172.21.15.40:0/1437884683 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ec8123130 0x7f8ec81ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.397+0000 7f8ec77fe700 1 -- 172.21.15.40:0/1437884683 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ec809e230 msgr2=0x7f8ec8122bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:30.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.397+0000 7f8ec77fe700 1 --2- 172.21.15.40:0/1437884683 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ec809e230 0x7f8ec8122bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.397+0000 7f8ec77fe700 1 -- 172.21.15.40:0/1437884683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec0009a70 con 0x7f8ec809d920 2023-09-30T22:30:30.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.397+0000 7f8ec6ffd700 1 --2- 172.21.15.40:0/1437884683 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ec809e230 0x7f8ec8122bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:30.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.397+0000 7f8ec7fff700 1 --2- 172.21.15.40:0/1437884683 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ec8123130 0x7f8ec81ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:30.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.397+0000 7f8ec77fe700 1 --2- 172.21.15.40:0/1437884683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ec809d920 0x7f8ec81226b0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f8eb800e8a0 tx=0x7f8eb800ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:30.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.397+0000 7f8eaffff700 1 -- 172.21.15.40:0/1437884683 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb8013680 con 0x7f8ec809d920 2023-09-30T22:30:30.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.397+0000 7f8eaffff700 1 -- 172.21.15.40:0/1437884683 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb80137e0 con 0x7f8ec809d920 2023-09-30T22:30:30.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.397+0000 7f8eaffff700 1 -- 172.21.15.40:0/1437884683 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb8013b50 con 0x7f8ec809d920 2023-09-30T22:30:30.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.398+0000 7f8ecddf7700 1 -- 172.21.15.40:0/1437884683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ec81261d0 con 0x7f8ec809d920 2023-09-30T22:30:30.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.398+0000 7f8ecddf7700 1 -- 172.21.15.40:0/1437884683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec8125510 con 0x7f8ec809d920 2023-09-30T22:30:30.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.398+0000 7f8eaffff700 1 -- 172.21.15.40:0/1437884683 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8eb8013cb0 con 0x7f8ec809d920 2023-09-30T22:30:30.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.399+0000 7f8eaffff700 1 -- 172.21.15.40:0/1437884683 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f8eb803f690 con 0x7f8ec809d920 2023-09-30T22:30:30.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.399+0000 7f8ecddf7700 1 -- 172.21.15.40:0/1437884683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec8125d50 con 0x7f8ec809d920 2023-09-30T22:30:30.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.404+0000 7f8eaffff700 1 -- 172.21.15.40:0/1437884683 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ec8125d50 con 0x7f8ec809d920 2023-09-30T22:30:30.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.467+0000 7f62a087e700 1 Processor -- start 2023-09-30T22:30:30.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.467+0000 7f62a087e700 1 -- start start 2023-09-30T22:30:30.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.468+0000 7f62a087e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f629c133e00 0x7f629c1341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:30.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.468+0000 7f62a087e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f629c09d400 0x7f629c09d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:30.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.468+0000 7f62a087e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f629c133940 con 0x7f629c09dd70 2023-09-30T22:30:30.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.468+0000 7f62a087e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f629c09f0d0 con 0x7f629c133e00 2023-09-30T22:30:30.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.468+0000 7f62a087e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f629c133be0 con 0x7f629c09d400 2023-09-30T22:30:30.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.468+0000 7f629a59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f629c133e00 0x7f629c1341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:30.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.468+0000 7f6299d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f629c09d400 0x7f629c09d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:30.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.468+0000 7f629a59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f629c133e00 0x7f629c1341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53948/0 (socket says 172.21.15.40:53948) 2023-09-30T22:30:30.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.468+0000 7f629a59c700 1 -- 172.21.15.40:0/409554490 learned_addr learned my addr 172.21.15.40:0/409554490 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:30.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.468+0000 7f6299d9b700 1 -- 172.21.15.40:0/409554490 >> v2:172.21.15.40:3300/0 conn(0x7f629c133e00 msgr2=0x7f629c1341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:30.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.468+0000 7f6299d9b700 1 --2- 172.21.15.40:0/409554490 >> v2:172.21.15.40:3300/0 conn(0x7f629c133e00 0x7f629c1341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.468+0000 7f6299d9b700 1 -- 172.21.15.40:0/409554490 >> v1:172.21.15.40:6789/0 conn(0x7f629c09dd70 legacy=0x7f629c13ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:30.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.468+0000 7f6299d9b700 1 -- 172.21.15.40:0/409554490 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629c09a860 con 0x7f629c09d400 2023-09-30T22:30:30.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.468+0000 7f6299d9b700 1 --2- 172.21.15.40:0/409554490 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f629c09d400 0x7f629c09d830 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f6290009840 tx=0x7f6290009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1ddba61c07b7e80 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:30.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.469+0000 7f629959a700 1 -- 172.21.15.40:0/409554490 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6290011830 con 0x7f629c09d400 2023-09-30T22:30:30.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.469+0000 7f629959a700 1 -- 172.21.15.40:0/409554490 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6290011990 con 0x7f629c09d400 2023-09-30T22:30:30.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.469+0000 7f629959a700 1 -- 172.21.15.40:0/409554490 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6290011d20 con 0x7f629c09d400 2023-09-30T22:30:30.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.469+0000 7f62a087e700 1 -- 172.21.15.40:0/409554490 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f629c09d400 msgr2=0x7f629c09d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:30.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.469+0000 7f62a087e700 1 --2- 172.21.15.40:0/409554490 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f629c09d400 0x7f629c09d830 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f6290009840 tx=0x7f6290009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:30.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.469+0000 7f62a087e700 1 -- 172.21.15.40:0/409554490 shutdown_connections 2023-09-30T22:30:30.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.469+0000 7f62a087e700 1 --2- 172.21.15.40:0/409554490 >> v2:172.21.15.40:3300/0 conn(0x7f629c133e00 0x7f629c1341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.469+0000 7f62a087e700 1 --2- 172.21.15.40:0/409554490 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f629c09d400 0x7f629c09d830 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.469+0000 7f62a087e700 1 -- 172.21.15.40:0/409554490 >> 172.21.15.40:0/409554490 conn(0x7f629c0a2a00 msgr2=0x7f629c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:30.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.470+0000 7f62a087e700 1 -- 172.21.15.40:0/409554490 shutdown_connections 2023-09-30T22:30:30.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.470+0000 7f62a087e700 1 -- 172.21.15.40:0/409554490 wait complete. 2023-09-30T22:30:30.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.471+0000 7f62a087e700 1 Processor -- start 2023-09-30T22:30:30.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.471+0000 7f62a087e700 1 -- start start 2023-09-30T22:30:30.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.472+0000 7f62a087e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f629c09d400 0x7f629c11bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:30.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.472+0000 7f62a087e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f629c09dd70 0x7f629c11c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:30.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.472+0000 7f62a087e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f629c133e00 0x7f629c11c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:30.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.472+0000 7f62a087e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629c11f890 con 0x7f629c09dd70 2023-09-30T22:30:30.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.472+0000 7f62a087e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f629c0a0120 con 0x7f629c09d400 2023-09-30T22:30:30.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.472+0000 7f62a087e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f629c12e1a0 con 0x7f629c133e00 2023-09-30T22:30:30.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.472+0000 7f629a59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f629c09d400 0x7f629c11bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:30.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.472+0000 7f629a59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f629c09d400 0x7f629c11bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:34320/0 (socket says 172.21.15.40:34320) 2023-09-30T22:30:30.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.472+0000 7f629a59c700 1 -- 172.21.15.40:0/3376756151 learned_addr learned my addr 172.21.15.40:0/3376756151 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:30.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.472+0000 7f6299d9b700 1 --2- 172.21.15.40:0/3376756151 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f629c09dd70 0x7f629c11c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:30.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.472+0000 7f629ad9d700 1 --2- 172.21.15.40:0/3376756151 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f629c133e00 0x7f629c11c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:30.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.472+0000 7f629a59c700 1 -- 172.21.15.40:0/3376756151 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f629c133e00 msgr2=0x7f629c11c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:30.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.472+0000 7f629a59c700 1 --2- 172.21.15.40:0/3376756151 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f629c133e00 0x7f629c11c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.472+0000 7f629a59c700 1 -- 172.21.15.40:0/3376756151 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f629c09dd70 msgr2=0x7f629c11c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:30.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.472+0000 7f629a59c700 1 --2- 172.21.15.40:0/3376756151 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f629c09dd70 0x7f629c11c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.472+0000 7f629a59c700 1 -- 172.21.15.40:0/3376756151 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62900094a0 con 0x7f629c09d400 2023-09-30T22:30:30.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.472+0000 7f6299d9b700 1 --2- 172.21.15.40:0/3376756151 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f629c09dd70 0x7f629c11c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:30.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.473+0000 7f629a59c700 1 --2- 172.21.15.40:0/3376756151 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f629c09d400 0x7f629c11bdf0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f628c00e910 tx=0x7f628c00ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:30.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.473+0000 7f628affd700 1 -- 172.21.15.40:0/3376756151 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c0096a0 con 0x7f629c09d400 2023-09-30T22:30:30.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.473+0000 7f628affd700 1 -- 172.21.15.40:0/3376756151 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628c013680 con 0x7f629c09d400 2023-09-30T22:30:30.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.473+0000 7f62a087e700 1 -- 172.21.15.40:0/3376756151 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f629c11d9b0 con 0x7f629c09d400 2023-09-30T22:30:30.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.473+0000 7f628affd700 1 -- 172.21.15.40:0/3376756151 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c013a30 con 0x7f629c09d400 2023-09-30T22:30:30.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.473+0000 7f62a087e700 1 -- 172.21.15.40:0/3376756151 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f629c11fd90 con 0x7f629c09d400 2023-09-30T22:30:30.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.474+0000 7f628affd700 1 -- 172.21.15.40:0/3376756151 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f628c013b90 con 0x7f629c09d400 2023-09-30T22:30:30.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.474+0000 7f628affd700 1 -- 172.21.15.40:0/3376756151 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f628c03fa90 con 0x7f629c09d400 2023-09-30T22:30:30.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.474+0000 7f62a087e700 1 -- 172.21.15.40:0/3376756151 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f629c11f1c0 con 0x7f629c09d400 2023-09-30T22:30:30.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.483+0000 7f628affd700 1 -- 172.21.15.40:0/3376756151 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f628c021020 con 0x7f629c09d400 2023-09-30T22:30:30.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.510+0000 7f3eab313700 1 Processor -- start 2023-09-30T22:30:30.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.510+0000 7f3eab313700 1 -- start start 2023-09-30T22:30:30.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.510+0000 7f3eab313700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ea409c890 0x7f3ea409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:30.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.510+0000 7f3eab313700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ea409d920 0x7f3ea409dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:30.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.510+0000 7f3eab313700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ea40a2600 con 0x7f3ea409e2b0 2023-09-30T22:30:30.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.510+0000 7f3eab313700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea40a29d0 con 0x7f3ea409d920 2023-09-30T22:30:30.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.510+0000 7f3eab313700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea409fb40 con 0x7f3ea409c890 2023-09-30T22:30:30.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.511+0000 7f3ea90af700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ea409c890 0x7f3ea409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:30.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.511+0000 7f3ea98b0700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3ea409e2b0 0x7f3ea413ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46126/0 (socket says 172.21.15.40:46126) 2023-09-30T22:30:30.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.511+0000 7f3ea98b0700 1 -- 172.21.15.40:0/4097227256 learned_addr learned my addr 172.21.15.40:0/4097227256 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:30.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.511+0000 7f3ea88ae700 1 --2- 172.21.15.40:0/4097227256 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ea409d920 0x7f3ea409dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:30.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.511+0000 7f3e9bfff700 1 -- 172.21.15.40:0/4097227256 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1476136876 0 0) 0x7f3ea40a2600 con 0x7f3ea409e2b0 2023-09-30T22:30:30.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.511+0000 7f3e9bfff700 1 -- 172.21.15.40:0/4097227256 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e900035b0 con 0x7f3ea409e2b0 2023-09-30T22:30:30.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.511+0000 7f3ea88ae700 1 -- 172.21.15.40:0/4097227256 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ea409c890 msgr2=0x7f3ea409cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:30.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.511+0000 7f3ea88ae700 1 --2- 172.21.15.40:0/4097227256 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ea409c890 0x7f3ea409cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.511+0000 7f3ea88ae700 1 -- 172.21.15.40:0/4097227256 >> v1:172.21.15.40:6789/0 conn(0x7f3ea409e2b0 legacy=0x7f3ea413ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:30.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.511+0000 7f3ea88ae700 1 -- 172.21.15.40:0/4097227256 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea409e720 con 0x7f3ea409d920 2023-09-30T22:30:30.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.511+0000 7f3ea90af700 1 --2- 172.21.15.40:0/4097227256 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ea409c890 0x7f3ea409cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:30.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.511+0000 7f3ea88ae700 1 --2- 172.21.15.40:0/4097227256 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ea409d920 0x7f3ea409dd70 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f3e94009870 tx=0x7f3e94009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c9a7d63b2d5086 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:30.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.511+0000 7f3e9bfff700 1 -- 172.21.15.40:0/4097227256 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e94011830 con 0x7f3ea409d920 2023-09-30T22:30:30.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.511+0000 7f3e9bfff700 1 -- 172.21.15.40:0/4097227256 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e94011990 con 0x7f3ea409d920 2023-09-30T22:30:30.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.511+0000 7f3e9bfff700 1 -- 172.21.15.40:0/4097227256 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e94011d20 con 0x7f3ea409d920 2023-09-30T22:30:30.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.512+0000 7f3eab313700 1 -- 172.21.15.40:0/4097227256 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ea409d920 msgr2=0x7f3ea409dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:30.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.512+0000 7f3eab313700 1 --2- 172.21.15.40:0/4097227256 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ea409d920 0x7f3ea409dd70 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f3e94009870 tx=0x7f3e94009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:30.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.512+0000 7f3eab313700 1 -- 172.21.15.40:0/4097227256 shutdown_connections 2023-09-30T22:30:30.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.512+0000 7f3eab313700 1 --2- 172.21.15.40:0/4097227256 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ea409c890 0x7f3ea409cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.512+0000 7f3eab313700 1 --2- 172.21.15.40:0/4097227256 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ea409d920 0x7f3ea409dd70 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.512+0000 7f3eab313700 1 -- 172.21.15.40:0/4097227256 >> 172.21.15.40:0/4097227256 conn(0x7f3ea40a7080 msgr2=0x7f3ea40a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:30.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.512+0000 7f3eab313700 1 -- 172.21.15.40:0/4097227256 shutdown_connections 2023-09-30T22:30:30.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.513+0000 7f3eab313700 1 -- 172.21.15.40:0/4097227256 wait complete. 2023-09-30T22:30:30.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.513+0000 7f3eab313700 1 Processor -- start 2023-09-30T22:30:30.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.513+0000 7f3eab313700 1 -- start start 2023-09-30T22:30:30.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.514+0000 7f3eab313700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ea409c890 0x7f3ea412f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:30.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.514+0000 7f3eab313700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ea409d920 0x7f3ea412fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:30.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.514+0000 7f3eab313700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ea409e2b0 0x7f3ea4130090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:30.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.514+0000 7f3eab313700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea412eb40 con 0x7f3ea409c890 2023-09-30T22:30:30.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.514+0000 7f3eab313700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea412d0d0 con 0x7f3ea409d920 2023-09-30T22:30:30.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.514+0000 7f3eab313700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea40a5a80 con 0x7f3ea409e2b0 2023-09-30T22:30:30.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.514+0000 7f3ea88ae700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ea409d920 0x7f3ea412fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:30.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.514+0000 7f3ea88ae700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ea409d920 0x7f3ea412fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:34344/0 (socket says 172.21.15.40:34344) 2023-09-30T22:30:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.514+0000 7f3ea88ae700 1 -- 172.21.15.40:0/1688924455 learned_addr learned my addr 172.21.15.40:0/1688924455 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.514+0000 7f3ea98b0700 1 --2- 172.21.15.40:0/1688924455 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ea409e2b0 0x7f3ea4130090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.514+0000 7f3ea90af700 1 --2- 172.21.15.40:0/1688924455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ea409c890 0x7f3ea412f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.514+0000 7f3ea88ae700 1 -- 172.21.15.40:0/1688924455 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ea409e2b0 msgr2=0x7f3ea4130090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.514+0000 7f3ea88ae700 1 --2- 172.21.15.40:0/1688924455 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ea409e2b0 0x7f3ea4130090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.514+0000 7f3ea88ae700 1 -- 172.21.15.40:0/1688924455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ea409c890 msgr2=0x7f3ea412f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.514+0000 7f3ea88ae700 1 --2- 172.21.15.40:0/1688924455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ea409c890 0x7f3ea412f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.514+0000 7f3ea88ae700 1 -- 172.21.15.40:0/1688924455 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea0009430 con 0x7f3ea409d920 2023-09-30T22:30:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.515+0000 7f3ea88ae700 1 --2- 172.21.15.40:0/1688924455 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ea409d920 0x7f3ea412fb50 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3e94009bc0 tx=0x7f3e94004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.515+0000 7f3e99ffb700 1 -- 172.21.15.40:0/1688924455 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e94004300 con 0x7f3ea409d920 2023-09-30T22:30:30.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.515+0000 7f3e99ffb700 1 -- 172.21.15.40:0/1688924455 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e9401f070 con 0x7f3ea409d920 2023-09-30T22:30:30.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.515+0000 7f3eab313700 1 -- 172.21.15.40:0/1688924455 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e940094a0 con 0x7f3ea409d920 2023-09-30T22:30:30.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.515+0000 7f3e99ffb700 1 -- 172.21.15.40:0/1688924455 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e940036a0 con 0x7f3ea409d920 2023-09-30T22:30:30.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.515+0000 7f3eab313700 1 -- 172.21.15.40:0/1688924455 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea412e750 con 0x7f3ea409d920 2023-09-30T22:30:30.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.516+0000 7f3eab313700 1 -- 172.21.15.40:0/1688924455 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ea412dd10 con 0x7f3ea409d920 2023-09-30T22:30:30.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.516+0000 7f3e99ffb700 1 -- 172.21.15.40:0/1688924455 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3e94021030 con 0x7f3ea409d920 2023-09-30T22:30:30.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.516+0000 7f3e99ffb700 1 -- 172.21.15.40:0/1688924455 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3e940405e0 con 0x7f3ea409d920 2023-09-30T22:30:30.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.525+0000 7f3e99ffb700 1 -- 172.21.15.40:0/1688924455 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3e940239c0 con 0x7f3ea409d920 2023-09-30T22:30:30.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.605+0000 7f8ecddf7700 1 -- 172.21.15.40:0/1437884683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8ec8125d50 con 0x7f8ec809d920 2023-09-30T22:30:30.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.606+0000 7f8eaffff700 1 -- 172.21.15.40:0/1437884683 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ec8125d50 con 0x7f8ec809d920 2023-09-30T22:30:30.607 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:30.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.608+0000 7f8ecddf7700 1 -- 172.21.15.40:0/1437884683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ec809d920 msgr2=0x7f8ec81226b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:30.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.608+0000 7f8ecddf7700 1 --2- 172.21.15.40:0/1437884683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ec809d920 0x7f8ec81226b0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f8eb800e8a0 tx=0x7f8eb800ebb0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.608+0000 7f8ecddf7700 1 -- 172.21.15.40:0/1437884683 shutdown_connections 2023-09-30T22:30:30.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.608+0000 7f8ecddf7700 1 --2- 172.21.15.40:0/1437884683 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ec8123130 0x7f8ec81ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.608+0000 7f8ecddf7700 1 --2- 172.21.15.40:0/1437884683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ec809d920 0x7f8ec81226b0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.608+0000 7f8ecddf7700 1 --2- 172.21.15.40:0/1437884683 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ec809e230 0x7f8ec8122bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.608+0000 7f8ecddf7700 1 -- 172.21.15.40:0/1437884683 >> 172.21.15.40:0/1437884683 conn(0x7f8ec809fb20 msgr2=0x7f8ec80707d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:30.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.608+0000 7f8ecddf7700 1 -- 172.21.15.40:0/1437884683 shutdown_connections 2023-09-30T22:30:30.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.608+0000 7f8ecddf7700 1 -- 172.21.15.40:0/1437884683 wait complete. 2023-09-30T22:30:30.621 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:30.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.687+0000 7f62a087e700 1 -- 172.21.15.40:0/3376756151 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f629c062380 con 0x7f629c09d400 2023-09-30T22:30:30.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.687+0000 7f628affd700 1 -- 172.21.15.40:0/3376756151 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f628c017070 con 0x7f629c09d400 2023-09-30T22:30:30.688 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:30.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.691+0000 7f62a087e700 1 -- 172.21.15.40:0/3376756151 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f629c09d400 msgr2=0x7f629c11bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:30.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.691+0000 7f62a087e700 1 --2- 172.21.15.40:0/3376756151 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f629c09d400 0x7f629c11bdf0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f628c00e910 tx=0x7f628c00ec20 comp rx=0 tx=0).stop 2023-09-30T22:30:30.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.691+0000 7f62a087e700 1 -- 172.21.15.40:0/3376756151 shutdown_connections 2023-09-30T22:30:30.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.691+0000 7f62a087e700 1 --2- 172.21.15.40:0/3376756151 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f629c133e00 0x7f629c11c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.691+0000 7f62a087e700 1 --2- 172.21.15.40:0/3376756151 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f629c09d400 0x7f629c11bdf0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.691+0000 7f62a087e700 1 --2- 172.21.15.40:0/3376756151 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f629c09dd70 0x7f629c11c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.691+0000 7f62a087e700 1 -- 172.21.15.40:0/3376756151 >> 172.21.15.40:0/3376756151 conn(0x7f629c0a2a00 msgr2=0x7f629c131840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:30.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.691+0000 7f62a087e700 1 -- 172.21.15.40:0/3376756151 shutdown_connections 2023-09-30T22:30:30.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.691+0000 7f62a087e700 1 -- 172.21.15.40:0/3376756151 wait complete. 2023-09-30T22:30:30.708 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:30.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.732+0000 7f3eab313700 1 -- 172.21.15.40:0/1688924455 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3ea406e600 con 0x7f3ea409d920 2023-09-30T22:30:30.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.732+0000 7f3e99ffb700 1 -- 172.21.15.40:0/1688924455 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3e94015030 con 0x7f3ea409d920 2023-09-30T22:30:30.733 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:30.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.734+0000 7f3eab313700 1 -- 172.21.15.40:0/1688924455 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ea409d920 msgr2=0x7f3ea412fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:30.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.734+0000 7f3eab313700 1 --2- 172.21.15.40:0/1688924455 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ea409d920 0x7f3ea412fb50 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3e94009bc0 tx=0x7f3e94004750 comp rx=0 tx=0).stop 2023-09-30T22:30:30.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.734+0000 7f3eab313700 1 -- 172.21.15.40:0/1688924455 shutdown_connections 2023-09-30T22:30:30.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.734+0000 7f3eab313700 1 --2- 172.21.15.40:0/1688924455 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3ea409e2b0 0x7f3ea4130090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.734+0000 7f3eab313700 1 --2- 172.21.15.40:0/1688924455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ea409c890 0x7f3ea412f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.734+0000 7f3eab313700 1 --2- 172.21.15.40:0/1688924455 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3ea409d920 0x7f3ea412fb50 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.734+0000 7f3eab313700 1 -- 172.21.15.40:0/1688924455 >> 172.21.15.40:0/1688924455 conn(0x7f3ea40a7080 msgr2=0x7f3ea41baff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:30.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.734+0000 7f3eab313700 1 -- 172.21.15.40:0/1688924455 shutdown_connections 2023-09-30T22:30:30.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.734+0000 7f3eab313700 1 -- 172.21.15.40:0/1688924455 wait complete. 2023-09-30T22:30:30.747 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:30.756 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:30.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.914+0000 7fa310849700 1 Processor -- start 2023-09-30T22:30:30.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.914+0000 7fa310849700 1 -- start start 2023-09-30T22:30:30.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.915+0000 7fa310849700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa30c136bf0 0x7fa30c138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:30.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.915+0000 7fa310849700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa30c139510 0x7fa30c13b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:30.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.915+0000 7fa310849700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa30c0a2600 con 0x7fa30c09c890 2023-09-30T22:30:30.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.915+0000 7fa310849700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa30c0a29d0 con 0x7fa30c139510 2023-09-30T22:30:30.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.915+0000 7fa310849700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c09fb40 con 0x7fa30c136bf0 2023-09-30T22:30:30.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.915+0000 7fa30ad9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa30c139510 0x7fa30c13b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:30.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.915+0000 7fa309d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa30c136bf0 0x7fa30c138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:30.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.915+0000 7fa30ad9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa30c139510 0x7fa30c13b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53982/0 (socket says 172.21.15.40:53982) 2023-09-30T22:30:30.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.915+0000 7fa30ad9d700 1 -- 172.21.15.40:0/3091092486 learned_addr learned my addr 172.21.15.40:0/3091092486 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:30.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.915+0000 7fa309d9b700 1 -- 172.21.15.40:0/3091092486 >> v2:172.21.15.40:3300/0 conn(0x7fa30c139510 msgr2=0x7fa30c13b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:30.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.915+0000 7fa309d9b700 1 --2- 172.21.15.40:0/3091092486 >> v2:172.21.15.40:3300/0 conn(0x7fa30c139510 0x7fa30c13b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.915+0000 7fa309d9b700 1 -- 172.21.15.40:0/3091092486 >> v1:172.21.15.40:6789/0 conn(0x7fa30c09c890 legacy=0x7fa30c09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:30.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.915+0000 7fa309d9b700 1 -- 172.21.15.40:0/3091092486 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30c09d370 con 0x7fa30c136bf0 2023-09-30T22:30:30.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.915+0000 7fa30ad9d700 1 --2- 172.21.15.40:0/3091092486 >> v2:172.21.15.40:3300/0 conn(0x7fa30c139510 0x7fa30c13b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:30.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.915+0000 7fa309d9b700 1 --2- 172.21.15.40:0/3091092486 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa30c136bf0 0x7fa30c138fd0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc009840 tx=0x7fa2fc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecdea09ee48f9011 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:30.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.915+0000 7fa30959a700 1 -- 172.21.15.40:0/3091092486 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc011830 con 0x7fa30c136bf0 2023-09-30T22:30:30.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.915+0000 7fa30959a700 1 -- 172.21.15.40:0/3091092486 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2fc011990 con 0x7fa30c136bf0 2023-09-30T22:30:30.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.915+0000 7fa30959a700 1 -- 172.21.15.40:0/3091092486 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc011d20 con 0x7fa30c136bf0 2023-09-30T22:30:30.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.916+0000 7fa310849700 1 -- 172.21.15.40:0/3091092486 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa30c136bf0 msgr2=0x7fa30c138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:30.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.916+0000 7fa310849700 1 --2- 172.21.15.40:0/3091092486 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa30c136bf0 0x7fa30c138fd0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc009840 tx=0x7fa2fc009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:30.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.916+0000 7fa310849700 1 -- 172.21.15.40:0/3091092486 shutdown_connections 2023-09-30T22:30:30.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.916+0000 7fa310849700 1 --2- 172.21.15.40:0/3091092486 >> v2:172.21.15.40:3300/0 conn(0x7fa30c139510 0x7fa30c13b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.916+0000 7fa310849700 1 --2- 172.21.15.40:0/3091092486 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa30c136bf0 0x7fa30c138fd0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.916+0000 7fa310849700 1 -- 172.21.15.40:0/3091092486 >> 172.21.15.40:0/3091092486 conn(0x7fa30c0a7080 msgr2=0x7fa30c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:30.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.916+0000 7fa310849700 1 -- 172.21.15.40:0/3091092486 shutdown_connections 2023-09-30T22:30:30.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.916+0000 7fa310849700 1 -- 172.21.15.40:0/3091092486 wait complete. 2023-09-30T22:30:30.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.917+0000 7fa310849700 1 Processor -- start 2023-09-30T22:30:30.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.917+0000 7fa310849700 1 -- start start 2023-09-30T22:30:30.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.917+0000 7fa310849700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa30c09c890 0x7fa30c06eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:30.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.917+0000 7fa310849700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa30c136bf0 0x7fa30c06f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:30.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.917+0000 7fa310849700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa30c139510 0x7fa30c06fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:30.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.917+0000 7fa310849700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c0704c0 con 0x7fa30c139510 2023-09-30T22:30:30.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.917+0000 7fa310849700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c12bb70 con 0x7fa30c136bf0 2023-09-30T22:30:30.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.917+0000 7fa310849700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c0a6210 con 0x7fa30c09c890 2023-09-30T22:30:30.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.918+0000 7fa309d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa30c136bf0 0x7fa30c06f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:30.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.918+0000 7fa30ad9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa30c139510 0x7fa30c06fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:30.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.918+0000 7fa309d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa30c136bf0 0x7fa30c06f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:34360/0 (socket says 172.21.15.40:34360) 2023-09-30T22:30:30.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.918+0000 7fa30ad9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa30c139510 0x7fa30c06fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53984/0 (socket says 172.21.15.40:53984) 2023-09-30T22:30:30.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.918+0000 7fa309d9b700 1 -- 172.21.15.40:0/3236295862 learned_addr learned my addr 172.21.15.40:0/3236295862 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:30.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.918+0000 7fa30a59c700 1 --2- 172.21.15.40:0/3236295862 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa30c09c890 0x7fa30c06eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:30.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.918+0000 7fa309d9b700 1 -- 172.21.15.40:0/3236295862 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa30c09c890 msgr2=0x7fa30c06eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:30.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.918+0000 7fa309d9b700 1 --2- 172.21.15.40:0/3236295862 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa30c09c890 0x7fa30c06eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.918+0000 7fa309d9b700 1 -- 172.21.15.40:0/3236295862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa30c139510 msgr2=0x7fa30c06fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:30.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.918+0000 7fa309d9b700 1 --2- 172.21.15.40:0/3236295862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa30c139510 0x7fa30c06fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:30.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.918+0000 7fa309d9b700 1 -- 172.21.15.40:0/3236295862 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa304009b30 con 0x7fa30c136bf0 2023-09-30T22:30:30.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.918+0000 7fa30ad9d700 1 --2- 172.21.15.40:0/3236295862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa30c139510 0x7fa30c06fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:30.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.918+0000 7fa309d9b700 1 --2- 172.21.15.40:0/3236295862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa30c136bf0 0x7fa30c06f530 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc0090b0 tx=0x7fa2fc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:30.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.918+0000 7fa2faffd700 1 -- 172.21.15.40:0/3236295862 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc004400 con 0x7fa30c136bf0 2023-09-30T22:30:30.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.918+0000 7fa2faffd700 1 -- 172.21.15.40:0/3236295862 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2fc01f070 con 0x7fa30c136bf0 2023-09-30T22:30:30.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.918+0000 7fa2faffd700 1 -- 172.21.15.40:0/3236295862 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc0038e0 con 0x7fa30c136bf0 2023-09-30T22:30:30.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.918+0000 7fa310849700 1 -- 172.21.15.40:0/3236295862 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2fc0094a0 con 0x7fa30c136bf0 2023-09-30T22:30:30.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.918+0000 7fa310849700 1 -- 172.21.15.40:0/3236295862 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa30c070c10 con 0x7fa30c136bf0 2023-09-30T22:30:30.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.919+0000 7fa2faffd700 1 -- 172.21.15.40:0/3236295862 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa2fc021030 con 0x7fa30c136bf0 2023-09-30T22:30:30.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.919+0000 7fa2faffd700 1 -- 172.21.15.40:0/3236295862 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa2fc040800 con 0x7fa30c136bf0 2023-09-30T22:30:30.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.919+0000 7fa310849700 1 -- 172.21.15.40:0/3236295862 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa30c12c050 con 0x7fa30c136bf0 2023-09-30T22:30:30.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:30.924+0000 7fa2faffd700 1 -- 172.21.15.40:0/3236295862 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa30c12c050 con 0x7fa30c136bf0 2023-09-30T22:30:31.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.117+0000 7fa310849700 1 -- 172.21.15.40:0/3236295862 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa30c12c050 con 0x7fa30c136bf0 2023-09-30T22:30:31.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.118+0000 7fa2faffd700 1 -- 172.21.15.40:0/3236295862 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa30c12c050 con 0x7fa30c136bf0 2023-09-30T22:30:31.118 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:31.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.120+0000 7fa310849700 1 -- 172.21.15.40:0/3236295862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa30c136bf0 msgr2=0x7fa30c06f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:31.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.120+0000 7fa310849700 1 --2- 172.21.15.40:0/3236295862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa30c136bf0 0x7fa30c06f530 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc0090b0 tx=0x7fa2fc004750 comp rx=0 tx=0).stop 2023-09-30T22:30:31.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.120+0000 7fa310849700 1 -- 172.21.15.40:0/3236295862 shutdown_connections 2023-09-30T22:30:31.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.120+0000 7fa310849700 1 --2- 172.21.15.40:0/3236295862 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa30c09c890 0x7fa30c06eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.120+0000 7fa310849700 1 --2- 172.21.15.40:0/3236295862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa30c139510 0x7fa30c06fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.120+0000 7fa310849700 1 --2- 172.21.15.40:0/3236295862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa30c136bf0 0x7fa30c06f530 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.120+0000 7fa310849700 1 -- 172.21.15.40:0/3236295862 >> 172.21.15.40:0/3236295862 conn(0x7fa30c0a7080 msgr2=0x7fa30c136fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:31.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.120+0000 7fa310849700 1 -- 172.21.15.40:0/3236295862 shutdown_connections 2023-09-30T22:30:31.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.120+0000 7fa310849700 1 -- 172.21.15.40:0/3236295862 wait complete. 2023-09-30T22:30:31.133 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:31.622 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:31.708 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:31.750 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:31.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.759+0000 7ff73114e700 1 Processor -- start 2023-09-30T22:30:31.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.759+0000 7ff73114e700 1 -- start start 2023-09-30T22:30:31.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.760+0000 7ff73114e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff72c09d450 0x7ff72c09d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:31.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.760+0000 7ff73114e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff72c09dd60 0x7ff72c1301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:31.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.760+0000 7ff73114e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff72c130700 0x7ff72c130b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:31.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.760+0000 7ff73114e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff72c09e8b0 con 0x7ff72c09d450 2023-09-30T22:30:31.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.760+0000 7ff73114e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c09c3b0 con 0x7ff72c130700 2023-09-30T22:30:31.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.760+0000 7ff73114e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c09a6b0 con 0x7ff72c09dd60 2023-09-30T22:30:31.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.760+0000 7ff72ad9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff72c09d450 0x7ff72c09d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:31.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.760+0000 7ff72b59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff72c130700 0x7ff72c130b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:31.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.760+0000 7ff72a59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff72c09dd60 0x7ff72c1301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:31.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.760+0000 7ff72b59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff72c130700 0x7ff72c130b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:34364/0 (socket says 172.21.15.40:34364) 2023-09-30T22:30:31.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.760+0000 7ff72ad9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff72c09d450 0x7ff72c09d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53988/0 (socket says 172.21.15.40:53988) 2023-09-30T22:30:31.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.760+0000 7ff72b59e700 1 -- 172.21.15.40:0/3827475656 learned_addr learned my addr 172.21.15.40:0/3827475656 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:31.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.760+0000 7ff72b59e700 1 -- 172.21.15.40:0/3827475656 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff72c09dd60 msgr2=0x7ff72c1301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:31.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.760+0000 7ff72b59e700 1 --2- 172.21.15.40:0/3827475656 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff72c09dd60 0x7ff72c1301c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.760+0000 7ff72b59e700 1 -- 172.21.15.40:0/3827475656 >> v2:172.21.15.40:3300/0 conn(0x7ff72c09d450 msgr2=0x7ff72c09d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:31.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.760+0000 7ff72b59e700 1 --2- 172.21.15.40:0/3827475656 >> v2:172.21.15.40:3300/0 conn(0x7ff72c09d450 0x7ff72c09d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.760+0000 7ff72b59e700 1 -- 172.21.15.40:0/3827475656 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff72c09b4f0 con 0x7ff72c130700 2023-09-30T22:30:31.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.760+0000 7ff72ad9d700 1 --2- 172.21.15.40:0/3827475656 >> v2:172.21.15.40:3300/0 conn(0x7ff72c09d450 0x7ff72c09d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:31.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.760+0000 7ff72b59e700 1 --2- 172.21.15.40:0/3827475656 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff72c130700 0x7ff72c130b80 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7ff72400bef0 tx=0x7ff72400a4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe8e46746334e64 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:31.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.761+0000 7ff729d9b700 1 -- 172.21.15.40:0/3827475656 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72400a2e0 con 0x7ff72c130700 2023-09-30T22:30:31.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.761+0000 7ff729d9b700 1 -- 172.21.15.40:0/3827475656 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff72400cb50 con 0x7ff72c130700 2023-09-30T22:30:31.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.761+0000 7ff729d9b700 1 -- 172.21.15.40:0/3827475656 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff724013420 con 0x7ff72c130700 2023-09-30T22:30:31.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.761+0000 7ff73114e700 1 -- 172.21.15.40:0/3827475656 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff72c130700 msgr2=0x7ff72c130b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:31.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.761+0000 7ff73114e700 1 --2- 172.21.15.40:0/3827475656 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff72c130700 0x7ff72c130b80 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7ff72400bef0 tx=0x7ff72400a4c0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.761+0000 7ff73114e700 1 -- 172.21.15.40:0/3827475656 shutdown_connections 2023-09-30T22:30:31.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.761+0000 7ff73114e700 1 --2- 172.21.15.40:0/3827475656 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff72c130700 0x7ff72c130b80 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.761+0000 7ff73114e700 1 --2- 172.21.15.40:0/3827475656 >> v2:172.21.15.40:3300/0 conn(0x7ff72c09d450 0x7ff72c09d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.761+0000 7ff73114e700 1 --2- 172.21.15.40:0/3827475656 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff72c09dd60 0x7ff72c1301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.761+0000 7ff73114e700 1 -- 172.21.15.40:0/3827475656 >> 172.21.15.40:0/3827475656 conn(0x7ff72c0a2a00 msgr2=0x7ff72c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:31.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.761+0000 7ff73114e700 1 -- 172.21.15.40:0/3827475656 shutdown_connections 2023-09-30T22:30:31.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.761+0000 7ff73114e700 1 -- 172.21.15.40:0/3827475656 wait complete. 2023-09-30T22:30:31.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.763+0000 7ff73114e700 1 Processor -- start 2023-09-30T22:30:31.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.763+0000 7ff73114e700 1 -- start start 2023-09-30T22:30:31.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.763+0000 7ff73114e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff72c09d450 0x7ff72c11afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:31.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.763+0000 7ff73114e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff72c09dd60 0x7ff72c11b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:31.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.763+0000 7ff73114e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff72c130700 0x7ff72c11ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:31.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.763+0000 7ff73114e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c11c480 con 0x7ff72c09dd60 2023-09-30T22:30:31.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.763+0000 7ff73114e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c11ead0 con 0x7ff72c09d450 2023-09-30T22:30:31.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.763+0000 7ff73114e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c11cbc0 con 0x7ff72c130700 2023-09-30T22:30:31.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.764+0000 7ff72ad9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff72c09d450 0x7ff72c11afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:31.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.764+0000 7ff72ad9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff72c09d450 0x7ff72c11afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:34370/0 (socket says 172.21.15.40:34370) 2023-09-30T22:30:31.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.764+0000 7ff72a59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff72c09dd60 0x7ff72c11b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:31.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.764+0000 7ff72ad9d700 1 -- 172.21.15.40:0/430964719 learned_addr learned my addr 172.21.15.40:0/430964719 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:31.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.764+0000 7ff72b59e700 1 --2- 172.21.15.40:0/430964719 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff72c130700 0x7ff72c11ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:31.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.764+0000 7ff72a59c700 1 -- 172.21.15.40:0/430964719 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff72c130700 msgr2=0x7ff72c11ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:31.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.764+0000 7ff72a59c700 1 --2- 172.21.15.40:0/430964719 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff72c130700 0x7ff72c11ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.764+0000 7ff72a59c700 1 -- 172.21.15.40:0/430964719 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff72c09d450 msgr2=0x7ff72c11afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:31.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.764+0000 7ff72a59c700 1 --2- 172.21.15.40:0/430964719 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff72c09d450 0x7ff72c11afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.764+0000 7ff72a59c700 1 -- 172.21.15.40:0/430964719 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff71c0094a0 con 0x7ff72c09dd60 2023-09-30T22:30:31.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.764+0000 7ff72a59c700 1 --2- 172.21.15.40:0/430964719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff72c09dd60 0x7ff72c11b4f0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7ff720012c40 tx=0x7ff720012f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:31.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.764+0000 7ff7137fe700 1 -- 172.21.15.40:0/430964719 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7200108d0 con 0x7ff72c09dd60 2023-09-30T22:30:31.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.764+0000 7ff7137fe700 1 -- 172.21.15.40:0/430964719 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff720013040 con 0x7ff72c09dd60 2023-09-30T22:30:31.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.765+0000 7ff73114e700 1 -- 172.21.15.40:0/430964719 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff72400bb50 con 0x7ff72c09dd60 2023-09-30T22:30:31.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.765+0000 7ff7137fe700 1 -- 172.21.15.40:0/430964719 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff720010c30 con 0x7ff72c09dd60 2023-09-30T22:30:31.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.765+0000 7ff73114e700 1 -- 172.21.15.40:0/430964719 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff72c11e530 con 0x7ff72c09dd60 2023-09-30T22:30:31.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.766+0000 7ff7137fe700 1 -- 172.21.15.40:0/430964719 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff720010d90 con 0x7ff72c09dd60 2023-09-30T22:30:31.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.766+0000 7ff73114e700 1 -- 172.21.15.40:0/430964719 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff72c062380 con 0x7ff72c09dd60 2023-09-30T22:30:31.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.766+0000 7ff7137fe700 1 -- 172.21.15.40:0/430964719 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff7200438f0 con 0x7ff72c09dd60 2023-09-30T22:30:31.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.775+0000 7ff7137fe700 1 -- 172.21.15.40:0/430964719 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff720018e60 con 0x7ff72c09dd60 2023-09-30T22:30:31.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.848+0000 7f833d502700 1 Processor -- start 2023-09-30T22:30:31.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.848+0000 7f833d502700 1 -- start start 2023-09-30T22:30:31.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.848+0000 7f833d502700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f833806f070 0x7f833806f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:31.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.848+0000 7f833d502700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f833806fdb0 0x7f83380977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:31.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.848+0000 7f833d502700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8338070830 con 0x7f833806f980 2023-09-30T22:30:31.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.849+0000 7f833d502700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8338070ad0 con 0x7f833806fdb0 2023-09-30T22:30:31.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.849+0000 7f833d502700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8338070de0 con 0x7f833806f070 2023-09-30T22:30:31.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.849+0000 7f83377fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f833806fdb0 0x7f83380977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:31.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.849+0000 7f83367fc700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f833806f980 0x7f8338097090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46150/0 (socket says 172.21.15.40:46150) 2023-09-30T22:30:31.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.849+0000 7f83367fc700 1 -- 172.21.15.40:0/2466461047 learned_addr learned my addr 172.21.15.40:0/2466461047 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:31.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.849+0000 7f8336ffd700 1 --2- 172.21.15.40:0/2466461047 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f833806f070 0x7f833806f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:31.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.849+0000 7f8335ffb700 1 -- 172.21.15.40:0/2466461047 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2815923984 0 0) 0x7f8338070830 con 0x7f833806f980 2023-09-30T22:30:31.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.849+0000 7f8335ffb700 1 -- 172.21.15.40:0/2466461047 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83200035b0 con 0x7f833806f980 2023-09-30T22:30:31.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.849+0000 7f8336ffd700 1 -- 172.21.15.40:0/2466461047 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f833806fdb0 msgr2=0x7f83380977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:31.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.849+0000 7f8336ffd700 1 --2- 172.21.15.40:0/2466461047 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f833806fdb0 0x7f83380977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.849+0000 7f8336ffd700 1 -- 172.21.15.40:0/2466461047 >> v1:172.21.15.40:6789/0 conn(0x7f833806f980 legacy=0x7f8338097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:31.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.849+0000 7f8336ffd700 1 -- 172.21.15.40:0/2466461047 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f833809fe20 con 0x7f833806f070 2023-09-30T22:30:31.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.849+0000 7f8336ffd700 1 --2- 172.21.15.40:0/2466461047 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f833806f070 0x7f833806f440 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f8328009870 tx=0x7f8328009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b223c39bcb722303 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:31.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.849+0000 7f8335ffb700 1 -- 172.21.15.40:0/2466461047 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8328011830 con 0x7f833806f070 2023-09-30T22:30:31.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.850+0000 7f8335ffb700 1 -- 172.21.15.40:0/2466461047 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8328011990 con 0x7f833806f070 2023-09-30T22:30:31.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.850+0000 7f8335ffb700 1 -- 172.21.15.40:0/2466461047 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8328011d20 con 0x7f833806f070 2023-09-30T22:30:31.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.850+0000 7f833d502700 1 -- 172.21.15.40:0/2466461047 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f833806f070 msgr2=0x7f833806f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:31.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.850+0000 7f833d502700 1 --2- 172.21.15.40:0/2466461047 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f833806f070 0x7f833806f440 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f8328009870 tx=0x7f8328009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:31.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.850+0000 7f833d502700 1 -- 172.21.15.40:0/2466461047 shutdown_connections 2023-09-30T22:30:31.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.850+0000 7f833d502700 1 --2- 172.21.15.40:0/2466461047 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f833806fdb0 0x7f83380977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.850+0000 7f833d502700 1 --2- 172.21.15.40:0/2466461047 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f833806f070 0x7f833806f440 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.851+0000 7f833d502700 1 -- 172.21.15.40:0/2466461047 >> 172.21.15.40:0/2466461047 conn(0x7f83380a41a0 msgr2=0x7f83380a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:31.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.851+0000 7f833d502700 1 -- 172.21.15.40:0/2466461047 shutdown_connections 2023-09-30T22:30:31.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.851+0000 7f833d502700 1 -- 172.21.15.40:0/2466461047 wait complete. 2023-09-30T22:30:31.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.852+0000 7f833d502700 1 Processor -- start 2023-09-30T22:30:31.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.852+0000 7f833d502700 1 -- start start 2023-09-30T22:30:31.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.853+0000 7f833d502700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f833806f070 0x7f833806c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:31.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.853+0000 7f833d502700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f833806f980 0x7f833806ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:31.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.853+0000 7f833d502700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f833806fdb0 0x7f833806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:31.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.853+0000 7f833d502700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83381320c0 con 0x7f833806fdb0 2023-09-30T22:30:31.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.853+0000 7f833d502700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f833808b330 con 0x7f833806f070 2023-09-30T22:30:31.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.853+0000 7f833d502700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8338129330 con 0x7f833806f980 2023-09-30T22:30:31.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.853+0000 7f8336ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f833806f070 0x7f833806c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:31.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.853+0000 7f8336ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f833806f070 0x7f833806c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:34384/0 (socket says 172.21.15.40:34384) 2023-09-30T22:30:31.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.853+0000 7f8336ffd700 1 -- 172.21.15.40:0/3315458721 learned_addr learned my addr 172.21.15.40:0/3315458721 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:31.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.853+0000 7f83367fc700 1 --2- 172.21.15.40:0/3315458721 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f833806f980 0x7f833806ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:31.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.853+0000 7f83377fe700 1 --2- 172.21.15.40:0/3315458721 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f833806fdb0 0x7f833806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:31.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.853+0000 7f8336ffd700 1 -- 172.21.15.40:0/3315458721 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f833806f980 msgr2=0x7f833806ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:31.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.853+0000 7f8336ffd700 1 --2- 172.21.15.40:0/3315458721 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f833806f980 0x7f833806ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.853+0000 7f8336ffd700 1 -- 172.21.15.40:0/3315458721 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f833806fdb0 msgr2=0x7f833806d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:31.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.853+0000 7f8336ffd700 1 --2- 172.21.15.40:0/3315458721 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f833806fdb0 0x7f833806d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.853+0000 7f8336ffd700 1 -- 172.21.15.40:0/3315458721 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83280094a0 con 0x7f833806f070 2023-09-30T22:30:31.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.854+0000 7f8336ffd700 1 --2- 172.21.15.40:0/3315458721 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f833806f070 0x7f833806c990 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f83280090b0 tx=0x7f8328004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:31.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.854+0000 7f831f7fe700 1 -- 172.21.15.40:0/3315458721 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8328004240 con 0x7f833806f070 2023-09-30T22:30:31.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.854+0000 7f831f7fe700 1 -- 172.21.15.40:0/3315458721 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f832801f070 con 0x7f833806f070 2023-09-30T22:30:31.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.854+0000 7f833d502700 1 -- 172.21.15.40:0/3315458721 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f833812c2d0 con 0x7f833806f070 2023-09-30T22:30:31.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.854+0000 7f831f7fe700 1 -- 172.21.15.40:0/3315458721 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83280045c0 con 0x7f833806f070 2023-09-30T22:30:31.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.854+0000 7f833d502700 1 -- 172.21.15.40:0/3315458721 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f833806dac0 con 0x7f833806f070 2023-09-30T22:30:31.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.855+0000 7f833d502700 1 -- 172.21.15.40:0/3315458721 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f833808b150 con 0x7f833806f070 2023-09-30T22:30:31.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.855+0000 7f831f7fe700 1 -- 172.21.15.40:0/3315458721 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8328021030 con 0x7f833806f070 2023-09-30T22:30:31.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.855+0000 7f831f7fe700 1 -- 172.21.15.40:0/3315458721 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f8328040620 con 0x7f833806f070 2023-09-30T22:30:31.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.860+0000 7f831f7fe700 1 -- 172.21.15.40:0/3315458721 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f83280237e0 con 0x7f833806f070 2023-09-30T22:30:31.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.899+0000 7ffb2dd6a700 1 Processor -- start 2023-09-30T22:30:31.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.899+0000 7ffb2dd6a700 1 -- start start 2023-09-30T22:30:31.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.899+0000 7ffb2dd6a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb2809fbb0 0x7ffb2806c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:31.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.899+0000 7ffb2dd6a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb2806d2c0 0x7ffb2813baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:31.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.899+0000 7ffb2dd6a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb280a0590 con 0x7ffb2806ced0 2023-09-30T22:30:31.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.899+0000 7ffb2dd6a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2809ff80 con 0x7ffb2809fbb0 2023-09-30T22:30:31.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.899+0000 7ffb2dd6a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2806da80 con 0x7ffb2806d2c0 2023-09-30T22:30:31.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.899+0000 7ffb277fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb2809fbb0 0x7ffb2806c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:31.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.899+0000 7ffb26ffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ffb2806ced0 0x7ffb28138370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46156/0 (socket says 172.21.15.40:46156) 2023-09-30T22:30:31.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.899+0000 7ffb26ffd700 1 -- 172.21.15.40:0/2861911065 learned_addr learned my addr 172.21.15.40:0/2861911065 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:31.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.899+0000 7ffb27fff700 1 --2- 172.21.15.40:0/2861911065 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb2806d2c0 0x7ffb2813baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:31.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.900+0000 7ffb267fc700 1 -- 172.21.15.40:0/2861911065 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3886651189 0 0) 0x7ffb280a0590 con 0x7ffb2806ced0 2023-09-30T22:30:31.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.900+0000 7ffb277fe700 1 -- 172.21.15.40:0/2861911065 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb2806d2c0 msgr2=0x7ffb2813baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:31.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.900+0000 7ffb277fe700 1 --2- 172.21.15.40:0/2861911065 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb2806d2c0 0x7ffb2813baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.900+0000 7ffb277fe700 1 -- 172.21.15.40:0/2861911065 >> v1:172.21.15.40:6789/0 conn(0x7ffb2806ced0 legacy=0x7ffb28138370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:31.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.900+0000 7ffb277fe700 1 -- 172.21.15.40:0/2861911065 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb280a0780 con 0x7ffb2809fbb0 2023-09-30T22:30:31.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.900+0000 7ffb277fe700 1 --2- 172.21.15.40:0/2861911065 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb2809fbb0 0x7ffb2806c990 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7ffb18009870 tx=0x7ffb18009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2872ec7e806f431 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:31.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.900+0000 7ffb267fc700 1 -- 172.21.15.40:0/2861911065 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb18011830 con 0x7ffb2809fbb0 2023-09-30T22:30:31.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.900+0000 7ffb267fc700 1 -- 172.21.15.40:0/2861911065 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb18011990 con 0x7ffb2809fbb0 2023-09-30T22:30:31.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.900+0000 7ffb267fc700 1 -- 172.21.15.40:0/2861911065 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb18011d20 con 0x7ffb2809fbb0 2023-09-30T22:30:31.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.901+0000 7ffb2dd6a700 1 -- 172.21.15.40:0/2861911065 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb2809fbb0 msgr2=0x7ffb2806c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:31.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.901+0000 7ffb2dd6a700 1 --2- 172.21.15.40:0/2861911065 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb2809fbb0 0x7ffb2806c990 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7ffb18009870 tx=0x7ffb18009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:31.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.901+0000 7ffb2dd6a700 1 -- 172.21.15.40:0/2861911065 shutdown_connections 2023-09-30T22:30:31.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.901+0000 7ffb2dd6a700 1 --2- 172.21.15.40:0/2861911065 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb2806d2c0 0x7ffb2813baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.901+0000 7ffb2dd6a700 1 --2- 172.21.15.40:0/2861911065 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb2809fbb0 0x7ffb2806c990 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.901+0000 7ffb2dd6a700 1 -- 172.21.15.40:0/2861911065 >> 172.21.15.40:0/2861911065 conn(0x7ffb280a41a0 msgr2=0x7ffb280a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:31.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.901+0000 7ffb2dd6a700 1 -- 172.21.15.40:0/2861911065 shutdown_connections 2023-09-30T22:30:31.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.901+0000 7ffb2dd6a700 1 -- 172.21.15.40:0/2861911065 wait complete. 2023-09-30T22:30:31.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.902+0000 7ffb2dd6a700 1 Processor -- start 2023-09-30T22:30:31.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.902+0000 7ffb2dd6a700 1 -- start start 2023-09-30T22:30:31.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.902+0000 7ffb2dd6a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb2806ced0 0x7ffb2808f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:31.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.902+0000 7ffb2dd6a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb2806d2c0 0x7ffb2808f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:31.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.902+0000 7ffb2dd6a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb2809fbb0 0x7ffb2808fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:31.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.902+0000 7ffb2dd6a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb28090830 con 0x7ffb2806ced0 2023-09-30T22:30:31.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.902+0000 7ffb2dd6a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb28091e70 con 0x7ffb2806d2c0 2023-09-30T22:30:31.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.902+0000 7ffb2dd6a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2806f8c0 con 0x7ffb2809fbb0 2023-09-30T22:30:31.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.902+0000 7ffb277fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb2806ced0 0x7ffb2808f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:31.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.902+0000 7ffb277fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb2806ced0 0x7ffb2808f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54016/0 (socket says 172.21.15.40:54016) 2023-09-30T22:30:31.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.903+0000 7ffb277fe700 1 -- 172.21.15.40:0/3976377447 learned_addr learned my addr 172.21.15.40:0/3976377447 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:31.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.903+0000 7ffb27fff700 1 --2- 172.21.15.40:0/3976377447 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb2809fbb0 0x7ffb2808fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:31.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.903+0000 7ffb26ffd700 1 --2- 172.21.15.40:0/3976377447 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb2806d2c0 0x7ffb2808f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:31.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.903+0000 7ffb277fe700 1 -- 172.21.15.40:0/3976377447 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb2809fbb0 msgr2=0x7ffb2808fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:31.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.903+0000 7ffb277fe700 1 --2- 172.21.15.40:0/3976377447 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb2809fbb0 0x7ffb2808fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.903+0000 7ffb277fe700 1 -- 172.21.15.40:0/3976377447 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb2806d2c0 msgr2=0x7ffb2808f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:31.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.903+0000 7ffb277fe700 1 --2- 172.21.15.40:0/3976377447 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb2806d2c0 0x7ffb2808f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.903+0000 7ffb277fe700 1 -- 172.21.15.40:0/3976377447 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb180094a0 con 0x7ffb2806ced0 2023-09-30T22:30:31.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.903+0000 7ffb277fe700 1 --2- 172.21.15.40:0/3976377447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb2806ced0 0x7ffb2808f3e0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7ffb180090b0 tx=0x7ffb18004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:31.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.903+0000 7ffb0ffff700 1 -- 172.21.15.40:0/3976377447 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb18004590 con 0x7ffb2806ced0 2023-09-30T22:30:31.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.903+0000 7ffb0ffff700 1 -- 172.21.15.40:0/3976377447 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb180036a0 con 0x7ffb2806ced0 2023-09-30T22:30:31.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.903+0000 7ffb2dd6a700 1 -- 172.21.15.40:0/3976377447 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb2806df90 con 0x7ffb2806ced0 2023-09-30T22:30:31.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.903+0000 7ffb0ffff700 1 -- 172.21.15.40:0/3976377447 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb18003a50 con 0x7ffb2806ced0 2023-09-30T22:30:31.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.903+0000 7ffb2dd6a700 1 -- 172.21.15.40:0/3976377447 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb28071eb0 con 0x7ffb2806ced0 2023-09-30T22:30:31.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.904+0000 7ffb0ffff700 1 -- 172.21.15.40:0/3976377447 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffb18003bb0 con 0x7ffb2806ced0 2023-09-30T22:30:31.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.904+0000 7ffb0ffff700 1 -- 172.21.15.40:0/3976377447 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ffb18040b20 con 0x7ffb2806ced0 2023-09-30T22:30:31.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.904+0000 7ffb2dd6a700 1 -- 172.21.15.40:0/3976377447 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb28062380 con 0x7ffb2806ced0 2023-09-30T22:30:31.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.909+0000 7ffb0ffff700 1 -- 172.21.15.40:0/3976377447 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb18015080 con 0x7ffb2806ced0 2023-09-30T22:30:31.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.982+0000 7ff73114e700 1 -- 172.21.15.40:0/430964719 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff72c11d370 con 0x7ff72c09dd60 2023-09-30T22:30:31.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.982+0000 7ff7137fe700 1 -- 172.21.15.40:0/430964719 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff7200213c0 con 0x7ff72c09dd60 2023-09-30T22:30:31.983 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:31.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.984+0000 7ff73114e700 1 -- 172.21.15.40:0/430964719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff72c09dd60 msgr2=0x7ff72c11b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:31.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.984+0000 7ff73114e700 1 --2- 172.21.15.40:0/430964719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff72c09dd60 0x7ff72c11b4f0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7ff720012c40 tx=0x7ff720012f50 comp rx=0 tx=0).stop 2023-09-30T22:30:31.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.984+0000 7ff73114e700 1 -- 172.21.15.40:0/430964719 shutdown_connections 2023-09-30T22:30:31.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.984+0000 7ff73114e700 1 --2- 172.21.15.40:0/430964719 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff72c130700 0x7ff72c11ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.984+0000 7ff73114e700 1 --2- 172.21.15.40:0/430964719 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff72c09d450 0x7ff72c11afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.984+0000 7ff73114e700 1 --2- 172.21.15.40:0/430964719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff72c09dd60 0x7ff72c11b4f0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:31.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.984+0000 7ff73114e700 1 -- 172.21.15.40:0/430964719 >> 172.21.15.40:0/430964719 conn(0x7ff72c0a2a00 msgr2=0x7ff72c06fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:31.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.984+0000 7ff73114e700 1 -- 172.21.15.40:0/430964719 shutdown_connections 2023-09-30T22:30:31.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:31.984+0000 7ff73114e700 1 -- 172.21.15.40:0/430964719 wait complete. 2023-09-30T22:30:31.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:32.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.073+0000 7f833d502700 1 -- 172.21.15.40:0/3315458721 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8338062380 con 0x7f833806f070 2023-09-30T22:30:32.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.073+0000 7f831f7fe700 1 -- 172.21.15.40:0/3315458721 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8328015030 con 0x7f833806f070 2023-09-30T22:30:32.074 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:32.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.075+0000 7f833d502700 1 -- 172.21.15.40:0/3315458721 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f833806f070 msgr2=0x7f833806c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:32.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.075+0000 7f833d502700 1 --2- 172.21.15.40:0/3315458721 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f833806f070 0x7f833806c990 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f83280090b0 tx=0x7f8328004750 comp rx=0 tx=0).stop 2023-09-30T22:30:32.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.075+0000 7f833d502700 1 -- 172.21.15.40:0/3315458721 shutdown_connections 2023-09-30T22:30:32.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.075+0000 7f833d502700 1 --2- 172.21.15.40:0/3315458721 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f833806fdb0 0x7f833806d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.075+0000 7f833d502700 1 --2- 172.21.15.40:0/3315458721 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f833806f070 0x7f833806c990 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.075+0000 7f833d502700 1 --2- 172.21.15.40:0/3315458721 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f833806f980 0x7f833806ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.075+0000 7f833d502700 1 -- 172.21.15.40:0/3315458721 >> 172.21.15.40:0/3315458721 conn(0x7f83380a41a0 msgr2=0x7f83380a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:32.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.075+0000 7f833d502700 1 -- 172.21.15.40:0/3315458721 shutdown_connections 2023-09-30T22:30:32.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.075+0000 7f833d502700 1 -- 172.21.15.40:0/3315458721 wait complete. 2023-09-30T22:30:32.088 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:32.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.108+0000 7ffb2dd6a700 1 -- 172.21.15.40:0/3976377447 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffb28074620 con 0x7ffb2806ced0 2023-09-30T22:30:32.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.108+0000 7ffb0ffff700 1 -- 172.21.15.40:0/3976377447 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffb18003e60 con 0x7ffb2806ced0 2023-09-30T22:30:32.109 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:32.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.110+0000 7ffb2dd6a700 1 -- 172.21.15.40:0/3976377447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb2806ced0 msgr2=0x7ffb2808f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:32.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.110+0000 7ffb2dd6a700 1 --2- 172.21.15.40:0/3976377447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb2806ced0 0x7ffb2808f3e0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7ffb180090b0 tx=0x7ffb18004750 comp rx=0 tx=0).stop 2023-09-30T22:30:32.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.110+0000 7ffb2dd6a700 1 -- 172.21.15.40:0/3976377447 shutdown_connections 2023-09-30T22:30:32.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.110+0000 7ffb2dd6a700 1 --2- 172.21.15.40:0/3976377447 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffb2809fbb0 0x7ffb2808fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.110+0000 7ffb2dd6a700 1 --2- 172.21.15.40:0/3976377447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb2806ced0 0x7ffb2808f3e0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.110+0000 7ffb2dd6a700 1 --2- 172.21.15.40:0/3976377447 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffb2806d2c0 0x7ffb2808f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.110+0000 7ffb2dd6a700 1 -- 172.21.15.40:0/3976377447 >> 172.21.15.40:0/3976377447 conn(0x7ffb280a41a0 msgr2=0x7ffb280a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:32.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.110+0000 7ffb2dd6a700 1 -- 172.21.15.40:0/3976377447 shutdown_connections 2023-09-30T22:30:32.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.110+0000 7ffb2dd6a700 1 -- 172.21.15.40:0/3976377447 wait complete. 2023-09-30T22:30:32.123 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:32.133 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:32.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.290+0000 7f6c798cc700 1 Processor -- start 2023-09-30T22:30:32.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.290+0000 7f6c798cc700 1 -- start start 2023-09-30T22:30:32.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.290+0000 7f6c798cc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c7409df30 0x7f6c74135400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:32.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.290+0000 7f6c798cc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6c74135940 0x7f6c74137d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:32.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.290+0000 7f6c798cc700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c7409e8b0 con 0x7f6c7409d450 2023-09-30T22:30:32.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.290+0000 7f6c798cc700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c7409c3b0 con 0x7f6c74135940 2023-09-30T22:30:32.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.291+0000 7f6c798cc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7409a6b0 con 0x7f6c7409df30 2023-09-30T22:30:32.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.291+0000 7f6c6bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c7409df30 0x7f6c74135400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:32.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.291+0000 7f6c72ffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6c7409d450 0x7f6c7409d820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46170/0 (socket says 172.21.15.40:46170) 2023-09-30T22:30:32.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.291+0000 7f6c72ffd700 1 -- 172.21.15.40:0/458108382 learned_addr learned my addr 172.21.15.40:0/458108382 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:32.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.291+0000 7f6c737fe700 1 --2- 172.21.15.40:0/458108382 >> v2:172.21.15.40:3300/0 conn(0x7f6c74135940 0x7f6c74137d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:32.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.291+0000 7f6c737fe700 1 -- 172.21.15.40:0/458108382 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c7409df30 msgr2=0x7f6c74135400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:32.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.291+0000 7f6c737fe700 1 --2- 172.21.15.40:0/458108382 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c7409df30 0x7f6c74135400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.291+0000 7f6c737fe700 1 -- 172.21.15.40:0/458108382 >> v1:172.21.15.40:6789/0 conn(0x7f6c7409d450 legacy=0x7f6c7409d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:32.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.291+0000 7f6c737fe700 1 -- 172.21.15.40:0/458108382 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7409b4f0 con 0x7f6c74135940 2023-09-30T22:30:32.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.291+0000 7f6c6bfff700 1 --2- 172.21.15.40:0/458108382 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c7409df30 0x7f6c74135400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:32.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.291+0000 7f6c737fe700 1 --2- 172.21.15.40:0/458108382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c74135940 0x7f6c74137d20 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c009d90 tx=0x7f6c6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2401cb6a539cb2df server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:32.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.291+0000 7f6c727fc700 1 -- 172.21.15.40:0/458108382 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c00e070 con 0x7f6c74135940 2023-09-30T22:30:32.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.291+0000 7f6c727fc700 1 -- 172.21.15.40:0/458108382 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6c00bb20 con 0x7f6c74135940 2023-09-30T22:30:32.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.291+0000 7f6c727fc700 1 -- 172.21.15.40:0/458108382 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c012430 con 0x7f6c74135940 2023-09-30T22:30:32.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.292+0000 7f6c798cc700 1 -- 172.21.15.40:0/458108382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c74135940 msgr2=0x7f6c74137d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:32.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.292+0000 7f6c798cc700 1 --2- 172.21.15.40:0/458108382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c74135940 0x7f6c74137d20 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c009d90 tx=0x7f6c6c00b330 comp rx=0 tx=0).stop 2023-09-30T22:30:32.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.292+0000 7f6c798cc700 1 -- 172.21.15.40:0/458108382 shutdown_connections 2023-09-30T22:30:32.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.292+0000 7f6c798cc700 1 --2- 172.21.15.40:0/458108382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c74135940 0x7f6c74137d20 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.292+0000 7f6c798cc700 1 --2- 172.21.15.40:0/458108382 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c7409df30 0x7f6c74135400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.292+0000 7f6c798cc700 1 -- 172.21.15.40:0/458108382 >> 172.21.15.40:0/458108382 conn(0x7f6c740a2a00 msgr2=0x7f6c740a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:32.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.292+0000 7f6c798cc700 1 -- 172.21.15.40:0/458108382 shutdown_connections 2023-09-30T22:30:32.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.292+0000 7f6c798cc700 1 -- 172.21.15.40:0/458108382 wait complete. 2023-09-30T22:30:32.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.293+0000 7f6c798cc700 1 Processor -- start 2023-09-30T22:30:32.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.293+0000 7f6c798cc700 1 -- start start 2023-09-30T22:30:32.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.293+0000 7f6c798cc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c7409d450 0x7f6c741c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:32.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.293+0000 7f6c798cc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c7409df30 0x7f6c741c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:32.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.293+0000 7f6c798cc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c74135940 0x7f6c74119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:32.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.293+0000 7f6c798cc700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c741c4100 con 0x7f6c7409d450 2023-09-30T22:30:32.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.293+0000 7f6c798cc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c741c4f60 con 0x7f6c7409df30 2023-09-30T22:30:32.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.293+0000 7f6c798cc700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7409c5d0 con 0x7f6c74135940 2023-09-30T22:30:32.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.293+0000 7f6c72ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c7409d450 0x7f6c741c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:32.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.293+0000 7f6c6bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c7409df30 0x7f6c741c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:32.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.293+0000 7f6c72ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c7409d450 0x7f6c741c44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54022/0 (socket says 172.21.15.40:54022) 2023-09-30T22:30:32.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.293+0000 7f6c72ffd700 1 -- 172.21.15.40:0/2774802510 learned_addr learned my addr 172.21.15.40:0/2774802510 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:32.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.293+0000 7f6c737fe700 1 --2- 172.21.15.40:0/2774802510 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c74135940 0x7f6c74119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:32.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.294+0000 7f6c6bfff700 1 -- 172.21.15.40:0/2774802510 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c74135940 msgr2=0x7f6c74119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:32.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.294+0000 7f6c6bfff700 1 --2- 172.21.15.40:0/2774802510 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c74135940 0x7f6c74119050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.294+0000 7f6c6bfff700 1 -- 172.21.15.40:0/2774802510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c7409d450 msgr2=0x7f6c741c44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:32.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.294+0000 7f6c6bfff700 1 --2- 172.21.15.40:0/2774802510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c7409d450 0x7f6c741c44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.294+0000 7f6c6bfff700 1 -- 172.21.15.40:0/2774802510 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c5c00b740 con 0x7f6c7409df30 2023-09-30T22:30:32.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.294+0000 7f6c72ffd700 1 --2- 172.21.15.40:0/2774802510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c7409d450 0x7f6c741c44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:32.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.294+0000 7f6c6bfff700 1 --2- 172.21.15.40:0/2774802510 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c7409df30 0x7f6c741c4a20 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c010f10 tx=0x7f6c5c00e640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:32.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.294+0000 7f6c70ff9700 1 -- 172.21.15.40:0/2774802510 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c011450 con 0x7f6c7409df30 2023-09-30T22:30:32.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.294+0000 7f6c70ff9700 1 -- 172.21.15.40:0/2774802510 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5c0115b0 con 0x7f6c7409df30 2023-09-30T22:30:32.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.294+0000 7f6c798cc700 1 -- 172.21.15.40:0/2774802510 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c6c009a70 con 0x7f6c7409df30 2023-09-30T22:30:32.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.294+0000 7f6c70ff9700 1 -- 172.21.15.40:0/2774802510 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c011960 con 0x7f6c7409df30 2023-09-30T22:30:32.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.294+0000 7f6c798cc700 1 -- 172.21.15.40:0/2774802510 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c74071090 con 0x7f6c7409df30 2023-09-30T22:30:32.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.295+0000 7f6c70ff9700 1 -- 172.21.15.40:0/2774802510 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6c5c011ac0 con 0x7f6c7409df30 2023-09-30T22:30:32.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.295+0000 7f6c70ff9700 1 -- 172.21.15.40:0/2774802510 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6c5c042360 con 0x7f6c7409df30 2023-09-30T22:30:32.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.295+0000 7f6c798cc700 1 -- 172.21.15.40:0/2774802510 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c74062380 con 0x7f6c7409df30 2023-09-30T22:30:32.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.300+0000 7f6c70ff9700 1 -- 172.21.15.40:0/2774802510 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6c5c017bc0 con 0x7f6c7409df30 2023-09-30T22:30:32.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.495+0000 7f6c798cc700 1 -- 172.21.15.40:0/2774802510 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6c74074330 con 0x7f6c7409df30 2023-09-30T22:30:32.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.495+0000 7f6c70ff9700 1 -- 172.21.15.40:0/2774802510 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6c5c0177b0 con 0x7f6c7409df30 2023-09-30T22:30:32.496 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:32.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.497+0000 7f6c798cc700 1 -- 172.21.15.40:0/2774802510 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c7409df30 msgr2=0x7f6c741c4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:32.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.497+0000 7f6c798cc700 1 --2- 172.21.15.40:0/2774802510 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c7409df30 0x7f6c741c4a20 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c010f10 tx=0x7f6c5c00e640 comp rx=0 tx=0).stop 2023-09-30T22:30:32.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.497+0000 7f6c798cc700 1 -- 172.21.15.40:0/2774802510 shutdown_connections 2023-09-30T22:30:32.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.497+0000 7f6c798cc700 1 --2- 172.21.15.40:0/2774802510 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6c74135940 0x7f6c74119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.497+0000 7f6c798cc700 1 --2- 172.21.15.40:0/2774802510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c7409d450 0x7f6c741c44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.497+0000 7f6c798cc700 1 --2- 172.21.15.40:0/2774802510 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c7409df30 0x7f6c741c4a20 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:32.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.497+0000 7f6c798cc700 1 -- 172.21.15.40:0/2774802510 >> 172.21.15.40:0/2774802510 conn(0x7f6c740a2a00 msgr2=0x7f6c74130940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:32.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.497+0000 7f6c798cc700 1 -- 172.21.15.40:0/2774802510 shutdown_connections 2023-09-30T22:30:32.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:32.497+0000 7f6c798cc700 1 -- 172.21.15.40:0/2774802510 wait complete. 2023-09-30T22:30:32.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:33.001 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:33.089 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:33.124 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:33.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.144+0000 7f04837e4700 1 Processor -- start 2023-09-30T22:30:33.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.144+0000 7f04837e4700 1 -- start start 2023-09-30T22:30:33.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.144+0000 7f04837e4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f047c131d50 0x7f047c132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:33.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.144+0000 7f04837e4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f047c09bc50 0x7f047c09c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:33.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.145+0000 7f04837e4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f047c09c600 0x7f047c138ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:33.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.145+0000 7f04837e4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f047c071920 con 0x7f047c09bc50 2023-09-30T22:30:33.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.145+0000 7f04837e4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f047c132660 con 0x7f047c09c600 2023-09-30T22:30:33.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.145+0000 7f04837e4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f047c131900 con 0x7f047c131d50 2023-09-30T22:30:33.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.145+0000 7f0481580700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f047c131d50 0x7f047c132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:33.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.145+0000 7f0481d81700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f047c09c600 0x7f047c138ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:33.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.145+0000 7f0481580700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f047c131d50 0x7f047c132120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51770/0 (socket says 172.21.15.40:51770) 2023-09-30T22:30:33.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.145+0000 7f0481580700 1 -- 172.21.15.40:0/2256457767 learned_addr learned my addr 172.21.15.40:0/2256457767 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:33.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.145+0000 7f0480d7f700 1 --2- 172.21.15.40:0/2256457767 >> v2:172.21.15.40:3300/0 conn(0x7f047c09bc50 0x7f047c09c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:33.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.145+0000 7f0481580700 1 -- 172.21.15.40:0/2256457767 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f047c09c600 msgr2=0x7f047c138ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:33.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.145+0000 7f0481580700 1 --2- 172.21.15.40:0/2256457767 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f047c09c600 0x7f047c138ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.145+0000 7f0481580700 1 -- 172.21.15.40:0/2256457767 >> v2:172.21.15.40:3300/0 conn(0x7f047c09bc50 msgr2=0x7f047c09c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:33.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.145+0000 7f0481580700 1 --2- 172.21.15.40:0/2256457767 >> v2:172.21.15.40:3300/0 conn(0x7f047c09bc50 0x7f047c09c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.145+0000 7f0481580700 1 -- 172.21.15.40:0/2256457767 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f047c09e820 con 0x7f047c131d50 2023-09-30T22:30:33.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.145+0000 7f0481d81700 1 --2- 172.21.15.40:0/2256457767 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f047c09c600 0x7f047c138ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:33.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.145+0000 7f0481580700 1 --2- 172.21.15.40:0/2256457767 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f047c131d50 0x7f047c132120 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f04780098f0 tx=0x7f0478009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e40e43bf38ce0e46 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:33.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.146+0000 7f0473fff700 1 -- 172.21.15.40:0/2256457767 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0478011830 con 0x7f047c131d50 2023-09-30T22:30:33.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.146+0000 7f0473fff700 1 -- 172.21.15.40:0/2256457767 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0478011990 con 0x7f047c131d50 2023-09-30T22:30:33.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.146+0000 7f0473fff700 1 -- 172.21.15.40:0/2256457767 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0478011d20 con 0x7f047c131d50 2023-09-30T22:30:33.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.146+0000 7f04837e4700 1 -- 172.21.15.40:0/2256457767 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f047c131d50 msgr2=0x7f047c132120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:33.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.146+0000 7f04837e4700 1 --2- 172.21.15.40:0/2256457767 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f047c131d50 0x7f047c132120 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f04780098f0 tx=0x7f0478009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:33.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.146+0000 7f04837e4700 1 -- 172.21.15.40:0/2256457767 shutdown_connections 2023-09-30T22:30:33.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.146+0000 7f04837e4700 1 --2- 172.21.15.40:0/2256457767 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f047c131d50 0x7f047c132120 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.146+0000 7f04837e4700 1 --2- 172.21.15.40:0/2256457767 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f047c09c600 0x7f047c138ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.146+0000 7f04837e4700 1 --2- 172.21.15.40:0/2256457767 >> v2:172.21.15.40:3300/0 conn(0x7f047c09bc50 0x7f047c09c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.146+0000 7f04837e4700 1 -- 172.21.15.40:0/2256457767 >> 172.21.15.40:0/2256457767 conn(0x7f047c0a2a00 msgr2=0x7f047c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:33.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.146+0000 7f04837e4700 1 -- 172.21.15.40:0/2256457767 shutdown_connections 2023-09-30T22:30:33.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.146+0000 7f04837e4700 1 -- 172.21.15.40:0/2256457767 wait complete. 2023-09-30T22:30:33.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.147+0000 7f04837e4700 1 Processor -- start 2023-09-30T22:30:33.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.147+0000 7f04837e4700 1 -- start start 2023-09-30T22:30:33.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.148+0000 7f04837e4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f047c09bc50 0x7f047c099a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:33.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.148+0000 7f04837e4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f047c09c600 0x7f047c099f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:33.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.148+0000 7f04837e4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f047c131d50 0x7f047c09a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:33.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.148+0000 7f04837e4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f047c11e780 con 0x7f047c09c600 2023-09-30T22:30:33.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.148+0000 7f04837e4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f047c09b260 con 0x7f047c131d50 2023-09-30T22:30:33.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.148+0000 7f04837e4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f047c1299c0 con 0x7f047c09bc50 2023-09-30T22:30:33.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.148+0000 7f0480d7f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f047c09c600 0x7f047c099f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:33.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.148+0000 7f0480d7f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f047c09c600 0x7f047c099f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54054/0 (socket says 172.21.15.40:54054) 2023-09-30T22:30:33.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.148+0000 7f0480d7f700 1 -- 172.21.15.40:0/1593135820 learned_addr learned my addr 172.21.15.40:0/1593135820 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:33.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.148+0000 7f0481580700 1 --2- 172.21.15.40:0/1593135820 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f047c09bc50 0x7f047c099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:33.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.148+0000 7f0481d81700 1 --2- 172.21.15.40:0/1593135820 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f047c131d50 0x7f047c09a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:33.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.149+0000 7f0481d81700 1 -- 172.21.15.40:0/1593135820 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f047c09bc50 msgr2=0x7f047c099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:33.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.149+0000 7f0481d81700 1 --2- 172.21.15.40:0/1593135820 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f047c09bc50 0x7f047c099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.149+0000 7f0481d81700 1 -- 172.21.15.40:0/1593135820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f047c09c600 msgr2=0x7f047c099f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:33.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.149+0000 7f0481d81700 1 --2- 172.21.15.40:0/1593135820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f047c09c600 0x7f047c099f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.149+0000 7f0481d81700 1 -- 172.21.15.40:0/1593135820 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0474009a70 con 0x7f047c131d50 2023-09-30T22:30:33.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.149+0000 7f0480d7f700 1 --2- 172.21.15.40:0/1593135820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f047c09c600 0x7f047c099f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:33.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.149+0000 7f0481d81700 1 --2- 172.21.15.40:0/1593135820 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f047c131d50 0x7f047c09a4c0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f0474009db0 tx=0x7f047400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:33.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.149+0000 7f0471ffb700 1 -- 172.21.15.40:0/1593135820 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0474009c20 con 0x7f047c131d50 2023-09-30T22:30:33.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.149+0000 7f0471ffb700 1 -- 172.21.15.40:0/1593135820 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f047400f040 con 0x7f047c131d50 2023-09-30T22:30:33.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.149+0000 7f0471ffb700 1 -- 172.21.15.40:0/1593135820 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047400ccb0 con 0x7f047c131d50 2023-09-30T22:30:33.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.149+0000 7f04837e4700 1 -- 172.21.15.40:0/1593135820 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0478009550 con 0x7f047c131d50 2023-09-30T22:30:33.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.150+0000 7f04837e4700 1 -- 172.21.15.40:0/1593135820 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f047c09ea60 con 0x7f047c131d50 2023-09-30T22:30:33.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.150+0000 7f0471ffb700 1 -- 172.21.15.40:0/1593135820 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0474014480 con 0x7f047c131d50 2023-09-30T22:30:33.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.150+0000 7f0471ffb700 1 -- 172.21.15.40:0/1593135820 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f047403fbd0 con 0x7f047c131d50 2023-09-30T22:30:33.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.151+0000 7f04837e4700 1 -- 172.21.15.40:0/1593135820 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f047c062380 con 0x7f047c131d50 2023-09-30T22:30:33.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.156+0000 7f0471ffb700 1 -- 172.21.15.40:0/1593135820 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0474012750 con 0x7f047c131d50 2023-09-30T22:30:33.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.242+0000 7f1ba54d3700 1 Processor -- start 2023-09-30T22:30:33.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.242+0000 7f1ba54d3700 1 -- start start 2023-09-30T22:30:33.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.243+0000 7f1ba54d3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ba009d450 0x7f1ba009d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:33.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.243+0000 7f1ba54d3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ba01308d0 0x7f1ba0138420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:33.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.243+0000 7f1ba54d3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ba009e8b0 con 0x7f1ba009dd60 2023-09-30T22:30:33.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.243+0000 7f1ba54d3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba009c3b0 con 0x7f1ba01308d0 2023-09-30T22:30:33.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.243+0000 7f1ba54d3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba009a6b0 con 0x7f1ba009d450 2023-09-30T22:30:33.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.243+0000 7f1b9e7fc700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1ba009dd60 0x7f1ba01301c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33532/0 (socket says 172.21.15.40:33532) 2023-09-30T22:30:33.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.243+0000 7f1b9effd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ba009d450 0x7f1ba009d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:33.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.243+0000 7f1b9e7fc700 1 -- 172.21.15.40:0/4035203140 learned_addr learned my addr 172.21.15.40:0/4035203140 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:33.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.243+0000 7f1b9f7fe700 1 --2- 172.21.15.40:0/4035203140 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ba01308d0 0x7f1ba0138420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:33.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.244+0000 7f1b9effd700 1 -- 172.21.15.40:0/4035203140 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ba01308d0 msgr2=0x7f1ba0138420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:33.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.244+0000 7f1b9dffb700 1 -- 172.21.15.40:0/4035203140 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4158246986 0 0) 0x7f1ba009e8b0 con 0x7f1ba009dd60 2023-09-30T22:30:33.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.244+0000 7f1b9effd700 1 --2- 172.21.15.40:0/4035203140 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ba01308d0 0x7f1ba0138420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.244+0000 7f1b9effd700 1 -- 172.21.15.40:0/4035203140 >> v1:172.21.15.40:6789/0 conn(0x7f1ba009dd60 legacy=0x7f1ba01301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:33.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.244+0000 7f1b9effd700 1 -- 172.21.15.40:0/4035203140 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba009b4f0 con 0x7f1ba009d450 2023-09-30T22:30:33.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.244+0000 7f1b9f7fe700 1 --2- 172.21.15.40:0/4035203140 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ba01308d0 0x7f1ba0138420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:33.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.244+0000 7f1b9effd700 1 --2- 172.21.15.40:0/4035203140 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ba009d450 0x7f1ba009d820 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f1b90009870 tx=0x7f1b90009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25f05be97683b836 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:33.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.244+0000 7f1b9dffb700 1 -- 172.21.15.40:0/4035203140 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b90011830 con 0x7f1ba009d450 2023-09-30T22:30:33.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.244+0000 7f1b9dffb700 1 -- 172.21.15.40:0/4035203140 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b90011990 con 0x7f1ba009d450 2023-09-30T22:30:33.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.244+0000 7f1b9dffb700 1 -- 172.21.15.40:0/4035203140 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b90011d20 con 0x7f1ba009d450 2023-09-30T22:30:33.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.245+0000 7f1ba54d3700 1 -- 172.21.15.40:0/4035203140 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ba009d450 msgr2=0x7f1ba009d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:33.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.245+0000 7f1ba54d3700 1 --2- 172.21.15.40:0/4035203140 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ba009d450 0x7f1ba009d820 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f1b90009870 tx=0x7f1b90009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:33.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.245+0000 7f1ba54d3700 1 -- 172.21.15.40:0/4035203140 shutdown_connections 2023-09-30T22:30:33.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.245+0000 7f1ba54d3700 1 --2- 172.21.15.40:0/4035203140 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ba01308d0 0x7f1ba0138420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.245+0000 7f1ba54d3700 1 --2- 172.21.15.40:0/4035203140 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ba009d450 0x7f1ba009d820 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.245+0000 7f1ba54d3700 1 -- 172.21.15.40:0/4035203140 >> 172.21.15.40:0/4035203140 conn(0x7f1ba00a2a00 msgr2=0x7f1ba00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:33.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.245+0000 7f1ba54d3700 1 -- 172.21.15.40:0/4035203140 shutdown_connections 2023-09-30T22:30:33.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.245+0000 7f1ba54d3700 1 -- 172.21.15.40:0/4035203140 wait complete. 2023-09-30T22:30:33.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.246+0000 7f1ba54d3700 1 Processor -- start 2023-09-30T22:30:33.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.246+0000 7f1ba54d3700 1 -- start start 2023-09-30T22:30:33.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.246+0000 7f1ba54d3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ba009d450 0x7f1ba01c5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:33.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.246+0000 7f1ba54d3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ba009dd60 0x7f1ba01c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:33.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.247+0000 7f1ba54d3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ba01308d0 0x7f1ba01c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:33.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.247+0000 7f1ba54d3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba012e410 con 0x7f1ba009d450 2023-09-30T22:30:33.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.247+0000 7f1ba54d3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba01bb770 con 0x7f1ba01308d0 2023-09-30T22:30:33.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.247+0000 7f1ba54d3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba011d8b0 con 0x7f1ba009dd60 2023-09-30T22:30:33.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.247+0000 7f1b9effd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ba009d450 0x7f1ba01c5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:33.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.247+0000 7f1b9e7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ba009dd60 0x7f1ba01c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:33.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.247+0000 7f1b9f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ba01308d0 0x7f1ba01c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:33.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.247+0000 7f1b9effd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ba009d450 0x7f1ba01c5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47748/0 (socket says 172.21.15.40:47748) 2023-09-30T22:30:33.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.247+0000 7f1b9effd700 1 -- 172.21.15.40:0/3077070310 learned_addr learned my addr 172.21.15.40:0/3077070310 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:33.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.247+0000 7f1b9e7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ba009dd60 0x7f1ba01c58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:50680/0 (socket says 172.21.15.40:50680) 2023-09-30T22:30:33.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.247+0000 7f1b9effd700 1 -- 172.21.15.40:0/3077070310 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ba009dd60 msgr2=0x7f1ba01c58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:33.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.247+0000 7f1b9effd700 1 --2- 172.21.15.40:0/3077070310 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ba009dd60 0x7f1ba01c58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.247+0000 7f1b9effd700 1 -- 172.21.15.40:0/3077070310 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ba01308d0 msgr2=0x7f1ba01c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:33.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.247+0000 7f1b9effd700 1 --2- 172.21.15.40:0/3077070310 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ba01308d0 0x7f1ba01c82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.247+0000 7f1b9effd700 1 -- 172.21.15.40:0/3077070310 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b98009a70 con 0x7f1ba009d450 2023-09-30T22:30:33.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.247+0000 7f1b9f7fe700 1 --2- 172.21.15.40:0/3077070310 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ba01308d0 0x7f1ba01c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:33.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.247+0000 7f1b9effd700 1 --2- 172.21.15.40:0/3077070310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ba009d450 0x7f1ba01c5380 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f1b900090b0 tx=0x7f1b90004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:33.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.247+0000 7f1b877fe700 1 -- 172.21.15.40:0/3077070310 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b90004510 con 0x7f1ba009d450 2023-09-30T22:30:33.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.247+0000 7f1b877fe700 1 -- 172.21.15.40:0/3077070310 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b9001f070 con 0x7f1ba009d450 2023-09-30T22:30:33.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.247+0000 7f1b877fe700 1 -- 172.21.15.40:0/3077070310 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b900038e0 con 0x7f1ba009d450 2023-09-30T22:30:33.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.248+0000 7f1ba54d3700 1 -- 172.21.15.40:0/3077070310 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b900094a0 con 0x7f1ba009d450 2023-09-30T22:30:33.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.248+0000 7f1ba54d3700 1 -- 172.21.15.40:0/3077070310 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ba011e2d0 con 0x7f1ba009d450 2023-09-30T22:30:33.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.249+0000 7f1b877fe700 1 -- 172.21.15.40:0/3077070310 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1b90003a40 con 0x7f1ba009d450 2023-09-30T22:30:33.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.249+0000 7f1b877fe700 1 -- 172.21.15.40:0/3077070310 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f1b90021070 con 0x7f1ba009d450 2023-09-30T22:30:33.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.249+0000 7f1ba54d3700 1 -- 172.21.15.40:0/3077070310 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ba011e130 con 0x7f1ba009d450 2023-09-30T22:30:33.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.258+0000 7f1b877fe700 1 -- 172.21.15.40:0/3077070310 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1ba011e130 con 0x7f1ba009d450 2023-09-30T22:30:33.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.265+0000 7f1489bac700 1 Processor -- start 2023-09-30T22:30:33.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.265+0000 7f1489bac700 1 -- start start 2023-09-30T22:30:33.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.266+0000 7f1489bac700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f148409d920 0x7f148409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:33.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.266+0000 7f1489bac700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f148409f0f0 0x7f148409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:33.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.266+0000 7f1489bac700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f148409f940 con 0x7f1484133ca0 2023-09-30T22:30:33.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.266+0000 7f1489bac700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f148406b4c0 con 0x7f148409f0f0 2023-09-30T22:30:33.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.266+0000 7f1489bac700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f148409a8f0 con 0x7f148409d920 2023-09-30T22:30:33.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.266+0000 7f1482ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f148409f0f0 0x7f148409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:33.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.266+0000 7f14837fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f148409d920 0x7f148409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:33.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.266+0000 7f1482ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f148409f0f0 0x7f148409e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47764/0 (socket says 172.21.15.40:47764) 2023-09-30T22:30:33.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.266+0000 7f1482ffd700 1 -- 172.21.15.40:0/1475455812 learned_addr learned my addr 172.21.15.40:0/1475455812 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:33.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.266+0000 7f1482ffd700 1 -- 172.21.15.40:0/1475455812 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f148409d920 msgr2=0x7f148409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:33.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.266+0000 7f1482ffd700 1 --2- 172.21.15.40:0/1475455812 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f148409d920 0x7f148409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.266+0000 7f1482ffd700 1 -- 172.21.15.40:0/1475455812 >> v1:172.21.15.40:6789/0 conn(0x7f1484133ca0 legacy=0x7f1484134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:33.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.266+0000 7f14827fc700 1 -- 172.21.15.40:0/1475455812 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3845493789 0 0) 0x7f148409f940 con 0x7f1484133ca0 2023-09-30T22:30:33.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.266+0000 7f1482ffd700 1 -- 172.21.15.40:0/1475455812 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148409f6e0 con 0x7f148409f0f0 2023-09-30T22:30:33.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.266+0000 7f14837fe700 1 --2- 172.21.15.40:0/1475455812 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f148409d920 0x7f148409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:33.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.266+0000 7f1482ffd700 1 --2- 172.21.15.40:0/1475455812 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f148409f0f0 0x7f148409e230 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f1478009920 tx=0x7f1478009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1b323ed092e7391 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:33.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.267+0000 7f14827fc700 1 -- 172.21.15.40:0/1475455812 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1478011830 con 0x7f148409f0f0 2023-09-30T22:30:33.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.267+0000 7f14827fc700 1 -- 172.21.15.40:0/1475455812 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1478011990 con 0x7f148409f0f0 2023-09-30T22:30:33.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.267+0000 7f14827fc700 1 -- 172.21.15.40:0/1475455812 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1478011d20 con 0x7f148409f0f0 2023-09-30T22:30:33.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.267+0000 7f1489bac700 1 -- 172.21.15.40:0/1475455812 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f148409f0f0 msgr2=0x7f148409e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:33.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.267+0000 7f1489bac700 1 --2- 172.21.15.40:0/1475455812 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f148409f0f0 0x7f148409e230 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f1478009920 tx=0x7f1478009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:33.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.267+0000 7f1489bac700 1 -- 172.21.15.40:0/1475455812 shutdown_connections 2023-09-30T22:30:33.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.267+0000 7f1489bac700 1 --2- 172.21.15.40:0/1475455812 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f148409d920 0x7f148409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.267+0000 7f1489bac700 1 --2- 172.21.15.40:0/1475455812 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f148409f0f0 0x7f148409e230 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.267+0000 7f1489bac700 1 -- 172.21.15.40:0/1475455812 >> 172.21.15.40:0/1475455812 conn(0x7f148409fb20 msgr2=0x7f148409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:33.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.267+0000 7f1489bac700 1 -- 172.21.15.40:0/1475455812 shutdown_connections 2023-09-30T22:30:33.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.267+0000 7f1489bac700 1 -- 172.21.15.40:0/1475455812 wait complete. 2023-09-30T22:30:33.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.268+0000 7f1489bac700 1 Processor -- start 2023-09-30T22:30:33.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.268+0000 7f1489bac700 1 -- start start 2023-09-30T22:30:33.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.269+0000 7f1489bac700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f148409d920 0x7f1484120670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:33.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.269+0000 7f1489bac700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1484133ca0 0x7f1484120bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:33.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.269+0000 7f1489bac700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f14841244f0 0x7f14841210f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:33.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.269+0000 7f1489bac700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1484124170 con 0x7f14841244f0 2023-09-30T22:30:33.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.269+0000 7f1489bac700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1484123da0 con 0x7f1484133ca0 2023-09-30T22:30:33.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.269+0000 7f1489bac700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14840a2630 con 0x7f148409d920 2023-09-30T22:30:33.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.269+0000 7f14837fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f148409d920 0x7f1484120670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:33.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.269+0000 7f14837fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f148409d920 0x7f1484120670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:50688/0 (socket says 172.21.15.40:50688) 2023-09-30T22:30:33.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.269+0000 7f14837fe700 1 -- 172.21.15.40:0/2980546639 learned_addr learned my addr 172.21.15.40:0/2980546639 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:33.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.269+0000 7f1482ffd700 1 --2- 172.21.15.40:0/2980546639 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1484133ca0 0x7f1484120bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:33.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.269+0000 7f1483fff700 1 --2- 172.21.15.40:0/2980546639 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f14841244f0 0x7f14841210f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:33.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.269+0000 7f1482ffd700 1 -- 172.21.15.40:0/2980546639 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f148409d920 msgr2=0x7f1484120670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:33.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.269+0000 7f1482ffd700 1 --2- 172.21.15.40:0/2980546639 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f148409d920 0x7f1484120670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.269+0000 7f1482ffd700 1 -- 172.21.15.40:0/2980546639 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f14841244f0 msgr2=0x7f14841210f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:33.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.269+0000 7f1482ffd700 1 --2- 172.21.15.40:0/2980546639 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f14841244f0 0x7f14841210f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.269+0000 7f1482ffd700 1 -- 172.21.15.40:0/2980546639 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1474009430 con 0x7f1484133ca0 2023-09-30T22:30:33.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.269+0000 7f14837fe700 1 --2- 172.21.15.40:0/2980546639 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f148409d920 0x7f1484120670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:33.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.270+0000 7f1482ffd700 1 --2- 172.21.15.40:0/2980546639 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1484133ca0 0x7f1484120bb0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f1478016000 tx=0x7f1478004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:33.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.270+0000 7f146bfff700 1 -- 172.21.15.40:0/2980546639 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1478004510 con 0x7f1484133ca0 2023-09-30T22:30:33.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.270+0000 7f146bfff700 1 -- 172.21.15.40:0/2980546639 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147801f070 con 0x7f1484133ca0 2023-09-30T22:30:33.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.270+0000 7f1489bac700 1 -- 172.21.15.40:0/2980546639 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1478009550 con 0x7f1484133ca0 2023-09-30T22:30:33.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.270+0000 7f146bfff700 1 -- 172.21.15.40:0/2980546639 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14780038e0 con 0x7f1484133ca0 2023-09-30T22:30:33.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.270+0000 7f1489bac700 1 -- 172.21.15.40:0/2980546639 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f148409c9e0 con 0x7f1484133ca0 2023-09-30T22:30:33.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.271+0000 7f146bfff700 1 -- 172.21.15.40:0/2980546639 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1478003a40 con 0x7f1484133ca0 2023-09-30T22:30:33.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.271+0000 7f1489bac700 1 -- 172.21.15.40:0/2980546639 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1484123be0 con 0x7f1484133ca0 2023-09-30T22:30:33.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.271+0000 7f146bfff700 1 -- 172.21.15.40:0/2980546639 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f1478021070 con 0x7f1484133ca0 2023-09-30T22:30:33.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.276+0000 7f146bfff700 1 -- 172.21.15.40:0/2980546639 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1484123be0 con 0x7f1484133ca0 2023-09-30T22:30:33.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.384+0000 7f04837e4700 1 -- 172.21.15.40:0/1593135820 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f047c11dff0 con 0x7f047c131d50 2023-09-30T22:30:33.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.384+0000 7f0471ffb700 1 -- 172.21.15.40:0/1593135820 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f047401b360 con 0x7f047c131d50 2023-09-30T22:30:33.385 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:33.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.386+0000 7f04837e4700 1 -- 172.21.15.40:0/1593135820 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f047c131d50 msgr2=0x7f047c09a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:33.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.386+0000 7f04837e4700 1 --2- 172.21.15.40:0/1593135820 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f047c131d50 0x7f047c09a4c0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f0474009db0 tx=0x7f047400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.387+0000 7f04837e4700 1 -- 172.21.15.40:0/1593135820 shutdown_connections 2023-09-30T22:30:33.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.387+0000 7f04837e4700 1 --2- 172.21.15.40:0/1593135820 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f047c09bc50 0x7f047c099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.387+0000 7f04837e4700 1 --2- 172.21.15.40:0/1593135820 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f047c131d50 0x7f047c09a4c0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.387+0000 7f04837e4700 1 --2- 172.21.15.40:0/1593135820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f047c09c600 0x7f047c099f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.387+0000 7f04837e4700 1 -- 172.21.15.40:0/1593135820 >> 172.21.15.40:0/1593135820 conn(0x7f047c0a2a00 msgr2=0x7f047c0a0900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:33.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.387+0000 7f04837e4700 1 -- 172.21.15.40:0/1593135820 shutdown_connections 2023-09-30T22:30:33.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.387+0000 7f04837e4700 1 -- 172.21.15.40:0/1593135820 wait complete. 2023-09-30T22:30:33.404 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:33.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.463+0000 7f1ba54d3700 1 -- 172.21.15.40:0/3077070310 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1ba011e130 con 0x7f1ba009d450 2023-09-30T22:30:33.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.464+0000 7f1b877fe700 1 -- 172.21.15.40:0/3077070310 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1ba011e130 con 0x7f1ba009d450 2023-09-30T22:30:33.465 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:33.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.466+0000 7f1ba54d3700 1 -- 172.21.15.40:0/3077070310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ba009d450 msgr2=0x7f1ba01c5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:33.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.466+0000 7f1ba54d3700 1 --2- 172.21.15.40:0/3077070310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ba009d450 0x7f1ba01c5380 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f1b900090b0 tx=0x7f1b90004750 comp rx=0 tx=0).stop 2023-09-30T22:30:33.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.466+0000 7f1ba54d3700 1 -- 172.21.15.40:0/3077070310 shutdown_connections 2023-09-30T22:30:33.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.466+0000 7f1ba54d3700 1 --2- 172.21.15.40:0/3077070310 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ba01308d0 0x7f1ba01c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.466+0000 7f1ba54d3700 1 --2- 172.21.15.40:0/3077070310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ba009d450 0x7f1ba01c5380 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.466+0000 7f1ba54d3700 1 --2- 172.21.15.40:0/3077070310 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ba009dd60 0x7f1ba01c58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.466+0000 7f1ba54d3700 1 -- 172.21.15.40:0/3077070310 >> 172.21.15.40:0/3077070310 conn(0x7f1ba00a2a00 msgr2=0x7f1ba012fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:33.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.466+0000 7f1ba54d3700 1 -- 172.21.15.40:0/3077070310 shutdown_connections 2023-09-30T22:30:33.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.466+0000 7f1ba54d3700 1 -- 172.21.15.40:0/3077070310 wait complete. 2023-09-30T22:30:33.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.473+0000 7f1489bac700 1 -- 172.21.15.40:0/2980546639 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1484123be0 con 0x7f1484133ca0 2023-09-30T22:30:33.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.473+0000 7f146bfff700 1 -- 172.21.15.40:0/2980546639 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1484123be0 con 0x7f1484133ca0 2023-09-30T22:30:33.474 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:33.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.475+0000 7f1489bac700 1 -- 172.21.15.40:0/2980546639 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1484133ca0 msgr2=0x7f1484120bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:33.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.475+0000 7f1489bac700 1 --2- 172.21.15.40:0/2980546639 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1484133ca0 0x7f1484120bb0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f1478016000 tx=0x7f1478004750 comp rx=0 tx=0).stop 2023-09-30T22:30:33.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.475+0000 7f1489bac700 1 -- 172.21.15.40:0/2980546639 shutdown_connections 2023-09-30T22:30:33.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.475+0000 7f1489bac700 1 --2- 172.21.15.40:0/2980546639 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f148409d920 0x7f1484120670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.475+0000 7f1489bac700 1 --2- 172.21.15.40:0/2980546639 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f14841244f0 0x7f14841210f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.475+0000 7f1489bac700 1 --2- 172.21.15.40:0/2980546639 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1484133ca0 0x7f1484120bb0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.475+0000 7f1489bac700 1 -- 172.21.15.40:0/2980546639 >> 172.21.15.40:0/2980546639 conn(0x7f148409fb20 msgr2=0x7f14841b9850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:33.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.475+0000 7f1489bac700 1 -- 172.21.15.40:0/2980546639 shutdown_connections 2023-09-30T22:30:33.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.475+0000 7f1489bac700 1 -- 172.21.15.40:0/2980546639 wait complete. 2023-09-30T22:30:33.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:33.488 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:33.511 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:33.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.655+0000 7fd37a227700 1 Processor -- start 2023-09-30T22:30:33.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.655+0000 7fd37a227700 1 -- start start 2023-09-30T22:30:33.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.655+0000 7fd37a227700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd37409c890 0x7fd37409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:33.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.655+0000 7fd37a227700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd37409e480 0x7fd37413bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:33.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.655+0000 7fd37a227700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3740a2600 con 0x7fd37409d920 2023-09-30T22:30:33.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.655+0000 7fd37a227700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3740a29d0 con 0x7fd37409e480 2023-09-30T22:30:33.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.655+0000 7fd37a227700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd37409fb40 con 0x7fd37409c890 2023-09-30T22:30:33.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.655+0000 7fd3737fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd37409c890 0x7fd37409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:33.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.655+0000 7fd372ffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd37409d920 0x7fd37409dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33550/0 (socket says 172.21.15.40:33550) 2023-09-30T22:30:33.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.655+0000 7fd372ffd700 1 -- 172.21.15.40:0/2517094721 learned_addr learned my addr 172.21.15.40:0/2517094721 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:33.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.655+0000 7fd373fff700 1 --2- 172.21.15.40:0/2517094721 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd37409e480 0x7fd37413bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:33.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.656+0000 7fd3737fe700 1 -- 172.21.15.40:0/2517094721 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd37409e480 msgr2=0x7fd37413bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:33.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.656+0000 7fd3727fc700 1 -- 172.21.15.40:0/2517094721 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1578016675 0 0) 0x7fd3740a2600 con 0x7fd37409d920 2023-09-30T22:30:33.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.656+0000 7fd3737fe700 1 --2- 172.21.15.40:0/2517094721 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd37409e480 0x7fd37413bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.656+0000 7fd3737fe700 1 -- 172.21.15.40:0/2517094721 >> v1:172.21.15.40:6789/0 conn(0x7fd37409d920 legacy=0x7fd37409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:33.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.656+0000 7fd3737fe700 1 -- 172.21.15.40:0/2517094721 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37409fed0 con 0x7fd37409c890 2023-09-30T22:30:33.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.656+0000 7fd373fff700 1 --2- 172.21.15.40:0/2517094721 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd37409e480 0x7fd37413bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:33.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.656+0000 7fd3737fe700 1 --2- 172.21.15.40:0/2517094721 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd37409c890 0x7fd37409cc60 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fd364009850 tx=0x7fd364009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1edbcc476549689 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:33.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.656+0000 7fd3727fc700 1 -- 172.21.15.40:0/2517094721 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd364005e30 con 0x7fd37409c890 2023-09-30T22:30:33.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.656+0000 7fd3727fc700 1 -- 172.21.15.40:0/2517094721 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd364006030 con 0x7fd37409c890 2023-09-30T22:30:33.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.656+0000 7fd3727fc700 1 -- 172.21.15.40:0/2517094721 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3640063e0 con 0x7fd37409c890 2023-09-30T22:30:33.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.657+0000 7fd37a227700 1 -- 172.21.15.40:0/2517094721 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd37409c890 msgr2=0x7fd37409cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:33.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.657+0000 7fd37a227700 1 --2- 172.21.15.40:0/2517094721 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd37409c890 0x7fd37409cc60 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fd364009850 tx=0x7fd364009b60 comp rx=0 tx=0).stop 2023-09-30T22:30:33.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.657+0000 7fd37a227700 1 -- 172.21.15.40:0/2517094721 shutdown_connections 2023-09-30T22:30:33.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.657+0000 7fd37a227700 1 --2- 172.21.15.40:0/2517094721 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd37409e480 0x7fd37413bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.657+0000 7fd37a227700 1 --2- 172.21.15.40:0/2517094721 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd37409c890 0x7fd37409cc60 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.657+0000 7fd37a227700 1 -- 172.21.15.40:0/2517094721 >> 172.21.15.40:0/2517094721 conn(0x7fd3740a7080 msgr2=0x7fd3740a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:33.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.657+0000 7fd37a227700 1 -- 172.21.15.40:0/2517094721 shutdown_connections 2023-09-30T22:30:33.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.657+0000 7fd37a227700 1 -- 172.21.15.40:0/2517094721 wait complete. 2023-09-30T22:30:33.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.657+0000 7fd37a227700 1 Processor -- start 2023-09-30T22:30:33.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.658+0000 7fd37a227700 1 -- start start 2023-09-30T22:30:33.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.658+0000 7fd37a227700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd37409c890 0x7fd37412d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:33.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.658+0000 7fd37a227700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd37409d920 0x7fd37412d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:33.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.658+0000 7fd37a227700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd37409e480 0x7fd37412df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:33.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.658+0000 7fd37a227700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37409c050 con 0x7fd37409d920 2023-09-30T22:30:33.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.658+0000 7fd37a227700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37408f4f0 con 0x7fd37409e480 2023-09-30T22:30:33.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.658+0000 7fd37a227700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3741309c0 con 0x7fd37409c890 2023-09-30T22:30:33.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.658+0000 7fd372ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd37409d920 0x7fd37412d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:33.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.658+0000 7fd373fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd37409e480 0x7fd37412df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:33.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.658+0000 7fd372ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd37409d920 0x7fd37412d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47772/0 (socket says 172.21.15.40:47772) 2023-09-30T22:30:33.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.658+0000 7fd372ffd700 1 -- 172.21.15.40:0/2840138268 learned_addr learned my addr 172.21.15.40:0/2840138268 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:33.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.658+0000 7fd3737fe700 1 --2- 172.21.15.40:0/2840138268 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd37409c890 0x7fd37412d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:33.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.659+0000 7fd3737fe700 1 -- 172.21.15.40:0/2840138268 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd37409e480 msgr2=0x7fd37412df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:33.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.659+0000 7fd3737fe700 1 --2- 172.21.15.40:0/2840138268 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd37409e480 0x7fd37412df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.659+0000 7fd3737fe700 1 -- 172.21.15.40:0/2840138268 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd37409d920 msgr2=0x7fd37412d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:33.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.659+0000 7fd3737fe700 1 --2- 172.21.15.40:0/2840138268 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd37409d920 0x7fd37412d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.659+0000 7fd3737fe700 1 -- 172.21.15.40:0/2840138268 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36c009a70 con 0x7fd37409c890 2023-09-30T22:30:33.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.659+0000 7fd372ffd700 1 --2- 172.21.15.40:0/2840138268 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd37409d920 0x7fd37412d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:33.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.659+0000 7fd373fff700 1 --2- 172.21.15.40:0/2840138268 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd37409e480 0x7fd37412df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:33.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.659+0000 7fd3737fe700 1 --2- 172.21.15.40:0/2840138268 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd37409c890 0x7fd37412d4b0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fd364015000 tx=0x7fd364004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:33.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.659+0000 7fd35bfff700 1 -- 172.21.15.40:0/2840138268 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd364025670 con 0x7fd37409c890 2023-09-30T22:30:33.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.659+0000 7fd35bfff700 1 -- 172.21.15.40:0/2840138268 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3640257d0 con 0x7fd37409c890 2023-09-30T22:30:33.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.659+0000 7fd37a227700 1 -- 172.21.15.40:0/2840138268 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd364009430 con 0x7fd37409c890 2023-09-30T22:30:33.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.659+0000 7fd35bfff700 1 -- 172.21.15.40:0/2840138268 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd364025b60 con 0x7fd37409c890 2023-09-30T22:30:33.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.659+0000 7fd37a227700 1 -- 172.21.15.40:0/2840138268 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd374130ca0 con 0x7fd37409c890 2023-09-30T22:30:33.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.660+0000 7fd35bfff700 1 -- 172.21.15.40:0/2840138268 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd364022070 con 0x7fd37409c890 2023-09-30T22:30:33.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.660+0000 7fd35bfff700 1 -- 172.21.15.40:0/2840138268 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd364040bc0 con 0x7fd37409c890 2023-09-30T22:30:33.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.660+0000 7fd37a227700 1 -- 172.21.15.40:0/2840138268 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd374130b00 con 0x7fd37409c890 2023-09-30T22:30:33.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.665+0000 7fd35bfff700 1 -- 172.21.15.40:0/2840138268 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd374130b00 con 0x7fd37409c890 2023-09-30T22:30:33.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.861+0000 7fd37a227700 1 -- 172.21.15.40:0/2840138268 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd374130b00 con 0x7fd37409c890 2023-09-30T22:30:33.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.861+0000 7fd35bfff700 1 -- 172.21.15.40:0/2840138268 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd374130b00 con 0x7fd37409c890 2023-09-30T22:30:33.862 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:33.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.863+0000 7fd37a227700 1 -- 172.21.15.40:0/2840138268 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd37409c890 msgr2=0x7fd37412d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:33.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.863+0000 7fd37a227700 1 --2- 172.21.15.40:0/2840138268 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd37409c890 0x7fd37412d4b0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fd364015000 tx=0x7fd364004750 comp rx=0 tx=0).stop 2023-09-30T22:30:33.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.863+0000 7fd37a227700 1 -- 172.21.15.40:0/2840138268 shutdown_connections 2023-09-30T22:30:33.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.863+0000 7fd37a227700 1 --2- 172.21.15.40:0/2840138268 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd37409c890 0x7fd37412d4b0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.863+0000 7fd37a227700 1 --2- 172.21.15.40:0/2840138268 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd37409e480 0x7fd37412df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.863+0000 7fd37a227700 1 --2- 172.21.15.40:0/2840138268 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd37409d920 0x7fd37412d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:33.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.863+0000 7fd37a227700 1 -- 172.21.15.40:0/2840138268 >> 172.21.15.40:0/2840138268 conn(0x7fd3740a7080 msgr2=0x7fd3741332c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:33.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.864+0000 7fd37a227700 1 -- 172.21.15.40:0/2840138268 shutdown_connections 2023-09-30T22:30:33.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:33.864+0000 7fd37a227700 1 -- 172.21.15.40:0/2840138268 wait complete. 2023-09-30T22:30:33.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:34.404 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:34.480 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:34.489 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:34.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.545+0000 7fe4c10d3700 1 Processor -- start 2023-09-30T22:30:34.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.545+0000 7fe4c10d3700 1 -- start start 2023-09-30T22:30:34.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.546+0000 7fe4c10d3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe4bc09d920 0x7fe4bc09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:34.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.546+0000 7fe4c10d3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe4bc09e230 0x7fe4bc1308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:34.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.546+0000 7fe4c10d3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4bc09adf0 con 0x7fe4bc130de0 2023-09-30T22:30:34.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.546+0000 7fe4c10d3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4bc09edf0 con 0x7fe4bc09e230 2023-09-30T22:30:34.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.546+0000 7fe4c10d3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4bc09b660 con 0x7fe4bc09d920 2023-09-30T22:30:34.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.546+0000 7fe4ba59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe4bc09e230 0x7fe4bc1308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:34.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.546+0000 7fe4bad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe4bc09d920 0x7fe4bc09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:34.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.546+0000 7fe4bad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe4bc09d920 0x7fe4bc09dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:50700/0 (socket says 172.21.15.40:50700) 2023-09-30T22:30:34.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.546+0000 7fe4ba59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe4bc09e230 0x7fe4bc1308a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47788/0 (socket says 172.21.15.40:47788) 2023-09-30T22:30:34.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.546+0000 7fe4bad9d700 1 -- 172.21.15.40:0/494274258 learned_addr learned my addr 172.21.15.40:0/494274258 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:34.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.546+0000 7fe4bad9d700 1 -- 172.21.15.40:0/494274258 >> v2:172.21.15.40:3300/0 conn(0x7fe4bc09e230 msgr2=0x7fe4bc1308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:34.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.546+0000 7fe4bad9d700 1 --2- 172.21.15.40:0/494274258 >> v2:172.21.15.40:3300/0 conn(0x7fe4bc09e230 0x7fe4bc1308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.546+0000 7fe4bad9d700 1 -- 172.21.15.40:0/494274258 >> v1:172.21.15.40:6789/0 conn(0x7fe4bc130de0 legacy=0x7fe4bc137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:34.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.546+0000 7fe4bad9d700 1 -- 172.21.15.40:0/494274258 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4bc09a6e0 con 0x7fe4bc09d920 2023-09-30T22:30:34.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.546+0000 7fe4b9d9b700 1 -- 172.21.15.40:0/494274258 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 972733912 0 0) 0x7fe4bc09adf0 con 0x7fe4bc130de0 2023-09-30T22:30:34.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.546+0000 7fe4ba59c700 1 --2- 172.21.15.40:0/494274258 >> v2:172.21.15.40:3300/0 conn(0x7fe4bc09e230 0x7fe4bc1308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:34.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.546+0000 7fe4bad9d700 1 --2- 172.21.15.40:0/494274258 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe4bc09d920 0x7fe4bc09dcf0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac006fd0 tx=0x7fe4ac009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f1e68122e0e8f6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:34.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.547+0000 7fe4b9d9b700 1 -- 172.21.15.40:0/494274258 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac005e30 con 0x7fe4bc09d920 2023-09-30T22:30:34.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.547+0000 7fe4b9d9b700 1 -- 172.21.15.40:0/494274258 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4ac004030 con 0x7fe4bc09d920 2023-09-30T22:30:34.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.547+0000 7fe4b9d9b700 1 -- 172.21.15.40:0/494274258 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac0043e0 con 0x7fe4bc09d920 2023-09-30T22:30:34.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.547+0000 7fe4c10d3700 1 -- 172.21.15.40:0/494274258 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe4bc09d920 msgr2=0x7fe4bc09dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:34.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.548+0000 7fe4c10d3700 1 --2- 172.21.15.40:0/494274258 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe4bc09d920 0x7fe4bc09dcf0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac006fd0 tx=0x7fe4ac009bd0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.548+0000 7fe4c10d3700 1 -- 172.21.15.40:0/494274258 shutdown_connections 2023-09-30T22:30:34.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.548+0000 7fe4c10d3700 1 --2- 172.21.15.40:0/494274258 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe4bc09d920 0x7fe4bc09dcf0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.548+0000 7fe4c10d3700 1 --2- 172.21.15.40:0/494274258 >> v2:172.21.15.40:3300/0 conn(0x7fe4bc09e230 0x7fe4bc1308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.548+0000 7fe4c10d3700 1 -- 172.21.15.40:0/494274258 >> 172.21.15.40:0/494274258 conn(0x7fe4bc09fb20 msgr2=0x7fe4bc09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:34.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.548+0000 7fe4c10d3700 1 -- 172.21.15.40:0/494274258 shutdown_connections 2023-09-30T22:30:34.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.548+0000 7fe4c10d3700 1 -- 172.21.15.40:0/494274258 wait complete. 2023-09-30T22:30:34.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.549+0000 7fe4c10d3700 1 Processor -- start 2023-09-30T22:30:34.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.549+0000 7fe4c10d3700 1 -- start start 2023-09-30T22:30:34.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.549+0000 7fe4c10d3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4bc09d920 0x7fe4bc1c4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:34.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.549+0000 7fe4c10d3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe4bc09e230 0x7fe4bc1c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:34.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.549+0000 7fe4c10d3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe4bc130de0 0x7fe4bc1c08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:34.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.549+0000 7fe4c10d3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4bc11d8b0 con 0x7fe4bc09d920 2023-09-30T22:30:34.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.549+0000 7fe4c10d3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4bc11dc90 con 0x7fe4bc09e230 2023-09-30T22:30:34.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.549+0000 7fe4c10d3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4bc11e3d0 con 0x7fe4bc130de0 2023-09-30T22:30:34.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.550+0000 7fe4bb59e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe4bc130de0 0x7fe4bc1c08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:34.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.550+0000 7fe4bad9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4bc09d920 0x7fe4bc1c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:34.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.550+0000 7fe4bb59e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe4bc130de0 0x7fe4bc1c08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:50702/0 (socket says 172.21.15.40:50702) 2023-09-30T22:30:34.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.550+0000 7fe4bb59e700 1 -- 172.21.15.40:0/361535501 learned_addr learned my addr 172.21.15.40:0/361535501 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:34.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.550+0000 7fe4ba59c700 1 --2- 172.21.15.40:0/361535501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe4bc09e230 0x7fe4bc1c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:34.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.550+0000 7fe4bb59e700 1 -- 172.21.15.40:0/361535501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe4bc09e230 msgr2=0x7fe4bc1c49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:34.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.550+0000 7fe4bb59e700 1 --2- 172.21.15.40:0/361535501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe4bc09e230 0x7fe4bc1c49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.550+0000 7fe4bb59e700 1 -- 172.21.15.40:0/361535501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4bc09d920 msgr2=0x7fe4bc1c4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:34.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.550+0000 7fe4bb59e700 1 --2- 172.21.15.40:0/361535501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4bc09d920 0x7fe4bc1c4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.550+0000 7fe4bb59e700 1 -- 172.21.15.40:0/361535501 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b000d940 con 0x7fe4bc130de0 2023-09-30T22:30:34.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.550+0000 7fe4bad9d700 1 --2- 172.21.15.40:0/361535501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4bc09d920 0x7fe4bc1c4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:34.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.550+0000 7fe4bb59e700 1 --2- 172.21.15.40:0/361535501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe4bc130de0 0x7fe4bc1c08e0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4001560 tx=0x7fe4b400cb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:34.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.551+0000 7fe4a37fe700 1 -- 172.21.15.40:0/361535501 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4003e30 con 0x7fe4bc130de0 2023-09-30T22:30:34.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.551+0000 7fe4a37fe700 1 -- 172.21.15.40:0/361535501 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b4005070 con 0x7fe4bc130de0 2023-09-30T22:30:34.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.551+0000 7fe4a37fe700 1 -- 172.21.15.40:0/361535501 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4005420 con 0x7fe4bc130de0 2023-09-30T22:30:34.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.551+0000 7fe4c10d3700 1 -- 172.21.15.40:0/361535501 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4ac009500 con 0x7fe4bc130de0 2023-09-30T22:30:34.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.551+0000 7fe4c10d3700 1 -- 172.21.15.40:0/361535501 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4bc11ca60 con 0x7fe4bc130de0 2023-09-30T22:30:34.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.551+0000 7fe4a37fe700 1 -- 172.21.15.40:0/361535501 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe4b4005580 con 0x7fe4bc130de0 2023-09-30T22:30:34.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.552+0000 7fe4a37fe700 1 -- 172.21.15.40:0/361535501 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe4b403ee80 con 0x7fe4bc130de0 2023-09-30T22:30:34.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.552+0000 7fe4c10d3700 1 -- 172.21.15.40:0/361535501 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4bc11cc20 con 0x7fe4bc130de0 2023-09-30T22:30:34.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.557+0000 7fe4a37fe700 1 -- 172.21.15.40:0/361535501 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe4b4005830 con 0x7fe4bc130de0 2023-09-30T22:30:34.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.618+0000 7fdd494b4700 1 Processor -- start 2023-09-30T22:30:34.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.619+0000 7fdd494b4700 1 -- start start 2023-09-30T22:30:34.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.619+0000 7fdd494b4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdd4409d920 0x7fdd4409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:34.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.619+0000 7fdd494b4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd4409f0f0 0x7fdd4409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:34.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.619+0000 7fdd494b4700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd4409f940 con 0x7fdd44133ca0 2023-09-30T22:30:34.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.619+0000 7fdd494b4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd4406b4c0 con 0x7fdd4409d920 2023-09-30T22:30:34.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.619+0000 7fdd494b4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4409a8f0 con 0x7fdd4409f0f0 2023-09-30T22:30:34.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.619+0000 7fdd427fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd4409f0f0 0x7fdd4409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:34.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.619+0000 7fdd427fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd4409f0f0 0x7fdd4409e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:47702/0 (socket says 172.21.15.40:47702) 2023-09-30T22:30:34.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.619+0000 7fdd427fc700 1 -- 172.21.15.40:0/2094296190 learned_addr learned my addr 172.21.15.40:0/2094296190 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:34.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.619+0000 7fdd42ffd700 1 --2- 172.21.15.40:0/2094296190 >> v2:172.21.15.40:3300/0 conn(0x7fdd4409d920 0x7fdd4409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:34.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.619+0000 7fdd427fc700 1 -- 172.21.15.40:0/2094296190 >> v2:172.21.15.40:3300/0 conn(0x7fdd4409d920 msgr2=0x7fdd4409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:34.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.619+0000 7fdd427fc700 1 --2- 172.21.15.40:0/2094296190 >> v2:172.21.15.40:3300/0 conn(0x7fdd4409d920 0x7fdd4409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.619+0000 7fdd427fc700 1 -- 172.21.15.40:0/2094296190 >> v1:172.21.15.40:6789/0 conn(0x7fdd44133ca0 legacy=0x7fdd44134120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:34.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.620+0000 7fdd427fc700 1 -- 172.21.15.40:0/2094296190 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd4409f6e0 con 0x7fdd4409f0f0 2023-09-30T22:30:34.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.620+0000 7fdd427fc700 1 --2- 172.21.15.40:0/2094296190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd4409f0f0 0x7fdd4409e230 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fdd380098f0 tx=0x7fdd38009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8cc2c3c05aadbcd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:34.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.620+0000 7fdd41ffb700 1 -- 172.21.15.40:0/2094296190 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd38011830 con 0x7fdd4409f0f0 2023-09-30T22:30:34.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.620+0000 7fdd41ffb700 1 -- 172.21.15.40:0/2094296190 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd38011990 con 0x7fdd4409f0f0 2023-09-30T22:30:34.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.620+0000 7fdd41ffb700 1 -- 172.21.15.40:0/2094296190 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd38011d20 con 0x7fdd4409f0f0 2023-09-30T22:30:34.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.620+0000 7fdd494b4700 1 -- 172.21.15.40:0/2094296190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd4409f0f0 msgr2=0x7fdd4409e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:34.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.620+0000 7fdd494b4700 1 --2- 172.21.15.40:0/2094296190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd4409f0f0 0x7fdd4409e230 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fdd380098f0 tx=0x7fdd38009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:34.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.621+0000 7fdd494b4700 1 -- 172.21.15.40:0/2094296190 shutdown_connections 2023-09-30T22:30:34.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.621+0000 7fdd494b4700 1 --2- 172.21.15.40:0/2094296190 >> v2:172.21.15.40:3300/0 conn(0x7fdd4409d920 0x7fdd4409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.621+0000 7fdd494b4700 1 --2- 172.21.15.40:0/2094296190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd4409f0f0 0x7fdd4409e230 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.621+0000 7fdd494b4700 1 -- 172.21.15.40:0/2094296190 >> 172.21.15.40:0/2094296190 conn(0x7fdd4409fb20 msgr2=0x7fdd4409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:34.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.621+0000 7fdd494b4700 1 -- 172.21.15.40:0/2094296190 shutdown_connections 2023-09-30T22:30:34.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.621+0000 7fdd494b4700 1 -- 172.21.15.40:0/2094296190 wait complete. 2023-09-30T22:30:34.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.622+0000 7fdd494b4700 1 Processor -- start 2023-09-30T22:30:34.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.622+0000 7fdd494b4700 1 -- start start 2023-09-30T22:30:34.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.622+0000 7fdd494b4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdd4409d920 0x7fdd441217a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:34.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.622+0000 7fdd494b4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd44133ca0 0x7fdd44121ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:34.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.622+0000 7fdd494b4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd44122220 0x7fdd441ce990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:34.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.622+0000 7fdd494b4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd440a2940 con 0x7fdd44122220 2023-09-30T22:30:34.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.622+0000 7fdd494b4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4409c9e0 con 0x7fdd44133ca0 2023-09-30T22:30:34.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.622+0000 7fdd494b4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd44124190 con 0x7fdd4409d920 2023-09-30T22:30:34.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.622+0000 7fdd437fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd44122220 0x7fdd441ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:34.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.622+0000 7fdd42ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdd4409d920 0x7fdd441217a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:34.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.622+0000 7fdd437fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd44122220 0x7fdd441ce990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47822/0 (socket says 172.21.15.40:47822) 2023-09-30T22:30:34.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.622+0000 7fdd437fe700 1 -- 172.21.15.40:0/2732733150 learned_addr learned my addr 172.21.15.40:0/2732733150 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:34.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.622+0000 7fdd427fc700 1 --2- 172.21.15.40:0/2732733150 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd44133ca0 0x7fdd44121ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:34.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.623+0000 7fdd427fc700 1 -- 172.21.15.40:0/2732733150 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdd4409d920 msgr2=0x7fdd441217a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:34.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.623+0000 7fdd427fc700 1 --2- 172.21.15.40:0/2732733150 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdd4409d920 0x7fdd441217a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.623+0000 7fdd427fc700 1 -- 172.21.15.40:0/2732733150 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd44122220 msgr2=0x7fdd441ce990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:34.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.623+0000 7fdd427fc700 1 --2- 172.21.15.40:0/2732733150 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd44122220 0x7fdd441ce990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.623+0000 7fdd427fc700 1 -- 172.21.15.40:0/2732733150 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd38009550 con 0x7fdd44133ca0 2023-09-30T22:30:34.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.623+0000 7fdd437fe700 1 --2- 172.21.15.40:0/2732733150 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd44122220 0x7fdd441ce990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:34.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.623+0000 7fdd427fc700 1 --2- 172.21.15.40:0/2732733150 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd44133ca0 0x7fdd44121ce0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fdd380098f0 tx=0x7fdd38004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:34.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.623+0000 7fdd2b7fe700 1 -- 172.21.15.40:0/2732733150 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd38004300 con 0x7fdd44133ca0 2023-09-30T22:30:34.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.623+0000 7fdd2b7fe700 1 -- 172.21.15.40:0/2732733150 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3801f070 con 0x7fdd44133ca0 2023-09-30T22:30:34.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.623+0000 7fdd2b7fe700 1 -- 172.21.15.40:0/2732733150 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd380036a0 con 0x7fdd44133ca0 2023-09-30T22:30:34.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.624+0000 7fdd494b4700 1 -- 172.21.15.40:0/2732733150 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd44124a10 con 0x7fdd44133ca0 2023-09-30T22:30:34.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.624+0000 7fdd494b4700 1 -- 172.21.15.40:0/2732733150 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd44124fa0 con 0x7fdd44133ca0 2023-09-30T22:30:34.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.625+0000 7fdd2b7fe700 1 -- 172.21.15.40:0/2732733150 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdd38021030 con 0x7fdd44133ca0 2023-09-30T22:30:34.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.625+0000 7fdd494b4700 1 -- 172.21.15.40:0/2732733150 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd44062380 con 0x7fdd44133ca0 2023-09-30T22:30:34.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.625+0000 7fdd2b7fe700 1 -- 172.21.15.40:0/2732733150 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fdd38040950 con 0x7fdd44133ca0 2023-09-30T22:30:34.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.634+0000 7fdd2b7fe700 1 -- 172.21.15.40:0/2732733150 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdd380239c0 con 0x7fdd44133ca0 2023-09-30T22:30:34.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.658+0000 7fc544558700 1 Processor -- start 2023-09-30T22:30:34.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.659+0000 7fc544558700 1 -- start start 2023-09-30T22:30:34.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.659+0000 7fc544558700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc53c06fb50 0x7fc53c136c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:34.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.659+0000 7fc544558700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc53c1371b0 0x7fc53c139590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:34.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.659+0000 7fc544558700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc53c070830 con 0x7fc53c06f070 2023-09-30T22:30:34.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.659+0000 7fc544558700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c070ad0 con 0x7fc53c1371b0 2023-09-30T22:30:34.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.659+0000 7fc544558700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c070de0 con 0x7fc53c06fb50 2023-09-30T22:30:34.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.659+0000 7fc541af3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc53c06fb50 0x7fc53c136c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:34.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.659+0000 7fc541af3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc53c06fb50 0x7fc53c136c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:50730/0 (socket says 172.21.15.40:50730) 2023-09-30T22:30:34.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.659+0000 7fc541af3700 1 -- 172.21.15.40:0/161830763 learned_addr learned my addr 172.21.15.40:0/161830763 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:34.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.659+0000 7fc542af5700 1 --2- 172.21.15.40:0/161830763 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc53c1371b0 0x7fc53c139590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:34.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.660+0000 7fc541af3700 1 -- 172.21.15.40:0/161830763 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc53c1371b0 msgr2=0x7fc53c139590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:34.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.660+0000 7fc541af3700 1 --2- 172.21.15.40:0/161830763 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc53c1371b0 0x7fc53c139590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.660+0000 7fc541af3700 1 -- 172.21.15.40:0/161830763 >> v1:172.21.15.40:6789/0 conn(0x7fc53c06f070 legacy=0x7fc53c06f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:34.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.660+0000 7fc541af3700 1 -- 172.21.15.40:0/161830763 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc53c09fe20 con 0x7fc53c06fb50 2023-09-30T22:30:34.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.660+0000 7fc541af3700 1 --2- 172.21.15.40:0/161830763 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc53c06fb50 0x7fc53c136c70 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fc52c009920 tx=0x7fc52c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=769ce7dc94029d26 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:34.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.660+0000 7fc5412f2700 1 -- 172.21.15.40:0/161830763 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52c011830 con 0x7fc53c06fb50 2023-09-30T22:30:34.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.660+0000 7fc5412f2700 1 -- 172.21.15.40:0/161830763 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52c011990 con 0x7fc53c06fb50 2023-09-30T22:30:34.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.660+0000 7fc5412f2700 1 -- 172.21.15.40:0/161830763 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52c011d20 con 0x7fc53c06fb50 2023-09-30T22:30:34.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.661+0000 7fc544558700 1 -- 172.21.15.40:0/161830763 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc53c06fb50 msgr2=0x7fc53c136c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:34.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.661+0000 7fc544558700 1 --2- 172.21.15.40:0/161830763 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc53c06fb50 0x7fc53c136c70 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fc52c009920 tx=0x7fc52c009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:34.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.661+0000 7fc544558700 1 -- 172.21.15.40:0/161830763 shutdown_connections 2023-09-30T22:30:34.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.661+0000 7fc544558700 1 --2- 172.21.15.40:0/161830763 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc53c1371b0 0x7fc53c139590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.661+0000 7fc544558700 1 --2- 172.21.15.40:0/161830763 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc53c06fb50 0x7fc53c136c70 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.661+0000 7fc544558700 1 -- 172.21.15.40:0/161830763 >> 172.21.15.40:0/161830763 conn(0x7fc53c0a41a0 msgr2=0x7fc53c0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:34.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.661+0000 7fc544558700 1 -- 172.21.15.40:0/161830763 shutdown_connections 2023-09-30T22:30:34.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.661+0000 7fc544558700 1 -- 172.21.15.40:0/161830763 wait complete. 2023-09-30T22:30:34.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.662+0000 7fc544558700 1 Processor -- start 2023-09-30T22:30:34.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.662+0000 7fc544558700 1 -- start start 2023-09-30T22:30:34.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.662+0000 7fc544558700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc53c06f070 0x7fc53c099400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:34.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.662+0000 7fc544558700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc53c06fb50 0x7fc53c099940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:34.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.662+0000 7fc544558700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc53c1371b0 0x7fc53c1c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:34.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.662+0000 7fc544558700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c1308f0 con 0x7fc53c1371b0 2023-09-30T22:30:34.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.662+0000 7fc544558700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c06d870 con 0x7fc53c06fb50 2023-09-30T22:30:34.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.662+0000 7fc544558700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c1366b0 con 0x7fc53c06f070 2023-09-30T22:30:34.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.662+0000 7fc5422f4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc53c06f070 0x7fc53c099400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:34.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.662+0000 7fc541af3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc53c06fb50 0x7fc53c099940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:34.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.662+0000 7fc5422f4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc53c06f070 0x7fc53c099400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:50738/0 (socket says 172.21.15.40:50738) 2023-09-30T22:30:34.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.662+0000 7fc5422f4700 1 -- 172.21.15.40:0/133310937 learned_addr learned my addr 172.21.15.40:0/133310937 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:34.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.663+0000 7fc542af5700 1 --2- 172.21.15.40:0/133310937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc53c1371b0 0x7fc53c1c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:34.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.663+0000 7fc541af3700 1 -- 172.21.15.40:0/133310937 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc53c06f070 msgr2=0x7fc53c099400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:34.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.663+0000 7fc541af3700 1 --2- 172.21.15.40:0/133310937 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc53c06f070 0x7fc53c099400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.663+0000 7fc541af3700 1 -- 172.21.15.40:0/133310937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc53c1371b0 msgr2=0x7fc53c1c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:34.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.663+0000 7fc541af3700 1 --2- 172.21.15.40:0/133310937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc53c1371b0 0x7fc53c1c84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.663+0000 7fc541af3700 1 -- 172.21.15.40:0/133310937 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc52c009550 con 0x7fc53c06fb50 2023-09-30T22:30:34.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.663+0000 7fc5422f4700 1 --2- 172.21.15.40:0/133310937 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc53c06f070 0x7fc53c099400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:34.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.663+0000 7fc541af3700 1 --2- 172.21.15.40:0/133310937 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc53c06fb50 0x7fc53c099940 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fc52c016000 tx=0x7fc52c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:34.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.663+0000 7fc532ffd700 1 -- 172.21.15.40:0/133310937 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52c004450 con 0x7fc53c06fb50 2023-09-30T22:30:34.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.663+0000 7fc532ffd700 1 -- 172.21.15.40:0/133310937 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52c01f070 con 0x7fc53c06fb50 2023-09-30T22:30:34.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.663+0000 7fc544558700 1 -- 172.21.15.40:0/133310937 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc53c06d2d0 con 0x7fc53c06fb50 2023-09-30T22:30:34.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.663+0000 7fc532ffd700 1 -- 172.21.15.40:0/133310937 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52c0038e0 con 0x7fc53c06fb50 2023-09-30T22:30:34.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.663+0000 7fc544558700 1 -- 172.21.15.40:0/133310937 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc53c099e80 con 0x7fc53c06fb50 2023-09-30T22:30:34.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.664+0000 7fc532ffd700 1 -- 172.21.15.40:0/133310937 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc52c003a40 con 0x7fc53c06fb50 2023-09-30T22:30:34.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.664+0000 7fc544558700 1 -- 172.21.15.40:0/133310937 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc53c062380 con 0x7fc53c06fb50 2023-09-30T22:30:34.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.664+0000 7fc532ffd700 1 -- 172.21.15.40:0/133310937 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc52c021070 con 0x7fc53c06fb50 2023-09-30T22:30:34.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.669+0000 7fc532ffd700 1 -- 172.21.15.40:0/133310937 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc52c01a430 con 0x7fc53c06fb50 2023-09-30T22:30:34.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.759+0000 7fe4c10d3700 1 -- 172.21.15.40:0/361535501 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe4bc11e9c0 con 0x7fe4bc130de0 2023-09-30T22:30:34.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.759+0000 7fe4a37fe700 1 -- 172.21.15.40:0/361535501 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe4b4010300 con 0x7fe4bc130de0 2023-09-30T22:30:34.760 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:34.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.761+0000 7fe4c10d3700 1 -- 172.21.15.40:0/361535501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe4bc130de0 msgr2=0x7fe4bc1c08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:34.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.761+0000 7fe4c10d3700 1 --2- 172.21.15.40:0/361535501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe4bc130de0 0x7fe4bc1c08e0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4001560 tx=0x7fe4b400cb50 comp rx=0 tx=0).stop 2023-09-30T22:30:34.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.761+0000 7fe4c10d3700 1 -- 172.21.15.40:0/361535501 shutdown_connections 2023-09-30T22:30:34.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.761+0000 7fe4c10d3700 1 --2- 172.21.15.40:0/361535501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe4bc130de0 0x7fe4bc1c08e0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.761+0000 7fe4c10d3700 1 --2- 172.21.15.40:0/361535501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4bc09d920 0x7fe4bc1c4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.761+0000 7fe4c10d3700 1 --2- 172.21.15.40:0/361535501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe4bc09e230 0x7fe4bc1c49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.761+0000 7fe4c10d3700 1 -- 172.21.15.40:0/361535501 >> 172.21.15.40:0/361535501 conn(0x7fe4bc09fb20 msgr2=0x7fe4bc12dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:34.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.761+0000 7fe4c10d3700 1 -- 172.21.15.40:0/361535501 shutdown_connections 2023-09-30T22:30:34.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.761+0000 7fe4c10d3700 1 -- 172.21.15.40:0/361535501 wait complete. 2023-09-30T22:30:34.774 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:34.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.832+0000 7fdd494b4700 1 -- 172.21.15.40:0/2732733150 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdd44074720 con 0x7fdd44133ca0 2023-09-30T22:30:34.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.833+0000 7fdd2b7fe700 1 -- 172.21.15.40:0/2732733150 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdd380233d0 con 0x7fdd44133ca0 2023-09-30T22:30:34.833 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:34.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.835+0000 7fdd494b4700 1 -- 172.21.15.40:0/2732733150 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd44133ca0 msgr2=0x7fdd44121ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:34.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.835+0000 7fdd494b4700 1 --2- 172.21.15.40:0/2732733150 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd44133ca0 0x7fdd44121ce0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fdd380098f0 tx=0x7fdd38004750 comp rx=0 tx=0).stop 2023-09-30T22:30:34.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.835+0000 7fdd494b4700 1 -- 172.21.15.40:0/2732733150 shutdown_connections 2023-09-30T22:30:34.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.835+0000 7fdd494b4700 1 --2- 172.21.15.40:0/2732733150 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdd4409d920 0x7fdd441217a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.835+0000 7fdd494b4700 1 --2- 172.21.15.40:0/2732733150 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd44122220 0x7fdd441ce990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.835+0000 7fdd494b4700 1 --2- 172.21.15.40:0/2732733150 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd44133ca0 0x7fdd44121ce0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.835+0000 7fdd494b4700 1 -- 172.21.15.40:0/2732733150 >> 172.21.15.40:0/2732733150 conn(0x7fdd4409fb20 msgr2=0x7fdd440a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:34.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.835+0000 7fdd494b4700 1 -- 172.21.15.40:0/2732733150 shutdown_connections 2023-09-30T22:30:34.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.835+0000 7fdd494b4700 1 -- 172.21.15.40:0/2732733150 wait complete. 2023-09-30T22:30:34.848 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:34.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.868+0000 7fc544558700 1 -- 172.21.15.40:0/133310937 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc53c0a04e0 con 0x7fc53c06fb50 2023-09-30T22:30:34.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.868+0000 7fc532ffd700 1 -- 172.21.15.40:0/133310937 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc52c033020 con 0x7fc53c06fb50 2023-09-30T22:30:34.869 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:34.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.870+0000 7fc544558700 1 -- 172.21.15.40:0/133310937 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc53c06fb50 msgr2=0x7fc53c099940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:34.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.870+0000 7fc544558700 1 --2- 172.21.15.40:0/133310937 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc53c06fb50 0x7fc53c099940 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fc52c016000 tx=0x7fc52c004750 comp rx=0 tx=0).stop 2023-09-30T22:30:34.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.870+0000 7fc544558700 1 -- 172.21.15.40:0/133310937 shutdown_connections 2023-09-30T22:30:34.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.870+0000 7fc544558700 1 --2- 172.21.15.40:0/133310937 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc53c06f070 0x7fc53c099400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.870+0000 7fc544558700 1 --2- 172.21.15.40:0/133310937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc53c1371b0 0x7fc53c1c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.870+0000 7fc544558700 1 --2- 172.21.15.40:0/133310937 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc53c06fb50 0x7fc53c099940 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:34.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.870+0000 7fc544558700 1 -- 172.21.15.40:0/133310937 >> 172.21.15.40:0/133310937 conn(0x7fc53c0a41a0 msgr2=0x7fc53c0a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:34.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.870+0000 7fc544558700 1 -- 172.21.15.40:0/133310937 shutdown_connections 2023-09-30T22:30:34.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:34.870+0000 7fc544558700 1 -- 172.21.15.40:0/133310937 wait complete. 2023-09-30T22:30:34.877 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:34.883 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:35.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.003+0000 7f7a20d8b700 1 Processor -- start 2023-09-30T22:30:35.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.003+0000 7f7a20d8b700 1 -- start start 2023-09-30T22:30:35.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.004+0000 7f7a20d8b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a1c136c50 0x7f7a1c139030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:35.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.004+0000 7f7a20d8b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a1c139570 0x7f7a1c13b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:35.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.004+0000 7f7a20d8b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a1c133940 con 0x7f7a1c133e00 2023-09-30T22:30:35.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.004+0000 7f7a20d8b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c09af70 con 0x7f7a1c136c50 2023-09-30T22:30:35.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.004+0000 7f7a20d8b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c09ab20 con 0x7f7a1c139570 2023-09-30T22:30:35.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.004+0000 7f7a1a59c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7a1c133e00 0x7f7a1c1341d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33570/0 (socket says 172.21.15.40:33570) 2023-09-30T22:30:35.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.004+0000 7f7a1a59c700 1 -- 172.21.15.40:0/1740555946 learned_addr learned my addr 172.21.15.40:0/1740555946 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:35.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.004+0000 7f7a1ad9d700 1 --2- 172.21.15.40:0/1740555946 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a1c139570 0x7f7a1c13b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:35.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.004+0000 7f7a11d9b700 1 --2- 172.21.15.40:0/1740555946 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a1c136c50 0x7f7a1c139030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:35.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.005+0000 7f7a11d9b700 1 -- 172.21.15.40:0/1740555946 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a1c139570 msgr2=0x7f7a1c13b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:35.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.005+0000 7f7a11d9b700 1 --2- 172.21.15.40:0/1740555946 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a1c139570 0x7f7a1c13b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.005+0000 7f7a11d9b700 1 -- 172.21.15.40:0/1740555946 >> v1:172.21.15.40:6789/0 conn(0x7f7a1c133e00 legacy=0x7f7a1c1341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:35.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.005+0000 7f7a19d9b700 1 -- 172.21.15.40:0/1740555946 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2372981017 0 0) 0x7f7a1c133940 con 0x7f7a1c133e00 2023-09-30T22:30:35.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.005+0000 7f7a11d9b700 1 -- 172.21.15.40:0/1740555946 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1c09f0d0 con 0x7f7a1c136c50 2023-09-30T22:30:35.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.005+0000 7f7a11d9b700 1 --2- 172.21.15.40:0/1740555946 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a1c136c50 0x7f7a1c139030 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f7a04009870 tx=0x7f7a04009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb0ff8ec9f02bd1d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:35.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.005+0000 7f7a19d9b700 1 -- 172.21.15.40:0/1740555946 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a04011830 con 0x7f7a1c136c50 2023-09-30T22:30:35.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.005+0000 7f7a19d9b700 1 -- 172.21.15.40:0/1740555946 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a04011990 con 0x7f7a1c136c50 2023-09-30T22:30:35.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.005+0000 7f7a19d9b700 1 -- 172.21.15.40:0/1740555946 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a04011d20 con 0x7f7a1c136c50 2023-09-30T22:30:35.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.005+0000 7f7a20d8b700 1 -- 172.21.15.40:0/1740555946 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a1c136c50 msgr2=0x7f7a1c139030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:35.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.005+0000 7f7a20d8b700 1 --2- 172.21.15.40:0/1740555946 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a1c136c50 0x7f7a1c139030 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f7a04009870 tx=0x7f7a04009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:35.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.006+0000 7f7a20d8b700 1 -- 172.21.15.40:0/1740555946 shutdown_connections 2023-09-30T22:30:35.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.006+0000 7f7a20d8b700 1 --2- 172.21.15.40:0/1740555946 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a1c139570 0x7f7a1c13b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.006+0000 7f7a20d8b700 1 --2- 172.21.15.40:0/1740555946 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a1c136c50 0x7f7a1c139030 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.006+0000 7f7a20d8b700 1 -- 172.21.15.40:0/1740555946 >> 172.21.15.40:0/1740555946 conn(0x7f7a1c0a2a00 msgr2=0x7f7a1c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:35.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.006+0000 7f7a20d8b700 1 -- 172.21.15.40:0/1740555946 shutdown_connections 2023-09-30T22:30:35.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.006+0000 7f7a20d8b700 1 -- 172.21.15.40:0/1740555946 wait complete. 2023-09-30T22:30:35.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.007+0000 7f7a20d8b700 1 Processor -- start 2023-09-30T22:30:35.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.007+0000 7f7a20d8b700 1 -- start start 2023-09-30T22:30:35.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.008+0000 7f7a20d8b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a1c133e00 0x7f7a1c119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:35.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.008+0000 7f7a20d8b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a1c136c50 0x7f7a1c119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:35.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.008+0000 7f7a20d8b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a1c139570 0x7f7a1c119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:35.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.008+0000 7f7a20d8b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c12d7b0 con 0x7f7a1c136c50 2023-09-30T22:30:35.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.008+0000 7f7a20d8b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c1337d0 con 0x7f7a1c133e00 2023-09-30T22:30:35.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.008+0000 7f7a20d8b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c1365a0 con 0x7f7a1c139570 2023-09-30T22:30:35.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.008+0000 7f7a1a59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a1c133e00 0x7f7a1c119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:35.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.008+0000 7f7a1a59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a1c133e00 0x7f7a1c119050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:47732/0 (socket says 172.21.15.40:47732) 2023-09-30T22:30:35.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.008+0000 7f7a1a59c700 1 -- 172.21.15.40:0/1817222820 learned_addr learned my addr 172.21.15.40:0/1817222820 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:35.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.008+0000 7f7a1ad9d700 1 --2- 172.21.15.40:0/1817222820 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a1c139570 0x7f7a1c119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:35.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.008+0000 7f7a11d9b700 1 --2- 172.21.15.40:0/1817222820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a1c136c50 0x7f7a1c119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:35.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.008+0000 7f7a1ad9d700 1 -- 172.21.15.40:0/1817222820 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a1c133e00 msgr2=0x7f7a1c119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:35.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.008+0000 7f7a1ad9d700 1 --2- 172.21.15.40:0/1817222820 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a1c133e00 0x7f7a1c119050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.008+0000 7f7a1ad9d700 1 -- 172.21.15.40:0/1817222820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a1c136c50 msgr2=0x7f7a1c119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:35.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.008+0000 7f7a1ad9d700 1 --2- 172.21.15.40:0/1817222820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a1c136c50 0x7f7a1c119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.008+0000 7f7a1ad9d700 1 -- 172.21.15.40:0/1817222820 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a040094a0 con 0x7f7a1c139570 2023-09-30T22:30:35.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.008+0000 7f7a1a59c700 1 --2- 172.21.15.40:0/1817222820 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a1c133e00 0x7f7a1c119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:35.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.009+0000 7f7a1ad9d700 1 --2- 172.21.15.40:0/1817222820 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a1c139570 0x7f7a1c119ad0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c131500 tx=0x7f7a1400ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:35.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.009+0000 7f7a137fe700 1 -- 172.21.15.40:0/1817222820 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1400cc20 con 0x7f7a1c139570 2023-09-30T22:30:35.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.009+0000 7f7a137fe700 1 -- 172.21.15.40:0/1817222820 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1400f040 con 0x7f7a1c139570 2023-09-30T22:30:35.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.009+0000 7f7a20d8b700 1 -- 172.21.15.40:0/1817222820 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a1c12dd70 con 0x7f7a1c139570 2023-09-30T22:30:35.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.009+0000 7f7a137fe700 1 -- 172.21.15.40:0/1817222820 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14009e60 con 0x7f7a1c139570 2023-09-30T22:30:35.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.009+0000 7f7a20d8b700 1 -- 172.21.15.40:0/1817222820 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a1c11b450 con 0x7f7a1c139570 2023-09-30T22:30:35.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.009+0000 7f7a137fe700 1 -- 172.21.15.40:0/1817222820 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7a14014480 con 0x7f7a1c139570 2023-09-30T22:30:35.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.010+0000 7f7a137fe700 1 -- 172.21.15.40:0/1817222820 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f7a14040380 con 0x7f7a1c139570 2023-09-30T22:30:35.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.010+0000 7f7a20d8b700 1 -- 172.21.15.40:0/1817222820 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a1c11b5e0 con 0x7f7a1c139570 2023-09-30T22:30:35.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.014+0000 7f7a137fe700 1 -- 172.21.15.40:0/1817222820 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7a14012930 con 0x7f7a1c139570 2023-09-30T22:30:35.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.209+0000 7f7a20d8b700 1 -- 172.21.15.40:0/1817222820 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7a1c062380 con 0x7f7a1c139570 2023-09-30T22:30:35.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.209+0000 7f7a137fe700 1 -- 172.21.15.40:0/1817222820 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7a1402c090 con 0x7f7a1c139570 2023-09-30T22:30:35.210 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:35.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.211+0000 7f7a20d8b700 1 -- 172.21.15.40:0/1817222820 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a1c139570 msgr2=0x7f7a1c119ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:35.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.211+0000 7f7a20d8b700 1 --2- 172.21.15.40:0/1817222820 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a1c139570 0x7f7a1c119ad0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c131500 tx=0x7f7a1400ef90 comp rx=0 tx=0).stop 2023-09-30T22:30:35.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.211+0000 7f7a20d8b700 1 -- 172.21.15.40:0/1817222820 shutdown_connections 2023-09-30T22:30:35.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.211+0000 7f7a20d8b700 1 --2- 172.21.15.40:0/1817222820 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7a1c139570 0x7f7a1c119ad0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.211+0000 7f7a20d8b700 1 --2- 172.21.15.40:0/1817222820 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7a1c133e00 0x7f7a1c119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.211+0000 7f7a20d8b700 1 --2- 172.21.15.40:0/1817222820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a1c136c50 0x7f7a1c119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.211+0000 7f7a20d8b700 1 -- 172.21.15.40:0/1817222820 >> 172.21.15.40:0/1817222820 conn(0x7f7a1c0a2a00 msgr2=0x7f7a1c09b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:35.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.211+0000 7f7a20d8b700 1 -- 172.21.15.40:0/1817222820 shutdown_connections 2023-09-30T22:30:35.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.211+0000 7f7a20d8b700 1 -- 172.21.15.40:0/1817222820 wait complete. 2023-09-30T22:30:35.224 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:35.775 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:35.849 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:35.884 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:35.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.916+0000 7fdd49d22700 1 Processor -- start 2023-09-30T22:30:35.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.916+0000 7fdd49d22700 1 -- start start 2023-09-30T22:30:35.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.916+0000 7fdd49d22700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdd4409d920 0x7fdd4409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:35.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.916+0000 7fdd49d22700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd4409e230 0x7fdd441308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:35.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.917+0000 7fdd49d22700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd4409adf0 con 0x7fdd44130de0 2023-09-30T22:30:35.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.917+0000 7fdd49d22700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4409edf0 con 0x7fdd4409e230 2023-09-30T22:30:35.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.917+0000 7fdd49d22700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4409b660 con 0x7fdd4409d920 2023-09-30T22:30:35.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.917+0000 7fdd43fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fdd44130de0 0x7fdd44137d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33584/0 (socket says 172.21.15.40:33584) 2023-09-30T22:30:35.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.917+0000 7fdd43fff700 1 -- 172.21.15.40:0/2690497270 learned_addr learned my addr 172.21.15.40:0/2690497270 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:35.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.917+0000 7fdd437fe700 1 --2- 172.21.15.40:0/2690497270 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdd4409d920 0x7fdd4409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:35.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.917+0000 7fdd42ffd700 1 --2- 172.21.15.40:0/2690497270 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd4409e230 0x7fdd441308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:35.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.917+0000 7fdd427fc700 1 -- 172.21.15.40:0/2690497270 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2578481919 0 0) 0x7fdd4409adf0 con 0x7fdd44130de0 2023-09-30T22:30:35.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.917+0000 7fdd437fe700 1 -- 172.21.15.40:0/2690497270 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd4409e230 msgr2=0x7fdd441308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:35.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.917+0000 7fdd437fe700 1 --2- 172.21.15.40:0/2690497270 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd4409e230 0x7fdd441308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.917+0000 7fdd437fe700 1 -- 172.21.15.40:0/2690497270 >> v1:172.21.15.40:6789/0 conn(0x7fdd44130de0 legacy=0x7fdd44137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:35.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.917+0000 7fdd437fe700 1 -- 172.21.15.40:0/2690497270 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd4409a6e0 con 0x7fdd4409d920 2023-09-30T22:30:35.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.917+0000 7fdd437fe700 1 --2- 172.21.15.40:0/2690497270 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdd4409d920 0x7fdd4409dcf0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fdd34009850 tx=0x7fdd34009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c50becde100428 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:35.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.917+0000 7fdd427fc700 1 -- 172.21.15.40:0/2690497270 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd34005e30 con 0x7fdd4409d920 2023-09-30T22:30:35.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.918+0000 7fdd427fc700 1 -- 172.21.15.40:0/2690497270 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd34006030 con 0x7fdd4409d920 2023-09-30T22:30:35.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.918+0000 7fdd427fc700 1 -- 172.21.15.40:0/2690497270 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd340063e0 con 0x7fdd4409d920 2023-09-30T22:30:35.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.918+0000 7fdd49d22700 1 -- 172.21.15.40:0/2690497270 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdd4409d920 msgr2=0x7fdd4409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:35.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.918+0000 7fdd49d22700 1 --2- 172.21.15.40:0/2690497270 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdd4409d920 0x7fdd4409dcf0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fdd34009850 tx=0x7fdd34009b60 comp rx=0 tx=0).stop 2023-09-30T22:30:35.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.918+0000 7fdd49d22700 1 -- 172.21.15.40:0/2690497270 shutdown_connections 2023-09-30T22:30:35.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.918+0000 7fdd49d22700 1 --2- 172.21.15.40:0/2690497270 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdd4409d920 0x7fdd4409dcf0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.918+0000 7fdd49d22700 1 --2- 172.21.15.40:0/2690497270 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd4409e230 0x7fdd441308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.918+0000 7fdd49d22700 1 -- 172.21.15.40:0/2690497270 >> 172.21.15.40:0/2690497270 conn(0x7fdd4409fb20 msgr2=0x7fdd4409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:35.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.918+0000 7fdd49d22700 1 -- 172.21.15.40:0/2690497270 shutdown_connections 2023-09-30T22:30:35.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.918+0000 7fdd49d22700 1 -- 172.21.15.40:0/2690497270 wait complete. 2023-09-30T22:30:35.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.919+0000 7fdd49d22700 1 Processor -- start 2023-09-30T22:30:35.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.920+0000 7fdd49d22700 1 -- start start 2023-09-30T22:30:35.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.920+0000 7fdd49d22700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd4409d920 0x7fdd4412eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:35.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.920+0000 7fdd49d22700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd4409e230 0x7fdd4412f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:35.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.920+0000 7fdd49d22700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdd44130de0 0x7fdd4412f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:35.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.920+0000 7fdd49d22700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd44130070 con 0x7fdd4409d920 2023-09-30T22:30:35.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.920+0000 7fdd49d22700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4409cb90 con 0x7fdd4409e230 2023-09-30T22:30:35.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.920+0000 7fdd49d22700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd441330f0 con 0x7fdd44130de0 2023-09-30T22:30:35.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.920+0000 7fdd42ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd4409e230 0x7fdd4412f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:35.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.920+0000 7fdd437fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd4409d920 0x7fdd4412eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:35.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.920+0000 7fdd437fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd4409d920 0x7fdd4412eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47858/0 (socket says 172.21.15.40:47858) 2023-09-30T22:30:35.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.920+0000 7fdd42ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd4409e230 0x7fdd4412f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:47746/0 (socket says 172.21.15.40:47746) 2023-09-30T22:30:35.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.920+0000 7fdd437fe700 1 -- 172.21.15.40:0/2259145632 learned_addr learned my addr 172.21.15.40:0/2259145632 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:35.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.920+0000 7fdd43fff700 1 --2- 172.21.15.40:0/2259145632 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdd44130de0 0x7fdd4412f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:35.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.921+0000 7fdd437fe700 1 -- 172.21.15.40:0/2259145632 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdd44130de0 msgr2=0x7fdd4412f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:35.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.921+0000 7fdd437fe700 1 --2- 172.21.15.40:0/2259145632 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdd44130de0 0x7fdd4412f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.921+0000 7fdd437fe700 1 -- 172.21.15.40:0/2259145632 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd4409e230 msgr2=0x7fdd4412f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:35.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.921+0000 7fdd437fe700 1 --2- 172.21.15.40:0/2259145632 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd4409e230 0x7fdd4412f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.921+0000 7fdd437fe700 1 -- 172.21.15.40:0/2259145632 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd34009430 con 0x7fdd4409d920 2023-09-30T22:30:35.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.921+0000 7fdd42ffd700 1 --2- 172.21.15.40:0/2259145632 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd4409e230 0x7fdd4412f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:35.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.921+0000 7fdd437fe700 1 --2- 172.21.15.40:0/2259145632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd4409d920 0x7fdd4412eba0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fdd34009ba0 tx=0x7fdd34004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:35.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.921+0000 7fdd2bfff700 1 -- 172.21.15.40:0/2259145632 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd340069e0 con 0x7fdd4409d920 2023-09-30T22:30:35.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.921+0000 7fdd2bfff700 1 -- 172.21.15.40:0/2259145632 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd34020070 con 0x7fdd4409d920 2023-09-30T22:30:35.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.921+0000 7fdd2bfff700 1 -- 172.21.15.40:0/2259145632 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd34004280 con 0x7fdd4409d920 2023-09-30T22:30:35.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.921+0000 7fdd49d22700 1 -- 172.21.15.40:0/2259145632 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd44133cd0 con 0x7fdd4409d920 2023-09-30T22:30:35.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.921+0000 7fdd49d22700 1 -- 172.21.15.40:0/2259145632 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd44133880 con 0x7fdd4409d920 2023-09-30T22:30:35.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.922+0000 7fdd2bfff700 1 -- 172.21.15.40:0/2259145632 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdd34022030 con 0x7fdd4409d920 2023-09-30T22:30:35.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.922+0000 7fdd2bfff700 1 -- 172.21.15.40:0/2259145632 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fdd34040de0 con 0x7fdd4409d920 2023-09-30T22:30:35.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.922+0000 7fdd49d22700 1 -- 172.21.15.40:0/2259145632 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd44132d70 con 0x7fdd4409d920 2023-09-30T22:30:35.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.927+0000 7fdd2bfff700 1 -- 172.21.15.40:0/2259145632 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdd44132d70 con 0x7fdd4409d920 2023-09-30T22:30:35.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.986+0000 7f696827d700 1 Processor -- start 2023-09-30T22:30:35.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.986+0000 7f696827d700 1 -- start start 2023-09-30T22:30:35.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.986+0000 7f696827d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6960136bf0 0x7f6960138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:35.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.986+0000 7f696827d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6960139510 0x7f696013b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:35.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.986+0000 7f696827d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69600a2600 con 0x7f696009c890 2023-09-30T22:30:35.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.987+0000 7f696827d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69600a29d0 con 0x7f6960139510 2023-09-30T22:30:35.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.987+0000 7f696827d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696009fb40 con 0x7f6960136bf0 2023-09-30T22:30:35.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.987+0000 7f6965818700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6960136bf0 0x7f6960138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:35.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.987+0000 7f696681a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6960139510 0x7f696013b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:35.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.987+0000 7f6965818700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6960136bf0 0x7f6960138fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:47760/0 (socket says 172.21.15.40:47760) 2023-09-30T22:30:35.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.987+0000 7f6965818700 1 -- 172.21.15.40:0/602034878 learned_addr learned my addr 172.21.15.40:0/602034878 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:35.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.987+0000 7f696681a700 1 -- 172.21.15.40:0/602034878 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6960136bf0 msgr2=0x7f6960138fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:35.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.987+0000 7f696681a700 1 --2- 172.21.15.40:0/602034878 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6960136bf0 0x7f6960138fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.987+0000 7f696681a700 1 -- 172.21.15.40:0/602034878 >> v1:172.21.15.40:6789/0 conn(0x7f696009c890 legacy=0x7f696009cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:35.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.987+0000 7f696681a700 1 -- 172.21.15.40:0/602034878 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696009d370 con 0x7f6960139510 2023-09-30T22:30:35.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.987+0000 7f6965017700 1 -- 172.21.15.40:0/602034878 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2337985710 0 0) 0x7f69600a2600 con 0x7f696009c890 2023-09-30T22:30:35.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.987+0000 7f6965818700 1 --2- 172.21.15.40:0/602034878 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6960136bf0 0x7f6960138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:35.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.987+0000 7f696681a700 1 --2- 172.21.15.40:0/602034878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6960139510 0x7f696013b8f0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f6958009d90 tx=0x7f695800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d4dc718655ecef2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:35.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.987+0000 7f6965017700 1 -- 172.21.15.40:0/602034878 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695800e070 con 0x7f6960139510 2023-09-30T22:30:35.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.988+0000 7f6965017700 1 -- 172.21.15.40:0/602034878 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695800bb20 con 0x7f6960139510 2023-09-30T22:30:35.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.988+0000 7f6965017700 1 -- 172.21.15.40:0/602034878 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6958012430 con 0x7f6960139510 2023-09-30T22:30:35.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.988+0000 7f696827d700 1 -- 172.21.15.40:0/602034878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6960139510 msgr2=0x7f696013b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:35.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.988+0000 7f696827d700 1 --2- 172.21.15.40:0/602034878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6960139510 0x7f696013b8f0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f6958009d90 tx=0x7f695800b330 comp rx=0 tx=0).stop 2023-09-30T22:30:35.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.988+0000 7f696827d700 1 -- 172.21.15.40:0/602034878 shutdown_connections 2023-09-30T22:30:35.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.988+0000 7f696827d700 1 --2- 172.21.15.40:0/602034878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6960139510 0x7f696013b8f0 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.988+0000 7f696827d700 1 --2- 172.21.15.40:0/602034878 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6960136bf0 0x7f6960138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.988+0000 7f696827d700 1 -- 172.21.15.40:0/602034878 >> 172.21.15.40:0/602034878 conn(0x7f69600a7080 msgr2=0x7f69600a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:35.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.988+0000 7f696827d700 1 -- 172.21.15.40:0/602034878 shutdown_connections 2023-09-30T22:30:35.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.988+0000 7f696827d700 1 -- 172.21.15.40:0/602034878 wait complete. 2023-09-30T22:30:35.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.990+0000 7f696827d700 1 Processor -- start 2023-09-30T22:30:35.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.990+0000 7f696827d700 1 -- start start 2023-09-30T22:30:35.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.990+0000 7f696827d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f696009c890 0x7f696006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:35.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.990+0000 7f696827d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6960136bf0 0x7f696006f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:35.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.990+0000 7f696827d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6960139510 0x7f696006f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:35.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.990+0000 7f696827d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6960070970 con 0x7f6960139510 2023-09-30T22:30:35.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.990+0000 7f696827d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6960138fe0 con 0x7f6960136bf0 2023-09-30T22:30:35.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.991+0000 7f696827d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f696009ecf0 con 0x7f696009c890 2023-09-30T22:30:35.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.991+0000 7f6966019700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f696009c890 0x7f696006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:35.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.991+0000 7f6966019700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f696009c890 0x7f696006ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:50772/0 (socket says 172.21.15.40:50772) 2023-09-30T22:30:35.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.991+0000 7f6966019700 1 -- 172.21.15.40:0/2975044418 learned_addr learned my addr 172.21.15.40:0/2975044418 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:35.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.991+0000 7f696681a700 1 --2- 172.21.15.40:0/2975044418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6960139510 0x7f696006f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:35.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.991+0000 7f6965818700 1 --2- 172.21.15.40:0/2975044418 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6960136bf0 0x7f696006f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:35.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.991+0000 7f6966019700 1 -- 172.21.15.40:0/2975044418 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6960136bf0 msgr2=0x7f696006f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:35.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.991+0000 7f6966019700 1 --2- 172.21.15.40:0/2975044418 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6960136bf0 0x7f696006f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.991+0000 7f6966019700 1 -- 172.21.15.40:0/2975044418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6960139510 msgr2=0x7f696006f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:35.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.991+0000 7f6966019700 1 --2- 172.21.15.40:0/2975044418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6960139510 0x7f696006f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:35.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.991+0000 7f6966019700 1 -- 172.21.15.40:0/2975044418 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6950009550 con 0x7f696009c890 2023-09-30T22:30:35.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.991+0000 7f696681a700 1 --2- 172.21.15.40:0/2975044418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6960139510 0x7f696006f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:35.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.991+0000 7f6966019700 1 --2- 172.21.15.40:0/2975044418 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f696009c890 0x7f696006ee80 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f695c00c550 tx=0x7f695c00c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:35.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.991+0000 7f6956ffd700 1 -- 172.21.15.40:0/2975044418 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c0054e0 con 0x7f696009c890 2023-09-30T22:30:35.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.991+0000 7f6956ffd700 1 -- 172.21.15.40:0/2975044418 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695c003680 con 0x7f696009c890 2023-09-30T22:30:35.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.991+0000 7f696827d700 1 -- 172.21.15.40:0/2975044418 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6958009a70 con 0x7f696009c890 2023-09-30T22:30:35.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.991+0000 7f6956ffd700 1 -- 172.21.15.40:0/2975044418 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c003a30 con 0x7f696009c890 2023-09-30T22:30:35.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.992+0000 7f696827d700 1 -- 172.21.15.40:0/2975044418 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f696012c590 con 0x7f696009c890 2023-09-30T22:30:35.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.992+0000 7f696827d700 1 -- 172.21.15.40:0/2975044418 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6960062380 con 0x7f696009c890 2023-09-30T22:30:35.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.993+0000 7f6956ffd700 1 -- 172.21.15.40:0/2975044418 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f695c003b90 con 0x7f696009c890 2023-09-30T22:30:35.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.993+0000 7f6956ffd700 1 -- 172.21.15.40:0/2975044418 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f695c03eb60 con 0x7f696009c890 2023-09-30T22:30:35.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:35.997+0000 7f6956ffd700 1 -- 172.21.15.40:0/2975044418 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f695c003e40 con 0x7f696009c890 2023-09-30T22:30:36.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.026+0000 7f701af3b700 1 Processor -- start 2023-09-30T22:30:36.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.026+0000 7f701af3b700 1 -- start start 2023-09-30T22:30:36.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.026+0000 7f701af3b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f701409c890 0x7f701409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:36.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.026+0000 7f701af3b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f701409d920 0x7f701409dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:36.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.026+0000 7f701af3b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70140a2600 con 0x7f701409e2b0 2023-09-30T22:30:36.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.026+0000 7f701af3b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70140a29d0 con 0x7f701409d920 2023-09-30T22:30:36.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.026+0000 7f701af3b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f701409fb40 con 0x7f701409c890 2023-09-30T22:30:36.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.026+0000 7f7018cd7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f701409c890 0x7f701409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:36.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.026+0000 7f7013fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f701409d920 0x7f701409dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:36.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.026+0000 7f7018cd7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f701409c890 0x7f701409cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:50780/0 (socket says 172.21.15.40:50780) 2023-09-30T22:30:36.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.026+0000 7f7018cd7700 1 -- 172.21.15.40:0/3415820840 learned_addr learned my addr 172.21.15.40:0/3415820840 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:36.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.027+0000 7f7018cd7700 1 -- 172.21.15.40:0/3415820840 >> v2:172.21.15.40:3300/0 conn(0x7f701409d920 msgr2=0x7f701409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:36.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.027+0000 7f7018cd7700 1 --2- 172.21.15.40:0/3415820840 >> v2:172.21.15.40:3300/0 conn(0x7f701409d920 0x7f701409dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.027+0000 7f7018cd7700 1 -- 172.21.15.40:0/3415820840 >> v1:172.21.15.40:6789/0 conn(0x7f701409e2b0 legacy=0x7f701413ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:36.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.027+0000 7f7018cd7700 1 -- 172.21.15.40:0/3415820840 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f701409e750 con 0x7f701409c890 2023-09-30T22:30:36.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.027+0000 7f7013fff700 1 --2- 172.21.15.40:0/3415820840 >> v2:172.21.15.40:3300/0 conn(0x7f701409d920 0x7f701409dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:36.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.027+0000 7f7018cd7700 1 --2- 172.21.15.40:0/3415820840 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f701409c890 0x7f701409cc60 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f7008006fd0 tx=0x7f7008009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=692ee867687dd88e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:36.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.027+0000 7f70137fe700 1 -- 172.21.15.40:0/3415820840 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7008005e30 con 0x7f701409c890 2023-09-30T22:30:36.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.027+0000 7f70137fe700 1 -- 172.21.15.40:0/3415820840 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7008004030 con 0x7f701409c890 2023-09-30T22:30:36.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.027+0000 7f70137fe700 1 -- 172.21.15.40:0/3415820840 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70080043e0 con 0x7f701409c890 2023-09-30T22:30:36.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.028+0000 7f701af3b700 1 -- 172.21.15.40:0/3415820840 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f701409c890 msgr2=0x7f701409cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:36.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.028+0000 7f701af3b700 1 --2- 172.21.15.40:0/3415820840 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f701409c890 0x7f701409cc60 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f7008006fd0 tx=0x7f7008009bd0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.028+0000 7f701af3b700 1 -- 172.21.15.40:0/3415820840 shutdown_connections 2023-09-30T22:30:36.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.028+0000 7f701af3b700 1 --2- 172.21.15.40:0/3415820840 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f701409c890 0x7f701409cc60 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.028+0000 7f701af3b700 1 --2- 172.21.15.40:0/3415820840 >> v2:172.21.15.40:3300/0 conn(0x7f701409d920 0x7f701409dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.028+0000 7f701af3b700 1 -- 172.21.15.40:0/3415820840 >> 172.21.15.40:0/3415820840 conn(0x7f70140a7080 msgr2=0x7f70140a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:36.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.028+0000 7f701af3b700 1 -- 172.21.15.40:0/3415820840 shutdown_connections 2023-09-30T22:30:36.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.028+0000 7f701af3b700 1 -- 172.21.15.40:0/3415820840 wait complete. 2023-09-30T22:30:36.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.029+0000 7f701af3b700 1 Processor -- start 2023-09-30T22:30:36.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.029+0000 7f701af3b700 1 -- start start 2023-09-30T22:30:36.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.029+0000 7f701af3b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f701409c890 0x7f701412d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:36.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.029+0000 7f701af3b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f701409d920 0x7f701412da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:36.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.029+0000 7f701af3b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f701409e2b0 0x7f701412df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:36.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.029+0000 7f701af3b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7014130b40 con 0x7f701409c890 2023-09-30T22:30:36.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.029+0000 7f701af3b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7014131500 con 0x7f701409e2b0 2023-09-30T22:30:36.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.029+0000 7f701af3b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7014130d40 con 0x7f701409d920 2023-09-30T22:30:36.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.029+0000 7f7018cd7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f701409c890 0x7f701412d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:36.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.029+0000 7f7018cd7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f701409c890 0x7f701412d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47878/0 (socket says 172.21.15.40:47878) 2023-09-30T22:30:36.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.029+0000 7f7018cd7700 1 -- 172.21.15.40:0/2794832240 learned_addr learned my addr 172.21.15.40:0/2794832240 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:36.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.029+0000 7f70194d8700 1 --2- 172.21.15.40:0/2794832240 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f701409e2b0 0x7f701412df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:36.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.029+0000 7f7013fff700 1 --2- 172.21.15.40:0/2794832240 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f701409d920 0x7f701412da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:36.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.030+0000 7f7018cd7700 1 -- 172.21.15.40:0/2794832240 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f701409d920 msgr2=0x7f701412da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:36.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.030+0000 7f7018cd7700 1 --2- 172.21.15.40:0/2794832240 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f701409d920 0x7f701412da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.030+0000 7f7018cd7700 1 -- 172.21.15.40:0/2794832240 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f701409e2b0 msgr2=0x7f701412df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:36.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.030+0000 7f7018cd7700 1 --2- 172.21.15.40:0/2794832240 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f701409e2b0 0x7f701412df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.030+0000 7f7018cd7700 1 -- 172.21.15.40:0/2794832240 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70000094a0 con 0x7f701409c890 2023-09-30T22:30:36.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.030+0000 7f70194d8700 1 --2- 172.21.15.40:0/2794832240 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f701409e2b0 0x7f701412df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:36.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.030+0000 7f7018cd7700 1 --2- 172.21.15.40:0/2794832240 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f701409c890 0x7f701412d4d0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f7008000c00 tx=0x7f7008004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:36.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.030+0000 7f70117fa700 1 -- 172.21.15.40:0/2794832240 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7008006b70 con 0x7f701409c890 2023-09-30T22:30:36.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.030+0000 7f70117fa700 1 -- 172.21.15.40:0/2794832240 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700801c420 con 0x7f701409c890 2023-09-30T22:30:36.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.030+0000 7f701af3b700 1 -- 172.21.15.40:0/2794832240 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7008009500 con 0x7f701409c890 2023-09-30T22:30:36.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.030+0000 7f70117fa700 1 -- 172.21.15.40:0/2794832240 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700801c7d0 con 0x7f701409c890 2023-09-30T22:30:36.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.030+0000 7f701af3b700 1 -- 172.21.15.40:0/2794832240 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f701409ecf0 con 0x7f701409c890 2023-09-30T22:30:36.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.031+0000 7f70117fa700 1 -- 172.21.15.40:0/2794832240 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f700801c930 con 0x7f701409c890 2023-09-30T22:30:36.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.032+0000 7f70117fa700 1 -- 172.21.15.40:0/2794832240 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f7008040720 con 0x7f701409c890 2023-09-30T22:30:36.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.032+0000 7f701af3b700 1 -- 172.21.15.40:0/2794832240 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7014062380 con 0x7f701409c890 2023-09-30T22:30:36.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.036+0000 7f70117fa700 1 -- 172.21.15.40:0/2794832240 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7008016080 con 0x7f701409c890 2023-09-30T22:30:36.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.128+0000 7fdd49d22700 1 -- 172.21.15.40:0/2259145632 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdd44132d70 con 0x7fdd4409d920 2023-09-30T22:30:36.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.128+0000 7fdd2bfff700 1 -- 172.21.15.40:0/2259145632 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdd44132d70 con 0x7fdd4409d920 2023-09-30T22:30:36.129 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:36.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.130+0000 7fdd49d22700 1 -- 172.21.15.40:0/2259145632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd4409d920 msgr2=0x7fdd4412eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:36.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.130+0000 7fdd49d22700 1 --2- 172.21.15.40:0/2259145632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd4409d920 0x7fdd4412eba0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fdd34009ba0 tx=0x7fdd34004750 comp rx=0 tx=0).stop 2023-09-30T22:30:36.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.130+0000 7fdd49d22700 1 -- 172.21.15.40:0/2259145632 shutdown_connections 2023-09-30T22:30:36.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.130+0000 7fdd49d22700 1 --2- 172.21.15.40:0/2259145632 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdd44130de0 0x7fdd4412f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.130+0000 7fdd49d22700 1 --2- 172.21.15.40:0/2259145632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd4409d920 0x7fdd4412eba0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.130+0000 7fdd49d22700 1 --2- 172.21.15.40:0/2259145632 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd4409e230 0x7fdd4412f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.130+0000 7fdd49d22700 1 -- 172.21.15.40:0/2259145632 >> 172.21.15.40:0/2259145632 conn(0x7fdd4409fb20 msgr2=0x7fdd4406ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:36.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.130+0000 7fdd49d22700 1 -- 172.21.15.40:0/2259145632 shutdown_connections 2023-09-30T22:30:36.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.130+0000 7fdd49d22700 1 -- 172.21.15.40:0/2259145632 wait complete. 2023-09-30T22:30:36.144 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:36.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.197+0000 7f696827d700 1 -- 172.21.15.40:0/2975044418 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6960074620 con 0x7f696009c890 2023-09-30T22:30:36.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.198+0000 7f6956ffd700 1 -- 172.21.15.40:0/2975044418 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f695c0192c0 con 0x7f696009c890 2023-09-30T22:30:36.199 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:36.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.200+0000 7f696827d700 1 -- 172.21.15.40:0/2975044418 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f696009c890 msgr2=0x7f696006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:36.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.200+0000 7f696827d700 1 --2- 172.21.15.40:0/2975044418 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f696009c890 0x7f696006ee80 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f695c00c550 tx=0x7f695c00c860 comp rx=0 tx=0).stop 2023-09-30T22:30:36.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.200+0000 7f696827d700 1 -- 172.21.15.40:0/2975044418 shutdown_connections 2023-09-30T22:30:36.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.200+0000 7f696827d700 1 --2- 172.21.15.40:0/2975044418 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f696009c890 0x7f696006ee80 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.200+0000 7f696827d700 1 --2- 172.21.15.40:0/2975044418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6960139510 0x7f696006f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.200+0000 7f696827d700 1 --2- 172.21.15.40:0/2975044418 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6960136bf0 0x7f696006f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.200+0000 7f696827d700 1 -- 172.21.15.40:0/2975044418 >> 172.21.15.40:0/2975044418 conn(0x7f69600a7080 msgr2=0x7f69601349d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:36.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.200+0000 7f696827d700 1 -- 172.21.15.40:0/2975044418 shutdown_connections 2023-09-30T22:30:36.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.200+0000 7f696827d700 1 -- 172.21.15.40:0/2975044418 wait complete. 2023-09-30T22:30:36.213 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:36.225 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:36.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.237+0000 7f701af3b700 1 -- 172.21.15.40:0/2794832240 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7014131240 con 0x7f701409c890 2023-09-30T22:30:36.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.238+0000 7f70117fa700 1 -- 172.21.15.40:0/2794832240 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f700802a020 con 0x7f701409c890 2023-09-30T22:30:36.238 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:36.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.239+0000 7f701af3b700 1 -- 172.21.15.40:0/2794832240 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f701409c890 msgr2=0x7f701412d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:36.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.240+0000 7f701af3b700 1 --2- 172.21.15.40:0/2794832240 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f701409c890 0x7f701412d4d0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f7008000c00 tx=0x7f7008004750 comp rx=0 tx=0).stop 2023-09-30T22:30:36.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.240+0000 7f701af3b700 1 -- 172.21.15.40:0/2794832240 shutdown_connections 2023-09-30T22:30:36.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.240+0000 7f701af3b700 1 --2- 172.21.15.40:0/2794832240 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f701409e2b0 0x7f701412df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.240+0000 7f701af3b700 1 --2- 172.21.15.40:0/2794832240 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f701409c890 0x7f701412d4d0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.240+0000 7f701af3b700 1 --2- 172.21.15.40:0/2794832240 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f701409d920 0x7f701412da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.240+0000 7f701af3b700 1 -- 172.21.15.40:0/2794832240 >> 172.21.15.40:0/2794832240 conn(0x7f70140a7080 msgr2=0x7f70140a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:36.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.240+0000 7f701af3b700 1 -- 172.21.15.40:0/2794832240 shutdown_connections 2023-09-30T22:30:36.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.240+0000 7f701af3b700 1 -- 172.21.15.40:0/2794832240 wait complete. 2023-09-30T22:30:36.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:36.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.352+0000 7f5ef0b52700 1 Processor -- start 2023-09-30T22:30:36.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.352+0000 7f5ef0b52700 1 -- start start 2023-09-30T22:30:36.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.353+0000 7f5ef0b52700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5eec136bf0 0x7f5eec138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:36.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.353+0000 7f5ef0b52700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5eec139510 0x7f5eec13b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:36.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.353+0000 7f5ef0b52700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eec0a2600 con 0x7f5eec09c890 2023-09-30T22:30:36.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.353+0000 7f5ef0b52700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eec0a29d0 con 0x7f5eec139510 2023-09-30T22:30:36.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.353+0000 7f5ef0b52700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec09fb40 con 0x7f5eec136bf0 2023-09-30T22:30:36.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.353+0000 7f5ee9d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5eec136bf0 0x7f5eec138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:36.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.353+0000 7f5eead9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5eec139510 0x7f5eec13b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:36.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.353+0000 7f5eead9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5eec139510 0x7f5eec13b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47888/0 (socket says 172.21.15.40:47888) 2023-09-30T22:30:36.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.353+0000 7f5ee9d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5eec136bf0 0x7f5eec138fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:50794/0 (socket says 172.21.15.40:50794) 2023-09-30T22:30:36.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.353+0000 7f5eead9d700 1 -- 172.21.15.40:0/3006229200 learned_addr learned my addr 172.21.15.40:0/3006229200 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:36.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.353+0000 7f5ee9d9b700 1 -- 172.21.15.40:0/3006229200 >> v2:172.21.15.40:3300/0 conn(0x7f5eec139510 msgr2=0x7f5eec13b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:36.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.353+0000 7f5ee9d9b700 1 --2- 172.21.15.40:0/3006229200 >> v2:172.21.15.40:3300/0 conn(0x7f5eec139510 0x7f5eec13b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.353+0000 7f5ee9d9b700 1 -- 172.21.15.40:0/3006229200 >> v1:172.21.15.40:6789/0 conn(0x7f5eec09c890 legacy=0x7f5eec09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:36.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.353+0000 7f5ee9d9b700 1 -- 172.21.15.40:0/3006229200 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eec09d370 con 0x7f5eec136bf0 2023-09-30T22:30:36.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.353+0000 7f5eead9d700 1 --2- 172.21.15.40:0/3006229200 >> v2:172.21.15.40:3300/0 conn(0x7f5eec139510 0x7f5eec13b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:36.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.353+0000 7f5ee9d9b700 1 --2- 172.21.15.40:0/3006229200 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5eec136bf0 0x7f5eec138fd0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f5edc009840 tx=0x7f5edc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ecf5e7c254c7dc0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:36.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.354+0000 7f5ee959a700 1 -- 172.21.15.40:0/3006229200 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc011830 con 0x7f5eec136bf0 2023-09-30T22:30:36.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.354+0000 7f5ee959a700 1 -- 172.21.15.40:0/3006229200 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5edc011990 con 0x7f5eec136bf0 2023-09-30T22:30:36.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.354+0000 7f5ee959a700 1 -- 172.21.15.40:0/3006229200 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc011d20 con 0x7f5eec136bf0 2023-09-30T22:30:36.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.354+0000 7f5ef0b52700 1 -- 172.21.15.40:0/3006229200 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5eec136bf0 msgr2=0x7f5eec138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:36.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.354+0000 7f5ef0b52700 1 --2- 172.21.15.40:0/3006229200 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5eec136bf0 0x7f5eec138fd0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f5edc009840 tx=0x7f5edc009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:36.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.354+0000 7f5ef0b52700 1 -- 172.21.15.40:0/3006229200 shutdown_connections 2023-09-30T22:30:36.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.354+0000 7f5ef0b52700 1 --2- 172.21.15.40:0/3006229200 >> v2:172.21.15.40:3300/0 conn(0x7f5eec139510 0x7f5eec13b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.354+0000 7f5ef0b52700 1 --2- 172.21.15.40:0/3006229200 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5eec136bf0 0x7f5eec138fd0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.354+0000 7f5ef0b52700 1 -- 172.21.15.40:0/3006229200 >> 172.21.15.40:0/3006229200 conn(0x7f5eec0a7080 msgr2=0x7f5eec0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:36.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.354+0000 7f5ef0b52700 1 -- 172.21.15.40:0/3006229200 shutdown_connections 2023-09-30T22:30:36.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.354+0000 7f5ef0b52700 1 -- 172.21.15.40:0/3006229200 wait complete. 2023-09-30T22:30:36.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.355+0000 7f5ef0b52700 1 Processor -- start 2023-09-30T22:30:36.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.355+0000 7f5ef0b52700 1 -- start start 2023-09-30T22:30:36.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.356+0000 7f5ef0b52700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5eec09c890 0x7f5eec1c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:36.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.356+0000 7f5ef0b52700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5eec136bf0 0x7f5eec1c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:36.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.356+0000 7f5ef0b52700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5eec139510 0x7f5eec1c9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:36.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.356+0000 7f5ef0b52700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec070dc0 con 0x7f5eec139510 2023-09-30T22:30:36.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.356+0000 7f5ef0b52700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec0a61a0 con 0x7f5eec136bf0 2023-09-30T22:30:36.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.356+0000 7f5ef0b52700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec12bf10 con 0x7f5eec09c890 2023-09-30T22:30:36.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.356+0000 7f5eead9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5eec139510 0x7f5eec1c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:36.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.356+0000 7f5eea59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5eec09c890 0x7f5eec1c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:36.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.356+0000 7f5eea59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5eec09c890 0x7f5eec1c8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:50804/0 (socket says 172.21.15.40:50804) 2023-09-30T22:30:36.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.356+0000 7f5eead9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5eec139510 0x7f5eec1c9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47898/0 (socket says 172.21.15.40:47898) 2023-09-30T22:30:36.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.356+0000 7f5eea59c700 1 -- 172.21.15.40:0/4276286379 learned_addr learned my addr 172.21.15.40:0/4276286379 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:36.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.356+0000 7f5ee9d9b700 1 --2- 172.21.15.40:0/4276286379 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5eec136bf0 0x7f5eec1c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:36.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.356+0000 7f5eead9d700 1 -- 172.21.15.40:0/4276286379 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5eec09c890 msgr2=0x7f5eec1c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:36.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.356+0000 7f5eead9d700 1 --2- 172.21.15.40:0/4276286379 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5eec09c890 0x7f5eec1c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.356+0000 7f5eead9d700 1 -- 172.21.15.40:0/4276286379 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5eec136bf0 msgr2=0x7f5eec1c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:36.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.356+0000 7f5eead9d700 1 --2- 172.21.15.40:0/4276286379 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5eec136bf0 0x7f5eec1c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.356+0000 7f5eead9d700 1 -- 172.21.15.40:0/4276286379 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee4009b30 con 0x7f5eec139510 2023-09-30T22:30:36.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.356+0000 7f5eea59c700 1 --2- 172.21.15.40:0/4276286379 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5eec09c890 0x7f5eec1c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:36.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.357+0000 7f5eead9d700 1 --2- 172.21.15.40:0/4276286379 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5eec139510 0x7f5eec1c9180 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f5ee400ef90 tx=0x7f5ee400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:36.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.357+0000 7f5edaffd700 1 -- 172.21.15.40:0/4276286379 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4018070 con 0x7f5eec139510 2023-09-30T22:30:36.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.357+0000 7f5edaffd700 1 -- 172.21.15.40:0/4276286379 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee400f040 con 0x7f5eec139510 2023-09-30T22:30:36.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.357+0000 7f5ef0b52700 1 -- 172.21.15.40:0/4276286379 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5edc0094a0 con 0x7f5eec139510 2023-09-30T22:30:36.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.357+0000 7f5edaffd700 1 -- 172.21.15.40:0/4276286379 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4003c60 con 0x7f5eec139510 2023-09-30T22:30:36.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.357+0000 7f5ef0b52700 1 -- 172.21.15.40:0/4276286379 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eec12c910 con 0x7f5eec139510 2023-09-30T22:30:36.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.357+0000 7f5edaffd700 1 -- 172.21.15.40:0/4276286379 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5ee400c880 con 0x7f5eec139510 2023-09-30T22:30:36.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.358+0000 7f5edaffd700 1 -- 172.21.15.40:0/4276286379 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5ee403f710 con 0x7f5eec139510 2023-09-30T22:30:36.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.358+0000 7f5ef0b52700 1 -- 172.21.15.40:0/4276286379 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eec062380 con 0x7f5eec139510 2023-09-30T22:30:36.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.362+0000 7f5edaffd700 1 -- 172.21.15.40:0/4276286379 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5ee4003dc0 con 0x7f5eec139510 2023-09-30T22:30:36.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.555+0000 7f5ef0b52700 1 -- 172.21.15.40:0/4276286379 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5eec09ef90 con 0x7f5eec139510 2023-09-30T22:30:36.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.555+0000 7f5edaffd700 1 -- 172.21.15.40:0/4276286379 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5ee401cb20 con 0x7f5eec139510 2023-09-30T22:30:36.556 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:36.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.557+0000 7f5ef0b52700 1 -- 172.21.15.40:0/4276286379 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5eec139510 msgr2=0x7f5eec1c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:36.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.557+0000 7f5ef0b52700 1 --2- 172.21.15.40:0/4276286379 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5eec139510 0x7f5eec1c9180 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f5ee400ef90 tx=0x7f5ee400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.557+0000 7f5ef0b52700 1 -- 172.21.15.40:0/4276286379 shutdown_connections 2023-09-30T22:30:36.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.557+0000 7f5ef0b52700 1 --2- 172.21.15.40:0/4276286379 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5eec09c890 0x7f5eec1c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.557+0000 7f5ef0b52700 1 --2- 172.21.15.40:0/4276286379 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5eec139510 0x7f5eec1c9180 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.557+0000 7f5ef0b52700 1 --2- 172.21.15.40:0/4276286379 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5eec136bf0 0x7f5eec1c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:36.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.557+0000 7f5ef0b52700 1 -- 172.21.15.40:0/4276286379 >> 172.21.15.40:0/4276286379 conn(0x7f5eec0a7080 msgr2=0x7f5eec136fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:36.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.557+0000 7f5ef0b52700 1 -- 172.21.15.40:0/4276286379 shutdown_connections 2023-09-30T22:30:36.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:36.557+0000 7f5ef0b52700 1 -- 172.21.15.40:0/4276286379 wait complete. 2023-09-30T22:30:36.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:37.145 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:37.213 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:37.254 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:37.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.287+0000 7fc618327700 1 Processor -- start 2023-09-30T22:30:37.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.287+0000 7fc618327700 1 -- start start 2023-09-30T22:30:37.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.287+0000 7fc618327700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc61009d920 0x7fc61009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:37.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.287+0000 7fc618327700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc61009e230 0x7fc6101308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:37.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.288+0000 7fc618327700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc61009adf0 con 0x7fc610130de0 2023-09-30T22:30:37.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.288+0000 7fc618327700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61009edf0 con 0x7fc61009d920 2023-09-30T22:30:37.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.288+0000 7fc618327700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc61009b660 con 0x7fc61009e230 2023-09-30T22:30:37.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.288+0000 7fc6160c3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc61009d920 0x7fc61009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:37.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.288+0000 7fc6168c4700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc610130de0 0x7fc610137d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33628/0 (socket says 172.21.15.40:33628) 2023-09-30T22:30:37.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.288+0000 7fc6168c4700 1 -- 172.21.15.40:0/2644368745 learned_addr learned my addr 172.21.15.40:0/2644368745 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:37.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.288+0000 7fc6158c2700 1 --2- 172.21.15.40:0/2644368745 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc61009e230 0x7fc6101308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:37.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.288+0000 7fc6160c3700 1 -- 172.21.15.40:0/2644368745 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc61009e230 msgr2=0x7fc6101308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:37.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.288+0000 7fc6160c3700 1 --2- 172.21.15.40:0/2644368745 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc61009e230 0x7fc6101308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.288+0000 7fc6160c3700 1 -- 172.21.15.40:0/2644368745 >> v1:172.21.15.40:6789/0 conn(0x7fc610130de0 legacy=0x7fc610137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:37.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.288+0000 7fc6150c1700 1 -- 172.21.15.40:0/2644368745 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 626946336 0 0) 0x7fc61009adf0 con 0x7fc610130de0 2023-09-30T22:30:37.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.288+0000 7fc6160c3700 1 -- 172.21.15.40:0/2644368745 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61009a6e0 con 0x7fc61009d920 2023-09-30T22:30:37.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.288+0000 7fc6158c2700 1 --2- 172.21.15.40:0/2644368745 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc61009e230 0x7fc6101308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:37.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.288+0000 7fc6160c3700 1 --2- 172.21.15.40:0/2644368745 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc61009d920 0x7fc61009dcf0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fc60c009850 tx=0x7fc60c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7840b762e08e6f36 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:37.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.288+0000 7fc6150c1700 1 -- 172.21.15.40:0/2644368745 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c005e30 con 0x7fc61009d920 2023-09-30T22:30:37.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.289+0000 7fc6150c1700 1 -- 172.21.15.40:0/2644368745 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60c010680 con 0x7fc61009d920 2023-09-30T22:30:37.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.289+0000 7fc6150c1700 1 -- 172.21.15.40:0/2644368745 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c010a30 con 0x7fc61009d920 2023-09-30T22:30:37.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.289+0000 7fc618327700 1 -- 172.21.15.40:0/2644368745 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc61009d920 msgr2=0x7fc61009dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:37.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.289+0000 7fc618327700 1 --2- 172.21.15.40:0/2644368745 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc61009d920 0x7fc61009dcf0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fc60c009850 tx=0x7fc60c009b60 comp rx=0 tx=0).stop 2023-09-30T22:30:37.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.290+0000 7fc618327700 1 -- 172.21.15.40:0/2644368745 shutdown_connections 2023-09-30T22:30:37.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.290+0000 7fc618327700 1 --2- 172.21.15.40:0/2644368745 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc61009d920 0x7fc61009dcf0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.290+0000 7fc618327700 1 --2- 172.21.15.40:0/2644368745 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc61009e230 0x7fc6101308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.290+0000 7fc618327700 1 -- 172.21.15.40:0/2644368745 >> 172.21.15.40:0/2644368745 conn(0x7fc61009fb20 msgr2=0x7fc61009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:37.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.290+0000 7fc618327700 1 -- 172.21.15.40:0/2644368745 shutdown_connections 2023-09-30T22:30:37.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.290+0000 7fc618327700 1 -- 172.21.15.40:0/2644368745 wait complete. 2023-09-30T22:30:37.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.291+0000 7fc618327700 1 Processor -- start 2023-09-30T22:30:37.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.291+0000 7fc618327700 1 -- start start 2023-09-30T22:30:37.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.292+0000 7fc618327700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc61009d920 0x7fc61011b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:37.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.292+0000 7fc618327700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc61009e230 0x7fc61011b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:37.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.292+0000 7fc618327700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc610130de0 0x7fc6101c3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:37.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.292+0000 7fc618327700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61012f370 con 0x7fc610130de0 2023-09-30T22:30:37.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.292+0000 7fc618327700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61011aea0 con 0x7fc61009d920 2023-09-30T22:30:37.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.292+0000 7fc618327700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc61011e220 con 0x7fc61009e230 2023-09-30T22:30:37.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.292+0000 7fc6158c2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc61009e230 0x7fc61011b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:37.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.292+0000 7fc6160c3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc61009d920 0x7fc61011b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:37.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.292+0000 7fc6158c2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc61009e230 0x7fc61011b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:50822/0 (socket says 172.21.15.40:50822) 2023-09-30T22:30:37.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.292+0000 7fc6158c2700 1 -- 172.21.15.40:0/2746553011 learned_addr learned my addr 172.21.15.40:0/2746553011 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:37.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.292+0000 7fc6160c3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc61009d920 0x7fc61011b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:47802/0 (socket says 172.21.15.40:47802) 2023-09-30T22:30:37.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.292+0000 7fc6168c4700 1 --2- 172.21.15.40:0/2746553011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc610130de0 0x7fc6101c3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:37.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.292+0000 7fc6158c2700 1 -- 172.21.15.40:0/2746553011 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc61009d920 msgr2=0x7fc61011b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:37.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.292+0000 7fc6158c2700 1 --2- 172.21.15.40:0/2746553011 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc61009d920 0x7fc61011b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.292+0000 7fc6158c2700 1 -- 172.21.15.40:0/2746553011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc610130de0 msgr2=0x7fc6101c3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:37.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.292+0000 7fc6158c2700 1 --2- 172.21.15.40:0/2746553011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc610130de0 0x7fc6101c3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.292+0000 7fc6158c2700 1 -- 172.21.15.40:0/2746553011 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6000094a0 con 0x7fc61009e230 2023-09-30T22:30:37.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.293+0000 7fc6158c2700 1 --2- 172.21.15.40:0/2746553011 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc61009e230 0x7fc61011b880 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fc60000ebe0 tx=0x7fc60000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:37.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.293+0000 7fc606ffd700 1 -- 172.21.15.40:0/2746553011 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60000c850 con 0x7fc61009e230 2023-09-30T22:30:37.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.293+0000 7fc606ffd700 1 -- 172.21.15.40:0/2746553011 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60000c9b0 con 0x7fc61009e230 2023-09-30T22:30:37.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.293+0000 7fc618327700 1 -- 172.21.15.40:0/2746553011 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc60c009430 con 0x7fc61009e230 2023-09-30T22:30:37.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.293+0000 7fc606ffd700 1 -- 172.21.15.40:0/2746553011 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60000cd40 con 0x7fc61009e230 2023-09-30T22:30:37.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.293+0000 7fc618327700 1 -- 172.21.15.40:0/2746553011 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc61011bdc0 con 0x7fc61009e230 2023-09-30T22:30:37.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.294+0000 7fc606ffd700 1 -- 172.21.15.40:0/2746553011 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc600013470 con 0x7fc61009e230 2023-09-30T22:30:37.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.294+0000 7fc606ffd700 1 -- 172.21.15.40:0/2746553011 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc60003f810 con 0x7fc61009e230 2023-09-30T22:30:37.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.294+0000 7fc618327700 1 -- 172.21.15.40:0/2746553011 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc610062380 con 0x7fc61009e230 2023-09-30T22:30:37.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.299+0000 7fc606ffd700 1 -- 172.21.15.40:0/2746553011 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc600013720 con 0x7fc61009e230 2023-09-30T22:30:37.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.349+0000 7f40bb3c5700 1 Processor -- start 2023-09-30T22:30:37.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.349+0000 7f40bb3c5700 1 -- start start 2023-09-30T22:30:37.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.350+0000 7f40bb3c5700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f40b4136bf0 0x7f40b4138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:37.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.350+0000 7f40bb3c5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40b4139510 0x7f40b413b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:37.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.350+0000 7f40bb3c5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40b40a2600 con 0x7f40b409c890 2023-09-30T22:30:37.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.350+0000 7f40bb3c5700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b40a29d0 con 0x7f40b4136bf0 2023-09-30T22:30:37.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.350+0000 7f40bb3c5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b409fb40 con 0x7f40b4139510 2023-09-30T22:30:37.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.350+0000 7f40b9962700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40b4139510 0x7f40b413b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:37.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.350+0000 7f40b8960700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f40b4136bf0 0x7f40b4138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:37.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.350+0000 7f40b9962700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40b4139510 0x7f40b413b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:47818/0 (socket says 172.21.15.40:47818) 2023-09-30T22:30:37.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.350+0000 7f40b9161700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f40b409c890 0x7f40b409cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33640/0 (socket says 172.21.15.40:33640) 2023-09-30T22:30:37.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.350+0000 7f40b9962700 1 -- 172.21.15.40:0/2068661529 learned_addr learned my addr 172.21.15.40:0/2068661529 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:37.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.350+0000 7f40b8960700 1 -- 172.21.15.40:0/2068661529 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40b4139510 msgr2=0x7f40b413b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:37.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.350+0000 7f40b8960700 1 --2- 172.21.15.40:0/2068661529 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40b4139510 0x7f40b413b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.350+0000 7f40b8960700 1 -- 172.21.15.40:0/2068661529 >> v1:172.21.15.40:6789/0 conn(0x7f40b409c890 legacy=0x7f40b409cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:37.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.350+0000 7f40b8960700 1 -- 172.21.15.40:0/2068661529 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b409d370 con 0x7f40b4136bf0 2023-09-30T22:30:37.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.350+0000 7f40abfff700 1 -- 172.21.15.40:0/2068661529 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2622586346 0 0) 0x7f40b40a2600 con 0x7f40b409c890 2023-09-30T22:30:37.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.351+0000 7f40b8960700 1 --2- 172.21.15.40:0/2068661529 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40b4136bf0 0x7f40b4138fd0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f40a4009840 tx=0x7f40a4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b5d472944624339 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:37.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.351+0000 7f40abfff700 1 -- 172.21.15.40:0/2068661529 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a4011830 con 0x7f40b4136bf0 2023-09-30T22:30:37.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.351+0000 7f40abfff700 1 -- 172.21.15.40:0/2068661529 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a4011990 con 0x7f40b4136bf0 2023-09-30T22:30:37.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.351+0000 7f40abfff700 1 -- 172.21.15.40:0/2068661529 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a4011d20 con 0x7f40b4136bf0 2023-09-30T22:30:37.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.351+0000 7f40bb3c5700 1 -- 172.21.15.40:0/2068661529 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40b4136bf0 msgr2=0x7f40b4138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:37.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.351+0000 7f40bb3c5700 1 --2- 172.21.15.40:0/2068661529 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40b4136bf0 0x7f40b4138fd0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f40a4009840 tx=0x7f40a4009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:37.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.351+0000 7f40bb3c5700 1 -- 172.21.15.40:0/2068661529 shutdown_connections 2023-09-30T22:30:37.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.351+0000 7f40bb3c5700 1 --2- 172.21.15.40:0/2068661529 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40b4139510 0x7f40b413b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.351+0000 7f40bb3c5700 1 --2- 172.21.15.40:0/2068661529 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40b4136bf0 0x7f40b4138fd0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.351+0000 7f40bb3c5700 1 -- 172.21.15.40:0/2068661529 >> 172.21.15.40:0/2068661529 conn(0x7f40b40a7080 msgr2=0x7f40b40a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:37.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.352+0000 7f40bb3c5700 1 -- 172.21.15.40:0/2068661529 shutdown_connections 2023-09-30T22:30:37.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.352+0000 7f40bb3c5700 1 -- 172.21.15.40:0/2068661529 wait complete. 2023-09-30T22:30:37.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.353+0000 7f40bb3c5700 1 Processor -- start 2023-09-30T22:30:37.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.353+0000 7f40bb3c5700 1 -- start start 2023-09-30T22:30:37.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.353+0000 7f40bb3c5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40b409c890 0x7f40b409b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:37.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.353+0000 7f40bb3c5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f40b4136bf0 0x7f40b409bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:37.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.353+0000 7f40bb3c5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40b4139510 0x7f40b406eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:37.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.353+0000 7f40bb3c5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b40717f0 con 0x7f40b409c890 2023-09-30T22:30:37.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.353+0000 7f40bb3c5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b4070a80 con 0x7f40b4139510 2023-09-30T22:30:37.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.353+0000 7f40bb3c5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40b409ecf0 con 0x7f40b4136bf0 2023-09-30T22:30:37.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.353+0000 7f40b8960700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f40b4136bf0 0x7f40b409bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:37.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.353+0000 7f40b9161700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40b409c890 0x7f40b409b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:37.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.353+0000 7f40b8960700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f40b4136bf0 0x7f40b409bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:50826/0 (socket says 172.21.15.40:50826) 2023-09-30T22:30:37.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.353+0000 7f40b8960700 1 -- 172.21.15.40:0/1810925328 learned_addr learned my addr 172.21.15.40:0/1810925328 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:37.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.353+0000 7f40b9962700 1 --2- 172.21.15.40:0/1810925328 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40b4139510 0x7f40b406eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:37.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.353+0000 7f40b8960700 1 -- 172.21.15.40:0/1810925328 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40b4139510 msgr2=0x7f40b406eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:37.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.354+0000 7f40b8960700 1 --2- 172.21.15.40:0/1810925328 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40b4139510 0x7f40b406eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.354+0000 7f40b8960700 1 -- 172.21.15.40:0/1810925328 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40b409c890 msgr2=0x7f40b409b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:37.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.354+0000 7f40b8960700 1 --2- 172.21.15.40:0/1810925328 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40b409c890 0x7f40b409b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.354+0000 7f40b8960700 1 -- 172.21.15.40:0/1810925328 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a40094a0 con 0x7f40b4136bf0 2023-09-30T22:30:37.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.354+0000 7f40b9161700 1 --2- 172.21.15.40:0/1810925328 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40b409c890 0x7f40b409b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:37.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.354+0000 7f40b9962700 1 --2- 172.21.15.40:0/1810925328 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40b4139510 0x7f40b406eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:37.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.354+0000 7f40b8960700 1 --2- 172.21.15.40:0/1810925328 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f40b4136bf0 0x7f40b409bd30 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f40a40090b0 tx=0x7f40a4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:37.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.354+0000 7f40a9ffb700 1 -- 172.21.15.40:0/1810925328 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a4004480 con 0x7f40b4136bf0 2023-09-30T22:30:37.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.354+0000 7f40a9ffb700 1 -- 172.21.15.40:0/1810925328 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a401f070 con 0x7f40b4136bf0 2023-09-30T22:30:37.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.354+0000 7f40a9ffb700 1 -- 172.21.15.40:0/1810925328 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a40038c0 con 0x7f40b4136bf0 2023-09-30T22:30:37.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.355+0000 7f40bb3c5700 1 -- 172.21.15.40:0/1810925328 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40b412ba90 con 0x7f40b4136bf0 2023-09-30T22:30:37.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.355+0000 7f40bb3c5700 1 -- 172.21.15.40:0/1810925328 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b412b4e0 con 0x7f40b4136bf0 2023-09-30T22:30:37.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.355+0000 7f40a9ffb700 1 -- 172.21.15.40:0/1810925328 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f40a4021030 con 0x7f40b4136bf0 2023-09-30T22:30:37.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.356+0000 7f40a9ffb700 1 -- 172.21.15.40:0/1810925328 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f40a4040a20 con 0x7f40b4136bf0 2023-09-30T22:30:37.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.356+0000 7f40bb3c5700 1 -- 172.21.15.40:0/1810925328 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40b4062380 con 0x7f40b4136bf0 2023-09-30T22:30:37.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.361+0000 7f40a9ffb700 1 -- 172.21.15.40:0/1810925328 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f40a4015080 con 0x7f40b4136bf0 2023-09-30T22:30:37.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.390+0000 7f1482efc700 1 Processor -- start 2023-09-30T22:30:37.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.390+0000 7f1482efc700 1 -- start start 2023-09-30T22:30:37.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.391+0000 7f1482efc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f147c09d920 0x7f147c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:37.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.391+0000 7f1482efc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f147c09f0f0 0x7f147c09e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:37.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.391+0000 7f1482efc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f147c133ca0 0x7f147c134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:37.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.391+0000 7f1482efc700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f147c06b4c0 con 0x7f147c133ca0 2023-09-30T22:30:37.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.391+0000 7f1482efc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147c09a8f0 con 0x7f147c09d920 2023-09-30T22:30:37.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.391+0000 7f1482efc700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f147c09f940 con 0x7f147c09f0f0 2023-09-30T22:30:37.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.391+0000 7f1480c98700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f147c09d920 0x7f147c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:37.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.391+0000 7f1481499700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f147c133ca0 0x7f147c134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:37.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.391+0000 7f1480c98700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f147c09d920 0x7f147c09dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:47830/0 (socket says 172.21.15.40:47830) 2023-09-30T22:30:37.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.391+0000 7f1481499700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f147c133ca0 0x7f147c134140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47936/0 (socket says 172.21.15.40:47936) 2023-09-30T22:30:37.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.391+0000 7f1480c98700 1 -- 172.21.15.40:0/486853308 learned_addr learned my addr 172.21.15.40:0/486853308 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:37.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.391+0000 7f147bfff700 1 --2- 172.21.15.40:0/486853308 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f147c09f0f0 0x7f147c09e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:37.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.391+0000 7f1481499700 1 -- 172.21.15.40:0/486853308 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f147c09f0f0 msgr2=0x7f147c09e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:37.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.391+0000 7f1481499700 1 --2- 172.21.15.40:0/486853308 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f147c09f0f0 0x7f147c09e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.391+0000 7f1481499700 1 -- 172.21.15.40:0/486853308 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f147c09d920 msgr2=0x7f147c09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:37.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.391+0000 7f1481499700 1 --2- 172.21.15.40:0/486853308 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f147c09d920 0x7f147c09dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.391+0000 7f1481499700 1 -- 172.21.15.40:0/486853308 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147c09f6e0 con 0x7f147c133ca0 2023-09-30T22:30:37.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.391+0000 7f1480c98700 1 --2- 172.21.15.40:0/486853308 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f147c09d920 0x7f147c09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:37.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.391+0000 7f1481499700 1 --2- 172.21.15.40:0/486853308 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f147c133ca0 0x7f147c134140 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f1474009dc0 tx=0x7f147400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e9e2d1beacf1136 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:37.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.392+0000 7f147b7fe700 1 -- 172.21.15.40:0/486853308 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147400e070 con 0x7f147c133ca0 2023-09-30T22:30:37.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.392+0000 7f147b7fe700 1 -- 172.21.15.40:0/486853308 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147400bae0 con 0x7f147c133ca0 2023-09-30T22:30:37.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.392+0000 7f147b7fe700 1 -- 172.21.15.40:0/486853308 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147400be90 con 0x7f147c133ca0 2023-09-30T22:30:37.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.392+0000 7f1482efc700 1 -- 172.21.15.40:0/486853308 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f147c133ca0 msgr2=0x7f147c134140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:37.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.392+0000 7f1482efc700 1 --2- 172.21.15.40:0/486853308 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f147c133ca0 0x7f147c134140 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f1474009dc0 tx=0x7f147400b330 comp rx=0 tx=0).stop 2023-09-30T22:30:37.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.392+0000 7f1482efc700 1 -- 172.21.15.40:0/486853308 shutdown_connections 2023-09-30T22:30:37.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.392+0000 7f1482efc700 1 --2- 172.21.15.40:0/486853308 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f147c133ca0 0x7f147c134140 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.392+0000 7f1482efc700 1 --2- 172.21.15.40:0/486853308 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f147c09d920 0x7f147c09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.392+0000 7f1482efc700 1 --2- 172.21.15.40:0/486853308 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f147c09f0f0 0x7f147c09e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.392+0000 7f1482efc700 1 -- 172.21.15.40:0/486853308 >> 172.21.15.40:0/486853308 conn(0x7f147c09fb20 msgr2=0x7f147c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:37.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.392+0000 7f1482efc700 1 -- 172.21.15.40:0/486853308 shutdown_connections 2023-09-30T22:30:37.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.392+0000 7f1482efc700 1 -- 172.21.15.40:0/486853308 wait complete. 2023-09-30T22:30:37.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.393+0000 7f1482efc700 1 Processor -- start 2023-09-30T22:30:37.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.393+0000 7f1482efc700 1 -- start start 2023-09-30T22:30:37.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.394+0000 7f1482efc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f147c09d920 0x7f147c121840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:37.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.394+0000 7f1482efc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f147c133ca0 0x7f147c121d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:37.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.394+0000 7f1482efc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f147c1222c0 0x7f147c1c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:37.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.394+0000 7f1482efc700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c125360 con 0x7f147c133ca0 2023-09-30T22:30:37.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.394+0000 7f1482efc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147c122ca0 con 0x7f147c09d920 2023-09-30T22:30:37.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.394+0000 7f1482efc700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f147c09c9e0 con 0x7f147c1222c0 2023-09-30T22:30:37.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.394+0000 7f1480c98700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f147c09d920 0x7f147c121840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:37.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.394+0000 7f1480c98700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f147c09d920 0x7f147c121840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:47844/0 (socket says 172.21.15.40:47844) 2023-09-30T22:30:37.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.394+0000 7f1480c98700 1 -- 172.21.15.40:0/1782816366 learned_addr learned my addr 172.21.15.40:0/1782816366 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:37.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.394+0000 7f147bfff700 1 --2- 172.21.15.40:0/1782816366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f147c133ca0 0x7f147c121d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:37.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.394+0000 7f1481499700 1 --2- 172.21.15.40:0/1782816366 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f147c1222c0 0x7f147c1c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:37.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.394+0000 7f1480c98700 1 -- 172.21.15.40:0/1782816366 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f147c1222c0 msgr2=0x7f147c1c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:37.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.394+0000 7f1480c98700 1 --2- 172.21.15.40:0/1782816366 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f147c1222c0 0x7f147c1c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.394+0000 7f1480c98700 1 -- 172.21.15.40:0/1782816366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f147c133ca0 msgr2=0x7f147c121d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:37.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.394+0000 7f1480c98700 1 --2- 172.21.15.40:0/1782816366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f147c133ca0 0x7f147c121d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.394+0000 7f1480c98700 1 -- 172.21.15.40:0/1782816366 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1470009500 con 0x7f147c09d920 2023-09-30T22:30:37.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.394+0000 7f147bfff700 1 --2- 172.21.15.40:0/1782816366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f147c133ca0 0x7f147c121d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:37.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.395+0000 7f1480c98700 1 --2- 172.21.15.40:0/1782816366 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f147c09d920 0x7f147c121840 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f147000ebe0 tx=0x7f147000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:37.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.395+0000 7f14797fa700 1 -- 172.21.15.40:0/1782816366 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1470009790 con 0x7f147c09d920 2023-09-30T22:30:37.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.395+0000 7f14797fa700 1 -- 172.21.15.40:0/1782816366 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1470005a20 con 0x7f147c09d920 2023-09-30T22:30:37.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.395+0000 7f1482efc700 1 -- 172.21.15.40:0/1782816366 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1474009a70 con 0x7f147c09d920 2023-09-30T22:30:37.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.395+0000 7f14797fa700 1 -- 172.21.15.40:0/1782816366 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1470005db0 con 0x7f147c09d920 2023-09-30T22:30:37.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.395+0000 7f1482efc700 1 -- 172.21.15.40:0/1782816366 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147c0a2ad0 con 0x7f147c09d920 2023-09-30T22:30:37.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.395+0000 7f14797fa700 1 -- 172.21.15.40:0/1782816366 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f147000c850 con 0x7f147c09d920 2023-09-30T22:30:37.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.396+0000 7f14797fa700 1 -- 172.21.15.40:0/1782816366 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f147003fa30 con 0x7f147c09d920 2023-09-30T22:30:37.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.396+0000 7f1482efc700 1 -- 172.21.15.40:0/1782816366 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f147c124f00 con 0x7f147c09d920 2023-09-30T22:30:37.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.401+0000 7f14797fa700 1 -- 172.21.15.40:0/1782816366 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1470020080 con 0x7f147c09d920 2023-09-30T22:30:37.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.501+0000 7fc618327700 1 -- 172.21.15.40:0/2746553011 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc61011cde0 con 0x7fc61009e230 2023-09-30T22:30:37.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.501+0000 7fc606ffd700 1 -- 172.21.15.40:0/2746553011 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc60001b3b0 con 0x7fc61009e230 2023-09-30T22:30:37.502 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:37.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.503+0000 7fc618327700 1 -- 172.21.15.40:0/2746553011 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc61009e230 msgr2=0x7fc61011b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:37.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.503+0000 7fc618327700 1 --2- 172.21.15.40:0/2746553011 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc61009e230 0x7fc61011b880 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fc60000ebe0 tx=0x7fc60000eef0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.504+0000 7fc618327700 1 -- 172.21.15.40:0/2746553011 shutdown_connections 2023-09-30T22:30:37.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.504+0000 7fc618327700 1 --2- 172.21.15.40:0/2746553011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc610130de0 0x7fc6101c3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.504+0000 7fc618327700 1 --2- 172.21.15.40:0/2746553011 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc61009d920 0x7fc61011b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.504+0000 7fc618327700 1 --2- 172.21.15.40:0/2746553011 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc61009e230 0x7fc61011b880 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.504+0000 7fc618327700 1 -- 172.21.15.40:0/2746553011 >> 172.21.15.40:0/2746553011 conn(0x7fc61009fb20 msgr2=0x7fc61012f990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:37.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.504+0000 7fc618327700 1 -- 172.21.15.40:0/2746553011 shutdown_connections 2023-09-30T22:30:37.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.504+0000 7fc618327700 1 -- 172.21.15.40:0/2746553011 wait complete. 2023-09-30T22:30:37.517 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:37.571 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:37.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.579+0000 7f40bb3c5700 1 -- 172.21.15.40:0/1810925328 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f40b4074620 con 0x7f40b4136bf0 2023-09-30T22:30:37.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.579+0000 7f40a9ffb700 1 -- 172.21.15.40:0/1810925328 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f40a4003a20 con 0x7f40b4136bf0 2023-09-30T22:30:37.580 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:37.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.581+0000 7f40bb3c5700 1 -- 172.21.15.40:0/1810925328 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f40b4136bf0 msgr2=0x7f40b409bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:37.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.581+0000 7f40bb3c5700 1 --2- 172.21.15.40:0/1810925328 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f40b4136bf0 0x7f40b409bd30 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f40a40090b0 tx=0x7f40a4004750 comp rx=0 tx=0).stop 2023-09-30T22:30:37.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.582+0000 7f40bb3c5700 1 -- 172.21.15.40:0/1810925328 shutdown_connections 2023-09-30T22:30:37.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.582+0000 7f40bb3c5700 1 --2- 172.21.15.40:0/1810925328 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40b4139510 0x7f40b406eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.582+0000 7f40bb3c5700 1 --2- 172.21.15.40:0/1810925328 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40b409c890 0x7f40b409b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.582+0000 7f40bb3c5700 1 --2- 172.21.15.40:0/1810925328 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f40b4136bf0 0x7f40b409bd30 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.582+0000 7f40bb3c5700 1 -- 172.21.15.40:0/1810925328 >> 172.21.15.40:0/1810925328 conn(0x7f40b40a7080 msgr2=0x7f40b4136fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:37.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.582+0000 7f40bb3c5700 1 -- 172.21.15.40:0/1810925328 shutdown_connections 2023-09-30T22:30:37.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.582+0000 7f40bb3c5700 1 -- 172.21.15.40:0/1810925328 wait complete. 2023-09-30T22:30:37.596 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:37.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.616+0000 7f1482efc700 1 -- 172.21.15.40:0/1782816366 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f147c062380 con 0x7f147c09d920 2023-09-30T22:30:37.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.616+0000 7f14797fa700 1 -- 172.21.15.40:0/1782816366 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1470006030 con 0x7f147c09d920 2023-09-30T22:30:37.617 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:37.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.618+0000 7f1482efc700 1 -- 172.21.15.40:0/1782816366 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f147c09d920 msgr2=0x7f147c121840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:37.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.618+0000 7f1482efc700 1 --2- 172.21.15.40:0/1782816366 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f147c09d920 0x7f147c121840 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f147000ebe0 tx=0x7f147000eef0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.619+0000 7f1482efc700 1 -- 172.21.15.40:0/1782816366 shutdown_connections 2023-09-30T22:30:37.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.619+0000 7f1482efc700 1 --2- 172.21.15.40:0/1782816366 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f147c1222c0 0x7f147c1c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.619+0000 7f1482efc700 1 --2- 172.21.15.40:0/1782816366 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f147c09d920 0x7f147c121840 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.619+0000 7f1482efc700 1 --2- 172.21.15.40:0/1782816366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f147c133ca0 0x7f147c121d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.619+0000 7f1482efc700 1 -- 172.21.15.40:0/1782816366 >> 172.21.15.40:0/1782816366 conn(0x7f147c09fb20 msgr2=0x7f147c0a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:37.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.619+0000 7f1482efc700 1 -- 172.21.15.40:0/1782816366 shutdown_connections 2023-09-30T22:30:37.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.619+0000 7f1482efc700 1 -- 172.21.15.40:0/1782816366 wait complete. 2023-09-30T22:30:37.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:37.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.698+0000 7ff7851bf700 1 Processor -- start 2023-09-30T22:30:37.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.698+0000 7ff7851bf700 1 -- start start 2023-09-30T22:30:37.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.699+0000 7ff7851bf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff78009c890 0x7ff78009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:37.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.699+0000 7ff7851bf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff78009d920 0x7ff78009dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:37.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.699+0000 7ff7851bf700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7800a2600 con 0x7ff78009e2b0 2023-09-30T22:30:37.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.699+0000 7ff7851bf700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7800a29d0 con 0x7ff78009d920 2023-09-30T22:30:37.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.699+0000 7ff7851bf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff78009fb40 con 0x7ff78009c890 2023-09-30T22:30:37.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.699+0000 7ff77ed9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff78009c890 0x7ff78009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:37.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.699+0000 7ff77e59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff78009d920 0x7ff78009dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:37.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.699+0000 7ff77ed9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff78009c890 0x7ff78009cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:47858/0 (socket says 172.21.15.40:47858) 2023-09-30T22:30:37.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.699+0000 7ff77e59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff78009d920 0x7ff78009dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47954/0 (socket says 172.21.15.40:47954) 2023-09-30T22:30:37.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.699+0000 7ff77ed9d700 1 -- 172.21.15.40:0/1824578165 learned_addr learned my addr 172.21.15.40:0/1824578165 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:37.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.699+0000 7ff77ed9d700 1 -- 172.21.15.40:0/1824578165 >> v2:172.21.15.40:3300/0 conn(0x7ff78009d920 msgr2=0x7ff78009dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:37.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.699+0000 7ff77ed9d700 1 --2- 172.21.15.40:0/1824578165 >> v2:172.21.15.40:3300/0 conn(0x7ff78009d920 0x7ff78009dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.699+0000 7ff77ed9d700 1 -- 172.21.15.40:0/1824578165 >> v1:172.21.15.40:6789/0 conn(0x7ff78009e2b0 legacy=0x7ff78013ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:37.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.699+0000 7ff77ed9d700 1 -- 172.21.15.40:0/1824578165 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78009e750 con 0x7ff78009c890 2023-09-30T22:30:37.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.699+0000 7ff77e59c700 1 --2- 172.21.15.40:0/1824578165 >> v2:172.21.15.40:3300/0 conn(0x7ff78009d920 0x7ff78009dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:37.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.699+0000 7ff77ed9d700 1 --2- 172.21.15.40:0/1824578165 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff78009c890 0x7ff78009cc60 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7ff770006fd0 tx=0x7ff770009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cf0709b8721d770 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:37.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.700+0000 7ff77dd9b700 1 -- 172.21.15.40:0/1824578165 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff770005e30 con 0x7ff78009c890 2023-09-30T22:30:37.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.700+0000 7ff77dd9b700 1 -- 172.21.15.40:0/1824578165 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff770004030 con 0x7ff78009c890 2023-09-30T22:30:37.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.700+0000 7ff77dd9b700 1 -- 172.21.15.40:0/1824578165 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7700043e0 con 0x7ff78009c890 2023-09-30T22:30:37.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.700+0000 7ff7851bf700 1 -- 172.21.15.40:0/1824578165 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff78009c890 msgr2=0x7ff78009cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:37.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.700+0000 7ff7851bf700 1 --2- 172.21.15.40:0/1824578165 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff78009c890 0x7ff78009cc60 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7ff770006fd0 tx=0x7ff770009bd0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.700+0000 7ff7851bf700 1 -- 172.21.15.40:0/1824578165 shutdown_connections 2023-09-30T22:30:37.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.700+0000 7ff7851bf700 1 --2- 172.21.15.40:0/1824578165 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff78009c890 0x7ff78009cc60 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.700+0000 7ff7851bf700 1 --2- 172.21.15.40:0/1824578165 >> v2:172.21.15.40:3300/0 conn(0x7ff78009d920 0x7ff78009dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.700+0000 7ff7851bf700 1 -- 172.21.15.40:0/1824578165 >> 172.21.15.40:0/1824578165 conn(0x7ff7800a7080 msgr2=0x7ff7800a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:37.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.700+0000 7ff7851bf700 1 -- 172.21.15.40:0/1824578165 shutdown_connections 2023-09-30T22:30:37.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.700+0000 7ff7851bf700 1 -- 172.21.15.40:0/1824578165 wait complete. 2023-09-30T22:30:37.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.701+0000 7ff7851bf700 1 Processor -- start 2023-09-30T22:30:37.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.701+0000 7ff7851bf700 1 -- start start 2023-09-30T22:30:37.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.702+0000 7ff7851bf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff78009c890 0x7ff7801c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:37.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.702+0000 7ff7851bf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff78009d920 0x7ff7801c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:37.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.702+0000 7ff7851bf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff78009e2b0 0x7ff7801c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:37.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.702+0000 7ff7851bf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78012faf0 con 0x7ff78009c890 2023-09-30T22:30:37.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.702+0000 7ff7851bf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff78012f580 con 0x7ff78009e2b0 2023-09-30T22:30:37.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.702+0000 7ff7851bf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7800a5d00 con 0x7ff78009d920 2023-09-30T22:30:37.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.702+0000 7ff77ed9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff78009c890 0x7ff7801c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:37.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.702+0000 7ff77f59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff78009e2b0 0x7ff7801c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:37.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.702+0000 7ff77ed9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff78009c890 0x7ff7801c89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47970/0 (socket says 172.21.15.40:47970) 2023-09-30T22:30:37.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.702+0000 7ff77ed9d700 1 -- 172.21.15.40:0/2078831886 learned_addr learned my addr 172.21.15.40:0/2078831886 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:37.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.702+0000 7ff77e59c700 1 --2- 172.21.15.40:0/2078831886 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff78009d920 0x7ff7801c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:37.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.702+0000 7ff77ed9d700 1 -- 172.21.15.40:0/2078831886 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff78009d920 msgr2=0x7ff7801c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:37.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.702+0000 7ff77ed9d700 1 --2- 172.21.15.40:0/2078831886 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff78009d920 0x7ff7801c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.702+0000 7ff77ed9d700 1 -- 172.21.15.40:0/2078831886 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff78009e2b0 msgr2=0x7ff7801c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:37.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.702+0000 7ff77ed9d700 1 --2- 172.21.15.40:0/2078831886 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff78009e2b0 0x7ff7801c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.702+0000 7ff77ed9d700 1 -- 172.21.15.40:0/2078831886 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7680094a0 con 0x7ff78009c890 2023-09-30T22:30:37.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.702+0000 7ff77f59e700 1 --2- 172.21.15.40:0/2078831886 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff78009e2b0 0x7ff7801c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:37.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.702+0000 7ff77ed9d700 1 --2- 172.21.15.40:0/2078831886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff78009c890 0x7ff7801c89e0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7ff770009c10 tx=0x7ff770004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:37.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.703+0000 7ff7777fe700 1 -- 172.21.15.40:0/2078831886 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77001c420 con 0x7ff78009c890 2023-09-30T22:30:37.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.703+0000 7ff7777fe700 1 -- 172.21.15.40:0/2078831886 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77001c5a0 con 0x7ff78009c890 2023-09-30T22:30:37.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.703+0000 7ff7851bf700 1 -- 172.21.15.40:0/2078831886 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff770009500 con 0x7ff78009c890 2023-09-30T22:30:37.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.703+0000 7ff7777fe700 1 -- 172.21.15.40:0/2078831886 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77001c950 con 0x7ff78009c890 2023-09-30T22:30:37.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.703+0000 7ff7851bf700 1 -- 172.21.15.40:0/2078831886 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff780130d80 con 0x7ff78009c890 2023-09-30T22:30:37.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.703+0000 7ff7777fe700 1 -- 172.21.15.40:0/2078831886 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff77001cab0 con 0x7ff78009c890 2023-09-30T22:30:37.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.704+0000 7ff7777fe700 1 -- 172.21.15.40:0/2078831886 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff7700407a0 con 0x7ff78009c890 2023-09-30T22:30:37.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.704+0000 7ff7851bf700 1 -- 172.21.15.40:0/2078831886 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff78009ecf0 con 0x7ff78009c890 2023-09-30T22:30:37.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.708+0000 7ff7777fe700 1 -- 172.21.15.40:0/2078831886 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff78009ecf0 con 0x7ff78009c890 2023-09-30T22:30:37.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.903+0000 7ff7851bf700 1 -- 172.21.15.40:0/2078831886 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff78009ecf0 con 0x7ff78009c890 2023-09-30T22:30:37.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.903+0000 7ff7777fe700 1 -- 172.21.15.40:0/2078831886 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff78009ecf0 con 0x7ff78009c890 2023-09-30T22:30:37.904 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:37.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.905+0000 7ff7851bf700 1 -- 172.21.15.40:0/2078831886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff78009c890 msgr2=0x7ff7801c89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:37.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.905+0000 7ff7851bf700 1 --2- 172.21.15.40:0/2078831886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff78009c890 0x7ff7801c89e0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7ff770009c10 tx=0x7ff770004750 comp rx=0 tx=0).stop 2023-09-30T22:30:37.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.906+0000 7ff7851bf700 1 -- 172.21.15.40:0/2078831886 shutdown_connections 2023-09-30T22:30:37.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.906+0000 7ff7851bf700 1 --2- 172.21.15.40:0/2078831886 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff78009e2b0 0x7ff7801c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.906+0000 7ff7851bf700 1 --2- 172.21.15.40:0/2078831886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff78009c890 0x7ff7801c89e0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.906+0000 7ff7851bf700 1 --2- 172.21.15.40:0/2078831886 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff78009d920 0x7ff7801c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:37.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.906+0000 7ff7851bf700 1 -- 172.21.15.40:0/2078831886 >> 172.21.15.40:0/2078831886 conn(0x7ff7800a7080 msgr2=0x7ff7800a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:37.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.906+0000 7ff7851bf700 1 -- 172.21.15.40:0/2078831886 shutdown_connections 2023-09-30T22:30:37.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:37.906+0000 7ff7851bf700 1 -- 172.21.15.40:0/2078831886 wait complete. 2023-09-30T22:30:37.919 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:38.518 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:38.596 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:38.633 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:38.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.660+0000 7f02613a1700 1 Processor -- start 2023-09-30T22:30:38.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.660+0000 7f02613a1700 1 -- start start 2023-09-30T22:30:38.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.660+0000 7f02613a1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f025c09d8b0 0x7f025c09dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.660+0000 7f02613a1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f025c09e1c0 0x7f025c130770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.660+0000 7f02613a1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f025c130cb0 0x7f025c131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.660+0000 7f02613a1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f025c09f2f0 con 0x7f025c09d8b0 2023-09-30T22:30:38.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.660+0000 7f02613a1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f025c09b160 con 0x7f025c130cb0 2023-09-30T22:30:38.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.660+0000 7f02613a1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f025c09ab30 con 0x7f025c09e1c0 2023-09-30T22:30:38.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.660+0000 7f025b7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f025c09e1c0 0x7f025c130770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.660+0000 7f025b7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f025c09e1c0 0x7f025c130770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:50878/0 (socket says 172.21.15.40:50878) 2023-09-30T22:30:38.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.660+0000 7f025b7fe700 1 -- 172.21.15.40:0/3880338921 learned_addr learned my addr 172.21.15.40:0/3880338921 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:38.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.660+0000 7f025bfff700 1 --2- 172.21.15.40:0/3880338921 >> v2:172.21.15.40:3300/0 conn(0x7f025c09d8b0 0x7f025c09dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.660+0000 7f0260ba0700 1 --2- 172.21.15.40:0/3880338921 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f025c130cb0 0x7f025c131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.661+0000 7f025bfff700 1 -- 172.21.15.40:0/3880338921 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f025c09e1c0 msgr2=0x7f025c130770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:38.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.661+0000 7f025bfff700 1 --2- 172.21.15.40:0/3880338921 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f025c09e1c0 0x7f025c130770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.661+0000 7f025bfff700 1 -- 172.21.15.40:0/3880338921 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f025c130cb0 msgr2=0x7f025c131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:38.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.661+0000 7f025bfff700 1 --2- 172.21.15.40:0/3880338921 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f025c130cb0 0x7f025c131130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.661+0000 7f025bfff700 1 -- 172.21.15.40:0/3880338921 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025c09c700 con 0x7f025c09d8b0 2023-09-30T22:30:38.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.661+0000 7f025b7fe700 1 --2- 172.21.15.40:0/3880338921 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f025c09e1c0 0x7f025c130770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:38.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.661+0000 7f025bfff700 1 --2- 172.21.15.40:0/3880338921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f025c09d8b0 0x7f025c09dc80 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f024c009840 tx=0x7f024c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b98a9b128f6e165b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:38.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.661+0000 7f025affd700 1 -- 172.21.15.40:0/3880338921 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c011830 con 0x7f025c09d8b0 2023-09-30T22:30:38.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.661+0000 7f025affd700 1 -- 172.21.15.40:0/3880338921 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024c011990 con 0x7f025c09d8b0 2023-09-30T22:30:38.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.661+0000 7f025affd700 1 -- 172.21.15.40:0/3880338921 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c011d20 con 0x7f025c09d8b0 2023-09-30T22:30:38.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.662+0000 7f02613a1700 1 -- 172.21.15.40:0/3880338921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f025c09d8b0 msgr2=0x7f025c09dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:38.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.662+0000 7f02613a1700 1 --2- 172.21.15.40:0/3880338921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f025c09d8b0 0x7f025c09dc80 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f024c009840 tx=0x7f024c009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:38.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.662+0000 7f02613a1700 1 -- 172.21.15.40:0/3880338921 shutdown_connections 2023-09-30T22:30:38.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.662+0000 7f02613a1700 1 --2- 172.21.15.40:0/3880338921 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f025c130cb0 0x7f025c131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.662+0000 7f02613a1700 1 --2- 172.21.15.40:0/3880338921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f025c09d8b0 0x7f025c09dc80 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.662+0000 7f02613a1700 1 --2- 172.21.15.40:0/3880338921 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f025c09e1c0 0x7f025c130770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.662+0000 7f02613a1700 1 -- 172.21.15.40:0/3880338921 >> 172.21.15.40:0/3880338921 conn(0x7f025c0a2fb0 msgr2=0x7f025c0a33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:38.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.662+0000 7f02613a1700 1 -- 172.21.15.40:0/3880338921 shutdown_connections 2023-09-30T22:30:38.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.662+0000 7f02613a1700 1 -- 172.21.15.40:0/3880338921 wait complete. 2023-09-30T22:30:38.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.663+0000 7f02613a1700 1 Processor -- start 2023-09-30T22:30:38.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.664+0000 7f02613a1700 1 -- start start 2023-09-30T22:30:38.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.664+0000 7f02613a1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f025c09d8b0 0x7f025c11ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.664+0000 7f02613a1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f025c09e1c0 0x7f025c11b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.664+0000 7f02613a1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f025c130cb0 0x7f025c11b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.664+0000 7f02613a1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025c11c320 con 0x7f025c130cb0 2023-09-30T22:30:38.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.664+0000 7f02613a1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f025c11ca80 con 0x7f025c09e1c0 2023-09-30T22:30:38.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.664+0000 7f02613a1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f025c11dcd0 con 0x7f025c09d8b0 2023-09-30T22:30:38.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.664+0000 7f025bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f025c09d8b0 0x7f025c11ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.664+0000 7f0260ba0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f025c130cb0 0x7f025c11b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.664+0000 7f025bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f025c09d8b0 0x7f025c11ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:50882/0 (socket says 172.21.15.40:50882) 2023-09-30T22:30:38.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.664+0000 7f0260ba0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f025c130cb0 0x7f025c11b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47982/0 (socket says 172.21.15.40:47982) 2023-09-30T22:30:38.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.664+0000 7f025bfff700 1 -- 172.21.15.40:0/106639914 learned_addr learned my addr 172.21.15.40:0/106639914 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:38.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.664+0000 7f025b7fe700 1 --2- 172.21.15.40:0/106639914 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f025c09e1c0 0x7f025c11b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.665+0000 7f025bfff700 1 -- 172.21.15.40:0/106639914 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f025c09e1c0 msgr2=0x7f025c11b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:38.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.665+0000 7f025bfff700 1 --2- 172.21.15.40:0/106639914 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f025c09e1c0 0x7f025c11b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.665+0000 7f025bfff700 1 -- 172.21.15.40:0/106639914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f025c130cb0 msgr2=0x7f025c11b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:38.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.665+0000 7f025bfff700 1 --2- 172.21.15.40:0/106639914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f025c130cb0 0x7f025c11b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.665+0000 7f025bfff700 1 -- 172.21.15.40:0/106639914 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0250009550 con 0x7f025c09d8b0 2023-09-30T22:30:38.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.665+0000 7f025b7fe700 1 --2- 172.21.15.40:0/106639914 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f025c09e1c0 0x7f025c11b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:38.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.665+0000 7f0260ba0700 1 --2- 172.21.15.40:0/106639914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f025c130cb0 0x7f025c11b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:38.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.665+0000 7f025bfff700 1 --2- 172.21.15.40:0/106639914 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f025c09d8b0 0x7f025c11ae70 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f024c000c00 tx=0x7f024c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:38.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.665+0000 7f0258ff9700 1 -- 172.21.15.40:0/106639914 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c004450 con 0x7f025c09d8b0 2023-09-30T22:30:38.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.665+0000 7f0258ff9700 1 -- 172.21.15.40:0/106639914 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024c0045b0 con 0x7f025c09d8b0 2023-09-30T22:30:38.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.665+0000 7f02613a1700 1 -- 172.21.15.40:0/106639914 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f024c0094a0 con 0x7f025c09d8b0 2023-09-30T22:30:38.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.665+0000 7f0258ff9700 1 -- 172.21.15.40:0/106639914 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c01da00 con 0x7f025c09d8b0 2023-09-30T22:30:38.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.665+0000 7f02613a1700 1 -- 172.21.15.40:0/106639914 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f025c11e120 con 0x7f025c09d8b0 2023-09-30T22:30:38.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.666+0000 7f0258ff9700 1 -- 172.21.15.40:0/106639914 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f024c01db60 con 0x7f025c09d8b0 2023-09-30T22:30:38.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.666+0000 7f0258ff9700 1 -- 172.21.15.40:0/106639914 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f024c044910 con 0x7f025c09d8b0 2023-09-30T22:30:38.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.667+0000 7f02613a1700 1 -- 172.21.15.40:0/106639914 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f025c0a0580 con 0x7f025c09d8b0 2023-09-30T22:30:38.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.672+0000 7f0258ff9700 1 -- 172.21.15.40:0/106639914 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f024c0036a0 con 0x7f025c09d8b0 2023-09-30T22:30:38.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.733+0000 7ff43184b700 1 Processor -- start 2023-09-30T22:30:38.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.733+0000 7ff43184b700 1 -- start start 2023-09-30T22:30:38.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.734+0000 7ff43184b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff42c09c890 0x7ff42c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.734+0000 7ff43184b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff42c09d920 0x7ff42c09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.734+0000 7ff43184b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff42c0a2600 con 0x7ff42c09e2b0 2023-09-30T22:30:38.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.734+0000 7ff43184b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff42c0a29d0 con 0x7ff42c09c890 2023-09-30T22:30:38.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.734+0000 7ff43184b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c09fb40 con 0x7ff42c09d920 2023-09-30T22:30:38.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.734+0000 7ff42a7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff42c09d920 0x7ff42c09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.734+0000 7ff42a7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff42c09d920 0x7ff42c09dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:47904/0 (socket says 172.21.15.40:47904) 2023-09-30T22:30:38.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.734+0000 7ff42affd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff42c09c890 0x7ff42c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.734+0000 7ff42a7fc700 1 -- 172.21.15.40:0/624594207 learned_addr learned my addr 172.21.15.40:0/624594207 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:38.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.734+0000 7ff42affd700 1 -- 172.21.15.40:0/624594207 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff42c09d920 msgr2=0x7ff42c09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:38.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.734+0000 7ff42affd700 1 --2- 172.21.15.40:0/624594207 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff42c09d920 0x7ff42c09dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.734+0000 7ff42affd700 1 -- 172.21.15.40:0/624594207 >> v1:172.21.15.40:6789/0 conn(0x7ff42c09e2b0 legacy=0x7ff42c13ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:38.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.734+0000 7ff42affd700 1 -- 172.21.15.40:0/624594207 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42c09e730 con 0x7ff42c09c890 2023-09-30T22:30:38.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.734+0000 7ff42a7fc700 1 --2- 172.21.15.40:0/624594207 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff42c09d920 0x7ff42c09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:38.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.734+0000 7ff42affd700 1 --2- 172.21.15.40:0/624594207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff42c09c890 0x7ff42c09cc60 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7ff41c009820 tx=0x7ff41c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=897694506a2e6951 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:38.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.735+0000 7ff429ffb700 1 -- 172.21.15.40:0/624594207 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c005e30 con 0x7ff42c09c890 2023-09-30T22:30:38.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.735+0000 7ff429ffb700 1 -- 172.21.15.40:0/624594207 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41c006030 con 0x7ff42c09c890 2023-09-30T22:30:38.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.735+0000 7ff429ffb700 1 -- 172.21.15.40:0/624594207 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c0063c0 con 0x7ff42c09c890 2023-09-30T22:30:38.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.735+0000 7ff43184b700 1 -- 172.21.15.40:0/624594207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff42c09c890 msgr2=0x7ff42c09cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:38.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.735+0000 7ff43184b700 1 --2- 172.21.15.40:0/624594207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff42c09c890 0x7ff42c09cc60 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7ff41c009820 tx=0x7ff41c009b30 comp rx=0 tx=0).stop 2023-09-30T22:30:38.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.735+0000 7ff43184b700 1 -- 172.21.15.40:0/624594207 shutdown_connections 2023-09-30T22:30:38.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.735+0000 7ff43184b700 1 --2- 172.21.15.40:0/624594207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff42c09c890 0x7ff42c09cc60 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.735+0000 7ff43184b700 1 --2- 172.21.15.40:0/624594207 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff42c09d920 0x7ff42c09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.735+0000 7ff43184b700 1 -- 172.21.15.40:0/624594207 >> 172.21.15.40:0/624594207 conn(0x7ff42c0a7080 msgr2=0x7ff42c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:38.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.735+0000 7ff43184b700 1 -- 172.21.15.40:0/624594207 shutdown_connections 2023-09-30T22:30:38.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.735+0000 7ff43184b700 1 -- 172.21.15.40:0/624594207 wait complete. 2023-09-30T22:30:38.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.736+0000 7ff43184b700 1 Processor -- start 2023-09-30T22:30:38.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.737+0000 7ff43184b700 1 -- start start 2023-09-30T22:30:38.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.737+0000 7ff43184b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff42c09c890 0x7ff42c1c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.737+0000 7ff43184b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff42c09d920 0x7ff42c1c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.737+0000 7ff43184b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff42c09e2b0 0x7ff42c12d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.737+0000 7ff43184b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c09bdc0 con 0x7ff42c09d920 2023-09-30T22:30:38.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.737+0000 7ff43184b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c12f170 con 0x7ff42c09c890 2023-09-30T22:30:38.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.737+0000 7ff43184b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c0a5cb0 con 0x7ff42c09e2b0 2023-09-30T22:30:38.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.737+0000 7ff42a7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff42c09d920 0x7ff42c1c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.737+0000 7ff42a7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff42c09d920 0x7ff42c1c9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47996/0 (socket says 172.21.15.40:47996) 2023-09-30T22:30:38.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.737+0000 7ff42a7fc700 1 -- 172.21.15.40:0/3146778787 learned_addr learned my addr 172.21.15.40:0/3146778787 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:38.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.737+0000 7ff42affd700 1 --2- 172.21.15.40:0/3146778787 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff42c09c890 0x7ff42c1c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.737+0000 7ff42b7fe700 1 --2- 172.21.15.40:0/3146778787 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff42c09e2b0 0x7ff42c12d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.737+0000 7ff42a7fc700 1 -- 172.21.15.40:0/3146778787 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff42c09e2b0 msgr2=0x7ff42c12d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:38.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.737+0000 7ff42a7fc700 1 --2- 172.21.15.40:0/3146778787 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff42c09e2b0 0x7ff42c12d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.737+0000 7ff42a7fc700 1 -- 172.21.15.40:0/3146778787 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff42c09c890 msgr2=0x7ff42c1c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:38.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.738+0000 7ff42a7fc700 1 --2- 172.21.15.40:0/3146778787 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff42c09c890 0x7ff42c1c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.738+0000 7ff42a7fc700 1 -- 172.21.15.40:0/3146778787 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff420009550 con 0x7ff42c09d920 2023-09-30T22:30:38.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.738+0000 7ff42affd700 1 --2- 172.21.15.40:0/3146778787 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff42c09c890 0x7ff42c1c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:38.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.738+0000 7ff42a7fc700 1 --2- 172.21.15.40:0/3146778787 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff42c09d920 0x7ff42c1c9190 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7ff42000ebe0 tx=0x7ff42000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:38.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.738+0000 7ff413fff700 1 -- 172.21.15.40:0/3146778787 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42000c850 con 0x7ff42c09d920 2023-09-30T22:30:38.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.738+0000 7ff413fff700 1 -- 172.21.15.40:0/3146778787 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42000c9b0 con 0x7ff42c09d920 2023-09-30T22:30:38.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.738+0000 7ff43184b700 1 -- 172.21.15.40:0/3146778787 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff41c009430 con 0x7ff42c09d920 2023-09-30T22:30:38.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.738+0000 7ff413fff700 1 -- 172.21.15.40:0/3146778787 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42000cd40 con 0x7ff42c09d920 2023-09-30T22:30:38.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.738+0000 7ff43184b700 1 -- 172.21.15.40:0/3146778787 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff42c12f850 con 0x7ff42c09d920 2023-09-30T22:30:38.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.739+0000 7ff413fff700 1 -- 172.21.15.40:0/3146778787 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff420013470 con 0x7ff42c09d920 2023-09-30T22:30:38.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.739+0000 7ff43184b700 1 -- 172.21.15.40:0/3146778787 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff42c062380 con 0x7ff42c09d920 2023-09-30T22:30:38.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.739+0000 7ff413fff700 1 -- 172.21.15.40:0/3146778787 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff42003fc50 con 0x7ff42c09d920 2023-09-30T22:30:38.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.744+0000 7ff413fff700 1 -- 172.21.15.40:0/3146778787 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff42001b3b0 con 0x7ff42c09d920 2023-09-30T22:30:38.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.772+0000 7f45ea354700 1 Processor -- start 2023-09-30T22:30:38.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.772+0000 7f45ea354700 1 -- start start 2023-09-30T22:30:38.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.773+0000 7f45ea354700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f45e409fbb0 0x7f45e406c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.773+0000 7f45ea354700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45e406ced0 0x7f45e406d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.773+0000 7f45ea354700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f45e4138370 0x7f45e413a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.773+0000 7f45ea354700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e409ff80 con 0x7f45e4138370 2023-09-30T22:30:38.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.773+0000 7f45ea354700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e406ec40 con 0x7f45e406ced0 2023-09-30T22:30:38.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.773+0000 7f45ea354700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45e406f510 con 0x7f45e409fbb0 2023-09-30T22:30:38.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.773+0000 7f45e3fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f45e409fbb0 0x7f45e406c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.773+0000 7f45e88f1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f45e4138370 0x7f45e413a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.773+0000 7f45e88f1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f45e4138370 0x7f45e413a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48012/0 (socket says 172.21.15.40:48012) 2023-09-30T22:30:38.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.773+0000 7f45e3fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f45e409fbb0 0x7f45e406c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:50896/0 (socket says 172.21.15.40:50896) 2023-09-30T22:30:38.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.773+0000 7f45e88f1700 1 -- 172.21.15.40:0/1199706775 learned_addr learned my addr 172.21.15.40:0/1199706775 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:38.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.773+0000 7f45e37fe700 1 --2- 172.21.15.40:0/1199706775 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45e406ced0 0x7f45e406d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.773+0000 7f45e88f1700 1 -- 172.21.15.40:0/1199706775 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f45e409fbb0 msgr2=0x7f45e406c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:38.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.773+0000 7f45e88f1700 1 --2- 172.21.15.40:0/1199706775 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f45e409fbb0 0x7f45e406c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.773+0000 7f45e88f1700 1 -- 172.21.15.40:0/1199706775 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45e406ced0 msgr2=0x7f45e406d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:38.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.773+0000 7f45e88f1700 1 --2- 172.21.15.40:0/1199706775 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45e406ced0 0x7f45e406d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.773+0000 7f45e88f1700 1 -- 172.21.15.40:0/1199706775 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e406e3f0 con 0x7f45e4138370 2023-09-30T22:30:38.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.773+0000 7f45e3fff700 1 --2- 172.21.15.40:0/1199706775 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f45e409fbb0 0x7f45e406c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:38.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.773+0000 7f45e37fe700 1 --2- 172.21.15.40:0/1199706775 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45e406ced0 0x7f45e406d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:38.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.774+0000 7f45e88f1700 1 --2- 172.21.15.40:0/1199706775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45e4138370 0x7f45e413a750 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f45dc009eb0 tx=0x7f45dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5180f09e0a67c1df server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:38.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.774+0000 7f45e2ffd700 1 -- 172.21.15.40:0/1199706775 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc00e070 con 0x7f45e4138370 2023-09-30T22:30:38.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.774+0000 7f45e2ffd700 1 -- 172.21.15.40:0/1199706775 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45dc00b890 con 0x7f45e4138370 2023-09-30T22:30:38.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.774+0000 7f45e2ffd700 1 -- 172.21.15.40:0/1199706775 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc00bc40 con 0x7f45e4138370 2023-09-30T22:30:38.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.774+0000 7f45ea354700 1 -- 172.21.15.40:0/1199706775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45e4138370 msgr2=0x7f45e413a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:38.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.774+0000 7f45ea354700 1 --2- 172.21.15.40:0/1199706775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45e4138370 0x7f45e413a750 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f45dc009eb0 tx=0x7f45dc00b330 comp rx=0 tx=0).stop 2023-09-30T22:30:38.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.774+0000 7f45ea354700 1 -- 172.21.15.40:0/1199706775 shutdown_connections 2023-09-30T22:30:38.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.774+0000 7f45ea354700 1 --2- 172.21.15.40:0/1199706775 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f45e409fbb0 0x7f45e406c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.774+0000 7f45ea354700 1 --2- 172.21.15.40:0/1199706775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45e4138370 0x7f45e413a750 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.774+0000 7f45ea354700 1 --2- 172.21.15.40:0/1199706775 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45e406ced0 0x7f45e406d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.774+0000 7f45ea354700 1 -- 172.21.15.40:0/1199706775 >> 172.21.15.40:0/1199706775 conn(0x7f45e40a41a0 msgr2=0x7f45e40a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:38.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.774+0000 7f45ea354700 1 -- 172.21.15.40:0/1199706775 shutdown_connections 2023-09-30T22:30:38.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.775+0000 7f45ea354700 1 -- 172.21.15.40:0/1199706775 wait complete. 2023-09-30T22:30:38.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.775+0000 7f45ea354700 1 Processor -- start 2023-09-30T22:30:38.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.776+0000 7f45ea354700 1 -- start start 2023-09-30T22:30:38.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.776+0000 7f45ea354700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f45e406ced0 0x7f45e41377c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.776+0000 7f45ea354700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45e409fbb0 0x7f45e4137d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.776+0000 7f45ea354700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45e4138370 0x7f45e4095990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:38.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.776+0000 7f45ea354700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e4094880 con 0x7f45e409fbb0 2023-09-30T22:30:38.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.776+0000 7f45ea354700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e4096a40 con 0x7f45e4138370 2023-09-30T22:30:38.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.776+0000 7f45ea354700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45e4094ad0 con 0x7f45e406ced0 2023-09-30T22:30:38.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.776+0000 7f45e37fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45e409fbb0 0x7f45e4137d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.776+0000 7f45e37fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45e409fbb0 0x7f45e4137d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48016/0 (socket says 172.21.15.40:48016) 2023-09-30T22:30:38.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.776+0000 7f45e37fe700 1 -- 172.21.15.40:0/1212406521 learned_addr learned my addr 172.21.15.40:0/1212406521 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:38.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.776+0000 7f45e88f1700 1 --2- 172.21.15.40:0/1212406521 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45e4138370 0x7f45e4095990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.776+0000 7f45e3fff700 1 --2- 172.21.15.40:0/1212406521 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f45e406ced0 0x7f45e41377c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:38.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.776+0000 7f45e37fe700 1 -- 172.21.15.40:0/1212406521 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f45e406ced0 msgr2=0x7f45e41377c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:38.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.776+0000 7f45e37fe700 1 --2- 172.21.15.40:0/1212406521 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f45e406ced0 0x7f45e41377c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.776+0000 7f45e37fe700 1 -- 172.21.15.40:0/1212406521 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45e4138370 msgr2=0x7f45e4095990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:38.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.777+0000 7f45e37fe700 1 --2- 172.21.15.40:0/1212406521 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45e4138370 0x7f45e4095990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.777+0000 7f45e37fe700 1 -- 172.21.15.40:0/1212406521 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d80094a0 con 0x7f45e409fbb0 2023-09-30T22:30:38.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.777+0000 7f45e88f1700 1 --2- 172.21.15.40:0/1212406521 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45e4138370 0x7f45e4095990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:38.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.777+0000 7f45e37fe700 1 --2- 172.21.15.40:0/1212406521 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45e409fbb0 0x7f45e4137d00 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f45d800ebe0 tx=0x7f45d800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:38.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.777+0000 7f45e0ff9700 1 -- 172.21.15.40:0/1212406521 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d800c850 con 0x7f45e409fbb0 2023-09-30T22:30:38.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.777+0000 7f45e0ff9700 1 -- 172.21.15.40:0/1212406521 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d800c9b0 con 0x7f45e409fbb0 2023-09-30T22:30:38.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.777+0000 7f45ea354700 1 -- 172.21.15.40:0/1212406521 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d40094a0 con 0x7f45e409fbb0 2023-09-30T22:30:38.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.777+0000 7f45e0ff9700 1 -- 172.21.15.40:0/1212406521 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d800cd40 con 0x7f45e409fbb0 2023-09-30T22:30:38.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.777+0000 7f45ea354700 1 -- 172.21.15.40:0/1212406521 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45dc009b30 con 0x7f45e409fbb0 2023-09-30T22:30:38.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.778+0000 7f45e0ff9700 1 -- 172.21.15.40:0/1212406521 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f45d8013470 con 0x7f45e409fbb0 2023-09-30T22:30:38.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.778+0000 7f45e0ff9700 1 -- 172.21.15.40:0/1212406521 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f45d803fb60 con 0x7f45e409fbb0 2023-09-30T22:30:38.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.778+0000 7f45ea354700 1 -- 172.21.15.40:0/1212406521 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e4062380 con 0x7f45e409fbb0 2023-09-30T22:30:38.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.783+0000 7f45e0ff9700 1 -- 172.21.15.40:0/1212406521 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f45d8013720 con 0x7f45e409fbb0 2023-09-30T22:30:38.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.872+0000 7f02613a1700 1 -- 172.21.15.40:0/106639914 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f025c070530 con 0x7f025c09d8b0 2023-09-30T22:30:38.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.873+0000 7f0258ff9700 1 -- 172.21.15.40:0/106639914 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f024c015020 con 0x7f025c09d8b0 2023-09-30T22:30:38.874 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:38.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.875+0000 7f02613a1700 1 -- 172.21.15.40:0/106639914 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f025c09d8b0 msgr2=0x7f025c11ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:38.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.875+0000 7f02613a1700 1 --2- 172.21.15.40:0/106639914 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f025c09d8b0 0x7f025c11ae70 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f024c000c00 tx=0x7f024c004750 comp rx=0 tx=0).stop 2023-09-30T22:30:38.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.875+0000 7f02613a1700 1 -- 172.21.15.40:0/106639914 shutdown_connections 2023-09-30T22:30:38.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.875+0000 7f02613a1700 1 --2- 172.21.15.40:0/106639914 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f025c09d8b0 0x7f025c11ae70 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.875+0000 7f02613a1700 1 --2- 172.21.15.40:0/106639914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f025c130cb0 0x7f025c11b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.875+0000 7f02613a1700 1 --2- 172.21.15.40:0/106639914 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f025c09e1c0 0x7f025c11b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.875+0000 7f02613a1700 1 -- 172.21.15.40:0/106639914 >> 172.21.15.40:0/106639914 conn(0x7f025c0a2fb0 msgr2=0x7f025c12de10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:38.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.875+0000 7f02613a1700 1 -- 172.21.15.40:0/106639914 shutdown_connections 2023-09-30T22:30:38.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.875+0000 7f02613a1700 1 -- 172.21.15.40:0/106639914 wait complete. 2023-09-30T22:30:38.888 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:38.919 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:38.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.947+0000 7ff43184b700 1 -- 172.21.15.40:0/3146778787 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff42c0a5790 con 0x7ff42c09d920 2023-09-30T22:30:38.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.947+0000 7ff413fff700 1 -- 172.21.15.40:0/3146778787 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff420011ca0 con 0x7ff42c09d920 2023-09-30T22:30:38.948 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:38.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.950+0000 7ff43184b700 1 -- 172.21.15.40:0/3146778787 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff42c09d920 msgr2=0x7ff42c1c9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:38.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.950+0000 7ff43184b700 1 --2- 172.21.15.40:0/3146778787 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff42c09d920 0x7ff42c1c9190 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7ff42000ebe0 tx=0x7ff42000eef0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.950+0000 7ff43184b700 1 -- 172.21.15.40:0/3146778787 shutdown_connections 2023-09-30T22:30:38.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.950+0000 7ff43184b700 1 --2- 172.21.15.40:0/3146778787 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff42c09e2b0 0x7ff42c12d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.950+0000 7ff43184b700 1 --2- 172.21.15.40:0/3146778787 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff42c09c890 0x7ff42c1c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.950+0000 7ff43184b700 1 --2- 172.21.15.40:0/3146778787 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff42c09d920 0x7ff42c1c9190 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.950+0000 7ff43184b700 1 -- 172.21.15.40:0/3146778787 >> 172.21.15.40:0/3146778787 conn(0x7ff42c0a7080 msgr2=0x7ff42c0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:38.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.950+0000 7ff43184b700 1 -- 172.21.15.40:0/3146778787 shutdown_connections 2023-09-30T22:30:38.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.950+0000 7ff43184b700 1 -- 172.21.15.40:0/3146778787 wait complete. 2023-09-30T22:30:38.963 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:38.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.985+0000 7f45ea354700 1 -- 172.21.15.40:0/1212406521 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f45e4093420 con 0x7f45e409fbb0 2023-09-30T22:30:38.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.985+0000 7f45e0ff9700 1 -- 172.21.15.40:0/1212406521 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f45d8021020 con 0x7f45e409fbb0 2023-09-30T22:30:38.986 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:38.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.987+0000 7f45ea354700 1 -- 172.21.15.40:0/1212406521 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45e409fbb0 msgr2=0x7f45e4137d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:38.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.987+0000 7f45ea354700 1 --2- 172.21.15.40:0/1212406521 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45e409fbb0 0x7f45e4137d00 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f45d800ebe0 tx=0x7f45d800eef0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.987+0000 7f45ea354700 1 -- 172.21.15.40:0/1212406521 shutdown_connections 2023-09-30T22:30:38.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.987+0000 7f45ea354700 1 --2- 172.21.15.40:0/1212406521 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f45e406ced0 0x7f45e41377c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.987+0000 7f45ea354700 1 --2- 172.21.15.40:0/1212406521 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45e4138370 0x7f45e4095990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.987+0000 7f45ea354700 1 --2- 172.21.15.40:0/1212406521 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45e409fbb0 0x7f45e4137d00 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:38.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.987+0000 7f45ea354700 1 -- 172.21.15.40:0/1212406521 >> 172.21.15.40:0/1212406521 conn(0x7f45e40a41a0 msgr2=0x7f45e40a20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:38.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.988+0000 7f45ea354700 1 -- 172.21.15.40:0/1212406521 shutdown_connections 2023-09-30T22:30:38.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:38.988+0000 7f45ea354700 1 -- 172.21.15.40:0/1212406521 wait complete. 2023-09-30T22:30:39.000 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:39.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.056+0000 7f3700038700 1 Processor -- start 2023-09-30T22:30:39.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.057+0000 7f3700038700 1 -- start start 2023-09-30T22:30:39.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.057+0000 7f3700038700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f36f8136bf0 0x7f36f8138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:39.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.057+0000 7f3700038700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36f8139510 0x7f36f813b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:39.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.057+0000 7f3700038700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f80a2600 con 0x7f36f809c890 2023-09-30T22:30:39.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.057+0000 7f3700038700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f80a29d0 con 0x7f36f8136bf0 2023-09-30T22:30:39.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.057+0000 7f3700038700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f809fb40 con 0x7f36f8139510 2023-09-30T22:30:39.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.057+0000 7f36fd5d3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f36f8136bf0 0x7f36f8138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:39.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.057+0000 7f36fe5d5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36f8139510 0x7f36f813b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:39.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.057+0000 7f36fd5d3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f36f8136bf0 0x7f36f8138fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48032/0 (socket says 172.21.15.40:48032) 2023-09-30T22:30:39.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.057+0000 7f36fe5d5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36f8139510 0x7f36f813b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:47942/0 (socket says 172.21.15.40:47942) 2023-09-30T22:30:39.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.057+0000 7f36fd5d3700 1 -- 172.21.15.40:0/3331101770 learned_addr learned my addr 172.21.15.40:0/3331101770 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:39.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.058+0000 7f36fd5d3700 1 -- 172.21.15.40:0/3331101770 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36f8139510 msgr2=0x7f36f813b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:39.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.058+0000 7f36fd5d3700 1 --2- 172.21.15.40:0/3331101770 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36f8139510 0x7f36f813b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.058+0000 7f36fd5d3700 1 -- 172.21.15.40:0/3331101770 >> v1:172.21.15.40:6789/0 conn(0x7f36f809c890 legacy=0x7f36f809cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:39.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.058+0000 7f36fd5d3700 1 -- 172.21.15.40:0/3331101770 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f809d370 con 0x7f36f8136bf0 2023-09-30T22:30:39.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.058+0000 7f36fcdd2700 1 -- 172.21.15.40:0/3331101770 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 707362191 0 0) 0x7f36f80a2600 con 0x7f36f809c890 2023-09-30T22:30:39.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.058+0000 7f36fe5d5700 1 --2- 172.21.15.40:0/3331101770 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36f8139510 0x7f36f813b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:39.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.058+0000 7f36fd5d3700 1 --2- 172.21.15.40:0/3331101770 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36f8136bf0 0x7f36f8138fd0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f36e80098f0 tx=0x7f36e8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47cb967c6edc85bb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:39.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.058+0000 7f36fcdd2700 1 -- 172.21.15.40:0/3331101770 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e8011830 con 0x7f36f8136bf0 2023-09-30T22:30:39.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.058+0000 7f36fcdd2700 1 -- 172.21.15.40:0/3331101770 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e8011990 con 0x7f36f8136bf0 2023-09-30T22:30:39.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.058+0000 7f36fcdd2700 1 -- 172.21.15.40:0/3331101770 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e8011d20 con 0x7f36f8136bf0 2023-09-30T22:30:39.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.058+0000 7f3700038700 1 -- 172.21.15.40:0/3331101770 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36f8136bf0 msgr2=0x7f36f8138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:39.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.058+0000 7f3700038700 1 --2- 172.21.15.40:0/3331101770 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36f8136bf0 0x7f36f8138fd0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f36e80098f0 tx=0x7f36e8009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:39.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.058+0000 7f3700038700 1 -- 172.21.15.40:0/3331101770 shutdown_connections 2023-09-30T22:30:39.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.059+0000 7f3700038700 1 --2- 172.21.15.40:0/3331101770 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36f8139510 0x7f36f813b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.059+0000 7f3700038700 1 --2- 172.21.15.40:0/3331101770 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36f8136bf0 0x7f36f8138fd0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.059+0000 7f3700038700 1 -- 172.21.15.40:0/3331101770 >> 172.21.15.40:0/3331101770 conn(0x7f36f80a7080 msgr2=0x7f36f80a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:39.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.059+0000 7f3700038700 1 -- 172.21.15.40:0/3331101770 shutdown_connections 2023-09-30T22:30:39.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.059+0000 7f3700038700 1 -- 172.21.15.40:0/3331101770 wait complete. 2023-09-30T22:30:39.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.059+0000 7f3700038700 1 Processor -- start 2023-09-30T22:30:39.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.060+0000 7f3700038700 1 -- start start 2023-09-30T22:30:39.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.060+0000 7f3700038700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36f809c890 0x7f36f806f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:39.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.060+0000 7f3700038700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36f8136bf0 0x7f36f806ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:39.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.060+0000 7f3700038700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36f8139510 0x7f36f81c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:39.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.060+0000 7f3700038700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f812bc20 con 0x7f36f8139510 2023-09-30T22:30:39.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.060+0000 7f3700038700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f8070c70 con 0x7f36f809c890 2023-09-30T22:30:39.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.060+0000 7f3700038700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36f8139070 con 0x7f36f8136bf0 2023-09-30T22:30:39.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.060+0000 7f36fe5d5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36f8139510 0x7f36f81c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:39.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.060+0000 7f36fddd4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36f809c890 0x7f36f806f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:39.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.060+0000 7f36fe5d5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36f8139510 0x7f36f81c8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48042/0 (socket says 172.21.15.40:48042) 2023-09-30T22:30:39.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.060+0000 7f36fe5d5700 1 -- 172.21.15.40:0/600327374 learned_addr learned my addr 172.21.15.40:0/600327374 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:39.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.060+0000 7f36fd5d3700 1 --2- 172.21.15.40:0/600327374 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36f8136bf0 0x7f36f806ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:39.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.060+0000 7f36fe5d5700 1 -- 172.21.15.40:0/600327374 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36f8136bf0 msgr2=0x7f36f806ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:39.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.060+0000 7f36fe5d5700 1 --2- 172.21.15.40:0/600327374 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36f8136bf0 0x7f36f806ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.060+0000 7f36fe5d5700 1 -- 172.21.15.40:0/600327374 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36f809c890 msgr2=0x7f36f806f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:39.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.060+0000 7f36fe5d5700 1 --2- 172.21.15.40:0/600327374 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36f809c890 0x7f36f806f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.060+0000 7f36fe5d5700 1 -- 172.21.15.40:0/600327374 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f0009a70 con 0x7f36f8139510 2023-09-30T22:30:39.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.060+0000 7f36fddd4700 1 --2- 172.21.15.40:0/600327374 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36f809c890 0x7f36f806f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:39.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.060+0000 7f36fd5d3700 1 --2- 172.21.15.40:0/600327374 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36f8136bf0 0x7f36f806ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:39.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.061+0000 7f36fe5d5700 1 --2- 172.21.15.40:0/600327374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36f8139510 0x7f36f81c8770 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f36f0009eb0 tx=0x7f36f000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:39.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.061+0000 7f36ee7fc700 1 -- 172.21.15.40:0/600327374 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f0009d50 con 0x7f36f8139510 2023-09-30T22:30:39.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.061+0000 7f36ee7fc700 1 -- 172.21.15.40:0/600327374 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f000f040 con 0x7f36f8139510 2023-09-30T22:30:39.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.061+0000 7f3700038700 1 -- 172.21.15.40:0/600327374 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e8009550 con 0x7f36f8139510 2023-09-30T22:30:39.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.061+0000 7f36ee7fc700 1 -- 172.21.15.40:0/600327374 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f000ceb0 con 0x7f36f8139510 2023-09-30T22:30:39.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.061+0000 7f3700038700 1 -- 172.21.15.40:0/600327374 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f809ecf0 con 0x7f36f8139510 2023-09-30T22:30:39.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.061+0000 7f36ee7fc700 1 -- 172.21.15.40:0/600327374 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f36f0014480 con 0x7f36f8139510 2023-09-30T22:30:39.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.062+0000 7f36ee7fc700 1 -- 172.21.15.40:0/600327374 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f36f0040340 con 0x7f36f8139510 2023-09-30T22:30:39.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.062+0000 7f3700038700 1 -- 172.21.15.40:0/600327374 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f80a5930 con 0x7f36f8139510 2023-09-30T22:30:39.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.066+0000 7f36ee7fc700 1 -- 172.21.15.40:0/600327374 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f36f0007920 con 0x7f36f8139510 2023-09-30T22:30:39.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.260+0000 7f3700038700 1 -- 172.21.15.40:0/600327374 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f36f809c660 con 0x7f36f8139510 2023-09-30T22:30:39.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.260+0000 7f36ee7fc700 1 -- 172.21.15.40:0/600327374 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f36f002a020 con 0x7f36f8139510 2023-09-30T22:30:39.261 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:39.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.262+0000 7f3700038700 1 -- 172.21.15.40:0/600327374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36f8139510 msgr2=0x7f36f81c8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:39.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.262+0000 7f3700038700 1 --2- 172.21.15.40:0/600327374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36f8139510 0x7f36f81c8770 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f36f0009eb0 tx=0x7f36f000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.262+0000 7f3700038700 1 -- 172.21.15.40:0/600327374 shutdown_connections 2023-09-30T22:30:39.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.262+0000 7f3700038700 1 --2- 172.21.15.40:0/600327374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36f8139510 0x7f36f81c8770 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.262+0000 7f3700038700 1 --2- 172.21.15.40:0/600327374 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36f809c890 0x7f36f806f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.262+0000 7f3700038700 1 --2- 172.21.15.40:0/600327374 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f36f8136bf0 0x7f36f806ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:39.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.262+0000 7f3700038700 1 -- 172.21.15.40:0/600327374 >> 172.21.15.40:0/600327374 conn(0x7f36f80a7080 msgr2=0x7f36f8136fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:39.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.262+0000 7f3700038700 1 -- 172.21.15.40:0/600327374 shutdown_connections 2023-09-30T22:30:39.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:39.262+0000 7f3700038700 1 -- 172.21.15.40:0/600327374 wait complete. 2023-09-30T22:30:39.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:39.889 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:39.964 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:40.001 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:40.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.027+0000 7fb9bc880700 1 Processor -- start 2023-09-30T22:30:40.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.027+0000 7fb9bc880700 1 -- start start 2023-09-30T22:30:40.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.028+0000 7fb9bc880700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb9b812e590 0x7fb9b812e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:40.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.028+0000 7fb9bc880700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9b812eea0 0x7fb9b812d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:40.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.028+0000 7fb9bc880700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9b812d6d0 0x7fb9b812db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:40.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.028+0000 7fb9bc880700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9b809ca30 con 0x7fb9b812e590 2023-09-30T22:30:40.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.028+0000 7fb9bc880700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b809ab70 con 0x7fb9b812d6d0 2023-09-30T22:30:40.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.028+0000 7fb9bc880700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b809bd70 con 0x7fb9b812eea0 2023-09-30T22:30:40.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.028+0000 7fb9b5d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9b812eea0 0x7fb9b812d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:40.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.028+0000 7fb9b5d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9b812eea0 0x7fb9b812d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:50912/0 (socket says 172.21.15.40:50912) 2023-09-30T22:30:40.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.028+0000 7fb9b5d9b700 1 -- 172.21.15.40:0/10084676 learned_addr learned my addr 172.21.15.40:0/10084676 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:40.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.028+0000 7fb9b659c700 1 --2- 172.21.15.40:0/10084676 >> v2:172.21.15.40:3300/0 conn(0x7fb9b812e590 0x7fb9b812e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:40.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.028+0000 7fb9b6d9d700 1 --2- 172.21.15.40:0/10084676 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9b812d6d0 0x7fb9b812db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:40.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.028+0000 7fb9b5d9b700 1 -- 172.21.15.40:0/10084676 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9b812d6d0 msgr2=0x7fb9b812db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.028+0000 7fb9b5d9b700 1 --2- 172.21.15.40:0/10084676 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9b812d6d0 0x7fb9b812db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.028+0000 7fb9b5d9b700 1 -- 172.21.15.40:0/10084676 >> v2:172.21.15.40:3300/0 conn(0x7fb9b812e590 msgr2=0x7fb9b812e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.028+0000 7fb9b5d9b700 1 --2- 172.21.15.40:0/10084676 >> v2:172.21.15.40:3300/0 conn(0x7fb9b812e590 0x7fb9b812e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.029+0000 7fb9b5d9b700 1 -- 172.21.15.40:0/10084676 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b809b270 con 0x7fb9b812eea0 2023-09-30T22:30:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.029+0000 7fb9b659c700 1 --2- 172.21.15.40:0/10084676 >> v2:172.21.15.40:3300/0 conn(0x7fb9b812e590 0x7fb9b812e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.029+0000 7fb9b5d9b700 1 --2- 172.21.15.40:0/10084676 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9b812eea0 0x7fb9b812d190 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac0098f0 tx=0x7fb9ac009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=989776589d59e725 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.029+0000 7fb9b559a700 1 -- 172.21.15.40:0/10084676 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac011830 con 0x7fb9b812eea0 2023-09-30T22:30:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.029+0000 7fb9b559a700 1 -- 172.21.15.40:0/10084676 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ac011990 con 0x7fb9b812eea0 2023-09-30T22:30:40.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.029+0000 7fb9b559a700 1 -- 172.21.15.40:0/10084676 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac011d20 con 0x7fb9b812eea0 2023-09-30T22:30:40.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.030+0000 7fb9bc880700 1 -- 172.21.15.40:0/10084676 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9b812eea0 msgr2=0x7fb9b812d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:40.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.030+0000 7fb9bc880700 1 --2- 172.21.15.40:0/10084676 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9b812eea0 0x7fb9b812d190 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac0098f0 tx=0x7fb9ac009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:40.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.030+0000 7fb9bc880700 1 -- 172.21.15.40:0/10084676 shutdown_connections 2023-09-30T22:30:40.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.030+0000 7fb9bc880700 1 --2- 172.21.15.40:0/10084676 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9b812d6d0 0x7fb9b812db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.030+0000 7fb9bc880700 1 --2- 172.21.15.40:0/10084676 >> v2:172.21.15.40:3300/0 conn(0x7fb9b812e590 0x7fb9b812e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.030+0000 7fb9bc880700 1 --2- 172.21.15.40:0/10084676 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9b812eea0 0x7fb9b812d190 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.030+0000 7fb9bc880700 1 -- 172.21.15.40:0/10084676 >> 172.21.15.40:0/10084676 conn(0x7fb9b80a2a00 msgr2=0x7fb9b80a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.030+0000 7fb9bc880700 1 -- 172.21.15.40:0/10084676 shutdown_connections 2023-09-30T22:30:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.030+0000 7fb9bc880700 1 -- 172.21.15.40:0/10084676 wait complete. 2023-09-30T22:30:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.031+0000 7fb9bc880700 1 Processor -- start 2023-09-30T22:30:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.031+0000 7fb9bc880700 1 -- start start 2023-09-30T22:30:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.031+0000 7fb9bc880700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9b812d6d0 0x7fb9b8139360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.031+0000 7fb9bc880700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9b812e590 0x7fb9b8137a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.031+0000 7fb9bc880700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9b812eea0 0x7fb9b8137f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.031+0000 7fb9bc880700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b8138b30 con 0x7fb9b812e590 2023-09-30T22:30:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.031+0000 7fb9bc880700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b81398a0 con 0x7fb9b812d6d0 2023-09-30T22:30:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.031+0000 7fb9bc880700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b81357e0 con 0x7fb9b812eea0 2023-09-30T22:30:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.032+0000 7fb9b5d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9b812e590 0x7fb9b8137a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:40.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.032+0000 7fb9b5d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9b812e590 0x7fb9b8137a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48068/0 (socket says 172.21.15.40:48068) 2023-09-30T22:30:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.032+0000 7fb9b5d9b700 1 -- 172.21.15.40:0/124048585 learned_addr learned my addr 172.21.15.40:0/124048585 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.032+0000 7fb9b659c700 1 --2- 172.21.15.40:0/124048585 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9b812d6d0 0x7fb9b8139360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.032+0000 7fb9b6d9d700 1 --2- 172.21.15.40:0/124048585 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9b812eea0 0x7fb9b8137f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.032+0000 7fb9b5d9b700 1 -- 172.21.15.40:0/124048585 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9b812eea0 msgr2=0x7fb9b8137f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.032+0000 7fb9b5d9b700 1 --2- 172.21.15.40:0/124048585 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9b812eea0 0x7fb9b8137f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.032+0000 7fb9b5d9b700 1 -- 172.21.15.40:0/124048585 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9b812d6d0 msgr2=0x7fb9b8139360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.032+0000 7fb9b5d9b700 1 --2- 172.21.15.40:0/124048585 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9b812d6d0 0x7fb9b8139360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.032+0000 7fb9b5d9b700 1 -- 172.21.15.40:0/124048585 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a80094a0 con 0x7fb9b812e590 2023-09-30T22:30:40.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.032+0000 7fb9b5d9b700 1 --2- 172.21.15.40:0/124048585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9b812e590 0x7fb9b8137a40 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac009c40 tx=0x7fb9ac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:40.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.032+0000 7fb9a6ffd700 1 -- 172.21.15.40:0/124048585 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac004450 con 0x7fb9b812e590 2023-09-30T22:30:40.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.032+0000 7fb9a6ffd700 1 -- 172.21.15.40:0/124048585 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ac0045b0 con 0x7fb9b812e590 2023-09-30T22:30:40.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.032+0000 7fb9a6ffd700 1 -- 172.21.15.40:0/124048585 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac0038c0 con 0x7fb9b812e590 2023-09-30T22:30:40.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.032+0000 7fb9bc880700 1 -- 172.21.15.40:0/124048585 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9ac009550 con 0x7fb9b812e590 2023-09-30T22:30:40.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.033+0000 7fb9bc880700 1 -- 172.21.15.40:0/124048585 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b81361a0 con 0x7fb9b812e590 2023-09-30T22:30:40.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.033+0000 7fb9a6ffd700 1 -- 172.21.15.40:0/124048585 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb9ac003a20 con 0x7fb9b812e590 2023-09-30T22:30:40.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.033+0000 7fb9a6ffd700 1 -- 172.21.15.40:0/124048585 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb9ac040cb0 con 0x7fb9b812e590 2023-09-30T22:30:40.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.034+0000 7fb9bc880700 1 -- 172.21.15.40:0/124048585 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b809b4b0 con 0x7fb9b812e590 2023-09-30T22:30:40.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.039+0000 7fb9a6ffd700 1 -- 172.21.15.40:0/124048585 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb9ac015070 con 0x7fb9b812e590 2023-09-30T22:30:40.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.098+0000 7fd8b9993700 1 Processor -- start 2023-09-30T22:30:40.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.098+0000 7fd8b9993700 1 -- start start 2023-09-30T22:30:40.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.099+0000 7fd8b9993700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd8b409d920 0x7fd8b409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:40.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.099+0000 7fd8b9993700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8b409e230 0x7fd8b41308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:40.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.099+0000 7fd8b9993700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b409adf0 con 0x7fd8b4130de0 2023-09-30T22:30:40.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.099+0000 7fd8b9993700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b409edf0 con 0x7fd8b409d920 2023-09-30T22:30:40.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.099+0000 7fd8b9993700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b409b660 con 0x7fd8b409e230 2023-09-30T22:30:40.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.099+0000 7fd8b27fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8b409e230 0x7fd8b41308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:40.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.099+0000 7fd8b27fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8b409e230 0x7fd8b41308a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:47994/0 (socket says 172.21.15.40:47994) 2023-09-30T22:30:40.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.099+0000 7fd8b27fc700 1 -- 172.21.15.40:0/4216812448 learned_addr learned my addr 172.21.15.40:0/4216812448 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:40.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.099+0000 7fd8b2ffd700 1 --2- 172.21.15.40:0/4216812448 >> v2:172.21.15.40:3300/0 conn(0x7fd8b409d920 0x7fd8b409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:40.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.099+0000 7fd8b27fc700 1 -- 172.21.15.40:0/4216812448 >> v2:172.21.15.40:3300/0 conn(0x7fd8b409d920 msgr2=0x7fd8b409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:40.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.099+0000 7fd8b27fc700 1 --2- 172.21.15.40:0/4216812448 >> v2:172.21.15.40:3300/0 conn(0x7fd8b409d920 0x7fd8b409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.099+0000 7fd8b27fc700 1 -- 172.21.15.40:0/4216812448 >> v1:172.21.15.40:6789/0 conn(0x7fd8b4130de0 legacy=0x7fd8b4137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:40.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.099+0000 7fd8b27fc700 1 -- 172.21.15.40:0/4216812448 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b409a6e0 con 0x7fd8b409e230 2023-09-30T22:30:40.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.100+0000 7fd8b27fc700 1 --2- 172.21.15.40:0/4216812448 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8b409e230 0x7fd8b41308a0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fd8a80098f0 tx=0x7fd8a8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=823d4cc904055e3d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:40.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.100+0000 7fd8b1ffb700 1 -- 172.21.15.40:0/4216812448 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a8011830 con 0x7fd8b409e230 2023-09-30T22:30:40.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.100+0000 7fd8b1ffb700 1 -- 172.21.15.40:0/4216812448 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a8011990 con 0x7fd8b409e230 2023-09-30T22:30:40.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.100+0000 7fd8b1ffb700 1 -- 172.21.15.40:0/4216812448 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a8011d20 con 0x7fd8b409e230 2023-09-30T22:30:40.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.100+0000 7fd8b9993700 1 -- 172.21.15.40:0/4216812448 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8b409e230 msgr2=0x7fd8b41308a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:40.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.100+0000 7fd8b9993700 1 --2- 172.21.15.40:0/4216812448 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8b409e230 0x7fd8b41308a0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fd8a80098f0 tx=0x7fd8a8009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:40.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.101+0000 7fd8b9993700 1 -- 172.21.15.40:0/4216812448 shutdown_connections 2023-09-30T22:30:40.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.101+0000 7fd8b9993700 1 --2- 172.21.15.40:0/4216812448 >> v2:172.21.15.40:3300/0 conn(0x7fd8b409d920 0x7fd8b409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.101+0000 7fd8b9993700 1 --2- 172.21.15.40:0/4216812448 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8b409e230 0x7fd8b41308a0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.101+0000 7fd8b9993700 1 -- 172.21.15.40:0/4216812448 >> 172.21.15.40:0/4216812448 conn(0x7fd8b409fb20 msgr2=0x7fd8b409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:40.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.101+0000 7fd8b9993700 1 -- 172.21.15.40:0/4216812448 shutdown_connections 2023-09-30T22:30:40.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.101+0000 7fd8b9993700 1 -- 172.21.15.40:0/4216812448 wait complete. 2023-09-30T22:30:40.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.101+0000 7fd8b9993700 1 Processor -- start 2023-09-30T22:30:40.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.102+0000 7fd8b9993700 1 -- start start 2023-09-30T22:30:40.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.102+0000 7fd8b9993700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8b409d920 0x7fd8b406fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:40.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.102+0000 7fd8b9993700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8b409e230 0x7fd8b4070160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:40.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.102+0000 7fd8b9993700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd8b4130de0 0x7fd8b41c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:40.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.102+0000 7fd8b9993700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b4136940 con 0x7fd8b409e230 2023-09-30T22:30:40.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.102+0000 7fd8b9993700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b40715c0 con 0x7fd8b409d920 2023-09-30T22:30:40.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.102+0000 7fd8b9993700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b406f6a0 con 0x7fd8b4130de0 2023-09-30T22:30:40.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.102+0000 7fd8b2ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8b409d920 0x7fd8b406fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:40.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.102+0000 7fd8b2ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8b409d920 0x7fd8b406fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:47998/0 (socket says 172.21.15.40:47998) 2023-09-30T22:30:40.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.102+0000 7fd8b2ffd700 1 -- 172.21.15.40:0/301186377 learned_addr learned my addr 172.21.15.40:0/301186377 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:40.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.102+0000 7fd8b37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd8b4130de0 0x7fd8b41c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:40.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.102+0000 7fd8b27fc700 1 --2- 172.21.15.40:0/301186377 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8b409e230 0x7fd8b4070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:40.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.103+0000 7fd8b2ffd700 1 -- 172.21.15.40:0/301186377 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd8b4130de0 msgr2=0x7fd8b41c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:40.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.103+0000 7fd8b2ffd700 1 --2- 172.21.15.40:0/301186377 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd8b4130de0 0x7fd8b41c8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.103+0000 7fd8b2ffd700 1 -- 172.21.15.40:0/301186377 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8b409e230 msgr2=0x7fd8b4070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:40.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.103+0000 7fd8b2ffd700 1 --2- 172.21.15.40:0/301186377 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8b409e230 0x7fd8b4070160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.103+0000 7fd8b2ffd700 1 -- 172.21.15.40:0/301186377 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a8009550 con 0x7fd8b409d920 2023-09-30T22:30:40.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.103+0000 7fd8b2ffd700 1 --2- 172.21.15.40:0/301186377 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8b409d920 0x7fd8b406fc20 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fd8a400e9c0 tx=0x7fd8a400ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:40.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.103+0000 7fd89bfff700 1 -- 172.21.15.40:0/301186377 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a40096f0 con 0x7fd8b409d920 2023-09-30T22:30:40.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.103+0000 7fd89bfff700 1 -- 172.21.15.40:0/301186377 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a400ee60 con 0x7fd8b409d920 2023-09-30T22:30:40.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.103+0000 7fd8b9993700 1 -- 172.21.15.40:0/301186377 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b4136d20 con 0x7fd8b409d920 2023-09-30T22:30:40.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.103+0000 7fd89bfff700 1 -- 172.21.15.40:0/301186377 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a400ca50 con 0x7fd8b409d920 2023-09-30T22:30:40.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.103+0000 7fd8b9993700 1 -- 172.21.15.40:0/301186377 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b41365f0 con 0x7fd8b409d920 2023-09-30T22:30:40.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.104+0000 7fd89bfff700 1 -- 172.21.15.40:0/301186377 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd8a400cbb0 con 0x7fd8b409d920 2023-09-30T22:30:40.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.104+0000 7fd89bfff700 1 -- 172.21.15.40:0/301186377 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd8a403fb70 con 0x7fd8b409d920 2023-09-30T22:30:40.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.104+0000 7fd8b9993700 1 -- 172.21.15.40:0/301186377 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b40706a0 con 0x7fd8b409d920 2023-09-30T22:30:40.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.109+0000 7fd89bfff700 1 -- 172.21.15.40:0/301186377 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd8a4021080 con 0x7fd8b409d920 2023-09-30T22:30:40.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.138+0000 7fa4f4038700 1 Processor -- start 2023-09-30T22:30:40.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.138+0000 7fa4f4038700 1 -- start start 2023-09-30T22:30:40.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.139+0000 7fa4f4038700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa4ec06a6d0 0x7fa4ec06aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:40.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.139+0000 7fa4f4038700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4ec06afe0 0x7fa4ec1318b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:40.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.139+0000 7fa4f4038700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4ec09eb50 con 0x7fa4ec131df0 2023-09-30T22:30:40.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.139+0000 7fa4f4038700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4ec09dde0 con 0x7fa4ec06a6d0 2023-09-30T22:30:40.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.139+0000 7fa4f4038700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec09d4a0 con 0x7fa4ec06afe0 2023-09-30T22:30:40.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.139+0000 7fa4f1dd4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa4ec06a6d0 0x7fa4ec06aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:40.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.139+0000 7fa4f1dd4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa4ec06a6d0 0x7fa4ec06aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48098/0 (socket says 172.21.15.40:48098) 2023-09-30T22:30:40.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.139+0000 7fa4f1dd4700 1 -- 172.21.15.40:0/2154777979 learned_addr learned my addr 172.21.15.40:0/2154777979 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:40.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.139+0000 7fa4f15d3700 1 --2- 172.21.15.40:0/2154777979 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4ec06afe0 0x7fa4ec1318b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:40.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.139+0000 7fa4f1dd4700 1 -- 172.21.15.40:0/2154777979 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4ec06afe0 msgr2=0x7fa4ec1318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:40.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.139+0000 7fa4f1dd4700 1 --2- 172.21.15.40:0/2154777979 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4ec06afe0 0x7fa4ec1318b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.139+0000 7fa4f1dd4700 1 -- 172.21.15.40:0/2154777979 >> v1:172.21.15.40:6789/0 conn(0x7fa4ec131df0 legacy=0x7fa4ec138b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:40.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.139+0000 7fa4f1dd4700 1 -- 172.21.15.40:0/2154777979 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ec09f5f0 con 0x7fa4ec06a6d0 2023-09-30T22:30:40.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.140+0000 7fa4f15d3700 1 --2- 172.21.15.40:0/2154777979 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4ec06afe0 0x7fa4ec1318b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:40.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.140+0000 7fa4f1dd4700 1 --2- 172.21.15.40:0/2154777979 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4ec06a6d0 0x7fa4ec06aaa0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8006fd0 tx=0x7fa4e8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1426594d72eec4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:40.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.140+0000 7fa4f0dd2700 1 -- 172.21.15.40:0/2154777979 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8005e30 con 0x7fa4ec06a6d0 2023-09-30T22:30:40.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.140+0000 7fa4f0dd2700 1 -- 172.21.15.40:0/2154777979 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e8004030 con 0x7fa4ec06a6d0 2023-09-30T22:30:40.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.140+0000 7fa4f0dd2700 1 -- 172.21.15.40:0/2154777979 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e80043e0 con 0x7fa4ec06a6d0 2023-09-30T22:30:40.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.140+0000 7fa4f4038700 1 -- 172.21.15.40:0/2154777979 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4ec06a6d0 msgr2=0x7fa4ec06aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:40.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.140+0000 7fa4f4038700 1 --2- 172.21.15.40:0/2154777979 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4ec06a6d0 0x7fa4ec06aaa0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8006fd0 tx=0x7fa4e8009bd0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.140+0000 7fa4f4038700 1 -- 172.21.15.40:0/2154777979 shutdown_connections 2023-09-30T22:30:40.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.140+0000 7fa4f4038700 1 --2- 172.21.15.40:0/2154777979 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4ec06a6d0 0x7fa4ec06aaa0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.140+0000 7fa4f4038700 1 --2- 172.21.15.40:0/2154777979 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4ec06afe0 0x7fa4ec1318b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.140+0000 7fa4f4038700 1 -- 172.21.15.40:0/2154777979 >> 172.21.15.40:0/2154777979 conn(0x7fa4ec09fb20 msgr2=0x7fa4ec09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:40.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.141+0000 7fa4f4038700 1 -- 172.21.15.40:0/2154777979 shutdown_connections 2023-09-30T22:30:40.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.141+0000 7fa4f4038700 1 -- 172.21.15.40:0/2154777979 wait complete. 2023-09-30T22:30:40.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.141+0000 7fa4f4038700 1 Processor -- start 2023-09-30T22:30:40.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.142+0000 7fa4f4038700 1 -- start start 2023-09-30T22:30:40.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.142+0000 7fa4f4038700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4ec06a6d0 0x7fa4ec11c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:40.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.142+0000 7fa4f4038700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4ec06afe0 0x7fa4ec11ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:40.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.142+0000 7fa4f4038700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4ec131df0 0x7fa4ec11d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:40.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.142+0000 7fa4f4038700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec120440 con 0x7fa4ec06afe0 2023-09-30T22:30:40.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.142+0000 7fa4f4038700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec131740 con 0x7fa4ec131df0 2023-09-30T22:30:40.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.142+0000 7fa4f4038700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec11fff0 con 0x7fa4ec06a6d0 2023-09-30T22:30:40.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.142+0000 7fa4f1dd4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4ec06a6d0 0x7fa4ec11c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:40.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.142+0000 7fa4f1dd4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4ec06a6d0 0x7fa4ec11c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:50946/0 (socket says 172.21.15.40:50946) 2023-09-30T22:30:40.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.142+0000 7fa4f1dd4700 1 -- 172.21.15.40:0/1095443168 learned_addr learned my addr 172.21.15.40:0/1095443168 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:40.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.142+0000 7fa4f15d3700 1 --2- 172.21.15.40:0/1095443168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4ec06afe0 0x7fa4ec11ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:40.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.142+0000 7fa4f25d5700 1 --2- 172.21.15.40:0/1095443168 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4ec131df0 0x7fa4ec11d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:40.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.142+0000 7fa4f1dd4700 1 -- 172.21.15.40:0/1095443168 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4ec131df0 msgr2=0x7fa4ec11d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:40.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.142+0000 7fa4f1dd4700 1 --2- 172.21.15.40:0/1095443168 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4ec131df0 0x7fa4ec11d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.142+0000 7fa4f1dd4700 1 -- 172.21.15.40:0/1095443168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4ec06afe0 msgr2=0x7fa4ec11ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:40.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.142+0000 7fa4f1dd4700 1 --2- 172.21.15.40:0/1095443168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4ec06afe0 0x7fa4ec11ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.142+0000 7fa4f1dd4700 1 -- 172.21.15.40:0/1095443168 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4dc0094a0 con 0x7fa4ec06a6d0 2023-09-30T22:30:40.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.143+0000 7fa4f1dd4700 1 --2- 172.21.15.40:0/1095443168 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4ec06a6d0 0x7fa4ec11c8d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8004000 tx=0x7fa4e8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:40.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.143+0000 7fa4e27fc700 1 -- 172.21.15.40:0/1095443168 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8003ce0 con 0x7fa4ec06a6d0 2023-09-30T22:30:40.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.143+0000 7fa4e27fc700 1 -- 172.21.15.40:0/1095443168 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e8003e40 con 0x7fa4ec06a6d0 2023-09-30T22:30:40.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.143+0000 7fa4e27fc700 1 -- 172.21.15.40:0/1095443168 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e801c640 con 0x7fa4ec06a6d0 2023-09-30T22:30:40.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.143+0000 7fa4f4038700 1 -- 172.21.15.40:0/1095443168 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4e8009500 con 0x7fa4ec06a6d0 2023-09-30T22:30:40.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.143+0000 7fa4f4038700 1 -- 172.21.15.40:0/1095443168 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4ec11ec20 con 0x7fa4ec06a6d0 2023-09-30T22:30:40.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.144+0000 7fa4f4038700 1 -- 172.21.15.40:0/1095443168 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4ec062380 con 0x7fa4ec06a6d0 2023-09-30T22:30:40.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.144+0000 7fa4e27fc700 1 -- 172.21.15.40:0/1095443168 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa4e801c7a0 con 0x7fa4ec06a6d0 2023-09-30T22:30:40.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.144+0000 7fa4e27fc700 1 -- 172.21.15.40:0/1095443168 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa4e8040760 con 0x7fa4ec06a6d0 2023-09-30T22:30:40.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.153+0000 7fa4e27fc700 1 -- 172.21.15.40:0/1095443168 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa4e8011420 con 0x7fa4ec06a6d0 2023-09-30T22:30:40.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.240+0000 7fb9bc880700 1 -- 172.21.15.40:0/124048585 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb9b8062380 con 0x7fb9b812e590 2023-09-30T22:30:40.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.240+0000 7fb9a6ffd700 1 -- 172.21.15.40:0/124048585 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb9ac036070 con 0x7fb9b812e590 2023-09-30T22:30:40.241 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:40.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.242+0000 7fb9bc880700 1 -- 172.21.15.40:0/124048585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9b812e590 msgr2=0x7fb9b8137a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:40.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.242+0000 7fb9bc880700 1 --2- 172.21.15.40:0/124048585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9b812e590 0x7fb9b8137a40 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac009c40 tx=0x7fb9ac004750 comp rx=0 tx=0).stop 2023-09-30T22:30:40.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.242+0000 7fb9bc880700 1 -- 172.21.15.40:0/124048585 shutdown_connections 2023-09-30T22:30:40.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.242+0000 7fb9bc880700 1 --2- 172.21.15.40:0/124048585 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9b812eea0 0x7fb9b8137f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.242+0000 7fb9bc880700 1 --2- 172.21.15.40:0/124048585 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9b812d6d0 0x7fb9b8139360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.242+0000 7fb9bc880700 1 --2- 172.21.15.40:0/124048585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9b812e590 0x7fb9b8137a40 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.242+0000 7fb9bc880700 1 -- 172.21.15.40:0/124048585 >> 172.21.15.40:0/124048585 conn(0x7fb9b80a2a00 msgr2=0x7fb9b809d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:40.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.242+0000 7fb9bc880700 1 -- 172.21.15.40:0/124048585 shutdown_connections 2023-09-30T22:30:40.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.242+0000 7fb9bc880700 1 -- 172.21.15.40:0/124048585 wait complete. 2023-09-30T22:30:40.255 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:40.275 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:40.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.316+0000 7fd8b9993700 1 -- 172.21.15.40:0/301186377 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd8b4136780 con 0x7fd8b409d920 2023-09-30T22:30:40.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.316+0000 7fd89bfff700 1 -- 172.21.15.40:0/301186377 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd8a4017020 con 0x7fd8b409d920 2023-09-30T22:30:40.317 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:40.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.318+0000 7fd8b9993700 1 -- 172.21.15.40:0/301186377 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8b409d920 msgr2=0x7fd8b406fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:40.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.318+0000 7fd8b9993700 1 --2- 172.21.15.40:0/301186377 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8b409d920 0x7fd8b406fc20 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fd8a400e9c0 tx=0x7fd8a400ecd0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.319+0000 7fd8b9993700 1 -- 172.21.15.40:0/301186377 shutdown_connections 2023-09-30T22:30:40.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.319+0000 7fd8b9993700 1 --2- 172.21.15.40:0/301186377 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd8b4130de0 0x7fd8b41c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.319+0000 7fd8b9993700 1 --2- 172.21.15.40:0/301186377 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8b409d920 0x7fd8b406fc20 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.319+0000 7fd8b9993700 1 --2- 172.21.15.40:0/301186377 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8b409e230 0x7fd8b4070160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.319+0000 7fd8b9993700 1 -- 172.21.15.40:0/301186377 >> 172.21.15.40:0/301186377 conn(0x7fd8b409fb20 msgr2=0x7fd8b412bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:40.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.319+0000 7fd8b9993700 1 -- 172.21.15.40:0/301186377 shutdown_connections 2023-09-30T22:30:40.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.319+0000 7fd8b9993700 1 -- 172.21.15.40:0/301186377 wait complete. 2023-09-30T22:30:40.332 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:40.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.353+0000 7fa4f4038700 1 -- 172.21.15.40:0/1095443168 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa4ec120ac0 con 0x7fa4ec06a6d0 2023-09-30T22:30:40.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.353+0000 7fa4e27fc700 1 -- 172.21.15.40:0/1095443168 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa4e802a070 con 0x7fa4ec06a6d0 2023-09-30T22:30:40.354 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:40.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.356+0000 7fa4f4038700 1 -- 172.21.15.40:0/1095443168 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4ec06a6d0 msgr2=0x7fa4ec11c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:40.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.356+0000 7fa4f4038700 1 --2- 172.21.15.40:0/1095443168 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4ec06a6d0 0x7fa4ec11c8d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8004000 tx=0x7fa4e8004750 comp rx=0 tx=0).stop 2023-09-30T22:30:40.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.356+0000 7fa4f4038700 1 -- 172.21.15.40:0/1095443168 shutdown_connections 2023-09-30T22:30:40.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.356+0000 7fa4f4038700 1 --2- 172.21.15.40:0/1095443168 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa4ec06a6d0 0x7fa4ec11c8d0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.356+0000 7fa4f4038700 1 --2- 172.21.15.40:0/1095443168 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4ec131df0 0x7fa4ec11d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.356+0000 7fa4f4038700 1 --2- 172.21.15.40:0/1095443168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4ec06afe0 0x7fa4ec11ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.356+0000 7fa4f4038700 1 -- 172.21.15.40:0/1095443168 >> 172.21.15.40:0/1095443168 conn(0x7fa4ec09fb20 msgr2=0x7fa4ec0a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:40.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.356+0000 7fa4f4038700 1 -- 172.21.15.40:0/1095443168 shutdown_connections 2023-09-30T22:30:40.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.356+0000 7fa4f4038700 1 -- 172.21.15.40:0/1095443168 wait complete. 2023-09-30T22:30:40.368 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:40.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.426+0000 7f554f80a700 1 Processor -- start 2023-09-30T22:30:40.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.426+0000 7f554f80a700 1 -- start start 2023-09-30T22:30:40.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.426+0000 7f554f80a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f554809fbb0 0x7f554806c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:40.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.427+0000 7f554f80a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5548139380 0x7f554813b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:40.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.427+0000 7f554f80a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f554806e3f0 con 0x7f554806ced0 2023-09-30T22:30:40.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.427+0000 7f554f80a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f554809ff80 con 0x7f554809fbb0 2023-09-30T22:30:40.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.427+0000 7f554f80a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f554806ec40 con 0x7f5548139380 2023-09-30T22:30:40.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.427+0000 7f554d5a6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f554809fbb0 0x7f554806c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:40.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.427+0000 7f554dda7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5548139380 0x7f554813b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:40.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.427+0000 7f554d5a6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f554809fbb0 0x7f554806c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48116/0 (socket says 172.21.15.40:48116) 2023-09-30T22:30:40.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.427+0000 7f554d5a6700 1 -- 172.21.15.40:0/669660247 learned_addr learned my addr 172.21.15.40:0/669660247 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:40.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.427+0000 7f554dda7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5548139380 0x7f554813b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:50948/0 (socket says 172.21.15.40:50948) 2023-09-30T22:30:40.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.427+0000 7f554d5a6700 1 -- 172.21.15.40:0/669660247 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5548139380 msgr2=0x7f554813b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:40.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.427+0000 7f554d5a6700 1 --2- 172.21.15.40:0/669660247 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5548139380 0x7f554813b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.427+0000 7f554d5a6700 1 -- 172.21.15.40:0/669660247 >> v1:172.21.15.40:6789/0 conn(0x7f554806ced0 legacy=0x7f554806d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:40.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.427+0000 7f554d5a6700 1 -- 172.21.15.40:0/669660247 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554806d9f0 con 0x7f554809fbb0 2023-09-30T22:30:40.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.427+0000 7f554dda7700 1 --2- 172.21.15.40:0/669660247 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5548139380 0x7f554813b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:40.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.427+0000 7f554d5a6700 1 --2- 172.21.15.40:0/669660247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f554809fbb0 0x7f554806c990 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f55440098f0 tx=0x7f5544009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab32698cc89824e8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:40.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.427+0000 7f553ffff700 1 -- 172.21.15.40:0/669660247 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5544011830 con 0x7f554809fbb0 2023-09-30T22:30:40.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.427+0000 7f553ffff700 1 -- 172.21.15.40:0/669660247 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5544011990 con 0x7f554809fbb0 2023-09-30T22:30:40.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.427+0000 7f553ffff700 1 -- 172.21.15.40:0/669660247 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5544011d20 con 0x7f554809fbb0 2023-09-30T22:30:40.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.428+0000 7f554f80a700 1 -- 172.21.15.40:0/669660247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f554809fbb0 msgr2=0x7f554806c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:40.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.428+0000 7f554f80a700 1 --2- 172.21.15.40:0/669660247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f554809fbb0 0x7f554806c990 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f55440098f0 tx=0x7f5544009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:40.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.428+0000 7f554f80a700 1 -- 172.21.15.40:0/669660247 shutdown_connections 2023-09-30T22:30:40.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.428+0000 7f554f80a700 1 --2- 172.21.15.40:0/669660247 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5548139380 0x7f554813b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.428+0000 7f554f80a700 1 --2- 172.21.15.40:0/669660247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f554809fbb0 0x7f554806c990 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.428+0000 7f554f80a700 1 -- 172.21.15.40:0/669660247 >> 172.21.15.40:0/669660247 conn(0x7f55480a41a0 msgr2=0x7f55480a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:40.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.428+0000 7f554f80a700 1 -- 172.21.15.40:0/669660247 shutdown_connections 2023-09-30T22:30:40.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.428+0000 7f554f80a700 1 -- 172.21.15.40:0/669660247 wait complete. 2023-09-30T22:30:40.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.429+0000 7f554f80a700 1 Processor -- start 2023-09-30T22:30:40.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.429+0000 7f554f80a700 1 -- start start 2023-09-30T22:30:40.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.429+0000 7f554f80a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f554806ced0 0x7f5548090660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:40.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.429+0000 7f554f80a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f554809fbb0 0x7f5548090ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:40.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.429+0000 7f554f80a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5548139380 0x7f55480910e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:40.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.429+0000 7f554f80a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5548093dc0 con 0x7f5548139380 2023-09-30T22:30:40.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.429+0000 7f554f80a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5548093fa0 con 0x7f554806ced0 2023-09-30T22:30:40.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.429+0000 7f554f80a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f554809f510 con 0x7f554809fbb0 2023-09-30T22:30:40.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.429+0000 7f554d5a6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f554806ced0 0x7f5548090660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:40.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.429+0000 7f554cda5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f554809fbb0 0x7f5548090ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:40.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.429+0000 7f554d5a6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f554806ced0 0x7f5548090660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48016/0 (socket says 172.21.15.40:48016) 2023-09-30T22:30:40.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.429+0000 7f554d5a6700 1 -- 172.21.15.40:0/2495394468 learned_addr learned my addr 172.21.15.40:0/2495394468 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:40.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.429+0000 7f554dda7700 1 --2- 172.21.15.40:0/2495394468 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5548139380 0x7f55480910e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:40.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.430+0000 7f554dda7700 1 -- 172.21.15.40:0/2495394468 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f554809fbb0 msgr2=0x7f5548090ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:40.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.430+0000 7f554dda7700 1 --2- 172.21.15.40:0/2495394468 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f554809fbb0 0x7f5548090ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.430+0000 7f554dda7700 1 -- 172.21.15.40:0/2495394468 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f554806ced0 msgr2=0x7f5548090660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:40.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.430+0000 7f554dda7700 1 --2- 172.21.15.40:0/2495394468 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f554806ced0 0x7f5548090660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.430+0000 7f554dda7700 1 -- 172.21.15.40:0/2495394468 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5540009a70 con 0x7f5548139380 2023-09-30T22:30:40.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.430+0000 7f554d5a6700 1 --2- 172.21.15.40:0/2495394468 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f554806ced0 0x7f5548090660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:40.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.430+0000 7f554dda7700 1 --2- 172.21.15.40:0/2495394468 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5548139380 0x7f55480910e0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f554000efc0 tx=0x7f554000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:40.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.430+0000 7f553dffb700 1 -- 172.21.15.40:0/2495394468 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554000ca90 con 0x7f5548139380 2023-09-30T22:30:40.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.430+0000 7f553dffb700 1 -- 172.21.15.40:0/2495394468 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554000f040 con 0x7f5548139380 2023-09-30T22:30:40.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.430+0000 7f554f80a700 1 -- 172.21.15.40:0/2495394468 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5544009550 con 0x7f5548139380 2023-09-30T22:30:40.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.430+0000 7f553dffb700 1 -- 172.21.15.40:0/2495394468 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554000ce30 con 0x7f5548139380 2023-09-30T22:30:40.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.430+0000 7f554f80a700 1 -- 172.21.15.40:0/2495394468 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5548092600 con 0x7f5548139380 2023-09-30T22:30:40.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.431+0000 7f553dffb700 1 -- 172.21.15.40:0/2495394468 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5540014480 con 0x7f5548139380 2023-09-30T22:30:40.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.431+0000 7f553dffb700 1 -- 172.21.15.40:0/2495394468 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f554003fc20 con 0x7f5548139380 2023-09-30T22:30:40.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.431+0000 7f554f80a700 1 -- 172.21.15.40:0/2495394468 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5548062380 con 0x7f5548139380 2023-09-30T22:30:40.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.436+0000 7f553dffb700 1 -- 172.21.15.40:0/2495394468 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5540012930 con 0x7f5548139380 2023-09-30T22:30:40.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.631+0000 7f554f80a700 1 -- 172.21.15.40:0/2495394468 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f55480a04e0 con 0x7f5548139380 2023-09-30T22:30:40.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.631+0000 7f553dffb700 1 -- 172.21.15.40:0/2495394468 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5540012340 con 0x7f5548139380 2023-09-30T22:30:40.632 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:40.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.633+0000 7f554f80a700 1 -- 172.21.15.40:0/2495394468 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5548139380 msgr2=0x7f55480910e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:40.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.633+0000 7f554f80a700 1 --2- 172.21.15.40:0/2495394468 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5548139380 0x7f55480910e0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f554000efc0 tx=0x7f554000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.633+0000 7f554f80a700 1 -- 172.21.15.40:0/2495394468 shutdown_connections 2023-09-30T22:30:40.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.633+0000 7f554f80a700 1 --2- 172.21.15.40:0/2495394468 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5548139380 0x7f55480910e0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.633+0000 7f554f80a700 1 --2- 172.21.15.40:0/2495394468 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f554806ced0 0x7f5548090660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.633+0000 7f554f80a700 1 --2- 172.21.15.40:0/2495394468 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f554809fbb0 0x7f5548090ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:40.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.633+0000 7f554f80a700 1 -- 172.21.15.40:0/2495394468 >> 172.21.15.40:0/2495394468 conn(0x7f55480a41a0 msgr2=0x7f55481385a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:40.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.634+0000 7f554f80a700 1 -- 172.21.15.40:0/2495394468 shutdown_connections 2023-09-30T22:30:40.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:40.634+0000 7f554f80a700 1 -- 172.21.15.40:0/2495394468 wait complete. 2023-09-30T22:30:40.646 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:41.256 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:41.333 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:41.369 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:41.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.396+0000 7f7319268700 1 Processor -- start 2023-09-30T22:30:41.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.396+0000 7f7319268700 1 -- start start 2023-09-30T22:30:41.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.397+0000 7f7319268700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f731406f070 0x7f731406f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.397+0000 7f7319268700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f731406f980 0x7f7314097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.397+0000 7f7319268700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f731406fdb0 0x7f73140975d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.397+0000 7f7319268700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7314070830 con 0x7f731406f070 2023-09-30T22:30:41.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.397+0000 7f7319268700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7314070ad0 con 0x7f731406f980 2023-09-30T22:30:41.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.397+0000 7f7319268700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7314070de0 con 0x7f731406fdb0 2023-09-30T22:30:41.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.397+0000 7f7312ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f731406f070 0x7f731406f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.397+0000 7f7312ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f731406f070 0x7f731406f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48130/0 (socket says 172.21.15.40:48130) 2023-09-30T22:30:41.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.397+0000 7f7312ffd700 1 -- 172.21.15.40:0/209341145 learned_addr learned my addr 172.21.15.40:0/209341145 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:41.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.397+0000 7f73127fc700 1 --2- 172.21.15.40:0/209341145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f731406f980 0x7f7314097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.397+0000 7f73137fe700 1 --2- 172.21.15.40:0/209341145 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f731406fdb0 0x7f73140975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.397+0000 7f7312ffd700 1 -- 172.21.15.40:0/209341145 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f731406fdb0 msgr2=0x7f73140975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:41.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.397+0000 7f7312ffd700 1 --2- 172.21.15.40:0/209341145 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f731406fdb0 0x7f73140975d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.397+0000 7f7312ffd700 1 -- 172.21.15.40:0/209341145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f731406f980 msgr2=0x7f7314097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:41.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.397+0000 7f7312ffd700 1 --2- 172.21.15.40:0/209341145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f731406f980 0x7f7314097090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.397+0000 7f7312ffd700 1 -- 172.21.15.40:0/209341145 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731409fe20 con 0x7f731406f070 2023-09-30T22:30:41.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.397+0000 7f73127fc700 1 --2- 172.21.15.40:0/209341145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f731406f980 0x7f7314097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:41.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.398+0000 7f7312ffd700 1 --2- 172.21.15.40:0/209341145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f731406f070 0x7f731406f440 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f73040098f0 tx=0x7f7304009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a79bfd5945d69ad server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:41.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.398+0000 7f7311ffb700 1 -- 172.21.15.40:0/209341145 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730400b8a0 con 0x7f731406f070 2023-09-30T22:30:41.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.398+0000 7f7311ffb700 1 -- 172.21.15.40:0/209341145 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730400ba00 con 0x7f731406f070 2023-09-30T22:30:41.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.398+0000 7f7311ffb700 1 -- 172.21.15.40:0/209341145 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730400bd90 con 0x7f731406f070 2023-09-30T22:30:41.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.398+0000 7f7319268700 1 -- 172.21.15.40:0/209341145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f731406f070 msgr2=0x7f731406f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:41.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.398+0000 7f7319268700 1 --2- 172.21.15.40:0/209341145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f731406f070 0x7f731406f440 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f73040098f0 tx=0x7f7304009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:41.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.398+0000 7f7319268700 1 -- 172.21.15.40:0/209341145 shutdown_connections 2023-09-30T22:30:41.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.398+0000 7f7319268700 1 --2- 172.21.15.40:0/209341145 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f731406fdb0 0x7f73140975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.398+0000 7f7319268700 1 --2- 172.21.15.40:0/209341145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f731406f070 0x7f731406f440 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.398+0000 7f7319268700 1 --2- 172.21.15.40:0/209341145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f731406f980 0x7f7314097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.398+0000 7f7319268700 1 -- 172.21.15.40:0/209341145 >> 172.21.15.40:0/209341145 conn(0x7f73140a41a0 msgr2=0x7f73140a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:41.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.399+0000 7f7319268700 1 -- 172.21.15.40:0/209341145 shutdown_connections 2023-09-30T22:30:41.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.399+0000 7f7319268700 1 -- 172.21.15.40:0/209341145 wait complete. 2023-09-30T22:30:41.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.400+0000 7f7319268700 1 Processor -- start 2023-09-30T22:30:41.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.400+0000 7f7319268700 1 -- start start 2023-09-30T22:30:41.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.400+0000 7f7319268700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f731406f070 0x7f731406c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.400+0000 7f7319268700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f731406f980 0x7f731406ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.400+0000 7f7319268700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f731406fdb0 0x7f731406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.400+0000 7f7319268700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7314129330 con 0x7f731406f980 2023-09-30T22:30:41.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.400+0000 7f7319268700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f731408b300 con 0x7f731406fdb0 2023-09-30T22:30:41.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.400+0000 7f7319268700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f731406e640 con 0x7f731406f070 2023-09-30T22:30:41.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.401+0000 7f73127fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f731406f980 0x7f731406ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.401+0000 7f73127fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f731406f980 0x7f731406ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48146/0 (socket says 172.21.15.40:48146) 2023-09-30T22:30:41.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.401+0000 7f73127fc700 1 -- 172.21.15.40:0/1204302068 learned_addr learned my addr 172.21.15.40:0/1204302068 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:41.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.401+0000 7f7312ffd700 1 --2- 172.21.15.40:0/1204302068 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f731406f070 0x7f731406c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.401+0000 7f73137fe700 1 --2- 172.21.15.40:0/1204302068 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f731406fdb0 0x7f731406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.401+0000 7f73127fc700 1 -- 172.21.15.40:0/1204302068 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f731406f070 msgr2=0x7f731406c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:41.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.401+0000 7f73127fc700 1 --2- 172.21.15.40:0/1204302068 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f731406f070 0x7f731406c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.401+0000 7f73127fc700 1 -- 172.21.15.40:0/1204302068 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f731406fdb0 msgr2=0x7f731406d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:41.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.401+0000 7f73127fc700 1 --2- 172.21.15.40:0/1204302068 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f731406fdb0 0x7f731406d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.401+0000 7f73127fc700 1 -- 172.21.15.40:0/1204302068 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7304009550 con 0x7f731406f980 2023-09-30T22:30:41.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.401+0000 7f73127fc700 1 --2- 172.21.15.40:0/1204302068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f731406f980 0x7f731406ced0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f730800e810 tx=0x7f730800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:41.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.401+0000 7f72fb7fe700 1 -- 172.21.15.40:0/1204302068 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7308013610 con 0x7f731406f980 2023-09-30T22:30:41.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.401+0000 7f72fb7fe700 1 -- 172.21.15.40:0/1204302068 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7308013770 con 0x7f731406f980 2023-09-30T22:30:41.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.401+0000 7f7319268700 1 -- 172.21.15.40:0/1204302068 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f731406e210 con 0x7f731406f980 2023-09-30T22:30:41.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.402+0000 7f72fb7fe700 1 -- 172.21.15.40:0/1204302068 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7308013b20 con 0x7f731406f980 2023-09-30T22:30:41.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.402+0000 7f7319268700 1 -- 172.21.15.40:0/1204302068 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f731406de50 con 0x7f731406f980 2023-09-30T22:30:41.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.403+0000 7f7319268700 1 -- 172.21.15.40:0/1204302068 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7314062380 con 0x7f731406f980 2023-09-30T22:30:41.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.403+0000 7f72fb7fe700 1 -- 172.21.15.40:0/1204302068 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7308013c80 con 0x7f731406f980 2023-09-30T22:30:41.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.403+0000 7f72fb7fe700 1 -- 172.21.15.40:0/1204302068 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f730803f780 con 0x7f731406f980 2023-09-30T22:30:41.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.408+0000 7f72fb7fe700 1 -- 172.21.15.40:0/1204302068 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7308026480 con 0x7f731406f980 2023-09-30T22:30:41.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.488+0000 7f0dd179e700 1 Processor -- start 2023-09-30T22:30:41.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.488+0000 7f0dd179e700 1 -- start start 2023-09-30T22:30:41.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.488+0000 7f0dd179e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0dcc06f070 0x7f0dcc06f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.488+0000 7f0dd179e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0dcc06fdb0 0x7f0dcc0977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.488+0000 7f0dd179e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dcc070830 con 0x7f0dcc06f980 2023-09-30T22:30:41.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.488+0000 7f0dd179e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc070ad0 con 0x7f0dcc06f070 2023-09-30T22:30:41.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.488+0000 7f0dd179e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc070de0 con 0x7f0dcc06fdb0 2023-09-30T22:30:41.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.488+0000 7f0dca7fc700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f0dcc06f980 0x7f0dcc097090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33718/0 (socket says 172.21.15.40:33718) 2023-09-30T22:30:41.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.488+0000 7f0dca7fc700 1 -- 172.21.15.40:0/756340459 learned_addr learned my addr 172.21.15.40:0/756340459 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:41.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.488+0000 7f0dcb7fe700 1 --2- 172.21.15.40:0/756340459 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0dcc06fdb0 0x7f0dcc0977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.488+0000 7f0dcaffd700 1 --2- 172.21.15.40:0/756340459 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0dcc06f070 0x7f0dcc06f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.489+0000 7f0dcb7fe700 1 -- 172.21.15.40:0/756340459 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0dcc06f070 msgr2=0x7f0dcc06f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:41.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.489+0000 7f0dcb7fe700 1 --2- 172.21.15.40:0/756340459 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0dcc06f070 0x7f0dcc06f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.489+0000 7f0dcb7fe700 1 -- 172.21.15.40:0/756340459 >> v1:172.21.15.40:6789/0 conn(0x7f0dcc06f980 legacy=0x7f0dcc097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:41.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.489+0000 7f0dcb7fe700 1 -- 172.21.15.40:0/756340459 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dcc09fe20 con 0x7f0dcc06fdb0 2023-09-30T22:30:41.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.489+0000 7f0dcaffd700 1 --2- 172.21.15.40:0/756340459 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0dcc06f070 0x7f0dcc06f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:41.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.489+0000 7f0dcb7fe700 1 --2- 172.21.15.40:0/756340459 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0dcc06fdb0 0x7f0dcc0977a0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4009dc0 tx=0x7f0dc400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57e3da61009e23ca server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:41.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.489+0000 7f0dc9ffb700 1 -- 172.21.15.40:0/756340459 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc400e070 con 0x7f0dcc06fdb0 2023-09-30T22:30:41.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.489+0000 7f0dc9ffb700 1 -- 172.21.15.40:0/756340459 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc4003a20 con 0x7f0dcc06fdb0 2023-09-30T22:30:41.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.489+0000 7f0dc9ffb700 1 -- 172.21.15.40:0/756340459 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc4003dd0 con 0x7f0dcc06fdb0 2023-09-30T22:30:41.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.490+0000 7f0dd179e700 1 -- 172.21.15.40:0/756340459 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0dcc06fdb0 msgr2=0x7f0dcc0977a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:41.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.490+0000 7f0dd179e700 1 --2- 172.21.15.40:0/756340459 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0dcc06fdb0 0x7f0dcc0977a0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4009dc0 tx=0x7f0dc400b330 comp rx=0 tx=0).stop 2023-09-30T22:30:41.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.490+0000 7f0dd179e700 1 -- 172.21.15.40:0/756340459 shutdown_connections 2023-09-30T22:30:41.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.490+0000 7f0dd179e700 1 --2- 172.21.15.40:0/756340459 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0dcc06fdb0 0x7f0dcc0977a0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.490+0000 7f0dd179e700 1 --2- 172.21.15.40:0/756340459 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0dcc06f070 0x7f0dcc06f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.490+0000 7f0dd179e700 1 -- 172.21.15.40:0/756340459 >> 172.21.15.40:0/756340459 conn(0x7f0dcc0a41a0 msgr2=0x7f0dcc0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:41.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.490+0000 7f0dd179e700 1 -- 172.21.15.40:0/756340459 shutdown_connections 2023-09-30T22:30:41.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.490+0000 7f0dd179e700 1 -- 172.21.15.40:0/756340459 wait complete. 2023-09-30T22:30:41.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.492+0000 7f0dd179e700 1 Processor -- start 2023-09-30T22:30:41.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.492+0000 7f0dd179e700 1 -- start start 2023-09-30T22:30:41.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.492+0000 7f0dd179e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0dcc06f070 0x7f0dcc09c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.492+0000 7f0dd179e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0dcc06f980 0x7f0dcc09c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.492+0000 7f0dd179e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0dcc06fdb0 0x7f0dcc09cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.492+0000 7f0dd179e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc12d890 con 0x7f0dcc06fdb0 2023-09-30T22:30:41.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.492+0000 7f0dd179e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc12da70 con 0x7f0dcc06f980 2023-09-30T22:30:41.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.492+0000 7f0dd179e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc06cb30 con 0x7f0dcc06f070 2023-09-30T22:30:41.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.492+0000 7f0dcaffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0dcc06f070 0x7f0dcc09c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.492+0000 7f0dcaffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0dcc06f070 0x7f0dcc09c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:50978/0 (socket says 172.21.15.40:50978) 2023-09-30T22:30:41.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.492+0000 7f0dcaffd700 1 -- 172.21.15.40:0/1917645949 learned_addr learned my addr 172.21.15.40:0/1917645949 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:41.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.492+0000 7f0dcb7fe700 1 --2- 172.21.15.40:0/1917645949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0dcc06fdb0 0x7f0dcc09cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.493+0000 7f0dca7fc700 1 --2- 172.21.15.40:0/1917645949 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0dcc06f980 0x7f0dcc09c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.493+0000 7f0dcaffd700 1 -- 172.21.15.40:0/1917645949 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0dcc06f980 msgr2=0x7f0dcc09c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:41.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.493+0000 7f0dcaffd700 1 --2- 172.21.15.40:0/1917645949 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0dcc06f980 0x7f0dcc09c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.493+0000 7f0dcaffd700 1 -- 172.21.15.40:0/1917645949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0dcc06fdb0 msgr2=0x7f0dcc09cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:41.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.493+0000 7f0dcaffd700 1 --2- 172.21.15.40:0/1917645949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0dcc06fdb0 0x7f0dcc09cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.493+0000 7f0dcaffd700 1 -- 172.21.15.40:0/1917645949 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dbc00d940 con 0x7f0dcc06f070 2023-09-30T22:30:41.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.493+0000 7f0dcb7fe700 1 --2- 172.21.15.40:0/1917645949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0dcc06fdb0 0x7f0dcc09cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:41.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.493+0000 7f0dcaffd700 1 --2- 172.21.15.40:0/1917645949 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0dcc06f070 0x7f0dcc09c2a0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00de30 tx=0x7f0dbc0103a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:41.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.493+0000 7f0db37fe700 1 -- 172.21.15.40:0/1917645949 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc010b00 con 0x7f0dcc06f070 2023-09-30T22:30:41.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.493+0000 7f0db37fe700 1 -- 172.21.15.40:0/1917645949 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dbc013040 con 0x7f0dcc06f070 2023-09-30T22:30:41.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.493+0000 7f0dd179e700 1 -- 172.21.15.40:0/1917645949 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc4009a70 con 0x7f0dcc06f070 2023-09-30T22:30:41.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.493+0000 7f0db37fe700 1 -- 172.21.15.40:0/1917645949 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc010e80 con 0x7f0dcc06f070 2023-09-30T22:30:41.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.493+0000 7f0dd179e700 1 -- 172.21.15.40:0/1917645949 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dcc12e200 con 0x7f0dcc06f070 2023-09-30T22:30:41.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.494+0000 7f0dd179e700 1 -- 172.21.15.40:0/1917645949 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dcc062380 con 0x7f0dcc06f070 2023-09-30T22:30:41.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.495+0000 7f0db37fe700 1 -- 172.21.15.40:0/1917645949 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0dbc018480 con 0x7f0dcc06f070 2023-09-30T22:30:41.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.495+0000 7f0db37fe700 1 -- 172.21.15.40:0/1917645949 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f0dbc0441e0 con 0x7f0dcc06f070 2023-09-30T22:30:41.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.500+0000 7f0db37fe700 1 -- 172.21.15.40:0/1917645949 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0dbc020730 con 0x7f0dcc06f070 2023-09-30T22:30:41.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.510+0000 7f27b1067700 1 Processor -- start 2023-09-30T22:30:41.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.510+0000 7f27b1067700 1 -- start start 2023-09-30T22:30:41.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.511+0000 7f27b1067700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f27ac09d920 0x7f27ac09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.511+0000 7f27b1067700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f27ac09e230 0x7f27ac1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.511+0000 7f27b1067700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27ac09f940 con 0x7f27ac09f0f0 2023-09-30T22:30:41.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.511+0000 7f27b1067700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27ac06b4c0 con 0x7f27ac09d920 2023-09-30T22:30:41.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.511+0000 7f27b1067700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27ac09a8f0 con 0x7f27ac09e230 2023-09-30T22:30:41.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.511+0000 7f27aad9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f27ac09d920 0x7f27ac09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.511+0000 7f27aad9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f27ac09d920 0x7f27ac09dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48172/0 (socket says 172.21.15.40:48172) 2023-09-30T22:30:41.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.511+0000 7f27aad9d700 1 -- 172.21.15.40:0/1505970800 learned_addr learned my addr 172.21.15.40:0/1505970800 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:41.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.511+0000 7f27ab59e700 1 --2- 172.21.15.40:0/1505970800 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f27ac09e230 0x7f27ac1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.511+0000 7f27aad9d700 1 -- 172.21.15.40:0/1505970800 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f27ac09e230 msgr2=0x7f27ac1343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:41.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.511+0000 7f27aad9d700 1 --2- 172.21.15.40:0/1505970800 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f27ac09e230 0x7f27ac1343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.511+0000 7f27aad9d700 1 -- 172.21.15.40:0/1505970800 >> v1:172.21.15.40:6789/0 conn(0x7f27ac09f0f0 legacy=0x7f27ac133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:41.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.511+0000 7f27aad9d700 1 -- 172.21.15.40:0/1505970800 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ac09f6e0 con 0x7f27ac09d920 2023-09-30T22:30:41.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.511+0000 7f27ab59e700 1 --2- 172.21.15.40:0/1505970800 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f27ac09e230 0x7f27ac1343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:41.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.512+0000 7f27aad9d700 1 --2- 172.21.15.40:0/1505970800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27ac09d920 0x7f27ac09dcf0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f279c006fd0 tx=0x7f279c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feb27daaf5eaabd2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:41.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.512+0000 7f27a9d9b700 1 -- 172.21.15.40:0/1505970800 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279c005e30 con 0x7f27ac09d920 2023-09-30T22:30:41.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.512+0000 7f27a9d9b700 1 -- 172.21.15.40:0/1505970800 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f279c004030 con 0x7f27ac09d920 2023-09-30T22:30:41.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.512+0000 7f27a9d9b700 1 -- 172.21.15.40:0/1505970800 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279c0043e0 con 0x7f27ac09d920 2023-09-30T22:30:41.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.513+0000 7f27b1067700 1 -- 172.21.15.40:0/1505970800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27ac09d920 msgr2=0x7f27ac09dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:41.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.513+0000 7f27b1067700 1 --2- 172.21.15.40:0/1505970800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27ac09d920 0x7f27ac09dcf0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f279c006fd0 tx=0x7f279c009bd0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.513+0000 7f27b1067700 1 -- 172.21.15.40:0/1505970800 shutdown_connections 2023-09-30T22:30:41.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.513+0000 7f27b1067700 1 --2- 172.21.15.40:0/1505970800 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f27ac09e230 0x7f27ac1343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.513+0000 7f27b1067700 1 --2- 172.21.15.40:0/1505970800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27ac09d920 0x7f27ac09dcf0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.513+0000 7f27b1067700 1 -- 172.21.15.40:0/1505970800 >> 172.21.15.40:0/1505970800 conn(0x7f27ac09fb20 msgr2=0x7f27ac09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:41.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.513+0000 7f27b1067700 1 -- 172.21.15.40:0/1505970800 shutdown_connections 2023-09-30T22:30:41.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.513+0000 7f27b1067700 1 -- 172.21.15.40:0/1505970800 wait complete. 2023-09-30T22:30:41.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.514+0000 7f27b1067700 1 Processor -- start 2023-09-30T22:30:41.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.514+0000 7f27b1067700 1 -- start start 2023-09-30T22:30:41.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.514+0000 7f27b1067700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f27ac09d920 0x7f27ac1a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.514+0000 7f27b1067700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27ac09e230 0x7f27ac1a68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.514+0000 7f27b1067700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f27ac1a6e10 0x7f27ac1cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.514+0000 7f27b1067700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ac1a7860 con 0x7f27ac09e230 2023-09-30T22:30:41.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.514+0000 7f27b1067700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27ac1b9780 con 0x7f27ac09d920 2023-09-30T22:30:41.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.514+0000 7f27b1067700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27ac1a91f0 con 0x7f27ac1a6e10 2023-09-30T22:30:41.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.515+0000 7f27ab59e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f27ac1a6e10 0x7f27ac1cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.515+0000 7f27aa59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27ac09e230 0x7f27ac1a68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.515+0000 7f27aad9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f27ac09d920 0x7f27ac1a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.515+0000 7f27ab59e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f27ac1a6e10 0x7f27ac1cecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:50996/0 (socket says 172.21.15.40:50996) 2023-09-30T22:30:41.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.515+0000 7f27ab59e700 1 -- 172.21.15.40:0/3757804437 learned_addr learned my addr 172.21.15.40:0/3757804437 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:41.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.515+0000 7f27aad9d700 1 -- 172.21.15.40:0/3757804437 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f27ac1a6e10 msgr2=0x7f27ac1cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:41.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.515+0000 7f27aad9d700 1 --2- 172.21.15.40:0/3757804437 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f27ac1a6e10 0x7f27ac1cecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.515+0000 7f27aad9d700 1 -- 172.21.15.40:0/3757804437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27ac09e230 msgr2=0x7f27ac1a68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:41.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.515+0000 7f27aad9d700 1 --2- 172.21.15.40:0/3757804437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27ac09e230 0x7f27ac1a68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.515+0000 7f27aad9d700 1 -- 172.21.15.40:0/3757804437 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a4009a70 con 0x7f27ac09d920 2023-09-30T22:30:41.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.515+0000 7f27aa59c700 1 --2- 172.21.15.40:0/3757804437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27ac09e230 0x7f27ac1a68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:41.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.515+0000 7f27ab59e700 1 --2- 172.21.15.40:0/3757804437 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f27ac1a6e10 0x7f27ac1cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:41.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.515+0000 7f27aad9d700 1 --2- 172.21.15.40:0/3757804437 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f27ac09d920 0x7f27ac1a6390 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f279c009fd0 tx=0x7f279c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:41.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.515+0000 7f27937fe700 1 -- 172.21.15.40:0/3757804437 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279c003c30 con 0x7f27ac09d920 2023-09-30T22:30:41.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.515+0000 7f27937fe700 1 -- 172.21.15.40:0/3757804437 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f279c003db0 con 0x7f27ac09d920 2023-09-30T22:30:41.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.515+0000 7f27b1067700 1 -- 172.21.15.40:0/3757804437 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f279c009500 con 0x7f27ac09d920 2023-09-30T22:30:41.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.515+0000 7f27937fe700 1 -- 172.21.15.40:0/3757804437 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279c01c660 con 0x7f27ac09d920 2023-09-30T22:30:41.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.516+0000 7f27b1067700 1 -- 172.21.15.40:0/3757804437 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27ac1a9c20 con 0x7f27ac09d920 2023-09-30T22:30:41.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.516+0000 7f27937fe700 1 -- 172.21.15.40:0/3757804437 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f279c01c7c0 con 0x7f27ac09d920 2023-09-30T22:30:41.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.516+0000 7f27937fe700 1 -- 172.21.15.40:0/3757804437 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f279c040570 con 0x7f27ac09d920 2023-09-30T22:30:41.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.517+0000 7f27b1067700 1 -- 172.21.15.40:0/3757804437 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27ac1a9c20 con 0x7f27ac09d920 2023-09-30T22:30:41.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.521+0000 7f27937fe700 1 -- 172.21.15.40:0/3757804437 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f27ac1a9c20 con 0x7f27ac09d920 2023-09-30T22:30:41.647 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:41.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.650+0000 7f7319268700 1 -- 172.21.15.40:0/1204302068 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7314074620 con 0x7f731406f980 2023-09-30T22:30:41.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.650+0000 7f72fb7fe700 1 -- 172.21.15.40:0/1204302068 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f730802b090 con 0x7f731406f980 2023-09-30T22:30:41.651 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:41.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.652+0000 7f7319268700 1 -- 172.21.15.40:0/1204302068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f731406f980 msgr2=0x7f731406ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:41.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.652+0000 7f7319268700 1 --2- 172.21.15.40:0/1204302068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f731406f980 0x7f731406ced0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f730800e810 tx=0x7f730800eb20 comp rx=0 tx=0).stop 2023-09-30T22:30:41.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.652+0000 7f7319268700 1 -- 172.21.15.40:0/1204302068 shutdown_connections 2023-09-30T22:30:41.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.652+0000 7f7319268700 1 --2- 172.21.15.40:0/1204302068 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f731406f070 0x7f731406c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.652+0000 7f7319268700 1 --2- 172.21.15.40:0/1204302068 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f731406fdb0 0x7f731406d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.652+0000 7f7319268700 1 --2- 172.21.15.40:0/1204302068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f731406f980 0x7f731406ced0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.653+0000 7f7319268700 1 -- 172.21.15.40:0/1204302068 >> 172.21.15.40:0/1204302068 conn(0x7f73140a41a0 msgr2=0x7f73140973c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:41.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.653+0000 7f7319268700 1 -- 172.21.15.40:0/1204302068 shutdown_connections 2023-09-30T22:30:41.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.653+0000 7f7319268700 1 -- 172.21.15.40:0/1204302068 wait complete. 2023-09-30T22:30:41.667 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:41.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.702+0000 7f0dd179e700 1 -- 172.21.15.40:0/1917645949 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0dcc074620 con 0x7f0dcc06f070 2023-09-30T22:30:41.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.703+0000 7f0db37fe700 1 -- 172.21.15.40:0/1917645949 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0dbc020370 con 0x7f0dcc06f070 2023-09-30T22:30:41.703 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:41.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.705+0000 7f0dd179e700 1 -- 172.21.15.40:0/1917645949 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0dcc06f070 msgr2=0x7f0dcc09c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:41.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.705+0000 7f0dd179e700 1 --2- 172.21.15.40:0/1917645949 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0dcc06f070 0x7f0dcc09c2a0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00de30 tx=0x7f0dbc0103a0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.705+0000 7f0dd179e700 1 -- 172.21.15.40:0/1917645949 shutdown_connections 2023-09-30T22:30:41.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.705+0000 7f0dd179e700 1 --2- 172.21.15.40:0/1917645949 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0dcc06f070 0x7f0dcc09c2a0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.705+0000 7f0dd179e700 1 --2- 172.21.15.40:0/1917645949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0dcc06fdb0 0x7f0dcc09cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.705+0000 7f0dd179e700 1 --2- 172.21.15.40:0/1917645949 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0dcc06f980 0x7f0dcc09c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.705+0000 7f0dd179e700 1 -- 172.21.15.40:0/1917645949 >> 172.21.15.40:0/1917645949 conn(0x7f0dcc0a41a0 msgr2=0x7f0dcc0975c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:41.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.705+0000 7f0dd179e700 1 -- 172.21.15.40:0/1917645949 shutdown_connections 2023-09-30T22:30:41.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.705+0000 7f0dd179e700 1 -- 172.21.15.40:0/1917645949 wait complete. 2023-09-30T22:30:41.718 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:41.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.739+0000 7f27b1067700 1 -- 172.21.15.40:0/3757804437 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f27ac1a9c20 con 0x7f27ac09d920 2023-09-30T22:30:41.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.739+0000 7f27937fe700 1 -- 172.21.15.40:0/3757804437 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f27ac1a9c20 con 0x7f27ac09d920 2023-09-30T22:30:41.740 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:41.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.742+0000 7f27b1067700 1 -- 172.21.15.40:0/3757804437 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f27ac09d920 msgr2=0x7f27ac1a6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:41.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.742+0000 7f27b1067700 1 --2- 172.21.15.40:0/3757804437 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f27ac09d920 0x7f27ac1a6390 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f279c009fd0 tx=0x7f279c004750 comp rx=0 tx=0).stop 2023-09-30T22:30:41.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.742+0000 7f27b1067700 1 -- 172.21.15.40:0/3757804437 shutdown_connections 2023-09-30T22:30:41.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.742+0000 7f27b1067700 1 --2- 172.21.15.40:0/3757804437 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f27ac1a6e10 0x7f27ac1cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.742+0000 7f27b1067700 1 --2- 172.21.15.40:0/3757804437 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f27ac09d920 0x7f27ac1a6390 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.742+0000 7f27b1067700 1 --2- 172.21.15.40:0/3757804437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27ac09e230 0x7f27ac1a68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.742+0000 7f27b1067700 1 -- 172.21.15.40:0/3757804437 >> 172.21.15.40:0/3757804437 conn(0x7f27ac09fb20 msgr2=0x7f27ac1bb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:41.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.742+0000 7f27b1067700 1 -- 172.21.15.40:0/3757804437 shutdown_connections 2023-09-30T22:30:41.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.742+0000 7f27b1067700 1 -- 172.21.15.40:0/3757804437 wait complete. 2023-09-30T22:30:41.755 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:41.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.779+0000 7f36179b4700 1 Processor -- start 2023-09-30T22:30:41.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.779+0000 7f36179b4700 1 -- start start 2023-09-30T22:30:41.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.779+0000 7f36179b4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f361009d920 0x7f361009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.779+0000 7f36179b4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f361009f0f0 0x7f361009e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.779+0000 7f36179b4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3610133ca0 0x7f3610134110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.779+0000 7f36179b4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f361006b4c0 con 0x7f361009d920 2023-09-30T22:30:41.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.779+0000 7f36179b4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361009a8f0 con 0x7f3610133ca0 2023-09-30T22:30:41.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.779+0000 7f36179b4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f361009f940 con 0x7f361009f0f0 2023-09-30T22:30:41.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.780+0000 7f3615750700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f361009d920 0x7f361009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.780+0000 7f3614f4f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f361009f0f0 0x7f361009e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.780+0000 7f3615750700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f361009d920 0x7f361009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48190/0 (socket says 172.21.15.40:48190) 2023-09-30T22:30:41.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.780+0000 7f3614f4f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f361009f0f0 0x7f361009e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51012/0 (socket says 172.21.15.40:51012) 2023-09-30T22:30:41.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.780+0000 7f3615750700 1 -- 172.21.15.40:0/1965304252 learned_addr learned my addr 172.21.15.40:0/1965304252 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:41.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.780+0000 7f3615f51700 1 --2- 172.21.15.40:0/1965304252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3610133ca0 0x7f3610134110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.780+0000 7f3614f4f700 1 -- 172.21.15.40:0/1965304252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3610133ca0 msgr2=0x7f3610134110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:41.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.780+0000 7f3614f4f700 1 --2- 172.21.15.40:0/1965304252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3610133ca0 0x7f3610134110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.780+0000 7f3614f4f700 1 -- 172.21.15.40:0/1965304252 >> v2:172.21.15.40:3300/0 conn(0x7f361009d920 msgr2=0x7f361009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:41.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.780+0000 7f3614f4f700 1 --2- 172.21.15.40:0/1965304252 >> v2:172.21.15.40:3300/0 conn(0x7f361009d920 0x7f361009dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.780+0000 7f3614f4f700 1 -- 172.21.15.40:0/1965304252 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361009f6e0 con 0x7f361009f0f0 2023-09-30T22:30:41.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.780+0000 7f3615f51700 1 --2- 172.21.15.40:0/1965304252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3610133ca0 0x7f3610134110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:41.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.780+0000 7f3615750700 1 --2- 172.21.15.40:0/1965304252 >> v2:172.21.15.40:3300/0 conn(0x7f361009d920 0x7f361009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:41.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.780+0000 7f3614f4f700 1 --2- 172.21.15.40:0/1965304252 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f361009f0f0 0x7f361009e230 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f360c009870 tx=0x7f360c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7070c28534240506 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:41.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.780+0000 7f3603fff700 1 -- 172.21.15.40:0/1965304252 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360c011830 con 0x7f361009f0f0 2023-09-30T22:30:41.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.780+0000 7f3603fff700 1 -- 172.21.15.40:0/1965304252 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360c011990 con 0x7f361009f0f0 2023-09-30T22:30:41.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.780+0000 7f3603fff700 1 -- 172.21.15.40:0/1965304252 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360c011d20 con 0x7f361009f0f0 2023-09-30T22:30:41.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.781+0000 7f36179b4700 1 -- 172.21.15.40:0/1965304252 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f361009f0f0 msgr2=0x7f361009e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:41.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.781+0000 7f36179b4700 1 --2- 172.21.15.40:0/1965304252 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f361009f0f0 0x7f361009e230 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f360c009870 tx=0x7f360c009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:41.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.781+0000 7f36179b4700 1 -- 172.21.15.40:0/1965304252 shutdown_connections 2023-09-30T22:30:41.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.781+0000 7f36179b4700 1 --2- 172.21.15.40:0/1965304252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3610133ca0 0x7f3610134110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.781+0000 7f36179b4700 1 --2- 172.21.15.40:0/1965304252 >> v2:172.21.15.40:3300/0 conn(0x7f361009d920 0x7f361009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.781+0000 7f36179b4700 1 --2- 172.21.15.40:0/1965304252 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f361009f0f0 0x7f361009e230 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.781+0000 7f36179b4700 1 -- 172.21.15.40:0/1965304252 >> 172.21.15.40:0/1965304252 conn(0x7f361009fb20 msgr2=0x7f361009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:41.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.781+0000 7f36179b4700 1 -- 172.21.15.40:0/1965304252 shutdown_connections 2023-09-30T22:30:41.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.781+0000 7f36179b4700 1 -- 172.21.15.40:0/1965304252 wait complete. 2023-09-30T22:30:41.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.782+0000 7f36179b4700 1 Processor -- start 2023-09-30T22:30:41.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.782+0000 7f36179b4700 1 -- start start 2023-09-30T22:30:41.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.782+0000 7f36179b4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f361009d920 0x7f361011f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.782+0000 7f36179b4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3610133ca0 0x7f361011fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.782+0000 7f36179b4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36101c8960 0x7f36101c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:41.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.782+0000 7f36179b4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3610133790 con 0x7f361009d920 2023-09-30T22:30:41.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.782+0000 7f36179b4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361011f4b0 con 0x7f36101c8960 2023-09-30T22:30:41.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.782+0000 7f36179b4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3610122a20 con 0x7f3610133ca0 2023-09-30T22:30:41.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.782+0000 7f3615750700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f361009d920 0x7f361011f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.782+0000 7f3615750700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f361009d920 0x7f361011f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48202/0 (socket says 172.21.15.40:48202) 2023-09-30T22:30:41.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.782+0000 7f3615750700 1 -- 172.21.15.40:0/3336520279 learned_addr learned my addr 172.21.15.40:0/3336520279 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:41.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.782+0000 7f3615f51700 1 --2- 172.21.15.40:0/3336520279 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36101c8960 0x7f36101c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.782+0000 7f3614f4f700 1 --2- 172.21.15.40:0/3336520279 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3610133ca0 0x7f361011fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:41.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.783+0000 7f3614f4f700 1 -- 172.21.15.40:0/3336520279 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36101c8960 msgr2=0x7f36101c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:41.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.783+0000 7f3614f4f700 1 --2- 172.21.15.40:0/3336520279 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36101c8960 0x7f36101c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.783+0000 7f3614f4f700 1 -- 172.21.15.40:0/3336520279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f361009d920 msgr2=0x7f361011f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:41.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.783+0000 7f3614f4f700 1 --2- 172.21.15.40:0/3336520279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f361009d920 0x7f361011f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.783+0000 7f3614f4f700 1 -- 172.21.15.40:0/3336520279 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3604009500 con 0x7f3610133ca0 2023-09-30T22:30:41.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.783+0000 7f3615750700 1 --2- 172.21.15.40:0/3336520279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f361009d920 0x7f361011f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:41.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.783+0000 7f3614f4f700 1 --2- 172.21.15.40:0/3336520279 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3610133ca0 0x7f361011fee0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f360c009870 tx=0x7f360c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:41.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.783+0000 7f3601ffb700 1 -- 172.21.15.40:0/3336520279 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360c004450 con 0x7f3610133ca0 2023-09-30T22:30:41.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.783+0000 7f3601ffb700 1 -- 172.21.15.40:0/3336520279 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360c01f070 con 0x7f3610133ca0 2023-09-30T22:30:41.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.783+0000 7f36179b4700 1 -- 172.21.15.40:0/3336520279 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3608009a70 con 0x7f3610133ca0 2023-09-30T22:30:41.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.783+0000 7f3601ffb700 1 -- 172.21.15.40:0/3336520279 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360c0038a0 con 0x7f3610133ca0 2023-09-30T22:30:41.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.783+0000 7f36179b4700 1 -- 172.21.15.40:0/3336520279 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f360c0094a0 con 0x7f3610133ca0 2023-09-30T22:30:41.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.784+0000 7f3601ffb700 1 -- 172.21.15.40:0/3336520279 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f360c003a00 con 0x7f3610133ca0 2023-09-30T22:30:41.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.784+0000 7f3601ffb700 1 -- 172.21.15.40:0/3336520279 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f360c021070 con 0x7f3610133ca0 2023-09-30T22:30:41.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.784+0000 7f36179b4700 1 -- 172.21.15.40:0/3336520279 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36101224a0 con 0x7f3610133ca0 2023-09-30T22:30:41.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.789+0000 7f3601ffb700 1 -- 172.21.15.40:0/3336520279 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f36101224a0 con 0x7f3610133ca0 2023-09-30T22:30:41.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.988+0000 7f36179b4700 1 -- 172.21.15.40:0/3336520279 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f36101224a0 con 0x7f3610133ca0 2023-09-30T22:30:41.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.989+0000 7f3601ffb700 1 -- 172.21.15.40:0/3336520279 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f36101224a0 con 0x7f3610133ca0 2023-09-30T22:30:41.990 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:41.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.991+0000 7f36179b4700 1 -- 172.21.15.40:0/3336520279 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3610133ca0 msgr2=0x7f361011fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:41.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.991+0000 7f36179b4700 1 --2- 172.21.15.40:0/3336520279 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3610133ca0 0x7f361011fee0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f360c009870 tx=0x7f360c004750 comp rx=0 tx=0).stop 2023-09-30T22:30:41.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.991+0000 7f36179b4700 1 -- 172.21.15.40:0/3336520279 shutdown_connections 2023-09-30T22:30:41.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.991+0000 7f36179b4700 1 --2- 172.21.15.40:0/3336520279 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f36101c8960 0x7f36101c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.991+0000 7f36179b4700 1 --2- 172.21.15.40:0/3336520279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f361009d920 0x7f361011f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.991+0000 7f36179b4700 1 --2- 172.21.15.40:0/3336520279 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3610133ca0 0x7f361011fee0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:41.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.991+0000 7f36179b4700 1 -- 172.21.15.40:0/3336520279 >> 172.21.15.40:0/3336520279 conn(0x7f361009fb20 msgr2=0x7f36100a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:41.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.991+0000 7f36179b4700 1 -- 172.21.15.40:0/3336520279 shutdown_connections 2023-09-30T22:30:41.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:41.991+0000 7f36179b4700 1 -- 172.21.15.40:0/3336520279 wait complete. 2023-09-30T22:30:42.006 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:42.669 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:42.719 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:42.756 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:42.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.807+0000 7f2e1af0b700 1 Processor -- start 2023-09-30T22:30:42.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.807+0000 7f2e1af0b700 1 -- start start 2023-09-30T22:30:42.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.808+0000 7f2e1af0b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2e1409d920 0x7f2e1409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.808+0000 7f2e1af0b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e1409f0f0 0x7f2e1409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.808+0000 7f2e1af0b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e14133ca0 0x7f2e14134110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.808+0000 7f2e1af0b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e1406b4c0 con 0x7f2e1409d920 2023-09-30T22:30:42.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.808+0000 7f2e1af0b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1409a8f0 con 0x7f2e14133ca0 2023-09-30T22:30:42.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.808+0000 7f2e1af0b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1409f940 con 0x7f2e1409f0f0 2023-09-30T22:30:42.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.808+0000 7f2e18ca7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2e1409d920 0x7f2e1409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.808+0000 7f2e18ca7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2e1409d920 0x7f2e1409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48216/0 (socket says 172.21.15.40:48216) 2023-09-30T22:30:42.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.808+0000 7f2e18ca7700 1 -- 172.21.15.40:0/1964751874 learned_addr learned my addr 172.21.15.40:0/1964751874 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:42.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.808+0000 7f2e13fff700 1 --2- 172.21.15.40:0/1964751874 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e1409f0f0 0x7f2e1409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.808+0000 7f2e194a8700 1 --2- 172.21.15.40:0/1964751874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e14133ca0 0x7f2e14134110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.808+0000 7f2e18ca7700 1 -- 172.21.15.40:0/1964751874 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e1409f0f0 msgr2=0x7f2e1409e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:42.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.808+0000 7f2e18ca7700 1 --2- 172.21.15.40:0/1964751874 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e1409f0f0 0x7f2e1409e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.808+0000 7f2e18ca7700 1 -- 172.21.15.40:0/1964751874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e14133ca0 msgr2=0x7f2e14134110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:42.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.808+0000 7f2e18ca7700 1 --2- 172.21.15.40:0/1964751874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e14133ca0 0x7f2e14134110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.808+0000 7f2e18ca7700 1 -- 172.21.15.40:0/1964751874 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1409f6e0 con 0x7f2e1409d920 2023-09-30T22:30:42.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.808+0000 7f2e13fff700 1 --2- 172.21.15.40:0/1964751874 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e1409f0f0 0x7f2e1409e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:42.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.808+0000 7f2e194a8700 1 --2- 172.21.15.40:0/1964751874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e14133ca0 0x7f2e14134110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:42.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.808+0000 7f2e18ca7700 1 --2- 172.21.15.40:0/1964751874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e1409d920 0x7f2e1409dcf0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f2e080098f0 tx=0x7f2e08009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfded9f4fff631d2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:42.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.809+0000 7f2e137fe700 1 -- 172.21.15.40:0/1964751874 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e08005e30 con 0x7f2e1409d920 2023-09-30T22:30:42.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.809+0000 7f2e137fe700 1 -- 172.21.15.40:0/1964751874 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e08004030 con 0x7f2e1409d920 2023-09-30T22:30:42.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.809+0000 7f2e137fe700 1 -- 172.21.15.40:0/1964751874 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e080043e0 con 0x7f2e1409d920 2023-09-30T22:30:42.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.809+0000 7f2e1af0b700 1 -- 172.21.15.40:0/1964751874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e1409d920 msgr2=0x7f2e1409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:42.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.809+0000 7f2e1af0b700 1 --2- 172.21.15.40:0/1964751874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e1409d920 0x7f2e1409dcf0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f2e080098f0 tx=0x7f2e08009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:42.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.809+0000 7f2e1af0b700 1 -- 172.21.15.40:0/1964751874 shutdown_connections 2023-09-30T22:30:42.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.809+0000 7f2e1af0b700 1 --2- 172.21.15.40:0/1964751874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e14133ca0 0x7f2e14134110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.809+0000 7f2e1af0b700 1 --2- 172.21.15.40:0/1964751874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e1409d920 0x7f2e1409dcf0 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.809+0000 7f2e1af0b700 1 --2- 172.21.15.40:0/1964751874 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e1409f0f0 0x7f2e1409e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.809+0000 7f2e1af0b700 1 -- 172.21.15.40:0/1964751874 >> 172.21.15.40:0/1964751874 conn(0x7f2e1409fb20 msgr2=0x7f2e1409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:42.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.809+0000 7f2e1af0b700 1 -- 172.21.15.40:0/1964751874 shutdown_connections 2023-09-30T22:30:42.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.809+0000 7f2e1af0b700 1 -- 172.21.15.40:0/1964751874 wait complete. 2023-09-30T22:30:42.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.810+0000 7f2e1af0b700 1 Processor -- start 2023-09-30T22:30:42.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.810+0000 7f2e1af0b700 1 -- start start 2023-09-30T22:30:42.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.811+0000 7f2e1af0b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e1409d920 0x7f2e14120470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.811+0000 7f2e1af0b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e14133ca0 0x7f2e141209b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.811+0000 7f2e1af0b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e14124490 0x7f2e14120ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.811+0000 7f2e1af0b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e14121900 con 0x7f2e1409d920 2023-09-30T22:30:42.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.811+0000 7f2e1af0b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e14122080 con 0x7f2e14124490 2023-09-30T22:30:42.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.811+0000 7f2e1af0b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e141226a0 con 0x7f2e14133ca0 2023-09-30T22:30:42.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.811+0000 7f2e18ca7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e1409d920 0x7f2e14120470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.811+0000 7f2e18ca7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e1409d920 0x7f2e14120470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48232/0 (socket says 172.21.15.40:48232) 2023-09-30T22:30:42.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.811+0000 7f2e18ca7700 1 -- 172.21.15.40:0/1020928305 learned_addr learned my addr 172.21.15.40:0/1020928305 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:42.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.811+0000 7f2e194a8700 1 --2- 172.21.15.40:0/1020928305 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e14124490 0x7f2e14120ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.811+0000 7f2e13fff700 1 --2- 172.21.15.40:0/1020928305 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e14133ca0 0x7f2e141209b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.811+0000 7f2e18ca7700 1 -- 172.21.15.40:0/1020928305 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e14133ca0 msgr2=0x7f2e141209b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:42.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.811+0000 7f2e18ca7700 1 --2- 172.21.15.40:0/1020928305 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e14133ca0 0x7f2e141209b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.811+0000 7f2e18ca7700 1 -- 172.21.15.40:0/1020928305 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e14124490 msgr2=0x7f2e14120ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:42.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.811+0000 7f2e18ca7700 1 --2- 172.21.15.40:0/1020928305 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e14124490 0x7f2e14120ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.811+0000 7f2e18ca7700 1 -- 172.21.15.40:0/1020928305 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e000094a0 con 0x7f2e1409d920 2023-09-30T22:30:42.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.812+0000 7f2e194a8700 1 --2- 172.21.15.40:0/1020928305 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e14124490 0x7f2e14120ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:42.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.812+0000 7f2e18ca7700 1 --2- 172.21.15.40:0/1020928305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e1409d920 0x7f2e14120470 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f2e08000c00 tx=0x7f2e08004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:42.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.812+0000 7f2e117fa700 1 -- 172.21.15.40:0/1020928305 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e08003ce0 con 0x7f2e1409d920 2023-09-30T22:30:42.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.812+0000 7f2e117fa700 1 -- 172.21.15.40:0/1020928305 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e08003e40 con 0x7f2e1409d920 2023-09-30T22:30:42.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.812+0000 7f2e1af0b700 1 -- 172.21.15.40:0/1020928305 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e0c009a70 con 0x7f2e1409d920 2023-09-30T22:30:42.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.812+0000 7f2e117fa700 1 -- 172.21.15.40:0/1020928305 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e08011660 con 0x7f2e1409d920 2023-09-30T22:30:42.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.812+0000 7f2e1af0b700 1 -- 172.21.15.40:0/1020928305 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e08009500 con 0x7f2e1409d920 2023-09-30T22:30:42.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.813+0000 7f2e117fa700 1 -- 172.21.15.40:0/1020928305 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2e08018070 con 0x7f2e1409d920 2023-09-30T22:30:42.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.813+0000 7f2e1af0b700 1 -- 172.21.15.40:0/1020928305 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e14071700 con 0x7f2e1409d920 2023-09-30T22:30:42.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.813+0000 7f2e117fa700 1 -- 172.21.15.40:0/1020928305 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f2e08040000 con 0x7f2e1409d920 2023-09-30T22:30:42.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.822+0000 7f2e117fa700 1 -- 172.21.15.40:0/1020928305 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e080117c0 con 0x7f2e1409d920 2023-09-30T22:30:42.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.854+0000 7f3152f10700 1 Processor -- start 2023-09-30T22:30:42.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.854+0000 7f3152f10700 1 -- start start 2023-09-30T22:30:42.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.855+0000 7f3152f10700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f314c06f070 0x7f314c06f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.855+0000 7f3152f10700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f314c06fdb0 0x7f314c0977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.855+0000 7f3152f10700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f314c070830 con 0x7f314c06f980 2023-09-30T22:30:42.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.855+0000 7f3152f10700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f314c070ad0 con 0x7f314c06f070 2023-09-30T22:30:42.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.855+0000 7f3152f10700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f314c070de0 con 0x7f314c06fdb0 2023-09-30T22:30:42.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.855+0000 7f31514ad700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f314c06fdb0 0x7f314c0977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.855+0000 7f314bfff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f314c06f980 0x7f314c097090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33728/0 (socket says 172.21.15.40:33728) 2023-09-30T22:30:42.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.855+0000 7f3150cac700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f314c06f070 0x7f314c06f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.855+0000 7f314bfff700 1 -- 172.21.15.40:0/4237911496 learned_addr learned my addr 172.21.15.40:0/4237911496 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:42.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.855+0000 7f31514ad700 1 -- 172.21.15.40:0/4237911496 >> v2:172.21.15.40:3300/0 conn(0x7f314c06f070 msgr2=0x7f314c06f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:42.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.855+0000 7f31514ad700 1 --2- 172.21.15.40:0/4237911496 >> v2:172.21.15.40:3300/0 conn(0x7f314c06f070 0x7f314c06f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.855+0000 7f31514ad700 1 -- 172.21.15.40:0/4237911496 >> v1:172.21.15.40:6789/0 conn(0x7f314c06f980 legacy=0x7f314c097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:42.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.855+0000 7f31514ad700 1 -- 172.21.15.40:0/4237911496 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314c09fe20 con 0x7f314c06fdb0 2023-09-30T22:30:42.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.856+0000 7f31514ad700 1 --2- 172.21.15.40:0/4237911496 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f314c06fdb0 0x7f314c0977a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f3144009d90 tx=0x7f314400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4269ff8ff06b98b3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:42.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.856+0000 7f314b7fe700 1 -- 172.21.15.40:0/4237911496 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314400e070 con 0x7f314c06fdb0 2023-09-30T22:30:42.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.856+0000 7f314b7fe700 1 -- 172.21.15.40:0/4237911496 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314400bb20 con 0x7f314c06fdb0 2023-09-30T22:30:42.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.856+0000 7f314b7fe700 1 -- 172.21.15.40:0/4237911496 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3144012430 con 0x7f314c06fdb0 2023-09-30T22:30:42.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.856+0000 7f3152f10700 1 -- 172.21.15.40:0/4237911496 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f314c06fdb0 msgr2=0x7f314c0977a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:42.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.856+0000 7f3152f10700 1 --2- 172.21.15.40:0/4237911496 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f314c06fdb0 0x7f314c0977a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f3144009d90 tx=0x7f314400b330 comp rx=0 tx=0).stop 2023-09-30T22:30:42.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.856+0000 7f3152f10700 1 -- 172.21.15.40:0/4237911496 shutdown_connections 2023-09-30T22:30:42.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.856+0000 7f3152f10700 1 --2- 172.21.15.40:0/4237911496 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f314c06fdb0 0x7f314c0977a0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.856+0000 7f3152f10700 1 --2- 172.21.15.40:0/4237911496 >> v2:172.21.15.40:3300/0 conn(0x7f314c06f070 0x7f314c06f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.856+0000 7f3152f10700 1 -- 172.21.15.40:0/4237911496 >> 172.21.15.40:0/4237911496 conn(0x7f314c0a41a0 msgr2=0x7f314c0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:42.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.856+0000 7f3152f10700 1 -- 172.21.15.40:0/4237911496 shutdown_connections 2023-09-30T22:30:42.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.857+0000 7f3152f10700 1 -- 172.21.15.40:0/4237911496 wait complete. 2023-09-30T22:30:42.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.857+0000 7f3152f10700 1 Processor -- start 2023-09-30T22:30:42.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.857+0000 7f3152f10700 1 -- start start 2023-09-30T22:30:42.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.858+0000 7f3152f10700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f314c06f070 0x7f314c09b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.858+0000 7f3152f10700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f314c06f980 0x7f314c09bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.858+0000 7f3152f10700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f314c06fdb0 0x7f314c09c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.858+0000 7f3152f10700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314c08b480 con 0x7f314c06f980 2023-09-30T22:30:42.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.858+0000 7f3152f10700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f314c12c2d0 con 0x7f314c06fdb0 2023-09-30T22:30:42.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.858+0000 7f3152f10700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f314c096eb0 con 0x7f314c06f070 2023-09-30T22:30:42.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.858+0000 7f3150cac700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f314c06f070 0x7f314c09b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.858+0000 7f3150cac700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f314c06f070 0x7f314c09b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51078/0 (socket says 172.21.15.40:51078) 2023-09-30T22:30:42.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.858+0000 7f3150cac700 1 -- 172.21.15.40:0/2843853949 learned_addr learned my addr 172.21.15.40:0/2843853949 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:42.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.858+0000 7f31514ad700 1 --2- 172.21.15.40:0/2843853949 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f314c06fdb0 0x7f314c09c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.858+0000 7f314bfff700 1 --2- 172.21.15.40:0/2843853949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f314c06f980 0x7f314c09bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.858+0000 7f3150cac700 1 -- 172.21.15.40:0/2843853949 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f314c06fdb0 msgr2=0x7f314c09c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:42.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.858+0000 7f3150cac700 1 --2- 172.21.15.40:0/2843853949 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f314c06fdb0 0x7f314c09c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.858+0000 7f3150cac700 1 -- 172.21.15.40:0/2843853949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f314c06f980 msgr2=0x7f314c09bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:42.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.859+0000 7f3150cac700 1 --2- 172.21.15.40:0/2843853949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f314c06f980 0x7f314c09bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.859+0000 7f3150cac700 1 -- 172.21.15.40:0/2843853949 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3144009a70 con 0x7f314c06f070 2023-09-30T22:30:42.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.859+0000 7f3150cac700 1 --2- 172.21.15.40:0/2843853949 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f314c06f070 0x7f314c09b5a0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f314000e9b0 tx=0x7f314000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:42.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.859+0000 7f31497fa700 1 -- 172.21.15.40:0/2843853949 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3140009710 con 0x7f314c06f070 2023-09-30T22:30:42.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.859+0000 7f31497fa700 1 -- 172.21.15.40:0/2843853949 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314000ee50 con 0x7f314c06f070 2023-09-30T22:30:42.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.859+0000 7f3152f10700 1 -- 172.21.15.40:0/2843853949 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f314c08b680 con 0x7f314c06f070 2023-09-30T22:30:42.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.859+0000 7f31497fa700 1 -- 172.21.15.40:0/2843853949 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314000ca50 con 0x7f314c06f070 2023-09-30T22:30:42.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.859+0000 7f3152f10700 1 -- 172.21.15.40:0/2843853949 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f314c130b40 con 0x7f314c06f070 2023-09-30T22:30:42.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.860+0000 7f31497fa700 1 -- 172.21.15.40:0/2843853949 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f314000cbb0 con 0x7f314c06f070 2023-09-30T22:30:42.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.860+0000 7f31497fa700 1 -- 172.21.15.40:0/2843853949 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f314003fab0 con 0x7f314c06f070 2023-09-30T22:30:42.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.860+0000 7f3152f10700 1 -- 172.21.15.40:0/2843853949 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f314c062380 con 0x7f314c06f070 2023-09-30T22:30:42.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.865+0000 7f31497fa700 1 -- 172.21.15.40:0/2843853949 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3140021080 con 0x7f314c06f070 2023-09-30T22:30:42.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.902+0000 7f15d093a700 1 Processor -- start 2023-09-30T22:30:42.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.902+0000 7f15d093a700 1 -- start start 2023-09-30T22:30:42.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.902+0000 7f15d093a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f15cc06a6d0 0x7f15cc06aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.902+0000 7f15d093a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15cc06afe0 0x7f15cc1318b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.902+0000 7f15d093a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f15cc131df0 0x7f15cc132290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.902+0000 7f15d093a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15cc09eb50 con 0x7f15cc131df0 2023-09-30T22:30:42.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.902+0000 7f15d093a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc09dde0 con 0x7f15cc06afe0 2023-09-30T22:30:42.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.902+0000 7f15d093a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc09d4a0 con 0x7f15cc06a6d0 2023-09-30T22:30:42.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.903+0000 7f15c9d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15cc06afe0 0x7f15cc1318b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.903+0000 7f15c9d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15cc06afe0 0x7f15cc1318b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48108/0 (socket says 172.21.15.40:48108) 2023-09-30T22:30:42.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.903+0000 7f15c9d9b700 1 -- 172.21.15.40:0/1175399554 learned_addr learned my addr 172.21.15.40:0/1175399554 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:42.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.903+0000 7f15cad9d700 1 --2- 172.21.15.40:0/1175399554 >> v2:172.21.15.40:3300/0 conn(0x7f15cc131df0 0x7f15cc132290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.903+0000 7f15ca59c700 1 --2- 172.21.15.40:0/1175399554 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f15cc06a6d0 0x7f15cc06aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.903+0000 7f15c9d9b700 1 -- 172.21.15.40:0/1175399554 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f15cc06a6d0 msgr2=0x7f15cc06aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:42.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.903+0000 7f15c9d9b700 1 --2- 172.21.15.40:0/1175399554 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f15cc06a6d0 0x7f15cc06aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.903+0000 7f15c9d9b700 1 -- 172.21.15.40:0/1175399554 >> v2:172.21.15.40:3300/0 conn(0x7f15cc131df0 msgr2=0x7f15cc132290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:42.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.903+0000 7f15c9d9b700 1 --2- 172.21.15.40:0/1175399554 >> v2:172.21.15.40:3300/0 conn(0x7f15cc131df0 0x7f15cc132290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.903+0000 7f15c9d9b700 1 -- 172.21.15.40:0/1175399554 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15cc09f5f0 con 0x7f15cc06afe0 2023-09-30T22:30:42.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.903+0000 7f15ca59c700 1 --2- 172.21.15.40:0/1175399554 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f15cc06a6d0 0x7f15cc06aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:42.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.903+0000 7f15cad9d700 1 --2- 172.21.15.40:0/1175399554 >> v2:172.21.15.40:3300/0 conn(0x7f15cc131df0 0x7f15cc132290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:42.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.903+0000 7f15c9d9b700 1 --2- 172.21.15.40:0/1175399554 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15cc06afe0 0x7f15cc1318b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f15c00098f0 tx=0x7f15c0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc9f8a77e9fce17b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:42.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.903+0000 7f15c959a700 1 -- 172.21.15.40:0/1175399554 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c0011830 con 0x7f15cc06afe0 2023-09-30T22:30:42.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.903+0000 7f15c959a700 1 -- 172.21.15.40:0/1175399554 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c0011990 con 0x7f15cc06afe0 2023-09-30T22:30:42.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.903+0000 7f15c959a700 1 -- 172.21.15.40:0/1175399554 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c0011d20 con 0x7f15cc06afe0 2023-09-30T22:30:42.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.904+0000 7f15d093a700 1 -- 172.21.15.40:0/1175399554 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15cc06afe0 msgr2=0x7f15cc1318b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:42.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.904+0000 7f15d093a700 1 --2- 172.21.15.40:0/1175399554 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15cc06afe0 0x7f15cc1318b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f15c00098f0 tx=0x7f15c0009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:42.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.904+0000 7f15d093a700 1 -- 172.21.15.40:0/1175399554 shutdown_connections 2023-09-30T22:30:42.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.904+0000 7f15d093a700 1 --2- 172.21.15.40:0/1175399554 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f15cc06a6d0 0x7f15cc06aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.904+0000 7f15d093a700 1 --2- 172.21.15.40:0/1175399554 >> v2:172.21.15.40:3300/0 conn(0x7f15cc131df0 0x7f15cc132290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.904+0000 7f15d093a700 1 --2- 172.21.15.40:0/1175399554 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15cc06afe0 0x7f15cc1318b0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.904+0000 7f15d093a700 1 -- 172.21.15.40:0/1175399554 >> 172.21.15.40:0/1175399554 conn(0x7f15cc09fb20 msgr2=0x7f15cc09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:42.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.904+0000 7f15d093a700 1 -- 172.21.15.40:0/1175399554 shutdown_connections 2023-09-30T22:30:42.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.904+0000 7f15d093a700 1 -- 172.21.15.40:0/1175399554 wait complete. 2023-09-30T22:30:42.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.905+0000 7f15d093a700 1 Processor -- start 2023-09-30T22:30:42.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.905+0000 7f15d093a700 1 -- start start 2023-09-30T22:30:42.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.906+0000 7f15d093a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f15cc06a6d0 0x7f15cc09ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.906+0000 7f15d093a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15cc06afe0 0x7f15cc09b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.906+0000 7f15d093a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15cc131df0 0x7f15cc1c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:42.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.906+0000 7f15d093a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc120fc0 con 0x7f15cc131df0 2023-09-30T22:30:42.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.906+0000 7f15d093a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc131280 con 0x7f15cc06afe0 2023-09-30T22:30:42.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.906+0000 7f15d093a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc131880 con 0x7f15cc06a6d0 2023-09-30T22:30:42.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.906+0000 7f15c9d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15cc06afe0 0x7f15cc09b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.906+0000 7f15c9d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15cc06afe0 0x7f15cc09b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:48122/0 (socket says 172.21.15.40:48122) 2023-09-30T22:30:42.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.906+0000 7f15c9d9b700 1 -- 172.21.15.40:0/2157433964 learned_addr learned my addr 172.21.15.40:0/2157433964 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:42.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.906+0000 7f15ca59c700 1 --2- 172.21.15.40:0/2157433964 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f15cc06a6d0 0x7f15cc09ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.906+0000 7f15cad9d700 1 --2- 172.21.15.40:0/2157433964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15cc131df0 0x7f15cc1c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:42.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.906+0000 7f15c9d9b700 1 -- 172.21.15.40:0/2157433964 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f15cc06a6d0 msgr2=0x7f15cc09ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:42.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.906+0000 7f15c9d9b700 1 --2- 172.21.15.40:0/2157433964 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f15cc06a6d0 0x7f15cc09ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.906+0000 7f15c9d9b700 1 -- 172.21.15.40:0/2157433964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15cc131df0 msgr2=0x7f15cc1c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:42.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.906+0000 7f15c9d9b700 1 --2- 172.21.15.40:0/2157433964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15cc131df0 0x7f15cc1c83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:42.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.906+0000 7f15c9d9b700 1 -- 172.21.15.40:0/2157433964 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15bc009430 con 0x7f15cc06afe0 2023-09-30T22:30:42.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.906+0000 7f15cad9d700 1 --2- 172.21.15.40:0/2157433964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15cc131df0 0x7f15cc1c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:42.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.906+0000 7f15c9d9b700 1 --2- 172.21.15.40:0/2157433964 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15cc06afe0 0x7f15cc09b390 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f15cc09df70 tx=0x7f15c0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:42.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.907+0000 7f15baffd700 1 -- 172.21.15.40:0/2157433964 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c0004240 con 0x7f15cc06afe0 2023-09-30T22:30:42.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.907+0000 7f15baffd700 1 -- 172.21.15.40:0/2157433964 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c001f070 con 0x7f15cc06afe0 2023-09-30T22:30:42.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.907+0000 7f15d093a700 1 -- 172.21.15.40:0/2157433964 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c4009a70 con 0x7f15cc06afe0 2023-09-30T22:30:42.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.907+0000 7f15baffd700 1 -- 172.21.15.40:0/2157433964 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c00045c0 con 0x7f15cc06afe0 2023-09-30T22:30:42.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.907+0000 7f15d093a700 1 -- 172.21.15.40:0/2157433964 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c0009550 con 0x7f15cc06afe0 2023-09-30T22:30:42.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.908+0000 7f15baffd700 1 -- 172.21.15.40:0/2157433964 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f15c0021030 con 0x7f15cc06afe0 2023-09-30T22:30:42.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.908+0000 7f15d093a700 1 -- 172.21.15.40:0/2157433964 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15cc062380 con 0x7f15cc06afe0 2023-09-30T22:30:42.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.908+0000 7f15baffd700 1 -- 172.21.15.40:0/2157433964 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f15c00407f0 con 0x7f15cc06afe0 2023-09-30T22:30:42.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:42.917+0000 7f15baffd700 1 -- 172.21.15.40:0/2157433964 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f15c0015070 con 0x7f15cc06afe0 2023-09-30T22:30:43.007 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:43.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.030+0000 7f2e1af0b700 1 -- 172.21.15.40:0/1020928305 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2e140a29e0 con 0x7f2e1409d920 2023-09-30T22:30:43.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.030+0000 7f2e117fa700 1 -- 172.21.15.40:0/1020928305 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2e08016020 con 0x7f2e1409d920 2023-09-30T22:30:43.031 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:43.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.032+0000 7f2e1af0b700 1 -- 172.21.15.40:0/1020928305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e1409d920 msgr2=0x7f2e14120470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:43.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.032+0000 7f2e1af0b700 1 --2- 172.21.15.40:0/1020928305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e1409d920 0x7f2e14120470 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f2e08000c00 tx=0x7f2e08004750 comp rx=0 tx=0).stop 2023-09-30T22:30:43.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.033+0000 7f2e1af0b700 1 -- 172.21.15.40:0/1020928305 shutdown_connections 2023-09-30T22:30:43.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.033+0000 7f2e1af0b700 1 --2- 172.21.15.40:0/1020928305 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e14124490 0x7f2e14120ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.033+0000 7f2e1af0b700 1 --2- 172.21.15.40:0/1020928305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e1409d920 0x7f2e14120470 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.033+0000 7f2e1af0b700 1 --2- 172.21.15.40:0/1020928305 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e14133ca0 0x7f2e141209b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.033+0000 7f2e1af0b700 1 -- 172.21.15.40:0/1020928305 >> 172.21.15.40:0/1020928305 conn(0x7f2e1409fb20 msgr2=0x7f2e141bb150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:43.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.033+0000 7f2e1af0b700 1 -- 172.21.15.40:0/1020928305 shutdown_connections 2023-09-30T22:30:43.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.033+0000 7f2e1af0b700 1 -- 172.21.15.40:0/1020928305 wait complete. 2023-09-30T22:30:43.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:43.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.068+0000 7f3152f10700 1 -- 172.21.15.40:0/2843853949 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f314c074620 con 0x7f314c06f070 2023-09-30T22:30:43.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.068+0000 7f31497fa700 1 -- 172.21.15.40:0/2843853949 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3140017020 con 0x7f314c06f070 2023-09-30T22:30:43.070 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:43.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.070+0000 7f3152f10700 1 -- 172.21.15.40:0/2843853949 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f314c06f070 msgr2=0x7f314c09b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:43.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.070+0000 7f3152f10700 1 --2- 172.21.15.40:0/2843853949 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f314c06f070 0x7f314c09b5a0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f314000e9b0 tx=0x7f314000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.070+0000 7f3152f10700 1 -- 172.21.15.40:0/2843853949 shutdown_connections 2023-09-30T22:30:43.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.070+0000 7f3152f10700 1 --2- 172.21.15.40:0/2843853949 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f314c06f070 0x7f314c09b5a0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.070+0000 7f3152f10700 1 --2- 172.21.15.40:0/2843853949 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f314c06fdb0 0x7f314c09c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.070+0000 7f3152f10700 1 --2- 172.21.15.40:0/2843853949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f314c06f980 0x7f314c09bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.071+0000 7f3152f10700 1 -- 172.21.15.40:0/2843853949 >> 172.21.15.40:0/2843853949 conn(0x7f314c0a41a0 msgr2=0x7f314c0974c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:43.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.071+0000 7f3152f10700 1 -- 172.21.15.40:0/2843853949 shutdown_connections 2023-09-30T22:30:43.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.071+0000 7f3152f10700 1 -- 172.21.15.40:0/2843853949 wait complete. 2023-09-30T22:30:43.084 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:43.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.117+0000 7f15d093a700 1 -- 172.21.15.40:0/2157433964 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f15cc1220b0 con 0x7f15cc06afe0 2023-09-30T22:30:43.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.117+0000 7f15baffd700 1 -- 172.21.15.40:0/2157433964 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f15c002d440 con 0x7f15cc06afe0 2023-09-30T22:30:43.118 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:43.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.119+0000 7f15d093a700 1 -- 172.21.15.40:0/2157433964 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15cc06afe0 msgr2=0x7f15cc09b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:43.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.119+0000 7f15d093a700 1 --2- 172.21.15.40:0/2157433964 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15cc06afe0 0x7f15cc09b390 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f15cc09df70 tx=0x7f15c0004750 comp rx=0 tx=0).stop 2023-09-30T22:30:43.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.119+0000 7f15d093a700 1 -- 172.21.15.40:0/2157433964 shutdown_connections 2023-09-30T22:30:43.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.119+0000 7f15d093a700 1 --2- 172.21.15.40:0/2157433964 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f15cc06a6d0 0x7f15cc09ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.119+0000 7f15d093a700 1 --2- 172.21.15.40:0/2157433964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15cc131df0 0x7f15cc1c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.119+0000 7f15d093a700 1 --2- 172.21.15.40:0/2157433964 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f15cc06afe0 0x7f15cc09b390 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.119+0000 7f15d093a700 1 -- 172.21.15.40:0/2157433964 >> 172.21.15.40:0/2157433964 conn(0x7f15cc09fb20 msgr2=0x7f15cc0a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:43.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.119+0000 7f15d093a700 1 -- 172.21.15.40:0/2157433964 shutdown_connections 2023-09-30T22:30:43.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.119+0000 7f15d093a700 1 -- 172.21.15.40:0/2157433964 wait complete. 2023-09-30T22:30:43.132 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:43.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.138+0000 7f95a37b0700 1 Processor -- start 2023-09-30T22:30:43.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.138+0000 7f95a37b0700 1 -- start start 2023-09-30T22:30:43.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.138+0000 7f95a37b0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f959c06f3a0 0x7f959c06c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:43.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.138+0000 7f95a37b0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f959c09fbb0 0x7f959c06ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:43.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.139+0000 7f95a37b0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f959c06d410 0x7f959c13a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:43.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.139+0000 7f95a37b0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f959c09ff80 con 0x7f959c09fbb0 2023-09-30T22:30:43.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.139+0000 7f95a37b0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959c0a0590 con 0x7f959c06d410 2023-09-30T22:30:43.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.139+0000 7f95a37b0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f959c06bac0 con 0x7f959c06f3a0 2023-09-30T22:30:43.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.139+0000 7f95a0d4b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f959c09fbb0 0x7f959c06ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:43.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.139+0000 7f95a154c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f959c06f3a0 0x7f959c06c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:43.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.139+0000 7f95a1d4d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f959c06d410 0x7f959c13a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:43.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.139+0000 7f95a0d4b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f959c09fbb0 0x7f959c06ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48282/0 (socket says 172.21.15.40:48282) 2023-09-30T22:30:43.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.139+0000 7f95a154c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f959c06f3a0 0x7f959c06c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51106/0 (socket says 172.21.15.40:51106) 2023-09-30T22:30:43.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.139+0000 7f95a0d4b700 1 -- 172.21.15.40:0/2312153836 learned_addr learned my addr 172.21.15.40:0/2312153836 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:43.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.139+0000 7f95a0d4b700 1 -- 172.21.15.40:0/2312153836 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f959c06f3a0 msgr2=0x7f959c06c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:43.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.139+0000 7f95a0d4b700 1 --2- 172.21.15.40:0/2312153836 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f959c06f3a0 0x7f959c06c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.139+0000 7f95a0d4b700 1 -- 172.21.15.40:0/2312153836 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f959c06d410 msgr2=0x7f959c13a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:43.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.139+0000 7f95a0d4b700 1 --2- 172.21.15.40:0/2312153836 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f959c06d410 0x7f959c13a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.139+0000 7f95a0d4b700 1 -- 172.21.15.40:0/2312153836 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959c0a0780 con 0x7f959c09fbb0 2023-09-30T22:30:43.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.139+0000 7f95a1d4d700 1 --2- 172.21.15.40:0/2312153836 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f959c06d410 0x7f959c13a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:43.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.139+0000 7f95a154c700 1 --2- 172.21.15.40:0/2312153836 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f959c06f3a0 0x7f959c06c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:43.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.139+0000 7f95a0d4b700 1 --2- 172.21.15.40:0/2312153836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f959c09fbb0 0x7f959c06ced0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f9598009920 tx=0x7f9598009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c824db54b6e701b6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:43.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.139+0000 7f9593fff700 1 -- 172.21.15.40:0/2312153836 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9598011830 con 0x7f959c09fbb0 2023-09-30T22:30:43.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.139+0000 7f9593fff700 1 -- 172.21.15.40:0/2312153836 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9598011990 con 0x7f959c09fbb0 2023-09-30T22:30:43.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.139+0000 7f9593fff700 1 -- 172.21.15.40:0/2312153836 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9598011d20 con 0x7f959c09fbb0 2023-09-30T22:30:43.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.140+0000 7f95a37b0700 1 -- 172.21.15.40:0/2312153836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f959c09fbb0 msgr2=0x7f959c06ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:43.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.140+0000 7f95a37b0700 1 --2- 172.21.15.40:0/2312153836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f959c09fbb0 0x7f959c06ced0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f9598009920 tx=0x7f9598009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:43.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.140+0000 7f95a37b0700 1 -- 172.21.15.40:0/2312153836 shutdown_connections 2023-09-30T22:30:43.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.140+0000 7f95a37b0700 1 --2- 172.21.15.40:0/2312153836 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f959c06f3a0 0x7f959c06c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.140+0000 7f95a37b0700 1 --2- 172.21.15.40:0/2312153836 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f959c06d410 0x7f959c13a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.140+0000 7f95a37b0700 1 --2- 172.21.15.40:0/2312153836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f959c09fbb0 0x7f959c06ced0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.140+0000 7f95a37b0700 1 -- 172.21.15.40:0/2312153836 >> 172.21.15.40:0/2312153836 conn(0x7f959c0a41a0 msgr2=0x7f959c0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:43.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.140+0000 7f95a37b0700 1 -- 172.21.15.40:0/2312153836 shutdown_connections 2023-09-30T22:30:43.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.140+0000 7f95a37b0700 1 -- 172.21.15.40:0/2312153836 wait complete. 2023-09-30T22:30:43.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.141+0000 7f95a37b0700 1 Processor -- start 2023-09-30T22:30:43.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.141+0000 7f95a37b0700 1 -- start start 2023-09-30T22:30:43.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.142+0000 7f95a37b0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f959c06d410 0x7f959c08f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:43.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.142+0000 7f95a37b0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f959c06f3a0 0x7f959c08fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:43.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.142+0000 7f95a37b0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f959c09fbb0 0x7f959c0900c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:43.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.142+0000 7f95a37b0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959c090b30 con 0x7f959c06f3a0 2023-09-30T22:30:43.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.142+0000 7f95a37b0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959c092c40 con 0x7f959c09fbb0 2023-09-30T22:30:43.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.142+0000 7f95a37b0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f959c092e20 con 0x7f959c06d410 2023-09-30T22:30:43.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.142+0000 7f95a154c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f959c06d410 0x7f959c08f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:43.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.142+0000 7f95a0d4b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f959c06f3a0 0x7f959c08fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:43.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.142+0000 7f95a154c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f959c06d410 0x7f959c08f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51122/0 (socket says 172.21.15.40:51122) 2023-09-30T22:30:43.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.142+0000 7f95a154c700 1 -- 172.21.15.40:0/4087957330 learned_addr learned my addr 172.21.15.40:0/4087957330 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:43.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.142+0000 7f95a1d4d700 1 --2- 172.21.15.40:0/4087957330 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f959c09fbb0 0x7f959c0900c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:43.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.142+0000 7f95a0d4b700 1 -- 172.21.15.40:0/4087957330 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f959c06d410 msgr2=0x7f959c08f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:43.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.142+0000 7f95a0d4b700 1 --2- 172.21.15.40:0/4087957330 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f959c06d410 0x7f959c08f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.142+0000 7f95a0d4b700 1 -- 172.21.15.40:0/4087957330 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f959c09fbb0 msgr2=0x7f959c0900c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:43.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.142+0000 7f95a0d4b700 1 --2- 172.21.15.40:0/4087957330 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f959c09fbb0 0x7f959c0900c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.142+0000 7f95a0d4b700 1 -- 172.21.15.40:0/4087957330 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9594009a70 con 0x7f959c06f3a0 2023-09-30T22:30:43.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.143+0000 7f95a0d4b700 1 --2- 172.21.15.40:0/4087957330 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f959c06f3a0 0x7f959c08fb80 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f9598009920 tx=0x7f9598004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:43.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.143+0000 7f9591ffb700 1 -- 172.21.15.40:0/4087957330 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9598004450 con 0x7f959c06f3a0 2023-09-30T22:30:43.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.143+0000 7f9591ffb700 1 -- 172.21.15.40:0/4087957330 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95980045b0 con 0x7f959c06f3a0 2023-09-30T22:30:43.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.143+0000 7f95a37b0700 1 -- 172.21.15.40:0/4087957330 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f958c0094a0 con 0x7f959c06f3a0 2023-09-30T22:30:43.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.143+0000 7f9591ffb700 1 -- 172.21.15.40:0/4087957330 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95980038e0 con 0x7f959c06f3a0 2023-09-30T22:30:43.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.143+0000 7f95a37b0700 1 -- 172.21.15.40:0/4087957330 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9598009550 con 0x7f959c06f3a0 2023-09-30T22:30:43.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.144+0000 7f9591ffb700 1 -- 172.21.15.40:0/4087957330 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9598021070 con 0x7f959c06f3a0 2023-09-30T22:30:43.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.144+0000 7f95a37b0700 1 -- 172.21.15.40:0/4087957330 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f959c06df90 con 0x7f959c06f3a0 2023-09-30T22:30:43.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.144+0000 7f9591ffb700 1 -- 172.21.15.40:0/4087957330 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9598040640 con 0x7f959c06f3a0 2023-09-30T22:30:43.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.148+0000 7f9591ffb700 1 -- 172.21.15.40:0/4087957330 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9598028070 con 0x7f959c06f3a0 2023-09-30T22:30:43.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.342+0000 7f95a37b0700 1 -- 172.21.15.40:0/4087957330 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f959c092a80 con 0x7f959c06f3a0 2023-09-30T22:30:43.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.342+0000 7f9591ffb700 1 -- 172.21.15.40:0/4087957330 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f959c092a80 con 0x7f959c06f3a0 2023-09-30T22:30:43.343 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:43.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.344+0000 7f95a37b0700 1 -- 172.21.15.40:0/4087957330 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f959c06f3a0 msgr2=0x7f959c08fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:43.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.344+0000 7f95a37b0700 1 --2- 172.21.15.40:0/4087957330 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f959c06f3a0 0x7f959c08fb80 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f9598009920 tx=0x7f9598004750 comp rx=0 tx=0).stop 2023-09-30T22:30:43.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.345+0000 7f95a37b0700 1 -- 172.21.15.40:0/4087957330 shutdown_connections 2023-09-30T22:30:43.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.345+0000 7f95a37b0700 1 --2- 172.21.15.40:0/4087957330 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f959c06d410 0x7f959c08f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.345+0000 7f95a37b0700 1 --2- 172.21.15.40:0/4087957330 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f959c09fbb0 0x7f959c0900c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.345+0000 7f95a37b0700 1 --2- 172.21.15.40:0/4087957330 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f959c06f3a0 0x7f959c08fb80 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:43.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.345+0000 7f95a37b0700 1 -- 172.21.15.40:0/4087957330 >> 172.21.15.40:0/4087957330 conn(0x7f959c0a41a0 msgr2=0x7f959c06f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:43.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.345+0000 7f95a37b0700 1 -- 172.21.15.40:0/4087957330 shutdown_connections 2023-09-30T22:30:43.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:43.345+0000 7f95a37b0700 1 -- 172.21.15.40:0/4087957330 wait complete. 2023-09-30T22:30:43.357 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:44.048 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:44.085 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:44.133 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:44.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.197+0000 7f68358f6700 1 Processor -- start 2023-09-30T22:30:44.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.198+0000 7f68358f6700 1 -- start start 2023-09-30T22:30:44.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.198+0000 7f68358f6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6830133e00 0x7f68301341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:44.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.198+0000 7f68358f6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f683009df70 0x7f683013bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:44.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.198+0000 7f68358f6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6830133940 con 0x7f683009d400 2023-09-30T22:30:44.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.198+0000 7f68358f6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f683009ab20 con 0x7f6830133e00 2023-09-30T22:30:44.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.198+0000 7f68358f6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f683009f0d0 con 0x7f683009df70 2023-09-30T22:30:44.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.198+0000 7f682effd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6830133e00 0x7f68301341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:44.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.198+0000 7f682e7fc700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f683009d400 0x7f683009d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51972/0 (socket says 172.21.15.40:51972) 2023-09-30T22:30:44.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.198+0000 7f682effd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6830133e00 0x7f68301341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43178/0 (socket says 172.21.15.40:43178) 2023-09-30T22:30:44.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.198+0000 7f682e7fc700 1 -- 172.21.15.40:0/1645058332 learned_addr learned my addr 172.21.15.40:0/1645058332 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:44.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.198+0000 7f682f7fe700 1 --2- 172.21.15.40:0/1645058332 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f683009df70 0x7f683013bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:44.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.199+0000 7f682f7fe700 1 -- 172.21.15.40:0/1645058332 >> v2:172.21.15.40:3300/0 conn(0x7f6830133e00 msgr2=0x7f68301341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:44.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.199+0000 7f682f7fe700 1 --2- 172.21.15.40:0/1645058332 >> v2:172.21.15.40:3300/0 conn(0x7f6830133e00 0x7f68301341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.199+0000 7f682f7fe700 1 -- 172.21.15.40:0/1645058332 >> v1:172.21.15.40:6789/0 conn(0x7f683009d400 legacy=0x7f683009d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:44.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.199+0000 7f682dffb700 1 -- 172.21.15.40:0/1645058332 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3107604430 0 0) 0x7f6830133940 con 0x7f683009d400 2023-09-30T22:30:44.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.199+0000 7f682f7fe700 1 -- 172.21.15.40:0/1645058332 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6830133be0 con 0x7f683009df70 2023-09-30T22:30:44.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.199+0000 7f682effd700 1 --2- 172.21.15.40:0/1645058332 >> v2:172.21.15.40:3300/0 conn(0x7f6830133e00 0x7f68301341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:44.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.199+0000 7f682f7fe700 1 --2- 172.21.15.40:0/1645058332 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f683009df70 0x7f683013bc80 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f6828009d90 tx=0x7f682800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e401cc1753f87fa9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:44.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.199+0000 7f682dffb700 1 -- 172.21.15.40:0/1645058332 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682800e070 con 0x7f683009df70 2023-09-30T22:30:44.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.199+0000 7f682dffb700 1 -- 172.21.15.40:0/1645058332 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682800bb20 con 0x7f683009df70 2023-09-30T22:30:44.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.199+0000 7f682dffb700 1 -- 172.21.15.40:0/1645058332 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6828012430 con 0x7f683009df70 2023-09-30T22:30:44.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.200+0000 7f68358f6700 1 -- 172.21.15.40:0/1645058332 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f683009df70 msgr2=0x7f683013bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:44.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.200+0000 7f68358f6700 1 --2- 172.21.15.40:0/1645058332 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f683009df70 0x7f683013bc80 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f6828009d90 tx=0x7f682800b330 comp rx=0 tx=0).stop 2023-09-30T22:30:44.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.200+0000 7f68358f6700 1 -- 172.21.15.40:0/1645058332 shutdown_connections 2023-09-30T22:30:44.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.200+0000 7f68358f6700 1 --2- 172.21.15.40:0/1645058332 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f683009df70 0x7f683013bc80 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.200+0000 7f68358f6700 1 --2- 172.21.15.40:0/1645058332 >> v2:172.21.15.40:3300/0 conn(0x7f6830133e00 0x7f68301341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.200+0000 7f68358f6700 1 -- 172.21.15.40:0/1645058332 >> 172.21.15.40:0/1645058332 conn(0x7f68300a2a00 msgr2=0x7f68300a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:44.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.200+0000 7f68358f6700 1 -- 172.21.15.40:0/1645058332 shutdown_connections 2023-09-30T22:30:44.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.200+0000 7f68358f6700 1 -- 172.21.15.40:0/1645058332 wait complete. 2023-09-30T22:30:44.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.201+0000 7f68358f6700 1 Processor -- start 2023-09-30T22:30:44.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.201+0000 7f68358f6700 1 -- start start 2023-09-30T22:30:44.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.201+0000 7f68358f6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f683009d400 0x7f683011b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:44.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.201+0000 7f68358f6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f683009df70 0x7f68301c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:44.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.202+0000 7f68358f6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6830133e00 0x7f68301c4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:44.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.202+0000 7f68358f6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f683011e070 con 0x7f683009df70 2023-09-30T22:30:44.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.202+0000 7f68358f6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f683011e290 con 0x7f6830133e00 2023-09-30T22:30:44.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.202+0000 7f68358f6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f683011c480 con 0x7f683009d400 2023-09-30T22:30:44.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.202+0000 7f682effd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f683009d400 0x7f683011b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:44.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.202+0000 7f682effd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f683009d400 0x7f683011b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56328/0 (socket says 172.21.15.40:56328) 2023-09-30T22:30:44.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.202+0000 7f682effd700 1 -- 172.21.15.40:0/1388142258 learned_addr learned my addr 172.21.15.40:0/1388142258 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:44.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.202+0000 7f682f7fe700 1 --2- 172.21.15.40:0/1388142258 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6830133e00 0x7f68301c4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:44.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.202+0000 7f682e7fc700 1 --2- 172.21.15.40:0/1388142258 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f683009df70 0x7f68301c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:44.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.202+0000 7f682effd700 1 -- 172.21.15.40:0/1388142258 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6830133e00 msgr2=0x7f68301c4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:44.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.202+0000 7f682effd700 1 --2- 172.21.15.40:0/1388142258 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6830133e00 0x7f68301c4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.202+0000 7f682effd700 1 -- 172.21.15.40:0/1388142258 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f683009df70 msgr2=0x7f68301c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:44.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.202+0000 7f682effd700 1 --2- 172.21.15.40:0/1388142258 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f683009df70 0x7f68301c8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.202+0000 7f682effd700 1 -- 172.21.15.40:0/1388142258 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68200094a0 con 0x7f683009d400 2023-09-30T22:30:44.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.202+0000 7f682f7fe700 1 --2- 172.21.15.40:0/1388142258 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6830133e00 0x7f68301c4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:44.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.202+0000 7f682effd700 1 --2- 172.21.15.40:0/1388142258 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f683009d400 0x7f683011b8e0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f682000ec10 tx=0x7f682000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:44.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.202+0000 7f6817fff700 1 -- 172.21.15.40:0/1388142258 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682000c850 con 0x7f683009d400 2023-09-30T22:30:44.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.202+0000 7f6817fff700 1 -- 172.21.15.40:0/1388142258 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682000c9b0 con 0x7f683009d400 2023-09-30T22:30:44.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.203+0000 7f68358f6700 1 -- 172.21.15.40:0/1388142258 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6828009a70 con 0x7f683009d400 2023-09-30T22:30:44.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.203+0000 7f6817fff700 1 -- 172.21.15.40:0/1388142258 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682000cd20 con 0x7f683009d400 2023-09-30T22:30:44.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.203+0000 7f68358f6700 1 -- 172.21.15.40:0/1388142258 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68301c86b0 con 0x7f683009d400 2023-09-30T22:30:44.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.203+0000 7f6817fff700 1 -- 172.21.15.40:0/1388142258 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6820013470 con 0x7f683009d400 2023-09-30T22:30:44.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.204+0000 7f6817fff700 1 -- 172.21.15.40:0/1388142258 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f682003f810 con 0x7f683009d400 2023-09-30T22:30:44.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.204+0000 7f68358f6700 1 -- 172.21.15.40:0/1388142258 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6830062380 con 0x7f683009d400 2023-09-30T22:30:44.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.209+0000 7f6817fff700 1 -- 172.21.15.40:0/1388142258 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6820021080 con 0x7f683009d400 2023-09-30T22:30:44.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.230+0000 7fe09ef35700 1 Processor -- start 2023-09-30T22:30:44.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.230+0000 7fe09ef35700 1 -- start start 2023-09-30T22:30:44.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.230+0000 7fe09ef35700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe09813b130 0x7fe09813d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:44.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.230+0000 7fe09ef35700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe09813da50 0x7fe09813fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:44.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.231+0000 7fe09ef35700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe098137e20 con 0x7fe098138250 2023-09-30T22:30:44.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.231+0000 7fe09ef35700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe098138d30 con 0x7fe09813b130 2023-09-30T22:30:44.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.231+0000 7fe09ef35700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe098138050 con 0x7fe09813da50 2023-09-30T22:30:44.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.231+0000 7fe097fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe09813b130 0x7fe09813d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:44.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.231+0000 7fe097fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe09813b130 0x7fe09813d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43200/0 (socket says 172.21.15.40:43200) 2023-09-30T22:30:44.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.231+0000 7fe097fff700 1 -- 172.21.15.40:0/3544021121 learned_addr learned my addr 172.21.15.40:0/3544021121 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:44.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.231+0000 7fe09d4d2700 1 --2- 172.21.15.40:0/3544021121 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe09813da50 0x7fe09813fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:44.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.231+0000 7fe097fff700 1 -- 172.21.15.40:0/3544021121 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe09813da50 msgr2=0x7fe09813fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:44.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.231+0000 7fe097fff700 1 --2- 172.21.15.40:0/3544021121 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe09813da50 0x7fe09813fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.231+0000 7fe097fff700 1 -- 172.21.15.40:0/3544021121 >> v1:172.21.15.40:6789/0 conn(0x7fe098138250 legacy=0x7fe098138620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:44.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.231+0000 7fe097fff700 1 -- 172.21.15.40:0/3544021121 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09809b010 con 0x7fe09813b130 2023-09-30T22:30:44.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.231+0000 7fe097fff700 1 --2- 172.21.15.40:0/3544021121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe09813b130 0x7fe09813d510 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fe0840098f0 tx=0x7fe084009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85348d27656e1673 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:44.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.231+0000 7fe0977fe700 1 -- 172.21.15.40:0/3544021121 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe084011830 con 0x7fe09813b130 2023-09-30T22:30:44.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.231+0000 7fe0977fe700 1 -- 172.21.15.40:0/3544021121 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe084011990 con 0x7fe09813b130 2023-09-30T22:30:44.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.231+0000 7fe0977fe700 1 -- 172.21.15.40:0/3544021121 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe084011d20 con 0x7fe09813b130 2023-09-30T22:30:44.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.232+0000 7fe09ef35700 1 -- 172.21.15.40:0/3544021121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe09813b130 msgr2=0x7fe09813d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:44.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.232+0000 7fe09ef35700 1 --2- 172.21.15.40:0/3544021121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe09813b130 0x7fe09813d510 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fe0840098f0 tx=0x7fe084009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:44.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.232+0000 7fe09ef35700 1 -- 172.21.15.40:0/3544021121 shutdown_connections 2023-09-30T22:30:44.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.232+0000 7fe09ef35700 1 --2- 172.21.15.40:0/3544021121 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe09813da50 0x7fe09813fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.232+0000 7fe09ef35700 1 --2- 172.21.15.40:0/3544021121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe09813b130 0x7fe09813d510 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.232+0000 7fe09ef35700 1 -- 172.21.15.40:0/3544021121 >> 172.21.15.40:0/3544021121 conn(0x7fe0980a2a00 msgr2=0x7fe0980a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:44.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.232+0000 7fe09ef35700 1 -- 172.21.15.40:0/3544021121 shutdown_connections 2023-09-30T22:30:44.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.232+0000 7fe09ef35700 1 -- 172.21.15.40:0/3544021121 wait complete. 2023-09-30T22:30:44.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.233+0000 7fe09ef35700 1 Processor -- start 2023-09-30T22:30:44.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.233+0000 7fe09ef35700 1 -- start start 2023-09-30T22:30:44.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.234+0000 7fe09ef35700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe098138250 0x7fe09813f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:44.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.234+0000 7fe09ef35700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe09813b130 0x7fe09813fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:44.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.234+0000 7fe09ef35700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe09813da50 0x7fe098140250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:44.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.234+0000 7fe09ef35700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe098140ee0 con 0x7fe098138250 2023-09-30T22:30:44.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.234+0000 7fe09ef35700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09806f480 con 0x7fe09813b130 2023-09-30T22:30:44.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.234+0000 7fe09ef35700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe09806f7e0 con 0x7fe09813da50 2023-09-30T22:30:44.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.234+0000 7fe09ccd1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe098138250 0x7fe09813f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:44.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.234+0000 7fe09ccd1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe098138250 0x7fe09813f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43214/0 (socket says 172.21.15.40:43214) 2023-09-30T22:30:44.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.234+0000 7fe09ccd1700 1 -- 172.21.15.40:0/903517946 learned_addr learned my addr 172.21.15.40:0/903517946 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:44.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.234+0000 7fe09d4d2700 1 --2- 172.21.15.40:0/903517946 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe09813da50 0x7fe098140250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:44.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.234+0000 7fe097fff700 1 --2- 172.21.15.40:0/903517946 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe09813b130 0x7fe09813fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:44.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.234+0000 7fe09d4d2700 1 -- 172.21.15.40:0/903517946 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe09813b130 msgr2=0x7fe09813fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:44.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.234+0000 7fe09d4d2700 1 --2- 172.21.15.40:0/903517946 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe09813b130 0x7fe09813fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.234+0000 7fe09d4d2700 1 -- 172.21.15.40:0/903517946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe098138250 msgr2=0x7fe09813f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:44.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.234+0000 7fe09d4d2700 1 --2- 172.21.15.40:0/903517946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe098138250 0x7fe09813f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.234+0000 7fe09d4d2700 1 -- 172.21.15.40:0/903517946 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe084009550 con 0x7fe09813da50 2023-09-30T22:30:44.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.234+0000 7fe09ccd1700 1 --2- 172.21.15.40:0/903517946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe098138250 0x7fe09813f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:44.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.235+0000 7fe09d4d2700 1 --2- 172.21.15.40:0/903517946 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe09813da50 0x7fe098140250 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fe09000efc0 tx=0x7fe09000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:44.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.235+0000 7fe0957fa700 1 -- 172.21.15.40:0/903517946 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09000cc90 con 0x7fe09813da50 2023-09-30T22:30:44.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.235+0000 7fe0957fa700 1 -- 172.21.15.40:0/903517946 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09000f040 con 0x7fe09813da50 2023-09-30T22:30:44.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.235+0000 7fe0957fa700 1 -- 172.21.15.40:0/903517946 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0900146c0 con 0x7fe09813da50 2023-09-30T22:30:44.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.235+0000 7fe09ef35700 1 -- 172.21.15.40:0/903517946 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09806f1b0 con 0x7fe09813da50 2023-09-30T22:30:44.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.235+0000 7fe09ef35700 1 -- 172.21.15.40:0/903517946 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe09809a300 con 0x7fe09813da50 2023-09-30T22:30:44.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.236+0000 7fe0957fa700 1 -- 172.21.15.40:0/903517946 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe090014820 con 0x7fe09813da50 2023-09-30T22:30:44.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.236+0000 7fe09ef35700 1 -- 172.21.15.40:0/903517946 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe098062380 con 0x7fe09813da50 2023-09-30T22:30:44.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.236+0000 7fe0957fa700 1 -- 172.21.15.40:0/903517946 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe090040340 con 0x7fe09813da50 2023-09-30T22:30:44.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.245+0000 7fe0957fa700 1 -- 172.21.15.40:0/903517946 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe090012910 con 0x7fe09813da50 2023-09-30T22:30:44.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.270+0000 7f6466512700 1 Processor -- start 2023-09-30T22:30:44.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.270+0000 7f6466512700 1 -- start start 2023-09-30T22:30:44.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.271+0000 7f6466512700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f646009c890 0x7f646009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:44.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.271+0000 7f6466512700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f646009d920 0x7f646009dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:44.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.271+0000 7f6466512700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f646009e2b0 0x7f646013ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:44.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.271+0000 7f6466512700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64600a29d0 con 0x7f646009e2b0 2023-09-30T22:30:44.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.271+0000 7f6466512700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646009fb40 con 0x7f646009d920 2023-09-30T22:30:44.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.271+0000 7f6466512700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f64600a2600 con 0x7f646009c890 2023-09-30T22:30:44.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.271+0000 7f645f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f646009d920 0x7f646009dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:44.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.271+0000 7f645ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f646009c890 0x7f646009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:44.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.271+0000 7f6464aaf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f646009e2b0 0x7f646013ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:44.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.271+0000 7f645ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f646009c890 0x7f646009cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56344/0 (socket says 172.21.15.40:56344) 2023-09-30T22:30:44.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.271+0000 7f645f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f646009d920 0x7f646009dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:44602/0 (socket says 172.21.15.40:44602) 2023-09-30T22:30:44.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.271+0000 7f645ffff700 1 -- 172.21.15.40:0/3183670473 learned_addr learned my addr 172.21.15.40:0/3183670473 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:44.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.271+0000 7f645f7fe700 1 -- 172.21.15.40:0/3183670473 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f646009c890 msgr2=0x7f646009cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:44.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.271+0000 7f645f7fe700 1 --2- 172.21.15.40:0/3183670473 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f646009c890 0x7f646009cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.271+0000 7f645f7fe700 1 -- 172.21.15.40:0/3183670473 >> v2:172.21.15.40:3300/0 conn(0x7f646009e2b0 msgr2=0x7f646013ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:44.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.271+0000 7f645f7fe700 1 --2- 172.21.15.40:0/3183670473 >> v2:172.21.15.40:3300/0 conn(0x7f646009e2b0 0x7f646013ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.271+0000 7f645f7fe700 1 -- 172.21.15.40:0/3183670473 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646009e720 con 0x7f646009d920 2023-09-30T22:30:44.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.271+0000 7f645ffff700 1 --2- 172.21.15.40:0/3183670473 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f646009c890 0x7f646009cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:44.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.271+0000 7f6464aaf700 1 --2- 172.21.15.40:0/3183670473 >> v2:172.21.15.40:3300/0 conn(0x7f646009e2b0 0x7f646013ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:44.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.272+0000 7f645f7fe700 1 --2- 172.21.15.40:0/3183670473 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f646009d920 0x7f646009dd70 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f6454009870 tx=0x7f6454009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7aeff396d30474ff server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:44.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.272+0000 7f645effd700 1 -- 172.21.15.40:0/3183670473 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6454011830 con 0x7f646009d920 2023-09-30T22:30:44.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.272+0000 7f645effd700 1 -- 172.21.15.40:0/3183670473 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6454011990 con 0x7f646009d920 2023-09-30T22:30:44.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.272+0000 7f645effd700 1 -- 172.21.15.40:0/3183670473 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6454011d20 con 0x7f646009d920 2023-09-30T22:30:44.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.272+0000 7f6466512700 1 -- 172.21.15.40:0/3183670473 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f646009d920 msgr2=0x7f646009dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:44.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.272+0000 7f6466512700 1 --2- 172.21.15.40:0/3183670473 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f646009d920 0x7f646009dd70 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f6454009870 tx=0x7f6454009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:44.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.273+0000 7f6466512700 1 -- 172.21.15.40:0/3183670473 shutdown_connections 2023-09-30T22:30:44.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.273+0000 7f6466512700 1 --2- 172.21.15.40:0/3183670473 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f646009c890 0x7f646009cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.273+0000 7f6466512700 1 --2- 172.21.15.40:0/3183670473 >> v2:172.21.15.40:3300/0 conn(0x7f646009e2b0 0x7f646013ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.273+0000 7f6466512700 1 --2- 172.21.15.40:0/3183670473 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f646009d920 0x7f646009dd70 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.273+0000 7f6466512700 1 -- 172.21.15.40:0/3183670473 >> 172.21.15.40:0/3183670473 conn(0x7f64600a7080 msgr2=0x7f64600a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:44.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.273+0000 7f6466512700 1 -- 172.21.15.40:0/3183670473 shutdown_connections 2023-09-30T22:30:44.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.273+0000 7f6466512700 1 -- 172.21.15.40:0/3183670473 wait complete. 2023-09-30T22:30:44.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.274+0000 7f6466512700 1 Processor -- start 2023-09-30T22:30:44.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.274+0000 7f6466512700 1 -- start start 2023-09-30T22:30:44.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.274+0000 7f6466512700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f646009c890 0x7f646012d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:44.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.274+0000 7f6466512700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f646009d920 0x7f646012d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:44.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.274+0000 7f6466512700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f646009e2b0 0x7f646012dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:44.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.274+0000 7f6466512700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646012fe50 con 0x7f646009e2b0 2023-09-30T22:30:44.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.274+0000 7f6466512700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64601308d0 con 0x7f646009c890 2023-09-30T22:30:44.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.274+0000 7f6466512700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f646012ec00 con 0x7f646009d920 2023-09-30T22:30:44.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.274+0000 7f645f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f646009d920 0x7f646012d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:44.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.274+0000 7f645f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f646009d920 0x7f646012d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56356/0 (socket says 172.21.15.40:56356) 2023-09-30T22:30:44.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.274+0000 7f645f7fe700 1 -- 172.21.15.40:0/2105278950 learned_addr learned my addr 172.21.15.40:0/2105278950 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:44.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.274+0000 7f6464aaf700 1 --2- 172.21.15.40:0/2105278950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f646009e2b0 0x7f646012dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:44.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.274+0000 7f645ffff700 1 --2- 172.21.15.40:0/2105278950 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f646009c890 0x7f646012d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:44.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.275+0000 7f6464aaf700 1 -- 172.21.15.40:0/2105278950 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f646009d920 msgr2=0x7f646012d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:44.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.275+0000 7f6464aaf700 1 --2- 172.21.15.40:0/2105278950 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f646009d920 0x7f646012d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.275+0000 7f6464aaf700 1 -- 172.21.15.40:0/2105278950 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f646009c890 msgr2=0x7f646012d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:44.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.275+0000 7f6464aaf700 1 --2- 172.21.15.40:0/2105278950 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f646009c890 0x7f646012d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.275+0000 7f6464aaf700 1 -- 172.21.15.40:0/2105278950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6450009500 con 0x7f646009e2b0 2023-09-30T22:30:44.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.275+0000 7f645f7fe700 1 --2- 172.21.15.40:0/2105278950 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f646009d920 0x7f646012d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:44.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.275+0000 7f6464aaf700 1 --2- 172.21.15.40:0/2105278950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f646009e2b0 0x7f646012dba0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f6458011650 tx=0x7f6458011960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:44.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.275+0000 7f645cff9700 1 -- 172.21.15.40:0/2105278950 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6458019040 con 0x7f646009e2b0 2023-09-30T22:30:44.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.275+0000 7f645cff9700 1 -- 172.21.15.40:0/2105278950 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6458003c20 con 0x7f646009e2b0 2023-09-30T22:30:44.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.275+0000 7f6466512700 1 -- 172.21.15.40:0/2105278950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6458014660 con 0x7f646009e2b0 2023-09-30T22:30:44.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.275+0000 7f645cff9700 1 -- 172.21.15.40:0/2105278950 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645800fe50 con 0x7f646009e2b0 2023-09-30T22:30:44.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.275+0000 7f6466512700 1 -- 172.21.15.40:0/2105278950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64540094a0 con 0x7f646009e2b0 2023-09-30T22:30:44.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.276+0000 7f645cff9700 1 -- 172.21.15.40:0/2105278950 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f64580177c0 con 0x7f646009e2b0 2023-09-30T22:30:44.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.276+0000 7f645cff9700 1 -- 172.21.15.40:0/2105278950 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6458048720 con 0x7f646009e2b0 2023-09-30T22:30:44.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.276+0000 7f6466512700 1 -- 172.21.15.40:0/2105278950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6460070610 con 0x7f646009e2b0 2023-09-30T22:30:44.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.281+0000 7f645cff9700 1 -- 172.21.15.40:0/2105278950 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6458017a70 con 0x7f646009e2b0 2023-09-30T22:30:44.358 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:44.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.412+0000 7f68358f6700 1 -- 172.21.15.40:0/1388142258 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6830074330 con 0x7f683009d400 2023-09-30T22:30:44.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.413+0000 7f6817fff700 1 -- 172.21.15.40:0/1388142258 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6820013720 con 0x7f683009d400 2023-09-30T22:30:44.414 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:44.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.415+0000 7f68358f6700 1 -- 172.21.15.40:0/1388142258 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f683009d400 msgr2=0x7f683011b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:44.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.415+0000 7f68358f6700 1 --2- 172.21.15.40:0/1388142258 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f683009d400 0x7f683011b8e0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f682000ec10 tx=0x7f682000ef20 comp rx=0 tx=0).stop 2023-09-30T22:30:44.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.415+0000 7f68358f6700 1 -- 172.21.15.40:0/1388142258 shutdown_connections 2023-09-30T22:30:44.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.415+0000 7f68358f6700 1 --2- 172.21.15.40:0/1388142258 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f683009d400 0x7f683011b8e0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.415+0000 7f68358f6700 1 --2- 172.21.15.40:0/1388142258 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6830133e00 0x7f68301c4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.415+0000 7f68358f6700 1 --2- 172.21.15.40:0/1388142258 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f683009df70 0x7f68301c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.415+0000 7f68358f6700 1 -- 172.21.15.40:0/1388142258 >> 172.21.15.40:0/1388142258 conn(0x7f68300a2a00 msgr2=0x7f68301baf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:44.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.415+0000 7f68358f6700 1 -- 172.21.15.40:0/1388142258 shutdown_connections 2023-09-30T22:30:44.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.415+0000 7f68358f6700 1 -- 172.21.15.40:0/1388142258 wait complete. 2023-09-30T22:30:44.428 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:44.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.450+0000 7fe09ef35700 1 -- 172.21.15.40:0/903517946 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe098070600 con 0x7fe09813da50 2023-09-30T22:30:44.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.451+0000 7fe0957fa700 1 -- 172.21.15.40:0/903517946 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe090012340 con 0x7fe09813da50 2023-09-30T22:30:44.451 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:44.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.453+0000 7fe09ef35700 1 -- 172.21.15.40:0/903517946 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe09813da50 msgr2=0x7fe098140250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:44.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.453+0000 7fe09ef35700 1 --2- 172.21.15.40:0/903517946 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe09813da50 0x7fe098140250 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fe09000efc0 tx=0x7fe09000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.453+0000 7fe09ef35700 1 -- 172.21.15.40:0/903517946 shutdown_connections 2023-09-30T22:30:44.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.453+0000 7fe09ef35700 1 --2- 172.21.15.40:0/903517946 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe09813da50 0x7fe098140250 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.453+0000 7fe09ef35700 1 --2- 172.21.15.40:0/903517946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe098138250 0x7fe09813f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.453+0000 7fe09ef35700 1 --2- 172.21.15.40:0/903517946 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe09813b130 0x7fe09813fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.453+0000 7fe09ef35700 1 -- 172.21.15.40:0/903517946 >> 172.21.15.40:0/903517946 conn(0x7fe0980a2a00 msgr2=0x7fe0980a2170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:44.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.453+0000 7fe09ef35700 1 -- 172.21.15.40:0/903517946 shutdown_connections 2023-09-30T22:30:44.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.453+0000 7fe09ef35700 1 -- 172.21.15.40:0/903517946 wait complete. 2023-09-30T22:30:44.466 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:44.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.484+0000 7f6466512700 1 -- 172.21.15.40:0/2105278950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6460062380 con 0x7f646009e2b0 2023-09-30T22:30:44.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.485+0000 7f645cff9700 1 -- 172.21.15.40:0/2105278950 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6458027b50 con 0x7f646009e2b0 2023-09-30T22:30:44.485 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:44.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.487+0000 7f6466512700 1 -- 172.21.15.40:0/2105278950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f646009e2b0 msgr2=0x7f646012dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:44.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.487+0000 7f6466512700 1 --2- 172.21.15.40:0/2105278950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f646009e2b0 0x7f646012dba0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f6458011650 tx=0x7f6458011960 comp rx=0 tx=0).stop 2023-09-30T22:30:44.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.487+0000 7f6466512700 1 -- 172.21.15.40:0/2105278950 shutdown_connections 2023-09-30T22:30:44.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.487+0000 7f6466512700 1 --2- 172.21.15.40:0/2105278950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f646009e2b0 0x7f646012dba0 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.487+0000 7f6466512700 1 --2- 172.21.15.40:0/2105278950 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f646009c890 0x7f646012d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.487+0000 7f6466512700 1 --2- 172.21.15.40:0/2105278950 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f646009d920 0x7f646012d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.487+0000 7f6466512700 1 -- 172.21.15.40:0/2105278950 >> 172.21.15.40:0/2105278950 conn(0x7f64600a7080 msgr2=0x7f64601331e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:44.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.487+0000 7f6466512700 1 -- 172.21.15.40:0/2105278950 shutdown_connections 2023-09-30T22:30:44.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.487+0000 7f6466512700 1 -- 172.21.15.40:0/2105278950 wait complete. 2023-09-30T22:30:44.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.491+0000 7f4c9ec54700 1 Processor -- start 2023-09-30T22:30:44.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.491+0000 7f4c9ec54700 1 -- start start 2023-09-30T22:30:44.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.491+0000 7f4c9ec54700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4c9809c890 0x7f4c9809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:44.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.491+0000 7f4c9ec54700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c9809d920 0x7f4c9809dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:44.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.491+0000 7f4c9ec54700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c980a2600 con 0x7f4c9809e2b0 2023-09-30T22:30:44.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.491+0000 7f4c9ec54700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c980a29d0 con 0x7f4c9809c890 2023-09-30T22:30:44.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.491+0000 7f4c9ec54700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9809fb40 con 0x7f4c9809d920 2023-09-30T22:30:44.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.491+0000 7f4c9c9f0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4c9809c890 0x7f4c9809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:44.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.491+0000 7f4c97fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c9809d920 0x7f4c9809dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:44.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.492+0000 7f4c97fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c9809d920 0x7f4c9809dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:44632/0 (socket says 172.21.15.40:44632) 2023-09-30T22:30:44.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.492+0000 7f4c9c9f0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4c9809c890 0x7f4c9809cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43238/0 (socket says 172.21.15.40:43238) 2023-09-30T22:30:44.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.492+0000 7f4c97fff700 1 -- 172.21.15.40:0/985362279 learned_addr learned my addr 172.21.15.40:0/985362279 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:44.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.492+0000 7f4c9d1f1700 1 --1- 172.21.15.40:0/985362279 >> v1:172.21.15.40:6789/0 conn(0x7f4c9809e2b0 0x7f4c9813ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51978/0 (socket says 172.21.15.40:51978) 2023-09-30T22:30:44.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.492+0000 7f4c97fff700 1 -- 172.21.15.40:0/985362279 >> v2:172.21.15.40:3300/0 conn(0x7f4c9809c890 msgr2=0x7f4c9809cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:44.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.492+0000 7f4c97fff700 1 --2- 172.21.15.40:0/985362279 >> v2:172.21.15.40:3300/0 conn(0x7f4c9809c890 0x7f4c9809cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.492+0000 7f4c97fff700 1 -- 172.21.15.40:0/985362279 >> v1:172.21.15.40:6789/0 conn(0x7f4c9809e2b0 legacy=0x7f4c9813ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:44.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.492+0000 7f4c97fff700 1 -- 172.21.15.40:0/985362279 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c9809e730 con 0x7f4c9809d920 2023-09-30T22:30:44.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.492+0000 7f4c9c9f0700 1 --2- 172.21.15.40:0/985362279 >> v2:172.21.15.40:3300/0 conn(0x7f4c9809c890 0x7f4c9809cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:44.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.492+0000 7f4c97fff700 1 --2- 172.21.15.40:0/985362279 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c9809d920 0x7f4c9809dd70 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f4c840098f0 tx=0x7f4c84009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c10c075ff543569c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:44.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.492+0000 7f4c977fe700 1 -- 172.21.15.40:0/985362279 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c84011830 con 0x7f4c9809d920 2023-09-30T22:30:44.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.492+0000 7f4c977fe700 1 -- 172.21.15.40:0/985362279 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c84011990 con 0x7f4c9809d920 2023-09-30T22:30:44.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.492+0000 7f4c977fe700 1 -- 172.21.15.40:0/985362279 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c84011d20 con 0x7f4c9809d920 2023-09-30T22:30:44.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.493+0000 7f4c9ec54700 1 -- 172.21.15.40:0/985362279 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c9809d920 msgr2=0x7f4c9809dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:44.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.493+0000 7f4c9ec54700 1 --2- 172.21.15.40:0/985362279 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c9809d920 0x7f4c9809dd70 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f4c840098f0 tx=0x7f4c84009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:44.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.493+0000 7f4c9ec54700 1 -- 172.21.15.40:0/985362279 shutdown_connections 2023-09-30T22:30:44.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.493+0000 7f4c9ec54700 1 --2- 172.21.15.40:0/985362279 >> v2:172.21.15.40:3300/0 conn(0x7f4c9809c890 0x7f4c9809cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.493+0000 7f4c9ec54700 1 --2- 172.21.15.40:0/985362279 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c9809d920 0x7f4c9809dd70 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.493+0000 7f4c9ec54700 1 -- 172.21.15.40:0/985362279 >> 172.21.15.40:0/985362279 conn(0x7f4c980a7080 msgr2=0x7f4c980a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:44.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.493+0000 7f4c9ec54700 1 -- 172.21.15.40:0/985362279 shutdown_connections 2023-09-30T22:30:44.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.493+0000 7f4c9ec54700 1 -- 172.21.15.40:0/985362279 wait complete. 2023-09-30T22:30:44.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.494+0000 7f4c9ec54700 1 Processor -- start 2023-09-30T22:30:44.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.494+0000 7f4c9ec54700 1 -- start start 2023-09-30T22:30:44.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.495+0000 7f4c9ec54700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c9809c890 0x7f4c981c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:44.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.495+0000 7f4c9ec54700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c9809d920 0x7f4c981c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:44.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.495+0000 7f4c9ec54700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c9809e2b0 0x7f4c9812d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:44.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.495+0000 7f4c9ec54700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9808f3e0 con 0x7f4c9809d920 2023-09-30T22:30:44.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.495+0000 7f4c9ec54700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c98130940 con 0x7f4c9809e2b0 2023-09-30T22:30:44.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.495+0000 7f4c9ec54700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9812fe60 con 0x7f4c9809c890 2023-09-30T22:30:44.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.495+0000 7f4c9d1f1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c9809e2b0 0x7f4c9812d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:44.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.495+0000 7f4c97fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c9809d920 0x7f4c981c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:44.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.495+0000 7f4c9d1f1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c9809e2b0 0x7f4c9812d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:44638/0 (socket says 172.21.15.40:44638) 2023-09-30T22:30:44.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.495+0000 7f4c97fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c9809d920 0x7f4c981c9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43250/0 (socket says 172.21.15.40:43250) 2023-09-30T22:30:44.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.495+0000 7f4c9d1f1700 1 -- 172.21.15.40:0/3702589767 learned_addr learned my addr 172.21.15.40:0/3702589767 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:44.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.495+0000 7f4c9c9f0700 1 --2- 172.21.15.40:0/3702589767 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c9809c890 0x7f4c981c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:44.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.495+0000 7f4c97fff700 1 -- 172.21.15.40:0/3702589767 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c9809c890 msgr2=0x7f4c981c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:44.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.495+0000 7f4c97fff700 1 --2- 172.21.15.40:0/3702589767 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c9809c890 0x7f4c981c8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.495+0000 7f4c97fff700 1 -- 172.21.15.40:0/3702589767 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c9809e2b0 msgr2=0x7f4c9812d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:44.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.495+0000 7f4c97fff700 1 --2- 172.21.15.40:0/3702589767 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c9809e2b0 0x7f4c9812d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.495+0000 7f4c97fff700 1 -- 172.21.15.40:0/3702589767 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8c009430 con 0x7f4c9809d920 2023-09-30T22:30:44.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.495+0000 7f4c9d1f1700 1 --2- 172.21.15.40:0/3702589767 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c9809e2b0 0x7f4c9812d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:44.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.495+0000 7f4c97fff700 1 --2- 172.21.15.40:0/3702589767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c9809d920 0x7f4c981c9100 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f4c84016000 tx=0x7f4c84004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:44.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.495+0000 7f4c957fa700 1 -- 172.21.15.40:0/3702589767 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c84004400 con 0x7f4c9809d920 2023-09-30T22:30:44.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.495+0000 7f4c957fa700 1 -- 172.21.15.40:0/3702589767 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8401f070 con 0x7f4c9809d920 2023-09-30T22:30:44.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.495+0000 7f4c9ec54700 1 -- 172.21.15.40:0/3702589767 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c84009550 con 0x7f4c9809d920 2023-09-30T22:30:44.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.496+0000 7f4c957fa700 1 -- 172.21.15.40:0/3702589767 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c840038e0 con 0x7f4c9809d920 2023-09-30T22:30:44.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.496+0000 7f4c9ec54700 1 -- 172.21.15.40:0/3702589767 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c98130c50 con 0x7f4c9809d920 2023-09-30T22:30:44.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.496+0000 7f4c957fa700 1 -- 172.21.15.40:0/3702589767 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4c84021030 con 0x7f4c9809d920 2023-09-30T22:30:44.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.497+0000 7f4c957fa700 1 -- 172.21.15.40:0/3702589767 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4c840408c0 con 0x7f4c9809d920 2023-09-30T22:30:44.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.497+0000 7f4c9ec54700 1 -- 172.21.15.40:0/3702589767 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c98130c50 con 0x7f4c9809d920 2023-09-30T22:30:44.503 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:44.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.503+0000 7f4c957fa700 1 -- 172.21.15.40:0/3702589767 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4c98130c50 con 0x7f4c9809d920 2023-09-30T22:30:44.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.700+0000 7f4c9ec54700 1 -- 172.21.15.40:0/3702589767 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4c98130c50 con 0x7f4c9809d920 2023-09-30T22:30:44.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.700+0000 7f4c957fa700 1 -- 172.21.15.40:0/3702589767 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4c98130c50 con 0x7f4c9809d920 2023-09-30T22:30:44.701 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:44.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.702+0000 7f4c9ec54700 1 -- 172.21.15.40:0/3702589767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c9809d920 msgr2=0x7f4c981c9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:44.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.702+0000 7f4c9ec54700 1 --2- 172.21.15.40:0/3702589767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c9809d920 0x7f4c981c9100 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f4c84016000 tx=0x7f4c84004750 comp rx=0 tx=0).stop 2023-09-30T22:30:44.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.702+0000 7f4c9ec54700 1 -- 172.21.15.40:0/3702589767 shutdown_connections 2023-09-30T22:30:44.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.702+0000 7f4c9ec54700 1 --2- 172.21.15.40:0/3702589767 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c9809c890 0x7f4c981c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.702+0000 7f4c9ec54700 1 --2- 172.21.15.40:0/3702589767 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c9809e2b0 0x7f4c9812d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.702+0000 7f4c9ec54700 1 --2- 172.21.15.40:0/3702589767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c9809d920 0x7f4c981c9100 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:44.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.702+0000 7f4c9ec54700 1 -- 172.21.15.40:0/3702589767 >> 172.21.15.40:0/3702589767 conn(0x7f4c980a7080 msgr2=0x7f4c980a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:44.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.702+0000 7f4c9ec54700 1 -- 172.21.15.40:0/3702589767 shutdown_connections 2023-09-30T22:30:44.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:44.702+0000 7f4c9ec54700 1 -- 172.21.15.40:0/3702589767 wait complete. 2023-09-30T22:30:44.715 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:45.429 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:45.467 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:45.504 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:45.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.572+0000 7fcef1c1b700 1 Processor -- start 2023-09-30T22:30:45.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.572+0000 7fcef1c1b700 1 -- start start 2023-09-30T22:30:45.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.573+0000 7fcef1c1b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fceec09c890 0x7fceec09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.573+0000 7fcef1c1b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fceec09d920 0x7fceec09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.573+0000 7fcef1c1b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceec0a2600 con 0x7fceec09e2b0 2023-09-30T22:30:45.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.573+0000 7fcef1c1b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceec0a29d0 con 0x7fceec09c890 2023-09-30T22:30:45.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.573+0000 7fcef1c1b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fceec09fb40 con 0x7fceec09d920 2023-09-30T22:30:45.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.573+0000 7fceebfff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fceec09e2b0 0x7fceec13ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51992/0 (socket says 172.21.15.40:51992) 2023-09-30T22:30:45.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.573+0000 7fceeb7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fceec09c890 0x7fceec09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.573+0000 7fceebfff700 1 -- 172.21.15.40:0/1887936827 learned_addr learned my addr 172.21.15.40:0/1887936827 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:45.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.573+0000 7fceeaffd700 1 --2- 172.21.15.40:0/1887936827 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fceec09d920 0x7fceec09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.573+0000 7fceeaffd700 1 -- 172.21.15.40:0/1887936827 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fceec09c890 msgr2=0x7fceec09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:45.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.573+0000 7fceeaffd700 1 --2- 172.21.15.40:0/1887936827 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fceec09c890 0x7fceec09cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.573+0000 7fceea7fc700 1 -- 172.21.15.40:0/1887936827 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1574868511 0 0) 0x7fceec0a2600 con 0x7fceec09e2b0 2023-09-30T22:30:45.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.573+0000 7fceeaffd700 1 -- 172.21.15.40:0/1887936827 >> v1:172.21.15.40:6789/0 conn(0x7fceec09e2b0 legacy=0x7fceec13ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.573+0000 7fceeaffd700 1 -- 172.21.15.40:0/1887936827 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceec09e720 con 0x7fceec09d920 2023-09-30T22:30:45.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.573+0000 7fceeb7fe700 1 --2- 172.21.15.40:0/1887936827 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fceec09c890 0x7fceec09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:45.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.574+0000 7fceeaffd700 1 --2- 172.21.15.40:0/1887936827 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fceec09d920 0x7fceec09dd70 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fcee0009870 tx=0x7fcee0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73b528c7a63d9f19 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:45.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.574+0000 7fceea7fc700 1 -- 172.21.15.40:0/1887936827 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee0011830 con 0x7fceec09d920 2023-09-30T22:30:45.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.574+0000 7fceea7fc700 1 -- 172.21.15.40:0/1887936827 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee0011990 con 0x7fceec09d920 2023-09-30T22:30:45.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.574+0000 7fceea7fc700 1 -- 172.21.15.40:0/1887936827 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee0011d20 con 0x7fceec09d920 2023-09-30T22:30:45.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.574+0000 7fcef1c1b700 1 -- 172.21.15.40:0/1887936827 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fceec09d920 msgr2=0x7fceec09dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.574+0000 7fcef1c1b700 1 --2- 172.21.15.40:0/1887936827 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fceec09d920 0x7fceec09dd70 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fcee0009870 tx=0x7fcee0009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:45.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.575+0000 7fcef1c1b700 1 -- 172.21.15.40:0/1887936827 shutdown_connections 2023-09-30T22:30:45.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.575+0000 7fcef1c1b700 1 --2- 172.21.15.40:0/1887936827 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fceec09c890 0x7fceec09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.575+0000 7fcef1c1b700 1 --2- 172.21.15.40:0/1887936827 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fceec09d920 0x7fceec09dd70 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.575+0000 7fcef1c1b700 1 -- 172.21.15.40:0/1887936827 >> 172.21.15.40:0/1887936827 conn(0x7fceec0a7080 msgr2=0x7fceec0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:45.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.575+0000 7fcef1c1b700 1 -- 172.21.15.40:0/1887936827 shutdown_connections 2023-09-30T22:30:45.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.575+0000 7fcef1c1b700 1 -- 172.21.15.40:0/1887936827 wait complete. 2023-09-30T22:30:45.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.576+0000 7fcef1c1b700 1 Processor -- start 2023-09-30T22:30:45.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.576+0000 7fcef1c1b700 1 -- start start 2023-09-30T22:30:45.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.576+0000 7fcef1c1b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fceec09c890 0x7fceec1c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.576+0000 7fcef1c1b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fceec09d920 0x7fceec1c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.576+0000 7fcef1c1b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fceec09e2b0 0x7fceec12d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.576+0000 7fcef1c1b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec130b70 con 0x7fceec09d920 2023-09-30T22:30:45.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.576+0000 7fcef1c1b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceec130d50 con 0x7fceec09e2b0 2023-09-30T22:30:45.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.576+0000 7fcef1c1b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fceec0a59b0 con 0x7fceec09c890 2023-09-30T22:30:45.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.576+0000 7fceeb7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fceec09c890 0x7fceec1c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.576+0000 7fceeb7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fceec09c890 0x7fceec1c8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56390/0 (socket says 172.21.15.40:56390) 2023-09-30T22:30:45.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.576+0000 7fceeb7fe700 1 -- 172.21.15.40:0/2442859647 learned_addr learned my addr 172.21.15.40:0/2442859647 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:45.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.576+0000 7fceeaffd700 1 --2- 172.21.15.40:0/2442859647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fceec09d920 0x7fceec1c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.576+0000 7fceebfff700 1 --2- 172.21.15.40:0/2442859647 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fceec09e2b0 0x7fceec12d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.577+0000 7fceeb7fe700 1 -- 172.21.15.40:0/2442859647 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fceec09e2b0 msgr2=0x7fceec12d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.577+0000 7fceeb7fe700 1 --2- 172.21.15.40:0/2442859647 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fceec09e2b0 0x7fceec12d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.577+0000 7fceeb7fe700 1 -- 172.21.15.40:0/2442859647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fceec09d920 msgr2=0x7fceec1c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.577+0000 7fceeb7fe700 1 --2- 172.21.15.40:0/2442859647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fceec09d920 0x7fceec1c9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.577+0000 7fceeb7fe700 1 -- 172.21.15.40:0/2442859647 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcedc009430 con 0x7fceec09c890 2023-09-30T22:30:45.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.577+0000 7fceeb7fe700 1 --2- 172.21.15.40:0/2442859647 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fceec09c890 0x7fceec1c8bc0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fcedc00ec10 tx=0x7fcedc00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:45.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.577+0000 7fced3fff700 1 -- 172.21.15.40:0/2442859647 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcedc005a20 con 0x7fceec09c890 2023-09-30T22:30:45.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.577+0000 7fced3fff700 1 -- 172.21.15.40:0/2442859647 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcedc005b80 con 0x7fceec09c890 2023-09-30T22:30:45.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.577+0000 7fced3fff700 1 -- 172.21.15.40:0/2442859647 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcedc00c910 con 0x7fceec09c890 2023-09-30T22:30:45.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.577+0000 7fcef1c1b700 1 -- 172.21.15.40:0/2442859647 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee00094a0 con 0x7fceec09c890 2023-09-30T22:30:45.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.577+0000 7fcef1c1b700 1 -- 172.21.15.40:0/2442859647 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceec12fbd0 con 0x7fceec09c890 2023-09-30T22:30:45.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.578+0000 7fced3fff700 1 -- 172.21.15.40:0/2442859647 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcedc00ca70 con 0x7fceec09c890 2023-09-30T22:30:45.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.578+0000 7fcef1c1b700 1 -- 172.21.15.40:0/2442859647 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceec062380 con 0x7fceec09c890 2023-09-30T22:30:45.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.579+0000 7fced3fff700 1 -- 172.21.15.40:0/2442859647 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fcedc03fa40 con 0x7fceec09c890 2023-09-30T22:30:45.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.587+0000 7fced3fff700 1 -- 172.21.15.40:0/2442859647 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcedc011b00 con 0x7fceec09c890 2023-09-30T22:30:45.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.614+0000 7fcdded2e700 1 Processor -- start 2023-09-30T22:30:45.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.614+0000 7fcdded2e700 1 -- start start 2023-09-30T22:30:45.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.614+0000 7fcdded2e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdd809d920 0x7fcdd809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.614+0000 7fcdded2e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcdd809e230 0x7fcdd81308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.614+0000 7fcdded2e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd809adf0 con 0x7fcdd8130de0 2023-09-30T22:30:45.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.614+0000 7fcdded2e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdd809edf0 con 0x7fcdd809e230 2023-09-30T22:30:45.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.614+0000 7fcdded2e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd809b660 con 0x7fcdd809d920 2023-09-30T22:30:45.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.615+0000 7fcddcaca700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdd809d920 0x7fcdd809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.615+0000 7fcddcaca700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdd809d920 0x7fcdd809dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56400/0 (socket says 172.21.15.40:56400) 2023-09-30T22:30:45.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.615+0000 7fcddcaca700 1 -- 172.21.15.40:0/4197161009 learned_addr learned my addr 172.21.15.40:0/4197161009 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:45.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.615+0000 7fcdd7fff700 1 --2- 172.21.15.40:0/4197161009 >> v2:172.21.15.40:3300/0 conn(0x7fcdd809e230 0x7fcdd81308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.615+0000 7fcddcaca700 1 -- 172.21.15.40:0/4197161009 >> v2:172.21.15.40:3300/0 conn(0x7fcdd809e230 msgr2=0x7fcdd81308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:45.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.615+0000 7fcddcaca700 1 --2- 172.21.15.40:0/4197161009 >> v2:172.21.15.40:3300/0 conn(0x7fcdd809e230 0x7fcdd81308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.615+0000 7fcddcaca700 1 -- 172.21.15.40:0/4197161009 >> v1:172.21.15.40:6789/0 conn(0x7fcdd8130de0 legacy=0x7fcdd8137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.615+0000 7fcddcaca700 1 -- 172.21.15.40:0/4197161009 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd809a6e0 con 0x7fcdd809d920 2023-09-30T22:30:45.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.615+0000 7fcdd7fff700 1 --2- 172.21.15.40:0/4197161009 >> v2:172.21.15.40:3300/0 conn(0x7fcdd809e230 0x7fcdd81308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:45.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.615+0000 7fcddcaca700 1 --2- 172.21.15.40:0/4197161009 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdd809d920 0x7fcdd809dcf0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc006fd0 tx=0x7fcdcc009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78222b1035eba7be server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:45.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.615+0000 7fcdd77fe700 1 -- 172.21.15.40:0/4197161009 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc005e30 con 0x7fcdd809d920 2023-09-30T22:30:45.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.615+0000 7fcdd77fe700 1 -- 172.21.15.40:0/4197161009 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdcc004030 con 0x7fcdd809d920 2023-09-30T22:30:45.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.615+0000 7fcdd77fe700 1 -- 172.21.15.40:0/4197161009 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc0043e0 con 0x7fcdd809d920 2023-09-30T22:30:45.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.616+0000 7fcdded2e700 1 -- 172.21.15.40:0/4197161009 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdd809d920 msgr2=0x7fcdd809dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.616+0000 7fcdded2e700 1 --2- 172.21.15.40:0/4197161009 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdd809d920 0x7fcdd809dcf0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc006fd0 tx=0x7fcdcc009bd0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.616+0000 7fcdded2e700 1 -- 172.21.15.40:0/4197161009 shutdown_connections 2023-09-30T22:30:45.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.616+0000 7fcdded2e700 1 --2- 172.21.15.40:0/4197161009 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdd809d920 0x7fcdd809dcf0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.616+0000 7fcdded2e700 1 --2- 172.21.15.40:0/4197161009 >> v2:172.21.15.40:3300/0 conn(0x7fcdd809e230 0x7fcdd81308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.616+0000 7fcdded2e700 1 -- 172.21.15.40:0/4197161009 >> 172.21.15.40:0/4197161009 conn(0x7fcdd809fb20 msgr2=0x7fcdd809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:45.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.616+0000 7fcdded2e700 1 -- 172.21.15.40:0/4197161009 shutdown_connections 2023-09-30T22:30:45.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.616+0000 7fcdded2e700 1 -- 172.21.15.40:0/4197161009 wait complete. 2023-09-30T22:30:45.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.617+0000 7fcdded2e700 1 Processor -- start 2023-09-30T22:30:45.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.617+0000 7fcdded2e700 1 -- start start 2023-09-30T22:30:45.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.618+0000 7fcdded2e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdd809d920 0x7fcdd812c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.618+0000 7fcdded2e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdd809e230 0x7fcdd812c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.618+0000 7fcdded2e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdd8130de0 0x7fcdd812cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.618+0000 7fcdded2e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd812f640 con 0x7fcdd809e230 2023-09-30T22:30:45.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.618+0000 7fcdded2e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd812f8b0 con 0x7fcdd8130de0 2023-09-30T22:30:45.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.618+0000 7fcdded2e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd812da40 con 0x7fcdd809d920 2023-09-30T22:30:45.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.618+0000 7fcddd2cb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdd8130de0 0x7fcdd812cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.618+0000 7fcddd2cb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdd8130de0 0x7fcdd812cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:44676/0 (socket says 172.21.15.40:44676) 2023-09-30T22:30:45.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.618+0000 7fcddd2cb700 1 -- 172.21.15.40:0/2621301230 learned_addr learned my addr 172.21.15.40:0/2621301230 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:45.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.618+0000 7fcdd7fff700 1 --2- 172.21.15.40:0/2621301230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdd809e230 0x7fcdd812c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.618+0000 7fcddd2cb700 1 -- 172.21.15.40:0/2621301230 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdd809d920 msgr2=0x7fcdd812c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.618+0000 7fcddd2cb700 1 --2- 172.21.15.40:0/2621301230 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdd809d920 0x7fcdd812c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.618+0000 7fcddd2cb700 1 -- 172.21.15.40:0/2621301230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdd809e230 msgr2=0x7fcdd812c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.618+0000 7fcddd2cb700 1 --2- 172.21.15.40:0/2621301230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdd809e230 0x7fcdd812c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.618+0000 7fcddd2cb700 1 -- 172.21.15.40:0/2621301230 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc40094a0 con 0x7fcdd8130de0 2023-09-30T22:30:45.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.618+0000 7fcddd2cb700 1 --2- 172.21.15.40:0/2621301230 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdd8130de0 0x7fcdd812cb40 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fcdd000cc50 tx=0x7fcdd000cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:45.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.618+0000 7fcdd57fa700 1 -- 172.21.15.40:0/2621301230 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd0003c00 con 0x7fcdd8130de0 2023-09-30T22:30:45.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.619+0000 7fcdd57fa700 1 -- 172.21.15.40:0/2621301230 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd0003d60 con 0x7fcdd8130de0 2023-09-30T22:30:45.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.619+0000 7fcdd57fa700 1 -- 172.21.15.40:0/2621301230 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd000ab60 con 0x7fcdd8130de0 2023-09-30T22:30:45.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.619+0000 7fcdded2e700 1 -- 172.21.15.40:0/2621301230 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdcc009500 con 0x7fcdd8130de0 2023-09-30T22:30:45.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.619+0000 7fcdded2e700 1 -- 172.21.15.40:0/2621301230 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd812d4b0 con 0x7fcdd8130de0 2023-09-30T22:30:45.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.620+0000 7fcdd57fa700 1 -- 172.21.15.40:0/2621301230 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcdd000acc0 con 0x7fcdd8130de0 2023-09-30T22:30:45.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.620+0000 7fcdded2e700 1 -- 172.21.15.40:0/2621301230 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdd812f270 con 0x7fcdd8130de0 2023-09-30T22:30:45.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.620+0000 7fcdd57fa700 1 -- 172.21.15.40:0/2621301230 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fcdd003f810 con 0x7fcdd8130de0 2023-09-30T22:30:45.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.625+0000 7fcdd57fa700 1 -- 172.21.15.40:0/2621301230 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcdd00198f0 con 0x7fcdd8130de0 2023-09-30T22:30:45.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.652+0000 7f9fea26c700 1 Processor -- start 2023-09-30T22:30:45.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.652+0000 7f9fea26c700 1 -- start start 2023-09-30T22:30:45.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.652+0000 7f9fea26c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9fe409fbb0 0x7f9fe406c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.652+0000 7f9fea26c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9fe406ced0 0x7f9fe406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.652+0000 7f9fea26c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9fe4138370 0x7f9fe413a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.652+0000 7f9fea26c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe409ff80 con 0x7f9fe409fbb0 2023-09-30T22:30:45.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.652+0000 7f9fea26c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe406da80 con 0x7f9fe4138370 2023-09-30T22:30:45.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.652+0000 7f9fea26c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe406d800 con 0x7f9fe406ced0 2023-09-30T22:30:45.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.653+0000 7f9fe37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9fe406ced0 0x7f9fe406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.653+0000 7f9fe37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9fe406ced0 0x7f9fe406d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56408/0 (socket says 172.21.15.40:56408) 2023-09-30T22:30:45.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.653+0000 7f9fe8809700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9fe4138370 0x7f9fe413a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.653+0000 7f9fe37fe700 1 -- 172.21.15.40:0/2696778259 learned_addr learned my addr 172.21.15.40:0/2696778259 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:45.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.653+0000 7f9fe3fff700 1 --2- 172.21.15.40:0/2696778259 >> v2:172.21.15.40:3300/0 conn(0x7f9fe409fbb0 0x7f9fe406c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.653+0000 7f9fe37fe700 1 -- 172.21.15.40:0/2696778259 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9fe4138370 msgr2=0x7f9fe413a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:45.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.653+0000 7f9fe37fe700 1 --2- 172.21.15.40:0/2696778259 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9fe4138370 0x7f9fe413a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.653+0000 7f9fe37fe700 1 -- 172.21.15.40:0/2696778259 >> v2:172.21.15.40:3300/0 conn(0x7f9fe409fbb0 msgr2=0x7f9fe406c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:45.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.653+0000 7f9fe37fe700 1 --2- 172.21.15.40:0/2696778259 >> v2:172.21.15.40:3300/0 conn(0x7f9fe409fbb0 0x7f9fe406c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.653+0000 7f9fe37fe700 1 -- 172.21.15.40:0/2696778259 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe40a0590 con 0x7f9fe406ced0 2023-09-30T22:30:45.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.653+0000 7f9fe8809700 1 --2- 172.21.15.40:0/2696778259 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9fe4138370 0x7f9fe413a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:45.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.653+0000 7f9fe37fe700 1 --2- 172.21.15.40:0/2696778259 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9fe406ced0 0x7f9fe406d2c0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8009920 tx=0x7f9fd8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53fcff963ded41c1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:45.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.653+0000 7f9fe2ffd700 1 -- 172.21.15.40:0/2696778259 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8011830 con 0x7f9fe406ced0 2023-09-30T22:30:45.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.653+0000 7f9fe2ffd700 1 -- 172.21.15.40:0/2696778259 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd8011990 con 0x7f9fe406ced0 2023-09-30T22:30:45.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.653+0000 7f9fe2ffd700 1 -- 172.21.15.40:0/2696778259 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8011d20 con 0x7f9fe406ced0 2023-09-30T22:30:45.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.654+0000 7f9fea26c700 1 -- 172.21.15.40:0/2696778259 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9fe406ced0 msgr2=0x7f9fe406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.654+0000 7f9fea26c700 1 --2- 172.21.15.40:0/2696778259 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9fe406ced0 0x7f9fe406d2c0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8009920 tx=0x7f9fd8009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:45.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.654+0000 7f9fea26c700 1 -- 172.21.15.40:0/2696778259 shutdown_connections 2023-09-30T22:30:45.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.654+0000 7f9fea26c700 1 --2- 172.21.15.40:0/2696778259 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9fe4138370 0x7f9fe413a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.654+0000 7f9fea26c700 1 --2- 172.21.15.40:0/2696778259 >> v2:172.21.15.40:3300/0 conn(0x7f9fe409fbb0 0x7f9fe406c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.654+0000 7f9fea26c700 1 --2- 172.21.15.40:0/2696778259 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9fe406ced0 0x7f9fe406d2c0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.654+0000 7f9fea26c700 1 -- 172.21.15.40:0/2696778259 >> 172.21.15.40:0/2696778259 conn(0x7f9fe40a41a0 msgr2=0x7f9fe40a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:45.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.654+0000 7f9fea26c700 1 -- 172.21.15.40:0/2696778259 shutdown_connections 2023-09-30T22:30:45.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.654+0000 7f9fea26c700 1 -- 172.21.15.40:0/2696778259 wait complete. 2023-09-30T22:30:45.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.655+0000 7f9fea26c700 1 Processor -- start 2023-09-30T22:30:45.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.655+0000 7f9fea26c700 1 -- start start 2023-09-30T22:30:45.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.656+0000 7f9fea26c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fe406ced0 0x7f9fe40908e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.656+0000 7f9fea26c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9fe409fbb0 0x7f9fe4090e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.656+0000 7f9fea26c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9fe4138370 0x7f9fe4091360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.656+0000 7f9fea26c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe4093a20 con 0x7f9fe406ced0 2023-09-30T22:30:45.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.656+0000 7f9fea26c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe4096f20 con 0x7f9fe4138370 2023-09-30T22:30:45.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.656+0000 7f9fea26c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe4093ce0 con 0x7f9fe409fbb0 2023-09-30T22:30:45.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.656+0000 7f9fe8809700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9fe4138370 0x7f9fe4091360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.656+0000 7f9fe8809700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9fe4138370 0x7f9fe4091360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:44700/0 (socket says 172.21.15.40:44700) 2023-09-30T22:30:45.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.656+0000 7f9fe8809700 1 -- 172.21.15.40:0/2031897344 learned_addr learned my addr 172.21.15.40:0/2031897344 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:45.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.656+0000 7f9fe37fe700 1 --2- 172.21.15.40:0/2031897344 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9fe409fbb0 0x7f9fe4090e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.656+0000 7f9fe3fff700 1 --2- 172.21.15.40:0/2031897344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fe406ced0 0x7f9fe40908e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.656+0000 7f9fe37fe700 1 -- 172.21.15.40:0/2031897344 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9fe4138370 msgr2=0x7f9fe4091360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.656+0000 7f9fe37fe700 1 --2- 172.21.15.40:0/2031897344 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9fe4138370 0x7f9fe4091360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.656+0000 7f9fe37fe700 1 -- 172.21.15.40:0/2031897344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fe406ced0 msgr2=0x7f9fe40908e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.656+0000 7f9fe37fe700 1 --2- 172.21.15.40:0/2031897344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fe406ced0 0x7f9fe40908e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.656+0000 7f9fe37fe700 1 -- 172.21.15.40:0/2031897344 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fdc009a70 con 0x7f9fe409fbb0 2023-09-30T22:30:45.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.656+0000 7f9fe8809700 1 --2- 172.21.15.40:0/2031897344 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9fe4138370 0x7f9fe4091360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:45.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.656+0000 7f9fe3fff700 1 --2- 172.21.15.40:0/2031897344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fe406ced0 0x7f9fe40908e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:45.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.657+0000 7f9fe37fe700 1 --2- 172.21.15.40:0/2031897344 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9fe409fbb0 0x7f9fe4090e20 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8016000 tx=0x7f9fd8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:45.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.657+0000 7f9fe0ff9700 1 -- 172.21.15.40:0/2031897344 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8004240 con 0x7f9fe409fbb0 2023-09-30T22:30:45.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.657+0000 7f9fe0ff9700 1 -- 172.21.15.40:0/2031897344 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd801f070 con 0x7f9fe409fbb0 2023-09-30T22:30:45.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.657+0000 7f9fea26c700 1 -- 172.21.15.40:0/2031897344 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fd8009550 con 0x7f9fe409fbb0 2023-09-30T22:30:45.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.657+0000 7f9fe0ff9700 1 -- 172.21.15.40:0/2031897344 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd80036a0 con 0x7f9fe409fbb0 2023-09-30T22:30:45.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.657+0000 7f9fea26c700 1 -- 172.21.15.40:0/2031897344 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe40920c0 con 0x7f9fe409fbb0 2023-09-30T22:30:45.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.658+0000 7f9fe0ff9700 1 -- 172.21.15.40:0/2031897344 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9fd8021030 con 0x7f9fe409fbb0 2023-09-30T22:30:45.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.658+0000 7f9fea26c700 1 -- 172.21.15.40:0/2031897344 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe4062380 con 0x7f9fe409fbb0 2023-09-30T22:30:45.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.658+0000 7f9fe0ff9700 1 -- 172.21.15.40:0/2031897344 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9fd8040820 con 0x7f9fe409fbb0 2023-09-30T22:30:45.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.663+0000 7f9fe0ff9700 1 -- 172.21.15.40:0/2031897344 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9fd80239c0 con 0x7f9fe409fbb0 2023-09-30T22:30:45.716 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:45.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.794+0000 7fcef1c1b700 1 -- 172.21.15.40:0/2442859647 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fceec074620 con 0x7fceec09c890 2023-09-30T22:30:45.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.795+0000 7fced3fff700 1 -- 172.21.15.40:0/2442859647 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcedc013e60 con 0x7fceec09c890 2023-09-30T22:30:45.796 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:45.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.797+0000 7fcef1c1b700 1 -- 172.21.15.40:0/2442859647 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fceec09c890 msgr2=0x7fceec1c8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.797+0000 7fcef1c1b700 1 --2- 172.21.15.40:0/2442859647 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fceec09c890 0x7fceec1c8bc0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fcedc00ec10 tx=0x7fcedc00ef20 comp rx=0 tx=0).stop 2023-09-30T22:30:45.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.797+0000 7fcef1c1b700 1 -- 172.21.15.40:0/2442859647 shutdown_connections 2023-09-30T22:30:45.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.797+0000 7fcef1c1b700 1 --2- 172.21.15.40:0/2442859647 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fceec09c890 0x7fceec1c8bc0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.797+0000 7fcef1c1b700 1 --2- 172.21.15.40:0/2442859647 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fceec09e2b0 0x7fceec12d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.797+0000 7fcef1c1b700 1 --2- 172.21.15.40:0/2442859647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fceec09d920 0x7fceec1c9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.797+0000 7fcef1c1b700 1 -- 172.21.15.40:0/2442859647 >> 172.21.15.40:0/2442859647 conn(0x7fceec0a7080 msgr2=0x7fceec132700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:45.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.797+0000 7fcef1c1b700 1 -- 172.21.15.40:0/2442859647 shutdown_connections 2023-09-30T22:30:45.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.797+0000 7fcef1c1b700 1 -- 172.21.15.40:0/2442859647 wait complete. 2023-09-30T22:30:45.815 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:45.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.829+0000 7fcdded2e700 1 -- 172.21.15.40:0/2621301230 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcdd809cb00 con 0x7fcdd8130de0 2023-09-30T22:30:45.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.829+0000 7fcdd57fa700 1 -- 172.21.15.40:0/2621301230 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcdd002dec0 con 0x7fcdd8130de0 2023-09-30T22:30:45.830 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:45.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.832+0000 7fcdded2e700 1 -- 172.21.15.40:0/2621301230 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdd8130de0 msgr2=0x7fcdd812cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.832+0000 7fcdded2e700 1 --2- 172.21.15.40:0/2621301230 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdd8130de0 0x7fcdd812cb40 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fcdd000cc50 tx=0x7fcdd000cf60 comp rx=0 tx=0).stop 2023-09-30T22:30:45.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.832+0000 7fcdded2e700 1 -- 172.21.15.40:0/2621301230 shutdown_connections 2023-09-30T22:30:45.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.832+0000 7fcdded2e700 1 --2- 172.21.15.40:0/2621301230 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdd809d920 0x7fcdd812c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.832+0000 7fcdded2e700 1 --2- 172.21.15.40:0/2621301230 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdd8130de0 0x7fcdd812cb40 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.832+0000 7fcdded2e700 1 --2- 172.21.15.40:0/2621301230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdd809e230 0x7fcdd812c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.832+0000 7fcdded2e700 1 -- 172.21.15.40:0/2621301230 >> 172.21.15.40:0/2621301230 conn(0x7fcdd809fb20 msgr2=0x7fcdd8129ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:45.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.832+0000 7fcdded2e700 1 -- 172.21.15.40:0/2621301230 shutdown_connections 2023-09-30T22:30:45.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.832+0000 7fcdded2e700 1 -- 172.21.15.40:0/2621301230 wait complete. 2023-09-30T22:30:45.847 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:45.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.848+0000 7fbe6becd700 1 Processor -- start 2023-09-30T22:30:45.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.849+0000 7fbe6becd700 1 -- start start 2023-09-30T22:30:45.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.849+0000 7fbe6becd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbe64099ff0 0x7fbe641353a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.849+0000 7fbe6becd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe641358e0 0x7fbe64137cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.849+0000 7fbe6becd700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe6409a630 con 0x7fbe64099510 2023-09-30T22:30:45.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.849+0000 7fbe6becd700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe6409a950 con 0x7fbe64099ff0 2023-09-30T22:30:45.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.849+0000 7fbe6becd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6409a420 con 0x7fbe641358e0 2023-09-30T22:30:45.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.849+0000 7fbe6a46a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe641358e0 0x7fbe64137cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.849+0000 7fbe69468700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbe64099ff0 0x7fbe641353a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.849+0000 7fbe69468700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbe64099ff0 0x7fbe641353a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43308/0 (socket says 172.21.15.40:43308) 2023-09-30T22:30:45.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.849+0000 7fbe6a46a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe641358e0 0x7fbe64137cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:44712/0 (socket says 172.21.15.40:44712) 2023-09-30T22:30:45.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.849+0000 7fbe69468700 1 -- 172.21.15.40:0/398255108 learned_addr learned my addr 172.21.15.40:0/398255108 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:45.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.849+0000 7fbe69468700 1 -- 172.21.15.40:0/398255108 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe641358e0 msgr2=0x7fbe64137cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:45.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.850+0000 7fbe69468700 1 --2- 172.21.15.40:0/398255108 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe641358e0 0x7fbe64137cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.850+0000 7fbe69468700 1 -- 172.21.15.40:0/398255108 >> v1:172.21.15.40:6789/0 conn(0x7fbe64099510 legacy=0x7fbe640998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.850+0000 7fbe69468700 1 -- 172.21.15.40:0/398255108 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6409ba50 con 0x7fbe64099ff0 2023-09-30T22:30:45.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.850+0000 7fbe6a46a700 1 --2- 172.21.15.40:0/398255108 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe641358e0 0x7fbe64137cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:45.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.850+0000 7fbe69468700 1 --2- 172.21.15.40:0/398255108 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe64099ff0 0x7fbe641353a0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fbe5400bb90 tx=0x7fbe5400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4abb928016312c41 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:45.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.850+0000 7fbe68c67700 1 -- 172.21.15.40:0/398255108 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5400dc20 con 0x7fbe64099ff0 2023-09-30T22:30:45.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.850+0000 7fbe68c67700 1 -- 172.21.15.40:0/398255108 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5400dd80 con 0x7fbe64099ff0 2023-09-30T22:30:45.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.850+0000 7fbe68c67700 1 -- 172.21.15.40:0/398255108 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe54017660 con 0x7fbe64099ff0 2023-09-30T22:30:45.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.850+0000 7fbe6becd700 1 -- 172.21.15.40:0/398255108 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe64099ff0 msgr2=0x7fbe641353a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.850+0000 7fbe6becd700 1 --2- 172.21.15.40:0/398255108 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe64099ff0 0x7fbe641353a0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fbe5400bb90 tx=0x7fbe5400bea0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.850+0000 7fbe6becd700 1 -- 172.21.15.40:0/398255108 shutdown_connections 2023-09-30T22:30:45.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.850+0000 7fbe6becd700 1 --2- 172.21.15.40:0/398255108 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe641358e0 0x7fbe64137cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.850+0000 7fbe6becd700 1 --2- 172.21.15.40:0/398255108 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe64099ff0 0x7fbe641353a0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.850+0000 7fbe6becd700 1 -- 172.21.15.40:0/398255108 >> 172.21.15.40:0/398255108 conn(0x7fbe6409eb10 msgr2=0x7fbe6409ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:45.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.851+0000 7fbe6becd700 1 -- 172.21.15.40:0/398255108 shutdown_connections 2023-09-30T22:30:45.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.851+0000 7fbe6becd700 1 -- 172.21.15.40:0/398255108 wait complete. 2023-09-30T22:30:45.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.851+0000 7fbe6becd700 1 Processor -- start 2023-09-30T22:30:45.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.852+0000 7fbe6becd700 1 -- start start 2023-09-30T22:30:45.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.852+0000 7fbe6becd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe64099510 0x7fbe64095850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.852+0000 7fbe6becd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe64099ff0 0x7fbe64095d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.852+0000 7fbe6becd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe641358e0 0x7fbe640962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:45.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.852+0000 7fbe6becd700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe64096bb0 con 0x7fbe64099510 2023-09-30T22:30:45.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.852+0000 7fbe6becd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe640a1ac0 con 0x7fbe64099ff0 2023-09-30T22:30:45.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.852+0000 7fbe6becd700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe64098e60 con 0x7fbe641358e0 2023-09-30T22:30:45.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.852+0000 7fbe6a46a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe641358e0 0x7fbe640962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.852+0000 7fbe69c69700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe64099510 0x7fbe64095850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.852+0000 7fbe69c69700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe64099510 0x7fbe64095850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43316/0 (socket says 172.21.15.40:43316) 2023-09-30T22:30:45.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.852+0000 7fbe6a46a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe641358e0 0x7fbe640962d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56434/0 (socket says 172.21.15.40:56434) 2023-09-30T22:30:45.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.852+0000 7fbe69c69700 1 -- 172.21.15.40:0/897929809 learned_addr learned my addr 172.21.15.40:0/897929809 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:45.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.852+0000 7fbe69468700 1 --2- 172.21.15.40:0/897929809 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe64099ff0 0x7fbe64095d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:45.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.852+0000 7fbe69c69700 1 -- 172.21.15.40:0/897929809 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe641358e0 msgr2=0x7fbe640962d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.852+0000 7fbe69c69700 1 --2- 172.21.15.40:0/897929809 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe641358e0 0x7fbe640962d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.852+0000 7fbe69c69700 1 -- 172.21.15.40:0/897929809 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe64099ff0 msgr2=0x7fbe64095d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.852+0000 7fbe69c69700 1 --2- 172.21.15.40:0/897929809 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe64099ff0 0x7fbe64095d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.852+0000 7fbe69c69700 1 -- 172.21.15.40:0/897929809 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5c009a70 con 0x7fbe64099510 2023-09-30T22:30:45.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.853+0000 7fbe69468700 1 --2- 172.21.15.40:0/897929809 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe64099ff0 0x7fbe64095d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:45.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.853+0000 7fbe69c69700 1 --2- 172.21.15.40:0/897929809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe64099510 0x7fbe64095850 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fbe6000c4d0 tx=0x7fbe6000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:45.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.853+0000 7fbe5a7fc700 1 -- 172.21.15.40:0/897929809 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe600054e0 con 0x7fbe64099510 2023-09-30T22:30:45.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.853+0000 7fbe5a7fc700 1 -- 172.21.15.40:0/897929809 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe60003680 con 0x7fbe64099510 2023-09-30T22:30:45.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.853+0000 7fbe6becd700 1 -- 172.21.15.40:0/897929809 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe5400b7f0 con 0x7fbe64099510 2023-09-30T22:30:45.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.853+0000 7fbe5a7fc700 1 -- 172.21.15.40:0/897929809 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe60003a30 con 0x7fbe64099510 2023-09-30T22:30:45.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.853+0000 7fbe6becd700 1 -- 172.21.15.40:0/897929809 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe64097320 con 0x7fbe64099510 2023-09-30T22:30:45.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.854+0000 7fbe6becd700 1 -- 172.21.15.40:0/897929809 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe6406f8c0 con 0x7fbe64099510 2023-09-30T22:30:45.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.854+0000 7fbe5a7fc700 1 -- 172.21.15.40:0/897929809 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbe60003b90 con 0x7fbe64099510 2023-09-30T22:30:45.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.855+0000 7fbe5a7fc700 1 -- 172.21.15.40:0/897929809 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fbe6003efc0 con 0x7fbe64099510 2023-09-30T22:30:45.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.859+0000 7fbe5a7fc700 1 -- 172.21.15.40:0/897929809 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe60003e40 con 0x7fbe64099510 2023-09-30T22:30:45.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.876+0000 7f9fea26c700 1 -- 172.21.15.40:0/2031897344 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9fe4074620 con 0x7f9fe409fbb0 2023-09-30T22:30:45.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.876+0000 7f9fe0ff9700 1 -- 172.21.15.40:0/2031897344 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9fd8015070 con 0x7f9fe409fbb0 2023-09-30T22:30:45.877 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:45.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.878+0000 7f9fea26c700 1 -- 172.21.15.40:0/2031897344 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9fe409fbb0 msgr2=0x7f9fe4090e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:45.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.878+0000 7f9fea26c700 1 --2- 172.21.15.40:0/2031897344 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9fe409fbb0 0x7f9fe4090e20 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8016000 tx=0x7f9fd8004750 comp rx=0 tx=0).stop 2023-09-30T22:30:45.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.878+0000 7f9fea26c700 1 -- 172.21.15.40:0/2031897344 shutdown_connections 2023-09-30T22:30:45.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.878+0000 7f9fea26c700 1 --2- 172.21.15.40:0/2031897344 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9fe4138370 0x7f9fe4091360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.878+0000 7f9fea26c700 1 --2- 172.21.15.40:0/2031897344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fe406ced0 0x7f9fe40908e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.878+0000 7f9fea26c700 1 --2- 172.21.15.40:0/2031897344 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9fe409fbb0 0x7f9fe4090e20 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:45.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.878+0000 7f9fea26c700 1 -- 172.21.15.40:0/2031897344 >> 172.21.15.40:0/2031897344 conn(0x7f9fe40a41a0 msgr2=0x7f9fe4137590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:45.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.879+0000 7f9fea26c700 1 -- 172.21.15.40:0/2031897344 shutdown_connections 2023-09-30T22:30:45.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:45.879+0000 7f9fea26c700 1 -- 172.21.15.40:0/2031897344 wait complete. 2023-09-30T22:30:45.892 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:46.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.054+0000 7fbe6becd700 1 -- 172.21.15.40:0/897929809 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbe641353b0 con 0x7fbe64099510 2023-09-30T22:30:46.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.054+0000 7fbe5a7fc700 1 -- 172.21.15.40:0/897929809 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbe60017020 con 0x7fbe64099510 2023-09-30T22:30:46.055 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:46.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.057+0000 7fbe6becd700 1 -- 172.21.15.40:0/897929809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe64099510 msgr2=0x7fbe64095850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:46.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.057+0000 7fbe6becd700 1 --2- 172.21.15.40:0/897929809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe64099510 0x7fbe64095850 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fbe6000c4d0 tx=0x7fbe6000c890 comp rx=0 tx=0).stop 2023-09-30T22:30:46.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.057+0000 7fbe6becd700 1 -- 172.21.15.40:0/897929809 shutdown_connections 2023-09-30T22:30:46.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.057+0000 7fbe6becd700 1 --2- 172.21.15.40:0/897929809 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbe641358e0 0x7fbe640962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:46.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.057+0000 7fbe6becd700 1 --2- 172.21.15.40:0/897929809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe64099510 0x7fbe64095850 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:46.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.057+0000 7fbe6becd700 1 --2- 172.21.15.40:0/897929809 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe64099ff0 0x7fbe64095d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:46.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.057+0000 7fbe6becd700 1 -- 172.21.15.40:0/897929809 >> 172.21.15.40:0/897929809 conn(0x7fbe6409eb10 msgr2=0x7fbe6409ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:46.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.057+0000 7fbe6becd700 1 -- 172.21.15.40:0/897929809 shutdown_connections 2023-09-30T22:30:46.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.057+0000 7fbe6becd700 1 -- 172.21.15.40:0/897929809 wait complete. 2023-09-30T22:30:46.069 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:46.817 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:46.848 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:46.892 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:46.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.961+0000 7fa916543700 1 Processor -- start 2023-09-30T22:30:46.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.961+0000 7fa916543700 1 -- start start 2023-09-30T22:30:46.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.962+0000 7fa916543700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa91009c890 0x7fa91009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:46.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.962+0000 7fa916543700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa91009d920 0x7fa91009dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:46.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.962+0000 7fa916543700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa91009e2b0 0x7fa91013ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:46.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.962+0000 7fa916543700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9100a29d0 con 0x7fa91009e2b0 2023-09-30T22:30:46.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.962+0000 7fa916543700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa91009fb40 con 0x7fa91009d920 2023-09-30T22:30:46.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.962+0000 7fa916543700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9100a2600 con 0x7fa91009c890 2023-09-30T22:30:46.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.962+0000 7fa90f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa91009d920 0x7fa91009dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:46.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.962+0000 7fa914ae0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa91009e2b0 0x7fa91013ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:46.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.962+0000 7fa914ae0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa91009e2b0 0x7fa91013ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43320/0 (socket says 172.21.15.40:43320) 2023-09-30T22:30:46.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.962+0000 7fa90ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa91009c890 0x7fa91009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:46.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.962+0000 7fa914ae0700 1 -- 172.21.15.40:0/1675496484 learned_addr learned my addr 172.21.15.40:0/1675496484 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:46.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.962+0000 7fa90f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa91009d920 0x7fa91009dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:44726/0 (socket says 172.21.15.40:44726) 2023-09-30T22:30:46.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.962+0000 7fa914ae0700 1 -- 172.21.15.40:0/1675496484 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa91009c890 msgr2=0x7fa91009cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:46.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.962+0000 7fa914ae0700 1 --2- 172.21.15.40:0/1675496484 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa91009c890 0x7fa91009cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:46.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.962+0000 7fa914ae0700 1 -- 172.21.15.40:0/1675496484 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa91009d920 msgr2=0x7fa91009dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:46.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.962+0000 7fa914ae0700 1 --2- 172.21.15.40:0/1675496484 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa91009d920 0x7fa91009dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:46.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.962+0000 7fa914ae0700 1 -- 172.21.15.40:0/1675496484 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa91009e720 con 0x7fa91009e2b0 2023-09-30T22:30:46.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.962+0000 7fa90f7fe700 1 --2- 172.21.15.40:0/1675496484 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa91009d920 0x7fa91009dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:46.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.962+0000 7fa914ae0700 1 --2- 172.21.15.40:0/1675496484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa91009e2b0 0x7fa91013ac10 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fa908009e80 tx=0x7fa90800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb17c2a11d7b2dd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:46.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.963+0000 7fa90effd700 1 -- 172.21.15.40:0/1675496484 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90800e070 con 0x7fa91009e2b0 2023-09-30T22:30:46.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.963+0000 7fa90effd700 1 -- 172.21.15.40:0/1675496484 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90800b8d0 con 0x7fa91009e2b0 2023-09-30T22:30:46.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.963+0000 7fa90effd700 1 -- 172.21.15.40:0/1675496484 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90800bc80 con 0x7fa91009e2b0 2023-09-30T22:30:46.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.963+0000 7fa916543700 1 -- 172.21.15.40:0/1675496484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa91009e2b0 msgr2=0x7fa91013ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:46.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.963+0000 7fa916543700 1 --2- 172.21.15.40:0/1675496484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa91009e2b0 0x7fa91013ac10 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fa908009e80 tx=0x7fa90800b330 comp rx=0 tx=0).stop 2023-09-30T22:30:46.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.963+0000 7fa916543700 1 -- 172.21.15.40:0/1675496484 shutdown_connections 2023-09-30T22:30:46.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.963+0000 7fa916543700 1 --2- 172.21.15.40:0/1675496484 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa91009c890 0x7fa91009cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:46.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.963+0000 7fa916543700 1 --2- 172.21.15.40:0/1675496484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa91009e2b0 0x7fa91013ac10 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:46.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.963+0000 7fa916543700 1 --2- 172.21.15.40:0/1675496484 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa91009d920 0x7fa91009dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:46.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.963+0000 7fa916543700 1 -- 172.21.15.40:0/1675496484 >> 172.21.15.40:0/1675496484 conn(0x7fa9100a7080 msgr2=0x7fa9100a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:46.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.964+0000 7fa916543700 1 -- 172.21.15.40:0/1675496484 shutdown_connections 2023-09-30T22:30:46.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.964+0000 7fa916543700 1 -- 172.21.15.40:0/1675496484 wait complete. 2023-09-30T22:30:46.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.964+0000 7fa916543700 1 Processor -- start 2023-09-30T22:30:46.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.965+0000 7fa916543700 1 -- start start 2023-09-30T22:30:46.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.965+0000 7fa916543700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa91009c890 0x7fa91012f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:46.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.965+0000 7fa916543700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa91009d920 0x7fa91012fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:46.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.965+0000 7fa916543700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa91009e2b0 0x7fa9101301a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:46.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.965+0000 7fa916543700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91012e680 con 0x7fa91009e2b0 2023-09-30T22:30:46.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.965+0000 7fa916543700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa91012e900 con 0x7fa91009c890 2023-09-30T22:30:46.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.965+0000 7fa916543700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa91012d1e0 con 0x7fa91009d920 2023-09-30T22:30:46.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.965+0000 7fa90f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa91009d920 0x7fa91012fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:46.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.965+0000 7fa90f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa91009d920 0x7fa91012fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56452/0 (socket says 172.21.15.40:56452) 2023-09-30T22:30:46.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.965+0000 7fa914ae0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa91009e2b0 0x7fa9101301a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:46.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.965+0000 7fa90f7fe700 1 -- 172.21.15.40:0/2353284323 learned_addr learned my addr 172.21.15.40:0/2353284323 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:46.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.965+0000 7fa90ffff700 1 --2- 172.21.15.40:0/2353284323 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa91009c890 0x7fa91012f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:46.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.966+0000 7fa914ae0700 1 -- 172.21.15.40:0/2353284323 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa91009d920 msgr2=0x7fa91012fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:46.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.966+0000 7fa914ae0700 1 --2- 172.21.15.40:0/2353284323 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa91009d920 0x7fa91012fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:46.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.966+0000 7fa914ae0700 1 -- 172.21.15.40:0/2353284323 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa91009c890 msgr2=0x7fa91012f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:46.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.966+0000 7fa914ae0700 1 --2- 172.21.15.40:0/2353284323 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa91009c890 0x7fa91012f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:46.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.966+0000 7fa914ae0700 1 -- 172.21.15.40:0/2353284323 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9040094a0 con 0x7fa91009e2b0 2023-09-30T22:30:46.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.966+0000 7fa90ffff700 1 --2- 172.21.15.40:0/2353284323 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa91009c890 0x7fa91012f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:46.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.966+0000 7fa914ae0700 1 --2- 172.21.15.40:0/2353284323 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa91009e2b0 0x7fa9101301a0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fa908015000 tx=0x7fa908004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:46.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.966+0000 7fa90cff9700 1 -- 172.21.15.40:0/2353284323 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa908004450 con 0x7fa91009e2b0 2023-09-30T22:30:46.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.966+0000 7fa90cff9700 1 -- 172.21.15.40:0/2353284323 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9080045b0 con 0x7fa91009e2b0 2023-09-30T22:30:46.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.966+0000 7fa90cff9700 1 -- 172.21.15.40:0/2353284323 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa908004960 con 0x7fa91009e2b0 2023-09-30T22:30:46.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.966+0000 7fa916543700 1 -- 172.21.15.40:0/2353284323 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa908009b30 con 0x7fa91009e2b0 2023-09-30T22:30:46.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.966+0000 7fa916543700 1 -- 172.21.15.40:0/2353284323 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa91009ecf0 con 0x7fa91009e2b0 2023-09-30T22:30:46.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.967+0000 7fa90cff9700 1 -- 172.21.15.40:0/2353284323 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa90801c410 con 0x7fa91009e2b0 2023-09-30T22:30:46.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.967+0000 7fa916543700 1 -- 172.21.15.40:0/2353284323 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa91006e600 con 0x7fa91009e2b0 2023-09-30T22:30:46.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.968+0000 7fa90cff9700 1 -- 172.21.15.40:0/2353284323 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa908040db0 con 0x7fa91009e2b0 2023-09-30T22:30:46.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:46.976+0000 7fa90cff9700 1 -- 172.21.15.40:0/2353284323 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa90801c6c0 con 0x7fa91009e2b0 2023-09-30T22:30:47.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.002+0000 7f5cac278700 1 Processor -- start 2023-09-30T22:30:47.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.002+0000 7f5cac278700 1 -- start start 2023-09-30T22:30:47.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.003+0000 7f5cac278700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5ca409f0f0 0x7f5ca4138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:47.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.003+0000 7f5cac278700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ca409e400 0x7f5ca413b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:47.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.003+0000 7f5cac278700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ca409f940 con 0x7f5ca409d920 2023-09-30T22:30:47.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.003+0000 7f5cac278700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca406b4c0 con 0x7f5ca409f0f0 2023-09-30T22:30:47.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.003+0000 7f5cac278700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca409a8f0 con 0x7f5ca409e400 2023-09-30T22:30:47.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.003+0000 7f5ca9813700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5ca409f0f0 0x7f5ca4138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:47.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.003+0000 7f5ca9813700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5ca409f0f0 0x7f5ca4138ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43338/0 (socket says 172.21.15.40:43338) 2023-09-30T22:30:47.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.003+0000 7f5ca9813700 1 -- 172.21.15.40:0/3852063887 learned_addr learned my addr 172.21.15.40:0/3852063887 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:47.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.003+0000 7f5caa815700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ca409e400 0x7f5ca413b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:47.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.003+0000 7f5ca9813700 1 -- 172.21.15.40:0/3852063887 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ca409e400 msgr2=0x7f5ca413b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:47.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.003+0000 7f5ca9813700 1 --2- 172.21.15.40:0/3852063887 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ca409e400 0x7f5ca413b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.003+0000 7f5ca9813700 1 -- 172.21.15.40:0/3852063887 >> v1:172.21.15.40:6789/0 conn(0x7f5ca409d920 legacy=0x7f5ca409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:47.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.003+0000 7f5ca9813700 1 -- 172.21.15.40:0/3852063887 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca409f6e0 con 0x7f5ca409f0f0 2023-09-30T22:30:47.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.003+0000 7f5caa815700 1 --2- 172.21.15.40:0/3852063887 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ca409e400 0x7f5ca413b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:47.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.004+0000 7f5ca9813700 1 --2- 172.21.15.40:0/3852063887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ca409f0f0 0x7f5ca4138ee0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f5c940098f0 tx=0x7f5c94009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a6202c347c03a52 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:47.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.004+0000 7f5ca9012700 1 -- 172.21.15.40:0/3852063887 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c94011830 con 0x7f5ca409f0f0 2023-09-30T22:30:47.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.004+0000 7f5ca9012700 1 -- 172.21.15.40:0/3852063887 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c94011990 con 0x7f5ca409f0f0 2023-09-30T22:30:47.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.004+0000 7f5ca9012700 1 -- 172.21.15.40:0/3852063887 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c94011d20 con 0x7f5ca409f0f0 2023-09-30T22:30:47.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.005+0000 7f5cac278700 1 -- 172.21.15.40:0/3852063887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ca409f0f0 msgr2=0x7f5ca4138ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:47.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.005+0000 7f5cac278700 1 --2- 172.21.15.40:0/3852063887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ca409f0f0 0x7f5ca4138ee0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f5c940098f0 tx=0x7f5c94009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:47.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.005+0000 7f5cac278700 1 -- 172.21.15.40:0/3852063887 shutdown_connections 2023-09-30T22:30:47.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.005+0000 7f5cac278700 1 --2- 172.21.15.40:0/3852063887 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ca409e400 0x7f5ca413b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.005+0000 7f5cac278700 1 --2- 172.21.15.40:0/3852063887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ca409f0f0 0x7f5ca4138ee0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.005+0000 7f5cac278700 1 -- 172.21.15.40:0/3852063887 >> 172.21.15.40:0/3852063887 conn(0x7f5ca409fb20 msgr2=0x7f5ca409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:47.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.005+0000 7f5cac278700 1 -- 172.21.15.40:0/3852063887 shutdown_connections 2023-09-30T22:30:47.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.005+0000 7f5cac278700 1 -- 172.21.15.40:0/3852063887 wait complete. 2023-09-30T22:30:47.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.006+0000 7f5cac278700 1 Processor -- start 2023-09-30T22:30:47.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.006+0000 7f5cac278700 1 -- start start 2023-09-30T22:30:47.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.007+0000 7f5cac278700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ca409d920 0x7f5ca411e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:47.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.007+0000 7f5cac278700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ca409e400 0x7f5ca411edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:47.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.007+0000 7f5cac278700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ca411f330 0x7f5ca41350d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:47.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.007+0000 7f5cac278700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca4120b10 con 0x7f5ca409d920 2023-09-30T22:30:47.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.007+0000 7f5cac278700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca411f760 con 0x7f5ca411f330 2023-09-30T22:30:47.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.007+0000 7f5cac278700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca40a3460 con 0x7f5ca409e400 2023-09-30T22:30:47.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.007+0000 7f5caa014700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ca409d920 0x7f5ca411e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:47.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.007+0000 7f5caa014700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ca409d920 0x7f5ca411e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43350/0 (socket says 172.21.15.40:43350) 2023-09-30T22:30:47.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.007+0000 7f5caa014700 1 -- 172.21.15.40:0/2449910605 learned_addr learned my addr 172.21.15.40:0/2449910605 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:47.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.007+0000 7f5ca9813700 1 --2- 172.21.15.40:0/2449910605 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ca409e400 0x7f5ca411edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:47.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.007+0000 7f5caa815700 1 --2- 172.21.15.40:0/2449910605 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ca411f330 0x7f5ca41350d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:47.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.008+0000 7f5caa014700 1 -- 172.21.15.40:0/2449910605 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ca409e400 msgr2=0x7f5ca411edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:47.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.008+0000 7f5caa014700 1 --2- 172.21.15.40:0/2449910605 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ca409e400 0x7f5ca411edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.008+0000 7f5caa014700 1 -- 172.21.15.40:0/2449910605 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ca411f330 msgr2=0x7f5ca41350d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:47.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.008+0000 7f5caa014700 1 --2- 172.21.15.40:0/2449910605 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ca411f330 0x7f5ca41350d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.008+0000 7f5caa014700 1 -- 172.21.15.40:0/2449910605 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c9c009a70 con 0x7f5ca409d920 2023-09-30T22:30:47.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.008+0000 7f5ca9813700 1 --2- 172.21.15.40:0/2449910605 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ca409e400 0x7f5ca411edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:47.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.008+0000 7f5caa815700 1 --2- 172.21.15.40:0/2449910605 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ca411f330 0x7f5ca41350d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:47.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.008+0000 7f5caa014700 1 --2- 172.21.15.40:0/2449910605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ca409d920 0x7f5ca411e8b0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f5ca000c430 tx=0x7f5ca000c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:47.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.008+0000 7f5c9affd700 1 -- 172.21.15.40:0/2449910605 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca00054e0 con 0x7f5ca409d920 2023-09-30T22:30:47.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.008+0000 7f5c9affd700 1 -- 172.21.15.40:0/2449910605 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca000ce30 con 0x7f5ca409d920 2023-09-30T22:30:47.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.008+0000 7f5cac278700 1 -- 172.21.15.40:0/2449910605 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c94009550 con 0x7f5ca409d920 2023-09-30T22:30:47.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.008+0000 7f5c9affd700 1 -- 172.21.15.40:0/2449910605 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca00038c0 con 0x7f5ca409d920 2023-09-30T22:30:47.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.008+0000 7f5cac278700 1 -- 172.21.15.40:0/2449910605 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca4122470 con 0x7f5ca409d920 2023-09-30T22:30:47.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.009+0000 7f5c9affd700 1 -- 172.21.15.40:0/2449910605 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5ca0003a20 con 0x7f5ca409d920 2023-09-30T22:30:47.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.009+0000 7f5c9affd700 1 -- 172.21.15.40:0/2449910605 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5ca003ea20 con 0x7f5ca409d920 2023-09-30T22:30:47.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.009+0000 7f5cac278700 1 -- 172.21.15.40:0/2449910605 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca4121d40 con 0x7f5ca409d920 2023-09-30T22:30:47.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.014+0000 7f5c9affd700 1 -- 172.21.15.40:0/2449910605 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5ca0017070 con 0x7f5ca409d920 2023-09-30T22:30:47.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.040+0000 7f8ef5746700 1 Processor -- start 2023-09-30T22:30:47.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.040+0000 7f8ef5746700 1 -- start start 2023-09-30T22:30:47.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.040+0000 7f8ef5746700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ef006d0a0 0x7f8ef006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:47.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.040+0000 7f8ef5746700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8ef0139380 0x7f8ef013b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:47.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.040+0000 7f8ef5746700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ef006e3f0 con 0x7f8ef009fbb0 2023-09-30T22:30:47.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.040+0000 7f8ef5746700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef009ff80 con 0x7f8ef0139380 2023-09-30T22:30:47.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.040+0000 7f8ef5746700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef006ec40 con 0x7f8ef006d0a0 2023-09-30T22:30:47.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.040+0000 7f8eee7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ef006d0a0 0x7f8ef006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:47.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.040+0000 7f8eee7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ef006d0a0 0x7f8ef006d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56474/0 (socket says 172.21.15.40:56474) 2023-09-30T22:30:47.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.040+0000 7f8eee7fc700 1 -- 172.21.15.40:0/1019922746 learned_addr learned my addr 172.21.15.40:0/1019922746 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:47.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.040+0000 7f8eef7fe700 1 --2- 172.21.15.40:0/1019922746 >> v2:172.21.15.40:3300/0 conn(0x7f8ef0139380 0x7f8ef013b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:47.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.041+0000 7f8eee7fc700 1 -- 172.21.15.40:0/1019922746 >> v2:172.21.15.40:3300/0 conn(0x7f8ef0139380 msgr2=0x7f8ef013b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:47.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.041+0000 7f8eee7fc700 1 --2- 172.21.15.40:0/1019922746 >> v2:172.21.15.40:3300/0 conn(0x7f8ef0139380 0x7f8ef013b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.041+0000 7f8eee7fc700 1 -- 172.21.15.40:0/1019922746 >> v1:172.21.15.40:6789/0 conn(0x7f8ef009fbb0 legacy=0x7f8ef006c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:47.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.041+0000 7f8eee7fc700 1 -- 172.21.15.40:0/1019922746 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef006d9f0 con 0x7f8ef006d0a0 2023-09-30T22:30:47.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.041+0000 7f8eee7fc700 1 --2- 172.21.15.40:0/1019922746 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ef006d0a0 0x7f8ef006d4b0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f8ee40098f0 tx=0x7f8ee4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1edd39302036bad5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:47.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.041+0000 7f8eedffb700 1 -- 172.21.15.40:0/1019922746 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee4011830 con 0x7f8ef006d0a0 2023-09-30T22:30:47.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.041+0000 7f8eedffb700 1 -- 172.21.15.40:0/1019922746 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee4011990 con 0x7f8ef006d0a0 2023-09-30T22:30:47.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.041+0000 7f8eedffb700 1 -- 172.21.15.40:0/1019922746 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee4011d20 con 0x7f8ef006d0a0 2023-09-30T22:30:47.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.042+0000 7f8ef5746700 1 -- 172.21.15.40:0/1019922746 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ef006d0a0 msgr2=0x7f8ef006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:47.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.042+0000 7f8ef5746700 1 --2- 172.21.15.40:0/1019922746 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ef006d0a0 0x7f8ef006d4b0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f8ee40098f0 tx=0x7f8ee4009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:47.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.042+0000 7f8ef5746700 1 -- 172.21.15.40:0/1019922746 shutdown_connections 2023-09-30T22:30:47.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.042+0000 7f8ef5746700 1 --2- 172.21.15.40:0/1019922746 >> v2:172.21.15.40:3300/0 conn(0x7f8ef0139380 0x7f8ef013b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.042+0000 7f8ef5746700 1 --2- 172.21.15.40:0/1019922746 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ef006d0a0 0x7f8ef006d4b0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.042+0000 7f8ef5746700 1 -- 172.21.15.40:0/1019922746 >> 172.21.15.40:0/1019922746 conn(0x7f8ef00a41a0 msgr2=0x7f8ef00a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:47.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.042+0000 7f8ef5746700 1 -- 172.21.15.40:0/1019922746 shutdown_connections 2023-09-30T22:30:47.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.042+0000 7f8ef5746700 1 -- 172.21.15.40:0/1019922746 wait complete. 2023-09-30T22:30:47.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.043+0000 7f8ef5746700 1 Processor -- start 2023-09-30T22:30:47.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.043+0000 7f8ef5746700 1 -- start start 2023-09-30T22:30:47.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.044+0000 7f8ef5746700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ef006d0a0 0x7f8ef01385c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:47.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.044+0000 7f8ef5746700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ef009fbb0 0x7f8ef0138b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:47.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.044+0000 7f8ef5746700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ef0139380 0x7f8ef008f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:47.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.044+0000 7f8ef5746700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef0092a90 con 0x7f8ef009fbb0 2023-09-30T22:30:47.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.044+0000 7f8ef5746700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef0092c70 con 0x7f8ef006d0a0 2023-09-30T22:30:47.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.044+0000 7f8ef5746700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef013b770 con 0x7f8ef0139380 2023-09-30T22:30:47.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.044+0000 7f8eee7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ef009fbb0 0x7f8ef0138b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:47.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.044+0000 7f8eef7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ef0139380 0x7f8ef008f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:47.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.044+0000 7f8eee7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ef009fbb0 0x7f8ef0138b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43376/0 (socket says 172.21.15.40:43376) 2023-09-30T22:30:47.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.044+0000 7f8eee7fc700 1 -- 172.21.15.40:0/654821751 learned_addr learned my addr 172.21.15.40:0/654821751 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:47.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.044+0000 7f8eee7fc700 1 -- 172.21.15.40:0/654821751 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ef0139380 msgr2=0x7f8ef008f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:47.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.044+0000 7f8eee7fc700 1 --2- 172.21.15.40:0/654821751 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ef0139380 0x7f8ef008f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.044+0000 7f8eee7fc700 1 -- 172.21.15.40:0/654821751 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ef006d0a0 msgr2=0x7f8ef01385c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:47.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.044+0000 7f8eee7fc700 1 --2- 172.21.15.40:0/654821751 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ef006d0a0 0x7f8ef01385c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.044+0000 7f8eee7fc700 1 -- 172.21.15.40:0/654821751 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee4009550 con 0x7f8ef009fbb0 2023-09-30T22:30:47.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.044+0000 7f8eef7fe700 1 --2- 172.21.15.40:0/654821751 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ef0139380 0x7f8ef008f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:47.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.045+0000 7f8eee7fc700 1 --2- 172.21.15.40:0/654821751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ef009fbb0 0x7f8ef0138b00 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4000c00 tx=0x7f8ee4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:47.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.045+0000 7f8ed77fe700 1 -- 172.21.15.40:0/654821751 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee4004480 con 0x7f8ef009fbb0 2023-09-30T22:30:47.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.045+0000 7f8ed77fe700 1 -- 172.21.15.40:0/654821751 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee401f070 con 0x7f8ef009fbb0 2023-09-30T22:30:47.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.045+0000 7f8ef5746700 1 -- 172.21.15.40:0/654821751 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef0097f10 con 0x7f8ef009fbb0 2023-09-30T22:30:47.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.045+0000 7f8ed77fe700 1 -- 172.21.15.40:0/654821751 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee40038c0 con 0x7f8ef009fbb0 2023-09-30T22:30:47.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.045+0000 7f8ef5746700 1 -- 172.21.15.40:0/654821751 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef0096be0 con 0x7f8ef009fbb0 2023-09-30T22:30:47.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.045+0000 7f8ed77fe700 1 -- 172.21.15.40:0/654821751 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8ee4021030 con 0x7f8ef009fbb0 2023-09-30T22:30:47.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.046+0000 7f8ed77fe700 1 -- 172.21.15.40:0/654821751 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f8ee4040a80 con 0x7f8ef009fbb0 2023-09-30T22:30:47.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.046+0000 7f8ef5746700 1 -- 172.21.15.40:0/654821751 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ef0062380 con 0x7f8ef009fbb0 2023-09-30T22:30:47.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.050+0000 7f8ed77fe700 1 -- 172.21.15.40:0/654821751 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ee4015080 con 0x7f8ef009fbb0 2023-09-30T22:30:47.070 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:47.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.206+0000 7fc7524e1700 1 Processor -- start 2023-09-30T22:30:47.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.206+0000 7fc7524e1700 1 -- start start 2023-09-30T22:30:47.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.206+0000 7fc7524e1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc74c09c890 0x7fc74c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:47.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.206+0000 7fc7524e1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc74c09d920 0x7fc74c09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:47.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.206+0000 7fc7524e1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc74c0a2600 con 0x7fc74c09e2b0 2023-09-30T22:30:47.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.206+0000 7fc7524e1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc74c0a29d0 con 0x7fc74c09c890 2023-09-30T22:30:47.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.206+0000 7fc7524e1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c09fb40 con 0x7fc74c09d920 2023-09-30T22:30:47.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.207+0000 7fc74bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc74c09c890 0x7fc74c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:47.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.207+0000 7fc750a7e700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc74c09e2b0 0x7fc74c13ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52032/0 (socket says 172.21.15.40:52032) 2023-09-30T22:30:47.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.207+0000 7fc750a7e700 1 -- 172.21.15.40:0/2135414513 learned_addr learned my addr 172.21.15.40:0/2135414513 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:47.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.207+0000 7fc74bfff700 1 -- 172.21.15.40:0/2135414513 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc74c09d920 msgr2=0x7fc74c09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:47.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.207+0000 7fc74bfff700 1 --2- 172.21.15.40:0/2135414513 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc74c09d920 0x7fc74c09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.207+0000 7fc74bfff700 1 -- 172.21.15.40:0/2135414513 >> v1:172.21.15.40:6789/0 conn(0x7fc74c09e2b0 legacy=0x7fc74c13ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:47.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.207+0000 7fc74bfff700 1 -- 172.21.15.40:0/2135414513 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc74c09e730 con 0x7fc74c09c890 2023-09-30T22:30:47.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.207+0000 7fc74affd700 1 -- 172.21.15.40:0/2135414513 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3394403241 0 0) 0x7fc74c0a2600 con 0x7fc74c09e2b0 2023-09-30T22:30:47.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.207+0000 7fc74bfff700 1 --2- 172.21.15.40:0/2135414513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc74c09c890 0x7fc74c09cc60 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fc73c009820 tx=0x7fc73c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff8dfc5d874ccbf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:47.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.207+0000 7fc74affd700 1 -- 172.21.15.40:0/2135414513 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c005e30 con 0x7fc74c09c890 2023-09-30T22:30:47.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.207+0000 7fc74affd700 1 -- 172.21.15.40:0/2135414513 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73c006030 con 0x7fc74c09c890 2023-09-30T22:30:47.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.207+0000 7fc74affd700 1 -- 172.21.15.40:0/2135414513 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c0063e0 con 0x7fc74c09c890 2023-09-30T22:30:47.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.208+0000 7fc7524e1700 1 -- 172.21.15.40:0/2135414513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc74c09c890 msgr2=0x7fc74c09cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:47.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.208+0000 7fc7524e1700 1 --2- 172.21.15.40:0/2135414513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc74c09c890 0x7fc74c09cc60 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fc73c009820 tx=0x7fc73c009b30 comp rx=0 tx=0).stop 2023-09-30T22:30:47.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.208+0000 7fc7524e1700 1 -- 172.21.15.40:0/2135414513 shutdown_connections 2023-09-30T22:30:47.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.208+0000 7fc7524e1700 1 --2- 172.21.15.40:0/2135414513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc74c09c890 0x7fc74c09cc60 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.208+0000 7fc7524e1700 1 --2- 172.21.15.40:0/2135414513 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc74c09d920 0x7fc74c09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.208+0000 7fc7524e1700 1 -- 172.21.15.40:0/2135414513 >> 172.21.15.40:0/2135414513 conn(0x7fc74c0a7080 msgr2=0x7fc74c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:47.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.208+0000 7fc7524e1700 1 -- 172.21.15.40:0/2135414513 shutdown_connections 2023-09-30T22:30:47.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.208+0000 7fc7524e1700 1 -- 172.21.15.40:0/2135414513 wait complete. 2023-09-30T22:30:47.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.210+0000 7fc7524e1700 1 Processor -- start 2023-09-30T22:30:47.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.210+0000 7fc7524e1700 1 -- start start 2023-09-30T22:30:47.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.211+0000 7fc7524e1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc74c09c890 0x7fc74c12d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:47.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.211+0000 7fc7524e1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc74c09d920 0x7fc74c12d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:47.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.211+0000 7fc7524e1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc74c09e2b0 0x7fc74c12dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:47.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.211+0000 7fc7524e1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c12fc20 con 0x7fc74c09e2b0 2023-09-30T22:30:47.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.211+0000 7fc7524e1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c130c80 con 0x7fc74c09d920 2023-09-30T22:30:47.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.211+0000 7fc7524e1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c0a5c60 con 0x7fc74c09c890 2023-09-30T22:30:47.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.211+0000 7fc74bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc74c09c890 0x7fc74c12d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:47.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.211+0000 7fc74bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc74c09c890 0x7fc74c12d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56488/0 (socket says 172.21.15.40:56488) 2023-09-30T22:30:47.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.211+0000 7fc74bfff700 1 -- 172.21.15.40:0/1677689683 learned_addr learned my addr 172.21.15.40:0/1677689683 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:47.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.211+0000 7fc750a7e700 1 --2- 172.21.15.40:0/1677689683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc74c09e2b0 0x7fc74c12dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:47.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.211+0000 7fc74b7fe700 1 --2- 172.21.15.40:0/1677689683 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc74c09d920 0x7fc74c12d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:47.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.211+0000 7fc750a7e700 1 -- 172.21.15.40:0/1677689683 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc74c09c890 msgr2=0x7fc74c12d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:47.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.211+0000 7fc750a7e700 1 --2- 172.21.15.40:0/1677689683 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc74c09c890 0x7fc74c12d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.211+0000 7fc750a7e700 1 -- 172.21.15.40:0/1677689683 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc74c09d920 msgr2=0x7fc74c12d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:47.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.211+0000 7fc750a7e700 1 --2- 172.21.15.40:0/1677689683 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc74c09d920 0x7fc74c12d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.211+0000 7fc750a7e700 1 -- 172.21.15.40:0/1677689683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc73c009430 con 0x7fc74c09e2b0 2023-09-30T22:30:47.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.211+0000 7fc74bfff700 1 --2- 172.21.15.40:0/1677689683 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc74c09c890 0x7fc74c12d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:47.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.211+0000 7fc750a7e700 1 --2- 172.21.15.40:0/1677689683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc74c09e2b0 0x7fc74c12dcf0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fc74400cbe0 tx=0x7fc74400cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:47.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.212+0000 7fc748ff9700 1 -- 172.21.15.40:0/1677689683 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74400aa40 con 0x7fc74c09e2b0 2023-09-30T22:30:47.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.212+0000 7fc748ff9700 1 -- 172.21.15.40:0/1677689683 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74400abc0 con 0x7fc74c09e2b0 2023-09-30T22:30:47.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.212+0000 7fc7524e1700 1 -- 172.21.15.40:0/1677689683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc74c09ecf0 con 0x7fc74c09e2b0 2023-09-30T22:30:47.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.212+0000 7fc748ff9700 1 -- 172.21.15.40:0/1677689683 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7440070d0 con 0x7fc74c09e2b0 2023-09-30T22:30:47.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.212+0000 7fc7524e1700 1 -- 172.21.15.40:0/1677689683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc74c09c2c0 con 0x7fc74c09e2b0 2023-09-30T22:30:47.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.213+0000 7fc7524e1700 1 -- 172.21.15.40:0/1677689683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc74c12ffc0 con 0x7fc74c09e2b0 2023-09-30T22:30:47.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.214+0000 7fc748ff9700 1 -- 172.21.15.40:0/1677689683 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc744007230 con 0x7fc74c09e2b0 2023-09-30T22:30:47.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.214+0000 7fc748ff9700 1 -- 172.21.15.40:0/1677689683 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc74403f5c0 con 0x7fc74c09e2b0 2023-09-30T22:30:47.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.218+0000 7fc748ff9700 1 -- 172.21.15.40:0/1677689683 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc74401c3b0 con 0x7fc74c09e2b0 2023-09-30T22:30:47.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.230+0000 7fa916543700 1 -- 172.21.15.40:0/2353284323 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa910062380 con 0x7fa91009e2b0 2023-09-30T22:30:47.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.230+0000 7fa90cff9700 1 -- 172.21.15.40:0/2353284323 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa90802a030 con 0x7fa91009e2b0 2023-09-30T22:30:47.231 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:47.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.232+0000 7fa916543700 1 -- 172.21.15.40:0/2353284323 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa91009e2b0 msgr2=0x7fa9101301a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:47.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.232+0000 7fa916543700 1 --2- 172.21.15.40:0/2353284323 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa91009e2b0 0x7fa9101301a0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fa908015000 tx=0x7fa908004ad0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.232+0000 7fa916543700 1 -- 172.21.15.40:0/2353284323 shutdown_connections 2023-09-30T22:30:47.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.232+0000 7fa916543700 1 --2- 172.21.15.40:0/2353284323 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa91009e2b0 0x7fa9101301a0 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.232+0000 7fa916543700 1 --2- 172.21.15.40:0/2353284323 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa91009c890 0x7fa91012f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.232+0000 7fa916543700 1 --2- 172.21.15.40:0/2353284323 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa91009d920 0x7fa91012fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.232+0000 7fa916543700 1 -- 172.21.15.40:0/2353284323 >> 172.21.15.40:0/2353284323 conn(0x7fa9100a7080 msgr2=0x7fa9101bb110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:47.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.233+0000 7fa916543700 1 -- 172.21.15.40:0/2353284323 shutdown_connections 2023-09-30T22:30:47.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.233+0000 7fa916543700 1 -- 172.21.15.40:0/2353284323 wait complete. 2023-09-30T22:30:47.246 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:47.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.255+0000 7f5cac278700 1 -- 172.21.15.40:0/2449910605 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5ca4062380 con 0x7f5ca409d920 2023-09-30T22:30:47.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.255+0000 7f5c9affd700 1 -- 172.21.15.40:0/2449910605 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5ca0019b40 con 0x7f5ca409d920 2023-09-30T22:30:47.256 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:47.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.257+0000 7f5cac278700 1 -- 172.21.15.40:0/2449910605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ca409d920 msgr2=0x7f5ca411e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:47.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.257+0000 7f5cac278700 1 --2- 172.21.15.40:0/2449910605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ca409d920 0x7f5ca411e8b0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f5ca000c430 tx=0x7f5ca000c740 comp rx=0 tx=0).stop 2023-09-30T22:30:47.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.257+0000 7f5cac278700 1 -- 172.21.15.40:0/2449910605 shutdown_connections 2023-09-30T22:30:47.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.257+0000 7f5cac278700 1 --2- 172.21.15.40:0/2449910605 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ca411f330 0x7f5ca41350d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.257+0000 7f5cac278700 1 --2- 172.21.15.40:0/2449910605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ca409d920 0x7f5ca411e8b0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.257+0000 7f5cac278700 1 --2- 172.21.15.40:0/2449910605 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ca409e400 0x7f5ca411edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.257+0000 7f5cac278700 1 -- 172.21.15.40:0/2449910605 >> 172.21.15.40:0/2449910605 conn(0x7f5ca409fb20 msgr2=0x7f5ca4070970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:47.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.257+0000 7f5cac278700 1 -- 172.21.15.40:0/2449910605 shutdown_connections 2023-09-30T22:30:47.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.257+0000 7f5cac278700 1 -- 172.21.15.40:0/2449910605 wait complete. 2023-09-30T22:30:47.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.260+0000 7f8ef5746700 1 -- 172.21.15.40:0/654821751 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8ef00a04e0 con 0x7f8ef009fbb0 2023-09-30T22:30:47.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.260+0000 7f8ed77fe700 1 -- 172.21.15.40:0/654821751 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ee4003a20 con 0x7f8ef009fbb0 2023-09-30T22:30:47.261 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:47.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.263+0000 7f8ef5746700 1 -- 172.21.15.40:0/654821751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ef009fbb0 msgr2=0x7f8ef0138b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:47.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.263+0000 7f8ef5746700 1 --2- 172.21.15.40:0/654821751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ef009fbb0 0x7f8ef0138b00 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4000c00 tx=0x7f8ee4004750 comp rx=0 tx=0).stop 2023-09-30T22:30:47.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.263+0000 7f8ef5746700 1 -- 172.21.15.40:0/654821751 shutdown_connections 2023-09-30T22:30:47.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.263+0000 7f8ef5746700 1 --2- 172.21.15.40:0/654821751 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8ef0139380 0x7f8ef008f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.263+0000 7f8ef5746700 1 --2- 172.21.15.40:0/654821751 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ef006d0a0 0x7f8ef01385c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.263+0000 7f8ef5746700 1 --2- 172.21.15.40:0/654821751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ef009fbb0 0x7f8ef0138b00 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.263+0000 7f8ef5746700 1 -- 172.21.15.40:0/654821751 >> 172.21.15.40:0/654821751 conn(0x7f8ef00a41a0 msgr2=0x7f8ef00a20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:47.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.263+0000 7f8ef5746700 1 -- 172.21.15.40:0/654821751 shutdown_connections 2023-09-30T22:30:47.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.263+0000 7f8ef5746700 1 -- 172.21.15.40:0/654821751 wait complete. 2023-09-30T22:30:47.272 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:47.277 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:47.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.416+0000 7fc7524e1700 1 -- 172.21.15.40:0/1677689683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc74c12e6d0 con 0x7fc74c09e2b0 2023-09-30T22:30:47.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.416+0000 7fc748ff9700 1 -- 172.21.15.40:0/1677689683 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc744018030 con 0x7fc74c09e2b0 2023-09-30T22:30:47.417 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:47.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.418+0000 7fc7524e1700 1 -- 172.21.15.40:0/1677689683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc74c09e2b0 msgr2=0x7fc74c12dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:47.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.418+0000 7fc7524e1700 1 --2- 172.21.15.40:0/1677689683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc74c09e2b0 0x7fc74c12dcf0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fc74400cbe0 tx=0x7fc74400cef0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.418+0000 7fc7524e1700 1 -- 172.21.15.40:0/1677689683 shutdown_connections 2023-09-30T22:30:47.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.418+0000 7fc7524e1700 1 --2- 172.21.15.40:0/1677689683 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc74c09c890 0x7fc74c12d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.418+0000 7fc7524e1700 1 --2- 172.21.15.40:0/1677689683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc74c09e2b0 0x7fc74c12dcf0 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.418+0000 7fc7524e1700 1 --2- 172.21.15.40:0/1677689683 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc74c09d920 0x7fc74c12d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:47.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.418+0000 7fc7524e1700 1 -- 172.21.15.40:0/1677689683 >> 172.21.15.40:0/1677689683 conn(0x7fc74c0a7080 msgr2=0x7fc74c0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:47.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.419+0000 7fc7524e1700 1 -- 172.21.15.40:0/1677689683 shutdown_connections 2023-09-30T22:30:47.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:47.419+0000 7fc7524e1700 1 -- 172.21.15.40:0/1677689683 wait complete. 2023-09-30T22:30:47.431 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:48.247 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:48.273 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:48.278 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:48.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.392+0000 7fd7121b3700 1 Processor -- start 2023-09-30T22:30:48.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.392+0000 7fd7121b3700 1 -- start start 2023-09-30T22:30:48.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.392+0000 7fd7121b3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd70c09c890 0x7fd70c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.392+0000 7fd7121b3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd70c09d920 0x7fd70c09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.392+0000 7fd7121b3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd70c09e2b0 0x7fd70c13ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.392+0000 7fd7121b3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd70c0a29d0 con 0x7fd70c09c890 2023-09-30T22:30:48.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.392+0000 7fd7121b3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c09fb40 con 0x7fd70c09e2b0 2023-09-30T22:30:48.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.392+0000 7fd7121b3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c0a2600 con 0x7fd70c09d920 2023-09-30T22:30:48.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.392+0000 7fd70bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd70c09e2b0 0x7fd70c13ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.392+0000 7fd70b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd70c09c890 0x7fd70c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.392+0000 7fd702ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd70c09d920 0x7fd70c09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.392+0000 7fd70bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd70c09e2b0 0x7fd70c13ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:44800/0 (socket says 172.21.15.40:44800) 2023-09-30T22:30:48.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.392+0000 7fd70b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd70c09c890 0x7fd70c09cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43420/0 (socket says 172.21.15.40:43420) 2023-09-30T22:30:48.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.392+0000 7fd70bfff700 1 -- 172.21.15.40:0/525625069 learned_addr learned my addr 172.21.15.40:0/525625069 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:48.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.393+0000 7fd70bfff700 1 -- 172.21.15.40:0/525625069 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd70c09d920 msgr2=0x7fd70c09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:48.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.393+0000 7fd70bfff700 1 --2- 172.21.15.40:0/525625069 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd70c09d920 0x7fd70c09dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.393+0000 7fd70bfff700 1 -- 172.21.15.40:0/525625069 >> v2:172.21.15.40:3300/0 conn(0x7fd70c09c890 msgr2=0x7fd70c09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:48.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.393+0000 7fd70bfff700 1 --2- 172.21.15.40:0/525625069 >> v2:172.21.15.40:3300/0 conn(0x7fd70c09c890 0x7fd70c09cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.393+0000 7fd70bfff700 1 -- 172.21.15.40:0/525625069 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70c09fed0 con 0x7fd70c09e2b0 2023-09-30T22:30:48.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.393+0000 7fd70bfff700 1 --2- 172.21.15.40:0/525625069 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd70c09e2b0 0x7fd70c13ac10 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd704009e50 tx=0x7fd70400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3758abbe5fbc826 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:48.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.393+0000 7fd70affd700 1 -- 172.21.15.40:0/525625069 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70400e070 con 0x7fd70c09e2b0 2023-09-30T22:30:48.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.393+0000 7fd70affd700 1 -- 172.21.15.40:0/525625069 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70400b910 con 0x7fd70c09e2b0 2023-09-30T22:30:48.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.393+0000 7fd70affd700 1 -- 172.21.15.40:0/525625069 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70400bcc0 con 0x7fd70c09e2b0 2023-09-30T22:30:48.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.394+0000 7fd7121b3700 1 -- 172.21.15.40:0/525625069 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd70c09e2b0 msgr2=0x7fd70c13ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:48.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.394+0000 7fd7121b3700 1 --2- 172.21.15.40:0/525625069 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd70c09e2b0 0x7fd70c13ac10 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd704009e50 tx=0x7fd70400b330 comp rx=0 tx=0).stop 2023-09-30T22:30:48.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.394+0000 7fd7121b3700 1 -- 172.21.15.40:0/525625069 shutdown_connections 2023-09-30T22:30:48.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.394+0000 7fd7121b3700 1 --2- 172.21.15.40:0/525625069 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd70c09e2b0 0x7fd70c13ac10 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.394+0000 7fd7121b3700 1 --2- 172.21.15.40:0/525625069 >> v2:172.21.15.40:3300/0 conn(0x7fd70c09c890 0x7fd70c09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.394+0000 7fd7121b3700 1 --2- 172.21.15.40:0/525625069 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd70c09d920 0x7fd70c09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.394+0000 7fd7121b3700 1 -- 172.21.15.40:0/525625069 >> 172.21.15.40:0/525625069 conn(0x7fd70c0a7080 msgr2=0x7fd70c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:48.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.394+0000 7fd7121b3700 1 -- 172.21.15.40:0/525625069 shutdown_connections 2023-09-30T22:30:48.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.394+0000 7fd7121b3700 1 -- 172.21.15.40:0/525625069 wait complete. 2023-09-30T22:30:48.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.396+0000 7fd7121b3700 1 Processor -- start 2023-09-30T22:30:48.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.396+0000 7fd7121b3700 1 -- start start 2023-09-30T22:30:48.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.397+0000 7fd7121b3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd70c09c890 0x7fd70c12d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.397+0000 7fd7121b3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd70c09d920 0x7fd70c12d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.397+0000 7fd7121b3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd70c09e2b0 0x7fd70c12ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.397+0000 7fd7121b3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c09ecf0 con 0x7fd70c09d920 2023-09-30T22:30:48.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.397+0000 7fd7121b3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c1305e0 con 0x7fd70c09c890 2023-09-30T22:30:48.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.397+0000 7fd7121b3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c09c230 con 0x7fd70c09e2b0 2023-09-30T22:30:48.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.397+0000 7fd702ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd70c09d920 0x7fd70c12d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.397+0000 7fd702ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd70c09d920 0x7fd70c12d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43428/0 (socket says 172.21.15.40:43428) 2023-09-30T22:30:48.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.397+0000 7fd702ffd700 1 -- 172.21.15.40:0/3849713158 learned_addr learned my addr 172.21.15.40:0/3849713158 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:48.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.397+0000 7fd70b7fe700 1 --2- 172.21.15.40:0/3849713158 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd70c09c890 0x7fd70c12d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.397+0000 7fd70bfff700 1 --2- 172.21.15.40:0/3849713158 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd70c09e2b0 0x7fd70c12ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.397+0000 7fd702ffd700 1 -- 172.21.15.40:0/3849713158 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd70c09e2b0 msgr2=0x7fd70c12ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:48.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.397+0000 7fd702ffd700 1 --2- 172.21.15.40:0/3849713158 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd70c09e2b0 0x7fd70c12ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.397+0000 7fd702ffd700 1 -- 172.21.15.40:0/3849713158 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd70c09c890 msgr2=0x7fd70c12d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:48.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.397+0000 7fd702ffd700 1 --2- 172.21.15.40:0/3849713158 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd70c09c890 0x7fd70c12d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.397+0000 7fd702ffd700 1 -- 172.21.15.40:0/3849713158 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd704009b30 con 0x7fd70c09d920 2023-09-30T22:30:48.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.397+0000 7fd70b7fe700 1 --2- 172.21.15.40:0/3849713158 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd70c09c890 0x7fd70c12d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:48.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.398+0000 7fd702ffd700 1 --2- 172.21.15.40:0/3849713158 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd70c09d920 0x7fd70c12d880 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fd6f400e9b0 tx=0x7fd6f400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:48.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.398+0000 7fd708ff9700 1 -- 172.21.15.40:0/3849713158 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f4009710 con 0x7fd70c09d920 2023-09-30T22:30:48.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.398+0000 7fd708ff9700 1 -- 172.21.15.40:0/3849713158 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f400c850 con 0x7fd70c09d920 2023-09-30T22:30:48.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.398+0000 7fd7121b3700 1 -- 172.21.15.40:0/3849713158 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd70c12e300 con 0x7fd70c09d920 2023-09-30T22:30:48.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.398+0000 7fd708ff9700 1 -- 172.21.15.40:0/3849713158 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f400cbc0 con 0x7fd70c09d920 2023-09-30T22:30:48.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.398+0000 7fd7121b3700 1 -- 172.21.15.40:0/3849713158 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd70c12f9c0 con 0x7fd70c09d920 2023-09-30T22:30:48.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.399+0000 7fd708ff9700 1 -- 172.21.15.40:0/3849713158 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd6f400cd20 con 0x7fd70c09d920 2023-09-30T22:30:48.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.399+0000 7fd7121b3700 1 -- 172.21.15.40:0/3849713158 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd70c062380 con 0x7fd70c09d920 2023-09-30T22:30:48.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.399+0000 7fd708ff9700 1 -- 172.21.15.40:0/3849713158 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd6f403f7d0 con 0x7fd70c09d920 2023-09-30T22:30:48.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.404+0000 7fd708ff9700 1 -- 172.21.15.40:0/3849713158 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd6f40232f0 con 0x7fd70c09d920 2023-09-30T22:30:48.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.430+0000 7f630e6cf700 1 Processor -- start 2023-09-30T22:30:48.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.431+0000 7f630e6cf700 1 -- start start 2023-09-30T22:30:48.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.431+0000 7f630e6cf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f630806f070 0x7f630806f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.431+0000 7f630e6cf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f630806f980 0x7f6308097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.431+0000 7f630e6cf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f630806fdb0 0x7f63080975d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.431+0000 7f630e6cf700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6308070830 con 0x7f630806f980 2023-09-30T22:30:48.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.431+0000 7f630e6cf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6308070ad0 con 0x7f630806fdb0 2023-09-30T22:30:48.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.431+0000 7f630e6cf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6308070de0 con 0x7f630806f070 2023-09-30T22:30:48.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.431+0000 7fe0444d7700 1 Processor -- start 2023-09-30T22:30:48.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.431+0000 7f6307fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f630806f070 0x7f630806f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.431+0000 7f6307fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f630806f070 0x7f630806f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56528/0 (socket says 172.21.15.40:56528) 2023-09-30T22:30:48.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.431+0000 7f6307fff700 1 -- 172.21.15.40:0/2789171240 learned_addr learned my addr 172.21.15.40:0/2789171240 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:48.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.431+0000 7fe0444d7700 1 -- start start 2023-09-30T22:30:48.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.431+0000 7f63077fe700 1 --2- 172.21.15.40:0/2789171240 >> v2:172.21.15.40:3300/0 conn(0x7f630806f980 0x7f6308097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.431+0000 7f630cc6c700 1 --2- 172.21.15.40:0/2789171240 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f630806fdb0 0x7f63080975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.432+0000 7f6307fff700 1 -- 172.21.15.40:0/2789171240 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f630806fdb0 msgr2=0x7f63080975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:48.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.432+0000 7f6307fff700 1 --2- 172.21.15.40:0/2789171240 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f630806fdb0 0x7f63080975d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.432+0000 7f6307fff700 1 -- 172.21.15.40:0/2789171240 >> v2:172.21.15.40:3300/0 conn(0x7f630806f980 msgr2=0x7f6308097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:48.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.432+0000 7f6307fff700 1 --2- 172.21.15.40:0/2789171240 >> v2:172.21.15.40:3300/0 conn(0x7f630806f980 0x7f6308097090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.432+0000 7f6307fff700 1 -- 172.21.15.40:0/2789171240 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f630809fe20 con 0x7f630806f070 2023-09-30T22:30:48.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.432+0000 7f63077fe700 1 --2- 172.21.15.40:0/2789171240 >> v2:172.21.15.40:3300/0 conn(0x7f630806f980 0x7f6308097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:48.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.432+0000 7f6307fff700 1 --2- 172.21.15.40:0/2789171240 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f630806f070 0x7f630806f440 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f62f80098f0 tx=0x7f62f8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27d47fe1c0de07d6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:48.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.432+0000 7fe0444d7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe03c09d920 0x7fe03c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.432+0000 7fe0444d7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe03c130fb0 0x7fe03c139f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.432+0000 7fe0444d7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe03c09adf0 con 0x7fe03c09e230 2023-09-30T22:30:48.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.432+0000 7fe0444d7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe03c09edf0 con 0x7fe03c09d920 2023-09-30T22:30:48.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.432+0000 7fe0444d7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c09b660 con 0x7fe03c130fb0 2023-09-30T22:30:48.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.432+0000 7fe042a74700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe03c130fb0 0x7fe03c139f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.432+0000 7fe042a74700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe03c130fb0 0x7fe03c139f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56534/0 (socket says 172.21.15.40:56534) 2023-09-30T22:30:48.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.432+0000 7fe042a74700 1 -- 172.21.15.40:0/4095576341 learned_addr learned my addr 172.21.15.40:0/4095576341 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:48.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.433+0000 7fe042a74700 1 -- 172.21.15.40:0/4095576341 >> v2:172.21.15.40:3300/0 conn(0x7fe03c09d920 msgr2=0x7fe03c09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:48.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.433+0000 7fe042a74700 1 --2- 172.21.15.40:0/4095576341 >> v2:172.21.15.40:3300/0 conn(0x7fe03c09d920 0x7fe03c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.433+0000 7fe042a74700 1 -- 172.21.15.40:0/4095576341 >> v1:172.21.15.40:6789/0 conn(0x7fe03c09e230 legacy=0x7fe03c1308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:48.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.433+0000 7fe042a74700 1 -- 172.21.15.40:0/4095576341 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe03c09a6e0 con 0x7fe03c130fb0 2023-09-30T22:30:48.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.433+0000 7fe042a74700 1 --2- 172.21.15.40:0/4095576341 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe03c130fb0 0x7fe03c139f10 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fe02c0098f0 tx=0x7fe02c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88fd270da42b8a76 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:48.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.433+0000 7fe041271700 1 -- 172.21.15.40:0/4095576341 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c004230 con 0x7fe03c130fb0 2023-09-30T22:30:48.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.433+0000 7fe041271700 1 -- 172.21.15.40:0/4095576341 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02c004390 con 0x7fe03c130fb0 2023-09-30T22:30:48.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.433+0000 7fe041271700 1 -- 172.21.15.40:0/4095576341 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c0036a0 con 0x7fe03c130fb0 2023-09-30T22:30:48.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.432+0000 7f6306ffd700 1 -- 172.21.15.40:0/2789171240 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f8011830 con 0x7f630806f070 2023-09-30T22:30:48.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.432+0000 7f6306ffd700 1 -- 172.21.15.40:0/2789171240 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f8011990 con 0x7f630806f070 2023-09-30T22:30:48.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.432+0000 7f6306ffd700 1 -- 172.21.15.40:0/2789171240 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f8011d20 con 0x7f630806f070 2023-09-30T22:30:48.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.433+0000 7f630e6cf700 1 -- 172.21.15.40:0/2789171240 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f630806f070 msgr2=0x7f630806f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:48.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.433+0000 7f630e6cf700 1 --2- 172.21.15.40:0/2789171240 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f630806f070 0x7f630806f440 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f62f80098f0 tx=0x7f62f8009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:48.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.433+0000 7f630e6cf700 1 -- 172.21.15.40:0/2789171240 shutdown_connections 2023-09-30T22:30:48.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.433+0000 7f630e6cf700 1 --2- 172.21.15.40:0/2789171240 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f630806f070 0x7f630806f440 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.433+0000 7f630e6cf700 1 --2- 172.21.15.40:0/2789171240 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f630806fdb0 0x7f63080975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.433+0000 7f630e6cf700 1 --2- 172.21.15.40:0/2789171240 >> v2:172.21.15.40:3300/0 conn(0x7f630806f980 0x7f6308097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.433+0000 7f630e6cf700 1 -- 172.21.15.40:0/2789171240 >> 172.21.15.40:0/2789171240 conn(0x7f63080a41a0 msgr2=0x7f63080a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:48.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.433+0000 7f630e6cf700 1 -- 172.21.15.40:0/2789171240 shutdown_connections 2023-09-30T22:30:48.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.433+0000 7f630e6cf700 1 -- 172.21.15.40:0/2789171240 wait complete. 2023-09-30T22:30:48.440 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:48.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.434+0000 7fe0444d7700 1 -- 172.21.15.40:0/4095576341 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe03c130fb0 msgr2=0x7fe03c139f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:48.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.434+0000 7fe0444d7700 1 --2- 172.21.15.40:0/4095576341 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe03c130fb0 0x7fe03c139f10 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fe02c0098f0 tx=0x7fe02c009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:48.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.434+0000 7fe0444d7700 1 -- 172.21.15.40:0/4095576341 shutdown_connections 2023-09-30T22:30:48.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.434+0000 7fe0444d7700 1 --2- 172.21.15.40:0/4095576341 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe03c130fb0 0x7fe03c139f10 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.434+0000 7fe0444d7700 1 --2- 172.21.15.40:0/4095576341 >> v2:172.21.15.40:3300/0 conn(0x7fe03c09d920 0x7fe03c09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.434+0000 7fe0444d7700 1 -- 172.21.15.40:0/4095576341 >> 172.21.15.40:0/4095576341 conn(0x7fe03c09fb20 msgr2=0x7fe03c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:48.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.434+0000 7fe0444d7700 1 -- 172.21.15.40:0/4095576341 shutdown_connections 2023-09-30T22:30:48.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.434+0000 7fe0444d7700 1 -- 172.21.15.40:0/4095576341 wait complete. 2023-09-30T22:30:48.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.434+0000 7f630e6cf700 1 Processor -- start 2023-09-30T22:30:48.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.435+0000 7f630e6cf700 1 -- start start 2023-09-30T22:30:48.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.435+0000 7fe0444d7700 1 Processor -- start 2023-09-30T22:30:48.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.435+0000 7fe0444d7700 1 -- start start 2023-09-30T22:30:48.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.435+0000 7f630e6cf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f630806f070 0x7f630812cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.435+0000 7f630e6cf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f630806f980 0x7f630812d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.435+0000 7f630e6cf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f630806fdb0 0x7f630812d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.435+0000 7f630e6cf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630812f990 con 0x7f630806f980 2023-09-30T22:30:48.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.435+0000 7f630e6cf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f630812ec80 con 0x7f630806fdb0 2023-09-30T22:30:48.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.435+0000 7f630e6cf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f630812ea90 con 0x7f630806f070 2023-09-30T22:30:48.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.435+0000 7fe0444d7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe03c09d920 0x7fe03c12faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.435+0000 7fe0444d7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe03c09e230 0x7fe03c12ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.435+0000 7fe0444d7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe03c130fb0 0x7fe03c130520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.435+0000 7fe0444d7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c1392d0 con 0x7fe03c09d920 2023-09-30T22:30:48.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.435+0000 7fe0444d7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c1377b0 con 0x7fe03c09e230 2023-09-30T22:30:48.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.435+0000 7fe0444d7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c06b2d0 con 0x7fe03c130fb0 2023-09-30T22:30:48.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.435+0000 7fe042273700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe03c09d920 0x7fe03c12faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.435+0000 7fe042a74700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe03c130fb0 0x7fe03c130520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.435+0000 7fe042273700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe03c09d920 0x7fe03c12faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43468/0 (socket says 172.21.15.40:43468) 2023-09-30T22:30:48.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.435+0000 7fe042a74700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe03c130fb0 0x7fe03c130520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56558/0 (socket says 172.21.15.40:56558) 2023-09-30T22:30:48.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.435+0000 7fe042273700 1 -- 172.21.15.40:0/3015070759 learned_addr learned my addr 172.21.15.40:0/3015070759 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:48.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.436+0000 7fe041a72700 1 --2- 172.21.15.40:0/3015070759 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe03c09e230 0x7fe03c12ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.436+0000 7fe042273700 1 -- 172.21.15.40:0/3015070759 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe03c130fb0 msgr2=0x7fe03c130520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:48.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.436+0000 7fe042273700 1 --2- 172.21.15.40:0/3015070759 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe03c130fb0 0x7fe03c130520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.436+0000 7fe042273700 1 -- 172.21.15.40:0/3015070759 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe03c09e230 msgr2=0x7fe03c12ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:48.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.435+0000 7f630cc6c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f630806fdb0 0x7f630812d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.435+0000 7f630cc6c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f630806fdb0 0x7f630812d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:44834/0 (socket says 172.21.15.40:44834) 2023-09-30T22:30:48.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.435+0000 7f630cc6c700 1 -- 172.21.15.40:0/3748503775 learned_addr learned my addr 172.21.15.40:0/3748503775 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:48.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.436+0000 7fe042273700 1 --2- 172.21.15.40:0/3015070759 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe03c09e230 0x7fe03c12ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.436+0000 7fe042273700 1 -- 172.21.15.40:0/3015070759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe02c009550 con 0x7fe03c09d920 2023-09-30T22:30:48.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.435+0000 7f6307fff700 1 --2- 172.21.15.40:0/3748503775 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f630806f070 0x7f630812cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.435+0000 7f630cc6c700 1 -- 172.21.15.40:0/3748503775 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f630806f070 msgr2=0x7f630812cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:48.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.435+0000 7f630cc6c700 1 --2- 172.21.15.40:0/3748503775 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f630806f070 0x7f630812cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.435+0000 7f630cc6c700 1 -- 172.21.15.40:0/3748503775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f630806f980 msgr2=0x7f630812d450 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:30:48.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.435+0000 7f630cc6c700 1 --2- 172.21.15.40:0/3748503775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f630806f980 0x7f630812d450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.435+0000 7f630cc6c700 1 -- 172.21.15.40:0/3748503775 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f8009550 con 0x7f630806fdb0 2023-09-30T22:30:48.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.436+0000 7f630cc6c700 1 --2- 172.21.15.40:0/3748503775 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f630806fdb0 0x7f630812d990 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f630000efc0 tx=0x7f630000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:48.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.436+0000 7fe042a74700 1 --2- 172.21.15.40:0/3015070759 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe03c130fb0 0x7fe03c130520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:48.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.436+0000 7fe041a72700 1 --2- 172.21.15.40:0/3015070759 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe03c09e230 0x7fe03c12ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:30:48.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.436+0000 7fe042273700 1 --2- 172.21.15.40:0/3015070759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe03c09d920 0x7fe03c12faa0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fe03400ba50 tx=0x7fe03400be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:48.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.436+0000 7f6304ff9700 1 -- 172.21.15.40:0/3748503775 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6300009ea0 con 0x7f630806fdb0 2023-09-30T22:30:48.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.436+0000 7f6304ff9700 1 -- 172.21.15.40:0/3748503775 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630000f040 con 0x7f630806fdb0 2023-09-30T22:30:48.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.436+0000 7f6304ff9700 1 -- 172.21.15.40:0/3748503775 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6300014480 con 0x7f630806fdb0 2023-09-30T22:30:48.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.436+0000 7f630e6cf700 1 -- 172.21.15.40:0/3748503775 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6308131580 con 0x7f630806fdb0 2023-09-30T22:30:48.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.436+0000 7f630e6cf700 1 -- 172.21.15.40:0/3748503775 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f630812fce0 con 0x7f630806fdb0 2023-09-30T22:30:48.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.436+0000 7fe032ffd700 1 -- 172.21.15.40:0/3015070759 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03400cab0 con 0x7fe03c09d920 2023-09-30T22:30:48.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.436+0000 7fe032ffd700 1 -- 172.21.15.40:0/3015070759 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03400cc30 con 0x7fe03c09d920 2023-09-30T22:30:48.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.436+0000 7fe032ffd700 1 -- 172.21.15.40:0/3015070759 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe034014440 con 0x7fe03c09d920 2023-09-30T22:30:48.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.437+0000 7fe0444d7700 1 -- 172.21.15.40:0/3015070759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe03c137e90 con 0x7fe03c09d920 2023-09-30T22:30:48.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.437+0000 7fe0444d7700 1 -- 172.21.15.40:0/3015070759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe03c1395b0 con 0x7fe03c09d920 2023-09-30T22:30:48.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.437+0000 7f6304ff9700 1 -- 172.21.15.40:0/3748503775 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f63000145e0 con 0x7f630806fdb0 2023-09-30T22:30:48.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.437+0000 7f6304ff9700 1 -- 172.21.15.40:0/3748503775 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f630003fe70 con 0x7f630806fdb0 2023-09-30T22:30:48.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.437+0000 7f630e6cf700 1 -- 172.21.15.40:0/3748503775 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6308130130 con 0x7f630806fdb0 2023-09-30T22:30:48.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.438+0000 7fe0444d7700 1 -- 172.21.15.40:0/3015070759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe03c132e60 con 0x7fe03c09d920 2023-09-30T22:30:48.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.438+0000 7fe032ffd700 1 -- 172.21.15.40:0/3015070759 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe03401d3b0 con 0x7fe03c09d920 2023-09-30T22:30:48.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.438+0000 7fe032ffd700 1 -- 172.21.15.40:0/3015070759 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe03403f520 con 0x7fe03c09d920 2023-09-30T22:30:48.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.442+0000 7f6304ff9700 1 -- 172.21.15.40:0/3748503775 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6300018070 con 0x7f630806fdb0 2023-09-30T22:30:48.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.443+0000 7fe032ffd700 1 -- 172.21.15.40:0/3015070759 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe034007370 con 0x7fe03c09d920 2023-09-30T22:30:48.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.580+0000 7f99a661e700 1 Processor -- start 2023-09-30T22:30:48.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.580+0000 7f99a661e700 1 -- start start 2023-09-30T22:30:48.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.580+0000 7f99a661e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f99a009d450 0x7f99a009d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.580+0000 7f99a661e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99a009dd60 0x7f99a01301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.580+0000 7f99a661e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f99a0130700 0x7f99a0130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.580+0000 7f99a661e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a009e8b0 con 0x7f99a0130700 2023-09-30T22:30:48.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.580+0000 7f99a661e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a009c3b0 con 0x7f99a009dd60 2023-09-30T22:30:48.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.580+0000 7f99a661e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99a009a6b0 con 0x7f99a009d450 2023-09-30T22:30:48.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.580+0000 7f999f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99a009dd60 0x7f99a01301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.581+0000 7f999f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99a009dd60 0x7f99a01301c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:44856/0 (socket says 172.21.15.40:44856) 2023-09-30T22:30:48.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.581+0000 7f999f7fe700 1 -- 172.21.15.40:0/2605585600 learned_addr learned my addr 172.21.15.40:0/2605585600 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:48.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.581+0000 7f999ffff700 1 --2- 172.21.15.40:0/2605585600 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f99a009d450 0x7f99a009d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.581+0000 7f99a4bbb700 1 --2- 172.21.15.40:0/2605585600 >> v2:172.21.15.40:3300/0 conn(0x7f99a0130700 0x7f99a0130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.581+0000 7f999f7fe700 1 -- 172.21.15.40:0/2605585600 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f99a009d450 msgr2=0x7f99a009d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:48.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.581+0000 7f999f7fe700 1 --2- 172.21.15.40:0/2605585600 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f99a009d450 0x7f99a009d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.581+0000 7f999f7fe700 1 -- 172.21.15.40:0/2605585600 >> v2:172.21.15.40:3300/0 conn(0x7f99a0130700 msgr2=0x7f99a0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:48.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.581+0000 7f999f7fe700 1 --2- 172.21.15.40:0/2605585600 >> v2:172.21.15.40:3300/0 conn(0x7f99a0130700 0x7f99a0130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.581+0000 7f999f7fe700 1 -- 172.21.15.40:0/2605585600 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a009b4f0 con 0x7f99a009dd60 2023-09-30T22:30:48.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.581+0000 7f999f7fe700 1 --2- 172.21.15.40:0/2605585600 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99a009dd60 0x7f99a01301c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f99940098f0 tx=0x7f9994009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11057709377e56b6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:48.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.581+0000 7f999effd700 1 -- 172.21.15.40:0/2605585600 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999400b8a0 con 0x7f99a009dd60 2023-09-30T22:30:48.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.581+0000 7f999effd700 1 -- 172.21.15.40:0/2605585600 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999400ba00 con 0x7f99a009dd60 2023-09-30T22:30:48.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.581+0000 7f999effd700 1 -- 172.21.15.40:0/2605585600 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999400bd90 con 0x7f99a009dd60 2023-09-30T22:30:48.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.582+0000 7f99a661e700 1 -- 172.21.15.40:0/2605585600 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99a009dd60 msgr2=0x7f99a01301c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:48.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.582+0000 7f99a661e700 1 --2- 172.21.15.40:0/2605585600 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99a009dd60 0x7f99a01301c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f99940098f0 tx=0x7f9994009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:48.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.582+0000 7f99a661e700 1 -- 172.21.15.40:0/2605585600 shutdown_connections 2023-09-30T22:30:48.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.582+0000 7f99a661e700 1 --2- 172.21.15.40:0/2605585600 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f99a009d450 0x7f99a009d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.582+0000 7f99a661e700 1 --2- 172.21.15.40:0/2605585600 >> v2:172.21.15.40:3300/0 conn(0x7f99a0130700 0x7f99a0130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.582+0000 7f99a661e700 1 --2- 172.21.15.40:0/2605585600 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99a009dd60 0x7f99a01301c0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.582+0000 7f99a661e700 1 -- 172.21.15.40:0/2605585600 >> 172.21.15.40:0/2605585600 conn(0x7f99a00a2a00 msgr2=0x7f99a00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:48.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.582+0000 7f99a661e700 1 -- 172.21.15.40:0/2605585600 shutdown_connections 2023-09-30T22:30:48.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.582+0000 7f99a661e700 1 -- 172.21.15.40:0/2605585600 wait complete. 2023-09-30T22:30:48.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.583+0000 7f99a661e700 1 Processor -- start 2023-09-30T22:30:48.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.583+0000 7f99a661e700 1 -- start start 2023-09-30T22:30:48.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.583+0000 7f99a661e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99a009d450 0x7f99a012b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.584+0000 7f99a661e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99a009dd60 0x7f99a012b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.584+0000 7f99a661e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f99a0130700 0x7f99a012bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:48.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.584+0000 7f99a661e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a0135d40 con 0x7f99a009d450 2023-09-30T22:30:48.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.584+0000 7f99a661e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a0071370 con 0x7f99a009dd60 2023-09-30T22:30:48.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.584+0000 7f99a661e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99a009c5d0 con 0x7f99a0130700 2023-09-30T22:30:48.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.584+0000 7f99a4bbb700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f99a0130700 0x7f99a012bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.584+0000 7f99a4bbb700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f99a0130700 0x7f99a012bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56574/0 (socket says 172.21.15.40:56574) 2023-09-30T22:30:48.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.584+0000 7f99a4bbb700 1 -- 172.21.15.40:0/1610390246 learned_addr learned my addr 172.21.15.40:0/1610390246 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:48.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.584+0000 7f999f7fe700 1 --2- 172.21.15.40:0/1610390246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99a009dd60 0x7f99a012b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:48.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.584+0000 7f99a4bbb700 1 -- 172.21.15.40:0/1610390246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99a009dd60 msgr2=0x7f99a012b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:48.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.584+0000 7f99a4bbb700 1 --2- 172.21.15.40:0/1610390246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99a009dd60 0x7f99a012b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.584+0000 7f99a4bbb700 1 -- 172.21.15.40:0/1610390246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99a009d450 msgr2=0x7f99a012b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:48.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.584+0000 7f99a4bbb700 1 --2- 172.21.15.40:0/1610390246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99a009d450 0x7f99a012b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.584+0000 7f99a4bbb700 1 -- 172.21.15.40:0/1610390246 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9994009550 con 0x7f99a0130700 2023-09-30T22:30:48.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.584+0000 7f99a4bbb700 1 --2- 172.21.15.40:0/1610390246 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f99a0130700 0x7f99a012bbf0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f9998007e40 tx=0x7f999800e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:48.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.585+0000 7f999cff9700 1 -- 172.21.15.40:0/1610390246 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999800ede0 con 0x7f99a0130700 2023-09-30T22:30:48.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.585+0000 7f999cff9700 1 -- 172.21.15.40:0/1610390246 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9998013560 con 0x7f99a0130700 2023-09-30T22:30:48.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.585+0000 7f99a661e700 1 -- 172.21.15.40:0/1610390246 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a0133e30 con 0x7f99a0130700 2023-09-30T22:30:48.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.585+0000 7f999cff9700 1 -- 172.21.15.40:0/1610390246 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9998013910 con 0x7f99a0130700 2023-09-30T22:30:48.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.585+0000 7f99a661e700 1 -- 172.21.15.40:0/1610390246 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a01364d0 con 0x7f99a0130700 2023-09-30T22:30:48.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.586+0000 7f99a661e700 1 -- 172.21.15.40:0/1610390246 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99a0062380 con 0x7f99a0130700 2023-09-30T22:30:48.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.591+0000 7f999cff9700 1 -- 172.21.15.40:0/1610390246 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9998013a70 con 0x7f99a0130700 2023-09-30T22:30:48.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.591+0000 7f999cff9700 1 -- 172.21.15.40:0/1610390246 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f99980442f0 con 0x7f99a0130700 2023-09-30T22:30:48.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.594+0000 7f999cff9700 1 -- 172.21.15.40:0/1610390246 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f99980182a0 con 0x7f99a0130700 2023-09-30T22:30:48.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.613+0000 7fd7121b3700 1 -- 172.21.15.40:0/3849713158 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd70c130ae0 con 0x7fd70c09d920 2023-09-30T22:30:48.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.613+0000 7fd708ff9700 1 -- 172.21.15.40:0/3849713158 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd70c130ae0 con 0x7fd70c09d920 2023-09-30T22:30:48.614 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:48.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.616+0000 7fd7121b3700 1 -- 172.21.15.40:0/3849713158 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd70c09d920 msgr2=0x7fd70c12d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:48.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.616+0000 7fd7121b3700 1 --2- 172.21.15.40:0/3849713158 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd70c09d920 0x7fd70c12d880 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fd6f400e9b0 tx=0x7fd6f400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.616+0000 7fd7121b3700 1 -- 172.21.15.40:0/3849713158 shutdown_connections 2023-09-30T22:30:48.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.616+0000 7fd7121b3700 1 --2- 172.21.15.40:0/3849713158 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd70c09e2b0 0x7fd70c12ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.616+0000 7fd7121b3700 1 --2- 172.21.15.40:0/3849713158 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd70c09c890 0x7fd70c12d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.616+0000 7fd7121b3700 1 --2- 172.21.15.40:0/3849713158 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd70c09d920 0x7fd70c12d880 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:48.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.616+0000 7fd7121b3700 1 -- 172.21.15.40:0/3849713158 >> 172.21.15.40:0/3849713158 conn(0x7fd70c0a7080 msgr2=0x7fd70c0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:48.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.616+0000 7fd7121b3700 1 -- 172.21.15.40:0/3849713158 shutdown_connections 2023-09-30T22:30:48.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.616+0000 7fd7121b3700 1 -- 172.21.15.40:0/3849713158 wait complete. 2023-09-30T22:30:48.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:48.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.671+0000 7fe0444d7700 1 -- 172.21.15.40:0/3015070759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe03c139410 con 0x7fe03c09d920 2023-09-30T22:30:48.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.672+0000 7fe032ffd700 1 -- 172.21.15.40:0/3015070759 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe03c139410 con 0x7fe03c09d920 2023-09-30T22:30:48.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.672+0000 7f630e6cf700 1 -- 172.21.15.40:0/3748503775 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6308062380 con 0x7f630806fdb0 2023-09-30T22:30:48.673 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:48.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.672+0000 7f6304ff9700 1 -- 172.21.15.40:0/3748503775 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f630002b090 con 0x7f630806fdb0 2023-09-30T22:30:48.674 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:48.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.674+0000 7fe0444d7700 1 -- 172.21.15.40:0/3015070759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe03c09d920 msgr2=0x7fe03c12faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:48.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.674+0000 7fe0444d7700 1 --2- 172.21.15.40:0/3015070759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe03c09d920 0x7fe03c12faa0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fe03400ba50 tx=0x7fe03400be10 comp rx=0 tx=0).stop 2023-09-30T22:30:48.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.674+0000 7fe0444d7700 1 -- 172.21.15.40:0/3015070759 shutdown_connections 2023-09-30T22:30:49.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.674+0000 7fe0444d7700 1 --2- 172.21.15.40:0/3015070759 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe03c130fb0 0x7fe03c130520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.674+0000 7fe0444d7700 1 --2- 172.21.15.40:0/3015070759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe03c09d920 0x7fe03c12faa0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.674+0000 7fe0444d7700 1 --2- 172.21.15.40:0/3015070759 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe03c09e230 0x7fe03c12ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.674+0000 7fe0444d7700 1 -- 172.21.15.40:0/3015070759 >> 172.21.15.40:0/3015070759 conn(0x7fe03c09fb20 msgr2=0x7fe03c071550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:49.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.674+0000 7fe0444d7700 1 -- 172.21.15.40:0/3015070759 shutdown_connections 2023-09-30T22:30:49.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.674+0000 7fe0444d7700 1 -- 172.21.15.40:0/3015070759 wait complete. 2023-09-30T22:30:49.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.674+0000 7f630e6cf700 1 -- 172.21.15.40:0/3748503775 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f630806fdb0 msgr2=0x7f630812d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:49.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.674+0000 7f630e6cf700 1 --2- 172.21.15.40:0/3748503775 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f630806fdb0 0x7f630812d990 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f630000efc0 tx=0x7f630000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.675+0000 7f630e6cf700 1 -- 172.21.15.40:0/3748503775 shutdown_connections 2023-09-30T22:30:49.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.675+0000 7f630e6cf700 1 --2- 172.21.15.40:0/3748503775 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f630806f070 0x7f630812cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.675+0000 7f630e6cf700 1 --2- 172.21.15.40:0/3748503775 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f630806fdb0 0x7f630812d990 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.675+0000 7f630e6cf700 1 --2- 172.21.15.40:0/3748503775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f630806f980 0x7f630812d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.675+0000 7f630e6cf700 1 -- 172.21.15.40:0/3748503775 >> 172.21.15.40:0/3748503775 conn(0x7f63080a41a0 msgr2=0x7f63080972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:49.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.675+0000 7f630e6cf700 1 -- 172.21.15.40:0/3748503775 shutdown_connections 2023-09-30T22:30:49.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.675+0000 7f630e6cf700 1 -- 172.21.15.40:0/3748503775 wait complete. 2023-09-30T22:30:49.056 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:49.057 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:49.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.803+0000 7f99a661e700 1 -- 172.21.15.40:0/1610390246 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f99a0138240 con 0x7f99a0130700 2023-09-30T22:30:49.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.803+0000 7f999cff9700 1 -- 172.21.15.40:0/1610390246 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9998022b00 con 0x7f99a0130700 2023-09-30T22:30:49.058 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:49.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.805+0000 7f99a661e700 1 -- 172.21.15.40:0/1610390246 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f99a0130700 msgr2=0x7f99a012bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:49.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.805+0000 7f99a661e700 1 --2- 172.21.15.40:0/1610390246 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f99a0130700 0x7f99a012bbf0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f9998007e40 tx=0x7f999800e3c0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.805+0000 7f99a661e700 1 -- 172.21.15.40:0/1610390246 shutdown_connections 2023-09-30T22:30:49.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.805+0000 7f99a661e700 1 --2- 172.21.15.40:0/1610390246 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f99a0130700 0x7f99a012bbf0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.805+0000 7f99a661e700 1 --2- 172.21.15.40:0/1610390246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99a009d450 0x7f99a012b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.805+0000 7f99a661e700 1 --2- 172.21.15.40:0/1610390246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99a009dd60 0x7f99a012b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.805+0000 7f99a661e700 1 -- 172.21.15.40:0/1610390246 >> 172.21.15.40:0/1610390246 conn(0x7f99a00a2a00 msgr2=0x7f99a00a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:49.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.806+0000 7f99a661e700 1 -- 172.21.15.40:0/1610390246 shutdown_connections 2023-09-30T22:30:49.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:48.806+0000 7f99a661e700 1 -- 172.21.15.40:0/1610390246 wait complete. 2023-09-30T22:30:49.061 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:49.632 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:49.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.781+0000 7fdd3a8a7700 1 Processor -- start 2023-09-30T22:30:49.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.781+0000 7fdd3a8a7700 1 -- start start 2023-09-30T22:30:49.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.782+0000 7fdd3a8a7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd3406f070 0x7fdd3406f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:49.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.782+0000 7fdd3a8a7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdd3406f980 0x7fdd34097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:49.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.782+0000 7fdd3a8a7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdd3406fdb0 0x7fdd340975d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:49.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.782+0000 7fdd3a8a7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd34070830 con 0x7fdd3406f980 2023-09-30T22:30:49.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.782+0000 7fdd3a8a7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd34070ad0 con 0x7fdd3406f070 2023-09-30T22:30:49.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.782+0000 7fdd3a8a7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd34070de0 con 0x7fdd3406fdb0 2023-09-30T22:30:49.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.782+0000 7fdd33fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd3406f070 0x7fdd3406f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:49.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.782+0000 7fdd33fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd3406f070 0x7fdd3406f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:44876/0 (socket says 172.21.15.40:44876) 2023-09-30T22:30:49.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.782+0000 7fdd33fff700 1 -- 172.21.15.40:0/3900878567 learned_addr learned my addr 172.21.15.40:0/3900878567 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:49.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.782+0000 7fdd337fe700 1 --2- 172.21.15.40:0/3900878567 >> v2:172.21.15.40:3300/0 conn(0x7fdd3406f980 0x7fdd34097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:49.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.782+0000 7fdd38e44700 1 --2- 172.21.15.40:0/3900878567 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdd3406fdb0 0x7fdd340975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:49.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.783+0000 7fdd33fff700 1 -- 172.21.15.40:0/3900878567 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdd3406fdb0 msgr2=0x7fdd340975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:49.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.783+0000 7fdd33fff700 1 --2- 172.21.15.40:0/3900878567 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdd3406fdb0 0x7fdd340975d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.783+0000 7fdd33fff700 1 -- 172.21.15.40:0/3900878567 >> v2:172.21.15.40:3300/0 conn(0x7fdd3406f980 msgr2=0x7fdd34097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:49.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.783+0000 7fdd33fff700 1 --2- 172.21.15.40:0/3900878567 >> v2:172.21.15.40:3300/0 conn(0x7fdd3406f980 0x7fdd34097090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.783+0000 7fdd33fff700 1 -- 172.21.15.40:0/3900878567 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd3409fe20 con 0x7fdd3406f070 2023-09-30T22:30:49.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.783+0000 7fdd337fe700 1 --2- 172.21.15.40:0/3900878567 >> v2:172.21.15.40:3300/0 conn(0x7fdd3406f980 0x7fdd34097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:49.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.783+0000 7fdd38e44700 1 --2- 172.21.15.40:0/3900878567 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdd3406fdb0 0x7fdd340975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:49.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.783+0000 7fdd33fff700 1 --2- 172.21.15.40:0/3900878567 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd3406f070 0x7fdd3406f440 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fdd240098f0 tx=0x7fdd24009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a299369ee73f994a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:49.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.783+0000 7fdd32ffd700 1 -- 172.21.15.40:0/3900878567 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd24011830 con 0x7fdd3406f070 2023-09-30T22:30:49.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.783+0000 7fdd32ffd700 1 -- 172.21.15.40:0/3900878567 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd24011990 con 0x7fdd3406f070 2023-09-30T22:30:49.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.783+0000 7fdd32ffd700 1 -- 172.21.15.40:0/3900878567 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd24011d20 con 0x7fdd3406f070 2023-09-30T22:30:49.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.784+0000 7fdd3a8a7700 1 -- 172.21.15.40:0/3900878567 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd3406f070 msgr2=0x7fdd3406f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:49.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.784+0000 7fdd3a8a7700 1 --2- 172.21.15.40:0/3900878567 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd3406f070 0x7fdd3406f440 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fdd240098f0 tx=0x7fdd24009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:49.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.784+0000 7fdd3a8a7700 1 -- 172.21.15.40:0/3900878567 shutdown_connections 2023-09-30T22:30:49.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.784+0000 7fdd3a8a7700 1 --2- 172.21.15.40:0/3900878567 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdd3406fdb0 0x7fdd340975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.784+0000 7fdd3a8a7700 1 --2- 172.21.15.40:0/3900878567 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd3406f070 0x7fdd3406f440 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.784+0000 7fdd3a8a7700 1 --2- 172.21.15.40:0/3900878567 >> v2:172.21.15.40:3300/0 conn(0x7fdd3406f980 0x7fdd34097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.784+0000 7fdd3a8a7700 1 -- 172.21.15.40:0/3900878567 >> 172.21.15.40:0/3900878567 conn(0x7fdd340a41a0 msgr2=0x7fdd340a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:49.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.784+0000 7fdd3a8a7700 1 -- 172.21.15.40:0/3900878567 shutdown_connections 2023-09-30T22:30:49.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.784+0000 7fdd3a8a7700 1 -- 172.21.15.40:0/3900878567 wait complete. 2023-09-30T22:30:49.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.785+0000 7fdd3a8a7700 1 Processor -- start 2023-09-30T22:30:49.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.785+0000 7fdd3a8a7700 1 -- start start 2023-09-30T22:30:49.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.785+0000 7fdd3a8a7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd3406f070 0x7fdd3412d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:49.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.785+0000 7fdd3a8a7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd3406f980 0x7fdd3412da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:49.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.785+0000 7fdd3a8a7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdd3406fdb0 0x7fdd3412dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:49.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.785+0000 7fdd3a8a7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd34130b00 con 0x7fdd3406f980 2023-09-30T22:30:49.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.785+0000 7fdd3a8a7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3412ebc0 con 0x7fdd3406f070 2023-09-30T22:30:49.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.785+0000 7fdd3a8a7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd34130480 con 0x7fdd3406fdb0 2023-09-30T22:30:49.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.785+0000 7fdd337fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd3406f980 0x7fdd3412da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:49.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.785+0000 7fdd38e44700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdd3406fdb0 0x7fdd3412dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:49.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.785+0000 7fdd33fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd3406f070 0x7fdd3412d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:49.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.785+0000 7fdd337fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd3406f980 0x7fdd3412da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43496/0 (socket says 172.21.15.40:43496) 2023-09-30T22:30:49.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.785+0000 7fdd337fe700 1 -- 172.21.15.40:0/1351675379 learned_addr learned my addr 172.21.15.40:0/1351675379 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:49.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.786+0000 7fdd337fe700 1 -- 172.21.15.40:0/1351675379 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdd3406fdb0 msgr2=0x7fdd3412dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:49.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.786+0000 7fdd337fe700 1 --2- 172.21.15.40:0/1351675379 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdd3406fdb0 0x7fdd3412dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.786+0000 7fdd337fe700 1 -- 172.21.15.40:0/1351675379 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd3406f070 msgr2=0x7fdd3412d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:49.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.786+0000 7fdd337fe700 1 --2- 172.21.15.40:0/1351675379 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd3406f070 0x7fdd3412d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:49.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.786+0000 7fdd337fe700 1 -- 172.21.15.40:0/1351675379 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1c0094a0 con 0x7fdd3406f980 2023-09-30T22:30:49.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.786+0000 7fdd33fff700 1 --2- 172.21.15.40:0/1351675379 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd3406f070 0x7fdd3412d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:49.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.786+0000 7fdd337fe700 1 --2- 172.21.15.40:0/1351675379 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd3406f980 0x7fdd3412da70 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c010ec0 tx=0x7fdd1c00b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:49.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.786+0000 7fdd30ff9700 1 -- 172.21.15.40:0/1351675379 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c015070 con 0x7fdd3406f980 2023-09-30T22:30:49.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.786+0000 7fdd30ff9700 1 -- 172.21.15.40:0/1351675379 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1c00bc40 con 0x7fdd3406f980 2023-09-30T22:30:49.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.786+0000 7fdd3a8a7700 1 -- 172.21.15.40:0/1351675379 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd2c009a70 con 0x7fdd3406f980 2023-09-30T22:30:49.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.786+0000 7fdd30ff9700 1 -- 172.21.15.40:0/1351675379 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c009ea0 con 0x7fdd3406f980 2023-09-30T22:30:49.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.786+0000 7fdd3a8a7700 1 -- 172.21.15.40:0/1351675379 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd24009550 con 0x7fdd3406f980 2023-09-30T22:30:49.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.787+0000 7fdd30ff9700 1 -- 172.21.15.40:0/1351675379 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdd1c019410 con 0x7fdd3406f980 2023-09-30T22:30:49.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.787+0000 7fdd3a8a7700 1 -- 172.21.15.40:0/1351675379 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd34062380 con 0x7fdd3406f980 2023-09-30T22:30:49.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.787+0000 7fdd30ff9700 1 -- 172.21.15.40:0/1351675379 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fdd1c043070 con 0x7fdd3406f980 2023-09-30T22:30:49.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.792+0000 7fdd30ff9700 1 -- 172.21.15.40:0/1351675379 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdd1c01e020 con 0x7fdd3406f980 2023-09-30T22:30:49.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.987+0000 7fdd3a8a7700 1 -- 172.21.15.40:0/1351675379 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdd340008d0 con 0x7fdd3406f980 2023-09-30T22:30:50.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.987+0000 7fdd30ff9700 1 -- 172.21.15.40:0/1351675379 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdd1c02b070 con 0x7fdd3406f980 2023-09-30T22:30:50.225 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:50.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.989+0000 7fdd3a8a7700 1 -- 172.21.15.40:0/1351675379 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd3406f980 msgr2=0x7fdd3412da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:50.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.989+0000 7fdd3a8a7700 1 --2- 172.21.15.40:0/1351675379 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd3406f980 0x7fdd3412da70 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c010ec0 tx=0x7fdd1c00b420 comp rx=0 tx=0).stop 2023-09-30T22:30:50.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.989+0000 7fdd3a8a7700 1 -- 172.21.15.40:0/1351675379 shutdown_connections 2023-09-30T22:30:50.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.989+0000 7fdd3a8a7700 1 --2- 172.21.15.40:0/1351675379 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdd3406fdb0 0x7fdd3412dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:50.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.989+0000 7fdd3a8a7700 1 --2- 172.21.15.40:0/1351675379 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdd3406f070 0x7fdd3412d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:50.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.989+0000 7fdd3a8a7700 1 --2- 172.21.15.40:0/1351675379 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd3406f980 0x7fdd3412da70 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:50.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.989+0000 7fdd3a8a7700 1 -- 172.21.15.40:0/1351675379 >> 172.21.15.40:0/1351675379 conn(0x7fdd340a41a0 msgr2=0x7fdd340972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:50.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.990+0000 7fdd3a8a7700 1 -- 172.21.15.40:0/1351675379 shutdown_connections 2023-09-30T22:30:50.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:49.990+0000 7fdd3a8a7700 1 -- 172.21.15.40:0/1351675379 wait complete. 2023-09-30T22:30:50.227 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:50.227 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:50.228 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:50.228 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:50.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.360+0000 7f3daf1f3700 1 Processor -- start 2023-09-30T22:30:50.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.360+0000 7f3daf1f3700 1 -- start start 2023-09-30T22:30:51.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.361+0000 7f3daf1f3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3da809e400 0x7f3da8135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.361+0000 7f3daf1f3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3da8136230 0x7f3da8138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.361+0000 7f3daf1f3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da809adf0 con 0x7f3da809d920 2023-09-30T22:30:51.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.361+0000 7f3daf1f3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da809e7f0 con 0x7f3da8136230 2023-09-30T22:30:51.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.361+0000 7f3daf1f3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da809edf0 con 0x7f3da809e400 2023-09-30T22:30:51.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.361+0000 7f3da7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3da809e400 0x7f3da8135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.361+0000 7f3da7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3da809e400 0x7f3da8135cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:44886/0 (socket says 172.21.15.40:44886) 2023-09-30T22:30:51.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.361+0000 7f3da7fff700 1 -- 172.21.15.40:0/3799310526 learned_addr learned my addr 172.21.15.40:0/3799310526 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:51.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.361+0000 7f3dacf8f700 1 --1- 172.21.15.40:0/3799310526 >> v1:172.21.15.40:6789/0 conn(0x7f3da809d920 0x7f3da809dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52042/0 (socket says 172.21.15.40:52042) 2023-09-30T22:30:51.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.361+0000 7f3dad790700 1 --2- 172.21.15.40:0/3799310526 >> v2:172.21.15.40:3300/0 conn(0x7f3da8136230 0x7f3da8138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.361+0000 7f3da7fff700 1 -- 172.21.15.40:0/3799310526 >> v2:172.21.15.40:3300/0 conn(0x7f3da8136230 msgr2=0x7f3da8138610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:51.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.361+0000 7f3da7fff700 1 --2- 172.21.15.40:0/3799310526 >> v2:172.21.15.40:3300/0 conn(0x7f3da8136230 0x7f3da8138610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.361+0000 7f3da7fff700 1 -- 172.21.15.40:0/3799310526 >> v1:172.21.15.40:6789/0 conn(0x7f3da809d920 legacy=0x7f3da809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:51.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.361+0000 7f3da7fff700 1 -- 172.21.15.40:0/3799310526 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da809b660 con 0x7f3da809e400 2023-09-30T22:30:51.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.361+0000 7f3da7fff700 1 --2- 172.21.15.40:0/3799310526 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3da809e400 0x7f3da8135cf0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f3d9400bb90 tx=0x7f3d9400bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2adbe251685fcf52 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:51.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.361+0000 7f3da77fe700 1 -- 172.21.15.40:0/3799310526 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9400dd30 con 0x7f3da809e400 2023-09-30T22:30:51.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.362+0000 7f3da77fe700 1 -- 172.21.15.40:0/3799310526 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9400de90 con 0x7f3da809e400 2023-09-30T22:30:51.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.362+0000 7f3da77fe700 1 -- 172.21.15.40:0/3799310526 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d94010690 con 0x7f3da809e400 2023-09-30T22:30:51.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.362+0000 7f3daf1f3700 1 -- 172.21.15.40:0/3799310526 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3da809e400 msgr2=0x7f3da8135cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:51.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.362+0000 7f3daf1f3700 1 --2- 172.21.15.40:0/3799310526 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3da809e400 0x7f3da8135cf0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f3d9400bb90 tx=0x7f3d9400bea0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.362+0000 7f3daf1f3700 1 -- 172.21.15.40:0/3799310526 shutdown_connections 2023-09-30T22:30:51.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.362+0000 7f3daf1f3700 1 --2- 172.21.15.40:0/3799310526 >> v2:172.21.15.40:3300/0 conn(0x7f3da8136230 0x7f3da8138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.362+0000 7f3daf1f3700 1 --2- 172.21.15.40:0/3799310526 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3da809e400 0x7f3da8135cf0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.362+0000 7f3daf1f3700 1 -- 172.21.15.40:0/3799310526 >> 172.21.15.40:0/3799310526 conn(0x7f3da809fb20 msgr2=0x7f3da809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:51.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.362+0000 7f3daf1f3700 1 -- 172.21.15.40:0/3799310526 shutdown_connections 2023-09-30T22:30:51.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.362+0000 7f3daf1f3700 1 -- 172.21.15.40:0/3799310526 wait complete. 2023-09-30T22:30:51.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.364+0000 7f3daf1f3700 1 Processor -- start 2023-09-30T22:30:51.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.364+0000 7f3daf1f3700 1 -- start start 2023-09-30T22:30:51.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.364+0000 7f3daf1f3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3da809d920 0x7f3da8122950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.364+0000 7f3daf1f3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3da809e400 0x7f3da8122e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.364+0000 7f3daf1f3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3da8136230 0x7f3da81233d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.365+0000 7f3daf1f3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da8126190 con 0x7f3da809d920 2023-09-30T22:30:51.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.365+0000 7f3daf1f3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da8124670 con 0x7f3da809e400 2023-09-30T22:30:51.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.365+0000 7f3daf1f3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3da8124b10 con 0x7f3da8136230 2023-09-30T22:30:51.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.365+0000 7f3dacf8f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3da809d920 0x7f3da8122950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.365+0000 7f3da7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3da809e400 0x7f3da8122e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.365+0000 7f3dacf8f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3da809d920 0x7f3da8122950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43512/0 (socket says 172.21.15.40:43512) 2023-09-30T22:30:51.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.365+0000 7f3dacf8f700 1 -- 172.21.15.40:0/3902947604 learned_addr learned my addr 172.21.15.40:0/3902947604 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:51.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.365+0000 7f3da7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3da809e400 0x7f3da8122e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:44896/0 (socket says 172.21.15.40:44896) 2023-09-30T22:30:51.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.365+0000 7f3dad790700 1 --2- 172.21.15.40:0/3902947604 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3da8136230 0x7f3da81233d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.365+0000 7f3dad790700 1 -- 172.21.15.40:0/3902947604 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3da809e400 msgr2=0x7f3da8122e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:51.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.365+0000 7f3dad790700 1 --2- 172.21.15.40:0/3902947604 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3da809e400 0x7f3da8122e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.365+0000 7f3dad790700 1 -- 172.21.15.40:0/3902947604 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3da809d920 msgr2=0x7f3da8122950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:51.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.365+0000 7f3dad790700 1 --2- 172.21.15.40:0/3902947604 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3da809d920 0x7f3da8122950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.365+0000 7f3dad790700 1 -- 172.21.15.40:0/3902947604 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9400b7f0 con 0x7f3da8136230 2023-09-30T22:30:51.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.365+0000 7f3dad790700 1 --2- 172.21.15.40:0/3902947604 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3da8136230 0x7f3da81233d0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f3da0009d90 tx=0x7f3da000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:51.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.365+0000 7f3da57fa700 1 -- 172.21.15.40:0/3902947604 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da0009c00 con 0x7f3da8136230 2023-09-30T22:30:51.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.365+0000 7f3da57fa700 1 -- 172.21.15.40:0/3902947604 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da000f040 con 0x7f3da8136230 2023-09-30T22:30:51.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.365+0000 7f3daf1f3700 1 -- 172.21.15.40:0/3902947604 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da80a3f10 con 0x7f3da8136230 2023-09-30T22:30:51.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.365+0000 7f3da57fa700 1 -- 172.21.15.40:0/3902947604 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da0014480 con 0x7f3da8136230 2023-09-30T22:30:51.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.365+0000 7f3daf1f3700 1 -- 172.21.15.40:0/3902947604 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da8126470 con 0x7f3da8136230 2023-09-30T22:30:51.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.367+0000 7f3daf1f3700 1 -- 172.21.15.40:0/3902947604 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da809a660 con 0x7f3da8136230 2023-09-30T22:30:51.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.367+0000 7f3da57fa700 1 -- 172.21.15.40:0/3902947604 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3da00145e0 con 0x7f3da8136230 2023-09-30T22:30:51.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.368+0000 7f3da57fa700 1 -- 172.21.15.40:0/3902947604 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3da00407c0 con 0x7f3da8136230 2023-09-30T22:30:51.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.376+0000 7f3da57fa700 1 -- 172.21.15.40:0/3902947604 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3da0012930 con 0x7f3da8136230 2023-09-30T22:30:51.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.383+0000 7f802b742700 1 Processor -- start 2023-09-30T22:30:51.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.383+0000 7f802b742700 1 -- start start 2023-09-30T22:30:51.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.383+0000 7f802b742700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f802409d920 0x7f802409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.383+0000 7f802b742700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f802409e230 0x7f80241343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.383+0000 7f802b742700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f802409f940 con 0x7f802409f0f0 2023-09-30T22:30:51.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.383+0000 7f802b742700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f802406b4c0 con 0x7f802409e230 2023-09-30T22:30:51.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.383+0000 7f802b742700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f802409a8f0 con 0x7f802409d920 2023-09-30T22:30:51.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.384+0000 7f80294de700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f802409d920 0x7f802409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.384+0000 7f8029cdf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f802409e230 0x7f80241343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.384+0000 7f80294de700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f802409d920 0x7f802409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56594/0 (socket says 172.21.15.40:56594) 2023-09-30T22:30:51.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.384+0000 7f80294de700 1 -- 172.21.15.40:0/1434734838 learned_addr learned my addr 172.21.15.40:0/1434734838 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:51.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.384+0000 7f80294de700 1 -- 172.21.15.40:0/1434734838 >> v2:172.21.15.40:3300/0 conn(0x7f802409e230 msgr2=0x7f80241343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:51.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.384+0000 7f80294de700 1 --2- 172.21.15.40:0/1434734838 >> v2:172.21.15.40:3300/0 conn(0x7f802409e230 0x7f80241343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.384+0000 7f80294de700 1 -- 172.21.15.40:0/1434734838 >> v1:172.21.15.40:6789/0 conn(0x7f802409f0f0 legacy=0x7f8024133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:51.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.384+0000 7f80294de700 1 -- 172.21.15.40:0/1434734838 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802409f6e0 con 0x7f802409d920 2023-09-30T22:30:51.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.384+0000 7f80294de700 1 --2- 172.21.15.40:0/1434734838 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f802409d920 0x7f802409dcf0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f8020006fd0 tx=0x7f8020009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=322fe794855aa534 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:51.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.384+0000 7f801bfff700 1 -- 172.21.15.40:0/1434734838 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8020005e30 con 0x7f802409d920 2023-09-30T22:30:51.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.384+0000 7f801bfff700 1 -- 172.21.15.40:0/1434734838 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8020004030 con 0x7f802409d920 2023-09-30T22:30:51.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.384+0000 7f801bfff700 1 -- 172.21.15.40:0/1434734838 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80200043e0 con 0x7f802409d920 2023-09-30T22:30:51.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.385+0000 7f802b742700 1 -- 172.21.15.40:0/1434734838 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f802409d920 msgr2=0x7f802409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:51.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.385+0000 7f802b742700 1 --2- 172.21.15.40:0/1434734838 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f802409d920 0x7f802409dcf0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f8020006fd0 tx=0x7f8020009bd0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.385+0000 7f802b742700 1 -- 172.21.15.40:0/1434734838 shutdown_connections 2023-09-30T22:30:51.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.385+0000 7f802b742700 1 --2- 172.21.15.40:0/1434734838 >> v2:172.21.15.40:3300/0 conn(0x7f802409e230 0x7f80241343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.385+0000 7f802b742700 1 --2- 172.21.15.40:0/1434734838 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f802409d920 0x7f802409dcf0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.385+0000 7f802b742700 1 -- 172.21.15.40:0/1434734838 >> 172.21.15.40:0/1434734838 conn(0x7f802409fb20 msgr2=0x7f802409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:51.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.385+0000 7f802b742700 1 -- 172.21.15.40:0/1434734838 shutdown_connections 2023-09-30T22:30:51.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.385+0000 7f802b742700 1 -- 172.21.15.40:0/1434734838 wait complete. 2023-09-30T22:30:51.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.387+0000 7f802b742700 1 Processor -- start 2023-09-30T22:30:51.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.387+0000 7f802b742700 1 -- start start 2023-09-30T22:30:51.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.387+0000 7f802b742700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f802409d920 0x7f80241a60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.387+0000 7f802b742700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f802409e230 0x7f80241a65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.387+0000 7f802b742700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f80241b94a0 0x7f80241a6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.387+0000 7f802b742700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80241aa590 con 0x7f802409d920 2023-09-30T22:30:51.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.387+0000 7f802b742700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80241a9bd0 con 0x7f802409e230 2023-09-30T22:30:51.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.387+0000 7f802b742700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80241a8f10 con 0x7f80241b94a0 2023-09-30T22:30:51.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.387+0000 7f8028cdd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f802409e230 0x7f80241a65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.387+0000 7f80294de700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f802409d920 0x7f80241a60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.387+0000 7f8028cdd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f802409e230 0x7f80241a65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:44908/0 (socket says 172.21.15.40:44908) 2023-09-30T22:30:51.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.387+0000 7f8028cdd700 1 -- 172.21.15.40:0/4242086766 learned_addr learned my addr 172.21.15.40:0/4242086766 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:51.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.387+0000 7f80294de700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f802409d920 0x7f80241a60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43540/0 (socket says 172.21.15.40:43540) 2023-09-30T22:30:51.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.388+0000 7f8029cdf700 1 --2- 172.21.15.40:0/4242086766 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f80241b94a0 0x7f80241a6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.388+0000 7f8028cdd700 1 -- 172.21.15.40:0/4242086766 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f80241b94a0 msgr2=0x7f80241a6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:51.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.388+0000 7f8028cdd700 1 --2- 172.21.15.40:0/4242086766 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f80241b94a0 0x7f80241a6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.388+0000 7f8028cdd700 1 -- 172.21.15.40:0/4242086766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f802409d920 msgr2=0x7f80241a60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:51.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.388+0000 7f8028cdd700 1 --2- 172.21.15.40:0/4242086766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f802409d920 0x7f80241a60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.388+0000 7f8028cdd700 1 -- 172.21.15.40:0/4242086766 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8020009500 con 0x7f802409e230 2023-09-30T22:30:51.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.388+0000 7f80294de700 1 --2- 172.21.15.40:0/4242086766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f802409d920 0x7f80241a60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:51.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.388+0000 7f8028cdd700 1 --2- 172.21.15.40:0/4242086766 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f802409e230 0x7f80241a65f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f801400c4b0 tx=0x7f801400c7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:51.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.388+0000 7f8019ffb700 1 -- 172.21.15.40:0/4242086766 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80140052d0 con 0x7f802409e230 2023-09-30T22:30:51.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.388+0000 7f8019ffb700 1 -- 172.21.15.40:0/4242086766 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8014005430 con 0x7f802409e230 2023-09-30T22:30:51.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.388+0000 7f8019ffb700 1 -- 172.21.15.40:0/4242086766 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80140038c0 con 0x7f802409e230 2023-09-30T22:30:51.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.388+0000 7f24296a0700 1 Processor -- start 2023-09-30T22:30:51.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.389+0000 7f24296a0700 1 -- start start 2023-09-30T22:30:51.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.389+0000 7f802b742700 1 -- 172.21.15.40:0/4242086766 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80240a3630 con 0x7f802409e230 2023-09-30T22:30:51.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.389+0000 7f24296a0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f242409d920 0x7f242409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.389+0000 7f24296a0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f242409f0f0 0x7f242409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.389+0000 7f24296a0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2424133ca0 0x7f2424134110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.389+0000 7f24296a0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f242406b4c0 con 0x7f242409d920 2023-09-30T22:30:51.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.389+0000 7f24296a0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f242409a8f0 con 0x7f2424133ca0 2023-09-30T22:30:51.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.389+0000 7f24296a0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f242409f940 con 0x7f242409f0f0 2023-09-30T22:30:51.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.389+0000 7f802b742700 1 -- 172.21.15.40:0/4242086766 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80241a7cc0 con 0x7f802409e230 2023-09-30T22:30:51.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.389+0000 7f2422ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f242409d920 0x7f242409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.389+0000 7f2422ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f242409d920 0x7f242409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43554/0 (socket says 172.21.15.40:43554) 2023-09-30T22:30:51.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.389+0000 7f2422ffd700 1 -- 172.21.15.40:0/3145391874 learned_addr learned my addr 172.21.15.40:0/3145391874 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:51.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.389+0000 7f24227fc700 1 --2- 172.21.15.40:0/3145391874 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f242409f0f0 0x7f242409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.389+0000 7f24237fe700 1 --2- 172.21.15.40:0/3145391874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2424133ca0 0x7f2424134110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.390+0000 7f2422ffd700 1 -- 172.21.15.40:0/3145391874 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f242409f0f0 msgr2=0x7f242409e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:51.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.390+0000 7f2422ffd700 1 --2- 172.21.15.40:0/3145391874 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f242409f0f0 0x7f242409e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.390+0000 7f2422ffd700 1 -- 172.21.15.40:0/3145391874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2424133ca0 msgr2=0x7f2424134110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:51.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.390+0000 7f2422ffd700 1 --2- 172.21.15.40:0/3145391874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2424133ca0 0x7f2424134110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.390+0000 7f2422ffd700 1 -- 172.21.15.40:0/3145391874 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f242409f6e0 con 0x7f242409d920 2023-09-30T22:30:51.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.390+0000 7f8019ffb700 1 -- 172.21.15.40:0/4242086766 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8014003a20 con 0x7f802409e230 2023-09-30T22:30:51.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.390+0000 7f2422ffd700 1 --2- 172.21.15.40:0/3145391874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f242409d920 0x7f242409dcf0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f24140098f0 tx=0x7f2414009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7787301f3ab5ca75 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:51.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.390+0000 7f2421ffb700 1 -- 172.21.15.40:0/3145391874 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2414014e90 con 0x7f242409d920 2023-09-30T22:30:51.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.390+0000 7f2421ffb700 1 -- 172.21.15.40:0/3145391874 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2414005a20 con 0x7f242409d920 2023-09-30T22:30:51.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.390+0000 7f2421ffb700 1 -- 172.21.15.40:0/3145391874 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2414005dd0 con 0x7f242409d920 2023-09-30T22:30:51.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.390+0000 7f8019ffb700 1 -- 172.21.15.40:0/4242086766 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f801403ea50 con 0x7f802409e230 2023-09-30T22:30:51.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.390+0000 7f802b742700 1 -- 172.21.15.40:0/4242086766 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80241a9770 con 0x7f802409e230 2023-09-30T22:30:51.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.391+0000 7f24296a0700 1 -- 172.21.15.40:0/3145391874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f242409d920 msgr2=0x7f242409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:51.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.391+0000 7f24296a0700 1 --2- 172.21.15.40:0/3145391874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f242409d920 0x7f242409dcf0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f24140098f0 tx=0x7f2414009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:51.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.391+0000 7f24296a0700 1 -- 172.21.15.40:0/3145391874 shutdown_connections 2023-09-30T22:30:51.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.391+0000 7f24296a0700 1 --2- 172.21.15.40:0/3145391874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2424133ca0 0x7f2424134110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.391+0000 7f24296a0700 1 --2- 172.21.15.40:0/3145391874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f242409d920 0x7f242409dcf0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.391+0000 7f24296a0700 1 --2- 172.21.15.40:0/3145391874 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f242409f0f0 0x7f242409e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.391+0000 7f24296a0700 1 -- 172.21.15.40:0/3145391874 >> 172.21.15.40:0/3145391874 conn(0x7f242409fb20 msgr2=0x7f242409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:51.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.391+0000 7f24296a0700 1 -- 172.21.15.40:0/3145391874 shutdown_connections 2023-09-30T22:30:51.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.391+0000 7f24296a0700 1 -- 172.21.15.40:0/3145391874 wait complete. 2023-09-30T22:30:51.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.392+0000 7f24296a0700 1 Processor -- start 2023-09-30T22:30:51.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.392+0000 7f24296a0700 1 -- start start 2023-09-30T22:30:51.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.392+0000 7f24296a0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f242409d920 0x7f242411e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.393+0000 7f24296a0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2424133ca0 0x7f242411e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.393+0000 7f24296a0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f242411edf0 0x7f24241ca560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.393+0000 7f24296a0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24241205b0 con 0x7f242411edf0 2023-09-30T22:30:51.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.393+0000 7f24296a0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f242409c9e0 con 0x7f2424133ca0 2023-09-30T22:30:51.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.393+0000 7f24296a0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24240a2c90 con 0x7f242409d920 2023-09-30T22:30:51.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.393+0000 7f24227fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2424133ca0 0x7f242411e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.393+0000 7f24227fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2424133ca0 0x7f242411e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:44930/0 (socket says 172.21.15.40:44930) 2023-09-30T22:30:51.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.393+0000 7f24227fc700 1 -- 172.21.15.40:0/1824883126 learned_addr learned my addr 172.21.15.40:0/1824883126 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:51.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.393+0000 7f24237fe700 1 --2- 172.21.15.40:0/1824883126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f242411edf0 0x7f24241ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.393+0000 7f24237fe700 1 -- 172.21.15.40:0/1824883126 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f242409d920 msgr2=0x7f242411e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:51.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.393+0000 7f24237fe700 1 --2- 172.21.15.40:0/1824883126 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f242409d920 0x7f242411e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.393+0000 7f24237fe700 1 -- 172.21.15.40:0/1824883126 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2424133ca0 msgr2=0x7f242411e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:51.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.393+0000 7f24237fe700 1 --2- 172.21.15.40:0/1824883126 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2424133ca0 0x7f242411e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.393+0000 7f24237fe700 1 -- 172.21.15.40:0/1824883126 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2414009500 con 0x7f242411edf0 2023-09-30T22:30:51.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.393+0000 7f24227fc700 1 --2- 172.21.15.40:0/1824883126 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2424133ca0 0x7f242411e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:51.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.393+0000 7f24237fe700 1 --2- 172.21.15.40:0/1824883126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f242411edf0 0x7f24241ca560 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f241c00efc0 tx=0x7f241c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:51.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.393+0000 7f240b7fe700 1 -- 172.21.15.40:0/1824883126 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c00cd40 con 0x7f242411edf0 2023-09-30T22:30:51.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.394+0000 7f24296a0700 1 -- 172.21.15.40:0/1824883126 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2424121620 con 0x7f242411edf0 2023-09-30T22:30:51.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.393+0000 7f240b7fe700 1 -- 172.21.15.40:0/1824883126 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241c00f040 con 0x7f242411edf0 2023-09-30T22:30:51.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.394+0000 7f240b7fe700 1 -- 172.21.15.40:0/1824883126 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c0146c0 con 0x7f242411edf0 2023-09-30T22:30:51.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.394+0000 7f24296a0700 1 -- 172.21.15.40:0/1824883126 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2424120770 con 0x7f242411edf0 2023-09-30T22:30:51.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.394+0000 7f24296a0700 1 -- 172.21.15.40:0/1824883126 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24241217e0 con 0x7f242411edf0 2023-09-30T22:30:51.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.395+0000 7f240b7fe700 1 -- 172.21.15.40:0/1824883126 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f241c014820 con 0x7f242411edf0 2023-09-30T22:30:51.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.395+0000 7f240b7fe700 1 -- 172.21.15.40:0/1824883126 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f241c040810 con 0x7f242411edf0 2023-09-30T22:30:51.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.396+0000 7f8019ffb700 1 -- 172.21.15.40:0/4242086766 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8014017080 con 0x7f802409e230 2023-09-30T22:30:51.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.404+0000 7f240b7fe700 1 -- 172.21.15.40:0/1824883126 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f241c012930 con 0x7f242411edf0 2023-09-30T22:30:51.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.581+0000 7f3daf1f3700 1 -- 172.21.15.40:0/3902947604 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3da81262d0 con 0x7f3da8136230 2023-09-30T22:30:51.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.582+0000 7f3da57fa700 1 -- 172.21.15.40:0/3902947604 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3da81262d0 con 0x7f3da8136230 2023-09-30T22:30:51.080 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:51.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.584+0000 7f3daf1f3700 1 -- 172.21.15.40:0/3902947604 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3da8136230 msgr2=0x7f3da81233d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:51.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.584+0000 7f3daf1f3700 1 --2- 172.21.15.40:0/3902947604 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3da8136230 0x7f3da81233d0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f3da0009d90 tx=0x7f3da000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.584+0000 7f3daf1f3700 1 -- 172.21.15.40:0/3902947604 shutdown_connections 2023-09-30T22:30:51.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.584+0000 7f3daf1f3700 1 --2- 172.21.15.40:0/3902947604 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3da8136230 0x7f3da81233d0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.584+0000 7f3daf1f3700 1 --2- 172.21.15.40:0/3902947604 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3da809d920 0x7f3da8122950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.584+0000 7f3daf1f3700 1 --2- 172.21.15.40:0/3902947604 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3da809e400 0x7f3da8122e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.584+0000 7f3daf1f3700 1 -- 172.21.15.40:0/3902947604 >> 172.21.15.40:0/3902947604 conn(0x7f3da809fb20 msgr2=0x7f3da80a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:51.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.584+0000 7f3daf1f3700 1 -- 172.21.15.40:0/3902947604 shutdown_connections 2023-09-30T22:30:51.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.584+0000 7f3daf1f3700 1 -- 172.21.15.40:0/3902947604 wait complete. 2023-09-30T22:30:51.083 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:51.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.598+0000 7f802b742700 1 -- 172.21.15.40:0/4242086766 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8024062380 con 0x7f802409e230 2023-09-30T22:30:51.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.598+0000 7f8019ffb700 1 -- 172.21.15.40:0/4242086766 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f80140192c0 con 0x7f802409e230 2023-09-30T22:30:51.083 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:51.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.600+0000 7f802b742700 1 -- 172.21.15.40:0/4242086766 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f802409e230 msgr2=0x7f80241a65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:51.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.600+0000 7f802b742700 1 --2- 172.21.15.40:0/4242086766 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f802409e230 0x7f80241a65f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f801400c4b0 tx=0x7f801400c7c0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.600+0000 7f802b742700 1 -- 172.21.15.40:0/4242086766 shutdown_connections 2023-09-30T22:30:51.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.600+0000 7f802b742700 1 --2- 172.21.15.40:0/4242086766 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f80241b94a0 0x7f80241a6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.600+0000 7f802b742700 1 --2- 172.21.15.40:0/4242086766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f802409d920 0x7f80241a60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.600+0000 7f802b742700 1 --2- 172.21.15.40:0/4242086766 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f802409e230 0x7f80241a65f0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.600+0000 7f802b742700 1 -- 172.21.15.40:0/4242086766 >> 172.21.15.40:0/4242086766 conn(0x7f802409fb20 msgr2=0x7f80241bb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:51.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.600+0000 7f802b742700 1 -- 172.21.15.40:0/4242086766 shutdown_connections 2023-09-30T22:30:51.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.600+0000 7f802b742700 1 -- 172.21.15.40:0/4242086766 wait complete. 2023-09-30T22:30:51.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.608+0000 7f24296a0700 1 -- 172.21.15.40:0/1824883126 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2424062380 con 0x7f242411edf0 2023-09-30T22:30:51.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.609+0000 7f240b7fe700 1 -- 172.21.15.40:0/1824883126 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f241c02a030 con 0x7f242411edf0 2023-09-30T22:30:51.086 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:51.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.611+0000 7f24296a0700 1 -- 172.21.15.40:0/1824883126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f242411edf0 msgr2=0x7f24241ca560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:51.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.611+0000 7f24296a0700 1 --2- 172.21.15.40:0/1824883126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f242411edf0 0x7f24241ca560 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f241c00efc0 tx=0x7f241c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.611+0000 7f24296a0700 1 -- 172.21.15.40:0/1824883126 shutdown_connections 2023-09-30T22:30:51.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.611+0000 7f24296a0700 1 --2- 172.21.15.40:0/1824883126 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f242409d920 0x7f242411e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.611+0000 7f24296a0700 1 --2- 172.21.15.40:0/1824883126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f242411edf0 0x7f24241ca560 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.611+0000 7f24296a0700 1 --2- 172.21.15.40:0/1824883126 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2424133ca0 0x7f242411e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.611+0000 7f24296a0700 1 -- 172.21.15.40:0/1824883126 >> 172.21.15.40:0/1824883126 conn(0x7f242409fb20 msgr2=0x7f24240a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:51.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.611+0000 7f24296a0700 1 -- 172.21.15.40:0/1824883126 shutdown_connections 2023-09-30T22:30:51.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:50.611+0000 7f24296a0700 1 -- 172.21.15.40:0/1824883126 wait complete. 2023-09-30T22:30:51.088 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:51.089 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:51.228 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:51.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.368+0000 7f5db9d7a700 1 Processor -- start 2023-09-30T22:30:51.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.369+0000 7f5db9d7a700 1 -- start start 2023-09-30T22:30:51.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.369+0000 7f5db9d7a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5db4136bf0 0x7f5db4138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.369+0000 7f5db9d7a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5db4139510 0x7f5db413b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.369+0000 7f5db9d7a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5db40a2600 con 0x7f5db409c890 2023-09-30T22:30:51.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.369+0000 7f5db9d7a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db40a29d0 con 0x7f5db4136bf0 2023-09-30T22:30:51.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.369+0000 7f5db9d7a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5db409fb40 con 0x7f5db4139510 2023-09-30T22:30:51.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.369+0000 7f5db2ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5db4136bf0 0x7f5db4138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.369+0000 7f5db3fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5db4139510 0x7f5db413b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.369+0000 7f5db37fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5db409c890 0x7f5db409cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52046/0 (socket says 172.21.15.40:52046) 2023-09-30T22:30:51.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.369+0000 7f5db37fe700 1 -- 172.21.15.40:0/3402060888 learned_addr learned my addr 172.21.15.40:0/3402060888 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:51.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.369+0000 7f5db2ffd700 1 -- 172.21.15.40:0/3402060888 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5db4139510 msgr2=0x7f5db413b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:51.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.369+0000 7f5db2ffd700 1 --2- 172.21.15.40:0/3402060888 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5db4139510 0x7f5db413b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.369+0000 7f5db27fc700 1 -- 172.21.15.40:0/3402060888 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1652580627 0 0) 0x7f5db40a2600 con 0x7f5db409c890 2023-09-30T22:30:51.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.369+0000 7f5db2ffd700 1 -- 172.21.15.40:0/3402060888 >> v1:172.21.15.40:6789/0 conn(0x7f5db409c890 legacy=0x7f5db409cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:51.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.369+0000 7f5db2ffd700 1 -- 172.21.15.40:0/3402060888 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db409d370 con 0x7f5db4136bf0 2023-09-30T22:30:51.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.370+0000 7f5db2ffd700 1 --2- 172.21.15.40:0/3402060888 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5db4136bf0 0x7f5db4138fd0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f5da8009870 tx=0x7f5da8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24963489f04e76b8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:51.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.370+0000 7f5db27fc700 1 -- 172.21.15.40:0/3402060888 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da8011830 con 0x7f5db4136bf0 2023-09-30T22:30:51.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.370+0000 7f5db27fc700 1 -- 172.21.15.40:0/3402060888 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da8011990 con 0x7f5db4136bf0 2023-09-30T22:30:51.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.370+0000 7f5db27fc700 1 -- 172.21.15.40:0/3402060888 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da8011d20 con 0x7f5db4136bf0 2023-09-30T22:30:51.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.370+0000 7f5db9d7a700 1 -- 172.21.15.40:0/3402060888 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5db4136bf0 msgr2=0x7f5db4138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:51.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.370+0000 7f5db9d7a700 1 --2- 172.21.15.40:0/3402060888 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5db4136bf0 0x7f5db4138fd0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f5da8009870 tx=0x7f5da8009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:51.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.370+0000 7f5db9d7a700 1 -- 172.21.15.40:0/3402060888 shutdown_connections 2023-09-30T22:30:51.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.370+0000 7f5db9d7a700 1 --2- 172.21.15.40:0/3402060888 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5db4139510 0x7f5db413b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.370+0000 7f5db9d7a700 1 --2- 172.21.15.40:0/3402060888 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5db4136bf0 0x7f5db4138fd0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.370+0000 7f5db9d7a700 1 -- 172.21.15.40:0/3402060888 >> 172.21.15.40:0/3402060888 conn(0x7f5db40a7080 msgr2=0x7f5db40a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:51.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.370+0000 7f5db9d7a700 1 -- 172.21.15.40:0/3402060888 shutdown_connections 2023-09-30T22:30:51.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.370+0000 7f5db9d7a700 1 -- 172.21.15.40:0/3402060888 wait complete. 2023-09-30T22:30:51.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.371+0000 7f5db9d7a700 1 Processor -- start 2023-09-30T22:30:51.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.372+0000 7f5db9d7a700 1 -- start start 2023-09-30T22:30:51.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.372+0000 7f5db9d7a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5db409c890 0x7f5db406efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.372+0000 7f5db9d7a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5db4136bf0 0x7f5db406f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.372+0000 7f5db9d7a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5db4139510 0x7f5db406fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:51.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.372+0000 7f5db9d7a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db412b4e0 con 0x7f5db409c890 2023-09-30T22:30:51.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.372+0000 7f5db9d7a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db4070b10 con 0x7f5db4139510 2023-09-30T22:30:51.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.372+0000 7f5db9d7a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5db40a5ef0 con 0x7f5db4136bf0 2023-09-30T22:30:51.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.372+0000 7f5db37fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5db409c890 0x7f5db406efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.372+0000 7f5db37fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5db409c890 0x7f5db406efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43570/0 (socket says 172.21.15.40:43570) 2023-09-30T22:30:51.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.372+0000 7f5db37fe700 1 -- 172.21.15.40:0/150927336 learned_addr learned my addr 172.21.15.40:0/150927336 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:51.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.372+0000 7f5db2ffd700 1 --2- 172.21.15.40:0/150927336 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5db4136bf0 0x7f5db406f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.372+0000 7f5db3fff700 1 --2- 172.21.15.40:0/150927336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5db4139510 0x7f5db406fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:51.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.372+0000 7f5db37fe700 1 -- 172.21.15.40:0/150927336 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5db4136bf0 msgr2=0x7f5db406f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:51.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.372+0000 7f5db37fe700 1 --2- 172.21.15.40:0/150927336 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5db4136bf0 0x7f5db406f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.372+0000 7f5db37fe700 1 -- 172.21.15.40:0/150927336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5db4139510 msgr2=0x7f5db406fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:51.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.372+0000 7f5db37fe700 1 --2- 172.21.15.40:0/150927336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5db4139510 0x7f5db406fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.372+0000 7f5db37fe700 1 -- 172.21.15.40:0/150927336 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da80094a0 con 0x7f5db409c890 2023-09-30T22:30:51.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.372+0000 7f5db2ffd700 1 --2- 172.21.15.40:0/150927336 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5db4136bf0 0x7f5db406f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:51.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.372+0000 7f5db3fff700 1 --2- 172.21.15.40:0/150927336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5db4139510 0x7f5db406fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:51.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.373+0000 7f5db37fe700 1 --2- 172.21.15.40:0/150927336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5db409c890 0x7f5db406efd0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f5da400c470 tx=0x7f5da400c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:51.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.373+0000 7f5d9bfff700 1 -- 172.21.15.40:0/150927336 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da40074e0 con 0x7f5db409c890 2023-09-30T22:30:51.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.373+0000 7f5d9bfff700 1 -- 172.21.15.40:0/150927336 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da4007640 con 0x7f5db409c890 2023-09-30T22:30:51.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.373+0000 7f5d9bfff700 1 -- 172.21.15.40:0/150927336 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da4005a70 con 0x7f5db409c890 2023-09-30T22:30:51.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.373+0000 7f5db9d7a700 1 -- 172.21.15.40:0/150927336 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5db409ecf0 con 0x7f5db409c890 2023-09-30T22:30:51.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.373+0000 7f5db9d7a700 1 -- 172.21.15.40:0/150927336 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5db4071780 con 0x7f5db409c890 2023-09-30T22:30:51.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.374+0000 7f5d9bfff700 1 -- 172.21.15.40:0/150927336 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5da4005bd0 con 0x7f5db409c890 2023-09-30T22:30:51.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.374+0000 7f5d9bfff700 1 -- 172.21.15.40:0/150927336 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5da403eac0 con 0x7f5db409c890 2023-09-30T22:30:51.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.374+0000 7f5db9d7a700 1 -- 172.21.15.40:0/150927336 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5db412bc00 con 0x7f5db409c890 2023-09-30T22:30:51.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.379+0000 7f5d9bfff700 1 -- 172.21.15.40:0/150927336 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5da4017080 con 0x7f5db409c890 2023-09-30T22:30:51.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.573+0000 7f5db9d7a700 1 -- 172.21.15.40:0/150927336 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5db4062380 con 0x7f5db409c890 2023-09-30T22:30:51.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.573+0000 7f5d9bfff700 1 -- 172.21.15.40:0/150927336 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5da4018260 con 0x7f5db409c890 2023-09-30T22:30:51.574 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:51.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.575+0000 7f5db9d7a700 1 -- 172.21.15.40:0/150927336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5db409c890 msgr2=0x7f5db406efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:51.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.575+0000 7f5db9d7a700 1 --2- 172.21.15.40:0/150927336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5db409c890 0x7f5db406efd0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f5da400c470 tx=0x7f5da400c780 comp rx=0 tx=0).stop 2023-09-30T22:30:51.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.575+0000 7f5db9d7a700 1 -- 172.21.15.40:0/150927336 shutdown_connections 2023-09-30T22:30:51.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.575+0000 7f5db9d7a700 1 --2- 172.21.15.40:0/150927336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5db4139510 0x7f5db406fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.575+0000 7f5db9d7a700 1 --2- 172.21.15.40:0/150927336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5db409c890 0x7f5db406efd0 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.575+0000 7f5db9d7a700 1 --2- 172.21.15.40:0/150927336 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5db4136bf0 0x7f5db406f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:51.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.575+0000 7f5db9d7a700 1 -- 172.21.15.40:0/150927336 >> 172.21.15.40:0/150927336 conn(0x7f5db40a7080 msgr2=0x7f5db41349d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:51.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.576+0000 7f5db9d7a700 1 -- 172.21.15.40:0/150927336 shutdown_connections 2023-09-30T22:30:51.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:51.576+0000 7f5db9d7a700 1 -- 172.21.15.40:0/150927336 wait complete. 2023-09-30T22:30:51.589 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:52.083 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:52.089 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:52.090 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:52.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.221+0000 7f5f325c3700 1 Processor -- start 2023-09-30T22:30:52.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.221+0000 7f5f325c3700 1 -- start start 2023-09-30T22:30:52.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.222+0000 7f5f325c3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f2c136bf0 0x7f5f2c138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.222+0000 7f5f325c3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f2c139510 0x7f5f2c13b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.222+0000 7f5f325c3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f2c0a2600 con 0x7f5f2c09c890 2023-09-30T22:30:52.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.222+0000 7f5f325c3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c0a29d0 con 0x7f5f2c139510 2023-09-30T22:30:52.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.222+0000 7f5f325c3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c09fb40 con 0x7f5f2c136bf0 2023-09-30T22:30:52.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.222+0000 7f5f2bfff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5f2c09c890 0x7f5f2c09cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52060/0 (socket says 172.21.15.40:52060) 2023-09-30T22:30:52.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.222+0000 7f5f2bfff700 1 -- 172.21.15.40:0/1084997378 learned_addr learned my addr 172.21.15.40:0/1084997378 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:52.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.222+0000 7f5f2b7fe700 1 --2- 172.21.15.40:0/1084997378 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f2c136bf0 0x7f5f2c138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.222+0000 7f5f30b60700 1 --2- 172.21.15.40:0/1084997378 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f2c139510 0x7f5f2c13b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.222+0000 7f5f2affd700 1 -- 172.21.15.40:0/1084997378 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575997203 0 0) 0x7f5f2c0a2600 con 0x7f5f2c09c890 2023-09-30T22:30:52.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.223+0000 7f5f2affd700 1 -- 172.21.15.40:0/1084997378 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f140035b0 con 0x7f5f2c09c890 2023-09-30T22:30:52.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.223+0000 7f5f2b7fe700 1 -- 172.21.15.40:0/1084997378 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f2c139510 msgr2=0x7f5f2c13b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:52.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.223+0000 7f5f2b7fe700 1 --2- 172.21.15.40:0/1084997378 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f2c139510 0x7f5f2c13b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.223+0000 7f5f2b7fe700 1 -- 172.21.15.40:0/1084997378 >> v1:172.21.15.40:6789/0 conn(0x7f5f2c09c890 legacy=0x7f5f2c09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.223+0000 7f5f2b7fe700 1 -- 172.21.15.40:0/1084997378 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2c09d370 con 0x7f5f2c136bf0 2023-09-30T22:30:52.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.223+0000 7f5f30b60700 1 --2- 172.21.15.40:0/1084997378 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f2c139510 0x7f5f2c13b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:52.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.223+0000 7f5f2b7fe700 1 --2- 172.21.15.40:0/1084997378 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f2c136bf0 0x7f5f2c138fd0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f5f20009870 tx=0x7f5f20009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17e03a00247f5fca server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:52.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.223+0000 7f5f2affd700 1 -- 172.21.15.40:0/1084997378 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f20011830 con 0x7f5f2c136bf0 2023-09-30T22:30:52.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.223+0000 7f5f2affd700 1 -- 172.21.15.40:0/1084997378 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f20011990 con 0x7f5f2c136bf0 2023-09-30T22:30:52.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.223+0000 7f5f2affd700 1 -- 172.21.15.40:0/1084997378 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f20011d00 con 0x7f5f2c136bf0 2023-09-30T22:30:52.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.224+0000 7f5f325c3700 1 -- 172.21.15.40:0/1084997378 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f2c136bf0 msgr2=0x7f5f2c138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.224+0000 7f5f325c3700 1 --2- 172.21.15.40:0/1084997378 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f2c136bf0 0x7f5f2c138fd0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f5f20009870 tx=0x7f5f20009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:52.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.224+0000 7f5f325c3700 1 -- 172.21.15.40:0/1084997378 shutdown_connections 2023-09-30T22:30:52.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.224+0000 7f5f325c3700 1 --2- 172.21.15.40:0/1084997378 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f2c139510 0x7f5f2c13b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.224+0000 7f5f325c3700 1 --2- 172.21.15.40:0/1084997378 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f2c136bf0 0x7f5f2c138fd0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.224+0000 7f5f325c3700 1 -- 172.21.15.40:0/1084997378 >> 172.21.15.40:0/1084997378 conn(0x7f5f2c0a7080 msgr2=0x7f5f2c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:52.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.224+0000 7f5f325c3700 1 -- 172.21.15.40:0/1084997378 shutdown_connections 2023-09-30T22:30:52.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.224+0000 7f5f325c3700 1 -- 172.21.15.40:0/1084997378 wait complete. 2023-09-30T22:30:52.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.225+0000 7f5f325c3700 1 Processor -- start 2023-09-30T22:30:52.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.225+0000 7f5f325c3700 1 -- start start 2023-09-30T22:30:52.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.225+0000 7f5f325c3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f2c09c890 0x7f5f2c06eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.226+0000 7f5f325c3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f2c136bf0 0x7f5f2c06f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.226+0000 7f5f325c3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f2c139510 0x7f5f2c06f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.226+0000 7f5f325c3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c09ecf0 con 0x7f5f2c136bf0 2023-09-30T22:30:52.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.226+0000 7f5f325c3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c12c000 con 0x7f5f2c139510 2023-09-30T22:30:52.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.226+0000 7f5f325c3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c12b4e0 con 0x7f5f2c09c890 2023-09-30T22:30:52.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.226+0000 7f5f2bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f2c09c890 0x7f5f2c06eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.226+0000 7f5f30b60700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f2c139510 0x7f5f2c06f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.226+0000 7f5f2bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f2c09c890 0x7f5f2c06eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:56644/0 (socket says 172.21.15.40:56644) 2023-09-30T22:30:52.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.226+0000 7f5f2bfff700 1 -- 172.21.15.40:0/1875280681 learned_addr learned my addr 172.21.15.40:0/1875280681 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:52.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.226+0000 7f5f2b7fe700 1 --2- 172.21.15.40:0/1875280681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f2c136bf0 0x7f5f2c06f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.226+0000 7f5f2bfff700 1 -- 172.21.15.40:0/1875280681 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f2c139510 msgr2=0x7f5f2c06f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.226+0000 7f5f2bfff700 1 --2- 172.21.15.40:0/1875280681 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f2c139510 0x7f5f2c06f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.226+0000 7f5f2bfff700 1 -- 172.21.15.40:0/1875280681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f2c136bf0 msgr2=0x7f5f2c06f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.226+0000 7f5f2bfff700 1 --2- 172.21.15.40:0/1875280681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f2c136bf0 0x7f5f2c06f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.226+0000 7f5f2bfff700 1 -- 172.21.15.40:0/1875280681 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f24009a70 con 0x7f5f2c09c890 2023-09-30T22:30:52.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.226+0000 7f5f30b60700 1 --2- 172.21.15.40:0/1875280681 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f2c139510 0x7f5f2c06f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:52.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.226+0000 7f5f2b7fe700 1 --2- 172.21.15.40:0/1875280681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f2c136bf0 0x7f5f2c06f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:52.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.226+0000 7f5f2bfff700 1 --2- 172.21.15.40:0/1875280681 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f2c09c890 0x7f5f2c06eed0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c001260 tx=0x7f5f1c00c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:52.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.227+0000 7f5f28ff9700 1 -- 172.21.15.40:0/1875280681 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c0074e0 con 0x7f5f2c09c890 2023-09-30T22:30:52.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.227+0000 7f5f28ff9700 1 -- 172.21.15.40:0/1875280681 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1c007640 con 0x7f5f2c09c890 2023-09-30T22:30:52.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.227+0000 7f5f325c3700 1 -- 172.21.15.40:0/1875280681 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f200094a0 con 0x7f5f2c09c890 2023-09-30T22:30:52.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.227+0000 7f5f28ff9700 1 -- 172.21.15.40:0/1875280681 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c005a50 con 0x7f5f2c09c890 2023-09-30T22:30:52.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.227+0000 7f5f325c3700 1 -- 172.21.15.40:0/1875280681 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f2c070950 con 0x7f5f2c09c890 2023-09-30T22:30:52.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.228+0000 7f5f28ff9700 1 -- 172.21.15.40:0/1875280681 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5f1c005bb0 con 0x7f5f2c09c890 2023-09-30T22:30:52.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.228+0000 7f5f325c3700 1 -- 172.21.15.40:0/1875280681 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f2c12be40 con 0x7f5f2c09c890 2023-09-30T22:30:52.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.228+0000 7f5f28ff9700 1 -- 172.21.15.40:0/1875280681 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5f1c03ebc0 con 0x7f5f2c09c890 2023-09-30T22:30:52.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.237+0000 7f5f28ff9700 1 -- 172.21.15.40:0/1875280681 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5f2c12be40 con 0x7f5f2c09c890 2023-09-30T22:30:52.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.263+0000 7fd6c9226700 1 Processor -- start 2023-09-30T22:30:52.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.263+0000 7fd6c9226700 1 -- start start 2023-09-30T22:30:52.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.263+0000 7fd6c9226700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6c4133e00 0x7fd6c41341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.263+0000 7fd6c9226700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd6c409df40 0x7fd6c413bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.263+0000 7fd6c9226700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c4133940 con 0x7fd6c409d400 2023-09-30T22:30:52.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.263+0000 7fd6c9226700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c409ab20 con 0x7fd6c4133e00 2023-09-30T22:30:52.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.263+0000 7fd6c9226700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c409f0d0 con 0x7fd6c409df40 2023-09-30T22:30:52.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.264+0000 7fd6c2d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6c4133e00 0x7fd6c41341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.264+0000 7fd6c2d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6c4133e00 0x7fd6c41341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:44982/0 (socket says 172.21.15.40:44982) 2023-09-30T22:30:52.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.264+0000 7fd6c2d9d700 1 -- 172.21.15.40:0/2273248326 learned_addr learned my addr 172.21.15.40:0/2273248326 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:52.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.264+0000 7fd6c359e700 1 --2- 172.21.15.40:0/2273248326 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd6c409df40 0x7fd6c413bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.264+0000 7fd6c2d9d700 1 -- 172.21.15.40:0/2273248326 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd6c409df40 msgr2=0x7fd6c413bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:52.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.264+0000 7fd6c2d9d700 1 --2- 172.21.15.40:0/2273248326 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd6c409df40 0x7fd6c413bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.264+0000 7fd6c2d9d700 1 -- 172.21.15.40:0/2273248326 >> v1:172.21.15.40:6789/0 conn(0x7fd6c409d400 legacy=0x7fd6c409d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.264+0000 7fd6c1d9b700 1 -- 172.21.15.40:0/2273248326 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 834447457 0 0) 0x7fd6c4133940 con 0x7fd6c409d400 2023-09-30T22:30:52.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.264+0000 7fd6c2d9d700 1 -- 172.21.15.40:0/2273248326 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c4133be0 con 0x7fd6c4133e00 2023-09-30T22:30:52.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.264+0000 7fd6c359e700 1 --2- 172.21.15.40:0/2273248326 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd6c409df40 0x7fd6c413bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:52.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.264+0000 7fd6c2d9d700 1 --2- 172.21.15.40:0/2273248326 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6c4133e00 0x7fd6c41341d0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4009920 tx=0x7fd6b4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be0e5c7fc97f0d24 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:52.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.264+0000 7fd6c1d9b700 1 -- 172.21.15.40:0/2273248326 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b4011830 con 0x7fd6c4133e00 2023-09-30T22:30:52.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.264+0000 7fd6c1d9b700 1 -- 172.21.15.40:0/2273248326 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b4011990 con 0x7fd6c4133e00 2023-09-30T22:30:52.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.264+0000 7fd6c1d9b700 1 -- 172.21.15.40:0/2273248326 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b4011d20 con 0x7fd6c4133e00 2023-09-30T22:30:52.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.265+0000 7fd6c9226700 1 -- 172.21.15.40:0/2273248326 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6c4133e00 msgr2=0x7fd6c41341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.265+0000 7fd6c9226700 1 --2- 172.21.15.40:0/2273248326 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6c4133e00 0x7fd6c41341d0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4009920 tx=0x7fd6b4009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:52.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.265+0000 7fd6c9226700 1 -- 172.21.15.40:0/2273248326 shutdown_connections 2023-09-30T22:30:52.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.265+0000 7fd6c9226700 1 --2- 172.21.15.40:0/2273248326 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd6c409df40 0x7fd6c413bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.265+0000 7fd6c9226700 1 --2- 172.21.15.40:0/2273248326 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6c4133e00 0x7fd6c41341d0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.265+0000 7fd6c9226700 1 -- 172.21.15.40:0/2273248326 >> 172.21.15.40:0/2273248326 conn(0x7fd6c40a2a00 msgr2=0x7fd6c40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:52.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.265+0000 7fd6c9226700 1 -- 172.21.15.40:0/2273248326 shutdown_connections 2023-09-30T22:30:52.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.265+0000 7fd6c9226700 1 -- 172.21.15.40:0/2273248326 wait complete. 2023-09-30T22:30:52.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.266+0000 7fd6c9226700 1 Processor -- start 2023-09-30T22:30:52.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.266+0000 7fd6c9226700 1 -- start start 2023-09-30T22:30:52.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.267+0000 7fd6c9226700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6c409d400 0x7fd6c411a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.267+0000 7fd6c9226700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd6c409df40 0x7fd6c411add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.267+0000 7fd6c9226700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6c4133e00 0x7fd6c411b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.267+0000 7fd6c9226700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c412e200 con 0x7fd6c409d400 2023-09-30T22:30:52.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.267+0000 7fd6c9226700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c411c620 con 0x7fd6c4133e00 2023-09-30T22:30:52.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.267+0000 7fd6c9226700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c411de10 con 0x7fd6c409df40 2023-09-30T22:30:52.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.267+0000 7fd6c2d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6c409d400 0x7fd6c411a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.267+0000 7fd6c2d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6c409d400 0x7fd6c411a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43584/0 (socket says 172.21.15.40:43584) 2023-09-30T22:30:52.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.267+0000 7fd6c2d9d700 1 -- 172.21.15.40:0/1137595036 learned_addr learned my addr 172.21.15.40:0/1137595036 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:52.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.267+0000 7fd6c259c700 1 --2- 172.21.15.40:0/1137595036 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd6c409df40 0x7fd6c411add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.267+0000 7fd6c359e700 1 --2- 172.21.15.40:0/1137595036 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6c4133e00 0x7fd6c411b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.267+0000 7fd6c2d9d700 1 -- 172.21.15.40:0/1137595036 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd6c409df40 msgr2=0x7fd6c411add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.267+0000 7fd6c2d9d700 1 --2- 172.21.15.40:0/1137595036 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd6c409df40 0x7fd6c411add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.267+0000 7fd6c2d9d700 1 -- 172.21.15.40:0/1137595036 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6c4133e00 msgr2=0x7fd6c411b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.267+0000 7fd6c2d9d700 1 --2- 172.21.15.40:0/1137595036 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6c4133e00 0x7fd6c411b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.267+0000 7fd6c2d9d700 1 -- 172.21.15.40:0/1137595036 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6bc009a70 con 0x7fd6c409d400 2023-09-30T22:30:52.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.268+0000 7fd6c2d9d700 1 --2- 172.21.15.40:0/1137595036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6c409d400 0x7fd6c411a890 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fd6b40098f0 tx=0x7fd6b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:52.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.268+0000 7fd6ab7fe700 1 -- 172.21.15.40:0/1137595036 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b4004450 con 0x7fd6c409d400 2023-09-30T22:30:52.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.268+0000 7fd6ab7fe700 1 -- 172.21.15.40:0/1137595036 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b40045b0 con 0x7fd6c409d400 2023-09-30T22:30:52.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.268+0000 7fd6c9226700 1 -- 172.21.15.40:0/1137595036 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b4009550 con 0x7fd6c409d400 2023-09-30T22:30:52.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.268+0000 7fd6c9226700 1 -- 172.21.15.40:0/1137595036 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c411d6f0 con 0x7fd6c409d400 2023-09-30T22:30:52.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.268+0000 7fd6ab7fe700 1 -- 172.21.15.40:0/1137595036 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b40038c0 con 0x7fd6c409d400 2023-09-30T22:30:52.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.268+0000 7f170869e700 1 Processor -- start 2023-09-30T22:30:52.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.268+0000 7f170869e700 1 -- start start 2023-09-30T22:30:52.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.269+0000 7f170869e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1700130c00 0x7f1700130fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.269+0000 7f170869e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1700130570 0x7f170009a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.269+0000 7f170869e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f170009ba60 con 0x7f170009ab60 2023-09-30T22:30:52.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.269+0000 7f170869e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f170009df10 con 0x7f1700130570 2023-09-30T22:30:52.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.269+0000 7f170869e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1700131510 con 0x7f1700130c00 2023-09-30T22:30:52.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.269+0000 7f1706c3b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f170009ab60 0x7f1700137900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52080/0 (socket says 172.21.15.40:52080) 2023-09-30T22:30:52.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.269+0000 7f1706c3b700 1 -- 172.21.15.40:0/2332210603 learned_addr learned my addr 172.21.15.40:0/2332210603 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:52.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.269+0000 7f1705438700 1 -- 172.21.15.40:0/2332210603 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1261532089 0 0) 0x7f170009ba60 con 0x7f170009ab60 2023-09-30T22:30:52.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.269+0000 7f1705438700 1 -- 172.21.15.40:0/2332210603 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16ec0035b0 con 0x7f170009ab60 2023-09-30T22:30:52.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.269+0000 7fd6ab7fe700 1 -- 172.21.15.40:0/1137595036 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd6b4003a20 con 0x7fd6c409d400 2023-09-30T22:30:52.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.269+0000 7fd6ab7fe700 1 -- 172.21.15.40:0/1137595036 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd6b4040a30 con 0x7fd6c409d400 2023-09-30T22:30:52.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.270+0000 7fd6c9226700 1 -- 172.21.15.40:0/1137595036 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6a40052e0 con 0x7fd6c409d400 2023-09-30T22:30:52.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.270+0000 7f170643a700 1 --2- 172.21.15.40:0/2332210603 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1700130c00 0x7f1700130fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.270+0000 7f1705438700 1 -- 172.21.15.40:0/2332210603 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2682802869 0 0) 0x7f16ec0035b0 con 0x7f170009ab60 2023-09-30T22:30:52.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.270+0000 7f1705438700 1 -- 172.21.15.40:0/2332210603 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1700130c00 msgr2=0x7f1700130fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:52.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.270+0000 7f1705438700 1 --2- 172.21.15.40:0/2332210603 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1700130c00 0x7f1700130fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.270+0000 7f1705438700 1 -- 172.21.15.40:0/2332210603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1700130570 msgr2=0x7f170009a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:52.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.270+0000 7f1705438700 1 --2- 172.21.15.40:0/2332210603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1700130570 0x7f170009a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.270+0000 7f1705438700 1 -- 172.21.15.40:0/2332210603 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1700130a00 con 0x7f170009ab60 2023-09-30T22:30:52.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.270+0000 7f1705438700 1 -- 172.21.15.40:0/2332210603 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4231795173 0 0) 0x7f16f80019f0 con 0x7f170009ab60 2023-09-30T22:30:52.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.270+0000 7f1705438700 1 -- 172.21.15.40:0/2332210603 >> v1:172.21.15.40:6789/0 conn(0x7f170009ab60 legacy=0x7f1700137900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.270+0000 7f1705438700 1 --2- 172.21.15.40:0/2332210603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f16ec003a00 0x7f16ec003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.270+0000 7f1705438700 1 --2- 172.21.15.40:0/2332210603 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16ec004850 0x7f16ec004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.270+0000 7f1705438700 1 --2- 172.21.15.40:0/2332210603 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1700130c00 0x7f16ec005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.270+0000 7f1705438700 1 -- 172.21.15.40:0/2332210603 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170009df10 con 0x7f16ec004850 2023-09-30T22:30:52.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.270+0000 7f1705438700 1 -- 172.21.15.40:0/2332210603 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1700131510 con 0x7f16ec003a00 2023-09-30T22:30:52.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.270+0000 7f1705438700 1 -- 172.21.15.40:0/2332210603 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec00dd50 con 0x7f1700130c00 2023-09-30T22:30:52.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.270+0000 7f1706c3b700 1 --2- 172.21.15.40:0/2332210603 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1700130c00 0x7f16ec005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.270+0000 7f170643a700 1 --2- 172.21.15.40:0/2332210603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f16ec003a00 0x7f16ec003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.270+0000 7f1705c39700 1 --2- 172.21.15.40:0/2332210603 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16ec004850 0x7f16ec004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.270+0000 7f1706c3b700 1 -- 172.21.15.40:0/2332210603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f16ec003a00 msgr2=0x7f16ec003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:52.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.270+0000 7f1706c3b700 1 --2- 172.21.15.40:0/2332210603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f16ec003a00 0x7f16ec003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.271+0000 7f1706c3b700 1 -- 172.21.15.40:0/2332210603 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16ec004850 msgr2=0x7f16ec004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:52.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.271+0000 7f1706c3b700 1 --2- 172.21.15.40:0/2332210603 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16ec004850 0x7f16ec004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.271+0000 7f1706c3b700 1 -- 172.21.15.40:0/2332210603 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ec0035b0 con 0x7f1700130c00 2023-09-30T22:30:52.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.271+0000 7f1705c39700 1 --2- 172.21.15.40:0/2332210603 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16ec004850 0x7f16ec004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:30:52.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.271+0000 7f1706c3b700 1 --2- 172.21.15.40:0/2332210603 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1700130c00 0x7f16ec005200 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f16f800a760 tx=0x7f16ec005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5840a4da970cd7c8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:52.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.271+0000 7f1705438700 1 -- 172.21.15.40:0/2332210603 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f800a250 con 0x7f1700130c00 2023-09-30T22:30:52.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.271+0000 7f1705438700 1 -- 172.21.15.40:0/2332210603 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f80072f0 con 0x7f1700130c00 2023-09-30T22:30:52.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.271+0000 7f1705438700 1 -- 172.21.15.40:0/2332210603 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f80076a0 con 0x7f1700130c00 2023-09-30T22:30:52.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.272+0000 7f170869e700 1 -- 172.21.15.40:0/2332210603 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1700130c00 msgr2=0x7f16ec005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.272+0000 7f170869e700 1 --2- 172.21.15.40:0/2332210603 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1700130c00 0x7f16ec005200 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f16f800a760 tx=0x7f16ec005880 comp rx=0 tx=0).stop 2023-09-30T22:30:52.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.272+0000 7f170869e700 1 -- 172.21.15.40:0/2332210603 shutdown_connections 2023-09-30T22:30:52.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.272+0000 7f170869e700 1 --2- 172.21.15.40:0/2332210603 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1700130c00 0x7f16ec005200 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.272+0000 7f170869e700 1 --2- 172.21.15.40:0/2332210603 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16ec004850 0x7f16ec004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.272+0000 7f170869e700 1 --2- 172.21.15.40:0/2332210603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f16ec003a00 0x7f16ec003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.272+0000 7f170869e700 1 -- 172.21.15.40:0/2332210603 >> 172.21.15.40:0/2332210603 conn(0x7f170009eb10 msgr2=0x7f170009ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:52.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.272+0000 7f170869e700 1 -- 172.21.15.40:0/2332210603 shutdown_connections 2023-09-30T22:30:52.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.272+0000 7f170869e700 1 -- 172.21.15.40:0/2332210603 wait complete. 2023-09-30T22:30:52.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.273+0000 7f170869e700 1 Processor -- start 2023-09-30T22:30:52.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.273+0000 7f170869e700 1 -- start start 2023-09-30T22:30:52.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.273+0000 7f170869e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f16ec003a00 0x7f170008afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.273+0000 7f170869e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16ec004850 0x7f170008b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.273+0000 7f170869e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f170009ab60 0x7f170008ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.273+0000 7f170869e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17000a07b0 con 0x7f16ec004850 2023-09-30T22:30:52.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.273+0000 7f170869e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f170009bc10 con 0x7f16ec003a00 2023-09-30T22:30:52.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.273+0000 7f170869e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f170008cd90 con 0x7f170009ab60 2023-09-30T22:30:52.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.273+0000 7f170643a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f16ec003a00 0x7f170008afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.273+0000 7f1706c3b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f170009ab60 0x7f170008ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.273+0000 7f170643a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f16ec003a00 0x7f170008afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:45016/0 (socket says 172.21.15.40:45016) 2023-09-30T22:30:52.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.273+0000 7f170643a700 1 -- 172.21.15.40:0/69086219 learned_addr learned my addr 172.21.15.40:0/69086219 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:52.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.273+0000 7f1705c39700 1 --2- 172.21.15.40:0/69086219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16ec004850 0x7f170008b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.274+0000 7f1706c3b700 1 -- 172.21.15.40:0/69086219 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f16ec003a00 msgr2=0x7f170008afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.274+0000 7f1706c3b700 1 --2- 172.21.15.40:0/69086219 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f16ec003a00 0x7f170008afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.274+0000 7f1706c3b700 1 -- 172.21.15.40:0/69086219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16ec004850 msgr2=0x7f170008b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.274+0000 7f1706c3b700 1 --2- 172.21.15.40:0/69086219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16ec004850 0x7f170008b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.274+0000 7f1706c3b700 1 -- 172.21.15.40:0/69086219 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f170008de90 con 0x7f170009ab60 2023-09-30T22:30:52.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.274+0000 7f1706c3b700 1 --2- 172.21.15.40:0/69086219 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f170009ab60 0x7f170008ba50 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f16f8015000 tx=0x7f170006d300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:52.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.274+0000 7f16f6ffd700 1 -- 172.21.15.40:0/69086219 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f800a250 con 0x7f170009ab60 2023-09-30T22:30:52.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.274+0000 7f16f6ffd700 1 -- 172.21.15.40:0/69086219 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f8007b20 con 0x7f170009ab60 2023-09-30T22:30:52.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.274+0000 7f16f6ffd700 1 -- 172.21.15.40:0/69086219 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f8012640 con 0x7f170009ab60 2023-09-30T22:30:52.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.274+0000 7f170869e700 1 -- 172.21.15.40:0/69086219 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f170008e7a0 con 0x7f170009ab60 2023-09-30T22:30:52.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.274+0000 7f170869e700 1 -- 172.21.15.40:0/69086219 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f170008e420 con 0x7f170009ab60 2023-09-30T22:30:52.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.275+0000 7f16f6ffd700 1 -- 172.21.15.40:0/69086219 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f16f801a070 con 0x7f170009ab60 2023-09-30T22:30:52.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.275+0000 7f16f6ffd700 1 -- 172.21.15.40:0/69086219 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f16f8042d90 con 0x7f170009ab60 2023-09-30T22:30:52.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.276+0000 7f170869e700 1 -- 172.21.15.40:0/69086219 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1700062380 con 0x7f170009ab60 2023-09-30T22:30:52.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.276+0000 7fd6ab7fe700 1 -- 172.21.15.40:0/1137595036 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd6b4015080 con 0x7fd6c409d400 2023-09-30T22:30:52.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.285+0000 7f16f6ffd700 1 -- 172.21.15.40:0/69086219 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f16f8023020 con 0x7f170009ab60 2023-09-30T22:30:52.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.436+0000 7f5f325c3700 1 -- 172.21.15.40:0/1875280681 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5f2c12be40 con 0x7f5f2c09c890 2023-09-30T22:30:52.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.436+0000 7f5f28ff9700 1 -- 172.21.15.40:0/1875280681 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5f2c12be40 con 0x7f5f2c09c890 2023-09-30T22:30:52.437 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:52.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.438+0000 7f5f325c3700 1 -- 172.21.15.40:0/1875280681 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f2c09c890 msgr2=0x7f5f2c06eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.438+0000 7f5f325c3700 1 --2- 172.21.15.40:0/1875280681 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f2c09c890 0x7f5f2c06eed0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c001260 tx=0x7f5f1c00c9e0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.438+0000 7f5f325c3700 1 -- 172.21.15.40:0/1875280681 shutdown_connections 2023-09-30T22:30:52.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.438+0000 7f5f325c3700 1 --2- 172.21.15.40:0/1875280681 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5f2c09c890 0x7f5f2c06eed0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.438+0000 7f5f325c3700 1 --2- 172.21.15.40:0/1875280681 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5f2c139510 0x7f5f2c06f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.438+0000 7f5f325c3700 1 --2- 172.21.15.40:0/1875280681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f2c136bf0 0x7f5f2c06f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.438+0000 7f5f325c3700 1 -- 172.21.15.40:0/1875280681 >> 172.21.15.40:0/1875280681 conn(0x7f5f2c0a7080 msgr2=0x7f5f2c1356d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:52.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.439+0000 7f5f325c3700 1 -- 172.21.15.40:0/1875280681 shutdown_connections 2023-09-30T22:30:52.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.439+0000 7f5f325c3700 1 -- 172.21.15.40:0/1875280681 wait complete. 2023-09-30T22:30:52.451 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:52.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.477+0000 7fd6c9226700 1 -- 172.21.15.40:0/1137595036 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd6a4005590 con 0x7fd6c409d400 2023-09-30T22:30:52.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.477+0000 7fd6ab7fe700 1 -- 172.21.15.40:0/1137595036 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd6b4003cd0 con 0x7fd6c409d400 2023-09-30T22:30:52.478 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:52.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.479+0000 7fd6c9226700 1 -- 172.21.15.40:0/1137595036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6c409d400 msgr2=0x7fd6c411a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.479+0000 7fd6c9226700 1 --2- 172.21.15.40:0/1137595036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6c409d400 0x7fd6c411a890 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fd6b40098f0 tx=0x7fd6b4004750 comp rx=0 tx=0).stop 2023-09-30T22:30:52.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.479+0000 7fd6c9226700 1 -- 172.21.15.40:0/1137595036 shutdown_connections 2023-09-30T22:30:52.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.479+0000 7fd6c9226700 1 --2- 172.21.15.40:0/1137595036 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6c4133e00 0x7fd6c411b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.479+0000 7fd6c9226700 1 --2- 172.21.15.40:0/1137595036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6c409d400 0x7fd6c411a890 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.479+0000 7fd6c9226700 1 --2- 172.21.15.40:0/1137595036 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd6c409df40 0x7fd6c411add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.479+0000 7fd6c9226700 1 -- 172.21.15.40:0/1137595036 >> 172.21.15.40:0/1137595036 conn(0x7fd6c40a2a00 msgr2=0x7fd6c41b9950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:52.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.479+0000 7fd6c9226700 1 -- 172.21.15.40:0/1137595036 shutdown_connections 2023-09-30T22:30:52.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.479+0000 7fd6c9226700 1 -- 172.21.15.40:0/1137595036 wait complete. 2023-09-30T22:30:52.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.482+0000 7f170869e700 1 -- 172.21.15.40:0/69086219 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1700074620 con 0x7f170009ab60 2023-09-30T22:30:52.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.482+0000 7f16f6ffd700 1 -- 172.21.15.40:0/69086219 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f16f8018070 con 0x7f170009ab60 2023-09-30T22:30:52.483 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:52.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.484+0000 7f170869e700 1 -- 172.21.15.40:0/69086219 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f170009ab60 msgr2=0x7f170008ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.484+0000 7f170869e700 1 --2- 172.21.15.40:0/69086219 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f170009ab60 0x7f170008ba50 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f16f8015000 tx=0x7f170006d300 comp rx=0 tx=0).stop 2023-09-30T22:30:52.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.484+0000 7f170869e700 1 -- 172.21.15.40:0/69086219 shutdown_connections 2023-09-30T22:30:52.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.484+0000 7f170869e700 1 --2- 172.21.15.40:0/69086219 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f170009ab60 0x7f170008ba50 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.484+0000 7f170869e700 1 --2- 172.21.15.40:0/69086219 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f16ec003a00 0x7f170008afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.484+0000 7f170869e700 1 --2- 172.21.15.40:0/69086219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16ec004850 0x7f170008b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.484+0000 7f170869e700 1 -- 172.21.15.40:0/69086219 >> 172.21.15.40:0/69086219 conn(0x7f170009eb10 msgr2=0x7f170012fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:52.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.484+0000 7f170869e700 1 -- 172.21.15.40:0/69086219 shutdown_connections 2023-09-30T22:30:52.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.484+0000 7f170869e700 1 -- 172.21.15.40:0/69086219 wait complete. 2023-09-30T22:30:52.494 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:52.497 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:52.590 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:52.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.719+0000 7f9fa3878700 1 Processor -- start 2023-09-30T22:30:52.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.719+0000 7f9fa3878700 1 -- start start 2023-09-30T22:30:52.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.720+0000 7f9fa3878700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f9c12e590 0x7f9f9c12e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.720+0000 7f9fa3878700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9f9c12d8a0 0x7f9f9c138c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.720+0000 7f9fa3878700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f9c09ab70 con 0x7f9f9c12eea0 2023-09-30T22:30:52.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.720+0000 7f9fa3878700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f9c09b270 con 0x7f9f9c12d8a0 2023-09-30T22:30:52.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.720+0000 7f9fa3878700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c09bab0 con 0x7f9f9c12e590 2023-09-30T22:30:52.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.720+0000 7f9fa1614700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f9c12e590 0x7f9f9c12e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.720+0000 7f9fa0e13700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9f9c12eea0 0x7f9f9c12d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52090/0 (socket says 172.21.15.40:52090) 2023-09-30T22:30:52.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.720+0000 7f9fa0e13700 1 -- 172.21.15.40:0/1699899814 learned_addr learned my addr 172.21.15.40:0/1699899814 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:52.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.720+0000 7f9fa1e15700 1 --2- 172.21.15.40:0/1699899814 >> v2:172.21.15.40:3300/0 conn(0x7f9f9c12d8a0 0x7f9f9c138c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.720+0000 7f9fa1e15700 1 -- 172.21.15.40:0/1699899814 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f9c12e590 msgr2=0x7f9f9c12e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:52.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.720+0000 7f9fa1e15700 1 --2- 172.21.15.40:0/1699899814 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f9c12e590 0x7f9f9c12e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.720+0000 7f9fa1e15700 1 -- 172.21.15.40:0/1699899814 >> v1:172.21.15.40:6789/0 conn(0x7f9f9c12eea0 legacy=0x7f9f9c12d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.721+0000 7f9fa1e15700 1 -- 172.21.15.40:0/1699899814 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9c09bd70 con 0x7f9f9c12d8a0 2023-09-30T22:30:52.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.721+0000 7f9fa1614700 1 --2- 172.21.15.40:0/1699899814 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f9c12e590 0x7f9f9c12e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:52.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.721+0000 7f9fa1e15700 1 --2- 172.21.15.40:0/1699899814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f9c12d8a0 0x7f9f9c138c50 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f9f94009dc0 tx=0x7f9f9400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6b9a39a3063d0b9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:52.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.721+0000 7f9f93fff700 1 -- 172.21.15.40:0/1699899814 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9400e070 con 0x7f9f9c12d8a0 2023-09-30T22:30:52.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.721+0000 7f9f93fff700 1 -- 172.21.15.40:0/1699899814 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9400bae0 con 0x7f9f9c12d8a0 2023-09-30T22:30:52.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.721+0000 7f9f93fff700 1 -- 172.21.15.40:0/1699899814 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9400be90 con 0x7f9f9c12d8a0 2023-09-30T22:30:52.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.721+0000 7f9fa3878700 1 -- 172.21.15.40:0/1699899814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f9c12d8a0 msgr2=0x7f9f9c138c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.721+0000 7f9fa3878700 1 --2- 172.21.15.40:0/1699899814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f9c12d8a0 0x7f9f9c138c50 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f9f94009dc0 tx=0x7f9f9400b330 comp rx=0 tx=0).stop 2023-09-30T22:30:52.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.721+0000 7f9fa3878700 1 -- 172.21.15.40:0/1699899814 shutdown_connections 2023-09-30T22:30:52.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.721+0000 7f9fa3878700 1 --2- 172.21.15.40:0/1699899814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f9c12d8a0 0x7f9f9c138c50 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.721+0000 7f9fa3878700 1 --2- 172.21.15.40:0/1699899814 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f9c12e590 0x7f9f9c12e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.721+0000 7f9fa3878700 1 -- 172.21.15.40:0/1699899814 >> 172.21.15.40:0/1699899814 conn(0x7f9f9c0a2a00 msgr2=0x7f9f9c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:52.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.722+0000 7f9fa3878700 1 -- 172.21.15.40:0/1699899814 shutdown_connections 2023-09-30T22:30:52.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.722+0000 7f9fa3878700 1 -- 172.21.15.40:0/1699899814 wait complete. 2023-09-30T22:30:52.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.722+0000 7f9fa3878700 1 Processor -- start 2023-09-30T22:30:52.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.722+0000 7f9fa3878700 1 -- start start 2023-09-30T22:30:52.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.723+0000 7f9fa3878700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f9c12d8a0 0x7f9f9c11bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.723+0000 7f9fa3878700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f9c12e590 0x7f9f9c11c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.723+0000 7f9fa3878700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f9c12eea0 0x7f9f9c11c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:52.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.723+0000 7f9fa3878700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c11f610 con 0x7f9f9c12eea0 2023-09-30T22:30:52.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.723+0000 7f9fa3878700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c11f100 con 0x7f9f9c12d8a0 2023-09-30T22:30:52.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.723+0000 7f9fa3878700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c11e590 con 0x7f9f9c12e590 2023-09-30T22:30:52.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.723+0000 7f9fa1e15700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f9c12eea0 0x7f9f9c11c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.723+0000 7f9fa1614700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f9c12d8a0 0x7f9f9c11bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.723+0000 7f9fa1e15700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f9c12eea0 0x7f9f9c11c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43620/0 (socket says 172.21.15.40:43620) 2023-09-30T22:30:52.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.723+0000 7f9fa1e15700 1 -- 172.21.15.40:0/2460020711 learned_addr learned my addr 172.21.15.40:0/2460020711 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:52.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.723+0000 7f9fa0e13700 1 --2- 172.21.15.40:0/2460020711 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f9c12e590 0x7f9f9c11c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:52.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.723+0000 7f9fa1614700 1 -- 172.21.15.40:0/2460020711 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f9c12e590 msgr2=0x7f9f9c11c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.723+0000 7f9fa1614700 1 --2- 172.21.15.40:0/2460020711 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f9c12e590 0x7f9f9c11c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.723+0000 7f9fa1614700 1 -- 172.21.15.40:0/2460020711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f9c12eea0 msgr2=0x7f9f9c11c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.723+0000 7f9fa1614700 1 --2- 172.21.15.40:0/2460020711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f9c12eea0 0x7f9f9c11c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.723+0000 7f9fa1614700 1 -- 172.21.15.40:0/2460020711 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f980094a0 con 0x7f9f9c12d8a0 2023-09-30T22:30:52.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.723+0000 7f9fa1e15700 1 --2- 172.21.15.40:0/2460020711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f9c12eea0 0x7f9f9c11c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:52.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.723+0000 7f9fa0e13700 1 --2- 172.21.15.40:0/2460020711 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f9c12e590 0x7f9f9c11c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:52.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.724+0000 7f9fa1614700 1 --2- 172.21.15.40:0/2460020711 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f9c12d8a0 0x7f9f9c11bb90 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f9f9800e9e0 tx=0x7f9f9800ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:52.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.724+0000 7f9f91ffb700 1 -- 172.21.15.40:0/2460020711 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9800ee80 con 0x7f9f9c12d8a0 2023-09-30T22:30:52.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.724+0000 7f9f91ffb700 1 -- 172.21.15.40:0/2460020711 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9800c850 con 0x7f9f9c12d8a0 2023-09-30T22:30:52.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.724+0000 7f9fa3878700 1 -- 172.21.15.40:0/2460020711 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f94009a70 con 0x7f9f9c12d8a0 2023-09-30T22:30:52.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.724+0000 7f9f91ffb700 1 -- 172.21.15.40:0/2460020711 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9800cc00 con 0x7f9f9c12d8a0 2023-09-30T22:30:52.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.724+0000 7f9fa3878700 1 -- 172.21.15.40:0/2460020711 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f9c09cdb0 con 0x7f9f9c12d8a0 2023-09-30T22:30:52.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.725+0000 7f9f91ffb700 1 -- 172.21.15.40:0/2460020711 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9f9800cd60 con 0x7f9f9c12d8a0 2023-09-30T22:30:52.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.725+0000 7f9fa3878700 1 -- 172.21.15.40:0/2460020711 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f9c0a0170 con 0x7f9f9c12d8a0 2023-09-30T22:30:52.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.725+0000 7f9f91ffb700 1 -- 172.21.15.40:0/2460020711 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9f9803fab0 con 0x7f9f9c12d8a0 2023-09-30T22:30:52.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.730+0000 7f9f91ffb700 1 -- 172.21.15.40:0/2460020711 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9f9801b3b0 con 0x7f9f9c12d8a0 2023-09-30T22:30:52.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.927+0000 7f9fa3878700 1 -- 172.21.15.40:0/2460020711 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9f9c062380 con 0x7f9f9c12d8a0 2023-09-30T22:30:52.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.927+0000 7f9f91ffb700 1 -- 172.21.15.40:0/2460020711 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9f98017030 con 0x7f9f9c12d8a0 2023-09-30T22:30:52.928 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:52.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.929+0000 7f9fa3878700 1 -- 172.21.15.40:0/2460020711 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f9c12d8a0 msgr2=0x7f9f9c11bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:52.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.929+0000 7f9fa3878700 1 --2- 172.21.15.40:0/2460020711 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f9c12d8a0 0x7f9f9c11bb90 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f9f9800e9e0 tx=0x7f9f9800ecf0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.929+0000 7f9fa3878700 1 -- 172.21.15.40:0/2460020711 shutdown_connections 2023-09-30T22:30:52.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.929+0000 7f9fa3878700 1 --2- 172.21.15.40:0/2460020711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f9c12eea0 0x7f9f9c11c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.929+0000 7f9fa3878700 1 --2- 172.21.15.40:0/2460020711 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f9c12d8a0 0x7f9f9c11bb90 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.929+0000 7f9fa3878700 1 --2- 172.21.15.40:0/2460020711 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9f9c12e590 0x7f9f9c11c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:52.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.929+0000 7f9fa3878700 1 -- 172.21.15.40:0/2460020711 >> 172.21.15.40:0/2460020711 conn(0x7f9f9c0a2a00 msgr2=0x7f9f9c131030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:52.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.929+0000 7f9fa3878700 1 -- 172.21.15.40:0/2460020711 shutdown_connections 2023-09-30T22:30:52.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:52.929+0000 7f9fa3878700 1 -- 172.21.15.40:0/2460020711 wait complete. 2023-09-30T22:30:52.942 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:53.452 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:53.494 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:53.498 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:53.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.596+0000 7f34bf29a700 1 Processor -- start 2023-09-30T22:30:53.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.597+0000 7f34bf29a700 1 -- start start 2023-09-30T22:30:53.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.597+0000 7f34bf29a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34b8133e00 0x7f34b81341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:53.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.597+0000 7f34bf29a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f34b809d400 0x7f34b809d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:53.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.597+0000 7f34bf29a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34b8133940 con 0x7f34b809dd70 2023-09-30T22:30:53.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.597+0000 7f34bf29a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34b809f0d0 con 0x7f34b809d400 2023-09-30T22:30:53.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.597+0000 7f34bf29a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b809e210 con 0x7f34b8133e00 2023-09-30T22:30:53.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.597+0000 7f34bc835700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f34b809d400 0x7f34b809d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:53.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.597+0000 7f34bc835700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f34b809d400 0x7f34b809d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42580/0 (socket says 172.21.15.40:42580) 2023-09-30T22:30:53.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.598+0000 7f34bc835700 1 -- 172.21.15.40:0/2976931748 learned_addr learned my addr 172.21.15.40:0/2976931748 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:53.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.598+0000 7f34bd837700 1 --1- 172.21.15.40:0/2976931748 >> v1:172.21.15.40:6789/0 conn(0x7f34b809dd70 0x7f34b813ac70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46186/0 (socket says 172.21.15.40:46186) 2023-09-30T22:30:53.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.598+0000 7f34bc835700 1 -- 172.21.15.40:0/2976931748 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34b8133e00 msgr2=0x7f34b81341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:53.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.598+0000 7f34bc835700 1 --2- 172.21.15.40:0/2976931748 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34b8133e00 0x7f34b81341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:53.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.598+0000 7f34bc835700 1 -- 172.21.15.40:0/2976931748 >> v1:172.21.15.40:6789/0 conn(0x7f34b809dd70 legacy=0x7f34b813ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:53.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.598+0000 7f34bc835700 1 -- 172.21.15.40:0/2976931748 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b8133be0 con 0x7f34b809d400 2023-09-30T22:30:53.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.598+0000 7f34bc835700 1 --2- 172.21.15.40:0/2976931748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34b809d400 0x7f34b809d830 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f34a80098f0 tx=0x7f34a8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17314bd2ee0d3d6f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:53.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.598+0000 7f34affff700 1 -- 172.21.15.40:0/2976931748 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a800b8a0 con 0x7f34b809d400 2023-09-30T22:30:53.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.598+0000 7f34affff700 1 -- 172.21.15.40:0/2976931748 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a800ba00 con 0x7f34b809d400 2023-09-30T22:30:53.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.598+0000 7f34affff700 1 -- 172.21.15.40:0/2976931748 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a800bd90 con 0x7f34b809d400 2023-09-30T22:30:53.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.599+0000 7f34bf29a700 1 -- 172.21.15.40:0/2976931748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34b809d400 msgr2=0x7f34b809d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:53.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.599+0000 7f34bf29a700 1 --2- 172.21.15.40:0/2976931748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34b809d400 0x7f34b809d830 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f34a80098f0 tx=0x7f34a8009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:53.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.599+0000 7f34bf29a700 1 -- 172.21.15.40:0/2976931748 shutdown_connections 2023-09-30T22:30:53.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.599+0000 7f34bf29a700 1 --2- 172.21.15.40:0/2976931748 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34b8133e00 0x7f34b81341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:53.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.599+0000 7f34bf29a700 1 --2- 172.21.15.40:0/2976931748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34b809d400 0x7f34b809d830 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:53.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.599+0000 7f34bf29a700 1 -- 172.21.15.40:0/2976931748 >> 172.21.15.40:0/2976931748 conn(0x7f34b80a2a00 msgr2=0x7f34b80a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:53.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.600+0000 7f34bf29a700 1 -- 172.21.15.40:0/2976931748 shutdown_connections 2023-09-30T22:30:53.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.600+0000 7f34bf29a700 1 -- 172.21.15.40:0/2976931748 wait complete. 2023-09-30T22:30:53.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.600+0000 7f34bf29a700 1 Processor -- start 2023-09-30T22:30:53.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.601+0000 7f34bf29a700 1 -- start start 2023-09-30T22:30:53.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.601+0000 7f34bf29a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34b809d400 0x7f34b811a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:53.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.601+0000 7f34bf29a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34b809dd70 0x7f34b811ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:53.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.601+0000 7f34bf29a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f34b8133e00 0x7f34b811b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:53.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.601+0000 7f34bf29a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b811caf0 con 0x7f34b809dd70 2023-09-30T22:30:53.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.601+0000 7f34bf29a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b811c650 con 0x7f34b809d400 2023-09-30T22:30:53.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.601+0000 7f34bf29a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34b811de40 con 0x7f34b8133e00 2023-09-30T22:30:53.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.601+0000 7f34bc835700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34b809dd70 0x7f34b811ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:53.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.601+0000 7f34bd036700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34b809d400 0x7f34b811a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:53.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.601+0000 7f34bc835700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34b809dd70 0x7f34b811ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42596/0 (socket says 172.21.15.40:42596) 2023-09-30T22:30:53.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.601+0000 7f34bc835700 1 -- 172.21.15.40:0/2284683272 learned_addr learned my addr 172.21.15.40:0/2284683272 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:53.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.601+0000 7f34bd837700 1 --2- 172.21.15.40:0/2284683272 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f34b8133e00 0x7f34b811b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:53.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.602+0000 7f34bd036700 1 -- 172.21.15.40:0/2284683272 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f34b8133e00 msgr2=0x7f34b811b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:53.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.602+0000 7f34bd036700 1 --2- 172.21.15.40:0/2284683272 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f34b8133e00 0x7f34b811b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:53.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.602+0000 7f34bd036700 1 -- 172.21.15.40:0/2284683272 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34b809dd70 msgr2=0x7f34b811ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:53.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.602+0000 7f34bd036700 1 --2- 172.21.15.40:0/2284683272 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34b809dd70 0x7f34b811ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:53.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.602+0000 7f34bd036700 1 -- 172.21.15.40:0/2284683272 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a8009550 con 0x7f34b809d400 2023-09-30T22:30:53.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.602+0000 7f34bd036700 1 --2- 172.21.15.40:0/2284683272 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34b809d400 0x7f34b811a910 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f34b400b480 tx=0x7f34b400b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:53.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.602+0000 7f34adffb700 1 -- 172.21.15.40:0/2284683272 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b4011830 con 0x7f34b809d400 2023-09-30T22:30:53.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.602+0000 7f34adffb700 1 -- 172.21.15.40:0/2284683272 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b4011990 con 0x7f34b809d400 2023-09-30T22:30:53.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.602+0000 7f34bf29a700 1 -- 172.21.15.40:0/2284683272 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b811e3e0 con 0x7f34b809d400 2023-09-30T22:30:53.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.602+0000 7f34adffb700 1 -- 172.21.15.40:0/2284683272 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b4011d40 con 0x7f34b809d400 2023-09-30T22:30:53.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.602+0000 7f34bf29a700 1 -- 172.21.15.40:0/2284683272 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34b80a1390 con 0x7f34b809d400 2023-09-30T22:30:53.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.603+0000 7f34adffb700 1 -- 172.21.15.40:0/2284683272 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f34b401a400 con 0x7f34b809d400 2023-09-30T22:30:53.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.603+0000 7f34adffb700 1 -- 172.21.15.40:0/2284683272 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f34b403f600 con 0x7f34b809d400 2023-09-30T22:30:53.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.603+0000 7f34bf29a700 1 -- 172.21.15.40:0/2284683272 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34b811db70 con 0x7f34b809d400 2023-09-30T22:30:53.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.608+0000 7f34adffb700 1 -- 172.21.15.40:0/2284683272 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f34b4015030 con 0x7f34b809d400 2023-09-30T22:30:53.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.634+0000 7fda2e44b700 1 Processor -- start 2023-09-30T22:30:53.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.635+0000 7fda2e44b700 1 -- start start 2023-09-30T22:30:53.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.635+0000 7fda2e44b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda2806f070 0x7fda2806f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:53.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.635+0000 7fda2e44b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda2806f980 0x7fda28097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:53.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.635+0000 7fda2e44b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fda2806fdb0 0x7fda280975d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:53.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.635+0000 7fda2e44b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda28071af0 con 0x7fda2806fdb0 2023-09-30T22:30:53.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.635+0000 7fda2e44b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda28070830 con 0x7fda2806f070 2023-09-30T22:30:53.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.635+0000 7fda2e44b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda28070ad0 con 0x7fda2806f980 2023-09-30T22:30:53.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.635+0000 7fda277fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda2806f980 0x7fda28097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:53.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.635+0000 7fda27fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda2806f070 0x7fda2806f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:53.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.635+0000 7fda277fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda2806f980 0x7fda28097090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60006/0 (socket says 172.21.15.40:60006) 2023-09-30T22:30:53.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.635+0000 7fda277fe700 1 -- 172.21.15.40:0/340531907 learned_addr learned my addr 172.21.15.40:0/340531907 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:53.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.635+0000 7fda2c9e8700 1 --2- 172.21.15.40:0/340531907 >> v2:172.21.15.40:3300/0 conn(0x7fda2806fdb0 0x7fda280975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:53.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.636+0000 7fda277fe700 1 -- 172.21.15.40:0/340531907 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda2806f070 msgr2=0x7fda2806f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:53.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.636+0000 7fda277fe700 1 --2- 172.21.15.40:0/340531907 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda2806f070 0x7fda2806f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:53.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.636+0000 7fda277fe700 1 -- 172.21.15.40:0/340531907 >> v2:172.21.15.40:3300/0 conn(0x7fda2806fdb0 msgr2=0x7fda280975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:53.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.636+0000 7fda277fe700 1 --2- 172.21.15.40:0/340531907 >> v2:172.21.15.40:3300/0 conn(0x7fda2806fdb0 0x7fda280975d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:53.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.636+0000 7fda277fe700 1 -- 172.21.15.40:0/340531907 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda28070de0 con 0x7fda2806f980 2023-09-30T22:30:53.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.636+0000 7fda2c9e8700 1 --2- 172.21.15.40:0/340531907 >> v2:172.21.15.40:3300/0 conn(0x7fda2806fdb0 0x7fda280975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:53.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.636+0000 7fda27fff700 1 --2- 172.21.15.40:0/340531907 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda2806f070 0x7fda2806f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:53.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.636+0000 7fda277fe700 1 --2- 172.21.15.40:0/340531907 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda2806f980 0x7fda28097090 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fda1c009920 tx=0x7fda1c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4c59203dad707c6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:53.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.636+0000 7fda26ffd700 1 -- 172.21.15.40:0/340531907 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c011830 con 0x7fda2806f980 2023-09-30T22:30:53.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.636+0000 7fda26ffd700 1 -- 172.21.15.40:0/340531907 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1c011990 con 0x7fda2806f980 2023-09-30T22:30:53.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.636+0000 7fda26ffd700 1 -- 172.21.15.40:0/340531907 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c011d20 con 0x7fda2806f980 2023-09-30T22:30:53.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.637+0000 7fda2e44b700 1 -- 172.21.15.40:0/340531907 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda2806f980 msgr2=0x7fda28097090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:53.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.637+0000 7fda2e44b700 1 --2- 172.21.15.40:0/340531907 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda2806f980 0x7fda28097090 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fda1c009920 tx=0x7fda1c009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:53.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.637+0000 7fda2e44b700 1 -- 172.21.15.40:0/340531907 shutdown_connections 2023-09-30T22:30:53.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.637+0000 7fda2e44b700 1 --2- 172.21.15.40:0/340531907 >> v2:172.21.15.40:3300/0 conn(0x7fda2806fdb0 0x7fda280975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:53.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.637+0000 7fda2e44b700 1 --2- 172.21.15.40:0/340531907 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda2806f070 0x7fda2806f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:53.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.637+0000 7fda2e44b700 1 --2- 172.21.15.40:0/340531907 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda2806f980 0x7fda28097090 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:53.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.637+0000 7fda2e44b700 1 -- 172.21.15.40:0/340531907 >> 172.21.15.40:0/340531907 conn(0x7fda280a41a0 msgr2=0x7fda280a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:53.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.637+0000 7fda2e44b700 1 -- 172.21.15.40:0/340531907 shutdown_connections 2023-09-30T22:30:53.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.637+0000 7fda2e44b700 1 -- 172.21.15.40:0/340531907 wait complete. 2023-09-30T22:30:53.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.638+0000 7fda2e44b700 1 Processor -- start 2023-09-30T22:30:53.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.639+0000 7fda2e44b700 1 -- start start 2023-09-30T22:30:53.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.639+0000 7fda2e44b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda2806f070 0x7fda2812c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:53.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.639+0000 7fda2e44b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda2806f980 0x7fda2812c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:53.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.639+0000 7fda2e44b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda2806fdb0 0x7fda2812cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:53.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.639+0000 7fda2e44b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2812f440 con 0x7fda2806f070 2023-09-30T22:30:53.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.639+0000 7fda2e44b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2809dfc0 con 0x7fda2806fdb0 2023-09-30T22:30:53.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.639+0000 7fda2e44b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda2812e4e0 con 0x7fda2806f980 2023-09-30T22:30:53.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.640+0000 7fda277fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda2806f980 0x7fda2812c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:53.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.640+0000 7fda277fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda2806f980 0x7fda2812c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60022/0 (socket says 172.21.15.40:60022) 2023-09-30T22:30:53.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.640+0000 7fda277fe700 1 -- 172.21.15.40:0/1611409173 learned_addr learned my addr 172.21.15.40:0/1611409173 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:53.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.640+0000 7fda2c9e8700 1 --2- 172.21.15.40:0/1611409173 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda2806fdb0 0x7fda2812cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:53.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.640+0000 7fda27fff700 1 --2- 172.21.15.40:0/1611409173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda2806f070 0x7fda2812c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:53.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.640+0000 7fda277fe700 1 -- 172.21.15.40:0/1611409173 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda2806fdb0 msgr2=0x7fda2812cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:53.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.640+0000 7fda277fe700 1 --2- 172.21.15.40:0/1611409173 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda2806fdb0 0x7fda2812cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:53.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.640+0000 7fda277fe700 1 -- 172.21.15.40:0/1611409173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda2806f070 msgr2=0x7fda2812c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:53.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.640+0000 7fda277fe700 1 --2- 172.21.15.40:0/1611409173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda2806f070 0x7fda2812c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:53.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.640+0000 7fda277fe700 1 -- 172.21.15.40:0/1611409173 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1800d940 con 0x7fda2806f980 2023-09-30T22:30:53.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.640+0000 7fda27fff700 1 --2- 172.21.15.40:0/1611409173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda2806f070 0x7fda2812c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:53.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.640+0000 7fda277fe700 1 --2- 172.21.15.40:0/1611409173 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda2806f980 0x7fda2812c810 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fda1c009c70 tx=0x7fda1c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:53.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.640+0000 7fda24ff9700 1 -- 172.21.15.40:0/1611409173 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c004450 con 0x7fda2806f980 2023-09-30T22:30:53.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.640+0000 7fda24ff9700 1 -- 172.21.15.40:0/1611409173 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1c0045d0 con 0x7fda2806f980 2023-09-30T22:30:53.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.640+0000 7fda2e44b700 1 -- 172.21.15.40:0/1611409173 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda20009a70 con 0x7fda2806f980 2023-09-30T22:30:53.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.640+0000 7fda24ff9700 1 -- 172.21.15.40:0/1611409173 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c0038e0 con 0x7fda2806f980 2023-09-30T22:30:53.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.640+0000 7fda2e44b700 1 -- 172.21.15.40:0/1611409173 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda1c009550 con 0x7fda2806f980 2023-09-30T22:30:53.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.641+0000 7fda24ff9700 1 -- 172.21.15.40:0/1611409173 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fda1c021070 con 0x7fda2806f980 2023-09-30T22:30:53.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.642+0000 7fda24ff9700 1 -- 172.21.15.40:0/1611409173 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fda1c040ad0 con 0x7fda2806f980 2023-09-30T22:30:53.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.642+0000 7fda2e44b700 1 -- 172.21.15.40:0/1611409173 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda28099630 con 0x7fda2806f980 2023-09-30T22:30:53.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.646+0000 7fda24ff9700 1 -- 172.21.15.40:0/1611409173 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fda1c029020 con 0x7fda2806f980 2023-09-30T22:30:53.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.678+0000 7fd265fa5700 1 Processor -- start 2023-09-30T22:30:53.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.678+0000 7fd265fa5700 1 -- start start 2023-09-30T22:30:53.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.678+0000 7fd265fa5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd26006f3a0 0x7fd26006c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:53.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.678+0000 7fd265fa5700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd260139380 0x7fd26013b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:53.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.678+0000 7fd265fa5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2600a0780 con 0x7fd26009fbb0 2023-09-30T22:30:53.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.678+0000 7fd265fa5700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2600a0590 con 0x7fd260139380 2023-09-30T22:30:53.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.678+0000 7fd265fa5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd26006bac0 con 0x7fd26006f3a0 2023-09-30T22:30:53.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.678+0000 7fd25ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd260139380 0x7fd26013b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:53.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.678+0000 7fd25f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd26006f3a0 0x7fd26006c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:53.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.678+0000 7fd25ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd260139380 0x7fd26013b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42622/0 (socket says 172.21.15.40:42622) 2023-09-30T22:30:53.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.678+0000 7fd25ffff700 1 -- 172.21.15.40:0/2810634887 learned_addr learned my addr 172.21.15.40:0/2810634887 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:53.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.679+0000 7fd25ffff700 1 -- 172.21.15.40:0/2810634887 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd26006f3a0 msgr2=0x7fd26006c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:53.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.679+0000 7fd25ffff700 1 --2- 172.21.15.40:0/2810634887 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd26006f3a0 0x7fd26006c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:53.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.679+0000 7fd25ffff700 1 -- 172.21.15.40:0/2810634887 >> v1:172.21.15.40:6789/0 conn(0x7fd26009fbb0 legacy=0x7fd26006ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:53.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.679+0000 7fd25ffff700 1 -- 172.21.15.40:0/2810634887 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd26006df90 con 0x7fd260139380 2023-09-30T22:30:53.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.679+0000 7fd25f7fe700 1 --2- 172.21.15.40:0/2810634887 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd26006f3a0 0x7fd26006c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:53.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.679+0000 7fd25ffff700 1 --2- 172.21.15.40:0/2810634887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd260139380 0x7fd26013b760 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fd2580098f0 tx=0x7fd258009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6505401d63550f3f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:53.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.679+0000 7fd25e7fc700 1 -- 172.21.15.40:0/2810634887 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd258011830 con 0x7fd260139380 2023-09-30T22:30:53.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.679+0000 7fd25e7fc700 1 -- 172.21.15.40:0/2810634887 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd258011990 con 0x7fd260139380 2023-09-30T22:30:53.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.679+0000 7fd25e7fc700 1 -- 172.21.15.40:0/2810634887 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd258011d20 con 0x7fd260139380 2023-09-30T22:30:53.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.680+0000 7fd265fa5700 1 -- 172.21.15.40:0/2810634887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd260139380 msgr2=0x7fd26013b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:53.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.680+0000 7fd265fa5700 1 --2- 172.21.15.40:0/2810634887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd260139380 0x7fd26013b760 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fd2580098f0 tx=0x7fd258009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:53.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.680+0000 7fd265fa5700 1 -- 172.21.15.40:0/2810634887 shutdown_connections 2023-09-30T22:30:53.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.680+0000 7fd265fa5700 1 --2- 172.21.15.40:0/2810634887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd260139380 0x7fd26013b760 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:53.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.680+0000 7fd265fa5700 1 --2- 172.21.15.40:0/2810634887 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd26006f3a0 0x7fd26006c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:53.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.680+0000 7fd265fa5700 1 -- 172.21.15.40:0/2810634887 >> 172.21.15.40:0/2810634887 conn(0x7fd2600a41a0 msgr2=0x7fd2600a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:53.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.680+0000 7fd265fa5700 1 -- 172.21.15.40:0/2810634887 shutdown_connections 2023-09-30T22:30:53.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.680+0000 7fd265fa5700 1 -- 172.21.15.40:0/2810634887 wait complete. 2023-09-30T22:30:53.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.681+0000 7fd265fa5700 1 Processor -- start 2023-09-30T22:30:53.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.681+0000 7fd265fa5700 1 -- start start 2023-09-30T22:30:53.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.681+0000 7fd265fa5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd26006f3a0 0x7fd2601387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:53.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.681+0000 7fd265fa5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd26009fbb0 0x7fd260138d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:53.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.681+0000 7fd265fa5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd260139380 0x7fd260095b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:53.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.681+0000 7fd265fa5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2600972d0 con 0x7fd26009fbb0 2023-09-30T22:30:53.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.681+0000 7fd265fa5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2600711c0 con 0x7fd26006f3a0 2023-09-30T22:30:53.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.681+0000 7fd265fa5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd260096cc0 con 0x7fd260139380 2023-09-30T22:30:53.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.681+0000 7fd25f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd26006f3a0 0x7fd2601387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:53.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.681+0000 7fd25effd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd26009fbb0 0x7fd260138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:53.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.681+0000 7fd25f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd26006f3a0 0x7fd2601387d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42728/0 (socket says 172.21.15.40:42728) 2023-09-30T22:30:53.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.681+0000 7fd25f7fe700 1 -- 172.21.15.40:0/119657654 learned_addr learned my addr 172.21.15.40:0/119657654 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:53.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.682+0000 7fd25ffff700 1 --2- 172.21.15.40:0/119657654 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd260139380 0x7fd260095b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:53.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.682+0000 7fd25effd700 1 -- 172.21.15.40:0/119657654 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd260139380 msgr2=0x7fd260095b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:53.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.682+0000 7fd25effd700 1 --2- 172.21.15.40:0/119657654 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd260139380 0x7fd260095b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:53.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.682+0000 7fd25effd700 1 -- 172.21.15.40:0/119657654 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd26006f3a0 msgr2=0x7fd2601387d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:53.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.682+0000 7fd25effd700 1 --2- 172.21.15.40:0/119657654 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd26006f3a0 0x7fd2601387d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:53.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.682+0000 7fd25effd700 1 -- 172.21.15.40:0/119657654 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd250009a70 con 0x7fd26009fbb0 2023-09-30T22:30:53.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.682+0000 7fd25f7fe700 1 --2- 172.21.15.40:0/119657654 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd26006f3a0 0x7fd2601387d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:53.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.682+0000 7fd25effd700 1 --2- 172.21.15.40:0/119657654 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd26009fbb0 0x7fd260138d10 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fd254000f60 tx=0x7fd25400c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:53.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.682+0000 7fd247fff700 1 -- 172.21.15.40:0/119657654 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2540052d0 con 0x7fd26009fbb0 2023-09-30T22:30:53.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.682+0000 7fd247fff700 1 -- 172.21.15.40:0/119657654 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd254005430 con 0x7fd26009fbb0 2023-09-30T22:30:53.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.682+0000 7fd265fa5700 1 -- 172.21.15.40:0/119657654 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd258009550 con 0x7fd26009fbb0 2023-09-30T22:30:53.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.682+0000 7fd247fff700 1 -- 172.21.15.40:0/119657654 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2540038c0 con 0x7fd26009fbb0 2023-09-30T22:30:53.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.682+0000 7fd265fa5700 1 -- 172.21.15.40:0/119657654 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd260071eb0 con 0x7fd26009fbb0 2023-09-30T22:30:53.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.683+0000 7fd247fff700 1 -- 172.21.15.40:0/119657654 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd254003c30 con 0x7fd26009fbb0 2023-09-30T22:30:53.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.683+0000 7fd247fff700 1 -- 172.21.15.40:0/119657654 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd25403ec20 con 0x7fd26009fbb0 2023-09-30T22:30:53.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.684+0000 7fd265fa5700 1 -- 172.21.15.40:0/119657654 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd260062380 con 0x7fd26009fbb0 2023-09-30T22:30:53.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.689+0000 7fd247fff700 1 -- 172.21.15.40:0/119657654 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd254017080 con 0x7fd26009fbb0 2023-09-30T22:30:53.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.811+0000 7f34bf29a700 1 -- 172.21.15.40:0/2284683272 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f34b8062380 con 0x7f34b809d400 2023-09-30T22:30:53.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.811+0000 7f34adffb700 1 -- 172.21.15.40:0/2284683272 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f34b4029090 con 0x7f34b809d400 2023-09-30T22:30:53.812 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:53.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.815+0000 7f34bf29a700 1 -- 172.21.15.40:0/2284683272 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34b809d400 msgr2=0x7f34b811a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:53.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.815+0000 7f34bf29a700 1 --2- 172.21.15.40:0/2284683272 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34b809d400 0x7f34b811a910 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f34b400b480 tx=0x7f34b400b790 comp rx=0 tx=0).stop 2023-09-30T22:30:53.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.815+0000 7f34bf29a700 1 -- 172.21.15.40:0/2284683272 shutdown_connections 2023-09-30T22:30:53.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.815+0000 7f34bf29a700 1 --2- 172.21.15.40:0/2284683272 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f34b8133e00 0x7f34b811b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:53.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.815+0000 7f34bf29a700 1 --2- 172.21.15.40:0/2284683272 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34b809d400 0x7f34b811a910 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:53.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.815+0000 7f34bf29a700 1 --2- 172.21.15.40:0/2284683272 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34b809dd70 0x7f34b811ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:53.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.815+0000 7f34bf29a700 1 -- 172.21.15.40:0/2284683272 >> 172.21.15.40:0/2284683272 conn(0x7f34b80a2a00 msgr2=0x7f34b81bb340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:53.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.815+0000 7f34bf29a700 1 -- 172.21.15.40:0/2284683272 shutdown_connections 2023-09-30T22:30:53.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.815+0000 7f34bf29a700 1 -- 172.21.15.40:0/2284683272 wait complete. 2023-09-30T22:30:53.832 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:53.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.854+0000 7fda2e44b700 1 -- 172.21.15.40:0/1611409173 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fda2812dd40 con 0x7fda2806f980 2023-09-30T22:30:53.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.855+0000 7fda24ff9700 1 -- 172.21.15.40:0/1611409173 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fda1c032090 con 0x7fda2806f980 2023-09-30T22:30:53.856 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:53.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.856+0000 7fda2e44b700 1 -- 172.21.15.40:0/1611409173 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda2806f980 msgr2=0x7fda2812c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:53.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.856+0000 7fda2e44b700 1 --2- 172.21.15.40:0/1611409173 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda2806f980 0x7fda2812c810 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fda1c009c70 tx=0x7fda1c004750 comp rx=0 tx=0).stop 2023-09-30T22:30:53.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.857+0000 7fda2e44b700 1 -- 172.21.15.40:0/1611409173 shutdown_connections 2023-09-30T22:30:53.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.857+0000 7fda2e44b700 1 --2- 172.21.15.40:0/1611409173 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda2806fdb0 0x7fda2812cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:53.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.857+0000 7fda2e44b700 1 --2- 172.21.15.40:0/1611409173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda2806f070 0x7fda2812c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:53.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.857+0000 7fda2e44b700 1 --2- 172.21.15.40:0/1611409173 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fda2806f980 0x7fda2812c810 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:53.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.857+0000 7fda2e44b700 1 -- 172.21.15.40:0/1611409173 >> 172.21.15.40:0/1611409173 conn(0x7fda280a41a0 msgr2=0x7fda280972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:53.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.857+0000 7fda2e44b700 1 -- 172.21.15.40:0/1611409173 shutdown_connections 2023-09-30T22:30:53.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.857+0000 7fda2e44b700 1 -- 172.21.15.40:0/1611409173 wait complete. 2023-09-30T22:30:53.870 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:53.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.885+0000 7fd265fa5700 1 -- 172.21.15.40:0/119657654 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd26006e3c0 con 0x7fd26009fbb0 2023-09-30T22:30:53.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.886+0000 7fd247fff700 1 -- 172.21.15.40:0/119657654 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd25401bb10 con 0x7fd26009fbb0 2023-09-30T22:30:53.889 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:53.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.888+0000 7fd265fa5700 1 -- 172.21.15.40:0/119657654 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd26009fbb0 msgr2=0x7fd260138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:53.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.888+0000 7fd265fa5700 1 --2- 172.21.15.40:0/119657654 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd26009fbb0 0x7fd260138d10 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fd254000f60 tx=0x7fd25400c6e0 comp rx=0 tx=0).stop 2023-09-30T22:30:53.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.888+0000 7fd265fa5700 1 -- 172.21.15.40:0/119657654 shutdown_connections 2023-09-30T22:30:53.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.888+0000 7fd265fa5700 1 --2- 172.21.15.40:0/119657654 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd260139380 0x7fd260095b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:53.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.888+0000 7fd265fa5700 1 --2- 172.21.15.40:0/119657654 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd26006f3a0 0x7fd2601387d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:53.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.888+0000 7fd265fa5700 1 --2- 172.21.15.40:0/119657654 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd26009fbb0 0x7fd260138d10 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:53.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.888+0000 7fd265fa5700 1 -- 172.21.15.40:0/119657654 >> 172.21.15.40:0/119657654 conn(0x7fd2600a41a0 msgr2=0x7fd26009a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:53.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.888+0000 7fd265fa5700 1 -- 172.21.15.40:0/119657654 shutdown_connections 2023-09-30T22:30:53.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:53.888+0000 7fd265fa5700 1 -- 172.21.15.40:0/119657654 wait complete. 2023-09-30T22:30:53.901 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:53.943 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:54.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.069+0000 7f68674f7700 1 Processor -- start 2023-09-30T22:30:54.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.069+0000 7f68674f7700 1 -- start start 2023-09-30T22:30:54.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.069+0000 7f68674f7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6860133e00 0x7f68601341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:54.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.069+0000 7f68674f7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f686009d400 0x7f686009d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:54.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.069+0000 7f68674f7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6860133940 con 0x7f686009dd70 2023-09-30T22:30:54.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.069+0000 7f68674f7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f686009f0d0 con 0x7f686009d400 2023-09-30T22:30:54.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.069+0000 7f68674f7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f686009e210 con 0x7f6860133e00 2023-09-30T22:30:54.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.070+0000 7f6865293700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6860133e00 0x7f68601341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:54.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.070+0000 7f6864a92700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f686009d400 0x7f686009d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:54.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.070+0000 7f6865293700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6860133e00 0x7f68601341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60046/0 (socket says 172.21.15.40:60046) 2023-09-30T22:30:54.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.070+0000 7f6865293700 1 -- 172.21.15.40:0/1038425321 learned_addr learned my addr 172.21.15.40:0/1038425321 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:54.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.070+0000 7f6865293700 1 -- 172.21.15.40:0/1038425321 >> v2:172.21.15.40:3300/0 conn(0x7f686009d400 msgr2=0x7f686009d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:54.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.070+0000 7f6865293700 1 --2- 172.21.15.40:0/1038425321 >> v2:172.21.15.40:3300/0 conn(0x7f686009d400 0x7f686009d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.070+0000 7f6865293700 1 -- 172.21.15.40:0/1038425321 >> v1:172.21.15.40:6789/0 conn(0x7f686009dd70 legacy=0x7f686013ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:54.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.070+0000 7f6865293700 1 -- 172.21.15.40:0/1038425321 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6860133be0 con 0x7f6860133e00 2023-09-30T22:30:54.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.070+0000 7f6864a92700 1 --2- 172.21.15.40:0/1038425321 >> v2:172.21.15.40:3300/0 conn(0x7f686009d400 0x7f686009d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:54.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.070+0000 7f6865293700 1 --2- 172.21.15.40:0/1038425321 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6860133e00 0x7f68601341d0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f685c0098f0 tx=0x7f685c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ba0365b7822f420 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:54.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.070+0000 7f6857fff700 1 -- 172.21.15.40:0/1038425321 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c011830 con 0x7f6860133e00 2023-09-30T22:30:54.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.070+0000 7f6857fff700 1 -- 172.21.15.40:0/1038425321 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685c011990 con 0x7f6860133e00 2023-09-30T22:30:54.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.070+0000 7f6857fff700 1 -- 172.21.15.40:0/1038425321 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c011d20 con 0x7f6860133e00 2023-09-30T22:30:54.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.071+0000 7f68674f7700 1 -- 172.21.15.40:0/1038425321 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6860133e00 msgr2=0x7f68601341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:54.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.071+0000 7f68674f7700 1 --2- 172.21.15.40:0/1038425321 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6860133e00 0x7f68601341d0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f685c0098f0 tx=0x7f685c009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:54.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.071+0000 7f68674f7700 1 -- 172.21.15.40:0/1038425321 shutdown_connections 2023-09-30T22:30:54.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.071+0000 7f68674f7700 1 --2- 172.21.15.40:0/1038425321 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6860133e00 0x7f68601341d0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.071+0000 7f68674f7700 1 --2- 172.21.15.40:0/1038425321 >> v2:172.21.15.40:3300/0 conn(0x7f686009d400 0x7f686009d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.071+0000 7f68674f7700 1 -- 172.21.15.40:0/1038425321 >> 172.21.15.40:0/1038425321 conn(0x7f68600a2a00 msgr2=0x7f68600a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:54.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.071+0000 7f68674f7700 1 -- 172.21.15.40:0/1038425321 shutdown_connections 2023-09-30T22:30:54.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.071+0000 7f68674f7700 1 -- 172.21.15.40:0/1038425321 wait complete. 2023-09-30T22:30:54.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.072+0000 7f68674f7700 1 Processor -- start 2023-09-30T22:30:54.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.072+0000 7f68674f7700 1 -- start start 2023-09-30T22:30:54.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.072+0000 7f68674f7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f686009d400 0x7f686011ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:54.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.072+0000 7f68674f7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f686009dd70 0x7f686011b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:54.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.072+0000 7f68674f7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6860133e00 0x7f686011b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:54.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.072+0000 7f68674f7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686011e3d0 con 0x7f686009d400 2023-09-30T22:30:54.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.072+0000 7f68674f7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f686011e5b0 con 0x7f686009dd70 2023-09-30T22:30:54.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.072+0000 7f68674f7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f686011eab0 con 0x7f6860133e00 2023-09-30T22:30:54.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.072+0000 7f6865293700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f686009d400 0x7f686011ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:54.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.072+0000 7f6864a92700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f686009dd70 0x7f686011b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:54.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.072+0000 7f6865293700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f686009d400 0x7f686011ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42646/0 (socket says 172.21.15.40:42646) 2023-09-30T22:30:54.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.072+0000 7f6865293700 1 -- 172.21.15.40:0/3064065350 learned_addr learned my addr 172.21.15.40:0/3064065350 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:54.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.072+0000 7f6865a94700 1 --2- 172.21.15.40:0/3064065350 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6860133e00 0x7f686011b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:54.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.073+0000 7f6865293700 1 -- 172.21.15.40:0/3064065350 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6860133e00 msgr2=0x7f686011b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:54.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.073+0000 7f6865293700 1 --2- 172.21.15.40:0/3064065350 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6860133e00 0x7f686011b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.073+0000 7f6865293700 1 -- 172.21.15.40:0/3064065350 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f686009dd70 msgr2=0x7f686011b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:54.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.073+0000 7f6865293700 1 --2- 172.21.15.40:0/3064065350 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f686009dd70 0x7f686011b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.073+0000 7f6865293700 1 -- 172.21.15.40:0/3064065350 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68500094a0 con 0x7f686009d400 2023-09-30T22:30:54.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.073+0000 7f6864a92700 1 --2- 172.21.15.40:0/3064065350 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f686009dd70 0x7f686011b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:54.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.073+0000 7f6865293700 1 --2- 172.21.15.40:0/3064065350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f686009d400 0x7f686011ab50 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f686009e350 tx=0x7f685c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:54.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.073+0000 7f6855ffb700 1 -- 172.21.15.40:0/3064065350 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c004510 con 0x7f686009d400 2023-09-30T22:30:54.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.073+0000 7f6855ffb700 1 -- 172.21.15.40:0/3064065350 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685c0036a0 con 0x7f686009d400 2023-09-30T22:30:54.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.073+0000 7f68674f7700 1 -- 172.21.15.40:0/3064065350 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f685c009550 con 0x7f686009d400 2023-09-30T22:30:54.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.073+0000 7f6855ffb700 1 -- 172.21.15.40:0/3064065350 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c003a50 con 0x7f686009d400 2023-09-30T22:30:54.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.073+0000 7f68674f7700 1 -- 172.21.15.40:0/3064065350 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f686011e010 con 0x7f686009d400 2023-09-30T22:30:54.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.074+0000 7f6855ffb700 1 -- 172.21.15.40:0/3064065350 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f685c003bb0 con 0x7f686009d400 2023-09-30T22:30:54.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.074+0000 7f6855ffb700 1 -- 172.21.15.40:0/3064065350 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f685c040760 con 0x7f686009d400 2023-09-30T22:30:54.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.074+0000 7f68674f7700 1 -- 172.21.15.40:0/3064065350 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f686012fb50 con 0x7f686009d400 2023-09-30T22:30:54.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.079+0000 7f6855ffb700 1 -- 172.21.15.40:0/3064065350 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f685c01a420 con 0x7f686009d400 2023-09-30T22:30:54.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.274+0000 7f68674f7700 1 -- 172.21.15.40:0/3064065350 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6860062380 con 0x7f686009d400 2023-09-30T22:30:54.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.274+0000 7f6855ffb700 1 -- 172.21.15.40:0/3064065350 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f685c028030 con 0x7f686009d400 2023-09-30T22:30:54.275 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:54.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.276+0000 7f68674f7700 1 -- 172.21.15.40:0/3064065350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f686009d400 msgr2=0x7f686011ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:54.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.276+0000 7f68674f7700 1 --2- 172.21.15.40:0/3064065350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f686009d400 0x7f686011ab50 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f686009e350 tx=0x7f685c004750 comp rx=0 tx=0).stop 2023-09-30T22:30:54.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.276+0000 7f68674f7700 1 -- 172.21.15.40:0/3064065350 shutdown_connections 2023-09-30T22:30:54.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.276+0000 7f68674f7700 1 --2- 172.21.15.40:0/3064065350 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6860133e00 0x7f686011b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.276+0000 7f68674f7700 1 --2- 172.21.15.40:0/3064065350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f686009d400 0x7f686011ab50 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.276+0000 7f68674f7700 1 --2- 172.21.15.40:0/3064065350 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f686009dd70 0x7f686011b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.276+0000 7f68674f7700 1 -- 172.21.15.40:0/3064065350 >> 172.21.15.40:0/3064065350 conn(0x7f68600a2a00 msgr2=0x7f68601325e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:54.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.276+0000 7f68674f7700 1 -- 172.21.15.40:0/3064065350 shutdown_connections 2023-09-30T22:30:54.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.276+0000 7f68674f7700 1 -- 172.21.15.40:0/3064065350 wait complete. 2023-09-30T22:30:54.289 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:54.833 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:54.871 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:54.902 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:54.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.975+0000 7f5c564cc700 1 Processor -- start 2023-09-30T22:30:54.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.975+0000 7f5c564cc700 1 -- start start 2023-09-30T22:30:54.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.975+0000 7f5c564cc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5c5006a6d0 0x7f5c5006aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:54.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.975+0000 7f5c564cc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c50131fc0 0x7f5c50139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:54.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.975+0000 7f5c564cc700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c5009eb50 con 0x7f5c5006afe0 2023-09-30T22:30:54.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.975+0000 7f5c564cc700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c5009dde0 con 0x7f5c5006a6d0 2023-09-30T22:30:54.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.975+0000 7f5c564cc700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5009d4a0 con 0x7f5c50131fc0 2023-09-30T22:30:54.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.975+0000 7f5c4ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5c5006a6d0 0x7f5c5006aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:54.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.975+0000 7f5c54a69700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c50131fc0 0x7f5c50139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:54.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.975+0000 7f5c54a69700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c50131fc0 0x7f5c50139b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60062/0 (socket says 172.21.15.40:60062) 2023-09-30T22:30:54.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.975+0000 7f5c4ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5c5006a6d0 0x7f5c5006aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42658/0 (socket says 172.21.15.40:42658) 2023-09-30T22:30:54.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.975+0000 7f5c54a69700 1 -- 172.21.15.40:0/2101215640 learned_addr learned my addr 172.21.15.40:0/2101215640 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:54.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.976+0000 7f5c4ffff700 1 -- 172.21.15.40:0/2101215640 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c50131fc0 msgr2=0x7f5c50139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:54.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.976+0000 7f5c4ffff700 1 --2- 172.21.15.40:0/2101215640 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c50131fc0 0x7f5c50139b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.976+0000 7f5c4ffff700 1 -- 172.21.15.40:0/2101215640 >> v1:172.21.15.40:6789/0 conn(0x7f5c5006afe0 legacy=0x7f5c501318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:54.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.976+0000 7f5c4ffff700 1 -- 172.21.15.40:0/2101215640 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c5009f5f0 con 0x7f5c5006a6d0 2023-09-30T22:30:54.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.976+0000 7f5c54a69700 1 --2- 172.21.15.40:0/2101215640 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c50131fc0 0x7f5c50139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:54.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.976+0000 7f5c4ffff700 1 --2- 172.21.15.40:0/2101215640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c5006a6d0 0x7f5c5006aaa0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f5c40009820 tx=0x7f5c40009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e38c742fa6119fc6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:54.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.976+0000 7f5c4effd700 1 -- 172.21.15.40:0/2101215640 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c40005e30 con 0x7f5c5006a6d0 2023-09-30T22:30:54.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.976+0000 7f5c4effd700 1 -- 172.21.15.40:0/2101215640 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c40006030 con 0x7f5c5006a6d0 2023-09-30T22:30:54.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.976+0000 7f5c4effd700 1 -- 172.21.15.40:0/2101215640 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c400063c0 con 0x7f5c5006a6d0 2023-09-30T22:30:54.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.977+0000 7f5c564cc700 1 -- 172.21.15.40:0/2101215640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c5006a6d0 msgr2=0x7f5c5006aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:54.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.977+0000 7f5c564cc700 1 --2- 172.21.15.40:0/2101215640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c5006a6d0 0x7f5c5006aaa0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f5c40009820 tx=0x7f5c40009b30 comp rx=0 tx=0).stop 2023-09-30T22:30:54.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.977+0000 7f5c564cc700 1 -- 172.21.15.40:0/2101215640 shutdown_connections 2023-09-30T22:30:54.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.977+0000 7f5c564cc700 1 --2- 172.21.15.40:0/2101215640 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c50131fc0 0x7f5c50139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.977+0000 7f5c564cc700 1 --2- 172.21.15.40:0/2101215640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c5006a6d0 0x7f5c5006aaa0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.977+0000 7f5c564cc700 1 -- 172.21.15.40:0/2101215640 >> 172.21.15.40:0/2101215640 conn(0x7f5c5009fb20 msgr2=0x7f5c5009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:54.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.977+0000 7f5c564cc700 1 -- 172.21.15.40:0/2101215640 shutdown_connections 2023-09-30T22:30:54.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.977+0000 7f5c564cc700 1 -- 172.21.15.40:0/2101215640 wait complete. 2023-09-30T22:30:54.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.978+0000 7f5c564cc700 1 Processor -- start 2023-09-30T22:30:54.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.978+0000 7f5c564cc700 1 -- start start 2023-09-30T22:30:54.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.979+0000 7f5c564cc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c5006a6d0 0x7f5c5009afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:54.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.979+0000 7f5c564cc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c5006afe0 0x7f5c5009b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:54.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.979+0000 7f5c564cc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c50131fc0 0x7f5c501c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:54.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.979+0000 7f5c564cc700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5009a980 con 0x7f5c5006afe0 2023-09-30T22:30:54.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.979+0000 7f5c564cc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c50125260 con 0x7f5c50131fc0 2023-09-30T22:30:54.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.979+0000 7f5c564cc700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c50125e60 con 0x7f5c5006a6d0 2023-09-30T22:30:54.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.979+0000 7f5c4ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c5006a6d0 0x7f5c5009afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:54.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.979+0000 7f5c4ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c5006a6d0 0x7f5c5009afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60074/0 (socket says 172.21.15.40:60074) 2023-09-30T22:30:54.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.979+0000 7f5c4ffff700 1 -- 172.21.15.40:0/230617688 learned_addr learned my addr 172.21.15.40:0/230617688 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:54.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.979+0000 7f5c4f7fe700 1 --2- 172.21.15.40:0/230617688 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c5006afe0 0x7f5c5009b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:54.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.979+0000 7f5c54a69700 1 --2- 172.21.15.40:0/230617688 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c50131fc0 0x7f5c501c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:54.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.979+0000 7f5c4f7fe700 1 -- 172.21.15.40:0/230617688 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c5006a6d0 msgr2=0x7f5c5009afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:54.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.979+0000 7f5c4f7fe700 1 --2- 172.21.15.40:0/230617688 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c5006a6d0 0x7f5c5009afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.979+0000 7f5c4f7fe700 1 -- 172.21.15.40:0/230617688 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c50131fc0 msgr2=0x7f5c501c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:54.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.979+0000 7f5c4f7fe700 1 --2- 172.21.15.40:0/230617688 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c50131fc0 0x7f5c501c8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:54.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.979+0000 7f5c4f7fe700 1 -- 172.21.15.40:0/230617688 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c48009b30 con 0x7f5c5006afe0 2023-09-30T22:30:54.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.979+0000 7f5c4ffff700 1 --2- 172.21.15.40:0/230617688 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c5006a6d0 0x7f5c5009afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:54.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.979+0000 7f5c54a69700 1 --2- 172.21.15.40:0/230617688 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c50131fc0 0x7f5c501c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:54.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.979+0000 7f5c4f7fe700 1 --2- 172.21.15.40:0/230617688 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c5006afe0 0x7f5c5009b4e0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f5c44000f60 tx=0x7f5c4400c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:54.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.980+0000 7f5c4cff9700 1 -- 172.21.15.40:0/230617688 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c440052d0 con 0x7f5c5006afe0 2023-09-30T22:30:54.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.980+0000 7f5c4cff9700 1 -- 172.21.15.40:0/230617688 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c44005430 con 0x7f5c5006afe0 2023-09-30T22:30:54.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.980+0000 7f5c564cc700 1 -- 172.21.15.40:0/230617688 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c40009430 con 0x7f5c5006afe0 2023-09-30T22:30:54.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.980+0000 7f5c4cff9700 1 -- 172.21.15.40:0/230617688 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c440038c0 con 0x7f5c5006afe0 2023-09-30T22:30:54.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.980+0000 7f5c564cc700 1 -- 172.21.15.40:0/230617688 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c50124ce0 con 0x7f5c5006afe0 2023-09-30T22:30:54.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.981+0000 7f5c4cff9700 1 -- 172.21.15.40:0/230617688 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5c44003a20 con 0x7f5c5006afe0 2023-09-30T22:30:54.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.981+0000 7f5c4cff9700 1 -- 172.21.15.40:0/230617688 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5c4403e9f0 con 0x7f5c5006afe0 2023-09-30T22:30:54.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.981+0000 7f5c564cc700 1 -- 172.21.15.40:0/230617688 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c50126200 con 0x7f5c5006afe0 2023-09-30T22:30:54.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:54.986+0000 7f5c4cff9700 1 -- 172.21.15.40:0/230617688 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5c44017080 con 0x7f5c5006afe0 2023-09-30T22:30:55.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.016+0000 7fed9b905700 1 Processor -- start 2023-09-30T22:30:55.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.016+0000 7fed9b905700 1 -- start start 2023-09-30T22:30:55.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.017+0000 7fed9b905700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fed9406f070 0x7fed9406f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:55.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.017+0000 7fed9b905700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed9406fdb0 0x7fed940977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:55.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.017+0000 7fed9b905700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed94070830 con 0x7fed9406f980 2023-09-30T22:30:55.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.017+0000 7fed9b905700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed94070ad0 con 0x7fed9406f070 2023-09-30T22:30:55.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.017+0000 7fed9b905700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed94070de0 con 0x7fed9406fdb0 2023-09-30T22:30:55.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.017+0000 7fed996a1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fed9406f070 0x7fed9406f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:55.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.017+0000 7fed99ea2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed9406fdb0 0x7fed940977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:55.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.017+0000 7fed99ea2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed9406fdb0 0x7fed940977a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42742/0 (socket says 172.21.15.40:42742) 2023-09-30T22:30:55.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.017+0000 7fed99ea2700 1 -- 172.21.15.40:0/1805107287 learned_addr learned my addr 172.21.15.40:0/1805107287 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:55.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.017+0000 7fed996a1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fed9406f070 0x7fed9406f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42678/0 (socket says 172.21.15.40:42678) 2023-09-30T22:30:55.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.017+0000 7fed99ea2700 1 -- 172.21.15.40:0/1805107287 >> v2:172.21.15.40:3300/0 conn(0x7fed9406f070 msgr2=0x7fed9406f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:55.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.017+0000 7fed99ea2700 1 --2- 172.21.15.40:0/1805107287 >> v2:172.21.15.40:3300/0 conn(0x7fed9406f070 0x7fed9406f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.017+0000 7fed99ea2700 1 -- 172.21.15.40:0/1805107287 >> v1:172.21.15.40:6789/0 conn(0x7fed9406f980 legacy=0x7fed94097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:55.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.017+0000 7fed99ea2700 1 -- 172.21.15.40:0/1805107287 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9409fe20 con 0x7fed9406fdb0 2023-09-30T22:30:55.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.018+0000 7fed99ea2700 1 --2- 172.21.15.40:0/1805107287 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed9406fdb0 0x7fed940977a0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009e50 tx=0x7fed8c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb4cb3eec442d1ef server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:55.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.018+0000 7fed8bfff700 1 -- 172.21.15.40:0/1805107287 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8c00e070 con 0x7fed9406fdb0 2023-09-30T22:30:55.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.018+0000 7fed8bfff700 1 -- 172.21.15.40:0/1805107287 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8c00b910 con 0x7fed9406fdb0 2023-09-30T22:30:55.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.018+0000 7fed8bfff700 1 -- 172.21.15.40:0/1805107287 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8c00bcc0 con 0x7fed9406fdb0 2023-09-30T22:30:55.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.018+0000 7fed9b905700 1 -- 172.21.15.40:0/1805107287 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed9406fdb0 msgr2=0x7fed940977a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:55.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.018+0000 7fed9b905700 1 --2- 172.21.15.40:0/1805107287 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed9406fdb0 0x7fed940977a0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009e50 tx=0x7fed8c00b330 comp rx=0 tx=0).stop 2023-09-30T22:30:55.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.018+0000 7fed9b905700 1 -- 172.21.15.40:0/1805107287 shutdown_connections 2023-09-30T22:30:55.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.018+0000 7fed9b905700 1 --2- 172.21.15.40:0/1805107287 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed9406fdb0 0x7fed940977a0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.018+0000 7fed9b905700 1 --2- 172.21.15.40:0/1805107287 >> v2:172.21.15.40:3300/0 conn(0x7fed9406f070 0x7fed9406f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.018+0000 7fed9b905700 1 -- 172.21.15.40:0/1805107287 >> 172.21.15.40:0/1805107287 conn(0x7fed940a41a0 msgr2=0x7fed940a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:55.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.019+0000 7fed9b905700 1 -- 172.21.15.40:0/1805107287 shutdown_connections 2023-09-30T22:30:55.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.019+0000 7fed9b905700 1 -- 172.21.15.40:0/1805107287 wait complete. 2023-09-30T22:30:55.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.019+0000 7fed9b905700 1 Processor -- start 2023-09-30T22:30:55.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.020+0000 7fed9b905700 1 -- start start 2023-09-30T22:30:55.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.020+0000 7fed9b905700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed9406f070 0x7fed941321e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:55.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.020+0000 7fed9b905700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed9406f980 0x7fed9412c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:55.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.020+0000 7fed9b905700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fed9406fdb0 0x7fed9412c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:55.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.020+0000 7fed9b905700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9412f390 con 0x7fed9406f070 2023-09-30T22:30:55.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.020+0000 7fed9b905700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9412dd10 con 0x7fed9406f980 2023-09-30T22:30:55.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.020+0000 7fed9b905700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed9412e430 con 0x7fed9406fdb0 2023-09-30T22:30:55.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.020+0000 7fed996a1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed9406f070 0x7fed941321e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:55.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.020+0000 7fed996a1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed9406f070 0x7fed941321e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42680/0 (socket says 172.21.15.40:42680) 2023-09-30T22:30:55.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.020+0000 7fed996a1700 1 -- 172.21.15.40:0/3509383629 learned_addr learned my addr 172.21.15.40:0/3509383629 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:55.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.020+0000 7fed99ea2700 1 --2- 172.21.15.40:0/3509383629 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fed9406fdb0 0x7fed9412c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:55.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.020+0000 7fed98ea0700 1 --2- 172.21.15.40:0/3509383629 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed9406f980 0x7fed9412c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:55.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.020+0000 7fed996a1700 1 -- 172.21.15.40:0/3509383629 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fed9406fdb0 msgr2=0x7fed9412c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:55.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.020+0000 7fed996a1700 1 --2- 172.21.15.40:0/3509383629 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fed9406fdb0 0x7fed9412c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.020+0000 7fed996a1700 1 -- 172.21.15.40:0/3509383629 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed9406f980 msgr2=0x7fed9412c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:55.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.020+0000 7fed996a1700 1 --2- 172.21.15.40:0/3509383629 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed9406f980 0x7fed9412c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.020+0000 7fed996a1700 1 -- 172.21.15.40:0/3509383629 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8c009b30 con 0x7fed9406f070 2023-09-30T22:30:55.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.021+0000 7fed996a1700 1 --2- 172.21.15.40:0/3509383629 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed9406f070 0x7fed941321e0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fed90012fc0 tx=0x7fed900100c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:55.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.021+0000 7fed89ffb700 1 -- 172.21.15.40:0/3509383629 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9000dbb0 con 0x7fed9406f070 2023-09-30T22:30:55.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.021+0000 7fed89ffb700 1 -- 172.21.15.40:0/3509383629 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed90013040 con 0x7fed9406f070 2023-09-30T22:30:55.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.021+0000 7fed9b905700 1 -- 172.21.15.40:0/3509383629 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed9412e1d0 con 0x7fed9406f070 2023-09-30T22:30:55.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.021+0000 7fed89ffb700 1 -- 172.21.15.40:0/3509383629 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed90010bf0 con 0x7fed9406f070 2023-09-30T22:30:55.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.021+0000 7fed9b905700 1 -- 172.21.15.40:0/3509383629 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed9412cd50 con 0x7fed9406f070 2023-09-30T22:30:55.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.022+0000 7fed89ffb700 1 -- 172.21.15.40:0/3509383629 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fed90010d50 con 0x7fed9406f070 2023-09-30T22:30:55.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.022+0000 7fed89ffb700 1 -- 172.21.15.40:0/3509383629 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fed900437a0 con 0x7fed9406f070 2023-09-30T22:30:55.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.022+0000 7fed9b905700 1 -- 172.21.15.40:0/3509383629 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed94099840 con 0x7fed9406f070 2023-09-30T22:30:55.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.027+0000 7fed89ffb700 1 -- 172.21.15.40:0/3509383629 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fed9000b450 con 0x7fed9406f070 2023-09-30T22:30:55.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.055+0000 7f5425179700 1 Processor -- start 2023-09-30T22:30:55.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.055+0000 7f5425179700 1 -- start start 2023-09-30T22:30:55.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.056+0000 7f5425179700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f542009c890 0x7f542009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:55.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.056+0000 7f5425179700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f542009d920 0x7f542009dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:55.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.056+0000 7f5425179700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54200a2600 con 0x7f542009e2b0 2023-09-30T22:30:55.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.056+0000 7f5425179700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54200a29d0 con 0x7f542009d920 2023-09-30T22:30:55.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.056+0000 7f5425179700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f542009fb40 con 0x7f542009c890 2023-09-30T22:30:55.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.056+0000 7f541ed9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f542009c890 0x7f542009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:55.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.056+0000 7f541f59e700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f542009e2b0 0x7f542013ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46230/0 (socket says 172.21.15.40:46230) 2023-09-30T22:30:55.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.056+0000 7f541f59e700 1 -- 172.21.15.40:0/4002274043 learned_addr learned my addr 172.21.15.40:0/4002274043 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:55.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.056+0000 7f541e59c700 1 --2- 172.21.15.40:0/4002274043 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f542009d920 0x7f542009dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:55.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.057+0000 7f541dd9b700 1 -- 172.21.15.40:0/4002274043 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4044792520 0 0) 0x7f54200a2600 con 0x7f542009e2b0 2023-09-30T22:30:55.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.057+0000 7f541ed9d700 1 -- 172.21.15.40:0/4002274043 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f542009d920 msgr2=0x7f542009dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:55.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.057+0000 7f541ed9d700 1 --2- 172.21.15.40:0/4002274043 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f542009d920 0x7f542009dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.057+0000 7f541ed9d700 1 -- 172.21.15.40:0/4002274043 >> v1:172.21.15.40:6789/0 conn(0x7f542009e2b0 legacy=0x7f542013ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:55.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.057+0000 7f541ed9d700 1 -- 172.21.15.40:0/4002274043 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542009e720 con 0x7f542009c890 2023-09-30T22:30:55.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.057+0000 7f541e59c700 1 --2- 172.21.15.40:0/4002274043 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f542009d920 0x7f542009dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:55.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.057+0000 7f541ed9d700 1 --2- 172.21.15.40:0/4002274043 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f542009c890 0x7f542009cc60 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f5410009850 tx=0x7f5410009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ed196cce8c141fe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:55.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.057+0000 7f541dd9b700 1 -- 172.21.15.40:0/4002274043 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5410005e30 con 0x7f542009c890 2023-09-30T22:30:55.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.057+0000 7f541dd9b700 1 -- 172.21.15.40:0/4002274043 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5410006030 con 0x7f542009c890 2023-09-30T22:30:55.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.057+0000 7f541dd9b700 1 -- 172.21.15.40:0/4002274043 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54100063e0 con 0x7f542009c890 2023-09-30T22:30:55.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.057+0000 7f5425179700 1 -- 172.21.15.40:0/4002274043 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f542009c890 msgr2=0x7f542009cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:55.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.057+0000 7f5425179700 1 --2- 172.21.15.40:0/4002274043 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f542009c890 0x7f542009cc60 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f5410009850 tx=0x7f5410009b60 comp rx=0 tx=0).stop 2023-09-30T22:30:55.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.057+0000 7f5425179700 1 -- 172.21.15.40:0/4002274043 shutdown_connections 2023-09-30T22:30:55.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.057+0000 7f5425179700 1 --2- 172.21.15.40:0/4002274043 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f542009c890 0x7f542009cc60 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.058+0000 7f5425179700 1 --2- 172.21.15.40:0/4002274043 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f542009d920 0x7f542009dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.058+0000 7f5425179700 1 -- 172.21.15.40:0/4002274043 >> 172.21.15.40:0/4002274043 conn(0x7f54200a7080 msgr2=0x7f54200a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:55.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.058+0000 7f5425179700 1 -- 172.21.15.40:0/4002274043 shutdown_connections 2023-09-30T22:30:55.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.058+0000 7f5425179700 1 -- 172.21.15.40:0/4002274043 wait complete. 2023-09-30T22:30:55.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.059+0000 7f5425179700 1 Processor -- start 2023-09-30T22:30:55.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.059+0000 7f5425179700 1 -- start start 2023-09-30T22:30:55.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.060+0000 7f5425179700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f542009c890 0x7f542012b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:55.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.060+0000 7f5425179700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f542009d920 0x7f542012ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:55.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.060+0000 7f5425179700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f542009e2b0 0x7f542012bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:55.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.060+0000 7f5425179700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542012d220 con 0x7f542009d920 2023-09-30T22:30:55.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.060+0000 7f5425179700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5420131420 con 0x7f542009e2b0 2023-09-30T22:30:55.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.060+0000 7f5425179700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f542012ca60 con 0x7f542009c890 2023-09-30T22:30:55.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.060+0000 7f541e59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f542009d920 0x7f542012ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:55.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.060+0000 7f541f59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f542009e2b0 0x7f542012bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:55.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.060+0000 7f541e59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f542009d920 0x7f542012ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42692/0 (socket says 172.21.15.40:42692) 2023-09-30T22:30:55.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.060+0000 7f541e59c700 1 -- 172.21.15.40:0/992512669 learned_addr learned my addr 172.21.15.40:0/992512669 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:55.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.060+0000 7f541ed9d700 1 --2- 172.21.15.40:0/992512669 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f542009c890 0x7f542012b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:55.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.061+0000 7f541ed9d700 1 -- 172.21.15.40:0/992512669 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f542009e2b0 msgr2=0x7f542012bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:55.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.061+0000 7f541ed9d700 1 --2- 172.21.15.40:0/992512669 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f542009e2b0 0x7f542012bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.061+0000 7f541ed9d700 1 -- 172.21.15.40:0/992512669 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f542009d920 msgr2=0x7f542012ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:55.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.061+0000 7f541ed9d700 1 --2- 172.21.15.40:0/992512669 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f542009d920 0x7f542012ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.061+0000 7f541ed9d700 1 -- 172.21.15.40:0/992512669 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54140094a0 con 0x7f542009c890 2023-09-30T22:30:55.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.061+0000 7f541ed9d700 1 --2- 172.21.15.40:0/992512669 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f542009c890 0x7f542012b4e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f5420074960 tx=0x7f5410004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:55.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.061+0000 7f54077fe700 1 -- 172.21.15.40:0/992512669 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5410006a20 con 0x7f542009c890 2023-09-30T22:30:55.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.061+0000 7f54077fe700 1 -- 172.21.15.40:0/992512669 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5410004040 con 0x7f542009c890 2023-09-30T22:30:55.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.061+0000 7f5425179700 1 -- 172.21.15.40:0/992512669 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5410009430 con 0x7f542009c890 2023-09-30T22:30:55.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.061+0000 7f54077fe700 1 -- 172.21.15.40:0/992512669 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54100043d0 con 0x7f542009c890 2023-09-30T22:30:55.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.061+0000 7f5425179700 1 -- 172.21.15.40:0/992512669 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f542012cf00 con 0x7f542009c890 2023-09-30T22:30:55.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.062+0000 7f54077fe700 1 -- 172.21.15.40:0/992512669 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5410022070 con 0x7f542009c890 2023-09-30T22:30:55.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.062+0000 7f54077fe700 1 -- 172.21.15.40:0/992512669 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5410040be0 con 0x7f542009c890 2023-09-30T22:30:55.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.062+0000 7f5425179700 1 -- 172.21.15.40:0/992512669 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f542006e600 con 0x7f542009c890 2023-09-30T22:30:55.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.071+0000 7f54077fe700 1 -- 172.21.15.40:0/992512669 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f541002a080 con 0x7f542009c890 2023-09-30T22:30:55.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.190+0000 7f5c564cc700 1 -- 172.21.15.40:0/230617688 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5c50062380 con 0x7f5c5006afe0 2023-09-30T22:30:55.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.190+0000 7f5c4cff9700 1 -- 172.21.15.40:0/230617688 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5c44011590 con 0x7f5c5006afe0 2023-09-30T22:30:55.191 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:55.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.192+0000 7f5c564cc700 1 -- 172.21.15.40:0/230617688 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c5006afe0 msgr2=0x7f5c5009b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:55.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.192+0000 7f5c564cc700 1 --2- 172.21.15.40:0/230617688 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c5006afe0 0x7f5c5009b4e0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f5c44000f60 tx=0x7f5c4400c730 comp rx=0 tx=0).stop 2023-09-30T22:30:55.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.192+0000 7f5c564cc700 1 -- 172.21.15.40:0/230617688 shutdown_connections 2023-09-30T22:30:55.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.192+0000 7f5c564cc700 1 --2- 172.21.15.40:0/230617688 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5c5006a6d0 0x7f5c5009afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.192+0000 7f5c564cc700 1 --2- 172.21.15.40:0/230617688 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5c50131fc0 0x7f5c501c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.192+0000 7f5c564cc700 1 --2- 172.21.15.40:0/230617688 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c5006afe0 0x7f5c5009b4e0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.192+0000 7f5c564cc700 1 -- 172.21.15.40:0/230617688 >> 172.21.15.40:0/230617688 conn(0x7f5c5009fb20 msgr2=0x7f5c5006f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:55.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.193+0000 7f5c564cc700 1 -- 172.21.15.40:0/230617688 shutdown_connections 2023-09-30T22:30:55.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.193+0000 7f5c564cc700 1 -- 172.21.15.40:0/230617688 wait complete. 2023-09-30T22:30:55.206 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:55.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.231+0000 7fed9b905700 1 -- 172.21.15.40:0/3509383629 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fed94062380 con 0x7fed9406f070 2023-09-30T22:30:55.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.231+0000 7fed89ffb700 1 -- 172.21.15.40:0/3509383629 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fed900173e0 con 0x7fed9406f070 2023-09-30T22:30:55.232 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:55.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.233+0000 7fed9b905700 1 -- 172.21.15.40:0/3509383629 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed9406f070 msgr2=0x7fed941321e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:55.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.233+0000 7fed9b905700 1 --2- 172.21.15.40:0/3509383629 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed9406f070 0x7fed941321e0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fed90012fc0 tx=0x7fed900100c0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.233+0000 7fed9b905700 1 -- 172.21.15.40:0/3509383629 shutdown_connections 2023-09-30T22:30:55.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.233+0000 7fed9b905700 1 --2- 172.21.15.40:0/3509383629 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fed9406fdb0 0x7fed9412c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.233+0000 7fed9b905700 1 --2- 172.21.15.40:0/3509383629 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed9406f070 0x7fed941321e0 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.233+0000 7fed9b905700 1 --2- 172.21.15.40:0/3509383629 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fed9406f980 0x7fed9412c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.233+0000 7fed9b905700 1 -- 172.21.15.40:0/3509383629 >> 172.21.15.40:0/3509383629 conn(0x7fed940a41a0 msgr2=0x7fed940972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:55.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.233+0000 7fed9b905700 1 -- 172.21.15.40:0/3509383629 shutdown_connections 2023-09-30T22:30:55.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.233+0000 7fed9b905700 1 -- 172.21.15.40:0/3509383629 wait complete. 2023-09-30T22:30:55.246 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:55.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.269+0000 7f5425179700 1 -- 172.21.15.40:0/992512669 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f542012e1a0 con 0x7f542009c890 2023-09-30T22:30:55.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.269+0000 7f54077fe700 1 -- 172.21.15.40:0/992512669 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f541002e7b0 con 0x7f542009c890 2023-09-30T22:30:55.270 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:55.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.271+0000 7f5425179700 1 -- 172.21.15.40:0/992512669 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f542009c890 msgr2=0x7f542012b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:55.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.271+0000 7f5425179700 1 --2- 172.21.15.40:0/992512669 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f542009c890 0x7f542012b4e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f5420074960 tx=0x7f5410004750 comp rx=0 tx=0).stop 2023-09-30T22:30:55.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.271+0000 7f5425179700 1 -- 172.21.15.40:0/992512669 shutdown_connections 2023-09-30T22:30:55.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.271+0000 7f5425179700 1 --2- 172.21.15.40:0/992512669 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f542009c890 0x7f542012b4e0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.271+0000 7f5425179700 1 --2- 172.21.15.40:0/992512669 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f542009e2b0 0x7f542012bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.271+0000 7f5425179700 1 --2- 172.21.15.40:0/992512669 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f542009d920 0x7f542012ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.271+0000 7f5425179700 1 -- 172.21.15.40:0/992512669 >> 172.21.15.40:0/992512669 conn(0x7f54200a7080 msgr2=0x7f54201baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:55.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.272+0000 7f5425179700 1 -- 172.21.15.40:0/992512669 shutdown_connections 2023-09-30T22:30:55.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.272+0000 7f5425179700 1 -- 172.21.15.40:0/992512669 wait complete. 2023-09-30T22:30:55.284 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:55.289 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:55.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.450+0000 7f19439ba700 1 Processor -- start 2023-09-30T22:30:55.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.450+0000 7f19439ba700 1 -- start start 2023-09-30T22:30:55.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.451+0000 7f19439ba700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f193c09c890 0x7f193c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:55.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.451+0000 7f19439ba700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f193c09e480 0x7f193c13bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:55.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.451+0000 7f19439ba700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f193c0a2600 con 0x7f193c09d920 2023-09-30T22:30:55.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.451+0000 7f19439ba700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193c0a29d0 con 0x7f193c09c890 2023-09-30T22:30:55.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.451+0000 7f19439ba700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f193c09fb40 con 0x7f193c09e480 2023-09-30T22:30:55.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.451+0000 7f1941756700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f193c09c890 0x7f193c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:55.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.451+0000 7f1941f57700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f193c09e480 0x7f193c13bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:55.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.451+0000 7f1941f57700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f193c09e480 0x7f193c13bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60124/0 (socket says 172.21.15.40:60124) 2023-09-30T22:30:55.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.451+0000 7f1941756700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f193c09c890 0x7f193c09cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42698/0 (socket says 172.21.15.40:42698) 2023-09-30T22:30:55.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.451+0000 7f1941f57700 1 -- 172.21.15.40:0/4118025785 learned_addr learned my addr 172.21.15.40:0/4118025785 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:55.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.451+0000 7f1941f57700 1 -- 172.21.15.40:0/4118025785 >> v2:172.21.15.40:3300/0 conn(0x7f193c09c890 msgr2=0x7f193c09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:55.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.451+0000 7f1941f57700 1 --2- 172.21.15.40:0/4118025785 >> v2:172.21.15.40:3300/0 conn(0x7f193c09c890 0x7f193c09cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.451+0000 7f1941f57700 1 -- 172.21.15.40:0/4118025785 >> v1:172.21.15.40:6789/0 conn(0x7f193c09d920 legacy=0x7f193c09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:55.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.451+0000 7f1933fff700 1 -- 172.21.15.40:0/4118025785 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 175599491 0 0) 0x7f193c0a2600 con 0x7f193c09d920 2023-09-30T22:30:55.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.451+0000 7f1941f57700 1 -- 172.21.15.40:0/4118025785 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193c09fed0 con 0x7f193c09e480 2023-09-30T22:30:55.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.451+0000 7f1941756700 1 --2- 172.21.15.40:0/4118025785 >> v2:172.21.15.40:3300/0 conn(0x7f193c09c890 0x7f193c09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:55.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.451+0000 7f1941f57700 1 --2- 172.21.15.40:0/4118025785 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f193c09e480 0x7f193c13bc20 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f1934009e50 tx=0x7f193400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e01e6be05a24a21 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:55.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.451+0000 7f1933fff700 1 -- 172.21.15.40:0/4118025785 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193400e070 con 0x7f193c09e480 2023-09-30T22:30:55.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.452+0000 7f1933fff700 1 -- 172.21.15.40:0/4118025785 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193400b910 con 0x7f193c09e480 2023-09-30T22:30:55.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.452+0000 7f1933fff700 1 -- 172.21.15.40:0/4118025785 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193400bcc0 con 0x7f193c09e480 2023-09-30T22:30:55.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.452+0000 7f19439ba700 1 -- 172.21.15.40:0/4118025785 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f193c09e480 msgr2=0x7f193c13bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:55.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.452+0000 7f19439ba700 1 --2- 172.21.15.40:0/4118025785 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f193c09e480 0x7f193c13bc20 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f1934009e50 tx=0x7f193400b330 comp rx=0 tx=0).stop 2023-09-30T22:30:55.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.452+0000 7f19439ba700 1 -- 172.21.15.40:0/4118025785 shutdown_connections 2023-09-30T22:30:55.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.452+0000 7f19439ba700 1 --2- 172.21.15.40:0/4118025785 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f193c09e480 0x7f193c13bc20 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.452+0000 7f19439ba700 1 --2- 172.21.15.40:0/4118025785 >> v2:172.21.15.40:3300/0 conn(0x7f193c09c890 0x7f193c09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.452+0000 7f19439ba700 1 -- 172.21.15.40:0/4118025785 >> 172.21.15.40:0/4118025785 conn(0x7f193c0a7080 msgr2=0x7f193c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:55.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.452+0000 7f19439ba700 1 -- 172.21.15.40:0/4118025785 shutdown_connections 2023-09-30T22:30:55.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.452+0000 7f19439ba700 1 -- 172.21.15.40:0/4118025785 wait complete. 2023-09-30T22:30:55.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.453+0000 7f19439ba700 1 Processor -- start 2023-09-30T22:30:55.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.453+0000 7f19439ba700 1 -- start start 2023-09-30T22:30:55.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.454+0000 7f19439ba700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f193c09c890 0x7f193c12f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:55.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.454+0000 7f19439ba700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f193c09d920 0x7f193c12fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:55.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.454+0000 7f19439ba700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f193c09e480 0x7f193c12ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:55.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.454+0000 7f19439ba700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c12e960 con 0x7f193c09c890 2023-09-30T22:30:55.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.454+0000 7f19439ba700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f193c12f320 con 0x7f193c09d920 2023-09-30T22:30:55.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.454+0000 7f19439ba700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f193c12dc80 con 0x7f193c09e480 2023-09-30T22:30:55.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.454+0000 7f1941756700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f193c09c890 0x7f193c12f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:55.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.454+0000 7f1941756700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f193c09c890 0x7f193c12f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42712/0 (socket says 172.21.15.40:42712) 2023-09-30T22:30:55.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.454+0000 7f1941756700 1 -- 172.21.15.40:0/32460857 learned_addr learned my addr 172.21.15.40:0/32460857 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:55.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.454+0000 7f1940f55700 1 --2- 172.21.15.40:0/32460857 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f193c09d920 0x7f193c12fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:55.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.454+0000 7f1941f57700 1 --2- 172.21.15.40:0/32460857 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f193c09e480 0x7f193c12ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:55.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.454+0000 7f1941756700 1 -- 172.21.15.40:0/32460857 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f193c09e480 msgr2=0x7f193c12ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:55.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.454+0000 7f1941756700 1 --2- 172.21.15.40:0/32460857 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f193c09e480 0x7f193c12ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.454+0000 7f1941756700 1 -- 172.21.15.40:0/32460857 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f193c09d920 msgr2=0x7f193c12fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:55.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.454+0000 7f1941756700 1 --2- 172.21.15.40:0/32460857 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f193c09d920 0x7f193c12fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.454+0000 7f1941756700 1 -- 172.21.15.40:0/32460857 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192c009430 con 0x7f193c09c890 2023-09-30T22:30:55.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.454+0000 7f1941756700 1 --2- 172.21.15.40:0/32460857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f193c09c890 0x7f193c12f540 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f192c00ec10 tx=0x7f192c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:55.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.454+0000 7f1931ffb700 1 -- 172.21.15.40:0/32460857 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c009740 con 0x7f193c09c890 2023-09-30T22:30:55.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.454+0000 7f1931ffb700 1 -- 172.21.15.40:0/32460857 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192c005a20 con 0x7f193c09c890 2023-09-30T22:30:55.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.454+0000 7f19439ba700 1 -- 172.21.15.40:0/32460857 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1934009b30 con 0x7f193c09c890 2023-09-30T22:30:55.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.454+0000 7f1931ffb700 1 -- 172.21.15.40:0/32460857 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c005d90 con 0x7f193c09c890 2023-09-30T22:30:55.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.455+0000 7f19439ba700 1 -- 172.21.15.40:0/32460857 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f193c09ecf0 con 0x7f193c09c890 2023-09-30T22:30:55.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.455+0000 7f1931ffb700 1 -- 172.21.15.40:0/32460857 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f192c00c850 con 0x7f193c09c890 2023-09-30T22:30:55.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.455+0000 7f1931ffb700 1 -- 172.21.15.40:0/32460857 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f192c03f950 con 0x7f193c09c890 2023-09-30T22:30:55.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.455+0000 7f19439ba700 1 -- 172.21.15.40:0/32460857 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f193c06e600 con 0x7f193c09c890 2023-09-30T22:30:55.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.460+0000 7f1931ffb700 1 -- 172.21.15.40:0/32460857 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f192c020080 con 0x7f193c09c890 2023-09-30T22:30:55.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.655+0000 7f19439ba700 1 -- 172.21.15.40:0/32460857 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f193c062380 con 0x7f193c09c890 2023-09-30T22:30:55.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.655+0000 7f1931ffb700 1 -- 172.21.15.40:0/32460857 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f192c006030 con 0x7f193c09c890 2023-09-30T22:30:55.656 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:55.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.657+0000 7f19439ba700 1 -- 172.21.15.40:0/32460857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f193c09c890 msgr2=0x7f193c12f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:55.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.657+0000 7f19439ba700 1 --2- 172.21.15.40:0/32460857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f193c09c890 0x7f193c12f540 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f192c00ec10 tx=0x7f192c00ef20 comp rx=0 tx=0).stop 2023-09-30T22:30:55.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.657+0000 7f19439ba700 1 -- 172.21.15.40:0/32460857 shutdown_connections 2023-09-30T22:30:55.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.657+0000 7f19439ba700 1 --2- 172.21.15.40:0/32460857 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f193c09e480 0x7f193c12ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.657+0000 7f19439ba700 1 --2- 172.21.15.40:0/32460857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f193c09c890 0x7f193c12f540 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.657+0000 7f19439ba700 1 --2- 172.21.15.40:0/32460857 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f193c09d920 0x7f193c12fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:55.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.657+0000 7f19439ba700 1 -- 172.21.15.40:0/32460857 >> 172.21.15.40:0/32460857 conn(0x7f193c0a7080 msgr2=0x7f193c1bb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:55.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.657+0000 7f19439ba700 1 -- 172.21.15.40:0/32460857 shutdown_connections 2023-09-30T22:30:55.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:55.657+0000 7f19439ba700 1 -- 172.21.15.40:0/32460857 wait complete. 2023-09-30T22:30:55.670 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:56.208 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:56.247 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:56.285 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:56.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.341+0000 7ff311d6d700 1 Processor -- start 2023-09-30T22:30:56.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.341+0000 7ff311d6d700 1 -- start start 2023-09-30T22:30:56.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.342+0000 7ff311d6d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff30c09d450 0x7ff30c09d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.342+0000 7ff311d6d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff30c1308d0 0x7ff30c138420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.342+0000 7ff311d6d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff30c09e8b0 con 0x7ff30c09dd60 2023-09-30T22:30:56.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.342+0000 7ff311d6d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff30c09c3b0 con 0x7ff30c09d450 2023-09-30T22:30:56.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.342+0000 7ff311d6d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff30c09a6b0 con 0x7ff30c1308d0 2023-09-30T22:30:56.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.342+0000 7ff30b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff30c09d450 0x7ff30c09d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.342+0000 7ff30bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff30c1308d0 0x7ff30c138420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.342+0000 7ff30b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff30c09d450 0x7ff30c09d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42718/0 (socket says 172.21.15.40:42718) 2023-09-30T22:30:56.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.342+0000 7ff30affd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff30c09dd60 0x7ff30c1301c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46256/0 (socket says 172.21.15.40:46256) 2023-09-30T22:30:56.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.342+0000 7ff30bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff30c1308d0 0x7ff30c138420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42792/0 (socket says 172.21.15.40:42792) 2023-09-30T22:30:56.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.342+0000 7ff30b7fe700 1 -- 172.21.15.40:0/1487559432 learned_addr learned my addr 172.21.15.40:0/1487559432 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:56.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.342+0000 7ff30b7fe700 1 -- 172.21.15.40:0/1487559432 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff30c1308d0 msgr2=0x7ff30c138420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:56.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.342+0000 7ff30b7fe700 1 --2- 172.21.15.40:0/1487559432 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff30c1308d0 0x7ff30c138420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.342+0000 7ff30b7fe700 1 -- 172.21.15.40:0/1487559432 >> v1:172.21.15.40:6789/0 conn(0x7ff30c09dd60 legacy=0x7ff30c1301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:56.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.342+0000 7ff30b7fe700 1 -- 172.21.15.40:0/1487559432 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff30c09b4f0 con 0x7ff30c09d450 2023-09-30T22:30:56.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.342+0000 7ff30a7fc700 1 -- 172.21.15.40:0/1487559432 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3702985638 0 0) 0x7ff30c09e8b0 con 0x7ff30c09dd60 2023-09-30T22:30:56.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.342+0000 7ff30bfff700 1 --2- 172.21.15.40:0/1487559432 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff30c1308d0 0x7ff30c138420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:56.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.342+0000 7ff30b7fe700 1 --2- 172.21.15.40:0/1487559432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff30c09d450 0x7ff30c09d820 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0098f0 tx=0x7ff2fc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35bdbee2a187cf65 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:56.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.343+0000 7ff30a7fc700 1 -- 172.21.15.40:0/1487559432 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc011830 con 0x7ff30c09d450 2023-09-30T22:30:56.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.343+0000 7ff30a7fc700 1 -- 172.21.15.40:0/1487559432 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2fc011990 con 0x7ff30c09d450 2023-09-30T22:30:56.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.343+0000 7ff30a7fc700 1 -- 172.21.15.40:0/1487559432 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc011d20 con 0x7ff30c09d450 2023-09-30T22:30:56.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.343+0000 7ff311d6d700 1 -- 172.21.15.40:0/1487559432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff30c09d450 msgr2=0x7ff30c09d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:56.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.343+0000 7ff311d6d700 1 --2- 172.21.15.40:0/1487559432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff30c09d450 0x7ff30c09d820 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0098f0 tx=0x7ff2fc009c00 comp rx=0 tx=0).stop 2023-09-30T22:30:56.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.343+0000 7ff311d6d700 1 -- 172.21.15.40:0/1487559432 shutdown_connections 2023-09-30T22:30:56.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.343+0000 7ff311d6d700 1 --2- 172.21.15.40:0/1487559432 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff30c1308d0 0x7ff30c138420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.343+0000 7ff311d6d700 1 --2- 172.21.15.40:0/1487559432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff30c09d450 0x7ff30c09d820 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.343+0000 7ff311d6d700 1 -- 172.21.15.40:0/1487559432 >> 172.21.15.40:0/1487559432 conn(0x7ff30c0a2a00 msgr2=0x7ff30c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:56.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.343+0000 7ff311d6d700 1 -- 172.21.15.40:0/1487559432 shutdown_connections 2023-09-30T22:30:56.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.343+0000 7ff311d6d700 1 -- 172.21.15.40:0/1487559432 wait complete. 2023-09-30T22:30:56.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.344+0000 7ff311d6d700 1 Processor -- start 2023-09-30T22:30:56.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.345+0000 7ff311d6d700 1 -- start start 2023-09-30T22:30:56.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.345+0000 7ff311d6d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff30c09d450 0x7ff30c138140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.345+0000 7ff311d6d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff30c09dd60 0x7ff30c138680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.345+0000 7ff311d6d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff30c1308d0 0x7ff30c138bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.345+0000 7ff311d6d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30c1376d0 con 0x7ff30c1308d0 2023-09-30T22:30:56.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.345+0000 7ff311d6d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff30c13aab0 con 0x7ff30c09dd60 2023-09-30T22:30:56.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.345+0000 7ff311d6d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff30c09c640 con 0x7ff30c09d450 2023-09-30T22:30:56.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.345+0000 7ff30affd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff30c09dd60 0x7ff30c138680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.345+0000 7ff30affd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff30c09dd60 0x7ff30c138680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42802/0 (socket says 172.21.15.40:42802) 2023-09-30T22:30:56.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.345+0000 7ff30bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff30c1308d0 0x7ff30c138bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.345+0000 7ff30affd700 1 -- 172.21.15.40:0/3508568792 learned_addr learned my addr 172.21.15.40:0/3508568792 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:56.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.346+0000 7ff30affd700 1 -- 172.21.15.40:0/3508568792 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff30c09d450 msgr2=0x7ff30c138140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:56.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.346+0000 7ff30affd700 1 --2- 172.21.15.40:0/3508568792 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff30c09d450 0x7ff30c138140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.346+0000 7ff30affd700 1 -- 172.21.15.40:0/3508568792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff30c1308d0 msgr2=0x7ff30c138bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:56.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.346+0000 7ff30affd700 1 --2- 172.21.15.40:0/3508568792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff30c1308d0 0x7ff30c138bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.346+0000 7ff30affd700 1 -- 172.21.15.40:0/3508568792 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff304009a70 con 0x7ff30c09dd60 2023-09-30T22:30:56.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.346+0000 7ff30bfff700 1 --2- 172.21.15.40:0/3508568792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff30c1308d0 0x7ff30c138bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:56.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.346+0000 7ff30affd700 1 --2- 172.21.15.40:0/3508568792 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff30c09dd60 0x7ff30c138680 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7ff30000c520 tx=0x7ff30000c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:56.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.346+0000 7ff2f3fff700 1 -- 172.21.15.40:0/3508568792 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff300004c80 con 0x7ff30c09dd60 2023-09-30T22:30:56.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.346+0000 7ff2f3fff700 1 -- 172.21.15.40:0/3508568792 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff300004e00 con 0x7ff30c09dd60 2023-09-30T22:30:56.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.346+0000 7ff311d6d700 1 -- 172.21.15.40:0/3508568792 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2fc009550 con 0x7ff30c09dd60 2023-09-30T22:30:56.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.346+0000 7ff2f3fff700 1 -- 172.21.15.40:0/3508568792 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff300007310 con 0x7ff30c09dd60 2023-09-30T22:30:56.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.346+0000 7ff311d6d700 1 -- 172.21.15.40:0/3508568792 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff30c13c690 con 0x7ff30c09dd60 2023-09-30T22:30:56.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.347+0000 7ff2f3fff700 1 -- 172.21.15.40:0/3508568792 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff300007470 con 0x7ff30c09dd60 2023-09-30T22:30:56.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.347+0000 7ff311d6d700 1 -- 172.21.15.40:0/3508568792 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff30c062380 con 0x7ff30c09dd60 2023-09-30T22:30:56.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.347+0000 7ff2f3fff700 1 -- 172.21.15.40:0/3508568792 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff30003f3a0 con 0x7ff30c09dd60 2023-09-30T22:30:56.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.352+0000 7ff2f3fff700 1 -- 172.21.15.40:0/3508568792 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff3000133c0 con 0x7ff30c09dd60 2023-09-30T22:30:56.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.391+0000 7f162062f700 1 Processor -- start 2023-09-30T22:30:56.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.391+0000 7f162062f700 1 -- start start 2023-09-30T22:30:56.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.392+0000 7f162062f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f161809f0f0 0x7f1618138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.392+0000 7f162062f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f161809e400 0x7f161813b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.392+0000 7f162062f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f161809f940 con 0x7f161809d920 2023-09-30T22:30:56.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.392+0000 7f162062f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161806b4c0 con 0x7f161809f0f0 2023-09-30T22:30:56.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.392+0000 7f162062f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f161809a8f0 con 0x7f161809e400 2023-09-30T22:30:56.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.392+0000 7f161dbca700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f161809f0f0 0x7f1618138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.392+0000 7f161e3cb700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f161809d920 0x7f161809dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46270/0 (socket says 172.21.15.40:46270) 2023-09-30T22:30:56.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.392+0000 7f161e3cb700 1 -- 172.21.15.40:0/223081400 learned_addr learned my addr 172.21.15.40:0/223081400 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:30:56.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.392+0000 7f161dbca700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f161809f0f0 0x7f1618138ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42804/0 (socket says 172.21.15.40:42804) 2023-09-30T22:30:56.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.392+0000 7f161ebcc700 1 --2- 172.21.15.40:0/223081400 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f161809e400 0x7f161813b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.392+0000 7f161d3c9700 1 -- 172.21.15.40:0/223081400 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 620478779 0 0) 0x7f161809f940 con 0x7f161809d920 2023-09-30T22:30:56.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.392+0000 7f161d3c9700 1 -- 172.21.15.40:0/223081400 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16040035b0 con 0x7f161809d920 2023-09-30T22:30:56.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.392+0000 7f161dbca700 1 -- 172.21.15.40:0/223081400 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f161809e400 msgr2=0x7f161813b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:56.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.392+0000 7f161dbca700 1 --2- 172.21.15.40:0/223081400 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f161809e400 0x7f161813b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.392+0000 7f161dbca700 1 -- 172.21.15.40:0/223081400 >> v1:172.21.15.40:6789/0 conn(0x7f161809d920 legacy=0x7f161809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:56.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.392+0000 7f161dbca700 1 -- 172.21.15.40:0/223081400 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161809f6e0 con 0x7f161809f0f0 2023-09-30T22:30:56.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.392+0000 7f161dbca700 1 --2- 172.21.15.40:0/223081400 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f161809f0f0 0x7f1618138ee0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f1608009870 tx=0x7f1608009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=724c9593baafb645 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:56.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.393+0000 7f161d3c9700 1 -- 172.21.15.40:0/223081400 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1608011830 con 0x7f161809f0f0 2023-09-30T22:30:56.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.393+0000 7f161d3c9700 1 -- 172.21.15.40:0/223081400 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1608011990 con 0x7f161809f0f0 2023-09-30T22:30:56.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.393+0000 7f161d3c9700 1 -- 172.21.15.40:0/223081400 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1608011d20 con 0x7f161809f0f0 2023-09-30T22:30:56.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.393+0000 7f162062f700 1 -- 172.21.15.40:0/223081400 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f161809f0f0 msgr2=0x7f1618138ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:56.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.393+0000 7f162062f700 1 --2- 172.21.15.40:0/223081400 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f161809f0f0 0x7f1618138ee0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f1608009870 tx=0x7f1608009b80 comp rx=0 tx=0).stop 2023-09-30T22:30:56.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.393+0000 7f162062f700 1 -- 172.21.15.40:0/223081400 shutdown_connections 2023-09-30T22:30:56.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.393+0000 7f162062f700 1 --2- 172.21.15.40:0/223081400 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f161809e400 0x7f161813b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.393+0000 7f162062f700 1 --2- 172.21.15.40:0/223081400 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f161809f0f0 0x7f1618138ee0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.393+0000 7f162062f700 1 -- 172.21.15.40:0/223081400 >> 172.21.15.40:0/223081400 conn(0x7f161809fb20 msgr2=0x7f161809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:56.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.393+0000 7f162062f700 1 -- 172.21.15.40:0/223081400 shutdown_connections 2023-09-30T22:30:56.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.393+0000 7f162062f700 1 -- 172.21.15.40:0/223081400 wait complete. 2023-09-30T22:30:56.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.394+0000 7f162062f700 1 Processor -- start 2023-09-30T22:30:56.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.394+0000 7f162062f700 1 -- start start 2023-09-30T22:30:56.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.395+0000 7f162062f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f161809d920 0x7f161811db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.395+0000 7f162062f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f161809e400 0x7f161811e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.395+0000 7f162062f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f161811e5c0 0x7f16181ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.395+0000 7f162062f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161811fec0 con 0x7f161809d920 2023-09-30T22:30:56.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.395+0000 7f162062f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16181201a0 con 0x7f161811e5c0 2023-09-30T22:30:56.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.395+0000 7f162062f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16180a2eb0 con 0x7f161809e400 2023-09-30T22:30:56.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.395+0000 7f161e3cb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f161809d920 0x7f161811db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.395+0000 7f161e3cb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f161809d920 0x7f161811db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42742/0 (socket says 172.21.15.40:42742) 2023-09-30T22:30:56.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.395+0000 7f161e3cb700 1 -- 172.21.15.40:0/3364389333 learned_addr learned my addr 172.21.15.40:0/3364389333 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:56.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.395+0000 7f161dbca700 1 --2- 172.21.15.40:0/3364389333 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f161809e400 0x7f161811e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.395+0000 7f161ebcc700 1 --2- 172.21.15.40:0/3364389333 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f161811e5c0 0x7f16181ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.395+0000 7f161dbca700 1 -- 172.21.15.40:0/3364389333 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f161811e5c0 msgr2=0x7f16181ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:56.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.395+0000 7f161dbca700 1 --2- 172.21.15.40:0/3364389333 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f161811e5c0 0x7f16181ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.396+0000 7f161dbca700 1 -- 172.21.15.40:0/3364389333 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f161809d920 msgr2=0x7f161811db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:56.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.396+0000 7f161dbca700 1 --2- 172.21.15.40:0/3364389333 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f161809d920 0x7f161811db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.396+0000 7f161dbca700 1 -- 172.21.15.40:0/3364389333 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16080094a0 con 0x7f161809e400 2023-09-30T22:30:56.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.396+0000 7f161e3cb700 1 --2- 172.21.15.40:0/3364389333 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f161809d920 0x7f161811db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:56.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.396+0000 7f161dbca700 1 --2- 172.21.15.40:0/3364389333 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f161809e400 0x7f161811e080 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f1608009870 tx=0x7f1608004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:56.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.396+0000 7f160effd700 1 -- 172.21.15.40:0/3364389333 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1608004450 con 0x7f161809e400 2023-09-30T22:30:56.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.396+0000 7f160effd700 1 -- 172.21.15.40:0/3364389333 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16080045b0 con 0x7f161809e400 2023-09-30T22:30:56.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.396+0000 7f162062f700 1 -- 172.21.15.40:0/3364389333 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f161809c9e0 con 0x7f161809e400 2023-09-30T22:30:56.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.396+0000 7f160effd700 1 -- 172.21.15.40:0/3364389333 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16080038e0 con 0x7f161809e400 2023-09-30T22:30:56.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.396+0000 7f162062f700 1 -- 172.21.15.40:0/3364389333 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f161811fc50 con 0x7f161809e400 2023-09-30T22:30:56.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.397+0000 7f160effd700 1 -- 172.21.15.40:0/3364389333 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1608003a40 con 0x7f161809e400 2023-09-30T22:30:56.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.397+0000 7f160effd700 1 -- 172.21.15.40:0/3364389333 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f1608040910 con 0x7f161809e400 2023-09-30T22:30:56.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.397+0000 7f162062f700 1 -- 172.21.15.40:0/3364389333 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f161811f9f0 con 0x7f161809e400 2023-09-30T22:30:56.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.402+0000 7f160effd700 1 -- 172.21.15.40:0/3364389333 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1608015020 con 0x7f161809e400 2023-09-30T22:30:56.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.447+0000 7fe817509700 1 Processor -- start 2023-09-30T22:30:56.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.448+0000 7fe817509700 1 -- start start 2023-09-30T22:30:56.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.448+0000 7fe817509700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe81009d920 0x7fe81009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.448+0000 7fe817509700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe81009e230 0x7fe8101308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.448+0000 7fe817509700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81009adf0 con 0x7fe810130de0 2023-09-30T22:30:56.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.448+0000 7fe817509700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe81009edf0 con 0x7fe81009e230 2023-09-30T22:30:56.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.448+0000 7fe817509700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe81009b660 con 0x7fe81009d920 2023-09-30T22:30:56.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.448+0000 7fe8152a5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe81009d920 0x7fe81009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.448+0000 7fe8152a5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe81009d920 0x7fe81009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60192/0 (socket says 172.21.15.40:60192) 2023-09-30T22:30:56.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.448+0000 7fe8152a5700 1 -- 172.21.15.40:0/1975057929 learned_addr learned my addr 172.21.15.40:0/1975057929 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:56.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.448+0000 7fe814aa4700 1 --2- 172.21.15.40:0/1975057929 >> v2:172.21.15.40:3300/0 conn(0x7fe81009e230 0x7fe8101308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.449+0000 7fe814aa4700 1 -- 172.21.15.40:0/1975057929 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe81009d920 msgr2=0x7fe81009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:56.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.449+0000 7fe814aa4700 1 --2- 172.21.15.40:0/1975057929 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe81009d920 0x7fe81009dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.449+0000 7fe814aa4700 1 -- 172.21.15.40:0/1975057929 >> v1:172.21.15.40:6789/0 conn(0x7fe810130de0 legacy=0x7fe810137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:56.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.449+0000 7fe814aa4700 1 -- 172.21.15.40:0/1975057929 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81009a6e0 con 0x7fe81009e230 2023-09-30T22:30:56.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.449+0000 7fe8152a5700 1 --2- 172.21.15.40:0/1975057929 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe81009d920 0x7fe81009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:56.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.449+0000 7fe814aa4700 1 --2- 172.21.15.40:0/1975057929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe81009e230 0x7fe8101308a0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fe800009840 tx=0x7fe800009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51d2dc140d93344f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:56.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.449+0000 7fe807fff700 1 -- 172.21.15.40:0/1975057929 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe800011830 con 0x7fe81009e230 2023-09-30T22:30:56.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.449+0000 7fe807fff700 1 -- 172.21.15.40:0/1975057929 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe800011990 con 0x7fe81009e230 2023-09-30T22:30:56.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.449+0000 7fe807fff700 1 -- 172.21.15.40:0/1975057929 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe800011d20 con 0x7fe81009e230 2023-09-30T22:30:56.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.450+0000 7fe817509700 1 -- 172.21.15.40:0/1975057929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe81009e230 msgr2=0x7fe8101308a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:56.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.450+0000 7fe817509700 1 --2- 172.21.15.40:0/1975057929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe81009e230 0x7fe8101308a0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fe800009840 tx=0x7fe800009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:56.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.450+0000 7fe817509700 1 -- 172.21.15.40:0/1975057929 shutdown_connections 2023-09-30T22:30:56.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.450+0000 7fe817509700 1 --2- 172.21.15.40:0/1975057929 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe81009d920 0x7fe81009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.450+0000 7fe817509700 1 --2- 172.21.15.40:0/1975057929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe81009e230 0x7fe8101308a0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.450+0000 7fe817509700 1 -- 172.21.15.40:0/1975057929 >> 172.21.15.40:0/1975057929 conn(0x7fe81009fb20 msgr2=0x7fe81009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:56.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.450+0000 7fe817509700 1 -- 172.21.15.40:0/1975057929 shutdown_connections 2023-09-30T22:30:56.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.450+0000 7fe817509700 1 -- 172.21.15.40:0/1975057929 wait complete. 2023-09-30T22:30:56.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.451+0000 7fe817509700 1 Processor -- start 2023-09-30T22:30:56.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.451+0000 7fe817509700 1 -- start start 2023-09-30T22:30:56.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.452+0000 7fe817509700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe81009d920 0x7fe810138cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.452+0000 7fe817509700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe81009e230 0x7fe810139230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.452+0000 7fe817509700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe810130de0 0x7fe81013a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.452+0000 7fe817509700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe810139770 con 0x7fe810130de0 2023-09-30T22:30:56.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.452+0000 7fe817509700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81012f2d0 con 0x7fe81009d920 2023-09-30T22:30:56.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.452+0000 7fe817509700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe81012f540 con 0x7fe81009e230 2023-09-30T22:30:56.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.452+0000 7fe814aa4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe81009e230 0x7fe810139230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.452+0000 7fe814aa4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe81009e230 0x7fe810139230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60196/0 (socket says 172.21.15.40:60196) 2023-09-30T22:30:56.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.452+0000 7fe814aa4700 1 -- 172.21.15.40:0/3034446626 learned_addr learned my addr 172.21.15.40:0/3034446626 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:56.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.452+0000 7fe8152a5700 1 --2- 172.21.15.40:0/3034446626 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe81009d920 0x7fe810138cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.452+0000 7fe815aa6700 1 --2- 172.21.15.40:0/3034446626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe810130de0 0x7fe81013a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.452+0000 7fe814aa4700 1 -- 172.21.15.40:0/3034446626 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe81009d920 msgr2=0x7fe810138cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:56.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.452+0000 7fe814aa4700 1 --2- 172.21.15.40:0/3034446626 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe81009d920 0x7fe810138cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.452+0000 7fe814aa4700 1 -- 172.21.15.40:0/3034446626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe810130de0 msgr2=0x7fe81013a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:56.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.452+0000 7fe814aa4700 1 --2- 172.21.15.40:0/3034446626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe810130de0 0x7fe81013a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.452+0000 7fe814aa4700 1 -- 172.21.15.40:0/3034446626 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe80c009500 con 0x7fe81009e230 2023-09-30T22:30:56.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.453+0000 7fe814aa4700 1 --2- 172.21.15.40:0/3034446626 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe81009e230 0x7fe810139230 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fe8000090b0 tx=0x7fe800004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:56.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.453+0000 7fe805ffb700 1 -- 172.21.15.40:0/3034446626 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8000036a0 con 0x7fe81009e230 2023-09-30T22:30:56.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.453+0000 7fe805ffb700 1 -- 172.21.15.40:0/3034446626 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80001f070 con 0x7fe81009e230 2023-09-30T22:30:56.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.453+0000 7fe817509700 1 -- 172.21.15.40:0/3034446626 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8000094a0 con 0x7fe81009e230 2023-09-30T22:30:56.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.453+0000 7fe805ffb700 1 -- 172.21.15.40:0/3034446626 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe800003a60 con 0x7fe81009e230 2023-09-30T22:30:56.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.453+0000 7fe817509700 1 -- 172.21.15.40:0/3034446626 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe810130170 con 0x7fe81009e230 2023-09-30T22:30:56.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.454+0000 7fe817509700 1 -- 172.21.15.40:0/3034446626 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe81009cb00 con 0x7fe81009e230 2023-09-30T22:30:56.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.454+0000 7fe805ffb700 1 -- 172.21.15.40:0/3034446626 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe800003bc0 con 0x7fe81009e230 2023-09-30T22:30:56.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.454+0000 7fe805ffb700 1 -- 172.21.15.40:0/3034446626 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe800021070 con 0x7fe81009e230 2023-09-30T22:30:56.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.459+0000 7fe805ffb700 1 -- 172.21.15.40:0/3034446626 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe8000257f0 con 0x7fe81009e230 2023-09-30T22:30:56.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.549+0000 7ff311d6d700 1 -- 172.21.15.40:0/3508568792 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff30c1374a0 con 0x7ff30c09dd60 2023-09-30T22:30:56.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.550+0000 7ff2f3fff700 1 -- 172.21.15.40:0/3508568792 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff3000102c0 con 0x7ff30c09dd60 2023-09-30T22:30:56.551 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:56.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.552+0000 7ff311d6d700 1 -- 172.21.15.40:0/3508568792 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff30c09dd60 msgr2=0x7ff30c138680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:56.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.552+0000 7ff311d6d700 1 --2- 172.21.15.40:0/3508568792 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff30c09dd60 0x7ff30c138680 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7ff30000c520 tx=0x7ff30000c8e0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.552+0000 7ff311d6d700 1 -- 172.21.15.40:0/3508568792 shutdown_connections 2023-09-30T22:30:56.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.552+0000 7ff311d6d700 1 --2- 172.21.15.40:0/3508568792 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff30c09d450 0x7ff30c138140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.552+0000 7ff311d6d700 1 --2- 172.21.15.40:0/3508568792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff30c1308d0 0x7ff30c138bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.552+0000 7ff311d6d700 1 --2- 172.21.15.40:0/3508568792 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff30c09dd60 0x7ff30c138680 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.552+0000 7ff311d6d700 1 -- 172.21.15.40:0/3508568792 >> 172.21.15.40:0/3508568792 conn(0x7ff30c0a2a00 msgr2=0x7ff30c0a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:56.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.552+0000 7ff311d6d700 1 -- 172.21.15.40:0/3508568792 shutdown_connections 2023-09-30T22:30:56.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.552+0000 7ff311d6d700 1 -- 172.21.15.40:0/3508568792 wait complete. 2023-09-30T22:30:56.565 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:56.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.620+0000 7f162062f700 1 -- 172.21.15.40:0/3364389333 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1618062380 con 0x7f161809e400 2023-09-30T22:30:56.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.620+0000 7f160effd700 1 -- 172.21.15.40:0/3364389333 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f160802e970 con 0x7f161809e400 2023-09-30T22:30:56.621 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:56.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.622+0000 7f162062f700 1 -- 172.21.15.40:0/3364389333 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f161809e400 msgr2=0x7f161811e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:56.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.622+0000 7f162062f700 1 --2- 172.21.15.40:0/3364389333 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f161809e400 0x7f161811e080 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f1608009870 tx=0x7f1608004750 comp rx=0 tx=0).stop 2023-09-30T22:30:56.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.623+0000 7f162062f700 1 -- 172.21.15.40:0/3364389333 shutdown_connections 2023-09-30T22:30:56.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.623+0000 7f162062f700 1 --2- 172.21.15.40:0/3364389333 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f161811e5c0 0x7f16181ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.623+0000 7f162062f700 1 --2- 172.21.15.40:0/3364389333 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f161809d920 0x7f161811db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.623+0000 7f162062f700 1 --2- 172.21.15.40:0/3364389333 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f161809e400 0x7f161811e080 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.623+0000 7f162062f700 1 -- 172.21.15.40:0/3364389333 >> 172.21.15.40:0/3364389333 conn(0x7f161809fb20 msgr2=0x7f16180a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:56.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.623+0000 7f162062f700 1 -- 172.21.15.40:0/3364389333 shutdown_connections 2023-09-30T22:30:56.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.623+0000 7f162062f700 1 -- 172.21.15.40:0/3364389333 wait complete. 2023-09-30T22:30:56.635 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:56.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.658+0000 7fe817509700 1 -- 172.21.15.40:0/3034446626 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe810062380 con 0x7fe81009e230 2023-09-30T22:30:56.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.659+0000 7fe805ffb700 1 -- 172.21.15.40:0/3034446626 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe800015020 con 0x7fe81009e230 2023-09-30T22:30:56.660 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:56.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.661+0000 7fe817509700 1 -- 172.21.15.40:0/3034446626 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe81009e230 msgr2=0x7fe810139230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:56.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.661+0000 7fe817509700 1 --2- 172.21.15.40:0/3034446626 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe81009e230 0x7fe810139230 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fe8000090b0 tx=0x7fe800004750 comp rx=0 tx=0).stop 2023-09-30T22:30:56.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.661+0000 7fe817509700 1 -- 172.21.15.40:0/3034446626 shutdown_connections 2023-09-30T22:30:56.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.661+0000 7fe817509700 1 --2- 172.21.15.40:0/3034446626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe810130de0 0x7fe81013a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.661+0000 7fe817509700 1 --2- 172.21.15.40:0/3034446626 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe81009d920 0x7fe810138cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.661+0000 7fe817509700 1 --2- 172.21.15.40:0/3034446626 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe81009e230 0x7fe810139230 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.661+0000 7fe817509700 1 -- 172.21.15.40:0/3034446626 >> 172.21.15.40:0/3034446626 conn(0x7fe81009fb20 msgr2=0x7fe8101298a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:56.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.661+0000 7fe817509700 1 -- 172.21.15.40:0/3034446626 shutdown_connections 2023-09-30T22:30:56.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.661+0000 7fe817509700 1 -- 172.21.15.40:0/3034446626 wait complete. 2023-09-30T22:30:56.671 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:56.673 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:56.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.797+0000 7f46fe329700 1 Processor -- start 2023-09-30T22:30:56.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.797+0000 7f46fe329700 1 -- start start 2023-09-30T22:30:56.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.797+0000 7f46fe329700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46f8133e00 0x7f46f81341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.797+0000 7f46fe329700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f46f809d400 0x7f46f809d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.797+0000 7f46fe329700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f46f809dd70 0x7f46f813ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.798+0000 7f46fe329700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46f809ab20 con 0x7f46f809d400 2023-09-30T22:30:56.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.798+0000 7f46fe329700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f8133940 con 0x7f46f8133e00 2023-09-30T22:30:56.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.798+0000 7f46fe329700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46f809f0d0 con 0x7f46f809dd70 2023-09-30T22:30:56.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.798+0000 7f46f77fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f46f809d400 0x7f46f809d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.798+0000 7f46f7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46f8133e00 0x7f46f81341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.798+0000 7f46fc8c6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f46f809dd70 0x7f46f813ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.798+0000 7f46f77fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f46f809d400 0x7f46f809d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42772/0 (socket says 172.21.15.40:42772) 2023-09-30T22:30:56.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.798+0000 7f46f7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46f8133e00 0x7f46f81341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42812/0 (socket says 172.21.15.40:42812) 2023-09-30T22:30:56.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.798+0000 7f46f77fe700 1 -- 172.21.15.40:0/2325727170 learned_addr learned my addr 172.21.15.40:0/2325727170 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:56.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.798+0000 7f46fc8c6700 1 -- 172.21.15.40:0/2325727170 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46f8133e00 msgr2=0x7f46f81341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:56.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.798+0000 7f46fc8c6700 1 --2- 172.21.15.40:0/2325727170 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46f8133e00 0x7f46f81341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.798+0000 7f46fc8c6700 1 -- 172.21.15.40:0/2325727170 >> v2:172.21.15.40:3300/0 conn(0x7f46f809d400 msgr2=0x7f46f809d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:56.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.798+0000 7f46fc8c6700 1 --2- 172.21.15.40:0/2325727170 >> v2:172.21.15.40:3300/0 conn(0x7f46f809d400 0x7f46f809d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.798+0000 7f46fc8c6700 1 -- 172.21.15.40:0/2325727170 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f809e210 con 0x7f46f809dd70 2023-09-30T22:30:56.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.798+0000 7f46f77fe700 1 --2- 172.21.15.40:0/2325727170 >> v2:172.21.15.40:3300/0 conn(0x7f46f809d400 0x7f46f809d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:56.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.798+0000 7f46f7fff700 1 --2- 172.21.15.40:0/2325727170 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46f8133e00 0x7f46f81341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:56.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.798+0000 7f46fc8c6700 1 --2- 172.21.15.40:0/2325727170 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f46f809dd70 0x7f46f813ac70 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f46f0009d90 tx=0x7f46f000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee8f0fc4aa6fe323 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:56.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.798+0000 7f46f6ffd700 1 -- 172.21.15.40:0/2325727170 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f000e070 con 0x7f46f809dd70 2023-09-30T22:30:56.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.798+0000 7f46f6ffd700 1 -- 172.21.15.40:0/2325727170 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f000bb20 con 0x7f46f809dd70 2023-09-30T22:30:56.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.798+0000 7f46f6ffd700 1 -- 172.21.15.40:0/2325727170 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f0012430 con 0x7f46f809dd70 2023-09-30T22:30:56.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.799+0000 7f46fe329700 1 -- 172.21.15.40:0/2325727170 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f46f809dd70 msgr2=0x7f46f813ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:56.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.799+0000 7f46fe329700 1 --2- 172.21.15.40:0/2325727170 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f46f809dd70 0x7f46f813ac70 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f46f0009d90 tx=0x7f46f000b330 comp rx=0 tx=0).stop 2023-09-30T22:30:56.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.799+0000 7f46fe329700 1 -- 172.21.15.40:0/2325727170 shutdown_connections 2023-09-30T22:30:56.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.799+0000 7f46fe329700 1 --2- 172.21.15.40:0/2325727170 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f46f809dd70 0x7f46f813ac70 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.799+0000 7f46fe329700 1 --2- 172.21.15.40:0/2325727170 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46f8133e00 0x7f46f81341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.799+0000 7f46fe329700 1 --2- 172.21.15.40:0/2325727170 >> v2:172.21.15.40:3300/0 conn(0x7f46f809d400 0x7f46f809d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.799+0000 7f46fe329700 1 -- 172.21.15.40:0/2325727170 >> 172.21.15.40:0/2325727170 conn(0x7f46f80a2a00 msgr2=0x7f46f80a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:56.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.799+0000 7f46fe329700 1 -- 172.21.15.40:0/2325727170 shutdown_connections 2023-09-30T22:30:56.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.799+0000 7f46fe329700 1 -- 172.21.15.40:0/2325727170 wait complete. 2023-09-30T22:30:56.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.800+0000 7f46fe329700 1 Processor -- start 2023-09-30T22:30:56.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.800+0000 7f46fe329700 1 -- start start 2023-09-30T22:30:56.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.801+0000 7f46fe329700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46f809d400 0x7f46f8119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.801+0000 7f46fe329700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46f809dd70 0x7f46f8119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.801+0000 7f46fe329700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f46f8133e00 0x7f46f8119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:56.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.801+0000 7f46fe329700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f811c200 con 0x7f46f809d400 2023-09-30T22:30:56.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.801+0000 7f46fe329700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f811a530 con 0x7f46f809dd70 2023-09-30T22:30:56.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.801+0000 7f46fe329700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46f811b780 con 0x7f46f8133e00 2023-09-30T22:30:56.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.801+0000 7f46f7fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46f809d400 0x7f46f8119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.801+0000 7f46f77fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46f809dd70 0x7f46f8119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.801+0000 7f46f7fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46f809d400 0x7f46f8119050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42780/0 (socket says 172.21.15.40:42780) 2023-09-30T22:30:56.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.801+0000 7f46f7fff700 1 -- 172.21.15.40:0/2344968145 learned_addr learned my addr 172.21.15.40:0/2344968145 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:56.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.801+0000 7f46fc8c6700 1 --2- 172.21.15.40:0/2344968145 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f46f8133e00 0x7f46f8119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:56.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.801+0000 7f46f7fff700 1 -- 172.21.15.40:0/2344968145 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f46f8133e00 msgr2=0x7f46f8119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:56.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.801+0000 7f46f7fff700 1 --2- 172.21.15.40:0/2344968145 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f46f8133e00 0x7f46f8119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.801+0000 7f46f7fff700 1 -- 172.21.15.40:0/2344968145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46f809dd70 msgr2=0x7f46f8119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:56.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.801+0000 7f46f7fff700 1 --2- 172.21.15.40:0/2344968145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46f809dd70 0x7f46f8119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:56.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.801+0000 7f46f7fff700 1 -- 172.21.15.40:0/2344968145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ec009550 con 0x7f46f809d400 2023-09-30T22:30:56.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.801+0000 7f46f77fe700 1 --2- 172.21.15.40:0/2344968145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46f809dd70 0x7f46f8119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:56.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.802+0000 7f46f7fff700 1 --2- 172.21.15.40:0/2344968145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46f809d400 0x7f46f8119050 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f46e800ec10 tx=0x7f46e800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:56.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.802+0000 7f46f4ff9700 1 -- 172.21.15.40:0/2344968145 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e800c850 con 0x7f46f809d400 2023-09-30T22:30:56.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.802+0000 7f46f4ff9700 1 -- 172.21.15.40:0/2344968145 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e800c9b0 con 0x7f46f809d400 2023-09-30T22:30:56.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.802+0000 7f46fe329700 1 -- 172.21.15.40:0/2344968145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e80094a0 con 0x7f46f809d400 2023-09-30T22:30:56.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.802+0000 7f46f4ff9700 1 -- 172.21.15.40:0/2344968145 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e800cd20 con 0x7f46f809d400 2023-09-30T22:30:56.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.802+0000 7f46fe329700 1 -- 172.21.15.40:0/2344968145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f0009a70 con 0x7f46f809d400 2023-09-30T22:30:56.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.803+0000 7f46f4ff9700 1 -- 172.21.15.40:0/2344968145 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f46e8013470 con 0x7f46f809d400 2023-09-30T22:30:56.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.803+0000 7f46f4ff9700 1 -- 172.21.15.40:0/2344968145 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f46e803fa80 con 0x7f46f809d400 2023-09-30T22:30:56.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.803+0000 7f46fe329700 1 -- 172.21.15.40:0/2344968145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46f809c2a0 con 0x7f46f809d400 2023-09-30T22:30:56.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:56.807+0000 7f46f4ff9700 1 -- 172.21.15.40:0/2344968145 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f46e8013720 con 0x7f46f809d400 2023-09-30T22:30:57.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.004+0000 7f46fe329700 1 -- 172.21.15.40:0/2344968145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f46f812e1a0 con 0x7f46f809d400 2023-09-30T22:30:57.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.004+0000 7f46f4ff9700 1 -- 172.21.15.40:0/2344968145 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f46e8017020 con 0x7f46f809d400 2023-09-30T22:30:57.005 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:57.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.007+0000 7f46fe329700 1 -- 172.21.15.40:0/2344968145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46f809d400 msgr2=0x7f46f8119050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:57.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.007+0000 7f46fe329700 1 --2- 172.21.15.40:0/2344968145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46f809d400 0x7f46f8119050 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f46e800ec10 tx=0x7f46e800ef20 comp rx=0 tx=0).stop 2023-09-30T22:30:57.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.007+0000 7f46fe329700 1 -- 172.21.15.40:0/2344968145 shutdown_connections 2023-09-30T22:30:57.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.007+0000 7f46fe329700 1 --2- 172.21.15.40:0/2344968145 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f46f8133e00 0x7f46f8119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.007+0000 7f46fe329700 1 --2- 172.21.15.40:0/2344968145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46f809d400 0x7f46f8119050 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.007+0000 7f46fe329700 1 --2- 172.21.15.40:0/2344968145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46f809dd70 0x7f46f8119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.007+0000 7f46fe329700 1 -- 172.21.15.40:0/2344968145 >> 172.21.15.40:0/2344968145 conn(0x7f46f80a2a00 msgr2=0x7f46f812d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:57.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.007+0000 7f46fe329700 1 -- 172.21.15.40:0/2344968145 shutdown_connections 2023-09-30T22:30:57.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.007+0000 7f46fe329700 1 -- 172.21.15.40:0/2344968145 wait complete. 2023-09-30T22:30:57.019 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:57.567 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:57.636 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:57.675 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:57.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.701+0000 7f786ba52700 1 Processor -- start 2023-09-30T22:30:57.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.702+0000 7f786ba52700 1 -- start start 2023-09-30T22:30:57.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.702+0000 7f786ba52700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f786412e590 0x7f786412e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:57.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.702+0000 7f786ba52700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f786412eea0 0x7f786412d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:57.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.702+0000 7f786ba52700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f786412d6d0 0x7f786412db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:57.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.702+0000 7f786ba52700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f786409ca30 con 0x7f786412e590 2023-09-30T22:30:57.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.702+0000 7f786ba52700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f786409ab70 con 0x7f786412d6d0 2023-09-30T22:30:57.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.702+0000 7f786ba52700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f786409bd70 con 0x7f786412eea0 2023-09-30T22:30:57.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.702+0000 7f7868fed700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f786412eea0 0x7f786412d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:57.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.702+0000 7f7868fed700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f786412eea0 0x7f786412d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60226/0 (socket says 172.21.15.40:60226) 2023-09-30T22:30:57.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.702+0000 7f7868fed700 1 -- 172.21.15.40:0/1472944068 learned_addr learned my addr 172.21.15.40:0/1472944068 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:57.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.702+0000 7f78697ee700 1 --2- 172.21.15.40:0/1472944068 >> v2:172.21.15.40:3300/0 conn(0x7f786412e590 0x7f786412e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:57.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.702+0000 7f7869fef700 1 --2- 172.21.15.40:0/1472944068 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f786412d6d0 0x7f786412db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:57.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.703+0000 7f78697ee700 1 -- 172.21.15.40:0/1472944068 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f786412eea0 msgr2=0x7f786412d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:57.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.703+0000 7f78697ee700 1 --2- 172.21.15.40:0/1472944068 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f786412eea0 0x7f786412d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.703+0000 7f78697ee700 1 -- 172.21.15.40:0/1472944068 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f786412d6d0 msgr2=0x7f786412db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:57.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.703+0000 7f78697ee700 1 --2- 172.21.15.40:0/1472944068 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f786412d6d0 0x7f786412db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.703+0000 7f78697ee700 1 -- 172.21.15.40:0/1472944068 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f786409b270 con 0x7f786412e590 2023-09-30T22:30:57.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.703+0000 7f78697ee700 1 --2- 172.21.15.40:0/1472944068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f786412e590 0x7f786412e960 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f7860009840 tx=0x7f7860009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f779448e972ec17 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:57.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.703+0000 7f785bfff700 1 -- 172.21.15.40:0/1472944068 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7860011830 con 0x7f786412e590 2023-09-30T22:30:57.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.703+0000 7f785bfff700 1 -- 172.21.15.40:0/1472944068 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7860011990 con 0x7f786412e590 2023-09-30T22:30:57.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.703+0000 7f785bfff700 1 -- 172.21.15.40:0/1472944068 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7860011d20 con 0x7f786412e590 2023-09-30T22:30:57.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.704+0000 7f786ba52700 1 -- 172.21.15.40:0/1472944068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f786412e590 msgr2=0x7f786412e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:57.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.704+0000 7f786ba52700 1 --2- 172.21.15.40:0/1472944068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f786412e590 0x7f786412e960 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f7860009840 tx=0x7f7860009b50 comp rx=0 tx=0).stop 2023-09-30T22:30:57.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.704+0000 7f786ba52700 1 -- 172.21.15.40:0/1472944068 shutdown_connections 2023-09-30T22:30:57.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.704+0000 7f786ba52700 1 --2- 172.21.15.40:0/1472944068 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f786412d6d0 0x7f786412db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.704+0000 7f786ba52700 1 --2- 172.21.15.40:0/1472944068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f786412e590 0x7f786412e960 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.704+0000 7f786ba52700 1 --2- 172.21.15.40:0/1472944068 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f786412eea0 0x7f786412d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.704+0000 7f786ba52700 1 -- 172.21.15.40:0/1472944068 >> 172.21.15.40:0/1472944068 conn(0x7f78640a2a00 msgr2=0x7f78640a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:57.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.704+0000 7f786ba52700 1 -- 172.21.15.40:0/1472944068 shutdown_connections 2023-09-30T22:30:57.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.704+0000 7f786ba52700 1 -- 172.21.15.40:0/1472944068 wait complete. 2023-09-30T22:30:57.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.705+0000 7f786ba52700 1 Processor -- start 2023-09-30T22:30:57.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.706+0000 7f786ba52700 1 -- start start 2023-09-30T22:30:57.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.706+0000 7f786ba52700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f786412d6d0 0x7f786411ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:57.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.706+0000 7f786ba52700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f786412e590 0x7f786411e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:57.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.706+0000 7f786ba52700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f786412eea0 0x7f786411e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:57.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.706+0000 7f786ba52700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7864120c30 con 0x7f786412d6d0 2023-09-30T22:30:57.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.706+0000 7f786ba52700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f786411ff10 con 0x7f786412e590 2023-09-30T22:30:57.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.706+0000 7f786ba52700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f786409b4b0 con 0x7f786412eea0 2023-09-30T22:30:57.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.707+0000 7f7869fef700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f786412eea0 0x7f786411e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:57.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.707+0000 7f78697ee700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f786412d6d0 0x7f786411ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:57.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.707+0000 7f7868fed700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f786412e590 0x7f786411e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:57.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.707+0000 7f7869fef700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f786412eea0 0x7f786411e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60234/0 (socket says 172.21.15.40:60234) 2023-09-30T22:30:57.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.707+0000 7f7869fef700 1 -- 172.21.15.40:0/3741610363 learned_addr learned my addr 172.21.15.40:0/3741610363 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:57.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.707+0000 7f78697ee700 1 -- 172.21.15.40:0/3741610363 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f786412eea0 msgr2=0x7f786411e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:57.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.707+0000 7f78697ee700 1 --2- 172.21.15.40:0/3741610363 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f786412eea0 0x7f786411e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.707+0000 7f78697ee700 1 -- 172.21.15.40:0/3741610363 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f786412e590 msgr2=0x7f786411e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:57.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.707+0000 7f78697ee700 1 --2- 172.21.15.40:0/3741610363 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f786412e590 0x7f786411e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.707+0000 7f78697ee700 1 -- 172.21.15.40:0/3741610363 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78600094a0 con 0x7f786412d6d0 2023-09-30T22:30:57.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.707+0000 7f7869fef700 1 --2- 172.21.15.40:0/3741610363 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f786412eea0 0x7f786411e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:57.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.707+0000 7f78697ee700 1 --2- 172.21.15.40:0/3741610363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f786412d6d0 0x7f786411ddc0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f7860016000 tx=0x7f7860004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:57.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.707+0000 7f7859ffb700 1 -- 172.21.15.40:0/3741610363 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7860004450 con 0x7f786412d6d0 2023-09-30T22:30:57.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.707+0000 7f7859ffb700 1 -- 172.21.15.40:0/3741610363 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786001f070 con 0x7f786412d6d0 2023-09-30T22:30:57.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.707+0000 7f786ba52700 1 -- 172.21.15.40:0/3741610363 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f786409fc70 con 0x7f786412d6d0 2023-09-30T22:30:57.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.707+0000 7f7859ffb700 1 -- 172.21.15.40:0/3741610363 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78600038e0 con 0x7f786412d6d0 2023-09-30T22:30:57.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.708+0000 7f786ba52700 1 -- 172.21.15.40:0/3741610363 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7864121530 con 0x7f786412d6d0 2023-09-30T22:30:57.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.708+0000 7f7859ffb700 1 -- 172.21.15.40:0/3741610363 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7860003a40 con 0x7f786412d6d0 2023-09-30T22:30:57.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.708+0000 7f7859ffb700 1 -- 172.21.15.40:0/3741610363 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f7860021070 con 0x7f786412d6d0 2023-09-30T22:30:57.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.709+0000 7f786ba52700 1 -- 172.21.15.40:0/3741610363 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7864062380 con 0x7f786412d6d0 2023-09-30T22:30:57.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.714+0000 7f7859ffb700 1 -- 172.21.15.40:0/3741610363 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f786002b080 con 0x7f786412d6d0 2023-09-30T22:30:57.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.770+0000 7fcdfdf3f700 1 Processor -- start 2023-09-30T22:30:57.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.770+0000 7fcdfdf3f700 1 -- start start 2023-09-30T22:30:57.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.771+0000 7fcdfdf3f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcdf8133e00 0x7fcdf81341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:57.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.771+0000 7fcdfdf3f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdf809d400 0x7fcdf809d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:57.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.771+0000 7fcdfdf3f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdf809dd70 0x7fcdf813ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:57.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.771+0000 7fcdfdf3f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdf809ab20 con 0x7fcdf8133e00 2023-09-30T22:30:57.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.771+0000 7fcdfdf3f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf8133940 con 0x7fcdf809d400 2023-09-30T22:30:57.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.771+0000 7fcdfdf3f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf809f0d0 con 0x7fcdf809dd70 2023-09-30T22:30:57.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.771+0000 7fcdf77fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcdf8133e00 0x7fcdf81341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:57.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.771+0000 7fcdf7fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdf809dd70 0x7fcdf813ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:57.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.771+0000 7fcdf6ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdf809d400 0x7fcdf809d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:57.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.771+0000 7fcdf7fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdf809dd70 0x7fcdf813ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60250/0 (socket says 172.21.15.40:60250) 2023-09-30T22:30:57.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.771+0000 7fcdf77fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcdf8133e00 0x7fcdf81341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42816/0 (socket says 172.21.15.40:42816) 2023-09-30T22:30:57.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.771+0000 7fcdf7fff700 1 -- 172.21.15.40:0/1586368394 learned_addr learned my addr 172.21.15.40:0/1586368394 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:57.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.771+0000 7fcdf7fff700 1 -- 172.21.15.40:0/1586368394 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdf809d400 msgr2=0x7fcdf809d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:57.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.771+0000 7fcdf7fff700 1 --2- 172.21.15.40:0/1586368394 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdf809d400 0x7fcdf809d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.771+0000 7fcdf7fff700 1 -- 172.21.15.40:0/1586368394 >> v2:172.21.15.40:3300/0 conn(0x7fcdf8133e00 msgr2=0x7fcdf81341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:57.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.771+0000 7fcdf7fff700 1 --2- 172.21.15.40:0/1586368394 >> v2:172.21.15.40:3300/0 conn(0x7fcdf8133e00 0x7fcdf81341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.771+0000 7fcdf7fff700 1 -- 172.21.15.40:0/1586368394 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf8133be0 con 0x7fcdf809dd70 2023-09-30T22:30:57.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.771+0000 7fcdf6ffd700 1 --2- 172.21.15.40:0/1586368394 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdf809d400 0x7fcdf809d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:57.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.771+0000 7fcdf77fe700 1 --2- 172.21.15.40:0/1586368394 >> v2:172.21.15.40:3300/0 conn(0x7fcdf8133e00 0x7fcdf81341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:57.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.772+0000 7fcdf7fff700 1 --2- 172.21.15.40:0/1586368394 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdf809dd70 0x7fcdf813ac70 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0009e50 tx=0x7fcdf000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb1e5bd47fcb201 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:57.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.772+0000 7fcdf67fc700 1 -- 172.21.15.40:0/1586368394 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf000e070 con 0x7fcdf809dd70 2023-09-30T22:30:57.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.772+0000 7fcdf67fc700 1 -- 172.21.15.40:0/1586368394 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf000b910 con 0x7fcdf809dd70 2023-09-30T22:30:57.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.772+0000 7fcdf67fc700 1 -- 172.21.15.40:0/1586368394 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf000bcc0 con 0x7fcdf809dd70 2023-09-30T22:30:57.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.772+0000 7fcdfdf3f700 1 -- 172.21.15.40:0/1586368394 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdf809dd70 msgr2=0x7fcdf813ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:57.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.772+0000 7fcdfdf3f700 1 --2- 172.21.15.40:0/1586368394 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdf809dd70 0x7fcdf813ac70 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0009e50 tx=0x7fcdf000b330 comp rx=0 tx=0).stop 2023-09-30T22:30:57.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.772+0000 7fcdfdf3f700 1 -- 172.21.15.40:0/1586368394 shutdown_connections 2023-09-30T22:30:57.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.772+0000 7fcdfdf3f700 1 --2- 172.21.15.40:0/1586368394 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdf809dd70 0x7fcdf813ac70 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.772+0000 7fcdfdf3f700 1 --2- 172.21.15.40:0/1586368394 >> v2:172.21.15.40:3300/0 conn(0x7fcdf8133e00 0x7fcdf81341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.772+0000 7fcdfdf3f700 1 --2- 172.21.15.40:0/1586368394 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdf809d400 0x7fcdf809d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.772+0000 7fcdfdf3f700 1 -- 172.21.15.40:0/1586368394 >> 172.21.15.40:0/1586368394 conn(0x7fcdf80a2a00 msgr2=0x7fcdf80a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:57.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.772+0000 7fcdfdf3f700 1 -- 172.21.15.40:0/1586368394 shutdown_connections 2023-09-30T22:30:57.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.772+0000 7fcdfdf3f700 1 -- 172.21.15.40:0/1586368394 wait complete. 2023-09-30T22:30:57.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.773+0000 7fcdfdf3f700 1 Processor -- start 2023-09-30T22:30:57.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.774+0000 7fcdfdf3f700 1 -- start start 2023-09-30T22:30:57.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.774+0000 7fcdfdf3f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdf809d400 0x7fcdf8119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:57.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.774+0000 7fcdfdf3f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdf809dd70 0x7fcdf8119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:57.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.774+0000 7fcdfdf3f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdf8133e00 0x7fcdf8119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:57.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.774+0000 7fcdfdf3f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf812e1a0 con 0x7fcdf809d400 2023-09-30T22:30:57.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.774+0000 7fcdfdf3f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf812bfb0 con 0x7fcdf8133e00 2023-09-30T22:30:57.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.774+0000 7fcdfdf3f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf811a440 con 0x7fcdf809dd70 2023-09-30T22:30:57.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.774+0000 7fcdf77fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdf809d400 0x7fcdf8119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:57.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.774+0000 7fcdf7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdf8133e00 0x7fcdf8119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:57.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.774+0000 7fcdf7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdf8133e00 0x7fcdf8119ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42846/0 (socket says 172.21.15.40:42846) 2023-09-30T22:30:57.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.774+0000 7fcdf77fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdf809d400 0x7fcdf8119050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42826/0 (socket says 172.21.15.40:42826) 2023-09-30T22:30:57.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.774+0000 7fcdf7fff700 1 -- 172.21.15.40:0/4154855762 learned_addr learned my addr 172.21.15.40:0/4154855762 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:57.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.774+0000 7fcdf6ffd700 1 --2- 172.21.15.40:0/4154855762 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdf809dd70 0x7fcdf8119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:57.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.775+0000 7fcdf77fe700 1 -- 172.21.15.40:0/4154855762 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdf809dd70 msgr2=0x7fcdf8119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:57.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.775+0000 7fcdf77fe700 1 --2- 172.21.15.40:0/4154855762 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdf809dd70 0x7fcdf8119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.775+0000 7fcdf77fe700 1 -- 172.21.15.40:0/4154855762 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdf8133e00 msgr2=0x7fcdf8119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:57.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.775+0000 7fcdf77fe700 1 --2- 172.21.15.40:0/4154855762 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdf8133e00 0x7fcdf8119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.775+0000 7fcdf77fe700 1 -- 172.21.15.40:0/4154855762 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdec0094a0 con 0x7fcdf809d400 2023-09-30T22:30:57.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.775+0000 7fcdf77fe700 1 --2- 172.21.15.40:0/4154855762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdf809d400 0x7fcdf8119050 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fcde800e9b0 tx=0x7fcde800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:57.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.775+0000 7fcddffff700 1 -- 172.21.15.40:0/4154855762 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde800ee50 con 0x7fcdf809d400 2023-09-30T22:30:57.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.775+0000 7fcddffff700 1 -- 172.21.15.40:0/4154855762 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde800c850 con 0x7fcdf809d400 2023-09-30T22:30:57.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.775+0000 7fcdfdf3f700 1 -- 172.21.15.40:0/4154855762 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcde80094a0 con 0x7fcdf809d400 2023-09-30T22:30:57.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.775+0000 7fcddffff700 1 -- 172.21.15.40:0/4154855762 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde800cbe0 con 0x7fcdf809d400 2023-09-30T22:30:57.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.775+0000 7fcdfdf3f700 1 -- 172.21.15.40:0/4154855762 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf0009b30 con 0x7fcdf809d400 2023-09-30T22:30:57.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.776+0000 7fcdfdf3f700 1 -- 172.21.15.40:0/4154855762 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdf8062380 con 0x7fcdf809d400 2023-09-30T22:30:57.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.776+0000 7fcddffff700 1 -- 172.21.15.40:0/4154855762 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcde800cd40 con 0x7fcdf809d400 2023-09-30T22:30:57.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.777+0000 7fcddffff700 1 -- 172.21.15.40:0/4154855762 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fcde803f680 con 0x7fcdf809d400 2023-09-30T22:30:57.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.781+0000 7fcddffff700 1 -- 172.21.15.40:0/4154855762 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcde80036a0 con 0x7fcdf809d400 2023-09-30T22:30:57.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.838+0000 7fdf0ce4c700 1 Processor -- start 2023-09-30T22:30:57.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.838+0000 7fdf0ce4c700 1 -- start start 2023-09-30T22:30:57.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.839+0000 7fdf0ce4c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdf0809c890 0x7fdf0809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:57.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.839+0000 7fdf0ce4c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf0809d920 0x7fdf0809dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:57.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.839+0000 7fdf0ce4c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf080a2600 con 0x7fdf0809e2b0 2023-09-30T22:30:57.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.839+0000 7fdf0ce4c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf080a29d0 con 0x7fdf0809c890 2023-09-30T22:30:57.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.839+0000 7fdf0ce4c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0809fb40 con 0x7fdf0809d920 2023-09-30T22:30:57.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.839+0000 7fdf0659c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdf0809c890 0x7fdf0809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:57.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.839+0000 7fdf0659c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdf0809c890 0x7fdf0809cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42838/0 (socket says 172.21.15.40:42838) 2023-09-30T22:30:57.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.839+0000 7fdf0659c700 1 -- 172.21.15.40:0/409876841 learned_addr learned my addr 172.21.15.40:0/409876841 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:57.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.839+0000 7fdf05d9b700 1 --2- 172.21.15.40:0/409876841 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf0809d920 0x7fdf0809dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:57.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.839+0000 7fdf0659c700 1 -- 172.21.15.40:0/409876841 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf0809d920 msgr2=0x7fdf0809dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:57.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.839+0000 7fdf0659c700 1 --2- 172.21.15.40:0/409876841 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf0809d920 0x7fdf0809dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.839+0000 7fdf0659c700 1 -- 172.21.15.40:0/409876841 >> v1:172.21.15.40:6789/0 conn(0x7fdf0809e2b0 legacy=0x7fdf0813ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:57.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.839+0000 7fdf0659c700 1 -- 172.21.15.40:0/409876841 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0809e730 con 0x7fdf0809c890 2023-09-30T22:30:57.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.839+0000 7fdf0559a700 1 -- 172.21.15.40:0/409876841 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3335137756 0 0) 0x7fdf080a2600 con 0x7fdf0809e2b0 2023-09-30T22:30:57.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.839+0000 7fdf0659c700 1 --2- 172.21.15.40:0/409876841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf0809c890 0x7fdf0809cc60 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fdef8006fd0 tx=0x7fdef8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31739e3675625547 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:57.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.840+0000 7fdf0559a700 1 -- 172.21.15.40:0/409876841 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef8005e30 con 0x7fdf0809c890 2023-09-30T22:30:57.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.840+0000 7fdf0559a700 1 -- 172.21.15.40:0/409876841 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef8004030 con 0x7fdf0809c890 2023-09-30T22:30:57.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.840+0000 7fdf0559a700 1 -- 172.21.15.40:0/409876841 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef80043e0 con 0x7fdf0809c890 2023-09-30T22:30:57.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.840+0000 7fdf0ce4c700 1 -- 172.21.15.40:0/409876841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf0809c890 msgr2=0x7fdf0809cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:57.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.840+0000 7fdf0ce4c700 1 --2- 172.21.15.40:0/409876841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf0809c890 0x7fdf0809cc60 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fdef8006fd0 tx=0x7fdef8009bd0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.841+0000 7fdf0ce4c700 1 -- 172.21.15.40:0/409876841 shutdown_connections 2023-09-30T22:30:57.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.841+0000 7fdf0ce4c700 1 --2- 172.21.15.40:0/409876841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf0809c890 0x7fdf0809cc60 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.841+0000 7fdf0ce4c700 1 --2- 172.21.15.40:0/409876841 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf0809d920 0x7fdf0809dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.841+0000 7fdf0ce4c700 1 -- 172.21.15.40:0/409876841 >> 172.21.15.40:0/409876841 conn(0x7fdf080a7080 msgr2=0x7fdf080a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:57.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.841+0000 7fdf0ce4c700 1 -- 172.21.15.40:0/409876841 shutdown_connections 2023-09-30T22:30:57.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.841+0000 7fdf0ce4c700 1 -- 172.21.15.40:0/409876841 wait complete. 2023-09-30T22:30:57.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.842+0000 7fdf0ce4c700 1 Processor -- start 2023-09-30T22:30:57.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.842+0000 7fdf0ce4c700 1 -- start start 2023-09-30T22:30:57.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.842+0000 7fdf0ce4c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf0809c890 0x7fdf0812f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:57.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.842+0000 7fdf0ce4c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf0809d920 0x7fdf0812f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:57.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.842+0000 7fdf0ce4c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf0809e2b0 0x7fdf0812ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:57.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.842+0000 7fdf0ce4c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0812daa0 con 0x7fdf0809d920 2023-09-30T22:30:57.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.842+0000 7fdf0ce4c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf08131400 con 0x7fdf0809c890 2023-09-30T22:30:57.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.842+0000 7fdf0ce4c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0812e300 con 0x7fdf0809e2b0 2023-09-30T22:30:57.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.842+0000 7fdf05d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf0809d920 0x7fdf0812f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:57.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.842+0000 7fdf05d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf0809d920 0x7fdf0812f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42854/0 (socket says 172.21.15.40:42854) 2023-09-30T22:30:57.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.842+0000 7fdf06d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf0809e2b0 0x7fdf0812ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:57.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.842+0000 7fdf05d9b700 1 -- 172.21.15.40:0/1559136914 learned_addr learned my addr 172.21.15.40:0/1559136914 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:57.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.842+0000 7fdf0659c700 1 --2- 172.21.15.40:0/1559136914 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf0809c890 0x7fdf0812f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:57.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.843+0000 7fdf05d9b700 1 -- 172.21.15.40:0/1559136914 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf0809e2b0 msgr2=0x7fdf0812ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:57.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.843+0000 7fdf05d9b700 1 --2- 172.21.15.40:0/1559136914 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf0809e2b0 0x7fdf0812ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.843+0000 7fdf05d9b700 1 -- 172.21.15.40:0/1559136914 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf0809c890 msgr2=0x7fdf0812f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:57.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.843+0000 7fdf05d9b700 1 --2- 172.21.15.40:0/1559136914 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf0809c890 0x7fdf0812f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.843+0000 7fdf05d9b700 1 -- 172.21.15.40:0/1559136914 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef8009500 con 0x7fdf0809d920 2023-09-30T22:30:57.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.843+0000 7fdf05d9b700 1 --2- 172.21.15.40:0/1559136914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf0809d920 0x7fdf0812f9c0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fdefc00e9b0 tx=0x7fdefc00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:57.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.843+0000 7fdef6ffd700 1 -- 172.21.15.40:0/1559136914 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc009710 con 0x7fdf0809d920 2023-09-30T22:30:57.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.843+0000 7fdef6ffd700 1 -- 172.21.15.40:0/1559136914 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdefc00ee50 con 0x7fdf0809d920 2023-09-30T22:30:57.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.843+0000 7fdf0ce4c700 1 -- 172.21.15.40:0/1559136914 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf0809ecf0 con 0x7fdf0809d920 2023-09-30T22:30:57.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.843+0000 7fdef6ffd700 1 -- 172.21.15.40:0/1559136914 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc00ca50 con 0x7fdf0809d920 2023-09-30T22:30:57.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.843+0000 7fdf0ce4c700 1 -- 172.21.15.40:0/1559136914 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf0812d590 con 0x7fdf0809d920 2023-09-30T22:30:57.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.844+0000 7fdef6ffd700 1 -- 172.21.15.40:0/1559136914 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdefc00cbb0 con 0x7fdf0809d920 2023-09-30T22:30:57.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.844+0000 7fdef6ffd700 1 -- 172.21.15.40:0/1559136914 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fdefc03fae0 con 0x7fdf0809d920 2023-09-30T22:30:57.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.844+0000 7fdf0ce4c700 1 -- 172.21.15.40:0/1559136914 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf0806e600 con 0x7fdf0809d920 2023-09-30T22:30:57.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.853+0000 7fdef6ffd700 1 -- 172.21.15.40:0/1559136914 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdefc01b3b0 con 0x7fdf0809d920 2023-09-30T22:30:57.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.936+0000 7f786ba52700 1 -- 172.21.15.40:0/3741610363 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f78641211d0 con 0x7f786412d6d0 2023-09-30T22:30:57.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.936+0000 7f7859ffb700 1 -- 172.21.15.40:0/3741610363 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7860015020 con 0x7f786412d6d0 2023-09-30T22:30:57.937 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:57.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.938+0000 7f786ba52700 1 -- 172.21.15.40:0/3741610363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f786412d6d0 msgr2=0x7f786411ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:57.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.938+0000 7f786ba52700 1 --2- 172.21.15.40:0/3741610363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f786412d6d0 0x7f786411ddc0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f7860016000 tx=0x7f7860004750 comp rx=0 tx=0).stop 2023-09-30T22:30:57.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.938+0000 7f786ba52700 1 -- 172.21.15.40:0/3741610363 shutdown_connections 2023-09-30T22:30:57.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.938+0000 7f786ba52700 1 --2- 172.21.15.40:0/3741610363 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f786412eea0 0x7f786411e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.938+0000 7f786ba52700 1 --2- 172.21.15.40:0/3741610363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f786412d6d0 0x7f786411ddc0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.938+0000 7f786ba52700 1 --2- 172.21.15.40:0/3741610363 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f786412e590 0x7f786411e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:57.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.938+0000 7f786ba52700 1 -- 172.21.15.40:0/3741610363 >> 172.21.15.40:0/3741610363 conn(0x7f78640a2a00 msgr2=0x7f786412c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:57.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.938+0000 7f786ba52700 1 -- 172.21.15.40:0/3741610363 shutdown_connections 2023-09-30T22:30:57.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.939+0000 7f786ba52700 1 -- 172.21.15.40:0/3741610363 wait complete. 2023-09-30T22:30:57.951 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:57.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.997+0000 7fcdfdf3f700 1 -- 172.21.15.40:0/4154855762 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcdf811aaf0 con 0x7fcdf809d400 2023-09-30T22:30:57.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.997+0000 7fcddffff700 1 -- 172.21.15.40:0/4154855762 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcde8021020 con 0x7fcdf809d400 2023-09-30T22:30:57.998 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.999+0000 7fcdfdf3f700 1 -- 172.21.15.40:0/4154855762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdf809d400 msgr2=0x7fcdf8119050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.999+0000 7fcdfdf3f700 1 --2- 172.21.15.40:0/4154855762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdf809d400 0x7fcdf8119050 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fcde800e9b0 tx=0x7fcde800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.999+0000 7fcdfdf3f700 1 -- 172.21.15.40:0/4154855762 shutdown_connections 2023-09-30T22:30:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.999+0000 7fcdfdf3f700 1 --2- 172.21.15.40:0/4154855762 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcdf8133e00 0x7fcdf8119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.999+0000 7fcdfdf3f700 1 --2- 172.21.15.40:0/4154855762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdf809d400 0x7fcdf8119050 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.999+0000 7fcdfdf3f700 1 --2- 172.21.15.40:0/4154855762 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcdf809dd70 0x7fcdf8119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.999+0000 7fcdfdf3f700 1 -- 172.21.15.40:0/4154855762 >> 172.21.15.40:0/4154855762 conn(0x7fcdf80a2a00 msgr2=0x7fcdf812d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:58.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.999+0000 7fcdfdf3f700 1 -- 172.21.15.40:0/4154855762 shutdown_connections 2023-09-30T22:30:58.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:57.999+0000 7fcdfdf3f700 1 -- 172.21.15.40:0/4154855762 wait complete. 2023-09-30T22:30:58.012 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:58.020 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:58.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.055+0000 7fdf0ce4c700 1 -- 172.21.15.40:0/1559136914 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdf08062380 con 0x7fdf0809d920 2023-09-30T22:30:58.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.055+0000 7fdef6ffd700 1 -- 172.21.15.40:0/1559136914 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdefc017020 con 0x7fdf0809d920 2023-09-30T22:30:58.056 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:58.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.057+0000 7fdf0ce4c700 1 -- 172.21.15.40:0/1559136914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf0809d920 msgr2=0x7fdf0812f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:58.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.057+0000 7fdf0ce4c700 1 --2- 172.21.15.40:0/1559136914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf0809d920 0x7fdf0812f9c0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fdefc00e9b0 tx=0x7fdefc00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.057+0000 7fdf0ce4c700 1 -- 172.21.15.40:0/1559136914 shutdown_connections 2023-09-30T22:30:58.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.057+0000 7fdf0ce4c700 1 --2- 172.21.15.40:0/1559136914 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fdf0809e2b0 0x7fdf0812ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.057+0000 7fdf0ce4c700 1 --2- 172.21.15.40:0/1559136914 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf0809c890 0x7fdf0812f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.057+0000 7fdf0ce4c700 1 --2- 172.21.15.40:0/1559136914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf0809d920 0x7fdf0812f9c0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.057+0000 7fdf0ce4c700 1 -- 172.21.15.40:0/1559136914 >> 172.21.15.40:0/1559136914 conn(0x7fdf080a7080 msgr2=0x7fdf081bb140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:58.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.057+0000 7fdf0ce4c700 1 -- 172.21.15.40:0/1559136914 shutdown_connections 2023-09-30T22:30:58.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.057+0000 7fdf0ce4c700 1 -- 172.21.15.40:0/1559136914 wait complete. 2023-09-30T22:30:58.070 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:58.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.148+0000 7fadcea65700 1 Processor -- start 2023-09-30T22:30:58.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.148+0000 7fadcea65700 1 -- start start 2023-09-30T22:30:58.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.148+0000 7fadcea65700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadc809c890 0x7fadc809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:58.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.148+0000 7fadcea65700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadc809d920 0x7fadc809dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:58.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.148+0000 7fadcea65700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc80a2600 con 0x7fadc809e2b0 2023-09-30T22:30:58.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.148+0000 7fadcea65700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc80a29d0 con 0x7fadc809d920 2023-09-30T22:30:58.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.148+0000 7fadcea65700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fadc809fb40 con 0x7fadc809c890 2023-09-30T22:30:58.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.148+0000 7fadc7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadc809d920 0x7fadc809dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:58.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.148+0000 7fadc7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadc809d920 0x7fadc809dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42874/0 (socket says 172.21.15.40:42874) 2023-09-30T22:30:58.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.148+0000 7fadc7fff700 1 -- 172.21.15.40:0/734696543 learned_addr learned my addr 172.21.15.40:0/734696543 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:58.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.148+0000 7fadcc801700 1 --2- 172.21.15.40:0/734696543 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadc809c890 0x7fadc809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:58.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.149+0000 7fadc7fff700 1 -- 172.21.15.40:0/734696543 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadc809c890 msgr2=0x7fadc809cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:58.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.149+0000 7fadc7fff700 1 --2- 172.21.15.40:0/734696543 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadc809c890 0x7fadc809cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.149+0000 7fadc7fff700 1 -- 172.21.15.40:0/734696543 >> v1:172.21.15.40:6789/0 conn(0x7fadc809e2b0 legacy=0x7fadc813ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:58.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.149+0000 7fadc77fe700 1 -- 172.21.15.40:0/734696543 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2653808826 0 0) 0x7fadc80a2600 con 0x7fadc809e2b0 2023-09-30T22:30:58.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.149+0000 7fadc7fff700 1 -- 172.21.15.40:0/734696543 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc809e720 con 0x7fadc809d920 2023-09-30T22:30:58.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.149+0000 7fadc7fff700 1 --2- 172.21.15.40:0/734696543 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadc809d920 0x7fadc809dd70 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fadb4009920 tx=0x7fadb4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8e8f0530653b209 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:58.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.149+0000 7fadc77fe700 1 -- 172.21.15.40:0/734696543 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb4011830 con 0x7fadc809d920 2023-09-30T22:30:58.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.149+0000 7fadc77fe700 1 -- 172.21.15.40:0/734696543 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb4011990 con 0x7fadc809d920 2023-09-30T22:30:58.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.149+0000 7fadc77fe700 1 -- 172.21.15.40:0/734696543 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb4011d20 con 0x7fadc809d920 2023-09-30T22:30:58.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.150+0000 7fadcea65700 1 -- 172.21.15.40:0/734696543 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadc809d920 msgr2=0x7fadc809dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:58.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.150+0000 7fadcea65700 1 --2- 172.21.15.40:0/734696543 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadc809d920 0x7fadc809dd70 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fadb4009920 tx=0x7fadb4009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:58.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.150+0000 7fadcea65700 1 -- 172.21.15.40:0/734696543 shutdown_connections 2023-09-30T22:30:58.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.150+0000 7fadcea65700 1 --2- 172.21.15.40:0/734696543 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadc809c890 0x7fadc809cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.150+0000 7fadcea65700 1 --2- 172.21.15.40:0/734696543 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadc809d920 0x7fadc809dd70 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.150+0000 7fadcea65700 1 -- 172.21.15.40:0/734696543 >> 172.21.15.40:0/734696543 conn(0x7fadc80a7080 msgr2=0x7fadc80a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:58.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.150+0000 7fadcea65700 1 -- 172.21.15.40:0/734696543 shutdown_connections 2023-09-30T22:30:58.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.150+0000 7fadcea65700 1 -- 172.21.15.40:0/734696543 wait complete. 2023-09-30T22:30:58.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.151+0000 7fadcea65700 1 Processor -- start 2023-09-30T22:30:58.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.151+0000 7fadcea65700 1 -- start start 2023-09-30T22:30:58.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.151+0000 7fadcea65700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadc809c890 0x7fadc812b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:58.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.151+0000 7fadcea65700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadc809d920 0x7fadc812ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:58.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.151+0000 7fadcea65700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadc809e2b0 0x7fadc812bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:58.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.151+0000 7fadcea65700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc80a5a60 con 0x7fadc809c890 2023-09-30T22:30:58.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.151+0000 7fadcea65700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc809ecf0 con 0x7fadc809e2b0 2023-09-30T22:30:58.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.151+0000 7fadcea65700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fadc812e960 con 0x7fadc809d920 2023-09-30T22:30:58.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.151+0000 7fadcc801700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadc809c890 0x7fadc812b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:58.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.151+0000 7fadc7fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadc809d920 0x7fadc812ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:58.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.151+0000 7fadcc801700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadc809c890 0x7fadc812b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42864/0 (socket says 172.21.15.40:42864) 2023-09-30T22:30:58.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.151+0000 7fadcd002700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadc809e2b0 0x7fadc812bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:58.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.152+0000 7fadc7fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadc809d920 0x7fadc812ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60300/0 (socket says 172.21.15.40:60300) 2023-09-30T22:30:58.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.152+0000 7fadcc801700 1 -- 172.21.15.40:0/2344278339 learned_addr learned my addr 172.21.15.40:0/2344278339 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:58.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.152+0000 7fadcc801700 1 -- 172.21.15.40:0/2344278339 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadc809d920 msgr2=0x7fadc812ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:58.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.152+0000 7fadcc801700 1 --2- 172.21.15.40:0/2344278339 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadc809d920 0x7fadc812ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.152+0000 7fadcc801700 1 -- 172.21.15.40:0/2344278339 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadc809e2b0 msgr2=0x7fadc812bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:58.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.152+0000 7fadcc801700 1 --2- 172.21.15.40:0/2344278339 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadc809e2b0 0x7fadc812bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.152+0000 7fadcc801700 1 -- 172.21.15.40:0/2344278339 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb4009550 con 0x7fadc809c890 2023-09-30T22:30:58.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.152+0000 7fadc7fff700 1 --2- 172.21.15.40:0/2344278339 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadc809d920 0x7fadc812ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:58.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.152+0000 7fadcc801700 1 --2- 172.21.15.40:0/2344278339 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadc809c890 0x7fadc812b4e0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fadbc00e9b0 tx=0x7fadbc00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:58.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.152+0000 7fadc57fa700 1 -- 172.21.15.40:0/2344278339 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadbc009700 con 0x7fadc809c890 2023-09-30T22:30:58.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.152+0000 7fadc57fa700 1 -- 172.21.15.40:0/2344278339 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadbc00ee50 con 0x7fadc809c890 2023-09-30T22:30:58.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.152+0000 7fadcea65700 1 -- 172.21.15.40:0/2344278339 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc812d010 con 0x7fadc809c890 2023-09-30T22:30:58.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.152+0000 7fadc57fa700 1 -- 172.21.15.40:0/2344278339 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadbc00ca50 con 0x7fadc809c890 2023-09-30T22:30:58.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.152+0000 7fadcea65700 1 -- 172.21.15.40:0/2344278339 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc812e680 con 0x7fadc809c890 2023-09-30T22:30:58.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.153+0000 7fadc57fa700 1 -- 172.21.15.40:0/2344278339 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fadbc00cbb0 con 0x7fadc809c890 2023-09-30T22:30:58.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.153+0000 7fadc57fa700 1 -- 172.21.15.40:0/2344278339 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fadbc03fab0 con 0x7fadc809c890 2023-09-30T22:30:58.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.153+0000 7fadcea65700 1 -- 172.21.15.40:0/2344278339 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc806e600 con 0x7fadc809c890 2023-09-30T22:30:58.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.158+0000 7fadc57fa700 1 -- 172.21.15.40:0/2344278339 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fadbc021070 con 0x7fadc809c890 2023-09-30T22:30:58.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.352+0000 7fadcea65700 1 -- 172.21.15.40:0/2344278339 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fadc812e320 con 0x7fadc809c890 2023-09-30T22:30:58.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.353+0000 7fadc57fa700 1 -- 172.21.15.40:0/2344278339 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fadbc02a090 con 0x7fadc809c890 2023-09-30T22:30:58.354 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:58.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.355+0000 7fadcea65700 1 -- 172.21.15.40:0/2344278339 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadc809c890 msgr2=0x7fadc812b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:58.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.355+0000 7fadcea65700 1 --2- 172.21.15.40:0/2344278339 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadc809c890 0x7fadc812b4e0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fadbc00e9b0 tx=0x7fadbc00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.355+0000 7fadcea65700 1 -- 172.21.15.40:0/2344278339 shutdown_connections 2023-09-30T22:30:58.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.355+0000 7fadcea65700 1 --2- 172.21.15.40:0/2344278339 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadc809e2b0 0x7fadc812bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.355+0000 7fadcea65700 1 --2- 172.21.15.40:0/2344278339 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadc809c890 0x7fadc812b4e0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.355+0000 7fadcea65700 1 --2- 172.21.15.40:0/2344278339 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fadc809d920 0x7fadc812ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:58.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.355+0000 7fadcea65700 1 -- 172.21.15.40:0/2344278339 >> 172.21.15.40:0/2344278339 conn(0x7fadc80a7080 msgr2=0x7fadc81bb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:58.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.355+0000 7fadcea65700 1 -- 172.21.15.40:0/2344278339 shutdown_connections 2023-09-30T22:30:58.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:58.355+0000 7fadcea65700 1 -- 172.21.15.40:0/2344278339 wait complete. 2023-09-30T22:30:58.368 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:30:58.953 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:30:59.013 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:30:59.071 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:30:59.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.094+0000 7f8534f76700 1 Processor -- start 2023-09-30T22:30:59.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.094+0000 7f8534f76700 1 -- start start 2023-09-30T22:30:59.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.094+0000 7f8534f76700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8530131d50 0x7f8530132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.094+0000 7f8534f76700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f853009c7d0 0x7f8530139ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.095+0000 7f8534f76700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8530132660 con 0x7f853009bc50 2023-09-30T22:30:59.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.095+0000 7f8534f76700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85300719e0 con 0x7f853009c7d0 2023-09-30T22:30:59.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.095+0000 7f8534f76700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8530131900 con 0x7f8530131d50 2023-09-30T22:30:59.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.095+0000 7f852e59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8530131d50 0x7f8530132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.095+0000 7f852e59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8530131d50 0x7f8530132120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60316/0 (socket says 172.21.15.40:60316) 2023-09-30T22:30:59.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.095+0000 7f852e59c700 1 -- 172.21.15.40:0/3398971505 learned_addr learned my addr 172.21.15.40:0/3398971505 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:59.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.095+0000 7f852ed9d700 1 --2- 172.21.15.40:0/3398971505 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f853009c7d0 0x7f8530139ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.095+0000 7f852e59c700 1 -- 172.21.15.40:0/3398971505 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f853009c7d0 msgr2=0x7f8530139ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:59.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.095+0000 7f852e59c700 1 --2- 172.21.15.40:0/3398971505 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f853009c7d0 0x7f8530139ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.095+0000 7f852e59c700 1 -- 172.21.15.40:0/3398971505 >> v1:172.21.15.40:6789/0 conn(0x7f853009bc50 legacy=0x7f853009c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.095+0000 7f852e59c700 1 -- 172.21.15.40:0/3398971505 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853009e820 con 0x7f8530131d50 2023-09-30T22:30:59.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.095+0000 7f852e59c700 1 --2- 172.21.15.40:0/3398971505 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8530131d50 0x7f8530132120 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f8520009950 tx=0x7f8520009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5ed7fe87f1f75b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:59.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.095+0000 7f852d59a700 1 -- 172.21.15.40:0/3398971505 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8520011830 con 0x7f8530131d50 2023-09-30T22:30:59.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.095+0000 7f852d59a700 1 -- 172.21.15.40:0/3398971505 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8520011990 con 0x7f8530131d50 2023-09-30T22:30:59.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.095+0000 7f852d59a700 1 -- 172.21.15.40:0/3398971505 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8520011d40 con 0x7f8530131d50 2023-09-30T22:30:59.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.096+0000 7f8534f76700 1 -- 172.21.15.40:0/3398971505 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8530131d50 msgr2=0x7f8530132120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.096+0000 7f8534f76700 1 --2- 172.21.15.40:0/3398971505 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8530131d50 0x7f8530132120 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f8520009950 tx=0x7f8520009c60 comp rx=0 tx=0).stop 2023-09-30T22:30:59.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.096+0000 7f8534f76700 1 -- 172.21.15.40:0/3398971505 shutdown_connections 2023-09-30T22:30:59.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.096+0000 7f8534f76700 1 --2- 172.21.15.40:0/3398971505 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f853009c7d0 0x7f8530139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.096+0000 7f8534f76700 1 --2- 172.21.15.40:0/3398971505 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8530131d50 0x7f8530132120 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.096+0000 7f8534f76700 1 -- 172.21.15.40:0/3398971505 >> 172.21.15.40:0/3398971505 conn(0x7f85300a2a00 msgr2=0x7f85300a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:59.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.096+0000 7f8534f76700 1 -- 172.21.15.40:0/3398971505 shutdown_connections 2023-09-30T22:30:59.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.096+0000 7f8534f76700 1 -- 172.21.15.40:0/3398971505 wait complete. 2023-09-30T22:30:59.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.097+0000 7f8534f76700 1 Processor -- start 2023-09-30T22:30:59.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.098+0000 7f8534f76700 1 -- start start 2023-09-30T22:30:59.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.098+0000 7f8534f76700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f853009bc50 0x7f8530134840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.098+0000 7f8534f76700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f853009c7d0 0x7f8530134d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.098+0000 7f8534f76700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8530131d50 0x7f85301c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.098+0000 7f8534f76700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8530136b90 con 0x7f853009bc50 2023-09-30T22:30:59.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.098+0000 7f8534f76700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f853013ae00 con 0x7f8530131d50 2023-09-30T22:30:59.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.098+0000 7f8534f76700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8530134460 con 0x7f853009c7d0 2023-09-30T22:30:59.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.098+0000 7f852dd9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f853009c7d0 0x7f8530134d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.098+0000 7f852e59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f853009bc50 0x7f8530134840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.098+0000 7f852dd9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f853009c7d0 0x7f8530134d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60328/0 (socket says 172.21.15.40:60328) 2023-09-30T22:30:59.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.098+0000 7f852dd9b700 1 -- 172.21.15.40:0/3556343198 learned_addr learned my addr 172.21.15.40:0/3556343198 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:59.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.098+0000 7f852ed9d700 1 --2- 172.21.15.40:0/3556343198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8530131d50 0x7f85301c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.098+0000 7f852dd9b700 1 -- 172.21.15.40:0/3556343198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8530131d50 msgr2=0x7f85301c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.098+0000 7f852dd9b700 1 --2- 172.21.15.40:0/3556343198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8530131d50 0x7f85301c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.098+0000 7f852dd9b700 1 -- 172.21.15.40:0/3556343198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f853009bc50 msgr2=0x7f8530134840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.098+0000 7f852dd9b700 1 --2- 172.21.15.40:0/3556343198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f853009bc50 0x7f8530134840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.099+0000 7f852dd9b700 1 -- 172.21.15.40:0/3556343198 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8520009550 con 0x7f853009c7d0 2023-09-30T22:30:59.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.099+0000 7f852dd9b700 1 --2- 172.21.15.40:0/3556343198 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f853009c7d0 0x7f8530134d80 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f852400c420 tx=0x7f852400c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:59.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.099+0000 7f851effd700 1 -- 172.21.15.40:0/3556343198 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85240052d0 con 0x7f853009c7d0 2023-09-30T22:30:59.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.099+0000 7f851effd700 1 -- 172.21.15.40:0/3556343198 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8524005430 con 0x7f853009c7d0 2023-09-30T22:30:59.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.099+0000 7f8534f76700 1 -- 172.21.15.40:0/3556343198 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85301352c0 con 0x7f853009c7d0 2023-09-30T22:30:59.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.099+0000 7f851effd700 1 -- 172.21.15.40:0/3556343198 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85240038a0 con 0x7f853009c7d0 2023-09-30T22:30:59.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.099+0000 7f8534f76700 1 -- 172.21.15.40:0/3556343198 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85301373f0 con 0x7f853009c7d0 2023-09-30T22:30:59.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.100+0000 7f851effd700 1 -- 172.21.15.40:0/3556343198 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8524003a00 con 0x7f853009c7d0 2023-09-30T22:30:59.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.101+0000 7f8534f76700 1 -- 172.21.15.40:0/3556343198 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8530062380 con 0x7f853009c7d0 2023-09-30T22:30:59.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.101+0000 7f851effd700 1 -- 172.21.15.40:0/3556343198 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f852403e970 con 0x7f853009c7d0 2023-09-30T22:30:59.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.106+0000 7f851effd700 1 -- 172.21.15.40:0/3556343198 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8524019b40 con 0x7f853009c7d0 2023-09-30T22:30:59.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.148+0000 7f1f1b877700 1 Processor -- start 2023-09-30T22:30:59.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.148+0000 7f1f1b877700 1 -- start start 2023-09-30T22:30:59.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.149+0000 7f1f1b877700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f1409c890 0x7f1f1409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.149+0000 7f1f1b877700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1f1409d920 0x7f1f1409dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.149+0000 7f1f1b877700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f1409e2b0 0x7f1f1413ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.149+0000 7f1f1b877700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f140a29d0 con 0x7f1f1409d920 2023-09-30T22:30:59.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.149+0000 7f1f1b877700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1409fb40 con 0x7f1f1409e2b0 2023-09-30T22:30:59.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.149+0000 7f1f1b877700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f140a2600 con 0x7f1f1409c890 2023-09-30T22:30:59.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.149+0000 7f1f19613700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f1409c890 0x7f1f1409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.149+0000 7f1f19e14700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f1409e2b0 0x7f1f1413ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.149+0000 7f1f18e12700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1f1409d920 0x7f1f1409dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.149+0000 7f1f19613700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f1409c890 0x7f1f1409cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60338/0 (socket says 172.21.15.40:60338) 2023-09-30T22:30:59.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.149+0000 7f1f19e14700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f1409e2b0 0x7f1f1413ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42894/0 (socket says 172.21.15.40:42894) 2023-09-30T22:30:59.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.149+0000 7f1f18e12700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1f1409d920 0x7f1f1409dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42878/0 (socket says 172.21.15.40:42878) 2023-09-30T22:30:59.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.149+0000 7f1f19613700 1 -- 172.21.15.40:0/1263392780 learned_addr learned my addr 172.21.15.40:0/1263392780 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:59.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.149+0000 7f1f19613700 1 -- 172.21.15.40:0/1263392780 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f1409e2b0 msgr2=0x7f1f1413ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:59.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.149+0000 7f1f19613700 1 --2- 172.21.15.40:0/1263392780 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f1409e2b0 0x7f1f1413ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.149+0000 7f1f19613700 1 -- 172.21.15.40:0/1263392780 >> v2:172.21.15.40:3300/0 conn(0x7f1f1409d920 msgr2=0x7f1f1409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:59.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.149+0000 7f1f19613700 1 --2- 172.21.15.40:0/1263392780 >> v2:172.21.15.40:3300/0 conn(0x7f1f1409d920 0x7f1f1409dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.149+0000 7f1f19613700 1 -- 172.21.15.40:0/1263392780 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f1409e750 con 0x7f1f1409c890 2023-09-30T22:30:59.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.149+0000 7f1f19e14700 1 --2- 172.21.15.40:0/1263392780 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f1409e2b0 0x7f1f1413ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:59.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.149+0000 7f1f19613700 1 --2- 172.21.15.40:0/1263392780 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f1409c890 0x7f1f1409cc60 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f1f10006fd0 tx=0x7f1f10009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42beeb5efda2f186 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:59.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.150+0000 7f1f0bfff700 1 -- 172.21.15.40:0/1263392780 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f10005e30 con 0x7f1f1409c890 2023-09-30T22:30:59.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.150+0000 7f1f0bfff700 1 -- 172.21.15.40:0/1263392780 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f10004030 con 0x7f1f1409c890 2023-09-30T22:30:59.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.150+0000 7f1f0bfff700 1 -- 172.21.15.40:0/1263392780 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f100043e0 con 0x7f1f1409c890 2023-09-30T22:30:59.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.150+0000 7f1f1b877700 1 -- 172.21.15.40:0/1263392780 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f1409c890 msgr2=0x7f1f1409cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.150+0000 7f1f1b877700 1 --2- 172.21.15.40:0/1263392780 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f1409c890 0x7f1f1409cc60 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f1f10006fd0 tx=0x7f1f10009bd0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.150+0000 7f1f1b877700 1 -- 172.21.15.40:0/1263392780 shutdown_connections 2023-09-30T22:30:59.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.150+0000 7f1f1b877700 1 --2- 172.21.15.40:0/1263392780 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f1409c890 0x7f1f1409cc60 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.150+0000 7f1f1b877700 1 --2- 172.21.15.40:0/1263392780 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f1409e2b0 0x7f1f1413ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.150+0000 7f1f1b877700 1 --2- 172.21.15.40:0/1263392780 >> v2:172.21.15.40:3300/0 conn(0x7f1f1409d920 0x7f1f1409dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.150+0000 7f1f1b877700 1 -- 172.21.15.40:0/1263392780 >> 172.21.15.40:0/1263392780 conn(0x7f1f140a7080 msgr2=0x7f1f140a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:59.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.150+0000 7f1f1b877700 1 -- 172.21.15.40:0/1263392780 shutdown_connections 2023-09-30T22:30:59.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.150+0000 7f1f1b877700 1 -- 172.21.15.40:0/1263392780 wait complete. 2023-09-30T22:30:59.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.151+0000 7f1f1b877700 1 Processor -- start 2023-09-30T22:30:59.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.151+0000 7f1f1b877700 1 -- start start 2023-09-30T22:30:59.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.152+0000 7f1f1b877700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f1409c890 0x7f1f1412d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.152+0000 7f1f1b877700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f1409d920 0x7f1f1412d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.152+0000 7f1f1b877700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f1409e2b0 0x7f1f1412de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.152+0000 7f1f1b877700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1409bf10 con 0x7f1f1409d920 2023-09-30T22:30:59.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.152+0000 7f1f1b877700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1412ee10 con 0x7f1f1409e2b0 2023-09-30T22:30:59.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.152+0000 7f1f1b877700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f141306e0 con 0x7f1f1409c890 2023-09-30T22:30:59.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.152+0000 7f1f18e12700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f1409d920 0x7f1f1412d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.152+0000 7f1f19613700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f1409c890 0x7f1f1412d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.152+0000 7f1f18e12700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f1409d920 0x7f1f1412d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42890/0 (socket says 172.21.15.40:42890) 2023-09-30T22:30:59.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.152+0000 7f1f18e12700 1 -- 172.21.15.40:0/74572468 learned_addr learned my addr 172.21.15.40:0/74572468 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:59.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.152+0000 7f1f19613700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f1409c890 0x7f1f1412d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60340/0 (socket says 172.21.15.40:60340) 2023-09-30T22:30:59.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.152+0000 7f1f19e14700 1 --2- 172.21.15.40:0/74572468 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f1409e2b0 0x7f1f1412de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.152+0000 7f1f18e12700 1 -- 172.21.15.40:0/74572468 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f1409c890 msgr2=0x7f1f1412d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.152+0000 7f1f18e12700 1 --2- 172.21.15.40:0/74572468 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f1409c890 0x7f1f1412d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.152+0000 7f1f18e12700 1 -- 172.21.15.40:0/74572468 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f1409e2b0 msgr2=0x7f1f1412de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.152+0000 7f1f18e12700 1 --2- 172.21.15.40:0/74572468 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f1409e2b0 0x7f1f1412de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.152+0000 7f1f18e12700 1 -- 172.21.15.40:0/74572468 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f0c009a70 con 0x7f1f1409d920 2023-09-30T22:30:59.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.152+0000 7f1f19613700 1 --2- 172.21.15.40:0/74572468 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f1409c890 0x7f1f1412d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:59.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.153+0000 7f1f18e12700 1 --2- 172.21.15.40:0/74572468 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f1409d920 0x7f1f1412d910 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f1f0400e900 tx=0x7f1f0400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:59.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.153+0000 7f1f09ffb700 1 -- 172.21.15.40:0/74572468 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0400c640 con 0x7f1f1409d920 2023-09-30T22:30:59.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.153+0000 7f1f09ffb700 1 -- 172.21.15.40:0/74572468 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f0400c7a0 con 0x7f1f1409d920 2023-09-30T22:30:59.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.153+0000 7f1f09ffb700 1 -- 172.21.15.40:0/74572468 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0400cb50 con 0x7f1f1409d920 2023-09-30T22:30:59.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.153+0000 7f1f1b877700 1 -- 172.21.15.40:0/74572468 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f10009500 con 0x7f1f1409d920 2023-09-30T22:30:59.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.153+0000 7f1f1b877700 1 -- 172.21.15.40:0/74572468 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f1412e390 con 0x7f1f1409d920 2023-09-30T22:30:59.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.154+0000 7f1f1b877700 1 -- 172.21.15.40:0/74572468 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f14062380 con 0x7f1f1409d920 2023-09-30T22:30:59.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.154+0000 7f1f09ffb700 1 -- 172.21.15.40:0/74572468 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1f0400ccb0 con 0x7f1f1409d920 2023-09-30T22:30:59.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.154+0000 7f1f09ffb700 1 -- 172.21.15.40:0/74572468 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f1f0403f270 con 0x7f1f1409d920 2023-09-30T22:30:59.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.163+0000 7f1f09ffb700 1 -- 172.21.15.40:0/74572468 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f0401bc10 con 0x7f1f1409d920 2023-09-30T22:30:59.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.204+0000 7f114fcc9700 1 Processor -- start 2023-09-30T22:30:59.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.205+0000 7f114fcc9700 1 -- start start 2023-09-30T22:30:59.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.205+0000 7f114fcc9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f114809c890 0x7f114809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.205+0000 7f114fcc9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f114809d920 0x7f114809dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.205+0000 7f114fcc9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f114809e2b0 0x7f114813ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.205+0000 7f114fcc9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11480a29d0 con 0x7f114809e2b0 2023-09-30T22:30:59.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.205+0000 7f114fcc9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f114809fb40 con 0x7f114809d920 2023-09-30T22:30:59.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.205+0000 7f114fcc9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11480a2600 con 0x7f114809c890 2023-09-30T22:30:59.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.205+0000 7f114d264700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f114809d920 0x7f114809dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.205+0000 7f114e266700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f114809e2b0 0x7f114813ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.205+0000 7f114d264700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f114809d920 0x7f114809dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42910/0 (socket says 172.21.15.40:42910) 2023-09-30T22:30:59.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.205+0000 7f114d264700 1 -- 172.21.15.40:0/801746195 learned_addr learned my addr 172.21.15.40:0/801746195 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:59.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.206+0000 7f114da65700 1 --2- 172.21.15.40:0/801746195 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f114809c890 0x7f114809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.206+0000 7f114d264700 1 -- 172.21.15.40:0/801746195 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f114809c890 msgr2=0x7f114809cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:59.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.206+0000 7f114d264700 1 --2- 172.21.15.40:0/801746195 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f114809c890 0x7f114809cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.206+0000 7f114d264700 1 -- 172.21.15.40:0/801746195 >> v2:172.21.15.40:3300/0 conn(0x7f114809e2b0 msgr2=0x7f114813ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:59.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.206+0000 7f114d264700 1 --2- 172.21.15.40:0/801746195 >> v2:172.21.15.40:3300/0 conn(0x7f114809e2b0 0x7f114813ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.206+0000 7f114d264700 1 -- 172.21.15.40:0/801746195 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f114809e720 con 0x7f114809d920 2023-09-30T22:30:59.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.206+0000 7f114d264700 1 --2- 172.21.15.40:0/801746195 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f114809d920 0x7f114809dd70 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f1138009920 tx=0x7f1138009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c190c4950887e67 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:59.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.206+0000 7f114ca63700 1 -- 172.21.15.40:0/801746195 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1138011830 con 0x7f114809d920 2023-09-30T22:30:59.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.206+0000 7f114ca63700 1 -- 172.21.15.40:0/801746195 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1138011990 con 0x7f114809d920 2023-09-30T22:30:59.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.206+0000 7f114ca63700 1 -- 172.21.15.40:0/801746195 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1138011d20 con 0x7f114809d920 2023-09-30T22:30:59.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.207+0000 7f114fcc9700 1 -- 172.21.15.40:0/801746195 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f114809d920 msgr2=0x7f114809dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.207+0000 7f114fcc9700 1 --2- 172.21.15.40:0/801746195 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f114809d920 0x7f114809dd70 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f1138009920 tx=0x7f1138009c30 comp rx=0 tx=0).stop 2023-09-30T22:30:59.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.207+0000 7f114fcc9700 1 -- 172.21.15.40:0/801746195 shutdown_connections 2023-09-30T22:30:59.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.207+0000 7f114fcc9700 1 --2- 172.21.15.40:0/801746195 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f114809c890 0x7f114809cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.207+0000 7f114fcc9700 1 --2- 172.21.15.40:0/801746195 >> v2:172.21.15.40:3300/0 conn(0x7f114809e2b0 0x7f114813ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.207+0000 7f114fcc9700 1 --2- 172.21.15.40:0/801746195 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f114809d920 0x7f114809dd70 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.207+0000 7f114fcc9700 1 -- 172.21.15.40:0/801746195 >> 172.21.15.40:0/801746195 conn(0x7f11480a7080 msgr2=0x7f11480a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:59.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.207+0000 7f114fcc9700 1 -- 172.21.15.40:0/801746195 shutdown_connections 2023-09-30T22:30:59.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.207+0000 7f114fcc9700 1 -- 172.21.15.40:0/801746195 wait complete. 2023-09-30T22:30:59.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.208+0000 7f114fcc9700 1 Processor -- start 2023-09-30T22:30:59.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.208+0000 7f114fcc9700 1 -- start start 2023-09-30T22:30:59.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.208+0000 7f114fcc9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f114809c890 0x7f114812d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.208+0000 7f114fcc9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f114809d920 0x7f114812dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.208+0000 7f114fcc9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f114809e2b0 0x7f114812e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.208+0000 7f114fcc9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11480a5b90 con 0x7f114809e2b0 2023-09-30T22:30:59.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.208+0000 7f114fcc9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f114808f480 con 0x7f114809c890 2023-09-30T22:30:59.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.208+0000 7f114fcc9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1148130b70 con 0x7f114809d920 2023-09-30T22:30:59.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.208+0000 7f114d264700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f114809d920 0x7f114812dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.208+0000 7f114d264700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f114809d920 0x7f114812dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60362/0 (socket says 172.21.15.40:60362) 2023-09-30T22:30:59.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.208+0000 7f114d264700 1 -- 172.21.15.40:0/1031664665 learned_addr learned my addr 172.21.15.40:0/1031664665 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:59.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.208+0000 7f114da65700 1 --2- 172.21.15.40:0/1031664665 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f114809c890 0x7f114812d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.208+0000 7f114e266700 1 --2- 172.21.15.40:0/1031664665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f114809e2b0 0x7f114812e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.209+0000 7f114d264700 1 -- 172.21.15.40:0/1031664665 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f114809c890 msgr2=0x7f114812d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.209+0000 7f114d264700 1 --2- 172.21.15.40:0/1031664665 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f114809c890 0x7f114812d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.209+0000 7f114d264700 1 -- 172.21.15.40:0/1031664665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f114809e2b0 msgr2=0x7f114812e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.209+0000 7f114d264700 1 --2- 172.21.15.40:0/1031664665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f114809e2b0 0x7f114812e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.209+0000 7f114d264700 1 -- 172.21.15.40:0/1031664665 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1138009550 con 0x7f114809d920 2023-09-30T22:30:59.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.209+0000 7f114d264700 1 --2- 172.21.15.40:0/1031664665 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f114809d920 0x7f114812dae0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f1138009c70 tx=0x7f1138004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:59.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.209+0000 7f113e7fc700 1 -- 172.21.15.40:0/1031664665 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1138004450 con 0x7f114809d920 2023-09-30T22:30:59.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.209+0000 7f113e7fc700 1 -- 172.21.15.40:0/1031664665 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11380045b0 con 0x7f114809d920 2023-09-30T22:30:59.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.209+0000 7f114fcc9700 1 -- 172.21.15.40:0/1031664665 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f114809ecf0 con 0x7f114809d920 2023-09-30T22:30:59.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.209+0000 7f113e7fc700 1 -- 172.21.15.40:0/1031664665 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11380038c0 con 0x7f114809d920 2023-09-30T22:30:59.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.209+0000 7f114fcc9700 1 -- 172.21.15.40:0/1031664665 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1148130e50 con 0x7f114809d920 2023-09-30T22:30:59.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.210+0000 7f113e7fc700 1 -- 172.21.15.40:0/1031664665 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1138021070 con 0x7f114809d920 2023-09-30T22:30:59.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.210+0000 7f113e7fc700 1 -- 172.21.15.40:0/1031664665 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f11380409c0 con 0x7f114809d920 2023-09-30T22:30:59.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.210+0000 7f114fcc9700 1 -- 172.21.15.40:0/1031664665 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1148062380 con 0x7f114809d920 2023-09-30T22:30:59.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.219+0000 7f113e7fc700 1 -- 172.21.15.40:0/1031664665 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1138015080 con 0x7f114809d920 2023-09-30T22:30:59.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.317+0000 7f8534f76700 1 -- 172.21.15.40:0/3556343198 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8530138180 con 0x7f853009c7d0 2023-09-30T22:30:59.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.317+0000 7f851effd700 1 -- 172.21.15.40:0/3556343198 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8524017020 con 0x7f853009c7d0 2023-09-30T22:30:59.318 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:59.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.319+0000 7f8534f76700 1 -- 172.21.15.40:0/3556343198 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f853009c7d0 msgr2=0x7f8530134d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.319+0000 7f8534f76700 1 --2- 172.21.15.40:0/3556343198 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f853009c7d0 0x7f8530134d80 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f852400c420 tx=0x7f852400c730 comp rx=0 tx=0).stop 2023-09-30T22:30:59.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.320+0000 7f8534f76700 1 -- 172.21.15.40:0/3556343198 shutdown_connections 2023-09-30T22:30:59.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.320+0000 7f8534f76700 1 --2- 172.21.15.40:0/3556343198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8530131d50 0x7f85301c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.320+0000 7f8534f76700 1 --2- 172.21.15.40:0/3556343198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f853009bc50 0x7f8530134840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.320+0000 7f8534f76700 1 --2- 172.21.15.40:0/3556343198 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f853009c7d0 0x7f8530134d80 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.320+0000 7f8534f76700 1 -- 172.21.15.40:0/3556343198 >> 172.21.15.40:0/3556343198 conn(0x7f85300a2a00 msgr2=0x7f8530130cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:59.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.320+0000 7f8534f76700 1 -- 172.21.15.40:0/3556343198 shutdown_connections 2023-09-30T22:30:59.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.320+0000 7f8534f76700 1 -- 172.21.15.40:0/3556343198 wait complete. 2023-09-30T22:30:59.333 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:30:59.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.363+0000 7f1f1b877700 1 -- 172.21.15.40:0/74572468 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1f14074620 con 0x7f1f1409d920 2023-09-30T22:30:59.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.363+0000 7f1f09ffb700 1 -- 172.21.15.40:0/74572468 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1f04017020 con 0x7f1f1409d920 2023-09-30T22:30:59.364 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:30:59.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.366+0000 7f1f1b877700 1 -- 172.21.15.40:0/74572468 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f1409d920 msgr2=0x7f1f1412d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.366+0000 7f1f1b877700 1 --2- 172.21.15.40:0/74572468 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f1409d920 0x7f1f1412d910 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f1f0400e900 tx=0x7f1f0400ec10 comp rx=0 tx=0).stop 2023-09-30T22:30:59.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.366+0000 7f1f1b877700 1 -- 172.21.15.40:0/74572468 shutdown_connections 2023-09-30T22:30:59.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.366+0000 7f1f1b877700 1 --2- 172.21.15.40:0/74572468 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f1409c890 0x7f1f1412d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.366+0000 7f1f1b877700 1 --2- 172.21.15.40:0/74572468 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f1409e2b0 0x7f1f1412de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.366+0000 7f1f1b877700 1 --2- 172.21.15.40:0/74572468 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f1409d920 0x7f1f1412d910 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.366+0000 7f1f1b877700 1 -- 172.21.15.40:0/74572468 >> 172.21.15.40:0/74572468 conn(0x7f1f140a7080 msgr2=0x7f1f140a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:59.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.366+0000 7f1f1b877700 1 -- 172.21.15.40:0/74572468 shutdown_connections 2023-09-30T22:30:59.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.366+0000 7f1f1b877700 1 -- 172.21.15.40:0/74572468 wait complete. 2023-09-30T22:30:59.369 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:30:59.379 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:30:59.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.417+0000 7f114fcc9700 1 -- 172.21.15.40:0/1031664665 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1148074620 con 0x7f114809d920 2023-09-30T22:30:59.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.418+0000 7f113e7fc700 1 -- 172.21.15.40:0/1031664665 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1138029020 con 0x7f114809d920 2023-09-30T22:30:59.419 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:30:59.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.420+0000 7f114fcc9700 1 -- 172.21.15.40:0/1031664665 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f114809d920 msgr2=0x7f114812dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.420+0000 7f114fcc9700 1 --2- 172.21.15.40:0/1031664665 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f114809d920 0x7f114812dae0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f1138009c70 tx=0x7f1138004750 comp rx=0 tx=0).stop 2023-09-30T22:30:59.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.420+0000 7f114fcc9700 1 -- 172.21.15.40:0/1031664665 shutdown_connections 2023-09-30T22:30:59.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.420+0000 7f114fcc9700 1 --2- 172.21.15.40:0/1031664665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f114809e2b0 0x7f114812e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.420+0000 7f114fcc9700 1 --2- 172.21.15.40:0/1031664665 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f114809c890 0x7f114812d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.420+0000 7f114fcc9700 1 --2- 172.21.15.40:0/1031664665 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f114809d920 0x7f114812dae0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.420+0000 7f114fcc9700 1 -- 172.21.15.40:0/1031664665 >> 172.21.15.40:0/1031664665 conn(0x7f11480a7080 msgr2=0x7f11480a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:59.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.420+0000 7f114fcc9700 1 -- 172.21.15.40:0/1031664665 shutdown_connections 2023-09-30T22:30:59.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.420+0000 7f114fcc9700 1 -- 172.21.15.40:0/1031664665 wait complete. 2023-09-30T22:30:59.433 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:30:59.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.498+0000 7f258970a700 1 Processor -- start 2023-09-30T22:30:59.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.498+0000 7f258970a700 1 -- start start 2023-09-30T22:30:59.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.499+0000 7f258970a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f258409c890 0x7f258409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.499+0000 7f258970a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f258409d920 0x7f258409dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.499+0000 7f258970a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25840a2600 con 0x7f258409e2b0 2023-09-30T22:30:59.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.499+0000 7f258970a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25840a29d0 con 0x7f258409c890 2023-09-30T22:30:59.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.499+0000 7f258970a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258409fb40 con 0x7f258409d920 2023-09-30T22:30:59.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.499+0000 7f25827fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f258409d920 0x7f258409dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.499+0000 7f2582ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f258409c890 0x7f258409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.499+0000 7f25827fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f258409d920 0x7f258409dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42930/0 (socket says 172.21.15.40:42930) 2023-09-30T22:30:59.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.499+0000 7f25827fc700 1 -- 172.21.15.40:0/672652670 learned_addr learned my addr 172.21.15.40:0/672652670 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:59.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.499+0000 7f2582ffd700 1 -- 172.21.15.40:0/672652670 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f258409d920 msgr2=0x7f258409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:30:59.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.499+0000 7f2582ffd700 1 --2- 172.21.15.40:0/672652670 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f258409d920 0x7f258409dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.499+0000 7f2582ffd700 1 -- 172.21.15.40:0/672652670 >> v1:172.21.15.40:6789/0 conn(0x7f258409e2b0 legacy=0x7f258413ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.499+0000 7f2582ffd700 1 -- 172.21.15.40:0/672652670 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f258409e730 con 0x7f258409c890 2023-09-30T22:30:59.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.499+0000 7f25827fc700 1 --2- 172.21.15.40:0/672652670 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f258409d920 0x7f258409dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:30:59.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.499+0000 7f2582ffd700 1 --2- 172.21.15.40:0/672652670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f258409c890 0x7f258409cc60 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f2578009820 tx=0x7f2578009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c7e3596b1eebc0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:59.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.499+0000 7f2581ffb700 1 -- 172.21.15.40:0/672652670 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2578005e30 con 0x7f258409c890 2023-09-30T22:30:59.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.499+0000 7f2581ffb700 1 -- 172.21.15.40:0/672652670 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2578006030 con 0x7f258409c890 2023-09-30T22:30:59.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.500+0000 7f2581ffb700 1 -- 172.21.15.40:0/672652670 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25780063c0 con 0x7f258409c890 2023-09-30T22:30:59.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.500+0000 7f258970a700 1 -- 172.21.15.40:0/672652670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f258409c890 msgr2=0x7f258409cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.500+0000 7f258970a700 1 --2- 172.21.15.40:0/672652670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f258409c890 0x7f258409cc60 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f2578009820 tx=0x7f2578009b30 comp rx=0 tx=0).stop 2023-09-30T22:30:59.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.500+0000 7f258970a700 1 -- 172.21.15.40:0/672652670 shutdown_connections 2023-09-30T22:30:59.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.500+0000 7f258970a700 1 --2- 172.21.15.40:0/672652670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f258409c890 0x7f258409cc60 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.500+0000 7f258970a700 1 --2- 172.21.15.40:0/672652670 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f258409d920 0x7f258409dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.500+0000 7f258970a700 1 -- 172.21.15.40:0/672652670 >> 172.21.15.40:0/672652670 conn(0x7f25840a7080 msgr2=0x7f25840a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:59.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.500+0000 7f258970a700 1 -- 172.21.15.40:0/672652670 shutdown_connections 2023-09-30T22:30:59.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.500+0000 7f258970a700 1 -- 172.21.15.40:0/672652670 wait complete. 2023-09-30T22:30:59.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.501+0000 7f258970a700 1 Processor -- start 2023-09-30T22:30:59.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.501+0000 7f258970a700 1 -- start start 2023-09-30T22:30:59.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.501+0000 7f258970a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f258409c890 0x7f25841c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.501+0000 7f258970a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f258409d920 0x7f25841c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.502+0000 7f258970a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f258409e2b0 0x7f258412d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:30:59.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.502+0000 7f258970a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258409bdc0 con 0x7f258409e2b0 2023-09-30T22:30:59.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.502+0000 7f258970a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258412f170 con 0x7f258409d920 2023-09-30T22:30:59.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.502+0000 7f258970a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25840a5cb0 con 0x7f258409c890 2023-09-30T22:30:59.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.502+0000 7f25827fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f258409d920 0x7f25841c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.502+0000 7f25827fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f258409d920 0x7f25841c9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42932/0 (socket says 172.21.15.40:42932) 2023-09-30T22:30:59.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.502+0000 7f25837fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f258409e2b0 0x7f258412d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.502+0000 7f25827fc700 1 -- 172.21.15.40:0/1435131213 learned_addr learned my addr 172.21.15.40:0/1435131213 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:30:59.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.502+0000 7f2582ffd700 1 --2- 172.21.15.40:0/1435131213 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f258409c890 0x7f25841c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:30:59.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.502+0000 7f25827fc700 1 -- 172.21.15.40:0/1435131213 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f258409c890 msgr2=0x7f25841c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.502+0000 7f25827fc700 1 --2- 172.21.15.40:0/1435131213 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f258409c890 0x7f25841c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.502+0000 7f25827fc700 1 -- 172.21.15.40:0/1435131213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f258409e2b0 msgr2=0x7f258412d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.502+0000 7f25827fc700 1 --2- 172.21.15.40:0/1435131213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f258409e2b0 0x7f258412d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.502+0000 7f25827fc700 1 -- 172.21.15.40:0/1435131213 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2574009550 con 0x7f258409d920 2023-09-30T22:30:59.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.502+0000 7f25827fc700 1 --2- 172.21.15.40:0/1435131213 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f258409d920 0x7f25841c9190 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f257400ebe0 tx=0x7f257400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:30:59.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.502+0000 7f256b7fe700 1 -- 172.21.15.40:0/1435131213 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257400c850 con 0x7f258409d920 2023-09-30T22:30:59.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.502+0000 7f256b7fe700 1 -- 172.21.15.40:0/1435131213 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257400c9b0 con 0x7f258409d920 2023-09-30T22:30:59.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.502+0000 7f258970a700 1 -- 172.21.15.40:0/1435131213 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2578009430 con 0x7f258409d920 2023-09-30T22:30:59.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.502+0000 7f256b7fe700 1 -- 172.21.15.40:0/1435131213 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257400cd40 con 0x7f258409d920 2023-09-30T22:30:59.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.502+0000 7f258970a700 1 -- 172.21.15.40:0/1435131213 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f258412f850 con 0x7f258409d920 2023-09-30T22:30:59.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.503+0000 7f258970a700 1 -- 172.21.15.40:0/1435131213 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2584062380 con 0x7f258409d920 2023-09-30T22:30:59.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.503+0000 7f256b7fe700 1 -- 172.21.15.40:0/1435131213 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2574013470 con 0x7f258409d920 2023-09-30T22:30:59.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.503+0000 7f256b7fe700 1 -- 172.21.15.40:0/1435131213 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f257403fc50 con 0x7f258409d920 2023-09-30T22:30:59.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.508+0000 7f256b7fe700 1 -- 172.21.15.40:0/1435131213 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f257401b3b0 con 0x7f258409d920 2023-09-30T22:30:59.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.707+0000 7f258970a700 1 -- 172.21.15.40:0/1435131213 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f25840a5790 con 0x7f258409d920 2023-09-30T22:30:59.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.707+0000 7f256b7fe700 1 -- 172.21.15.40:0/1435131213 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2574011ca0 con 0x7f258409d920 2023-09-30T22:30:59.708 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:30:59.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.709+0000 7f258970a700 1 -- 172.21.15.40:0/1435131213 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f258409d920 msgr2=0x7f25841c9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:30:59.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.709+0000 7f258970a700 1 --2- 172.21.15.40:0/1435131213 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f258409d920 0x7f25841c9190 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f257400ebe0 tx=0x7f257400eef0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.709+0000 7f258970a700 1 -- 172.21.15.40:0/1435131213 shutdown_connections 2023-09-30T22:30:59.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.709+0000 7f258970a700 1 --2- 172.21.15.40:0/1435131213 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f258409c890 0x7f25841c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.709+0000 7f258970a700 1 --2- 172.21.15.40:0/1435131213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f258409e2b0 0x7f258412d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.709+0000 7f258970a700 1 --2- 172.21.15.40:0/1435131213 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f258409d920 0x7f25841c9190 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:30:59.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.709+0000 7f258970a700 1 -- 172.21.15.40:0/1435131213 >> 172.21.15.40:0/1435131213 conn(0x7f25840a7080 msgr2=0x7f25840a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:30:59.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.709+0000 7f258970a700 1 -- 172.21.15.40:0/1435131213 shutdown_connections 2023-09-30T22:30:59.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:30:59.709+0000 7f258970a700 1 -- 172.21.15.40:0/1435131213 wait complete. 2023-09-30T22:30:59.722 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:00.334 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:00.381 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:00.433 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:00.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.477+0000 7f56deff7700 1 Processor -- start 2023-09-30T22:31:00.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.477+0000 7f56deff7700 1 -- start start 2023-09-30T22:31:00.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.477+0000 7f56deff7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f56d809d450 0x7f56d809d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:00.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.477+0000 7f56deff7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56d809dd60 0x7f56d81301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:00.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.477+0000 7f56deff7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56d8130700 0x7f56d8130b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:00.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.477+0000 7f56deff7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56d809e8b0 con 0x7f56d809d450 2023-09-30T22:31:00.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.477+0000 7f56deff7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d809c3b0 con 0x7f56d8130700 2023-09-30T22:31:00.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.477+0000 7f56deff7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56d809a6b0 con 0x7f56d809dd60 2023-09-30T22:31:00.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.478+0000 7f56d7fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56d809dd60 0x7f56d81301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:00.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.478+0000 7f56d7fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56d809dd60 0x7f56d81301c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60386/0 (socket says 172.21.15.40:60386) 2023-09-30T22:31:00.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.478+0000 7f56d7fff700 1 -- 172.21.15.40:0/2316667556 learned_addr learned my addr 172.21.15.40:0/2316667556 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:00.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.478+0000 7f56dd594700 1 --2- 172.21.15.40:0/2316667556 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56d8130700 0x7f56d8130b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:00.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.478+0000 7f56dcd93700 1 --2- 172.21.15.40:0/2316667556 >> v2:172.21.15.40:3300/0 conn(0x7f56d809d450 0x7f56d809d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:00.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.478+0000 7f56d7fff700 1 -- 172.21.15.40:0/2316667556 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56d8130700 msgr2=0x7f56d8130b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:00.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.478+0000 7f56d7fff700 1 --2- 172.21.15.40:0/2316667556 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56d8130700 0x7f56d8130b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.478+0000 7f56d7fff700 1 -- 172.21.15.40:0/2316667556 >> v2:172.21.15.40:3300/0 conn(0x7f56d809d450 msgr2=0x7f56d809d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:00.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.478+0000 7f56d7fff700 1 --2- 172.21.15.40:0/2316667556 >> v2:172.21.15.40:3300/0 conn(0x7f56d809d450 0x7f56d809d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.478+0000 7f56d7fff700 1 -- 172.21.15.40:0/2316667556 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d809b4f0 con 0x7f56d809dd60 2023-09-30T22:31:00.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.478+0000 7f56dd594700 1 --2- 172.21.15.40:0/2316667556 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56d8130700 0x7f56d8130b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:00.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.478+0000 7f56d7fff700 1 --2- 172.21.15.40:0/2316667556 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56d809dd60 0x7f56d81301c0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f56c40098f0 tx=0x7f56c4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c89f62078d477e1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:00.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.478+0000 7f56d77fe700 1 -- 172.21.15.40:0/2316667556 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c400f8a0 con 0x7f56d809dd60 2023-09-30T22:31:00.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.478+0000 7f56d77fe700 1 -- 172.21.15.40:0/2316667556 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c400fa00 con 0x7f56d809dd60 2023-09-30T22:31:00.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.478+0000 7f56d77fe700 1 -- 172.21.15.40:0/2316667556 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c400fd90 con 0x7f56d809dd60 2023-09-30T22:31:00.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.479+0000 7f56deff7700 1 -- 172.21.15.40:0/2316667556 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56d809dd60 msgr2=0x7f56d81301c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:00.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.479+0000 7f56deff7700 1 --2- 172.21.15.40:0/2316667556 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56d809dd60 0x7f56d81301c0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f56c40098f0 tx=0x7f56c4009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:00.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.479+0000 7f56deff7700 1 -- 172.21.15.40:0/2316667556 shutdown_connections 2023-09-30T22:31:00.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.479+0000 7f56deff7700 1 --2- 172.21.15.40:0/2316667556 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56d8130700 0x7f56d8130b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.479+0000 7f56deff7700 1 --2- 172.21.15.40:0/2316667556 >> v2:172.21.15.40:3300/0 conn(0x7f56d809d450 0x7f56d809d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.479+0000 7f56deff7700 1 --2- 172.21.15.40:0/2316667556 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56d809dd60 0x7f56d81301c0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.479+0000 7f56deff7700 1 -- 172.21.15.40:0/2316667556 >> 172.21.15.40:0/2316667556 conn(0x7f56d80a2a00 msgr2=0x7f56d80a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:00.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.479+0000 7f56deff7700 1 -- 172.21.15.40:0/2316667556 shutdown_connections 2023-09-30T22:31:00.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.479+0000 7f56deff7700 1 -- 172.21.15.40:0/2316667556 wait complete. 2023-09-30T22:31:00.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.480+0000 7f56deff7700 1 Processor -- start 2023-09-30T22:31:00.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.480+0000 7f56deff7700 1 -- start start 2023-09-30T22:31:00.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.481+0000 7f56deff7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56d809d450 0x7f56d81c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:00.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.481+0000 7f56deff7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56d809dd60 0x7f56d81c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:00.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.481+0000 7f56deff7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56d8130700 0x7f56d81c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:00.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.481+0000 7f56deff7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d80a1ae0 con 0x7f56d809dd60 2023-09-30T22:31:00.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.481+0000 7f56deff7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d809c5d0 con 0x7f56d809d450 2023-09-30T22:31:00.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.481+0000 7f56deff7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56d8120070 con 0x7f56d8130700 2023-09-30T22:31:00.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.481+0000 7f56d7fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56d809dd60 0x7f56d81c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:00.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.481+0000 7f56dd594700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56d8130700 0x7f56d81c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:00.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.481+0000 7f56d7fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56d809dd60 0x7f56d81c8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42942/0 (socket says 172.21.15.40:42942) 2023-09-30T22:31:00.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.481+0000 7f56d7fff700 1 -- 172.21.15.40:0/3728204162 learned_addr learned my addr 172.21.15.40:0/3728204162 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:00.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.481+0000 7f56dcd93700 1 --2- 172.21.15.40:0/3728204162 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56d809d450 0x7f56d81c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:00.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.481+0000 7f56d7fff700 1 -- 172.21.15.40:0/3728204162 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56d8130700 msgr2=0x7f56d81c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:00.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.481+0000 7f56d7fff700 1 --2- 172.21.15.40:0/3728204162 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56d8130700 0x7f56d81c90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.482+0000 7f56d7fff700 1 -- 172.21.15.40:0/3728204162 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56d809d450 msgr2=0x7f56d81c8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:00.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.482+0000 7f56d7fff700 1 --2- 172.21.15.40:0/3728204162 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56d809d450 0x7f56d81c8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.482+0000 7f56d7fff700 1 -- 172.21.15.40:0/3728204162 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d000ab80 con 0x7f56d809dd60 2023-09-30T22:31:00.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.482+0000 7f56dd594700 1 --2- 172.21.15.40:0/3728204162 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56d8130700 0x7f56d81c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:00.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.482+0000 7f56d7fff700 1 --2- 172.21.15.40:0/3728204162 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56d809dd60 0x7f56d81c8b90 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f56c4000c00 tx=0x7f56c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:00.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.482+0000 7f56d57fa700 1 -- 172.21.15.40:0/3728204162 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c40038a0 con 0x7f56d809dd60 2023-09-30T22:31:00.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.482+0000 7f56d57fa700 1 -- 172.21.15.40:0/3728204162 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c4003a20 con 0x7f56d809dd60 2023-09-30T22:31:00.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.482+0000 7f56deff7700 1 -- 172.21.15.40:0/3728204162 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56c4009550 con 0x7f56d809dd60 2023-09-30T22:31:00.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.482+0000 7f56d57fa700 1 -- 172.21.15.40:0/3728204162 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c4003dd0 con 0x7f56d809dd60 2023-09-30T22:31:00.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.482+0000 7f56deff7700 1 -- 172.21.15.40:0/3728204162 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d8121a40 con 0x7f56d809dd60 2023-09-30T22:31:00.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.483+0000 7f56deff7700 1 -- 172.21.15.40:0/3728204162 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56d8121bd0 con 0x7f56d809dd60 2023-09-30T22:31:00.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.483+0000 7f56d57fa700 1 -- 172.21.15.40:0/3728204162 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f56c4019400 con 0x7f56d809dd60 2023-09-30T22:31:00.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.483+0000 7f56d57fa700 1 -- 172.21.15.40:0/3728204162 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f56c40404c0 con 0x7f56d809dd60 2023-09-30T22:31:00.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.488+0000 7f56d57fa700 1 -- 172.21.15.40:0/3728204162 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f56c401f2f0 con 0x7f56d809dd60 2023-09-30T22:31:00.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.517+0000 7f0acf852700 1 Processor -- start 2023-09-30T22:31:00.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.517+0000 7f0acf852700 1 -- start start 2023-09-30T22:31:00.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.518+0000 7f0acf852700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ac8136bf0 0x7f0ac8138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:00.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.518+0000 7f0acf852700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0ac8139510 0x7f0ac813b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:00.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.518+0000 7f0acf852700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac80a2600 con 0x7f0ac809c890 2023-09-30T22:31:00.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.518+0000 7f0acf852700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac80a29d0 con 0x7f0ac8139510 2023-09-30T22:31:00.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.518+0000 7f0acf852700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac809fb40 con 0x7f0ac8136bf0 2023-09-30T22:31:00.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.518+0000 7f0accded700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ac8136bf0 0x7f0ac8138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:00.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.518+0000 7f0accded700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ac8136bf0 0x7f0ac8138fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60414/0 (socket says 172.21.15.40:60414) 2023-09-30T22:31:00.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.518+0000 7f0accded700 1 -- 172.21.15.40:0/1007700654 learned_addr learned my addr 172.21.15.40:0/1007700654 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:00.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.518+0000 7f0acddef700 1 --2- 172.21.15.40:0/1007700654 >> v2:172.21.15.40:3300/0 conn(0x7f0ac8139510 0x7f0ac813b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:00.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.518+0000 7f0accded700 1 -- 172.21.15.40:0/1007700654 >> v2:172.21.15.40:3300/0 conn(0x7f0ac8139510 msgr2=0x7f0ac813b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:00.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.518+0000 7f0accded700 1 --2- 172.21.15.40:0/1007700654 >> v2:172.21.15.40:3300/0 conn(0x7f0ac8139510 0x7f0ac813b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.518+0000 7f0accded700 1 -- 172.21.15.40:0/1007700654 >> v1:172.21.15.40:6789/0 conn(0x7f0ac809c890 legacy=0x7f0ac809cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:00.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.518+0000 7f0accded700 1 -- 172.21.15.40:0/1007700654 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac809d370 con 0x7f0ac8136bf0 2023-09-30T22:31:00.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.518+0000 7f0accded700 1 --2- 172.21.15.40:0/1007700654 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ac8136bf0 0x7f0ac8138fd0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f0ab80098f0 tx=0x7f0ab8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa5e819d1ba78a54 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:00.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.519+0000 7f0abffff700 1 -- 172.21.15.40:0/1007700654 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab8011830 con 0x7f0ac8136bf0 2023-09-30T22:31:00.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.519+0000 7f0abffff700 1 -- 172.21.15.40:0/1007700654 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab8011990 con 0x7f0ac8136bf0 2023-09-30T22:31:00.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.519+0000 7f0abffff700 1 -- 172.21.15.40:0/1007700654 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab8011d20 con 0x7f0ac8136bf0 2023-09-30T22:31:00.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.519+0000 7f0acf852700 1 -- 172.21.15.40:0/1007700654 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ac8136bf0 msgr2=0x7f0ac8138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:00.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.519+0000 7f0acf852700 1 --2- 172.21.15.40:0/1007700654 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ac8136bf0 0x7f0ac8138fd0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f0ab80098f0 tx=0x7f0ab8009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:00.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.519+0000 7f0acf852700 1 -- 172.21.15.40:0/1007700654 shutdown_connections 2023-09-30T22:31:00.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.519+0000 7f0acf852700 1 --2- 172.21.15.40:0/1007700654 >> v2:172.21.15.40:3300/0 conn(0x7f0ac8139510 0x7f0ac813b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.519+0000 7f0acf852700 1 --2- 172.21.15.40:0/1007700654 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ac8136bf0 0x7f0ac8138fd0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.519+0000 7f0acf852700 1 -- 172.21.15.40:0/1007700654 >> 172.21.15.40:0/1007700654 conn(0x7f0ac80a7080 msgr2=0x7f0ac80a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:00.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.520+0000 7f0acf852700 1 -- 172.21.15.40:0/1007700654 shutdown_connections 2023-09-30T22:31:00.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.520+0000 7f0acf852700 1 -- 172.21.15.40:0/1007700654 wait complete. 2023-09-30T22:31:00.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.520+0000 7f0acf852700 1 Processor -- start 2023-09-30T22:31:00.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.520+0000 7f0acf852700 1 -- start start 2023-09-30T22:31:00.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.521+0000 7f0acf852700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ac809c890 0x7f0ac806f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:00.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.521+0000 7f0acf852700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac8136bf0 0x7f0ac806f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:00.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.521+0000 7f0acf852700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ac8139510 0x7f0ac806fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:00.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.521+0000 7f0acf852700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac80706d0 con 0x7f0ac809c890 2023-09-30T22:31:00.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.521+0000 7f0acf852700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac8071380 con 0x7f0ac8136bf0 2023-09-30T22:31:00.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.521+0000 7f0acf852700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac809c5b0 con 0x7f0ac8139510 2023-09-30T22:31:00.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.521+0000 7f0accded700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac8136bf0 0x7f0ac806f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:00.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.521+0000 7f0acddef700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ac8139510 0x7f0ac806fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:00.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.521+0000 7f0accded700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac8136bf0 0x7f0ac806f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42966/0 (socket says 172.21.15.40:42966) 2023-09-30T22:31:00.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.521+0000 7f0accded700 1 -- 172.21.15.40:0/1114429149 learned_addr learned my addr 172.21.15.40:0/1114429149 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:00.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.521+0000 7f0acd5ee700 1 --2- 172.21.15.40:0/1114429149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ac809c890 0x7f0ac806f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:00.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.521+0000 7f0acddef700 1 -- 172.21.15.40:0/1114429149 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac8136bf0 msgr2=0x7f0ac806f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:00.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.521+0000 7f0acddef700 1 --2- 172.21.15.40:0/1114429149 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac8136bf0 0x7f0ac806f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.521+0000 7f0acddef700 1 -- 172.21.15.40:0/1114429149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ac809c890 msgr2=0x7f0ac806f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:00.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.521+0000 7f0acddef700 1 --2- 172.21.15.40:0/1114429149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ac809c890 0x7f0ac806f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.521+0000 7f0acddef700 1 -- 172.21.15.40:0/1114429149 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab8009550 con 0x7f0ac8139510 2023-09-30T22:31:00.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.521+0000 7f0acd5ee700 1 --2- 172.21.15.40:0/1114429149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ac809c890 0x7f0ac806f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:31:00.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.522+0000 7f0acddef700 1 --2- 172.21.15.40:0/1114429149 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ac8139510 0x7f0ac806fcf0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f0ac80a0df0 tx=0x7f0ac000ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:00.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.522+0000 7f0abdffb700 1 -- 172.21.15.40:0/1114429149 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac000ccd0 con 0x7f0ac8139510 2023-09-30T22:31:00.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.522+0000 7f0abdffb700 1 -- 172.21.15.40:0/1114429149 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac000f040 con 0x7f0ac8139510 2023-09-30T22:31:00.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.522+0000 7f0abdffb700 1 -- 172.21.15.40:0/1114429149 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac00146c0 con 0x7f0ac8139510 2023-09-30T22:31:00.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.522+0000 7f0acf852700 1 -- 172.21.15.40:0/1114429149 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac8070f70 con 0x7f0ac8139510 2023-09-30T22:31:00.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.522+0000 7f0acf852700 1 -- 172.21.15.40:0/1114429149 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac809ecf0 con 0x7f0ac8139510 2023-09-30T22:31:00.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.523+0000 7f0abdffb700 1 -- 172.21.15.40:0/1114429149 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0ac0014820 con 0x7f0ac8139510 2023-09-30T22:31:00.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.523+0000 7f0abdffb700 1 -- 172.21.15.40:0/1114429149 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f0ac0040460 con 0x7f0ac8139510 2023-09-30T22:31:00.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.523+0000 7f0acf852700 1 -- 172.21.15.40:0/1114429149 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac8071640 con 0x7f0ac8139510 2023-09-30T22:31:00.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.532+0000 7f0abdffb700 1 -- 172.21.15.40:0/1114429149 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0ac0009e60 con 0x7f0ac8139510 2023-09-30T22:31:00.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.571+0000 7f6652716700 1 Processor -- start 2023-09-30T22:31:00.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.571+0000 7f6652716700 1 -- start start 2023-09-30T22:31:00.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.571+0000 7f6652716700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f664c09c890 0x7f664c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:00.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.571+0000 7f6652716700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f664c09d920 0x7f664c09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:00.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.571+0000 7f6652716700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f664c09e2b0 0x7f664c13ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:00.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.571+0000 7f6652716700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f664c0a29d0 con 0x7f664c09d920 2023-09-30T22:31:00.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.571+0000 7f6652716700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f664c09fb40 con 0x7f664c09e2b0 2023-09-30T22:31:00.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.571+0000 7f6652716700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f664c0a2600 con 0x7f664c09c890 2023-09-30T22:31:00.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.571+0000 7f664bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f664c09c890 0x7f664c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:00.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.571+0000 7f664b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f664c09d920 0x7f664c09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:00.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.571+0000 7f664b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f664c09d920 0x7f664c09dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42978/0 (socket says 172.21.15.40:42978) 2023-09-30T22:31:00.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.571+0000 7f664bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f664c09c890 0x7f664c09cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60430/0 (socket says 172.21.15.40:60430) 2023-09-30T22:31:00.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.571+0000 7f664b7fe700 1 -- 172.21.15.40:0/3449102227 learned_addr learned my addr 172.21.15.40:0/3449102227 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:00.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.571+0000 7f6650cb3700 1 --2- 172.21.15.40:0/3449102227 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f664c09e2b0 0x7f664c13ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:00.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.572+0000 7f664b7fe700 1 -- 172.21.15.40:0/3449102227 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f664c09c890 msgr2=0x7f664c09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:00.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.572+0000 7f664b7fe700 1 --2- 172.21.15.40:0/3449102227 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f664c09c890 0x7f664c09cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.572+0000 7f664b7fe700 1 -- 172.21.15.40:0/3449102227 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f664c09e2b0 msgr2=0x7f664c13ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:00.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.572+0000 7f664b7fe700 1 --2- 172.21.15.40:0/3449102227 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f664c09e2b0 0x7f664c13ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.572+0000 7f664b7fe700 1 -- 172.21.15.40:0/3449102227 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f664c09e750 con 0x7f664c09d920 2023-09-30T22:31:00.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.572+0000 7f664bfff700 1 --2- 172.21.15.40:0/3449102227 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f664c09c890 0x7f664c09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:00.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.572+0000 7f6650cb3700 1 --2- 172.21.15.40:0/3449102227 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f664c09e2b0 0x7f664c13ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:00.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.572+0000 7f664b7fe700 1 --2- 172.21.15.40:0/3449102227 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f664c09d920 0x7f664c09dd70 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f66400098f0 tx=0x7f6640009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90544c5d5b744b1e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:00.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.572+0000 7f664affd700 1 -- 172.21.15.40:0/3449102227 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6640011830 con 0x7f664c09d920 2023-09-30T22:31:00.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.572+0000 7f664affd700 1 -- 172.21.15.40:0/3449102227 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6640011990 con 0x7f664c09d920 2023-09-30T22:31:00.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.572+0000 7f664affd700 1 -- 172.21.15.40:0/3449102227 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6640011d20 con 0x7f664c09d920 2023-09-30T22:31:00.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.573+0000 7f6652716700 1 -- 172.21.15.40:0/3449102227 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f664c09d920 msgr2=0x7f664c09dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:00.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.573+0000 7f6652716700 1 --2- 172.21.15.40:0/3449102227 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f664c09d920 0x7f664c09dd70 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f66400098f0 tx=0x7f6640009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:00.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.573+0000 7f6652716700 1 -- 172.21.15.40:0/3449102227 shutdown_connections 2023-09-30T22:31:00.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.573+0000 7f6652716700 1 --2- 172.21.15.40:0/3449102227 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f664c09c890 0x7f664c09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.573+0000 7f6652716700 1 --2- 172.21.15.40:0/3449102227 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f664c09e2b0 0x7f664c13ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.573+0000 7f6652716700 1 --2- 172.21.15.40:0/3449102227 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f664c09d920 0x7f664c09dd70 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.573+0000 7f6652716700 1 -- 172.21.15.40:0/3449102227 >> 172.21.15.40:0/3449102227 conn(0x7f664c0a7080 msgr2=0x7f664c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:00.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.573+0000 7f6652716700 1 -- 172.21.15.40:0/3449102227 shutdown_connections 2023-09-30T22:31:00.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.573+0000 7f6652716700 1 -- 172.21.15.40:0/3449102227 wait complete. 2023-09-30T22:31:00.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.574+0000 7f6652716700 1 Processor -- start 2023-09-30T22:31:00.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.574+0000 7f6652716700 1 -- start start 2023-09-30T22:31:00.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.575+0000 7f6652716700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f664c09c890 0x7f664c1c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:00.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.575+0000 7f6652716700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f664c09d920 0x7f664c1c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:00.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.575+0000 7f6652716700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f664c09e2b0 0x7f664c12d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:00.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.575+0000 7f6652716700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664c130860 con 0x7f664c09e2b0 2023-09-30T22:31:00.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.575+0000 7f6652716700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f664c12fcf0 con 0x7f664c09d920 2023-09-30T22:31:00.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.575+0000 7f6652716700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f664c09ecf0 con 0x7f664c09c890 2023-09-30T22:31:00.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.575+0000 7f664b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f664c09d920 0x7f664c1c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:00.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.575+0000 7f664b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f664c09d920 0x7f664c1c9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42980/0 (socket says 172.21.15.40:42980) 2023-09-30T22:31:00.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.575+0000 7f664b7fe700 1 -- 172.21.15.40:0/486843956 learned_addr learned my addr 172.21.15.40:0/486843956 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:00.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.575+0000 7f664bfff700 1 --2- 172.21.15.40:0/486843956 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f664c09c890 0x7f664c1c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:00.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.575+0000 7f6650cb3700 1 --2- 172.21.15.40:0/486843956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f664c09e2b0 0x7f664c12d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:00.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.575+0000 7f664bfff700 1 -- 172.21.15.40:0/486843956 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f664c09d920 msgr2=0x7f664c1c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:00.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.575+0000 7f664bfff700 1 --2- 172.21.15.40:0/486843956 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f664c09d920 0x7f664c1c9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.575+0000 7f664bfff700 1 -- 172.21.15.40:0/486843956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f664c09e2b0 msgr2=0x7f664c12d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:00.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.575+0000 7f664bfff700 1 --2- 172.21.15.40:0/486843956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f664c09e2b0 0x7f664c12d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.575+0000 7f664bfff700 1 -- 172.21.15.40:0/486843956 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663c009430 con 0x7f664c09c890 2023-09-30T22:31:00.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.575+0000 7f6650cb3700 1 --2- 172.21.15.40:0/486843956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f664c09e2b0 0x7f664c12d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:00.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.575+0000 7f664bfff700 1 --2- 172.21.15.40:0/486843956 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f664c09c890 0x7f664c1c8bc0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f663c00e860 tx=0x7f663c00eb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:00.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.576+0000 7f6648ff9700 1 -- 172.21.15.40:0/486843956 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663c005a20 con 0x7f664c09c890 2023-09-30T22:31:00.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.576+0000 7f6648ff9700 1 -- 172.21.15.40:0/486843956 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f663c005b80 con 0x7f664c09c890 2023-09-30T22:31:00.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.576+0000 7f6648ff9700 1 -- 172.21.15.40:0/486843956 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663c004030 con 0x7f664c09c890 2023-09-30T22:31:00.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.576+0000 7f6652716700 1 -- 172.21.15.40:0/486843956 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6644009a70 con 0x7f664c09c890 2023-09-30T22:31:00.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.576+0000 7f6652716700 1 -- 172.21.15.40:0/486843956 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6640009550 con 0x7f664c09c890 2023-09-30T22:31:00.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.576+0000 7f6648ff9700 1 -- 172.21.15.40:0/486843956 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f663c004190 con 0x7f664c09c890 2023-09-30T22:31:00.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.577+0000 7f6648ff9700 1 -- 172.21.15.40:0/486843956 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f663c03faa0 con 0x7f664c09c890 2023-09-30T22:31:00.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.577+0000 7f6652716700 1 -- 172.21.15.40:0/486843956 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f664c130140 con 0x7f664c09c890 2023-09-30T22:31:00.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.586+0000 7f6648ff9700 1 -- 172.21.15.40:0/486843956 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f663c004440 con 0x7f664c09c890 2023-09-30T22:31:00.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.701+0000 7f56deff7700 1 -- 172.21.15.40:0/3728204162 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f56d8062380 con 0x7f56d809dd60 2023-09-30T22:31:00.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.702+0000 7f56d57fa700 1 -- 172.21.15.40:0/3728204162 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f56c4026090 con 0x7f56d809dd60 2023-09-30T22:31:00.703 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:00.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.704+0000 7f56deff7700 1 -- 172.21.15.40:0/3728204162 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56d809dd60 msgr2=0x7f56d81c8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:00.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.704+0000 7f56deff7700 1 --2- 172.21.15.40:0/3728204162 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56d809dd60 0x7f56d81c8b90 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f56c4000c00 tx=0x7f56c4004750 comp rx=0 tx=0).stop 2023-09-30T22:31:00.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.704+0000 7f56deff7700 1 -- 172.21.15.40:0/3728204162 shutdown_connections 2023-09-30T22:31:00.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.704+0000 7f56deff7700 1 --2- 172.21.15.40:0/3728204162 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f56d8130700 0x7f56d81c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.704+0000 7f56deff7700 1 --2- 172.21.15.40:0/3728204162 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56d809d450 0x7f56d81c8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.704+0000 7f56deff7700 1 --2- 172.21.15.40:0/3728204162 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56d809dd60 0x7f56d81c8b90 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.704+0000 7f56deff7700 1 -- 172.21.15.40:0/3728204162 >> 172.21.15.40:0/3728204162 conn(0x7f56d80a2a00 msgr2=0x7f56d81b7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:00.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.704+0000 7f56deff7700 1 -- 172.21.15.40:0/3728204162 shutdown_connections 2023-09-30T22:31:00.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.704+0000 7f56deff7700 1 -- 172.21.15.40:0/3728204162 wait complete. 2023-09-30T22:31:00.717 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:00.722 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:00.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.734+0000 7f0acf852700 1 -- 172.21.15.40:0/1114429149 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0ac8138fe0 con 0x7f0ac8139510 2023-09-30T22:31:00.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.734+0000 7f0abdffb700 1 -- 172.21.15.40:0/1114429149 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0ac0012340 con 0x7f0ac8139510 2023-09-30T22:31:00.735 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:00.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.736+0000 7f0acf852700 1 -- 172.21.15.40:0/1114429149 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ac8139510 msgr2=0x7f0ac806fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:00.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.736+0000 7f0acf852700 1 --2- 172.21.15.40:0/1114429149 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ac8139510 0x7f0ac806fcf0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f0ac80a0df0 tx=0x7f0ac000ef90 comp rx=0 tx=0).stop 2023-09-30T22:31:00.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.736+0000 7f0acf852700 1 -- 172.21.15.40:0/1114429149 shutdown_connections 2023-09-30T22:31:00.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.736+0000 7f0acf852700 1 --2- 172.21.15.40:0/1114429149 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0ac8139510 0x7f0ac806fcf0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.736+0000 7f0acf852700 1 --2- 172.21.15.40:0/1114429149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ac809c890 0x7f0ac806f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.736+0000 7f0acf852700 1 --2- 172.21.15.40:0/1114429149 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac8136bf0 0x7f0ac806f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.736+0000 7f0acf852700 1 -- 172.21.15.40:0/1114429149 >> 172.21.15.40:0/1114429149 conn(0x7f0ac80a7080 msgr2=0x7f0ac81349d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:00.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.737+0000 7f0acf852700 1 -- 172.21.15.40:0/1114429149 shutdown_connections 2023-09-30T22:31:00.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.737+0000 7f0acf852700 1 -- 172.21.15.40:0/1114429149 wait complete. 2023-09-30T22:31:00.751 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:00.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.787+0000 7f6652716700 1 -- 172.21.15.40:0/486843956 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f664c062380 con 0x7f664c09c890 2023-09-30T22:31:00.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.787+0000 7f6648ff9700 1 -- 172.21.15.40:0/486843956 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f663c01ab90 con 0x7f664c09c890 2023-09-30T22:31:00.788 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:00.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.789+0000 7f6652716700 1 -- 172.21.15.40:0/486843956 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f664c09c890 msgr2=0x7f664c1c8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:00.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.789+0000 7f6652716700 1 --2- 172.21.15.40:0/486843956 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f664c09c890 0x7f664c1c8bc0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f663c00e860 tx=0x7f663c00eb70 comp rx=0 tx=0).stop 2023-09-30T22:31:00.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.790+0000 7f6652716700 1 -- 172.21.15.40:0/486843956 shutdown_connections 2023-09-30T22:31:00.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.790+0000 7f6652716700 1 --2- 172.21.15.40:0/486843956 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f664c09c890 0x7f664c1c8bc0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.790+0000 7f6652716700 1 --2- 172.21.15.40:0/486843956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f664c09e2b0 0x7f664c12d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.790+0000 7f6652716700 1 --2- 172.21.15.40:0/486843956 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f664c09d920 0x7f664c1c9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.790+0000 7f6652716700 1 -- 172.21.15.40:0/486843956 >> 172.21.15.40:0/486843956 conn(0x7f664c0a7080 msgr2=0x7f664c0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:00.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.790+0000 7f6652716700 1 -- 172.21.15.40:0/486843956 shutdown_connections 2023-09-30T22:31:00.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.790+0000 7f6652716700 1 -- 172.21.15.40:0/486843956 wait complete. 2023-09-30T22:31:00.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:00.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.861+0000 7fc060f33700 1 Processor -- start 2023-09-30T22:31:00.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.861+0000 7fc060f33700 1 -- start start 2023-09-30T22:31:00.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.862+0000 7fc060f33700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc05c09c890 0x7fc05c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:00.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.862+0000 7fc060f33700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc05c09e480 0x7fc05c13bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:00.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.862+0000 7fc060f33700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc05c0a2600 con 0x7fc05c09d920 2023-09-30T22:31:00.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.862+0000 7fc060f33700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc05c0a29d0 con 0x7fc05c09c890 2023-09-30T22:31:00.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.862+0000 7fc060f33700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c09fb40 con 0x7fc05c09e480 2023-09-30T22:31:00.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.862+0000 7fc05a59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc05c09c890 0x7fc05c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:00.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.862+0000 7fc05ad9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc05c09e480 0x7fc05c13bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:00.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.862+0000 7fc05a59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc05c09c890 0x7fc05c09cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42996/0 (socket says 172.21.15.40:42996) 2023-09-30T22:31:00.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.862+0000 7fc05ad9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc05c09e480 0x7fc05c13bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42996/0 (socket says 172.21.15.40:42996) 2023-09-30T22:31:00.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.862+0000 7fc05a59c700 1 -- 172.21.15.40:0/1258506085 learned_addr learned my addr 172.21.15.40:0/1258506085 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:00.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.862+0000 7fc05ad9d700 1 -- 172.21.15.40:0/1258506085 >> v2:172.21.15.40:3300/0 conn(0x7fc05c09c890 msgr2=0x7fc05c09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:00.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.862+0000 7fc05ad9d700 1 --2- 172.21.15.40:0/1258506085 >> v2:172.21.15.40:3300/0 conn(0x7fc05c09c890 0x7fc05c09cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.862+0000 7fc05ad9d700 1 -- 172.21.15.40:0/1258506085 >> v1:172.21.15.40:6789/0 conn(0x7fc05c09d920 legacy=0x7fc05c09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:00.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.862+0000 7fc05ad9d700 1 -- 172.21.15.40:0/1258506085 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05c09fed0 con 0x7fc05c09e480 2023-09-30T22:31:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.862+0000 7fc05959a700 1 -- 172.21.15.40:0/1258506085 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2555392556 0 0) 0x7fc05c0a2600 con 0x7fc05c09d920 2023-09-30T22:31:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.862+0000 7fc05a59c700 1 --2- 172.21.15.40:0/1258506085 >> v2:172.21.15.40:3300/0 conn(0x7fc05c09c890 0x7fc05c09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.862+0000 7fc05ad9d700 1 --2- 172.21.15.40:0/1258506085 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc05c09e480 0x7fc05c13bc20 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fc054009d90 tx=0x7fc05400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f811540c9311bd1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.863+0000 7fc05959a700 1 -- 172.21.15.40:0/1258506085 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05400e070 con 0x7fc05c09e480 2023-09-30T22:31:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.863+0000 7fc05959a700 1 -- 172.21.15.40:0/1258506085 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05400bb20 con 0x7fc05c09e480 2023-09-30T22:31:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.863+0000 7fc05959a700 1 -- 172.21.15.40:0/1258506085 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc054012430 con 0x7fc05c09e480 2023-09-30T22:31:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.863+0000 7fc060f33700 1 -- 172.21.15.40:0/1258506085 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc05c09e480 msgr2=0x7fc05c13bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.863+0000 7fc060f33700 1 --2- 172.21.15.40:0/1258506085 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc05c09e480 0x7fc05c13bc20 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fc054009d90 tx=0x7fc05400b330 comp rx=0 tx=0).stop 2023-09-30T22:31:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.863+0000 7fc060f33700 1 -- 172.21.15.40:0/1258506085 shutdown_connections 2023-09-30T22:31:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.863+0000 7fc060f33700 1 --2- 172.21.15.40:0/1258506085 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc05c09e480 0x7fc05c13bc20 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.863+0000 7fc060f33700 1 --2- 172.21.15.40:0/1258506085 >> v2:172.21.15.40:3300/0 conn(0x7fc05c09c890 0x7fc05c09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.863+0000 7fc060f33700 1 -- 172.21.15.40:0/1258506085 >> 172.21.15.40:0/1258506085 conn(0x7fc05c0a7080 msgr2=0x7fc05c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:00.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.863+0000 7fc060f33700 1 -- 172.21.15.40:0/1258506085 shutdown_connections 2023-09-30T22:31:00.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.863+0000 7fc060f33700 1 -- 172.21.15.40:0/1258506085 wait complete. 2023-09-30T22:31:00.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.864+0000 7fc060f33700 1 Processor -- start 2023-09-30T22:31:00.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.864+0000 7fc060f33700 1 -- start start 2023-09-30T22:31:00.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.865+0000 7fc060f33700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc05c09c890 0x7fc05c12f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:00.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.865+0000 7fc060f33700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc05c09d920 0x7fc05c12fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:00.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.865+0000 7fc060f33700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc05c09e480 0x7fc05c12ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:00.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.865+0000 7fc060f33700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c12e960 con 0x7fc05c09c890 2023-09-30T22:31:00.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.865+0000 7fc060f33700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c12f320 con 0x7fc05c09d920 2023-09-30T22:31:00.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.865+0000 7fc060f33700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c12dc80 con 0x7fc05c09e480 2023-09-30T22:31:00.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.865+0000 7fc059d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc05c09d920 0x7fc05c12fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:00.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.865+0000 7fc05a59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc05c09c890 0x7fc05c12f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:00.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.865+0000 7fc05ad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc05c09e480 0x7fc05c12ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:00.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.865+0000 7fc059d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc05c09d920 0x7fc05c12fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:42998/0 (socket says 172.21.15.40:42998) 2023-09-30T22:31:00.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.865+0000 7fc05a59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc05c09c890 0x7fc05c12f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43000/0 (socket says 172.21.15.40:43000) 2023-09-30T22:31:00.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.865+0000 7fc059d9b700 1 -- 172.21.15.40:0/659713291 learned_addr learned my addr 172.21.15.40:0/659713291 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:00.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.865+0000 7fc059d9b700 1 -- 172.21.15.40:0/659713291 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc05c09e480 msgr2=0x7fc05c12ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:00.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.865+0000 7fc059d9b700 1 --2- 172.21.15.40:0/659713291 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc05c09e480 0x7fc05c12ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.865+0000 7fc059d9b700 1 -- 172.21.15.40:0/659713291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc05c09c890 msgr2=0x7fc05c12f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:00.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.865+0000 7fc059d9b700 1 --2- 172.21.15.40:0/659713291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc05c09c890 0x7fc05c12f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:00.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.865+0000 7fc059d9b700 1 -- 172.21.15.40:0/659713291 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc044009500 con 0x7fc05c09d920 2023-09-30T22:31:00.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.865+0000 7fc05a59c700 1 --2- 172.21.15.40:0/659713291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc05c09c890 0x7fc05c12f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:00.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.866+0000 7fc059d9b700 1 --2- 172.21.15.40:0/659713291 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc05c09d920 0x7fc05c12fa80 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fc04c00c520 tx=0x7fc04c00c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:00.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.866+0000 7fc052ffd700 1 -- 172.21.15.40:0/659713291 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c0054e0 con 0x7fc05c09d920 2023-09-30T22:31:00.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.866+0000 7fc052ffd700 1 -- 172.21.15.40:0/659713291 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04c003680 con 0x7fc05c09d920 2023-09-30T22:31:00.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.866+0000 7fc060f33700 1 -- 172.21.15.40:0/659713291 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc054009a70 con 0x7fc05c09d920 2023-09-30T22:31:00.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.866+0000 7fc052ffd700 1 -- 172.21.15.40:0/659713291 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c0039f0 con 0x7fc05c09d920 2023-09-30T22:31:00.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.866+0000 7fc060f33700 1 -- 172.21.15.40:0/659713291 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc05c09ecf0 con 0x7fc05c09d920 2023-09-30T22:31:00.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.867+0000 7fc052ffd700 1 -- 172.21.15.40:0/659713291 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc04c003b50 con 0x7fc05c09d920 2023-09-30T22:31:00.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.867+0000 7fc052ffd700 1 -- 172.21.15.40:0/659713291 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc04c03eaf0 con 0x7fc05c09d920 2023-09-30T22:31:00.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.867+0000 7fc060f33700 1 -- 172.21.15.40:0/659713291 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc05c06e600 con 0x7fc05c09d920 2023-09-30T22:31:00.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:00.871+0000 7fc052ffd700 1 -- 172.21.15.40:0/659713291 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc04c01b3b0 con 0x7fc05c09d920 2023-09-30T22:31:01.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.067+0000 7fc060f33700 1 -- 172.21.15.40:0/659713291 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc05c062380 con 0x7fc05c09d920 2023-09-30T22:31:01.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.068+0000 7fc052ffd700 1 -- 172.21.15.40:0/659713291 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc04c017020 con 0x7fc05c09d920 2023-09-30T22:31:01.069 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:01.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.070+0000 7fc060f33700 1 -- 172.21.15.40:0/659713291 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc05c09d920 msgr2=0x7fc05c12fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:01.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.070+0000 7fc060f33700 1 --2- 172.21.15.40:0/659713291 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc05c09d920 0x7fc05c12fa80 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fc04c00c520 tx=0x7fc04c00c830 comp rx=0 tx=0).stop 2023-09-30T22:31:01.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.070+0000 7fc060f33700 1 -- 172.21.15.40:0/659713291 shutdown_connections 2023-09-30T22:31:01.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.070+0000 7fc060f33700 1 --2- 172.21.15.40:0/659713291 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc05c09e480 0x7fc05c12ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.070+0000 7fc060f33700 1 --2- 172.21.15.40:0/659713291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc05c09c890 0x7fc05c12f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.070+0000 7fc060f33700 1 --2- 172.21.15.40:0/659713291 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc05c09d920 0x7fc05c12fa80 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.070+0000 7fc060f33700 1 -- 172.21.15.40:0/659713291 >> 172.21.15.40:0/659713291 conn(0x7fc05c0a7080 msgr2=0x7fc05c1bb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:01.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.070+0000 7fc060f33700 1 -- 172.21.15.40:0/659713291 shutdown_connections 2023-09-30T22:31:01.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.070+0000 7fc060f33700 1 -- 172.21.15.40:0/659713291 wait complete. 2023-09-30T22:31:01.083 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:01.718 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:01.752 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:01.804 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:01.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.870+0000 7f6e13d81700 1 Processor -- start 2023-09-30T22:31:01.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.870+0000 7f6e13d81700 1 -- start start 2023-09-30T22:31:01.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.870+0000 7f6e13d81700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6e0c06a6d0 0x7f6e0c06aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:01.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.870+0000 7f6e13d81700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e0c06afe0 0x7f6e0c1318b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:01.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.870+0000 7f6e13d81700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e0c09eb50 con 0x7f6e0c131df0 2023-09-30T22:31:01.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.870+0000 7f6e13d81700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c09dde0 con 0x7f6e0c06afe0 2023-09-30T22:31:01.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.870+0000 7f6e13d81700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c09d4a0 con 0x7f6e0c06a6d0 2023-09-30T22:31:01.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.870+0000 7f6e11b1d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6e0c06a6d0 0x7f6e0c06aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:01.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.871+0000 7f6e1231e700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6e0c131df0 0x7f6e0c138b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46350/0 (socket says 172.21.15.40:46350) 2023-09-30T22:31:01.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.871+0000 7f6e11b1d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6e0c06a6d0 0x7f6e0c06aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60444/0 (socket says 172.21.15.40:60444) 2023-09-30T22:31:01.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.871+0000 7f6e1231e700 1 -- 172.21.15.40:0/3506864986 learned_addr learned my addr 172.21.15.40:0/3506864986 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:01.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.871+0000 7f6e1131c700 1 --2- 172.21.15.40:0/3506864986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e0c06afe0 0x7f6e0c1318b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:01.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.871+0000 7f6e10b1b700 1 -- 172.21.15.40:0/3506864986 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1406183919 0 0) 0x7f6e0c09eb50 con 0x7f6e0c131df0 2023-09-30T22:31:01.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.871+0000 7f6e10b1b700 1 -- 172.21.15.40:0/3506864986 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6df80035b0 con 0x7f6e0c131df0 2023-09-30T22:31:01.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.871+0000 7f6e1131c700 1 -- 172.21.15.40:0/3506864986 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6e0c06a6d0 msgr2=0x7f6e0c06aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:01.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.871+0000 7f6e1131c700 1 --2- 172.21.15.40:0/3506864986 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6e0c06a6d0 0x7f6e0c06aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.871+0000 7f6e1131c700 1 -- 172.21.15.40:0/3506864986 >> v1:172.21.15.40:6789/0 conn(0x7f6e0c131df0 legacy=0x7f6e0c138b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:01.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.871+0000 7f6e1131c700 1 -- 172.21.15.40:0/3506864986 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0c09f5f0 con 0x7f6e0c06afe0 2023-09-30T22:31:01.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.871+0000 7f6e11b1d700 1 --2- 172.21.15.40:0/3506864986 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6e0c06a6d0 0x7f6e0c06aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:01.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.871+0000 7f6e1131c700 1 --2- 172.21.15.40:0/3506864986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e0c06afe0 0x7f6e0c1318b0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc009870 tx=0x7f6dfc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21ac921f8aa90172 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:01.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.871+0000 7f6e10b1b700 1 -- 172.21.15.40:0/3506864986 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc011830 con 0x7f6e0c06afe0 2023-09-30T22:31:01.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.871+0000 7f6e10b1b700 1 -- 172.21.15.40:0/3506864986 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dfc011990 con 0x7f6e0c06afe0 2023-09-30T22:31:01.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.871+0000 7f6e10b1b700 1 -- 172.21.15.40:0/3506864986 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc011d00 con 0x7f6e0c06afe0 2023-09-30T22:31:01.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.872+0000 7f6e13d81700 1 -- 172.21.15.40:0/3506864986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e0c06afe0 msgr2=0x7f6e0c1318b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:01.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.872+0000 7f6e13d81700 1 --2- 172.21.15.40:0/3506864986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e0c06afe0 0x7f6e0c1318b0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc009870 tx=0x7f6dfc009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:01.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.872+0000 7f6e13d81700 1 -- 172.21.15.40:0/3506864986 shutdown_connections 2023-09-30T22:31:01.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.872+0000 7f6e13d81700 1 --2- 172.21.15.40:0/3506864986 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6e0c06a6d0 0x7f6e0c06aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.872+0000 7f6e13d81700 1 --2- 172.21.15.40:0/3506864986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e0c06afe0 0x7f6e0c1318b0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.872+0000 7f6e13d81700 1 -- 172.21.15.40:0/3506864986 >> 172.21.15.40:0/3506864986 conn(0x7f6e0c09fb20 msgr2=0x7f6e0c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:01.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.872+0000 7f6e13d81700 1 -- 172.21.15.40:0/3506864986 shutdown_connections 2023-09-30T22:31:01.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.872+0000 7f6e13d81700 1 -- 172.21.15.40:0/3506864986 wait complete. 2023-09-30T22:31:01.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.873+0000 7f6e13d81700 1 Processor -- start 2023-09-30T22:31:01.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.873+0000 7f6e13d81700 1 -- start start 2023-09-30T22:31:01.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.874+0000 7f6e13d81700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e0c06a6d0 0x7f6e0c1208c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:01.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.874+0000 7f6e13d81700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e0c06afe0 0x7f6e0c120e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:01.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.874+0000 7f6e13d81700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6e0c131df0 0x7f6e0c121340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:01.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.874+0000 7f6e13d81700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c123dc0 con 0x7f6e0c06a6d0 2023-09-30T22:31:01.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.874+0000 7f6e13d81700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c0a3e60 con 0x7f6e0c06afe0 2023-09-30T22:31:01.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.874+0000 7f6e13d81700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c124f40 con 0x7f6e0c131df0 2023-09-30T22:31:01.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.874+0000 7f6e11b1d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e0c06a6d0 0x7f6e0c1208c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:01.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.874+0000 7f6e11b1d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e0c06a6d0 0x7f6e0c1208c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43006/0 (socket says 172.21.15.40:43006) 2023-09-30T22:31:01.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.874+0000 7f6e11b1d700 1 -- 172.21.15.40:0/3331446228 learned_addr learned my addr 172.21.15.40:0/3331446228 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:01.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.874+0000 7f6e1131c700 1 --2- 172.21.15.40:0/3331446228 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e0c06afe0 0x7f6e0c120e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:01.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.874+0000 7f6e1231e700 1 --2- 172.21.15.40:0/3331446228 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6e0c131df0 0x7f6e0c121340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:01.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.874+0000 7f6e11b1d700 1 -- 172.21.15.40:0/3331446228 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6e0c131df0 msgr2=0x7f6e0c121340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:01.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.874+0000 7f6e11b1d700 1 --2- 172.21.15.40:0/3331446228 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6e0c131df0 0x7f6e0c121340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.874+0000 7f6e11b1d700 1 -- 172.21.15.40:0/3331446228 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e0c06afe0 msgr2=0x7f6e0c120e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:01.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.874+0000 7f6e11b1d700 1 --2- 172.21.15.40:0/3331446228 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e0c06afe0 0x7f6e0c120e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.874+0000 7f6e11b1d700 1 -- 172.21.15.40:0/3331446228 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e08009430 con 0x7f6e0c06a6d0 2023-09-30T22:31:01.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.874+0000 7f6e1131c700 1 --2- 172.21.15.40:0/3331446228 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e0c06afe0 0x7f6e0c120e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:01.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.875+0000 7f6e11b1d700 1 --2- 172.21.15.40:0/3331446228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e0c06a6d0 0x7f6e0c1208c0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f6e0800ebe0 tx=0x7f6e0800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:01.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.875+0000 7f6e027fc700 1 -- 172.21.15.40:0/3331446228 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e08005a20 con 0x7f6e0c06a6d0 2023-09-30T22:31:01.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.875+0000 7f6e027fc700 1 -- 172.21.15.40:0/3331446228 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e08005b80 con 0x7f6e0c06a6d0 2023-09-30T22:31:01.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.875+0000 7f6e13d81700 1 -- 172.21.15.40:0/3331446228 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dfc0094a0 con 0x7f6e0c06a6d0 2023-09-30T22:31:01.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.875+0000 7f6e027fc700 1 -- 172.21.15.40:0/3331446228 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0800c850 con 0x7f6e0c06a6d0 2023-09-30T22:31:01.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.875+0000 7f6e13d81700 1 -- 172.21.15.40:0/3331446228 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e0c0715b0 con 0x7f6e0c06a6d0 2023-09-30T22:31:01.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.876+0000 7f6e027fc700 1 -- 172.21.15.40:0/3331446228 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6e0800c9b0 con 0x7f6e0c06a6d0 2023-09-30T22:31:01.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.876+0000 7f6e027fc700 1 -- 172.21.15.40:0/3331446228 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6e0803f980 con 0x7f6e0c06a6d0 2023-09-30T22:31:01.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.876+0000 7f6e13d81700 1 -- 172.21.15.40:0/3331446228 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e0c124bb0 con 0x7f6e0c06a6d0 2023-09-30T22:31:01.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.881+0000 7f6e027fc700 1 -- 172.21.15.40:0/3331446228 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6e08020080 con 0x7f6e0c06a6d0 2023-09-30T22:31:01.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.921+0000 7f7e913bd700 1 Processor -- start 2023-09-30T22:31:01.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.921+0000 7f7e913bd700 1 -- start start 2023-09-30T22:31:01.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.922+0000 7f7e913bd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e8c09c890 0x7f7e8c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:01.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.922+0000 7f7e913bd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e8c09e480 0x7f7e8c13bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:01.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.922+0000 7f7e913bd700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e8c0a2600 con 0x7f7e8c09d920 2023-09-30T22:31:01.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.922+0000 7f7e913bd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8c0a29d0 con 0x7f7e8c09e480 2023-09-30T22:31:01.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.922+0000 7f7e913bd700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8c09fb40 con 0x7f7e8c09c890 2023-09-30T22:31:01.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.922+0000 7f7e8affd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e8c09c890 0x7f7e8c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:01.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.922+0000 7f7e8b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e8c09e480 0x7f7e8c13bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:01.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.922+0000 7f7e8affd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e8c09c890 0x7f7e8c09cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60454/0 (socket says 172.21.15.40:60454) 2023-09-30T22:31:01.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.922+0000 7f7e8affd700 1 -- 172.21.15.40:0/3869421321 learned_addr learned my addr 172.21.15.40:0/3869421321 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:01.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.923+0000 7f7e89ffb700 1 -- 172.21.15.40:0/3869421321 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3090139223 0 0) 0x7f7e8c0a2600 con 0x7f7e8c09d920 2023-09-30T22:31:01.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.923+0000 7f7e8b7fe700 1 -- 172.21.15.40:0/3869421321 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e8c09c890 msgr2=0x7f7e8c09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:01.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.923+0000 7f7e8b7fe700 1 --2- 172.21.15.40:0/3869421321 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e8c09c890 0x7f7e8c09cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.923+0000 7f7e8b7fe700 1 -- 172.21.15.40:0/3869421321 >> v1:172.21.15.40:6789/0 conn(0x7f7e8c09d920 legacy=0x7f7e8c09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:01.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.923+0000 7f7e8b7fe700 1 -- 172.21.15.40:0/3869421321 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8c09fed0 con 0x7f7e8c09e480 2023-09-30T22:31:01.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.923+0000 7f7e8b7fe700 1 --2- 172.21.15.40:0/3869421321 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e8c09e480 0x7f7e8c13bc20 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009dc0 tx=0x7f7e8400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dce6533eb730c04a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:01.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.923+0000 7f7e89ffb700 1 -- 172.21.15.40:0/3869421321 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8400e070 con 0x7f7e8c09e480 2023-09-30T22:31:01.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.923+0000 7f7e89ffb700 1 -- 172.21.15.40:0/3869421321 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8400bb20 con 0x7f7e8c09e480 2023-09-30T22:31:01.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.923+0000 7f7e89ffb700 1 -- 172.21.15.40:0/3869421321 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e84012430 con 0x7f7e8c09e480 2023-09-30T22:31:01.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.924+0000 7f7e913bd700 1 -- 172.21.15.40:0/3869421321 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e8c09e480 msgr2=0x7f7e8c13bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:01.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.924+0000 7f7e913bd700 1 --2- 172.21.15.40:0/3869421321 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e8c09e480 0x7f7e8c13bc20 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009dc0 tx=0x7f7e8400b330 comp rx=0 tx=0).stop 2023-09-30T22:31:01.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.924+0000 7f7e913bd700 1 -- 172.21.15.40:0/3869421321 shutdown_connections 2023-09-30T22:31:01.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.924+0000 7f7e913bd700 1 --2- 172.21.15.40:0/3869421321 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e8c09e480 0x7f7e8c13bc20 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.924+0000 7f7e913bd700 1 --2- 172.21.15.40:0/3869421321 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e8c09c890 0x7f7e8c09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.924+0000 7f7e913bd700 1 -- 172.21.15.40:0/3869421321 >> 172.21.15.40:0/3869421321 conn(0x7f7e8c0a7080 msgr2=0x7f7e8c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:01.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.924+0000 7f7e913bd700 1 -- 172.21.15.40:0/3869421321 shutdown_connections 2023-09-30T22:31:01.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.924+0000 7f7e913bd700 1 -- 172.21.15.40:0/3869421321 wait complete. 2023-09-30T22:31:01.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.926+0000 7f7e913bd700 1 Processor -- start 2023-09-30T22:31:01.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.926+0000 7f7e913bd700 1 -- start start 2023-09-30T22:31:01.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.926+0000 7f7e913bd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e8c09c890 0x7f7e8c12d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:01.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.926+0000 7f7e913bd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e8c09d920 0x7f7e8c12d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:01.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.926+0000 7f7e913bd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e8c09e480 0x7f7e8c12db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:01.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.926+0000 7f7e913bd700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8c09c1c0 con 0x7f7e8c09d920 2023-09-30T22:31:01.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.926+0000 7f7e913bd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8c09ecf0 con 0x7f7e8c09c890 2023-09-30T22:31:01.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.926+0000 7f7e913bd700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8c0a5b90 con 0x7f7e8c09e480 2023-09-30T22:31:01.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.927+0000 7f7e8a7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e8c09d920 0x7f7e8c12d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:01.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.927+0000 7f7e8a7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e8c09d920 0x7f7e8c12d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43012/0 (socket says 172.21.15.40:43012) 2023-09-30T22:31:01.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.927+0000 7f7e8a7fc700 1 -- 172.21.15.40:0/1397748900 learned_addr learned my addr 172.21.15.40:0/1397748900 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:01.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.927+0000 7f7e8b7fe700 1 --2- 172.21.15.40:0/1397748900 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e8c09e480 0x7f7e8c12db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:01.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.927+0000 7f7e8affd700 1 --2- 172.21.15.40:0/1397748900 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e8c09c890 0x7f7e8c12d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:01.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.927+0000 7f7e8b7fe700 1 -- 172.21.15.40:0/1397748900 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e8c09c890 msgr2=0x7f7e8c12d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:01.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.927+0000 7f7e8b7fe700 1 --2- 172.21.15.40:0/1397748900 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e8c09c890 0x7f7e8c12d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.927+0000 7f7e8b7fe700 1 -- 172.21.15.40:0/1397748900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e8c09d920 msgr2=0x7f7e8c12d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:01.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.927+0000 7f7e8b7fe700 1 --2- 172.21.15.40:0/1397748900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e8c09d920 0x7f7e8c12d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.927+0000 7f7e8b7fe700 1 -- 172.21.15.40:0/1397748900 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e84009a70 con 0x7f7e8c09e480 2023-09-30T22:31:01.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.927+0000 7f7e8b7fe700 1 --2- 172.21.15.40:0/1397748900 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e8c09e480 0x7f7e8c12db80 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f7e84016000 tx=0x7f7e84004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:01.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.927+0000 7f7e737fe700 1 -- 172.21.15.40:0/1397748900 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e84012430 con 0x7f7e8c09e480 2023-09-30T22:31:01.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.927+0000 7f7e737fe700 1 -- 172.21.15.40:0/1397748900 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e84020070 con 0x7f7e8c09e480 2023-09-30T22:31:01.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.927+0000 7f7e913bd700 1 -- 172.21.15.40:0/1397748900 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e8c130470 con 0x7f7e8c09e480 2023-09-30T22:31:01.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.927+0000 7f7e737fe700 1 -- 172.21.15.40:0/1397748900 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e84004280 con 0x7f7e8c09e480 2023-09-30T22:31:01.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.927+0000 7f7e913bd700 1 -- 172.21.15.40:0/1397748900 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e8c130730 con 0x7f7e8c09e480 2023-09-30T22:31:01.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.928+0000 7f7e737fe700 1 -- 172.21.15.40:0/1397748900 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7e840043e0 con 0x7f7e8c09e480 2023-09-30T22:31:01.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.929+0000 7f7e737fe700 1 -- 172.21.15.40:0/1397748900 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f7e84022070 con 0x7f7e8c09e480 2023-09-30T22:31:01.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.929+0000 7f7e913bd700 1 -- 172.21.15.40:0/1397748900 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e8c12fd50 con 0x7f7e8c09e480 2023-09-30T22:31:01.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.934+0000 7f7e737fe700 1 -- 172.21.15.40:0/1397748900 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e84011390 con 0x7f7e8c09e480 2023-09-30T22:31:01.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.942+0000 7f32e1486700 1 Processor -- start 2023-09-30T22:31:01.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.942+0000 7f32e1486700 1 -- start start 2023-09-30T22:31:01.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.943+0000 7f32e1486700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f32dc09d920 0x7f32dc09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:01.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.943+0000 7f32e1486700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32dc09f0f0 0x7f32dc09e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:01.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.943+0000 7f32e1486700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f32dc133ca0 0x7f32dc134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:01.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.943+0000 7f32e1486700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32dc06b4c0 con 0x7f32dc133ca0 2023-09-30T22:31:01.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.943+0000 7f32e1486700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc09a8f0 con 0x7f32dc09f0f0 2023-09-30T22:31:01.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.943+0000 7f32e1486700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc09f940 con 0x7f32dc09d920 2023-09-30T22:31:01.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.943+0000 7f32da7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32dc09f0f0 0x7f32dc09e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:01.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.943+0000 7f32daffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f32dc09d920 0x7f32dc09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:01.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.943+0000 7f32da7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32dc09f0f0 0x7f32dc09e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:43038/0 (socket says 172.21.15.40:43038) 2023-09-30T22:31:01.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.943+0000 7f32da7fc700 1 -- 172.21.15.40:0/1279829575 learned_addr learned my addr 172.21.15.40:0/1279829575 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:01.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.943+0000 7f32db7fe700 1 --2- 172.21.15.40:0/1279829575 >> v2:172.21.15.40:3300/0 conn(0x7f32dc133ca0 0x7f32dc134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:01.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.943+0000 7f32da7fc700 1 -- 172.21.15.40:0/1279829575 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f32dc09d920 msgr2=0x7f32dc09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:01.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.943+0000 7f32da7fc700 1 --2- 172.21.15.40:0/1279829575 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f32dc09d920 0x7f32dc09dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.943+0000 7f32da7fc700 1 -- 172.21.15.40:0/1279829575 >> v2:172.21.15.40:3300/0 conn(0x7f32dc133ca0 msgr2=0x7f32dc134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:01.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.943+0000 7f32da7fc700 1 --2- 172.21.15.40:0/1279829575 >> v2:172.21.15.40:3300/0 conn(0x7f32dc133ca0 0x7f32dc134140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.943+0000 7f32da7fc700 1 -- 172.21.15.40:0/1279829575 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32dc09f6e0 con 0x7f32dc09f0f0 2023-09-30T22:31:01.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.943+0000 7f32daffd700 1 --2- 172.21.15.40:0/1279829575 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f32dc09d920 0x7f32dc09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:01.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.943+0000 7f32da7fc700 1 --2- 172.21.15.40:0/1279829575 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32dc09f0f0 0x7f32dc09e230 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f32d0009950 tx=0x7f32d0009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=261b2b12eae5d6e1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:01.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.944+0000 7f32d9ffb700 1 -- 172.21.15.40:0/1279829575 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d0011830 con 0x7f32dc09f0f0 2023-09-30T22:31:01.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.944+0000 7f32d9ffb700 1 -- 172.21.15.40:0/1279829575 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d0011990 con 0x7f32dc09f0f0 2023-09-30T22:31:01.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.944+0000 7f32d9ffb700 1 -- 172.21.15.40:0/1279829575 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d0011d40 con 0x7f32dc09f0f0 2023-09-30T22:31:01.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.944+0000 7f32e1486700 1 -- 172.21.15.40:0/1279829575 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32dc09f0f0 msgr2=0x7f32dc09e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:01.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.944+0000 7f32e1486700 1 --2- 172.21.15.40:0/1279829575 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32dc09f0f0 0x7f32dc09e230 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f32d0009950 tx=0x7f32d0009c60 comp rx=0 tx=0).stop 2023-09-30T22:31:01.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.944+0000 7f32e1486700 1 -- 172.21.15.40:0/1279829575 shutdown_connections 2023-09-30T22:31:01.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.944+0000 7f32e1486700 1 --2- 172.21.15.40:0/1279829575 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f32dc09d920 0x7f32dc09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.944+0000 7f32e1486700 1 --2- 172.21.15.40:0/1279829575 >> v2:172.21.15.40:3300/0 conn(0x7f32dc133ca0 0x7f32dc134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.944+0000 7f32e1486700 1 --2- 172.21.15.40:0/1279829575 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32dc09f0f0 0x7f32dc09e230 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.944+0000 7f32e1486700 1 -- 172.21.15.40:0/1279829575 >> 172.21.15.40:0/1279829575 conn(0x7f32dc09fb20 msgr2=0x7f32dc09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:01.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.944+0000 7f32e1486700 1 -- 172.21.15.40:0/1279829575 shutdown_connections 2023-09-30T22:31:01.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.944+0000 7f32e1486700 1 -- 172.21.15.40:0/1279829575 wait complete. 2023-09-30T22:31:01.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.945+0000 7f32e1486700 1 Processor -- start 2023-09-30T22:31:01.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.946+0000 7f32e1486700 1 -- start start 2023-09-30T22:31:01.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.946+0000 7f32e1486700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f32dc09d920 0x7f32dc1219a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:01.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.946+0000 7f32e1486700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32dc133ca0 0x7f32dc121ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:01.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.946+0000 7f32e1486700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32dc122420 0x7f32dc1c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:01.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.946+0000 7f32e1486700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc124ea0 con 0x7f32dc133ca0 2023-09-30T22:31:01.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.946+0000 7f32e1486700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc123a80 con 0x7f32dc122420 2023-09-30T22:31:01.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.946+0000 7f32e1486700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc126020 con 0x7f32dc09d920 2023-09-30T22:31:01.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.946+0000 7f32db7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32dc122420 0x7f32dc1c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:01.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.946+0000 7f32db7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32dc122420 0x7f32dc1c87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:43040/0 (socket says 172.21.15.40:43040) 2023-09-30T22:31:01.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.946+0000 7f32db7fe700 1 -- 172.21.15.40:0/1514787145 learned_addr learned my addr 172.21.15.40:0/1514787145 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:01.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.946+0000 7f32da7fc700 1 --2- 172.21.15.40:0/1514787145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32dc133ca0 0x7f32dc121ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:01.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.946+0000 7f32daffd700 1 --2- 172.21.15.40:0/1514787145 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f32dc09d920 0x7f32dc1219a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:01.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.947+0000 7f32da7fc700 1 -- 172.21.15.40:0/1514787145 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f32dc09d920 msgr2=0x7f32dc1219a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:01.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.947+0000 7f32da7fc700 1 --2- 172.21.15.40:0/1514787145 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f32dc09d920 0x7f32dc1219a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.947+0000 7f32da7fc700 1 -- 172.21.15.40:0/1514787145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32dc122420 msgr2=0x7f32dc1c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:01.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.947+0000 7f32da7fc700 1 --2- 172.21.15.40:0/1514787145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32dc122420 0x7f32dc1c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:01.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.947+0000 7f32da7fc700 1 -- 172.21.15.40:0/1514787145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32cc009430 con 0x7f32dc133ca0 2023-09-30T22:31:01.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.947+0000 7f32db7fe700 1 --2- 172.21.15.40:0/1514787145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32dc122420 0x7f32dc1c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:01.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.947+0000 7f32da7fc700 1 --2- 172.21.15.40:0/1514787145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32dc133ca0 0x7f32dc121ee0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f32d0016000 tx=0x7f32d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:01.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.947+0000 7f32c37fe700 1 -- 172.21.15.40:0/1514787145 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d0004240 con 0x7f32dc133ca0 2023-09-30T22:31:01.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.947+0000 7f32c37fe700 1 -- 172.21.15.40:0/1514787145 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d001f070 con 0x7f32dc133ca0 2023-09-30T22:31:01.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.947+0000 7f32e1486700 1 -- 172.21.15.40:0/1514787145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32d0009550 con 0x7f32dc133ca0 2023-09-30T22:31:01.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.947+0000 7f32c37fe700 1 -- 172.21.15.40:0/1514787145 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d00045e0 con 0x7f32dc133ca0 2023-09-30T22:31:01.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.947+0000 7f32e1486700 1 -- 172.21.15.40:0/1514787145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32dc123560 con 0x7f32dc133ca0 2023-09-30T22:31:01.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.948+0000 7f32e1486700 1 -- 172.21.15.40:0/1514787145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32dc062380 con 0x7f32dc133ca0 2023-09-30T22:31:01.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.948+0000 7f32c37fe700 1 -- 172.21.15.40:0/1514787145 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f32d0021030 con 0x7f32dc133ca0 2023-09-30T22:31:01.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.948+0000 7f32c37fe700 1 -- 172.21.15.40:0/1514787145 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f32d0040700 con 0x7f32dc133ca0 2023-09-30T22:31:01.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:01.957+0000 7f32c37fe700 1 -- 172.21.15.40:0/1514787145 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f32d00036a0 con 0x7f32dc133ca0 2023-09-30T22:31:02.084 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:02.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.097+0000 7f6e13d81700 1 -- 172.21.15.40:0/3331446228 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6e0c062380 con 0x7f6e0c06a6d0 2023-09-30T22:31:02.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.097+0000 7f6e027fc700 1 -- 172.21.15.40:0/3331446228 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6e08022300 con 0x7f6e0c06a6d0 2023-09-30T22:31:02.098 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:02.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.099+0000 7f6e13d81700 1 -- 172.21.15.40:0/3331446228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e0c06a6d0 msgr2=0x7f6e0c1208c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:02.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.099+0000 7f6e13d81700 1 --2- 172.21.15.40:0/3331446228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e0c06a6d0 0x7f6e0c1208c0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f6e0800ebe0 tx=0x7f6e0800eef0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.099+0000 7f6e13d81700 1 -- 172.21.15.40:0/3331446228 shutdown_connections 2023-09-30T22:31:02.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.099+0000 7f6e13d81700 1 --2- 172.21.15.40:0/3331446228 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6e0c131df0 0x7f6e0c121340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.099+0000 7f6e13d81700 1 --2- 172.21.15.40:0/3331446228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e0c06a6d0 0x7f6e0c1208c0 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.099+0000 7f6e13d81700 1 --2- 172.21.15.40:0/3331446228 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e0c06afe0 0x7f6e0c120e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.099+0000 7f6e13d81700 1 -- 172.21.15.40:0/3331446228 >> 172.21.15.40:0/3331446228 conn(0x7f6e0c09fb20 msgr2=0x7f6e0c0a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:02.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.100+0000 7f6e13d81700 1 -- 172.21.15.40:0/3331446228 shutdown_connections 2023-09-30T22:31:02.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.100+0000 7f6e13d81700 1 -- 172.21.15.40:0/3331446228 wait complete. 2023-09-30T22:31:02.118 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:02.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.142+0000 7f7e913bd700 1 -- 172.21.15.40:0/1397748900 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7e8c062380 con 0x7f7e8c09e480 2023-09-30T22:31:02.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.142+0000 7f7e737fe700 1 -- 172.21.15.40:0/1397748900 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7e8402fce0 con 0x7f7e8c09e480 2023-09-30T22:31:02.143 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:02.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.145+0000 7f7e913bd700 1 -- 172.21.15.40:0/1397748900 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e8c09e480 msgr2=0x7f7e8c12db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:02.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.145+0000 7f7e913bd700 1 --2- 172.21.15.40:0/1397748900 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e8c09e480 0x7f7e8c12db80 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f7e84016000 tx=0x7f7e84004ad0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.145+0000 7f7e913bd700 1 -- 172.21.15.40:0/1397748900 shutdown_connections 2023-09-30T22:31:02.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.145+0000 7f7e913bd700 1 --2- 172.21.15.40:0/1397748900 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e8c09e480 0x7f7e8c12db80 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.145+0000 7f7e913bd700 1 --2- 172.21.15.40:0/1397748900 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e8c09c890 0x7f7e8c12d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.145+0000 7f7e913bd700 1 --2- 172.21.15.40:0/1397748900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e8c09d920 0x7f7e8c12d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.145+0000 7f7e913bd700 1 -- 172.21.15.40:0/1397748900 >> 172.21.15.40:0/1397748900 conn(0x7f7e8c0a7080 msgr2=0x7f7e8c0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:02.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.145+0000 7f7e913bd700 1 -- 172.21.15.40:0/1397748900 shutdown_connections 2023-09-30T22:31:02.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.145+0000 7f7e913bd700 1 -- 172.21.15.40:0/1397748900 wait complete. 2023-09-30T22:31:02.159 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:02.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.166+0000 7f32e1486700 1 -- 172.21.15.40:0/1514787145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f32dc074720 con 0x7f32dc133ca0 2023-09-30T22:31:02.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.166+0000 7f32c37fe700 1 -- 172.21.15.40:0/1514787145 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f32d0015070 con 0x7f32dc133ca0 2023-09-30T22:31:02.167 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:02.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.168+0000 7f32e1486700 1 -- 172.21.15.40:0/1514787145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32dc133ca0 msgr2=0x7f32dc121ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:02.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.168+0000 7f32e1486700 1 --2- 172.21.15.40:0/1514787145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32dc133ca0 0x7f32dc121ee0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f32d0016000 tx=0x7f32d0004750 comp rx=0 tx=0).stop 2023-09-30T22:31:02.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.168+0000 7f32e1486700 1 -- 172.21.15.40:0/1514787145 shutdown_connections 2023-09-30T22:31:02.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.168+0000 7f32e1486700 1 --2- 172.21.15.40:0/1514787145 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f32dc09d920 0x7f32dc1219a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.168+0000 7f32e1486700 1 --2- 172.21.15.40:0/1514787145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32dc122420 0x7f32dc1c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.168+0000 7f32e1486700 1 --2- 172.21.15.40:0/1514787145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32dc133ca0 0x7f32dc121ee0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.168+0000 7f32e1486700 1 -- 172.21.15.40:0/1514787145 >> 172.21.15.40:0/1514787145 conn(0x7f32dc09fb20 msgr2=0x7f32dc0a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:02.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.168+0000 7f32e1486700 1 -- 172.21.15.40:0/1514787145 shutdown_connections 2023-09-30T22:31:02.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.168+0000 7f32e1486700 1 -- 172.21.15.40:0/1514787145 wait complete. 2023-09-30T22:31:02.181 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:02.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.214+0000 7f5d4c5e8700 1 Processor -- start 2023-09-30T22:31:02.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.214+0000 7f5d4c5e8700 1 -- start start 2023-09-30T22:31:02.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.215+0000 7f5d4c5e8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d4409fbb0 0x7f5d4406c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:02.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.215+0000 7f5d4c5e8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d4406ced0 0x7f5d4406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:02.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.215+0000 7f5d4c5e8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d4406d800 con 0x7f5d44138370 2023-09-30T22:31:02.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.215+0000 7f5d4c5e8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4409ff80 con 0x7f5d4409fbb0 2023-09-30T22:31:02.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.215+0000 7f5d4c5e8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4406da80 con 0x7f5d4406ced0 2023-09-30T22:31:02.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.215+0000 7f5d49b83700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d4406ced0 0x7f5d4406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:02.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.215+0000 7f5d4a384700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d4409fbb0 0x7f5d4406c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:02.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.215+0000 7f5d4ab85700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5d44138370 0x7f5d4413a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:46380/0 (socket says 172.21.15.40:46380) 2023-09-30T22:31:02.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.215+0000 7f5d49b83700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d4406ced0 0x7f5d4406d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:60482/0 (socket says 172.21.15.40:60482) 2023-09-30T22:31:02.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.215+0000 7f5d4ab85700 1 -- 172.21.15.40:0/2782934761 learned_addr learned my addr 172.21.15.40:0/2782934761 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:02.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.215+0000 7f5d4a384700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d4409fbb0 0x7f5d4406c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:43056/0 (socket says 172.21.15.40:43056) 2023-09-30T22:31:02.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.215+0000 7f5d4a384700 1 -- 172.21.15.40:0/2782934761 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d4406ced0 msgr2=0x7f5d4406d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:02.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.215+0000 7f5d49382700 1 -- 172.21.15.40:0/2782934761 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3258887723 0 0) 0x7f5d3c001490 con 0x7f5d44138370 2023-09-30T22:31:02.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.215+0000 7f5d4a384700 1 --2- 172.21.15.40:0/2782934761 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d4406ced0 0x7f5d4406d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.215+0000 7f5d4a384700 1 -- 172.21.15.40:0/2782934761 >> v1:172.21.15.40:6789/0 conn(0x7f5d44138370 legacy=0x7f5d4413a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:02.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.215+0000 7f5d4a384700 1 -- 172.21.15.40:0/2782934761 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d440a0590 con 0x7f5d4409fbb0 2023-09-30T22:31:02.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.215+0000 7f5d49b83700 1 --2- 172.21.15.40:0/2782934761 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d4406ced0 0x7f5d4406d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:02.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.215+0000 7f5d4a384700 1 --2- 172.21.15.40:0/2782934761 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d4409fbb0 0x7f5d4406c990 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5d40009870 tx=0x7f5d40009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec94529d4929fd30 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:02.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.215+0000 7f5d49382700 1 -- 172.21.15.40:0/2782934761 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d40011830 con 0x7f5d4409fbb0 2023-09-30T22:31:02.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.215+0000 7f5d49382700 1 -- 172.21.15.40:0/2782934761 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d40011990 con 0x7f5d4409fbb0 2023-09-30T22:31:02.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.215+0000 7f5d49382700 1 -- 172.21.15.40:0/2782934761 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d40011d20 con 0x7f5d4409fbb0 2023-09-30T22:31:02.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.216+0000 7f5d4c5e8700 1 -- 172.21.15.40:0/2782934761 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d4409fbb0 msgr2=0x7f5d4406c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:02.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.216+0000 7f5d4c5e8700 1 --2- 172.21.15.40:0/2782934761 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d4409fbb0 0x7f5d4406c990 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5d40009870 tx=0x7f5d40009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:02.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.216+0000 7f5d4c5e8700 1 -- 172.21.15.40:0/2782934761 shutdown_connections 2023-09-30T22:31:02.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.216+0000 7f5d4c5e8700 1 --2- 172.21.15.40:0/2782934761 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d4409fbb0 0x7f5d4406c990 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.216+0000 7f5d4c5e8700 1 --2- 172.21.15.40:0/2782934761 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d4406ced0 0x7f5d4406d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.216+0000 7f5d4c5e8700 1 -- 172.21.15.40:0/2782934761 >> 172.21.15.40:0/2782934761 conn(0x7f5d440a41a0 msgr2=0x7f5d440a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:02.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.216+0000 7f5d4c5e8700 1 -- 172.21.15.40:0/2782934761 shutdown_connections 2023-09-30T22:31:02.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.216+0000 7f5d4c5e8700 1 -- 172.21.15.40:0/2782934761 wait complete. 2023-09-30T22:31:02.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.217+0000 7f5d4c5e8700 1 Processor -- start 2023-09-30T22:31:02.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.217+0000 7f5d4c5e8700 1 -- start start 2023-09-30T22:31:02.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.217+0000 7f5d4c5e8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d4406ced0 0x7f5d441377a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:02.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.217+0000 7f5d4c5e8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d4409fbb0 0x7f5d44137ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:02.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.217+0000 7f5d4c5e8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d44138370 0x7f5d44095be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:02.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.217+0000 7f5d4c5e8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d44138220 con 0x7f5d4406ced0 2023-09-30T22:31:02.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.217+0000 7f5d4c5e8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4406f8c0 con 0x7f5d44138370 2023-09-30T22:31:02.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.217+0000 7f5d4c5e8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d44095100 con 0x7f5d4409fbb0 2023-09-30T22:31:02.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.217+0000 7f5d4a384700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d4406ced0 0x7f5d441377a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:02.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.217+0000 7f5d49b83700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d4409fbb0 0x7f5d44137ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:02.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.217+0000 7f5d4a384700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d4406ced0 0x7f5d441377a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43036/0 (socket says 172.21.15.40:43036) 2023-09-30T22:31:02.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.217+0000 7f5d4a384700 1 -- 172.21.15.40:0/857024124 learned_addr learned my addr 172.21.15.40:0/857024124 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:02.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.217+0000 7f5d4ab85700 1 --2- 172.21.15.40:0/857024124 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d44138370 0x7f5d44095be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:02.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.218+0000 7f5d4a384700 1 -- 172.21.15.40:0/857024124 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d4409fbb0 msgr2=0x7f5d44137ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:02.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.218+0000 7f5d4a384700 1 --2- 172.21.15.40:0/857024124 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d4409fbb0 0x7f5d44137ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.218+0000 7f5d4a384700 1 -- 172.21.15.40:0/857024124 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d44138370 msgr2=0x7f5d44095be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:02.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.218+0000 7f5d4a384700 1 --2- 172.21.15.40:0/857024124 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d44138370 0x7f5d44095be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.218+0000 7f5d4a384700 1 -- 172.21.15.40:0/857024124 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d340094a0 con 0x7f5d4406ced0 2023-09-30T22:31:02.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.218+0000 7f5d4ab85700 1 --2- 172.21.15.40:0/857024124 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d44138370 0x7f5d44095be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:02.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.218+0000 7f5d49b83700 1 --2- 172.21.15.40:0/857024124 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d4409fbb0 0x7f5d44137ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:02.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.218+0000 7f5d4a384700 1 --2- 172.21.15.40:0/857024124 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d4406ced0 0x7f5d441377a0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f5d40009ed0 tx=0x7f5d40004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:02.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.218+0000 7f5d3affd700 1 -- 172.21.15.40:0/857024124 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4001a6e0 con 0x7f5d4406ced0 2023-09-30T22:31:02.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.218+0000 7f5d3affd700 1 -- 172.21.15.40:0/857024124 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4001a840 con 0x7f5d4406ced0 2023-09-30T22:31:02.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.218+0000 7f5d4c5e8700 1 -- 172.21.15.40:0/857024124 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d400094a0 con 0x7f5d4406ced0 2023-09-30T22:31:02.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.218+0000 7f5d3affd700 1 -- 172.21.15.40:0/857024124 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4001abd0 con 0x7f5d4406ced0 2023-09-30T22:31:02.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.218+0000 7f5d4c5e8700 1 -- 172.21.15.40:0/857024124 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d44094a60 con 0x7f5d4406ced0 2023-09-30T22:31:02.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.219+0000 7f5d3affd700 1 -- 172.21.15.40:0/857024124 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5d40022070 con 0x7f5d4406ced0 2023-09-30T22:31:02.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.219+0000 7f5d3affd700 1 -- 172.21.15.40:0/857024124 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5d400406a0 con 0x7f5d4406ced0 2023-09-30T22:31:02.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.219+0000 7f5d4c5e8700 1 -- 172.21.15.40:0/857024124 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d44062380 con 0x7f5d4406ced0 2023-09-30T22:31:02.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.224+0000 7f5d3affd700 1 -- 172.21.15.40:0/857024124 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5d40029080 con 0x7f5d4406ced0 2023-09-30T22:31:02.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.419+0000 7f5d4c5e8700 1 -- 172.21.15.40:0/857024124 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5d44094eb0 con 0x7f5d4406ced0 2023-09-30T22:31:02.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.419+0000 7f5d3affd700 1 -- 172.21.15.40:0/857024124 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5d4002d3b0 con 0x7f5d4406ced0 2023-09-30T22:31:02.420 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:02.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.421+0000 7f5d4c5e8700 1 -- 172.21.15.40:0/857024124 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d4406ced0 msgr2=0x7f5d441377a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:02.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.421+0000 7f5d4c5e8700 1 --2- 172.21.15.40:0/857024124 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d4406ced0 0x7f5d441377a0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f5d40009ed0 tx=0x7f5d40004750 comp rx=0 tx=0).stop 2023-09-30T22:31:02.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.421+0000 7f5d4c5e8700 1 -- 172.21.15.40:0/857024124 shutdown_connections 2023-09-30T22:31:02.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.421+0000 7f5d4c5e8700 1 --2- 172.21.15.40:0/857024124 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5d44138370 0x7f5d44095be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.421+0000 7f5d4c5e8700 1 --2- 172.21.15.40:0/857024124 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d4406ced0 0x7f5d441377a0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.421+0000 7f5d4c5e8700 1 --2- 172.21.15.40:0/857024124 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5d4409fbb0 0x7f5d44137ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:02.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.421+0000 7f5d4c5e8700 1 -- 172.21.15.40:0/857024124 >> 172.21.15.40:0/857024124 conn(0x7f5d440a41a0 msgr2=0x7f5d4409a070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:02.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.421+0000 7f5d4c5e8700 1 -- 172.21.15.40:0/857024124 shutdown_connections 2023-09-30T22:31:02.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:02.421+0000 7f5d4c5e8700 1 -- 172.21.15.40:0/857024124 wait complete. 2023-09-30T22:31:02.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:03.119 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:03.160 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:03.182 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:03.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.263+0000 7f659b19d700 1 Processor -- start 2023-09-30T22:31:03.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.263+0000 7f659b19d700 1 -- start start 2023-09-30T22:31:03.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.264+0000 7f659b19d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6594133e00 0x7f65941341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.264+0000 7f659b19d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f659409d400 0x7f659409d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.264+0000 7f659b19d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f659409dd70 0x7f659413ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.264+0000 7f659b19d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f659409ab20 con 0x7f6594133e00 2023-09-30T22:31:03.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.264+0000 7f659b19d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6594133940 con 0x7f659409d400 2023-09-30T22:31:03.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.264+0000 7f659b19d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f659409f0d0 con 0x7f659409dd70 2023-09-30T22:31:03.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.264+0000 7f6593fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f659409d400 0x7f659409d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.264+0000 7f6598f39700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6594133e00 0x7f65941341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.264+0000 7f6593fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f659409d400 0x7f659409d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54458/0 (socket says 172.21.15.40:54458) 2023-09-30T22:31:03.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.264+0000 7f6598f39700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6594133e00 0x7f65941341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35116/0 (socket says 172.21.15.40:35116) 2023-09-30T22:31:03.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.264+0000 7f6593fff700 1 -- 172.21.15.40:0/2539092425 learned_addr learned my addr 172.21.15.40:0/2539092425 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:03.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.264+0000 7f659973a700 1 --2- 172.21.15.40:0/2539092425 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f659409dd70 0x7f659413ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.264+0000 7f6598f39700 1 -- 172.21.15.40:0/2539092425 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f659409dd70 msgr2=0x7f659413ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:03.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.264+0000 7f6598f39700 1 --2- 172.21.15.40:0/2539092425 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f659409dd70 0x7f659413ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.264+0000 7f6598f39700 1 -- 172.21.15.40:0/2539092425 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f659409d400 msgr2=0x7f659409d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:03.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.264+0000 7f6598f39700 1 --2- 172.21.15.40:0/2539092425 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f659409d400 0x7f659409d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.264+0000 7f6598f39700 1 -- 172.21.15.40:0/2539092425 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6594133be0 con 0x7f6594133e00 2023-09-30T22:31:03.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.264+0000 7f6593fff700 1 --2- 172.21.15.40:0/2539092425 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f659409d400 0x7f659409d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:03.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.265+0000 7f6598f39700 1 --2- 172.21.15.40:0/2539092425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6594133e00 0x7f65941341d0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f6588009840 tx=0x7f6588009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a553182d4f66bac7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:03.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.265+0000 7f65937fe700 1 -- 172.21.15.40:0/2539092425 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6588011830 con 0x7f6594133e00 2023-09-30T22:31:03.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.265+0000 7f65937fe700 1 -- 172.21.15.40:0/2539092425 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6588011990 con 0x7f6594133e00 2023-09-30T22:31:03.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.265+0000 7f65937fe700 1 -- 172.21.15.40:0/2539092425 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6588011d20 con 0x7f6594133e00 2023-09-30T22:31:03.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.265+0000 7f659b19d700 1 -- 172.21.15.40:0/2539092425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6594133e00 msgr2=0x7f65941341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:03.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.266+0000 7f659b19d700 1 --2- 172.21.15.40:0/2539092425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6594133e00 0x7f65941341d0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f6588009840 tx=0x7f6588009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:03.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.266+0000 7f659b19d700 1 -- 172.21.15.40:0/2539092425 shutdown_connections 2023-09-30T22:31:03.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.266+0000 7f659b19d700 1 --2- 172.21.15.40:0/2539092425 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f659409dd70 0x7f659413ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.266+0000 7f659b19d700 1 --2- 172.21.15.40:0/2539092425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6594133e00 0x7f65941341d0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.266+0000 7f659b19d700 1 --2- 172.21.15.40:0/2539092425 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f659409d400 0x7f659409d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.266+0000 7f659b19d700 1 -- 172.21.15.40:0/2539092425 >> 172.21.15.40:0/2539092425 conn(0x7f65940a2a00 msgr2=0x7f65940a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:03.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.266+0000 7f659b19d700 1 -- 172.21.15.40:0/2539092425 shutdown_connections 2023-09-30T22:31:03.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.266+0000 7f659b19d700 1 -- 172.21.15.40:0/2539092425 wait complete. 2023-09-30T22:31:03.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.267+0000 7f659b19d700 1 Processor -- start 2023-09-30T22:31:03.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.267+0000 7f659b19d700 1 -- start start 2023-09-30T22:31:03.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.268+0000 7f659b19d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f659409d400 0x7f659412fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.268+0000 7f659b19d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f659409dd70 0x7f6594130300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.268+0000 7f659b19d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6594133e00 0x7f6594130840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.268+0000 7f659b19d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659411b1a0 con 0x7f659409d400 2023-09-30T22:31:03.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.268+0000 7f659b19d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6594119680 con 0x7f659409dd70 2023-09-30T22:31:03.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.268+0000 7f659b19d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f659411bdb0 con 0x7f6594133e00 2023-09-30T22:31:03.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.268+0000 7f6598f39700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f659409d400 0x7f659412fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.268+0000 7f6598f39700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f659409d400 0x7f659412fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35118/0 (socket says 172.21.15.40:35118) 2023-09-30T22:31:03.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.268+0000 7f6598f39700 1 -- 172.21.15.40:0/4168213921 learned_addr learned my addr 172.21.15.40:0/4168213921 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:03.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.268+0000 7f6593fff700 1 --2- 172.21.15.40:0/4168213921 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f659409dd70 0x7f6594130300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.268+0000 7f659973a700 1 --2- 172.21.15.40:0/4168213921 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6594133e00 0x7f6594130840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.268+0000 7f6598f39700 1 -- 172.21.15.40:0/4168213921 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6594133e00 msgr2=0x7f6594130840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:03.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.268+0000 7f6598f39700 1 --2- 172.21.15.40:0/4168213921 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6594133e00 0x7f6594130840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.268+0000 7f6598f39700 1 -- 172.21.15.40:0/4168213921 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f659409dd70 msgr2=0x7f6594130300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:03.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.268+0000 7f6598f39700 1 --2- 172.21.15.40:0/4168213921 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f659409dd70 0x7f6594130300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.268+0000 7f6598f39700 1 -- 172.21.15.40:0/4168213921 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6580009550 con 0x7f659409d400 2023-09-30T22:31:03.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.269+0000 7f6598f39700 1 --2- 172.21.15.40:0/4168213921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f659409d400 0x7f659412fdc0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f65880090b0 tx=0x7f6588004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:03.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.269+0000 7f65917fa700 1 -- 172.21.15.40:0/4168213921 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6588004240 con 0x7f659409d400 2023-09-30T22:31:03.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.269+0000 7f65917fa700 1 -- 172.21.15.40:0/4168213921 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658801f070 con 0x7f659409d400 2023-09-30T22:31:03.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.269+0000 7f65917fa700 1 -- 172.21.15.40:0/4168213921 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65880036a0 con 0x7f659409d400 2023-09-30T22:31:03.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.269+0000 7f659b19d700 1 -- 172.21.15.40:0/4168213921 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65880094a0 con 0x7f659409d400 2023-09-30T22:31:03.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.269+0000 7f659b19d700 1 -- 172.21.15.40:0/4168213921 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f659411a7c0 con 0x7f659409d400 2023-09-30T22:31:03.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.270+0000 7f65917fa700 1 -- 172.21.15.40:0/4168213921 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6588021030 con 0x7f659409d400 2023-09-30T22:31:03.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.270+0000 7f65917fa700 1 -- 172.21.15.40:0/4168213921 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6588040610 con 0x7f659409d400 2023-09-30T22:31:03.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.270+0000 7f659b19d700 1 -- 172.21.15.40:0/4168213921 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6594062380 con 0x7f659409d400 2023-09-30T22:31:03.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.279+0000 7f65917fa700 1 -- 172.21.15.40:0/4168213921 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6588015020 con 0x7f659409d400 2023-09-30T22:31:03.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.305+0000 7fb9b6320700 1 Processor -- start 2023-09-30T22:31:03.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.305+0000 7fb9b6320700 1 -- start start 2023-09-30T22:31:03.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.305+0000 7fb9b6320700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9b0134a90 0x7fb9b0136e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.305+0000 7fb9b6320700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9b01373b0 0x7fb9b0139790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.305+0000 7fb9b6320700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9b0131900 con 0x7fb9b0131d50 2023-09-30T22:31:03.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.305+0000 7fb9b6320700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b00719e0 con 0x7fb9b01373b0 2023-09-30T22:31:03.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.305+0000 7fb9b6320700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b009e820 con 0x7fb9b0134a90 2023-09-30T22:31:03.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.305+0000 7fb9affff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb9b0131d50 0x7fb9b0132120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41914/0 (socket says 172.21.15.40:41914) 2023-09-30T22:31:03.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.305+0000 7fb9affff700 1 -- 172.21.15.40:0/1340102622 learned_addr learned my addr 172.21.15.40:0/1340102622 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:03.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.305+0000 7fb9af7fe700 1 --2- 172.21.15.40:0/1340102622 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9b0134a90 0x7fb9b0136e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.305+0000 7fb9b48bd700 1 --2- 172.21.15.40:0/1340102622 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9b01373b0 0x7fb9b0139790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.306+0000 7fb9b48bd700 1 -- 172.21.15.40:0/1340102622 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9b0134a90 msgr2=0x7fb9b0136e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:03.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.306+0000 7fb9aeffd700 1 -- 172.21.15.40:0/1340102622 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3879036327 0 0) 0x7fb9b0131900 con 0x7fb9b0131d50 2023-09-30T22:31:03.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.306+0000 7fb9b48bd700 1 --2- 172.21.15.40:0/1340102622 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9b0134a90 0x7fb9b0136e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.306+0000 7fb9b48bd700 1 -- 172.21.15.40:0/1340102622 >> v1:172.21.15.40:6789/0 conn(0x7fb9b0131d50 legacy=0x7fb9b0132120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:03.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.306+0000 7fb9b48bd700 1 -- 172.21.15.40:0/1340102622 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b009ef60 con 0x7fb9b01373b0 2023-09-30T22:31:03.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.306+0000 7fb9af7fe700 1 --2- 172.21.15.40:0/1340102622 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9b0134a90 0x7fb9b0136e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:03.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.306+0000 7fb9b48bd700 1 --2- 172.21.15.40:0/1340102622 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9b01373b0 0x7fb9b0139790 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8009dc0 tx=0x7fb9a800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2043ef2217022a39 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:03.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.306+0000 7fb9aeffd700 1 -- 172.21.15.40:0/1340102622 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a800e070 con 0x7fb9b01373b0 2023-09-30T22:31:03.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.306+0000 7fb9aeffd700 1 -- 172.21.15.40:0/1340102622 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a800bb20 con 0x7fb9b01373b0 2023-09-30T22:31:03.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.306+0000 7fb9aeffd700 1 -- 172.21.15.40:0/1340102622 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a8012430 con 0x7fb9b01373b0 2023-09-30T22:31:03.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.307+0000 7fb9b6320700 1 -- 172.21.15.40:0/1340102622 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9b01373b0 msgr2=0x7fb9b0139790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:03.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.307+0000 7fb9b6320700 1 --2- 172.21.15.40:0/1340102622 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9b01373b0 0x7fb9b0139790 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8009dc0 tx=0x7fb9a800b330 comp rx=0 tx=0).stop 2023-09-30T22:31:03.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.307+0000 7fb9b6320700 1 -- 172.21.15.40:0/1340102622 shutdown_connections 2023-09-30T22:31:03.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.307+0000 7fb9b6320700 1 --2- 172.21.15.40:0/1340102622 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9b01373b0 0x7fb9b0139790 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.307+0000 7fb9b6320700 1 --2- 172.21.15.40:0/1340102622 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9b0134a90 0x7fb9b0136e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.307+0000 7fb9b6320700 1 -- 172.21.15.40:0/1340102622 >> 172.21.15.40:0/1340102622 conn(0x7fb9b00a2a00 msgr2=0x7fb9b00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:03.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.307+0000 7fb9b6320700 1 -- 172.21.15.40:0/1340102622 shutdown_connections 2023-09-30T22:31:03.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.307+0000 7fb9b6320700 1 -- 172.21.15.40:0/1340102622 wait complete. 2023-09-30T22:31:03.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.308+0000 7fb9b6320700 1 Processor -- start 2023-09-30T22:31:03.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.308+0000 7fb9b6320700 1 -- start start 2023-09-30T22:31:03.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.308+0000 7fb9b6320700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9b0131d50 0x7fb9b0119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.308+0000 7fb9b6320700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9b0134a90 0x7fb9b0119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.308+0000 7fb9b6320700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9b01373b0 0x7fb9b0119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.308+0000 7fb9b6320700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b011c8f0 con 0x7fb9b01373b0 2023-09-30T22:31:03.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.308+0000 7fb9b6320700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b0132ba0 con 0x7fb9b0131d50 2023-09-30T22:31:03.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.308+0000 7fb9b6320700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b009ea60 con 0x7fb9b0134a90 2023-09-30T22:31:03.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.309+0000 7fb9affff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9b0131d50 0x7fb9b0119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.309+0000 7fb9b48bd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9b01373b0 0x7fb9b0119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.309+0000 7fb9af7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9b0134a90 0x7fb9b0119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.309+0000 7fb9affff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9b0131d50 0x7fb9b0119050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54490/0 (socket says 172.21.15.40:54490) 2023-09-30T22:31:03.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.309+0000 7fb9affff700 1 -- 172.21.15.40:0/4159862430 learned_addr learned my addr 172.21.15.40:0/4159862430 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:03.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.309+0000 7fb9af7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9b0134a90 0x7fb9b0119590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55220/0 (socket says 172.21.15.40:55220) 2023-09-30T22:31:03.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.309+0000 7fb9af7fe700 1 -- 172.21.15.40:0/4159862430 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9b0131d50 msgr2=0x7fb9b0119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:03.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.309+0000 7fb9af7fe700 1 --2- 172.21.15.40:0/4159862430 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9b0131d50 0x7fb9b0119050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.309+0000 7fb9af7fe700 1 -- 172.21.15.40:0/4159862430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9b01373b0 msgr2=0x7fb9b0119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:03.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.309+0000 7fb9af7fe700 1 --2- 172.21.15.40:0/4159862430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9b01373b0 0x7fb9b0119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.309+0000 7fb9af7fe700 1 -- 172.21.15.40:0/4159862430 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a40094a0 con 0x7fb9b0134a90 2023-09-30T22:31:03.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.309+0000 7fb9affff700 1 --2- 172.21.15.40:0/4159862430 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9b0131d50 0x7fb9b0119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:03.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.309+0000 7fb9b48bd700 1 --2- 172.21.15.40:0/4159862430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9b01373b0 0x7fb9b0119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:03.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.309+0000 7fb9af7fe700 1 --2- 172.21.15.40:0/4159862430 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9b0134a90 0x7fb9b0119590 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fb9a400e9b0 tx=0x7fb9a400ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:03.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.309+0000 7fb9acff9700 1 -- 172.21.15.40:0/4159862430 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a400ee50 con 0x7fb9b0134a90 2023-09-30T22:31:03.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.309+0000 7fb9acff9700 1 -- 172.21.15.40:0/4159862430 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a400c850 con 0x7fb9b0134a90 2023-09-30T22:31:03.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.309+0000 7fb9acff9700 1 -- 172.21.15.40:0/4159862430 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a400cc00 con 0x7fb9b0134a90 2023-09-30T22:31:03.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.309+0000 7fb9b6320700 1 -- 172.21.15.40:0/4159862430 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9a8009a70 con 0x7fb9b0134a90 2023-09-30T22:31:03.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.309+0000 7fb9b6320700 1 -- 172.21.15.40:0/4159862430 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b011c350 con 0x7fb9b0134a90 2023-09-30T22:31:03.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.311+0000 7fb9b6320700 1 -- 172.21.15.40:0/4159862430 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b0062380 con 0x7fb9b0134a90 2023-09-30T22:31:03.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.311+0000 7fb9acff9700 1 -- 172.21.15.40:0/4159862430 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb9a4013470 con 0x7fb9b0134a90 2023-09-30T22:31:03.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.311+0000 7fb9acff9700 1 -- 172.21.15.40:0/4159862430 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb9a403fac0 con 0x7fb9b0134a90 2023-09-30T22:31:03.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.316+0000 7fb9acff9700 1 -- 172.21.15.40:0/4159862430 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb9a4013720 con 0x7fb9b0134a90 2023-09-30T22:31:03.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.342+0000 7f02a1e08700 1 Processor -- start 2023-09-30T22:31:03.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.342+0000 7f02a1e08700 1 -- start start 2023-09-30T22:31:03.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.343+0000 7f02a1e08700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f029c131d50 0x7f029c132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.343+0000 7f02a1e08700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f029c09c7d0 0x7f029c139ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.343+0000 7f02a1e08700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f029c132660 con 0x7f029c09bc50 2023-09-30T22:31:03.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.343+0000 7f02a1e08700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f029c0719b0 con 0x7f029c09c7d0 2023-09-30T22:31:03.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.343+0000 7f02a1e08700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029c131900 con 0x7f029c131d50 2023-09-30T22:31:03.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.343+0000 7f029b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f029c131d50 0x7f029c132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.343+0000 7f029b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f029c131d50 0x7f029c132120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54498/0 (socket says 172.21.15.40:54498) 2023-09-30T22:31:03.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.343+0000 7f029bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f029c09c7d0 0x7f029c139ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.343+0000 7f029b7fe700 1 -- 172.21.15.40:0/2007253005 learned_addr learned my addr 172.21.15.40:0/2007253005 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:03.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.344+0000 7f029b7fe700 1 -- 172.21.15.40:0/2007253005 >> v2:172.21.15.40:3300/0 conn(0x7f029c09c7d0 msgr2=0x7f029c139ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:03.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.344+0000 7f029b7fe700 1 --2- 172.21.15.40:0/2007253005 >> v2:172.21.15.40:3300/0 conn(0x7f029c09c7d0 0x7f029c139ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.344+0000 7f029b7fe700 1 -- 172.21.15.40:0/2007253005 >> v1:172.21.15.40:6789/0 conn(0x7f029c09bc50 legacy=0x7f029c09c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:03.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.344+0000 7f029b7fe700 1 -- 172.21.15.40:0/2007253005 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029c09e820 con 0x7f029c131d50 2023-09-30T22:31:03.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.344+0000 7f029bfff700 1 --2- 172.21.15.40:0/2007253005 >> v2:172.21.15.40:3300/0 conn(0x7f029c09c7d0 0x7f029c139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:03.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.344+0000 7f029b7fe700 1 --2- 172.21.15.40:0/2007253005 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f029c131d50 0x7f029c132120 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f028c0098f0 tx=0x7f028c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e8e227990bcd373 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:03.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.344+0000 7f029affd700 1 -- 172.21.15.40:0/2007253005 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028c011830 con 0x7f029c131d50 2023-09-30T22:31:03.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.344+0000 7f029affd700 1 -- 172.21.15.40:0/2007253005 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028c011990 con 0x7f029c131d50 2023-09-30T22:31:03.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.344+0000 7f029affd700 1 -- 172.21.15.40:0/2007253005 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028c011d20 con 0x7f029c131d50 2023-09-30T22:31:03.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.345+0000 7f02a1e08700 1 -- 172.21.15.40:0/2007253005 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f029c131d50 msgr2=0x7f029c132120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:03.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.345+0000 7f02a1e08700 1 --2- 172.21.15.40:0/2007253005 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f029c131d50 0x7f029c132120 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f028c0098f0 tx=0x7f028c009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:03.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.345+0000 7f02a1e08700 1 -- 172.21.15.40:0/2007253005 shutdown_connections 2023-09-30T22:31:03.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.345+0000 7f02a1e08700 1 --2- 172.21.15.40:0/2007253005 >> v2:172.21.15.40:3300/0 conn(0x7f029c09c7d0 0x7f029c139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.345+0000 7f02a1e08700 1 --2- 172.21.15.40:0/2007253005 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f029c131d50 0x7f029c132120 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.345+0000 7f02a1e08700 1 -- 172.21.15.40:0/2007253005 >> 172.21.15.40:0/2007253005 conn(0x7f029c0a2a00 msgr2=0x7f029c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:03.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.345+0000 7f02a1e08700 1 -- 172.21.15.40:0/2007253005 shutdown_connections 2023-09-30T22:31:03.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.345+0000 7f02a1e08700 1 -- 172.21.15.40:0/2007253005 wait complete. 2023-09-30T22:31:03.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.346+0000 7f02a1e08700 1 Processor -- start 2023-09-30T22:31:03.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.346+0000 7f02a1e08700 1 -- start start 2023-09-30T22:31:03.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.347+0000 7f02a1e08700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f029c09bc50 0x7f029c11bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.347+0000 7f02a1e08700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f029c09c7d0 0x7f029c11c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.347+0000 7f02a1e08700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f029c131d50 0x7f029c11c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.347+0000 7f02a1e08700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029c11ef50 con 0x7f029c09c7d0 2023-09-30T22:31:03.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.347+0000 7f02a1e08700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029c0a0010 con 0x7f029c131d50 2023-09-30T22:31:03.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.347+0000 7f02a1e08700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f029c11e6d0 con 0x7f029c09bc50 2023-09-30T22:31:03.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.347+0000 7f029b7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f029c09bc50 0x7f029c11bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.347+0000 7f029b7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f029c09bc50 0x7f029c11bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55222/0 (socket says 172.21.15.40:55222) 2023-09-30T22:31:03.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.347+0000 7f029b7fe700 1 -- 172.21.15.40:0/1604394606 learned_addr learned my addr 172.21.15.40:0/1604394606 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:03.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.347+0000 7f0293fff700 1 --2- 172.21.15.40:0/1604394606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f029c09c7d0 0x7f029c11c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.347+0000 7f029bfff700 1 --2- 172.21.15.40:0/1604394606 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f029c131d50 0x7f029c11c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.347+0000 7f029b7fe700 1 -- 172.21.15.40:0/1604394606 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f029c131d50 msgr2=0x7f029c11c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:03.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.347+0000 7f029b7fe700 1 --2- 172.21.15.40:0/1604394606 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f029c131d50 0x7f029c11c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.347+0000 7f029b7fe700 1 -- 172.21.15.40:0/1604394606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f029c09c7d0 msgr2=0x7f029c11c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:03.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.347+0000 7f029b7fe700 1 --2- 172.21.15.40:0/1604394606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f029c09c7d0 0x7f029c11c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.347+0000 7f029b7fe700 1 -- 172.21.15.40:0/1604394606 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0294009a70 con 0x7f029c09bc50 2023-09-30T22:31:03.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.348+0000 7f029b7fe700 1 --2- 172.21.15.40:0/1604394606 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f029c09bc50 0x7f029c11bcf0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f028c000c00 tx=0x7f028c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:03.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.348+0000 7f0298ff9700 1 -- 172.21.15.40:0/1604394606 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028c0045d0 con 0x7f029c09bc50 2023-09-30T22:31:03.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.348+0000 7f0298ff9700 1 -- 172.21.15.40:0/1604394606 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028c01e7d0 con 0x7f029c09bc50 2023-09-30T22:31:03.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.348+0000 7f02a1e08700 1 -- 172.21.15.40:0/1604394606 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f028c009550 con 0x7f029c09bc50 2023-09-30T22:31:03.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.348+0000 7f0298ff9700 1 -- 172.21.15.40:0/1604394606 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028c01eb80 con 0x7f029c09bc50 2023-09-30T22:31:03.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.348+0000 7f02a1e08700 1 -- 172.21.15.40:0/1604394606 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f029c11fcc0 con 0x7f029c09bc50 2023-09-30T22:31:03.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.349+0000 7f0298ff9700 1 -- 172.21.15.40:0/1604394606 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f028c01ece0 con 0x7f029c09bc50 2023-09-30T22:31:03.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.349+0000 7f0298ff9700 1 -- 172.21.15.40:0/1604394606 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f028c044c60 con 0x7f029c09bc50 2023-09-30T22:31:03.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.349+0000 7f02a1e08700 1 -- 172.21.15.40:0/1604394606 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f029c09ea60 con 0x7f029c09bc50 2023-09-30T22:31:03.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.354+0000 7f0298ff9700 1 -- 172.21.15.40:0/1604394606 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f028c015070 con 0x7f029c09bc50 2023-09-30T22:31:03.434 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:03.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.497+0000 7f659b19d700 1 -- 172.21.15.40:0/4168213921 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6594074330 con 0x7f659409d400 2023-09-30T22:31:03.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.498+0000 7f65917fa700 1 -- 172.21.15.40:0/4168213921 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f65880239c0 con 0x7f659409d400 2023-09-30T22:31:03.499 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:03.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.500+0000 7f659b19d700 1 -- 172.21.15.40:0/4168213921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f659409d400 msgr2=0x7f659412fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:03.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.500+0000 7f659b19d700 1 --2- 172.21.15.40:0/4168213921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f659409d400 0x7f659412fdc0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f65880090b0 tx=0x7f6588004750 comp rx=0 tx=0).stop 2023-09-30T22:31:03.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.500+0000 7f659b19d700 1 -- 172.21.15.40:0/4168213921 shutdown_connections 2023-09-30T22:31:03.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.500+0000 7f659b19d700 1 --2- 172.21.15.40:0/4168213921 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6594133e00 0x7f6594130840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.500+0000 7f659b19d700 1 --2- 172.21.15.40:0/4168213921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f659409d400 0x7f659412fdc0 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.500+0000 7f659b19d700 1 --2- 172.21.15.40:0/4168213921 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f659409dd70 0x7f6594130300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.500+0000 7f659b19d700 1 -- 172.21.15.40:0/4168213921 >> 172.21.15.40:0/4168213921 conn(0x7f65940a2a00 msgr2=0x7f659409b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:03.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.500+0000 7f659b19d700 1 -- 172.21.15.40:0/4168213921 shutdown_connections 2023-09-30T22:31:03.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.500+0000 7f659b19d700 1 -- 172.21.15.40:0/4168213921 wait complete. 2023-09-30T22:31:03.513 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:03.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.535+0000 7fb9b6320700 1 -- 172.21.15.40:0/4159862430 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb9b011b1d0 con 0x7fb9b0134a90 2023-09-30T22:31:03.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.535+0000 7fb9acff9700 1 -- 172.21.15.40:0/4159862430 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb9a4021020 con 0x7fb9b0134a90 2023-09-30T22:31:03.536 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:03.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.538+0000 7fb9b6320700 1 -- 172.21.15.40:0/4159862430 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9b0134a90 msgr2=0x7fb9b0119590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:03.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.538+0000 7fb9b6320700 1 --2- 172.21.15.40:0/4159862430 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9b0134a90 0x7fb9b0119590 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fb9a400e9b0 tx=0x7fb9a400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.538+0000 7fb9b6320700 1 -- 172.21.15.40:0/4159862430 shutdown_connections 2023-09-30T22:31:03.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.538+0000 7fb9b6320700 1 --2- 172.21.15.40:0/4159862430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9b01373b0 0x7fb9b0119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.538+0000 7fb9b6320700 1 --2- 172.21.15.40:0/4159862430 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9b0131d50 0x7fb9b0119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.538+0000 7fb9b6320700 1 --2- 172.21.15.40:0/4159862430 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9b0134a90 0x7fb9b0119590 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.538+0000 7fb9b6320700 1 -- 172.21.15.40:0/4159862430 >> 172.21.15.40:0/4159862430 conn(0x7fb9b00a2a00 msgr2=0x7fb9b0134e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:03.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.538+0000 7fb9b6320700 1 -- 172.21.15.40:0/4159862430 shutdown_connections 2023-09-30T22:31:03.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.538+0000 7fb9b6320700 1 -- 172.21.15.40:0/4159862430 wait complete. 2023-09-30T22:31:03.551 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:03.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.556+0000 7f02a1e08700 1 -- 172.21.15.40:0/1604394606 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f029c062380 con 0x7f029c09bc50 2023-09-30T22:31:03.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.556+0000 7f0298ff9700 1 -- 172.21.15.40:0/1604394606 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f028c030360 con 0x7f029c09bc50 2023-09-30T22:31:03.557 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:03.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.558+0000 7f02a1e08700 1 -- 172.21.15.40:0/1604394606 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f029c09bc50 msgr2=0x7f029c11bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:03.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.558+0000 7f02a1e08700 1 --2- 172.21.15.40:0/1604394606 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f029c09bc50 0x7f029c11bcf0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f028c000c00 tx=0x7f028c004750 comp rx=0 tx=0).stop 2023-09-30T22:31:03.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.558+0000 7f02a1e08700 1 -- 172.21.15.40:0/1604394606 shutdown_connections 2023-09-30T22:31:03.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.558+0000 7f02a1e08700 1 --2- 172.21.15.40:0/1604394606 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f029c09bc50 0x7f029c11bcf0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.558+0000 7f02a1e08700 1 --2- 172.21.15.40:0/1604394606 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f029c131d50 0x7f029c11c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.558+0000 7f02a1e08700 1 --2- 172.21.15.40:0/1604394606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f029c09c7d0 0x7f029c11c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.558+0000 7f02a1e08700 1 -- 172.21.15.40:0/1604394606 >> 172.21.15.40:0/1604394606 conn(0x7f029c0a2a00 msgr2=0x7f029c0702a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:03.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.558+0000 7f02a1e08700 1 -- 172.21.15.40:0/1604394606 shutdown_connections 2023-09-30T22:31:03.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.558+0000 7f02a1e08700 1 -- 172.21.15.40:0/1604394606 wait complete. 2023-09-30T22:31:03.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.566+0000 7f8d7cbf3700 1 Processor -- start 2023-09-30T22:31:03.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.567+0000 7f8d7cbf3700 1 -- start start 2023-09-30T22:31:03.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.567+0000 7f8d7cbf3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8d7806f3a0 0x7f8d7806c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.567+0000 7f8d7cbf3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8d7809fbb0 0x7f8d7806ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.567+0000 7f8d7cbf3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d780a0780 con 0x7f8d7806d410 2023-09-30T22:31:03.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.567+0000 7f8d7cbf3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7809ff80 con 0x7f8d7806f3a0 2023-09-30T22:31:03.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.567+0000 7f8d7cbf3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d780a0590 con 0x7f8d7809fbb0 2023-09-30T22:31:03.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.567+0000 7f8d6dd9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8d7809fbb0 0x7f8d7806ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.567+0000 7f8d7659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8d7806f3a0 0x7f8d7806c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.567+0000 7f8d6dd9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8d7809fbb0 0x7f8d7806ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55238/0 (socket says 172.21.15.40:55238) 2023-09-30T22:31:03.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.567+0000 7f8d6dd9b700 1 -- 172.21.15.40:0/1807540081 learned_addr learned my addr 172.21.15.40:0/1807540081 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:03.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.568+0000 7f8d6dd9b700 1 -- 172.21.15.40:0/1807540081 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8d7806f3a0 msgr2=0x7f8d7806c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:03.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.568+0000 7f8d6dd9b700 1 --2- 172.21.15.40:0/1807540081 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8d7806f3a0 0x7f8d7806c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.568+0000 7f8d6dd9b700 1 -- 172.21.15.40:0/1807540081 >> v1:172.21.15.40:6789/0 conn(0x7f8d7806d410 legacy=0x7f8d7813a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:03.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.568+0000 7f8d6dd9b700 1 -- 172.21.15.40:0/1807540081 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7806df90 con 0x7f8d7809fbb0 2023-09-30T22:31:03.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.568+0000 7f8d6dd9b700 1 --2- 172.21.15.40:0/1807540081 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8d7809fbb0 0x7f8d7806ced0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f8d60009950 tx=0x7f8d60009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd9f99c69bd66a49 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:03.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.568+0000 7f8d75d9b700 1 -- 172.21.15.40:0/1807540081 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d60011830 con 0x7f8d7809fbb0 2023-09-30T22:31:03.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.568+0000 7f8d75d9b700 1 -- 172.21.15.40:0/1807540081 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d60011990 con 0x7f8d7809fbb0 2023-09-30T22:31:03.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.568+0000 7f8d75d9b700 1 -- 172.21.15.40:0/1807540081 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d60011d40 con 0x7f8d7809fbb0 2023-09-30T22:31:03.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.569+0000 7f8d7cbf3700 1 -- 172.21.15.40:0/1807540081 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8d7809fbb0 msgr2=0x7f8d7806ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:03.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.569+0000 7f8d7cbf3700 1 --2- 172.21.15.40:0/1807540081 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8d7809fbb0 0x7f8d7806ced0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f8d60009950 tx=0x7f8d60009c60 comp rx=0 tx=0).stop 2023-09-30T22:31:03.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.569+0000 7f8d7cbf3700 1 -- 172.21.15.40:0/1807540081 shutdown_connections 2023-09-30T22:31:03.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.569+0000 7f8d7cbf3700 1 --2- 172.21.15.40:0/1807540081 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8d7806f3a0 0x7f8d7806c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.569+0000 7f8d7cbf3700 1 --2- 172.21.15.40:0/1807540081 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8d7809fbb0 0x7f8d7806ced0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.569+0000 7f8d7cbf3700 1 -- 172.21.15.40:0/1807540081 >> 172.21.15.40:0/1807540081 conn(0x7f8d780a41a0 msgr2=0x7f8d780a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:03.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.569+0000 7f8d7cbf3700 1 -- 172.21.15.40:0/1807540081 shutdown_connections 2023-09-30T22:31:03.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.569+0000 7f8d7cbf3700 1 -- 172.21.15.40:0/1807540081 wait complete. 2023-09-30T22:31:03.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.570+0000 7f8d7cbf3700 1 Processor -- start 2023-09-30T22:31:03.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.570+0000 7f8d7cbf3700 1 -- start start 2023-09-30T22:31:03.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.571+0000 7f8d7cbf3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d7806d410 0x7f8d7808f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.571+0000 7f8d7cbf3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8d7806f3a0 0x7f8d7808f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.571+0000 7f8d7cbf3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8d7809fbb0 0x7f8d7808fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:03.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.571+0000 7f8d7cbf3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d78071eb0 con 0x7f8d7806d410 2023-09-30T22:31:03.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.571+0000 7f8d7cbf3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7813b4e0 con 0x7f8d7809fbb0 2023-09-30T22:31:03.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.571+0000 7f8d7cbf3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d780915c0 con 0x7f8d7806f3a0 2023-09-30T22:31:03.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.571+0000 7f8d7659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d7806d410 0x7f8d7808f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.571+0000 7f8d76d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8d7809fbb0 0x7f8d7808fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:03.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.571+0000 7f8d7659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d7806d410 0x7f8d7808f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35148/0 (socket says 172.21.15.40:35148) 2023-09-30T22:31:03.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.571+0000 7f8d7659c700 1 -- 172.21.15.40:0/3448212287 learned_addr learned my addr 172.21.15.40:0/3448212287 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:03.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.571+0000 7f8d7659c700 1 -- 172.21.15.40:0/3448212287 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8d7806f3a0 msgr2=0x7f8d7808f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:03.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.571+0000 7f8d7659c700 1 --2- 172.21.15.40:0/3448212287 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8d7806f3a0 0x7f8d7808f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.571+0000 7f8d7659c700 1 -- 172.21.15.40:0/3448212287 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8d7809fbb0 msgr2=0x7f8d7808fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:03.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.571+0000 7f8d7659c700 1 --2- 172.21.15.40:0/3448212287 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8d7809fbb0 0x7f8d7808fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.571+0000 7f8d7659c700 1 -- 172.21.15.40:0/3448212287 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d60009550 con 0x7f8d7806d410 2023-09-30T22:31:03.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.571+0000 7f8d76d9d700 1 --2- 172.21.15.40:0/3448212287 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8d7809fbb0 0x7f8d7808fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:03.575 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:03.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.571+0000 7f8d7659c700 1 --2- 172.21.15.40:0/3448212287 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d7806d410 0x7f8d7808f3e0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f8d6800e870 tx=0x7f8d6800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:03.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.571+0000 7f8d6f7fe700 1 -- 172.21.15.40:0/3448212287 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d68009590 con 0x7f8d7806d410 2023-09-30T22:31:03.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.571+0000 7f8d6f7fe700 1 -- 172.21.15.40:0/3448212287 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d68013680 con 0x7f8d7806d410 2023-09-30T22:31:03.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.571+0000 7f8d6f7fe700 1 -- 172.21.15.40:0/3448212287 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d680139f0 con 0x7f8d7806d410 2023-09-30T22:31:03.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.571+0000 7f8d7cbf3700 1 -- 172.21.15.40:0/3448212287 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d780917f0 con 0x7f8d7806d410 2023-09-30T22:31:03.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.571+0000 7f8d7cbf3700 1 -- 172.21.15.40:0/3448212287 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d7813b840 con 0x7f8d7806d410 2023-09-30T22:31:03.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.572+0000 7f8d6f7fe700 1 -- 172.21.15.40:0/3448212287 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8d68013b50 con 0x7f8d7806d410 2023-09-30T22:31:03.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.572+0000 7f8d6f7fe700 1 -- 172.21.15.40:0/3448212287 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f8d6803f770 con 0x7f8d7806d410 2023-09-30T22:31:03.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.572+0000 7f8d7cbf3700 1 -- 172.21.15.40:0/3448212287 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d78062380 con 0x7f8d7806d410 2023-09-30T22:31:03.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.577+0000 7f8d6f7fe700 1 -- 172.21.15.40:0/3448212287 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8d68021080 con 0x7f8d7806d410 2023-09-30T22:31:03.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.775+0000 7f8d7cbf3700 1 -- 172.21.15.40:0/3448212287 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8d7806e3c0 con 0x7f8d7806d410 2023-09-30T22:31:03.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.775+0000 7f8d6f7fe700 1 -- 172.21.15.40:0/3448212287 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8d68017020 con 0x7f8d7806d410 2023-09-30T22:31:03.776 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:03.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.777+0000 7f8d7cbf3700 1 -- 172.21.15.40:0/3448212287 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d7806d410 msgr2=0x7f8d7808f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:03.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.777+0000 7f8d7cbf3700 1 --2- 172.21.15.40:0/3448212287 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d7806d410 0x7f8d7808f3e0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f8d6800e870 tx=0x7f8d6800eb80 comp rx=0 tx=0).stop 2023-09-30T22:31:03.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.777+0000 7f8d7cbf3700 1 -- 172.21.15.40:0/3448212287 shutdown_connections 2023-09-30T22:31:03.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.777+0000 7f8d7cbf3700 1 --2- 172.21.15.40:0/3448212287 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8d7809fbb0 0x7f8d7808fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.777+0000 7f8d7cbf3700 1 --2- 172.21.15.40:0/3448212287 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d7806d410 0x7f8d7808f3e0 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.777+0000 7f8d7cbf3700 1 --2- 172.21.15.40:0/3448212287 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8d7806f3a0 0x7f8d7808f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:03.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.777+0000 7f8d7cbf3700 1 -- 172.21.15.40:0/3448212287 >> 172.21.15.40:0/3448212287 conn(0x7f8d780a41a0 msgr2=0x7f8d7806f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:03.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.777+0000 7f8d7cbf3700 1 -- 172.21.15.40:0/3448212287 shutdown_connections 2023-09-30T22:31:03.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:03.777+0000 7f8d7cbf3700 1 -- 172.21.15.40:0/3448212287 wait complete. 2023-09-30T22:31:03.790 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:04.514 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:04.552 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:04.576 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:04.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.662+0000 7fd55f94c700 1 Processor -- start 2023-09-30T22:31:04.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.662+0000 7fd55f94c700 1 -- start start 2023-09-30T22:31:04.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.662+0000 7fd55f94c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd55809fbb0 0x7fd55806c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:04.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.662+0000 7fd55f94c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd55806ced0 0x7fd55806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:04.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.662+0000 7fd55f94c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd55806d800 con 0x7fd558138370 2023-09-30T22:31:04.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.663+0000 7fd55f94c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd55809ff80 con 0x7fd55806ced0 2023-09-30T22:31:04.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.663+0000 7fd55f94c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd55806da80 con 0x7fd55809fbb0 2023-09-30T22:31:04.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.663+0000 7fd55d6e8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd55809fbb0 0x7fd55806c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:04.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.663+0000 7fd55dee9700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd558138370 0x7fd55813a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41948/0 (socket says 172.21.15.40:41948) 2023-09-30T22:31:04.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.663+0000 7fd55dee9700 1 -- 172.21.15.40:0/2973800032 learned_addr learned my addr 172.21.15.40:0/2973800032 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:04.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.663+0000 7fd55cee7700 1 --2- 172.21.15.40:0/2973800032 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd55806ced0 0x7fd55806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:04.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.663+0000 7fd55cee7700 1 -- 172.21.15.40:0/2973800032 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd55809fbb0 msgr2=0x7fd55806c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:04.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.663+0000 7fd55cee7700 1 --2- 172.21.15.40:0/2973800032 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd55809fbb0 0x7fd55806c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.663+0000 7fd54ffff700 1 -- 172.21.15.40:0/2973800032 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1127178535 0 0) 0x7fd550001490 con 0x7fd558138370 2023-09-30T22:31:04.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.663+0000 7fd55cee7700 1 -- 172.21.15.40:0/2973800032 >> v1:172.21.15.40:6789/0 conn(0x7fd558138370 legacy=0x7fd55813a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:04.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.663+0000 7fd55cee7700 1 -- 172.21.15.40:0/2973800032 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5580a0590 con 0x7fd55806ced0 2023-09-30T22:31:04.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.663+0000 7fd55cee7700 1 --2- 172.21.15.40:0/2973800032 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd55806ced0 0x7fd55806d2c0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fd548009870 tx=0x7fd548009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c94912409379a71a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:04.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.664+0000 7fd54ffff700 1 -- 172.21.15.40:0/2973800032 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd548011830 con 0x7fd55806ced0 2023-09-30T22:31:04.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.664+0000 7fd54ffff700 1 -- 172.21.15.40:0/2973800032 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd548011990 con 0x7fd55806ced0 2023-09-30T22:31:04.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.664+0000 7fd54ffff700 1 -- 172.21.15.40:0/2973800032 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd548011d20 con 0x7fd55806ced0 2023-09-30T22:31:04.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.664+0000 7fd55f94c700 1 -- 172.21.15.40:0/2973800032 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd55806ced0 msgr2=0x7fd55806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:04.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.664+0000 7fd55f94c700 1 --2- 172.21.15.40:0/2973800032 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd55806ced0 0x7fd55806d2c0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fd548009870 tx=0x7fd548009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:04.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.664+0000 7fd55f94c700 1 -- 172.21.15.40:0/2973800032 shutdown_connections 2023-09-30T22:31:04.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.664+0000 7fd55f94c700 1 --2- 172.21.15.40:0/2973800032 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd55809fbb0 0x7fd55806c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.664+0000 7fd55f94c700 1 --2- 172.21.15.40:0/2973800032 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd55806ced0 0x7fd55806d2c0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.664+0000 7fd55f94c700 1 -- 172.21.15.40:0/2973800032 >> 172.21.15.40:0/2973800032 conn(0x7fd5580a41a0 msgr2=0x7fd5580a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:04.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.664+0000 7fd55f94c700 1 -- 172.21.15.40:0/2973800032 shutdown_connections 2023-09-30T22:31:04.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.664+0000 7fd55f94c700 1 -- 172.21.15.40:0/2973800032 wait complete. 2023-09-30T22:31:04.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.665+0000 7fd55f94c700 1 Processor -- start 2023-09-30T22:31:04.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.665+0000 7fd55f94c700 1 -- start start 2023-09-30T22:31:04.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.666+0000 7fd55f94c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd55806ced0 0x7fd558137c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:04.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.666+0000 7fd55f94c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd55809fbb0 0x7fd558095ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:04.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.666+0000 7fd55f94c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd558138370 0x7fd5580963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:04.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.666+0000 7fd55f94c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd558097390 con 0x7fd55809fbb0 2023-09-30T22:31:04.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.666+0000 7fd55f94c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd558093ca0 con 0x7fd558138370 2023-09-30T22:31:04.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.666+0000 7fd55f94c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5581378b0 con 0x7fd55806ced0 2023-09-30T22:31:04.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.666+0000 7fd55cee7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd55809fbb0 0x7fd558095ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:04.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.666+0000 7fd55cee7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd55809fbb0 0x7fd558095ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35150/0 (socket says 172.21.15.40:35150) 2023-09-30T22:31:04.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.666+0000 7fd55cee7700 1 -- 172.21.15.40:0/2219902961 learned_addr learned my addr 172.21.15.40:0/2219902961 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:04.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.666+0000 7fd55dee9700 1 --2- 172.21.15.40:0/2219902961 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd558138370 0x7fd5580963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:04.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.666+0000 7fd55d6e8700 1 --2- 172.21.15.40:0/2219902961 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd55806ced0 0x7fd558137c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:04.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.666+0000 7fd55cee7700 1 -- 172.21.15.40:0/2219902961 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd55806ced0 msgr2=0x7fd558137c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:04.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.666+0000 7fd55cee7700 1 --2- 172.21.15.40:0/2219902961 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd55806ced0 0x7fd558137c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.666+0000 7fd55cee7700 1 -- 172.21.15.40:0/2219902961 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd558138370 msgr2=0x7fd5580963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:04.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.666+0000 7fd55cee7700 1 --2- 172.21.15.40:0/2219902961 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd558138370 0x7fd5580963e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.666+0000 7fd55cee7700 1 -- 172.21.15.40:0/2219902961 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5480094a0 con 0x7fd55809fbb0 2023-09-30T22:31:04.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.667+0000 7fd55dee9700 1 --2- 172.21.15.40:0/2219902961 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd558138370 0x7fd5580963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:04.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.667+0000 7fd55cee7700 1 --2- 172.21.15.40:0/2219902961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd55809fbb0 0x7fd558095ea0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fd548009ed0 tx=0x7fd548004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:04.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.667+0000 7fd54dffb700 1 -- 172.21.15.40:0/2219902961 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54801a8f0 con 0x7fd55809fbb0 2023-09-30T22:31:04.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.667+0000 7fd54dffb700 1 -- 172.21.15.40:0/2219902961 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54801aa50 con 0x7fd55809fbb0 2023-09-30T22:31:04.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.667+0000 7fd55f94c700 1 -- 172.21.15.40:0/2219902961 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd558094d20 con 0x7fd55809fbb0 2023-09-30T22:31:04.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.667+0000 7fd54dffb700 1 -- 172.21.15.40:0/2219902961 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54801ade0 con 0x7fd55809fbb0 2023-09-30T22:31:04.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.667+0000 7fd55f94c700 1 -- 172.21.15.40:0/2219902961 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd558071f00 con 0x7fd55809fbb0 2023-09-30T22:31:04.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.668+0000 7fd54dffb700 1 -- 172.21.15.40:0/2219902961 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd5480243f0 con 0x7fd55809fbb0 2023-09-30T22:31:04.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.668+0000 7fd54dffb700 1 -- 172.21.15.40:0/2219902961 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd548040af0 con 0x7fd55809fbb0 2023-09-30T22:31:04.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.668+0000 7fd55f94c700 1 -- 172.21.15.40:0/2219902961 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd558062380 con 0x7fd55809fbb0 2023-09-30T22:31:04.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.677+0000 7fd54dffb700 1 -- 172.21.15.40:0/2219902961 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd548015080 con 0x7fd55809fbb0 2023-09-30T22:31:04.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.705+0000 7f87ed281700 1 Processor -- start 2023-09-30T22:31:04.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.705+0000 7f87ed281700 1 -- start start 2023-09-30T22:31:04.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.705+0000 7f87ed281700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87e809d450 0x7f87e809d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:04.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.705+0000 7f87ed281700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87e809dd60 0x7f87e81301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:04.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.705+0000 7f87ed281700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f87e8130700 0x7f87e8130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:04.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.705+0000 7f87ed281700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e809e8b0 con 0x7f87e8130700 2023-09-30T22:31:04.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.705+0000 7f87ed281700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e809c3b0 con 0x7f87e809dd60 2023-09-30T22:31:04.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.705+0000 7f87ed281700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87e809a6b0 con 0x7f87e809d450 2023-09-30T22:31:04.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.706+0000 7f87e6ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87e809d450 0x7f87e809d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:04.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.706+0000 7f87e6ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87e809d450 0x7f87e809d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55280/0 (socket says 172.21.15.40:55280) 2023-09-30T22:31:04.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.706+0000 7f87e6ffd700 1 -- 172.21.15.40:0/2577814728 learned_addr learned my addr 172.21.15.40:0/2577814728 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:04.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.706+0000 7f87e67fc700 1 --2- 172.21.15.40:0/2577814728 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87e809dd60 0x7f87e81301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:04.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.706+0000 7f87e77fe700 1 --2- 172.21.15.40:0/2577814728 >> v2:172.21.15.40:3300/0 conn(0x7f87e8130700 0x7f87e8130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:04.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.706+0000 7f87e6ffd700 1 -- 172.21.15.40:0/2577814728 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87e809dd60 msgr2=0x7f87e81301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:04.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.706+0000 7f87e6ffd700 1 --2- 172.21.15.40:0/2577814728 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87e809dd60 0x7f87e81301c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.706+0000 7f87e6ffd700 1 -- 172.21.15.40:0/2577814728 >> v2:172.21.15.40:3300/0 conn(0x7f87e8130700 msgr2=0x7f87e8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:04.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.706+0000 7f87e6ffd700 1 --2- 172.21.15.40:0/2577814728 >> v2:172.21.15.40:3300/0 conn(0x7f87e8130700 0x7f87e8130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.706+0000 7f87e6ffd700 1 -- 172.21.15.40:0/2577814728 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e809b4f0 con 0x7f87e809d450 2023-09-30T22:31:04.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.706+0000 7f87e6ffd700 1 --2- 172.21.15.40:0/2577814728 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87e809d450 0x7f87e809d820 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f87d80098f0 tx=0x7f87d8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e38b3d7586b6a001 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:04.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.706+0000 7f87e5ffb700 1 -- 172.21.15.40:0/2577814728 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d8012b80 con 0x7f87e809d450 2023-09-30T22:31:04.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.706+0000 7f87e5ffb700 1 -- 172.21.15.40:0/2577814728 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d8012ce0 con 0x7f87e809d450 2023-09-30T22:31:04.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.706+0000 7f87e5ffb700 1 -- 172.21.15.40:0/2577814728 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d801b620 con 0x7f87e809d450 2023-09-30T22:31:04.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.707+0000 7f87ed281700 1 -- 172.21.15.40:0/2577814728 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87e809d450 msgr2=0x7f87e809d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:04.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.707+0000 7f87ed281700 1 --2- 172.21.15.40:0/2577814728 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87e809d450 0x7f87e809d820 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f87d80098f0 tx=0x7f87d8009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:04.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.707+0000 7f87ed281700 1 -- 172.21.15.40:0/2577814728 shutdown_connections 2023-09-30T22:31:04.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.707+0000 7f87ed281700 1 --2- 172.21.15.40:0/2577814728 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87e809d450 0x7f87e809d820 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.707+0000 7f87ed281700 1 --2- 172.21.15.40:0/2577814728 >> v2:172.21.15.40:3300/0 conn(0x7f87e8130700 0x7f87e8130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.707+0000 7f87ed281700 1 --2- 172.21.15.40:0/2577814728 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87e809dd60 0x7f87e81301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.707+0000 7f87ed281700 1 -- 172.21.15.40:0/2577814728 >> 172.21.15.40:0/2577814728 conn(0x7f87e80a2a00 msgr2=0x7f87e80a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:04.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.707+0000 7f87ed281700 1 -- 172.21.15.40:0/2577814728 shutdown_connections 2023-09-30T22:31:04.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.707+0000 7f87ed281700 1 -- 172.21.15.40:0/2577814728 wait complete. 2023-09-30T22:31:04.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.709+0000 7f87ed281700 1 Processor -- start 2023-09-30T22:31:04.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.709+0000 7f87ed281700 1 -- start start 2023-09-30T22:31:04.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.709+0000 7f87ed281700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87e809d450 0x7f87e81c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:04.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.709+0000 7f87ed281700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87e809dd60 0x7f87e81c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:04.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.710+0000 7f87ed281700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87e8130700 0x7f87e811b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:04.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.710+0000 7f87ed281700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e811e950 con 0x7f87e8130700 2023-09-30T22:31:04.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.710+0000 7f87ed281700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e812fc10 con 0x7f87e809d450 2023-09-30T22:31:04.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.710+0000 7f87ed281700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87e811cbd0 con 0x7f87e809dd60 2023-09-30T22:31:04.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.710+0000 7f87e6ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87e809d450 0x7f87e81c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:04.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.710+0000 7f87e6ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87e809d450 0x7f87e81c44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54550/0 (socket says 172.21.15.40:54550) 2023-09-30T22:31:04.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.710+0000 7f87e77fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87e8130700 0x7f87e811b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:04.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.710+0000 7f87e6ffd700 1 -- 172.21.15.40:0/4063437030 learned_addr learned my addr 172.21.15.40:0/4063437030 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:04.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.710+0000 7f87e67fc700 1 --2- 172.21.15.40:0/4063437030 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87e809dd60 0x7f87e81c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:04.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.710+0000 7f87e6ffd700 1 -- 172.21.15.40:0/4063437030 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87e809dd60 msgr2=0x7f87e81c4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:04.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.710+0000 7f87e6ffd700 1 --2- 172.21.15.40:0/4063437030 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87e809dd60 0x7f87e81c4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.710+0000 7f87e6ffd700 1 -- 172.21.15.40:0/4063437030 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87e8130700 msgr2=0x7f87e811b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:04.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.710+0000 7f87e6ffd700 1 --2- 172.21.15.40:0/4063437030 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87e8130700 0x7f87e811b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.710+0000 7f87e6ffd700 1 -- 172.21.15.40:0/4063437030 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d8009550 con 0x7f87e809d450 2023-09-30T22:31:04.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.710+0000 7f87e77fe700 1 --2- 172.21.15.40:0/4063437030 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87e8130700 0x7f87e811b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:04.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.710+0000 7f87e6ffd700 1 --2- 172.21.15.40:0/4063437030 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87e809d450 0x7f87e81c44e0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f87e809a7f0 tx=0x7f87d8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:04.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.710+0000 7f87cf7fe700 1 -- 172.21.15.40:0/4063437030 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d8020070 con 0x7f87e809d450 2023-09-30T22:31:04.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.710+0000 7f87cf7fe700 1 -- 172.21.15.40:0/4063437030 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d80038b0 con 0x7f87e809d450 2023-09-30T22:31:04.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.710+0000 7f87ed281700 1 -- 172.21.15.40:0/4063437030 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e80a18c0 con 0x7f87e809d450 2023-09-30T22:31:04.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.711+0000 7f87cf7fe700 1 -- 172.21.15.40:0/4063437030 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d8003c40 con 0x7f87e809d450 2023-09-30T22:31:04.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.711+0000 7f87ed281700 1 -- 172.21.15.40:0/4063437030 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e811d380 con 0x7f87e809d450 2023-09-30T22:31:04.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.712+0000 7f87ed281700 1 -- 172.21.15.40:0/4063437030 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e8062380 con 0x7f87e809d450 2023-09-30T22:31:04.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.712+0000 7f87cf7fe700 1 -- 172.21.15.40:0/4063437030 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f87d801b400 con 0x7f87e809d450 2023-09-30T22:31:04.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.712+0000 7f87cf7fe700 1 -- 172.21.15.40:0/4063437030 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f87d8043e50 con 0x7f87e809d450 2023-09-30T22:31:04.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.721+0000 7f87cf7fe700 1 -- 172.21.15.40:0/4063437030 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f87d8003da0 con 0x7f87e809d450 2023-09-30T22:31:04.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.747+0000 7f2c17680700 1 Processor -- start 2023-09-30T22:31:04.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.747+0000 7f2c17680700 1 -- start start 2023-09-30T22:31:04.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.747+0000 7f2c17680700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c1006a6d0 0x7f2c1006aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:04.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.747+0000 7f2c17680700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c1006afe0 0x7f2c101318b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:04.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.747+0000 7f2c17680700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c1009eb50 con 0x7f2c10131df0 2023-09-30T22:31:04.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.747+0000 7f2c17680700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1009dde0 con 0x7f2c1006a6d0 2023-09-30T22:31:04.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.747+0000 7f2c17680700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1009d4a0 con 0x7f2c1006afe0 2023-09-30T22:31:04.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.748+0000 7f2c1541c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c1006a6d0 0x7f2c1006aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:04.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.748+0000 7f2c1541c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c1006a6d0 0x7f2c1006aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54564/0 (socket says 172.21.15.40:54564) 2023-09-30T22:31:04.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.748+0000 7f2c1541c700 1 -- 172.21.15.40:0/2972809919 learned_addr learned my addr 172.21.15.40:0/2972809919 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:04.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.748+0000 7f2c15c1d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2c10131df0 0x7f2c10138b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41956/0 (socket says 172.21.15.40:41956) 2023-09-30T22:31:04.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.748+0000 7f2c14c1b700 1 --2- 172.21.15.40:0/2972809919 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c1006afe0 0x7f2c101318b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:04.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.748+0000 7f2c1541c700 1 -- 172.21.15.40:0/2972809919 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c1006afe0 msgr2=0x7f2c101318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:04.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.748+0000 7f2c1541c700 1 --2- 172.21.15.40:0/2972809919 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c1006afe0 0x7f2c101318b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.748+0000 7f2c1541c700 1 -- 172.21.15.40:0/2972809919 >> v1:172.21.15.40:6789/0 conn(0x7f2c10131df0 legacy=0x7f2c10138b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:04.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.748+0000 7f2c07fff700 1 -- 172.21.15.40:0/2972809919 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1399700854 0 0) 0x7f2c1009eb50 con 0x7f2c10131df0 2023-09-30T22:31:04.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.748+0000 7f2c1541c700 1 -- 172.21.15.40:0/2972809919 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1009f5f0 con 0x7f2c1006a6d0 2023-09-30T22:31:04.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.748+0000 7f2c1541c700 1 --2- 172.21.15.40:0/2972809919 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c1006a6d0 0x7f2c1006aaa0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c0098f0 tx=0x7f2c0c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1578a2bd70265af4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:04.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.748+0000 7f2c07fff700 1 -- 172.21.15.40:0/2972809919 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c005e30 con 0x7f2c1006a6d0 2023-09-30T22:31:04.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.748+0000 7f2c07fff700 1 -- 172.21.15.40:0/2972809919 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0c004030 con 0x7f2c1006a6d0 2023-09-30T22:31:04.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.748+0000 7f2c07fff700 1 -- 172.21.15.40:0/2972809919 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c0043e0 con 0x7f2c1006a6d0 2023-09-30T22:31:04.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.749+0000 7f2c17680700 1 -- 172.21.15.40:0/2972809919 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c1006a6d0 msgr2=0x7f2c1006aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:04.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.749+0000 7f2c17680700 1 --2- 172.21.15.40:0/2972809919 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c1006a6d0 0x7f2c1006aaa0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c0098f0 tx=0x7f2c0c009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:04.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.749+0000 7f2c17680700 1 -- 172.21.15.40:0/2972809919 shutdown_connections 2023-09-30T22:31:04.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.749+0000 7f2c17680700 1 --2- 172.21.15.40:0/2972809919 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c1006a6d0 0x7f2c1006aaa0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.749+0000 7f2c17680700 1 --2- 172.21.15.40:0/2972809919 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c1006afe0 0x7f2c101318b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.749+0000 7f2c17680700 1 -- 172.21.15.40:0/2972809919 >> 172.21.15.40:0/2972809919 conn(0x7f2c1009fb20 msgr2=0x7f2c1009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:04.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.749+0000 7f2c17680700 1 -- 172.21.15.40:0/2972809919 shutdown_connections 2023-09-30T22:31:04.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.749+0000 7f2c17680700 1 -- 172.21.15.40:0/2972809919 wait complete. 2023-09-30T22:31:04.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.750+0000 7f2c17680700 1 Processor -- start 2023-09-30T22:31:04.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.750+0000 7f2c17680700 1 -- start start 2023-09-30T22:31:04.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.750+0000 7f2c17680700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c1006a6d0 0x7f2c1011d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:04.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.750+0000 7f2c17680700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c1006afe0 0x7f2c1011da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:04.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.750+0000 7f2c17680700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c10131df0 0x7f2c101c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:04.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.750+0000 7f2c17680700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c10120600 con 0x7f2c1006a6d0 2023-09-30T22:31:04.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.750+0000 7f2c17680700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c10131470 con 0x7f2c10131df0 2023-09-30T22:31:04.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.750+0000 7f2c17680700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c10071560 con 0x7f2c1006afe0 2023-09-30T22:31:04.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.751+0000 7f2c1541c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c1006a6d0 0x7f2c1011d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:04.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.751+0000 7f2c1541c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c1006a6d0 0x7f2c1011d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35178/0 (socket says 172.21.15.40:35178) 2023-09-30T22:31:04.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.751+0000 7f2c1541c700 1 -- 172.21.15.40:0/78780315 learned_addr learned my addr 172.21.15.40:0/78780315 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:04.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.751+0000 7f2c14c1b700 1 --2- 172.21.15.40:0/78780315 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c1006afe0 0x7f2c1011da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:04.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.751+0000 7f2c15c1d700 1 --2- 172.21.15.40:0/78780315 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c10131df0 0x7f2c101c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:04.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.751+0000 7f2c1541c700 1 -- 172.21.15.40:0/78780315 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c1006afe0 msgr2=0x7f2c1011da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:04.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.751+0000 7f2c1541c700 1 --2- 172.21.15.40:0/78780315 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c1006afe0 0x7f2c1011da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.751+0000 7f2c1541c700 1 -- 172.21.15.40:0/78780315 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c10131df0 msgr2=0x7f2c101c66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:04.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.751+0000 7f2c1541c700 1 --2- 172.21.15.40:0/78780315 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c10131df0 0x7f2c101c66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.751+0000 7f2c1541c700 1 -- 172.21.15.40:0/78780315 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c0c009500 con 0x7f2c1006a6d0 2023-09-30T22:31:04.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.751+0000 7f2c14c1b700 1 --2- 172.21.15.40:0/78780315 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c1006afe0 0x7f2c1011da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:04.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.751+0000 7f2c15c1d700 1 --2- 172.21.15.40:0/78780315 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c10131df0 0x7f2c101c66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:04.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.751+0000 7f2c1541c700 1 --2- 172.21.15.40:0/78780315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c1006a6d0 0x7f2c1011d540 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f2c1009d350 tx=0x7f2c0c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:04.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.751+0000 7f2c05ffb700 1 -- 172.21.15.40:0/78780315 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c003da0 con 0x7f2c1006a6d0 2023-09-30T22:31:04.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.751+0000 7f2c05ffb700 1 -- 172.21.15.40:0/78780315 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0c01d430 con 0x7f2c1006a6d0 2023-09-30T22:31:04.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.751+0000 7f2c17680700 1 -- 172.21.15.40:0/78780315 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c1011dfc0 con 0x7f2c1006a6d0 2023-09-30T22:31:04.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.751+0000 7f2c05ffb700 1 -- 172.21.15.40:0/78780315 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c01d7e0 con 0x7f2c1006a6d0 2023-09-30T22:31:04.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.752+0000 7f2c17680700 1 -- 172.21.15.40:0/78780315 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c1011d080 con 0x7f2c1006a6d0 2023-09-30T22:31:04.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.753+0000 7f2c17680700 1 -- 172.21.15.40:0/78780315 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c10062380 con 0x7f2c1006a6d0 2023-09-30T22:31:04.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.753+0000 7f2c05ffb700 1 -- 172.21.15.40:0/78780315 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2c0c01d940 con 0x7f2c1006a6d0 2023-09-30T22:31:04.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.753+0000 7f2c05ffb700 1 -- 172.21.15.40:0/78780315 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f2c0c040870 con 0x7f2c1006a6d0 2023-09-30T22:31:04.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.758+0000 7f2c05ffb700 1 -- 172.21.15.40:0/78780315 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2c0c01dbf0 con 0x7f2c1006a6d0 2023-09-30T22:31:04.791 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:04.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.921+0000 7ff3a168c700 1 Processor -- start 2023-09-30T22:31:04.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.921+0000 7ff3a168c700 1 -- start start 2023-09-30T22:31:04.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.922+0000 7ff3a168c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff39c12e590 0x7ff39c12e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:04.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.922+0000 7ff3a168c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff39c12d8a0 0x7ff39c138c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:04.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.922+0000 7ff3a168c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff39c09ab70 con 0x7ff39c12eea0 2023-09-30T22:31:04.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.922+0000 7ff3a168c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff39c09b270 con 0x7ff39c12e590 2023-09-30T22:31:04.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.922+0000 7ff3a168c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff39c09bab0 con 0x7ff39c12d8a0 2023-09-30T22:31:04.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.922+0000 7ff39a7fc700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff39c12eea0 0x7ff39c12d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41970/0 (socket says 172.21.15.40:41970) 2023-09-30T22:31:04.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.922+0000 7ff39a7fc700 1 -- 172.21.15.40:0/3907816406 learned_addr learned my addr 172.21.15.40:0/3907816406 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:04.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.922+0000 7ff39affd700 1 --2- 172.21.15.40:0/3907816406 >> v2:172.21.15.40:3300/0 conn(0x7ff39c12e590 0x7ff39c12e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:04.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.922+0000 7ff39b7fe700 1 --2- 172.21.15.40:0/3907816406 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff39c12d8a0 0x7ff39c138c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:04.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.923+0000 7ff39b7fe700 1 -- 172.21.15.40:0/3907816406 >> v2:172.21.15.40:3300/0 conn(0x7ff39c12e590 msgr2=0x7ff39c12e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:04.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.923+0000 7ff39b7fe700 1 --2- 172.21.15.40:0/3907816406 >> v2:172.21.15.40:3300/0 conn(0x7ff39c12e590 0x7ff39c12e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.923+0000 7ff39b7fe700 1 -- 172.21.15.40:0/3907816406 >> v1:172.21.15.40:6789/0 conn(0x7ff39c12eea0 legacy=0x7ff39c12d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:04.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.923+0000 7ff39b7fe700 1 -- 172.21.15.40:0/3907816406 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff39c09bd70 con 0x7ff39c12d8a0 2023-09-30T22:31:04.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.923+0000 7ff39b7fe700 1 --2- 172.21.15.40:0/3907816406 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff39c12d8a0 0x7ff39c138c50 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7ff394009d90 tx=0x7ff39400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40a5b90f7d9bb5e4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:04.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.923+0000 7ff399ffb700 1 -- 172.21.15.40:0/3907816406 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39400e070 con 0x7ff39c12d8a0 2023-09-30T22:31:04.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.923+0000 7ff399ffb700 1 -- 172.21.15.40:0/3907816406 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39400bb20 con 0x7ff39c12d8a0 2023-09-30T22:31:04.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.923+0000 7ff399ffb700 1 -- 172.21.15.40:0/3907816406 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff394012430 con 0x7ff39c12d8a0 2023-09-30T22:31:04.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.924+0000 7ff3a168c700 1 -- 172.21.15.40:0/3907816406 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff39c12d8a0 msgr2=0x7ff39c138c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:04.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.924+0000 7ff3a168c700 1 --2- 172.21.15.40:0/3907816406 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff39c12d8a0 0x7ff39c138c50 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7ff394009d90 tx=0x7ff39400b330 comp rx=0 tx=0).stop 2023-09-30T22:31:04.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.924+0000 7ff3a168c700 1 -- 172.21.15.40:0/3907816406 shutdown_connections 2023-09-30T22:31:04.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.924+0000 7ff3a168c700 1 --2- 172.21.15.40:0/3907816406 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff39c12d8a0 0x7ff39c138c50 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.924+0000 7ff3a168c700 1 --2- 172.21.15.40:0/3907816406 >> v2:172.21.15.40:3300/0 conn(0x7ff39c12e590 0x7ff39c12e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.924+0000 7ff3a168c700 1 -- 172.21.15.40:0/3907816406 >> 172.21.15.40:0/3907816406 conn(0x7ff39c0a2a00 msgr2=0x7ff39c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:04.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.924+0000 7ff3a168c700 1 -- 172.21.15.40:0/3907816406 shutdown_connections 2023-09-30T22:31:04.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.924+0000 7ff3a168c700 1 -- 172.21.15.40:0/3907816406 wait complete. 2023-09-30T22:31:04.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.925+0000 7ff3a168c700 1 Processor -- start 2023-09-30T22:31:04.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.925+0000 7ff3a168c700 1 -- start start 2023-09-30T22:31:04.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.926+0000 7ff3a168c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff39c12d8a0 0x7ff39c11f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:04.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.926+0000 7ff3a168c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff39c12e590 0x7ff39c11f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:04.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.926+0000 7ff3a168c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff39c12eea0 0x7ff39c11fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:04.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.926+0000 7ff3a168c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39c12d210 con 0x7ff39c12eea0 2023-09-30T22:31:04.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.926+0000 7ff3a168c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff39c09fd00 con 0x7ff39c12e590 2023-09-30T22:31:04.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.926+0000 7ff3a168c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff39c120f10 con 0x7ff39c12d8a0 2023-09-30T22:31:04.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.926+0000 7ff39affd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff39c12d8a0 0x7ff39c11f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:04.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.926+0000 7ff39affd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff39c12d8a0 0x7ff39c11f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55332/0 (socket says 172.21.15.40:55332) 2023-09-30T22:31:04.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.926+0000 7ff39affd700 1 -- 172.21.15.40:0/3103074418 learned_addr learned my addr 172.21.15.40:0/3103074418 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:04.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.926+0000 7ff39a7fc700 1 --2- 172.21.15.40:0/3103074418 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff39c12e590 0x7ff39c11f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:04.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.926+0000 7ff39b7fe700 1 --2- 172.21.15.40:0/3103074418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff39c12eea0 0x7ff39c11fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:04.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.926+0000 7fd55f94c700 1 -- 172.21.15.40:0/2219902961 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd55809f6a0 con 0x7fd55809fbb0 2023-09-30T22:31:04.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.926+0000 7ff39a7fc700 1 -- 172.21.15.40:0/3103074418 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff39c12d8a0 msgr2=0x7ff39c11f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:04.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.926+0000 7ff39a7fc700 1 --2- 172.21.15.40:0/3103074418 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff39c12d8a0 0x7ff39c11f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.926+0000 7ff39a7fc700 1 -- 172.21.15.40:0/3103074418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff39c12eea0 msgr2=0x7ff39c11fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:04.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.926+0000 7ff39a7fc700 1 --2- 172.21.15.40:0/3103074418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff39c12eea0 0x7ff39c11fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.926+0000 7ff39a7fc700 1 -- 172.21.15.40:0/3103074418 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff394009a70 con 0x7ff39c12e590 2023-09-30T22:31:04.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.926+0000 7ff39b7fe700 1 --2- 172.21.15.40:0/3103074418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff39c12eea0 0x7ff39c11fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:04.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.926+0000 7ff39affd700 1 --2- 172.21.15.40:0/3103074418 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff39c12d8a0 0x7ff39c11f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:04.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.926+0000 7ff39a7fc700 1 --2- 172.21.15.40:0/3103074418 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff39c12e590 0x7ff39c11f7e0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7ff39000c500 tx=0x7ff39000c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:04.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.926+0000 7fd54dffb700 1 -- 172.21.15.40:0/2219902961 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd54800b360 con 0x7fd55809fbb0 2023-09-30T22:31:04.931 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:04.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.927+0000 7ff3837fe700 1 -- 172.21.15.40:0/3103074418 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff390005d70 con 0x7ff39c12e590 2023-09-30T22:31:04.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.927+0000 7ff3837fe700 1 -- 172.21.15.40:0/3103074418 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3900070d0 con 0x7ff39c12e590 2023-09-30T22:31:04.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.927+0000 7ff3837fe700 1 -- 172.21.15.40:0/3103074418 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff390007440 con 0x7ff39c12e590 2023-09-30T22:31:04.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.927+0000 7ff3a168c700 1 -- 172.21.15.40:0/3103074418 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff39c122aa0 con 0x7ff39c12e590 2023-09-30T22:31:04.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.927+0000 7ff3a168c700 1 -- 172.21.15.40:0/3103074418 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff39c123510 con 0x7ff39c12e590 2023-09-30T22:31:04.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.928+0000 7ff3837fe700 1 -- 172.21.15.40:0/3103074418 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff3900075a0 con 0x7ff39c12e590 2023-09-30T22:31:04.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.928+0000 7ff3837fe700 1 -- 172.21.15.40:0/3103074418 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff39003eb10 con 0x7ff39c12e590 2023-09-30T22:31:04.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.929+0000 7ff3a168c700 1 -- 172.21.15.40:0/3103074418 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff39c062380 con 0x7ff39c12e590 2023-09-30T22:31:04.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.929+0000 7fd55f94c700 1 -- 172.21.15.40:0/2219902961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd55809fbb0 msgr2=0x7fd558095ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:04.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.929+0000 7fd55f94c700 1 --2- 172.21.15.40:0/2219902961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd55809fbb0 0x7fd558095ea0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fd548009ed0 tx=0x7fd548004750 comp rx=0 tx=0).stop 2023-09-30T22:31:04.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.929+0000 7fd55f94c700 1 -- 172.21.15.40:0/2219902961 shutdown_connections 2023-09-30T22:31:04.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.929+0000 7fd55f94c700 1 --2- 172.21.15.40:0/2219902961 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd55806ced0 0x7fd558137c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.929+0000 7fd55f94c700 1 --2- 172.21.15.40:0/2219902961 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd558138370 0x7fd5580963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.929+0000 7fd55f94c700 1 --2- 172.21.15.40:0/2219902961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd55809fbb0 0x7fd558095ea0 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.929+0000 7fd55f94c700 1 -- 172.21.15.40:0/2219902961 >> 172.21.15.40:0/2219902961 conn(0x7fd5580a41a0 msgr2=0x7fd55809d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:04.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.930+0000 7fd55f94c700 1 -- 172.21.15.40:0/2219902961 shutdown_connections 2023-09-30T22:31:04.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.933+0000 7fd55f94c700 1 -- 172.21.15.40:0/2219902961 wait complete. 2023-09-30T22:31:04.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.934+0000 7ff3837fe700 1 -- 172.21.15.40:0/3103074418 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff390019d20 con 0x7ff39c12e590 2023-09-30T22:31:04.950 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:04.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.971+0000 7f87ed281700 1 -- 172.21.15.40:0/4063437030 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f87e811e510 con 0x7f87e809d450 2023-09-30T22:31:04.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.971+0000 7f2c17680700 1 -- 172.21.15.40:0/78780315 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2c10071090 con 0x7f2c1006a6d0 2023-09-30T22:31:04.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.971+0000 7f2c05ffb700 1 -- 172.21.15.40:0/78780315 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2c0c02a030 con 0x7f2c1006a6d0 2023-09-30T22:31:04.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.971+0000 7f87cf7fe700 1 -- 172.21.15.40:0/4063437030 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f87d8029030 con 0x7f87e809d450 2023-09-30T22:31:04.973 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:04.973 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:04.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.973+0000 7f87ed281700 1 -- 172.21.15.40:0/4063437030 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87e809d450 msgr2=0x7f87e81c44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:04.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.973+0000 7f87ed281700 1 --2- 172.21.15.40:0/4063437030 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87e809d450 0x7f87e81c44e0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f87e809a7f0 tx=0x7f87d8004750 comp rx=0 tx=0).stop 2023-09-30T22:31:04.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.973+0000 7f2c17680700 1 -- 172.21.15.40:0/78780315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c1006a6d0 msgr2=0x7f2c1011d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:04.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.973+0000 7f2c17680700 1 --2- 172.21.15.40:0/78780315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c1006a6d0 0x7f2c1011d540 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f2c1009d350 tx=0x7f2c0c004750 comp rx=0 tx=0).stop 2023-09-30T22:31:04.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.973+0000 7f87ed281700 1 -- 172.21.15.40:0/4063437030 shutdown_connections 2023-09-30T22:31:04.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.973+0000 7f87ed281700 1 --2- 172.21.15.40:0/4063437030 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87e8130700 0x7f87e811b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.973+0000 7f87ed281700 1 --2- 172.21.15.40:0/4063437030 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f87e809d450 0x7f87e81c44e0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.973+0000 7f87ed281700 1 --2- 172.21.15.40:0/4063437030 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f87e809dd60 0x7f87e81c4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.973+0000 7f87ed281700 1 -- 172.21.15.40:0/4063437030 >> 172.21.15.40:0/4063437030 conn(0x7f87e80a2a00 msgr2=0x7f87e81b7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:04.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.973+0000 7f2c17680700 1 -- 172.21.15.40:0/78780315 shutdown_connections 2023-09-30T22:31:04.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.973+0000 7f2c17680700 1 --2- 172.21.15.40:0/78780315 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c10131df0 0x7f2c101c66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.973+0000 7f2c17680700 1 --2- 172.21.15.40:0/78780315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c1006a6d0 0x7f2c1011d540 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.973+0000 7f2c17680700 1 --2- 172.21.15.40:0/78780315 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2c1006afe0 0x7f2c1011da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:04.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.973+0000 7f2c17680700 1 -- 172.21.15.40:0/78780315 >> 172.21.15.40:0/78780315 conn(0x7f2c1009fb20 msgr2=0x7f2c101b8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:04.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.974+0000 7f2c17680700 1 -- 172.21.15.40:0/78780315 shutdown_connections 2023-09-30T22:31:04.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.974+0000 7f87ed281700 1 -- 172.21.15.40:0/4063437030 shutdown_connections 2023-09-30T22:31:04.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.974+0000 7f2c17680700 1 -- 172.21.15.40:0/78780315 wait complete. 2023-09-30T22:31:04.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:04.974+0000 7f87ed281700 1 -- 172.21.15.40:0/4063437030 wait complete. 2023-09-30T22:31:04.993 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:04.994 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:05.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:05.140+0000 7ff3a168c700 1 -- 172.21.15.40:0/3103074418 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff39c074330 con 0x7ff39c12e590 2023-09-30T22:31:05.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:05.140+0000 7ff3837fe700 1 -- 172.21.15.40:0/3103074418 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff390017020 con 0x7ff39c12e590 2023-09-30T22:31:05.141 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:05.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:05.142+0000 7ff3a168c700 1 -- 172.21.15.40:0/3103074418 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff39c12e590 msgr2=0x7ff39c11f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:05.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:05.142+0000 7ff3a168c700 1 --2- 172.21.15.40:0/3103074418 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff39c12e590 0x7ff39c11f7e0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7ff39000c500 tx=0x7ff39000c810 comp rx=0 tx=0).stop 2023-09-30T22:31:05.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:05.142+0000 7ff3a168c700 1 -- 172.21.15.40:0/3103074418 shutdown_connections 2023-09-30T22:31:05.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:05.142+0000 7ff3a168c700 1 --2- 172.21.15.40:0/3103074418 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff39c12d8a0 0x7ff39c11f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:05.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:05.142+0000 7ff3a168c700 1 --2- 172.21.15.40:0/3103074418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff39c12eea0 0x7ff39c11fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:05.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:05.142+0000 7ff3a168c700 1 --2- 172.21.15.40:0/3103074418 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff39c12e590 0x7ff39c11f7e0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:05.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:05.142+0000 7ff3a168c700 1 -- 172.21.15.40:0/3103074418 >> 172.21.15.40:0/3103074418 conn(0x7ff39c0a2a00 msgr2=0x7ff39c06d610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:05.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:05.142+0000 7ff3a168c700 1 -- 172.21.15.40:0/3103074418 shutdown_connections 2023-09-30T22:31:05.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:05.142+0000 7ff3a168c700 1 -- 172.21.15.40:0/3103074418 wait complete. 2023-09-30T22:31:05.155 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:05.951 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:05.994 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:05.995 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:06.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.096+0000 7fce112f7700 1 Processor -- start 2023-09-30T22:31:06.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.096+0000 7fce112f7700 1 -- start start 2023-09-30T22:31:06.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.097+0000 7fce112f7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fce0c09d920 0x7fce0c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.097+0000 7fce112f7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce0c130fb0 0x7fce0c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.097+0000 7fce112f7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce0c09adf0 con 0x7fce0c09e230 2023-09-30T22:31:06.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.097+0000 7fce112f7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce0c09edf0 con 0x7fce0c09d920 2023-09-30T22:31:06.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.097+0000 7fce112f7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c09b660 con 0x7fce0c130fb0 2023-09-30T22:31:06.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.097+0000 7fce0b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce0c130fb0 0x7fce0c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:06.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.097+0000 7fce0b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce0c130fb0 0x7fce0c138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54586/0 (socket says 172.21.15.40:54586) 2023-09-30T22:31:06.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.097+0000 7fce0b7fe700 1 -- 172.21.15.40:0/3693907551 learned_addr learned my addr 172.21.15.40:0/3693907551 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:06.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.097+0000 7fce0affd700 1 --2- 172.21.15.40:0/3693907551 >> v2:172.21.15.40:3300/0 conn(0x7fce0c09d920 0x7fce0c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:06.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.097+0000 7fce0b7fe700 1 -- 172.21.15.40:0/3693907551 >> v2:172.21.15.40:3300/0 conn(0x7fce0c09d920 msgr2=0x7fce0c09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:06.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.097+0000 7fce0b7fe700 1 --2- 172.21.15.40:0/3693907551 >> v2:172.21.15.40:3300/0 conn(0x7fce0c09d920 0x7fce0c09dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.097+0000 7fce0b7fe700 1 -- 172.21.15.40:0/3693907551 >> v1:172.21.15.40:6789/0 conn(0x7fce0c09e230 legacy=0x7fce0c1308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:06.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.097+0000 7fce0b7fe700 1 -- 172.21.15.40:0/3693907551 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0c09a6e0 con 0x7fce0c130fb0 2023-09-30T22:31:06.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.097+0000 7fce0b7fe700 1 --2- 172.21.15.40:0/3693907551 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce0c130fb0 0x7fce0c138d10 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fce0400d150 tx=0x7fce0400d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7b844fde694b510 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:06.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.098+0000 7fce09ffb700 1 -- 172.21.15.40:0/3693907551 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce04010070 con 0x7fce0c130fb0 2023-09-30T22:31:06.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.098+0000 7fce09ffb700 1 -- 172.21.15.40:0/3693907551 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0400dd10 con 0x7fce0c130fb0 2023-09-30T22:31:06.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.098+0000 7fce09ffb700 1 -- 172.21.15.40:0/3693907551 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0400b310 con 0x7fce0c130fb0 2023-09-30T22:31:06.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.098+0000 7fce112f7700 1 -- 172.21.15.40:0/3693907551 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce0c130fb0 msgr2=0x7fce0c138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:06.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.098+0000 7fce112f7700 1 --2- 172.21.15.40:0/3693907551 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce0c130fb0 0x7fce0c138d10 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fce0400d150 tx=0x7fce0400d460 comp rx=0 tx=0).stop 2023-09-30T22:31:06.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.098+0000 7fce112f7700 1 -- 172.21.15.40:0/3693907551 shutdown_connections 2023-09-30T22:31:06.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.098+0000 7fce112f7700 1 --2- 172.21.15.40:0/3693907551 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce0c130fb0 0x7fce0c138d10 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.098+0000 7fce112f7700 1 --2- 172.21.15.40:0/3693907551 >> v2:172.21.15.40:3300/0 conn(0x7fce0c09d920 0x7fce0c09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.098+0000 7fce112f7700 1 -- 172.21.15.40:0/3693907551 >> 172.21.15.40:0/3693907551 conn(0x7fce0c09fb20 msgr2=0x7fce0c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:06.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.098+0000 7fce112f7700 1 -- 172.21.15.40:0/3693907551 shutdown_connections 2023-09-30T22:31:06.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.099+0000 7fce112f7700 1 -- 172.21.15.40:0/3693907551 wait complete. 2023-09-30T22:31:06.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.100+0000 7fce112f7700 1 Processor -- start 2023-09-30T22:31:06.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.100+0000 7fce112f7700 1 -- start start 2023-09-30T22:31:06.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.100+0000 7fce112f7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fce0c09d920 0x7fce0c11d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.100+0000 7fce112f7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce0c09e230 0x7fce0c11d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.100+0000 7fce112f7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce0c130fb0 0x7fce0c11daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.100+0000 7fce112f7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c11f240 con 0x7fce0c09e230 2023-09-30T22:31:06.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.100+0000 7fce112f7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c1214c0 con 0x7fce0c130fb0 2023-09-30T22:31:06.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.100+0000 7fce112f7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c120b00 con 0x7fce0c09d920 2023-09-30T22:31:06.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.100+0000 7fce0b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce0c130fb0 0x7fce0c11daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:06.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.100+0000 7fce0affd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fce0c09d920 0x7fce0c11d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:06.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.100+0000 7fce0b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce0c130fb0 0x7fce0c11daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54592/0 (socket says 172.21.15.40:54592) 2023-09-30T22:31:06.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.100+0000 7fce0affd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fce0c09d920 0x7fce0c11d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55346/0 (socket says 172.21.15.40:55346) 2023-09-30T22:31:06.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.100+0000 7fce0b7fe700 1 -- 172.21.15.40:0/2597595894 learned_addr learned my addr 172.21.15.40:0/2597595894 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:06.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.100+0000 7fce0a7fc700 1 --2- 172.21.15.40:0/2597595894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce0c09e230 0x7fce0c11d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:06.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.101+0000 7fce0affd700 1 -- 172.21.15.40:0/2597595894 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce0c130fb0 msgr2=0x7fce0c11daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:06.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.101+0000 7fce0affd700 1 --2- 172.21.15.40:0/2597595894 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce0c130fb0 0x7fce0c11daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.101+0000 7fce0affd700 1 -- 172.21.15.40:0/2597595894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce0c09e230 msgr2=0x7fce0c11d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:06.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.101+0000 7fce0affd700 1 --2- 172.21.15.40:0/2597595894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce0c09e230 0x7fce0c11d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.101+0000 7fce0affd700 1 -- 172.21.15.40:0/2597595894 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0400bd40 con 0x7fce0c09d920 2023-09-30T22:31:06.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.101+0000 7fce0affd700 1 --2- 172.21.15.40:0/2597595894 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fce0c09d920 0x7fce0c11d070 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc00e900 tx=0x7fcdfc00ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:06.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.101+0000 7fcdf37fe700 1 -- 172.21.15.40:0/2597595894 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc013680 con 0x7fce0c09d920 2023-09-30T22:31:06.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.101+0000 7fcdf37fe700 1 -- 172.21.15.40:0/2597595894 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdfc0137e0 con 0x7fce0c09d920 2023-09-30T22:31:06.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.101+0000 7fce112f7700 1 -- 172.21.15.40:0/2597595894 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce0c11fed0 con 0x7fce0c09d920 2023-09-30T22:31:06.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.101+0000 7fcdf37fe700 1 -- 172.21.15.40:0/2597595894 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc013b50 con 0x7fce0c09d920 2023-09-30T22:31:06.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.101+0000 7fce112f7700 1 -- 172.21.15.40:0/2597595894 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce0c1202e0 con 0x7fce0c09d920 2023-09-30T22:31:06.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.102+0000 7fcdf37fe700 1 -- 172.21.15.40:0/2597595894 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcdfc013cb0 con 0x7fce0c09d920 2023-09-30T22:31:06.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.102+0000 7fce112f7700 1 -- 172.21.15.40:0/2597595894 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce0c062380 con 0x7fce0c09d920 2023-09-30T22:31:06.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.102+0000 7fcdf37fe700 1 -- 172.21.15.40:0/2597595894 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fcdfc03f9f0 con 0x7fce0c09d920 2023-09-30T22:31:06.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.107+0000 7fcdf37fe700 1 -- 172.21.15.40:0/2597595894 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcdfc01adc0 con 0x7fce0c09d920 2023-09-30T22:31:06.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.135+0000 7fc44c2c6700 1 Processor -- start 2023-09-30T22:31:06.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.135+0000 7fc44c2c6700 1 -- start start 2023-09-30T22:31:06.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.135+0000 7f7e1261a700 1 Processor -- start 2023-09-30T22:31:06.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.135+0000 7f7e1261a700 1 -- start start 2023-09-30T22:31:06.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.136+0000 7f7e1261a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7e0c133e00 0x7f7e0c1341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.136+0000 7f7e1261a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e0c09d400 0x7f7e0c09d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.136+0000 7f7e1261a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e0c09dd70 0x7f7e0c13ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.136+0000 7f7e1261a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e0c09ab20 con 0x7f7e0c133e00 2023-09-30T22:31:06.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.136+0000 7f7e1261a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c133940 con 0x7f7e0c09d400 2023-09-30T22:31:06.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.136+0000 7f7e1261a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c09f0d0 con 0x7f7e0c09dd70 2023-09-30T22:31:06.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.136+0000 7f7e10bb7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e0c09dd70 0x7f7e0c13ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:06.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.136+0000 7fc44c2c6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc44406fb50 0x7fc444136c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.136+0000 7fc44c2c6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4441371b0 0x7fc444139590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.136+0000 7fc44c2c6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc444070830 con 0x7fc44406f070 2023-09-30T22:31:06.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.136+0000 7f7e10bb7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e0c09dd70 0x7f7e0c13ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55350/0 (socket says 172.21.15.40:55350) 2023-09-30T22:31:06.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.136+0000 7f7e10bb7700 1 -- 172.21.15.40:0/3265109146 learned_addr learned my addr 172.21.15.40:0/3265109146 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:06.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.136+0000 7f7e0b7fe700 1 --2- 172.21.15.40:0/3265109146 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e0c09d400 0x7f7e0c09d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:06.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.136+0000 7fc44c2c6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc444070ad0 con 0x7fc44406fb50 2023-09-30T22:31:06.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.136+0000 7fc44c2c6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc444070de0 con 0x7fc4441371b0 2023-09-30T22:31:06.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.136+0000 7fc44a863700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4441371b0 0x7fc444139590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:06.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.136+0000 7fc44a863700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4441371b0 0x7fc444139590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54608/0 (socket says 172.21.15.40:54608) 2023-09-30T22:31:06.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.136+0000 7fc44a863700 1 -- 172.21.15.40:0/313078480 learned_addr learned my addr 172.21.15.40:0/313078480 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:06.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.136+0000 7f7e10bb7700 1 -- 172.21.15.40:0/3265109146 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e0c09d400 msgr2=0x7f7e0c09d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:06.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.136+0000 7f7e10bb7700 1 --2- 172.21.15.40:0/3265109146 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e0c09d400 0x7f7e0c09d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.136+0000 7f7e10bb7700 1 -- 172.21.15.40:0/3265109146 >> v2:172.21.15.40:3300/0 conn(0x7f7e0c133e00 msgr2=0x7f7e0c1341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:06.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.136+0000 7f7e10bb7700 1 --2- 172.21.15.40:0/3265109146 >> v2:172.21.15.40:3300/0 conn(0x7f7e0c133e00 0x7f7e0c1341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.136+0000 7f7e10bb7700 1 -- 172.21.15.40:0/3265109146 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0c133be0 con 0x7f7e0c09dd70 2023-09-30T22:31:06.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.136+0000 7f7e0b7fe700 1 --2- 172.21.15.40:0/3265109146 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e0c09d400 0x7f7e0c09d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:06.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.137+0000 7fc44a863700 1 -- 172.21.15.40:0/313078480 >> v2:172.21.15.40:3300/0 conn(0x7fc44406fb50 msgr2=0x7fc444136c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:06.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.137+0000 7fc44a863700 1 --2- 172.21.15.40:0/313078480 >> v2:172.21.15.40:3300/0 conn(0x7fc44406fb50 0x7fc444136c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.137+0000 7fc44a863700 1 -- 172.21.15.40:0/313078480 >> v1:172.21.15.40:6789/0 conn(0x7fc44406f070 legacy=0x7fc44406f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:06.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.137+0000 7fc44a863700 1 -- 172.21.15.40:0/313078480 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44409fe20 con 0x7fc4441371b0 2023-09-30T22:31:06.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.137+0000 7f7e10bb7700 1 --2- 172.21.15.40:0/3265109146 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e0c09dd70 0x7f7e0c13ac70 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009e50 tx=0x7f7e0400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6ccbb529b0c260b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:06.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.137+0000 7f7e0affd700 1 -- 172.21.15.40:0/3265109146 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0400e070 con 0x7f7e0c09dd70 2023-09-30T22:31:06.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.137+0000 7fc44a863700 1 --2- 172.21.15.40:0/313078480 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4441371b0 0x7fc444139590 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fc43c009e50 tx=0x7fc43c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff75b7f0152b1532 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:06.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.137+0000 7f7e0affd700 1 -- 172.21.15.40:0/3265109146 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0400b9c0 con 0x7f7e0c09dd70 2023-09-30T22:31:06.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.137+0000 7f7e0affd700 1 -- 172.21.15.40:0/3265109146 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0400bd70 con 0x7f7e0c09dd70 2023-09-30T22:31:06.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.137+0000 7fc449060700 1 -- 172.21.15.40:0/313078480 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43c00e070 con 0x7fc4441371b0 2023-09-30T22:31:06.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.137+0000 7fc449060700 1 -- 172.21.15.40:0/313078480 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43c003a20 con 0x7fc4441371b0 2023-09-30T22:31:06.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.137+0000 7fc449060700 1 -- 172.21.15.40:0/313078480 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43c003dd0 con 0x7fc4441371b0 2023-09-30T22:31:06.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.138+0000 7f7e1261a700 1 -- 172.21.15.40:0/3265109146 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e0c09dd70 msgr2=0x7f7e0c13ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:06.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.138+0000 7f7e1261a700 1 --2- 172.21.15.40:0/3265109146 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e0c09dd70 0x7f7e0c13ac70 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009e50 tx=0x7f7e0400b330 comp rx=0 tx=0).stop 2023-09-30T22:31:06.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.138+0000 7f7e1261a700 1 -- 172.21.15.40:0/3265109146 shutdown_connections 2023-09-30T22:31:06.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.138+0000 7f7e1261a700 1 --2- 172.21.15.40:0/3265109146 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e0c09dd70 0x7f7e0c13ac70 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.138+0000 7f7e1261a700 1 --2- 172.21.15.40:0/3265109146 >> v2:172.21.15.40:3300/0 conn(0x7f7e0c133e00 0x7f7e0c1341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.138+0000 7f7e1261a700 1 --2- 172.21.15.40:0/3265109146 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e0c09d400 0x7f7e0c09d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.138+0000 7f7e1261a700 1 -- 172.21.15.40:0/3265109146 >> 172.21.15.40:0/3265109146 conn(0x7f7e0c0a2a00 msgr2=0x7f7e0c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:06.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.138+0000 7f7e1261a700 1 -- 172.21.15.40:0/3265109146 shutdown_connections 2023-09-30T22:31:06.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.138+0000 7f7e1261a700 1 -- 172.21.15.40:0/3265109146 wait complete. 2023-09-30T22:31:06.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.138+0000 7fc44c2c6700 1 -- 172.21.15.40:0/313078480 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4441371b0 msgr2=0x7fc444139590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:06.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.138+0000 7fc44c2c6700 1 --2- 172.21.15.40:0/313078480 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4441371b0 0x7fc444139590 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fc43c009e50 tx=0x7fc43c00b330 comp rx=0 tx=0).stop 2023-09-30T22:31:06.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.138+0000 7fc44c2c6700 1 -- 172.21.15.40:0/313078480 shutdown_connections 2023-09-30T22:31:06.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.138+0000 7fc44c2c6700 1 --2- 172.21.15.40:0/313078480 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4441371b0 0x7fc444139590 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.138+0000 7fc44c2c6700 1 --2- 172.21.15.40:0/313078480 >> v2:172.21.15.40:3300/0 conn(0x7fc44406fb50 0x7fc444136c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.138+0000 7fc44c2c6700 1 -- 172.21.15.40:0/313078480 >> 172.21.15.40:0/313078480 conn(0x7fc4440a41a0 msgr2=0x7fc4440a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:06.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.138+0000 7fc44c2c6700 1 -- 172.21.15.40:0/313078480 shutdown_connections 2023-09-30T22:31:06.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.138+0000 7fc44c2c6700 1 -- 172.21.15.40:0/313078480 wait complete. 2023-09-30T22:31:06.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.139+0000 7f7e1261a700 1 Processor -- start 2023-09-30T22:31:06.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.139+0000 7f7e1261a700 1 -- start start 2023-09-30T22:31:06.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.139+0000 7f7e1261a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e0c09d400 0x7f7e0c1d5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.139+0000 7f7e1261a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e0c09dd70 0x7f7e0c1d5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.139+0000 7f7e1261a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e0c133e00 0x7f7e0c1d5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.139+0000 7f7e1261a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c130320 con 0x7f7e0c09d400 2023-09-30T22:31:06.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.139+0000 7f7e1261a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c12ff60 con 0x7f7e0c133e00 2023-09-30T22:31:06.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.139+0000 7f7e1261a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c12fc50 con 0x7f7e0c09dd70 2023-09-30T22:31:06.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.140+0000 7fc44c2c6700 1 Processor -- start 2023-09-30T22:31:06.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.140+0000 7f7e0b7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e0c09dd70 0x7f7e0c1d5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:06.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.140+0000 7f7e0b7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e0c09dd70 0x7f7e0c1d5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55364/0 (socket says 172.21.15.40:55364) 2023-09-30T22:31:06.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.140+0000 7f7e0b7fe700 1 -- 172.21.15.40:0/521534656 learned_addr learned my addr 172.21.15.40:0/521534656 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:06.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.140+0000 7f7e0bfff700 1 --2- 172.21.15.40:0/521534656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e0c09d400 0x7f7e0c1d5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:06.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.140+0000 7f7e10bb7700 1 --2- 172.21.15.40:0/521534656 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e0c133e00 0x7f7e0c1d5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:06.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.140+0000 7f7e0b7fe700 1 -- 172.21.15.40:0/521534656 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e0c133e00 msgr2=0x7f7e0c1d5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:06.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.140+0000 7f7e0b7fe700 1 --2- 172.21.15.40:0/521534656 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e0c133e00 0x7f7e0c1d5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.140+0000 7f7e0b7fe700 1 -- 172.21.15.40:0/521534656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e0c09d400 msgr2=0x7f7e0c1d5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:06.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.140+0000 7f7e0b7fe700 1 --2- 172.21.15.40:0/521534656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e0c09d400 0x7f7e0c1d5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.140+0000 7f7e0b7fe700 1 -- 172.21.15.40:0/521534656 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e04009b30 con 0x7f7e0c09dd70 2023-09-30T22:31:06.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.140+0000 7f7e0b7fe700 1 --2- 172.21.15.40:0/521534656 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e0c09dd70 0x7f7e0c1d5690 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000e760 tx=0x7f7e0000ea70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:06.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.140+0000 7fc44c2c6700 1 -- start start 2023-09-30T22:31:06.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.140+0000 7fc44c2c6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc44406f070 0x7fc4441347d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.140+0000 7fc44c2c6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc44406fb50 0x7fc444134d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.140+0000 7fc44c2c6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4441371b0 0x7fc444135250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.140+0000 7fc44c2c6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc444135c30 con 0x7fc44406fb50 2023-09-30T22:31:06.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.140+0000 7fc44c2c6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc44412d9c0 con 0x7fc4441371b0 2023-09-30T22:31:06.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.140+0000 7fc44c2c6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc44412df60 con 0x7fc44406f070 2023-09-30T22:31:06.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.140+0000 7fc44a062700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc44406f070 0x7fc4441347d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:06.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.140+0000 7f7e08ff9700 1 -- 172.21.15.40:0/521534656 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e00013610 con 0x7f7e0c09dd70 2023-09-30T22:31:06.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.140+0000 7f7e08ff9700 1 -- 172.21.15.40:0/521534656 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e00013770 con 0x7f7e0c09dd70 2023-09-30T22:31:06.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.140+0000 7f7e08ff9700 1 -- 172.21.15.40:0/521534656 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e00013b20 con 0x7f7e0c09dd70 2023-09-30T22:31:06.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.140+0000 7fc44a062700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc44406f070 0x7fc4441347d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55378/0 (socket says 172.21.15.40:55378) 2023-09-30T22:31:06.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.140+0000 7fc44a062700 1 -- 172.21.15.40:0/2569846541 learned_addr learned my addr 172.21.15.40:0/2569846541 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:06.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.141+0000 7fc44a863700 1 --2- 172.21.15.40:0/2569846541 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4441371b0 0x7fc444135250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:06.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.141+0000 7fc449861700 1 --2- 172.21.15.40:0/2569846541 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc44406fb50 0x7fc444134d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:06.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.141+0000 7fc44a062700 1 -- 172.21.15.40:0/2569846541 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4441371b0 msgr2=0x7fc444135250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:06.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.141+0000 7fc44a062700 1 --2- 172.21.15.40:0/2569846541 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4441371b0 0x7fc444135250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.141+0000 7fc44a062700 1 -- 172.21.15.40:0/2569846541 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc44406fb50 msgr2=0x7fc444134d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:06.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.141+0000 7fc44a062700 1 --2- 172.21.15.40:0/2569846541 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc44406fb50 0x7fc444134d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.141+0000 7fc44a062700 1 -- 172.21.15.40:0/2569846541 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43c009b30 con 0x7fc44406f070 2023-09-30T22:31:06.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.141+0000 7fc44a062700 1 --2- 172.21.15.40:0/2569846541 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc44406f070 0x7fc4441347d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fc44000b470 tx=0x7fc44000b780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:06.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.141+0000 7fc43affd700 1 -- 172.21.15.40:0/2569846541 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc440011830 con 0x7fc44406f070 2023-09-30T22:31:06.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.141+0000 7fc43affd700 1 -- 172.21.15.40:0/2569846541 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4400119b0 con 0x7fc44406f070 2023-09-30T22:31:06.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.142+0000 7fc44c2c6700 1 -- 172.21.15.40:0/2569846541 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc44412d640 con 0x7fc44406f070 2023-09-30T22:31:06.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.142+0000 7fc43affd700 1 -- 172.21.15.40:0/2569846541 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc440011d60 con 0x7fc44406f070 2023-09-30T22:31:06.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.142+0000 7fc44c2c6700 1 -- 172.21.15.40:0/2569846541 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4441363e0 con 0x7fc44406f070 2023-09-30T22:31:06.156 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:06.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.141+0000 7f7e1261a700 1 -- 172.21.15.40:0/521534656 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e0c12e200 con 0x7f7e0c09dd70 2023-09-30T22:31:06.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.141+0000 7f7e1261a700 1 -- 172.21.15.40:0/521534656 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e0c1310e0 con 0x7f7e0c09dd70 2023-09-30T22:31:06.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.142+0000 7f7e08ff9700 1 -- 172.21.15.40:0/521534656 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7e00013c80 con 0x7f7e0c09dd70 2023-09-30T22:31:06.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.142+0000 7f7e08ff9700 1 -- 172.21.15.40:0/521534656 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f7e0003f300 con 0x7f7e0c09dd70 2023-09-30T22:31:06.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.142+0000 7f7e1261a700 1 -- 172.21.15.40:0/521534656 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e0c130180 con 0x7f7e0c09dd70 2023-09-30T22:31:06.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.142+0000 7fc43affd700 1 -- 172.21.15.40:0/2569846541 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc44001a400 con 0x7fc44406f070 2023-09-30T22:31:06.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.143+0000 7fc43affd700 1 -- 172.21.15.40:0/2569846541 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc44003f5d0 con 0x7fc44406f070 2023-09-30T22:31:06.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.143+0000 7fc44c2c6700 1 -- 172.21.15.40:0/2569846541 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc44412d7d0 con 0x7fc44406f070 2023-09-30T22:31:06.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.147+0000 7f7e08ff9700 1 -- 172.21.15.40:0/521534656 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e0c130180 con 0x7f7e0c09dd70 2023-09-30T22:31:06.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.152+0000 7fc43affd700 1 -- 172.21.15.40:0/2569846541 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc440015020 con 0x7fc44406f070 2023-09-30T22:31:06.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.289+0000 7f799de0f700 1 Processor -- start 2023-09-30T22:31:06.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.289+0000 7f799de0f700 1 -- start start 2023-09-30T22:31:06.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.289+0000 7f799de0f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f799809d920 0x7f799809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.289+0000 7f799de0f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f799809e230 0x7f79981308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.289+0000 7f799de0f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7998130de0 0x7f7998131260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.289+0000 7f799de0f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f799809edf0 con 0x7f799809e230 2023-09-30T22:31:06.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.289+0000 7f799de0f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f799809adf0 con 0x7f799809d920 2023-09-30T22:31:06.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.289+0000 7f799de0f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f799809b660 con 0x7f7998130de0 2023-09-30T22:31:06.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.289+0000 7f7997fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7998130de0 0x7f7998131260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:06.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.289+0000 7f7997fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7998130de0 0x7f7998131260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55386/0 (socket says 172.21.15.40:55386) 2023-09-30T22:31:06.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.289+0000 7f7997fff700 1 -- 172.21.15.40:0/4274043883 learned_addr learned my addr 172.21.15.40:0/4274043883 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:06.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.289+0000 7f79977fe700 1 --2- 172.21.15.40:0/4274043883 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f799809d920 0x7f799809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:06.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.290+0000 7f7997fff700 1 -- 172.21.15.40:0/4274043883 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f799809d920 msgr2=0x7f799809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:06.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.290+0000 7f7997fff700 1 --2- 172.21.15.40:0/4274043883 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f799809d920 0x7f799809dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.290+0000 7f7997fff700 1 -- 172.21.15.40:0/4274043883 >> v2:172.21.15.40:3300/0 conn(0x7f799809e230 msgr2=0x7f79981308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:06.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.290+0000 7f7997fff700 1 --2- 172.21.15.40:0/4274043883 >> v2:172.21.15.40:3300/0 conn(0x7f799809e230 0x7f79981308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.290+0000 7f7997fff700 1 -- 172.21.15.40:0/4274043883 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799809a6e0 con 0x7f7998130de0 2023-09-30T22:31:06.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.290+0000 7f79977fe700 1 --2- 172.21.15.40:0/4274043883 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f799809d920 0x7f799809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:06.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.290+0000 7f7997fff700 1 --2- 172.21.15.40:0/4274043883 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7998130de0 0x7f7998131260 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f799000bef0 tx=0x7f79900093b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d921f1c122a5cca server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:06.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.290+0000 7f79967fc700 1 -- 172.21.15.40:0/4274043883 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799000b4e0 con 0x7f7998130de0 2023-09-30T22:31:06.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.290+0000 7f79967fc700 1 -- 172.21.15.40:0/4274043883 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799000c950 con 0x7f7998130de0 2023-09-30T22:31:06.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.290+0000 7f79967fc700 1 -- 172.21.15.40:0/4274043883 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799000cd00 con 0x7f7998130de0 2023-09-30T22:31:06.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.291+0000 7f799de0f700 1 -- 172.21.15.40:0/4274043883 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7998130de0 msgr2=0x7f7998131260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:06.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.291+0000 7f799de0f700 1 --2- 172.21.15.40:0/4274043883 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7998130de0 0x7f7998131260 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f799000bef0 tx=0x7f79900093b0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.291+0000 7f799de0f700 1 -- 172.21.15.40:0/4274043883 shutdown_connections 2023-09-30T22:31:06.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.291+0000 7f799de0f700 1 --2- 172.21.15.40:0/4274043883 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7998130de0 0x7f7998131260 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.291+0000 7f799de0f700 1 --2- 172.21.15.40:0/4274043883 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f799809d920 0x7f799809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.291+0000 7f799de0f700 1 --2- 172.21.15.40:0/4274043883 >> v2:172.21.15.40:3300/0 conn(0x7f799809e230 0x7f79981308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.291+0000 7f799de0f700 1 -- 172.21.15.40:0/4274043883 >> 172.21.15.40:0/4274043883 conn(0x7f799809fb20 msgr2=0x7f799809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:06.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.291+0000 7f799de0f700 1 -- 172.21.15.40:0/4274043883 shutdown_connections 2023-09-30T22:31:06.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.291+0000 7f799de0f700 1 -- 172.21.15.40:0/4274043883 wait complete. 2023-09-30T22:31:06.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.292+0000 7f799de0f700 1 Processor -- start 2023-09-30T22:31:06.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.292+0000 7f799de0f700 1 -- start start 2023-09-30T22:31:06.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.292+0000 7f799de0f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f799809d920 0x7f799811a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.292+0000 7f799de0f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f799809e230 0x7f799811a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.292+0000 7f799de0f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7998130de0 0x7f799811aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:06.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.292+0000 7f799de0f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799811d780 con 0x7f799809e230 2023-09-30T22:31:06.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.292+0000 7f799de0f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f799809cb00 con 0x7f799809d920 2023-09-30T22:31:06.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.292+0000 7f799de0f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f799812c7a0 con 0x7f7998130de0 2023-09-30T22:31:06.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.293+0000 7f7997fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7998130de0 0x7f799811aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:06.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.293+0000 7f7996ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f799809e230 0x7f799811a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:06.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.293+0000 7f7997fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7998130de0 0x7f799811aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55396/0 (socket says 172.21.15.40:55396) 2023-09-30T22:31:06.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.293+0000 7f7997fff700 1 -- 172.21.15.40:0/2052663800 learned_addr learned my addr 172.21.15.40:0/2052663800 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:06.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.293+0000 7f79977fe700 1 --2- 172.21.15.40:0/2052663800 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f799809d920 0x7f799811a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:06.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.293+0000 7f7997fff700 1 -- 172.21.15.40:0/2052663800 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f799809d920 msgr2=0x7f799811a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:06.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.293+0000 7f7997fff700 1 --2- 172.21.15.40:0/2052663800 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f799809d920 0x7f799811a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.293+0000 7f7997fff700 1 -- 172.21.15.40:0/2052663800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f799809e230 msgr2=0x7f799811a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:06.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.293+0000 7f7997fff700 1 --2- 172.21.15.40:0/2052663800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f799809e230 0x7f799811a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.293+0000 7f7997fff700 1 -- 172.21.15.40:0/2052663800 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f798800d8d0 con 0x7f7998130de0 2023-09-30T22:31:06.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.293+0000 7f7997fff700 1 --2- 172.21.15.40:0/2052663800 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7998130de0 0x7f799811aaa0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f799809b7f0 tx=0x7f7990004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:06.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.293+0000 7f797ffff700 1 -- 172.21.15.40:0/2052663800 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7990009c40 con 0x7f7998130de0 2023-09-30T22:31:06.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.293+0000 7f797ffff700 1 -- 172.21.15.40:0/2052663800 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7990009dc0 con 0x7f7998130de0 2023-09-30T22:31:06.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.293+0000 7f799de0f700 1 -- 172.21.15.40:0/2052663800 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f799000bb50 con 0x7f7998130de0 2023-09-30T22:31:06.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.293+0000 7f797ffff700 1 -- 172.21.15.40:0/2052663800 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799002e660 con 0x7f7998130de0 2023-09-30T22:31:06.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.294+0000 7f799de0f700 1 -- 172.21.15.40:0/2052663800 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f799811cda0 con 0x7f7998130de0 2023-09-30T22:31:06.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.295+0000 7f799de0f700 1 -- 172.21.15.40:0/2052663800 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f799806f6f0 con 0x7f7998130de0 2023-09-30T22:31:06.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.295+0000 7f797ffff700 1 -- 172.21.15.40:0/2052663800 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f799001a070 con 0x7f7998130de0 2023-09-30T22:31:06.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.296+0000 7f797ffff700 1 -- 172.21.15.40:0/2052663800 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f79900524b0 con 0x7f7998130de0 2023-09-30T22:31:06.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.300+0000 7f797ffff700 1 -- 172.21.15.40:0/2052663800 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7990008370 con 0x7f7998130de0 2023-09-30T22:31:06.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.314+0000 7fce112f7700 1 -- 172.21.15.40:0/2597595894 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fce0c074720 con 0x7fce0c09d920 2023-09-30T22:31:06.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.315+0000 7fcdf37fe700 1 -- 172.21.15.40:0/2597595894 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcdfc021030 con 0x7fce0c09d920 2023-09-30T22:31:06.316 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:06.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.317+0000 7fce112f7700 1 -- 172.21.15.40:0/2597595894 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fce0c09d920 msgr2=0x7fce0c11d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:06.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.317+0000 7fce112f7700 1 --2- 172.21.15.40:0/2597595894 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fce0c09d920 0x7fce0c11d070 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc00e900 tx=0x7fcdfc00ec10 comp rx=0 tx=0).stop 2023-09-30T22:31:06.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.317+0000 7fce112f7700 1 -- 172.21.15.40:0/2597595894 shutdown_connections 2023-09-30T22:31:06.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.317+0000 7fce112f7700 1 --2- 172.21.15.40:0/2597595894 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fce0c09d920 0x7fce0c11d070 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.317+0000 7fce112f7700 1 --2- 172.21.15.40:0/2597595894 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fce0c130fb0 0x7fce0c11daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.317+0000 7fce112f7700 1 --2- 172.21.15.40:0/2597595894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce0c09e230 0x7fce0c11d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.317+0000 7fce112f7700 1 -- 172.21.15.40:0/2597595894 >> 172.21.15.40:0/2597595894 conn(0x7fce0c09fb20 msgr2=0x7fce0c130060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:06.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.318+0000 7fce112f7700 1 -- 172.21.15.40:0/2597595894 shutdown_connections 2023-09-30T22:31:06.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.318+0000 7fce112f7700 1 -- 172.21.15.40:0/2597595894 wait complete. 2023-09-30T22:31:06.331 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:06.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.350+0000 7f7e1261a700 1 -- 172.21.15.40:0/521534656 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7e0c130180 con 0x7f7e0c09dd70 2023-09-30T22:31:06.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.350+0000 7f7e08ff9700 1 -- 172.21.15.40:0/521534656 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7e0c130180 con 0x7f7e0c09dd70 2023-09-30T22:31:06.351 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:06.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.353+0000 7f7e1261a700 1 -- 172.21.15.40:0/521534656 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e0c09dd70 msgr2=0x7f7e0c1d5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:06.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.353+0000 7f7e1261a700 1 --2- 172.21.15.40:0/521534656 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e0c09dd70 0x7f7e0c1d5690 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000e760 tx=0x7f7e0000ea70 comp rx=0 tx=0).stop 2023-09-30T22:31:06.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.353+0000 7f7e1261a700 1 -- 172.21.15.40:0/521534656 shutdown_connections 2023-09-30T22:31:06.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.353+0000 7f7e1261a700 1 --2- 172.21.15.40:0/521534656 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e0c133e00 0x7f7e0c1d5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.353+0000 7f7e1261a700 1 --2- 172.21.15.40:0/521534656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e0c09d400 0x7f7e0c1d5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.353+0000 7f7e1261a700 1 --2- 172.21.15.40:0/521534656 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7e0c09dd70 0x7f7e0c1d5690 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.353+0000 7f7e1261a700 1 -- 172.21.15.40:0/521534656 >> 172.21.15.40:0/521534656 conn(0x7f7e0c0a2a00 msgr2=0x7f7e0c09b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:06.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.353+0000 7f7e1261a700 1 -- 172.21.15.40:0/521534656 shutdown_connections 2023-09-30T22:31:06.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.353+0000 7f7e1261a700 1 -- 172.21.15.40:0/521534656 wait complete. 2023-09-30T22:31:06.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.357+0000 7fc44c2c6700 1 -- 172.21.15.40:0/2569846541 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc4440a04e0 con 0x7fc44406f070 2023-09-30T22:31:06.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.357+0000 7fc43affd700 1 -- 172.21.15.40:0/2569846541 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc44000f8d0 con 0x7fc44406f070 2023-09-30T22:31:06.358 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:06.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.359+0000 7fc44c2c6700 1 -- 172.21.15.40:0/2569846541 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc44406f070 msgr2=0x7fc4441347d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:06.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.359+0000 7fc44c2c6700 1 --2- 172.21.15.40:0/2569846541 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc44406f070 0x7fc4441347d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fc44000b470 tx=0x7fc44000b780 comp rx=0 tx=0).stop 2023-09-30T22:31:06.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.360+0000 7fc44c2c6700 1 -- 172.21.15.40:0/2569846541 shutdown_connections 2023-09-30T22:31:06.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.360+0000 7fc44c2c6700 1 --2- 172.21.15.40:0/2569846541 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc44406f070 0x7fc4441347d0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.360+0000 7fc44c2c6700 1 --2- 172.21.15.40:0/2569846541 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4441371b0 0x7fc444135250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.360+0000 7fc44c2c6700 1 --2- 172.21.15.40:0/2569846541 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc44406fb50 0x7fc444134d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.360+0000 7fc44c2c6700 1 -- 172.21.15.40:0/2569846541 >> 172.21.15.40:0/2569846541 conn(0x7fc4440a41a0 msgr2=0x7fc444137580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:06.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.360+0000 7fc44c2c6700 1 -- 172.21.15.40:0/2569846541 shutdown_connections 2023-09-30T22:31:06.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.360+0000 7fc44c2c6700 1 -- 172.21.15.40:0/2569846541 wait complete. 2023-09-30T22:31:06.367 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:06.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:06.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.500+0000 7f799de0f700 1 -- 172.21.15.40:0/2052663800 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f799811d8c0 con 0x7f7998130de0 2023-09-30T22:31:06.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.501+0000 7f797ffff700 1 -- 172.21.15.40:0/2052663800 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f799811d8c0 con 0x7f7998130de0 2023-09-30T22:31:06.502 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:06.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.503+0000 7f799de0f700 1 -- 172.21.15.40:0/2052663800 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7998130de0 msgr2=0x7f799811aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:06.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.503+0000 7f799de0f700 1 --2- 172.21.15.40:0/2052663800 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7998130de0 0x7f799811aaa0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f799809b7f0 tx=0x7f7990004ad0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.503+0000 7f799de0f700 1 -- 172.21.15.40:0/2052663800 shutdown_connections 2023-09-30T22:31:06.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.503+0000 7f799de0f700 1 --2- 172.21.15.40:0/2052663800 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7998130de0 0x7f799811aaa0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.503+0000 7f799de0f700 1 --2- 172.21.15.40:0/2052663800 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f799809d920 0x7f799811a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.503+0000 7f799de0f700 1 --2- 172.21.15.40:0/2052663800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f799809e230 0x7f799811a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:06.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.503+0000 7f799de0f700 1 -- 172.21.15.40:0/2052663800 >> 172.21.15.40:0/2052663800 conn(0x7f799809fb20 msgr2=0x7f7998130190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:06.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.503+0000 7f799de0f700 1 -- 172.21.15.40:0/2052663800 shutdown_connections 2023-09-30T22:31:06.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:06.503+0000 7f799de0f700 1 -- 172.21.15.40:0/2052663800 wait complete. 2023-09-30T22:31:06.515 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:07.332 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:07.368 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:07.374 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:07.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.477+0000 7f1a685f7700 1 Processor -- start 2023-09-30T22:31:07.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.478+0000 7f1a685f7700 1 -- start start 2023-09-30T22:31:07.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.478+0000 7f1a685f7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1a60133e00 0x7f1a601341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:07.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.478+0000 7f1a685f7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1a6009d400 0x7f1a6009d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:07.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.478+0000 7f1a685f7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a6009dd70 0x7f1a6013ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:07.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.478+0000 7f1a685f7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a6009ab20 con 0x7f1a6009d400 2023-09-30T22:31:07.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.478+0000 7f1a685f7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a60133940 con 0x7f1a6009dd70 2023-09-30T22:31:07.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.478+0000 7f1a685f7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6009f0d0 con 0x7f1a60133e00 2023-09-30T22:31:07.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.478+0000 7f1a66b94700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a6009dd70 0x7f1a6013ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:07.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.478+0000 7f1a65b92700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1a6009d400 0x7f1a6009d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:07.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.478+0000 7f1a66b94700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a6009dd70 0x7f1a6013ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54648/0 (socket says 172.21.15.40:54648) 2023-09-30T22:31:07.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.478+0000 7f1a66b94700 1 -- 172.21.15.40:0/3219756168 learned_addr learned my addr 172.21.15.40:0/3219756168 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:07.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.478+0000 7f1a66393700 1 --2- 172.21.15.40:0/3219756168 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1a60133e00 0x7f1a601341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:07.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.479+0000 7f1a66b94700 1 -- 172.21.15.40:0/3219756168 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1a60133e00 msgr2=0x7f1a601341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:07.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.479+0000 7f1a66b94700 1 --2- 172.21.15.40:0/3219756168 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1a60133e00 0x7f1a601341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.479+0000 7f1a66b94700 1 -- 172.21.15.40:0/3219756168 >> v2:172.21.15.40:3300/0 conn(0x7f1a6009d400 msgr2=0x7f1a6009d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:07.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.479+0000 7f1a66b94700 1 --2- 172.21.15.40:0/3219756168 >> v2:172.21.15.40:3300/0 conn(0x7f1a6009d400 0x7f1a6009d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.479+0000 7f1a66b94700 1 -- 172.21.15.40:0/3219756168 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a6009e210 con 0x7f1a6009dd70 2023-09-30T22:31:07.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.479+0000 7f1a65b92700 1 --2- 172.21.15.40:0/3219756168 >> v2:172.21.15.40:3300/0 conn(0x7f1a6009d400 0x7f1a6009d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:07.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.479+0000 7f1a66393700 1 --2- 172.21.15.40:0/3219756168 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1a60133e00 0x7f1a601341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:07.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.479+0000 7f1a66b94700 1 --2- 172.21.15.40:0/3219756168 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a6009dd70 0x7f1a6013ac70 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f1a58009e50 tx=0x7f1a5800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbea24b8e27cba8b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:07.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.479+0000 7f1a65391700 1 -- 172.21.15.40:0/3219756168 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5800e070 con 0x7f1a6009dd70 2023-09-30T22:31:07.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.479+0000 7f1a65391700 1 -- 172.21.15.40:0/3219756168 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5800b910 con 0x7f1a6009dd70 2023-09-30T22:31:07.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.479+0000 7f1a65391700 1 -- 172.21.15.40:0/3219756168 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5800bcc0 con 0x7f1a6009dd70 2023-09-30T22:31:07.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.480+0000 7f1a685f7700 1 -- 172.21.15.40:0/3219756168 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a6009dd70 msgr2=0x7f1a6013ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:07.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.480+0000 7f1a685f7700 1 --2- 172.21.15.40:0/3219756168 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a6009dd70 0x7f1a6013ac70 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f1a58009e50 tx=0x7f1a5800b330 comp rx=0 tx=0).stop 2023-09-30T22:31:07.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.480+0000 7f1a685f7700 1 -- 172.21.15.40:0/3219756168 shutdown_connections 2023-09-30T22:31:07.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.480+0000 7f1a685f7700 1 --2- 172.21.15.40:0/3219756168 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1a60133e00 0x7f1a601341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.480+0000 7f1a685f7700 1 --2- 172.21.15.40:0/3219756168 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a6009dd70 0x7f1a6013ac70 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.480+0000 7f1a685f7700 1 --2- 172.21.15.40:0/3219756168 >> v2:172.21.15.40:3300/0 conn(0x7f1a6009d400 0x7f1a6009d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.480+0000 7f1a685f7700 1 -- 172.21.15.40:0/3219756168 >> 172.21.15.40:0/3219756168 conn(0x7f1a600a2a00 msgr2=0x7f1a600a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:07.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.480+0000 7f1a685f7700 1 -- 172.21.15.40:0/3219756168 shutdown_connections 2023-09-30T22:31:07.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.480+0000 7f1a685f7700 1 -- 172.21.15.40:0/3219756168 wait complete. 2023-09-30T22:31:07.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.481+0000 7f1a685f7700 1 Processor -- start 2023-09-30T22:31:07.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.481+0000 7f1a685f7700 1 -- start start 2023-09-30T22:31:07.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.481+0000 7f1a685f7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a6009d400 0x7f1a60119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:07.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.481+0000 7f1a685f7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a6009dd70 0x7f1a60119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:07.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.481+0000 7f1a685f7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1a60133e00 0x7f1a60119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.482+0000 7f1a685f7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6011cc70 con 0x7f1a6009dd70 2023-09-30T22:31:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.482+0000 7f1a685f7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6011a3a0 con 0x7f1a6009d400 2023-09-30T22:31:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.482+0000 7f1a685f7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6011a9c0 con 0x7f1a60133e00 2023-09-30T22:31:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.482+0000 7f1a66393700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a6009d400 0x7f1a60119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.482+0000 7f1a66393700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a6009d400 0x7f1a60119050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54660/0 (socket says 172.21.15.40:54660) 2023-09-30T22:31:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.482+0000 7f1a66393700 1 -- 172.21.15.40:0/3053395927 learned_addr learned my addr 172.21.15.40:0/3053395927 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.482+0000 7f1a65b92700 1 --2- 172.21.15.40:0/3053395927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a6009dd70 0x7f1a60119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.482+0000 7f1a66b94700 1 --2- 172.21.15.40:0/3053395927 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1a60133e00 0x7f1a60119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.482+0000 7f1a66393700 1 -- 172.21.15.40:0/3053395927 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1a60133e00 msgr2=0x7f1a60119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.482+0000 7f1a66393700 1 --2- 172.21.15.40:0/3053395927 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1a60133e00 0x7f1a60119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.482+0000 7f1a66393700 1 -- 172.21.15.40:0/3053395927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a6009dd70 msgr2=0x7f1a60119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:07.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.482+0000 7f1a66393700 1 --2- 172.21.15.40:0/3053395927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a6009dd70 0x7f1a60119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.482+0000 7f1a66393700 1 -- 172.21.15.40:0/3053395927 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a500094a0 con 0x7f1a6009d400 2023-09-30T22:31:07.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.482+0000 7f1a66393700 1 --2- 172.21.15.40:0/3053395927 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a6009d400 0x7f1a60119050 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00ec10 tx=0x7f1a5c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:07.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.482+0000 7f1a56ffd700 1 -- 172.21.15.40:0/3053395927 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c00c850 con 0x7f1a6009d400 2023-09-30T22:31:07.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.482+0000 7f1a56ffd700 1 -- 172.21.15.40:0/3053395927 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5c00c9b0 con 0x7f1a6009d400 2023-09-30T22:31:07.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.482+0000 7f1a685f7700 1 -- 172.21.15.40:0/3053395927 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a5c0094a0 con 0x7f1a6009d400 2023-09-30T22:31:07.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.482+0000 7f1a56ffd700 1 -- 172.21.15.40:0/3053395927 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c00cd20 con 0x7f1a6009d400 2023-09-30T22:31:07.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.483+0000 7f1a685f7700 1 -- 172.21.15.40:0/3053395927 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a58009b30 con 0x7f1a6009d400 2023-09-30T22:31:07.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.483+0000 7f1a56ffd700 1 -- 172.21.15.40:0/3053395927 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1a5c013470 con 0x7f1a6009d400 2023-09-30T22:31:07.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.483+0000 7f1a685f7700 1 -- 172.21.15.40:0/3053395927 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a6011ba40 con 0x7f1a6009d400 2023-09-30T22:31:07.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.484+0000 7f1a56ffd700 1 -- 172.21.15.40:0/3053395927 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f1a5c03f780 con 0x7f1a6009d400 2023-09-30T22:31:07.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.488+0000 7f1a56ffd700 1 -- 172.21.15.40:0/3053395927 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1a5c013720 con 0x7f1a6009d400 2023-09-30T22:31:07.516 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:07.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.516+0000 7ff3a91b3700 1 Processor -- start 2023-09-30T22:31:07.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.516+0000 7ff3a91b3700 1 -- start start 2023-09-30T22:31:07.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.516+0000 7fe1c717d700 1 Processor -- start 2023-09-30T22:31:07.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.516+0000 7fe1c717d700 1 -- start start 2023-09-30T22:31:07.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.516+0000 7ff3a91b3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff3a406a6d0 0x7ff3a406aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:07.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.516+0000 7ff3a91b3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3a4131fc0 0x7ff3a4139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:07.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.517+0000 7ff3a91b3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3a409eb50 con 0x7ff3a406afe0 2023-09-30T22:31:07.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.517+0000 7ff3a91b3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3a409dde0 con 0x7ff3a406a6d0 2023-09-30T22:31:07.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.517+0000 7ff3a91b3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a409d4a0 con 0x7ff3a4131fc0 2023-09-30T22:31:07.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.517+0000 7ff3a2d9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff3a406a6d0 0x7ff3a406aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:07.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.517+0000 7ff3a359e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3a4131fc0 0x7ff3a4139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:07.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.517+0000 7ff3a2d9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff3a406a6d0 0x7ff3a406aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35310/0 (socket says 172.21.15.40:35310) 2023-09-30T22:31:07.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.517+0000 7ff3a2d9d700 1 -- 172.21.15.40:0/3240980182 learned_addr learned my addr 172.21.15.40:0/3240980182 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:07.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.517+0000 7ff3a2d9d700 1 -- 172.21.15.40:0/3240980182 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3a4131fc0 msgr2=0x7ff3a4139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:07.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.517+0000 7ff3a2d9d700 1 --2- 172.21.15.40:0/3240980182 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3a4131fc0 0x7ff3a4139b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.517+0000 7ff3a2d9d700 1 -- 172.21.15.40:0/3240980182 >> v1:172.21.15.40:6789/0 conn(0x7ff3a406afe0 legacy=0x7ff3a41318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:07.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.517+0000 7ff3a2d9d700 1 -- 172.21.15.40:0/3240980182 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a409f5f0 con 0x7ff3a406a6d0 2023-09-30T22:31:07.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.517+0000 7ff3a2d9d700 1 --2- 172.21.15.40:0/3240980182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3a406a6d0 0x7ff3a406aaa0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7ff394006fd0 tx=0x7ff394009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1dc1220e6e6921c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:07.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.517+0000 7fe1c717d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1c009d920 0x7fe1c009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:07.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.517+0000 7fe1c717d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe1c009f0f0 0x7fe1c009e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:07.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.517+0000 7fe1c717d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1c009f940 con 0x7fe1c0133ca0 2023-09-30T22:31:07.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.517+0000 7fe1c717d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c006b4c0 con 0x7fe1c009d920 2023-09-30T22:31:07.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.517+0000 7fe1c717d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c009a8f0 con 0x7fe1c009f0f0 2023-09-30T22:31:07.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.517+0000 7fe1c4f19700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1c009d920 0x7fe1c009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:07.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.517+0000 7fe1c571a700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe1c0133ca0 0x7fe1c0134140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41998/0 (socket says 172.21.15.40:41998) 2023-09-30T22:31:07.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.517+0000 7fe1c571a700 1 -- 172.21.15.40:0/428466893 learned_addr learned my addr 172.21.15.40:0/428466893 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:07.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.517+0000 7ff3a1d9b700 1 -- 172.21.15.40:0/3240980182 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff394005e30 con 0x7ff3a406a6d0 2023-09-30T22:31:07.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.517+0000 7ff3a1d9b700 1 -- 172.21.15.40:0/3240980182 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff394004030 con 0x7ff3a406a6d0 2023-09-30T22:31:07.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.517+0000 7ff3a1d9b700 1 -- 172.21.15.40:0/3240980182 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3940043e0 con 0x7ff3a406a6d0 2023-09-30T22:31:07.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.518+0000 7fe1bf7fe700 1 -- 172.21.15.40:0/428466893 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1501887241 0 0) 0x7fe1c009f940 con 0x7fe1c0133ca0 2023-09-30T22:31:07.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.518+0000 7fe1bf7fe700 1 -- 172.21.15.40:0/428466893 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1b00035b0 con 0x7fe1c0133ca0 2023-09-30T22:31:07.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.518+0000 7fe1c4f19700 1 -- 172.21.15.40:0/428466893 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe1c009f0f0 msgr2=0x7fe1c009e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:07.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.518+0000 7fe1c4f19700 1 --2- 172.21.15.40:0/428466893 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe1c009f0f0 0x7fe1c009e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.518+0000 7fe1c4f19700 1 -- 172.21.15.40:0/428466893 >> v1:172.21.15.40:6789/0 conn(0x7fe1c0133ca0 legacy=0x7fe1c0134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:07.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.518+0000 7fe1c4f19700 1 -- 172.21.15.40:0/428466893 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c009f6e0 con 0x7fe1c009d920 2023-09-30T22:31:07.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.518+0000 7fe1c4f19700 1 --2- 172.21.15.40:0/428466893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1c009d920 0x7fe1c009dcf0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4009850 tx=0x7fe1b4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d4d01cbc03003ce server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:07.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.518+0000 7fe1bf7fe700 1 -- 172.21.15.40:0/428466893 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b4005e30 con 0x7fe1c009d920 2023-09-30T22:31:07.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.518+0000 7fe1bf7fe700 1 -- 172.21.15.40:0/428466893 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b4006030 con 0x7fe1c009d920 2023-09-30T22:31:07.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.518+0000 7fe1bf7fe700 1 -- 172.21.15.40:0/428466893 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b40063e0 con 0x7fe1c009d920 2023-09-30T22:31:07.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.518+0000 7ff3a91b3700 1 -- 172.21.15.40:0/3240980182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3a406a6d0 msgr2=0x7ff3a406aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:07.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.518+0000 7ff3a91b3700 1 --2- 172.21.15.40:0/3240980182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3a406a6d0 0x7ff3a406aaa0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7ff394006fd0 tx=0x7ff394009bd0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.518+0000 7ff3a91b3700 1 -- 172.21.15.40:0/3240980182 shutdown_connections 2023-09-30T22:31:07.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.518+0000 7ff3a91b3700 1 --2- 172.21.15.40:0/3240980182 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3a4131fc0 0x7ff3a4139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.518+0000 7ff3a91b3700 1 --2- 172.21.15.40:0/3240980182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3a406a6d0 0x7ff3a406aaa0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.518+0000 7ff3a91b3700 1 -- 172.21.15.40:0/3240980182 >> 172.21.15.40:0/3240980182 conn(0x7ff3a409fb20 msgr2=0x7ff3a409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:07.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.518+0000 7ff3a91b3700 1 -- 172.21.15.40:0/3240980182 shutdown_connections 2023-09-30T22:31:07.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.518+0000 7ff3a91b3700 1 -- 172.21.15.40:0/3240980182 wait complete. 2023-09-30T22:31:07.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.519+0000 7fe1c717d700 1 -- 172.21.15.40:0/428466893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1c009d920 msgr2=0x7fe1c009dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:07.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.519+0000 7fe1c717d700 1 --2- 172.21.15.40:0/428466893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1c009d920 0x7fe1c009dcf0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4009850 tx=0x7fe1b4009b60 comp rx=0 tx=0).stop 2023-09-30T22:31:07.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.519+0000 7fe1c717d700 1 -- 172.21.15.40:0/428466893 shutdown_connections 2023-09-30T22:31:07.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.519+0000 7fe1c717d700 1 --2- 172.21.15.40:0/428466893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1c009d920 0x7fe1c009dcf0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.519+0000 7fe1c717d700 1 --2- 172.21.15.40:0/428466893 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe1c009f0f0 0x7fe1c009e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.519+0000 7fe1c717d700 1 -- 172.21.15.40:0/428466893 >> 172.21.15.40:0/428466893 conn(0x7fe1c009fb20 msgr2=0x7fe1c009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:07.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.519+0000 7fe1c717d700 1 -- 172.21.15.40:0/428466893 shutdown_connections 2023-09-30T22:31:07.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.519+0000 7fe1c717d700 1 -- 172.21.15.40:0/428466893 wait complete. 2023-09-30T22:31:07.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.520+0000 7ff3a91b3700 1 Processor -- start 2023-09-30T22:31:07.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.520+0000 7ff3a91b3700 1 -- start start 2023-09-30T22:31:07.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.520+0000 7fe1c717d700 1 Processor -- start 2023-09-30T22:31:07.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.520+0000 7ff3a91b3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3a406a6d0 0x7ff3a4120710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:07.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.520+0000 7ff3a91b3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3a406afe0 0x7ff3a4120c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:07.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.520+0000 7ff3a91b3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff3a4131fc0 0x7ff3a4121190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:07.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.521+0000 7ff3a91b3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a40a3ef0 con 0x7ff3a406afe0 2023-09-30T22:31:07.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.521+0000 7ff3a91b3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a4123f50 con 0x7ff3a406a6d0 2023-09-30T22:31:07.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.521+0000 7ff3a91b3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a4131660 con 0x7ff3a4131fc0 2023-09-30T22:31:07.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.520+0000 7fe1c717d700 1 -- start start 2023-09-30T22:31:07.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.521+0000 7ff3a259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3a406afe0 0x7ff3a4120c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:07.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.521+0000 7ff3a259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3a406afe0 0x7ff3a4120c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35314/0 (socket says 172.21.15.40:35314) 2023-09-30T22:31:07.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.521+0000 7ff3a259c700 1 -- 172.21.15.40:0/2965699537 learned_addr learned my addr 172.21.15.40:0/2965699537 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:07.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.521+0000 7ff3a359e700 1 --2- 172.21.15.40:0/2965699537 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff3a4131fc0 0x7ff3a4121190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:07.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.521+0000 7ff3a259c700 1 -- 172.21.15.40:0/2965699537 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff3a4131fc0 msgr2=0x7ff3a4121190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:07.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.521+0000 7ff3a259c700 1 --2- 172.21.15.40:0/2965699537 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff3a4131fc0 0x7ff3a4121190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.521+0000 7ff3a259c700 1 -- 172.21.15.40:0/2965699537 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3a406a6d0 msgr2=0x7ff3a4120710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:07.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.521+0000 7ff3a259c700 1 --2- 172.21.15.40:0/2965699537 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3a406a6d0 0x7ff3a4120710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.521+0000 7ff3a259c700 1 -- 172.21.15.40:0/2965699537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff394009500 con 0x7ff3a406afe0 2023-09-30T22:31:07.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.521+0000 7fe1c717d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1c009d920 0x7fe1c01333b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:07.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.521+0000 7fe1c717d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1c0133ca0 0x7fe1c0135e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:07.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.521+0000 7ff3a259c700 1 --2- 172.21.15.40:0/2965699537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3a406afe0 0x7ff3a4120c50 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7ff39800c4e0 tx=0x7ff39800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:07.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.521+0000 7fe1c717d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe1c0136370 0x7fe1c01367e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:07.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.521+0000 7fe1c717d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c01391c0 con 0x7fe1c009d920 2023-09-30T22:31:07.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.521+0000 7fe1c717d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c0139840 con 0x7fe1c0133ca0 2023-09-30T22:31:07.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.521+0000 7fe1c717d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c00a23b0 con 0x7fe1c0136370 2023-09-30T22:31:07.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.522+0000 7fe1c571a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe1c0136370 0x7fe1c01367e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:07.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.522+0000 7fe1c571a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe1c0136370 0x7fe1c01367e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55444/0 (socket says 172.21.15.40:55444) 2023-09-30T22:31:07.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.522+0000 7fe1c571a700 1 -- 172.21.15.40:0/2311309761 learned_addr learned my addr 172.21.15.40:0/2311309761 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:07.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.522+0000 7fe1c4f19700 1 --2- 172.21.15.40:0/2311309761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1c009d920 0x7fe1c01333b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:07.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.522+0000 7ff38b7fe700 1 -- 172.21.15.40:0/2965699537 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3980052d0 con 0x7ff3a406afe0 2023-09-30T22:31:07.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.522+0000 7ff38b7fe700 1 -- 172.21.15.40:0/2965699537 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff398005430 con 0x7ff3a406afe0 2023-09-30T22:31:07.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.522+0000 7ff38b7fe700 1 -- 172.21.15.40:0/2965699537 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3980038c0 con 0x7ff3a406afe0 2023-09-30T22:31:07.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.522+0000 7fe1c571a700 1 -- 172.21.15.40:0/2311309761 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1c0133ca0 msgr2=0x7fe1c0135e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:07.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.522+0000 7fe1bffff700 1 --2- 172.21.15.40:0/2311309761 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1c0133ca0 0x7fe1c0135e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:07.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.522+0000 7ff3a91b3700 1 -- 172.21.15.40:0/2965699537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a4131230 con 0x7ff3a406afe0 2023-09-30T22:31:07.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.522+0000 7ff3a91b3700 1 -- 172.21.15.40:0/2965699537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a4122ad0 con 0x7ff3a406afe0 2023-09-30T22:31:07.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.523+0000 7ff3a91b3700 1 -- 172.21.15.40:0/2965699537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3a4123d90 con 0x7ff3a406afe0 2023-09-30T22:31:07.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.524+0000 7ff38b7fe700 1 -- 172.21.15.40:0/2965699537 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff398003a20 con 0x7ff3a406afe0 2023-09-30T22:31:07.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.524+0000 7ff38b7fe700 1 -- 172.21.15.40:0/2965699537 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff39803eed0 con 0x7ff3a406afe0 2023-09-30T22:31:07.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.523+0000 7fe1c571a700 1 --2- 172.21.15.40:0/2311309761 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1c0133ca0 0x7fe1c0135e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.523+0000 7fe1c571a700 1 -- 172.21.15.40:0/2311309761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1c009d920 msgr2=0x7fe1c01333b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:07.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.523+0000 7fe1c571a700 1 --2- 172.21.15.40:0/2311309761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1c009d920 0x7fe1c01333b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.523+0000 7fe1c571a700 1 -- 172.21.15.40:0/2311309761 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b4009430 con 0x7fe1c0136370 2023-09-30T22:31:07.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.523+0000 7fe1c4f19700 1 --2- 172.21.15.40:0/2311309761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1c009d920 0x7fe1c01333b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:07.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.523+0000 7fe1bffff700 1 --2- 172.21.15.40:0/2311309761 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1c0133ca0 0x7fe1c0135e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:31:07.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.523+0000 7fe1c571a700 1 --2- 172.21.15.40:0/2311309761 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe1c0136370 0x7fe1c01367e0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fe1b800cb40 tx=0x7fe1b800cf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:07.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.523+0000 7fe1bd7fa700 1 -- 172.21.15.40:0/2311309761 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b800ab50 con 0x7fe1c0136370 2023-09-30T22:31:07.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.523+0000 7fe1bd7fa700 1 -- 172.21.15.40:0/2311309761 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b800acb0 con 0x7fe1c0136370 2023-09-30T22:31:07.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.523+0000 7fe1bd7fa700 1 -- 172.21.15.40:0/2311309761 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b8012620 con 0x7fe1c0136370 2023-09-30T22:31:07.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.523+0000 7fe1c717d700 1 -- 172.21.15.40:0/2311309761 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c009c9e0 con 0x7fe1c0136370 2023-09-30T22:31:07.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.523+0000 7fe1c717d700 1 -- 172.21.15.40:0/2311309761 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c0137870 con 0x7fe1c0136370 2023-09-30T22:31:07.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.525+0000 7fe1c717d700 1 -- 172.21.15.40:0/2311309761 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1c0062380 con 0x7fe1c0136370 2023-09-30T22:31:07.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.526+0000 7fe1bd7fa700 1 -- 172.21.15.40:0/2311309761 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe1b801b3b0 con 0x7fe1c0136370 2023-09-30T22:31:07.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.531+0000 7ff38b7fe700 1 -- 172.21.15.40:0/2965699537 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff398003cd0 con 0x7ff3a406afe0 2023-09-30T22:31:07.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.526+0000 7fe1bd7fa700 1 -- 172.21.15.40:0/2311309761 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe1b803f660 con 0x7fe1c0136370 2023-09-30T22:31:07.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.534+0000 7fe1bd7fa700 1 -- 172.21.15.40:0/2311309761 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe1b80192c0 con 0x7fe1c0136370 2023-09-30T22:31:07.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.651+0000 7ff642b0c700 1 Processor -- start 2023-09-30T22:31:07.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.652+0000 7ff642b0c700 1 -- start start 2023-09-30T22:31:07.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.652+0000 7ff642b0c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff63c09c890 0x7ff63c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:07.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.652+0000 7ff642b0c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff63c09d920 0x7ff63c09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:07.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.652+0000 7ff642b0c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff63c09e2b0 0x7ff63c13ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:07.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.652+0000 7ff642b0c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff63c0a29d0 con 0x7ff63c09e2b0 2023-09-30T22:31:07.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.652+0000 7ff642b0c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c09fb40 con 0x7ff63c09c890 2023-09-30T22:31:07.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.652+0000 7ff642b0c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c0a2600 con 0x7ff63c09d920 2023-09-30T22:31:07.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.652+0000 7ff6408a8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff63c09c890 0x7ff63c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:07.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.652+0000 7ff6408a8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff63c09c890 0x7ff63c09cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54706/0 (socket says 172.21.15.40:54706) 2023-09-30T22:31:07.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.652+0000 7ff6408a8700 1 -- 172.21.15.40:0/1197535637 learned_addr learned my addr 172.21.15.40:0/1197535637 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:07.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.653+0000 7ff6410a9700 1 --2- 172.21.15.40:0/1197535637 >> v2:172.21.15.40:3300/0 conn(0x7ff63c09e2b0 0x7ff63c13ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:07.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.653+0000 7ff63bfff700 1 --2- 172.21.15.40:0/1197535637 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff63c09d920 0x7ff63c09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:07.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.653+0000 7ff6408a8700 1 -- 172.21.15.40:0/1197535637 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff63c09d920 msgr2=0x7ff63c09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:07.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.653+0000 7ff6408a8700 1 --2- 172.21.15.40:0/1197535637 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff63c09d920 0x7ff63c09dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.653+0000 7ff6408a8700 1 -- 172.21.15.40:0/1197535637 >> v2:172.21.15.40:3300/0 conn(0x7ff63c09e2b0 msgr2=0x7ff63c13ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:07.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.653+0000 7ff6408a8700 1 --2- 172.21.15.40:0/1197535637 >> v2:172.21.15.40:3300/0 conn(0x7ff63c09e2b0 0x7ff63c13ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.653+0000 7ff6408a8700 1 -- 172.21.15.40:0/1197535637 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff63c09e720 con 0x7ff63c09c890 2023-09-30T22:31:07.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.653+0000 7ff6408a8700 1 --2- 172.21.15.40:0/1197535637 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff63c09c890 0x7ff63c09cc60 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ff6300098f0 tx=0x7ff630009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c395917a12c7e8c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:07.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.653+0000 7ff63b7fe700 1 -- 172.21.15.40:0/1197535637 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff630005e30 con 0x7ff63c09c890 2023-09-30T22:31:07.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.653+0000 7ff63b7fe700 1 -- 172.21.15.40:0/1197535637 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff630004030 con 0x7ff63c09c890 2023-09-30T22:31:07.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.653+0000 7ff63b7fe700 1 -- 172.21.15.40:0/1197535637 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6300043e0 con 0x7ff63c09c890 2023-09-30T22:31:07.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.654+0000 7ff642b0c700 1 -- 172.21.15.40:0/1197535637 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff63c09c890 msgr2=0x7ff63c09cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:07.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.654+0000 7ff642b0c700 1 --2- 172.21.15.40:0/1197535637 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff63c09c890 0x7ff63c09cc60 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ff6300098f0 tx=0x7ff630009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:07.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.654+0000 7ff642b0c700 1 -- 172.21.15.40:0/1197535637 shutdown_connections 2023-09-30T22:31:07.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.654+0000 7ff642b0c700 1 --2- 172.21.15.40:0/1197535637 >> v2:172.21.15.40:3300/0 conn(0x7ff63c09e2b0 0x7ff63c13ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.654+0000 7ff642b0c700 1 --2- 172.21.15.40:0/1197535637 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff63c09c890 0x7ff63c09cc60 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.654+0000 7ff642b0c700 1 --2- 172.21.15.40:0/1197535637 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff63c09d920 0x7ff63c09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.654+0000 7ff642b0c700 1 -- 172.21.15.40:0/1197535637 >> 172.21.15.40:0/1197535637 conn(0x7ff63c0a7080 msgr2=0x7ff63c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:07.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.654+0000 7ff642b0c700 1 -- 172.21.15.40:0/1197535637 shutdown_connections 2023-09-30T22:31:07.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.654+0000 7ff642b0c700 1 -- 172.21.15.40:0/1197535637 wait complete. 2023-09-30T22:31:07.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.655+0000 7ff642b0c700 1 Processor -- start 2023-09-30T22:31:07.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.656+0000 7ff642b0c700 1 -- start start 2023-09-30T22:31:07.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.656+0000 7ff642b0c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff63c09c890 0x7ff63c1c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:07.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.656+0000 7ff642b0c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff63c09d920 0x7ff63c1c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:07.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.656+0000 7ff642b0c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff63c09e2b0 0x7ff63c1c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:07.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.656+0000 7ff642b0c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c12fae0 con 0x7ff63c09e2b0 2023-09-30T22:31:07.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.656+0000 7ff642b0c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c09c2f0 con 0x7ff63c09d920 2023-09-30T22:31:07.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.656+0000 7ff642b0c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c12f1e0 con 0x7ff63c09c890 2023-09-30T22:31:07.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.657+0000 7ff6408a8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff63c09c890 0x7ff63c1c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:07.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.657+0000 7ff63bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff63c09d920 0x7ff63c1c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:07.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.657+0000 7ff6408a8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff63c09c890 0x7ff63c1c89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55450/0 (socket says 172.21.15.40:55450) 2023-09-30T22:31:07.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.657+0000 7ff6408a8700 1 -- 172.21.15.40:0/2795567212 learned_addr learned my addr 172.21.15.40:0/2795567212 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:07.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.657+0000 7ff6410a9700 1 --2- 172.21.15.40:0/2795567212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff63c09e2b0 0x7ff63c1c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:07.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.657+0000 7ff6408a8700 1 -- 172.21.15.40:0/2795567212 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff63c09d920 msgr2=0x7ff63c1c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:07.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.657+0000 7ff6408a8700 1 --2- 172.21.15.40:0/2795567212 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff63c09d920 0x7ff63c1c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.657+0000 7ff6408a8700 1 -- 172.21.15.40:0/2795567212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff63c09e2b0 msgr2=0x7ff63c1c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:07.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.657+0000 7ff6408a8700 1 --2- 172.21.15.40:0/2795567212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff63c09e2b0 0x7ff63c1c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.657+0000 7ff6408a8700 1 -- 172.21.15.40:0/2795567212 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff630009500 con 0x7ff63c09c890 2023-09-30T22:31:07.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.657+0000 7ff6410a9700 1 --2- 172.21.15.40:0/2795567212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff63c09e2b0 0x7ff63c1c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:07.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.657+0000 7ff6408a8700 1 --2- 172.21.15.40:0/2795567212 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff63c09c890 0x7ff63c1c89e0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7ff630014040 tx=0x7ff630004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:07.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.657+0000 7ff6397fa700 1 -- 172.21.15.40:0/2795567212 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff630011420 con 0x7ff63c09c890 2023-09-30T22:31:07.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.657+0000 7ff6397fa700 1 -- 172.21.15.40:0/2795567212 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff630011580 con 0x7ff63c09c890 2023-09-30T22:31:07.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.658+0000 7ff642b0c700 1 -- 172.21.15.40:0/2795567212 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff63c0a5d80 con 0x7ff63c09c890 2023-09-30T22:31:07.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.658+0000 7ff6397fa700 1 -- 172.21.15.40:0/2795567212 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff630011930 con 0x7ff63c09c890 2023-09-30T22:31:07.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.658+0000 7ff642b0c700 1 -- 172.21.15.40:0/2795567212 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff63c12d340 con 0x7ff63c09c890 2023-09-30T22:31:07.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.659+0000 7ff6397fa700 1 -- 172.21.15.40:0/2795567212 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff630018030 con 0x7ff63c09c890 2023-09-30T22:31:07.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.659+0000 7ff6397fa700 1 -- 172.21.15.40:0/2795567212 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff630040280 con 0x7ff63c09c890 2023-09-30T22:31:07.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.659+0000 7ff642b0c700 1 -- 172.21.15.40:0/2795567212 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff63c062380 con 0x7ff63c09c890 2023-09-30T22:31:07.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.668+0000 7ff6397fa700 1 -- 172.21.15.40:0/2795567212 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff630029080 con 0x7ff63c09c890 2023-09-30T22:31:07.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.699+0000 7f1a685f7700 1 -- 172.21.15.40:0/3053395927 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1a6009c1b0 con 0x7f1a6009d400 2023-09-30T22:31:07.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.700+0000 7f1a56ffd700 1 -- 172.21.15.40:0/3053395927 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1a5c021070 con 0x7f1a6009d400 2023-09-30T22:31:07.701 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:07.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.702+0000 7f1a685f7700 1 -- 172.21.15.40:0/3053395927 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a6009d400 msgr2=0x7f1a60119050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:07.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.702+0000 7f1a685f7700 1 --2- 172.21.15.40:0/3053395927 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a6009d400 0x7f1a60119050 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00ec10 tx=0x7f1a5c00ef20 comp rx=0 tx=0).stop 2023-09-30T22:31:07.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.702+0000 7f1a685f7700 1 -- 172.21.15.40:0/3053395927 shutdown_connections 2023-09-30T22:31:07.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.702+0000 7f1a685f7700 1 --2- 172.21.15.40:0/3053395927 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1a60133e00 0x7f1a60119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.702+0000 7f1a685f7700 1 --2- 172.21.15.40:0/3053395927 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a6009d400 0x7f1a60119050 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.702+0000 7f1a685f7700 1 --2- 172.21.15.40:0/3053395927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a6009dd70 0x7f1a60119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.702+0000 7f1a685f7700 1 -- 172.21.15.40:0/3053395927 >> 172.21.15.40:0/3053395927 conn(0x7f1a600a2a00 msgr2=0x7f1a6012d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:07.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.702+0000 7f1a685f7700 1 -- 172.21.15.40:0/3053395927 shutdown_connections 2023-09-30T22:31:07.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.702+0000 7f1a685f7700 1 -- 172.21.15.40:0/3053395927 wait complete. 2023-09-30T22:31:07.715 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:07.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.744+0000 7ff3a91b3700 1 -- 172.21.15.40:0/2965699537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff3a4062380 con 0x7ff3a406afe0 2023-09-30T22:31:07.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.744+0000 7ff38b7fe700 1 -- 172.21.15.40:0/2965699537 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff398017090 con 0x7ff3a406afe0 2023-09-30T22:31:07.745 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:07.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.746+0000 7ff3a91b3700 1 -- 172.21.15.40:0/2965699537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3a406afe0 msgr2=0x7ff3a4120c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:07.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.746+0000 7ff3a91b3700 1 --2- 172.21.15.40:0/2965699537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3a406afe0 0x7ff3a4120c50 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7ff39800c4e0 tx=0x7ff39800c7f0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.746+0000 7ff3a91b3700 1 -- 172.21.15.40:0/2965699537 shutdown_connections 2023-09-30T22:31:07.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.746+0000 7ff3a91b3700 1 --2- 172.21.15.40:0/2965699537 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff3a4131fc0 0x7ff3a4121190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.746+0000 7ff3a91b3700 1 --2- 172.21.15.40:0/2965699537 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3a406a6d0 0x7ff3a4120710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.746+0000 7ff3a91b3700 1 --2- 172.21.15.40:0/2965699537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3a406afe0 0x7ff3a4120c50 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.746+0000 7ff3a91b3700 1 -- 172.21.15.40:0/2965699537 >> 172.21.15.40:0/2965699537 conn(0x7ff3a409fb20 msgr2=0x7ff3a40a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:07.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.747+0000 7ff3a91b3700 1 -- 172.21.15.40:0/2965699537 shutdown_connections 2023-09-30T22:31:07.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.747+0000 7ff3a91b3700 1 -- 172.21.15.40:0/2965699537 wait complete. 2023-09-30T22:31:07.761 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:07.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.767+0000 7fe1c717d700 1 -- 172.21.15.40:0/2311309761 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe1c0074720 con 0x7fe1c0136370 2023-09-30T22:31:07.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.768+0000 7fe1bd7fa700 1 -- 172.21.15.40:0/2311309761 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe1b8017070 con 0x7fe1c0136370 2023-09-30T22:31:07.768 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:07.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.770+0000 7fe1c717d700 1 -- 172.21.15.40:0/2311309761 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe1c0136370 msgr2=0x7fe1c01367e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:07.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.770+0000 7fe1c717d700 1 --2- 172.21.15.40:0/2311309761 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe1c0136370 0x7fe1c01367e0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fe1b800cb40 tx=0x7fe1b800cf00 comp rx=0 tx=0).stop 2023-09-30T22:31:07.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.770+0000 7fe1c717d700 1 -- 172.21.15.40:0/2311309761 shutdown_connections 2023-09-30T22:31:07.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.770+0000 7fe1c717d700 1 --2- 172.21.15.40:0/2311309761 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe1c0136370 0x7fe1c01367e0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.770+0000 7fe1c717d700 1 --2- 172.21.15.40:0/2311309761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1c009d920 0x7fe1c01333b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.770+0000 7fe1c717d700 1 --2- 172.21.15.40:0/2311309761 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1c0133ca0 0x7fe1c0135e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.770+0000 7fe1c717d700 1 -- 172.21.15.40:0/2311309761 >> 172.21.15.40:0/2311309761 conn(0x7fe1c009fb20 msgr2=0x7fe1c0129c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:07.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.770+0000 7fe1c717d700 1 -- 172.21.15.40:0/2311309761 shutdown_connections 2023-09-30T22:31:07.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.770+0000 7fe1c717d700 1 -- 172.21.15.40:0/2311309761 wait complete. 2023-09-30T22:31:07.783 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:07.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.883+0000 7ff642b0c700 1 -- 172.21.15.40:0/2795567212 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff63c074620 con 0x7ff63c09c890 2023-09-30T22:31:07.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.883+0000 7ff6397fa700 1 -- 172.21.15.40:0/2795567212 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff63001f020 con 0x7ff63c09c890 2023-09-30T22:31:07.884 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:07.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.885+0000 7ff642b0c700 1 -- 172.21.15.40:0/2795567212 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff63c09c890 msgr2=0x7ff63c1c89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:07.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.885+0000 7ff642b0c700 1 --2- 172.21.15.40:0/2795567212 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff63c09c890 0x7ff63c1c89e0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7ff630014040 tx=0x7ff630004750 comp rx=0 tx=0).stop 2023-09-30T22:31:07.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.885+0000 7ff642b0c700 1 -- 172.21.15.40:0/2795567212 shutdown_connections 2023-09-30T22:31:07.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.885+0000 7ff642b0c700 1 --2- 172.21.15.40:0/2795567212 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff63c09c890 0x7ff63c1c89e0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.885+0000 7ff642b0c700 1 --2- 172.21.15.40:0/2795567212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff63c09e2b0 0x7ff63c1c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.885+0000 7ff642b0c700 1 --2- 172.21.15.40:0/2795567212 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff63c09d920 0x7ff63c1c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:07.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.885+0000 7ff642b0c700 1 -- 172.21.15.40:0/2795567212 >> 172.21.15.40:0/2795567212 conn(0x7ff63c0a7080 msgr2=0x7ff63c0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:07.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.885+0000 7ff642b0c700 1 -- 172.21.15.40:0/2795567212 shutdown_connections 2023-09-30T22:31:07.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:07.885+0000 7ff642b0c700 1 -- 172.21.15.40:0/2795567212 wait complete. 2023-09-30T22:31:07.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:08.716 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:08.762 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:08.784 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:08.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.887+0000 7ff3d8112700 1 Processor -- start 2023-09-30T22:31:08.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.887+0000 7ff3d8112700 1 -- start start 2023-09-30T22:31:08.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.887+0000 7ff3d8112700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff3d009f0f0 0x7ff3d0138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:08.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.887+0000 7ff3d8112700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff3d009e400 0x7ff3d013b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:08.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.887+0000 7ff3d8112700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3d009f940 con 0x7ff3d009d920 2023-09-30T22:31:08.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.887+0000 7ff3d8112700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3d006b4c0 con 0x7ff3d009f0f0 2023-09-30T22:31:08.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.887+0000 7ff3d8112700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d009a8f0 con 0x7ff3d009e400 2023-09-30T22:31:08.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.888+0000 7ff3d66af700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff3d009e400 0x7ff3d013b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:08.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.888+0000 7ff3d66af700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff3d009e400 0x7ff3d013b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55460/0 (socket says 172.21.15.40:55460) 2023-09-30T22:31:08.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.888+0000 7ff3d56ad700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff3d009f0f0 0x7ff3d0138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:08.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.888+0000 7ff3d66af700 1 -- 172.21.15.40:0/1574685166 learned_addr learned my addr 172.21.15.40:0/1574685166 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:08.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.888+0000 7ff3d56ad700 1 -- 172.21.15.40:0/1574685166 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff3d009e400 msgr2=0x7ff3d013b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:08.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.888+0000 7ff3d56ad700 1 --2- 172.21.15.40:0/1574685166 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff3d009e400 0x7ff3d013b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.888+0000 7ff3d56ad700 1 -- 172.21.15.40:0/1574685166 >> v1:172.21.15.40:6789/0 conn(0x7ff3d009d920 legacy=0x7ff3d009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:08.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.888+0000 7ff3d56ad700 1 -- 172.21.15.40:0/1574685166 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d009f6e0 con 0x7ff3d009f0f0 2023-09-30T22:31:08.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.888+0000 7ff3d56ad700 1 --2- 172.21.15.40:0/1574685166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3d009f0f0 0x7ff3d0138ee0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0009840 tx=0x7ff3c0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd1fa8811e9b8fb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:08.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.888+0000 7ff3d4eac700 1 -- 172.21.15.40:0/1574685166 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0011830 con 0x7ff3d009f0f0 2023-09-30T22:31:08.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.888+0000 7ff3d4eac700 1 -- 172.21.15.40:0/1574685166 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c0011990 con 0x7ff3d009f0f0 2023-09-30T22:31:08.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.888+0000 7ff3d4eac700 1 -- 172.21.15.40:0/1574685166 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0011d20 con 0x7ff3d009f0f0 2023-09-30T22:31:08.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.889+0000 7ff3d8112700 1 -- 172.21.15.40:0/1574685166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3d009f0f0 msgr2=0x7ff3d0138ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:08.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.889+0000 7ff3d8112700 1 --2- 172.21.15.40:0/1574685166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3d009f0f0 0x7ff3d0138ee0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0009840 tx=0x7ff3c0009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:08.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.889+0000 7ff3d8112700 1 -- 172.21.15.40:0/1574685166 shutdown_connections 2023-09-30T22:31:08.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.889+0000 7ff3d8112700 1 --2- 172.21.15.40:0/1574685166 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff3d009e400 0x7ff3d013b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.889+0000 7ff3d8112700 1 --2- 172.21.15.40:0/1574685166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3d009f0f0 0x7ff3d0138ee0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.889+0000 7ff3d8112700 1 -- 172.21.15.40:0/1574685166 >> 172.21.15.40:0/1574685166 conn(0x7ff3d009fb20 msgr2=0x7ff3d009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:08.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.889+0000 7ff3d8112700 1 -- 172.21.15.40:0/1574685166 shutdown_connections 2023-09-30T22:31:08.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.889+0000 7ff3d8112700 1 -- 172.21.15.40:0/1574685166 wait complete. 2023-09-30T22:31:08.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.890+0000 7ff3d8112700 1 Processor -- start 2023-09-30T22:31:08.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.890+0000 7ff3d8112700 1 -- start start 2023-09-30T22:31:08.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.891+0000 7ff3d8112700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3d009d920 0x7ff3d011e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:08.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.891+0000 7ff3d8112700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3d009e400 0x7ff3d011ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:08.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.891+0000 7ff3d8112700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff3d011f1f0 0x7ff3d01c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:08.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.891+0000 7ff3d8112700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d00a32d0 con 0x7ff3d009e400 2023-09-30T22:31:08.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.891+0000 7ff3d8112700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d0120920 con 0x7ff3d009d920 2023-09-30T22:31:08.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.891+0000 7ff3d8112700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d009c9e0 con 0x7ff3d011f1f0 2023-09-30T22:31:08.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.891+0000 7ff3d5eae700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3d009d920 0x7ff3d011e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:08.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.891+0000 7ff3d5eae700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3d009d920 0x7ff3d011e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54730/0 (socket says 172.21.15.40:54730) 2023-09-30T22:31:08.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.891+0000 7ff3d66af700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff3d011f1f0 0x7ff3d01c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:08.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.891+0000 7ff3d5eae700 1 -- 172.21.15.40:0/1979834167 learned_addr learned my addr 172.21.15.40:0/1979834167 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:08.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.891+0000 7ff3d56ad700 1 --2- 172.21.15.40:0/1979834167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3d009e400 0x7ff3d011ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:08.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.891+0000 7ff3d66af700 1 -- 172.21.15.40:0/1979834167 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3d009d920 msgr2=0x7ff3d011e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:08.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.891+0000 7ff3d66af700 1 --2- 172.21.15.40:0/1979834167 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3d009d920 0x7ff3d011e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.891+0000 7ff3d66af700 1 -- 172.21.15.40:0/1979834167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3d009e400 msgr2=0x7ff3d011ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:08.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.891+0000 7ff3d66af700 1 --2- 172.21.15.40:0/1979834167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3d009e400 0x7ff3d011ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.891+0000 7ff3d66af700 1 -- 172.21.15.40:0/1979834167 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c00094a0 con 0x7ff3d011f1f0 2023-09-30T22:31:08.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.892+0000 7ff3d66af700 1 --2- 172.21.15.40:0/1979834167 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff3d011f1f0 0x7ff3d01c8880 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7ff3c800efc0 tx=0x7ff3c800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:08.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.892+0000 7ff3c67fc700 1 -- 172.21.15.40:0/1979834167 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c8003c20 con 0x7ff3d011f1f0 2023-09-30T22:31:08.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.892+0000 7ff3c67fc700 1 -- 172.21.15.40:0/1979834167 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c800f040 con 0x7ff3d011f1f0 2023-09-30T22:31:08.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.892+0000 7ff3d8112700 1 -- 172.21.15.40:0/1979834167 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3d0121a20 con 0x7ff3d011f1f0 2023-09-30T22:31:08.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.892+0000 7ff3c67fc700 1 -- 172.21.15.40:0/1979834167 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c8009e60 con 0x7ff3d011f1f0 2023-09-30T22:31:08.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.892+0000 7ff3d8112700 1 -- 172.21.15.40:0/1979834167 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3d0120b70 con 0x7ff3d011f1f0 2023-09-30T22:31:08.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.893+0000 7ff3c67fc700 1 -- 172.21.15.40:0/1979834167 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff3c800c880 con 0x7ff3d011f1f0 2023-09-30T22:31:08.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.893+0000 7ff3c67fc700 1 -- 172.21.15.40:0/1979834167 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff3c803fa20 con 0x7ff3d011f1f0 2023-09-30T22:31:08.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.894+0000 7ff3d8112700 1 -- 172.21.15.40:0/1979834167 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3d0062380 con 0x7ff3d011f1f0 2023-09-30T22:31:08.899 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:08.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.899+0000 7ff3c67fc700 1 -- 172.21.15.40:0/1979834167 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff3c801c360 con 0x7ff3d011f1f0 2023-09-30T22:31:08.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.915+0000 7f8e6f16a700 1 Processor -- start 2023-09-30T22:31:08.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.915+0000 7f8e6f16a700 1 -- start start 2023-09-30T22:31:08.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.916+0000 7f8e6f16a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8e6812e590 0x7f8e6812e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:08.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.916+0000 7f8e6f16a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e6812eea0 0x7f8e6812d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:08.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.916+0000 7f8e6f16a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e6809ab70 con 0x7f8e6812d6d0 2023-09-30T22:31:08.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.916+0000 7f8e6f16a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e6809b270 con 0x7f8e6812e590 2023-09-30T22:31:08.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.916+0000 7f8e6f16a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6809bab0 con 0x7f8e6812eea0 2023-09-30T22:31:08.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.916+0000 7f8e6cf06700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8e6812e590 0x7f8e6812e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:08.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.916+0000 7f8e6cf06700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8e6812e590 0x7f8e6812e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35356/0 (socket says 172.21.15.40:35356) 2023-09-30T22:31:08.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.916+0000 7f8e6cf06700 1 -- 172.21.15.40:0/1053791358 learned_addr learned my addr 172.21.15.40:0/1053791358 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:08.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.916+0000 7f8e6cf06700 1 -- 172.21.15.40:0/1053791358 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e6812eea0 msgr2=0x7f8e6812d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:08.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.916+0000 7f8e6cf06700 1 --2- 172.21.15.40:0/1053791358 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e6812eea0 0x7f8e6812d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.916+0000 7f8e6cf06700 1 -- 172.21.15.40:0/1053791358 >> v1:172.21.15.40:6789/0 conn(0x7f8e6812d6d0 legacy=0x7f8e68137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:08.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.916+0000 7f8e6cf06700 1 -- 172.21.15.40:0/1053791358 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e6809bd70 con 0x7f8e6812e590 2023-09-30T22:31:08.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.917+0000 7f8e6cf06700 1 --2- 172.21.15.40:0/1053791358 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e6812e590 0x7f8e6812e960 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c009920 tx=0x7f8e5c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe446c8e0357e1ff server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:08.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.917+0000 7f8e677fe700 1 -- 172.21.15.40:0/1053791358 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c00ba20 con 0x7f8e6812e590 2023-09-30T22:31:08.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.917+0000 7f8e677fe700 1 -- 172.21.15.40:0/1053791358 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e5c00bb80 con 0x7f8e6812e590 2023-09-30T22:31:08.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.917+0000 7f8e677fe700 1 -- 172.21.15.40:0/1053791358 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c009e70 con 0x7f8e6812e590 2023-09-30T22:31:08.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.917+0000 7f8e6f16a700 1 -- 172.21.15.40:0/1053791358 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e6812e590 msgr2=0x7f8e6812e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:08.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.917+0000 7f8e6f16a700 1 --2- 172.21.15.40:0/1053791358 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e6812e590 0x7f8e6812e960 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c009920 tx=0x7f8e5c009c30 comp rx=0 tx=0).stop 2023-09-30T22:31:08.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.918+0000 7f8e6f16a700 1 -- 172.21.15.40:0/1053791358 shutdown_connections 2023-09-30T22:31:08.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.918+0000 7f8e6f16a700 1 --2- 172.21.15.40:0/1053791358 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e6812e590 0x7f8e6812e960 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.918+0000 7f8e6f16a700 1 --2- 172.21.15.40:0/1053791358 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e6812eea0 0x7f8e6812d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.918+0000 7f8e6f16a700 1 -- 172.21.15.40:0/1053791358 >> 172.21.15.40:0/1053791358 conn(0x7f8e680a2a00 msgr2=0x7f8e680a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:08.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.918+0000 7f8e6f16a700 1 -- 172.21.15.40:0/1053791358 shutdown_connections 2023-09-30T22:31:08.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.918+0000 7f8e6f16a700 1 -- 172.21.15.40:0/1053791358 wait complete. 2023-09-30T22:31:08.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.919+0000 7f8e6f16a700 1 Processor -- start 2023-09-30T22:31:08.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.919+0000 7f8e6f16a700 1 -- start start 2023-09-30T22:31:08.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.919+0000 7f8e6f16a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e6812d6d0 0x7f8e680702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:08.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.919+0000 7f8e6f16a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e6812e590 0x7f8e680707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:08.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.919+0000 7f8e6f16a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e6812eea0 0x7f8e681c6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:08.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.919+0000 7f8e6f16a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e68128080 con 0x7f8e6812eea0 2023-09-30T22:31:08.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.919+0000 7f8e6f16a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e68128b00 con 0x7f8e6812d6d0 2023-09-30T22:31:08.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.919+0000 7f8e6f16a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e68128d80 con 0x7f8e6812e590 2023-09-30T22:31:08.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.919+0000 7f8e6cf06700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e6812d6d0 0x7f8e680702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:08.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.919+0000 7f8e6cf06700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e6812d6d0 0x7f8e680702b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54742/0 (socket says 172.21.15.40:54742) 2023-09-30T22:31:08.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.919+0000 7f8e6cf06700 1 -- 172.21.15.40:0/2740775530 learned_addr learned my addr 172.21.15.40:0/2740775530 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:08.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.920+0000 7f8e6d707700 1 --2- 172.21.15.40:0/2740775530 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e6812eea0 0x7f8e681c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:08.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.920+0000 7f8e6cf06700 1 -- 172.21.15.40:0/2740775530 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e6812e590 msgr2=0x7f8e680707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:08.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.920+0000 7f8e6cf06700 1 --2- 172.21.15.40:0/2740775530 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e6812e590 0x7f8e680707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.920+0000 7f8e6cf06700 1 -- 172.21.15.40:0/2740775530 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e6812eea0 msgr2=0x7f8e681c6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:08.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.920+0000 7f8e6cf06700 1 --2- 172.21.15.40:0/2740775530 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e6812eea0 0x7f8e681c6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.920+0000 7f8e6cf06700 1 -- 172.21.15.40:0/2740775530 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5c009550 con 0x7f8e6812d6d0 2023-09-30T22:31:08.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.920+0000 7f8e6d707700 1 --2- 172.21.15.40:0/2740775530 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e6812eea0 0x7f8e681c6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:08.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.920+0000 7f8e6cf06700 1 --2- 172.21.15.40:0/2740775530 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e6812d6d0 0x7f8e680702b0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f8e6809b3b0 tx=0x7f8e5c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:08.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.920+0000 7f8e657fa700 1 -- 172.21.15.40:0/2740775530 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c0036a0 con 0x7f8e6812d6d0 2023-09-30T22:31:08.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.920+0000 7f8e657fa700 1 -- 172.21.15.40:0/2740775530 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e5c003820 con 0x7f8e6812d6d0 2023-09-30T22:31:08.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.920+0000 7f8e6f16a700 1 -- 172.21.15.40:0/2740775530 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e6809b4b0 con 0x7f8e6812d6d0 2023-09-30T22:31:08.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.920+0000 7f8e657fa700 1 -- 172.21.15.40:0/2740775530 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c003bd0 con 0x7f8e6812d6d0 2023-09-30T22:31:08.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.920+0000 7f8e6f16a700 1 -- 172.21.15.40:0/2740775530 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e68070d30 con 0x7f8e6812d6d0 2023-09-30T22:31:08.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.922+0000 7f8e6f16a700 1 -- 172.21.15.40:0/2740775530 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e68127a10 con 0x7f8e6812d6d0 2023-09-30T22:31:08.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.922+0000 7f8e657fa700 1 -- 172.21.15.40:0/2740775530 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8e5c003d30 con 0x7f8e6812d6d0 2023-09-30T22:31:08.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.922+0000 7f8e657fa700 1 -- 172.21.15.40:0/2740775530 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f8e5c040ed0 con 0x7f8e6812d6d0 2023-09-30T22:31:08.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.927+0000 7f8e657fa700 1 -- 172.21.15.40:0/2740775530 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e5c02b360 con 0x7f8e6812d6d0 2023-09-30T22:31:08.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.994+0000 7f0f2b2ed700 1 Processor -- start 2023-09-30T22:31:08.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.994+0000 7f0f2b2ed700 1 -- start start 2023-09-30T22:31:08.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.995+0000 7f0f2b2ed700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0f24134a90 0x7f0f24136e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:08.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.995+0000 7f0f2b2ed700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0f241373b0 0x7f0f24139790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:08.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.995+0000 7f0f2b2ed700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f24131900 con 0x7f0f24131d50 2023-09-30T22:31:08.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.995+0000 7f0f2b2ed700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f240719e0 con 0x7f0f24134a90 2023-09-30T22:31:08.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.995+0000 7f0f2b2ed700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2409e820 con 0x7f0f241373b0 2023-09-30T22:31:08.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.995+0000 7f0f28888700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0f24134a90 0x7f0f24136e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:08.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.995+0000 7f0f28888700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0f24134a90 0x7f0f24136e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54748/0 (socket says 172.21.15.40:54748) 2023-09-30T22:31:08.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.995+0000 7f0f29089700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f0f24131d50 0x7f0f24132120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:42024/0 (socket says 172.21.15.40:42024) 2023-09-30T22:31:08.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.995+0000 7f0f28888700 1 -- 172.21.15.40:0/532782440 learned_addr learned my addr 172.21.15.40:0/532782440 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:08.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.995+0000 7f0f2988a700 1 --2- 172.21.15.40:0/532782440 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0f241373b0 0x7f0f24139790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:08.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.995+0000 7f0f28888700 1 -- 172.21.15.40:0/532782440 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0f241373b0 msgr2=0x7f0f24139790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:08.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.995+0000 7f0f28888700 1 --2- 172.21.15.40:0/532782440 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0f241373b0 0x7f0f24139790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:08.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.995+0000 7f0f28888700 1 -- 172.21.15.40:0/532782440 >> v1:172.21.15.40:6789/0 conn(0x7f0f24131d50 legacy=0x7f0f24132120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:08.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.995+0000 7f0f28888700 1 -- 172.21.15.40:0/532782440 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f2409ef60 con 0x7f0f24134a90 2023-09-30T22:31:08.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.995+0000 7f0f28888700 1 --2- 172.21.15.40:0/532782440 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0f24134a90 0x7f0f24136e70 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f0f14009920 tx=0x7f0f14009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22637c87597bba98 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:08.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.996+0000 7f0f1bfff700 1 -- 172.21.15.40:0/532782440 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f14011830 con 0x7f0f24134a90 2023-09-30T22:31:08.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.996+0000 7f0f1bfff700 1 -- 172.21.15.40:0/532782440 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f14011990 con 0x7f0f24134a90 2023-09-30T22:31:08.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.996+0000 7f0f1bfff700 1 -- 172.21.15.40:0/532782440 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f14011d20 con 0x7f0f24134a90 2023-09-30T22:31:09.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.996+0000 7f0f2b2ed700 1 -- 172.21.15.40:0/532782440 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0f24134a90 msgr2=0x7f0f24136e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:09.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.996+0000 7f0f2b2ed700 1 --2- 172.21.15.40:0/532782440 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0f24134a90 0x7f0f24136e70 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f0f14009920 tx=0x7f0f14009c30 comp rx=0 tx=0).stop 2023-09-30T22:31:09.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.997+0000 7f0f2b2ed700 1 -- 172.21.15.40:0/532782440 shutdown_connections 2023-09-30T22:31:09.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.997+0000 7f0f2b2ed700 1 --2- 172.21.15.40:0/532782440 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0f241373b0 0x7f0f24139790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.997+0000 7f0f2b2ed700 1 --2- 172.21.15.40:0/532782440 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0f24134a90 0x7f0f24136e70 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.997+0000 7f0f2b2ed700 1 -- 172.21.15.40:0/532782440 >> 172.21.15.40:0/532782440 conn(0x7f0f240a2a00 msgr2=0x7f0f240a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:09.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.997+0000 7f0f2b2ed700 1 -- 172.21.15.40:0/532782440 shutdown_connections 2023-09-30T22:31:09.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.997+0000 7f0f2b2ed700 1 -- 172.21.15.40:0/532782440 wait complete. 2023-09-30T22:31:09.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.998+0000 7f0f2b2ed700 1 Processor -- start 2023-09-30T22:31:09.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.998+0000 7f0f2b2ed700 1 -- start start 2023-09-30T22:31:09.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.999+0000 7f0f2b2ed700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0f24131d50 0x7f0f241c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:09.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.999+0000 7f0f2b2ed700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0f24134a90 0x7f0f241c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:09.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.999+0000 7f0f2b2ed700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f241373b0 0x7f0f241c9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:09.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.999+0000 7f0f2b2ed700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f240a02e0 con 0x7f0f241373b0 2023-09-30T22:31:09.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.999+0000 7f0f2b2ed700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2409ea60 con 0x7f0f24134a90 2023-09-30T22:31:09.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.999+0000 7f0f2b2ed700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2409aeb0 con 0x7f0f24131d50 2023-09-30T22:31:09.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.999+0000 7f0f29089700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0f24131d50 0x7f0f241c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:09.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.999+0000 7f0f29089700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0f24131d50 0x7f0f241c86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55532/0 (socket says 172.21.15.40:55532) 2023-09-30T22:31:09.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.999+0000 7f0f29089700 1 -- 172.21.15.40:0/800673025 learned_addr learned my addr 172.21.15.40:0/800673025 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:09.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.999+0000 7f0f28888700 1 --2- 172.21.15.40:0/800673025 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0f24134a90 0x7f0f241c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:09.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.999+0000 7f0f2988a700 1 --2- 172.21.15.40:0/800673025 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f241373b0 0x7f0f241c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:09.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.999+0000 7f0f29089700 1 -- 172.21.15.40:0/800673025 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0f24134a90 msgr2=0x7f0f241c8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:09.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.999+0000 7f0f29089700 1 --2- 172.21.15.40:0/800673025 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0f24134a90 0x7f0f241c8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.999+0000 7f0f29089700 1 -- 172.21.15.40:0/800673025 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f241373b0 msgr2=0x7f0f241c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:09.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.999+0000 7f0f29089700 1 --2- 172.21.15.40:0/800673025 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f241373b0 0x7f0f241c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:08.999+0000 7f0f29089700 1 -- 172.21.15.40:0/800673025 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f14009550 con 0x7f0f24131d50 2023-09-30T22:31:09.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.000+0000 7f0f2988a700 1 --2- 172.21.15.40:0/800673025 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f241373b0 0x7f0f241c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:09.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.000+0000 7f0f29089700 1 --2- 172.21.15.40:0/800673025 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0f24131d50 0x7f0f241c86c0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f0f2000c500 tx=0x7f0f2000c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:09.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.000+0000 7f0f19ffb700 1 -- 172.21.15.40:0/800673025 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f20005cb0 con 0x7f0f24131d50 2023-09-30T22:31:09.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.000+0000 7f0f19ffb700 1 -- 172.21.15.40:0/800673025 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f20005e10 con 0x7f0f24131d50 2023-09-30T22:31:09.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.000+0000 7f0f2b2ed700 1 -- 172.21.15.40:0/800673025 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f2409ab90 con 0x7f0f24131d50 2023-09-30T22:31:09.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.000+0000 7f0f19ffb700 1 -- 172.21.15.40:0/800673025 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f200072d0 con 0x7f0f24131d50 2023-09-30T22:31:09.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.000+0000 7f0f2b2ed700 1 -- 172.21.15.40:0/800673025 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f2411dd80 con 0x7f0f24131d50 2023-09-30T22:31:09.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.001+0000 7f0f2b2ed700 1 -- 172.21.15.40:0/800673025 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f24062380 con 0x7f0f24131d50 2023-09-30T22:31:09.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.002+0000 7f0f19ffb700 1 -- 172.21.15.40:0/800673025 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0f20007430 con 0x7f0f24131d50 2023-09-30T22:31:09.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.008+0000 7f0f19ffb700 1 -- 172.21.15.40:0/800673025 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f0f2001a920 con 0x7f0f24131d50 2023-09-30T22:31:09.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.010+0000 7f0f19ffb700 1 -- 172.21.15.40:0/800673025 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f20044060 con 0x7f0f24131d50 2023-09-30T22:31:09.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.038+0000 7f805f0e2700 1 Processor -- start 2023-09-30T22:31:09.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.038+0000 7f805f0e2700 1 -- start start 2023-09-30T22:31:09.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.039+0000 7f805f0e2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f805809e400 0x7f8058135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:09.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.039+0000 7f805f0e2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8058136230 0x7f8058138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:09.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.039+0000 7f805f0e2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f805809adf0 con 0x7f805809d920 2023-09-30T22:31:09.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.039+0000 7f805f0e2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f805809e7f0 con 0x7f8058136230 2023-09-30T22:31:09.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.039+0000 7f805f0e2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f805809edf0 con 0x7f805809e400 2023-09-30T22:31:09.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.039+0000 7f805ce7e700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f805809d920 0x7f805809dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:42032/0 (socket says 172.21.15.40:42032) 2023-09-30T22:31:09.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.039+0000 7f805ce7e700 1 -- 172.21.15.40:0/3751348364 learned_addr learned my addr 172.21.15.40:0/3751348364 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:09.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.039+0000 7f8057fff700 1 --2- 172.21.15.40:0/3751348364 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f805809e400 0x7f8058135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:09.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.039+0000 7f805d67f700 1 --2- 172.21.15.40:0/3751348364 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8058136230 0x7f8058138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:09.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.039+0000 7f80577fe700 1 -- 172.21.15.40:0/3751348364 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 426337714 0 0) 0x7f805809adf0 con 0x7f805809d920 2023-09-30T22:31:09.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.039+0000 7f80577fe700 1 -- 172.21.15.40:0/3751348364 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80480057c0 con 0x7f805809d920 2023-09-30T22:31:09.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.039+0000 7f8057fff700 1 -- 172.21.15.40:0/3751348364 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8058136230 msgr2=0x7f8058138610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:09.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.039+0000 7f8057fff700 1 --2- 172.21.15.40:0/3751348364 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8058136230 0x7f8058138610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.039+0000 7f8057fff700 1 -- 172.21.15.40:0/3751348364 >> v1:172.21.15.40:6789/0 conn(0x7f805809d920 legacy=0x7f805809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:09.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.039+0000 7f8057fff700 1 -- 172.21.15.40:0/3751348364 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f805809b660 con 0x7f805809e400 2023-09-30T22:31:09.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.039+0000 7f805d67f700 1 --2- 172.21.15.40:0/3751348364 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8058136230 0x7f8058138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:09.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.040+0000 7f8057fff700 1 --2- 172.21.15.40:0/3751348364 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f805809e400 0x7f8058135cf0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f8044009870 tx=0x7f8044009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6aa2c8be1fc8f68c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:09.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.040+0000 7f80577fe700 1 -- 172.21.15.40:0/3751348364 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8044010a90 con 0x7f805809e400 2023-09-30T22:31:09.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.040+0000 7f80577fe700 1 -- 172.21.15.40:0/3751348364 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8044010bf0 con 0x7f805809e400 2023-09-30T22:31:09.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.040+0000 7f80577fe700 1 -- 172.21.15.40:0/3751348364 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8044018440 con 0x7f805809e400 2023-09-30T22:31:09.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.040+0000 7f805f0e2700 1 -- 172.21.15.40:0/3751348364 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f805809e400 msgr2=0x7f8058135cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:09.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.040+0000 7f805f0e2700 1 --2- 172.21.15.40:0/3751348364 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f805809e400 0x7f8058135cf0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f8044009870 tx=0x7f8044009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:09.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.040+0000 7f805f0e2700 1 -- 172.21.15.40:0/3751348364 shutdown_connections 2023-09-30T22:31:09.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.040+0000 7f805f0e2700 1 --2- 172.21.15.40:0/3751348364 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8058136230 0x7f8058138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.040+0000 7f805f0e2700 1 --2- 172.21.15.40:0/3751348364 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f805809e400 0x7f8058135cf0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.040+0000 7f805f0e2700 1 -- 172.21.15.40:0/3751348364 >> 172.21.15.40:0/3751348364 conn(0x7f805809fb20 msgr2=0x7f805809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:09.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.040+0000 7f805f0e2700 1 -- 172.21.15.40:0/3751348364 shutdown_connections 2023-09-30T22:31:09.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.041+0000 7f805f0e2700 1 -- 172.21.15.40:0/3751348364 wait complete. 2023-09-30T22:31:09.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.041+0000 7f805f0e2700 1 Processor -- start 2023-09-30T22:31:09.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.041+0000 7f805f0e2700 1 -- start start 2023-09-30T22:31:09.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.042+0000 7f805f0e2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f805809d920 0x7f805811e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:09.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.042+0000 7f805f0e2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f805809e400 0x7f805811e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:09.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.042+0000 7f805f0e2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8058136230 0x7f805811eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:09.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.042+0000 7f805f0e2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805809cb00 con 0x7f805809d920 2023-09-30T22:31:09.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.042+0000 7f805f0e2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80581219f0 con 0x7f8058136230 2023-09-30T22:31:09.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.042+0000 7f805f0e2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80581208e0 con 0x7f805809e400 2023-09-30T22:31:09.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.042+0000 7f8057fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f805809e400 0x7f805811e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:09.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.042+0000 7f8057fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f805809e400 0x7f805811e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55550/0 (socket says 172.21.15.40:55550) 2023-09-30T22:31:09.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.042+0000 7f8057fff700 1 -- 172.21.15.40:0/1997345677 learned_addr learned my addr 172.21.15.40:0/1997345677 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:09.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.042+0000 7f805d67f700 1 --2- 172.21.15.40:0/1997345677 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8058136230 0x7f805811eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:09.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.042+0000 7f805ce7e700 1 --2- 172.21.15.40:0/1997345677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f805809d920 0x7f805811e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:09.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.043+0000 7f805d67f700 1 -- 172.21.15.40:0/1997345677 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f805809e400 msgr2=0x7f805811e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:09.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.043+0000 7f805d67f700 1 --2- 172.21.15.40:0/1997345677 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f805809e400 0x7f805811e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.043+0000 7f805d67f700 1 -- 172.21.15.40:0/1997345677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f805809d920 msgr2=0x7f805811e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:09.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.043+0000 7f805d67f700 1 --2- 172.21.15.40:0/1997345677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f805809d920 0x7f805811e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.043+0000 7f805d67f700 1 -- 172.21.15.40:0/1997345677 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8050009a70 con 0x7f8058136230 2023-09-30T22:31:09.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.043+0000 7f805d67f700 1 --2- 172.21.15.40:0/1997345677 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8058136230 0x7f805811eef0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f8050009e50 tx=0x7f805000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:09.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.043+0000 7f80557fa700 1 -- 172.21.15.40:0/1997345677 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f805000ca90 con 0x7f8058136230 2023-09-30T22:31:09.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.043+0000 7f80557fa700 1 -- 172.21.15.40:0/1997345677 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f805000f040 con 0x7f8058136230 2023-09-30T22:31:09.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.043+0000 7f805f0e2700 1 -- 172.21.15.40:0/1997345677 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80440094a0 con 0x7f8058136230 2023-09-30T22:31:09.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.043+0000 7f80557fa700 1 -- 172.21.15.40:0/1997345677 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f805000ce50 con 0x7f8058136230 2023-09-30T22:31:09.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.043+0000 7f805f0e2700 1 -- 172.21.15.40:0/1997345677 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80580a3e20 con 0x7f8058136230 2023-09-30T22:31:09.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.044+0000 7f80557fa700 1 -- 172.21.15.40:0/1997345677 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8050014480 con 0x7f8058136230 2023-09-30T22:31:09.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.044+0000 7f805f0e2700 1 -- 172.21.15.40:0/1997345677 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f805809a660 con 0x7f8058136230 2023-09-30T22:31:09.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.044+0000 7f80557fa700 1 -- 172.21.15.40:0/1997345677 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f805003fde0 con 0x7f8058136230 2023-09-30T22:31:09.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.049+0000 7f80557fa700 1 -- 172.21.15.40:0/1997345677 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8050012930 con 0x7f8058136230 2023-09-30T22:31:09.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.127+0000 7f8e6f16a700 1 -- 172.21.15.40:0/2740775530 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8e68071980 con 0x7f8e6812d6d0 2023-09-30T22:31:09.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.127+0000 7f8e657fa700 1 -- 172.21.15.40:0/2740775530 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8e5c028030 con 0x7f8e6812d6d0 2023-09-30T22:31:09.129 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:09.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.131+0000 7f8e6f16a700 1 -- 172.21.15.40:0/2740775530 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e6812d6d0 msgr2=0x7f8e680702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:09.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.131+0000 7f8e6f16a700 1 --2- 172.21.15.40:0/2740775530 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e6812d6d0 0x7f8e680702b0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f8e6809b3b0 tx=0x7f8e5c004750 comp rx=0 tx=0).stop 2023-09-30T22:31:09.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.131+0000 7f8e6f16a700 1 -- 172.21.15.40:0/2740775530 shutdown_connections 2023-09-30T22:31:09.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.131+0000 7f8e6f16a700 1 --2- 172.21.15.40:0/2740775530 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e6812eea0 0x7f8e681c6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.131+0000 7f8e6f16a700 1 --2- 172.21.15.40:0/2740775530 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e6812d6d0 0x7f8e680702b0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.131+0000 7f8e6f16a700 1 --2- 172.21.15.40:0/2740775530 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e6812e590 0x7f8e680707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.131+0000 7f8e6f16a700 1 -- 172.21.15.40:0/2740775530 >> 172.21.15.40:0/2740775530 conn(0x7f8e680a2a00 msgr2=0x7f8e6809f490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:09.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.131+0000 7f8e6f16a700 1 -- 172.21.15.40:0/2740775530 shutdown_connections 2023-09-30T22:31:09.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.131+0000 7f8e6f16a700 1 -- 172.21.15.40:0/2740775530 wait complete. 2023-09-30T22:31:09.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.136+0000 7ff3d8112700 1 -- 172.21.15.40:0/1979834167 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff3d0121bb0 con 0x7ff3d011f1f0 2023-09-30T22:31:09.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.136+0000 7ff3c67fc700 1 -- 172.21.15.40:0/1979834167 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff3c8013bd0 con 0x7ff3d011f1f0 2023-09-30T22:31:09.137 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:09.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.138+0000 7ff3d8112700 1 -- 172.21.15.40:0/1979834167 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff3d011f1f0 msgr2=0x7ff3d01c8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:09.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.138+0000 7ff3d8112700 1 --2- 172.21.15.40:0/1979834167 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff3d011f1f0 0x7ff3d01c8880 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7ff3c800efc0 tx=0x7ff3c800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.138+0000 7ff3d8112700 1 -- 172.21.15.40:0/1979834167 shutdown_connections 2023-09-30T22:31:09.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.138+0000 7ff3d8112700 1 --2- 172.21.15.40:0/1979834167 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff3d011f1f0 0x7ff3d01c8880 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.138+0000 7ff3d8112700 1 --2- 172.21.15.40:0/1979834167 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff3d009d920 0x7ff3d011e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.138+0000 7ff3d8112700 1 --2- 172.21.15.40:0/1979834167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3d009e400 0x7ff3d011ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.138+0000 7ff3d8112700 1 -- 172.21.15.40:0/1979834167 >> 172.21.15.40:0/1979834167 conn(0x7ff3d009fb20 msgr2=0x7ff3d00a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:09.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.139+0000 7ff3d8112700 1 -- 172.21.15.40:0/1979834167 shutdown_connections 2023-09-30T22:31:09.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.141+0000 7ff3d8112700 1 -- 172.21.15.40:0/1979834167 wait complete. 2023-09-30T22:31:09.150 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:09.154 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:09.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.212+0000 7f0f2b2ed700 1 -- 172.21.15.40:0/800673025 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0f24074330 con 0x7f0f24131d50 2023-09-30T22:31:09.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.212+0000 7f0f19ffb700 1 -- 172.21.15.40:0/800673025 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0f20017070 con 0x7f0f24131d50 2023-09-30T22:31:09.213 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:09.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.214+0000 7f0f2b2ed700 1 -- 172.21.15.40:0/800673025 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0f24131d50 msgr2=0x7f0f241c86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:09.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.214+0000 7f0f2b2ed700 1 --2- 172.21.15.40:0/800673025 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0f24131d50 0x7f0f241c86c0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f0f2000c500 tx=0x7f0f2000c810 comp rx=0 tx=0).stop 2023-09-30T22:31:09.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.214+0000 7f0f2b2ed700 1 -- 172.21.15.40:0/800673025 shutdown_connections 2023-09-30T22:31:09.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.214+0000 7f0f2b2ed700 1 --2- 172.21.15.40:0/800673025 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0f24131d50 0x7f0f241c86c0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.214+0000 7f0f2b2ed700 1 --2- 172.21.15.40:0/800673025 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f241373b0 0x7f0f241c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.214+0000 7f0f2b2ed700 1 --2- 172.21.15.40:0/800673025 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0f24134a90 0x7f0f241c8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.214+0000 7f0f2b2ed700 1 -- 172.21.15.40:0/800673025 >> 172.21.15.40:0/800673025 conn(0x7f0f240a2a00 msgr2=0x7f0f2412e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:09.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.214+0000 7f0f2b2ed700 1 -- 172.21.15.40:0/800673025 shutdown_connections 2023-09-30T22:31:09.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.214+0000 7f0f2b2ed700 1 -- 172.21.15.40:0/800673025 wait complete. 2023-09-30T22:31:09.227 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:09.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.256+0000 7f805f0e2700 1 -- 172.21.15.40:0/1997345677 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8058062380 con 0x7f8058136230 2023-09-30T22:31:09.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.256+0000 7f80557fa700 1 -- 172.21.15.40:0/1997345677 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8050012340 con 0x7f8058136230 2023-09-30T22:31:09.257 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:09.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.258+0000 7f805f0e2700 1 -- 172.21.15.40:0/1997345677 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8058136230 msgr2=0x7f805811eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:09.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.258+0000 7f805f0e2700 1 --2- 172.21.15.40:0/1997345677 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8058136230 0x7f805811eef0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f8050009e50 tx=0x7f805000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.259+0000 7f805f0e2700 1 -- 172.21.15.40:0/1997345677 shutdown_connections 2023-09-30T22:31:09.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.259+0000 7f805f0e2700 1 --2- 172.21.15.40:0/1997345677 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8058136230 0x7f805811eef0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.259+0000 7f805f0e2700 1 --2- 172.21.15.40:0/1997345677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f805809d920 0x7f805811e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.259+0000 7f805f0e2700 1 --2- 172.21.15.40:0/1997345677 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f805809e400 0x7f805811e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:09.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.259+0000 7f805f0e2700 1 -- 172.21.15.40:0/1997345677 >> 172.21.15.40:0/1997345677 conn(0x7f805809fb20 msgr2=0x7f80580704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:09.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.259+0000 7f805f0e2700 1 -- 172.21.15.40:0/1997345677 shutdown_connections 2023-09-30T22:31:09.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:09.259+0000 7f805f0e2700 1 -- 172.21.15.40:0/1997345677 wait complete. 2023-09-30T22:31:09.271 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:10.151 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:10.154 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:10.228 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:10.272 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:10.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.300+0000 7f8e357e4700 1 Processor -- start 2023-09-30T22:31:10.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.300+0000 7f8e357e4700 1 -- start start 2023-09-30T22:31:10.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.301+0000 7f8e357e4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e3009d920 0x7f8e3009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.301+0000 7f8e357e4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e3009e230 0x7f8e301308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.301+0000 7f8e357e4700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e3009adf0 con 0x7f8e30130de0 2023-09-30T22:31:10.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.301+0000 7f8e357e4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3009edf0 con 0x7f8e3009e230 2023-09-30T22:31:10.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.301+0000 7f8e357e4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3009b660 con 0x7f8e3009d920 2023-09-30T22:31:10.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.301+0000 7f8e2effd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e3009d920 0x7f8e3009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.302+0000 7f8e2effd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e3009d920 0x7f8e3009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55562/0 (socket says 172.21.15.40:55562) 2023-09-30T22:31:10.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.302+0000 7f8e2effd700 1 -- 172.21.15.40:0/1436842082 learned_addr learned my addr 172.21.15.40:0/1436842082 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:10.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.302+0000 7f8e2e7fc700 1 --2- 172.21.15.40:0/1436842082 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e3009e230 0x7f8e301308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.302+0000 7f8e2e7fc700 1 -- 172.21.15.40:0/1436842082 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e3009d920 msgr2=0x7f8e3009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:10.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.302+0000 7f8e2e7fc700 1 --2- 172.21.15.40:0/1436842082 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e3009d920 0x7f8e3009dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.302+0000 7f8e2e7fc700 1 -- 172.21.15.40:0/1436842082 >> v1:172.21.15.40:6789/0 conn(0x7f8e30130de0 legacy=0x7f8e30137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:10.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.302+0000 7f8e2dffb700 1 -- 172.21.15.40:0/1436842082 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1875237976 0 0) 0x7f8e3009adf0 con 0x7f8e30130de0 2023-09-30T22:31:10.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.302+0000 7f8e2e7fc700 1 -- 172.21.15.40:0/1436842082 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3009a6e0 con 0x7f8e3009e230 2023-09-30T22:31:10.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.302+0000 7f8e2effd700 1 --2- 172.21.15.40:0/1436842082 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e3009d920 0x7f8e3009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:10.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.302+0000 7f8e2e7fc700 1 --2- 172.21.15.40:0/1436842082 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e3009e230 0x7f8e301308a0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f8e24009870 tx=0x7f8e24009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7c8f8faf78439db server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:10.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.302+0000 7f8e2dffb700 1 -- 172.21.15.40:0/1436842082 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e24010a90 con 0x7f8e3009e230 2023-09-30T22:31:10.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.302+0000 7f8e2dffb700 1 -- 172.21.15.40:0/1436842082 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e24010bf0 con 0x7f8e3009e230 2023-09-30T22:31:10.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.302+0000 7f8e2dffb700 1 -- 172.21.15.40:0/1436842082 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e24018440 con 0x7f8e3009e230 2023-09-30T22:31:10.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.303+0000 7f8e357e4700 1 -- 172.21.15.40:0/1436842082 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e3009e230 msgr2=0x7f8e301308a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:10.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.303+0000 7f8e357e4700 1 --2- 172.21.15.40:0/1436842082 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e3009e230 0x7f8e301308a0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f8e24009870 tx=0x7f8e24009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:10.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.303+0000 7f8e357e4700 1 -- 172.21.15.40:0/1436842082 shutdown_connections 2023-09-30T22:31:10.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.303+0000 7f8e357e4700 1 --2- 172.21.15.40:0/1436842082 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e3009d920 0x7f8e3009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.303+0000 7f8e357e4700 1 --2- 172.21.15.40:0/1436842082 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e3009e230 0x7f8e301308a0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.303+0000 7f8e357e4700 1 -- 172.21.15.40:0/1436842082 >> 172.21.15.40:0/1436842082 conn(0x7f8e3009fb20 msgr2=0x7f8e3009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:10.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.304+0000 7f8e357e4700 1 -- 172.21.15.40:0/1436842082 shutdown_connections 2023-09-30T22:31:10.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.304+0000 7f8e357e4700 1 -- 172.21.15.40:0/1436842082 wait complete. 2023-09-30T22:31:10.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.305+0000 7f8e357e4700 1 Processor -- start 2023-09-30T22:31:10.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.305+0000 7f8e357e4700 1 -- start start 2023-09-30T22:31:10.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.305+0000 7f8e357e4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e3009d920 0x7f8e301c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.305+0000 7f8e357e4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e3009e230 0x7f8e301c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.305+0000 7f8e357e4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e30130de0 0x7f8e301c0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.305+0000 7f8e357e4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3009cb70 con 0x7f8e3009e230 2023-09-30T22:31:10.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.305+0000 7f8e357e4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e30120370 con 0x7f8e30130de0 2023-09-30T22:31:10.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.305+0000 7f8e357e4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e301c4d20 con 0x7f8e3009d920 2023-09-30T22:31:10.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.305+0000 7f8e2f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e30130de0 0x7f8e301c0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.305+0000 7f8e2f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e30130de0 0x7f8e301c0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54794/0 (socket says 172.21.15.40:54794) 2023-09-30T22:31:10.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.305+0000 7f8e2f7fe700 1 -- 172.21.15.40:0/3821147406 learned_addr learned my addr 172.21.15.40:0/3821147406 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:10.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.305+0000 7f8e2e7fc700 1 --2- 172.21.15.40:0/3821147406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e3009e230 0x7f8e301c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.306+0000 7f8e2effd700 1 --2- 172.21.15.40:0/3821147406 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e3009d920 0x7f8e301c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.306+0000 7f8e2f7fe700 1 -- 172.21.15.40:0/3821147406 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e3009d920 msgr2=0x7f8e301c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:10.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.306+0000 7f8e2f7fe700 1 --2- 172.21.15.40:0/3821147406 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e3009d920 0x7f8e301c42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.306+0000 7f8e2f7fe700 1 -- 172.21.15.40:0/3821147406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e3009e230 msgr2=0x7f8e301c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:10.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.306+0000 7f8e2f7fe700 1 --2- 172.21.15.40:0/3821147406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e3009e230 0x7f8e301c47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.306+0000 7f8e2f7fe700 1 -- 172.21.15.40:0/3821147406 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e20009500 con 0x7f8e30130de0 2023-09-30T22:31:10.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.306+0000 7f8e2f7fe700 1 --2- 172.21.15.40:0/3821147406 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e30130de0 0x7f8e301c0870 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f8e2800c810 tx=0x7f8e2800cb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:10.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.306+0000 7f8e177fe700 1 -- 172.21.15.40:0/3821147406 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e28003e30 con 0x7f8e30130de0 2023-09-30T22:31:10.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.306+0000 7f8e177fe700 1 -- 172.21.15.40:0/3821147406 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e28005070 con 0x7f8e30130de0 2023-09-30T22:31:10.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.306+0000 7f8e177fe700 1 -- 172.21.15.40:0/3821147406 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e28005420 con 0x7f8e30130de0 2023-09-30T22:31:10.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.307+0000 7f8e357e4700 1 -- 172.21.15.40:0/3821147406 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e240094a0 con 0x7f8e30130de0 2023-09-30T22:31:10.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.307+0000 7f8e357e4700 1 -- 172.21.15.40:0/3821147406 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e30120910 con 0x7f8e30130de0 2023-09-30T22:31:10.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.308+0000 7f8e177fe700 1 -- 172.21.15.40:0/3821147406 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8e28005580 con 0x7f8e30130de0 2023-09-30T22:31:10.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.308+0000 7f8e177fe700 1 -- 172.21.15.40:0/3821147406 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f8e2803f580 con 0x7f8e30130de0 2023-09-30T22:31:10.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.308+0000 7f8e357e4700 1 -- 172.21.15.40:0/3821147406 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e3011fc20 con 0x7f8e30130de0 2023-09-30T22:31:10.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.314+0000 7f8e177fe700 1 -- 172.21.15.40:0/3821147406 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e3011fc20 con 0x7f8e30130de0 2023-09-30T22:31:10.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.335+0000 7f9c7435d700 1 Processor -- start 2023-09-30T22:31:10.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.335+0000 7f9c7435d700 1 -- start start 2023-09-30T22:31:10.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.336+0000 7f9c7435d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c6c09c890 0x7f9c6c09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.336+0000 7f9c7435d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9c6c09d920 0x7f9c6c09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.336+0000 7f9c7435d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c6c0a2600 con 0x7f9c6c09e2b0 2023-09-30T22:31:10.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.336+0000 7f9c7435d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c6c0a29d0 con 0x7f9c6c09d920 2023-09-30T22:31:10.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.336+0000 7f9c7435d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c09fb40 con 0x7f9c6c09c890 2023-09-30T22:31:10.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.336+0000 7f9c720f9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c6c09c890 0x7f9c6c09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.336+0000 7f9c720f9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c6c09c890 0x7f9c6c09cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54796/0 (socket says 172.21.15.40:54796) 2023-09-30T22:31:10.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.336+0000 7f9c720f9700 1 -- 172.21.15.40:0/97022440 learned_addr learned my addr 172.21.15.40:0/97022440 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:10.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.336+0000 7f9c718f8700 1 --2- 172.21.15.40:0/97022440 >> v2:172.21.15.40:3300/0 conn(0x7f9c6c09d920 0x7f9c6c09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.336+0000 7f9c720f9700 1 -- 172.21.15.40:0/97022440 >> v2:172.21.15.40:3300/0 conn(0x7f9c6c09d920 msgr2=0x7f9c6c09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:10.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.336+0000 7f9c720f9700 1 --2- 172.21.15.40:0/97022440 >> v2:172.21.15.40:3300/0 conn(0x7f9c6c09d920 0x7f9c6c09dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.336+0000 7f9c720f9700 1 -- 172.21.15.40:0/97022440 >> v1:172.21.15.40:6789/0 conn(0x7f9c6c09e2b0 legacy=0x7f9c6c13ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:10.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.336+0000 7f9c720f9700 1 -- 172.21.15.40:0/97022440 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c6c09e750 con 0x7f9c6c09c890 2023-09-30T22:31:10.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.337+0000 7f9c720f9700 1 --2- 172.21.15.40:0/97022440 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c6c09c890 0x7f9c6c09cc60 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f9c68006fd0 tx=0x7f9c68009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37613612c0c61699 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:10.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.337+0000 7f9c710f7700 1 -- 172.21.15.40:0/97022440 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c68005e30 con 0x7f9c6c09c890 2023-09-30T22:31:10.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.337+0000 7f9c710f7700 1 -- 172.21.15.40:0/97022440 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c68004030 con 0x7f9c6c09c890 2023-09-30T22:31:10.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.337+0000 7f9c710f7700 1 -- 172.21.15.40:0/97022440 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c680043e0 con 0x7f9c6c09c890 2023-09-30T22:31:10.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.337+0000 7f9c7435d700 1 -- 172.21.15.40:0/97022440 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c6c09c890 msgr2=0x7f9c6c09cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:10.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.337+0000 7f9c7435d700 1 --2- 172.21.15.40:0/97022440 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c6c09c890 0x7f9c6c09cc60 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f9c68006fd0 tx=0x7f9c68009bd0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.338+0000 7f9c7435d700 1 -- 172.21.15.40:0/97022440 shutdown_connections 2023-09-30T22:31:10.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.338+0000 7f9c7435d700 1 --2- 172.21.15.40:0/97022440 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c6c09c890 0x7f9c6c09cc60 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.338+0000 7f9c7435d700 1 --2- 172.21.15.40:0/97022440 >> v2:172.21.15.40:3300/0 conn(0x7f9c6c09d920 0x7f9c6c09dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.338+0000 7f9c7435d700 1 -- 172.21.15.40:0/97022440 >> 172.21.15.40:0/97022440 conn(0x7f9c6c0a7080 msgr2=0x7f9c6c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:10.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.338+0000 7f9c7435d700 1 -- 172.21.15.40:0/97022440 shutdown_connections 2023-09-30T22:31:10.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.338+0000 7f9c7435d700 1 -- 172.21.15.40:0/97022440 wait complete. 2023-09-30T22:31:10.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.339+0000 7f9c7435d700 1 Processor -- start 2023-09-30T22:31:10.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.339+0000 7f9c7435d700 1 -- start start 2023-09-30T22:31:10.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.339+0000 7f9c7435d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9c6c09c890 0x7f9c6c1c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.339+0000 7f9c7435d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c6c09d920 0x7f9c6c1c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.339+0000 7f9c7435d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c6c09e2b0 0x7f9c6c1c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.339+0000 7f9c7435d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c130d10 con 0x7f9c6c09d920 2023-09-30T22:31:10.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.339+0000 7f9c7435d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c09c250 con 0x7f9c6c09e2b0 2023-09-30T22:31:10.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.339+0000 7f9c7435d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c09ed60 con 0x7f9c6c09c890 2023-09-30T22:31:10.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.340+0000 7f9c720f9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9c6c09c890 0x7f9c6c1c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.340+0000 7f9c720f9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9c6c09c890 0x7f9c6c1c89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55582/0 (socket says 172.21.15.40:55582) 2023-09-30T22:31:10.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.340+0000 7f9c720f9700 1 -- 172.21.15.40:0/3275208145 learned_addr learned my addr 172.21.15.40:0/3275208145 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:10.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.340+0000 7f9c728fa700 1 --2- 172.21.15.40:0/3275208145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c6c09e2b0 0x7f9c6c1c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.340+0000 7f9c718f8700 1 --2- 172.21.15.40:0/3275208145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c6c09d920 0x7f9c6c1c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.340+0000 7f9c720f9700 1 -- 172.21.15.40:0/3275208145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c6c09e2b0 msgr2=0x7f9c6c1c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:10.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.340+0000 7f9c720f9700 1 --2- 172.21.15.40:0/3275208145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c6c09e2b0 0x7f9c6c1c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.340+0000 7f9c720f9700 1 -- 172.21.15.40:0/3275208145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c6c09d920 msgr2=0x7f9c6c1c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:10.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.340+0000 7f9c720f9700 1 --2- 172.21.15.40:0/3275208145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c6c09d920 0x7f9c6c1c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.340+0000 7f9c720f9700 1 -- 172.21.15.40:0/3275208145 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c68009500 con 0x7f9c6c09c890 2023-09-30T22:31:10.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.340+0000 7f9c728fa700 1 --2- 172.21.15.40:0/3275208145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c6c09e2b0 0x7f9c6c1c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:10.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.340+0000 7f9c718f8700 1 --2- 172.21.15.40:0/3275208145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c6c09d920 0x7f9c6c1c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:10.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.340+0000 7f9c720f9700 1 --2- 172.21.15.40:0/3275208145 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9c6c09c890 0x7f9c6c1c89e0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f9c68009c10 tx=0x7f9c68004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:10.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.340+0000 7f9c62ffd700 1 -- 172.21.15.40:0/3275208145 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c68003d60 con 0x7f9c6c09c890 2023-09-30T22:31:10.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.340+0000 7f9c7435d700 1 -- 172.21.15.40:0/3275208145 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c6c0a5d00 con 0x7f9c6c09c890 2023-09-30T22:31:10.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.340+0000 7f9c62ffd700 1 -- 172.21.15.40:0/3275208145 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6802d430 con 0x7f9c6c09c890 2023-09-30T22:31:10.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.340+0000 7f9c62ffd700 1 -- 172.21.15.40:0/3275208145 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6802d7e0 con 0x7f9c6c09c890 2023-09-30T22:31:10.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.341+0000 7f9c7435d700 1 -- 172.21.15.40:0/3275208145 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c6c130990 con 0x7f9c6c09c890 2023-09-30T22:31:10.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.341+0000 7f9c7435d700 1 -- 172.21.15.40:0/3275208145 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c6c062380 con 0x7f9c6c09c890 2023-09-30T22:31:10.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.342+0000 7f9c62ffd700 1 -- 172.21.15.40:0/3275208145 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9c6802d940 con 0x7f9c6c09c890 2023-09-30T22:31:10.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.342+0000 7f9c62ffd700 1 -- 172.21.15.40:0/3275208145 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9c68051650 con 0x7f9c6c09c890 2023-09-30T22:31:10.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.350+0000 7f9c62ffd700 1 -- 172.21.15.40:0/3275208145 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9c6802b6e0 con 0x7f9c6c09c890 2023-09-30T22:31:10.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.381+0000 7f9e7fbb1700 1 Processor -- start 2023-09-30T22:31:10.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.381+0000 7f9e7fbb1700 1 -- start start 2023-09-30T22:31:10.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.381+0000 7f9e7fbb1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e78136bf0 0x7f9e78138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.381+0000 7f9e7fbb1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e78139510 0x7f9e7813b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.381+0000 7f9e7fbb1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e780a2600 con 0x7f9e7809c890 2023-09-30T22:31:10.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.381+0000 7f9e7fbb1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e780a29d0 con 0x7f9e78136bf0 2023-09-30T22:31:10.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.381+0000 7f9e7fbb1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7809fb40 con 0x7f9e78139510 2023-09-30T22:31:10.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.381+0000 7f9e7d14c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e78136bf0 0x7f9e78138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.382+0000 7f9e7d14c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e78136bf0 0x7f9e78138fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54808/0 (socket says 172.21.15.40:54808) 2023-09-30T22:31:10.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.382+0000 7f9e7d14c700 1 -- 172.21.15.40:0/3100486193 learned_addr learned my addr 172.21.15.40:0/3100486193 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:10.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.382+0000 7f9e7e14e700 1 --2- 172.21.15.40:0/3100486193 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e78139510 0x7f9e7813b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.382+0000 7f9e7d14c700 1 -- 172.21.15.40:0/3100486193 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e78139510 msgr2=0x7f9e7813b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:10.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.382+0000 7f9e7d14c700 1 --2- 172.21.15.40:0/3100486193 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e78139510 0x7f9e7813b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.382+0000 7f9e7d14c700 1 -- 172.21.15.40:0/3100486193 >> v1:172.21.15.40:6789/0 conn(0x7f9e7809c890 legacy=0x7f9e7809cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:10.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.382+0000 7f9e7d14c700 1 -- 172.21.15.40:0/3100486193 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e7809d370 con 0x7f9e78136bf0 2023-09-30T22:31:10.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.382+0000 7f9e7d14c700 1 --2- 172.21.15.40:0/3100486193 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e78136bf0 0x7f9e78138fd0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f9e68009920 tx=0x7f9e68009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81432423b8e8ece5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:10.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.382+0000 7f9e7c94b700 1 -- 172.21.15.40:0/3100486193 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6800ba60 con 0x7f9e78136bf0 2023-09-30T22:31:10.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.382+0000 7f9e7c94b700 1 -- 172.21.15.40:0/3100486193 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e6800bbc0 con 0x7f9e78136bf0 2023-09-30T22:31:10.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.382+0000 7f9e7c94b700 1 -- 172.21.15.40:0/3100486193 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e68009e70 con 0x7f9e78136bf0 2023-09-30T22:31:10.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.383+0000 7f9e7fbb1700 1 -- 172.21.15.40:0/3100486193 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e78136bf0 msgr2=0x7f9e78138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:10.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.383+0000 7f9e7fbb1700 1 --2- 172.21.15.40:0/3100486193 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e78136bf0 0x7f9e78138fd0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f9e68009920 tx=0x7f9e68009c30 comp rx=0 tx=0).stop 2023-09-30T22:31:10.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.383+0000 7f9e7fbb1700 1 -- 172.21.15.40:0/3100486193 shutdown_connections 2023-09-30T22:31:10.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.383+0000 7f9e7fbb1700 1 --2- 172.21.15.40:0/3100486193 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e78139510 0x7f9e7813b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.383+0000 7f9e7fbb1700 1 --2- 172.21.15.40:0/3100486193 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e78136bf0 0x7f9e78138fd0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.383+0000 7f9e7fbb1700 1 -- 172.21.15.40:0/3100486193 >> 172.21.15.40:0/3100486193 conn(0x7f9e780a7080 msgr2=0x7f9e780a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:10.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.383+0000 7f9e7fbb1700 1 -- 172.21.15.40:0/3100486193 shutdown_connections 2023-09-30T22:31:10.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.383+0000 7f9e7fbb1700 1 -- 172.21.15.40:0/3100486193 wait complete. 2023-09-30T22:31:10.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.384+0000 7f9e7fbb1700 1 Processor -- start 2023-09-30T22:31:10.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.384+0000 7f9e7fbb1700 1 -- start start 2023-09-30T22:31:10.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.384+0000 7f9e7fbb1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e7809c890 0x7f9e7808d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.384+0000 7f9e7fbb1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e78136bf0 0x7f9e7808ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.384+0000 7f9e7fbb1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e78139510 0x7f9e781cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.384+0000 7f9e7fbb1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7809c380 con 0x7f9e78139510 2023-09-30T22:31:10.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.384+0000 7f9e7fbb1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7808e2f0 con 0x7f9e78136bf0 2023-09-30T22:31:10.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.384+0000 7f9e7fbb1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7808d460 con 0x7f9e7809c890 2023-09-30T22:31:10.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.384+0000 7f9e7d14c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e78136bf0 0x7f9e7808ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.384+0000 7f9e7d14c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e78136bf0 0x7f9e7808ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54824/0 (socket says 172.21.15.40:54824) 2023-09-30T22:31:10.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.384+0000 7f9e7d14c700 1 -- 172.21.15.40:0/3341916218 learned_addr learned my addr 172.21.15.40:0/3341916218 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:10.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.385+0000 7f9e7e14e700 1 --2- 172.21.15.40:0/3341916218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e78139510 0x7f9e781cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.385+0000 7f9e7d94d700 1 --2- 172.21.15.40:0/3341916218 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e7809c890 0x7f9e7808d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.385+0000 7f9e7d14c700 1 -- 172.21.15.40:0/3341916218 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e7809c890 msgr2=0x7f9e7808d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:10.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.385+0000 7f9e7d14c700 1 --2- 172.21.15.40:0/3341916218 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e7809c890 0x7f9e7808d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.385+0000 7f9e7d14c700 1 -- 172.21.15.40:0/3341916218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e78139510 msgr2=0x7f9e781cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:10.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.385+0000 7f9e7d14c700 1 --2- 172.21.15.40:0/3341916218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e78139510 0x7f9e781cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.385+0000 7f9e7d14c700 1 -- 172.21.15.40:0/3341916218 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e68009550 con 0x7f9e78136bf0 2023-09-30T22:31:10.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.385+0000 7f9e7e14e700 1 --2- 172.21.15.40:0/3341916218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e78139510 0x7f9e781cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:10.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.385+0000 7f9e7d94d700 1 --2- 172.21.15.40:0/3341916218 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e7809c890 0x7f9e7808d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:10.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.385+0000 7f9e7d14c700 1 --2- 172.21.15.40:0/3341916218 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e78136bf0 0x7f9e7808ddb0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f9e68000c00 tx=0x7f9e68004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:10.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.385+0000 7f9e6e7fc700 1 -- 172.21.15.40:0/3341916218 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e680036a0 con 0x7f9e78136bf0 2023-09-30T22:31:10.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.385+0000 7f9e7fbb1700 1 -- 172.21.15.40:0/3341916218 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e78138fe0 con 0x7f9e78136bf0 2023-09-30T22:31:10.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.385+0000 7f9e6e7fc700 1 -- 172.21.15.40:0/3341916218 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e6801f070 con 0x7f9e78136bf0 2023-09-30T22:31:10.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.385+0000 7f9e7fbb1700 1 -- 172.21.15.40:0/3341916218 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e780990e0 con 0x7f9e78136bf0 2023-09-30T22:31:10.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.385+0000 7f9e6e7fc700 1 -- 172.21.15.40:0/3341916218 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e68003a60 con 0x7f9e78136bf0 2023-09-30T22:31:10.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.386+0000 7f9e6e7fc700 1 -- 172.21.15.40:0/3341916218 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9e68003bc0 con 0x7f9e78136bf0 2023-09-30T22:31:10.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.386+0000 7f9e7fbb1700 1 -- 172.21.15.40:0/3341916218 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e78062380 con 0x7f9e78136bf0 2023-09-30T22:31:10.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.387+0000 7f9e6e7fc700 1 -- 172.21.15.40:0/3341916218 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9e68021070 con 0x7f9e78136bf0 2023-09-30T22:31:10.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.396+0000 7f9e6e7fc700 1 -- 172.21.15.40:0/3341916218 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9e6802b080 con 0x7f9e78136bf0 2023-09-30T22:31:10.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.452+0000 7f042c352700 1 Processor -- start 2023-09-30T22:31:10.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.453+0000 7f042c352700 1 -- start start 2023-09-30T22:31:10.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.453+0000 7f042c352700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f042406f070 0x7f042406f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.453+0000 7f042c352700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f042406fdb0 0x7f04240977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.453+0000 7f042c352700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0424070830 con 0x7f042406f980 2023-09-30T22:31:10.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.453+0000 7f042c352700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0424070ad0 con 0x7f042406f070 2023-09-30T22:31:10.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.453+0000 7f042c352700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0424070de0 con 0x7f042406fdb0 2023-09-30T22:31:10.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.453+0000 7f042a8ef700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f042406fdb0 0x7f04240977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.453+0000 7f04298ed700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f042406f980 0x7f0424097090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:42066/0 (socket says 172.21.15.40:42066) 2023-09-30T22:31:10.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.453+0000 7f04298ed700 1 -- 172.21.15.40:0/1639979457 learned_addr learned my addr 172.21.15.40:0/1639979457 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:10.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.454+0000 7f042a0ee700 1 --2- 172.21.15.40:0/1639979457 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f042406f070 0x7f042406f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.454+0000 7f042a8ef700 1 -- 172.21.15.40:0/1639979457 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f042406f070 msgr2=0x7f042406f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:10.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.454+0000 7f042a8ef700 1 --2- 172.21.15.40:0/1639979457 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f042406f070 0x7f042406f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.454+0000 7f042a8ef700 1 -- 172.21.15.40:0/1639979457 >> v1:172.21.15.40:6789/0 conn(0x7f042406f980 legacy=0x7f0424097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:10.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.454+0000 7f04290ec700 1 -- 172.21.15.40:0/1639979457 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987886362 0 0) 0x7f0424070830 con 0x7f042406f980 2023-09-30T22:31:10.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.454+0000 7f042a8ef700 1 -- 172.21.15.40:0/1639979457 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042409fe20 con 0x7f042406fdb0 2023-09-30T22:31:10.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.454+0000 7f042a0ee700 1 --2- 172.21.15.40:0/1639979457 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f042406f070 0x7f042406f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:10.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.454+0000 7f042a8ef700 1 --2- 172.21.15.40:0/1639979457 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f042406fdb0 0x7f04240977a0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f041c009dc0 tx=0x7f041c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82820ea9471b0943 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:10.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.454+0000 7f04290ec700 1 -- 172.21.15.40:0/1639979457 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041c00e070 con 0x7f042406fdb0 2023-09-30T22:31:10.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.454+0000 7f04290ec700 1 -- 172.21.15.40:0/1639979457 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041c00bbd0 con 0x7f042406fdb0 2023-09-30T22:31:10.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.454+0000 7f04290ec700 1 -- 172.21.15.40:0/1639979457 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041c012430 con 0x7f042406fdb0 2023-09-30T22:31:10.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.455+0000 7f042c352700 1 -- 172.21.15.40:0/1639979457 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f042406fdb0 msgr2=0x7f04240977a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:10.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.455+0000 7f042c352700 1 --2- 172.21.15.40:0/1639979457 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f042406fdb0 0x7f04240977a0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f041c009dc0 tx=0x7f041c00b330 comp rx=0 tx=0).stop 2023-09-30T22:31:10.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.455+0000 7f042c352700 1 -- 172.21.15.40:0/1639979457 shutdown_connections 2023-09-30T22:31:10.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.455+0000 7f042c352700 1 --2- 172.21.15.40:0/1639979457 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f042406fdb0 0x7f04240977a0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.455+0000 7f042c352700 1 --2- 172.21.15.40:0/1639979457 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f042406f070 0x7f042406f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.455+0000 7f042c352700 1 -- 172.21.15.40:0/1639979457 >> 172.21.15.40:0/1639979457 conn(0x7f04240a41a0 msgr2=0x7f04240a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:10.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.455+0000 7f042c352700 1 -- 172.21.15.40:0/1639979457 shutdown_connections 2023-09-30T22:31:10.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.455+0000 7f042c352700 1 -- 172.21.15.40:0/1639979457 wait complete. 2023-09-30T22:31:10.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.456+0000 7f042c352700 1 Processor -- start 2023-09-30T22:31:10.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.456+0000 7f042c352700 1 -- start start 2023-09-30T22:31:10.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.456+0000 7f042c352700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f042406f070 0x7f04240980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.456+0000 7f042c352700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f042406f980 0x7f04240985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.456+0000 7f042c352700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f042406fdb0 0x7f0424098b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:10.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.457+0000 7f042c352700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042409ae30 con 0x7f042406f070 2023-09-30T22:31:10.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.457+0000 7f042c352700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0424130980 con 0x7f042406f980 2023-09-30T22:31:10.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.457+0000 7f042c352700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f042412c2d0 con 0x7f042406fdb0 2023-09-30T22:31:10.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.457+0000 7f042a8ef700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f042406fdb0 0x7f0424098b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.457+0000 7f042a8ef700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f042406fdb0 0x7f0424098b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55614/0 (socket says 172.21.15.40:55614) 2023-09-30T22:31:10.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.457+0000 7f042a8ef700 1 -- 172.21.15.40:0/427934952 learned_addr learned my addr 172.21.15.40:0/427934952 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:10.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.457+0000 7f042a0ee700 1 --2- 172.21.15.40:0/427934952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f042406f070 0x7f04240980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.457+0000 7f04298ed700 1 --2- 172.21.15.40:0/427934952 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f042406f980 0x7f04240985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:10.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.457+0000 7f042a8ef700 1 -- 172.21.15.40:0/427934952 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f042406f980 msgr2=0x7f04240985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:10.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.457+0000 7f042a8ef700 1 --2- 172.21.15.40:0/427934952 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f042406f980 0x7f04240985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.457+0000 7f042a8ef700 1 -- 172.21.15.40:0/427934952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f042406f070 msgr2=0x7f04240980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:10.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.457+0000 7f042a8ef700 1 --2- 172.21.15.40:0/427934952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f042406f070 0x7f04240980a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.457+0000 7f042a8ef700 1 -- 172.21.15.40:0/427934952 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c009a70 con 0x7f042406fdb0 2023-09-30T22:31:10.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.457+0000 7f042a0ee700 1 --2- 172.21.15.40:0/427934952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f042406f070 0x7f04240980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:10.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.457+0000 7f042a8ef700 1 --2- 172.21.15.40:0/427934952 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f042406fdb0 0x7f0424098b20 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f041c014040 tx=0x7f041c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:10.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.457+0000 7f041affd700 1 -- 172.21.15.40:0/427934952 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041c012430 con 0x7f042406fdb0 2023-09-30T22:31:10.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.458+0000 7f041affd700 1 -- 172.21.15.40:0/427934952 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041c020070 con 0x7f042406fdb0 2023-09-30T22:31:10.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.458+0000 7f042c352700 1 -- 172.21.15.40:0/427934952 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0424096d90 con 0x7f042406fdb0 2023-09-30T22:31:10.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.458+0000 7f041affd700 1 -- 172.21.15.40:0/427934952 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041c004280 con 0x7f042406fdb0 2023-09-30T22:31:10.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.458+0000 7f042c352700 1 -- 172.21.15.40:0/427934952 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0424099f80 con 0x7f042406fdb0 2023-09-30T22:31:10.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.458+0000 7f041affd700 1 -- 172.21.15.40:0/427934952 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f041c0043e0 con 0x7f042406fdb0 2023-09-30T22:31:10.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.459+0000 7f041affd700 1 -- 172.21.15.40:0/427934952 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f041c022070 con 0x7f042406fdb0 2023-09-30T22:31:10.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.459+0000 7f042c352700 1 -- 172.21.15.40:0/427934952 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0424062380 con 0x7f042406fdb0 2023-09-30T22:31:10.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.464+0000 7f041affd700 1 -- 172.21.15.40:0/427934952 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f041c004870 con 0x7f042406fdb0 2023-09-30T22:31:10.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.565+0000 7f8e357e4700 1 -- 172.21.15.40:0/3821147406 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8e3011fc20 con 0x7f8e30130de0 2023-09-30T22:31:10.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.565+0000 7f8e177fe700 1 -- 172.21.15.40:0/3821147406 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8e3011fc20 con 0x7f8e30130de0 2023-09-30T22:31:10.566 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:10.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.568+0000 7f9c7435d700 1 -- 172.21.15.40:0/3275208145 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9c6c074620 con 0x7f9c6c09c890 2023-09-30T22:31:10.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.568+0000 7f8e357e4700 1 -- 172.21.15.40:0/3821147406 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e30130de0 msgr2=0x7f8e301c0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:10.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.568+0000 7f8e357e4700 1 --2- 172.21.15.40:0/3821147406 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e30130de0 0x7f8e301c0870 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f8e2800c810 tx=0x7f8e2800cb20 comp rx=0 tx=0).stop 2023-09-30T22:31:10.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.568+0000 7f8e357e4700 1 -- 172.21.15.40:0/3821147406 shutdown_connections 2023-09-30T22:31:10.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.568+0000 7f8e357e4700 1 --2- 172.21.15.40:0/3821147406 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8e3009d920 0x7f8e301c42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.568+0000 7f8e357e4700 1 --2- 172.21.15.40:0/3821147406 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e30130de0 0x7f8e301c0870 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.568+0000 7f8e357e4700 1 --2- 172.21.15.40:0/3821147406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e3009e230 0x7f8e301c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.568+0000 7f8e357e4700 1 -- 172.21.15.40:0/3821147406 >> 172.21.15.40:0/3821147406 conn(0x7f8e3009fb20 msgr2=0x7f8e3012fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:10.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.569+0000 7f9c62ffd700 1 -- 172.21.15.40:0/3275208145 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9c68031070 con 0x7f9c6c09c890 2023-09-30T22:31:10.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.569+0000 7f8e357e4700 1 -- 172.21.15.40:0/3821147406 shutdown_connections 2023-09-30T22:31:10.571 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:10.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.569+0000 7f8e357e4700 1 -- 172.21.15.40:0/3821147406 wait complete. 2023-09-30T22:31:10.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.572+0000 7f9c7435d700 1 -- 172.21.15.40:0/3275208145 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9c6c09c890 msgr2=0x7f9c6c1c89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:10.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.572+0000 7f9c7435d700 1 --2- 172.21.15.40:0/3275208145 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9c6c09c890 0x7f9c6c1c89e0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f9c68009c10 tx=0x7f9c68004750 comp rx=0 tx=0).stop 2023-09-30T22:31:10.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.572+0000 7f9c7435d700 1 -- 172.21.15.40:0/3275208145 shutdown_connections 2023-09-30T22:31:10.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.572+0000 7f9c7435d700 1 --2- 172.21.15.40:0/3275208145 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9c6c09c890 0x7f9c6c1c89e0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.572+0000 7f9c7435d700 1 --2- 172.21.15.40:0/3275208145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c6c09e2b0 0x7f9c6c1c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.572+0000 7f9c7435d700 1 --2- 172.21.15.40:0/3275208145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c6c09d920 0x7f9c6c1c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.572+0000 7f9c7435d700 1 -- 172.21.15.40:0/3275208145 >> 172.21.15.40:0/3275208145 conn(0x7f9c6c0a7080 msgr2=0x7f9c6c0a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:10.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.572+0000 7f9c7435d700 1 -- 172.21.15.40:0/3275208145 shutdown_connections 2023-09-30T22:31:10.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.572+0000 7f9c7435d700 1 -- 172.21.15.40:0/3275208145 wait complete. 2023-09-30T22:31:10.583 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:10.592 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:10.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.596+0000 7f9e7fbb1700 1 -- 172.21.15.40:0/3341916218 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9e78098eb0 con 0x7f9e78136bf0 2023-09-30T22:31:10.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.596+0000 7f9e6e7fc700 1 -- 172.21.15.40:0/3341916218 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9e68015020 con 0x7f9e78136bf0 2023-09-30T22:31:10.597 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:10.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.598+0000 7f9e7fbb1700 1 -- 172.21.15.40:0/3341916218 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e78136bf0 msgr2=0x7f9e7808ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:10.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.598+0000 7f9e7fbb1700 1 --2- 172.21.15.40:0/3341916218 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e78136bf0 0x7f9e7808ddb0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f9e68000c00 tx=0x7f9e68004750 comp rx=0 tx=0).stop 2023-09-30T22:31:10.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.598+0000 7f9e7fbb1700 1 -- 172.21.15.40:0/3341916218 shutdown_connections 2023-09-30T22:31:10.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.598+0000 7f9e7fbb1700 1 --2- 172.21.15.40:0/3341916218 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9e7809c890 0x7f9e7808d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.598+0000 7f9e7fbb1700 1 --2- 172.21.15.40:0/3341916218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e78139510 0x7f9e781cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.598+0000 7f9e7fbb1700 1 --2- 172.21.15.40:0/3341916218 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9e78136bf0 0x7f9e7808ddb0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.598+0000 7f9e7fbb1700 1 -- 172.21.15.40:0/3341916218 >> 172.21.15.40:0/3341916218 conn(0x7f9e780a7080 msgr2=0x7f9e781349d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:10.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.598+0000 7f9e7fbb1700 1 -- 172.21.15.40:0/3341916218 shutdown_connections 2023-09-30T22:31:10.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.598+0000 7f9e7fbb1700 1 -- 172.21.15.40:0/3341916218 wait complete. 2023-09-30T22:31:10.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:10.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.684+0000 7f042c352700 1 -- 172.21.15.40:0/427934952 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0424074620 con 0x7f042406fdb0 2023-09-30T22:31:10.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.684+0000 7f041affd700 1 -- 172.21.15.40:0/427934952 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f041c026bd0 con 0x7f042406fdb0 2023-09-30T22:31:10.685 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:10.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.687+0000 7f042c352700 1 -- 172.21.15.40:0/427934952 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f042406fdb0 msgr2=0x7f0424098b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:10.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.687+0000 7f042c352700 1 --2- 172.21.15.40:0/427934952 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f042406fdb0 0x7f0424098b20 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f041c014040 tx=0x7f041c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.687+0000 7f042c352700 1 -- 172.21.15.40:0/427934952 shutdown_connections 2023-09-30T22:31:10.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.687+0000 7f042c352700 1 --2- 172.21.15.40:0/427934952 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f042406fdb0 0x7f0424098b20 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.687+0000 7f042c352700 1 --2- 172.21.15.40:0/427934952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f042406f070 0x7f04240980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.687+0000 7f042c352700 1 --2- 172.21.15.40:0/427934952 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f042406f980 0x7f04240985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:10.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.687+0000 7f042c352700 1 -- 172.21.15.40:0/427934952 >> 172.21.15.40:0/427934952 conn(0x7f04240a41a0 msgr2=0x7f04241292a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:10.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.687+0000 7f042c352700 1 -- 172.21.15.40:0/427934952 shutdown_connections 2023-09-30T22:31:10.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:10.687+0000 7f042c352700 1 -- 172.21.15.40:0/427934952 wait complete. 2023-09-30T22:31:10.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:11.584 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:11.592 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:11.612 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:11.700 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:11.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.738+0000 7fbdc9a2a700 1 Processor -- start 2023-09-30T22:31:11.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.738+0000 7fbdc9a2a700 1 -- start start 2023-09-30T22:31:11.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.738+0000 7fbdc9a2a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbdc409d920 0x7fbdc409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:11.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.738+0000 7fbdc9a2a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdc409e230 0x7fbdc41308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:11.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.738+0000 7fbdc9a2a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdc409adf0 con 0x7fbdc4130de0 2023-09-30T22:31:11.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.738+0000 7fbdc9a2a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc409edf0 con 0x7fbdc409e230 2023-09-30T22:31:11.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.738+0000 7fbdc9a2a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc409b660 con 0x7fbdc409d920 2023-09-30T22:31:11.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.738+0000 7fbdc2ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbdc409d920 0x7fbdc409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:11.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.738+0000 7fbdc2ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbdc409d920 0x7fbdc409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55618/0 (socket says 172.21.15.40:55618) 2023-09-30T22:31:11.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.738+0000 7fbdc2ffd700 1 -- 172.21.15.40:0/2294759871 learned_addr learned my addr 172.21.15.40:0/2294759871 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:11.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.739+0000 7fbdc27fc700 1 --2- 172.21.15.40:0/2294759871 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdc409e230 0x7fbdc41308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:11.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.739+0000 7fbdc1ffb700 1 -- 172.21.15.40:0/2294759871 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3793697995 0 0) 0x7fbdc409adf0 con 0x7fbdc4130de0 2023-09-30T22:31:11.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.739+0000 7fbdc2ffd700 1 -- 172.21.15.40:0/2294759871 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdc409e230 msgr2=0x7fbdc41308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:11.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.739+0000 7fbdc2ffd700 1 --2- 172.21.15.40:0/2294759871 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdc409e230 0x7fbdc41308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.739+0000 7fbdc2ffd700 1 -- 172.21.15.40:0/2294759871 >> v1:172.21.15.40:6789/0 conn(0x7fbdc4130de0 legacy=0x7fbdc4137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:11.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.739+0000 7fbdc2ffd700 1 -- 172.21.15.40:0/2294759871 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc409a6e0 con 0x7fbdc409d920 2023-09-30T22:31:11.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.739+0000 7fbdc2ffd700 1 --2- 172.21.15.40:0/2294759871 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbdc409d920 0x7fbdc409dcf0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fbdb40098f0 tx=0x7fbdb4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad8cac6026e1b2f5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:11.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.739+0000 7fbdc1ffb700 1 -- 172.21.15.40:0/2294759871 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4005e30 con 0x7fbdc409d920 2023-09-30T22:31:11.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.739+0000 7fbdc1ffb700 1 -- 172.21.15.40:0/2294759871 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb4004030 con 0x7fbdc409d920 2023-09-30T22:31:11.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.739+0000 7fbdc1ffb700 1 -- 172.21.15.40:0/2294759871 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb40043e0 con 0x7fbdc409d920 2023-09-30T22:31:11.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.740+0000 7fbdc9a2a700 1 -- 172.21.15.40:0/2294759871 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbdc409d920 msgr2=0x7fbdc409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:11.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.740+0000 7fbdc9a2a700 1 --2- 172.21.15.40:0/2294759871 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbdc409d920 0x7fbdc409dcf0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fbdb40098f0 tx=0x7fbdb4009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:11.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.740+0000 7fbdc9a2a700 1 -- 172.21.15.40:0/2294759871 shutdown_connections 2023-09-30T22:31:11.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.740+0000 7fbdc9a2a700 1 --2- 172.21.15.40:0/2294759871 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbdc409d920 0x7fbdc409dcf0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.740+0000 7fbdc9a2a700 1 --2- 172.21.15.40:0/2294759871 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdc409e230 0x7fbdc41308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.740+0000 7fbdc9a2a700 1 -- 172.21.15.40:0/2294759871 >> 172.21.15.40:0/2294759871 conn(0x7fbdc409fb20 msgr2=0x7fbdc409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:11.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.740+0000 7fbdc9a2a700 1 -- 172.21.15.40:0/2294759871 shutdown_connections 2023-09-30T22:31:11.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.740+0000 7fbdc9a2a700 1 -- 172.21.15.40:0/2294759871 wait complete. 2023-09-30T22:31:11.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.742+0000 7fbdc9a2a700 1 Processor -- start 2023-09-30T22:31:11.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.742+0000 7fbdc9a2a700 1 -- start start 2023-09-30T22:31:11.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.743+0000 7fbdc9a2a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdc409d920 0x7fbdc411b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:11.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.743+0000 7fbdc9a2a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdc409e230 0x7fbdc411b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:11.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.743+0000 7fbdc9a2a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbdc4130de0 0x7fbdc41c5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:11.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.743+0000 7fbdc9a2a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc412f370 con 0x7fbdc409d920 2023-09-30T22:31:11.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.743+0000 7fbdc9a2a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc411aea0 con 0x7fbdc409e230 2023-09-30T22:31:11.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.743+0000 7fbdc9a2a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc411e220 con 0x7fbdc4130de0 2023-09-30T22:31:11.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.743+0000 7fbdc27fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdc409e230 0x7fbdc411b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:11.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.743+0000 7fbdc27fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdc409e230 0x7fbdc411b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54872/0 (socket says 172.21.15.40:54872) 2023-09-30T22:31:11.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.743+0000 7fbdc27fc700 1 -- 172.21.15.40:0/3002076124 learned_addr learned my addr 172.21.15.40:0/3002076124 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:11.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.743+0000 7fbdc2ffd700 1 --2- 172.21.15.40:0/3002076124 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdc409d920 0x7fbdc411b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:11.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.743+0000 7fbdc37fe700 1 --2- 172.21.15.40:0/3002076124 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbdc4130de0 0x7fbdc41c5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:11.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.743+0000 7fbdc27fc700 1 -- 172.21.15.40:0/3002076124 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbdc4130de0 msgr2=0x7fbdc41c5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:11.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.743+0000 7fbdc27fc700 1 --2- 172.21.15.40:0/3002076124 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbdc4130de0 0x7fbdc41c5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.743+0000 7fbdc27fc700 1 -- 172.21.15.40:0/3002076124 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdc409d920 msgr2=0x7fbdc411b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:11.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.743+0000 7fbdc27fc700 1 --2- 172.21.15.40:0/3002076124 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdc409d920 0x7fbdc411b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.743+0000 7fbdc27fc700 1 -- 172.21.15.40:0/3002076124 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb4009500 con 0x7fbdc409e230 2023-09-30T22:31:11.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.743+0000 7fbdc2ffd700 1 --2- 172.21.15.40:0/3002076124 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdc409d920 0x7fbdc411b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:11.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.744+0000 7fbdc27fc700 1 --2- 172.21.15.40:0/3002076124 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdc409e230 0x7fbdc411b880 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8010b90 tx=0x7fbdb8010ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:11.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.744+0000 7fbdabfff700 1 -- 172.21.15.40:0/3002076124 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb8009710 con 0x7fbdc409e230 2023-09-30T22:31:11.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.744+0000 7fbdabfff700 1 -- 172.21.15.40:0/3002076124 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb800ed20 con 0x7fbdc409e230 2023-09-30T22:31:11.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.744+0000 7fbdc9a2a700 1 -- 172.21.15.40:0/3002076124 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdc409a210 con 0x7fbdc409e230 2023-09-30T22:31:11.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.744+0000 7fbdabfff700 1 -- 172.21.15.40:0/3002076124 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb8011670 con 0x7fbdc409e230 2023-09-30T22:31:11.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.744+0000 7fbdc9a2a700 1 -- 172.21.15.40:0/3002076124 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdc411cde0 con 0x7fbdc409e230 2023-09-30T22:31:11.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.745+0000 7fbdabfff700 1 -- 172.21.15.40:0/3002076124 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbdb80117d0 con 0x7fbdc409e230 2023-09-30T22:31:11.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.745+0000 7fbdabfff700 1 -- 172.21.15.40:0/3002076124 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fbdb8041980 con 0x7fbdc409e230 2023-09-30T22:31:11.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.745+0000 7fbdc9a2a700 1 -- 172.21.15.40:0/3002076124 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdc4062380 con 0x7fbdc409e230 2023-09-30T22:31:11.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.754+0000 7fbdabfff700 1 -- 172.21.15.40:0/3002076124 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbdb801e080 con 0x7fbdc409e230 2023-09-30T22:31:11.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.769+0000 7f472d500700 1 Processor -- start 2023-09-30T22:31:11.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.769+0000 7f472d500700 1 -- start start 2023-09-30T22:31:11.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.770+0000 7f472d500700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f472806a6d0 0x7f472809d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:11.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.770+0000 7f472d500700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f472809de60 0x7f472809e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:11.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.770+0000 7f472d500700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f472813c490 0x7f472813e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:11.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.770+0000 7f472d500700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f472806aaa0 con 0x7f472813c490 2023-09-30T22:31:11.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.770+0000 7f472d500700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472809e790 con 0x7f472806a6d0 2023-09-30T22:31:11.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.770+0000 7f472d500700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f472811d980 con 0x7f472809de60 2023-09-30T22:31:11.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.770+0000 7f4726ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f472806a6d0 0x7f472809d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:11.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.770+0000 7f4726ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f472806a6d0 0x7f472809d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54882/0 (socket says 172.21.15.40:54882) 2023-09-30T22:31:11.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.770+0000 7f4726ffd700 1 -- 172.21.15.40:0/2062268685 learned_addr learned my addr 172.21.15.40:0/2062268685 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:11.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.770+0000 7f47277fe700 1 --2- 172.21.15.40:0/2062268685 >> v2:172.21.15.40:3300/0 conn(0x7f472813c490 0x7f472813e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:11.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.770+0000 7f47267fc700 1 --2- 172.21.15.40:0/2062268685 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f472809de60 0x7f472809e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:11.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.770+0000 7f4726ffd700 1 -- 172.21.15.40:0/2062268685 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f472809de60 msgr2=0x7f472809e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:11.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.770+0000 7f4726ffd700 1 --2- 172.21.15.40:0/2062268685 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f472809de60 0x7f472809e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.770+0000 7f4726ffd700 1 -- 172.21.15.40:0/2062268685 >> v2:172.21.15.40:3300/0 conn(0x7f472813c490 msgr2=0x7f472813e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:11.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.770+0000 7f4726ffd700 1 --2- 172.21.15.40:0/2062268685 >> v2:172.21.15.40:3300/0 conn(0x7f472813c490 0x7f472813e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.770+0000 7f4726ffd700 1 -- 172.21.15.40:0/2062268685 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f472806b150 con 0x7f472806a6d0 2023-09-30T22:31:11.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.771+0000 7f47277fe700 1 --2- 172.21.15.40:0/2062268685 >> v2:172.21.15.40:3300/0 conn(0x7f472813c490 0x7f472813e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:11.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.771+0000 7f9b09dbf700 1 Processor -- start 2023-09-30T22:31:11.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.771+0000 7f4726ffd700 1 --2- 172.21.15.40:0/2062268685 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f472806a6d0 0x7f472809d920 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f47180098f0 tx=0x7f4718009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7eb0463352e26f95 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:11.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.771+0000 7f9b09dbf700 1 -- start start 2023-09-30T22:31:11.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.771+0000 7f4725ffb700 1 -- 172.21.15.40:0/2062268685 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4718005e30 con 0x7f472806a6d0 2023-09-30T22:31:11.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.771+0000 7f4725ffb700 1 -- 172.21.15.40:0/2062268685 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4718004030 con 0x7f472806a6d0 2023-09-30T22:31:11.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.771+0000 7f4725ffb700 1 -- 172.21.15.40:0/2062268685 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47180043e0 con 0x7f472806a6d0 2023-09-30T22:31:11.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.771+0000 7f9b09dbf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9b0409d920 0x7f9b0409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:11.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.771+0000 7f9b09dbf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b04130fb0 0x7f9b04138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:11.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.771+0000 7f9b09dbf700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b0409adf0 con 0x7f9b0409e230 2023-09-30T22:31:11.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.771+0000 7f9b09dbf700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b0409edf0 con 0x7f9b0409d920 2023-09-30T22:31:11.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.771+0000 7f9b09dbf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0409b660 con 0x7f9b04130fb0 2023-09-30T22:31:11.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.771+0000 7f9b03fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b04130fb0 0x7f9b04138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:11.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.771+0000 7f9b037fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9b0409d920 0x7f9b0409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:11.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.772+0000 7f9b037fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9b0409d920 0x7f9b0409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35470/0 (socket says 172.21.15.40:35470) 2023-09-30T22:31:11.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.772+0000 7f9b03fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b04130fb0 0x7f9b04138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54888/0 (socket says 172.21.15.40:54888) 2023-09-30T22:31:11.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.772+0000 7f9b037fe700 1 -- 172.21.15.40:0/3705131745 learned_addr learned my addr 172.21.15.40:0/3705131745 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:11.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.772+0000 7f9b037fe700 1 -- 172.21.15.40:0/3705131745 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b04130fb0 msgr2=0x7f9b04138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:11.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.772+0000 7f9b037fe700 1 --2- 172.21.15.40:0/3705131745 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b04130fb0 0x7f9b04138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.772+0000 7f9b037fe700 1 -- 172.21.15.40:0/3705131745 >> v1:172.21.15.40:6789/0 conn(0x7f9b0409e230 legacy=0x7f9b041308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:11.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.772+0000 7f9b037fe700 1 -- 172.21.15.40:0/3705131745 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b0409a6e0 con 0x7f9b0409d920 2023-09-30T22:31:11.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.772+0000 7f9b03fff700 1 --2- 172.21.15.40:0/3705131745 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b04130fb0 0x7f9b04138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:31:11.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.772+0000 7f9b037fe700 1 --2- 172.21.15.40:0/3705131745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b0409d920 0x7f9b0409dcf0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f9af4006fd0 tx=0x7f9af400f050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e779a9d02b334e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:11.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.772+0000 7f9b027fc700 1 -- 172.21.15.40:0/3705131745 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af4012070 con 0x7f9b0409d920 2023-09-30T22:31:11.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.772+0000 7f9b027fc700 1 -- 172.21.15.40:0/3705131745 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af4005a20 con 0x7f9b0409d920 2023-09-30T22:31:11.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.772+0000 7f9b027fc700 1 -- 172.21.15.40:0/3705131745 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af4005dd0 con 0x7f9b0409d920 2023-09-30T22:31:11.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.772+0000 7f472d500700 1 -- 172.21.15.40:0/2062268685 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f472806a6d0 msgr2=0x7f472809d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:11.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.772+0000 7f472d500700 1 --2- 172.21.15.40:0/2062268685 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f472806a6d0 0x7f472809d920 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f47180098f0 tx=0x7f4718009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:11.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.773+0000 7f9b09dbf700 1 -- 172.21.15.40:0/3705131745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b0409d920 msgr2=0x7f9b0409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:11.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.773+0000 7f9b09dbf700 1 --2- 172.21.15.40:0/3705131745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b0409d920 0x7f9b0409dcf0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f9af4006fd0 tx=0x7f9af400f050 comp rx=0 tx=0).stop 2023-09-30T22:31:11.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.773+0000 7f472d500700 1 -- 172.21.15.40:0/2062268685 shutdown_connections 2023-09-30T22:31:11.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.773+0000 7f472d500700 1 --2- 172.21.15.40:0/2062268685 >> v2:172.21.15.40:3300/0 conn(0x7f472813c490 0x7f472813e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.773+0000 7f472d500700 1 --2- 172.21.15.40:0/2062268685 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f472806a6d0 0x7f472809d920 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.773+0000 7f472d500700 1 --2- 172.21.15.40:0/2062268685 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f472809de60 0x7f472809e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.773+0000 7f472d500700 1 -- 172.21.15.40:0/2062268685 >> 172.21.15.40:0/2062268685 conn(0x7f472809fb20 msgr2=0x7f472809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:11.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.773+0000 7f472d500700 1 -- 172.21.15.40:0/2062268685 shutdown_connections 2023-09-30T22:31:11.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.773+0000 7f472d500700 1 -- 172.21.15.40:0/2062268685 wait complete. 2023-09-30T22:31:11.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.773+0000 7f9b09dbf700 1 -- 172.21.15.40:0/3705131745 shutdown_connections 2023-09-30T22:31:11.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.773+0000 7f9b09dbf700 1 --2- 172.21.15.40:0/3705131745 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b04130fb0 0x7f9b04138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.773+0000 7f9b09dbf700 1 --2- 172.21.15.40:0/3705131745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b0409d920 0x7f9b0409dcf0 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.773+0000 7f9b09dbf700 1 -- 172.21.15.40:0/3705131745 >> 172.21.15.40:0/3705131745 conn(0x7f9b0409fb20 msgr2=0x7f9b0409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:11.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.773+0000 7f9b09dbf700 1 -- 172.21.15.40:0/3705131745 shutdown_connections 2023-09-30T22:31:11.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.773+0000 7f9b09dbf700 1 -- 172.21.15.40:0/3705131745 wait complete. 2023-09-30T22:31:11.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.775+0000 7f9b09dbf700 1 Processor -- start 2023-09-30T22:31:11.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.775+0000 7f472d500700 1 Processor -- start 2023-09-30T22:31:11.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.775+0000 7f472d500700 1 -- start start 2023-09-30T22:31:11.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.775+0000 7f9b09dbf700 1 -- start start 2023-09-30T22:31:11.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.775+0000 7f472d500700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f472806a6d0 0x7f47281cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:11.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.775+0000 7f9b09dbf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b0409d920 0x7f9b0411d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:11.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.775+0000 7f9b09dbf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b0409e230 0x7f9b0411d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:11.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.775+0000 7f9b09dbf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b04130fb0 0x7f9b0411dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:11.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.775+0000 7f9b09dbf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0411ed70 con 0x7f9b0409e230 2023-09-30T22:31:11.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.775+0000 7f9b09dbf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0411ffc0 con 0x7f9b0409d920 2023-09-30T22:31:11.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.775+0000 7f9b09dbf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0411f350 con 0x7f9b04130fb0 2023-09-30T22:31:11.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.775+0000 7f472d500700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f472809de60 0x7f47281cce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:11.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.775+0000 7f472d500700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f472813c490 0x7f47281cd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:11.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.775+0000 7f472d500700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472809f600 con 0x7f472806a6d0 2023-09-30T22:31:11.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.775+0000 7f472d500700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472811bf00 con 0x7f472813c490 2023-09-30T22:31:11.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.775+0000 7f472d500700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4728127200 con 0x7f472809de60 2023-09-30T22:31:11.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.776+0000 7f47277fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f472813c490 0x7f47281cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:11.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.776+0000 7f47277fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f472813c490 0x7f47281cd390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54902/0 (socket says 172.21.15.40:54902) 2023-09-30T22:31:11.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.776+0000 7f47277fe700 1 -- 172.21.15.40:0/3443872237 learned_addr learned my addr 172.21.15.40:0/3443872237 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:11.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.776+0000 7f9b037fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b0409d920 0x7f9b0411d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:11.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.776+0000 7f9b037fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b0409d920 0x7f9b0411d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54906/0 (socket says 172.21.15.40:54906) 2023-09-30T22:31:11.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.776+0000 7f9b037fe700 1 -- 172.21.15.40:0/1859904536 learned_addr learned my addr 172.21.15.40:0/1859904536 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:11.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.776+0000 7f9b03fff700 1 --2- 172.21.15.40:0/1859904536 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b04130fb0 0x7f9b0411dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:11.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.776+0000 7f47277fe700 1 -- 172.21.15.40:0/3443872237 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f472809de60 msgr2=0x7f47281cce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:11.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.776+0000 7f47277fe700 1 --2- 172.21.15.40:0/3443872237 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f472809de60 0x7f47281cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.776+0000 7f47277fe700 1 -- 172.21.15.40:0/3443872237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f472806a6d0 msgr2=0x7f47281cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:11.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.776+0000 7f47277fe700 1 --2- 172.21.15.40:0/3443872237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f472806a6d0 0x7f47281cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.776+0000 7f47277fe700 1 -- 172.21.15.40:0/3443872237 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4720009a70 con 0x7f472813c490 2023-09-30T22:31:11.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.776+0000 7f9b037fe700 1 -- 172.21.15.40:0/1859904536 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b04130fb0 msgr2=0x7f9b0411dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:11.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.776+0000 7f9b037fe700 1 --2- 172.21.15.40:0/1859904536 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b04130fb0 0x7f9b0411dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.776+0000 7f9b037fe700 1 -- 172.21.15.40:0/1859904536 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b0409e230 msgr2=0x7f9b0411d6a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:31:11.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.776+0000 7f9b037fe700 1 --2- 172.21.15.40:0/1859904536 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b0409e230 0x7f9b0411d6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.776+0000 7f9b037fe700 1 -- 172.21.15.40:0/1859904536 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af400d9a0 con 0x7f9b0409d920 2023-09-30T22:31:11.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.776+0000 7f9b037fe700 1 --2- 172.21.15.40:0/1859904536 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b0409d920 0x7f9b0411d160 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f9b04068450 tx=0x7f9af4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:11.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.776+0000 7f9aebfff700 1 -- 172.21.15.40:0/1859904536 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af40038a0 con 0x7f9b0409d920 2023-09-30T22:31:11.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.776+0000 7f9aebfff700 1 -- 172.21.15.40:0/1859904536 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af4003a00 con 0x7f9b0409d920 2023-09-30T22:31:11.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.776+0000 7f9b09dbf700 1 -- 172.21.15.40:0/1859904536 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b041209a0 con 0x7f9b0409d920 2023-09-30T22:31:11.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.777+0000 7f9b09dbf700 1 -- 172.21.15.40:0/1859904536 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b0409cb00 con 0x7f9b0409d920 2023-09-30T22:31:11.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.777+0000 7f47277fe700 1 --2- 172.21.15.40:0/3443872237 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f472813c490 0x7f47281cd390 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f472000efc0 tx=0x7f472000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:11.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.777+0000 7f470f7fe700 1 -- 172.21.15.40:0/3443872237 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4720009d70 con 0x7f472813c490 2023-09-30T22:31:11.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.777+0000 7f470f7fe700 1 -- 172.21.15.40:0/3443872237 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472000f040 con 0x7f472813c490 2023-09-30T22:31:11.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.777+0000 7f472d500700 1 -- 172.21.15.40:0/3443872237 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4718009500 con 0x7f472813c490 2023-09-30T22:31:11.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.777+0000 7f470f7fe700 1 -- 172.21.15.40:0/3443872237 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4720014480 con 0x7f472813c490 2023-09-30T22:31:11.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.777+0000 7f472d500700 1 -- 172.21.15.40:0/3443872237 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4728128220 con 0x7f472813c490 2023-09-30T22:31:11.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.777+0000 7f9aebfff700 1 -- 172.21.15.40:0/1859904536 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af4003db0 con 0x7f9b0409d920 2023-09-30T22:31:11.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.777+0000 7f9aebfff700 1 -- 172.21.15.40:0/1859904536 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9af4006000 con 0x7f9b0409d920 2023-09-30T22:31:11.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.778+0000 7f9aebfff700 1 -- 172.21.15.40:0/1859904536 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9af40456e0 con 0x7f9b0409d920 2023-09-30T22:31:11.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.778+0000 7f9b09dbf700 1 -- 172.21.15.40:0/1859904536 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ae40052e0 con 0x7f9b0409d920 2023-09-30T22:31:11.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.778+0000 7f472d500700 1 -- 172.21.15.40:0/3443872237 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4728062380 con 0x7f472813c490 2023-09-30T22:31:11.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.779+0000 7f470f7fe700 1 -- 172.21.15.40:0/3443872237 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f47200145e0 con 0x7f472813c490 2023-09-30T22:31:11.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.783+0000 7f470f7fe700 1 -- 172.21.15.40:0/3443872237 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f472001d400 con 0x7f472813c490 2023-09-30T22:31:11.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.783+0000 7f9aebfff700 1 -- 172.21.15.40:0/1859904536 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9af4026030 con 0x7f9b0409d920 2023-09-30T22:31:11.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.788+0000 7f470f7fe700 1 -- 172.21.15.40:0/3443872237 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4720054750 con 0x7f472813c490 2023-09-30T22:31:11.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.841+0000 7f2e2a901700 1 Processor -- start 2023-09-30T22:31:11.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.841+0000 7f2e2a901700 1 -- start start 2023-09-30T22:31:11.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.842+0000 7f2e2a901700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2e24067820 0x7f2e2409d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:11.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.842+0000 7f2e2a901700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e24067bf0 0x7f2e2409d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:11.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.842+0000 7f2e2a901700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e2409e8b0 con 0x7f2e2409ded0 2023-09-30T22:31:11.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.842+0000 7f2e2a901700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e2409e310 con 0x7f2e24067820 2023-09-30T22:31:11.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.842+0000 7f2e2a901700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2409c3b0 con 0x7f2e24067bf0 2023-09-30T22:31:11.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.842+0000 7f2e28e9e700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2e2409ded0 0x7f2e241301c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:42088/0 (socket says 172.21.15.40:42088) 2023-09-30T22:31:11.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.842+0000 7f2e28e9e700 1 -- 172.21.15.40:0/3210626720 learned_addr learned my addr 172.21.15.40:0/3210626720 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:11.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.842+0000 7f2e23fff700 1 --2- 172.21.15.40:0/3210626720 >> v2:172.21.15.40:3300/0 conn(0x7f2e24067820 0x7f2e2409d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:11.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.843+0000 7f2e237fe700 1 --2- 172.21.15.40:0/3210626720 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e24067bf0 0x7f2e2409d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:11.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.843+0000 7f2e23fff700 1 -- 172.21.15.40:0/3210626720 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e24067bf0 msgr2=0x7f2e2409d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:11.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.843+0000 7f2e23fff700 1 --2- 172.21.15.40:0/3210626720 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e24067bf0 0x7f2e2409d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.843+0000 7f2e23fff700 1 -- 172.21.15.40:0/3210626720 >> v1:172.21.15.40:6789/0 conn(0x7f2e2409ded0 legacy=0x7f2e241301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:11.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.843+0000 7f2e23fff700 1 -- 172.21.15.40:0/3210626720 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2409a6b0 con 0x7f2e24067820 2023-09-30T22:31:11.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.843+0000 7f2e23fff700 1 --2- 172.21.15.40:0/3210626720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e24067820 0x7f2e2409d450 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f2e14009840 tx=0x7f2e14009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9836fdb6a3bc6394 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:11.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.843+0000 7f2e22ffd700 1 -- 172.21.15.40:0/3210626720 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e14011830 con 0x7f2e24067820 2023-09-30T22:31:11.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.843+0000 7f2e22ffd700 1 -- 172.21.15.40:0/3210626720 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e14011990 con 0x7f2e24067820 2023-09-30T22:31:11.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.843+0000 7f2e22ffd700 1 -- 172.21.15.40:0/3210626720 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e14011d20 con 0x7f2e24067820 2023-09-30T22:31:11.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.844+0000 7f2e2a901700 1 -- 172.21.15.40:0/3210626720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e24067820 msgr2=0x7f2e2409d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:11.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.844+0000 7f2e2a901700 1 --2- 172.21.15.40:0/3210626720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e24067820 0x7f2e2409d450 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f2e14009840 tx=0x7f2e14009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:11.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.844+0000 7f2e2a901700 1 -- 172.21.15.40:0/3210626720 shutdown_connections 2023-09-30T22:31:11.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.844+0000 7f2e2a901700 1 --2- 172.21.15.40:0/3210626720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e24067820 0x7f2e2409d450 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.844+0000 7f2e2a901700 1 --2- 172.21.15.40:0/3210626720 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e24067bf0 0x7f2e2409d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.844+0000 7f2e2a901700 1 -- 172.21.15.40:0/3210626720 >> 172.21.15.40:0/3210626720 conn(0x7f2e240a2a00 msgr2=0x7f2e240a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:11.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.844+0000 7f2e2a901700 1 -- 172.21.15.40:0/3210626720 shutdown_connections 2023-09-30T22:31:11.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.844+0000 7f2e2a901700 1 -- 172.21.15.40:0/3210626720 wait complete. 2023-09-30T22:31:11.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.845+0000 7f2e2a901700 1 Processor -- start 2023-09-30T22:31:11.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.845+0000 7f2e2a901700 1 -- start start 2023-09-30T22:31:11.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.846+0000 7f2e2a901700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e24067820 0x7f2e241c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:11.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.846+0000 7f2e2a901700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e24067bf0 0x7f2e241c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:11.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.846+0000 7f2e2a901700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e2409ded0 0x7f2e241c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:11.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.846+0000 7f2e2a901700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2409c5d0 con 0x7f2e24067bf0 2023-09-30T22:31:11.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.846+0000 7f2e2a901700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e24125cb0 con 0x7f2e24067820 2023-09-30T22:31:11.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.846+0000 7f2e2a901700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e24131e60 con 0x7f2e2409ded0 2023-09-30T22:31:11.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.846+0000 7f2e23fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e24067820 0x7f2e241c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:11.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.846+0000 7f2e23fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e24067820 0x7f2e241c84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54916/0 (socket says 172.21.15.40:54916) 2023-09-30T22:31:11.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.846+0000 7f2e23fff700 1 -- 172.21.15.40:0/314217381 learned_addr learned my addr 172.21.15.40:0/314217381 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:11.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.846+0000 7f2e28e9e700 1 --2- 172.21.15.40:0/314217381 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e2409ded0 0x7f2e241c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:11.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.846+0000 7f2e237fe700 1 --2- 172.21.15.40:0/314217381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e24067bf0 0x7f2e241c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:11.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.846+0000 7f2e23fff700 1 -- 172.21.15.40:0/314217381 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e2409ded0 msgr2=0x7f2e241c8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:11.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.846+0000 7f2e23fff700 1 --2- 172.21.15.40:0/314217381 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e2409ded0 0x7f2e241c8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.846+0000 7f2e23fff700 1 -- 172.21.15.40:0/314217381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e24067bf0 msgr2=0x7f2e241c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:11.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.846+0000 7f2e23fff700 1 --2- 172.21.15.40:0/314217381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e24067bf0 0x7f2e241c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.846+0000 7f2e23fff700 1 -- 172.21.15.40:0/314217381 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e140094a0 con 0x7f2e24067820 2023-09-30T22:31:11.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.847+0000 7f2e23fff700 1 --2- 172.21.15.40:0/314217381 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e24067820 0x7f2e241c84f0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f2e14009fd0 tx=0x7f2e14004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:11.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.847+0000 7f2e20ff9700 1 -- 172.21.15.40:0/314217381 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e14004400 con 0x7f2e24067820 2023-09-30T22:31:11.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.847+0000 7f2e20ff9700 1 -- 172.21.15.40:0/314217381 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1401f070 con 0x7f2e24067820 2023-09-30T22:31:11.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.847+0000 7f2e20ff9700 1 -- 172.21.15.40:0/314217381 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e140038e0 con 0x7f2e24067820 2023-09-30T22:31:11.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.847+0000 7f2e2a901700 1 -- 172.21.15.40:0/314217381 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e24070a50 con 0x7f2e24067820 2023-09-30T22:31:11.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.847+0000 7f2e2a901700 1 -- 172.21.15.40:0/314217381 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e24131650 con 0x7f2e24067820 2023-09-30T22:31:11.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.848+0000 7f2e20ff9700 1 -- 172.21.15.40:0/314217381 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2e14021030 con 0x7f2e24067820 2023-09-30T22:31:11.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.848+0000 7f2e20ff9700 1 -- 172.21.15.40:0/314217381 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f2e14040820 con 0x7f2e24067820 2023-09-30T22:31:11.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.848+0000 7f2e2a901700 1 -- 172.21.15.40:0/314217381 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e24062380 con 0x7f2e24067820 2023-09-30T22:31:11.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.853+0000 7f2e20ff9700 1 -- 172.21.15.40:0/314217381 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e14004580 con 0x7f2e24067820 2023-09-30T22:31:11.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.982+0000 7f9b09dbf700 1 -- 172.21.15.40:0/1859904536 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9ae4005590 con 0x7f9b0409d920 2023-09-30T22:31:11.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.983+0000 7f9aebfff700 1 -- 172.21.15.40:0/1859904536 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9af400b450 con 0x7f9b0409d920 2023-09-30T22:31:11.984 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:11.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.985+0000 7f9b09dbf700 1 -- 172.21.15.40:0/1859904536 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b0409d920 msgr2=0x7f9b0411d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:11.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.985+0000 7f9b09dbf700 1 --2- 172.21.15.40:0/1859904536 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b0409d920 0x7f9b0411d160 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f9b04068450 tx=0x7f9af4004750 comp rx=0 tx=0).stop 2023-09-30T22:31:11.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.985+0000 7f9b09dbf700 1 -- 172.21.15.40:0/1859904536 shutdown_connections 2023-09-30T22:31:11.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.985+0000 7f9b09dbf700 1 --2- 172.21.15.40:0/1859904536 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9b04130fb0 0x7f9b0411dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.985+0000 7f9b09dbf700 1 --2- 172.21.15.40:0/1859904536 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9b0409d920 0x7f9b0411d160 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.985+0000 7f9b09dbf700 1 --2- 172.21.15.40:0/1859904536 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b0409e230 0x7f9b0411d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:11.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.985+0000 7f9b09dbf700 1 -- 172.21.15.40:0/1859904536 >> 172.21.15.40:0/1859904536 conn(0x7f9b0409fb20 msgr2=0x7f9b04130080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:11.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.986+0000 7f9b09dbf700 1 -- 172.21.15.40:0/1859904536 shutdown_connections 2023-09-30T22:31:11.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:11.986+0000 7f9b09dbf700 1 -- 172.21.15.40:0/1859904536 wait complete. 2023-09-30T22:31:11.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:12.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:12.005+0000 7fbdc9a2a700 1 -- 172.21.15.40:0/3002076124 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbdc4130bc0 con 0x7fbdc409e230 2023-09-30T22:31:12.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:12.006+0000 7fbdabfff700 1 -- 172.21.15.40:0/3002076124 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbdb8018580 con 0x7fbdc409e230 2023-09-30T22:31:12.006 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:12.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:12.009+0000 7fbdc9a2a700 1 -- 172.21.15.40:0/3002076124 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdc409e230 msgr2=0x7fbdc411b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:12.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:12.009+0000 7fbdc9a2a700 1 --2- 172.21.15.40:0/3002076124 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdc409e230 0x7fbdc411b880 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8010b90 tx=0x7fbdb8010ea0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:12.009+0000 7fbdc9a2a700 1 -- 172.21.15.40:0/3002076124 shutdown_connections 2023-09-30T22:31:12.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:12.009+0000 7fbdc9a2a700 1 --2- 172.21.15.40:0/3002076124 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbdc4130de0 0x7fbdc41c5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:12.009+0000 7fbdc9a2a700 1 --2- 172.21.15.40:0/3002076124 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdc409d920 0x7fbdc411b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:12.009+0000 7fbdc9a2a700 1 --2- 172.21.15.40:0/3002076124 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdc409e230 0x7fbdc411b880 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:12.009+0000 7fbdc9a2a700 1 -- 172.21.15.40:0/3002076124 >> 172.21.15.40:0/3002076124 conn(0x7fbdc409fb20 msgr2=0x7fbdc412f990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:12.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:12.009+0000 7fbdc9a2a700 1 -- 172.21.15.40:0/3002076124 shutdown_connections 2023-09-30T22:31:12.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:12.009+0000 7fbdc9a2a700 1 -- 172.21.15.40:0/3002076124 wait complete. 2023-09-30T22:31:12.026 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:12.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:12.044+0000 7f472d500700 1 -- 172.21.15.40:0/3443872237 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4728127d30 con 0x7f472813c490 2023-09-30T22:31:12.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:12.044+0000 7f470f7fe700 1 -- 172.21.15.40:0/3443872237 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f472002a070 con 0x7f472813c490 2023-09-30T22:31:12.045 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:12.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:12.046+0000 7f472d500700 1 -- 172.21.15.40:0/3443872237 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f472813c490 msgr2=0x7f47281cd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:12.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:12.046+0000 7f472d500700 1 --2- 172.21.15.40:0/3443872237 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f472813c490 0x7f47281cd390 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f472000efc0 tx=0x7f472000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:12.046+0000 7f472d500700 1 -- 172.21.15.40:0/3443872237 shutdown_connections 2023-09-30T22:31:12.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:12.046+0000 7f472d500700 1 --2- 172.21.15.40:0/3443872237 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f472813c490 0x7f47281cd390 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:12.046+0000 7f472d500700 1 --2- 172.21.15.40:0/3443872237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f472806a6d0 0x7f47281cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:12.046+0000 7f472d500700 1 --2- 172.21.15.40:0/3443872237 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f472809de60 0x7f47281cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:12.046+0000 7f472d500700 1 -- 172.21.15.40:0/3443872237 >> 172.21.15.40:0/3443872237 conn(0x7f472809fb20 msgr2=0x7f472813b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:12.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:12.046+0000 7f472d500700 1 -- 172.21.15.40:0/3443872237 shutdown_connections 2023-09-30T22:31:12.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:12.046+0000 7f472d500700 1 -- 172.21.15.40:0/3443872237 wait complete. 2023-09-30T22:31:12.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:12.053+0000 7f2e2a901700 1 -- 172.21.15.40:0/314217381 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2e24074330 con 0x7f2e24067820 2023-09-30T22:31:12.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:12.053+0000 7f2e20ff9700 1 -- 172.21.15.40:0/314217381 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2e14015020 con 0x7f2e24067820 2023-09-30T22:31:12.054 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:12.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:12.055+0000 7f2e2a901700 1 -- 172.21.15.40:0/314217381 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e24067820 msgr2=0x7f2e241c84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:12.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:12.055+0000 7f2e2a901700 1 --2- 172.21.15.40:0/314217381 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e24067820 0x7f2e241c84f0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f2e14009fd0 tx=0x7f2e14004750 comp rx=0 tx=0).stop 2023-09-30T22:31:12.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:12.055+0000 7f2e2a901700 1 -- 172.21.15.40:0/314217381 shutdown_connections 2023-09-30T22:31:12.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:12.055+0000 7f2e2a901700 1 --2- 172.21.15.40:0/314217381 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2e2409ded0 0x7f2e241c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:12.055+0000 7f2e2a901700 1 --2- 172.21.15.40:0/314217381 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e24067820 0x7f2e241c84f0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:12.055+0000 7f2e2a901700 1 --2- 172.21.15.40:0/314217381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e24067bf0 0x7f2e241c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:12.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:12.055+0000 7f2e2a901700 1 -- 172.21.15.40:0/314217381 >> 172.21.15.40:0/314217381 conn(0x7f2e240a2a00 msgr2=0x7f2e2406ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:12.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:12.056+0000 7f2e2a901700 1 -- 172.21.15.40:0/314217381 shutdown_connections 2023-09-30T22:31:12.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:12.056+0000 7f2e2a901700 1 -- 172.21.15.40:0/314217381 wait complete. 2023-09-30T22:31:12.060 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:12.069 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:13.000 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:13.027 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:13.060 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:13.069 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:13.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.156+0000 7fe0c6736700 1 Processor -- start 2023-09-30T22:31:13.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.157+0000 7fe0c6736700 1 -- start start 2023-09-30T22:31:13.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.157+0000 7fe0c6736700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0c012e590 0x7fe0c012e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:13.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.157+0000 7fe0c6736700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe0c012d8a0 0x7fe0c0138c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:13.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.157+0000 7fe0c6736700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c009ab70 con 0x7fe0c012eea0 2023-09-30T22:31:13.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.157+0000 7fe0c6736700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c009b270 con 0x7fe0c012e590 2023-09-30T22:31:13.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.157+0000 7fe0c6736700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c009bab0 con 0x7fe0c012d8a0 2023-09-30T22:31:13.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.157+0000 7fe0bffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0c012e590 0x7fe0c012e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:13.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.157+0000 7fe0bf7fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe0c012eea0 0x7fe0c012d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:42094/0 (socket says 172.21.15.40:42094) 2023-09-30T22:31:13.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.157+0000 7fe0bf7fe700 1 -- 172.21.15.40:0/917213075 learned_addr learned my addr 172.21.15.40:0/917213075 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:13.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.158+0000 7fe0c4cd3700 1 --2- 172.21.15.40:0/917213075 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe0c012d8a0 0x7fe0c0138c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:13.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.158+0000 7fe0bffff700 1 -- 172.21.15.40:0/917213075 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe0c012d8a0 msgr2=0x7fe0c0138c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:13.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.158+0000 7fe0bffff700 1 --2- 172.21.15.40:0/917213075 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe0c012d8a0 0x7fe0c0138c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.158+0000 7fe0bffff700 1 -- 172.21.15.40:0/917213075 >> v1:172.21.15.40:6789/0 conn(0x7fe0c012eea0 legacy=0x7fe0c012d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:13.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.158+0000 7fe0bffff700 1 -- 172.21.15.40:0/917213075 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c009bd70 con 0x7fe0c012e590 2023-09-30T22:31:13.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.158+0000 7fe0bffff700 1 --2- 172.21.15.40:0/917213075 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0c012e590 0x7fe0c012e960 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fe0b00098d0 tx=0x7fe0b0009be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf8c6288350326a1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:13.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.158+0000 7fe0beffd700 1 -- 172.21.15.40:0/917213075 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0004230 con 0x7fe0c012e590 2023-09-30T22:31:13.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.158+0000 7fe0beffd700 1 -- 172.21.15.40:0/917213075 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b0004390 con 0x7fe0c012e590 2023-09-30T22:31:13.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.158+0000 7fe0beffd700 1 -- 172.21.15.40:0/917213075 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0010890 con 0x7fe0c012e590 2023-09-30T22:31:13.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.159+0000 7fe0c6736700 1 -- 172.21.15.40:0/917213075 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0c012e590 msgr2=0x7fe0c012e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:13.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.159+0000 7fe0c6736700 1 --2- 172.21.15.40:0/917213075 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0c012e590 0x7fe0c012e960 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fe0b00098d0 tx=0x7fe0b0009be0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.159+0000 7fe0c6736700 1 -- 172.21.15.40:0/917213075 shutdown_connections 2023-09-30T22:31:13.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.159+0000 7fe0c6736700 1 --2- 172.21.15.40:0/917213075 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe0c012d8a0 0x7fe0c0138c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.159+0000 7fe0c6736700 1 --2- 172.21.15.40:0/917213075 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0c012e590 0x7fe0c012e960 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.159+0000 7fe0c6736700 1 -- 172.21.15.40:0/917213075 >> 172.21.15.40:0/917213075 conn(0x7fe0c00a2a00 msgr2=0x7fe0c00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:13.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.159+0000 7fe0c6736700 1 -- 172.21.15.40:0/917213075 shutdown_connections 2023-09-30T22:31:13.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.159+0000 7fe0c6736700 1 -- 172.21.15.40:0/917213075 wait complete. 2023-09-30T22:31:13.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.160+0000 7fe0c6736700 1 Processor -- start 2023-09-30T22:31:13.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.161+0000 7fe0c6736700 1 -- start start 2023-09-30T22:31:13.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.161+0000 7fe0c6736700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0c012d8a0 0x7fe0c011aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:13.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.161+0000 7fe0c6736700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe0c012e590 0x7fe0c011aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:13.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.161+0000 7fe0c6736700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0c012eea0 0x7fe0c011b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:13.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.161+0000 7fe0c6736700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c011c630 con 0x7fe0c012eea0 2023-09-30T22:31:13.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.161+0000 7fe0c6736700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c011cc50 con 0x7fe0c012d8a0 2023-09-30T22:31:13.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.161+0000 7fe0c6736700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c011d880 con 0x7fe0c012e590 2023-09-30T22:31:13.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.162+0000 7fe0bf7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe0c012e590 0x7fe0c011aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:13.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.162+0000 7fe0bf7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe0c012e590 0x7fe0c011aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:55682/0 (socket says 172.21.15.40:55682) 2023-09-30T22:31:13.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.162+0000 7fe0bf7fe700 1 -- 172.21.15.40:0/550666946 learned_addr learned my addr 172.21.15.40:0/550666946 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:13.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.162+0000 7fe0c4cd3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0c012eea0 0x7fe0c011b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:13.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.162+0000 7fe0bffff700 1 --2- 172.21.15.40:0/550666946 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0c012d8a0 0x7fe0c011aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:13.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.162+0000 7fe0bf7fe700 1 -- 172.21.15.40:0/550666946 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0c012d8a0 msgr2=0x7fe0c011aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:13.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.162+0000 7fe0bf7fe700 1 --2- 172.21.15.40:0/550666946 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0c012d8a0 0x7fe0c011aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.162+0000 7fe0bf7fe700 1 -- 172.21.15.40:0/550666946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0c012eea0 msgr2=0x7fe0c011b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:13.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.162+0000 7fe0bf7fe700 1 --2- 172.21.15.40:0/550666946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0c012eea0 0x7fe0c011b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.162+0000 7fe0bf7fe700 1 -- 172.21.15.40:0/550666946 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b00094a0 con 0x7fe0c012e590 2023-09-30T22:31:13.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.162+0000 7fe0bf7fe700 1 --2- 172.21.15.40:0/550666946 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe0c012e590 0x7fe0c011aff0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400c500 tx=0x7fe0b400c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:13.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.163+0000 7fe0bcff9700 1 -- 172.21.15.40:0/550666946 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b4005d70 con 0x7fe0c012e590 2023-09-30T22:31:13.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.163+0000 7fe0bcff9700 1 -- 172.21.15.40:0/550666946 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b40070d0 con 0x7fe0c012e590 2023-09-30T22:31:13.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.163+0000 7fe0bcff9700 1 -- 172.21.15.40:0/550666946 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b4007440 con 0x7fe0c012e590 2023-09-30T22:31:13.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.163+0000 7fe0c6736700 1 -- 172.21.15.40:0/550666946 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c011e260 con 0x7fe0c012e590 2023-09-30T22:31:13.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.163+0000 7fe0c6736700 1 -- 172.21.15.40:0/550666946 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c009b4b0 con 0x7fe0c012e590 2023-09-30T22:31:13.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.164+0000 7fe0bcff9700 1 -- 172.21.15.40:0/550666946 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe0b40075a0 con 0x7fe0c012e590 2023-09-30T22:31:13.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.164+0000 7fe0c6736700 1 -- 172.21.15.40:0/550666946 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c0062380 con 0x7fe0c012e590 2023-09-30T22:31:13.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.164+0000 7fe0bcff9700 1 -- 172.21.15.40:0/550666946 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe0b403ea80 con 0x7fe0c012e590 2023-09-30T22:31:13.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.169+0000 7fe0bcff9700 1 -- 172.21.15.40:0/550666946 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe0b4019d20 con 0x7fe0c012e590 2023-09-30T22:31:13.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.190+0000 7f859cf0b700 1 Processor -- start 2023-09-30T22:31:13.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.191+0000 7f859cf0b700 1 -- start start 2023-09-30T22:31:13.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.191+0000 7f859cf0b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f859809d920 0x7f859809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:13.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.191+0000 7f859cf0b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8598130fb0 0x7f8598138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:13.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.191+0000 7f859cf0b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f859809adf0 con 0x7f859809e230 2023-09-30T22:31:13.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.191+0000 7f859cf0b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f859809edf0 con 0x7f859809d920 2023-09-30T22:31:13.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.191+0000 7f859cf0b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f859809b660 con 0x7f8598130fb0 2023-09-30T22:31:13.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.191+0000 7f8595d9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f859809e230 0x7f85981308a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53030/0 (socket says 172.21.15.40:53030) 2023-09-30T22:31:13.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.191+0000 7f8595d9b700 1 -- 172.21.15.40:0/183762250 learned_addr learned my addr 172.21.15.40:0/183762250 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:13.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.191+0000 7f859659c700 1 --2- 172.21.15.40:0/183762250 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f859809d920 0x7f859809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:13.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.191+0000 7f8596d9d700 1 --2- 172.21.15.40:0/183762250 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8598130fb0 0x7f8598138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:13.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.192+0000 7f859559a700 1 -- 172.21.15.40:0/183762250 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 156323788 0 0) 0x7f859809adf0 con 0x7f859809e230 2023-09-30T22:31:13.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.192+0000 7f859559a700 1 -- 172.21.15.40:0/183762250 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85800035b0 con 0x7f859809e230 2023-09-30T22:31:13.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.192+0000 7f8596d9d700 1 -- 172.21.15.40:0/183762250 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f859809d920 msgr2=0x7f859809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:13.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.192+0000 7f8596d9d700 1 --2- 172.21.15.40:0/183762250 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f859809d920 0x7f859809dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.192+0000 7f8596d9d700 1 -- 172.21.15.40:0/183762250 >> v1:172.21.15.40:6789/0 conn(0x7f859809e230 legacy=0x7f85981308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:13.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.192+0000 7f8596d9d700 1 -- 172.21.15.40:0/183762250 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f859809a6e0 con 0x7f8598130fb0 2023-09-30T22:31:13.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.192+0000 7f8596d9d700 1 --2- 172.21.15.40:0/183762250 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8598130fb0 0x7f8598138d10 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f859000f3a0 tx=0x7f859000f6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=655d0caa6a62575b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:13.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.192+0000 7f859559a700 1 -- 172.21.15.40:0/183762250 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8590012070 con 0x7f8598130fb0 2023-09-30T22:31:13.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.192+0000 7f859559a700 1 -- 172.21.15.40:0/183762250 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f859000d0d0 con 0x7f8598130fb0 2023-09-30T22:31:13.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.192+0000 7f859559a700 1 -- 172.21.15.40:0/183762250 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859000fea0 con 0x7f8598130fb0 2023-09-30T22:31:13.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.193+0000 7f859cf0b700 1 -- 172.21.15.40:0/183762250 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8598130fb0 msgr2=0x7f8598138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:13.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.193+0000 7f859cf0b700 1 --2- 172.21.15.40:0/183762250 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8598130fb0 0x7f8598138d10 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f859000f3a0 tx=0x7f859000f6b0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.193+0000 7f859cf0b700 1 -- 172.21.15.40:0/183762250 shutdown_connections 2023-09-30T22:31:13.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.193+0000 7f859cf0b700 1 --2- 172.21.15.40:0/183762250 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f8598130fb0 0x7f8598138d10 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.193+0000 7f859cf0b700 1 --2- 172.21.15.40:0/183762250 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f859809d920 0x7f859809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.193+0000 7f859cf0b700 1 -- 172.21.15.40:0/183762250 >> 172.21.15.40:0/183762250 conn(0x7f859809fb20 msgr2=0x7f859809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:13.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.193+0000 7f859cf0b700 1 -- 172.21.15.40:0/183762250 shutdown_connections 2023-09-30T22:31:13.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.193+0000 7f859cf0b700 1 -- 172.21.15.40:0/183762250 wait complete. 2023-09-30T22:31:13.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.194+0000 7f859cf0b700 1 Processor -- start 2023-09-30T22:31:13.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.194+0000 7f859cf0b700 1 -- start start 2023-09-30T22:31:13.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.195+0000 7f859cf0b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f859809d920 0x7f85981c0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:13.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.195+0000 7f859cf0b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f859809e230 0x7f85981c13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:13.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.195+0000 7f859cf0b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8598130fb0 0x7f85981c3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:13.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.195+0000 7f859cf0b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f859811e1b0 con 0x7f859809e230 2023-09-30T22:31:13.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.195+0000 7f859cf0b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85981c1920 con 0x7f8598130fb0 2023-09-30T22:31:13.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.195+0000 7f859cf0b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f859811ca30 con 0x7f859809d920 2023-09-30T22:31:13.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.195+0000 7f859659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f859809d920 0x7f85981c0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:13.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.195+0000 7f859659c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f859809d920 0x7f85981c0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48170/0 (socket says 172.21.15.40:48170) 2023-09-30T22:31:13.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.195+0000 7f859659c700 1 -- 172.21.15.40:0/1159769453 learned_addr learned my addr 172.21.15.40:0/1159769453 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:13.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.195+0000 7f859659c700 1 -- 172.21.15.40:0/1159769453 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8598130fb0 msgr2=0x7f85981c3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:13.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.195+0000 7f859659c700 1 --2- 172.21.15.40:0/1159769453 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8598130fb0 0x7f85981c3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.195+0000 7f859659c700 1 -- 172.21.15.40:0/1159769453 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f859809e230 msgr2=0x7f85981c13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:13.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.195+0000 7f859659c700 1 --2- 172.21.15.40:0/1159769453 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f859809e230 0x7f85981c13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.195+0000 7f859659c700 1 -- 172.21.15.40:0/1159769453 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f859000f050 con 0x7f859809d920 2023-09-30T22:31:13.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.196+0000 7f859659c700 1 --2- 172.21.15.40:0/1159769453 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f859809d920 0x7f85981c0ea0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f858800fb60 tx=0x7f858800ff20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:13.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.196+0000 7f8586ffd700 1 -- 172.21.15.40:0/1159769453 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858800ddc0 con 0x7f859809d920 2023-09-30T22:31:13.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.196+0000 7f8586ffd700 1 -- 172.21.15.40:0/1159769453 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8588018440 con 0x7f859809d920 2023-09-30T22:31:13.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.196+0000 7f859cf0b700 1 -- 172.21.15.40:0/1159769453 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f859812e880 con 0x7f859809d920 2023-09-30T22:31:13.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.196+0000 7f8586ffd700 1 -- 172.21.15.40:0/1159769453 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85880187b0 con 0x7f859809d920 2023-09-30T22:31:13.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.196+0000 7f859cf0b700 1 -- 172.21.15.40:0/1159769453 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f859811dc80 con 0x7f859809d920 2023-09-30T22:31:13.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.197+0000 7f8586ffd700 1 -- 172.21.15.40:0/1159769453 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8588018910 con 0x7f859809d920 2023-09-30T22:31:13.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.197+0000 7f8586ffd700 1 -- 172.21.15.40:0/1159769453 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f858803fe50 con 0x7f859809d920 2023-09-30T22:31:13.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.197+0000 7f859cf0b700 1 -- 172.21.15.40:0/1159769453 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8598062380 con 0x7f859809d920 2023-09-30T22:31:13.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.202+0000 7f8586ffd700 1 -- 172.21.15.40:0/1159769453 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f858801d020 con 0x7f859809d920 2023-09-30T22:31:13.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.225+0000 7f45ca5ce700 1 Processor -- start 2023-09-30T22:31:13.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.225+0000 7f45ca5ce700 1 -- start start 2023-09-30T22:31:13.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.226+0000 7f45ca5ce700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45c409d920 0x7f45c409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:13.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.226+0000 7f45ca5ce700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f45c409e230 0x7f45c41308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:13.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.226+0000 7f45ca5ce700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c409adf0 con 0x7f45c4130de0 2023-09-30T22:31:13.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.226+0000 7f45ca5ce700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c409edf0 con 0x7f45c409d920 2023-09-30T22:31:13.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.226+0000 7f45ca5ce700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45c409b660 con 0x7f45c409e230 2023-09-30T22:31:13.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.226+0000 7f45c37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f45c409e230 0x7f45c41308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:13.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.226+0000 7f45c37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f45c409e230 0x7f45c41308a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48186/0 (socket says 172.21.15.40:48186) 2023-09-30T22:31:13.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.226+0000 7f45c37fe700 1 -- 172.21.15.40:0/1858060554 learned_addr learned my addr 172.21.15.40:0/1858060554 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:13.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.226+0000 7f45c3fff700 1 --2- 172.21.15.40:0/1858060554 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45c409d920 0x7f45c409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:13.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.226+0000 7f45c37fe700 1 -- 172.21.15.40:0/1858060554 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45c409d920 msgr2=0x7f45c409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:13.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.226+0000 7f45c37fe700 1 --2- 172.21.15.40:0/1858060554 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45c409d920 0x7f45c409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.226+0000 7f45c37fe700 1 -- 172.21.15.40:0/1858060554 >> v1:172.21.15.40:6789/0 conn(0x7f45c4130de0 legacy=0x7f45c4137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:13.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.226+0000 7f45c37fe700 1 -- 172.21.15.40:0/1858060554 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c409a6e0 con 0x7f45c409e230 2023-09-30T22:31:13.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.227+0000 7f45c37fe700 1 --2- 172.21.15.40:0/1858060554 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f45c409e230 0x7f45c41308a0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f45b8009920 tx=0x7f45b8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57f0747177191e1c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:13.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.227+0000 7f45c2ffd700 1 -- 172.21.15.40:0/1858060554 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b800ba60 con 0x7f45c409e230 2023-09-30T22:31:13.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.227+0000 7f45c2ffd700 1 -- 172.21.15.40:0/1858060554 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b800bbc0 con 0x7f45c409e230 2023-09-30T22:31:13.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.227+0000 7f45c2ffd700 1 -- 172.21.15.40:0/1858060554 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b8009e70 con 0x7f45c409e230 2023-09-30T22:31:13.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.228+0000 7f45ca5ce700 1 -- 172.21.15.40:0/1858060554 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f45c409e230 msgr2=0x7f45c41308a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:13.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.228+0000 7f45ca5ce700 1 --2- 172.21.15.40:0/1858060554 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f45c409e230 0x7f45c41308a0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f45b8009920 tx=0x7f45b8009c30 comp rx=0 tx=0).stop 2023-09-30T22:31:13.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.228+0000 7f45ca5ce700 1 -- 172.21.15.40:0/1858060554 shutdown_connections 2023-09-30T22:31:13.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.228+0000 7f45ca5ce700 1 --2- 172.21.15.40:0/1858060554 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45c409d920 0x7f45c409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.228+0000 7f45ca5ce700 1 --2- 172.21.15.40:0/1858060554 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f45c409e230 0x7f45c41308a0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.228+0000 7f45ca5ce700 1 -- 172.21.15.40:0/1858060554 >> 172.21.15.40:0/1858060554 conn(0x7f45c409fb20 msgr2=0x7f45c409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:13.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.228+0000 7f45ca5ce700 1 -- 172.21.15.40:0/1858060554 shutdown_connections 2023-09-30T22:31:13.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.228+0000 7f45ca5ce700 1 -- 172.21.15.40:0/1858060554 wait complete. 2023-09-30T22:31:13.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.229+0000 7f45ca5ce700 1 Processor -- start 2023-09-30T22:31:13.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.229+0000 7f45ca5ce700 1 -- start start 2023-09-30T22:31:13.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.230+0000 7f45ca5ce700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45c409d920 0x7f45c41215b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:13.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.230+0000 7f45ca5ce700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f45c409e230 0x7f45c4121af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:13.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.230+0000 7f45ca5ce700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45c4130de0 0x7f45c4122030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:13.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.230+0000 7f45ca5ce700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c41247d0 con 0x7f45c4130de0 2023-09-30T22:31:13.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.230+0000 7f45ca5ce700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c41231c0 con 0x7f45c409d920 2023-09-30T22:31:13.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.230+0000 7f45ca5ce700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45c4123a90 con 0x7f45c409e230 2023-09-30T22:31:13.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.230+0000 7f45c3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45c409d920 0x7f45c41215b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:13.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.230+0000 7f45c3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45c409d920 0x7f45c41215b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41548/0 (socket says 172.21.15.40:41548) 2023-09-30T22:31:13.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.230+0000 7f45c3fff700 1 -- 172.21.15.40:0/2639197501 learned_addr learned my addr 172.21.15.40:0/2639197501 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:13.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.230+0000 7f45c8b6b700 1 --2- 172.21.15.40:0/2639197501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45c4130de0 0x7f45c4122030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:13.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.230+0000 7f45c37fe700 1 --2- 172.21.15.40:0/2639197501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f45c409e230 0x7f45c4121af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:13.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.230+0000 7f45c3fff700 1 -- 172.21.15.40:0/2639197501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f45c409e230 msgr2=0x7f45c4121af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:13.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.230+0000 7f45c3fff700 1 --2- 172.21.15.40:0/2639197501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f45c409e230 0x7f45c4121af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.230+0000 7f45c3fff700 1 -- 172.21.15.40:0/2639197501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45c4130de0 msgr2=0x7f45c4122030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:13.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.230+0000 7f45c3fff700 1 --2- 172.21.15.40:0/2639197501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45c4130de0 0x7f45c4122030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.231+0000 7f45c3fff700 1 -- 172.21.15.40:0/2639197501 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b8009550 con 0x7f45c409d920 2023-09-30T22:31:13.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.231+0000 7f45c3fff700 1 --2- 172.21.15.40:0/2639197501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45c409d920 0x7f45c41215b0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f45b400e730 tx=0x7f45b400ea40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:13.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.231+0000 7f45c0ff9700 1 -- 172.21.15.40:0/2639197501 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b400c070 con 0x7f45c409d920 2023-09-30T22:31:13.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.231+0000 7f45c0ff9700 1 -- 172.21.15.40:0/2639197501 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b4013610 con 0x7f45c409d920 2023-09-30T22:31:13.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.231+0000 7f45c0ff9700 1 -- 172.21.15.40:0/2639197501 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b40139a0 con 0x7f45c409d920 2023-09-30T22:31:13.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.231+0000 7f45ca5ce700 1 -- 172.21.15.40:0/2639197501 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c41250d0 con 0x7f45c409d920 2023-09-30T22:31:13.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.231+0000 7f45ca5ce700 1 -- 172.21.15.40:0/2639197501 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c409cb60 con 0x7f45c409d920 2023-09-30T22:31:13.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.232+0000 7f45ca5ce700 1 -- 172.21.15.40:0/2639197501 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c4124f10 con 0x7f45c409d920 2023-09-30T22:31:13.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.232+0000 7f45c0ff9700 1 -- 172.21.15.40:0/2639197501 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f45b4013b00 con 0x7f45c409d920 2023-09-30T22:31:13.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.232+0000 7f45c0ff9700 1 -- 172.21.15.40:0/2639197501 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f45b403f3f0 con 0x7f45c409d920 2023-09-30T22:31:13.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.236+0000 7fba0d00e700 1 Processor -- start 2023-09-30T22:31:13.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.236+0000 7fba0d00e700 1 -- start start 2023-09-30T22:31:13.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.237+0000 7fba0d00e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba0809d450 0x7fba0809d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:13.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.237+0000 7f45c0ff9700 1 -- 172.21.15.40:0/2639197501 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f45b40108d0 con 0x7f45c409d920 2023-09-30T22:31:13.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.237+0000 7fba0d00e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fba081308d0 0x7fba08138420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:13.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.237+0000 7fba0d00e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba0809c3b0 con 0x7fba0809dd60 2023-09-30T22:31:13.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.237+0000 7fba0d00e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba0809a6b0 con 0x7fba081308d0 2023-09-30T22:31:13.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.237+0000 7fba0d00e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba0809b4f0 con 0x7fba0809d450 2023-09-30T22:31:13.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.237+0000 7fba0659c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fba0809dd60 0x7fba081301c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53042/0 (socket says 172.21.15.40:53042) 2023-09-30T22:31:13.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.237+0000 7fba0659c700 1 -- 172.21.15.40:0/2237455851 learned_addr learned my addr 172.21.15.40:0/2237455851 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:13.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.237+0000 7fba0759e700 1 --2- 172.21.15.40:0/2237455851 >> v2:172.21.15.40:3300/0 conn(0x7fba081308d0 0x7fba08138420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:13.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.238+0000 7fba0759e700 1 -- 172.21.15.40:0/2237455851 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba0809d450 msgr2=0x7fba0809d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:13.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.238+0000 7fba0759e700 1 --2- 172.21.15.40:0/2237455851 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba0809d450 0x7fba0809d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.238+0000 7fba0759e700 1 -- 172.21.15.40:0/2237455851 >> v1:172.21.15.40:6789/0 conn(0x7fba0809dd60 legacy=0x7fba081301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:13.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.238+0000 7fba0759e700 1 -- 172.21.15.40:0/2237455851 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0809af90 con 0x7fba081308d0 2023-09-30T22:31:13.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.238+0000 7fba0759e700 1 --2- 172.21.15.40:0/2237455851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba081308d0 0x7fba08138420 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fba0000aea0 tx=0x7fba0000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc8ea67b8070628 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:13.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.238+0000 7fba05d9b700 1 -- 172.21.15.40:0/2237455851 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0000f070 con 0x7fba081308d0 2023-09-30T22:31:13.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.238+0000 7fba05d9b700 1 -- 172.21.15.40:0/2237455851 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0000c9c0 con 0x7fba081308d0 2023-09-30T22:31:13.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.238+0000 7fba05d9b700 1 -- 172.21.15.40:0/2237455851 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0000cd50 con 0x7fba081308d0 2023-09-30T22:31:13.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.239+0000 7fba0d00e700 1 -- 172.21.15.40:0/2237455851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba081308d0 msgr2=0x7fba08138420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:13.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.239+0000 7fba0d00e700 1 --2- 172.21.15.40:0/2237455851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba081308d0 0x7fba08138420 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fba0000aea0 tx=0x7fba0000c330 comp rx=0 tx=0).stop 2023-09-30T22:31:13.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.239+0000 7fba0d00e700 1 -- 172.21.15.40:0/2237455851 shutdown_connections 2023-09-30T22:31:13.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.239+0000 7fba0d00e700 1 --2- 172.21.15.40:0/2237455851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba081308d0 0x7fba08138420 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.239+0000 7fba0d00e700 1 --2- 172.21.15.40:0/2237455851 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba0809d450 0x7fba0809d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.239+0000 7fba0d00e700 1 -- 172.21.15.40:0/2237455851 >> 172.21.15.40:0/2237455851 conn(0x7fba080a2a00 msgr2=0x7fba080a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:13.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.239+0000 7fba0d00e700 1 -- 172.21.15.40:0/2237455851 shutdown_connections 2023-09-30T22:31:13.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.239+0000 7fba0d00e700 1 -- 172.21.15.40:0/2237455851 wait complete. 2023-09-30T22:31:13.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.240+0000 7fba0d00e700 1 Processor -- start 2023-09-30T22:31:13.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.240+0000 7fba0d00e700 1 -- start start 2023-09-30T22:31:13.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.241+0000 7fba0d00e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba0809d450 0x7fba081c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:13.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.241+0000 7fba0d00e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fba0809dd60 0x7fba081c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:13.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.241+0000 7fba0d00e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba081308d0 0x7fba081c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:13.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.241+0000 7fba0d00e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0811fcf0 con 0x7fba0809d450 2023-09-30T22:31:13.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.241+0000 7fba0d00e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba0811e6b0 con 0x7fba081308d0 2023-09-30T22:31:13.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.241+0000 7fba0d00e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba080701d0 con 0x7fba0809dd60 2023-09-30T22:31:13.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.241+0000 7fba0759e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba081308d0 0x7fba081c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:13.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.241+0000 7fba0759e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba081308d0 0x7fba081c8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41572/0 (socket says 172.21.15.40:41572) 2023-09-30T22:31:13.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.241+0000 7fba0759e700 1 -- 172.21.15.40:0/3577745577 learned_addr learned my addr 172.21.15.40:0/3577745577 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:13.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.241+0000 7fba06d9d700 1 --2- 172.21.15.40:0/3577745577 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba0809d450 0x7fba081c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:13.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.241+0000 7fba0659c700 1 --2- 172.21.15.40:0/3577745577 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fba0809dd60 0x7fba081c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:13.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.241+0000 7fba0759e700 1 -- 172.21.15.40:0/3577745577 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fba0809dd60 msgr2=0x7fba081c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:13.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.241+0000 7fba0759e700 1 --2- 172.21.15.40:0/3577745577 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fba0809dd60 0x7fba081c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.241+0000 7fba0759e700 1 -- 172.21.15.40:0/3577745577 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba0809d450 msgr2=0x7fba081c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:13.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.241+0000 7fba0759e700 1 --2- 172.21.15.40:0/3577745577 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba0809d450 0x7fba081c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.241+0000 7fba0759e700 1 -- 172.21.15.40:0/3577745577 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0000ab80 con 0x7fba081308d0 2023-09-30T22:31:13.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.241+0000 7fba06d9d700 1 --2- 172.21.15.40:0/3577745577 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba0809d450 0x7fba081c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:13.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.241+0000 7fba0659c700 1 --2- 172.21.15.40:0/3577745577 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fba0809dd60 0x7fba081c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:13.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.241+0000 7fba0759e700 1 --2- 172.21.15.40:0/3577745577 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba081308d0 0x7fba081c8fb0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fba0809c540 tx=0x7fba00004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:13.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.242+0000 7fb9ef7fe700 1 -- 172.21.15.40:0/3577745577 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba00004870 con 0x7fba081308d0 2023-09-30T22:31:13.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.242+0000 7fb9ef7fe700 1 -- 172.21.15.40:0/3577745577 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0000a520 con 0x7fba081308d0 2023-09-30T22:31:13.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.242+0000 7fba0d00e700 1 -- 172.21.15.40:0/3577745577 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba080a2530 con 0x7fba081308d0 2023-09-30T22:31:13.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.242+0000 7fb9ef7fe700 1 -- 172.21.15.40:0/3577745577 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba00008680 con 0x7fba081308d0 2023-09-30T22:31:13.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.242+0000 7fba0d00e700 1 -- 172.21.15.40:0/3577745577 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba0809c5d0 con 0x7fba081308d0 2023-09-30T22:31:13.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.243+0000 7fb9ef7fe700 1 -- 172.21.15.40:0/3577745577 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fba000087e0 con 0x7fba081308d0 2023-09-30T22:31:13.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.243+0000 7fb9ef7fe700 1 -- 172.21.15.40:0/3577745577 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fba0001b9e0 con 0x7fba081308d0 2023-09-30T22:31:13.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.246+0000 7fba0d00e700 1 -- 172.21.15.40:0/3577745577 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba0811fe30 con 0x7fba081308d0 2023-09-30T22:31:13.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.255+0000 7fb9ef7fe700 1 -- 172.21.15.40:0/3577745577 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fba0811fe30 con 0x7fba081308d0 2023-09-30T22:31:13.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.371+0000 7fe0c6736700 1 -- 172.21.15.40:0/550666946 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe0c0074330 con 0x7fe0c012e590 2023-09-30T22:31:13.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.371+0000 7fe0bcff9700 1 -- 172.21.15.40:0/550666946 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe0b4017020 con 0x7fe0c012e590 2023-09-30T22:31:13.372 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:13.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.374+0000 7fe0c6736700 1 -- 172.21.15.40:0/550666946 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe0c012e590 msgr2=0x7fe0c011aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:13.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.374+0000 7fe0c6736700 1 --2- 172.21.15.40:0/550666946 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe0c012e590 0x7fe0c011aff0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400c500 tx=0x7fe0b400c810 comp rx=0 tx=0).stop 2023-09-30T22:31:13.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.374+0000 7fe0c6736700 1 -- 172.21.15.40:0/550666946 shutdown_connections 2023-09-30T22:31:13.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.374+0000 7fe0c6736700 1 --2- 172.21.15.40:0/550666946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0c012eea0 0x7fe0c011b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.374+0000 7fe0c6736700 1 --2- 172.21.15.40:0/550666946 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0c012d8a0 0x7fe0c011aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.374+0000 7fe0c6736700 1 --2- 172.21.15.40:0/550666946 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe0c012e590 0x7fe0c011aff0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.375+0000 7fe0c6736700 1 -- 172.21.15.40:0/550666946 >> 172.21.15.40:0/550666946 conn(0x7fe0c00a2a00 msgr2=0x7fe0c0099a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:13.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.375+0000 7fe0c6736700 1 -- 172.21.15.40:0/550666946 shutdown_connections 2023-09-30T22:31:13.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.375+0000 7fe0c6736700 1 -- 172.21.15.40:0/550666946 wait complete. 2023-09-30T22:31:13.388 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:13.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.414+0000 7f859cf0b700 1 -- 172.21.15.40:0/1159769453 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f859811e300 con 0x7f859809d920 2023-09-30T22:31:13.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.415+0000 7f8586ffd700 1 -- 172.21.15.40:0/1159769453 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8588017990 con 0x7f859809d920 2023-09-30T22:31:13.416 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:13.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.417+0000 7f859cf0b700 1 -- 172.21.15.40:0/1159769453 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f859809d920 msgr2=0x7f85981c0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:13.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.417+0000 7f859cf0b700 1 --2- 172.21.15.40:0/1159769453 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f859809d920 0x7f85981c0ea0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f858800fb60 tx=0x7f858800ff20 comp rx=0 tx=0).stop 2023-09-30T22:31:13.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.417+0000 7f859cf0b700 1 -- 172.21.15.40:0/1159769453 shutdown_connections 2023-09-30T22:31:13.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.417+0000 7f859cf0b700 1 --2- 172.21.15.40:0/1159769453 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f859809d920 0x7f85981c0ea0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.417+0000 7f859cf0b700 1 --2- 172.21.15.40:0/1159769453 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8598130fb0 0x7f85981c3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.417+0000 7f859cf0b700 1 --2- 172.21.15.40:0/1159769453 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f859809e230 0x7f85981c13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.417+0000 7f859cf0b700 1 -- 172.21.15.40:0/1159769453 >> 172.21.15.40:0/1159769453 conn(0x7f859809fb20 msgr2=0x7f859812de40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:13.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.417+0000 7f859cf0b700 1 -- 172.21.15.40:0/1159769453 shutdown_connections 2023-09-30T22:31:13.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.417+0000 7f859cf0b700 1 -- 172.21.15.40:0/1159769453 wait complete. 2023-09-30T22:31:13.430 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:13.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.467+0000 7f45ca5ce700 1 -- 172.21.15.40:0/2639197501 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f45c4062380 con 0x7f45c409d920 2023-09-30T22:31:13.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.468+0000 7f45c0ff9700 1 -- 172.21.15.40:0/2639197501 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f45b4010310 con 0x7f45c409d920 2023-09-30T22:31:13.468 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:13.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.470+0000 7f45ca5ce700 1 -- 172.21.15.40:0/2639197501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45c409d920 msgr2=0x7f45c41215b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:13.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.470+0000 7f45ca5ce700 1 --2- 172.21.15.40:0/2639197501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45c409d920 0x7f45c41215b0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f45b400e730 tx=0x7f45b400ea40 comp rx=0 tx=0).stop 2023-09-30T22:31:13.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.470+0000 7f45ca5ce700 1 -- 172.21.15.40:0/2639197501 shutdown_connections 2023-09-30T22:31:13.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.470+0000 7f45ca5ce700 1 --2- 172.21.15.40:0/2639197501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45c4130de0 0x7f45c4122030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.470+0000 7f45ca5ce700 1 --2- 172.21.15.40:0/2639197501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f45c409d920 0x7f45c41215b0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.470+0000 7f45ca5ce700 1 --2- 172.21.15.40:0/2639197501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f45c409e230 0x7f45c4121af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.470+0000 7f45ca5ce700 1 -- 172.21.15.40:0/2639197501 >> 172.21.15.40:0/2639197501 conn(0x7f45c409fb20 msgr2=0x7f45c412fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:13.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.470+0000 7f45ca5ce700 1 -- 172.21.15.40:0/2639197501 shutdown_connections 2023-09-30T22:31:13.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.470+0000 7f45ca5ce700 1 -- 172.21.15.40:0/2639197501 wait complete. 2023-09-30T22:31:13.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.475+0000 7fba0d00e700 1 -- 172.21.15.40:0/3577745577 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fba0811fe30 con 0x7fba081308d0 2023-09-30T22:31:13.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.475+0000 7fb9ef7fe700 1 -- 172.21.15.40:0/3577745577 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fba0811fe30 con 0x7fba081308d0 2023-09-30T22:31:13.476 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:13.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.477+0000 7fba0d00e700 1 -- 172.21.15.40:0/3577745577 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba081308d0 msgr2=0x7fba081c8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:13.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.477+0000 7fba0d00e700 1 --2- 172.21.15.40:0/3577745577 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba081308d0 0x7fba081c8fb0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fba0809c540 tx=0x7fba00004ad0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.477+0000 7fba0d00e700 1 -- 172.21.15.40:0/3577745577 shutdown_connections 2023-09-30T22:31:13.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.477+0000 7fba0d00e700 1 --2- 172.21.15.40:0/3577745577 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba081308d0 0x7fba081c8fb0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.477+0000 7fba0d00e700 1 --2- 172.21.15.40:0/3577745577 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba0809d450 0x7fba081c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.477+0000 7fba0d00e700 1 --2- 172.21.15.40:0/3577745577 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fba0809dd60 0x7fba081c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:13.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.477+0000 7fba0d00e700 1 -- 172.21.15.40:0/3577745577 >> 172.21.15.40:0/3577745577 conn(0x7fba080a2a00 msgr2=0x7fba08070700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:13.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.477+0000 7fba0d00e700 1 -- 172.21.15.40:0/3577745577 shutdown_connections 2023-09-30T22:31:13.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:13.477+0000 7fba0d00e700 1 -- 172.21.15.40:0/3577745577 wait complete. 2023-09-30T22:31:13.484 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:13.491 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:14.389 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:14.431 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:14.484 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:14.491 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:14.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.534+0000 7f1357c9b700 1 Processor -- start 2023-09-30T22:31:14.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.534+0000 7f1357c9b700 1 -- start start 2023-09-30T22:31:14.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.535+0000 7f1357c9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f135009d920 0x7f135009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:14.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.535+0000 7f1357c9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f135009f0f0 0x7f135009e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:14.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.535+0000 7f1357c9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1350133ca0 0x7f1350134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:14.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.535+0000 7f1357c9b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f135006b4c0 con 0x7f1350133ca0 2023-09-30T22:31:14.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.535+0000 7f1357c9b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135009a8f0 con 0x7f135009f0f0 2023-09-30T22:31:14.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.535+0000 7f1357c9b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f135009f940 con 0x7f135009d920 2023-09-30T22:31:14.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.535+0000 7f1355236700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f135009f0f0 0x7f135009e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:14.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.535+0000 7f1355a37700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f135009d920 0x7f135009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:14.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.535+0000 7f1355236700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f135009f0f0 0x7f135009e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41576/0 (socket says 172.21.15.40:41576) 2023-09-30T22:31:14.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.535+0000 7f1355a37700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f135009d920 0x7f135009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48216/0 (socket says 172.21.15.40:48216) 2023-09-30T22:31:14.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.535+0000 7f1355236700 1 -- 172.21.15.40:0/4098522180 learned_addr learned my addr 172.21.15.40:0/4098522180 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:14.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.535+0000 7f1356238700 1 --2- 172.21.15.40:0/4098522180 >> v2:172.21.15.40:3300/0 conn(0x7f1350133ca0 0x7f1350134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:14.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.536+0000 7f1355a37700 1 -- 172.21.15.40:0/4098522180 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f135009f0f0 msgr2=0x7f135009e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:14.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.536+0000 7f1355a37700 1 --2- 172.21.15.40:0/4098522180 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f135009f0f0 0x7f135009e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.536+0000 7f1355a37700 1 -- 172.21.15.40:0/4098522180 >> v2:172.21.15.40:3300/0 conn(0x7f1350133ca0 msgr2=0x7f1350134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:14.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.536+0000 7f1355a37700 1 --2- 172.21.15.40:0/4098522180 >> v2:172.21.15.40:3300/0 conn(0x7f1350133ca0 0x7f1350134140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.536+0000 7f1355a37700 1 -- 172.21.15.40:0/4098522180 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135009f6e0 con 0x7f135009d920 2023-09-30T22:31:14.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.536+0000 7f1356238700 1 --2- 172.21.15.40:0/4098522180 >> v2:172.21.15.40:3300/0 conn(0x7f1350133ca0 0x7f1350134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:14.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.536+0000 7f1355a37700 1 --2- 172.21.15.40:0/4098522180 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f135009d920 0x7f135009dcf0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f134c009850 tx=0x7f134c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d77db8559fb24f8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:14.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.536+0000 7f1354a35700 1 -- 172.21.15.40:0/4098522180 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c005e30 con 0x7f135009d920 2023-09-30T22:31:14.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.536+0000 7f1354a35700 1 -- 172.21.15.40:0/4098522180 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134c006030 con 0x7f135009d920 2023-09-30T22:31:14.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.536+0000 7f1354a35700 1 -- 172.21.15.40:0/4098522180 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c0063c0 con 0x7f135009d920 2023-09-30T22:31:14.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.537+0000 7f1357c9b700 1 -- 172.21.15.40:0/4098522180 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f135009d920 msgr2=0x7f135009dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:14.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.537+0000 7f1357c9b700 1 --2- 172.21.15.40:0/4098522180 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f135009d920 0x7f135009dcf0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f134c009850 tx=0x7f134c009b60 comp rx=0 tx=0).stop 2023-09-30T22:31:14.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.537+0000 7f1357c9b700 1 -- 172.21.15.40:0/4098522180 shutdown_connections 2023-09-30T22:31:14.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.537+0000 7f1357c9b700 1 --2- 172.21.15.40:0/4098522180 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f135009d920 0x7f135009dcf0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.537+0000 7f1357c9b700 1 --2- 172.21.15.40:0/4098522180 >> v2:172.21.15.40:3300/0 conn(0x7f1350133ca0 0x7f1350134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.537+0000 7f1357c9b700 1 --2- 172.21.15.40:0/4098522180 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f135009f0f0 0x7f135009e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.538+0000 7f1357c9b700 1 -- 172.21.15.40:0/4098522180 >> 172.21.15.40:0/4098522180 conn(0x7f135009fb20 msgr2=0x7f135009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:14.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.538+0000 7f1357c9b700 1 -- 172.21.15.40:0/4098522180 shutdown_connections 2023-09-30T22:31:14.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.538+0000 7f1357c9b700 1 -- 172.21.15.40:0/4098522180 wait complete. 2023-09-30T22:31:14.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.539+0000 7f1357c9b700 1 Processor -- start 2023-09-30T22:31:14.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.539+0000 7f1357c9b700 1 -- start start 2023-09-30T22:31:14.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.540+0000 7f1357c9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f135009d920 0x7f135011e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:14.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.540+0000 7f1357c9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1350133ca0 0x7f135011ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:14.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.540+0000 7f1357c9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f135011f340 0x7f13501c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:14.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.540+0000 7f1357c9b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135011fd00 con 0x7f135009d920 2023-09-30T22:31:14.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.540+0000 7f1357c9b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13500a2cb0 con 0x7f135011f340 2023-09-30T22:31:14.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.540+0000 7f1357c9b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1350120520 con 0x7f1350133ca0 2023-09-30T22:31:14.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.540+0000 7f1355a37700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f135009d920 0x7f135011e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:14.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.540+0000 7f1355236700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1350133ca0 0x7f135011ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:14.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.540+0000 7f1355a37700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f135009d920 0x7f135011e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51494/0 (socket says 172.21.15.40:51494) 2023-09-30T22:31:14.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.540+0000 7f1356238700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f135011f340 0x7f13501c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:14.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.540+0000 7f1355a37700 1 -- 172.21.15.40:0/967788722 learned_addr learned my addr 172.21.15.40:0/967788722 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:14.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.540+0000 7f1355236700 1 --2- 172.21.15.40:0/967788722 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1350133ca0 0x7f135011ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48232/0 (socket says 172.21.15.40:48232) 2023-09-30T22:31:14.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.541+0000 7f1356238700 1 -- 172.21.15.40:0/967788722 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1350133ca0 msgr2=0x7f135011ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:14.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.541+0000 7f1356238700 1 --2- 172.21.15.40:0/967788722 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1350133ca0 0x7f135011ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.541+0000 7f1356238700 1 -- 172.21.15.40:0/967788722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f135009d920 msgr2=0x7f135011e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:14.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.541+0000 7f1356238700 1 --2- 172.21.15.40:0/967788722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f135009d920 0x7f135011e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.541+0000 7f1356238700 1 -- 172.21.15.40:0/967788722 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1348009a70 con 0x7f135011f340 2023-09-30T22:31:14.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.541+0000 7f1355a37700 1 --2- 172.21.15.40:0/967788722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f135009d920 0x7f135011e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:14.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.541+0000 7f1356238700 1 --2- 172.21.15.40:0/967788722 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f135011f340 0x7f13501c8720 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f134800efc0 tx=0x7f134800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:14.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.541+0000 7f13467fc700 1 -- 172.21.15.40:0/967788722 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1348009e60 con 0x7f135011f340 2023-09-30T22:31:14.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.541+0000 7f13467fc700 1 -- 172.21.15.40:0/967788722 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134800f040 con 0x7f135011f340 2023-09-30T22:31:14.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.541+0000 7f13467fc700 1 -- 172.21.15.40:0/967788722 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134800cd60 con 0x7f135011f340 2023-09-30T22:31:14.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.541+0000 7f1357c9b700 1 -- 172.21.15.40:0/967788722 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f134c009430 con 0x7f135011f340 2023-09-30T22:31:14.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.541+0000 7f1357c9b700 1 -- 172.21.15.40:0/967788722 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1350122040 con 0x7f135011f340 2023-09-30T22:31:14.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.542+0000 7f13467fc700 1 -- 172.21.15.40:0/967788722 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1348014480 con 0x7f135011f340 2023-09-30T22:31:14.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.542+0000 7f1357c9b700 1 -- 172.21.15.40:0/967788722 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1350121cc0 con 0x7f135011f340 2023-09-30T22:31:14.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.543+0000 7f13467fc700 1 -- 172.21.15.40:0/967788722 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f134803fdc0 con 0x7f135011f340 2023-09-30T22:31:14.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.552+0000 7f13467fc700 1 -- 172.21.15.40:0/967788722 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1350121cc0 con 0x7f135011f340 2023-09-30T22:31:14.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.576+0000 7f735f4eb700 1 Processor -- start 2023-09-30T22:31:14.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.576+0000 7f735f4eb700 1 -- start start 2023-09-30T22:31:14.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.576+0000 7f735f4eb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f735809d450 0x7f735809d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:14.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.576+0000 7f735f4eb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f735809dd60 0x7f7358067820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:14.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.576+0000 7f735f4eb700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73581301c0 0x7f7358130640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:14.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.576+0000 7f735f4eb700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f735809c3b0 con 0x7f735809d450 2023-09-30T22:31:14.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.576+0000 7f735f4eb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f735809a6b0 con 0x7f735809dd60 2023-09-30T22:31:14.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.576+0000 7f735f4eb700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f735809b4f0 con 0x7f73581301c0 2023-09-30T22:31:14.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.577+0000 7f735da88700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73581301c0 0x7f7358130640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:14.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.577+0000 7f735ca86700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f735809dd60 0x7f7358067820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:14.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.577+0000 7f735da88700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73581301c0 0x7f7358130640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48238/0 (socket says 172.21.15.40:48238) 2023-09-30T22:31:14.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.577+0000 7f735da88700 1 -- 172.21.15.40:0/746155779 learned_addr learned my addr 172.21.15.40:0/746155779 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:14.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.577+0000 7f735d287700 1 --2- 172.21.15.40:0/746155779 >> v2:172.21.15.40:3300/0 conn(0x7f735809d450 0x7f735809d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:14.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.577+0000 7f735ca86700 1 -- 172.21.15.40:0/746155779 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73581301c0 msgr2=0x7f7358130640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:14.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.577+0000 7f735ca86700 1 --2- 172.21.15.40:0/746155779 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73581301c0 0x7f7358130640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.577+0000 7f735ca86700 1 -- 172.21.15.40:0/746155779 >> v2:172.21.15.40:3300/0 conn(0x7f735809d450 msgr2=0x7f735809d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:14.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.577+0000 7f735ca86700 1 --2- 172.21.15.40:0/746155779 >> v2:172.21.15.40:3300/0 conn(0x7f735809d450 0x7f735809d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.577+0000 7f735ca86700 1 -- 172.21.15.40:0/746155779 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f735809af90 con 0x7f735809dd60 2023-09-30T22:31:14.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.577+0000 7f735ca86700 1 --2- 172.21.15.40:0/746155779 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f735809dd60 0x7f7358067820 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f7348009840 tx=0x7f7348009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=431c65adee3e7816 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:14.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.577+0000 7f734ffff700 1 -- 172.21.15.40:0/746155779 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7348011830 con 0x7f735809dd60 2023-09-30T22:31:14.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.578+0000 7f734ffff700 1 -- 172.21.15.40:0/746155779 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7348011990 con 0x7f735809dd60 2023-09-30T22:31:14.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.578+0000 7f734ffff700 1 -- 172.21.15.40:0/746155779 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7348011d20 con 0x7f735809dd60 2023-09-30T22:31:14.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.578+0000 7f735f4eb700 1 -- 172.21.15.40:0/746155779 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f735809dd60 msgr2=0x7f7358067820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:14.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.578+0000 7f735f4eb700 1 --2- 172.21.15.40:0/746155779 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f735809dd60 0x7f7358067820 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f7348009840 tx=0x7f7348009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:14.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.578+0000 7f735f4eb700 1 -- 172.21.15.40:0/746155779 shutdown_connections 2023-09-30T22:31:14.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.578+0000 7f735f4eb700 1 --2- 172.21.15.40:0/746155779 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f73581301c0 0x7f7358130640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.578+0000 7f735f4eb700 1 --2- 172.21.15.40:0/746155779 >> v2:172.21.15.40:3300/0 conn(0x7f735809d450 0x7f735809d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.578+0000 7f735f4eb700 1 --2- 172.21.15.40:0/746155779 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f735809dd60 0x7f7358067820 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.578+0000 7f735f4eb700 1 -- 172.21.15.40:0/746155779 >> 172.21.15.40:0/746155779 conn(0x7f73580a2a00 msgr2=0x7f73580a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:14.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.578+0000 7f735f4eb700 1 -- 172.21.15.40:0/746155779 shutdown_connections 2023-09-30T22:31:14.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.579+0000 7f735f4eb700 1 -- 172.21.15.40:0/746155779 wait complete. 2023-09-30T22:31:14.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.580+0000 7f735f4eb700 1 Processor -- start 2023-09-30T22:31:14.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.580+0000 7f735f4eb700 1 -- start start 2023-09-30T22:31:14.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.580+0000 7f735f4eb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f735809d450 0x7f735812c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:14.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.580+0000 7f735f4eb700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f735809dd60 0x7f735812c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:14.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.580+0000 7f735f4eb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73581301c0 0x7f735812cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:14.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.580+0000 7f735f4eb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7358130e60 con 0x7f73581301c0 2023-09-30T22:31:14.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.580+0000 7f735f4eb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73581308e0 con 0x7f735809d450 2023-09-30T22:31:14.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.580+0000 7f735f4eb700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7358130640 con 0x7f735809dd60 2023-09-30T22:31:14.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.580+0000 7f735d287700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f735809d450 0x7f735812c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:14.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.580+0000 7f735d287700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f735809d450 0x7f735812c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41584/0 (socket says 172.21.15.40:41584) 2023-09-30T22:31:14.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.580+0000 7f735d287700 1 -- 172.21.15.40:0/1142815738 learned_addr learned my addr 172.21.15.40:0/1142815738 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:14.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.580+0000 7f735da88700 1 --2- 172.21.15.40:0/1142815738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73581301c0 0x7f735812cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:14.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.581+0000 7f735d287700 1 -- 172.21.15.40:0/1142815738 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f735809dd60 msgr2=0x7f735812c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:14.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.581+0000 7f735d287700 1 --2- 172.21.15.40:0/1142815738 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f735809dd60 0x7f735812c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.581+0000 7f735d287700 1 -- 172.21.15.40:0/1142815738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73581301c0 msgr2=0x7f735812cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:14.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.581+0000 7f735d287700 1 --2- 172.21.15.40:0/1142815738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73581301c0 0x7f735812cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.581+0000 7f735d287700 1 -- 172.21.15.40:0/1142815738 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73480094a0 con 0x7f735809d450 2023-09-30T22:31:14.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.581+0000 7f735d287700 1 --2- 172.21.15.40:0/1142815738 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f735809d450 0x7f735812c490 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f735400e9e0 tx=0x7f735400eda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:14.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.581+0000 7f734dffb700 1 -- 172.21.15.40:0/1142815738 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7354009710 con 0x7f735809d450 2023-09-30T22:31:14.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.581+0000 7f734dffb700 1 -- 172.21.15.40:0/1142815738 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735400c850 con 0x7f735809d450 2023-09-30T22:31:14.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.581+0000 7f735f4eb700 1 -- 172.21.15.40:0/1142815738 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f735809c630 con 0x7f735809d450 2023-09-30T22:31:14.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.581+0000 7f734dffb700 1 -- 172.21.15.40:0/1142815738 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735400cbc0 con 0x7f735809d450 2023-09-30T22:31:14.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.581+0000 7f735f4eb700 1 -- 172.21.15.40:0/1142815738 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f735812e7e0 con 0x7f735809d450 2023-09-30T22:31:14.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.582+0000 7f734dffb700 1 -- 172.21.15.40:0/1142815738 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f735400cd20 con 0x7f735809d450 2023-09-30T22:31:14.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.583+0000 7f734dffb700 1 -- 172.21.15.40:0/1142815738 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f735403f970 con 0x7f735809d450 2023-09-30T22:31:14.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.583+0000 7f735f4eb700 1 -- 172.21.15.40:0/1142815738 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73580a2340 con 0x7f735809d450 2023-09-30T22:31:14.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.588+0000 7f734dffb700 1 -- 172.21.15.40:0/1142815738 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7354021080 con 0x7f735809d450 2023-09-30T22:31:14.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.629+0000 7fc2a82b0700 1 Processor -- start 2023-09-30T22:31:14.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.629+0000 7fc2a82b0700 1 -- start start 2023-09-30T22:31:14.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.629+0000 7fc2a82b0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc2a009d920 0x7fc2a009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:14.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.629+0000 7fc2a82b0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2a009e230 0x7fc2a01343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:14.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.629+0000 7fc2a82b0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a009f940 con 0x7fc2a009f0f0 2023-09-30T22:31:14.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.629+0000 7fc2a82b0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a006b4c0 con 0x7fc2a009d920 2023-09-30T22:31:14.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.629+0000 7fc2a82b0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a009a8f0 con 0x7fc2a009e230 2023-09-30T22:31:14.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.630+0000 7fc2a604c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc2a009d920 0x7fc2a009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:14.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.630+0000 7fc2a604c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc2a009d920 0x7fc2a009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51514/0 (socket says 172.21.15.40:51514) 2023-09-30T22:31:14.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.630+0000 7fc2a604c700 1 -- 172.21.15.40:0/1352451647 learned_addr learned my addr 172.21.15.40:0/1352451647 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:14.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.630+0000 7fc2a684d700 1 --2- 172.21.15.40:0/1352451647 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2a009e230 0x7fc2a01343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:14.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.630+0000 7fc2a604c700 1 -- 172.21.15.40:0/1352451647 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2a009e230 msgr2=0x7fc2a01343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:14.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.630+0000 7fc2a604c700 1 --2- 172.21.15.40:0/1352451647 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2a009e230 0x7fc2a01343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.630+0000 7fc2a604c700 1 -- 172.21.15.40:0/1352451647 >> v1:172.21.15.40:6789/0 conn(0x7fc2a009f0f0 legacy=0x7fc2a0133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:14.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.630+0000 7fc2a604c700 1 -- 172.21.15.40:0/1352451647 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a009f6e0 con 0x7fc2a009d920 2023-09-30T22:31:14.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.630+0000 7fc2a604c700 1 --2- 172.21.15.40:0/1352451647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2a009d920 0x7fc2a009dcf0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fc29c006fd0 tx=0x7fc29c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47032818a46f7005 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:14.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.630+0000 7fc2a504a700 1 -- 172.21.15.40:0/1352451647 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c005e30 con 0x7fc2a009d920 2023-09-30T22:31:14.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.630+0000 7fc2a504a700 1 -- 172.21.15.40:0/1352451647 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29c004030 con 0x7fc2a009d920 2023-09-30T22:31:14.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.630+0000 7fc2a504a700 1 -- 172.21.15.40:0/1352451647 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c0043e0 con 0x7fc2a009d920 2023-09-30T22:31:14.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.631+0000 7fc2a82b0700 1 -- 172.21.15.40:0/1352451647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2a009d920 msgr2=0x7fc2a009dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:14.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.631+0000 7fc2a82b0700 1 --2- 172.21.15.40:0/1352451647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2a009d920 0x7fc2a009dcf0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fc29c006fd0 tx=0x7fc29c009bd0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.631+0000 7fc2a82b0700 1 -- 172.21.15.40:0/1352451647 shutdown_connections 2023-09-30T22:31:14.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.631+0000 7fc2a82b0700 1 --2- 172.21.15.40:0/1352451647 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2a009e230 0x7fc2a01343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.631+0000 7fc2a82b0700 1 --2- 172.21.15.40:0/1352451647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2a009d920 0x7fc2a009dcf0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.631+0000 7fc2a82b0700 1 -- 172.21.15.40:0/1352451647 >> 172.21.15.40:0/1352451647 conn(0x7fc2a009fb20 msgr2=0x7fc2a009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:14.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.631+0000 7fc2a82b0700 1 -- 172.21.15.40:0/1352451647 shutdown_connections 2023-09-30T22:31:14.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.631+0000 7fc2a82b0700 1 -- 172.21.15.40:0/1352451647 wait complete. 2023-09-30T22:31:14.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.632+0000 7fc2a82b0700 1 Processor -- start 2023-09-30T22:31:14.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.632+0000 7fc2a82b0700 1 -- start start 2023-09-30T22:31:14.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.633+0000 7fc2a82b0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc2a009d920 0x7fc2a01a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:14.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.633+0000 7fc2a82b0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2a009e230 0x7fc2a01a6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:14.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.633+0000 7fc2a82b0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2a01b9540 0x7fc2a01a6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:14.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.633+0000 7fc2a82b0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a01a7610 con 0x7fc2a009e230 2023-09-30T22:31:14.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.633+0000 7fc2a82b0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a01a94e0 con 0x7fc2a01b9540 2023-09-30T22:31:14.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.633+0000 7fc2a82b0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a01aa630 con 0x7fc2a009d920 2023-09-30T22:31:14.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.633+0000 7fc2a684d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2a01b9540 0x7fc2a01a6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:14.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.633+0000 7fc2a684d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2a01b9540 0x7fc2a01a6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41596/0 (socket says 172.21.15.40:41596) 2023-09-30T22:31:14.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.633+0000 7fc2a684d700 1 -- 172.21.15.40:0/4093455662 learned_addr learned my addr 172.21.15.40:0/4093455662 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:14.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.633+0000 7fc2a604c700 1 --2- 172.21.15.40:0/4093455662 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc2a009d920 0x7fc2a01a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:14.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.633+0000 7fc2a684d700 1 -- 172.21.15.40:0/4093455662 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc2a009d920 msgr2=0x7fc2a01a61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:14.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.633+0000 7fc2a684d700 1 --2- 172.21.15.40:0/4093455662 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc2a009d920 0x7fc2a01a61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.633+0000 7fc2a684d700 1 -- 172.21.15.40:0/4093455662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2a009e230 msgr2=0x7fc2a01a6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:14.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.633+0000 7fc2a684d700 1 --2- 172.21.15.40:0/4093455662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2a009e230 0x7fc2a01a6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.633+0000 7fc2a684d700 1 -- 172.21.15.40:0/4093455662 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29c009500 con 0x7fc2a01b9540 2023-09-30T22:31:14.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.634+0000 7fc2a684d700 1 --2- 172.21.15.40:0/4093455662 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2a01b9540 0x7fc2a01a6c50 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fc298009dd0 tx=0x7fc29800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:14.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.634+0000 7fc296ffd700 1 -- 172.21.15.40:0/4093455662 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc298009c40 con 0x7fc2a01b9540 2023-09-30T22:31:14.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.634+0000 7fc2a82b0700 1 -- 172.21.15.40:0/4093455662 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a01a7e00 con 0x7fc2a01b9540 2023-09-30T22:31:14.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.634+0000 7fc2a82b0700 1 -- 172.21.15.40:0/4093455662 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a009c9e0 con 0x7fc2a01b9540 2023-09-30T22:31:14.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.634+0000 7fc296ffd700 1 -- 172.21.15.40:0/4093455662 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29800f040 con 0x7fc2a01b9540 2023-09-30T22:31:14.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.634+0000 7fc296ffd700 1 -- 172.21.15.40:0/4093455662 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc298014480 con 0x7fc2a01b9540 2023-09-30T22:31:14.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.635+0000 7fc296ffd700 1 -- 172.21.15.40:0/4093455662 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc2980145e0 con 0x7fc2a01b9540 2023-09-30T22:31:14.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.635+0000 7fc2a82b0700 1 -- 172.21.15.40:0/4093455662 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2880052e0 con 0x7fc2a01b9540 2023-09-30T22:31:14.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.635+0000 7fc296ffd700 1 -- 172.21.15.40:0/4093455662 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc298040320 con 0x7fc2a01b9540 2023-09-30T22:31:14.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.644+0000 7fc296ffd700 1 -- 172.21.15.40:0/4093455662 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc298018070 con 0x7fc2a01b9540 2023-09-30T22:31:14.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.669+0000 7f1a3b445700 1 Processor -- start 2023-09-30T22:31:14.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.669+0000 7f1a3b445700 1 -- start start 2023-09-30T22:31:14.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.670+0000 7f1a3b445700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a3412e590 0x7f1a3412e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:14.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.670+0000 7f1a3b445700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1a3412eea0 0x7f1a3412d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:14.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.670+0000 7f1a3b445700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1a3412d6d0 0x7f1a3412db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:14.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.670+0000 7f1a3b445700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a3409ca30 con 0x7f1a3412eea0 2023-09-30T22:31:14.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.670+0000 7f1a3b445700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3409ab70 con 0x7f1a3412e590 2023-09-30T22:31:14.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.670+0000 7f1a3b445700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3409bd70 con 0x7f1a3412d6d0 2023-09-30T22:31:14.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.670+0000 7f1a391e1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a3412e590 0x7f1a3412e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:14.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.670+0000 7f1a391e1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a3412e590 0x7f1a3412e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41604/0 (socket says 172.21.15.40:41604) 2023-09-30T22:31:14.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.670+0000 7f1a391e1700 1 -- 172.21.15.40:0/3457344043 learned_addr learned my addr 172.21.15.40:0/3457344043 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:14.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.670+0000 7f1a389e0700 1 --2- 172.21.15.40:0/3457344043 >> v2:172.21.15.40:3300/0 conn(0x7f1a3412eea0 0x7f1a3412d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:14.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.670+0000 7f1a399e2700 1 --2- 172.21.15.40:0/3457344043 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1a3412d6d0 0x7f1a3412db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:14.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.670+0000 7f1a391e1700 1 -- 172.21.15.40:0/3457344043 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1a3412d6d0 msgr2=0x7f1a3412db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:14.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.670+0000 7f1a391e1700 1 --2- 172.21.15.40:0/3457344043 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1a3412d6d0 0x7f1a3412db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.670+0000 7f1a391e1700 1 -- 172.21.15.40:0/3457344043 >> v2:172.21.15.40:3300/0 conn(0x7f1a3412eea0 msgr2=0x7f1a3412d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:14.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.670+0000 7f1a391e1700 1 --2- 172.21.15.40:0/3457344043 >> v2:172.21.15.40:3300/0 conn(0x7f1a3412eea0 0x7f1a3412d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.670+0000 7f1a391e1700 1 -- 172.21.15.40:0/3457344043 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a3409b270 con 0x7f1a3412e590 2023-09-30T22:31:14.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.671+0000 7f1a391e1700 1 --2- 172.21.15.40:0/3457344043 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a3412e590 0x7f1a3412e960 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f1a30009920 tx=0x7f1a30009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abf6159d223453f6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:14.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.671+0000 7f1a2bfff700 1 -- 172.21.15.40:0/3457344043 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a30011830 con 0x7f1a3412e590 2023-09-30T22:31:14.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.671+0000 7f1a2bfff700 1 -- 172.21.15.40:0/3457344043 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a30011990 con 0x7f1a3412e590 2023-09-30T22:31:14.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.671+0000 7f1a2bfff700 1 -- 172.21.15.40:0/3457344043 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a30011d20 con 0x7f1a3412e590 2023-09-30T22:31:14.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.671+0000 7f1a3b445700 1 -- 172.21.15.40:0/3457344043 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a3412e590 msgr2=0x7f1a3412e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:14.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.671+0000 7f1a3b445700 1 --2- 172.21.15.40:0/3457344043 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a3412e590 0x7f1a3412e960 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f1a30009920 tx=0x7f1a30009c30 comp rx=0 tx=0).stop 2023-09-30T22:31:14.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.671+0000 7f1a3b445700 1 -- 172.21.15.40:0/3457344043 shutdown_connections 2023-09-30T22:31:14.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.671+0000 7f1a3b445700 1 --2- 172.21.15.40:0/3457344043 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1a3412d6d0 0x7f1a3412db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.671+0000 7f1a3b445700 1 --2- 172.21.15.40:0/3457344043 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a3412e590 0x7f1a3412e960 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.671+0000 7f1a3b445700 1 --2- 172.21.15.40:0/3457344043 >> v2:172.21.15.40:3300/0 conn(0x7f1a3412eea0 0x7f1a3412d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.671+0000 7f1a3b445700 1 -- 172.21.15.40:0/3457344043 >> 172.21.15.40:0/3457344043 conn(0x7f1a340a2a00 msgr2=0x7f1a340a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:14.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.672+0000 7f1a3b445700 1 -- 172.21.15.40:0/3457344043 shutdown_connections 2023-09-30T22:31:14.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.672+0000 7f1a3b445700 1 -- 172.21.15.40:0/3457344043 wait complete. 2023-09-30T22:31:14.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.673+0000 7f1a3b445700 1 Processor -- start 2023-09-30T22:31:14.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.673+0000 7f1a3b445700 1 -- start start 2023-09-30T22:31:14.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.673+0000 7f1a3b445700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1a3412d6d0 0x7f1a341cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:14.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.673+0000 7f1a3b445700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a3412e590 0x7f1a341cce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:14.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.673+0000 7f1a3b445700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a3412eea0 0x7f1a341cd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:14.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.673+0000 7f1a3b445700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3409b520 con 0x7f1a3412eea0 2023-09-30T22:31:14.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.673+0000 7f1a3b445700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3409fd90 con 0x7f1a3412e590 2023-09-30T22:31:14.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.673+0000 7f1a3b445700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a34125d40 con 0x7f1a3412d6d0 2023-09-30T22:31:14.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.673+0000 7f1a399e2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a3412eea0 0x7f1a341cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:14.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.673+0000 7f1a399e2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a3412eea0 0x7f1a341cd360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51542/0 (socket says 172.21.15.40:51542) 2023-09-30T22:31:14.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.673+0000 7f1a399e2700 1 -- 172.21.15.40:0/463886497 learned_addr learned my addr 172.21.15.40:0/463886497 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:14.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.673+0000 7f1a391e1700 1 --2- 172.21.15.40:0/463886497 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1a3412d6d0 0x7f1a341cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:14.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.674+0000 7f1a399e2700 1 -- 172.21.15.40:0/463886497 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1a3412d6d0 msgr2=0x7f1a341cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:14.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.674+0000 7f1a399e2700 1 --2- 172.21.15.40:0/463886497 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1a3412d6d0 0x7f1a341cc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.674+0000 7f1a399e2700 1 -- 172.21.15.40:0/463886497 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a3412e590 msgr2=0x7f1a341cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:14.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.674+0000 7f1a399e2700 1 --2- 172.21.15.40:0/463886497 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a3412e590 0x7f1a341cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.674+0000 7f1a399e2700 1 -- 172.21.15.40:0/463886497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a30009550 con 0x7f1a3412eea0 2023-09-30T22:31:14.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.674+0000 7f1a391e1700 1 --2- 172.21.15.40:0/463886497 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1a3412d6d0 0x7f1a341cc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:14.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.674+0000 7f1a399e2700 1 --2- 172.21.15.40:0/463886497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a3412eea0 0x7f1a341cd360 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c0095b0 tx=0x7f1a2c0098c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:14.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.674+0000 7f1a29ffb700 1 -- 172.21.15.40:0/463886497 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c007340 con 0x7f1a3412eea0 2023-09-30T22:31:14.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.674+0000 7f1a29ffb700 1 -- 172.21.15.40:0/463886497 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2c003c20 con 0x7f1a3412eea0 2023-09-30T22:31:14.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.674+0000 7f1a29ffb700 1 -- 172.21.15.40:0/463886497 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c00d110 con 0x7f1a3412eea0 2023-09-30T22:31:14.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.674+0000 7f1a3b445700 1 -- 172.21.15.40:0/463886497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a341243f0 con 0x7f1a3412eea0 2023-09-30T22:31:14.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.674+0000 7f1a3b445700 1 -- 172.21.15.40:0/463886497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a34124010 con 0x7f1a3412eea0 2023-09-30T22:31:14.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.675+0000 7f1a3b445700 1 -- 172.21.15.40:0/463886497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a34062380 con 0x7f1a3412eea0 2023-09-30T22:31:14.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.676+0000 7f1a29ffb700 1 -- 172.21.15.40:0/463886497 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1a2c00d270 con 0x7f1a3412eea0 2023-09-30T22:31:14.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.676+0000 7f1a29ffb700 1 -- 172.21.15.40:0/463886497 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f1a2c040210 con 0x7f1a3412eea0 2023-09-30T22:31:14.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.685+0000 7f1a29ffb700 1 -- 172.21.15.40:0/463886497 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1a2c00d520 con 0x7f1a3412eea0 2023-09-30T22:31:14.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.774+0000 7f1357c9b700 1 -- 172.21.15.40:0/967788722 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1350121cc0 con 0x7f135011f340 2023-09-30T22:31:14.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.774+0000 7f13467fc700 1 -- 172.21.15.40:0/967788722 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1350121cc0 con 0x7f135011f340 2023-09-30T22:31:14.776 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:14.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.776+0000 7f1357c9b700 1 -- 172.21.15.40:0/967788722 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f135011f340 msgr2=0x7f13501c8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:14.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.776+0000 7f1357c9b700 1 --2- 172.21.15.40:0/967788722 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f135011f340 0x7f13501c8720 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f134800efc0 tx=0x7f134800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.777+0000 7f1357c9b700 1 -- 172.21.15.40:0/967788722 shutdown_connections 2023-09-30T22:31:14.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.777+0000 7f1357c9b700 1 --2- 172.21.15.40:0/967788722 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f135011f340 0x7f13501c8720 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.777+0000 7f1357c9b700 1 --2- 172.21.15.40:0/967788722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f135009d920 0x7f135011e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.777+0000 7f1357c9b700 1 --2- 172.21.15.40:0/967788722 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1350133ca0 0x7f135011ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.777+0000 7f1357c9b700 1 -- 172.21.15.40:0/967788722 >> 172.21.15.40:0/967788722 conn(0x7f135009fb20 msgr2=0x7f13500a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:14.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.778+0000 7f1357c9b700 1 -- 172.21.15.40:0/967788722 shutdown_connections 2023-09-30T22:31:14.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.778+0000 7f1357c9b700 1 -- 172.21.15.40:0/967788722 wait complete. 2023-09-30T22:31:14.791 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:14.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.792+0000 7f735f4eb700 1 -- 172.21.15.40:0/1142815738 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7358062380 con 0x7f735809d450 2023-09-30T22:31:14.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.793+0000 7f734dffb700 1 -- 172.21.15.40:0/1142815738 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f73540232f0 con 0x7f735809d450 2023-09-30T22:31:14.793 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:14.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.796+0000 7f735f4eb700 1 -- 172.21.15.40:0/1142815738 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f735809d450 msgr2=0x7f735812c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:14.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.796+0000 7f735f4eb700 1 --2- 172.21.15.40:0/1142815738 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f735809d450 0x7f735812c490 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f735400e9e0 tx=0x7f735400eda0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.796+0000 7f735f4eb700 1 -- 172.21.15.40:0/1142815738 shutdown_connections 2023-09-30T22:31:14.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.796+0000 7f735f4eb700 1 --2- 172.21.15.40:0/1142815738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73581301c0 0x7f735812cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.796+0000 7f735f4eb700 1 --2- 172.21.15.40:0/1142815738 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f735809d450 0x7f735812c490 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.796+0000 7f735f4eb700 1 --2- 172.21.15.40:0/1142815738 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f735809dd60 0x7f735812c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.796+0000 7f735f4eb700 1 -- 172.21.15.40:0/1142815738 >> 172.21.15.40:0/1142815738 conn(0x7f73580a2a00 msgr2=0x7f7358127230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:14.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.796+0000 7f735f4eb700 1 -- 172.21.15.40:0/1142815738 shutdown_connections 2023-09-30T22:31:14.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.796+0000 7f735f4eb700 1 -- 172.21.15.40:0/1142815738 wait complete. 2023-09-30T22:31:14.814 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:14.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.851+0000 7fc2a82b0700 1 -- 172.21.15.40:0/4093455662 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc288005590 con 0x7fc2a01b9540 2023-09-30T22:31:14.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.851+0000 7fc296ffd700 1 -- 172.21.15.40:0/4093455662 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc29802c090 con 0x7fc2a01b9540 2023-09-30T22:31:14.852 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:14.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.853+0000 7fc2a82b0700 1 -- 172.21.15.40:0/4093455662 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2a01b9540 msgr2=0x7fc2a01a6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:14.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.853+0000 7fc2a82b0700 1 --2- 172.21.15.40:0/4093455662 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2a01b9540 0x7fc2a01a6c50 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fc298009dd0 tx=0x7fc29800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.853+0000 7fc2a82b0700 1 -- 172.21.15.40:0/4093455662 shutdown_connections 2023-09-30T22:31:14.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.853+0000 7fc2a82b0700 1 --2- 172.21.15.40:0/4093455662 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc2a009d920 0x7fc2a01a61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.853+0000 7fc2a82b0700 1 --2- 172.21.15.40:0/4093455662 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc2a01b9540 0x7fc2a01a6c50 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.853+0000 7fc2a82b0700 1 --2- 172.21.15.40:0/4093455662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2a009e230 0x7fc2a01a6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.853+0000 7fc2a82b0700 1 -- 172.21.15.40:0/4093455662 >> 172.21.15.40:0/4093455662 conn(0x7fc2a009fb20 msgr2=0x7fc2a01bb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:14.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.853+0000 7fc2a82b0700 1 -- 172.21.15.40:0/4093455662 shutdown_connections 2023-09-30T22:31:14.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.853+0000 7fc2a82b0700 1 -- 172.21.15.40:0/4093455662 wait complete. 2023-09-30T22:31:14.866 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:14.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.907+0000 7f1a3b445700 1 -- 172.21.15.40:0/463886497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1a34123fe0 con 0x7f1a3412eea0 2023-09-30T22:31:14.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.907+0000 7f1a29ffb700 1 -- 172.21.15.40:0/463886497 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1a2c020350 con 0x7f1a3412eea0 2023-09-30T22:31:14.908 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:14.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.909+0000 7f1a3b445700 1 -- 172.21.15.40:0/463886497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a3412eea0 msgr2=0x7f1a341cd360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:14.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.909+0000 7f1a3b445700 1 --2- 172.21.15.40:0/463886497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a3412eea0 0x7f1a341cd360 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c0095b0 tx=0x7f1a2c0098c0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.910+0000 7f1a3b445700 1 -- 172.21.15.40:0/463886497 shutdown_connections 2023-09-30T22:31:14.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.910+0000 7f1a3b445700 1 --2- 172.21.15.40:0/463886497 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1a3412d6d0 0x7f1a341cc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.910+0000 7f1a3b445700 1 --2- 172.21.15.40:0/463886497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a3412eea0 0x7f1a341cd360 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.910+0000 7f1a3b445700 1 --2- 172.21.15.40:0/463886497 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a3412e590 0x7f1a341cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:14.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.910+0000 7f1a3b445700 1 -- 172.21.15.40:0/463886497 >> 172.21.15.40:0/463886497 conn(0x7f1a340a2a00 msgr2=0x7f1a3412c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:14.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.910+0000 7f1a3b445700 1 -- 172.21.15.40:0/463886497 shutdown_connections 2023-09-30T22:31:14.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:14.910+0000 7f1a3b445700 1 -- 172.21.15.40:0/463886497 wait complete. 2023-09-30T22:31:14.922 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:15.792 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:15.815 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:15.867 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:15.923 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:15.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.938+0000 7f07e6366700 1 Processor -- start 2023-09-30T22:31:15.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.938+0000 7f07e6366700 1 -- start start 2023-09-30T22:31:15.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.938+0000 7f07e6366700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07e009d450 0x7f07e009d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.938+0000 7f07e6366700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f07e009dd60 0x7f07e01301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.938+0000 7f07e6366700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07e0130700 0x7f07e0130b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.938+0000 7f07e6366700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e009e8b0 con 0x7f07e009dd60 2023-09-30T22:31:15.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.938+0000 7f07e6366700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e009c3b0 con 0x7f07e009d450 2023-09-30T22:31:15.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.938+0000 7f07e6366700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07e009a6b0 con 0x7f07e0130700 2023-09-30T22:31:15.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.939+0000 7f07df7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f07e009dd60 0x7f07e01301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.939+0000 7f07df7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f07e009dd60 0x7f07e01301c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51548/0 (socket says 172.21.15.40:51548) 2023-09-30T22:31:15.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.939+0000 7f07df7fe700 1 -- 172.21.15.40:0/3193549410 learned_addr learned my addr 172.21.15.40:0/3193549410 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:15.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.939+0000 7f07dffff700 1 --2- 172.21.15.40:0/3193549410 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07e009d450 0x7f07e009d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.939+0000 7f07df7fe700 1 -- 172.21.15.40:0/3193549410 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07e0130700 msgr2=0x7f07e0130b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:15.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.939+0000 7f07df7fe700 1 --2- 172.21.15.40:0/3193549410 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07e0130700 0x7f07e0130b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.939+0000 7f07df7fe700 1 -- 172.21.15.40:0/3193549410 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07e009d450 msgr2=0x7f07e009d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:15.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.939+0000 7f07df7fe700 1 --2- 172.21.15.40:0/3193549410 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07e009d450 0x7f07e009d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.939+0000 7f07df7fe700 1 -- 172.21.15.40:0/3193549410 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e009b4f0 con 0x7f07e009dd60 2023-09-30T22:31:15.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.939+0000 7f07dffff700 1 --2- 172.21.15.40:0/3193549410 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07e009d450 0x7f07e009d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:15.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.939+0000 7f07df7fe700 1 --2- 172.21.15.40:0/3193549410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07e009dd60 0x7f07e01301c0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f07d40098f0 tx=0x7f07d4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=952002fa7cc9706b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:15.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.940+0000 7f07deffd700 1 -- 172.21.15.40:0/3193549410 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d400b8a0 con 0x7f07e009dd60 2023-09-30T22:31:15.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.940+0000 7f07deffd700 1 -- 172.21.15.40:0/3193549410 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d400ba00 con 0x7f07e009dd60 2023-09-30T22:31:15.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.940+0000 7f07deffd700 1 -- 172.21.15.40:0/3193549410 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d400bd90 con 0x7f07e009dd60 2023-09-30T22:31:15.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.940+0000 7f07e6366700 1 -- 172.21.15.40:0/3193549410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07e009dd60 msgr2=0x7f07e01301c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:15.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.940+0000 7f07e6366700 1 --2- 172.21.15.40:0/3193549410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07e009dd60 0x7f07e01301c0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f07d40098f0 tx=0x7f07d4009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:15.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.941+0000 7f07e6366700 1 -- 172.21.15.40:0/3193549410 shutdown_connections 2023-09-30T22:31:15.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.941+0000 7f07e6366700 1 --2- 172.21.15.40:0/3193549410 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07e0130700 0x7f07e0130b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.941+0000 7f07e6366700 1 --2- 172.21.15.40:0/3193549410 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07e009d450 0x7f07e009d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.941+0000 7f07e6366700 1 --2- 172.21.15.40:0/3193549410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07e009dd60 0x7f07e01301c0 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.941+0000 7f07e6366700 1 -- 172.21.15.40:0/3193549410 >> 172.21.15.40:0/3193549410 conn(0x7f07e00a2a00 msgr2=0x7f07e00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:15.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.941+0000 7f07e6366700 1 -- 172.21.15.40:0/3193549410 shutdown_connections 2023-09-30T22:31:15.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.941+0000 7f07e6366700 1 -- 172.21.15.40:0/3193549410 wait complete. 2023-09-30T22:31:15.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.942+0000 7f07e6366700 1 Processor -- start 2023-09-30T22:31:15.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.942+0000 7f07e6366700 1 -- start start 2023-09-30T22:31:15.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.943+0000 7f07e6366700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07e009d450 0x7f07e011b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.943+0000 7f07e6366700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07e009dd60 0x7f07e011b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.943+0000 7f07e6366700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07e0130700 0x7f07e011bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.943+0000 7f07e6366700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e012fcf0 con 0x7f07e0130700 2023-09-30T22:31:15.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.943+0000 7f07e6366700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e00a1c50 con 0x7f07e009d450 2023-09-30T22:31:15.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.943+0000 7f07e6366700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07e011ce70 con 0x7f07e009dd60 2023-09-30T22:31:15.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.943+0000 7f07dffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07e009d450 0x7f07e011b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.943+0000 7f07dffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07e009d450 0x7f07e011b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41638/0 (socket says 172.21.15.40:41638) 2023-09-30T22:31:15.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.943+0000 7f07dffff700 1 -- 172.21.15.40:0/1812402533 learned_addr learned my addr 172.21.15.40:0/1812402533 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:15.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.943+0000 7f07e4903700 1 --2- 172.21.15.40:0/1812402533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07e0130700 0x7f07e011bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.943+0000 7f07df7fe700 1 --2- 172.21.15.40:0/1812402533 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07e009dd60 0x7f07e011b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.943+0000 7f07dffff700 1 -- 172.21.15.40:0/1812402533 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07e009dd60 msgr2=0x7f07e011b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:15.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.943+0000 7f07dffff700 1 --2- 172.21.15.40:0/1812402533 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07e009dd60 0x7f07e011b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.943+0000 7f07dffff700 1 -- 172.21.15.40:0/1812402533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07e0130700 msgr2=0x7f07e011bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:15.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.943+0000 7f07dffff700 1 --2- 172.21.15.40:0/1812402533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07e0130700 0x7f07e011bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.944+0000 7f07dffff700 1 -- 172.21.15.40:0/1812402533 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d4009550 con 0x7f07e009d450 2023-09-30T22:31:15.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.944+0000 7f07dffff700 1 --2- 172.21.15.40:0/1812402533 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07e009d450 0x7f07e011b0e0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f07d0011f30 tx=0x7f07d000bf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:15.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.944+0000 7f07dcff9700 1 -- 172.21.15.40:0/1812402533 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d0009030 con 0x7f07e009d450 2023-09-30T22:31:15.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.944+0000 7f07dcff9700 1 -- 172.21.15.40:0/1812402533 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d00107f0 con 0x7f07e009d450 2023-09-30T22:31:15.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.944+0000 7f07dcff9700 1 -- 172.21.15.40:0/1812402533 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d0010b80 con 0x7f07e009d450 2023-09-30T22:31:15.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.944+0000 7f07e6366700 1 -- 172.21.15.40:0/1812402533 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e009b000 con 0x7f07e009d450 2023-09-30T22:31:15.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.944+0000 7f07e6366700 1 -- 172.21.15.40:0/1812402533 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e011e920 con 0x7f07e009d450 2023-09-30T22:31:15.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.945+0000 7f07e6366700 1 -- 172.21.15.40:0/1812402533 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e0062380 con 0x7f07e009d450 2023-09-30T22:31:15.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.946+0000 7f07dcff9700 1 -- 172.21.15.40:0/1812402533 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f07d0010ce0 con 0x7f07e009d450 2023-09-30T22:31:15.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.946+0000 7f07dcff9700 1 -- 172.21.15.40:0/1812402533 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f07d000a070 con 0x7f07e009d450 2023-09-30T22:31:15.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.950+0000 7f07dcff9700 1 -- 172.21.15.40:0/1812402533 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f07d0021520 con 0x7f07e009d450 2023-09-30T22:31:15.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.988+0000 7f00fa3cf700 1 Processor -- start 2023-09-30T22:31:15.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.988+0000 7f00fa3cf700 1 -- start start 2023-09-30T22:31:15.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.988+0000 7f00fa3cf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00f409c890 0x7f00f409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.988+0000 7f00fa3cf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00f409d920 0x7f00f409dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.988+0000 7f00fa3cf700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f40a2600 con 0x7f00f409e2b0 2023-09-30T22:31:15.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.988+0000 7f00fa3cf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f40a29d0 con 0x7f00f409d920 2023-09-30T22:31:15.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.988+0000 7f00fa3cf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00f409fb40 con 0x7f00f409c890 2023-09-30T22:31:15.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.989+0000 7f00f896c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f00f409e2b0 0x7f00f413ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53060/0 (socket says 172.21.15.40:53060) 2023-09-30T22:31:15.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.989+0000 7f00f896c700 1 -- 172.21.15.40:0/2166688786 learned_addr learned my addr 172.21.15.40:0/2166688786 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:15.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.989+0000 7f00f37fe700 1 --2- 172.21.15.40:0/2166688786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00f409d920 0x7f00f409dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.989+0000 7f00f3fff700 1 --2- 172.21.15.40:0/2166688786 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00f409c890 0x7f00f409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.989+0000 7f00f37fe700 1 -- 172.21.15.40:0/2166688786 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00f409c890 msgr2=0x7f00f409cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:15.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.989+0000 7f00f37fe700 1 --2- 172.21.15.40:0/2166688786 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00f409c890 0x7f00f409cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.989+0000 7f00f37fe700 1 -- 172.21.15.40:0/2166688786 >> v1:172.21.15.40:6789/0 conn(0x7f00f409e2b0 legacy=0x7f00f413ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:15.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.989+0000 7f00f2ffd700 1 -- 172.21.15.40:0/2166688786 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3033400792 0 0) 0x7f00f40a2600 con 0x7f00f409e2b0 2023-09-30T22:31:15.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.989+0000 7f00f37fe700 1 -- 172.21.15.40:0/2166688786 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f409e720 con 0x7f00f409d920 2023-09-30T22:31:15.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.989+0000 7f00f37fe700 1 --2- 172.21.15.40:0/2166688786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00f409d920 0x7f00f409dd70 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f00e8009870 tx=0x7f00e8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=549ffe3e555ad6f8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:15.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.990+0000 7f00f2ffd700 1 -- 172.21.15.40:0/2166688786 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e8011830 con 0x7f00f409d920 2023-09-30T22:31:15.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.990+0000 7f00f2ffd700 1 -- 172.21.15.40:0/2166688786 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e8011990 con 0x7f00f409d920 2023-09-30T22:31:15.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.990+0000 7f00f2ffd700 1 -- 172.21.15.40:0/2166688786 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e8011d20 con 0x7f00f409d920 2023-09-30T22:31:15.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.990+0000 7f00fa3cf700 1 -- 172.21.15.40:0/2166688786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00f409d920 msgr2=0x7f00f409dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:15.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.990+0000 7f00fa3cf700 1 --2- 172.21.15.40:0/2166688786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00f409d920 0x7f00f409dd70 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f00e8009870 tx=0x7f00e8009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:15.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.990+0000 7f00fa3cf700 1 -- 172.21.15.40:0/2166688786 shutdown_connections 2023-09-30T22:31:15.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.990+0000 7f00fa3cf700 1 --2- 172.21.15.40:0/2166688786 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00f409c890 0x7f00f409cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.990+0000 7f00fa3cf700 1 --2- 172.21.15.40:0/2166688786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00f409d920 0x7f00f409dd70 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.990+0000 7f00fa3cf700 1 -- 172.21.15.40:0/2166688786 >> 172.21.15.40:0/2166688786 conn(0x7f00f40a7080 msgr2=0x7f00f40a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:15.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.990+0000 7f00fa3cf700 1 -- 172.21.15.40:0/2166688786 shutdown_connections 2023-09-30T22:31:15.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.990+0000 7f00fa3cf700 1 -- 172.21.15.40:0/2166688786 wait complete. 2023-09-30T22:31:15.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.992+0000 7f00fa3cf700 1 Processor -- start 2023-09-30T22:31:15.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.992+0000 7f00fa3cf700 1 -- start start 2023-09-30T22:31:15.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.992+0000 7f00fa3cf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f409c890 0x7f00f412cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.992+0000 7f00fa3cf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00f409d920 0x7f00f412d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.992+0000 7f00fa3cf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00f409e2b0 0x7f00f412da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.992+0000 7f00fa3cf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f4130770 con 0x7f00f409c890 2023-09-30T22:31:15.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.992+0000 7f00fa3cf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f40a5ab0 con 0x7f00f409e2b0 2023-09-30T22:31:15.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.992+0000 7f00fa3cf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00f409ecf0 con 0x7f00f409d920 2023-09-30T22:31:15.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.992+0000 7f00f37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00f409d920 0x7f00f412d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.993+0000 7f00f37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00f409d920 0x7f00f412d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48330/0 (socket says 172.21.15.40:48330) 2023-09-30T22:31:15.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.993+0000 7f00f37fe700 1 -- 172.21.15.40:0/2404700767 learned_addr learned my addr 172.21.15.40:0/2404700767 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:15.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.993+0000 7f00f896c700 1 --2- 172.21.15.40:0/2404700767 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00f409e2b0 0x7f00f412da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.993+0000 7f00f3fff700 1 --2- 172.21.15.40:0/2404700767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f409c890 0x7f00f412cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.993+0000 7f00f37fe700 1 -- 172.21.15.40:0/2404700767 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00f409e2b0 msgr2=0x7f00f412da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:15.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.993+0000 7f00f37fe700 1 --2- 172.21.15.40:0/2404700767 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00f409e2b0 0x7f00f412da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.993+0000 7f00f37fe700 1 -- 172.21.15.40:0/2404700767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f409c890 msgr2=0x7f00f412cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:15.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.993+0000 7f00f37fe700 1 --2- 172.21.15.40:0/2404700767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f409c890 0x7f00f412cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.993+0000 7f00f37fe700 1 -- 172.21.15.40:0/2404700767 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e80094a0 con 0x7f00f409d920 2023-09-30T22:31:15.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.993+0000 7f00f37fe700 1 --2- 172.21.15.40:0/2404700767 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00f409d920 0x7f00f412d4f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f00e80090b0 tx=0x7f00e8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:15.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.993+0000 7f00f0ff9700 1 -- 172.21.15.40:0/2404700767 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e8004300 con 0x7f00f409d920 2023-09-30T22:31:15.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.993+0000 7f00f0ff9700 1 -- 172.21.15.40:0/2404700767 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e801f070 con 0x7f00f409d920 2023-09-30T22:31:15.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.993+0000 7f00fa3cf700 1 -- 172.21.15.40:0/2404700767 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f409c2b0 con 0x7f00f409d920 2023-09-30T22:31:15.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.993+0000 7f00f0ff9700 1 -- 172.21.15.40:0/2404700767 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e80036a0 con 0x7f00f409d920 2023-09-30T22:31:15.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.993+0000 7f00fa3cf700 1 -- 172.21.15.40:0/2404700767 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f41311e0 con 0x7f00f409d920 2023-09-30T22:31:15.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.994+0000 7f00f0ff9700 1 -- 172.21.15.40:0/2404700767 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f00e8021030 con 0x7f00f409d920 2023-09-30T22:31:15.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.995+0000 7f00f0ff9700 1 -- 172.21.15.40:0/2404700767 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f00e8040590 con 0x7f00f409d920 2023-09-30T22:31:15.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:15.995+0000 7f00fa3cf700 1 -- 172.21.15.40:0/2404700767 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f41302e0 con 0x7f00f409d920 2023-09-30T22:31:16.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.004+0000 7f00f0ff9700 1 -- 172.21.15.40:0/2404700767 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f00e8024480 con 0x7f00f409d920 2023-09-30T22:31:16.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.018+0000 7faf8d5b4700 1 Processor -- start 2023-09-30T22:31:16.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.018+0000 7faf8d5b4700 1 -- start start 2023-09-30T22:31:16.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.018+0000 7faf8d5b4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faf8809d450 0x7faf8809d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.019+0000 7faf8d5b4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faf881308d0 0x7faf88138420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.019+0000 7faf8d5b4700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf8809e8b0 con 0x7faf8809dd60 2023-09-30T22:31:16.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.019+0000 7faf8d5b4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf8809c3b0 con 0x7faf8809d450 2023-09-30T22:31:16.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.019+0000 7faf8d5b4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf8809a6b0 con 0x7faf881308d0 2023-09-30T22:31:16.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.019+0000 7faf877fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faf881308d0 0x7faf88138420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.019+0000 7faf877fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faf881308d0 0x7faf88138420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48346/0 (socket says 172.21.15.40:48346) 2023-09-30T22:31:16.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.019+0000 7faf877fe700 1 -- 172.21.15.40:0/1882293114 learned_addr learned my addr 172.21.15.40:0/1882293114 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:16.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.019+0000 7faf86ffd700 1 --2- 172.21.15.40:0/1882293114 >> v2:172.21.15.40:3300/0 conn(0x7faf8809d450 0x7faf8809d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.019+0000 7faf877fe700 1 -- 172.21.15.40:0/1882293114 >> v2:172.21.15.40:3300/0 conn(0x7faf8809d450 msgr2=0x7faf8809d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:16.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.019+0000 7faf877fe700 1 --2- 172.21.15.40:0/1882293114 >> v2:172.21.15.40:3300/0 conn(0x7faf8809d450 0x7faf8809d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.019+0000 7faf877fe700 1 -- 172.21.15.40:0/1882293114 >> v1:172.21.15.40:6789/0 conn(0x7faf8809dd60 legacy=0x7faf881301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.019+0000 7faf877fe700 1 -- 172.21.15.40:0/1882293114 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8809b4f0 con 0x7faf881308d0 2023-09-30T22:31:16.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.019+0000 7faf877fe700 1 --2- 172.21.15.40:0/1882293114 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faf881308d0 0x7faf88138420 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7faf8000d150 tx=0x7faf8000d460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1aae9f4e11ff5391 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:16.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.020+0000 7faf85ffb700 1 -- 172.21.15.40:0/1882293114 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf80010070 con 0x7faf881308d0 2023-09-30T22:31:16.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.020+0000 7faf85ffb700 1 -- 172.21.15.40:0/1882293114 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8000db00 con 0x7faf881308d0 2023-09-30T22:31:16.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.020+0000 7faf85ffb700 1 -- 172.21.15.40:0/1882293114 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf80016400 con 0x7faf881308d0 2023-09-30T22:31:16.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.020+0000 7faf8d5b4700 1 -- 172.21.15.40:0/1882293114 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faf881308d0 msgr2=0x7faf88138420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.020+0000 7faf8d5b4700 1 --2- 172.21.15.40:0/1882293114 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faf881308d0 0x7faf88138420 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7faf8000d150 tx=0x7faf8000d460 comp rx=0 tx=0).stop 2023-09-30T22:31:16.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.020+0000 7faf8d5b4700 1 -- 172.21.15.40:0/1882293114 shutdown_connections 2023-09-30T22:31:16.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.020+0000 7faf8d5b4700 1 --2- 172.21.15.40:0/1882293114 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faf881308d0 0x7faf88138420 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.020+0000 7faf8d5b4700 1 --2- 172.21.15.40:0/1882293114 >> v2:172.21.15.40:3300/0 conn(0x7faf8809d450 0x7faf8809d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.020+0000 7faf8d5b4700 1 -- 172.21.15.40:0/1882293114 >> 172.21.15.40:0/1882293114 conn(0x7faf880a2a00 msgr2=0x7faf880a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:16.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.020+0000 7faf8d5b4700 1 -- 172.21.15.40:0/1882293114 shutdown_connections 2023-09-30T22:31:16.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.020+0000 7faf8d5b4700 1 -- 172.21.15.40:0/1882293114 wait complete. 2023-09-30T22:31:16.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.022+0000 7faf8d5b4700 1 Processor -- start 2023-09-30T22:31:16.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.022+0000 7faf8d5b4700 1 -- start start 2023-09-30T22:31:16.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.023+0000 7faf8d5b4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faf8809d450 0x7faf881c5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.023+0000 7faf8d5b4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf8809dd60 0x7faf881c59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.023+0000 7faf8d5b4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf881308d0 0x7faf881c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.023+0000 7faf8d5b4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf88120ff0 con 0x7faf881308d0 2023-09-30T22:31:16.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.023+0000 7faf8d5b4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf88120070 con 0x7faf8809dd60 2023-09-30T22:31:16.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.023+0000 7faf8d5b4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf880a2510 con 0x7faf8809d450 2023-09-30T22:31:16.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.023+0000 7faf867fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf8809dd60 0x7faf881c59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.023+0000 7faf867fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf8809dd60 0x7faf881c59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41672/0 (socket says 172.21.15.40:41672) 2023-09-30T22:31:16.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.023+0000 7faf86ffd700 1 --2- 172.21.15.40:0/2772375409 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faf8809d450 0x7faf881c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.023+0000 7faf867fc700 1 -- 172.21.15.40:0/2772375409 learned_addr learned my addr 172.21.15.40:0/2772375409 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:16.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.023+0000 7faf877fe700 1 --2- 172.21.15.40:0/2772375409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf881308d0 0x7faf881c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.023+0000 7faf877fe700 1 -- 172.21.15.40:0/2772375409 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faf8809d450 msgr2=0x7faf881c5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.023+0000 7faf877fe700 1 --2- 172.21.15.40:0/2772375409 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faf8809d450 0x7faf881c5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.023+0000 7faf877fe700 1 -- 172.21.15.40:0/2772375409 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf8809dd60 msgr2=0x7faf881c59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.023+0000 7faf877fe700 1 --2- 172.21.15.40:0/2772375409 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf8809dd60 0x7faf881c59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.023+0000 7faf877fe700 1 -- 172.21.15.40:0/2772375409 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8000bd40 con 0x7faf881308d0 2023-09-30T22:31:16.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.024+0000 7faf877fe700 1 --2- 172.21.15.40:0/2772375409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf881308d0 0x7faf881c8430 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7faf80019000 tx=0x7faf80004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:16.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.024+0000 7faf6f7fe700 1 -- 172.21.15.40:0/2772375409 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf800165b0 con 0x7faf881308d0 2023-09-30T22:31:16.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.024+0000 7faf6f7fe700 1 -- 172.21.15.40:0/2772375409 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf80016710 con 0x7faf881308d0 2023-09-30T22:31:16.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.024+0000 7faf8d5b4700 1 -- 172.21.15.40:0/2772375409 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf8809c5d0 con 0x7faf881308d0 2023-09-30T22:31:16.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.024+0000 7faf6f7fe700 1 -- 172.21.15.40:0/2772375409 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf80016ac0 con 0x7faf881308d0 2023-09-30T22:31:16.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.024+0000 7faf8d5b4700 1 -- 172.21.15.40:0/2772375409 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf881c5ee0 con 0x7faf881308d0 2023-09-30T22:31:16.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.025+0000 7faf8d5b4700 1 -- 172.21.15.40:0/2772375409 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf8811e900 con 0x7faf881308d0 2023-09-30T22:31:16.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.025+0000 7faf6f7fe700 1 -- 172.21.15.40:0/2772375409 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faf80016c20 con 0x7faf881308d0 2023-09-30T22:31:16.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.026+0000 7faf6f7fe700 1 -- 172.21.15.40:0/2772375409 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7faf80040c20 con 0x7faf881308d0 2023-09-30T22:31:16.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.030+0000 7faf6f7fe700 1 -- 172.21.15.40:0/2772375409 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faf8811e900 con 0x7faf881308d0 2023-09-30T22:31:16.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.095+0000 7fe08f0d6700 1 Processor -- start 2023-09-30T22:31:16.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.096+0000 7fe08f0d6700 1 -- start start 2023-09-30T22:31:16.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.096+0000 7fe08f0d6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe08809e400 0x7fe088135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.096+0000 7fe08f0d6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe088136230 0x7fe088138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.096+0000 7fe08f0d6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe08809adf0 con 0x7fe08809d920 2023-09-30T22:31:16.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.096+0000 7fe08f0d6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe08809edf0 con 0x7fe08809e400 2023-09-30T22:31:16.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.096+0000 7fe08f0d6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe08809b660 con 0x7fe088136230 2023-09-30T22:31:16.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.097+0000 7fe08ce72700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe08809d920 0x7fe08809dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53066/0 (socket says 172.21.15.40:53066) 2023-09-30T22:31:16.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.097+0000 7fe08ce72700 1 -- 172.21.15.40:0/968775196 learned_addr learned my addr 172.21.15.40:0/968775196 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:16.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.097+0000 7fe08d673700 1 --2- 172.21.15.40:0/968775196 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe088136230 0x7fe088138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.097+0000 7fe087fff700 1 --2- 172.21.15.40:0/968775196 >> v2:172.21.15.40:3300/0 conn(0x7fe08809e400 0x7fe088135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.097+0000 7fe0877fe700 1 -- 172.21.15.40:0/968775196 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2727435574 0 0) 0x7fe08809adf0 con 0x7fe08809d920 2023-09-30T22:31:16.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.097+0000 7fe0877fe700 1 -- 172.21.15.40:0/968775196 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0780035b0 con 0x7fe08809d920 2023-09-30T22:31:16.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.097+0000 7fe087fff700 1 -- 172.21.15.40:0/968775196 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe088136230 msgr2=0x7fe088138610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:16.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.097+0000 7fe087fff700 1 --2- 172.21.15.40:0/968775196 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe088136230 0x7fe088138610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.097+0000 7fe087fff700 1 -- 172.21.15.40:0/968775196 >> v1:172.21.15.40:6789/0 conn(0x7fe08809d920 legacy=0x7fe08809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.097+0000 7fe087fff700 1 -- 172.21.15.40:0/968775196 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe08809a6e0 con 0x7fe08809e400 2023-09-30T22:31:16.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.097+0000 7fe087fff700 1 --2- 172.21.15.40:0/968775196 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe08809e400 0x7fe088135cf0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7fe074009840 tx=0x7fe074009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a701c3f02dcc3fb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:16.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.097+0000 7fe0877fe700 1 -- 172.21.15.40:0/968775196 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe074011830 con 0x7fe08809e400 2023-09-30T22:31:16.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.098+0000 7fe0877fe700 1 -- 172.21.15.40:0/968775196 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe074011990 con 0x7fe08809e400 2023-09-30T22:31:16.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.098+0000 7fe0877fe700 1 -- 172.21.15.40:0/968775196 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe074011d00 con 0x7fe08809e400 2023-09-30T22:31:16.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.098+0000 7fe08f0d6700 1 -- 172.21.15.40:0/968775196 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe08809e400 msgr2=0x7fe088135cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.098+0000 7fe08f0d6700 1 --2- 172.21.15.40:0/968775196 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe08809e400 0x7fe088135cf0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7fe074009840 tx=0x7fe074009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:16.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.098+0000 7fe08f0d6700 1 -- 172.21.15.40:0/968775196 shutdown_connections 2023-09-30T22:31:16.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.098+0000 7fe08f0d6700 1 --2- 172.21.15.40:0/968775196 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe088136230 0x7fe088138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.098+0000 7fe08f0d6700 1 --2- 172.21.15.40:0/968775196 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe08809e400 0x7fe088135cf0 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.098+0000 7fe08f0d6700 1 -- 172.21.15.40:0/968775196 >> 172.21.15.40:0/968775196 conn(0x7fe08809fb20 msgr2=0x7fe08809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:16.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.099+0000 7fe08f0d6700 1 -- 172.21.15.40:0/968775196 shutdown_connections 2023-09-30T22:31:16.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.099+0000 7fe08f0d6700 1 -- 172.21.15.40:0/968775196 wait complete. 2023-09-30T22:31:16.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.100+0000 7fe08f0d6700 1 Processor -- start 2023-09-30T22:31:16.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.100+0000 7fe08f0d6700 1 -- start start 2023-09-30T22:31:16.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.101+0000 7fe08f0d6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe08809d920 0x7fe08811e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.101+0000 7fe08f0d6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe08809e400 0x7fe08811e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.101+0000 7fe08f0d6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe088136230 0x7fe08811eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.101+0000 7fe08f0d6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0881219f0 con 0x7fe088136230 2023-09-30T22:31:16.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.101+0000 7fe08f0d6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe088120200 con 0x7fe08809e400 2023-09-30T22:31:16.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.101+0000 7fe08f0d6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe08809cb00 con 0x7fe08809d920 2023-09-30T22:31:16.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.101+0000 7fe08ce72700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe08809d920 0x7fe08811e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.101+0000 7fe08ce72700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe08809d920 0x7fe08811e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48376/0 (socket says 172.21.15.40:48376) 2023-09-30T22:31:16.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.101+0000 7fe08ce72700 1 -- 172.21.15.40:0/1758572675 learned_addr learned my addr 172.21.15.40:0/1758572675 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:16.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.101+0000 7fe087fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe08809e400 0x7fe08811e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.101+0000 7fe08d673700 1 --2- 172.21.15.40:0/1758572675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe088136230 0x7fe08811eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.101+0000 7fe087fff700 1 -- 172.21.15.40:0/1758572675 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe08809d920 msgr2=0x7fe08811e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.101+0000 7fe087fff700 1 --2- 172.21.15.40:0/1758572675 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe08809d920 0x7fe08811e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.101+0000 7fe087fff700 1 -- 172.21.15.40:0/1758572675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe088136230 msgr2=0x7fe08811eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.101+0000 7fe087fff700 1 --2- 172.21.15.40:0/1758572675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe088136230 0x7fe08811eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.101+0000 7fe087fff700 1 -- 172.21.15.40:0/1758572675 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0740094a0 con 0x7fe08809e400 2023-09-30T22:31:16.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.101+0000 7fe08d673700 1 --2- 172.21.15.40:0/1758572675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe088136230 0x7fe08811eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:16.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.102+0000 7fe087fff700 1 --2- 172.21.15.40:0/1758572675 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe08809e400 0x7fe08811e9b0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fe074016000 tx=0x7fe074004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:16.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.102+0000 7fe0857fa700 1 -- 172.21.15.40:0/1758572675 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe074004550 con 0x7fe08809e400 2023-09-30T22:31:16.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.102+0000 7fe0857fa700 1 -- 172.21.15.40:0/1758572675 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07401f070 con 0x7fe08809e400 2023-09-30T22:31:16.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.102+0000 7fe08f0d6700 1 -- 172.21.15.40:0/1758572675 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0881208e0 con 0x7fe08809e400 2023-09-30T22:31:16.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.102+0000 7fe0857fa700 1 -- 172.21.15.40:0/1758572675 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0740038e0 con 0x7fe08809e400 2023-09-30T22:31:16.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.102+0000 7fe08f0d6700 1 -- 172.21.15.40:0/1758572675 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe088122490 con 0x7fe08809e400 2023-09-30T22:31:16.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.103+0000 7fe0857fa700 1 -- 172.21.15.40:0/1758572675 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe074003a40 con 0x7fe08809e400 2023-09-30T22:31:16.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.103+0000 7fe0857fa700 1 -- 172.21.15.40:0/1758572675 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe074021070 con 0x7fe08809e400 2023-09-30T22:31:16.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.103+0000 7fe08f0d6700 1 -- 172.21.15.40:0/1758572675 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe088062380 con 0x7fe08809e400 2023-09-30T22:31:16.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.108+0000 7fe0857fa700 1 -- 172.21.15.40:0/1758572675 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe074015030 con 0x7fe08809e400 2023-09-30T22:31:16.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.167+0000 7f07e6366700 1 -- 172.21.15.40:0/1812402533 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f07e009a300 con 0x7f07e009d450 2023-09-30T22:31:16.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.168+0000 7f07dcff9700 1 -- 172.21.15.40:0/1812402533 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f07e009a300 con 0x7f07e009d450 2023-09-30T22:31:16.168 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:16.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.170+0000 7f07e6366700 1 -- 172.21.15.40:0/1812402533 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07e009d450 msgr2=0x7f07e011b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.170+0000 7f07e6366700 1 --2- 172.21.15.40:0/1812402533 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07e009d450 0x7f07e011b0e0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f07d0011f30 tx=0x7f07d000bf90 comp rx=0 tx=0).stop 2023-09-30T22:31:16.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.170+0000 7f07e6366700 1 -- 172.21.15.40:0/1812402533 shutdown_connections 2023-09-30T22:31:16.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.170+0000 7f07e6366700 1 --2- 172.21.15.40:0/1812402533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07e0130700 0x7f07e011bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.170+0000 7f07e6366700 1 --2- 172.21.15.40:0/1812402533 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07e009d450 0x7f07e011b0e0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.170+0000 7f07e6366700 1 --2- 172.21.15.40:0/1812402533 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f07e009dd60 0x7f07e011b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.170+0000 7f07e6366700 1 -- 172.21.15.40:0/1812402533 >> 172.21.15.40:0/1812402533 conn(0x7f07e00a2a00 msgr2=0x7f07e01b7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:16.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.170+0000 7f07e6366700 1 -- 172.21.15.40:0/1812402533 shutdown_connections 2023-09-30T22:31:16.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.170+0000 7f07e6366700 1 -- 172.21.15.40:0/1812402533 wait complete. 2023-09-30T22:31:16.183 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:16.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.232+0000 7faf8d5b4700 1 -- 172.21.15.40:0/2772375409 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faf8811e900 con 0x7faf881308d0 2023-09-30T22:31:16.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.232+0000 7faf6f7fe700 1 -- 172.21.15.40:0/2772375409 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faf8811e900 con 0x7faf881308d0 2023-09-30T22:31:16.232 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:16.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.234+0000 7faf8d5b4700 1 -- 172.21.15.40:0/2772375409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf881308d0 msgr2=0x7faf881c8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.234+0000 7faf8d5b4700 1 --2- 172.21.15.40:0/2772375409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf881308d0 0x7faf881c8430 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7faf80019000 tx=0x7faf80004ad0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.234+0000 7faf8d5b4700 1 -- 172.21.15.40:0/2772375409 shutdown_connections 2023-09-30T22:31:16.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.234+0000 7faf8d5b4700 1 --2- 172.21.15.40:0/2772375409 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7faf8809d450 0x7faf881c5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.234+0000 7faf8d5b4700 1 --2- 172.21.15.40:0/2772375409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf881308d0 0x7faf881c8430 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.234+0000 7faf8d5b4700 1 --2- 172.21.15.40:0/2772375409 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faf8809dd60 0x7faf881c59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.234+0000 7faf8d5b4700 1 -- 172.21.15.40:0/2772375409 >> 172.21.15.40:0/2772375409 conn(0x7faf880a2a00 msgr2=0x7faf880a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:16.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.234+0000 7faf8d5b4700 1 -- 172.21.15.40:0/2772375409 shutdown_connections 2023-09-30T22:31:16.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.234+0000 7faf8d5b4700 1 -- 172.21.15.40:0/2772375409 wait complete. 2023-09-30T22:31:16.248 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:16.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.248+0000 7f00fa3cf700 1 -- 172.21.15.40:0/2404700767 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f00f4062380 con 0x7f00f409d920 2023-09-30T22:31:16.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.248+0000 7f00f0ff9700 1 -- 172.21.15.40:0/2404700767 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f00e8029030 con 0x7f00f409d920 2023-09-30T22:31:16.249 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:16.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.251+0000 7f00fa3cf700 1 -- 172.21.15.40:0/2404700767 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00f409d920 msgr2=0x7f00f412d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.251+0000 7f00fa3cf700 1 --2- 172.21.15.40:0/2404700767 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00f409d920 0x7f00f412d4f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f00e80090b0 tx=0x7f00e8004750 comp rx=0 tx=0).stop 2023-09-30T22:31:16.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.251+0000 7f00fa3cf700 1 -- 172.21.15.40:0/2404700767 shutdown_connections 2023-09-30T22:31:16.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.251+0000 7f00fa3cf700 1 --2- 172.21.15.40:0/2404700767 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00f409e2b0 0x7f00f412da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.251+0000 7f00fa3cf700 1 --2- 172.21.15.40:0/2404700767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f409c890 0x7f00f412cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.251+0000 7f00fa3cf700 1 --2- 172.21.15.40:0/2404700767 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00f409d920 0x7f00f412d4f0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.251+0000 7f00fa3cf700 1 -- 172.21.15.40:0/2404700767 >> 172.21.15.40:0/2404700767 conn(0x7f00f40a7080 msgr2=0x7f00f4132820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:16.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.251+0000 7f00fa3cf700 1 -- 172.21.15.40:0/2404700767 shutdown_connections 2023-09-30T22:31:16.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.251+0000 7f00fa3cf700 1 -- 172.21.15.40:0/2404700767 wait complete. 2023-09-30T22:31:16.269 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:16.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.316+0000 7fe08f0d6700 1 -- 172.21.15.40:0/1758572675 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe0881217d0 con 0x7fe08809e400 2023-09-30T22:31:16.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.317+0000 7fe0857fa700 1 -- 172.21.15.40:0/1758572675 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe074010380 con 0x7fe08809e400 2023-09-30T22:31:16.318 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:16.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.319+0000 7fe08f0d6700 1 -- 172.21.15.40:0/1758572675 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe08809e400 msgr2=0x7fe08811e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.319+0000 7fe08f0d6700 1 --2- 172.21.15.40:0/1758572675 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe08809e400 0x7fe08811e9b0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fe074016000 tx=0x7fe074004750 comp rx=0 tx=0).stop 2023-09-30T22:31:16.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.319+0000 7fe08f0d6700 1 -- 172.21.15.40:0/1758572675 shutdown_connections 2023-09-30T22:31:16.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.319+0000 7fe08f0d6700 1 --2- 172.21.15.40:0/1758572675 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe08809d920 0x7fe08811e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.319+0000 7fe08f0d6700 1 --2- 172.21.15.40:0/1758572675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe088136230 0x7fe08811eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.319+0000 7fe08f0d6700 1 --2- 172.21.15.40:0/1758572675 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe08809e400 0x7fe08811e9b0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.319+0000 7fe08f0d6700 1 -- 172.21.15.40:0/1758572675 >> 172.21.15.40:0/1758572675 conn(0x7fe08809fb20 msgr2=0x7fe0880a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:16.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.319+0000 7fe08f0d6700 1 -- 172.21.15.40:0/1758572675 shutdown_connections 2023-09-30T22:31:16.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:16.319+0000 7fe08f0d6700 1 -- 172.21.15.40:0/1758572675 wait complete. 2023-09-30T22:31:16.331 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:17.184 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:17.248 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:17.270 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:17.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.330+0000 7ff11a0d5700 1 Processor -- start 2023-09-30T22:31:17.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.330+0000 7ff11a0d5700 1 -- start start 2023-09-30T22:31:17.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.331+0000 7ff11a0d5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff114133e00 0x7ff1141341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.331+0000 7ff11a0d5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff11409d400 0x7ff11409d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.331+0000 7ff11a0d5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff114133940 con 0x7ff11409dd70 2023-09-30T22:31:17.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.331+0000 7ff11a0d5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff11409ab20 con 0x7ff11409d400 2023-09-30T22:31:17.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.331+0000 7ff11a0d5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff11409f0d0 con 0x7ff114133e00 2023-09-30T22:31:17.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.331+0000 7ff1137fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff114133e00 0x7ff1141341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.331+0000 7ff113fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff11409dd70 0x7ff11413ac70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53074/0 (socket says 172.21.15.40:53074) 2023-09-30T22:31:17.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.331+0000 7ff113fff700 1 -- 172.21.15.40:0/3794688721 learned_addr learned my addr 172.21.15.40:0/3794688721 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:17.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.331+0000 7ff112ffd700 1 --2- 172.21.15.40:0/3794688721 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff11409d400 0x7ff11409d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.332+0000 7ff1137fe700 1 -- 172.21.15.40:0/3794688721 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff11409d400 msgr2=0x7ff11409d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:17.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.332+0000 7ff1127fc700 1 -- 172.21.15.40:0/3794688721 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1342032934 0 0) 0x7ff114133940 con 0x7ff11409dd70 2023-09-30T22:31:17.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.332+0000 7ff1137fe700 1 --2- 172.21.15.40:0/3794688721 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff11409d400 0x7ff11409d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.332+0000 7ff1137fe700 1 -- 172.21.15.40:0/3794688721 >> v1:172.21.15.40:6789/0 conn(0x7ff11409dd70 legacy=0x7ff11413ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.332+0000 7ff1137fe700 1 -- 172.21.15.40:0/3794688721 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11409e210 con 0x7ff114133e00 2023-09-30T22:31:17.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.332+0000 7ff112ffd700 1 --2- 172.21.15.40:0/3794688721 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff11409d400 0x7ff11409d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:17.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.332+0000 7ff1137fe700 1 --2- 172.21.15.40:0/3794688721 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff114133e00 0x7ff1141341d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7ff104009870 tx=0x7ff104009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d11147c146ba2960 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:17.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.332+0000 7ff1127fc700 1 -- 172.21.15.40:0/3794688721 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff104011830 con 0x7ff114133e00 2023-09-30T22:31:17.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.332+0000 7ff1127fc700 1 -- 172.21.15.40:0/3794688721 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff104011990 con 0x7ff114133e00 2023-09-30T22:31:17.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.332+0000 7ff1127fc700 1 -- 172.21.15.40:0/3794688721 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff104011d20 con 0x7ff114133e00 2023-09-30T22:31:17.334 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:17.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.333+0000 7ff11a0d5700 1 -- 172.21.15.40:0/3794688721 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff114133e00 msgr2=0x7ff1141341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.333+0000 7ff11a0d5700 1 --2- 172.21.15.40:0/3794688721 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff114133e00 0x7ff1141341d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7ff104009870 tx=0x7ff104009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:17.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.333+0000 7ff11a0d5700 1 -- 172.21.15.40:0/3794688721 shutdown_connections 2023-09-30T22:31:17.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.333+0000 7ff11a0d5700 1 --2- 172.21.15.40:0/3794688721 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff114133e00 0x7ff1141341d0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.333+0000 7ff11a0d5700 1 --2- 172.21.15.40:0/3794688721 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff11409d400 0x7ff11409d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.333+0000 7ff11a0d5700 1 -- 172.21.15.40:0/3794688721 >> 172.21.15.40:0/3794688721 conn(0x7ff1140a2a00 msgr2=0x7ff1140a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:17.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.333+0000 7ff11a0d5700 1 -- 172.21.15.40:0/3794688721 shutdown_connections 2023-09-30T22:31:17.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.333+0000 7ff11a0d5700 1 -- 172.21.15.40:0/3794688721 wait complete. 2023-09-30T22:31:17.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.334+0000 7ff11a0d5700 1 Processor -- start 2023-09-30T22:31:17.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.334+0000 7ff11a0d5700 1 -- start start 2023-09-30T22:31:17.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.334+0000 7ff11a0d5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff11409d400 0x7ff11411b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.335+0000 7ff11a0d5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff11409dd70 0x7ff1141c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.335+0000 7ff11a0d5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff114133e00 0x7ff1141c4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.335+0000 7ff11a0d5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11411dfb0 con 0x7ff114133e00 2023-09-30T22:31:17.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.335+0000 7ff11a0d5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff11411c480 con 0x7ff11409d400 2023-09-30T22:31:17.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.335+0000 7ff11a0d5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff11411e290 con 0x7ff11409dd70 2023-09-30T22:31:17.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.335+0000 7ff1137fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff11409d400 0x7ff11411b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.335+0000 7ff1137fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff11409d400 0x7ff11411b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41700/0 (socket says 172.21.15.40:41700) 2023-09-30T22:31:17.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.335+0000 7ff113fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff114133e00 0x7ff1141c4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.335+0000 7ff1137fe700 1 -- 172.21.15.40:0/321806669 learned_addr learned my addr 172.21.15.40:0/321806669 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:17.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.335+0000 7ff112ffd700 1 --2- 172.21.15.40:0/321806669 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff11409dd70 0x7ff1141c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.335+0000 7ff113fff700 1 -- 172.21.15.40:0/321806669 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff11409dd70 msgr2=0x7ff1141c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.335+0000 7ff113fff700 1 --2- 172.21.15.40:0/321806669 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff11409dd70 0x7ff1141c8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.335+0000 7ff113fff700 1 -- 172.21.15.40:0/321806669 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff11409d400 msgr2=0x7ff11411b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.335+0000 7ff113fff700 1 --2- 172.21.15.40:0/321806669 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff11409d400 0x7ff11411b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.335+0000 7ff113fff700 1 -- 172.21.15.40:0/321806669 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1040094a0 con 0x7ff114133e00 2023-09-30T22:31:17.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.335+0000 7ff1137fe700 1 --2- 172.21.15.40:0/321806669 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff11409d400 0x7ff11411b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:17.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.335+0000 7ff113fff700 1 --2- 172.21.15.40:0/321806669 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff114133e00 0x7ff1141c4c80 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7ff10c00cbe0 tx=0x7ff10c00cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:17.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.335+0000 7ff0fbfff700 1 -- 172.21.15.40:0/321806669 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10c00aa40 con 0x7ff114133e00 2023-09-30T22:31:17.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.336+0000 7ff0fbfff700 1 -- 172.21.15.40:0/321806669 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10c00abc0 con 0x7ff114133e00 2023-09-30T22:31:17.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.336+0000 7ff0fbfff700 1 -- 172.21.15.40:0/321806669 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10c0070d0 con 0x7ff114133e00 2023-09-30T22:31:17.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.336+0000 7ff11a0d5700 1 -- 172.21.15.40:0/321806669 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff11411e990 con 0x7ff114133e00 2023-09-30T22:31:17.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.336+0000 7ff11a0d5700 1 -- 172.21.15.40:0/321806669 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1141c86d0 con 0x7ff114133e00 2023-09-30T22:31:17.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.337+0000 7ff11a0d5700 1 -- 172.21.15.40:0/321806669 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff11411eb50 con 0x7ff114133e00 2023-09-30T22:31:17.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.337+0000 7ff0fbfff700 1 -- 172.21.15.40:0/321806669 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff10c007230 con 0x7ff114133e00 2023-09-30T22:31:17.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.337+0000 7ff0fbfff700 1 -- 172.21.15.40:0/321806669 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff10c03f040 con 0x7ff114133e00 2023-09-30T22:31:17.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.342+0000 7ff0fbfff700 1 -- 172.21.15.40:0/321806669 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff10c0074e0 con 0x7ff114133e00 2023-09-30T22:31:17.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.390+0000 7f628499f700 1 Processor -- start 2023-09-30T22:31:17.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.390+0000 7f628499f700 1 -- start start 2023-09-30T22:31:17.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.390+0000 7f628499f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6280138250 0x7f6280138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.390+0000 7f628499f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f628009d400 0x7f628009d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.391+0000 7f628499f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f628009dd50 0x7f628013f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.391+0000 7f628499f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6280137e20 con 0x7f628009d400 2023-09-30T22:31:17.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.391+0000 7f628499f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6280138050 con 0x7f628009dd50 2023-09-30T22:31:17.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.391+0000 7f628499f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f628009b010 con 0x7f6280138250 2023-09-30T22:31:17.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.391+0000 7f627ed9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f628009dd50 0x7f628013f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.391+0000 7f627ed9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f628009dd50 0x7f628013f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41708/0 (socket says 172.21.15.40:41708) 2023-09-30T22:31:17.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.391+0000 7f627ed9d700 1 -- 172.21.15.40:0/2428391188 learned_addr learned my addr 172.21.15.40:0/2428391188 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:17.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.391+0000 7f627e59c700 1 --2- 172.21.15.40:0/2428391188 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6280138250 0x7f6280138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.391+0000 7f627dd9b700 1 --2- 172.21.15.40:0/2428391188 >> v2:172.21.15.40:3300/0 conn(0x7f628009d400 0x7f628009d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.391+0000 7f627ed9d700 1 -- 172.21.15.40:0/2428391188 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6280138250 msgr2=0x7f6280138620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:17.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.391+0000 7f627ed9d700 1 --2- 172.21.15.40:0/2428391188 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6280138250 0x7f6280138620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.391+0000 7f627ed9d700 1 -- 172.21.15.40:0/2428391188 >> v2:172.21.15.40:3300/0 conn(0x7f628009d400 msgr2=0x7f628009d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:17.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.391+0000 7f627ed9d700 1 --2- 172.21.15.40:0/2428391188 >> v2:172.21.15.40:3300/0 conn(0x7f628009d400 0x7f628009d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.391+0000 7f627ed9d700 1 -- 172.21.15.40:0/2428391188 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f628009e1f0 con 0x7f628009dd50 2023-09-30T22:31:17.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.391+0000 7f627e59c700 1 --2- 172.21.15.40:0/2428391188 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6280138250 0x7f6280138620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:17.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.391+0000 7f627ed9d700 1 --2- 172.21.15.40:0/2428391188 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f628009dd50 0x7f628013f150 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f6278009e50 tx=0x7f627800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4006b56670c4e9c1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:17.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.392+0000 7f627d59a700 1 -- 172.21.15.40:0/2428391188 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627800e070 con 0x7f628009dd50 2023-09-30T22:31:17.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.392+0000 7f627d59a700 1 -- 172.21.15.40:0/2428391188 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627800b910 con 0x7f628009dd50 2023-09-30T22:31:17.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.392+0000 7f627d59a700 1 -- 172.21.15.40:0/2428391188 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627800bcc0 con 0x7f628009dd50 2023-09-30T22:31:17.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.392+0000 7f628499f700 1 -- 172.21.15.40:0/2428391188 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f628009dd50 msgr2=0x7f628013f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.392+0000 7f628499f700 1 --2- 172.21.15.40:0/2428391188 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f628009dd50 0x7f628013f150 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f6278009e50 tx=0x7f627800b330 comp rx=0 tx=0).stop 2023-09-30T22:31:17.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.393+0000 7f628499f700 1 -- 172.21.15.40:0/2428391188 shutdown_connections 2023-09-30T22:31:17.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.393+0000 7f628499f700 1 --2- 172.21.15.40:0/2428391188 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6280138250 0x7f6280138620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.393+0000 7f628499f700 1 --2- 172.21.15.40:0/2428391188 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f628009dd50 0x7f628013f150 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.393+0000 7f628499f700 1 --2- 172.21.15.40:0/2428391188 >> v2:172.21.15.40:3300/0 conn(0x7f628009d400 0x7f628009d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.393+0000 7f628499f700 1 -- 172.21.15.40:0/2428391188 >> 172.21.15.40:0/2428391188 conn(0x7f62800a2a00 msgr2=0x7f62800a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:17.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.393+0000 7f628499f700 1 -- 172.21.15.40:0/2428391188 shutdown_connections 2023-09-30T22:31:17.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.393+0000 7f628499f700 1 -- 172.21.15.40:0/2428391188 wait complete. 2023-09-30T22:31:17.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.394+0000 7f628499f700 1 Processor -- start 2023-09-30T22:31:17.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.394+0000 7f628499f700 1 -- start start 2023-09-30T22:31:17.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.395+0000 7f628499f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f628009d400 0x7f628013a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.395+0000 7f628499f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f628009dd50 0x7f628013a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.395+0000 7f628499f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6280138250 0x7f628013ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.395+0000 7f628499f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628013d630 con 0x7f628009d400 2023-09-30T22:31:17.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.395+0000 7f628499f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6280135fd0 con 0x7f628009dd50 2023-09-30T22:31:17.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.395+0000 7f628499f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f628013dc70 con 0x7f6280138250 2023-09-30T22:31:17.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.395+0000 7f627e59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f628009d400 0x7f628013a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.395+0000 7f627e59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f628009d400 0x7f628013a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51628/0 (socket says 172.21.15.40:51628) 2023-09-30T22:31:17.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.395+0000 7f627e59c700 1 -- 172.21.15.40:0/3201227193 learned_addr learned my addr 172.21.15.40:0/3201227193 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:17.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.395+0000 7f627ed9d700 1 --2- 172.21.15.40:0/3201227193 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6280138250 0x7f628013ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.396+0000 7f627dd9b700 1 --2- 172.21.15.40:0/3201227193 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f628009dd50 0x7f628013a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.396+0000 7f627e59c700 1 -- 172.21.15.40:0/3201227193 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6280138250 msgr2=0x7f628013ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.396+0000 7f627e59c700 1 --2- 172.21.15.40:0/3201227193 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6280138250 0x7f628013ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.396+0000 7f627e59c700 1 -- 172.21.15.40:0/3201227193 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f628009dd50 msgr2=0x7f628013a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.396+0000 7f627e59c700 1 --2- 172.21.15.40:0/3201227193 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f628009dd50 0x7f628013a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.396+0000 7f627e59c700 1 -- 172.21.15.40:0/3201227193 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62700094a0 con 0x7f628009d400 2023-09-30T22:31:17.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.396+0000 7f627e59c700 1 --2- 172.21.15.40:0/3201227193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f628009d400 0x7f628013a1a0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f627000ebe0 tx=0x7f627000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:17.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.396+0000 7f627dd9b700 1 --2- 172.21.15.40:0/3201227193 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f628009dd50 0x7f628013a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:31:17.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.396+0000 7f626effd700 1 -- 172.21.15.40:0/3201227193 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6270009800 con 0x7f628009d400 2023-09-30T22:31:17.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.396+0000 7f626effd700 1 -- 172.21.15.40:0/3201227193 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627000c910 con 0x7f628009d400 2023-09-30T22:31:17.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.396+0000 7f628499f700 1 -- 172.21.15.40:0/3201227193 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6278009b30 con 0x7f628009d400 2023-09-30T22:31:17.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.396+0000 7f628499f700 1 -- 172.21.15.40:0/3201227193 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f628013e360 con 0x7f628009d400 2023-09-30T22:31:17.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.397+0000 7f626effd700 1 -- 172.21.15.40:0/3201227193 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627000cc80 con 0x7f628009d400 2023-09-30T22:31:17.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.397+0000 7f626effd700 1 -- 172.21.15.40:0/3201227193 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6270013470 con 0x7f628009d400 2023-09-30T22:31:17.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.398+0000 7f626effd700 1 -- 172.21.15.40:0/3201227193 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f627003fa80 con 0x7f628009d400 2023-09-30T22:31:17.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.398+0000 7f628499f700 1 -- 172.21.15.40:0/3201227193 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6280062380 con 0x7f628009d400 2023-09-30T22:31:17.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.403+0000 7f626effd700 1 -- 172.21.15.40:0/3201227193 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6270017080 con 0x7f628009d400 2023-09-30T22:31:17.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.431+0000 7f402e8c2700 1 Processor -- start 2023-09-30T22:31:17.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.431+0000 7f402e8c2700 1 -- start start 2023-09-30T22:31:17.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.432+0000 7f402e8c2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4028133e00 0x7f40281341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.432+0000 7f402e8c2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f402809df40 0x7f402813bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.432+0000 7f402e8c2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4028133940 con 0x7f402809d400 2023-09-30T22:31:17.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.432+0000 7f402e8c2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f402809ab20 con 0x7f4028133e00 2023-09-30T22:31:17.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.432+0000 7f402e8c2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f402809f0d0 con 0x7f402809df40 2023-09-30T22:31:17.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.432+0000 7f40277fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f402809d400 0x7f402809d830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53088/0 (socket says 172.21.15.40:53088) 2023-09-30T22:31:17.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.432+0000 7f40277fe700 1 -- 172.21.15.40:0/1313960664 learned_addr learned my addr 172.21.15.40:0/1313960664 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:17.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.432+0000 7f402ce5f700 1 --2- 172.21.15.40:0/1313960664 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f402809df40 0x7f402813bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.432+0000 7f4027fff700 1 --2- 172.21.15.40:0/1313960664 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4028133e00 0x7f40281341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.432+0000 7f4026ffd700 1 -- 172.21.15.40:0/1313960664 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2537827627 0 0) 0x7f4028133940 con 0x7f402809d400 2023-09-30T22:31:17.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.433+0000 7f4026ffd700 1 -- 172.21.15.40:0/1313960664 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40100035b0 con 0x7f402809d400 2023-09-30T22:31:17.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.433+0000 7f4027fff700 1 -- 172.21.15.40:0/1313960664 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f402809df40 msgr2=0x7f402813bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:17.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.433+0000 7f4027fff700 1 --2- 172.21.15.40:0/1313960664 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f402809df40 0x7f402813bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.433+0000 7f4027fff700 1 -- 172.21.15.40:0/1313960664 >> v1:172.21.15.40:6789/0 conn(0x7f402809d400 legacy=0x7f402809d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.433+0000 7f4026ffd700 1 -- 172.21.15.40:0/1313960664 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 805341093 0 0) 0x7f40100035b0 con 0x7f402809d400 2023-09-30T22:31:17.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.433+0000 7f4027fff700 1 -- 172.21.15.40:0/1313960664 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4028133be0 con 0x7f4028133e00 2023-09-30T22:31:17.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.433+0000 7f402ce5f700 1 --2- 172.21.15.40:0/1313960664 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f402809df40 0x7f402813bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:17.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.433+0000 7f4027fff700 1 --2- 172.21.15.40:0/1313960664 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4028133e00 0x7f40281341d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f4018009870 tx=0x7f4018009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b320e6c69d9d0dcf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:17.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.433+0000 7f4026ffd700 1 -- 172.21.15.40:0/1313960664 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401c001670 con 0x7f4028133e00 2023-09-30T22:31:17.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.433+0000 7f4026ffd700 1 -- 172.21.15.40:0/1313960664 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4018004030 con 0x7f4028133e00 2023-09-30T22:31:17.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.433+0000 7f4026ffd700 1 -- 172.21.15.40:0/1313960664 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40180043c0 con 0x7f4028133e00 2023-09-30T22:31:17.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.434+0000 7f402e8c2700 1 -- 172.21.15.40:0/1313960664 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4028133e00 msgr2=0x7f40281341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.434+0000 7f402e8c2700 1 --2- 172.21.15.40:0/1313960664 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4028133e00 0x7f40281341d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f4018009870 tx=0x7f4018009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:17.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.434+0000 7f402e8c2700 1 -- 172.21.15.40:0/1313960664 shutdown_connections 2023-09-30T22:31:17.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.434+0000 7f402e8c2700 1 --2- 172.21.15.40:0/1313960664 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f402809df40 0x7f402813bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.434+0000 7f402e8c2700 1 --2- 172.21.15.40:0/1313960664 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4028133e00 0x7f40281341d0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.434+0000 7f402e8c2700 1 -- 172.21.15.40:0/1313960664 >> 172.21.15.40:0/1313960664 conn(0x7f40280a2a00 msgr2=0x7f40280a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:17.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.434+0000 7f402e8c2700 1 -- 172.21.15.40:0/1313960664 shutdown_connections 2023-09-30T22:31:17.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.434+0000 7f402e8c2700 1 -- 172.21.15.40:0/1313960664 wait complete. 2023-09-30T22:31:17.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.435+0000 7f402e8c2700 1 Processor -- start 2023-09-30T22:31:17.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.435+0000 7f402e8c2700 1 -- start start 2023-09-30T22:31:17.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.436+0000 7f402e8c2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f402809d400 0x7f4028119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.436+0000 7f402e8c2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f402809df40 0x7f4028119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.436+0000 7f402e8c2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4028133e00 0x7f4028119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.436+0000 7f402e8c2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402811c100 con 0x7f402809df40 2023-09-30T22:31:17.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.436+0000 7f402e8c2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f402812c000 con 0x7f402809d400 2023-09-30T22:31:17.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.436+0000 7f402e8c2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f402811a420 con 0x7f4028133e00 2023-09-30T22:31:17.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.436+0000 7f4027fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f402809d400 0x7f4028119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.436+0000 7f4027fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f402809d400 0x7f4028119050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41742/0 (socket says 172.21.15.40:41742) 2023-09-30T22:31:17.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.436+0000 7f4027fff700 1 -- 172.21.15.40:0/633175443 learned_addr learned my addr 172.21.15.40:0/633175443 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:17.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.436+0000 7f402ce5f700 1 --2- 172.21.15.40:0/633175443 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4028133e00 0x7f4028119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.436+0000 7f40277fe700 1 --2- 172.21.15.40:0/633175443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f402809df40 0x7f4028119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.436+0000 7f4027fff700 1 -- 172.21.15.40:0/633175443 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4028133e00 msgr2=0x7f4028119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.436+0000 7f4027fff700 1 --2- 172.21.15.40:0/633175443 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4028133e00 0x7f4028119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.436+0000 7f4027fff700 1 -- 172.21.15.40:0/633175443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f402809df40 msgr2=0x7f4028119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.436+0000 7f4027fff700 1 --2- 172.21.15.40:0/633175443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f402809df40 0x7f4028119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.436+0000 7f4027fff700 1 -- 172.21.15.40:0/633175443 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4020009a70 con 0x7f402809d400 2023-09-30T22:31:17.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.437+0000 7f4027fff700 1 --2- 172.21.15.40:0/633175443 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f402809d400 0x7f4028119050 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f4018009840 tx=0x7f4018004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:17.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.437+0000 7f4024ff9700 1 -- 172.21.15.40:0/633175443 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4018003cf0 con 0x7f402809d400 2023-09-30T22:31:17.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.437+0000 7f4024ff9700 1 -- 172.21.15.40:0/633175443 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f401801f070 con 0x7f402809d400 2023-09-30T22:31:17.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.437+0000 7f402e8c2700 1 -- 172.21.15.40:0/633175443 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40180094a0 con 0x7f402809d400 2023-09-30T22:31:17.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.437+0000 7f4024ff9700 1 -- 172.21.15.40:0/633175443 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4018011830 con 0x7f402809d400 2023-09-30T22:31:17.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.437+0000 7f402e8c2700 1 -- 172.21.15.40:0/633175443 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f402811ab30 con 0x7f402809d400 2023-09-30T22:31:17.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.438+0000 7f402e8c2700 1 -- 172.21.15.40:0/633175443 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40281bb0f0 con 0x7f402809d400 2023-09-30T22:31:17.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.439+0000 7f4024ff9700 1 -- 172.21.15.40:0/633175443 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4018011990 con 0x7f402809d400 2023-09-30T22:31:17.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.439+0000 7f4024ff9700 1 -- 172.21.15.40:0/633175443 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4018021070 con 0x7f402809d400 2023-09-30T22:31:17.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.443+0000 7f4024ff9700 1 -- 172.21.15.40:0/633175443 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f401802f990 con 0x7f402809d400 2023-09-30T22:31:17.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.473+0000 7f1e9891f700 1 Processor -- start 2023-09-30T22:31:17.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.473+0000 7f1e9891f700 1 -- start start 2023-09-30T22:31:17.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.473+0000 7f1e9891f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1e9409c890 0x7f1e9409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.473+0000 7f1e9891f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e9409d920 0x7f1e9409dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.474+0000 7f1e9891f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e940a2600 con 0x7f1e9409e2b0 2023-09-30T22:31:17.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.474+0000 7f1e9891f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e940a29d0 con 0x7f1e9409d920 2023-09-30T22:31:17.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.474+0000 7f1e9891f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9409fb40 con 0x7f1e9409c890 2023-09-30T22:31:17.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.474+0000 7f1e91d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e9409d920 0x7f1e9409dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.474+0000 7f1e91d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e9409d920 0x7f1e9409dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41754/0 (socket says 172.21.15.40:41754) 2023-09-30T22:31:17.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.474+0000 7f1e91d9b700 1 -- 172.21.15.40:0/180840080 learned_addr learned my addr 172.21.15.40:0/180840080 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:17.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.474+0000 7f1e9259c700 1 --2- 172.21.15.40:0/180840080 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1e9409c890 0x7f1e9409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.474+0000 7f1e91d9b700 1 -- 172.21.15.40:0/180840080 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1e9409c890 msgr2=0x7f1e9409cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:17.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.474+0000 7f1e91d9b700 1 --2- 172.21.15.40:0/180840080 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1e9409c890 0x7f1e9409cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.474+0000 7f1e91d9b700 1 -- 172.21.15.40:0/180840080 >> v1:172.21.15.40:6789/0 conn(0x7f1e9409e2b0 legacy=0x7f1e9413ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.474+0000 7f1e91d9b700 1 -- 172.21.15.40:0/180840080 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e9409e720 con 0x7f1e9409d920 2023-09-30T22:31:17.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.474+0000 7f1e9259c700 1 --2- 172.21.15.40:0/180840080 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1e9409c890 0x7f1e9409cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:31:17.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.474+0000 7f1e91d9b700 1 --2- 172.21.15.40:0/180840080 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e9409d920 0x7f1e9409dd70 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f1e88009920 tx=0x7f1e88009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcfa28b36327118b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:17.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.474+0000 7f1e9159a700 1 -- 172.21.15.40:0/180840080 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8800ba60 con 0x7f1e9409d920 2023-09-30T22:31:17.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.475+0000 7f1e9159a700 1 -- 172.21.15.40:0/180840080 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8800bbc0 con 0x7f1e9409d920 2023-09-30T22:31:17.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.475+0000 7f1e9159a700 1 -- 172.21.15.40:0/180840080 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e88009e70 con 0x7f1e9409d920 2023-09-30T22:31:17.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.475+0000 7f1e9891f700 1 -- 172.21.15.40:0/180840080 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e9409d920 msgr2=0x7f1e9409dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.475+0000 7f1e9891f700 1 --2- 172.21.15.40:0/180840080 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e9409d920 0x7f1e9409dd70 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f1e88009920 tx=0x7f1e88009c30 comp rx=0 tx=0).stop 2023-09-30T22:31:17.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.475+0000 7f1e9891f700 1 -- 172.21.15.40:0/180840080 shutdown_connections 2023-09-30T22:31:17.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.475+0000 7f1e9891f700 1 --2- 172.21.15.40:0/180840080 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1e9409c890 0x7f1e9409cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.475+0000 7f1e9891f700 1 --2- 172.21.15.40:0/180840080 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e9409d920 0x7f1e9409dd70 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.475+0000 7f1e9891f700 1 -- 172.21.15.40:0/180840080 >> 172.21.15.40:0/180840080 conn(0x7f1e940a7080 msgr2=0x7f1e940a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:17.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.475+0000 7f1e9891f700 1 -- 172.21.15.40:0/180840080 shutdown_connections 2023-09-30T22:31:17.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.475+0000 7f1e9891f700 1 -- 172.21.15.40:0/180840080 wait complete. 2023-09-30T22:31:17.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.477+0000 7f1e9891f700 1 Processor -- start 2023-09-30T22:31:17.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.477+0000 7f1e9891f700 1 -- start start 2023-09-30T22:31:17.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.477+0000 7f1e9891f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e9409c890 0x7f1e9408d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.477+0000 7f1e9891f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1e9409d920 0x7f1e9408d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.477+0000 7f1e9891f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e9409e2b0 0x7f1e9408dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.477+0000 7f1e9891f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9406e750 con 0x7f1e9409c890 2023-09-30T22:31:17.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.477+0000 7f1e9891f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9406f530 con 0x7f1e9409e2b0 2023-09-30T22:31:17.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.477+0000 7f1e9891f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9406e950 con 0x7f1e9409d920 2023-09-30T22:31:17.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.477+0000 7f1e9259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e9409c890 0x7f1e9408d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.477+0000 7f1e9259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e9409c890 0x7f1e9408d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51648/0 (socket says 172.21.15.40:51648) 2023-09-30T22:31:17.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.477+0000 7f1e9259c700 1 -- 172.21.15.40:0/196078993 learned_addr learned my addr 172.21.15.40:0/196078993 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:17.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.477+0000 7f1e92d9d700 1 --2- 172.21.15.40:0/196078993 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e9409e2b0 0x7f1e9408dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.478+0000 7f1e91d9b700 1 --2- 172.21.15.40:0/196078993 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1e9409d920 0x7f1e9408d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.478+0000 7f1e9259c700 1 -- 172.21.15.40:0/196078993 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1e9409d920 msgr2=0x7f1e9408d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.478+0000 7f1e9259c700 1 --2- 172.21.15.40:0/196078993 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1e9409d920 0x7f1e9408d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.478+0000 7f1e9259c700 1 -- 172.21.15.40:0/196078993 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e9409e2b0 msgr2=0x7f1e9408dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.478+0000 7f1e9259c700 1 --2- 172.21.15.40:0/196078993 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e9409e2b0 0x7f1e9408dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.478+0000 7f1e9259c700 1 -- 172.21.15.40:0/196078993 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e88009550 con 0x7f1e9409c890 2023-09-30T22:31:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.478+0000 7f1e91d9b700 1 --2- 172.21.15.40:0/196078993 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1e9409d920 0x7f1e9408d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:31:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.478+0000 7f1e9259c700 1 --2- 172.21.15.40:0/196078993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e9409c890 0x7f1e9408d1c0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f1e8400c7f0 tx=0x7f1e8400cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.478+0000 7f1e82ffd700 1 -- 172.21.15.40:0/196078993 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e84005c20 con 0x7f1e9409c890 2023-09-30T22:31:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.478+0000 7f1e82ffd700 1 -- 172.21.15.40:0/196078993 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e84005d80 con 0x7f1e9409c890 2023-09-30T22:31:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.478+0000 7f1e9891f700 1 -- 172.21.15.40:0/196078993 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e9408ed40 con 0x7f1e9409c890 2023-09-30T22:31:17.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.478+0000 7f1e82ffd700 1 -- 172.21.15.40:0/196078993 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e84011800 con 0x7f1e9409c890 2023-09-30T22:31:17.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.478+0000 7f1e9891f700 1 -- 172.21.15.40:0/196078993 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e9409ecf0 con 0x7f1e9409c890 2023-09-30T22:31:17.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.479+0000 7f1e9891f700 1 -- 172.21.15.40:0/196078993 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e9408e650 con 0x7f1e9409c890 2023-09-30T22:31:17.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.480+0000 7f1e82ffd700 1 -- 172.21.15.40:0/196078993 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e84011960 con 0x7f1e9409c890 2023-09-30T22:31:17.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.480+0000 7f1e82ffd700 1 -- 172.21.15.40:0/196078993 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f1e8403f830 con 0x7f1e9409c890 2023-09-30T22:31:17.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.484+0000 7f1e82ffd700 1 -- 172.21.15.40:0/196078993 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e84020300 con 0x7f1e9409c890 2023-09-30T22:31:17.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.549+0000 7ff11a0d5700 1 -- 172.21.15.40:0/321806669 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff114062380 con 0x7ff114133e00 2023-09-30T22:31:17.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.549+0000 7ff0fbfff700 1 -- 172.21.15.40:0/321806669 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff10c018020 con 0x7ff114133e00 2023-09-30T22:31:17.550 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:17.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.552+0000 7ff11a0d5700 1 -- 172.21.15.40:0/321806669 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff114133e00 msgr2=0x7ff1141c4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.552+0000 7ff11a0d5700 1 --2- 172.21.15.40:0/321806669 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff114133e00 0x7ff1141c4c80 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7ff10c00cbe0 tx=0x7ff10c00cef0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.552+0000 7ff11a0d5700 1 -- 172.21.15.40:0/321806669 shutdown_connections 2023-09-30T22:31:17.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.552+0000 7ff11a0d5700 1 --2- 172.21.15.40:0/321806669 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff114133e00 0x7ff1141c4c80 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.552+0000 7ff11a0d5700 1 --2- 172.21.15.40:0/321806669 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff11409d400 0x7ff11411b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.552+0000 7ff11a0d5700 1 --2- 172.21.15.40:0/321806669 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff11409dd70 0x7ff1141c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.552+0000 7ff11a0d5700 1 -- 172.21.15.40:0/321806669 >> 172.21.15.40:0/321806669 conn(0x7ff1140a2a00 msgr2=0x7ff1141bb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:17.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.552+0000 7ff11a0d5700 1 -- 172.21.15.40:0/321806669 shutdown_connections 2023-09-30T22:31:17.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.552+0000 7ff11a0d5700 1 -- 172.21.15.40:0/321806669 wait complete. 2023-09-30T22:31:17.565 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:17.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.606+0000 7f628499f700 1 -- 172.21.15.40:0/3201227193 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f628009abb0 con 0x7f628009d400 2023-09-30T22:31:17.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.606+0000 7f626effd700 1 -- 172.21.15.40:0/3201227193 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f62700232f0 con 0x7f628009d400 2023-09-30T22:31:17.607 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:17.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.608+0000 7f628499f700 1 -- 172.21.15.40:0/3201227193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f628009d400 msgr2=0x7f628013a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.608+0000 7f628499f700 1 --2- 172.21.15.40:0/3201227193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f628009d400 0x7f628013a1a0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f627000ebe0 tx=0x7f627000eef0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.608+0000 7f628499f700 1 -- 172.21.15.40:0/3201227193 shutdown_connections 2023-09-30T22:31:17.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.608+0000 7f628499f700 1 --2- 172.21.15.40:0/3201227193 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6280138250 0x7f628013ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.608+0000 7f628499f700 1 --2- 172.21.15.40:0/3201227193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f628009d400 0x7f628013a1a0 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.608+0000 7f628499f700 1 --2- 172.21.15.40:0/3201227193 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f628009dd50 0x7f628013a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.608+0000 7f628499f700 1 -- 172.21.15.40:0/3201227193 >> 172.21.15.40:0/3201227193 conn(0x7f62800a2a00 msgr2=0x7f62800a0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:17.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.608+0000 7f628499f700 1 -- 172.21.15.40:0/3201227193 shutdown_connections 2023-09-30T22:31:17.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.608+0000 7f628499f700 1 -- 172.21.15.40:0/3201227193 wait complete. 2023-09-30T22:31:17.621 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:17.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.643+0000 7f402e8c2700 1 -- 172.21.15.40:0/633175443 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4028062380 con 0x7f402809d400 2023-09-30T22:31:17.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.644+0000 7f4024ff9700 1 -- 172.21.15.40:0/633175443 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f401802b030 con 0x7f402809d400 2023-09-30T22:31:17.644 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:17.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.646+0000 7f402e8c2700 1 -- 172.21.15.40:0/633175443 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f402809d400 msgr2=0x7f4028119050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.646+0000 7f402e8c2700 1 --2- 172.21.15.40:0/633175443 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f402809d400 0x7f4028119050 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f4018009840 tx=0x7f4018004750 comp rx=0 tx=0).stop 2023-09-30T22:31:17.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.646+0000 7f402e8c2700 1 -- 172.21.15.40:0/633175443 shutdown_connections 2023-09-30T22:31:17.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.646+0000 7f402e8c2700 1 --2- 172.21.15.40:0/633175443 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4028133e00 0x7f4028119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.646+0000 7f402e8c2700 1 --2- 172.21.15.40:0/633175443 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f402809d400 0x7f4028119050 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.646+0000 7f402e8c2700 1 --2- 172.21.15.40:0/633175443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f402809df40 0x7f4028119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.646+0000 7f402e8c2700 1 -- 172.21.15.40:0/633175443 >> 172.21.15.40:0/633175443 conn(0x7f40280a2a00 msgr2=0x7f402812d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:17.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.646+0000 7f402e8c2700 1 -- 172.21.15.40:0/633175443 shutdown_connections 2023-09-30T22:31:17.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.646+0000 7f402e8c2700 1 -- 172.21.15.40:0/633175443 wait complete. 2023-09-30T22:31:17.659 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:17.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.683+0000 7f1e9891f700 1 -- 172.21.15.40:0/196078993 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1e9408ece0 con 0x7f1e9409c890 2023-09-30T22:31:17.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.683+0000 7f1e82ffd700 1 -- 172.21.15.40:0/196078993 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e84021350 con 0x7f1e9409c890 2023-09-30T22:31:17.684 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:17.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.685+0000 7f1e9891f700 1 -- 172.21.15.40:0/196078993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e9409c890 msgr2=0x7f1e9408d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.685+0000 7f1e9891f700 1 --2- 172.21.15.40:0/196078993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e9409c890 0x7f1e9408d1c0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f1e8400c7f0 tx=0x7f1e8400cb00 comp rx=0 tx=0).stop 2023-09-30T22:31:17.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.686+0000 7f1e9891f700 1 -- 172.21.15.40:0/196078993 shutdown_connections 2023-09-30T22:31:17.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.686+0000 7f1e9891f700 1 --2- 172.21.15.40:0/196078993 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e9409e2b0 0x7f1e9408dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.686+0000 7f1e9891f700 1 --2- 172.21.15.40:0/196078993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e9409c890 0x7f1e9408d1c0 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.686+0000 7f1e9891f700 1 --2- 172.21.15.40:0/196078993 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1e9409d920 0x7f1e9408d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.686+0000 7f1e9891f700 1 -- 172.21.15.40:0/196078993 >> 172.21.15.40:0/196078993 conn(0x7f1e940a7080 msgr2=0x7f1e94132c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:17.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.686+0000 7f1e9891f700 1 -- 172.21.15.40:0/196078993 shutdown_connections 2023-09-30T22:31:17.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:17.686+0000 7f1e9891f700 1 -- 172.21.15.40:0/196078993 wait complete. 2023-09-30T22:31:17.698 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:18.566 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:18.622 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:18.660 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:18.699 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:18.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.710+0000 7f23e8ebd700 1 Processor -- start 2023-09-30T22:31:18.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.710+0000 7f23e8ebd700 1 -- start start 2023-09-30T22:31:18.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.711+0000 7f23e8ebd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f23e409da20 0x7f23e4099510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.711+0000 7f23e8ebd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f23e409e5f0 0x7f23e4099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.711+0000 7f23e8ebd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23e4099f90 0x7f23e413a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.711+0000 7f23e8ebd700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23e409ddf0 con 0x7f23e409da20 2023-09-30T22:31:18.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.711+0000 7f23e8ebd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e409b7c0 con 0x7f23e4099f90 2023-09-30T22:31:18.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.711+0000 7f23e8ebd700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23e409c440 con 0x7f23e409e5f0 2023-09-30T22:31:18.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.711+0000 7f23e259c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f23e409da20 0x7f23e4099510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.711+0000 7f23e259c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f23e409da20 0x7f23e4099510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51650/0 (socket says 172.21.15.40:51650) 2023-09-30T22:31:18.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.711+0000 7f23e259c700 1 -- 172.21.15.40:0/3606299993 learned_addr learned my addr 172.21.15.40:0/3606299993 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:18.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.711+0000 7f23e2d9d700 1 --2- 172.21.15.40:0/3606299993 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23e4099f90 0x7f23e413a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.711+0000 7f23e259c700 1 -- 172.21.15.40:0/3606299993 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f23e409e5f0 msgr2=0x7f23e4099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:18.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.711+0000 7f23e259c700 1 --2- 172.21.15.40:0/3606299993 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f23e409e5f0 0x7f23e4099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.711+0000 7f23e259c700 1 -- 172.21.15.40:0/3606299993 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23e4099f90 msgr2=0x7f23e413a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:18.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.711+0000 7f23e259c700 1 --2- 172.21.15.40:0/3606299993 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23e4099f90 0x7f23e413a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.711+0000 7f23e259c700 1 -- 172.21.15.40:0/3606299993 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e409a9e0 con 0x7f23e409da20 2023-09-30T22:31:18.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.711+0000 7f23e2d9d700 1 --2- 172.21.15.40:0/3606299993 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23e4099f90 0x7f23e413a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:18.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.712+0000 7f23e259c700 1 --2- 172.21.15.40:0/3606299993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23e409da20 0x7f23e4099510 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f23d4006fd0 tx=0x7f23d4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6aee678eeba50f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:18.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.712+0000 7f23e159a700 1 -- 172.21.15.40:0/3606299993 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d4005e30 con 0x7f23e409da20 2023-09-30T22:31:18.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.712+0000 7f23e159a700 1 -- 172.21.15.40:0/3606299993 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d4004030 con 0x7f23e409da20 2023-09-30T22:31:18.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.712+0000 7f23e159a700 1 -- 172.21.15.40:0/3606299993 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d40043e0 con 0x7f23e409da20 2023-09-30T22:31:18.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.713+0000 7f23e8ebd700 1 -- 172.21.15.40:0/3606299993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23e409da20 msgr2=0x7f23e4099510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.713+0000 7f23e8ebd700 1 --2- 172.21.15.40:0/3606299993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23e409da20 0x7f23e4099510 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f23d4006fd0 tx=0x7f23d4009bd0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.713+0000 7f23e8ebd700 1 -- 172.21.15.40:0/3606299993 shutdown_connections 2023-09-30T22:31:18.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.713+0000 7f23e8ebd700 1 --2- 172.21.15.40:0/3606299993 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23e4099f90 0x7f23e413a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.713+0000 7f23e8ebd700 1 --2- 172.21.15.40:0/3606299993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23e409da20 0x7f23e4099510 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.713+0000 7f23e8ebd700 1 --2- 172.21.15.40:0/3606299993 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f23e409e5f0 0x7f23e4099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.713+0000 7f23e8ebd700 1 -- 172.21.15.40:0/3606299993 >> 172.21.15.40:0/3606299993 conn(0x7f23e409eb10 msgr2=0x7f23e409ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:18.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.713+0000 7f23e8ebd700 1 -- 172.21.15.40:0/3606299993 shutdown_connections 2023-09-30T22:31:18.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.713+0000 7f23e8ebd700 1 -- 172.21.15.40:0/3606299993 wait complete. 2023-09-30T22:31:18.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.714+0000 7f23e8ebd700 1 Processor -- start 2023-09-30T22:31:18.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.714+0000 7f23e8ebd700 1 -- start start 2023-09-30T22:31:18.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.715+0000 7f23e8ebd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23e4099f90 0x7f23e41371d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.715+0000 7f23e8ebd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f23e409da20 0x7f23e4137710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.715+0000 7f23e8ebd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23e409e5f0 0x7f23e4137c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.715+0000 7f23e8ebd700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e4093780 con 0x7f23e409e5f0 2023-09-30T22:31:18.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.715+0000 7f23e8ebd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e4097b40 con 0x7f23e4099f90 2023-09-30T22:31:18.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.715+0000 7f23e8ebd700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23e40a1b20 con 0x7f23e409da20 2023-09-30T22:31:18.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.715+0000 7f23e2d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23e409e5f0 0x7f23e4137c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.715+0000 7f23e2d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23e409e5f0 0x7f23e4137c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51664/0 (socket says 172.21.15.40:51664) 2023-09-30T22:31:18.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.715+0000 7f23e2d9d700 1 -- 172.21.15.40:0/2405803999 learned_addr learned my addr 172.21.15.40:0/2405803999 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:18.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.715+0000 7f23e259c700 1 --2- 172.21.15.40:0/2405803999 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23e4099f90 0x7f23e41371d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.715+0000 7f23e2d9d700 1 -- 172.21.15.40:0/2405803999 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f23e409da20 msgr2=0x7f23e4137710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.715+0000 7f23e2d9d700 1 --2- 172.21.15.40:0/2405803999 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f23e409da20 0x7f23e4137710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.715+0000 7f23e2d9d700 1 -- 172.21.15.40:0/2405803999 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23e4099f90 msgr2=0x7f23e41371d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.715+0000 7f23e2d9d700 1 --2- 172.21.15.40:0/2405803999 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23e4099f90 0x7f23e41371d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.715+0000 7f23e2d9d700 1 -- 172.21.15.40:0/2405803999 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d4009500 con 0x7f23e409e5f0 2023-09-30T22:31:18.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.716+0000 7f23e2d9d700 1 --2- 172.21.15.40:0/2405803999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23e409e5f0 0x7f23e4137c50 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f23dc007ef0 tx=0x7f23dc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:18.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.716+0000 7f23d2ffd700 1 -- 172.21.15.40:0/2405803999 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc00de30 con 0x7f23e409e5f0 2023-09-30T22:31:18.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.716+0000 7f23d2ffd700 1 -- 172.21.15.40:0/2405803999 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23dc00f040 con 0x7f23e409e5f0 2023-09-30T22:31:18.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.716+0000 7f23d2ffd700 1 -- 172.21.15.40:0/2405803999 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc003c60 con 0x7f23e409e5f0 2023-09-30T22:31:18.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.716+0000 7f23e8ebd700 1 -- 172.21.15.40:0/2405803999 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23e409ac20 con 0x7f23e409e5f0 2023-09-30T22:31:18.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.716+0000 7f23e8ebd700 1 -- 172.21.15.40:0/2405803999 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e40965d0 con 0x7f23e409e5f0 2023-09-30T22:31:18.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.717+0000 7f23e8ebd700 1 -- 172.21.15.40:0/2405803999 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23e4062380 con 0x7f23e409e5f0 2023-09-30T22:31:18.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.718+0000 7f23d2ffd700 1 -- 172.21.15.40:0/2405803999 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f23dc004030 con 0x7f23e409e5f0 2023-09-30T22:31:18.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.718+0000 7f23d2ffd700 1 -- 172.21.15.40:0/2405803999 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f23dc03f860 con 0x7f23e409e5f0 2023-09-30T22:31:18.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.723+0000 7f23d2ffd700 1 -- 172.21.15.40:0/2405803999 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f23dc01e3b0 con 0x7f23e409e5f0 2023-09-30T22:31:18.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.762+0000 7f4f819bb700 1 Processor -- start 2023-09-30T22:31:18.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.762+0000 7f4f819bb700 1 -- start start 2023-09-30T22:31:18.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.763+0000 7f4f819bb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f7c09e400 0x7f4f7c135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.763+0000 7f4f819bb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4f7c136230 0x7f4f7c138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.763+0000 7f4f819bb700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f7c09adf0 con 0x7f4f7c09d920 2023-09-30T22:31:18.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.763+0000 7f4f819bb700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f7c09e7f0 con 0x7f4f7c136230 2023-09-30T22:31:18.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.763+0000 7f4f819bb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c09edf0 con 0x7f4f7c09e400 2023-09-30T22:31:18.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.763+0000 7f4f7affd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f4f7c09d920 0x7f4f7c09dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53110/0 (socket says 172.21.15.40:53110) 2023-09-30T22:31:18.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.763+0000 7f4f7affd700 1 -- 172.21.15.40:0/2959033445 learned_addr learned my addr 172.21.15.40:0/2959033445 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:18.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.763+0000 7f4f7b7fe700 1 --2- 172.21.15.40:0/2959033445 >> v2:172.21.15.40:3300/0 conn(0x7f4f7c136230 0x7f4f7c138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.763+0000 7f4f7a7fc700 1 --2- 172.21.15.40:0/2959033445 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f7c09e400 0x7f4f7c135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.763+0000 7f4f79ffb700 1 -- 172.21.15.40:0/2959033445 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3991651535 0 0) 0x7f4f7c09adf0 con 0x7f4f7c09d920 2023-09-30T22:31:18.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.763+0000 7f4f79ffb700 1 -- 172.21.15.40:0/2959033445 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f640035b0 con 0x7f4f7c09d920 2023-09-30T22:31:18.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.764+0000 7f4f7b7fe700 1 -- 172.21.15.40:0/2959033445 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f7c09e400 msgr2=0x7f4f7c135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:18.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.764+0000 7f4f7b7fe700 1 --2- 172.21.15.40:0/2959033445 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f7c09e400 0x7f4f7c135cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.764+0000 7f4f7b7fe700 1 -- 172.21.15.40:0/2959033445 >> v1:172.21.15.40:6789/0 conn(0x7f4f7c09d920 legacy=0x7f4f7c09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.764+0000 7f4f7b7fe700 1 -- 172.21.15.40:0/2959033445 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f7c09b660 con 0x7f4f7c136230 2023-09-30T22:31:18.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.764+0000 7f4f7b7fe700 1 --2- 172.21.15.40:0/2959033445 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f7c136230 0x7f4f7c138610 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f4f74009d90 tx=0x7f4f7400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63bf8364d59a171c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:18.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.764+0000 7f4f79ffb700 1 -- 172.21.15.40:0/2959033445 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7400e070 con 0x7f4f7c136230 2023-09-30T22:31:18.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.764+0000 7f4f79ffb700 1 -- 172.21.15.40:0/2959033445 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f7400bb20 con 0x7f4f7c136230 2023-09-30T22:31:18.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.764+0000 7f4f79ffb700 1 -- 172.21.15.40:0/2959033445 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7400be90 con 0x7f4f7c136230 2023-09-30T22:31:18.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.765+0000 7f4f819bb700 1 -- 172.21.15.40:0/2959033445 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f7c136230 msgr2=0x7f4f7c138610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.765+0000 7f4f819bb700 1 --2- 172.21.15.40:0/2959033445 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f7c136230 0x7f4f7c138610 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f4f74009d90 tx=0x7f4f7400b330 comp rx=0 tx=0).stop 2023-09-30T22:31:18.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.765+0000 7f4f819bb700 1 -- 172.21.15.40:0/2959033445 shutdown_connections 2023-09-30T22:31:18.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.765+0000 7f4f819bb700 1 --2- 172.21.15.40:0/2959033445 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f7c136230 0x7f4f7c138610 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.765+0000 7f4f819bb700 1 --2- 172.21.15.40:0/2959033445 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f7c09e400 0x7f4f7c135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.765+0000 7f4f819bb700 1 -- 172.21.15.40:0/2959033445 >> 172.21.15.40:0/2959033445 conn(0x7f4f7c09fb20 msgr2=0x7f4f7c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:18.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.766+0000 7f4f819bb700 1 -- 172.21.15.40:0/2959033445 shutdown_connections 2023-09-30T22:31:18.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.766+0000 7f4f819bb700 1 -- 172.21.15.40:0/2959033445 wait complete. 2023-09-30T22:31:18.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.767+0000 7f4f819bb700 1 Processor -- start 2023-09-30T22:31:18.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.767+0000 7f4f819bb700 1 -- start start 2023-09-30T22:31:18.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.768+0000 7f4f819bb700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4f7c09d920 0x7f4f7c070c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.768+0000 7f4f819bb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f7c09e400 0x7f4f7c071140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.768+0000 7f4f819bb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f7c136230 0x7f4f7c1c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.768+0000 7f4f819bb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c131980 con 0x7f4f7c09e400 2023-09-30T22:31:18.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.768+0000 7f4f819bb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c0a3ab0 con 0x7f4f7c136230 2023-09-30T22:31:18.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.768+0000 7f4f819bb700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c09cb00 con 0x7f4f7c09d920 2023-09-30T22:31:18.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.768+0000 7f4f7b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f7c136230 0x7f4f7c1c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.768+0000 7f4f7affd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4f7c09d920 0x7f4f7c070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.768+0000 7f4f7b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f7c136230 0x7f4f7c1c5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41812/0 (socket says 172.21.15.40:41812) 2023-09-30T22:31:18.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.768+0000 7f4f7affd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4f7c09d920 0x7f4f7c070c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48480/0 (socket says 172.21.15.40:48480) 2023-09-30T22:31:18.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.768+0000 7f4f7b7fe700 1 -- 172.21.15.40:0/83861200 learned_addr learned my addr 172.21.15.40:0/83861200 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:18.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.769+0000 7f4f7affd700 1 -- 172.21.15.40:0/83861200 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f7c136230 msgr2=0x7f4f7c1c5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.769+0000 7f4f7affd700 1 --2- 172.21.15.40:0/83861200 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f7c136230 0x7f4f7c1c5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.769+0000 7f4f7affd700 1 -- 172.21.15.40:0/83861200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f7c09e400 msgr2=0x7f4f7c071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.769+0000 7f4f7affd700 1 --2- 172.21.15.40:0/83861200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f7c09e400 0x7f4f7c071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.769+0000 7f4f7affd700 1 -- 172.21.15.40:0/83861200 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f74009a70 con 0x7f4f7c09d920 2023-09-30T22:31:18.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.769+0000 7f4f7b7fe700 1 --2- 172.21.15.40:0/83861200 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f7c136230 0x7f4f7c1c5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:18.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.769+0000 7f4f7affd700 1 --2- 172.21.15.40:0/83861200 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4f7c09d920 0x7f4f7c070c00 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c00c730 tx=0x7f4f6c00ca40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:18.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.769+0000 7f4f63fff700 1 -- 172.21.15.40:0/83861200 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c0074e0 con 0x7f4f7c09d920 2023-09-30T22:31:18.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.769+0000 7f4f63fff700 1 -- 172.21.15.40:0/83861200 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f6c007640 con 0x7f4f7c09d920 2023-09-30T22:31:18.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.769+0000 7f4f819bb700 1 -- 172.21.15.40:0/83861200 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f7c130d10 con 0x7f4f7c09d920 2023-09-30T22:31:18.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.769+0000 7f4f819bb700 1 -- 172.21.15.40:0/83861200 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f7c0704e0 con 0x7f4f7c09d920 2023-09-30T22:31:18.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.769+0000 7f4f63fff700 1 -- 172.21.15.40:0/83861200 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c005a50 con 0x7f4f7c09d920 2023-09-30T22:31:18.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.770+0000 7f4f63fff700 1 -- 172.21.15.40:0/83861200 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4f6c005bb0 con 0x7f4f7c09d920 2023-09-30T22:31:18.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.770+0000 7f4f63fff700 1 -- 172.21.15.40:0/83861200 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4f6c040b40 con 0x7f4f7c09d920 2023-09-30T22:31:18.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.771+0000 7f4f819bb700 1 -- 172.21.15.40:0/83861200 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f7c062380 con 0x7f4f7c09d920 2023-09-30T22:31:18.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.780+0000 7f4f63fff700 1 -- 172.21.15.40:0/83861200 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4f6c017070 con 0x7f4f7c09d920 2023-09-30T22:31:18.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.805+0000 7fbfd8a8a700 1 Processor -- start 2023-09-30T22:31:18.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.805+0000 7fbfd8a8a700 1 -- start start 2023-09-30T22:31:18.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.806+0000 7fbfd8a8a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbfd4138250 0x7fbfd4138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.806+0000 7fbfd8a8a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfd409df20 0x7fbfd4140160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.806+0000 7fbfd8a8a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd4137e20 con 0x7fbfd409d400 2023-09-30T22:31:18.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.806+0000 7fbfd8a8a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd4138050 con 0x7fbfd409df20 2023-09-30T22:31:18.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.806+0000 7fbfd8a8a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd409b010 con 0x7fbfd4138250 2023-09-30T22:31:18.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.806+0000 7fbfd1d9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbfd409d400 0x7fbfd409d810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53114/0 (socket says 172.21.15.40:53114) 2023-09-30T22:31:18.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.806+0000 7fbfd1d9b700 1 -- 172.21.15.40:0/2412274803 learned_addr learned my addr 172.21.15.40:0/2412274803 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:18.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.806+0000 7fbfd259c700 1 --2- 172.21.15.40:0/2412274803 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbfd4138250 0x7fbfd4138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.806+0000 7fbfd2d9d700 1 --2- 172.21.15.40:0/2412274803 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfd409df20 0x7fbfd4140160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.806+0000 7fbfd159a700 1 -- 172.21.15.40:0/2412274803 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2477606271 0 0) 0x7fbfd4137e20 con 0x7fbfd409d400 2023-09-30T22:31:18.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.806+0000 7fbfd159a700 1 -- 172.21.15.40:0/2412274803 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfbc0035b0 con 0x7fbfd409d400 2023-09-30T22:31:18.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.807+0000 7fbfd259c700 1 -- 172.21.15.40:0/2412274803 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfd409df20 msgr2=0x7fbfd4140160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:18.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.807+0000 7fbfd259c700 1 --2- 172.21.15.40:0/2412274803 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfd409df20 0x7fbfd4140160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.807+0000 7fbfd259c700 1 -- 172.21.15.40:0/2412274803 >> v1:172.21.15.40:6789/0 conn(0x7fbfd409d400 legacy=0x7fbfd409d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.807+0000 7fbfd259c700 1 -- 172.21.15.40:0/2412274803 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd409f1f0 con 0x7fbfd4138250 2023-09-30T22:31:18.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.807+0000 7fbfd2d9d700 1 --2- 172.21.15.40:0/2412274803 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfd409df20 0x7fbfd4140160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:18.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.807+0000 7fbfd259c700 1 --2- 172.21.15.40:0/2412274803 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbfd4138250 0x7fbfd4138620 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4009870 tx=0x7fbfc4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4060b71799a73bed server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:18.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.807+0000 7fbfd159a700 1 -- 172.21.15.40:0/2412274803 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4011830 con 0x7fbfd4138250 2023-09-30T22:31:18.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.807+0000 7fbfd159a700 1 -- 172.21.15.40:0/2412274803 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc4011990 con 0x7fbfd4138250 2023-09-30T22:31:18.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.807+0000 7fbfd159a700 1 -- 172.21.15.40:0/2412274803 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4011d00 con 0x7fbfd4138250 2023-09-30T22:31:18.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.808+0000 7fbfd8a8a700 1 -- 172.21.15.40:0/2412274803 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbfd4138250 msgr2=0x7fbfd4138620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.808+0000 7fbfd8a8a700 1 --2- 172.21.15.40:0/2412274803 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbfd4138250 0x7fbfd4138620 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4009870 tx=0x7fbfc4009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:18.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.808+0000 7fbfd8a8a700 1 -- 172.21.15.40:0/2412274803 shutdown_connections 2023-09-30T22:31:18.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.808+0000 7fbfd8a8a700 1 --2- 172.21.15.40:0/2412274803 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfd409df20 0x7fbfd4140160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.808+0000 7fbfd8a8a700 1 --2- 172.21.15.40:0/2412274803 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbfd4138250 0x7fbfd4138620 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.808+0000 7fbfd8a8a700 1 -- 172.21.15.40:0/2412274803 >> 172.21.15.40:0/2412274803 conn(0x7fbfd40a2a00 msgr2=0x7fbfd40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:18.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.808+0000 7fbfd8a8a700 1 -- 172.21.15.40:0/2412274803 shutdown_connections 2023-09-30T22:31:18.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.808+0000 7fbfd8a8a700 1 -- 172.21.15.40:0/2412274803 wait complete. 2023-09-30T22:31:18.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.809+0000 7fbfd8a8a700 1 Processor -- start 2023-09-30T22:31:18.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.809+0000 7fbfd8a8a700 1 -- start start 2023-09-30T22:31:18.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.809+0000 7fbfd8a8a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfd409d400 0x7fbfd41c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.809+0000 7fbfd8a8a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfd409df20 0x7fbfd41c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.809+0000 7fbfd8a8a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbfd4138250 0x7fbfd41cc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.809+0000 7fbfd8a8a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd4125340 con 0x7fbfd409df20 2023-09-30T22:31:18.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.809+0000 7fbfd8a8a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd41ca1a0 con 0x7fbfd409d400 2023-09-30T22:31:18.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.809+0000 7fbfd8a8a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd4123bc0 con 0x7fbfd4138250 2023-09-30T22:31:18.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.810+0000 7fbfd259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfd409d400 0x7fbfd41c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.810+0000 7fbfd259c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfd409d400 0x7fbfd41c9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41830/0 (socket says 172.21.15.40:41830) 2023-09-30T22:31:18.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.810+0000 7fbfd259c700 1 -- 172.21.15.40:0/1452797263 learned_addr learned my addr 172.21.15.40:0/1452797263 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:18.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.810+0000 7fbfd1d9b700 1 --2- 172.21.15.40:0/1452797263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfd409df20 0x7fbfd41c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.810+0000 7fbfd2d9d700 1 --2- 172.21.15.40:0/1452797263 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbfd4138250 0x7fbfd41cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.810+0000 7fbfd259c700 1 -- 172.21.15.40:0/1452797263 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbfd4138250 msgr2=0x7fbfd41cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.810+0000 7fbfd259c700 1 --2- 172.21.15.40:0/1452797263 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbfd4138250 0x7fbfd41cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.810+0000 7fbfd259c700 1 -- 172.21.15.40:0/1452797263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfd409df20 msgr2=0x7fbfd41c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.810+0000 7fbfd259c700 1 --2- 172.21.15.40:0/1452797263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfd409df20 0x7fbfd41c9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.810+0000 7fbfd259c700 1 -- 172.21.15.40:0/1452797263 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfcc009a70 con 0x7fbfd409d400 2023-09-30T22:31:18.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.810+0000 7fbfd259c700 1 --2- 172.21.15.40:0/1452797263 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfd409d400 0x7fbfd41c9720 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4000c00 tx=0x7fbfc4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:18.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.810+0000 7fbfc2ffd700 1 -- 172.21.15.40:0/1452797263 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4004550 con 0x7fbfd409d400 2023-09-30T22:31:18.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.810+0000 7fbfc2ffd700 1 -- 172.21.15.40:0/1452797263 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc401f070 con 0x7fbfd409d400 2023-09-30T22:31:18.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.810+0000 7fbfc2ffd700 1 -- 172.21.15.40:0/1452797263 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc40038e0 con 0x7fbfd409d400 2023-09-30T22:31:18.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.811+0000 7fbfd8a8a700 1 -- 172.21.15.40:0/1452797263 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc40094a0 con 0x7fbfd409d400 2023-09-30T22:31:18.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.811+0000 7fbfd8a8a700 1 -- 172.21.15.40:0/1452797263 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd409a300 con 0x7fbfd409d400 2023-09-30T22:31:18.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.812+0000 7fbfd8a8a700 1 -- 172.21.15.40:0/1452797263 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfd4062380 con 0x7fbfd409d400 2023-09-30T22:31:18.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.812+0000 7fbfc2ffd700 1 -- 172.21.15.40:0/1452797263 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbfc4003a40 con 0x7fbfd409d400 2023-09-30T22:31:18.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.812+0000 7fbfc2ffd700 1 -- 172.21.15.40:0/1452797263 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fbfc4021070 con 0x7fbfd409d400 2023-09-30T22:31:18.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.821+0000 7fbfc2ffd700 1 -- 172.21.15.40:0/1452797263 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbfc4010380 con 0x7fbfd409d400 2023-09-30T22:31:18.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.851+0000 7fe8970ee700 1 Processor -- start 2023-09-30T22:31:18.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.851+0000 7fe8970ee700 1 -- start start 2023-09-30T22:31:18.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.852+0000 7fe8970ee700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe89013b130 0x7fe89013d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.852+0000 7fe8970ee700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe89013da50 0x7fe89013fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.852+0000 7fe8970ee700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe890137e20 con 0x7fe890138250 2023-09-30T22:31:18.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.852+0000 7fe8970ee700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe890138d30 con 0x7fe89013b130 2023-09-30T22:31:18.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.852+0000 7fe8970ee700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe890138050 con 0x7fe89013da50 2023-09-30T22:31:18.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.852+0000 7fe88ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe89013b130 0x7fe89013d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.852+0000 7fe88ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe89013b130 0x7fe89013d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51706/0 (socket says 172.21.15.40:51706) 2023-09-30T22:31:18.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.852+0000 7fe88ffff700 1 -- 172.21.15.40:0/1015917722 learned_addr learned my addr 172.21.15.40:0/1015917722 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:18.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.852+0000 7fe89568b700 1 --2- 172.21.15.40:0/1015917722 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe89013da50 0x7fe89013fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.852+0000 7fe88ffff700 1 -- 172.21.15.40:0/1015917722 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe89013da50 msgr2=0x7fe89013fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:18.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.852+0000 7fe88ffff700 1 --2- 172.21.15.40:0/1015917722 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe89013da50 0x7fe89013fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.852+0000 7fe88ffff700 1 -- 172.21.15.40:0/1015917722 >> v1:172.21.15.40:6789/0 conn(0x7fe890138250 legacy=0x7fe890138620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:18.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.852+0000 7fe88ffff700 1 -- 172.21.15.40:0/1015917722 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89009b010 con 0x7fe89013b130 2023-09-30T22:31:18.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.853+0000 7fe89568b700 1 --2- 172.21.15.40:0/1015917722 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe89013da50 0x7fe89013fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:18.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.853+0000 7fe88ffff700 1 --2- 172.21.15.40:0/1015917722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe89013b130 0x7fe89013d510 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fe87c0098f0 tx=0x7fe87c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77d932fb49e13261 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:18.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.853+0000 7fe88f7fe700 1 -- 172.21.15.40:0/1015917722 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c004230 con 0x7fe89013b130 2023-09-30T22:31:18.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.853+0000 7fe88f7fe700 1 -- 172.21.15.40:0/1015917722 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87c004390 con 0x7fe89013b130 2023-09-30T22:31:18.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.853+0000 7fe88f7fe700 1 -- 172.21.15.40:0/1015917722 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c0036a0 con 0x7fe89013b130 2023-09-30T22:31:18.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.853+0000 7fe8970ee700 1 -- 172.21.15.40:0/1015917722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe89013b130 msgr2=0x7fe89013d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.853+0000 7fe8970ee700 1 --2- 172.21.15.40:0/1015917722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe89013b130 0x7fe89013d510 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fe87c0098f0 tx=0x7fe87c009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:18.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.854+0000 7fe8970ee700 1 -- 172.21.15.40:0/1015917722 shutdown_connections 2023-09-30T22:31:18.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.854+0000 7fe8970ee700 1 --2- 172.21.15.40:0/1015917722 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe89013da50 0x7fe89013fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.854+0000 7fe8970ee700 1 --2- 172.21.15.40:0/1015917722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe89013b130 0x7fe89013d510 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.854+0000 7fe8970ee700 1 -- 172.21.15.40:0/1015917722 >> 172.21.15.40:0/1015917722 conn(0x7fe8900a2a00 msgr2=0x7fe8900a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:18.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.854+0000 7fe8970ee700 1 -- 172.21.15.40:0/1015917722 shutdown_connections 2023-09-30T22:31:18.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.854+0000 7fe8970ee700 1 -- 172.21.15.40:0/1015917722 wait complete. 2023-09-30T22:31:18.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.855+0000 7fe8970ee700 1 Processor -- start 2023-09-30T22:31:18.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.855+0000 7fe8970ee700 1 -- start start 2023-09-30T22:31:18.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.855+0000 7fe8970ee700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe890138250 0x7fe89006d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.855+0000 7fe8970ee700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe89013b130 0x7fe89006db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.855+0000 7fe8970ee700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe89013da50 0x7fe89006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.855+0000 7fe8970ee700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89006eab0 con 0x7fe89013da50 2023-09-30T22:31:18.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.855+0000 7fe8970ee700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89006f250 con 0x7fe89013b130 2023-09-30T22:31:18.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.855+0000 7fe8970ee700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe890140f50 con 0x7fe890138250 2023-09-30T22:31:18.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.855+0000 7fe88ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe89013b130 0x7fe89006db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.855+0000 7fe88ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe89013b130 0x7fe89006db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41852/0 (socket says 172.21.15.40:41852) 2023-09-30T22:31:18.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.855+0000 7fe88ffff700 1 -- 172.21.15.40:0/261611331 learned_addr learned my addr 172.21.15.40:0/261611331 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:18.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.855+0000 7fe89568b700 1 --2- 172.21.15.40:0/261611331 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe89013da50 0x7fe89006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.856+0000 7fe88ffff700 1 -- 172.21.15.40:0/261611331 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe890138250 msgr2=0x7fe89006d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.856+0000 7fe88ffff700 1 --2- 172.21.15.40:0/261611331 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe890138250 0x7fe89006d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.856+0000 7fe88ffff700 1 -- 172.21.15.40:0/261611331 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe89013da50 msgr2=0x7fe89006e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.856+0000 7fe88ffff700 1 --2- 172.21.15.40:0/261611331 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe89013da50 0x7fe89006e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.856+0000 7fe88ffff700 1 -- 172.21.15.40:0/261611331 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe888009a70 con 0x7fe89013b130 2023-09-30T22:31:18.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.856+0000 7fe89568b700 1 --2- 172.21.15.40:0/261611331 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe89013da50 0x7fe89006e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:18.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.856+0000 7fe88ffff700 1 --2- 172.21.15.40:0/261611331 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe89013b130 0x7fe89006db50 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fe890138e70 tx=0x7fe87c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:18.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.856+0000 7fe88d7fa700 1 -- 172.21.15.40:0/261611331 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c003de0 con 0x7fe89013b130 2023-09-30T22:31:18.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.856+0000 7fe88d7fa700 1 -- 172.21.15.40:0/261611331 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87c011630 con 0x7fe89013b130 2023-09-30T22:31:18.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.856+0000 7fe88d7fa700 1 -- 172.21.15.40:0/261611331 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c0119e0 con 0x7fe89013b130 2023-09-30T22:31:18.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.856+0000 7fe8970ee700 1 -- 172.21.15.40:0/261611331 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe87c009550 con 0x7fe89013b130 2023-09-30T22:31:18.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.856+0000 7fe8970ee700 1 -- 172.21.15.40:0/261611331 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe890140c90 con 0x7fe89013b130 2023-09-30T22:31:18.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.857+0000 7fe88d7fa700 1 -- 172.21.15.40:0/261611331 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe87c021070 con 0x7fe89013b130 2023-09-30T22:31:18.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.857+0000 7fe8970ee700 1 -- 172.21.15.40:0/261611331 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe890062380 con 0x7fe89013b130 2023-09-30T22:31:18.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.858+0000 7fe88d7fa700 1 -- 172.21.15.40:0/261611331 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe87c040f30 con 0x7fe89013b130 2023-09-30T22:31:18.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.866+0000 7fe88d7fa700 1 -- 172.21.15.40:0/261611331 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe87c072750 con 0x7fe89013b130 2023-09-30T22:31:18.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.940+0000 7f23e8ebd700 1 -- 172.21.15.40:0/2405803999 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f23e4071180 con 0x7f23e409e5f0 2023-09-30T22:31:18.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.941+0000 7f23d2ffd700 1 -- 172.21.15.40:0/2405803999 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f23dc01a070 con 0x7f23e409e5f0 2023-09-30T22:31:18.942 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:18.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.943+0000 7f23e8ebd700 1 -- 172.21.15.40:0/2405803999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23e409e5f0 msgr2=0x7f23e4137c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.943+0000 7f23e8ebd700 1 --2- 172.21.15.40:0/2405803999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23e409e5f0 0x7f23e4137c50 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f23dc007ef0 tx=0x7f23dc00d3b0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.943+0000 7f23e8ebd700 1 -- 172.21.15.40:0/2405803999 shutdown_connections 2023-09-30T22:31:18.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.943+0000 7f23e8ebd700 1 --2- 172.21.15.40:0/2405803999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23e409e5f0 0x7f23e4137c50 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.943+0000 7f23e8ebd700 1 --2- 172.21.15.40:0/2405803999 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23e4099f90 0x7f23e41371d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.943+0000 7f23e8ebd700 1 --2- 172.21.15.40:0/2405803999 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f23e409da20 0x7f23e4137710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.943+0000 7f23e8ebd700 1 -- 172.21.15.40:0/2405803999 >> 172.21.15.40:0/2405803999 conn(0x7f23e409eb10 msgr2=0x7f23e406e150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:18.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.943+0000 7f23e8ebd700 1 -- 172.21.15.40:0/2405803999 shutdown_connections 2023-09-30T22:31:18.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.943+0000 7f23e8ebd700 1 -- 172.21.15.40:0/2405803999 wait complete. 2023-09-30T22:31:18.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:18.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.996+0000 7f4f819bb700 1 -- 172.21.15.40:0/83861200 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4f7c074720 con 0x7f4f7c09d920 2023-09-30T22:31:18.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.997+0000 7f4f63fff700 1 -- 172.21.15.40:0/83861200 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4f6c017020 con 0x7f4f7c09d920 2023-09-30T22:31:18.997 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:19.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.999+0000 7f4f819bb700 1 -- 172.21.15.40:0/83861200 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4f7c09d920 msgr2=0x7f4f7c070c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:19.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.999+0000 7f4f819bb700 1 --2- 172.21.15.40:0/83861200 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4f7c09d920 0x7f4f7c070c00 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c00c730 tx=0x7f4f6c00ca40 comp rx=0 tx=0).stop 2023-09-30T22:31:19.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.999+0000 7f4f819bb700 1 -- 172.21.15.40:0/83861200 shutdown_connections 2023-09-30T22:31:19.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.999+0000 7f4f819bb700 1 --2- 172.21.15.40:0/83861200 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4f7c09d920 0x7f4f7c070c00 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.999+0000 7f4f819bb700 1 --2- 172.21.15.40:0/83861200 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f7c136230 0x7f4f7c1c5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.999+0000 7f4f819bb700 1 --2- 172.21.15.40:0/83861200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f7c09e400 0x7f4f7c071140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.999+0000 7f4f819bb700 1 -- 172.21.15.40:0/83861200 >> 172.21.15.40:0/83861200 conn(0x7f4f7c09fb20 msgr2=0x7f4f7c12ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:19.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.999+0000 7f4f819bb700 1 -- 172.21.15.40:0/83861200 shutdown_connections 2023-09-30T22:31:19.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:18.999+0000 7f4f819bb700 1 -- 172.21.15.40:0/83861200 wait complete. 2023-09-30T22:31:19.012 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:19.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:19.022+0000 7fbfd8a8a700 1 -- 172.21.15.40:0/1452797263 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbfd4124e10 con 0x7fbfd409d400 2023-09-30T22:31:19.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:19.022+0000 7fbfc2ffd700 1 -- 172.21.15.40:0/1452797263 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbfc4015070 con 0x7fbfd409d400 2023-09-30T22:31:19.023 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:19.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:19.025+0000 7fbfd8a8a700 1 -- 172.21.15.40:0/1452797263 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfd409d400 msgr2=0x7fbfd41c9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:19.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:19.025+0000 7fbfd8a8a700 1 --2- 172.21.15.40:0/1452797263 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfd409d400 0x7fbfd41c9720 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4000c00 tx=0x7fbfc4004750 comp rx=0 tx=0).stop 2023-09-30T22:31:19.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:19.025+0000 7fbfd8a8a700 1 -- 172.21.15.40:0/1452797263 shutdown_connections 2023-09-30T22:31:19.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:19.025+0000 7fbfd8a8a700 1 --2- 172.21.15.40:0/1452797263 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbfd4138250 0x7fbfd41cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:19.025+0000 7fbfd8a8a700 1 --2- 172.21.15.40:0/1452797263 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfd409d400 0x7fbfd41c9720 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:19.025+0000 7fbfd8a8a700 1 --2- 172.21.15.40:0/1452797263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfd409df20 0x7fbfd41c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:19.025+0000 7fbfd8a8a700 1 -- 172.21.15.40:0/1452797263 >> 172.21.15.40:0/1452797263 conn(0x7fbfd40a2a00 msgr2=0x7fbfd41bf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:19.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:19.025+0000 7fbfd8a8a700 1 -- 172.21.15.40:0/1452797263 shutdown_connections 2023-09-30T22:31:19.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:19.025+0000 7fbfd8a8a700 1 -- 172.21.15.40:0/1452797263 wait complete. 2023-09-30T22:31:19.038 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:19.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:19.075+0000 7fe8970ee700 1 -- 172.21.15.40:0/261611331 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe89009abb0 con 0x7fe89013b130 2023-09-30T22:31:19.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:19.076+0000 7fe88d7fa700 1 -- 172.21.15.40:0/261611331 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe87c029030 con 0x7fe89013b130 2023-09-30T22:31:19.076 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:19.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:19.078+0000 7fe8970ee700 1 -- 172.21.15.40:0/261611331 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe89013b130 msgr2=0x7fe89006db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:19.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:19.078+0000 7fe8970ee700 1 --2- 172.21.15.40:0/261611331 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe89013b130 0x7fe89006db50 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fe890138e70 tx=0x7fe87c004750 comp rx=0 tx=0).stop 2023-09-30T22:31:19.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:19.078+0000 7fe8970ee700 1 -- 172.21.15.40:0/261611331 shutdown_connections 2023-09-30T22:31:19.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:19.078+0000 7fe8970ee700 1 --2- 172.21.15.40:0/261611331 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe890138250 0x7fe89006d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:19.078+0000 7fe8970ee700 1 --2- 172.21.15.40:0/261611331 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe89013da50 0x7fe89006e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:19.078+0000 7fe8970ee700 1 --2- 172.21.15.40:0/261611331 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe89013b130 0x7fe89006db50 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:19.078+0000 7fe8970ee700 1 -- 172.21.15.40:0/261611331 >> 172.21.15.40:0/261611331 conn(0x7fe8900a2a00 msgr2=0x7fe89009d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:19.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:19.078+0000 7fe8970ee700 1 -- 172.21.15.40:0/261611331 shutdown_connections 2023-09-30T22:31:19.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:19.078+0000 7fe8970ee700 1 -- 172.21.15.40:0/261611331 wait complete. 2023-09-30T22:31:19.090 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:19.957 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:20.013 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:20.038 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:20.091 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:20.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.101+0000 7fe02b272700 1 Processor -- start 2023-09-30T22:31:20.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.101+0000 7fe02b272700 1 -- start start 2023-09-30T22:31:20.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.102+0000 7fe02b272700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe02409f0f0 0x7fe024138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:20.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.102+0000 7fe02b272700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe02409e400 0x7fe02413b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:20.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.102+0000 7fe02b272700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe02409f940 con 0x7fe02409d920 2023-09-30T22:31:20.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.102+0000 7fe02b272700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe02406b4c0 con 0x7fe02409e400 2023-09-30T22:31:20.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.102+0000 7fe02b272700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe02409a8f0 con 0x7fe02409f0f0 2023-09-30T22:31:20.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.102+0000 7fe02980f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe02409e400 0x7fe02413b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:20.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.102+0000 7fe02980f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe02409e400 0x7fe02413b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51718/0 (socket says 172.21.15.40:51718) 2023-09-30T22:31:20.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.102+0000 7fe02980f700 1 -- 172.21.15.40:0/415908912 learned_addr learned my addr 172.21.15.40:0/415908912 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:20.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.103+0000 7fe02980f700 1 -- 172.21.15.40:0/415908912 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe02409f0f0 msgr2=0x7fe024138ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:20.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.103+0000 7fe02980f700 1 --2- 172.21.15.40:0/415908912 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe02409f0f0 0x7fe024138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.103+0000 7fe02980f700 1 -- 172.21.15.40:0/415908912 >> v1:172.21.15.40:6789/0 conn(0x7fe02409d920 legacy=0x7fe02409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:20.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.103+0000 7fe02980f700 1 -- 172.21.15.40:0/415908912 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe02409f6e0 con 0x7fe02409e400 2023-09-30T22:31:20.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.103+0000 7fe02980f700 1 --2- 172.21.15.40:0/415908912 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe02409e400 0x7fe02413b430 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fe01c009e80 tx=0x7fe01c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=770c60a03f07d241 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:20.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.103+0000 7fe01bfff700 1 -- 172.21.15.40:0/415908912 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01c00e070 con 0x7fe02409e400 2023-09-30T22:31:20.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.103+0000 7fe01bfff700 1 -- 172.21.15.40:0/415908912 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe01c00b980 con 0x7fe02409e400 2023-09-30T22:31:20.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.103+0000 7fe01bfff700 1 -- 172.21.15.40:0/415908912 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01c00bd30 con 0x7fe02409e400 2023-09-30T22:31:20.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.104+0000 7fe02b272700 1 -- 172.21.15.40:0/415908912 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe02409e400 msgr2=0x7fe02413b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:20.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.104+0000 7fe02b272700 1 --2- 172.21.15.40:0/415908912 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe02409e400 0x7fe02413b430 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fe01c009e80 tx=0x7fe01c00b330 comp rx=0 tx=0).stop 2023-09-30T22:31:20.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.104+0000 7fe02b272700 1 -- 172.21.15.40:0/415908912 shutdown_connections 2023-09-30T22:31:20.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.104+0000 7fe02b272700 1 --2- 172.21.15.40:0/415908912 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe02409e400 0x7fe02413b430 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.104+0000 7fe02b272700 1 --2- 172.21.15.40:0/415908912 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe02409f0f0 0x7fe024138ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.104+0000 7fe02b272700 1 -- 172.21.15.40:0/415908912 >> 172.21.15.40:0/415908912 conn(0x7fe02409fb20 msgr2=0x7fe02409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:20.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.104+0000 7fe02b272700 1 -- 172.21.15.40:0/415908912 shutdown_connections 2023-09-30T22:31:20.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.104+0000 7fe02b272700 1 -- 172.21.15.40:0/415908912 wait complete. 2023-09-30T22:31:20.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.105+0000 7fe02b272700 1 Processor -- start 2023-09-30T22:31:20.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.105+0000 7fe02b272700 1 -- start start 2023-09-30T22:31:20.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.105+0000 7fe02b272700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe02409d920 0x7fe02411e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:20.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.105+0000 7fe02b272700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe02409e400 0x7fe02411edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:20.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.105+0000 7fe02b272700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe02411f2f0 0x7fe0241ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:20.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.105+0000 7fe02b272700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02411f720 con 0x7fe02411f2f0 2023-09-30T22:31:20.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.105+0000 7fe02b272700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe024120480 con 0x7fe02409e400 2023-09-30T22:31:20.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.105+0000 7fe02b272700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe024120ce0 con 0x7fe02409d920 2023-09-30T22:31:20.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.106+0000 7fe02880d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe02409e400 0x7fe02411edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:20.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.106+0000 7fe02880d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe02409e400 0x7fe02411edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41856/0 (socket says 172.21.15.40:41856) 2023-09-30T22:31:20.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.106+0000 7fe02880d700 1 -- 172.21.15.40:0/1931645447 learned_addr learned my addr 172.21.15.40:0/1931645447 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:20.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.106+0000 7fe02900e700 1 --2- 172.21.15.40:0/1931645447 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe02409d920 0x7fe02411e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:20.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.106+0000 7fe02880d700 1 -- 172.21.15.40:0/1931645447 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe02409d920 msgr2=0x7fe02411e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:20.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.106+0000 7fe02880d700 1 --2- 172.21.15.40:0/1931645447 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe02409d920 0x7fe02411e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.106+0000 7fe02880d700 1 -- 172.21.15.40:0/1931645447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe02411f2f0 msgr2=0x7fe0241ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:20.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.106+0000 7fe02880d700 1 --2- 172.21.15.40:0/1931645447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe02411f2f0 0x7fe0241ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.106+0000 7fe02880d700 1 -- 172.21.15.40:0/1931645447 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01c009b30 con 0x7fe02409e400 2023-09-30T22:31:20.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.106+0000 7fe02900e700 1 --2- 172.21.15.40:0/1931645447 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe02409d920 0x7fe02411e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:20.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.106+0000 7fe02880d700 1 --2- 172.21.15.40:0/1931645447 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe02409e400 0x7fe02411edb0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fe01400b560 tx=0x7fe01400b920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:20.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.106+0000 7fe019ffb700 1 -- 172.21.15.40:0/1931645447 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe014011830 con 0x7fe02409e400 2023-09-30T22:31:20.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.106+0000 7fe019ffb700 1 -- 172.21.15.40:0/1931645447 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe014011990 con 0x7fe02409e400 2023-09-30T22:31:20.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.106+0000 7fe02b272700 1 -- 172.21.15.40:0/1931645447 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0241220b0 con 0x7fe02409e400 2023-09-30T22:31:20.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.106+0000 7fe019ffb700 1 -- 172.21.15.40:0/1931645447 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe014011d40 con 0x7fe02409e400 2023-09-30T22:31:20.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.107+0000 7fe02b272700 1 -- 172.21.15.40:0/1931645447 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe024121b70 con 0x7fe02409e400 2023-09-30T22:31:20.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.108+0000 7fe02b272700 1 -- 172.21.15.40:0/1931645447 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe024062380 con 0x7fe02409e400 2023-09-30T22:31:20.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.109+0000 7fe019ffb700 1 -- 172.21.15.40:0/1931645447 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe01401a400 con 0x7fe02409e400 2023-09-30T22:31:20.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.109+0000 7fe019ffb700 1 -- 172.21.15.40:0/1931645447 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe01403fe00 con 0x7fe02409e400 2023-09-30T22:31:20.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.114+0000 7fe019ffb700 1 -- 172.21.15.40:0/1931645447 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe01401ae60 con 0x7fe02409e400 2023-09-30T22:31:20.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.156+0000 7fbc3965f700 1 Processor -- start 2023-09-30T22:31:20.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.156+0000 7fbc3965f700 1 -- start start 2023-09-30T22:31:20.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.156+0000 7fbc3965f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc3409c890 0x7fbc3409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:20.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.156+0000 7fbc3965f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc3409d920 0x7fbc3409dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:20.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.156+0000 7fbc3965f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbc3409e2b0 0x7fbc3413ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:20.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.156+0000 7fbc3965f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc340a29d0 con 0x7fbc3409e2b0 2023-09-30T22:31:20.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.156+0000 7fbc3965f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3409fb40 con 0x7fbc3409d920 2023-09-30T22:31:20.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.156+0000 7fbc3965f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc340a2600 con 0x7fbc3409c890 2023-09-30T22:31:20.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.156+0000 7fbc32ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc3409c890 0x7fbc3409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:20.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.156+0000 7fbc32ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc3409c890 0x7fbc3409cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48520/0 (socket says 172.21.15.40:48520) 2023-09-30T22:31:20.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.157+0000 7fbc32ffd700 1 -- 172.21.15.40:0/206583802 learned_addr learned my addr 172.21.15.40:0/206583802 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:20.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.157+0000 7fbc337fe700 1 --2- 172.21.15.40:0/206583802 >> v2:172.21.15.40:3300/0 conn(0x7fbc3409e2b0 0x7fbc3413ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:20.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.157+0000 7fbc327fc700 1 --2- 172.21.15.40:0/206583802 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc3409d920 0x7fbc3409dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:20.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.157+0000 7fbc32ffd700 1 -- 172.21.15.40:0/206583802 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc3409d920 msgr2=0x7fbc3409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:20.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.157+0000 7fbc32ffd700 1 --2- 172.21.15.40:0/206583802 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc3409d920 0x7fbc3409dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.157+0000 7fbc32ffd700 1 -- 172.21.15.40:0/206583802 >> v2:172.21.15.40:3300/0 conn(0x7fbc3409e2b0 msgr2=0x7fbc3413ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:20.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.157+0000 7fbc32ffd700 1 --2- 172.21.15.40:0/206583802 >> v2:172.21.15.40:3300/0 conn(0x7fbc3409e2b0 0x7fbc3413ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.157+0000 7fbc32ffd700 1 -- 172.21.15.40:0/206583802 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3409e720 con 0x7fbc3409c890 2023-09-30T22:31:20.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.157+0000 7fbc32ffd700 1 --2- 172.21.15.40:0/206583802 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc3409c890 0x7fbc3409cc60 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fbc24006fd0 tx=0x7fbc24009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4714946413e3606a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:20.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.157+0000 7fbc31ffb700 1 -- 172.21.15.40:0/206583802 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc24005e30 con 0x7fbc3409c890 2023-09-30T22:31:20.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.157+0000 7fbc31ffb700 1 -- 172.21.15.40:0/206583802 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc24004030 con 0x7fbc3409c890 2023-09-30T22:31:20.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.157+0000 7fbc31ffb700 1 -- 172.21.15.40:0/206583802 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc240043e0 con 0x7fbc3409c890 2023-09-30T22:31:20.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.158+0000 7fbc3965f700 1 -- 172.21.15.40:0/206583802 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc3409c890 msgr2=0x7fbc3409cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:20.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.158+0000 7fbc3965f700 1 --2- 172.21.15.40:0/206583802 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc3409c890 0x7fbc3409cc60 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fbc24006fd0 tx=0x7fbc24009bd0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.158+0000 7fbc3965f700 1 -- 172.21.15.40:0/206583802 shutdown_connections 2023-09-30T22:31:20.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.158+0000 7fbc3965f700 1 --2- 172.21.15.40:0/206583802 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc3409c890 0x7fbc3409cc60 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.158+0000 7fbc3965f700 1 --2- 172.21.15.40:0/206583802 >> v2:172.21.15.40:3300/0 conn(0x7fbc3409e2b0 0x7fbc3413ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.158+0000 7fbc3965f700 1 --2- 172.21.15.40:0/206583802 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc3409d920 0x7fbc3409dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.158+0000 7fbc3965f700 1 -- 172.21.15.40:0/206583802 >> 172.21.15.40:0/206583802 conn(0x7fbc340a7080 msgr2=0x7fbc340a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:20.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.158+0000 7fbc3965f700 1 -- 172.21.15.40:0/206583802 shutdown_connections 2023-09-30T22:31:20.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.158+0000 7fbc3965f700 1 -- 172.21.15.40:0/206583802 wait complete. 2023-09-30T22:31:20.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.159+0000 7fbc3965f700 1 Processor -- start 2023-09-30T22:31:20.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.160+0000 7fbc3965f700 1 -- start start 2023-09-30T22:31:20.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.160+0000 7fbc3965f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc3409c890 0x7fbc3412d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:20.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.160+0000 7fbc3965f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc3409d920 0x7fbc3412ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:20.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.160+0000 7fbc3965f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc3409e2b0 0x7fbc3412e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:20.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.160+0000 7fbc3965f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc341315c0 con 0x7fbc3409e2b0 2023-09-30T22:31:20.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.160+0000 7fbc3965f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc34130cb0 con 0x7fbc3409d920 2023-09-30T22:31:20.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.160+0000 7fbc3965f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3409ecf0 con 0x7fbc3409c890 2023-09-30T22:31:20.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.160+0000 7fbc327fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc3409d920 0x7fbc3412ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:20.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.160+0000 7fbc327fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc3409d920 0x7fbc3412ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41866/0 (socket says 172.21.15.40:41866) 2023-09-30T22:31:20.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.160+0000 7fbc327fc700 1 -- 172.21.15.40:0/1905549968 learned_addr learned my addr 172.21.15.40:0/1905549968 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:20.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.160+0000 7fbc32ffd700 1 --2- 172.21.15.40:0/1905549968 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc3409c890 0x7fbc3412d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:20.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.160+0000 7fbc337fe700 1 --2- 172.21.15.40:0/1905549968 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc3409e2b0 0x7fbc3412e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:20.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.161+0000 7fbc327fc700 1 -- 172.21.15.40:0/1905549968 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc3409c890 msgr2=0x7fbc3412d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:20.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.161+0000 7fbc327fc700 1 --2- 172.21.15.40:0/1905549968 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc3409c890 0x7fbc3412d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.161+0000 7fbc327fc700 1 -- 172.21.15.40:0/1905549968 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc3409e2b0 msgr2=0x7fbc3412e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:20.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.161+0000 7fbc327fc700 1 --2- 172.21.15.40:0/1905549968 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc3409e2b0 0x7fbc3412e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.161+0000 7fbc327fc700 1 -- 172.21.15.40:0/1905549968 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc24009500 con 0x7fbc3409d920 2023-09-30T22:31:20.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.161+0000 7fbc337fe700 1 --2- 172.21.15.40:0/1905549968 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc3409e2b0 0x7fbc3412e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:20.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.161+0000 7fbc327fc700 1 --2- 172.21.15.40:0/1905549968 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc3409d920 0x7fbc3412ddc0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fbc2800e900 tx=0x7fbc2800ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:20.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.161+0000 7fbc1b7fe700 1 -- 172.21.15.40:0/1905549968 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2800ee50 con 0x7fbc3409d920 2023-09-30T22:31:20.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.161+0000 7fbc1b7fe700 1 -- 172.21.15.40:0/1905549968 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2800c850 con 0x7fbc3409d920 2023-09-30T22:31:20.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.161+0000 7fbc1b7fe700 1 -- 172.21.15.40:0/1905549968 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2800cbe0 con 0x7fbc3409d920 2023-09-30T22:31:20.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.162+0000 7fbc3965f700 1 -- 172.21.15.40:0/1905549968 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc340a5d60 con 0x7fbc3409d920 2023-09-30T22:31:20.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.162+0000 7fbc3965f700 1 -- 172.21.15.40:0/1905549968 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc3409bc80 con 0x7fbc3409d920 2023-09-30T22:31:20.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.163+0000 7fbc1b7fe700 1 -- 172.21.15.40:0/1905549968 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbc2800cd40 con 0x7fbc3409d920 2023-09-30T22:31:20.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.163+0000 7fbc1b7fe700 1 -- 172.21.15.40:0/1905549968 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fbc2803f400 con 0x7fbc3409d920 2023-09-30T22:31:20.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.163+0000 7fbc3965f700 1 -- 172.21.15.40:0/1905549968 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc34062380 con 0x7fbc3409d920 2023-09-30T22:31:20.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.172+0000 7fbc1b7fe700 1 -- 172.21.15.40:0/1905549968 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbc28017020 con 0x7fbc3409d920 2023-09-30T22:31:20.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.197+0000 7f84739ec700 1 Processor -- start 2023-09-30T22:31:20.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.198+0000 7f84739ec700 1 -- start start 2023-09-30T22:31:20.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.198+0000 7f84739ec700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f846c09e030 0x7f846c13d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:20.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.198+0000 7f84739ec700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f846c09e450 0x7f846c13f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:20.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.198+0000 7f84739ec700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f846c11d980 con 0x7f846c06a6d0 2023-09-30T22:31:20.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.198+0000 7f84739ec700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f846c06aaa0 con 0x7f846c09e030 2023-09-30T22:31:20.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.198+0000 7f84739ec700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f846c06b150 con 0x7f846c09e450 2023-09-30T22:31:20.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.198+0000 7f8471788700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f846c06a6d0 0x7f846c09d920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53142/0 (socket says 172.21.15.40:53142) 2023-09-30T22:31:20.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.198+0000 7f8471788700 1 -- 172.21.15.40:0/1740767907 learned_addr learned my addr 172.21.15.40:0/1740767907 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:20.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.198+0000 7f8470f87700 1 --2- 172.21.15.40:0/1740767907 >> v2:172.21.15.40:3300/0 conn(0x7f846c09e030 0x7f846c13d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:20.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.198+0000 7f8471f89700 1 --2- 172.21.15.40:0/1740767907 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f846c09e450 0x7f846c13f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:20.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.199+0000 7f8471f89700 1 -- 172.21.15.40:0/1740767907 >> v2:172.21.15.40:3300/0 conn(0x7f846c09e030 msgr2=0x7f846c13d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:20.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.199+0000 7f8463fff700 1 -- 172.21.15.40:0/1740767907 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2874705665 0 0) 0x7f846c11d980 con 0x7f846c06a6d0 2023-09-30T22:31:20.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.199+0000 7f8471f89700 1 --2- 172.21.15.40:0/1740767907 >> v2:172.21.15.40:3300/0 conn(0x7f846c09e030 0x7f846c13d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.199+0000 7f8471f89700 1 -- 172.21.15.40:0/1740767907 >> v1:172.21.15.40:6789/0 conn(0x7f846c06a6d0 legacy=0x7f846c09d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:20.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.199+0000 7f8471f89700 1 -- 172.21.15.40:0/1740767907 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846c09f300 con 0x7f846c09e450 2023-09-30T22:31:20.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.199+0000 7f8470f87700 1 --2- 172.21.15.40:0/1740767907 >> v2:172.21.15.40:3300/0 conn(0x7f846c09e030 0x7f846c13d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:20.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.199+0000 7f8471f89700 1 --2- 172.21.15.40:0/1740767907 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f846c09e450 0x7f846c13f9f0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f8464009d90 tx=0x7f846400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c1e6f58b3caf20 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:20.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.199+0000 7f8463fff700 1 -- 172.21.15.40:0/1740767907 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846400e070 con 0x7f846c09e450 2023-09-30T22:31:20.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.199+0000 7f8463fff700 1 -- 172.21.15.40:0/1740767907 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846400bb20 con 0x7f846c09e450 2023-09-30T22:31:20.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.199+0000 7f8463fff700 1 -- 172.21.15.40:0/1740767907 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8464012430 con 0x7f846c09e450 2023-09-30T22:31:20.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.200+0000 7f84739ec700 1 -- 172.21.15.40:0/1740767907 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f846c09e450 msgr2=0x7f846c13f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:20.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.200+0000 7f84739ec700 1 --2- 172.21.15.40:0/1740767907 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f846c09e450 0x7f846c13f9f0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f8464009d90 tx=0x7f846400b330 comp rx=0 tx=0).stop 2023-09-30T22:31:20.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.200+0000 7f84739ec700 1 -- 172.21.15.40:0/1740767907 shutdown_connections 2023-09-30T22:31:20.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.200+0000 7f84739ec700 1 --2- 172.21.15.40:0/1740767907 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f846c09e450 0x7f846c13f9f0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.200+0000 7f84739ec700 1 --2- 172.21.15.40:0/1740767907 >> v2:172.21.15.40:3300/0 conn(0x7f846c09e030 0x7f846c13d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.200+0000 7f84739ec700 1 -- 172.21.15.40:0/1740767907 >> 172.21.15.40:0/1740767907 conn(0x7f846c09fb20 msgr2=0x7f846c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:20.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.200+0000 7f84739ec700 1 -- 172.21.15.40:0/1740767907 shutdown_connections 2023-09-30T22:31:20.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.200+0000 7f84739ec700 1 -- 172.21.15.40:0/1740767907 wait complete. 2023-09-30T22:31:20.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.202+0000 7f84739ec700 1 Processor -- start 2023-09-30T22:31:20.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.202+0000 7f84739ec700 1 -- start start 2023-09-30T22:31:20.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.202+0000 7f84739ec700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f846c06a6d0 0x7f846c11b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:20.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.202+0000 7f84739ec700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f846c09e030 0x7f846c11b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:20.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.202+0000 7f84739ec700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f846c09e450 0x7f846c11beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:20.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.202+0000 7f84739ec700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846c11cf80 con 0x7f846c09e030 2023-09-30T22:31:20.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.202+0000 7f84739ec700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f846c13c2e0 con 0x7f846c06a6d0 2023-09-30T22:31:20.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.202+0000 7f84739ec700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f846c071d40 con 0x7f846c09e450 2023-09-30T22:31:20.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.203+0000 7f8471788700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f846c06a6d0 0x7f846c11b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:20.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.203+0000 7f8471788700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f846c06a6d0 0x7f846c11b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41890/0 (socket says 172.21.15.40:41890) 2023-09-30T22:31:20.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.203+0000 7f8471f89700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f846c09e450 0x7f846c11beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:20.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.203+0000 7f8471788700 1 -- 172.21.15.40:0/1410970051 learned_addr learned my addr 172.21.15.40:0/1410970051 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:20.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.203+0000 7f8470f87700 1 --2- 172.21.15.40:0/1410970051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f846c09e030 0x7f846c11b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:20.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.203+0000 7f8471f89700 1 -- 172.21.15.40:0/1410970051 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f846c06a6d0 msgr2=0x7f846c11b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:20.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.203+0000 7f8471f89700 1 --2- 172.21.15.40:0/1410970051 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f846c06a6d0 0x7f846c11b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.203+0000 7f8471f89700 1 -- 172.21.15.40:0/1410970051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f846c09e030 msgr2=0x7f846c11b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:20.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.203+0000 7f8471f89700 1 --2- 172.21.15.40:0/1410970051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f846c09e030 0x7f846c11b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.203+0000 7f8471f89700 1 -- 172.21.15.40:0/1410970051 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845c0094a0 con 0x7f846c09e450 2023-09-30T22:31:20.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.203+0000 7f8471788700 1 --2- 172.21.15.40:0/1410970051 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f846c06a6d0 0x7f846c11b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:20.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.203+0000 7f8471f89700 1 --2- 172.21.15.40:0/1410970051 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f846c09e450 0x7f846c11beb0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f846c0a0b50 tx=0x7f8464004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:20.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.203+0000 7f8461ffb700 1 -- 172.21.15.40:0/1410970051 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8464012430 con 0x7f846c09e450 2023-09-30T22:31:20.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.204+0000 7f8461ffb700 1 -- 172.21.15.40:0/1410970051 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8464020070 con 0x7f846c09e450 2023-09-30T22:31:20.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.204+0000 7f8461ffb700 1 -- 172.21.15.40:0/1410970051 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8464004260 con 0x7f846c09e450 2023-09-30T22:31:20.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.204+0000 7f84739ec700 1 -- 172.21.15.40:0/1410970051 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8464009a70 con 0x7f846c09e450 2023-09-30T22:31:20.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.204+0000 7f84739ec700 1 -- 172.21.15.40:0/1410970051 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f846c127aa0 con 0x7f846c09e450 2023-09-30T22:31:20.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.205+0000 7f8461ffb700 1 -- 172.21.15.40:0/1410970051 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f84640043c0 con 0x7f846c09e450 2023-09-30T22:31:20.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.205+0000 7f84739ec700 1 -- 172.21.15.40:0/1410970051 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f846c1273f0 con 0x7f846c09e450 2023-09-30T22:31:20.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.205+0000 7f8461ffb700 1 -- 172.21.15.40:0/1410970051 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f8464022070 con 0x7f846c09e450 2023-09-30T22:31:20.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.210+0000 7f8461ffb700 1 -- 172.21.15.40:0/1410970051 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f846c1273f0 con 0x7f846c09e450 2023-09-30T22:31:20.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.242+0000 7f68022b9700 1 Processor -- start 2023-09-30T22:31:20.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.242+0000 7f68022b9700 1 -- start start 2023-09-30T22:31:20.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.242+0000 7f68022b9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f67fc09e030 0x7f67fc13d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:20.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.242+0000 7f68022b9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67fc09e450 0x7f67fc13f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:20.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.242+0000 7f68022b9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67fc11d980 con 0x7f67fc06a6d0 2023-09-30T22:31:20.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.242+0000 7f68022b9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67fc06aaa0 con 0x7f67fc09e030 2023-09-30T22:31:20.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.242+0000 7f68022b9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc06b150 con 0x7f67fc09e450 2023-09-30T22:31:20.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.242+0000 7f6800856700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67fc09e450 0x7f67fc13f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:20.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.243+0000 7f6800856700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67fc09e450 0x7f67fc13f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41902/0 (socket says 172.21.15.40:41902) 2023-09-30T22:31:20.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.243+0000 7f6800856700 1 -- 172.21.15.40:0/413210089 learned_addr learned my addr 172.21.15.40:0/413210089 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:20.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.243+0000 7f67fb7fe700 1 --2- 172.21.15.40:0/413210089 >> v2:172.21.15.40:3300/0 conn(0x7f67fc09e030 0x7f67fc13d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:20.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.243+0000 7f67fb7fe700 1 -- 172.21.15.40:0/413210089 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67fc09e450 msgr2=0x7f67fc13f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:20.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.243+0000 7f67fb7fe700 1 --2- 172.21.15.40:0/413210089 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67fc09e450 0x7f67fc13f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.243+0000 7f67fb7fe700 1 -- 172.21.15.40:0/413210089 >> v1:172.21.15.40:6789/0 conn(0x7f67fc06a6d0 legacy=0x7f67fc09d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:20.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.243+0000 7f67fb7fe700 1 -- 172.21.15.40:0/413210089 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67fc09f300 con 0x7f67fc09e030 2023-09-30T22:31:20.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.243+0000 7f67fb7fe700 1 --2- 172.21.15.40:0/413210089 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67fc09e030 0x7f67fc13d4a0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f67f0009840 tx=0x7f67f0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eaf907b55b0affb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:20.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.243+0000 7f67faffd700 1 -- 172.21.15.40:0/413210089 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f0011830 con 0x7f67fc09e030 2023-09-30T22:31:20.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.243+0000 7f67faffd700 1 -- 172.21.15.40:0/413210089 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f0011990 con 0x7f67fc09e030 2023-09-30T22:31:20.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.243+0000 7f67faffd700 1 -- 172.21.15.40:0/413210089 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f0011d20 con 0x7f67fc09e030 2023-09-30T22:31:20.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.244+0000 7f68022b9700 1 -- 172.21.15.40:0/413210089 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67fc09e030 msgr2=0x7f67fc13d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:20.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.244+0000 7f68022b9700 1 --2- 172.21.15.40:0/413210089 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67fc09e030 0x7f67fc13d4a0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f67f0009840 tx=0x7f67f0009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:20.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.244+0000 7f68022b9700 1 -- 172.21.15.40:0/413210089 shutdown_connections 2023-09-30T22:31:20.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.244+0000 7f68022b9700 1 --2- 172.21.15.40:0/413210089 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67fc09e450 0x7f67fc13f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.244+0000 7f68022b9700 1 --2- 172.21.15.40:0/413210089 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67fc09e030 0x7f67fc13d4a0 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.244+0000 7f68022b9700 1 -- 172.21.15.40:0/413210089 >> 172.21.15.40:0/413210089 conn(0x7f67fc09fb20 msgr2=0x7f67fc09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:20.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.244+0000 7f68022b9700 1 -- 172.21.15.40:0/413210089 shutdown_connections 2023-09-30T22:31:20.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.244+0000 7f68022b9700 1 -- 172.21.15.40:0/413210089 wait complete. 2023-09-30T22:31:20.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.245+0000 7f68022b9700 1 Processor -- start 2023-09-30T22:31:20.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.246+0000 7f68022b9700 1 -- start start 2023-09-30T22:31:20.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.246+0000 7f68022b9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67fc06a6d0 0x7f67fc12e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:20.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.246+0000 7f68022b9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67fc09e030 0x7f67fc12e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:20.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.246+0000 7f68022b9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f67fc09e450 0x7f67fc12eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:20.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.246+0000 7f68022b9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc070550 con 0x7f67fc06a6d0 2023-09-30T22:31:20.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.246+0000 7f68022b9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc070cb0 con 0x7f67fc09e030 2023-09-30T22:31:20.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.246+0000 7f68022b9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc133c40 con 0x7f67fc09e450 2023-09-30T22:31:20.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.246+0000 7f67fbfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67fc06a6d0 0x7f67fc12e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:20.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.246+0000 7f6800856700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f67fc09e450 0x7f67fc12eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:20.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.246+0000 7f67fbfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67fc06a6d0 0x7f67fc12e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51794/0 (socket says 172.21.15.40:51794) 2023-09-30T22:31:20.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.246+0000 7f67fbfff700 1 -- 172.21.15.40:0/308907149 learned_addr learned my addr 172.21.15.40:0/308907149 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:20.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.246+0000 7f67fb7fe700 1 --2- 172.21.15.40:0/308907149 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67fc09e030 0x7f67fc12e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:20.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.247+0000 7f6800856700 1 -- 172.21.15.40:0/308907149 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67fc09e030 msgr2=0x7f67fc12e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:20.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.247+0000 7f6800856700 1 --2- 172.21.15.40:0/308907149 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67fc09e030 0x7f67fc12e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.247+0000 7f6800856700 1 -- 172.21.15.40:0/308907149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67fc06a6d0 msgr2=0x7f67fc12e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:20.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.247+0000 7f6800856700 1 --2- 172.21.15.40:0/308907149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67fc06a6d0 0x7f67fc12e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.247+0000 7f6800856700 1 -- 172.21.15.40:0/308907149 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f00094a0 con 0x7f67fc09e450 2023-09-30T22:31:20.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.247+0000 7f6800856700 1 --2- 172.21.15.40:0/308907149 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f67fc09e450 0x7f67fc12eb60 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f67f400efc0 tx=0x7f67f400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:20.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.247+0000 7f67f8ff9700 1 -- 172.21.15.40:0/308907149 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f4003c20 con 0x7f67fc09e450 2023-09-30T22:31:20.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.247+0000 7f67f8ff9700 1 -- 172.21.15.40:0/308907149 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f400f040 con 0x7f67fc09e450 2023-09-30T22:31:20.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.247+0000 7f67f8ff9700 1 -- 172.21.15.40:0/308907149 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f4009e60 con 0x7f67fc09e450 2023-09-30T22:31:20.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.247+0000 7f68022b9700 1 -- 172.21.15.40:0/308907149 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67fc0a1130 con 0x7f67fc09e450 2023-09-30T22:31:20.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.247+0000 7f68022b9700 1 -- 172.21.15.40:0/308907149 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67fc12f850 con 0x7f67fc09e450 2023-09-30T22:31:20.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.248+0000 7f68022b9700 1 -- 172.21.15.40:0/308907149 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67fc133870 con 0x7f67fc09e450 2023-09-30T22:31:20.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.248+0000 7f67f8ff9700 1 -- 172.21.15.40:0/308907149 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f67f400c880 con 0x7f67fc09e450 2023-09-30T22:31:20.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.253+0000 7f67f8ff9700 1 -- 172.21.15.40:0/308907149 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f67f4014e30 con 0x7f67fc09e450 2023-09-30T22:31:20.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.258+0000 7f67f8ff9700 1 -- 172.21.15.40:0/308907149 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f67f401c360 con 0x7f67fc09e450 2023-09-30T22:31:20.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.320+0000 7fe02b272700 1 -- 172.21.15.40:0/1931645447 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe024121740 con 0x7fe02409e400 2023-09-30T22:31:20.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.320+0000 7fe019ffb700 1 -- 172.21.15.40:0/1931645447 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe014028020 con 0x7fe02409e400 2023-09-30T22:31:20.321 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:20.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.322+0000 7fe02b272700 1 -- 172.21.15.40:0/1931645447 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe02409e400 msgr2=0x7fe02411edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:20.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.322+0000 7fe02b272700 1 --2- 172.21.15.40:0/1931645447 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe02409e400 0x7fe02411edb0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fe01400b560 tx=0x7fe01400b920 comp rx=0 tx=0).stop 2023-09-30T22:31:20.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.322+0000 7fe02b272700 1 -- 172.21.15.40:0/1931645447 shutdown_connections 2023-09-30T22:31:20.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.322+0000 7fe02b272700 1 --2- 172.21.15.40:0/1931645447 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe02409d920 0x7fe02411e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.322+0000 7fe02b272700 1 --2- 172.21.15.40:0/1931645447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe02411f2f0 0x7fe0241ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.322+0000 7fe02b272700 1 --2- 172.21.15.40:0/1931645447 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe02409e400 0x7fe02411edb0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.322+0000 7fe02b272700 1 -- 172.21.15.40:0/1931645447 >> 172.21.15.40:0/1931645447 conn(0x7fe02409fb20 msgr2=0x7fe02406e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:20.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.322+0000 7fe02b272700 1 -- 172.21.15.40:0/1931645447 shutdown_connections 2023-09-30T22:31:20.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.322+0000 7fe02b272700 1 -- 172.21.15.40:0/1931645447 wait complete. 2023-09-30T22:31:20.336 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:20.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.394+0000 7fbc3965f700 1 -- 172.21.15.40:0/1905549968 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbc340a57e0 con 0x7fbc3409d920 2023-09-30T22:31:20.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.395+0000 7fbc1b7fe700 1 -- 172.21.15.40:0/1905549968 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbc280102b0 con 0x7fbc3409d920 2023-09-30T22:31:20.396 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:20.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.397+0000 7fbc3965f700 1 -- 172.21.15.40:0/1905549968 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc3409d920 msgr2=0x7fbc3412ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:20.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.397+0000 7fbc3965f700 1 --2- 172.21.15.40:0/1905549968 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc3409d920 0x7fbc3412ddc0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fbc2800e900 tx=0x7fbc2800ec10 comp rx=0 tx=0).stop 2023-09-30T22:31:20.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.397+0000 7fbc3965f700 1 -- 172.21.15.40:0/1905549968 shutdown_connections 2023-09-30T22:31:20.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.397+0000 7fbc3965f700 1 --2- 172.21.15.40:0/1905549968 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fbc3409c890 0x7fbc3412d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.397+0000 7fbc3965f700 1 --2- 172.21.15.40:0/1905549968 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc3409e2b0 0x7fbc3412e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.397+0000 7fbc3965f700 1 --2- 172.21.15.40:0/1905549968 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc3409d920 0x7fbc3412ddc0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.397+0000 7fbc3965f700 1 -- 172.21.15.40:0/1905549968 >> 172.21.15.40:0/1905549968 conn(0x7fbc340a7080 msgr2=0x7fbc340a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:20.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.397+0000 7fbc3965f700 1 -- 172.21.15.40:0/1905549968 shutdown_connections 2023-09-30T22:31:20.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.397+0000 7fbc3965f700 1 -- 172.21.15.40:0/1905549968 wait complete. 2023-09-30T22:31:20.410 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:20.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.427+0000 7f84739ec700 1 -- 172.21.15.40:0/1410970051 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f846c127900 con 0x7f846c09e450 2023-09-30T22:31:20.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.428+0000 7f8461ffb700 1 -- 172.21.15.40:0/1410970051 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f846c127900 con 0x7f846c09e450 2023-09-30T22:31:20.428 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:20.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.430+0000 7f84739ec700 1 -- 172.21.15.40:0/1410970051 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f846c09e450 msgr2=0x7f846c11beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:20.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.430+0000 7f84739ec700 1 --2- 172.21.15.40:0/1410970051 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f846c09e450 0x7f846c11beb0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f846c0a0b50 tx=0x7f8464004ad0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.430+0000 7f84739ec700 1 -- 172.21.15.40:0/1410970051 shutdown_connections 2023-09-30T22:31:20.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.430+0000 7f84739ec700 1 --2- 172.21.15.40:0/1410970051 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f846c09e450 0x7f846c11beb0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.430+0000 7f84739ec700 1 --2- 172.21.15.40:0/1410970051 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f846c06a6d0 0x7f846c11b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.430+0000 7f84739ec700 1 --2- 172.21.15.40:0/1410970051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f846c09e030 0x7f846c11b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.430+0000 7f84739ec700 1 -- 172.21.15.40:0/1410970051 >> 172.21.15.40:0/1410970051 conn(0x7f846c09fb20 msgr2=0x7f846c0a0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:20.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.430+0000 7f84739ec700 1 -- 172.21.15.40:0/1410970051 shutdown_connections 2023-09-30T22:31:20.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.430+0000 7f84739ec700 1 -- 172.21.15.40:0/1410970051 wait complete. 2023-09-30T22:31:20.443 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:20.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.457+0000 7f68022b9700 1 -- 172.21.15.40:0/308907149 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f67fc133aa0 con 0x7f67fc09e450 2023-09-30T22:31:20.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.457+0000 7f67f8ff9700 1 -- 172.21.15.40:0/308907149 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f67fc133aa0 con 0x7f67fc09e450 2023-09-30T22:31:20.458 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:20.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.459+0000 7f68022b9700 1 -- 172.21.15.40:0/308907149 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f67fc09e450 msgr2=0x7f67fc12eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:20.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.459+0000 7f68022b9700 1 --2- 172.21.15.40:0/308907149 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f67fc09e450 0x7f67fc12eb60 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f67f400efc0 tx=0x7f67f400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.459+0000 7f68022b9700 1 -- 172.21.15.40:0/308907149 shutdown_connections 2023-09-30T22:31:20.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.459+0000 7f68022b9700 1 --2- 172.21.15.40:0/308907149 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f67fc09e450 0x7f67fc12eb60 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.460+0000 7f68022b9700 1 --2- 172.21.15.40:0/308907149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67fc06a6d0 0x7f67fc12e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.460+0000 7f68022b9700 1 --2- 172.21.15.40:0/308907149 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67fc09e030 0x7f67fc12e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:20.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.460+0000 7f68022b9700 1 -- 172.21.15.40:0/308907149 >> 172.21.15.40:0/308907149 conn(0x7f67fc09fb20 msgr2=0x7f67fc131fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:20.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.460+0000 7f68022b9700 1 -- 172.21.15.40:0/308907149 shutdown_connections 2023-09-30T22:31:20.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:20.460+0000 7f68022b9700 1 -- 172.21.15.40:0/308907149 wait complete. 2023-09-30T22:31:20.473 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:21.337 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:21.411 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:21.444 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:21.474 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:21.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.480+0000 7efd1740d700 1 Processor -- start 2023-09-30T22:31:21.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.480+0000 7efd1740d700 1 -- start start 2023-09-30T22:31:21.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.480+0000 7efd1740d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd10131d50 0x7efd10132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:21.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.480+0000 7efd1740d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efd1009c7d0 0x7efd10139ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:21.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.480+0000 7efd1740d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd10132660 con 0x7efd1009bc50 2023-09-30T22:31:21.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.480+0000 7efd1740d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd100719b0 con 0x7efd1009c7d0 2023-09-30T22:31:21.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.480+0000 7efd1740d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd10131900 con 0x7efd10131d50 2023-09-30T22:31:21.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.480+0000 7efd149a8700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7efd1009bc50 0x7efd1009c0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53160/0 (socket says 172.21.15.40:53160) 2023-09-30T22:31:21.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.480+0000 7efd149a8700 1 -- 172.21.15.40:0/1294440815 learned_addr learned my addr 172.21.15.40:0/1294440815 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:21.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.480+0000 7efd151a9700 1 --2- 172.21.15.40:0/1294440815 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd10131d50 0x7efd10132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:21.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.481+0000 7efd151a9700 1 -- 172.21.15.40:0/1294440815 >> v2:172.21.15.40:3300/0 conn(0x7efd1009c7d0 msgr2=0x7efd10139ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:31:21.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.481+0000 7efd151a9700 1 --2- 172.21.15.40:0/1294440815 >> v2:172.21.15.40:3300/0 conn(0x7efd1009c7d0 0x7efd10139ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.481+0000 7efd151a9700 1 -- 172.21.15.40:0/1294440815 >> v1:172.21.15.40:6789/0 conn(0x7efd1009bc50 legacy=0x7efd1009c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:21.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.481+0000 7efd151a9700 1 -- 172.21.15.40:0/1294440815 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd1009e820 con 0x7efd10131d50 2023-09-30T22:31:21.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.481+0000 7efd07fff700 1 -- 172.21.15.40:0/1294440815 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3979623570 0 0) 0x7efd10132660 con 0x7efd1009bc50 2023-09-30T22:31:21.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.481+0000 7efd151a9700 1 --2- 172.21.15.40:0/1294440815 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd10131d50 0x7efd10132120 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7efd0c009840 tx=0x7efd0c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8c3aeb02af7ed4c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:21.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.481+0000 7efd07fff700 1 -- 172.21.15.40:0/1294440815 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c011830 con 0x7efd10131d50 2023-09-30T22:31:21.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.481+0000 7efd07fff700 1 -- 172.21.15.40:0/1294440815 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0c011990 con 0x7efd10131d50 2023-09-30T22:31:21.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.482+0000 7efd07fff700 1 -- 172.21.15.40:0/1294440815 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c011d20 con 0x7efd10131d50 2023-09-30T22:31:21.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.483+0000 7efd1740d700 1 -- 172.21.15.40:0/1294440815 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd10131d50 msgr2=0x7efd10132120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:21.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.483+0000 7efd1740d700 1 --2- 172.21.15.40:0/1294440815 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd10131d50 0x7efd10132120 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7efd0c009840 tx=0x7efd0c009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:21.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.483+0000 7efd1740d700 1 -- 172.21.15.40:0/1294440815 shutdown_connections 2023-09-30T22:31:21.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.483+0000 7efd1740d700 1 --2- 172.21.15.40:0/1294440815 >> v2:172.21.15.40:3300/0 conn(0x7efd1009c7d0 0x7efd10139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.483+0000 7efd1740d700 1 --2- 172.21.15.40:0/1294440815 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd10131d50 0x7efd10132120 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.483+0000 7efd1740d700 1 -- 172.21.15.40:0/1294440815 >> 172.21.15.40:0/1294440815 conn(0x7efd100a2a00 msgr2=0x7efd100a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:21.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.484+0000 7efd1740d700 1 -- 172.21.15.40:0/1294440815 shutdown_connections 2023-09-30T22:31:21.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.484+0000 7efd1740d700 1 -- 172.21.15.40:0/1294440815 wait complete. 2023-09-30T22:31:21.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.485+0000 7efd1740d700 1 Processor -- start 2023-09-30T22:31:21.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.485+0000 7efd1740d700 1 -- start start 2023-09-30T22:31:21.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.485+0000 7efd1740d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd1009bc50 0x7efd101c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:21.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.485+0000 7efd1740d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd1009c7d0 0x7efd101c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:21.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.485+0000 7efd1740d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd10131d50 0x7efd101c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:21.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.485+0000 7efd1740d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd10134290 con 0x7efd1009bc50 2023-09-30T22:31:21.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.485+0000 7efd1740d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd10135960 con 0x7efd10131d50 2023-09-30T22:31:21.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.485+0000 7efd1740d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd10137670 con 0x7efd1009c7d0 2023-09-30T22:31:21.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.485+0000 7efd151a9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd1009bc50 0x7efd101c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:21.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.485+0000 7efd151a9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd1009bc50 0x7efd101c84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51798/0 (socket says 172.21.15.40:51798) 2023-09-30T22:31:21.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.485+0000 7efd151a9700 1 -- 172.21.15.40:0/1699173134 learned_addr learned my addr 172.21.15.40:0/1699173134 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:21.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.485+0000 7efd159aa700 1 --2- 172.21.15.40:0/1699173134 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd10131d50 0x7efd101c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:21.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.485+0000 7efd149a8700 1 --2- 172.21.15.40:0/1699173134 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd1009c7d0 0x7efd101c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:21.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.486+0000 7efd159aa700 1 -- 172.21.15.40:0/1699173134 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd1009c7d0 msgr2=0x7efd101c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:21.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.486+0000 7efd159aa700 1 --2- 172.21.15.40:0/1699173134 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd1009c7d0 0x7efd101c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.486+0000 7efd159aa700 1 -- 172.21.15.40:0/1699173134 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd1009bc50 msgr2=0x7efd101c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:21.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.486+0000 7efd159aa700 1 --2- 172.21.15.40:0/1699173134 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd1009bc50 0x7efd101c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.486+0000 7efd159aa700 1 -- 172.21.15.40:0/1699173134 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0c0094a0 con 0x7efd10131d50 2023-09-30T22:31:21.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.486+0000 7efd151a9700 1 --2- 172.21.15.40:0/1699173134 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd1009bc50 0x7efd101c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:21.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.486+0000 7efd159aa700 1 --2- 172.21.15.40:0/1699173134 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd10131d50 0x7efd101c8f70 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7efd0800bdd0 tx=0x7efd08009ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:21.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.486+0000 7efd05ffb700 1 -- 172.21.15.40:0/1699173134 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0800cb30 con 0x7efd10131d50 2023-09-30T22:31:21.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.486+0000 7efd05ffb700 1 -- 172.21.15.40:0/1699173134 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0800ccb0 con 0x7efd10131d50 2023-09-30T22:31:21.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.486+0000 7efd1740d700 1 -- 172.21.15.40:0/1699173134 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd101378e0 con 0x7efd10131d50 2023-09-30T22:31:21.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.487+0000 7efd05ffb700 1 -- 172.21.15.40:0/1699173134 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd08014680 con 0x7efd10131d50 2023-09-30T22:31:21.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.487+0000 7efd1740d700 1 -- 172.21.15.40:0/1699173134 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd10138070 con 0x7efd10131d50 2023-09-30T22:31:21.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.487+0000 7efd05ffb700 1 -- 172.21.15.40:0/1699173134 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efd0801c360 con 0x7efd10131d50 2023-09-30T22:31:21.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.487+0000 7efd05ffb700 1 -- 172.21.15.40:0/1699173134 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7efd0803f5a0 con 0x7efd10131d50 2023-09-30T22:31:21.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.488+0000 7efd1740d700 1 -- 172.21.15.40:0/1699173134 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd101374d0 con 0x7efd10131d50 2023-09-30T22:31:21.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.497+0000 7efd05ffb700 1 -- 172.21.15.40:0/1699173134 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efd101374d0 con 0x7efd10131d50 2023-09-30T22:31:21.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.553+0000 7ff5ecac1700 1 Processor -- start 2023-09-30T22:31:21.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.553+0000 7ff5ecac1700 1 -- start start 2023-09-30T22:31:21.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.553+0000 7ff5ecac1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff5e809d450 0x7ff5e809d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:21.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.554+0000 7ff5ecac1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5e81308d0 0x7ff5e8138420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:21.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.554+0000 7ff5ecac1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5e809e8b0 con 0x7ff5e809dd60 2023-09-30T22:31:21.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.554+0000 7ff5ecac1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e809c3b0 con 0x7ff5e81308d0 2023-09-30T22:31:21.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.554+0000 7ff5ecac1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e809a6b0 con 0x7ff5e809d450 2023-09-30T22:31:21.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.554+0000 7ff5e5d9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff5e809dd60 0x7ff5e81301c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53174/0 (socket says 172.21.15.40:53174) 2023-09-30T22:31:21.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.554+0000 7ff5e6d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5e81308d0 0x7ff5e8138420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:21.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.554+0000 7ff5e5d9b700 1 -- 172.21.15.40:0/3827243767 learned_addr learned my addr 172.21.15.40:0/3827243767 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:21.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.554+0000 7ff5e659c700 1 --2- 172.21.15.40:0/3827243767 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff5e809d450 0x7ff5e809d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:21.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.554+0000 7ff5e559a700 1 -- 172.21.15.40:0/3827243767 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1553498330 0 0) 0x7ff5e809e8b0 con 0x7ff5e809dd60 2023-09-30T22:31:21.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.554+0000 7ff5e559a700 1 -- 172.21.15.40:0/3827243767 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5d00035b0 con 0x7ff5e809dd60 2023-09-30T22:31:21.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.554+0000 7ff5e6d9d700 1 -- 172.21.15.40:0/3827243767 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff5e809d450 msgr2=0x7ff5e809d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:21.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.554+0000 7ff5e6d9d700 1 --2- 172.21.15.40:0/3827243767 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff5e809d450 0x7ff5e809d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.554+0000 7ff5e6d9d700 1 -- 172.21.15.40:0/3827243767 >> v1:172.21.15.40:6789/0 conn(0x7ff5e809dd60 legacy=0x7ff5e81301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:21.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.554+0000 7ff5e6d9d700 1 -- 172.21.15.40:0/3827243767 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e809b4f0 con 0x7ff5e81308d0 2023-09-30T22:31:21.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.555+0000 7ff5e6d9d700 1 --2- 172.21.15.40:0/3827243767 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5e81308d0 0x7ff5e8138420 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0009dc0 tx=0x7ff5e000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a01a72d9d079c19 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:21.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.555+0000 7ff5e559a700 1 -- 172.21.15.40:0/3827243767 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e000e070 con 0x7ff5e81308d0 2023-09-30T22:31:21.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.555+0000 7ff5e559a700 1 -- 172.21.15.40:0/3827243767 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e000bb20 con 0x7ff5e81308d0 2023-09-30T22:31:21.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.555+0000 7ff5e559a700 1 -- 172.21.15.40:0/3827243767 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e0012430 con 0x7ff5e81308d0 2023-09-30T22:31:21.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.555+0000 7ff5ecac1700 1 -- 172.21.15.40:0/3827243767 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5e81308d0 msgr2=0x7ff5e8138420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:21.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.555+0000 7ff5ecac1700 1 --2- 172.21.15.40:0/3827243767 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5e81308d0 0x7ff5e8138420 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0009dc0 tx=0x7ff5e000b330 comp rx=0 tx=0).stop 2023-09-30T22:31:21.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.556+0000 7ff5ecac1700 1 -- 172.21.15.40:0/3827243767 shutdown_connections 2023-09-30T22:31:21.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.556+0000 7ff5ecac1700 1 --2- 172.21.15.40:0/3827243767 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5e81308d0 0x7ff5e8138420 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.556+0000 7ff5ecac1700 1 --2- 172.21.15.40:0/3827243767 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff5e809d450 0x7ff5e809d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.556+0000 7ff5ecac1700 1 -- 172.21.15.40:0/3827243767 >> 172.21.15.40:0/3827243767 conn(0x7ff5e80a2a00 msgr2=0x7ff5e80a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:21.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.556+0000 7ff5ecac1700 1 -- 172.21.15.40:0/3827243767 shutdown_connections 2023-09-30T22:31:21.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.556+0000 7ff5ecac1700 1 -- 172.21.15.40:0/3827243767 wait complete. 2023-09-30T22:31:21.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.557+0000 7ff5ecac1700 1 Processor -- start 2023-09-30T22:31:21.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.557+0000 7ff5ecac1700 1 -- start start 2023-09-30T22:31:21.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.557+0000 7ff5ecac1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5e809d450 0x7ff5e813a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:21.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.557+0000 7ff5ecac1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff5e809dd60 0x7ff5e813a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:21.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.557+0000 7ff5ecac1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5e81308d0 0x7ff5e813ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:21.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.557+0000 7ff5ecac1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e809c5d0 con 0x7ff5e81308d0 2023-09-30T22:31:21.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.557+0000 7ff5ecac1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e80a2280 con 0x7ff5e809d450 2023-09-30T22:31:21.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.557+0000 7ff5ecac1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e8119050 con 0x7ff5e809dd60 2023-09-30T22:31:21.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.558+0000 7ff5e659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5e809d450 0x7ff5e813a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:21.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.558+0000 7ff5e659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5e809d450 0x7ff5e813a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41944/0 (socket says 172.21.15.40:41944) 2023-09-30T22:31:21.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.558+0000 7ff5e659c700 1 -- 172.21.15.40:0/2371881020 learned_addr learned my addr 172.21.15.40:0/2371881020 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:21.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.558+0000 7ff5e5d9b700 1 --2- 172.21.15.40:0/2371881020 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff5e809dd60 0x7ff5e813a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:21.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.558+0000 7ff5e6d9d700 1 --2- 172.21.15.40:0/2371881020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5e81308d0 0x7ff5e813ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:21.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.558+0000 7ff5e659c700 1 -- 172.21.15.40:0/2371881020 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff5e809dd60 msgr2=0x7ff5e813a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:21.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.558+0000 7ff5e659c700 1 --2- 172.21.15.40:0/2371881020 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff5e809dd60 0x7ff5e813a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.558+0000 7ff5e659c700 1 -- 172.21.15.40:0/2371881020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5e81308d0 msgr2=0x7ff5e813ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:21.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.558+0000 7ff5e659c700 1 --2- 172.21.15.40:0/2371881020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5e81308d0 0x7ff5e813ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.558+0000 7ff5e659c700 1 -- 172.21.15.40:0/2371881020 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e0009a70 con 0x7ff5e809d450 2023-09-30T22:31:21.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.558+0000 7ff5e659c700 1 --2- 172.21.15.40:0/2371881020 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5e809d450 0x7ff5e813a3c0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ff5d800e9b0 tx=0x7ff5d800ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:21.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.558+0000 7ff5d6ffd700 1 -- 172.21.15.40:0/2371881020 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8009710 con 0x7ff5e809d450 2023-09-30T22:31:21.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.558+0000 7ff5d6ffd700 1 -- 172.21.15.40:0/2371881020 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d800ee50 con 0x7ff5e809d450 2023-09-30T22:31:21.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.559+0000 7ff5d6ffd700 1 -- 172.21.15.40:0/2371881020 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d800ca50 con 0x7ff5e809d450 2023-09-30T22:31:21.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.559+0000 7ff5ecac1700 1 -- 172.21.15.40:0/2371881020 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e811aeb0 con 0x7ff5e809d450 2023-09-30T22:31:21.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.559+0000 7ff5ecac1700 1 -- 172.21.15.40:0/2371881020 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e811ab30 con 0x7ff5e809d450 2023-09-30T22:31:21.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.560+0000 7ff5d6ffd700 1 -- 172.21.15.40:0/2371881020 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff5d800cbb0 con 0x7ff5e809d450 2023-09-30T22:31:21.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.560+0000 7ff5ecac1700 1 -- 172.21.15.40:0/2371881020 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e811a970 con 0x7ff5e809d450 2023-09-30T22:31:21.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.560+0000 7ff5d6ffd700 1 -- 172.21.15.40:0/2371881020 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff5d803f7a0 con 0x7ff5e809d450 2023-09-30T22:31:21.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.565+0000 7ff5d6ffd700 1 -- 172.21.15.40:0/2371881020 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff5d8021030 con 0x7ff5e809d450 2023-09-30T22:31:21.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.594+0000 7f4a25c72700 1 Processor -- start 2023-09-30T22:31:21.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.595+0000 7f4a25c72700 1 -- start start 2023-09-30T22:31:21.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.595+0000 7f4a25c72700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4a20131d50 0x7f4a20132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:21.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.595+0000 7f4a25c72700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4a2009c7d0 0x7f4a20139ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:21.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.595+0000 7f4a25c72700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a20132660 con 0x7f4a2009bc50 2023-09-30T22:31:21.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.595+0000 7f4a25c72700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a200719b0 con 0x7f4a2009c7d0 2023-09-30T22:31:21.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.595+0000 7f4a25c72700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a20131900 con 0x7f4a20131d50 2023-09-30T22:31:21.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.595+0000 7f4a1ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4a2009c7d0 0x7f4a20139ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:21.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.595+0000 7f4a1ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4a2009c7d0 0x7f4a20139ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51812/0 (socket says 172.21.15.40:51812) 2023-09-30T22:31:21.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.595+0000 7f4a1effd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f4a2009bc50 0x7f4a2009c0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53182/0 (socket says 172.21.15.40:53182) 2023-09-30T22:31:21.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.595+0000 7f4a1ffff700 1 -- 172.21.15.40:0/3391862140 learned_addr learned my addr 172.21.15.40:0/3391862140 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:21.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.595+0000 7f4a1f7fe700 1 --2- 172.21.15.40:0/3391862140 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4a20131d50 0x7f4a20132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:21.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.596+0000 7f4a1e7fc700 1 -- 172.21.15.40:0/3391862140 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3506081706 0 0) 0x7f4a20132660 con 0x7f4a2009bc50 2023-09-30T22:31:21.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.596+0000 7f4a1f7fe700 1 -- 172.21.15.40:0/3391862140 >> v2:172.21.15.40:3300/0 conn(0x7f4a2009c7d0 msgr2=0x7f4a20139ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:21.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.596+0000 7f4a1f7fe700 1 --2- 172.21.15.40:0/3391862140 >> v2:172.21.15.40:3300/0 conn(0x7f4a2009c7d0 0x7f4a20139ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.596+0000 7f4a1f7fe700 1 -- 172.21.15.40:0/3391862140 >> v1:172.21.15.40:6789/0 conn(0x7f4a2009bc50 legacy=0x7f4a2009c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:21.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.596+0000 7f4a1f7fe700 1 -- 172.21.15.40:0/3391862140 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a2009e820 con 0x7f4a20131d50 2023-09-30T22:31:21.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.596+0000 7f4a1ffff700 1 --2- 172.21.15.40:0/3391862140 >> v2:172.21.15.40:3300/0 conn(0x7f4a2009c7d0 0x7f4a20139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:21.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.596+0000 7f4a1f7fe700 1 --2- 172.21.15.40:0/3391862140 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4a20131d50 0x7f4a20132120 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f4a10009840 tx=0x7f4a10009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71ef2c55d2d48ff9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:21.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.596+0000 7f4a1e7fc700 1 -- 172.21.15.40:0/3391862140 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a10011830 con 0x7f4a20131d50 2023-09-30T22:31:21.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.596+0000 7f4a1e7fc700 1 -- 172.21.15.40:0/3391862140 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a10011990 con 0x7f4a20131d50 2023-09-30T22:31:21.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.596+0000 7f4a1e7fc700 1 -- 172.21.15.40:0/3391862140 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a10011d20 con 0x7f4a20131d50 2023-09-30T22:31:21.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.597+0000 7f4a25c72700 1 -- 172.21.15.40:0/3391862140 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4a20131d50 msgr2=0x7f4a20132120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:21.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.597+0000 7f4a25c72700 1 --2- 172.21.15.40:0/3391862140 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4a20131d50 0x7f4a20132120 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f4a10009840 tx=0x7f4a10009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:21.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.597+0000 7f4a25c72700 1 -- 172.21.15.40:0/3391862140 shutdown_connections 2023-09-30T22:31:21.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.597+0000 7f4a25c72700 1 --2- 172.21.15.40:0/3391862140 >> v2:172.21.15.40:3300/0 conn(0x7f4a2009c7d0 0x7f4a20139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.597+0000 7f4a25c72700 1 --2- 172.21.15.40:0/3391862140 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4a20131d50 0x7f4a20132120 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.597+0000 7f4a25c72700 1 -- 172.21.15.40:0/3391862140 >> 172.21.15.40:0/3391862140 conn(0x7f4a200a2a00 msgr2=0x7f4a200a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:21.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.597+0000 7f4a25c72700 1 -- 172.21.15.40:0/3391862140 shutdown_connections 2023-09-30T22:31:21.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.597+0000 7f4a25c72700 1 -- 172.21.15.40:0/3391862140 wait complete. 2023-09-30T22:31:21.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.598+0000 7f4a25c72700 1 Processor -- start 2023-09-30T22:31:21.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.598+0000 7f4a25c72700 1 -- start start 2023-09-30T22:31:21.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.599+0000 7f4a25c72700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4a2009bc50 0x7f4a20099a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:21.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.599+0000 7f4a25c72700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a2009c7d0 0x7f4a20099fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:21.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.599+0000 7f4a25c72700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a20131d50 0x7f4a2009a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:21.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.599+0000 7f4a25c72700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2009af00 con 0x7f4a2009c7d0 2023-09-30T22:31:21.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.599+0000 7f4a25c72700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2012df70 con 0x7f4a20131d50 2023-09-30T22:31:21.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.599+0000 7f4a25c72700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2011f640 con 0x7f4a2009bc50 2023-09-30T22:31:21.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.599+0000 7f4a1f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4a2009bc50 0x7f4a20099a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:21.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.599+0000 7f4a1f7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4a2009bc50 0x7f4a20099a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48592/0 (socket says 172.21.15.40:48592) 2023-09-30T22:31:21.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.599+0000 7f4a1f7fe700 1 -- 172.21.15.40:0/1293221033 learned_addr learned my addr 172.21.15.40:0/1293221033 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:21.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.599+0000 7f4a1effd700 1 --2- 172.21.15.40:0/1293221033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a2009c7d0 0x7f4a20099fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:21.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.599+0000 7f4a1f7fe700 1 -- 172.21.15.40:0/1293221033 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a20131d50 msgr2=0x7f4a2009a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:21.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.599+0000 7f4a1f7fe700 1 --2- 172.21.15.40:0/1293221033 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a20131d50 0x7f4a2009a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.599+0000 7f4a1f7fe700 1 -- 172.21.15.40:0/1293221033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a2009c7d0 msgr2=0x7f4a20099fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:21.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.599+0000 7f4a1f7fe700 1 --2- 172.21.15.40:0/1293221033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a2009c7d0 0x7f4a20099fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.599+0000 7f4a1f7fe700 1 -- 172.21.15.40:0/1293221033 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a18009b30 con 0x7f4a2009bc50 2023-09-30T22:31:21.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.600+0000 7f4a1f7fe700 1 --2- 172.21.15.40:0/1293221033 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4a2009bc50 0x7f4a20099a70 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4a10009fd0 tx=0x7f4a10004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:21.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.600+0000 7f4a07fff700 1 -- 172.21.15.40:0/1293221033 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a100036a0 con 0x7f4a2009bc50 2023-09-30T22:31:21.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.600+0000 7f4a07fff700 1 -- 172.21.15.40:0/1293221033 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1001f070 con 0x7f4a2009bc50 2023-09-30T22:31:21.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.600+0000 7f4a25c72700 1 -- 172.21.15.40:0/1293221033 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a100094a0 con 0x7f4a2009bc50 2023-09-30T22:31:21.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.600+0000 7f4a07fff700 1 -- 172.21.15.40:0/1293221033 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a10003a60 con 0x7f4a2009bc50 2023-09-30T22:31:21.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.600+0000 7f4a25c72700 1 -- 172.21.15.40:0/1293221033 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a2011fe50 con 0x7f4a2009bc50 2023-09-30T22:31:21.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.601+0000 7f4a07fff700 1 -- 172.21.15.40:0/1293221033 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4a10003bc0 con 0x7f4a2009bc50 2023-09-30T22:31:21.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.601+0000 7f4a07fff700 1 -- 172.21.15.40:0/1293221033 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4a10021070 con 0x7f4a2009bc50 2023-09-30T22:31:21.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.601+0000 7f4a25c72700 1 -- 172.21.15.40:0/1293221033 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a2006fa30 con 0x7f4a2009bc50 2023-09-30T22:31:21.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.606+0000 7f4a07fff700 1 -- 172.21.15.40:0/1293221033 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4a1002b020 con 0x7f4a2009bc50 2023-09-30T22:31:21.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.616+0000 7f5bbf41c700 1 Processor -- start 2023-09-30T22:31:21.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.616+0000 7f5bbf41c700 1 -- start start 2023-09-30T22:31:21.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.617+0000 7f5bbf41c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bb812e590 0x7f5bb812e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:21.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.617+0000 7f5bbf41c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bb812eea0 0x7f5bb812d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:21.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.617+0000 7f5bbf41c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5bb812d6d0 0x7f5bb812db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:21.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.617+0000 7f5bbf41c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bb809ca30 con 0x7f5bb812d6d0 2023-09-30T22:31:21.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.617+0000 7f5bbf41c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb809ab70 con 0x7f5bb812e590 2023-09-30T22:31:21.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.617+0000 7f5bbf41c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb809bd70 con 0x7f5bb812eea0 2023-09-30T22:31:21.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.617+0000 7f5bbc9b7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bb812eea0 0x7f5bb812d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:21.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.617+0000 7f5bbd1b8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bb812e590 0x7f5bb812e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:21.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.617+0000 7f5bbc9b7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bb812eea0 0x7f5bb812d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48606/0 (socket says 172.21.15.40:48606) 2023-09-30T22:31:21.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.617+0000 7f5bbc9b7700 1 -- 172.21.15.40:0/1715099903 learned_addr learned my addr 172.21.15.40:0/1715099903 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:21.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.618+0000 7f5bbd9b9700 1 --2- 172.21.15.40:0/1715099903 >> v2:172.21.15.40:3300/0 conn(0x7f5bb812d6d0 0x7f5bb812db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:21.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.618+0000 7f5bbc9b7700 1 -- 172.21.15.40:0/1715099903 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bb812e590 msgr2=0x7f5bb812e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:21.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.618+0000 7f5bbc9b7700 1 --2- 172.21.15.40:0/1715099903 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bb812e590 0x7f5bb812e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.618+0000 7f5bbc9b7700 1 -- 172.21.15.40:0/1715099903 >> v2:172.21.15.40:3300/0 conn(0x7f5bb812d6d0 msgr2=0x7f5bb812db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:21.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.618+0000 7f5bbc9b7700 1 --2- 172.21.15.40:0/1715099903 >> v2:172.21.15.40:3300/0 conn(0x7f5bb812d6d0 0x7f5bb812db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.618+0000 7f5bbc9b7700 1 -- 172.21.15.40:0/1715099903 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb809b270 con 0x7f5bb812eea0 2023-09-30T22:31:21.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.618+0000 7f5bbd1b8700 1 --2- 172.21.15.40:0/1715099903 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bb812e590 0x7f5bb812e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:21.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.618+0000 7f5bbc9b7700 1 --2- 172.21.15.40:0/1715099903 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bb812eea0 0x7f5bb812d190 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f5ba80098f0 tx=0x7f5ba8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45421b5d591dcd85 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:21.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.618+0000 7f5baffff700 1 -- 172.21.15.40:0/1715099903 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba8011830 con 0x7f5bb812eea0 2023-09-30T22:31:21.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.618+0000 7f5baffff700 1 -- 172.21.15.40:0/1715099903 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba8011990 con 0x7f5bb812eea0 2023-09-30T22:31:21.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.618+0000 7f5baffff700 1 -- 172.21.15.40:0/1715099903 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba8011d20 con 0x7f5bb812eea0 2023-09-30T22:31:21.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.619+0000 7f5bbf41c700 1 -- 172.21.15.40:0/1715099903 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bb812eea0 msgr2=0x7f5bb812d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:21.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.619+0000 7f5bbf41c700 1 --2- 172.21.15.40:0/1715099903 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bb812eea0 0x7f5bb812d190 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f5ba80098f0 tx=0x7f5ba8009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:21.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.619+0000 7f5bbf41c700 1 -- 172.21.15.40:0/1715099903 shutdown_connections 2023-09-30T22:31:21.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.619+0000 7f5bbf41c700 1 --2- 172.21.15.40:0/1715099903 >> v2:172.21.15.40:3300/0 conn(0x7f5bb812d6d0 0x7f5bb812db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.619+0000 7f5bbf41c700 1 --2- 172.21.15.40:0/1715099903 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bb812e590 0x7f5bb812e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.619+0000 7f5bbf41c700 1 --2- 172.21.15.40:0/1715099903 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bb812eea0 0x7f5bb812d190 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.619+0000 7f5bbf41c700 1 -- 172.21.15.40:0/1715099903 >> 172.21.15.40:0/1715099903 conn(0x7f5bb80a2a00 msgr2=0x7f5bb80a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:21.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.619+0000 7f5bbf41c700 1 -- 172.21.15.40:0/1715099903 shutdown_connections 2023-09-30T22:31:21.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.619+0000 7f5bbf41c700 1 -- 172.21.15.40:0/1715099903 wait complete. 2023-09-30T22:31:21.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.620+0000 7f5bbf41c700 1 Processor -- start 2023-09-30T22:31:21.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.620+0000 7f5bbf41c700 1 -- start start 2023-09-30T22:31:21.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.621+0000 7f5bbf41c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bb812d6d0 0x7f5bb8119900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:21.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.621+0000 7f5bbf41c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bb812e590 0x7f5bb8119e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:21.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.621+0000 7f5bbf41c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bb812eea0 0x7f5bb811a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:21.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.621+0000 7f5bbf41c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb811dde0 con 0x7f5bb812eea0 2023-09-30T22:31:21.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.621+0000 7f5bbf41c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb811b5b0 con 0x7f5bb812e590 2023-09-30T22:31:21.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.621+0000 7f5bbf41c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb811d140 con 0x7f5bb812d6d0 2023-09-30T22:31:21.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.621+0000 7f5bbd9b9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bb812eea0 0x7f5bb811a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:21.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.621+0000 7f5bbd1b8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bb812d6d0 0x7f5bb8119900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:21.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.621+0000 7f5bbd9b9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bb812eea0 0x7f5bb811a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51850/0 (socket says 172.21.15.40:51850) 2023-09-30T22:31:21.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.621+0000 7f5bbd9b9700 1 -- 172.21.15.40:0/3202599696 learned_addr learned my addr 172.21.15.40:0/3202599696 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:21.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.621+0000 7f5bbc9b7700 1 --2- 172.21.15.40:0/3202599696 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bb812e590 0x7f5bb8119e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:21.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.622+0000 7f5bbd1b8700 1 -- 172.21.15.40:0/3202599696 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bb812e590 msgr2=0x7f5bb8119e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:21.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.622+0000 7f5bbd1b8700 1 --2- 172.21.15.40:0/3202599696 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bb812e590 0x7f5bb8119e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.622+0000 7f5bbd1b8700 1 -- 172.21.15.40:0/3202599696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bb812eea0 msgr2=0x7f5bb811a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:21.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.622+0000 7f5bbd1b8700 1 --2- 172.21.15.40:0/3202599696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bb812eea0 0x7f5bb811a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.622+0000 7f5bbd1b8700 1 -- 172.21.15.40:0/3202599696 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb400b740 con 0x7f5bb812d6d0 2023-09-30T22:31:21.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.622+0000 7f5bbc9b7700 1 --2- 172.21.15.40:0/3202599696 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bb812e590 0x7f5bb8119e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:21.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.622+0000 7f5bbd1b8700 1 --2- 172.21.15.40:0/3202599696 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bb812d6d0 0x7f5bb8119900 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f5bb400d6b0 tx=0x7f5bb400d9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:21.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.622+0000 7f5badffb700 1 -- 172.21.15.40:0/3202599696 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb400c6f0 con 0x7f5bb812d6d0 2023-09-30T22:31:21.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.622+0000 7f5badffb700 1 -- 172.21.15.40:0/3202599696 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb400c850 con 0x7f5bb812d6d0 2023-09-30T22:31:21.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.622+0000 7f5bbf41c700 1 -- 172.21.15.40:0/3202599696 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ba8009550 con 0x7f5bb812d6d0 2023-09-30T22:31:21.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.622+0000 7f5badffb700 1 -- 172.21.15.40:0/3202599696 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb400cc00 con 0x7f5bb812d6d0 2023-09-30T22:31:21.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.622+0000 7f5bbf41c700 1 -- 172.21.15.40:0/3202599696 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bb811c760 con 0x7f5bb812d6d0 2023-09-30T22:31:21.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.623+0000 7f5bbf41c700 1 -- 172.21.15.40:0/3202599696 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bb806edb0 con 0x7f5bb812d6d0 2023-09-30T22:31:21.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.624+0000 7f5badffb700 1 -- 172.21.15.40:0/3202599696 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5bb401b440 con 0x7f5bb812d6d0 2023-09-30T22:31:21.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.624+0000 7f5badffb700 1 -- 172.21.15.40:0/3202599696 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5bb4047490 con 0x7f5bb812d6d0 2023-09-30T22:31:21.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.629+0000 7f5badffb700 1 -- 172.21.15.40:0/3202599696 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5bb400be40 con 0x7f5bb812d6d0 2023-09-30T22:31:21.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.726+0000 7efd1740d700 1 -- 172.21.15.40:0/1699173134 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efd101374d0 con 0x7efd10131d50 2023-09-30T22:31:21.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.727+0000 7efd05ffb700 1 -- 172.21.15.40:0/1699173134 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efd101374d0 con 0x7efd10131d50 2023-09-30T22:31:21.728 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:21.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.730+0000 7efd1740d700 1 -- 172.21.15.40:0/1699173134 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd10131d50 msgr2=0x7efd101c8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:21.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.730+0000 7efd1740d700 1 --2- 172.21.15.40:0/1699173134 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd10131d50 0x7efd101c8f70 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7efd0800bdd0 tx=0x7efd08009ed0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.730+0000 7efd1740d700 1 -- 172.21.15.40:0/1699173134 shutdown_connections 2023-09-30T22:31:21.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.730+0000 7efd1740d700 1 --2- 172.21.15.40:0/1699173134 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd10131d50 0x7efd101c8f70 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.730+0000 7efd1740d700 1 --2- 172.21.15.40:0/1699173134 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd1009bc50 0x7efd101c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.730+0000 7efd1740d700 1 --2- 172.21.15.40:0/1699173134 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efd1009c7d0 0x7efd101c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.730+0000 7efd1740d700 1 -- 172.21.15.40:0/1699173134 >> 172.21.15.40:0/1699173134 conn(0x7efd100a2a00 msgr2=0x7efd10130c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:21.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.731+0000 7efd1740d700 1 -- 172.21.15.40:0/1699173134 shutdown_connections 2023-09-30T22:31:21.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.731+0000 7efd1740d700 1 -- 172.21.15.40:0/1699173134 wait complete. 2023-09-30T22:31:21.748 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:21.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.771+0000 7ff5ecac1700 1 -- 172.21.15.40:0/2371881020 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff5e811a1e0 con 0x7ff5e809d450 2023-09-30T22:31:21.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.771+0000 7ff5d6ffd700 1 -- 172.21.15.40:0/2371881020 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff5d801be10 con 0x7ff5e809d450 2023-09-30T22:31:21.772 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:21.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.774+0000 7ff5ecac1700 1 -- 172.21.15.40:0/2371881020 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5e809d450 msgr2=0x7ff5e813a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:21.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.774+0000 7ff5ecac1700 1 --2- 172.21.15.40:0/2371881020 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5e809d450 0x7ff5e813a3c0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ff5d800e9b0 tx=0x7ff5d800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.774+0000 7ff5ecac1700 1 -- 172.21.15.40:0/2371881020 shutdown_connections 2023-09-30T22:31:21.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.774+0000 7ff5ecac1700 1 --2- 172.21.15.40:0/2371881020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5e81308d0 0x7ff5e813ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.774+0000 7ff5ecac1700 1 --2- 172.21.15.40:0/2371881020 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5e809d450 0x7ff5e813a3c0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.774+0000 7ff5ecac1700 1 --2- 172.21.15.40:0/2371881020 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff5e809dd60 0x7ff5e813a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.774+0000 7ff5ecac1700 1 -- 172.21.15.40:0/2371881020 >> 172.21.15.40:0/2371881020 conn(0x7ff5e80a2a00 msgr2=0x7ff5e8070300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:21.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.774+0000 7ff5ecac1700 1 -- 172.21.15.40:0/2371881020 shutdown_connections 2023-09-30T22:31:21.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.774+0000 7ff5ecac1700 1 -- 172.21.15.40:0/2371881020 wait complete. 2023-09-30T22:31:21.788 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:21.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.828+0000 7f5bbf41c700 1 -- 172.21.15.40:0/3202599696 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5bb8062380 con 0x7f5bb812d6d0 2023-09-30T22:31:21.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.829+0000 7f5badffb700 1 -- 172.21.15.40:0/3202599696 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5bb40182f0 con 0x7f5bb812d6d0 2023-09-30T22:31:21.829 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:21.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.831+0000 7f5bbf41c700 1 -- 172.21.15.40:0/3202599696 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bb812d6d0 msgr2=0x7f5bb8119900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:21.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.831+0000 7f5bbf41c700 1 --2- 172.21.15.40:0/3202599696 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bb812d6d0 0x7f5bb8119900 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f5bb400d6b0 tx=0x7f5bb400d9c0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.831+0000 7f5bbf41c700 1 -- 172.21.15.40:0/3202599696 shutdown_connections 2023-09-30T22:31:21.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.831+0000 7f5bbf41c700 1 --2- 172.21.15.40:0/3202599696 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5bb812d6d0 0x7f5bb8119900 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.831+0000 7f5bbf41c700 1 --2- 172.21.15.40:0/3202599696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bb812eea0 0x7f5bb811a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.831+0000 7f5bbf41c700 1 --2- 172.21.15.40:0/3202599696 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5bb812e590 0x7f5bb8119e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.831+0000 7f5bbf41c700 1 -- 172.21.15.40:0/3202599696 >> 172.21.15.40:0/3202599696 conn(0x7f5bb80a2a00 msgr2=0x7f5bb812c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:21.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.831+0000 7f5bbf41c700 1 -- 172.21.15.40:0/3202599696 shutdown_connections 2023-09-30T22:31:21.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.831+0000 7f5bbf41c700 1 -- 172.21.15.40:0/3202599696 wait complete. 2023-09-30T22:31:21.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.841+0000 7f4a25c72700 1 -- 172.21.15.40:0/1293221033 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4a2009ea60 con 0x7f4a2009bc50 2023-09-30T22:31:21.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.841+0000 7f4a07fff700 1 -- 172.21.15.40:0/1293221033 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4a10015070 con 0x7f4a2009bc50 2023-09-30T22:31:21.843 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:21.844 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:21.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.844+0000 7f4a25c72700 1 -- 172.21.15.40:0/1293221033 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4a2009bc50 msgr2=0x7f4a20099a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:21.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.844+0000 7f4a25c72700 1 --2- 172.21.15.40:0/1293221033 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4a2009bc50 0x7f4a20099a70 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4a10009fd0 tx=0x7f4a10004750 comp rx=0 tx=0).stop 2023-09-30T22:31:21.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.844+0000 7f4a25c72700 1 -- 172.21.15.40:0/1293221033 shutdown_connections 2023-09-30T22:31:21.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.844+0000 7f4a25c72700 1 --2- 172.21.15.40:0/1293221033 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4a2009bc50 0x7f4a20099a70 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.844+0000 7f4a25c72700 1 --2- 172.21.15.40:0/1293221033 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a20131d50 0x7f4a2009a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.844+0000 7f4a25c72700 1 --2- 172.21.15.40:0/1293221033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a2009c7d0 0x7f4a20099fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:21.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.844+0000 7f4a25c72700 1 -- 172.21.15.40:0/1293221033 >> 172.21.15.40:0/1293221033 conn(0x7f4a200a2a00 msgr2=0x7f4a201b8f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:21.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.844+0000 7f4a25c72700 1 -- 172.21.15.40:0/1293221033 shutdown_connections 2023-09-30T22:31:21.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:21.844+0000 7f4a25c72700 1 -- 172.21.15.40:0/1293221033 wait complete. 2023-09-30T22:31:21.857 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:22.749 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:22.789 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:22.845 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:22.858 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:22.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.898+0000 7fa0b72e9700 1 Processor -- start 2023-09-30T22:31:22.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.898+0000 7fa0b72e9700 1 -- start start 2023-09-30T22:31:22.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.899+0000 7fa0b72e9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa0b0136c50 0x7fa0b0139030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.899+0000 7fa0b72e9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0b0139570 0x7fa0b013b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.899+0000 7fa0b72e9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0b0133940 con 0x7fa0b0133e00 2023-09-30T22:31:22.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.899+0000 7fa0b72e9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b009af70 con 0x7fa0b0139570 2023-09-30T22:31:22.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.899+0000 7fa0b72e9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b009ab20 con 0x7fa0b0136c50 2023-09-30T22:31:22.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.899+0000 7fa0b5085700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa0b0133e00 0x7fa0b01341d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53188/0 (socket says 172.21.15.40:53188) 2023-09-30T22:31:22.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.899+0000 7fa0b5886700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0b0139570 0x7fa0b013b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.899+0000 7fa0b4884700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa0b0136c50 0x7fa0b0139030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.899+0000 7fa0b5085700 1 -- 172.21.15.40:0/809786060 learned_addr learned my addr 172.21.15.40:0/809786060 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:22.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.900+0000 7fa0b5886700 1 -- 172.21.15.40:0/809786060 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa0b0136c50 msgr2=0x7fa0b0139030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:22.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.900+0000 7fa0b5886700 1 --2- 172.21.15.40:0/809786060 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa0b0136c50 0x7fa0b0139030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.900+0000 7fa0b5886700 1 -- 172.21.15.40:0/809786060 >> v1:172.21.15.40:6789/0 conn(0x7fa0b0133e00 legacy=0x7fa0b01341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:22.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.900+0000 7fa0b5886700 1 -- 172.21.15.40:0/809786060 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b009f0d0 con 0x7fa0b0139570 2023-09-30T22:31:22.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.900+0000 7fa0a7fff700 1 -- 172.21.15.40:0/809786060 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3261758795 0 0) 0x7fa0b0133940 con 0x7fa0b0133e00 2023-09-30T22:31:22.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.900+0000 7fa0b5886700 1 --2- 172.21.15.40:0/809786060 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0b0139570 0x7fa0b013b950 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8009dc0 tx=0x7fa0a800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b20df49a9c3687fd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:22.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.900+0000 7fa0a7fff700 1 -- 172.21.15.40:0/809786060 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a800e070 con 0x7fa0b0139570 2023-09-30T22:31:22.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.900+0000 7fa0a7fff700 1 -- 172.21.15.40:0/809786060 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a800bb20 con 0x7fa0b0139570 2023-09-30T22:31:22.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.900+0000 7fa0a7fff700 1 -- 172.21.15.40:0/809786060 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a8012430 con 0x7fa0b0139570 2023-09-30T22:31:22.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.901+0000 7fa0b72e9700 1 -- 172.21.15.40:0/809786060 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0b0139570 msgr2=0x7fa0b013b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:22.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.901+0000 7fa0b72e9700 1 --2- 172.21.15.40:0/809786060 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0b0139570 0x7fa0b013b950 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8009dc0 tx=0x7fa0a800b330 comp rx=0 tx=0).stop 2023-09-30T22:31:22.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.901+0000 7fa0b72e9700 1 -- 172.21.15.40:0/809786060 shutdown_connections 2023-09-30T22:31:22.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.901+0000 7fa0b72e9700 1 --2- 172.21.15.40:0/809786060 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0b0139570 0x7fa0b013b950 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.901+0000 7fa0b72e9700 1 --2- 172.21.15.40:0/809786060 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa0b0136c50 0x7fa0b0139030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.901+0000 7fa0b72e9700 1 -- 172.21.15.40:0/809786060 >> 172.21.15.40:0/809786060 conn(0x7fa0b00a2a00 msgr2=0x7fa0b00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:22.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.902+0000 7fa0b72e9700 1 -- 172.21.15.40:0/809786060 shutdown_connections 2023-09-30T22:31:22.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.902+0000 7fa0b72e9700 1 -- 172.21.15.40:0/809786060 wait complete. 2023-09-30T22:31:22.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.903+0000 7fa0b72e9700 1 Processor -- start 2023-09-30T22:31:22.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.903+0000 7fa0b72e9700 1 -- start start 2023-09-30T22:31:22.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.903+0000 7fa0b72e9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa0b0133e00 0x7fa0b0119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.903+0000 7fa0b72e9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0b0136c50 0x7fa0b0119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.903+0000 7fa0b72e9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0b0139570 0x7fa0b0119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.903+0000 7fa0b72e9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b011bdf0 con 0x7fa0b0139570 2023-09-30T22:31:22.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.903+0000 7fa0b72e9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b012dbc0 con 0x7fa0b0136c50 2023-09-30T22:31:22.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.903+0000 7fa0b72e9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b012e120 con 0x7fa0b0133e00 2023-09-30T22:31:22.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.903+0000 7fa0b4884700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0b0136c50 0x7fa0b0119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.903+0000 7fa0b4884700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0b0136c50 0x7fa0b0119590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41966/0 (socket says 172.21.15.40:41966) 2023-09-30T22:31:22.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.903+0000 7fa0b4884700 1 -- 172.21.15.40:0/3095096625 learned_addr learned my addr 172.21.15.40:0/3095096625 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:22.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.903+0000 7fa0b5085700 1 --2- 172.21.15.40:0/3095096625 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa0b0133e00 0x7fa0b0119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.904+0000 7fa0b4884700 1 -- 172.21.15.40:0/3095096625 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa0b0133e00 msgr2=0x7fa0b0119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:22.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.904+0000 7fa0b4884700 1 --2- 172.21.15.40:0/3095096625 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa0b0133e00 0x7fa0b0119050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.904+0000 7fa0b4884700 1 -- 172.21.15.40:0/3095096625 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0b0139570 msgr2=0x7fa0b0119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:22.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.904+0000 7fa0b4884700 1 --2- 172.21.15.40:0/3095096625 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0b0139570 0x7fa0b0119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.904+0000 7fa0b4884700 1 -- 172.21.15.40:0/3095096625 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a8009a70 con 0x7fa0b0136c50 2023-09-30T22:31:22.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.904+0000 7fa0b4884700 1 --2- 172.21.15.40:0/3095096625 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0b0136c50 0x7fa0b0119590 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fa0a000b3f0 tx=0x7fa0a000b700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:22.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.904+0000 7fa0a5ffb700 1 -- 172.21.15.40:0/3095096625 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a0019070 con 0x7fa0b0136c50 2023-09-30T22:31:22.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.904+0000 7fa0b72e9700 1 -- 172.21.15.40:0/3095096625 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0b011b630 con 0x7fa0b0136c50 2023-09-30T22:31:22.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.904+0000 7fa0a5ffb700 1 -- 172.21.15.40:0/3095096625 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a001d410 con 0x7fa0b0136c50 2023-09-30T22:31:22.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.904+0000 7fa0a5ffb700 1 -- 172.21.15.40:0/3095096625 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a0014af0 con 0x7fa0b0136c50 2023-09-30T22:31:22.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.905+0000 7fa0b72e9700 1 -- 172.21.15.40:0/3095096625 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b0132cc0 con 0x7fa0b0136c50 2023-09-30T22:31:22.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.905+0000 7fa0a5ffb700 1 -- 172.21.15.40:0/3095096625 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa0a001d7a0 con 0x7fa0b0136c50 2023-09-30T22:31:22.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.906+0000 7fa0a5ffb700 1 -- 172.21.15.40:0/3095096625 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa0a0047630 con 0x7fa0b0136c50 2023-09-30T22:31:22.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.906+0000 7fa0b72e9700 1 -- 172.21.15.40:0/3095096625 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0b0099b60 con 0x7fa0b0136c50 2023-09-30T22:31:22.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.915+0000 7fa0a5ffb700 1 -- 172.21.15.40:0/3095096625 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa0a0022020 con 0x7fa0b0136c50 2023-09-30T22:31:22.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.938+0000 7f4868233700 1 Processor -- start 2023-09-30T22:31:22.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.939+0000 7f4868233700 1 -- start start 2023-09-30T22:31:22.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.939+0000 7f4868233700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f486009e400 0x7f4860135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.939+0000 7f4868233700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4860136230 0x7f4860138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.939+0000 7f4868233700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f486009adf0 con 0x7f486009d920 2023-09-30T22:31:22.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.939+0000 7f4868233700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f486009e7f0 con 0x7f4860136230 2023-09-30T22:31:22.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.939+0000 7f4868233700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f486009edf0 con 0x7f486009e400 2023-09-30T22:31:22.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.939+0000 7f48667d0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4860136230 0x7f4860138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.939+0000 7f48667d0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4860136230 0x7f4860138610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41968/0 (socket says 172.21.15.40:41968) 2023-09-30T22:31:22.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.939+0000 7f48667d0700 1 -- 172.21.15.40:0/3141578350 learned_addr learned my addr 172.21.15.40:0/3141578350 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:22.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.939+0000 7f48657ce700 1 --2- 172.21.15.40:0/3141578350 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f486009e400 0x7f4860135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.940+0000 7f48667d0700 1 -- 172.21.15.40:0/3141578350 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f486009e400 msgr2=0x7f4860135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:22.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.940+0000 7f48667d0700 1 --2- 172.21.15.40:0/3141578350 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f486009e400 0x7f4860135cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.940+0000 7f48667d0700 1 -- 172.21.15.40:0/3141578350 >> v1:172.21.15.40:6789/0 conn(0x7f486009d920 legacy=0x7f486009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:22.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.940+0000 7f48667d0700 1 -- 172.21.15.40:0/3141578350 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f486009b660 con 0x7f4860136230 2023-09-30T22:31:22.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.940+0000 7f48667d0700 1 --2- 172.21.15.40:0/3141578350 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4860136230 0x7f4860138610 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f4858009eb0 tx=0x7f485800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6fea134b21c87d0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:22.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.940+0000 7f4864fcd700 1 -- 172.21.15.40:0/3141578350 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485800e070 con 0x7f4860136230 2023-09-30T22:31:22.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.940+0000 7f4864fcd700 1 -- 172.21.15.40:0/3141578350 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485800b8d0 con 0x7f4860136230 2023-09-30T22:31:22.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.940+0000 7f4864fcd700 1 -- 172.21.15.40:0/3141578350 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485800bc80 con 0x7f4860136230 2023-09-30T22:31:22.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.941+0000 7f4868233700 1 -- 172.21.15.40:0/3141578350 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4860136230 msgr2=0x7f4860138610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:22.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.941+0000 7f4868233700 1 --2- 172.21.15.40:0/3141578350 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4860136230 0x7f4860138610 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f4858009eb0 tx=0x7f485800b330 comp rx=0 tx=0).stop 2023-09-30T22:31:22.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.941+0000 7f4868233700 1 -- 172.21.15.40:0/3141578350 shutdown_connections 2023-09-30T22:31:22.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.941+0000 7f4868233700 1 --2- 172.21.15.40:0/3141578350 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4860136230 0x7f4860138610 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.941+0000 7f4868233700 1 --2- 172.21.15.40:0/3141578350 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f486009e400 0x7f4860135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.941+0000 7f4868233700 1 -- 172.21.15.40:0/3141578350 >> 172.21.15.40:0/3141578350 conn(0x7f486009fb20 msgr2=0x7f486009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:22.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.941+0000 7f4868233700 1 -- 172.21.15.40:0/3141578350 shutdown_connections 2023-09-30T22:31:22.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.941+0000 7f4868233700 1 -- 172.21.15.40:0/3141578350 wait complete. 2023-09-30T22:31:22.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.942+0000 7f4868233700 1 Processor -- start 2023-09-30T22:31:22.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.942+0000 7f4868233700 1 -- start start 2023-09-30T22:31:22.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.942+0000 7f4868233700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f486009d920 0x7f4860120670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.942+0000 7f4868233700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f486009e400 0x7f4860120bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.942+0000 7f4868233700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4860136230 0x7f48601210f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.942+0000 7f4868233700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4860122b50 con 0x7f4860136230 2023-09-30T22:31:22.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.942+0000 7f4868233700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4860122280 con 0x7f486009e400 2023-09-30T22:31:22.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.942+0000 7f4868233700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4860135000 con 0x7f486009d920 2023-09-30T22:31:22.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.943+0000 7f48657ce700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f486009e400 0x7f4860120bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.943+0000 7f48657ce700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f486009e400 0x7f4860120bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41976/0 (socket says 172.21.15.40:41976) 2023-09-30T22:31:22.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.943+0000 7f48657ce700 1 -- 172.21.15.40:0/2712284112 learned_addr learned my addr 172.21.15.40:0/2712284112 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:22.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.943+0000 7f48667d0700 1 --2- 172.21.15.40:0/2712284112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4860136230 0x7f48601210f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.943+0000 7f4865fcf700 1 --2- 172.21.15.40:0/2712284112 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f486009d920 0x7f4860120670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.943+0000 7f48657ce700 1 -- 172.21.15.40:0/2712284112 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f486009d920 msgr2=0x7f4860120670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:22.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.943+0000 7f48657ce700 1 --2- 172.21.15.40:0/2712284112 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f486009d920 0x7f4860120670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.943+0000 7f48657ce700 1 -- 172.21.15.40:0/2712284112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4860136230 msgr2=0x7f48601210f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:22.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.943+0000 7f48657ce700 1 --2- 172.21.15.40:0/2712284112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4860136230 0x7f48601210f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.943+0000 7f48657ce700 1 -- 172.21.15.40:0/2712284112 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4858009b30 con 0x7f486009e400 2023-09-30T22:31:22.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.943+0000 7f48657ce700 1 --2- 172.21.15.40:0/2712284112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f486009e400 0x7f4860120bb0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f485000e9b0 tx=0x7f485000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:22.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.943+0000 7f48567fc700 1 -- 172.21.15.40:0/2712284112 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4850009710 con 0x7f486009e400 2023-09-30T22:31:22.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.943+0000 7f48567fc700 1 -- 172.21.15.40:0/2712284112 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485000c850 con 0x7f486009e400 2023-09-30T22:31:22.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.943+0000 7f48567fc700 1 -- 172.21.15.40:0/2712284112 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485000cbc0 con 0x7f486009e400 2023-09-30T22:31:22.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.943+0000 7f4868233700 1 -- 172.21.15.40:0/2712284112 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4860135b00 con 0x7f486009e400 2023-09-30T22:31:22.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.944+0000 7f4868233700 1 -- 172.21.15.40:0/2712284112 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f486009cb00 con 0x7f486009e400 2023-09-30T22:31:22.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.944+0000 7f48567fc700 1 -- 172.21.15.40:0/2712284112 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f485000cd20 con 0x7f486009e400 2023-09-30T22:31:22.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.945+0000 7f4868233700 1 -- 172.21.15.40:0/2712284112 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4860123b30 con 0x7f486009e400 2023-09-30T22:31:22.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.945+0000 7f48567fc700 1 -- 172.21.15.40:0/2712284112 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f485003f780 con 0x7f486009e400 2023-09-30T22:31:22.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.954+0000 7f48567fc700 1 -- 172.21.15.40:0/2712284112 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4860123b30 con 0x7f486009e400 2023-09-30T22:31:22.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.987+0000 7f78effb5700 1 Processor -- start 2023-09-30T22:31:22.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.987+0000 7f78effb5700 1 -- start start 2023-09-30T22:31:22.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.987+0000 7f78effb5700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f78e8133e00 0x7f78e81341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.987+0000 7f78effb5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f78e809df70 0x7f78e813bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.988+0000 7f78effb5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78e8133940 con 0x7f78e809d400 2023-09-30T22:31:22.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.988+0000 7f78effb5700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78e809ab20 con 0x7f78e8133e00 2023-09-30T22:31:22.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.988+0000 7f78effb5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78e809f0d0 con 0x7f78e809df70 2023-09-30T22:31:22.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.988+0000 7f78edd51700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f78e8133e00 0x7f78e81341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.988+0000 7f78edd51700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f78e8133e00 0x7f78e81341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51870/0 (socket says 172.21.15.40:51870) 2023-09-30T22:31:22.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.988+0000 7f78edd51700 1 -- 172.21.15.40:0/1037598532 learned_addr learned my addr 172.21.15.40:0/1037598532 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:22.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.988+0000 7f78ee552700 1 --2- 172.21.15.40:0/1037598532 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f78e809df70 0x7f78e813bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.988+0000 7f78ee552700 1 -- 172.21.15.40:0/1037598532 >> v2:172.21.15.40:3300/0 conn(0x7f78e8133e00 msgr2=0x7f78e81341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:22.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.988+0000 7f78ee552700 1 --2- 172.21.15.40:0/1037598532 >> v2:172.21.15.40:3300/0 conn(0x7f78e8133e00 0x7f78e81341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.988+0000 7f78ee552700 1 -- 172.21.15.40:0/1037598532 >> v1:172.21.15.40:6789/0 conn(0x7f78e809d400 legacy=0x7f78e809d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:22.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.988+0000 7f78ee552700 1 -- 172.21.15.40:0/1037598532 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e8133be0 con 0x7f78e809df70 2023-09-30T22:31:22.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.988+0000 7f78ee552700 1 --2- 172.21.15.40:0/1037598532 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f78e809df70 0x7f78e813bc80 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f78e0009d90 tx=0x7f78e000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=694be90fc836013b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:22.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.988+0000 7f78ecd4f700 1 -- 172.21.15.40:0/1037598532 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e000e070 con 0x7f78e809df70 2023-09-30T22:31:22.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.989+0000 7f78ecd4f700 1 -- 172.21.15.40:0/1037598532 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e000bb20 con 0x7f78e809df70 2023-09-30T22:31:22.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.989+0000 7f78ecd4f700 1 -- 172.21.15.40:0/1037598532 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e0012430 con 0x7f78e809df70 2023-09-30T22:31:22.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.989+0000 7f78effb5700 1 -- 172.21.15.40:0/1037598532 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f78e809df70 msgr2=0x7f78e813bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:22.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.989+0000 7f78effb5700 1 --2- 172.21.15.40:0/1037598532 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f78e809df70 0x7f78e813bc80 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f78e0009d90 tx=0x7f78e000b330 comp rx=0 tx=0).stop 2023-09-30T22:31:22.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.989+0000 7f78effb5700 1 -- 172.21.15.40:0/1037598532 shutdown_connections 2023-09-30T22:31:22.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.989+0000 7f78effb5700 1 --2- 172.21.15.40:0/1037598532 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f78e809df70 0x7f78e813bc80 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.989+0000 7f78effb5700 1 --2- 172.21.15.40:0/1037598532 >> v2:172.21.15.40:3300/0 conn(0x7f78e8133e00 0x7f78e81341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.989+0000 7f78effb5700 1 -- 172.21.15.40:0/1037598532 >> 172.21.15.40:0/1037598532 conn(0x7f78e80a2a00 msgr2=0x7f78e80a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:22.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.989+0000 7f78effb5700 1 -- 172.21.15.40:0/1037598532 shutdown_connections 2023-09-30T22:31:22.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.989+0000 7f78effb5700 1 -- 172.21.15.40:0/1037598532 wait complete. 2023-09-30T22:31:22.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.990+0000 7f78effb5700 1 Processor -- start 2023-09-30T22:31:22.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.990+0000 7f78effb5700 1 -- start start 2023-09-30T22:31:22.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.991+0000 7f78effb5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f78e809d400 0x7f78e811bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.991+0000 7f78effb5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78e809df70 0x7f78e811c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.991+0000 7f78effb5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78e8133e00 0x7f78e811c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:22.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.991+0000 7f78effb5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e811f3e0 con 0x7f78e8133e00 2023-09-30T22:31:22.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.991+0000 7f78effb5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e812d000 con 0x7f78e809df70 2023-09-30T22:31:22.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.991+0000 7f78effb5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78e811e640 con 0x7f78e809d400 2023-09-30T22:31:22.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.991+0000 7f78ee552700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78e8133e00 0x7f78e811c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.991+0000 7f78ed550700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78e809df70 0x7f78e811c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.991+0000 7f78ee552700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78e8133e00 0x7f78e811c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51878/0 (socket says 172.21.15.40:51878) 2023-09-30T22:31:22.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.991+0000 7f78ee552700 1 -- 172.21.15.40:0/698679881 learned_addr learned my addr 172.21.15.40:0/698679881 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:22.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.991+0000 7f78edd51700 1 --2- 172.21.15.40:0/698679881 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f78e809d400 0x7f78e811bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:22.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.991+0000 7f78ee552700 1 -- 172.21.15.40:0/698679881 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f78e809d400 msgr2=0x7f78e811bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:22.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.991+0000 7f78ee552700 1 --2- 172.21.15.40:0/698679881 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f78e809d400 0x7f78e811bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.991+0000 7f78ee552700 1 -- 172.21.15.40:0/698679881 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78e809df70 msgr2=0x7f78e811c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:22.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.991+0000 7f78ee552700 1 --2- 172.21.15.40:0/698679881 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78e809df70 0x7f78e811c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:22.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.991+0000 7f78ee552700 1 -- 172.21.15.40:0/698679881 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e0009a70 con 0x7f78e8133e00 2023-09-30T22:31:22.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.992+0000 7f78ee552700 1 --2- 172.21.15.40:0/698679881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78e8133e00 0x7f78e811c620 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f78e809f210 tx=0x7f78e0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:22.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.992+0000 7f78de7fc700 1 -- 172.21.15.40:0/698679881 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e0012430 con 0x7f78e8133e00 2023-09-30T22:31:22.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.992+0000 7f78de7fc700 1 -- 172.21.15.40:0/698679881 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e0020070 con 0x7f78e8133e00 2023-09-30T22:31:22.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.992+0000 7f78effb5700 1 -- 172.21.15.40:0/698679881 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78e811f6c0 con 0x7f78e8133e00 2023-09-30T22:31:22.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.992+0000 7f78de7fc700 1 -- 172.21.15.40:0/698679881 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e0004280 con 0x7f78e8133e00 2023-09-30T22:31:22.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.992+0000 7f78effb5700 1 -- 172.21.15.40:0/698679881 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78e812e1f0 con 0x7f78e8133e00 2023-09-30T22:31:22.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.993+0000 7f78de7fc700 1 -- 172.21.15.40:0/698679881 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f78e00043e0 con 0x7f78e8133e00 2023-09-30T22:31:22.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.993+0000 7f78de7fc700 1 -- 172.21.15.40:0/698679881 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f78e0022070 con 0x7f78e8133e00 2023-09-30T22:31:22.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:22.994+0000 7f78effb5700 1 -- 172.21.15.40:0/698679881 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78e8062380 con 0x7f78e8133e00 2023-09-30T22:31:23.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.002+0000 7f78de7fc700 1 -- 172.21.15.40:0/698679881 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f78e0046060 con 0x7f78e8133e00 2023-09-30T22:31:23.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.039+0000 7ffbc5937700 1 Processor -- start 2023-09-30T22:31:23.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.039+0000 7ffbc5937700 1 -- start start 2023-09-30T22:31:23.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.040+0000 7ffbc5937700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbc009d920 0x7ffbc009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:23.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.040+0000 7ffbc5937700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffbc009e230 0x7ffbc01308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:23.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.040+0000 7ffbc5937700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffbc0130de0 0x7ffbc0131260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:23.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.040+0000 7ffbc5937700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbc009edf0 con 0x7ffbc009e230 2023-09-30T22:31:23.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.040+0000 7ffbc5937700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc009adf0 con 0x7ffbc009d920 2023-09-30T22:31:23.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.040+0000 7ffbc5937700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc009b660 con 0x7ffbc0130de0 2023-09-30T22:31:23.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.040+0000 7ffbbeffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbc009d920 0x7ffbc009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:23.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.041+0000 7ffbbeffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbc009d920 0x7ffbc009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41996/0 (socket says 172.21.15.40:41996) 2023-09-30T22:31:23.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.041+0000 7ffbbeffd700 1 -- 172.21.15.40:0/2727986210 learned_addr learned my addr 172.21.15.40:0/2727986210 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:23.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.041+0000 7ffbbe7fc700 1 --2- 172.21.15.40:0/2727986210 >> v2:172.21.15.40:3300/0 conn(0x7ffbc009e230 0x7ffbc01308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:23.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.041+0000 7ffbbf7fe700 1 --2- 172.21.15.40:0/2727986210 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffbc0130de0 0x7ffbc0131260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:23.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.041+0000 7ffbbf7fe700 1 -- 172.21.15.40:0/2727986210 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbc009d920 msgr2=0x7ffbc009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:23.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.041+0000 7ffbbf7fe700 1 --2- 172.21.15.40:0/2727986210 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbc009d920 0x7ffbc009dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.041+0000 7ffbbf7fe700 1 -- 172.21.15.40:0/2727986210 >> v2:172.21.15.40:3300/0 conn(0x7ffbc009e230 msgr2=0x7ffbc01308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:23.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.041+0000 7ffbbf7fe700 1 --2- 172.21.15.40:0/2727986210 >> v2:172.21.15.40:3300/0 conn(0x7ffbc009e230 0x7ffbc01308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.041+0000 7ffbbf7fe700 1 -- 172.21.15.40:0/2727986210 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc009a6e0 con 0x7ffbc0130de0 2023-09-30T22:31:23.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.041+0000 7ffbbf7fe700 1 --2- 172.21.15.40:0/2727986210 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffbc0130de0 0x7ffbc0131260 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800be30 tx=0x7ffbb80092f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2dda97ef1cefea6b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:23.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.041+0000 7ffbbdffb700 1 -- 172.21.15.40:0/2727986210 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb800c890 con 0x7ffbc0130de0 2023-09-30T22:31:23.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.041+0000 7ffbbdffb700 1 -- 172.21.15.40:0/2727986210 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb800c9f0 con 0x7ffbc0130de0 2023-09-30T22:31:23.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.041+0000 7ffbbdffb700 1 -- 172.21.15.40:0/2727986210 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb800cda0 con 0x7ffbc0130de0 2023-09-30T22:31:23.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.042+0000 7ffbc5937700 1 -- 172.21.15.40:0/2727986210 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffbc0130de0 msgr2=0x7ffbc0131260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:23.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.042+0000 7ffbc5937700 1 --2- 172.21.15.40:0/2727986210 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffbc0130de0 0x7ffbc0131260 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800be30 tx=0x7ffbb80092f0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.042+0000 7ffbc5937700 1 -- 172.21.15.40:0/2727986210 shutdown_connections 2023-09-30T22:31:23.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.042+0000 7ffbc5937700 1 --2- 172.21.15.40:0/2727986210 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffbc0130de0 0x7ffbc0131260 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.042+0000 7ffbc5937700 1 --2- 172.21.15.40:0/2727986210 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbc009d920 0x7ffbc009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.042+0000 7ffbc5937700 1 --2- 172.21.15.40:0/2727986210 >> v2:172.21.15.40:3300/0 conn(0x7ffbc009e230 0x7ffbc01308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.042+0000 7ffbc5937700 1 -- 172.21.15.40:0/2727986210 >> 172.21.15.40:0/2727986210 conn(0x7ffbc009fb20 msgr2=0x7ffbc009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:23.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.042+0000 7ffbc5937700 1 -- 172.21.15.40:0/2727986210 shutdown_connections 2023-09-30T22:31:23.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.042+0000 7ffbc5937700 1 -- 172.21.15.40:0/2727986210 wait complete. 2023-09-30T22:31:23.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.044+0000 7ffbc5937700 1 Processor -- start 2023-09-30T22:31:23.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.044+0000 7ffbc5937700 1 -- start start 2023-09-30T22:31:23.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.045+0000 7ffbc5937700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffbc009d920 0x7ffbc011b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:23.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.045+0000 7ffbc5937700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbc009e230 0x7ffbc011b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:23.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.045+0000 7ffbc5937700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbc0130de0 0x7ffbc011bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:23.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.045+0000 7ffbc5937700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc011eae0 con 0x7ffbc009e230 2023-09-30T22:31:23.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.045+0000 7ffbc5937700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc011d1b0 con 0x7ffbc0130de0 2023-09-30T22:31:23.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.045+0000 7ffbc5937700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc011e270 con 0x7ffbc009d920 2023-09-30T22:31:23.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.045+0000 7ffbbeffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffbc009d920 0x7ffbc011b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:23.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.045+0000 7ffbbf7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbc0130de0 0x7ffbc011bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:23.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.045+0000 7ffbbeffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffbc009d920 0x7ffbc011b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48688/0 (socket says 172.21.15.40:48688) 2023-09-30T22:31:23.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.045+0000 7ffbbeffd700 1 -- 172.21.15.40:0/4045519053 learned_addr learned my addr 172.21.15.40:0/4045519053 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:23.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.045+0000 7ffbbeffd700 1 -- 172.21.15.40:0/4045519053 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbc0130de0 msgr2=0x7ffbc011bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:23.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.045+0000 7ffbbeffd700 1 --2- 172.21.15.40:0/4045519053 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbc0130de0 0x7ffbc011bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.045+0000 7ffbbeffd700 1 -- 172.21.15.40:0/4045519053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbc009e230 msgr2=0x7ffbc011b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:23.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.045+0000 7ffbbeffd700 1 --2- 172.21.15.40:0/4045519053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbc009e230 0x7ffbc011b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.045+0000 7ffbbeffd700 1 -- 172.21.15.40:0/4045519053 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb800ba90 con 0x7ffbc009d920 2023-09-30T22:31:23.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.045+0000 7ffbbf7fe700 1 --2- 172.21.15.40:0/4045519053 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbc0130de0 0x7ffbc011bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:23.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.045+0000 7ffbbeffd700 1 --2- 172.21.15.40:0/4045519053 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffbc009d920 0x7ffbc011b0f0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000e870 tx=0x7ffbb000eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:23.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.046+0000 7ffba7fff700 1 -- 172.21.15.40:0/4045519053 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0013680 con 0x7ffbc009d920 2023-09-30T22:31:23.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.046+0000 7ffbc5937700 1 -- 172.21.15.40:0/4045519053 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc009cb00 con 0x7ffbc009d920 2023-09-30T22:31:23.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.046+0000 7ffbc5937700 1 -- 172.21.15.40:0/4045519053 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc011cbd0 con 0x7ffbc009d920 2023-09-30T22:31:23.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.046+0000 7ffba7fff700 1 -- 172.21.15.40:0/4045519053 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb00137e0 con 0x7ffbc009d920 2023-09-30T22:31:23.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.046+0000 7ffba7fff700 1 -- 172.21.15.40:0/4045519053 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0013b50 con 0x7ffbc009d920 2023-09-30T22:31:23.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.047+0000 7ffba7fff700 1 -- 172.21.15.40:0/4045519053 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffbb0013cb0 con 0x7ffbc009d920 2023-09-30T22:31:23.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.048+0000 7ffbc5937700 1 -- 172.21.15.40:0/4045519053 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbc0070700 con 0x7ffbc009d920 2023-09-30T22:31:23.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.048+0000 7ffba7fff700 1 -- 172.21.15.40:0/4045519053 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ffbb00249a0 con 0x7ffbc009d920 2023-09-30T22:31:23.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.057+0000 7ffba7fff700 1 -- 172.21.15.40:0/4045519053 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffbb0017030 con 0x7ffbc009d920 2023-09-30T22:31:23.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.156+0000 7f4868233700 1 -- 172.21.15.40:0/2712284112 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f486009a660 con 0x7f486009e400 2023-09-30T22:31:23.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.156+0000 7f48567fc700 1 -- 172.21.15.40:0/2712284112 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4850021070 con 0x7f486009e400 2023-09-30T22:31:23.157 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:23.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.158+0000 7f4868233700 1 -- 172.21.15.40:0/2712284112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f486009e400 msgr2=0x7f4860120bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:23.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.158+0000 7f4868233700 1 --2- 172.21.15.40:0/2712284112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f486009e400 0x7f4860120bb0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f485000e9b0 tx=0x7f485000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.158+0000 7f4868233700 1 -- 172.21.15.40:0/2712284112 shutdown_connections 2023-09-30T22:31:23.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.158+0000 7f4868233700 1 --2- 172.21.15.40:0/2712284112 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f486009d920 0x7f4860120670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.158+0000 7f4868233700 1 --2- 172.21.15.40:0/2712284112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4860136230 0x7f48601210f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.158+0000 7f4868233700 1 --2- 172.21.15.40:0/2712284112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f486009e400 0x7f4860120bb0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.158+0000 7f4868233700 1 -- 172.21.15.40:0/2712284112 >> 172.21.15.40:0/2712284112 conn(0x7f486009fb20 msgr2=0x7f48600706a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:23.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.158+0000 7f4868233700 1 -- 172.21.15.40:0/2712284112 shutdown_connections 2023-09-30T22:31:23.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.158+0000 7f4868233700 1 -- 172.21.15.40:0/2712284112 wait complete. 2023-09-30T22:31:23.172 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:23.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.175+0000 7fa0b72e9700 1 -- 172.21.15.40:0/3095096625 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa0b0062380 con 0x7fa0b0136c50 2023-09-30T22:31:23.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.176+0000 7fa0a5ffb700 1 -- 172.21.15.40:0/3095096625 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa0a00263b0 con 0x7fa0b0136c50 2023-09-30T22:31:23.176 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:23.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.178+0000 7fa0b72e9700 1 -- 172.21.15.40:0/3095096625 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0b0136c50 msgr2=0x7fa0b0119590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:23.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.178+0000 7fa0b72e9700 1 --2- 172.21.15.40:0/3095096625 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0b0136c50 0x7fa0b0119590 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fa0a000b3f0 tx=0x7fa0a000b700 comp rx=0 tx=0).stop 2023-09-30T22:31:23.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.178+0000 7fa0b72e9700 1 -- 172.21.15.40:0/3095096625 shutdown_connections 2023-09-30T22:31:23.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.178+0000 7fa0b72e9700 1 --2- 172.21.15.40:0/3095096625 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa0b0133e00 0x7fa0b0119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.178+0000 7fa0b72e9700 1 --2- 172.21.15.40:0/3095096625 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0b0139570 0x7fa0b0119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.178+0000 7fa0b72e9700 1 --2- 172.21.15.40:0/3095096625 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0b0136c50 0x7fa0b0119590 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.178+0000 7fa0b72e9700 1 -- 172.21.15.40:0/3095096625 >> 172.21.15.40:0/3095096625 conn(0x7fa0b00a2a00 msgr2=0x7fa0b0130420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:23.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.178+0000 7fa0b72e9700 1 -- 172.21.15.40:0/3095096625 shutdown_connections 2023-09-30T22:31:23.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.178+0000 7fa0b72e9700 1 -- 172.21.15.40:0/3095096625 wait complete. 2023-09-30T22:31:23.191 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:23.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.204+0000 7f78effb5700 1 -- 172.21.15.40:0/698679881 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f78e8074330 con 0x7f78e8133e00 2023-09-30T22:31:23.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.205+0000 7f78de7fc700 1 -- 172.21.15.40:0/698679881 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f78e001c400 con 0x7f78e8133e00 2023-09-30T22:31:23.205 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:23.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.206+0000 7f78effb5700 1 -- 172.21.15.40:0/698679881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78e8133e00 msgr2=0x7f78e811c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:23.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.206+0000 7f78effb5700 1 --2- 172.21.15.40:0/698679881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78e8133e00 0x7f78e811c620 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f78e809f210 tx=0x7f78e0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.207+0000 7f78effb5700 1 -- 172.21.15.40:0/698679881 shutdown_connections 2023-09-30T22:31:23.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.207+0000 7f78effb5700 1 --2- 172.21.15.40:0/698679881 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f78e809d400 0x7f78e811bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.207+0000 7f78effb5700 1 --2- 172.21.15.40:0/698679881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78e8133e00 0x7f78e811c620 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.207+0000 7f78effb5700 1 --2- 172.21.15.40:0/698679881 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78e809df70 0x7f78e811c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.207+0000 7f78effb5700 1 -- 172.21.15.40:0/698679881 >> 172.21.15.40:0/698679881 conn(0x7f78e80a2a00 msgr2=0x7f78e80a2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:23.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.207+0000 7f78effb5700 1 -- 172.21.15.40:0/698679881 shutdown_connections 2023-09-30T22:31:23.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.207+0000 7f78effb5700 1 -- 172.21.15.40:0/698679881 wait complete. 2023-09-30T22:31:23.219 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:23.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.295+0000 7ffbc5937700 1 -- 172.21.15.40:0/4045519053 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffbc011e680 con 0x7ffbc009d920 2023-09-30T22:31:23.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.296+0000 7ffba7fff700 1 -- 172.21.15.40:0/4045519053 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffbc011e680 con 0x7ffbc009d920 2023-09-30T22:31:23.297 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:23.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.298+0000 7ffbc5937700 1 -- 172.21.15.40:0/4045519053 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffbc009d920 msgr2=0x7ffbc011b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:23.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.298+0000 7ffbc5937700 1 --2- 172.21.15.40:0/4045519053 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffbc009d920 0x7ffbc011b0f0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000e870 tx=0x7ffbb000eb80 comp rx=0 tx=0).stop 2023-09-30T22:31:23.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.298+0000 7ffbc5937700 1 -- 172.21.15.40:0/4045519053 shutdown_connections 2023-09-30T22:31:23.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.298+0000 7ffbc5937700 1 --2- 172.21.15.40:0/4045519053 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ffbc009d920 0x7ffbc011b0f0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.298+0000 7ffbc5937700 1 --2- 172.21.15.40:0/4045519053 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ffbc0130de0 0x7ffbc011bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.298+0000 7ffbc5937700 1 --2- 172.21.15.40:0/4045519053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbc009e230 0x7ffbc011b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:23.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.298+0000 7ffbc5937700 1 -- 172.21.15.40:0/4045519053 >> 172.21.15.40:0/4045519053 conn(0x7ffbc009fb20 msgr2=0x7ffbc012de60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:23.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.298+0000 7ffbc5937700 1 -- 172.21.15.40:0/4045519053 shutdown_connections 2023-09-30T22:31:23.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:23.298+0000 7ffbc5937700 1 -- 172.21.15.40:0/4045519053 wait complete. 2023-09-30T22:31:23.311 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:24.173 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:24.193 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:24.220 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:24.312 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:24.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.326+0000 7f53a45fa700 1 Processor -- start 2023-09-30T22:31:24.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.326+0000 7f53a45fa700 1 -- start start 2023-09-30T22:31:24.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.327+0000 7f53a45fa700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f539c09df30 0x7f539c135400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:24.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.327+0000 7f53a45fa700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f539c135940 0x7f539c137d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:24.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.327+0000 7f53a45fa700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f539c09e8b0 con 0x7f539c09d450 2023-09-30T22:31:24.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.327+0000 7f53a45fa700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f539c09c3b0 con 0x7f539c135940 2023-09-30T22:31:24.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.327+0000 7f53a45fa700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f539c09a6b0 con 0x7f539c09df30 2023-09-30T22:31:24.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.328+0000 7f53a1b95700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f539c09df30 0x7f539c135400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:24.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.328+0000 7f53a1b95700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f539c09df30 0x7f539c135400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51424/0 (socket says 172.21.15.40:51424) 2023-09-30T22:31:24.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.328+0000 7f53a1b95700 1 -- 172.21.15.40:0/2601325727 learned_addr learned my addr 172.21.15.40:0/2601325727 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:24.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.328+0000 7f53a2b97700 1 --2- 172.21.15.40:0/2601325727 >> v2:172.21.15.40:3300/0 conn(0x7f539c135940 0x7f539c137d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:24.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.328+0000 7f53a1b95700 1 -- 172.21.15.40:0/2601325727 >> v2:172.21.15.40:3300/0 conn(0x7f539c135940 msgr2=0x7f539c137d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:24.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.328+0000 7f53a1b95700 1 --2- 172.21.15.40:0/2601325727 >> v2:172.21.15.40:3300/0 conn(0x7f539c135940 0x7f539c137d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.328+0000 7f53a1b95700 1 -- 172.21.15.40:0/2601325727 >> v1:172.21.15.40:6789/0 conn(0x7f539c09d450 legacy=0x7f539c09d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:24.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.328+0000 7f53a1b95700 1 -- 172.21.15.40:0/2601325727 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539c09b4f0 con 0x7f539c09df30 2023-09-30T22:31:24.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.328+0000 7f53a2b97700 1 --2- 172.21.15.40:0/2601325727 >> v2:172.21.15.40:3300/0 conn(0x7f539c135940 0x7f539c137d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:31:24.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.328+0000 7f53a1b95700 1 --2- 172.21.15.40:0/2601325727 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f539c09df30 0x7f539c135400 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f538c0098f0 tx=0x7f538c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8e15bb24314aa86 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:24.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.328+0000 7f53a1394700 1 -- 172.21.15.40:0/2601325727 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538c004230 con 0x7f539c09df30 2023-09-30T22:31:24.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.328+0000 7f53a1394700 1 -- 172.21.15.40:0/2601325727 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538c004390 con 0x7f539c09df30 2023-09-30T22:31:24.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.328+0000 7f53a1394700 1 -- 172.21.15.40:0/2601325727 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538c0036a0 con 0x7f539c09df30 2023-09-30T22:31:24.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.329+0000 7f53a45fa700 1 -- 172.21.15.40:0/2601325727 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f539c09df30 msgr2=0x7f539c135400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:24.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.329+0000 7f53a45fa700 1 --2- 172.21.15.40:0/2601325727 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f539c09df30 0x7f539c135400 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f538c0098f0 tx=0x7f538c009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:24.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.329+0000 7f53a45fa700 1 -- 172.21.15.40:0/2601325727 shutdown_connections 2023-09-30T22:31:24.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.329+0000 7f53a45fa700 1 --2- 172.21.15.40:0/2601325727 >> v2:172.21.15.40:3300/0 conn(0x7f539c135940 0x7f539c137d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.329+0000 7f53a45fa700 1 --2- 172.21.15.40:0/2601325727 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f539c09df30 0x7f539c135400 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.329+0000 7f53a45fa700 1 -- 172.21.15.40:0/2601325727 >> 172.21.15.40:0/2601325727 conn(0x7f539c0a2a00 msgr2=0x7f539c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:24.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.330+0000 7f53a45fa700 1 -- 172.21.15.40:0/2601325727 shutdown_connections 2023-09-30T22:31:24.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.330+0000 7f53a45fa700 1 -- 172.21.15.40:0/2601325727 wait complete. 2023-09-30T22:31:24.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.331+0000 7f53a45fa700 1 Processor -- start 2023-09-30T22:31:24.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.331+0000 7f53a45fa700 1 -- start start 2023-09-30T22:31:24.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.331+0000 7f53a45fa700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f539c09d450 0x7f539c12da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:24.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.331+0000 7f53a45fa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f539c09df30 0x7f539c135d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:24.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.331+0000 7f53a45fa700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f539c135940 0x7f539c136250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:24.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.331+0000 7f53a45fa700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539c0714b0 con 0x7f539c135940 2023-09-30T22:31:24.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.331+0000 7f53a45fa700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f539c09c5d0 con 0x7f539c09df30 2023-09-30T22:31:24.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.331+0000 7f53a45fa700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f539c06fc30 con 0x7f539c09d450 2023-09-30T22:31:24.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.331+0000 7f53a2b97700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f539c135940 0x7f539c136250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:24.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.331+0000 7f53a2b97700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f539c135940 0x7f539c136250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42806/0 (socket says 172.21.15.40:42806) 2023-09-30T22:31:24.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.331+0000 7f53a2b97700 1 -- 172.21.15.40:0/411209063 learned_addr learned my addr 172.21.15.40:0/411209063 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:24.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.332+0000 7f53a2b97700 1 -- 172.21.15.40:0/411209063 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f539c09d450 msgr2=0x7f539c12da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:24.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.332+0000 7f53a2396700 1 --2- 172.21.15.40:0/411209063 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f539c09d450 0x7f539c12da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:24.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.332+0000 7f53a2b97700 1 --2- 172.21.15.40:0/411209063 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f539c09d450 0x7f539c12da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.332+0000 7f53a2b97700 1 -- 172.21.15.40:0/411209063 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f539c09df30 msgr2=0x7f539c135d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:24.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.332+0000 7f53a2b97700 1 --2- 172.21.15.40:0/411209063 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f539c09df30 0x7f539c135d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.332+0000 7f53a2b97700 1 -- 172.21.15.40:0/411209063 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f538c009550 con 0x7f539c135940 2023-09-30T22:31:24.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.332+0000 7f53a2396700 1 --2- 172.21.15.40:0/411209063 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f539c09d450 0x7f539c12da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:31:24.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.332+0000 7f53a2b97700 1 --2- 172.21.15.40:0/411209063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f539c135940 0x7f539c136250 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f539400ce80 tx=0x7f539400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:24.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.332+0000 7f5392ffd700 1 -- 172.21.15.40:0/411209063 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539400ae20 con 0x7f539c135940 2023-09-30T22:31:24.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.332+0000 7f5392ffd700 1 -- 172.21.15.40:0/411209063 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5394015440 con 0x7f539c135940 2023-09-30T22:31:24.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.332+0000 7f5392ffd700 1 -- 172.21.15.40:0/411209063 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53940157f0 con 0x7f539c135940 2023-09-30T22:31:24.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.333+0000 7f53a45fa700 1 -- 172.21.15.40:0/411209063 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f539c12df70 con 0x7f539c135940 2023-09-30T22:31:24.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.333+0000 7f53a45fa700 1 -- 172.21.15.40:0/411209063 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f539c070db0 con 0x7f539c135940 2023-09-30T22:31:24.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.334+0000 7f5392ffd700 1 -- 172.21.15.40:0/411209063 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f539400d430 con 0x7f539c135940 2023-09-30T22:31:24.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.334+0000 7f5392ffd700 1 -- 172.21.15.40:0/411209063 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f539403fcf0 con 0x7f539c135940 2023-09-30T22:31:24.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.335+0000 7f53a45fa700 1 -- 172.21.15.40:0/411209063 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f539c133b90 con 0x7f539c135940 2023-09-30T22:31:24.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.344+0000 7f5392ffd700 1 -- 172.21.15.40:0/411209063 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f539401a020 con 0x7f539c135940 2023-09-30T22:31:24.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.365+0000 7f4197620700 1 Processor -- start 2023-09-30T22:31:24.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.365+0000 7f4197620700 1 -- start start 2023-09-30T22:31:24.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.366+0000 7f4197620700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f419006fb50 0x7f4190136c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:24.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.366+0000 7f4197620700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f41901371b0 0x7f4190139590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:24.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.366+0000 7f4197620700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4190070830 con 0x7f419006f070 2023-09-30T22:31:24.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.366+0000 7f4197620700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4190071af0 con 0x7f41901371b0 2023-09-30T22:31:24.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.366+0000 7f4197620700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4190070ad0 con 0x7f419006fb50 2023-09-30T22:31:24.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.366+0000 7f4194bbb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f419006fb50 0x7f4190136c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:24.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.367+0000 7f4194bbb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f419006fb50 0x7f4190136c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50480/0 (socket says 172.21.15.40:50480) 2023-09-30T22:31:24.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.367+0000 7f4194bbb700 1 -- 172.21.15.40:0/295159365 learned_addr learned my addr 172.21.15.40:0/295159365 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:24.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.367+0000 7f4195bbd700 1 --2- 172.21.15.40:0/295159365 >> v2:172.21.15.40:3300/0 conn(0x7f41901371b0 0x7f4190139590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:24.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.367+0000 7f4195bbd700 1 -- 172.21.15.40:0/295159365 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f419006fb50 msgr2=0x7f4190136c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:24.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.367+0000 7f4195bbd700 1 --2- 172.21.15.40:0/295159365 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f419006fb50 0x7f4190136c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.367+0000 7f4195bbd700 1 -- 172.21.15.40:0/295159365 >> v1:172.21.15.40:6789/0 conn(0x7f419006f070 legacy=0x7f419006f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:24.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.367+0000 7f4195bbd700 1 -- 172.21.15.40:0/295159365 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4190070de0 con 0x7f41901371b0 2023-09-30T22:31:24.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.367+0000 7f4194bbb700 1 --2- 172.21.15.40:0/295159365 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f419006fb50 0x7f4190136c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:24.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.367+0000 7f4195bbd700 1 --2- 172.21.15.40:0/295159365 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41901371b0 0x7f4190139590 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f4188009d90 tx=0x7f418800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=134a3d6290df7b69 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:24.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.367+0000 7f4187fff700 1 -- 172.21.15.40:0/295159365 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418800e070 con 0x7f41901371b0 2023-09-30T22:31:24.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.367+0000 7f4187fff700 1 -- 172.21.15.40:0/295159365 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418800bb20 con 0x7f41901371b0 2023-09-30T22:31:24.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.367+0000 7f4187fff700 1 -- 172.21.15.40:0/295159365 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4188012430 con 0x7f41901371b0 2023-09-30T22:31:24.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.368+0000 7f4197620700 1 -- 172.21.15.40:0/295159365 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41901371b0 msgr2=0x7f4190139590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:24.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.368+0000 7f4197620700 1 --2- 172.21.15.40:0/295159365 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41901371b0 0x7f4190139590 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f4188009d90 tx=0x7f418800b330 comp rx=0 tx=0).stop 2023-09-30T22:31:24.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.368+0000 7f4197620700 1 -- 172.21.15.40:0/295159365 shutdown_connections 2023-09-30T22:31:24.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.368+0000 7f4197620700 1 --2- 172.21.15.40:0/295159365 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41901371b0 0x7f4190139590 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.368+0000 7f4197620700 1 --2- 172.21.15.40:0/295159365 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f419006fb50 0x7f4190136c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.368+0000 7f4197620700 1 -- 172.21.15.40:0/295159365 >> 172.21.15.40:0/295159365 conn(0x7f41900a41a0 msgr2=0x7f41900a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:24.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.368+0000 7f4197620700 1 -- 172.21.15.40:0/295159365 shutdown_connections 2023-09-30T22:31:24.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.368+0000 7f4197620700 1 -- 172.21.15.40:0/295159365 wait complete. 2023-09-30T22:31:24.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.370+0000 7f4197620700 1 Processor -- start 2023-09-30T22:31:24.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.370+0000 7f4197620700 1 -- start start 2023-09-30T22:31:24.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.370+0000 7f4197620700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f419006f070 0x7f4190134b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:24.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.370+0000 7f4197620700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f419006fb50 0x7f4190135050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:24.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.370+0000 7f4197620700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41901371b0 0x7f4190135590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:24.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.370+0000 7f4197620700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4190136bd0 con 0x7f41901371b0 2023-09-30T22:31:24.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.370+0000 7f4197620700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4190136820 con 0x7f419006f070 2023-09-30T22:31:24.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.370+0000 7f4197620700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f419012c370 con 0x7f419006fb50 2023-09-30T22:31:24.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.371+0000 7f41953bc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f419006f070 0x7f4190134b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:24.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.371+0000 7f41953bc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f419006f070 0x7f4190134b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50482/0 (socket says 172.21.15.40:50482) 2023-09-30T22:31:24.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.371+0000 7f41953bc700 1 -- 172.21.15.40:0/1242310215 learned_addr learned my addr 172.21.15.40:0/1242310215 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:24.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.371+0000 7f4195bbd700 1 --2- 172.21.15.40:0/1242310215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41901371b0 0x7f4190135590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:24.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.371+0000 7f4194bbb700 1 --2- 172.21.15.40:0/1242310215 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f419006fb50 0x7f4190135050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:24.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.371+0000 7f41953bc700 1 -- 172.21.15.40:0/1242310215 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f419006fb50 msgr2=0x7f4190135050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:24.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.371+0000 7f41953bc700 1 --2- 172.21.15.40:0/1242310215 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f419006fb50 0x7f4190135050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.371+0000 7f41953bc700 1 -- 172.21.15.40:0/1242310215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41901371b0 msgr2=0x7f4190135590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:24.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.371+0000 7f41953bc700 1 --2- 172.21.15.40:0/1242310215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41901371b0 0x7f4190135590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.371+0000 7f41953bc700 1 -- 172.21.15.40:0/1242310215 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4180009550 con 0x7f419006f070 2023-09-30T22:31:24.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.371+0000 7f4195bbd700 1 --2- 172.21.15.40:0/1242310215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41901371b0 0x7f4190135590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:24.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.371+0000 7f41953bc700 1 --2- 172.21.15.40:0/1242310215 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f419006f070 0x7f4190134b10 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f418c00c4e0 tx=0x7f418c00c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:24.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.372+0000 7f4185ffb700 1 -- 172.21.15.40:0/1242310215 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c0052d0 con 0x7f419006f070 2023-09-30T22:31:24.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.372+0000 7f4185ffb700 1 -- 172.21.15.40:0/1242310215 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418c005430 con 0x7f419006f070 2023-09-30T22:31:24.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.372+0000 7f4185ffb700 1 -- 172.21.15.40:0/1242310215 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c0038c0 con 0x7f419006f070 2023-09-30T22:31:24.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.372+0000 7f4197620700 1 -- 172.21.15.40:0/1242310215 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4188009a70 con 0x7f419006f070 2023-09-30T22:31:24.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.372+0000 7f4197620700 1 -- 172.21.15.40:0/1242310215 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f419012e7a0 con 0x7f419006f070 2023-09-30T22:31:24.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.373+0000 7f4185ffb700 1 -- 172.21.15.40:0/1242310215 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f418c003a20 con 0x7f419006f070 2023-09-30T22:31:24.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.373+0000 7f4185ffb700 1 -- 172.21.15.40:0/1242310215 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f418c03ebd0 con 0x7f419006f070 2023-09-30T22:31:24.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.373+0000 7f4197620700 1 -- 172.21.15.40:0/1242310215 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f419012dbc0 con 0x7f419006f070 2023-09-30T22:31:24.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.382+0000 7f4185ffb700 1 -- 172.21.15.40:0/1242310215 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f418c017020 con 0x7f419006f070 2023-09-30T22:31:24.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.402+0000 7f19cecc3700 1 Processor -- start 2023-09-30T22:31:24.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.402+0000 7f19cecc3700 1 -- start start 2023-09-30T22:31:24.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.402+0000 7f19cecc3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f19c809f0f0 0x7f19c8138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:24.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.402+0000 7f19cecc3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f19c809e400 0x7f19c813b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:24.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.402+0000 7f19cecc3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c809f940 con 0x7f19c809d920 2023-09-30T22:31:24.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.402+0000 7f19cecc3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c806b4c0 con 0x7f19c809e400 2023-09-30T22:31:24.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.402+0000 7f19cecc3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c809a8f0 con 0x7f19c809f0f0 2023-09-30T22:31:24.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.402+0000 7f19c7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f19c809f0f0 0x7f19c8138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:24.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.402+0000 7f19c7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f19c809f0f0 0x7f19c8138ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50492/0 (socket says 172.21.15.40:50492) 2023-09-30T22:31:24.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.402+0000 7f19c7fff700 1 -- 172.21.15.40:0/1289736078 learned_addr learned my addr 172.21.15.40:0/1289736078 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:24.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.403+0000 7f19cd260700 1 --2- 172.21.15.40:0/1289736078 >> v2:172.21.15.40:3300/0 conn(0x7f19c809e400 0x7f19c813b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:24.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.403+0000 7f19c7fff700 1 -- 172.21.15.40:0/1289736078 >> v2:172.21.15.40:3300/0 conn(0x7f19c809e400 msgr2=0x7f19c813b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:24.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.403+0000 7f19c7fff700 1 --2- 172.21.15.40:0/1289736078 >> v2:172.21.15.40:3300/0 conn(0x7f19c809e400 0x7f19c813b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.403+0000 7f19c7fff700 1 -- 172.21.15.40:0/1289736078 >> v1:172.21.15.40:6789/0 conn(0x7f19c809d920 legacy=0x7f19c809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:24.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.403+0000 7f19c7fff700 1 -- 172.21.15.40:0/1289736078 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c809f6e0 con 0x7f19c809f0f0 2023-09-30T22:31:24.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.403+0000 7f19c7fff700 1 --2- 172.21.15.40:0/1289736078 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f19c809f0f0 0x7f19c8138ee0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f19b40098f0 tx=0x7f19b4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c167ae6bf63cc472 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:24.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.403+0000 7f19c77fe700 1 -- 172.21.15.40:0/1289736078 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b4011830 con 0x7f19c809f0f0 2023-09-30T22:31:24.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.403+0000 7f19c77fe700 1 -- 172.21.15.40:0/1289736078 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b4011990 con 0x7f19c809f0f0 2023-09-30T22:31:24.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.403+0000 7f19c77fe700 1 -- 172.21.15.40:0/1289736078 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b4011d20 con 0x7f19c809f0f0 2023-09-30T22:31:24.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.404+0000 7f19cecc3700 1 -- 172.21.15.40:0/1289736078 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f19c809f0f0 msgr2=0x7f19c8138ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:24.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.404+0000 7f19cecc3700 1 --2- 172.21.15.40:0/1289736078 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f19c809f0f0 0x7f19c8138ee0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f19b40098f0 tx=0x7f19b4009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:24.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.404+0000 7f19cecc3700 1 -- 172.21.15.40:0/1289736078 shutdown_connections 2023-09-30T22:31:24.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.404+0000 7f19cecc3700 1 --2- 172.21.15.40:0/1289736078 >> v2:172.21.15.40:3300/0 conn(0x7f19c809e400 0x7f19c813b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.404+0000 7f19cecc3700 1 --2- 172.21.15.40:0/1289736078 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f19c809f0f0 0x7f19c8138ee0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.404+0000 7f19cecc3700 1 -- 172.21.15.40:0/1289736078 >> 172.21.15.40:0/1289736078 conn(0x7f19c809fb20 msgr2=0x7f19c809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:24.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.404+0000 7f19cecc3700 1 -- 172.21.15.40:0/1289736078 shutdown_connections 2023-09-30T22:31:24.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.404+0000 7f19cecc3700 1 -- 172.21.15.40:0/1289736078 wait complete. 2023-09-30T22:31:24.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.405+0000 7f19cecc3700 1 Processor -- start 2023-09-30T22:31:24.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.405+0000 7f19cecc3700 1 -- start start 2023-09-30T22:31:24.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.406+0000 7f19cecc3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f19c809d920 0x7f19c811e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:24.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.406+0000 7f19cecc3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19c809e400 0x7f19c811ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:24.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.406+0000 7f19cecc3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f19c811f200 0x7f19c81ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:24.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.406+0000 7f19cecc3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c811f650 con 0x7f19c809e400 2023-09-30T22:31:24.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.406+0000 7f19cecc3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c80a3340 con 0x7f19c809d920 2023-09-30T22:31:24.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.406+0000 7f19cecc3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19c809c9e0 con 0x7f19c811f200 2023-09-30T22:31:24.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.406+0000 7f19cca5f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f19c809d920 0x7f19c811e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:24.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.406+0000 7f19cca5f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f19c809d920 0x7f19c811e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50498/0 (socket says 172.21.15.40:50498) 2023-09-30T22:31:24.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.406+0000 7f19cca5f700 1 -- 172.21.15.40:0/1633036608 learned_addr learned my addr 172.21.15.40:0/1633036608 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:24.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.406+0000 7f19cd260700 1 --2- 172.21.15.40:0/1633036608 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f19c811f200 0x7f19c81ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:24.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.406+0000 7f19c7fff700 1 --2- 172.21.15.40:0/1633036608 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19c809e400 0x7f19c811ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:24.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.406+0000 7f19cd260700 1 -- 172.21.15.40:0/1633036608 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f19c809d920 msgr2=0x7f19c811e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:24.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.406+0000 7f19cd260700 1 --2- 172.21.15.40:0/1633036608 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f19c809d920 0x7f19c811e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.406+0000 7f19cd260700 1 -- 172.21.15.40:0/1633036608 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19c809e400 msgr2=0x7f19c811ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:24.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.406+0000 7f19cd260700 1 --2- 172.21.15.40:0/1633036608 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19c809e400 0x7f19c811ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.406+0000 7f19cd260700 1 -- 172.21.15.40:0/1633036608 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b4009550 con 0x7f19c811f200 2023-09-30T22:31:24.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.406+0000 7f19cd260700 1 --2- 172.21.15.40:0/1633036608 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f19c811f200 0x7f19c81ce8b0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f19c000efc0 tx=0x7f19c000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:24.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.407+0000 7f19c57fa700 1 -- 172.21.15.40:0/1633036608 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c000cc90 con 0x7f19c811f200 2023-09-30T22:31:24.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.407+0000 7f19c57fa700 1 -- 172.21.15.40:0/1633036608 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c000f040 con 0x7f19c811f200 2023-09-30T22:31:24.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.407+0000 7f19cecc3700 1 -- 172.21.15.40:0/1633036608 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c8121a30 con 0x7f19c811f200 2023-09-30T22:31:24.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.407+0000 7f19c57fa700 1 -- 172.21.15.40:0/1633036608 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c00146c0 con 0x7f19c811f200 2023-09-30T22:31:24.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.407+0000 7f19cecc3700 1 -- 172.21.15.40:0/1633036608 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c8120b80 con 0x7f19c811f200 2023-09-30T22:31:24.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.408+0000 7f19b2ffd700 1 -- 172.21.15.40:0/1633036608 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c8062380 con 0x7f19c811f200 2023-09-30T22:31:24.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.408+0000 7f19c57fa700 1 -- 172.21.15.40:0/1633036608 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f19c0014820 con 0x7f19c811f200 2023-09-30T22:31:24.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.408+0000 7f19c57fa700 1 -- 172.21.15.40:0/1633036608 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f19c0040230 con 0x7f19c811f200 2023-09-30T22:31:24.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.413+0000 7f19c57fa700 1 -- 172.21.15.40:0/1633036608 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f19c0007900 con 0x7f19c811f200 2023-09-30T22:31:24.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.452+0000 7f20fe3e4700 1 Processor -- start 2023-09-30T22:31:24.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.452+0000 7f20fe3e4700 1 -- start start 2023-09-30T22:31:24.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.452+0000 7f20fe3e4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20f806c990 0x7f20f806cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:24.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.452+0000 7f20fe3e4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20f806d2a0 0x7f20f813c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:24.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.452+0000 7f20fe3e4700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20f806df30 con 0x7f20f813c8f0 2023-09-30T22:31:24.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.452+0000 7f20fe3e4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f806ec40 con 0x7f20f806d2a0 2023-09-30T22:31:24.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.452+0000 7f20fe3e4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20f806ea40 con 0x7f20f806c990 2023-09-30T22:31:24.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.453+0000 7f20f7fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20f806c990 0x7f20f806cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:24.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.453+0000 7f20f77fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20f806d2a0 0x7f20f813c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:24.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.453+0000 7f20f7fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20f806c990 0x7f20f806cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51454/0 (socket says 172.21.15.40:51454) 2023-09-30T22:31:24.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.453+0000 7f20f7fff700 1 -- 172.21.15.40:0/4168379230 learned_addr learned my addr 172.21.15.40:0/4168379230 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:24.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.453+0000 7f20f7fff700 1 -- 172.21.15.40:0/4168379230 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20f806d2a0 msgr2=0x7f20f813c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:24.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.453+0000 7f20f7fff700 1 --2- 172.21.15.40:0/4168379230 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20f806d2a0 0x7f20f813c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.453+0000 7f20f7fff700 1 -- 172.21.15.40:0/4168379230 >> v1:172.21.15.40:6789/0 conn(0x7f20f813c8f0 legacy=0x7f20f813ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:24.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.453+0000 7f20f7fff700 1 -- 172.21.15.40:0/4168379230 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f8072050 con 0x7f20f806c990 2023-09-30T22:31:24.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.453+0000 7f20f7fff700 1 --2- 172.21.15.40:0/4168379230 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20f806c990 0x7f20f806cd60 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f20e8009920 tx=0x7f20e8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c21243ddf2054e15 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:24.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.454+0000 7f20f6ffd700 1 -- 172.21.15.40:0/4168379230 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e8011830 con 0x7f20f806c990 2023-09-30T22:31:24.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.454+0000 7f20f6ffd700 1 -- 172.21.15.40:0/4168379230 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e8011990 con 0x7f20f806c990 2023-09-30T22:31:24.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.454+0000 7f20f6ffd700 1 -- 172.21.15.40:0/4168379230 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e8011d20 con 0x7f20f806c990 2023-09-30T22:31:24.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.454+0000 7f20fe3e4700 1 -- 172.21.15.40:0/4168379230 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20f806c990 msgr2=0x7f20f806cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:24.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.454+0000 7f20fe3e4700 1 --2- 172.21.15.40:0/4168379230 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20f806c990 0x7f20f806cd60 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f20e8009920 tx=0x7f20e8009c30 comp rx=0 tx=0).stop 2023-09-30T22:31:24.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.454+0000 7f20fe3e4700 1 -- 172.21.15.40:0/4168379230 shutdown_connections 2023-09-30T22:31:24.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.454+0000 7f20fe3e4700 1 --2- 172.21.15.40:0/4168379230 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20f806c990 0x7f20f806cd60 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.454+0000 7f20fe3e4700 1 --2- 172.21.15.40:0/4168379230 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20f806d2a0 0x7f20f813c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.454+0000 7f20fe3e4700 1 -- 172.21.15.40:0/4168379230 >> 172.21.15.40:0/4168379230 conn(0x7f20f80a41a0 msgr2=0x7f20f80a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:24.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.454+0000 7f20fe3e4700 1 -- 172.21.15.40:0/4168379230 shutdown_connections 2023-09-30T22:31:24.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.454+0000 7f20fe3e4700 1 -- 172.21.15.40:0/4168379230 wait complete. 2023-09-30T22:31:24.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.456+0000 7f20fe3e4700 1 Processor -- start 2023-09-30T22:31:24.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.456+0000 7f20fe3e4700 1 -- start start 2023-09-30T22:31:24.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.457+0000 7f20fe3e4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20f806c990 0x7f20f808e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:24.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.457+0000 7f20fe3e4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20f806d2a0 0x7f20f813f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:24.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.457+0000 7f20fe3e4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20f813c8f0 0x7f20f813f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:24.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.457+0000 7f20fe3e4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f809b390 con 0x7f20f806c990 2023-09-30T22:31:24.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.457+0000 7f20fe3e4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f80a0850 con 0x7f20f806d2a0 2023-09-30T22:31:24.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.457+0000 7f20fe3e4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20f813dd00 con 0x7f20f813c8f0 2023-09-30T22:31:24.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.457+0000 7f20f7fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20f806c990 0x7f20f808e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:24.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.457+0000 7f20f7fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20f806c990 0x7f20f808e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42846/0 (socket says 172.21.15.40:42846) 2023-09-30T22:31:24.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.457+0000 7f20f7fff700 1 -- 172.21.15.40:0/3417134464 learned_addr learned my addr 172.21.15.40:0/3417134464 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:24.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.457+0000 7f20fc981700 1 --2- 172.21.15.40:0/3417134464 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20f813c8f0 0x7f20f813f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:24.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.457+0000 7f20f77fe700 1 --2- 172.21.15.40:0/3417134464 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20f806d2a0 0x7f20f813f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:24.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.457+0000 7f20f7fff700 1 -- 172.21.15.40:0/3417134464 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20f813c8f0 msgr2=0x7f20f813f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:24.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.457+0000 7f20f7fff700 1 --2- 172.21.15.40:0/3417134464 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20f813c8f0 0x7f20f813f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.457+0000 7f20f7fff700 1 -- 172.21.15.40:0/3417134464 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20f806d2a0 msgr2=0x7f20f813f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:24.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.457+0000 7f20f7fff700 1 --2- 172.21.15.40:0/3417134464 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20f806d2a0 0x7f20f813f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.457+0000 7f20f7fff700 1 -- 172.21.15.40:0/3417134464 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e8009550 con 0x7f20f806c990 2023-09-30T22:31:24.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.458+0000 7f20f7fff700 1 --2- 172.21.15.40:0/3417134464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20f806c990 0x7f20f808e980 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f20e8009130 tx=0x7f20e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:24.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.458+0000 7f20f4ff9700 1 -- 172.21.15.40:0/3417134464 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e8004450 con 0x7f20f806c990 2023-09-30T22:31:24.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.458+0000 7f20fe3e4700 1 -- 172.21.15.40:0/3417134464 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f813e290 con 0x7f20f806c990 2023-09-30T22:31:24.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.458+0000 7f20f4ff9700 1 -- 172.21.15.40:0/3417134464 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e801f070 con 0x7f20f806c990 2023-09-30T22:31:24.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.458+0000 7f20f4ff9700 1 -- 172.21.15.40:0/3417134464 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e80038a0 con 0x7f20f806c990 2023-09-30T22:31:24.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.458+0000 7f20fe3e4700 1 -- 172.21.15.40:0/3417134464 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f813fbd0 con 0x7f20f806c990 2023-09-30T22:31:24.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.460+0000 7f20de7fc700 1 -- 172.21.15.40:0/3417134464 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d00052e0 con 0x7f20f806c990 2023-09-30T22:31:24.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.460+0000 7f20f4ff9700 1 -- 172.21.15.40:0/3417134464 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f20e8003a00 con 0x7f20f806c990 2023-09-30T22:31:24.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.460+0000 7f20f4ff9700 1 -- 172.21.15.40:0/3417134464 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f20e8021070 con 0x7f20f806c990 2023-09-30T22:31:24.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.469+0000 7f20f4ff9700 1 -- 172.21.15.40:0/3417134464 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f20e80045b0 con 0x7f20f806c990 2023-09-30T22:31:24.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.564+0000 7f53a45fa700 1 -- 172.21.15.40:0/411209063 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f539c062380 con 0x7f539c135940 2023-09-30T22:31:24.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.564+0000 7f5392ffd700 1 -- 172.21.15.40:0/411209063 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5394008910 con 0x7f539c135940 2023-09-30T22:31:24.565 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:24.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.566+0000 7f53a45fa700 1 -- 172.21.15.40:0/411209063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f539c135940 msgr2=0x7f539c136250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:24.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.566+0000 7f53a45fa700 1 --2- 172.21.15.40:0/411209063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f539c135940 0x7f539c136250 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f539400ce80 tx=0x7f539400cf60 comp rx=0 tx=0).stop 2023-09-30T22:31:24.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.566+0000 7f53a45fa700 1 -- 172.21.15.40:0/411209063 shutdown_connections 2023-09-30T22:31:24.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.566+0000 7f53a45fa700 1 --2- 172.21.15.40:0/411209063 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f539c09d450 0x7f539c12da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.566+0000 7f53a45fa700 1 --2- 172.21.15.40:0/411209063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f539c135940 0x7f539c136250 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.566+0000 7f53a45fa700 1 --2- 172.21.15.40:0/411209063 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f539c09df30 0x7f539c135d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.566+0000 7f53a45fa700 1 -- 172.21.15.40:0/411209063 >> 172.21.15.40:0/411209063 conn(0x7f539c0a2a00 msgr2=0x7f539c1303c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:24.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.566+0000 7f53a45fa700 1 -- 172.21.15.40:0/411209063 shutdown_connections 2023-09-30T22:31:24.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.566+0000 7f53a45fa700 1 -- 172.21.15.40:0/411209063 wait complete. 2023-09-30T22:31:24.580 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:24.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.599+0000 7f4197620700 1 -- 172.21.15.40:0/1242310215 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4190062380 con 0x7f419006f070 2023-09-30T22:31:24.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.600+0000 7f4185ffb700 1 -- 172.21.15.40:0/1242310215 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f418c018260 con 0x7f419006f070 2023-09-30T22:31:24.601 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:24.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.602+0000 7f4197620700 1 -- 172.21.15.40:0/1242310215 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f419006f070 msgr2=0x7f4190134b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:24.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.602+0000 7f4197620700 1 --2- 172.21.15.40:0/1242310215 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f419006f070 0x7f4190134b10 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f418c00c4e0 tx=0x7f418c00c7f0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.602+0000 7f4197620700 1 -- 172.21.15.40:0/1242310215 shutdown_connections 2023-09-30T22:31:24.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.602+0000 7f4197620700 1 --2- 172.21.15.40:0/1242310215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41901371b0 0x7f4190135590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.602+0000 7f4197620700 1 --2- 172.21.15.40:0/1242310215 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f419006f070 0x7f4190134b10 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.602+0000 7f4197620700 1 --2- 172.21.15.40:0/1242310215 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f419006fb50 0x7f4190135050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.602+0000 7f4197620700 1 -- 172.21.15.40:0/1242310215 >> 172.21.15.40:0/1242310215 conn(0x7f41900a41a0 msgr2=0x7f41900a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:24.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.602+0000 7f4197620700 1 -- 172.21.15.40:0/1242310215 shutdown_connections 2023-09-30T22:31:24.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.602+0000 7f4197620700 1 -- 172.21.15.40:0/1242310215 wait complete. 2023-09-30T22:31:24.615 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:24.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.614+0000 7f19b2ffd700 1 -- 172.21.15.40:0/1633036608 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f19c8121bc0 con 0x7f19c811f200 2023-09-30T22:31:24.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.614+0000 7f19c57fa700 1 -- 172.21.15.40:0/1633036608 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f19c0018020 con 0x7f19c811f200 2023-09-30T22:31:24.616 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:24.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.616+0000 7f19b2ffd700 1 -- 172.21.15.40:0/1633036608 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f19c811f200 msgr2=0x7f19c81ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:24.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.616+0000 7f19b2ffd700 1 --2- 172.21.15.40:0/1633036608 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f19c811f200 0x7f19c81ce8b0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f19c000efc0 tx=0x7f19c000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.616+0000 7f19b2ffd700 1 -- 172.21.15.40:0/1633036608 shutdown_connections 2023-09-30T22:31:24.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.616+0000 7f19b2ffd700 1 --2- 172.21.15.40:0/1633036608 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f19c811f200 0x7f19c81ce8b0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.616+0000 7f19b2ffd700 1 --2- 172.21.15.40:0/1633036608 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f19c809d920 0x7f19c811e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.616+0000 7f19b2ffd700 1 --2- 172.21.15.40:0/1633036608 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19c809e400 0x7f19c811ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.616+0000 7f19b2ffd700 1 -- 172.21.15.40:0/1633036608 >> 172.21.15.40:0/1633036608 conn(0x7f19c809fb20 msgr2=0x7f19c8070900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:24.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.617+0000 7f19b2ffd700 1 -- 172.21.15.40:0/1633036608 shutdown_connections 2023-09-30T22:31:24.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.617+0000 7f19b2ffd700 1 -- 172.21.15.40:0/1633036608 wait complete. 2023-09-30T22:31:24.629 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:24.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.673+0000 7f20de7fc700 1 -- 172.21.15.40:0/3417134464 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f20d0005590 con 0x7f20f806c990 2023-09-30T22:31:24.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.673+0000 7f20f4ff9700 1 -- 172.21.15.40:0/3417134464 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f20e8015020 con 0x7f20f806c990 2023-09-30T22:31:24.674 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:24.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.675+0000 7f20de7fc700 1 -- 172.21.15.40:0/3417134464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20f806c990 msgr2=0x7f20f808e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:24.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.675+0000 7f20de7fc700 1 --2- 172.21.15.40:0/3417134464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20f806c990 0x7f20f808e980 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f20e8009130 tx=0x7f20e8004750 comp rx=0 tx=0).stop 2023-09-30T22:31:24.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.675+0000 7f20de7fc700 1 -- 172.21.15.40:0/3417134464 shutdown_connections 2023-09-30T22:31:24.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.675+0000 7f20de7fc700 1 --2- 172.21.15.40:0/3417134464 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f20f813c8f0 0x7f20f813f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.675+0000 7f20de7fc700 1 --2- 172.21.15.40:0/3417134464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20f806c990 0x7f20f808e980 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.675+0000 7f20de7fc700 1 --2- 172.21.15.40:0/3417134464 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20f806d2a0 0x7f20f813f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:24.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.675+0000 7f20de7fc700 1 -- 172.21.15.40:0/3417134464 >> 172.21.15.40:0/3417134464 conn(0x7f20f80a41a0 msgr2=0x7f20f80978e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:24.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.675+0000 7f20de7fc700 1 -- 172.21.15.40:0/3417134464 shutdown_connections 2023-09-30T22:31:24.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:24.675+0000 7f20de7fc700 1 -- 172.21.15.40:0/3417134464 wait complete. 2023-09-30T22:31:24.688 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:25.581 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:25.616 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:25.630 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:25.689 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:25.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.726+0000 7f43e16d3700 1 Processor -- start 2023-09-30T22:31:25.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.726+0000 7f43e16d3700 1 -- start start 2023-09-30T22:31:25.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.726+0000 7f43e16d3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43dc09d920 0x7f43dc09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:25.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.726+0000 7f43e16d3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f43dc09e230 0x7f43dc1308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:25.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.726+0000 7f43e16d3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43dc09adf0 con 0x7f43dc130de0 2023-09-30T22:31:25.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.726+0000 7f43e16d3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc09edf0 con 0x7f43dc09d920 2023-09-30T22:31:25.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.726+0000 7f43e16d3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc09b660 con 0x7f43dc09e230 2023-09-30T22:31:25.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.726+0000 7f43db7fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f43dc130de0 0x7f43dc137d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50640/0 (socket says 172.21.15.40:50640) 2023-09-30T22:31:25.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.726+0000 7f43db7fe700 1 -- 172.21.15.40:0/723324597 learned_addr learned my addr 172.21.15.40:0/723324597 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:25.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.726+0000 7f43daffd700 1 --2- 172.21.15.40:0/723324597 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43dc09d920 0x7f43dc09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:25.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.726+0000 7f43da7fc700 1 --2- 172.21.15.40:0/723324597 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f43dc09e230 0x7f43dc1308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:25.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.727+0000 7f43d9ffb700 1 -- 172.21.15.40:0/723324597 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 946504173 0 0) 0x7f43dc09adf0 con 0x7f43dc130de0 2023-09-30T22:31:25.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.727+0000 7f43da7fc700 1 -- 172.21.15.40:0/723324597 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43dc09d920 msgr2=0x7f43dc09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:25.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.727+0000 7f43da7fc700 1 --2- 172.21.15.40:0/723324597 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43dc09d920 0x7f43dc09dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.727+0000 7f43da7fc700 1 -- 172.21.15.40:0/723324597 >> v1:172.21.15.40:6789/0 conn(0x7f43dc130de0 legacy=0x7f43dc137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:25.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.727+0000 7f43da7fc700 1 -- 172.21.15.40:0/723324597 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43dc09a6e0 con 0x7f43dc09e230 2023-09-30T22:31:25.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.727+0000 7f43da7fc700 1 --2- 172.21.15.40:0/723324597 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f43dc09e230 0x7f43dc1308a0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f43d000dfc0 tx=0x7f43d000f330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdab1a03e1c860e6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:25.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.727+0000 7f43d9ffb700 1 -- 172.21.15.40:0/723324597 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d0012070 con 0x7f43dc09e230 2023-09-30T22:31:25.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.727+0000 7f43d9ffb700 1 -- 172.21.15.40:0/723324597 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d0005d10 con 0x7f43dc09e230 2023-09-30T22:31:25.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.727+0000 7f43d9ffb700 1 -- 172.21.15.40:0/723324597 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d000fc70 con 0x7f43dc09e230 2023-09-30T22:31:25.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.728+0000 7f43e16d3700 1 -- 172.21.15.40:0/723324597 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f43dc09e230 msgr2=0x7f43dc1308a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:25.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.728+0000 7f43e16d3700 1 --2- 172.21.15.40:0/723324597 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f43dc09e230 0x7f43dc1308a0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f43d000dfc0 tx=0x7f43d000f330 comp rx=0 tx=0).stop 2023-09-30T22:31:25.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.728+0000 7f43e16d3700 1 -- 172.21.15.40:0/723324597 shutdown_connections 2023-09-30T22:31:25.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.728+0000 7f43e16d3700 1 --2- 172.21.15.40:0/723324597 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43dc09d920 0x7f43dc09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.728+0000 7f43e16d3700 1 --2- 172.21.15.40:0/723324597 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f43dc09e230 0x7f43dc1308a0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.728+0000 7f43e16d3700 1 -- 172.21.15.40:0/723324597 >> 172.21.15.40:0/723324597 conn(0x7f43dc09fb20 msgr2=0x7f43dc09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:25.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.729+0000 7f43e16d3700 1 -- 172.21.15.40:0/723324597 shutdown_connections 2023-09-30T22:31:25.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.729+0000 7f43e16d3700 1 -- 172.21.15.40:0/723324597 wait complete. 2023-09-30T22:31:25.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.730+0000 7f43e16d3700 1 Processor -- start 2023-09-30T22:31:25.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.730+0000 7f43e16d3700 1 -- start start 2023-09-30T22:31:25.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.731+0000 7f43e16d3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43dc09d920 0x7f43dc11d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:25.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.731+0000 7f43e16d3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43dc09e230 0x7f43dc11dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:25.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.731+0000 7f43e16d3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f43dc130de0 0x7f43dc1c3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:25.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.731+0000 7f43e16d3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc06b260 con 0x7f43dc09e230 2023-09-30T22:31:25.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.731+0000 7f43e16d3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc12f690 con 0x7f43dc09d920 2023-09-30T22:31:25.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.731+0000 7f43e16d3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc11d320 con 0x7f43dc130de0 2023-09-30T22:31:25.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.731+0000 7f43daffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43dc09d920 0x7f43dc11d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:25.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.731+0000 7f43daffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43dc09d920 0x7f43dc11d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50540/0 (socket says 172.21.15.40:50540) 2023-09-30T22:31:25.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.731+0000 7f43daffd700 1 -- 172.21.15.40:0/1076008469 learned_addr learned my addr 172.21.15.40:0/1076008469 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:25.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.731+0000 7f43db7fe700 1 --2- 172.21.15.40:0/1076008469 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f43dc130de0 0x7f43dc1c3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:25.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.731+0000 7f43da7fc700 1 --2- 172.21.15.40:0/1076008469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43dc09e230 0x7f43dc11dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:25.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.732+0000 7f43daffd700 1 -- 172.21.15.40:0/1076008469 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f43dc130de0 msgr2=0x7f43dc1c3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:25.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.732+0000 7f43daffd700 1 --2- 172.21.15.40:0/1076008469 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f43dc130de0 0x7f43dc1c3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.732+0000 7f43daffd700 1 -- 172.21.15.40:0/1076008469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43dc09e230 msgr2=0x7f43dc11dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:25.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.732+0000 7f43daffd700 1 --2- 172.21.15.40:0/1076008469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43dc09e230 0x7f43dc11dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.732+0000 7f43daffd700 1 -- 172.21.15.40:0/1076008469 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d000dca0 con 0x7f43dc09d920 2023-09-30T22:31:25.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.732+0000 7f43db7fe700 1 --2- 172.21.15.40:0/1076008469 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f43dc130de0 0x7f43dc1c3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:25.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.732+0000 7f43daffd700 1 --2- 172.21.15.40:0/1076008469 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43dc09d920 0x7f43dc11d7e0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f43cc00e990 tx=0x7f43cc00eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:25.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.732+0000 7f43c37fe700 1 -- 172.21.15.40:0/1076008469 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc0096f0 con 0x7f43dc09d920 2023-09-30T22:31:25.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.732+0000 7f43e16d3700 1 -- 172.21.15.40:0/1076008469 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43dc11e260 con 0x7f43dc09d920 2023-09-30T22:31:25.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.732+0000 7f43c37fe700 1 -- 172.21.15.40:0/1076008469 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43cc00c690 con 0x7f43dc09d920 2023-09-30T22:31:25.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.732+0000 7f43c37fe700 1 -- 172.21.15.40:0/1076008469 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc00ca00 con 0x7f43dc09d920 2023-09-30T22:31:25.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.732+0000 7f43e16d3700 1 -- 172.21.15.40:0/1076008469 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43dc11f5a0 con 0x7f43dc09d920 2023-09-30T22:31:25.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.734+0000 7f43e16d3700 1 -- 172.21.15.40:0/1076008469 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43dc120450 con 0x7f43dc09d920 2023-09-30T22:31:25.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.734+0000 7f43c37fe700 1 -- 172.21.15.40:0/1076008469 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f43cc00cb60 con 0x7f43dc09d920 2023-09-30T22:31:25.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.734+0000 7f43c37fe700 1 -- 172.21.15.40:0/1076008469 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f43cc03fb80 con 0x7f43dc09d920 2023-09-30T22:31:25.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.743+0000 7f43c37fe700 1 -- 172.21.15.40:0/1076008469 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f43dc120450 con 0x7f43dc09d920 2023-09-30T22:31:25.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.765+0000 7f5ae93e6700 1 Processor -- start 2023-09-30T22:31:25.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.765+0000 7f5ae93e6700 1 -- start start 2023-09-30T22:31:25.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.766+0000 7f5ae93e6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5ae409c890 0x7f5ae409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:25.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.766+0000 7f5ae93e6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ae409e480 0x7f5ae413bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:25.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.766+0000 7f5ae93e6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ae40a2600 con 0x7f5ae409d920 2023-09-30T22:31:25.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.766+0000 7f5ae93e6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ae40a29d0 con 0x7f5ae409c890 2023-09-30T22:31:25.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.766+0000 7f5ae93e6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae409fb40 con 0x7f5ae409e480 2023-09-30T22:31:25.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.766+0000 7f5ae2ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5ae409c890 0x7f5ae409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:25.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.766+0000 7f5ae2ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5ae409c890 0x7f5ae409cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42858/0 (socket says 172.21.15.40:42858) 2023-09-30T22:31:25.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.766+0000 7f5ae2ffd700 1 -- 172.21.15.40:0/2331777480 learned_addr learned my addr 172.21.15.40:0/2331777480 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:25.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.766+0000 7f5ae37fe700 1 --2- 172.21.15.40:0/2331777480 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ae409e480 0x7f5ae413bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:25.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.767+0000 7f5ae2ffd700 1 -- 172.21.15.40:0/2331777480 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ae409e480 msgr2=0x7f5ae413bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:25.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.767+0000 7f5ae2ffd700 1 --2- 172.21.15.40:0/2331777480 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ae409e480 0x7f5ae413bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.767+0000 7f5ae2ffd700 1 -- 172.21.15.40:0/2331777480 >> v1:172.21.15.40:6789/0 conn(0x7f5ae409d920 legacy=0x7f5ae409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:25.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.767+0000 7f5ae2ffd700 1 -- 172.21.15.40:0/2331777480 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae409fed0 con 0x7f5ae409c890 2023-09-30T22:31:25.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.767+0000 7f5ae2ffd700 1 --2- 172.21.15.40:0/2331777480 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ae409c890 0x7f5ae409cc60 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4006fd0 tx=0x7f5ad4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d62d1f5d0031a6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:25.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.767+0000 7f5ae1ffb700 1 -- 172.21.15.40:0/2331777480 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4005e30 con 0x7f5ae409c890 2023-09-30T22:31:25.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.767+0000 7f5ae1ffb700 1 -- 172.21.15.40:0/2331777480 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad4004030 con 0x7f5ae409c890 2023-09-30T22:31:25.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.767+0000 7f5ae1ffb700 1 -- 172.21.15.40:0/2331777480 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad40043e0 con 0x7f5ae409c890 2023-09-30T22:31:25.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.768+0000 7f5ae93e6700 1 -- 172.21.15.40:0/2331777480 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ae409c890 msgr2=0x7f5ae409cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:25.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.768+0000 7f5ae93e6700 1 --2- 172.21.15.40:0/2331777480 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ae409c890 0x7f5ae409cc60 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4006fd0 tx=0x7f5ad4009bd0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.768+0000 7f5ae93e6700 1 -- 172.21.15.40:0/2331777480 shutdown_connections 2023-09-30T22:31:25.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.768+0000 7f5ae93e6700 1 --2- 172.21.15.40:0/2331777480 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ae409e480 0x7f5ae413bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.768+0000 7f5ae93e6700 1 --2- 172.21.15.40:0/2331777480 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ae409c890 0x7f5ae409cc60 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.768+0000 7f5ae93e6700 1 -- 172.21.15.40:0/2331777480 >> 172.21.15.40:0/2331777480 conn(0x7f5ae40a7080 msgr2=0x7f5ae40a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:25.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.768+0000 7f5ae93e6700 1 -- 172.21.15.40:0/2331777480 shutdown_connections 2023-09-30T22:31:25.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.768+0000 7f5ae93e6700 1 -- 172.21.15.40:0/2331777480 wait complete. 2023-09-30T22:31:25.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.770+0000 7f5ae93e6700 1 Processor -- start 2023-09-30T22:31:25.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.770+0000 7f5ae93e6700 1 -- start start 2023-09-30T22:31:25.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.770+0000 7f5ae93e6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ae409c890 0x7f5ae412d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:25.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.770+0000 7f5ae93e6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ae409d920 0x7f5ae412db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:25.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.770+0000 7f5ae93e6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ae409e480 0x7f5ae412e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:25.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.770+0000 7f5ae93e6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae408f560 con 0x7f5ae409c890 2023-09-30T22:31:25.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.770+0000 7f5ae93e6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae4130820 con 0x7f5ae409e480 2023-09-30T22:31:25.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.770+0000 7f5ae93e6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae409bc20 con 0x7f5ae409d920 2023-09-30T22:31:25.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.771+0000 7f5ae37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ae409e480 0x7f5ae412e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:25.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.771+0000 7f5ae37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ae409e480 0x7f5ae412e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50572/0 (socket says 172.21.15.40:50572) 2023-09-30T22:31:25.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.771+0000 7f5ae37fe700 1 -- 172.21.15.40:0/3331417159 learned_addr learned my addr 172.21.15.40:0/3331417159 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:25.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.771+0000 7f5ae2ffd700 1 --2- 172.21.15.40:0/3331417159 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ae409c890 0x7f5ae412d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:25.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.771+0000 7f5ae2ffd700 1 -- 172.21.15.40:0/3331417159 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ae409d920 msgr2=0x7f5ae412db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:25.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.771+0000 7f5ae2ffd700 1 --2- 172.21.15.40:0/3331417159 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ae409d920 0x7f5ae412db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.771+0000 7f5ae2ffd700 1 -- 172.21.15.40:0/3331417159 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ae409e480 msgr2=0x7f5ae412e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:25.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.771+0000 7f5ae2ffd700 1 --2- 172.21.15.40:0/3331417159 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ae409e480 0x7f5ae412e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.771+0000 7f5ae2ffd700 1 -- 172.21.15.40:0/3331417159 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad4009500 con 0x7f5ae409c890 2023-09-30T22:31:25.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.771+0000 7f5ae37fe700 1 --2- 172.21.15.40:0/3331417159 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ae409e480 0x7f5ae412e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:25.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.771+0000 7f5ae2ffd700 1 --2- 172.21.15.40:0/3331417159 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ae409c890 0x7f5ae412d5d0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4013000 tx=0x7f5ad4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:25.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.771+0000 7f5acb7fe700 1 -- 172.21.15.40:0/3331417159 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4006af0 con 0x7f5ae409c890 2023-09-30T22:31:25.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.771+0000 7f5acb7fe700 1 -- 172.21.15.40:0/3331417159 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad40045d0 con 0x7f5ae409c890 2023-09-30T22:31:25.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.771+0000 7f5acb7fe700 1 -- 172.21.15.40:0/3331417159 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad401d650 con 0x7f5ae409c890 2023-09-30T22:31:25.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.771+0000 7f5ae93e6700 1 -- 172.21.15.40:0/3331417159 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae40a5da0 con 0x7f5ae409c890 2023-09-30T22:31:25.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.772+0000 7f5ae93e6700 1 -- 172.21.15.40:0/3331417159 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae4130ae0 con 0x7f5ae409c890 2023-09-30T22:31:25.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.772+0000 7f5acb7fe700 1 -- 172.21.15.40:0/3331417159 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5ad401d7b0 con 0x7f5ae409c890 2023-09-30T22:31:25.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.773+0000 7f5acb7fe700 1 -- 172.21.15.40:0/3331417159 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5ad40409e0 con 0x7f5ae409c890 2023-09-30T22:31:25.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.773+0000 7f5ae93e6700 1 -- 172.21.15.40:0/3331417159 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ae4062380 con 0x7f5ae409c890 2023-09-30T22:31:25.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.778+0000 7f5acb7fe700 1 -- 172.21.15.40:0/3331417159 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5ad4021020 con 0x7f5ae409c890 2023-09-30T22:31:25.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.819+0000 7f0b877f7700 1 Processor -- start 2023-09-30T22:31:25.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.820+0000 7f0b877f7700 1 -- start start 2023-09-30T22:31:25.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.820+0000 7f0b877f7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0b8009d920 0x7f0b8009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:25.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.820+0000 7f0b877f7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0b80130fb0 0x7f0b80138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:25.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.820+0000 7f0b877f7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b8009adf0 con 0x7f0b8009e230 2023-09-30T22:31:25.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.820+0000 7f0b877f7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8009edf0 con 0x7f0b80130fb0 2023-09-30T22:31:25.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.820+0000 7f0b877f7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8009b660 con 0x7f0b8009d920 2023-09-30T22:31:25.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.821+0000 7f0b84d92700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f0b8009e230 0x7f0b801308a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50668/0 (socket says 172.21.15.40:50668) 2023-09-30T22:31:25.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.821+0000 7f0b85593700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0b8009d920 0x7f0b8009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:25.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.821+0000 7f0b84d92700 1 -- 172.21.15.40:0/2209429739 learned_addr learned my addr 172.21.15.40:0/2209429739 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:25.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.821+0000 7f0b85d94700 1 --2- 172.21.15.40:0/2209429739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0b80130fb0 0x7f0b80138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:25.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.821+0000 7f0b85593700 1 -- 172.21.15.40:0/2209429739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0b80130fb0 msgr2=0x7f0b80138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:25.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.821+0000 7f0b85593700 1 --2- 172.21.15.40:0/2209429739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0b80130fb0 0x7f0b80138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.821+0000 7f0b85593700 1 -- 172.21.15.40:0/2209429739 >> v1:172.21.15.40:6789/0 conn(0x7f0b8009e230 legacy=0x7f0b801308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:25.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.821+0000 7f0b77fff700 1 -- 172.21.15.40:0/2209429739 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3848086387 0 0) 0x7f0b8009adf0 con 0x7f0b8009e230 2023-09-30T22:31:25.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.821+0000 7f0b85593700 1 -- 172.21.15.40:0/2209429739 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8009a6e0 con 0x7f0b8009d920 2023-09-30T22:31:25.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.821+0000 7f0b85593700 1 --2- 172.21.15.40:0/2209429739 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0b8009d920 0x7f0b8009dcf0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c009850 tx=0x7f0b7c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=334212e5a0c59eb7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:25.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.821+0000 7f0b77fff700 1 -- 172.21.15.40:0/2209429739 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c005e30 con 0x7f0b8009d920 2023-09-30T22:31:25.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.821+0000 7f0b77fff700 1 -- 172.21.15.40:0/2209429739 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7c006030 con 0x7f0b8009d920 2023-09-30T22:31:25.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.821+0000 7f0b77fff700 1 -- 172.21.15.40:0/2209429739 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c0063a0 con 0x7f0b8009d920 2023-09-30T22:31:25.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.822+0000 7f0b877f7700 1 -- 172.21.15.40:0/2209429739 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0b8009d920 msgr2=0x7f0b8009dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:25.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.822+0000 7f0b877f7700 1 --2- 172.21.15.40:0/2209429739 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0b8009d920 0x7f0b8009dcf0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c009850 tx=0x7f0b7c009b60 comp rx=0 tx=0).stop 2023-09-30T22:31:25.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.822+0000 7f0b877f7700 1 -- 172.21.15.40:0/2209429739 shutdown_connections 2023-09-30T22:31:25.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.822+0000 7f0b877f7700 1 --2- 172.21.15.40:0/2209429739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0b80130fb0 0x7f0b80138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.822+0000 7f0b877f7700 1 --2- 172.21.15.40:0/2209429739 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0b8009d920 0x7f0b8009dcf0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.822+0000 7f0b877f7700 1 -- 172.21.15.40:0/2209429739 >> 172.21.15.40:0/2209429739 conn(0x7f0b8009fb20 msgr2=0x7f0b8009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:25.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.823+0000 7f0b877f7700 1 -- 172.21.15.40:0/2209429739 shutdown_connections 2023-09-30T22:31:25.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.823+0000 7f0b877f7700 1 -- 172.21.15.40:0/2209429739 wait complete. 2023-09-30T22:31:25.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.823+0000 7f0b877f7700 1 Processor -- start 2023-09-30T22:31:25.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.824+0000 7f0b877f7700 1 -- start start 2023-09-30T22:31:25.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.824+0000 7f0b877f7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0b8009d920 0x7f0b80126800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:25.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.824+0000 7f0b877f7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0b8009e230 0x7f0b80126d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:25.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.824+0000 7f0b877f7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b80130fb0 0x7f0b80127280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:25.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.824+0000 7f0b877f7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8012f840 con 0x7f0b80130fb0 2023-09-30T22:31:25.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.824+0000 7f0b877f7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8012dac0 con 0x7f0b8009e230 2023-09-30T22:31:25.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.824+0000 7f0b877f7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b80139b40 con 0x7f0b8009d920 2023-09-30T22:31:25.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.824+0000 7f0b84d92700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0b8009e230 0x7f0b80126d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:25.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.824+0000 7f0b85593700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0b8009d920 0x7f0b80126800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:25.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.824+0000 7f0b84d92700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0b8009e230 0x7f0b80126d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50592/0 (socket says 172.21.15.40:50592) 2023-09-30T22:31:25.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.824+0000 7f0b84d92700 1 -- 172.21.15.40:0/3753308195 learned_addr learned my addr 172.21.15.40:0/3753308195 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:25.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.825+0000 7f0b85d94700 1 --2- 172.21.15.40:0/3753308195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b80130fb0 0x7f0b80127280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:25.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.825+0000 7f0b84d92700 1 -- 172.21.15.40:0/3753308195 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0b8009d920 msgr2=0x7f0b80126800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:25.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.825+0000 7f0b84d92700 1 --2- 172.21.15.40:0/3753308195 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0b8009d920 0x7f0b80126800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.825+0000 7f0b84d92700 1 -- 172.21.15.40:0/3753308195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b80130fb0 msgr2=0x7f0b80127280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:25.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.825+0000 7f0b84d92700 1 --2- 172.21.15.40:0/3753308195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b80130fb0 0x7f0b80127280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.825+0000 7f0b84d92700 1 -- 172.21.15.40:0/3753308195 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7c009430 con 0x7f0b8009e230 2023-09-30T22:31:25.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.825+0000 7f0b84d92700 1 --2- 172.21.15.40:0/3753308195 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0b8009e230 0x7f0b80126d40 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f0b70001eb0 tx=0x7f0b7000c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:25.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.825+0000 7f0b75ffb700 1 -- 172.21.15.40:0/3753308195 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b70004c80 con 0x7f0b8009e230 2023-09-30T22:31:25.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.825+0000 7f0b75ffb700 1 -- 172.21.15.40:0/3753308195 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b70004de0 con 0x7f0b8009e230 2023-09-30T22:31:25.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.825+0000 7f0b877f7700 1 -- 172.21.15.40:0/3753308195 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b8009cb00 con 0x7f0b8009e230 2023-09-30T22:31:25.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.825+0000 7f0b75ffb700 1 -- 172.21.15.40:0/3753308195 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b70007310 con 0x7f0b8009e230 2023-09-30T22:31:25.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.826+0000 7f0b877f7700 1 -- 172.21.15.40:0/3753308195 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b801301d0 con 0x7f0b8009e230 2023-09-30T22:31:25.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.826+0000 7f0b75ffb700 1 -- 172.21.15.40:0/3753308195 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0b70007470 con 0x7f0b8009e230 2023-09-30T22:31:25.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.827+0000 7f0b75ffb700 1 -- 172.21.15.40:0/3753308195 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f0b7003f300 con 0x7f0b8009e230 2023-09-30T22:31:25.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.827+0000 7f0b877f7700 1 -- 172.21.15.40:0/3753308195 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b80062380 con 0x7f0b8009e230 2023-09-30T22:31:25.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.836+0000 7f0b75ffb700 1 -- 172.21.15.40:0/3753308195 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0b700123b0 con 0x7f0b8009e230 2023-09-30T22:31:25.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.852+0000 7fe66913a700 1 Processor -- start 2023-09-30T22:31:25.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.852+0000 7fe66913a700 1 -- start start 2023-09-30T22:31:25.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.853+0000 7fe66913a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe66409e400 0x7fe664135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:25.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.853+0000 7fe66913a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe664136230 0x7fe664138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:25.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.853+0000 7fe66913a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe66409adf0 con 0x7fe66409d920 2023-09-30T22:31:25.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.853+0000 7fe66913a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe66409edf0 con 0x7fe66409e400 2023-09-30T22:31:25.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.853+0000 7fe66913a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe66409b660 con 0x7fe664136230 2023-09-30T22:31:25.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.853+0000 7fe66259c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe66409e400 0x7fe664135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:25.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.853+0000 7fe66259c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe66409e400 0x7fe664135cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42888/0 (socket says 172.21.15.40:42888) 2023-09-30T22:31:25.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.853+0000 7fe66259c700 1 -- 172.21.15.40:0/2905881549 learned_addr learned my addr 172.21.15.40:0/2905881549 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:25.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.853+0000 7fe66359e700 1 --2- 172.21.15.40:0/2905881549 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe664136230 0x7fe664138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:25.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.854+0000 7fe66359e700 1 -- 172.21.15.40:0/2905881549 >> v2:172.21.15.40:3300/0 conn(0x7fe66409e400 msgr2=0x7fe664135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:25.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.854+0000 7fe66359e700 1 --2- 172.21.15.40:0/2905881549 >> v2:172.21.15.40:3300/0 conn(0x7fe66409e400 0x7fe664135cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.854+0000 7fe66359e700 1 -- 172.21.15.40:0/2905881549 >> v1:172.21.15.40:6789/0 conn(0x7fe66409d920 legacy=0x7fe66409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:25.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.854+0000 7fe66359e700 1 -- 172.21.15.40:0/2905881549 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe66409a6e0 con 0x7fe664136230 2023-09-30T22:31:25.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.854+0000 7fe66359e700 1 --2- 172.21.15.40:0/2905881549 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe664136230 0x7fe664138610 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fe65c009d90 tx=0x7fe65c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ef92011ef6de338 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:25.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.854+0000 7fe661d9b700 1 -- 172.21.15.40:0/2905881549 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c00bd20 con 0x7fe664136230 2023-09-30T22:31:25.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.854+0000 7fe661d9b700 1 -- 172.21.15.40:0/2905881549 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65c00be80 con 0x7fe664136230 2023-09-30T22:31:25.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.854+0000 7fe661d9b700 1 -- 172.21.15.40:0/2905881549 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c0116a0 con 0x7fe664136230 2023-09-30T22:31:25.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.855+0000 7fe66913a700 1 -- 172.21.15.40:0/2905881549 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe664136230 msgr2=0x7fe664138610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:25.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.855+0000 7fe66913a700 1 --2- 172.21.15.40:0/2905881549 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe664136230 0x7fe664138610 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fe65c009d90 tx=0x7fe65c00b330 comp rx=0 tx=0).stop 2023-09-30T22:31:25.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.855+0000 7fe66913a700 1 -- 172.21.15.40:0/2905881549 shutdown_connections 2023-09-30T22:31:25.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.855+0000 7fe66913a700 1 --2- 172.21.15.40:0/2905881549 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe664136230 0x7fe664138610 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.855+0000 7fe66913a700 1 --2- 172.21.15.40:0/2905881549 >> v2:172.21.15.40:3300/0 conn(0x7fe66409e400 0x7fe664135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.855+0000 7fe66913a700 1 -- 172.21.15.40:0/2905881549 >> 172.21.15.40:0/2905881549 conn(0x7fe66409fb20 msgr2=0x7fe66409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:25.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.855+0000 7fe66913a700 1 -- 172.21.15.40:0/2905881549 shutdown_connections 2023-09-30T22:31:25.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.855+0000 7fe66913a700 1 -- 172.21.15.40:0/2905881549 wait complete. 2023-09-30T22:31:25.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.856+0000 7fe66913a700 1 Processor -- start 2023-09-30T22:31:25.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.856+0000 7fe66913a700 1 -- start start 2023-09-30T22:31:25.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.857+0000 7fe66913a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe66409d920 0x7fe6641273a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:25.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.857+0000 7fe66913a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe66409e400 0x7fe6641278e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:25.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.857+0000 7fe66913a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe664136230 0x7fe664127e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:25.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.857+0000 7fe66913a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66412aa00 con 0x7fe66409d920 2023-09-30T22:31:25.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.857+0000 7fe66913a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe66409cb00 con 0x7fe66409e400 2023-09-30T22:31:25.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.857+0000 7fe66913a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6640a2e20 con 0x7fe664136230 2023-09-30T22:31:25.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.857+0000 7fe662d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe66409d920 0x7fe6641273a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:25.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.857+0000 7fe662d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe66409d920 0x7fe6641273a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42904/0 (socket says 172.21.15.40:42904) 2023-09-30T22:31:25.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.857+0000 7fe662d9d700 1 -- 172.21.15.40:0/1629225851 learned_addr learned my addr 172.21.15.40:0/1629225851 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:25.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.857+0000 7fe66359e700 1 --2- 172.21.15.40:0/1629225851 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe664136230 0x7fe664127e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:25.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.857+0000 7fe662d9d700 1 -- 172.21.15.40:0/1629225851 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe664136230 msgr2=0x7fe664127e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:25.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.857+0000 7fe662d9d700 1 --2- 172.21.15.40:0/1629225851 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe664136230 0x7fe664127e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.857+0000 7fe662d9d700 1 -- 172.21.15.40:0/1629225851 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe66409e400 msgr2=0x7fe6641278e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:25.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.857+0000 7fe662d9d700 1 --2- 172.21.15.40:0/1629225851 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe66409e400 0x7fe6641278e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.857+0000 7fe662d9d700 1 -- 172.21.15.40:0/1629225851 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65c009a70 con 0x7fe66409d920 2023-09-30T22:31:25.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.857+0000 7fe66359e700 1 --2- 172.21.15.40:0/1629225851 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe664136230 0x7fe664127e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:25.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.858+0000 7fe662d9d700 1 --2- 172.21.15.40:0/1629225851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe66409d920 0x7fe6641273a0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fe65400c4d0 tx=0x7fe65400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:25.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.858+0000 7fe64b7fe700 1 -- 172.21.15.40:0/1629225851 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6540054e0 con 0x7fe66409d920 2023-09-30T22:31:25.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.858+0000 7fe64b7fe700 1 -- 172.21.15.40:0/1629225851 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe654003680 con 0x7fe66409d920 2023-09-30T22:31:25.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.858+0000 7fe64b7fe700 1 -- 172.21.15.40:0/1629225851 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe654003a30 con 0x7fe66409d920 2023-09-30T22:31:25.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.858+0000 7fe66913a700 1 -- 172.21.15.40:0/1629225851 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe664129d40 con 0x7fe66409d920 2023-09-30T22:31:25.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.858+0000 7fe66913a700 1 -- 172.21.15.40:0/1629225851 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6641292e0 con 0x7fe66409d920 2023-09-30T22:31:25.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.859+0000 7fe64b7fe700 1 -- 172.21.15.40:0/1629225851 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe654003b90 con 0x7fe66409d920 2023-09-30T22:31:25.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.859+0000 7fe64b7fe700 1 -- 172.21.15.40:0/1629225851 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe65403ec20 con 0x7fe66409d920 2023-09-30T22:31:25.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.860+0000 7fe66913a700 1 -- 172.21.15.40:0/1629225851 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe66412a580 con 0x7fe66409d920 2023-09-30T22:31:25.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.869+0000 7fe64b7fe700 1 -- 172.21.15.40:0/1629225851 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe66412a580 con 0x7fe66409d920 2023-09-30T22:31:25.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.985+0000 7f5ae93e6700 1 -- 172.21.15.40:0/3331417159 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5ae4074620 con 0x7f5ae409c890 2023-09-30T22:31:25.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.985+0000 7f5acb7fe700 1 -- 172.21.15.40:0/3331417159 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5ad4016070 con 0x7f5ae409c890 2023-09-30T22:31:25.986 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:25.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.987+0000 7f5ae93e6700 1 -- 172.21.15.40:0/3331417159 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ae409c890 msgr2=0x7f5ae412d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:25.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.987+0000 7f5ae93e6700 1 --2- 172.21.15.40:0/3331417159 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ae409c890 0x7f5ae412d5d0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4013000 tx=0x7f5ad4004750 comp rx=0 tx=0).stop 2023-09-30T22:31:25.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.987+0000 7f5ae93e6700 1 -- 172.21.15.40:0/3331417159 shutdown_connections 2023-09-30T22:31:25.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.987+0000 7f5ae93e6700 1 --2- 172.21.15.40:0/3331417159 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ae409e480 0x7f5ae412e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.987+0000 7f5ae93e6700 1 --2- 172.21.15.40:0/3331417159 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ae409c890 0x7f5ae412d5d0 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.987+0000 7f5ae93e6700 1 --2- 172.21.15.40:0/3331417159 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5ae409d920 0x7f5ae412db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.987+0000 7f5ae93e6700 1 -- 172.21.15.40:0/3331417159 >> 172.21.15.40:0/3331417159 conn(0x7f5ae40a7080 msgr2=0x7f5ae40a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:25.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.988+0000 7f5ae93e6700 1 -- 172.21.15.40:0/3331417159 shutdown_connections 2023-09-30T22:31:25.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.988+0000 7f5ae93e6700 1 -- 172.21.15.40:0/3331417159 wait complete. 2023-09-30T22:31:25.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.997+0000 7f43e16d3700 1 -- 172.21.15.40:0/1076008469 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f43dc120450 con 0x7f43dc09d920 2023-09-30T22:31:25.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:25.998+0000 7f43c37fe700 1 -- 172.21.15.40:0/1076008469 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f43cc021070 con 0x7f43dc09d920 2023-09-30T22:31:25.998 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:26.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:26.000+0000 7f43e16d3700 1 -- 172.21.15.40:0/1076008469 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43dc09d920 msgr2=0x7f43dc11d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:26.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:26.000+0000 7f43e16d3700 1 --2- 172.21.15.40:0/1076008469 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43dc09d920 0x7f43dc11d7e0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f43cc00e990 tx=0x7f43cc00eca0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:26.000+0000 7f43e16d3700 1 -- 172.21.15.40:0/1076008469 shutdown_connections 2023-09-30T22:31:26.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:26.000+0000 7f43e16d3700 1 --2- 172.21.15.40:0/1076008469 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f43dc130de0 0x7f43dc1c3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:26.000+0000 7f43e16d3700 1 --2- 172.21.15.40:0/1076008469 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43dc09d920 0x7f43dc11d7e0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:26.000+0000 7f43e16d3700 1 --2- 172.21.15.40:0/1076008469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43dc09e230 0x7f43dc11dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:26.000+0000 7f43e16d3700 1 -- 172.21.15.40:0/1076008469 >> 172.21.15.40:0/1076008469 conn(0x7f43dc09fb20 msgr2=0x7f43dc12ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:26.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:26.000+0000 7f43e16d3700 1 -- 172.21.15.40:0/1076008469 shutdown_connections 2023-09-30T22:31:26.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:26.000+0000 7f43e16d3700 1 -- 172.21.15.40:0/1076008469 wait complete. 2023-09-30T22:31:26.002 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:26.013 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:26.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:26.038+0000 7f0b877f7700 1 -- 172.21.15.40:0/3753308195 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0b80074720 con 0x7f0b8009e230 2023-09-30T22:31:26.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:26.041+0000 7f0b75ffb700 1 -- 172.21.15.40:0/3753308195 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0b700102c0 con 0x7f0b8009e230 2023-09-30T22:31:26.042 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:26.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:26.043+0000 7f0b877f7700 1 -- 172.21.15.40:0/3753308195 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0b8009e230 msgr2=0x7f0b80126d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:26.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:26.043+0000 7f0b877f7700 1 --2- 172.21.15.40:0/3753308195 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0b8009e230 0x7f0b80126d40 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f0b70001eb0 tx=0x7f0b7000c800 comp rx=0 tx=0).stop 2023-09-30T22:31:26.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:26.043+0000 7f0b877f7700 1 -- 172.21.15.40:0/3753308195 shutdown_connections 2023-09-30T22:31:26.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:26.043+0000 7f0b877f7700 1 --2- 172.21.15.40:0/3753308195 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0b8009d920 0x7f0b80126800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:26.043+0000 7f0b877f7700 1 --2- 172.21.15.40:0/3753308195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b80130fb0 0x7f0b80127280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:26.043+0000 7f0b877f7700 1 --2- 172.21.15.40:0/3753308195 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0b8009e230 0x7f0b80126d40 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:26.043+0000 7f0b877f7700 1 -- 172.21.15.40:0/3753308195 >> 172.21.15.40:0/3753308195 conn(0x7f0b8009fb20 msgr2=0x7f0b80129b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:26.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:26.043+0000 7f0b877f7700 1 -- 172.21.15.40:0/3753308195 shutdown_connections 2023-09-30T22:31:26.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:26.043+0000 7f0b877f7700 1 -- 172.21.15.40:0/3753308195 wait complete. 2023-09-30T22:31:26.056 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:26.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:26.106+0000 7fe66913a700 1 -- 172.21.15.40:0/1629225851 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe66412a580 con 0x7fe66409d920 2023-09-30T22:31:26.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:26.106+0000 7fe64b7fe700 1 -- 172.21.15.40:0/1629225851 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe66412a580 con 0x7fe66409d920 2023-09-30T22:31:26.107 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:26.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:26.108+0000 7fe66913a700 1 -- 172.21.15.40:0/1629225851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe66409d920 msgr2=0x7fe6641273a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:26.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:26.108+0000 7fe66913a700 1 --2- 172.21.15.40:0/1629225851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe66409d920 0x7fe6641273a0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fe65400c4d0 tx=0x7fe65400c890 comp rx=0 tx=0).stop 2023-09-30T22:31:26.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:26.108+0000 7fe66913a700 1 -- 172.21.15.40:0/1629225851 shutdown_connections 2023-09-30T22:31:26.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:26.108+0000 7fe66913a700 1 --2- 172.21.15.40:0/1629225851 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe664136230 0x7fe664127e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:26.108+0000 7fe66913a700 1 --2- 172.21.15.40:0/1629225851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe66409d920 0x7fe6641273a0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:26.108+0000 7fe66913a700 1 --2- 172.21.15.40:0/1629225851 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe66409e400 0x7fe6641278e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:26.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:26.108+0000 7fe66913a700 1 -- 172.21.15.40:0/1629225851 >> 172.21.15.40:0/1629225851 conn(0x7fe66409fb20 msgr2=0x7fe664071a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:26.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:26.108+0000 7fe66913a700 1 -- 172.21.15.40:0/1629225851 shutdown_connections 2023-09-30T22:31:26.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:26.108+0000 7fe66913a700 1 -- 172.21.15.40:0/1629225851 wait complete. 2023-09-30T22:31:26.121 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:27.003 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:27.014 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:27.057 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:27.121 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:27.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.149+0000 7fe9824ae700 1 Processor -- start 2023-09-30T22:31:27.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.149+0000 7fe9824ae700 1 -- start start 2023-09-30T22:31:27.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.150+0000 7fe9824ae700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe97c09d920 0x7fe97c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.150+0000 7fe9824ae700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe97c09e230 0x7fe97c1308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.150+0000 7fe9824ae700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe97c09adf0 con 0x7fe97c130de0 2023-09-30T22:31:27.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.150+0000 7fe9824ae700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c09edf0 con 0x7fe97c09d920 2023-09-30T22:31:27.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.150+0000 7fe9824ae700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c09b660 con 0x7fe97c09e230 2023-09-30T22:31:27.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.150+0000 7fe980a4b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe97c130de0 0x7fe97c137d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50678/0 (socket says 172.21.15.40:50678) 2023-09-30T22:31:27.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.150+0000 7fe980a4b700 1 -- 172.21.15.40:0/2116841893 learned_addr learned my addr 172.21.15.40:0/2116841893 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:27.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.150+0000 7fe97affd700 1 -- 172.21.15.40:0/2116841893 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3173478014 0 0) 0x7fe97c09adf0 con 0x7fe97c130de0 2023-09-30T22:31:27.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.150+0000 7fe97affd700 1 -- 172.21.15.40:0/2116841893 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9640057c0 con 0x7fe97c130de0 2023-09-30T22:31:27.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.151+0000 7fe97affd700 1 -- 172.21.15.40:0/2116841893 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3318717190 0 0) 0x7fe9640057c0 con 0x7fe97c130de0 2023-09-30T22:31:27.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.151+0000 7fe97bfff700 1 --2- 172.21.15.40:0/2116841893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe97c09d920 0x7fe97c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.151+0000 7fe97affd700 1 -- 172.21.15.40:0/2116841893 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe97c09e230 msgr2=0x7fe97c1308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:27.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.151+0000 7fe97b7fe700 1 --2- 172.21.15.40:0/2116841893 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe97c09e230 0x7fe97c1308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.151+0000 7fe97affd700 1 --2- 172.21.15.40:0/2116841893 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe97c09e230 0x7fe97c1308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.151+0000 7fe97affd700 1 -- 172.21.15.40:0/2116841893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe97c09d920 msgr2=0x7fe97c09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:27.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.151+0000 7fe97affd700 1 --2- 172.21.15.40:0/2116841893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe97c09d920 0x7fe97c09dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.151+0000 7fe97affd700 1 -- 172.21.15.40:0/2116841893 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97c09a6e0 con 0x7fe97c130de0 2023-09-30T22:31:27.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.151+0000 7fe97affd700 1 -- 172.21.15.40:0/2116841893 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4231795173 0 0) 0x7fe9740019f0 con 0x7fe97c130de0 2023-09-30T22:31:27.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.151+0000 7fe97bfff700 1 --2- 172.21.15.40:0/2116841893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe97c09d920 0x7fe97c09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:31:27.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.151+0000 7fe97b7fe700 1 --2- 172.21.15.40:0/2116841893 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe97c09e230 0x7fe97c1308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:31:27.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.151+0000 7fe97affd700 1 -- 172.21.15.40:0/2116841893 >> v1:172.21.15.40:6789/0 conn(0x7fe97c130de0 legacy=0x7fe97c137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:27.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.151+0000 7fe97affd700 1 --2- 172.21.15.40:0/2116841893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe97c09d920 0x7fe964005c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.151+0000 7fe97affd700 1 --2- 172.21.15.40:0/2116841893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9640062e0 0x7fe964006a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.151+0000 7fe97affd700 1 --2- 172.21.15.40:0/2116841893 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe97c09e230 0x7fe964007010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.151+0000 7fe97affd700 1 -- 172.21.15.40:0/2116841893 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c09b660 con 0x7fe9640062e0 2023-09-30T22:31:27.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.151+0000 7fe97affd700 1 -- 172.21.15.40:0/2116841893 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe964007720 con 0x7fe97c09d920 2023-09-30T22:31:27.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.151+0000 7fe97affd700 1 -- 172.21.15.40:0/2116841893 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9640078e0 con 0x7fe97c09e230 2023-09-30T22:31:27.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.151+0000 7fe97bfff700 1 --2- 172.21.15.40:0/2116841893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe97c09d920 0x7fe964005c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.151+0000 7fe97b7fe700 1 --2- 172.21.15.40:0/2116841893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9640062e0 0x7fe964006a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.151+0000 7fe980a4b700 1 --2- 172.21.15.40:0/2116841893 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe97c09e230 0x7fe964007010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.151+0000 7fe97b7fe700 1 -- 172.21.15.40:0/2116841893 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe97c09e230 msgr2=0x7fe964007010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:27.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.151+0000 7fe97b7fe700 1 --2- 172.21.15.40:0/2116841893 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe97c09e230 0x7fe964007010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.151+0000 7fe97b7fe700 1 -- 172.21.15.40:0/2116841893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe97c09d920 msgr2=0x7fe964005c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:27.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.151+0000 7fe97b7fe700 1 --2- 172.21.15.40:0/2116841893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe97c09d920 0x7fe964005c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.151+0000 7fe97b7fe700 1 -- 172.21.15.40:0/2116841893 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9640057c0 con 0x7fe9640062e0 2023-09-30T22:31:27.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.152+0000 7fe97b7fe700 1 --2- 172.21.15.40:0/2116841893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9640062e0 0x7fe964006a60 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fe97000ab00 tx=0x7fe964007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fe29b200ce38fca server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:27.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.152+0000 7fe97affd700 1 -- 172.21.15.40:0/2116841893 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97000a5a0 con 0x7fe9640062e0 2023-09-30T22:31:27.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.152+0000 7fe97affd700 1 -- 172.21.15.40:0/2116841893 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe970004230 con 0x7fe9640062e0 2023-09-30T22:31:27.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.152+0000 7fe97affd700 1 -- 172.21.15.40:0/2116841893 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9700036a0 con 0x7fe9640062e0 2023-09-30T22:31:27.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.153+0000 7fe9824ae700 1 -- 172.21.15.40:0/2116841893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9640062e0 msgr2=0x7fe964006a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:27.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.153+0000 7fe9824ae700 1 --2- 172.21.15.40:0/2116841893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9640062e0 0x7fe964006a60 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fe97000ab00 tx=0x7fe964007a90 comp rx=0 tx=0).stop 2023-09-30T22:31:27.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.154+0000 7fe9824ae700 1 -- 172.21.15.40:0/2116841893 shutdown_connections 2023-09-30T22:31:27.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.154+0000 7fe9824ae700 1 --2- 172.21.15.40:0/2116841893 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe97c09e230 0x7fe964007010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.154+0000 7fe9824ae700 1 --2- 172.21.15.40:0/2116841893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9640062e0 0x7fe964006a60 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.154+0000 7fe9824ae700 1 --2- 172.21.15.40:0/2116841893 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe97c09d920 0x7fe964005c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.154+0000 7fe9824ae700 1 -- 172.21.15.40:0/2116841893 >> 172.21.15.40:0/2116841893 conn(0x7fe97c09fb20 msgr2=0x7fe97c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:27.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.154+0000 7fe9824ae700 1 -- 172.21.15.40:0/2116841893 shutdown_connections 2023-09-30T22:31:27.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.154+0000 7fe9824ae700 1 -- 172.21.15.40:0/2116841893 wait complete. 2023-09-30T22:31:27.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.155+0000 7fe9824ae700 1 Processor -- start 2023-09-30T22:31:27.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.155+0000 7fe9824ae700 1 -- start start 2023-09-30T22:31:27.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.156+0000 7fe9824ae700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe9640062e0 0x7fe97c12f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.156+0000 7fe9824ae700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe97c09d920 0x7fe97c12fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.156+0000 7fe9824ae700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe97c09e230 0x7fe97c1c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.156+0000 7fe9824ae700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c11f280 con 0x7fe97c09d920 2023-09-30T22:31:27.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.156+0000 7fe9824ae700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c130330 con 0x7fe97c09e230 2023-09-30T22:31:27.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.156+0000 7fe9824ae700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c11d5c0 con 0x7fe9640062e0 2023-09-30T22:31:27.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.156+0000 7fe97bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe9640062e0 0x7fe97c12f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.156+0000 7fe97bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe9640062e0 0x7fe97c12f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51554/0 (socket says 172.21.15.40:51554) 2023-09-30T22:31:27.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.156+0000 7fe97bfff700 1 -- 172.21.15.40:0/2330016344 learned_addr learned my addr 172.21.15.40:0/2330016344 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:27.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.156+0000 7fe980a4b700 1 --2- 172.21.15.40:0/2330016344 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe97c09e230 0x7fe97c1c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.156+0000 7fe97b7fe700 1 --2- 172.21.15.40:0/2330016344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe97c09d920 0x7fe97c12fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.156+0000 7fe97bfff700 1 -- 172.21.15.40:0/2330016344 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe97c09e230 msgr2=0x7fe97c1c3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:27.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.156+0000 7fe97bfff700 1 --2- 172.21.15.40:0/2330016344 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe97c09e230 0x7fe97c1c3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.156+0000 7fe97bfff700 1 -- 172.21.15.40:0/2330016344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe97c09d920 msgr2=0x7fe97c12fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:27.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.157+0000 7fe97bfff700 1 --2- 172.21.15.40:0/2330016344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe97c09d920 0x7fe97c12fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.157+0000 7fe97bfff700 1 -- 172.21.15.40:0/2330016344 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97c09ff60 con 0x7fe9640062e0 2023-09-30T22:31:27.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.157+0000 7fe97bfff700 1 --2- 172.21.15.40:0/2330016344 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe9640062e0 0x7fe97c12f8b0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fe96c00e840 tx=0x7fe96c00eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:27.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.157+0000 7fe978ff9700 1 -- 172.21.15.40:0/2330016344 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c013660 con 0x7fe9640062e0 2023-09-30T22:31:27.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.157+0000 7fe978ff9700 1 -- 172.21.15.40:0/2330016344 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96c0137c0 con 0x7fe9640062e0 2023-09-30T22:31:27.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.157+0000 7fe9824ae700 1 -- 172.21.15.40:0/2330016344 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe97c09cb00 con 0x7fe9640062e0 2023-09-30T22:31:27.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.157+0000 7fe978ff9700 1 -- 172.21.15.40:0/2330016344 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c013b30 con 0x7fe9640062e0 2023-09-30T22:31:27.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.157+0000 7fe9824ae700 1 -- 172.21.15.40:0/2330016344 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe97c11fc60 con 0x7fe9640062e0 2023-09-30T22:31:27.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.158+0000 7fe978ff9700 1 -- 172.21.15.40:0/2330016344 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe96c013c90 con 0x7fe9640062e0 2023-09-30T22:31:27.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.158+0000 7fe978ff9700 1 -- 172.21.15.40:0/2330016344 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe96c03fc30 con 0x7fe9640062e0 2023-09-30T22:31:27.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.158+0000 7fe9824ae700 1 -- 172.21.15.40:0/2330016344 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe97c11ee30 con 0x7fe9640062e0 2023-09-30T22:31:27.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.164+0000 7fe978ff9700 1 -- 172.21.15.40:0/2330016344 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe96c025760 con 0x7fe9640062e0 2023-09-30T22:31:27.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.202+0000 7ff117064700 1 Processor -- start 2023-09-30T22:31:27.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.202+0000 7ff117064700 1 -- start start 2023-09-30T22:31:27.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.202+0000 7ff117064700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff11009c890 0x7ff11009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.202+0000 7ff117064700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff11009d920 0x7ff11009dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.202+0000 7ff117064700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1100a2600 con 0x7ff11009e2b0 2023-09-30T22:31:27.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.202+0000 7ff117064700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1100a29d0 con 0x7ff11009d920 2023-09-30T22:31:27.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.202+0000 7ff117064700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff11009fb40 con 0x7ff11009c890 2023-09-30T22:31:27.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.203+0000 7ff114e00700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff11009c890 0x7ff11009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.203+0000 7ff114e00700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff11009c890 0x7ff11009cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50626/0 (socket says 172.21.15.40:50626) 2023-09-30T22:31:27.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.203+0000 7ff114e00700 1 -- 172.21.15.40:0/103204847 learned_addr learned my addr 172.21.15.40:0/103204847 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:27.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.203+0000 7ff115601700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff11009e2b0 0x7ff11013ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50682/0 (socket says 172.21.15.40:50682) 2023-09-30T22:31:27.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.203+0000 7ff10f7fe700 1 -- 172.21.15.40:0/103204847 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1703435315 0 0) 0x7ff1100a2600 con 0x7ff11009e2b0 2023-09-30T22:31:27.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.203+0000 7ff10f7fe700 1 -- 172.21.15.40:0/103204847 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1000035b0 con 0x7ff11009e2b0 2023-09-30T22:31:27.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.203+0000 7ff114e00700 1 -- 172.21.15.40:0/103204847 >> v2:172.21.15.40:3300/0 conn(0x7ff11009d920 msgr2=0x7ff11009dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:27.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.203+0000 7ff114e00700 1 --2- 172.21.15.40:0/103204847 >> v2:172.21.15.40:3300/0 conn(0x7ff11009d920 0x7ff11009dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.203+0000 7ff114e00700 1 -- 172.21.15.40:0/103204847 >> v1:172.21.15.40:6789/0 conn(0x7ff11009e2b0 legacy=0x7ff11013ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:27.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.203+0000 7ff114e00700 1 -- 172.21.15.40:0/103204847 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11009e750 con 0x7ff11009c890 2023-09-30T22:31:27.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.203+0000 7ff114e00700 1 --2- 172.21.15.40:0/103204847 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff11009c890 0x7ff11009cc60 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7ff104006fd0 tx=0x7ff104009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2aa95a0afe3ca79 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:27.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.204+0000 7ff10f7fe700 1 -- 172.21.15.40:0/103204847 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff104005e30 con 0x7ff11009c890 2023-09-30T22:31:27.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.204+0000 7ff10f7fe700 1 -- 172.21.15.40:0/103204847 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff104004030 con 0x7ff11009c890 2023-09-30T22:31:27.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.204+0000 7ff10f7fe700 1 -- 172.21.15.40:0/103204847 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1040043e0 con 0x7ff11009c890 2023-09-30T22:31:27.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.204+0000 7ff117064700 1 -- 172.21.15.40:0/103204847 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff11009c890 msgr2=0x7ff11009cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:27.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.204+0000 7ff117064700 1 --2- 172.21.15.40:0/103204847 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff11009c890 0x7ff11009cc60 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7ff104006fd0 tx=0x7ff104009bd0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.204+0000 7ff117064700 1 -- 172.21.15.40:0/103204847 shutdown_connections 2023-09-30T22:31:27.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.204+0000 7ff117064700 1 --2- 172.21.15.40:0/103204847 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff11009c890 0x7ff11009cc60 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.204+0000 7ff117064700 1 --2- 172.21.15.40:0/103204847 >> v2:172.21.15.40:3300/0 conn(0x7ff11009d920 0x7ff11009dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.204+0000 7ff117064700 1 -- 172.21.15.40:0/103204847 >> 172.21.15.40:0/103204847 conn(0x7ff1100a7080 msgr2=0x7ff1100a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:27.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.205+0000 7ff117064700 1 -- 172.21.15.40:0/103204847 shutdown_connections 2023-09-30T22:31:27.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.205+0000 7ff117064700 1 -- 172.21.15.40:0/103204847 wait complete. 2023-09-30T22:31:27.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.205+0000 7ff117064700 1 Processor -- start 2023-09-30T22:31:27.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.206+0000 7ff117064700 1 -- start start 2023-09-30T22:31:27.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.206+0000 7ff117064700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff11009c890 0x7ff1101d5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.206+0000 7ff117064700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff11009d920 0x7ff1101d57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.206+0000 7ff117064700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff11009e2b0 0x7ff1101d5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.206+0000 7ff117064700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11012b7a0 con 0x7ff11009e2b0 2023-09-30T22:31:27.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.206+0000 7ff117064700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff11012b5b0 con 0x7ff11009c890 2023-09-30T22:31:27.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.206+0000 7ff117064700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff11012be80 con 0x7ff11009d920 2023-09-30T22:31:27.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.206+0000 7ff114e00700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff11009c890 0x7ff1101d5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.206+0000 7ff114e00700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff11009c890 0x7ff1101d5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50642/0 (socket says 172.21.15.40:50642) 2023-09-30T22:31:27.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.206+0000 7ff114e00700 1 -- 172.21.15.40:0/864809163 learned_addr learned my addr 172.21.15.40:0/864809163 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:27.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.206+0000 7ff115601700 1 --2- 172.21.15.40:0/864809163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff11009e2b0 0x7ff1101d5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.207+0000 7ff114e00700 1 -- 172.21.15.40:0/864809163 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff11009d920 msgr2=0x7ff1101d57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:27.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.207+0000 7ff114e00700 1 --2- 172.21.15.40:0/864809163 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff11009d920 0x7ff1101d57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.207+0000 7ff114e00700 1 -- 172.21.15.40:0/864809163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff11009e2b0 msgr2=0x7ff1101d5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:27.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.207+0000 7ff114e00700 1 --2- 172.21.15.40:0/864809163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff11009e2b0 0x7ff1101d5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.207+0000 7ff114e00700 1 -- 172.21.15.40:0/864809163 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff104009500 con 0x7ff11009c890 2023-09-30T22:31:27.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.207+0000 7ff114e00700 1 --2- 172.21.15.40:0/864809163 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff11009c890 0x7ff1101d5290 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7ff104009c10 tx=0x7ff104004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:27.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.207+0000 7ff10d7fa700 1 -- 172.21.15.40:0/864809163 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10401c420 con 0x7ff11009c890 2023-09-30T22:31:27.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.207+0000 7ff10d7fa700 1 -- 172.21.15.40:0/864809163 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10401c580 con 0x7ff11009c890 2023-09-30T22:31:27.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.207+0000 7ff10d7fa700 1 -- 172.21.15.40:0/864809163 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10401c8f0 con 0x7ff11009c890 2023-09-30T22:31:27.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.208+0000 7ff117064700 1 -- 172.21.15.40:0/864809163 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff11012bb60 con 0x7ff11009c890 2023-09-30T22:31:27.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.208+0000 7ff117064700 1 -- 172.21.15.40:0/864809163 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff11009ecf0 con 0x7ff11009c890 2023-09-30T22:31:27.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.209+0000 7ff117064700 1 -- 172.21.15.40:0/864809163 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff11012ce80 con 0x7ff11009c890 2023-09-30T22:31:27.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.210+0000 7ff10d7fa700 1 -- 172.21.15.40:0/864809163 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff10401ca50 con 0x7ff11009c890 2023-09-30T22:31:27.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.211+0000 7ff10d7fa700 1 -- 172.21.15.40:0/864809163 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff104006c40 con 0x7ff11009c890 2023-09-30T22:31:27.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.219+0000 7ff10d7fa700 1 -- 172.21.15.40:0/864809163 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff11012ce80 con 0x7ff11009c890 2023-09-30T22:31:27.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.232+0000 7f462b9bf700 1 Processor -- start 2023-09-30T22:31:27.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.232+0000 7f462b9bf700 1 -- start start 2023-09-30T22:31:27.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.233+0000 7f462b9bf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4624131d50 0x7f4624132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.233+0000 7f462b9bf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f462409bc50 0x7f462409c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.233+0000 7f462b9bf700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4624071920 con 0x7f462409c600 2023-09-30T22:31:27.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.233+0000 7f462b9bf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462409cb00 con 0x7f4624131d50 2023-09-30T22:31:27.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.233+0000 7f462b9bf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4624132660 con 0x7f462409bc50 2023-09-30T22:31:27.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.233+0000 7f462975b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4624131d50 0x7f4624132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.233+0000 7f462975b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4624131d50 0x7f4624132120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50652/0 (socket says 172.21.15.40:50652) 2023-09-30T22:31:27.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.233+0000 7f462975b700 1 -- 172.21.15.40:0/2905228217 learned_addr learned my addr 172.21.15.40:0/2905228217 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:27.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.233+0000 7f4629f5c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f462409c600 0x7f4624138ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50688/0 (socket says 172.21.15.40:50688) 2023-09-30T22:31:27.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.233+0000 7f4628f5a700 1 --2- 172.21.15.40:0/2905228217 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f462409bc50 0x7f462409c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.233+0000 7f462975b700 1 -- 172.21.15.40:0/2905228217 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f462409bc50 msgr2=0x7f462409c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:27.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.233+0000 7f461bfff700 1 -- 172.21.15.40:0/2905228217 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3273027046 0 0) 0x7f4624071920 con 0x7f462409c600 2023-09-30T22:31:27.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.233+0000 7f462975b700 1 --2- 172.21.15.40:0/2905228217 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f462409bc50 0x7f462409c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.233+0000 7f462975b700 1 -- 172.21.15.40:0/2905228217 >> v1:172.21.15.40:6789/0 conn(0x7f462409c600 legacy=0x7f4624138ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:27.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.233+0000 7f462975b700 1 -- 172.21.15.40:0/2905228217 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4624131900 con 0x7f4624131d50 2023-09-30T22:31:27.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.233+0000 7f4628f5a700 1 --2- 172.21.15.40:0/2905228217 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f462409bc50 0x7f462409c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:27.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.233+0000 7f462975b700 1 --2- 172.21.15.40:0/2905228217 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4624131d50 0x7f4624132120 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f4620009920 tx=0x7f4620009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6362b2343be18cc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:27.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.234+0000 7f461bfff700 1 -- 172.21.15.40:0/2905228217 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4620011830 con 0x7f4624131d50 2023-09-30T22:31:27.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.234+0000 7f461bfff700 1 -- 172.21.15.40:0/2905228217 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4620011990 con 0x7f4624131d50 2023-09-30T22:31:27.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.234+0000 7f461bfff700 1 -- 172.21.15.40:0/2905228217 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4620011d20 con 0x7f4624131d50 2023-09-30T22:31:27.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.234+0000 7f462b9bf700 1 -- 172.21.15.40:0/2905228217 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4624131d50 msgr2=0x7f4624132120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:27.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.234+0000 7f462b9bf700 1 --2- 172.21.15.40:0/2905228217 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4624131d50 0x7f4624132120 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f4620009920 tx=0x7f4620009c30 comp rx=0 tx=0).stop 2023-09-30T22:31:27.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.234+0000 7f462b9bf700 1 -- 172.21.15.40:0/2905228217 shutdown_connections 2023-09-30T22:31:27.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.234+0000 7f462b9bf700 1 --2- 172.21.15.40:0/2905228217 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4624131d50 0x7f4624132120 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.234+0000 7f462b9bf700 1 --2- 172.21.15.40:0/2905228217 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f462409bc50 0x7f462409c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.234+0000 7f462b9bf700 1 -- 172.21.15.40:0/2905228217 >> 172.21.15.40:0/2905228217 conn(0x7f46240a2a00 msgr2=0x7f46240a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:27.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.235+0000 7f462b9bf700 1 -- 172.21.15.40:0/2905228217 shutdown_connections 2023-09-30T22:31:27.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.235+0000 7f462b9bf700 1 -- 172.21.15.40:0/2905228217 wait complete. 2023-09-30T22:31:27.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.235+0000 7f462b9bf700 1 Processor -- start 2023-09-30T22:31:27.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.236+0000 7f462b9bf700 1 -- start start 2023-09-30T22:31:27.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.236+0000 7f462b9bf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f462409bc50 0x7f4624099a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.236+0000 7f462b9bf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f462409c600 0x7f4624099f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.236+0000 7f462b9bf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4624131d50 0x7f462409a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.236+0000 7f462b9bf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462411ef90 con 0x7f462409c600 2023-09-30T22:31:27.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.236+0000 7f462b9bf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462412bf70 con 0x7f462409bc50 2023-09-30T22:31:27.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.236+0000 7f462b9bf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f462411e340 con 0x7f4624131d50 2023-09-30T22:31:27.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.236+0000 7f462975b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f462409bc50 0x7f4624099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.236+0000 7f462975b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f462409bc50 0x7f4624099a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50666/0 (socket says 172.21.15.40:50666) 2023-09-30T22:31:27.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.236+0000 7f462975b700 1 -- 172.21.15.40:0/1336394282 learned_addr learned my addr 172.21.15.40:0/1336394282 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:27.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.236+0000 7f4628f5a700 1 --2- 172.21.15.40:0/1336394282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f462409c600 0x7f4624099f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.236+0000 7f4629f5c700 1 --2- 172.21.15.40:0/1336394282 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4624131d50 0x7f462409a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.237+0000 7f462975b700 1 -- 172.21.15.40:0/1336394282 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4624131d50 msgr2=0x7f462409a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:27.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.237+0000 7f462975b700 1 --2- 172.21.15.40:0/1336394282 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4624131d50 0x7f462409a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.237+0000 7f462975b700 1 -- 172.21.15.40:0/1336394282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f462409c600 msgr2=0x7f4624099f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:27.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.237+0000 7f462975b700 1 --2- 172.21.15.40:0/1336394282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f462409c600 0x7f4624099f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.237+0000 7f462975b700 1 -- 172.21.15.40:0/1336394282 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46140094a0 con 0x7f462409bc50 2023-09-30T22:31:27.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.237+0000 7f4629f5c700 1 --2- 172.21.15.40:0/1336394282 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4624131d50 0x7f462409a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:27.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.237+0000 7f4628f5a700 1 --2- 172.21.15.40:0/1336394282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f462409c600 0x7f4624099f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:27.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.237+0000 7f462975b700 1 --2- 172.21.15.40:0/1336394282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f462409bc50 0x7f4624099a40 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f462000a010 tx=0x7f4620004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:27.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.237+0000 7f4619ffb700 1 -- 172.21.15.40:0/1336394282 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4620004450 con 0x7f462409bc50 2023-09-30T22:31:27.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.237+0000 7f4619ffb700 1 -- 172.21.15.40:0/1336394282 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46200045b0 con 0x7f462409bc50 2023-09-30T22:31:27.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.237+0000 7f462b9bf700 1 -- 172.21.15.40:0/1336394282 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4620009550 con 0x7f462409bc50 2023-09-30T22:31:27.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.237+0000 7f4619ffb700 1 -- 172.21.15.40:0/1336394282 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46200038e0 con 0x7f462409bc50 2023-09-30T22:31:27.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.237+0000 7f462b9bf700 1 -- 172.21.15.40:0/1336394282 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f462409ea60 con 0x7f462409bc50 2023-09-30T22:31:27.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.238+0000 7f4619ffb700 1 -- 172.21.15.40:0/1336394282 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4620003a40 con 0x7f462409bc50 2023-09-30T22:31:27.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.238+0000 7f4619ffb700 1 -- 172.21.15.40:0/1336394282 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4620040ca0 con 0x7f462409bc50 2023-09-30T22:31:27.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.238+0000 7f462b9bf700 1 -- 172.21.15.40:0/1336394282 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46241b8f30 con 0x7f462409bc50 2023-09-30T22:31:27.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.243+0000 7f4619ffb700 1 -- 172.21.15.40:0/1336394282 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4620015070 con 0x7f462409bc50 2023-09-30T22:31:27.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.271+0000 7f3d3a267700 1 Processor -- start 2023-09-30T22:31:27.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.271+0000 7f3d3a267700 1 -- start start 2023-09-30T22:31:27.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.272+0000 7f3d3a267700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3d3409d920 0x7f3d3409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.272+0000 7f3d3a267700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d3409e230 0x7f3d341308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.272+0000 7f3d3a267700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d34130de0 0x7f3d34131240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.272+0000 7f3d3a267700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d3409edf0 con 0x7f3d3409d920 2023-09-30T22:31:27.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.272+0000 7f3d3a267700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3409adf0 con 0x7f3d34130de0 2023-09-30T22:31:27.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.272+0000 7f3d3a267700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3409b660 con 0x7f3d3409e230 2023-09-30T22:31:27.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.272+0000 7f3d337fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d3409e230 0x7f3d341308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.272+0000 7f3d337fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d3409e230 0x7f3d341308a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51580/0 (socket says 172.21.15.40:51580) 2023-09-30T22:31:27.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.272+0000 7f3d337fe700 1 -- 172.21.15.40:0/2995791917 learned_addr learned my addr 172.21.15.40:0/2995791917 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:27.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.272+0000 7f3d33fff700 1 --2- 172.21.15.40:0/2995791917 >> v2:172.21.15.40:3300/0 conn(0x7f3d3409d920 0x7f3d3409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.272+0000 7f3d38804700 1 --2- 172.21.15.40:0/2995791917 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d34130de0 0x7f3d34131240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.272+0000 7f3d337fe700 1 -- 172.21.15.40:0/2995791917 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d34130de0 msgr2=0x7f3d34131240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:27.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.272+0000 7f3d337fe700 1 --2- 172.21.15.40:0/2995791917 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d34130de0 0x7f3d34131240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.272+0000 7f3d337fe700 1 -- 172.21.15.40:0/2995791917 >> v2:172.21.15.40:3300/0 conn(0x7f3d3409d920 msgr2=0x7f3d3409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:27.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.272+0000 7f3d337fe700 1 --2- 172.21.15.40:0/2995791917 >> v2:172.21.15.40:3300/0 conn(0x7f3d3409d920 0x7f3d3409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.273+0000 7f3d337fe700 1 -- 172.21.15.40:0/2995791917 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d3409a6e0 con 0x7f3d3409e230 2023-09-30T22:31:27.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.273+0000 7f3d38804700 1 --2- 172.21.15.40:0/2995791917 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d34130de0 0x7f3d34131240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:27.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.273+0000 7f3d337fe700 1 --2- 172.21.15.40:0/2995791917 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d3409e230 0x7f3d341308a0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f3d2800bb90 tx=0x7f3d2800bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eabf17a7a45b4fd8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:27.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.273+0000 7f3d32ffd700 1 -- 172.21.15.40:0/2995791917 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2800dd30 con 0x7f3d3409e230 2023-09-30T22:31:27.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.273+0000 7f3d32ffd700 1 -- 172.21.15.40:0/2995791917 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2800de90 con 0x7f3d3409e230 2023-09-30T22:31:27.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.273+0000 7f3d32ffd700 1 -- 172.21.15.40:0/2995791917 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d28010690 con 0x7f3d3409e230 2023-09-30T22:31:27.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.274+0000 7f3d3a267700 1 -- 172.21.15.40:0/2995791917 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d3409e230 msgr2=0x7f3d341308a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:27.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.274+0000 7f3d3a267700 1 --2- 172.21.15.40:0/2995791917 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d3409e230 0x7f3d341308a0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f3d2800bb90 tx=0x7f3d2800bea0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.274+0000 7f3d3a267700 1 -- 172.21.15.40:0/2995791917 shutdown_connections 2023-09-30T22:31:27.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.274+0000 7f3d3a267700 1 --2- 172.21.15.40:0/2995791917 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d34130de0 0x7f3d34131240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.274+0000 7f3d3a267700 1 --2- 172.21.15.40:0/2995791917 >> v2:172.21.15.40:3300/0 conn(0x7f3d3409d920 0x7f3d3409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.274+0000 7f3d3a267700 1 --2- 172.21.15.40:0/2995791917 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d3409e230 0x7f3d341308a0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.274+0000 7f3d3a267700 1 -- 172.21.15.40:0/2995791917 >> 172.21.15.40:0/2995791917 conn(0x7f3d3409fb20 msgr2=0x7f3d3409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:27.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.274+0000 7f3d3a267700 1 -- 172.21.15.40:0/2995791917 shutdown_connections 2023-09-30T22:31:27.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.274+0000 7f3d3a267700 1 -- 172.21.15.40:0/2995791917 wait complete. 2023-09-30T22:31:27.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.275+0000 7f3d3a267700 1 Processor -- start 2023-09-30T22:31:27.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.275+0000 7f3d3a267700 1 -- start start 2023-09-30T22:31:27.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.275+0000 7f3d3a267700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d3409d920 0x7f3d341213c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.275+0000 7f3d3a267700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d3409e230 0x7f3d34121900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.275+0000 7f3d3a267700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d34130de0 0x7f3d34121e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:27.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.275+0000 7f3d3a267700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3406b240 con 0x7f3d3409e230 2023-09-30T22:31:27.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.275+0000 7f3d3a267700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3409cb00 con 0x7f3d34130de0 2023-09-30T22:31:27.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.275+0000 7f3d3a267700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d34124670 con 0x7f3d3409d920 2023-09-30T22:31:27.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.276+0000 7f3d337fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d3409e230 0x7f3d34121900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.276+0000 7f3d337fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d3409e230 0x7f3d34121900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42966/0 (socket says 172.21.15.40:42966) 2023-09-30T22:31:27.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.276+0000 7f3d337fe700 1 -- 172.21.15.40:0/3498720445 learned_addr learned my addr 172.21.15.40:0/3498720445 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:27.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.276+0000 7f3d38804700 1 --2- 172.21.15.40:0/3498720445 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d34130de0 0x7f3d34121e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.276+0000 7f3d33fff700 1 --2- 172.21.15.40:0/3498720445 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d3409d920 0x7f3d341213c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:27.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.276+0000 7f3d337fe700 1 -- 172.21.15.40:0/3498720445 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d3409d920 msgr2=0x7f3d341213c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:27.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.276+0000 7f3d337fe700 1 --2- 172.21.15.40:0/3498720445 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d3409d920 0x7f3d341213c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.276+0000 7f3d337fe700 1 -- 172.21.15.40:0/3498720445 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d34130de0 msgr2=0x7f3d34121e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.276+0000 7f3d337fe700 1 --2- 172.21.15.40:0/3498720445 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d34130de0 0x7f3d34121e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.276+0000 7f3d337fe700 1 -- 172.21.15.40:0/3498720445 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2800b7f0 con 0x7f3d3409e230 2023-09-30T22:31:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.276+0000 7f3d38804700 1 --2- 172.21.15.40:0/3498720445 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d34130de0 0x7f3d34121e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.276+0000 7f3d337fe700 1 --2- 172.21.15.40:0/3498720445 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d3409e230 0x7f3d34121900 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f3d28000c00 tx=0x7f3d28004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.276+0000 7f3d30ff9700 1 -- 172.21.15.40:0/3498720445 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d28003bf0 con 0x7f3d3409e230 2023-09-30T22:31:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.276+0000 7f3d30ff9700 1 -- 172.21.15.40:0/3498720445 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d28003d50 con 0x7f3d3409e230 2023-09-30T22:31:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.276+0000 7f3d30ff9700 1 -- 172.21.15.40:0/3498720445 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d280106b0 con 0x7f3d3409e230 2023-09-30T22:31:27.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.276+0000 7f3d3a267700 1 -- 172.21.15.40:0/3498720445 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d34124c00 con 0x7f3d3409e230 2023-09-30T22:31:27.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.276+0000 7f3d3a267700 1 -- 172.21.15.40:0/3498720445 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d34125670 con 0x7f3d3409e230 2023-09-30T22:31:27.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.277+0000 7f3d30ff9700 1 -- 172.21.15.40:0/3498720445 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3d28019400 con 0x7f3d3409e230 2023-09-30T22:31:27.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.278+0000 7f3d3a267700 1 -- 172.21.15.40:0/3498720445 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d34062380 con 0x7f3d3409e230 2023-09-30T22:31:27.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.278+0000 7f3d30ff9700 1 -- 172.21.15.40:0/3498720445 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3d28040990 con 0x7f3d3409e230 2023-09-30T22:31:27.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.287+0000 7f3d30ff9700 1 -- 172.21.15.40:0/3498720445 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3d28018950 con 0x7f3d3409e230 2023-09-30T22:31:27.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.401+0000 7fe9824ae700 1 -- 172.21.15.40:0/2330016344 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe97c062380 con 0x7fe9640062e0 2023-09-30T22:31:27.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.401+0000 7fe978ff9700 1 -- 172.21.15.40:0/2330016344 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe96c010370 con 0x7fe9640062e0 2023-09-30T22:31:27.402 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:27.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.404+0000 7fe9824ae700 1 -- 172.21.15.40:0/2330016344 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe9640062e0 msgr2=0x7fe97c12f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:27.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.404+0000 7fe9824ae700 1 --2- 172.21.15.40:0/2330016344 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe9640062e0 0x7fe97c12f8b0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fe96c00e840 tx=0x7fe96c00eb50 comp rx=0 tx=0).stop 2023-09-30T22:31:27.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.404+0000 7fe9824ae700 1 -- 172.21.15.40:0/2330016344 shutdown_connections 2023-09-30T22:31:27.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.404+0000 7fe9824ae700 1 --2- 172.21.15.40:0/2330016344 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe9640062e0 0x7fe97c12f8b0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.404+0000 7fe9824ae700 1 --2- 172.21.15.40:0/2330016344 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe97c09e230 0x7fe97c1c3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.404+0000 7fe9824ae700 1 --2- 172.21.15.40:0/2330016344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe97c09d920 0x7fe97c12fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.404+0000 7fe9824ae700 1 -- 172.21.15.40:0/2330016344 >> 172.21.15.40:0/2330016344 conn(0x7fe97c09fb20 msgr2=0x7fe97c06df50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:27.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.404+0000 7fe9824ae700 1 -- 172.21.15.40:0/2330016344 shutdown_connections 2023-09-30T22:31:27.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.404+0000 7fe9824ae700 1 -- 172.21.15.40:0/2330016344 wait complete. 2023-09-30T22:31:27.422 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:27.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.433+0000 7ff117064700 1 -- 172.21.15.40:0/864809163 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff11012ce80 con 0x7ff11009c890 2023-09-30T22:31:27.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.433+0000 7ff10d7fa700 1 -- 172.21.15.40:0/864809163 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff11012ce80 con 0x7ff11009c890 2023-09-30T22:31:27.434 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:27.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.435+0000 7ff117064700 1 -- 172.21.15.40:0/864809163 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff11009c890 msgr2=0x7ff1101d5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:27.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.435+0000 7ff117064700 1 --2- 172.21.15.40:0/864809163 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff11009c890 0x7ff1101d5290 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7ff104009c10 tx=0x7ff104004750 comp rx=0 tx=0).stop 2023-09-30T22:31:27.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.435+0000 7ff117064700 1 -- 172.21.15.40:0/864809163 shutdown_connections 2023-09-30T22:31:27.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.435+0000 7ff117064700 1 --2- 172.21.15.40:0/864809163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff11009e2b0 0x7ff1101d5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.435+0000 7ff117064700 1 --2- 172.21.15.40:0/864809163 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff11009c890 0x7ff1101d5290 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.435+0000 7ff117064700 1 --2- 172.21.15.40:0/864809163 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff11009d920 0x7ff1101d57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.436+0000 7ff117064700 1 -- 172.21.15.40:0/864809163 >> 172.21.15.40:0/864809163 conn(0x7ff1100a7080 msgr2=0x7ff110132770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:27.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.436+0000 7ff117064700 1 -- 172.21.15.40:0/864809163 shutdown_connections 2023-09-30T22:31:27.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.436+0000 7ff117064700 1 -- 172.21.15.40:0/864809163 wait complete. 2023-09-30T22:31:27.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.443+0000 7f462b9bf700 1 -- 172.21.15.40:0/1336394282 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f462411d550 con 0x7f462409bc50 2023-09-30T22:31:27.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.443+0000 7f4619ffb700 1 -- 172.21.15.40:0/1336394282 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4620010380 con 0x7f462409bc50 2023-09-30T22:31:27.444 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:27.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.445+0000 7f462b9bf700 1 -- 172.21.15.40:0/1336394282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f462409bc50 msgr2=0x7f4624099a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:27.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.445+0000 7f462b9bf700 1 --2- 172.21.15.40:0/1336394282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f462409bc50 0x7f4624099a40 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f462000a010 tx=0x7f4620004750 comp rx=0 tx=0).stop 2023-09-30T22:31:27.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.445+0000 7f462b9bf700 1 -- 172.21.15.40:0/1336394282 shutdown_connections 2023-09-30T22:31:27.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.445+0000 7f462b9bf700 1 --2- 172.21.15.40:0/1336394282 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4624131d50 0x7f462409a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.445+0000 7f462b9bf700 1 --2- 172.21.15.40:0/1336394282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f462409bc50 0x7f4624099a40 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.445+0000 7f462b9bf700 1 --2- 172.21.15.40:0/1336394282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f462409c600 0x7f4624099f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.445+0000 7f462b9bf700 1 -- 172.21.15.40:0/1336394282 >> 172.21.15.40:0/1336394282 conn(0x7f46240a2a00 msgr2=0x7f462412d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:27.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.445+0000 7f462b9bf700 1 -- 172.21.15.40:0/1336394282 shutdown_connections 2023-09-30T22:31:27.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.445+0000 7f462b9bf700 1 -- 172.21.15.40:0/1336394282 wait complete. 2023-09-30T22:31:27.449 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:27.458 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:27.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.493+0000 7f3d3a267700 1 -- 172.21.15.40:0/3498720445 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3d34074720 con 0x7f3d3409e230 2023-09-30T22:31:27.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.493+0000 7f3d30ff9700 1 -- 172.21.15.40:0/3498720445 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3d28018360 con 0x7f3d3409e230 2023-09-30T22:31:27.494 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:27.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.495+0000 7f3d3a267700 1 -- 172.21.15.40:0/3498720445 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d3409e230 msgr2=0x7f3d34121900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:27.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.495+0000 7f3d3a267700 1 --2- 172.21.15.40:0/3498720445 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d3409e230 0x7f3d34121900 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f3d28000c00 tx=0x7f3d28004750 comp rx=0 tx=0).stop 2023-09-30T22:31:27.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.495+0000 7f3d3a267700 1 -- 172.21.15.40:0/3498720445 shutdown_connections 2023-09-30T22:31:27.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.495+0000 7f3d3a267700 1 --2- 172.21.15.40:0/3498720445 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d3409d920 0x7f3d341213c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.495+0000 7f3d3a267700 1 --2- 172.21.15.40:0/3498720445 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d34130de0 0x7f3d34121e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.495+0000 7f3d3a267700 1 --2- 172.21.15.40:0/3498720445 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d3409e230 0x7f3d34121900 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:27.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.495+0000 7f3d3a267700 1 -- 172.21.15.40:0/3498720445 >> 172.21.15.40:0/3498720445 conn(0x7f3d3409fb20 msgr2=0x7f3d3412ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:27.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.495+0000 7f3d3a267700 1 -- 172.21.15.40:0/3498720445 shutdown_connections 2023-09-30T22:31:27.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:27.495+0000 7f3d3a267700 1 -- 172.21.15.40:0/3498720445 wait complete. 2023-09-30T22:31:27.508 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:28.422 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:28.450 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:28.459 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:28.510 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:28.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.570+0000 7f38d91b3700 1 Processor -- start 2023-09-30T22:31:28.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.570+0000 7f38d91b3700 1 -- start start 2023-09-30T22:31:28.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.570+0000 7f38d91b3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f38d409d920 0x7f38d409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:28.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.571+0000 7f38d91b3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f38d409e230 0x7f38d41343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:28.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.571+0000 7f38d91b3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d409f940 con 0x7f38d409f0f0 2023-09-30T22:31:28.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.571+0000 7f38d91b3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d406b4c0 con 0x7f38d409e230 2023-09-30T22:31:28.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.571+0000 7f38d91b3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38d409a8f0 con 0x7f38d409d920 2023-09-30T22:31:28.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.571+0000 7f38d2d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f38d409d920 0x7f38d409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:28.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.571+0000 7f38d2d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f38d409d920 0x7f38d409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51588/0 (socket says 172.21.15.40:51588) 2023-09-30T22:31:28.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.571+0000 7f38d2d9d700 1 -- 172.21.15.40:0/2018872645 learned_addr learned my addr 172.21.15.40:0/2018872645 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:28.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.571+0000 7f38d359e700 1 --2- 172.21.15.40:0/2018872645 >> v2:172.21.15.40:3300/0 conn(0x7f38d409e230 0x7f38d41343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:28.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.571+0000 7f38d2d9d700 1 -- 172.21.15.40:0/2018872645 >> v2:172.21.15.40:3300/0 conn(0x7f38d409e230 msgr2=0x7f38d41343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:28.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.571+0000 7f38d2d9d700 1 --2- 172.21.15.40:0/2018872645 >> v2:172.21.15.40:3300/0 conn(0x7f38d409e230 0x7f38d41343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.571+0000 7f38d2d9d700 1 -- 172.21.15.40:0/2018872645 >> v1:172.21.15.40:6789/0 conn(0x7f38d409f0f0 legacy=0x7f38d4133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:28.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.571+0000 7f38d2d9d700 1 -- 172.21.15.40:0/2018872645 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d409f6e0 con 0x7f38d409d920 2023-09-30T22:31:28.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.571+0000 7f38d2d9d700 1 --2- 172.21.15.40:0/2018872645 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f38d409d920 0x7f38d409dcf0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f38c4006fd0 tx=0x7f38c4009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2a131659ee302da server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:28.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.572+0000 7f38d1d9b700 1 -- 172.21.15.40:0/2018872645 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c4005e30 con 0x7f38d409d920 2023-09-30T22:31:28.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.572+0000 7f38d1d9b700 1 -- 172.21.15.40:0/2018872645 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c4006030 con 0x7f38d409d920 2023-09-30T22:31:28.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.572+0000 7f38d1d9b700 1 -- 172.21.15.40:0/2018872645 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c40063c0 con 0x7f38d409d920 2023-09-30T22:31:28.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.573+0000 7f38d91b3700 1 -- 172.21.15.40:0/2018872645 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f38d409d920 msgr2=0x7f38d409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:28.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.573+0000 7f38d91b3700 1 --2- 172.21.15.40:0/2018872645 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f38d409d920 0x7f38d409dcf0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f38c4006fd0 tx=0x7f38c4009bd0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.573+0000 7f38d91b3700 1 -- 172.21.15.40:0/2018872645 shutdown_connections 2023-09-30T22:31:28.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.573+0000 7f38d91b3700 1 --2- 172.21.15.40:0/2018872645 >> v2:172.21.15.40:3300/0 conn(0x7f38d409e230 0x7f38d41343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.573+0000 7f38d91b3700 1 --2- 172.21.15.40:0/2018872645 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f38d409d920 0x7f38d409dcf0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.573+0000 7f38d91b3700 1 -- 172.21.15.40:0/2018872645 >> 172.21.15.40:0/2018872645 conn(0x7f38d409fb20 msgr2=0x7f38d409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:28.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.573+0000 7f38d91b3700 1 -- 172.21.15.40:0/2018872645 shutdown_connections 2023-09-30T22:31:28.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.573+0000 7f38d91b3700 1 -- 172.21.15.40:0/2018872645 wait complete. 2023-09-30T22:31:28.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.575+0000 7f38d91b3700 1 Processor -- start 2023-09-30T22:31:28.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.575+0000 7f38d91b3700 1 -- start start 2023-09-30T22:31:28.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.575+0000 7f38d91b3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38d409d920 0x7f38d41abb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:28.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.576+0000 7f38d91b3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38d409e230 0x7f38d41ac0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:28.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.576+0000 7f38d91b3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f38d41ac5e0 0x7f38d41d2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:28.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.576+0000 7f38d91b3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d41baf10 con 0x7f38d409d920 2023-09-30T22:31:28.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.576+0000 7f38d91b3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d41af0e0 con 0x7f38d409e230 2023-09-30T22:31:28.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.576+0000 7f38d91b3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38d41af3a0 con 0x7f38d41ac5e0 2023-09-30T22:31:28.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.576+0000 7f38d2d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38d409d920 0x7f38d41abb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:28.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.576+0000 7f38d2d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38d409d920 0x7f38d41abb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42972/0 (socket says 172.21.15.40:42972) 2023-09-30T22:31:28.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.576+0000 7f38d2d9d700 1 -- 172.21.15.40:0/2328528114 learned_addr learned my addr 172.21.15.40:0/2328528114 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:28.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.576+0000 7f38d359e700 1 --2- 172.21.15.40:0/2328528114 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f38d41ac5e0 0x7f38d41d2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:28.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.576+0000 7f38d2d9d700 1 -- 172.21.15.40:0/2328528114 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f38d41ac5e0 msgr2=0x7f38d41d2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:28.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.576+0000 7f38d2d9d700 1 --2- 172.21.15.40:0/2328528114 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f38d41ac5e0 0x7f38d41d2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.576+0000 7f38d2d9d700 1 -- 172.21.15.40:0/2328528114 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38d409e230 msgr2=0x7f38d41ac0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:28.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.576+0000 7f38d2d9d700 1 --2- 172.21.15.40:0/2328528114 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38d409e230 0x7f38d41ac0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.576+0000 7f38d2d9d700 1 -- 172.21.15.40:0/2328528114 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c4009500 con 0x7f38d409d920 2023-09-30T22:31:28.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.576+0000 7f38d2d9d700 1 --2- 172.21.15.40:0/2328528114 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38d409d920 0x7f38d41abb60 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f38c4009f20 tx=0x7f38c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:28.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.577+0000 7f38bb7fe700 1 -- 172.21.15.40:0/2328528114 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c4011620 con 0x7f38d409d920 2023-09-30T22:31:28.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.577+0000 7f38bb7fe700 1 -- 172.21.15.40:0/2328528114 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c4011780 con 0x7f38d409d920 2023-09-30T22:31:28.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.577+0000 7f38d91b3700 1 -- 172.21.15.40:0/2328528114 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d40a35a0 con 0x7f38d409d920 2023-09-30T22:31:28.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.577+0000 7f38bb7fe700 1 -- 172.21.15.40:0/2328528114 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c4011b30 con 0x7f38d409d920 2023-09-30T22:31:28.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.577+0000 7f38d91b3700 1 -- 172.21.15.40:0/2328528114 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d41aee10 con 0x7f38d409d920 2023-09-30T22:31:28.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.578+0000 7f38bb7fe700 1 -- 172.21.15.40:0/2328528114 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f38c4011c90 con 0x7f38d409d920 2023-09-30T22:31:28.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.578+0000 7f38b97fa700 1 -- 172.21.15.40:0/2328528114 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d4062380 con 0x7f38d409d920 2023-09-30T22:31:28.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.578+0000 7f38bb7fe700 1 -- 172.21.15.40:0/2328528114 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f38c4040bd0 con 0x7f38d409d920 2023-09-30T22:31:28.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.583+0000 7f38bb7fe700 1 -- 172.21.15.40:0/2328528114 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f38c4025410 con 0x7f38d409d920 2023-09-30T22:31:28.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.613+0000 7ff1cfe9b700 1 Processor -- start 2023-09-30T22:31:28.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.613+0000 7ff1cfe9b700 1 -- start start 2023-09-30T22:31:28.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.614+0000 7ff1cfe9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff1c809d920 0x7ff1c809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:28.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.614+0000 7ff1cfe9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff1c809f0f0 0x7ff1c809e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:28.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.614+0000 7ff1cfe9b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c809f940 con 0x7ff1c8133ca0 2023-09-30T22:31:28.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.614+0000 7ff1cfe9b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1c806b4c0 con 0x7ff1c809f0f0 2023-09-30T22:31:28.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.614+0000 7ff1cfe9b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c809a8f0 con 0x7ff1c809d920 2023-09-30T22:31:28.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.614+0000 7ff1cd436700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff1c809f0f0 0x7ff1c809e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:28.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.614+0000 7ff1cdc37700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff1c809d920 0x7ff1c809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:28.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.614+0000 7ff1cd436700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff1c809f0f0 0x7ff1c809e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42986/0 (socket says 172.21.15.40:42986) 2023-09-30T22:31:28.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.614+0000 7ff1cd436700 1 -- 172.21.15.40:0/412790928 learned_addr learned my addr 172.21.15.40:0/412790928 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:28.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.615+0000 7ff1cd436700 1 -- 172.21.15.40:0/412790928 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff1c809d920 msgr2=0x7ff1c809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:28.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.615+0000 7ff1cd436700 1 --2- 172.21.15.40:0/412790928 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff1c809d920 0x7ff1c809dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.615+0000 7ff1cd436700 1 -- 172.21.15.40:0/412790928 >> v1:172.21.15.40:6789/0 conn(0x7ff1c8133ca0 legacy=0x7ff1c8134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:28.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.615+0000 7ff1cd436700 1 -- 172.21.15.40:0/412790928 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c809f6e0 con 0x7ff1c809f0f0 2023-09-30T22:31:28.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.615+0000 7ff1cdc37700 1 --2- 172.21.15.40:0/412790928 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff1c809d920 0x7ff1c809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:28.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.615+0000 7ff1cd436700 1 --2- 172.21.15.40:0/412790928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1c809f0f0 0x7ff1c809e230 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8009920 tx=0x7ff1b8009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bafd772fc147e4b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:28.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.615+0000 7ff1ccc35700 1 -- 172.21.15.40:0/412790928 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8011830 con 0x7ff1c809f0f0 2023-09-30T22:31:28.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.615+0000 7ff1ccc35700 1 -- 172.21.15.40:0/412790928 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b8011990 con 0x7ff1c809f0f0 2023-09-30T22:31:28.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.615+0000 7ff1ccc35700 1 -- 172.21.15.40:0/412790928 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8011d20 con 0x7ff1c809f0f0 2023-09-30T22:31:28.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.616+0000 7ff1cfe9b700 1 -- 172.21.15.40:0/412790928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1c809f0f0 msgr2=0x7ff1c809e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:28.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.616+0000 7ff1cfe9b700 1 --2- 172.21.15.40:0/412790928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1c809f0f0 0x7ff1c809e230 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8009920 tx=0x7ff1b8009c30 comp rx=0 tx=0).stop 2023-09-30T22:31:28.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.616+0000 7ff1cfe9b700 1 -- 172.21.15.40:0/412790928 shutdown_connections 2023-09-30T22:31:28.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.616+0000 7ff1cfe9b700 1 --2- 172.21.15.40:0/412790928 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff1c809d920 0x7ff1c809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.616+0000 7ff1cfe9b700 1 --2- 172.21.15.40:0/412790928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1c809f0f0 0x7ff1c809e230 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.616+0000 7ff1cfe9b700 1 -- 172.21.15.40:0/412790928 >> 172.21.15.40:0/412790928 conn(0x7ff1c809fb20 msgr2=0x7ff1c809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:28.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.616+0000 7ff1cfe9b700 1 -- 172.21.15.40:0/412790928 shutdown_connections 2023-09-30T22:31:28.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.616+0000 7ff1cfe9b700 1 -- 172.21.15.40:0/412790928 wait complete. 2023-09-30T22:31:28.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.617+0000 7ff1cfe9b700 1 Processor -- start 2023-09-30T22:31:28.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.617+0000 7ff1cfe9b700 1 -- start start 2023-09-30T22:31:28.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.618+0000 7ff1cfe9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff1c809d920 0x7ff1c81217e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:28.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.618+0000 7ff1cfe9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff1c8133ca0 0x7ff1c8121d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:28.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.618+0000 7ff1cfe9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1c8122260 0x7ff1c81c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:28.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.618+0000 7ff1cfe9b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c8122cb0 con 0x7ff1c8122260 2023-09-30T22:31:28.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.618+0000 7ff1cfe9b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c8125300 con 0x7ff1c809d920 2023-09-30T22:31:28.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.618+0000 7ff1cfe9b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c809c9e0 con 0x7ff1c8133ca0 2023-09-30T22:31:28.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.618+0000 7ff1ce438700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1c8122260 0x7ff1c81c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:28.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.618+0000 7ff1cd436700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff1c8133ca0 0x7ff1c8121d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:28.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.618+0000 7ff1cd436700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff1c8133ca0 0x7ff1c8121d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51604/0 (socket says 172.21.15.40:51604) 2023-09-30T22:31:28.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.618+0000 7ff1cd436700 1 -- 172.21.15.40:0/3520619308 learned_addr learned my addr 172.21.15.40:0/3520619308 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:28.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.618+0000 7ff1ce438700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1c8122260 0x7ff1c81c8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42988/0 (socket says 172.21.15.40:42988) 2023-09-30T22:31:28.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.619+0000 7ff1ce438700 1 -- 172.21.15.40:0/3520619308 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff1c8133ca0 msgr2=0x7ff1c8121d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:28.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.619+0000 7ff1ce438700 1 --2- 172.21.15.40:0/3520619308 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff1c8133ca0 0x7ff1c8121d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.619+0000 7ff1ce438700 1 -- 172.21.15.40:0/3520619308 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff1c809d920 msgr2=0x7ff1c81217e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:28.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.619+0000 7ff1ce438700 1 --2- 172.21.15.40:0/3520619308 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff1c809d920 0x7ff1c81217e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.619+0000 7ff1ce438700 1 -- 172.21.15.40:0/3520619308 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c4009430 con 0x7ff1c8122260 2023-09-30T22:31:28.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.619+0000 7ff1cd436700 1 --2- 172.21.15.40:0/3520619308 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff1c8133ca0 0x7ff1c8121d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:28.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.619+0000 7ff1ce438700 1 --2- 172.21.15.40:0/3520619308 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1c8122260 0x7ff1c81c8940 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7ff1c000cbc0 tx=0x7ff1c000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:28.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.619+0000 7ff1be7fc700 1 -- 172.21.15.40:0/3520619308 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0003c00 con 0x7ff1c8122260 2023-09-30T22:31:28.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.619+0000 7ff1be7fc700 1 -- 172.21.15.40:0/3520619308 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c0003d60 con 0x7ff1c8122260 2023-09-30T22:31:28.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.619+0000 7ff1be7fc700 1 -- 172.21.15.40:0/3520619308 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c000aaa0 con 0x7ff1c8122260 2023-09-30T22:31:28.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.620+0000 7ff1cfe9b700 1 -- 172.21.15.40:0/3520619308 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b8009550 con 0x7ff1c8122260 2023-09-30T22:31:28.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.620+0000 7ff1cfe9b700 1 -- 172.21.15.40:0/3520619308 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1c8123450 con 0x7ff1c8122260 2023-09-30T22:31:28.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.620+0000 7f7d0371d700 1 Processor -- start 2023-09-30T22:31:28.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.621+0000 7ff1be7fc700 1 -- 172.21.15.40:0/3520619308 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff1c000ac00 con 0x7ff1c8122260 2023-09-30T22:31:28.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.621+0000 7f7d0371d700 1 -- start start 2023-09-30T22:31:28.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.621+0000 7ff1be7fc700 1 -- 172.21.15.40:0/3520619308 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff1c003f500 con 0x7ff1c8122260 2023-09-30T22:31:28.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.621+0000 7ff1cfe9b700 1 -- 172.21.15.40:0/3520619308 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1c81233f0 con 0x7ff1c8122260 2023-09-30T22:31:28.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.621+0000 7f7d0371d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7cfc09d920 0x7f7cfc09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:28.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.621+0000 7f7d0371d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7cfc09e230 0x7f7cfc1308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:28.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.621+0000 7f7d0371d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7cfc130de0 0x7f7cfc131280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:28.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.621+0000 7f7d0371d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cfc09edf0 con 0x7f7cfc130de0 2023-09-30T22:31:28.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.621+0000 7f7d0371d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc09adf0 con 0x7f7cfc09d920 2023-09-30T22:31:28.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.621+0000 7f7d0371d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc09b660 con 0x7f7cfc09e230 2023-09-30T22:31:28.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.621+0000 7f7d014b9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7cfc09d920 0x7f7cfc09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:28.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.621+0000 7f7d014b9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7cfc09d920 0x7f7cfc09dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50704/0 (socket says 172.21.15.40:50704) 2023-09-30T22:31:28.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.621+0000 7f7d014b9700 1 -- 172.21.15.40:0/1268652012 learned_addr learned my addr 172.21.15.40:0/1268652012 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:28.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.622+0000 7f7d00cb8700 1 --2- 172.21.15.40:0/1268652012 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7cfc09e230 0x7f7cfc1308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:28.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.622+0000 7f7d014b9700 1 -- 172.21.15.40:0/1268652012 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7cfc09e230 msgr2=0x7f7cfc1308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:28.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.622+0000 7f7d014b9700 1 --2- 172.21.15.40:0/1268652012 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7cfc09e230 0x7f7cfc1308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.622+0000 7f7d014b9700 1 -- 172.21.15.40:0/1268652012 >> v2:172.21.15.40:3300/0 conn(0x7f7cfc130de0 msgr2=0x7f7cfc131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:28.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.622+0000 7f7d014b9700 1 --2- 172.21.15.40:0/1268652012 >> v2:172.21.15.40:3300/0 conn(0x7f7cfc130de0 0x7f7cfc131280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.622+0000 7f7d014b9700 1 -- 172.21.15.40:0/1268652012 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cfc09a6e0 con 0x7f7cfc09d920 2023-09-30T22:31:28.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.622+0000 7f7d014b9700 1 --2- 172.21.15.40:0/1268652012 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7cfc09d920 0x7f7cfc09dcf0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0006fd0 tx=0x7f7cf0009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb17c513debb9498 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:28.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.622+0000 7f7ceffff700 1 -- 172.21.15.40:0/1268652012 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf0005e30 con 0x7f7cfc09d920 2023-09-30T22:31:28.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.622+0000 7f7ceffff700 1 -- 172.21.15.40:0/1268652012 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf0006030 con 0x7f7cfc09d920 2023-09-30T22:31:28.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.622+0000 7f7ceffff700 1 -- 172.21.15.40:0/1268652012 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf00063a0 con 0x7f7cfc09d920 2023-09-30T22:31:28.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.623+0000 7f7d0371d700 1 -- 172.21.15.40:0/1268652012 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7cfc09d920 msgr2=0x7f7cfc09dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:28.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.623+0000 7f7d0371d700 1 --2- 172.21.15.40:0/1268652012 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7cfc09d920 0x7f7cfc09dcf0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0006fd0 tx=0x7f7cf0009bd0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.623+0000 7f7d0371d700 1 -- 172.21.15.40:0/1268652012 shutdown_connections 2023-09-30T22:31:28.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.623+0000 7f7d0371d700 1 --2- 172.21.15.40:0/1268652012 >> v2:172.21.15.40:3300/0 conn(0x7f7cfc130de0 0x7f7cfc131280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.623+0000 7f7d0371d700 1 --2- 172.21.15.40:0/1268652012 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7cfc09d920 0x7f7cfc09dcf0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.623+0000 7f7d0371d700 1 --2- 172.21.15.40:0/1268652012 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7cfc09e230 0x7f7cfc1308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.623+0000 7f7d0371d700 1 -- 172.21.15.40:0/1268652012 >> 172.21.15.40:0/1268652012 conn(0x7f7cfc09fb20 msgr2=0x7f7cfc09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:28.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.623+0000 7f7d0371d700 1 -- 172.21.15.40:0/1268652012 shutdown_connections 2023-09-30T22:31:28.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.623+0000 7f7d0371d700 1 -- 172.21.15.40:0/1268652012 wait complete. 2023-09-30T22:31:28.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.624+0000 7f7d0371d700 1 Processor -- start 2023-09-30T22:31:28.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.624+0000 7f7d0371d700 1 -- start start 2023-09-30T22:31:28.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.624+0000 7f7d0371d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7cfc09d920 0x7f7cfc11c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:28.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.624+0000 7f7d0371d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7cfc09e230 0x7f7cfc11c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:28.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.625+0000 7f7d0371d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7cfc130de0 0x7f7cfc11cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:28.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.625+0000 7f7d0371d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc11e300 con 0x7f7cfc130de0 2023-09-30T22:31:28.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.625+0000 7f7d0371d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc06b190 con 0x7f7cfc09e230 2023-09-30T22:31:28.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.625+0000 7f7d0371d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc09cb00 con 0x7f7cfc09d920 2023-09-30T22:31:28.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.625+0000 7f7d01cba700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7cfc130de0 0x7f7cfc11cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:28.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.625+0000 7f7d014b9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7cfc09d920 0x7f7cfc11c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:28.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.625+0000 7f7d014b9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7cfc09d920 0x7f7cfc11c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51620/0 (socket says 172.21.15.40:51620) 2023-09-30T22:31:28.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.625+0000 7f7d00cb8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7cfc09e230 0x7f7cfc11c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:28.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.625+0000 7f7d01cba700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7cfc130de0 0x7f7cfc11cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43016/0 (socket says 172.21.15.40:43016) 2023-09-30T22:31:28.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.625+0000 7f7d014b9700 1 -- 172.21.15.40:0/1652330874 learned_addr learned my addr 172.21.15.40:0/1652330874 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:28.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.625+0000 7f7d014b9700 1 -- 172.21.15.40:0/1652330874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7cfc09e230 msgr2=0x7f7cfc11c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:28.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.625+0000 7f7d014b9700 1 --2- 172.21.15.40:0/1652330874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7cfc09e230 0x7f7cfc11c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.625+0000 7f7d014b9700 1 -- 172.21.15.40:0/1652330874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7cfc130de0 msgr2=0x7f7cfc11cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:28.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.625+0000 7f7d014b9700 1 --2- 172.21.15.40:0/1652330874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7cfc130de0 0x7f7cfc11cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.625+0000 7f7d014b9700 1 -- 172.21.15.40:0/1652330874 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf0009500 con 0x7f7cfc09d920 2023-09-30T22:31:28.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.625+0000 7f7d014b9700 1 --2- 172.21.15.40:0/1652330874 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7cfc09d920 0x7f7cfc11c2e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0009c10 tx=0x7f7cf0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:28.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.625+0000 7f7cedffb700 1 -- 172.21.15.40:0/1652330874 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf0004050 con 0x7f7cfc09d920 2023-09-30T22:31:28.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.626+0000 7f7cedffb700 1 -- 172.21.15.40:0/1652330874 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf00041b0 con 0x7f7cfc09d920 2023-09-30T22:31:28.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.626+0000 7f7d0371d700 1 -- 172.21.15.40:0/1652330874 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cfc11f3f0 con 0x7f7cfc09d920 2023-09-30T22:31:28.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.626+0000 7f7cedffb700 1 -- 172.21.15.40:0/1652330874 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf0004560 con 0x7f7cfc09d920 2023-09-30T22:31:28.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.626+0000 7f7d0371d700 1 -- 172.21.15.40:0/1652330874 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cfc120160 con 0x7f7cfc09d920 2023-09-30T22:31:28.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.627+0000 7f7cedffb700 1 -- 172.21.15.40:0/1652330874 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7cf0022070 con 0x7f7cfc09d920 2023-09-30T22:31:28.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.627+0000 7f7cedffb700 1 -- 172.21.15.40:0/1652330874 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f7cf0040cd0 con 0x7f7cfc09d920 2023-09-30T22:31:28.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.627+0000 7f7d0371d700 1 -- 172.21.15.40:0/1652330874 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cfc071700 con 0x7f7cfc09d920 2023-09-30T22:31:28.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.631+0000 7ff1be7fc700 1 -- 172.21.15.40:0/3520619308 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff1c00198f0 con 0x7ff1c8122260 2023-09-30T22:31:28.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.632+0000 7f7cedffb700 1 -- 172.21.15.40:0/1652330874 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7cf002e9e0 con 0x7f7cfc09d920 2023-09-30T22:31:28.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.667+0000 7fe50ebd6700 1 Processor -- start 2023-09-30T22:31:28.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.667+0000 7fe50ebd6700 1 -- start start 2023-09-30T22:31:28.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.667+0000 7fe50ebd6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe50809e030 0x7fe50813d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:28.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.667+0000 7fe50ebd6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe50809e450 0x7fe50813f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:28.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.667+0000 7fe50ebd6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe50811d980 con 0x7fe50806a6d0 2023-09-30T22:31:28.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.667+0000 7fe50ebd6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe50806aaa0 con 0x7fe50809e030 2023-09-30T22:31:28.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.667+0000 7fe50ebd6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe50806b150 con 0x7fe50809e450 2023-09-30T22:31:28.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.668+0000 7fe507fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe50809e030 0x7fe50813d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:28.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.668+0000 7fe507fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe50809e030 0x7fe50813d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43024/0 (socket says 172.21.15.40:43024) 2023-09-30T22:31:28.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.668+0000 7fe50c972700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe50806a6d0 0x7fe50809d920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50716/0 (socket says 172.21.15.40:50716) 2023-09-30T22:31:28.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.668+0000 7fe507fff700 1 -- 172.21.15.40:0/1106644703 learned_addr learned my addr 172.21.15.40:0/1106644703 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:28.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.668+0000 7fe507fff700 1 -- 172.21.15.40:0/1106644703 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe50809e450 msgr2=0x7fe50813f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:28.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.668+0000 7fe507fff700 1 --2- 172.21.15.40:0/1106644703 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe50809e450 0x7fe50813f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.668+0000 7fe507fff700 1 -- 172.21.15.40:0/1106644703 >> v1:172.21.15.40:6789/0 conn(0x7fe50806a6d0 legacy=0x7fe50809d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:28.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.668+0000 7fe507fff700 1 -- 172.21.15.40:0/1106644703 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe50809f300 con 0x7fe50809e030 2023-09-30T22:31:28.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.668+0000 7fe507fff700 1 --2- 172.21.15.40:0/1106644703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe50809e030 0x7fe50813d4a0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7fe4f40098f0 tx=0x7fe4f4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf520c98ca2cc0aa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:28.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.668+0000 7fe5077fe700 1 -- 172.21.15.40:0/1106644703 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f400b8a0 con 0x7fe50809e030 2023-09-30T22:31:28.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.669+0000 7fe5077fe700 1 -- 172.21.15.40:0/1106644703 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f400ba00 con 0x7fe50809e030 2023-09-30T22:31:28.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.669+0000 7fe5077fe700 1 -- 172.21.15.40:0/1106644703 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f400bd90 con 0x7fe50809e030 2023-09-30T22:31:28.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.669+0000 7fe50ebd6700 1 -- 172.21.15.40:0/1106644703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe50809e030 msgr2=0x7fe50813d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:28.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.669+0000 7fe50ebd6700 1 --2- 172.21.15.40:0/1106644703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe50809e030 0x7fe50813d4a0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7fe4f40098f0 tx=0x7fe4f4009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:28.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.669+0000 7fe50ebd6700 1 -- 172.21.15.40:0/1106644703 shutdown_connections 2023-09-30T22:31:28.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.669+0000 7fe50ebd6700 1 --2- 172.21.15.40:0/1106644703 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe50809e450 0x7fe50813f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.669+0000 7fe50ebd6700 1 --2- 172.21.15.40:0/1106644703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe50809e030 0x7fe50813d4a0 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.669+0000 7fe50ebd6700 1 -- 172.21.15.40:0/1106644703 >> 172.21.15.40:0/1106644703 conn(0x7fe50809fb20 msgr2=0x7fe50809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:28.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.669+0000 7fe50ebd6700 1 -- 172.21.15.40:0/1106644703 shutdown_connections 2023-09-30T22:31:28.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.669+0000 7fe50ebd6700 1 -- 172.21.15.40:0/1106644703 wait complete. 2023-09-30T22:31:28.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.670+0000 7fe50ebd6700 1 Processor -- start 2023-09-30T22:31:28.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.670+0000 7fe50ebd6700 1 -- start start 2023-09-30T22:31:28.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.671+0000 7fe50ebd6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe50806a6d0 0x7fe508119730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:28.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.671+0000 7fe50ebd6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe50809e030 0x7fe508119c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:28.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.671+0000 7fe50ebd6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe50809e450 0x7fe50811a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:28.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.671+0000 7fe50ebd6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50811c9f0 con 0x7fe50809e450 2023-09-30T22:31:28.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.671+0000 7fe50ebd6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe50811ab80 con 0x7fe50806a6d0 2023-09-30T22:31:28.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.671+0000 7fe50ebd6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe50811d360 con 0x7fe50809e030 2023-09-30T22:31:28.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.671+0000 7fe50d173700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe50809e450 0x7fe50811a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:28.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.671+0000 7fe50c972700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe50806a6d0 0x7fe508119730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:28.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.671+0000 7fe50d173700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe50809e450 0x7fe50811a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43034/0 (socket says 172.21.15.40:43034) 2023-09-30T22:31:28.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.671+0000 7fe50d173700 1 -- 172.21.15.40:0/164292387 learned_addr learned my addr 172.21.15.40:0/164292387 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:28.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.671+0000 7fe50c972700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe50806a6d0 0x7fe508119730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50734/0 (socket says 172.21.15.40:50734) 2023-09-30T22:31:28.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.671+0000 7fe507fff700 1 --2- 172.21.15.40:0/164292387 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe50809e030 0x7fe508119c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:28.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.671+0000 7fe50c972700 1 -- 172.21.15.40:0/164292387 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe50809e030 msgr2=0x7fe508119c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:28.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.671+0000 7fe50c972700 1 --2- 172.21.15.40:0/164292387 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe50809e030 0x7fe508119c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.671+0000 7fe50c972700 1 -- 172.21.15.40:0/164292387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe50809e450 msgr2=0x7fe50811a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:28.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.671+0000 7fe50c972700 1 --2- 172.21.15.40:0/164292387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe50809e450 0x7fe50811a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.671+0000 7fe50c972700 1 -- 172.21.15.40:0/164292387 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f4009550 con 0x7fe50806a6d0 2023-09-30T22:31:28.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.672+0000 7fe50d173700 1 --2- 172.21.15.40:0/164292387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe50809e450 0x7fe50811a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:28.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.672+0000 7fe50c972700 1 --2- 172.21.15.40:0/164292387 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe50806a6d0 0x7fe508119730 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc00c400 tx=0x7fe4fc00c710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:28.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.672+0000 7fe5057fa700 1 -- 172.21.15.40:0/164292387 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc0072d0 con 0x7fe50806a6d0 2023-09-30T22:31:28.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.672+0000 7fe5057fa700 1 -- 172.21.15.40:0/164292387 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4fc007430 con 0x7fe50806a6d0 2023-09-30T22:31:28.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.672+0000 7fe50ebd6700 1 -- 172.21.15.40:0/164292387 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5080a2120 con 0x7fe50806a6d0 2023-09-30T22:31:28.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.672+0000 7fe5057fa700 1 -- 172.21.15.40:0/164292387 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc005830 con 0x7fe50806a6d0 2023-09-30T22:31:28.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.672+0000 7fe50ebd6700 1 -- 172.21.15.40:0/164292387 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe50813f090 con 0x7fe50806a6d0 2023-09-30T22:31:28.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.673+0000 7fe5057fa700 1 -- 172.21.15.40:0/164292387 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe4fc005990 con 0x7fe50806a6d0 2023-09-30T22:31:28.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.673+0000 7fe5057fa700 1 -- 172.21.15.40:0/164292387 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe4fc03e8d0 con 0x7fe50806a6d0 2023-09-30T22:31:28.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.673+0000 7fe50ebd6700 1 -- 172.21.15.40:0/164292387 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe50811cd50 con 0x7fe50806a6d0 2023-09-30T22:31:28.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.678+0000 7fe5057fa700 1 -- 172.21.15.40:0/164292387 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe4fc017070 con 0x7fe50806a6d0 2023-09-30T22:31:28.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.794+0000 7f38b97fa700 1 -- 172.21.15.40:0/2328528114 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f38d41adf70 con 0x7f38d409d920 2023-09-30T22:31:28.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.794+0000 7f38bb7fe700 1 -- 172.21.15.40:0/2328528114 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f38c402a020 con 0x7f38d409d920 2023-09-30T22:31:28.795 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.796+0000 7f38b97fa700 1 -- 172.21.15.40:0/2328528114 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38d409d920 msgr2=0x7f38d41abb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.796+0000 7f38b97fa700 1 --2- 172.21.15.40:0/2328528114 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38d409d920 0x7f38d41abb60 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f38c4009f20 tx=0x7f38c4004750 comp rx=0 tx=0).stop 2023-09-30T22:31:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.797+0000 7f38b97fa700 1 -- 172.21.15.40:0/2328528114 shutdown_connections 2023-09-30T22:31:28.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.797+0000 7f38b97fa700 1 --2- 172.21.15.40:0/2328528114 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f38d41ac5e0 0x7f38d41d2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.797+0000 7f38b97fa700 1 --2- 172.21.15.40:0/2328528114 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38d409d920 0x7f38d41abb60 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.797+0000 7f38b97fa700 1 --2- 172.21.15.40:0/2328528114 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f38d409e230 0x7f38d41ac0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.797+0000 7f38b97fa700 1 -- 172.21.15.40:0/2328528114 >> 172.21.15.40:0/2328528114 conn(0x7f38d409fb20 msgr2=0x7f38d406e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:28.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.797+0000 7f38b97fa700 1 -- 172.21.15.40:0/2328528114 shutdown_connections 2023-09-30T22:31:28.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.797+0000 7f38b97fa700 1 -- 172.21.15.40:0/2328528114 wait complete. 2023-09-30T22:31:28.810 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:28.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.834+0000 7ff1cfe9b700 1 -- 172.21.15.40:0/3520619308 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff1c8062380 con 0x7ff1c8122260 2023-09-30T22:31:28.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.834+0000 7ff1be7fc700 1 -- 172.21.15.40:0/3520619308 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff1c0029090 con 0x7ff1c8122260 2023-09-30T22:31:28.835 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:28.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.837+0000 7ff1cfe9b700 1 -- 172.21.15.40:0/3520619308 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1c8122260 msgr2=0x7ff1c81c8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:28.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.837+0000 7ff1cfe9b700 1 --2- 172.21.15.40:0/3520619308 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1c8122260 0x7ff1c81c8940 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7ff1c000cbc0 tx=0x7ff1c000ced0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.837+0000 7ff1cfe9b700 1 -- 172.21.15.40:0/3520619308 shutdown_connections 2023-09-30T22:31:28.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.837+0000 7ff1cfe9b700 1 --2- 172.21.15.40:0/3520619308 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1c8122260 0x7ff1c81c8940 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.837+0000 7ff1cfe9b700 1 --2- 172.21.15.40:0/3520619308 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff1c809d920 0x7ff1c81217e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.837+0000 7ff1cfe9b700 1 --2- 172.21.15.40:0/3520619308 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff1c8133ca0 0x7ff1c8121d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.837+0000 7ff1cfe9b700 1 -- 172.21.15.40:0/3520619308 >> 172.21.15.40:0/3520619308 conn(0x7ff1c809fb20 msgr2=0x7ff1c80a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:28.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.837+0000 7ff1cfe9b700 1 -- 172.21.15.40:0/3520619308 shutdown_connections 2023-09-30T22:31:28.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.837+0000 7ff1cfe9b700 1 -- 172.21.15.40:0/3520619308 wait complete. 2023-09-30T22:31:28.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.846+0000 7f7d0371d700 1 -- 172.21.15.40:0/1652330874 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7cfc11efa0 con 0x7f7cfc09d920 2023-09-30T22:31:28.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.846+0000 7f7cedffb700 1 -- 172.21.15.40:0/1652330874 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7cf0011420 con 0x7f7cfc09d920 2023-09-30T22:31:28.847 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:28.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.848+0000 7f7d0371d700 1 -- 172.21.15.40:0/1652330874 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7cfc09d920 msgr2=0x7f7cfc11c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:28.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.848+0000 7f7d0371d700 1 --2- 172.21.15.40:0/1652330874 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7cfc09d920 0x7f7cfc11c2e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0009c10 tx=0x7f7cf0004750 comp rx=0 tx=0).stop 2023-09-30T22:31:28.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.849+0000 7f7d0371d700 1 -- 172.21.15.40:0/1652330874 shutdown_connections 2023-09-30T22:31:28.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.849+0000 7f7d0371d700 1 --2- 172.21.15.40:0/1652330874 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7cfc09d920 0x7f7cfc11c2e0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.849+0000 7f7d0371d700 1 --2- 172.21.15.40:0/1652330874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7cfc130de0 0x7f7cfc11cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.849+0000 7f7d0371d700 1 --2- 172.21.15.40:0/1652330874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7cfc09e230 0x7f7cfc11c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.849+0000 7f7d0371d700 1 -- 172.21.15.40:0/1652330874 >> 172.21.15.40:0/1652330874 conn(0x7f7cfc09fb20 msgr2=0x7f7cfc130160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:28.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.849+0000 7f7d0371d700 1 -- 172.21.15.40:0/1652330874 shutdown_connections 2023-09-30T22:31:28.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.849+0000 7f7d0371d700 1 -- 172.21.15.40:0/1652330874 wait complete. 2023-09-30T22:31:28.855 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:28.862 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:28.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.886+0000 7fe50ebd6700 1 -- 172.21.15.40:0/164292387 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe508062380 con 0x7fe50806a6d0 2023-09-30T22:31:28.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.886+0000 7fe5057fa700 1 -- 172.21.15.40:0/164292387 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe4fc011540 con 0x7fe50806a6d0 2023-09-30T22:31:28.887 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:28.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.889+0000 7fe50ebd6700 1 -- 172.21.15.40:0/164292387 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe50806a6d0 msgr2=0x7fe508119730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:28.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.889+0000 7fe50ebd6700 1 --2- 172.21.15.40:0/164292387 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe50806a6d0 0x7fe508119730 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc00c400 tx=0x7fe4fc00c710 comp rx=0 tx=0).stop 2023-09-30T22:31:28.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.889+0000 7fe50ebd6700 1 -- 172.21.15.40:0/164292387 shutdown_connections 2023-09-30T22:31:28.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.889+0000 7fe50ebd6700 1 --2- 172.21.15.40:0/164292387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe50809e450 0x7fe50811a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.889+0000 7fe50ebd6700 1 --2- 172.21.15.40:0/164292387 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe50806a6d0 0x7fe508119730 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.889+0000 7fe50ebd6700 1 --2- 172.21.15.40:0/164292387 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe50809e030 0x7fe508119c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:28.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.889+0000 7fe50ebd6700 1 -- 172.21.15.40:0/164292387 >> 172.21.15.40:0/164292387 conn(0x7fe50809fb20 msgr2=0x7fe50806e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:28.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.889+0000 7fe50ebd6700 1 -- 172.21.15.40:0/164292387 shutdown_connections 2023-09-30T22:31:28.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:28.889+0000 7fe50ebd6700 1 -- 172.21.15.40:0/164292387 wait complete. 2023-09-30T22:31:28.901 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:29.811 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:29.856 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:29.862 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:29.902 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:29.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.965+0000 7fcb38152700 1 Processor -- start 2023-09-30T22:31:29.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.966+0000 7fcb38152700 1 -- start start 2023-09-30T22:31:29.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.966+0000 7fcb38152700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb3009d920 0x7fcb3009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:29.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.966+0000 7fcb38152700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb3009e230 0x7fcb301308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:29.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.966+0000 7fcb38152700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcb30130de0 0x7fcb30131280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:29.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.966+0000 7fcb38152700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb3009edf0 con 0x7fcb30130de0 2023-09-30T22:31:29.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.966+0000 7fcb38152700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3009adf0 con 0x7fcb3009e230 2023-09-30T22:31:29.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.966+0000 7fcb38152700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3009b660 con 0x7fcb3009d920 2023-09-30T22:31:29.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.966+0000 7fcb356ed700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb3009e230 0x7fcb301308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:29.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.966+0000 7fcb356ed700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb3009e230 0x7fcb301308a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50744/0 (socket says 172.21.15.40:50744) 2023-09-30T22:31:29.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.967+0000 7fcb356ed700 1 -- 172.21.15.40:0/2657022666 learned_addr learned my addr 172.21.15.40:0/2657022666 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:29.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.967+0000 7fcb366ef700 1 --2- 172.21.15.40:0/2657022666 >> v2:172.21.15.40:3300/0 conn(0x7fcb30130de0 0x7fcb30131280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:29.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.967+0000 7fcb366ef700 1 -- 172.21.15.40:0/2657022666 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb3009d920 msgr2=0x7fcb3009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:29.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.967+0000 7fcb366ef700 1 --2- 172.21.15.40:0/2657022666 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb3009d920 0x7fcb3009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.967+0000 7fcb366ef700 1 -- 172.21.15.40:0/2657022666 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb3009e230 msgr2=0x7fcb301308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:29.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.967+0000 7fcb366ef700 1 --2- 172.21.15.40:0/2657022666 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb3009e230 0x7fcb301308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.967+0000 7fcb366ef700 1 -- 172.21.15.40:0/2657022666 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3009a6e0 con 0x7fcb30130de0 2023-09-30T22:31:29.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.967+0000 7fcb356ed700 1 --2- 172.21.15.40:0/2657022666 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb3009e230 0x7fcb301308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:29.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.967+0000 7fcb366ef700 1 --2- 172.21.15.40:0/2657022666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb30130de0 0x7fcb30131280 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fcb28009d90 tx=0x7fcb2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e14de1f9fb3583b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:29.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.967+0000 7fcb34eec700 1 -- 172.21.15.40:0/2657022666 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2800e070 con 0x7fcb30130de0 2023-09-30T22:31:29.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.967+0000 7fcb34eec700 1 -- 172.21.15.40:0/2657022666 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb2800bb20 con 0x7fcb30130de0 2023-09-30T22:31:29.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.967+0000 7fcb34eec700 1 -- 172.21.15.40:0/2657022666 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb28012430 con 0x7fcb30130de0 2023-09-30T22:31:29.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.968+0000 7fcb38152700 1 -- 172.21.15.40:0/2657022666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb30130de0 msgr2=0x7fcb30131280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:29.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.968+0000 7fcb38152700 1 --2- 172.21.15.40:0/2657022666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb30130de0 0x7fcb30131280 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fcb28009d90 tx=0x7fcb2800b330 comp rx=0 tx=0).stop 2023-09-30T22:31:29.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.968+0000 7fcb38152700 1 -- 172.21.15.40:0/2657022666 shutdown_connections 2023-09-30T22:31:29.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.968+0000 7fcb38152700 1 --2- 172.21.15.40:0/2657022666 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb3009d920 0x7fcb3009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.968+0000 7fcb38152700 1 --2- 172.21.15.40:0/2657022666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb30130de0 0x7fcb30131280 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.968+0000 7fcb38152700 1 --2- 172.21.15.40:0/2657022666 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb3009e230 0x7fcb301308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.968+0000 7fcb38152700 1 -- 172.21.15.40:0/2657022666 >> 172.21.15.40:0/2657022666 conn(0x7fcb3009fb20 msgr2=0x7fcb3009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:29.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.969+0000 7fcb38152700 1 -- 172.21.15.40:0/2657022666 shutdown_connections 2023-09-30T22:31:29.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.969+0000 7fcb38152700 1 -- 172.21.15.40:0/2657022666 wait complete. 2023-09-30T22:31:29.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.970+0000 7fcb38152700 1 Processor -- start 2023-09-30T22:31:29.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.970+0000 7fcb38152700 1 -- start start 2023-09-30T22:31:29.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.971+0000 7fcb38152700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb3009d920 0x7fcb301201a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:29.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.971+0000 7fcb38152700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb3009e230 0x7fcb301206e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:29.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.971+0000 7fcb38152700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb30130de0 0x7fcb30120c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:29.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.971+0000 7fcb38152700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb30123cc0 con 0x7fcb3009d920 2023-09-30T22:31:29.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.971+0000 7fcb38152700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb30121e90 con 0x7fcb3009e230 2023-09-30T22:31:29.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.971+0000 7fcb38152700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb30122f60 con 0x7fcb30130de0 2023-09-30T22:31:29.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.971+0000 7fcb35eee700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb3009d920 0x7fcb301201a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:29.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.971+0000 7fcb35eee700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb3009d920 0x7fcb301201a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43044/0 (socket says 172.21.15.40:43044) 2023-09-30T22:31:29.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.971+0000 7fcb35eee700 1 -- 172.21.15.40:0/2390428381 learned_addr learned my addr 172.21.15.40:0/2390428381 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:29.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.971+0000 7fcb356ed700 1 --2- 172.21.15.40:0/2390428381 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb3009e230 0x7fcb301206e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:29.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.971+0000 7fcb366ef700 1 --2- 172.21.15.40:0/2390428381 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb30130de0 0x7fcb30120c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:29.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.972+0000 7fcb356ed700 1 -- 172.21.15.40:0/2390428381 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb30130de0 msgr2=0x7fcb30120c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:29.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.972+0000 7fcb356ed700 1 --2- 172.21.15.40:0/2390428381 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb30130de0 0x7fcb30120c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.972+0000 7fcb356ed700 1 -- 172.21.15.40:0/2390428381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb3009d920 msgr2=0x7fcb301201a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:29.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.972+0000 7fcb356ed700 1 --2- 172.21.15.40:0/2390428381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb3009d920 0x7fcb301201a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:29.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.972+0000 7fcb356ed700 1 -- 172.21.15.40:0/2390428381 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb20009550 con 0x7fcb3009e230 2023-09-30T22:31:29.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.972+0000 7fcb356ed700 1 --2- 172.21.15.40:0/2390428381 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb3009e230 0x7fcb301206e0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fcb2000e9a0 tx=0x7fcb2000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:29.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.972+0000 7fcb267fc700 1 -- 172.21.15.40:0/2390428381 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb20004240 con 0x7fcb3009e230 2023-09-30T22:31:29.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.972+0000 7fcb267fc700 1 -- 172.21.15.40:0/2390428381 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb200043a0 con 0x7fcb3009e230 2023-09-30T22:31:29.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.972+0000 7fcb38152700 1 -- 172.21.15.40:0/2390428381 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb28009a70 con 0x7fcb3009e230 2023-09-30T22:31:29.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.972+0000 7fcb267fc700 1 -- 172.21.15.40:0/2390428381 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb200036a0 con 0x7fcb3009e230 2023-09-30T22:31:29.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.972+0000 7fcb38152700 1 -- 172.21.15.40:0/2390428381 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb30122510 con 0x7fcb3009e230 2023-09-30T22:31:29.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.973+0000 7fcb267fc700 1 -- 172.21.15.40:0/2390428381 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcb20003800 con 0x7fcb3009e230 2023-09-30T22:31:29.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.973+0000 7fcb267fc700 1 -- 172.21.15.40:0/2390428381 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fcb2003f940 con 0x7fcb3009e230 2023-09-30T22:31:29.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.974+0000 7fcb38152700 1 -- 172.21.15.40:0/2390428381 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb30062380 con 0x7fcb3009e230 2023-09-30T22:31:29.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:29.983+0000 7fcb267fc700 1 -- 172.21.15.40:0/2390428381 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcb20013470 con 0x7fcb3009e230 2023-09-30T22:31:30.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.015+0000 7f0e42c3f700 1 Processor -- start 2023-09-30T22:31:30.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.015+0000 7f0e42c3f700 1 -- start start 2023-09-30T22:31:30.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.016+0000 7f0e42c3f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e3c06f3a0 0x7f0e3c06c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:30.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.016+0000 7f0e42c3f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0e3c139380 0x7f0e3c13b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:30.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.016+0000 7f0e42c3f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e3c0a0780 con 0x7f0e3c09fbb0 2023-09-30T22:31:30.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.016+0000 7f0e42c3f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c09ff80 con 0x7f0e3c06f3a0 2023-09-30T22:31:30.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.016+0000 7f0e42c3f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c0a0590 con 0x7f0e3c139380 2023-09-30T22:31:30.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.016+0000 7f0e409db700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e3c06f3a0 0x7f0e3c06c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:30.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.016+0000 7f0e411dc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0e3c139380 0x7f0e3c13b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:30.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.016+0000 7f0e409db700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e3c06f3a0 0x7f0e3c06c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50762/0 (socket says 172.21.15.40:50762) 2023-09-30T22:31:30.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.016+0000 7f0e409db700 1 -- 172.21.15.40:0/3008602839 learned_addr learned my addr 172.21.15.40:0/3008602839 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:30.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.016+0000 7f0e411dc700 1 -- 172.21.15.40:0/3008602839 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e3c06f3a0 msgr2=0x7f0e3c06c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:30.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.016+0000 7f0e411dc700 1 --2- 172.21.15.40:0/3008602839 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e3c06f3a0 0x7f0e3c06c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.016+0000 7f0e411dc700 1 -- 172.21.15.40:0/3008602839 >> v1:172.21.15.40:6789/0 conn(0x7f0e3c09fbb0 legacy=0x7f0e3c06ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:30.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.016+0000 7f0e411dc700 1 -- 172.21.15.40:0/3008602839 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c06df90 con 0x7f0e3c139380 2023-09-30T22:31:30.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.017+0000 7f0e411dc700 1 --2- 172.21.15.40:0/3008602839 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0e3c139380 0x7f0e3c13b760 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f0e34009df0 tx=0x7f0e3400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5122fb005ab8f63 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:30.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.017+0000 7f0e3b7fe700 1 -- 172.21.15.40:0/3008602839 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3400e070 con 0x7f0e3c139380 2023-09-30T22:31:30.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.017+0000 7f0e3b7fe700 1 -- 172.21.15.40:0/3008602839 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3400bb90 con 0x7f0e3c139380 2023-09-30T22:31:30.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.017+0000 7f0e3b7fe700 1 -- 172.21.15.40:0/3008602839 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e34012430 con 0x7f0e3c139380 2023-09-30T22:31:30.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.018+0000 7f0e42c3f700 1 -- 172.21.15.40:0/3008602839 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0e3c139380 msgr2=0x7f0e3c13b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:30.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.018+0000 7f0e42c3f700 1 --2- 172.21.15.40:0/3008602839 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0e3c139380 0x7f0e3c13b760 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f0e34009df0 tx=0x7f0e3400b330 comp rx=0 tx=0).stop 2023-09-30T22:31:30.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.018+0000 7f0e42c3f700 1 -- 172.21.15.40:0/3008602839 shutdown_connections 2023-09-30T22:31:30.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.018+0000 7f0e42c3f700 1 --2- 172.21.15.40:0/3008602839 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0e3c139380 0x7f0e3c13b760 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.018+0000 7f0e42c3f700 1 --2- 172.21.15.40:0/3008602839 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e3c06f3a0 0x7f0e3c06c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.018+0000 7f0e42c3f700 1 -- 172.21.15.40:0/3008602839 >> 172.21.15.40:0/3008602839 conn(0x7f0e3c0a41a0 msgr2=0x7f0e3c0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:30.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.020+0000 7f0e42c3f700 1 -- 172.21.15.40:0/3008602839 shutdown_connections 2023-09-30T22:31:30.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.020+0000 7f0e42c3f700 1 -- 172.21.15.40:0/3008602839 wait complete. 2023-09-30T22:31:30.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.021+0000 7f0e42c3f700 1 Processor -- start 2023-09-30T22:31:30.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.021+0000 7f0e42c3f700 1 -- start start 2023-09-30T22:31:30.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.022+0000 7f0e42c3f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e3c06f3a0 0x7f0e3c1387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:30.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.022+0000 7f0e42c3f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0e3c139380 0x7f0e3c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:30.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.022+0000 7f0e42c3f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e3c095bc0 0x7f0e3c096020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:30.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.022+0000 7f0e42c3f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c071eb0 con 0x7f0e3c06f3a0 2023-09-30T22:31:30.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.022+0000 7f0e42c3f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c070b00 con 0x7f0e3c095bc0 2023-09-30T22:31:30.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.022+0000 7f0e42c3f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c093930 con 0x7f0e3c139380 2023-09-30T22:31:30.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.022+0000 7f0e3bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0e3c139380 0x7f0e3c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:30.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.022+0000 7f0e3bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0e3c139380 0x7f0e3c138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51680/0 (socket says 172.21.15.40:51680) 2023-09-30T22:31:30.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.022+0000 7f0e3bfff700 1 -- 172.21.15.40:0/542606225 learned_addr learned my addr 172.21.15.40:0/542606225 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:30.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.022+0000 7f0e411dc700 1 --2- 172.21.15.40:0/542606225 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e3c095bc0 0x7f0e3c096020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:30.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.022+0000 7f0e409db700 1 --2- 172.21.15.40:0/542606225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e3c06f3a0 0x7f0e3c1387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:30.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.022+0000 7f0e3bfff700 1 -- 172.21.15.40:0/542606225 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e3c095bc0 msgr2=0x7f0e3c096020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:30.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.022+0000 7f0e3bfff700 1 --2- 172.21.15.40:0/542606225 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e3c095bc0 0x7f0e3c096020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.022+0000 7f0e3bfff700 1 -- 172.21.15.40:0/542606225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e3c06f3a0 msgr2=0x7f0e3c1387d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:30.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.022+0000 7f0e3bfff700 1 --2- 172.21.15.40:0/542606225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e3c06f3a0 0x7f0e3c1387d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.022+0000 7f0e3bfff700 1 -- 172.21.15.40:0/542606225 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e34009a70 con 0x7f0e3c139380 2023-09-30T22:31:30.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.023+0000 7f0e3bfff700 1 --2- 172.21.15.40:0/542606225 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0e3c139380 0x7f0e3c138d10 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f0e2800c450 tx=0x7f0e2800c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:30.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.023+0000 7f0e397fa700 1 -- 172.21.15.40:0/542606225 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e28011790 con 0x7f0e3c139380 2023-09-30T22:31:30.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.023+0000 7f0e397fa700 1 -- 172.21.15.40:0/542606225 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e280118f0 con 0x7f0e3c139380 2023-09-30T22:31:30.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.023+0000 7f0e42c3f700 1 -- 172.21.15.40:0/542606225 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e3c097360 con 0x7f0e3c139380 2023-09-30T22:31:30.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.023+0000 7f0e397fa700 1 -- 172.21.15.40:0/542606225 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e28011c60 con 0x7f0e3c139380 2023-09-30T22:31:30.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.023+0000 7f0e42c3f700 1 -- 172.21.15.40:0/542606225 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e3c096ce0 con 0x7f0e3c139380 2023-09-30T22:31:30.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.024+0000 7f0e397fa700 1 -- 172.21.15.40:0/542606225 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0e28005080 con 0x7f0e3c139380 2023-09-30T22:31:30.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.024+0000 7f0e397fa700 1 -- 172.21.15.40:0/542606225 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f0e2803ee90 con 0x7f0e3c139380 2023-09-30T22:31:30.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.025+0000 7f0e42c3f700 1 -- 172.21.15.40:0/542606225 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e3c062380 con 0x7f0e3c139380 2023-09-30T22:31:30.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.030+0000 7f0e397fa700 1 -- 172.21.15.40:0/542606225 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0e2806a750 con 0x7f0e3c139380 2023-09-30T22:31:30.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.045+0000 7fd58d44c700 1 Processor -- start 2023-09-30T22:31:30.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.045+0000 7fd58d44c700 1 -- start start 2023-09-30T22:31:30.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.045+0000 7fd58d44c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd58806a6d0 0x7fd58809d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:30.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.045+0000 7fd58d44c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd58809e250 0x7fd58813fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:30.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.045+0000 7fd58d44c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd58811d980 con 0x7fd58809de60 2023-09-30T22:31:30.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.045+0000 7fd58d44c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd58806aaa0 con 0x7fd58809e250 2023-09-30T22:31:30.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.045+0000 7fd58d44c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd58806b150 con 0x7fd58806a6d0 2023-09-30T22:31:30.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.046+0000 7fd5867fc700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd58809de60 0x7fd58813c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50742/0 (socket says 172.21.15.40:50742) 2023-09-30T22:31:30.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.046+0000 7fd5867fc700 1 -- 172.21.15.40:0/103908590 learned_addr learned my addr 172.21.15.40:0/103908590 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:30.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.046+0000 7fd5877fe700 1 --2- 172.21.15.40:0/103908590 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd58809e250 0x7fd58813fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:30.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.046+0000 7fd586ffd700 1 --2- 172.21.15.40:0/103908590 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd58806a6d0 0x7fd58809d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:30.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.046+0000 7fd585ffb700 1 -- 172.21.15.40:0/103908590 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3067806061 0 0) 0x7fd58811d980 con 0x7fd58809de60 2023-09-30T22:31:30.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.046+0000 7fd5877fe700 1 -- 172.21.15.40:0/103908590 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd58806a6d0 msgr2=0x7fd58809d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:30.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.046+0000 7fd5877fe700 1 --2- 172.21.15.40:0/103908590 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd58806a6d0 0x7fd58809d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.046+0000 7fd5877fe700 1 -- 172.21.15.40:0/103908590 >> v1:172.21.15.40:6789/0 conn(0x7fd58809de60 legacy=0x7fd58813c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:30.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.046+0000 7fd5877fe700 1 -- 172.21.15.40:0/103908590 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd58809f300 con 0x7fd58809e250 2023-09-30T22:31:30.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.046+0000 7fd586ffd700 1 --2- 172.21.15.40:0/103908590 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd58806a6d0 0x7fd58809d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:30.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.046+0000 7fd5877fe700 1 --2- 172.21.15.40:0/103908590 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd58809e250 0x7fd58813fbc0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fd580009dc0 tx=0x7fd58000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf0759557ad9645a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:30.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.046+0000 7fd585ffb700 1 -- 172.21.15.40:0/103908590 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58000e070 con 0x7fd58809e250 2023-09-30T22:31:30.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.046+0000 7fd585ffb700 1 -- 172.21.15.40:0/103908590 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58000bb20 con 0x7fd58809e250 2023-09-30T22:31:30.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.046+0000 7fd585ffb700 1 -- 172.21.15.40:0/103908590 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd580012430 con 0x7fd58809e250 2023-09-30T22:31:30.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.047+0000 7fd58d44c700 1 -- 172.21.15.40:0/103908590 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd58809e250 msgr2=0x7fd58813fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:30.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.047+0000 7fd58d44c700 1 --2- 172.21.15.40:0/103908590 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd58809e250 0x7fd58813fbc0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fd580009dc0 tx=0x7fd58000b330 comp rx=0 tx=0).stop 2023-09-30T22:31:30.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.047+0000 7fd58d44c700 1 -- 172.21.15.40:0/103908590 shutdown_connections 2023-09-30T22:31:30.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.047+0000 7fd58d44c700 1 --2- 172.21.15.40:0/103908590 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd58809e250 0x7fd58813fbc0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.047+0000 7fd58d44c700 1 --2- 172.21.15.40:0/103908590 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd58806a6d0 0x7fd58809d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.047+0000 7fd58d44c700 1 -- 172.21.15.40:0/103908590 >> 172.21.15.40:0/103908590 conn(0x7fd58809fb20 msgr2=0x7fd58809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:30.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.047+0000 7fd58d44c700 1 -- 172.21.15.40:0/103908590 shutdown_connections 2023-09-30T22:31:30.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.047+0000 7fd58d44c700 1 -- 172.21.15.40:0/103908590 wait complete. 2023-09-30T22:31:30.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.048+0000 7fd58d44c700 1 Processor -- start 2023-09-30T22:31:30.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.048+0000 7fd58d44c700 1 -- start start 2023-09-30T22:31:30.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.049+0000 7fd58d44c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd58806a6d0 0x7fd58811b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:30.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.049+0000 7fd58d44c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd58809de60 0x7fd58811bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:30.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.049+0000 7fd58d44c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd58809e250 0x7fd58811c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:30.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.049+0000 7fd58d44c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5881abec0 con 0x7fd58809e250 2023-09-30T22:31:30.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.049+0000 7fd58d44c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5881ac6e0 con 0x7fd58806a6d0 2023-09-30T22:31:30.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.049+0000 7fd58d44c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5881ace30 con 0x7fd58809de60 2023-09-30T22:31:30.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.049+0000 7fd586ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd58806a6d0 0x7fd58811b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:30.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.049+0000 7fd586ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd58806a6d0 0x7fd58811b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50790/0 (socket says 172.21.15.40:50790) 2023-09-30T22:31:30.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.049+0000 7fd586ffd700 1 -- 172.21.15.40:0/3919874303 learned_addr learned my addr 172.21.15.40:0/3919874303 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:30.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.049+0000 7fd5867fc700 1 --2- 172.21.15.40:0/3919874303 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd58809de60 0x7fd58811bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:30.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.049+0000 7fd586ffd700 1 -- 172.21.15.40:0/3919874303 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd58809de60 msgr2=0x7fd58811bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:30.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.049+0000 7fd586ffd700 1 --2- 172.21.15.40:0/3919874303 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd58809de60 0x7fd58811bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.049+0000 7fd586ffd700 1 -- 172.21.15.40:0/3919874303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd58809e250 msgr2=0x7fd58811c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:30.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.049+0000 7fd586ffd700 1 --2- 172.21.15.40:0/3919874303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd58809e250 0x7fd58811c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.049+0000 7fd586ffd700 1 -- 172.21.15.40:0/3919874303 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd578009430 con 0x7fd58806a6d0 2023-09-30T22:31:30.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.050+0000 7fd586ffd700 1 --2- 172.21.15.40:0/3919874303 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd58806a6d0 0x7fd58811b8a0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fd57800ebe0 tx=0x7fd57800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:30.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.050+0000 7fd56f7fe700 1 -- 172.21.15.40:0/3919874303 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd578005a20 con 0x7fd58806a6d0 2023-09-30T22:31:30.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.050+0000 7fd56f7fe700 1 -- 172.21.15.40:0/3919874303 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd578005b80 con 0x7fd58806a6d0 2023-09-30T22:31:30.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.050+0000 7fd56f7fe700 1 -- 172.21.15.40:0/3919874303 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57800c8b0 con 0x7fd58806a6d0 2023-09-30T22:31:30.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.051+0000 7fd58d44c700 1 -- 172.21.15.40:0/3919874303 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd580009a70 con 0x7fd58806a6d0 2023-09-30T22:31:30.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.051+0000 7fd58d44c700 1 -- 172.21.15.40:0/3919874303 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd58811d470 con 0x7fd58806a6d0 2023-09-30T22:31:30.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.051+0000 7fd56f7fe700 1 -- 172.21.15.40:0/3919874303 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd57800ca10 con 0x7fd58806a6d0 2023-09-30T22:31:30.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.052+0000 7fd56f7fe700 1 -- 172.21.15.40:0/3919874303 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd57803f8e0 con 0x7fd58806a6d0 2023-09-30T22:31:30.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.052+0000 7fd58d44c700 1 -- 172.21.15.40:0/3919874303 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5881ab530 con 0x7fd58806a6d0 2023-09-30T22:31:30.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.057+0000 7fd56f7fe700 1 -- 172.21.15.40:0/3919874303 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd578011bd0 con 0x7fd58806a6d0 2023-09-30T22:31:30.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.094+0000 7f19b2da2700 1 Processor -- start 2023-09-30T22:31:30.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.095+0000 7f19b2da2700 1 -- start start 2023-09-30T22:31:30.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.095+0000 7f19b2da2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f19ac1308b0 0x7f19ac130c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:30.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.095+0000 7f19b2da2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f19ac133800 0x7f19ac133c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:30.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.095+0000 7f19b2da2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f19ac134170 0x7f19ac13ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:30.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.095+0000 7f19b2da2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19ac0a24a0 con 0x7f19ac1308b0 2023-09-30T22:31:30.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.095+0000 7f19b2da2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac09f710 con 0x7f19ac134170 2023-09-30T22:31:30.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.095+0000 7f19b2da2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac130480 con 0x7f19ac133800 2023-09-30T22:31:30.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.095+0000 7f19b1da0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f19ac1308b0 0x7f19ac130c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:30.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.095+0000 7f19b1da0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f19ac1308b0 0x7f19ac130c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43066/0 (socket says 172.21.15.40:43066) 2023-09-30T22:31:30.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.095+0000 7f19b1da0700 1 -- 172.21.15.40:0/3743513480 learned_addr learned my addr 172.21.15.40:0/3743513480 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:30.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.095+0000 7f19b25a1700 1 --2- 172.21.15.40:0/3743513480 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f19ac134170 0x7f19ac13ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:30.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.095+0000 7f19b1da0700 1 -- 172.21.15.40:0/3743513480 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f19ac133800 msgr2=0x7f19ac133c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:30.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.095+0000 7f19b1da0700 1 --2- 172.21.15.40:0/3743513480 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f19ac133800 0x7f19ac133c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.095+0000 7f19b1da0700 1 -- 172.21.15.40:0/3743513480 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f19ac134170 msgr2=0x7f19ac13ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:30.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.095+0000 7f19b1da0700 1 --2- 172.21.15.40:0/3743513480 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f19ac134170 0x7f19ac13ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.096+0000 7f19b1da0700 1 -- 172.21.15.40:0/3743513480 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ac0a2890 con 0x7f19ac1308b0 2023-09-30T22:31:30.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.096+0000 7f19b1da0700 1 --2- 172.21.15.40:0/3743513480 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19ac1308b0 0x7f19ac130c80 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f19a8006fd0 tx=0x7f19a8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11a73fe8300c84d2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:30.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.096+0000 7f19b0d9e700 1 -- 172.21.15.40:0/3743513480 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a8005e30 con 0x7f19ac1308b0 2023-09-30T22:31:30.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.096+0000 7f19b0d9e700 1 -- 172.21.15.40:0/3743513480 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a8004030 con 0x7f19ac1308b0 2023-09-30T22:31:30.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.096+0000 7f19b0d9e700 1 -- 172.21.15.40:0/3743513480 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a80043e0 con 0x7f19ac1308b0 2023-09-30T22:31:30.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.096+0000 7f19b2da2700 1 -- 172.21.15.40:0/3743513480 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19ac1308b0 msgr2=0x7f19ac130c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:30.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.097+0000 7f19b2da2700 1 --2- 172.21.15.40:0/3743513480 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19ac1308b0 0x7f19ac130c80 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f19a8006fd0 tx=0x7f19a8009bd0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.097+0000 7f19b2da2700 1 -- 172.21.15.40:0/3743513480 shutdown_connections 2023-09-30T22:31:30.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.097+0000 7f19b2da2700 1 --2- 172.21.15.40:0/3743513480 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f19ac134170 0x7f19ac13ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.097+0000 7f19b2da2700 1 --2- 172.21.15.40:0/3743513480 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19ac1308b0 0x7f19ac130c80 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.097+0000 7f19b2da2700 1 --2- 172.21.15.40:0/3743513480 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f19ac133800 0x7f19ac133c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.097+0000 7f19b2da2700 1 -- 172.21.15.40:0/3743513480 >> 172.21.15.40:0/3743513480 conn(0x7f19ac0a6df0 msgr2=0x7f19ac0a2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:30.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.097+0000 7f19b2da2700 1 -- 172.21.15.40:0/3743513480 shutdown_connections 2023-09-30T22:31:30.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.097+0000 7f19b2da2700 1 -- 172.21.15.40:0/3743513480 wait complete. 2023-09-30T22:31:30.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.098+0000 7f19b2da2700 1 Processor -- start 2023-09-30T22:31:30.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.098+0000 7f19b2da2700 1 -- start start 2023-09-30T22:31:30.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.098+0000 7f19b2da2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f19ac1308b0 0x7f19ac1c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:30.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.098+0000 7f19b2da2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f19ac133800 0x7f19ac1c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:30.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.098+0000 7f19b2da2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19ac134170 0x7f19ac06dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:30.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.098+0000 7f19b2da2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac08f560 con 0x7f19ac134170 2023-09-30T22:31:30.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.098+0000 7f19b2da2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac09ee60 con 0x7f19ac1308b0 2023-09-30T22:31:30.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.098+0000 7f19b2da2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac070f30 con 0x7f19ac133800 2023-09-30T22:31:30.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.098+0000 7f19b1da0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f19ac1308b0 0x7f19ac1c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:30.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.098+0000 7f19b1da0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f19ac1308b0 0x7f19ac1c8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50812/0 (socket says 172.21.15.40:50812) 2023-09-30T22:31:30.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.098+0000 7f19b1da0700 1 -- 172.21.15.40:0/1949083695 learned_addr learned my addr 172.21.15.40:0/1949083695 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:30.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.098+0000 7f19b25a1700 1 --2- 172.21.15.40:0/1949083695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19ac134170 0x7f19ac06dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:30.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.099+0000 7f19b159f700 1 --2- 172.21.15.40:0/1949083695 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f19ac133800 0x7f19ac1c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:30.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.099+0000 7f19b25a1700 1 -- 172.21.15.40:0/1949083695 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f19ac133800 msgr2=0x7f19ac1c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:30.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.099+0000 7f19b25a1700 1 --2- 172.21.15.40:0/1949083695 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f19ac133800 0x7f19ac1c90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.099+0000 7f19b25a1700 1 -- 172.21.15.40:0/1949083695 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f19ac1308b0 msgr2=0x7f19ac1c8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:30.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.099+0000 7f19b25a1700 1 --2- 172.21.15.40:0/1949083695 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f19ac1308b0 0x7f19ac1c8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.099+0000 7f19b25a1700 1 -- 172.21.15.40:0/1949083695 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a8009500 con 0x7f19ac134170 2023-09-30T22:31:30.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.099+0000 7f19b1da0700 1 --2- 172.21.15.40:0/1949083695 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f19ac1308b0 0x7f19ac1c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:30.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.099+0000 7f19b25a1700 1 --2- 172.21.15.40:0/1949083695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19ac134170 0x7f19ac06dc80 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f19a400efc0 tx=0x7f19a400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:30.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.099+0000 7f19a27fc700 1 -- 172.21.15.40:0/1949083695 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a400cd40 con 0x7f19ac134170 2023-09-30T22:31:30.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.099+0000 7f19a27fc700 1 -- 172.21.15.40:0/1949083695 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a400f040 con 0x7f19ac134170 2023-09-30T22:31:30.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.099+0000 7f19a27fc700 1 -- 172.21.15.40:0/1949083695 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a40146c0 con 0x7f19ac134170 2023-09-30T22:31:30.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.100+0000 7f19b2da2700 1 -- 172.21.15.40:0/1949083695 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19ac09bf30 con 0x7f19ac134170 2023-09-30T22:31:30.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.100+0000 7f19b2da2700 1 -- 172.21.15.40:0/1949083695 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19ac070c20 con 0x7f19ac134170 2023-09-30T22:31:30.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.100+0000 7f19a27fc700 1 -- 172.21.15.40:0/1949083695 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f19a4014820 con 0x7f19ac134170 2023-09-30T22:31:30.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.100+0000 7f19a27fc700 1 -- 172.21.15.40:0/1949083695 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f19a4040270 con 0x7f19ac134170 2023-09-30T22:31:30.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.100+0000 7f19b2da2700 1 -- 172.21.15.40:0/1949083695 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19ac071380 con 0x7f19ac134170 2023-09-30T22:31:30.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.105+0000 7f19a27fc700 1 -- 172.21.15.40:0/1949083695 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f19a4018070 con 0x7f19ac134170 2023-09-30T22:31:30.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.253+0000 7fcb38152700 1 -- 172.21.15.40:0/2390428381 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcb301239a0 con 0x7fcb3009e230 2023-09-30T22:31:30.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.254+0000 7fcb267fc700 1 -- 172.21.15.40:0/2390428381 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcb2001bb60 con 0x7fcb3009e230 2023-09-30T22:31:30.254 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:30.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.256+0000 7fcb38152700 1 -- 172.21.15.40:0/2390428381 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb3009e230 msgr2=0x7fcb301206e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:30.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.256+0000 7fcb38152700 1 --2- 172.21.15.40:0/2390428381 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb3009e230 0x7fcb301206e0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fcb2000e9a0 tx=0x7fcb2000ecb0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.256+0000 7fcb38152700 1 -- 172.21.15.40:0/2390428381 shutdown_connections 2023-09-30T22:31:30.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.256+0000 7fcb38152700 1 --2- 172.21.15.40:0/2390428381 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcb30130de0 0x7fcb30120c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.256+0000 7fcb38152700 1 --2- 172.21.15.40:0/2390428381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb3009d920 0x7fcb301201a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.256+0000 7fcb38152700 1 --2- 172.21.15.40:0/2390428381 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcb3009e230 0x7fcb301206e0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.256+0000 7fcb38152700 1 -- 172.21.15.40:0/2390428381 >> 172.21.15.40:0/2390428381 conn(0x7fcb3009fb20 msgr2=0x7fcb3006a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:30.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.256+0000 7fcb38152700 1 -- 172.21.15.40:0/2390428381 shutdown_connections 2023-09-30T22:31:30.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.256+0000 7fcb38152700 1 -- 172.21.15.40:0/2390428381 wait complete. 2023-09-30T22:31:30.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.266+0000 7fd58d44c700 1 -- 172.21.15.40:0/3919874303 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd58811d410 con 0x7fd58806a6d0 2023-09-30T22:31:30.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.266+0000 7fd56f7fe700 1 -- 172.21.15.40:0/3919874303 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd57802a090 con 0x7fd58806a6d0 2023-09-30T22:31:30.270 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:30.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.268+0000 7fd58d44c700 1 -- 172.21.15.40:0/3919874303 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd58806a6d0 msgr2=0x7fd58811b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:30.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.268+0000 7fd58d44c700 1 --2- 172.21.15.40:0/3919874303 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd58806a6d0 0x7fd58811b8a0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fd57800ebe0 tx=0x7fd57800eef0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.268+0000 7fd58d44c700 1 -- 172.21.15.40:0/3919874303 shutdown_connections 2023-09-30T22:31:30.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.268+0000 7fd58d44c700 1 --2- 172.21.15.40:0/3919874303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd58809e250 0x7fd58811c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.268+0000 7fd58d44c700 1 --2- 172.21.15.40:0/3919874303 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd58806a6d0 0x7fd58811b8a0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.268+0000 7fd58d44c700 1 --2- 172.21.15.40:0/3919874303 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd58809de60 0x7fd58811bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.268+0000 7fd58d44c700 1 -- 172.21.15.40:0/3919874303 >> 172.21.15.40:0/3919874303 conn(0x7fd58809fb20 msgr2=0x7fd5880a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:30.272 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:30.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.268+0000 7fd58d44c700 1 -- 172.21.15.40:0/3919874303 shutdown_connections 2023-09-30T22:31:30.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.269+0000 7fd58d44c700 1 -- 172.21.15.40:0/3919874303 wait complete. 2023-09-30T22:31:30.281 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:30.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.287+0000 7f0e42c3f700 1 -- 172.21.15.40:0/542606225 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0e3c0949a0 con 0x7f0e3c139380 2023-09-30T22:31:30.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.287+0000 7f0e397fa700 1 -- 172.21.15.40:0/542606225 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0e28019310 con 0x7f0e3c139380 2023-09-30T22:31:30.288 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:30.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.289+0000 7f0e42c3f700 1 -- 172.21.15.40:0/542606225 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0e3c139380 msgr2=0x7f0e3c138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:30.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.289+0000 7f0e42c3f700 1 --2- 172.21.15.40:0/542606225 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0e3c139380 0x7f0e3c138d10 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f0e2800c450 tx=0x7f0e2800c760 comp rx=0 tx=0).stop 2023-09-30T22:31:30.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.289+0000 7f0e42c3f700 1 -- 172.21.15.40:0/542606225 shutdown_connections 2023-09-30T22:31:30.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.289+0000 7f0e42c3f700 1 --2- 172.21.15.40:0/542606225 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e3c095bc0 0x7f0e3c096020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.289+0000 7f0e42c3f700 1 --2- 172.21.15.40:0/542606225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e3c06f3a0 0x7f0e3c1387d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.289+0000 7f0e42c3f700 1 --2- 172.21.15.40:0/542606225 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f0e3c139380 0x7f0e3c138d10 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.289+0000 7f0e42c3f700 1 -- 172.21.15.40:0/542606225 >> 172.21.15.40:0/542606225 conn(0x7f0e3c0a41a0 msgr2=0x7f0e3c06f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:30.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.289+0000 7f0e42c3f700 1 -- 172.21.15.40:0/542606225 shutdown_connections 2023-09-30T22:31:30.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.289+0000 7f0e42c3f700 1 -- 172.21.15.40:0/542606225 wait complete. 2023-09-30T22:31:30.302 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:30.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.304+0000 7f19b2da2700 1 -- 172.21.15.40:0/1949083695 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f19ac071150 con 0x7f19ac134170 2023-09-30T22:31:30.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.304+0000 7f19a27fc700 1 -- 172.21.15.40:0/1949083695 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f19a4009e60 con 0x7f19ac134170 2023-09-30T22:31:30.305 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:30.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.306+0000 7f19b2da2700 1 -- 172.21.15.40:0/1949083695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19ac134170 msgr2=0x7f19ac06dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:30.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.306+0000 7f19b2da2700 1 --2- 172.21.15.40:0/1949083695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19ac134170 0x7f19ac06dc80 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f19a400efc0 tx=0x7f19a400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.306+0000 7f19b2da2700 1 -- 172.21.15.40:0/1949083695 shutdown_connections 2023-09-30T22:31:30.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.306+0000 7f19b2da2700 1 --2- 172.21.15.40:0/1949083695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19ac134170 0x7f19ac06dc80 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.306+0000 7f19b2da2700 1 --2- 172.21.15.40:0/1949083695 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f19ac1308b0 0x7f19ac1c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.306+0000 7f19b2da2700 1 --2- 172.21.15.40:0/1949083695 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f19ac133800 0x7f19ac1c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:30.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.306+0000 7f19b2da2700 1 -- 172.21.15.40:0/1949083695 >> 172.21.15.40:0/1949083695 conn(0x7f19ac0a6df0 msgr2=0x7f19ac0a4060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:30.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.306+0000 7f19b2da2700 1 -- 172.21.15.40:0/1949083695 shutdown_connections 2023-09-30T22:31:30.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:30.306+0000 7f19b2da2700 1 -- 172.21.15.40:0/1949083695 wait complete. 2023-09-30T22:31:30.319 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:31.272 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:31.282 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:31.304 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:31.320 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:31.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.422+0000 7f541bd1b700 1 Processor -- start 2023-09-30T22:31:31.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.422+0000 7f541bd1b700 1 -- start start 2023-09-30T22:31:31.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.423+0000 7f541bd1b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f541409d920 0x7f541409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:31.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.423+0000 7f541bd1b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f541409e230 0x7f54141343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:31.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.423+0000 7f541bd1b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f541409f940 con 0x7f541409f0f0 2023-09-30T22:31:31.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.423+0000 7f541bd1b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f541406b4c0 con 0x7f541409e230 2023-09-30T22:31:31.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.423+0000 7f541bd1b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f541409a8f0 con 0x7f541409d920 2023-09-30T22:31:31.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.423+0000 7f541a2b8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f541409e230 0x7f54141343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:31.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.423+0000 7f5419ab7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f541409d920 0x7f541409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:31.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.424+0000 7f541a2b8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f541409e230 0x7f54141343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43086/0 (socket says 172.21.15.40:43086) 2023-09-30T22:31:31.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.424+0000 7f5419ab7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f541409d920 0x7f541409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51728/0 (socket says 172.21.15.40:51728) 2023-09-30T22:31:31.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.424+0000 7f541a2b8700 1 -- 172.21.15.40:0/2457246716 learned_addr learned my addr 172.21.15.40:0/2457246716 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:31.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.424+0000 7f5419ab7700 1 -- 172.21.15.40:0/2457246716 >> v2:172.21.15.40:3300/0 conn(0x7f541409e230 msgr2=0x7f54141343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:31.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.424+0000 7f5419ab7700 1 --2- 172.21.15.40:0/2457246716 >> v2:172.21.15.40:3300/0 conn(0x7f541409e230 0x7f54141343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.424+0000 7f5419ab7700 1 -- 172.21.15.40:0/2457246716 >> v1:172.21.15.40:6789/0 conn(0x7f541409f0f0 legacy=0x7f5414133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:31.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.424+0000 7f5419ab7700 1 -- 172.21.15.40:0/2457246716 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541409f6e0 con 0x7f541409d920 2023-09-30T22:31:31.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.424+0000 7f541a2b8700 1 --2- 172.21.15.40:0/2457246716 >> v2:172.21.15.40:3300/0 conn(0x7f541409e230 0x7f54141343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:31.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.424+0000 7f5419ab7700 1 --2- 172.21.15.40:0/2457246716 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f541409d920 0x7f541409dcf0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f5410009820 tx=0x7f5410009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df84078b2c0a0696 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:31.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.424+0000 7f5418ab5700 1 -- 172.21.15.40:0/2457246716 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5410005e30 con 0x7f541409d920 2023-09-30T22:31:31.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.424+0000 7f5418ab5700 1 -- 172.21.15.40:0/2457246716 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5410004030 con 0x7f541409d920 2023-09-30T22:31:31.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.424+0000 7f5418ab5700 1 -- 172.21.15.40:0/2457246716 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54100043c0 con 0x7f541409d920 2023-09-30T22:31:31.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.425+0000 7f541bd1b700 1 -- 172.21.15.40:0/2457246716 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f541409d920 msgr2=0x7f541409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:31.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.425+0000 7f541bd1b700 1 --2- 172.21.15.40:0/2457246716 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f541409d920 0x7f541409dcf0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f5410009820 tx=0x7f5410009b30 comp rx=0 tx=0).stop 2023-09-30T22:31:31.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.425+0000 7f541bd1b700 1 -- 172.21.15.40:0/2457246716 shutdown_connections 2023-09-30T22:31:31.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.425+0000 7f541bd1b700 1 --2- 172.21.15.40:0/2457246716 >> v2:172.21.15.40:3300/0 conn(0x7f541409e230 0x7f54141343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.425+0000 7f541bd1b700 1 --2- 172.21.15.40:0/2457246716 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f541409d920 0x7f541409dcf0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.425+0000 7f541bd1b700 1 -- 172.21.15.40:0/2457246716 >> 172.21.15.40:0/2457246716 conn(0x7f541409fb20 msgr2=0x7f541409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:31.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.425+0000 7f541bd1b700 1 -- 172.21.15.40:0/2457246716 shutdown_connections 2023-09-30T22:31:31.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.425+0000 7f541bd1b700 1 -- 172.21.15.40:0/2457246716 wait complete. 2023-09-30T22:31:31.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.427+0000 7f541bd1b700 1 Processor -- start 2023-09-30T22:31:31.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.427+0000 7f541bd1b700 1 -- start start 2023-09-30T22:31:31.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.427+0000 7f541bd1b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f541409d920 0x7f54141a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:31.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.427+0000 7f541bd1b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f541409e230 0x7f54141a67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:31.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.427+0000 7f541bd1b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54141aa210 0x7f54141a6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:31.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.428+0000 7f541bd1b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54141a7e00 con 0x7f541409d920 2023-09-30T22:31:31.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.428+0000 7f541bd1b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54141a8420 con 0x7f54141aa210 2023-09-30T22:31:31.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.428+0000 7f541bd1b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54141a9050 con 0x7f541409e230 2023-09-30T22:31:31.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.428+0000 7f54192b6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f541409e230 0x7f54141a67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:31.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.428+0000 7f54192b6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f541409e230 0x7f54141a67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51738/0 (socket says 172.21.15.40:51738) 2023-09-30T22:31:31.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.428+0000 7f54192b6700 1 -- 172.21.15.40:0/4246418713 learned_addr learned my addr 172.21.15.40:0/4246418713 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:31.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.428+0000 7f541a2b8700 1 --2- 172.21.15.40:0/4246418713 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54141aa210 0x7f54141a6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:31.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.428+0000 7f5419ab7700 1 --2- 172.21.15.40:0/4246418713 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f541409d920 0x7f54141a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:31.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.428+0000 7f54192b6700 1 -- 172.21.15.40:0/4246418713 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54141aa210 msgr2=0x7f54141a6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:31.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.428+0000 7f54192b6700 1 --2- 172.21.15.40:0/4246418713 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54141aa210 0x7f54141a6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.428+0000 7f54192b6700 1 -- 172.21.15.40:0/4246418713 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f541409d920 msgr2=0x7f54141a6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:31.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.428+0000 7f54192b6700 1 --2- 172.21.15.40:0/4246418713 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f541409d920 0x7f54141a6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.428+0000 7f54192b6700 1 -- 172.21.15.40:0/4246418713 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540c009b30 con 0x7f541409e230 2023-09-30T22:31:31.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.428+0000 7f5419ab7700 1 --2- 172.21.15.40:0/4246418713 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f541409d920 0x7f54141a6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:31.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.428+0000 7f54192b6700 1 --2- 172.21.15.40:0/4246418713 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f541409e230 0x7f54141a67c0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f540400c520 tx=0x7f540400c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:31.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.429+0000 7f540a7fc700 1 -- 172.21.15.40:0/4246418713 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5404016070 con 0x7f541409e230 2023-09-30T22:31:31.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.429+0000 7f540a7fc700 1 -- 172.21.15.40:0/4246418713 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5404006860 con 0x7f541409e230 2023-09-30T22:31:31.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.429+0000 7f541bd1b700 1 -- 172.21.15.40:0/4246418713 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5410009430 con 0x7f541409e230 2023-09-30T22:31:31.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.429+0000 7f540a7fc700 1 -- 172.21.15.40:0/4246418713 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5404006bf0 con 0x7f541409e230 2023-09-30T22:31:31.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.429+0000 7f541bd1b700 1 -- 172.21.15.40:0/4246418713 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54141a94a0 con 0x7f541409e230 2023-09-30T22:31:31.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.430+0000 7f541bd1b700 1 -- 172.21.15.40:0/4246418713 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54141bb870 con 0x7f541409e230 2023-09-30T22:31:31.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.431+0000 7f540a7fc700 1 -- 172.21.15.40:0/4246418713 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5404006d50 con 0x7f541409e230 2023-09-30T22:31:31.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.431+0000 7f540a7fc700 1 -- 172.21.15.40:0/4246418713 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f540403f760 con 0x7f541409e230 2023-09-30T22:31:31.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.435+0000 7f540a7fc700 1 -- 172.21.15.40:0/4246418713 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5404024c10 con 0x7f541409e230 2023-09-30T22:31:31.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.459+0000 7f272e7c1700 1 Processor -- start 2023-09-30T22:31:31.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.459+0000 7f272e7c1700 1 -- start start 2023-09-30T22:31:31.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.459+0000 7f272e7c1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f272809f0f0 0x7f2728138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:31.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.459+0000 7f272e7c1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f272809e400 0x7f272813b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:31.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.459+0000 7f272e7c1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f272809f940 con 0x7f272809d920 2023-09-30T22:31:31.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.459+0000 7f272e7c1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f272806b4c0 con 0x7f272809e400 2023-09-30T22:31:31.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.459+0000 7f272e7c1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272809a8f0 con 0x7f272809f0f0 2023-09-30T22:31:31.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.459+0000 7f272cd5e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f272809e400 0x7f272813b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:31.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.460+0000 7f272cd5e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f272809e400 0x7f272813b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43108/0 (socket says 172.21.15.40:43108) 2023-09-30T22:31:31.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.460+0000 7f272cd5e700 1 -- 172.21.15.40:0/2199413689 learned_addr learned my addr 172.21.15.40:0/2199413689 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:31.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.460+0000 7f27277fe700 1 --2- 172.21.15.40:0/2199413689 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f272809f0f0 0x7f2728138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:31.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.460+0000 7f272cd5e700 1 -- 172.21.15.40:0/2199413689 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f272809f0f0 msgr2=0x7f2728138ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:31.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.460+0000 7f272cd5e700 1 --2- 172.21.15.40:0/2199413689 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f272809f0f0 0x7f2728138ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.460+0000 7f272cd5e700 1 -- 172.21.15.40:0/2199413689 >> v1:172.21.15.40:6789/0 conn(0x7f272809d920 legacy=0x7f272809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:31.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.460+0000 7f272cd5e700 1 -- 172.21.15.40:0/2199413689 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272809f6e0 con 0x7f272809e400 2023-09-30T22:31:31.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.460+0000 7f272cd5e700 1 --2- 172.21.15.40:0/2199413689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f272809e400 0x7f272813b430 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f2720009e80 tx=0x7f272000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f4084aa0c89fa7f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:31.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.460+0000 7f2726ffd700 1 -- 172.21.15.40:0/2199413689 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272000e070 con 0x7f272809e400 2023-09-30T22:31:31.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.460+0000 7f2726ffd700 1 -- 172.21.15.40:0/2199413689 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272000b8d0 con 0x7f272809e400 2023-09-30T22:31:31.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.460+0000 7f2726ffd700 1 -- 172.21.15.40:0/2199413689 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272000bc80 con 0x7f272809e400 2023-09-30T22:31:31.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.461+0000 7f272e7c1700 1 -- 172.21.15.40:0/2199413689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f272809e400 msgr2=0x7f272813b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:31.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.461+0000 7f272e7c1700 1 --2- 172.21.15.40:0/2199413689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f272809e400 0x7f272813b430 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f2720009e80 tx=0x7f272000b330 comp rx=0 tx=0).stop 2023-09-30T22:31:31.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.461+0000 7f272e7c1700 1 -- 172.21.15.40:0/2199413689 shutdown_connections 2023-09-30T22:31:31.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.461+0000 7f272e7c1700 1 --2- 172.21.15.40:0/2199413689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f272809e400 0x7f272813b430 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.461+0000 7f272e7c1700 1 --2- 172.21.15.40:0/2199413689 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f272809f0f0 0x7f2728138ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.461+0000 7f272e7c1700 1 -- 172.21.15.40:0/2199413689 >> 172.21.15.40:0/2199413689 conn(0x7f272809fb20 msgr2=0x7f272809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:31.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.461+0000 7f272e7c1700 1 -- 172.21.15.40:0/2199413689 shutdown_connections 2023-09-30T22:31:31.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.461+0000 7f272e7c1700 1 -- 172.21.15.40:0/2199413689 wait complete. 2023-09-30T22:31:31.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.462+0000 7f272e7c1700 1 Processor -- start 2023-09-30T22:31:31.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.463+0000 7f272e7c1700 1 -- start start 2023-09-30T22:31:31.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.463+0000 7f272e7c1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f272809d920 0x7f272811e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:31.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.463+0000 7f272e7c1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f272809e400 0x7f272811ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:31.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.463+0000 7f272e7c1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f272811f230 0x7f27281ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:31.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.463+0000 7f272e7c1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27280a32b0 con 0x7f272809d920 2023-09-30T22:31:31.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.463+0000 7f272e7c1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272809c9e0 con 0x7f272811f230 2023-09-30T22:31:31.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.463+0000 7f272e7c1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2728121a10 con 0x7f272809e400 2023-09-30T22:31:31.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.463+0000 7f27277fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f272809e400 0x7f272811ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:31.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.463+0000 7f27277fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f272809e400 0x7f272811ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51752/0 (socket says 172.21.15.40:51752) 2023-09-30T22:31:31.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.463+0000 7f27277fe700 1 -- 172.21.15.40:0/2198012561 learned_addr learned my addr 172.21.15.40:0/2198012561 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:31.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.463+0000 7f272cd5e700 1 --2- 172.21.15.40:0/2198012561 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f272811f230 0x7f27281ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:31.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.463+0000 7f2727fff700 1 --2- 172.21.15.40:0/2198012561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f272809d920 0x7f272811e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:31.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.464+0000 7f27277fe700 1 -- 172.21.15.40:0/2198012561 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f272811f230 msgr2=0x7f27281ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:31.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.464+0000 7f27277fe700 1 --2- 172.21.15.40:0/2198012561 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f272811f230 0x7f27281ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.464+0000 7f27277fe700 1 -- 172.21.15.40:0/2198012561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f272809d920 msgr2=0x7f272811e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:31.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.464+0000 7f27277fe700 1 --2- 172.21.15.40:0/2198012561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f272809d920 0x7f272811e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.464+0000 7f27277fe700 1 -- 172.21.15.40:0/2198012561 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2720009b30 con 0x7f272809e400 2023-09-30T22:31:31.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.464+0000 7f272cd5e700 1 --2- 172.21.15.40:0/2198012561 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f272811f230 0x7f27281ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:31.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.464+0000 7f27277fe700 1 --2- 172.21.15.40:0/2198012561 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f272809e400 0x7f272811ecf0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f271c00e9b0 tx=0x7f271c00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:31.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.464+0000 7f2724ff9700 1 -- 172.21.15.40:0/2198012561 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c009710 con 0x7f272809e400 2023-09-30T22:31:31.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.464+0000 7f2724ff9700 1 -- 172.21.15.40:0/2198012561 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271c00c850 con 0x7f272809e400 2023-09-30T22:31:31.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.464+0000 7fa8db464700 1 Processor -- start 2023-09-30T22:31:31.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.464+0000 7f2724ff9700 1 -- 172.21.15.40:0/2198012561 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c00cbc0 con 0x7f272809e400 2023-09-30T22:31:31.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.464+0000 7f272e7c1700 1 -- 172.21.15.40:0/2198012561 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2728121fa0 con 0x7f272809e400 2023-09-30T22:31:31.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.464+0000 7f272e7c1700 1 -- 172.21.15.40:0/2198012561 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2728122a10 con 0x7f272809e400 2023-09-30T22:31:31.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.464+0000 7fa8db464700 1 -- start start 2023-09-30T22:31:31.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.465+0000 7fa8db464700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa8d409d450 0x7fa8d409d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:31.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.465+0000 7fa8db464700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa8d41308d0 0x7fa8d4138420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:31.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.465+0000 7fa8db464700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d409c3b0 con 0x7fa8d409dd60 2023-09-30T22:31:31.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.465+0000 7fa8db464700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d409a6b0 con 0x7fa8d41308d0 2023-09-30T22:31:31.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.465+0000 7fa8db464700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d409b4f0 con 0x7fa8d409d450 2023-09-30T22:31:31.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.465+0000 7fa8d89ff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa8d409dd60 0x7fa8d41301c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50778/0 (socket says 172.21.15.40:50778) 2023-09-30T22:31:31.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.465+0000 7fa8d89ff700 1 -- 172.21.15.40:0/268558685 learned_addr learned my addr 172.21.15.40:0/268558685 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:31.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.466+0000 7fa8d9200700 1 --2- 172.21.15.40:0/268558685 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa8d409d450 0x7fa8d409d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:31.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.465+0000 7f2724ff9700 1 -- 172.21.15.40:0/2198012561 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f271c00cd20 con 0x7f272809e400 2023-09-30T22:31:31.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.465+0000 7f272e7c1700 1 -- 172.21.15.40:0/2198012561 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27281215c0 con 0x7f272809e400 2023-09-30T22:31:31.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.466+0000 7f2724ff9700 1 -- 172.21.15.40:0/2198012561 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f271c03f7d0 con 0x7f272809e400 2023-09-30T22:31:31.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.466+0000 7fa8d9a01700 1 --2- 172.21.15.40:0/268558685 >> v2:172.21.15.40:3300/0 conn(0x7fa8d41308d0 0x7fa8d4138420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:31.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.466+0000 7fa8d9200700 1 -- 172.21.15.40:0/268558685 >> v2:172.21.15.40:3300/0 conn(0x7fa8d41308d0 msgr2=0x7fa8d4138420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:31.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.466+0000 7fa8d9200700 1 --2- 172.21.15.40:0/268558685 >> v2:172.21.15.40:3300/0 conn(0x7fa8d41308d0 0x7fa8d4138420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.466+0000 7fa8d9200700 1 -- 172.21.15.40:0/268558685 >> v1:172.21.15.40:6789/0 conn(0x7fa8d409dd60 legacy=0x7fa8d41301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:31.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.466+0000 7fa8d9200700 1 -- 172.21.15.40:0/268558685 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d409af90 con 0x7fa8d409d450 2023-09-30T22:31:31.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.466+0000 7fa8d9a01700 1 --2- 172.21.15.40:0/268558685 >> v2:172.21.15.40:3300/0 conn(0x7fa8d41308d0 0x7fa8d4138420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:31:31.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.466+0000 7fa8d9200700 1 --2- 172.21.15.40:0/268558685 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa8d409d450 0x7fa8d409d820 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fa8d000a9e0 tx=0x7fa8d000acf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=536e8399ab4d41f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:31.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.471+0000 7fa8cbfff700 1 -- 172.21.15.40:0/268558685 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d000cb70 con 0x7fa8d409d450 2023-09-30T22:31:31.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.471+0000 7fa8cbfff700 1 -- 172.21.15.40:0/268558685 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d000ccd0 con 0x7fa8d409d450 2023-09-30T22:31:31.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.471+0000 7fa8cbfff700 1 -- 172.21.15.40:0/268558685 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d0018600 con 0x7fa8d409d450 2023-09-30T22:31:31.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.471+0000 7f2724ff9700 1 -- 172.21.15.40:0/2198012561 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f271c0232f0 con 0x7f272809e400 2023-09-30T22:31:31.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.472+0000 7fa8db464700 1 -- 172.21.15.40:0/268558685 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa8d409d450 msgr2=0x7fa8d409d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:31.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.472+0000 7fa8db464700 1 --2- 172.21.15.40:0/268558685 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa8d409d450 0x7fa8d409d820 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fa8d000a9e0 tx=0x7fa8d000acf0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.472+0000 7fa8db464700 1 -- 172.21.15.40:0/268558685 shutdown_connections 2023-09-30T22:31:31.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.472+0000 7fa8db464700 1 --2- 172.21.15.40:0/268558685 >> v2:172.21.15.40:3300/0 conn(0x7fa8d41308d0 0x7fa8d4138420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.472+0000 7fa8db464700 1 --2- 172.21.15.40:0/268558685 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa8d409d450 0x7fa8d409d820 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.472+0000 7fa8db464700 1 -- 172.21.15.40:0/268558685 >> 172.21.15.40:0/268558685 conn(0x7fa8d40a2a00 msgr2=0x7fa8d40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:31.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.472+0000 7fa8db464700 1 -- 172.21.15.40:0/268558685 shutdown_connections 2023-09-30T22:31:31.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.472+0000 7fa8db464700 1 -- 172.21.15.40:0/268558685 wait complete. 2023-09-30T22:31:31.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.473+0000 7fa8db464700 1 Processor -- start 2023-09-30T22:31:31.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.474+0000 7fa8db464700 1 -- start start 2023-09-30T22:31:31.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.474+0000 7fa8db464700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa8d409d450 0x7fa8d412ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:31.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.474+0000 7fa8db464700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8d409dd60 0x7fa8d411a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:31.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.474+0000 7fa8db464700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8d41308d0 0x7fa8d411a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:31.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.474+0000 7fa8db464700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d411b560 con 0x7fa8d409dd60 2023-09-30T22:31:31.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.474+0000 7fa8db464700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d411dbd0 con 0x7fa8d41308d0 2023-09-30T22:31:31.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.474+0000 7fa8db464700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d409c5d0 con 0x7fa8d409d450 2023-09-30T22:31:31.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.475+0000 7fa8d9200700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa8d409d450 0x7fa8d412ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:31.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.475+0000 7fa8d89ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8d409dd60 0x7fa8d411a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:31.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.475+0000 7fa8d9200700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa8d409d450 0x7fa8d412ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:51774/0 (socket says 172.21.15.40:51774) 2023-09-30T22:31:31.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.475+0000 7fa8d9200700 1 -- 172.21.15.40:0/2044606549 learned_addr learned my addr 172.21.15.40:0/2044606549 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:31.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.475+0000 7fa8d9a01700 1 --2- 172.21.15.40:0/2044606549 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8d41308d0 0x7fa8d411a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:31.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.475+0000 7fa8d89ff700 1 -- 172.21.15.40:0/2044606549 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa8d409d450 msgr2=0x7fa8d412ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:31.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.475+0000 7fa8d89ff700 1 --2- 172.21.15.40:0/2044606549 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa8d409d450 0x7fa8d412ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.475+0000 7fa8d89ff700 1 -- 172.21.15.40:0/2044606549 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8d41308d0 msgr2=0x7fa8d411a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:31.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.475+0000 7fa8d89ff700 1 --2- 172.21.15.40:0/2044606549 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8d41308d0 0x7fa8d411a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.475+0000 7fa8d89ff700 1 -- 172.21.15.40:0/2044606549 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d000a640 con 0x7fa8d409dd60 2023-09-30T22:31:31.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.475+0000 7fa8d89ff700 1 --2- 172.21.15.40:0/2044606549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8d409dd60 0x7fa8d411a0b0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400c500 tx=0x7fa8c400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:31.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.475+0000 7fa8c9ffb700 1 -- 172.21.15.40:0/2044606549 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4005d70 con 0x7fa8d409dd60 2023-09-30T22:31:31.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.476+0000 7fa8c9ffb700 1 -- 172.21.15.40:0/2044606549 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c40070d0 con 0x7fa8d409dd60 2023-09-30T22:31:31.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.476+0000 7fa8db464700 1 -- 172.21.15.40:0/2044606549 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d4126d40 con 0x7fa8d409dd60 2023-09-30T22:31:31.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.476+0000 7fa8c9ffb700 1 -- 172.21.15.40:0/2044606549 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4007440 con 0x7fa8d409dd60 2023-09-30T22:31:31.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.476+0000 7fa8db464700 1 -- 172.21.15.40:0/2044606549 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d412f130 con 0x7fa8d409dd60 2023-09-30T22:31:31.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.477+0000 7fa8c9ffb700 1 -- 172.21.15.40:0/2044606549 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa8c40075a0 con 0x7fa8d409dd60 2023-09-30T22:31:31.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.477+0000 7fa8c9ffb700 1 -- 172.21.15.40:0/2044606549 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa8c4040b70 con 0x7fa8d409dd60 2023-09-30T22:31:31.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.477+0000 7fa8db464700 1 -- 172.21.15.40:0/2044606549 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d4062380 con 0x7fa8d409dd60 2023-09-30T22:31:31.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.482+0000 7fa8c9ffb700 1 -- 172.21.15.40:0/2044606549 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa8c4017030 con 0x7fa8d409dd60 2023-09-30T22:31:31.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.503+0000 7f6889f1e700 1 Processor -- start 2023-09-30T22:31:31.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.504+0000 7f6889f1e700 1 -- start start 2023-09-30T22:31:31.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.504+0000 7f6889f1e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f688409d920 0x7f688409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:31.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.504+0000 7f6889f1e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f688409f0f0 0x7f688409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:31.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.504+0000 7f6889f1e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f688409f940 con 0x7f6884133ca0 2023-09-30T22:31:31.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.504+0000 7f6889f1e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f688406b4c0 con 0x7f688409f0f0 2023-09-30T22:31:31.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.504+0000 7f6889f1e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f688409a8f0 con 0x7f688409d920 2023-09-30T22:31:31.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.504+0000 7f68837fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f688409d920 0x7f688409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:31.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.504+0000 7f68837fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f688409d920 0x7f688409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50870/0 (socket says 172.21.15.40:50870) 2023-09-30T22:31:31.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.504+0000 7f68837fe700 1 -- 172.21.15.40:0/1505964945 learned_addr learned my addr 172.21.15.40:0/1505964945 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:31.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.505+0000 7f6882ffd700 1 --2- 172.21.15.40:0/1505964945 >> v2:172.21.15.40:3300/0 conn(0x7f688409f0f0 0x7f688409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:31.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.505+0000 7f68837fe700 1 -- 172.21.15.40:0/1505964945 >> v2:172.21.15.40:3300/0 conn(0x7f688409f0f0 msgr2=0x7f688409e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:31.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.505+0000 7f68837fe700 1 --2- 172.21.15.40:0/1505964945 >> v2:172.21.15.40:3300/0 conn(0x7f688409f0f0 0x7f688409e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.505+0000 7f68837fe700 1 -- 172.21.15.40:0/1505964945 >> v1:172.21.15.40:6789/0 conn(0x7f6884133ca0 legacy=0x7f6884134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:31.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.505+0000 7f68837fe700 1 -- 172.21.15.40:0/1505964945 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f688409f6e0 con 0x7f688409d920 2023-09-30T22:31:31.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.505+0000 7f68837fe700 1 --2- 172.21.15.40:0/1505964945 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f688409d920 0x7f688409dcf0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f6874006fd0 tx=0x7f6874009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8df51e1b7771c27 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:31.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.505+0000 7f68827fc700 1 -- 172.21.15.40:0/1505964945 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6874005e30 con 0x7f688409d920 2023-09-30T22:31:31.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.505+0000 7f68827fc700 1 -- 172.21.15.40:0/1505964945 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6874006030 con 0x7f688409d920 2023-09-30T22:31:31.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.505+0000 7f68827fc700 1 -- 172.21.15.40:0/1505964945 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68740063c0 con 0x7f688409d920 2023-09-30T22:31:31.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.506+0000 7f6889f1e700 1 -- 172.21.15.40:0/1505964945 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f688409d920 msgr2=0x7f688409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:31.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.506+0000 7f6889f1e700 1 --2- 172.21.15.40:0/1505964945 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f688409d920 0x7f688409dcf0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f6874006fd0 tx=0x7f6874009bd0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.506+0000 7f6889f1e700 1 -- 172.21.15.40:0/1505964945 shutdown_connections 2023-09-30T22:31:31.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.506+0000 7f6889f1e700 1 --2- 172.21.15.40:0/1505964945 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f688409d920 0x7f688409dcf0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.506+0000 7f6889f1e700 1 --2- 172.21.15.40:0/1505964945 >> v2:172.21.15.40:3300/0 conn(0x7f688409f0f0 0x7f688409e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.506+0000 7f6889f1e700 1 -- 172.21.15.40:0/1505964945 >> 172.21.15.40:0/1505964945 conn(0x7f688409fb20 msgr2=0x7f688409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:31.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.506+0000 7f6889f1e700 1 -- 172.21.15.40:0/1505964945 shutdown_connections 2023-09-30T22:31:31.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.506+0000 7f6889f1e700 1 -- 172.21.15.40:0/1505964945 wait complete. 2023-09-30T22:31:31.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.507+0000 7f6889f1e700 1 Processor -- start 2023-09-30T22:31:31.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.507+0000 7f6889f1e700 1 -- start start 2023-09-30T22:31:31.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.508+0000 7f6889f1e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f688409d920 0x7f688411e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:31.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.508+0000 7f6889f1e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6884133ca0 0x7f688411e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:31.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.508+0000 7f6889f1e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6884122480 0x7f688411eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:31.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.508+0000 7f6889f1e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688411f8f0 con 0x7f6884133ca0 2023-09-30T22:31:31.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.508+0000 7f6889f1e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6884120070 con 0x7f688409d920 2023-09-30T22:31:31.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.508+0000 7f6889f1e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6884120690 con 0x7f6884122480 2023-09-30T22:31:31.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.508+0000 7f68837fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f688409d920 0x7f688411e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:31.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.508+0000 7f6882ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6884133ca0 0x7f688411e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:31.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.508+0000 7f68837fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f688409d920 0x7f688411e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50882/0 (socket says 172.21.15.40:50882) 2023-09-30T22:31:31.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.508+0000 7f68837fe700 1 -- 172.21.15.40:0/2607763544 learned_addr learned my addr 172.21.15.40:0/2607763544 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:31.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.508+0000 7f6883fff700 1 --2- 172.21.15.40:0/2607763544 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6884122480 0x7f688411eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:31.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.508+0000 7f6882ffd700 1 -- 172.21.15.40:0/2607763544 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6884122480 msgr2=0x7f688411eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:31.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.508+0000 7f6882ffd700 1 --2- 172.21.15.40:0/2607763544 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6884122480 0x7f688411eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.508+0000 7f6882ffd700 1 -- 172.21.15.40:0/2607763544 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f688409d920 msgr2=0x7f688411e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:31.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.508+0000 7f6882ffd700 1 --2- 172.21.15.40:0/2607763544 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f688409d920 0x7f688411e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.508+0000 7f6882ffd700 1 -- 172.21.15.40:0/2607763544 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6874009500 con 0x7f6884133ca0 2023-09-30T22:31:31.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.508+0000 7f68837fe700 1 --2- 172.21.15.40:0/2607763544 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f688409d920 0x7f688411e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:31.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.509+0000 7f6882ffd700 1 --2- 172.21.15.40:0/2607763544 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6884133ca0 0x7f688411e9a0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f688406b7b0 tx=0x7f687800ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:31.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.509+0000 7f686bfff700 1 -- 172.21.15.40:0/2607763544 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6878004020 con 0x7f6884133ca0 2023-09-30T22:31:31.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.509+0000 7f686bfff700 1 -- 172.21.15.40:0/2607763544 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6878004180 con 0x7f6884133ca0 2023-09-30T22:31:31.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.509+0000 7f6889f1e700 1 -- 172.21.15.40:0/2607763544 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68841212c0 con 0x7f6884133ca0 2023-09-30T22:31:31.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.509+0000 7f6889f1e700 1 -- 172.21.15.40:0/2607763544 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68840a28a0 con 0x7f6884133ca0 2023-09-30T22:31:31.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.509+0000 7f686bfff700 1 -- 172.21.15.40:0/2607763544 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68780044f0 con 0x7f6884133ca0 2023-09-30T22:31:31.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.510+0000 7f686bfff700 1 -- 172.21.15.40:0/2607763544 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f68780036a0 con 0x7f6884133ca0 2023-09-30T22:31:31.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.510+0000 7f686bfff700 1 -- 172.21.15.40:0/2607763544 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6878040d80 con 0x7f6884133ca0 2023-09-30T22:31:31.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.510+0000 7f6889f1e700 1 -- 172.21.15.40:0/2607763544 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68640052e0 con 0x7f6884133ca0 2023-09-30T22:31:31.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.519+0000 7f686bfff700 1 -- 172.21.15.40:0/2607763544 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6878017080 con 0x7f6884133ca0 2023-09-30T22:31:31.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.648+0000 7f541bd1b700 1 -- 172.21.15.40:0/4246418713 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f541409c9e0 con 0x7f541409e230 2023-09-30T22:31:31.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.649+0000 7f540a7fc700 1 -- 172.21.15.40:0/4246418713 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f54040243e0 con 0x7f541409e230 2023-09-30T22:31:31.650 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:31.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.652+0000 7f541bd1b700 1 -- 172.21.15.40:0/4246418713 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f541409e230 msgr2=0x7f54141a67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:31.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.652+0000 7f541bd1b700 1 --2- 172.21.15.40:0/4246418713 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f541409e230 0x7f54141a67c0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f540400c520 tx=0x7f540400c830 comp rx=0 tx=0).stop 2023-09-30T22:31:31.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.652+0000 7f541bd1b700 1 -- 172.21.15.40:0/4246418713 shutdown_connections 2023-09-30T22:31:31.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.652+0000 7f541bd1b700 1 --2- 172.21.15.40:0/4246418713 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54141aa210 0x7f54141a6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.652+0000 7f541bd1b700 1 --2- 172.21.15.40:0/4246418713 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f541409d920 0x7f54141a6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.652+0000 7f541bd1b700 1 --2- 172.21.15.40:0/4246418713 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f541409e230 0x7f54141a67c0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.652+0000 7f541bd1b700 1 -- 172.21.15.40:0/4246418713 >> 172.21.15.40:0/4246418713 conn(0x7f541409fb20 msgr2=0x7f54140a26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:31.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.652+0000 7f541bd1b700 1 -- 172.21.15.40:0/4246418713 shutdown_connections 2023-09-30T22:31:31.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.652+0000 7f541bd1b700 1 -- 172.21.15.40:0/4246418713 wait complete. 2023-09-30T22:31:31.666 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:31.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.676+0000 7f272e7c1700 1 -- 172.21.15.40:0/2198012561 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2728062380 con 0x7f272809e400 2023-09-30T22:31:31.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.676+0000 7f2724ff9700 1 -- 172.21.15.40:0/2198012561 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f271c01ae80 con 0x7f272809e400 2023-09-30T22:31:31.677 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:31.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.678+0000 7f272e7c1700 1 -- 172.21.15.40:0/2198012561 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f272809e400 msgr2=0x7f272811ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:31.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.678+0000 7f272e7c1700 1 --2- 172.21.15.40:0/2198012561 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f272809e400 0x7f272811ecf0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f271c00e9b0 tx=0x7f271c00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.678+0000 7f272e7c1700 1 -- 172.21.15.40:0/2198012561 shutdown_connections 2023-09-30T22:31:31.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.678+0000 7f272e7c1700 1 --2- 172.21.15.40:0/2198012561 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f272811f230 0x7f27281ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.678+0000 7f272e7c1700 1 --2- 172.21.15.40:0/2198012561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f272809d920 0x7f272811e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.678+0000 7f272e7c1700 1 --2- 172.21.15.40:0/2198012561 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f272809e400 0x7f272811ecf0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.678+0000 7f272e7c1700 1 -- 172.21.15.40:0/2198012561 >> 172.21.15.40:0/2198012561 conn(0x7f272809fb20 msgr2=0x7f2728070860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:31.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.679+0000 7f272e7c1700 1 -- 172.21.15.40:0/2198012561 shutdown_connections 2023-09-30T22:31:31.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.679+0000 7f272e7c1700 1 -- 172.21.15.40:0/2198012561 wait complete. 2023-09-30T22:31:31.691 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:31.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.692+0000 7fa8db464700 1 -- 172.21.15.40:0/2044606549 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa8d4074330 con 0x7fa8d409dd60 2023-09-30T22:31:31.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.692+0000 7fa8c9ffb700 1 -- 172.21.15.40:0/2044606549 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa8c4044060 con 0x7fa8d409dd60 2023-09-30T22:31:31.693 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:31.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.696+0000 7fa8db464700 1 -- 172.21.15.40:0/2044606549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8d409dd60 msgr2=0x7fa8d411a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:31.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.696+0000 7fa8db464700 1 --2- 172.21.15.40:0/2044606549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8d409dd60 0x7fa8d411a0b0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400c500 tx=0x7fa8c400c810 comp rx=0 tx=0).stop 2023-09-30T22:31:31.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.696+0000 7fa8db464700 1 -- 172.21.15.40:0/2044606549 shutdown_connections 2023-09-30T22:31:31.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.696+0000 7fa8db464700 1 --2- 172.21.15.40:0/2044606549 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa8d409d450 0x7fa8d412ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.696+0000 7fa8db464700 1 --2- 172.21.15.40:0/2044606549 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8d41308d0 0x7fa8d411a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.696+0000 7fa8db464700 1 --2- 172.21.15.40:0/2044606549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8d409dd60 0x7fa8d411a0b0 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.696+0000 7fa8db464700 1 -- 172.21.15.40:0/2044606549 >> 172.21.15.40:0/2044606549 conn(0x7fa8d40a2a00 msgr2=0x7fa8d40a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:31.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.696+0000 7fa8db464700 1 -- 172.21.15.40:0/2044606549 shutdown_connections 2023-09-30T22:31:31.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.696+0000 7fa8db464700 1 -- 172.21.15.40:0/2044606549 wait complete. 2023-09-30T22:31:31.709 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:31.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.722+0000 7f6889f1e700 1 -- 172.21.15.40:0/2607763544 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6864005590 con 0x7f6884133ca0 2023-09-30T22:31:31.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.722+0000 7f686bfff700 1 -- 172.21.15.40:0/2607763544 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6878044060 con 0x7f6884133ca0 2023-09-30T22:31:31.722 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:31.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.723+0000 7f6889f1e700 1 -- 172.21.15.40:0/2607763544 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6884133ca0 msgr2=0x7f688411e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:31.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.723+0000 7f6889f1e700 1 --2- 172.21.15.40:0/2607763544 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6884133ca0 0x7f688411e9a0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f688406b7b0 tx=0x7f687800ebb0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.723+0000 7f6889f1e700 1 -- 172.21.15.40:0/2607763544 shutdown_connections 2023-09-30T22:31:31.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.723+0000 7f6889f1e700 1 --2- 172.21.15.40:0/2607763544 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6884122480 0x7f688411eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.723+0000 7f6889f1e700 1 --2- 172.21.15.40:0/2607763544 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f688409d920 0x7f688411e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.723+0000 7f6889f1e700 1 --2- 172.21.15.40:0/2607763544 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6884133ca0 0x7f688411e9a0 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:31.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.723+0000 7f6889f1e700 1 -- 172.21.15.40:0/2607763544 >> 172.21.15.40:0/2607763544 conn(0x7f688409fb20 msgr2=0x7f68841332f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:31.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.723+0000 7f6889f1e700 1 -- 172.21.15.40:0/2607763544 shutdown_connections 2023-09-30T22:31:31.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:31.723+0000 7f6889f1e700 1 -- 172.21.15.40:0/2607763544 wait complete. 2023-09-30T22:31:31.736 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:32.667 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:32.692 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:32.710 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:32.737 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:32.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.824+0000 7f23ecae7700 1 Processor -- start 2023-09-30T22:31:32.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.825+0000 7f23ecae7700 1 -- start start 2023-09-30T22:31:32.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.825+0000 7f23ecae7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23e806f070 0x7f23e806f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:32.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.825+0000 7f23ecae7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f23e806fdb0 0x7f23e80977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:32.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.825+0000 7f23ecae7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23e8070830 con 0x7f23e806f980 2023-09-30T22:31:32.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.826+0000 7f23ecae7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23e8071af0 con 0x7f23e806fdb0 2023-09-30T22:31:32.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.826+0000 7f23ecae7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e8070ad0 con 0x7f23e806f070 2023-09-30T22:31:32.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.826+0000 7f23e659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23e806f070 0x7f23e806f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:32.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.826+0000 7f23e659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23e806f070 0x7f23e806f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50896/0 (socket says 172.21.15.40:50896) 2023-09-30T22:31:32.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.826+0000 7f23e6d9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f23e806fdb0 0x7f23e80977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:32.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.826+0000 7f23e659c700 1 -- 172.21.15.40:0/825311944 learned_addr learned my addr 172.21.15.40:0/825311944 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:32.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.826+0000 7f23e659c700 1 -- 172.21.15.40:0/825311944 >> v2:172.21.15.40:3300/0 conn(0x7f23e806fdb0 msgr2=0x7f23e80977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:32.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.826+0000 7f23e659c700 1 --2- 172.21.15.40:0/825311944 >> v2:172.21.15.40:3300/0 conn(0x7f23e806fdb0 0x7f23e80977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.826+0000 7f23e659c700 1 -- 172.21.15.40:0/825311944 >> v1:172.21.15.40:6789/0 conn(0x7f23e806f980 legacy=0x7f23e8097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:32.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.826+0000 7f23e659c700 1 -- 172.21.15.40:0/825311944 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e8070de0 con 0x7f23e806f070 2023-09-30T22:31:32.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.826+0000 7f23e6d9d700 1 --2- 172.21.15.40:0/825311944 >> v2:172.21.15.40:3300/0 conn(0x7f23e806fdb0 0x7f23e80977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:32.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.826+0000 7f23e659c700 1 --2- 172.21.15.40:0/825311944 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23e806f070 0x7f23e806f440 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f23d8009950 tx=0x7f23d8009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c1580b23f12f9f8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:32.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.826+0000 7f23e559a700 1 -- 172.21.15.40:0/825311944 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d8011830 con 0x7f23e806f070 2023-09-30T22:31:32.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.827+0000 7f23e559a700 1 -- 172.21.15.40:0/825311944 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d8011990 con 0x7f23e806f070 2023-09-30T22:31:32.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.827+0000 7f23e559a700 1 -- 172.21.15.40:0/825311944 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d8011d40 con 0x7f23e806f070 2023-09-30T22:31:32.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.827+0000 7f23ecae7700 1 -- 172.21.15.40:0/825311944 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23e806f070 msgr2=0x7f23e806f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:32.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.827+0000 7f23ecae7700 1 --2- 172.21.15.40:0/825311944 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23e806f070 0x7f23e806f440 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f23d8009950 tx=0x7f23d8009c60 comp rx=0 tx=0).stop 2023-09-30T22:31:32.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.827+0000 7f23ecae7700 1 -- 172.21.15.40:0/825311944 shutdown_connections 2023-09-30T22:31:32.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.827+0000 7f23ecae7700 1 --2- 172.21.15.40:0/825311944 >> v2:172.21.15.40:3300/0 conn(0x7f23e806fdb0 0x7f23e80977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.827+0000 7f23ecae7700 1 --2- 172.21.15.40:0/825311944 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23e806f070 0x7f23e806f440 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.827+0000 7f23ecae7700 1 -- 172.21.15.40:0/825311944 >> 172.21.15.40:0/825311944 conn(0x7f23e80a41a0 msgr2=0x7f23e80a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:32.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.827+0000 7f23ecae7700 1 -- 172.21.15.40:0/825311944 shutdown_connections 2023-09-30T22:31:32.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.827+0000 7f23ecae7700 1 -- 172.21.15.40:0/825311944 wait complete. 2023-09-30T22:31:32.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.829+0000 7f23ecae7700 1 Processor -- start 2023-09-30T22:31:32.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.829+0000 7f23ecae7700 1 -- start start 2023-09-30T22:31:32.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.830+0000 7f23ecae7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f23e806f070 0x7f23e812d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:32.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.830+0000 7f23ecae7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23e806f980 0x7f23e812da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:32.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.830+0000 7f23ecae7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23e806fdb0 0x7f23e812dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:32.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.830+0000 7f23ecae7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e8131670 con 0x7f23e806f980 2023-09-30T22:31:32.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.830+0000 7f23ecae7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e81302c0 con 0x7f23e806fdb0 2023-09-30T22:31:32.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.830+0000 7f23ecae7700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23e8130a90 con 0x7f23e806f070 2023-09-30T22:31:32.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.830+0000 7f23e5d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23e806f980 0x7f23e812da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:32.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.830+0000 7f23e5d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23e806f980 0x7f23e812da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43180/0 (socket says 172.21.15.40:43180) 2023-09-30T22:31:32.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.830+0000 7f23e5d9b700 1 -- 172.21.15.40:0/3295657328 learned_addr learned my addr 172.21.15.40:0/3295657328 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:32.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.830+0000 7f23e659c700 1 --2- 172.21.15.40:0/3295657328 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f23e806f070 0x7f23e812d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:32.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.830+0000 7f23e6d9d700 1 --2- 172.21.15.40:0/3295657328 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23e806fdb0 0x7f23e812dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:32.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.830+0000 7f23e5d9b700 1 -- 172.21.15.40:0/3295657328 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f23e806f070 msgr2=0x7f23e812d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:32.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.830+0000 7f23e5d9b700 1 --2- 172.21.15.40:0/3295657328 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f23e806f070 0x7f23e812d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.830+0000 7f23e5d9b700 1 -- 172.21.15.40:0/3295657328 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23e806fdb0 msgr2=0x7f23e812dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:32.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.830+0000 7f23e5d9b700 1 --2- 172.21.15.40:0/3295657328 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23e806fdb0 0x7f23e812dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.830+0000 7f23e5d9b700 1 -- 172.21.15.40:0/3295657328 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e0009a70 con 0x7f23e806f980 2023-09-30T22:31:32.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.830+0000 7f23e6d9d700 1 --2- 172.21.15.40:0/3295657328 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23e806fdb0 0x7f23e812dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:32.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.831+0000 7f23e5d9b700 1 --2- 172.21.15.40:0/3295657328 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23e806f980 0x7f23e812da70 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f23dc00c4b0 tx=0x7f23dc00c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:32.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.831+0000 7f23d6ffd700 1 -- 172.21.15.40:0/3295657328 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc0052d0 con 0x7f23e806f980 2023-09-30T22:31:32.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.831+0000 7f23ecae7700 1 -- 172.21.15.40:0/3295657328 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d8009550 con 0x7f23e806f980 2023-09-30T22:31:32.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.831+0000 7f23d6ffd700 1 -- 172.21.15.40:0/3295657328 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23dc005430 con 0x7f23e806f980 2023-09-30T22:31:32.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.831+0000 7f23ecae7700 1 -- 172.21.15.40:0/3295657328 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e8131170 con 0x7f23e806f980 2023-09-30T22:31:32.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.831+0000 7f23d6ffd700 1 -- 172.21.15.40:0/3295657328 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc003880 con 0x7f23e806f980 2023-09-30T22:31:32.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.833+0000 7f23ecae7700 1 -- 172.21.15.40:0/3295657328 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23cc0052e0 con 0x7f23e806f980 2023-09-30T22:31:32.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.834+0000 7f23d6ffd700 1 -- 172.21.15.40:0/3295657328 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f23dc0039e0 con 0x7f23e806f980 2023-09-30T22:31:32.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.834+0000 7f23d6ffd700 1 -- 172.21.15.40:0/3295657328 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f23dc03efa0 con 0x7f23e806f980 2023-09-30T22:31:32.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.838+0000 7f23d6ffd700 1 -- 172.21.15.40:0/3295657328 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f23dc018650 con 0x7f23e806f980 2023-09-30T22:31:32.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.854+0000 7f7f9b03d700 1 Processor -- start 2023-09-30T22:31:32.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.854+0000 7f7f9b03d700 1 -- start start 2023-09-30T22:31:32.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.854+0000 7f7f9b03d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f9409df30 0x7f7f94135400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:32.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.854+0000 7f7f9b03d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7f94135940 0x7f7f94137d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:32.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.854+0000 7f7f9b03d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f9409e8b0 con 0x7f7f9409d450 2023-09-30T22:31:32.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.854+0000 7f7f9b03d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f9409c3b0 con 0x7f7f94135940 2023-09-30T22:31:32.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.854+0000 7f7f9b03d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9409a6b0 con 0x7f7f9409df30 2023-09-30T22:31:32.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.854+0000 7f7f995da700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7f94135940 0x7f7f94137d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:32.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.854+0000 7f7f93fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f9409df30 0x7f7f94135400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:32.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.854+0000 7f7f995da700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7f94135940 0x7f7f94137d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43194/0 (socket says 172.21.15.40:43194) 2023-09-30T22:31:32.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.854+0000 7f7f995da700 1 -- 172.21.15.40:0/1285010949 learned_addr learned my addr 172.21.15.40:0/1285010949 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:32.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.855+0000 7f7f93fff700 1 -- 172.21.15.40:0/1285010949 >> v2:172.21.15.40:3300/0 conn(0x7f7f94135940 msgr2=0x7f7f94137d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:32.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.855+0000 7f7f93fff700 1 --2- 172.21.15.40:0/1285010949 >> v2:172.21.15.40:3300/0 conn(0x7f7f94135940 0x7f7f94137d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.855+0000 7f7f93fff700 1 -- 172.21.15.40:0/1285010949 >> v1:172.21.15.40:6789/0 conn(0x7f7f9409d450 legacy=0x7f7f9409d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:32.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.855+0000 7f7f93fff700 1 -- 172.21.15.40:0/1285010949 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f9409b4f0 con 0x7f7f9409df30 2023-09-30T22:31:32.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.855+0000 7f7f93fff700 1 --2- 172.21.15.40:0/1285010949 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f9409df30 0x7f7f94135400 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f7f80009840 tx=0x7f7f80009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54bcc555978d28bb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:32.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.855+0000 7f7f937fe700 1 -- 172.21.15.40:0/1285010949 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f80011830 con 0x7f7f9409df30 2023-09-30T22:31:32.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.855+0000 7f7f937fe700 1 -- 172.21.15.40:0/1285010949 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f80011990 con 0x7f7f9409df30 2023-09-30T22:31:32.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.855+0000 7f7f937fe700 1 -- 172.21.15.40:0/1285010949 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f80011d20 con 0x7f7f9409df30 2023-09-30T22:31:32.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.856+0000 7f7f9b03d700 1 -- 172.21.15.40:0/1285010949 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f9409df30 msgr2=0x7f7f94135400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:32.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.856+0000 7f7f9b03d700 1 --2- 172.21.15.40:0/1285010949 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f9409df30 0x7f7f94135400 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f7f80009840 tx=0x7f7f80009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:32.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.856+0000 7f7f9b03d700 1 -- 172.21.15.40:0/1285010949 shutdown_connections 2023-09-30T22:31:32.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.856+0000 7f7f9b03d700 1 --2- 172.21.15.40:0/1285010949 >> v2:172.21.15.40:3300/0 conn(0x7f7f94135940 0x7f7f94137d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.856+0000 7f7f9b03d700 1 --2- 172.21.15.40:0/1285010949 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f9409df30 0x7f7f94135400 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.856+0000 7f7f9b03d700 1 -- 172.21.15.40:0/1285010949 >> 172.21.15.40:0/1285010949 conn(0x7f7f940a2a00 msgr2=0x7f7f940a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:32.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.856+0000 7f7f9b03d700 1 -- 172.21.15.40:0/1285010949 shutdown_connections 2023-09-30T22:31:32.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.856+0000 7f7f9b03d700 1 -- 172.21.15.40:0/1285010949 wait complete. 2023-09-30T22:31:32.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.858+0000 7f7f9b03d700 1 Processor -- start 2023-09-30T22:31:32.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.858+0000 7f7f9b03d700 1 -- start start 2023-09-30T22:31:32.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.859+0000 7f7f9b03d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f9409d450 0x7f7f941c0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:32.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.859+0000 7f7f9b03d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f9409df30 0x7f7f941c1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:32.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.859+0000 7f7f9b03d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f94135940 0x7f7f94119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:32.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.859+0000 7f7f9b03d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f941c1a50 con 0x7f7f94135940 2023-09-30T22:31:32.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.859+0000 7f7f9b03d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9409c640 con 0x7f7f9409df30 2023-09-30T22:31:32.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.859+0000 7f7f9b03d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f940a2470 con 0x7f7f9409d450 2023-09-30T22:31:32.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.859+0000 7f7f93fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f9409df30 0x7f7f941c1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:32.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.859+0000 7f7f93fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f9409df30 0x7f7f941c1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50926/0 (socket says 172.21.15.40:50926) 2023-09-30T22:31:32.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.859+0000 7f7f93fff700 1 -- 172.21.15.40:0/1212932922 learned_addr learned my addr 172.21.15.40:0/1212932922 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:32.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.859+0000 7f7f98dd9700 1 --2- 172.21.15.40:0/1212932922 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f9409d450 0x7f7f941c0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:32.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.859+0000 7f7f995da700 1 --2- 172.21.15.40:0/1212932922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f94135940 0x7f7f94119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:32.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.859+0000 7f7f995da700 1 -- 172.21.15.40:0/1212932922 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f9409d450 msgr2=0x7f7f941c0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:32.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.859+0000 7f7f995da700 1 --2- 172.21.15.40:0/1212932922 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f9409d450 0x7f7f941c0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.859+0000 7f7f995da700 1 -- 172.21.15.40:0/1212932922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f9409df30 msgr2=0x7f7f941c1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:32.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.859+0000 7f7f995da700 1 --2- 172.21.15.40:0/1212932922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f9409df30 0x7f7f941c1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.859+0000 7f7f995da700 1 -- 172.21.15.40:0/1212932922 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f800094a0 con 0x7f7f94135940 2023-09-30T22:31:32.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.859+0000 7f7f93fff700 1 --2- 172.21.15.40:0/1212932922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f9409df30 0x7f7f941c1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:32.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.859+0000 7f7f98dd9700 1 --2- 172.21.15.40:0/1212932922 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f9409d450 0x7f7f941c0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:32.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.860+0000 7f7f995da700 1 --2- 172.21.15.40:0/1212932922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f94135940 0x7f7f94119050 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c00aed0 tx=0x7f7f8c0074d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:32.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.860+0000 7f7f917fa700 1 -- 172.21.15.40:0/1212932922 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c00ad00 con 0x7f7f94135940 2023-09-30T22:31:32.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.860+0000 7f7f917fa700 1 -- 172.21.15.40:0/1212932922 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8c003e30 con 0x7f7f94135940 2023-09-30T22:31:32.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.860+0000 7f7f9b03d700 1 -- 172.21.15.40:0/1212932922 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f9411a350 con 0x7f7f94135940 2023-09-30T22:31:32.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.860+0000 7f7f917fa700 1 -- 172.21.15.40:0/1212932922 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c007b90 con 0x7f7f94135940 2023-09-30T22:31:32.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.860+0000 7f7f9b03d700 1 -- 172.21.15.40:0/1212932922 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f9411aa80 con 0x7f7f94135940 2023-09-30T22:31:32.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.861+0000 7f7f917fa700 1 -- 172.21.15.40:0/1212932922 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7f8c019070 con 0x7f7f94135940 2023-09-30T22:31:32.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.861+0000 7f7f917fa700 1 -- 172.21.15.40:0/1212932922 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f7f8c043840 con 0x7f7f94135940 2023-09-30T22:31:32.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.861+0000 7f7f9b03d700 1 -- 172.21.15.40:0/1212932922 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f94062380 con 0x7f7f94135940 2023-09-30T22:31:32.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.870+0000 7f7f917fa700 1 -- 172.21.15.40:0/1212932922 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7f8c013550 con 0x7f7f94135940 2023-09-30T22:31:32.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.873+0000 7fc0ccbd3700 1 Processor -- start 2023-09-30T22:31:32.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.873+0000 7fc0ccbd3700 1 -- start start 2023-09-30T22:31:32.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.874+0000 7fc0ccbd3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc0c809d920 0x7fc0c809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:32.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.874+0000 7fc0ccbd3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc0c809e230 0x7fc0c81343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:32.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.874+0000 7fc0ccbd3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0c809f940 con 0x7fc0c809f0f0 2023-09-30T22:31:32.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.874+0000 7fc0ccbd3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0c806b4c0 con 0x7fc0c809e230 2023-09-30T22:31:32.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.874+0000 7fc0ccbd3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c809a8f0 con 0x7fc0c809d920 2023-09-30T22:31:32.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.874+0000 7fc0c5d9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc0c809f0f0 0x7fc0c8133ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50810/0 (socket says 172.21.15.40:50810) 2023-09-30T22:31:32.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.874+0000 7fc0c5d9b700 1 -- 172.21.15.40:0/2413497669 learned_addr learned my addr 172.21.15.40:0/2413497669 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:32.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.874+0000 7fc0c659c700 1 --2- 172.21.15.40:0/2413497669 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc0c809d920 0x7fc0c809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:32.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.874+0000 7fc0c6d9d700 1 --2- 172.21.15.40:0/2413497669 >> v2:172.21.15.40:3300/0 conn(0x7fc0c809e230 0x7fc0c81343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:32.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.874+0000 7fc0c559a700 1 -- 172.21.15.40:0/2413497669 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3678761597 0 0) 0x7fc0c809f940 con 0x7fc0c809f0f0 2023-09-30T22:31:32.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.874+0000 7fc0c559a700 1 -- 172.21.15.40:0/2413497669 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0b00035b0 con 0x7fc0c809f0f0 2023-09-30T22:31:32.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.875+0000 7fc0c659c700 1 -- 172.21.15.40:0/2413497669 >> v2:172.21.15.40:3300/0 conn(0x7fc0c809e230 msgr2=0x7fc0c81343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:32.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.875+0000 7fc0c659c700 1 --2- 172.21.15.40:0/2413497669 >> v2:172.21.15.40:3300/0 conn(0x7fc0c809e230 0x7fc0c81343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.875+0000 7fc0c659c700 1 -- 172.21.15.40:0/2413497669 >> v1:172.21.15.40:6789/0 conn(0x7fc0c809f0f0 legacy=0x7fc0c8133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:32.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.875+0000 7fc0c659c700 1 -- 172.21.15.40:0/2413497669 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c809f6e0 con 0x7fc0c809d920 2023-09-30T22:31:32.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.875+0000 7fc0c659c700 1 --2- 172.21.15.40:0/2413497669 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc0c809d920 0x7fc0c809dcf0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8009820 tx=0x7fc0b8009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb95a03e4a4421c4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:32.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.875+0000 7fc0c559a700 1 -- 172.21.15.40:0/2413497669 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8005e30 con 0x7fc0c809d920 2023-09-30T22:31:32.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.875+0000 7fc0c559a700 1 -- 172.21.15.40:0/2413497669 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b8006030 con 0x7fc0c809d920 2023-09-30T22:31:32.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.875+0000 7fc0c559a700 1 -- 172.21.15.40:0/2413497669 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b80063c0 con 0x7fc0c809d920 2023-09-30T22:31:32.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.876+0000 7fc0ccbd3700 1 -- 172.21.15.40:0/2413497669 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc0c809d920 msgr2=0x7fc0c809dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:32.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.876+0000 7fc0ccbd3700 1 --2- 172.21.15.40:0/2413497669 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc0c809d920 0x7fc0c809dcf0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8009820 tx=0x7fc0b8009b30 comp rx=0 tx=0).stop 2023-09-30T22:31:32.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.876+0000 7fc0ccbd3700 1 -- 172.21.15.40:0/2413497669 shutdown_connections 2023-09-30T22:31:32.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.876+0000 7fc0ccbd3700 1 --2- 172.21.15.40:0/2413497669 >> v2:172.21.15.40:3300/0 conn(0x7fc0c809e230 0x7fc0c81343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.876+0000 7fc0ccbd3700 1 --2- 172.21.15.40:0/2413497669 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc0c809d920 0x7fc0c809dcf0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.876+0000 7fc0ccbd3700 1 -- 172.21.15.40:0/2413497669 >> 172.21.15.40:0/2413497669 conn(0x7fc0c809fb20 msgr2=0x7fc0c809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:32.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.876+0000 7fc0ccbd3700 1 -- 172.21.15.40:0/2413497669 shutdown_connections 2023-09-30T22:31:32.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.876+0000 7fc0ccbd3700 1 -- 172.21.15.40:0/2413497669 wait complete. 2023-09-30T22:31:32.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.878+0000 7fc0ccbd3700 1 Processor -- start 2023-09-30T22:31:32.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.878+0000 7fc0ccbd3700 1 -- start start 2023-09-30T22:31:32.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.878+0000 7fc0ccbd3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0c809d920 0x7fc0c81c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:32.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.878+0000 7fc0ccbd3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc0c809e230 0x7fc0c81c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:32.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.879+0000 7fc0ccbd3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc0c81a9f80 0x7fc0c81c4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:32.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.879+0000 7fc0ccbd3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c81a8920 con 0x7fc0c809d920 2023-09-30T22:31:32.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.879+0000 7fc0ccbd3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c81a9a80 con 0x7fc0c81a9f80 2023-09-30T22:31:32.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.879+0000 7fc0ccbd3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c81c9150 con 0x7fc0c809e230 2023-09-30T22:31:32.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.879+0000 7fc0c659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0c809d920 0x7fc0c81c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:32.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.879+0000 7fc0c659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0c809d920 0x7fc0c81c86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43208/0 (socket says 172.21.15.40:43208) 2023-09-30T22:31:32.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.879+0000 7fc0c659c700 1 -- 172.21.15.40:0/623835450 learned_addr learned my addr 172.21.15.40:0/623835450 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:32.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.879+0000 7fc0c6d9d700 1 --2- 172.21.15.40:0/623835450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc0c81a9f80 0x7fc0c81c4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:32.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.879+0000 7fc0c659c700 1 -- 172.21.15.40:0/623835450 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc0c809e230 msgr2=0x7fc0c81c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:32.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.879+0000 7fc0c659c700 1 --2- 172.21.15.40:0/623835450 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc0c809e230 0x7fc0c81c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.879+0000 7fc0c659c700 1 -- 172.21.15.40:0/623835450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc0c81a9f80 msgr2=0x7fc0c81c4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:32.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.879+0000 7fc0c659c700 1 --2- 172.21.15.40:0/623835450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc0c81a9f80 0x7fc0c81c4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.879+0000 7fc0c659c700 1 -- 172.21.15.40:0/623835450 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b8009430 con 0x7fc0c809d920 2023-09-30T22:31:32.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.879+0000 7fc0c6d9d700 1 --2- 172.21.15.40:0/623835450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc0c81a9f80 0x7fc0c81c4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:32.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.879+0000 7fc0c659c700 1 --2- 172.21.15.40:0/623835450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0c809d920 0x7fc0c81c86d0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8009e80 tx=0x7fc0b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:32.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.879+0000 7fc0b6ffd700 1 -- 172.21.15.40:0/623835450 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b80061a0 con 0x7fc0c809d920 2023-09-30T22:31:32.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.879+0000 7fc0b6ffd700 1 -- 172.21.15.40:0/623835450 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b8020070 con 0x7fc0c809d920 2023-09-30T22:31:32.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.880+0000 7fc0ccbd3700 1 -- 172.21.15.40:0/623835450 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0c80a31f0 con 0x7fc0c809d920 2023-09-30T22:31:32.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.880+0000 7fc0b6ffd700 1 -- 172.21.15.40:0/623835450 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8006560 con 0x7fc0c809d920 2023-09-30T22:31:32.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.880+0000 7fc0ccbd3700 1 -- 172.21.15.40:0/623835450 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0c809c9e0 con 0x7fc0c809d920 2023-09-30T22:31:32.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.881+0000 7fc0ccbd3700 1 -- 172.21.15.40:0/623835450 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0c81a9700 con 0x7fc0c809d920 2023-09-30T22:31:32.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.881+0000 7fc0b6ffd700 1 -- 172.21.15.40:0/623835450 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc0b8022030 con 0x7fc0c809d920 2023-09-30T22:31:32.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.882+0000 7fc0b6ffd700 1 -- 172.21.15.40:0/623835450 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc0b8040ed0 con 0x7fc0c809d920 2023-09-30T22:31:32.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.886+0000 7fc0b6ffd700 1 -- 172.21.15.40:0/623835450 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc0b8006900 con 0x7fc0c809d920 2023-09-30T22:31:32.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.910+0000 7f5b49ec0700 1 Processor -- start 2023-09-30T22:31:32.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.911+0000 7f5b49ec0700 1 -- start start 2023-09-30T22:31:32.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.911+0000 7f5b49ec0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5b4409c890 0x7f5b4409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:32.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.911+0000 7f5b49ec0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b4409d920 0x7f5b4409dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:32.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.911+0000 7f5b49ec0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b440a2600 con 0x7f5b4409e2b0 2023-09-30T22:31:32.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.911+0000 7f5b49ec0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b440a29d0 con 0x7f5b4409d920 2023-09-30T22:31:32.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.911+0000 7f5b49ec0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4409fb40 con 0x7f5b4409c890 2023-09-30T22:31:32.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.912+0000 7f5b43fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5b4409e2b0 0x7f5b4413ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50816/0 (socket says 172.21.15.40:50816) 2023-09-30T22:31:32.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.912+0000 7f5b43fff700 1 -- 172.21.15.40:0/2162428787 learned_addr learned my addr 172.21.15.40:0/2162428787 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:32.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.912+0000 7f5b437fe700 1 --2- 172.21.15.40:0/2162428787 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5b4409c890 0x7f5b4409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:32.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.912+0000 7f5b42ffd700 1 --2- 172.21.15.40:0/2162428787 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b4409d920 0x7f5b4409dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:32.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.912+0000 7f5b437fe700 1 -- 172.21.15.40:0/2162428787 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b4409d920 msgr2=0x7f5b4409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:32.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.912+0000 7f5b437fe700 1 --2- 172.21.15.40:0/2162428787 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b4409d920 0x7f5b4409dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.912+0000 7f5b437fe700 1 -- 172.21.15.40:0/2162428787 >> v1:172.21.15.40:6789/0 conn(0x7f5b4409e2b0 legacy=0x7f5b4413ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:32.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.912+0000 7f5b437fe700 1 -- 172.21.15.40:0/2162428787 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b4409e720 con 0x7f5b4409c890 2023-09-30T22:31:32.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.912+0000 7f5b42ffd700 1 --2- 172.21.15.40:0/2162428787 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b4409d920 0x7f5b4409dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:32.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.912+0000 7f5b437fe700 1 --2- 172.21.15.40:0/2162428787 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5b4409c890 0x7f5b4409cc60 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009850 tx=0x7f5b34009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c9bcc1bfe7cb9af server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:32.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.912+0000 7f5b427fc700 1 -- 172.21.15.40:0/2162428787 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b34005e30 con 0x7f5b4409c890 2023-09-30T22:31:32.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.913+0000 7f5b427fc700 1 -- 172.21.15.40:0/2162428787 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b34006030 con 0x7f5b4409c890 2023-09-30T22:31:32.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.913+0000 7f5b427fc700 1 -- 172.21.15.40:0/2162428787 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b340063c0 con 0x7f5b4409c890 2023-09-30T22:31:32.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.913+0000 7f5b49ec0700 1 -- 172.21.15.40:0/2162428787 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5b4409c890 msgr2=0x7f5b4409cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:32.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.913+0000 7f5b49ec0700 1 --2- 172.21.15.40:0/2162428787 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5b4409c890 0x7f5b4409cc60 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009850 tx=0x7f5b34009b60 comp rx=0 tx=0).stop 2023-09-30T22:31:32.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.914+0000 7f5b49ec0700 1 -- 172.21.15.40:0/2162428787 shutdown_connections 2023-09-30T22:31:32.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.914+0000 7f5b49ec0700 1 --2- 172.21.15.40:0/2162428787 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5b4409c890 0x7f5b4409cc60 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.914+0000 7f5b49ec0700 1 --2- 172.21.15.40:0/2162428787 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b4409d920 0x7f5b4409dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.914+0000 7f5b49ec0700 1 -- 172.21.15.40:0/2162428787 >> 172.21.15.40:0/2162428787 conn(0x7f5b440a7080 msgr2=0x7f5b440a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:32.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.914+0000 7f5b49ec0700 1 -- 172.21.15.40:0/2162428787 shutdown_connections 2023-09-30T22:31:32.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.914+0000 7f5b49ec0700 1 -- 172.21.15.40:0/2162428787 wait complete. 2023-09-30T22:31:32.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.915+0000 7f5b49ec0700 1 Processor -- start 2023-09-30T22:31:32.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.915+0000 7f5b49ec0700 1 -- start start 2023-09-30T22:31:32.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.916+0000 7f5b49ec0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b4409c890 0x7f5b4412d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:32.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.916+0000 7f5b49ec0700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5b4409d920 0x7f5b4412daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:32.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.916+0000 7f5b49ec0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b4409e2b0 0x7f5b4412e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:32.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.916+0000 7f5b49ec0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b440a5ce0 con 0x7f5b4409c890 2023-09-30T22:31:32.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.916+0000 7f5b49ec0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b441300c0 con 0x7f5b4409e2b0 2023-09-30T22:31:32.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.916+0000 7f5b49ec0700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4412fc90 con 0x7f5b4409d920 2023-09-30T22:31:32.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.916+0000 7f5b43fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b4409e2b0 0x7f5b4412e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:32.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.916+0000 7f5b43fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b4409e2b0 0x7f5b4412e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50954/0 (socket says 172.21.15.40:50954) 2023-09-30T22:31:32.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.916+0000 7f5b43fff700 1 -- 172.21.15.40:0/3846826007 learned_addr learned my addr 172.21.15.40:0/3846826007 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:32.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.916+0000 7f5b437fe700 1 --2- 172.21.15.40:0/3846826007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b4409c890 0x7f5b4412d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:32.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.916+0000 7f5b42ffd700 1 --2- 172.21.15.40:0/3846826007 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5b4409d920 0x7f5b4412daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:32.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.917+0000 7f5b43fff700 1 -- 172.21.15.40:0/3846826007 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5b4409d920 msgr2=0x7f5b4412daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:32.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.917+0000 7f5b43fff700 1 --2- 172.21.15.40:0/3846826007 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5b4409d920 0x7f5b4412daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.917+0000 7f5b43fff700 1 -- 172.21.15.40:0/3846826007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b4409c890 msgr2=0x7f5b4412d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:32.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.917+0000 7f5b43fff700 1 --2- 172.21.15.40:0/3846826007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b4409c890 0x7f5b4412d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:32.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.917+0000 7f5b43fff700 1 -- 172.21.15.40:0/3846826007 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b34009430 con 0x7f5b4409e2b0 2023-09-30T22:31:32.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.917+0000 7f5b42ffd700 1 --2- 172.21.15.40:0/3846826007 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5b4409d920 0x7f5b4412daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:32.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.917+0000 7f5b437fe700 1 --2- 172.21.15.40:0/3846826007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b4409c890 0x7f5b4412d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:32.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.917+0000 7f5b43fff700 1 --2- 172.21.15.40:0/3846826007 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b4409e2b0 0x7f5b4412e030 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c00cbc0 tx=0x7f5b3c00cf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:32.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.917+0000 7f5b2bfff700 1 -- 172.21.15.40:0/3846826007 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c00ab50 con 0x7f5b4409e2b0 2023-09-30T22:31:32.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.917+0000 7f5b2bfff700 1 -- 172.21.15.40:0/3846826007 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3c00acb0 con 0x7f5b4409e2b0 2023-09-30T22:31:32.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.917+0000 7f5b49ec0700 1 -- 172.21.15.40:0/3846826007 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b44130510 con 0x7f5b4409e2b0 2023-09-30T22:31:32.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.917+0000 7f5b2bfff700 1 -- 172.21.15.40:0/3846826007 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c012600 con 0x7f5b4409e2b0 2023-09-30T22:31:32.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.917+0000 7f5b49ec0700 1 -- 172.21.15.40:0/3846826007 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b4412e570 con 0x7f5b4409e2b0 2023-09-30T22:31:32.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.918+0000 7f5b2bfff700 1 -- 172.21.15.40:0/3846826007 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5b3c01b3b0 con 0x7f5b4409e2b0 2023-09-30T22:31:32.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.918+0000 7f5b49ec0700 1 -- 172.21.15.40:0/3846826007 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b441308e0 con 0x7f5b4409e2b0 2023-09-30T22:31:32.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.919+0000 7f5b2bfff700 1 -- 172.21.15.40:0/3846826007 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5b3c03f570 con 0x7f5b4409e2b0 2023-09-30T22:31:32.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:32.928+0000 7f5b2bfff700 1 -- 172.21.15.40:0/3846826007 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5b3c017080 con 0x7f5b4409e2b0 2023-09-30T22:31:33.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.053+0000 7f23ecae7700 1 -- 172.21.15.40:0/3295657328 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f23cc005860 con 0x7f23e806f980 2023-09-30T22:31:33.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.054+0000 7f23d6ffd700 1 -- 172.21.15.40:0/3295657328 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f23dc017020 con 0x7f23e806f980 2023-09-30T22:31:33.055 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:33.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.056+0000 7f23ecae7700 1 -- 172.21.15.40:0/3295657328 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23e806f980 msgr2=0x7f23e812da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:33.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.056+0000 7f23ecae7700 1 --2- 172.21.15.40:0/3295657328 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23e806f980 0x7f23e812da70 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f23dc00c4b0 tx=0x7f23dc00c7c0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.057+0000 7f23ecae7700 1 -- 172.21.15.40:0/3295657328 shutdown_connections 2023-09-30T22:31:33.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.057+0000 7f23ecae7700 1 --2- 172.21.15.40:0/3295657328 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f23e806f070 0x7f23e812d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.057+0000 7f23ecae7700 1 --2- 172.21.15.40:0/3295657328 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f23e806fdb0 0x7f23e812dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.057+0000 7f23ecae7700 1 --2- 172.21.15.40:0/3295657328 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23e806f980 0x7f23e812da70 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.057+0000 7f23ecae7700 1 -- 172.21.15.40:0/3295657328 >> 172.21.15.40:0/3295657328 conn(0x7f23e80a41a0 msgr2=0x7f23e80a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:33.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.057+0000 7f23ecae7700 1 -- 172.21.15.40:0/3295657328 shutdown_connections 2023-09-30T22:31:33.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.057+0000 7f23ecae7700 1 -- 172.21.15.40:0/3295657328 wait complete. 2023-09-30T22:31:33.070 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:33.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.091+0000 7fc0ccbd3700 1 -- 172.21.15.40:0/623835450 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc0c81a9700 con 0x7fc0c809d920 2023-09-30T22:31:33.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.091+0000 7fc0b6ffd700 1 -- 172.21.15.40:0/623835450 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc0c81a9700 con 0x7fc0c809d920 2023-09-30T22:31:33.092 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:33.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.093+0000 7fc0ccbd3700 1 -- 172.21.15.40:0/623835450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0c809d920 msgr2=0x7fc0c81c86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:33.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.093+0000 7fc0ccbd3700 1 --2- 172.21.15.40:0/623835450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0c809d920 0x7fc0c81c86d0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8009e80 tx=0x7fc0b8004750 comp rx=0 tx=0).stop 2023-09-30T22:31:33.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.093+0000 7fc0ccbd3700 1 -- 172.21.15.40:0/623835450 shutdown_connections 2023-09-30T22:31:33.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.093+0000 7fc0ccbd3700 1 --2- 172.21.15.40:0/623835450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc0c81a9f80 0x7fc0c81c4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.093+0000 7fc0ccbd3700 1 --2- 172.21.15.40:0/623835450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0c809d920 0x7fc0c81c86d0 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.093+0000 7fc0ccbd3700 1 --2- 172.21.15.40:0/623835450 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc0c809e230 0x7fc0c81c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.093+0000 7fc0ccbd3700 1 -- 172.21.15.40:0/623835450 >> 172.21.15.40:0/623835450 conn(0x7fc0c809fb20 msgr2=0x7fc0c81bb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:33.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.093+0000 7fc0ccbd3700 1 -- 172.21.15.40:0/623835450 shutdown_connections 2023-09-30T22:31:33.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.093+0000 7fc0ccbd3700 1 -- 172.21.15.40:0/623835450 wait complete. 2023-09-30T22:31:33.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.104+0000 7f7f9b03d700 1 -- 172.21.15.40:0/1212932922 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7f940008d0 con 0x7f7f94135940 2023-09-30T22:31:33.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.104+0000 7f7f917fa700 1 -- 172.21.15.40:0/1212932922 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7f8c01b3d0 con 0x7f7f94135940 2023-09-30T22:31:33.105 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:33.107 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:33.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.107+0000 7f7f9b03d700 1 -- 172.21.15.40:0/1212932922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f94135940 msgr2=0x7f7f94119050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:33.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.107+0000 7f7f9b03d700 1 --2- 172.21.15.40:0/1212932922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f94135940 0x7f7f94119050 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c00aed0 tx=0x7f7f8c0074d0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.107+0000 7f7f9b03d700 1 -- 172.21.15.40:0/1212932922 shutdown_connections 2023-09-30T22:31:33.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.107+0000 7f7f9b03d700 1 --2- 172.21.15.40:0/1212932922 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f9409d450 0x7f7f941c0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.107+0000 7f7f9b03d700 1 --2- 172.21.15.40:0/1212932922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f94135940 0x7f7f94119050 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.107+0000 7f7f9b03d700 1 --2- 172.21.15.40:0/1212932922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f9409df30 0x7f7f941c1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.107+0000 7f7f9b03d700 1 -- 172.21.15.40:0/1212932922 >> 172.21.15.40:0/1212932922 conn(0x7f7f940a2a00 msgr2=0x7f7f941308d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:33.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.107+0000 7f7f9b03d700 1 -- 172.21.15.40:0/1212932922 shutdown_connections 2023-09-30T22:31:33.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.107+0000 7f7f9b03d700 1 -- 172.21.15.40:0/1212932922 wait complete. 2023-09-30T22:31:33.120 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:33.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.140+0000 7f5b49ec0700 1 -- 172.21.15.40:0/3846826007 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5b44062380 con 0x7f5b4409e2b0 2023-09-30T22:31:33.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.141+0000 7f5b2bfff700 1 -- 172.21.15.40:0/3846826007 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5b3c01b660 con 0x7f5b4409e2b0 2023-09-30T22:31:33.141 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:33.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.143+0000 7f5b49ec0700 1 -- 172.21.15.40:0/3846826007 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b4409e2b0 msgr2=0x7f5b4412e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:33.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.143+0000 7f5b49ec0700 1 --2- 172.21.15.40:0/3846826007 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b4409e2b0 0x7f5b4412e030 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c00cbc0 tx=0x7f5b3c00cf80 comp rx=0 tx=0).stop 2023-09-30T22:31:33.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.143+0000 7f5b49ec0700 1 -- 172.21.15.40:0/3846826007 shutdown_connections 2023-09-30T22:31:33.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.143+0000 7f5b49ec0700 1 --2- 172.21.15.40:0/3846826007 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b4409e2b0 0x7f5b4412e030 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.143+0000 7f5b49ec0700 1 --2- 172.21.15.40:0/3846826007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b4409c890 0x7f5b4412d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.143+0000 7f5b49ec0700 1 --2- 172.21.15.40:0/3846826007 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5b4409d920 0x7f5b4412daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:33.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.143+0000 7f5b49ec0700 1 -- 172.21.15.40:0/3846826007 >> 172.21.15.40:0/3846826007 conn(0x7f5b440a7080 msgr2=0x7f5b440a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:33.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.143+0000 7f5b49ec0700 1 -- 172.21.15.40:0/3846826007 shutdown_connections 2023-09-30T22:31:33.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:33.143+0000 7f5b49ec0700 1 -- 172.21.15.40:0/3846826007 wait complete. 2023-09-30T22:31:33.155 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:34.072 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:34.108 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:34.121 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:34.155 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:34.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.223+0000 7f2326617700 1 Processor -- start 2023-09-30T22:31:34.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.223+0000 7f2326617700 1 -- start start 2023-09-30T22:31:34.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.224+0000 7f2326617700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2320131d50 0x7f2320132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.224+0000 7f2326617700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f232009bc50 0x7f232009c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.224+0000 7f2326617700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f232009c600 0x7f2320138ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.224+0000 7f2326617700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f232009cb00 con 0x7f232009c600 2023-09-30T22:31:34.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.224+0000 7f2326617700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2320071920 con 0x7f232009bc50 2023-09-30T22:31:34.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.224+0000 7f2326617700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2320132660 con 0x7f2320131d50 2023-09-30T22:31:34.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.224+0000 7f231ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2320131d50 0x7f2320132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.224+0000 7f231ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2320131d50 0x7f2320132120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48024/0 (socket says 172.21.15.40:48024) 2023-09-30T22:31:34.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.224+0000 7f231ffff700 1 -- 172.21.15.40:0/222475899 learned_addr learned my addr 172.21.15.40:0/222475899 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:34.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.224+0000 7f231f7fe700 1 --2- 172.21.15.40:0/222475899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f232009bc50 0x7f232009c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.224+0000 7f2324bb4700 1 --2- 172.21.15.40:0/222475899 >> v2:172.21.15.40:3300/0 conn(0x7f232009c600 0x7f2320138ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.224+0000 7f2324bb4700 1 -- 172.21.15.40:0/222475899 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2320131d50 msgr2=0x7f2320132120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:34.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.224+0000 7f2324bb4700 1 --2- 172.21.15.40:0/222475899 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2320131d50 0x7f2320132120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.224+0000 7f2324bb4700 1 -- 172.21.15.40:0/222475899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f232009bc50 msgr2=0x7f232009c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:34.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.224+0000 7f2324bb4700 1 --2- 172.21.15.40:0/222475899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f232009bc50 0x7f232009c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.224+0000 7f2324bb4700 1 -- 172.21.15.40:0/222475899 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2320131900 con 0x7f232009c600 2023-09-30T22:31:34.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.224+0000 7f231f7fe700 1 --2- 172.21.15.40:0/222475899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f232009bc50 0x7f232009c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:34.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.225+0000 7f2324bb4700 1 --2- 172.21.15.40:0/222475899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f232009c600 0x7f2320138ab0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f2318009d90 tx=0x7f231800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fe5365463104a7a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:34.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.225+0000 7f231effd700 1 -- 172.21.15.40:0/222475899 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231800e070 con 0x7f232009c600 2023-09-30T22:31:34.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.225+0000 7f231effd700 1 -- 172.21.15.40:0/222475899 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231800bb20 con 0x7f232009c600 2023-09-30T22:31:34.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.225+0000 7f231effd700 1 -- 172.21.15.40:0/222475899 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2318012430 con 0x7f232009c600 2023-09-30T22:31:34.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.226+0000 7f2326617700 1 -- 172.21.15.40:0/222475899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f232009c600 msgr2=0x7f2320138ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:34.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.226+0000 7f2326617700 1 --2- 172.21.15.40:0/222475899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f232009c600 0x7f2320138ab0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f2318009d90 tx=0x7f231800b330 comp rx=0 tx=0).stop 2023-09-30T22:31:34.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.226+0000 7f2326617700 1 -- 172.21.15.40:0/222475899 shutdown_connections 2023-09-30T22:31:34.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.226+0000 7f2326617700 1 --2- 172.21.15.40:0/222475899 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2320131d50 0x7f2320132120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.226+0000 7f2326617700 1 --2- 172.21.15.40:0/222475899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f232009c600 0x7f2320138ab0 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.226+0000 7f2326617700 1 --2- 172.21.15.40:0/222475899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f232009bc50 0x7f232009c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.226+0000 7f2326617700 1 -- 172.21.15.40:0/222475899 >> 172.21.15.40:0/222475899 conn(0x7f23200a2a00 msgr2=0x7f23200a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:34.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.226+0000 7f2326617700 1 -- 172.21.15.40:0/222475899 shutdown_connections 2023-09-30T22:31:34.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.226+0000 7f2326617700 1 -- 172.21.15.40:0/222475899 wait complete. 2023-09-30T22:31:34.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.227+0000 7f2326617700 1 Processor -- start 2023-09-30T22:31:34.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.228+0000 7f2326617700 1 -- start start 2023-09-30T22:31:34.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.228+0000 7f2326617700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f232009bc50 0x7f23201c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.228+0000 7f2326617700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f232009c600 0x7f23201c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.228+0000 7f2326617700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2320131d50 0x7f23201c9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.228+0000 7f2326617700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2320136480 con 0x7f232009c600 2023-09-30T22:31:34.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.228+0000 7f2326617700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2320137350 con 0x7f2320131d50 2023-09-30T22:31:34.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.228+0000 7f2326617700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2320138c00 con 0x7f232009bc50 2023-09-30T22:31:34.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.229+0000 7f231f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f232009c600 0x7f23201c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.229+0000 7f231f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f232009c600 0x7f23201c8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47268/0 (socket says 172.21.15.40:47268) 2023-09-30T22:31:34.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.229+0000 7f231f7fe700 1 -- 172.21.15.40:0/3888862555 learned_addr learned my addr 172.21.15.40:0/3888862555 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:34.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.229+0000 7f2324bb4700 1 --2- 172.21.15.40:0/3888862555 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2320131d50 0x7f23201c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.229+0000 7f231ffff700 1 --2- 172.21.15.40:0/3888862555 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f232009bc50 0x7f23201c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.229+0000 7f231f7fe700 1 -- 172.21.15.40:0/3888862555 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f232009bc50 msgr2=0x7f23201c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:34.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.229+0000 7f231f7fe700 1 --2- 172.21.15.40:0/3888862555 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f232009bc50 0x7f23201c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.229+0000 7f231f7fe700 1 -- 172.21.15.40:0/3888862555 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2320131d50 msgr2=0x7f23201c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:34.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.229+0000 7f231f7fe700 1 --2- 172.21.15.40:0/3888862555 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2320131d50 0x7f23201c9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.229+0000 7f231f7fe700 1 -- 172.21.15.40:0/3888862555 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23140094a0 con 0x7f232009c600 2023-09-30T22:31:34.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.229+0000 7f231ffff700 1 --2- 172.21.15.40:0/3888862555 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f232009bc50 0x7f23201c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:34.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.229+0000 7f231f7fe700 1 --2- 172.21.15.40:0/3888862555 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f232009c600 0x7f23201c8b10 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f231400e930 tx=0x7f231400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:34.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.230+0000 7f231cff9700 1 -- 172.21.15.40:0/3888862555 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231400ee80 con 0x7f232009c600 2023-09-30T22:31:34.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.230+0000 7f231cff9700 1 -- 172.21.15.40:0/3888862555 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231400c850 con 0x7f232009c600 2023-09-30T22:31:34.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.230+0000 7f2326617700 1 -- 172.21.15.40:0/3888862555 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2318009a70 con 0x7f232009c600 2023-09-30T22:31:34.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.230+0000 7f231cff9700 1 -- 172.21.15.40:0/3888862555 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231400cbe0 con 0x7f232009c600 2023-09-30T22:31:34.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.230+0000 7f2326617700 1 -- 172.21.15.40:0/3888862555 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f232009ea60 con 0x7f232009c600 2023-09-30T22:31:34.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.231+0000 7f231cff9700 1 -- 172.21.15.40:0/3888862555 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f231400cd40 con 0x7f232009c600 2023-09-30T22:31:34.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.231+0000 7f2326617700 1 -- 172.21.15.40:0/3888862555 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23201374e0 con 0x7f232009c600 2023-09-30T22:31:34.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.231+0000 7f231cff9700 1 -- 172.21.15.40:0/3888862555 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f231403f7a0 con 0x7f232009c600 2023-09-30T22:31:34.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.240+0000 7f231cff9700 1 -- 172.21.15.40:0/3888862555 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f23201374e0 con 0x7f232009c600 2023-09-30T22:31:34.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.262+0000 7f596c780700 1 Processor -- start 2023-09-30T22:31:34.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.262+0000 7f596c780700 1 -- start start 2023-09-30T22:31:34.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.262+0000 7f596c780700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f596406a6d0 0x7f596406aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.262+0000 7f596c780700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f596406afe0 0x7f59641318b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.262+0000 7f596c780700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f596409eb50 con 0x7f5964131df0 2023-09-30T22:31:34.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.262+0000 7f596c780700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596409dde0 con 0x7f596406a6d0 2023-09-30T22:31:34.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.262+0000 7f596c780700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f596409d4a0 con 0x7f596406afe0 2023-09-30T22:31:34.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.263+0000 7f596a51c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f596406a6d0 0x7f596406aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.263+0000 7f596a51c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f596406a6d0 0x7f596406aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:51332/0 (socket says 172.21.15.40:51332) 2023-09-30T22:31:34.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.263+0000 7f596a51c700 1 -- 172.21.15.40:0/909240150 learned_addr learned my addr 172.21.15.40:0/909240150 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:34.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.263+0000 7f5969d1b700 1 --2- 172.21.15.40:0/909240150 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f596406afe0 0x7f59641318b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.263+0000 7f596a51c700 1 -- 172.21.15.40:0/909240150 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f596406afe0 msgr2=0x7f59641318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:34.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.263+0000 7f596a51c700 1 --2- 172.21.15.40:0/909240150 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f596406afe0 0x7f59641318b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.263+0000 7f596a51c700 1 -- 172.21.15.40:0/909240150 >> v1:172.21.15.40:6789/0 conn(0x7f5964131df0 legacy=0x7f5964138b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:34.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.263+0000 7f596a51c700 1 -- 172.21.15.40:0/909240150 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f596409f5f0 con 0x7f596406a6d0 2023-09-30T22:31:34.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.263+0000 7f596a51c700 1 --2- 172.21.15.40:0/909240150 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f596406a6d0 0x7f596406aaa0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f59600098f0 tx=0x7f5960009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce0cc49f9851d873 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:34.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.263+0000 7f596951a700 1 -- 172.21.15.40:0/909240150 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5960005e30 con 0x7f596406a6d0 2023-09-30T22:31:34.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.263+0000 7f596951a700 1 -- 172.21.15.40:0/909240150 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5960004030 con 0x7f596406a6d0 2023-09-30T22:31:34.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.263+0000 7f596951a700 1 -- 172.21.15.40:0/909240150 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59600043e0 con 0x7f596406a6d0 2023-09-30T22:31:34.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.264+0000 7f596c780700 1 -- 172.21.15.40:0/909240150 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f596406a6d0 msgr2=0x7f596406aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:34.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.264+0000 7f596c780700 1 --2- 172.21.15.40:0/909240150 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f596406a6d0 0x7f596406aaa0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f59600098f0 tx=0x7f5960009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:34.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.264+0000 7f596c780700 1 -- 172.21.15.40:0/909240150 shutdown_connections 2023-09-30T22:31:34.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.264+0000 7f596c780700 1 --2- 172.21.15.40:0/909240150 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f596406a6d0 0x7f596406aaa0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.264+0000 7f596c780700 1 --2- 172.21.15.40:0/909240150 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f596406afe0 0x7f59641318b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.264+0000 7f596c780700 1 -- 172.21.15.40:0/909240150 >> 172.21.15.40:0/909240150 conn(0x7f596409fb20 msgr2=0x7f596409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:34.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.264+0000 7f596c780700 1 -- 172.21.15.40:0/909240150 shutdown_connections 2023-09-30T22:31:34.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.264+0000 7f596c780700 1 -- 172.21.15.40:0/909240150 wait complete. 2023-09-30T22:31:34.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.266+0000 7f596c780700 1 Processor -- start 2023-09-30T22:31:34.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.266+0000 7f596c780700 1 -- start start 2023-09-30T22:31:34.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.266+0000 7f596c780700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f596406a6d0 0x7f59641c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.266+0000 7f596c780700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f596406afe0 0x7f59641c6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.266+0000 7f596c780700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5964131df0 0x7f59641c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.266+0000 7f596c780700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596411e6b0 con 0x7f596406afe0 2023-09-30T22:31:34.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.266+0000 7f596c780700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596411fde0 con 0x7f596406a6d0 2023-09-30T22:31:34.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.266+0000 7f596c780700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5964071560 con 0x7f5964131df0 2023-09-30T22:31:34.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.266+0000 7f596a51c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f596406a6d0 0x7f59641c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.266+0000 7f5969d1b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f596406afe0 0x7f59641c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.266+0000 7f596a51c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f596406a6d0 0x7f59641c62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:51342/0 (socket says 172.21.15.40:51342) 2023-09-30T22:31:34.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.266+0000 7f596a51c700 1 -- 172.21.15.40:0/4112293384 learned_addr learned my addr 172.21.15.40:0/4112293384 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:34.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.267+0000 7f596ad1d700 1 --2- 172.21.15.40:0/4112293384 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5964131df0 0x7f59641c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.267+0000 7f596a51c700 1 -- 172.21.15.40:0/4112293384 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5964131df0 msgr2=0x7f59641c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:34.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.267+0000 7f596a51c700 1 --2- 172.21.15.40:0/4112293384 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5964131df0 0x7f59641c6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.267+0000 7f596a51c700 1 -- 172.21.15.40:0/4112293384 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f596406afe0 msgr2=0x7f59641c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:34.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.267+0000 7f596a51c700 1 --2- 172.21.15.40:0/4112293384 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f596406afe0 0x7f59641c6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.267+0000 7f596a51c700 1 -- 172.21.15.40:0/4112293384 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5960009500 con 0x7f596406a6d0 2023-09-30T22:31:34.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.267+0000 7f5969d1b700 1 --2- 172.21.15.40:0/4112293384 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f596406afe0 0x7f59641c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:34.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.267+0000 7f596a51c700 1 --2- 172.21.15.40:0/4112293384 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f596406a6d0 0x7f59641c62f0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f5960004000 tx=0x7f5960004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:34.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.267+0000 7f595affd700 1 -- 172.21.15.40:0/4112293384 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5960003cb0 con 0x7f596406a6d0 2023-09-30T22:31:34.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.267+0000 7f595affd700 1 -- 172.21.15.40:0/4112293384 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5960003e10 con 0x7f596406a6d0 2023-09-30T22:31:34.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.267+0000 7f595affd700 1 -- 172.21.15.40:0/4112293384 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596001c660 con 0x7f596406a6d0 2023-09-30T22:31:34.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.268+0000 7f596c780700 1 -- 172.21.15.40:0/4112293384 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f596411ec60 con 0x7f596406a6d0 2023-09-30T22:31:34.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.268+0000 7f596c780700 1 -- 172.21.15.40:0/4112293384 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59641317f0 con 0x7f596406a6d0 2023-09-30T22:31:34.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.269+0000 7f596c780700 1 -- 172.21.15.40:0/4112293384 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5964120230 con 0x7f596406a6d0 2023-09-30T22:31:34.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.269+0000 7f595affd700 1 -- 172.21.15.40:0/4112293384 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f596001c7c0 con 0x7f596406a6d0 2023-09-30T22:31:34.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.269+0000 7f595affd700 1 -- 172.21.15.40:0/4112293384 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5960041d60 con 0x7f596406a6d0 2023-09-30T22:31:34.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.274+0000 7f595affd700 1 -- 172.21.15.40:0/4112293384 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5960045060 con 0x7f596406a6d0 2023-09-30T22:31:34.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.301+0000 7f3a7e8c1700 1 Processor -- start 2023-09-30T22:31:34.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.301+0000 7f3a7e8c1700 1 -- start start 2023-09-30T22:31:34.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.302+0000 7f3a7e8c1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3a7809f0f0 0x7f3a78138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.302+0000 7f3a7e8c1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a7809e400 0x7f3a7813b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.302+0000 7f3a7e8c1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a7809f940 con 0x7f3a7809d920 2023-09-30T22:31:34.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.302+0000 7f3a7e8c1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a7806b4c0 con 0x7f3a7809f0f0 2023-09-30T22:31:34.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.302+0000 7f3a7e8c1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7809a8f0 con 0x7f3a7809e400 2023-09-30T22:31:34.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.302+0000 7f3a7ce5e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a7809e400 0x7f3a7813b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.302+0000 7f3a7ce5e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a7809e400 0x7f3a7813b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:51346/0 (socket says 172.21.15.40:51346) 2023-09-30T22:31:34.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.302+0000 7f3a7ce5e700 1 -- 172.21.15.40:0/3398227690 learned_addr learned my addr 172.21.15.40:0/3398227690 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:34.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.302+0000 7f3a777fe700 1 --2- 172.21.15.40:0/3398227690 >> v2:172.21.15.40:3300/0 conn(0x7f3a7809f0f0 0x7f3a78138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.302+0000 7f3a7ce5e700 1 -- 172.21.15.40:0/3398227690 >> v2:172.21.15.40:3300/0 conn(0x7f3a7809f0f0 msgr2=0x7f3a78138ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:34.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.302+0000 7f3a7ce5e700 1 --2- 172.21.15.40:0/3398227690 >> v2:172.21.15.40:3300/0 conn(0x7f3a7809f0f0 0x7f3a78138ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.302+0000 7f3a7ce5e700 1 -- 172.21.15.40:0/3398227690 >> v1:172.21.15.40:6789/0 conn(0x7f3a7809d920 legacy=0x7f3a7809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:34.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.302+0000 7f3a7ce5e700 1 -- 172.21.15.40:0/3398227690 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7809f6e0 con 0x7f3a7809e400 2023-09-30T22:31:34.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.303+0000 7f3a7ce5e700 1 --2- 172.21.15.40:0/3398227690 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a7809e400 0x7f3a7813b430 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f3a70009e80 tx=0x7f3a7000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2c5c698a1ceda45 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:34.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.303+0000 7f3a76ffd700 1 -- 172.21.15.40:0/3398227690 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7000e070 con 0x7f3a7809e400 2023-09-30T22:31:34.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.303+0000 7f3a76ffd700 1 -- 172.21.15.40:0/3398227690 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7000b8d0 con 0x7f3a7809e400 2023-09-30T22:31:34.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.303+0000 7f3a76ffd700 1 -- 172.21.15.40:0/3398227690 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7000bc80 con 0x7f3a7809e400 2023-09-30T22:31:34.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.303+0000 7f3a7e8c1700 1 -- 172.21.15.40:0/3398227690 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a7809e400 msgr2=0x7f3a7813b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:34.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.303+0000 7f3a7e8c1700 1 --2- 172.21.15.40:0/3398227690 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a7809e400 0x7f3a7813b430 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f3a70009e80 tx=0x7f3a7000b330 comp rx=0 tx=0).stop 2023-09-30T22:31:34.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.303+0000 7f3a7e8c1700 1 -- 172.21.15.40:0/3398227690 shutdown_connections 2023-09-30T22:31:34.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.303+0000 7f3a7e8c1700 1 --2- 172.21.15.40:0/3398227690 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a7809e400 0x7f3a7813b430 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.303+0000 7f3a7e8c1700 1 --2- 172.21.15.40:0/3398227690 >> v2:172.21.15.40:3300/0 conn(0x7f3a7809f0f0 0x7f3a78138ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.303+0000 7f3a7e8c1700 1 -- 172.21.15.40:0/3398227690 >> 172.21.15.40:0/3398227690 conn(0x7f3a7809fb20 msgr2=0x7f3a7809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:34.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.304+0000 7f3a7e8c1700 1 -- 172.21.15.40:0/3398227690 shutdown_connections 2023-09-30T22:31:34.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.304+0000 7f3a7e8c1700 1 -- 172.21.15.40:0/3398227690 wait complete. 2023-09-30T22:31:34.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.304+0000 7f3a7e8c1700 1 Processor -- start 2023-09-30T22:31:34.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.305+0000 7f3a7e8c1700 1 -- start start 2023-09-30T22:31:34.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.305+0000 7f3a7e8c1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a7809d920 0x7f3a7811e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.305+0000 7f3a7e8c1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a7809e400 0x7f3a7811ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.305+0000 7f3a7e8c1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a7811f180 0x7f3a781ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.305+0000 7f3a7e8c1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a78120960 con 0x7f3a7809e400 2023-09-30T22:31:34.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.305+0000 7f3a7e8c1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a780a32f0 con 0x7f3a7809d920 2023-09-30T22:31:34.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.305+0000 7f3a7e8c1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a781219b0 con 0x7f3a7811f180 2023-09-30T22:31:34.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.305+0000 7f3a77fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a7809d920 0x7f3a7811e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.305+0000 7f3a77fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a7809d920 0x7f3a7811e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:51352/0 (socket says 172.21.15.40:51352) 2023-09-30T22:31:34.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.305+0000 7f3a77fff700 1 -- 172.21.15.40:0/607469341 learned_addr learned my addr 172.21.15.40:0/607469341 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:34.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.305+0000 7f3a777fe700 1 --2- 172.21.15.40:0/607469341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a7809e400 0x7f3a7811ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.305+0000 7f3a7ce5e700 1 --2- 172.21.15.40:0/607469341 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a7811f180 0x7f3a781ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.306+0000 7f3a77fff700 1 -- 172.21.15.40:0/607469341 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a7811f180 msgr2=0x7f3a781ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:34.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.306+0000 7f3a77fff700 1 --2- 172.21.15.40:0/607469341 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a7811f180 0x7f3a781ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.306+0000 7f3a77fff700 1 -- 172.21.15.40:0/607469341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a7809e400 msgr2=0x7f3a7811ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:34.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.306+0000 7f3a77fff700 1 --2- 172.21.15.40:0/607469341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a7809e400 0x7f3a7811ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.306+0000 7f3a77fff700 1 -- 172.21.15.40:0/607469341 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a70009b30 con 0x7f3a7809d920 2023-09-30T22:31:34.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.306+0000 7f3a777fe700 1 --2- 172.21.15.40:0/607469341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a7809e400 0x7f3a7811ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:34.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.306+0000 7f3a7ce5e700 1 --2- 172.21.15.40:0/607469341 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a7811f180 0x7f3a781ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:34.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.306+0000 7f3a77fff700 1 --2- 172.21.15.40:0/607469341 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a7809d920 0x7f3a7811e700 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f3a6800c4d0 tx=0x7f3a6800c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:34.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.306+0000 7f3a74ff9700 1 -- 172.21.15.40:0/607469341 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a680054e0 con 0x7f3a7809d920 2023-09-30T22:31:34.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.306+0000 7f3a74ff9700 1 -- 172.21.15.40:0/607469341 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a68003680 con 0x7f3a7809d920 2023-09-30T22:31:34.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.306+0000 7f3a7e8c1700 1 -- 172.21.15.40:0/607469341 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a781222c0 con 0x7f3a7809d920 2023-09-30T22:31:34.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.306+0000 7f3a74ff9700 1 -- 172.21.15.40:0/607469341 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a68003a30 con 0x7f3a7809d920 2023-09-30T22:31:34.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.306+0000 7f3a7e8c1700 1 -- 172.21.15.40:0/607469341 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a78121f40 con 0x7f3a7809d920 2023-09-30T22:31:34.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.307+0000 7f3a74ff9700 1 -- 172.21.15.40:0/607469341 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3a68003b90 con 0x7f3a7809d920 2023-09-30T22:31:34.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.307+0000 7f3a7e8c1700 1 -- 172.21.15.40:0/607469341 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a78062380 con 0x7f3a7809d920 2023-09-30T22:31:34.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.307+0000 7f3a74ff9700 1 -- 172.21.15.40:0/607469341 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3a6803eb50 con 0x7f3a7809d920 2023-09-30T22:31:34.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.312+0000 7f3a74ff9700 1 -- 172.21.15.40:0/607469341 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3a68017020 con 0x7f3a7809d920 2023-09-30T22:31:34.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.339+0000 7fd7d4972700 1 Processor -- start 2023-09-30T22:31:34.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.339+0000 7fd7d4972700 1 -- start start 2023-09-30T22:31:34.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.340+0000 7fd7d4972700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd7d006f070 0x7fd7d006f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.340+0000 7fd7d4972700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7d006fdb0 0x7fd7d00977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.340+0000 7fd7d4972700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7d0070830 con 0x7fd7d006f980 2023-09-30T22:31:34.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.340+0000 7fd7d4972700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7d0070ad0 con 0x7fd7d006f070 2023-09-30T22:31:34.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.340+0000 7fd7d4972700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d0070de0 con 0x7fd7d006fdb0 2023-09-30T22:31:34.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.340+0000 7fd7ce59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd7d006f070 0x7fd7d006f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.340+0000 7fd7ce59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd7d006f070 0x7fd7d006f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47312/0 (socket says 172.21.15.40:47312) 2023-09-30T22:31:34.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.340+0000 7fd7ce59c700 1 -- 172.21.15.40:0/3191344912 learned_addr learned my addr 172.21.15.40:0/3191344912 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:34.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.340+0000 7fd7ced9d700 1 --2- 172.21.15.40:0/3191344912 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7d006fdb0 0x7fd7d00977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.340+0000 7fd7ced9d700 1 -- 172.21.15.40:0/3191344912 >> v2:172.21.15.40:3300/0 conn(0x7fd7d006f070 msgr2=0x7fd7d006f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:34.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.340+0000 7fd7ced9d700 1 --2- 172.21.15.40:0/3191344912 >> v2:172.21.15.40:3300/0 conn(0x7fd7d006f070 0x7fd7d006f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.340+0000 7fd7ced9d700 1 -- 172.21.15.40:0/3191344912 >> v1:172.21.15.40:6789/0 conn(0x7fd7d006f980 legacy=0x7fd7d0097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:34.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.340+0000 7fd7ced9d700 1 -- 172.21.15.40:0/3191344912 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d009fe20 con 0x7fd7d006fdb0 2023-09-30T22:31:34.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.341+0000 7fd7ced9d700 1 --2- 172.21.15.40:0/3191344912 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7d006fdb0 0x7fd7d00977a0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8009d90 tx=0x7fd7c800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=448fb9ae5d910338 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:34.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.341+0000 7fd7cd59a700 1 -- 172.21.15.40:0/3191344912 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c800e070 con 0x7fd7d006fdb0 2023-09-30T22:31:34.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.341+0000 7fd7cd59a700 1 -- 172.21.15.40:0/3191344912 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c800bb20 con 0x7fd7d006fdb0 2023-09-30T22:31:34.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.341+0000 7fd7cd59a700 1 -- 172.21.15.40:0/3191344912 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8012430 con 0x7fd7d006fdb0 2023-09-30T22:31:34.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.342+0000 7fd7d4972700 1 -- 172.21.15.40:0/3191344912 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7d006fdb0 msgr2=0x7fd7d00977a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:34.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.342+0000 7fd7d4972700 1 --2- 172.21.15.40:0/3191344912 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7d006fdb0 0x7fd7d00977a0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8009d90 tx=0x7fd7c800b330 comp rx=0 tx=0).stop 2023-09-30T22:31:34.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.342+0000 7fd7d4972700 1 -- 172.21.15.40:0/3191344912 shutdown_connections 2023-09-30T22:31:34.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.342+0000 7fd7d4972700 1 --2- 172.21.15.40:0/3191344912 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7d006fdb0 0x7fd7d00977a0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.342+0000 7fd7d4972700 1 --2- 172.21.15.40:0/3191344912 >> v2:172.21.15.40:3300/0 conn(0x7fd7d006f070 0x7fd7d006f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.342+0000 7fd7d4972700 1 -- 172.21.15.40:0/3191344912 >> 172.21.15.40:0/3191344912 conn(0x7fd7d00a41a0 msgr2=0x7fd7d00a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:34.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.342+0000 7fd7d4972700 1 -- 172.21.15.40:0/3191344912 shutdown_connections 2023-09-30T22:31:34.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.342+0000 7fd7d4972700 1 -- 172.21.15.40:0/3191344912 wait complete. 2023-09-30T22:31:34.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.344+0000 7fd7d4972700 1 Processor -- start 2023-09-30T22:31:34.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.344+0000 7fd7d4972700 1 -- start start 2023-09-30T22:31:34.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.344+0000 7fd7d4972700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd7d006f070 0x7fd7d006c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.344+0000 7fd7d4972700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7d006f980 0x7fd7d006ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.344+0000 7fd7d4972700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7d006fdb0 0x7fd7d006d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:34.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.344+0000 7fd7d4972700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d006e050 con 0x7fd7d006fdb0 2023-09-30T22:31:34.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.344+0000 7fd7d4972700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d008b750 con 0x7fd7d006f980 2023-09-30T22:31:34.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.344+0000 7fd7d4972700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d006e650 con 0x7fd7d006f070 2023-09-30T22:31:34.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.345+0000 7fd7ced9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7d006fdb0 0x7fd7d006d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.345+0000 7fd7ce59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd7d006f070 0x7fd7d006c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.345+0000 7fd7ced9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7d006fdb0 0x7fd7d006d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47318/0 (socket says 172.21.15.40:47318) 2023-09-30T22:31:34.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.345+0000 7fd7ce59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd7d006f070 0x7fd7d006c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48090/0 (socket says 172.21.15.40:48090) 2023-09-30T22:31:34.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.345+0000 7fd7ced9d700 1 -- 172.21.15.40:0/430407261 learned_addr learned my addr 172.21.15.40:0/430407261 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:34.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.345+0000 7fd7cdd9b700 1 --2- 172.21.15.40:0/430407261 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7d006f980 0x7fd7d006ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:34.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.345+0000 7fd7ced9d700 1 -- 172.21.15.40:0/430407261 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd7d006f070 msgr2=0x7fd7d006c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:34.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.345+0000 7fd7ced9d700 1 --2- 172.21.15.40:0/430407261 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd7d006f070 0x7fd7d006c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.345+0000 7fd7ced9d700 1 -- 172.21.15.40:0/430407261 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7d006f980 msgr2=0x7fd7d006ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:34.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.345+0000 7fd7ced9d700 1 --2- 172.21.15.40:0/430407261 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7d006f980 0x7fd7d006ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.345+0000 7fd7ced9d700 1 -- 172.21.15.40:0/430407261 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c8009a70 con 0x7fd7d006fdb0 2023-09-30T22:31:34.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.345+0000 7fd7ce59c700 1 --2- 172.21.15.40:0/430407261 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd7d006f070 0x7fd7d006c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:34.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.345+0000 7fd7ced9d700 1 --2- 172.21.15.40:0/430407261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7d006fdb0 0x7fd7d006d410 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8014040 tx=0x7fd7c8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:34.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.345+0000 7fd7beffd700 1 -- 172.21.15.40:0/430407261 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8012430 con 0x7fd7d006fdb0 2023-09-30T22:31:34.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.346+0000 7fd7beffd700 1 -- 172.21.15.40:0/430407261 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c8020070 con 0x7fd7d006fdb0 2023-09-30T22:31:34.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.346+0000 7fd7d4972700 1 -- 172.21.15.40:0/430407261 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7d006e220 con 0x7fd7d006fdb0 2023-09-30T22:31:34.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.346+0000 7fd7beffd700 1 -- 172.21.15.40:0/430407261 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8004280 con 0x7fd7d006fdb0 2023-09-30T22:31:34.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.346+0000 7fd7d4972700 1 -- 172.21.15.40:0/430407261 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7d006db60 con 0x7fd7d006fdb0 2023-09-30T22:31:34.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.347+0000 7fd7d4972700 1 -- 172.21.15.40:0/430407261 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7d0062380 con 0x7fd7d006fdb0 2023-09-30T22:31:34.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.347+0000 7fd7beffd700 1 -- 172.21.15.40:0/430407261 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd7c80043e0 con 0x7fd7d006fdb0 2023-09-30T22:31:34.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.347+0000 7fd7beffd700 1 -- 172.21.15.40:0/430407261 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd7c8022070 con 0x7fd7d006fdb0 2023-09-30T22:31:34.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.356+0000 7fd7beffd700 1 -- 172.21.15.40:0/430407261 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd7c8031430 con 0x7fd7d006fdb0 2023-09-30T22:31:34.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.478+0000 7f596c780700 1 -- 172.21.15.40:0/4112293384 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5964062380 con 0x7f596406a6d0 2023-09-30T22:31:34.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.478+0000 7f595affd700 1 -- 172.21.15.40:0/4112293384 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5960016090 con 0x7f596406a6d0 2023-09-30T22:31:34.478 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:34.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.481+0000 7f596c780700 1 -- 172.21.15.40:0/4112293384 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f596406a6d0 msgr2=0x7f59641c62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:34.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.481+0000 7f596c780700 1 --2- 172.21.15.40:0/4112293384 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f596406a6d0 0x7f59641c62f0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f5960004000 tx=0x7f5960004750 comp rx=0 tx=0).stop 2023-09-30T22:31:34.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.481+0000 7f596c780700 1 -- 172.21.15.40:0/4112293384 shutdown_connections 2023-09-30T22:31:34.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.481+0000 7f596c780700 1 --2- 172.21.15.40:0/4112293384 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f5964131df0 0x7f59641c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.481+0000 7f596c780700 1 --2- 172.21.15.40:0/4112293384 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f596406a6d0 0x7f59641c62f0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.481+0000 7f596c780700 1 --2- 172.21.15.40:0/4112293384 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f596406afe0 0x7f59641c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.481+0000 7f596c780700 1 -- 172.21.15.40:0/4112293384 >> 172.21.15.40:0/4112293384 conn(0x7f596409fb20 msgr2=0x7f59640a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:34.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.482+0000 7f596c780700 1 -- 172.21.15.40:0/4112293384 shutdown_connections 2023-09-30T22:31:34.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.482+0000 7f596c780700 1 -- 172.21.15.40:0/4112293384 wait complete. 2023-09-30T22:31:34.498 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:34.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.518+0000 7f3a7e8c1700 1 -- 172.21.15.40:0/607469341 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3a78074720 con 0x7f3a7809d920 2023-09-30T22:31:34.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.518+0000 7f3a74ff9700 1 -- 172.21.15.40:0/607469341 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3a68019b20 con 0x7f3a7809d920 2023-09-30T22:31:34.518 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:34.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.520+0000 7f3a7e8c1700 1 -- 172.21.15.40:0/607469341 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a7809d920 msgr2=0x7f3a7811e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:34.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.520+0000 7f3a7e8c1700 1 --2- 172.21.15.40:0/607469341 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a7809d920 0x7f3a7811e700 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f3a6800c4d0 tx=0x7f3a6800c7e0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.520+0000 7f3a7e8c1700 1 -- 172.21.15.40:0/607469341 shutdown_connections 2023-09-30T22:31:34.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.520+0000 7f3a7e8c1700 1 --2- 172.21.15.40:0/607469341 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a7811f180 0x7f3a781ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.520+0000 7f3a7e8c1700 1 --2- 172.21.15.40:0/607469341 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a7809d920 0x7f3a7811e700 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.520+0000 7f3a7e8c1700 1 --2- 172.21.15.40:0/607469341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a7809e400 0x7f3a7811ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.520+0000 7f3a7e8c1700 1 -- 172.21.15.40:0/607469341 >> 172.21.15.40:0/607469341 conn(0x7f3a7809fb20 msgr2=0x7f3a78070860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:34.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.520+0000 7f3a7e8c1700 1 -- 172.21.15.40:0/607469341 shutdown_connections 2023-09-30T22:31:34.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.521+0000 7f3a7e8c1700 1 -- 172.21.15.40:0/607469341 wait complete. 2023-09-30T22:31:34.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.522+0000 7f2326617700 1 -- 172.21.15.40:0/3888862555 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2320062380 con 0x7f232009c600 2023-09-30T22:31:34.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.523+0000 7f231cff9700 1 -- 172.21.15.40:0/3888862555 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2314021020 con 0x7f232009c600 2023-09-30T22:31:34.523 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:34.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.525+0000 7f2326617700 1 -- 172.21.15.40:0/3888862555 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f232009c600 msgr2=0x7f23201c8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:34.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.525+0000 7f2326617700 1 --2- 172.21.15.40:0/3888862555 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f232009c600 0x7f23201c8b10 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f231400e930 tx=0x7f231400ec40 comp rx=0 tx=0).stop 2023-09-30T22:31:34.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.525+0000 7f2326617700 1 -- 172.21.15.40:0/3888862555 shutdown_connections 2023-09-30T22:31:34.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.525+0000 7f2326617700 1 --2- 172.21.15.40:0/3888862555 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f232009bc50 0x7f23201c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.525+0000 7f2326617700 1 --2- 172.21.15.40:0/3888862555 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2320131d50 0x7f23201c9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.525+0000 7f2326617700 1 --2- 172.21.15.40:0/3888862555 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f232009c600 0x7f23201c8b10 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.525+0000 7f2326617700 1 -- 172.21.15.40:0/3888862555 >> 172.21.15.40:0/3888862555 conn(0x7f23200a2a00 msgr2=0x7f2320130bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:34.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.525+0000 7f2326617700 1 -- 172.21.15.40:0/3888862555 shutdown_connections 2023-09-30T22:31:34.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.525+0000 7f2326617700 1 -- 172.21.15.40:0/3888862555 wait complete. 2023-09-30T22:31:34.534 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:34.538 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:34.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.579+0000 7fd7d4972700 1 -- 172.21.15.40:0/430407261 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd7d0074620 con 0x7fd7d006fdb0 2023-09-30T22:31:34.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.580+0000 7fd7beffd700 1 -- 172.21.15.40:0/430407261 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd7c802c070 con 0x7fd7d006fdb0 2023-09-30T22:31:34.580 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:34.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.582+0000 7fd7d4972700 1 -- 172.21.15.40:0/430407261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7d006fdb0 msgr2=0x7fd7d006d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:34.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.582+0000 7fd7d4972700 1 --2- 172.21.15.40:0/430407261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7d006fdb0 0x7fd7d006d410 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8014040 tx=0x7fd7c8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.582+0000 7fd7d4972700 1 -- 172.21.15.40:0/430407261 shutdown_connections 2023-09-30T22:31:34.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.582+0000 7fd7d4972700 1 --2- 172.21.15.40:0/430407261 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd7d006f070 0x7fd7d006c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.582+0000 7fd7d4972700 1 --2- 172.21.15.40:0/430407261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7d006fdb0 0x7fd7d006d410 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.582+0000 7fd7d4972700 1 --2- 172.21.15.40:0/430407261 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7d006f980 0x7fd7d006ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:34.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.582+0000 7fd7d4972700 1 -- 172.21.15.40:0/430407261 >> 172.21.15.40:0/430407261 conn(0x7fd7d00a41a0 msgr2=0x7fd7d012af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:34.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.582+0000 7fd7d4972700 1 -- 172.21.15.40:0/430407261 shutdown_connections 2023-09-30T22:31:34.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:34.582+0000 7fd7d4972700 1 -- 172.21.15.40:0/430407261 wait complete. 2023-09-30T22:31:34.593 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:35.500 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:35.535 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:35.539 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:35.594 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:35.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.652+0000 7f3a8df2a700 1 Processor -- start 2023-09-30T22:31:35.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.653+0000 7f3a8df2a700 1 -- start start 2023-09-30T22:31:35.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.653+0000 7f3a8df2a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3a8809f0f0 0x7f3a88138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:35.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.653+0000 7f3a8df2a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a8809e400 0x7f3a8813b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:35.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.653+0000 7f3a8df2a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a8809f940 con 0x7f3a8809d920 2023-09-30T22:31:35.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.653+0000 7f3a8df2a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a8806b4c0 con 0x7f3a8809f0f0 2023-09-30T22:31:35.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.653+0000 7f3a8df2a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8809a8f0 con 0x7f3a8809e400 2023-09-30T22:31:35.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.653+0000 7f3a877fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3a8809d920 0x7f3a8809dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:35954/0 (socket says 172.21.15.40:35954) 2023-09-30T22:31:35.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.653+0000 7f3a877fe700 1 -- 172.21.15.40:0/3875382181 learned_addr learned my addr 172.21.15.40:0/3875382181 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:35.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.653+0000 7f3a86ffd700 1 --2- 172.21.15.40:0/3875382181 >> v2:172.21.15.40:3300/0 conn(0x7f3a8809f0f0 0x7f3a88138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:35.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.654+0000 7f3a87fff700 1 --2- 172.21.15.40:0/3875382181 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a8809e400 0x7f3a8813b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:35.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.654+0000 7f3a86ffd700 1 -- 172.21.15.40:0/3875382181 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a8809e400 msgr2=0x7f3a8813b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:35.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.654+0000 7f3a86ffd700 1 --2- 172.21.15.40:0/3875382181 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a8809e400 0x7f3a8813b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.654+0000 7f3a86ffd700 1 -- 172.21.15.40:0/3875382181 >> v1:172.21.15.40:6789/0 conn(0x7f3a8809d920 legacy=0x7f3a8809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:35.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.654+0000 7f3a86ffd700 1 -- 172.21.15.40:0/3875382181 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8809f6e0 con 0x7f3a8809f0f0 2023-09-30T22:31:35.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.654+0000 7f3a87fff700 1 --2- 172.21.15.40:0/3875382181 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a8809e400 0x7f3a8813b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:35.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.654+0000 7f3a86ffd700 1 --2- 172.21.15.40:0/3875382181 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a8809f0f0 0x7f3a88138ee0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c009840 tx=0x7f3a7c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad4f2dc19d5145b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:35.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.654+0000 7f3a867fc700 1 -- 172.21.15.40:0/3875382181 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c011830 con 0x7f3a8809f0f0 2023-09-30T22:31:35.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.654+0000 7f3a867fc700 1 -- 172.21.15.40:0/3875382181 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7c011990 con 0x7f3a8809f0f0 2023-09-30T22:31:35.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.654+0000 7f3a867fc700 1 -- 172.21.15.40:0/3875382181 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c011d20 con 0x7f3a8809f0f0 2023-09-30T22:31:35.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.655+0000 7f3a8df2a700 1 -- 172.21.15.40:0/3875382181 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a8809f0f0 msgr2=0x7f3a88138ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:35.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.655+0000 7f3a8df2a700 1 --2- 172.21.15.40:0/3875382181 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a8809f0f0 0x7f3a88138ee0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c009840 tx=0x7f3a7c009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:35.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.655+0000 7f3a8df2a700 1 -- 172.21.15.40:0/3875382181 shutdown_connections 2023-09-30T22:31:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.655+0000 7f3a8df2a700 1 --2- 172.21.15.40:0/3875382181 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a8809e400 0x7f3a8813b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.655+0000 7f3a8df2a700 1 --2- 172.21.15.40:0/3875382181 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a8809f0f0 0x7f3a88138ee0 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.655+0000 7f3a8df2a700 1 -- 172.21.15.40:0/3875382181 >> 172.21.15.40:0/3875382181 conn(0x7f3a8809fb20 msgr2=0x7f3a8809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.655+0000 7f3a8df2a700 1 -- 172.21.15.40:0/3875382181 shutdown_connections 2023-09-30T22:31:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.655+0000 7f3a8df2a700 1 -- 172.21.15.40:0/3875382181 wait complete. 2023-09-30T22:31:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.656+0000 7f3a8df2a700 1 Processor -- start 2023-09-30T22:31:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.656+0000 7f3a8df2a700 1 -- start start 2023-09-30T22:31:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.657+0000 7f3a8df2a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a8809d920 0x7f3a8811e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.657+0000 7f3a8df2a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a8809e400 0x7f3a8811ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.657+0000 7f3a8df2a700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a8811f2c0 0x7f3a881ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.657+0000 7f3a8df2a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a88122400 con 0x7f3a8809d920 2023-09-30T22:31:35.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.657+0000 7f3a8df2a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8809c9e0 con 0x7f3a8809e400 2023-09-30T22:31:35.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.657+0000 7f3a8df2a700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a880a3390 con 0x7f3a8811f2c0 2023-09-30T22:31:35.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.657+0000 7f3a877fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a8809d920 0x7f3a8811e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:35.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.657+0000 7f3a86ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a8809e400 0x7f3a8811ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:35.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.657+0000 7f3a877fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a8809d920 0x7f3a8811e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47332/0 (socket says 172.21.15.40:47332) 2023-09-30T22:31:35.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.657+0000 7f3a877fe700 1 -- 172.21.15.40:0/3180368073 learned_addr learned my addr 172.21.15.40:0/3180368073 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:35.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.657+0000 7f3a87fff700 1 --2- 172.21.15.40:0/3180368073 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a8811f2c0 0x7f3a881ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:35.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.657+0000 7f3a86ffd700 1 -- 172.21.15.40:0/3180368073 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a8811f2c0 msgr2=0x7f3a881ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:35.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.657+0000 7f3a86ffd700 1 --2- 172.21.15.40:0/3180368073 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a8811f2c0 0x7f3a881ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.657+0000 7f3a86ffd700 1 -- 172.21.15.40:0/3180368073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a8809d920 msgr2=0x7f3a8811e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:35.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.657+0000 7f3a86ffd700 1 --2- 172.21.15.40:0/3180368073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a8809d920 0x7f3a8811e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.657+0000 7f3a86ffd700 1 -- 172.21.15.40:0/3180368073 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7c0094a0 con 0x7f3a8809e400 2023-09-30T22:31:35.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.658+0000 7f3a86ffd700 1 --2- 172.21.15.40:0/3180368073 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a8809e400 0x7f3a8811ed80 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c009840 tx=0x7f3a7c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:35.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.658+0000 7f3a6ffff700 1 -- 172.21.15.40:0/3180368073 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c0036a0 con 0x7f3a8809e400 2023-09-30T22:31:35.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.658+0000 7f3a6ffff700 1 -- 172.21.15.40:0/3180368073 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7c01f070 con 0x7f3a8809e400 2023-09-30T22:31:35.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.658+0000 7f3a8df2a700 1 -- 172.21.15.40:0/3180368073 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a88121af0 con 0x7f3a8809e400 2023-09-30T22:31:35.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.658+0000 7f3a6ffff700 1 -- 172.21.15.40:0/3180368073 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c003a60 con 0x7f3a8809e400 2023-09-30T22:31:35.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.658+0000 7f3a8df2a700 1 -- 172.21.15.40:0/3180368073 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a88122080 con 0x7f3a8809e400 2023-09-30T22:31:35.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.659+0000 7f3a6ffff700 1 -- 172.21.15.40:0/3180368073 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3a7c003bc0 con 0x7f3a8809e400 2023-09-30T22:31:35.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.659+0000 7f3a8df2a700 1 -- 172.21.15.40:0/3180368073 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a680052e0 con 0x7f3a8809e400 2023-09-30T22:31:35.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.659+0000 7f3a6ffff700 1 -- 172.21.15.40:0/3180368073 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3a7c021070 con 0x7f3a8809e400 2023-09-30T22:31:35.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.668+0000 7f3a6ffff700 1 -- 172.21.15.40:0/3180368073 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3a7c0253e0 con 0x7f3a8809e400 2023-09-30T22:31:35.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.691+0000 7f507c24e700 1 Processor -- start 2023-09-30T22:31:35.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.691+0000 7f507c24e700 1 -- start start 2023-09-30T22:31:35.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.692+0000 7f507c24e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f507409d450 0x7f507409d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:35.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.692+0000 7f507c24e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f507409dd60 0x7f50741301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:35.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.692+0000 7f507c24e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5074130700 0x7f5074130b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:35.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.692+0000 7f507c24e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f507409e8b0 con 0x7f507409dd60 2023-09-30T22:31:35.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.692+0000 7f507c24e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f507409c3b0 con 0x7f5074130700 2023-09-30T22:31:35.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.692+0000 7f507c24e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f507409a6b0 con 0x7f507409d450 2023-09-30T22:31:35.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.692+0000 7f5079fea700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f507409d450 0x7f507409d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:35.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.692+0000 7f5079fea700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f507409d450 0x7f507409d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48104/0 (socket says 172.21.15.40:48104) 2023-09-30T22:31:35.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.692+0000 7f50797e9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f507409dd60 0x7f50741301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:35.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.692+0000 7f5079fea700 1 -- 172.21.15.40:0/4234868698 learned_addr learned my addr 172.21.15.40:0/4234868698 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:35.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.692+0000 7f507a7eb700 1 --2- 172.21.15.40:0/4234868698 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5074130700 0x7f5074130b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:35.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.692+0000 7f50797e9700 1 -- 172.21.15.40:0/4234868698 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f507409d450 msgr2=0x7f507409d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:35.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.692+0000 7f50797e9700 1 --2- 172.21.15.40:0/4234868698 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f507409d450 0x7f507409d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.692+0000 7f50797e9700 1 -- 172.21.15.40:0/4234868698 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5074130700 msgr2=0x7f5074130b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:35.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.692+0000 7f50797e9700 1 --2- 172.21.15.40:0/4234868698 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5074130700 0x7f5074130b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.692+0000 7f50797e9700 1 -- 172.21.15.40:0/4234868698 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f507409b4f0 con 0x7f507409dd60 2023-09-30T22:31:35.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.693+0000 7f50797e9700 1 --2- 172.21.15.40:0/4234868698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f507409dd60 0x7f50741301c0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f5064009840 tx=0x7f5064009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab378e10ebf84dc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:35.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.693+0000 7f5078fe8700 1 -- 172.21.15.40:0/4234868698 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5064017070 con 0x7f507409dd60 2023-09-30T22:31:35.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.693+0000 7f5078fe8700 1 -- 172.21.15.40:0/4234868698 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506400d040 con 0x7f507409dd60 2023-09-30T22:31:35.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.693+0000 7f5078fe8700 1 -- 172.21.15.40:0/4234868698 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5064006d50 con 0x7f507409dd60 2023-09-30T22:31:35.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.694+0000 7f507c24e700 1 -- 172.21.15.40:0/4234868698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f507409dd60 msgr2=0x7f50741301c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:35.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.694+0000 7f507c24e700 1 --2- 172.21.15.40:0/4234868698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f507409dd60 0x7f50741301c0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f5064009840 tx=0x7f5064009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:35.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.694+0000 7f507c24e700 1 -- 172.21.15.40:0/4234868698 shutdown_connections 2023-09-30T22:31:35.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.694+0000 7f507c24e700 1 --2- 172.21.15.40:0/4234868698 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f507409d450 0x7f507409d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.694+0000 7f507c24e700 1 --2- 172.21.15.40:0/4234868698 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5074130700 0x7f5074130b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.694+0000 7f507c24e700 1 --2- 172.21.15.40:0/4234868698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f507409dd60 0x7f50741301c0 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.694+0000 7f507c24e700 1 -- 172.21.15.40:0/4234868698 >> 172.21.15.40:0/4234868698 conn(0x7f50740a2a00 msgr2=0x7f50740a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:35.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.694+0000 7f507c24e700 1 -- 172.21.15.40:0/4234868698 shutdown_connections 2023-09-30T22:31:35.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.694+0000 7f507c24e700 1 -- 172.21.15.40:0/4234868698 wait complete. 2023-09-30T22:31:35.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.695+0000 7f507c24e700 1 Processor -- start 2023-09-30T22:31:35.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.695+0000 7f507c24e700 1 -- start start 2023-09-30T22:31:35.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.696+0000 7f507c24e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f507409d450 0x7f507411fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:35.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.696+0000 7f507c24e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f507409dd60 0x7f50741203d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:35.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.696+0000 7f507c24e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5074130700 0x7f50741c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:35.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.696+0000 7f507c24e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507412ffb0 con 0x7f5074130700 2023-09-30T22:31:35.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.696+0000 7f507c24e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5074122cd0 con 0x7f507409dd60 2023-09-30T22:31:35.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.696+0000 7f507c24e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f507411faa0 con 0x7f507409d450 2023-09-30T22:31:35.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.696+0000 7f5079fea700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f507409d450 0x7f507411fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:35.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.696+0000 7f5079fea700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f507409d450 0x7f507411fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48120/0 (socket says 172.21.15.40:48120) 2023-09-30T22:31:35.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.696+0000 7f5079fea700 1 -- 172.21.15.40:0/2763464078 learned_addr learned my addr 172.21.15.40:0/2763464078 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:35.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.696+0000 7f507a7eb700 1 --2- 172.21.15.40:0/2763464078 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5074130700 0x7f50741c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:35.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.696+0000 7f50797e9700 1 --2- 172.21.15.40:0/2763464078 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f507409dd60 0x7f50741203d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:35.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.697+0000 7f5079fea700 1 -- 172.21.15.40:0/2763464078 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f507409dd60 msgr2=0x7f50741203d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:35.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.697+0000 7f5079fea700 1 --2- 172.21.15.40:0/2763464078 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f507409dd60 0x7f50741203d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.697+0000 7f5079fea700 1 -- 172.21.15.40:0/2763464078 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5074130700 msgr2=0x7f50741c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:35.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.697+0000 7f5079fea700 1 --2- 172.21.15.40:0/2763464078 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5074130700 0x7f50741c8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.697+0000 7f5079fea700 1 -- 172.21.15.40:0/2763464078 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50640094a0 con 0x7f507409d450 2023-09-30T22:31:35.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.697+0000 7f507a7eb700 1 --2- 172.21.15.40:0/2763464078 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5074130700 0x7f50741c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:35.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.697+0000 7f5079fea700 1 --2- 172.21.15.40:0/2763464078 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f507409d450 0x7f507411fe90 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f507000ed40 tx=0x7f507000d630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:35.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.697+0000 7f506a7fc700 1 -- 172.21.15.40:0/2763464078 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507000dd90 con 0x7f507409d450 2023-09-30T22:31:35.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.697+0000 7f506a7fc700 1 -- 172.21.15.40:0/2763464078 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5070010440 con 0x7f507409d450 2023-09-30T22:31:35.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.697+0000 7f506a7fc700 1 -- 172.21.15.40:0/2763464078 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50700107d0 con 0x7f507409d450 2023-09-30T22:31:35.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.697+0000 7f507c24e700 1 -- 172.21.15.40:0/2763464078 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f507409b000 con 0x7f507409d450 2023-09-30T22:31:35.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.697+0000 7f507c24e700 1 -- 172.21.15.40:0/2763464078 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50740a1a30 con 0x7f507409d450 2023-09-30T22:31:35.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.699+0000 7f507c24e700 1 -- 172.21.15.40:0/2763464078 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5074062380 con 0x7f507409d450 2023-09-30T22:31:35.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.699+0000 7f506a7fc700 1 -- 172.21.15.40:0/2763464078 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5070010930 con 0x7f507409d450 2023-09-30T22:31:35.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.699+0000 7f506a7fc700 1 -- 172.21.15.40:0/2763464078 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f50700400e0 con 0x7f507409d450 2023-09-30T22:31:35.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.700+0000 7f74bafec700 1 Processor -- start 2023-09-30T22:31:35.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.700+0000 7f74bafec700 1 -- start start 2023-09-30T22:31:35.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.700+0000 7f74bafec700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74b4136bf0 0x7f74b4138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:35.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.700+0000 7f74bafec700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f74b4139510 0x7f74b413b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:35.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.700+0000 7f74bafec700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b40a2600 con 0x7f74b409c890 2023-09-30T22:31:35.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.700+0000 7f74bafec700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b40a29d0 con 0x7f74b4139510 2023-09-30T22:31:35.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.700+0000 7f74bafec700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b409fb40 con 0x7f74b4136bf0 2023-09-30T22:31:35.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.701+0000 7f74b3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74b4136bf0 0x7f74b4138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:35.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.701+0000 7f74b3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74b4136bf0 0x7f74b4138fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:51414/0 (socket says 172.21.15.40:51414) 2023-09-30T22:31:35.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.701+0000 7f74b3fff700 1 -- 172.21.15.40:0/3584855238 learned_addr learned my addr 172.21.15.40:0/3584855238 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:35.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.701+0000 7f74b3fff700 1 -- 172.21.15.40:0/3584855238 >> v2:172.21.15.40:3300/0 conn(0x7f74b4139510 msgr2=0x7f74b413b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:35.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.701+0000 7f74b3fff700 1 --2- 172.21.15.40:0/3584855238 >> v2:172.21.15.40:3300/0 conn(0x7f74b4139510 0x7f74b413b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.701+0000 7f74b3fff700 1 -- 172.21.15.40:0/3584855238 >> v1:172.21.15.40:6789/0 conn(0x7f74b409c890 legacy=0x7f74b409cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:35.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.701+0000 7f74b3fff700 1 -- 172.21.15.40:0/3584855238 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b409d370 con 0x7f74b4136bf0 2023-09-30T22:31:35.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.701+0000 7f74b3fff700 1 --2- 172.21.15.40:0/3584855238 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74b4136bf0 0x7f74b4138fd0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f74a00098f0 tx=0x7f74a0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b51de0aa249cb61c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:35.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.701+0000 7f74b37fe700 1 -- 172.21.15.40:0/3584855238 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a0004230 con 0x7f74b4136bf0 2023-09-30T22:31:35.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.701+0000 7f74b37fe700 1 -- 172.21.15.40:0/3584855238 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a0004390 con 0x7f74b4136bf0 2023-09-30T22:31:35.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.701+0000 7f74b37fe700 1 -- 172.21.15.40:0/3584855238 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a00036a0 con 0x7f74b4136bf0 2023-09-30T22:31:35.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.702+0000 7f74bafec700 1 -- 172.21.15.40:0/3584855238 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74b4136bf0 msgr2=0x7f74b4138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:35.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.702+0000 7f74bafec700 1 --2- 172.21.15.40:0/3584855238 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74b4136bf0 0x7f74b4138fd0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f74a00098f0 tx=0x7f74a0009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:35.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.702+0000 7f74bafec700 1 -- 172.21.15.40:0/3584855238 shutdown_connections 2023-09-30T22:31:35.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.702+0000 7f74bafec700 1 --2- 172.21.15.40:0/3584855238 >> v2:172.21.15.40:3300/0 conn(0x7f74b4139510 0x7f74b413b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.702+0000 7f74bafec700 1 --2- 172.21.15.40:0/3584855238 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74b4136bf0 0x7f74b4138fd0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.702+0000 7f74bafec700 1 -- 172.21.15.40:0/3584855238 >> 172.21.15.40:0/3584855238 conn(0x7f74b40a7080 msgr2=0x7f74b40a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:35.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.703+0000 7f74bafec700 1 -- 172.21.15.40:0/3584855238 shutdown_connections 2023-09-30T22:31:35.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.703+0000 7f74bafec700 1 -- 172.21.15.40:0/3584855238 wait complete. 2023-09-30T22:31:35.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.704+0000 7f74bafec700 1 Processor -- start 2023-09-30T22:31:35.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.704+0000 7f74bafec700 1 -- start start 2023-09-30T22:31:35.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.705+0000 7f74bafec700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74b409c890 0x7f74b406e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:35.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.705+0000 7f74bafec700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f74b4136bf0 0x7f74b406e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:35.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.705+0000 7f74bafec700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74b4139510 0x7f74b406eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:35.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.705+0000 7f74bafec700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b406fc60 con 0x7f74b409c890 2023-09-30T22:31:35.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.705+0000 7f74bafec700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b4138fe0 con 0x7f74b4139510 2023-09-30T22:31:35.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.705+0000 7f74bafec700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74b4071900 con 0x7f74b4136bf0 2023-09-30T22:31:35.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.705+0000 7f74b8d88700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74b409c890 0x7f74b406e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:35.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.705+0000 7f74b9589700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74b4139510 0x7f74b406eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:35.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.705+0000 7f74b8d88700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74b409c890 0x7f74b406e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47364/0 (socket says 172.21.15.40:47364) 2023-09-30T22:31:35.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.705+0000 7f74b9589700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74b4139510 0x7f74b406eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:51420/0 (socket says 172.21.15.40:51420) 2023-09-30T22:31:35.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.705+0000 7f74b8d88700 1 -- 172.21.15.40:0/1284003214 learned_addr learned my addr 172.21.15.40:0/1284003214 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:35.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.705+0000 7f74b9589700 1 -- 172.21.15.40:0/1284003214 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f74b4136bf0 msgr2=0x7f74b406e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:35.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.705+0000 7f74b9589700 1 --2- 172.21.15.40:0/1284003214 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f74b4136bf0 0x7f74b406e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.705+0000 7f74b9589700 1 -- 172.21.15.40:0/1284003214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74b409c890 msgr2=0x7f74b406e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:35.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.705+0000 7f74b9589700 1 --2- 172.21.15.40:0/1284003214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74b409c890 0x7f74b406e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.705+0000 7f74b9589700 1 -- 172.21.15.40:0/1284003214 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a0009550 con 0x7f74b4139510 2023-09-30T22:31:35.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.705+0000 7f74b8d88700 1 --2- 172.21.15.40:0/1284003214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74b409c890 0x7f74b406e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:35.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.706+0000 7f74b9589700 1 --2- 172.21.15.40:0/1284003214 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74b4139510 0x7f74b406eb60 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f74b40a0df0 tx=0x7f74ac009ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:35.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.706+0000 7f74b17fa700 1 -- 172.21.15.40:0/1284003214 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac00cbb0 con 0x7f74b4139510 2023-09-30T22:31:35.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.706+0000 7f74b17fa700 1 -- 172.21.15.40:0/1284003214 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ac00cd30 con 0x7f74b4139510 2023-09-30T22:31:35.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.706+0000 7f74b17fa700 1 -- 172.21.15.40:0/1284003214 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac00cea0 con 0x7f74b4139510 2023-09-30T22:31:35.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.706+0000 7f74bafec700 1 -- 172.21.15.40:0/1284003214 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b409ecf0 con 0x7f74b4139510 2023-09-30T22:31:35.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.706+0000 7f74bafec700 1 -- 172.21.15.40:0/1284003214 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b412b7e0 con 0x7f74b4139510 2023-09-30T22:31:35.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.707+0000 7f74bafec700 1 -- 172.21.15.40:0/1284003214 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b4071640 con 0x7f74b4139510 2023-09-30T22:31:35.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.707+0000 7f74b17fa700 1 -- 172.21.15.40:0/1284003214 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f74ac01d3b0 con 0x7f74b4139510 2023-09-30T22:31:35.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.708+0000 7f74b17fa700 1 -- 172.21.15.40:0/1284003214 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f74ac006e40 con 0x7f74b4139510 2023-09-30T22:31:35.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.708+0000 7f506a7fc700 1 -- 172.21.15.40:0/2763464078 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f50700168f0 con 0x7f507409d450 2023-09-30T22:31:35.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.712+0000 7f74b17fa700 1 -- 172.21.15.40:0/1284003214 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f74ac01c360 con 0x7f74b4139510 2023-09-30T22:31:35.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.753+0000 7fea4d84b700 1 Processor -- start 2023-09-30T22:31:35.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.753+0000 7fea4d84b700 1 -- start start 2023-09-30T22:31:35.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.754+0000 7fea4d84b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea4809df30 0x7fea48135400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:35.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.754+0000 7fea4d84b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fea48135940 0x7fea48137d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:35.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.754+0000 7fea4d84b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea4809e8b0 con 0x7fea4809d450 2023-09-30T22:31:35.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.754+0000 7fea4d84b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea4809c3b0 con 0x7fea48135940 2023-09-30T22:31:35.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.754+0000 7fea4d84b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea4809a6b0 con 0x7fea4809df30 2023-09-30T22:31:35.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.754+0000 7fea46ffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fea4809d450 0x7fea4809d820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:35976/0 (socket says 172.21.15.40:35976) 2023-09-30T22:31:35.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.754+0000 7fea46ffd700 1 -- 172.21.15.40:0/1017852061 learned_addr learned my addr 172.21.15.40:0/1017852061 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:35.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.754+0000 7fea477fe700 1 --2- 172.21.15.40:0/1017852061 >> v2:172.21.15.40:3300/0 conn(0x7fea48135940 0x7fea48137d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:35.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.755+0000 7fea477fe700 1 -- 172.21.15.40:0/1017852061 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea4809df30 msgr2=0x7fea48135400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:35.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.755+0000 7fea477fe700 1 --2- 172.21.15.40:0/1017852061 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea4809df30 0x7fea48135400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.755+0000 7fea477fe700 1 -- 172.21.15.40:0/1017852061 >> v1:172.21.15.40:6789/0 conn(0x7fea4809d450 legacy=0x7fea4809d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:35.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.755+0000 7fea45ffb700 1 -- 172.21.15.40:0/1017852061 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685090852 0 0) 0x7fea4809e8b0 con 0x7fea4809d450 2023-09-30T22:31:35.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.755+0000 7fea477fe700 1 -- 172.21.15.40:0/1017852061 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4809b4f0 con 0x7fea48135940 2023-09-30T22:31:35.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.755+0000 7fea477fe700 1 --2- 172.21.15.40:0/1017852061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea48135940 0x7fea48137d20 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fea40009d90 tx=0x7fea4000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40f2b9a77b2b687d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:35.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.755+0000 7fea45ffb700 1 -- 172.21.15.40:0/1017852061 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4000e070 con 0x7fea48135940 2023-09-30T22:31:35.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.755+0000 7fea45ffb700 1 -- 172.21.15.40:0/1017852061 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4000bbd0 con 0x7fea48135940 2023-09-30T22:31:35.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.755+0000 7fea45ffb700 1 -- 172.21.15.40:0/1017852061 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea40012430 con 0x7fea48135940 2023-09-30T22:31:35.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.756+0000 7fea4d84b700 1 -- 172.21.15.40:0/1017852061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea48135940 msgr2=0x7fea48137d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:35.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.756+0000 7fea4d84b700 1 --2- 172.21.15.40:0/1017852061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea48135940 0x7fea48137d20 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fea40009d90 tx=0x7fea4000b330 comp rx=0 tx=0).stop 2023-09-30T22:31:35.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.756+0000 7fea4d84b700 1 -- 172.21.15.40:0/1017852061 shutdown_connections 2023-09-30T22:31:35.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.756+0000 7fea4d84b700 1 --2- 172.21.15.40:0/1017852061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea48135940 0x7fea48137d20 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.756+0000 7fea4d84b700 1 --2- 172.21.15.40:0/1017852061 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea4809df30 0x7fea48135400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.756+0000 7fea4d84b700 1 -- 172.21.15.40:0/1017852061 >> 172.21.15.40:0/1017852061 conn(0x7fea480a2a00 msgr2=0x7fea480a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:35.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.756+0000 7fea4d84b700 1 -- 172.21.15.40:0/1017852061 shutdown_connections 2023-09-30T22:31:35.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.756+0000 7fea4d84b700 1 -- 172.21.15.40:0/1017852061 wait complete. 2023-09-30T22:31:35.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.757+0000 7fea4d84b700 1 Processor -- start 2023-09-30T22:31:35.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.757+0000 7fea4d84b700 1 -- start start 2023-09-30T22:31:35.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.758+0000 7fea4d84b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea4809d450 0x7fea4813a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:35.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.758+0000 7fea4d84b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fea4809df30 0x7fea4813a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:35.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.758+0000 7fea4d84b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea48135940 0x7fea4813ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:35.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.758+0000 7fea4d84b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4812dc20 con 0x7fea48135940 2023-09-30T22:31:35.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.758+0000 7fea4d84b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea4812f2b0 con 0x7fea4809df30 2023-09-30T22:31:35.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.758+0000 7fea4d84b700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea480a1a50 con 0x7fea4809d450 2023-09-30T22:31:35.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.758+0000 7fea46ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea4809d450 0x7fea4813a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:35.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.758+0000 7fea477fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea48135940 0x7fea4813ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:35.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.758+0000 7fea46ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea4809d450 0x7fea4813a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48148/0 (socket says 172.21.15.40:48148) 2023-09-30T22:31:35.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.758+0000 7fea477fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea48135940 0x7fea4813ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47384/0 (socket says 172.21.15.40:47384) 2023-09-30T22:31:35.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.758+0000 7fea46ffd700 1 -- 172.21.15.40:0/2501182338 learned_addr learned my addr 172.21.15.40:0/2501182338 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:35.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.758+0000 7fea477fe700 1 -- 172.21.15.40:0/2501182338 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea4809d450 msgr2=0x7fea4813a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:35.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.758+0000 7fea477fe700 1 --2- 172.21.15.40:0/2501182338 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea4809d450 0x7fea4813a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.758+0000 7fea477fe700 1 -- 172.21.15.40:0/2501182338 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fea4809df30 msgr2=0x7fea4813a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:35.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.758+0000 7fea477fe700 1 --2- 172.21.15.40:0/2501182338 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fea4809df30 0x7fea4813a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.758+0000 7fea477fe700 1 -- 172.21.15.40:0/2501182338 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea40009a70 con 0x7fea48135940 2023-09-30T22:31:35.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.758+0000 7fea46ffd700 1 --2- 172.21.15.40:0/2501182338 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea4809d450 0x7fea4813a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:35.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.759+0000 7fea477fe700 1 --2- 172.21.15.40:0/2501182338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea48135940 0x7fea4813ab50 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fea40009d90 tx=0x7fea40004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:35.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.759+0000 7fea2ffff700 1 -- 172.21.15.40:0/2501182338 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea40012430 con 0x7fea48135940 2023-09-30T22:31:35.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.759+0000 7fea2ffff700 1 -- 172.21.15.40:0/2501182338 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea40020070 con 0x7fea48135940 2023-09-30T22:31:35.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.759+0000 7fea4d84b700 1 -- 172.21.15.40:0/2501182338 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea4809c5d0 con 0x7fea48135940 2023-09-30T22:31:35.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.759+0000 7fea2ffff700 1 -- 172.21.15.40:0/2501182338 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4001be80 con 0x7fea48135940 2023-09-30T22:31:35.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.759+0000 7fea4d84b700 1 -- 172.21.15.40:0/2501182338 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea48135670 con 0x7fea48135940 2023-09-30T22:31:35.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.760+0000 7fea2ffff700 1 -- 172.21.15.40:0/2501182338 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fea4001c400 con 0x7fea48135940 2023-09-30T22:31:35.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.760+0000 7fea2ffff700 1 -- 172.21.15.40:0/2501182338 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fea40040f70 con 0x7fea48135940 2023-09-30T22:31:35.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.760+0000 7fea4d84b700 1 -- 172.21.15.40:0/2501182338 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea48062380 con 0x7fea48135940 2023-09-30T22:31:35.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.769+0000 7fea2ffff700 1 -- 172.21.15.40:0/2501182338 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fea40012e40 con 0x7fea48135940 2023-09-30T22:31:35.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.875+0000 7f3a8df2a700 1 -- 172.21.15.40:0/3180368073 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3a68005590 con 0x7f3a8809e400 2023-09-30T22:31:35.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.876+0000 7f3a6ffff700 1 -- 172.21.15.40:0/3180368073 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3a7c015020 con 0x7f3a8809e400 2023-09-30T22:31:35.877 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:35.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.878+0000 7f3a8df2a700 1 -- 172.21.15.40:0/3180368073 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a8809e400 msgr2=0x7f3a8811ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:35.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.878+0000 7f3a8df2a700 1 --2- 172.21.15.40:0/3180368073 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a8809e400 0x7f3a8811ed80 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c009840 tx=0x7f3a7c004750 comp rx=0 tx=0).stop 2023-09-30T22:31:35.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.878+0000 7f3a8df2a700 1 -- 172.21.15.40:0/3180368073 shutdown_connections 2023-09-30T22:31:35.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.878+0000 7f3a8df2a700 1 --2- 172.21.15.40:0/3180368073 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3a8811f2c0 0x7f3a881ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.878+0000 7f3a8df2a700 1 --2- 172.21.15.40:0/3180368073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a8809d920 0x7f3a8811e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.878+0000 7f3a8df2a700 1 --2- 172.21.15.40:0/3180368073 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a8809e400 0x7f3a8811ed80 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.878+0000 7f3a8df2a700 1 -- 172.21.15.40:0/3180368073 >> 172.21.15.40:0/3180368073 conn(0x7f3a8809fb20 msgr2=0x7f3a8806e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:35.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.878+0000 7f3a8df2a700 1 -- 172.21.15.40:0/3180368073 shutdown_connections 2023-09-30T22:31:35.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.878+0000 7f3a8df2a700 1 -- 172.21.15.40:0/3180368073 wait complete. 2023-09-30T22:31:35.890 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:35.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.918+0000 7f74bafec700 1 -- 172.21.15.40:0/1284003214 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f74b4062380 con 0x7f74b4139510 2023-09-30T22:31:35.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.918+0000 7f74b17fa700 1 -- 172.21.15.40:0/1284003214 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f74ac019030 con 0x7f74b4139510 2023-09-30T22:31:35.918 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:35.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.920+0000 7f74bafec700 1 -- 172.21.15.40:0/1284003214 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74b4139510 msgr2=0x7f74b406eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:35.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.920+0000 7f74bafec700 1 --2- 172.21.15.40:0/1284003214 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74b4139510 0x7f74b406eb60 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f74b40a0df0 tx=0x7f74ac009ed0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.920+0000 7f74bafec700 1 -- 172.21.15.40:0/1284003214 shutdown_connections 2023-09-30T22:31:35.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.920+0000 7f74bafec700 1 --2- 172.21.15.40:0/1284003214 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74b4139510 0x7f74b406eb60 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.920+0000 7f74bafec700 1 --2- 172.21.15.40:0/1284003214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74b409c890 0x7f74b406e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.920+0000 7f74bafec700 1 --2- 172.21.15.40:0/1284003214 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f74b4136bf0 0x7f74b406e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.920+0000 7f74bafec700 1 -- 172.21.15.40:0/1284003214 >> 172.21.15.40:0/1284003214 conn(0x7f74b40a7080 msgr2=0x7f74b409b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:35.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.920+0000 7f74bafec700 1 -- 172.21.15.40:0/1284003214 shutdown_connections 2023-09-30T22:31:35.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.920+0000 7f74bafec700 1 -- 172.21.15.40:0/1284003214 wait complete. 2023-09-30T22:31:35.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.925+0000 7f507c24e700 1 -- 172.21.15.40:0/2763464078 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5074122e10 con 0x7f507409d450 2023-09-30T22:31:35.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.925+0000 7f506a7fc700 1 -- 172.21.15.40:0/2763464078 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f507001d020 con 0x7f507409d450 2023-09-30T22:31:35.925 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:35.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.928+0000 7f507c24e700 1 -- 172.21.15.40:0/2763464078 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f507409d450 msgr2=0x7f507411fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:35.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.928+0000 7f507c24e700 1 --2- 172.21.15.40:0/2763464078 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f507409d450 0x7f507411fe90 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f507000ed40 tx=0x7f507000d630 comp rx=0 tx=0).stop 2023-09-30T22:31:35.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.929+0000 7f507c24e700 1 -- 172.21.15.40:0/2763464078 shutdown_connections 2023-09-30T22:31:35.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.929+0000 7f507c24e700 1 --2- 172.21.15.40:0/2763464078 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f507409d450 0x7f507411fe90 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.929+0000 7f507c24e700 1 --2- 172.21.15.40:0/2763464078 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5074130700 0x7f50741c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.929+0000 7f507c24e700 1 --2- 172.21.15.40:0/2763464078 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f507409dd60 0x7f50741203d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.929+0000 7f507c24e700 1 -- 172.21.15.40:0/2763464078 >> 172.21.15.40:0/2763464078 conn(0x7f50740a2a00 msgr2=0x7f50741b7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:35.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.931+0000 7f507c24e700 1 -- 172.21.15.40:0/2763464078 shutdown_connections 2023-09-30T22:31:35.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.931+0000 7f507c24e700 1 -- 172.21.15.40:0/2763464078 wait complete. 2023-09-30T22:31:35.934 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:35.947 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:35.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.977+0000 7fea4d84b700 1 -- 172.21.15.40:0/2501182338 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fea4812f090 con 0x7fea48135940 2023-09-30T22:31:35.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.977+0000 7fea2ffff700 1 -- 172.21.15.40:0/2501182338 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fea40011390 con 0x7fea48135940 2023-09-30T22:31:35.977 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:35.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.979+0000 7fea4d84b700 1 -- 172.21.15.40:0/2501182338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea48135940 msgr2=0x7fea4813ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:35.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.979+0000 7fea4d84b700 1 --2- 172.21.15.40:0/2501182338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea48135940 0x7fea4813ab50 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fea40009d90 tx=0x7fea40004ad0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.979+0000 7fea4d84b700 1 -- 172.21.15.40:0/2501182338 shutdown_connections 2023-09-30T22:31:35.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.979+0000 7fea4d84b700 1 --2- 172.21.15.40:0/2501182338 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fea4809d450 0x7fea4813a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.979+0000 7fea4d84b700 1 --2- 172.21.15.40:0/2501182338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea48135940 0x7fea4813ab50 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.979+0000 7fea4d84b700 1 --2- 172.21.15.40:0/2501182338 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fea4809df30 0x7fea4813a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:35.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.979+0000 7fea4d84b700 1 -- 172.21.15.40:0/2501182338 >> 172.21.15.40:0/2501182338 conn(0x7fea480a2a00 msgr2=0x7fea480a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:35.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.979+0000 7fea4d84b700 1 -- 172.21.15.40:0/2501182338 shutdown_connections 2023-09-30T22:31:35.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:35.979+0000 7fea4d84b700 1 -- 172.21.15.40:0/2501182338 wait complete. 2023-09-30T22:31:35.991 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:36.892 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:36.934 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:36.948 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:36.992 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:37.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.046+0000 7f7ad0cd5700 1 Processor -- start 2023-09-30T22:31:37.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.046+0000 7f7ad0cd5700 1 -- start start 2023-09-30T22:31:37.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.047+0000 7f7ad0cd5700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7acc13b130 0x7f7acc13d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.047+0000 7f7ad0cd5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7acc13da50 0x7f7acc13fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.047+0000 7f7ad0cd5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7acc137e20 con 0x7f7acc138250 2023-09-30T22:31:37.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.047+0000 7f7ad0cd5700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7acc138d30 con 0x7f7acc13b130 2023-09-30T22:31:37.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.047+0000 7f7ad0cd5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc138050 con 0x7f7acc13da50 2023-09-30T22:31:37.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.047+0000 7f7ac9d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7acc13b130 0x7f7acc13d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.047+0000 7f7acad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7acc13da50 0x7f7acc13fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.047+0000 7f7ac9d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7acc13b130 0x7f7acc13d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47392/0 (socket says 172.21.15.40:47392) 2023-09-30T22:31:37.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.047+0000 7f7ac9d9b700 1 -- 172.21.15.40:0/3512830224 learned_addr learned my addr 172.21.15.40:0/3512830224 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:37.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.048+0000 7f7acad9d700 1 -- 172.21.15.40:0/3512830224 >> v2:172.21.15.40:3300/0 conn(0x7f7acc13b130 msgr2=0x7f7acc13d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:37.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.048+0000 7f7acad9d700 1 --2- 172.21.15.40:0/3512830224 >> v2:172.21.15.40:3300/0 conn(0x7f7acc13b130 0x7f7acc13d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.048+0000 7f7acad9d700 1 -- 172.21.15.40:0/3512830224 >> v1:172.21.15.40:6789/0 conn(0x7f7acc138250 legacy=0x7f7acc138620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.048+0000 7f7acad9d700 1 -- 172.21.15.40:0/3512830224 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7acc09b010 con 0x7f7acc13da50 2023-09-30T22:31:37.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.048+0000 7f7acad9d700 1 --2- 172.21.15.40:0/3512830224 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7acc13da50 0x7f7acc13fe30 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4009d90 tx=0x7f7ac400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=849e9b697f623c93 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:37.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.048+0000 7f7ac959a700 1 -- 172.21.15.40:0/3512830224 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac400e070 con 0x7f7acc13da50 2023-09-30T22:31:37.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.048+0000 7f7ac959a700 1 -- 172.21.15.40:0/3512830224 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac400bb20 con 0x7f7acc13da50 2023-09-30T22:31:37.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.048+0000 7f7ac959a700 1 -- 172.21.15.40:0/3512830224 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac4012430 con 0x7f7acc13da50 2023-09-30T22:31:37.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.049+0000 7f7ad0cd5700 1 -- 172.21.15.40:0/3512830224 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7acc13da50 msgr2=0x7f7acc13fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.049+0000 7f7ad0cd5700 1 --2- 172.21.15.40:0/3512830224 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7acc13da50 0x7f7acc13fe30 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4009d90 tx=0x7f7ac400b330 comp rx=0 tx=0).stop 2023-09-30T22:31:37.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.050+0000 7f7ad0cd5700 1 -- 172.21.15.40:0/3512830224 shutdown_connections 2023-09-30T22:31:37.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.050+0000 7f7ad0cd5700 1 --2- 172.21.15.40:0/3512830224 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7acc13da50 0x7f7acc13fe30 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.050+0000 7f7ad0cd5700 1 --2- 172.21.15.40:0/3512830224 >> v2:172.21.15.40:3300/0 conn(0x7f7acc13b130 0x7f7acc13d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.050+0000 7f7ad0cd5700 1 -- 172.21.15.40:0/3512830224 >> 172.21.15.40:0/3512830224 conn(0x7f7acc0a2a00 msgr2=0x7f7acc0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:37.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.050+0000 7f7ad0cd5700 1 -- 172.21.15.40:0/3512830224 shutdown_connections 2023-09-30T22:31:37.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.050+0000 7f7ad0cd5700 1 -- 172.21.15.40:0/3512830224 wait complete. 2023-09-30T22:31:37.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.051+0000 7f7ad0cd5700 1 Processor -- start 2023-09-30T22:31:37.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.051+0000 7f7ad0cd5700 1 -- start start 2023-09-30T22:31:37.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.052+0000 7f7ad0cd5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7acc138250 0x7f7acc06f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.052+0000 7f7ad0cd5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7acc13b130 0x7f7acc06fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.052+0000 7f7ad0cd5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7acc13da50 0x7f7acc06ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.052+0000 7f7ad0cd5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc122bc0 con 0x7f7acc13da50 2023-09-30T22:31:37.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.052+0000 7f7ad0cd5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc122450 con 0x7f7acc138250 2023-09-30T22:31:37.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.052+0000 7f7ad0cd5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc122da0 con 0x7f7acc13b130 2023-09-30T22:31:37.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.052+0000 7f7aca59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7acc138250 0x7f7acc06f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.052+0000 7f7aca59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7acc138250 0x7f7acc06f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:51448/0 (socket says 172.21.15.40:51448) 2023-09-30T22:31:37.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.052+0000 7f7aca59c700 1 -- 172.21.15.40:0/4102364224 learned_addr learned my addr 172.21.15.40:0/4102364224 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:37.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.052+0000 7f7acad9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7acc13da50 0x7f7acc06ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.052+0000 7f7ac9d9b700 1 --2- 172.21.15.40:0/4102364224 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7acc13b130 0x7f7acc06fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.053+0000 7f7acad9d700 1 -- 172.21.15.40:0/4102364224 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7acc13b130 msgr2=0x7f7acc06fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.053+0000 7f7acad9d700 1 --2- 172.21.15.40:0/4102364224 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7acc13b130 0x7f7acc06fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.053+0000 7f7acad9d700 1 -- 172.21.15.40:0/4102364224 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7acc138250 msgr2=0x7f7acc06f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.053+0000 7f7acad9d700 1 --2- 172.21.15.40:0/4102364224 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7acc138250 0x7f7acc06f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.053+0000 7f7acad9d700 1 -- 172.21.15.40:0/4102364224 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac4009a70 con 0x7f7acc13da50 2023-09-30T22:31:37.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.053+0000 7f7acad9d700 1 --2- 172.21.15.40:0/4102364224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7acc13da50 0x7f7acc06ff60 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f7acc067f50 tx=0x7f7ac4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:37.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.053+0000 7f7abaffd700 1 -- 172.21.15.40:0/4102364224 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac4012430 con 0x7f7acc13da50 2023-09-30T22:31:37.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.053+0000 7f7abaffd700 1 -- 172.21.15.40:0/4102364224 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac4020070 con 0x7f7acc13da50 2023-09-30T22:31:37.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.053+0000 7f7ad0cd5700 1 -- 172.21.15.40:0/4102364224 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7acc13d5b0 con 0x7f7acc13da50 2023-09-30T22:31:37.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.053+0000 7f7abaffd700 1 -- 172.21.15.40:0/4102364224 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac4004040 con 0x7f7acc13da50 2023-09-30T22:31:37.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.053+0000 7f7ad0cd5700 1 -- 172.21.15.40:0/4102364224 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7acc123810 con 0x7f7acc13da50 2023-09-30T22:31:37.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.054+0000 7f7abaffd700 1 -- 172.21.15.40:0/4102364224 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7ac40041a0 con 0x7f7acc13da50 2023-09-30T22:31:37.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.055+0000 7f7ad0cd5700 1 -- 172.21.15.40:0/4102364224 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab00052e0 con 0x7f7acc13da50 2023-09-30T22:31:37.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.055+0000 7f7abaffd700 1 -- 172.21.15.40:0/4102364224 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f7ac4022070 con 0x7f7acc13da50 2023-09-30T22:31:37.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.060+0000 7f7abaffd700 1 -- 172.21.15.40:0/4102364224 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7ac4011bd0 con 0x7f7acc13da50 2023-09-30T22:31:37.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.084+0000 7f18fe653700 1 Processor -- start 2023-09-30T22:31:37.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.084+0000 7f18fe653700 1 -- start start 2023-09-30T22:31:37.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.084+0000 7f18fe653700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18f809d920 0x7f18f809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.084+0000 7f18fe653700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18f809e230 0x7f18f81343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.084+0000 7f18fe653700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18f809f940 con 0x7f18f809f0f0 2023-09-30T22:31:37.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.084+0000 7f18fe653700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f806b4c0 con 0x7f18f809e230 2023-09-30T22:31:37.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.084+0000 7f18fe653700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18f809a8f0 con 0x7f18f809d920 2023-09-30T22:31:37.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.084+0000 7f18f77fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f18f809f0f0 0x7f18f8133ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:35994/0 (socket says 172.21.15.40:35994) 2023-09-30T22:31:37.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.084+0000 7f18f77fe700 1 -- 172.21.15.40:0/980203605 learned_addr learned my addr 172.21.15.40:0/980203605 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:37.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.085+0000 7f18f7fff700 1 --2- 172.21.15.40:0/980203605 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18f809d920 0x7f18f809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.085+0000 7f18f6ffd700 1 -- 172.21.15.40:0/980203605 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 271486213 0 0) 0x7f18f809f940 con 0x7f18f809f0f0 2023-09-30T22:31:37.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.085+0000 7f18f6ffd700 1 -- 172.21.15.40:0/980203605 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18e00035b0 con 0x7f18f809f0f0 2023-09-30T22:31:37.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.085+0000 7f18f7fff700 1 -- 172.21.15.40:0/980203605 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18f809e230 msgr2=0x7f18f81343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:37.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.085+0000 7f18f7fff700 1 --2- 172.21.15.40:0/980203605 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18f809e230 0x7f18f81343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.085+0000 7f18f7fff700 1 -- 172.21.15.40:0/980203605 >> v1:172.21.15.40:6789/0 conn(0x7f18f809f0f0 legacy=0x7f18f8133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.085+0000 7f18f7fff700 1 -- 172.21.15.40:0/980203605 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f809f6e0 con 0x7f18f809d920 2023-09-30T22:31:37.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.085+0000 7f18f7fff700 1 --2- 172.21.15.40:0/980203605 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18f809d920 0x7f18f809dcf0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f18e8009880 tx=0x7f18e8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f906d01478767500 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:37.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.085+0000 7f18f6ffd700 1 -- 172.21.15.40:0/980203605 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e8005e30 con 0x7f18f809d920 2023-09-30T22:31:37.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.085+0000 7f18f6ffd700 1 -- 172.21.15.40:0/980203605 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e8006030 con 0x7f18f809d920 2023-09-30T22:31:37.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.085+0000 7f18f6ffd700 1 -- 172.21.15.40:0/980203605 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e80063c0 con 0x7f18f809d920 2023-09-30T22:31:37.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.086+0000 7f18fe653700 1 -- 172.21.15.40:0/980203605 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18f809d920 msgr2=0x7f18f809dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.086+0000 7f18fe653700 1 --2- 172.21.15.40:0/980203605 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18f809d920 0x7f18f809dcf0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f18e8009880 tx=0x7f18e8009b90 comp rx=0 tx=0).stop 2023-09-30T22:31:37.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.086+0000 7f18fe653700 1 -- 172.21.15.40:0/980203605 shutdown_connections 2023-09-30T22:31:37.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.086+0000 7f18fe653700 1 --2- 172.21.15.40:0/980203605 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18f809e230 0x7f18f81343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.086+0000 7f18fe653700 1 --2- 172.21.15.40:0/980203605 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18f809d920 0x7f18f809dcf0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.086+0000 7f18fe653700 1 -- 172.21.15.40:0/980203605 >> 172.21.15.40:0/980203605 conn(0x7f18f809fb20 msgr2=0x7f18f809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:37.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.086+0000 7f18fe653700 1 -- 172.21.15.40:0/980203605 shutdown_connections 2023-09-30T22:31:37.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.087+0000 7f18fe653700 1 -- 172.21.15.40:0/980203605 wait complete. 2023-09-30T22:31:37.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.088+0000 7f18fe653700 1 Processor -- start 2023-09-30T22:31:37.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.088+0000 7f18fe653700 1 -- start start 2023-09-30T22:31:37.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.089+0000 7f18fe653700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18f809d920 0x7f18f81226a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.089+0000 7f18fe653700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18f809e230 0x7f18f8122be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.089+0000 7f18fe653700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18f8123120 0x7f18f81ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.089+0000 7f18fe653700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f81261c0 con 0x7f18f8123120 2023-09-30T22:31:37.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.089+0000 7f18fe653700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f8125140 con 0x7f18f809d920 2023-09-30T22:31:37.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.089+0000 7f18fe653700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18f8125c20 con 0x7f18f809e230 2023-09-30T22:31:37.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.089+0000 7f18fcbf0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18f8123120 0x7f18f81ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.089+0000 7f18fcbf0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18f8123120 0x7f18f81ce9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47420/0 (socket says 172.21.15.40:47420) 2023-09-30T22:31:37.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.089+0000 7f18fcbf0700 1 -- 172.21.15.40:0/2612853803 learned_addr learned my addr 172.21.15.40:0/2612853803 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:37.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.089+0000 7f18f7fff700 1 --2- 172.21.15.40:0/2612853803 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18f809d920 0x7f18f81226a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.089+0000 7f18f77fe700 1 --2- 172.21.15.40:0/2612853803 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18f809e230 0x7f18f8122be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.089+0000 7f18fcbf0700 1 -- 172.21.15.40:0/2612853803 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18f809e230 msgr2=0x7f18f8122be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.089+0000 7f18fcbf0700 1 --2- 172.21.15.40:0/2612853803 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18f809e230 0x7f18f8122be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.089+0000 7f18fcbf0700 1 -- 172.21.15.40:0/2612853803 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18f809d920 msgr2=0x7f18f81226a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.089+0000 7f18fcbf0700 1 --2- 172.21.15.40:0/2612853803 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18f809d920 0x7f18f81226a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.089+0000 7f18fcbf0700 1 -- 172.21.15.40:0/2612853803 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e8009430 con 0x7f18f8123120 2023-09-30T22:31:37.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.090+0000 7f18fcbf0700 1 --2- 172.21.15.40:0/2612853803 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18f8123120 0x7f18f81ce9c0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f18f000b9a0 tx=0x7f18f000bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:37.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.090+0000 7f18f4ff9700 1 -- 172.21.15.40:0/2612853803 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f000c930 con 0x7f18f8123120 2023-09-30T22:31:37.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.090+0000 7f18fe653700 1 -- 172.21.15.40:0/2612853803 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18f80a2fb0 con 0x7f18f8123120 2023-09-30T22:31:37.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.090+0000 7f18f4ff9700 1 -- 172.21.15.40:0/2612853803 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f000cab0 con 0x7f18f8123120 2023-09-30T22:31:37.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.090+0000 7f18f4ff9700 1 -- 172.21.15.40:0/2612853803 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f000ce60 con 0x7f18f8123120 2023-09-30T22:31:37.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.090+0000 7f18fe653700 1 -- 172.21.15.40:0/2612853803 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f8133a70 con 0x7f18f8123120 2023-09-30T22:31:37.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.091+0000 7f18fe653700 1 -- 172.21.15.40:0/2612853803 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f8062380 con 0x7f18f8123120 2023-09-30T22:31:37.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.092+0000 7f18f4ff9700 1 -- 172.21.15.40:0/2612853803 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f18f0007370 con 0x7f18f8123120 2023-09-30T22:31:37.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.092+0000 7f18f4ff9700 1 -- 172.21.15.40:0/2612853803 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f18f0006e40 con 0x7f18f8123120 2023-09-30T22:31:37.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.097+0000 7f18f4ff9700 1 -- 172.21.15.40:0/2612853803 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f18f001c360 con 0x7f18f8123120 2023-09-30T22:31:37.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.149+0000 7efee28e4700 1 Processor -- start 2023-09-30T22:31:37.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.149+0000 7efee28e4700 1 -- start start 2023-09-30T22:31:37.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.150+0000 7efee28e4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efedc136c50 0x7efedc139030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.150+0000 7efee28e4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efedc139570 0x7efedc13b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.150+0000 7efee28e4700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efedc133940 con 0x7efedc133e00 2023-09-30T22:31:37.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.150+0000 7efee28e4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efedc09ab20 con 0x7efedc139570 2023-09-30T22:31:37.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.150+0000 7efee28e4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efedc09f0d0 con 0x7efedc136c50 2023-09-30T22:31:37.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.150+0000 7efedbfff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7efedc133e00 0x7efedc1341d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:36000/0 (socket says 172.21.15.40:36000) 2023-09-30T22:31:37.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.150+0000 7efedbfff700 1 -- 172.21.15.40:0/1449695421 learned_addr learned my addr 172.21.15.40:0/1449695421 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:37.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.150+0000 7efedb7fe700 1 --2- 172.21.15.40:0/1449695421 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efedc136c50 0x7efedc139030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.150+0000 7efee0e81700 1 --2- 172.21.15.40:0/1449695421 >> v2:172.21.15.40:3300/0 conn(0x7efedc139570 0x7efedc13b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.150+0000 7efedb7fe700 1 -- 172.21.15.40:0/1449695421 >> v2:172.21.15.40:3300/0 conn(0x7efedc139570 msgr2=0x7efedc13b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:37.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.150+0000 7efedb7fe700 1 --2- 172.21.15.40:0/1449695421 >> v2:172.21.15.40:3300/0 conn(0x7efedc139570 0x7efedc13b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.150+0000 7efedb7fe700 1 -- 172.21.15.40:0/1449695421 >> v1:172.21.15.40:6789/0 conn(0x7efedc133e00 legacy=0x7efedc1341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.150+0000 7efedaffd700 1 -- 172.21.15.40:0/1449695421 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3145548908 0 0) 0x7efedc133940 con 0x7efedc133e00 2023-09-30T22:31:37.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.151+0000 7efedb7fe700 1 -- 172.21.15.40:0/1449695421 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efedc133be0 con 0x7efedc136c50 2023-09-30T22:31:37.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.151+0000 7efedb7fe700 1 --2- 172.21.15.40:0/1449695421 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efedc136c50 0x7efedc139030 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7efed0009840 tx=0x7efed0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0fe8f9e6d16620f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:37.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.151+0000 7efedaffd700 1 -- 172.21.15.40:0/1449695421 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed0011830 con 0x7efedc136c50 2023-09-30T22:31:37.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.151+0000 7efedaffd700 1 -- 172.21.15.40:0/1449695421 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed0011990 con 0x7efedc136c50 2023-09-30T22:31:37.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.151+0000 7efedaffd700 1 -- 172.21.15.40:0/1449695421 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed0011d20 con 0x7efedc136c50 2023-09-30T22:31:37.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.152+0000 7efee28e4700 1 -- 172.21.15.40:0/1449695421 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efedc136c50 msgr2=0x7efedc139030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.152+0000 7efee28e4700 1 --2- 172.21.15.40:0/1449695421 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efedc136c50 0x7efedc139030 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7efed0009840 tx=0x7efed0009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:37.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.155+0000 7efee28e4700 1 -- 172.21.15.40:0/1449695421 shutdown_connections 2023-09-30T22:31:37.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.155+0000 7efee28e4700 1 --2- 172.21.15.40:0/1449695421 >> v2:172.21.15.40:3300/0 conn(0x7efedc139570 0x7efedc13b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.155+0000 7efee28e4700 1 --2- 172.21.15.40:0/1449695421 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efedc136c50 0x7efedc139030 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.155+0000 7efee28e4700 1 -- 172.21.15.40:0/1449695421 >> 172.21.15.40:0/1449695421 conn(0x7efedc0a2a00 msgr2=0x7efedc0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:37.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.155+0000 7efee28e4700 1 -- 172.21.15.40:0/1449695421 shutdown_connections 2023-09-30T22:31:37.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.155+0000 7efee28e4700 1 -- 172.21.15.40:0/1449695421 wait complete. 2023-09-30T22:31:37.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.156+0000 7efee28e4700 1 Processor -- start 2023-09-30T22:31:37.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.156+0000 7efee28e4700 1 -- start start 2023-09-30T22:31:37.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.156+0000 7efee28e4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efedc133e00 0x7efedc119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.156+0000 7efee28e4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efedc136c50 0x7efedc119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.157+0000 7efee28e4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efedc139570 0x7efedc119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.157+0000 7efee28e4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efedc12e210 con 0x7efedc136c50 2023-09-30T22:31:37.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.157+0000 7efee28e4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efedc1368e0 con 0x7efedc139570 2023-09-30T22:31:37.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.157+0000 7efee28e4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efedc131340 con 0x7efedc133e00 2023-09-30T22:31:37.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.157+0000 7efedbfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efedc133e00 0x7efedc119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.157+0000 7efedbfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efedc133e00 0x7efedc119050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48206/0 (socket says 172.21.15.40:48206) 2023-09-30T22:31:37.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.157+0000 7efedbfff700 1 -- 172.21.15.40:0/3965328892 learned_addr learned my addr 172.21.15.40:0/3965328892 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:37.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.157+0000 7efee0e81700 1 --2- 172.21.15.40:0/3965328892 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efedc139570 0x7efedc119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.157+0000 7efedb7fe700 1 --2- 172.21.15.40:0/3965328892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efedc136c50 0x7efedc119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.157+0000 7efedbfff700 1 -- 172.21.15.40:0/3965328892 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efedc139570 msgr2=0x7efedc119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.157+0000 7efedbfff700 1 --2- 172.21.15.40:0/3965328892 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efedc139570 0x7efedc119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.157+0000 7efedbfff700 1 -- 172.21.15.40:0/3965328892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efedc136c50 msgr2=0x7efedc119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.157+0000 7efedbfff700 1 --2- 172.21.15.40:0/3965328892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efedc136c50 0x7efedc119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.157+0000 7efedbfff700 1 -- 172.21.15.40:0/3965328892 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed00094a0 con 0x7efedc133e00 2023-09-30T22:31:37.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.157+0000 7efedbfff700 1 --2- 172.21.15.40:0/3965328892 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efedc133e00 0x7efedc119050 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7efecc00c520 tx=0x7efecc00c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:37.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.158+0000 7efed8ff9700 1 -- 172.21.15.40:0/3965328892 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc004c80 con 0x7efedc133e00 2023-09-30T22:31:37.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.158+0000 7efed8ff9700 1 -- 172.21.15.40:0/3965328892 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efecc004e00 con 0x7efedc133e00 2023-09-30T22:31:37.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.158+0000 7efee28e4700 1 -- 172.21.15.40:0/3965328892 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efedc12df10 con 0x7efedc133e00 2023-09-30T22:31:37.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.158+0000 7efed8ff9700 1 -- 172.21.15.40:0/3965328892 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc007310 con 0x7efedc133e00 2023-09-30T22:31:37.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.158+0000 7efee28e4700 1 -- 172.21.15.40:0/3965328892 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efedc130990 con 0x7efedc133e00 2023-09-30T22:31:37.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.159+0000 7efed8ff9700 1 -- 172.21.15.40:0/3965328892 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efecc007470 con 0x7efedc133e00 2023-09-30T22:31:37.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.159+0000 7efed8ff9700 1 -- 172.21.15.40:0/3965328892 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7efecc03f2e0 con 0x7efedc133e00 2023-09-30T22:31:37.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.159+0000 7efee28e4700 1 -- 172.21.15.40:0/3965328892 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efedc062380 con 0x7efedc133e00 2023-09-30T22:31:37.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.161+0000 7fa903128700 1 Processor -- start 2023-09-30T22:31:37.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.161+0000 7fa903128700 1 -- start start 2023-09-30T22:31:37.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.162+0000 7fa903128700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa8fc138250 0x7fa8fc138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.162+0000 7fa903128700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa8fc09d400 0x7fa8fc09d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.162+0000 7fa903128700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8fc09dd50 0x7fa8fc13f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.162+0000 7fa903128700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8fc137e20 con 0x7fa8fc138250 2023-09-30T22:31:37.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.162+0000 7fa903128700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc138050 con 0x7fa8fc09dd50 2023-09-30T22:31:37.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.162+0000 7fa903128700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc09b010 con 0x7fa8fc09d400 2023-09-30T22:31:37.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.162+0000 7fa900ec4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa8fc138250 0x7fa8fc138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.162+0000 7fa900ec4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa8fc138250 0x7fa8fc138620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47464/0 (socket says 172.21.15.40:47464) 2023-09-30T22:31:37.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.162+0000 7fa900ec4700 1 -- 172.21.15.40:0/1261508899 learned_addr learned my addr 172.21.15.40:0/1261508899 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:37.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.162+0000 7fa9016c5700 1 --2- 172.21.15.40:0/1261508899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8fc09dd50 0x7fa8fc13f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.162+0000 7fa8fbfff700 1 --2- 172.21.15.40:0/1261508899 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa8fc09d400 0x7fa8fc09d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.163+0000 7fa900ec4700 1 -- 172.21.15.40:0/1261508899 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa8fc09d400 msgr2=0x7fa8fc09d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:37.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.163+0000 7fa900ec4700 1 --2- 172.21.15.40:0/1261508899 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa8fc09d400 0x7fa8fc09d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.163+0000 7fa900ec4700 1 -- 172.21.15.40:0/1261508899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8fc09dd50 msgr2=0x7fa8fc13f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:37.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.163+0000 7fa900ec4700 1 --2- 172.21.15.40:0/1261508899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8fc09dd50 0x7fa8fc13f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.163+0000 7fa900ec4700 1 -- 172.21.15.40:0/1261508899 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8fc09f1f0 con 0x7fa8fc138250 2023-09-30T22:31:37.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.163+0000 7fa900ec4700 1 --2- 172.21.15.40:0/1261508899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8fc138250 0x7fa8fc138620 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fa8f00098f0 tx=0x7fa8f0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29bf6c7d85da42e6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:37.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.163+0000 7fa8fb7fe700 1 -- 172.21.15.40:0/1261508899 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f0011830 con 0x7fa8fc138250 2023-09-30T22:31:37.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.163+0000 7fa8fb7fe700 1 -- 172.21.15.40:0/1261508899 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f0011990 con 0x7fa8fc138250 2023-09-30T22:31:37.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.163+0000 7fa8fb7fe700 1 -- 172.21.15.40:0/1261508899 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f0011d20 con 0x7fa8fc138250 2023-09-30T22:31:37.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.164+0000 7fa903128700 1 -- 172.21.15.40:0/1261508899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8fc138250 msgr2=0x7fa8fc138620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.164+0000 7fa903128700 1 --2- 172.21.15.40:0/1261508899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8fc138250 0x7fa8fc138620 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fa8f00098f0 tx=0x7fa8f0009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:37.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.164+0000 7fa903128700 1 -- 172.21.15.40:0/1261508899 shutdown_connections 2023-09-30T22:31:37.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.164+0000 7fa903128700 1 --2- 172.21.15.40:0/1261508899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8fc09dd50 0x7fa8fc13f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.164+0000 7fa903128700 1 --2- 172.21.15.40:0/1261508899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8fc138250 0x7fa8fc138620 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.164+0000 7fa903128700 1 --2- 172.21.15.40:0/1261508899 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa8fc09d400 0x7fa8fc09d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.164+0000 7fa903128700 1 -- 172.21.15.40:0/1261508899 >> 172.21.15.40:0/1261508899 conn(0x7fa8fc0a2a00 msgr2=0x7fa8fc0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:37.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.164+0000 7fa903128700 1 -- 172.21.15.40:0/1261508899 shutdown_connections 2023-09-30T22:31:37.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.164+0000 7fa903128700 1 -- 172.21.15.40:0/1261508899 wait complete. 2023-09-30T22:31:37.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.165+0000 7efed8ff9700 1 -- 172.21.15.40:0/3965328892 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efecc0123b0 con 0x7efedc133e00 2023-09-30T22:31:37.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.166+0000 7fa903128700 1 Processor -- start 2023-09-30T22:31:37.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.166+0000 7fa903128700 1 -- start start 2023-09-30T22:31:37.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.167+0000 7fa903128700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8fc09d400 0x7fa8fc122050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.167+0000 7fa903128700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa8fc09dd50 0x7fa8fc122590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.167+0000 7fa903128700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8fc138250 0x7fa8fc122ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:37.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.167+0000 7fa903128700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc125b70 con 0x7fa8fc138250 2023-09-30T22:31:37.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.167+0000 7fa903128700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc126510 con 0x7fa8fc09d400 2023-09-30T22:31:37.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.167+0000 7fa903128700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc125300 con 0x7fa8fc09dd50 2023-09-30T22:31:37.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.167+0000 7fa900ec4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8fc09d400 0x7fa8fc122050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.167+0000 7fa9016c5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8fc138250 0x7fa8fc122ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.167+0000 7fa900ec4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8fc09d400 0x7fa8fc122050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:51484/0 (socket says 172.21.15.40:51484) 2023-09-30T22:31:37.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.167+0000 7fa9016c5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8fc138250 0x7fa8fc122ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47470/0 (socket says 172.21.15.40:47470) 2023-09-30T22:31:37.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.167+0000 7fa900ec4700 1 -- 172.21.15.40:0/2890490043 learned_addr learned my addr 172.21.15.40:0/2890490043 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:37.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.167+0000 7fa8fbfff700 1 --2- 172.21.15.40:0/2890490043 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa8fc09dd50 0x7fa8fc122590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:37.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.167+0000 7fa900ec4700 1 -- 172.21.15.40:0/2890490043 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa8fc09dd50 msgr2=0x7fa8fc122590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.167+0000 7fa900ec4700 1 --2- 172.21.15.40:0/2890490043 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa8fc09dd50 0x7fa8fc122590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.167+0000 7fa900ec4700 1 -- 172.21.15.40:0/2890490043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8fc138250 msgr2=0x7fa8fc122ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.167+0000 7fa900ec4700 1 --2- 172.21.15.40:0/2890490043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8fc138250 0x7fa8fc122ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.167+0000 7fa900ec4700 1 -- 172.21.15.40:0/2890490043 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f0009550 con 0x7fa8fc09d400 2023-09-30T22:31:37.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.167+0000 7fa9016c5700 1 --2- 172.21.15.40:0/2890490043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8fc138250 0x7fa8fc122ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:37.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.167+0000 7fa900ec4700 1 --2- 172.21.15.40:0/2890490043 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8fc09d400 0x7fa8fc122050 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0000c00 tx=0x7fa8f0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:37.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.168+0000 7fa8f97fa700 1 -- 172.21.15.40:0/2890490043 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f0004240 con 0x7fa8fc09d400 2023-09-30T22:31:37.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.168+0000 7fa8f97fa700 1 -- 172.21.15.40:0/2890490043 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f001f070 con 0x7fa8fc09d400 2023-09-30T22:31:37.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.168+0000 7fa8f97fa700 1 -- 172.21.15.40:0/2890490043 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f00045e0 con 0x7fa8fc09d400 2023-09-30T22:31:37.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.168+0000 7fa903128700 1 -- 172.21.15.40:0/2890490043 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8fc136630 con 0x7fa8fc09d400 2023-09-30T22:31:37.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.168+0000 7fa903128700 1 -- 172.21.15.40:0/2890490043 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8fc123c60 con 0x7fa8fc09d400 2023-09-30T22:31:37.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.169+0000 7fa903128700 1 -- 172.21.15.40:0/2890490043 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8fc06edb0 con 0x7fa8fc09d400 2023-09-30T22:31:37.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.169+0000 7fa8f97fa700 1 -- 172.21.15.40:0/2890490043 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa8f0021030 con 0x7fa8fc09d400 2023-09-30T22:31:37.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.170+0000 7fa8f97fa700 1 -- 172.21.15.40:0/2890490043 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa8f0040900 con 0x7fa8fc09d400 2023-09-30T22:31:37.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.178+0000 7fa8f97fa700 1 -- 172.21.15.40:0/2890490043 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa8f00197c0 con 0x7fa8fc09d400 2023-09-30T22:31:37.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.279+0000 7f7ad0cd5700 1 -- 172.21.15.40:0/4102364224 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7ab0005150 con 0x7f7acc13da50 2023-09-30T22:31:37.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.279+0000 7f7abaffd700 1 -- 172.21.15.40:0/4102364224 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7ac4011e00 con 0x7f7acc13da50 2023-09-30T22:31:37.279 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:37.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.282+0000 7f7ad0cd5700 1 -- 172.21.15.40:0/4102364224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7acc13da50 msgr2=0x7f7acc06ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.282+0000 7f7ad0cd5700 1 --2- 172.21.15.40:0/4102364224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7acc13da50 0x7f7acc06ff60 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f7acc067f50 tx=0x7f7ac4004ad0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.282+0000 7f7ad0cd5700 1 -- 172.21.15.40:0/4102364224 shutdown_connections 2023-09-30T22:31:37.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.282+0000 7f7ad0cd5700 1 --2- 172.21.15.40:0/4102364224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7acc13da50 0x7f7acc06ff60 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.282+0000 7f7ad0cd5700 1 --2- 172.21.15.40:0/4102364224 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7acc138250 0x7f7acc06f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.282+0000 7f7ad0cd5700 1 --2- 172.21.15.40:0/4102364224 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7acc13b130 0x7f7acc06fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.282+0000 7f7ad0cd5700 1 -- 172.21.15.40:0/4102364224 >> 172.21.15.40:0/4102364224 conn(0x7f7acc0a2a00 msgr2=0x7f7acc09d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:37.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.282+0000 7f7ad0cd5700 1 -- 172.21.15.40:0/4102364224 shutdown_connections 2023-09-30T22:31:37.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.282+0000 7f7ad0cd5700 1 -- 172.21.15.40:0/4102364224 wait complete. 2023-09-30T22:31:37.299 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:37.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.312+0000 7f18fe653700 1 -- 172.21.15.40:0/2612853803 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f18f8125d60 con 0x7f18f8123120 2023-09-30T22:31:37.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.313+0000 7f18f4ff9700 1 -- 172.21.15.40:0/2612853803 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f18f0019030 con 0x7f18f8123120 2023-09-30T22:31:37.312 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:37.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.315+0000 7f18fe653700 1 -- 172.21.15.40:0/2612853803 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18f8123120 msgr2=0x7f18f81ce9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.315+0000 7f18fe653700 1 --2- 172.21.15.40:0/2612853803 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18f8123120 0x7f18f81ce9c0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f18f000b9a0 tx=0x7f18f000bcb0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.315+0000 7f18fe653700 1 -- 172.21.15.40:0/2612853803 shutdown_connections 2023-09-30T22:31:37.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.315+0000 7f18fe653700 1 --2- 172.21.15.40:0/2612853803 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18f8123120 0x7f18f81ce9c0 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.315+0000 7f18fe653700 1 --2- 172.21.15.40:0/2612853803 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18f809d920 0x7f18f81226a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.315+0000 7f18fe653700 1 --2- 172.21.15.40:0/2612853803 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18f809e230 0x7f18f8122be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.315+0000 7f18fe653700 1 -- 172.21.15.40:0/2612853803 >> 172.21.15.40:0/2612853803 conn(0x7f18f809fb20 msgr2=0x7f18f80706e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:37.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.315+0000 7f18fe653700 1 -- 172.21.15.40:0/2612853803 shutdown_connections 2023-09-30T22:31:37.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.315+0000 7f18fe653700 1 -- 172.21.15.40:0/2612853803 wait complete. 2023-09-30T22:31:37.328 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:37.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.363+0000 7efee28e4700 1 -- 172.21.15.40:0/3965328892 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efedc1366c0 con 0x7efedc133e00 2023-09-30T22:31:37.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.363+0000 7efed8ff9700 1 -- 172.21.15.40:0/3965328892 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efecc011360 con 0x7efedc133e00 2023-09-30T22:31:37.363 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:37.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.366+0000 7efee28e4700 1 -- 172.21.15.40:0/3965328892 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efedc133e00 msgr2=0x7efedc119050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.366+0000 7efee28e4700 1 --2- 172.21.15.40:0/3965328892 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efedc133e00 0x7efedc119050 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7efecc00c520 tx=0x7efecc00c830 comp rx=0 tx=0).stop 2023-09-30T22:31:37.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.366+0000 7efee28e4700 1 -- 172.21.15.40:0/3965328892 shutdown_connections 2023-09-30T22:31:37.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.366+0000 7efee28e4700 1 --2- 172.21.15.40:0/3965328892 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efedc133e00 0x7efedc119050 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.366+0000 7efee28e4700 1 --2- 172.21.15.40:0/3965328892 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efedc139570 0x7efedc119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.366+0000 7efee28e4700 1 --2- 172.21.15.40:0/3965328892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efedc136c50 0x7efedc119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.366+0000 7efee28e4700 1 -- 172.21.15.40:0/3965328892 >> 172.21.15.40:0/3965328892 conn(0x7efedc0a2a00 msgr2=0x7efedc134a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:37.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.366+0000 7efee28e4700 1 -- 172.21.15.40:0/3965328892 shutdown_connections 2023-09-30T22:31:37.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.366+0000 7efee28e4700 1 -- 172.21.15.40:0/3965328892 wait complete. 2023-09-30T22:31:37.378 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:37.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.384+0000 7fa903128700 1 -- 172.21.15.40:0/2890490043 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa8fc1256f0 con 0x7fa8fc09d400 2023-09-30T22:31:37.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.385+0000 7fa8f97fa700 1 -- 172.21.15.40:0/2890490043 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa8f0015020 con 0x7fa8fc09d400 2023-09-30T22:31:37.384 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:37.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.387+0000 7fa903128700 1 -- 172.21.15.40:0/2890490043 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8fc09d400 msgr2=0x7fa8fc122050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:37.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.387+0000 7fa903128700 1 --2- 172.21.15.40:0/2890490043 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8fc09d400 0x7fa8fc122050 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0000c00 tx=0x7fa8f0004750 comp rx=0 tx=0).stop 2023-09-30T22:31:37.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.387+0000 7fa903128700 1 -- 172.21.15.40:0/2890490043 shutdown_connections 2023-09-30T22:31:37.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.387+0000 7fa903128700 1 --2- 172.21.15.40:0/2890490043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8fc138250 0x7fa8fc122ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.387+0000 7fa903128700 1 --2- 172.21.15.40:0/2890490043 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8fc09d400 0x7fa8fc122050 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.387+0000 7fa903128700 1 --2- 172.21.15.40:0/2890490043 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa8fc09dd50 0x7fa8fc122590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:37.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.387+0000 7fa903128700 1 -- 172.21.15.40:0/2890490043 >> 172.21.15.40:0/2890490043 conn(0x7fa8fc0a2a00 msgr2=0x7fa8fc1bf550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:37.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.387+0000 7fa903128700 1 -- 172.21.15.40:0/2890490043 shutdown_connections 2023-09-30T22:31:37.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:37.387+0000 7fa903128700 1 -- 172.21.15.40:0/2890490043 wait complete. 2023-09-30T22:31:37.399 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:38.300 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:38.329 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:38.379 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:38.399 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:38.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.451+0000 7ff06931f700 1 Processor -- start 2023-09-30T22:31:38.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.451+0000 7ff06931f700 1 -- start start 2023-09-30T22:31:38.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.451+0000 7ff06931f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff064136c50 0x7ff064139030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:38.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.451+0000 7ff06931f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff064139570 0x7ff06413b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:38.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.451+0000 7ff06931f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff064133940 con 0x7ff064133e00 2023-09-30T22:31:38.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.451+0000 7ff06931f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff06409af70 con 0x7ff064136c50 2023-09-30T22:31:38.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.451+0000 7ff06931f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff06409ab20 con 0x7ff064139570 2023-09-30T22:31:38.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.451+0000 7ff0627fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff064136c50 0x7ff064139030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:38.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.451+0000 7ff0637fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff064139570 0x7ff06413b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:38.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.452+0000 7ff0637fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff064139570 0x7ff06413b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:51492/0 (socket says 172.21.15.40:51492) 2023-09-30T22:31:38.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.452+0000 7ff0627fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff064136c50 0x7ff064139030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47476/0 (socket says 172.21.15.40:47476) 2023-09-30T22:31:38.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.452+0000 7ff0637fe700 1 -- 172.21.15.40:0/502716333 learned_addr learned my addr 172.21.15.40:0/502716333 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:38.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.452+0000 7ff0627fc700 1 -- 172.21.15.40:0/502716333 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff064139570 msgr2=0x7ff06413b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:38.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.452+0000 7ff0627fc700 1 --2- 172.21.15.40:0/502716333 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff064139570 0x7ff06413b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.452+0000 7ff0627fc700 1 -- 172.21.15.40:0/502716333 >> v1:172.21.15.40:6789/0 conn(0x7ff064133e00 legacy=0x7ff0641341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:38.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.452+0000 7ff0627fc700 1 -- 172.21.15.40:0/502716333 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff06409f0d0 con 0x7ff064136c50 2023-09-30T22:31:38.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.452+0000 7ff0637fe700 1 --2- 172.21.15.40:0/502716333 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff064139570 0x7ff06413b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:38.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.452+0000 7ff0627fc700 1 --2- 172.21.15.40:0/502716333 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff064136c50 0x7ff064139030 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7ff058009840 tx=0x7ff058009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df43d18ebdda35d7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:38.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.452+0000 7ff061ffb700 1 -- 172.21.15.40:0/502716333 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff058011830 con 0x7ff064136c50 2023-09-30T22:31:38.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.452+0000 7ff061ffb700 1 -- 172.21.15.40:0/502716333 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff058011990 con 0x7ff064136c50 2023-09-30T22:31:38.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.453+0000 7ff061ffb700 1 -- 172.21.15.40:0/502716333 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff058011d20 con 0x7ff064136c50 2023-09-30T22:31:38.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.453+0000 7ff06931f700 1 -- 172.21.15.40:0/502716333 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff064136c50 msgr2=0x7ff064139030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:38.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.453+0000 7ff06931f700 1 --2- 172.21.15.40:0/502716333 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff064136c50 0x7ff064139030 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7ff058009840 tx=0x7ff058009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:38.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.453+0000 7ff06931f700 1 -- 172.21.15.40:0/502716333 shutdown_connections 2023-09-30T22:31:38.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.453+0000 7ff06931f700 1 --2- 172.21.15.40:0/502716333 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff064139570 0x7ff06413b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.453+0000 7ff06931f700 1 --2- 172.21.15.40:0/502716333 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff064136c50 0x7ff064139030 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.453+0000 7ff06931f700 1 -- 172.21.15.40:0/502716333 >> 172.21.15.40:0/502716333 conn(0x7ff0640a2a00 msgr2=0x7ff0640a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:38.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.453+0000 7ff06931f700 1 -- 172.21.15.40:0/502716333 shutdown_connections 2023-09-30T22:31:38.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.453+0000 7ff06931f700 1 -- 172.21.15.40:0/502716333 wait complete. 2023-09-30T22:31:38.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.455+0000 7ff06931f700 1 Processor -- start 2023-09-30T22:31:38.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.455+0000 7ff06931f700 1 -- start start 2023-09-30T22:31:38.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.456+0000 7ff06931f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff064133e00 0x7ff064071000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:38.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.456+0000 7ff06931f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff064136c50 0x7ff06406d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:38.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.456+0000 7ff06931f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff064139570 0x7ff06406db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:38.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.456+0000 7ff06931f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06412de90 con 0x7ff064136c50 2023-09-30T22:31:38.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.456+0000 7ff06931f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff064070bd0 con 0x7ff064133e00 2023-09-30T22:31:38.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.456+0000 7ff06931f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff06406fa50 con 0x7ff064139570 2023-09-30T22:31:38.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.456+0000 7ff062ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff064133e00 0x7ff064071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:38.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.456+0000 7ff062ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff064133e00 0x7ff064071000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:51498/0 (socket says 172.21.15.40:51498) 2023-09-30T22:31:38.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.456+0000 7ff062ffd700 1 -- 172.21.15.40:0/2080316199 learned_addr learned my addr 172.21.15.40:0/2080316199 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:38.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.456+0000 7ff0627fc700 1 --2- 172.21.15.40:0/2080316199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff064136c50 0x7ff06406d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:38.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.456+0000 7ff062ffd700 1 -- 172.21.15.40:0/2080316199 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff064139570 msgr2=0x7ff06406db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:38.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.456+0000 7ff062ffd700 1 --2- 172.21.15.40:0/2080316199 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff064139570 0x7ff06406db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.456+0000 7ff062ffd700 1 -- 172.21.15.40:0/2080316199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff064136c50 msgr2=0x7ff06406d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:38.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.456+0000 7ff062ffd700 1 --2- 172.21.15.40:0/2080316199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff064136c50 0x7ff06406d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.456+0000 7ff062ffd700 1 -- 172.21.15.40:0/2080316199 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff05c009b30 con 0x7ff064133e00 2023-09-30T22:31:38.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.457+0000 7ff062ffd700 1 --2- 172.21.15.40:0/2080316199 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff064133e00 0x7ff064071000 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7ff05400c480 tx=0x7ff05400c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:38.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.457+0000 7ff04b7fe700 1 -- 172.21.15.40:0/2080316199 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0540052d0 con 0x7ff064133e00 2023-09-30T22:31:38.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.457+0000 7ff04b7fe700 1 -- 172.21.15.40:0/2080316199 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff054005430 con 0x7ff064133e00 2023-09-30T22:31:38.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.457+0000 7ff06931f700 1 -- 172.21.15.40:0/2080316199 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0580094a0 con 0x7ff064133e00 2023-09-30T22:31:38.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.457+0000 7ff04b7fe700 1 -- 172.21.15.40:0/2080316199 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0540038c0 con 0x7ff064133e00 2023-09-30T22:31:38.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.457+0000 7ff06931f700 1 -- 172.21.15.40:0/2080316199 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff06406fff0 con 0x7ff064133e00 2023-09-30T22:31:38.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.458+0000 7ff04b7fe700 1 -- 172.21.15.40:0/2080316199 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff054003a20 con 0x7ff064133e00 2023-09-30T22:31:38.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.458+0000 7ff04b7fe700 1 -- 172.21.15.40:0/2080316199 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff05403ea50 con 0x7ff064133e00 2023-09-30T22:31:38.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.458+0000 7ff06931f700 1 -- 172.21.15.40:0/2080316199 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff064062380 con 0x7ff064133e00 2023-09-30T22:31:38.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.464+0000 7ff04b7fe700 1 -- 172.21.15.40:0/2080316199 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff054018260 con 0x7ff064133e00 2023-09-30T22:31:38.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.489+0000 7ff953965700 1 Processor -- start 2023-09-30T22:31:38.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.489+0000 7ff953965700 1 -- start start 2023-09-30T22:31:38.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.490+0000 7ff953965700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff94c09d920 0x7ff94c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:38.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.490+0000 7ff953965700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff94c09e230 0x7ff94c1308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:38.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.490+0000 7ff953965700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff94c130de0 0x7ff94c131260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:38.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.490+0000 7ff953965700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff94c09edf0 con 0x7ff94c09e230 2023-09-30T22:31:38.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.490+0000 7ff953965700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c09adf0 con 0x7ff94c09d920 2023-09-30T22:31:38.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.490+0000 7ff953965700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c09b660 con 0x7ff94c130de0 2023-09-30T22:31:38.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.490+0000 7ff951701700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff94c09d920 0x7ff94c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:38.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.490+0000 7ff951701700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff94c09d920 0x7ff94c09dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:51510/0 (socket says 172.21.15.40:51510) 2023-09-30T22:31:38.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.490+0000 7ff951701700 1 -- 172.21.15.40:0/2785510501 learned_addr learned my addr 172.21.15.40:0/2785510501 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:38.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.490+0000 7ff951f02700 1 --2- 172.21.15.40:0/2785510501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff94c130de0 0x7ff94c131260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:38.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.490+0000 7ff950f00700 1 --2- 172.21.15.40:0/2785510501 >> v2:172.21.15.40:3300/0 conn(0x7ff94c09e230 0x7ff94c1308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:38.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.490+0000 7ff951f02700 1 -- 172.21.15.40:0/2785510501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff94c09d920 msgr2=0x7ff94c09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:38.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.490+0000 7ff951f02700 1 --2- 172.21.15.40:0/2785510501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff94c09d920 0x7ff94c09dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.490+0000 7ff951f02700 1 -- 172.21.15.40:0/2785510501 >> v2:172.21.15.40:3300/0 conn(0x7ff94c09e230 msgr2=0x7ff94c1308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:38.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.491+0000 7ff951f02700 1 --2- 172.21.15.40:0/2785510501 >> v2:172.21.15.40:3300/0 conn(0x7ff94c09e230 0x7ff94c1308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.491+0000 7ff951f02700 1 -- 172.21.15.40:0/2785510501 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94c09a6e0 con 0x7ff94c130de0 2023-09-30T22:31:38.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.491+0000 7ff950f00700 1 --2- 172.21.15.40:0/2785510501 >> v2:172.21.15.40:3300/0 conn(0x7ff94c09e230 0x7ff94c1308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:38.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.491+0000 7ff951701700 1 --2- 172.21.15.40:0/2785510501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff94c09d920 0x7ff94c09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:38.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.491+0000 7ff951f02700 1 --2- 172.21.15.40:0/2785510501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff94c130de0 0x7ff94c131260 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7ff944014a00 tx=0x7ff944014d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18123ef04b7f348 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:38.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.491+0000 7ff943fff700 1 -- 172.21.15.40:0/2785510501 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff944014ea0 con 0x7ff94c130de0 2023-09-30T22:31:38.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.491+0000 7ff943fff700 1 -- 172.21.15.40:0/2785510501 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94400fd50 con 0x7ff94c130de0 2023-09-30T22:31:38.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.491+0000 7ff943fff700 1 -- 172.21.15.40:0/2785510501 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff944013b20 con 0x7ff94c130de0 2023-09-30T22:31:38.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.492+0000 7ff953965700 1 -- 172.21.15.40:0/2785510501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff94c130de0 msgr2=0x7ff94c131260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:38.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.492+0000 7ff953965700 1 --2- 172.21.15.40:0/2785510501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff94c130de0 0x7ff94c131260 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7ff944014a00 tx=0x7ff944014d10 comp rx=0 tx=0).stop 2023-09-30T22:31:38.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.492+0000 7ff953965700 1 -- 172.21.15.40:0/2785510501 shutdown_connections 2023-09-30T22:31:38.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.492+0000 7ff953965700 1 --2- 172.21.15.40:0/2785510501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff94c130de0 0x7ff94c131260 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.492+0000 7ff953965700 1 --2- 172.21.15.40:0/2785510501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff94c09d920 0x7ff94c09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.492+0000 7ff953965700 1 --2- 172.21.15.40:0/2785510501 >> v2:172.21.15.40:3300/0 conn(0x7ff94c09e230 0x7ff94c1308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.492+0000 7ff953965700 1 -- 172.21.15.40:0/2785510501 >> 172.21.15.40:0/2785510501 conn(0x7ff94c09fb20 msgr2=0x7ff94c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:38.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.492+0000 7ff953965700 1 -- 172.21.15.40:0/2785510501 shutdown_connections 2023-09-30T22:31:38.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.492+0000 7ff953965700 1 -- 172.21.15.40:0/2785510501 wait complete. 2023-09-30T22:31:38.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.493+0000 7ff953965700 1 Processor -- start 2023-09-30T22:31:38.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.493+0000 7ff953965700 1 -- start start 2023-09-30T22:31:38.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.493+0000 7ff953965700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff94c09d920 0x7ff94c11d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:38.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.493+0000 7ff953965700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff94c09e230 0x7ff94c11d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:38.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.493+0000 7ff953965700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff94c130de0 0x7ff94c11dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:38.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.493+0000 7ff953965700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c12f6b0 con 0x7ff94c09d920 2023-09-30T22:31:38.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.493+0000 7ff953965700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c120a50 con 0x7ff94c09e230 2023-09-30T22:31:38.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.493+0000 7ff953965700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c0a3af0 con 0x7ff94c130de0 2023-09-30T22:31:38.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.494+0000 7ff951701700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff94c09d920 0x7ff94c11d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:38.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.494+0000 7ff950f00700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff94c09e230 0x7ff94c11d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:38.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.494+0000 7ff951701700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff94c09d920 0x7ff94c11d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47496/0 (socket says 172.21.15.40:47496) 2023-09-30T22:31:38.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.494+0000 7ff950f00700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff94c09e230 0x7ff94c11d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:51524/0 (socket says 172.21.15.40:51524) 2023-09-30T22:31:38.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.494+0000 7ff951701700 1 -- 172.21.15.40:0/636763638 learned_addr learned my addr 172.21.15.40:0/636763638 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:38.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.494+0000 7ff951f02700 1 --2- 172.21.15.40:0/636763638 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff94c130de0 0x7ff94c11dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:38.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.494+0000 7ff951701700 1 -- 172.21.15.40:0/636763638 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff94c130de0 msgr2=0x7ff94c11dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:38.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.494+0000 7ff951701700 1 --2- 172.21.15.40:0/636763638 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff94c130de0 0x7ff94c11dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.494+0000 7ff951701700 1 -- 172.21.15.40:0/636763638 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff94c09e230 msgr2=0x7ff94c11d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:38.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.494+0000 7ff951701700 1 --2- 172.21.15.40:0/636763638 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff94c09e230 0x7ff94c11d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.494+0000 7ff951701700 1 -- 172.21.15.40:0/636763638 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94800d9a0 con 0x7ff94c09d920 2023-09-30T22:31:38.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.494+0000 7ff951701700 1 --2- 172.21.15.40:0/636763638 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff94c09d920 0x7ff94c11d040 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7ff948008e00 tx=0x7ff94800d3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:38.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.494+0000 7ff941ffb700 1 -- 172.21.15.40:0/636763638 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff948005c20 con 0x7ff94c09d920 2023-09-30T22:31:38.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.494+0000 7ff941ffb700 1 -- 172.21.15.40:0/636763638 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff948005d80 con 0x7ff94c09d920 2023-09-30T22:31:38.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.495+0000 7ff953965700 1 -- 172.21.15.40:0/636763638 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff93c0094a0 con 0x7ff94c09d920 2023-09-30T22:31:38.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.495+0000 7ff941ffb700 1 -- 172.21.15.40:0/636763638 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff948006250 con 0x7ff94c09d920 2023-09-30T22:31:38.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.495+0000 7ff953965700 1 -- 172.21.15.40:0/636763638 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff944014660 con 0x7ff94c09d920 2023-09-30T22:31:38.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.496+0000 7ff941ffb700 1 -- 172.21.15.40:0/636763638 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff9480063b0 con 0x7ff94c09d920 2023-09-30T22:31:38.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.496+0000 7ff941ffb700 1 -- 172.21.15.40:0/636763638 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff94803ecf0 con 0x7ff94c09d920 2023-09-30T22:31:38.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.496+0000 7ff953965700 1 -- 172.21.15.40:0/636763638 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff94c062380 con 0x7ff94c09d920 2023-09-30T22:31:38.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.505+0000 7ff941ffb700 1 -- 172.21.15.40:0/636763638 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff94801a030 con 0x7ff94c09d920 2023-09-30T22:31:38.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.531+0000 7f6195644700 1 Processor -- start 2023-09-30T22:31:38.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.531+0000 7f6195644700 1 -- start start 2023-09-30T22:31:38.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.532+0000 7f6195644700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f619006d470 0x7f619013d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:38.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.532+0000 7f6195644700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f619013d900 0x7f619013fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:38.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.532+0000 7f6195644700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f619006df30 con 0x7f619006c990 2023-09-30T22:31:38.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.532+0000 7f6195644700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f619006ec40 con 0x7f619006d470 2023-09-30T22:31:38.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.532+0000 7f6195644700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f619006ea40 con 0x7f619013d900 2023-09-30T22:31:38.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.532+0000 7f618e7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f619006d470 0x7f619013d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:38.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.532+0000 7f618e7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f619006d470 0x7f619013d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:51540/0 (socket says 172.21.15.40:51540) 2023-09-30T22:31:38.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.532+0000 7f618e7fc700 1 -- 172.21.15.40:0/1530746942 learned_addr learned my addr 172.21.15.40:0/1530746942 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:38.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.532+0000 7f618f7fe700 1 --2- 172.21.15.40:0/1530746942 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f619013d900 0x7f619013fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:38.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.532+0000 7f618dffb700 1 -- 172.21.15.40:0/1530746942 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4247394367 0 0) 0x7f619006df30 con 0x7f619006c990 2023-09-30T22:31:38.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.532+0000 7f618dffb700 1 -- 172.21.15.40:0/1530746942 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61780035b0 con 0x7f619006c990 2023-09-30T22:31:38.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.533+0000 7f618e7fc700 1 -- 172.21.15.40:0/1530746942 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f619013d900 msgr2=0x7f619013fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:38.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.533+0000 7f618e7fc700 1 --2- 172.21.15.40:0/1530746942 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f619013d900 0x7f619013fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.533+0000 7f618e7fc700 1 -- 172.21.15.40:0/1530746942 >> v1:172.21.15.40:6789/0 conn(0x7f619006c990 legacy=0x7f619006cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:38.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.533+0000 7f618e7fc700 1 -- 172.21.15.40:0/1530746942 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6190072050 con 0x7f619006d470 2023-09-30T22:31:38.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.533+0000 7f618f7fe700 1 --2- 172.21.15.40:0/1530746942 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f619013d900 0x7f619013fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:38.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.533+0000 7f618e7fc700 1 --2- 172.21.15.40:0/1530746942 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f619006d470 0x7f619013d3c0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f6184009950 tx=0x7f6184009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aede94cc727e692d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:38.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.533+0000 7f618dffb700 1 -- 172.21.15.40:0/1530746942 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6184011830 con 0x7f619006d470 2023-09-30T22:31:38.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.533+0000 7f618dffb700 1 -- 172.21.15.40:0/1530746942 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6184011990 con 0x7f619006d470 2023-09-30T22:31:38.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.533+0000 7f618dffb700 1 -- 172.21.15.40:0/1530746942 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6184011d00 con 0x7f619006d470 2023-09-30T22:31:38.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.534+0000 7f6195644700 1 -- 172.21.15.40:0/1530746942 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f619006d470 msgr2=0x7f619013d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:38.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.534+0000 7f6195644700 1 --2- 172.21.15.40:0/1530746942 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f619006d470 0x7f619013d3c0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f6184009950 tx=0x7f6184009c60 comp rx=0 tx=0).stop 2023-09-30T22:31:38.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.534+0000 7f6195644700 1 -- 172.21.15.40:0/1530746942 shutdown_connections 2023-09-30T22:31:38.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.534+0000 7f6195644700 1 --2- 172.21.15.40:0/1530746942 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f619013d900 0x7f619013fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.534+0000 7f6195644700 1 --2- 172.21.15.40:0/1530746942 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f619006d470 0x7f619013d3c0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.534+0000 7f6195644700 1 -- 172.21.15.40:0/1530746942 >> 172.21.15.40:0/1530746942 conn(0x7f61900a41a0 msgr2=0x7f61900a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:38.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.534+0000 7f6195644700 1 -- 172.21.15.40:0/1530746942 shutdown_connections 2023-09-30T22:31:38.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.534+0000 7f6195644700 1 -- 172.21.15.40:0/1530746942 wait complete. 2023-09-30T22:31:38.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.535+0000 7f6195644700 1 Processor -- start 2023-09-30T22:31:38.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.535+0000 7f6195644700 1 -- start start 2023-09-30T22:31:38.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.535+0000 7f6195644700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f619006c990 0x7f619008bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:38.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.536+0000 7f6195644700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f619006d470 0x7f619008c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:38.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.536+0000 7f6195644700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f619013d900 0x7f61901ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:38.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.536+0000 7f6195644700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619013ad40 con 0x7f619006c990 2023-09-30T22:31:38.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.536+0000 7f6195644700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f619008b860 con 0x7f619013d900 2023-09-30T22:31:38.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.536+0000 7f6195644700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f619006f560 con 0x7f619006d470 2023-09-30T22:31:38.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.536+0000 7f618effd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f619006c990 0x7f619008bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:38.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.536+0000 7f618effd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f619006c990 0x7f619008bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47498/0 (socket says 172.21.15.40:47498) 2023-09-30T22:31:38.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.536+0000 7f618effd700 1 -- 172.21.15.40:0/1665029773 learned_addr learned my addr 172.21.15.40:0/1665029773 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:38.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.536+0000 7f618f7fe700 1 --2- 172.21.15.40:0/1665029773 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f619013d900 0x7f61901ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:38.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.536+0000 7f618e7fc700 1 --2- 172.21.15.40:0/1665029773 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f619006d470 0x7f619008c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:38.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.536+0000 7f618effd700 1 -- 172.21.15.40:0/1665029773 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f619006d470 msgr2=0x7f619008c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:38.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.536+0000 7f618effd700 1 --2- 172.21.15.40:0/1665029773 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f619006d470 0x7f619008c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.536+0000 7f618effd700 1 -- 172.21.15.40:0/1665029773 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f619013d900 msgr2=0x7f61901ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:38.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.536+0000 7f618effd700 1 --2- 172.21.15.40:0/1665029773 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f619013d900 0x7f61901ccb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.536+0000 7f618effd700 1 -- 172.21.15.40:0/1665029773 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6188009a70 con 0x7f619006c990 2023-09-30T22:31:38.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.536+0000 7f618f7fe700 1 --2- 172.21.15.40:0/1665029773 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f619013d900 0x7f61901ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:38.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.536+0000 7f618effd700 1 --2- 172.21.15.40:0/1665029773 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f619006c990 0x7f619008bc20 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f618000c520 tx=0x7f618000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:38.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.537+0000 7f61777fe700 1 -- 172.21.15.40:0/1665029773 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61800052d0 con 0x7f619006c990 2023-09-30T22:31:38.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.537+0000 7f61777fe700 1 -- 172.21.15.40:0/1665029773 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6180005430 con 0x7f619006c990 2023-09-30T22:31:38.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.537+0000 7f6195644700 1 -- 172.21.15.40:0/1665029773 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6184009550 con 0x7f619006c990 2023-09-30T22:31:38.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.537+0000 7f61777fe700 1 -- 172.21.15.40:0/1665029773 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61800038c0 con 0x7f619006c990 2023-09-30T22:31:38.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.537+0000 7f6195644700 1 -- 172.21.15.40:0/1665029773 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61900a0850 con 0x7f619006c990 2023-09-30T22:31:38.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.538+0000 7f61777fe700 1 -- 172.21.15.40:0/1665029773 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6180003a20 con 0x7f619006c990 2023-09-30T22:31:38.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.538+0000 7f61777fe700 1 -- 172.21.15.40:0/1665029773 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f618003eb00 con 0x7f619006c990 2023-09-30T22:31:38.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.538+0000 7f6195644700 1 -- 172.21.15.40:0/1665029773 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f619006cd60 con 0x7f619006c990 2023-09-30T22:31:38.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.543+0000 7f61777fe700 1 -- 172.21.15.40:0/1665029773 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6180017070 con 0x7f619006c990 2023-09-30T22:31:38.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.572+0000 7f41b37b2700 1 Processor -- start 2023-09-30T22:31:38.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.572+0000 7f41b37b2700 1 -- start start 2023-09-30T22:31:38.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.572+0000 7f41b37b2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f41ac136bf0 0x7f41ac138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:38.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.572+0000 7f41b37b2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f41ac139510 0x7f41ac13b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:38.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.572+0000 7f41b37b2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41ac0a2600 con 0x7f41ac09c890 2023-09-30T22:31:38.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.573+0000 7f41b37b2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41ac0a29d0 con 0x7f41ac139510 2023-09-30T22:31:38.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.573+0000 7f41b37b2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41ac09fb40 con 0x7f41ac136bf0 2023-09-30T22:31:38.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.573+0000 7f41b0d4d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f41ac136bf0 0x7f41ac138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:38.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.573+0000 7f41b1d4f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f41ac139510 0x7f41ac13b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:38.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.573+0000 7f41b0d4d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f41ac136bf0 0x7f41ac138fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48278/0 (socket says 172.21.15.40:48278) 2023-09-30T22:31:38.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.573+0000 7f41b0d4d700 1 -- 172.21.15.40:0/2939909398 learned_addr learned my addr 172.21.15.40:0/2939909398 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:38.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.573+0000 7f41b0d4d700 1 -- 172.21.15.40:0/2939909398 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f41ac139510 msgr2=0x7f41ac13b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:38.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.573+0000 7f41b0d4d700 1 --2- 172.21.15.40:0/2939909398 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f41ac139510 0x7f41ac13b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.573+0000 7f41b0d4d700 1 -- 172.21.15.40:0/2939909398 >> v1:172.21.15.40:6789/0 conn(0x7f41ac09c890 legacy=0x7f41ac09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:38.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.573+0000 7f41b0d4d700 1 -- 172.21.15.40:0/2939909398 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ac09d370 con 0x7f41ac136bf0 2023-09-30T22:31:38.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.573+0000 7f41b0d4d700 1 --2- 172.21.15.40:0/2939909398 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f41ac136bf0 0x7f41ac138fd0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f419c009920 tx=0x7f419c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=444a31b134e13ccf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:38.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.574+0000 7f41a3fff700 1 -- 172.21.15.40:0/2939909398 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c011830 con 0x7f41ac136bf0 2023-09-30T22:31:38.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.574+0000 7f41a3fff700 1 -- 172.21.15.40:0/2939909398 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419c011990 con 0x7f41ac136bf0 2023-09-30T22:31:38.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.574+0000 7f41a3fff700 1 -- 172.21.15.40:0/2939909398 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c011d20 con 0x7f41ac136bf0 2023-09-30T22:31:38.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.574+0000 7f41b37b2700 1 -- 172.21.15.40:0/2939909398 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f41ac136bf0 msgr2=0x7f41ac138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:38.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.574+0000 7f41b37b2700 1 --2- 172.21.15.40:0/2939909398 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f41ac136bf0 0x7f41ac138fd0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f419c009920 tx=0x7f419c009c30 comp rx=0 tx=0).stop 2023-09-30T22:31:38.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.574+0000 7f41b37b2700 1 -- 172.21.15.40:0/2939909398 shutdown_connections 2023-09-30T22:31:38.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.574+0000 7f41b37b2700 1 --2- 172.21.15.40:0/2939909398 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f41ac139510 0x7f41ac13b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.574+0000 7f41b37b2700 1 --2- 172.21.15.40:0/2939909398 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f41ac136bf0 0x7f41ac138fd0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.574+0000 7f41b37b2700 1 -- 172.21.15.40:0/2939909398 >> 172.21.15.40:0/2939909398 conn(0x7f41ac0a7080 msgr2=0x7f41ac0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:38.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.574+0000 7f41b37b2700 1 -- 172.21.15.40:0/2939909398 shutdown_connections 2023-09-30T22:31:38.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.574+0000 7f41b37b2700 1 -- 172.21.15.40:0/2939909398 wait complete. 2023-09-30T22:31:38.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.576+0000 7f41b37b2700 1 Processor -- start 2023-09-30T22:31:38.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.576+0000 7f41b37b2700 1 -- start start 2023-09-30T22:31:38.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.576+0000 7f41b37b2700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f41ac09c890 0x7f41ac06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:38.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.576+0000 7f41b37b2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41ac136bf0 0x7f41ac0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:38.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.576+0000 7f41b37b2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f41ac139510 0x7f41ac1c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:38.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.577+0000 7f41b37b2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41ac139050 con 0x7f41ac136bf0 2023-09-30T22:31:38.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.577+0000 7f41b37b2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41ac12bcd0 con 0x7f41ac139510 2023-09-30T22:31:38.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.577+0000 7f41b37b2700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41ac070830 con 0x7f41ac09c890 2023-09-30T22:31:38.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.577+0000 7f41b0d4d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41ac136bf0 0x7f41ac0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:38.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.577+0000 7f41b0d4d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41ac136bf0 0x7f41ac0702f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47512/0 (socket says 172.21.15.40:47512) 2023-09-30T22:31:38.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.577+0000 7f41b0d4d700 1 -- 172.21.15.40:0/2837946166 learned_addr learned my addr 172.21.15.40:0/2837946166 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:38.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.577+0000 7f41b1d4f700 1 --2- 172.21.15.40:0/2837946166 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f41ac139510 0x7f41ac1c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:38.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.577+0000 7f41b154e700 1 --2- 172.21.15.40:0/2837946166 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f41ac09c890 0x7f41ac06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:38.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.577+0000 7f41b0d4d700 1 -- 172.21.15.40:0/2837946166 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f41ac09c890 msgr2=0x7f41ac06fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:38.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.577+0000 7f41b0d4d700 1 --2- 172.21.15.40:0/2837946166 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f41ac09c890 0x7f41ac06fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.577+0000 7f41b0d4d700 1 -- 172.21.15.40:0/2837946166 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f41ac139510 msgr2=0x7f41ac1c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:38.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.577+0000 7f41b0d4d700 1 --2- 172.21.15.40:0/2837946166 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f41ac139510 0x7f41ac1c8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.577+0000 7f41b0d4d700 1 -- 172.21.15.40:0/2837946166 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419c009550 con 0x7f41ac136bf0 2023-09-30T22:31:38.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.577+0000 7f41b154e700 1 --2- 172.21.15.40:0/2837946166 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f41ac09c890 0x7f41ac06fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:31:38.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.577+0000 7f41b0d4d700 1 --2- 172.21.15.40:0/2837946166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41ac136bf0 0x7f41ac0702f0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f419c0098f0 tx=0x7f419c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:38.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.577+0000 7f41a1ffb700 1 -- 172.21.15.40:0/2837946166 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c004510 con 0x7f41ac136bf0 2023-09-30T22:31:38.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.577+0000 7f41a1ffb700 1 -- 172.21.15.40:0/2837946166 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419c0036a0 con 0x7f41ac136bf0 2023-09-30T22:31:38.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.577+0000 7f41a1ffb700 1 -- 172.21.15.40:0/2837946166 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c003a10 con 0x7f41ac136bf0 2023-09-30T22:31:38.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.577+0000 7f41b37b2700 1 -- 172.21.15.40:0/2837946166 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41ac09ed50 con 0x7f41ac136bf0 2023-09-30T22:31:38.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.578+0000 7f41b37b2700 1 -- 172.21.15.40:0/2837946166 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41ac12ca00 con 0x7f41ac136bf0 2023-09-30T22:31:38.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.579+0000 7f41a1ffb700 1 -- 172.21.15.40:0/2837946166 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f419c021070 con 0x7f41ac136bf0 2023-09-30T22:31:38.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.579+0000 7f41b37b2700 1 -- 172.21.15.40:0/2837946166 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41ac12be60 con 0x7f41ac136bf0 2023-09-30T22:31:38.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.579+0000 7f41a1ffb700 1 -- 172.21.15.40:0/2837946166 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f419c040a70 con 0x7f41ac136bf0 2023-09-30T22:31:38.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.584+0000 7f41a1ffb700 1 -- 172.21.15.40:0/2837946166 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f41ac12be60 con 0x7f41ac136bf0 2023-09-30T22:31:38.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.677+0000 7ff06931f700 1 -- 172.21.15.40:0/2080316199 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff06406fc10 con 0x7ff064133e00 2023-09-30T22:31:38.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.677+0000 7ff04b7fe700 1 -- 172.21.15.40:0/2080316199 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff054017020 con 0x7ff064133e00 2023-09-30T22:31:38.677 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:38.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.679+0000 7ff06931f700 1 -- 172.21.15.40:0/2080316199 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff064133e00 msgr2=0x7ff064071000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:38.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.679+0000 7ff06931f700 1 --2- 172.21.15.40:0/2080316199 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff064133e00 0x7ff064071000 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7ff05400c480 tx=0x7ff05400c790 comp rx=0 tx=0).stop 2023-09-30T22:31:38.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.679+0000 7ff06931f700 1 -- 172.21.15.40:0/2080316199 shutdown_connections 2023-09-30T22:31:38.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.679+0000 7ff06931f700 1 --2- 172.21.15.40:0/2080316199 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff064139570 0x7ff06406db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.679+0000 7ff06931f700 1 --2- 172.21.15.40:0/2080316199 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff064133e00 0x7ff064071000 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.679+0000 7ff06931f700 1 --2- 172.21.15.40:0/2080316199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff064136c50 0x7ff06406d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.679+0000 7ff06931f700 1 -- 172.21.15.40:0/2080316199 >> 172.21.15.40:0/2080316199 conn(0x7ff0640a2a00 msgr2=0x7ff06409b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:38.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.680+0000 7ff06931f700 1 -- 172.21.15.40:0/2080316199 shutdown_connections 2023-09-30T22:31:38.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.680+0000 7ff06931f700 1 -- 172.21.15.40:0/2080316199 wait complete. 2023-09-30T22:31:38.692 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:38.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.730+0000 7ff953965700 1 -- 172.21.15.40:0/636763638 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff94c074720 con 0x7ff94c09d920 2023-09-30T22:31:38.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.730+0000 7ff941ffb700 1 -- 172.21.15.40:0/636763638 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff94801db90 con 0x7ff94c09d920 2023-09-30T22:31:38.730 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:38.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.732+0000 7ff953965700 1 -- 172.21.15.40:0/636763638 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff94c09d920 msgr2=0x7ff94c11d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:38.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.732+0000 7ff953965700 1 --2- 172.21.15.40:0/636763638 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff94c09d920 0x7ff94c11d040 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7ff948008e00 tx=0x7ff94800d3c0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.732+0000 7ff953965700 1 -- 172.21.15.40:0/636763638 shutdown_connections 2023-09-30T22:31:38.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.732+0000 7ff953965700 1 --2- 172.21.15.40:0/636763638 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff94c130de0 0x7ff94c11dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.732+0000 7ff953965700 1 --2- 172.21.15.40:0/636763638 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff94c09d920 0x7ff94c11d040 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.732+0000 7ff953965700 1 --2- 172.21.15.40:0/636763638 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff94c09e230 0x7ff94c11d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.732+0000 7ff953965700 1 -- 172.21.15.40:0/636763638 >> 172.21.15.40:0/636763638 conn(0x7ff94c09fb20 msgr2=0x7ff94c12fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:38.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.732+0000 7ff953965700 1 -- 172.21.15.40:0/636763638 shutdown_connections 2023-09-30T22:31:38.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.732+0000 7ff953965700 1 -- 172.21.15.40:0/636763638 wait complete. 2023-09-30T22:31:38.745 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:38.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.760+0000 7f6195644700 1 -- 172.21.15.40:0/1665029773 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6190062380 con 0x7f619006c990 2023-09-30T22:31:38.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.761+0000 7f61777fe700 1 -- 172.21.15.40:0/1665029773 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f618000f260 con 0x7f619006c990 2023-09-30T22:31:38.761 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:38.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.763+0000 7f6195644700 1 -- 172.21.15.40:0/1665029773 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f619006c990 msgr2=0x7f619008bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:38.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.763+0000 7f6195644700 1 --2- 172.21.15.40:0/1665029773 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f619006c990 0x7f619008bc20 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f618000c520 tx=0x7f618000c830 comp rx=0 tx=0).stop 2023-09-30T22:31:38.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.763+0000 7f6195644700 1 -- 172.21.15.40:0/1665029773 shutdown_connections 2023-09-30T22:31:38.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.763+0000 7f6195644700 1 --2- 172.21.15.40:0/1665029773 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f619013d900 0x7f61901ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.763+0000 7f6195644700 1 --2- 172.21.15.40:0/1665029773 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f619006c990 0x7f619008bc20 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.763+0000 7f6195644700 1 --2- 172.21.15.40:0/1665029773 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f619006d470 0x7f619008c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.763+0000 7f6195644700 1 -- 172.21.15.40:0/1665029773 >> 172.21.15.40:0/1665029773 conn(0x7f61900a41a0 msgr2=0x7f619009a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:38.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.763+0000 7f6195644700 1 -- 172.21.15.40:0/1665029773 shutdown_connections 2023-09-30T22:31:38.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.763+0000 7f6195644700 1 -- 172.21.15.40:0/1665029773 wait complete. 2023-09-30T22:31:38.775 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:38.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.782+0000 7f41b37b2700 1 -- 172.21.15.40:0/2837946166 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f41ac12be10 con 0x7f41ac136bf0 2023-09-30T22:31:38.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.782+0000 7f41a1ffb700 1 -- 172.21.15.40:0/2837946166 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f419c015030 con 0x7f41ac136bf0 2023-09-30T22:31:38.782 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:38.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.784+0000 7f41b37b2700 1 -- 172.21.15.40:0/2837946166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41ac136bf0 msgr2=0x7f41ac0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:38.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.784+0000 7f41b37b2700 1 --2- 172.21.15.40:0/2837946166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41ac136bf0 0x7f41ac0702f0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f419c0098f0 tx=0x7f419c004750 comp rx=0 tx=0).stop 2023-09-30T22:31:38.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.784+0000 7f41b37b2700 1 -- 172.21.15.40:0/2837946166 shutdown_connections 2023-09-30T22:31:38.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.784+0000 7f41b37b2700 1 --2- 172.21.15.40:0/2837946166 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f41ac09c890 0x7f41ac06fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.784+0000 7f41b37b2700 1 --2- 172.21.15.40:0/2837946166 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f41ac139510 0x7f41ac1c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.784+0000 7f41b37b2700 1 --2- 172.21.15.40:0/2837946166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41ac136bf0 0x7f41ac0702f0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:38.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.784+0000 7f41b37b2700 1 -- 172.21.15.40:0/2837946166 >> 172.21.15.40:0/2837946166 conn(0x7f41ac0a7080 msgr2=0x7f41ac1349d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:38.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.785+0000 7f41b37b2700 1 -- 172.21.15.40:0/2837946166 shutdown_connections 2023-09-30T22:31:38.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:38.785+0000 7f41b37b2700 1 -- 172.21.15.40:0/2837946166 wait complete. 2023-09-30T22:31:38.796 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:39.693 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:39.745 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:39.775 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:39.797 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:39.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.837+0000 7f29a875f700 1 Processor -- start 2023-09-30T22:31:39.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.838+0000 7f29a875f700 1 -- start start 2023-09-30T22:31:39.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.838+0000 7f29a875f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f29a012e590 0x7f29a012e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:39.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.838+0000 7f29a875f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29a012eea0 0x7f29a012d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:39.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.838+0000 7f29a875f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29a009ab70 con 0x7f29a012d6d0 2023-09-30T22:31:39.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.838+0000 7f29a875f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29a009b270 con 0x7f29a012e590 2023-09-30T22:31:39.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.838+0000 7f29a875f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29a009bab0 con 0x7f29a012eea0 2023-09-30T22:31:39.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.838+0000 7f29a64fb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f29a012e590 0x7f29a012e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:39.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.838+0000 7f29a5cfa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29a012eea0 0x7f29a012d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:39.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.839+0000 7f29a64fb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f29a012e590 0x7f29a012e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47516/0 (socket says 172.21.15.40:47516) 2023-09-30T22:31:39.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.839+0000 7f29a64fb700 1 -- 172.21.15.40:0/39407453 learned_addr learned my addr 172.21.15.40:0/39407453 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:39.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.839+0000 7f29a5cfa700 1 -- 172.21.15.40:0/39407453 >> v2:172.21.15.40:3300/0 conn(0x7f29a012e590 msgr2=0x7f29a012e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:39.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.839+0000 7f29a5cfa700 1 --2- 172.21.15.40:0/39407453 >> v2:172.21.15.40:3300/0 conn(0x7f29a012e590 0x7f29a012e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.839+0000 7f29a5cfa700 1 -- 172.21.15.40:0/39407453 >> v1:172.21.15.40:6789/0 conn(0x7f29a012d6d0 legacy=0x7f29a0137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:39.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.839+0000 7f29a5cfa700 1 -- 172.21.15.40:0/39407453 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a009bd70 con 0x7f29a012eea0 2023-09-30T22:31:39.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.839+0000 7f29a64fb700 1 --2- 172.21.15.40:0/39407453 >> v2:172.21.15.40:3300/0 conn(0x7f29a012e590 0x7f29a012e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:39.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.839+0000 7f29a5cfa700 1 --2- 172.21.15.40:0/39407453 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29a012eea0 0x7f29a012d190 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f299000dc90 tx=0x7f299000f050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9ddeba209bd72cb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:39.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.839+0000 7f29a54f9700 1 -- 172.21.15.40:0/39407453 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2990012070 con 0x7f29a012eea0 2023-09-30T22:31:39.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.839+0000 7f29a54f9700 1 -- 172.21.15.40:0/39407453 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299000d2e0 con 0x7f29a012eea0 2023-09-30T22:31:39.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.839+0000 7f29a54f9700 1 -- 172.21.15.40:0/39407453 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299000f8b0 con 0x7f29a012eea0 2023-09-30T22:31:39.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.840+0000 7f29a875f700 1 -- 172.21.15.40:0/39407453 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29a012eea0 msgr2=0x7f29a012d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:39.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.840+0000 7f29a875f700 1 --2- 172.21.15.40:0/39407453 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29a012eea0 0x7f29a012d190 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f299000dc90 tx=0x7f299000f050 comp rx=0 tx=0).stop 2023-09-30T22:31:39.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.840+0000 7f29a875f700 1 -- 172.21.15.40:0/39407453 shutdown_connections 2023-09-30T22:31:39.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.840+0000 7f29a875f700 1 --2- 172.21.15.40:0/39407453 >> v2:172.21.15.40:3300/0 conn(0x7f29a012e590 0x7f29a012e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.840+0000 7f29a875f700 1 --2- 172.21.15.40:0/39407453 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29a012eea0 0x7f29a012d190 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.840+0000 7f29a875f700 1 -- 172.21.15.40:0/39407453 >> 172.21.15.40:0/39407453 conn(0x7f29a00a2a00 msgr2=0x7f29a00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:39.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.841+0000 7f29a875f700 1 -- 172.21.15.40:0/39407453 shutdown_connections 2023-09-30T22:31:39.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.841+0000 7f29a875f700 1 -- 172.21.15.40:0/39407453 wait complete. 2023-09-30T22:31:39.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.842+0000 7f29a875f700 1 Processor -- start 2023-09-30T22:31:39.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.842+0000 7f29a875f700 1 -- start start 2023-09-30T22:31:39.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.843+0000 7f29a875f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f29a012d6d0 0x7f29a0119a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:39.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.843+0000 7f29a875f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29a012e590 0x7f29a0119fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:39.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.843+0000 7f29a875f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29a012eea0 0x7f29a011a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:39.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.843+0000 7f29a875f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a011cd40 con 0x7f29a012eea0 2023-09-30T22:31:39.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.843+0000 7f29a875f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29a009b4b0 con 0x7f29a012e590 2023-09-30T22:31:39.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.843+0000 7f29a875f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29a009a2b0 con 0x7f29a012d6d0 2023-09-30T22:31:39.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.843+0000 7f29a64fb700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f29a012d6d0 0x7f29a0119a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:39.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.843+0000 7f29a64fb700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f29a012d6d0 0x7f29a0119a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48306/0 (socket says 172.21.15.40:48306) 2023-09-30T22:31:39.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.843+0000 7f29a64fb700 1 -- 172.21.15.40:0/1427856322 learned_addr learned my addr 172.21.15.40:0/1427856322 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:39.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.843+0000 7f29a5cfa700 1 --2- 172.21.15.40:0/1427856322 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29a012e590 0x7f29a0119fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:39.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.843+0000 7f29a6cfc700 1 --2- 172.21.15.40:0/1427856322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29a012eea0 0x7f29a011a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:39.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.843+0000 7f29a64fb700 1 -- 172.21.15.40:0/1427856322 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29a012e590 msgr2=0x7f29a0119fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:39.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.843+0000 7f29a64fb700 1 --2- 172.21.15.40:0/1427856322 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29a012e590 0x7f29a0119fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.843+0000 7f29a64fb700 1 -- 172.21.15.40:0/1427856322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29a012eea0 msgr2=0x7f29a011a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:39.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.843+0000 7f29a64fb700 1 --2- 172.21.15.40:0/1427856322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29a012eea0 0x7f29a011a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.843+0000 7f29a64fb700 1 -- 172.21.15.40:0/1427856322 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299c00b600 con 0x7f29a012d6d0 2023-09-30T22:31:39.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.844+0000 7f29a5cfa700 1 --2- 172.21.15.40:0/1427856322 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29a012e590 0x7f29a0119fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:39.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.844+0000 7f29a64fb700 1 --2- 172.21.15.40:0/1427856322 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f29a012d6d0 0x7f29a0119a90 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f299c00fde0 tx=0x7f299c00d630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:39.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.844+0000 7f2996ffd700 1 -- 172.21.15.40:0/1427856322 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299c00de40 con 0x7f29a012d6d0 2023-09-30T22:31:39.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.844+0000 7f2996ffd700 1 -- 172.21.15.40:0/1427856322 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299c018440 con 0x7f29a012d6d0 2023-09-30T22:31:39.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.844+0000 7f29a875f700 1 -- 172.21.15.40:0/1427856322 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299000d940 con 0x7f29a012d6d0 2023-09-30T22:31:39.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.844+0000 7f2996ffd700 1 -- 172.21.15.40:0/1427856322 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299c0187b0 con 0x7f29a012d6d0 2023-09-30T22:31:39.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.844+0000 7f29a875f700 1 -- 172.21.15.40:0/1427856322 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29a011c8f0 con 0x7f29a012d6d0 2023-09-30T22:31:39.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.845+0000 7f29a875f700 1 -- 172.21.15.40:0/1427856322 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29a006edb0 con 0x7f29a012d6d0 2023-09-30T22:31:39.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.846+0000 7f2996ffd700 1 -- 172.21.15.40:0/1427856322 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f299c004020 con 0x7f29a012d6d0 2023-09-30T22:31:39.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.846+0000 7f2996ffd700 1 -- 172.21.15.40:0/1427856322 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f299c03ffd0 con 0x7f29a012d6d0 2023-09-30T22:31:39.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.852+0000 7f2996ffd700 1 -- 172.21.15.40:0/1427856322 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f299c018910 con 0x7f29a012d6d0 2023-09-30T22:31:39.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.885+0000 7fc928099700 1 Processor -- start 2023-09-30T22:31:39.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.886+0000 7fc928099700 1 -- start start 2023-09-30T22:31:39.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.886+0000 7fc928099700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc920133e00 0x7fc9201341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:39.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.886+0000 7fc928099700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc92009d400 0x7fc92009d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:39.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.886+0000 7fc928099700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc920133940 con 0x7fc92009dd70 2023-09-30T22:31:39.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.886+0000 7fc928099700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc92009f0d0 con 0x7fc92009d400 2023-09-30T22:31:39.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.886+0000 7fc928099700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc92009e210 con 0x7fc920133e00 2023-09-30T22:31:39.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.886+0000 7fc925e35700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc920133e00 0x7fc9201341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:39.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.886+0000 7fc925634700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc92009d400 0x7fc92009d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:39.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.886+0000 7fc925e35700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc920133e00 0x7fc9201341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:51590/0 (socket says 172.21.15.40:51590) 2023-09-30T22:31:39.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.886+0000 7fc925e35700 1 -- 172.21.15.40:0/3292059400 learned_addr learned my addr 172.21.15.40:0/3292059400 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:39.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.887+0000 7fc925e35700 1 -- 172.21.15.40:0/3292059400 >> v2:172.21.15.40:3300/0 conn(0x7fc92009d400 msgr2=0x7fc92009d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:39.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.887+0000 7fc925e35700 1 --2- 172.21.15.40:0/3292059400 >> v2:172.21.15.40:3300/0 conn(0x7fc92009d400 0x7fc92009d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.887+0000 7fc925e35700 1 -- 172.21.15.40:0/3292059400 >> v1:172.21.15.40:6789/0 conn(0x7fc92009dd70 legacy=0x7fc92013ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:39.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.887+0000 7fc925e35700 1 -- 172.21.15.40:0/3292059400 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc920133be0 con 0x7fc920133e00 2023-09-30T22:31:39.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.887+0000 7fc925e35700 1 --2- 172.21.15.40:0/3292059400 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc920133e00 0x7fc9201341d0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fc91c0098f0 tx=0x7fc91c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47405fe089ace814 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:39.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.887+0000 7fc924e33700 1 -- 172.21.15.40:0/3292059400 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91c011830 con 0x7fc920133e00 2023-09-30T22:31:39.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.887+0000 7fc924e33700 1 -- 172.21.15.40:0/3292059400 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91c011990 con 0x7fc920133e00 2023-09-30T22:31:39.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.887+0000 7fc924e33700 1 -- 172.21.15.40:0/3292059400 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91c011d20 con 0x7fc920133e00 2023-09-30T22:31:39.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.888+0000 7fc928099700 1 -- 172.21.15.40:0/3292059400 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc920133e00 msgr2=0x7fc9201341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:39.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.888+0000 7fc928099700 1 --2- 172.21.15.40:0/3292059400 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc920133e00 0x7fc9201341d0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fc91c0098f0 tx=0x7fc91c009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:39.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.888+0000 7fc928099700 1 -- 172.21.15.40:0/3292059400 shutdown_connections 2023-09-30T22:31:39.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.888+0000 7fc928099700 1 --2- 172.21.15.40:0/3292059400 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc920133e00 0x7fc9201341d0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.888+0000 7fc928099700 1 --2- 172.21.15.40:0/3292059400 >> v2:172.21.15.40:3300/0 conn(0x7fc92009d400 0x7fc92009d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.888+0000 7fc928099700 1 -- 172.21.15.40:0/3292059400 >> 172.21.15.40:0/3292059400 conn(0x7fc9200a2a00 msgr2=0x7fc9200a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:39.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.888+0000 7fc928099700 1 -- 172.21.15.40:0/3292059400 shutdown_connections 2023-09-30T22:31:39.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.888+0000 7fc928099700 1 -- 172.21.15.40:0/3292059400 wait complete. 2023-09-30T22:31:39.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.889+0000 7fc928099700 1 Processor -- start 2023-09-30T22:31:39.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.889+0000 7fc928099700 1 -- start start 2023-09-30T22:31:39.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.890+0000 7fc928099700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc92009d400 0x7fc92011cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:39.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.890+0000 7fc928099700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc92009dd70 0x7fc92011d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:39.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.890+0000 7fc928099700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc92011d9a0 0x7fc9201cea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:39.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.890+0000 7fc928099700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc920120650 con 0x7fc92009d400 2023-09-30T22:31:39.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.890+0000 7fc928099700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc92011e940 con 0x7fc92009dd70 2023-09-30T22:31:39.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.890+0000 7fc928099700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc920120850 con 0x7fc92011d9a0 2023-09-30T22:31:39.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.890+0000 7fc925e35700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc92009d400 0x7fc92011cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:39.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.890+0000 7fc925e35700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc92009d400 0x7fc92011cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47538/0 (socket says 172.21.15.40:47538) 2023-09-30T22:31:39.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.890+0000 7fc925e35700 1 -- 172.21.15.40:0/2910638792 learned_addr learned my addr 172.21.15.40:0/2910638792 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:39.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.890+0000 7fc925634700 1 --2- 172.21.15.40:0/2910638792 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc92009dd70 0x7fc92011d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:39.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.891+0000 7fc926636700 1 --2- 172.21.15.40:0/2910638792 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc92011d9a0 0x7fc9201cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:39.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.891+0000 7fc925e35700 1 -- 172.21.15.40:0/2910638792 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc92011d9a0 msgr2=0x7fc9201cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:39.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.891+0000 7fc925e35700 1 --2- 172.21.15.40:0/2910638792 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc92011d9a0 0x7fc9201cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.891+0000 7fc925e35700 1 -- 172.21.15.40:0/2910638792 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc92009dd70 msgr2=0x7fc92011d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:39.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.891+0000 7fc925e35700 1 --2- 172.21.15.40:0/2910638792 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc92009dd70 0x7fc92011d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.891+0000 7fc925e35700 1 -- 172.21.15.40:0/2910638792 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91c009550 con 0x7fc92009d400 2023-09-30T22:31:39.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.891+0000 7fc925e35700 1 --2- 172.21.15.40:0/2910638792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc92009d400 0x7fc92011cf20 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fc91c000c00 tx=0x7fc91c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:39.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.891+0000 7fc9167fc700 1 -- 172.21.15.40:0/2910638792 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91c0043c0 con 0x7fc92009d400 2023-09-30T22:31:39.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.891+0000 7fc9167fc700 1 -- 172.21.15.40:0/2910638792 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91c01f070 con 0x7fc92009d400 2023-09-30T22:31:39.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.891+0000 7fc928099700 1 -- 172.21.15.40:0/2910638792 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc92012e0d0 con 0x7fc92009d400 2023-09-30T22:31:39.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.891+0000 7fc928099700 1 -- 172.21.15.40:0/2910638792 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9200a0170 con 0x7fc92009d400 2023-09-30T22:31:39.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.891+0000 7fc9167fc700 1 -- 172.21.15.40:0/2910638792 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91c0036a0 con 0x7fc92009d400 2023-09-30T22:31:39.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.892+0000 7fc9167fc700 1 -- 172.21.15.40:0/2910638792 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc91c021030 con 0x7fc92009d400 2023-09-30T22:31:39.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.892+0000 7fc928099700 1 -- 172.21.15.40:0/2910638792 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9080052e0 con 0x7fc92009d400 2023-09-30T22:31:39.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.892+0000 7fc9167fc700 1 -- 172.21.15.40:0/2910638792 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc91c040ae0 con 0x7fc92009d400 2023-09-30T22:31:39.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.896+0000 7fc926636700 1 --2- 172.21.15.40:0/2910638792 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc92011d9a0 0x7fc9201cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:31:39.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.902+0000 7fc9167fc700 1 -- 172.21.15.40:0/2910638792 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc91c003a40 con 0x7fc92009d400 2023-09-30T22:31:39.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.930+0000 7f2dc272c700 1 Processor -- start 2023-09-30T22:31:39.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.930+0000 7f2dc272c700 1 -- start start 2023-09-30T22:31:39.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.931+0000 7f2dc272c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2dbc09f0f0 0x7f2dbc138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:39.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.931+0000 7f2dc272c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2dbc09e400 0x7f2dbc13b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:39.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.931+0000 7f2dc272c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dbc09f940 con 0x7f2dbc09d920 2023-09-30T22:31:39.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.931+0000 7f2dc272c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dbc06b4c0 con 0x7f2dbc09e400 2023-09-30T22:31:39.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.931+0000 7f2dc272c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2dbc09a8f0 con 0x7f2dbc09f0f0 2023-09-30T22:31:39.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.931+0000 7f2dbb7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2dbc09f0f0 0x7f2dbc138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:39.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.931+0000 7f2dbb7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2dbc09f0f0 0x7f2dbc138ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48326/0 (socket says 172.21.15.40:48326) 2023-09-30T22:31:39.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.931+0000 7f2dbb7fe700 1 -- 172.21.15.40:0/3063270654 learned_addr learned my addr 172.21.15.40:0/3063270654 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:39.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.931+0000 7f2dc0cc9700 1 --2- 172.21.15.40:0/3063270654 >> v2:172.21.15.40:3300/0 conn(0x7f2dbc09e400 0x7f2dbc13b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:39.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.931+0000 7f2dbb7fe700 1 -- 172.21.15.40:0/3063270654 >> v2:172.21.15.40:3300/0 conn(0x7f2dbc09e400 msgr2=0x7f2dbc13b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:39.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.931+0000 7f2dbb7fe700 1 --2- 172.21.15.40:0/3063270654 >> v2:172.21.15.40:3300/0 conn(0x7f2dbc09e400 0x7f2dbc13b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.931+0000 7f2dbb7fe700 1 -- 172.21.15.40:0/3063270654 >> v1:172.21.15.40:6789/0 conn(0x7f2dbc09d920 legacy=0x7f2dbc09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:39.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.931+0000 7f2dbb7fe700 1 -- 172.21.15.40:0/3063270654 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dbc09f6e0 con 0x7f2dbc09f0f0 2023-09-30T22:31:39.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.932+0000 7f2dbb7fe700 1 --2- 172.21.15.40:0/3063270654 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2dbc09f0f0 0x7f2dbc138ee0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f2db00098f0 tx=0x7f2db0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a7a8424590ac6d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:39.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.932+0000 7f2dbaffd700 1 -- 172.21.15.40:0/3063270654 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db0004230 con 0x7f2dbc09f0f0 2023-09-30T22:31:39.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.932+0000 7f2dbaffd700 1 -- 172.21.15.40:0/3063270654 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db0004390 con 0x7f2dbc09f0f0 2023-09-30T22:31:39.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.932+0000 7f2dbaffd700 1 -- 172.21.15.40:0/3063270654 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db00036a0 con 0x7f2dbc09f0f0 2023-09-30T22:31:39.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.932+0000 7f2dc272c700 1 -- 172.21.15.40:0/3063270654 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2dbc09f0f0 msgr2=0x7f2dbc138ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:39.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.932+0000 7f2dc272c700 1 --2- 172.21.15.40:0/3063270654 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2dbc09f0f0 0x7f2dbc138ee0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f2db00098f0 tx=0x7f2db0009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:39.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.933+0000 7f2dc272c700 1 -- 172.21.15.40:0/3063270654 shutdown_connections 2023-09-30T22:31:39.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.933+0000 7f2dc272c700 1 --2- 172.21.15.40:0/3063270654 >> v2:172.21.15.40:3300/0 conn(0x7f2dbc09e400 0x7f2dbc13b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.933+0000 7f2dc272c700 1 --2- 172.21.15.40:0/3063270654 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2dbc09f0f0 0x7f2dbc138ee0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.933+0000 7f2dc272c700 1 -- 172.21.15.40:0/3063270654 >> 172.21.15.40:0/3063270654 conn(0x7f2dbc09fb20 msgr2=0x7f2dbc09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:39.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.933+0000 7f2dc272c700 1 -- 172.21.15.40:0/3063270654 shutdown_connections 2023-09-30T22:31:39.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.933+0000 7f2dc272c700 1 -- 172.21.15.40:0/3063270654 wait complete. 2023-09-30T22:31:39.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.934+0000 7f2dc272c700 1 Processor -- start 2023-09-30T22:31:39.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.934+0000 7f2dc272c700 1 -- start start 2023-09-30T22:31:39.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.934+0000 7f2dc272c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dbc09d920 0x7f2dbc11e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:39.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.934+0000 7f2dc272c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2dbc09e400 0x7f2dbc11eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:39.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.934+0000 7f2dc272c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2dbc11f400 0x7f2dbc1351a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:39.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.934+0000 7f2dc272c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dbc121fe0 con 0x7f2dbc09d920 2023-09-30T22:31:39.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.934+0000 7f2dc272c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dbc136240 con 0x7f2dbc11f400 2023-09-30T22:31:39.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.934+0000 7f2dc272c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2dbc09c9e0 con 0x7f2dbc09e400 2023-09-30T22:31:39.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.934+0000 7f2dbbfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dbc09d920 0x7f2dbc11e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:39.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.934+0000 7f2dbbfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dbc09d920 0x7f2dbc11e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47558/0 (socket says 172.21.15.40:47558) 2023-09-30T22:31:39.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.935+0000 7f2dbbfff700 1 -- 172.21.15.40:0/374954102 learned_addr learned my addr 172.21.15.40:0/374954102 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:39.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.935+0000 7f2dbb7fe700 1 --2- 172.21.15.40:0/374954102 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2dbc09e400 0x7f2dbc11eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:39.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.935+0000 7f2dc0cc9700 1 --2- 172.21.15.40:0/374954102 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2dbc11f400 0x7f2dbc1351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:39.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.935+0000 7f2dbbfff700 1 -- 172.21.15.40:0/374954102 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2dbc09e400 msgr2=0x7f2dbc11eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:39.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.935+0000 7f2dbbfff700 1 --2- 172.21.15.40:0/374954102 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2dbc09e400 0x7f2dbc11eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.935+0000 7f2dbbfff700 1 -- 172.21.15.40:0/374954102 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2dbc11f400 msgr2=0x7f2dbc1351a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:39.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.935+0000 7f2dbbfff700 1 --2- 172.21.15.40:0/374954102 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2dbc11f400 0x7f2dbc1351a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.935+0000 7f2dbbfff700 1 -- 172.21.15.40:0/374954102 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db0009550 con 0x7f2dbc09d920 2023-09-30T22:31:39.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.935+0000 7f2dbbfff700 1 --2- 172.21.15.40:0/374954102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dbc09d920 0x7f2dbc11e980 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f2dac00c520 tx=0x7f2dac00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:39.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.935+0000 7f2db8ff9700 1 -- 172.21.15.40:0/374954102 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac0054e0 con 0x7f2dbc09d920 2023-09-30T22:31:39.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.935+0000 7f2db8ff9700 1 -- 172.21.15.40:0/374954102 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dac003680 con 0x7f2dbc09d920 2023-09-30T22:31:39.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.935+0000 7f2dc272c700 1 -- 172.21.15.40:0/374954102 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dbc0a32d0 con 0x7f2dbc09d920 2023-09-30T22:31:39.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.935+0000 7f2db8ff9700 1 -- 172.21.15.40:0/374954102 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac003a30 con 0x7f2dbc09d920 2023-09-30T22:31:39.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.935+0000 7f2dc272c700 1 -- 172.21.15.40:0/374954102 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dbc1221c0 con 0x7f2dbc09d920 2023-09-30T22:31:39.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.936+0000 7f2db8ff9700 1 -- 172.21.15.40:0/374954102 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2dac003b90 con 0x7f2dbc09d920 2023-09-30T22:31:39.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.936+0000 7f2dc272c700 1 -- 172.21.15.40:0/374954102 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dbc121e10 con 0x7f2dbc09d920 2023-09-30T22:31:39.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.937+0000 7f2db8ff9700 1 -- 172.21.15.40:0/374954102 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f2dac03eab0 con 0x7f2dbc09d920 2023-09-30T22:31:39.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.941+0000 7f2db8ff9700 1 -- 172.21.15.40:0/374954102 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2dac003e40 con 0x7f2dbc09d920 2023-09-30T22:31:39.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.971+0000 7f3c116bb700 1 Processor -- start 2023-09-30T22:31:39.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.971+0000 7f3c116bb700 1 -- start start 2023-09-30T22:31:39.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.972+0000 7f3c116bb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c0c09d920 0x7f3c0c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:39.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.972+0000 7f3c116bb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3c0c130fb0 0x7f3c0c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:39.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.972+0000 7f3c116bb700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c0c09adf0 con 0x7f3c0c09e230 2023-09-30T22:31:39.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.972+0000 7f3c116bb700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c0c09edf0 con 0x7f3c0c130fb0 2023-09-30T22:31:39.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.972+0000 7f3c116bb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c09b660 con 0x7f3c0c09d920 2023-09-30T22:31:39.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.972+0000 7f3c0a7fc700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3c0c09e230 0x7f3c0c1308a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:36054/0 (socket says 172.21.15.40:36054) 2023-09-30T22:31:39.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.972+0000 7f3c0a7fc700 1 -- 172.21.15.40:0/2730410198 learned_addr learned my addr 172.21.15.40:0/2730410198 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:39.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.972+0000 7f3c0affd700 1 --2- 172.21.15.40:0/2730410198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c0c09d920 0x7f3c0c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:39.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.972+0000 7f3c0b7fe700 1 --2- 172.21.15.40:0/2730410198 >> v2:172.21.15.40:3300/0 conn(0x7f3c0c130fb0 0x7f3c0c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:39.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.973+0000 7f3c09ffb700 1 -- 172.21.15.40:0/2730410198 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 516568987 0 0) 0x7f3c0c09adf0 con 0x7f3c0c09e230 2023-09-30T22:31:39.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.973+0000 7f3c09ffb700 1 -- 172.21.15.40:0/2730410198 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bf40035b0 con 0x7f3c0c09e230 2023-09-30T22:31:39.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.973+0000 7f3c0affd700 1 -- 172.21.15.40:0/2730410198 >> v2:172.21.15.40:3300/0 conn(0x7f3c0c130fb0 msgr2=0x7f3c0c138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:39.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.973+0000 7f3c0affd700 1 --2- 172.21.15.40:0/2730410198 >> v2:172.21.15.40:3300/0 conn(0x7f3c0c130fb0 0x7f3c0c138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.973+0000 7f3c0affd700 1 -- 172.21.15.40:0/2730410198 >> v1:172.21.15.40:6789/0 conn(0x7f3c0c09e230 legacy=0x7f3c0c1308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:39.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.973+0000 7f3c0affd700 1 -- 172.21.15.40:0/2730410198 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0c09a6e0 con 0x7f3c0c09d920 2023-09-30T22:31:39.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.973+0000 7f3c0affd700 1 --2- 172.21.15.40:0/2730410198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c0c09d920 0x7f3c0c09dcf0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc009820 tx=0x7f3bfc009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e9791b78765d31 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.973+0000 7f3c09ffb700 1 -- 172.21.15.40:0/2730410198 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc005e30 con 0x7f3c0c09d920 2023-09-30T22:31:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.973+0000 7f3c09ffb700 1 -- 172.21.15.40:0/2730410198 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bfc006030 con 0x7f3c0c09d920 2023-09-30T22:31:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.973+0000 7f3c09ffb700 1 -- 172.21.15.40:0/2730410198 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc0063a0 con 0x7f3c0c09d920 2023-09-30T22:31:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.974+0000 7f3c116bb700 1 -- 172.21.15.40:0/2730410198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c0c09d920 msgr2=0x7f3c0c09dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.974+0000 7f3c116bb700 1 --2- 172.21.15.40:0/2730410198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c0c09d920 0x7f3c0c09dcf0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc009820 tx=0x7f3bfc009b30 comp rx=0 tx=0).stop 2023-09-30T22:31:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.974+0000 7f3c116bb700 1 -- 172.21.15.40:0/2730410198 shutdown_connections 2023-09-30T22:31:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.974+0000 7f3c116bb700 1 --2- 172.21.15.40:0/2730410198 >> v2:172.21.15.40:3300/0 conn(0x7f3c0c130fb0 0x7f3c0c138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.974+0000 7f3c116bb700 1 --2- 172.21.15.40:0/2730410198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c0c09d920 0x7f3c0c09dcf0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.974+0000 7f3c116bb700 1 -- 172.21.15.40:0/2730410198 >> 172.21.15.40:0/2730410198 conn(0x7f3c0c09fb20 msgr2=0x7f3c0c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.974+0000 7f3c116bb700 1 -- 172.21.15.40:0/2730410198 shutdown_connections 2023-09-30T22:31:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.974+0000 7f3c116bb700 1 -- 172.21.15.40:0/2730410198 wait complete. 2023-09-30T22:31:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.976+0000 7f3c116bb700 1 Processor -- start 2023-09-30T22:31:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.976+0000 7f3c116bb700 1 -- start start 2023-09-30T22:31:39.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.976+0000 7f3c116bb700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c0c09d920 0x7f3c0c12cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:39.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.976+0000 7f3c116bb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c0c09e230 0x7f3c0c12d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:39.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.976+0000 7f3c116bb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c0c130fb0 0x7f3c0c12d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:39.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.976+0000 7f3c116bb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c131a30 con 0x7f3c0c130fb0 2023-09-30T22:31:39.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.976+0000 7f3c116bb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c1308f0 con 0x7f3c0c09e230 2023-09-30T22:31:39.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.976+0000 7f3c116bb700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c131610 con 0x7f3c0c09d920 2023-09-30T22:31:39.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.977+0000 7f3c0affd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c0c09d920 0x7f3c0c12cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:39.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.977+0000 7f3c0affd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c0c09d920 0x7f3c0c12cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48336/0 (socket says 172.21.15.40:48336) 2023-09-30T22:31:39.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.977+0000 7f3c0affd700 1 -- 172.21.15.40:0/252497915 learned_addr learned my addr 172.21.15.40:0/252497915 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:39.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.977+0000 7f3c0b7fe700 1 --2- 172.21.15.40:0/252497915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c0c130fb0 0x7f3c0c12d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:39.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.977+0000 7f3c0a7fc700 1 --2- 172.21.15.40:0/252497915 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c0c09e230 0x7f3c0c12d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:39.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.977+0000 7f3c0affd700 1 -- 172.21.15.40:0/252497915 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c0c09e230 msgr2=0x7f3c0c12d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:39.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.977+0000 7f3c0affd700 1 --2- 172.21.15.40:0/252497915 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c0c09e230 0x7f3c0c12d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.977+0000 7f3c0affd700 1 -- 172.21.15.40:0/252497915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c0c130fb0 msgr2=0x7f3c0c12d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:39.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.977+0000 7f3c0affd700 1 --2- 172.21.15.40:0/252497915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c0c130fb0 0x7f3c0c12d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:39.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.977+0000 7f3c0affd700 1 -- 172.21.15.40:0/252497915 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bfc009430 con 0x7f3c0c09d920 2023-09-30T22:31:39.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.977+0000 7f3c0affd700 1 --2- 172.21.15.40:0/252497915 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c0c09d920 0x7f3c0c12cf30 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc000c00 tx=0x7f3bfc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:39.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.977+0000 7f3bf37fe700 1 -- 172.21.15.40:0/252497915 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc0067a0 con 0x7f3c0c09d920 2023-09-30T22:31:39.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.977+0000 7f3bf37fe700 1 -- 172.21.15.40:0/252497915 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bfc020070 con 0x7f3c0c09d920 2023-09-30T22:31:39.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.977+0000 7f3c116bb700 1 -- 172.21.15.40:0/252497915 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c0c13b250 con 0x7f3c0c09d920 2023-09-30T22:31:39.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.978+0000 7f3bf37fe700 1 -- 172.21.15.40:0/252497915 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc004280 con 0x7f3c0c09d920 2023-09-30T22:31:39.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.978+0000 7f3c116bb700 1 -- 172.21.15.40:0/252497915 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c0c12ebd0 con 0x7f3c0c09d920 2023-09-30T22:31:39.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.979+0000 7f3c116bb700 1 -- 172.21.15.40:0/252497915 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c0c062380 con 0x7f3c0c09d920 2023-09-30T22:31:39.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.984+0000 7f3bf37fe700 1 -- 172.21.15.40:0/252497915 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3bfc022030 con 0x7f3c0c09d920 2023-09-30T22:31:39.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.984+0000 7f3bf37fe700 1 -- 172.21.15.40:0/252497915 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3bfc040fc0 con 0x7f3c0c09d920 2023-09-30T22:31:39.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:39.984+0000 7f3bf37fe700 1 -- 172.21.15.40:0/252497915 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3bfc01cb60 con 0x7f3c0c09d920 2023-09-30T22:31:40.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.062+0000 7f29a875f700 1 -- 172.21.15.40:0/1427856322 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f29a011cf70 con 0x7f29a012d6d0 2023-09-30T22:31:40.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.062+0000 7f2996ffd700 1 -- 172.21.15.40:0/1427856322 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f29a011cf70 con 0x7f29a012d6d0 2023-09-30T22:31:40.062 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:40.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.065+0000 7f29a875f700 1 -- 172.21.15.40:0/1427856322 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f29a012d6d0 msgr2=0x7f29a0119a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:40.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.065+0000 7f29a875f700 1 --2- 172.21.15.40:0/1427856322 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f29a012d6d0 0x7f29a0119a90 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f299c00fde0 tx=0x7f299c00d630 comp rx=0 tx=0).stop 2023-09-30T22:31:40.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.066+0000 7f29a875f700 1 -- 172.21.15.40:0/1427856322 shutdown_connections 2023-09-30T22:31:40.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.066+0000 7f29a875f700 1 --2- 172.21.15.40:0/1427856322 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f29a012d6d0 0x7f29a0119a90 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.066+0000 7f29a875f700 1 --2- 172.21.15.40:0/1427856322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29a012eea0 0x7f29a011a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.066+0000 7f29a875f700 1 --2- 172.21.15.40:0/1427856322 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f29a012e590 0x7f29a0119fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.066+0000 7f29a875f700 1 -- 172.21.15.40:0/1427856322 >> 172.21.15.40:0/1427856322 conn(0x7f29a00a2a00 msgr2=0x7f29a012c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:40.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.066+0000 7f29a875f700 1 -- 172.21.15.40:0/1427856322 shutdown_connections 2023-09-30T22:31:40.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.066+0000 7f29a875f700 1 -- 172.21.15.40:0/1427856322 wait complete. 2023-09-30T22:31:40.082 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:40.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.113+0000 7fc928099700 1 -- 172.21.15.40:0/2910638792 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc908005590 con 0x7fc92009d400 2023-09-30T22:31:40.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.114+0000 7fc9167fc700 1 -- 172.21.15.40:0/2910638792 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc91c015090 con 0x7fc92009d400 2023-09-30T22:31:40.114 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:40.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.115+0000 7fc928099700 1 -- 172.21.15.40:0/2910638792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc92009d400 msgr2=0x7fc92011cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:40.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.116+0000 7fc928099700 1 --2- 172.21.15.40:0/2910638792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc92009d400 0x7fc92011cf20 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fc91c000c00 tx=0x7fc91c004750 comp rx=0 tx=0).stop 2023-09-30T22:31:40.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.116+0000 7fc928099700 1 -- 172.21.15.40:0/2910638792 shutdown_connections 2023-09-30T22:31:40.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.116+0000 7fc928099700 1 --2- 172.21.15.40:0/2910638792 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc92011d9a0 0x7fc9201cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.116+0000 7fc928099700 1 --2- 172.21.15.40:0/2910638792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc92009d400 0x7fc92011cf20 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.116+0000 7fc928099700 1 --2- 172.21.15.40:0/2910638792 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc92009dd70 0x7fc92011d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.116+0000 7fc928099700 1 -- 172.21.15.40:0/2910638792 >> 172.21.15.40:0/2910638792 conn(0x7fc9200a2a00 msgr2=0x7fc920131840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:40.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.116+0000 7fc928099700 1 -- 172.21.15.40:0/2910638792 shutdown_connections 2023-09-30T22:31:40.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.116+0000 7fc928099700 1 -- 172.21.15.40:0/2910638792 wait complete. 2023-09-30T22:31:40.128 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:40.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.142+0000 7f2dc272c700 1 -- 172.21.15.40:0/374954102 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2dbc0a2cf0 con 0x7f2dbc09d920 2023-09-30T22:31:40.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.142+0000 7f2db8ff9700 1 -- 172.21.15.40:0/374954102 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2dac017030 con 0x7f2dbc09d920 2023-09-30T22:31:40.142 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:40.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.144+0000 7f2dc272c700 1 -- 172.21.15.40:0/374954102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dbc09d920 msgr2=0x7f2dbc11e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:40.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.144+0000 7f2dc272c700 1 --2- 172.21.15.40:0/374954102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dbc09d920 0x7f2dbc11e980 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f2dac00c520 tx=0x7f2dac00c830 comp rx=0 tx=0).stop 2023-09-30T22:31:40.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.144+0000 7f2dc272c700 1 -- 172.21.15.40:0/374954102 shutdown_connections 2023-09-30T22:31:40.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.144+0000 7f2dc272c700 1 --2- 172.21.15.40:0/374954102 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2dbc11f400 0x7f2dbc1351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.144+0000 7f2dc272c700 1 --2- 172.21.15.40:0/374954102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dbc09d920 0x7f2dbc11e980 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.144+0000 7f2dc272c700 1 --2- 172.21.15.40:0/374954102 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2dbc09e400 0x7f2dbc11eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.144+0000 7f2dc272c700 1 -- 172.21.15.40:0/374954102 >> 172.21.15.40:0/374954102 conn(0x7f2dbc09fb20 msgr2=0x7f2dbc0a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:40.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.145+0000 7f2dc272c700 1 -- 172.21.15.40:0/374954102 shutdown_connections 2023-09-30T22:31:40.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.145+0000 7f2dc272c700 1 -- 172.21.15.40:0/374954102 wait complete. 2023-09-30T22:31:40.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:40.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.185+0000 7f3c116bb700 1 -- 172.21.15.40:0/252497915 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3c0c1301b0 con 0x7f3c0c09d920 2023-09-30T22:31:40.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.185+0000 7f3bf37fe700 1 -- 172.21.15.40:0/252497915 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3bfc01cdf0 con 0x7f3c0c09d920 2023-09-30T22:31:40.185 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:40.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.188+0000 7f3c116bb700 1 -- 172.21.15.40:0/252497915 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c0c09d920 msgr2=0x7f3c0c12cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:40.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.188+0000 7f3c116bb700 1 --2- 172.21.15.40:0/252497915 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c0c09d920 0x7f3c0c12cf30 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc000c00 tx=0x7f3bfc004750 comp rx=0 tx=0).stop 2023-09-30T22:31:40.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.188+0000 7f3c116bb700 1 -- 172.21.15.40:0/252497915 shutdown_connections 2023-09-30T22:31:40.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.188+0000 7f3c116bb700 1 --2- 172.21.15.40:0/252497915 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3c0c09d920 0x7f3c0c12cf30 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.188+0000 7f3c116bb700 1 --2- 172.21.15.40:0/252497915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c0c130fb0 0x7f3c0c12d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.188+0000 7f3c116bb700 1 --2- 172.21.15.40:0/252497915 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c0c09e230 0x7f3c0c12d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:40.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.188+0000 7f3c116bb700 1 -- 172.21.15.40:0/252497915 >> 172.21.15.40:0/252497915 conn(0x7f3c0c09fb20 msgr2=0x7f3c0c06df50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:40.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.188+0000 7f3c116bb700 1 -- 172.21.15.40:0/252497915 shutdown_connections 2023-09-30T22:31:40.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:40.188+0000 7f3c116bb700 1 -- 172.21.15.40:0/252497915 wait complete. 2023-09-30T22:31:40.200 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:41.083 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:41.129 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:41.157 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:41.201 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:41.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.235+0000 7fafb95ec700 1 Processor -- start 2023-09-30T22:31:41.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.235+0000 7fafb95ec700 1 -- start start 2023-09-30T22:31:41.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.236+0000 7fafb95ec700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafb409df30 0x7fafb4135400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.236+0000 7fafb95ec700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafb4135940 0x7fafb4137d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.236+0000 7fafb95ec700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb409e8b0 con 0x7fafb409d450 2023-09-30T22:31:41.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.236+0000 7fafb95ec700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb409c3b0 con 0x7fafb4135940 2023-09-30T22:31:41.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.236+0000 7fafb95ec700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fafb409a6b0 con 0x7fafb409df30 2023-09-30T22:31:41.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.236+0000 7fafb2ffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fafb409d450 0x7fafb409d820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:36058/0 (socket says 172.21.15.40:36058) 2023-09-30T22:31:41.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.236+0000 7fafb2ffd700 1 -- 172.21.15.40:0/245403399 learned_addr learned my addr 172.21.15.40:0/245403399 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:41.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.236+0000 7fafb37fe700 1 --2- 172.21.15.40:0/245403399 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafb4135940 0x7fafb4137d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.237+0000 7fafb27fc700 1 --2- 172.21.15.40:0/245403399 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafb409df30 0x7fafb4135400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.237+0000 7fafb1ffb700 1 -- 172.21.15.40:0/245403399 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1989000494 0 0) 0x7fafb409e8b0 con 0x7fafb409d450 2023-09-30T22:31:41.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.237+0000 7fafb1ffb700 1 -- 172.21.15.40:0/245403399 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf9c0035b0 con 0x7fafb409d450 2023-09-30T22:31:41.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.237+0000 7fafb37fe700 1 -- 172.21.15.40:0/245403399 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafb409df30 msgr2=0x7fafb4135400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:41.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.237+0000 7fafb37fe700 1 --2- 172.21.15.40:0/245403399 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafb409df30 0x7fafb4135400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.237+0000 7fafb37fe700 1 -- 172.21.15.40:0/245403399 >> v1:172.21.15.40:6789/0 conn(0x7fafb409d450 legacy=0x7fafb409d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:41.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.237+0000 7fafb37fe700 1 -- 172.21.15.40:0/245403399 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb409b4f0 con 0x7fafb4135940 2023-09-30T22:31:41.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.237+0000 7fafb37fe700 1 --2- 172.21.15.40:0/245403399 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafb4135940 0x7fafb4137d20 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fafac00bec0 tx=0x7fafac00d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8edf4c59109ffad2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:41.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.237+0000 7fafb1ffb700 1 -- 172.21.15.40:0/245403399 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac010070 con 0x7fafb4135940 2023-09-30T22:31:41.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.237+0000 7fafb1ffb700 1 -- 172.21.15.40:0/245403399 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafac00d910 con 0x7fafb4135940 2023-09-30T22:31:41.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.237+0000 7fafb1ffb700 1 -- 172.21.15.40:0/245403399 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac00dcc0 con 0x7fafb4135940 2023-09-30T22:31:41.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.238+0000 7fafb95ec700 1 -- 172.21.15.40:0/245403399 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafb4135940 msgr2=0x7fafb4137d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:41.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.238+0000 7fafb95ec700 1 --2- 172.21.15.40:0/245403399 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafb4135940 0x7fafb4137d20 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fafac00bec0 tx=0x7fafac00d330 comp rx=0 tx=0).stop 2023-09-30T22:31:41.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.238+0000 7fafb95ec700 1 -- 172.21.15.40:0/245403399 shutdown_connections 2023-09-30T22:31:41.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.238+0000 7fafb95ec700 1 --2- 172.21.15.40:0/245403399 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafb4135940 0x7fafb4137d20 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.238+0000 7fafb95ec700 1 --2- 172.21.15.40:0/245403399 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafb409df30 0x7fafb4135400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.238+0000 7fafb95ec700 1 -- 172.21.15.40:0/245403399 >> 172.21.15.40:0/245403399 conn(0x7fafb40a2a00 msgr2=0x7fafb40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:41.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.238+0000 7fafb95ec700 1 -- 172.21.15.40:0/245403399 shutdown_connections 2023-09-30T22:31:41.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.238+0000 7fafb95ec700 1 -- 172.21.15.40:0/245403399 wait complete. 2023-09-30T22:31:41.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.239+0000 7fafb95ec700 1 Processor -- start 2023-09-30T22:31:41.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.239+0000 7fafb95ec700 1 -- start start 2023-09-30T22:31:41.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.240+0000 7fafb95ec700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafb409d450 0x7fafb411d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.240+0000 7fafb95ec700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafb409df30 0x7fafb411d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.240+0000 7fafb95ec700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafb4135940 0x7fafb411dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.240+0000 7fafb95ec700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb41201f0 con 0x7fafb409d450 2023-09-30T22:31:41.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.240+0000 7fafb95ec700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb40a2180 con 0x7fafb4135940 2023-09-30T22:31:41.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.240+0000 7fafb95ec700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fafb411e6f0 con 0x7fafb409df30 2023-09-30T22:31:41.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.240+0000 7fafb2ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafb409d450 0x7fafb411d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.240+0000 7fafb2ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafb409d450 0x7fafb411d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47576/0 (socket says 172.21.15.40:47576) 2023-09-30T22:31:41.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.240+0000 7fafb2ffd700 1 -- 172.21.15.40:0/3941747824 learned_addr learned my addr 172.21.15.40:0/3941747824 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:41.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.240+0000 7fafb27fc700 1 --2- 172.21.15.40:0/3941747824 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafb409df30 0x7fafb411d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.240+0000 7fafb37fe700 1 --2- 172.21.15.40:0/3941747824 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafb4135940 0x7fafb411dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.240+0000 7fafb2ffd700 1 -- 172.21.15.40:0/3941747824 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafb409df30 msgr2=0x7fafb411d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:41.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.240+0000 7fafb2ffd700 1 --2- 172.21.15.40:0/3941747824 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafb409df30 0x7fafb411d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.240+0000 7fafb2ffd700 1 -- 172.21.15.40:0/3941747824 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafb4135940 msgr2=0x7fafb411dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:41.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.240+0000 7fafb2ffd700 1 --2- 172.21.15.40:0/3941747824 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafb4135940 0x7fafb411dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.240+0000 7fafb2ffd700 1 -- 172.21.15.40:0/3941747824 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafac00bb70 con 0x7fafb409d450 2023-09-30T22:31:41.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.240+0000 7fafb37fe700 1 --2- 172.21.15.40:0/3941747824 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafb4135940 0x7fafb411dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:41.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.241+0000 7fafb2ffd700 1 --2- 172.21.15.40:0/3941747824 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafb409d450 0x7fafb411d460 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fafa400c700 tx=0x7fafa400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:41.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.241+0000 7faf9b7fe700 1 -- 172.21.15.40:0/3941747824 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa4005d70 con 0x7fafb409d450 2023-09-30T22:31:41.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.241+0000 7faf9b7fe700 1 -- 172.21.15.40:0/3941747824 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa40070d0 con 0x7fafb409d450 2023-09-30T22:31:41.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.241+0000 7faf9b7fe700 1 -- 172.21.15.40:0/3941747824 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa4007460 con 0x7fafb409d450 2023-09-30T22:31:41.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.242+0000 7fafb95ec700 1 -- 172.21.15.40:0/3941747824 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb409c5d0 con 0x7fafb409d450 2023-09-30T22:31:41.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.242+0000 7fafb95ec700 1 -- 172.21.15.40:0/3941747824 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb41204d0 con 0x7fafb409d450 2023-09-30T22:31:41.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.242+0000 7faf9b7fe700 1 -- 172.21.15.40:0/3941747824 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fafa40075c0 con 0x7fafb409d450 2023-09-30T22:31:41.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.243+0000 7faf9b7fe700 1 -- 172.21.15.40:0/3941747824 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fafa403ec40 con 0x7fafb409d450 2023-09-30T22:31:41.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.243+0000 7fafb95ec700 1 -- 172.21.15.40:0/3941747824 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb4062380 con 0x7fafb409d450 2023-09-30T22:31:41.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.252+0000 7faf9b7fe700 1 -- 172.21.15.40:0/3941747824 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fafa400e280 con 0x7fafb409d450 2023-09-30T22:31:41.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.274+0000 7fcaac9c1700 1 Processor -- start 2023-09-30T22:31:41.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.274+0000 7fcaac9c1700 1 -- start start 2023-09-30T22:31:41.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.274+0000 7fcaac9c1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcaa809d920 0x7fcaa809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.274+0000 7fcaac9c1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcaa809e230 0x7fcaa81343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.274+0000 7fcaac9c1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaa809f940 con 0x7fcaa809f0f0 2023-09-30T22:31:41.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.274+0000 7fcaac9c1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa806b4c0 con 0x7fcaa809d920 2023-09-30T22:31:41.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.274+0000 7fcaac9c1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa809a8f0 con 0x7fcaa809e230 2023-09-30T22:31:41.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.275+0000 7fcaa659c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcaa809d920 0x7fcaa809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.275+0000 7fcaa659c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcaa809d920 0x7fcaa809dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47580/0 (socket says 172.21.15.40:47580) 2023-09-30T22:31:41.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.275+0000 7fcaa659c700 1 -- 172.21.15.40:0/147216310 learned_addr learned my addr 172.21.15.40:0/147216310 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:41.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.275+0000 7fcaa6d9d700 1 --2- 172.21.15.40:0/147216310 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcaa809e230 0x7fcaa81343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.275+0000 7fcaa659c700 1 -- 172.21.15.40:0/147216310 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcaa809e230 msgr2=0x7fcaa81343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:41.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.275+0000 7fcaa659c700 1 --2- 172.21.15.40:0/147216310 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcaa809e230 0x7fcaa81343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.275+0000 7fcaa659c700 1 -- 172.21.15.40:0/147216310 >> v1:172.21.15.40:6789/0 conn(0x7fcaa809f0f0 legacy=0x7fcaa8133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:41.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.275+0000 7fcaa659c700 1 -- 172.21.15.40:0/147216310 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa809f6e0 con 0x7fcaa809d920 2023-09-30T22:31:41.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.275+0000 7fcaa659c700 1 --2- 172.21.15.40:0/147216310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcaa809d920 0x7fcaa809dcf0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fca98006fd0 tx=0x7fca98009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acaedbb1e4fa55c6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:41.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.276+0000 7fcaa559a700 1 -- 172.21.15.40:0/147216310 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca98005e30 con 0x7fcaa809d920 2023-09-30T22:31:41.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.276+0000 7fcaa559a700 1 -- 172.21.15.40:0/147216310 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca98004030 con 0x7fcaa809d920 2023-09-30T22:31:41.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.276+0000 7fcaa559a700 1 -- 172.21.15.40:0/147216310 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca980043e0 con 0x7fcaa809d920 2023-09-30T22:31:41.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.276+0000 7fcaac9c1700 1 -- 172.21.15.40:0/147216310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcaa809d920 msgr2=0x7fcaa809dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:41.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.276+0000 7fcaac9c1700 1 --2- 172.21.15.40:0/147216310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcaa809d920 0x7fcaa809dcf0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fca98006fd0 tx=0x7fca98009bd0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.276+0000 7fcaac9c1700 1 -- 172.21.15.40:0/147216310 shutdown_connections 2023-09-30T22:31:41.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.276+0000 7fcaac9c1700 1 --2- 172.21.15.40:0/147216310 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcaa809e230 0x7fcaa81343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.276+0000 7fcaac9c1700 1 --2- 172.21.15.40:0/147216310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcaa809d920 0x7fcaa809dcf0 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.276+0000 7fcaac9c1700 1 -- 172.21.15.40:0/147216310 >> 172.21.15.40:0/147216310 conn(0x7fcaa809fb20 msgr2=0x7fcaa809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:41.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.276+0000 7fcaac9c1700 1 -- 172.21.15.40:0/147216310 shutdown_connections 2023-09-30T22:31:41.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.276+0000 7fcaac9c1700 1 -- 172.21.15.40:0/147216310 wait complete. 2023-09-30T22:31:41.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.278+0000 7fcaac9c1700 1 Processor -- start 2023-09-30T22:31:41.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.278+0000 7fcaac9c1700 1 -- start start 2023-09-30T22:31:41.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.278+0000 7fcaac9c1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcaa809d920 0x7fcaa81a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.278+0000 7fcaac9c1700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcaa809e230 0x7fcaa81a67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.278+0000 7fcaac9c1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcaa81a6ce0 0x7fcaa81ced60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.278+0000 7fcaac9c1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa81a7730 con 0x7fcaa809d920 2023-09-30T22:31:41.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.278+0000 7fcaac9c1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa81a9d80 con 0x7fcaa81a6ce0 2023-09-30T22:31:41.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.278+0000 7fcaac9c1700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa81a9150 con 0x7fcaa809e230 2023-09-30T22:31:41.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.278+0000 7fcaa659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcaa809d920 0x7fcaa81a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.278+0000 7fcaa659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcaa809d920 0x7fcaa81a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47584/0 (socket says 172.21.15.40:47584) 2023-09-30T22:31:41.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.278+0000 7fcaa659c700 1 -- 172.21.15.40:0/2679944201 learned_addr learned my addr 172.21.15.40:0/2679944201 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:41.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.278+0000 7fcaa6d9d700 1 --2- 172.21.15.40:0/2679944201 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcaa81a6ce0 0x7fcaa81ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.278+0000 7fcaa5d9b700 1 --2- 172.21.15.40:0/2679944201 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcaa809e230 0x7fcaa81a67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.279+0000 7fcaa6d9d700 1 -- 172.21.15.40:0/2679944201 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcaa809e230 msgr2=0x7fcaa81a67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:41.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.279+0000 7fcaa6d9d700 1 --2- 172.21.15.40:0/2679944201 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcaa809e230 0x7fcaa81a67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.279+0000 7fcaa6d9d700 1 -- 172.21.15.40:0/2679944201 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcaa809d920 msgr2=0x7fcaa81a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:41.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.279+0000 7fcaa6d9d700 1 --2- 172.21.15.40:0/2679944201 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcaa809d920 0x7fcaa81a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.279+0000 7fcaa6d9d700 1 -- 172.21.15.40:0/2679944201 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca98009500 con 0x7fcaa81a6ce0 2023-09-30T22:31:41.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.279+0000 7fcaa659c700 1 --2- 172.21.15.40:0/2679944201 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcaa809d920 0x7fcaa81a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:41.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.279+0000 7fcaa6d9d700 1 --2- 172.21.15.40:0/2679944201 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcaa81a6ce0 0x7fcaa81ced60 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0009d90 tx=0x7fcaa000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:41.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.279+0000 7fca96ffd700 1 -- 172.21.15.40:0/2679944201 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa0009c00 con 0x7fcaa81a6ce0 2023-09-30T22:31:41.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.279+0000 7fca96ffd700 1 -- 172.21.15.40:0/2679944201 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa000f040 con 0x7fcaa81a6ce0 2023-09-30T22:31:41.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.279+0000 7fcaac9c1700 1 -- 172.21.15.40:0/2679944201 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa81a8450 con 0x7fcaa81a6ce0 2023-09-30T22:31:41.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.279+0000 7fca96ffd700 1 -- 172.21.15.40:0/2679944201 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa0014480 con 0x7fcaa81a6ce0 2023-09-30T22:31:41.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.279+0000 7fcaac9c1700 1 -- 172.21.15.40:0/2679944201 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa809c9e0 con 0x7fcaa81a6ce0 2023-09-30T22:31:41.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.280+0000 7fca96ffd700 1 -- 172.21.15.40:0/2679944201 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcaa00145e0 con 0x7fcaa81a6ce0 2023-09-30T22:31:41.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.280+0000 7fcaac9c1700 1 -- 172.21.15.40:0/2679944201 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaa81a9740 con 0x7fcaa81a6ce0 2023-09-30T22:31:41.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.280+0000 7fca96ffd700 1 -- 172.21.15.40:0/2679944201 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fcaa0040200 con 0x7fcaa81a6ce0 2023-09-30T22:31:41.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.285+0000 7fca96ffd700 1 -- 172.21.15.40:0/2679944201 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcaa81a9740 con 0x7fcaa81a6ce0 2023-09-30T22:31:41.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.319+0000 7f135c5b4700 1 Processor -- start 2023-09-30T22:31:41.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.319+0000 7f135c5b4700 1 -- start start 2023-09-30T22:31:41.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.320+0000 7f135c5b4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1354136bf0 0x7f1354138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.320+0000 7f135c5b4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1354139510 0x7f135413b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.320+0000 7f135c5b4700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13540a2600 con 0x7f135409c890 2023-09-30T22:31:41.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.320+0000 7f135c5b4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13540a29d0 con 0x7f1354136bf0 2023-09-30T22:31:41.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.320+0000 7f135c5b4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f135409fb40 con 0x7f1354139510 2023-09-30T22:31:41.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.321+0000 7f1359b4f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1354136bf0 0x7f1354138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.321+0000 7f135a350700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f135409c890 0x7f135409cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:36076/0 (socket says 172.21.15.40:36076) 2023-09-30T22:31:41.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.321+0000 7f135a350700 1 -- 172.21.15.40:0/170433668 learned_addr learned my addr 172.21.15.40:0/170433668 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:41.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.321+0000 7f135ab51700 1 --2- 172.21.15.40:0/170433668 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1354139510 0x7f135413b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.321+0000 7f135934e700 1 -- 172.21.15.40:0/170433668 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 666465696 0 0) 0x7f13540a2600 con 0x7f135409c890 2023-09-30T22:31:41.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.321+0000 7f135934e700 1 -- 172.21.15.40:0/170433668 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13400035b0 con 0x7f135409c890 2023-09-30T22:31:41.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.321+0000 7f1359b4f700 1 -- 172.21.15.40:0/170433668 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1354139510 msgr2=0x7f135413b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:41.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.321+0000 7f1359b4f700 1 --2- 172.21.15.40:0/170433668 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1354139510 0x7f135413b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.321+0000 7f1359b4f700 1 -- 172.21.15.40:0/170433668 >> v1:172.21.15.40:6789/0 conn(0x7f135409c890 legacy=0x7f135409cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:41.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.321+0000 7f1359b4f700 1 -- 172.21.15.40:0/170433668 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135409d370 con 0x7f1354136bf0 2023-09-30T22:31:41.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.321+0000 7f135ab51700 1 --2- 172.21.15.40:0/170433668 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1354139510 0x7f135413b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:41.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.321+0000 7f1359b4f700 1 --2- 172.21.15.40:0/170433668 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1354136bf0 0x7f1354138fd0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f1344009870 tx=0x7f1344009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d552e4fc15269026 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:41.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.322+0000 7f135934e700 1 -- 172.21.15.40:0/170433668 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1344011830 con 0x7f1354136bf0 2023-09-30T22:31:41.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.322+0000 7f135934e700 1 -- 172.21.15.40:0/170433668 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1344011990 con 0x7f1354136bf0 2023-09-30T22:31:41.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.322+0000 7f135934e700 1 -- 172.21.15.40:0/170433668 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1344011d20 con 0x7f1354136bf0 2023-09-30T22:31:41.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.322+0000 7f135c5b4700 1 -- 172.21.15.40:0/170433668 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1354136bf0 msgr2=0x7f1354138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:41.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.322+0000 7f135c5b4700 1 --2- 172.21.15.40:0/170433668 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1354136bf0 0x7f1354138fd0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f1344009870 tx=0x7f1344009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:41.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.322+0000 7f135c5b4700 1 -- 172.21.15.40:0/170433668 shutdown_connections 2023-09-30T22:31:41.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.322+0000 7f135c5b4700 1 --2- 172.21.15.40:0/170433668 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1354139510 0x7f135413b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.322+0000 7f135c5b4700 1 --2- 172.21.15.40:0/170433668 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1354136bf0 0x7f1354138fd0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.322+0000 7f135c5b4700 1 -- 172.21.15.40:0/170433668 >> 172.21.15.40:0/170433668 conn(0x7f13540a7080 msgr2=0x7f13540a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:41.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.322+0000 7f135c5b4700 1 -- 172.21.15.40:0/170433668 shutdown_connections 2023-09-30T22:31:41.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.322+0000 7f135c5b4700 1 -- 172.21.15.40:0/170433668 wait complete. 2023-09-30T22:31:41.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.323+0000 7f135c5b4700 1 Processor -- start 2023-09-30T22:31:41.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.323+0000 7f135c5b4700 1 -- start start 2023-09-30T22:31:41.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.324+0000 7f135c5b4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f135409c890 0x7f135406eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.324+0000 7f135c5b4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1354136bf0 0x7f135406f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.324+0000 7f135c5b4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1354139510 0x7f135406f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.324+0000 7f135c5b4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1354097790 con 0x7f135409c890 2023-09-30T22:31:41.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.324+0000 7f135c5b4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135409c330 con 0x7f1354136bf0 2023-09-30T22:31:41.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.324+0000 7f135c5b4700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13540a5f80 con 0x7f1354139510 2023-09-30T22:31:41.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.324+0000 7f1359b4f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1354136bf0 0x7f135406f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.324+0000 7f1359b4f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1354136bf0 0x7f135406f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:51674/0 (socket says 172.21.15.40:51674) 2023-09-30T22:31:41.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.324+0000 7f1359b4f700 1 -- 172.21.15.40:0/2337298426 learned_addr learned my addr 172.21.15.40:0/2337298426 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:41.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.324+0000 7f135a350700 1 --2- 172.21.15.40:0/2337298426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f135409c890 0x7f135406eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.324+0000 7f135ab51700 1 --2- 172.21.15.40:0/2337298426 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1354139510 0x7f135406f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.325+0000 7f1359b4f700 1 -- 172.21.15.40:0/2337298426 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1354139510 msgr2=0x7f135406f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:41.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.325+0000 7f1359b4f700 1 --2- 172.21.15.40:0/2337298426 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1354139510 0x7f135406f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.325+0000 7f1359b4f700 1 -- 172.21.15.40:0/2337298426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f135409c890 msgr2=0x7f135406eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:41.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.325+0000 7f1359b4f700 1 --2- 172.21.15.40:0/2337298426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f135409c890 0x7f135406eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.325+0000 7f1359b4f700 1 -- 172.21.15.40:0/2337298426 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f134c009a70 con 0x7f1354136bf0 2023-09-30T22:31:41.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.325+0000 7f135a350700 1 --2- 172.21.15.40:0/2337298426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f135409c890 0x7f135406eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:41.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.325+0000 7f1359b4f700 1 --2- 172.21.15.40:0/2337298426 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1354136bf0 0x7f135406f420 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f1344009840 tx=0x7f1344004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:41.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.325+0000 7f134affd700 1 -- 172.21.15.40:0/2337298426 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13440036a0 con 0x7f1354136bf0 2023-09-30T22:31:41.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.325+0000 7f134affd700 1 -- 172.21.15.40:0/2337298426 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134401e070 con 0x7f1354136bf0 2023-09-30T22:31:41.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.325+0000 7f135c5b4700 1 -- 172.21.15.40:0/2337298426 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13440094a0 con 0x7f1354136bf0 2023-09-30T22:31:41.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.325+0000 7f134affd700 1 -- 172.21.15.40:0/2337298426 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1344003a60 con 0x7f1354136bf0 2023-09-30T22:31:41.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.325+0000 7f135c5b4700 1 -- 172.21.15.40:0/2337298426 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1354097a70 con 0x7f1354136bf0 2023-09-30T22:31:41.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.326+0000 7f134affd700 1 -- 172.21.15.40:0/2337298426 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1344003bc0 con 0x7f1354136bf0 2023-09-30T22:31:41.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.326+0000 7f134affd700 1 -- 172.21.15.40:0/2337298426 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f1344020070 con 0x7f1354136bf0 2023-09-30T22:31:41.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.326+0000 7f135c5b4700 1 -- 172.21.15.40:0/2337298426 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1354097430 con 0x7f1354136bf0 2023-09-30T22:31:41.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.336+0000 7f134affd700 1 -- 172.21.15.40:0/2337298426 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1354097430 con 0x7f1354136bf0 2023-09-30T22:31:41.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.371+0000 7f2b7b06f700 1 Processor -- start 2023-09-30T22:31:41.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.371+0000 7f2b7b06f700 1 -- start start 2023-09-30T22:31:41.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.371+0000 7f2b7b06f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b7409f0f0 0x7f2b74138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.371+0000 7f2b7b06f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2b7409e400 0x7f2b7413b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.371+0000 7f2b7b06f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b7409f940 con 0x7f2b7409d920 2023-09-30T22:31:41.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.371+0000 7f2b7b06f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7406b4c0 con 0x7f2b7409f0f0 2023-09-30T22:31:41.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.371+0000 7f2b7b06f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7409a8f0 con 0x7f2b7409e400 2023-09-30T22:31:41.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.372+0000 7f2b78e0b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2b7409d920 0x7f2b7409dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:36088/0 (socket says 172.21.15.40:36088) 2023-09-30T22:31:41.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.372+0000 7f2b7960c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2b7409e400 0x7f2b7413b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.372+0000 7f2b78e0b700 1 -- 172.21.15.40:0/4213041319 learned_addr learned my addr 172.21.15.40:0/4213041319 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:41.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.372+0000 7f2b73fff700 1 --2- 172.21.15.40:0/4213041319 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b7409f0f0 0x7f2b74138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.372+0000 7f2b737fe700 1 -- 172.21.15.40:0/4213041319 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 13451366 0 0) 0x7f2b7409f940 con 0x7f2b7409d920 2023-09-30T22:31:41.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.372+0000 7f2b7960c700 1 -- 172.21.15.40:0/4213041319 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b7409f0f0 msgr2=0x7f2b74138ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:41.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.372+0000 7f2b7960c700 1 --2- 172.21.15.40:0/4213041319 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b7409f0f0 0x7f2b74138ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.372+0000 7f2b7960c700 1 -- 172.21.15.40:0/4213041319 >> v1:172.21.15.40:6789/0 conn(0x7f2b7409d920 legacy=0x7f2b7409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:41.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.372+0000 7f2b7960c700 1 -- 172.21.15.40:0/4213041319 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7409f6e0 con 0x7f2b7409e400 2023-09-30T22:31:41.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.372+0000 7f2b73fff700 1 --2- 172.21.15.40:0/4213041319 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b7409f0f0 0x7f2b74138ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:41.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.372+0000 7f2b7960c700 1 --2- 172.21.15.40:0/4213041319 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2b7409e400 0x7f2b7413b430 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c009df0 tx=0x7f2b6c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f23d874b820805b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:41.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.372+0000 7f2b737fe700 1 -- 172.21.15.40:0/4213041319 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c00e070 con 0x7f2b7409e400 2023-09-30T22:31:41.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.373+0000 7f2b737fe700 1 -- 172.21.15.40:0/4213041319 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6c00bae0 con 0x7f2b7409e400 2023-09-30T22:31:41.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.373+0000 7f2b737fe700 1 -- 172.21.15.40:0/4213041319 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c00be90 con 0x7f2b7409e400 2023-09-30T22:31:41.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.373+0000 7f2b7b06f700 1 -- 172.21.15.40:0/4213041319 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2b7409e400 msgr2=0x7f2b7413b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:41.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.373+0000 7f2b7b06f700 1 --2- 172.21.15.40:0/4213041319 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2b7409e400 0x7f2b7413b430 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c009df0 tx=0x7f2b6c00b330 comp rx=0 tx=0).stop 2023-09-30T22:31:41.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.373+0000 7f2b7b06f700 1 -- 172.21.15.40:0/4213041319 shutdown_connections 2023-09-30T22:31:41.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.373+0000 7f2b7b06f700 1 --2- 172.21.15.40:0/4213041319 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2b7409e400 0x7f2b7413b430 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.373+0000 7f2b7b06f700 1 --2- 172.21.15.40:0/4213041319 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b7409f0f0 0x7f2b74138ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.373+0000 7f2b7b06f700 1 -- 172.21.15.40:0/4213041319 >> 172.21.15.40:0/4213041319 conn(0x7f2b7409fb20 msgr2=0x7f2b7409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:41.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.373+0000 7f2b7b06f700 1 -- 172.21.15.40:0/4213041319 shutdown_connections 2023-09-30T22:31:41.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.374+0000 7f2b7b06f700 1 -- 172.21.15.40:0/4213041319 wait complete. 2023-09-30T22:31:41.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.375+0000 7f2b7b06f700 1 Processor -- start 2023-09-30T22:31:41.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.375+0000 7f2b7b06f700 1 -- start start 2023-09-30T22:31:41.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.376+0000 7f2b7b06f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b7409d920 0x7f2b7411db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.376+0000 7f2b7b06f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b7409e400 0x7f2b7411e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.376+0000 7f2b7b06f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2b7411e5c0 0x7f2b741ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:41.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.376+0000 7f2b7b06f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7411fec0 con 0x7f2b7409e400 2023-09-30T22:31:41.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.376+0000 7f2b7b06f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b74120b10 con 0x7f2b7409d920 2023-09-30T22:31:41.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.376+0000 7f2b7b06f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b741201a0 con 0x7f2b7411e5c0 2023-09-30T22:31:41.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.376+0000 7f2b7960c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2b7411e5c0 0x7f2b741ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.376+0000 7f2b7960c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2b7411e5c0 0x7f2b741ce8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48412/0 (socket says 172.21.15.40:48412) 2023-09-30T22:31:41.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.376+0000 7f2b7960c700 1 -- 172.21.15.40:0/3512087107 learned_addr learned my addr 172.21.15.40:0/3512087107 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:41.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.376+0000 7f2b78e0b700 1 --2- 172.21.15.40:0/3512087107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b7409d920 0x7f2b7411db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:41.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.376+0000 7f2b7960c700 1 -- 172.21.15.40:0/3512087107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b7409d920 msgr2=0x7f2b7411db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:41.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.376+0000 7f2b7960c700 1 --2- 172.21.15.40:0/3512087107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b7409d920 0x7f2b7411db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.376+0000 7f2b7960c700 1 -- 172.21.15.40:0/3512087107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b7409e400 msgr2=0x7f2b7411e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:41.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.376+0000 7f2b7960c700 1 --2- 172.21.15.40:0/3512087107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b7409e400 0x7f2b7411e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.376+0000 7f2b7960c700 1 -- 172.21.15.40:0/3512087107 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b600094a0 con 0x7f2b7411e5c0 2023-09-30T22:31:41.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.377+0000 7f2b7960c700 1 --2- 172.21.15.40:0/3512087107 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2b7411e5c0 0x7f2b741ce8b0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f2b7409cd10 tx=0x7f2b6c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:41.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.377+0000 7f2b717fa700 1 -- 172.21.15.40:0/3512087107 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c027680 con 0x7f2b7411e5c0 2023-09-30T22:31:41.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.377+0000 7f2b717fa700 1 -- 172.21.15.40:0/3512087107 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6c020070 con 0x7f2b7411e5c0 2023-09-30T22:31:41.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.377+0000 7f2b7b06f700 1 -- 172.21.15.40:0/3512087107 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b6c009a70 con 0x7f2b7411e5c0 2023-09-30T22:31:41.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.377+0000 7f2b717fa700 1 -- 172.21.15.40:0/3512087107 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c027a40 con 0x7f2b7411e5c0 2023-09-30T22:31:41.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.377+0000 7f2b7b06f700 1 -- 172.21.15.40:0/3512087107 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b7411fc00 con 0x7f2b7411e5c0 2023-09-30T22:31:41.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.378+0000 7f2b7b06f700 1 -- 172.21.15.40:0/3512087107 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b74062380 con 0x7f2b7411e5c0 2023-09-30T22:31:41.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.379+0000 7f2b717fa700 1 -- 172.21.15.40:0/3512087107 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2b6c01c400 con 0x7f2b7411e5c0 2023-09-30T22:31:41.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.381+0000 7f2b717fa700 1 -- 172.21.15.40:0/3512087107 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f2b6c022070 con 0x7f2b7411e5c0 2023-09-30T22:31:41.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.387+0000 7f2b717fa700 1 -- 172.21.15.40:0/3512087107 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2b6c01a380 con 0x7f2b7411e5c0 2023-09-30T22:31:41.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.493+0000 7fafb95ec700 1 -- 172.21.15.40:0/3941747824 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fafb4074330 con 0x7fafb409d450 2023-09-30T22:31:41.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.493+0000 7faf9b7fe700 1 -- 172.21.15.40:0/3941747824 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fafa4017020 con 0x7fafb409d450 2023-09-30T22:31:41.494 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:41.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.496+0000 7fafb95ec700 1 -- 172.21.15.40:0/3941747824 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafb409d450 msgr2=0x7fafb411d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:41.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.496+0000 7fafb95ec700 1 --2- 172.21.15.40:0/3941747824 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafb409d450 0x7fafb411d460 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fafa400c700 tx=0x7fafa400ca10 comp rx=0 tx=0).stop 2023-09-30T22:31:41.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.496+0000 7fafb95ec700 1 -- 172.21.15.40:0/3941747824 shutdown_connections 2023-09-30T22:31:41.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.496+0000 7fafb95ec700 1 --2- 172.21.15.40:0/3941747824 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fafb4135940 0x7fafb411dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.496+0000 7fafb95ec700 1 --2- 172.21.15.40:0/3941747824 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafb409d450 0x7fafb411d460 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.496+0000 7fafb95ec700 1 --2- 172.21.15.40:0/3941747824 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fafb409df30 0x7fafb411d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.496+0000 7fafb95ec700 1 -- 172.21.15.40:0/3941747824 >> 172.21.15.40:0/3941747824 conn(0x7fafb40a2a00 msgr2=0x7fafb4131240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:41.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.496+0000 7fafb95ec700 1 -- 172.21.15.40:0/3941747824 shutdown_connections 2023-09-30T22:31:41.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.496+0000 7fafb95ec700 1 -- 172.21.15.40:0/3941747824 wait complete. 2023-09-30T22:31:41.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:41.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.543+0000 7f135c5b4700 1 -- 172.21.15.40:0/2337298426 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1354097430 con 0x7f1354136bf0 2023-09-30T22:31:41.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.543+0000 7f134affd700 1 -- 172.21.15.40:0/2337298426 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1354097430 con 0x7f1354136bf0 2023-09-30T22:31:41.544 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:41.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.544+0000 7fcaac9c1700 1 -- 172.21.15.40:0/2679944201 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcaa81a9740 con 0x7fcaa81a6ce0 2023-09-30T22:31:41.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.545+0000 7fca96ffd700 1 -- 172.21.15.40:0/2679944201 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcaa81a9740 con 0x7fcaa81a6ce0 2023-09-30T22:31:41.545 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:41.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.546+0000 7f135c5b4700 1 -- 172.21.15.40:0/2337298426 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1354136bf0 msgr2=0x7f135406f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:41.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.546+0000 7f135c5b4700 1 --2- 172.21.15.40:0/2337298426 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1354136bf0 0x7f135406f420 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f1344009840 tx=0x7f1344004750 comp rx=0 tx=0).stop 2023-09-30T22:31:41.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.546+0000 7f135c5b4700 1 -- 172.21.15.40:0/2337298426 shutdown_connections 2023-09-30T22:31:41.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.546+0000 7f135c5b4700 1 --2- 172.21.15.40:0/2337298426 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1354139510 0x7f135406f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.546+0000 7f135c5b4700 1 --2- 172.21.15.40:0/2337298426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f135409c890 0x7f135406eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.546+0000 7f135c5b4700 1 --2- 172.21.15.40:0/2337298426 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1354136bf0 0x7f135406f420 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.546+0000 7f135c5b4700 1 -- 172.21.15.40:0/2337298426 >> 172.21.15.40:0/2337298426 conn(0x7f13540a7080 msgr2=0x7f13541349d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:41.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.546+0000 7f135c5b4700 1 -- 172.21.15.40:0/2337298426 shutdown_connections 2023-09-30T22:31:41.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.546+0000 7f135c5b4700 1 -- 172.21.15.40:0/2337298426 wait complete. 2023-09-30T22:31:41.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.547+0000 7fcaac9c1700 1 -- 172.21.15.40:0/2679944201 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcaa81a6ce0 msgr2=0x7fcaa81ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:41.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.547+0000 7fcaac9c1700 1 --2- 172.21.15.40:0/2679944201 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcaa81a6ce0 0x7fcaa81ced60 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0009d90 tx=0x7fcaa000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.547+0000 7fcaac9c1700 1 -- 172.21.15.40:0/2679944201 shutdown_connections 2023-09-30T22:31:41.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.547+0000 7fcaac9c1700 1 --2- 172.21.15.40:0/2679944201 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcaa81a6ce0 0x7fcaa81ced60 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.547+0000 7fcaac9c1700 1 --2- 172.21.15.40:0/2679944201 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcaa809d920 0x7fcaa81a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.547+0000 7fcaac9c1700 1 --2- 172.21.15.40:0/2679944201 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fcaa809e230 0x7fcaa81a67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.547+0000 7fcaac9c1700 1 -- 172.21.15.40:0/2679944201 >> 172.21.15.40:0/2679944201 conn(0x7fcaa809fb20 msgr2=0x7fcaa81bb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:41.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.547+0000 7fcaac9c1700 1 -- 172.21.15.40:0/2679944201 shutdown_connections 2023-09-30T22:31:41.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.547+0000 7fcaac9c1700 1 -- 172.21.15.40:0/2679944201 wait complete. 2023-09-30T22:31:41.560 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:41.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:41.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.642+0000 7f2b7b06f700 1 -- 172.21.15.40:0/3512087107 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2b74074720 con 0x7f2b7411e5c0 2023-09-30T22:31:41.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.642+0000 7f2b717fa700 1 -- 172.21.15.40:0/3512087107 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2b6c025b70 con 0x7f2b7411e5c0 2023-09-30T22:31:41.643 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:41.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.644+0000 7f2b7b06f700 1 -- 172.21.15.40:0/3512087107 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2b7411e5c0 msgr2=0x7f2b741ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:41.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.644+0000 7f2b7b06f700 1 --2- 172.21.15.40:0/3512087107 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2b7411e5c0 0x7f2b741ce8b0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f2b7409cd10 tx=0x7f2b6c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.644+0000 7f2b7b06f700 1 -- 172.21.15.40:0/3512087107 shutdown_connections 2023-09-30T22:31:41.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.644+0000 7f2b7b06f700 1 --2- 172.21.15.40:0/3512087107 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f2b7411e5c0 0x7f2b741ce8b0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.644+0000 7f2b7b06f700 1 --2- 172.21.15.40:0/3512087107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b7409d920 0x7f2b7411db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.644+0000 7f2b7b06f700 1 --2- 172.21.15.40:0/3512087107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b7409e400 0x7f2b7411e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:41.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.644+0000 7f2b7b06f700 1 -- 172.21.15.40:0/3512087107 >> 172.21.15.40:0/3512087107 conn(0x7f2b7409fb20 msgr2=0x7f2b740a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:41.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.644+0000 7f2b7b06f700 1 -- 172.21.15.40:0/3512087107 shutdown_connections 2023-09-30T22:31:41.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:41.644+0000 7f2b7b06f700 1 -- 172.21.15.40:0/3512087107 wait complete. 2023-09-30T22:31:41.657 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:42.511 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:42.561 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:42.561 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:42.658 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:42.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.658+0000 7fd868f36700 1 Processor -- start 2023-09-30T22:31:42.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.658+0000 7fd868f36700 1 -- start start 2023-09-30T22:31:42.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.659+0000 7fd868f36700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd864133e00 0x7fd8641341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:42.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.659+0000 7fd868f36700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd86409d400 0x7fd86409d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:42.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.659+0000 7fd868f36700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd86409dd70 0x7fd86413ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:42.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.659+0000 7fd868f36700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd86409ab20 con 0x7fd86409d400 2023-09-30T22:31:42.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.659+0000 7fd868f36700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd864133940 con 0x7fd864133e00 2023-09-30T22:31:42.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.659+0000 7fd868f36700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd86409f0d0 con 0x7fd86409dd70 2023-09-30T22:31:42.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.659+0000 7fd861d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd86409d400 0x7fd86409d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:42.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.659+0000 7fd861d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd86409d400 0x7fd86409d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47612/0 (socket says 172.21.15.40:47612) 2023-09-30T22:31:42.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.659+0000 7fd861d9b700 1 -- 172.21.15.40:0/3976476925 learned_addr learned my addr 172.21.15.40:0/3976476925 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:42.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.659+0000 7fd862d9d700 1 --2- 172.21.15.40:0/3976476925 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd86409dd70 0x7fd86413ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:42.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.659+0000 7fd86259c700 1 --2- 172.21.15.40:0/3976476925 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd864133e00 0x7fd8641341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:42.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.659+0000 7fd861d9b700 1 -- 172.21.15.40:0/3976476925 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd86409dd70 msgr2=0x7fd86413ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:42.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.659+0000 7fd861d9b700 1 --2- 172.21.15.40:0/3976476925 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd86409dd70 0x7fd86413ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.659+0000 7fd861d9b700 1 -- 172.21.15.40:0/3976476925 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd864133e00 msgr2=0x7fd8641341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:42.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.659+0000 7fd861d9b700 1 --2- 172.21.15.40:0/3976476925 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd864133e00 0x7fd8641341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.659+0000 7fd861d9b700 1 -- 172.21.15.40:0/3976476925 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd86409e210 con 0x7fd86409d400 2023-09-30T22:31:42.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.660+0000 7fd861d9b700 1 --2- 172.21.15.40:0/3976476925 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd86409d400 0x7fd86409d830 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fd8580098f0 tx=0x7fd858009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cefdb906ab093430 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:42.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.660+0000 7fd86159a700 1 -- 172.21.15.40:0/3976476925 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd858011830 con 0x7fd86409d400 2023-09-30T22:31:42.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.660+0000 7fd86159a700 1 -- 172.21.15.40:0/3976476925 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd858011990 con 0x7fd86409d400 2023-09-30T22:31:42.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.660+0000 7fd86159a700 1 -- 172.21.15.40:0/3976476925 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd858011d20 con 0x7fd86409d400 2023-09-30T22:31:42.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.660+0000 7fd868f36700 1 -- 172.21.15.40:0/3976476925 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd86409d400 msgr2=0x7fd86409d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:42.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.660+0000 7fd868f36700 1 --2- 172.21.15.40:0/3976476925 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd86409d400 0x7fd86409d830 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fd8580098f0 tx=0x7fd858009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:42.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.661+0000 7fd868f36700 1 -- 172.21.15.40:0/3976476925 shutdown_connections 2023-09-30T22:31:42.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.661+0000 7fd868f36700 1 --2- 172.21.15.40:0/3976476925 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd86409dd70 0x7fd86413ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.661+0000 7fd868f36700 1 --2- 172.21.15.40:0/3976476925 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd864133e00 0x7fd8641341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.661+0000 7fd868f36700 1 --2- 172.21.15.40:0/3976476925 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd86409d400 0x7fd86409d830 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.661+0000 7fd868f36700 1 -- 172.21.15.40:0/3976476925 >> 172.21.15.40:0/3976476925 conn(0x7fd8640a2a00 msgr2=0x7fd8640a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:42.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.661+0000 7fd868f36700 1 -- 172.21.15.40:0/3976476925 shutdown_connections 2023-09-30T22:31:42.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.661+0000 7fd868f36700 1 -- 172.21.15.40:0/3976476925 wait complete. 2023-09-30T22:31:42.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.662+0000 7fd868f36700 1 Processor -- start 2023-09-30T22:31:42.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.662+0000 7fd868f36700 1 -- start start 2023-09-30T22:31:42.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.663+0000 7fd868f36700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd86409d400 0x7fd864119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:42.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.663+0000 7fd868f36700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd86409dd70 0x7fd864119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:42.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.663+0000 7fd868f36700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd864133e00 0x7fd864119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:42.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.663+0000 7fd868f36700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86411ab00 con 0x7fd86409dd70 2023-09-30T22:31:42.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.663+0000 7fd868f36700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86411bbc0 con 0x7fd864133e00 2023-09-30T22:31:42.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.663+0000 7fd868f36700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd86412e1a0 con 0x7fd86409d400 2023-09-30T22:31:42.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.663+0000 7fd86259c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd86409d400 0x7fd864119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:42.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.663+0000 7fd86259c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd86409d400 0x7fd864119050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48438/0 (socket says 172.21.15.40:48438) 2023-09-30T22:31:42.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.663+0000 7fd86259c700 1 -- 172.21.15.40:0/3922384738 learned_addr learned my addr 172.21.15.40:0/3922384738 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:42.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.663+0000 7fd861d9b700 1 --2- 172.21.15.40:0/3922384738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd86409dd70 0x7fd864119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:42.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.663+0000 7fd862d9d700 1 --2- 172.21.15.40:0/3922384738 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd864133e00 0x7fd864119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:42.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.664+0000 7fd861d9b700 1 -- 172.21.15.40:0/3922384738 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd86409d400 msgr2=0x7fd864119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:42.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.664+0000 7fd861d9b700 1 --2- 172.21.15.40:0/3922384738 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd86409d400 0x7fd864119050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.664+0000 7fd861d9b700 1 -- 172.21.15.40:0/3922384738 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd864133e00 msgr2=0x7fd864119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:42.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.664+0000 7fd861d9b700 1 --2- 172.21.15.40:0/3922384738 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd864133e00 0x7fd864119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.664+0000 7fd861d9b700 1 -- 172.21.15.40:0/3922384738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd858009550 con 0x7fd86409dd70 2023-09-30T22:31:42.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.664+0000 7fd86259c700 1 --2- 172.21.15.40:0/3922384738 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd86409d400 0x7fd864119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:42.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.664+0000 7fd861d9b700 1 --2- 172.21.15.40:0/3922384738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd86409dd70 0x7fd864119590 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fd858016000 tx=0x7fd858004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:42.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.664+0000 7fd852ffd700 1 -- 172.21.15.40:0/3922384738 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd858004450 con 0x7fd86409dd70 2023-09-30T22:31:42.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.664+0000 7fd852ffd700 1 -- 172.21.15.40:0/3922384738 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85801e070 con 0x7fd86409dd70 2023-09-30T22:31:42.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.664+0000 7fd868f36700 1 -- 172.21.15.40:0/3922384738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd86409c460 con 0x7fd86409dd70 2023-09-30T22:31:42.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.664+0000 7fd852ffd700 1 -- 172.21.15.40:0/3922384738 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8580038e0 con 0x7fd86409dd70 2023-09-30T22:31:42.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.664+0000 7fd868f36700 1 -- 172.21.15.40:0/3922384738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd86411b770 con 0x7fd86409dd70 2023-09-30T22:31:42.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.666+0000 7fd868f36700 1 -- 172.21.15.40:0/3922384738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd864062380 con 0x7fd86409dd70 2023-09-30T22:31:42.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.666+0000 7fd852ffd700 1 -- 172.21.15.40:0/3922384738 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd858003a40 con 0x7fd86409dd70 2023-09-30T22:31:42.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.666+0000 7fd852ffd700 1 -- 172.21.15.40:0/3922384738 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd8580402c0 con 0x7fd86409dd70 2023-09-30T22:31:42.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.675+0000 7fd852ffd700 1 -- 172.21.15.40:0/3922384738 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd8580239a0 con 0x7fd86409dd70 2023-09-30T22:31:42.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.711+0000 7eff5b3cb700 1 Processor -- start 2023-09-30T22:31:42.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.711+0000 7eff5b3cb700 1 -- start start 2023-09-30T22:31:42.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.712+0000 7eff5b3cb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7eff5409d920 0x7eff5409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:42.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.712+0000 7eff5b3cb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7eff5409f0f0 0x7eff5409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:42.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.712+0000 7eff5b3cb700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff5409f940 con 0x7eff54133ca0 2023-09-30T22:31:42.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.712+0000 7eff5b3cb700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff5406b4c0 con 0x7eff5409d920 2023-09-30T22:31:42.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.712+0000 7eff5b3cb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff5409a8f0 con 0x7eff5409f0f0 2023-09-30T22:31:42.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.712+0000 7eff59968700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7eff54133ca0 0x7eff54134120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:36100/0 (socket says 172.21.15.40:36100) 2023-09-30T22:31:42.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.712+0000 7eff59167700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7eff5409d920 0x7eff5409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:42.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.712+0000 7eff59968700 1 -- 172.21.15.40:0/311194114 learned_addr learned my addr 172.21.15.40:0/311194114 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:42.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.712+0000 7eff58966700 1 --2- 172.21.15.40:0/311194114 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7eff5409f0f0 0x7eff5409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:42.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.713+0000 7eff58966700 1 -- 172.21.15.40:0/311194114 >> v2:172.21.15.40:3300/0 conn(0x7eff5409d920 msgr2=0x7eff5409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:42.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.713+0000 7eff58966700 1 --2- 172.21.15.40:0/311194114 >> v2:172.21.15.40:3300/0 conn(0x7eff5409d920 0x7eff5409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.713+0000 7eff58966700 1 -- 172.21.15.40:0/311194114 >> v1:172.21.15.40:6789/0 conn(0x7eff54133ca0 legacy=0x7eff54134120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:42.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.713+0000 7eff4bfff700 1 -- 172.21.15.40:0/311194114 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2880261736 0 0) 0x7eff5409f940 con 0x7eff54133ca0 2023-09-30T22:31:42.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.713+0000 7eff58966700 1 -- 172.21.15.40:0/311194114 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5409f6e0 con 0x7eff5409f0f0 2023-09-30T22:31:42.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.713+0000 7eff59167700 1 --2- 172.21.15.40:0/311194114 >> v2:172.21.15.40:3300/0 conn(0x7eff5409d920 0x7eff5409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:42.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.713+0000 7eff58966700 1 --2- 172.21.15.40:0/311194114 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7eff5409f0f0 0x7eff5409e230 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7eff44013db0 tx=0x7eff44009660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=766b9b534b99690 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:42.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.713+0000 7eff4bfff700 1 -- 172.21.15.40:0/311194114 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff44009e50 con 0x7eff5409f0f0 2023-09-30T22:31:42.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.713+0000 7eff4bfff700 1 -- 172.21.15.40:0/311194114 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff440128e0 con 0x7eff5409f0f0 2023-09-30T22:31:42.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.713+0000 7eff4bfff700 1 -- 172.21.15.40:0/311194114 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff44012c70 con 0x7eff5409f0f0 2023-09-30T22:31:42.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.714+0000 7eff5b3cb700 1 -- 172.21.15.40:0/311194114 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7eff5409f0f0 msgr2=0x7eff5409e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:42.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.714+0000 7eff5b3cb700 1 --2- 172.21.15.40:0/311194114 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7eff5409f0f0 0x7eff5409e230 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7eff44013db0 tx=0x7eff44009660 comp rx=0 tx=0).stop 2023-09-30T22:31:42.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.714+0000 7eff5b3cb700 1 -- 172.21.15.40:0/311194114 shutdown_connections 2023-09-30T22:31:42.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.714+0000 7eff5b3cb700 1 --2- 172.21.15.40:0/311194114 >> v2:172.21.15.40:3300/0 conn(0x7eff5409d920 0x7eff5409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.714+0000 7eff5b3cb700 1 --2- 172.21.15.40:0/311194114 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7eff5409f0f0 0x7eff5409e230 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.714+0000 7eff5b3cb700 1 -- 172.21.15.40:0/311194114 >> 172.21.15.40:0/311194114 conn(0x7eff5409fb20 msgr2=0x7eff5409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:42.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.714+0000 7eff5b3cb700 1 -- 172.21.15.40:0/311194114 shutdown_connections 2023-09-30T22:31:42.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.714+0000 7eff5b3cb700 1 -- 172.21.15.40:0/311194114 wait complete. 2023-09-30T22:31:42.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.715+0000 7f71e25fe700 1 Processor -- start 2023-09-30T22:31:42.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.715+0000 7f71e25fe700 1 -- start start 2023-09-30T22:31:42.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.715+0000 7eff5b3cb700 1 Processor -- start 2023-09-30T22:31:42.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.715+0000 7eff5b3cb700 1 -- start start 2023-09-30T22:31:42.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.716+0000 7f71e25fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f71dc131d50 0x7f71dc132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:42.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.716+0000 7f71e25fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f71dc09bc50 0x7f71dc09c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:42.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.716+0000 7f71e25fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71dc09c600 0x7f71dc138ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:42.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.716+0000 7f71e25fe700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71dc0719e0 con 0x7f71dc131d50 2023-09-30T22:31:42.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.716+0000 7f71e25fe700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc132660 con 0x7f71dc09c600 2023-09-30T22:31:42.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.716+0000 7f71e25fe700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc09ca50 con 0x7f71dc09bc50 2023-09-30T22:31:42.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.716+0000 7eff5b3cb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff5409d920 0x7eff54070910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:42.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.716+0000 7eff5b3cb700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff54133ca0 0x7eff54070e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:42.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.716+0000 7eff5b3cb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7eff5412d2c0 0x7eff54071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:42.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.716+0000 7eff5b3cb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff54119d40 con 0x7eff5409d920 2023-09-30T22:31:42.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.716+0000 7eff5b3cb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff54119b50 con 0x7eff5412d2c0 2023-09-30T22:31:42.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.716+0000 7eff5b3cb700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff540a25a0 con 0x7eff54133ca0 2023-09-30T22:31:42.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.716+0000 7f71db7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f71dc09bc50 0x7f71dc09c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:42.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.716+0000 7f71db7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f71dc09bc50 0x7f71dc09c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48454/0 (socket says 172.21.15.40:48454) 2023-09-30T22:31:42.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.716+0000 7f71db7fe700 1 -- 172.21.15.40:0/2905640695 learned_addr learned my addr 172.21.15.40:0/2905640695 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:42.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.716+0000 7eff59167700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff5409d920 0x7eff54070910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:42.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.716+0000 7f71db7fe700 1 -- 172.21.15.40:0/2905640695 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71dc09c600 msgr2=0x7f71dc138ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:42.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.716+0000 7f71db7fe700 1 --2- 172.21.15.40:0/2905640695 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71dc09c600 0x7f71dc138ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.716+0000 7eff59167700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff5409d920 0x7eff54070910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47646/0 (socket says 172.21.15.40:47646) 2023-09-30T22:31:42.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.716+0000 7eff59167700 1 -- 172.21.15.40:0/420248367 learned_addr learned my addr 172.21.15.40:0/420248367 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:42.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.716+0000 7f71db7fe700 1 -- 172.21.15.40:0/2905640695 >> v2:172.21.15.40:3300/0 conn(0x7f71dc131d50 msgr2=0x7f71dc132120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:42.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.716+0000 7f71db7fe700 1 --2- 172.21.15.40:0/2905640695 >> v2:172.21.15.40:3300/0 conn(0x7f71dc131d50 0x7f71dc132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.716+0000 7f71db7fe700 1 -- 172.21.15.40:0/2905640695 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71dc131900 con 0x7f71dc09bc50 2023-09-30T22:31:42.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.717+0000 7f71db7fe700 1 --2- 172.21.15.40:0/2905640695 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f71dc09bc50 0x7f71dc09c0c0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f71d000f9b0 tx=0x7f71d000fcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4fd5908b5cec291 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:42.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.717+0000 7eff59167700 1 -- 172.21.15.40:0/420248367 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff54133ca0 msgr2=0x7eff54070e50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:31:42.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.717+0000 7eff59167700 1 --2- 172.21.15.40:0/420248367 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff54133ca0 0x7eff54070e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.717+0000 7eff59167700 1 -- 172.21.15.40:0/420248367 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7eff5412d2c0 msgr2=0x7eff54071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:42.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.717+0000 7eff59167700 1 --2- 172.21.15.40:0/420248367 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7eff5412d2c0 0x7eff54071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.717+0000 7eff59167700 1 -- 172.21.15.40:0/420248367 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff50009430 con 0x7eff5409d920 2023-09-30T22:31:42.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.717+0000 7f71daffd700 1 -- 172.21.15.40:0/2905640695 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d000f240 con 0x7f71dc09bc50 2023-09-30T22:31:42.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.717+0000 7eff59167700 1 --2- 172.21.15.40:0/420248367 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff5409d920 0x7eff54070910 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7eff5000ec10 tx=0x7eff50009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:42.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.717+0000 7f71daffd700 1 -- 172.21.15.40:0/2905640695 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d000f3a0 con 0x7f71dc09bc50 2023-09-30T22:31:42.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.717+0000 7f71daffd700 1 -- 172.21.15.40:0/2905640695 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d0009bc0 con 0x7f71dc09bc50 2023-09-30T22:31:42.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.717+0000 7eff49ffb700 1 -- 172.21.15.40:0/420248367 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff50005a20 con 0x7eff5409d920 2023-09-30T22:31:42.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.717+0000 7eff49ffb700 1 -- 172.21.15.40:0/420248367 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff50005b80 con 0x7eff5409d920 2023-09-30T22:31:42.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.717+0000 7eff5b3cb700 1 -- 172.21.15.40:0/420248367 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff44013a10 con 0x7eff5409d920 2023-09-30T22:31:42.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.717+0000 7eff49ffb700 1 -- 172.21.15.40:0/420248367 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5000c940 con 0x7eff5409d920 2023-09-30T22:31:42.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.717+0000 7eff5b3cb700 1 -- 172.21.15.40:0/420248367 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff5411a3b0 con 0x7eff5409d920 2023-09-30T22:31:42.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.718+0000 7f71e25fe700 1 -- 172.21.15.40:0/2905640695 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f71dc09bc50 msgr2=0x7f71dc09c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:42.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.718+0000 7f71e25fe700 1 --2- 172.21.15.40:0/2905640695 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f71dc09bc50 0x7f71dc09c0c0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f71d000f9b0 tx=0x7f71d000fcc0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.718+0000 7eff5b3cb700 1 -- 172.21.15.40:0/420248367 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff54133260 con 0x7eff5409d920 2023-09-30T22:31:42.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.718+0000 7f71e25fe700 1 -- 172.21.15.40:0/2905640695 shutdown_connections 2023-09-30T22:31:42.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.718+0000 7f71e25fe700 1 --2- 172.21.15.40:0/2905640695 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71dc09c600 0x7f71dc138ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.718+0000 7f71e25fe700 1 --2- 172.21.15.40:0/2905640695 >> v2:172.21.15.40:3300/0 conn(0x7f71dc131d50 0x7f71dc132120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.718+0000 7f71e25fe700 1 --2- 172.21.15.40:0/2905640695 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f71dc09bc50 0x7f71dc09c0c0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.718+0000 7f71e25fe700 1 -- 172.21.15.40:0/2905640695 >> 172.21.15.40:0/2905640695 conn(0x7f71dc0a2a00 msgr2=0x7f71dc0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:42.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.719+0000 7eff49ffb700 1 -- 172.21.15.40:0/420248367 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7eff5000caa0 con 0x7eff5409d920 2023-09-30T22:31:42.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.719+0000 7eff49ffb700 1 -- 172.21.15.40:0/420248367 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7eff5003ff80 con 0x7eff5409d920 2023-09-30T22:31:42.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.720+0000 7f71e25fe700 1 -- 172.21.15.40:0/2905640695 shutdown_connections 2023-09-30T22:31:42.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.724+0000 7f71e25fe700 1 -- 172.21.15.40:0/2905640695 wait complete. 2023-09-30T22:31:42.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.726+0000 7f71e25fe700 1 Processor -- start 2023-09-30T22:31:42.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.726+0000 7f71e25fe700 1 -- start start 2023-09-30T22:31:42.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.727+0000 7f71e25fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71dc09bc50 0x7f71dc119c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:42.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.727+0000 7f71e25fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f71dc09c600 0x7f71dc11a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:42.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.727+0000 7f71e25fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71dc131d50 0x7f71dc11a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:42.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.727+0000 7f71e25fe700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc11b080 con 0x7f71dc131d50 2023-09-30T22:31:42.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.727+0000 7f71e25fe700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc11d740 con 0x7f71dc09bc50 2023-09-30T22:31:42.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.727+0000 7f71e25fe700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc11bde0 con 0x7f71dc09c600 2023-09-30T22:31:42.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.727+0000 7f71db7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f71dc09c600 0x7f71dc11a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:42.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.727+0000 7f71db7fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f71dc09c600 0x7f71dc11a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:48470/0 (socket says 172.21.15.40:48470) 2023-09-30T22:31:42.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.727+0000 7f71db7fe700 1 -- 172.21.15.40:0/3705241394 learned_addr learned my addr 172.21.15.40:0/3705241394 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:42.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.727+0000 7f71dbfff700 1 --2- 172.21.15.40:0/3705241394 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71dc09bc50 0x7f71dc119c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:42.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.727+0000 7f71e0b9b700 1 --2- 172.21.15.40:0/3705241394 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71dc131d50 0x7f71dc11a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:42.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.727+0000 7f71db7fe700 1 -- 172.21.15.40:0/3705241394 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71dc09bc50 msgr2=0x7f71dc119c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:42.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.727+0000 7f71db7fe700 1 --2- 172.21.15.40:0/3705241394 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71dc09bc50 0x7f71dc119c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.727+0000 7f71db7fe700 1 -- 172.21.15.40:0/3705241394 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71dc131d50 msgr2=0x7f71dc11a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:42.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.727+0000 7f71db7fe700 1 --2- 172.21.15.40:0/3705241394 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71dc131d50 0x7f71dc11a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.727+0000 7f71db7fe700 1 -- 172.21.15.40:0/3705241394 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d000f610 con 0x7f71dc09c600 2023-09-30T22:31:42.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.727+0000 7f71e0b9b700 1 --2- 172.21.15.40:0/3705241394 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71dc131d50 0x7f71dc11a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:42.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.727+0000 7f71dbfff700 1 --2- 172.21.15.40:0/3705241394 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71dc09bc50 0x7f71dc119c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:42.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.728+0000 7f71db7fe700 1 --2- 172.21.15.40:0/3705241394 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f71dc09c600 0x7f71dc11a160 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f71d0000c00 tx=0x7f71d0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:42.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.728+0000 7eff49ffb700 1 -- 172.21.15.40:0/420248367 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7eff5000cd50 con 0x7eff5409d920 2023-09-30T22:31:42.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.728+0000 7f71d8ff9700 1 -- 172.21.15.40:0/3705241394 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d00036a0 con 0x7f71dc09c600 2023-09-30T22:31:42.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.728+0000 7f71d8ff9700 1 -- 172.21.15.40:0/3705241394 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d0003820 con 0x7f71dc09c600 2023-09-30T22:31:42.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.728+0000 7f71e25fe700 1 -- 172.21.15.40:0/3705241394 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71dc09feb0 con 0x7f71dc09c600 2023-09-30T22:31:42.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.728+0000 7f71d8ff9700 1 -- 172.21.15.40:0/3705241394 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d0003bd0 con 0x7f71dc09c600 2023-09-30T22:31:42.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.728+0000 7f71e25fe700 1 -- 172.21.15.40:0/3705241394 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71dc11d1a0 con 0x7f71dc09c600 2023-09-30T22:31:42.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.729+0000 7f71d8ff9700 1 -- 172.21.15.40:0/3705241394 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f71d001e040 con 0x7f71dc09c600 2023-09-30T22:31:42.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.729+0000 7f71e25fe700 1 -- 172.21.15.40:0/3705241394 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71dc11cb10 con 0x7f71dc09c600 2023-09-30T22:31:42.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.729+0000 7f71d8ff9700 1 -- 172.21.15.40:0/3705241394 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f71d0044870 con 0x7f71dc09c600 2023-09-30T22:31:42.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.734+0000 7f71d8ff9700 1 -- 172.21.15.40:0/3705241394 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f71d0003d30 con 0x7f71dc09c600 2023-09-30T22:31:42.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.794+0000 7fc72df0f700 1 Processor -- start 2023-09-30T22:31:42.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.795+0000 7fc72df0f700 1 -- start start 2023-09-30T22:31:42.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.795+0000 7fc72df0f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc72809d920 0x7fc72809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:42.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.795+0000 7fc72df0f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc72809f0f0 0x7fc72809e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:42.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.795+0000 7fc72df0f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc72809f940 con 0x7fc728133ca0 2023-09-30T22:31:42.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.795+0000 7fc72df0f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc72806b4c0 con 0x7fc72809d920 2023-09-30T22:31:42.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.795+0000 7fc72df0f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc72809a8f0 con 0x7fc72809f0f0 2023-09-30T22:31:42.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.795+0000 7fc727fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc728133ca0 0x7fc728134120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:36110/0 (socket says 172.21.15.40:36110) 2023-09-30T22:31:42.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.795+0000 7fc727fff700 1 -- 172.21.15.40:0/3620928198 learned_addr learned my addr 172.21.15.40:0/3620928198 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:42.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.795+0000 7fc726ffd700 1 --2- 172.21.15.40:0/3620928198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc72809f0f0 0x7fc72809e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:42.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.795+0000 7fc7277fe700 1 --2- 172.21.15.40:0/3620928198 >> v2:172.21.15.40:3300/0 conn(0x7fc72809d920 0x7fc72809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:42.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.796+0000 7fc726ffd700 1 -- 172.21.15.40:0/3620928198 >> v2:172.21.15.40:3300/0 conn(0x7fc72809d920 msgr2=0x7fc72809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:42.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.796+0000 7fc726ffd700 1 --2- 172.21.15.40:0/3620928198 >> v2:172.21.15.40:3300/0 conn(0x7fc72809d920 0x7fc72809dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.796+0000 7fc726ffd700 1 -- 172.21.15.40:0/3620928198 >> v1:172.21.15.40:6789/0 conn(0x7fc728133ca0 legacy=0x7fc728134120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:42.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.796+0000 7fc726ffd700 1 -- 172.21.15.40:0/3620928198 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72809f6e0 con 0x7fc72809f0f0 2023-09-30T22:31:42.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.796+0000 7fc726ffd700 1 --2- 172.21.15.40:0/3620928198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc72809f0f0 0x7fc72809e230 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fc71c009840 tx=0x7fc71c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b279f04f7d3ae9be server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:42.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.796+0000 7fc7267fc700 1 -- 172.21.15.40:0/3620928198 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71c011830 con 0x7fc72809f0f0 2023-09-30T22:31:42.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.796+0000 7fc7267fc700 1 -- 172.21.15.40:0/3620928198 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc71c011990 con 0x7fc72809f0f0 2023-09-30T22:31:42.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.796+0000 7fc7267fc700 1 -- 172.21.15.40:0/3620928198 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71c011d20 con 0x7fc72809f0f0 2023-09-30T22:31:42.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.797+0000 7fc72df0f700 1 -- 172.21.15.40:0/3620928198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc72809f0f0 msgr2=0x7fc72809e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:42.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.797+0000 7fc72df0f700 1 --2- 172.21.15.40:0/3620928198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc72809f0f0 0x7fc72809e230 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fc71c009840 tx=0x7fc71c009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:42.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.797+0000 7fc72df0f700 1 -- 172.21.15.40:0/3620928198 shutdown_connections 2023-09-30T22:31:42.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.797+0000 7fc72df0f700 1 --2- 172.21.15.40:0/3620928198 >> v2:172.21.15.40:3300/0 conn(0x7fc72809d920 0x7fc72809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.797+0000 7fc72df0f700 1 --2- 172.21.15.40:0/3620928198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc72809f0f0 0x7fc72809e230 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.797+0000 7fc72df0f700 1 -- 172.21.15.40:0/3620928198 >> 172.21.15.40:0/3620928198 conn(0x7fc72809fb20 msgr2=0x7fc72809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:42.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.797+0000 7fc72df0f700 1 -- 172.21.15.40:0/3620928198 shutdown_connections 2023-09-30T22:31:42.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.797+0000 7fc72df0f700 1 -- 172.21.15.40:0/3620928198 wait complete. 2023-09-30T22:31:42.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.799+0000 7fc72df0f700 1 Processor -- start 2023-09-30T22:31:42.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.799+0000 7fc72df0f700 1 -- start start 2023-09-30T22:31:42.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.799+0000 7fc72df0f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc72809d920 0x7fc72811e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:42.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.799+0000 7fc72df0f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc728133ca0 0x7fc72811e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:42.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.799+0000 7fc72df0f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc7281317a0 0x7fc72811eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:42.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.799+0000 7fc72df0f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc728122890 con 0x7fc728133ca0 2023-09-30T22:31:42.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.799+0000 7fc72df0f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc728121ed0 con 0x7fc72809d920 2023-09-30T22:31:42.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.799+0000 7fc72df0f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7280a2980 con 0x7fc7281317a0 2023-09-30T22:31:42.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.800+0000 7fc7277fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc72809d920 0x7fc72811e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:42.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.800+0000 7fc7277fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc72809d920 0x7fc72811e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:51796/0 (socket says 172.21.15.40:51796) 2023-09-30T22:31:42.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.800+0000 7fc7277fe700 1 -- 172.21.15.40:0/401393509 learned_addr learned my addr 172.21.15.40:0/401393509 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:42.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.800+0000 7fc727fff700 1 --2- 172.21.15.40:0/401393509 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc7281317a0 0x7fc72811eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:42.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.800+0000 7fc726ffd700 1 --2- 172.21.15.40:0/401393509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc728133ca0 0x7fc72811e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:42.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.800+0000 7fc727fff700 1 -- 172.21.15.40:0/401393509 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc72809d920 msgr2=0x7fc72811e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:42.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.800+0000 7fc727fff700 1 --2- 172.21.15.40:0/401393509 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc72809d920 0x7fc72811e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.800+0000 7fc727fff700 1 -- 172.21.15.40:0/401393509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc728133ca0 msgr2=0x7fc72811e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:42.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.800+0000 7fc727fff700 1 --2- 172.21.15.40:0/401393509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc728133ca0 0x7fc72811e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.800+0000 7fc727fff700 1 -- 172.21.15.40:0/401393509 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc71c0094a0 con 0x7fc7281317a0 2023-09-30T22:31:42.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.800+0000 7fc726ffd700 1 --2- 172.21.15.40:0/401393509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc728133ca0 0x7fc72811e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:42.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.800+0000 7fc727fff700 1 --2- 172.21.15.40:0/401393509 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc7281317a0 0x7fc72811eed0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fc72000cad0 tx=0x7fc72000cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:42.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.801+0000 7fc70ffff700 1 -- 172.21.15.40:0/401393509 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72000a960 con 0x7fc7281317a0 2023-09-30T22:31:42.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.801+0000 7fc70ffff700 1 -- 172.21.15.40:0/401393509 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72000aac0 con 0x7fc7281317a0 2023-09-30T22:31:42.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.801+0000 7fc72df0f700 1 -- 172.21.15.40:0/401393509 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc728121210 con 0x7fc7281317a0 2023-09-30T22:31:42.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.801+0000 7fc70ffff700 1 -- 172.21.15.40:0/401393509 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72000ae30 con 0x7fc7281317a0 2023-09-30T22:31:42.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.801+0000 7fc72df0f700 1 -- 172.21.15.40:0/401393509 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc72811ffc0 con 0x7fc7281317a0 2023-09-30T22:31:42.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.802+0000 7fc70ffff700 1 -- 172.21.15.40:0/401393509 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc72001b3b0 con 0x7fc7281317a0 2023-09-30T22:31:42.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.802+0000 7fc72df0f700 1 -- 172.21.15.40:0/401393509 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc728121a70 con 0x7fc7281317a0 2023-09-30T22:31:42.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.802+0000 7fc70ffff700 1 -- 172.21.15.40:0/401393509 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fc72003f1f0 con 0x7fc7281317a0 2023-09-30T22:31:42.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.807+0000 7fc70ffff700 1 -- 172.21.15.40:0/401393509 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc720017070 con 0x7fc7281317a0 2023-09-30T22:31:42.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.886+0000 7fd868f36700 1 -- 172.21.15.40:0/3922384738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd864074330 con 0x7fd86409dd70 2023-09-30T22:31:42.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.886+0000 7fd852ffd700 1 -- 172.21.15.40:0/3922384738 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd858015030 con 0x7fd86409dd70 2023-09-30T22:31:42.887 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:42.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.889+0000 7fd868f36700 1 -- 172.21.15.40:0/3922384738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd86409dd70 msgr2=0x7fd864119590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:42.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.889+0000 7fd868f36700 1 --2- 172.21.15.40:0/3922384738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd86409dd70 0x7fd864119590 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fd858016000 tx=0x7fd858004750 comp rx=0 tx=0).stop 2023-09-30T22:31:42.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.889+0000 7fd868f36700 1 -- 172.21.15.40:0/3922384738 shutdown_connections 2023-09-30T22:31:42.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.889+0000 7fd868f36700 1 --2- 172.21.15.40:0/3922384738 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd86409d400 0x7fd864119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.889+0000 7fd868f36700 1 --2- 172.21.15.40:0/3922384738 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd864133e00 0x7fd864119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.889+0000 7fd868f36700 1 --2- 172.21.15.40:0/3922384738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd86409dd70 0x7fd864119590 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.889+0000 7fd868f36700 1 -- 172.21.15.40:0/3922384738 >> 172.21.15.40:0/3922384738 conn(0x7fd8640a2a00 msgr2=0x7fd86412d980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:42.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.889+0000 7fd868f36700 1 -- 172.21.15.40:0/3922384738 shutdown_connections 2023-09-30T22:31:42.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.889+0000 7fd868f36700 1 -- 172.21.15.40:0/3922384738 wait complete. 2023-09-30T22:31:42.902 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:42.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.952+0000 7eff5b3cb700 1 -- 172.21.15.40:0/420248367 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7eff54062380 con 0x7eff5409d920 2023-09-30T22:31:42.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.952+0000 7eff49ffb700 1 -- 172.21.15.40:0/420248367 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7eff500123d0 con 0x7eff5409d920 2023-09-30T22:31:42.953 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:42.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.954+0000 7eff5b3cb700 1 -- 172.21.15.40:0/420248367 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff5409d920 msgr2=0x7eff54070910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:42.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.954+0000 7eff5b3cb700 1 --2- 172.21.15.40:0/420248367 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff5409d920 0x7eff54070910 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7eff5000ec10 tx=0x7eff50009ea0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.954+0000 7eff5b3cb700 1 -- 172.21.15.40:0/420248367 shutdown_connections 2023-09-30T22:31:42.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.954+0000 7eff5b3cb700 1 --2- 172.21.15.40:0/420248367 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7eff5412d2c0 0x7eff54071390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.954+0000 7eff5b3cb700 1 --2- 172.21.15.40:0/420248367 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff5409d920 0x7eff54070910 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.954+0000 7eff5b3cb700 1 --2- 172.21.15.40:0/420248367 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7eff54133ca0 0x7eff54070e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.954+0000 7eff5b3cb700 1 -- 172.21.15.40:0/420248367 >> 172.21.15.40:0/420248367 conn(0x7eff5409fb20 msgr2=0x7eff54130dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:42.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.954+0000 7eff5b3cb700 1 -- 172.21.15.40:0/420248367 shutdown_connections 2023-09-30T22:31:42.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.954+0000 7eff5b3cb700 1 -- 172.21.15.40:0/420248367 wait complete. 2023-09-30T22:31:42.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.956+0000 7f71e25fe700 1 -- 172.21.15.40:0/3705241394 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f71dc11cf90 con 0x7f71dc09c600 2023-09-30T22:31:42.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.957+0000 7f71d8ff9700 1 -- 172.21.15.40:0/3705241394 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f71d0026070 con 0x7f71dc09c600 2023-09-30T22:31:42.957 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:42.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.959+0000 7f71e25fe700 1 -- 172.21.15.40:0/3705241394 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f71dc09c600 msgr2=0x7f71dc11a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:42.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.959+0000 7f71e25fe700 1 --2- 172.21.15.40:0/3705241394 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f71dc09c600 0x7f71dc11a160 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f71d0000c00 tx=0x7f71d0004750 comp rx=0 tx=0).stop 2023-09-30T22:31:42.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.959+0000 7f71e25fe700 1 -- 172.21.15.40:0/3705241394 shutdown_connections 2023-09-30T22:31:42.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.959+0000 7f71e25fe700 1 --2- 172.21.15.40:0/3705241394 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71dc131d50 0x7f71dc11a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.959+0000 7f71e25fe700 1 --2- 172.21.15.40:0/3705241394 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71dc09bc50 0x7f71dc119c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.959+0000 7f71e25fe700 1 --2- 172.21.15.40:0/3705241394 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f71dc09c600 0x7f71dc11a160 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:42.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.959+0000 7f71e25fe700 1 -- 172.21.15.40:0/3705241394 >> 172.21.15.40:0/3705241394 conn(0x7f71dc0a2a00 msgr2=0x7f71dc0a0900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:42.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.959+0000 7f71e25fe700 1 -- 172.21.15.40:0/3705241394 shutdown_connections 2023-09-30T22:31:42.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:42.959+0000 7f71e25fe700 1 -- 172.21.15.40:0/3705241394 wait complete. 2023-09-30T22:31:42.969 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:42.973 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:43.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:43.009+0000 7fc72df0f700 1 -- 172.21.15.40:0/401393509 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc728062380 con 0x7fc7281317a0 2023-09-30T22:31:43.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:43.009+0000 7fc70ffff700 1 -- 172.21.15.40:0/401393509 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc7200192c0 con 0x7fc7281317a0 2023-09-30T22:31:43.010 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:43.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:43.011+0000 7fc72df0f700 1 -- 172.21.15.40:0/401393509 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc7281317a0 msgr2=0x7fc72811eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:43.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:43.011+0000 7fc72df0f700 1 --2- 172.21.15.40:0/401393509 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc7281317a0 0x7fc72811eed0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fc72000cad0 tx=0x7fc72000cde0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:43.011+0000 7fc72df0f700 1 -- 172.21.15.40:0/401393509 shutdown_connections 2023-09-30T22:31:43.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:43.011+0000 7fc72df0f700 1 --2- 172.21.15.40:0/401393509 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fc7281317a0 0x7fc72811eed0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:43.011+0000 7fc72df0f700 1 --2- 172.21.15.40:0/401393509 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc72809d920 0x7fc72811e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:43.011+0000 7fc72df0f700 1 --2- 172.21.15.40:0/401393509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc728133ca0 0x7fc72811e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:43.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:43.011+0000 7fc72df0f700 1 -- 172.21.15.40:0/401393509 >> 172.21.15.40:0/401393509 conn(0x7fc72809fb20 msgr2=0x7fc728133480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:43.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:43.011+0000 7fc72df0f700 1 -- 172.21.15.40:0/401393509 shutdown_connections 2023-09-30T22:31:43.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:43.011+0000 7fc72df0f700 1 -- 172.21.15.40:0/401393509 wait complete. 2023-09-30T22:31:43.024 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:43.903 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:43.970 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:43.975 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:44.025 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:44.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.053+0000 7fa7cafa9700 1 Processor -- start 2023-09-30T22:31:44.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.054+0000 7fa7cafa9700 1 -- start start 2023-09-30T22:31:44.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.054+0000 7fa7cafa9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7c409d450 0x7fa7c409d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.054+0000 7fa7cafa9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa7c41308d0 0x7fa7c4138420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.054+0000 7fa7cafa9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7c409c3b0 con 0x7fa7c409dd60 2023-09-30T22:31:44.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.054+0000 7fa7cafa9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7c409a6b0 con 0x7fa7c41308d0 2023-09-30T22:31:44.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.054+0000 7fa7cafa9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c409b4f0 con 0x7fa7c409d450 2023-09-30T22:31:44.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.055+0000 7fa7c8d45700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7c409d450 0x7fa7c409d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.055+0000 7fa7c8d45700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7c409d450 0x7fa7c409d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:57836/0 (socket says 172.21.15.40:57836) 2023-09-30T22:31:44.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.055+0000 7fa7c8d45700 1 -- 172.21.15.40:0/4096185777 learned_addr learned my addr 172.21.15.40:0/4096185777 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:44.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.055+0000 7fa7c9546700 1 --2- 172.21.15.40:0/4096185777 >> v2:172.21.15.40:3300/0 conn(0x7fa7c41308d0 0x7fa7c4138420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.055+0000 7fa7c8d45700 1 -- 172.21.15.40:0/4096185777 >> v2:172.21.15.40:3300/0 conn(0x7fa7c41308d0 msgr2=0x7fa7c4138420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:44.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.055+0000 7fa7c8d45700 1 --2- 172.21.15.40:0/4096185777 >> v2:172.21.15.40:3300/0 conn(0x7fa7c41308d0 0x7fa7c4138420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.055+0000 7fa7c8d45700 1 -- 172.21.15.40:0/4096185777 >> v1:172.21.15.40:6789/0 conn(0x7fa7c409dd60 legacy=0x7fa7c41301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.055+0000 7fa7c8d45700 1 -- 172.21.15.40:0/4096185777 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c409af90 con 0x7fa7c409d450 2023-09-30T22:31:44.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.055+0000 7fa7c8d45700 1 --2- 172.21.15.40:0/4096185777 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7c409d450 0x7fa7c409d820 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fa7b800bb90 tx=0x7fa7b800bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2683fb08abd126c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:44.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.055+0000 7fa7c37fe700 1 -- 172.21.15.40:0/4096185777 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b800dd30 con 0x7fa7c409d450 2023-09-30T22:31:44.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.055+0000 7fa7c37fe700 1 -- 172.21.15.40:0/4096185777 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b800de90 con 0x7fa7c409d450 2023-09-30T22:31:44.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.055+0000 7fa7c37fe700 1 -- 172.21.15.40:0/4096185777 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b8004270 con 0x7fa7c409d450 2023-09-30T22:31:44.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.056+0000 7fa7cafa9700 1 -- 172.21.15.40:0/4096185777 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7c409d450 msgr2=0x7fa7c409d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.056+0000 7fa7cafa9700 1 --2- 172.21.15.40:0/4096185777 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7c409d450 0x7fa7c409d820 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fa7b800bb90 tx=0x7fa7b800bea0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.056+0000 7fa7cafa9700 1 -- 172.21.15.40:0/4096185777 shutdown_connections 2023-09-30T22:31:44.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.056+0000 7fa7cafa9700 1 --2- 172.21.15.40:0/4096185777 >> v2:172.21.15.40:3300/0 conn(0x7fa7c41308d0 0x7fa7c4138420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.056+0000 7fa7cafa9700 1 --2- 172.21.15.40:0/4096185777 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7c409d450 0x7fa7c409d820 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.056+0000 7fa7cafa9700 1 -- 172.21.15.40:0/4096185777 >> 172.21.15.40:0/4096185777 conn(0x7fa7c40a2a00 msgr2=0x7fa7c40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:44.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.056+0000 7fa7cafa9700 1 -- 172.21.15.40:0/4096185777 shutdown_connections 2023-09-30T22:31:44.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.056+0000 7fa7cafa9700 1 -- 172.21.15.40:0/4096185777 wait complete. 2023-09-30T22:31:44.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.058+0000 7fa7cafa9700 1 Processor -- start 2023-09-30T22:31:44.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.058+0000 7fa7cafa9700 1 -- start start 2023-09-30T22:31:44.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.059+0000 7fa7cafa9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7c409d450 0x7fa7c41c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.059+0000 7fa7cafa9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa7c409dd60 0x7fa7c41c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.059+0000 7fa7cafa9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7c41308d0 0x7fa7c41c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.059+0000 7fa7cafa9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c41200c0 con 0x7fa7c409d450 2023-09-30T22:31:44.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.059+0000 7fa7cafa9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c4120710 con 0x7fa7c41308d0 2023-09-30T22:31:44.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.059+0000 7fa7cafa9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c4121fd0 con 0x7fa7c409dd60 2023-09-30T22:31:44.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.059+0000 7fa7c9546700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7c41308d0 0x7fa7c41c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.059+0000 7fa7c9546700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7c41308d0 0x7fa7c41c8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:57850/0 (socket says 172.21.15.40:57850) 2023-09-30T22:31:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.059+0000 7fa7c9546700 1 -- 172.21.15.40:0/3246050976 learned_addr learned my addr 172.21.15.40:0/3246050976 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.059+0000 7fa7c9546700 1 -- 172.21.15.40:0/3246050976 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa7c409dd60 msgr2=0x7fa7c41c89f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:31:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.059+0000 7fa7c9546700 1 --2- 172.21.15.40:0/3246050976 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa7c409dd60 0x7fa7c41c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.059+0000 7fa7c9546700 1 -- 172.21.15.40:0/3246050976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7c409d450 msgr2=0x7fa7c41c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.059+0000 7fa7c9546700 1 --2- 172.21.15.40:0/3246050976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7c409d450 0x7fa7c41c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.059+0000 7fa7c9546700 1 -- 172.21.15.40:0/3246050976 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b800b7f0 con 0x7fa7c41308d0 2023-09-30T22:31:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.060+0000 7fa7c9546700 1 --2- 172.21.15.40:0/3246050976 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7c41308d0 0x7fa7c41c8f30 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc00efc0 tx=0x7fa7bc00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.060+0000 7fa7c17fa700 1 -- 172.21.15.40:0/3246050976 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc00cd40 con 0x7fa7c41308d0 2023-09-30T22:31:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.060+0000 7fa7c17fa700 1 -- 172.21.15.40:0/3246050976 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7bc00f040 con 0x7fa7c41308d0 2023-09-30T22:31:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.060+0000 7fa7c17fa700 1 -- 172.21.15.40:0/3246050976 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc0146c0 con 0x7fa7c41308d0 2023-09-30T22:31:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.060+0000 7fa7cafa9700 1 -- 172.21.15.40:0/3246050976 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7c4121040 con 0x7fa7c41308d0 2023-09-30T22:31:44.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.060+0000 7fa7cafa9700 1 -- 172.21.15.40:0/3246050976 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7c40a2440 con 0x7fa7c41308d0 2023-09-30T22:31:44.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.061+0000 7fa7c17fa700 1 -- 172.21.15.40:0/3246050976 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa7bc014820 con 0x7fa7c41308d0 2023-09-30T22:31:44.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.061+0000 7fa7cafa9700 1 -- 172.21.15.40:0/3246050976 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7c4121e10 con 0x7fa7c41308d0 2023-09-30T22:31:44.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.061+0000 7fa7c17fa700 1 -- 172.21.15.40:0/3246050976 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa7bc0405a0 con 0x7fa7c41308d0 2023-09-30T22:31:44.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.070+0000 7fa7c17fa700 1 -- 172.21.15.40:0/3246050976 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa7bc018030 con 0x7fa7c41308d0 2023-09-30T22:31:44.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.126+0000 7f53ac42c700 1 Processor -- start 2023-09-30T22:31:44.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.126+0000 7f53ac42c700 1 -- start start 2023-09-30T22:31:44.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.127+0000 7f53ac42c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f53a409d920 0x7f53a409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.127+0000 7f53ac42c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f53a409e230 0x7f53a41308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.127+0000 7f53ac42c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a409adf0 con 0x7f53a4130de0 2023-09-30T22:31:44.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.127+0000 7f53ac42c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53a409edf0 con 0x7f53a409e230 2023-09-30T22:31:44.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.127+0000 7f53ac42c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a409b660 con 0x7f53a409d920 2023-09-30T22:31:44.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.127+0000 7f53a99c7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f53a409e230 0x7f53a41308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.127+0000 7f53a99c7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f53a409e230 0x7f53a41308a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38780/0 (socket says 172.21.15.40:38780) 2023-09-30T22:31:44.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.127+0000 7f53a99c7700 1 -- 172.21.15.40:0/3706432973 learned_addr learned my addr 172.21.15.40:0/3706432973 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:44.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.127+0000 7f53aa1c8700 1 --2- 172.21.15.40:0/3706432973 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f53a409d920 0x7f53a409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.128+0000 7f53a99c7700 1 -- 172.21.15.40:0/3706432973 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f53a409d920 msgr2=0x7f53a409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:44.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.128+0000 7f53a99c7700 1 --2- 172.21.15.40:0/3706432973 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f53a409d920 0x7f53a409dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.128+0000 7f53a99c7700 1 -- 172.21.15.40:0/3706432973 >> v1:172.21.15.40:6789/0 conn(0x7f53a4130de0 legacy=0x7f53a4137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.128+0000 7f53a99c7700 1 -- 172.21.15.40:0/3706432973 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a409a6e0 con 0x7f53a409e230 2023-09-30T22:31:44.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.128+0000 7f53a99c7700 1 --2- 172.21.15.40:0/3706432973 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53a409e230 0x7f53a41308a0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f53940098f0 tx=0x7f5394009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fa57fb636336b7f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:44.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.128+0000 7f53a91c6700 1 -- 172.21.15.40:0/3706432973 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5394011830 con 0x7f53a409e230 2023-09-30T22:31:44.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.128+0000 7f53a91c6700 1 -- 172.21.15.40:0/3706432973 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5394011990 con 0x7f53a409e230 2023-09-30T22:31:44.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.128+0000 7f53a91c6700 1 -- 172.21.15.40:0/3706432973 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5394011d20 con 0x7f53a409e230 2023-09-30T22:31:44.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.129+0000 7f53ac42c700 1 -- 172.21.15.40:0/3706432973 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53a409e230 msgr2=0x7f53a41308a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.129+0000 7f53ac42c700 1 --2- 172.21.15.40:0/3706432973 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53a409e230 0x7f53a41308a0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f53940098f0 tx=0x7f5394009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:44.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.129+0000 7f53ac42c700 1 -- 172.21.15.40:0/3706432973 shutdown_connections 2023-09-30T22:31:44.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.129+0000 7f53ac42c700 1 --2- 172.21.15.40:0/3706432973 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f53a409d920 0x7f53a409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.129+0000 7f53ac42c700 1 --2- 172.21.15.40:0/3706432973 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53a409e230 0x7f53a41308a0 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.129+0000 7f53ac42c700 1 -- 172.21.15.40:0/3706432973 >> 172.21.15.40:0/3706432973 conn(0x7f53a409fb20 msgr2=0x7f53a409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:44.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.129+0000 7f53ac42c700 1 -- 172.21.15.40:0/3706432973 shutdown_connections 2023-09-30T22:31:44.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.129+0000 7f53ac42c700 1 -- 172.21.15.40:0/3706432973 wait complete. 2023-09-30T22:31:44.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.131+0000 7f53ac42c700 1 Processor -- start 2023-09-30T22:31:44.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.131+0000 7f53ac42c700 1 -- start start 2023-09-30T22:31:44.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.131+0000 7f53ac42c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f53a409d920 0x7f53a411f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.131+0000 7f53ac42c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f53a409e230 0x7f53a411f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.131+0000 7f53ac42c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53a4130de0 0x7f53a411fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.131+0000 7f53ac42c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a409cb70 con 0x7f53a4130de0 2023-09-30T22:31:44.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.131+0000 7f53ac42c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a409a210 con 0x7f53a409d920 2023-09-30T22:31:44.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.131+0000 7f53ac42c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53a4121740 con 0x7f53a409e230 2023-09-30T22:31:44.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.131+0000 7f53aa1c8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f53a409d920 0x7f53a411f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.131+0000 7f53aa9c9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53a4130de0 0x7f53a411fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.131+0000 7f53aa1c8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f53a409d920 0x7f53a411f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:57862/0 (socket says 172.21.15.40:57862) 2023-09-30T22:31:44.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.131+0000 7f53a99c7700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f53a409e230 0x7f53a411f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.131+0000 7f53aa1c8700 1 -- 172.21.15.40:0/385441922 learned_addr learned my addr 172.21.15.40:0/385441922 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:44.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.132+0000 7f53a99c7700 1 -- 172.21.15.40:0/385441922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f53a409d920 msgr2=0x7f53a411f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.132+0000 7f53a99c7700 1 --2- 172.21.15.40:0/385441922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f53a409d920 0x7f53a411f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.132+0000 7f53a99c7700 1 -- 172.21.15.40:0/385441922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53a4130de0 msgr2=0x7f53a411fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.132+0000 7f53a99c7700 1 --2- 172.21.15.40:0/385441922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53a4130de0 0x7f53a411fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.132+0000 7f53a99c7700 1 -- 172.21.15.40:0/385441922 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5394009550 con 0x7f53a409e230 2023-09-30T22:31:44.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.132+0000 7f53aa9c9700 1 --2- 172.21.15.40:0/385441922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53a4130de0 0x7f53a411fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:44.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.132+0000 7f53a99c7700 1 --2- 172.21.15.40:0/385441922 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f53a409e230 0x7f53a411f850 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f5394016000 tx=0x7f5394004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:44.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.132+0000 7f539affd700 1 -- 172.21.15.40:0/385441922 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53940036a0 con 0x7f53a409e230 2023-09-30T22:31:44.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.132+0000 7f539affd700 1 -- 172.21.15.40:0/385441922 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5394003800 con 0x7f53a409e230 2023-09-30T22:31:44.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.132+0000 7f53ac42c700 1 -- 172.21.15.40:0/385441922 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a4122170 con 0x7f53a409e230 2023-09-30T22:31:44.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.132+0000 7f539affd700 1 -- 172.21.15.40:0/385441922 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5394003bb0 con 0x7f53a409e230 2023-09-30T22:31:44.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.132+0000 7f53ac42c700 1 -- 172.21.15.40:0/385441922 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a41225c0 con 0x7f53a409e230 2023-09-30T22:31:44.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.133+0000 7f539affd700 1 -- 172.21.15.40:0/385441922 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5394021070 con 0x7f53a409e230 2023-09-30T22:31:44.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.134+0000 7f539affd700 1 -- 172.21.15.40:0/385441922 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f5394040b60 con 0x7f53a409e230 2023-09-30T22:31:44.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.134+0000 7f53ac42c700 1 -- 172.21.15.40:0/385441922 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53a4062380 con 0x7f53a409e230 2023-09-30T22:31:44.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.139+0000 7f539affd700 1 -- 172.21.15.40:0/385441922 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5394015070 con 0x7f53a409e230 2023-09-30T22:31:44.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.163+0000 7fe1141f5700 1 Processor -- start 2023-09-30T22:31:44.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.163+0000 7fe1141f5700 1 -- start start 2023-09-30T22:31:44.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.164+0000 7fe1141f5700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe10c09e400 0x7fe10c135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.164+0000 7fe1141f5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe10c136230 0x7fe10c138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.164+0000 7fe1141f5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe10c09adf0 con 0x7fe10c09d920 2023-09-30T22:31:44.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.164+0000 7fe1141f5700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe10c09edf0 con 0x7fe10c09e400 2023-09-30T22:31:44.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.164+0000 7fe1141f5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c09b660 con 0x7fe10c136230 2023-09-30T22:31:44.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.164+0000 7fe111790700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe10c09e400 0x7fe10c135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.164+0000 7fe112792700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe10c136230 0x7fe10c138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.164+0000 7fe111790700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe10c09e400 0x7fe10c135cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38792/0 (socket says 172.21.15.40:38792) 2023-09-30T22:31:44.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.164+0000 7fe111790700 1 -- 172.21.15.40:0/2409491693 learned_addr learned my addr 172.21.15.40:0/2409491693 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:44.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.164+0000 7fe111790700 1 -- 172.21.15.40:0/2409491693 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe10c136230 msgr2=0x7fe10c138610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:44.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.164+0000 7fe111790700 1 --2- 172.21.15.40:0/2409491693 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe10c136230 0x7fe10c138610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.164+0000 7fe111790700 1 -- 172.21.15.40:0/2409491693 >> v1:172.21.15.40:6789/0 conn(0x7fe10c09d920 legacy=0x7fe10c09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.164+0000 7fe111790700 1 -- 172.21.15.40:0/2409491693 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10c09a6e0 con 0x7fe10c09e400 2023-09-30T22:31:44.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.165+0000 7fe111790700 1 --2- 172.21.15.40:0/2409491693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe10c09e400 0x7fe10c135cf0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc0098f0 tx=0x7fe0fc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d48bf34f0df92c58 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:44.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.165+0000 7fe110f8f700 1 -- 172.21.15.40:0/2409491693 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc011830 con 0x7fe10c09e400 2023-09-30T22:31:44.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.165+0000 7fe110f8f700 1 -- 172.21.15.40:0/2409491693 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0fc011990 con 0x7fe10c09e400 2023-09-30T22:31:44.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.165+0000 7fe110f8f700 1 -- 172.21.15.40:0/2409491693 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc011d20 con 0x7fe10c09e400 2023-09-30T22:31:44.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.166+0000 7fe1141f5700 1 -- 172.21.15.40:0/2409491693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe10c09e400 msgr2=0x7fe10c135cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.166+0000 7fe1141f5700 1 --2- 172.21.15.40:0/2409491693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe10c09e400 0x7fe10c135cf0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc0098f0 tx=0x7fe0fc009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:44.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.166+0000 7fe1141f5700 1 -- 172.21.15.40:0/2409491693 shutdown_connections 2023-09-30T22:31:44.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.166+0000 7fe1141f5700 1 --2- 172.21.15.40:0/2409491693 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe10c136230 0x7fe10c138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.166+0000 7fe1141f5700 1 --2- 172.21.15.40:0/2409491693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe10c09e400 0x7fe10c135cf0 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.166+0000 7fe1141f5700 1 -- 172.21.15.40:0/2409491693 >> 172.21.15.40:0/2409491693 conn(0x7fe10c09fb20 msgr2=0x7fe10c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:44.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.166+0000 7fe1141f5700 1 -- 172.21.15.40:0/2409491693 shutdown_connections 2023-09-30T22:31:44.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.166+0000 7fe1141f5700 1 -- 172.21.15.40:0/2409491693 wait complete. 2023-09-30T22:31:44.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.167+0000 7fe1141f5700 1 Processor -- start 2023-09-30T22:31:44.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.167+0000 7fe1141f5700 1 -- start start 2023-09-30T22:31:44.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.167+0000 7fe1141f5700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe10c09d920 0x7fe10c11b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.167+0000 7fe1141f5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe10c09e400 0x7fe10c11b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.167+0000 7fe1141f5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe10c136230 0x7fe10c11bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.167+0000 7fe1141f5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c11c930 con 0x7fe10c09e400 2023-09-30T22:31:44.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.167+0000 7fe1141f5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c11d000 con 0x7fe10c136230 2023-09-30T22:31:44.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.167+0000 7fe1141f5700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c11e250 con 0x7fe10c09d920 2023-09-30T22:31:44.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.167+0000 7fe112792700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe10c136230 0x7fe10c11bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.167+0000 7fe112792700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe10c136230 0x7fe10c11bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:57876/0 (socket says 172.21.15.40:57876) 2023-09-30T22:31:44.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.167+0000 7fe112792700 1 -- 172.21.15.40:0/2132665591 learned_addr learned my addr 172.21.15.40:0/2132665591 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:44.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.168+0000 7fe111f91700 1 --2- 172.21.15.40:0/2132665591 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe10c09d920 0x7fe10c11b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.168+0000 7fe112792700 1 -- 172.21.15.40:0/2132665591 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe10c09d920 msgr2=0x7fe10c11b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.168+0000 7fe112792700 1 --2- 172.21.15.40:0/2132665591 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe10c09d920 0x7fe10c11b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.168+0000 7fe112792700 1 -- 172.21.15.40:0/2132665591 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe10c09e400 msgr2=0x7fe10c11b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.168+0000 7fe112792700 1 --2- 172.21.15.40:0/2132665591 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe10c09e400 0x7fe10c11b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.168+0000 7fe112792700 1 -- 172.21.15.40:0/2132665591 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0fc009550 con 0x7fe10c136230 2023-09-30T22:31:44.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.168+0000 7fe112792700 1 --2- 172.21.15.40:0/2132665591 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe10c136230 0x7fe10c11bf00 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fe10400efc0 tx=0x7fe10400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:44.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.168+0000 7fe1027fc700 1 -- 172.21.15.40:0/2132665591 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe104009ea0 con 0x7fe10c136230 2023-09-30T22:31:44.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.168+0000 7fe1027fc700 1 -- 172.21.15.40:0/2132665591 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10400f040 con 0x7fe10c136230 2023-09-30T22:31:44.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.168+0000 7fe1027fc700 1 -- 172.21.15.40:0/2132665591 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1040135c0 con 0x7fe10c136230 2023-09-30T22:31:44.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.169+0000 7fe1141f5700 1 -- 172.21.15.40:0/2132665591 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe10c11ec30 con 0x7fe10c136230 2023-09-30T22:31:44.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.169+0000 7fe1141f5700 1 -- 172.21.15.40:0/2132665591 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe10c135f20 con 0x7fe10c136230 2023-09-30T22:31:44.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.170+0000 7fe1027fc700 1 -- 172.21.15.40:0/2132665591 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe104013720 con 0x7fe10c136230 2023-09-30T22:31:44.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.170+0000 7fe1027fc700 1 -- 172.21.15.40:0/2132665591 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe104043db0 con 0x7fe10c136230 2023-09-30T22:31:44.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.171+0000 7fe1141f5700 1 -- 172.21.15.40:0/2132665591 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe10c09cb60 con 0x7fe10c136230 2023-09-30T22:31:44.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.176+0000 7fe1027fc700 1 -- 172.21.15.40:0/2132665591 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe104007920 con 0x7fe10c136230 2023-09-30T22:31:44.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.192+0000 7f75a1222700 1 Processor -- start 2023-09-30T22:31:44.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.193+0000 7f75a1222700 1 -- start start 2023-09-30T22:31:44.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.193+0000 7f75a1222700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f759c06f070 0x7f759c06f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.193+0000 7f75a1222700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f759c06fdb0 0x7f759c0977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.193+0000 7f75a1222700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f759c070830 con 0x7f759c06f980 2023-09-30T22:31:44.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.193+0000 7f75a1222700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f759c070ad0 con 0x7f759c06fdb0 2023-09-30T22:31:44.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.193+0000 7f75a1222700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f759c070de0 con 0x7f759c06f070 2023-09-30T22:31:44.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.193+0000 7f759ad9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f759c06f070 0x7f759c06f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.193+0000 7f759a59c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f759c06f980 0x7f759c097090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:35146/0 (socket says 172.21.15.40:35146) 2023-09-30T22:31:44.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.193+0000 7f759a59c700 1 -- 172.21.15.40:0/1673955431 learned_addr learned my addr 172.21.15.40:0/1673955431 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:44.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.193+0000 7f759b59e700 1 --2- 172.21.15.40:0/1673955431 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f759c06fdb0 0x7f759c0977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.194+0000 7f759ad9d700 1 -- 172.21.15.40:0/1673955431 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f759c06fdb0 msgr2=0x7f759c0977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:44.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.194+0000 7f759ad9d700 1 --2- 172.21.15.40:0/1673955431 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f759c06fdb0 0x7f759c0977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.194+0000 7f759ad9d700 1 -- 172.21.15.40:0/1673955431 >> v1:172.21.15.40:6789/0 conn(0x7f759c06f980 legacy=0x7f759c097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.194+0000 7f7599d9b700 1 -- 172.21.15.40:0/1673955431 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1889242281 0 0) 0x7f759c070830 con 0x7f759c06f980 2023-09-30T22:31:44.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.194+0000 7f759ad9d700 1 -- 172.21.15.40:0/1673955431 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759c09fe20 con 0x7f759c06f070 2023-09-30T22:31:44.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.194+0000 7f759b59e700 1 --2- 172.21.15.40:0/1673955431 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f759c06fdb0 0x7f759c0977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:44.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.194+0000 7f759ad9d700 1 --2- 172.21.15.40:0/1673955431 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f759c06f070 0x7f759c06f440 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f758c009870 tx=0x7f758c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=658f5ba4375719d3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:44.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.194+0000 7f7599d9b700 1 -- 172.21.15.40:0/1673955431 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c011830 con 0x7f759c06f070 2023-09-30T22:31:44.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.194+0000 7f7599d9b700 1 -- 172.21.15.40:0/1673955431 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758c011990 con 0x7f759c06f070 2023-09-30T22:31:44.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.194+0000 7f7599d9b700 1 -- 172.21.15.40:0/1673955431 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c011d20 con 0x7f759c06f070 2023-09-30T22:31:44.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.195+0000 7f75a1222700 1 -- 172.21.15.40:0/1673955431 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f759c06f070 msgr2=0x7f759c06f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.195+0000 7f75a1222700 1 --2- 172.21.15.40:0/1673955431 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f759c06f070 0x7f759c06f440 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f758c009870 tx=0x7f758c009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:44.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.195+0000 7f75a1222700 1 -- 172.21.15.40:0/1673955431 shutdown_connections 2023-09-30T22:31:44.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.195+0000 7f75a1222700 1 --2- 172.21.15.40:0/1673955431 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f759c06fdb0 0x7f759c0977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.195+0000 7f75a1222700 1 --2- 172.21.15.40:0/1673955431 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f759c06f070 0x7f759c06f440 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.195+0000 7f75a1222700 1 -- 172.21.15.40:0/1673955431 >> 172.21.15.40:0/1673955431 conn(0x7f759c0a41a0 msgr2=0x7f759c0a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:44.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.195+0000 7f75a1222700 1 -- 172.21.15.40:0/1673955431 shutdown_connections 2023-09-30T22:31:44.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.195+0000 7f75a1222700 1 -- 172.21.15.40:0/1673955431 wait complete. 2023-09-30T22:31:44.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.196+0000 7f75a1222700 1 Processor -- start 2023-09-30T22:31:44.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.196+0000 7f75a1222700 1 -- start start 2023-09-30T22:31:44.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.197+0000 7f75a1222700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f759c06f070 0x7f759c0956f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.197+0000 7f75a1222700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f759c06f980 0x7f759c095c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.197+0000 7f75a1222700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f759c06fdb0 0x7f759c096170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:44.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.197+0000 7f75a1222700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759c096f00 con 0x7f759c06f980 2023-09-30T22:31:44.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.197+0000 7f75a1222700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f759c12c340 con 0x7f759c06f070 2023-09-30T22:31:44.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.197+0000 7f75a1222700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f759c129310 con 0x7f759c06fdb0 2023-09-30T22:31:44.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.197+0000 7f759ad9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f759c06f070 0x7f759c0956f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.197+0000 7f759ad9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f759c06f070 0x7f759c0956f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:57898/0 (socket says 172.21.15.40:57898) 2023-09-30T22:31:44.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.197+0000 7f759ad9d700 1 -- 172.21.15.40:0/2582147669 learned_addr learned my addr 172.21.15.40:0/2582147669 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:44.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.197+0000 7f759b59e700 1 --2- 172.21.15.40:0/2582147669 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f759c06fdb0 0x7f759c096170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.197+0000 7f759a59c700 1 --2- 172.21.15.40:0/2582147669 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f759c06f980 0x7f759c095c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:44.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.197+0000 7f759ad9d700 1 -- 172.21.15.40:0/2582147669 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f759c06fdb0 msgr2=0x7f759c096170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.197+0000 7f759ad9d700 1 --2- 172.21.15.40:0/2582147669 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f759c06fdb0 0x7f759c096170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.197+0000 7f759ad9d700 1 -- 172.21.15.40:0/2582147669 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f759c06f980 msgr2=0x7f759c095c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.197+0000 7f759ad9d700 1 --2- 172.21.15.40:0/2582147669 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f759c06f980 0x7f759c095c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.197+0000 7f759ad9d700 1 -- 172.21.15.40:0/2582147669 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7594009a70 con 0x7f759c06f070 2023-09-30T22:31:44.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.198+0000 7f759ad9d700 1 --2- 172.21.15.40:0/2582147669 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f759c06f070 0x7f759c0956f0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f758c0090b0 tx=0x7f758c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:44.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.198+0000 7f75837fe700 1 -- 172.21.15.40:0/2582147669 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c0043c0 con 0x7f759c06f070 2023-09-30T22:31:44.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.198+0000 7f75837fe700 1 -- 172.21.15.40:0/2582147669 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758c01f070 con 0x7f759c06f070 2023-09-30T22:31:44.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.198+0000 7f75a1222700 1 -- 172.21.15.40:0/2582147669 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f758c0094a0 con 0x7f759c06f070 2023-09-30T22:31:44.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.198+0000 7f75837fe700 1 -- 172.21.15.40:0/2582147669 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c0036a0 con 0x7f759c06f070 2023-09-30T22:31:44.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.198+0000 7f75a1222700 1 -- 172.21.15.40:0/2582147669 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f759c06e060 con 0x7f759c06f070 2023-09-30T22:31:44.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.199+0000 7f75837fe700 1 -- 172.21.15.40:0/2582147669 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f758c021030 con 0x7f759c06f070 2023-09-30T22:31:44.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.199+0000 7f75837fe700 1 -- 172.21.15.40:0/2582147669 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f758c0408a0 con 0x7f759c06f070 2023-09-30T22:31:44.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.199+0000 7f75a1222700 1 -- 172.21.15.40:0/2582147669 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f757c0052e0 con 0x7f759c06f070 2023-09-30T22:31:44.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.204+0000 7f75837fe700 1 -- 172.21.15.40:0/2582147669 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f758c015020 con 0x7f759c06f070 2023-09-30T22:31:44.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.326+0000 7fa7cafa9700 1 -- 172.21.15.40:0/3246050976 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa7c4062380 con 0x7fa7c41308d0 2023-09-30T22:31:44.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.327+0000 7fa7c17fa700 1 -- 172.21.15.40:0/3246050976 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa7bc02c090 con 0x7fa7c41308d0 2023-09-30T22:31:44.328 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:44.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.330+0000 7fa7cafa9700 1 -- 172.21.15.40:0/3246050976 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7c41308d0 msgr2=0x7fa7c41c8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.330+0000 7fa7cafa9700 1 --2- 172.21.15.40:0/3246050976 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7c41308d0 0x7fa7c41c8f30 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc00efc0 tx=0x7fa7bc00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.330+0000 7fa7cafa9700 1 -- 172.21.15.40:0/3246050976 shutdown_connections 2023-09-30T22:31:44.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.330+0000 7fa7cafa9700 1 --2- 172.21.15.40:0/3246050976 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa7c41308d0 0x7fa7c41c8f30 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.330+0000 7fa7cafa9700 1 --2- 172.21.15.40:0/3246050976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7c409d450 0x7fa7c41c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.330+0000 7fa7cafa9700 1 --2- 172.21.15.40:0/3246050976 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa7c409dd60 0x7fa7c41c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.330+0000 7fa7cafa9700 1 -- 172.21.15.40:0/3246050976 >> 172.21.15.40:0/3246050976 conn(0x7fa7c40a2a00 msgr2=0x7fa7c40a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:44.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.331+0000 7fa7cafa9700 1 -- 172.21.15.40:0/3246050976 shutdown_connections 2023-09-30T22:31:44.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.331+0000 7fa7cafa9700 1 -- 172.21.15.40:0/3246050976 wait complete. 2023-09-30T22:31:44.348 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:44.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.378+0000 7fe1141f5700 1 -- 172.21.15.40:0/2132665591 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe10c062380 con 0x7fe10c136230 2023-09-30T22:31:44.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.379+0000 7fe1027fc700 1 -- 172.21.15.40:0/2132665591 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe104007330 con 0x7fe10c136230 2023-09-30T22:31:44.379 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:44.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.381+0000 7fe1141f5700 1 -- 172.21.15.40:0/2132665591 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe10c136230 msgr2=0x7fe10c11bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.381+0000 7fe1141f5700 1 --2- 172.21.15.40:0/2132665591 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe10c136230 0x7fe10c11bf00 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fe10400efc0 tx=0x7fe10400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.381+0000 7fe1141f5700 1 -- 172.21.15.40:0/2132665591 shutdown_connections 2023-09-30T22:31:44.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.381+0000 7fe1141f5700 1 --2- 172.21.15.40:0/2132665591 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe10c09d920 0x7fe10c11b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.381+0000 7fe1141f5700 1 --2- 172.21.15.40:0/2132665591 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe10c136230 0x7fe10c11bf00 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.381+0000 7fe1141f5700 1 --2- 172.21.15.40:0/2132665591 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe10c09e400 0x7fe10c11b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.381+0000 7fe1141f5700 1 -- 172.21.15.40:0/2132665591 >> 172.21.15.40:0/2132665591 conn(0x7fe10c09fb20 msgr2=0x7fe10c0a1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:44.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.381+0000 7fe1141f5700 1 -- 172.21.15.40:0/2132665591 shutdown_connections 2023-09-30T22:31:44.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.381+0000 7fe1141f5700 1 -- 172.21.15.40:0/2132665591 wait complete. 2023-09-30T22:31:44.394 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:44.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.400+0000 7f75a1222700 1 -- 172.21.15.40:0/2582147669 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f757c005590 con 0x7f759c06f070 2023-09-30T22:31:44.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.401+0000 7f75837fe700 1 -- 172.21.15.40:0/2582147669 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f758c0239c0 con 0x7f759c06f070 2023-09-30T22:31:44.402 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:44.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.401+0000 7f53ac42c700 1 -- 172.21.15.40:0/385441922 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f53a4130bc0 con 0x7f53a409e230 2023-09-30T22:31:44.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.402+0000 7f539affd700 1 -- 172.21.15.40:0/385441922 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5394003d10 con 0x7f53a409e230 2023-09-30T22:31:44.402 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:44.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.403+0000 7f75a1222700 1 -- 172.21.15.40:0/2582147669 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f759c06f070 msgr2=0x7f759c0956f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.403+0000 7f75a1222700 1 --2- 172.21.15.40:0/2582147669 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f759c06f070 0x7f759c0956f0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f758c0090b0 tx=0x7f758c004750 comp rx=0 tx=0).stop 2023-09-30T22:31:44.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.403+0000 7f75a1222700 1 -- 172.21.15.40:0/2582147669 shutdown_connections 2023-09-30T22:31:44.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.403+0000 7f75a1222700 1 --2- 172.21.15.40:0/2582147669 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f759c06fdb0 0x7f759c096170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.403+0000 7f75a1222700 1 --2- 172.21.15.40:0/2582147669 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f759c06f070 0x7f759c0956f0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.403+0000 7f75a1222700 1 --2- 172.21.15.40:0/2582147669 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f759c06f980 0x7f759c095c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.403+0000 7f75a1222700 1 -- 172.21.15.40:0/2582147669 >> 172.21.15.40:0/2582147669 conn(0x7f759c0a41a0 msgr2=0x7f759c0a2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:44.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.403+0000 7f75a1222700 1 -- 172.21.15.40:0/2582147669 shutdown_connections 2023-09-30T22:31:44.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.403+0000 7f75a1222700 1 -- 172.21.15.40:0/2582147669 wait complete. 2023-09-30T22:31:44.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.404+0000 7f53ac42c700 1 -- 172.21.15.40:0/385441922 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f53a409e230 msgr2=0x7f53a411f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:44.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.404+0000 7f53ac42c700 1 --2- 172.21.15.40:0/385441922 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f53a409e230 0x7f53a411f850 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f5394016000 tx=0x7f5394004750 comp rx=0 tx=0).stop 2023-09-30T22:31:44.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.404+0000 7f53ac42c700 1 -- 172.21.15.40:0/385441922 shutdown_connections 2023-09-30T22:31:44.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.404+0000 7f53ac42c700 1 --2- 172.21.15.40:0/385441922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53a4130de0 0x7f53a411fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.404+0000 7f53ac42c700 1 --2- 172.21.15.40:0/385441922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f53a409d920 0x7f53a411f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.404+0000 7f53ac42c700 1 --2- 172.21.15.40:0/385441922 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f53a409e230 0x7f53a411f850 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:44.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.404+0000 7f53ac42c700 1 -- 172.21.15.40:0/385441922 >> 172.21.15.40:0/385441922 conn(0x7f53a409fb20 msgr2=0x7f53a406f080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:44.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.404+0000 7f53ac42c700 1 -- 172.21.15.40:0/385441922 shutdown_connections 2023-09-30T22:31:44.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:44.404+0000 7f53ac42c700 1 -- 172.21.15.40:0/385441922 wait complete. 2023-09-30T22:31:44.417 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:44.418 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:45.349 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:45.395 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:45.418 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:45.418 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:45.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.502+0000 7fa3e484f700 1 Processor -- start 2023-09-30T22:31:45.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.502+0000 7fa3e484f700 1 -- start start 2023-09-30T22:31:45.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.502+0000 7fa3e484f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa3e012e590 0x7fa3e012e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:45.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.502+0000 7fa3e484f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa3e012eea0 0x7fa3e012d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:45.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.502+0000 7fa3e484f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e009ab70 con 0x7fa3e012d6d0 2023-09-30T22:31:45.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.502+0000 7fa3e484f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e009b270 con 0x7fa3e012eea0 2023-09-30T22:31:45.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.502+0000 7fa3e484f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e009bab0 con 0x7fa3e012e590 2023-09-30T22:31:45.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.503+0000 7fa3ddd9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa3e012eea0 0x7fa3e012d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:45.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.503+0000 7fa3ddd9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa3e012eea0 0x7fa3e012d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38816/0 (socket says 172.21.15.40:38816) 2023-09-30T22:31:45.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.503+0000 7fa3ddd9b700 1 -- 172.21.15.40:0/3953671088 learned_addr learned my addr 172.21.15.40:0/3953671088 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:45.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.503+0000 7fa3ded9d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa3e012d6d0 0x7fa3e0137c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:35158/0 (socket says 172.21.15.40:35158) 2023-09-30T22:31:45.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.503+0000 7fa3de59c700 1 --2- 172.21.15.40:0/3953671088 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa3e012e590 0x7fa3e012e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:45.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.503+0000 7fa3ddd9b700 1 -- 172.21.15.40:0/3953671088 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa3e012e590 msgr2=0x7fa3e012e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:45.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.503+0000 7fa3ddd9b700 1 --2- 172.21.15.40:0/3953671088 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa3e012e590 0x7fa3e012e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.503+0000 7fa3ddd9b700 1 -- 172.21.15.40:0/3953671088 >> v1:172.21.15.40:6789/0 conn(0x7fa3e012d6d0 legacy=0x7fa3e0137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:45.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.503+0000 7fa3ddd9b700 1 -- 172.21.15.40:0/3953671088 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e009bd70 con 0x7fa3e012eea0 2023-09-30T22:31:45.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.503+0000 7fa3ddd9b700 1 --2- 172.21.15.40:0/3953671088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3e012eea0 0x7fa3e012d190 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4009920 tx=0x7fa3d4009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1012341575ea60da server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:45.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.504+0000 7fa3dd59a700 1 -- 172.21.15.40:0/3953671088 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4011830 con 0x7fa3e012eea0 2023-09-30T22:31:45.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.504+0000 7fa3dd59a700 1 -- 172.21.15.40:0/3953671088 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d4011990 con 0x7fa3e012eea0 2023-09-30T22:31:45.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.504+0000 7fa3dd59a700 1 -- 172.21.15.40:0/3953671088 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4011d20 con 0x7fa3e012eea0 2023-09-30T22:31:45.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.504+0000 7fa3e484f700 1 -- 172.21.15.40:0/3953671088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3e012eea0 msgr2=0x7fa3e012d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:45.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.504+0000 7fa3e484f700 1 --2- 172.21.15.40:0/3953671088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3e012eea0 0x7fa3e012d190 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4009920 tx=0x7fa3d4009c30 comp rx=0 tx=0).stop 2023-09-30T22:31:45.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.505+0000 7fa3e484f700 1 -- 172.21.15.40:0/3953671088 shutdown_connections 2023-09-30T22:31:45.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.505+0000 7fa3e484f700 1 --2- 172.21.15.40:0/3953671088 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa3e012e590 0x7fa3e012e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.505+0000 7fa3e484f700 1 --2- 172.21.15.40:0/3953671088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3e012eea0 0x7fa3e012d190 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.505+0000 7fa3e484f700 1 -- 172.21.15.40:0/3953671088 >> 172.21.15.40:0/3953671088 conn(0x7fa3e00a2a00 msgr2=0x7fa3e00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:45.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.505+0000 7fa3e484f700 1 -- 172.21.15.40:0/3953671088 shutdown_connections 2023-09-30T22:31:45.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.505+0000 7fa3e484f700 1 -- 172.21.15.40:0/3953671088 wait complete. 2023-09-30T22:31:45.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.506+0000 7fa3e484f700 1 Processor -- start 2023-09-30T22:31:45.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.506+0000 7fa3e484f700 1 -- start start 2023-09-30T22:31:45.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.507+0000 7fa3e484f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3e012d6d0 0x7fa3e006f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:45.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.507+0000 7fa3e484f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3e012e590 0x7fa3e006ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:45.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.507+0000 7fa3e484f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa3e012eea0 0x7fa3e0070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:45.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.507+0000 7fa3e484f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e0129070 con 0x7fa3e012e590 2023-09-30T22:31:45.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.507+0000 7fa3e484f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e009fde0 con 0x7fa3e012d6d0 2023-09-30T22:31:45.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.507+0000 7fa3e484f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e0129fd0 con 0x7fa3e012eea0 2023-09-30T22:31:45.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.507+0000 7fa3de59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3e012d6d0 0x7fa3e006f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:45.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.507+0000 7fa3de59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3e012d6d0 0x7fa3e006f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:57906/0 (socket says 172.21.15.40:57906) 2023-09-30T22:31:45.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.507+0000 7fa3de59c700 1 -- 172.21.15.40:0/3136946898 learned_addr learned my addr 172.21.15.40:0/3136946898 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:45.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.507+0000 7fa3ddd9b700 1 --2- 172.21.15.40:0/3136946898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3e012e590 0x7fa3e006ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:45.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.507+0000 7fa3ded9d700 1 --2- 172.21.15.40:0/3136946898 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa3e012eea0 0x7fa3e0070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:45.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.508+0000 7fa3de59c700 1 -- 172.21.15.40:0/3136946898 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa3e012eea0 msgr2=0x7fa3e0070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:45.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.508+0000 7fa3de59c700 1 --2- 172.21.15.40:0/3136946898 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa3e012eea0 0x7fa3e0070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.508+0000 7fa3de59c700 1 -- 172.21.15.40:0/3136946898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3e012e590 msgr2=0x7fa3e006ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:45.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.508+0000 7fa3de59c700 1 --2- 172.21.15.40:0/3136946898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3e012e590 0x7fa3e006ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.508+0000 7fa3de59c700 1 -- 172.21.15.40:0/3136946898 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d4009550 con 0x7fa3e012d6d0 2023-09-30T22:31:45.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.508+0000 7fa3ded9d700 1 --2- 172.21.15.40:0/3136946898 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa3e012eea0 0x7fa3e0070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:45.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.508+0000 7fa3de59c700 1 --2- 172.21.15.40:0/3136946898 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3e012d6d0 0x7fa3e006f9d0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fa3d000e9b0 tx=0x7fa3d000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:45.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.508+0000 7fa3ceffd700 1 -- 172.21.15.40:0/3136946898 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0009710 con 0x7fa3e012d6d0 2023-09-30T22:31:45.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.508+0000 7fa3ceffd700 1 -- 172.21.15.40:0/3136946898 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d000c850 con 0x7fa3e012d6d0 2023-09-30T22:31:45.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.508+0000 7fa3e484f700 1 -- 172.21.15.40:0/3136946898 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e009cdb0 con 0x7fa3e012d6d0 2023-09-30T22:31:45.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.508+0000 7fa3e484f700 1 -- 172.21.15.40:0/3136946898 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e01279a0 con 0x7fa3e012d6d0 2023-09-30T22:31:45.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.508+0000 7fa3ceffd700 1 -- 172.21.15.40:0/3136946898 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d000cbc0 con 0x7fa3e012d6d0 2023-09-30T22:31:45.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.509+0000 7fa3ceffd700 1 -- 172.21.15.40:0/3136946898 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa3d000cd20 con 0x7fa3e012d6d0 2023-09-30T22:31:45.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.509+0000 7fa3e484f700 1 -- 172.21.15.40:0/3136946898 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3c40052e0 con 0x7fa3e012d6d0 2023-09-30T22:31:45.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.510+0000 7fa3ceffd700 1 -- 172.21.15.40:0/3136946898 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa3d003f7a0 con 0x7fa3e012d6d0 2023-09-30T22:31:45.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.518+0000 7fa3ceffd700 1 -- 172.21.15.40:0/3136946898 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa3d00232f0 con 0x7fa3e012d6d0 2023-09-30T22:31:45.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.541+0000 7f3e239ba700 1 Processor -- start 2023-09-30T22:31:45.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.541+0000 7f3e239ba700 1 -- start start 2023-09-30T22:31:45.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.541+0000 7f3e239ba700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e1c09d920 0x7f3e1c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:45.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.541+0000 7f3e239ba700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3e1c09e230 0x7f3e1c1308a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:45.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.542+0000 7f3e239ba700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e1c09adf0 con 0x7f3e1c130de0 2023-09-30T22:31:45.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.542+0000 7f3e21756700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e1c09d920 0x7f3e1c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:45.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.542+0000 7f3e239ba700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e1c09edf0 con 0x7f3e1c09e230 2023-09-30T22:31:45.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.542+0000 7f3e239ba700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c09b660 con 0x7f3e1c09d920 2023-09-30T22:31:45.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.542+0000 7f3e21756700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e1c09d920 0x7f3e1c09dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:36732/0 (socket says 172.21.15.40:36732) 2023-09-30T22:31:45.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.542+0000 7f3e21756700 1 -- 172.21.15.40:0/948711834 learned_addr learned my addr 172.21.15.40:0/948711834 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:45.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.542+0000 7f3e21756700 1 -- 172.21.15.40:0/948711834 >> v2:172.21.15.40:3300/0 conn(0x7f3e1c09e230 msgr2=0x7f3e1c1308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:45.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.542+0000 7f3e20f55700 1 --2- 172.21.15.40:0/948711834 >> v2:172.21.15.40:3300/0 conn(0x7f3e1c09e230 0x7f3e1c1308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:45.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.542+0000 7f3e21756700 1 --2- 172.21.15.40:0/948711834 >> v2:172.21.15.40:3300/0 conn(0x7f3e1c09e230 0x7f3e1c1308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.542+0000 7f3e21756700 1 -- 172.21.15.40:0/948711834 >> v1:172.21.15.40:6789/0 conn(0x7f3e1c130de0 legacy=0x7f3e1c137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:45.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.542+0000 7f3e21756700 1 -- 172.21.15.40:0/948711834 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1c09a6e0 con 0x7f3e1c09d920 2023-09-30T22:31:45.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.542+0000 7f3e20f55700 1 --2- 172.21.15.40:0/948711834 >> v2:172.21.15.40:3300/0 conn(0x7f3e1c09e230 0x7f3e1c1308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:31:45.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.542+0000 7f3e21756700 1 --2- 172.21.15.40:0/948711834 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e1c09d920 0x7f3e1c09dcf0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f3e180098e0 tx=0x7f3e18009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de2fa04a18cde96f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:45.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.543+0000 7f3e13fff700 1 -- 172.21.15.40:0/948711834 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e18004230 con 0x7f3e1c09d920 2023-09-30T22:31:45.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.543+0000 7f3e13fff700 1 -- 172.21.15.40:0/948711834 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e18004390 con 0x7f3e1c09d920 2023-09-30T22:31:45.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.543+0000 7f3e13fff700 1 -- 172.21.15.40:0/948711834 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e180036a0 con 0x7f3e1c09d920 2023-09-30T22:31:45.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.544+0000 7f3e239ba700 1 -- 172.21.15.40:0/948711834 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e1c09d920 msgr2=0x7f3e1c09dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:45.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.544+0000 7f3e239ba700 1 --2- 172.21.15.40:0/948711834 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e1c09d920 0x7f3e1c09dcf0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f3e180098e0 tx=0x7f3e18009bf0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.544+0000 7f3e239ba700 1 -- 172.21.15.40:0/948711834 shutdown_connections 2023-09-30T22:31:45.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.544+0000 7f3e239ba700 1 --2- 172.21.15.40:0/948711834 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e1c09d920 0x7f3e1c09dcf0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.544+0000 7f3e239ba700 1 --2- 172.21.15.40:0/948711834 >> v2:172.21.15.40:3300/0 conn(0x7f3e1c09e230 0x7f3e1c1308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.544+0000 7f3e239ba700 1 -- 172.21.15.40:0/948711834 >> 172.21.15.40:0/948711834 conn(0x7f3e1c09fb20 msgr2=0x7f3e1c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:45.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.544+0000 7f3e239ba700 1 -- 172.21.15.40:0/948711834 shutdown_connections 2023-09-30T22:31:45.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.544+0000 7f3e239ba700 1 -- 172.21.15.40:0/948711834 wait complete. 2023-09-30T22:31:45.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.545+0000 7f3e239ba700 1 Processor -- start 2023-09-30T22:31:45.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.545+0000 7f3e239ba700 1 -- start start 2023-09-30T22:31:45.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.545+0000 7f3e239ba700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e1c09d920 0x7f3e1c121750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:45.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.545+0000 7f3e239ba700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e1c09e230 0x7f3e1c121c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:45.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.545+0000 7f3e239ba700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e1c130de0 0x7f3e1c1221d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:45.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.545+0000 7f3e239ba700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c124f90 con 0x7f3e1c130de0 2023-09-30T22:31:45.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.545+0000 7f3e239ba700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c125270 con 0x7f3e1c09e230 2023-09-30T22:31:45.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.545+0000 7f3e239ba700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c0a2d70 con 0x7f3e1c09d920 2023-09-30T22:31:45.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.545+0000 7f3e20f55700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e1c09e230 0x7f3e1c121c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:45.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.546+0000 7f3e20f55700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e1c09e230 0x7f3e1c121c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:57920/0 (socket says 172.21.15.40:57920) 2023-09-30T22:31:45.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.546+0000 7f3e20f55700 1 -- 172.21.15.40:0/1477795898 learned_addr learned my addr 172.21.15.40:0/1477795898 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:45.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.546+0000 7f3e21f57700 1 --2- 172.21.15.40:0/1477795898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e1c130de0 0x7f3e1c1221d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:45.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.546+0000 7f3e21756700 1 --2- 172.21.15.40:0/1477795898 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e1c09d920 0x7f3e1c121750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:45.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.546+0000 7f3e20f55700 1 -- 172.21.15.40:0/1477795898 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e1c09d920 msgr2=0x7f3e1c121750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:45.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.546+0000 7f3e20f55700 1 --2- 172.21.15.40:0/1477795898 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e1c09d920 0x7f3e1c121750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.546+0000 7f3e20f55700 1 -- 172.21.15.40:0/1477795898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e1c130de0 msgr2=0x7f3e1c1221d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:45.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.546+0000 7f3e20f55700 1 --2- 172.21.15.40:0/1477795898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e1c130de0 0x7f3e1c1221d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.546+0000 7f3e20f55700 1 -- 172.21.15.40:0/1477795898 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e180094f0 con 0x7f3e1c09e230 2023-09-30T22:31:45.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.546+0000 7f3e20f55700 1 --2- 172.21.15.40:0/1477795898 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e1c09e230 0x7f3e1c121c90 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c00c740 tx=0x7f3e0c00ca50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:45.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.546+0000 7f3e11ffb700 1 -- 172.21.15.40:0/1477795898 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c004220 con 0x7f3e1c09e230 2023-09-30T22:31:45.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.546+0000 7f3e11ffb700 1 -- 172.21.15.40:0/1477795898 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0c004380 con 0x7f3e1c09e230 2023-09-30T22:31:45.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.546+0000 7f3e239ba700 1 -- 172.21.15.40:0/1477795898 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e1c09cb00 con 0x7f3e1c09e230 2023-09-30T22:31:45.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.546+0000 7f3e11ffb700 1 -- 172.21.15.40:0/1477795898 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c0036c0 con 0x7f3e1c09e230 2023-09-30T22:31:45.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.547+0000 7f3e239ba700 1 -- 172.21.15.40:0/1477795898 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e1c123b50 con 0x7f3e1c09e230 2023-09-30T22:31:45.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.548+0000 7f3e11ffb700 1 -- 172.21.15.40:0/1477795898 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3e0c003820 con 0x7f3e1c09e230 2023-09-30T22:31:45.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.548+0000 7f3e11ffb700 1 -- 172.21.15.40:0/1477795898 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3e0c03f9b0 con 0x7f3e1c09e230 2023-09-30T22:31:45.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.548+0000 7f3e239ba700 1 -- 172.21.15.40:0/1477795898 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e1c124df0 con 0x7f3e1c09e230 2023-09-30T22:31:45.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.557+0000 7f3e11ffb700 1 -- 172.21.15.40:0/1477795898 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3e1c124df0 con 0x7f3e1c09e230 2023-09-30T22:31:45.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.581+0000 7efceb7eb700 1 Processor -- start 2023-09-30T22:31:45.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.581+0000 7efceb7eb700 1 -- start start 2023-09-30T22:31:45.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.582+0000 7efceb7eb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efce409d450 0x7efce409d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:45.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.582+0000 7efceb7eb700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efce41308d0 0x7efce4138420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:45.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.582+0000 7efceb7eb700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce409e8b0 con 0x7efce409dd60 2023-09-30T22:31:45.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.582+0000 7efceb7eb700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efce409c3b0 con 0x7efce409d450 2023-09-30T22:31:45.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.582+0000 7efceb7eb700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efce409a6b0 con 0x7efce41308d0 2023-09-30T22:31:45.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.582+0000 7efce9587700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efce409d450 0x7efce409d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:45.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.582+0000 7efce9587700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efce409d450 0x7efce409d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38850/0 (socket says 172.21.15.40:38850) 2023-09-30T22:31:45.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.582+0000 7efce9587700 1 -- 172.21.15.40:0/277405578 learned_addr learned my addr 172.21.15.40:0/277405578 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:45.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.582+0000 7efce9d88700 1 --2- 172.21.15.40:0/277405578 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efce41308d0 0x7efce4138420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:45.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.583+0000 7efce9587700 1 -- 172.21.15.40:0/277405578 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efce41308d0 msgr2=0x7efce4138420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:45.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.583+0000 7efce9587700 1 --2- 172.21.15.40:0/277405578 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efce41308d0 0x7efce4138420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.583+0000 7efce9587700 1 -- 172.21.15.40:0/277405578 >> v1:172.21.15.40:6789/0 conn(0x7efce409dd60 legacy=0x7efce41301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:45.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.583+0000 7efce9587700 1 -- 172.21.15.40:0/277405578 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce409b4f0 con 0x7efce409d450 2023-09-30T22:31:45.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.583+0000 7efce9587700 1 --2- 172.21.15.40:0/277405578 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efce409d450 0x7efce409d820 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7efce000bb90 tx=0x7efce000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84cd122ed39760b4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:45.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.583+0000 7efcdbfff700 1 -- 172.21.15.40:0/277405578 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce000dc20 con 0x7efce409d450 2023-09-30T22:31:45.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.583+0000 7efcdbfff700 1 -- 172.21.15.40:0/277405578 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce000dd80 con 0x7efce409d450 2023-09-30T22:31:45.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.583+0000 7efcdbfff700 1 -- 172.21.15.40:0/277405578 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce0017630 con 0x7efce409d450 2023-09-30T22:31:45.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.584+0000 7efceb7eb700 1 -- 172.21.15.40:0/277405578 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efce409d450 msgr2=0x7efce409d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:45.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.584+0000 7efceb7eb700 1 --2- 172.21.15.40:0/277405578 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efce409d450 0x7efce409d820 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7efce000bb90 tx=0x7efce000bea0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.584+0000 7efceb7eb700 1 -- 172.21.15.40:0/277405578 shutdown_connections 2023-09-30T22:31:45.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.584+0000 7efceb7eb700 1 --2- 172.21.15.40:0/277405578 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efce41308d0 0x7efce4138420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.584+0000 7efceb7eb700 1 --2- 172.21.15.40:0/277405578 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efce409d450 0x7efce409d820 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.584+0000 7efceb7eb700 1 -- 172.21.15.40:0/277405578 >> 172.21.15.40:0/277405578 conn(0x7efce40a2a00 msgr2=0x7efce40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:45.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.584+0000 7efceb7eb700 1 -- 172.21.15.40:0/277405578 shutdown_connections 2023-09-30T22:31:45.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.584+0000 7efceb7eb700 1 -- 172.21.15.40:0/277405578 wait complete. 2023-09-30T22:31:45.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.585+0000 7ff7766f6700 1 Processor -- start 2023-09-30T22:31:45.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.585+0000 7ff7766f6700 1 -- start start 2023-09-30T22:31:45.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.585+0000 7efceb7eb700 1 Processor -- start 2023-09-30T22:31:45.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.585+0000 7efceb7eb700 1 -- start start 2023-09-30T22:31:45.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.586+0000 7ff7766f6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff77012e590 0x7ff77012e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:45.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.586+0000 7ff7766f6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff77012d8a0 0x7ff770138c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:45.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.586+0000 7ff7766f6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff77009ab70 con 0x7ff77012eea0 2023-09-30T22:31:45.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.586+0000 7ff7766f6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77009b270 con 0x7ff77012d8a0 2023-09-30T22:31:45.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.586+0000 7ff7766f6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff77009bab0 con 0x7ff77012e590 2023-09-30T22:31:45.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.586+0000 7efceb7eb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efce409d450 0x7efce411f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:45.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.586+0000 7efceb7eb700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efce409dd60 0x7efce411f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:45.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.586+0000 7efceb7eb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efce41308d0 0x7efce41c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:45.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.586+0000 7efceb7eb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce4121c70 con 0x7efce409d450 2023-09-30T22:31:45.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.586+0000 7efceb7eb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce411fb30 con 0x7efce41308d0 2023-09-30T22:31:45.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.586+0000 7efceb7eb700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efce411ecd0 con 0x7efce409dd60 2023-09-30T22:31:45.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.586+0000 7efce8d86700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efce409dd60 0x7efce411f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:45.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.586+0000 7ff76f7fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff77012eea0 0x7ff77012d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:35194/0 (socket says 172.21.15.40:35194) 2023-09-30T22:31:45.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.586+0000 7ff76f7fe700 1 -- 172.21.15.40:0/993775122 learned_addr learned my addr 172.21.15.40:0/993775122 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:45.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.587+0000 7ff774c93700 1 --2- 172.21.15.40:0/993775122 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff77012d8a0 0x7ff770138c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:45.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.586+0000 7efce9d88700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efce41308d0 0x7efce41c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:45.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.586+0000 7efce8d86700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efce409dd60 0x7efce411f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:36776/0 (socket says 172.21.15.40:36776) 2023-09-30T22:31:45.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.586+0000 7efce8d86700 1 -- 172.21.15.40:0/3360629187 learned_addr learned my addr 172.21.15.40:0/3360629187 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:45.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.586+0000 7efce9587700 1 --2- 172.21.15.40:0/3360629187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efce409d450 0x7efce411f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:45.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.587+0000 7efce8d86700 1 -- 172.21.15.40:0/3360629187 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efce41308d0 msgr2=0x7efce41c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:45.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.587+0000 7efce8d86700 1 --2- 172.21.15.40:0/3360629187 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efce41308d0 0x7efce41c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.587+0000 7efce8d86700 1 -- 172.21.15.40:0/3360629187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efce409d450 msgr2=0x7efce411f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:45.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.587+0000 7efce8d86700 1 --2- 172.21.15.40:0/3360629187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efce409d450 0x7efce411f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.587+0000 7efce8d86700 1 -- 172.21.15.40:0/3360629187 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce000b7f0 con 0x7efce409dd60 2023-09-30T22:31:45.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.587+0000 7ff76effd700 1 -- 172.21.15.40:0/993775122 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 300044731 0 0) 0x7ff77009ab70 con 0x7ff77012eea0 2023-09-30T22:31:45.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.587+0000 7ff76effd700 1 -- 172.21.15.40:0/993775122 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7580035b0 con 0x7ff77012eea0 2023-09-30T22:31:45.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.587+0000 7efce8d86700 1 --2- 172.21.15.40:0/3360629187 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efce409dd60 0x7efce411f5f0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7efcd400c4e0 tx=0x7efcd400c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:45.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.587+0000 7ff76effd700 1 -- 172.21.15.40:0/993775122 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 137894962 0 0) 0x7ff7580035b0 con 0x7ff77012eea0 2023-09-30T22:31:45.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.587+0000 7ff76effd700 1 -- 172.21.15.40:0/993775122 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff77012e590 msgr2=0x7ff77012e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:45.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.587+0000 7ff76effd700 1 --2- 172.21.15.40:0/993775122 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff77012e590 0x7ff77012e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.587+0000 7ff76effd700 1 -- 172.21.15.40:0/993775122 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff77012d8a0 msgr2=0x7ff770138c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:45.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.587+0000 7ff76effd700 1 --2- 172.21.15.40:0/993775122 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff77012d8a0 0x7ff770138c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.587+0000 7ff76effd700 1 -- 172.21.15.40:0/993775122 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77009bd70 con 0x7ff77012eea0 2023-09-30T22:31:45.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.587+0000 7ff76effd700 1 -- 172.21.15.40:0/993775122 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4231795173 0 0) 0x7ff764001670 con 0x7ff77012eea0 2023-09-30T22:31:45.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.587+0000 7ff76effd700 1 -- 172.21.15.40:0/993775122 >> v1:172.21.15.40:6789/0 conn(0x7ff77012eea0 legacy=0x7ff77012d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:45.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.587+0000 7ff76effd700 1 --2- 172.21.15.40:0/993775122 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff77012d8a0 0x7ff758003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:45.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.587+0000 7ff76effd700 1 --2- 172.21.15.40:0/993775122 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff77012e590 0x7ff758003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:45.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.587+0000 7ff76effd700 1 --2- 172.21.15.40:0/993775122 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff758004850 0x7ff758004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:45.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.587+0000 7ff76effd700 1 -- 172.21.15.40:0/993775122 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77009b270 con 0x7ff758004850 2023-09-30T22:31:45.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.587+0000 7ff76effd700 1 -- 172.21.15.40:0/993775122 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77009bab0 con 0x7ff77012d8a0 2023-09-30T22:31:45.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.587+0000 7ff76effd700 1 -- 172.21.15.40:0/993775122 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff758005350 con 0x7ff77012e590 2023-09-30T22:31:45.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.587+0000 7ff76f7fe700 1 --2- 172.21.15.40:0/993775122 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff77012e590 0x7ff758003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:45.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.587+0000 7efcd9ffb700 1 -- 172.21.15.40:0/3360629187 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd40052d0 con 0x7efce409dd60 2023-09-30T22:31:45.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.587+0000 7efcd9ffb700 1 -- 172.21.15.40:0/3360629187 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd400ce90 con 0x7efce409dd60 2023-09-30T22:31:45.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.587+0000 7ff76ffff700 1 --2- 172.21.15.40:0/993775122 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff77012d8a0 0x7ff758003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:45.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.587+0000 7ff774c93700 1 --2- 172.21.15.40:0/993775122 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff758004850 0x7ff758004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:45.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.587+0000 7efcd9ffb700 1 -- 172.21.15.40:0/3360629187 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd4003680 con 0x7efce409dd60 2023-09-30T22:31:45.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.588+0000 7ff76ffff700 1 -- 172.21.15.40:0/993775122 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff77012e590 msgr2=0x7ff758003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:45.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.588+0000 7ff76ffff700 1 --2- 172.21.15.40:0/993775122 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff77012e590 0x7ff758003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.588+0000 7ff76ffff700 1 -- 172.21.15.40:0/993775122 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff758004850 msgr2=0x7ff758004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:45.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.588+0000 7ff76ffff700 1 --2- 172.21.15.40:0/993775122 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff758004850 0x7ff758004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.588+0000 7ff76ffff700 1 -- 172.21.15.40:0/993775122 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77009bd70 con 0x7ff77012d8a0 2023-09-30T22:31:45.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.588+0000 7ff76f7fe700 1 --2- 172.21.15.40:0/993775122 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff77012e590 0x7ff758003fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:45.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.588+0000 7ff774c93700 1 --2- 172.21.15.40:0/993775122 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff758004850 0x7ff758004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:45.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.588+0000 7ff76ffff700 1 --2- 172.21.15.40:0/993775122 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff77012d8a0 0x7ff758003a00 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7ff760009910 tx=0x7ff758005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bbeca4c86adfa80 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:45.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.588+0000 7ff76effd700 1 -- 172.21.15.40:0/993775122 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff760004230 con 0x7ff77012d8a0 2023-09-30T22:31:45.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.588+0000 7ff76effd700 1 -- 172.21.15.40:0/993775122 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7600043b0 con 0x7ff77012d8a0 2023-09-30T22:31:45.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.588+0000 7ff76effd700 1 -- 172.21.15.40:0/993775122 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7600038c0 con 0x7ff77012d8a0 2023-09-30T22:31:45.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.588+0000 7efceb7eb700 1 -- 172.21.15.40:0/3360629187 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efce409c5d0 con 0x7efce409dd60 2023-09-30T22:31:45.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.589+0000 7efceb7eb700 1 -- 172.21.15.40:0/3360629187 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efce4120ee0 con 0x7efce409dd60 2023-09-30T22:31:45.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.589+0000 7ff7766f6700 1 -- 172.21.15.40:0/993775122 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff77012d8a0 msgr2=0x7ff758003a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:45.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.589+0000 7ff7766f6700 1 --2- 172.21.15.40:0/993775122 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff77012d8a0 0x7ff758003a00 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7ff760009910 tx=0x7ff758005880 comp rx=0 tx=0).stop 2023-09-30T22:31:45.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.589+0000 7ff7766f6700 1 -- 172.21.15.40:0/993775122 shutdown_connections 2023-09-30T22:31:45.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.589+0000 7ff7766f6700 1 --2- 172.21.15.40:0/993775122 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff77012e590 0x7ff758003fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.589+0000 7ff7766f6700 1 --2- 172.21.15.40:0/993775122 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff758004850 0x7ff758004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.589+0000 7ff7766f6700 1 --2- 172.21.15.40:0/993775122 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff77012d8a0 0x7ff758003a00 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.589+0000 7ff7766f6700 1 -- 172.21.15.40:0/993775122 >> 172.21.15.40:0/993775122 conn(0x7ff7700a2a00 msgr2=0x7ff7700a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:45.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.589+0000 7ff7766f6700 1 -- 172.21.15.40:0/993775122 shutdown_connections 2023-09-30T22:31:45.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.589+0000 7ff7766f6700 1 -- 172.21.15.40:0/993775122 wait complete. 2023-09-30T22:31:45.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.589+0000 7efcd9ffb700 1 -- 172.21.15.40:0/3360629187 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efcd40037e0 con 0x7efce409dd60 2023-09-30T22:31:45.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.589+0000 7efcd9ffb700 1 -- 172.21.15.40:0/3360629187 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7efcd403ea60 con 0x7efce409dd60 2023-09-30T22:31:45.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.590+0000 7efceb7eb700 1 -- 172.21.15.40:0/3360629187 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efce4121fe0 con 0x7efce409dd60 2023-09-30T22:31:45.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.590+0000 7ff7766f6700 1 Processor -- start 2023-09-30T22:31:45.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.590+0000 7ff7766f6700 1 -- start start 2023-09-30T22:31:45.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.591+0000 7ff7766f6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff758004850 0x7ff770119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:45.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.591+0000 7ff7766f6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff77012d8a0 0x7ff770119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:45.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.591+0000 7ff7766f6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff77012e590 0x7ff770119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:45.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.591+0000 7ff7766f6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77011a520 con 0x7ff758004850 2023-09-30T22:31:45.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.591+0000 7ff7766f6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7700714a0 con 0x7ff77012e590 2023-09-30T22:31:45.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.591+0000 7ff7766f6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff77012cc80 con 0x7ff77012d8a0 2023-09-30T22:31:45.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.591+0000 7ff76ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff758004850 0x7ff770119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:45.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.591+0000 7ff76ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff758004850 0x7ff770119050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38880/0 (socket says 172.21.15.40:38880) 2023-09-30T22:31:45.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.591+0000 7ff76ffff700 1 -- 172.21.15.40:0/3585747823 learned_addr learned my addr 172.21.15.40:0/3585747823 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:45.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.591+0000 7ff76f7fe700 1 --2- 172.21.15.40:0/3585747823 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff77012d8a0 0x7ff770119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:45.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.591+0000 7ff774c93700 1 --2- 172.21.15.40:0/3585747823 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff77012e590 0x7ff770119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:45.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.592+0000 7ff76ffff700 1 -- 172.21.15.40:0/3585747823 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff77012d8a0 msgr2=0x7ff770119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:45.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.592+0000 7ff76ffff700 1 --2- 172.21.15.40:0/3585747823 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff77012d8a0 0x7ff770119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.592+0000 7ff76ffff700 1 -- 172.21.15.40:0/3585747823 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff77012e590 msgr2=0x7ff770119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:45.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.592+0000 7ff76ffff700 1 --2- 172.21.15.40:0/3585747823 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff77012e590 0x7ff770119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.592+0000 7ff76ffff700 1 -- 172.21.15.40:0/3585747823 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77011a2e0 con 0x7ff758004850 2023-09-30T22:31:45.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.592+0000 7ff76ffff700 1 --2- 172.21.15.40:0/3585747823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff758004850 0x7ff770119050 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7ff760007fd0 tx=0x7ff760004860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:45.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.592+0000 7ff76cff9700 1 -- 172.21.15.40:0/3585747823 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff760011dc0 con 0x7ff758004850 2023-09-30T22:31:45.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.592+0000 7ff76cff9700 1 -- 172.21.15.40:0/3585747823 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7600224d0 con 0x7ff758004850 2023-09-30T22:31:45.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.592+0000 7ff76cff9700 1 -- 172.21.15.40:0/3585747823 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff760022880 con 0x7ff758004850 2023-09-30T22:31:45.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.593+0000 7ff7766f6700 1 -- 172.21.15.40:0/3585747823 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff77011b6a0 con 0x7ff758004850 2023-09-30T22:31:45.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.593+0000 7ff7766f6700 1 -- 172.21.15.40:0/3585747823 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff770070a90 con 0x7ff758004850 2023-09-30T22:31:45.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.594+0000 7ff7766f6700 1 -- 172.21.15.40:0/3585747823 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7700a1700 con 0x7ff758004850 2023-09-30T22:31:45.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.594+0000 7ff76cff9700 1 -- 172.21.15.40:0/3585747823 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff7600229e0 con 0x7ff758004850 2023-09-30T22:31:45.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.594+0000 7ff76cff9700 1 -- 172.21.15.40:0/3585747823 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff760044480 con 0x7ff758004850 2023-09-30T22:31:45.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.599+0000 7ff76cff9700 1 -- 172.21.15.40:0/3585747823 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff760022c90 con 0x7ff758004850 2023-09-30T22:31:45.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.599+0000 7efcd9ffb700 1 -- 172.21.15.40:0/3360629187 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efce4121fe0 con 0x7efce409dd60 2023-09-30T22:31:45.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.732+0000 7fa3e484f700 1 -- 172.21.15.40:0/3136946898 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa3c4005590 con 0x7fa3e012d6d0 2023-09-30T22:31:45.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.733+0000 7fa3ceffd700 1 -- 172.21.15.40:0/3136946898 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa3d0017070 con 0x7fa3e012d6d0 2023-09-30T22:31:45.734 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:45.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.735+0000 7fa3e484f700 1 -- 172.21.15.40:0/3136946898 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3e012d6d0 msgr2=0x7fa3e006f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:45.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.735+0000 7fa3e484f700 1 --2- 172.21.15.40:0/3136946898 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3e012d6d0 0x7fa3e006f9d0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fa3d000e9b0 tx=0x7fa3d000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.735+0000 7fa3e484f700 1 -- 172.21.15.40:0/3136946898 shutdown_connections 2023-09-30T22:31:45.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.735+0000 7fa3e484f700 1 --2- 172.21.15.40:0/3136946898 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa3e012eea0 0x7fa3e0070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.735+0000 7fa3e484f700 1 --2- 172.21.15.40:0/3136946898 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3e012d6d0 0x7fa3e006f9d0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.735+0000 7fa3e484f700 1 --2- 172.21.15.40:0/3136946898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3e012e590 0x7fa3e006ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.735+0000 7fa3e484f700 1 -- 172.21.15.40:0/3136946898 >> 172.21.15.40:0/3136946898 conn(0x7fa3e00a2a00 msgr2=0x7fa3e009d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:45.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.735+0000 7fa3e484f700 1 -- 172.21.15.40:0/3136946898 shutdown_connections 2023-09-30T22:31:45.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.735+0000 7fa3e484f700 1 -- 172.21.15.40:0/3136946898 wait complete. 2023-09-30T22:31:45.753 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:45.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.768+0000 7f3e239ba700 1 -- 172.21.15.40:0/1477795898 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3e1c124df0 con 0x7f3e1c09e230 2023-09-30T22:31:45.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.768+0000 7f3e11ffb700 1 -- 172.21.15.40:0/1477795898 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3e1c124df0 con 0x7f3e1c09e230 2023-09-30T22:31:45.769 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:45.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.770+0000 7f3e239ba700 1 -- 172.21.15.40:0/1477795898 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e1c09e230 msgr2=0x7f3e1c121c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:45.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.770+0000 7f3e239ba700 1 --2- 172.21.15.40:0/1477795898 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e1c09e230 0x7f3e1c121c90 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c00c740 tx=0x7f3e0c00ca50 comp rx=0 tx=0).stop 2023-09-30T22:31:45.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.770+0000 7f3e239ba700 1 -- 172.21.15.40:0/1477795898 shutdown_connections 2023-09-30T22:31:45.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.770+0000 7f3e239ba700 1 --2- 172.21.15.40:0/1477795898 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3e1c09d920 0x7f3e1c121750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.770+0000 7f3e239ba700 1 --2- 172.21.15.40:0/1477795898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e1c130de0 0x7f3e1c1221d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.770+0000 7f3e239ba700 1 --2- 172.21.15.40:0/1477795898 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3e1c09e230 0x7f3e1c121c90 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.770+0000 7f3e239ba700 1 -- 172.21.15.40:0/1477795898 >> 172.21.15.40:0/1477795898 conn(0x7f3e1c09fb20 msgr2=0x7f3e1c130190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:45.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.770+0000 7f3e239ba700 1 -- 172.21.15.40:0/1477795898 shutdown_connections 2023-09-30T22:31:45.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.770+0000 7f3e239ba700 1 -- 172.21.15.40:0/1477795898 wait complete. 2023-09-30T22:31:45.783 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:45.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.799+0000 7ff7766f6700 1 -- 172.21.15.40:0/3585747823 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff770062380 con 0x7ff758004850 2023-09-30T22:31:45.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.800+0000 7ff76cff9700 1 -- 172.21.15.40:0/3585747823 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff760032020 con 0x7ff758004850 2023-09-30T22:31:45.801 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:45.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.802+0000 7ff7766f6700 1 -- 172.21.15.40:0/3585747823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff758004850 msgr2=0x7ff770119050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:45.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.802+0000 7ff7766f6700 1 --2- 172.21.15.40:0/3585747823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff758004850 0x7ff770119050 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7ff760007fd0 tx=0x7ff760004860 comp rx=0 tx=0).stop 2023-09-30T22:31:45.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.802+0000 7ff7766f6700 1 -- 172.21.15.40:0/3585747823 shutdown_connections 2023-09-30T22:31:45.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.802+0000 7ff7766f6700 1 --2- 172.21.15.40:0/3585747823 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff77012e590 0x7ff770119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.802+0000 7ff7766f6700 1 --2- 172.21.15.40:0/3585747823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff758004850 0x7ff770119050 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.802+0000 7ff7766f6700 1 --2- 172.21.15.40:0/3585747823 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff77012d8a0 0x7ff770119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.802+0000 7ff7766f6700 1 -- 172.21.15.40:0/3585747823 >> 172.21.15.40:0/3585747823 conn(0x7ff7700a2a00 msgr2=0x7ff7701b6920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:45.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.802+0000 7ff7766f6700 1 -- 172.21.15.40:0/3585747823 shutdown_connections 2023-09-30T22:31:45.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.802+0000 7ff7766f6700 1 -- 172.21.15.40:0/3585747823 wait complete. 2023-09-30T22:31:45.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.803+0000 7efceb7eb700 1 -- 172.21.15.40:0/3360629187 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efce4121fe0 con 0x7efce409dd60 2023-09-30T22:31:45.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.804+0000 7efcd9ffb700 1 -- 172.21.15.40:0/3360629187 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efce4121fe0 con 0x7efce409dd60 2023-09-30T22:31:45.804 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:45.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.806+0000 7efceb7eb700 1 -- 172.21.15.40:0/3360629187 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efce409dd60 msgr2=0x7efce411f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:45.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.806+0000 7efceb7eb700 1 --2- 172.21.15.40:0/3360629187 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efce409dd60 0x7efce411f5f0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7efcd400c4e0 tx=0x7efcd400c7f0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.806+0000 7efceb7eb700 1 -- 172.21.15.40:0/3360629187 shutdown_connections 2023-09-30T22:31:45.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.806+0000 7efceb7eb700 1 --2- 172.21.15.40:0/3360629187 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efce41308d0 0x7efce41c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.806+0000 7efceb7eb700 1 --2- 172.21.15.40:0/3360629187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efce409d450 0x7efce411f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.806+0000 7efceb7eb700 1 --2- 172.21.15.40:0/3360629187 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7efce409dd60 0x7efce411f5f0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:45.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.806+0000 7efceb7eb700 1 -- 172.21.15.40:0/3360629187 >> 172.21.15.40:0/3360629187 conn(0x7efce40a2a00 msgr2=0x7efce40a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:45.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.806+0000 7efceb7eb700 1 -- 172.21.15.40:0/3360629187 shutdown_connections 2023-09-30T22:31:45.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:45.806+0000 7efceb7eb700 1 -- 172.21.15.40:0/3360629187 wait complete. 2023-09-30T22:31:45.817 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:45.822 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:46.754 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:46.784 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:46.817 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:46.822 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:46.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.906+0000 7fd9b1c4c700 1 Processor -- start 2023-09-30T22:31:46.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.906+0000 7fd9b1c4c700 1 -- start start 2023-09-30T22:31:46.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.906+0000 7fd9b1c4c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd9ac136c50 0x7fd9ac139030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:46.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.906+0000 7fd9b1c4c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9ac139570 0x7fd9ac13b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:46.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.906+0000 7fd9b1c4c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9ac133940 con 0x7fd9ac133e00 2023-09-30T22:31:46.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.906+0000 7fd9b1c4c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9ac09af70 con 0x7fd9ac136c50 2023-09-30T22:31:46.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.906+0000 7fd9b1c4c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac09ab20 con 0x7fd9ac139570 2023-09-30T22:31:46.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.907+0000 7fd9aaffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd9ac136c50 0x7fd9ac139030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:46.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.907+0000 7fd9abfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9ac139570 0x7fd9ac13b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:46.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.907+0000 7fd9aaffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd9ac136c50 0x7fd9ac139030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38896/0 (socket says 172.21.15.40:38896) 2023-09-30T22:31:46.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.907+0000 7fd9aaffd700 1 -- 172.21.15.40:0/537218432 learned_addr learned my addr 172.21.15.40:0/537218432 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:46.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.907+0000 7fd9aaffd700 1 -- 172.21.15.40:0/537218432 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9ac139570 msgr2=0x7fd9ac13b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:46.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.907+0000 7fd9aaffd700 1 --2- 172.21.15.40:0/537218432 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9ac139570 0x7fd9ac13b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.907+0000 7fd9aaffd700 1 -- 172.21.15.40:0/537218432 >> v1:172.21.15.40:6789/0 conn(0x7fd9ac133e00 legacy=0x7fd9ac1341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:46.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.907+0000 7fd9aaffd700 1 -- 172.21.15.40:0/537218432 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ac09f0d0 con 0x7fd9ac136c50 2023-09-30T22:31:46.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.907+0000 7fd9abfff700 1 --2- 172.21.15.40:0/537218432 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9ac139570 0x7fd9ac13b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:46.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.907+0000 7fd9aaffd700 1 --2- 172.21.15.40:0/537218432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9ac136c50 0x7fd9ac139030 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7fd9a00098f0 tx=0x7fd9a0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eec92a77f6f82e2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:46.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.908+0000 7fd9aa7fc700 1 -- 172.21.15.40:0/537218432 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a0011830 con 0x7fd9ac136c50 2023-09-30T22:31:46.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.908+0000 7fd9aa7fc700 1 -- 172.21.15.40:0/537218432 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a0011990 con 0x7fd9ac136c50 2023-09-30T22:31:46.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.908+0000 7fd9aa7fc700 1 -- 172.21.15.40:0/537218432 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a0011d20 con 0x7fd9ac136c50 2023-09-30T22:31:46.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.909+0000 7fd9b1c4c700 1 -- 172.21.15.40:0/537218432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9ac136c50 msgr2=0x7fd9ac139030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:46.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.909+0000 7fd9b1c4c700 1 --2- 172.21.15.40:0/537218432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9ac136c50 0x7fd9ac139030 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7fd9a00098f0 tx=0x7fd9a0009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:46.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.909+0000 7fd9b1c4c700 1 -- 172.21.15.40:0/537218432 shutdown_connections 2023-09-30T22:31:46.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.909+0000 7fd9b1c4c700 1 --2- 172.21.15.40:0/537218432 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9ac139570 0x7fd9ac13b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.909+0000 7fd9b1c4c700 1 --2- 172.21.15.40:0/537218432 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9ac136c50 0x7fd9ac139030 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.909+0000 7fd9b1c4c700 1 -- 172.21.15.40:0/537218432 >> 172.21.15.40:0/537218432 conn(0x7fd9ac0a2a00 msgr2=0x7fd9ac0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:46.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.909+0000 7fd9b1c4c700 1 -- 172.21.15.40:0/537218432 shutdown_connections 2023-09-30T22:31:46.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.909+0000 7fd9b1c4c700 1 -- 172.21.15.40:0/537218432 wait complete. 2023-09-30T22:31:46.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.910+0000 7fd9b1c4c700 1 Processor -- start 2023-09-30T22:31:46.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.911+0000 7fd9b1c4c700 1 -- start start 2023-09-30T22:31:46.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.911+0000 7fd9b1c4c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd9ac133e00 0x7fd9ac12c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:46.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.911+0000 7fd9b1c4c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9ac136c50 0x7fd9ac12cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:46.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.911+0000 7fd9b1c4c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9ac139570 0x7fd9ac12d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:46.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.911+0000 7fd9b1c4c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac130f10 con 0x7fd9ac136c50 2023-09-30T22:31:46.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.911+0000 7fd9b1c4c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac12de00 con 0x7fd9ac139570 2023-09-30T22:31:46.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.911+0000 7fd9b1c4c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac1392d0 con 0x7fd9ac133e00 2023-09-30T22:31:46.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.911+0000 7fd9abfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9ac139570 0x7fd9ac12d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:46.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.911+0000 7fd9abfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9ac139570 0x7fd9ac12d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:57998/0 (socket says 172.21.15.40:57998) 2023-09-30T22:31:46.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.911+0000 7fd9abfff700 1 -- 172.21.15.40:0/3665612567 learned_addr learned my addr 172.21.15.40:0/3665612567 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:46.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.911+0000 7fd9aaffd700 1 --2- 172.21.15.40:0/3665612567 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9ac136c50 0x7fd9ac12cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:46.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.912+0000 7fd9ab7fe700 1 --2- 172.21.15.40:0/3665612567 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd9ac133e00 0x7fd9ac12c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:46.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.912+0000 7fd9abfff700 1 -- 172.21.15.40:0/3665612567 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd9ac133e00 msgr2=0x7fd9ac12c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:46.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.912+0000 7fd9abfff700 1 --2- 172.21.15.40:0/3665612567 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd9ac133e00 0x7fd9ac12c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.912+0000 7fd9abfff700 1 -- 172.21.15.40:0/3665612567 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9ac136c50 msgr2=0x7fd9ac12cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:46.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.912+0000 7fd9abfff700 1 --2- 172.21.15.40:0/3665612567 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9ac136c50 0x7fd9ac12cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.912+0000 7fd9abfff700 1 -- 172.21.15.40:0/3665612567 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a4009a70 con 0x7fd9ac139570 2023-09-30T22:31:46.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.912+0000 7fd9ab7fe700 1 --2- 172.21.15.40:0/3665612567 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd9ac133e00 0x7fd9ac12c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:31:46.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.912+0000 7fd9abfff700 1 --2- 172.21.15.40:0/3665612567 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9ac139570 0x7fd9ac12d220 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fd9a400efc0 tx=0x7fd9a400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:46.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.912+0000 7fd993fff700 1 -- 172.21.15.40:0/3665612567 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a400cb40 con 0x7fd9ac139570 2023-09-30T22:31:46.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.912+0000 7fd993fff700 1 -- 172.21.15.40:0/3665612567 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a400f040 con 0x7fd9ac139570 2023-09-30T22:31:46.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.912+0000 7fd9b1c4c700 1 -- 172.21.15.40:0/3665612567 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a0009550 con 0x7fd9ac139570 2023-09-30T22:31:46.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.912+0000 7fd993fff700 1 -- 172.21.15.40:0/3665612567 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4003a20 con 0x7fd9ac139570 2023-09-30T22:31:46.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.912+0000 7fd9b1c4c700 1 -- 172.21.15.40:0/3665612567 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9ac11b4f0 con 0x7fd9ac139570 2023-09-30T22:31:46.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.913+0000 7fd9b1c4c700 1 -- 172.21.15.40:0/3665612567 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9ac11b680 con 0x7fd9ac139570 2023-09-30T22:31:46.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.914+0000 7fd993fff700 1 -- 172.21.15.40:0/3665612567 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd9a4014480 con 0x7fd9ac139570 2023-09-30T22:31:46.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.915+0000 7fd993fff700 1 -- 172.21.15.40:0/3665612567 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd9a4040720 con 0x7fd9ac139570 2023-09-30T22:31:46.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.918+0000 7fd993fff700 1 -- 172.21.15.40:0/3665612567 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd9a401b950 con 0x7fd9ac139570 2023-09-30T22:31:46.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.944+0000 7fd04cb65700 1 Processor -- start 2023-09-30T22:31:46.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.945+0000 7fd04cb65700 1 -- start start 2023-09-30T22:31:46.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.945+0000 7fd04cb65700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd04809e400 0x7fd048135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:46.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.945+0000 7fd04cb65700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd048136230 0x7fd048138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:46.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.945+0000 7fd04cb65700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd04809adf0 con 0x7fd04809d920 2023-09-30T22:31:46.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.945+0000 7fd04cb65700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04809e7f0 con 0x7fd048136230 2023-09-30T22:31:46.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.945+0000 7fd04cb65700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd04809edf0 con 0x7fd04809e400 2023-09-30T22:31:46.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.945+0000 7fd046d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd048136230 0x7fd048138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:46.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.945+0000 7fd04659c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd04809d920 0x7fd04809dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:35208/0 (socket says 172.21.15.40:35208) 2023-09-30T22:31:46.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.946+0000 7fd04659c700 1 -- 172.21.15.40:0/1982003465 learned_addr learned my addr 172.21.15.40:0/1982003465 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:46.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.946+0000 7fd045d9b700 1 --2- 172.21.15.40:0/1982003465 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd04809e400 0x7fd048135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:46.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.946+0000 7fd046d9d700 1 -- 172.21.15.40:0/1982003465 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd04809e400 msgr2=0x7fd048135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:46.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.946+0000 7fd046d9d700 1 --2- 172.21.15.40:0/1982003465 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd04809e400 0x7fd048135cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.946+0000 7fd046d9d700 1 -- 172.21.15.40:0/1982003465 >> v1:172.21.15.40:6789/0 conn(0x7fd04809d920 legacy=0x7fd04809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:46.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.946+0000 7fd04559a700 1 -- 172.21.15.40:0/1982003465 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4116781320 0 0) 0x7fd04809adf0 con 0x7fd04809d920 2023-09-30T22:31:46.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.946+0000 7fd046d9d700 1 -- 172.21.15.40:0/1982003465 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04809b660 con 0x7fd048136230 2023-09-30T22:31:46.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.946+0000 7fd046d9d700 1 --2- 172.21.15.40:0/1982003465 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd048136230 0x7fd048138610 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fd04000d050 tx=0x7fd04000d360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4af5445cace26bb9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:46.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.946+0000 7fd04559a700 1 -- 172.21.15.40:0/1982003465 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd040010070 con 0x7fd048136230 2023-09-30T22:31:46.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.946+0000 7fd04559a700 1 -- 172.21.15.40:0/1982003465 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04000b2e0 con 0x7fd048136230 2023-09-30T22:31:46.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.946+0000 7fd04559a700 1 -- 172.21.15.40:0/1982003465 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04000dc60 con 0x7fd048136230 2023-09-30T22:31:46.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.947+0000 7fd04cb65700 1 -- 172.21.15.40:0/1982003465 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd048136230 msgr2=0x7fd048138610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:46.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.947+0000 7fd04cb65700 1 --2- 172.21.15.40:0/1982003465 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd048136230 0x7fd048138610 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fd04000d050 tx=0x7fd04000d360 comp rx=0 tx=0).stop 2023-09-30T22:31:46.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.947+0000 7fd04cb65700 1 -- 172.21.15.40:0/1982003465 shutdown_connections 2023-09-30T22:31:46.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.947+0000 7fd04cb65700 1 --2- 172.21.15.40:0/1982003465 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd048136230 0x7fd048138610 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.947+0000 7fd04cb65700 1 --2- 172.21.15.40:0/1982003465 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd04809e400 0x7fd048135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.947+0000 7fd04cb65700 1 -- 172.21.15.40:0/1982003465 >> 172.21.15.40:0/1982003465 conn(0x7fd04809fb20 msgr2=0x7fd04809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:46.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.948+0000 7fd04cb65700 1 -- 172.21.15.40:0/1982003465 shutdown_connections 2023-09-30T22:31:46.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.948+0000 7fd04cb65700 1 -- 172.21.15.40:0/1982003465 wait complete. 2023-09-30T22:31:46.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.949+0000 7fd04cb65700 1 Processor -- start 2023-09-30T22:31:46.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.949+0000 7fd04cb65700 1 -- start start 2023-09-30T22:31:46.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.950+0000 7fd04cb65700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd04809d920 0x7fd04811e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:46.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.950+0000 7fd04cb65700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd04809e400 0x7fd04811e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:46.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.950+0000 7fd04cb65700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd048136230 0x7fd04811ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:46.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.950+0000 7fd04cb65700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd048121a10 con 0x7fd04809e400 2023-09-30T22:31:46.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.950+0000 7fd04cb65700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd048120220 con 0x7fd04809d920 2023-09-30T22:31:46.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.950+0000 7fd04cb65700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd04809cb00 con 0x7fd048136230 2023-09-30T22:31:46.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.950+0000 7fd045d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd04809e400 0x7fd04811e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:46.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.950+0000 7fd04659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd04809d920 0x7fd04811e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:46.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.950+0000 7fd045d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd04809e400 0x7fd04811e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38904/0 (socket says 172.21.15.40:38904) 2023-09-30T22:31:46.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.950+0000 7fd045d9b700 1 -- 172.21.15.40:0/1065541228 learned_addr learned my addr 172.21.15.40:0/1065541228 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:46.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.950+0000 7fd046d9d700 1 --2- 172.21.15.40:0/1065541228 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd048136230 0x7fd04811ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:46.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.951+0000 7fd045d9b700 1 -- 172.21.15.40:0/1065541228 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd048136230 msgr2=0x7fd04811ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:46.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.951+0000 7fd045d9b700 1 --2- 172.21.15.40:0/1065541228 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd048136230 0x7fd04811ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.951+0000 7fd045d9b700 1 -- 172.21.15.40:0/1065541228 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd04809d920 msgr2=0x7fd04811e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:46.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.951+0000 7fd045d9b700 1 --2- 172.21.15.40:0/1065541228 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd04809d920 0x7fd04811e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.951+0000 7fd045d9b700 1 -- 172.21.15.40:0/1065541228 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04000bc80 con 0x7fd04809e400 2023-09-30T22:31:46.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.951+0000 7fd046d9d700 1 --2- 172.21.15.40:0/1065541228 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd048136230 0x7fd04811ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:31:46.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.951+0000 7fd04659c700 1 --2- 172.21.15.40:0/1065541228 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd04809d920 0x7fd04811e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:46.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.951+0000 7fd045d9b700 1 --2- 172.21.15.40:0/1065541228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd04809e400 0x7fd04811e9d0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fd03c00e9b0 tx=0x7fd03c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:46.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.951+0000 7fd036ffd700 1 -- 172.21.15.40:0/1065541228 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c009710 con 0x7fd04809e400 2023-09-30T22:31:46.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.951+0000 7fd036ffd700 1 -- 172.21.15.40:0/1065541228 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03c00c850 con 0x7fd04809e400 2023-09-30T22:31:46.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.951+0000 7fd036ffd700 1 -- 172.21.15.40:0/1065541228 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c00cbc0 con 0x7fd04809e400 2023-09-30T22:31:46.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.951+0000 7fd04cb65700 1 -- 172.21.15.40:0/1065541228 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd048120900 con 0x7fd04809e400 2023-09-30T22:31:46.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.951+0000 7fd04cb65700 1 -- 172.21.15.40:0/1065541228 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0481224b0 con 0x7fd04809e400 2023-09-30T22:31:46.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.953+0000 7fd04cb65700 1 -- 172.21.15.40:0/1065541228 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd04809a660 con 0x7fd04809e400 2023-09-30T22:31:46.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.953+0000 7fd036ffd700 1 -- 172.21.15.40:0/1065541228 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd03c00cd20 con 0x7fd04809e400 2023-09-30T22:31:46.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.953+0000 7fd036ffd700 1 -- 172.21.15.40:0/1065541228 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd03c03fc40 con 0x7fd04809e400 2023-09-30T22:31:46.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.958+0000 7fd036ffd700 1 -- 172.21.15.40:0/1065541228 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd03c01b3b0 con 0x7fd04809e400 2023-09-30T22:31:46.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.984+0000 7ff6f5a67700 1 Processor -- start 2023-09-30T22:31:46.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.984+0000 7ff6f5a67700 1 -- start start 2023-09-30T22:31:46.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.984+0000 7ff6f5a67700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff6f009e400 0x7ff6f0135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:46.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.984+0000 7ff6f5a67700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff6f0136230 0x7ff6f0138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:46.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.985+0000 7ff6f5a67700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f009adf0 con 0x7ff6f009d920 2023-09-30T22:31:46.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.985+0000 7ff6f5a67700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6f009edf0 con 0x7ff6f009e400 2023-09-30T22:31:46.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.985+0000 7ff6f5a67700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f009b660 con 0x7ff6f0136230 2023-09-30T22:31:46.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.985+0000 7ff6effff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff6f0136230 0x7ff6f0138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:46.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.985+0000 7ff6effff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff6f0136230 0x7ff6f0138610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:58008/0 (socket says 172.21.15.40:58008) 2023-09-30T22:31:46.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.985+0000 7ff6effff700 1 -- 172.21.15.40:0/796957008 learned_addr learned my addr 172.21.15.40:0/796957008 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:46.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.985+0000 7ff6eeffd700 1 --2- 172.21.15.40:0/796957008 >> v2:172.21.15.40:3300/0 conn(0x7ff6f009e400 0x7ff6f0135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:46.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.985+0000 7ff6effff700 1 -- 172.21.15.40:0/796957008 >> v2:172.21.15.40:3300/0 conn(0x7ff6f009e400 msgr2=0x7ff6f0135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:46.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.985+0000 7ff6effff700 1 --2- 172.21.15.40:0/796957008 >> v2:172.21.15.40:3300/0 conn(0x7ff6f009e400 0x7ff6f0135cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.985+0000 7ff6effff700 1 -- 172.21.15.40:0/796957008 >> v1:172.21.15.40:6789/0 conn(0x7ff6f009d920 legacy=0x7ff6f009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:46.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.985+0000 7ff6effff700 1 -- 172.21.15.40:0/796957008 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f009a6e0 con 0x7ff6f0136230 2023-09-30T22:31:46.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.985+0000 7ff6effff700 1 --2- 172.21.15.40:0/796957008 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff6f0136230 0x7ff6f0138610 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7ff6e800d150 tx=0x7ff6e800d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8444713a41bbbbfb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:46.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.986+0000 7ff6ee7fc700 1 -- 172.21.15.40:0/796957008 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e8010070 con 0x7ff6f0136230 2023-09-30T22:31:46.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.986+0000 7ff6ee7fc700 1 -- 172.21.15.40:0/796957008 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e800dcd0 con 0x7ff6f0136230 2023-09-30T22:31:46.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.986+0000 7ff6ee7fc700 1 -- 172.21.15.40:0/796957008 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e800b310 con 0x7ff6f0136230 2023-09-30T22:31:46.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.986+0000 7f1f78eea700 1 Processor -- start 2023-09-30T22:31:46.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.986+0000 7f1f78eea700 1 -- start start 2023-09-30T22:31:46.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.986+0000 7ff6f5a67700 1 -- 172.21.15.40:0/796957008 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff6f0136230 msgr2=0x7ff6f0138610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:46.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.986+0000 7ff6f5a67700 1 --2- 172.21.15.40:0/796957008 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff6f0136230 0x7ff6f0138610 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7ff6e800d150 tx=0x7ff6e800d460 comp rx=0 tx=0).stop 2023-09-30T22:31:46.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.987+0000 7ff6f5a67700 1 -- 172.21.15.40:0/796957008 shutdown_connections 2023-09-30T22:31:46.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.987+0000 7ff6f5a67700 1 --2- 172.21.15.40:0/796957008 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff6f0136230 0x7ff6f0138610 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.987+0000 7ff6f5a67700 1 --2- 172.21.15.40:0/796957008 >> v2:172.21.15.40:3300/0 conn(0x7ff6f009e400 0x7ff6f0135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.987+0000 7ff6f5a67700 1 -- 172.21.15.40:0/796957008 >> 172.21.15.40:0/796957008 conn(0x7ff6f009fb20 msgr2=0x7ff6f009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:46.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.987+0000 7ff6f5a67700 1 -- 172.21.15.40:0/796957008 shutdown_connections 2023-09-30T22:31:46.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.987+0000 7ff6f5a67700 1 -- 172.21.15.40:0/796957008 wait complete. 2023-09-30T22:31:46.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.987+0000 7f1f78eea700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f7409d920 0x7f1f7409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:46.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.987+0000 7f1f78eea700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1f7409f0f0 0x7f1f7409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:46.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.987+0000 7f1f78eea700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f74133ca0 0x7f1f74134140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:46.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.987+0000 7f1f78eea700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f7406b4c0 con 0x7f1f7409f0f0 2023-09-30T22:31:46.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.987+0000 7f1f78eea700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7409a8f0 con 0x7f1f74133ca0 2023-09-30T22:31:46.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.987+0000 7f1f78eea700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7409f940 con 0x7f1f7409d920 2023-09-30T22:31:46.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.987+0000 7f1f7259c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f7409d920 0x7f1f7409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:46.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.987+0000 7f1f7259c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f7409d920 0x7f1f7409dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:36834/0 (socket says 172.21.15.40:36834) 2023-09-30T22:31:46.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.987+0000 7f1f7259c700 1 -- 172.21.15.40:0/253321679 learned_addr learned my addr 172.21.15.40:0/253321679 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:46.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.987+0000 7f1f71d9b700 1 --2- 172.21.15.40:0/253321679 >> v2:172.21.15.40:3300/0 conn(0x7f1f7409f0f0 0x7f1f7409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:46.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.987+0000 7f1f72d9d700 1 --2- 172.21.15.40:0/253321679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f74133ca0 0x7f1f74134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:46.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.988+0000 7f1f7259c700 1 -- 172.21.15.40:0/253321679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f74133ca0 msgr2=0x7f1f74134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:46.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.988+0000 7f1f7259c700 1 --2- 172.21.15.40:0/253321679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f74133ca0 0x7f1f74134140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.988+0000 7f1f7259c700 1 -- 172.21.15.40:0/253321679 >> v2:172.21.15.40:3300/0 conn(0x7f1f7409f0f0 msgr2=0x7f1f7409e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:46.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.988+0000 7f1f7259c700 1 --2- 172.21.15.40:0/253321679 >> v2:172.21.15.40:3300/0 conn(0x7f1f7409f0f0 0x7f1f7409e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.988+0000 7f1f7259c700 1 -- 172.21.15.40:0/253321679 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f7409f6e0 con 0x7f1f7409d920 2023-09-30T22:31:46.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.988+0000 7f1f7259c700 1 --2- 172.21.15.40:0/253321679 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f7409d920 0x7f1f7409dcf0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f1f640098f0 tx=0x7f1f64009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f227d633e224518f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:46.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.988+0000 7f1f7159a700 1 -- 172.21.15.40:0/253321679 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f64005e30 con 0x7f1f7409d920 2023-09-30T22:31:46.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.988+0000 7ff6f5a67700 1 Processor -- start 2023-09-30T22:31:46.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.988+0000 7f1f7159a700 1 -- 172.21.15.40:0/253321679 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f64004030 con 0x7f1f7409d920 2023-09-30T22:31:46.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.988+0000 7f1f7159a700 1 -- 172.21.15.40:0/253321679 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f640043e0 con 0x7f1f7409d920 2023-09-30T22:31:46.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.988+0000 7ff6f5a67700 1 -- start start 2023-09-30T22:31:46.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.989+0000 7f1f78eea700 1 -- 172.21.15.40:0/253321679 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f7409d920 msgr2=0x7f1f7409dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:46.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.989+0000 7f1f78eea700 1 --2- 172.21.15.40:0/253321679 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f7409d920 0x7f1f7409dcf0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f1f640098f0 tx=0x7f1f64009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:46.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.989+0000 7f1f78eea700 1 -- 172.21.15.40:0/253321679 shutdown_connections 2023-09-30T22:31:46.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.989+0000 7f1f78eea700 1 --2- 172.21.15.40:0/253321679 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f7409d920 0x7f1f7409dcf0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.989+0000 7f1f78eea700 1 --2- 172.21.15.40:0/253321679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f74133ca0 0x7f1f74134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.989+0000 7f1f78eea700 1 --2- 172.21.15.40:0/253321679 >> v2:172.21.15.40:3300/0 conn(0x7f1f7409f0f0 0x7f1f7409e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.989+0000 7f1f78eea700 1 -- 172.21.15.40:0/253321679 >> 172.21.15.40:0/253321679 conn(0x7f1f7409fb20 msgr2=0x7f1f7409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:46.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.989+0000 7ff6f5a67700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff6f009d920 0x7ff6f011e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:46.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.989+0000 7ff6f5a67700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6f009e400 0x7ff6f011eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:46.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.989+0000 7ff6f5a67700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff6f0136230 0x7ff6f011f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:46.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.989+0000 7ff6f5a67700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f0120770 con 0x7ff6f009e400 2023-09-30T22:31:46.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.989+0000 7ff6f5a67700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f00a32f0 con 0x7ff6f0136230 2023-09-30T22:31:46.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.989+0000 7ff6f5a67700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f009cb00 con 0x7ff6f009d920 2023-09-30T22:31:46.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.989+0000 7ff6eeffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6f009e400 0x7ff6f011eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:46.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.989+0000 7ff6effff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff6f0136230 0x7ff6f011f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:46.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.989+0000 7ff6eeffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6f009e400 0x7ff6f011eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38938/0 (socket says 172.21.15.40:38938) 2023-09-30T22:31:46.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.989+0000 7ff6effff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff6f0136230 0x7ff6f011f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:58026/0 (socket says 172.21.15.40:58026) 2023-09-30T22:31:46.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.989+0000 7ff6eeffd700 1 -- 172.21.15.40:0/1060365438 learned_addr learned my addr 172.21.15.40:0/1060365438 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:46.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.989+0000 7ff6ef7fe700 1 --2- 172.21.15.40:0/1060365438 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff6f009d920 0x7ff6f011e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:46.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.989+0000 7f1f78eea700 1 -- 172.21.15.40:0/253321679 shutdown_connections 2023-09-30T22:31:46.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.989+0000 7f1f78eea700 1 -- 172.21.15.40:0/253321679 wait complete. 2023-09-30T22:31:46.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.990+0000 7ff6effff700 1 -- 172.21.15.40:0/1060365438 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff6f009d920 msgr2=0x7ff6f011e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:46.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.990+0000 7ff6effff700 1 --2- 172.21.15.40:0/1060365438 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff6f009d920 0x7ff6f011e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.990+0000 7ff6effff700 1 -- 172.21.15.40:0/1060365438 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6f009e400 msgr2=0x7ff6f011eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:46.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.990+0000 7ff6effff700 1 --2- 172.21.15.40:0/1060365438 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6f009e400 0x7ff6f011eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:46.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.990+0000 7ff6effff700 1 -- 172.21.15.40:0/1060365438 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e800bd40 con 0x7ff6f0136230 2023-09-30T22:31:46.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.990+0000 7ff6effff700 1 --2- 172.21.15.40:0/1060365438 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff6f0136230 0x7ff6f011f0d0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8016000 tx=0x7ff6e8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:46.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.990+0000 7ff6d7fff700 1 -- 172.21.15.40:0/1060365438 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e8009a10 con 0x7ff6f0136230 2023-09-30T22:31:46.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.990+0000 7ff6f5a67700 1 -- 172.21.15.40:0/1060365438 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f0121870 con 0x7ff6f0136230 2023-09-30T22:31:46.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.990+0000 7ff6d7fff700 1 -- 172.21.15.40:0/1060365438 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e8009b70 con 0x7ff6f0136230 2023-09-30T22:31:46.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.990+0000 7ff6d7fff700 1 -- 172.21.15.40:0/1060365438 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e8004030 con 0x7ff6f0136230 2023-09-30T22:31:46.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.990+0000 7ff6f5a67700 1 -- 172.21.15.40:0/1060365438 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f01209c0 con 0x7ff6f0136230 2023-09-30T22:31:46.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.991+0000 7ff6d7fff700 1 -- 172.21.15.40:0/1060365438 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff6e8004190 con 0x7ff6f0136230 2023-09-30T22:31:46.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.991+0000 7ff6d7fff700 1 -- 172.21.15.40:0/1060365438 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff6e800de40 con 0x7ff6f0136230 2023-09-30T22:31:46.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.991+0000 7f1f78eea700 1 Processor -- start 2023-09-30T22:31:46.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.991+0000 7ff6f5a67700 1 -- 172.21.15.40:0/1060365438 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d00052e0 con 0x7ff6f0136230 2023-09-30T22:31:46.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.992+0000 7f1f78eea700 1 -- start start 2023-09-30T22:31:47.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.992+0000 7f1f78eea700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f7409d920 0x7f1f74121a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:47.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.992+0000 7f1f78eea700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f74133ca0 0x7f1f74121fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:47.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.992+0000 7f1f78eea700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f74125a90 0x7f1f741224f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:47.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.992+0000 7f1f78eea700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f74125590 con 0x7f1f74133ca0 2023-09-30T22:31:47.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.992+0000 7f1f78eea700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f74123680 con 0x7f1f7409d920 2023-09-30T22:31:47.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.992+0000 7f1f78eea700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f740a2a50 con 0x7f1f74125a90 2023-09-30T22:31:47.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.992+0000 7f1f72d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f74125a90 0x7f1f741224f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:47.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.992+0000 7f1f72d9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f74125a90 0x7f1f741224f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:36846/0 (socket says 172.21.15.40:36846) 2023-09-30T22:31:47.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.992+0000 7f1f72d9d700 1 -- 172.21.15.40:0/791500501 learned_addr learned my addr 172.21.15.40:0/791500501 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:47.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.993+0000 7f1f71d9b700 1 --2- 172.21.15.40:0/791500501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f74133ca0 0x7f1f74121fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:47.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.993+0000 7f1f72d9d700 1 -- 172.21.15.40:0/791500501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f7409d920 msgr2=0x7f1f74121a70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:31:47.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.993+0000 7f1f72d9d700 1 --2- 172.21.15.40:0/791500501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f7409d920 0x7f1f74121a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.993+0000 7f1f72d9d700 1 -- 172.21.15.40:0/791500501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f74133ca0 msgr2=0x7f1f74121fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:47.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.993+0000 7f1f72d9d700 1 --2- 172.21.15.40:0/791500501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f74133ca0 0x7f1f74121fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.993+0000 7f1f72d9d700 1 -- 172.21.15.40:0/791500501 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f64009500 con 0x7f1f74125a90 2023-09-30T22:31:47.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.993+0000 7f1f71d9b700 1 --2- 172.21.15.40:0/791500501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f74133ca0 0x7f1f74121fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:47.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.993+0000 7f1f72d9d700 1 --2- 172.21.15.40:0/791500501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f74125a90 0x7f1f741224f0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c007e70 tx=0x7f1f6c00e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:47.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.993+0000 7f1f62ffd700 1 -- 172.21.15.40:0/791500501 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c00ede0 con 0x7f1f74125a90 2023-09-30T22:31:47.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.993+0000 7f1f62ffd700 1 -- 172.21.15.40:0/791500501 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6c014420 con 0x7f1f74125a90 2023-09-30T22:31:47.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.994+0000 7f1f62ffd700 1 -- 172.21.15.40:0/791500501 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c0147d0 con 0x7f1f74125a90 2023-09-30T22:31:47.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.994+0000 7f1f78eea700 1 -- 172.21.15.40:0/791500501 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f7409c9e0 con 0x7f1f74125a90 2023-09-30T22:31:47.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.994+0000 7f1f78eea700 1 -- 172.21.15.40:0/791500501 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f74132590 con 0x7f1f74125a90 2023-09-30T22:31:47.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.995+0000 7f1f62ffd700 1 -- 172.21.15.40:0/791500501 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1f6c014930 con 0x7f1f74125a90 2023-09-30T22:31:47.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.995+0000 7f1f78eea700 1 -- 172.21.15.40:0/791500501 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f580052e0 con 0x7f1f74125a90 2023-09-30T22:31:47.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:46.995+0000 7f1f62ffd700 1 -- 172.21.15.40:0/791500501 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f1f6c03ff80 con 0x7f1f74125a90 2023-09-30T22:31:47.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.000+0000 7f1f62ffd700 1 -- 172.21.15.40:0/791500501 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f6c01bce0 con 0x7f1f74125a90 2023-09-30T22:31:47.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.001+0000 7ff6d7fff700 1 -- 172.21.15.40:0/1060365438 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff6e8022080 con 0x7ff6f0136230 2023-09-30T22:31:47.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.125+0000 7fd9b1c4c700 1 -- 172.21.15.40:0/3665612567 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd9ac130640 con 0x7fd9ac139570 2023-09-30T22:31:47.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.125+0000 7fd993fff700 1 -- 172.21.15.40:0/3665612567 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd9a401b360 con 0x7fd9ac139570 2023-09-30T22:31:47.126 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:47.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.127+0000 7fd9b1c4c700 1 -- 172.21.15.40:0/3665612567 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9ac139570 msgr2=0x7fd9ac12d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:47.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.127+0000 7fd9b1c4c700 1 --2- 172.21.15.40:0/3665612567 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9ac139570 0x7fd9ac12d220 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fd9a400efc0 tx=0x7fd9a400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.127+0000 7fd9b1c4c700 1 -- 172.21.15.40:0/3665612567 shutdown_connections 2023-09-30T22:31:47.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.127+0000 7fd9b1c4c700 1 --2- 172.21.15.40:0/3665612567 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd9ac133e00 0x7fd9ac12c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.127+0000 7fd9b1c4c700 1 --2- 172.21.15.40:0/3665612567 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9ac139570 0x7fd9ac12d220 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.127+0000 7fd9b1c4c700 1 --2- 172.21.15.40:0/3665612567 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9ac136c50 0x7fd9ac12cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.127+0000 7fd9b1c4c700 1 -- 172.21.15.40:0/3665612567 >> 172.21.15.40:0/3665612567 conn(0x7fd9ac0a2a00 msgr2=0x7fd9ac09b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:47.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.128+0000 7fd9b1c4c700 1 -- 172.21.15.40:0/3665612567 shutdown_connections 2023-09-30T22:31:47.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.128+0000 7fd9b1c4c700 1 -- 172.21.15.40:0/3665612567 wait complete. 2023-09-30T22:31:47.141 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:47.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.159+0000 7fd04cb65700 1 -- 172.21.15.40:0/1065541228 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd048062380 con 0x7fd04809e400 2023-09-30T22:31:47.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.160+0000 7fd036ffd700 1 -- 172.21.15.40:0/1065541228 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd03c021070 con 0x7fd04809e400 2023-09-30T22:31:47.160 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:47.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.162+0000 7fd04cb65700 1 -- 172.21.15.40:0/1065541228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd04809e400 msgr2=0x7fd04811e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:47.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.162+0000 7fd04cb65700 1 --2- 172.21.15.40:0/1065541228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd04809e400 0x7fd04811e9d0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fd03c00e9b0 tx=0x7fd03c00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.162+0000 7fd04cb65700 1 -- 172.21.15.40:0/1065541228 shutdown_connections 2023-09-30T22:31:47.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.162+0000 7fd04cb65700 1 --2- 172.21.15.40:0/1065541228 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd048136230 0x7fd04811ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.162+0000 7fd04cb65700 1 --2- 172.21.15.40:0/1065541228 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd04809d920 0x7fd04811e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.162+0000 7fd04cb65700 1 --2- 172.21.15.40:0/1065541228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd04809e400 0x7fd04811e9d0 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.162+0000 7fd04cb65700 1 -- 172.21.15.40:0/1065541228 >> 172.21.15.40:0/1065541228 conn(0x7fd04809fb20 msgr2=0x7fd048070310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:47.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.162+0000 7fd04cb65700 1 -- 172.21.15.40:0/1065541228 shutdown_connections 2023-09-30T22:31:47.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.162+0000 7fd04cb65700 1 -- 172.21.15.40:0/1065541228 wait complete. 2023-09-30T22:31:47.175 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:47.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.200+0000 7f1f78eea700 1 -- 172.21.15.40:0/791500501 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1f58005590 con 0x7f1f74125a90 2023-09-30T22:31:47.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.200+0000 7f1f62ffd700 1 -- 172.21.15.40:0/791500501 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1f6c01bb00 con 0x7f1f74125a90 2023-09-30T22:31:47.201 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:47.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.201+0000 7ff6f5a67700 1 -- 172.21.15.40:0/1060365438 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff6d0005590 con 0x7ff6f0136230 2023-09-30T22:31:47.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.201+0000 7ff6d7fff700 1 -- 172.21.15.40:0/1060365438 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff6e8019020 con 0x7ff6f0136230 2023-09-30T22:31:47.202 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:47.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.202+0000 7f1f78eea700 1 -- 172.21.15.40:0/791500501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f74125a90 msgr2=0x7f1f741224f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:47.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.202+0000 7f1f78eea700 1 --2- 172.21.15.40:0/791500501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f74125a90 0x7f1f741224f0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c007e70 tx=0x7f1f6c00e3c0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.202+0000 7f1f78eea700 1 -- 172.21.15.40:0/791500501 shutdown_connections 2023-09-30T22:31:47.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.202+0000 7f1f78eea700 1 --2- 172.21.15.40:0/791500501 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1f74125a90 0x7f1f741224f0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.202+0000 7f1f78eea700 1 --2- 172.21.15.40:0/791500501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f7409d920 0x7f1f74121a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.202+0000 7f1f78eea700 1 --2- 172.21.15.40:0/791500501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f74133ca0 0x7f1f74121fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.202+0000 7f1f78eea700 1 -- 172.21.15.40:0/791500501 >> 172.21.15.40:0/791500501 conn(0x7f1f7409fb20 msgr2=0x7f1f740a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:47.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.202+0000 7f1f78eea700 1 -- 172.21.15.40:0/791500501 shutdown_connections 2023-09-30T22:31:47.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.202+0000 7f1f78eea700 1 -- 172.21.15.40:0/791500501 wait complete. 2023-09-30T22:31:47.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.203+0000 7ff6f5a67700 1 -- 172.21.15.40:0/1060365438 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff6f0136230 msgr2=0x7ff6f011f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:47.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.203+0000 7ff6f5a67700 1 --2- 172.21.15.40:0/1060365438 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff6f0136230 0x7ff6f011f0d0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8016000 tx=0x7ff6e8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.203+0000 7ff6f5a67700 1 -- 172.21.15.40:0/1060365438 shutdown_connections 2023-09-30T22:31:47.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.203+0000 7ff6f5a67700 1 --2- 172.21.15.40:0/1060365438 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff6f009d920 0x7ff6f011e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.203+0000 7ff6f5a67700 1 --2- 172.21.15.40:0/1060365438 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff6f0136230 0x7ff6f011f0d0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.203+0000 7ff6f5a67700 1 --2- 172.21.15.40:0/1060365438 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6f009e400 0x7ff6f011eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:47.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.203+0000 7ff6f5a67700 1 -- 172.21.15.40:0/1060365438 >> 172.21.15.40:0/1060365438 conn(0x7ff6f009fb20 msgr2=0x7ff6f00a3500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:47.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.204+0000 7ff6f5a67700 1 -- 172.21.15.40:0/1060365438 shutdown_connections 2023-09-30T22:31:47.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:47.204+0000 7ff6f5a67700 1 -- 172.21.15.40:0/1060365438 wait complete. 2023-09-30T22:31:47.216 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:47.217 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:48.142 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:48.176 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:48.217 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:48.218 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:48.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.290+0000 7f4c0ad61700 1 Processor -- start 2023-09-30T22:31:48.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.290+0000 7f4c0ad61700 1 -- start start 2023-09-30T22:31:48.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.290+0000 7f4c0ad61700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4c0409c890 0x7f4c0409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.291+0000 7f4c0ad61700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c0409d920 0x7f4c0409dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.291+0000 7f4c0ad61700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c040a2600 con 0x7f4c0409e2b0 2023-09-30T22:31:48.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.291+0000 7f4c0ad61700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c040a29d0 con 0x7f4c0409c890 2023-09-30T22:31:48.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.291+0000 7f4c0ad61700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0409fb40 con 0x7f4c0409d920 2023-09-30T22:31:48.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.291+0000 7f4c08afd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4c0409c890 0x7f4c0409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:48.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.291+0000 7f4c08afd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4c0409c890 0x7f4c0409cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38964/0 (socket says 172.21.15.40:38964) 2023-09-30T22:31:48.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.291+0000 7f4c08afd700 1 -- 172.21.15.40:0/4223528637 learned_addr learned my addr 172.21.15.40:0/4223528637 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:48.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.291+0000 7f4c03fff700 1 --2- 172.21.15.40:0/4223528637 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c0409d920 0x7f4c0409dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:48.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.291+0000 7f4c08afd700 1 -- 172.21.15.40:0/4223528637 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c0409d920 msgr2=0x7f4c0409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:48.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.291+0000 7f4c08afd700 1 --2- 172.21.15.40:0/4223528637 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c0409d920 0x7f4c0409dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.291+0000 7f4c08afd700 1 -- 172.21.15.40:0/4223528637 >> v1:172.21.15.40:6789/0 conn(0x7f4c0409e2b0 legacy=0x7f4c0413ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:48.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.291+0000 7f4c08afd700 1 -- 172.21.15.40:0/4223528637 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0409e730 con 0x7f4c0409c890 2023-09-30T22:31:48.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.291+0000 7f4c08afd700 1 --2- 172.21.15.40:0/4223528637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c0409c890 0x7f4c0409cc60 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8006fd0 tx=0x7f4bf8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da978ba33c467879 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:48.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.292+0000 7f4c037fe700 1 -- 172.21.15.40:0/4223528637 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8005e30 con 0x7f4c0409c890 2023-09-30T22:31:48.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.292+0000 7f4c037fe700 1 -- 172.21.15.40:0/4223528637 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf8004030 con 0x7f4c0409c890 2023-09-30T22:31:48.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.292+0000 7f4c037fe700 1 -- 172.21.15.40:0/4223528637 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf80043e0 con 0x7f4c0409c890 2023-09-30T22:31:48.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.292+0000 7f4c0ad61700 1 -- 172.21.15.40:0/4223528637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c0409c890 msgr2=0x7f4c0409cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:48.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.292+0000 7f4c0ad61700 1 --2- 172.21.15.40:0/4223528637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c0409c890 0x7f4c0409cc60 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8006fd0 tx=0x7f4bf8009bd0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.292+0000 7f4c0ad61700 1 -- 172.21.15.40:0/4223528637 shutdown_connections 2023-09-30T22:31:48.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.292+0000 7f4c0ad61700 1 --2- 172.21.15.40:0/4223528637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c0409c890 0x7f4c0409cc60 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.292+0000 7f4c0ad61700 1 --2- 172.21.15.40:0/4223528637 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c0409d920 0x7f4c0409dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.293+0000 7f4c0ad61700 1 -- 172.21.15.40:0/4223528637 >> 172.21.15.40:0/4223528637 conn(0x7f4c040a7080 msgr2=0x7f4c040a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:48.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.293+0000 7f4c0ad61700 1 -- 172.21.15.40:0/4223528637 shutdown_connections 2023-09-30T22:31:48.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.293+0000 7f4c0ad61700 1 -- 172.21.15.40:0/4223528637 wait complete. 2023-09-30T22:31:48.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.294+0000 7f4c0ad61700 1 Processor -- start 2023-09-30T22:31:48.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.294+0000 7f4c0ad61700 1 -- start start 2023-09-30T22:31:48.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.295+0000 7f4c0ad61700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c0409c890 0x7f4c0412d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.295+0000 7f4c0ad61700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c0409d920 0x7f4c0412d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.295+0000 7f4c0ad61700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c0409e2b0 0x7f4c0412dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.295+0000 7f4c0ad61700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c040a5d20 con 0x7f4c0409d920 2023-09-30T22:31:48.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.295+0000 7f4c0ad61700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c041305d0 con 0x7f4c0409c890 2023-09-30T22:31:48.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.295+0000 7f4c0ad61700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0409c310 con 0x7f4c0409e2b0 2023-09-30T22:31:48.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.295+0000 7f4c03fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c0409d920 0x7f4c0412d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:48.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.295+0000 7f4c03fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c0409d920 0x7f4c0412d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38974/0 (socket says 172.21.15.40:38974) 2023-09-30T22:31:48.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.295+0000 7f4c03fff700 1 -- 172.21.15.40:0/582176979 learned_addr learned my addr 172.21.15.40:0/582176979 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:48.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.295+0000 7f4c092fe700 1 --2- 172.21.15.40:0/582176979 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c0409e2b0 0x7f4c0412dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:48.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.295+0000 7f4c08afd700 1 --2- 172.21.15.40:0/582176979 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c0409c890 0x7f4c0412d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:48.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.296+0000 7f4c03fff700 1 -- 172.21.15.40:0/582176979 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c0409e2b0 msgr2=0x7f4c0412dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:48.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.296+0000 7f4c03fff700 1 --2- 172.21.15.40:0/582176979 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c0409e2b0 0x7f4c0412dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.296+0000 7f4c03fff700 1 -- 172.21.15.40:0/582176979 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c0409c890 msgr2=0x7f4c0412d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:48.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.296+0000 7f4c03fff700 1 --2- 172.21.15.40:0/582176979 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c0409c890 0x7f4c0412d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.296+0000 7f4c03fff700 1 -- 172.21.15.40:0/582176979 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf8009500 con 0x7f4c0409d920 2023-09-30T22:31:48.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.296+0000 7f4c03fff700 1 --2- 172.21.15.40:0/582176979 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c0409d920 0x7f4c0412d810 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000e9b0 tx=0x7f4bf000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:48.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.296+0000 7f4c017fa700 1 -- 172.21.15.40:0/582176979 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0009710 con 0x7f4c0409d920 2023-09-30T22:31:48.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.296+0000 7f4c017fa700 1 -- 172.21.15.40:0/582176979 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf000ee50 con 0x7f4c0409d920 2023-09-30T22:31:48.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.296+0000 7f4c0ad61700 1 -- 172.21.15.40:0/582176979 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c041300e0 con 0x7f4c0409d920 2023-09-30T22:31:48.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.296+0000 7f4c017fa700 1 -- 172.21.15.40:0/582176979 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf000ca50 con 0x7f4c0409d920 2023-09-30T22:31:48.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.296+0000 7f4c0ad61700 1 -- 172.21.15.40:0/582176979 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c0412e290 con 0x7f4c0409d920 2023-09-30T22:31:48.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.297+0000 7f4c017fa700 1 -- 172.21.15.40:0/582176979 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4bf000cbb0 con 0x7f4c0409d920 2023-09-30T22:31:48.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.297+0000 7f4c017fa700 1 -- 172.21.15.40:0/582176979 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f4bf003f7a0 con 0x7f4c0409d920 2023-09-30T22:31:48.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.298+0000 7f4c0ad61700 1 -- 172.21.15.40:0/582176979 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c04130710 con 0x7f4c0409d920 2023-09-30T22:31:48.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.302+0000 7f4c017fa700 1 -- 172.21.15.40:0/582176979 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4bf0021020 con 0x7f4c0409d920 2023-09-30T22:31:48.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.331+0000 7fe2de603700 1 Processor -- start 2023-09-30T22:31:48.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.331+0000 7fe2de603700 1 -- start start 2023-09-30T22:31:48.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.332+0000 7fe2de603700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe2d8136c50 0x7fe2d8139030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.332+0000 7fe2de603700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2d8139570 0x7fe2d813b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.332+0000 7fe2de603700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d8133940 con 0x7fe2d8133e00 2023-09-30T22:31:48.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.332+0000 7fe2de603700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2d809af70 con 0x7fe2d8136c50 2023-09-30T22:31:48.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.332+0000 7fe2de603700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d809ab20 con 0x7fe2d8139570 2023-09-30T22:31:48.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.332+0000 7fe2d77fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe2d8136c50 0x7fe2d8139030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:48.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.332+0000 7fe2d77fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe2d8136c50 0x7fe2d8139030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38982/0 (socket says 172.21.15.40:38982) 2023-09-30T22:31:48.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.332+0000 7fe2d77fe700 1 -- 172.21.15.40:0/2991432743 learned_addr learned my addr 172.21.15.40:0/2991432743 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:48.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.332+0000 7fe2dcba0700 1 --2- 172.21.15.40:0/2991432743 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2d8139570 0x7fe2d813b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:48.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.332+0000 7fe2d77fe700 1 -- 172.21.15.40:0/2991432743 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2d8139570 msgr2=0x7fe2d813b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:48.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.332+0000 7fe2d77fe700 1 --2- 172.21.15.40:0/2991432743 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2d8139570 0x7fe2d813b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.332+0000 7fe2d77fe700 1 -- 172.21.15.40:0/2991432743 >> v1:172.21.15.40:6789/0 conn(0x7fe2d8133e00 legacy=0x7fe2d81341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:48.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.332+0000 7fe2d77fe700 1 -- 172.21.15.40:0/2991432743 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d809f0d0 con 0x7fe2d8136c50 2023-09-30T22:31:48.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.332+0000 7fe2dcba0700 1 --2- 172.21.15.40:0/2991432743 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2d8139570 0x7fe2d813b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:48.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.333+0000 7fe2d77fe700 1 --2- 172.21.15.40:0/2991432743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2d8136c50 0x7fe2d8139030 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc0098f0 tx=0x7fe2cc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3eaecca9917cdf5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:48.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.333+0000 7fe2d6ffd700 1 -- 172.21.15.40:0/2991432743 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc011830 con 0x7fe2d8136c50 2023-09-30T22:31:48.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.333+0000 7fe2d6ffd700 1 -- 172.21.15.40:0/2991432743 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2cc011990 con 0x7fe2d8136c50 2023-09-30T22:31:48.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.333+0000 7fe2d6ffd700 1 -- 172.21.15.40:0/2991432743 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc011d20 con 0x7fe2d8136c50 2023-09-30T22:31:48.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.333+0000 7fe2de603700 1 -- 172.21.15.40:0/2991432743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2d8136c50 msgr2=0x7fe2d8139030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:48.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.334+0000 7fe2de603700 1 --2- 172.21.15.40:0/2991432743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2d8136c50 0x7fe2d8139030 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc0098f0 tx=0x7fe2cc009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:48.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.334+0000 7fe2de603700 1 -- 172.21.15.40:0/2991432743 shutdown_connections 2023-09-30T22:31:48.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.334+0000 7fe2de603700 1 --2- 172.21.15.40:0/2991432743 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2d8139570 0x7fe2d813b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.334+0000 7fe2de603700 1 --2- 172.21.15.40:0/2991432743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2d8136c50 0x7fe2d8139030 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.334+0000 7fe2de603700 1 -- 172.21.15.40:0/2991432743 >> 172.21.15.40:0/2991432743 conn(0x7fe2d80a2a00 msgr2=0x7fe2d80a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:48.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.334+0000 7fe2de603700 1 -- 172.21.15.40:0/2991432743 shutdown_connections 2023-09-30T22:31:48.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.334+0000 7fe2de603700 1 -- 172.21.15.40:0/2991432743 wait complete. 2023-09-30T22:31:48.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.335+0000 7fe2de603700 1 Processor -- start 2023-09-30T22:31:48.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.335+0000 7fe2de603700 1 -- start start 2023-09-30T22:31:48.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.335+0000 7fe2de603700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe2d8133e00 0x7fe2d806f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.335+0000 7fe2de603700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2d8136c50 0x7fe2d806d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.335+0000 7fe2de603700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2d8139570 0x7fe2d806db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.335+0000 7fe2de603700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d812df70 con 0x7fe2d8139570 2023-09-30T22:31:48.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.335+0000 7fe2de603700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d8070e30 con 0x7fe2d8136c50 2023-09-30T22:31:48.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.335+0000 7fe2de603700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d806fcb0 con 0x7fe2d8133e00 2023-09-30T22:31:48.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.336+0000 7fe2d77fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2d8136c50 0x7fe2d806d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:48.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.336+0000 7fe2d77fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2d8136c50 0x7fe2d806d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:58072/0 (socket says 172.21.15.40:58072) 2023-09-30T22:31:48.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.336+0000 7fe2d77fe700 1 -- 172.21.15.40:0/1423882456 learned_addr learned my addr 172.21.15.40:0/1423882456 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:48.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.336+0000 7fe2dcba0700 1 --2- 172.21.15.40:0/1423882456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2d8139570 0x7fe2d806db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:48.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.336+0000 7fe2d7fff700 1 --2- 172.21.15.40:0/1423882456 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe2d8133e00 0x7fe2d806f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:48.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.336+0000 7fe2d77fe700 1 -- 172.21.15.40:0/1423882456 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe2d8133e00 msgr2=0x7fe2d806f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:48.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.336+0000 7fe2d77fe700 1 --2- 172.21.15.40:0/1423882456 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe2d8133e00 0x7fe2d806f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.336+0000 7fe2d77fe700 1 -- 172.21.15.40:0/1423882456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2d8139570 msgr2=0x7fe2d806db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:48.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.336+0000 7fe2d77fe700 1 --2- 172.21.15.40:0/1423882456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2d8139570 0x7fe2d806db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.336+0000 7fe2d77fe700 1 -- 172.21.15.40:0/1423882456 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d0009a70 con 0x7fe2d8136c50 2023-09-30T22:31:48.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.336+0000 7fe2d77fe700 1 --2- 172.21.15.40:0/1423882456 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2d8136c50 0x7fe2d806d610 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc000c00 tx=0x7fe2cc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:48.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.336+0000 7fe2d4ff9700 1 -- 172.21.15.40:0/1423882456 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc004550 con 0x7fe2d8136c50 2023-09-30T22:31:48.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.336+0000 7fe2d4ff9700 1 -- 172.21.15.40:0/1423882456 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2cc0036a0 con 0x7fe2d8136c50 2023-09-30T22:31:48.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.336+0000 7fe2de603700 1 -- 172.21.15.40:0/1423882456 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2cc009550 con 0x7fe2d8136c50 2023-09-30T22:31:48.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.336+0000 7fe2d4ff9700 1 -- 172.21.15.40:0/1423882456 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc003a10 con 0x7fe2d8136c50 2023-09-30T22:31:48.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.336+0000 7fe2de603700 1 -- 172.21.15.40:0/1423882456 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d8130880 con 0x7fe2d8136c50 2023-09-30T22:31:48.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.337+0000 7fe2de603700 1 -- 172.21.15.40:0/1423882456 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2d809e5b0 con 0x7fe2d8136c50 2023-09-30T22:31:48.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.342+0000 7fe2d4ff9700 1 -- 172.21.15.40:0/1423882456 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe2cc021070 con 0x7fe2d8136c50 2023-09-30T22:31:48.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.342+0000 7fe2d4ff9700 1 -- 172.21.15.40:0/1423882456 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe2cc0410f0 con 0x7fe2d8136c50 2023-09-30T22:31:48.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.342+0000 7fe2d4ff9700 1 -- 172.21.15.40:0/1423882456 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe2cc0414d0 con 0x7fe2d8136c50 2023-09-30T22:31:48.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.370+0000 7f98a60fa700 1 Processor -- start 2023-09-30T22:31:48.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.371+0000 7f98a60fa700 1 -- start start 2023-09-30T22:31:48.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.371+0000 7f98a60fa700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f98a0138250 0x7f98a0138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.371+0000 7f98a60fa700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f98a009df20 0x7f98a0140160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.371+0000 7f98a60fa700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98a0137e20 con 0x7f98a009d400 2023-09-30T22:31:48.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.371+0000 7f98a60fa700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98a0138050 con 0x7f98a0138250 2023-09-30T22:31:48.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.371+0000 7f98a60fa700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98a009b010 con 0x7f98a009df20 2023-09-30T22:31:48.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.371+0000 7f989f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f98a0138250 0x7f98a0138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:48.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.371+0000 7f989f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f98a0138250 0x7f98a0138620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39000/0 (socket says 172.21.15.40:39000) 2023-09-30T22:31:48.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.371+0000 7f989f7fe700 1 -- 172.21.15.40:0/4172805850 learned_addr learned my addr 172.21.15.40:0/4172805850 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:48.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.372+0000 7f989ffff700 1 --2- 172.21.15.40:0/4172805850 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f98a009df20 0x7f98a0140160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:48.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.372+0000 7f989f7fe700 1 -- 172.21.15.40:0/4172805850 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f98a009df20 msgr2=0x7f98a0140160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:48.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.372+0000 7f989f7fe700 1 --2- 172.21.15.40:0/4172805850 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f98a009df20 0x7f98a0140160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.372+0000 7f989f7fe700 1 -- 172.21.15.40:0/4172805850 >> v1:172.21.15.40:6789/0 conn(0x7f98a009d400 legacy=0x7f98a009d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:48.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.372+0000 7f989e7fc700 1 -- 172.21.15.40:0/4172805850 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1957831096 0 0) 0x7f98a0137e20 con 0x7f98a009d400 2023-09-30T22:31:48.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.372+0000 7f989f7fe700 1 -- 172.21.15.40:0/4172805850 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a009f1f0 con 0x7f98a0138250 2023-09-30T22:31:48.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.372+0000 7f989f7fe700 1 --2- 172.21.15.40:0/4172805850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98a0138250 0x7f98a0138620 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f98900098f0 tx=0x7f9890009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc39b2c72f4699c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:48.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.372+0000 7f989e7fc700 1 -- 172.21.15.40:0/4172805850 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9890011830 con 0x7f98a0138250 2023-09-30T22:31:48.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.372+0000 7f989e7fc700 1 -- 172.21.15.40:0/4172805850 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9890011990 con 0x7f98a0138250 2023-09-30T22:31:48.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.372+0000 7f989e7fc700 1 -- 172.21.15.40:0/4172805850 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9890011d20 con 0x7f98a0138250 2023-09-30T22:31:48.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.373+0000 7f98a60fa700 1 -- 172.21.15.40:0/4172805850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98a0138250 msgr2=0x7f98a0138620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:48.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.373+0000 7f98a60fa700 1 --2- 172.21.15.40:0/4172805850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98a0138250 0x7f98a0138620 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f98900098f0 tx=0x7f9890009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:48.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.373+0000 7f98a60fa700 1 -- 172.21.15.40:0/4172805850 shutdown_connections 2023-09-30T22:31:48.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.373+0000 7f98a60fa700 1 --2- 172.21.15.40:0/4172805850 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f98a009df20 0x7f98a0140160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.373+0000 7f98a60fa700 1 --2- 172.21.15.40:0/4172805850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98a0138250 0x7f98a0138620 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.373+0000 7f98a60fa700 1 -- 172.21.15.40:0/4172805850 >> 172.21.15.40:0/4172805850 conn(0x7f98a00a2a00 msgr2=0x7f98a00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:48.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.373+0000 7f98a60fa700 1 -- 172.21.15.40:0/4172805850 shutdown_connections 2023-09-30T22:31:48.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.373+0000 7f98a60fa700 1 -- 172.21.15.40:0/4172805850 wait complete. 2023-09-30T22:31:48.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.374+0000 7f98a60fa700 1 Processor -- start 2023-09-30T22:31:48.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.374+0000 7f98a60fa700 1 -- start start 2023-09-30T22:31:48.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.375+0000 7f98a60fa700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f98a009d400 0x7f98a01228b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.375+0000 7f98a60fa700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98a009df20 0x7f98a0122df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.375+0000 7f98a60fa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98a0138250 0x7f98a0123330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.375+0000 7f98a60fa700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a0126580 con 0x7f98a009df20 2023-09-30T22:31:48.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.375+0000 7f98a60fa700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a0125bc0 con 0x7f98a0138250 2023-09-30T22:31:48.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.375+0000 7f98a60fa700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98a0124f90 con 0x7f98a009d400 2023-09-30T22:31:48.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.375+0000 7f989effd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98a009df20 0x7f98a0122df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:48.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.375+0000 7f989ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98a0138250 0x7f98a0123330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:48.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.375+0000 7f989effd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98a009df20 0x7f98a0122df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39006/0 (socket says 172.21.15.40:39006) 2023-09-30T22:31:48.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.375+0000 7f989effd700 1 -- 172.21.15.40:0/1410648376 learned_addr learned my addr 172.21.15.40:0/1410648376 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:48.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.375+0000 7f989f7fe700 1 --2- 172.21.15.40:0/1410648376 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f98a009d400 0x7f98a01228b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:48.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.375+0000 7f989f7fe700 1 -- 172.21.15.40:0/1410648376 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98a0138250 msgr2=0x7f98a0123330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:48.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.375+0000 7f989f7fe700 1 --2- 172.21.15.40:0/1410648376 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98a0138250 0x7f98a0123330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.375+0000 7f989f7fe700 1 -- 172.21.15.40:0/1410648376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98a009df20 msgr2=0x7f98a0122df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:48.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.375+0000 7f989f7fe700 1 --2- 172.21.15.40:0/1410648376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98a009df20 0x7f98a0122df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.375+0000 7f989f7fe700 1 -- 172.21.15.40:0/1410648376 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9890009550 con 0x7f98a009d400 2023-09-30T22:31:48.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.375+0000 7f989effd700 1 --2- 172.21.15.40:0/1410648376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98a009df20 0x7f98a0122df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:48.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.376+0000 7f989f7fe700 1 --2- 172.21.15.40:0/1410648376 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f98a009d400 0x7f98a01228b0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f98a009e610 tx=0x7f9890004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:48.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.376+0000 7f9887fff700 1 -- 172.21.15.40:0/1410648376 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9890004300 con 0x7f98a009d400 2023-09-30T22:31:48.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.376+0000 7f9887fff700 1 -- 172.21.15.40:0/1410648376 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989001f070 con 0x7f98a009d400 2023-09-30T22:31:48.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.376+0000 7f9887fff700 1 -- 172.21.15.40:0/1410648376 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98900036a0 con 0x7f98a009d400 2023-09-30T22:31:48.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.376+0000 7f98a60fa700 1 -- 172.21.15.40:0/1410648376 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a00a11a0 con 0x7f98a009d400 2023-09-30T22:31:48.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.376+0000 7f98a60fa700 1 -- 172.21.15.40:0/1410648376 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a0123cd0 con 0x7f98a009d400 2023-09-30T22:31:48.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.377+0000 7f9887fff700 1 -- 172.21.15.40:0/1410648376 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9890021030 con 0x7f98a009d400 2023-09-30T22:31:48.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.377+0000 7f9887fff700 1 -- 172.21.15.40:0/1410648376 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f98900409e0 con 0x7f98a009d400 2023-09-30T22:31:48.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.377+0000 7f98a60fa700 1 -- 172.21.15.40:0/1410648376 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98a006edb0 con 0x7f98a009d400 2023-09-30T22:31:48.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.382+0000 7f9887fff700 1 -- 172.21.15.40:0/1410648376 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9890015070 con 0x7f98a009d400 2023-09-30T22:31:48.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.391+0000 7f1adedb6700 1 Processor -- start 2023-09-30T22:31:48.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.391+0000 7f1adedb6700 1 -- start start 2023-09-30T22:31:48.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.392+0000 7f1adedb6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ad809e400 0x7f1ad8135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.392+0000 7f1adedb6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ad8136230 0x7f1ad8138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.392+0000 7f1adedb6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad809adf0 con 0x7f1ad809d920 2023-09-30T22:31:48.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.392+0000 7f1adedb6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad809e7f0 con 0x7f1ad809e400 2023-09-30T22:31:48.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.392+0000 7f1adedb6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad809edf0 con 0x7f1ad8136230 2023-09-30T22:31:48.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.392+0000 7f1ad7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ad809e400 0x7f1ad8135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:48.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.392+0000 7f1add353700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ad8136230 0x7f1ad8138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:48.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.392+0000 7f1ad7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ad809e400 0x7f1ad8135cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:58098/0 (socket says 172.21.15.40:58098) 2023-09-30T22:31:48.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.392+0000 7f1ad7fff700 1 -- 172.21.15.40:0/1604872409 learned_addr learned my addr 172.21.15.40:0/1604872409 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:48.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.392+0000 7f1ad7fff700 1 -- 172.21.15.40:0/1604872409 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ad8136230 msgr2=0x7f1ad8138610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:48.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.392+0000 7f1ad7fff700 1 --2- 172.21.15.40:0/1604872409 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ad8136230 0x7f1ad8138610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.392+0000 7f1ad7fff700 1 -- 172.21.15.40:0/1604872409 >> v1:172.21.15.40:6789/0 conn(0x7f1ad809d920 legacy=0x7f1ad809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:48.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.392+0000 7f1ad7fff700 1 -- 172.21.15.40:0/1604872409 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad809b660 con 0x7f1ad809e400 2023-09-30T22:31:48.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.392+0000 7f1add353700 1 --2- 172.21.15.40:0/1604872409 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ad8136230 0x7f1ad8138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:48.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.393+0000 7f1ad7fff700 1 --2- 172.21.15.40:0/1604872409 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ad809e400 0x7f1ad8135cf0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f1ac400bbf0 tx=0x7f1ac400bf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b76230dc41657cf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:48.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.393+0000 7f1ad77fe700 1 -- 172.21.15.40:0/1604872409 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac400dcb0 con 0x7f1ad809e400 2023-09-30T22:31:48.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.393+0000 7f1ad77fe700 1 -- 172.21.15.40:0/1604872409 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac400de10 con 0x7f1ad809e400 2023-09-30T22:31:48.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.393+0000 7f1ad77fe700 1 -- 172.21.15.40:0/1604872409 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac4004250 con 0x7f1ad809e400 2023-09-30T22:31:48.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.393+0000 7f1adedb6700 1 -- 172.21.15.40:0/1604872409 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ad809e400 msgr2=0x7f1ad8135cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:48.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.393+0000 7f1adedb6700 1 --2- 172.21.15.40:0/1604872409 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ad809e400 0x7f1ad8135cf0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f1ac400bbf0 tx=0x7f1ac400bf00 comp rx=0 tx=0).stop 2023-09-30T22:31:48.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.393+0000 7f1adedb6700 1 -- 172.21.15.40:0/1604872409 shutdown_connections 2023-09-30T22:31:48.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.393+0000 7f1adedb6700 1 --2- 172.21.15.40:0/1604872409 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ad8136230 0x7f1ad8138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.393+0000 7f1adedb6700 1 --2- 172.21.15.40:0/1604872409 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ad809e400 0x7f1ad8135cf0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.393+0000 7f1adedb6700 1 -- 172.21.15.40:0/1604872409 >> 172.21.15.40:0/1604872409 conn(0x7f1ad809fb20 msgr2=0x7f1ad809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:48.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.394+0000 7f1adedb6700 1 -- 172.21.15.40:0/1604872409 shutdown_connections 2023-09-30T22:31:48.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.394+0000 7f1adedb6700 1 -- 172.21.15.40:0/1604872409 wait complete. 2023-09-30T22:31:48.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.394+0000 7f1adedb6700 1 Processor -- start 2023-09-30T22:31:48.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.394+0000 7f1adedb6700 1 -- start start 2023-09-30T22:31:48.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.395+0000 7f1adedb6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ad809d920 0x7f1ad811e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.395+0000 7f1adedb6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ad809e400 0x7f1ad811ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.395+0000 7f1adedb6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ad8136230 0x7f1ad811f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:48.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.395+0000 7f1adedb6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad8122240 con 0x7f1ad809e400 2023-09-30T22:31:48.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.395+0000 7f1adedb6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad809cb00 con 0x7f1ad809d920 2023-09-30T22:31:48.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.395+0000 7f1adedb6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad80a2290 con 0x7f1ad8136230 2023-09-30T22:31:48.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.395+0000 7f1adcb52700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ad809d920 0x7f1ad811e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:48.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.395+0000 7f1ad7fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ad809e400 0x7f1ad811ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:48.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.395+0000 7f1adcb52700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ad809d920 0x7f1ad811e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:58104/0 (socket says 172.21.15.40:58104) 2023-09-30T22:31:48.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.395+0000 7f1adcb52700 1 -- 172.21.15.40:0/2755654496 learned_addr learned my addr 172.21.15.40:0/2755654496 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:48.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.395+0000 7f1add353700 1 --2- 172.21.15.40:0/2755654496 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ad8136230 0x7f1ad811f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:48.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.396+0000 7f1add353700 1 -- 172.21.15.40:0/2755654496 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ad809d920 msgr2=0x7f1ad811e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:48.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.396+0000 7f1add353700 1 --2- 172.21.15.40:0/2755654496 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ad809d920 0x7f1ad811e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.396+0000 7f1add353700 1 -- 172.21.15.40:0/2755654496 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ad809e400 msgr2=0x7f1ad811ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:48.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.396+0000 7f1add353700 1 --2- 172.21.15.40:0/2755654496 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ad809e400 0x7f1ad811ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.396+0000 7f1add353700 1 -- 172.21.15.40:0/2755654496 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad0009a70 con 0x7f1ad8136230 2023-09-30T22:31:48.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.396+0000 7f1adcb52700 1 --2- 172.21.15.40:0/2755654496 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ad809d920 0x7f1ad811e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:48.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.396+0000 7f1add353700 1 --2- 172.21.15.40:0/2755654496 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ad8136230 0x7f1ad811f100 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f1ad000b360 tx=0x7f1ad000b670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:48.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.396+0000 7f1ad57fa700 1 -- 172.21.15.40:0/2755654496 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad0015070 con 0x7f1ad8136230 2023-09-30T22:31:48.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.396+0000 7f1adedb6700 1 -- 172.21.15.40:0/2755654496 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ac400b7f0 con 0x7f1ad8136230 2023-09-30T22:31:48.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.396+0000 7f1ad57fa700 1 -- 172.21.15.40:0/2755654496 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad000bda0 con 0x7f1ad8136230 2023-09-30T22:31:48.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.396+0000 7f1ad57fa700 1 -- 172.21.15.40:0/2755654496 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad0003c60 con 0x7f1ad8136230 2023-09-30T22:31:48.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.397+0000 7f1adedb6700 1 -- 172.21.15.40:0/2755654496 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad8121ec0 con 0x7f1ad8136230 2023-09-30T22:31:48.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.397+0000 7f1ad57fa700 1 -- 172.21.15.40:0/2755654496 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1ad0019410 con 0x7f1ad8136230 2023-09-30T22:31:48.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.397+0000 7f1ad57fa700 1 -- 172.21.15.40:0/2755654496 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f1ad0044570 con 0x7f1ad8136230 2023-09-30T22:31:48.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.398+0000 7f1adedb6700 1 -- 172.21.15.40:0/2755654496 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad8121d00 con 0x7f1ad8136230 2023-09-30T22:31:48.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.403+0000 7f1ad57fa700 1 -- 172.21.15.40:0/2755654496 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1ad0020900 con 0x7f1ad8136230 2023-09-30T22:31:48.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.529+0000 7f4c0ad61700 1 -- 172.21.15.40:0/582176979 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4c04062380 con 0x7f4c0409d920 2023-09-30T22:31:48.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.529+0000 7f4c017fa700 1 -- 172.21.15.40:0/582176979 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4bf001be10 con 0x7f4c0409d920 2023-09-30T22:31:48.530 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:48.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.532+0000 7f4c0ad61700 1 -- 172.21.15.40:0/582176979 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c0409d920 msgr2=0x7f4c0412d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:48.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.532+0000 7f4c0ad61700 1 --2- 172.21.15.40:0/582176979 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c0409d920 0x7f4c0412d810 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000e9b0 tx=0x7f4bf000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.532+0000 7f4c0ad61700 1 -- 172.21.15.40:0/582176979 shutdown_connections 2023-09-30T22:31:48.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.532+0000 7f4c0ad61700 1 --2- 172.21.15.40:0/582176979 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f4c0409e2b0 0x7f4c0412dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.532+0000 7f4c0ad61700 1 --2- 172.21.15.40:0/582176979 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c0409c890 0x7f4c0412d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.532+0000 7f4c0ad61700 1 --2- 172.21.15.40:0/582176979 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c0409d920 0x7f4c0412d810 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.532+0000 7f4c0ad61700 1 -- 172.21.15.40:0/582176979 >> 172.21.15.40:0/582176979 conn(0x7f4c040a7080 msgr2=0x7f4c040a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:48.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.533+0000 7f4c0ad61700 1 -- 172.21.15.40:0/582176979 shutdown_connections 2023-09-30T22:31:48.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.533+0000 7f4c0ad61700 1 -- 172.21.15.40:0/582176979 wait complete. 2023-09-30T22:31:48.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.544+0000 7fe2de603700 1 -- 172.21.15.40:0/1423882456 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe2d8062380 con 0x7fe2d8136c50 2023-09-30T22:31:48.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.544+0000 7fe2d4ff9700 1 -- 172.21.15.40:0/1423882456 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe2cc029070 con 0x7fe2d8136c50 2023-09-30T22:31:48.545 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:48.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.546+0000 7fe2de603700 1 -- 172.21.15.40:0/1423882456 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2d8136c50 msgr2=0x7fe2d806d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:48.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.546+0000 7fe2de603700 1 --2- 172.21.15.40:0/1423882456 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2d8136c50 0x7fe2d806d610 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc000c00 tx=0x7fe2cc004750 comp rx=0 tx=0).stop 2023-09-30T22:31:48.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.546+0000 7fe2de603700 1 -- 172.21.15.40:0/1423882456 shutdown_connections 2023-09-30T22:31:48.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.546+0000 7fe2de603700 1 --2- 172.21.15.40:0/1423882456 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe2d8133e00 0x7fe2d806f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.546+0000 7fe2de603700 1 --2- 172.21.15.40:0/1423882456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2d8139570 0x7fe2d806db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.546+0000 7fe2de603700 1 --2- 172.21.15.40:0/1423882456 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2d8136c50 0x7fe2d806d610 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.546+0000 7fe2de603700 1 -- 172.21.15.40:0/1423882456 >> 172.21.15.40:0/1423882456 conn(0x7fe2d80a2a00 msgr2=0x7fe2d809b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:48.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.546+0000 7fe2de603700 1 -- 172.21.15.40:0/1423882456 shutdown_connections 2023-09-30T22:31:48.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.546+0000 7fe2de603700 1 -- 172.21.15.40:0/1423882456 wait complete. 2023-09-30T22:31:48.550 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:48.560 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:48.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.591+0000 7f98a60fa700 1 -- 172.21.15.40:0/1410648376 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f98a0062380 con 0x7f98a009d400 2023-09-30T22:31:48.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.592+0000 7f9887fff700 1 -- 172.21.15.40:0/1410648376 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f98900239c0 con 0x7f98a009d400 2023-09-30T22:31:48.593 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:48.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.594+0000 7f98a60fa700 1 -- 172.21.15.40:0/1410648376 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f98a009d400 msgr2=0x7f98a01228b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:48.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.594+0000 7f98a60fa700 1 --2- 172.21.15.40:0/1410648376 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f98a009d400 0x7f98a01228b0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f98a009e610 tx=0x7f9890004750 comp rx=0 tx=0).stop 2023-09-30T22:31:48.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.595+0000 7f98a60fa700 1 -- 172.21.15.40:0/1410648376 shutdown_connections 2023-09-30T22:31:48.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.595+0000 7f98a60fa700 1 --2- 172.21.15.40:0/1410648376 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f98a009d400 0x7f98a01228b0 secure :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f98a009e610 tx=0x7f9890004750 comp rx=0 tx=0).stop 2023-09-30T22:31:48.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.595+0000 7f98a60fa700 1 --2- 172.21.15.40:0/1410648376 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98a0138250 0x7f98a0123330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.595+0000 7f98a60fa700 1 --2- 172.21.15.40:0/1410648376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98a009df20 0x7f98a0122df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.595+0000 7f98a60fa700 1 -- 172.21.15.40:0/1410648376 >> 172.21.15.40:0/1410648376 conn(0x7f98a00a2a00 msgr2=0x7f98a01bf580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:48.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.596+0000 7f98a60fa700 1 -- 172.21.15.40:0/1410648376 shutdown_connections 2023-09-30T22:31:48.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.596+0000 7f98a60fa700 1 -- 172.21.15.40:0/1410648376 wait complete. 2023-09-30T22:31:48.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.602+0000 7f1adedb6700 1 -- 172.21.15.40:0/2755654496 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1ad8121b10 con 0x7f1ad8136230 2023-09-30T22:31:48.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.602+0000 7f1ad57fa700 1 -- 172.21.15.40:0/2755654496 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1ad0020310 con 0x7f1ad8136230 2023-09-30T22:31:48.603 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:48.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.605+0000 7f1adedb6700 1 -- 172.21.15.40:0/2755654496 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ad8136230 msgr2=0x7f1ad811f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:48.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.605+0000 7f1adedb6700 1 --2- 172.21.15.40:0/2755654496 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ad8136230 0x7f1ad811f100 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f1ad000b360 tx=0x7f1ad000b670 comp rx=0 tx=0).stop 2023-09-30T22:31:48.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.605+0000 7f1adedb6700 1 -- 172.21.15.40:0/2755654496 shutdown_connections 2023-09-30T22:31:48.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.605+0000 7f1adedb6700 1 --2- 172.21.15.40:0/2755654496 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1ad8136230 0x7f1ad811f100 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.605+0000 7f1adedb6700 1 --2- 172.21.15.40:0/2755654496 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ad809d920 0x7f1ad811e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.605+0000 7f1adedb6700 1 --2- 172.21.15.40:0/2755654496 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ad809e400 0x7f1ad811ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:48.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.605+0000 7f1adedb6700 1 -- 172.21.15.40:0/2755654496 >> 172.21.15.40:0/2755654496 conn(0x7f1ad809fb20 msgr2=0x7f1ad8070620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:48.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.605+0000 7f1adedb6700 1 -- 172.21.15.40:0/2755654496 shutdown_connections 2023-09-30T22:31:48.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:48.605+0000 7f1adedb6700 1 -- 172.21.15.40:0/2755654496 wait complete. 2023-09-30T22:31:48.609 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:48.618 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:49.551 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:49.561 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:49.610 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:49.619 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:49.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.699+0000 7f6537d04700 1 Processor -- start 2023-09-30T22:31:49.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.699+0000 7f6537d04700 1 -- start start 2023-09-30T22:31:49.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.700+0000 7f6537d04700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f653006a6d0 0x7f653006aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:49.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.700+0000 7f6537d04700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6530131fc0 0x7f6530139b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:49.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.700+0000 7f6537d04700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f653009eb50 con 0x7f653006afe0 2023-09-30T22:31:49.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.700+0000 7f6537d04700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f653009dde0 con 0x7f6530131fc0 2023-09-30T22:31:49.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.700+0000 7f6537d04700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f653009d4a0 con 0x7f653006a6d0 2023-09-30T22:31:49.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.700+0000 7f65362a1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6530131fc0 0x7f6530139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:49.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.700+0000 7f65362a1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6530131fc0 0x7f6530139b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:58108/0 (socket says 172.21.15.40:58108) 2023-09-30T22:31:49.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.700+0000 7f65362a1700 1 -- 172.21.15.40:0/3366460824 learned_addr learned my addr 172.21.15.40:0/3366460824 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:49.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.700+0000 7f6535aa0700 1 --2- 172.21.15.40:0/3366460824 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f653006a6d0 0x7f653006aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:49.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.700+0000 7f65362a1700 1 -- 172.21.15.40:0/3366460824 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f653006a6d0 msgr2=0x7f653006aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:49.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.700+0000 7f65362a1700 1 --2- 172.21.15.40:0/3366460824 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f653006a6d0 0x7f653006aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.700+0000 7f65362a1700 1 -- 172.21.15.40:0/3366460824 >> v1:172.21.15.40:6789/0 conn(0x7f653006afe0 legacy=0x7f65301318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:49.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.700+0000 7f65362a1700 1 -- 172.21.15.40:0/3366460824 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f653009f5f0 con 0x7f6530131fc0 2023-09-30T22:31:49.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.701+0000 7f65362a1700 1 --2- 172.21.15.40:0/3366460824 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6530131fc0 0x7f6530139b10 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f6528009e80 tx=0x7f652800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ffa09cc514c35b8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:49.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.701+0000 7f6534a9e700 1 -- 172.21.15.40:0/3366460824 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652800e070 con 0x7f6530131fc0 2023-09-30T22:31:49.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.701+0000 7f6534a9e700 1 -- 172.21.15.40:0/3366460824 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f652800b910 con 0x7f6530131fc0 2023-09-30T22:31:49.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.701+0000 7f6534a9e700 1 -- 172.21.15.40:0/3366460824 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652800bcc0 con 0x7f6530131fc0 2023-09-30T22:31:49.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.702+0000 7f6537d04700 1 -- 172.21.15.40:0/3366460824 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6530131fc0 msgr2=0x7f6530139b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:49.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.702+0000 7f6537d04700 1 --2- 172.21.15.40:0/3366460824 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6530131fc0 0x7f6530139b10 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f6528009e80 tx=0x7f652800b330 comp rx=0 tx=0).stop 2023-09-30T22:31:49.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.702+0000 7f6537d04700 1 -- 172.21.15.40:0/3366460824 shutdown_connections 2023-09-30T22:31:49.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.702+0000 7f6537d04700 1 --2- 172.21.15.40:0/3366460824 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6530131fc0 0x7f6530139b10 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.702+0000 7f6537d04700 1 --2- 172.21.15.40:0/3366460824 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f653006a6d0 0x7f653006aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.702+0000 7f6537d04700 1 -- 172.21.15.40:0/3366460824 >> 172.21.15.40:0/3366460824 conn(0x7f653009fb20 msgr2=0x7f653009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:49.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.702+0000 7f6537d04700 1 -- 172.21.15.40:0/3366460824 shutdown_connections 2023-09-30T22:31:49.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.702+0000 7f6537d04700 1 -- 172.21.15.40:0/3366460824 wait complete. 2023-09-30T22:31:49.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.704+0000 7f6537d04700 1 Processor -- start 2023-09-30T22:31:49.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.704+0000 7f6537d04700 1 -- start start 2023-09-30T22:31:49.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.704+0000 7f6537d04700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f653006a6d0 0x7f65301c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:49.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.704+0000 7f6537d04700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f653006afe0 0x7f65301c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:49.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.704+0000 7f6537d04700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6530131fc0 0x7f65301c9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:49.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.704+0000 7f6537d04700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653009c160 con 0x7f653006afe0 2023-09-30T22:31:49.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.704+0000 7f6537d04700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6530071560 con 0x7f653006a6d0 2023-09-30T22:31:49.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.704+0000 7f6537d04700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6530131580 con 0x7f6530131fc0 2023-09-30T22:31:49.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.705+0000 7f6535aa0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f653006a6d0 0x7f65301c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:49.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.705+0000 7f6535aa0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f653006a6d0 0x7f65301c85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:58110/0 (socket says 172.21.15.40:58110) 2023-09-30T22:31:49.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.705+0000 7f6535aa0700 1 -- 172.21.15.40:0/2665880222 learned_addr learned my addr 172.21.15.40:0/2665880222 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:49.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.705+0000 7f6535aa0700 1 -- 172.21.15.40:0/2665880222 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6530131fc0 msgr2=0x7f65301c9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:49.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.705+0000 7f6535aa0700 1 --2- 172.21.15.40:0/2665880222 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6530131fc0 0x7f65301c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.705+0000 7f6535aa0700 1 -- 172.21.15.40:0/2665880222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f653006afe0 msgr2=0x7f65301c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:49.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.705+0000 7f6535aa0700 1 --2- 172.21.15.40:0/2665880222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f653006afe0 0x7f65301c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.705+0000 7f6535aa0700 1 -- 172.21.15.40:0/2665880222 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6528009b30 con 0x7f653006a6d0 2023-09-30T22:31:49.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.705+0000 7f6535aa0700 1 --2- 172.21.15.40:0/2665880222 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f653006a6d0 0x7f65301c85e0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f652c00e990 tx=0x7f652c00ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:49.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.705+0000 7f65267fc700 1 -- 172.21.15.40:0/2665880222 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652c00c850 con 0x7f653006a6d0 2023-09-30T22:31:49.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.705+0000 7f65267fc700 1 -- 172.21.15.40:0/2665880222 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f652c00c9b0 con 0x7f653006a6d0 2023-09-30T22:31:49.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.705+0000 7f6537d04700 1 -- 172.21.15.40:0/2665880222 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f653009a210 con 0x7f653006a6d0 2023-09-30T22:31:49.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.705+0000 7f65267fc700 1 -- 172.21.15.40:0/2665880222 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652c00cd20 con 0x7f653006a6d0 2023-09-30T22:31:49.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.705+0000 7f6537d04700 1 -- 172.21.15.40:0/2665880222 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6530126cc0 con 0x7f653006a6d0 2023-09-30T22:31:49.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.706+0000 7f6537d04700 1 -- 172.21.15.40:0/2665880222 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6530062380 con 0x7f653006a6d0 2023-09-30T22:31:49.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.707+0000 7f65267fc700 1 -- 172.21.15.40:0/2665880222 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f652c013470 con 0x7f653006a6d0 2023-09-30T22:31:49.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.707+0000 7f65267fc700 1 -- 172.21.15.40:0/2665880222 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f652c03fd60 con 0x7f653006a6d0 2023-09-30T22:31:49.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.716+0000 7f65267fc700 1 -- 172.21.15.40:0/2665880222 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f652c01b3b0 con 0x7f653006a6d0 2023-09-30T22:31:49.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.752+0000 7f6646dd6700 1 Processor -- start 2023-09-30T22:31:49.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.752+0000 7f6646dd6700 1 -- start start 2023-09-30T22:31:49.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.753+0000 7f6646dd6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f664009d920 0x7f664009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:49.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.753+0000 7f6646dd6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f664009e230 0x7f66401343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:49.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.753+0000 7f6646dd6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f664009f940 con 0x7f664009f0f0 2023-09-30T22:31:49.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.753+0000 7f6646dd6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f664006b4c0 con 0x7f664009d920 2023-09-30T22:31:49.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.753+0000 7f6646dd6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f664009a8f0 con 0x7f664009e230 2023-09-30T22:31:49.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.753+0000 7f6644b72700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f664009d920 0x7f664009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:49.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.753+0000 7f6645373700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f664009e230 0x7f66401343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:49.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.754+0000 7f6645373700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f664009e230 0x7f66401343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:58124/0 (socket says 172.21.15.40:58124) 2023-09-30T22:31:49.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.754+0000 7f6644b72700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f664009d920 0x7f664009dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39040/0 (socket says 172.21.15.40:39040) 2023-09-30T22:31:49.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.754+0000 7f6645373700 1 -- 172.21.15.40:0/3451335939 learned_addr learned my addr 172.21.15.40:0/3451335939 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:49.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.754+0000 7f6645373700 1 -- 172.21.15.40:0/3451335939 >> v2:172.21.15.40:3300/0 conn(0x7f664009d920 msgr2=0x7f664009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:49.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.754+0000 7f6645373700 1 --2- 172.21.15.40:0/3451335939 >> v2:172.21.15.40:3300/0 conn(0x7f664009d920 0x7f664009dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.754+0000 7f6645373700 1 -- 172.21.15.40:0/3451335939 >> v1:172.21.15.40:6789/0 conn(0x7f664009f0f0 legacy=0x7f6640133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:49.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.754+0000 7f6645373700 1 -- 172.21.15.40:0/3451335939 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f664009f6e0 con 0x7f664009e230 2023-09-30T22:31:49.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.754+0000 7f6645373700 1 --2- 172.21.15.40:0/3451335939 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f664009e230 0x7f66401343b0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f6638009e80 tx=0x7f663800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4e91169cf4bb186 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:49.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.754+0000 7f663f7fe700 1 -- 172.21.15.40:0/3451335939 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663800e070 con 0x7f664009e230 2023-09-30T22:31:49.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.754+0000 7f663f7fe700 1 -- 172.21.15.40:0/3451335939 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f663800b980 con 0x7f664009e230 2023-09-30T22:31:49.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.754+0000 7f663f7fe700 1 -- 172.21.15.40:0/3451335939 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663800bd30 con 0x7f664009e230 2023-09-30T22:31:49.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.755+0000 7f6646dd6700 1 -- 172.21.15.40:0/3451335939 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f664009e230 msgr2=0x7f66401343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:49.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.755+0000 7f6646dd6700 1 --2- 172.21.15.40:0/3451335939 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f664009e230 0x7f66401343b0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f6638009e80 tx=0x7f663800b330 comp rx=0 tx=0).stop 2023-09-30T22:31:49.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.755+0000 7f6646dd6700 1 -- 172.21.15.40:0/3451335939 shutdown_connections 2023-09-30T22:31:49.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.755+0000 7f6646dd6700 1 --2- 172.21.15.40:0/3451335939 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f664009e230 0x7f66401343b0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.755+0000 7f6646dd6700 1 --2- 172.21.15.40:0/3451335939 >> v2:172.21.15.40:3300/0 conn(0x7f664009d920 0x7f664009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.755+0000 7f6646dd6700 1 -- 172.21.15.40:0/3451335939 >> 172.21.15.40:0/3451335939 conn(0x7f664009fb20 msgr2=0x7f664009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:49.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.755+0000 7f6646dd6700 1 -- 172.21.15.40:0/3451335939 shutdown_connections 2023-09-30T22:31:49.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.755+0000 7f6646dd6700 1 -- 172.21.15.40:0/3451335939 wait complete. 2023-09-30T22:31:49.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.757+0000 7f6646dd6700 1 Processor -- start 2023-09-30T22:31:49.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.757+0000 7f6646dd6700 1 -- start start 2023-09-30T22:31:49.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.757+0000 7f6646dd6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f664009d920 0x7f66401a60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:49.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.758+0000 7f6646dd6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f664009e230 0x7f66401a65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:49.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.758+0000 7f6646dd6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66401b9410 0x7f66401a6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:49.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.758+0000 7f6646dd6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66401aa500 con 0x7f664009d920 2023-09-30T22:31:49.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.758+0000 7f6646dd6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66401a7c30 con 0x7f66401b9410 2023-09-30T22:31:49.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.758+0000 7f6646dd6700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66401a8e80 con 0x7f664009e230 2023-09-30T22:31:49.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.758+0000 7f6644b72700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f664009d920 0x7f66401a60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:49.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.758+0000 7f6644b72700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f664009d920 0x7f66401a60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39052/0 (socket says 172.21.15.40:39052) 2023-09-30T22:31:49.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.758+0000 7f6644b72700 1 -- 172.21.15.40:0/4084847384 learned_addr learned my addr 172.21.15.40:0/4084847384 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:49.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.758+0000 7f6645373700 1 --2- 172.21.15.40:0/4084847384 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66401b9410 0x7f66401a6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:49.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.758+0000 7f6644b72700 1 -- 172.21.15.40:0/4084847384 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f664009e230 msgr2=0x7f66401a65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:49.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.758+0000 7f6644b72700 1 --2- 172.21.15.40:0/4084847384 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f664009e230 0x7f66401a65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.758+0000 7f6644b72700 1 -- 172.21.15.40:0/4084847384 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66401b9410 msgr2=0x7f66401a6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:49.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.758+0000 7f6644b72700 1 --2- 172.21.15.40:0/4084847384 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66401b9410 0x7f66401a6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.758+0000 7f6644b72700 1 -- 172.21.15.40:0/4084847384 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6638009b30 con 0x7f664009d920 2023-09-30T22:31:49.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.758+0000 7f6645373700 1 --2- 172.21.15.40:0/4084847384 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66401b9410 0x7f66401a6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:49.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.758+0000 7f6644b72700 1 --2- 172.21.15.40:0/4084847384 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f664009d920 0x7f66401a60b0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f663400e760 tx=0x7f663400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:49.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.759+0000 7f663d7fa700 1 -- 172.21.15.40:0/4084847384 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6634013610 con 0x7f664009d920 2023-09-30T22:31:49.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.759+0000 7f663d7fa700 1 -- 172.21.15.40:0/4084847384 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6634013770 con 0x7f664009d920 2023-09-30T22:31:49.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.759+0000 7f663d7fa700 1 -- 172.21.15.40:0/4084847384 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6634013b20 con 0x7f664009d920 2023-09-30T22:31:49.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.759+0000 7f6646dd6700 1 -- 172.21.15.40:0/4084847384 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66401a8220 con 0x7f664009d920 2023-09-30T22:31:49.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.759+0000 7f6646dd6700 1 -- 172.21.15.40:0/4084847384 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66400a3510 con 0x7f664009d920 2023-09-30T22:31:49.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.760+0000 7f663d7fa700 1 -- 172.21.15.40:0/4084847384 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6634013c80 con 0x7f664009d920 2023-09-30T22:31:49.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.760+0000 7f663d7fa700 1 -- 172.21.15.40:0/4084847384 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f663403f060 con 0x7f664009d920 2023-09-30T22:31:49.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.760+0000 7f6646dd6700 1 -- 172.21.15.40:0/4084847384 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6640062380 con 0x7f664009d920 2023-09-30T22:31:49.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.767+0000 7f663d7fa700 1 -- 172.21.15.40:0/4084847384 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6634021080 con 0x7f664009d920 2023-09-30T22:31:49.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.778+0000 7f52b7a8d700 1 Processor -- start 2023-09-30T22:31:49.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.778+0000 7f52b7a8d700 1 -- start start 2023-09-30T22:31:49.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.779+0000 7f52b7a8d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52b009d450 0x7f52b009d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:49.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.779+0000 7f52b7a8d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f52b009dd60 0x7f52b01301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:49.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.779+0000 7f52b7a8d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f52b0130700 0x7f52b0130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:49.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.779+0000 7f52b7a8d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52b009e8b0 con 0x7f52b0130700 2023-09-30T22:31:49.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.779+0000 7f52b7a8d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b009c3b0 con 0x7f52b009d450 2023-09-30T22:31:49.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.779+0000 7f52b7a8d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52b009a6b0 con 0x7f52b009dd60 2023-09-30T22:31:49.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.779+0000 7f52b5829700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52b009d450 0x7f52b009d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:49.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.779+0000 7f52b5829700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52b009d450 0x7f52b009d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:58138/0 (socket says 172.21.15.40:58138) 2023-09-30T22:31:49.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.779+0000 7f52b5829700 1 -- 172.21.15.40:0/3179614355 learned_addr learned my addr 172.21.15.40:0/3179614355 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:49.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.779+0000 7f52b5028700 1 --2- 172.21.15.40:0/3179614355 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f52b009dd60 0x7f52b01301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:49.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.779+0000 7f52b602a700 1 --2- 172.21.15.40:0/3179614355 >> v2:172.21.15.40:3300/0 conn(0x7f52b0130700 0x7f52b0130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:49.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.779+0000 7f52b5829700 1 -- 172.21.15.40:0/3179614355 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f52b009dd60 msgr2=0x7f52b01301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:49.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.779+0000 7f52b5829700 1 --2- 172.21.15.40:0/3179614355 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f52b009dd60 0x7f52b01301c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.779+0000 7f52b5829700 1 -- 172.21.15.40:0/3179614355 >> v2:172.21.15.40:3300/0 conn(0x7f52b0130700 msgr2=0x7f52b0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:49.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.779+0000 7f52b5829700 1 --2- 172.21.15.40:0/3179614355 >> v2:172.21.15.40:3300/0 conn(0x7f52b0130700 0x7f52b0130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.779+0000 7f52b5829700 1 -- 172.21.15.40:0/3179614355 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b009b4f0 con 0x7f52b009d450 2023-09-30T22:31:49.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.779+0000 7f52b5829700 1 --2- 172.21.15.40:0/3179614355 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52b009d450 0x7f52b009d820 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f52ac0131e0 tx=0x7f52ac0134f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9af94a105d32bca server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:49.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.780+0000 7f52b4827700 1 -- 172.21.15.40:0/3179614355 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ac016070 con 0x7f52b009d450 2023-09-30T22:31:49.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.780+0000 7f52b4827700 1 -- 172.21.15.40:0/3179614355 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ac013d80 con 0x7f52b009d450 2023-09-30T22:31:49.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.780+0000 7f52b4827700 1 -- 172.21.15.40:0/3179614355 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ac0112f0 con 0x7f52b009d450 2023-09-30T22:31:49.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.780+0000 7f52b7a8d700 1 -- 172.21.15.40:0/3179614355 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52b009d450 msgr2=0x7f52b009d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:49.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.780+0000 7f52b7a8d700 1 --2- 172.21.15.40:0/3179614355 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52b009d450 0x7f52b009d820 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f52ac0131e0 tx=0x7f52ac0134f0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.780+0000 7f52b7a8d700 1 -- 172.21.15.40:0/3179614355 shutdown_connections 2023-09-30T22:31:49.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.780+0000 7f52b7a8d700 1 --2- 172.21.15.40:0/3179614355 >> v2:172.21.15.40:3300/0 conn(0x7f52b0130700 0x7f52b0130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.780+0000 7f52b7a8d700 1 --2- 172.21.15.40:0/3179614355 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52b009d450 0x7f52b009d820 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.780+0000 7f52b7a8d700 1 --2- 172.21.15.40:0/3179614355 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f52b009dd60 0x7f52b01301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.780+0000 7f52b7a8d700 1 -- 172.21.15.40:0/3179614355 >> 172.21.15.40:0/3179614355 conn(0x7f52b00a2a00 msgr2=0x7f52b00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:49.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.780+0000 7f52b7a8d700 1 -- 172.21.15.40:0/3179614355 shutdown_connections 2023-09-30T22:31:49.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.780+0000 7f52b7a8d700 1 -- 172.21.15.40:0/3179614355 wait complete. 2023-09-30T22:31:49.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.781+0000 7f52b7a8d700 1 Processor -- start 2023-09-30T22:31:49.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.781+0000 7f52b7a8d700 1 -- start start 2023-09-30T22:31:49.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.782+0000 7f52b7a8d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52b009d450 0x7f52b011afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:49.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.782+0000 7f52b7a8d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52b009dd60 0x7f52b011b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:49.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.782+0000 7f52b7a8d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f52b0130700 0x7f52b011ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:49.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.782+0000 7f52b7a8d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b011ead0 con 0x7f52b009dd60 2023-09-30T22:31:49.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.782+0000 7f52b7a8d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b011d1e0 con 0x7f52b009d450 2023-09-30T22:31:49.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.782+0000 7f52b7a8d700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52b009c5d0 con 0x7f52b0130700 2023-09-30T22:31:49.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.782+0000 7f52b5028700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52b009dd60 0x7f52b011b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:49.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.782+0000 7f52b5028700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52b009dd60 0x7f52b011b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39064/0 (socket says 172.21.15.40:39064) 2023-09-30T22:31:49.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.782+0000 7f52b5028700 1 -- 172.21.15.40:0/1475940619 learned_addr learned my addr 172.21.15.40:0/1475940619 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:49.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.782+0000 7f52b5028700 1 -- 172.21.15.40:0/1475940619 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f52b0130700 msgr2=0x7f52b011ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:49.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.782+0000 7f52b5028700 1 --2- 172.21.15.40:0/1475940619 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f52b0130700 0x7f52b011ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.782+0000 7f52b5028700 1 -- 172.21.15.40:0/1475940619 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52b009d450 msgr2=0x7f52b011afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:49.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.782+0000 7f52b5028700 1 --2- 172.21.15.40:0/1475940619 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52b009d450 0x7f52b011afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.782+0000 7f52b5028700 1 -- 172.21.15.40:0/1475940619 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ac011df0 con 0x7f52b009dd60 2023-09-30T22:31:49.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.782+0000 7f52b5028700 1 --2- 172.21.15.40:0/1475940619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52b009dd60 0x7f52b011b4f0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f52a000e930 tx=0x7f52a000ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:49.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.783+0000 7f52a67fc700 1 -- 172.21.15.40:0/1475940619 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a0009710 con 0x7f52b009dd60 2023-09-30T22:31:49.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.783+0000 7f52a67fc700 1 -- 172.21.15.40:0/1475940619 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a000c850 con 0x7f52b009dd60 2023-09-30T22:31:49.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.783+0000 7f52b7a8d700 1 -- 172.21.15.40:0/1475940619 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52b011cbc0 con 0x7f52b009dd60 2023-09-30T22:31:49.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.783+0000 7f52a67fc700 1 -- 172.21.15.40:0/1475940619 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a000cbe0 con 0x7f52b009dd60 2023-09-30T22:31:49.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.783+0000 7f52b7a8d700 1 -- 172.21.15.40:0/1475940619 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52b011d3b0 con 0x7f52b009dd60 2023-09-30T22:31:49.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.784+0000 7f52b7a8d700 1 -- 172.21.15.40:0/1475940619 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52b0062380 con 0x7f52b009dd60 2023-09-30T22:31:49.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.784+0000 7f52a67fc700 1 -- 172.21.15.40:0/1475940619 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f52a000cd40 con 0x7f52b009dd60 2023-09-30T22:31:49.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.784+0000 7f52a67fc700 1 -- 172.21.15.40:0/1475940619 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f52a003fb60 con 0x7f52b009dd60 2023-09-30T22:31:49.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.788+0000 7f7422755700 1 Processor -- start 2023-09-30T22:31:49.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.788+0000 7f7422755700 1 -- start start 2023-09-30T22:31:49.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.789+0000 7f7422755700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f741c09d450 0x7f741c09d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:49.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.789+0000 7f7422755700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f741c09dd60 0x7f741c1301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:49.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.789+0000 7f7422755700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f741c09c3b0 con 0x7f741c130700 2023-09-30T22:31:49.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.789+0000 7f7422755700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f741c09a6b0 con 0x7f741c09d450 2023-09-30T22:31:49.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.789+0000 7f7422755700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741c09b4f0 con 0x7f741c09dd60 2023-09-30T22:31:49.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.789+0000 7f741b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f741c09dd60 0x7f741c1301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:49.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.789+0000 7f741b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f741c09dd60 0x7f741c1301c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:58162/0 (socket says 172.21.15.40:58162) 2023-09-30T22:31:49.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.789+0000 7f741b7fe700 1 -- 172.21.15.40:0/4179838950 learned_addr learned my addr 172.21.15.40:0/4179838950 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:49.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.789+0000 7f741b7fe700 1 -- 172.21.15.40:0/4179838950 >> v2:172.21.15.40:3300/0 conn(0x7f741c09d450 msgr2=0x7f741c09d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:49.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.789+0000 7f741b7fe700 1 --2- 172.21.15.40:0/4179838950 >> v2:172.21.15.40:3300/0 conn(0x7f741c09d450 0x7f741c09d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.789+0000 7f741b7fe700 1 -- 172.21.15.40:0/4179838950 >> v1:172.21.15.40:6789/0 conn(0x7f741c130700 legacy=0x7f741c137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:49.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.789+0000 7f741b7fe700 1 -- 172.21.15.40:0/4179838950 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741c09af90 con 0x7f741c09dd60 2023-09-30T22:31:49.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.789+0000 7f741b7fe700 1 --2- 172.21.15.40:0/4179838950 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f741c09dd60 0x7f741c1301c0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f74100098f0 tx=0x7f7410009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=344b913649279632 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:49.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.790+0000 7f741affd700 1 -- 172.21.15.40:0/4179838950 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7410004230 con 0x7f741c09dd60 2023-09-30T22:31:49.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.790+0000 7f741affd700 1 -- 172.21.15.40:0/4179838950 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7410004390 con 0x7f741c09dd60 2023-09-30T22:31:49.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.790+0000 7f741affd700 1 -- 172.21.15.40:0/4179838950 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74100036a0 con 0x7f741c09dd60 2023-09-30T22:31:49.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.790+0000 7f7422755700 1 -- 172.21.15.40:0/4179838950 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f741c09dd60 msgr2=0x7f741c1301c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:49.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.790+0000 7f7422755700 1 --2- 172.21.15.40:0/4179838950 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f741c09dd60 0x7f741c1301c0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f74100098f0 tx=0x7f7410009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:49.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.790+0000 7f7422755700 1 -- 172.21.15.40:0/4179838950 shutdown_connections 2023-09-30T22:31:49.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.790+0000 7f7422755700 1 --2- 172.21.15.40:0/4179838950 >> v2:172.21.15.40:3300/0 conn(0x7f741c09d450 0x7f741c09d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.790+0000 7f7422755700 1 --2- 172.21.15.40:0/4179838950 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f741c09dd60 0x7f741c1301c0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.790+0000 7f7422755700 1 -- 172.21.15.40:0/4179838950 >> 172.21.15.40:0/4179838950 conn(0x7f741c0a2a00 msgr2=0x7f741c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:49.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.790+0000 7f7422755700 1 -- 172.21.15.40:0/4179838950 shutdown_connections 2023-09-30T22:31:49.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.790+0000 7f7422755700 1 -- 172.21.15.40:0/4179838950 wait complete. 2023-09-30T22:31:49.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.791+0000 7f7422755700 1 Processor -- start 2023-09-30T22:31:49.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.791+0000 7f7422755700 1 -- start start 2023-09-30T22:31:49.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.792+0000 7f7422755700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f741c09d450 0x7f741c06d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:49.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.792+0000 7f7422755700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f741c09dd60 0x7f741c06db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:49.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.792+0000 7f7422755700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f741c130700 0x7f741c06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:49.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.792+0000 7f7422755700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c125a10 con 0x7f741c130700 2023-09-30T22:31:49.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.792+0000 7f7422755700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741c071e80 con 0x7f741c09dd60 2023-09-30T22:31:49.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.792+0000 7f7422755700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f741c125c60 con 0x7f741c09d450 2023-09-30T22:31:49.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.792+0000 7f741bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f741c09d450 0x7f741c06d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:49.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.792+0000 7f741b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f741c09dd60 0x7f741c06db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:49.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.792+0000 7f741bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f741c09d450 0x7f741c06d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:36986/0 (socket says 172.21.15.40:36986) 2023-09-30T22:31:49.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.792+0000 7f741bfff700 1 -- 172.21.15.40:0/2585612294 learned_addr learned my addr 172.21.15.40:0/2585612294 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:49.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.792+0000 7f741b7fe700 1 -- 172.21.15.40:0/2585612294 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f741c09d450 msgr2=0x7f741c06d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:49.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.792+0000 7f741b7fe700 1 --2- 172.21.15.40:0/2585612294 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f741c09d450 0x7f741c06d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.792+0000 7f741b7fe700 1 -- 172.21.15.40:0/2585612294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f741c130700 msgr2=0x7f741c06e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:49.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.792+0000 7f741b7fe700 1 --2- 172.21.15.40:0/2585612294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f741c130700 0x7f741c06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.792+0000 7f741b7fe700 1 -- 172.21.15.40:0/2585612294 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7410009550 con 0x7f741c09dd60 2023-09-30T22:31:49.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.792+0000 7f741bfff700 1 --2- 172.21.15.40:0/2585612294 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f741c09d450 0x7f741c06d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:49.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.793+0000 7f741b7fe700 1 --2- 172.21.15.40:0/2585612294 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f741c09dd60 0x7f741c06db80 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f7410016000 tx=0x7f7410004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:49.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.793+0000 7f7418ff9700 1 -- 172.21.15.40:0/2585612294 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741001d070 con 0x7f741c09dd60 2023-09-30T22:31:49.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.793+0000 7f7418ff9700 1 -- 172.21.15.40:0/2585612294 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f741000b660 con 0x7f741c09dd60 2023-09-30T22:31:49.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.793+0000 7f7418ff9700 1 -- 172.21.15.40:0/2585612294 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741000ba10 con 0x7f741c09dd60 2023-09-30T22:31:49.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.793+0000 7f7422755700 1 -- 172.21.15.40:0/2585612294 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f741c125390 con 0x7f741c09dd60 2023-09-30T22:31:49.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.793+0000 7f7422755700 1 -- 172.21.15.40:0/2585612294 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f741c1256c0 con 0x7f741c09dd60 2023-09-30T22:31:49.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.794+0000 7f52a67fc700 1 -- 172.21.15.40:0/1475940619 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f52a001b3b0 con 0x7f52b009dd60 2023-09-30T22:31:49.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.794+0000 7f7418ff9700 1 -- 172.21.15.40:0/2585612294 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f741000bb70 con 0x7f741c09dd60 2023-09-30T22:31:49.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.794+0000 7f7422755700 1 -- 172.21.15.40:0/2585612294 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f741c062380 con 0x7f741c09dd60 2023-09-30T22:31:49.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.794+0000 7f7418ff9700 1 -- 172.21.15.40:0/2585612294 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f74100404c0 con 0x7f741c09dd60 2023-09-30T22:31:49.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.803+0000 7f7418ff9700 1 -- 172.21.15.40:0/2585612294 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f741000be20 con 0x7f741c09dd60 2023-09-30T22:31:49.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.921+0000 7f6537d04700 1 -- 172.21.15.40:0/2665880222 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f65301260d0 con 0x7f653006a6d0 2023-09-30T22:31:49.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.921+0000 7f65267fc700 1 -- 172.21.15.40:0/2665880222 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f652c017030 con 0x7f653006a6d0 2023-09-30T22:31:49.922 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:49.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.923+0000 7f6537d04700 1 -- 172.21.15.40:0/2665880222 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f653006a6d0 msgr2=0x7f65301c85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:49.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.923+0000 7f6537d04700 1 --2- 172.21.15.40:0/2665880222 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f653006a6d0 0x7f65301c85e0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f652c00e990 tx=0x7f652c00ed50 comp rx=0 tx=0).stop 2023-09-30T22:31:49.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.923+0000 7f6537d04700 1 -- 172.21.15.40:0/2665880222 shutdown_connections 2023-09-30T22:31:49.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.923+0000 7f6537d04700 1 --2- 172.21.15.40:0/2665880222 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6530131fc0 0x7f65301c9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.923+0000 7f6537d04700 1 --2- 172.21.15.40:0/2665880222 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f653006a6d0 0x7f65301c85e0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.923+0000 7f6537d04700 1 --2- 172.21.15.40:0/2665880222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f653006afe0 0x7f65301c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.923+0000 7f6537d04700 1 -- 172.21.15.40:0/2665880222 >> 172.21.15.40:0/2665880222 conn(0x7f653009fb20 msgr2=0x7f65300a26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:49.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.924+0000 7f6537d04700 1 -- 172.21.15.40:0/2665880222 shutdown_connections 2023-09-30T22:31:49.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.924+0000 7f6537d04700 1 -- 172.21.15.40:0/2665880222 wait complete. 2023-09-30T22:31:49.937 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:49.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.971+0000 7f6646dd6700 1 -- 172.21.15.40:0/4084847384 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6640074720 con 0x7f664009d920 2023-09-30T22:31:49.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.972+0000 7f663d7fa700 1 -- 172.21.15.40:0/4084847384 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6634023700 con 0x7f664009d920 2023-09-30T22:31:49.972 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:49.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.974+0000 7f6646dd6700 1 -- 172.21.15.40:0/4084847384 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f664009d920 msgr2=0x7f66401a60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:49.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.974+0000 7f6646dd6700 1 --2- 172.21.15.40:0/4084847384 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f664009d920 0x7f66401a60b0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f663400e760 tx=0x7f663400ea70 comp rx=0 tx=0).stop 2023-09-30T22:31:49.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.975+0000 7f6646dd6700 1 -- 172.21.15.40:0/4084847384 shutdown_connections 2023-09-30T22:31:49.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.975+0000 7f6646dd6700 1 --2- 172.21.15.40:0/4084847384 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f66401b9410 0x7f66401a6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.975+0000 7f6646dd6700 1 --2- 172.21.15.40:0/4084847384 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f664009d920 0x7f66401a60b0 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.975+0000 7f6646dd6700 1 --2- 172.21.15.40:0/4084847384 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f664009e230 0x7f66401a65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:49.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.975+0000 7f6646dd6700 1 -- 172.21.15.40:0/4084847384 >> 172.21.15.40:0/4084847384 conn(0x7f664009fb20 msgr2=0x7f66401bb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:49.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.975+0000 7f6646dd6700 1 -- 172.21.15.40:0/4084847384 shutdown_connections 2023-09-30T22:31:49.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.976+0000 7f6646dd6700 1 -- 172.21.15.40:0/4084847384 wait complete. 2023-09-30T22:31:49.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:49.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.998+0000 7f52b7a8d700 1 -- 172.21.15.40:0/1475940619 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f52b0074330 con 0x7f52b009dd60 2023-09-30T22:31:49.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:49.999+0000 7f52a67fc700 1 -- 172.21.15.40:0/1475940619 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f52a0021070 con 0x7f52b009dd60 2023-09-30T22:31:49.999 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:50.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:50.001+0000 7f52b7a8d700 1 -- 172.21.15.40:0/1475940619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52b009dd60 msgr2=0x7f52b011b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:50.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:50.001+0000 7f52b7a8d700 1 --2- 172.21.15.40:0/1475940619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52b009dd60 0x7f52b011b4f0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f52a000e930 tx=0x7f52a000ecf0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:50.001+0000 7f52b7a8d700 1 -- 172.21.15.40:0/1475940619 shutdown_connections 2023-09-30T22:31:50.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:50.001+0000 7f52b7a8d700 1 --2- 172.21.15.40:0/1475940619 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f52b0130700 0x7f52b011ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:50.001+0000 7f52b7a8d700 1 --2- 172.21.15.40:0/1475940619 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52b009d450 0x7f52b011afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:50.001+0000 7f52b7a8d700 1 --2- 172.21.15.40:0/1475940619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52b009dd60 0x7f52b011b4f0 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:50.001+0000 7f52b7a8d700 1 -- 172.21.15.40:0/1475940619 >> 172.21.15.40:0/1475940619 conn(0x7f52b00a2a00 msgr2=0x7f52b00a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:50.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:50.001+0000 7f52b7a8d700 1 -- 172.21.15.40:0/1475940619 shutdown_connections 2023-09-30T22:31:50.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:50.001+0000 7f52b7a8d700 1 -- 172.21.15.40:0/1475940619 wait complete. 2023-09-30T22:31:50.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:50.004+0000 7f7422755700 1 -- 172.21.15.40:0/2585612294 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f741c1304e0 con 0x7f741c09dd60 2023-09-30T22:31:50.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:50.005+0000 7f7418ff9700 1 -- 172.21.15.40:0/2585612294 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7410026030 con 0x7f741c09dd60 2023-09-30T22:31:50.005 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:50.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:50.007+0000 7f7422755700 1 -- 172.21.15.40:0/2585612294 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f741c09dd60 msgr2=0x7f741c06db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:50.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:50.007+0000 7f7422755700 1 --2- 172.21.15.40:0/2585612294 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f741c09dd60 0x7f741c06db80 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f7410016000 tx=0x7f7410004750 comp rx=0 tx=0).stop 2023-09-30T22:31:50.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:50.007+0000 7f7422755700 1 -- 172.21.15.40:0/2585612294 shutdown_connections 2023-09-30T22:31:50.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:50.007+0000 7f7422755700 1 --2- 172.21.15.40:0/2585612294 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f741c09d450 0x7f741c06d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:50.007+0000 7f7422755700 1 --2- 172.21.15.40:0/2585612294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f741c130700 0x7f741c06e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:50.007+0000 7f7422755700 1 --2- 172.21.15.40:0/2585612294 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f741c09dd60 0x7f741c06db80 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:50.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:50.007+0000 7f7422755700 1 -- 172.21.15.40:0/2585612294 >> 172.21.15.40:0/2585612294 conn(0x7f741c0a2a00 msgr2=0x7f741c06f820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:50.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:50.007+0000 7f7422755700 1 -- 172.21.15.40:0/2585612294 shutdown_connections 2023-09-30T22:31:50.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:50.007+0000 7f7422755700 1 -- 172.21.15.40:0/2585612294 wait complete. 2023-09-30T22:31:50.015 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:50.021 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:50.938 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:50.990 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:51.016 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:51.022 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:51.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.097+0000 7fef4bc7e700 1 Processor -- start 2023-09-30T22:31:51.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.098+0000 7fef4bc7e700 1 -- start start 2023-09-30T22:31:51.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.099+0000 7fef4bc7e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef4409f0f0 0x7fef44138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.099+0000 7fef4bc7e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef4409e400 0x7fef4413b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.099+0000 7fef4bc7e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef4409f940 con 0x7fef4409d920 2023-09-30T22:31:51.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.099+0000 7fef4bc7e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef4406b4c0 con 0x7fef4409e400 2023-09-30T22:31:51.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.099+0000 7fef4bc7e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef4409a8f0 con 0x7fef4409f0f0 2023-09-30T22:31:51.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.099+0000 7fef49219700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef4409f0f0 0x7fef44138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.099+0000 7fef49219700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef4409f0f0 0x7fef44138ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:58170/0 (socket says 172.21.15.40:58170) 2023-09-30T22:31:51.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.099+0000 7fef49219700 1 -- 172.21.15.40:0/1254973405 learned_addr learned my addr 172.21.15.40:0/1254973405 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:51.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.099+0000 7fef4a21b700 1 --2- 172.21.15.40:0/1254973405 >> v2:172.21.15.40:3300/0 conn(0x7fef4409e400 0x7fef4413b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.099+0000 7fef4a21b700 1 -- 172.21.15.40:0/1254973405 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef4409f0f0 msgr2=0x7fef44138ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:51.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.099+0000 7fef4a21b700 1 --2- 172.21.15.40:0/1254973405 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef4409f0f0 0x7fef44138ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.099+0000 7fef4a21b700 1 -- 172.21.15.40:0/1254973405 >> v1:172.21.15.40:6789/0 conn(0x7fef4409d920 legacy=0x7fef4409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:51.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.099+0000 7fef48a18700 1 -- 172.21.15.40:0/1254973405 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 288978686 0 0) 0x7fef4409f940 con 0x7fef4409d920 2023-09-30T22:31:51.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.100+0000 7fef4a21b700 1 -- 172.21.15.40:0/1254973405 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef4409f6e0 con 0x7fef4409e400 2023-09-30T22:31:51.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.100+0000 7fef4a21b700 1 --2- 172.21.15.40:0/1254973405 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef4409e400 0x7fef4413b430 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fef3c009dc0 tx=0x7fef3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d83f97c70ee5ef server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:51.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.100+0000 7fef48a18700 1 -- 172.21.15.40:0/1254973405 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3c00e070 con 0x7fef4409e400 2023-09-30T22:31:51.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.100+0000 7fef48a18700 1 -- 172.21.15.40:0/1254973405 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3c00bae0 con 0x7fef4409e400 2023-09-30T22:31:51.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.100+0000 7fef48a18700 1 -- 172.21.15.40:0/1254973405 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3c00be90 con 0x7fef4409e400 2023-09-30T22:31:51.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.101+0000 7fef4bc7e700 1 -- 172.21.15.40:0/1254973405 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef4409e400 msgr2=0x7fef4413b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:51.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.101+0000 7fef4bc7e700 1 --2- 172.21.15.40:0/1254973405 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef4409e400 0x7fef4413b430 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fef3c009dc0 tx=0x7fef3c00b330 comp rx=0 tx=0).stop 2023-09-30T22:31:51.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.101+0000 7fef4bc7e700 1 -- 172.21.15.40:0/1254973405 shutdown_connections 2023-09-30T22:31:51.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.101+0000 7fef4bc7e700 1 --2- 172.21.15.40:0/1254973405 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef4409e400 0x7fef4413b430 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.101+0000 7fef4bc7e700 1 --2- 172.21.15.40:0/1254973405 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef4409f0f0 0x7fef44138ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.101+0000 7fef4bc7e700 1 -- 172.21.15.40:0/1254973405 >> 172.21.15.40:0/1254973405 conn(0x7fef4409fb20 msgr2=0x7fef4409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:51.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.101+0000 7fef4bc7e700 1 -- 172.21.15.40:0/1254973405 shutdown_connections 2023-09-30T22:31:51.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.101+0000 7fef4bc7e700 1 -- 172.21.15.40:0/1254973405 wait complete. 2023-09-30T22:31:51.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.103+0000 7fef4bc7e700 1 Processor -- start 2023-09-30T22:31:51.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.103+0000 7fef4bc7e700 1 -- start start 2023-09-30T22:31:51.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.103+0000 7fef4bc7e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef4409d920 0x7fef4411db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.103+0000 7fef4bc7e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef4409e400 0x7fef4411e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.103+0000 7fef4bc7e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef4411e5c0 0x7fef441ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.103+0000 7fef4bc7e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef441200e0 con 0x7fef4409d920 2023-09-30T22:31:51.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.103+0000 7fef4bc7e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef4411f870 con 0x7fef4411e5c0 2023-09-30T22:31:51.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.103+0000 7fef4bc7e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef440a2f40 con 0x7fef4409e400 2023-09-30T22:31:51.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.104+0000 7fef4a21b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef4411e5c0 0x7fef441ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.104+0000 7fef4a21b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef4411e5c0 0x7fef441ce8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:58184/0 (socket says 172.21.15.40:58184) 2023-09-30T22:31:51.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.104+0000 7fef4a21b700 1 -- 172.21.15.40:0/3740885739 learned_addr learned my addr 172.21.15.40:0/3740885739 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:51.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.104+0000 7fef49a1a700 1 --2- 172.21.15.40:0/3740885739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef4409d920 0x7fef4411db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.104+0000 7fef49219700 1 --2- 172.21.15.40:0/3740885739 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef4409e400 0x7fef4411e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.104+0000 7fef49a1a700 1 -- 172.21.15.40:0/3740885739 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef4409e400 msgr2=0x7fef4411e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:51.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.104+0000 7fef49a1a700 1 --2- 172.21.15.40:0/3740885739 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef4409e400 0x7fef4411e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.104+0000 7fef49a1a700 1 -- 172.21.15.40:0/3740885739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef4411e5c0 msgr2=0x7fef441ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:51.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.104+0000 7fef49a1a700 1 --2- 172.21.15.40:0/3740885739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef4411e5c0 0x7fef441ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.104+0000 7fef49a1a700 1 -- 172.21.15.40:0/3740885739 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef3c009a70 con 0x7fef4409d920 2023-09-30T22:31:51.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.104+0000 7fef4a21b700 1 --2- 172.21.15.40:0/3740885739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef4411e5c0 0x7fef441ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:51.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.104+0000 7fef49a1a700 1 --2- 172.21.15.40:0/3740885739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef4409d920 0x7fef4411db40 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fef40000fd0 tx=0x7fef4000c6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:51.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.104+0000 7fef3a7fc700 1 -- 172.21.15.40:0/3740885739 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef400052d0 con 0x7fef4409d920 2023-09-30T22:31:51.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.104+0000 7fef3a7fc700 1 -- 172.21.15.40:0/3740885739 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef40005430 con 0x7fef4409d920 2023-09-30T22:31:51.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.104+0000 7fef4bc7e700 1 -- 172.21.15.40:0/3740885739 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef4409c9e0 con 0x7fef4409d920 2023-09-30T22:31:51.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.104+0000 7fef3a7fc700 1 -- 172.21.15.40:0/3740885739 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef400038c0 con 0x7fef4409d920 2023-09-30T22:31:51.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.105+0000 7fef4bc7e700 1 -- 172.21.15.40:0/3740885739 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef4411f420 con 0x7fef4409d920 2023-09-30T22:31:51.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.106+0000 7fef4bc7e700 1 -- 172.21.15.40:0/3740885739 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef4411faa0 con 0x7fef4409d920 2023-09-30T22:31:51.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.106+0000 7fef3a7fc700 1 -- 172.21.15.40:0/3740885739 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fef40003a20 con 0x7fef4409d920 2023-09-30T22:31:51.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.106+0000 7fef3a7fc700 1 -- 172.21.15.40:0/3740885739 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fef4003e9c0 con 0x7fef4409d920 2023-09-30T22:31:51.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.115+0000 7fef3a7fc700 1 -- 172.21.15.40:0/3740885739 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef4411faa0 con 0x7fef4409d920 2023-09-30T22:31:51.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.144+0000 7f6595073700 1 Processor -- start 2023-09-30T22:31:51.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.144+0000 7f6595073700 1 -- start start 2023-09-30T22:31:51.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.145+0000 7f6595073700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6590133e00 0x7f65901341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.145+0000 7f6595073700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f659009d400 0x7f659009d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.145+0000 7f6595073700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f659009dd70 0x7f659013ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.145+0000 7f6595073700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f659009ab20 con 0x7f659009dd70 2023-09-30T22:31:51.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.145+0000 7f6595073700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6590133940 con 0x7f659009d400 2023-09-30T22:31:51.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.145+0000 7f6595073700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f659009f0d0 con 0x7f6590133e00 2023-09-30T22:31:51.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.145+0000 7f658ed9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6590133e00 0x7f65901341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.145+0000 7f658f59e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f659009dd70 0x7f659013ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.145+0000 7f658ed9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6590133e00 0x7f65901341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:37004/0 (socket says 172.21.15.40:37004) 2023-09-30T22:31:51.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.145+0000 7f658ed9d700 1 -- 172.21.15.40:0/1041459126 learned_addr learned my addr 172.21.15.40:0/1041459126 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:51.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.145+0000 7f658e59c700 1 --2- 172.21.15.40:0/1041459126 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f659009d400 0x7f659009d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.145+0000 7f658ed9d700 1 -- 172.21.15.40:0/1041459126 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f659009d400 msgr2=0x7f659009d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:51.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.145+0000 7f658ed9d700 1 --2- 172.21.15.40:0/1041459126 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f659009d400 0x7f659009d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.145+0000 7f658ed9d700 1 -- 172.21.15.40:0/1041459126 >> v2:172.21.15.40:3300/0 conn(0x7f659009dd70 msgr2=0x7f659013ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:51.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.145+0000 7f658ed9d700 1 --2- 172.21.15.40:0/1041459126 >> v2:172.21.15.40:3300/0 conn(0x7f659009dd70 0x7f659013ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.145+0000 7f658ed9d700 1 -- 172.21.15.40:0/1041459126 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659009e210 con 0x7f6590133e00 2023-09-30T22:31:51.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.145+0000 7f658ed9d700 1 --2- 172.21.15.40:0/1041459126 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6590133e00 0x7f65901341d0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f65800098f0 tx=0x7f6580009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2820b43cd5afbb72 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:51.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.146+0000 7f658dd9b700 1 -- 172.21.15.40:0/1041459126 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6580011830 con 0x7f6590133e00 2023-09-30T22:31:51.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.146+0000 7f658dd9b700 1 -- 172.21.15.40:0/1041459126 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6580011990 con 0x7f6590133e00 2023-09-30T22:31:51.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.146+0000 7f658dd9b700 1 -- 172.21.15.40:0/1041459126 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6580011d20 con 0x7f6590133e00 2023-09-30T22:31:51.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.147+0000 7f6595073700 1 -- 172.21.15.40:0/1041459126 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6590133e00 msgr2=0x7f65901341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:51.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.147+0000 7f6595073700 1 --2- 172.21.15.40:0/1041459126 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6590133e00 0x7f65901341d0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f65800098f0 tx=0x7f6580009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:51.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.147+0000 7f6595073700 1 -- 172.21.15.40:0/1041459126 shutdown_connections 2023-09-30T22:31:51.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.147+0000 7f6595073700 1 --2- 172.21.15.40:0/1041459126 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f6590133e00 0x7f65901341d0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.147+0000 7f6595073700 1 --2- 172.21.15.40:0/1041459126 >> v2:172.21.15.40:3300/0 conn(0x7f659009dd70 0x7f659013ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.147+0000 7f6595073700 1 --2- 172.21.15.40:0/1041459126 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f659009d400 0x7f659009d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.147+0000 7f6595073700 1 -- 172.21.15.40:0/1041459126 >> 172.21.15.40:0/1041459126 conn(0x7f65900a2a00 msgr2=0x7f65900a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:51.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.147+0000 7f6595073700 1 -- 172.21.15.40:0/1041459126 shutdown_connections 2023-09-30T22:31:51.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.147+0000 7f6595073700 1 -- 172.21.15.40:0/1041459126 wait complete. 2023-09-30T22:31:51.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.149+0000 7f6595073700 1 Processor -- start 2023-09-30T22:31:51.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.149+0000 7f6595073700 1 -- start start 2023-09-30T22:31:51.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.149+0000 7f6595073700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f659009d400 0x7f6590119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.149+0000 7f6595073700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f659009dd70 0x7f6590119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.149+0000 7f6595073700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6590133e00 0x7f6590119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.149+0000 7f6595073700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659011cc90 con 0x7f6590133e00 2023-09-30T22:31:51.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.149+0000 7f6595073700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f659011c2d0 con 0x7f659009dd70 2023-09-30T22:31:51.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.149+0000 7f6595073700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f659011b6a0 con 0x7f659009d400 2023-09-30T22:31:51.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.150+0000 7f658e59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f659009dd70 0x7f6590119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.150+0000 7f658ed9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f659009d400 0x7f6590119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.150+0000 7f658e59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f659009dd70 0x7f6590119590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:58214/0 (socket says 172.21.15.40:58214) 2023-09-30T22:31:51.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.150+0000 7f658ed9d700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f659009d400 0x7f6590119050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:37020/0 (socket says 172.21.15.40:37020) 2023-09-30T22:31:51.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.150+0000 7f658e59c700 1 -- 172.21.15.40:0/4076212769 learned_addr learned my addr 172.21.15.40:0/4076212769 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:51.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.150+0000 7f658ed9d700 1 -- 172.21.15.40:0/4076212769 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f659009dd70 msgr2=0x7f6590119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:51.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.150+0000 7f658ed9d700 1 --2- 172.21.15.40:0/4076212769 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f659009dd70 0x7f6590119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.150+0000 7f658ed9d700 1 -- 172.21.15.40:0/4076212769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6590133e00 msgr2=0x7f6590119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:51.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.150+0000 7f658ed9d700 1 --2- 172.21.15.40:0/4076212769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6590133e00 0x7f6590119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.150+0000 7f658ed9d700 1 -- 172.21.15.40:0/4076212769 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6580009550 con 0x7f659009d400 2023-09-30T22:31:51.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.150+0000 7f658e59c700 1 --2- 172.21.15.40:0/4076212769 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f659009dd70 0x7f6590119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:51.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.150+0000 7f658ed9d700 1 --2- 172.21.15.40:0/4076212769 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f659009d400 0x7f6590119050 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f659009b000 tx=0x7f6580004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:51.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.150+0000 7f65777fe700 1 -- 172.21.15.40:0/4076212769 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6580004510 con 0x7f659009d400 2023-09-30T22:31:51.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.150+0000 7f65777fe700 1 -- 172.21.15.40:0/4076212769 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65800036a0 con 0x7f659009d400 2023-09-30T22:31:51.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.150+0000 7f6595073700 1 -- 172.21.15.40:0/4076212769 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65900a0f60 con 0x7f659009d400 2023-09-30T22:31:51.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.150+0000 7f65777fe700 1 -- 172.21.15.40:0/4076212769 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6580003a10 con 0x7f659009d400 2023-09-30T22:31:51.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.150+0000 7f6595073700 1 -- 172.21.15.40:0/4076212769 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f659011a3e0 con 0x7f659009d400 2023-09-30T22:31:51.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.152+0000 7f6595073700 1 -- 172.21.15.40:0/4076212769 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6590132fe0 con 0x7f659009d400 2023-09-30T22:31:51.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.156+0000 7f65777fe700 1 -- 172.21.15.40:0/4076212769 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6580003b70 con 0x7f659009d400 2023-09-30T22:31:51.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.156+0000 7f65777fe700 1 -- 172.21.15.40:0/4076212769 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f6580041020 con 0x7f659009d400 2023-09-30T22:31:51.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.161+0000 7f65777fe700 1 -- 172.21.15.40:0/4076212769 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6580022390 con 0x7f659009d400 2023-09-30T22:31:51.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.170+0000 7fa47e12e700 1 Processor -- start 2023-09-30T22:31:51.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.170+0000 7fa47e12e700 1 -- start start 2023-09-30T22:31:51.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.171+0000 7fa47e12e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa478131d50 0x7fa478132120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.171+0000 7fa47e12e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa47809bc50 0x7fa47809c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.171+0000 7fa47e12e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa47809c600 0x7fa478138ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.171+0000 7fa47e12e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa47809cb00 con 0x7fa47809c600 2023-09-30T22:31:51.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.171+0000 7fa47e12e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa478071920 con 0x7fa478131d50 2023-09-30T22:31:51.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.171+0000 7fa47e12e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa478132660 con 0x7fa47809bc50 2023-09-30T22:31:51.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.171+0000 7fa476ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa47809bc50 0x7fa47809c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.171+0000 7fa477fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa47809c600 0x7fa478138ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.171+0000 7fa476ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa47809bc50 0x7fa47809c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:37034/0 (socket says 172.21.15.40:37034) 2023-09-30T22:31:51.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.171+0000 7fa476ffd700 1 -- 172.21.15.40:0/755510156 learned_addr learned my addr 172.21.15.40:0/755510156 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:51.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.171+0000 7fa4777fe700 1 --2- 172.21.15.40:0/755510156 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa478131d50 0x7fa478132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.172+0000 7fa476ffd700 1 -- 172.21.15.40:0/755510156 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa478131d50 msgr2=0x7fa478132120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:51.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.172+0000 7fa476ffd700 1 --2- 172.21.15.40:0/755510156 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa478131d50 0x7fa478132120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.172+0000 7fa476ffd700 1 -- 172.21.15.40:0/755510156 >> v2:172.21.15.40:3300/0 conn(0x7fa47809c600 msgr2=0x7fa478138ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:51.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.172+0000 7fa476ffd700 1 --2- 172.21.15.40:0/755510156 >> v2:172.21.15.40:3300/0 conn(0x7fa47809c600 0x7fa478138ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.172+0000 7fa476ffd700 1 -- 172.21.15.40:0/755510156 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa478131900 con 0x7fa47809bc50 2023-09-30T22:31:51.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.172+0000 7fa476ffd700 1 --2- 172.21.15.40:0/755510156 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa47809bc50 0x7fa47809c0c0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fa46c0098f0 tx=0x7fa46c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a326ae39f47577f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:51.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.172+0000 7fa4767fc700 1 -- 172.21.15.40:0/755510156 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c010a90 con 0x7fa47809bc50 2023-09-30T22:31:51.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.172+0000 7fa4767fc700 1 -- 172.21.15.40:0/755510156 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46c010bf0 con 0x7fa47809bc50 2023-09-30T22:31:51.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.172+0000 7fa4767fc700 1 -- 172.21.15.40:0/755510156 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c018440 con 0x7fa47809bc50 2023-09-30T22:31:51.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.173+0000 7fa47e12e700 1 -- 172.21.15.40:0/755510156 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa47809bc50 msgr2=0x7fa47809c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:51.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.173+0000 7fa47e12e700 1 --2- 172.21.15.40:0/755510156 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa47809bc50 0x7fa47809c0c0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fa46c0098f0 tx=0x7fa46c009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:51.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.173+0000 7fa47e12e700 1 -- 172.21.15.40:0/755510156 shutdown_connections 2023-09-30T22:31:51.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.173+0000 7fa47e12e700 1 --2- 172.21.15.40:0/755510156 >> v2:172.21.15.40:3300/0 conn(0x7fa47809c600 0x7fa478138ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.173+0000 7fa47e12e700 1 --2- 172.21.15.40:0/755510156 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa478131d50 0x7fa478132120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.173+0000 7fa47e12e700 1 --2- 172.21.15.40:0/755510156 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa47809bc50 0x7fa47809c0c0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.173+0000 7fa47e12e700 1 -- 172.21.15.40:0/755510156 >> 172.21.15.40:0/755510156 conn(0x7fa4780a2a00 msgr2=0x7fa4780a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:51.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.173+0000 7fa47e12e700 1 -- 172.21.15.40:0/755510156 shutdown_connections 2023-09-30T22:31:51.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.173+0000 7fa47e12e700 1 -- 172.21.15.40:0/755510156 wait complete. 2023-09-30T22:31:51.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.174+0000 7fa47e12e700 1 Processor -- start 2023-09-30T22:31:51.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.174+0000 7fa47e12e700 1 -- start start 2023-09-30T22:31:51.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.174+0000 7fa47e12e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa47809bc50 0x7fa47806e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.174+0000 7fa47e12e700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa47809c600 0x7fa47806e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.174+0000 7fa47e12e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa478131d50 0x7fa47806ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.175+0000 7fa47e12e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa47806f3c0 con 0x7fa478131d50 2023-09-30T22:31:51.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.175+0000 7fa47e12e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa478070700 con 0x7fa47809bc50 2023-09-30T22:31:51.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.175+0000 7fa47e12e700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa47809fef0 con 0x7fa47809c600 2023-09-30T22:31:51.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.175+0000 7fa476ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa47809c600 0x7fa47806e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.175+0000 7fa477fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa478131d50 0x7fa47806ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.175+0000 7fa476ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa47809c600 0x7fa47806e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:37046/0 (socket says 172.21.15.40:37046) 2023-09-30T22:31:51.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.175+0000 7fa477fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa478131d50 0x7fa47806ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39152/0 (socket says 172.21.15.40:39152) 2023-09-30T22:31:51.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.175+0000 7fa476ffd700 1 -- 172.21.15.40:0/1411859783 learned_addr learned my addr 172.21.15.40:0/1411859783 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:51.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.175+0000 7fa477fff700 1 -- 172.21.15.40:0/1411859783 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa47809c600 msgr2=0x7fa47806e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:51.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.175+0000 7fa477fff700 1 --2- 172.21.15.40:0/1411859783 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa47809c600 0x7fa47806e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.175+0000 7fa477fff700 1 -- 172.21.15.40:0/1411859783 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa47809bc50 msgr2=0x7fa47806e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:51.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.175+0000 7fa477fff700 1 --2- 172.21.15.40:0/1411859783 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa47809bc50 0x7fa47806e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.175+0000 7fa477fff700 1 -- 172.21.15.40:0/1411859783 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa46c009550 con 0x7fa478131d50 2023-09-30T22:31:51.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.175+0000 7fa477fff700 1 --2- 172.21.15.40:0/1411859783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa478131d50 0x7fa47806ed10 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7fa47000eae0 tx=0x7fa47000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:51.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.175+0000 7fa45ffff700 1 -- 172.21.15.40:0/1411859783 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa470010040 con 0x7fa478131d50 2023-09-30T22:31:51.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.176+0000 7fa45ffff700 1 -- 172.21.15.40:0/1411859783 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47000b9f0 con 0x7fa478131d50 2023-09-30T22:31:51.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.176+0000 7fa47e12e700 1 -- 172.21.15.40:0/1411859783 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4780709e0 con 0x7fa478131d50 2023-09-30T22:31:51.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.176+0000 7fa45ffff700 1 -- 172.21.15.40:0/1411859783 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa470009a80 con 0x7fa478131d50 2023-09-30T22:31:51.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.176+0000 7fa47e12e700 1 -- 172.21.15.40:0/1411859783 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa47806f740 con 0x7fa478131d50 2023-09-30T22:31:51.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.177+0000 7fa45ffff700 1 -- 172.21.15.40:0/1411859783 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa47001d400 con 0x7fa478131d50 2023-09-30T22:31:51.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.177+0000 7fa47e12e700 1 -- 172.21.15.40:0/1411859783 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa478062380 con 0x7fa478131d50 2023-09-30T22:31:51.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.177+0000 7fa45ffff700 1 -- 172.21.15.40:0/1411859783 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa47003fda0 con 0x7fa478131d50 2023-09-30T22:31:51.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.182+0000 7fa45ffff700 1 -- 172.21.15.40:0/1411859783 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa470024300 con 0x7fa478131d50 2023-09-30T22:31:51.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.184+0000 7fb9c9aee700 1 Processor -- start 2023-09-30T22:31:51.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.184+0000 7fb9c9aee700 1 -- start start 2023-09-30T22:31:51.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.184+0000 7fb9c9aee700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9c406a6d0 0x7fb9c409d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.184+0000 7fb9c9aee700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb9c409e250 0x7fb9c413fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.184+0000 7fb9c9aee700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c411d980 con 0x7fb9c409de60 2023-09-30T22:31:51.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.184+0000 7fb9c9aee700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c406aaa0 con 0x7fb9c409e250 2023-09-30T22:31:51.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.184+0000 7fb9c9aee700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c406b150 con 0x7fb9c406a6d0 2023-09-30T22:31:51.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.185+0000 7fb9c3fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb9c409e250 0x7fb9c413fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.185+0000 7fb9c37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9c406a6d0 0x7fb9c409d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.185+0000 7fb9c3fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb9c409e250 0x7fb9c413fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39158/0 (socket says 172.21.15.40:39158) 2023-09-30T22:31:51.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.185+0000 7fb9c3fff700 1 -- 172.21.15.40:0/4080654916 learned_addr learned my addr 172.21.15.40:0/4080654916 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:51.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.185+0000 7fb9c37fe700 1 -- 172.21.15.40:0/4080654916 >> v2:172.21.15.40:3300/0 conn(0x7fb9c409e250 msgr2=0x7fb9c413fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:51.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.185+0000 7fb9c37fe700 1 --2- 172.21.15.40:0/4080654916 >> v2:172.21.15.40:3300/0 conn(0x7fb9c409e250 0x7fb9c413fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.185+0000 7fb9c37fe700 1 -- 172.21.15.40:0/4080654916 >> v1:172.21.15.40:6789/0 conn(0x7fb9c409de60 legacy=0x7fb9c413c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:51.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.185+0000 7fb9c37fe700 1 -- 172.21.15.40:0/4080654916 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c409f300 con 0x7fb9c406a6d0 2023-09-30T22:31:51.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.185+0000 7fb9c27fc700 1 -- 172.21.15.40:0/4080654916 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2988751266 0 0) 0x7fb9c411d980 con 0x7fb9c409de60 2023-09-30T22:31:51.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.185+0000 7fb9c37fe700 1 --2- 172.21.15.40:0/4080654916 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9c406a6d0 0x7fb9c409d920 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4009820 tx=0x7fb9b4009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7f1ffd481e18164 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:51.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.185+0000 7fb9c27fc700 1 -- 172.21.15.40:0/4080654916 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b4005e30 con 0x7fb9c406a6d0 2023-09-30T22:31:51.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.185+0000 7fb9c27fc700 1 -- 172.21.15.40:0/4080654916 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b4006030 con 0x7fb9c406a6d0 2023-09-30T22:31:51.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.185+0000 7fb9c27fc700 1 -- 172.21.15.40:0/4080654916 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b40063c0 con 0x7fb9c406a6d0 2023-09-30T22:31:51.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.186+0000 7fb9c9aee700 1 -- 172.21.15.40:0/4080654916 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9c406a6d0 msgr2=0x7fb9c409d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:51.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.186+0000 7fb9c9aee700 1 --2- 172.21.15.40:0/4080654916 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9c406a6d0 0x7fb9c409d920 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4009820 tx=0x7fb9b4009b30 comp rx=0 tx=0).stop 2023-09-30T22:31:51.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.186+0000 7fb9c9aee700 1 -- 172.21.15.40:0/4080654916 shutdown_connections 2023-09-30T22:31:51.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.186+0000 7fb9c9aee700 1 --2- 172.21.15.40:0/4080654916 >> v2:172.21.15.40:3300/0 conn(0x7fb9c409e250 0x7fb9c413fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.186+0000 7fb9c9aee700 1 --2- 172.21.15.40:0/4080654916 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9c406a6d0 0x7fb9c409d920 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.186+0000 7fb9c9aee700 1 -- 172.21.15.40:0/4080654916 >> 172.21.15.40:0/4080654916 conn(0x7fb9c409fb20 msgr2=0x7fb9c409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:51.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.186+0000 7fb9c9aee700 1 -- 172.21.15.40:0/4080654916 shutdown_connections 2023-09-30T22:31:51.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.186+0000 7fb9c9aee700 1 -- 172.21.15.40:0/4080654916 wait complete. 2023-09-30T22:31:51.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.187+0000 7fb9c9aee700 1 Processor -- start 2023-09-30T22:31:51.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.187+0000 7fb9c9aee700 1 -- start start 2023-09-30T22:31:51.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.188+0000 7fb9c9aee700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9c406a6d0 0x7fb9c4132190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.188+0000 7fb9c9aee700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9c409de60 0x7fb9c411ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.188+0000 7fb9c9aee700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9c409e250 0x7fb9c411ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:51.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.188+0000 7fb9c9aee700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c41206e0 con 0x7fb9c406a6d0 2023-09-30T22:31:51.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.188+0000 7fb9c9aee700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c41326d0 con 0x7fb9c409e250 2023-09-30T22:31:51.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.188+0000 7fb9c9aee700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c4120b80 con 0x7fb9c409de60 2023-09-30T22:31:51.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.188+0000 7fb9c37fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9c406a6d0 0x7fb9c4132190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.188+0000 7fb9c37fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9c406a6d0 0x7fb9c4132190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39172/0 (socket says 172.21.15.40:39172) 2023-09-30T22:31:51.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.188+0000 7fb9c37fe700 1 -- 172.21.15.40:0/604922517 learned_addr learned my addr 172.21.15.40:0/604922517 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:51.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.188+0000 7fb9c2ffd700 1 --2- 172.21.15.40:0/604922517 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9c409de60 0x7fb9c411ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.188+0000 7fb9c3fff700 1 --2- 172.21.15.40:0/604922517 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9c409e250 0x7fb9c411ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:51.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.189+0000 7fb9c37fe700 1 -- 172.21.15.40:0/604922517 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9c409de60 msgr2=0x7fb9c411ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:51.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.189+0000 7fb9c37fe700 1 --2- 172.21.15.40:0/604922517 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9c409de60 0x7fb9c411ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.189+0000 7fb9c37fe700 1 -- 172.21.15.40:0/604922517 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9c409e250 msgr2=0x7fb9c411ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:51.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.189+0000 7fb9c37fe700 1 --2- 172.21.15.40:0/604922517 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9c409e250 0x7fb9c411ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.189+0000 7fb9c37fe700 1 -- 172.21.15.40:0/604922517 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b4009430 con 0x7fb9c406a6d0 2023-09-30T22:31:51.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.189+0000 7fb9c3fff700 1 --2- 172.21.15.40:0/604922517 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9c409e250 0x7fb9c411ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:51.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.189+0000 7fb9c2ffd700 1 --2- 172.21.15.40:0/604922517 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9c409de60 0x7fb9c411ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:51.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.189+0000 7fb9c37fe700 1 --2- 172.21.15.40:0/604922517 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9c406a6d0 0x7fb9c4132190 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4000c00 tx=0x7fb9b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:51.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.189+0000 7fb9abfff700 1 -- 172.21.15.40:0/604922517 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b40061a0 con 0x7fb9c406a6d0 2023-09-30T22:31:51.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.189+0000 7fb9abfff700 1 -- 172.21.15.40:0/604922517 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b4020070 con 0x7fb9c406a6d0 2023-09-30T22:31:51.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.189+0000 7fb9abfff700 1 -- 172.21.15.40:0/604922517 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b4006540 con 0x7fb9c406a6d0 2023-09-30T22:31:51.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.189+0000 7fb9c9aee700 1 -- 172.21.15.40:0/604922517 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c40a24d0 con 0x7fb9c406a6d0 2023-09-30T22:31:51.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.189+0000 7fb9c9aee700 1 -- 172.21.15.40:0/604922517 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c4120dc0 con 0x7fb9c406a6d0 2023-09-30T22:31:51.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.190+0000 7fb9abfff700 1 -- 172.21.15.40:0/604922517 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb9b4022030 con 0x7fb9c406a6d0 2023-09-30T22:31:51.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.190+0000 7fb9abfff700 1 -- 172.21.15.40:0/604922517 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb9b4040d00 con 0x7fb9c406a6d0 2023-09-30T22:31:51.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.190+0000 7fb9c9aee700 1 -- 172.21.15.40:0/604922517 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c4121e60 con 0x7fb9c406a6d0 2023-09-30T22:31:51.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.195+0000 7fb9abfff700 1 -- 172.21.15.40:0/604922517 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb9b40066a0 con 0x7fb9c406a6d0 2023-09-30T22:31:51.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.367+0000 7fef4bc7e700 1 -- 172.21.15.40:0/3740885739 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fef4411faa0 con 0x7fef4409d920 2023-09-30T22:31:51.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.367+0000 7fef3a7fc700 1 -- 172.21.15.40:0/3740885739 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fef4411faa0 con 0x7fef4409d920 2023-09-30T22:31:51.368 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:51.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.370+0000 7fef4bc7e700 1 -- 172.21.15.40:0/3740885739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef4409d920 msgr2=0x7fef4411db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:51.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.370+0000 7fef4bc7e700 1 --2- 172.21.15.40:0/3740885739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef4409d920 0x7fef4411db40 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fef40000fd0 tx=0x7fef4000c6c0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.370+0000 7fef4bc7e700 1 -- 172.21.15.40:0/3740885739 shutdown_connections 2023-09-30T22:31:51.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.370+0000 7fef4bc7e700 1 --2- 172.21.15.40:0/3740885739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fef4411e5c0 0x7fef441ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.370+0000 7fef4bc7e700 1 --2- 172.21.15.40:0/3740885739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef4409d920 0x7fef4411db40 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.370+0000 7fef4bc7e700 1 --2- 172.21.15.40:0/3740885739 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fef4409e400 0x7fef4411e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.370+0000 7fef4bc7e700 1 -- 172.21.15.40:0/3740885739 >> 172.21.15.40:0/3740885739 conn(0x7fef4409fb20 msgr2=0x7fef4406e710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:51.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.370+0000 7fef4bc7e700 1 -- 172.21.15.40:0/3740885739 shutdown_connections 2023-09-30T22:31:51.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.370+0000 7fef4bc7e700 1 -- 172.21.15.40:0/3740885739 wait complete. 2023-09-30T22:31:51.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.381+0000 7fa47e12e700 1 -- 172.21.15.40:0/1411859783 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa478070840 con 0x7fa478131d50 2023-09-30T22:31:51.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.382+0000 7fa45ffff700 1 -- 172.21.15.40:0/1411859783 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa478070840 con 0x7fa478131d50 2023-09-30T22:31:51.383 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:51.384 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:51.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.385+0000 7fa47e12e700 1 -- 172.21.15.40:0/1411859783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa478131d50 msgr2=0x7fa47806ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:51.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.385+0000 7fa47e12e700 1 --2- 172.21.15.40:0/1411859783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa478131d50 0x7fa47806ed10 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7fa47000eae0 tx=0x7fa47000edf0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.385+0000 7fa47e12e700 1 -- 172.21.15.40:0/1411859783 shutdown_connections 2023-09-30T22:31:51.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.385+0000 7fa47e12e700 1 --2- 172.21.15.40:0/1411859783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa478131d50 0x7fa47806ed10 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.385+0000 7fa47e12e700 1 --2- 172.21.15.40:0/1411859783 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa47809bc50 0x7fa47806e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.385+0000 7fa47e12e700 1 --2- 172.21.15.40:0/1411859783 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa47809c600 0x7fa47806e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.385+0000 7fa47e12e700 1 -- 172.21.15.40:0/1411859783 >> 172.21.15.40:0/1411859783 conn(0x7fa4780a2a00 msgr2=0x7fa47812b860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:51.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.385+0000 7fa47e12e700 1 -- 172.21.15.40:0/1411859783 shutdown_connections 2023-09-30T22:31:51.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.385+0000 7fa47e12e700 1 -- 172.21.15.40:0/1411859783 wait complete. 2023-09-30T22:31:51.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.394+0000 7fb9c9aee700 1 -- 172.21.15.40:0/604922517 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb9c409dc80 con 0x7fb9c406a6d0 2023-09-30T22:31:51.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.395+0000 7fb9abfff700 1 -- 172.21.15.40:0/604922517 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb9b401b410 con 0x7fb9c406a6d0 2023-09-30T22:31:51.395 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:51.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.397+0000 7fb9c9aee700 1 -- 172.21.15.40:0/604922517 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9c406a6d0 msgr2=0x7fb9c4132190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:51.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.397+0000 7fb9c9aee700 1 --2- 172.21.15.40:0/604922517 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9c406a6d0 0x7fb9c4132190 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4000c00 tx=0x7fb9b4004750 comp rx=0 tx=0).stop 2023-09-30T22:31:51.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.397+0000 7fb9c9aee700 1 -- 172.21.15.40:0/604922517 shutdown_connections 2023-09-30T22:31:51.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.397+0000 7fb9c9aee700 1 --2- 172.21.15.40:0/604922517 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb9c409e250 0x7fb9c411ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.397+0000 7fb9c9aee700 1 --2- 172.21.15.40:0/604922517 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9c406a6d0 0x7fb9c4132190 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.397+0000 7fb9c9aee700 1 --2- 172.21.15.40:0/604922517 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb9c409de60 0x7fb9c411ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.397+0000 7fb9c9aee700 1 -- 172.21.15.40:0/604922517 >> 172.21.15.40:0/604922517 conn(0x7fb9c409fb20 msgr2=0x7fb9c4070a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:51.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.397+0000 7fb9c9aee700 1 -- 172.21.15.40:0/604922517 shutdown_connections 2023-09-30T22:31:51.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.397+0000 7fb9c9aee700 1 -- 172.21.15.40:0/604922517 wait complete. 2023-09-30T22:31:51.399 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:51.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.408+0000 7f6595073700 1 -- 172.21.15.40:0/4076212769 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f659011be70 con 0x7f659009d400 2023-09-30T22:31:51.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.408+0000 7f65777fe700 1 -- 172.21.15.40:0/4076212769 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6580015070 con 0x7f659009d400 2023-09-30T22:31:51.409 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:51.410 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:51.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.410+0000 7f6595073700 1 -- 172.21.15.40:0/4076212769 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f659009d400 msgr2=0x7f6590119050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:51.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.410+0000 7f6595073700 1 --2- 172.21.15.40:0/4076212769 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f659009d400 0x7f6590119050 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f659009b000 tx=0x7f6580004750 comp rx=0 tx=0).stop 2023-09-30T22:31:51.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.410+0000 7f6595073700 1 -- 172.21.15.40:0/4076212769 shutdown_connections 2023-09-30T22:31:51.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.410+0000 7f6595073700 1 --2- 172.21.15.40:0/4076212769 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f659009d400 0x7f6590119050 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.410+0000 7f6595073700 1 --2- 172.21.15.40:0/4076212769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6590133e00 0x7f6590119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.410+0000 7f6595073700 1 --2- 172.21.15.40:0/4076212769 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f659009dd70 0x7f6590119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:51.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.411+0000 7f6595073700 1 -- 172.21.15.40:0/4076212769 >> 172.21.15.40:0/4076212769 conn(0x7f65900a2a00 msgr2=0x7f659012d740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:51.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.411+0000 7f6595073700 1 -- 172.21.15.40:0/4076212769 shutdown_connections 2023-09-30T22:31:51.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:51.411+0000 7f6595073700 1 -- 172.21.15.40:0/4076212769 wait complete. 2023-09-30T22:31:51.423 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:52.384 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:52.400 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:52.411 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:52.425 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:52.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.535+0000 7f78bf53f700 1 Processor -- start 2023-09-30T22:31:52.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.535+0000 7f78bf53f700 1 -- start start 2023-09-30T22:31:52.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.535+0000 7f78bf53f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78b809d920 0x7f78b809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:52.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.535+0000 7f78bf53f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f78b809e230 0x7f78b81343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:52.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.535+0000 7f78bf53f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b809f940 con 0x7f78b809f0f0 2023-09-30T22:31:52.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.535+0000 7f78bf53f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78b806b4c0 con 0x7f78b809e230 2023-09-30T22:31:52.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.535+0000 7f78bf53f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b809a8f0 con 0x7f78b809d920 2023-09-30T22:31:52.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.536+0000 7f78bcada700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f78b809f0f0 0x7f78b8133ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:35324/0 (socket says 172.21.15.40:35324) 2023-09-30T22:31:52.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.536+0000 7f78bcada700 1 -- 172.21.15.40:0/3538048669 learned_addr learned my addr 172.21.15.40:0/3538048669 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:52.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.536+0000 7f78bdadc700 1 --2- 172.21.15.40:0/3538048669 >> v2:172.21.15.40:3300/0 conn(0x7f78b809e230 0x7f78b81343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:52.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.536+0000 7f78bd2db700 1 --2- 172.21.15.40:0/3538048669 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78b809d920 0x7f78b809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:52.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.536+0000 7f78bdadc700 1 -- 172.21.15.40:0/3538048669 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78b809d920 msgr2=0x7f78b809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:52.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.536+0000 7f78bdadc700 1 --2- 172.21.15.40:0/3538048669 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78b809d920 0x7f78b809dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.536+0000 7f78bdadc700 1 -- 172.21.15.40:0/3538048669 >> v1:172.21.15.40:6789/0 conn(0x7f78b809f0f0 legacy=0x7f78b8133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:52.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.536+0000 7f78bdadc700 1 -- 172.21.15.40:0/3538048669 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b809f6e0 con 0x7f78b809e230 2023-09-30T22:31:52.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.536+0000 7f78bdadc700 1 --2- 172.21.15.40:0/3538048669 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78b809e230 0x7f78b81343b0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f78b0009dc0 tx=0x7f78b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fdf9811a1759abd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:52.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.536+0000 7f78affff700 1 -- 172.21.15.40:0/3538048669 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b000e070 con 0x7f78b809e230 2023-09-30T22:31:52.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.537+0000 7f78affff700 1 -- 172.21.15.40:0/3538048669 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b000bae0 con 0x7f78b809e230 2023-09-30T22:31:52.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.537+0000 7f78affff700 1 -- 172.21.15.40:0/3538048669 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b000be90 con 0x7f78b809e230 2023-09-30T22:31:52.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.537+0000 7f78bf53f700 1 -- 172.21.15.40:0/3538048669 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78b809e230 msgr2=0x7f78b81343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:52.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.537+0000 7f78bf53f700 1 --2- 172.21.15.40:0/3538048669 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78b809e230 0x7f78b81343b0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f78b0009dc0 tx=0x7f78b000b330 comp rx=0 tx=0).stop 2023-09-30T22:31:52.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.537+0000 7f78bf53f700 1 -- 172.21.15.40:0/3538048669 shutdown_connections 2023-09-30T22:31:52.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.537+0000 7f78bf53f700 1 --2- 172.21.15.40:0/3538048669 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78b809e230 0x7f78b81343b0 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.537+0000 7f78bf53f700 1 --2- 172.21.15.40:0/3538048669 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78b809d920 0x7f78b809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.537+0000 7f78bf53f700 1 -- 172.21.15.40:0/3538048669 >> 172.21.15.40:0/3538048669 conn(0x7f78b809fb20 msgr2=0x7f78b809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:52.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.537+0000 7f78bf53f700 1 -- 172.21.15.40:0/3538048669 shutdown_connections 2023-09-30T22:31:52.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.537+0000 7f78bf53f700 1 -- 172.21.15.40:0/3538048669 wait complete. 2023-09-30T22:31:52.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.538+0000 7f78bf53f700 1 Processor -- start 2023-09-30T22:31:52.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.538+0000 7f78bf53f700 1 -- start start 2023-09-30T22:31:52.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.539+0000 7f78bf53f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78b809d920 0x7f78b81a6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:52.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.539+0000 7f78bf53f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78b809e230 0x7f78b81a65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:52.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.539+0000 7f78bf53f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f78b81b9480 0x7f78b81a6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:52.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.539+0000 7f78bf53f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b81a93d0 con 0x7f78b809e230 2023-09-30T22:31:52.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.539+0000 7f78bf53f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b81aa570 con 0x7f78b809d920 2023-09-30T22:31:52.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.539+0000 7f78bf53f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78b81a7d40 con 0x7f78b81b9480 2023-09-30T22:31:52.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.539+0000 7f78bdadc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f78b81b9480 0x7f78b81a6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:52.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.539+0000 7f78bdadc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f78b81b9480 0x7f78b81a6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:37076/0 (socket says 172.21.15.40:37076) 2023-09-30T22:31:52.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.539+0000 7f78bdadc700 1 -- 172.21.15.40:0/4189299110 learned_addr learned my addr 172.21.15.40:0/4189299110 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:52.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.539+0000 7f78bd2db700 1 --2- 172.21.15.40:0/4189299110 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78b809d920 0x7f78b81a6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:52.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.539+0000 7f78bcada700 1 --2- 172.21.15.40:0/4189299110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78b809e230 0x7f78b81a65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:52.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.540+0000 7f78bdadc700 1 -- 172.21.15.40:0/4189299110 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78b809d920 msgr2=0x7f78b81a6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:52.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.540+0000 7f78bdadc700 1 --2- 172.21.15.40:0/4189299110 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78b809d920 0x7f78b81a6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.540+0000 7f78bdadc700 1 -- 172.21.15.40:0/4189299110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78b809e230 msgr2=0x7f78b81a65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:52.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.540+0000 7f78bdadc700 1 --2- 172.21.15.40:0/4189299110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78b809e230 0x7f78b81a65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.540+0000 7f78bdadc700 1 -- 172.21.15.40:0/4189299110 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b0009a70 con 0x7f78b81b9480 2023-09-30T22:31:52.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.540+0000 7f78bdadc700 1 --2- 172.21.15.40:0/4189299110 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f78b81b9480 0x7f78b81a6b10 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f78b809b7b0 tx=0x7f78b0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:52.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.540+0000 7f78adffb700 1 -- 172.21.15.40:0/4189299110 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b00045d0 con 0x7f78b81b9480 2023-09-30T22:31:52.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.540+0000 7f78adffb700 1 -- 172.21.15.40:0/4189299110 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b0028070 con 0x7f78b81b9480 2023-09-30T22:31:52.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.540+0000 7f78adffb700 1 -- 172.21.15.40:0/4189299110 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b0004970 con 0x7f78b81b9480 2023-09-30T22:31:52.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.541+0000 7f78bf53f700 1 -- 172.21.15.40:0/4189299110 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b81a98d0 con 0x7f78b81b9480 2023-09-30T22:31:52.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.541+0000 7f78bf53f700 1 -- 172.21.15.40:0/4189299110 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b81a8ef0 con 0x7f78b81b9480 2023-09-30T22:31:52.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.542+0000 7f78bf53f700 1 -- 172.21.15.40:0/4189299110 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b8062380 con 0x7f78b81b9480 2023-09-30T22:31:52.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.542+0000 7f78adffb700 1 -- 172.21.15.40:0/4189299110 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f78b0012430 con 0x7f78b81b9480 2023-09-30T22:31:52.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.542+0000 7f78adffb700 1 -- 172.21.15.40:0/4189299110 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f78b002a070 con 0x7f78b81b9480 2023-09-30T22:31:52.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.547+0000 7f78adffb700 1 -- 172.21.15.40:0/4189299110 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f78b001b400 con 0x7f78b81b9480 2023-09-30T22:31:52.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.571+0000 7f377880c700 1 Processor -- start 2023-09-30T22:31:52.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.571+0000 7f377880c700 1 -- start start 2023-09-30T22:31:52.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.571+0000 7f9d16fcf700 1 Processor -- start 2023-09-30T22:31:52.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.571+0000 7f9d16fcf700 1 -- start start 2023-09-30T22:31:52.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.572+0000 7f9d16fcf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9d1009c890 0x7f9d1009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:52.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.572+0000 7f377880c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f377409d920 0x7f377409dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:52.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.572+0000 7f377880c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f377409f0f0 0x7f377409e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:52.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.572+0000 7f9d16fcf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d1009d920 0x7f9d1009dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:52.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.572+0000 7f9d16fcf700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d100a2600 con 0x7f9d1009e2b0 2023-09-30T22:31:52.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.572+0000 7f9d16fcf700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d100a29d0 con 0x7f9d1009c890 2023-09-30T22:31:52.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.572+0000 7f9d16fcf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1009fb40 con 0x7f9d1009d920 2023-09-30T22:31:52.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.572+0000 7f377880c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f377409f940 con 0x7f3774133ca0 2023-09-30T22:31:52.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.572+0000 7f377880c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377406b4c0 con 0x7f377409d920 2023-09-30T22:31:52.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.572+0000 7f377880c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f377409a8f0 con 0x7f377409f0f0 2023-09-30T22:31:52.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.572+0000 7f3771d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f377409f0f0 0x7f377409e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:52.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.572+0000 7f3771d9b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f377409f0f0 0x7f377409e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:37080/0 (socket says 172.21.15.40:37080) 2023-09-30T22:31:52.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.572+0000 7f3771d9b700 1 -- 172.21.15.40:0/2860597777 learned_addr learned my addr 172.21.15.40:0/2860597777 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:52.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.572+0000 7f3771d9b700 1 -- 172.21.15.40:0/2860597777 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f377409d920 msgr2=0x7f377409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:52.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.572+0000 7f3771d9b700 1 --2- 172.21.15.40:0/2860597777 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f377409d920 0x7f377409dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.572+0000 7f3771d9b700 1 -- 172.21.15.40:0/2860597777 >> v1:172.21.15.40:6789/0 conn(0x7f3774133ca0 legacy=0x7f3774134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:52.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.572+0000 7f3771d9b700 1 -- 172.21.15.40:0/2860597777 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377409f6e0 con 0x7f377409f0f0 2023-09-30T22:31:52.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.573+0000 7f3771d9b700 1 --2- 172.21.15.40:0/2860597777 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f377409f0f0 0x7f377409e230 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f3768009950 tx=0x7f3768009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b75f81b2e11e366 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:52.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.573+0000 7f377159a700 1 -- 172.21.15.40:0/2860597777 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3768009ea0 con 0x7f377409f0f0 2023-09-30T22:31:52.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.573+0000 7f377159a700 1 -- 172.21.15.40:0/2860597777 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3768004230 con 0x7f377409f0f0 2023-09-30T22:31:52.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.573+0000 7f377159a700 1 -- 172.21.15.40:0/2860597777 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376800b7e0 con 0x7f377409f0f0 2023-09-30T22:31:52.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.573+0000 7f9d0ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d1009d920 0x7f9d1009dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:52.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.573+0000 7f9d0ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d1009d920 0x7f9d1009dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:58268/0 (socket says 172.21.15.40:58268) 2023-09-30T22:31:52.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.573+0000 7f9d0ffff700 1 -- 172.21.15.40:0/1477378515 learned_addr learned my addr 172.21.15.40:0/1477378515 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:52.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.573+0000 7f9d14d6b700 1 --2- 172.21.15.40:0/1477378515 >> v2:172.21.15.40:3300/0 conn(0x7f9d1009c890 0x7f9d1009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:52.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.573+0000 7f9d0ffff700 1 -- 172.21.15.40:0/1477378515 >> v2:172.21.15.40:3300/0 conn(0x7f9d1009c890 msgr2=0x7f9d1009cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:52.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.573+0000 7f9d0ffff700 1 --2- 172.21.15.40:0/1477378515 >> v2:172.21.15.40:3300/0 conn(0x7f9d1009c890 0x7f9d1009cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.573+0000 7f9d0ffff700 1 -- 172.21.15.40:0/1477378515 >> v1:172.21.15.40:6789/0 conn(0x7f9d1009e2b0 legacy=0x7f9d1013ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:52.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.573+0000 7f9d0ffff700 1 -- 172.21.15.40:0/1477378515 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1009e730 con 0x7f9d1009d920 2023-09-30T22:31:52.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.573+0000 7f9d14d6b700 1 --2- 172.21.15.40:0/1477378515 >> v2:172.21.15.40:3300/0 conn(0x7f9d1009c890 0x7f9d1009cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:31:52.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.574+0000 7f9d0ffff700 1 --2- 172.21.15.40:0/1477378515 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d1009d920 0x7f9d1009dd70 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc0098f0 tx=0x7f9cfc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6a0c2a76e16b307 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:52.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.574+0000 7f9d0f7fe700 1 -- 172.21.15.40:0/1477378515 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc004230 con 0x7f9d1009d920 2023-09-30T22:31:52.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.574+0000 7f377880c700 1 -- 172.21.15.40:0/2860597777 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f377409f0f0 msgr2=0x7f377409e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:52.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.574+0000 7f377880c700 1 --2- 172.21.15.40:0/2860597777 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f377409f0f0 0x7f377409e230 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f3768009950 tx=0x7f3768009c60 comp rx=0 tx=0).stop 2023-09-30T22:31:52.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.574+0000 7f9d0f7fe700 1 -- 172.21.15.40:0/1477378515 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cfc004390 con 0x7f9d1009d920 2023-09-30T22:31:52.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.574+0000 7f9d0f7fe700 1 -- 172.21.15.40:0/1477378515 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc0036a0 con 0x7f9d1009d920 2023-09-30T22:31:52.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.574+0000 7f377880c700 1 -- 172.21.15.40:0/2860597777 shutdown_connections 2023-09-30T22:31:52.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.574+0000 7f377880c700 1 --2- 172.21.15.40:0/2860597777 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f377409d920 0x7f377409dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.574+0000 7f377880c700 1 --2- 172.21.15.40:0/2860597777 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f377409f0f0 0x7f377409e230 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.574+0000 7f377880c700 1 -- 172.21.15.40:0/2860597777 >> 172.21.15.40:0/2860597777 conn(0x7f377409fb20 msgr2=0x7f377409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:52.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.574+0000 7f377880c700 1 -- 172.21.15.40:0/2860597777 shutdown_connections 2023-09-30T22:31:52.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.574+0000 7f377880c700 1 -- 172.21.15.40:0/2860597777 wait complete. 2023-09-30T22:31:52.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.575+0000 7f9d16fcf700 1 -- 172.21.15.40:0/1477378515 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d1009d920 msgr2=0x7f9d1009dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:52.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.575+0000 7f9d16fcf700 1 --2- 172.21.15.40:0/1477378515 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d1009d920 0x7f9d1009dd70 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc0098f0 tx=0x7f9cfc009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:52.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.575+0000 7f9d16fcf700 1 -- 172.21.15.40:0/1477378515 shutdown_connections 2023-09-30T22:31:52.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.575+0000 7f9d16fcf700 1 --2- 172.21.15.40:0/1477378515 >> v2:172.21.15.40:3300/0 conn(0x7f9d1009c890 0x7f9d1009cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.575+0000 7f9d16fcf700 1 --2- 172.21.15.40:0/1477378515 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d1009d920 0x7f9d1009dd70 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.575+0000 7f9d16fcf700 1 -- 172.21.15.40:0/1477378515 >> 172.21.15.40:0/1477378515 conn(0x7f9d100a7080 msgr2=0x7f9d100a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:52.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.575+0000 7f9d16fcf700 1 -- 172.21.15.40:0/1477378515 shutdown_connections 2023-09-30T22:31:52.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.575+0000 7f9d16fcf700 1 -- 172.21.15.40:0/1477378515 wait complete. 2023-09-30T22:31:52.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.576+0000 7f377880c700 1 Processor -- start 2023-09-30T22:31:52.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.576+0000 7f377880c700 1 -- start start 2023-09-30T22:31:52.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.576+0000 7f9d16fcf700 1 Processor -- start 2023-09-30T22:31:52.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.576+0000 7f9d16fcf700 1 -- start start 2023-09-30T22:31:52.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.576+0000 7f377880c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f377409d920 0x7f3774121910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:52.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.576+0000 7f377880c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3774133ca0 0x7f3774121e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:52.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.576+0000 7f377880c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3774122390 0x7f37741c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:52.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.576+0000 7f377880c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37741328f0 con 0x7f377409d920 2023-09-30T22:31:52.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.576+0000 7f377880c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3774125100 con 0x7f3774122390 2023-09-30T22:31:52.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.576+0000 7f377880c700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37741235e0 con 0x7f3774133ca0 2023-09-30T22:31:52.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.576+0000 7f9d16fcf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d1009c890 0x7f9d101c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:52.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.576+0000 7f9d16fcf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d1009d920 0x7f9d101c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:52.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.576+0000 7f9d16fcf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d1009e2b0 0x7f9d101c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:52.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.576+0000 7f9d16fcf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d101309f0 con 0x7f9d1009c890 2023-09-30T22:31:52.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.576+0000 7f9d16fcf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1008f4f0 con 0x7f9d1009e2b0 2023-09-30T22:31:52.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.576+0000 7f9d16fcf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d100a5cd0 con 0x7f9d1009d920 2023-09-30T22:31:52.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.577+0000 7f9d0ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d1009d920 0x7f9d101c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:52.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.577+0000 7f9d0ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d1009d920 0x7f9d101c8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:37090/0 (socket says 172.21.15.40:37090) 2023-09-30T22:31:52.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.577+0000 7f9d0ffff700 1 -- 172.21.15.40:0/1210705680 learned_addr learned my addr 172.21.15.40:0/1210705680 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:52.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.577+0000 7f9d14d6b700 1 --2- 172.21.15.40:0/1210705680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d1009c890 0x7f9d101c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:52.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.577+0000 7f9d1556c700 1 --2- 172.21.15.40:0/1210705680 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d1009e2b0 0x7f9d101c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:52.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.577+0000 7f377259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f377409d920 0x7f3774121910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:52.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.577+0000 7f377259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f377409d920 0x7f3774121910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39196/0 (socket says 172.21.15.40:39196) 2023-09-30T22:31:52.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.577+0000 7f377259c700 1 -- 172.21.15.40:0/4017503092 learned_addr learned my addr 172.21.15.40:0/4017503092 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:52.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.577+0000 7f3772d9d700 1 --2- 172.21.15.40:0/4017503092 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3774122390 0x7f37741c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:52.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.577+0000 7f9d14d6b700 1 -- 172.21.15.40:0/1210705680 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d1009d920 msgr2=0x7f9d101c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:52.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.577+0000 7f9d14d6b700 1 --2- 172.21.15.40:0/1210705680 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d1009d920 0x7f9d101c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.577+0000 7f9d14d6b700 1 -- 172.21.15.40:0/1210705680 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d1009e2b0 msgr2=0x7f9d101c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:52.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.577+0000 7f9d14d6b700 1 --2- 172.21.15.40:0/1210705680 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d1009e2b0 0x7f9d101c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.577+0000 7f9d14d6b700 1 -- 172.21.15.40:0/1210705680 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cfc009550 con 0x7f9d1009c890 2023-09-30T22:31:52.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.577+0000 7f3772d9d700 1 -- 172.21.15.40:0/4017503092 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3774133ca0 msgr2=0x7f3774121e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:52.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.577+0000 7f3772d9d700 1 --2- 172.21.15.40:0/4017503092 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3774133ca0 0x7f3774121e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.577+0000 7f3772d9d700 1 -- 172.21.15.40:0/4017503092 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f377409d920 msgr2=0x7f3774121910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:52.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.577+0000 7f3772d9d700 1 --2- 172.21.15.40:0/4017503092 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f377409d920 0x7f3774121910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.577+0000 7f3772d9d700 1 -- 172.21.15.40:0/4017503092 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3768009550 con 0x7f3774122390 2023-09-30T22:31:52.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.577+0000 7f9d14d6b700 1 --2- 172.21.15.40:0/1210705680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d1009c890 0x7f9d101c89e0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f9d0400e810 tx=0x7f9d0400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:52.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.577+0000 7f3772d9d700 1 --2- 172.21.15.40:0/4017503092 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3774122390 0x7f37741c88f0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f376c00c780 tx=0x7f376c00ca90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:52.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.578+0000 7f9d0d7fa700 1 -- 172.21.15.40:0/1210705680 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d04005c20 con 0x7f9d1009c890 2023-09-30T22:31:52.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.578+0000 7f9d0d7fa700 1 -- 172.21.15.40:0/1210705680 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d04005d80 con 0x7f9d1009c890 2023-09-30T22:31:52.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.578+0000 7f9d0d7fa700 1 -- 172.21.15.40:0/1210705680 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d04006270 con 0x7f9d1009c890 2023-09-30T22:31:52.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.578+0000 7f3762ffd700 1 -- 172.21.15.40:0/4017503092 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c003e10 con 0x7f3774122390 2023-09-30T22:31:52.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.578+0000 7f3762ffd700 1 -- 172.21.15.40:0/4017503092 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376c0050f0 con 0x7f3774122390 2023-09-30T22:31:52.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.578+0000 7f377880c700 1 -- 172.21.15.40:0/4017503092 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f377409c9e0 con 0x7f3774122390 2023-09-30T22:31:52.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.578+0000 7f9d16fcf700 1 -- 172.21.15.40:0/1210705680 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d1009ecf0 con 0x7f9d1009c890 2023-09-30T22:31:52.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.578+0000 7f9d16fcf700 1 -- 172.21.15.40:0/1210705680 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d1009bbd0 con 0x7f9d1009c890 2023-09-30T22:31:52.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.578+0000 7f377880c700 1 -- 172.21.15.40:0/4017503092 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37741323e0 con 0x7f3774122390 2023-09-30T22:31:52.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.579+0000 7f9d16fcf700 1 -- 172.21.15.40:0/1210705680 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d10062380 con 0x7f9d1009c890 2023-09-30T22:31:52.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.579+0000 7f3762ffd700 1 -- 172.21.15.40:0/4017503092 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c0054a0 con 0x7f3774122390 2023-09-30T22:31:52.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.579+0000 7f377880c700 1 -- 172.21.15.40:0/4017503092 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3774125c30 con 0x7f3774122390 2023-09-30T22:31:52.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.579+0000 7fefd4c86700 1 Processor -- start 2023-09-30T22:31:52.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.579+0000 7fefd4c86700 1 -- start start 2023-09-30T22:31:52.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.580+0000 7f9d0d7fa700 1 -- 172.21.15.40:0/1210705680 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d040063d0 con 0x7f9d1009c890 2023-09-30T22:31:52.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.580+0000 7f9d0d7fa700 1 -- 172.21.15.40:0/1210705680 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9d0403f080 con 0x7f9d1009c890 2023-09-30T22:31:52.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.580+0000 7f3762ffd700 1 -- 172.21.15.40:0/4017503092 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f376c005600 con 0x7f3774122390 2023-09-30T22:31:52.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.580+0000 7f3762ffd700 1 -- 172.21.15.40:0/4017503092 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f376c03eee0 con 0x7f3774122390 2023-09-30T22:31:52.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.580+0000 7fefd4c86700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefd009da20 0x7fefd009ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:52.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.580+0000 7fefd4c86700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fefd0130d10 0x7fefd0138970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:52.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.580+0000 7fefd4c86700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd009bae0 con 0x7fefd009b180 2023-09-30T22:31:52.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.580+0000 7fefd4c86700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefd009e5f0 con 0x7fefd0130d10 2023-09-30T22:31:52.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.580+0000 7fefd4c86700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fefd009e370 con 0x7fefd009da20 2023-09-30T22:31:52.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.580+0000 7fefced9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fefd0130d10 0x7fefd0138970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:52.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.580+0000 7fefce59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefd009da20 0x7fefd009ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:52.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.581+0000 7fefce59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefd009da20 0x7fefd009ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:37102/0 (socket says 172.21.15.40:37102) 2023-09-30T22:31:52.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.581+0000 7fefced9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fefd0130d10 0x7fefd0138970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39222/0 (socket says 172.21.15.40:39222) 2023-09-30T22:31:52.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.581+0000 7fefcdd9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fefd009b180 0x7fefd0130600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:35354/0 (socket says 172.21.15.40:35354) 2023-09-30T22:31:52.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.581+0000 7fefce59c700 1 -- 172.21.15.40:0/3878202948 learned_addr learned my addr 172.21.15.40:0/3878202948 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:52.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.581+0000 7fefce59c700 1 -- 172.21.15.40:0/3878202948 >> v2:172.21.15.40:3300/0 conn(0x7fefd0130d10 msgr2=0x7fefd0138970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:52.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.581+0000 7fefce59c700 1 --2- 172.21.15.40:0/3878202948 >> v2:172.21.15.40:3300/0 conn(0x7fefd0130d10 0x7fefd0138970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.581+0000 7fefce59c700 1 -- 172.21.15.40:0/3878202948 >> v1:172.21.15.40:6789/0 conn(0x7fefd009b180 legacy=0x7fefd0130600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:52.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.581+0000 7fefce59c700 1 -- 172.21.15.40:0/3878202948 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd009a620 con 0x7fefd009da20 2023-09-30T22:31:52.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.581+0000 7fefced9d700 1 --2- 172.21.15.40:0/3878202948 >> v2:172.21.15.40:3300/0 conn(0x7fefd0130d10 0x7fefd0138970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:52.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.581+0000 7fefce59c700 1 --2- 172.21.15.40:0/3878202948 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefd009da20 0x7fefd009ac40 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fefc0006fd0 tx=0x7fefc0009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f3d73e5fa14a15e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:52.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.581+0000 7fefcd59a700 1 -- 172.21.15.40:0/3878202948 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc0005e30 con 0x7fefd009da20 2023-09-30T22:31:52.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.581+0000 7fefcd59a700 1 -- 172.21.15.40:0/3878202948 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc0004030 con 0x7fefd009da20 2023-09-30T22:31:52.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.581+0000 7fefcd59a700 1 -- 172.21.15.40:0/3878202948 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc00043e0 con 0x7fefd009da20 2023-09-30T22:31:52.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.582+0000 7fefd4c86700 1 -- 172.21.15.40:0/3878202948 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefd009da20 msgr2=0x7fefd009ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:52.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.582+0000 7fefd4c86700 1 --2- 172.21.15.40:0/3878202948 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefd009da20 0x7fefd009ac40 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fefc0006fd0 tx=0x7fefc0009bd0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.582+0000 7fefd4c86700 1 -- 172.21.15.40:0/3878202948 shutdown_connections 2023-09-30T22:31:52.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.582+0000 7fefd4c86700 1 --2- 172.21.15.40:0/3878202948 >> v2:172.21.15.40:3300/0 conn(0x7fefd0130d10 0x7fefd0138970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.582+0000 7fefd4c86700 1 --2- 172.21.15.40:0/3878202948 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefd009da20 0x7fefd009ac40 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.582+0000 7fefd4c86700 1 -- 172.21.15.40:0/3878202948 >> 172.21.15.40:0/3878202948 conn(0x7fefd009eb10 msgr2=0x7fefd009ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:52.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.582+0000 7fefd4c86700 1 -- 172.21.15.40:0/3878202948 shutdown_connections 2023-09-30T22:31:52.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.582+0000 7fefd4c86700 1 -- 172.21.15.40:0/3878202948 wait complete. 2023-09-30T22:31:52.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.584+0000 7fefd4c86700 1 Processor -- start 2023-09-30T22:31:52.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.584+0000 7fefd4c86700 1 -- start start 2023-09-30T22:31:52.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.585+0000 7fefd4c86700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefd009b180 0x7fefd01270d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:52.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.585+0000 7fefd4c86700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefd009da20 0x7fefd0127610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:52.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.585+0000 7fefd4c86700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefd0130d10 0x7fefd0127b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:52.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.585+0000 7fefd4c86700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd012a2b0 con 0x7fefd0130d10 2023-09-30T22:31:52.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.585+0000 7fefd4c86700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd012a500 con 0x7fefd009da20 2023-09-30T22:31:52.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.585+0000 7fefd4c86700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fefd01293f0 con 0x7fefd009b180 2023-09-30T22:31:52.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.585+0000 7fefce59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefd009b180 0x7fefd01270d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:52.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.585+0000 7fefce59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefd009b180 0x7fefd01270d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:37108/0 (socket says 172.21.15.40:37108) 2023-09-30T22:31:52.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.585+0000 7fefce59c700 1 -- 172.21.15.40:0/3732717433 learned_addr learned my addr 172.21.15.40:0/3732717433 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:52.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.585+0000 7fefced9d700 1 --2- 172.21.15.40:0/3732717433 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefd0130d10 0x7fefd0127b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:52.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.585+0000 7f3762ffd700 1 -- 172.21.15.40:0/4017503092 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f376c00e280 con 0x7f3774122390 2023-09-30T22:31:52.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.586+0000 7f9d0d7fa700 1 -- 172.21.15.40:0/1210705680 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d040228f0 con 0x7f9d1009c890 2023-09-30T22:31:52.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.586+0000 7fefce59c700 1 -- 172.21.15.40:0/3732717433 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefd009da20 msgr2=0x7fefd0127610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:52.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.586+0000 7fefce59c700 1 --2- 172.21.15.40:0/3732717433 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefd009da20 0x7fefd0127610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.586+0000 7fefce59c700 1 -- 172.21.15.40:0/3732717433 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefd0130d10 msgr2=0x7fefd0127b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:52.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.586+0000 7fefce59c700 1 --2- 172.21.15.40:0/3732717433 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefd0130d10 0x7fefd0127b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.586+0000 7fefce59c700 1 -- 172.21.15.40:0/3732717433 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc40094a0 con 0x7fefd009b180 2023-09-30T22:31:52.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.586+0000 7fefce59c700 1 --2- 172.21.15.40:0/3732717433 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefd009b180 0x7fefd01270d0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fefc0000c00 tx=0x7fefc0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:52.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.586+0000 7fefbeffd700 1 -- 172.21.15.40:0/3732717433 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc001c620 con 0x7fefd009b180 2023-09-30T22:31:52.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.586+0000 7fefbeffd700 1 -- 172.21.15.40:0/3732717433 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc001c780 con 0x7fefd009b180 2023-09-30T22:31:52.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.586+0000 7fefd4c86700 1 -- 172.21.15.40:0/3732717433 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefc0009500 con 0x7fefd009b180 2023-09-30T22:31:52.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.586+0000 7fefbeffd700 1 -- 172.21.15.40:0/3732717433 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc001cb10 con 0x7fefd009b180 2023-09-30T22:31:52.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.586+0000 7fefd4c86700 1 -- 172.21.15.40:0/3732717433 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd0128690 con 0x7fefd009b180 2023-09-30T22:31:52.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.587+0000 7fefd4c86700 1 -- 172.21.15.40:0/3732717433 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefd0062380 con 0x7fefd009b180 2023-09-30T22:31:52.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.588+0000 7fefbeffd700 1 -- 172.21.15.40:0/3732717433 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fefc001cc70 con 0x7fefd009b180 2023-09-30T22:31:52.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.589+0000 7fefbeffd700 1 -- 172.21.15.40:0/3732717433 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fefc0040ca0 con 0x7fefd009b180 2023-09-30T22:31:52.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.597+0000 7fefbeffd700 1 -- 172.21.15.40:0/3732717433 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fefc002e9d0 con 0x7fefd009b180 2023-09-30T22:31:52.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.770+0000 7f78bf53f700 1 -- 172.21.15.40:0/4189299110 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f78b81a9570 con 0x7f78b81b9480 2023-09-30T22:31:52.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.771+0000 7f78adffb700 1 -- 172.21.15.40:0/4189299110 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f78b0034020 con 0x7f78b81b9480 2023-09-30T22:31:52.773 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:52.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.774+0000 7f78bf53f700 1 -- 172.21.15.40:0/4189299110 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f78b81b9480 msgr2=0x7f78b81a6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:52.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.774+0000 7f78bf53f700 1 --2- 172.21.15.40:0/4189299110 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f78b81b9480 0x7f78b81a6b10 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f78b809b7b0 tx=0x7f78b0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.774+0000 7f78bf53f700 1 -- 172.21.15.40:0/4189299110 shutdown_connections 2023-09-30T22:31:52.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.774+0000 7f78bf53f700 1 --2- 172.21.15.40:0/4189299110 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f78b81b9480 0x7f78b81a6b10 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.774+0000 7f78bf53f700 1 --2- 172.21.15.40:0/4189299110 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f78b809d920 0x7f78b81a6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.774+0000 7f78bf53f700 1 --2- 172.21.15.40:0/4189299110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78b809e230 0x7f78b81a65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.774+0000 7f78bf53f700 1 -- 172.21.15.40:0/4189299110 >> 172.21.15.40:0/4189299110 conn(0x7f78b809fb20 msgr2=0x7f78b81bb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:52.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.775+0000 7f78bf53f700 1 -- 172.21.15.40:0/4189299110 shutdown_connections 2023-09-30T22:31:52.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.775+0000 7f78bf53f700 1 -- 172.21.15.40:0/4189299110 wait complete. 2023-09-30T22:31:52.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.788+0000 7f377880c700 1 -- 172.21.15.40:0/4017503092 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3774062380 con 0x7f3774122390 2023-09-30T22:31:52.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.788+0000 7f3762ffd700 1 -- 172.21.15.40:0/4017503092 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f376c017020 con 0x7f3774122390 2023-09-30T22:31:52.790 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:52.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.790+0000 7f9d16fcf700 1 -- 172.21.15.40:0/1210705680 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9d10074620 con 0x7f9d1009c890 2023-09-30T22:31:52.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.791+0000 7f9d0d7fa700 1 -- 172.21.15.40:0/1210705680 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9d04022300 con 0x7f9d1009c890 2023-09-30T22:31:52.792 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:52.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.791+0000 7f377880c700 1 -- 172.21.15.40:0/4017503092 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3774122390 msgr2=0x7f37741c88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:52.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.791+0000 7f377880c700 1 --2- 172.21.15.40:0/4017503092 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3774122390 0x7f37741c88f0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f376c00c780 tx=0x7f376c00ca90 comp rx=0 tx=0).stop 2023-09-30T22:31:52.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.791+0000 7f377880c700 1 -- 172.21.15.40:0/4017503092 shutdown_connections 2023-09-30T22:31:52.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.791+0000 7f377880c700 1 --2- 172.21.15.40:0/4017503092 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3774122390 0x7f37741c88f0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.791+0000 7f377880c700 1 --2- 172.21.15.40:0/4017503092 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f377409d920 0x7f3774121910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.791+0000 7f377880c700 1 --2- 172.21.15.40:0/4017503092 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3774133ca0 0x7f3774121e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.795 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:52.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.791+0000 7f377880c700 1 -- 172.21.15.40:0/4017503092 >> 172.21.15.40:0/4017503092 conn(0x7f377409fb20 msgr2=0x7f37740a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:52.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.791+0000 7f377880c700 1 -- 172.21.15.40:0/4017503092 shutdown_connections 2023-09-30T22:31:52.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.791+0000 7f377880c700 1 -- 172.21.15.40:0/4017503092 wait complete. 2023-09-30T22:31:52.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.793+0000 7f9d16fcf700 1 -- 172.21.15.40:0/1210705680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d1009c890 msgr2=0x7f9d101c89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:52.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.793+0000 7f9d16fcf700 1 --2- 172.21.15.40:0/1210705680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d1009c890 0x7f9d101c89e0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f9d0400e810 tx=0x7f9d0400eb20 comp rx=0 tx=0).stop 2023-09-30T22:31:52.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.793+0000 7f9d16fcf700 1 -- 172.21.15.40:0/1210705680 shutdown_connections 2023-09-30T22:31:52.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.793+0000 7f9d16fcf700 1 --2- 172.21.15.40:0/1210705680 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d1009e2b0 0x7f9d101c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.793+0000 7f9d16fcf700 1 --2- 172.21.15.40:0/1210705680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d1009c890 0x7f9d101c89e0 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.793+0000 7f9d16fcf700 1 --2- 172.21.15.40:0/1210705680 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d1009d920 0x7f9d101c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.793+0000 7f9d16fcf700 1 -- 172.21.15.40:0/1210705680 >> 172.21.15.40:0/1210705680 conn(0x7f9d100a7080 msgr2=0x7f9d100a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:52.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.793+0000 7f9d16fcf700 1 -- 172.21.15.40:0/1210705680 shutdown_connections 2023-09-30T22:31:52.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.793+0000 7f9d16fcf700 1 -- 172.21.15.40:0/1210705680 wait complete. 2023-09-30T22:31:52.806 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:52.807 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:52.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.810+0000 7fefd4c86700 1 -- 172.21.15.40:0/3732717433 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fefd01298b0 con 0x7fefd009b180 2023-09-30T22:31:52.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.810+0000 7fefbeffd700 1 -- 172.21.15.40:0/3732717433 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fefc0016020 con 0x7fefd009b180 2023-09-30T22:31:52.811 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:52.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.812+0000 7fefd4c86700 1 -- 172.21.15.40:0/3732717433 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefd009b180 msgr2=0x7fefd01270d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:52.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.812+0000 7fefd4c86700 1 --2- 172.21.15.40:0/3732717433 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefd009b180 0x7fefd01270d0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fefc0000c00 tx=0x7fefc0004750 comp rx=0 tx=0).stop 2023-09-30T22:31:52.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.812+0000 7fefd4c86700 1 -- 172.21.15.40:0/3732717433 shutdown_connections 2023-09-30T22:31:52.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.812+0000 7fefd4c86700 1 --2- 172.21.15.40:0/3732717433 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fefd009b180 0x7fefd01270d0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.812+0000 7fefd4c86700 1 --2- 172.21.15.40:0/3732717433 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefd0130d10 0x7fefd0127b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.812+0000 7fefd4c86700 1 --2- 172.21.15.40:0/3732717433 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefd009da20 0x7fefd0127610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:52.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.812+0000 7fefd4c86700 1 -- 172.21.15.40:0/3732717433 >> 172.21.15.40:0/3732717433 conn(0x7fefd009eb10 msgr2=0x7fefd0098800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:52.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.812+0000 7fefd4c86700 1 -- 172.21.15.40:0/3732717433 shutdown_connections 2023-09-30T22:31:52.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:52.812+0000 7fefd4c86700 1 -- 172.21.15.40:0/3732717433 wait complete. 2023-09-30T22:31:52.825 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:53.796 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:31:53.806 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:53.808 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:53.825 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:53.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.949+0000 7f7c416bd700 1 Processor -- start 2023-09-30T22:31:53.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.949+0000 7f7c416bd700 1 -- start start 2023-09-30T22:31:53.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.950+0000 7f7c416bd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7c3c12e590 0x7f7c3c12e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:53.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.950+0000 7f7c416bd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c3c12d8a0 0x7f7c3c138c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:53.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.950+0000 7f7c416bd700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c3c09ab70 con 0x7f7c3c12eea0 2023-09-30T22:31:53.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.950+0000 7f7c416bd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c09b270 con 0x7f7c3c12d8a0 2023-09-30T22:31:53.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.950+0000 7f7c416bd700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c09bab0 con 0x7f7c3c12e590 2023-09-30T22:31:53.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.950+0000 7f7c3b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c3c12d8a0 0x7f7c3c138c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:53.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.950+0000 7f7c3b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c3c12d8a0 0x7f7c3c138c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54376/0 (socket says 172.21.15.40:54376) 2023-09-30T22:31:53.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.950+0000 7f7c3b7fe700 1 -- 172.21.15.40:0/179643846 learned_addr learned my addr 172.21.15.40:0/179643846 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:53.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.950+0000 7f7c3affd700 1 --2- 172.21.15.40:0/179643846 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7c3c12e590 0x7f7c3c12e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:53.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.950+0000 7f7c3b7fe700 1 -- 172.21.15.40:0/179643846 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7c3c12e590 msgr2=0x7f7c3c12e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:53.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.950+0000 7f7c3b7fe700 1 --2- 172.21.15.40:0/179643846 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7c3c12e590 0x7f7c3c12e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.950+0000 7f7c3b7fe700 1 -- 172.21.15.40:0/179643846 >> v1:172.21.15.40:6789/0 conn(0x7f7c3c12eea0 legacy=0x7f7c3c12d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:53.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.950+0000 7f7c39ffb700 1 -- 172.21.15.40:0/179643846 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1585400206 0 0) 0x7f7c3c09ab70 con 0x7f7c3c12eea0 2023-09-30T22:31:53.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.950+0000 7f7c3b7fe700 1 -- 172.21.15.40:0/179643846 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3c09bd70 con 0x7f7c3c12d8a0 2023-09-30T22:31:53.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.951+0000 7f7c3b7fe700 1 --2- 172.21.15.40:0/179643846 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c3c12d8a0 0x7f7c3c138c50 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f7c34009ee0 tx=0x7f7c3400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=caabce8d805f7dc8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:53.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.951+0000 7f7c39ffb700 1 -- 172.21.15.40:0/179643846 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c34003c20 con 0x7f7c3c12d8a0 2023-09-30T22:31:53.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.951+0000 7f7c39ffb700 1 -- 172.21.15.40:0/179643846 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c34003d80 con 0x7f7c3c12d8a0 2023-09-30T22:31:53.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.951+0000 7f7c39ffb700 1 -- 172.21.15.40:0/179643846 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3400bc40 con 0x7f7c3c12d8a0 2023-09-30T22:31:53.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.952+0000 7f7c416bd700 1 -- 172.21.15.40:0/179643846 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c3c12d8a0 msgr2=0x7f7c3c138c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:53.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.952+0000 7f7c416bd700 1 --2- 172.21.15.40:0/179643846 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c3c12d8a0 0x7f7c3c138c50 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f7c34009ee0 tx=0x7f7c3400b330 comp rx=0 tx=0).stop 2023-09-30T22:31:53.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.952+0000 7f7c416bd700 1 -- 172.21.15.40:0/179643846 shutdown_connections 2023-09-30T22:31:53.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.952+0000 7f7c416bd700 1 --2- 172.21.15.40:0/179643846 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c3c12d8a0 0x7f7c3c138c50 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.952+0000 7f7c416bd700 1 --2- 172.21.15.40:0/179643846 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7c3c12e590 0x7f7c3c12e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.952+0000 7f7c416bd700 1 -- 172.21.15.40:0/179643846 >> 172.21.15.40:0/179643846 conn(0x7f7c3c0a2a00 msgr2=0x7f7c3c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:53.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.952+0000 7f7c416bd700 1 -- 172.21.15.40:0/179643846 shutdown_connections 2023-09-30T22:31:53.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.952+0000 7f7c416bd700 1 -- 172.21.15.40:0/179643846 wait complete. 2023-09-30T22:31:53.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.953+0000 7f7c416bd700 1 Processor -- start 2023-09-30T22:31:53.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.953+0000 7f7c416bd700 1 -- start start 2023-09-30T22:31:53.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.954+0000 7f7c416bd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7c3c12d8a0 0x7f7c3c11dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:53.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.954+0000 7f7c416bd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c3c12e590 0x7f7c3c11e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:53.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.954+0000 7f7c416bd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c3c12eea0 0x7f7c3c11e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:53.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.954+0000 7f7c416bd700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c09fdb0 con 0x7f7c3c12eea0 2023-09-30T22:31:53.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.954+0000 7f7c416bd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c09b4b0 con 0x7f7c3c12e590 2023-09-30T22:31:53.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.954+0000 7f7c416bd700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c120f60 con 0x7f7c3c12d8a0 2023-09-30T22:31:53.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.954+0000 7f7c3a7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c3c12e590 0x7f7c3c11e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:53.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.954+0000 7f7c3a7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c3c12e590 0x7f7c3c11e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54380/0 (socket says 172.21.15.40:54380) 2023-09-30T22:31:53.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.954+0000 7f7c3a7fc700 1 -- 172.21.15.40:0/2870620930 learned_addr learned my addr 172.21.15.40:0/2870620930 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:53.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.954+0000 7f7c3b7fe700 1 --2- 172.21.15.40:0/2870620930 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c3c12eea0 0x7f7c3c11e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:53.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.954+0000 7f7c3affd700 1 --2- 172.21.15.40:0/2870620930 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7c3c12d8a0 0x7f7c3c11dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:53.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.954+0000 7f7c3b7fe700 1 -- 172.21.15.40:0/2870620930 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7c3c12d8a0 msgr2=0x7f7c3c11dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:53.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.954+0000 7f7c3b7fe700 1 --2- 172.21.15.40:0/2870620930 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7c3c12d8a0 0x7f7c3c11dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.954+0000 7f7c3b7fe700 1 -- 172.21.15.40:0/2870620930 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c3c12e590 msgr2=0x7f7c3c11e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:53.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.954+0000 7f7c3b7fe700 1 --2- 172.21.15.40:0/2870620930 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c3c12e590 0x7f7c3c11e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.954+0000 7f7c3b7fe700 1 -- 172.21.15.40:0/2870620930 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c34009b30 con 0x7f7c3c12eea0 2023-09-30T22:31:53.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.954+0000 7f7c3a7fc700 1 --2- 172.21.15.40:0/2870620930 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c3c12e590 0x7f7c3c11e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:53.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.955+0000 7f7c3b7fe700 1 --2- 172.21.15.40:0/2870620930 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c3c12eea0 0x7f7c3c11e730 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f7c34016000 tx=0x7f7c34004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:53.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.955+0000 7f7c237fe700 1 -- 172.21.15.40:0/2870620930 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3400be10 con 0x7f7c3c12eea0 2023-09-30T22:31:53.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.955+0000 7f7c237fe700 1 -- 172.21.15.40:0/2870620930 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c340092e0 con 0x7f7c3c12eea0 2023-09-30T22:31:53.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.955+0000 7f7c237fe700 1 -- 172.21.15.40:0/2870620930 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c340046f0 con 0x7f7c3c12eea0 2023-09-30T22:31:53.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.955+0000 7f7c416bd700 1 -- 172.21.15.40:0/2870620930 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c3c1214f0 con 0x7f7c3c12eea0 2023-09-30T22:31:53.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.956+0000 7f7c416bd700 1 -- 172.21.15.40:0/2870620930 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c3c121f60 con 0x7f7c3c12eea0 2023-09-30T22:31:53.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.956+0000 7f7c237fe700 1 -- 172.21.15.40:0/2870620930 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7c3400d070 con 0x7f7c3c12eea0 2023-09-30T22:31:53.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.956+0000 7f7c416bd700 1 -- 172.21.15.40:0/2870620930 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c3c06edb0 con 0x7f7c3c12eea0 2023-09-30T22:31:53.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.957+0000 7f7c237fe700 1 -- 172.21.15.40:0/2870620930 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f7c340411b0 con 0x7f7c3c12eea0 2023-09-30T22:31:53.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.962+0000 7f7c237fe700 1 -- 172.21.15.40:0/2870620930 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7c340107f0 con 0x7f7c3c12eea0 2023-09-30T22:31:53.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.984+0000 7f7f7fcef700 1 Processor -- start 2023-09-30T22:31:53.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.984+0000 7fd80040f700 1 Processor -- start 2023-09-30T22:31:53.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.984+0000 7f7f7fcef700 1 -- start start 2023-09-30T22:31:53.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.984+0000 7f7f7fcef700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7f78133c70 0x7f7f78134040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:53.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.985+0000 7f7f7fcef700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f7809e430 0x7f7f7813bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:53.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.985+0000 7f7f7fcef700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f78096930 con 0x7f7f78134580 2023-09-30T22:31:53.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.985+0000 7f7f7fcef700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f78071d60 con 0x7f7f78133c70 2023-09-30T22:31:53.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.985+0000 7f7f7fcef700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f78072880 con 0x7f7f7809e430 2023-09-30T22:31:53.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.985+0000 7f7f7da8b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7f78133c70 0x7f7f78134040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:53.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.985+0000 7f7f7da8b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7f78133c70 0x7f7f78134040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42156/0 (socket says 172.21.15.40:42156) 2023-09-30T22:31:53.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.985+0000 7f7f7da8b700 1 -- 172.21.15.40:0/361636755 learned_addr learned my addr 172.21.15.40:0/361636755 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:53.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.985+0000 7fb51aad9700 1 Processor -- start 2023-09-30T22:31:53.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.985+0000 7fb51aad9700 1 -- start start 2023-09-30T22:31:53.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.985+0000 7f7f7e28c700 1 --2- 172.21.15.40:0/361636755 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f7809e430 0x7f7f7813bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:53.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.985+0000 7f7f7da8b700 1 -- 172.21.15.40:0/361636755 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f7809e430 msgr2=0x7f7f7813bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:53.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.985+0000 7f7f7da8b700 1 --2- 172.21.15.40:0/361636755 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f7809e430 0x7f7f7813bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.985+0000 7f7f7da8b700 1 -- 172.21.15.40:0/361636755 >> v1:172.21.15.40:6789/0 conn(0x7f7f78134580 legacy=0x7f7f7809dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:53.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.985+0000 7f7f7da8b700 1 -- 172.21.15.40:0/361636755 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f7806c270 con 0x7f7f78133c70 2023-09-30T22:31:53.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.985+0000 7f7f7e28c700 1 --2- 172.21.15.40:0/361636755 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f7809e430 0x7f7f7813bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:31:53.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.986+0000 7f7f7da8b700 1 --2- 172.21.15.40:0/361636755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f78133c70 0x7f7f78134040 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f7f740098f0 tx=0x7f7f74009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d856c844f269fd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:53.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.986+0000 7f7f7ca89700 1 -- 172.21.15.40:0/361636755 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7400b8a0 con 0x7f7f78133c70 2023-09-30T22:31:53.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.986+0000 7f7f7ca89700 1 -- 172.21.15.40:0/361636755 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7400ba00 con 0x7f7f78133c70 2023-09-30T22:31:53.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.986+0000 7f7f7ca89700 1 -- 172.21.15.40:0/361636755 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7400bd90 con 0x7f7f78133c70 2023-09-30T22:31:53.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.985+0000 7fd80040f700 1 -- start start 2023-09-30T22:31:53.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.985+0000 7fd80040f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd7f806a6d0 0x7fd7f809d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:53.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.985+0000 7fd80040f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7f809de60 0x7fd7f809e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:53.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.986+0000 7fd80040f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7f809e790 con 0x7fd7f813c490 2023-09-30T22:31:53.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.986+0000 7fd80040f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7f806aaa0 con 0x7fd7f806a6d0 2023-09-30T22:31:53.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.986+0000 7fd80040f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f811d980 con 0x7fd7f809de60 2023-09-30T22:31:53.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.986+0000 7fd7fe1ab700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd7f806a6d0 0x7fd7f809d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:53.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.986+0000 7fd7fe1ab700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd7f806a6d0 0x7fd7f809d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42168/0 (socket says 172.21.15.40:42168) 2023-09-30T22:31:53.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.986+0000 7fd7fd9aa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7f809de60 0x7fd7f809e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:53.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.986+0000 7fd7fe1ab700 1 -- 172.21.15.40:0/3105661181 learned_addr learned my addr 172.21.15.40:0/3105661181 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:53.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.986+0000 7fb51aad9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb51409e400 0x7fb514135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:53.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.986+0000 7fb51aad9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb514136230 0x7fb514138610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:53.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.986+0000 7fb51aad9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb51409adf0 con 0x7fb51409d920 2023-09-30T22:31:53.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.986+0000 7fb51aad9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb51409edf0 con 0x7fb51409e400 2023-09-30T22:31:53.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.986+0000 7fb51aad9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb51409b660 con 0x7fb514136230 2023-09-30T22:31:53.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.986+0000 7fb513fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb51409e400 0x7fb514135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:53.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.986+0000 7fb518875700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb51409d920 0x7fb51409dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58654/0 (socket says 172.21.15.40:58654) 2023-09-30T22:31:53.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.986+0000 7fb518875700 1 -- 172.21.15.40:0/2288902461 learned_addr learned my addr 172.21.15.40:0/2288902461 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:53.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.986+0000 7fb519076700 1 --2- 172.21.15.40:0/2288902461 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb514136230 0x7fb514138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:53.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.986+0000 7fb513fff700 1 -- 172.21.15.40:0/2288902461 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb514136230 msgr2=0x7fb514138610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:53.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.986+0000 7fb513fff700 1 --2- 172.21.15.40:0/2288902461 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb514136230 0x7fb514138610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.986+0000 7fb513fff700 1 -- 172.21.15.40:0/2288902461 >> v1:172.21.15.40:6789/0 conn(0x7fb51409d920 legacy=0x7fb51409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:53.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.986+0000 7fb513fff700 1 -- 172.21.15.40:0/2288902461 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb51409a6e0 con 0x7fb51409e400 2023-09-30T22:31:53.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.986+0000 7fd7fd9aa700 1 -- 172.21.15.40:0/3105661181 >> v2:172.21.15.40:3300/0 conn(0x7fd7f806a6d0 msgr2=0x7fd7f809d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:53.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.986+0000 7fd7fd9aa700 1 --2- 172.21.15.40:0/3105661181 >> v2:172.21.15.40:3300/0 conn(0x7fd7f806a6d0 0x7fd7f809d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:53.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.986+0000 7fd7fd9aa700 1 -- 172.21.15.40:0/3105661181 >> v1:172.21.15.40:6789/0 conn(0x7fd7f813c490 legacy=0x7fd7f813e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:53.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.986+0000 7fd7fd9aa700 1 -- 172.21.15.40:0/3105661181 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f811daf0 con 0x7fd7f809de60 2023-09-30T22:31:53.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.986+0000 7fb513fff700 1 --2- 172.21.15.40:0/2288902461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb51409e400 0x7fb514135cf0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fb500009840 tx=0x7fb500009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb54851ee6912be6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:53.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.987+0000 7fd7fd9aa700 1 --2- 172.21.15.40:0/3105661181 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7f809de60 0x7fd7f809e250 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8009870 tx=0x7fd7e8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45ac2624bb49021d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:53.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.987+0000 7fb5137fe700 1 -- 172.21.15.40:0/2288902461 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb500011830 con 0x7fb51409e400 2023-09-30T22:31:53.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.987+0000 7fb5137fe700 1 -- 172.21.15.40:0/2288902461 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb500011990 con 0x7fb51409e400 2023-09-30T22:31:53.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.987+0000 7fb5137fe700 1 -- 172.21.15.40:0/2288902461 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb500011d20 con 0x7fb51409e400 2023-09-30T22:31:54.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.987+0000 7f7f7fcef700 1 -- 172.21.15.40:0/361636755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f78133c70 msgr2=0x7f7f78134040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:54.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.987+0000 7f7f7fcef700 1 --2- 172.21.15.40:0/361636755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f78133c70 0x7f7f78134040 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f7f740098f0 tx=0x7f7f74009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:54.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.987+0000 7f7f7fcef700 1 -- 172.21.15.40:0/361636755 shutdown_connections 2023-09-30T22:31:54.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.987+0000 7f7f7fcef700 1 --2- 172.21.15.40:0/361636755 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f7809e430 0x7f7f7813bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.987+0000 7f7f7fcef700 1 --2- 172.21.15.40:0/361636755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f78133c70 0x7f7f78134040 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.987+0000 7f7f7fcef700 1 -- 172.21.15.40:0/361636755 >> 172.21.15.40:0/361636755 conn(0x7f7f780a2ff0 msgr2=0x7f7f7809ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:54.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.987+0000 7f7f7fcef700 1 -- 172.21.15.40:0/361636755 shutdown_connections 2023-09-30T22:31:54.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.987+0000 7f7f7fcef700 1 -- 172.21.15.40:0/361636755 wait complete. 2023-09-30T22:31:54.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.987+0000 7fb51aad9700 1 -- 172.21.15.40:0/2288902461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb51409e400 msgr2=0x7fb514135cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:54.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.987+0000 7fb51aad9700 1 --2- 172.21.15.40:0/2288902461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb51409e400 0x7fb514135cf0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fb500009840 tx=0x7fb500009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:54.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.988+0000 7fb51aad9700 1 -- 172.21.15.40:0/2288902461 shutdown_connections 2023-09-30T22:31:54.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.988+0000 7fb51aad9700 1 --2- 172.21.15.40:0/2288902461 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb514136230 0x7fb514138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.988+0000 7fb51aad9700 1 --2- 172.21.15.40:0/2288902461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb51409e400 0x7fb514135cf0 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.988+0000 7fb51aad9700 1 -- 172.21.15.40:0/2288902461 >> 172.21.15.40:0/2288902461 conn(0x7fb51409fb20 msgr2=0x7fb51409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:54.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.988+0000 7fb51aad9700 1 -- 172.21.15.40:0/2288902461 shutdown_connections 2023-09-30T22:31:54.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.988+0000 7fb51aad9700 1 -- 172.21.15.40:0/2288902461 wait complete. 2023-09-30T22:31:54.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.989+0000 7f7f7fcef700 1 Processor -- start 2023-09-30T22:31:54.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.989+0000 7f7f7fcef700 1 -- start start 2023-09-30T22:31:54.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.989+0000 7fb51aad9700 1 Processor -- start 2023-09-30T22:31:54.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.989+0000 7fb51aad9700 1 -- start start 2023-09-30T22:31:54.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.989+0000 7f7f7fcef700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f7809e430 0x7f7f78128f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:54.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.989+0000 7f7f7fcef700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f78133c70 0x7f7f781294c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:54.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.989+0000 7f7f7fcef700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f78134580 0x7f7f78129a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:54.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.989+0000 7f7f7fcef700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7812ab60 con 0x7f7f78134580 2023-09-30T22:31:54.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.989+0000 7f7f7fcef700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7812b250 con 0x7f7f78133c70 2023-09-30T22:31:54.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.989+0000 7f7f7fcef700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7812b730 con 0x7f7f7809e430 2023-09-30T22:31:54.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.989+0000 7f7f7d28a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f78133c70 0x7f7f781294c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:54.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.989+0000 7f7f7d28a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f78133c70 0x7f7f781294c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54400/0 (socket says 172.21.15.40:54400) 2023-09-30T22:31:54.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.989+0000 7f7f7d28a700 1 -- 172.21.15.40:0/3675306707 learned_addr learned my addr 172.21.15.40:0/3675306707 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:54.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.989+0000 7f7f7e28c700 1 --2- 172.21.15.40:0/3675306707 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f78134580 0x7f7f78129a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:54.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.990+0000 7fd7fd1a9700 1 -- 172.21.15.40:0/3105661181 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8011830 con 0x7fd7f809de60 2023-09-30T22:31:54.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.990+0000 7fd7fd1a9700 1 -- 172.21.15.40:0/3105661181 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e8011990 con 0x7fd7f809de60 2023-09-30T22:31:54.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.990+0000 7fd7fd1a9700 1 -- 172.21.15.40:0/3105661181 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8011d20 con 0x7fd7f809de60 2023-09-30T22:31:54.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.990+0000 7f7f7d28a700 1 -- 172.21.15.40:0/3675306707 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f7809e430 msgr2=0x7f7f78128f80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:31:54.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.990+0000 7f7f7d28a700 1 --2- 172.21.15.40:0/3675306707 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f7809e430 0x7f7f78128f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.990+0000 7f7f7d28a700 1 -- 172.21.15.40:0/3675306707 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f78134580 msgr2=0x7f7f78129a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:54.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.990+0000 7f7f7d28a700 1 --2- 172.21.15.40:0/3675306707 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f78134580 0x7f7f78129a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.990+0000 7f7f7d28a700 1 -- 172.21.15.40:0/3675306707 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f74009550 con 0x7f7f78133c70 2023-09-30T22:31:54.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.990+0000 7fb51aad9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb51409d920 0x7fb5141c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:54.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.990+0000 7fb51aad9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb51409e400 0x7fb5141c8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:54.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.990+0000 7fb51aad9700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb514136230 0x7fb5141c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:54.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.990+0000 7fb51aad9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb514123a40 con 0x7fb51409d920 2023-09-30T22:31:54.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.990+0000 7fb51aad9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb514123850 con 0x7fb51409e400 2023-09-30T22:31:54.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.990+0000 7fb51aad9700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb514124120 con 0x7fb514136230 2023-09-30T22:31:54.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.990+0000 7fb513fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb51409e400 0x7fb5141c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:54.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.990+0000 7fb513fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb51409e400 0x7fb5141c8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54402/0 (socket says 172.21.15.40:54402) 2023-09-30T22:31:54.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.990+0000 7fb513fff700 1 -- 172.21.15.40:0/4259056093 learned_addr learned my addr 172.21.15.40:0/4259056093 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:54.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.990+0000 7fb518875700 1 --2- 172.21.15.40:0/4259056093 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb51409d920 0x7fb5141c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:54.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.990+0000 7fb519076700 1 --2- 172.21.15.40:0/4259056093 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb514136230 0x7fb5141c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:54.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.990+0000 7f7f7d28a700 1 --2- 172.21.15.40:0/3675306707 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f78133c70 0x7f7f781294c0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f7f6800c4e0 tx=0x7f7f6800c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:54.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.991+0000 7fb513fff700 1 -- 172.21.15.40:0/4259056093 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb514136230 msgr2=0x7fb5141c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:54.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.991+0000 7fb513fff700 1 --2- 172.21.15.40:0/4259056093 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb514136230 0x7fb5141c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.991+0000 7fb513fff700 1 -- 172.21.15.40:0/4259056093 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb51409d920 msgr2=0x7fb5141c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:54.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.991+0000 7fb513fff700 1 --2- 172.21.15.40:0/4259056093 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb51409d920 0x7fb5141c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.991+0000 7fb513fff700 1 -- 172.21.15.40:0/4259056093 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5000094a0 con 0x7fb51409e400 2023-09-30T22:31:54.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.991+0000 7fb519076700 1 --2- 172.21.15.40:0/4259056093 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb514136230 0x7fb5141c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:54.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.991+0000 7f7f6e7fc700 1 -- 172.21.15.40:0/3675306707 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f680052d0 con 0x7f7f78133c70 2023-09-30T22:31:54.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.991+0000 7f7f6e7fc700 1 -- 172.21.15.40:0/3675306707 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f68005430 con 0x7f7f78133c70 2023-09-30T22:31:54.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.991+0000 7f7f6e7fc700 1 -- 172.21.15.40:0/3675306707 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f680038a0 con 0x7f7f78133c70 2023-09-30T22:31:54.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.991+0000 7fb513fff700 1 --2- 172.21.15.40:0/4259056093 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb51409e400 0x7fb5141c8990 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fb500009b90 tx=0x7fb500004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:54.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.991+0000 7f7f7fcef700 1 -- 172.21.15.40:0/3675306707 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f7812c3c0 con 0x7f7f78133c70 2023-09-30T22:31:54.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.991+0000 7fb5117fa700 1 -- 172.21.15.40:0/4259056093 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5000036a0 con 0x7fb51409e400 2023-09-30T22:31:54.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.991+0000 7fb5117fa700 1 -- 172.21.15.40:0/4259056093 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50001f070 con 0x7fb51409e400 2023-09-30T22:31:54.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.991+0000 7fb5117fa700 1 -- 172.21.15.40:0/4259056093 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb500003a60 con 0x7fb51409e400 2023-09-30T22:31:54.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.991+0000 7fb51aad9700 1 -- 172.21.15.40:0/4259056093 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb514123e00 con 0x7fb51409e400 2023-09-30T22:31:54.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.991+0000 7fb51aad9700 1 -- 172.21.15.40:0/4259056093 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb51409cb00 con 0x7fb51409e400 2023-09-30T22:31:54.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.992+0000 7fb5117fa700 1 -- 172.21.15.40:0/4259056093 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb500003bc0 con 0x7fb51409e400 2023-09-30T22:31:54.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.993+0000 7fb5117fa700 1 -- 172.21.15.40:0/4259056093 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fb500021070 con 0x7fb51409e400 2023-09-30T22:31:54.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.992+0000 7fd80040f700 1 -- 172.21.15.40:0/3105661181 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7f809de60 msgr2=0x7fd7f809e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:54.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.992+0000 7fd80040f700 1 --2- 172.21.15.40:0/3105661181 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7f809de60 0x7fd7f809e250 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8009870 tx=0x7fd7e8009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:54.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.991+0000 7f7f7fcef700 1 -- 172.21.15.40:0/3675306707 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f78098e70 con 0x7f7f78133c70 2023-09-30T22:31:54.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.993+0000 7fb51aad9700 1 -- 172.21.15.40:0/4259056093 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb514062380 con 0x7fb51409e400 2023-09-30T22:31:54.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.993+0000 7f7f7fcef700 1 -- 172.21.15.40:0/3675306707 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f7809ada0 con 0x7f7f78133c70 2023-09-30T22:31:54.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.993+0000 7f7f6e7fc700 1 -- 172.21.15.40:0/3675306707 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7f68003a00 con 0x7f7f78133c70 2023-09-30T22:31:54.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.996+0000 7f7f6e7fc700 1 -- 172.21.15.40:0/3675306707 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f7f68023da0 con 0x7f7f78133c70 2023-09-30T22:31:54.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.994+0000 7fd80040f700 1 -- 172.21.15.40:0/3105661181 shutdown_connections 2023-09-30T22:31:54.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.994+0000 7fd80040f700 1 --2- 172.21.15.40:0/3105661181 >> v2:172.21.15.40:3300/0 conn(0x7fd7f806a6d0 0x7fd7f809d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.994+0000 7fd80040f700 1 --2- 172.21.15.40:0/3105661181 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7f809de60 0x7fd7f809e250 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.994+0000 7fd80040f700 1 -- 172.21.15.40:0/3105661181 >> 172.21.15.40:0/3105661181 conn(0x7fd7f809fb20 msgr2=0x7fd7f809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:54.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.994+0000 7fd80040f700 1 -- 172.21.15.40:0/3105661181 shutdown_connections 2023-09-30T22:31:54.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.994+0000 7fd80040f700 1 -- 172.21.15.40:0/3105661181 wait complete. 2023-09-30T22:31:54.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.995+0000 7fd80040f700 1 Processor -- start 2023-09-30T22:31:54.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.995+0000 7fd80040f700 1 -- start start 2023-09-30T22:31:54.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.996+0000 7fd80040f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7f806a6d0 0x7fd7f813d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:54.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.996+0000 7fd80040f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7f809de60 0x7fd7f813d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:54.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.996+0000 7fd80040f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd7f813c490 0x7fd7f813de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:54.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.996+0000 7fd80040f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f8141650 con 0x7fd7f809de60 2023-09-30T22:31:54.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.996+0000 7fd80040f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f80a3c40 con 0x7fd7f806a6d0 2023-09-30T22:31:54.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.996+0000 7fd80040f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f809f540 con 0x7fd7f813c490 2023-09-30T22:31:54.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.996+0000 7fd7fe9ac700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd7f813c490 0x7fd7f813de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:54.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.996+0000 7fd7fe9ac700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd7f813c490 0x7fd7f813de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:41986/0 (socket says 172.21.15.40:41986) 2023-09-30T22:31:54.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.996+0000 7fd7fe1ab700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7f806a6d0 0x7fd7f813d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:54.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.996+0000 7fd7fe9ac700 1 -- 172.21.15.40:0/67208595 learned_addr learned my addr 172.21.15.40:0/67208595 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:54.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.996+0000 7fd7fe9ac700 1 -- 172.21.15.40:0/67208595 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7f806a6d0 msgr2=0x7fd7f813d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:54.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.996+0000 7fd7fe9ac700 1 --2- 172.21.15.40:0/67208595 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7f806a6d0 0x7fd7f813d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.996+0000 7fd7fe9ac700 1 -- 172.21.15.40:0/67208595 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7f809de60 msgr2=0x7fd7f813d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:54.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.996+0000 7fd7fe9ac700 1 --2- 172.21.15.40:0/67208595 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7f809de60 0x7fd7f813d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.996+0000 7fd7fe9ac700 1 -- 172.21.15.40:0/67208595 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e80094a0 con 0x7fd7f813c490 2023-09-30T22:31:54.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.996+0000 7fd7fe1ab700 1 --2- 172.21.15.40:0/67208595 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7f806a6d0 0x7fd7f813d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:54.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.996+0000 7fd7fe9ac700 1 --2- 172.21.15.40:0/67208595 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd7f813c490 0x7fd7f813de90 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fd7f000cc50 tx=0x7fd7f000cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:54.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.997+0000 7fd7eeffd700 1 -- 172.21.15.40:0/67208595 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f0003c00 con 0x7fd7f813c490 2023-09-30T22:31:54.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.997+0000 7fd7eeffd700 1 -- 172.21.15.40:0/67208595 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f0003d60 con 0x7fd7f813c490 2023-09-30T22:31:54.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.997+0000 7fd7eeffd700 1 -- 172.21.15.40:0/67208595 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f000aae0 con 0x7fd7f813c490 2023-09-30T22:31:54.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.998+0000 7fd80040f700 1 -- 172.21.15.40:0/67208595 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f813efe0 con 0x7fd7f813c490 2023-09-30T22:31:54.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.998+0000 7fd80040f700 1 -- 172.21.15.40:0/67208595 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f8151680 con 0x7fd7f813c490 2023-09-30T22:31:54.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.998+0000 7fd7eeffd700 1 -- 172.21.15.40:0/67208595 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd7f000ac40 con 0x7fd7f813c490 2023-09-30T22:31:54.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.999+0000 7fd80040f700 1 -- 172.21.15.40:0/67208595 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7f811aed0 con 0x7fd7f813c490 2023-09-30T22:31:54.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:53.999+0000 7fd7eeffd700 1 -- 172.21.15.40:0/67208595 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fd7f003f5b0 con 0x7fd7f813c490 2023-09-30T22:31:54.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.002+0000 7fb5117fa700 1 -- 172.21.15.40:0/4259056093 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb500015080 con 0x7fb51409e400 2023-09-30T22:31:54.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.004+0000 7fd7eeffd700 1 -- 172.21.15.40:0/67208595 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd7f0019710 con 0x7fd7f813c490 2023-09-30T22:31:54.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.005+0000 7f7f6e7fc700 1 -- 172.21.15.40:0/3675306707 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7f68003cb0 con 0x7f7f78133c70 2023-09-30T22:31:54.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.164+0000 7f7c416bd700 1 -- 172.21.15.40:0/2870620930 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7c3c062380 con 0x7f7c3c12eea0 2023-09-30T22:31:54.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.165+0000 7f7c237fe700 1 -- 172.21.15.40:0/2870620930 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7c340193f0 con 0x7f7c3c12eea0 2023-09-30T22:31:54.166 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:54.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.167+0000 7f7c416bd700 1 -- 172.21.15.40:0/2870620930 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c3c12eea0 msgr2=0x7f7c3c11e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:54.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.167+0000 7f7c416bd700 1 --2- 172.21.15.40:0/2870620930 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c3c12eea0 0x7f7c3c11e730 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f7c34016000 tx=0x7f7c34004ad0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.167+0000 7f7c416bd700 1 -- 172.21.15.40:0/2870620930 shutdown_connections 2023-09-30T22:31:54.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.167+0000 7f7c416bd700 1 --2- 172.21.15.40:0/2870620930 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7c3c12d8a0 0x7f7c3c11dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.167+0000 7f7c416bd700 1 --2- 172.21.15.40:0/2870620930 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c3c12eea0 0x7f7c3c11e730 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.167+0000 7f7c416bd700 1 --2- 172.21.15.40:0/2870620930 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c3c12e590 0x7f7c3c11e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.167+0000 7f7c416bd700 1 -- 172.21.15.40:0/2870620930 >> 172.21.15.40:0/2870620930 conn(0x7f7c3c0a2a00 msgr2=0x7f7c3c12c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:54.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.167+0000 7f7c416bd700 1 -- 172.21.15.40:0/2870620930 shutdown_connections 2023-09-30T22:31:54.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.167+0000 7f7c416bd700 1 -- 172.21.15.40:0/2870620930 wait complete. 2023-09-30T22:31:54.180 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.1 2023-09-30T22:31:54.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.201+0000 7fb51aad9700 1 -- 172.21.15.40:0/4259056093 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb514125540 con 0x7fb51409e400 2023-09-30T22:31:54.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.201+0000 7fb5117fa700 1 -- 172.21.15.40:0/4259056093 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb50001a430 con 0x7fb51409e400 2023-09-30T22:31:54.202 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:54.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.203+0000 7fb51aad9700 1 -- 172.21.15.40:0/4259056093 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb51409e400 msgr2=0x7fb5141c8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:54.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.203+0000 7fb51aad9700 1 --2- 172.21.15.40:0/4259056093 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb51409e400 0x7fb5141c8990 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fb500009b90 tx=0x7fb500004750 comp rx=0 tx=0).stop 2023-09-30T22:31:54.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.203+0000 7fb51aad9700 1 -- 172.21.15.40:0/4259056093 shutdown_connections 2023-09-30T22:31:54.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.203+0000 7fb51aad9700 1 --2- 172.21.15.40:0/4259056093 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fb514136230 0x7fb5141c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.203+0000 7fb51aad9700 1 --2- 172.21.15.40:0/4259056093 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb51409d920 0x7fb5141c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.203+0000 7fb51aad9700 1 --2- 172.21.15.40:0/4259056093 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb51409e400 0x7fb5141c8990 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.203+0000 7fb51aad9700 1 -- 172.21.15.40:0/4259056093 >> 172.21.15.40:0/4259056093 conn(0x7fb51409fb20 msgr2=0x7fb514134ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:54.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.203+0000 7fb51aad9700 1 -- 172.21.15.40:0/4259056093 shutdown_connections 2023-09-30T22:31:54.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.203+0000 7fb51aad9700 1 -- 172.21.15.40:0/4259056093 wait complete. 2023-09-30T22:31:54.216 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:54.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.229+0000 7f7f7fcef700 1 -- 172.21.15.40:0/3675306707 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7f7812c780 con 0x7f7f78133c70 2023-09-30T22:31:54.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.229+0000 7f7f6e7fc700 1 -- 172.21.15.40:0/3675306707 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7f68017030 con 0x7f7f78133c70 2023-09-30T22:31:54.230 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:54.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.230+0000 7fd80040f700 1 -- 172.21.15.40:0/67208595 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd7f809e790 con 0x7fd7f813c490 2023-09-30T22:31:54.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.230+0000 7fd7eeffd700 1 -- 172.21.15.40:0/67208595 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd7f809e790 con 0x7fd7f813c490 2023-09-30T22:31:54.231 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:54.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.231+0000 7f7f7fcef700 1 -- 172.21.15.40:0/3675306707 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f78133c70 msgr2=0x7f7f781294c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:54.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.231+0000 7f7f7fcef700 1 --2- 172.21.15.40:0/3675306707 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f78133c70 0x7f7f781294c0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f7f6800c4e0 tx=0x7f7f6800c7f0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.231+0000 7f7f7fcef700 1 -- 172.21.15.40:0/3675306707 shutdown_connections 2023-09-30T22:31:54.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.231+0000 7f7f7fcef700 1 --2- 172.21.15.40:0/3675306707 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f7f7809e430 0x7f7f78128f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.231+0000 7f7f7fcef700 1 --2- 172.21.15.40:0/3675306707 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f78134580 0x7f7f78129a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.231+0000 7f7f7fcef700 1 --2- 172.21.15.40:0/3675306707 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7f78133c70 0x7f7f781294c0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.231+0000 7f7f7fcef700 1 -- 172.21.15.40:0/3675306707 >> 172.21.15.40:0/3675306707 conn(0x7f7f780a2ff0 msgr2=0x7f7f781baf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:54.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.231+0000 7f7f7fcef700 1 -- 172.21.15.40:0/3675306707 shutdown_connections 2023-09-30T22:31:54.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.231+0000 7f7f7fcef700 1 -- 172.21.15.40:0/3675306707 wait complete. 2023-09-30T22:31:54.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.232+0000 7fd80040f700 1 -- 172.21.15.40:0/67208595 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd7f813c490 msgr2=0x7fd7f813de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:54.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.232+0000 7fd80040f700 1 --2- 172.21.15.40:0/67208595 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd7f813c490 0x7fd7f813de90 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fd7f000cc50 tx=0x7fd7f000cf60 comp rx=0 tx=0).stop 2023-09-30T22:31:54.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.232+0000 7fd80040f700 1 -- 172.21.15.40:0/67208595 shutdown_connections 2023-09-30T22:31:54.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.232+0000 7fd80040f700 1 --2- 172.21.15.40:0/67208595 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fd7f813c490 0x7fd7f813de90 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.232+0000 7fd80040f700 1 --2- 172.21.15.40:0/67208595 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7f806a6d0 0x7fd7f813d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.232+0000 7fd80040f700 1 --2- 172.21.15.40:0/67208595 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7f809de60 0x7fd7f813d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:54.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.232+0000 7fd80040f700 1 -- 172.21.15.40:0/67208595 >> 172.21.15.40:0/67208595 conn(0x7fd7f809fb20 msgr2=0x7fd7f80a2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:54.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.232+0000 7fd80040f700 1 -- 172.21.15.40:0/67208595 shutdown_connections 2023-09-30T22:31:54.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:54.232+0000 7fd80040f700 1 -- 172.21.15.40:0/67208595 wait complete. 2023-09-30T22:31:54.246 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:54.246 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:55.182 INFO:tasks.ceph:ignoring flush pg stats error, probably testing upgrade: timed out waiting for mon to be updated with osd.1: 141733920771 < 141733920772 2023-09-30T22:31:55.182 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-30T22:31:55.183 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:31:55.218 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:55.246 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:31:55.248 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:55.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.336+0000 7fa9e9b7f700 1 Processor -- start 2023-09-30T22:31:55.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.336+0000 7fa9e9b7f700 1 -- start start 2023-09-30T22:31:55.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.337+0000 7fa9e9b7f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa9e409e2b0 0x7fa9e409e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:55.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.337+0000 7fa9e9b7f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa9e409ebc0 0x7fa9e4130930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:55.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.337+0000 7fa9e9b7f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9e409fad0 con 0x7fa9e4130e70 2023-09-30T22:31:55.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.337+0000 7fa9e9b7f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e406b900 con 0x7fa9e409e2b0 2023-09-30T22:31:55.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.337+0000 7fa9e9b7f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e409a880 con 0x7fa9e409ebc0 2023-09-30T22:31:55.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.337+0000 7fa9e37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa9e409e2b0 0x7fa9e409e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:55.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.337+0000 7fa9e37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa9e409e2b0 0x7fa9e409e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54414/0 (socket says 172.21.15.40:54414) 2023-09-30T22:31:55.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.337+0000 7fa9e37fe700 1 -- 172.21.15.40:0/2175745671 learned_addr learned my addr 172.21.15.40:0/2175745671 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:55.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.337+0000 7fa9e2ffd700 1 --2- 172.21.15.40:0/2175745671 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa9e409ebc0 0x7fa9e4130930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:55.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.337+0000 7fa9e2ffd700 1 -- 172.21.15.40:0/2175745671 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa9e409e2b0 msgr2=0x7fa9e409e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:55.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.337+0000 7fa9e2ffd700 1 --2- 172.21.15.40:0/2175745671 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa9e409e2b0 0x7fa9e409e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.337+0000 7fa9e2ffd700 1 -- 172.21.15.40:0/2175745671 >> v1:172.21.15.40:6789/0 conn(0x7fa9e4130e70 legacy=0x7fa9e4137d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:55.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.337+0000 7fa9e2ffd700 1 -- 172.21.15.40:0/2175745671 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e409c780 con 0x7fa9e409ebc0 2023-09-30T22:31:55.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.337+0000 7fa9e37fe700 1 --2- 172.21.15.40:0/2175745671 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa9e409e2b0 0x7fa9e409e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:55.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.338+0000 7fa9e2ffd700 1 --2- 172.21.15.40:0/2175745671 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa9e409ebc0 0x7fa9e4130930 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8009870 tx=0x7fa9d8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f8a6cf073c2f106 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:55.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.339+0000 7fa9e27fc700 1 -- 172.21.15.40:0/2175745671 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d8011830 con 0x7fa9e409ebc0 2023-09-30T22:31:55.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.339+0000 7fa9e27fc700 1 -- 172.21.15.40:0/2175745671 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d8011990 con 0x7fa9e409ebc0 2023-09-30T22:31:55.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.339+0000 7fa9e27fc700 1 -- 172.21.15.40:0/2175745671 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d8011d20 con 0x7fa9e409ebc0 2023-09-30T22:31:55.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.339+0000 7fa9e9b7f700 1 -- 172.21.15.40:0/2175745671 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa9e409ebc0 msgr2=0x7fa9e4130930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:55.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.339+0000 7fa9e9b7f700 1 --2- 172.21.15.40:0/2175745671 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa9e409ebc0 0x7fa9e4130930 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8009870 tx=0x7fa9d8009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:55.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.339+0000 7fa9e9b7f700 1 -- 172.21.15.40:0/2175745671 shutdown_connections 2023-09-30T22:31:55.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.339+0000 7fa9e9b7f700 1 --2- 172.21.15.40:0/2175745671 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa9e409e2b0 0x7fa9e409e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.339+0000 7fa9e9b7f700 1 --2- 172.21.15.40:0/2175745671 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa9e409ebc0 0x7fa9e4130930 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.339+0000 7fa9e9b7f700 1 -- 172.21.15.40:0/2175745671 >> 172.21.15.40:0/2175745671 conn(0x7fa9e40a3590 msgr2=0x7fa9e40a3990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:55.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.340+0000 7fa9e9b7f700 1 -- 172.21.15.40:0/2175745671 shutdown_connections 2023-09-30T22:31:55.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.340+0000 7fa9e9b7f700 1 -- 172.21.15.40:0/2175745671 wait complete. 2023-09-30T22:31:55.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.341+0000 7fa9e9b7f700 1 Processor -- start 2023-09-30T22:31:55.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.341+0000 7fa9e9b7f700 1 -- start start 2023-09-30T22:31:55.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.341+0000 7fa9e9b7f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa9e409e2b0 0x7fa9e4135ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:55.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.341+0000 7fa9e9b7f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9e409ebc0 0x7fa9e4136020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:55.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.341+0000 7fa9e9b7f700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa9e4130e70 0x7fa9e4136560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:55.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.341+0000 7fa9e9b7f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e4139320 con 0x7fa9e409ebc0 2023-09-30T22:31:55.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.341+0000 7fa9e9b7f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e41304e0 con 0x7fa9e409e2b0 2023-09-30T22:31:55.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.341+0000 7fa9e9b7f700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e41376f0 con 0x7fa9e4130e70 2023-09-30T22:31:55.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.341+0000 7fa9e37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa9e409e2b0 0x7fa9e4135ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:55.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.341+0000 7fa9e37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa9e409e2b0 0x7fa9e4135ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54422/0 (socket says 172.21.15.40:54422) 2023-09-30T22:31:55.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.342+0000 7fa9e37fe700 1 -- 172.21.15.40:0/2564848267 learned_addr learned my addr 172.21.15.40:0/2564848267 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:55.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.342+0000 7fa9e2ffd700 1 --2- 172.21.15.40:0/2564848267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9e409ebc0 0x7fa9e4136020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:55.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.342+0000 7fa9e3fff700 1 --2- 172.21.15.40:0/2564848267 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa9e4130e70 0x7fa9e4136560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:55.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.342+0000 7fa9e2ffd700 1 -- 172.21.15.40:0/2564848267 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa9e4130e70 msgr2=0x7fa9e4136560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:55.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.342+0000 7fa9e2ffd700 1 --2- 172.21.15.40:0/2564848267 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fa9e4130e70 0x7fa9e4136560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.342+0000 7fa9e2ffd700 1 -- 172.21.15.40:0/2564848267 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa9e409e2b0 msgr2=0x7fa9e4135ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:55.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.342+0000 7fa9e2ffd700 1 --2- 172.21.15.40:0/2564848267 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa9e409e2b0 0x7fa9e4135ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.342+0000 7fa9e2ffd700 1 -- 172.21.15.40:0/2564848267 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d4009550 con 0x7fa9e409ebc0 2023-09-30T22:31:55.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.342+0000 7fa9e37fe700 1 --2- 172.21.15.40:0/2564848267 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa9e409e2b0 0x7fa9e4135ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:55.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.342+0000 7fa9e2ffd700 1 --2- 172.21.15.40:0/2564848267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9e409ebc0 0x7fa9e4136020 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7fa9e409af00 tx=0x7fa9d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:55.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.342+0000 7fa9cbfff700 1 -- 172.21.15.40:0/2564848267 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d8004450 con 0x7fa9e409ebc0 2023-09-30T22:31:55.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.343+0000 7fa9cbfff700 1 -- 172.21.15.40:0/2564848267 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d801f070 con 0x7fa9e409ebc0 2023-09-30T22:31:55.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.343+0000 7fa9e9b7f700 1 -- 172.21.15.40:0/2564848267 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d80094a0 con 0x7fa9e409ebc0 2023-09-30T22:31:55.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.343+0000 7fa9cbfff700 1 -- 172.21.15.40:0/2564848267 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d80038e0 con 0x7fa9e409ebc0 2023-09-30T22:31:55.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.343+0000 7fa9e9b7f700 1 -- 172.21.15.40:0/2564848267 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9e4138d90 con 0x7fa9e409ebc0 2023-09-30T22:31:55.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.344+0000 7fa9cbfff700 1 -- 172.21.15.40:0/2564848267 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa9d8003a40 con 0x7fa9e409ebc0 2023-09-30T22:31:55.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.344+0000 7fa9c9ffb700 1 -- 172.21.15.40:0/2564848267 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9e4062380 con 0x7fa9e409ebc0 2023-09-30T22:31:55.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.344+0000 7fa9cbfff700 1 -- 172.21.15.40:0/2564848267 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fa9d8021070 con 0x7fa9e409ebc0 2023-09-30T22:31:55.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.353+0000 7fa9cbfff700 1 -- 172.21.15.40:0/2564848267 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa9d80199a0 con 0x7fa9e409ebc0 2023-09-30T22:31:55.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.381+0000 7f5934c31700 1 Processor -- start 2023-09-30T22:31:55.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.381+0000 7f5934c31700 1 -- start start 2023-09-30T22:31:55.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.382+0000 7f5934c31700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f593009fbb0 0x7f593006c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:55.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.382+0000 7f5934c31700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f593006ced0 0x7f593006d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:55.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.382+0000 7f5934c31700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5930138370 0x7f593013a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:55.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.382+0000 7f5934c31700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f593009ff80 con 0x7f5930138370 2023-09-30T22:31:55.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.382+0000 7f5934c31700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593006ec40 con 0x7f593006ced0 2023-09-30T22:31:55.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.382+0000 7f5934c31700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f593006f510 con 0x7f593009fbb0 2023-09-30T22:31:55.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.382+0000 7f592e59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f593009fbb0 0x7f593006c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.382+0000 7f592e59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f593009fbb0 0x7f593006c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:42010/0 (socket says 172.21.15.40:42010) 2023-09-30T22:31:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.382+0000 7f592ed9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5930138370 0x7f593013a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.382+0000 7f592e59c700 1 -- 172.21.15.40:0/4240031247 learned_addr learned my addr 172.21.15.40:0/4240031247 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.383+0000 7f592dd9b700 1 --2- 172.21.15.40:0/4240031247 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f593006ced0 0x7f593006d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:55.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.383+0000 7f592e59c700 1 -- 172.21.15.40:0/4240031247 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f593006ced0 msgr2=0x7f593006d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:55.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.383+0000 7f592e59c700 1 --2- 172.21.15.40:0/4240031247 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f593006ced0 0x7f593006d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.383+0000 7f592e59c700 1 -- 172.21.15.40:0/4240031247 >> v2:172.21.15.40:3300/0 conn(0x7f5930138370 msgr2=0x7f593013a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:55.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.383+0000 7f592e59c700 1 --2- 172.21.15.40:0/4240031247 >> v2:172.21.15.40:3300/0 conn(0x7f5930138370 0x7f593013a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.383+0000 7f592e59c700 1 -- 172.21.15.40:0/4240031247 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593006e3f0 con 0x7f593009fbb0 2023-09-30T22:31:55.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.383+0000 7f592ed9d700 1 --2- 172.21.15.40:0/4240031247 >> v2:172.21.15.40:3300/0 conn(0x7f5930138370 0x7f593013a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:55.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.383+0000 7f592e59c700 1 --2- 172.21.15.40:0/4240031247 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f593009fbb0 0x7f593006c990 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f5920009920 tx=0x7f5920009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28ac1ba3d3e7206 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:55.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.383+0000 7f592d59a700 1 -- 172.21.15.40:0/4240031247 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920011830 con 0x7f593009fbb0 2023-09-30T22:31:55.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.383+0000 7f592d59a700 1 -- 172.21.15.40:0/4240031247 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5920011990 con 0x7f593009fbb0 2023-09-30T22:31:55.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.383+0000 7f592d59a700 1 -- 172.21.15.40:0/4240031247 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920011d20 con 0x7f593009fbb0 2023-09-30T22:31:55.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.384+0000 7f5934c31700 1 -- 172.21.15.40:0/4240031247 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f593009fbb0 msgr2=0x7f593006c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:55.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.384+0000 7f5934c31700 1 --2- 172.21.15.40:0/4240031247 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f593009fbb0 0x7f593006c990 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f5920009920 tx=0x7f5920009c30 comp rx=0 tx=0).stop 2023-09-30T22:31:55.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.384+0000 7f5934c31700 1 -- 172.21.15.40:0/4240031247 shutdown_connections 2023-09-30T22:31:55.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.384+0000 7f5934c31700 1 --2- 172.21.15.40:0/4240031247 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f593009fbb0 0x7f593006c990 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.384+0000 7f5934c31700 1 --2- 172.21.15.40:0/4240031247 >> v2:172.21.15.40:3300/0 conn(0x7f5930138370 0x7f593013a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.384+0000 7f5934c31700 1 --2- 172.21.15.40:0/4240031247 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f593006ced0 0x7f593006d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.384+0000 7f5934c31700 1 -- 172.21.15.40:0/4240031247 >> 172.21.15.40:0/4240031247 conn(0x7f59300a41a0 msgr2=0x7f59300a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:55.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.384+0000 7f5934c31700 1 -- 172.21.15.40:0/4240031247 shutdown_connections 2023-09-30T22:31:55.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.384+0000 7f5934c31700 1 -- 172.21.15.40:0/4240031247 wait complete. 2023-09-30T22:31:55.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.386+0000 7f5934c31700 1 Processor -- start 2023-09-30T22:31:55.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.386+0000 7f5934c31700 1 -- start start 2023-09-30T22:31:55.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.386+0000 7f5934c31700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f593006ced0 0x7f5930090660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:55.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.386+0000 7f5934c31700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f593009fbb0 0x7f5930090ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:55.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.386+0000 7f5934c31700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5930138370 0x7f59300910e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:55.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.386+0000 7f5934c31700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5930091b50 con 0x7f5930138370 2023-09-30T22:31:55.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.386+0000 7f5934c31700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5930091fe0 con 0x7f593009fbb0 2023-09-30T22:31:55.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.386+0000 7f5934c31700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59300971d0 con 0x7f593006ced0 2023-09-30T22:31:55.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.387+0000 7f592e59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f593006ced0 0x7f5930090660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:55.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.387+0000 7f592e59c700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f593006ced0 0x7f5930090660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:42012/0 (socket says 172.21.15.40:42012) 2023-09-30T22:31:55.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.387+0000 7f592e59c700 1 -- 172.21.15.40:0/2740391553 learned_addr learned my addr 172.21.15.40:0/2740391553 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:55.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.387+0000 7f592dd9b700 1 --2- 172.21.15.40:0/2740391553 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f593009fbb0 0x7f5930090ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:55.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.387+0000 7f592ed9d700 1 --2- 172.21.15.40:0/2740391553 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5930138370 0x7f59300910e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:55.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.387+0000 7f592e59c700 1 -- 172.21.15.40:0/2740391553 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f593009fbb0 msgr2=0x7f5930090ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:55.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.387+0000 7f592e59c700 1 --2- 172.21.15.40:0/2740391553 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f593009fbb0 0x7f5930090ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.387+0000 7f592e59c700 1 -- 172.21.15.40:0/2740391553 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5930138370 msgr2=0x7f59300910e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:55.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.387+0000 7f592e59c700 1 --2- 172.21.15.40:0/2740391553 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5930138370 0x7f59300910e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.387+0000 7f592e59c700 1 -- 172.21.15.40:0/2740391553 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5928009a70 con 0x7f593006ced0 2023-09-30T22:31:55.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.387+0000 7f592e59c700 1 --2- 172.21.15.40:0/2740391553 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f593006ced0 0x7f5930090660 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f5920009870 tx=0x7f5920004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:55.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.387+0000 7f591effd700 1 -- 172.21.15.40:0/2740391553 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920004240 con 0x7f593006ced0 2023-09-30T22:31:55.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.387+0000 7f5934c31700 1 -- 172.21.15.40:0/2740391553 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5920009550 con 0x7f593006ced0 2023-09-30T22:31:55.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.387+0000 7f591effd700 1 -- 172.21.15.40:0/2740391553 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592001f070 con 0x7f593006ced0 2023-09-30T22:31:55.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.387+0000 7f591effd700 1 -- 172.21.15.40:0/2740391553 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59200045c0 con 0x7f593006ced0 2023-09-30T22:31:55.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.388+0000 7f5934c31700 1 -- 172.21.15.40:0/2740391553 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f593009f460 con 0x7f593006ced0 2023-09-30T22:31:55.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.388+0000 7f591effd700 1 -- 172.21.15.40:0/2740391553 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5920021030 con 0x7f593006ced0 2023-09-30T22:31:55.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.389+0000 7f591effd700 1 -- 172.21.15.40:0/2740391553 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f59200408b0 con 0x7f593006ced0 2023-09-30T22:31:55.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.389+0000 7f5934c31700 1 -- 172.21.15.40:0/2740391553 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5930071db0 con 0x7f593006ced0 2023-09-30T22:31:55.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.394+0000 7f591effd700 1 -- 172.21.15.40:0/2740391553 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5920015020 con 0x7f593006ced0 2023-09-30T22:31:55.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.409+0000 7fe9b0cdb700 1 Processor -- start 2023-09-30T22:31:55.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.409+0000 7fe9b0cdb700 1 -- start start 2023-09-30T22:31:55.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.410+0000 7fe9b0cdb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9ac09d920 0x7fe9ac09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:55.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.410+0000 7fe9b0cdb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe9ac130fb0 0x7fe9ac138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:55.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.410+0000 7fe9b0cdb700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9ac09adf0 con 0x7fe9ac09e230 2023-09-30T22:31:55.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.410+0000 7fe9b0cdb700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9ac09edf0 con 0x7fe9ac130fb0 2023-09-30T22:31:55.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.410+0000 7fe9b0cdb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac09b660 con 0x7fe9ac09d920 2023-09-30T22:31:55.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.410+0000 7fe9a9d9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe9ac09e230 0x7fe9ac1308a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58668/0 (socket says 172.21.15.40:58668) 2023-09-30T22:31:55.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.410+0000 7fe9a9d9b700 1 -- 172.21.15.40:0/3965833141 learned_addr learned my addr 172.21.15.40:0/3965833141 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:55.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.410+0000 7fe9aa59c700 1 --2- 172.21.15.40:0/3965833141 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9ac09d920 0x7fe9ac09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:55.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.410+0000 7fe9aad9d700 1 --2- 172.21.15.40:0/3965833141 >> v2:172.21.15.40:3300/0 conn(0x7fe9ac130fb0 0x7fe9ac138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:55.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.411+0000 7fe9aad9d700 1 -- 172.21.15.40:0/3965833141 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9ac09d920 msgr2=0x7fe9ac09dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:55.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.411+0000 7fe9aad9d700 1 --2- 172.21.15.40:0/3965833141 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9ac09d920 0x7fe9ac09dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.411+0000 7fe9a959a700 1 -- 172.21.15.40:0/3965833141 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 343351125 0 0) 0x7fe9ac09adf0 con 0x7fe9ac09e230 2023-09-30T22:31:55.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.411+0000 7fe9aad9d700 1 -- 172.21.15.40:0/3965833141 >> v1:172.21.15.40:6789/0 conn(0x7fe9ac09e230 legacy=0x7fe9ac1308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:55.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.411+0000 7fe9aad9d700 1 -- 172.21.15.40:0/3965833141 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ac09a6e0 con 0x7fe9ac130fb0 2023-09-30T22:31:55.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.411+0000 7fe9aad9d700 1 --2- 172.21.15.40:0/3965833141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9ac130fb0 0x7fe9ac138d10 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4009d90 tx=0x7fe9a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc7d7c3432d899ce server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:55.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.411+0000 7fe9a959a700 1 -- 172.21.15.40:0/3965833141 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a400e070 con 0x7fe9ac130fb0 2023-09-30T22:31:55.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.411+0000 7fe9a959a700 1 -- 172.21.15.40:0/3965833141 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9a400bb20 con 0x7fe9ac130fb0 2023-09-30T22:31:55.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.411+0000 7fe9a959a700 1 -- 172.21.15.40:0/3965833141 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a4012430 con 0x7fe9ac130fb0 2023-09-30T22:31:55.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.412+0000 7ff295910700 1 Processor -- start 2023-09-30T22:31:55.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.412+0000 7ff295910700 1 -- start start 2023-09-30T22:31:55.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.412+0000 7fe9b0cdb700 1 -- 172.21.15.40:0/3965833141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9ac130fb0 msgr2=0x7fe9ac138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:55.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.412+0000 7fe9b0cdb700 1 --2- 172.21.15.40:0/3965833141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9ac130fb0 0x7fe9ac138d10 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4009d90 tx=0x7fe9a400b330 comp rx=0 tx=0).stop 2023-09-30T22:31:55.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.412+0000 7fe9b0cdb700 1 -- 172.21.15.40:0/3965833141 shutdown_connections 2023-09-30T22:31:55.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.412+0000 7fe9b0cdb700 1 --2- 172.21.15.40:0/3965833141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9ac130fb0 0x7fe9ac138d10 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.412+0000 7fe9b0cdb700 1 --2- 172.21.15.40:0/3965833141 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9ac09d920 0x7fe9ac09dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.412+0000 7fe9b0cdb700 1 -- 172.21.15.40:0/3965833141 >> 172.21.15.40:0/3965833141 conn(0x7fe9ac09fb20 msgr2=0x7fe9ac09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:55.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.412+0000 7fe9b0cdb700 1 -- 172.21.15.40:0/3965833141 shutdown_connections 2023-09-30T22:31:55.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.412+0000 7ff295910700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff29009d920 0x7ff29009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:55.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.412+0000 7fe9b0cdb700 1 -- 172.21.15.40:0/3965833141 wait complete. 2023-09-30T22:31:55.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.412+0000 7ff295910700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff29009f0f0 0x7ff29009e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:55.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.412+0000 7ff295910700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff29009f940 con 0x7ff290133ca0 2023-09-30T22:31:55.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.412+0000 7ff295910700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff29006b4c0 con 0x7ff29009f0f0 2023-09-30T22:31:55.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.412+0000 7ff295910700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff29009a8f0 con 0x7ff29009d920 2023-09-30T22:31:55.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.412+0000 7ff28f7fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff290133ca0 0x7ff290134100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58680/0 (socket says 172.21.15.40:58680) 2023-09-30T22:31:55.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.412+0000 7ff28f7fe700 1 -- 172.21.15.40:0/3422693324 learned_addr learned my addr 172.21.15.40:0/3422693324 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:55.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.413+0000 7ff28e7fc700 1 --2- 172.21.15.40:0/3422693324 >> v2:172.21.15.40:3300/0 conn(0x7ff29009f0f0 0x7ff29009e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:55.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.413+0000 7ff28dffb700 1 -- 172.21.15.40:0/3422693324 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1606662730 0 0) 0x7ff29009f940 con 0x7ff290133ca0 2023-09-30T22:31:55.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.413+0000 7ff28dffb700 1 -- 172.21.15.40:0/3422693324 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2780035b0 con 0x7ff290133ca0 2023-09-30T22:31:55.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.413+0000 7ff28e7fc700 1 -- 172.21.15.40:0/3422693324 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff29009d920 msgr2=0x7ff29009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:55.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.413+0000 7ff28e7fc700 1 --2- 172.21.15.40:0/3422693324 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff29009d920 0x7ff29009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.413+0000 7ff28e7fc700 1 -- 172.21.15.40:0/3422693324 >> v1:172.21.15.40:6789/0 conn(0x7ff290133ca0 legacy=0x7ff290134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:55.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.413+0000 7ff28e7fc700 1 -- 172.21.15.40:0/3422693324 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29009f6e0 con 0x7ff29009f0f0 2023-09-30T22:31:55.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.413+0000 7ff28e7fc700 1 --2- 172.21.15.40:0/3422693324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff29009f0f0 0x7ff29009e230 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7ff284009870 tx=0x7ff284009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ab1801bebdeaf4f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:55.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.413+0000 7ff28dffb700 1 -- 172.21.15.40:0/3422693324 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff284011830 con 0x7ff29009f0f0 2023-09-30T22:31:55.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.413+0000 7ff28dffb700 1 -- 172.21.15.40:0/3422693324 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff284011990 con 0x7ff29009f0f0 2023-09-30T22:31:55.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.413+0000 7ff28dffb700 1 -- 172.21.15.40:0/3422693324 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff284011d20 con 0x7ff29009f0f0 2023-09-30T22:31:55.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.414+0000 7fe9b0cdb700 1 Processor -- start 2023-09-30T22:31:55.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.414+0000 7fe9b0cdb700 1 -- start start 2023-09-30T22:31:55.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.414+0000 7fe9b0cdb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9ac09d920 0x7fe9ac1cc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:55.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.414+0000 7fe9b0cdb700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe9ac09e230 0x7fe9ac1cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:55.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.414+0000 7fe9b0cdb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9ac130fb0 0x7fe9ac1cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:55.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.414+0000 7fe9b0cdb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac11b330 con 0x7fe9ac130fb0 2023-09-30T22:31:55.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.414+0000 7fe9b0cdb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac119c50 con 0x7fe9ac09d920 2023-09-30T22:31:55.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.414+0000 7fe9b0cdb700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac11b7e0 con 0x7fe9ac09e230 2023-09-30T22:31:55.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.414+0000 7ff295910700 1 -- 172.21.15.40:0/3422693324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff29009f0f0 msgr2=0x7ff29009e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:55.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.414+0000 7ff295910700 1 --2- 172.21.15.40:0/3422693324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff29009f0f0 0x7ff29009e230 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7ff284009870 tx=0x7ff284009b80 comp rx=0 tx=0).stop 2023-09-30T22:31:55.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.414+0000 7fe9aa59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9ac09d920 0x7fe9ac1cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:55.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.414+0000 7fe9aa59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9ac09d920 0x7fe9ac1cc770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54456/0 (socket says 172.21.15.40:54456) 2023-09-30T22:31:55.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.414+0000 7fe9aa59c700 1 -- 172.21.15.40:0/2121302363 learned_addr learned my addr 172.21.15.40:0/2121302363 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:55.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.414+0000 7fe9aad9d700 1 --2- 172.21.15.40:0/2121302363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9ac130fb0 0x7fe9ac1cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:55.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.415+0000 7fe9a9d9b700 1 --2- 172.21.15.40:0/2121302363 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe9ac09e230 0x7fe9ac1cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:55.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.415+0000 7ff295910700 1 -- 172.21.15.40:0/3422693324 shutdown_connections 2023-09-30T22:31:55.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.415+0000 7ff295910700 1 --2- 172.21.15.40:0/3422693324 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff29009d920 0x7ff29009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.415+0000 7ff295910700 1 --2- 172.21.15.40:0/3422693324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff29009f0f0 0x7ff29009e230 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.415+0000 7ff295910700 1 -- 172.21.15.40:0/3422693324 >> 172.21.15.40:0/3422693324 conn(0x7ff29009fb20 msgr2=0x7ff29009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:55.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.415+0000 7fe9aa59c700 1 -- 172.21.15.40:0/2121302363 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe9ac09e230 msgr2=0x7fe9ac1cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:55.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.415+0000 7fe9aa59c700 1 --2- 172.21.15.40:0/2121302363 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe9ac09e230 0x7fe9ac1cccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.415+0000 7fe9aa59c700 1 -- 172.21.15.40:0/2121302363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9ac130fb0 msgr2=0x7fe9ac1cd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:55.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.415+0000 7fe9aa59c700 1 --2- 172.21.15.40:0/2121302363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9ac130fb0 0x7fe9ac1cd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.415+0000 7fe9aa59c700 1 -- 172.21.15.40:0/2121302363 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a4009a70 con 0x7fe9ac09d920 2023-09-30T22:31:55.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.415+0000 7fe9aad9d700 1 --2- 172.21.15.40:0/2121302363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9ac130fb0 0x7fe9ac1cd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:55.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.415+0000 7ff295910700 1 -- 172.21.15.40:0/3422693324 shutdown_connections 2023-09-30T22:31:55.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.415+0000 7ff295910700 1 -- 172.21.15.40:0/3422693324 wait complete. 2023-09-30T22:31:55.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.415+0000 7fe9aa59c700 1 --2- 172.21.15.40:0/2121302363 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9ac09d920 0x7fe9ac1cc770 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fe99c00e9c0 tx=0x7fe99c00ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:55.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.415+0000 7fe99affd700 1 -- 172.21.15.40:0/2121302363 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99c0096f0 con 0x7fe9ac09d920 2023-09-30T22:31:55.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.415+0000 7fe99affd700 1 -- 172.21.15.40:0/2121302363 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe99c00c850 con 0x7fe9ac09d920 2023-09-30T22:31:55.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.415+0000 7fe9b0cdb700 1 -- 172.21.15.40:0/2121302363 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9ac09cb00 con 0x7fe9ac09d920 2023-09-30T22:31:55.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.415+0000 7fe99affd700 1 -- 172.21.15.40:0/2121302363 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99c00cbc0 con 0x7fe9ac09d920 2023-09-30T22:31:55.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.415+0000 7fe9b0cdb700 1 -- 172.21.15.40:0/2121302363 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9ac11c250 con 0x7fe9ac09d920 2023-09-30T22:31:55.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.416+0000 7ff295910700 1 Processor -- start 2023-09-30T22:31:55.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.416+0000 7fe99affd700 1 -- 172.21.15.40:0/2121302363 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe99c00cd20 con 0x7fe9ac09d920 2023-09-30T22:31:55.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.416+0000 7fe99affd700 1 -- 172.21.15.40:0/2121302363 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7fe99c03fbc0 con 0x7fe9ac09d920 2023-09-30T22:31:55.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.417+0000 7ff295910700 1 -- start start 2023-09-30T22:31:55.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.417+0000 7fe9b0cdb700 1 -- 172.21.15.40:0/2121302363 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9900052e0 con 0x7fe9ac09d920 2023-09-30T22:31:55.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.417+0000 7ff295910700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff29009d920 0x7ff29011b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:55.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.417+0000 7ff295910700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff290133ca0 0x7ff29011bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:55.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.417+0000 7ff295910700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff29011c150 0x7ff2901ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:55.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.417+0000 7ff295910700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29011d170 con 0x7ff29011c150 2023-09-30T22:31:55.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.417+0000 7ff295910700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff29011d700 con 0x7ff290133ca0 2023-09-30T22:31:55.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.417+0000 7ff295910700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2900a27f0 con 0x7ff29009d920 2023-09-30T22:31:55.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.417+0000 7ff28effd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff29009d920 0x7ff29011b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:55.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.417+0000 7ff28effd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff29009d920 0x7ff29011b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:42038/0 (socket says 172.21.15.40:42038) 2023-09-30T22:31:55.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.417+0000 7ff28effd700 1 -- 172.21.15.40:0/1168554762 learned_addr learned my addr 172.21.15.40:0/1168554762 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:55.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.417+0000 7ff28e7fc700 1 --2- 172.21.15.40:0/1168554762 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff290133ca0 0x7ff29011bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:55.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.418+0000 7ff28effd700 1 -- 172.21.15.40:0/1168554762 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff290133ca0 msgr2=0x7ff29011bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:55.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.418+0000 7ff28effd700 1 --2- 172.21.15.40:0/1168554762 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff290133ca0 0x7ff29011bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.418+0000 7ff28effd700 1 -- 172.21.15.40:0/1168554762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff29011c150 msgr2=0x7ff2901ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:55.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.418+0000 7ff28effd700 1 --2- 172.21.15.40:0/1168554762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff29011c150 0x7ff2901ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.418+0000 7ff28effd700 1 -- 172.21.15.40:0/1168554762 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2840094a0 con 0x7ff29009d920 2023-09-30T22:31:55.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.418+0000 7ff28effd700 1 --2- 172.21.15.40:0/1168554762 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff29009d920 0x7ff29011b6d0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7ff28000b480 tx=0x7ff28000b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:55.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.418+0000 7ff277fff700 1 -- 172.21.15.40:0/1168554762 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff280005a00 con 0x7ff29009d920 2023-09-30T22:31:55.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.418+0000 7ff277fff700 1 -- 172.21.15.40:0/1168554762 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff280005b60 con 0x7ff29009d920 2023-09-30T22:31:55.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.418+0000 7ff295910700 1 -- 172.21.15.40:0/1168554762 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff29009c9e0 con 0x7ff29009d920 2023-09-30T22:31:55.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.418+0000 7ff277fff700 1 -- 172.21.15.40:0/1168554762 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff280011630 con 0x7ff29009d920 2023-09-30T22:31:55.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.418+0000 7ff295910700 1 -- 172.21.15.40:0/1168554762 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff290127b90 con 0x7ff29009d920 2023-09-30T22:31:55.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.419+0000 7ff277fff700 1 -- 172.21.15.40:0/1168554762 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff280011790 con 0x7ff29009d920 2023-09-30T22:31:55.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.419+0000 7ff277fff700 1 -- 172.21.15.40:0/1168554762 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7ff28003f2c0 con 0x7ff29009d920 2023-09-30T22:31:55.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.419+0000 7ff295910700 1 -- 172.21.15.40:0/1168554762 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff29011cb30 con 0x7ff29009d920 2023-09-30T22:31:55.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.422+0000 7fe99affd700 1 -- 172.21.15.40:0/2121302363 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe99c017080 con 0x7fe9ac09d920 2023-09-30T22:31:55.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.424+0000 7ff277fff700 1 -- 172.21.15.40:0/1168554762 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff280005f10 con 0x7ff29009d920 2023-09-30T22:31:55.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.621+0000 7fe9b0cdb700 1 -- 172.21.15.40:0/2121302363 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe990005590 con 0x7fe9ac09d920 2023-09-30T22:31:55.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.621+0000 7ff295910700 1 -- 172.21.15.40:0/1168554762 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff2901278b0 con 0x7ff29009d920 2023-09-30T22:31:55.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.621+0000 7fe99affd700 1 -- 172.21.15.40:0/2121302363 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe99c01b3b0 con 0x7fe9ac09d920 2023-09-30T22:31:55.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.621+0000 7ff277fff700 1 -- 172.21.15.40:0/1168554762 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff280029090 con 0x7ff29009d920 2023-09-30T22:31:55.623 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:55.623 INFO:teuthology.orchestra.run.smithi040.stdout:141733920771 2023-09-30T22:31:55.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.624+0000 7fe9b0cdb700 1 -- 172.21.15.40:0/2121302363 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9ac09d920 msgr2=0x7fe9ac1cc770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:55.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.624+0000 7fe9b0cdb700 1 --2- 172.21.15.40:0/2121302363 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9ac09d920 0x7fe9ac1cc770 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fe99c00e9c0 tx=0x7fe99c00ecd0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.624+0000 7ff295910700 1 -- 172.21.15.40:0/1168554762 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff29009d920 msgr2=0x7ff29011b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:55.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.624+0000 7ff295910700 1 --2- 172.21.15.40:0/1168554762 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff29009d920 0x7ff29011b6d0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7ff28000b480 tx=0x7ff28000b790 comp rx=0 tx=0).stop 2023-09-30T22:31:55.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.624+0000 7ff295910700 1 -- 172.21.15.40:0/1168554762 shutdown_connections 2023-09-30T22:31:55.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.624+0000 7ff295910700 1 --2- 172.21.15.40:0/1168554762 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7ff29009d920 0x7ff29011b6d0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.624+0000 7ff295910700 1 --2- 172.21.15.40:0/1168554762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff29011c150 0x7ff2901ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.624+0000 7ff295910700 1 --2- 172.21.15.40:0/1168554762 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff290133ca0 0x7ff29011bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.624+0000 7ff295910700 1 -- 172.21.15.40:0/1168554762 >> 172.21.15.40:0/1168554762 conn(0x7ff29009fb20 msgr2=0x7ff2900a0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:55.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.624+0000 7fe9b0cdb700 1 -- 172.21.15.40:0/2121302363 shutdown_connections 2023-09-30T22:31:55.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.624+0000 7fe9b0cdb700 1 --2- 172.21.15.40:0/2121302363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9ac130fb0 0x7fe9ac1cd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.624+0000 7fe9b0cdb700 1 --2- 172.21.15.40:0/2121302363 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9ac09d920 0x7fe9ac1cc770 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.624+0000 7fe9b0cdb700 1 --2- 172.21.15.40:0/2121302363 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7fe9ac09e230 0x7fe9ac1cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.624+0000 7fe9b0cdb700 1 -- 172.21.15.40:0/2121302363 >> 172.21.15.40:0/2121302363 conn(0x7fe9ac09fb20 msgr2=0x7fe9ac13a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:55.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.625+0000 7fe9b0cdb700 1 -- 172.21.15.40:0/2121302363 shutdown_connections 2023-09-30T22:31:55.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.625+0000 7ff295910700 1 -- 172.21.15.40:0/1168554762 shutdown_connections 2023-09-30T22:31:55.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.625+0000 7ff295910700 1 -- 172.21.15.40:0/1168554762 wait complete. 2023-09-30T22:31:55.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.625+0000 7fe9b0cdb700 1 -- 172.21.15.40:0/2121302363 wait complete. 2023-09-30T22:31:55.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.632+0000 7f5934c31700 1 -- 172.21.15.40:0/2740391553 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5930093770 con 0x7f593006ced0 2023-09-30T22:31:55.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.632+0000 7f591effd700 1 -- 172.21.15.40:0/2740391553 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5930093770 con 0x7f593006ced0 2023-09-30T22:31:55.633 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:55.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.634+0000 7f5934c31700 1 -- 172.21.15.40:0/2740391553 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f593006ced0 msgr2=0x7f5930090660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:55.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.634+0000 7f5934c31700 1 --2- 172.21.15.40:0/2740391553 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f593006ced0 0x7f5930090660 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f5920009870 tx=0x7f5920004750 comp rx=0 tx=0).stop 2023-09-30T22:31:55.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.634+0000 7f5934c31700 1 -- 172.21.15.40:0/2740391553 shutdown_connections 2023-09-30T22:31:55.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.634+0000 7f5934c31700 1 --2- 172.21.15.40:0/2740391553 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f593006ced0 0x7f5930090660 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.634+0000 7f5934c31700 1 --2- 172.21.15.40:0/2740391553 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5930138370 0x7f59300910e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.634+0000 7f5934c31700 1 --2- 172.21.15.40:0/2740391553 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f593009fbb0 0x7f5930090ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:55.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.634+0000 7f5934c31700 1 -- 172.21.15.40:0/2740391553 >> 172.21.15.40:0/2740391553 conn(0x7f59300a41a0 msgr2=0x7f5930137590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:55.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.634+0000 7f5934c31700 1 -- 172.21.15.40:0/2740391553 shutdown_connections 2023-09-30T22:31:55.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:55.634+0000 7f5934c31700 1 -- 172.21.15.40:0/2740391553 wait complete. 2023-09-30T22:31:55.645 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:31:55.646 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920772 got 141733920771 for osd.2 2023-09-30T22:31:55.649 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:56.646 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:31:56.649 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:31:56.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.789+0000 7f1d78aa8700 1 Processor -- start 2023-09-30T22:31:56.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.790+0000 7f1d78aa8700 1 -- start start 2023-09-30T22:31:56.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.790+0000 7f1152ecf700 1 Processor -- start 2023-09-30T22:31:56.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.790+0000 7f1152ecf700 1 -- start start 2023-09-30T22:31:56.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.790+0000 7f1152ecf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f114c09d920 0x7f114c09dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:56.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.790+0000 7f1152ecf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f114c09e230 0x7f114c1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:56.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.790+0000 7f1152ecf700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f114c09f940 con 0x7f114c09f0f0 2023-09-30T22:31:56.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.790+0000 7f1152ecf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f114c06b4c0 con 0x7f114c09e230 2023-09-30T22:31:56.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.790+0000 7f1152ecf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f114c09a8f0 con 0x7f114c09d920 2023-09-30T22:31:56.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.790+0000 7f1150c6b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f114c09d920 0x7f114c09dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:56.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.790+0000 7f1150c6b700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f114c09d920 0x7f114c09dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:42048/0 (socket says 172.21.15.40:42048) 2023-09-30T22:31:56.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.790+0000 7f1d78aa8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d7409f0f0 0x7f1d74138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:56.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.790+0000 7f1d78aa8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d7409e400 0x7f1d7413b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:56.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.790+0000 7f1d78aa8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d7409f940 con 0x7f1d7409d920 2023-09-30T22:31:56.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.790+0000 7f1d78aa8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7406b4c0 con 0x7f1d7409e400 2023-09-30T22:31:56.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.790+0000 7f1d78aa8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7409a8f0 con 0x7f1d7409f0f0 2023-09-30T22:31:56.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.790+0000 7f1150c6b700 1 -- 172.21.15.40:0/369872518 learned_addr learned my addr 172.21.15.40:0/369872518 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:56.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.791+0000 7f115146c700 1 --2- 172.21.15.40:0/369872518 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f114c09e230 0x7f114c1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:56.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.791+0000 7f1d72d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d7409e400 0x7f1d7413b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:56.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.791+0000 7f1d7259c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1d7409d920 0x7f1d7409dcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58696/0 (socket says 172.21.15.40:58696) 2023-09-30T22:31:56.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.791+0000 7f1d7259c700 1 -- 172.21.15.40:0/2074442899 learned_addr learned my addr 172.21.15.40:0/2074442899 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:31:56.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.791+0000 7f1d71d9b700 1 --2- 172.21.15.40:0/2074442899 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d7409f0f0 0x7f1d74138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:56.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.791+0000 7f1d72d9d700 1 -- 172.21.15.40:0/2074442899 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d7409f0f0 msgr2=0x7f1d74138ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:56.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.791+0000 7f1d72d9d700 1 --2- 172.21.15.40:0/2074442899 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d7409f0f0 0x7f1d74138ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:56.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.791+0000 7f1d72d9d700 1 -- 172.21.15.40:0/2074442899 >> v1:172.21.15.40:6789/0 conn(0x7f1d7409d920 legacy=0x7f1d7409dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:56.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.791+0000 7f1d7159a700 1 -- 172.21.15.40:0/2074442899 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2974483425 0 0) 0x7f1d7409f940 con 0x7f1d7409d920 2023-09-30T22:31:56.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.791+0000 7f1d72d9d700 1 -- 172.21.15.40:0/2074442899 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7409f6e0 con 0x7f1d7409e400 2023-09-30T22:31:56.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.791+0000 7f1150c6b700 1 -- 172.21.15.40:0/369872518 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f114c09e230 msgr2=0x7f114c1343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:56.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.791+0000 7f1150c6b700 1 --2- 172.21.15.40:0/369872518 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f114c09e230 0x7f114c1343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:56.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.791+0000 7f1150c6b700 1 -- 172.21.15.40:0/369872518 >> v1:172.21.15.40:6789/0 conn(0x7f114c09f0f0 legacy=0x7f114c133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:56.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.791+0000 7f1150c6b700 1 -- 172.21.15.40:0/369872518 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f114c09f6e0 con 0x7f114c09d920 2023-09-30T22:31:56.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.791+0000 7f114b7fe700 1 -- 172.21.15.40:0/369872518 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3175466890 0 0) 0x7f114c09f940 con 0x7f114c09f0f0 2023-09-30T22:31:56.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.791+0000 7f1d72d9d700 1 --2- 172.21.15.40:0/2074442899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d7409e400 0x7f1d7413b430 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c009dc0 tx=0x7f1d6c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28216b90b3b4b5bb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:56.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.791+0000 7f1150c6b700 1 --2- 172.21.15.40:0/369872518 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f114c09d920 0x7f114c09dcf0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f1140009920 tx=0x7f1140009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f6f6b3c7a1753a9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:56.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.791+0000 7f1d7159a700 1 -- 172.21.15.40:0/2074442899 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c00e070 con 0x7f1d7409e400 2023-09-30T22:31:56.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.791+0000 7f114b7fe700 1 -- 172.21.15.40:0/369872518 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1140005e30 con 0x7f114c09d920 2023-09-30T22:31:56.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.791+0000 7f1d7159a700 1 -- 172.21.15.40:0/2074442899 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6c00bb20 con 0x7f1d7409e400 2023-09-30T22:31:56.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.791+0000 7f1d7159a700 1 -- 172.21.15.40:0/2074442899 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c012430 con 0x7f1d7409e400 2023-09-30T22:31:56.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.792+0000 7f114b7fe700 1 -- 172.21.15.40:0/369872518 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1140004030 con 0x7f114c09d920 2023-09-30T22:31:56.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.792+0000 7f114b7fe700 1 -- 172.21.15.40:0/369872518 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11400043e0 con 0x7f114c09d920 2023-09-30T22:31:56.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.792+0000 7f1d78aa8700 1 -- 172.21.15.40:0/2074442899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d7409e400 msgr2=0x7f1d7413b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:56.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.792+0000 7f1d78aa8700 1 --2- 172.21.15.40:0/2074442899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d7409e400 0x7f1d7413b430 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c009dc0 tx=0x7f1d6c00b330 comp rx=0 tx=0).stop 2023-09-30T22:31:56.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.792+0000 7f1152ecf700 1 -- 172.21.15.40:0/369872518 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f114c09d920 msgr2=0x7f114c09dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:56.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.792+0000 7f1152ecf700 1 --2- 172.21.15.40:0/369872518 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f114c09d920 0x7f114c09dcf0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f1140009920 tx=0x7f1140009c30 comp rx=0 tx=0).stop 2023-09-30T22:31:56.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.792+0000 7f1d78aa8700 1 -- 172.21.15.40:0/2074442899 shutdown_connections 2023-09-30T22:31:56.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.792+0000 7f1d78aa8700 1 --2- 172.21.15.40:0/2074442899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d7409e400 0x7f1d7413b430 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:56.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.792+0000 7f1d78aa8700 1 --2- 172.21.15.40:0/2074442899 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d7409f0f0 0x7f1d74138ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:56.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.792+0000 7f1d78aa8700 1 -- 172.21.15.40:0/2074442899 >> 172.21.15.40:0/2074442899 conn(0x7f1d7409fb20 msgr2=0x7f1d7409ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:56.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.792+0000 7f1152ecf700 1 -- 172.21.15.40:0/369872518 shutdown_connections 2023-09-30T22:31:56.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.792+0000 7f1152ecf700 1 --2- 172.21.15.40:0/369872518 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f114c09e230 0x7f114c1343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:56.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.792+0000 7f1152ecf700 1 --2- 172.21.15.40:0/369872518 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f114c09d920 0x7f114c09dcf0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:56.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.792+0000 7f1152ecf700 1 -- 172.21.15.40:0/369872518 >> 172.21.15.40:0/369872518 conn(0x7f114c09fb20 msgr2=0x7f114c09ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:56.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.792+0000 7f1d78aa8700 1 -- 172.21.15.40:0/2074442899 shutdown_connections 2023-09-30T22:31:56.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.792+0000 7f1152ecf700 1 -- 172.21.15.40:0/369872518 shutdown_connections 2023-09-30T22:31:56.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.792+0000 7f1152ecf700 1 -- 172.21.15.40:0/369872518 wait complete. 2023-09-30T22:31:56.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.792+0000 7f1d78aa8700 1 -- 172.21.15.40:0/2074442899 wait complete. 2023-09-30T22:31:56.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.793+0000 7f1152ecf700 1 Processor -- start 2023-09-30T22:31:56.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.793+0000 7f1152ecf700 1 -- start start 2023-09-30T22:31:56.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.793+0000 7f1d78aa8700 1 Processor -- start 2023-09-30T22:31:56.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.794+0000 7f1d78aa8700 1 -- start start 2023-09-30T22:31:56.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.794+0000 7f1152ecf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f114c09d920 0x7f114c122940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:56.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.794+0000 7f1152ecf700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f114c09e230 0x7f114c122e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:56.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.794+0000 7f1152ecf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f114c1233c0 0x7f114c1c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:56.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.794+0000 7f1152ecf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114c126210 con 0x7f114c1233c0 2023-09-30T22:31:56.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.794+0000 7f1152ecf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f114c124500 con 0x7f114c09d920 2023-09-30T22:31:56.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.794+0000 7f1152ecf700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f114c09c9e0 con 0x7f114c09e230 2023-09-30T22:31:56.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.794+0000 7f1d78aa8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d7409d920 0x7f1d7411db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:56.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.794+0000 7f1d78aa8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d7409e400 0x7f1d7411e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:56.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.794+0000 7f1d78aa8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d7411e5c0 0x7f1d741ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:56.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.794+0000 7f1d78aa8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7411fe70 con 0x7f1d7409d920 2023-09-30T22:31:56.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.794+0000 7f1d78aa8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7411f180 con 0x7f1d7409e400 2023-09-30T22:31:56.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.794+0000 7f1d78aa8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d740a2fb0 con 0x7f1d7411e5c0 2023-09-30T22:31:56.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.794+0000 7f114bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f114c09e230 0x7f114c122e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:56.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.794+0000 7f115146c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f114c1233c0 0x7f114c1c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:56.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.794+0000 7f114bfff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f114c09e230 0x7f114c122e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:42056/0 (socket says 172.21.15.40:42056) 2023-09-30T22:31:56.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.794+0000 7f114bfff700 1 -- 172.21.15.40:0/1194008902 learned_addr learned my addr 172.21.15.40:0/1194008902 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:56.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.794+0000 7f1150c6b700 1 --2- 172.21.15.40:0/1194008902 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f114c09d920 0x7f114c122940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:56.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.794+0000 7f1d71d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d7409e400 0x7f1d7411e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:56.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.794+0000 7f1d71d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d7409e400 0x7f1d7411e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:54510/0 (socket says 172.21.15.40:54510) 2023-09-30T22:31:56.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.794+0000 7f1d71d9b700 1 -- 172.21.15.40:0/3211817916 learned_addr learned my addr 172.21.15.40:0/3211817916 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:31:56.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.794+0000 7f1d7259c700 1 --2- 172.21.15.40:0/3211817916 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d7409d920 0x7f1d7411db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:56.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.794+0000 7f1d72d9d700 1 --2- 172.21.15.40:0/3211817916 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d7411e5c0 0x7f1d741ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:56.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.795+0000 7f114bfff700 1 -- 172.21.15.40:0/1194008902 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f114c09d920 msgr2=0x7f114c122940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:56.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.795+0000 7f114bfff700 1 --2- 172.21.15.40:0/1194008902 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f114c09d920 0x7f114c122940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:56.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.795+0000 7f114bfff700 1 -- 172.21.15.40:0/1194008902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f114c1233c0 msgr2=0x7f114c1c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:56.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.795+0000 7f114bfff700 1 --2- 172.21.15.40:0/1194008902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f114c1233c0 0x7f114c1c8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:56.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.795+0000 7f114bfff700 1 -- 172.21.15.40:0/1194008902 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1140009500 con 0x7f114c09e230 2023-09-30T22:31:56.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.795+0000 7f1150c6b700 1 --2- 172.21.15.40:0/1194008902 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f114c09d920 0x7f114c122940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:56.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.795+0000 7f1d71d9b700 1 -- 172.21.15.40:0/3211817916 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d7411e5c0 msgr2=0x7f1d741ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:56.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.795+0000 7f1d71d9b700 1 --2- 172.21.15.40:0/3211817916 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d7411e5c0 0x7f1d741ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:56.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.795+0000 7f1d71d9b700 1 -- 172.21.15.40:0/3211817916 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d7409d920 msgr2=0x7f1d7411db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:56.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.795+0000 7f1d71d9b700 1 --2- 172.21.15.40:0/3211817916 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d7409d920 0x7f1d7411db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:56.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.795+0000 7f1d71d9b700 1 -- 172.21.15.40:0/3211817916 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d6c009a70 con 0x7f1d7409e400 2023-09-30T22:31:56.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.795+0000 7f114bfff700 1 --2- 172.21.15.40:0/1194008902 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f114c09e230 0x7f114c122e80 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f113800c520 tx=0x7f113800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:56.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.795+0000 7f1d71d9b700 1 --2- 172.21.15.40:0/3211817916 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d7409e400 0x7f1d7411e080 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f1d6800e9e0 tx=0x7f1d6800ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:56.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.795+0000 7f1d62ffd700 1 -- 172.21.15.40:0/3211817916 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d68009710 con 0x7f1d7409e400 2023-09-30T22:31:56.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.795+0000 7f11497fa700 1 -- 172.21.15.40:0/1194008902 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11380054e0 con 0x7f114c09e230 2023-09-30T22:31:56.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.795+0000 7f11497fa700 1 -- 172.21.15.40:0/1194008902 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1138003680 con 0x7f114c09e230 2023-09-30T22:31:56.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.795+0000 7f1152ecf700 1 -- 172.21.15.40:0/1194008902 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f114c133410 con 0x7f114c09e230 2023-09-30T22:31:56.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.795+0000 7f1d78aa8700 1 -- 172.21.15.40:0/3211817916 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d74120150 con 0x7f1d7409e400 2023-09-30T22:31:56.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.795+0000 7f11497fa700 1 -- 172.21.15.40:0/1194008902 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1138003a10 con 0x7f114c09e230 2023-09-30T22:31:56.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.795+0000 7f1152ecf700 1 -- 172.21.15.40:0/1194008902 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f114c126ba0 con 0x7f114c09e230 2023-09-30T22:31:56.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.795+0000 7f1d78aa8700 1 -- 172.21.15.40:0/3211817916 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d7411ebe0 con 0x7f1d7409e400 2023-09-30T22:31:56.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.796+0000 7f11497fa700 1 -- 172.21.15.40:0/1194008902 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1138003b70 con 0x7f114c09e230 2023-09-30T22:31:56.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.796+0000 7f1152ecf700 1 -- 172.21.15.40:0/1194008902 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f114c126050 con 0x7f114c09e230 2023-09-30T22:31:56.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.796+0000 7f1d62ffd700 1 -- 172.21.15.40:0/3211817916 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6800ee80 con 0x7f1d7409e400 2023-09-30T22:31:56.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.796+0000 7f1d62ffd700 1 -- 172.21.15.40:0/3211817916 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6800ca50 con 0x7f1d7409e400 2023-09-30T22:31:56.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.796+0000 7f1d62ffd700 1 -- 172.21.15.40:0/3211817916 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1d6800cc30 con 0x7f1d7409e400 2023-09-30T22:31:56.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.797+0000 7f11497fa700 1 -- 172.21.15.40:0/1194008902 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f113803eb60 con 0x7f114c09e230 2023-09-30T22:31:56.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.797+0000 7f1d62ffd700 1 -- 172.21.15.40:0/3211817916 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f1d6803ffe0 con 0x7f1d7409e400 2023-09-30T22:31:56.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.797+0000 7f1d78aa8700 1 -- 172.21.15.40:0/3211817916 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d7411e9c0 con 0x7f1d7409e400 2023-09-30T22:31:56.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.801+0000 7f11497fa700 1 -- 172.21.15.40:0/1194008902 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1138019d20 con 0x7f114c09e230 2023-09-30T22:31:56.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.802+0000 7f1d62ffd700 1 -- 172.21.15.40:0/3211817916 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1d68017020 con 0x7f1d7409e400 2023-09-30T22:31:56.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.997+0000 7f1d78aa8700 1 -- 172.21.15.40:0/3211817916 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1d7411ffb0 con 0x7f1d7409e400 2023-09-30T22:31:56.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.997+0000 7f1d62ffd700 1 -- 172.21.15.40:0/3211817916 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1d7411ffb0 con 0x7f1d7409e400 2023-09-30T22:31:56.998 INFO:teuthology.orchestra.run.smithi040.stdout:146028888066 2023-09-30T22:31:57.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.999+0000 7f1d78aa8700 1 -- 172.21.15.40:0/3211817916 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d7409e400 msgr2=0x7f1d7411e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:57.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.999+0000 7f1d78aa8700 1 --2- 172.21.15.40:0/3211817916 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d7409e400 0x7f1d7411e080 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f1d6800e9e0 tx=0x7f1d6800ecf0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.999+0000 7f1d78aa8700 1 -- 172.21.15.40:0/3211817916 shutdown_connections 2023-09-30T22:31:57.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.999+0000 7f1d78aa8700 1 --2- 172.21.15.40:0/3211817916 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f1d7411e5c0 0x7f1d741ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.999+0000 7f1d78aa8700 1 --2- 172.21.15.40:0/3211817916 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d7409d920 0x7f1d7411db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.999+0000 7f1d78aa8700 1 --2- 172.21.15.40:0/3211817916 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1d7409e400 0x7f1d7411e080 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.999+0000 7f1d78aa8700 1 -- 172.21.15.40:0/3211817916 >> 172.21.15.40:0/3211817916 conn(0x7f1d7409fb20 msgr2=0x7f1d74137000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:57.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.999+0000 7f1d78aa8700 1 -- 172.21.15.40:0/3211817916 shutdown_connections 2023-09-30T22:31:57.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:56.999+0000 7f1d78aa8700 1 -- 172.21.15.40:0/3211817916 wait complete. 2023-09-30T22:31:57.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:57.000+0000 7f1152ecf700 1 -- 172.21.15.40:0/1194008902 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f114c062380 con 0x7f114c09e230 2023-09-30T22:31:57.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:57.000+0000 7f11497fa700 1 -- 172.21.15.40:0/1194008902 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f11380192c0 con 0x7f114c09e230 2023-09-30T22:31:57.001 INFO:teuthology.orchestra.run.smithi040.stdout:137438953475 2023-09-30T22:31:57.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:57.002+0000 7f1152ecf700 1 -- 172.21.15.40:0/1194008902 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f114c09e230 msgr2=0x7f114c122e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:57.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:57.002+0000 7f1152ecf700 1 --2- 172.21.15.40:0/1194008902 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f114c09e230 0x7f114c122e80 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f113800c520 tx=0x7f113800c830 comp rx=0 tx=0).stop 2023-09-30T22:31:57.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:57.003+0000 7f1152ecf700 1 -- 172.21.15.40:0/1194008902 shutdown_connections 2023-09-30T22:31:57.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:57.003+0000 7f1152ecf700 1 --2- 172.21.15.40:0/1194008902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f114c1233c0 0x7f114c1c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:57.003+0000 7f1152ecf700 1 --2- 172.21.15.40:0/1194008902 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f114c09d920 0x7f114c122940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:57.003+0000 7f1152ecf700 1 --2- 172.21.15.40:0/1194008902 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f114c09e230 0x7f114c122e80 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:57.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:57.003+0000 7f1152ecf700 1 -- 172.21.15.40:0/1194008902 >> 172.21.15.40:0/1194008902 conn(0x7f114c09fb20 msgr2=0x7f114c070720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:57.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:57.003+0000 7f1152ecf700 1 -- 172.21.15.40:0/1194008902 shutdown_connections 2023-09-30T22:31:57.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:31:57.003+0000 7f1152ecf700 1 -- 172.21.15.40:0/1194008902 wait complete. 2023-09-30T22:31:57.014 INFO:tasks.ceph.ceph_manager.ceph:need seq 146028888068 got 146028888066 for osd.3 2023-09-30T22:31:57.016 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.0 2023-09-30T22:33:55.223 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-09-30T22:33:55.224 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1496, in healthy manager.wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi040 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-09-30T22:33:55.294 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=d13c5f9f650d44d780f094bf1084cdea Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1496, in healthy manager.wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi040 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-09-30T22:33:55.298 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2023-09-30T22:33:55.309 DEBUG:teuthology.run_tasks:Unwinding manager ceph.stop 2023-09-30T22:33:55.343 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2023-09-30T22:33:55.393 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2023-09-30T22:33:55.443 DEBUG:teuthology.run_tasks:Unwinding manager install.upgrade 2023-09-30T22:33:55.493 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-09-30T22:33:55.543 INFO:tasks.kclient:Unmounting kernel clients... 2023-09-30T22:33:55.544 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-09-30T22:33:55.544 DEBUG:teuthology.orchestra.run.smithi158:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T22:33:55.601 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-09-30T22:33:55.602 DEBUG:teuthology.orchestra.run.smithi158:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T22:33:55.649 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:33:55.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.789+0000 7f3d965fd700 1 Processor -- start 2023-09-30T22:33:55.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.789+0000 7f3d965fd700 1 -- start start 2023-09-30T22:33:55.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.789+0000 7f3d965fd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d9009c890 0x7f3d9009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:55.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.789+0000 7f3d965fd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3d9009d920 0x7f3d9009dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:55.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.790+0000 7f3d965fd700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d900a2600 con 0x7f3d9009e2b0 2023-09-30T22:33:55.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.790+0000 7f3d965fd700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d900a29d0 con 0x7f3d9009d920 2023-09-30T22:33:55.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.790+0000 7f3d965fd700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9009fb40 con 0x7f3d9009c890 2023-09-30T22:33:55.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.790+0000 7f3d8f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3d9009d920 0x7f3d9009dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:55.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.790+0000 7f3d8ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d9009c890 0x7f3d9009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:55.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.790+0000 7f3d8ffff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d9009c890 0x7f3d9009cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:34504/0 (socket says 172.21.15.40:34504) 2023-09-30T22:33:55.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.790+0000 7f3d8f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3d9009d920 0x7f3d9009dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43858/0 (socket says 172.21.15.40:43858) 2023-09-30T22:33:55.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.790+0000 7f3d8ffff700 1 -- 172.21.15.40:0/2187627913 learned_addr learned my addr 172.21.15.40:0/2187627913 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:33:55.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.790+0000 7f3d8ffff700 1 -- 172.21.15.40:0/2187627913 >> v2:172.21.15.40:3300/0 conn(0x7f3d9009d920 msgr2=0x7f3d9009dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:55.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.790+0000 7f3d8ffff700 1 --2- 172.21.15.40:0/2187627913 >> v2:172.21.15.40:3300/0 conn(0x7f3d9009d920 0x7f3d9009dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:55.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.790+0000 7f3d8ffff700 1 -- 172.21.15.40:0/2187627913 >> v1:172.21.15.40:6789/0 conn(0x7f3d9009e2b0 legacy=0x7f3d9013ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:55.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.790+0000 7f3d8ffff700 1 -- 172.21.15.40:0/2187627913 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9009e750 con 0x7f3d9009c890 2023-09-30T22:33:55.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.790+0000 7f3d8ffff700 1 --2- 172.21.15.40:0/2187627913 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d9009c890 0x7f3d9009cc60 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f3d80006fd0 tx=0x7f3d80009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=598d801e4b7806c6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:55.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.790+0000 7f3d8effd700 1 -- 172.21.15.40:0/2187627913 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d80005e30 con 0x7f3d9009c890 2023-09-30T22:33:55.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.790+0000 7f3d8effd700 1 -- 172.21.15.40:0/2187627913 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d80004030 con 0x7f3d9009c890 2023-09-30T22:33:55.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.790+0000 7f3d8effd700 1 -- 172.21.15.40:0/2187627913 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d800043e0 con 0x7f3d9009c890 2023-09-30T22:33:55.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.791+0000 7f3d965fd700 1 -- 172.21.15.40:0/2187627913 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d9009c890 msgr2=0x7f3d9009cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:55.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.791+0000 7f3d965fd700 1 --2- 172.21.15.40:0/2187627913 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d9009c890 0x7f3d9009cc60 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f3d80006fd0 tx=0x7f3d80009bd0 comp rx=0 tx=0).stop 2023-09-30T22:33:55.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.791+0000 7f3d965fd700 1 -- 172.21.15.40:0/2187627913 shutdown_connections 2023-09-30T22:33:55.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.791+0000 7f3d965fd700 1 --2- 172.21.15.40:0/2187627913 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d9009c890 0x7f3d9009cc60 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:55.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.791+0000 7f3d965fd700 1 --2- 172.21.15.40:0/2187627913 >> v2:172.21.15.40:3300/0 conn(0x7f3d9009d920 0x7f3d9009dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:55.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.791+0000 7f3d965fd700 1 -- 172.21.15.40:0/2187627913 >> 172.21.15.40:0/2187627913 conn(0x7f3d900a7080 msgr2=0x7f3d900a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:55.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.791+0000 7f3d965fd700 1 -- 172.21.15.40:0/2187627913 shutdown_connections 2023-09-30T22:33:55.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.791+0000 7f3d965fd700 1 -- 172.21.15.40:0/2187627913 wait complete. 2023-09-30T22:33:55.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.792+0000 7f3d965fd700 1 Processor -- start 2023-09-30T22:33:55.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.792+0000 7f3d965fd700 1 -- start start 2023-09-30T22:33:55.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.793+0000 7f3d965fd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d9009c890 0x7f3d901c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:55.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.793+0000 7f3d965fd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d9009d920 0x7f3d901c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:55.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.793+0000 7f3d965fd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d9009e2b0 0x7f3d901c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:55.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.793+0000 7f3d965fd700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d90130d10 con 0x7f3d9009e2b0 2023-09-30T22:33:55.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.793+0000 7f3d965fd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9009c250 con 0x7f3d9009c890 2023-09-30T22:33:55.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.793+0000 7f3d965fd700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9009ed60 con 0x7f3d9009d920 2023-09-30T22:33:55.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.793+0000 7f3d8ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d9009c890 0x7f3d901c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:55.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.793+0000 7f3d94b9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d9009e2b0 0x7f3d901c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:55.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.793+0000 7f3d8ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d9009c890 0x7f3d901c89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:56698/0 (socket says 172.21.15.40:56698) 2023-09-30T22:33:55.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.793+0000 7f3d8ffff700 1 -- 172.21.15.40:0/1527147111 learned_addr learned my addr 172.21.15.40:0/1527147111 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:33:55.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.793+0000 7f3d8f7fe700 1 --2- 172.21.15.40:0/1527147111 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d9009d920 0x7f3d901c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:55.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.793+0000 7f3d94b9a700 1 -- 172.21.15.40:0/1527147111 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d9009d920 msgr2=0x7f3d901c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:55.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.793+0000 7f3d94b9a700 1 --2- 172.21.15.40:0/1527147111 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d9009d920 0x7f3d901c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:55.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.793+0000 7f3d94b9a700 1 -- 172.21.15.40:0/1527147111 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d9009c890 msgr2=0x7f3d901c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:55.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.793+0000 7f3d94b9a700 1 --2- 172.21.15.40:0/1527147111 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d9009c890 0x7f3d901c89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:55.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.793+0000 7f3d94b9a700 1 -- 172.21.15.40:0/1527147111 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d80009500 con 0x7f3d9009e2b0 2023-09-30T22:33:55.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.793+0000 7f3d8ffff700 1 --2- 172.21.15.40:0/1527147111 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d9009c890 0x7f3d901c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:55.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.793+0000 7f3d8f7fe700 1 --2- 172.21.15.40:0/1527147111 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d9009d920 0x7f3d901c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:55.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.793+0000 7f3d94b9a700 1 --2- 172.21.15.40:0/1527147111 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d9009e2b0 0x7f3d901c9460 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f3d8800cbc0 tx=0x7f3d8800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:55.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.793+0000 7f3d8cff9700 1 -- 172.21.15.40:0/1527147111 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d88003c00 con 0x7f3d9009e2b0 2023-09-30T22:33:55.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.794+0000 7f3d8cff9700 1 -- 172.21.15.40:0/1527147111 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d88003d60 con 0x7f3d9009e2b0 2023-09-30T22:33:55.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.794+0000 7f3d8cff9700 1 -- 172.21.15.40:0/1527147111 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8800a980 con 0x7f3d9009e2b0 2023-09-30T22:33:55.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.794+0000 7f3d965fd700 1 -- 172.21.15.40:0/1527147111 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d900a5d00 con 0x7f3d9009e2b0 2023-09-30T22:33:55.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.794+0000 7f3d965fd700 1 -- 172.21.15.40:0/1527147111 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d90130990 con 0x7f3d9009e2b0 2023-09-30T22:33:55.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.795+0000 7f3d8cff9700 1 -- 172.21.15.40:0/1527147111 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3d8800aae0 con 0x7f3d9009e2b0 2023-09-30T22:33:55.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.795+0000 7f3d8cff9700 1 -- 172.21.15.40:0/1527147111 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f3d8803f610 con 0x7f3d9009e2b0 2023-09-30T22:33:55.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.795+0000 7f3d965fd700 1 -- 172.21.15.40:0/1527147111 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d90062380 con 0x7f3d9009e2b0 2023-09-30T22:33:55.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.800+0000 7f3d8cff9700 1 -- 172.21.15.40:0/1527147111 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3d88012420 con 0x7f3d9009e2b0 2023-09-30T22:33:55.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.995+0000 7f3d965fd700 1 -- 172.21.15.40:0/1527147111 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d90074620 con 0x7f3d9009e2b0 2023-09-30T22:33:55.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.996+0000 7f3d8cff9700 1 -- 172.21.15.40:0/1527147111 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+13523 (secure 0 0 0) 0x7f3d88011380 con 0x7f3d9009e2b0 2023-09-30T22:33:55.996 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-09-30T22:33:55.997 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":42,"fsid":"79dd4d8e-f295-4d9c-bd93-9850863800e3","created":"2023-09-30T22:21:46.980357+0000","modified":"2023-09-30T22:25:23.520733+0000","last_up_change":"2023-09-30T22:24:43.600612+0000","last_in_change":"2023-09-30T22:21:48.205613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:21:54.875024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:21:56.197012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:22:00.759069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:22:01.327265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"771f785c-f464-4b17-936c-cbf31b1153e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":32,"up_thru":34,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6808","nonce":130098}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6809","nonce":130098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6811","nonce":130098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6810","nonce":130098}]},"public_addr":"172.21.15.40:6808/130098","cluster_addr":"172.21.15.40:6809/130098","heartbeat_back_addr":"172.21.15.40:6811/130098","heartbeat_front_addr":"172.21.15.40:6810/130098","state":["exists","up"]},{"osd":1,"uuid":"45f1e2e8-5310-4219-ab54-424e7440fcea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":33,"up_thru":34,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6800","nonce":130196}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6801","nonce":130196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6803","nonce":130196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6802","nonce":130196}]},"public_addr":"172.21.15.40:6800/130196","cluster_addr":"172.21.15.40:6801/130196","heartbeat_back_addr":"172.21.15.40:6803/130196","heartbeat_front_addr":"172.21.15.40:6802/130196","state":["exists","up"]},{"osd":2,"uuid":"7ba62ae5-d21e-4d56-b46c-ba7b718ede25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":27,"up_from":33,"up_thru":34,"down_at":28,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6804","nonce":130328}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6805","nonce":130328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6807","nonce":130328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6806","nonce":130328}]},"public_addr":"172.21.15.40:6804/130328","cluster_addr":"172.21.15.40:6805/130328","heartbeat_back_addr":"172.21.15.40:6807/130328","heartbeat_front_addr":"172.21.15.40:6806/130328","state":["exists","up"]},{"osd":3,"uuid":"c9c55985-8a90-4927-a8fa-6a1fcec1cd3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":28,"up_from":34,"up_thru":34,"down_at":29,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6812","nonce":130646}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6813","nonce":130646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6815","nonce":130646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.40:6814","nonce":130646}]},"public_addr":"172.21.15.40:6812/130646","cluster_addr":"172.21.15.40:6813/130646","heartbeat_back_addr":"172.21.15.40:6815/130646","heartbeat_front_addr":"172.21.15.40:6814/130646","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.339829+0000","dead_epoch":26},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.554690+0000","dead_epoch":27},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.641664+0000","dead_epoch":28},{"osd":3,"down_stamp":"2023-09-30T22:24:37.547345+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:21:53.320635+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2},{"from":1,"to":0}]},{"pgid":"4.1","mappings":[{"from":3,"to":0}]},{"pgid":"4.9","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.12","mappings":[{"from":3,"to":0}]},{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":3,"to":2},{"from":1,"to":0}]},{"pgid":"4.2c","mappings":[{"from":1,"to":2}]},{"pgid":"4.3f","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:0/3091130082":"2023-10-01T22:25:23.520704+0000","172.21.15.40:6816/127432":"2023-10-01T22:25:23.520704+0000","172.21.15.40:0/778194028":"2023-10-01T22:25:23.520704+0000","172.21.15.40:0/499521639":"2023-10-01T22:25:23.520704+0000","172.21.15.40:0/968436005":"2023-10-01T22:25:23.520704+0000","172.21.15.40:0/1764460125":"2023-10-01T22:24:24.127340+0000","172.21.15.40:0/1146580499":"2023-10-01T22:25:23.520704+0000","172.21.15.40:6816/118905":"2023-10-01T22:24:24.127340+0000","172.21.15.40:0/1890660785":"2023-10-01T22:24:24.127340+0000","172.21.15.40:6817/2392027806":"2023-10-01T22:24:50.682728+0000","172.21.15.40:0/4083948303":"2023-10-01T22:25:23.520704+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:33:55.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.998+0000 7f3d965fd700 1 -- 172.21.15.40:0/1527147111 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d9009e2b0 msgr2=0x7f3d901c9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:55.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.998+0000 7f3d965fd700 1 --2- 172.21.15.40:0/1527147111 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d9009e2b0 0x7f3d901c9460 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f3d8800cbc0 tx=0x7f3d8800ced0 comp rx=0 tx=0).stop 2023-09-30T22:33:55.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.998+0000 7f3d965fd700 1 -- 172.21.15.40:0/1527147111 shutdown_connections 2023-09-30T22:33:55.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.998+0000 7f3d965fd700 1 --2- 172.21.15.40:0/1527147111 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d9009e2b0 0x7f3d901c9460 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:55.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.998+0000 7f3d965fd700 1 --2- 172.21.15.40:0/1527147111 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d9009c890 0x7f3d901c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:55.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.998+0000 7f3d965fd700 1 --2- 172.21.15.40:0/1527147111 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f3d9009d920 0x7f3d901c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:55.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.998+0000 7f3d965fd700 1 -- 172.21.15.40:0/1527147111 >> 172.21.15.40:0/1527147111 conn(0x7f3d900a7080 msgr2=0x7f3d900a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:56.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.998+0000 7f3d965fd700 1 -- 172.21.15.40:0/1527147111 shutdown_connections 2023-09-30T22:33:56.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:55.998+0000 7f3d965fd700 1 -- 172.21.15.40:0/1527147111 wait complete. 2023-09-30T22:33:56.011 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:21:54.875024+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:21:56.197012+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:22:00.759069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:22:01.327265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.059999942779541, 'score_stable': 1.059999942779541, 'optimal_score': 1, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T22:33:56.011 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:33:56.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.140+0000 7f93e5836700 1 Processor -- start 2023-09-30T22:33:56.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.140+0000 7f93e5836700 1 -- start start 2023-09-30T22:33:56.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.140+0000 7f93e5836700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93e006a6d0 0x7f93e006aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:56.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.141+0000 7f93e5836700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f93e0131fc0 0x7f93e0139b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:56.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.141+0000 7f93e5836700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e009eb60 con 0x7f93e006afe0 2023-09-30T22:33:56.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.141+0000 7f93e5836700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e009db70 con 0x7f93e0131fc0 2023-09-30T22:33:56.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.141+0000 7f93e5836700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e009ddf0 con 0x7f93e006a6d0 2023-09-30T22:33:56.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.141+0000 7f93deffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93e006a6d0 0x7f93e006aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:56.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.141+0000 7f93df7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f93e0131fc0 0x7f93e0139b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:56.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.141+0000 7f93deffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93e006a6d0 0x7f93e006aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:56712/0 (socket says 172.21.15.40:56712) 2023-09-30T22:33:56.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.141+0000 7f93deffd700 1 -- 172.21.15.40:0/4130701326 learned_addr learned my addr 172.21.15.40:0/4130701326 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:33:56.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.141+0000 7f93df7fe700 1 -- 172.21.15.40:0/4130701326 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93e006a6d0 msgr2=0x7f93e006aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:56.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.141+0000 7f93df7fe700 1 --2- 172.21.15.40:0/4130701326 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93e006a6d0 0x7f93e006aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.141+0000 7f93df7fe700 1 -- 172.21.15.40:0/4130701326 >> v1:172.21.15.40:6789/0 conn(0x7f93e006afe0 legacy=0x7f93e01318b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:56.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.141+0000 7f93df7fe700 1 -- 172.21.15.40:0/4130701326 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e009c9a0 con 0x7f93e0131fc0 2023-09-30T22:33:56.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.141+0000 7f93deffd700 1 --2- 172.21.15.40:0/4130701326 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93e006a6d0 0x7f93e006aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:56.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.141+0000 7f93df7fe700 1 --2- 172.21.15.40:0/4130701326 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93e0131fc0 0x7f93e0139b80 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f93d8009d90 tx=0x7f93d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b677a1b87658f130 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:56.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.141+0000 7f93ddffb700 1 -- 172.21.15.40:0/4130701326 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d800e070 con 0x7f93e0131fc0 2023-09-30T22:33:56.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.141+0000 7f93ddffb700 1 -- 172.21.15.40:0/4130701326 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d800bb20 con 0x7f93e0131fc0 2023-09-30T22:33:56.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.141+0000 7f93ddffb700 1 -- 172.21.15.40:0/4130701326 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d8012430 con 0x7f93e0131fc0 2023-09-30T22:33:56.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.142+0000 7f93e5836700 1 -- 172.21.15.40:0/4130701326 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93e0131fc0 msgr2=0x7f93e0139b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:56.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.142+0000 7f93e5836700 1 --2- 172.21.15.40:0/4130701326 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93e0131fc0 0x7f93e0139b80 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f93d8009d90 tx=0x7f93d800b330 comp rx=0 tx=0).stop 2023-09-30T22:33:56.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.142+0000 7f93e5836700 1 -- 172.21.15.40:0/4130701326 shutdown_connections 2023-09-30T22:33:56.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.142+0000 7f93e5836700 1 --2- 172.21.15.40:0/4130701326 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93e0131fc0 0x7f93e0139b80 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.142+0000 7f93e5836700 1 --2- 172.21.15.40:0/4130701326 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93e006a6d0 0x7f93e006aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.142+0000 7f93e5836700 1 -- 172.21.15.40:0/4130701326 >> 172.21.15.40:0/4130701326 conn(0x7f93e009fb20 msgr2=0x7f93e009ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:56.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.142+0000 7f93e5836700 1 -- 172.21.15.40:0/4130701326 shutdown_connections 2023-09-30T22:33:56.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.142+0000 7f93e5836700 1 -- 172.21.15.40:0/4130701326 wait complete. 2023-09-30T22:33:56.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.143+0000 7f93e5836700 1 Processor -- start 2023-09-30T22:33:56.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.143+0000 7f93e5836700 1 -- start start 2023-09-30T22:33:56.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.144+0000 7f93e5836700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93e006a6d0 0x7f93e01206e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:56.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.144+0000 7f93e5836700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93e006afe0 0x7f93e0120c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:56.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.144+0000 7f93e5836700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f93e0131fc0 0x7f93e0121160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:56.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.144+0000 7f93e5836700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e0124020 con 0x7f93e006afe0 2023-09-30T22:33:56.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.144+0000 7f93e5836700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e0124200 con 0x7f93e006a6d0 2023-09-30T22:33:56.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.144+0000 7f93e5836700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93e0123c60 con 0x7f93e0131fc0 2023-09-30T22:33:56.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.144+0000 7f93deffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93e006a6d0 0x7f93e01206e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:56.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.144+0000 7f93deffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93e006a6d0 0x7f93e01206e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:56728/0 (socket says 172.21.15.40:56728) 2023-09-30T22:33:56.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.144+0000 7f93deffd700 1 -- 172.21.15.40:0/2125152296 learned_addr learned my addr 172.21.15.40:0/2125152296 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:33:56.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.144+0000 7f93de7fc700 1 --2- 172.21.15.40:0/2125152296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93e006afe0 0x7f93e0120c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:56.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.144+0000 7f93df7fe700 1 --2- 172.21.15.40:0/2125152296 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f93e0131fc0 0x7f93e0121160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:56.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.144+0000 7f93deffd700 1 -- 172.21.15.40:0/2125152296 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f93e0131fc0 msgr2=0x7f93e0121160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:56.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.144+0000 7f93deffd700 1 --2- 172.21.15.40:0/2125152296 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f93e0131fc0 0x7f93e0121160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.144+0000 7f93deffd700 1 -- 172.21.15.40:0/2125152296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93e006afe0 msgr2=0x7f93e0120c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:56.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.144+0000 7f93deffd700 1 --2- 172.21.15.40:0/2125152296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93e006afe0 0x7f93e0120c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.144+0000 7f93deffd700 1 -- 172.21.15.40:0/2125152296 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d0009500 con 0x7f93e006a6d0 2023-09-30T22:33:56.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.145+0000 7f93deffd700 1 --2- 172.21.15.40:0/2125152296 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93e006a6d0 0x7f93e01206e0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f93d000ebb0 tx=0x7f93d000eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:56.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.145+0000 7f93c7fff700 1 -- 172.21.15.40:0/2125152296 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d0005a20 con 0x7f93e006a6d0 2023-09-30T22:33:56.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.145+0000 7f93c7fff700 1 -- 172.21.15.40:0/2125152296 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d0005b80 con 0x7f93e006a6d0 2023-09-30T22:33:56.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.145+0000 7f93c7fff700 1 -- 172.21.15.40:0/2125152296 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d000c850 con 0x7f93e006a6d0 2023-09-30T22:33:56.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.145+0000 7f93e5836700 1 -- 172.21.15.40:0/2125152296 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d8009a70 con 0x7f93e006a6d0 2023-09-30T22:33:56.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.145+0000 7f93e5836700 1 -- 172.21.15.40:0/2125152296 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e009e420 con 0x7f93e006a6d0 2023-09-30T22:33:56.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.145+0000 7f93c7fff700 1 -- 172.21.15.40:0/2125152296 <== mon.1 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f93d000c9b0 con 0x7f93e006a6d0 2023-09-30T22:33:56.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.146+0000 7f93c7fff700 1 -- 172.21.15.40:0/2125152296 <== mon.1 v2:172.21.15.40:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f93d003f9b0 con 0x7f93e006a6d0 2023-09-30T22:33:56.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.146+0000 7f93e5836700 1 -- 172.21.15.40:0/2125152296 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e0062380 con 0x7f93e006a6d0 2023-09-30T22:33:56.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.151+0000 7f93c7fff700 1 -- 172.21.15.40:0/2125152296 <== mon.1 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f93d0020080 con 0x7f93e006a6d0 2023-09-30T22:33:56.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.344+0000 7f93e5836700 1 -- 172.21.15.40:0/2125152296 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f93e0122400 con 0x7f93e006a6d0 2023-09-30T22:33:56.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.344+0000 7f93c7fff700 1 -- 172.21.15.40:0/2125152296 <== mon.1 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f93d0022300 con 0x7f93e006a6d0 2023-09-30T22:33:56.345 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-09-30T22:33:56.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.346+0000 7f93e5836700 1 -- 172.21.15.40:0/2125152296 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93e006a6d0 msgr2=0x7f93e01206e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:56.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.346+0000 7f93e5836700 1 --2- 172.21.15.40:0/2125152296 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93e006a6d0 0x7f93e01206e0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f93d000ebb0 tx=0x7f93d000eec0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.346+0000 7f93e5836700 1 -- 172.21.15.40:0/2125152296 shutdown_connections 2023-09-30T22:33:56.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.346+0000 7f93e5836700 1 --2- 172.21.15.40:0/2125152296 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f93e0131fc0 0x7f93e0121160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.346+0000 7f93e5836700 1 --2- 172.21.15.40:0/2125152296 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93e006a6d0 0x7f93e01206e0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.346+0000 7f93e5836700 1 --2- 172.21.15.40:0/2125152296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93e006afe0 0x7f93e0120c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.346+0000 7f93e5836700 1 -- 172.21.15.40:0/2125152296 >> 172.21.15.40:0/2125152296 conn(0x7f93e009fb20 msgr2=0x7f93e00a26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:56.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.346+0000 7f93e5836700 1 -- 172.21.15.40:0/2125152296 shutdown_connections 2023-09-30T22:33:56.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.346+0000 7f93e5836700 1 -- 172.21.15.40:0/2125152296 wait complete. 2023-09-30T22:33:56.359 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:33:56.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.488+0000 7f18ee130700 1 Processor -- start 2023-09-30T22:33:56.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.488+0000 7f18ee130700 1 -- start start 2023-09-30T22:33:56.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.488+0000 7f18ee130700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18e809d920 0x7f18e809dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:56.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.488+0000 7f18ee130700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18e8130fb0 0x7f18e8138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:56.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.488+0000 7f18ee130700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e809adf0 con 0x7f18e809e230 2023-09-30T22:33:56.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.488+0000 7f18ee130700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e809edf0 con 0x7f18e809d920 2023-09-30T22:33:56.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.488+0000 7f18ee130700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18e809b660 con 0x7f18e8130fb0 2023-09-30T22:33:56.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.488+0000 7f18e77fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18e809d920 0x7f18e809dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:56.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.488+0000 7f18e7fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18e8130fb0 0x7f18e8138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:56.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.488+0000 7f18e6ffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f18e809e230 0x7f18e81308a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52006/0 (socket says 172.21.15.40:52006) 2023-09-30T22:33:56.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.488+0000 7f18e6ffd700 1 -- 172.21.15.40:0/453781955 learned_addr learned my addr 172.21.15.40:0/453781955 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-09-30T22:33:56.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.488+0000 7f18e67fc700 1 -- 172.21.15.40:0/453781955 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 119200466 0 0) 0x7f18e809adf0 con 0x7f18e809e230 2023-09-30T22:33:56.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.489+0000 7f18e67fc700 1 -- 172.21.15.40:0/453781955 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18d00035b0 con 0x7f18e809e230 2023-09-30T22:33:56.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.489+0000 7f18e7fff700 1 -- 172.21.15.40:0/453781955 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18e809d920 msgr2=0x7f18e809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:56.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.489+0000 7f18e7fff700 1 --2- 172.21.15.40:0/453781955 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18e809d920 0x7f18e809dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.489+0000 7f18e7fff700 1 -- 172.21.15.40:0/453781955 >> v1:172.21.15.40:6789/0 conn(0x7f18e809e230 legacy=0x7f18e81308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:56.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.489+0000 7f18e7fff700 1 -- 172.21.15.40:0/453781955 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e809a6e0 con 0x7f18e8130fb0 2023-09-30T22:33:56.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.489+0000 7f18e77fe700 1 --2- 172.21.15.40:0/453781955 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18e809d920 0x7f18e809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:56.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.489+0000 7f18e7fff700 1 --2- 172.21.15.40:0/453781955 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18e8130fb0 0x7f18e8138d10 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f18e0009dc0 tx=0x7f18e000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ff5f0fa176940f1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:56.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.489+0000 7f18e67fc700 1 -- 172.21.15.40:0/453781955 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e000e070 con 0x7f18e8130fb0 2023-09-30T22:33:56.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.489+0000 7f18e67fc700 1 -- 172.21.15.40:0/453781955 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e000bb20 con 0x7f18e8130fb0 2023-09-30T22:33:56.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.489+0000 7f18e67fc700 1 -- 172.21.15.40:0/453781955 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e0012430 con 0x7f18e8130fb0 2023-09-30T22:33:56.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.489+0000 7f18ee130700 1 -- 172.21.15.40:0/453781955 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18e8130fb0 msgr2=0x7f18e8138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:56.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.489+0000 7f18ee130700 1 --2- 172.21.15.40:0/453781955 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18e8130fb0 0x7f18e8138d10 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f18e0009dc0 tx=0x7f18e000b330 comp rx=0 tx=0).stop 2023-09-30T22:33:56.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.490+0000 7f18ee130700 1 -- 172.21.15.40:0/453781955 shutdown_connections 2023-09-30T22:33:56.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.490+0000 7f18ee130700 1 --2- 172.21.15.40:0/453781955 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18e8130fb0 0x7f18e8138d10 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.490+0000 7f18ee130700 1 --2- 172.21.15.40:0/453781955 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18e809d920 0x7f18e809dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.490+0000 7f18ee130700 1 -- 172.21.15.40:0/453781955 >> 172.21.15.40:0/453781955 conn(0x7f18e809fb20 msgr2=0x7f18e809ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:56.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.490+0000 7f18ee130700 1 -- 172.21.15.40:0/453781955 shutdown_connections 2023-09-30T22:33:56.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.490+0000 7f18ee130700 1 -- 172.21.15.40:0/453781955 wait complete. 2023-09-30T22:33:56.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.490+0000 7f18ee130700 1 Processor -- start 2023-09-30T22:33:56.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.491+0000 7f18ee130700 1 -- start start 2023-09-30T22:33:56.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.491+0000 7f18ee130700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18e809d920 0x7f18e8120090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:56.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.491+0000 7f18ee130700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18e809e230 0x7f18e81205d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:56.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.491+0000 7f18ee130700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18e8130fb0 0x7f18e8120b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:56.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.491+0000 7f18ee130700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e8121c00 con 0x7f18e809d920 2023-09-30T22:33:56.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.491+0000 7f18ee130700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e8123570 con 0x7f18e8130fb0 2023-09-30T22:33:56.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.491+0000 7f18ee130700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18e8122460 con 0x7f18e809e230 2023-09-30T22:33:56.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.491+0000 7f18e77fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18e809d920 0x7f18e8120090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:56.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.491+0000 7f18e6ffd700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18e809e230 0x7f18e81205d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:56.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.491+0000 7f18e77fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18e809d920 0x7f18e8120090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43882/0 (socket says 172.21.15.40:43882) 2023-09-30T22:33:56.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.491+0000 7f18e77fe700 1 -- 172.21.15.40:0/1909128222 learned_addr learned my addr 172.21.15.40:0/1909128222 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:33:56.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.491+0000 7f18e7fff700 1 --2- 172.21.15.40:0/1909128222 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18e8130fb0 0x7f18e8120b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:56.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.492+0000 7f18e77fe700 1 -- 172.21.15.40:0/1909128222 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18e809e230 msgr2=0x7f18e81205d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:56.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.492+0000 7f18e77fe700 1 --2- 172.21.15.40:0/1909128222 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18e809e230 0x7f18e81205d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.492+0000 7f18e77fe700 1 -- 172.21.15.40:0/1909128222 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18e8130fb0 msgr2=0x7f18e8120b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:56.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.492+0000 7f18e77fe700 1 --2- 172.21.15.40:0/1909128222 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18e8130fb0 0x7f18e8120b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.492+0000 7f18e77fe700 1 -- 172.21.15.40:0/1909128222 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d8009430 con 0x7f18e809d920 2023-09-30T22:33:56.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.492+0000 7f18e77fe700 1 --2- 172.21.15.40:0/1909128222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18e809d920 0x7f18e8120090 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f18d800ec10 tx=0x7f18d800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:56.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.492+0000 7f18cffff700 1 -- 172.21.15.40:0/1909128222 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d8009740 con 0x7f18e809d920 2023-09-30T22:33:56.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.492+0000 7f18cffff700 1 -- 172.21.15.40:0/1909128222 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d8005a20 con 0x7f18e809d920 2023-09-30T22:33:56.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.492+0000 7f18ee130700 1 -- 172.21.15.40:0/1909128222 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e0009a70 con 0x7f18e809d920 2023-09-30T22:33:56.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.492+0000 7f18cffff700 1 -- 172.21.15.40:0/1909128222 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d8005d90 con 0x7f18e809d920 2023-09-30T22:33:56.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.492+0000 7f18ee130700 1 -- 172.21.15.40:0/1909128222 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e80a2db0 con 0x7f18e809d920 2023-09-30T22:33:56.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.493+0000 7f18cffff700 1 -- 172.21.15.40:0/1909128222 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f18d800c850 con 0x7f18e809d920 2023-09-30T22:33:56.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.493+0000 7f18cffff700 1 -- 172.21.15.40:0/1909128222 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f18d803f8b0 con 0x7f18e809d920 2023-09-30T22:33:56.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.493+0000 7f18ee130700 1 -- 172.21.15.40:0/1909128222 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e811cee0 con 0x7f18e809d920 2023-09-30T22:33:56.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.498+0000 7f18cffff700 1 -- 172.21.15.40:0/1909128222 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f18d8020080 con 0x7f18e809d920 2023-09-30T22:33:56.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.692+0000 7f18ee130700 1 -- 172.21.15.40:0/1909128222 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f18e809cb00 con 0x7f18e809d920 2023-09-30T22:33:56.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.693+0000 7f18cffff700 1 -- 172.21.15.40:0/1909128222 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v42) v1 ==== 92+0+10 (secure 0 0 0) 0x7f18d8006030 con 0x7f18e809d920 2023-09-30T22:33:56.694 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-09-30T22:33:56.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.695+0000 7f18ee130700 1 -- 172.21.15.40:0/1909128222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18e809d920 msgr2=0x7f18e8120090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:56.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.695+0000 7f18ee130700 1 --2- 172.21.15.40:0/1909128222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18e809d920 0x7f18e8120090 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f18d800ec10 tx=0x7f18d800ef20 comp rx=0 tx=0).stop 2023-09-30T22:33:56.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.695+0000 7f18ee130700 1 -- 172.21.15.40:0/1909128222 shutdown_connections 2023-09-30T22:33:56.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.695+0000 7f18ee130700 1 --2- 172.21.15.40:0/1909128222 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18e8130fb0 0x7f18e8120b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.695+0000 7f18ee130700 1 --2- 172.21.15.40:0/1909128222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18e809d920 0x7f18e8120090 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.695+0000 7f18ee130700 1 --2- 172.21.15.40:0/1909128222 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f18e809e230 0x7f18e81205d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.695+0000 7f18ee130700 1 -- 172.21.15.40:0/1909128222 >> 172.21.15.40:0/1909128222 conn(0x7f18e809fb20 msgr2=0x7f18e8071940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:56.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.695+0000 7f18ee130700 1 -- 172.21.15.40:0/1909128222 shutdown_connections 2023-09-30T22:33:56.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.695+0000 7f18ee130700 1 -- 172.21.15.40:0/1909128222 wait complete. 2023-09-30T22:33:56.708 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:33:56.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.835+0000 7f798e906700 1 Processor -- start 2023-09-30T22:33:56.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.835+0000 7f798e906700 1 -- start start 2023-09-30T22:33:56.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.836+0000 7f798e906700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7988136bf0 0x7f7988138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:56.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.836+0000 7f798e906700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7988139510 0x7f798813b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:56.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.836+0000 7f798e906700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79880a2600 con 0x7f798809c890 2023-09-30T22:33:56.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.836+0000 7f798e906700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79880a29d0 con 0x7f7988139510 2023-09-30T22:33:56.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.836+0000 7f798e906700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f798809fb40 con 0x7f7988136bf0 2023-09-30T22:33:56.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.836+0000 7f79877fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7988136bf0 0x7f7988138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:56.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.836+0000 7f79877fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7988136bf0 0x7f7988138fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:56744/0 (socket says 172.21.15.40:56744) 2023-09-30T22:33:56.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.836+0000 7f79877fe700 1 -- 172.21.15.40:0/2814334106 learned_addr learned my addr 172.21.15.40:0/2814334106 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:33:56.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.836+0000 7f798cea3700 1 --2- 172.21.15.40:0/2814334106 >> v2:172.21.15.40:3300/0 conn(0x7f7988139510 0x7f798813b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:56.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.836+0000 7f79877fe700 1 -- 172.21.15.40:0/2814334106 >> v2:172.21.15.40:3300/0 conn(0x7f7988139510 msgr2=0x7f798813b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:56.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.836+0000 7f79877fe700 1 --2- 172.21.15.40:0/2814334106 >> v2:172.21.15.40:3300/0 conn(0x7f7988139510 0x7f798813b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.836+0000 7f79877fe700 1 -- 172.21.15.40:0/2814334106 >> v1:172.21.15.40:6789/0 conn(0x7f798809c890 legacy=0x7f798809cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:56.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.836+0000 7f79877fe700 1 -- 172.21.15.40:0/2814334106 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f798809d370 con 0x7f7988136bf0 2023-09-30T22:33:56.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.836+0000 7f79877fe700 1 --2- 172.21.15.40:0/2814334106 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7988136bf0 0x7f7988138fd0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f797c0098f0 tx=0x7f797c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4de4ae58897dd8e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:56.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.836+0000 7f7986ffd700 1 -- 172.21.15.40:0/2814334106 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c011830 con 0x7f7988136bf0 2023-09-30T22:33:56.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.837+0000 7f7986ffd700 1 -- 172.21.15.40:0/2814334106 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797c011990 con 0x7f7988136bf0 2023-09-30T22:33:56.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.837+0000 7f7986ffd700 1 -- 172.21.15.40:0/2814334106 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c011d20 con 0x7f7988136bf0 2023-09-30T22:33:56.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.837+0000 7f798e906700 1 -- 172.21.15.40:0/2814334106 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7988136bf0 msgr2=0x7f7988138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:56.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.837+0000 7f798e906700 1 --2- 172.21.15.40:0/2814334106 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7988136bf0 0x7f7988138fd0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f797c0098f0 tx=0x7f797c009c00 comp rx=0 tx=0).stop 2023-09-30T22:33:56.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.837+0000 7f798e906700 1 -- 172.21.15.40:0/2814334106 shutdown_connections 2023-09-30T22:33:56.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.837+0000 7f798e906700 1 --2- 172.21.15.40:0/2814334106 >> v2:172.21.15.40:3300/0 conn(0x7f7988139510 0x7f798813b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.837+0000 7f798e906700 1 --2- 172.21.15.40:0/2814334106 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7988136bf0 0x7f7988138fd0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.837+0000 7f798e906700 1 -- 172.21.15.40:0/2814334106 >> 172.21.15.40:0/2814334106 conn(0x7f79880a7080 msgr2=0x7f79880a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:56.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.837+0000 7f798e906700 1 -- 172.21.15.40:0/2814334106 shutdown_connections 2023-09-30T22:33:56.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.837+0000 7f798e906700 1 -- 172.21.15.40:0/2814334106 wait complete. 2023-09-30T22:33:56.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.838+0000 7f798e906700 1 Processor -- start 2023-09-30T22:33:56.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.838+0000 7f798e906700 1 -- start start 2023-09-30T22:33:56.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.839+0000 7f798e906700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f798809c890 0x7f798806f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:56.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.839+0000 7f798e906700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7988136bf0 0x7f798806f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:56.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.839+0000 7f798e906700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7988139510 0x7f798806fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:56.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.839+0000 7f798e906700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7988070ca0 con 0x7f7988139510 2023-09-30T22:33:56.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.839+0000 7f798e906700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f798809ecf0 con 0x7f7988136bf0 2023-09-30T22:33:56.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.839+0000 7f798e906700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f798812ba90 con 0x7f798809c890 2023-09-30T22:33:56.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.839+0000 7f798cea3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7988139510 0x7f798806fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:56.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.839+0000 7f7987fff700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f798809c890 0x7f798806f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:56.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.839+0000 7f798cea3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7988139510 0x7f798806fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43912/0 (socket says 172.21.15.40:43912) 2023-09-30T22:33:56.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.839+0000 7f798cea3700 1 -- 172.21.15.40:0/1276724049 learned_addr learned my addr 172.21.15.40:0/1276724049 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:33:56.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.839+0000 7f79877fe700 1 --2- 172.21.15.40:0/1276724049 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7988136bf0 0x7f798806f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:56.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.839+0000 7f798cea3700 1 -- 172.21.15.40:0/1276724049 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f798809c890 msgr2=0x7f798806f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:56.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.839+0000 7f798cea3700 1 --2- 172.21.15.40:0/1276724049 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f798809c890 0x7f798806f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.839+0000 7f798cea3700 1 -- 172.21.15.40:0/1276724049 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7988136bf0 msgr2=0x7f798806f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:56.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.839+0000 7f798cea3700 1 --2- 172.21.15.40:0/1276724049 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7988136bf0 0x7f798806f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:56.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.839+0000 7f798cea3700 1 -- 172.21.15.40:0/1276724049 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797c009550 con 0x7f7988139510 2023-09-30T22:33:56.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.839+0000 7f7987fff700 1 --2- 172.21.15.40:0/1276724049 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f798809c890 0x7f798806f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:56.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.839+0000 7f798cea3700 1 --2- 172.21.15.40:0/1276724049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7988139510 0x7f798806fb60 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f798000ef90 tx=0x7f798000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:56.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.839+0000 7f7984ff9700 1 -- 172.21.15.40:0/1276724049 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798000cc90 con 0x7f7988139510 2023-09-30T22:33:56.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.840+0000 7f7984ff9700 1 -- 172.21.15.40:0/1276724049 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798000f040 con 0x7f7988139510 2023-09-30T22:33:56.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.840+0000 7f7984ff9700 1 -- 172.21.15.40:0/1276724049 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7980014480 con 0x7f7988139510 2023-09-30T22:33:56.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.840+0000 7f798e906700 1 -- 172.21.15.40:0/1276724049 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7988071870 con 0x7f7988139510 2023-09-30T22:33:56.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.840+0000 7f798e906700 1 -- 172.21.15.40:0/1276724049 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f798812b4e0 con 0x7f7988139510 2023-09-30T22:33:56.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.840+0000 7f7984ff9700 1 -- 172.21.15.40:0/1276724049 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f79800145e0 con 0x7f7988139510 2023-09-30T22:33:56.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.840+0000 7f7984ff9700 1 -- 172.21.15.40:0/1276724049 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f79800402d0 con 0x7f7988139510 2023-09-30T22:33:56.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.840+0000 7f798e906700 1 -- 172.21.15.40:0/1276724049 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7988062380 con 0x7f7988139510 2023-09-30T22:33:56.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:56.845+0000 7f7984ff9700 1 -- 172.21.15.40:0/1276724049 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7980018030 con 0x7f7988139510 2023-09-30T22:33:57.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.036+0000 7f798e906700 1 -- 172.21.15.40:0/1276724049 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7988074620 con 0x7f7988139510 2023-09-30T22:33:57.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.036+0000 7f7984ff9700 1 -- 172.21.15.40:0/1276724049 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+11 (secure 0 0 0) 0x7f79800076f0 con 0x7f7988139510 2023-09-30T22:33:57.037 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-09-30T22:33:57.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.038+0000 7f798e906700 1 -- 172.21.15.40:0/1276724049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7988139510 msgr2=0x7f798806fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:57.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.038+0000 7f798e906700 1 --2- 172.21.15.40:0/1276724049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7988139510 0x7f798806fb60 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f798000ef90 tx=0x7f798000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.038+0000 7f798e906700 1 -- 172.21.15.40:0/1276724049 shutdown_connections 2023-09-30T22:33:57.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.038+0000 7f798e906700 1 --2- 172.21.15.40:0/1276724049 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f798809c890 0x7f798806f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.038+0000 7f798e906700 1 --2- 172.21.15.40:0/1276724049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7988139510 0x7f798806fb60 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.038+0000 7f798e906700 1 --2- 172.21.15.40:0/1276724049 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7988136bf0 0x7f798806f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.038+0000 7f798e906700 1 -- 172.21.15.40:0/1276724049 >> 172.21.15.40:0/1276724049 conn(0x7f79880a7080 msgr2=0x7f79881349d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:57.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.039+0000 7f798e906700 1 -- 172.21.15.40:0/1276724049 shutdown_connections 2023-09-30T22:33:57.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.039+0000 7f798e906700 1 -- 172.21.15.40:0/1276724049 wait complete. 2023-09-30T22:33:57.052 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:33:57.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.179+0000 7f00e96d3700 1 Processor -- start 2023-09-30T22:33:57.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.179+0000 7f00e96d3700 1 -- start start 2023-09-30T22:33:57.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.180+0000 7f00e96d3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00e406f070 0x7f00e406f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:57.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.180+0000 7f00e96d3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00e406f980 0x7f00e4097090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:57.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.180+0000 7f00e96d3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f00e406fdb0 0x7f00e40975d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:57.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.180+0000 7f00e96d3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00e4071af0 con 0x7f00e406fdb0 2023-09-30T22:33:57.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.180+0000 7f00e96d3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e4070830 con 0x7f00e406f070 2023-09-30T22:33:57.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.180+0000 7f00e96d3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00e4070ad0 con 0x7f00e406f980 2023-09-30T22:33:57.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.180+0000 7f00e2ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00e406f070 0x7f00e406f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:57.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.180+0000 7f00da7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00e406f980 0x7f00e4097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:57.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.180+0000 7f00da7fc700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00e406f980 0x7f00e4097090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:34566/0 (socket says 172.21.15.40:34566) 2023-09-30T22:33:57.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.180+0000 7f00e2ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00e406f070 0x7f00e406f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:56766/0 (socket says 172.21.15.40:56766) 2023-09-30T22:33:57.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.180+0000 7f00da7fc700 1 -- 172.21.15.40:0/2291593187 learned_addr learned my addr 172.21.15.40:0/2291593187 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:33:57.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.180+0000 7f00e37fe700 1 --2- 172.21.15.40:0/2291593187 >> v2:172.21.15.40:3300/0 conn(0x7f00e406fdb0 0x7f00e40975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:57.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.180+0000 7f00e2ffd700 1 -- 172.21.15.40:0/2291593187 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00e406f980 msgr2=0x7f00e4097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:57.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.180+0000 7f00e2ffd700 1 --2- 172.21.15.40:0/2291593187 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00e406f980 0x7f00e4097090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.180+0000 7f00e2ffd700 1 -- 172.21.15.40:0/2291593187 >> v2:172.21.15.40:3300/0 conn(0x7f00e406fdb0 msgr2=0x7f00e40975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:57.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.180+0000 7f00e2ffd700 1 --2- 172.21.15.40:0/2291593187 >> v2:172.21.15.40:3300/0 conn(0x7f00e406fdb0 0x7f00e40975d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.180+0000 7f00e2ffd700 1 -- 172.21.15.40:0/2291593187 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e4070de0 con 0x7f00e406f070 2023-09-30T22:33:57.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.180+0000 7f00e37fe700 1 --2- 172.21.15.40:0/2291593187 >> v2:172.21.15.40:3300/0 conn(0x7f00e406fdb0 0x7f00e40975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:57.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.180+0000 7f00da7fc700 1 --2- 172.21.15.40:0/2291593187 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00e406f980 0x7f00e4097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:57.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.181+0000 7f00e2ffd700 1 --2- 172.21.15.40:0/2291593187 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00e406f070 0x7f00e406f440 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f00d4009870 tx=0x7f00d4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d404360170fa41e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:57.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.181+0000 7f00e27fc700 1 -- 172.21.15.40:0/2291593187 <== mon.1 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d4011830 con 0x7f00e406f070 2023-09-30T22:33:57.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.181+0000 7f00e27fc700 1 -- 172.21.15.40:0/2291593187 <== mon.1 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d4011990 con 0x7f00e406f070 2023-09-30T22:33:57.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.181+0000 7f00e27fc700 1 -- 172.21.15.40:0/2291593187 <== mon.1 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d4011d20 con 0x7f00e406f070 2023-09-30T22:33:57.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.181+0000 7f00e96d3700 1 -- 172.21.15.40:0/2291593187 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00e406f070 msgr2=0x7f00e406f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:57.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.181+0000 7f00e96d3700 1 --2- 172.21.15.40:0/2291593187 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00e406f070 0x7f00e406f440 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f00d4009870 tx=0x7f00d4009b80 comp rx=0 tx=0).stop 2023-09-30T22:33:57.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.181+0000 7f00e96d3700 1 -- 172.21.15.40:0/2291593187 shutdown_connections 2023-09-30T22:33:57.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.181+0000 7f00e96d3700 1 --2- 172.21.15.40:0/2291593187 >> v2:172.21.15.40:3300/0 conn(0x7f00e406fdb0 0x7f00e40975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.181+0000 7f00e96d3700 1 --2- 172.21.15.40:0/2291593187 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00e406f070 0x7f00e406f440 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.181+0000 7f00e96d3700 1 --2- 172.21.15.40:0/2291593187 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00e406f980 0x7f00e4097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.181+0000 7f00e96d3700 1 -- 172.21.15.40:0/2291593187 >> 172.21.15.40:0/2291593187 conn(0x7f00e40a41a0 msgr2=0x7f00e40a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:57.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.181+0000 7f00e96d3700 1 -- 172.21.15.40:0/2291593187 shutdown_connections 2023-09-30T22:33:57.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.181+0000 7f00e96d3700 1 -- 172.21.15.40:0/2291593187 wait complete. 2023-09-30T22:33:57.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.182+0000 7f00e96d3700 1 Processor -- start 2023-09-30T22:33:57.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.182+0000 7f00e96d3700 1 -- start start 2023-09-30T22:33:57.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.183+0000 7f00e96d3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00e406f070 0x7f00e412cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:57.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.183+0000 7f00e96d3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00e406f980 0x7f00e412d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:57.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.183+0000 7f00e96d3700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00e406fdb0 0x7f00e412da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:57.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.183+0000 7f00e96d3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e41307c0 con 0x7f00e406f070 2023-09-30T22:33:57.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.183+0000 7f00e96d3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e412fa20 con 0x7f00e406f980 2023-09-30T22:33:57.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.183+0000 7f00e96d3700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00e4130aa0 con 0x7f00e406fdb0 2023-09-30T22:33:57.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.183+0000 7f00e2ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00e406f070 0x7f00e412cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:57.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.183+0000 7f00da7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00e406f980 0x7f00e412d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:57.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.183+0000 7f00e37fe700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00e406fdb0 0x7f00e412da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:57.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.183+0000 7f00e2ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00e406f070 0x7f00e412cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43934/0 (socket says 172.21.15.40:43934) 2023-09-30T22:33:57.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.183+0000 7f00da7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00e406f980 0x7f00e412d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:56780/0 (socket says 172.21.15.40:56780) 2023-09-30T22:33:57.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.183+0000 7f00e2ffd700 1 -- 172.21.15.40:0/244471208 learned_addr learned my addr 172.21.15.40:0/244471208 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:33:57.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.183+0000 7f00e2ffd700 1 -- 172.21.15.40:0/244471208 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00e406fdb0 msgr2=0x7f00e412da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:57.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.183+0000 7f00e2ffd700 1 --2- 172.21.15.40:0/244471208 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00e406fdb0 0x7f00e412da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.183+0000 7f00e2ffd700 1 -- 172.21.15.40:0/244471208 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00e406f980 msgr2=0x7f00e412d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:57.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.183+0000 7f00e2ffd700 1 --2- 172.21.15.40:0/244471208 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00e406f980 0x7f00e412d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.183+0000 7f00e2ffd700 1 -- 172.21.15.40:0/244471208 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00cc009550 con 0x7f00e406f070 2023-09-30T22:33:57.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.183+0000 7f00da7fc700 1 --2- 172.21.15.40:0/244471208 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00e406f980 0x7f00e412d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:57.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.183+0000 7f00e2ffd700 1 --2- 172.21.15.40:0/244471208 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00e406f070 0x7f00e412cf80 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f00d4000c00 tx=0x7f00d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:57.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.184+0000 7f00dbfff700 1 -- 172.21.15.40:0/244471208 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d4004450 con 0x7f00e406f070 2023-09-30T22:33:57.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.184+0000 7f00dbfff700 1 -- 172.21.15.40:0/244471208 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d401f070 con 0x7f00e406f070 2023-09-30T22:33:57.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.184+0000 7f00e96d3700 1 -- 172.21.15.40:0/244471208 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00dc009a70 con 0x7f00e406f070 2023-09-30T22:33:57.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.184+0000 7f00dbfff700 1 -- 172.21.15.40:0/244471208 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d40038a0 con 0x7f00e406f070 2023-09-30T22:33:57.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.184+0000 7f00e96d3700 1 -- 172.21.15.40:0/244471208 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d40094a0 con 0x7f00e406f070 2023-09-30T22:33:57.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.184+0000 7f00dbfff700 1 -- 172.21.15.40:0/244471208 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f00d4003a00 con 0x7f00e406f070 2023-09-30T22:33:57.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.185+0000 7f00dbfff700 1 -- 172.21.15.40:0/244471208 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f00d4021070 con 0x7f00e406f070 2023-09-30T22:33:57.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.185+0000 7f00e96d3700 1 -- 172.21.15.40:0/244471208 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e4062380 con 0x7f00e406f070 2023-09-30T22:33:57.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.189+0000 7f00dbfff700 1 -- 172.21.15.40:0/244471208 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f00d4015080 con 0x7f00e406f070 2023-09-30T22:33:57.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.381+0000 7f00e96d3700 1 -- 172.21.15.40:0/244471208 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f00e412fde0 con 0x7f00e406f070 2023-09-30T22:33:57.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.381+0000 7f00dbfff700 1 -- 172.21.15.40:0/244471208 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7f00d402b020 con 0x7f00e406f070 2023-09-30T22:33:57.382 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-09-30T22:33:57.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.383+0000 7f00e96d3700 1 -- 172.21.15.40:0/244471208 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00e406f070 msgr2=0x7f00e412cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:57.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.383+0000 7f00e96d3700 1 --2- 172.21.15.40:0/244471208 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00e406f070 0x7f00e412cf80 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f00d4000c00 tx=0x7f00d4004750 comp rx=0 tx=0).stop 2023-09-30T22:33:57.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.383+0000 7f00e96d3700 1 -- 172.21.15.40:0/244471208 shutdown_connections 2023-09-30T22:33:57.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.383+0000 7f00e96d3700 1 --2- 172.21.15.40:0/244471208 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f00e406fdb0 0x7f00e412da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.383+0000 7f00e96d3700 1 --2- 172.21.15.40:0/244471208 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00e406f070 0x7f00e412cf80 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.383+0000 7f00e96d3700 1 --2- 172.21.15.40:0/244471208 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f00e406f980 0x7f00e412d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.383+0000 7f00e96d3700 1 -- 172.21.15.40:0/244471208 >> 172.21.15.40:0/244471208 conn(0x7f00e40a41a0 msgr2=0x7f00e40972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:57.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.383+0000 7f00e96d3700 1 -- 172.21.15.40:0/244471208 shutdown_connections 2023-09-30T22:33:57.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.383+0000 7f00e96d3700 1 -- 172.21.15.40:0/244471208 wait complete. 2023-09-30T22:33:57.396 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-30T22:33:57.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.522+0000 7f9d4eeb8700 1 Processor -- start 2023-09-30T22:33:57.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.522+0000 7f9d4eeb8700 1 -- start start 2023-09-30T22:33:57.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.522+0000 7f9d4eeb8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9d4809c890 0x7f9d4809cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:57.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.522+0000 7f9d4eeb8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d4809e480 0x7f9d4813bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:57.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.522+0000 7f9d4eeb8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d480a2600 con 0x7f9d4809d920 2023-09-30T22:33:57.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.522+0000 7f9d4eeb8700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d480a29d0 con 0x7f9d4809c890 2023-09-30T22:33:57.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.522+0000 7f9d4eeb8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4809fb40 con 0x7f9d4809e480 2023-09-30T22:33:57.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.523+0000 7f9d4cc54700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9d4809c890 0x7f9d4809cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:57.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.523+0000 7f9d4d455700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d4809e480 0x7f9d4813bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:57.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.523+0000 7f9d4cc54700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9d4809c890 0x7f9d4809cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43936/0 (socket says 172.21.15.40:43936) 2023-09-30T22:33:57.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.523+0000 7f9d4cc54700 1 -- 172.21.15.40:0/1210319753 learned_addr learned my addr 172.21.15.40:0/1210319753 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:33:57.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.523+0000 7f9d4d455700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d4809e480 0x7f9d4813bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:34580/0 (socket says 172.21.15.40:34580) 2023-09-30T22:33:57.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.523+0000 7f9d4d455700 1 -- 172.21.15.40:0/1210319753 >> v2:172.21.15.40:3300/0 conn(0x7f9d4809c890 msgr2=0x7f9d4809cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:57.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.523+0000 7f9d4d455700 1 --2- 172.21.15.40:0/1210319753 >> v2:172.21.15.40:3300/0 conn(0x7f9d4809c890 0x7f9d4809cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.523+0000 7f9d4d455700 1 -- 172.21.15.40:0/1210319753 >> v1:172.21.15.40:6789/0 conn(0x7f9d4809d920 legacy=0x7f9d4809dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:57.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.523+0000 7f9d4d455700 1 -- 172.21.15.40:0/1210319753 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d4809fed0 con 0x7f9d4809e480 2023-09-30T22:33:57.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.523+0000 7f9d4cc54700 1 --2- 172.21.15.40:0/1210319753 >> v2:172.21.15.40:3300/0 conn(0x7f9d4809c890 0x7f9d4809cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:57.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.523+0000 7f9d4d455700 1 --2- 172.21.15.40:0/1210319753 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d4809e480 0x7f9d4813bc20 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f9d40009d90 tx=0x7f9d4000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20de3dfb39f80dd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:57.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.523+0000 7f9d477fe700 1 -- 172.21.15.40:0/1210319753 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4000e070 con 0x7f9d4809e480 2023-09-30T22:33:57.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.523+0000 7f9d477fe700 1 -- 172.21.15.40:0/1210319753 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4000bb20 con 0x7f9d4809e480 2023-09-30T22:33:57.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.523+0000 7f9d477fe700 1 -- 172.21.15.40:0/1210319753 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d40012430 con 0x7f9d4809e480 2023-09-30T22:33:57.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.524+0000 7f9d4eeb8700 1 -- 172.21.15.40:0/1210319753 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d4809e480 msgr2=0x7f9d4813bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:57.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.524+0000 7f9d4eeb8700 1 --2- 172.21.15.40:0/1210319753 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d4809e480 0x7f9d4813bc20 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f9d40009d90 tx=0x7f9d4000b330 comp rx=0 tx=0).stop 2023-09-30T22:33:57.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.524+0000 7f9d4eeb8700 1 -- 172.21.15.40:0/1210319753 shutdown_connections 2023-09-30T22:33:57.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.524+0000 7f9d4eeb8700 1 --2- 172.21.15.40:0/1210319753 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d4809e480 0x7f9d4813bc20 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.524+0000 7f9d4eeb8700 1 --2- 172.21.15.40:0/1210319753 >> v2:172.21.15.40:3300/0 conn(0x7f9d4809c890 0x7f9d4809cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.524+0000 7f9d4eeb8700 1 -- 172.21.15.40:0/1210319753 >> 172.21.15.40:0/1210319753 conn(0x7f9d480a7080 msgr2=0x7f9d480a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:57.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.524+0000 7f9d4eeb8700 1 -- 172.21.15.40:0/1210319753 shutdown_connections 2023-09-30T22:33:57.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.524+0000 7f9d4eeb8700 1 -- 172.21.15.40:0/1210319753 wait complete. 2023-09-30T22:33:57.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.525+0000 7f9d4eeb8700 1 Processor -- start 2023-09-30T22:33:57.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.525+0000 7f9d4eeb8700 1 -- start start 2023-09-30T22:33:57.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.525+0000 7f9d4eeb8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d4809c890 0x7f9d4812d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:57.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.525+0000 7f9d4eeb8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d4809d920 0x7f9d4812d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:57.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.525+0000 7f9d4eeb8700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d4809e480 0x7f9d4812de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:57.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.525+0000 7f9d4eeb8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4812ee40 con 0x7f9d4809c890 2023-09-30T22:33:57.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.525+0000 7f9d4eeb8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4812ec50 con 0x7f9d4809d920 2023-09-30T22:33:57.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.525+0000 7f9d4eeb8700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4812f520 con 0x7f9d4809e480 2023-09-30T22:33:57.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.526+0000 7f9d4d455700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d4809e480 0x7f9d4812de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:57.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.526+0000 7f9d47fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d4809d920 0x7f9d4812d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:57.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.526+0000 7f9d4cc54700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d4809c890 0x7f9d4812d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:57.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.526+0000 7f9d4d455700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d4809e480 0x7f9d4812de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:34582/0 (socket says 172.21.15.40:34582) 2023-09-30T22:33:57.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.526+0000 7f9d4d455700 1 -- 172.21.15.40:0/743251657 learned_addr learned my addr 172.21.15.40:0/743251657 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:33:57.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.526+0000 7f9d4d455700 1 -- 172.21.15.40:0/743251657 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d4809d920 msgr2=0x7f9d4812d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:57.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.526+0000 7f9d4d455700 1 --2- 172.21.15.40:0/743251657 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d4809d920 0x7f9d4812d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.526+0000 7f9d4d455700 1 -- 172.21.15.40:0/743251657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d4809c890 msgr2=0x7f9d4812d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:57.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.526+0000 7f9d4d455700 1 --2- 172.21.15.40:0/743251657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d4809c890 0x7f9d4812d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.526+0000 7f9d4d455700 1 -- 172.21.15.40:0/743251657 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3c009500 con 0x7f9d4809e480 2023-09-30T22:33:57.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.526+0000 7f9d47fff700 1 --2- 172.21.15.40:0/743251657 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d4809d920 0x7f9d4812d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:57.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.526+0000 7f9d4cc54700 1 --2- 172.21.15.40:0/743251657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d4809c890 0x7f9d4812d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:33:57.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.526+0000 7f9d4d455700 1 --2- 172.21.15.40:0/743251657 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d4809e480 0x7f9d4812de50 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f9d40014040 tx=0x7f9d40004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:57.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.526+0000 7f9d457fa700 1 -- 172.21.15.40:0/743251657 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d40012430 con 0x7f9d4809e480 2023-09-30T22:33:57.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.526+0000 7f9d457fa700 1 -- 172.21.15.40:0/743251657 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d40020070 con 0x7f9d4809e480 2023-09-30T22:33:57.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.526+0000 7f9d457fa700 1 -- 172.21.15.40:0/743251657 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d40003ea0 con 0x7f9d4809e480 2023-09-30T22:33:57.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.526+0000 7f9d4eeb8700 1 -- 172.21.15.40:0/743251657 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d40009a70 con 0x7f9d4809e480 2023-09-30T22:33:57.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.526+0000 7f9d4eeb8700 1 -- 172.21.15.40:0/743251657 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d481305c0 con 0x7f9d4809e480 2023-09-30T22:33:57.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.527+0000 7f9d4eeb8700 1 -- 172.21.15.40:0/743251657 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d4812ffc0 con 0x7f9d4809e480 2023-09-30T22:33:57.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.528+0000 7f9d457fa700 1 -- 172.21.15.40:0/743251657 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d40004040 con 0x7f9d4809e480 2023-09-30T22:33:57.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.528+0000 7f9d457fa700 1 -- 172.21.15.40:0/743251657 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f9d40022070 con 0x7f9d4809e480 2023-09-30T22:33:57.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.532+0000 7f9d457fa700 1 -- 172.21.15.40:0/743251657 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d40011980 con 0x7f9d4809e480 2023-09-30T22:33:57.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.742+0000 7f9d4eeb8700 1 -- 172.21.15.40:0/743251657 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9d48070610 con 0x7f9d4809e480 2023-09-30T22:33:57.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.742+0000 7f9d457fa700 1 -- 172.21.15.40:0/743251657 <== mon.2 v2:172.21.15.40:3302/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 11 entries v42) v1 ==== 81+0+636 (secure 0 0 0) 0x7f9d40035080 con 0x7f9d4809e480 2023-09-30T22:33:57.743 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3091130082 2023-10-01T22:25:23.520704+0000 2023-09-30T22:33:57.744 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6816/127432 2023-10-01T22:25:23.520704+0000 2023-09-30T22:33:57.744 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/778194028 2023-10-01T22:25:23.520704+0000 2023-09-30T22:33:57.744 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/499521639 2023-10-01T22:25:23.520704+0000 2023-09-30T22:33:57.744 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/968436005 2023-10-01T22:25:23.520704+0000 2023-09-30T22:33:57.744 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1764460125 2023-10-01T22:24:24.127340+0000 2023-09-30T22:33:57.744 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1146580499 2023-10-01T22:25:23.520704+0000 2023-09-30T22:33:57.744 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6816/118905 2023-10-01T22:24:24.127340+0000 2023-09-30T22:33:57.745 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1890660785 2023-10-01T22:24:24.127340+0000 2023-09-30T22:33:57.745 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6817/2392027806 2023-10-01T22:24:50.682728+0000 2023-09-30T22:33:57.745 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/4083948303 2023-10-01T22:25:23.520704+0000 2023-09-30T22:33:57.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.744+0000 7f9d4eeb8700 1 -- 172.21.15.40:0/743251657 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d4809e480 msgr2=0x7f9d4812de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:57.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.744+0000 7f9d4eeb8700 1 --2- 172.21.15.40:0/743251657 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d4809e480 0x7f9d4812de50 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f9d40014040 tx=0x7f9d40004ad0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.744+0000 7f9d4eeb8700 1 -- 172.21.15.40:0/743251657 shutdown_connections 2023-09-30T22:33:57.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.744+0000 7f9d4eeb8700 1 --2- 172.21.15.40:0/743251657 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f9d4809e480 0x7f9d4812de50 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.744+0000 7f9d4eeb8700 1 --2- 172.21.15.40:0/743251657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d4809c890 0x7f9d4812d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.744+0000 7f9d4eeb8700 1 --2- 172.21.15.40:0/743251657 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9d4809d920 0x7f9d4812d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:57.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.744+0000 7f9d4eeb8700 1 -- 172.21.15.40:0/743251657 >> 172.21.15.40:0/743251657 conn(0x7f9d480a7080 msgr2=0x7f9d481333e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:57.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.745+0000 7f9d4eeb8700 1 -- 172.21.15.40:0/743251657 shutdown_connections 2023-09-30T22:33:57.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:57.745+0000 7f9d4eeb8700 1 -- 172.21.15.40:0/743251657 wait complete. 2023-09-30T22:33:57.748 INFO:teuthology.orchestra.run.smithi040.stderr:listed 11 entries 2023-09-30T22:33:57.757 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-09-30T22:33:57.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:33:57.758 DEBUG:teuthology.orchestra.run.smithi158:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-09-30T22:33:57.862 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi158.front.sepia.ceph.com 2023-09-30T22:33:57.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:33:57.862 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-30T22:33:57.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:33:57.924 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list 2023-09-30T22:33:57.970 INFO:teuthology.orchestra.run.smithi158.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-30T22:33:57.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:33:57.971 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T22:33:58.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:33:58.082 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link delete ceph-brx 2023-09-30T22:33:58.183 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-09-30T22:33:58.204 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-30T22:33:58.205 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:33:58.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.338+0000 7f99d7b09700 1 Processor -- start 2023-09-30T22:33:58.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.339+0000 7f99d7b09700 1 -- start start 2023-09-30T22:33:58.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.339+0000 7f99d7b09700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f99d012e590 0x7f99d012e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:58.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.339+0000 7f99d7b09700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f99d012eea0 0x7f99d012d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:58.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.339+0000 7f99d7b09700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99d009ab70 con 0x7f99d012d6d0 2023-09-30T22:33:58.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.339+0000 7f99d7b09700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99d009b270 con 0x7f99d012e590 2023-09-30T22:33:58.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.339+0000 7f99d7b09700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99d009bab0 con 0x7f99d012eea0 2023-09-30T22:33:58.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.339+0000 7f99d50a4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f99d012eea0 0x7f99d012d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:58.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.339+0000 7f99d58a5700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f99d012e590 0x7f99d012e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:58.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.340+0000 7f99d50a4700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f99d012eea0 0x7f99d012d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3302/0 says I am v2:172.21.15.40:34586/0 (socket says 172.21.15.40:34586) 2023-09-30T22:33:58.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.340+0000 7f99d50a4700 1 -- 172.21.15.40:0/2989477226 learned_addr learned my addr 172.21.15.40:0/2989477226 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:33:58.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.340+0000 7f99d50a4700 1 -- 172.21.15.40:0/2989477226 >> v2:172.21.15.40:3300/0 conn(0x7f99d012e590 msgr2=0x7f99d012e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:33:58.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.340+0000 7f99d50a4700 1 --2- 172.21.15.40:0/2989477226 >> v2:172.21.15.40:3300/0 conn(0x7f99d012e590 0x7f99d012e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:58.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.340+0000 7f99d50a4700 1 -- 172.21.15.40:0/2989477226 >> v1:172.21.15.40:6789/0 conn(0x7f99d012d6d0 legacy=0x7f99d0137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:58.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.340+0000 7f99d50a4700 1 -- 172.21.15.40:0/2989477226 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d009bd70 con 0x7f99d012eea0 2023-09-30T22:33:58.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.340+0000 7f99d50a4700 1 --2- 172.21.15.40:0/2989477226 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f99d012eea0 0x7f99d012d190 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f99c0009920 tx=0x7f99c0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78731db8b97e0646 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:58.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.340+0000 7f99d48a3700 1 -- 172.21.15.40:0/2989477226 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c0011830 con 0x7f99d012eea0 2023-09-30T22:33:58.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.340+0000 7f99d48a3700 1 -- 172.21.15.40:0/2989477226 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c0011990 con 0x7f99d012eea0 2023-09-30T22:33:58.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.340+0000 7f99d48a3700 1 -- 172.21.15.40:0/2989477226 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c0011d20 con 0x7f99d012eea0 2023-09-30T22:33:58.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.341+0000 7f99d7b09700 1 -- 172.21.15.40:0/2989477226 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f99d012eea0 msgr2=0x7f99d012d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:58.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.341+0000 7f99d7b09700 1 --2- 172.21.15.40:0/2989477226 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f99d012eea0 0x7f99d012d190 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f99c0009920 tx=0x7f99c0009c30 comp rx=0 tx=0).stop 2023-09-30T22:33:58.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.341+0000 7f99d7b09700 1 -- 172.21.15.40:0/2989477226 shutdown_connections 2023-09-30T22:33:58.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.341+0000 7f99d7b09700 1 --2- 172.21.15.40:0/2989477226 >> v2:172.21.15.40:3300/0 conn(0x7f99d012e590 0x7f99d012e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:58.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.341+0000 7f99d7b09700 1 --2- 172.21.15.40:0/2989477226 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f99d012eea0 0x7f99d012d190 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:58.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.341+0000 7f99d7b09700 1 -- 172.21.15.40:0/2989477226 >> 172.21.15.40:0/2989477226 conn(0x7f99d00a2a00 msgr2=0x7f99d00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:33:58.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.341+0000 7f99d7b09700 1 -- 172.21.15.40:0/2989477226 shutdown_connections 2023-09-30T22:33:58.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.341+0000 7f99d7b09700 1 -- 172.21.15.40:0/2989477226 wait complete. 2023-09-30T22:33:58.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.342+0000 7f99d7b09700 1 Processor -- start 2023-09-30T22:33:58.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.342+0000 7f99d7b09700 1 -- start start 2023-09-30T22:33:58.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.343+0000 7f99d7b09700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99d012d6d0 0x7f99d012c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:58.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.343+0000 7f99d7b09700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99d012e590 0x7f99d012c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:58.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.343+0000 7f99d7b09700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f99d012eea0 0x7f99d01c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:33:58.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.343+0000 7f99d7b09700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d006f2b0 con 0x7f99d012e590 2023-09-30T22:33:58.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.343+0000 7f99d7b09700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d012c0b0 con 0x7f99d012d6d0 2023-09-30T22:33:58.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.343+0000 7f99d7b09700 1 -- --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99d00714f0 con 0x7f99d012eea0 2023-09-30T22:33:58.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.343+0000 7f99d58a5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99d012d6d0 0x7f99d012c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:58.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.343+0000 7f99d60a6700 1 --2- >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f99d012eea0 0x7f99d01c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:58.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.343+0000 7f99d58a5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99d012d6d0 0x7f99d012c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:56802/0 (socket says 172.21.15.40:56802) 2023-09-30T22:33:58.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.343+0000 7f99d58a5700 1 -- 172.21.15.40:0/3015739961 learned_addr learned my addr 172.21.15.40:0/3015739961 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-09-30T22:33:58.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.343+0000 7f99d50a4700 1 --2- 172.21.15.40:0/3015739961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99d012e590 0x7f99d012c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:33:58.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.343+0000 7f99d60a6700 1 -- 172.21.15.40:0/3015739961 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99d012d6d0 msgr2=0x7f99d012c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:58.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.343+0000 7f99d60a6700 1 --2- 172.21.15.40:0/3015739961 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99d012d6d0 0x7f99d012c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:58.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.343+0000 7f99d60a6700 1 -- 172.21.15.40:0/3015739961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99d012e590 msgr2=0x7f99d012c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:33:58.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.343+0000 7f99d60a6700 1 --2- 172.21.15.40:0/3015739961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99d012e590 0x7f99d012c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:33:58.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.343+0000 7f99d60a6700 1 -- 172.21.15.40:0/3015739961 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c0009550 con 0x7f99d012eea0 2023-09-30T22:33:58.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.343+0000 7f99d60a6700 1 --2- 172.21.15.40:0/3015739961 >> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] conn(0x7f99d012eea0 0x7f99d01c84e0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f99c800cbc0 tx=0x7f99c800ced0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:33:58.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.343+0000 7f99c67fc700 1 -- 172.21.15.40:0/3015739961 <== mon.2 v2:172.21.15.40:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c8003c00 con 0x7f99d012eea0 2023-09-30T22:33:58.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.344+0000 7f99c67fc700 1 -- 172.21.15.40:0/3015739961 <== mon.2 v2:172.21.15.40:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c8003d60 con 0x7f99d012eea0 2023-09-30T22:33:58.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.344+0000 7f99d7b09700 1 -- 172.21.15.40:0/3015739961 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d009b4b0 con 0x7f99d012eea0 2023-09-30T22:33:58.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.344+0000 7f99c67fc700 1 -- 172.21.15.40:0/3015739961 <== mon.2 v2:172.21.15.40:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c800aa40 con 0x7f99d012eea0 2023-09-30T22:33:58.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.344+0000 7f99d7b09700 1 -- 172.21.15.40:0/3015739961 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d006ddd0 con 0x7f99d012eea0 2023-09-30T22:33:58.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.344+0000 7f99c67fc700 1 -- 172.21.15.40:0/3015739961 <== mon.2 v2:172.21.15.40:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f99c800aba0 con 0x7f99d012eea0 2023-09-30T22:33:58.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.344+0000 7f99c67fc700 1 -- 172.21.15.40:0/3015739961 <== mon.2 v2:172.21.15.40:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4438+0+0 (secure 0 0 0) 0x7f99c803f5b0 con 0x7f99d012eea0 2023-09-30T22:33:58.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.345+0000 7f99d7b09700 1 -- 172.21.15.40:0/3015739961 --> [v2:172.21.15.40:3302/0,v1:172.21.15.40:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99d0062380 con 0x7f99d012eea0 2023-09-30T22:33:58.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-09-30T22:33:58.349+0000 7f99c67fc700 1 -- 172.21.15.40:0/3015739961 <== mon.2 v2:172.21.15.40:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f99c8012420 con 0x7f99d012eea0 2023-09-30T22:35:58.243 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-09-30T22:35:58.244 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi040 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-09-30T22:35:58.252 INFO:teuthology.misc:Shutting down mds daemons... 2023-09-30T22:35:58.253 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-30T22:35:58.253 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:35:58.266 INFO:tasks.ceph.mds.a:Stopped 2023-09-30T22:35:58.267 INFO:teuthology.misc:Shutting down osd daemons... 2023-09-30T22:35:58.267 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-09-30T22:35:58.267 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:35:58.336 INFO:tasks.ceph.osd.0:Stopped 2023-09-30T22:35:58.336 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-09-30T22:35:58.337 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:35:58.412 INFO:tasks.ceph.osd.1:Stopped 2023-09-30T22:35:58.412 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-09-30T22:35:58.412 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:35:58.480 INFO:tasks.ceph.osd.2:Stopped 2023-09-30T22:35:58.480 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-09-30T22:35:58.481 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:35:58.546 INFO:tasks.ceph.osd.3:Stopped 2023-09-30T22:35:58.546 INFO:teuthology.misc:Shutting down mgr daemons... 2023-09-30T22:35:58.547 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-09-30T22:35:58.547 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:35:58.547 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:35:58.547 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi040 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi040 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' 2023-09-30T22:35:58.559 INFO:tasks.ceph.mgr.x:Stopped 2023-09-30T22:35:58.559 INFO:teuthology.misc:Shutting down mon daemons... 2023-09-30T22:35:58.559 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-09-30T22:35:58.559 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:35:58.599 INFO:tasks.ceph.mon.a:Stopped 2023-09-30T22:35:58.599 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-09-30T22:35:58.599 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:35:58.652 INFO:tasks.ceph.mon.b:Stopped 2023-09-30T22:35:58.653 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-09-30T22:35:58.653 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:35:58.704 INFO:tasks.ceph.mon.c:Stopped 2023-09-30T22:35:58.705 INFO:tasks.ceph:Checking cluster log for badness... 2023-09-30T22:35:58.705 DEBUG:teuthology.orchestra.run.smithi040:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(FS_' | egrep -v '\(MDS_' | egrep -v '\(OSD_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(CACHE_POOL_' | egrep -v '\(POOL_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v 'Monitor daemon marked osd' | egrep -v 'Behind on trimming' | egrep -v 'Manager daemon' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'scrub mismatch' | egrep -v ScrubResult | egrep -v 'wrongly marked' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_MSGR2_NOT_ENABLED\)' | egrep -v 'slow request' | head -n 1 2023-09-30T22:35:58.789 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi040.front.sepia.ceph.com 2023-09-30T22:35:58.789 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-09-30T22:35:58.941 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi040.front.sepia.ceph.com 2023-09-30T22:35:58.941 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-09-30T22:35:59.067 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi040.front.sepia.ceph.com 2023-09-30T22:35:59.067 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-09-30T22:35:59.151 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi040.front.sepia.ceph.com 2023-09-30T22:35:59.151 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-09-30T22:35:59.223 INFO:tasks.ceph:Archiving mon data... 2023-09-30T22:35:59.225 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408039/data/mon.a.tgz 2023-09-30T22:35:59.225 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2023-09-30T22:35:59.244 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.C1EGBmOYJN 2023-09-30T22:35:59.245 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.C1EGBmOYJN 2023-09-30T22:35:59.395 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0666 /tmp/tmp.C1EGBmOYJN 2023-09-30T22:35:59.485 DEBUG:teuthology.orchestra.remote:smithi040:/tmp/tmp.C1EGBmOYJN is 328KB 2023-09-30T22:35:59.580 DEBUG:teuthology.orchestra.run.smithi040:> rm -fr /tmp/tmp.C1EGBmOYJN 2023-09-30T22:35:59.598 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408039/data/mon.b.tgz 2023-09-30T22:35:59.599 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2023-09-30T22:35:59.657 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.Y2PWTPmOem 2023-09-30T22:35:59.657 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Y2PWTPmOem 2023-09-30T22:35:59.791 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0666 /tmp/tmp.Y2PWTPmOem 2023-09-30T22:35:59.881 DEBUG:teuthology.orchestra.remote:smithi040:/tmp/tmp.Y2PWTPmOem is 330KB 2023-09-30T22:35:59.977 DEBUG:teuthology.orchestra.run.smithi040:> rm -fr /tmp/tmp.Y2PWTPmOem 2023-09-30T22:35:59.995 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408039/data/mon.c.tgz 2023-09-30T22:35:59.996 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2023-09-30T22:36:00.052 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.9bVpjPE3jd 2023-09-30T22:36:00.053 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.9bVpjPE3jd 2023-09-30T22:36:00.183 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0666 /tmp/tmp.9bVpjPE3jd 2023-09-30T22:36:00.272 DEBUG:teuthology.orchestra.remote:smithi040:/tmp/tmp.9bVpjPE3jd is 330KB 2023-09-30T22:36:00.367 DEBUG:teuthology.orchestra.run.smithi040:> rm -fr /tmp/tmp.9bVpjPE3jd 2023-09-30T22:36:00.385 INFO:tasks.ceph:Cleaning ceph cluster... 2023-09-30T22:36:00.385 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-09-30T22:36:00.427 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-09-30T22:36:00.506 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-09-30T22:36:00.507 DEBUG:teuthology.orchestra.run.smithi040:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-09-30T22:36:00.509 DEBUG:teuthology.orchestra.run.smithi158:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-09-30T22:36:00.536 INFO:teuthology.orchestra.run.smithi040.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-09-30T22:36:00.589 INFO:teuthology.orchestra.run.smithi158.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-09-30T22:36:00.605 INFO:tasks.ceph:Archiving crash dumps... 2023-09-30T22:36:00.607 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/crash to /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408039/remote/smithi040/crash 2023-09-30T22:36:00.608 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-09-30T22:36:00.638 DEBUG:teuthology.misc:Transferring archived files from smithi158:/var/lib/ceph/crash to /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408039/remote/smithi158/crash 2023-09-30T22:36:00.639 DEBUG:teuthology.orchestra.run.smithi158:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-09-30T22:36:00.719 INFO:tasks.ceph:Compressing logs... 2023-09-30T22:36:00.720 DEBUG:teuthology.orchestra.run.smithi040:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-09-30T22:36:00.722 DEBUG:teuthology.orchestra.run.smithi158:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-09-30T22:36:00.748 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188129.log 2023-09-30T22:36:00.749 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127414.log 2023-09-30T22:36:00.749 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.188129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125353.log 2023-09-30T22:36:00.749 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1%/var/log/ceph/ceph-client.admin.127414.log: -- replaced with /var/log/ceph/ceph-client.admin.188129.log.gz 2023-09-30T22:36:00.760 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142480.log 2023-09-30T22:36:00.761 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.125353.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.127414.log.gz 2023-09-30T22:36:00.761 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124177.log 2023-09-30T22:36:00.761 INFO:teuthology.orchestra.run.smithi040.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.125353.log.gz 2023-09-30T22:36:00.761 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.142480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142258.log 2023-09-30T22:36:00.761 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.124177.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.142480.log.gz 2023-09-30T22:36:00.761 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151661.log 2023-09-30T22:36:00.761 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.124177.log.gz 2023-09-30T22:36:00.762 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.142258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159504.log 2023-09-30T22:36:00.762 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.142258.log.gz 2023-09-30T22:36:00.762 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.151661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160659.log 2023-09-30T22:36:00.762 INFO:teuthology.orchestra.run.smithi040.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.151661.log.gz 2023-09-30T22:36:00.762 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.159504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146829.log 2023-09-30T22:36:00.762 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.159504.log.gz 2023-09-30T22:36:00.762 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.160659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145990.log 2023-09-30T22:36:00.762 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.160659.log.gz 2023-09-30T22:36:00.763 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.146829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145010.log 2023-09-30T22:36:00.763 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.145990.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.146829.log.gz 2023-09-30T22:36:00.763 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189357.log 2023-09-30T22:36:00.763 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.145990.log.gz 2023-09-30T22:36:00.763 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.145010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151688.log 2023-09-30T22:36:00.763 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.145010.log.gz 2023-09-30T22:36:00.763 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.189357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160071.log 2023-09-30T22:36:00.764 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.151688.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.189357.log.gz 2023-09-30T22:36:00.764 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158548.log 2023-09-30T22:36:00.764 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.151688.log.gz 2023-09-30T22:36:00.764 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.160071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166614.log 2023-09-30T22:36:00.764 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.160071.log.gz 2023-09-30T22:36:00.764 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.158548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177802.log 2023-09-30T22:36:00.764 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.166614.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.158548.log.gz 2023-09-30T22:36:00.765 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155947.log 2023-09-30T22:36:00.765 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166614.log.gz 2023-09-30T22:36:00.765 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.177802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190237.log 2023-09-30T22:36:00.765 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.177802.log.gz 2023-09-30T22:36:00.765 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.155947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176449.log 2023-09-30T22:36:00.765 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.190237.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.155947.log.gz 2023-09-30T22:36:00.765 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158129.log 2023-09-30T22:36:00.765 INFO:teuthology.orchestra.run.smithi040.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.190237.log.gz 2023-09-30T22:36:00.766 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.176449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139271.log 2023-09-30T22:36:00.766 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.176449.log.gz 2023-09-30T22:36:00.766 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.158129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164887.log 2023-09-30T22:36:00.766 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.139271.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.158129.log.gz 2023-09-30T22:36:00.766 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194633.log 2023-09-30T22:36:00.766 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.164887.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.139271.log.gz 2023-09-30T22:36:00.766 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141939.log 2023-09-30T22:36:00.766 INFO:teuthology.orchestra.run.smithi040.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.164887.log.gz 2023-09-30T22:36:00.767 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.194633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137410.log 2023-09-30T22:36:00.767 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.141939.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.194633.log.gz 2023-09-30T22:36:00.767 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163599.log 2023-09-30T22:36:00.767 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141939.log.gz 2023-09-30T22:36:00.767 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.137410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166931.log 2023-09-30T22:36:00.767 INFO:teuthology.orchestra.run.smithi040.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.137410.log.gz 2023-09-30T22:36:00.767 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.163599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175220.log 2023-09-30T22:36:00.767 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.163599.log.gz 2023-09-30T22:36:00.768 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.166931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190041.log 2023-09-30T22:36:00.768 INFO:teuthology.orchestra.run.smithi040.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.166931.log.gz 2023-09-30T22:36:00.768 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.175220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138487.log 2023-09-30T22:36:00.768 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.175220.log.gz 2023-09-30T22:36:00.768 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.190041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189703.log 2023-09-30T22:36:00.768 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.138487.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.190041.log.gz 2023-09-30T22:36:00.768 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148611.log 2023-09-30T22:36:00.768 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.138487.log.gz 2023-09-30T22:36:00.769 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.189703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166026.log 2023-09-30T22:36:00.769 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.189703.log.gz 2023-09-30T22:36:00.769 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.148611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149523.log 2023-09-30T22:36:00.769 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.166026.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.148611.log.gz 2023-09-30T22:36:00.769 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147362.log 2023-09-30T22:36:00.769 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.166026.log.gz 2023-09-30T22:36:00.769 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.149523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174329.log 2023-09-30T22:36:00.769 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.149523.log.gz 2023-09-30T22:36:00.770 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.147362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136919.log 2023-09-30T22:36:00.770 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.147362.log.gz 2023-09-30T22:36:00.770 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.174329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189552.log 2023-09-30T22:36:00.770 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.174329.log.gz 2023-09-30T22:36:00.770 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.136919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181605.log 2023-09-30T22:36:00.770 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.136919.log.gz 2023-09-30T22:36:00.770 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.189552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118843.log 2023-09-30T22:36:00.771 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.181605.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.189552.log.gz 2023-09-30T22:36:00.771 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142088.log 2023-09-30T22:36:00.771 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.181605.log.gz 2023-09-30T22:36:00.771 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.118843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172476.log 2023-09-30T22:36:00.771 INFO:teuthology.orchestra.run.smithi040.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.118843.log.gz 2023-09-30T22:36:00.771 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.142088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177213.log 2023-09-30T22:36:00.771 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.142088.log.gz 2023-09-30T22:36:00.771 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.172476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125598.log 2023-09-30T22:36:00.772 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.172476.log.gz 2023-09-30T22:36:00.772 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.177213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124499.log 2023-09-30T22:36:00.791 INFO:teuthology.orchestra.run.smithi158.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.107321.log 2023-09-30T22:36:00.799 INFO:teuthology.orchestra.run.smithi158.stderr:/var/log/ceph/ceph-client.0.107321.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.107321.log.gz 2023-09-30T22:36:00.800 INFO:teuthology.orchestra.run.smithi158.stderr: 2023-09-30T22:36:00.800 INFO:teuthology.orchestra.run.smithi158.stderr:real 0m0.030s 2023-09-30T22:36:00.800 INFO:teuthology.orchestra.run.smithi158.stderr:user 0m0.006s 2023-09-30T22:36:00.800 INFO:teuthology.orchestra.run.smithi158.stderr:sys 0m0.048s 2023-09-30T22:36:00.927 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.177213.log.gz 2023-09-30T22:36:00.927 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.125598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174828.log 2023-09-30T22:36:00.927 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.124499.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.125598.log.gz 2023-09-30T22:36:00.927 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162523.log 2023-09-30T22:36:00.927 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.124499.log.gz 2023-09-30T22:36:00.927 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.174828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190317.log 2023-09-30T22:36:00.928 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.174828.log.gz 2023-09-30T22:36:00.928 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.162523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181212.log 2023-09-30T22:36:00.928 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.190317.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.162523.log.gz 2023-09-30T22:36:00.928 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168303.log 2023-09-30T22:36:00.928 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.190317.log.gz 2023-09-30T22:36:00.928 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.181212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163870.log 2023-09-30T22:36:00.928 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.181212.log.gz 2023-09-30T22:36:00.929 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.168303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175124.log 2023-09-30T22:36:00.929 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.163870.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.168303.log.gz 2023-09-30T22:36:00.929 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173482.log 2023-09-30T22:36:00.929 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.163870.log.gz 2023-09-30T22:36:00.929 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.175124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178246.log 2023-09-30T22:36:00.929 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.175124.log.gz 2023-09-30T22:36:00.929 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.173482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172988.log 2023-09-30T22:36:00.930 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.178246.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.173482.log.gz 2023-09-30T22:36:00.930 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167006.log 2023-09-30T22:36:00.930 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.178246.log.gz 2023-09-30T22:36:00.930 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.172988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188862.log 2023-09-30T22:36:00.930 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.172988.log.gz 2023-09-30T22:36:00.930 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.167006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143395.log 2023-09-30T22:36:00.930 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.188862.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.167006.log.gz 2023-09-30T22:36:00.931 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179348.log 2023-09-30T22:36:00.931 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.188862.log.gz 2023-09-30T22:36:00.931 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.143395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143199.log 2023-09-30T22:36:00.931 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.143395.log.gz 2023-09-30T22:36:00.931 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.179348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147754.log 2023-09-30T22:36:00.931 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.143199.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.179348.log.gz 2023-09-30T22:36:00.931 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180403.log 2023-09-30T22:36:00.931 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.143199.log.gz 2023-09-30T22:36:00.932 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.147754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166392.log 2023-09-30T22:36:00.932 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.147754.log.gz 2023-09-30T22:36:00.932 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163280.log 2023-09-30T22:36:00.932 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.180403.log: /var/log/ceph/ceph-client.admin.166392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150699.log 2023-09-30T22:36:00.932 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.180403.log.gz 2023-09-30T22:36:00.932 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.163280.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.166392.log.gz 2023-09-30T22:36:00.932 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192419.log 2023-09-30T22:36:00.933 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.163280.log.gz 2023-09-30T22:36:00.933 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.150699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175834.log 2023-09-30T22:36:00.933 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.150699.log.gz 2023-09-30T22:36:00.933 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.192419.log: /var/log/ceph/ceph-client.admin.175834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173090.log 2023-09-30T22:36:00.933 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.192419.log.gz 2023-09-30T22:36:00.933 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.175834.log.gz 2023-09-30T22:36:00.933 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169873.log 2023-09-30T22:36:00.933 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.173090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146923.log 2023-09-30T22:36:00.934 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.169873.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.173090.log.gz 2023-09-30T22:36:00.934 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150843.log 2023-09-30T22:36:00.934 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.169873.log.gz 2023-09-30T22:36:00.934 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.146923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125647.log 2023-09-30T22:36:00.934 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.146923.log.gz 2023-09-30T22:36:00.934 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149374.log 2023-09-30T22:36:00.934 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.150843.log: /var/log/ceph/ceph-client.admin.125647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147415.log 2023-09-30T22:36:00.935 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.150843.log.gz 2023-09-30T22:36:00.935 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.125647.log.gz 2023-09-30T22:36:00.935 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143246.log 2023-09-30T22:36:00.935 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.149374.log: /var/log/ceph/ceph-client.admin.147415.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.149374.log.gz 2023-09-30T22:36:00.935 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183317.log 2023-09-30T22:36:00.935 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.143246.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.147415.log.gz 2023-09-30T22:36:00.935 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142311.log 2023-09-30T22:36:00.935 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.143246.log.gz 2023-09-30T22:36:00.936 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.183317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119431.log 2023-09-30T22:36:00.936 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.183317.log.gz 2023-09-30T22:36:00.936 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174710.log 2023-09-30T22:36:00.936 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.142311.log: /var/log/ceph/ceph-client.admin.119431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159966.log 2023-09-30T22:36:00.936 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.142311.log.gz 2023-09-30T22:36:00.936 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.119431.log.gz 2023-09-30T22:36:00.936 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.174710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161957.log 2023-09-30T22:36:00.936 INFO:teuthology.orchestra.run.smithi040.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.174710.log.gz 2023-09-30T22:36:00.937 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.159966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123628.log 2023-09-30T22:36:00.937 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.161957.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.159966.log.gz 2023-09-30T22:36:00.937 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137606.log 2023-09-30T22:36:00.937 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.161957.log.gz 2023-09-30T22:36:00.937 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.123628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173916.log 2023-09-30T22:36:00.937 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.123628.log.gz 2023-09-30T22:36:00.937 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146455.log 2023-09-30T22:36:00.937 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.137606.log: /var/log/ceph/ceph-client.admin.173916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137899.log 2023-09-30T22:36:00.938 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.137606.log.gz 2023-09-30T22:36:00.938 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.173916.log.gz 2023-09-30T22:36:00.938 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.146455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185622.log 2023-09-30T22:36:00.938 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.146455.log.gz 2023-09-30T22:36:00.938 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.137899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151065.log 2023-09-30T22:36:00.938 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.185622.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.137899.log.gz 2023-09-30T22:36:00.938 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180328.log 2023-09-30T22:36:00.938 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.185622.log.gz 2023-09-30T22:36:00.939 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.151065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167568.log 2023-09-30T22:36:00.939 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.151065.log.gz 2023-09-30T22:36:00.939 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129388.log 2023-09-30T22:36:00.939 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.180328.log: /var/log/ceph/ceph-client.admin.167568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195356.log 2023-09-30T22:36:00.939 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.180328.log.gz 2023-09-30T22:36:00.939 INFO:teuthology.orchestra.run.smithi040.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.167568.log.gz 2023-09-30T22:36:00.939 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.129388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156242.log 2023-09-30T22:36:00.940 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.195356.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.129388.log.gz 2023-09-30T22:36:00.940 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151235.log 2023-09-30T22:36:00.940 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.195356.log.gz 2023-09-30T22:36:00.940 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.156242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172894.log 2023-09-30T22:36:00.940 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.156242.log.gz 2023-09-30T22:36:00.940 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195454.log 2023-09-30T22:36:00.940 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.151235.log: /var/log/ceph/ceph-client.admin.172894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165242.log 2023-09-30T22:36:00.940 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.151235.log.gz 2023-09-30T22:36:00.941 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.172894.log.gz 2023-09-30T22:36:00.941 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186562.log 2023-09-30T22:36:00.941 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.195454.log: /var/log/ceph/ceph-client.admin.165242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173184.log 2023-09-30T22:36:00.941 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.195454.log.gz 2023-09-30T22:36:00.941 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.186562.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.165242.log.gz 2023-09-30T22:36:00.941 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172868.log 2023-09-30T22:36:00.941 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.186562.log.gz 2023-09-30T22:36:00.941 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171914.log 2023-09-30T22:36:00.942 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.173184.log: /var/log/ceph/ceph-client.admin.172868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144422.log 2023-09-30T22:36:00.942 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.173184.log.gz 2023-09-30T22:36:00.942 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.172868.log.gz 2023-09-30T22:36:00.942 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152615.log 2023-09-30T22:36:00.942 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.171914.log: /var/log/ceph/ceph-client.admin.144422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151116.log 2023-09-30T22:36:00.942 INFO:teuthology.orchestra.run.smithi040.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.171914.log.gz 2023-09-30T22:36:00.942 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.144422.log.gz 2023-09-30T22:36:00.942 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.152615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128733.log 2023-09-30T22:36:00.943 INFO:teuthology.orchestra.run.smithi040.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.152615.log.gz 2023-09-30T22:36:00.943 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.151116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163721.log 2023-09-30T22:36:00.943 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.151116.log.gz 2023-09-30T22:36:00.943 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.128733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188023.log 2023-09-30T22:36:00.943 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.163721.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.128733.log.gz 2023-09-30T22:36:00.943 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140912.log 2023-09-30T22:36:00.943 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.163721.log.gz 2023-09-30T22:36:00.943 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.188023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138999.log 2023-09-30T22:36:00.944 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.188023.log.gz 2023-09-30T22:36:00.944 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.140912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163329.log 2023-09-30T22:36:00.944 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.138999.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.140912.log.gz 2023-09-30T22:36:00.944 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187908.log 2023-09-30T22:36:00.944 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.138999.log.gz 2023-09-30T22:36:00.944 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.163329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157515.log 2023-09-30T22:36:00.944 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.163329.log.gz 2023-09-30T22:36:00.945 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.187908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143909.log 2023-09-30T22:36:00.945 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.157515.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.187908.log.gz 2023-09-30T22:36:00.945 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143272.log 2023-09-30T22:36:00.945 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.157515.log.gz 2023-09-30T22:36:00.945 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.143909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160536.log 2023-09-30T22:36:00.945 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.143909.log.gz 2023-09-30T22:36:00.945 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.143272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167986.log 2023-09-30T22:36:00.945 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.160536.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.143272.log.gz 2023-09-30T22:36:00.946 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144252.log 2023-09-30T22:36:00.946 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.160536.log.gz 2023-09-30T22:36:00.946 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.167986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170194.log 2023-09-30T22:36:00.946 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.167986.log.gz 2023-09-30T22:36:00.946 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.144252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180599.log 2023-09-30T22:36:00.946 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.170194.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.144252.log.gz 2023-09-30T22:36:00.946 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140447.log 2023-09-30T22:36:00.946 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.170194.log.gz 2023-09-30T22:36:00.947 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.180599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160143.log 2023-09-30T22:36:00.947 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180599.log.gz 2023-09-30T22:36:00.947 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.140447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163991.log 2023-09-30T22:36:00.947 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.160143.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.140447.log.gz 2023-09-30T22:36:00.947 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146408.log 2023-09-30T22:36:00.947 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.160143.log.gz 2023-09-30T22:36:00.947 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.163991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182092.log 2023-09-30T22:36:00.947 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.163991.log.gz 2023-09-30T22:36:00.948 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.146408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174487.log 2023-09-30T22:36:00.948 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.146408.log.gz 2023-09-30T22:36:00.948 INFO:teuthology.orchestra.run.smithi040.stderr:gzip /var/log/ceph/ceph-client.admin.182092.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.185277.log 2023-09-30T22:36:00.948 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.174487.log: gzip 89.6%-5 -- replaced with /var/log/ceph/ceph-client.admin.182092.log.gz--verbose 2023-09-30T22:36:00.948 INFO:teuthology.orchestra.run.smithi040.stderr:-- /var/log/ceph/ceph-client.admin.169144.log 2023-09-30T22:36:00.948 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.174487.log.gz 2023-09-30T22:36:00.948 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.185277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176496.log 2023-09-30T22:36:00.948 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.185277.log.gz 2023-09-30T22:36:00.949 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.169144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160463.log 2023-09-30T22:36:00.949 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.176496.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.169144.log.gz 2023-09-30T22:36:00.949 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139859.log 2023-09-30T22:36:00.949 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.176496.log.gz 2023-09-30T22:36:00.949 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.160463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135621.log 2023-09-30T22:36:00.949 INFO:teuthology.orchestra.run.smithi040.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.160463.log.gz 2023-09-30T22:36:00.949 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.139859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142995.log 2023-09-30T22:36:00.949 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.135621.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139859.log.gz 2023-09-30T22:36:00.950 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160955.log 2023-09-30T22:36:00.950 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.142995.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.135621.log.gz 2023-09-30T22:36:00.950 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.112554.log 2023-09-30T22:36:00.950 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.142995.log.gz 2023-09-30T22:36:00.950 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.160955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146382.log 2023-09-30T22:36:00.950 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.160955.log.gz 2023-09-30T22:36:00.950 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph.tmp-client.admin.112554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165438.log 2023-09-30T22:36:00.950 INFO:teuthology.orchestra.run.smithi040.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.112554.log.gz 2023-09-30T22:36:00.951 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.146382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185133.log 2023-09-30T22:36:00.951 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.146382.log.gz 2023-09-30T22:36:00.951 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.165438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124226.log 2023-09-30T22:36:00.951 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.165438.log.gz 2023-09-30T22:36:00.951 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.185133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156587.log 2023-09-30T22:36:00.951 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.124226.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.185133.log.gz 2023-09-30T22:36:00.951 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162496.log 2023-09-30T22:36:00.952 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.156587.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.124226.log.gz 2023-09-30T22:36:00.952 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189139.log 2023-09-30T22:36:00.952 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.156587.log.gz 2023-09-30T22:36:00.952 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.162496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183194.log 2023-09-30T22:36:00.952 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.189139.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.162496.log.gz 2023-09-30T22:36:00.952 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176869.log 2023-09-30T22:36:00.952 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.189139.log.gz 2023-09-30T22:36:00.953 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.183194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162815.log 2023-09-30T22:36:00.953 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.183194.log.gz 2023-09-30T22:36:00.953 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.176869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189479.log 2023-09-30T22:36:00.953 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.162815.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.176869.log.gz 2023-09-30T22:36:00.953 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124030.log 2023-09-30T22:36:00.953 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.162815.log.gz 2023-09-30T22:36:00.953 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.189479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162274.log 2023-09-30T22:36:00.954 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.189479.log.gz 2023-09-30T22:36:00.954 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.124030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125108.log 2023-09-30T22:36:00.954 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.162274.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.124030.log.gz 2023-09-30T22:36:00.954 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161321.log 2023-09-30T22:36:00.954 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.162274.log.gz 2023-09-30T22:36:00.954 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.125108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124128.log 2023-09-30T22:36:00.954 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.125108.log.gz 2023-09-30T22:36:00.955 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.161321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148883.log 2023-09-30T22:36:00.955 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.124128.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.161321.log.gz 2023-09-30T22:36:00.955 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195169.log 2023-09-30T22:36:00.955 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.124128.log.gz 2023-09-30T22:36:00.955 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.148883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154626.log 2023-09-30T22:36:00.955 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.148883.log.gz 2023-09-30T22:36:00.955 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.195169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138879.log 2023-09-30T22:36:00.956 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.154626.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.195169.log.gz 2023-09-30T22:36:00.956 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139663.log 2023-09-30T22:36:00.956 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.138879.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.154626.log.gz 2023-09-30T22:36:00.956 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147558.log 2023-09-30T22:36:00.956 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.138879.log.gz 2023-09-30T22:36:00.956 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.139663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168948.log 2023-09-30T22:36:00.956 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.147558.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.139663.log.gz 2023-09-30T22:36:00.956 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167715.log 2023-09-30T22:36:00.957 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.147558.log.gz 2023-09-30T22:36:00.957 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.168948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142650.log 2023-09-30T22:36:00.957 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.168948.log.gz 2023-09-30T22:36:00.957 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.167715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136411.log 2023-09-30T22:36:00.957 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.142650.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.167715.log.gz 2023-09-30T22:36:00.957 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148002.log 2023-09-30T22:36:00.957 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.142650.log.gz 2023-09-30T22:36:00.957 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.136411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172698.log 2023-09-30T22:36:00.958 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.136411.log.gz 2023-09-30T22:36:00.958 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.148002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178982.log 2023-09-30T22:36:00.958 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.172698.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.148002.log.gz 2023-09-30T22:36:00.958 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145821.log 2023-09-30T22:36:00.958 INFO:teuthology.orchestra.run.smithi040.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.172698.log.gz 2023-09-30T22:36:00.958 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.178982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158887.log 2023-09-30T22:36:00.958 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.178982.log.gz 2023-09-30T22:36:00.959 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.145821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136553.log 2023-09-30T22:36:00.959 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.158887.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.145821.log.gz 2023-09-30T22:36:00.959 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188942.log 2023-09-30T22:36:00.959 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.158887.log.gz 2023-09-30T22:36:00.959 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.136553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141231.log 2023-09-30T22:36:00.959 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.136553.log.gz 2023-09-30T22:36:00.959 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.188942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122990.log 2023-09-30T22:36:00.959 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.141231.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.188942.log.gz 2023-09-30T22:36:00.960 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165020.log 2023-09-30T22:36:00.960 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.141231.log.gz 2023-09-30T22:36:00.960 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.122990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141514.log 2023-09-30T22:36:00.960 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.122990.log.gz 2023-09-30T22:36:00.960 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.165020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186706.log 2023-09-30T22:36:00.960 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.141514.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.165020.log.gz 2023-09-30T22:36:00.960 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170516.log 2023-09-30T22:36:00.961 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.186706.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.141514.log.gz 2023-09-30T22:36:00.961 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165216.log 2023-09-30T22:36:00.961 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.186706.log.gz 2023-09-30T22:36:00.961 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.170516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167398.log 2023-09-30T22:36:00.961 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.165216.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.170516.log.gz 2023-09-30T22:36:00.961 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188692.log 2023-09-30T22:36:00.961 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.165216.log.gz 2023-09-30T22:36:00.961 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.167398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141155.log 2023-09-30T22:36:00.962 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.167398.log.gz 2023-09-30T22:36:00.962 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.188692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193595.log 2023-09-30T22:36:00.962 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.141155.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.188692.log.gz 2023-09-30T22:36:00.962 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153255.log 2023-09-30T22:36:00.962 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.141155.log.gz 2023-09-30T22:36:00.962 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.193595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149302.log 2023-09-30T22:36:00.962 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.193595.log.gz 2023-09-30T22:36:00.962 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.153255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173874.log 2023-09-30T22:36:00.963 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.149302.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.153255.log.gz 2023-09-30T22:36:00.963 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181749.log 2023-09-30T22:36:00.963 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.149302.log.gz 2023-09-30T22:36:00.963 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.173874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172769.log 2023-09-30T22:36:00.963 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.173874.log.gz 2023-09-30T22:36:00.963 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.181749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162078.log 2023-09-30T22:36:00.963 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.172769.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.181749.log.gz 2023-09-30T22:36:00.964 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175674.log 2023-09-30T22:36:00.964 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.172769.log.gz 2023-09-30T22:36:00.964 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.162078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181553.log 2023-09-30T22:36:00.964 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.162078.log.gz 2023-09-30T22:36:00.964 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.175674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141670.log 2023-09-30T22:36:00.964 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.181553.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.175674.log.gz 2023-09-30T22:36:00.964 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158966.log 2023-09-30T22:36:00.965 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.141670.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.181553.log.gz 2023-09-30T22:36:00.965 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188765.log 2023-09-30T22:36:00.965 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.141670.log.gz 2023-09-30T22:36:00.965 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.158966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148368.log 2023-09-30T22:36:00.965 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.188765.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.158966.log.gz 2023-09-30T22:36:00.965 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163795.log 2023-09-30T22:36:00.965 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.188765.log.gz 2023-09-30T22:36:00.965 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.148368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140690.log 2023-09-30T22:36:00.966 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.148368.log.gz 2023-09-30T22:36:00.966 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.163795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154235.log 2023-09-30T22:36:00.966 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.140690.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.163795.log.gz 2023-09-30T22:36:00.966 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138364.log 2023-09-30T22:36:00.966 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.140690.log.gz 2023-09-30T22:36:00.966 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.154235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182141.log 2023-09-30T22:36:00.966 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.154235.log.gz 2023-09-30T22:36:00.966 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.138364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146604.log 2023-09-30T22:36:00.967 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.182141.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.138364.log.gz 2023-09-30T22:36:00.967 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136037.log 2023-09-30T22:36:00.967 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.182141.log.gz 2023-09-30T22:36:00.967 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.146604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153450.log 2023-09-30T22:36:00.967 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.146604.log.gz 2023-09-30T22:36:00.967 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.136037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176692.log 2023-09-30T22:36:00.967 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.153450.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.136037.log.gz 2023-09-30T22:36:00.968 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157567.log 2023-09-30T22:36:00.968 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.153450.log.gz 2023-09-30T22:36:00.968 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.176692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153987.log 2023-09-30T22:36:00.968 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.176692.log.gz 2023-09-30T22:36:00.968 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.157567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124696.log 2023-09-30T22:36:00.968 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.153987.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.157567.log.gz 2023-09-30T22:36:00.968 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165363.log 2023-09-30T22:36:00.968 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.153987.log.gz 2023-09-30T22:36:00.969 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.124696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157711.log 2023-09-30T22:36:00.969 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.124696.log.gz 2023-09-30T22:36:00.969 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.165363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177384.log 2023-09-30T22:36:00.969 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.157711.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.165363.log.gz 2023-09-30T22:36:00.969 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147903.log 2023-09-30T22:36:00.969 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.157711.log.gz 2023-09-30T22:36:00.969 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.177384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125963.log 2023-09-30T22:36:00.969 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.177384.log.gz 2023-09-30T22:36:00.970 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.147903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150746.log 2023-09-30T22:36:00.970 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.125963.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.147903.log.gz 2023-09-30T22:36:00.970 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188130.log 2023-09-30T22:36:00.970 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.125963.log.gz 2023-09-30T22:36:00.970 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.150746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171327.log 2023-09-30T22:36:00.970 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.150746.log.gz 2023-09-30T22:36:00.970 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.188130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172502.log 2023-09-30T22:36:00.970 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.171327.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.188130.log.gz 2023-09-30T22:36:00.971 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190851.log 2023-09-30T22:36:00.971 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.171327.log.gz 2023-09-30T22:36:00.971 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.172502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151431.log 2023-09-30T22:36:00.971 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.172502.log.gz 2023-09-30T22:36:00.971 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.190851.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-09-30T22:36:00.971 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.151431.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.190851.log.gz 2023-09-30T22:36:00.971 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186759.log 2023-09-30T22:36:00.971 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.151431.log.gz 2023-09-30T22:36:00.972 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173456.log 2023-09-30T22:36:00.972 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.186759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187882.log 2023-09-30T22:36:00.972 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.186759.log.gz 2023-09-30T22:36:00.972 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.173456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182925.log 2023-09-30T22:36:00.972 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.187882.log: gzip 88.1%-5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.173456.log.gz/var/log/ceph/ceph-client.admin.184938.log 2023-09-30T22:36:00.972 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-09-30T22:36:00.972 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.187882.log.gz 2023-09-30T22:36:00.973 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.182925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137507.log 2023-09-30T22:36:00.973 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.182925.log.gz 2023-09-30T22:36:00.973 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.184938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163011.log 2023-09-30T22:36:00.973 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.137507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139783.log 2023-09-30T22:36:00.973 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.184938.log.gz 2023-09-30T22:36:00.973 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.163011.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.137507.log.gz 2023-09-30T22:36:00.973 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137605.log 2023-09-30T22:36:00.973 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.163011.log.gz 2023-09-30T22:36:00.974 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.139783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137554.log 2023-09-30T22:36:00.974 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.139783.log.gz 2023-09-30T22:36:00.974 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.137605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192688.log 2023-09-30T22:36:00.974 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.137554.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.137605.log.gz 2023-09-30T22:36:00.974 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187294.log 2023-09-30T22:36:00.974 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.137554.log.gz 2023-09-30T22:36:00.974 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.192688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137409.log 2023-09-30T22:36:00.974 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.192688.log.gz 2023-09-30T22:36:00.975 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.187294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194831.log 2023-09-30T22:36:00.975 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137409.log: /var/log/ceph/ceph-client.admin.166810.log 2023-09-30T22:36:00.975 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.187294.log.gz 2023-09-30T22:36:00.975 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.194831.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.137409.log.gz 2023-09-30T22:36:00.975 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125451.log 2023-09-30T22:36:00.975 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.194831.log.gz 2023-09-30T22:36:00.975 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.166810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148734.log 2023-09-30T22:36:00.976 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.125451.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.166810.log.gz 2023-09-30T22:36:00.976 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187516.log 2023-09-30T22:36:00.976 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.125451.log.gz 2023-09-30T22:36:00.976 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.148734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180625.log 2023-09-30T22:36:00.976 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.148734.log.gz 2023-09-30T22:36:00.976 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.187516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186536.log 2023-09-30T22:36:00.976 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.187516.log.gz 2023-09-30T22:36:00.976 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.180625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147511.log 2023-09-30T22:36:00.977 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.180625.log.gz 2023-09-30T22:36:00.977 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.186536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129584.log 2023-09-30T22:36:00.977 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.186536.log.gz 2023-09-30T22:36:00.977 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.147511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181112.log 2023-09-30T22:36:00.977 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.129584.log: 87.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.147511.log.gz-5 2023-09-30T22:36:00.977 INFO:teuthology.orchestra.run.smithi040.stderr:--verbose -- /var/log/ceph/ceph-client.admin.162300.log 2023-09-30T22:36:00.977 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.129584.log.gz 2023-09-30T22:36:00.977 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.181112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179766.log 2023-09-30T22:36:00.978 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.181112.log.gz 2023-09-30T22:36:00.978 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.162300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174488.log 2023-09-30T22:36:00.978 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.162300.log.gz 2023-09-30T22:36:00.978 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.179766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167519.log 2023-09-30T22:36:00.978 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.174488.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.179766.log.gz 2023-09-30T22:36:00.978 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154967.log 2023-09-30T22:36:00.978 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.174488.log.gz 2023-09-30T22:36:00.978 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.167519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159867.log 2023-09-30T22:36:00.979 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.154967.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.167519.log.gz 2023-09-30T22:36:00.979 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179792.log 2023-09-30T22:36:00.979 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.154967.log.gz 2023-09-30T22:36:00.979 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.159867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136749.log 2023-09-30T22:36:00.979 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.159867.log.gz 2023-09-30T22:36:00.979 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.179792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160340.log 2023-09-30T22:36:00.979 INFO:teuthology.orchestra.run.smithi040.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.179792.log.gz 2023-09-30T22:36:00.979 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.136749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140959.log 2023-09-30T22:36:00.980 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.160340.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.136749.log.gz 2023-09-30T22:36:00.980 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166588.log 2023-09-30T22:36:00.980 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.160340.log.gz 2023-09-30T22:36:00.980 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.140959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129976.log 2023-09-30T22:36:00.980 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140959.log.gz 2023-09-30T22:36:00.980 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.166588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149353.log 2023-09-30T22:36:00.980 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.129976.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.166588.log.gz 2023-09-30T22:36:00.980 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150896.log 2023-09-30T22:36:00.981 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.149353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174044.log 2023-09-30T22:36:00.981 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.150896.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.149353.log.gz 2023-09-30T22:36:00.981 INFO:teuthology.orchestra.run.smithi040.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.129976.log.gz 2023-09-30T22:36:00.981 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144963.log 2023-09-30T22:36:00.981 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.150896.log.gz 2023-09-30T22:36:00.981 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.174044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174854.log 2023-09-30T22:36:00.981 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.174044.log.gz 2023-09-30T22:36:00.981 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.144963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140542.log 2023-09-30T22:36:00.982 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.174854.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.144963.log.gz 2023-09-30T22:36:00.982 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176030.log 2023-09-30T22:36:00.982 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.174854.log.gz 2023-09-30T22:36:00.982 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.140542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192838.log 2023-09-30T22:36:00.982 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.140542.log.gz 2023-09-30T22:36:00.982 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177998.log 2023-09-30T22:36:00.982 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.176030.log: /var/log/ceph/ceph-client.admin.192838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166000.log 2023-09-30T22:36:00.983 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.176030.log.gz 2023-09-30T22:36:00.983 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.177998.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.192838.log.gz 2023-09-30T22:36:00.983 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189945.log 2023-09-30T22:36:00.983 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128563.log 2023-09-30T22:36:00.983 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.177998.log.gz 2023-09-30T22:36:00.983 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.166000.log: /var/log/ceph/ceph-client.admin.189945.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.166000.log.gz 2023-09-30T22:36:00.983 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158213.log 2023-09-30T22:36:00.983 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.189945.log.gz 2023-09-30T22:36:00.984 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192027.log 2023-09-30T22:36:00.984 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.128563.log: /var/log/ceph/ceph-client.admin.158213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129290.log 2023-09-30T22:36:00.984 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.128563.log.gz 2023-09-30T22:36:00.984 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158213.log.gz 2023-09-30T22:36:00.984 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.192027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182680.log 2023-09-30T22:36:00.984 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.192027.log.gz 2023-09-30T22:36:00.984 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152322.log 2023-09-30T22:36:00.984 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.129290.log: /var/log/ceph/ceph-client.admin.182680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140129.log 2023-09-30T22:36:00.984 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.129290.log.gz 2023-09-30T22:36:00.985 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.182680.log.gz 2023-09-30T22:36:00.985 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.152322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155262.log 2023-09-30T22:36:00.985 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.152322.log.gz 2023-09-30T22:36:00.985 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.140129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123883.log 2023-09-30T22:36:00.985 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.155262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189871.log 2023-09-30T22:36:00.985 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.140129.log.gz 2023-09-30T22:36:00.985 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.155262.log.gz 2023-09-30T22:36:00.986 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.123883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155803.log 2023-09-30T22:36:00.986 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.123883.log.gz 2023-09-30T22:36:00.986 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.189871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143073.log 2023-09-30T22:36:00.986 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.155803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159279.log 2023-09-30T22:36:00.986 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.189871.log.gz 2023-09-30T22:36:00.986 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.155803.log.gz 2023-09-30T22:36:00.986 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.143073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137946.log 2023-09-30T22:36:00.986 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.143073.log.gz 2023-09-30T22:36:00.987 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156438.log 2023-09-30T22:36:00.987 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.159279.log: /var/log/ceph/ceph-client.admin.137946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168209.log 2023-09-30T22:36:00.987 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.159279.log.gz 2023-09-30T22:36:00.987 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.156438.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.137946.log.gz 2023-09-30T22:36:00.987 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165559.log 2023-09-30T22:36:00.987 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.156438.log.gz 2023-09-30T22:36:00.987 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.168209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145598.log 2023-09-30T22:36:00.987 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.168209.log.gz 2023-09-30T22:36:00.988 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.165559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185028.log 2023-09-30T22:36:00.988 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.165559.log.gz 2023-09-30T22:36:00.988 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.145598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190459.log 2023-09-30T22:36:00.988 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.185028.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.145598.log.gz 2023-09-30T22:36:00.988 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147315.log 2023-09-30T22:36:00.988 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.185028.log.gz 2023-09-30T22:36:00.988 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.190459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150158.log 2023-09-30T22:36:00.988 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.190459.log.gz 2023-09-30T22:36:00.989 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.147315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125500.log 2023-09-30T22:36:00.989 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.147315.log.gz 2023-09-30T22:36:00.989 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.150158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183513.log 2023-09-30T22:36:00.989 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.125500.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.150158.log.gz 2023-09-30T22:36:00.989 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143042.log 2023-09-30T22:36:00.989 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.125500.log.gz 2023-09-30T22:36:00.989 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.183513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173064.log 2023-09-30T22:36:00.990 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.143042.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.183513.log.gz 2023-09-30T22:36:00.990 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136552.log 2023-09-30T22:36:00.990 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.143042.log.gz 2023-09-30T22:36:00.990 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.173064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122921.log 2023-09-30T22:36:00.990 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.173064.log.gz 2023-09-30T22:36:00.990 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.136552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137999.log 2023-09-30T22:36:00.990 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.122921.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.136552.log.gzgzip 2023-09-30T22:36:00.990 INFO:teuthology.orchestra.run.smithi040.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.136723.log 2023-09-30T22:36:00.991 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.122921.log.gz 2023-09-30T22:36:00.991 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.137999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184519.log 2023-09-30T22:36:00.991 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.137999.log.gz 2023-09-30T22:36:00.991 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.136723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158495.log 2023-09-30T22:36:00.991 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.184519.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.136723.log.gz 2023-09-30T22:36:00.991 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156757.log 2023-09-30T22:36:00.991 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.184519.log.gz 2023-09-30T22:36:00.991 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.158495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159181.log 2023-09-30T22:36:00.992 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.156757.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.158495.log.gz 2023-09-30T22:36:00.992 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183390.log 2023-09-30T22:36:00.992 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.156757.log.gz 2023-09-30T22:36:00.992 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.159181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149471.log 2023-09-30T22:36:00.992 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.159181.log.gz 2023-09-30T22:36:00.992 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.183390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135892.log 2023-09-30T22:36:00.992 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.183390.log.gz 2023-09-30T22:36:00.992 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.149471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146335.log 2023-09-30T22:36:00.993 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.135892.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.149471.log.gz 2023-09-30T22:36:00.993 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128075.log 2023-09-30T22:36:00.993 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.135892.log.gz 2023-09-30T22:36:00.993 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.146335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147023.log 2023-09-30T22:36:00.993 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.128075.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.146335.log.gz 2023-09-30T22:36:00.993 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178611.log 2023-09-30T22:36:00.993 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.128075.log.gz 2023-09-30T22:36:00.993 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.147023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146774.log 2023-09-30T22:36:00.994 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.147023.log.gz 2023-09-30T22:36:00.994 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.178611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160759.log 2023-09-30T22:36:00.994 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.178611.log.gz 2023-09-30T22:36:00.994 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.146774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194165.log 2023-09-30T22:36:00.994 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.160759.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.146774.log.gz 2023-09-30T22:36:00.994 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143468.log 2023-09-30T22:36:00.994 INFO:teuthology.orchestra.run.smithi040.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.160759.log.gz 2023-09-30T22:36:00.994 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.194165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142407.log 2023-09-30T22:36:00.995 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.194165.log.gz 2023-09-30T22:36:00.995 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149116.log 2023-09-30T22:36:00.995 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.143468.log: /var/log/ceph/ceph-client.admin.142407.log: gzip -5 --verbose -- 89.5%/var/log/ceph/ceph-client.admin.175808.log 2023-09-30T22:36:00.995 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.143468.log.gz 2023-09-30T22:36:00.995 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.142407.log.gz 2023-09-30T22:36:00.995 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.149116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163134.log 2023-09-30T22:36:00.995 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.149116.log.gz 2023-09-30T22:36:00.995 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.175808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181504.log 2023-09-30T22:36:00.996 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.163134.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.175808.log.gz 2023-09-30T22:36:00.996 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173949.log 2023-09-30T22:36:00.996 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.163134.log.gz 2023-09-30T22:36:00.996 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.181504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179178.log 2023-09-30T22:36:00.996 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.181504.log.gz/var/log/ceph/ceph-client.admin.173949.log: 2023-09-30T22:36:00.996 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142211.log 2023-09-30T22:36:00.996 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.179178.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.173949.log.gz 2023-09-30T22:36:00.997 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176422.log 2023-09-30T22:36:00.997 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.179178.log.gz 2023-09-30T22:36:00.997 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.142211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183121.log 2023-09-30T22:36:00.997 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.142211.log.gz 2023-09-30T22:36:00.997 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.176422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125696.log 2023-09-30T22:36:00.997 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.183121.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.176422.log.gz 2023-09-30T22:36:00.997 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136211.log 2023-09-30T22:36:00.997 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.183121.log.gz 2023-09-30T22:36:00.998 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.125696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146065.log 2023-09-30T22:36:00.998 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.125696.log.gz 2023-09-30T22:36:00.998 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.136211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125059.log 2023-09-30T22:36:00.998 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.146065.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.136211.log.gz 2023-09-30T22:36:00.998 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128759.log 2023-09-30T22:36:00.998 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.146065.log.gz 2023-09-30T22:36:00.998 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.125059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182214.log 2023-09-30T22:36:00.999 INFO:teuthology.orchestra.run.smithi040.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.125059.log.gz/var/log/ceph/ceph-client.admin.128759.log: 2023-09-30T22:36:00.999 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130138.log 2023-09-30T22:36:00.999 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.182214.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.128759.log.gz 2023-09-30T22:36:00.999 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138338.log 2023-09-30T22:36:00.999 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.130138.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.182214.log.gz 2023-09-30T22:36:00.999 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173652.log 2023-09-30T22:36:00.999 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.130138.log.gz 2023-09-30T22:36:01.000 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.138338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181822.log 2023-09-30T22:36:01.000 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.173652.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.138338.log.gz 2023-09-30T22:36:01.000 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129927.log 2023-09-30T22:36:01.000 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.173652.log.gz 2023-09-30T22:36:01.000 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.181822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140325.log 2023-09-30T22:36:01.000 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.181822.log.gz/var/log/ceph/ceph-client.admin.129927.log: 2023-09-30T22:36:01.000 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119234.log 2023-09-30T22:36:01.000 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.140325.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.129927.log.gz 2023-09-30T22:36:01.001 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160573.log 2023-09-30T22:36:01.001 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140325.log.gz 2023-09-30T22:36:01.001 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.119234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187098.log 2023-09-30T22:36:01.001 INFO:teuthology.orchestra.run.smithi040.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.119234.log.gz 2023-09-30T22:36:01.001 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.160573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175320.log 2023-09-30T22:36:01.001 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.187098.log: gzip -5 --verbose 88.0%-- /var/log/ceph/ceph-client.admin.186265.log -- replaced with /var/log/ceph/ceph-client.admin.160573.log.gz 2023-09-30T22:36:01.001 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-09-30T22:36:01.001 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.187098.log.gz 2023-09-30T22:36:01.002 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.175320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170050.log 2023-09-30T22:36:01.002 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.175320.log.gz 2023-09-30T22:36:01.002 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.186265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193569.log 2023-09-30T22:36:01.002 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.186265.log.gz 2023-09-30T22:36:01.002 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.170050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185972.log 2023-09-30T22:36:01.002 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.170050.log.gz 2023-09-30T22:36:01.002 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.193569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171522.log 2023-09-30T22:36:01.002 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.185972.log: gzip 88.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.193569.log.gz--verbose 2023-09-30T22:36:01.003 INFO:teuthology.orchestra.run.smithi040.stderr:-- /var/log/ceph/ceph-client.admin.153672.log 2023-09-30T22:36:01.003 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.185972.log.gz 2023-09-30T22:36:01.003 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.171522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119281.log 2023-09-30T22:36:01.003 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.171522.log.gz 2023-09-30T22:36:01.003 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.153672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157395.log 2023-09-30T22:36:01.003 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.153672.log.gz 2023-09-30T22:36:01.003 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.119281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156831.log 2023-09-30T22:36:01.004 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.119281.log.gz 2023-09-30T22:36:01.004 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.157395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141623.log 2023-09-30T22:36:01.004 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.157395.log.gz 2023-09-30T22:36:01.004 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.156831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179445.log 2023-09-30T22:36:01.004 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.141623.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.156831.log.gz 2023-09-30T22:36:01.004 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165465.log 2023-09-30T22:36:01.004 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.141623.log.gz 2023-09-30T22:36:01.004 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.179445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192811.log 2023-09-30T22:36:01.005 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.165465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141892.log 2023-09-30T22:36:01.005 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.179445.log.gz 2023-09-30T22:36:01.005 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.165465.log.gz 2023-09-30T22:36:01.005 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.192811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160732.log 2023-09-30T22:36:01.005 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.192811.log.gz 2023-09-30T22:36:01.005 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179989.log 2023-09-30T22:36:01.005 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.141892.log: /var/log/ceph/ceph-client.admin.160732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177658.log 2023-09-30T22:36:01.005 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.141892.log.gz 2023-09-30T22:36:01.006 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.160732.log.gz 2023-09-30T22:36:01.006 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.179989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179374.log 2023-09-30T22:36:01.006 INFO:teuthology.orchestra.run.smithi040.stderr:gzip 88.3%-5 -- replaced with /var/log/ceph/ceph-client.admin.179989.log.gz--verbose 2023-09-30T22:36:01.006 INFO:teuthology.orchestra.run.smithi040.stderr:-- /var/log/ceph/ceph-client.admin.155411.log 2023-09-30T22:36:01.006 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.177658.log: /var/log/ceph/ceph-client.admin.179374.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.177658.log.gz-5 2023-09-30T22:36:01.006 INFO:teuthology.orchestra.run.smithi040.stderr:--verbose -- /var/log/ceph/ceph-client.admin.169021.log 2023-09-30T22:36:01.006 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.179374.log.gz 2023-09-30T22:36:01.007 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130332.log 2023-09-30T22:36:01.007 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.155411.log: /var/log/ceph/ceph-client.admin.169021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177462.log 2023-09-30T22:36:01.007 INFO:teuthology.orchestra.run.smithi040.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.155411.log.gz 2023-09-30T22:36:01.007 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.169021.log.gz 2023-09-30T22:36:01.007 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.130332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127840.log 2023-09-30T22:36:01.007 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.130332.log.gz 2023-09-30T22:36:01.007 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.177462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150281.log 2023-09-30T22:36:01.007 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.177462.log.gz 2023-09-30T22:36:01.008 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.127840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139710.log 2023-09-30T22:36:01.008 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.150281.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.127840.log.gz 2023-09-30T22:36:01.008 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163918.log 2023-09-30T22:36:01.008 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.139710.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.150281.log.gz 2023-09-30T22:36:01.008 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164113.log 2023-09-30T22:36:01.008 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.139710.log.gz 2023-09-30T22:36:01.008 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.163918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193229.log 2023-09-30T22:36:01.008 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.163918.log.gz 2023-09-30T22:36:01.009 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.164113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136356.log 2023-09-30T22:36:01.009 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.193229.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.164113.log.gz 2023-09-30T22:36:01.009 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169366.log 2023-09-30T22:36:01.009 INFO:teuthology.orchestra.run.smithi040.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.193229.log.gz 2023-09-30T22:36:01.009 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183268.log 2023-09-30T22:36:01.009 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.136356.log: /var/log/ceph/ceph-client.admin.169366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136999.log 2023-09-30T22:36:01.009 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.136356.log.gz 2023-09-30T22:36:01.009 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.169366.log.gz 2023-09-30T22:36:01.009 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.183268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152668.log 2023-09-30T22:36:01.010 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175612.log 2023-09-30T22:36:01.010 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.183268.log.gz 2023-09-30T22:36:01.010 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.136999.log: /var/log/ceph/ceph-client.admin.152668.log: gzip -5 --verbose 88.0%-- /var/log/ceph/ceph-client.admin.194243.log -- replaced with /var/log/ceph/ceph-client.admin.136999.log.gz 2023-09-30T22:36:01.010 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-09-30T22:36:01.010 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.152668.log.gz 2023-09-30T22:36:01.010 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155359.log 2023-09-30T22:36:01.010 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.175612.log: /var/log/ceph/ceph-client.admin.194243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159962.log 2023-09-30T22:36:01.011 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.175612.log.gz 2023-09-30T22:36:01.011 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.194243.log.gz 2023-09-30T22:36:01.011 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.155359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139122.log 2023-09-30T22:36:01.011 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.155359.log.gz 2023-09-30T22:36:01.011 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.159962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144814.log 2023-09-30T22:36:01.011 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.159962.log.gz 2023-09-30T22:36:01.011 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.139122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178168.log 2023-09-30T22:36:01.011 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139122.log.gz 2023-09-30T22:36:01.012 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.144814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167425.log 2023-09-30T22:36:01.012 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.144814.log.gz 2023-09-30T22:36:01.012 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.178168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171202.log 2023-09-30T22:36:01.012 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.178168.log.gz 2023-09-30T22:36:01.012 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.167425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164775.log 2023-09-30T22:36:01.012 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.167425.log.gz 2023-09-30T22:36:01.012 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.171202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141035.log 2023-09-30T22:36:01.012 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.171202.log.gz 2023-09-30T22:36:01.013 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.164775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185533.log 2023-09-30T22:36:01.013 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.141035.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.164775.log.gz 2023-09-30T22:36:01.013 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190729.log 2023-09-30T22:36:01.013 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.141035.log.gz 2023-09-30T22:36:01.013 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.185533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158399.log 2023-09-30T22:36:01.013 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.185533.log.gz 2023-09-30T22:36:01.013 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.190729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158913.log 2023-09-30T22:36:01.013 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.190729.log.gz 2023-09-30T22:36:01.014 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.158399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127691.log 2023-09-30T22:36:01.014 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.158399.log.gz 2023-09-30T22:36:01.014 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.158913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152911.log 2023-09-30T22:36:01.014 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.158913.log.gz 2023-09-30T22:36:01.014 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124865.log 2023-09-30T22:36:01.014 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.127691.log: /var/log/ceph/ceph-client.admin.152911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180769.log 2023-09-30T22:36:01.014 INFO:teuthology.orchestra.run.smithi040.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.127691.log.gz 2023-09-30T22:36:01.014 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3%/var/log/ceph/ceph-client.admin.124865.log: -- replaced with /var/log/ceph/ceph-client.admin.152911.log.gz 2023-09-30T22:36:01.015 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151039.log 2023-09-30T22:36:01.015 INFO:teuthology.orchestra.run.smithi040.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.124865.log.gz 2023-09-30T22:36:01.015 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.180769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190067.log 2023-09-30T22:36:01.015 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.180769.log.gz 2023-09-30T22:36:01.015 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.151039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136210.log 2023-09-30T22:36:01.015 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.151039.log.gz 2023-09-30T22:36:01.015 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.190067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128591.log 2023-09-30T22:36:01.015 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.136210.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.190067.log.gz 2023-09-30T22:36:01.016 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-09-30T22:36:01.016 INFO:teuthology.orchestra.run.smithi040.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.136210.log.gz 2023-09-30T22:36:01.016 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.128591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185677.log 2023-09-30T22:36:01.016 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.128591.log.gz 2023-09-30T22:36:01.016 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164654.log 2023-09-30T22:36:01.016 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.185677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156196.log 2023-09-30T22:36:01.016 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.185677.log.gz 2023-09-30T22:36:01.016 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.164654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156026.log 2023-09-30T22:36:01.017 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.156196.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.164654.log.gz 2023-09-30T22:36:01.017 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151483.log 2023-09-30T22:36:01.017 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.156196.log.gz 2023-09-30T22:36:01.017 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.156026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138195.log 2023-09-30T22:36:01.017 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.151483.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.156026.log.gz 2023-09-30T22:36:01.017 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179962.log 2023-09-30T22:36:01.017 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.138195.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.151483.log.gz 2023-09-30T22:36:01.017 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175442.log 2023-09-30T22:36:01.018 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.138195.log.gz 2023-09-30T22:36:01.018 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.179962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172178.log 2023-09-30T22:36:01.018 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.175442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188914.log 2023-09-30T22:36:01.018 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.179962.log.gz 2023-09-30T22:36:01.018 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.175442.log.gz 2023-09-30T22:36:01.018 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.172178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149918.log 2023-09-30T22:36:01.018 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123734.log 2023-09-30T22:36:01.018 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.172178.log.gz 2023-09-30T22:36:01.019 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.188914.log: /var/log/ceph/ceph-client.admin.149918.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.188914.log.gz 2023-09-30T22:36:01.019 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142872.log 2023-09-30T22:36:01.019 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.149918.log.gz 2023-09-30T22:36:01.019 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159671.log 2023-09-30T22:36:01.019 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.123734.log: /var/log/ceph/ceph-client.admin.142872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185426.log 2023-09-30T22:36:01.019 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.123734.log.gz 2023-09-30T22:36:01.019 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.142872.log.gz 2023-09-30T22:36:01.020 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.159671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138534.log 2023-09-30T22:36:01.020 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178954.log 2023-09-30T22:36:01.020 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.159671.log.gz/var/log/ceph/ceph-client.admin.185426.log: 2023-09-30T22:36:01.020 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.138534.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.185426.log.gz 2023-09-30T22:36:01.020 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140494.log 2023-09-30T22:36:01.020 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.138534.log.gz 2023-09-30T22:36:01.020 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140886.log 2023-09-30T22:36:01.020 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.178954.log: /var/log/ceph/ceph-client.admin.140494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158717.log 2023-09-30T22:36:01.021 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.178954.log.gz 2023-09-30T22:36:01.021 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.140494.log.gz 2023-09-30T22:36:01.021 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.140886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123577.log 2023-09-30T22:36:01.021 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164432.log 2023-09-30T22:36:01.021 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.140886.log.gz 2023-09-30T22:36:01.021 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.158717.log: /var/log/ceph/ceph-client.admin.123577.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.158717.log.gz 2023-09-30T22:36:01.021 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149275.log 2023-09-30T22:36:01.021 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.123577.log.gz 2023-09-30T22:36:01.022 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163675.log 2023-09-30T22:36:01.022 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.164432.log: /var/log/ceph/ceph-client.admin.149275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148946.log 2023-09-30T22:36:01.022 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.164432.log.gz 2023-09-30T22:36:01.022 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.149275.log.gz 2023-09-30T22:36:01.022 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.163675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154575.log 2023-09-30T22:36:01.022 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126110.log 2023-09-30T22:36:01.022 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.148946.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.163675.log.gz 2023-09-30T22:36:01.022 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.154575.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.148946.log.gz 2023-09-30T22:36:01.023 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149863.log 2023-09-30T22:36:01.023 INFO:teuthology.orchestra.run.smithi040.stderr: 95.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-09-30T22:36:01.023 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.126110.log: gzip 88.2%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.154575.log.gz-- 2023-09-30T22:36:01.023 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.130049.log 2023-09-30T22:36:01.023 INFO:teuthology.orchestra.run.smithi040.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.126110.log.gz 2023-09-30T22:36:01.023 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.149863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180207.log 2023-09-30T22:36:01.023 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.149863.log.gz 2023-09-30T22:36:01.024 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188913.log 2023-09-30T22:36:01.024 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.130049.log: /var/log/ceph/ceph-client.admin.180207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144672.log 2023-09-30T22:36:01.024 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.130049.log.gz 2023-09-30T22:36:01.024 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.180207.log.gz 2023-09-30T22:36:01.024 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.188913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187934.log 2023-09-30T22:36:01.024 INFO:teuthology.orchestra.run.smithi040.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.188913.log.gz 2023-09-30T22:36:01.024 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.144672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159130.log 2023-09-30T22:36:01.024 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.144672.log.gz 2023-09-30T22:36:01.025 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180598.log 2023-09-30T22:36:01.025 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.187934.log: /var/log/ceph/ceph-client.admin.159130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179740.log 2023-09-30T22:36:01.025 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.187934.log.gz 2023-09-30T22:36:01.025 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.180598.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.159130.log.gz 2023-09-30T22:36:01.025 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143121.log 2023-09-30T22:36:01.025 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.180598.log.gz 2023-09-30T22:36:01.025 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156535.log 2023-09-30T22:36:01.025 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.179740.log: /var/log/ceph/ceph-client.admin.143121.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.179740.log.gz 2023-09-30T22:36:01.026 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172558.log 2023-09-30T22:36:01.026 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.143121.log.gz 2023-09-30T22:36:01.026 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178364.log 2023-09-30T22:36:01.026 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.156535.log: /var/log/ceph/ceph-client.admin.172558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192493.log 2023-09-30T22:36:01.026 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.156535.log.gz 2023-09-30T22:36:01.026 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.172558.log.gz 2023-09-30T22:36:01.026 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.178364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184442.log 2023-09-30T22:36:01.027 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.178364.log.gz 2023-09-30T22:36:01.027 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168107.log 2023-09-30T22:36:01.027 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.192493.log: /var/log/ceph/ceph-client.admin.184442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150476.log 2023-09-30T22:36:01.027 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.192493.log.gz 2023-09-30T22:36:01.027 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.184442.log.gz 2023-09-30T22:36:01.027 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.168107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179400.log 2023-09-30T22:36:01.027 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.150476.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.168107.log.gz 2023-09-30T22:36:01.028 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194753.log 2023-09-30T22:36:01.028 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.150476.log.gz 2023-09-30T22:36:01.028 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.179400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170320.log 2023-09-30T22:36:01.028 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.179400.log.gz 2023-09-30T22:36:01.028 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183464.log 2023-09-30T22:36:01.028 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.194753.log: /var/log/ceph/ceph-client.admin.170320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168425.log 2023-09-30T22:36:01.028 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.194753.log.gz 2023-09-30T22:36:01.029 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.170320.log.gz 2023-09-30T22:36:01.029 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.183464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153254.log 2023-09-30T22:36:01.029 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168897.log 2023-09-30T22:36:01.029 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.183464.log.gz 2023-09-30T22:36:01.029 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.168425.log: /var/log/ceph/ceph-client.admin.153254.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.168425.log.gz 2023-09-30T22:36:01.029 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184715.log 2023-09-30T22:36:01.029 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.153254.log.gz 2023-09-30T22:36:01.029 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187542.log 2023-09-30T22:36:01.030 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.168897.log: /var/log/ceph/ceph-client.admin.184715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178245.log 2023-09-30T22:36:01.030 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.168897.log.gz 2023-09-30T22:36:01.030 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.184715.log.gz 2023-09-30T22:36:01.030 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.187542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140251.log 2023-09-30T22:36:01.030 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.187542.log.gz 2023-09-30T22:36:01.030 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.178245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145625.log 2023-09-30T22:36:01.030 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.178245.log.gz 2023-09-30T22:36:01.031 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183344.log 2023-09-30T22:36:01.031 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.140251.log: /var/log/ceph/ceph-client.admin.145625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124618.log 2023-09-30T22:36:01.031 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.140251.log.gz 2023-09-30T22:36:01.031 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.145625.log.gz 2023-09-30T22:36:01.031 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.183344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149152.log 2023-09-30T22:36:01.031 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 87.8%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.183344.log.gz/var/log/ceph/ceph-client.admin.139075.log 2023-09-30T22:36:01.031 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-09-30T22:36:01.031 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.124618.log: /var/log/ceph/ceph-client.admin.149152.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.124618.log.gz-5 2023-09-30T22:36:01.032 INFO:teuthology.orchestra.run.smithi040.stderr:--verbose -- /var/log/ceph/ceph-client.admin.163842.log 2023-09-30T22:36:01.032 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.149152.log.gz 2023-09-30T22:36:01.032 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160928.log 2023-09-30T22:36:01.032 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.139075.log: /var/log/ceph/ceph-client.admin.163842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156927.log 2023-09-30T22:36:01.032 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.139075.log.gz 2023-09-30T22:36:01.032 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.163842.log.gz 2023-09-30T22:36:01.032 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.160928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187686.log 2023-09-30T22:36:01.033 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.160928.log.gz 2023-09-30T22:36:01.033 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.156927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145869.log 2023-09-30T22:36:01.033 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.156927.log.gz 2023-09-30T22:36:01.033 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169679.log 2023-09-30T22:36:01.033 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.187686.log: /var/log/ceph/ceph-client.admin.145869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158521.log 2023-09-30T22:36:01.033 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.187686.log.gz 2023-09-30T22:36:01.033 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.145869.log.gz 2023-09-30T22:36:01.033 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.169679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170934.log 2023-09-30T22:36:01.034 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128279.log 2023-09-30T22:36:01.034 INFO:teuthology.orchestra.run.smithi040.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.169679.log.gz 2023-09-30T22:36:01.034 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.158521.log: /var/log/ceph/ceph-client.admin.170934.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.158521.log.gz 2023-09-30T22:36:01.034 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154869.log 2023-09-30T22:36:01.034 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.170934.log.gz 2023-09-30T22:36:01.034 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176252.log 2023-09-30T22:36:01.034 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.128279.log: /var/log/ceph/ceph-client.admin.154869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184638.log 2023-09-30T22:36:01.035 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.128279.log.gz 2023-09-30T22:36:01.035 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.154869.log.gz 2023-09-30T22:36:01.035 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.176252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144571.log 2023-09-30T22:36:01.035 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.184638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165046.log 2023-09-30T22:36:01.035 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.176252.log.gz 2023-09-30T22:36:01.035 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.144571.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.184638.log.gz 2023-09-30T22:36:01.035 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164824.log 2023-09-30T22:36:01.036 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.144571.log.gz 2023-09-30T22:36:01.036 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182559.log 2023-09-30T22:36:01.036 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.165046.log: /var/log/ceph/ceph-client.admin.164824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186510.log 2023-09-30T22:36:01.036 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.165046.log.gz 2023-09-30T22:36:01.036 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.182559.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.164824.log.gz 2023-09-30T22:36:01.036 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190825.log 2023-09-30T22:36:01.036 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.182559.log.gz 2023-09-30T22:36:01.036 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.186510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125402.log 2023-09-30T22:36:01.037 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.186510.log.gz 2023-09-30T22:36:01.037 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189675.log 2023-09-30T22:36:01.037 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.190825.log: /var/log/ceph/ceph-client.admin.125402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190094.log 2023-09-30T22:36:01.037 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.190825.log.gz 2023-09-30T22:36:01.037 INFO:teuthology.orchestra.run.smithi040.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.125402.log.gz 2023-09-30T22:36:01.037 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.189675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167621.log 2023-09-30T22:36:01.037 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152715.log 2023-09-30T22:36:01.038 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.189675.log.gz 2023-09-30T22:36:01.038 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.190094.log: /var/log/ceph/ceph-client.admin.167621.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.190094.log.gz 2023-09-30T22:36:01.038 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186975.log 2023-09-30T22:36:01.038 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.167621.log.gz 2023-09-30T22:36:01.038 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.152715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152471.log 2023-09-30T22:36:01.038 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.186975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155633.log 2023-09-30T22:36:01.038 INFO:teuthology.orchestra.run.smithi040.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.152715.log.gz 2023-09-30T22:36:01.038 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2%/var/log/ceph/ceph-client.admin.152471.log: -- replaced with /var/log/ceph/ceph-client.admin.186975.log.gz 2023-09-30T22:36:01.039 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178560.log 2023-09-30T22:36:01.039 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.152471.log.gz 2023-09-30T22:36:01.039 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.155633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151117.log 2023-09-30T22:36:01.039 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.155633.log.gz 2023-09-30T22:36:01.039 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183660.log 2023-09-30T22:36:01.039 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.178560.log: /var/log/ceph/ceph-client.admin.151117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171399.log 2023-09-30T22:36:01.039 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.178560.log.gz 2023-09-30T22:36:01.040 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.151117.log.gz 2023-09-30T22:36:01.040 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.183660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159475.log 2023-09-30T22:36:01.040 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162692.log 2023-09-30T22:36:01.040 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.183660.log.gz 2023-09-30T22:36:01.040 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.171399.log: /var/log/ceph/ceph-client.admin.159475.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.171399.log.gz 2023-09-30T22:36:01.040 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150673.log 2023-09-30T22:36:01.040 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.159475.log.gz 2023-09-30T22:36:01.040 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176665.log 2023-09-30T22:36:01.041 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.162692.log: /var/log/ceph/ceph-client.admin.150673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161490.log 2023-09-30T22:36:01.041 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.162692.log.gz 2023-09-30T22:36:01.041 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.176665.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.150673.log.gz 2023-09-30T22:36:01.041 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128048.log 2023-09-30T22:36:01.041 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.176665.log.gz 2023-09-30T22:36:01.041 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.161490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191047.log 2023-09-30T22:36:01.041 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.161490.log.gz 2023-09-30T22:36:01.041 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.128048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135745.log 2023-09-30T22:36:01.042 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.128048.log.gz 2023-09-30T22:36:01.042 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.191047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145279.log 2023-09-30T22:36:01.042 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.135745.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.191047.log.gz 2023-09-30T22:36:01.042 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129022.log 2023-09-30T22:36:01.042 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.135745.log.gz 2023-09-30T22:36:01.042 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177853.log 2023-09-30T22:36:01.042 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.145279.log: /var/log/ceph/ceph-client.admin.129022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125010.log 2023-09-30T22:36:01.043 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.145279.log.gz 2023-09-30T22:36:01.043 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.129022.log.gz 2023-09-30T22:36:01.043 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.177853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171968.log 2023-09-30T22:36:01.043 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130236.log 2023-09-30T22:36:01.043 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.177853.log.gz 2023-09-30T22:36:01.043 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.125010.log: /var/log/ceph/ceph-client.admin.171968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144887.log 87.2% 2023-09-30T22:36:01.043 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.125010.log.gz 2023-09-30T22:36:01.044 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.171968.log.gz 2023-09-30T22:36:01.044 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174880.log 2023-09-30T22:36:01.044 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.130236.log: /var/log/ceph/ceph-client.admin.144887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190877.log 2023-09-30T22:36:01.044 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.130236.log.gz 2023-09-30T22:36:01.044 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0%/var/log/ceph/ceph-client.admin.174880.log: -- replaced with /var/log/ceph/ceph-client.admin.144887.log.gz 2023-09-30T22:36:01.044 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128351.log 2023-09-30T22:36:01.044 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.174880.log.gz 2023-09-30T22:36:01.044 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.190877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194557.log 2023-09-30T22:36:01.045 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.190877.log.gz 2023-09-30T22:36:01.045 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.128351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162104.log 2023-09-30T22:36:01.045 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.128351.log.gz 2023-09-30T22:36:01.045 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.194557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189310.log 2023-09-30T22:36:01.045 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.194557.log.gz 2023-09-30T22:36:01.045 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141351.log 2023-09-30T22:36:01.045 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.162104.log: /var/log/ceph/ceph-client.admin.189310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172379.log 2023-09-30T22:36:01.045 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.162104.log.gz 2023-09-30T22:36:01.046 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.189310.log.gz 2023-09-30T22:36:01.046 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.141351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183072.log 2023-09-30T22:36:01.046 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141351.log.gz 2023-09-30T22:36:01.046 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.172379.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-09-30T22:36:01.046 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.172379.log.gz 2023-09-30T22:36:01.046 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.183072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176992.log 2023-09-30T22:36:01.046 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.183072.log.gz 2023-09-30T22:36:01.046 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129878.log 2023-09-30T22:36:01.047 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.176992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170124.log 2023-09-30T22:36:01.047 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.176992.log.gz 2023-09-30T22:36:01.047 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.129878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128853.log 2023-09-30T22:36:01.047 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.129878.log.gz 2023-09-30T22:36:01.047 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.170124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144375.log 2023-09-30T22:36:01.047 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119137.log 2023-09-30T22:36:01.047 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.128853.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.170124.log.gz 2023-09-30T22:36:01.047 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.144375.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.128853.log.gz 2023-09-30T22:36:01.048 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.144375.log.gz 2023-09-30T22:36:01.048 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.119137.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.119137.log.gz 2023-09-30T22:36:01.048 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191021.log 2023-09-30T22:36:01.048 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182951.log 2023-09-30T22:36:01.048 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.191021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192276.log 2023-09-30T22:36:01.048 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.182951.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.191021.log.gz 2023-09-30T22:36:01.048 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174632.log 2023-09-30T22:36:01.048 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.182951.log.gz 2023-09-30T22:36:01.049 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.192276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177266.log 2023-09-30T22:36:01.049 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161294.log 2023-09-30T22:36:01.049 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.174632.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.192276.log.gz 2023-09-30T22:36:01.049 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.177266.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.174632.log.gz 2023-09-30T22:36:01.049 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149766.log 2023-09-30T22:36:01.049 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.177266.log.gz 2023-09-30T22:36:01.049 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167323.log 2023-09-30T22:36:01.049 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.161294.log: /var/log/ceph/ceph-client.admin.149766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148322.log 2023-09-30T22:36:01.050 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.161294.log.gz 2023-09-30T22:36:01.050 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.167323.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.149766.log.gz 2023-09-30T22:36:01.050 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126355.log 2023-09-30T22:36:01.050 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.167323.log.gz 2023-09-30T22:36:01.050 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.148322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141866.log 2023-09-30T22:36:01.050 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165634.log 2023-09-30T22:36:01.050 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.126355.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.148322.log.gz 2023-09-30T22:36:01.050 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.141866.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.126355.log.gz 2023-09-30T22:36:01.051 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148982.log 2023-09-30T22:36:01.051 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.141866.log.gz 2023-09-30T22:36:01.051 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195026.log 2023-09-30T22:36:01.051 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.165634.log: /var/log/ceph/ceph-client.admin.148982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178194.log 2023-09-30T22:36:01.051 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.165634.log.gz 2023-09-30T22:36:01.051 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.195026.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.148982.log.gz 2023-09-30T22:36:01.051 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125157.log 2023-09-30T22:36:01.051 INFO:teuthology.orchestra.run.smithi040.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.195026.log.gz 2023-09-30T22:36:01.052 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.178194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181357.log 2023-09-30T22:36:01.052 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194242.log 2023-09-30T22:36:01.052 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.178194.log.gz 2023-09-30T22:36:01.052 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.125157.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.125157.log.gz 2023-09-30T22:36:01.052 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.181357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141547.log 2023-09-30T22:36:01.052 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193373.log 2023-09-30T22:36:01.052 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.194242.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.181357.log.gz 2023-09-30T22:36:01.052 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.141547.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.194242.log.gz 2023-09-30T22:36:01.053 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.141547.log.gz 2023-09-30T22:36:01.053 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.193373.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.193373.log.gz 2023-09-30T22:36:01.053 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193177.log 2023-09-30T22:36:01.053 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147950.log 2023-09-30T22:36:01.053 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.193177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172280.log 2023-09-30T22:36:01.053 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.147950.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.193177.log.gz 2023-09-30T22:36:01.053 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153451.log 2023-09-30T22:36:01.053 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.147950.log.gz 2023-09-30T22:36:01.054 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.172280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156365.log 2023-09-30T22:36:01.054 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190629.log 2023-09-30T22:36:01.054 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.172280.log.gz 2023-09-30T22:36:01.054 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.153451.log: /var/log/ceph/ceph-client.admin.156365.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.153451.log.gz 2023-09-30T22:36:01.054 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126502.log 2023-09-30T22:36:01.054 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.156365.log.gz 2023-09-30T22:36:01.054 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.190629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147611.log 2023-09-30T22:36:01.054 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.126502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155437.log 2023-09-30T22:36:01.055 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.190629.log.gz 2023-09-30T22:36:01.055 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.147611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166837.log 2023-09-30T22:36:01.055 INFO:teuthology.orchestra.run.smithi040.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.126502.log.gz 2023-09-30T22:36:01.055 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.155437.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.147611.log.gz 2023-09-30T22:36:01.055 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.155437.log.gz 2023-09-30T22:36:01.055 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.166837.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.166837.log.gz 2023-09-30T22:36:01.055 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138767.log 2023-09-30T22:36:01.055 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148001.log 2023-09-30T22:36:01.056 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.138767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139195.log 2023-09-30T22:36:01.056 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.148001.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.138767.log.gz 2023-09-30T22:36:01.056 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177801.log 2023-09-30T22:36:01.056 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.148001.log.gz 2023-09-30T22:36:01.056 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.139195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154456.log 2023-09-30T22:36:01.056 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177069.log 2023-09-30T22:36:01.056 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.177801.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.139195.log.gz 2023-09-30T22:36:01.056 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.177801.log.gz 2023-09-30T22:36:01.057 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.154456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170812.log 2023-09-30T22:36:01.057 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.177069.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.154456.log.gz 2023-09-30T22:36:01.057 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170571.log 2023-09-30T22:36:01.057 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.170812.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.177069.log.gz 2023-09-30T22:36:01.057 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163450.log 2023-09-30T22:36:01.057 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.170812.log.gz 2023-09-30T22:36:01.057 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.170571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159083.log 2023-09-30T22:36:01.057 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.163450.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-09-30T22:36:01.058 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.170571.log.gz 2023-09-30T22:36:01.058 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.163450.log.gz 2023-09-30T22:36:01.058 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.159083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154183.log 2023-09-30T22:36:01.058 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151457.log 2023-09-30T22:36:01.058 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.0.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.159083.log.gz 2023-09-30T22:36:01.058 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.154183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169732.log 2023-09-30T22:36:01.059 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.151457.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.154183.log.gz 2023-09-30T22:36:01.059 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.151457.log.gz 2023-09-30T22:36:01.059 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.169732.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.169732.log.gz 2023-09-30T22:36:01.059 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167911.log 2023-09-30T22:36:01.059 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182791.log 2023-09-30T22:36:01.059 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.167911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142703.log 2023-09-30T22:36:01.059 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.167911.log.gz/var/log/ceph/ceph-client.admin.182791.log: 2023-09-30T22:36:01.059 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146727.log 2023-09-30T22:36:01.060 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.142703.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.182791.log.gz 2023-09-30T22:36:01.060 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152419.log 2023-09-30T22:36:01.060 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.142703.log.gz 2023-09-30T22:36:01.060 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.146727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162151.log 2023-09-30T22:36:01.060 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.146727.log.gz 2023-09-30T22:36:01.060 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.152419.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.152419.log.gz 2023-09-30T22:36:01.060 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.162151.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.162151.log.gz 2023-09-30T22:36:01.060 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129437.log 2023-09-30T22:36:01.061 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152079.log 2023-09-30T22:36:01.061 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.129437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167790.log 2023-09-30T22:36:01.061 INFO:teuthology.orchestra.run.smithi040.stderr: 87.4%/var/log/ceph/ceph-client.admin.152079.log: -- replaced with /var/log/ceph/ceph-client.admin.129437.log.gz 2023-09-30T22:36:01.061 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.152079.log.gz 2023-09-30T22:36:01.061 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.167790.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.167790.log.gz 2023-09-30T22:36:01.061 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157319.log 2023-09-30T22:36:01.061 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127889.log 2023-09-30T22:36:01.062 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.157319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136213.log 2023-09-30T22:36:01.062 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.157319.log.gz 2023-09-30T22:36:01.062 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.127889.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.127889.log.gz 2023-09-30T22:36:01.062 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.136213.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.136213.log.gz 2023-09-30T22:36:01.062 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128022.log 2023-09-30T22:36:01.062 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194047.log 2023-09-30T22:36:01.062 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.128022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126208.log 2023-09-30T22:36:01.062 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.128022.log.gz 2023-09-30T22:36:01.063 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.194047.log: /var/log/ceph/ceph-client.admin.126208.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.194047.log.gz 2023-09-30T22:36:01.063 INFO:teuthology.orchestra.run.smithi040.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.126208.log.gz 2023-09-30T22:36:01.063 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177972.log 2023-09-30T22:36:01.063 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160855.log 2023-09-30T22:36:01.063 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.177972.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.177972.log.gz 2023-09-30T22:36:01.063 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.160855.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.160855.log.gz 2023-09-30T22:36:01.063 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175638.log 2023-09-30T22:36:01.063 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173848.log 2023-09-30T22:36:01.064 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.175638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195027.log 2023-09-30T22:36:01.064 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.175638.log.gz 2023-09-30T22:36:01.064 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.173848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190263.log 2023-09-30T22:36:01.064 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.195027.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.173848.log.gz 2023-09-30T22:36:01.064 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129059.log 2023-09-30T22:36:01.064 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.195027.log.gz 2023-09-30T22:36:01.064 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165661.log 2023-09-30T22:36:01.064 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.190263.log: /var/log/ceph/ceph-client.admin.129059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188590.log 2023-09-30T22:36:01.065 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.190263.log.gz 2023-09-30T22:36:01.065 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.129059.log.gz 2023-09-30T22:36:01.065 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.165661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162666.log 2023-09-30T22:36:01.065 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.165661.log.gz 2023-09-30T22:36:01.065 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.188590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165167.log 2023-09-30T22:36:01.065 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.162666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161152.log 87.8% 2023-09-30T22:36:01.065 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.188590.log.gz 2023-09-30T22:36:01.065 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.162666.log.gz 2023-09-30T22:36:01.066 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.165167.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.165167.log.gz 2023-09-30T22:36:01.066 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.161152.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.161152.log.gz 2023-09-30T22:36:01.066 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144618.log 2023-09-30T22:36:01.066 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146259.log 2023-09-30T22:36:01.066 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.144618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139514.log 2023-09-30T22:36:01.066 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.146259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185107.log 2023-09-30T22:36:01.066 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.144618.log.gz 2023-09-30T22:36:01.067 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.146259.log.gz 2023-09-30T22:36:01.067 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.139514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163403.log 2023-09-30T22:36:01.067 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167594.log 2023-09-30T22:36:01.067 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.185107.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.139514.log.gz 2023-09-30T22:36:01.067 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.163403.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.185107.log.gz 2023-09-30T22:36:01.067 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155802.log 2023-09-30T22:36:01.067 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.163403.log.gz 2023-09-30T22:36:01.067 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.167594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185329.log 2023-09-30T22:36:01.068 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.167594.log.gz 2023-09-30T22:36:01.068 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.155802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191465.log 2023-09-30T22:36:01.068 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192981.log 2023-09-30T22:36:01.068 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.155802.log.gz 2023-09-30T22:36:01.068 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.185329.log: /var/log/ceph/ceph-client.admin.191465.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.185329.log.gz 2023-09-30T22:36:01.068 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151909.log 2023-09-30T22:36:01.068 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.191465.log.gz 2023-09-30T22:36:01.068 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.192981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153399.log 2023-09-30T22:36:01.069 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.192981.log.gz 2023-09-30T22:36:01.159 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.151909.log: /var/log/ceph/ceph-client.admin.153399.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.151909.log.gz 2023-09-30T22:36:01.160 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.153399.log.gz 2023-09-30T22:36:01.160 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123428.log 2023-09-30T22:36:01.160 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155410.log 2023-09-30T22:36:01.160 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.123428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139346.log 2023-09-30T22:36:01.160 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.155410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155163.log 87.4% 2023-09-30T22:36:01.160 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.123428.log.gz 2023-09-30T22:36:01.160 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.155410.log.gz 2023-09-30T22:36:01.161 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.139346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184832.log 2023-09-30T22:36:01.161 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154064.log 2023-09-30T22:36:01.161 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.155163.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.139346.log.gz 2023-09-30T22:36:01.161 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.184832.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.155163.log.gz 2023-09-30T22:36:01.161 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165951.log 2023-09-30T22:36:01.161 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.154064.log: 89.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.184832.log.gz-5 2023-09-30T22:36:01.161 INFO:teuthology.orchestra.run.smithi040.stderr:--verbose -- /var/log/ceph/ceph-client.admin.180524.log 2023-09-30T22:36:01.162 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.154064.log.gz 2023-09-30T22:36:01.162 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.165951.log: /var/log/ceph/ceph-client.admin.180524.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.165951.log.gz 2023-09-30T22:36:01.162 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.180524.log.gz 2023-09-30T22:36:01.162 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154457.log 2023-09-30T22:36:01.162 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181017.log 2023-09-30T22:36:01.162 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.154457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137194.log 2023-09-30T22:36:01.162 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.154457.log.gz 2023-09-30T22:36:01.162 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.181017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182018.log 2023-09-30T22:36:01.163 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.137194.log: gzip 89.2%-5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.181017.log.gz/var/log/ceph/ceph-client.admin.156143.log 2023-09-30T22:36:01.163 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-09-30T22:36:01.163 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.182018.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.137194.log.gz 2023-09-30T22:36:01.163 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172084.log 2023-09-30T22:36:01.163 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.182018.log.gz 2023-09-30T22:36:01.163 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.156143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151908.log 2023-09-30T22:36:01.163 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189283.log 2023-09-30T22:36:01.164 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.172084.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.156143.log.gz 2023-09-30T22:36:01.164 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.151908.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.172084.log.gz 2023-09-30T22:36:01.164 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148199.log 2023-09-30T22:36:01.164 INFO:teuthology.orchestra.run.smithi040.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.151908.log.gz 2023-09-30T22:36:01.164 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.189283.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.189283.log.gz 2023-09-30T22:36:01.164 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.148199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159378.log 2023-09-30T22:36:01.164 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.148199.log.gz 2023-09-30T22:36:01.164 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166147.log 2023-09-30T22:36:01.165 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.159378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153203.log 2023-09-30T22:36:01.165 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.159378.log.gz 2023-09-30T22:36:01.165 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.166147.log: /var/log/ceph/ceph-client.admin.153203.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.166147.log.gz 2023-09-30T22:36:01.165 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.153203.log.gz 2023-09-30T22:36:01.165 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137801.log 2023-09-30T22:36:01.165 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192445.log 2023-09-30T22:36:01.165 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.137801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194634.log 2023-09-30T22:36:01.165 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.192445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186314.log 2023-09-30T22:36:01.166 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.137801.log.gz 2023-09-30T22:36:01.166 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.192445.log.gz 2023-09-30T22:36:01.166 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.194634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165804.log 2023-09-30T22:36:01.166 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.194634.log.gz 2023-09-30T22:36:01.166 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185481.log 2023-09-30T22:36:01.166 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.186314.log: /var/log/ceph/ceph-client.admin.165804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148687.log 2023-09-30T22:36:01.166 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.186314.log.gz 2023-09-30T22:36:01.166 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.165804.log.gz 2023-09-30T22:36:01.167 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.185481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181604.log 2023-09-30T22:36:01.167 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.148687.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.185481.log.gz 2023-09-30T22:36:01.167 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171595.log 2023-09-30T22:36:01.167 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.148687.log.gz 2023-09-30T22:36:01.167 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.181604.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.181604.log.gz 2023-09-30T22:36:01.167 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.171595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180206.log 2023-09-30T22:36:01.167 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.171595.log.gz 2023-09-30T22:36:01.167 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163525.log 2023-09-30T22:36:01.168 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.180206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163207.log 2023-09-30T22:36:01.168 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.180206.log.gz 2023-09-30T22:36:01.168 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.163525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157933.log 2023-09-30T22:36:01.168 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.163207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175024.log 2023-09-30T22:36:01.168 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.163525.log.gz 2023-09-30T22:36:01.168 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.157933.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.163207.log.gz 2023-09-30T22:36:01.168 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181409.log 2023-09-30T22:36:01.168 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.175024.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.157933.log.gz 2023-09-30T22:36:01.169 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.175024.log.gz 2023-09-30T22:36:01.169 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.181409.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.181409.log.gz 2023-09-30T22:36:01.169 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143834.log 2023-09-30T22:36:01.169 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160387.log 2023-09-30T22:36:01.169 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.143834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160706.log 2023-09-30T22:36:01.169 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.143834.log.gz 2023-09-30T22:36:01.169 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.160387.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.160387.log.gz 2023-09-30T22:36:01.170 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.160706.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.160706.log.gz 2023-09-30T22:36:01.170 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144767.log 2023-09-30T22:36:01.170 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135842.log 2023-09-30T22:36:01.170 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.144767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182288.log 2023-09-30T22:36:01.170 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.135842.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.144767.log.gz 2023-09-30T22:36:01.170 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.135842.log.gz 2023-09-30T22:36:01.170 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.182288.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.182288.log.gz 2023-09-30T22:36:01.170 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149889.log 2023-09-30T22:36:01.171 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150477.log 2023-09-30T22:36:01.171 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.149889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141109.log 2023-09-30T22:36:01.171 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.149889.log.gz 2023-09-30T22:36:01.171 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.150477.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.150477.log.gz 2023-09-30T22:36:01.171 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.141109.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.141109.log.gz 2023-09-30T22:36:01.171 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164458.log 2023-09-30T22:36:01.171 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150085.log 2023-09-30T22:36:01.171 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.164458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138926.log 2023-09-30T22:36:01.172 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.150085.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.164458.log.gz 2023-09-30T22:36:01.172 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.150085.log.gz 2023-09-30T22:36:01.172 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.138926.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.138926.log.gz 2023-09-30T22:36:01.172 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145671.log 2023-09-30T22:36:01.172 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179152.log 2023-09-30T22:36:01.172 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.145671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158103.log 2023-09-30T22:36:01.172 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.145671.log.gz 2023-09-30T22:36:01.172 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.179152.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.179152.log.gz 2023-09-30T22:36:01.173 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.158103.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.158103.log.gz 2023-09-30T22:36:01.173 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175290.log 2023-09-30T22:36:01.173 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168352.log 2023-09-30T22:36:01.173 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.175290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161443.log 2023-09-30T22:36:01.173 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.175290.log.gz/var/log/ceph/ceph-client.admin.168352.log: 2023-09-30T22:36:01.173 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.168352.log.gz 2023-09-30T22:36:01.173 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.161443.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.161443.log.gz 2023-09-30T22:36:01.173 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168182.log 2023-09-30T22:36:01.174 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180429.log 2023-09-30T22:36:01.174 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.168182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169483.log 2023-09-30T22:36:01.174 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.168182.log.gz 2023-09-30T22:36:01.174 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.180429.log: /var/log/ceph/ceph-client.admin.169483.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.180429.log.gz 2023-09-30T22:36:01.174 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.169483.log.gz 2023-09-30T22:36:01.174 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188326.log 2023-09-30T22:36:01.174 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185081.log 2023-09-30T22:36:01.175 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.188326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150255.log 2023-09-30T22:36:01.175 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.188326.log.gz 2023-09-30T22:36:01.175 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.185081.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.185081.log.gz 2023-09-30T22:36:01.175 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.150255.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.150255.log.gz 2023-09-30T22:36:01.175 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169217.log 2023-09-30T22:36:01.175 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192785.log 2023-09-30T22:36:01.175 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.169217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191883.log 2023-09-30T22:36:01.176 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.169217.log.gz 2023-09-30T22:36:01.176 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.192785.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.192785.log.gz 2023-09-30T22:36:01.176 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.191883.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.191883.log.gz 2023-09-30T22:36:01.176 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136410.log 2023-09-30T22:36:01.176 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176396.log 2023-09-30T22:36:01.176 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.136410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168585.log 2023-09-30T22:36:01.176 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.136410.log.gz 2023-09-30T22:36:01.176 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.176396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168752.log 2023-09-30T22:36:01.177 INFO:teuthology.orchestra.run.smithi040.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.176396.log.gz 2023-09-30T22:36:01.177 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.168585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178050.log 2023-09-30T22:36:01.177 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.168752.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.168585.log.gz 2023-09-30T22:36:01.177 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172183.log 2023-09-30T22:36:01.177 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.168752.log.gz 2023-09-30T22:36:01.177 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.178050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142062.log 2023-09-30T22:36:01.177 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.172183.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.178050.log.gz 2023-09-30T22:36:01.177 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189505.log 2023-09-30T22:36:01.178 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.172183.log.gz 2023-09-30T22:36:01.178 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.142062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154405.log 2023-09-30T22:36:01.178 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.189505.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.142062.log.gz 2023-09-30T22:36:01.178 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173286.log 2023-09-30T22:36:01.178 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.154405.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.189505.log.gz 2023-09-30T22:36:01.178 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.154405.log.gz 2023-09-30T22:36:01.178 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.173286.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.173286.log.gz 2023-09-30T22:36:01.178 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149720.log 2023-09-30T22:36:01.179 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165830.log 2023-09-30T22:36:01.179 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.149720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173556.log 2023-09-30T22:36:01.179 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.149720.log.gz 2023-09-30T22:36:01.179 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.165830.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.165830.log.gz 2023-09-30T22:36:01.179 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.173556.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.173556.log.gz 2023-09-30T22:36:01.179 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186928.log 2023-09-30T22:36:01.179 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170001.log 2023-09-30T22:36:01.179 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.186928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183782.log 2023-09-30T22:36:01.180 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.170001.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.186928.log.gz 2023-09-30T22:36:01.180 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.170001.log.gz 2023-09-30T22:36:01.180 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.183782.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.183782.log.gz 2023-09-30T22:36:01.180 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157221.log 2023-09-30T22:36:01.180 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157123.log 2023-09-30T22:36:01.180 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.157221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144226.log 2023-09-30T22:36:01.180 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3%/var/log/ceph/ceph-client.admin.157123.log: -- replaced with /var/log/ceph/ceph-client.admin.157221.log.gz 2023-09-30T22:36:01.180 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.157123.log.gz 2023-09-30T22:36:01.181 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.144226.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.144226.log.gz 2023-09-30T22:36:01.181 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193969.log 2023-09-30T22:36:01.181 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148956.log 2023-09-30T22:36:01.181 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.193969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155216.log 2023-09-30T22:36:01.181 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.193969.log.gz 2023-09-30T22:36:01.181 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.148956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125745.log 2023-09-30T22:36:01.181 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.148956.log.gz 2023-09-30T22:36:01.181 INFO:teuthology.orchestra.run.smithi040.stderr:gzip /var/log/ceph/ceph-client.admin.155216.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.186853.log 2023-09-30T22:36:01.182 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.125745.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.155216.log.gz 2023-09-30T22:36:01.182 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6%/var/log/ceph/ceph-client.admin.186853.log: -- replaced with /var/log/ceph/ceph-client.admin.125745.log.gz 2023-09-30T22:36:01.182 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.186853.log.gz 2023-09-30T22:36:01.182 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171007.log 2023-09-30T22:36:01.182 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187633.log 2023-09-30T22:36:01.182 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.171007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177070.log 2023-09-30T22:36:01.182 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.171007.log.gz 2023-09-30T22:36:01.182 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.187633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165077.log 2023-09-30T22:36:01.183 INFO:teuthology.orchestra.run.smithi040.stderr:gzip /var/log/ceph/ceph-client.admin.177070.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.185507.log 2023-09-30T22:36:01.183 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.187633.log.gz 2023-09-30T22:36:01.183 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.165077.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.177070.log.gz 2023-09-30T22:36:01.183 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191073.log 2023-09-30T22:36:01.183 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.185507.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.165077.log.gzgzip 2023-09-30T22:36:01.183 INFO:teuthology.orchestra.run.smithi040.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.183586.log 2023-09-30T22:36:01.183 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.185507.log.gz 2023-09-30T22:36:01.183 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.191073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159570.log 2023-09-30T22:36:01.184 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.191073.log.gz--verbose 2023-09-30T22:36:01.184 INFO:teuthology.orchestra.run.smithi040.stderr:-- /var/log/ceph/ceph-client.admin.183709.log 2023-09-30T22:36:01.184 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.183586.log: /var/log/ceph/ceph-client.admin.159570.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.183586.log.gz 2023-09-30T22:36:01.184 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.183709.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.159570.log.gz 2023-09-30T22:36:01.184 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.183709.log.gz 2023-09-30T22:36:01.184 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162227.log 2023-09-30T22:36:01.184 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168703.log 2023-09-30T22:36:01.185 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.162227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162470.log 2023-09-30T22:36:01.185 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.162227.log.gz 2023-09-30T22:36:01.185 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.168703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182755.log 2023-09-30T22:36:01.185 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.168703.log.gz 2023-09-30T22:36:01.185 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.162470.log: /var/log/ceph/ceph-client.admin.182755.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.162470.log.gz 2023-09-30T22:36:01.185 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.182755.log.gz 2023-09-30T22:36:01.185 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119549.log 2023-09-30T22:36:01.185 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191512.log 2023-09-30T22:36:01.186 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.119549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187347.log 2023-09-30T22:36:01.186 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.191512.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.119549.log.gz 2023-09-30T22:36:01.186 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152445.log 2023-09-30T22:36:01.186 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.191512.log.gz 2023-09-30T22:36:01.186 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.187347.log: /var/log/ceph/ceph-client.admin.152445.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.187347.log.gz 2023-09-30T22:36:01.186 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.152445.log.gz 2023-09-30T22:36:01.186 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158006.log 2023-09-30T22:36:01.186 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155973.log 2023-09-30T22:36:01.187 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.158006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126404.log 2023-09-30T22:36:01.187 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.158006.log.gz 2023-09-30T22:36:01.187 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.155973.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.155973.log.gz 2023-09-30T22:36:01.187 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.126404.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.126404.log.gz 2023-09-30T22:36:01.187 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169289.log 2023-09-30T22:36:01.187 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180965.log 2023-09-30T22:36:01.187 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.169289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126012.log 2023-09-30T22:36:01.187 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.180965.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.169289.log.gz 2023-09-30T22:36:01.188 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.126012.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.180965.log.gz 2023-09-30T22:36:01.188 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.126012.log.gz 2023-09-30T22:36:01.188 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143860.log 2023-09-30T22:36:01.188 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178445.log 2023-09-30T22:36:01.188 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.143860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185974.log 2023-09-30T22:36:01.188 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.143860.log.gz 2023-09-30T22:36:01.188 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.178445.log: /var/log/ceph/ceph-client.admin.185974.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.178445.log.gz 2023-09-30T22:36:01.189 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.185974.log.gz 2023-09-30T22:36:01.189 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146017.log 2023-09-30T22:36:01.189 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181896.log 2023-09-30T22:36:01.189 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.146017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185873.log 2023-09-30T22:36:01.189 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.146017.log.gz 2023-09-30T22:36:01.189 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.181896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165271.log 2023-09-30T22:36:01.189 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.181896.log.gz 2023-09-30T22:36:01.189 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.185873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149962.log 2023-09-30T22:36:01.190 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136357.log 2023-09-30T22:36:01.190 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.165271.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.185873.log.gz 2023-09-30T22:36:01.190 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.149962.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.165271.log.gz 2023-09-30T22:36:01.190 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.136357.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.149962.log.gz 2023-09-30T22:36:01.190 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.136357.log.gz 2023-09-30T22:36:01.190 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140371.log 2023-09-30T22:36:01.190 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190336.log 2023-09-30T22:36:01.190 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.140371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127892.log 2023-09-30T22:36:01.191 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.140371.log.gz 2023-09-30T22:36:01.191 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.190336.log: /var/log/ceph/ceph-client.admin.127892.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.190336.log.gz 2023-09-30T22:36:01.191 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.127892.log.gz 2023-09-30T22:36:01.191 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152837.log 2023-09-30T22:36:01.191 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123183.log 2023-09-30T22:36:01.191 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.152837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185973.log 2023-09-30T22:36:01.191 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.123183.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.152837.log.gz 2023-09-30T22:36:01.191 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.123183.log.gz 2023-09-30T22:36:01.192 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.185973.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.185973.log.gz 2023-09-30T22:36:01.192 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181161.log 2023-09-30T22:36:01.192 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167764.log 2023-09-30T22:36:01.192 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.181161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138587.log 2023-09-30T22:36:01.192 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.167764.log: gzip -5 --verbose -- 88.1%/var/log/ceph/ceph-client.admin.194191.log 2023-09-30T22:36:01.192 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.181161.log.gz 2023-09-30T22:36:01.192 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.167764.log.gz 2023-09-30T22:36:01.192 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.138587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157615.log 2023-09-30T22:36:01.193 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138142.log 2023-09-30T22:36:01.193 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.194191.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.138587.log.gz 2023-09-30T22:36:01.193 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.157615.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.194191.log.gz 2023-09-30T22:36:01.193 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.157615.log.gz 2023-09-30T22:36:01.193 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.138142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171780.log 2023-09-30T22:36:01.193 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.138142.log.gz 2023-09-30T22:36:01.193 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138804.log 2023-09-30T22:36:01.193 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178051.log 2023-09-30T22:36:01.194 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.171780.log: /var/log/ceph/ceph-client.admin.138804.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.171780.log.gz 2023-09-30T22:36:01.194 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.178051.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.138804.log.gz 2023-09-30T22:36:01.194 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.178051.log.gz 2023-09-30T22:36:01.194 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139737.log 2023-09-30T22:36:01.194 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183905.log 2023-09-30T22:36:01.194 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.139737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185222.log 2023-09-30T22:36:01.194 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.139737.log.gz 2023-09-30T22:36:01.194 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.183905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177580.log 2023-09-30T22:36:01.195 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192079.log 2023-09-30T22:36:01.195 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.185222.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.183905.log.gz 2023-09-30T22:36:01.195 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.177580.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.185222.log.gz 2023-09-30T22:36:01.195 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149524.log 2023-09-30T22:36:01.195 INFO:teuthology.orchestra.run.smithi040.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.177580.log.gz 2023-09-30T22:36:01.195 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.192079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155066.log 2023-09-30T22:36:01.195 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.192079.log.gz 2023-09-30T22:36:01.196 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.149524.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.149524.log.gz 2023-09-30T22:36:01.196 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.155066.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.155066.log.gz 2023-09-30T22:36:01.196 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142117.log 2023-09-30T22:36:01.196 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187171.log 2023-09-30T22:36:01.196 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.142117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181971.log 2023-09-30T22:36:01.196 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.187171.log: gzip 87.6%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.142117.log.gz-- 2023-09-30T22:36:01.196 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.152519.log 2023-09-30T22:36:01.196 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.187171.log.gz 2023-09-30T22:36:01.197 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.181971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171692.log 2023-09-30T22:36:01.197 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148564.log 2023-09-30T22:36:01.197 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.152519.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.181971.log.gz 2023-09-30T22:36:01.197 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.171692.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.152519.log.gz 2023-09-30T22:36:01.197 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129192.log 2023-09-30T22:36:01.197 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.171692.log.gz 2023-09-30T22:36:01.197 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.148564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146651.log 2023-09-30T22:36:01.197 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.148564.log.gz 2023-09-30T22:36:01.198 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.129192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170908.log 2023-09-30T22:36:01.198 INFO:teuthology.orchestra.run.smithi040.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.129192.log.gz 2023-09-30T22:36:01.198 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.146651.log: /var/log/ceph/ceph-client.admin.170908.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.146651.log.gz 2023-09-30T22:36:01.198 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.170908.log.gz 2023-09-30T22:36:01.198 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182596.log 2023-09-30T22:36:01.198 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165608.log 2023-09-30T22:36:01.198 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.182596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146800.log 2023-09-30T22:36:01.198 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.182596.log.gz 2023-09-30T22:36:01.199 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.165608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182533.log 2023-09-30T22:36:01.199 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124497.log 2023-09-30T22:36:01.199 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.146800.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.165608.log.gz 2023-09-30T22:36:01.199 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.182533.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.146800.log.gz 2023-09-30T22:36:01.199 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149667.log 2023-09-30T22:36:01.199 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.182533.log.gz/var/log/ceph/ceph-client.admin.124497.log: 2023-09-30T22:36:01.199 INFO:teuthology.orchestra.run.smithi040.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.124497.log.gz 2023-09-30T22:36:01.199 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.149667.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.149667.log.gz 2023-09-30T22:36:01.200 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173314.log 2023-09-30T22:36:01.200 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141082.log 2023-09-30T22:36:01.200 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.173314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168974.log 2023-09-30T22:36:01.200 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.173314.log.gz/var/log/ceph/ceph-client.admin.141082.log: 2023-09-30T22:36:01.200 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.141082.log.gz 2023-09-30T22:36:01.200 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.168974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186170.log 2023-09-30T22:36:01.200 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.168974.log.gz 2023-09-30T22:36:01.200 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139979.log 2023-09-30T22:36:01.201 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.186170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129535.log 2023-09-30T22:36:01.201 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.186170.log.gz 2023-09-30T22:36:01.201 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.139979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191609.log 2023-09-30T22:36:01.201 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119185.log /var/log/ceph/ceph-client.admin.129535.log: 2023-09-30T22:36:01.201 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139979.log.gz 2023-09-30T22:36:01.201 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.191609.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.129535.log.gz 2023-09-30T22:36:01.201 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156731.log 2023-09-30T22:36:01.201 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.191609.log.gz 2023-09-30T22:36:01.202 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.119185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170346.log 2023-09-30T22:36:01.202 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.119185.log.gz 2023-09-30T22:36:01.202 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.156731.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.156731.log.gz 2023-09-30T22:36:01.202 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.170346.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.170346.log.gz 2023-09-30T22:36:01.202 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193799.log 2023-09-30T22:36:01.202 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129339.log 2023-09-30T22:36:01.202 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.193799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174133.log 2023-09-30T22:36:01.202 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.129339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134442.log 2023-09-30T22:36:01.203 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.193799.log.gz 2023-09-30T22:36:01.203 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.129339.log.gz 2023-09-30T22:36:01.203 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.174133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190486.log 2023-09-30T22:36:01.203 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151635.log 2023-09-30T22:36:01.203 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.134442.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.174133.log.gz 2023-09-30T22:36:01.203 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.190486.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.134442.log.gz 2023-09-30T22:36:01.203 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177632.log 2023-09-30T22:36:01.203 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.190486.log.gz 2023-09-30T22:36:01.204 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.151635.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.151635.log.gz 2023-09-30T22:36:01.204 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.177632.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.177632.log.gz 2023-09-30T22:36:01.204 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184164.log 2023-09-30T22:36:01.204 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146186.log 2023-09-30T22:36:01.204 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.184164.log: /var/log/ceph/ceph-client.admin.146186.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.184164.log.gz 2023-09-30T22:36:01.204 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.146186.log.gz 2023-09-30T22:36:01.204 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170765.log 2023-09-30T22:36:01.204 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174683.log 2023-09-30T22:36:01.205 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.170765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163058.log 2023-09-30T22:36:01.205 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.170765.log.gz 2023-09-30T22:36:01.205 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.174683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189898.log 2023-09-30T22:36:01.205 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144448.log 2023-09-30T22:36:01.205 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.174683.log.gz 2023-09-30T22:36:01.205 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.163058.log: /var/log/ceph/ceph-client.admin.189898.log: 89.5%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.163058.log.gz--verbose 2023-09-30T22:36:01.205 INFO:teuthology.orchestra.run.smithi040.stderr:-- /var/log/ceph/ceph-client.admin.194949.log 2023-09-30T22:36:01.205 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.189898.log.gz 2023-09-30T22:36:01.206 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.144448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143442.log 2023-09-30T22:36:01.206 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.144448.log.gz 2023-09-30T22:36:01.206 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.194949.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.194949.log.gz 2023-09-30T22:36:01.206 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.143442.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.143442.log.gz 2023-09-30T22:36:01.206 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128660.log 2023-09-30T22:36:01.206 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166784.log 2023-09-30T22:36:01.206 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.128660.log: /var/log/ceph/ceph-client.admin.166784.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.128660.log.gz 2023-09-30T22:36:01.206 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130461.log 2023-09-30T22:36:01.207 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.166784.log.gz 2023-09-30T22:36:01.207 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176004.log 2023-09-30T22:36:01.207 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.130461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190433.log 2023-09-30T22:36:01.207 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.130461.log.gz 2023-09-30T22:36:01.207 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.176004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150647.log 2023-09-30T22:36:01.207 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176868.log 2023-09-30T22:36:01.207 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.190433.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.176004.log.gz 2023-09-30T22:36:01.207 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.150647.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.190433.log.gz 2023-09-30T22:36:01.208 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.150647.log.gz 2023-09-30T22:36:01.208 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.176868.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.176868.log.gz 2023-09-30T22:36:01.208 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161759.log 2023-09-30T22:36:01.208 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173752.log 2023-09-30T22:36:01.208 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.161759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143983.log 2023-09-30T22:36:01.208 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.161759.log.gz 2023-09-30T22:36:01.208 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.173752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144096.log 2023-09-30T22:36:01.208 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.173752.log.gz 2023-09-30T22:36:01.209 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.143983.log: /var/log/ceph/ceph-client.admin.144096.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.143983.log.gz 2023-09-30T22:36:01.209 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.144096.log.gz 2023-09-30T22:36:01.209 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176056.log 2023-09-30T22:36:01.209 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141307.log 2023-09-30T22:36:01.209 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.176056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124866.log 2023-09-30T22:36:01.209 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.176056.log.gz 2023-09-30T22:36:01.209 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.141307.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-09-30T22:36:01.209 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191856.log 2023-09-30T22:36:01.210 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.141307.log.gz 2023-09-30T22:36:01.210 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.124866.log: /var/log/ceph/ceph-mgr.x.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.124866.log.gz 2023-09-30T22:36:01.210 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.191856.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.191856.log.gz 2023-09-30T22:36:01.210 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195405.log 2023-09-30T22:36:01.210 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182337.log 2023-09-30T22:36:01.210 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.195405.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.195405.log.gz 2023-09-30T22:36:01.210 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.182337.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.182337.log.gz 2023-09-30T22:36:01.211 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165755.log 2023-09-30T22:36:01.211 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164500.log 2023-09-30T22:36:01.211 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.165755.log: /var/log/ceph/ceph-client.admin.164500.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.165755.log.gz 2023-09-30T22:36:01.211 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.164500.log.gz 2023-09-30T22:36:01.211 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160144.log 2023-09-30T22:36:01.211 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145355.log 2023-09-30T22:36:01.211 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.160144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123783.log 2023-09-30T22:36:01.211 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.145355.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.160144.log.gz 2023-09-30T22:36:01.212 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.123783.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.145355.log.gz 2023-09-30T22:36:01.212 INFO:teuthology.orchestra.run.smithi040.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.123783.log.gz 2023-09-30T22:36:01.212 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192001.log 2023-09-30T22:36:01.212 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184911.log 2023-09-30T22:36:01.212 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.192001.log: /var/log/ceph/ceph-client.admin.184911.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.192001.log.gz 2023-09-30T22:36:01.212 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.184911.log.gz 2023-09-30T22:36:01.212 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183735.log 2023-09-30T22:36:01.212 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180132.log 2023-09-30T22:36:01.213 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.183735.log: /var/log/ceph/ceph-client.admin.180132.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.183735.log.gz 2023-09-30T22:36:01.213 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.180132.log.gz 2023-09-30T22:36:01.213 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152641.log 2023-09-30T22:36:01.213 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144056.log 2023-09-30T22:36:01.213 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.152641.log: /var/log/ceph/ceph-client.admin.144056.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.152641.log.gz 2023-09-30T22:36:01.213 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.144056.log.gz 2023-09-30T22:36:01.213 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150059.log 2023-09-30T22:36:01.213 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136212.log 2023-09-30T22:36:01.214 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.150059.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.150059.log.gz 2023-09-30T22:36:01.214 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.136212.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.136212.log.gz 2023-09-30T22:36:01.214 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124324.log 2023-09-30T22:36:01.214 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189748.log 2023-09-30T22:36:01.214 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.124324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137140.log 2023-09-30T22:36:01.214 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.124324.log.gz 2023-09-30T22:36:01.214 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.189748.log: /var/log/ceph/ceph-client.admin.137140.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.189748.log.gz 2023-09-30T22:36:01.215 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.137140.log.gz 2023-09-30T22:36:01.215 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175908.log 2023-09-30T22:36:01.215 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151315.log 2023-09-30T22:36:01.215 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.175908.log: /var/log/ceph/ceph-client.admin.151315.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.175908.log.gz 2023-09-30T22:36:01.215 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.151315.log.gz 2023-09-30T22:36:01.215 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179622.log 2023-09-30T22:36:01.215 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184370.log 2023-09-30T22:36:01.215 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.179622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187738.log 2023-09-30T22:36:01.216 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.184370.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.179622.log.gz 2023-09-30T22:36:01.216 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.187738.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.184370.log.gz 2023-09-30T22:36:01.216 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.187738.log.gz 2023-09-30T22:36:01.216 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168825.log 2023-09-30T22:36:01.216 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153621.log 2023-09-30T22:36:01.216 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.168825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178415.log 2023-09-30T22:36:01.216 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.153621.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.168825.log.gz 2023-09-30T22:36:01.216 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.178415.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.153621.log.gz 2023-09-30T22:36:01.217 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.178415.log.gz 2023-09-30T22:36:01.217 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184885.log 2023-09-30T22:36:01.217 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171967.log 2023-09-30T22:36:01.217 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.184885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183147.log 2023-09-30T22:36:01.217 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.171967.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.184885.log.gz 2023-09-30T22:36:01.217 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.183147.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.171967.log.gz 2023-09-30T22:36:01.217 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126306.log 2023-09-30T22:36:01.217 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.183147.log.gz 2023-09-30T22:36:01.218 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146139.log 2023-09-30T22:36:01.218 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.126306.log: /var/log/ceph/ceph-client.admin.146139.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.126306.log.gz 2023-09-30T22:36:01.218 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.146139.log.gz 2023-09-30T22:36:01.218 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149179.log 2023-09-30T22:36:01.218 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190925.log 2023-09-30T22:36:01.218 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.149179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171888.log 2023-09-30T22:36:01.219 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.190925.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.149179.log.gz 2023-09-30T22:36:01.219 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.190925.log.gz 2023-09-30T22:36:01.219 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.171888.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.171888.log.gz 2023-09-30T22:36:01.219 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148787.log 2023-09-30T22:36:01.219 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145232.log 2023-09-30T22:36:01.219 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.148787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138095.log 2023-09-30T22:36:01.219 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.145232.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.148787.log.gz 2023-09-30T22:36:01.219 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.138095.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.145232.log.gz 2023-09-30T22:36:01.220 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.138095.log.gz 2023-09-30T22:36:01.220 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154627.log 2023-09-30T22:36:01.220 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168012.log 2023-09-30T22:36:01.220 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.154627.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.154627.log.gz 2023-09-30T22:36:01.220 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.168012.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.168012.log.gz 2023-09-30T22:36:01.220 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142799.log 2023-09-30T22:36:01.220 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174143.log 2023-09-30T22:36:01.221 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.142799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177435.log 2023-09-30T22:36:01.221 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.174143.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.142799.log.gz 2023-09-30T22:36:01.221 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.177435.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.174143.log.gz 2023-09-30T22:36:01.221 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.177435.log.gz 2023-09-30T22:36:01.221 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153060.log 2023-09-30T22:36:01.221 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155606.log 2023-09-30T22:36:01.221 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.153060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160314.log 2023-09-30T22:36:01.222 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.155606.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.153060.log.gz 2023-09-30T22:36:01.222 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.160314.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.155606.log.gz 2023-09-30T22:36:01.222 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171594.log 2023-09-30T22:36:01.222 INFO:teuthology.orchestra.run.smithi040.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.160314.log.gz 2023-09-30T22:36:01.222 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194830.log 2023-09-30T22:36:01.222 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.171594.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.171594.log.gz 2023-09-30T22:36:01.222 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.194830.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.194830.log.gz 2023-09-30T22:36:01.222 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166222.log 2023-09-30T22:36:01.223 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167176.log 2023-09-30T22:36:01.223 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.166222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179204.log 2023-09-30T22:36:01.223 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.167176.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.166222.log.gz 2023-09-30T22:36:01.223 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.179204.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.167176.log.gz 2023-09-30T22:36:01.223 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.179204.log.gz 2023-09-30T22:36:01.223 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154870.log 2023-09-30T22:36:01.223 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169170.log 2023-09-30T22:36:01.223 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.154870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194440.log 2023-09-30T22:36:01.224 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.169170.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.154870.log.gz 2023-09-30T22:36:01.224 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.169170.log.gz 2023-09-30T22:36:01.224 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.194440.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.194440.log.gz 2023-09-30T22:36:01.224 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138291.log 2023-09-30T22:36:01.224 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195503.log 2023-09-30T22:36:01.224 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.138291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173707.log 2023-09-30T22:36:01.224 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.195503.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.138291.log.gz 2023-09-30T22:36:01.224 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.173707.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.195503.log.gz 2023-09-30T22:36:01.225 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.173707.log.gz 2023-09-30T22:36:01.225 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124079.log 2023-09-30T22:36:01.225 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135868.log 2023-09-30T22:36:01.225 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.124079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141819.log 2023-09-30T22:36:01.225 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.135868.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.124079.log.gz 2023-09-30T22:36:01.225 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.141819.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.135868.log.gz 2023-09-30T22:36:01.225 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.141819.log.gz 2023-09-30T22:36:01.225 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128786.log 2023-09-30T22:36:01.226 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145036.log 2023-09-30T22:36:01.226 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.128786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155607.log 2023-09-30T22:36:01.226 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.145036.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.128786.log.gz 2023-09-30T22:36:01.226 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.155607.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.145036.log.gz 2023-09-30T22:36:01.226 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.155607.log.gz 2023-09-30T22:36:01.226 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137000.log 2023-09-30T22:36:01.226 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170617.log 2023-09-30T22:36:01.226 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.137000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146970.log 2023-09-30T22:36:01.227 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.170617.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.137000.log.gz 2023-09-30T22:36:01.227 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.170617.log.gz 2023-09-30T22:36:01.227 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.146970.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.146970.log.gz 2023-09-30T22:36:01.227 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169798.log 2023-09-30T22:36:01.227 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180036.log 2023-09-30T22:36:01.227 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.169798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167817.log 2023-09-30T22:36:01.227 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.169798.log.gz 2023-09-30T22:36:01.228 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.180036.log: /var/log/ceph/ceph-client.admin.167817.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.180036.log.gz 2023-09-30T22:36:01.228 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.167817.log.gz 2023-09-30T22:36:01.228 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147119.log 2023-09-30T22:36:01.228 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178416.log 2023-09-30T22:36:01.228 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.147119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144179.log 2023-09-30T22:36:01.228 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.147119.log.gz 2023-09-30T22:36:01.228 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.178416.log: /var/log/ceph/ceph-client.admin.144179.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.178416.log.gz 2023-09-30T22:36:01.228 INFO:teuthology.orchestra.run.smithi040.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-09-30T22:36:01.229 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193995.log 2023-09-30T22:36:01.229 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.144179.log.gz 2023-09-30T22:36:01.229 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184052.log 2023-09-30T22:36:01.229 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.193995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192078.log 2023-09-30T22:36:01.229 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.193995.log.gz 2023-09-30T22:36:01.229 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.184052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191269.log 2023-09-30T22:36:01.229 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175076.log 2023-09-30T22:36:01.229 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.184052.log.gz 2023-09-30T22:36:01.230 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.192078.log: /var/log/ceph/ceph-client.admin.191269.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.192078.log.gz 2023-09-30T22:36:01.230 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.191269.log.gz 2023-09-30T22:36:01.230 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.175076.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.175076.log.gz 2023-09-30T22:36:01.230 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137972.log 2023-09-30T22:36:01.230 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189058.log 2023-09-30T22:36:01.230 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.137972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152223.log 2023-09-30T22:36:01.230 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.137972.log.gz 2023-09-30T22:36:01.230 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.189058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125794.log 2023-09-30T22:36:01.231 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135939.log 2023-09-30T22:36:01.231 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.189058.log.gz 2023-09-30T22:36:01.231 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.152223.log: /var/log/ceph/ceph-client.admin.125794.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.152223.log.gz 2023-09-30T22:36:01.231 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166250.log 2023-09-30T22:36:01.231 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.125794.log.gz 2023-09-30T22:36:01.231 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.135939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125206.log 2023-09-30T22:36:01.231 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.135939.log.gz 2023-09-30T22:36:01.231 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.166250.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.166250.log.gz/var/log/ceph/ceph-client.admin.125206.log: 2023-09-30T22:36:01.232 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.125206.log.gz 2023-09-30T22:36:01.232 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158299.log 2023-09-30T22:36:01.232 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184101.log 2023-09-30T22:36:01.232 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.158299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126453.log 2023-09-30T22:36:01.232 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.184101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195170.log 2023-09-30T22:36:01.232 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.158299.log.gz 2023-09-30T22:36:01.232 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.184101.log.gz 2023-09-30T22:36:01.232 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.126453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153106.log 2023-09-30T22:36:01.233 INFO:teuthology.orchestra.run.smithi040.stderr:gzip /var/log/ceph/ceph-client.admin.195170.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.135539.log 2023-09-30T22:36:01.233 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.126453.log.gz 2023-09-30T22:36:01.233 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.153106.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.195170.log.gz 2023-09-30T22:36:01.233 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.153106.log.gz 2023-09-30T22:36:01.233 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.135539.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.135539.log.gz 2023-09-30T22:36:01.233 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176592.log 2023-09-30T22:36:01.233 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171203.log 2023-09-30T22:36:01.233 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.176592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183539.log 2023-09-30T22:36:01.234 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.176592.log.gz 2023-09-30T22:36:01.234 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.171203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192393.log 2023-09-30T22:36:01.234 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127695.log 2023-09-30T22:36:01.234 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.171203.log.gz 2023-09-30T22:36:01.234 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.183539.log: /var/log/ceph/ceph-client.admin.192393.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.183539.log.gz 2023-09-30T22:36:01.234 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.192393.log.gz 2023-09-30T22:36:01.234 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.127695.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.127695.log.gz 2023-09-30T22:36:01.234 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137750.log 2023-09-30T22:36:01.235 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142846.log 2023-09-30T22:36:01.235 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.137750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149079.log 2023-09-30T22:36:01.235 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.137750.log.gz 2023-09-30T22:36:01.235 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.142846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148295.log 2023-09-30T22:36:01.235 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168556.log 2023-09-30T22:36:01.235 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.149079.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.142846.log.gz 2023-09-30T22:36:01.235 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.148295.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.149079.log.gz 2023-09-30T22:36:01.235 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151857.log 2023-09-30T22:36:01.236 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.148295.log.gz 2023-09-30T22:36:01.236 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.168556.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.168556.log.gz 2023-09-30T22:36:01.236 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.151857.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.151857.log.gz 2023-09-30T22:36:01.236 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154209.log 2023-09-30T22:36:01.236 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171781.log 2023-09-30T22:36:01.236 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.154209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136086.log 2023-09-30T22:36:01.236 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.171781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169093.log 87.9% 2023-09-30T22:36:01.237 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.154209.log.gz 2023-09-30T22:36:01.237 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.171781.log.gz 2023-09-30T22:36:01.237 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.136086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193647.log 2023-09-30T22:36:01.237 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140763.log 2023-09-30T22:36:01.237 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.169093.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.136086.log.gz 2023-09-30T22:36:01.237 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.193647.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.169093.log.gz 2023-09-30T22:36:01.237 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.140763.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.193647.log.gz 2023-09-30T22:36:01.237 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140763.log.gz 2023-09-30T22:36:01.238 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143507.log 2023-09-30T22:36:01.238 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175515.log 2023-09-30T22:36:01.238 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.143507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176226.log 2023-09-30T22:36:01.238 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.143507.log.gz 2023-09-30T22:36:01.238 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.175515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191660.log 2023-09-30T22:36:01.238 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163646.log 2023-09-30T22:36:01.238 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.176226.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.175515.log.gz 2023-09-30T22:36:01.239 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.191660.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.176226.log.gz 2023-09-30T22:36:01.239 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.191660.log.gz 2023-09-30T22:36:01.239 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.163646.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.163646.log.gz 2023-09-30T22:36:01.239 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170421.log 2023-09-30T22:36:01.239 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147192.log 2023-09-30T22:36:01.239 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.170421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178808.log 2023-09-30T22:36:01.239 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.170421.log.gz 2023-09-30T22:36:01.239 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.147192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179936.log 2023-09-30T22:36:01.240 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160902.log 2023-09-30T22:36:01.240 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.178808.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.147192.log.gz 2023-09-30T22:36:01.240 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.179936.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.178808.log.gz 2023-09-30T22:36:01.240 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159377.log 2023-09-30T22:36:01.240 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.160902.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.179936.log.gz 2023-09-30T22:36:01.240 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162862.log 2023-09-30T22:36:01.240 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.160902.log.gz 2023-09-30T22:36:01.240 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.159377.log: /var/log/ceph/ceph-client.admin.162862.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.159377.log.gz 2023-09-30T22:36:01.241 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169562.log 2023-09-30T22:36:01.241 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.162862.log.gz 2023-09-30T22:36:01.241 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140839.log 2023-09-30T22:36:01.241 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.169562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164038.log 2023-09-30T22:36:01.241 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.169562.log.gz 2023-09-30T22:36:01.241 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.140839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157222.log 2023-09-30T22:36:01.241 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.164038.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.140839.log.gz 2023-09-30T22:36:01.241 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.157222.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.164038.log.gz 2023-09-30T22:36:01.242 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.157222.log.gz 2023-09-30T22:36:01.242 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163479.log 2023-09-30T22:36:01.242 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139318.log 2023-09-30T22:36:01.242 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.163479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191805.log 2023-09-30T22:36:01.242 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.163479.log.gz 2023-09-30T22:36:01.242 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.139318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183856.log 2023-09-30T22:36:01.242 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189087.log 2023-09-30T22:36:01.243 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.191805.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.139318.log.gz 2023-09-30T22:36:01.243 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.183856.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.191805.log.gz 2023-09-30T22:36:01.243 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.183856.log.gz/var/log/ceph/ceph-client.admin.189087.log: 2023-09-30T22:36:01.243 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158169.log 2023-09-30T22:36:01.243 INFO:teuthology.orchestra.run.smithi040.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.189087.log.gz 2023-09-30T22:36:01.243 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-09-30T22:36:01.243 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.158169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163084.log 2023-09-30T22:36:01.243 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.158169.log.gz 2023-09-30T22:36:01.244 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176788.log 2023-09-30T22:36:01.244 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192641.log 2023-09-30T22:36:01.244 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.163084.log: /var/log/ceph/ceph-client.admin.176788.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.163084.log.gz 2023-09-30T22:36:01.244 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.176788.log.gz 2023-09-30T22:36:01.244 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.192641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153007.log 2023-09-30T22:36:01.244 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.192641.log.gz 2023-09-30T22:36:01.244 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168378.log 2023-09-30T22:36:01.244 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182484.log 2023-09-30T22:36:01.245 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.153007.log: /var/log/ceph/ceph-client.admin.168378.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.153007.log.gz 2023-09-30T22:36:01.245 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.168378.log.gz/var/log/ceph/ceph-client.admin.182484.log: 2023-09-30T22:36:01.245 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.182484.log.gz 2023-09-30T22:36:01.245 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194361.log 2023-09-30T22:36:01.245 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162919.log 2023-09-30T22:36:01.245 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.194361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164579.log 2023-09-30T22:36:01.245 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.194361.log.gz 2023-09-30T22:36:01.245 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.162919.log: /var/log/ceph/ceph-client.admin.164579.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.162919.log.gz 2023-09-30T22:36:01.246 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156169.log 2023-09-30T22:36:01.246 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.164579.log.gz 2023-09-30T22:36:01.246 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193644.log 2023-09-30T22:36:01.246 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.156169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194975.log 2023-09-30T22:36:01.246 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.156169.log.gz 2023-09-30T22:36:01.246 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.193644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177436.log 2023-09-30T22:36:01.246 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.193644.log.gz 2023-09-30T22:36:01.246 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.194975.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.194975.log.gz 2023-09-30T22:36:01.247 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.177436.log: 87.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.177436.log.gz 2023-09-30T22:36:01.247 INFO:teuthology.orchestra.run.smithi040.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.148518.log 2023-09-30T22:36:01.247 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148172.log 2023-09-30T22:36:01.247 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.148518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129829.log 2023-09-30T22:36:01.247 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.148518.log.gz 2023-09-30T22:36:01.247 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.148172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164069.log 2023-09-30T22:36:01.247 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.148172.log.gz 2023-09-30T22:36:01.247 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.129829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164289.log 2023-09-30T22:36:01.248 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.164069.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.129829.log.gz 2023-09-30T22:36:01.248 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.164069.log.gz 2023-09-30T22:36:01.248 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.164289.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.164289.log.gz 2023-09-30T22:36:01.248 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171718.log 2023-09-30T22:36:01.248 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-09-30T22:36:01.248 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.171718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123232.log 2023-09-30T22:36:01.248 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.171718.log.gz 2023-09-30T22:36:01.248 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.123232.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.123232.log.gz 2023-09-30T22:36:01.249 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184689.log 2023-09-30T22:36:01.249 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-09-30T22:36:01.249 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.184689.log: 89.2%/var/log/ceph/ceph-mon.a.log: -- replaced with /var/log/ceph/ceph-client.admin.184689.log.gz 2023-09-30T22:36:01.249 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142899.log 2023-09-30T22:36:01.249 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161516.log 2023-09-30T22:36:01.249 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.142899.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.142899.log.gz 2023-09-30T22:36:01.249 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193851.log 2023-09-30T22:36:01.250 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.161516.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.161516.log.gz 2023-09-30T22:36:01.250 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.193851.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.193851.log.gz 2023-09-30T22:36:01.250 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186366.log 2023-09-30T22:36:01.250 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162619.log 2023-09-30T22:36:01.250 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.186366.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.186366.log.gz 2023-09-30T22:36:01.250 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.162619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143787.log 2023-09-30T22:36:01.250 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.162619.log.gz 2023-09-30T22:36:01.250 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145159.log 2023-09-30T22:36:01.251 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.143787.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.143787.log.gz 2023-09-30T22:36:01.251 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.145159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171300.log 2023-09-30T22:36:01.251 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.145159.log.gz 2023-09-30T22:36:01.251 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172306.log 2023-09-30T22:36:01.251 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.171300.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.171300.log.gz 2023-09-30T22:36:01.251 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.172306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139467.log 2023-09-30T22:36:01.251 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.172306.log.gz 2023-09-30T22:36:01.251 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138955.log 2023-09-30T22:36:01.252 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.139467.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.139467.log.gz 2023-09-30T22:36:01.252 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.138955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166053.log 2023-09-30T22:36:01.252 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.138955.log.gz 2023-09-30T22:36:01.252 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136605.log 2023-09-30T22:36:01.252 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.166053.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.166053.log.gz 2023-09-30T22:36:01.252 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.136605.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.136605.log.gz 2023-09-30T22:36:01.252 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180233.log 2023-09-30T22:36:01.253 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.180233.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.180233.log.gz 2023-09-30T22:36:01.253 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187320.log 2023-09-30T22:36:01.253 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.187320.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.187320.log.gz 2023-09-30T22:36:01.253 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161563.log 2023-09-30T22:36:01.253 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.161563.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.161563.log.gz 2023-09-30T22:36:01.253 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160170.log 2023-09-30T22:36:01.253 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.160170.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.160170.log.gz 2023-09-30T22:36:01.253 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137167.log 2023-09-30T22:36:01.254 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.137167.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.137167.log.gz 2023-09-30T22:36:01.254 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158743.log 2023-09-30T22:36:01.254 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.158743.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.158743.log.gz 2023-09-30T22:36:01.254 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146578.log 2023-09-30T22:36:01.254 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.146578.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.146578.log.gz 2023-09-30T22:36:01.254 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164850.log 2023-09-30T22:36:01.254 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.164850.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.164850.log.gz 2023-09-30T22:36:01.254 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152078.log 2023-09-30T22:36:01.255 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.152078.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.152078.log.gz 2023-09-30T22:36:01.255 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179570.log 2023-09-30T22:36:01.255 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.179570.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.179570.log.gz 2023-09-30T22:36:01.255 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165857.log 2023-09-30T22:36:01.255 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.165857.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.165857.log.gz 2023-09-30T22:36:01.255 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139542.log 2023-09-30T22:36:01.256 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.139542.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.139542.log.gz 2023-09-30T22:36:01.256 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166445.log 2023-09-30T22:36:01.256 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.166445.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166445.log.gz 2023-09-30T22:36:01.256 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184566.log 2023-09-30T22:36:01.256 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.184566.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.184566.log.gz 2023-09-30T22:36:01.256 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173183.log 2023-09-30T22:36:01.256 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.173183.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.173183.log.gz 2023-09-30T22:36:01.256 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123040.log 2023-09-30T22:36:01.257 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.123040.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.123040.log.gz 2023-09-30T22:36:01.257 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175246.log 2023-09-30T22:36:01.257 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.175246.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.175246.log.gz 2023-09-30T22:36:01.257 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144644.log 2023-09-30T22:36:01.257 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.144644.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.144644.log.gz 2023-09-30T22:36:01.257 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166735.log 2023-09-30T22:36:01.257 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.166735.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.166735.log.gz 2023-09-30T22:36:01.257 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154797.log 2023-09-30T22:36:01.258 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.154797.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.154797.log.gz 2023-09-30T22:36:01.258 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157418.log 2023-09-30T22:36:01.258 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.157418.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.157418.log.gz 2023-09-30T22:36:01.258 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188078.log 2023-09-30T22:36:01.258 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.188078.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.188078.log.gz 2023-09-30T22:36:01.258 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136945.log 2023-09-30T22:36:01.258 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.136945.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.136945.log.gz 2023-09-30T22:36:01.258 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191413.log 2023-09-30T22:36:01.259 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.191413.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.191413.log.gz 2023-09-30T22:36:01.259 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180821.log 2023-09-30T22:36:01.259 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.180821.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.180821.log.gz 2023-09-30T22:36:01.259 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166343.log 2023-09-30T22:36:01.259 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.166343.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.166343.log.gz 2023-09-30T22:36:01.259 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137802.log 2023-09-30T22:36:01.259 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.137802.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.137802.log.gz 2023-09-30T22:36:01.259 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125914.log 2023-09-30T22:36:01.260 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.125914.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.125914.log.gz 2023-09-30T22:36:01.260 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178782.log 2023-09-30T22:36:01.260 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.178782.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.178782.log.gz 2023-09-30T22:36:01.260 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194437.log 2023-09-30T22:36:01.260 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.194437.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.194437.log.gz 2023-09-30T22:36:01.260 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191687.log 2023-09-30T22:36:01.260 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.191687.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.191687.log.gz 2023-09-30T22:36:01.260 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187124.log 2023-09-30T22:36:01.261 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.187124.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.187124.log.gz 2023-09-30T22:36:01.261 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152275.log 2023-09-30T22:36:01.261 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.152275.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152275.log.gz 2023-09-30T22:36:01.261 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-09-30T22:36:01.261 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151831.log 2023-09-30T22:36:01.306 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.151831.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.151831.log.gz 2023-09-30T22:36:01.306 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182167.log 2023-09-30T22:36:01.307 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.182167.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.182167.log.gz 2023-09-30T22:36:01.307 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138391.log 2023-09-30T22:36:01.307 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.138391.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.138391.log.gz 2023-09-30T22:36:01.307 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173511.log 2023-09-30T22:36:01.307 INFO:teuthology.orchestra.run.smithi040.stderr: 95.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-09-30T22:36:01.307 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.173511.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.173511.log.gz 2023-09-30T22:36:01.307 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154379.log 2023-09-30T22:36:01.307 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.154379.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.154379.log.gz 2023-09-30T22:36:01.308 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157541.log 2023-09-30T22:36:01.308 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.157541.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.157541.log.gz 2023-09-30T22:36:01.308 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156634.log 2023-09-30T22:36:01.308 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.156634.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156634.log.gz 2023-09-30T22:36:01.308 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151286.log 2023-09-30T22:36:01.308 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.151286.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.151286.log.gz 2023-09-30T22:36:01.308 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139587.log 2023-09-30T22:36:01.308 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.139587.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139587.log.gz 2023-09-30T22:36:01.309 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192885.log 2023-09-30T22:36:01.309 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.192885.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.192885.log.gz 2023-09-30T22:36:01.309 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150531.log 2023-09-30T22:36:01.309 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.150531.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.150531.log.gz 2023-09-30T22:36:01.309 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129633.log 2023-09-30T22:36:01.309 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.129633.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.129633.log.gz 2023-09-30T22:36:01.309 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127830.log 2023-09-30T22:36:01.309 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.127830.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.127830.log.gz 2023-09-30T22:36:01.310 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182729.log 2023-09-30T22:36:01.310 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.182729.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.182729.log.gz 2023-09-30T22:36:01.310 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183978.log 2023-09-30T22:36:01.310 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.183978.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.183978.log.gz 2023-09-30T22:36:01.310 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154656.log 2023-09-30T22:36:01.310 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.154656.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.154656.log.gz 2023-09-30T22:36:01.310 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192615.log 2023-09-30T22:36:01.311 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.192615.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.192615.log.gz 2023-09-30T22:36:01.311 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144840.log 2023-09-30T22:36:01.311 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.144840.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.144840.log.gz 2023-09-30T22:36:01.311 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158353.log 2023-09-30T22:36:01.311 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.158353.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158353.log.gz 2023-09-30T22:36:01.311 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194635.log 2023-09-30T22:36:01.311 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.194635.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.194635.log.gz 2023-09-30T22:36:01.311 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171496.log 2023-09-30T22:36:01.312 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.171496.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.171496.log.gz 2023-09-30T22:36:01.312 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187243.log 2023-09-30T22:36:01.312 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.187243.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.187243.log.gz 2023-09-30T22:36:01.312 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149570.log 2023-09-30T22:36:01.312 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135794.log 2023-09-30T22:36:01.312 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.149570.log: /var/log/ceph/ceph-client.admin.135794.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.149570.log.gz 2023-09-30T22:36:01.312 INFO:teuthology.orchestra.run.smithi040.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.135794.log.gz 2023-09-30T22:36:01.312 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143638.log 2023-09-30T22:36:01.313 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.143638.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.143638.log.gz 2023-09-30T22:36:01.313 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184323.log 2023-09-30T22:36:01.313 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.184323.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.184323.log.gz 2023-09-30T22:36:01.313 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174436.log 2023-09-30T22:36:01.313 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.174436.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.174436.log.gz 2023-09-30T22:36:01.313 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171395.log 2023-09-30T22:36:01.313 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.171395.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.171395.log.gz 2023-09-30T22:36:01.313 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172559.log 2023-09-30T22:36:01.314 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.172559.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.172559.log.gz 2023-09-30T22:36:01.314 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153868.log 2023-09-30T22:36:01.314 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.153868.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.153868.log.gz 2023-09-30T22:36:01.314 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140298.log 2023-09-30T22:36:01.314 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.140298.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.140298.log.gz 2023-09-30T22:36:01.314 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152249.log 2023-09-30T22:36:01.314 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.152249.log: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-09-30T22:36:01.314 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.152249.log.gz 2023-09-30T22:36:01.315 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157907.log 2023-09-30T22:36:01.315 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159182.log 2023-09-30T22:36:01.315 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.157907.log: /var/log/ceph/ceph-client.admin.159182.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.157907.log.gz 2023-09-30T22:36:01.315 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.159182.log.gz 2023-09-30T22:36:01.315 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159574.log 2023-09-30T22:36:01.315 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164628.log 2023-09-30T22:36:01.315 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.159574.log: /var/log/ceph/ceph-client.admin.164628.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.159574.log.gz 2023-09-30T22:36:01.315 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.164628.log.gz 2023-09-30T22:36:01.317 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191217.log 2023-09-30T22:36:01.317 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192249.log 2023-09-30T22:36:01.317 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.191217.log: /var/log/ceph/ceph-client.admin.192249.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.191217.log.gz 2023-09-30T22:36:01.317 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.192249.log.gz 2023-09-30T22:36:01.317 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187490.log 2023-09-30T22:36:01.318 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147388.log 2023-09-30T22:36:01.318 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.187490.log: /var/log/ceph/ceph-client.admin.147388.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.187490.log.gz 2023-09-30T22:36:01.318 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.147388.log.gz 2023-09-30T22:36:01.318 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128278.log 2023-09-30T22:36:01.318 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170417.log 2023-09-30T22:36:01.318 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.128278.log: /var/log/ceph/ceph-client.admin.170417.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.128278.log.gz 2023-09-30T22:36:01.318 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.170417.log.gz 2023-09-30T22:36:01.318 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124695.log 2023-09-30T22:36:01.319 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175479.log 2023-09-30T22:36:01.319 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.124695.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.124695.log.gz 2023-09-30T22:36:01.319 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.175479.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.175479.log.gz 2023-09-30T22:36:01.319 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126257.log 2023-09-30T22:36:01.319 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129143.log 2023-09-30T22:36:01.319 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.126257.log: /var/log/ceph/ceph-client.admin.129143.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.126257.log.gz 2023-09-30T22:36:01.319 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.129143.log.gz 2023-09-30T22:36:01.320 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169340.log 2023-09-30T22:36:01.320 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127514.log 2023-09-30T22:36:01.320 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.169340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164236.log 2023-09-30T22:36:01.320 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.169340.log.gz 2023-09-30T22:36:01.320 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.127514.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.127514.log.gz 2023-09-30T22:36:01.320 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.164236.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.164236.log.gz 2023-09-30T22:36:01.320 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124892.log 2023-09-30T22:36:01.320 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162423.log 2023-09-30T22:36:01.321 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.124892.log: /var/log/ceph/ceph-client.admin.162423.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.124892.log.gz 2023-09-30T22:36:01.321 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.162423.log.gz 2023-09-30T22:36:01.321 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140643.log 2023-09-30T22:36:01.321 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141278.log 2023-09-30T22:36:01.321 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.140643.log: /var/log/ceph/ceph-client.admin.141278.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.140643.log.gz 2023-09-30T22:36:01.321 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.141278.log.gz 2023-09-30T22:36:01.321 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157345.log 2023-09-30T22:36:01.321 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169758.log 2023-09-30T22:36:01.322 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.157345.log: /var/log/ceph/ceph-client.admin.169758.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.157345.log.gz 2023-09-30T22:36:01.322 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.169758.log.gz 2023-09-30T22:36:01.322 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147220.log 2023-09-30T22:36:01.322 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-09-30T22:36:01.322 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.147220.log: /var/log/ceph/ceph.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.147220.log.gz 2023-09-30T22:36:01.322 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145551.log 2023-09-30T22:36:01.322 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.145551.log: 94.1% -- replaced with /var/log/ceph/ceph.log.gz 2023-09-30T22:36:01.322 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.145551.log.gz 2023-09-30T22:36:01.323 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177854.log 2023-09-30T22:36:01.323 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164187.log 2023-09-30T22:36:01.323 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.177854.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.177854.log.gz 2023-09-30T22:36:01.323 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.164187.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.164187.log.gz 2023-09-30T22:36:01.323 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186169.log 2023-09-30T22:36:01.323 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171104.log 2023-09-30T22:36:01.323 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.186169.log: /var/log/ceph/ceph-client.admin.171104.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.186169.log.gz 2023-09-30T22:36:01.324 INFO:teuthology.orchestra.run.smithi040.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.171104.log.gz 2023-09-30T22:36:01.324 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144030.log 2023-09-30T22:36:01.324 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189649.log 2023-09-30T22:36:01.324 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.144030.log: /var/log/ceph/ceph-client.admin.189649.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.144030.log.gz 2023-09-30T22:36:01.324 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.189649.log.gz 2023-09-30T22:36:01.324 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123932.log 2023-09-30T22:36:01.324 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178856.log 2023-09-30T22:36:01.324 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.123932.log: /var/log/ceph/ceph-client.admin.178856.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.123932.log.gz 2023-09-30T22:36:01.325 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.178856.log.gz 2023-09-30T22:36:01.325 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191439.log 2023-09-30T22:36:01.325 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124814.log 2023-09-30T22:36:01.325 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.191439.log: /var/log/ceph/ceph-client.admin.124814.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.191439.log.gz 2023-09-30T22:36:01.325 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.124814.log.gz 2023-09-30T22:36:01.325 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125843.log 2023-09-30T22:36:01.325 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175050.log 2023-09-30T22:36:01.325 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.125843.log: /var/log/ceph/ceph-client.admin.175050.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.175050.log.gz 2023-09-30T22:36:01.326 INFO:teuthology.orchestra.run.smithi040.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.125843.log.gz 2023-09-30T22:36:01.326 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159766.log 2023-09-30T22:36:01.326 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158595.log 2023-09-30T22:36:01.326 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.159766.log: /var/log/ceph/ceph-client.admin.158595.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.159766.log.gz 2023-09-30T22:36:01.326 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.158595.log.gz 2023-09-30T22:36:01.326 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170542.log 2023-09-30T22:36:01.326 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145794.log 2023-09-30T22:36:01.326 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.170542.log: /var/log/ceph/ceph-client.admin.145794.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.170542.log.gz 2023-09-30T22:36:01.327 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.145794.log.gz 2023-09-30T22:36:01.327 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191120.log 2023-09-30T22:36:01.327 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170150.log 2023-09-30T22:36:01.327 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.191120.log: /var/log/ceph/ceph-client.admin.170150.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.191120.log.gz 2023-09-30T22:36:01.327 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.170150.log.gz 2023-09-30T22:36:01.327 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171131.log 2023-09-30T22:36:01.327 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137408.log 2023-09-30T22:36:01.327 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.171131.log: /var/log/ceph/ceph-client.admin.137408.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.171131.log.gz 2023-09-30T22:36:01.328 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.137408.log.gz 2023-09-30T22:36:01.328 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135698.log 2023-09-30T22:36:01.328 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137141.log 2023-09-30T22:36:01.328 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.135698.log: /var/log/ceph/ceph-client.admin.137141.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.135698.log.gz 2023-09-30T22:36:01.328 INFO:teuthology.orchestra.run.smithi040.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.137141.log.gz 2023-09-30T22:36:01.328 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166980.log 2023-09-30T22:36:01.328 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128996.log 2023-09-30T22:36:01.329 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.166980.log: /var/log/ceph/ceph-client.admin.128996.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.166980.log.gz 2023-09-30T22:36:01.329 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.128996.log.gz 2023-09-30T22:36:01.329 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142454.log 2023-09-30T22:36:01.329 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155751.log 2023-09-30T22:36:01.329 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.142454.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.142454.log.gz 2023-09-30T22:36:01.329 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.155751.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.155751.log.gz 2023-09-30T22:36:01.329 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139150.log 2023-09-30T22:36:01.329 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143713.log 2023-09-30T22:36:01.329 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.139150.log: /var/log/ceph/ceph-client.admin.143713.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.139150.log.gz 2023-09-30T22:36:01.330 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.143713.log.gz 2023-09-30T22:36:01.330 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174323.log 2023-09-30T22:36:01.330 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155829.log 2023-09-30T22:36:01.330 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.174323.log: /var/log/ceph/ceph-client.admin.155829.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.174323.log.gz 2023-09-30T22:36:01.330 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.155829.log.gz 2023-09-30T22:36:01.330 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169413.log 2023-09-30T22:36:01.330 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143664.log 2023-09-30T22:36:01.331 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.169413.log: /var/log/ceph/ceph-client.admin.143664.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.169413.log.gz 2023-09-30T22:36:01.331 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.143664.log.gz 2023-09-30T22:36:01.331 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179055.log 2023-09-30T22:36:01.331 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146213.log 2023-09-30T22:36:01.331 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.179055.log: /var/log/ceph/ceph-client.admin.146213.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.179055.log.gz 2023-09-30T22:36:01.331 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.146213.log.gz 2023-09-30T22:36:01.331 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167127.log 2023-09-30T22:36:01.331 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179569.log 2023-09-30T22:36:01.332 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.167127.log: /var/log/ceph/ceph-client.admin.179569.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.167127.log.gz 2023-09-30T22:36:01.332 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.179569.log.gz 2023-09-30T22:36:01.332 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157960.log 2023-09-30T22:36:01.332 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142507.log 2023-09-30T22:36:01.332 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.157960.log: /var/log/ceph/ceph-client.admin.142507.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.157960.log.gz 2023-09-30T22:36:01.332 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.142507.log.gz 2023-09-30T22:36:01.332 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188470.log 2023-09-30T22:36:01.332 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170738.log 2023-09-30T22:36:01.333 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.188470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166196.log 2023-09-30T22:36:01.333 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.188470.log.gz 2023-09-30T22:36:01.333 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.170738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124500.log 2023-09-30T22:36:01.333 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.170738.log.gz 2023-09-30T22:36:01.333 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.166196.log: /var/log/ceph/ceph-client.admin.124500.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.166196.log.gz 2023-09-30T22:36:01.333 INFO:teuthology.orchestra.run.smithi040.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.124500.log.gz 2023-09-30T22:36:01.333 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174240.log 2023-09-30T22:36:01.333 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185728.log 2023-09-30T22:36:01.334 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.174240.log: /var/log/ceph/ceph-client.admin.185728.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.174240.log.gz 2023-09-30T22:36:01.334 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.185728.log.gz 2023-09-30T22:36:01.334 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157026.log 2023-09-30T22:36:01.334 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174266.log 2023-09-30T22:36:01.334 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.157026.log: /var/log/ceph/ceph-client.admin.174266.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.157026.log.gz 2023-09-30T22:36:01.334 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.174266.log.gz 2023-09-30T22:36:01.334 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173285.log 2023-09-30T22:36:01.335 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127566.log 2023-09-30T22:36:01.335 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.173285.log: /var/log/ceph/ceph-client.admin.127566.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.173285.log.gz 2023-09-30T22:36:01.335 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161882.log 2023-09-30T22:36:01.335 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.127566.log.gz 2023-09-30T22:36:01.335 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140175.log 2023-09-30T22:36:01.335 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.161882.log: 88.0%/var/log/ceph/ceph-client.admin.140175.log: -- replaced with /var/log/ceph/ceph-client.admin.161882.log.gz 2023-09-30T22:36:01.335 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.140175.log.gz 2023-09-30T22:36:01.335 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145943.log 2023-09-30T22:36:01.335 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169536.log 2023-09-30T22:36:01.336 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.145943.log: /var/log/ceph/ceph-client.admin.169536.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.145943.log.gz 2023-09-30T22:36:01.336 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.169536.log.gz 2023-09-30T22:36:01.336 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128537.log 2023-09-30T22:36:01.336 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158808.log 2023-09-30T22:36:01.336 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.128537.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.128537.log.gz 2023-09-30T22:36:01.336 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.158808.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158808.log.gz 2023-09-30T22:36:01.336 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158325.log 2023-09-30T22:36:01.336 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169609.log 2023-09-30T22:36:01.337 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.158325.log: /var/log/ceph/ceph-client.admin.169609.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.158325.log.gz 2023-09-30T22:36:01.337 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.169609.log.gz 2023-09-30T22:36:01.337 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164288.log 2023-09-30T22:36:01.337 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166641.log 2023-09-30T22:36:01.337 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.164288.log: /var/log/ceph/ceph-client.admin.166641.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.164288.log.gz 2023-09-30T22:36:01.337 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181213.log 2023-09-30T22:36:01.337 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166641.log.gz 2023-09-30T22:36:01.337 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139391.log 2023-09-30T22:36:01.338 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.181213.log: /var/log/ceph/ceph-client.admin.139391.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.181213.log.gz 2023-09-30T22:36:01.338 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.139391.log.gz 2023-09-30T22:36:01.338 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156586.log 2023-09-30T22:36:01.338 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154283.log 2023-09-30T22:36:01.338 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.156586.log: /var/log/ceph/ceph-client.admin.154283.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.156586.log.gz 2023-09-30T22:36:01.338 INFO:teuthology.orchestra.run.smithi040.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.154283.log.gz 2023-09-30T22:36:01.338 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164701.log 2023-09-30T22:36:01.339 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170963.log 2023-09-30T22:36:01.339 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.164701.log: /var/log/ceph/ceph-client.admin.170963.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.164701.log.gz 2023-09-30T22:36:01.339 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.170963.log.gz 2023-09-30T22:36:01.339 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157025.log 2023-09-30T22:36:01.339 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180720.log 2023-09-30T22:36:01.339 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.157025.log: /var/log/ceph/ceph-client.admin.180720.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.157025.log.gz 2023-09-30T22:36:01.339 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.180720.log.gz 2023-09-30T22:36:01.339 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142284.log 2023-09-30T22:36:01.340 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138168.log 2023-09-30T22:36:01.340 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.142284.log: /var/log/ceph/ceph-client.admin.138168.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.142284.log.gz 2023-09-30T22:36:01.340 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.138168.log.gz 2023-09-30T22:36:01.340 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153791.log 2023-09-30T22:36:01.340 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140567.log 2023-09-30T22:36:01.340 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.153791.log: /var/log/ceph/ceph-client.admin.140567.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.153791.log.gz 2023-09-30T22:36:01.340 INFO:teuthology.orchestra.run.smithi040.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.140567.log.gz 2023-09-30T22:36:01.340 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186340.log 2023-09-30T22:36:01.341 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167035.log 2023-09-30T22:36:01.341 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.186340.log: /var/log/ceph/ceph-client.admin.167035.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.186340.log.gz 2023-09-30T22:36:01.341 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.167035.log.gz 2023-09-30T22:36:01.341 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158716.log 2023-09-30T22:36:01.341 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143319.log 2023-09-30T22:36:01.341 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.158716.log: /var/log/ceph/ceph-client.admin.143319.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.158716.log.gz 2023-09-30T22:36:01.341 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.143319.log.gz 2023-09-30T22:36:01.342 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180820.log 2023-09-30T22:36:01.342 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125549.log 2023-09-30T22:36:01.342 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.180820.log: /var/log/ceph/ceph-client.admin.125549.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.180820.log.gz 2023-09-30T22:36:01.342 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.125549.log.gz 2023-09-30T22:36:01.342 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186069.log 2023-09-30T22:36:01.342 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193033.log 2023-09-30T22:36:01.342 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.186069.log: /var/log/ceph/ceph-client.admin.193033.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.186069.log.gz 2023-09-30T22:36:01.342 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.193033.log.gz 2023-09-30T22:36:01.343 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152027.log 2023-09-30T22:36:01.343 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164971.log 2023-09-30T22:36:01.343 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.152027.log: /var/log/ceph/ceph-client.admin.164971.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.152027.log.gz 2023-09-30T22:36:01.343 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.164971.log.gz 2023-09-30T22:36:01.343 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169954.log 2023-09-30T22:36:01.343 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125304.log 2023-09-30T22:36:01.343 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.169954.log: /var/log/ceph/ceph-client.admin.125304.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.169954.log.gz 2023-09-30T22:36:01.343 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.125304.log.gz 2023-09-30T22:36:01.344 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187439.log 2023-09-30T22:36:01.344 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180916.log 2023-09-30T22:36:01.344 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.187439.log: /var/log/ceph/ceph-client.admin.180916.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.187439.log.gz 2023-09-30T22:36:01.344 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.180916.log.gz 2023-09-30T22:36:01.344 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182876.log 2023-09-30T22:36:01.344 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123834.log 2023-09-30T22:36:01.344 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.182876.log: /var/log/ceph/ceph-client.admin.123834.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.182876.log.gz 2023-09-30T22:36:01.344 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.123834.log.gz 2023-09-30T22:36:01.345 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161908.log 2023-09-30T22:36:01.345 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184127.log 2023-09-30T22:36:01.345 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.161908.log: /var/log/ceph/ceph-client.admin.184127.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.161908.log.gz 2023-09-30T22:36:01.345 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.184127.log.gz 2023-09-30T22:36:01.345 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160510.log 2023-09-30T22:36:01.345 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148491.log 2023-09-30T22:36:01.345 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.160510.log: /var/log/ceph/ceph-client.admin.148491.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.160510.log.gz 2023-09-30T22:36:01.345 INFO:teuthology.orchestra.run.smithi040.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.148491.log.gz 2023-09-30T22:36:01.346 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187827.log 2023-09-30T22:36:01.346 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179839.log 2023-09-30T22:36:01.346 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.187827.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.187827.log.gz 2023-09-30T22:36:01.346 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.179839.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.179839.log.gz 2023-09-30T22:36:01.346 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151287.log 2023-09-30T22:36:01.346 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190681.log 2023-09-30T22:36:01.346 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.151287.log: /var/log/ceph/ceph-client.admin.190681.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.151287.log.gz 2023-09-30T22:36:01.346 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.190681.log.gz 2023-09-30T22:36:01.347 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188718.log 2023-09-30T22:36:01.347 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153595.log 2023-09-30T22:36:01.347 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.188718.log: /var/log/ceph/ceph-client.admin.153595.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.188718.log.gz 2023-09-30T22:36:01.347 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.153595.log.gz 2023-09-30T22:36:01.347 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176618.log 2023-09-30T22:36:01.347 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157810.log 2023-09-30T22:36:01.347 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.176618.log: /var/log/ceph/ceph-client.admin.157810.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.176618.log.gz 2023-09-30T22:36:01.347 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.157810.log.gz 2023-09-30T22:36:01.348 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136800.log 2023-09-30T22:36:01.348 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152864.log 2023-09-30T22:36:01.348 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.136800.log: /var/log/ceph/ceph-client.admin.152864.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.136800.log.gz 2023-09-30T22:36:01.348 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.152864.log.gz 2023-09-30T22:36:01.348 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123477.log 2023-09-30T22:36:01.348 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145206.log 2023-09-30T22:36:01.348 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.123477.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.123477.log.gz 2023-09-30T22:36:01.348 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.145206.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.145206.log.gz 2023-09-30T22:36:01.349 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186461.log 2023-09-30T22:36:01.349 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137311.log 2023-09-30T22:36:01.349 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.186461.log: /var/log/ceph/ceph-client.admin.137311.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.186461.log.gz 2023-09-30T22:36:01.349 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.137311.log.gz 2023-09-30T22:36:01.349 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123685.log 2023-09-30T22:36:01.349 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181775.log 2023-09-30T22:36:01.349 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.123685.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.123685.log.gz 2023-09-30T22:36:01.349 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.181775.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.181775.log.gz 2023-09-30T22:36:01.350 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141427.log 2023-09-30T22:36:01.350 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154993.log 2023-09-30T22:36:01.350 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.141427.log: /var/log/ceph/ceph-client.admin.154993.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141427.log.gz 2023-09-30T22:36:01.350 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.154993.log.gz 2023-09-30T22:36:01.350 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192589.log 2023-09-30T22:36:01.350 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126061.log 2023-09-30T22:36:01.350 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.192589.log: /var/log/ceph/ceph-client.admin.126061.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.192589.log.gz 2023-09-30T22:36:01.350 INFO:teuthology.orchestra.run.smithi040.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.126061.log.gz 2023-09-30T22:36:01.351 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168499.log 2023-09-30T22:36:01.351 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190655.log 2023-09-30T22:36:01.351 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.168499.log: /var/log/ceph/ceph-client.admin.190655.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.168499.log.gz 2023-09-30T22:36:01.351 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.190655.log.gz 2023-09-30T22:36:01.351 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139906.log 2023-09-30T22:36:01.351 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189257.log 2023-09-30T22:36:01.351 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.139906.log: /var/log/ceph/ceph-client.admin.189257.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.139906.log.gz 2023-09-30T22:36:01.352 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.189257.log.gz 2023-09-30T22:36:01.352 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150354.log 2023-09-30T22:36:01.352 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173380.log 2023-09-30T22:36:01.352 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.150354.log: /var/log/ceph/ceph-client.admin.173380.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.150354.log.gz 2023-09-30T22:36:01.352 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.173380.log.gz 2023-09-30T22:36:01.352 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161686.log 2023-09-30T22:36:01.352 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158962.log 2023-09-30T22:36:01.352 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.161686.log: /var/log/ceph/ceph-client.admin.158962.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.161686.log.gz 2023-09-30T22:36:01.353 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.158962.log.gz 2023-09-30T22:36:01.353 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168779.log 2023-09-30T22:36:01.353 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140717.log 2023-09-30T22:36:01.353 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.168779.log: /var/log/ceph/ceph-client.admin.140717.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.168779.log.gz 2023-09-30T22:36:01.353 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.140717.log.gz 2023-09-30T22:36:01.353 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150869.log 2023-09-30T22:36:01.353 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175416.log 2023-09-30T22:36:01.353 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.150869.log: /var/log/ceph/ceph-client.admin.175416.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.150869.log.gz 2023-09-30T22:36:01.354 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.175416.log.gz 2023-09-30T22:36:01.354 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187047.log 2023-09-30T22:36:01.354 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181408.log 2023-09-30T22:36:01.354 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.187047.log: /var/log/ceph/ceph-client.admin.181408.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.187047.log.gz 2023-09-30T22:36:01.354 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.181408.log.gz 2023-09-30T22:36:01.354 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165412.log 2023-09-30T22:36:01.354 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156391.log 2023-09-30T22:36:01.355 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.165412.log: /var/log/ceph/ceph-client.admin.156391.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.165412.log.gz 2023-09-30T22:36:01.355 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.156391.log.gz 2023-09-30T22:36:01.355 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167229.log 2023-09-30T22:36:01.355 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173678.log 2023-09-30T22:36:01.355 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.167229.log: /var/log/ceph/ceph-client.admin.173678.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.167229.log.gz 2023-09-30T22:36:01.355 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167960.log 2023-09-30T22:36:01.355 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.173678.log.gz 2023-09-30T22:36:01.356 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123114.log 2023-09-30T22:36:01.356 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.167960.log: /var/log/ceph/ceph-client.admin.123114.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.167960.log.gz 2023-09-30T22:36:01.356 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.123114.log.gz 2023-09-30T22:36:01.356 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144495.log 2023-09-30T22:36:01.356 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126159.log 2023-09-30T22:36:01.356 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.144495.log: /var/log/ceph/ceph-client.admin.126159.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.144495.log.gz 2023-09-30T22:36:01.356 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.126159.log.gz 2023-09-30T22:36:01.357 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182998.log 2023-09-30T22:36:01.357 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156339.log 2023-09-30T22:36:01.357 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.182998.log: /var/log/ceph/ceph-client.admin.156339.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.182998.log.gz 2023-09-30T22:36:01.357 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.156339.log.gz 2023-09-30T22:36:01.357 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194046.log 2023-09-30T22:36:01.357 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186118.log 2023-09-30T22:36:01.357 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.194046.log: /var/log/ceph/ceph-client.admin.186118.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.194046.log.gz 2023-09-30T22:36:01.357 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.186118.log.gz 2023-09-30T22:36:01.358 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124373.log 2023-09-30T22:36:01.358 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160267.log 2023-09-30T22:36:01.358 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.124373.log: /var/log/ceph/ceph-client.admin.160267.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.124373.log.gz 2023-09-30T22:36:01.358 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153033.log 2023-09-30T22:36:01.358 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.160267.log.gz 2023-09-30T22:36:01.358 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162031.log 2023-09-30T22:36:01.358 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.153033.log: /var/log/ceph/ceph-client.admin.162031.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.153033.log.gz 2023-09-30T22:36:01.358 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.162031.log.gz 2023-09-30T22:36:01.359 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141697.log 2023-09-30T22:36:01.359 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193278.log 2023-09-30T22:36:01.359 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.141697.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.141697.log.gz 2023-09-30T22:36:01.359 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.193278.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.193278.log.gz 2023-09-30T22:36:01.359 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182363.log 2023-09-30T22:36:01.359 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137703.log 2023-09-30T22:36:01.359 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.182363.log: /var/log/ceph/ceph-client.admin.137703.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.182363.log.gz 2023-09-30T22:36:01.359 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.137703.log.gz 2023-09-30T22:36:01.360 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184493.log 2023-09-30T22:36:01.360 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193427.log 2023-09-30T22:36:01.360 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.184493.log: /var/log/ceph/ceph-client.admin.193427.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.184493.log.gz 2023-09-30T22:36:01.360 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.193427.log.gz 2023-09-30T22:36:01.360 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180402.log 2023-09-30T22:36:01.360 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193080.log 2023-09-30T22:36:01.381 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.180402.log: /var/log/ceph/ceph-client.admin.193080.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.180402.log.gz 2023-09-30T22:36:01.381 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.193080.log.gz 2023-09-30T22:36:01.382 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193850.log 2023-09-30T22:36:01.382 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159326.log 2023-09-30T22:36:01.382 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.193850.log: /var/log/ceph/ceph-client.admin.159326.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.193850.log.gz 2023-09-30T22:36:01.382 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.159326.log.gz 2023-09-30T22:36:01.382 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129486.log 2023-09-30T22:36:01.382 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176814.log 2023-09-30T22:36:01.382 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.129486.log: /var/log/ceph/ceph-client.admin.176814.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.129486.log.gz 2023-09-30T22:36:01.383 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.176814.log.gz 2023-09-30T22:36:01.383 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181308.log 2023-09-30T22:36:01.383 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177631.log 2023-09-30T22:36:01.383 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.181308.log: /var/log/ceph/ceph-client.admin.177631.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.181308.log.gz 2023-09-30T22:36:01.383 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.177631.log.gz 2023-09-30T22:36:01.383 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142015.log 2023-09-30T22:36:01.383 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176200.log 2023-09-30T22:36:01.383 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.142015.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.142015.log.gz 2023-09-30T22:36:01.384 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.176200.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.176200.log.gz 2023-09-30T22:36:01.384 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139934.log 2023-09-30T22:36:01.384 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185729.log 2023-09-30T22:36:01.384 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.139934.log: /var/log/ceph/ceph-client.admin.185729.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.139934.log.gz 2023-09-30T22:36:01.384 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.185729.log.gz 2023-09-30T22:36:01.384 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188415.log 2023-09-30T22:36:01.384 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123379.log 2023-09-30T22:36:01.384 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.188415.log: /var/log/ceph/ceph-client.admin.123379.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.188415.log.gz 2023-09-30T22:36:01.385 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.123379.log.gz 2023-09-30T22:36:01.385 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186657.log 2023-09-30T22:36:01.385 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141743.log 2023-09-30T22:36:01.385 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.186657.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.186657.log.gz 2023-09-30T22:36:01.385 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.141743.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.141743.log.gz 2023-09-30T22:36:01.385 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159770.log 2023-09-30T22:36:01.385 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167372.log 2023-09-30T22:36:01.385 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.159770.log: /var/log/ceph/ceph-client.admin.167372.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.159770.log.gz 2023-09-30T22:36:01.386 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.167372.log.gz 2023-09-30T22:36:01.386 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177265.log 2023-09-30T22:36:01.386 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162336.log 2023-09-30T22:36:01.386 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.177265.log: /var/log/ceph/ceph-client.admin.162336.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.177265.log.gz 2023-09-30T22:36:01.386 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.162336.log.gz 2023-09-30T22:36:01.386 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128132.log 2023-09-30T22:36:01.386 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193228.log 2023-09-30T22:36:01.387 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.128132.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.128132.log.gz 2023-09-30T22:36:01.387 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193773.log 2023-09-30T22:36:01.387 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.193228.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.193228.log.gz 2023-09-30T22:36:01.387 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.193773.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.193773.log.gz 2023-09-30T22:36:01.387 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141474.log 2023-09-30T22:36:01.387 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193399.log 2023-09-30T22:36:01.387 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.141474.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.141474.log.gz 2023-09-30T22:36:01.387 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127692.log 2023-09-30T22:36:01.388 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.193399.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.193399.log.gz 2023-09-30T22:36:01.388 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178640.log 2023-09-30T22:36:01.388 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.127692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145747.log 2023-09-30T22:36:01.388 INFO:teuthology.orchestra.run.smithi040.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.127692.log.gz 2023-09-30T22:36:01.388 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.178640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145477.log 2023-09-30T22:36:01.388 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.145747.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.178640.log.gz 2023-09-30T22:36:01.388 INFO:teuthology.orchestra.run.smithi040.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.145747.log.gz 2023-09-30T22:36:01.388 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174514.log 2023-09-30T22:36:01.389 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.145477.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.145477.log.gz 2023-09-30T22:36:01.389 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.174514.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.174514.log.gz 2023-09-30T22:36:01.389 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181945.log 2023-09-30T22:36:01.389 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170246.log 2023-09-30T22:36:01.389 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.181945.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.181945.log.gz 2023-09-30T22:36:01.389 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.170246.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.170246.log.gz 2023-09-30T22:36:01.389 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129241.log 2023-09-30T22:36:01.389 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153869.log 2023-09-30T22:36:01.390 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.129241.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.129241.log.gz 2023-09-30T22:36:01.390 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.153869.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.153869.log.gz 2023-09-30T22:36:01.390 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177214.log 2023-09-30T22:36:01.390 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191661.log 2023-09-30T22:36:01.390 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.177214.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.177214.log.gz 2023-09-30T22:36:01.390 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.191661.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.191661.log.gz 2023-09-30T22:36:01.390 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156025.log 2023-09-30T22:36:01.391 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154771.log 2023-09-30T22:36:01.391 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.156025.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.156025.log.gz 2023-09-30T22:36:01.391 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.154771.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.154771.log.gz 2023-09-30T22:36:01.391 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166539.log 2023-09-30T22:36:01.391 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181016.log 2023-09-30T22:36:01.391 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.166539.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.166539.log.gz 2023-09-30T22:36:01.391 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.181016.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.181016.log.gz 2023-09-30T22:36:01.391 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184297.log 2023-09-30T22:36:01.392 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184246.log 2023-09-30T22:36:01.392 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.184297.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.184297.log.gz 2023-09-30T22:36:01.392 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151530.log 2023-09-30T22:36:01.392 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.184246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146531.log 2023-09-30T22:36:01.392 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.184246.log.gz 2023-09-30T22:36:01.392 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.151530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189453.log 2023-09-30T22:36:01.392 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.151530.log.gz 2023-09-30T22:36:01.392 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.146531.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.146531.log.gz 2023-09-30T22:36:01.393 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.189453.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.189453.log.gz 2023-09-30T22:36:01.393 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161098.log 2023-09-30T22:36:01.393 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192248.log 2023-09-30T22:36:01.393 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.161098.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.161098.log.gz 2023-09-30T22:36:01.393 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.192248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172110.log 2023-09-30T22:36:01.393 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.192248.log.gz 2023-09-30T22:36:01.393 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186902.log 2023-09-30T22:36:01.394 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.172110.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.172110.log.gz 2023-09-30T22:36:01.394 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.186902.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.186902.log.gz 2023-09-30T22:36:01.394 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155189.log 2023-09-30T22:36:01.394 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185818.log 2023-09-30T22:36:01.394 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.155189.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.155189.log.gz 2023-09-30T22:36:01.394 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.185818.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.185818.log.gz 2023-09-30T22:36:01.394 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123330.log 2023-09-30T22:36:01.394 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172792.log 2023-09-30T22:36:01.395 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.123330.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.123330.log.gz/var/log/ceph/ceph-client.admin.172792.log: 2023-09-30T22:36:01.395 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.172792.log.gz 2023-09-30T22:36:01.395 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124498.log 2023-09-30T22:36:01.395 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161124.log 2023-09-30T22:36:01.395 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.124498.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.124498.log.gz/var/log/ceph/ceph-client.admin.161124.log: 2023-09-30T22:36:01.395 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124275.log 2023-09-30T22:36:01.395 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.161124.log.gz 2023-09-30T22:36:01.396 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142603.log 2023-09-30T22:36:01.396 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.124275.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.124275.log.gz 2023-09-30T22:36:01.396 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148128.log 2023-09-30T22:36:01.396 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.142603.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.142603.log.gz 2023-09-30T22:36:01.396 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181700.log 2023-09-30T22:36:01.396 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.148128.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.148128.log.gz 2023-09-30T22:36:01.396 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.181700.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.181700.log.gz 2023-09-30T22:36:01.396 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195307.log 2023-09-30T22:36:01.397 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147806.log 2023-09-30T22:36:01.397 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.195307.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.195307.log.gz 2023-09-30T22:36:01.397 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.147806.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.147806.log.gz 2023-09-30T22:36:01.397 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135818.log 2023-09-30T22:36:01.397 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145083.log 2023-09-30T22:36:01.397 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.135818.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.135818.log.gz 2023-09-30T22:36:01.397 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.145083.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.145083.log.gz 2023-09-30T22:36:01.397 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156783.log 2023-09-30T22:36:01.397 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179008.log 2023-09-30T22:36:01.398 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.156783.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.156783.log.gz 2023-09-30T22:36:01.398 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.179008.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.179008.log.gz 2023-09-30T22:36:01.398 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147166.log 2023-09-30T22:36:01.398 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189845.log 2023-09-30T22:36:01.398 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.147166.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.147166.log.gz 2023-09-30T22:36:01.398 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.189845.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.189845.log.gz 2023-09-30T22:36:01.398 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174684.log 2023-09-30T22:36:01.399 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162888.log 2023-09-30T22:36:01.399 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.174684.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.174684.log.gz 2023-09-30T22:36:01.399 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.162888.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.162888.log.gz 2023-09-30T22:36:01.399 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129780.log 2023-09-30T22:36:01.399 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195258.log 2023-09-30T22:36:01.399 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.129780.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.129780.log.gz 2023-09-30T22:36:01.399 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.195258.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.195258.log.gz 2023-09-30T22:36:01.399 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175711.log 2023-09-30T22:36:01.400 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192197.log 2023-09-30T22:36:01.400 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.175711.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.175711.log.gz 2023-09-30T22:36:01.400 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.192197.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.192197.log.gz 2023-09-30T22:36:01.400 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163254.log 2023-09-30T22:36:01.400 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148099.log 2023-09-30T22:36:01.400 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.163254.log: /var/log/ceph/ceph-client.admin.148099.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.163254.log.gz 2023-09-30T22:36:01.400 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.148099.log.gz 2023-09-30T22:36:01.400 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194829.log 2023-09-30T22:36:01.401 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136604.log 2023-09-30T22:36:01.401 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.194829.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.194829.log.gz 2023-09-30T22:36:01.401 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.136604.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.136604.log.gz 2023-09-30T22:36:01.401 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157737.log 2023-09-30T22:36:01.401 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182400.log 2023-09-30T22:36:01.401 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.157737.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.157737.log.gz 2023-09-30T22:36:01.401 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.182400.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.182400.log.gz 2023-09-30T22:36:01.401 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169928.log 2023-09-30T22:36:01.402 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162723.log 2023-09-30T22:36:01.402 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.169928.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.169928.log.gz 2023-09-30T22:36:01.402 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.162723.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.162723.log.gz 2023-09-30T22:36:01.402 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156954.log 2023-09-30T22:36:01.402 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143591.log 2023-09-30T22:36:01.402 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.156954.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.156954.log.gz 2023-09-30T22:36:01.402 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.143591.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.143591.log.gz 2023-09-30T22:36:01.402 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178756.log 2023-09-30T22:36:01.403 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153673.log 2023-09-30T22:36:01.403 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.178756.log: /var/log/ceph/ceph-client.admin.153673.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.178756.log.gz 2023-09-30T22:36:01.403 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.153673.log.gz 2023-09-30T22:36:01.403 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152105.log 2023-09-30T22:36:01.403 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168156.log 2023-09-30T22:36:01.403 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.152105.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.152105.log.gz 2023-09-30T22:36:01.403 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.168156.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.168156.log.gz 2023-09-30T22:36:01.404 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148760.log 2023-09-30T22:36:01.404 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148395.log 2023-09-30T22:36:01.404 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.148760.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.148760.log.gz 2023-09-30T22:36:01.404 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.148395.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.148395.log.gz 2023-09-30T22:36:01.404 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136801.log 2023-09-30T22:36:01.404 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159737.log 2023-09-30T22:36:01.404 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.136801.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.136801.log.gz 2023-09-30T22:36:01.405 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.159737.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.159737.log.gz 2023-09-30T22:36:01.405 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172672.log 2023-09-30T22:36:01.405 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176300.log 2023-09-30T22:36:01.405 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.172672.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.172672.log.gz 2023-09-30T22:36:01.405 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.176300.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.176300.log.gz 2023-09-30T22:36:01.405 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183931.log 2023-09-30T22:36:01.405 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172369.log 2023-09-30T22:36:01.405 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.183931.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.183931.log.gz 2023-09-30T22:36:01.406 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.172369.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.172369.log.gz 2023-09-30T22:36:01.406 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150353.log 2023-09-30T22:36:01.406 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152811.log 2023-09-30T22:36:01.406 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.150353.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.150353.log.gz 2023-09-30T22:36:01.406 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.152811.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.152811.log.gz 2023-09-30T22:36:01.406 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-09-30T22:36:01.406 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194387.log 2023-09-30T22:36:01.406 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.194387.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.194387.log.gz 2023-09-30T22:36:01.407 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127693.log 2023-09-30T22:36:01.407 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.127693.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.127693.log.gz 2023-09-30T22:36:01.407 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188274.log 2023-09-30T22:36:01.407 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150942.log 2023-09-30T22:36:01.407 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.188274.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.188274.log.gz 2023-09-30T22:36:01.407 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.150942.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.150942.log.gz 2023-09-30T22:36:01.407 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188325.log 2023-09-30T22:36:01.407 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195552.log 2023-09-30T22:36:01.408 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.188325.log: /var/log/ceph/ceph-client.admin.195552.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.188325.log.gz 2023-09-30T22:36:01.408 INFO:teuthology.orchestra.run.smithi040.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.195552.log.gz 2023-09-30T22:36:01.408 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124694.log 2023-09-30T22:36:01.408 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.124694.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.124694.log.gz 2023-09-30T22:36:01.408 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172987.log 2023-09-30T22:36:01.408 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129731.log 2023-09-30T22:36:01.408 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.172987.log: /var/log/ceph/ceph-client.admin.129731.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.172987.log.gz 2023-09-30T22:36:01.408 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.129731.log.gz 2023-09-30T22:36:01.409 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153477.log 2023-09-30T22:36:01.409 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159939.log 2023-09-30T22:36:01.409 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.153477.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.153477.log.gz 2023-09-30T22:36:01.412 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.159939.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.159939.log.gz 2023-09-30T22:36:01.412 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147584.log 2023-09-30T22:36:01.412 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.147584.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.147584.log.gz 2023-09-30T22:36:01.412 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128227.log 2023-09-30T22:36:01.413 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.128227.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.128227.log.gz 2023-09-30T22:36:01.413 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147707.log 2023-09-30T22:36:01.413 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.147707.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.147707.log.gz 2023-09-30T22:36:01.413 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151734.log 2023-09-30T22:36:01.413 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.151734.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.151734.log.gz 2023-09-30T22:36:01.413 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123981.log 2023-09-30T22:36:01.413 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.123981.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.123981.log.gz 2023-09-30T22:36:01.413 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146996.log 2023-09-30T22:36:01.414 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.146996.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.146996.log.gz 2023-09-30T22:36:01.414 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142676.log 2023-09-30T22:36:01.414 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.142676.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.142676.log.gz 2023-09-30T22:36:01.414 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189138.log 2023-09-30T22:36:01.414 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.189138.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.189138.log.gz 2023-09-30T22:36:01.414 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154065.log 2023-09-30T22:36:01.414 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.154065.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.154065.log.gz 2023-09-30T22:36:01.415 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174928.log 2023-09-30T22:36:01.415 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.174928.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.174928.log.gz 2023-09-30T22:36:01.415 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129682.log 2023-09-30T22:36:01.415 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.129682.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.129682.log.gz 2023-09-30T22:36:01.415 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135988.log 2023-09-30T22:36:01.415 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.135988.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.135988.log.gz 2023-09-30T22:36:01.415 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188522.log 2023-09-30T22:36:01.415 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.188522.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.188522.log.gz 2023-09-30T22:36:01.416 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177068.log 2023-09-30T22:36:01.416 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.177068.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.177068.log.gz 2023-09-30T22:36:01.416 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164383.log 2023-09-30T22:36:01.416 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.164383.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.164383.log.gz 2023-09-30T22:36:01.416 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187712.log 2023-09-30T22:36:01.416 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.187712.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.187712.log.gz 2023-09-30T22:36:01.416 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184762.log 2023-09-30T22:36:01.416 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.184762.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.184762.log.gz 2023-09-30T22:36:01.417 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155555.log 2023-09-30T22:36:01.417 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.155555.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.155555.log.gz 2023-09-30T22:36:01.417 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161713.log 2023-09-30T22:36:01.417 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145402.log 2023-09-30T22:36:01.417 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.161713.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.161713.log.gz 2023-09-30T22:36:01.417 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.145402.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.145402.log.gz 2023-09-30T22:36:01.417 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150503.log 2023-09-30T22:36:01.417 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125255.log 2023-09-30T22:36:01.418 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.150503.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.150503.log.gz 2023-09-30T22:36:01.418 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.125255.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.125255.log.gz 2023-09-30T22:36:01.418 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153817.log 2023-09-30T22:36:01.418 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.153817.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.153817.log.gz 2023-09-30T22:36:01.418 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145429.log 2023-09-30T22:36:01.418 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.145429.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.145429.log.gz 2023-09-30T22:36:01.418 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161639.log 2023-09-30T22:36:01.418 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191295.log 2023-09-30T22:36:01.419 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.161639.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.161639.log.gz 2023-09-30T22:36:01.419 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.191295.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.191295.log.gz 2023-09-30T22:36:01.419 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190141.log 2023-09-30T22:36:01.420 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.190141.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.190141.log.gz 2023-09-30T22:36:01.420 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147803.log 2023-09-30T22:36:01.420 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.147803.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.147803.log.gz 2023-09-30T22:36:01.420 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123526.log 2023-09-30T22:36:01.420 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.123526.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.123526.log.gz 2023-09-30T22:36:01.421 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186732.log 2023-09-30T22:36:01.421 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.186732.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.186732.log.gz 2023-09-30T22:36:01.421 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154013.log 2023-09-30T22:36:01.421 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.154013.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.154013.log.gz 2023-09-30T22:36:01.421 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168629.log 2023-09-30T22:36:01.421 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.168629.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.168629.log.gz 2023-09-30T22:36:01.421 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188666.log 2023-09-30T22:36:01.422 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.188666.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.188666.log.gz 2023-09-30T22:36:01.422 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166418.log 2023-09-30T22:36:01.422 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.166418.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.166418.log.gz 2023-09-30T22:36:01.422 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191268.log 2023-09-30T22:36:01.423 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.191268.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.191268.log.gz 2023-09-30T22:36:01.423 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176104.log 2023-09-30T22:36:01.423 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.176104.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.176104.log.gz 2023-09-30T22:36:01.423 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155065.log 2023-09-30T22:36:01.424 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.155065.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.155065.log.gz 2023-09-30T22:36:01.425 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140055.log 2023-09-30T22:36:01.425 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.140055.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.140055.log.gz 2023-09-30T22:36:01.426 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144301.log 2023-09-30T22:36:01.426 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.144301.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.144301.log.gz 2023-09-30T22:36:01.427 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123281.log 2023-09-30T22:36:01.428 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.123281.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.123281.log.gz 2023-09-30T22:36:01.428 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161051.log 2023-09-30T22:36:01.429 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.161051.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.161051.log.gz 2023-09-30T22:36:01.429 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191857.log 2023-09-30T22:36:01.430 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.191857.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.191857.log.gz 2023-09-30T22:36:01.430 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140102.log 2023-09-30T22:36:01.431 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.140102.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.140102.log.gz 2023-09-30T22:36:01.431 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138683.log 2023-09-30T22:36:01.432 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.138683.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.138683.log.gz 2023-09-30T22:36:01.432 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138730.log 2023-09-30T22:36:01.433 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.138730.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.138730.log.gz 2023-09-30T22:36:01.433 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161247.log 2023-09-30T22:36:01.434 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.161247.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.161247.log.gz 2023-09-30T22:36:01.434 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161369.log 2023-09-30T22:36:01.435 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.161369.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.161369.log.gz 2023-09-30T22:36:01.435 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188219.log 2023-09-30T22:36:01.436 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.188219.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.188219.log.gz 2023-09-30T22:36:01.436 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175860.log 2023-09-30T22:36:01.437 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185303.log 2023-09-30T22:36:01.438 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.175860.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.175860.log.gz 2023-09-30T22:36:01.438 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.185303.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.185303.log.gz 2023-09-30T22:36:01.438 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188496.log 2023-09-30T22:36:01.439 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149693.log 2023-09-30T22:36:01.439 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.188496.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.188496.log.gz 2023-09-30T22:36:01.443 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.149693.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.149693.log.gz 2023-09-30T22:36:01.443 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167202.log 2023-09-30T22:36:01.444 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.167202.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.167202.log.gz 2023-09-30T22:36:01.444 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179621.log 2023-09-30T22:36:01.445 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.179621.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.179621.log.gz 2023-09-30T22:36:01.445 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153282.log 2023-09-30T22:36:01.446 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.153282.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.153282.log.gz 2023-09-30T22:36:01.446 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190533.log 2023-09-30T22:36:01.447 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.190533.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.190533.log.gz 2023-09-30T22:36:01.447 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193472.log 2023-09-30T22:36:01.448 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.193472.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.193472.log.gz 2023-09-30T22:36:01.448 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157150.log 2023-09-30T22:36:01.449 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.157150.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.157150.log.gz 2023-09-30T22:36:01.449 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161835.log 2023-09-30T22:36:01.450 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.161835.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.161835.log.gz 2023-09-30T22:36:01.450 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193007.log 2023-09-30T22:36:01.451 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.193007.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.193007.log.gz 2023-09-30T22:36:01.452 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138560.log 2023-09-30T22:36:01.452 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.138560.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.138560.log.gz 2023-09-30T22:36:01.453 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178612.log 2023-09-30T22:36:01.454 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.178612.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.178612.log.gz 2023-09-30T22:36:01.454 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179252.log 2023-09-30T22:36:01.455 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.179252.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.179252.log.gz 2023-09-30T22:36:01.455 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174070.log 2023-09-30T22:36:01.456 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.174070.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.174070.log.gz 2023-09-30T22:36:01.456 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157777.log 2023-09-30T22:36:01.457 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.157777.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.157777.log.gz 2023-09-30T22:36:01.457 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150122.log 2023-09-30T22:36:01.458 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.150122.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.150122.log.gz 2023-09-30T22:36:01.458 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170712.log 2023-09-30T22:36:01.459 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.170712.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.170712.log.gz 2023-09-30T22:36:01.474 INFO:teuthology.orchestra.run.smithi040.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-09-30T22:36:01.510 INFO:teuthology.orchestra.run.smithi040.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-09-30T22:36:01.516 INFO:teuthology.orchestra.run.smithi040.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-09-30T22:36:01.563 INFO:teuthology.orchestra.run.smithi040.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-09-30T22:36:01.703 INFO:teuthology.orchestra.run.smithi040.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-09-30T22:36:01.812 INFO:teuthology.orchestra.run.smithi040.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-09-30T22:36:01.814 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-09-30T22:36:01.814 INFO:teuthology.orchestra.run.smithi040.stderr:real 0m1.076s 2023-09-30T22:36:01.814 INFO:teuthology.orchestra.run.smithi040.stderr:user 0m4.075s 2023-09-30T22:36:01.814 INFO:teuthology.orchestra.run.smithi040.stderr:sys 0m0.839s 2023-09-30T22:36:01.814 INFO:tasks.ceph:Archiving logs... 2023-09-30T22:36:01.815 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/log/ceph to /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408039/remote/smithi040/log 2023-09-30T22:36:01.816 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-30T22:36:03.394 DEBUG:teuthology.misc:Transferring archived files from smithi158:/var/log/ceph to /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408039/remote/smithi158/log 2023-09-30T22:36:03.395 DEBUG:teuthology.orchestra.run.smithi158:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-30T22:36:03.472 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi040 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-09-30T22:36:03.483 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-09-30T22:36:03.500 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi040 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-09-30T22:36:03.505 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-09-30T22:36:03.505 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-30T22:36:03.511 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-30T22:36:03.631 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-09-30T22:36:03.643 INFO:teuthology.task.clock:Checking final clock skew... 2023-09-30T22:36:03.643 DEBUG:teuthology.orchestra.run.smithi040:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T22:36:03.646 DEBUG:teuthology.orchestra.run.smithi158:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T22:36:03.664 INFO:teuthology.orchestra.run.smithi040.stderr:bash: ntpq: command not found 2023-09-30T22:36:03.669 INFO:teuthology.orchestra.run.smithi040.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-30T22:36:03.669 INFO:teuthology.orchestra.run.smithi040.stdout:=============================================================================== 2023-09-30T22:36:03.670 INFO:teuthology.orchestra.run.smithi040.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 40 +14us[ +14us] +/- 76ms 2023-09-30T22:36:03.670 INFO:teuthology.orchestra.run.smithi040.stdout:^* hv02.front.sepia.ceph.com 3 6 377 41 -386us[ -383us] +/- 56ms 2023-09-30T22:36:03.670 INFO:teuthology.orchestra.run.smithi040.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 40 +806us[ +806us] +/- 90ms 2023-09-30T22:36:03.670 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:36:03.690 INFO:teuthology.orchestra.run.smithi158.stderr:bash: ntpq: command not found 2023-09-30T22:36:03.698 INFO:teuthology.orchestra.run.smithi158.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-30T22:36:03.698 INFO:teuthology.orchestra.run.smithi158.stdout:=============================================================================== 2023-09-30T22:36:03.698 INFO:teuthology.orchestra.run.smithi158.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 41 -37us[ -29us] +/- 76ms 2023-09-30T22:36:03.699 INFO:teuthology.orchestra.run.smithi158.stdout:^* hv02.front.sepia.ceph.com 3 6 377 39 -429us[ -421us] +/- 56ms 2023-09-30T22:36:03.699 INFO:teuthology.orchestra.run.smithi158.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 39 +761us[ +761us] +/- 90ms 2023-09-30T22:36:03.699 INFO:teuthology.orchestra.run.smithi158.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:36:03.700 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-09-30T22:36:03.722 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-09-30T22:36:03.723 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-09-30T22:36:03.755 DEBUG:teuthology.orchestra.run.smithi040:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-09-30T22:36:03.808 DEBUG:teuthology.orchestra.run.smithi158:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-09-30T22:36:03.974 DEBUG:teuthology.orchestra.run.smithi040:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-30T22:36:04.007 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:36:04.007 DEBUG:teuthology.orchestra.run.smithi158:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-30T22:36:04.082 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:36:04.083 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-09-30T22:36:04.097 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-09-30T22:36:04.146 INFO:teuthology.task.internal:Duration was 1635.451199 seconds 2023-09-30T22:36:04.147 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-09-30T22:36:04.202 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-09-30T22:36:04.203 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-30T22:36:04.205 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-30T22:36:04.259 INFO:teuthology.orchestra.run.smithi040.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-30T22:36:04.323 INFO:teuthology.orchestra.run.smithi158.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-30T22:36:04.686 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-09-30T22:36:04.686 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi040.front.sepia.ceph.com 2023-09-30T22:36:04.686 DEBUG:teuthology.orchestra.run.smithi040:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-30T22:36:04.715 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi158.front.sepia.ceph.com 2023-09-30T22:36:04.715 DEBUG:teuthology.orchestra.run.smithi158:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-30T22:36:04.777 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-09-30T22:36:04.777 DEBUG:teuthology.orchestra.run.smithi040:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-30T22:36:04.780 DEBUG:teuthology.orchestra.run.smithi158:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-30T22:36:04.863 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-09-30T22:36:04.863 DEBUG:teuthology.orchestra.run.smithi040:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-30T22:36:04.866 DEBUG:teuthology.orchestra.run.smithi158:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-30T22:36:04.979 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-09-30T22:36:04.991 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-09-30T22:36:04.992 DEBUG:teuthology.orchestra.run.smithi040:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-30T22:36:05.021 DEBUG:teuthology.orchestra.run.smithi158:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-30T22:36:05.100 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-09-30T22:36:05.113 DEBUG:teuthology.orchestra.run.smithi040:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-30T22:36:05.115 DEBUG:teuthology.orchestra.run.smithi158:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-30T22:36:05.141 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = core 2023-09-30T22:36:05.184 INFO:teuthology.orchestra.run.smithi158.stdout:kernel.core_pattern = core 2023-09-30T22:36:05.219 DEBUG:teuthology.orchestra.run.smithi040:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-30T22:36:05.238 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi040.front.sepia.ceph.com, flagging run as failed 2023-09-30T22:36:05.238 DEBUG:teuthology.orchestra.run.smithi158:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-30T22:36:05.282 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:36:05.282 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-09-30T22:36:05.296 INFO:teuthology.task.internal:Transferring archived files... 2023-09-30T22:36:05.296 DEBUG:teuthology.misc:Transferring archived files from smithi040:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408039/remote/smithi040 2023-09-30T22:36:05.297 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-30T22:37:35.794 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2023-09-30T22:37:35.805 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408039/remote/smithi040/coredump/1696112692.127432.core.gz: gzip compressed data, was "1696112692.127432.core", last modified: Sat Sep 30 22:36:05 2023, max compression, original size modulo 2^32 1375133696 2023-09-30T22:37:35.805 INFO:teuthology.task.internal:core is compressed, try accessing gzip file ... 2023-09-30T22:37:41.609 INFO:teuthology.task.internal: core looks like: /tmp/tmp86l299vg: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mgr -f --cluster ceph -i x', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mgr', platform: 'x86_64' 2023-09-30T22:37:41.962 INFO:teuthology.task.internal: dump_program: ceph-mgr -f --cluster ceph -i x 2023-09-30T22:37:41.962 DEBUG:teuthology.orchestra.run.smithi040:> which 'ceph-mgr -f --cluster ceph -i x' 2023-09-30T22:37:41.985 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/which: invalid option -- 'f' 2023-09-30T22:37:41.986 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/which: unrecognized option '--cluster' 2023-09-30T22:37:41.987 INFO:teuthology.orchestra.run.smithi040.stderr:/usr/bin/which: no x in (/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin) 2023-09-30T22:37:41.988 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:37:41.988 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph-mgr 2023-09-30T22:37:41.988 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph 2023-09-30T22:37:41.989 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 392, in archive yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi040 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 96, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi040 with status 1: "which 'ceph-mgr -f --cluster ceph -i x'" 2023-09-30T22:37:42.005 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-09-30T22:37:42.017 INFO:teuthology.task.internal:Not uploading archives. 2023-09-30T22:37:42.017 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-09-30T22:37:42.054 INFO:teuthology.task.internal:Tidying up after the test... 2023-09-30T22:37:42.054 DEBUG:teuthology.orchestra.run.smithi040:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-30T22:37:42.069 DEBUG:teuthology.orchestra.run.smithi158:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-30T22:37:42.081 INFO:teuthology.orchestra.run.smithi040.stdout: 393229 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 30 22:36 /home/ubuntu/cephtest 2023-09-30T22:37:42.082 INFO:teuthology.orchestra.run.smithi040.stdout: 393230 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Sep 30 22:36 /home/ubuntu/cephtest/archive 2023-09-30T22:37:42.082 INFO:teuthology.orchestra.run.smithi040.stdout: 393231 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 30 22:24 /home/ubuntu/cephtest/archive/coredump 2023-09-30T22:37:42.082 INFO:teuthology.orchestra.run.smithi040.stdout: 393461 372900 -rw------- 1 root root 1375133696 Sep 30 22:24 /home/ubuntu/cephtest/archive/coredump/1696112692.127432.core 2023-09-30T22:37:42.082 INFO:teuthology.orchestra.run.smithi040.stdout: 393425 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Sep 30 22:36 /home/ubuntu/cephtest/archive/audit 2023-09-30T22:37:42.082 INFO:teuthology.orchestra.run.smithi040.stdout: 393427 28 -rw------- 1 ubuntu ubuntu 25093 Sep 30 22:36 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2023-09-30T22:37:42.082 INFO:teuthology.orchestra.run.smithi040.stdout: 393232 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 30 22:36 /home/ubuntu/cephtest/archive/syslog 2023-09-30T22:37:42.082 INFO:teuthology.orchestra.run.smithi040.stdout: 393426 4 -rw-rw-rw- 1 ubuntu ubuntu 777 Sep 30 22:35 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-09-30T22:37:42.082 INFO:teuthology.orchestra.run.smithi040.stdout: 393234 116 -rw-rw-r-- 1 ubuntu ubuntu 115154 Sep 30 22:36 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-30T22:37:42.083 INFO:teuthology.orchestra.run.smithi040.stdout: 393233 132 -rw-rw-rw- 1 ubuntu ubuntu 133459 Sep 30 22:36 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-09-30T22:37:42.083 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:37:42.084 INFO:teuthology.orchestra.run.smithi040.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-09-30T22:37:42.084 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi040 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi040 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-09-30T22:37:42.095 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-09-30T22:37:42.107 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-09-30T22:37:42.130 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi040 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-09-30T22:37:42.131 INFO:teuthology.nuke:Checking targets against current locks 2023-09-30T22:37:42.138 INFO:teuthology.orchestra.run.smithi158.stdout: 524301 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 30 22:36 /home/ubuntu/cephtest 2023-09-30T22:37:42.138 INFO:teuthology.orchestra.run.smithi158.stdout: 524302 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Sep 30 22:36 /home/ubuntu/cephtest/archive 2023-09-30T22:37:42.139 INFO:teuthology.orchestra.run.smithi158.stdout: 524440 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Sep 30 22:36 /home/ubuntu/cephtest/archive/audit 2023-09-30T22:37:42.139 INFO:teuthology.orchestra.run.smithi158.stdout: 524514 224 -rw------- 1 ubuntu ubuntu 227376 Sep 30 22:36 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2023-09-30T22:37:42.139 INFO:teuthology.orchestra.run.smithi158.stdout: 524304 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 30 22:36 /home/ubuntu/cephtest/archive/syslog 2023-09-30T22:37:42.139 INFO:teuthology.orchestra.run.smithi158.stdout: 524513 4 -rw-rw-rw- 1 ubuntu ubuntu 3256 Sep 30 22:33 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-09-30T22:37:42.139 INFO:teuthology.orchestra.run.smithi158.stdout: 524306 92 -rw-rw-r-- 1 ubuntu ubuntu 93732 Sep 30 22:36 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-30T22:37:42.139 INFO:teuthology.orchestra.run.smithi158.stdout: 524305 88 -rw-rw-rw- 1 ubuntu ubuntu 87029 Sep 30 22:36 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-09-30T22:37:42.140 INFO:teuthology.orchestra.run.smithi158.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-09-30T22:37:42.165 DEBUG:teuthology.nuke:shortname: smithi040 2023-09-30T22:37:42.165 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-30T22:37:42.190 DEBUG:teuthology.nuke:shortname: smithi158 2023-09-30T22:37:42.191 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-30T22:37:42.194 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408039', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 21:58:22.084654', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFqbonTGVhhSgPKdc3WgRKBJoXF6R9MoCundAIPrMI7XrrWDWgs5ddn0zAdLfSW36DtX6AUqZS0/w0Us6Btu74E='} 2023-09-30T22:37:42.219 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi158.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408039', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 21:58:22.083050', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLxpTz0DsyBfPSCTqvRHySCxYwvLwOg+AjBFPHdLqxnAj6QEHJ13IdTerhOmu22y+fNeVavBgZTsLqlvCCQOpEY='} 2023-09-30T22:37:42.244 INFO:teuthology.orchestra.console.smithi040:Power off 2023-09-30T22:37:42.244 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-30T22:37:42.269 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off 2023-09-30T22:37:42.270 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T22:37:42.288 INFO:teuthology.orchestra.console.smithi158:Power off 2023-09-30T22:37:42.288 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-30T22:37:42.298 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2023-09-30T22:37:42.310 DEBUG:teuthology.orchestra.console.smithi158:power off output: Chassis Power Control: Down/Off 2023-09-30T22:37:42.310 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T22:37:42.332 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on 2023-09-30T22:37:46.299 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T22:37:46.333 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T22:37:46.411 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2023-09-30T22:37:46.443 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on 2023-09-30T22:37:50.414 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T22:37:50.443 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T22:37:50.524 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2023-09-30T22:37:50.553 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off 2023-09-30T22:37:50.626 INFO:teuthology.orchestra.console.smithi040:Power off completed 2023-09-30T22:37:50.654 INFO:teuthology.orchestra.console.smithi158:Power off completed 2023-09-30T22:37:50.760 INFO:teuthology.run:Summary data: client.0-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c description: fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} 2-upgrade 3-workload/new_ops/{0-clients/kclient 1-client-sanity}}} duration: 1635.451199054718 failure_reason: 'Command failed on smithi040 with status 124: ''sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json''' flavor: default owner: scheduled_dparmar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=d13c5f9f650d44d780f094bf1084cdea status: fail success: false 2023-09-30T22:37:50.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T22:37:50.844 INFO:teuthology.run:FAIL